2024-09-15T23:02:29.060 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-15T23:02:29.082 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T23:02:29.172 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906308 branch: squid description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/scrub} email: ceph-qa@ceph.com first_in_suite: false job_id: '7906308' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds cache max size: 1000 mds debug frag: true mds debug scatterstat: true mds log max segments: 1 mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - Replacing daemon mds - Scrub error on inode - Behind on trimming - Metadata damage detected - bad backtrace on inode - overall HEALTH_ - \(MDS_TRIM\) sha1: 8921c8ef947807b717db041d85f0761b7914d5fc ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8921c8ef947807b717db041d85f0761b7914d5fc kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: ad35db06e8924912f01e32b35576297c0f1352b4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 3393 sha1: 8921c8ef947807b717db041d85f0761b7914d5fc sleep_before_teardown: 0 subset: 294/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ad35db06e8924912f01e32b35576297c0f1352b4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi123.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOvJnpUsOVZ9zPfcZHW5oP/s+VQa7H5AGXG1g/Gj1CDStjxoNEp5nlPfyfAW185RldTuuA952H+UL16Jzyteqy0= smithi188.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGF4laCqzvu23hCbchUBbUoREkmElApAuaE4nSM2Megg3fGlIHrP69cKVvGg7yLdtwIRL2HwBBGzn+cXTolD3TA= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_scrub_checks - tasks.cephfs.test_scrub teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-15_21:24:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-15T23:02:29.172 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa; will attempt to use it 2024-09-15T23:02:29.173 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks 2024-09-15T23:02:29.173 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-15T23:02:29.174 INFO:teuthology.task.internal:Checking packages... 2024-09-15T23:02:29.197 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8921c8ef947807b717db041d85f0761b7914d5fc' 2024-09-15T23:02:29.197 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-15T23:02:29.197 INFO:teuthology.packaging:ref: None 2024-09-15T23:02:29.197 INFO:teuthology.packaging:tag: None 2024-09-15T23:02:29.197 INFO:teuthology.packaging:branch: squid 2024-09-15T23:02:29.197 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T23:02:29.197 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-15T23:02:29.427 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-328.gad35db06 2024-09-15T23:02:29.429 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-15T23:02:29.440 INFO:teuthology.task.internal:no buildpackages task found 2024-09-15T23:02:29.440 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-15T23:02:29.457 INFO:teuthology.task.internal:Saving configuration 2024-09-15T23:02:29.477 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-15T23:02:29.489 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-15T23:02:29.515 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906308', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 22:57:31.422118', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOvJnpUsOVZ9zPfcZHW5oP/s+VQa7H5AGXG1g/Gj1CDStjxoNEp5nlPfyfAW185RldTuuA952H+UL16Jzyteqy0='} 2024-09-15T23:02:29.535 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906308', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 22:57:31.423612', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGF4laCqzvu23hCbchUBbUoREkmElApAuaE4nSM2Megg3fGlIHrP69cKVvGg7yLdtwIRL2HwBBGzn+cXTolD3TA='} 2024-09-15T23:02:29.535 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-15T23:02:29.543 INFO:teuthology.task.internal:roles: ubuntu@smithi123.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-15T23:02:29.543 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-15T23:02:29.543 INFO:teuthology.run_tasks:Running task console_log... 2024-09-15T23:02:29.622 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff448353be0>, signals=[15]) 2024-09-15T23:02:29.622 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-15T23:02:29.633 INFO:teuthology.task.internal:Opening connections... 2024-09-15T23:02:29.633 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi123.front.sepia.ceph.com 2024-09-15T23:02:29.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:02:29.712 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi188.front.sepia.ceph.com 2024-09-15T23:02:29.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:02:29.807 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-15T23:02:29.815 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2024-09-15T23:02:29.834 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2024-09-15T23:02:29.835 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2024-09-15T23:02:29.893 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream" 2024-09-15T23:02:29.893 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="9" 2024-09-15T23:02:29.894 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos" 2024-09-15T23:02:29.894 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora" 2024-09-15T23:02:29.894 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="9" 2024-09-15T23:02:29.894 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el9" 2024-09-15T23:02:29.894 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-15T23:02:29.894 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2024-09-15T23:02:29.894 INFO:teuthology.orchestra.run.smithi123.stdout:LOGO="fedora-logo-icon" 2024-09-15T23:02:29.895 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-15T23:02:29.895 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/" 2024-09-15T23:02:29.895 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-15T23:02:29.895 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-15T23:02:29.895 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-15T23:02:29.898 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2024-09-15T23:02:29.918 DEBUG:teuthology.orchestra.run.smithi188:> uname -m 2024-09-15T23:02:29.936 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64 2024-09-15T23:02:29.937 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2024-09-15T23:02:29.994 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream" 2024-09-15T23:02:29.995 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="9" 2024-09-15T23:02:29.995 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos" 2024-09-15T23:02:29.995 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora" 2024-09-15T23:02:29.995 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="9" 2024-09-15T23:02:29.995 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el9" 2024-09-15T23:02:29.995 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-15T23:02:29.995 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2024-09-15T23:02:29.995 INFO:teuthology.orchestra.run.smithi188.stdout:LOGO="fedora-logo-icon" 2024-09-15T23:02:29.995 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-15T23:02:29.995 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/" 2024-09-15T23:02:29.995 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-15T23:02:29.995 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-15T23:02:29.995 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-15T23:02:29.996 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2024-09-15T23:02:30.017 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-15T23:02:30.031 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-15T23:02:30.043 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-15T23:02:30.043 DEBUG:teuthology.orchestra.run.smithi123:> test '!' -e /home/ubuntu/cephtest 2024-09-15T23:02:30.046 DEBUG:teuthology.orchestra.run.smithi188:> test '!' -e /home/ubuntu/cephtest 2024-09-15T23:02:30.062 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-15T23:02:30.073 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-15T23:02:30.073 DEBUG:teuthology.orchestra.run.smithi123:> test -z $(ls -A /var/lib/ceph) 2024-09-15T23:02:30.103 DEBUG:teuthology.orchestra.run.smithi188:> test -z $(ls -A /var/lib/ceph) 2024-09-15T23:02:30.218 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-15T23:02:30.275 INFO:teuthology.run_tasks:Running task kernel... 2024-09-15T23:02:30.295 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-15T23:02:30.295 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-09-15T23:02:30.295 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-09-15T23:02:30.295 DEBUG:teuthology.orchestra.run.smithi123:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T23:02:30.296 DEBUG:teuthology.orchestra.run.smithi188:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T23:02:30.313 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:02:30.313 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:02:30.314 DEBUG:teuthology.orchestra.run.smithi123:> uname -r 2024-09-15T23:02:30.314 DEBUG:teuthology.orchestra.run.smithi188:> uname -r 2024-09-15T23:02:30.371 INFO:teuthology.orchestra.run.smithi188.stdout:5.14.0-503.el9.x86_64 2024-09-15T23:02:30.371 INFO:teuthology.task.kernel:Running kernel on smithi188: 5.14.0-503.el9.x86_64 2024-09-15T23:02:30.371 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum install -y kernel 2024-09-15T23:02:30.372 INFO:teuthology.orchestra.run.smithi123.stdout:5.14.0-503.el9.x86_64 2024-09-15T23:02:30.373 INFO:teuthology.task.kernel:Running kernel on smithi123: 5.14.0-503.el9.x86_64 2024-09-15T23:02:30.373 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum install -y kernel 2024-09-15T23:02:33.143 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - BaseOS 9.1 MB/s | 8.2 MB 00:00 2024-09-15T23:02:33.523 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - BaseOS 6.0 MB/s | 8.2 MB 00:01 2024-09-15T23:02:35.102 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-15T23:02:37.465 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - AppStream 7.2 MB/s | 20 MB 00:02 2024-09-15T23:02:39.420 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-15T23:02:41.187 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 19 kB 00:00 2024-09-15T23:02:41.849 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-15T23:02:42.341 INFO:teuthology.orchestra.run.smithi188.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-15T23:02:43.366 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 19 kB 00:00 2024-09-15T23:02:44.337 INFO:teuthology.orchestra.run.smithi123.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-15T23:02:47.788 INFO:teuthology.orchestra.run.smithi188.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-15T23:02:49.820 INFO:teuthology.orchestra.run.smithi188.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-15T23:02:49.820 INFO:teuthology.orchestra.run.smithi188.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-15T23:02:49.826 INFO:teuthology.orchestra.run.smithi123.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-15T23:02:49.904 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-09-15T23:02:49.908 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-09-15T23:02:49.908 INFO:teuthology.orchestra.run.smithi188.stdout: Package Architecture Version Repository Size 2024-09-15T23:02:49.908 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-09-15T23:02:49.908 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-09-15T23:02:49.908 INFO:teuthology.orchestra.run.smithi188.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-15T23:02:49.908 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2024-09-15T23:02:49.909 INFO:teuthology.orchestra.run.smithi188.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-15T23:02:49.909 INFO:teuthology.orchestra.run.smithi188.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-15T23:02:49.909 INFO:teuthology.orchestra.run.smithi188.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-15T23:02:49.909 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:02:49.909 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-09-15T23:02:49.909 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-09-15T23:02:49.909 INFO:teuthology.orchestra.run.smithi188.stdout:Install 4 Packages 2024-09-15T23:02:49.909 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:02:49.910 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 79 M 2024-09-15T23:02:49.910 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 126 M 2024-09-15T23:02:49.910 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-09-15T23:02:50.148 INFO:teuthology.orchestra.run.smithi188.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 186 kB/s | 23 kB 00:00 2024-09-15T23:02:50.740 INFO:teuthology.orchestra.run.smithi188.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 22 MB/s | 16 MB 00:00 2024-09-15T23:02:51.256 INFO:teuthology.orchestra.run.smithi188.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 28 MB/s | 35 MB 00:01 2024-09-15T23:02:51.791 INFO:teuthology.orchestra.run.smithi123.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-15T23:02:51.791 INFO:teuthology.orchestra.run.smithi123.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-15T23:02:51.869 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-09-15T23:02:51.874 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-09-15T23:02:51.874 INFO:teuthology.orchestra.run.smithi123.stdout: Package Architecture Version Repository Size 2024-09-15T23:02:51.874 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-09-15T23:02:51.874 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-09-15T23:02:51.875 INFO:teuthology.orchestra.run.smithi123.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-15T23:02:51.875 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2024-09-15T23:02:51.875 INFO:teuthology.orchestra.run.smithi123.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-15T23:02:51.875 INFO:teuthology.orchestra.run.smithi123.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-15T23:02:51.875 INFO:teuthology.orchestra.run.smithi123.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-15T23:02:51.875 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:02:51.875 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-09-15T23:02:51.875 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-09-15T23:02:51.876 INFO:teuthology.orchestra.run.smithi123.stdout:Install 4 Packages 2024-09-15T23:02:51.876 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:02:51.876 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 79 M 2024-09-15T23:02:51.877 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 126 M 2024-09-15T23:02:51.877 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-09-15T23:02:51.898 INFO:teuthology.orchestra.run.smithi188.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 16 MB/s | 29 MB 00:01 2024-09-15T23:02:51.898 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-09-15T23:02:51.898 INFO:teuthology.orchestra.run.smithi188.stdout:Total 40 MB/s | 79 MB 00:01 2024-09-15T23:02:52.086 INFO:teuthology.orchestra.run.smithi123.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 140 kB/s | 23 kB 00:00 2024-09-15T23:02:52.576 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-09-15T23:02:52.921 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-09-15T23:02:52.921 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-09-15T23:02:53.869 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-09-15T23:02:53.869 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-09-15T23:02:56.288 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-09-15T23:02:56.419 INFO:teuthology.orchestra.run.smithi123.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 3.5 MB/s | 16 MB 00:04 2024-09-15T23:02:57.010 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-15T23:02:57.101 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T23:02:59.761 INFO:teuthology.orchestra.run.smithi123.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 4.4 MB/s | 35 MB 00:07 2024-09-15T23:02:59.895 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T23:03:00.027 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T23:03:00.594 INFO:teuthology.orchestra.run.smithi123.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 3.4 MB/s | 29 MB 00:08 2024-09-15T23:03:00.594 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-09-15T23:03:00.594 INFO:teuthology.orchestra.run.smithi123.stdout:Total 9.0 MB/s | 79 MB 00:08 2024-09-15T23:03:01.270 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-09-15T23:03:01.628 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-09-15T23:03:01.628 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-09-15T23:03:02.561 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-09-15T23:03:02.561 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-09-15T23:03:04.859 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T23:03:04.951 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T23:03:04.999 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-09-15T23:03:05.709 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-15T23:03:05.794 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T23:03:08.586 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T23:03:08.722 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T23:03:09.777 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T23:03:13.539 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T23:03:13.664 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T23:03:18.522 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T23:03:48.005 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T23:03:48.045 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-15T23:03:48.350 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T23:03:48.350 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-15T23:03:48.350 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T23:03:48.350 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T23:03:49.165 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T23:03:49.165 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:03:49.165 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-09-15T23:03:49.166 INFO:teuthology.orchestra.run.smithi188.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-15T23:03:49.166 INFO:teuthology.orchestra.run.smithi188.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-15T23:03:49.166 INFO:teuthology.orchestra.run.smithi188.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-15T23:03:49.166 INFO:teuthology.orchestra.run.smithi188.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-15T23:03:49.166 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:03:49.166 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-09-15T23:03:49.510 DEBUG:teuthology.orchestra.run.smithi188:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T23:03:49.601 INFO:teuthology.orchestra.run.smithi188.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T23:03:49.602 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T23:03:49.602 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-15T23:03:49.602 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-15T23:03:49.602 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-15T23:03:49.602 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-09-15T23:03:49.602 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi188.front.sepia.ceph.com, path=None, version=distro) 2024-09-15T23:03:49.602 DEBUG:teuthology.orchestra.run.smithi188:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T23:03:49.662 INFO:teuthology.orchestra.run.smithi188.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T23:03:49.662 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T23:03:49.663 DEBUG:teuthology.orchestra.run.smithi188:> sudo rpm -qi grub2-tools 2024-09-15T23:03:49.705 INFO:teuthology.orchestra.run.smithi188.stdout:Name : grub2-tools 2024-09-15T23:03:49.705 INFO:teuthology.orchestra.run.smithi188.stdout:Epoch : 1 2024-09-15T23:03:49.705 INFO:teuthology.orchestra.run.smithi188.stdout:Version : 2.06 2024-09-15T23:03:49.706 INFO:teuthology.orchestra.run.smithi188.stdout:Release : 82.el9 2024-09-15T23:03:49.706 INFO:teuthology.orchestra.run.smithi188.stdout:Architecture: x86_64 2024-09-15T23:03:49.706 INFO:teuthology.orchestra.run.smithi188.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-15T23:03:49.706 INFO:teuthology.orchestra.run.smithi188.stdout:Group : Unspecified 2024-09-15T23:03:49.706 INFO:teuthology.orchestra.run.smithi188.stdout:Size : 8274670 2024-09-15T23:03:49.706 INFO:teuthology.orchestra.run.smithi188.stdout:License : GPLv3+ 2024-09-15T23:03:49.706 INFO:teuthology.orchestra.run.smithi188.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-15T23:03:49.707 INFO:teuthology.orchestra.run.smithi188.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-15T23:03:49.707 INFO:teuthology.orchestra.run.smithi188.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-15T23:03:49.707 INFO:teuthology.orchestra.run.smithi188.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-15T23:03:49.707 INFO:teuthology.orchestra.run.smithi188.stdout:Packager : builder@centos.org 2024-09-15T23:03:49.707 INFO:teuthology.orchestra.run.smithi188.stdout:Vendor : CentOS 2024-09-15T23:03:49.707 INFO:teuthology.orchestra.run.smithi188.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-15T23:03:49.707 INFO:teuthology.orchestra.run.smithi188.stdout:Summary : Support tools for GRUB. 2024-09-15T23:03:49.708 INFO:teuthology.orchestra.run.smithi188.stdout:Description : 2024-09-15T23:03:49.708 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:03:49.708 INFO:teuthology.orchestra.run.smithi188.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-15T23:03:49.708 INFO:teuthology.orchestra.run.smithi188.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-15T23:03:49.708 INFO:teuthology.orchestra.run.smithi188.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-15T23:03:49.708 INFO:teuthology.orchestra.run.smithi188.stdout:hardware devices. 2024-09-15T23:03:49.708 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:03:49.708 INFO:teuthology.orchestra.run.smithi188.stdout:This subpackage provides tools for support of all platforms. 2024-09-15T23:03:49.709 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-15T23:03:49.709 INFO:teuthology.task.kernel:Updating grub on smithi188 to boot 5.14.0-505.el9.x86_64 2024-09-15T23:03:49.710 DEBUG:teuthology.orchestra.run.smithi188:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-15T23:03:50.381 INFO:teuthology.orchestra.run.smithi188.stderr:Generating grub configuration file ... 2024-09-15T23:03:51.784 INFO:teuthology.orchestra.run.smithi188.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-15T23:03:51.812 INFO:teuthology.orchestra.run.smithi188.stderr:done 2024-09-15T23:03:51.814 DEBUG:teuthology.orchestra.run.smithi188:> mktemp 2024-09-15T23:03:51.829 INFO:teuthology.orchestra.run.smithi188.stdout:/tmp/tmp.Nnpwea1NWB 2024-09-15T23:03:51.830 DEBUG:teuthology.orchestra.run.smithi188:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Nnpwea1NWB 2024-09-15T23:03:51.896 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 0666 /tmp/tmp.Nnpwea1NWB 2024-09-15T23:03:52.029 DEBUG:teuthology.orchestra.remote:smithi188:/tmp/tmp.Nnpwea1NWB is 6KB 2024-09-15T23:03:52.077 DEBUG:teuthology.orchestra.run.smithi188:> rm -fr /tmp/tmp.Nnpwea1NWB 2024-09-15T23:03:52.094 DEBUG:teuthology.orchestra.run.smithi188:> sudo /bin/ls /boot/loader/entries || true 2024-09-15T23:03:52.155 INFO:teuthology.orchestra.run.smithi188.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-15T23:03:52.155 INFO:teuthology.orchestra.run.smithi188.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-15T23:03:52.156 INFO:teuthology.orchestra.run.smithi188.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-15T23:03:52.156 INFO:teuthology.orchestra.run.smithi188.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-15T23:03:52.157 DEBUG:teuthology.orchestra.run.smithi188:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-15T23:03:52.323 DEBUG:teuthology.orchestra.run.smithi188:> sudo shutdown -r now 2024-09-15T23:03:56.806 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T23:03:56.845 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-15T23:03:57.180 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T23:03:57.181 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-15T23:03:57.181 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T23:03:57.181 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T23:03:58.017 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T23:03:58.017 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:03:58.017 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-09-15T23:03:58.018 INFO:teuthology.orchestra.run.smithi123.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-15T23:03:58.018 INFO:teuthology.orchestra.run.smithi123.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-15T23:03:58.018 INFO:teuthology.orchestra.run.smithi123.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-15T23:03:58.018 INFO:teuthology.orchestra.run.smithi123.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-15T23:03:58.018 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:03:58.018 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-09-15T23:03:58.391 DEBUG:teuthology.orchestra.run.smithi123:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T23:03:58.471 INFO:teuthology.orchestra.run.smithi123.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T23:03:58.471 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T23:03:58.471 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-15T23:03:58.471 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-15T23:03:58.472 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-15T23:03:58.472 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-15T23:03:58.472 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi123.front.sepia.ceph.com, path=None, version=distro) 2024-09-15T23:03:58.472 DEBUG:teuthology.orchestra.run.smithi123:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T23:03:58.530 INFO:teuthology.orchestra.run.smithi123.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T23:03:58.531 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T23:03:58.531 DEBUG:teuthology.orchestra.run.smithi123:> sudo rpm -qi grub2-tools 2024-09-15T23:03:58.565 INFO:teuthology.orchestra.run.smithi123.stdout:Name : grub2-tools 2024-09-15T23:03:58.565 INFO:teuthology.orchestra.run.smithi123.stdout:Epoch : 1 2024-09-15T23:03:58.565 INFO:teuthology.orchestra.run.smithi123.stdout:Version : 2.06 2024-09-15T23:03:58.565 INFO:teuthology.orchestra.run.smithi123.stdout:Release : 82.el9 2024-09-15T23:03:58.565 INFO:teuthology.orchestra.run.smithi123.stdout:Architecture: x86_64 2024-09-15T23:03:58.565 INFO:teuthology.orchestra.run.smithi123.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-15T23:03:58.565 INFO:teuthology.orchestra.run.smithi123.stdout:Group : Unspecified 2024-09-15T23:03:58.565 INFO:teuthology.orchestra.run.smithi123.stdout:Size : 8274670 2024-09-15T23:03:58.565 INFO:teuthology.orchestra.run.smithi123.stdout:License : GPLv3+ 2024-09-15T23:03:58.565 INFO:teuthology.orchestra.run.smithi123.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-15T23:03:58.565 INFO:teuthology.orchestra.run.smithi123.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-15T23:03:58.566 INFO:teuthology.orchestra.run.smithi123.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-15T23:03:58.566 INFO:teuthology.orchestra.run.smithi123.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-15T23:03:58.566 INFO:teuthology.orchestra.run.smithi123.stdout:Packager : builder@centos.org 2024-09-15T23:03:58.566 INFO:teuthology.orchestra.run.smithi123.stdout:Vendor : CentOS 2024-09-15T23:03:58.566 INFO:teuthology.orchestra.run.smithi123.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-15T23:03:58.566 INFO:teuthology.orchestra.run.smithi123.stdout:Summary : Support tools for GRUB. 2024-09-15T23:03:58.566 INFO:teuthology.orchestra.run.smithi123.stdout:Description : 2024-09-15T23:03:58.566 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:03:58.566 INFO:teuthology.orchestra.run.smithi123.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-15T23:03:58.566 INFO:teuthology.orchestra.run.smithi123.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-15T23:03:58.566 INFO:teuthology.orchestra.run.smithi123.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-15T23:03:58.566 INFO:teuthology.orchestra.run.smithi123.stdout:hardware devices. 2024-09-15T23:03:58.566 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:03:58.566 INFO:teuthology.orchestra.run.smithi123.stdout:This subpackage provides tools for support of all platforms. 2024-09-15T23:03:58.567 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-15T23:03:58.567 INFO:teuthology.task.kernel:Updating grub on smithi123 to boot 5.14.0-505.el9.x86_64 2024-09-15T23:03:58.568 DEBUG:teuthology.orchestra.run.smithi123:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-15T23:03:59.254 INFO:teuthology.orchestra.run.smithi123.stderr:Generating grub configuration file ... 2024-09-15T23:04:00.555 INFO:teuthology.orchestra.run.smithi123.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-15T23:04:00.600 INFO:teuthology.orchestra.run.smithi123.stderr:done 2024-09-15T23:04:00.602 DEBUG:teuthology.orchestra.run.smithi123:> mktemp 2024-09-15T23:04:00.625 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/tmp.YKsdxU0wVc 2024-09-15T23:04:00.625 DEBUG:teuthology.orchestra.run.smithi123:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.YKsdxU0wVc 2024-09-15T23:04:00.696 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0666 /tmp/tmp.YKsdxU0wVc 2024-09-15T23:04:00.837 DEBUG:teuthology.orchestra.remote:smithi123:/tmp/tmp.YKsdxU0wVc is 6KB 2024-09-15T23:04:00.892 DEBUG:teuthology.orchestra.run.smithi123:> rm -fr /tmp/tmp.YKsdxU0wVc 2024-09-15T23:04:00.908 DEBUG:teuthology.orchestra.run.smithi123:> sudo /bin/ls /boot/loader/entries || true 2024-09-15T23:04:00.970 INFO:teuthology.orchestra.run.smithi123.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-15T23:04:00.970 INFO:teuthology.orchestra.run.smithi123.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-15T23:04:00.970 INFO:teuthology.orchestra.run.smithi123.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-15T23:04:00.970 INFO:teuthology.orchestra.run.smithi123.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-15T23:04:00.972 DEBUG:teuthology.orchestra.run.smithi123:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-15T23:04:01.122 DEBUG:teuthology.orchestra.run.smithi123:> sudo shutdown -r now 2024-09-15T23:04:22.345 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-15T23:04:22.346 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-09-15T23:04:22.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:04:31.133 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-15T23:04:31.133 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-09-15T23:04:31.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:05:05.601 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2024-09-15T23:05:14.609 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-09-15T23:05:14.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:05:22.354 DEBUG:teuthology.orchestra.remote:timed out 2024-09-15T23:05:31.364 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-09-15T23:05:31.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:05:31.762 DEBUG:teuthology.orchestra.run.smithi188:> true 2024-09-15T23:05:32.127 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-09-15T23:05:32.127 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-505.el9.x86_64"... 2024-09-15T23:05:32.127 DEBUG:teuthology.orchestra.run.smithi188:> uname -r 2024-09-15T23:05:32.142 INFO:teuthology.orchestra.run.smithi188.stdout:5.14.0-505.el9.x86_64 2024-09-15T23:05:32.142 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-15T23:05:32.142 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-15T23:05:32.143 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-15T23:05:32.989 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2024-09-15T23:05:33.144 DEBUG:teuthology.parallel:result is None 2024-09-15T23:05:44.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-09-15T23:05:44.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:05:45.437 DEBUG:teuthology.orchestra.run.smithi123:> true 2024-09-15T23:05:45.840 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-09-15T23:05:45.840 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-15T23:05:45.841 DEBUG:teuthology.orchestra.run.smithi123:> uname -r 2024-09-15T23:05:45.855 INFO:teuthology.orchestra.run.smithi123.stdout:5.14.0-505.el9.x86_64 2024-09-15T23:05:45.856 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-15T23:05:45.856 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-15T23:05:45.856 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-15T23:05:46.857 DEBUG:teuthology.parallel:result is None 2024-09-15T23:05:46.857 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-15T23:05:46.864 INFO:teuthology.task.internal:Creating test directory... 2024-09-15T23:05:46.865 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T23:05:46.867 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T23:05:46.888 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-15T23:05:46.905 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-15T23:05:46.914 INFO:teuthology.task.internal:Creating archive directory... 2024-09-15T23:05:46.914 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T23:05:46.922 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T23:05:46.956 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-15T23:05:46.963 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-15T23:05:46.964 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T23:05:46.977 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T23:05:47.091 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T23:05:47.096 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T23:05:47.110 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T23:05:47.133 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T23:05:47.134 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-15T23:05:47.141 INFO:teuthology.task.internal:Configuring sudo... 2024-09-15T23:05:47.142 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T23:05:47.144 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T23:05:47.171 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-15T23:05:47.180 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-15T23:05:47.180 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T23:05:47.210 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T23:05:47.228 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T23:05:47.306 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T23:05:47.354 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T23:05:47.437 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T23:05:47.476 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:05:47.476 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T23:05:47.540 DEBUG:teuthology.orchestra.run.smithi188:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T23:05:47.582 DEBUG:teuthology.orchestra.run.smithi188:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T23:05:47.634 DEBUG:teuthology.orchestra.run.smithi188:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T23:05:47.716 DEBUG:teuthology.orchestra.run.smithi188:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T23:05:47.761 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:05:47.761 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T23:05:47.828 DEBUG:teuthology.orchestra.run.smithi123:> sudo service rsyslog restart 2024-09-15T23:05:47.830 DEBUG:teuthology.orchestra.run.smithi188:> sudo service rsyslog restart 2024-09-15T23:05:47.876 INFO:teuthology.orchestra.run.smithi123.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T23:05:47.927 INFO:teuthology.orchestra.run.smithi188.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T23:05:48.314 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-15T23:05:48.322 INFO:teuthology.task.internal:Starting timer... 2024-09-15T23:05:48.322 INFO:teuthology.run_tasks:Running task pcp... 2024-09-15T23:05:48.332 INFO:teuthology.run_tasks:Running task selinux... 2024-09-15T23:05:48.341 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-15T23:05:48.341 DEBUG:teuthology.orchestra.run.smithi123:> sudo service auditd rotate 2024-09-15T23:05:48.400 INFO:teuthology.orchestra.run.smithi123.stdout:Rotating logs: 2024-09-15T23:05:48.402 DEBUG:teuthology.orchestra.run.smithi188:> sudo service auditd rotate 2024-09-15T23:05:48.458 INFO:teuthology.orchestra.run.smithi188.stdout:Rotating logs: 2024-09-15T23:05:48.460 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-15T23:05:48.460 DEBUG:teuthology.orchestra.run.smithi123:> /usr/sbin/getenforce 2024-09-15T23:05:48.500 INFO:teuthology.orchestra.run.smithi123.stdout:Permissive 2024-09-15T23:05:48.500 DEBUG:teuthology.orchestra.run.smithi188:> /usr/sbin/getenforce 2024-09-15T23:05:48.524 INFO:teuthology.orchestra.run.smithi188.stdout:Permissive 2024-09-15T23:05:48.524 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi123.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi188.front.sepia.ceph.com': 'permissive'} 2024-09-15T23:05:48.525 DEBUG:teuthology.orchestra.run.smithi123:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T23:05:48.566 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:05:48.566 DEBUG:teuthology.orchestra.run.smithi188:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T23:05:48.593 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:05:48.593 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-15T23:05:48.593 DEBUG:teuthology.orchestra.run.smithi123:> sudo /usr/sbin/setenforce permissive 2024-09-15T23:05:48.820 DEBUG:teuthology.orchestra.run.smithi188:> sudo /usr/sbin/setenforce permissive 2024-09-15T23:05:48.852 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-15T23:05:48.865 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-15T23:05:48.868 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-15T23:05:48.974 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-15T23:05:48.984 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-15T23:05:48.985 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi123.front.sepia.ceph.com,smithi188.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-15T23:09:31.972 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi123.front.sepia.ceph.com'), Remote(name='ubuntu@smithi188.front.sepia.ceph.com')] 2024-09-15T23:09:31.974 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-09-15T23:09:31.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:09:32.054 DEBUG:teuthology.orchestra.run.smithi123:> true 2024-09-15T23:09:32.091 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-09-15T23:09:32.092 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-09-15T23:09:32.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:09:32.176 DEBUG:teuthology.orchestra.run.smithi188:> true 2024-09-15T23:09:32.254 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-09-15T23:09:32.254 INFO:teuthology.run_tasks:Running task clock... 2024-09-15T23:09:32.272 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-15T23:09:32.272 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T23:09:32.273 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T23:09:32.275 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T23:09:32.275 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T23:09:32.304 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-15T23:09:32.316 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-15T23:09:32.324 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-15T23:09:32.339 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-15T23:09:32.340 INFO:teuthology.orchestra.run.smithi123.stderr:sudo: ntpd: command not found 2024-09-15T23:09:32.351 INFO:teuthology.orchestra.run.smithi123.stdout:506 Cannot talk to daemon 2024-09-15T23:09:32.364 INFO:teuthology.orchestra.run.smithi188.stderr:sudo: ntpd: command not found 2024-09-15T23:09:32.365 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-15T23:09:32.375 INFO:teuthology.orchestra.run.smithi188.stdout:506 Cannot talk to daemon 2024-09-15T23:09:32.379 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-15T23:09:32.389 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-15T23:09:32.405 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-15T23:09:32.434 INFO:teuthology.orchestra.run.smithi123.stderr:bash: line 1: ntpq: command not found 2024-09-15T23:09:32.439 INFO:teuthology.orchestra.run.smithi123.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T23:09:32.439 INFO:teuthology.orchestra.run.smithi123.stdout:=============================================================================== 2024-09-15T23:09:32.439 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:09:32.440 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:09:32.440 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:09:32.440 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:09:32.460 INFO:teuthology.orchestra.run.smithi188.stderr:bash: line 1: ntpq: command not found 2024-09-15T23:09:32.463 INFO:teuthology.orchestra.run.smithi188.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T23:09:32.463 INFO:teuthology.orchestra.run.smithi188.stdout:=============================================================================== 2024-09-15T23:09:32.463 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:09:32.463 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:09:32.463 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:09:32.463 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:09:32.465 INFO:teuthology.run_tasks:Running task install... 2024-09-15T23:09:32.476 DEBUG:teuthology.task.install:project ceph 2024-09-15T23:09:32.476 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}} 2024-09-15T23:09:32.477 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'} 2024-09-15T23:09:32.479 INFO:teuthology.task.install:Using flavor: default 2024-09-15T23:09:32.485 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-15T23:09:32.485 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-15T23:09:32.485 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-15T23:09:32.486 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T23:09:32.488 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-15T23:09:32.488 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T23:09:32.646 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-15T23:09:32.647 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-15T23:09:32.651 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-15T23:09:32.652 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-15T23:09:32.758 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-15T23:09:32.758 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:09:32.758 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-15T23:09:32.769 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-15T23:09:32.770 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:09:32.770 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-15T23:09:32.784 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-15T23:09:32.785 DEBUG:teuthology.orchestra.run.smithi188:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-15T23:09:32.797 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-15T23:09:32.797 DEBUG:teuthology.orchestra.run.smithi123:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-15T23:09:32.851 DEBUG:teuthology.orchestra.run.smithi188:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-15T23:09:32.862 DEBUG:teuthology.orchestra.run.smithi123:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-15T23:09:32.926 DEBUG:teuthology.orchestra.run.smithi188:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-15T23:09:32.937 DEBUG:teuthology.orchestra.run.smithi123:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-15T23:09:32.990 INFO:teuthology.orchestra.run.smithi188.stdout:check_obsoletes = 1 2024-09-15T23:09:32.992 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum clean all 2024-09-15T23:09:33.001 INFO:teuthology.orchestra.run.smithi123.stdout:check_obsoletes = 1 2024-09-15T23:09:33.002 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum clean all 2024-09-15T23:09:33.228 INFO:teuthology.orchestra.run.smithi188.stdout:45 files removed 2024-09-15T23:09:33.245 INFO:teuthology.orchestra.run.smithi123.stdout:45 files removed 2024-09-15T23:09:33.255 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-15T23:09:33.273 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-15T23:09:33.813 INFO:teuthology.orchestra.run.smithi188.stdout:ceph packages for x86_64 306 kB/s | 83 kB 00:00 2024-09-15T23:09:33.814 INFO:teuthology.orchestra.run.smithi123.stdout:ceph packages for x86_64 326 kB/s | 83 kB 00:00 2024-09-15T23:09:34.088 INFO:teuthology.orchestra.run.smithi123.stdout:ceph noarch packages 51 kB/s | 12 kB 00:00 2024-09-15T23:09:34.096 INFO:teuthology.orchestra.run.smithi188.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-15T23:09:34.356 INFO:teuthology.orchestra.run.smithi123.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-15T23:09:34.364 INFO:teuthology.orchestra.run.smithi188.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-15T23:09:34.830 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.2 MB 00:00 2024-09-15T23:09:37.031 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - BaseOS 3.1 MB/s | 8.2 MB 00:02 2024-09-15T23:09:37.831 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - AppStream 11 MB/s | 20 MB 00:01 2024-09-15T23:09:39.865 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - AppStream 12 MB/s | 20 MB 00:01 2024-09-15T23:09:42.057 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-15T23:09:43.558 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 19 kB 00:00 2024-09-15T23:09:44.629 INFO:teuthology.orchestra.run.smithi188.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-15T23:09:45.007 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - CRB 4.8 MB/s | 6.5 MB 00:01 2024-09-15T23:09:46.966 INFO:teuthology.orchestra.run.smithi123.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 19 kB 00:00 2024-09-15T23:09:47.920 INFO:teuthology.orchestra.run.smithi123.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-15T23:09:50.193 INFO:teuthology.orchestra.run.smithi188.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-15T23:09:52.572 INFO:teuthology.orchestra.run.smithi188.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T23:09:52.573 INFO:teuthology.orchestra.run.smithi188.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T23:09:52.586 INFO:teuthology.orchestra.run.smithi188.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-15T23:09:52.587 INFO:teuthology.orchestra.run.smithi188.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-15T23:09:52.588 INFO:teuthology.orchestra.run.smithi188.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-15T23:09:52.589 INFO:teuthology.orchestra.run.smithi188.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-15T23:09:52.592 INFO:teuthology.orchestra.run.smithi188.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-15T23:09:52.594 INFO:teuthology.orchestra.run.smithi188.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-15T23:09:52.595 INFO:teuthology.orchestra.run.smithi188.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-15T23:09:52.657 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-09-15T23:09:52.672 INFO:teuthology.orchestra.run.smithi188.stdout:====================================================================================== 2024-09-15T23:09:52.672 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2024-09-15T23:09:52.672 INFO:teuthology.orchestra.run.smithi188.stdout:====================================================================================== 2024-09-15T23:09:52.672 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-09-15T23:09:52.672 INFO:teuthology.orchestra.run.smithi188.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-15T23:09:52.673 INFO:teuthology.orchestra.run.smithi188.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-15T23:09:52.673 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-15T23:09:52.673 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-15T23:09:52.673 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-15T23:09:52.673 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-15T23:09:52.673 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-15T23:09:52.673 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-15T23:09:52.673 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-15T23:09:52.674 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-15T23:09:52.674 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-15T23:09:52.674 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-15T23:09:52.674 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-15T23:09:52.674 INFO:teuthology.orchestra.run.smithi188.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-15T23:09:52.674 INFO:teuthology.orchestra.run.smithi188.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-15T23:09:52.674 INFO:teuthology.orchestra.run.smithi188.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-15T23:09:52.674 INFO:teuthology.orchestra.run.smithi188.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-15T23:09:52.674 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-15T23:09:52.674 INFO:teuthology.orchestra.run.smithi188.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-15T23:09:52.674 INFO:teuthology.orchestra.run.smithi188.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-15T23:09:52.675 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-15T23:09:52.675 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-15T23:09:52.675 INFO:teuthology.orchestra.run.smithi188.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-15T23:09:52.675 INFO:teuthology.orchestra.run.smithi188.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-15T23:09:52.675 INFO:teuthology.orchestra.run.smithi188.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-15T23:09:52.675 INFO:teuthology.orchestra.run.smithi188.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-15T23:09:52.675 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-15T23:09:52.675 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-15T23:09:52.675 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-15T23:09:52.675 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-15T23:09:52.675 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-15T23:09:52.676 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-15T23:09:52.676 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-15T23:09:52.676 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-15T23:09:52.676 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-15T23:09:52.676 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-15T23:09:52.676 INFO:teuthology.orchestra.run.smithi188.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-15T23:09:52.676 INFO:teuthology.orchestra.run.smithi188.stdout:Upgrading: 2024-09-15T23:09:52.676 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-15T23:09:52.676 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-15T23:09:52.676 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-15T23:09:52.677 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-15T23:09:52.677 INFO:teuthology.orchestra.run.smithi188.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-15T23:09:52.677 INFO:teuthology.orchestra.run.smithi188.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-15T23:09:52.677 INFO:teuthology.orchestra.run.smithi188.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-15T23:09:52.677 INFO:teuthology.orchestra.run.smithi188.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-15T23:09:52.677 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2024-09-15T23:09:52.677 INFO:teuthology.orchestra.run.smithi188.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-15T23:09:52.677 INFO:teuthology.orchestra.run.smithi188.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-15T23:09:52.677 INFO:teuthology.orchestra.run.smithi188.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-15T23:09:52.677 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-15T23:09:52.677 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-15T23:09:52.677 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-15T23:09:52.678 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-15T23:09:52.678 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-15T23:09:52.678 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-15T23:09:52.678 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-15T23:09:52.678 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-15T23:09:52.678 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-15T23:09:52.678 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-15T23:09:52.678 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-15T23:09:52.678 INFO:teuthology.orchestra.run.smithi188.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-15T23:09:52.678 INFO:teuthology.orchestra.run.smithi188.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-15T23:09:52.678 INFO:teuthology.orchestra.run.smithi188.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-15T23:09:52.679 INFO:teuthology.orchestra.run.smithi188.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-15T23:09:52.679 INFO:teuthology.orchestra.run.smithi188.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-15T23:09:52.679 INFO:teuthology.orchestra.run.smithi188.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-15T23:09:52.679 INFO:teuthology.orchestra.run.smithi188.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-15T23:09:52.679 INFO:teuthology.orchestra.run.smithi188.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-15T23:09:52.679 INFO:teuthology.orchestra.run.smithi188.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-15T23:09:52.679 INFO:teuthology.orchestra.run.smithi188.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-15T23:09:52.679 INFO:teuthology.orchestra.run.smithi188.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-15T23:09:52.679 INFO:teuthology.orchestra.run.smithi188.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-15T23:09:52.679 INFO:teuthology.orchestra.run.smithi188.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-15T23:09:52.679 INFO:teuthology.orchestra.run.smithi188.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-15T23:09:52.680 INFO:teuthology.orchestra.run.smithi188.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-15T23:09:52.680 INFO:teuthology.orchestra.run.smithi188.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-15T23:09:52.680 INFO:teuthology.orchestra.run.smithi188.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-15T23:09:52.680 INFO:teuthology.orchestra.run.smithi188.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-15T23:09:52.680 INFO:teuthology.orchestra.run.smithi188.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-15T23:09:52.680 INFO:teuthology.orchestra.run.smithi188.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-15T23:09:52.680 INFO:teuthology.orchestra.run.smithi188.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-15T23:09:52.680 INFO:teuthology.orchestra.run.smithi188.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-15T23:09:52.680 INFO:teuthology.orchestra.run.smithi188.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-15T23:09:52.680 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-15T23:09:52.680 INFO:teuthology.orchestra.run.smithi188.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-15T23:09:52.681 INFO:teuthology.orchestra.run.smithi188.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-15T23:09:52.681 INFO:teuthology.orchestra.run.smithi188.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-15T23:09:52.681 INFO:teuthology.orchestra.run.smithi188.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-15T23:09:52.681 INFO:teuthology.orchestra.run.smithi188.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-15T23:09:52.681 INFO:teuthology.orchestra.run.smithi188.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-15T23:09:52.681 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-15T23:09:52.681 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-15T23:09:52.681 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-15T23:09:52.681 INFO:teuthology.orchestra.run.smithi188.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-15T23:09:52.681 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-15T23:09:52.681 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-15T23:09:52.682 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-15T23:09:52.682 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-15T23:09:52.682 INFO:teuthology.orchestra.run.smithi188.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-15T23:09:52.682 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-15T23:09:52.682 INFO:teuthology.orchestra.run.smithi188.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-15T23:09:52.682 INFO:teuthology.orchestra.run.smithi188.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-15T23:09:52.682 INFO:teuthology.orchestra.run.smithi188.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-15T23:09:52.682 INFO:teuthology.orchestra.run.smithi188.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-15T23:09:52.682 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-15T23:09:52.682 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-15T23:09:52.682 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-15T23:09:52.683 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-15T23:09:52.683 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-15T23:09:52.683 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-15T23:09:52.683 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-15T23:09:52.683 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-15T23:09:52.683 INFO:teuthology.orchestra.run.smithi188.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-15T23:09:52.683 INFO:teuthology.orchestra.run.smithi188.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-15T23:09:52.683 INFO:teuthology.orchestra.run.smithi188.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-15T23:09:52.683 INFO:teuthology.orchestra.run.smithi188.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-15T23:09:52.683 INFO:teuthology.orchestra.run.smithi188.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-15T23:09:52.683 INFO:teuthology.orchestra.run.smithi188.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-15T23:09:52.683 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-15T23:09:52.684 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-15T23:09:52.684 INFO:teuthology.orchestra.run.smithi188.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-15T23:09:52.684 INFO:teuthology.orchestra.run.smithi188.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-15T23:09:52.684 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-15T23:09:52.684 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-15T23:09:52.684 INFO:teuthology.orchestra.run.smithi188.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-15T23:09:52.684 INFO:teuthology.orchestra.run.smithi188.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-15T23:09:52.684 INFO:teuthology.orchestra.run.smithi188.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-15T23:09:52.684 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-15T23:09:52.684 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-15T23:09:52.684 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-15T23:09:52.685 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-15T23:09:52.685 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-15T23:09:52.685 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-15T23:09:52.685 INFO:teuthology.orchestra.run.smithi188.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-15T23:09:52.685 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-15T23:09:52.685 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-15T23:09:52.685 INFO:teuthology.orchestra.run.smithi188.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-15T23:09:52.685 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-15T23:09:52.685 INFO:teuthology.orchestra.run.smithi188.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-15T23:09:52.685 INFO:teuthology.orchestra.run.smithi188.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-15T23:09:52.685 INFO:teuthology.orchestra.run.smithi188.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-15T23:09:52.686 INFO:teuthology.orchestra.run.smithi188.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-15T23:09:52.686 INFO:teuthology.orchestra.run.smithi188.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-15T23:09:52.686 INFO:teuthology.orchestra.run.smithi188.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-15T23:09:52.686 INFO:teuthology.orchestra.run.smithi188.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-15T23:09:52.686 INFO:teuthology.orchestra.run.smithi188.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-15T23:09:52.686 INFO:teuthology.orchestra.run.smithi188.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-15T23:09:52.686 INFO:teuthology.orchestra.run.smithi188.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-15T23:09:52.686 INFO:teuthology.orchestra.run.smithi188.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-15T23:09:52.686 INFO:teuthology.orchestra.run.smithi188.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-15T23:09:52.686 INFO:teuthology.orchestra.run.smithi188.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-15T23:09:52.686 INFO:teuthology.orchestra.run.smithi188.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-15T23:09:52.686 INFO:teuthology.orchestra.run.smithi188.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-15T23:09:52.687 INFO:teuthology.orchestra.run.smithi188.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-15T23:09:52.687 INFO:teuthology.orchestra.run.smithi188.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-15T23:09:52.687 INFO:teuthology.orchestra.run.smithi188.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-15T23:09:52.687 INFO:teuthology.orchestra.run.smithi188.stdout:Installing weak dependencies: 2024-09-15T23:09:52.687 INFO:teuthology.orchestra.run.smithi188.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-15T23:09:52.687 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:09:52.687 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-09-15T23:09:52.687 INFO:teuthology.orchestra.run.smithi188.stdout:====================================================================================== 2024-09-15T23:09:52.687 INFO:teuthology.orchestra.run.smithi188.stdout:Install 148 Packages 2024-09-15T23:09:52.687 INFO:teuthology.orchestra.run.smithi188.stdout:Upgrade 8 Packages 2024-09-15T23:09:52.687 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:09:52.688 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 226 M 2024-09-15T23:09:52.688 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-09-15T23:09:53.178 INFO:teuthology.orchestra.run.smithi188.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 51 kB/s | 6.5 kB 00:00 2024-09-15T23:09:53.369 INFO:teuthology.orchestra.run.smithi188.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 4.6 MB/s | 896 kB 00:00 2024-09-15T23:09:53.443 INFO:teuthology.orchestra.run.smithi123.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-09-15T23:09:53.453 INFO:teuthology.orchestra.run.smithi188.stdout:(3/156): ceph-immutable-object-cache-19.1.1-326 1.7 MB/s | 145 kB 00:00 2024-09-15T23:09:53.553 INFO:teuthology.orchestra.run.smithi188.stdout:(4/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-15T23:09:53.695 INFO:teuthology.orchestra.run.smithi188.stdout:(5/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 9.9 MB/s | 2.4 MB 00:00 2024-09-15T23:09:53.737 INFO:teuthology.orchestra.run.smithi188.stdout:(6/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 8.3 MB/s | 1.5 MB 00:00 2024-09-15T23:09:54.113 INFO:teuthology.orchestra.run.smithi188.stdout:(7/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 11 MB/s | 4.7 MB 00:00 2024-09-15T23:09:54.421 INFO:teuthology.orchestra.run.smithi188.stdout:(8/156): ceph-common-19.1.1-326.g8921c8ef.el9.x 15 MB/s | 21 MB 00:01 2024-09-15T23:09:54.463 INFO:teuthology.orchestra.run.smithi188.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 610 kB/s | 25 kB 00:00 2024-09-15T23:09:54.705 INFO:teuthology.orchestra.run.smithi188.stdout:(10/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9 18 MB/s | 11 MB 00:00 2024-09-15T23:09:54.872 INFO:teuthology.orchestra.run.smithi188.stdout:(11/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86 15 MB/s | 17 MB 00:01 2024-09-15T23:09:54.897 INFO:teuthology.orchestra.run.smithi188.stdout:(12/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 1.2 MB/s | 228 kB 00:00 2024-09-15T23:09:55.039 INFO:teuthology.orchestra.run.smithi188.stdout:(13/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 162 kB/s | 27 kB 00:00 2024-09-15T23:09:55.064 INFO:teuthology.orchestra.run.smithi188.stdout:(14/156): libcephfs-devel-19.1.1-326.g8921c8ef. 190 kB/s | 32 kB 00:00 2024-09-15T23:09:55.123 INFO:teuthology.orchestra.run.smithi188.stdout:(15/156): libcephsqlite-19.1.1-326.g8921c8ef.el 2.7 MB/s | 163 kB 00:00 2024-09-15T23:09:55.156 INFO:teuthology.orchestra.run.smithi188.stdout:(16/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 8.0 MB/s | 751 kB 00:00 2024-09-15T23:09:55.182 INFO:teuthology.orchestra.run.smithi188.stdout:(17/156): librados-devel-19.1.1-326.g8921c8ef.e 2.1 MB/s | 127 kB 00:00 2024-09-15T23:09:55.224 INFO:teuthology.orchestra.run.smithi188.stdout:(18/156): libradosstriper1-19.1.1-326.g8921c8ef 7.4 MB/s | 506 kB 00:00 2024-09-15T23:09:55.291 INFO:teuthology.orchestra.run.smithi188.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 677 kB/s | 45 kB 00:00 2024-09-15T23:09:55.366 INFO:teuthology.orchestra.run.smithi188.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 1.8 MB/s | 136 kB 00:00 2024-09-15T23:09:55.433 INFO:teuthology.orchestra.run.smithi188.stdout:(21/156): python3-cephfs-19.1.1-326.g8921c8ef.e 2.4 MB/s | 161 kB 00:00 2024-09-15T23:09:55.525 INFO:teuthology.orchestra.run.smithi188.stdout:(22/156): python3-rados-19.1.1-326.g8921c8ef.el 3.4 MB/s | 320 kB 00:00 2024-09-15T23:09:55.609 INFO:teuthology.orchestra.run.smithi188.stdout:(23/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 13 MB/s | 5.3 MB 00:00 2024-09-15T23:09:55.634 INFO:teuthology.orchestra.run.smithi188.stdout:(24/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 2.7 MB/s | 300 kB 00:00 2024-09-15T23:09:55.660 INFO:teuthology.orchestra.run.smithi188.stdout:(25/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 1.9 MB/s | 99 kB 00:00 2024-09-15T23:09:55.685 INFO:teuthology.orchestra.run.smithi188.stdout:(26/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-15T23:09:55.743 INFO:teuthology.orchestra.run.smithi188.stdout:(27/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 2.9 MB/s | 170 kB 00:00 2024-09-15T23:09:55.819 INFO:teuthology.orchestra.run.smithi188.stdout:(28/156): ceph-grafana-dashboards-19.1.1-326.g8 426 kB/s | 32 kB 00:00 2024-09-15T23:09:55.839 INFO:teuthology.orchestra.run.smithi123.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T23:09:55.840 INFO:teuthology.orchestra.run.smithi123.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T23:09:55.854 INFO:teuthology.orchestra.run.smithi123.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-15T23:09:55.854 INFO:teuthology.orchestra.run.smithi123.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-15T23:09:55.855 INFO:teuthology.orchestra.run.smithi123.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-15T23:09:55.857 INFO:teuthology.orchestra.run.smithi123.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-15T23:09:55.859 INFO:teuthology.orchestra.run.smithi123.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-15T23:09:55.861 INFO:teuthology.orchestra.run.smithi123.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-15T23:09:55.862 INFO:teuthology.orchestra.run.smithi123.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-15T23:09:55.877 INFO:teuthology.orchestra.run.smithi188.stdout:(29/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 14 MB/s | 3.1 MB 00:00 2024-09-15T23:09:55.902 INFO:teuthology.orchestra.run.smithi188.stdout:(30/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 1.7 MB/s | 146 kB 00:00 2024-09-15T23:09:55.924 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-09-15T23:09:55.942 INFO:teuthology.orchestra.run.smithi123.stdout:====================================================================================== 2024-09-15T23:09:55.942 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2024-09-15T23:09:55.942 INFO:teuthology.orchestra.run.smithi123.stdout:====================================================================================== 2024-09-15T23:09:55.943 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-09-15T23:09:55.943 INFO:teuthology.orchestra.run.smithi123.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-15T23:09:55.943 INFO:teuthology.orchestra.run.smithi123.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-15T23:09:55.943 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-15T23:09:55.943 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-15T23:09:55.943 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-15T23:09:55.943 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-15T23:09:55.943 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-15T23:09:55.943 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-15T23:09:55.943 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-15T23:09:55.943 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-15T23:09:55.943 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-15T23:09:55.943 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-15T23:09:55.944 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-15T23:09:55.944 INFO:teuthology.orchestra.run.smithi123.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-15T23:09:55.944 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-15T23:09:55.944 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-15T23:09:55.944 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-15T23:09:55.944 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-15T23:09:55.944 INFO:teuthology.orchestra.run.smithi123.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-15T23:09:55.944 INFO:teuthology.orchestra.run.smithi123.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-15T23:09:55.944 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-15T23:09:55.944 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-15T23:09:55.944 INFO:teuthology.orchestra.run.smithi123.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-15T23:09:55.944 INFO:teuthology.orchestra.run.smithi123.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-15T23:09:55.945 INFO:teuthology.orchestra.run.smithi123.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-15T23:09:55.945 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-15T23:09:55.945 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-15T23:09:55.945 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-15T23:09:55.945 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-15T23:09:55.945 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-15T23:09:55.945 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-15T23:09:55.945 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-15T23:09:55.945 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-15T23:09:55.945 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-15T23:09:55.945 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-15T23:09:55.945 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-15T23:09:55.946 INFO:teuthology.orchestra.run.smithi123.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-15T23:09:55.946 INFO:teuthology.orchestra.run.smithi123.stdout:Upgrading: 2024-09-15T23:09:55.946 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-15T23:09:55.946 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-15T23:09:55.946 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-15T23:09:55.946 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-15T23:09:55.946 INFO:teuthology.orchestra.run.smithi123.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-15T23:09:55.946 INFO:teuthology.orchestra.run.smithi123.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-15T23:09:55.946 INFO:teuthology.orchestra.run.smithi123.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-15T23:09:55.946 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-15T23:09:55.946 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2024-09-15T23:09:55.946 INFO:teuthology.orchestra.run.smithi123.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-15T23:09:55.946 INFO:teuthology.orchestra.run.smithi123.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-15T23:09:55.947 INFO:teuthology.orchestra.run.smithi123.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-15T23:09:55.947 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-15T23:09:55.947 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-15T23:09:55.947 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-15T23:09:55.947 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-15T23:09:55.947 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-15T23:09:55.947 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-15T23:09:55.947 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-15T23:09:55.947 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-15T23:09:55.947 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-15T23:09:55.947 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-15T23:09:55.947 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-15T23:09:55.948 INFO:teuthology.orchestra.run.smithi123.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-15T23:09:55.948 INFO:teuthology.orchestra.run.smithi123.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-15T23:09:55.948 INFO:teuthology.orchestra.run.smithi123.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-15T23:09:55.948 INFO:teuthology.orchestra.run.smithi123.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-15T23:09:55.948 INFO:teuthology.orchestra.run.smithi123.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-15T23:09:55.948 INFO:teuthology.orchestra.run.smithi123.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-15T23:09:55.948 INFO:teuthology.orchestra.run.smithi123.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-15T23:09:55.948 INFO:teuthology.orchestra.run.smithi123.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-15T23:09:55.948 INFO:teuthology.orchestra.run.smithi123.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-15T23:09:55.948 INFO:teuthology.orchestra.run.smithi123.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-15T23:09:55.948 INFO:teuthology.orchestra.run.smithi123.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-15T23:09:55.948 INFO:teuthology.orchestra.run.smithi123.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-15T23:09:55.948 INFO:teuthology.orchestra.run.smithi123.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-15T23:09:55.949 INFO:teuthology.orchestra.run.smithi123.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-15T23:09:55.949 INFO:teuthology.orchestra.run.smithi123.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-15T23:09:55.949 INFO:teuthology.orchestra.run.smithi123.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-15T23:09:55.949 INFO:teuthology.orchestra.run.smithi123.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-15T23:09:55.949 INFO:teuthology.orchestra.run.smithi123.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-15T23:09:55.949 INFO:teuthology.orchestra.run.smithi123.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-15T23:09:55.949 INFO:teuthology.orchestra.run.smithi123.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-15T23:09:55.949 INFO:teuthology.orchestra.run.smithi123.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-15T23:09:55.949 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-15T23:09:55.949 INFO:teuthology.orchestra.run.smithi123.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-15T23:09:55.949 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-15T23:09:55.949 INFO:teuthology.orchestra.run.smithi123.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-15T23:09:55.949 INFO:teuthology.orchestra.run.smithi123.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-15T23:09:55.950 INFO:teuthology.orchestra.run.smithi123.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-15T23:09:55.950 INFO:teuthology.orchestra.run.smithi123.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-15T23:09:55.950 INFO:teuthology.orchestra.run.smithi123.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-15T23:09:55.950 INFO:teuthology.orchestra.run.smithi123.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-15T23:09:55.950 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-15T23:09:55.950 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-15T23:09:55.950 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-15T23:09:55.950 INFO:teuthology.orchestra.run.smithi123.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-15T23:09:55.950 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-15T23:09:55.950 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-15T23:09:55.950 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-15T23:09:55.950 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-15T23:09:55.950 INFO:teuthology.orchestra.run.smithi123.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-15T23:09:55.951 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-15T23:09:55.951 INFO:teuthology.orchestra.run.smithi123.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-15T23:09:55.951 INFO:teuthology.orchestra.run.smithi123.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-15T23:09:55.951 INFO:teuthology.orchestra.run.smithi123.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-15T23:09:55.951 INFO:teuthology.orchestra.run.smithi123.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-15T23:09:55.951 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-15T23:09:55.951 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-15T23:09:55.951 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-15T23:09:55.951 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-15T23:09:55.951 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-15T23:09:55.951 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-15T23:09:55.951 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-15T23:09:55.951 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-15T23:09:55.951 INFO:teuthology.orchestra.run.smithi123.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-15T23:09:55.952 INFO:teuthology.orchestra.run.smithi123.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-15T23:09:55.952 INFO:teuthology.orchestra.run.smithi123.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-15T23:09:55.952 INFO:teuthology.orchestra.run.smithi123.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-15T23:09:55.952 INFO:teuthology.orchestra.run.smithi123.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-15T23:09:55.952 INFO:teuthology.orchestra.run.smithi123.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-15T23:09:55.952 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-15T23:09:55.952 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-15T23:09:55.952 INFO:teuthology.orchestra.run.smithi123.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-15T23:09:55.952 INFO:teuthology.orchestra.run.smithi123.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-15T23:09:55.952 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-15T23:09:55.952 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-15T23:09:55.952 INFO:teuthology.orchestra.run.smithi123.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-15T23:09:55.952 INFO:teuthology.orchestra.run.smithi123.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-15T23:09:55.953 INFO:teuthology.orchestra.run.smithi123.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-15T23:09:55.953 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-15T23:09:55.953 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-15T23:09:55.953 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-15T23:09:55.953 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-15T23:09:55.953 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-15T23:09:55.953 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-15T23:09:55.953 INFO:teuthology.orchestra.run.smithi123.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-15T23:09:55.953 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-15T23:09:55.953 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-15T23:09:55.953 INFO:teuthology.orchestra.run.smithi123.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-15T23:09:55.953 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-15T23:09:55.953 INFO:teuthology.orchestra.run.smithi123.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-15T23:09:55.954 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-15T23:09:55.954 INFO:teuthology.orchestra.run.smithi123.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-15T23:09:55.954 INFO:teuthology.orchestra.run.smithi123.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-15T23:09:55.954 INFO:teuthology.orchestra.run.smithi123.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-15T23:09:55.954 INFO:teuthology.orchestra.run.smithi123.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-15T23:09:55.954 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-15T23:09:55.954 INFO:teuthology.orchestra.run.smithi123.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-15T23:09:55.954 INFO:teuthology.orchestra.run.smithi123.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-15T23:09:55.954 INFO:teuthology.orchestra.run.smithi123.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-15T23:09:55.954 INFO:teuthology.orchestra.run.smithi123.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-15T23:09:55.954 INFO:teuthology.orchestra.run.smithi123.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-15T23:09:55.954 INFO:teuthology.orchestra.run.smithi123.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-15T23:09:55.954 INFO:teuthology.orchestra.run.smithi123.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-15T23:09:55.955 INFO:teuthology.orchestra.run.smithi123.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-15T23:09:55.955 INFO:teuthology.orchestra.run.smithi123.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-15T23:09:55.955 INFO:teuthology.orchestra.run.smithi123.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-15T23:09:55.955 INFO:teuthology.orchestra.run.smithi123.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-15T23:09:55.955 INFO:teuthology.orchestra.run.smithi123.stdout:Installing weak dependencies: 2024-09-15T23:09:55.955 INFO:teuthology.orchestra.run.smithi123.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-15T23:09:55.955 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:09:55.955 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-09-15T23:09:55.955 INFO:teuthology.orchestra.run.smithi123.stdout:====================================================================================== 2024-09-15T23:09:55.955 INFO:teuthology.orchestra.run.smithi123.stdout:Install 148 Packages 2024-09-15T23:09:55.955 INFO:teuthology.orchestra.run.smithi123.stdout:Upgrade 8 Packages 2024-09-15T23:09:55.955 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:09:55.956 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 226 M 2024-09-15T23:09:55.956 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-09-15T23:09:56.161 INFO:teuthology.orchestra.run.smithi188.stdout:(31/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 13 MB/s | 3.6 MB 00:00 2024-09-15T23:09:56.327 INFO:teuthology.orchestra.run.smithi123.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 52 kB/s | 6.5 kB 00:00 2024-09-15T23:09:56.611 INFO:teuthology.orchestra.run.smithi123.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 3.1 MB/s | 896 kB 00:00 2024-09-15T23:09:56.645 INFO:teuthology.orchestra.run.smithi188.stdout:(32/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 22 MB/s | 49 MB 00:02 2024-09-15T23:09:56.672 INFO:teuthology.orchestra.run.smithi188.stdout:(33/156): ceph-mgr-modules-core-19.1.1-326.g892 491 kB/s | 249 kB 00:00 2024-09-15T23:09:56.678 INFO:teuthology.orchestra.run.smithi123.stdout:(3/156): ceph-immutable-object-cache-19.1.1-326 2.1 MB/s | 145 kB 00:00 2024-09-15T23:09:56.695 INFO:teuthology.orchestra.run.smithi188.stdout:(34/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 987 kB/s | 49 kB 00:00 2024-09-15T23:09:56.721 INFO:teuthology.orchestra.run.smithi188.stdout:(35/156): ceph-prometheus-alerts-19.1.1-326.g89 328 kB/s | 16 kB 00:00 2024-09-15T23:09:56.746 INFO:teuthology.orchestra.run.smithi188.stdout:(36/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 5.6 MB/s | 285 kB 00:00 2024-09-15T23:09:56.838 INFO:teuthology.orchestra.run.smithi188.stdout:(37/156): ceph-mgr-diskprediction-local-19.1.1- 7.9 MB/s | 7.4 MB 00:00 2024-09-15T23:09:56.863 INFO:teuthology.orchestra.run.smithi188.stdout:(38/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 156 kB/s | 18 kB 00:00 2024-09-15T23:09:56.888 INFO:teuthology.orchestra.run.smithi188.stdout:(39/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 4.5 MB/s | 765 kB 00:00 2024-09-15T23:09:57.005 INFO:teuthology.orchestra.run.smithi188.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 478 kB/s | 80 kB 00:00 2024-09-15T23:09:57.011 INFO:teuthology.orchestra.run.smithi123.stdout:(4/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 7.2 MB/s | 2.4 MB 00:00 2024-09-15T23:09:57.089 INFO:teuthology.orchestra.run.smithi188.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 954 kB/s | 191 kB 00:00 2024-09-15T23:09:57.120 INFO:teuthology.orchestra.run.smithi123.stdout:(5/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 5.9 MB/s | 5.4 MB 00:00 2024-09-15T23:09:57.148 INFO:teuthology.orchestra.run.smithi188.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-09-15T23:09:57.190 INFO:teuthology.orchestra.run.smithi188.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.4 MB/s | 801 kB 00:00 2024-09-15T23:09:57.215 INFO:teuthology.orchestra.run.smithi188.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.5 MB/s | 106 kB 00:00 2024-09-15T23:09:57.220 INFO:teuthology.orchestra.run.smithi123.stdout:(6/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 7.3 MB/s | 1.5 MB 00:00 2024-09-15T23:09:57.257 INFO:teuthology.orchestra.run.smithi188.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 7.3 MB/s | 1.2 MB 00:00 2024-09-15T23:09:57.282 INFO:teuthology.orchestra.run.smithi188.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-09-15T23:09:57.316 INFO:teuthology.orchestra.run.smithi188.stdout:(47/156): python3-pycparser-2.20-6.el9.noarch.r 1.0 MB/s | 135 kB 00:00 2024-09-15T23:09:57.349 INFO:teuthology.orchestra.run.smithi188.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-15T23:09:57.400 INFO:teuthology.orchestra.run.smithi188.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 5.7 MB/s | 689 kB 00:00 2024-09-15T23:09:57.425 INFO:teuthology.orchestra.run.smithi188.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-09-15T23:09:57.451 INFO:teuthology.orchestra.run.smithi188.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 432 kB/s | 22 kB 00:00 2024-09-15T23:09:57.462 INFO:teuthology.orchestra.run.smithi123.stdout:(7/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 14 MB/s | 4.7 MB 00:00 2024-09-15T23:09:57.484 INFO:teuthology.orchestra.run.smithi188.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-09-15T23:09:57.510 INFO:teuthology.orchestra.run.smithi188.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 559 kB/s | 33 kB 00:00 2024-09-15T23:09:57.560 INFO:teuthology.orchestra.run.smithi188.stdout:(54/156): bison-3.7.4-5.el9.x86_64.rpm 3.8 MB/s | 943 kB 00:00 2024-09-15T23:09:57.585 INFO:teuthology.orchestra.run.smithi188.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 242 kB/s | 18 kB 00:00 2024-09-15T23:09:57.610 INFO:teuthology.orchestra.run.smithi188.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 221 kB/s | 11 kB 00:00 2024-09-15T23:09:57.661 INFO:teuthology.orchestra.run.smithi188.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 17 MB/s | 3.0 MB 00:00 2024-09-15T23:09:57.686 INFO:teuthology.orchestra.run.smithi188.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 602 kB/s | 45 kB 00:00 2024-09-15T23:09:57.711 INFO:teuthology.orchestra.run.smithi188.stdout:(59/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-15T23:09:57.736 INFO:teuthology.orchestra.run.smithi188.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 662 kB 00:00 2024-09-15T23:09:57.762 INFO:teuthology.orchestra.run.smithi188.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 486 kB/s | 24 kB 00:00 2024-09-15T23:09:57.787 INFO:teuthology.orchestra.run.smithi188.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-15T23:09:57.821 INFO:teuthology.orchestra.run.smithi188.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-15T23:09:57.846 INFO:teuthology.orchestra.run.smithi188.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-15T23:09:57.871 INFO:teuthology.orchestra.run.smithi188.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 764 kB/s | 38 kB 00:00 2024-09-15T23:09:58.063 INFO:teuthology.orchestra.run.smithi188.stdout:(66/156): openblas-openmp-0.3.26-2.el9.x86_64.r 23 MB/s | 4.9 MB 00:00 2024-09-15T23:09:58.071 INFO:teuthology.orchestra.run.smithi123.stdout:(8/156): ceph-common-19.1.1-326.g8921c8ef.el9.x 11 MB/s | 21 MB 00:01 2024-09-15T23:09:58.089 INFO:teuthology.orchestra.run.smithi188.stdout:(67/156): libtool-2.4.6-46.el9.x86_64.rpm 1.4 MB/s | 581 kB 00:00 2024-09-15T23:09:58.164 INFO:teuthology.orchestra.run.smithi188.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 12 MB/s | 910 kB 00:00 2024-09-15T23:09:58.196 INFO:teuthology.orchestra.run.smithi123.stdout:(9/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9. 14 MB/s | 11 MB 00:00 2024-09-15T23:09:58.221 INFO:teuthology.orchestra.run.smithi123.stdout:(10/156): ceph-selinux-19.1.1-326.g8921c8ef.el9 168 kB/s | 25 kB 00:00 2024-09-15T23:09:58.222 INFO:teuthology.orchestra.run.smithi188.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-15T23:09:58.280 INFO:teuthology.orchestra.run.smithi123.stdout:(11/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 3.8 MB/s | 228 kB 00:00 2024-09-15T23:09:58.457 INFO:teuthology.orchestra.run.smithi188.stdout:(70/156): postgresql-server-13.16-1.el9.x86_64. 25 MB/s | 5.8 MB 00:00 2024-09-15T23:09:58.505 INFO:teuthology.orchestra.run.smithi123.stdout:(12/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86 13 MB/s | 17 MB 00:01 2024-09-15T23:09:58.530 INFO:teuthology.orchestra.run.smithi123.stdout:(13/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 108 kB/s | 27 kB 00:00 2024-09-15T23:09:58.532 INFO:teuthology.orchestra.run.smithi188.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-15T23:09:58.556 INFO:teuthology.orchestra.run.smithi123.stdout:(14/156): libcephfs-devel-19.1.1-326.g8921c8ef. 638 kB/s | 32 kB 00:00 2024-09-15T23:09:58.574 INFO:teuthology.orchestra.run.smithi188.stdout:(72/156): postgresql-13.16-1.el9.x86_64.rpm 3.1 MB/s | 1.6 MB 00:00 2024-09-15T23:09:58.589 INFO:teuthology.orchestra.run.smithi123.stdout:(15/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 13 MB/s | 751 kB 00:00 2024-09-15T23:09:58.599 INFO:teuthology.orchestra.run.smithi188.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-15T23:09:58.614 INFO:teuthology.orchestra.run.smithi123.stdout:(16/156): libcephsqlite-19.1.1-326.g8921c8ef.el 2.7 MB/s | 163 kB 00:00 2024-09-15T23:09:58.640 INFO:teuthology.orchestra.run.smithi123.stdout:(17/156): librados-devel-19.1.1-326.g8921c8ef.e 2.5 MB/s | 127 kB 00:00 2024-09-15T23:09:58.682 INFO:teuthology.orchestra.run.smithi123.stdout:(18/156): libradosstriper1-19.1.1-326.g8921c8ef 7.4 MB/s | 506 kB 00:00 2024-09-15T23:09:58.682 INFO:teuthology.orchestra.run.smithi188.stdout:(74/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 5.5 MB/s | 4.4 MB 00:00 2024-09-15T23:09:58.708 INFO:teuthology.orchestra.run.smithi188.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 564 kB/s | 61 kB 00:00 2024-09-15T23:09:58.740 INFO:teuthology.orchestra.run.smithi123.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 775 kB/s | 45 kB 00:00 2024-09-15T23:09:58.741 INFO:teuthology.orchestra.run.smithi188.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-15T23:09:58.766 INFO:teuthology.orchestra.run.smithi188.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-09-15T23:09:58.784 INFO:teuthology.orchestra.run.smithi188.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 608 kB/s | 26 kB 00:00 2024-09-15T23:09:58.815 INFO:teuthology.orchestra.run.smithi123.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 1.8 MB/s | 136 kB 00:00 2024-09-15T23:09:58.867 INFO:teuthology.orchestra.run.smithi188.stdout:(79/156): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 6.0 MB 00:00 2024-09-15T23:09:58.884 INFO:teuthology.orchestra.run.smithi188.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 163 kB/s | 19 kB 00:00 2024-09-15T23:09:58.910 INFO:teuthology.orchestra.run.smithi188.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-15T23:09:58.924 INFO:teuthology.orchestra.run.smithi123.stdout:(21/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 19 MB/s | 5.3 MB 00:00 2024-09-15T23:09:58.935 INFO:teuthology.orchestra.run.smithi188.stdout:(82/156): python3-markupsafe-1.1.1-12.el9.x86_6 517 kB/s | 35 kB 00:00 2024-09-15T23:09:58.949 INFO:teuthology.orchestra.run.smithi123.stdout:(22/156): python3-cephfs-19.1.1-326.g8921c8ef.e 1.2 MB/s | 161 kB 00:00 2024-09-15T23:09:58.968 INFO:teuthology.orchestra.run.smithi188.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-15T23:09:58.991 INFO:teuthology.orchestra.run.smithi123.stdout:(23/156): python3-rados-19.1.1-326.g8921c8ef.el 4.7 MB/s | 320 kB 00:00 2024-09-15T23:09:58.993 INFO:teuthology.orchestra.run.smithi188.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-15T23:09:59.017 INFO:teuthology.orchestra.run.smithi123.stdout:(24/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 4.4 MB/s | 300 kB 00:00 2024-09-15T23:09:59.042 INFO:teuthology.orchestra.run.smithi123.stdout:(25/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 1.9 MB/s | 99 kB 00:00 2024-09-15T23:09:59.069 INFO:teuthology.orchestra.run.smithi188.stdout:(85/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 28 MB/s | 5.1 MB 00:00 2024-09-15T23:09:59.076 INFO:teuthology.orchestra.run.smithi123.stdout:(26/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-15T23:09:59.094 INFO:teuthology.orchestra.run.smithi188.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 420 kB/s | 42 kB 00:00 2024-09-15T23:09:59.120 INFO:teuthology.orchestra.run.smithi188.stdout:(87/156): python3-packaging-20.9-5.el9.noarch.r 511 kB/s | 77 kB 00:00 2024-09-15T23:09:59.143 INFO:teuthology.orchestra.run.smithi123.stdout:(27/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 2.5 MB/s | 170 kB 00:00 2024-09-15T23:09:59.144 INFO:teuthology.orchestra.run.smithi188.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-09-15T23:09:59.179 INFO:teuthology.orchestra.run.smithi188.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.8 MB/s | 159 kB 00:00 2024-09-15T23:09:59.201 INFO:teuthology.orchestra.run.smithi123.stdout:(28/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 20 MB/s | 3.1 MB 00:00 2024-09-15T23:09:59.204 INFO:teuthology.orchestra.run.smithi188.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 867 kB/s | 51 kB 00:00 2024-09-15T23:09:59.227 INFO:teuthology.orchestra.run.smithi123.stdout:(29/156): ceph-grafana-dashboards-19.1.1-326.g8 381 kB/s | 32 kB 00:00 2024-09-15T23:09:59.229 INFO:teuthology.orchestra.run.smithi188.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 279 kB 00:00 2024-09-15T23:09:59.252 INFO:teuthology.orchestra.run.smithi123.stdout:(30/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 2.9 MB/s | 146 kB 00:00 2024-09-15T23:09:59.254 INFO:teuthology.orchestra.run.smithi188.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 712 kB/s | 54 kB 00:00 2024-09-15T23:09:59.288 INFO:teuthology.orchestra.run.smithi188.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 713 kB/s | 42 kB 00:00 2024-09-15T23:09:59.313 INFO:teuthology.orchestra.run.smithi188.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 753 kB/s | 44 kB 00:00 2024-09-15T23:09:59.347 INFO:teuthology.orchestra.run.smithi188.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-15T23:09:59.372 INFO:teuthology.orchestra.run.smithi188.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 610 kB/s | 36 kB 00:00 2024-09-15T23:09:59.397 INFO:teuthology.orchestra.run.smithi188.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 940 kB/s | 47 kB 00:00 2024-09-15T23:09:59.431 INFO:teuthology.orchestra.run.smithi188.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-15T23:09:59.456 INFO:teuthology.orchestra.run.smithi188.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 985 kB/s | 58 kB 00:00 2024-09-15T23:09:59.490 INFO:teuthology.orchestra.run.smithi188.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-15T23:09:59.515 INFO:teuthology.orchestra.run.smithi188.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-15T23:09:59.541 INFO:teuthology.orchestra.run.smithi188.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 890 kB/s | 45 kB 00:00 2024-09-15T23:09:59.599 INFO:teuthology.orchestra.run.smithi188.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 267 kB/s | 22 kB 00:00 2024-09-15T23:09:59.602 INFO:teuthology.orchestra.run.smithi123.stdout:(31/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 9.5 MB/s | 3.6 MB 00:00 2024-09-15T23:09:59.703 INFO:teuthology.orchestra.run.smithi123.stdout:(32/156): ceph-mgr-diskprediction-local-19.1.1- 16 MB/s | 7.4 MB 00:00 2024-09-15T23:09:59.737 INFO:teuthology.orchestra.run.smithi123.stdout:(33/156): ceph-mgr-modules-core-19.1.1-326.g892 1.8 MB/s | 249 kB 00:00 2024-09-15T23:09:59.753 INFO:teuthology.orchestra.run.smithi123.stdout:(34/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 986 kB/s | 49 kB 00:00 2024-09-15T23:09:59.767 INFO:teuthology.orchestra.run.smithi188.stdout:(104/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-09-15T23:09:59.770 INFO:teuthology.orchestra.run.smithi123.stdout:(35/156): ceph-prometheus-alerts-19.1.1-326.g89 495 kB/s | 16 kB 00:00 2024-09-15T23:09:59.804 INFO:teuthology.orchestra.run.smithi123.stdout:(36/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 5.6 MB/s | 285 kB 00:00 2024-09-15T23:09:59.842 INFO:teuthology.orchestra.run.smithi188.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 4.4 MB/s | 308 kB 00:00 2024-09-15T23:09:59.854 INFO:teuthology.orchestra.run.smithi123.stdout:(37/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 8.9 MB/s | 765 kB 00:00 2024-09-15T23:09:59.867 INFO:teuthology.orchestra.run.smithi188.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-09-15T23:09:59.892 INFO:teuthology.orchestra.run.smithi188.stdout:(107/156): abseil-cpp-20211102.0-3.el9.x86_64.r 1.8 MB/s | 548 kB 00:00 2024-09-15T23:09:59.904 INFO:teuthology.orchestra.run.smithi123.stdout:(38/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 182 kB/s | 18 kB 00:00 2024-09-15T23:09:59.934 INFO:teuthology.orchestra.run.smithi188.stdout:(108/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.1 MB/s | 863 kB 00:00 2024-09-15T23:09:59.960 INFO:teuthology.orchestra.run.smithi188.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 388 kB/s | 26 kB 00:00 2024-09-15T23:09:59.985 INFO:teuthology.orchestra.run.smithi188.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-15T23:10:00.021 INFO:teuthology.orchestra.run.smithi123.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 479 kB/s | 80 kB 00:00 2024-09-15T23:10:00.027 INFO:teuthology.orchestra.run.smithi188.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.3 MB/s | 151 kB 00:00 2024-09-15T23:10:00.060 INFO:teuthology.orchestra.run.smithi188.stdout:(112/156): libunwind-1.6.2-1.el9.x86_64.rpm 670 kB/s | 67 kB 00:00 2024-09-15T23:10:00.088 INFO:teuthology.orchestra.run.smithi123.stdout:(40/156): libgfortran-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 801 kB 00:00 2024-09-15T23:10:00.111 INFO:teuthology.orchestra.run.smithi188.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 10 MB/s | 839 kB 00:00 2024-09-15T23:10:00.113 INFO:teuthology.orchestra.run.smithi123.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 191 kB 00:00 2024-09-15T23:10:00.136 INFO:teuthology.orchestra.run.smithi188.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-15T23:10:00.138 INFO:teuthology.orchestra.run.smithi123.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-09-15T23:10:00.171 INFO:teuthology.orchestra.run.smithi188.stdout:(115/156): python3-asyncssh-2.13.2-5.el9.noarch 4.9 MB/s | 548 kB 00:00 2024-09-15T23:10:00.181 INFO:teuthology.orchestra.run.smithi123.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-15T23:10:00.195 INFO:teuthology.orchestra.run.smithi188.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 550 kB/s | 32 kB 00:00 2024-09-15T23:10:00.220 INFO:teuthology.orchestra.run.smithi188.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-15T23:10:00.223 INFO:teuthology.orchestra.run.smithi123.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-09-15T23:10:00.245 INFO:teuthology.orchestra.run.smithi188.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-15T23:10:00.256 INFO:teuthology.orchestra.run.smithi123.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 8.6 MB/s | 1.2 MB 00:00 2024-09-15T23:10:00.282 INFO:teuthology.orchestra.run.smithi123.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-15T23:10:00.287 INFO:teuthology.orchestra.run.smithi188.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-15T23:10:00.307 INFO:teuthology.orchestra.run.smithi123.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-15T23:10:00.312 INFO:teuthology.orchestra.run.smithi188.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-15T23:10:00.338 INFO:teuthology.orchestra.run.smithi188.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-15T23:10:00.349 INFO:teuthology.orchestra.run.smithi123.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 10 MB/s | 689 kB 00:00 2024-09-15T23:10:00.391 INFO:teuthology.orchestra.run.smithi123.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 11 MB/s | 943 kB 00:00 2024-09-15T23:10:00.405 INFO:teuthology.orchestra.run.smithi188.stdout:(122/156): libarrow-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 4.4 MB 00:00 2024-09-15T23:10:00.416 INFO:teuthology.orchestra.run.smithi123.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-09-15T23:10:00.430 INFO:teuthology.orchestra.run.smithi188.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 1.5 MB/s | 144 kB 00:00 2024-09-15T23:10:00.441 INFO:teuthology.orchestra.run.smithi123.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 433 kB/s | 22 kB 00:00 2024-09-15T23:10:00.456 INFO:teuthology.orchestra.run.smithi188.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-15T23:10:00.466 INFO:teuthology.orchestra.run.smithi123.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-15T23:10:00.481 INFO:teuthology.orchestra.run.smithi188.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-09-15T23:10:00.492 INFO:teuthology.orchestra.run.smithi123.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 652 kB/s | 33 kB 00:00 2024-09-15T23:10:00.515 INFO:teuthology.orchestra.run.smithi188.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 393 kB/s | 23 kB 00:00 2024-09-15T23:10:00.540 INFO:teuthology.orchestra.run.smithi188.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 330 kB/s | 19 kB 00:00 2024-09-15T23:10:00.565 INFO:teuthology.orchestra.run.smithi188.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-09-15T23:10:00.591 INFO:teuthology.orchestra.run.smithi188.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-15T23:10:00.616 INFO:teuthology.orchestra.run.smithi188.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-15T23:10:00.641 INFO:teuthology.orchestra.run.smithi188.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-15T23:10:00.683 INFO:teuthology.orchestra.run.smithi188.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 7.1 MB/s | 1.0 MB 00:00 2024-09-15T23:10:00.708 INFO:teuthology.orchestra.run.smithi188.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-09-15T23:10:00.733 INFO:teuthology.orchestra.run.smithi188.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-09-15T23:10:00.759 INFO:teuthology.orchestra.run.smithi188.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-15T23:10:00.784 INFO:teuthology.orchestra.run.smithi188.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-15T23:10:00.810 INFO:teuthology.orchestra.run.smithi188.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 610 kB/s | 31 kB 00:00 2024-09-15T23:10:00.835 INFO:teuthology.orchestra.run.smithi188.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-15T23:10:00.885 INFO:teuthology.orchestra.run.smithi188.stdout:(139/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.6 MB/s | 2.0 MB 00:00 2024-09-15T23:10:00.910 INFO:teuthology.orchestra.run.smithi188.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-15T23:10:00.917 INFO:teuthology.orchestra.run.smithi123.stdout:(54/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 18 MB/s | 49 MB 00:02 2024-09-15T23:10:00.936 INFO:teuthology.orchestra.run.smithi188.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 356 kB/s | 36 kB 00:00 2024-09-15T23:10:00.943 INFO:teuthology.orchestra.run.smithi123.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 40 kB/s | 18 kB 00:00 2024-09-15T23:10:00.978 INFO:teuthology.orchestra.run.smithi188.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 807 kB/s | 74 kB 00:00 2024-09-15T23:10:01.001 INFO:teuthology.orchestra.run.smithi123.stdout:(56/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.6 MB/s | 3.0 MB 00:00 2024-09-15T23:10:01.003 INFO:teuthology.orchestra.run.smithi188.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-09-15T23:10:01.026 INFO:teuthology.orchestra.run.smithi123.stdout:(57/156): libaio-devel-0.3.111-13.el9.x86_64.rp 103 kB/s | 11 kB 00:00 2024-09-15T23:10:01.037 INFO:teuthology.orchestra.run.smithi188.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-15T23:10:01.052 INFO:teuthology.orchestra.run.smithi123.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 904 kB/s | 45 kB 00:00 2024-09-15T23:10:01.053 INFO:teuthology.orchestra.run.smithi188.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-15T23:10:01.077 INFO:teuthology.orchestra.run.smithi123.stdout:(59/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-15T23:10:01.087 INFO:teuthology.orchestra.run.smithi188.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-15T23:10:01.110 INFO:teuthology.orchestra.run.smithi123.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 9.7 MB/s | 581 kB 00:00 2024-09-15T23:10:01.112 INFO:teuthology.orchestra.run.smithi188.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-15T23:10:01.136 INFO:teuthology.orchestra.run.smithi123.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 417 kB/s | 24 kB 00:00 2024-09-15T23:10:01.161 INFO:teuthology.orchestra.run.smithi123.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-15T23:10:01.179 INFO:teuthology.orchestra.run.smithi188.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-15T23:10:01.186 INFO:teuthology.orchestra.run.smithi123.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-15T23:10:01.211 INFO:teuthology.orchestra.run.smithi123.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-15T23:10:01.237 INFO:teuthology.orchestra.run.smithi123.stdout:(65/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.1 MB/s | 662 kB 00:00 2024-09-15T23:10:01.254 INFO:teuthology.orchestra.run.smithi123.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 573 kB/s | 38 kB 00:00 2024-09-15T23:10:01.354 INFO:teuthology.orchestra.run.smithi123.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 35 MB/s | 4.9 MB 00:00 2024-09-15T23:10:01.355 INFO:teuthology.orchestra.run.smithi188.stdout:(149/156): librados2-19.1.1-326.g8921c8ef.el9.x 13 MB/s | 3.4 MB 00:00 2024-09-15T23:10:01.396 INFO:teuthology.orchestra.run.smithi123.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-15T23:10:01.413 INFO:teuthology.orchestra.run.smithi188.stdout:(150/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 11 MB/s | 3.2 MB 00:00 2024-09-15T23:10:01.438 INFO:teuthology.orchestra.run.smithi123.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 11 MB/s | 910 kB 00:00 2024-09-15T23:10:01.463 INFO:teuthology.orchestra.run.smithi123.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-15T23:10:01.472 INFO:teuthology.orchestra.run.smithi188.stdout:(151/156): NetworkManager-1.49.90-1.el9.x86_64. 7.9 MB/s | 2.3 MB 00:00 2024-09-15T23:10:01.497 INFO:teuthology.orchestra.run.smithi188.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 488 kB/s | 41 kB 00:00 2024-09-15T23:10:01.531 INFO:teuthology.orchestra.run.smithi123.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-15T23:10:01.539 INFO:teuthology.orchestra.run.smithi188.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 3.6 MB/s | 249 kB 00:00 2024-09-15T23:10:01.572 INFO:teuthology.orchestra.run.smithi123.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-09-15T23:10:01.597 INFO:teuthology.orchestra.run.smithi123.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-15T23:10:01.606 INFO:teuthology.orchestra.run.smithi188.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 7.2 MB/s | 1.8 MB 00:00 2024-09-15T23:10:01.657 INFO:teuthology.orchestra.run.smithi188.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 20 MB/s | 2.4 MB 00:00 2024-09-15T23:10:01.690 INFO:teuthology.orchestra.run.smithi123.stdout:(74/156): postgresql-server-13.16-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2024-09-15T23:10:01.715 INFO:teuthology.orchestra.run.smithi123.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 524 kB/s | 61 kB 00:00 2024-09-15T23:10:01.723 INFO:teuthology.orchestra.run.smithi188.stdout:(156/156): openssl-3.2.2-6.el9.x86_64.rpm 6.0 MB/s | 1.4 MB 00:00 2024-09-15T23:10:01.730 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-09-15T23:10:01.730 INFO:teuthology.orchestra.run.smithi188.stdout:Total 25 MB/s | 226 MB 00:09 2024-09-15T23:10:01.740 INFO:teuthology.orchestra.run.smithi123.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-15T23:10:01.765 INFO:teuthology.orchestra.run.smithi123.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-09-15T23:10:01.791 INFO:teuthology.orchestra.run.smithi123.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-09-15T23:10:01.816 INFO:teuthology.orchestra.run.smithi123.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-15T23:10:01.841 INFO:teuthology.orchestra.run.smithi123.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-15T23:10:01.866 INFO:teuthology.orchestra.run.smithi123.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-09-15T23:10:01.967 INFO:teuthology.orchestra.run.smithi123.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-15T23:10:01.992 INFO:teuthology.orchestra.run.smithi123.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.0 MB/s | 250 kB 00:00 2024-09-15T23:10:02.017 INFO:teuthology.orchestra.run.smithi123.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-15T23:10:02.042 INFO:teuthology.orchestra.run.smithi123.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-15T23:10:02.068 INFO:teuthology.orchestra.run.smithi123.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 844 kB/s | 42 kB 00:00 2024-09-15T23:10:02.093 INFO:teuthology.orchestra.run.smithi123.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-15T23:10:02.118 INFO:teuthology.orchestra.run.smithi123.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-15T23:10:02.152 INFO:teuthology.orchestra.run.smithi123.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-15T23:10:02.177 INFO:teuthology.orchestra.run.smithi123.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 872 kB/s | 51 kB 00:00 2024-09-15T23:10:02.203 INFO:teuthology.orchestra.run.smithi123.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-15T23:10:02.278 INFO:teuthology.orchestra.run.smithi123.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-15T23:10:02.303 INFO:teuthology.orchestra.run.smithi123.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 416 kB/s | 42 kB 00:00 2024-09-15T23:10:02.328 INFO:teuthology.orchestra.run.smithi123.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 884 kB/s | 44 kB 00:00 2024-09-15T23:10:02.353 INFO:teuthology.orchestra.run.smithi123.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-15T23:10:02.378 INFO:teuthology.orchestra.run.smithi123.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 717 kB/s | 36 kB 00:00 2024-09-15T23:10:02.404 INFO:teuthology.orchestra.run.smithi123.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-15T23:10:02.438 INFO:teuthology.orchestra.run.smithi123.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-15T23:10:02.463 INFO:teuthology.orchestra.run.smithi123.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 989 kB/s | 58 kB 00:00 2024-09-15T23:10:02.488 INFO:teuthology.orchestra.run.smithi123.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-15T23:10:02.513 INFO:teuthology.orchestra.run.smithi123.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-15T23:10:02.539 INFO:teuthology.orchestra.run.smithi123.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-09-15T23:10:02.622 INFO:teuthology.orchestra.run.smithi123.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-09-15T23:10:02.806 INFO:teuthology.orchestra.run.smithi123.stdout:(104/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-09-15T23:10:02.856 INFO:teuthology.orchestra.run.smithi123.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 2.3 MB/s | 548 kB 00:00 2024-09-15T23:10:02.881 INFO:teuthology.orchestra.run.smithi123.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 845 kB/s | 19 kB 00:00 2024-09-15T23:10:02.923 INFO:teuthology.orchestra.run.smithi123.stdout:(107/156): gperftools-libs-2.9.1-3.el9.x86_64.r 2.6 MB/s | 308 kB 00:00 2024-09-15T23:10:02.949 INFO:teuthology.orchestra.run.smithi123.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-15T23:10:02.978 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-09-15T23:10:02.982 INFO:teuthology.orchestra.run.smithi123.stdout:(109/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.9 MB/s | 863 kB 00:00 2024-09-15T23:10:02.999 INFO:teuthology.orchestra.run.smithi123.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 967 kB/s | 49 kB 00:00 2024-09-15T23:10:03.041 INFO:teuthology.orchestra.run.smithi123.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.3 MB/s | 151 kB 00:00 2024-09-15T23:10:03.075 INFO:teuthology.orchestra.run.smithi123.stdout:(112/156): libunwind-1.6.2-1.el9.x86_64.rpm 734 kB/s | 67 kB 00:00 2024-09-15T23:10:03.129 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-09-15T23:10:03.129 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-09-15T23:10:03.133 INFO:teuthology.orchestra.run.smithi123.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 9.2 MB/s | 548 kB 00:00 2024-09-15T23:10:03.167 INFO:teuthology.orchestra.run.smithi123.stdout:(114/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.6 MB/s | 839 kB 00:00 2024-09-15T23:10:03.192 INFO:teuthology.orchestra.run.smithi123.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 737 kB/s | 43 kB 00:00 2024-09-15T23:10:03.218 INFO:teuthology.orchestra.run.smithi123.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 638 kB/s | 32 kB 00:00 2024-09-15T23:10:03.243 INFO:teuthology.orchestra.run.smithi123.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-15T23:10:03.268 INFO:teuthology.orchestra.run.smithi123.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-15T23:10:03.302 INFO:teuthology.orchestra.run.smithi123.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-15T23:10:03.327 INFO:teuthology.orchestra.run.smithi123.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-15T23:10:03.402 INFO:teuthology.orchestra.run.smithi123.stdout:(121/156): libarrow-9.0.0-11.el9.x86_64.rpm 8.5 MB/s | 4.4 MB 00:00 2024-09-15T23:10:03.428 INFO:teuthology.orchestra.run.smithi123.stdout:(122/156): python3-google-auth-2.34.0-1.el9.noa 1.7 MB/s | 220 kB 00:00 2024-09-15T23:10:03.453 INFO:teuthology.orchestra.run.smithi123.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-15T23:10:03.478 INFO:teuthology.orchestra.run.smithi123.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 214 kB/s | 11 kB 00:00 2024-09-15T23:10:03.503 INFO:teuthology.orchestra.run.smithi123.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 714 kB/s | 18 kB 00:00 2024-09-15T23:10:03.586 INFO:teuthology.orchestra.run.smithi123.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 216 kB/s | 23 kB 00:00 2024-09-15T23:10:03.612 INFO:teuthology.orchestra.run.smithi123.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 179 kB/s | 19 kB 00:00 2024-09-15T23:10:03.637 INFO:teuthology.orchestra.run.smithi123.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 383 kB/s | 20 kB 00:00 2024-09-15T23:10:03.688 INFO:teuthology.orchestra.run.smithi123.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 930 kB/s | 46 kB 00:00 2024-09-15T23:10:03.722 INFO:teuthology.orchestra.run.smithi123.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-15T23:10:03.747 INFO:teuthology.orchestra.run.smithi123.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-15T23:10:03.780 INFO:teuthology.orchestra.run.smithi123.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-09-15T23:10:03.806 INFO:teuthology.orchestra.run.smithi123.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 657 kB/s | 16 kB 00:00 2024-09-15T23:10:03.831 INFO:teuthology.orchestra.run.smithi123.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-15T23:10:03.856 INFO:teuthology.orchestra.run.smithi123.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-15T23:10:03.881 INFO:teuthology.orchestra.run.smithi123.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-15T23:10:03.907 INFO:teuthology.orchestra.run.smithi123.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-15T23:10:03.949 INFO:teuthology.orchestra.run.smithi123.stdout:(138/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.3 MB/s | 2.0 MB 00:00 2024-09-15T23:10:03.974 INFO:teuthology.orchestra.run.smithi123.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 885 kB/s | 59 kB 00:00 2024-09-15T23:10:03.999 INFO:teuthology.orchestra.run.smithi123.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-09-15T23:10:04.025 INFO:teuthology.orchestra.run.smithi123.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 474 kB/s | 36 kB 00:00 2024-09-15T23:10:04.050 INFO:teuthology.orchestra.run.smithi123.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 988 kB/s | 74 kB 00:00 2024-09-15T23:10:04.075 INFO:teuthology.orchestra.run.smithi123.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-15T23:10:04.100 INFO:teuthology.orchestra.run.smithi123.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 801 kB/s | 20 kB 00:00 2024-09-15T23:10:04.126 INFO:teuthology.orchestra.run.smithi123.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-15T23:10:04.151 INFO:teuthology.orchestra.run.smithi123.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-15T23:10:04.185 INFO:teuthology.orchestra.run.smithi123.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-15T23:10:04.235 INFO:teuthology.orchestra.run.smithi123.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-15T23:10:04.385 INFO:teuthology.orchestra.run.smithi123.stdout:(149/156): NetworkManager-1.49.90-1.el9.x86_64. 15 MB/s | 2.3 MB 00:00 2024-09-15T23:10:04.452 INFO:teuthology.orchestra.run.smithi123.stdout:(150/156): NetworkManager-libnm-1.49.90-1.el9.x 27 MB/s | 1.8 MB 00:00 2024-09-15T23:10:04.502 INFO:teuthology.orchestra.run.smithi123.stdout:(151/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 10 MB/s | 3.2 MB 00:00 2024-09-15T23:10:04.519 INFO:teuthology.orchestra.run.smithi123.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 612 kB/s | 41 kB 00:00 2024-09-15T23:10:04.578 INFO:teuthology.orchestra.run.smithi123.stdout:(153/156): librados2-19.1.1-326.g8921c8ef.el9.x 8.0 MB/s | 3.4 MB 00:00 2024-09-15T23:10:04.620 INFO:teuthology.orchestra.run.smithi123.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 14 MB/s | 1.4 MB 00:00 2024-09-15T23:10:04.658 INFO:teuthology.orchestra.run.smithi123.stdout:(155/156): NetworkManager-tui-1.49.90-1.el9.x86 1.7 MB/s | 249 kB 00:00 2024-09-15T23:10:04.803 INFO:teuthology.orchestra.run.smithi123.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 11 MB/s | 2.4 MB 00:00 2024-09-15T23:10:04.810 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-09-15T23:10:04.810 INFO:teuthology.orchestra.run.smithi123.stdout:Total 26 MB/s | 226 MB 00:08 2024-09-15T23:10:05.395 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-09-15T23:10:05.395 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-09-15T23:10:06.058 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-09-15T23:10:06.209 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-09-15T23:10:06.209 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-09-15T23:10:08.472 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-09-15T23:10:08.473 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-09-15T23:10:11.704 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-09-15T23:10:11.845 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-15T23:10:11.892 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-15T23:10:11.947 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-15T23:10:11.981 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-15T23:10:12.007 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-15T23:10:12.060 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-15T23:10:12.499 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-15T23:10:12.616 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T23:10:12.731 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T23:10:12.759 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T23:10:12.851 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T23:10:12.880 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T23:10:13.044 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-15T23:10:13.103 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-15T23:10:13.130 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T23:10:13.266 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T23:10:13.298 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T23:10:13.361 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T23:10:13.391 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T23:10:13.419 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T23:10:13.609 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T23:10:13.792 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T23:10:13.914 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-15T23:10:14.029 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T23:10:14.108 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T23:10:14.349 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T23:10:14.453 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-15T23:10:14.548 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-15T23:10:14.579 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-15T23:10:14.613 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-15T23:10:14.678 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-15T23:10:14.723 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-15T23:10:14.755 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-15T23:10:14.807 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-15T23:10:14.849 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-15T23:10:14.876 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-15T23:10:14.892 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-09-15T23:10:14.945 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-15T23:10:14.974 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-15T23:10:14.997 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-15T23:10:15.030 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-15T23:10:15.037 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-15T23:10:15.073 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-15T23:10:15.090 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-15T23:10:15.132 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-15T23:10:15.149 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-15T23:10:15.166 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-15T23:10:15.184 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-15T23:10:15.217 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-15T23:10:15.228 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-15T23:10:15.256 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-15T23:10:15.328 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-15T23:10:15.379 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-15T23:10:15.453 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-15T23:10:15.585 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-15T23:10:15.623 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-15T23:10:15.639 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-15T23:10:15.733 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T23:10:15.856 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T23:10:15.893 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T23:10:15.985 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T23:10:16.015 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T23:10:16.159 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-15T23:10:16.191 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-15T23:10:16.244 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-15T23:10:16.245 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-15T23:10:16.272 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T23:10:16.273 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-15T23:10:16.317 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-15T23:10:16.354 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-15T23:10:16.374 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T23:10:16.396 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-15T23:10:16.398 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T23:10:16.444 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T23:10:16.466 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T23:10:16.486 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T23:10:16.566 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-15T23:10:16.625 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-15T23:10:16.676 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T23:10:16.687 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-15T23:10:16.768 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-15T23:10:16.800 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-15T23:10:16.836 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-15T23:10:16.849 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T23:10:16.883 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-15T23:10:16.919 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-15T23:10:16.938 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-15T23:10:16.963 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-15T23:10:17.005 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-15T23:10:17.058 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T23:10:17.140 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-15T23:10:17.140 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T23:10:17.191 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-15T23:10:17.232 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-15T23:10:17.335 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-15T23:10:17.364 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T23:10:17.382 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-15T23:10:17.431 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-15T23:10:17.464 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-15T23:10:17.468 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-15T23:10:17.489 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-15T23:10:17.566 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-15T23:10:17.588 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-15T23:10:17.604 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-15T23:10:17.646 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-15T23:10:17.716 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-15T23:10:17.719 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-15T23:10:17.759 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-15T23:10:17.763 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-15T23:10:17.795 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-15T23:10:17.796 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-15T23:10:17.839 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-15T23:10:17.840 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-15T23:10:17.873 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-15T23:10:17.899 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-15T23:10:17.968 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-15T23:10:17.969 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-15T23:10:18.000 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-15T23:10:18.021 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-15T23:10:18.030 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-15T23:10:18.061 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-15T23:10:18.065 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-15T23:10:18.098 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-15T23:10:18.113 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-15T23:10:18.148 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-15T23:10:18.190 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-15T23:10:18.191 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-15T23:10:18.224 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-15T23:10:18.268 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-15T23:10:18.279 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-15T23:10:18.296 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-15T23:10:18.330 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-15T23:10:18.361 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-15T23:10:18.366 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-15T23:10:18.410 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-15T23:10:18.462 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-15T23:10:18.485 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-15T23:10:18.512 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-15T23:10:18.618 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-15T23:10:18.680 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-15T23:10:19.211 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-15T23:10:19.234 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-15T23:10:19.284 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-15T23:10:19.300 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-15T23:10:19.318 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-15T23:10:19.337 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-15T23:10:19.389 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-15T23:10:19.416 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-15T23:10:19.429 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-15T23:10:19.469 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-15T23:10:19.473 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-15T23:10:19.518 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-15T23:10:19.606 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-15T23:10:19.640 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-15T23:10:19.646 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-15T23:10:19.705 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-15T23:10:19.759 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-15T23:10:19.832 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-15T23:10:19.836 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-15T23:10:19.864 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-15T23:10:19.864 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-15T23:10:19.900 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-15T23:10:19.941 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-15T23:10:19.954 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-15T23:10:19.991 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-15T23:10:20.035 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-15T23:10:20.076 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-15T23:10:20.212 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-15T23:10:20.261 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-15T23:10:20.303 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-15T23:10:20.405 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-15T23:10:20.466 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-15T23:10:20.618 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-15T23:10:20.703 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-15T23:10:20.728 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-15T23:10:20.877 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-15T23:10:20.902 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-15T23:10:21.017 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-15T23:10:21.139 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-15T23:10:21.178 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-15T23:10:21.207 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-15T23:10:21.251 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-15T23:10:21.288 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-15T23:10:21.320 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-15T23:10:21.350 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-15T23:10:21.384 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-15T23:10:21.418 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-15T23:10:21.459 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-15T23:10:21.494 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-15T23:10:21.580 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-15T23:10:21.632 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-15T23:10:21.664 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-15T23:10:21.766 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-15T23:10:21.814 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-15T23:10:21.981 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-15T23:10:22.071 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-15T23:10:22.099 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-15T23:10:22.132 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-15T23:10:22.443 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-15T23:10:22.486 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T23:10:22.539 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-15T23:10:22.560 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T23:10:22.592 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-15T23:10:22.603 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-15T23:10:22.627 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-15T23:10:22.645 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-15T23:10:22.743 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-15T23:10:22.808 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-15T23:10:22.852 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-15T23:10:22.941 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-15T23:10:22.980 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-15T23:10:23.112 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-15T23:10:23.163 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-15T23:10:23.195 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-15T23:10:23.214 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T23:10:23.276 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-15T23:10:23.286 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T23:10:23.316 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-15T23:10:23.935 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-15T23:10:24.067 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-15T23:10:25.317 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-15T23:10:25.406 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-15T23:10:25.436 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-15T23:10:25.469 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-15T23:10:25.635 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T23:10:25.679 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T23:10:25.777 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-15T23:10:25.824 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T23:10:25.897 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T23:10:25.929 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-15T23:10:25.965 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-15T23:10:26.228 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T23:10:26.266 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T23:10:26.352 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T23:10:26.352 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-15T23:10:26.352 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-15T23:10:26.353 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:10:26.393 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T23:10:26.446 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-15T23:10:26.477 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T23:10:26.531 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T23:10:26.553 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-15T23:10:28.840 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T23:10:28.874 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T23:10:29.429 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T23:10:29.470 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T23:10:29.566 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T23:10:29.566 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-15T23:10:29.566 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-15T23:10:29.566 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:10:29.604 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T23:10:38.658 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T23:10:38.658 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /sys 2024-09-15T23:10:38.658 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /proc 2024-09-15T23:10:38.659 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /mnt 2024-09-15T23:10:38.659 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /var/tmp 2024-09-15T23:10:38.659 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /home 2024-09-15T23:10:38.659 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /root 2024-09-15T23:10:38.659 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /tmp 2024-09-15T23:10:38.659 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:10:38.838 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T23:10:38.855 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T23:10:38.855 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:10:38.855 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-15T23:10:38.855 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:10:40.308 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T23:10:40.336 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T23:10:40.336 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:10:40.336 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-15T23:10:40.336 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T23:10:40.336 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T23:10:40.336 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:10:40.559 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T23:10:40.583 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T23:10:40.583 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:10:40.583 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-15T23:10:40.583 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T23:10:40.583 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T23:10:40.583 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:10:41.026 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T23:10:41.050 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T23:10:41.050 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:10:41.050 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-15T23:10:41.050 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T23:10:41.051 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T23:10:41.051 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:10:41.117 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T23:10:41.117 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /sys 2024-09-15T23:10:41.117 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /proc 2024-09-15T23:10:41.118 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /mnt 2024-09-15T23:10:41.118 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /var/tmp 2024-09-15T23:10:41.118 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /home 2024-09-15T23:10:41.118 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /root 2024-09-15T23:10:41.118 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /tmp 2024-09-15T23:10:41.118 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:10:41.156 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-15T23:10:41.213 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-15T23:10:41.268 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-15T23:10:41.297 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T23:10:41.314 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T23:10:41.314 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:10:41.314 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-15T23:10:41.315 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:10:41.453 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-15T23:10:41.502 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-15T23:10:41.572 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-15T23:10:41.660 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-15T23:10:41.801 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-15T23:10:41.863 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-15T23:10:41.901 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-15T23:10:41.929 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-15T23:10:42.366 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T23:10:42.395 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T23:10:42.426 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-15T23:10:42.505 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-15T23:10:42.534 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T23:10:42.784 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T23:10:42.810 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T23:10:42.811 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:10:42.811 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-15T23:10:42.811 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T23:10:42.811 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T23:10:42.811 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:10:43.034 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T23:10:43.058 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T23:10:43.058 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:10:43.058 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-15T23:10:43.058 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T23:10:43.058 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T23:10:43.058 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:10:43.502 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T23:10:43.525 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T23:10:43.525 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:10:43.525 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-15T23:10:43.525 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T23:10:43.526 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T23:10:43.526 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:10:43.584 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T23:10:43.628 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T23:10:43.631 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-15T23:10:43.697 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-15T23:10:43.761 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-15T23:10:43.947 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-15T23:10:43.994 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-15T23:10:44.071 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-15T23:10:44.168 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-15T23:10:44.317 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-15T23:10:44.366 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-15T23:10:44.400 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-15T23:10:44.428 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-15T23:10:44.593 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T23:10:44.645 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T23:10:44.746 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T23:10:44.891 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T23:10:44.910 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-15T23:10:44.918 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T23:10:44.939 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T23:10:44.950 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-15T23:10:44.964 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T23:10:44.964 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:10:44.964 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-15T23:10:44.964 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T23:10:44.964 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T23:10:44.964 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:10:45.012 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-15T23:10:45.014 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T23:10:45.026 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T23:10:45.041 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T23:10:45.123 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-15T23:10:45.178 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-15T23:10:46.085 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T23:10:46.103 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-15T23:10:46.126 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T23:10:46.134 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T23:10:46.158 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T23:10:46.158 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:10:46.158 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-15T23:10:46.158 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T23:10:46.158 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T23:10:46.158 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:10:46.209 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T23:10:46.233 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T23:10:46.233 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:10:46.233 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-15T23:10:46.233 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:10:46.293 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T23:10:46.317 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T23:10:46.317 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:10:46.317 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-15T23:10:46.317 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T23:10:46.318 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T23:10:46.318 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:10:46.627 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T23:10:46.651 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T23:10:46.652 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:10:46.652 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-15T23:10:46.652 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T23:10:46.652 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T23:10:46.652 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:10:47.094 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T23:10:47.127 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T23:10:47.231 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T23:10:47.415 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-15T23:10:47.445 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T23:10:47.470 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T23:10:47.470 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:10:47.470 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-15T23:10:47.470 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T23:10:47.470 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T23:10:47.471 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:10:47.521 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T23:10:47.533 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T23:10:47.630 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-15T23:10:47.688 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-15T23:10:48.609 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-15T23:10:48.640 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T23:10:48.664 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T23:10:48.664 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:10:48.664 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-15T23:10:48.664 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T23:10:48.664 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T23:10:48.665 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:10:48.707 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T23:10:48.731 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T23:10:48.731 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:10:48.731 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-15T23:10:48.731 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:10:48.783 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T23:10:48.807 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T23:10:48.807 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:10:48.807 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-15T23:10:48.807 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T23:10:48.807 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T23:10:48.807 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:10:49.109 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T23:10:49.133 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T23:10:49.133 INFO:teuthology.orchestra.run.smithi123.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:10:49.133 INFO:teuthology.orchestra.run.smithi123.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-15T23:10:49.133 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T23:10:49.133 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T23:10:49.133 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:10:51.231 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-15T23:10:51.272 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-15T23:10:51.313 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-15T23:10:51.345 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-15T23:10:51.372 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-15T23:10:51.571 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-15T23:10:51.620 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-15T23:10:51.659 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-15T23:10:51.688 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-15T23:10:51.742 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-15T23:10:52.326 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T23:10:52.366 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T23:10:52.387 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T23:10:53.225 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-15T23:10:53.313 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-15T23:10:53.370 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-15T23:10:53.460 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-15T23:10:53.499 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-15T23:10:53.525 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-15T23:10:53.550 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-15T23:10:53.551 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T23:10:53.645 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T23:10:53.645 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T23:10:53.687 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-15T23:10:53.727 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T23:10:53.728 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-15T23:10:53.752 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-15T23:10:53.758 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T23:10:53.758 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T23:10:53.769 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-15T23:10:53.801 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-15T23:10:53.828 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-15T23:10:53.946 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T23:10:53.946 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T23:10:54.025 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-15T23:10:54.030 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T23:10:54.074 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-15T23:10:54.096 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T23:10:54.105 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-15T23:10:54.134 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-15T23:10:54.181 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-15T23:10:54.807 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T23:10:54.853 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T23:10:54.874 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T23:10:55.715 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-15T23:10:55.808 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-15T23:10:55.858 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-15T23:10:55.953 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-15T23:10:55.987 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-15T23:10:56.011 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-15T23:10:56.037 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-15T23:10:56.037 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T23:10:56.121 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T23:10:56.121 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T23:10:56.205 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T23:10:56.238 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-15T23:10:56.244 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T23:10:56.244 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T23:10:56.423 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T23:10:56.424 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T23:10:56.508 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T23:10:56.572 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T23:11:00.017 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T23:11:00.017 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-15T23:11:00.017 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-15T23:11:00.017 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-15T23:11:00.017 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-15T23:11:00.017 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-15T23:11:00.017 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-15T23:11:00.017 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-15T23:11:00.017 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T23:11:00.018 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T23:11:00.018 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T23:11:00.018 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-15T23:11:00.018 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-15T23:11:00.018 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T23:11:00.018 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-15T23:11:00.018 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-15T23:11:00.018 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-15T23:11:00.018 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-15T23:11:00.018 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-15T23:11:00.018 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-15T23:11:00.018 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-15T23:11:00.019 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-15T23:11:00.019 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-15T23:11:00.019 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-15T23:11:00.019 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-15T23:11:00.019 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-15T23:11:00.019 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-15T23:11:00.019 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-15T23:11:00.019 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-15T23:11:00.019 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-15T23:11:00.031 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-15T23:11:00.031 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-15T23:11:00.031 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-15T23:11:00.031 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-15T23:11:00.031 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-15T23:11:00.032 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-15T23:11:00.032 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-15T23:11:00.032 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-15T23:11:00.032 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-15T23:11:00.032 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-15T23:11:00.032 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-15T23:11:00.032 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-15T23:11:00.032 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-15T23:11:00.032 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-15T23:11:00.032 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-15T23:11:00.032 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-15T23:11:00.032 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-15T23:11:00.032 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-15T23:11:00.033 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-15T23:11:00.033 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-15T23:11:00.033 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-15T23:11:00.033 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-15T23:11:00.033 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-15T23:11:00.033 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-15T23:11:00.033 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-15T23:11:00.033 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-15T23:11:00.033 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-15T23:11:00.033 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-15T23:11:00.033 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-15T23:11:00.033 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-15T23:11:00.034 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-15T23:11:00.034 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-15T23:11:00.034 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-15T23:11:00.034 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-15T23:11:00.034 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-15T23:11:00.034 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-15T23:11:00.034 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-15T23:11:00.034 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-15T23:11:00.034 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-15T23:11:00.034 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-15T23:11:00.034 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-15T23:11:00.034 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-15T23:11:00.034 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-15T23:11:00.035 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-15T23:11:00.035 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-15T23:11:00.035 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-15T23:11:00.035 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-15T23:11:00.035 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-15T23:11:00.035 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-15T23:11:00.035 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-15T23:11:00.035 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-15T23:11:00.035 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-15T23:11:00.035 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-15T23:11:00.035 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-15T23:11:00.035 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-15T23:11:00.035 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-15T23:11:00.036 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-15T23:11:00.036 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-15T23:11:00.036 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-15T23:11:00.036 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-15T23:11:00.036 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-15T23:11:00.036 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-15T23:11:00.036 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-15T23:11:00.036 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-15T23:11:00.036 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-15T23:11:00.036 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-15T23:11:00.036 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-15T23:11:00.037 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-15T23:11:00.037 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-15T23:11:00.037 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-15T23:11:00.037 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-15T23:11:00.037 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-15T23:11:00.037 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-15T23:11:00.037 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-15T23:11:00.037 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-15T23:11:00.037 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-15T23:11:00.037 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-15T23:11:00.037 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-15T23:11:00.037 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-15T23:11:00.038 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-15T23:11:00.038 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-15T23:11:00.038 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-15T23:11:00.038 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-15T23:11:00.038 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-15T23:11:00.038 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-15T23:11:00.038 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-15T23:11:00.038 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-15T23:11:00.038 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-15T23:11:00.038 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-15T23:11:00.038 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-15T23:11:00.038 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-15T23:11:00.039 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-15T23:11:00.039 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-15T23:11:00.039 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-15T23:11:00.039 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-15T23:11:00.039 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-15T23:11:00.039 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-15T23:11:00.039 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-15T23:11:00.039 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-15T23:11:00.039 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-15T23:11:00.039 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-15T23:11:00.039 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-15T23:11:00.039 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-15T23:11:00.039 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-15T23:11:00.040 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-15T23:11:00.040 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-15T23:11:00.040 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-15T23:11:00.040 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-15T23:11:00.040 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-15T23:11:00.040 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-15T23:11:00.040 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-15T23:11:00.040 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-15T23:11:00.040 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-15T23:11:00.040 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-15T23:11:00.040 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-15T23:11:00.040 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-15T23:11:00.041 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-15T23:11:00.041 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-15T23:11:00.041 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-15T23:11:00.041 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-15T23:11:00.041 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-15T23:11:00.041 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-15T23:11:00.041 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-15T23:11:00.041 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-15T23:11:00.041 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-15T23:11:00.041 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-15T23:11:00.041 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-15T23:11:00.041 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-15T23:11:00.041 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-15T23:11:00.042 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-15T23:11:00.042 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-15T23:11:00.042 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-15T23:11:00.042 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-15T23:11:00.042 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-15T23:11:02.280 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T23:11:02.280 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-15T23:11:02.280 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-15T23:11:02.280 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-15T23:11:02.280 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-15T23:11:02.280 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-15T23:11:02.281 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-15T23:11:02.281 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-15T23:11:02.281 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T23:11:02.281 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T23:11:02.281 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T23:11:02.281 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-15T23:11:02.281 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-15T23:11:02.281 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T23:11:02.281 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-15T23:11:02.281 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-15T23:11:02.281 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-15T23:11:02.281 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-15T23:11:02.281 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-15T23:11:02.282 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-15T23:11:02.282 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-15T23:11:02.282 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-15T23:11:02.282 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-15T23:11:02.282 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-15T23:11:02.282 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-15T23:11:02.282 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-15T23:11:02.282 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-15T23:11:02.282 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-15T23:11:02.282 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-15T23:11:02.282 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-15T23:11:02.282 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-15T23:11:02.282 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-15T23:11:02.282 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-15T23:11:02.283 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-15T23:11:02.283 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-15T23:11:02.283 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-15T23:11:02.283 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-15T23:11:02.283 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-15T23:11:02.283 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-15T23:11:02.283 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-15T23:11:02.283 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-15T23:11:02.283 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-15T23:11:02.283 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-15T23:11:02.283 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-15T23:11:02.283 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-15T23:11:02.283 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-15T23:11:02.284 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-15T23:11:02.284 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-15T23:11:02.284 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-15T23:11:02.284 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-15T23:11:02.284 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-15T23:11:02.284 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-15T23:11:02.284 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-15T23:11:02.284 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-15T23:11:02.284 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-15T23:11:02.284 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-15T23:11:02.284 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-15T23:11:02.284 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-15T23:11:02.284 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-15T23:11:02.285 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-15T23:11:02.285 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-15T23:11:02.285 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-15T23:11:02.285 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-15T23:11:02.285 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-15T23:11:02.285 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-15T23:11:02.285 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-15T23:11:02.285 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-15T23:11:02.285 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-15T23:11:02.285 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-15T23:11:02.285 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-15T23:11:02.285 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-15T23:11:02.286 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-15T23:11:02.286 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-15T23:11:02.286 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-15T23:11:02.286 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-15T23:11:02.286 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-15T23:11:02.286 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-15T23:11:02.286 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-15T23:11:02.286 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-15T23:11:02.286 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-15T23:11:02.286 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-15T23:11:02.286 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-15T23:11:02.286 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-15T23:11:02.286 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-15T23:11:02.286 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-15T23:11:02.287 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-15T23:11:02.287 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-15T23:11:02.287 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-15T23:11:02.287 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-15T23:11:02.287 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-15T23:11:02.287 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-15T23:11:02.287 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-15T23:11:02.287 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-15T23:11:02.287 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-15T23:11:02.287 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-15T23:11:02.287 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-15T23:11:02.287 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-15T23:11:02.287 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-15T23:11:02.287 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-15T23:11:02.288 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-15T23:11:02.288 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-15T23:11:02.288 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-15T23:11:02.288 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-15T23:11:02.288 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-15T23:11:02.288 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-15T23:11:02.288 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-15T23:11:02.288 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-15T23:11:02.288 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-15T23:11:02.288 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-15T23:11:02.288 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-15T23:11:02.288 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-15T23:11:02.288 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-15T23:11:02.289 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-15T23:11:02.289 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-15T23:11:02.289 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-15T23:11:02.289 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-15T23:11:02.289 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-15T23:11:02.289 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-15T23:11:02.289 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-15T23:11:02.289 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-15T23:11:02.289 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-15T23:11:02.289 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-15T23:11:02.289 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-15T23:11:02.289 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-15T23:11:02.289 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-15T23:11:02.289 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-15T23:11:02.290 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-15T23:11:02.290 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-15T23:11:02.290 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-15T23:11:02.290 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-15T23:11:02.290 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-15T23:11:02.290 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-15T23:11:02.290 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-15T23:11:02.290 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-15T23:11:02.290 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-15T23:11:02.290 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-15T23:11:02.290 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-15T23:11:02.290 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-15T23:11:02.290 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-15T23:11:02.290 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-15T23:11:02.291 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-15T23:11:02.291 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-15T23:11:02.291 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-15T23:11:02.291 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-15T23:11:02.291 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-15T23:11:02.291 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-15T23:11:02.291 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-15T23:11:02.291 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-15T23:11:02.291 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-15T23:11:02.291 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-15T23:11:02.291 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-15T23:11:02.291 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-15T23:11:02.291 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-15T23:11:02.291 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-15T23:11:02.292 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-15T23:11:02.292 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-15T23:11:02.292 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-15T23:11:02.292 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-15T23:11:02.292 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-15T23:11:02.292 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-15T23:11:02.292 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-15T23:11:02.292 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-15T23:11:02.292 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-15T23:11:02.292 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-15T23:11:02.740 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T23:11:02.740 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:11:02.740 INFO:teuthology.orchestra.run.smithi188.stdout:Upgraded: 2024-09-15T23:11:02.740 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-15T23:11:02.741 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-15T23:11:02.741 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-15T23:11:02.741 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-15T23:11:02.741 INFO:teuthology.orchestra.run.smithi188.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:02.741 INFO:teuthology.orchestra.run.smithi188.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:02.741 INFO:teuthology.orchestra.run.smithi188.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-15T23:11:02.741 INFO:teuthology.orchestra.run.smithi188.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-15T23:11:02.741 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-09-15T23:11:02.741 INFO:teuthology.orchestra.run.smithi188.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-15T23:11:02.741 INFO:teuthology.orchestra.run.smithi188.stdout: automake-1.16.2-8.el9.noarch 2024-09-15T23:11:02.741 INFO:teuthology.orchestra.run.smithi188.stdout: bison-3.7.4-5.el9.x86_64 2024-09-15T23:11:02.741 INFO:teuthology.orchestra.run.smithi188.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-15T23:11:02.741 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:02.742 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:02.742 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:02.742 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:02.742 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:11:02.742 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:02.742 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:02.742 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:02.742 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:11:02.742 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:11:02.742 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:11:02.742 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:11:02.742 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:11:02.742 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:02.742 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:02.742 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:11:02.743 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:02.743 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:02.743 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:02.743 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:11:02.743 INFO:teuthology.orchestra.run.smithi188.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:11:02.743 INFO:teuthology.orchestra.run.smithi188.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:02.743 INFO:teuthology.orchestra.run.smithi188.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:02.743 INFO:teuthology.orchestra.run.smithi188.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:11:02.743 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-15T23:11:02.743 INFO:teuthology.orchestra.run.smithi188.stdout: flex-2.6.4-9.el9.x86_64 2024-09-15T23:11:02.743 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-15T23:11:02.743 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-15T23:11:02.743 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-15T23:11:02.743 INFO:teuthology.orchestra.run.smithi188.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-15T23:11:02.744 INFO:teuthology.orchestra.run.smithi188.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-15T23:11:02.744 INFO:teuthology.orchestra.run.smithi188.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-15T23:11:02.744 INFO:teuthology.orchestra.run.smithi188.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-15T23:11:02.744 INFO:teuthology.orchestra.run.smithi188.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-15T23:11:02.744 INFO:teuthology.orchestra.run.smithi188.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-15T23:11:02.744 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:02.744 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:02.744 INFO:teuthology.orchestra.run.smithi188.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:02.744 INFO:teuthology.orchestra.run.smithi188.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-15T23:11:02.744 INFO:teuthology.orchestra.run.smithi188.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-15T23:11:02.744 INFO:teuthology.orchestra.run.smithi188.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-15T23:11:02.744 INFO:teuthology.orchestra.run.smithi188.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-15T23:11:02.744 INFO:teuthology.orchestra.run.smithi188.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-15T23:11:02.744 INFO:teuthology.orchestra.run.smithi188.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:02.745 INFO:teuthology.orchestra.run.smithi188.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:02.745 INFO:teuthology.orchestra.run.smithi188.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-15T23:11:02.745 INFO:teuthology.orchestra.run.smithi188.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:02.745 INFO:teuthology.orchestra.run.smithi188.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-15T23:11:02.745 INFO:teuthology.orchestra.run.smithi188.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-15T23:11:02.745 INFO:teuthology.orchestra.run.smithi188.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-15T23:11:02.745 INFO:teuthology.orchestra.run.smithi188.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-15T23:11:02.745 INFO:teuthology.orchestra.run.smithi188.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-15T23:11:02.745 INFO:teuthology.orchestra.run.smithi188.stdout: lua-5.4.4-4.el9.x86_64 2024-09-15T23:11:02.745 INFO:teuthology.orchestra.run.smithi188.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-15T23:11:02.745 INFO:teuthology.orchestra.run.smithi188.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-15T23:11:02.745 INFO:teuthology.orchestra.run.smithi188.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-15T23:11:02.745 INFO:teuthology.orchestra.run.smithi188.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-15T23:11:02.745 INFO:teuthology.orchestra.run.smithi188.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-15T23:11:02.746 INFO:teuthology.orchestra.run.smithi188.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-15T23:11:02.746 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-13.16-1.el9.x86_64 2024-09-15T23:11:02.746 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-15T23:11:02.746 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-15T23:11:02.746 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-15T23:11:02.746 INFO:teuthology.orchestra.run.smithi188.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-15T23:11:02.746 INFO:teuthology.orchestra.run.smithi188.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-15T23:11:02.746 INFO:teuthology.orchestra.run.smithi188.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-15T23:11:02.746 INFO:teuthology.orchestra.run.smithi188.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-15T23:11:02.746 INFO:teuthology.orchestra.run.smithi188.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-15T23:11:02.746 INFO:teuthology.orchestra.run.smithi188.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-15T23:11:02.746 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-15T23:11:02.746 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:02.746 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:02.747 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:02.747 INFO:teuthology.orchestra.run.smithi188.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-15T23:11:02.747 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-15T23:11:02.747 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-15T23:11:02.747 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-15T23:11:02.747 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-15T23:11:02.747 INFO:teuthology.orchestra.run.smithi188.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-15T23:11:02.747 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-15T23:11:02.747 INFO:teuthology.orchestra.run.smithi188.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-15T23:11:02.747 INFO:teuthology.orchestra.run.smithi188.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-15T23:11:02.747 INFO:teuthology.orchestra.run.smithi188.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-15T23:11:02.747 INFO:teuthology.orchestra.run.smithi188.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-15T23:11:02.747 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-15T23:11:02.747 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-15T23:11:02.747 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-15T23:11:02.748 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-15T23:11:02.748 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-15T23:11:02.748 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-15T23:11:02.748 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-15T23:11:02.748 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-15T23:11:02.748 INFO:teuthology.orchestra.run.smithi188.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-15T23:11:02.748 INFO:teuthology.orchestra.run.smithi188.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-15T23:11:02.748 INFO:teuthology.orchestra.run.smithi188.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-15T23:11:02.748 INFO:teuthology.orchestra.run.smithi188.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-15T23:11:02.748 INFO:teuthology.orchestra.run.smithi188.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-15T23:11:02.748 INFO:teuthology.orchestra.run.smithi188.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-15T23:11:02.748 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-15T23:11:02.748 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-15T23:11:02.749 INFO:teuthology.orchestra.run.smithi188.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-15T23:11:02.749 INFO:teuthology.orchestra.run.smithi188.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-15T23:11:02.749 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-15T23:11:02.749 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ply-3.11-14.el9.noarch 2024-09-15T23:11:02.749 INFO:teuthology.orchestra.run.smithi188.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-15T23:11:02.749 INFO:teuthology.orchestra.run.smithi188.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-15T23:11:02.749 INFO:teuthology.orchestra.run.smithi188.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-15T23:11:02.749 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-15T23:11:02.749 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-15T23:11:02.749 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-15T23:11:02.749 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-15T23:11:02.749 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-15T23:11:02.749 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-15T23:11:02.750 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:02.750 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:02.750 INFO:teuthology.orchestra.run.smithi188.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-15T23:11:02.750 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-15T23:11:02.750 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-15T23:11:02.750 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:02.750 INFO:teuthology.orchestra.run.smithi188.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-15T23:11:02.750 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-15T23:11:02.750 INFO:teuthology.orchestra.run.smithi188.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-15T23:11:02.750 INFO:teuthology.orchestra.run.smithi188.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-15T23:11:02.750 INFO:teuthology.orchestra.run.smithi188.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-15T23:11:02.750 INFO:teuthology.orchestra.run.smithi188.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-15T23:11:02.750 INFO:teuthology.orchestra.run.smithi188.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-15T23:11:02.751 INFO:teuthology.orchestra.run.smithi188.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-15T23:11:02.751 INFO:teuthology.orchestra.run.smithi188.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-15T23:11:02.751 INFO:teuthology.orchestra.run.smithi188.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-15T23:11:02.751 INFO:teuthology.orchestra.run.smithi188.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-15T23:11:02.751 INFO:teuthology.orchestra.run.smithi188.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-15T23:11:02.751 INFO:teuthology.orchestra.run.smithi188.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-15T23:11:02.751 INFO:teuthology.orchestra.run.smithi188.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-15T23:11:02.751 INFO:teuthology.orchestra.run.smithi188.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-15T23:11:02.751 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:02.751 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:02.751 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:02.751 INFO:teuthology.orchestra.run.smithi188.stdout: re2-1:20211101-20.el9.x86_64 2024-09-15T23:11:02.751 INFO:teuthology.orchestra.run.smithi188.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-15T23:11:02.751 INFO:teuthology.orchestra.run.smithi188.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-15T23:11:02.752 INFO:teuthology.orchestra.run.smithi188.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-15T23:11:02.752 INFO:teuthology.orchestra.run.smithi188.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-15T23:11:02.752 INFO:teuthology.orchestra.run.smithi188.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-15T23:11:02.752 INFO:teuthology.orchestra.run.smithi188.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-15T23:11:02.752 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:11:02.752 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-09-15T23:11:03.201 DEBUG:teuthology.parallel:result is None 2024-09-15T23:11:04.716 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T23:11:04.716 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:11:04.716 INFO:teuthology.orchestra.run.smithi123.stdout:Upgraded: 2024-09-15T23:11:04.716 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-15T23:11:04.716 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-15T23:11:04.716 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-15T23:11:04.717 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-15T23:11:04.717 INFO:teuthology.orchestra.run.smithi123.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:04.717 INFO:teuthology.orchestra.run.smithi123.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:04.717 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-15T23:11:04.717 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-15T23:11:04.717 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-09-15T23:11:04.717 INFO:teuthology.orchestra.run.smithi123.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-15T23:11:04.717 INFO:teuthology.orchestra.run.smithi123.stdout: automake-1.16.2-8.el9.noarch 2024-09-15T23:11:04.717 INFO:teuthology.orchestra.run.smithi123.stdout: bison-3.7.4-5.el9.x86_64 2024-09-15T23:11:04.717 INFO:teuthology.orchestra.run.smithi123.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-15T23:11:04.717 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:04.717 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:04.718 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:04.718 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:04.718 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:11:04.718 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:04.718 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:04.718 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:04.718 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:11:04.718 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:11:04.718 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:11:04.718 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:11:04.718 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:11:04.718 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:04.719 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:04.719 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:11:04.719 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:04.719 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:04.719 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:04.719 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:11:04.719 INFO:teuthology.orchestra.run.smithi123.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:11:04.719 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:04.719 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:04.719 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:11:04.719 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-15T23:11:04.719 INFO:teuthology.orchestra.run.smithi123.stdout: flex-2.6.4-9.el9.x86_64 2024-09-15T23:11:04.719 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-15T23:11:04.720 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-15T23:11:04.720 INFO:teuthology.orchestra.run.smithi123.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-15T23:11:04.720 INFO:teuthology.orchestra.run.smithi123.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-15T23:11:04.720 INFO:teuthology.orchestra.run.smithi123.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-15T23:11:04.720 INFO:teuthology.orchestra.run.smithi123.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-15T23:11:04.720 INFO:teuthology.orchestra.run.smithi123.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-15T23:11:04.720 INFO:teuthology.orchestra.run.smithi123.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-15T23:11:04.720 INFO:teuthology.orchestra.run.smithi123.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-15T23:11:04.720 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:04.720 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:04.720 INFO:teuthology.orchestra.run.smithi123.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:04.720 INFO:teuthology.orchestra.run.smithi123.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-15T23:11:04.720 INFO:teuthology.orchestra.run.smithi123.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-15T23:11:04.721 INFO:teuthology.orchestra.run.smithi123.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-15T23:11:04.721 INFO:teuthology.orchestra.run.smithi123.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-15T23:11:04.721 INFO:teuthology.orchestra.run.smithi123.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-15T23:11:04.721 INFO:teuthology.orchestra.run.smithi123.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:04.721 INFO:teuthology.orchestra.run.smithi123.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:04.721 INFO:teuthology.orchestra.run.smithi123.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-15T23:11:04.721 INFO:teuthology.orchestra.run.smithi123.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:04.721 INFO:teuthology.orchestra.run.smithi123.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-15T23:11:04.721 INFO:teuthology.orchestra.run.smithi123.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-15T23:11:04.721 INFO:teuthology.orchestra.run.smithi123.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-15T23:11:04.721 INFO:teuthology.orchestra.run.smithi123.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-15T23:11:04.721 INFO:teuthology.orchestra.run.smithi123.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-15T23:11:04.722 INFO:teuthology.orchestra.run.smithi123.stdout: lua-5.4.4-4.el9.x86_64 2024-09-15T23:11:04.722 INFO:teuthology.orchestra.run.smithi123.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-15T23:11:04.722 INFO:teuthology.orchestra.run.smithi123.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-15T23:11:04.722 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-15T23:11:04.722 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-15T23:11:04.722 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-15T23:11:04.722 INFO:teuthology.orchestra.run.smithi123.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-15T23:11:04.722 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-13.16-1.el9.x86_64 2024-09-15T23:11:04.722 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-15T23:11:04.722 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-15T23:11:04.722 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-15T23:11:04.722 INFO:teuthology.orchestra.run.smithi123.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-15T23:11:04.722 INFO:teuthology.orchestra.run.smithi123.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-15T23:11:04.722 INFO:teuthology.orchestra.run.smithi123.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-15T23:11:04.723 INFO:teuthology.orchestra.run.smithi123.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-15T23:11:04.723 INFO:teuthology.orchestra.run.smithi123.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-15T23:11:04.723 INFO:teuthology.orchestra.run.smithi123.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-15T23:11:04.723 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-15T23:11:04.723 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:04.723 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:04.723 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:04.723 INFO:teuthology.orchestra.run.smithi123.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-15T23:11:04.723 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-15T23:11:04.723 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-15T23:11:04.723 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-15T23:11:04.723 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-15T23:11:04.723 INFO:teuthology.orchestra.run.smithi123.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-15T23:11:04.724 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-15T23:11:04.724 INFO:teuthology.orchestra.run.smithi123.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-15T23:11:04.724 INFO:teuthology.orchestra.run.smithi123.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-15T23:11:04.724 INFO:teuthology.orchestra.run.smithi123.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-15T23:11:04.724 INFO:teuthology.orchestra.run.smithi123.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-15T23:11:04.724 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-15T23:11:04.724 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-15T23:11:04.724 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-15T23:11:04.724 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-15T23:11:04.724 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-15T23:11:04.724 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-15T23:11:04.724 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-15T23:11:04.724 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-15T23:11:04.725 INFO:teuthology.orchestra.run.smithi123.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-15T23:11:04.725 INFO:teuthology.orchestra.run.smithi123.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-15T23:11:04.725 INFO:teuthology.orchestra.run.smithi123.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-15T23:11:04.725 INFO:teuthology.orchestra.run.smithi123.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-15T23:11:04.725 INFO:teuthology.orchestra.run.smithi123.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-15T23:11:04.725 INFO:teuthology.orchestra.run.smithi123.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-15T23:11:04.725 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-15T23:11:04.725 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-15T23:11:04.725 INFO:teuthology.orchestra.run.smithi123.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-15T23:11:04.725 INFO:teuthology.orchestra.run.smithi123.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-15T23:11:04.725 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-15T23:11:04.725 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ply-3.11-14.el9.noarch 2024-09-15T23:11:04.725 INFO:teuthology.orchestra.run.smithi123.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-15T23:11:04.726 INFO:teuthology.orchestra.run.smithi123.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-15T23:11:04.726 INFO:teuthology.orchestra.run.smithi123.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-15T23:11:04.726 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-15T23:11:04.726 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-15T23:11:04.726 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-15T23:11:04.726 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-15T23:11:04.726 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-15T23:11:04.726 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-15T23:11:04.726 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:04.726 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:04.726 INFO:teuthology.orchestra.run.smithi123.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-15T23:11:04.726 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-15T23:11:04.726 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-15T23:11:04.726 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:04.727 INFO:teuthology.orchestra.run.smithi123.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-15T23:11:04.727 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-15T23:11:04.727 INFO:teuthology.orchestra.run.smithi123.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-15T23:11:04.727 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-15T23:11:04.727 INFO:teuthology.orchestra.run.smithi123.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-15T23:11:04.727 INFO:teuthology.orchestra.run.smithi123.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-15T23:11:04.727 INFO:teuthology.orchestra.run.smithi123.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-15T23:11:04.727 INFO:teuthology.orchestra.run.smithi123.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-15T23:11:04.727 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-15T23:11:04.727 INFO:teuthology.orchestra.run.smithi123.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-15T23:11:04.727 INFO:teuthology.orchestra.run.smithi123.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-15T23:11:04.727 INFO:teuthology.orchestra.run.smithi123.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-15T23:11:04.727 INFO:teuthology.orchestra.run.smithi123.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-15T23:11:04.728 INFO:teuthology.orchestra.run.smithi123.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-15T23:11:04.728 INFO:teuthology.orchestra.run.smithi123.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-15T23:11:04.728 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:04.728 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:04.728 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:11:04.728 INFO:teuthology.orchestra.run.smithi123.stdout: re2-1:20211101-20.el9.x86_64 2024-09-15T23:11:04.728 INFO:teuthology.orchestra.run.smithi123.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-15T23:11:04.728 INFO:teuthology.orchestra.run.smithi123.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-15T23:11:04.728 INFO:teuthology.orchestra.run.smithi123.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-15T23:11:04.728 INFO:teuthology.orchestra.run.smithi123.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-15T23:11:04.728 INFO:teuthology.orchestra.run.smithi123.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-15T23:11:04.729 INFO:teuthology.orchestra.run.smithi123.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-15T23:11:04.729 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:11:04.729 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-09-15T23:11:05.158 DEBUG:teuthology.parallel:result is None 2024-09-15T23:11:05.159 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T23:11:05.302 DEBUG:teuthology.orchestra.run.smithi123:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-15T23:11:05.324 INFO:teuthology.orchestra.run.smithi123.stdout:19.1.1-326.g8921c8ef.el9 2024-09-15T23:11:05.325 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-15T23:11:05.325 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-15T23:11:05.327 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T23:11:05.470 DEBUG:teuthology.orchestra.run.smithi188:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-15T23:11:05.496 INFO:teuthology.orchestra.run.smithi188.stdout:19.1.1-326.g8921c8ef.el9 2024-09-15T23:11:05.496 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-15T23:11:05.496 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-15T23:11:05.498 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-15T23:11:05.498 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:11:05.498 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T23:11:05.525 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:11:05.525 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T23:11:05.567 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-15T23:11:05.567 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:11:05.567 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T23:11:05.592 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T23:11:05.657 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:11:05.657 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T23:11:05.685 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T23:11:05.751 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-15T23:11:05.752 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:11:05.752 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T23:11:05.776 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T23:11:05.840 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:11:05.840 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T23:11:05.867 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T23:11:05.933 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-15T23:11:05.933 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:11:05.933 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T23:11:05.957 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T23:11:06.022 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:11:06.022 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T23:11:06.048 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T23:11:06.114 INFO:teuthology.run_tasks:Running task ceph... 2024-09-15T23:11:06.195 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-15T23:11:06.195 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 777 /var/log/ceph 2024-09-15T23:11:06.197 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 777 /var/log/ceph 2024-09-15T23:11:06.223 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-15T23:11:06.223 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-15T23:11:06.262 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-15T23:11:06.287 INFO:tasks.ceph:Creating extra log directories... 2024-09-15T23:11:06.288 DEBUG:teuthology.orchestra.run.smithi123:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-15T23:11:06.326 DEBUG:teuthology.orchestra.run.smithi188:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-15T23:11:06.358 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-15T23:11:06.358 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-15T23:11:06.358 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-15T23:11:06.358 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:11:06.359 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-15T23:11:06.404 DEBUG:teuthology.orchestra.run.smithi123:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-15T23:11:06.513 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-15T23:11:06.538 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:11:06.538 DEBUG:teuthology.orchestra.run.smithi188:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-15T23:11:06.553 DEBUG:teuthology.orchestra.run.smithi188:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-15T23:11:06.665 DEBUG:teuthology.orchestra.run.smithi188:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-15T23:11:06.695 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-15T23:11:06.695 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-15T23:11:06.695 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906308', 'branch': 'squid', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/scrub}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7906308', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'ad35db06e8924912f01e32b35576297c0f1352b4'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 3393, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'sleep_before_teardown': 0, 'subset': '294/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'ad35db06e8924912f01e32b35576297c0f1352b4', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi123.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOvJnpUsOVZ9zPfcZHW5oP/s+VQa7H5AGXG1g/Gj1CDStjxoNEp5nlPfyfAW185RldTuuA952H+UL16Jzyteqy0=', 'smithi188.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGF4laCqzvu23hCbchUBbUoREkmElApAuaE4nSM2Megg3fGlIHrP69cKVvGg7yLdtwIRL2HwBBGzn+cXTolD3TA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_scrub_checks', 'tasks.cephfs.test_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-15_21:24:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-15T23:11:06.696 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-15T23:11:06.698 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-15T23:11:06.746 DEBUG:teuthology.orchestra.run.smithi123:> sudo install -d -m0777 -- /var/run/ceph 2024-09-15T23:11:06.754 DEBUG:teuthology.orchestra.run.smithi188:> sudo install -d -m0777 -- /var/run/ceph 2024-09-15T23:11:06.811 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:11:06.811 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T23:11:06.832 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T23:11:06.832 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_1 2024-09-15T23:11:06.887 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T23:11:06.887 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:11:06.887 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-15T23:11:06.887 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:11:06.887 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T23:11:06.887 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-09-15 23:10:56.941124215 +0000 2024-09-15T23:11:06.887 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-09-15 23:09:11.759230405 +0000 2024-09-15T23:11:06.887 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-09-15 23:09:11.759230405 +0000 2024-09-15T23:11:06.887 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-09-15 23:09:11.759230405 +0000 2024-09-15T23:11:06.888 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T23:11:06.949 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:11:06.949 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:11:06.949 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000180473 s, 2.8 MB/s 2024-09-15T23:11:06.951 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T23:11:07.007 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_2 2024-09-15T23:11:07.063 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T23:11:07.063 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:11:07.063 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-15T23:11:07.063 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:11:07.063 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T23:11:07.063 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-09-15 23:10:56.942124191 +0000 2024-09-15T23:11:07.063 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-09-15 23:09:12.089222583 +0000 2024-09-15T23:11:07.063 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-09-15 23:09:12.089222583 +0000 2024-09-15T23:11:07.063 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-09-15 23:09:12.089222583 +0000 2024-09-15T23:11:07.063 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T23:11:07.126 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:11:07.126 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:11:07.126 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000217831 s, 2.4 MB/s 2024-09-15T23:11:07.127 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T23:11:07.183 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_3 2024-09-15T23:11:07.239 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T23:11:07.239 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:11:07.239 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-15T23:11:07.239 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:11:07.239 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T23:11:07.239 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-09-15 23:10:56.942124191 +0000 2024-09-15T23:11:07.239 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-09-15 23:09:12.421214714 +0000 2024-09-15T23:11:07.239 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-09-15 23:09:12.421214714 +0000 2024-09-15T23:11:07.239 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-09-15 23:09:12.421214714 +0000 2024-09-15T23:11:07.240 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T23:11:07.301 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:11:07.301 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:11:07.301 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.00017327 s, 3.0 MB/s 2024-09-15T23:11:07.303 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T23:11:07.359 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_4 2024-09-15T23:11:07.414 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T23:11:07.414 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:11:07.414 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-15T23:11:07.414 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:11:07.414 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T23:11:07.414 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-09-15 23:10:56.942124191 +0000 2024-09-15T23:11:07.414 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-09-15 23:09:12.750206916 +0000 2024-09-15T23:11:07.414 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-09-15 23:09:12.750206916 +0000 2024-09-15T23:11:07.414 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-09-15 23:09:12.750206916 +0000 2024-09-15T23:11:07.414 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T23:11:07.476 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:11:07.476 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:11:07.476 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000201487 s, 2.5 MB/s 2024-09-15T23:11:07.478 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T23:11:07.533 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T23:11:07.533 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:11:07.534 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T23:11:07.550 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T23:11:07.551 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_1 2024-09-15T23:11:07.606 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T23:11:07.606 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:11:07.607 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-15T23:11:07.607 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:11:07.607 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T23:11:07.607 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2024-09-15 23:10:54.443737414 +0000 2024-09-15T23:11:07.607 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2024-09-15 23:09:12.303539754 +0000 2024-09-15T23:11:07.607 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2024-09-15 23:09:12.303539754 +0000 2024-09-15T23:11:07.607 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: 2024-09-15 23:09:12.303539754 +0000 2024-09-15T23:11:07.607 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T23:11:07.671 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2024-09-15T23:11:07.671 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2024-09-15T23:11:07.671 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000265842 s, 1.9 MB/s 2024-09-15T23:11:07.672 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T23:11:07.729 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_2 2024-09-15T23:11:07.785 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T23:11:07.785 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:11:07.785 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-15T23:11:07.786 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:11:07.786 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T23:11:07.786 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2024-09-15 23:10:54.443737414 +0000 2024-09-15T23:11:07.786 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2024-09-15 23:09:12.627533657 +0000 2024-09-15T23:11:07.786 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2024-09-15 23:09:12.627533657 +0000 2024-09-15T23:11:07.786 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: 2024-09-15 23:09:12.627533657 +0000 2024-09-15T23:11:07.786 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T23:11:07.849 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2024-09-15T23:11:07.849 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2024-09-15T23:11:07.850 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000190042 s, 2.7 MB/s 2024-09-15T23:11:07.851 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T23:11:07.907 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_3 2024-09-15T23:11:07.962 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T23:11:07.962 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:11:07.962 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-15T23:11:07.962 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:11:07.962 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T23:11:07.962 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2024-09-15 23:10:54.443737414 +0000 2024-09-15T23:11:07.962 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2024-09-15 23:09:12.947527636 +0000 2024-09-15T23:11:07.962 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2024-09-15 23:09:12.947527636 +0000 2024-09-15T23:11:07.962 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: 2024-09-15 23:09:12.947527636 +0000 2024-09-15T23:11:07.963 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T23:11:08.024 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2024-09-15T23:11:08.025 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2024-09-15T23:11:08.025 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000186535 s, 2.7 MB/s 2024-09-15T23:11:08.026 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T23:11:08.082 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_4 2024-09-15T23:11:08.137 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T23:11:08.137 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:11:08.137 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-15T23:11:08.137 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:11:08.137 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T23:11:08.137 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2024-09-15 23:10:54.444737395 +0000 2024-09-15T23:11:08.137 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2024-09-15 23:09:13.278521407 +0000 2024-09-15T23:11:08.137 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2024-09-15 23:09:13.278521407 +0000 2024-09-15T23:11:08.137 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: 2024-09-15 23:09:13.278521407 +0000 2024-09-15T23:11:08.138 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T23:11:08.199 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2024-09-15T23:11:08.199 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2024-09-15T23:11:08.199 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.00018827 s, 2.7 MB/s 2024-09-15T23:11:08.201 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T23:11:08.256 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T23:11:08.257 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi123.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi188.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-15T23:11:08.257 INFO:tasks.ceph:Generating config... 2024-09-15T23:11:08.258 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-15T23:11:08.258 INFO:tasks.ceph:[client] debug client = 20 2024-09-15T23:11:08.258 INFO:tasks.ceph:[client] debug ms = 1 2024-09-15T23:11:08.258 INFO:tasks.ceph:[client] pid file = 2024-09-15T23:11:08.258 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-15T23:11:08.258 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-15T23:11:08.259 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-15T23:11:08.259 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-15T23:11:08.259 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-15T23:11:08.259 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-15T23:11:08.259 INFO:tasks.ceph:[mds] mds cache max size = 1000 2024-09-15T23:11:08.259 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-15T23:11:08.259 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-15T23:11:08.259 INFO:tasks.ceph:[mds] mds log max segments = 1 2024-09-15T23:11:08.259 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-15T23:11:08.259 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-15T23:11:08.259 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-15T23:11:08.259 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-15T23:11:08.259 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-15T23:11:08.259 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-15T23:11:08.260 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-15T23:11:08.260 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-15T23:11:08.260 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-15T23:11:08.260 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-15T23:11:08.260 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-15T23:11:08.260 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-15T23:11:08.260 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-15T23:11:08.260 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-15T23:11:08.260 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-15T23:11:08.260 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-15T23:11:08.260 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-15T23:11:08.260 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-15T23:11:08.260 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-15T23:11:08.260 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-15T23:11:08.261 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-15T23:11:08.261 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-15T23:11:08.261 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-15T23:11:08.261 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-15T23:11:08.261 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-15T23:11:08.261 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-15T23:11:08.261 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-15T23:11:08.261 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-15T23:11:08.261 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-15T23:11:08.261 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-15T23:11:08.261 INFO:tasks.ceph:Setting up mon.a... 2024-09-15T23:11:08.262 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-15T23:11:08.312 INFO:teuthology.orchestra.run.smithi123.stdout:creating /etc/ceph/ceph.keyring 2024-09-15T23:11:08.315 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-15T23:11:08.358 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-15T23:11:08.422 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.123'), ('mon.b', '172.21.15.188'), ('mon.c', '[v2:172.21.15.188:3301,v1:172.21.15.188:6790]')] 2024-09-15T23:11:08.423 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.123,172.21.15.188,[v2:172.21.15.188:3301,v1:172.21.15.188:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-15T23:11:08.424 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:11:08.424 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-15T23:11:08.478 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.123 --add b 172.21.15.188 --addv c '[v2:172.21.15.188:3301,v1:172.21.15.188:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-15T23:11:08.565 INFO:teuthology.orchestra.run.smithi123.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-15T23:11:08.565 INFO:teuthology.orchestra.run.smithi123.stdout:monmaptool: generated fsid cb968ac4-8d3a-4b17-a673-6177aeaea589 2024-09-15T23:11:08.565 INFO:teuthology.orchestra.run.smithi123.stdout:setting min_mon_release = quincy 2024-09-15T23:11:08.565 INFO:teuthology.orchestra.run.smithi123.stdout:epoch 0 2024-09-15T23:11:08.565 INFO:teuthology.orchestra.run.smithi123.stdout:fsid cb968ac4-8d3a-4b17-a673-6177aeaea589 2024-09-15T23:11:08.565 INFO:teuthology.orchestra.run.smithi123.stdout:last_changed 2024-09-15T23:11:08.565168+0000 2024-09-15T23:11:08.566 INFO:teuthology.orchestra.run.smithi123.stdout:created 2024-09-15T23:11:08.565168+0000 2024-09-15T23:11:08.566 INFO:teuthology.orchestra.run.smithi123.stdout:min_mon_release 17 (quincy) 2024-09-15T23:11:08.566 INFO:teuthology.orchestra.run.smithi123.stdout:election_strategy: 1 2024-09-15T23:11:08.566 INFO:teuthology.orchestra.run.smithi123.stdout:0: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.a 2024-09-15T23:11:08.566 INFO:teuthology.orchestra.run.smithi123.stdout:1: [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] mon.b 2024-09-15T23:11:08.566 INFO:teuthology.orchestra.run.smithi123.stdout:2: [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] mon.c 2024-09-15T23:11:08.566 INFO:teuthology.orchestra.run.smithi123.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-15T23:11:08.567 DEBUG:teuthology.orchestra.run.smithi123:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-15T23:11:08.582 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID cb968ac4-8d3a-4b17-a673-6177aeaea589... 2024-09-15T23:11:08.583 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T23:11:08.626 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T23:11:08.665 INFO:teuthology.orchestra.run.smithi123.stdout:[global] 2024-09-15T23:11:08.665 INFO:teuthology.orchestra.run.smithi123.stdout: chdir = "" 2024-09-15T23:11:08.666 INFO:teuthology.orchestra.run.smithi123.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T23:11:08.666 INFO:teuthology.orchestra.run.smithi123.stdout: auth supported = cephx 2024-09-15T23:11:08.666 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:11:08.666 INFO:teuthology.orchestra.run.smithi123.stdout: filestore xattr use omap = true 2024-09-15T23:11:08.666 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:11:08.666 INFO:teuthology.orchestra.run.smithi123.stdout: mon clock drift allowed = 1.000 2024-09-15T23:11:08.666 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:11:08.666 INFO:teuthology.orchestra.run.smithi123.stdout: osd crush chooseleaf type = 0 2024-09-15T23:11:08.666 INFO:teuthology.orchestra.run.smithi123.stdout: auth debug = true 2024-09-15T23:11:08.666 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:11:08.666 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on old message = true 2024-09-15T23:11:08.666 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on bug = true 2024-09-15T23:11:08.666 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:11:08.666 INFO:teuthology.orchestra.run.smithi123.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T23:11:08.667 INFO:teuthology.orchestra.run.smithi123.stdout: mon pg warn max object skew = 0 2024-09-15T23:11:08.667 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:11:08.667 INFO:teuthology.orchestra.run.smithi123.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T23:11:08.667 INFO:teuthology.orchestra.run.smithi123.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T23:11:08.667 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:11:08.667 INFO:teuthology.orchestra.run.smithi123.stdout: osd pool default size = 2 2024-09-15T23:11:08.667 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:11:08.667 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd allow primary affinity = true 2024-09-15T23:11:08.667 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd allow pg remap = true 2024-09-15T23:11:08.667 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on legacy crush tunables = false 2024-09-15T23:11:08.667 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on crush straw calc version zero = false 2024-09-15T23:11:08.667 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on no sortbitwise = false 2024-09-15T23:11:08.667 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on osd down out interval zero = false 2024-09-15T23:11:08.667 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on too few osds = false 2024-09-15T23:11:08.668 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T23:11:08.668 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T23:11:08.668 INFO:teuthology.orchestra.run.smithi123.stdout: mon_allow_pool_size_one = true 2024-09-15T23:11:08.668 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:11:08.668 INFO:teuthology.orchestra.run.smithi123.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T23:11:08.668 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:11:08.668 INFO:teuthology.orchestra.run.smithi123.stdout: osd default data pool replay window = 5 2024-09-15T23:11:08.668 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:11:08.668 INFO:teuthology.orchestra.run.smithi123.stdout: mon allow pool delete = true 2024-09-15T23:11:08.668 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:11:08.668 INFO:teuthology.orchestra.run.smithi123.stdout: mon cluster log file level = debug 2024-09-15T23:11:08.668 INFO:teuthology.orchestra.run.smithi123.stdout: debug asserts on shutdown = true 2024-09-15T23:11:08.669 INFO:teuthology.orchestra.run.smithi123.stdout: mon health detail to clog = false 2024-09-15T23:11:08.669 INFO:teuthology.orchestra.run.smithi123.stdout: mon host = "172.21.15.123,172.21.15.188,[v2:172.21.15.188:3301,v1:172.21.15.188:6790]" 2024-09-15T23:11:08.669 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on skipped message = False 2024-09-15T23:11:08.669 INFO:teuthology.orchestra.run.smithi123.stdout: fsid = cb968ac4-8d3a-4b17-a673-6177aeaea589 2024-09-15T23:11:08.669 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:11:08.669 INFO:teuthology.orchestra.run.smithi123.stdout:[osd] 2024-09-15T23:11:08.669 INFO:teuthology.orchestra.run.smithi123.stdout: osd journal size = 100 2024-09-15T23:11:08.669 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:11:08.669 INFO:teuthology.orchestra.run.smithi123.stdout: osd scrub load threshold = 5.0 2024-09-15T23:11:08.669 INFO:teuthology.orchestra.run.smithi123.stdout: osd scrub max interval = 600 2024-09-15T23:11:08.669 INFO:teuthology.orchestra.run.smithi123.stdout: osd mclock profile = high_recovery_ops 2024-09-15T23:11:08.669 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:11:08.669 INFO:teuthology.orchestra.run.smithi123.stdout: osd recover clone overlap = true 2024-09-15T23:11:08.670 INFO:teuthology.orchestra.run.smithi123.stdout: osd recovery max chunk = 1048576 2024-09-15T23:11:08.670 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:11:08.670 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug shutdown = true 2024-09-15T23:11:08.670 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug op order = true 2024-09-15T23:11:08.670 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug verify stray on activate = true 2024-09-15T23:11:08.670 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug trim objects = true 2024-09-15T23:11:08.670 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:11:08.670 INFO:teuthology.orchestra.run.smithi123.stdout: osd open classes on start = true 2024-09-15T23:11:08.670 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug pg log writeout = true 2024-09-15T23:11:08.670 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:11:08.670 INFO:teuthology.orchestra.run.smithi123.stdout: osd deep scrub update digest min age = 30 2024-09-15T23:11:08.670 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:11:08.670 INFO:teuthology.orchestra.run.smithi123.stdout: osd map max advance = 10 2024-09-15T23:11:08.670 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:11:08.671 INFO:teuthology.orchestra.run.smithi123.stdout: journal zero on create = true 2024-09-15T23:11:08.671 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:11:08.671 INFO:teuthology.orchestra.run.smithi123.stdout: filestore ondisk finisher threads = 3 2024-09-15T23:11:08.671 INFO:teuthology.orchestra.run.smithi123.stdout: filestore apply finisher threads = 3 2024-09-15T23:11:08.671 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:11:08.671 INFO:teuthology.orchestra.run.smithi123.stdout: bdev debug aio = true 2024-09-15T23:11:08.671 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug misdirected ops = true 2024-09-15T23:11:08.671 INFO:teuthology.orchestra.run.smithi123.stdout: bdev async discard = True 2024-09-15T23:11:08.671 INFO:teuthology.orchestra.run.smithi123.stdout: bdev enable discard = True 2024-09-15T23:11:08.671 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore allocator = bitmap 2024-09-15T23:11:08.671 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore block size = 96636764160 2024-09-15T23:11:08.671 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore fsck on mount = True 2024-09-15T23:11:08.671 INFO:teuthology.orchestra.run.smithi123.stdout: debug bluefs = 1/20 2024-09-15T23:11:08.672 INFO:teuthology.orchestra.run.smithi123.stdout: debug bluestore = 1/20 2024-09-15T23:11:08.672 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-09-15T23:11:08.672 INFO:teuthology.orchestra.run.smithi123.stdout: debug osd = 20 2024-09-15T23:11:08.672 INFO:teuthology.orchestra.run.smithi123.stdout: debug rocksdb = 4/10 2024-09-15T23:11:08.672 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T23:11:08.672 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd full ratio = 0.9 2024-09-15T23:11:08.672 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd nearfull ratio = 0.8 2024-09-15T23:11:08.672 INFO:teuthology.orchestra.run.smithi123.stdout: osd failsafe full ratio = 0.95 2024-09-15T23:11:08.672 INFO:teuthology.orchestra.run.smithi123.stdout: osd objectstore = bluestore 2024-09-15T23:11:08.672 INFO:teuthology.orchestra.run.smithi123.stdout: osd op complaint time = 180 2024-09-15T23:11:08.672 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:11:08.672 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr] 2024-09-15T23:11:08.672 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-09-15T23:11:08.673 INFO:teuthology.orchestra.run.smithi123.stdout: debug mgr = 20 2024-09-15T23:11:08.673 INFO:teuthology.orchestra.run.smithi123.stdout: debug mon = 20 2024-09-15T23:11:08.673 INFO:teuthology.orchestra.run.smithi123.stdout: debug auth = 20 2024-09-15T23:11:08.673 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:11:08.673 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:11:08.673 INFO:teuthology.orchestra.run.smithi123.stdout: mgr/telemetry/nag = false 2024-09-15T23:11:08.673 INFO:teuthology.orchestra.run.smithi123.stdout: debug client = 20 2024-09-15T23:11:08.673 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:11:08.673 INFO:teuthology.orchestra.run.smithi123.stdout:[mon] 2024-09-15T23:11:08.673 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-09-15T23:11:08.673 INFO:teuthology.orchestra.run.smithi123.stdout: debug mon = 20 2024-09-15T23:11:08.673 INFO:teuthology.orchestra.run.smithi123.stdout: debug paxos = 20 2024-09-15T23:11:08.673 INFO:teuthology.orchestra.run.smithi123.stdout: debug auth = 20 2024-09-15T23:11:08.674 INFO:teuthology.orchestra.run.smithi123.stdout: mon data avail warn = 5 2024-09-15T23:11:08.674 INFO:teuthology.orchestra.run.smithi123.stdout: mon mgr mkfs grace = 240 2024-09-15T23:11:08.674 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:11:08.674 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd reporter subtree level = osd 2024-09-15T23:11:08.674 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd prime pg temp = true 2024-09-15T23:11:08.674 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:11:08.674 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:11:08.674 INFO:teuthology.orchestra.run.smithi123.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T23:11:08.674 INFO:teuthology.orchestra.run.smithi123.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T23:11:08.674 INFO:teuthology.orchestra.run.smithi123.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T23:11:08.674 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:11:08.674 INFO:teuthology.orchestra.run.smithi123.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T23:11:08.674 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T23:11:08.674 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T23:11:08.675 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:11:08.675 INFO:teuthology.orchestra.run.smithi123.stdout: # 1m isn't quite enough 2024-09-15T23:11:08.675 INFO:teuthology.orchestra.run.smithi123.stdout: mon_down_mkfs_grace = 2m 2024-09-15T23:11:08.675 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:11:08.675 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_filestore_osds = false 2024-09-15T23:11:08.675 INFO:teuthology.orchestra.run.smithi123.stdout: mon down mkfs grace = 300 2024-09-15T23:11:08.675 INFO:teuthology.orchestra.run.smithi123.stdout: mon op complaint time = 120 2024-09-15T23:11:08.675 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on pool no app = False 2024-09-15T23:11:08.675 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:11:08.675 INFO:teuthology.orchestra.run.smithi123.stdout:[client] 2024-09-15T23:11:08.675 INFO:teuthology.orchestra.run.smithi123.stdout: rgw cache enabled = true 2024-09-15T23:11:08.675 INFO:teuthology.orchestra.run.smithi123.stdout: rgw enable ops log = true 2024-09-15T23:11:08.676 INFO:teuthology.orchestra.run.smithi123.stdout: rgw enable usage log = true 2024-09-15T23:11:08.676 INFO:teuthology.orchestra.run.smithi123.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T23:11:08.676 INFO:teuthology.orchestra.run.smithi123.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T23:11:08.676 INFO:teuthology.orchestra.run.smithi123.stdout: client mount timeout = 600 2024-09-15T23:11:08.676 INFO:teuthology.orchestra.run.smithi123.stdout: debug client = 20 2024-09-15T23:11:08.676 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-09-15T23:11:08.676 INFO:teuthology.orchestra.run.smithi123.stdout: pid file = "" 2024-09-15T23:11:08.676 INFO:teuthology.orchestra.run.smithi123.stdout: rados mon op timeout = 900 2024-09-15T23:11:08.676 INFO:teuthology.orchestra.run.smithi123.stdout: rados osd op timeout = 900 2024-09-15T23:11:08.676 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.a] 2024-09-15T23:11:08.676 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.b] 2024-09-15T23:11:08.676 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.c] 2024-09-15T23:11:08.676 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.a] 2024-09-15T23:11:08.676 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.c] 2024-09-15T23:11:08.677 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.b] 2024-09-15T23:11:08.677 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.d] 2024-09-15T23:11:08.677 INFO:teuthology.orchestra.run.smithi123.stdout:[mds] 2024-09-15T23:11:08.677 INFO:teuthology.orchestra.run.smithi123.stdout: debug mds = 20 2024-09-15T23:11:08.677 INFO:teuthology.orchestra.run.smithi123.stdout: debug mds balancer = 20 2024-09-15T23:11:08.677 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-09-15T23:11:08.677 INFO:teuthology.orchestra.run.smithi123.stdout: mds cache max size = 1000 2024-09-15T23:11:08.677 INFO:teuthology.orchestra.run.smithi123.stdout: mds debug frag = True 2024-09-15T23:11:08.677 INFO:teuthology.orchestra.run.smithi123.stdout: mds debug scatterstat = True 2024-09-15T23:11:08.677 INFO:teuthology.orchestra.run.smithi123.stdout: mds log max segments = 1 2024-09-15T23:11:08.677 INFO:teuthology.orchestra.run.smithi123.stdout: mds op complaint time = 180 2024-09-15T23:11:08.677 INFO:teuthology.orchestra.run.smithi123.stdout: mds verify scatter = True 2024-09-15T23:11:08.677 INFO:teuthology.orchestra.run.smithi123.stdout: osd op complaint time = 180 2024-09-15T23:11:08.677 INFO:teuthology.orchestra.run.smithi123.stdout: rados mon op timeout = 900 2024-09-15T23:11:08.678 INFO:teuthology.orchestra.run.smithi123.stdout: rados osd op timeout = 900 2024-09-15T23:11:08.678 INFO:teuthology.orchestra.run.smithi188.stdout:[global] 2024-09-15T23:11:08.678 INFO:teuthology.orchestra.run.smithi188.stdout: chdir = "" 2024-09-15T23:11:08.678 INFO:teuthology.orchestra.run.smithi188.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T23:11:08.678 INFO:teuthology.orchestra.run.smithi188.stdout: auth supported = cephx 2024-09-15T23:11:08.678 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:11:08.678 INFO:teuthology.orchestra.run.smithi188.stdout: filestore xattr use omap = true 2024-09-15T23:11:08.679 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:11:08.679 INFO:teuthology.orchestra.run.smithi188.stdout: mon clock drift allowed = 1.000 2024-09-15T23:11:08.679 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:11:08.679 INFO:teuthology.orchestra.run.smithi188.stdout: osd crush chooseleaf type = 0 2024-09-15T23:11:08.679 INFO:teuthology.orchestra.run.smithi188.stdout: auth debug = true 2024-09-15T23:11:08.679 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:11:08.679 INFO:teuthology.orchestra.run.smithi188.stdout: ms die on old message = true 2024-09-15T23:11:08.679 INFO:teuthology.orchestra.run.smithi188.stdout: ms die on bug = true 2024-09-15T23:11:08.679 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:11:08.679 INFO:teuthology.orchestra.run.smithi188.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T23:11:08.679 INFO:teuthology.orchestra.run.smithi188.stdout: mon pg warn max object skew = 0 2024-09-15T23:11:08.679 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:11:08.679 INFO:teuthology.orchestra.run.smithi188.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T23:11:08.680 INFO:teuthology.orchestra.run.smithi188.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T23:11:08.680 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:11:08.680 INFO:teuthology.orchestra.run.smithi188.stdout: osd pool default size = 2 2024-09-15T23:11:08.680 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:11:08.680 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd allow primary affinity = true 2024-09-15T23:11:08.680 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd allow pg remap = true 2024-09-15T23:11:08.680 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on legacy crush tunables = false 2024-09-15T23:11:08.680 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on crush straw calc version zero = false 2024-09-15T23:11:08.680 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on no sortbitwise = false 2024-09-15T23:11:08.680 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on osd down out interval zero = false 2024-09-15T23:11:08.680 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on too few osds = false 2024-09-15T23:11:08.680 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T23:11:08.680 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T23:11:08.681 INFO:teuthology.orchestra.run.smithi188.stdout: mon_allow_pool_size_one = true 2024-09-15T23:11:08.681 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:11:08.681 INFO:teuthology.orchestra.run.smithi188.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T23:11:08.681 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:11:08.681 INFO:teuthology.orchestra.run.smithi188.stdout: osd default data pool replay window = 5 2024-09-15T23:11:08.681 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:11:08.681 INFO:teuthology.orchestra.run.smithi188.stdout: mon allow pool delete = true 2024-09-15T23:11:08.681 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:11:08.681 INFO:teuthology.orchestra.run.smithi188.stdout: mon cluster log file level = debug 2024-09-15T23:11:08.681 INFO:teuthology.orchestra.run.smithi188.stdout: debug asserts on shutdown = true 2024-09-15T23:11:08.681 INFO:teuthology.orchestra.run.smithi188.stdout: mon health detail to clog = false 2024-09-15T23:11:08.681 INFO:teuthology.orchestra.run.smithi188.stdout: mon host = "172.21.15.123,172.21.15.188,[v2:172.21.15.188:3301,v1:172.21.15.188:6790]" 2024-09-15T23:11:08.682 INFO:teuthology.orchestra.run.smithi188.stdout: ms die on skipped message = False 2024-09-15T23:11:08.682 INFO:teuthology.orchestra.run.smithi188.stdout: fsid = cb968ac4-8d3a-4b17-a673-6177aeaea589 2024-09-15T23:11:08.682 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:11:08.682 INFO:teuthology.orchestra.run.smithi188.stdout:[osd] 2024-09-15T23:11:08.682 INFO:teuthology.orchestra.run.smithi188.stdout: osd journal size = 100 2024-09-15T23:11:08.682 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:11:08.682 INFO:teuthology.orchestra.run.smithi188.stdout: osd scrub load threshold = 5.0 2024-09-15T23:11:08.682 INFO:teuthology.orchestra.run.smithi188.stdout: osd scrub max interval = 600 2024-09-15T23:11:08.682 INFO:teuthology.orchestra.run.smithi188.stdout: osd mclock profile = high_recovery_ops 2024-09-15T23:11:08.682 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:11:08.682 INFO:teuthology.orchestra.run.smithi188.stdout: osd recover clone overlap = true 2024-09-15T23:11:08.682 INFO:teuthology.orchestra.run.smithi188.stdout: osd recovery max chunk = 1048576 2024-09-15T23:11:08.682 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:11:08.682 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug shutdown = true 2024-09-15T23:11:08.683 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug op order = true 2024-09-15T23:11:08.683 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug verify stray on activate = true 2024-09-15T23:11:08.683 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug trim objects = true 2024-09-15T23:11:08.683 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:11:08.683 INFO:teuthology.orchestra.run.smithi188.stdout: osd open classes on start = true 2024-09-15T23:11:08.683 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug pg log writeout = true 2024-09-15T23:11:08.683 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:11:08.683 INFO:teuthology.orchestra.run.smithi188.stdout: osd deep scrub update digest min age = 30 2024-09-15T23:11:08.683 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:11:08.683 INFO:teuthology.orchestra.run.smithi188.stdout: osd map max advance = 10 2024-09-15T23:11:08.683 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:11:08.683 INFO:teuthology.orchestra.run.smithi188.stdout: journal zero on create = true 2024-09-15T23:11:08.683 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:11:08.683 INFO:teuthology.orchestra.run.smithi188.stdout: filestore ondisk finisher threads = 3 2024-09-15T23:11:08.684 INFO:teuthology.orchestra.run.smithi188.stdout: filestore apply finisher threads = 3 2024-09-15T23:11:08.684 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:11:08.684 INFO:teuthology.orchestra.run.smithi188.stdout: bdev debug aio = true 2024-09-15T23:11:08.684 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug misdirected ops = true 2024-09-15T23:11:08.684 INFO:teuthology.orchestra.run.smithi188.stdout: bdev async discard = True 2024-09-15T23:11:08.684 INFO:teuthology.orchestra.run.smithi188.stdout: bdev enable discard = True 2024-09-15T23:11:08.684 INFO:teuthology.orchestra.run.smithi188.stdout: bluestore allocator = bitmap 2024-09-15T23:11:08.684 INFO:teuthology.orchestra.run.smithi188.stdout: bluestore block size = 96636764160 2024-09-15T23:11:08.684 INFO:teuthology.orchestra.run.smithi188.stdout: bluestore fsck on mount = True 2024-09-15T23:11:08.684 INFO:teuthology.orchestra.run.smithi188.stdout: debug bluefs = 1/20 2024-09-15T23:11:08.684 INFO:teuthology.orchestra.run.smithi188.stdout: debug bluestore = 1/20 2024-09-15T23:11:08.684 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2024-09-15T23:11:08.684 INFO:teuthology.orchestra.run.smithi188.stdout: debug osd = 20 2024-09-15T23:11:08.684 INFO:teuthology.orchestra.run.smithi188.stdout: debug rocksdb = 4/10 2024-09-15T23:11:08.685 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T23:11:08.685 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd full ratio = 0.9 2024-09-15T23:11:08.685 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd nearfull ratio = 0.8 2024-09-15T23:11:08.685 INFO:teuthology.orchestra.run.smithi188.stdout: osd failsafe full ratio = 0.95 2024-09-15T23:11:08.685 INFO:teuthology.orchestra.run.smithi188.stdout: osd objectstore = bluestore 2024-09-15T23:11:08.685 INFO:teuthology.orchestra.run.smithi188.stdout: osd op complaint time = 180 2024-09-15T23:11:08.685 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:11:08.685 INFO:teuthology.orchestra.run.smithi188.stdout:[mgr] 2024-09-15T23:11:08.685 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2024-09-15T23:11:08.685 INFO:teuthology.orchestra.run.smithi188.stdout: debug mgr = 20 2024-09-15T23:11:08.686 INFO:teuthology.orchestra.run.smithi188.stdout: debug mon = 20 2024-09-15T23:11:08.686 INFO:teuthology.orchestra.run.smithi188.stdout: debug auth = 20 2024-09-15T23:11:08.686 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:11:08.686 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:11:08.686 INFO:teuthology.orchestra.run.smithi188.stdout: mgr/telemetry/nag = false 2024-09-15T23:11:08.686 INFO:teuthology.orchestra.run.smithi188.stdout: debug client = 20 2024-09-15T23:11:08.686 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:11:08.686 INFO:teuthology.orchestra.run.smithi188.stdout:[mon] 2024-09-15T23:11:08.686 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2024-09-15T23:11:08.686 INFO:teuthology.orchestra.run.smithi188.stdout: debug mon = 20 2024-09-15T23:11:08.686 INFO:teuthology.orchestra.run.smithi188.stdout: debug paxos = 20 2024-09-15T23:11:08.686 INFO:teuthology.orchestra.run.smithi188.stdout: debug auth = 20 2024-09-15T23:11:08.686 INFO:teuthology.orchestra.run.smithi188.stdout: mon data avail warn = 5 2024-09-15T23:11:08.686 INFO:teuthology.orchestra.run.smithi188.stdout: mon mgr mkfs grace = 240 2024-09-15T23:11:08.687 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:11:08.687 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd reporter subtree level = osd 2024-09-15T23:11:08.687 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd prime pg temp = true 2024-09-15T23:11:08.687 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:11:08.687 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:11:08.687 INFO:teuthology.orchestra.run.smithi188.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T23:11:08.687 INFO:teuthology.orchestra.run.smithi188.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T23:11:08.687 INFO:teuthology.orchestra.run.smithi188.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T23:11:08.687 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:11:08.687 INFO:teuthology.orchestra.run.smithi188.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T23:11:08.687 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T23:11:08.687 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T23:11:08.687 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:11:08.687 INFO:teuthology.orchestra.run.smithi188.stdout: # 1m isn't quite enough 2024-09-15T23:11:08.688 INFO:teuthology.orchestra.run.smithi188.stdout: mon_down_mkfs_grace = 2m 2024-09-15T23:11:08.688 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:11:08.688 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_filestore_osds = false 2024-09-15T23:11:08.688 INFO:teuthology.orchestra.run.smithi188.stdout: mon down mkfs grace = 300 2024-09-15T23:11:08.688 INFO:teuthology.orchestra.run.smithi188.stdout: mon op complaint time = 120 2024-09-15T23:11:08.688 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on pool no app = False 2024-09-15T23:11:08.688 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:11:08.688 INFO:teuthology.orchestra.run.smithi188.stdout:[client] 2024-09-15T23:11:08.688 INFO:teuthology.orchestra.run.smithi188.stdout: rgw cache enabled = true 2024-09-15T23:11:08.688 INFO:teuthology.orchestra.run.smithi188.stdout: rgw enable ops log = true 2024-09-15T23:11:08.688 INFO:teuthology.orchestra.run.smithi188.stdout: rgw enable usage log = true 2024-09-15T23:11:08.688 INFO:teuthology.orchestra.run.smithi188.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T23:11:08.688 INFO:teuthology.orchestra.run.smithi188.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T23:11:08.689 INFO:teuthology.orchestra.run.smithi188.stdout: client mount timeout = 600 2024-09-15T23:11:08.689 INFO:teuthology.orchestra.run.smithi188.stdout: debug client = 20 2024-09-15T23:11:08.689 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2024-09-15T23:11:08.689 INFO:teuthology.orchestra.run.smithi188.stdout: pid file = "" 2024-09-15T23:11:08.689 INFO:teuthology.orchestra.run.smithi188.stdout: rados mon op timeout = 900 2024-09-15T23:11:08.689 INFO:teuthology.orchestra.run.smithi188.stdout: rados osd op timeout = 900 2024-09-15T23:11:08.689 INFO:teuthology.orchestra.run.smithi188.stdout:[mon.a] 2024-09-15T23:11:08.689 INFO:teuthology.orchestra.run.smithi188.stdout:[mon.b] 2024-09-15T23:11:08.689 INFO:teuthology.orchestra.run.smithi188.stdout:[mon.c] 2024-09-15T23:11:08.689 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.a] 2024-09-15T23:11:08.689 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.c] 2024-09-15T23:11:08.689 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.b] 2024-09-15T23:11:08.689 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.d] 2024-09-15T23:11:08.689 INFO:teuthology.orchestra.run.smithi188.stdout:[mds] 2024-09-15T23:11:08.690 INFO:teuthology.orchestra.run.smithi188.stdout: debug mds = 20 2024-09-15T23:11:08.690 INFO:teuthology.orchestra.run.smithi188.stdout: debug mds balancer = 20 2024-09-15T23:11:08.690 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2024-09-15T23:11:08.690 INFO:teuthology.orchestra.run.smithi188.stdout: mds cache max size = 1000 2024-09-15T23:11:08.690 INFO:teuthology.orchestra.run.smithi188.stdout: mds debug frag = True 2024-09-15T23:11:08.690 INFO:teuthology.orchestra.run.smithi188.stdout: mds debug scatterstat = True 2024-09-15T23:11:08.690 INFO:teuthology.orchestra.run.smithi188.stdout: mds log max segments = 1 2024-09-15T23:11:08.690 INFO:teuthology.orchestra.run.smithi188.stdout: mds op complaint time = 180 2024-09-15T23:11:08.690 INFO:teuthology.orchestra.run.smithi188.stdout: mds verify scatter = True 2024-09-15T23:11:08.690 INFO:teuthology.orchestra.run.smithi188.stdout: osd op complaint time = 180 2024-09-15T23:11:08.690 INFO:teuthology.orchestra.run.smithi188.stdout: rados mon op timeout = 900 2024-09-15T23:11:08.690 INFO:teuthology.orchestra.run.smithi188.stdout: rados osd op timeout = 900 2024-09-15T23:11:08.692 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-15T23:11:08.692 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-15T23:11:08.786 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-15T23:11:08.786 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:11:08.786 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-15T23:11:08.801 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:11:08.801 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-15T23:11:08.857 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi123.front.sepia.ceph.com 2024-09-15T23:11:08.857 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:11:08.857 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-15T23:11:08.857 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-15T23:11:08.930 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:11:08.930 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-15T23:11:08.986 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi188.front.sepia.ceph.com 2024-09-15T23:11:08.986 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:11:08.986 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-15T23:11:08.986 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-15T23:11:09.024 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:11:09.024 DEBUG:teuthology.orchestra.run.smithi188:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-15T23:11:09.079 INFO:tasks.ceph:Setting up mon nodes... 2024-09-15T23:11:09.079 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-15T23:11:09.079 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-15T23:11:09.129 INFO:teuthology.orchestra.run.smithi123.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-15T23:11:09.132 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-15T23:11:09.193 INFO:teuthology.orchestra.run.smithi188.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-15T23:11:09.196 INFO:tasks.ceph:Setting up mds nodes... 2024-09-15T23:11:09.197 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-15T23:11:09.249 INFO:teuthology.orchestra.run.smithi123.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-15T23:11:09.251 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-15T23:11:09.276 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-15T23:11:09.366 INFO:teuthology.orchestra.run.smithi123.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-15T23:11:09.368 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-15T23:11:09.393 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-15T23:11:09.446 INFO:teuthology.orchestra.run.smithi188.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-15T23:11:09.449 DEBUG:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-15T23:11:09.475 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-15T23:11:09.568 INFO:teuthology.orchestra.run.smithi188.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-15T23:11:09.570 DEBUG:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-15T23:11:09.595 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-15T23:11:09.595 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-15T23:11:09.636 INFO:teuthology.orchestra.run.smithi123.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-15T23:11:09.649 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-15T23:11:09.729 INFO:teuthology.orchestra.run.smithi123.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-15T23:11:09.741 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-15T23:11:09.783 INFO:teuthology.orchestra.run.smithi188.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-15T23:11:09.796 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-15T23:11:09.876 INFO:teuthology.orchestra.run.smithi188.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-15T23:11:09.889 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-15T23:11:09.889 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi123.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi188.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-15T23:11:09.889 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-15T23:11:09.914 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T23:11:09.914 INFO:tasks.ceph:role: osd.0 2024-09-15T23:11:09.914 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi123.front.sepia.ceph.com 2024-09-15T23:11:09.914 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-15T23:11:09.987 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T23:11:09.987 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T23:11:09.987 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T23:11:09.987 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T23:11:09.987 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T23:11:09.987 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2024-09-15T23:11:09.987 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T23:11:09.987 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T23:11:09.987 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T23:11:09.988 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T23:11:10.502 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2024-09-15T23:11:10.504 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2024-09-15T23:11:10.505 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-15T23:11:10.620 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-15T23:11:10.651 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-15T23:11:10.717 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T23:11:10.717 INFO:tasks.ceph:role: osd.1 2024-09-15T23:11:10.717 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi123.front.sepia.ceph.com 2024-09-15T23:11:10.717 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-15T23:11:10.789 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T23:11:10.789 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T23:11:10.789 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T23:11:10.789 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T23:11:10.789 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T23:11:10.790 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2024-09-15T23:11:10.790 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T23:11:10.790 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T23:11:10.790 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T23:11:10.790 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T23:11:11.257 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2024-09-15T23:11:11.259 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2024-09-15T23:11:11.259 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-15T23:11:11.352 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-15T23:11:11.381 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-15T23:11:11.445 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T23:11:11.446 INFO:tasks.ceph:role: osd.2 2024-09-15T23:11:11.446 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi123.front.sepia.ceph.com 2024-09-15T23:11:11.446 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-15T23:11:11.519 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T23:11:11.519 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T23:11:11.519 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T23:11:11.519 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T23:11:11.519 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T23:11:11.519 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2024-09-15T23:11:11.519 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T23:11:11.519 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T23:11:11.519 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T23:11:11.519 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T23:11:12.004 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2024-09-15T23:11:12.007 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2024-09-15T23:11:12.007 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-15T23:11:12.126 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-15T23:11:12.156 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-15T23:11:12.220 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T23:11:12.221 INFO:tasks.ceph:role: osd.3 2024-09-15T23:11:12.221 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi123.front.sepia.ceph.com 2024-09-15T23:11:12.221 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-15T23:11:12.293 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T23:11:12.293 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T23:11:12.293 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T23:11:12.294 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T23:11:12.294 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T23:11:12.294 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2024-09-15T23:11:12.294 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T23:11:12.294 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T23:11:12.294 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T23:11:12.294 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T23:11:12.793 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2024-09-15T23:11:12.794 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2024-09-15T23:11:12.795 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-15T23:11:12.936 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-15T23:11:12.968 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T23:11:13.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:13.062+0000 7fed8fa1e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-15T23:11:13.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:13.062+0000 7fed8fa1e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-15T23:11:13.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:13.062+0000 7fed8fa1e640 -1 bdev(0x564396cdf800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-15T23:11:13.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:13.062+0000 7fed8fa1e640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-15T23:11:16.468 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-15T23:11:16.499 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T23:11:16.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:16.593+0000 7fbcd5864640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-15T23:11:16.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:16.593+0000 7fbcd5864640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-15T23:11:16.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:16.593+0000 7fbcd5864640 -1 bdev(0x562c53c87800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-15T23:11:16.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:16.593+0000 7fbcd5864640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-15T23:11:20.244 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-15T23:11:20.272 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T23:11:20.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:20.358+0000 7f57303fd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-15T23:11:20.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:20.359+0000 7f57303fd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-15T23:11:20.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:20.359+0000 7f57303fd640 -1 bdev(0x5601c4fa3800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-15T23:11:20.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:20.359+0000 7f57303fd640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-15T23:11:24.262 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-15T23:11:24.291 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T23:11:24.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:24.380+0000 7f92c041c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-15T23:11:24.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:24.381+0000 7f92c041c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-15T23:11:24.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:24.381+0000 7f92c041c640 -1 bdev(0x55ad17445800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-15T23:11:24.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:24.381+0000 7f92c041c640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-15T23:11:27.792 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-15T23:11:27.820 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-15T23:11:27.851 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T23:11:27.851 INFO:tasks.ceph:role: osd.4 2024-09-15T23:11:27.851 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi188.front.sepia.ceph.com 2024-09-15T23:11:27.851 DEBUG:teuthology.orchestra.run.smithi188:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-15T23:11:27.926 INFO:teuthology.orchestra.run.smithi188.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T23:11:27.927 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T23:11:27.927 INFO:teuthology.orchestra.run.smithi188.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T23:11:27.927 INFO:teuthology.orchestra.run.smithi188.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T23:11:27.927 INFO:teuthology.orchestra.run.smithi188.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T23:11:27.927 INFO:teuthology.orchestra.run.smithi188.stdout: = sunit=0 swidth=0 blks 2024-09-15T23:11:27.927 INFO:teuthology.orchestra.run.smithi188.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T23:11:27.927 INFO:teuthology.orchestra.run.smithi188.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T23:11:27.927 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T23:11:27.927 INFO:teuthology.orchestra.run.smithi188.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T23:11:28.428 INFO:teuthology.orchestra.run.smithi188.stdout:Discarding blocks...Done. 2024-09-15T23:11:28.431 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi188.front.sepia.ceph.com -o noatime 2024-09-15T23:11:28.431 DEBUG:teuthology.orchestra.run.smithi188:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-15T23:11:28.559 DEBUG:teuthology.orchestra.run.smithi188:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-15T23:11:28.595 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-15T23:11:28.663 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T23:11:28.663 INFO:tasks.ceph:role: osd.5 2024-09-15T23:11:28.663 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi188.front.sepia.ceph.com 2024-09-15T23:11:28.663 DEBUG:teuthology.orchestra.run.smithi188:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-15T23:11:28.737 INFO:teuthology.orchestra.run.smithi188.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T23:11:28.737 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T23:11:28.737 INFO:teuthology.orchestra.run.smithi188.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T23:11:28.737 INFO:teuthology.orchestra.run.smithi188.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T23:11:28.738 INFO:teuthology.orchestra.run.smithi188.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T23:11:28.738 INFO:teuthology.orchestra.run.smithi188.stdout: = sunit=0 swidth=0 blks 2024-09-15T23:11:28.738 INFO:teuthology.orchestra.run.smithi188.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T23:11:28.738 INFO:teuthology.orchestra.run.smithi188.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T23:11:28.738 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T23:11:28.738 INFO:teuthology.orchestra.run.smithi188.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T23:11:29.193 INFO:teuthology.orchestra.run.smithi188.stdout:Discarding blocks...Done. 2024-09-15T23:11:29.195 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi188.front.sepia.ceph.com -o noatime 2024-09-15T23:11:29.195 DEBUG:teuthology.orchestra.run.smithi188:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-15T23:11:29.285 DEBUG:teuthology.orchestra.run.smithi188:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-15T23:11:29.314 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-15T23:11:29.378 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T23:11:29.378 INFO:tasks.ceph:role: osd.6 2024-09-15T23:11:29.378 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi188.front.sepia.ceph.com 2024-09-15T23:11:29.378 DEBUG:teuthology.orchestra.run.smithi188:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-15T23:11:29.451 INFO:teuthology.orchestra.run.smithi188.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T23:11:29.451 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T23:11:29.451 INFO:teuthology.orchestra.run.smithi188.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T23:11:29.451 INFO:teuthology.orchestra.run.smithi188.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T23:11:29.451 INFO:teuthology.orchestra.run.smithi188.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T23:11:29.451 INFO:teuthology.orchestra.run.smithi188.stdout: = sunit=0 swidth=0 blks 2024-09-15T23:11:29.451 INFO:teuthology.orchestra.run.smithi188.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T23:11:29.451 INFO:teuthology.orchestra.run.smithi188.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T23:11:29.451 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T23:11:29.451 INFO:teuthology.orchestra.run.smithi188.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T23:11:29.933 INFO:teuthology.orchestra.run.smithi188.stdout:Discarding blocks...Done. 2024-09-15T23:11:29.935 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi188.front.sepia.ceph.com -o noatime 2024-09-15T23:11:29.935 DEBUG:teuthology.orchestra.run.smithi188:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-15T23:11:30.045 DEBUG:teuthology.orchestra.run.smithi188:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-15T23:11:30.073 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-15T23:11:30.139 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T23:11:30.139 INFO:tasks.ceph:role: osd.7 2024-09-15T23:11:30.139 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi188.front.sepia.ceph.com 2024-09-15T23:11:30.139 DEBUG:teuthology.orchestra.run.smithi188:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-15T23:11:30.210 INFO:teuthology.orchestra.run.smithi188.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T23:11:30.210 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T23:11:30.210 INFO:teuthology.orchestra.run.smithi188.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T23:11:30.210 INFO:teuthology.orchestra.run.smithi188.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T23:11:30.210 INFO:teuthology.orchestra.run.smithi188.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T23:11:30.211 INFO:teuthology.orchestra.run.smithi188.stdout: = sunit=0 swidth=0 blks 2024-09-15T23:11:30.211 INFO:teuthology.orchestra.run.smithi188.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T23:11:30.211 INFO:teuthology.orchestra.run.smithi188.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T23:11:30.211 INFO:teuthology.orchestra.run.smithi188.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T23:11:30.211 INFO:teuthology.orchestra.run.smithi188.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T23:11:30.731 INFO:teuthology.orchestra.run.smithi188.stdout:Discarding blocks...Done. 2024-09-15T23:11:30.734 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi188.front.sepia.ceph.com -o noatime 2024-09-15T23:11:30.734 DEBUG:teuthology.orchestra.run.smithi188:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-15T23:11:30.867 DEBUG:teuthology.orchestra.run.smithi188:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-15T23:11:30.898 DEBUG:teuthology.orchestra.run.smithi188:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T23:11:31.002 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:31.001+0000 7f4d18612640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-15T23:11:31.003 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:31.002+0000 7f4d18612640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-15T23:11:31.003 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:31.002+0000 7f4d18612640 -1 bdev(0x55d5d2739800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-15T23:11:31.003 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:31.002+0000 7f4d18612640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-15T23:11:34.903 DEBUG:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-15T23:11:34.933 DEBUG:teuthology.orchestra.run.smithi188:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T23:11:35.023 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:35.021+0000 7f1f3280b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-15T23:11:35.024 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:35.021+0000 7f1f3280b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-15T23:11:35.024 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:35.022+0000 7f1f3280b640 -1 bdev(0x562a8b5a5800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-15T23:11:35.024 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:35.022+0000 7f1f3280b640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-15T23:11:36.697 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:11:36.700 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:11:38.938 DEBUG:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-15T23:11:38.968 DEBUG:teuthology.orchestra.run.smithi188:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T23:11:39.059 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:39.057+0000 7ff704f25640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-15T23:11:39.060 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:39.058+0000 7ff704f25640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-15T23:11:39.060 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:39.058+0000 7ff704f25640 -1 bdev(0x5578822af800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-15T23:11:39.060 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:39.058+0000 7ff704f25640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-15T23:11:42.959 DEBUG:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-15T23:11:42.988 DEBUG:teuthology.orchestra.run.smithi188:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T23:11:43.079 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:43.076+0000 7fd18b214640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-15T23:11:43.079 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:43.077+0000 7fd18b214640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-15T23:11:43.079 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:43.077+0000 7fd18b214640 -1 bdev(0x55bfe5a5f800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-15T23:11:43.079 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:43.077+0000 7fd18b214640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-15T23:11:46.487 DEBUG:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-15T23:11:46.516 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-15T23:11:46.516 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:11:46.516 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-15T23:11:46.546 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:11:46.547 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-15T23:11:46.615 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:11:46.615 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-15T23:11:46.682 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:11:46.682 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-15T23:11:46.749 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:11:46.749 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-15T23:11:46.816 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:11:46.816 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-15T23:11:46.881 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:11:46.881 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-15T23:11:46.945 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:11:46.945 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-15T23:11:46.976 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:11:46.976 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-15T23:11:47.044 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:11:47.044 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-15T23:11:47.115 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:11:47.116 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-15T23:11:47.183 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:11:47.183 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-15T23:11:47.250 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:11:47.250 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-15T23:11:47.317 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:11:47.317 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-15T23:11:47.382 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:11:47.382 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-15T23:11:47.397 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:11:47.397 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-15T23:11:47.453 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:11:47.453 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-15T23:11:47.469 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:11:47.469 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-15T23:11:47.525 INFO:tasks.ceph:Adding keys to all mons... 2024-09-15T23:11:47.525 DEBUG:teuthology.orchestra.run.smithi123:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-15T23:11:47.527 DEBUG:teuthology.orchestra.run.smithi188:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-15T23:11:47.567 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr.y] 2024-09-15T23:11:47.568 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCNaedm5Om4BxAA/7ZtMMlbUA3bvMCfaNMQyg== 2024-09-15T23:11:47.568 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.a] 2024-09-15T23:11:47.568 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCNaedm9ATVDhAAnukyZogTuG4YCbzRXSCkiQ== 2024-09-15T23:11:47.568 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.c] 2024-09-15T23:11:47.568 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCNaedmua/VFRAAwbPm2TslrfQkrvHiO8oeLg== 2024-09-15T23:11:47.568 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.0] 2024-09-15T23:11:47.568 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCRaedmFrHGAxAAy/jTkothESNn2DC9xcHDAQ== 2024-09-15T23:11:47.568 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.1] 2024-09-15T23:11:47.568 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCUaedm6vZlIxAAdsnLqFSng6SRpCT6UZKGsw== 2024-09-15T23:11:47.568 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.2] 2024-09-15T23:11:47.568 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCYaedmXgVwFRAA1mOzzRafhKMsU7kTAT6TqA== 2024-09-15T23:11:47.568 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.3] 2024-09-15T23:11:47.569 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCcaedm+APAFhAAb8blNFzswwHriSmCrMuA0A== 2024-09-15T23:11:47.569 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr.x] 2024-09-15T23:11:47.569 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCNaedmGPSBCxAAHAhXQERogdAOm0ZPNtlxpw== 2024-09-15T23:11:47.569 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.b] 2024-09-15T23:11:47.569 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCNaedm4KmaGhAAbf6vcffqiJTOYXK5DCXcZA== 2024-09-15T23:11:47.569 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.d] 2024-09-15T23:11:47.569 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCNaedmzw3eIRAAaE+5y9USwp+xM3MTAndn7Q== 2024-09-15T23:11:47.569 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.4] 2024-09-15T23:11:47.569 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCjaedmReUmABAAXpxsK7osxn/ZelVXKiCLOw== 2024-09-15T23:11:47.569 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.5] 2024-09-15T23:11:47.569 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCnaedmtbdmARAAdxguBdtwBmtiaIx/y992GA== 2024-09-15T23:11:47.569 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.6] 2024-09-15T23:11:47.569 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCraedmkR+NAxAAd2GAAH0BgOMonU8iTSn+Fw== 2024-09-15T23:11:47.569 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.7] 2024-09-15T23:11:47.570 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCvaedmAaCwBBAAdpDtCbXchArmy019wiOdSQ== 2024-09-15T23:11:47.570 INFO:teuthology.orchestra.run.smithi123.stdout:[client.0] 2024-09-15T23:11:47.570 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCNaedmzQPqJRAAhUf1dnVYohN4obCfeu8+7g== 2024-09-15T23:11:47.570 INFO:teuthology.orchestra.run.smithi123.stdout:[client.2] 2024-09-15T23:11:47.570 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCNaedmRz55KxAARi7B4WYOY1QqH1CK81z9pA== 2024-09-15T23:11:47.570 INFO:teuthology.orchestra.run.smithi123.stdout:[client.1] 2024-09-15T23:11:47.570 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCNaedmdKK0LhAAXXmUkxVwMEjRTRXUh9CL/g== 2024-09-15T23:11:47.570 INFO:teuthology.orchestra.run.smithi123.stdout:[client.3] 2024-09-15T23:11:47.570 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCNaedmbWo8NBAAR1qGX1bs35ojx6lMxftcfg== 2024-09-15T23:11:47.588 INFO:teuthology.orchestra.run.smithi188.stdout:[mgr.y] 2024-09-15T23:11:47.588 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQCNaedm5Om4BxAA/7ZtMMlbUA3bvMCfaNMQyg== 2024-09-15T23:11:47.588 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.a] 2024-09-15T23:11:47.588 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQCNaedm9ATVDhAAnukyZogTuG4YCbzRXSCkiQ== 2024-09-15T23:11:47.588 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.c] 2024-09-15T23:11:47.588 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQCNaedmua/VFRAAwbPm2TslrfQkrvHiO8oeLg== 2024-09-15T23:11:47.588 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.0] 2024-09-15T23:11:47.589 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQCRaedmFrHGAxAAy/jTkothESNn2DC9xcHDAQ== 2024-09-15T23:11:47.589 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.1] 2024-09-15T23:11:47.589 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQCUaedm6vZlIxAAdsnLqFSng6SRpCT6UZKGsw== 2024-09-15T23:11:47.589 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.2] 2024-09-15T23:11:47.589 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQCYaedmXgVwFRAA1mOzzRafhKMsU7kTAT6TqA== 2024-09-15T23:11:47.589 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.3] 2024-09-15T23:11:47.589 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQCcaedm+APAFhAAb8blNFzswwHriSmCrMuA0A== 2024-09-15T23:11:47.589 INFO:teuthology.orchestra.run.smithi188.stdout:[mgr.x] 2024-09-15T23:11:47.589 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQCNaedmGPSBCxAAHAhXQERogdAOm0ZPNtlxpw== 2024-09-15T23:11:47.589 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.b] 2024-09-15T23:11:47.589 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQCNaedm4KmaGhAAbf6vcffqiJTOYXK5DCXcZA== 2024-09-15T23:11:47.589 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.d] 2024-09-15T23:11:47.589 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQCNaedmzw3eIRAAaE+5y9USwp+xM3MTAndn7Q== 2024-09-15T23:11:47.589 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.4] 2024-09-15T23:11:47.590 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQCjaedmReUmABAAXpxsK7osxn/ZelVXKiCLOw== 2024-09-15T23:11:47.590 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.5] 2024-09-15T23:11:47.590 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQCnaedmtbdmARAAdxguBdtwBmtiaIx/y992GA== 2024-09-15T23:11:47.590 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.6] 2024-09-15T23:11:47.590 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQCraedmkR+NAxAAd2GAAH0BgOMonU8iTSn+Fw== 2024-09-15T23:11:47.590 INFO:teuthology.orchestra.run.smithi188.stdout:[osd.7] 2024-09-15T23:11:47.590 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQCvaedmAaCwBBAAdpDtCbXchArmy019wiOdSQ== 2024-09-15T23:11:47.590 INFO:teuthology.orchestra.run.smithi188.stdout:[client.0] 2024-09-15T23:11:47.590 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQCNaedmzQPqJRAAhUf1dnVYohN4obCfeu8+7g== 2024-09-15T23:11:47.590 INFO:teuthology.orchestra.run.smithi188.stdout:[client.2] 2024-09-15T23:11:47.590 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQCNaedmRz55KxAARi7B4WYOY1QqH1CK81z9pA== 2024-09-15T23:11:47.590 INFO:teuthology.orchestra.run.smithi188.stdout:[client.1] 2024-09-15T23:11:47.590 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQCNaedmdKK0LhAAXXmUkxVwMEjRTRXUh9CL/g== 2024-09-15T23:11:47.590 INFO:teuthology.orchestra.run.smithi188.stdout:[client.3] 2024-09-15T23:11:47.590 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQCNaedmbWo8NBAAR1qGX1bs35ojx6lMxftcfg== 2024-09-15T23:11:47.591 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T23:11:47.614 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T23:11:47.682 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T23:11:47.685 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T23:11:47.739 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T23:11:47.741 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T23:11:47.794 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T23:11:47.796 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T23:11:47.846 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T23:11:47.848 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T23:11:47.898 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T23:11:47.901 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T23:11:47.952 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T23:11:47.954 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T23:11:48.005 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T23:11:48.007 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T23:11:48.057 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T23:11:48.060 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T23:11:48.113 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T23:11:48.115 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T23:11:48.168 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T23:11:48.171 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T23:11:48.221 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T23:11:48.223 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T23:11:48.274 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T23:11:48.276 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T23:11:48.327 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T23:11:48.329 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T23:11:48.379 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T23:11:48.382 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T23:11:48.435 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T23:11:48.437 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T23:11:48.490 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T23:11:48.493 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T23:11:48.546 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T23:11:48.548 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T23:11:48.602 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-15T23:11:48.602 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-15T23:11:48.626 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-15T23:11:48.721 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-15T23:11:48.746 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-15T23:11:48.771 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-15T23:11:48.868 DEBUG:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-15T23:11:48.894 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-15T23:11:48.959 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-15T23:11:49.055 DEBUG:teuthology.orchestra.run.smithi188:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-15T23:11:49.080 DEBUG:teuthology.orchestra.run.smithi123:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-15T23:11:49.082 DEBUG:teuthology.orchestra.run.smithi188:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-15T23:11:49.134 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-15T23:11:49.135 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-15T23:11:49.135 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-15T23:11:49.138 INFO:tasks.ceph.mon.a:Started 2024-09-15T23:11:49.138 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-15T23:11:49.138 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-15T23:11:49.177 INFO:tasks.ceph.mon.b:Started 2024-09-15T23:11:49.177 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-15T23:11:49.177 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-15T23:11:49.179 INFO:tasks.ceph.mon.c:Started 2024-09-15T23:11:49.179 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-15T23:11:49.180 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-15T23:11:49.180 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-15T23:11:49.182 INFO:tasks.ceph.mgr.y:Started 2024-09-15T23:11:49.182 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-15T23:11:49.182 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-15T23:11:49.184 INFO:tasks.ceph.mgr.x:Started 2024-09-15T23:11:49.184 INFO:tasks.ceph:Setting crush tunables to default 2024-09-15T23:11:49.185 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd crush tunables default 2024-09-15T23:11:49.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.281+0000 7fe0e3d9f640 1 Processor -- start 2024-09-15T23:11:49.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.281+0000 7fe0e3d9f640 1 -- start start 2024-09-15T23:11:49.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.282+0000 7fe0e3d9f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0dc15e810 0x7fe0dc06df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:49.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.282+0000 7fe0e3d9f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe0dc0cf460 0x7fe0dc0d1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:49.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.282+0000 7fe0e3d9f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0dc06e920 con 0x7fe0dc06e480 2024-09-15T23:11:49.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.282+0000 7fe0e3d9f640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fe0dc06ec00 con 0x7fe0dc0cf460 2024-09-15T23:11:49.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.282+0000 7fe0e3d9f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe0dc06f2d0 con 0x7fe0dc15e810 2024-09-15T23:11:49.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.282+0000 7fe0e1b3b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0dc15e810 0x7fe0dc06df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:49.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.282+0000 7fe0e233c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe0dc0cf460 0x7fe0dc0d1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:49.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.282+0000 7fe0e233c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe0dc0cf460 0x7fe0dc0d1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:41496/0 (socket says 172.21.15.123:41496) 2024-09-15T23:11:49.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.282+0000 7fe0e1b3b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0dc15e810 0x7fe0dc06df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:34824/0 (socket says 172.21.15.123:34824) 2024-09-15T23:11:49.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.282+0000 7fe0e233c640 1 -- 172.21.15.123:0/2621477016 learned_addr learned my addr 172.21.15.123:0/2621477016 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:11:49.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.282+0000 7fe0e133a640 1 --1- 172.21.15.123:0/2621477016 >> v1:172.21.15.188:6789/0 conn(0x7fe0dc06e480 0x7fe0dc0ced50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:38212/0 (socket says 172.21.15.123:38212) 2024-09-15T23:11:49.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.282+0000 7fe0e233c640 1 -- 172.21.15.123:0/2621477016 >> v2:172.21.15.188:3300/0 conn(0x7fe0dc0cf460 msgr2=0x7fe0dc0d1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-15T23:11:49.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.282+0000 7fe0e233c640 1 -- 172.21.15.123:0/2621477016 >> v2:172.21.15.188:3300/0 conn(0x7fe0dc0cf460 msgr2=0x7fe0dc0d1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T23:11:49.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.282+0000 7fe0e233c640 1 --2- 172.21.15.123:0/2621477016 >> v2:172.21.15.188:3300/0 conn(0x7fe0dc0cf460 0x7fe0dc0d1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T23:11:49.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.282+0000 7fe0e233c640 1 --2- 172.21.15.123:0/2621477016 >> v2:172.21.15.188:3300/0 conn(0x7fe0dc0cf460 0x7fe0dc0d1460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:11:49.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.282+0000 7fe0e1b3b640 1 -- 172.21.15.123:0/2621477016 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0dc15e810 msgr2=0x7fe0dc06df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-15T23:11:49.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.282+0000 7fe0e1b3b640 1 -- 172.21.15.123:0/2621477016 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0dc15e810 msgr2=0x7fe0dc06df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T23:11:49.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.282+0000 7fe0e1b3b640 1 --2- 172.21.15.123:0/2621477016 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0dc15e810 0x7fe0dc06df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T23:11:49.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.283+0000 7fe0e1b3b640 1 --2- 172.21.15.123:0/2621477016 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0dc15e810 0x7fe0dc06df40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:11:49.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.439+0000 7fe0e0b39640 1 -- 172.21.15.123:0/2621477016 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 970264364 0 0) 0x7fe0dc06e920 con 0x7fe0dc06e480 2024-09-15T23:11:49.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.440+0000 7fe0e0b39640 1 -- 172.21.15.123:0/2621477016 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0c4003520 con 0x7fe0dc06e480 2024-09-15T23:11:49.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.440+0000 7fe0e0b39640 1 -- 172.21.15.123:0/2621477016 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1845642552 0 0) 0x7fe0c4003520 con 0x7fe0dc06e480 2024-09-15T23:11:49.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.440+0000 7fe0e0b39640 1 -- 172.21.15.123:0/2621477016 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0dc15e810 msgr2=0x7fe0dc06df40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:11:49.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.440+0000 7fe0e0b39640 1 --2- 172.21.15.123:0/2621477016 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0dc15e810 0x7fe0dc06df40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:49.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.440+0000 7fe0e0b39640 1 -- 172.21.15.123:0/2621477016 >> v2:172.21.15.188:3300/0 conn(0x7fe0dc0cf460 msgr2=0x7fe0dc0d1460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:11:49.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.440+0000 7fe0e0b39640 1 --2- 172.21.15.123:0/2621477016 >> v2:172.21.15.188:3300/0 conn(0x7fe0dc0cf460 0x7fe0dc0d1460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:49.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.440+0000 7fe0e0b39640 1 -- 172.21.15.123:0/2621477016 --> v1:172.21.15.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0dc06f5b0 con 0x7fe0dc06e480 2024-09-15T23:11:49.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.440+0000 7fe0e0b39640 1 -- 172.21.15.123:0/2621477016 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fe0d0001670 con 0x7fe0dc06e480 2024-09-15T23:11:49.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.440+0000 7fe0e0b39640 1 -- 172.21.15.123:0/2621477016 >> v1:172.21.15.188:6789/0 conn(0x7fe0dc06e480 legacy=0x7fe0dc0ced50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:49.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.440+0000 7fe0e0b39640 1 --2- 172.21.15.123:0/2621477016 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0dc15e810 0x7fe0c40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:49.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.440+0000 7fe0e0b39640 1 --2- 172.21.15.123:0/2621477016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0c4004030 0x7fe0c4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:49.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.440+0000 7fe0e0b39640 1 --2- 172.21.15.123:0/2621477016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0c4004d40 0x7fe0c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:49.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.440+0000 7fe0e0b39640 1 -- 172.21.15.123:0/2621477016 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc06ec00 con 0x7fe0c4004d40 2024-09-15T23:11:49.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.440+0000 7fe0e0b39640 1 -- 172.21.15.123:0/2621477016 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc06f2d0 con 0x7fe0c4004030 2024-09-15T23:11:49.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.440+0000 7fe0e0b39640 1 -- 172.21.15.123:0/2621477016 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe0c400bb20 con 0x7fe0dc15e810 2024-09-15T23:11:49.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.440+0000 7fe0e233c640 1 --2- 172.21.15.123:0/2621477016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0c4004d40 0x7fe0c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:49.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.440+0000 7fe0e133a640 1 --2- 172.21.15.123:0/2621477016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0c4004030 0x7fe0c4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:49.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.440+0000 7fe0e1b3b640 1 --2- 172.21.15.123:0/2621477016 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0dc15e810 0x7fe0c40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:49.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.440+0000 7fe0e233c640 1 -- 172.21.15.123:0/2621477016 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0dc15e810 msgr2=0x7fe0c40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:11:49.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.441+0000 7fe0e233c640 1 --2- 172.21.15.123:0/2621477016 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0dc15e810 0x7fe0c40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:49.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.441+0000 7fe0e233c640 1 -- 172.21.15.123:0/2621477016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0c4004030 msgr2=0x7fe0c4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:11:49.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.441+0000 7fe0e233c640 1 --2- 172.21.15.123:0/2621477016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0c4004030 0x7fe0c4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:49.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.441+0000 7fe0e233c640 1 -- 172.21.15.123:0/2621477016 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c4003520 con 0x7fe0c4004d40 2024-09-15T23:11:49.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.441+0000 7fe0e233c640 1 --2- 172.21.15.123:0/2621477016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0c4004d40 0x7fe0c40051c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009890 tx=0x7fe0c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd5f5965c8527d0c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:49.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.442+0000 7fe0e0b39640 1 -- 172.21.15.123:0/2621477016 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d4037070 con 0x7fe0c4004d40 2024-09-15T23:11:49.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.442+0000 7fe0e0b39640 1 -- 172.21.15.123:0/2621477016 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0d402ad00 con 0x7fe0c4004d40 2024-09-15T23:11:49.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.442+0000 7fe0e0b39640 1 -- 172.21.15.123:0/2621477016 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d400f040 con 0x7fe0c4004d40 2024-09-15T23:11:49.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.442+0000 7fe0e3d9f640 1 -- 172.21.15.123:0/2621477016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0c4004d40 msgr2=0x7fe0c40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:49.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.442+0000 7fe0e3d9f640 1 --2- 172.21.15.123:0/2621477016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0c4004d40 0x7fe0c40051c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009890 tx=0x7fe0c4005830 comp rx=0 tx=0).stop 2024-09-15T23:11:49.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.442+0000 7fe0e233c640 1 -- 172.21.15.123:0/2621477016 reap_dead start 2024-09-15T23:11:49.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.442+0000 7fe0e3d9f640 1 -- 172.21.15.123:0/2621477016 shutdown_connections 2024-09-15T23:11:49.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.442+0000 7fe0e3d9f640 1 -- 172.21.15.123:0/2621477016 >> 172.21.15.123:0/2621477016 conn(0x7fe0dc067f80 msgr2=0x7fe0dc0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:49.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.443+0000 7fe0e3d9f640 1 -- 172.21.15.123:0/2621477016 shutdown_connections 2024-09-15T23:11:49.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.443+0000 7fe0e3d9f640 1 -- 172.21.15.123:0/2621477016 wait complete. 2024-09-15T23:11:49.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.444+0000 7fe0e3d9f640 1 Processor -- start 2024-09-15T23:11:49.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.444+0000 7fe0e3d9f640 1 -- start start 2024-09-15T23:11:49.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.445+0000 7fe0e3d9f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0c4004d40 0x7fe0dc1616d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:49.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.445+0000 7fe0e3d9f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0dc158fc0 0x7fe0dc0b74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:49.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.445+0000 7fe0e3d9f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0dc0b79f0 0x7fe0dc0ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:49.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.445+0000 7fe0e3d9f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc0ceb10 con 0x7fe0c4004d40 2024-09-15T23:11:49.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.445+0000 7fe0e3d9f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc0ce990 con 0x7fe0dc158fc0 2024-09-15T23:11:49.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.445+0000 7fe0e3d9f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe0dc06fdb0 con 0x7fe0dc0b79f0 2024-09-15T23:11:49.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.445+0000 7fe0e1b3b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0c4004d40 0x7fe0dc1616d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:49.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.445+0000 7fe0e1b3b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0c4004d40 0x7fe0dc1616d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35538/0 (socket says 172.21.15.123:35538) 2024-09-15T23:11:49.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.445+0000 7fe0e1b3b640 1 -- 172.21.15.123:0/2125784895 learned_addr learned my addr 172.21.15.123:0/2125784895 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:11:49.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.445+0000 7fe0e133a640 1 --2- 172.21.15.123:0/2125784895 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0dc158fc0 0x7fe0dc0b74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:49.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.445+0000 7fe0e233c640 1 --2- 172.21.15.123:0/2125784895 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0dc0b79f0 0x7fe0dc0ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:49.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.445+0000 7fe0e1b3b640 1 -- 172.21.15.123:0/2125784895 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0dc0b79f0 msgr2=0x7fe0dc0ae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:49.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.445+0000 7fe0e1b3b640 1 --2- 172.21.15.123:0/2125784895 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0dc0b79f0 0x7fe0dc0ae880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:49.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.445+0000 7fe0e1b3b640 1 -- 172.21.15.123:0/2125784895 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0dc158fc0 msgr2=0x7fe0dc0b74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:49.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.445+0000 7fe0e1b3b640 1 --2- 172.21.15.123:0/2125784895 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0dc158fc0 0x7fe0dc0b74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:49.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.445+0000 7fe0e1b3b640 1 -- 172.21.15.123:0/2125784895 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0dc1f4d90 con 0x7fe0c4004d40 2024-09-15T23:11:49.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.445+0000 7fe0e1b3b640 1 --2- 172.21.15.123:0/2125784895 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0c4004d40 0x7fe0dc1616d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00f1b0 tx=0x7fe0cc00f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:49.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.446+0000 7fe0da7fc640 1 -- 172.21.15.123:0/2125784895 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc009ce0 con 0x7fe0c4004d40 2024-09-15T23:11:49.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.446+0000 7fe0da7fc640 1 -- 172.21.15.123:0/2125784895 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0cc019070 con 0x7fe0c4004d40 2024-09-15T23:11:49.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.446+0000 7fe0da7fc640 1 -- 172.21.15.123:0/2125784895 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc00a230 con 0x7fe0c4004d40 2024-09-15T23:11:49.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.446+0000 7fe0e3d9f640 1 -- 172.21.15.123:0/2125784895 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0dc0b69d0 con 0x7fe0c4004d40 2024-09-15T23:11:49.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.446+0000 7fe0e3d9f640 1 -- 172.21.15.123:0/2125784895 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0dc0b05b0 con 0x7fe0c4004d40 2024-09-15T23:11:49.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.446+0000 7fe0da7fc640 1 -- 172.21.15.123:0/2125784895 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe0cc00a760 con 0x7fe0c4004d40 2024-09-15T23:11:49.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.446+0000 7fe0da7fc640 1 -- 172.21.15.123:0/2125784895 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe0cc014430 con 0x7fe0c4004d40 2024-09-15T23:11:49.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.447+0000 7fe0e3d9f640 1 -- 172.21.15.123:0/2125784895 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0dc06df40 con 0x7fe0c4004d40 2024-09-15T23:11:49.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.449+0000 7fe0da7fc640 1 -- 172.21.15.123:0/2125784895 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fe0cc01d410 con 0x7fe0c4004d40 2024-09-15T23:11:49.542 INFO:tasks.ceph.mgr.x.smithi188.stderr:2024-09-15T23:11:49.541+0000 7f71d549b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T23:11:49.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.572+0000 7fe0e3d9f640 1 -- 172.21.15.123:0/2125784895 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fe0dc0b3d50 con 0x7fe0c4004d40 2024-09-15T23:11:49.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.574+0000 7fe0da7fc640 1 -- 172.21.15.123:0/2125784895 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fe0cc01d5f0 con 0x7fe0c4004d40 2024-09-15T23:11:49.576 INFO:teuthology.orchestra.run.smithi123.stderr:adjusted tunables profile to default 2024-09-15T23:11:49.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.574+0000 7fe0e3d9f640 1 -- 172.21.15.123:0/2125784895 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0c4004d40 msgr2=0x7fe0dc1616d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:49.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.574+0000 7fe0e3d9f640 1 --2- 172.21.15.123:0/2125784895 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0c4004d40 0x7fe0dc1616d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00f1b0 tx=0x7fe0cc00f670 comp rx=0 tx=0).stop 2024-09-15T23:11:49.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.574+0000 7fe0e3d9f640 1 -- 172.21.15.123:0/2125784895 shutdown_connections 2024-09-15T23:11:49.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.574+0000 7fe0e3d9f640 1 --2- 172.21.15.123:0/2125784895 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0dc0b79f0 0x7fe0dc0ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:49.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.574+0000 7fe0e3d9f640 1 --2- 172.21.15.123:0/2125784895 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0dc158fc0 0x7fe0dc0b74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:49.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.574+0000 7fe0e3d9f640 1 --2- 172.21.15.123:0/2125784895 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0c4004d40 0x7fe0dc1616d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:49.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.574+0000 7fe0e3d9f640 1 -- 172.21.15.123:0/2125784895 >> 172.21.15.123:0/2125784895 conn(0x7fe0dc067f80 msgr2=0x7fe0dc0b4190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:49.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.575+0000 7fe0e3d9f640 1 -- 172.21.15.123:0/2125784895 shutdown_connections 2024-09-15T23:11:49.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:49.575+0000 7fe0e3d9f640 1 -- 172.21.15.123:0/2125784895 wait complete. 2024-09-15T23:11:49.583 INFO:tasks.ceph.mgr.x.smithi188.stderr:2024-09-15T23:11:49.582+0000 7f71d549b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T23:11:49.587 INFO:tasks.ceph:check_enable_crimson: False 2024-09-15T23:11:49.587 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-15T23:11:49.587 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:11:49.587 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-15T23:11:49.588 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-15T23:11:49.586+0000 7f6b06df9040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T23:11:49.612 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:11:49.613 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-15T23:11:49.630 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-15T23:11:49.628+0000 7f6b06df9040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T23:11:49.655 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:11:49.655 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-15T23:11:49.720 INFO:tasks.ceph.mgr.x.smithi188.stderr:2024-09-15T23:11:49.719+0000 7f71d549b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T23:11:49.721 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:11:49.721 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-15T23:11:49.769 INFO:tasks.ceph.mgr.x.smithi188.stderr:2024-09-15T23:11:49.768+0000 7f71d549b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T23:11:49.774 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-15T23:11:49.773+0000 7f6b06df9040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T23:11:49.786 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:11:49.786 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-15T23:11:49.811 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:11:49.811 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-15T23:11:49.826 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-15T23:11:49.824+0000 7f6b06df9040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T23:11:49.875 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:11:49.875 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-15T23:11:49.930 INFO:tasks.ceph.mgr.x.smithi188.stderr:2024-09-15T23:11:49.929+0000 7f71d549b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:11:49.941 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:11:49.941 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-15T23:11:49.990 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-15T23:11:49.988+0000 7f6b06df9040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:11:50.006 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new 9557a101-be0e-4cb6-abc3-392cc1a54f21 0 2024-09-15T23:11:50.045 INFO:tasks.ceph.mgr.x.smithi188.stderr:2024-09-15T23:11:50.044+0000 7f71d549b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T23:11:50.098 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-15T23:11:50.096+0000 7f6b06df9040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T23:11:50.143 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.142+0000 7f6d1b247640 1 Processor -- start 2024-09-15T23:11:50.144 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.142+0000 7f6d1b247640 1 -- start start 2024-09-15T23:11:50.145 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.143+0000 7f6d1b247640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6d140b7ce0 0x7f6d140d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:50.145 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.143+0000 7f6d1b247640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6d140d06f0 0x7f6d140cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:50.145 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.143+0000 7f6d1b247640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d140cdd30 con 0x7f6d1415c6d0 2024-09-15T23:11:50.145 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.143+0000 7f6d1b247640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f6d14160fe0 con 0x7f6d140b7ce0 2024-09-15T23:11:50.145 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.143+0000 7f6d1b247640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6d140cdfd0 con 0x7f6d140d06f0 2024-09-15T23:11:50.145 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.143+0000 7f6d18fe3640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f6d1415c6d0 0x7f6d141608d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:34410/0 (socket says 172.21.15.188:34410) 2024-09-15T23:11:50.145 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.143+0000 7f6d197e4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6d140d06f0 0x7f6d140cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:50.145 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.143+0000 7f6d18fe3640 1 -- 172.21.15.188:0/736087833 learned_addr learned my addr 172.21.15.188:0/736087833 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-09-15T23:11:50.146 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.143+0000 7f6d13fff640 1 --2- 172.21.15.188:0/736087833 >> v2:172.21.15.123:3300/0 conn(0x7f6d140b7ce0 0x7f6d140d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:50.146 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.144+0000 7f6d137fe640 1 -- 172.21.15.188:0/736087833 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1375522413 0 0) 0x7f6d140cdd30 con 0x7f6d1415c6d0 2024-09-15T23:11:50.146 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.144+0000 7f6d137fe640 1 -- 172.21.15.188:0/736087833 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d04003520 con 0x7f6d1415c6d0 2024-09-15T23:11:50.146 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.144+0000 7f6d197e4640 1 -- 172.21.15.188:0/736087833 >> v2:172.21.15.123:3300/0 conn(0x7f6d140b7ce0 msgr2=0x7f6d140d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:11:50.146 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.144+0000 7f6d197e4640 1 --2- 172.21.15.188:0/736087833 >> v2:172.21.15.123:3300/0 conn(0x7f6d140b7ce0 0x7f6d140d01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.146 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.144+0000 7f6d197e4640 1 -- 172.21.15.188:0/736087833 >> v1:172.21.15.188:6789/0 conn(0x7f6d1415c6d0 legacy=0x7f6d141608d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:50.146 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.144+0000 7f6d197e4640 1 -- 172.21.15.188:0/736087833 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d140ce2b0 con 0x7f6d140d06f0 2024-09-15T23:11:50.147 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.145+0000 7f6d197e4640 1 --2- 172.21.15.188:0/736087833 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6d140d06f0 0x7f6d140cf070 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c009d90 tx=0x7f6d0c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc0e0a598b5ee0c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:50.147 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.145+0000 7f6d137fe640 1 -- 172.21.15.188:0/736087833 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c007740 con 0x7f6d140d06f0 2024-09-15T23:11:50.147 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.145+0000 7f6d137fe640 1 -- 172.21.15.188:0/736087833 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d0c0078e0 con 0x7f6d140d06f0 2024-09-15T23:11:50.147 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.145+0000 7f6d137fe640 1 -- 172.21.15.188:0/736087833 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c007cb0 con 0x7f6d140d06f0 2024-09-15T23:11:50.148 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.146+0000 7f6d1b247640 1 -- 172.21.15.188:0/736087833 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6d140d06f0 msgr2=0x7f6d140cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:50.148 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.146+0000 7f6d1b247640 1 --2- 172.21.15.188:0/736087833 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6d140d06f0 0x7f6d140cf070 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c009d90 tx=0x7f6d0c02a660 comp rx=0 tx=0).stop 2024-09-15T23:11:50.148 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.146+0000 7f6d1b247640 1 -- 172.21.15.188:0/736087833 shutdown_connections 2024-09-15T23:11:50.148 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.146+0000 7f6d1b247640 1 --2- 172.21.15.188:0/736087833 >> v2:172.21.15.123:3300/0 conn(0x7f6d140b7ce0 0x7f6d140d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.148 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.146+0000 7f6d1b247640 1 --2- 172.21.15.188:0/736087833 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6d140d06f0 0x7f6d140cf070 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.148 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.146+0000 7f6d1b247640 1 -- 172.21.15.188:0/736087833 >> 172.21.15.188:0/736087833 conn(0x7f6d14067f80 msgr2=0x7f6d140b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:50.148 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.146+0000 7f6d1b247640 1 -- 172.21.15.188:0/736087833 shutdown_connections 2024-09-15T23:11:50.148 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.146+0000 7f6d1b247640 1 -- 172.21.15.188:0/736087833 wait complete. 2024-09-15T23:11:50.150 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.147+0000 7f6d1b247640 1 Processor -- start 2024-09-15T23:11:50.151 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.147+0000 7f6d1b247640 1 -- start start 2024-09-15T23:11:50.151 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.148+0000 7f6d1b247640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6d140b7ce0 0x7f6d141e7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:50.151 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.148+0000 7f6d1b247640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d140d06f0 0x7f6d140d1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:50.151 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.148+0000 7f6d1b247640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6d1415c6d0 0x7f6d140d1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:50.151 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.148+0000 7f6d1b247640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6d140ceb50 con 0x7f6d140d06f0 2024-09-15T23:11:50.151 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.148+0000 7f6d1b247640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6d140ce870 con 0x7f6d140b7ce0 2024-09-15T23:11:50.151 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.148+0000 7f6d1b247640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6d140cf5b0 con 0x7f6d1415c6d0 2024-09-15T23:11:50.151 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.148+0000 7f6d18fe3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6d140b7ce0 0x7f6d141e7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:50.151 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.148+0000 7f6d18fe3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6d140b7ce0 0x7f6d141e7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:39708/0 (socket says 172.21.15.188:39708) 2024-09-15T23:11:50.151 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.148+0000 7f6d197e4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6d1415c6d0 0x7f6d140d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:50.151 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.148+0000 7f6d18fe3640 1 -- 172.21.15.188:0/3568592961 learned_addr learned my addr 172.21.15.188:0/3568592961 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-09-15T23:11:50.151 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.148+0000 7f6d13fff640 1 --2- 172.21.15.188:0/3568592961 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d140d06f0 0x7f6d140d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:50.151 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.148+0000 7f6d197e4640 1 -- 172.21.15.188:0/3568592961 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6d140b7ce0 msgr2=0x7f6d141e7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:50.152 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.148+0000 7f6d197e4640 1 --2- 172.21.15.188:0/3568592961 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6d140b7ce0 0x7f6d141e7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.152 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.148+0000 7f6d197e4640 1 -- 172.21.15.188:0/3568592961 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d140d06f0 msgr2=0x7f6d140d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:50.152 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.148+0000 7f6d197e4640 1 --2- 172.21.15.188:0/3568592961 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d140d06f0 0x7f6d140d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.152 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.148+0000 7f6d197e4640 1 -- 172.21.15.188:0/3568592961 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d141e80b0 con 0x7f6d1415c6d0 2024-09-15T23:11:50.152 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.148+0000 7f6d18fe3640 1 --2- 172.21.15.188:0/3568592961 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6d140b7ce0 0x7f6d141e7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:11:50.152 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.148+0000 7f6d197e4640 1 --2- 172.21.15.188:0/3568592961 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6d1415c6d0 0x7f6d140d1640 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c031000 tx=0x7f6d0c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:50.152 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.149+0000 7f6d117fa640 1 -- 172.21.15.188:0/3568592961 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c040070 con 0x7f6d1415c6d0 2024-09-15T23:11:50.152 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.149+0000 7f6d117fa640 1 -- 172.21.15.188:0/3568592961 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d0c031c00 con 0x7f6d1415c6d0 2024-09-15T23:11:50.152 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.149+0000 7f6d1b247640 1 -- 172.21.15.188:0/3568592961 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d141e8390 con 0x7f6d1415c6d0 2024-09-15T23:11:50.152 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.149+0000 7f6d117fa640 1 -- 172.21.15.188:0/3568592961 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c009450 con 0x7f6d1415c6d0 2024-09-15T23:11:50.152 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.149+0000 7f6d1b247640 1 -- 172.21.15.188:0/3568592961 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d1415cfc0 con 0x7f6d1415c6d0 2024-09-15T23:11:50.152 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.149+0000 7f6d117fa640 1 -- 172.21.15.188:0/3568592961 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6d0c039040 con 0x7f6d1415c6d0 2024-09-15T23:11:50.152 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.149+0000 7f6d117fa640 1 -- 172.21.15.188:0/3568592961 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f6d0c045cc0 con 0x7f6d1415c6d0 2024-09-15T23:11:50.153 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.150+0000 7f6d1b247640 1 -- 172.21.15.188:0/3568592961 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d14076060 con 0x7f6d1415c6d0 2024-09-15T23:11:50.153 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.152+0000 7f6d117fa640 1 -- 172.21.15.188:0/3568592961 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f6d0c053020 con 0x7f6d1415c6d0 2024-09-15T23:11:50.222 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.221+0000 7f6d1b247640 1 -- 172.21.15.188:0/3568592961 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9557a101-be0e-4cb6-abc3-392cc1a54f21", "id": 0} v 0) -- 0x7f6d140b6ec0 con 0x7f6d1415c6d0 2024-09-15T23:11:50.227 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.227+0000 7f6d117fa640 1 -- 172.21.15.188:0/3568592961 <== mon.2 v2:172.21.15.188:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9557a101-be0e-4cb6-abc3-392cc1a54f21", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f6d0c007840 con 0x7f6d1415c6d0 2024-09-15T23:11:50.228 INFO:teuthology.orchestra.run.smithi188.stdout:0 2024-09-15T23:11:50.229 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.227+0000 7f6d1b247640 1 -- 172.21.15.188:0/3568592961 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6d1415c6d0 msgr2=0x7f6d140d1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:50.229 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.227+0000 7f6d1b247640 1 --2- 172.21.15.188:0/3568592961 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6d1415c6d0 0x7f6d140d1640 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c031000 tx=0x7f6d0c004a40 comp rx=0 tx=0).stop 2024-09-15T23:11:50.229 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.228+0000 7f6d1b247640 1 -- 172.21.15.188:0/3568592961 shutdown_connections 2024-09-15T23:11:50.229 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.228+0000 7f6d1b247640 1 --2- 172.21.15.188:0/3568592961 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6d1415c6d0 0x7f6d140d1640 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.229 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.228+0000 7f6d1b247640 1 --2- 172.21.15.188:0/3568592961 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d140d06f0 0x7f6d140d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.229 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.228+0000 7f6d1b247640 1 --2- 172.21.15.188:0/3568592961 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6d140b7ce0 0x7f6d141e7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.229 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.228+0000 7f6d1b247640 1 -- 172.21.15.188:0/3568592961 >> 172.21.15.188:0/3568592961 conn(0x7f6d14067f80 msgr2=0x7f6d140b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:50.229 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.228+0000 7f6d1b247640 1 -- 172.21.15.188:0/3568592961 shutdown_connections 2024-09-15T23:11:50.229 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.228+0000 7f6d1b247640 1 -- 172.21.15.188:0/3568592961 wait complete. 2024-09-15T23:11:50.239 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new 8b9f5628-6722-4dc2-88bd-404dd735e753 1 2024-09-15T23:11:50.338 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.337+0000 7fe2bd7e4640 1 Processor -- start 2024-09-15T23:11:50.338 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.337+0000 7fe2bd7e4640 1 -- start start 2024-09-15T23:11:50.341 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.338+0000 7fe2bd7e4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe2b806bc10 0x7fe2b806c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:50.341 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.338+0000 7fe2bd7e4640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe2b80732d0 0x7fe2b80736e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:50.341 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.338+0000 7fe2bd7e4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2b806c570 con 0x7fe2b815c7e0 2024-09-15T23:11:50.341 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.338+0000 7fe2bd7e4640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe2b8074220 con 0x7fe2b806bc10 2024-09-15T23:11:50.341 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.338+0000 7fe2bd7e4640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fe2b8073f40 con 0x7fe2b80732d0 2024-09-15T23:11:50.341 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.338+0000 7fe2b77fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe2b80732d0 0x7fe2b80736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:50.342 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.338+0000 7fe2b77fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe2b80732d0 0x7fe2b80736e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:39716/0 (socket says 172.21.15.188:39716) 2024-09-15T23:11:50.342 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.338+0000 7fe2b77fe640 1 -- 172.21.15.188:0/2603486182 learned_addr learned my addr 172.21.15.188:0/2603486182 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-09-15T23:11:50.342 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.338+0000 7fe2b67fc640 1 --2- 172.21.15.188:0/2603486182 >> v2:172.21.15.123:3300/0 conn(0x7fe2b806bc10 0x7fe2b806c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:50.342 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.338+0000 7fe2b77fe640 1 -- 172.21.15.188:0/2603486182 >> v2:172.21.15.123:3300/0 conn(0x7fe2b806bc10 msgr2=0x7fe2b806c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:11:50.344 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.338+0000 7fe2b77fe640 1 --2- 172.21.15.188:0/2603486182 >> v2:172.21.15.123:3300/0 conn(0x7fe2b806bc10 0x7fe2b806c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.344 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.338+0000 7fe2b77fe640 1 -- 172.21.15.188:0/2603486182 >> v1:172.21.15.123:6789/0 conn(0x7fe2b815c7e0 legacy=0x7fe2b806ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:50.344 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.338+0000 7fe2b77fe640 1 -- 172.21.15.188:0/2603486182 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b806e220 con 0x7fe2b80732d0 2024-09-15T23:11:50.344 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.339+0000 7fe2b77fe640 1 --2- 172.21.15.188:0/2603486182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe2b80732d0 0x7fe2b80736e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8069860 tx=0x7fe2b002a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d506e19a19726f84 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:50.344 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.339+0000 7fe2b5ffb640 1 -- 172.21.15.188:0/2603486182 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0036070 con 0x7fe2b80732d0 2024-09-15T23:11:50.345 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.339+0000 7fe2b5ffb640 1 -- 172.21.15.188:0/2603486182 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2b0031600 con 0x7fe2b80732d0 2024-09-15T23:11:50.345 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.339+0000 7fe2b5ffb640 1 -- 172.21.15.188:0/2603486182 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b00319d0 con 0x7fe2b80732d0 2024-09-15T23:11:50.345 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.340+0000 7fe2bd7e4640 1 -- 172.21.15.188:0/2603486182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe2b80732d0 msgr2=0x7fe2b80736e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:50.345 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.340+0000 7fe2bd7e4640 1 --2- 172.21.15.188:0/2603486182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe2b80732d0 0x7fe2b80736e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8069860 tx=0x7fe2b002a730 comp rx=0 tx=0).stop 2024-09-15T23:11:50.345 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.340+0000 7fe2bd7e4640 1 -- 172.21.15.188:0/2603486182 shutdown_connections 2024-09-15T23:11:50.345 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.340+0000 7fe2bd7e4640 1 --2- 172.21.15.188:0/2603486182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe2b80732d0 0x7fe2b80736e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.346 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.340+0000 7fe2bd7e4640 1 --2- 172.21.15.188:0/2603486182 >> v2:172.21.15.123:3300/0 conn(0x7fe2b806bc10 0x7fe2b806c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.346 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.340+0000 7fe2bd7e4640 1 -- 172.21.15.188:0/2603486182 >> 172.21.15.188:0/2603486182 conn(0x7fe2b80d1530 msgr2=0x7fe2b80d1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:50.346 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.340+0000 7fe2bd7e4640 1 -- 172.21.15.188:0/2603486182 shutdown_connections 2024-09-15T23:11:50.346 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.340+0000 7fe2bd7e4640 1 -- 172.21.15.188:0/2603486182 wait complete. 2024-09-15T23:11:50.351 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.341+0000 7fe2bd7e4640 1 Processor -- start 2024-09-15T23:11:50.351 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.341+0000 7fe2bd7e4640 1 -- start start 2024-09-15T23:11:50.352 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.342+0000 7fe2bd7e4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe2b806bc10 0x7fe2b81f5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:50.352 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.342+0000 7fe2bd7e4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe2b80732d0 0x7fe2b81f2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:50.352 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.342+0000 7fe2bd7e4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2b815c7e0 0x7fe2b80c7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:50.352 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.342+0000 7fe2bd7e4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b80d22e0 con 0x7fe2b815c7e0 2024-09-15T23:11:50.353 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.342+0000 7fe2bd7e4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b806e7e0 con 0x7fe2b80732d0 2024-09-15T23:11:50.353 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.342+0000 7fe2bd7e4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe2b8073c20 con 0x7fe2b806bc10 2024-09-15T23:11:50.353 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.342+0000 7fe2b67fc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe2b80732d0 0x7fe2b81f2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:50.353 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.342+0000 7fe2b67fc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe2b80732d0 0x7fe2b81f2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:39730/0 (socket says 172.21.15.188:39730) 2024-09-15T23:11:50.353 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.342+0000 7fe2b67fc640 1 -- 172.21.15.188:0/2391461314 learned_addr learned my addr 172.21.15.188:0/2391461314 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-09-15T23:11:50.354 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.342+0000 7fe2b6ffd640 1 --2- 172.21.15.188:0/2391461314 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe2b806bc10 0x7fe2b81f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:50.354 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.342+0000 7fe2b77fe640 1 --2- 172.21.15.188:0/2391461314 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2b815c7e0 0x7fe2b80c7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:50.354 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.342+0000 7fe2b6ffd640 1 -- 172.21.15.188:0/2391461314 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe2b80732d0 msgr2=0x7fe2b81f2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:50.354 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.342+0000 7fe2b6ffd640 1 --2- 172.21.15.188:0/2391461314 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe2b80732d0 0x7fe2b81f2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.354 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.342+0000 7fe2b6ffd640 1 -- 172.21.15.188:0/2391461314 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2b815c7e0 msgr2=0x7fe2b80c7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:50.355 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.342+0000 7fe2b6ffd640 1 --2- 172.21.15.188:0/2391461314 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2b815c7e0 0x7fe2b80c7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.355 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.342+0000 7fe2b6ffd640 1 -- 172.21.15.188:0/2391461314 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b80c7f80 con 0x7fe2b806bc10 2024-09-15T23:11:50.355 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.342+0000 7fe2b67fc640 1 --2- 172.21.15.188:0/2391461314 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe2b80732d0 0x7fe2b81f2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:11:50.355 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.343+0000 7fe2b6ffd640 1 --2- 172.21.15.188:0/2391461314 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe2b806bc10 0x7fe2b81f5550 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe2a000c390 tx=0x7fe2a000c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:50.355 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.343+0000 7fe2af7fe640 1 -- 172.21.15.188:0/2391461314 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a0017070 con 0x7fe2b806bc10 2024-09-15T23:11:50.355 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.343+0000 7fe2af7fe640 1 -- 172.21.15.188:0/2391461314 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a00052d0 con 0x7fe2b806bc10 2024-09-15T23:11:50.356 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.343+0000 7fe2bd7e4640 1 -- 172.21.15.188:0/2391461314 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2b81f5a90 con 0x7fe2b806bc10 2024-09-15T23:11:50.356 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.343+0000 7fe2af7fe640 1 -- 172.21.15.188:0/2391461314 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a0003830 con 0x7fe2b806bc10 2024-09-15T23:11:50.356 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.343+0000 7fe2bd7e4640 1 -- 172.21.15.188:0/2391461314 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2b8157820 con 0x7fe2b806bc10 2024-09-15T23:11:50.356 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.343+0000 7fe2af7fe640 1 -- 172.21.15.188:0/2391461314 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe2a001a070 con 0x7fe2b806bc10 2024-09-15T23:11:50.356 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.343+0000 7fe2af7fe640 1 -- 172.21.15.188:0/2391461314 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fe2a0011bd0 con 0x7fe2b806bc10 2024-09-15T23:11:50.357 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.344+0000 7fe2ad7fa640 1 -- 172.21.15.188:0/2391461314 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe290005290 con 0x7fe2b806bc10 2024-09-15T23:11:50.357 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.346+0000 7fe2af7fe640 1 -- 172.21.15.188:0/2391461314 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fe2a0021070 con 0x7fe2b806bc10 2024-09-15T23:11:50.380 INFO:tasks.ceph.mgr.x.smithi188.stderr:2024-09-15T23:11:50.379+0000 7f71d549b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T23:11:50.414 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-15T23:11:50.413+0000 7f6b06df9040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T23:11:50.416 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.415+0000 7fe2ad7fa640 1 -- 172.21.15.188:0/2391461314 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8b9f5628-6722-4dc2-88bd-404dd735e753", "id": 1} v 0) -- 0x7fe290005580 con 0x7fe2b806bc10 2024-09-15T23:11:50.424 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.423+0000 7fe2af7fe640 1 -- 172.21.15.188:0/2391461314 <== mon.2 v2:172.21.15.188:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8b9f5628-6722-4dc2-88bd-404dd735e753", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fe2a0011dd0 con 0x7fe2b806bc10 2024-09-15T23:11:50.425 INFO:teuthology.orchestra.run.smithi188.stdout:1 2024-09-15T23:11:50.426 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.424+0000 7fe2ad7fa640 1 -- 172.21.15.188:0/2391461314 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe2b806bc10 msgr2=0x7fe2b81f5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:50.426 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.424+0000 7fe2ad7fa640 1 --2- 172.21.15.188:0/2391461314 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe2b806bc10 0x7fe2b81f5550 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe2a000c390 tx=0x7fe2a000c850 comp rx=0 tx=0).stop 2024-09-15T23:11:50.426 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.424+0000 7fe2ad7fa640 1 -- 172.21.15.188:0/2391461314 shutdown_connections 2024-09-15T23:11:50.426 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.424+0000 7fe2ad7fa640 1 --2- 172.21.15.188:0/2391461314 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2b815c7e0 0x7fe2b80c7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.426 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.424+0000 7fe2ad7fa640 1 --2- 172.21.15.188:0/2391461314 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe2b80732d0 0x7fe2b81f2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.426 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.424+0000 7fe2ad7fa640 1 --2- 172.21.15.188:0/2391461314 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe2b806bc10 0x7fe2b81f5550 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.426 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.424+0000 7fe2ad7fa640 1 -- 172.21.15.188:0/2391461314 >> 172.21.15.188:0/2391461314 conn(0x7fe2b80d1530 msgr2=0x7fe2b80b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:50.426 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.425+0000 7fe2ad7fa640 1 -- 172.21.15.188:0/2391461314 shutdown_connections 2024-09-15T23:11:50.426 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.425+0000 7fe2ad7fa640 1 -- 172.21.15.188:0/2391461314 wait complete. 2024-09-15T23:11:50.433 INFO:tasks.ceph.mgr.x.smithi188.stderr:2024-09-15T23:11:50.433+0000 7f71d549b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T23:11:50.436 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c 2 2024-09-15T23:11:50.472 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-15T23:11:50.470+0000 7f6b06df9040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T23:11:50.535 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.534+0000 7f09da159640 1 Processor -- start 2024-09-15T23:11:50.535 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.534+0000 7f09da159640 1 -- start start 2024-09-15T23:11:50.538 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.534+0000 7f09da159640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f09d40cfea0 0x7f09d4162ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:50.538 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.535+0000 7f09da159640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f09d4072bc0 0x7f09d4163410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:50.538 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.535+0000 7f09da159640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09d40cc5d0 con 0x7f09d40c78a0 2024-09-15T23:11:50.539 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.535+0000 7f09da159640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f09d40af930 con 0x7f09d4072bc0 2024-09-15T23:11:50.539 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.535+0000 7f09da159640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f09d40afc10 con 0x7f09d40cfea0 2024-09-15T23:11:50.539 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.535+0000 7f09d37fe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f09d40cfea0 0x7f09d4162ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:50.539 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.535+0000 7f09d3fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f09d4072bc0 0x7f09d4163410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:50.539 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.535+0000 7f09d37fe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f09d40cfea0 0x7f09d4162ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.188:45814/0 (socket says 172.21.15.188:45814) 2024-09-15T23:11:50.539 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.535+0000 7f09d37fe640 1 -- 172.21.15.188:0/2341297000 learned_addr learned my addr 172.21.15.188:0/2341297000 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-09-15T23:11:50.539 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.535+0000 7f09d3fff640 1 -- 172.21.15.188:0/2341297000 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f09d40cfea0 msgr2=0x7f09d4162ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:11:50.539 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.535+0000 7f09d3fff640 1 --2- 172.21.15.188:0/2341297000 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f09d40cfea0 0x7f09d4162ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.539 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.535+0000 7f09d3fff640 1 -- 172.21.15.188:0/2341297000 >> v1:172.21.15.123:6789/0 conn(0x7f09d40c78a0 legacy=0x7f09d40ae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:50.539 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.535+0000 7f09d3fff640 1 -- 172.21.15.188:0/2341297000 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09d40afef0 con 0x7f09d4072bc0 2024-09-15T23:11:50.539 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.535+0000 7f09d37fe640 1 --2- 172.21.15.188:0/2341297000 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f09d40cfea0 0x7f09d4162ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:11:50.540 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.536+0000 7f09d3fff640 1 --2- 172.21.15.188:0/2341297000 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f09d4072bc0 0x7f09d4163410 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f09cc009d90 tx=0x7f09cc02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d396509394b22ea9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:50.540 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.536+0000 7f09d27fc640 1 -- 172.21.15.188:0/2341297000 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc007740 con 0x7f09d4072bc0 2024-09-15T23:11:50.540 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.536+0000 7f09d27fc640 1 -- 172.21.15.188:0/2341297000 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09cc0078e0 con 0x7f09d4072bc0 2024-09-15T23:11:50.540 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.536+0000 7f09d27fc640 1 -- 172.21.15.188:0/2341297000 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc007cb0 con 0x7f09d4072bc0 2024-09-15T23:11:50.540 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.537+0000 7f09da159640 1 -- 172.21.15.188:0/2341297000 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f09d4072bc0 msgr2=0x7f09d4163410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:50.540 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.537+0000 7f09da159640 1 --2- 172.21.15.188:0/2341297000 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f09d4072bc0 0x7f09d4163410 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f09cc009d90 tx=0x7f09cc02a6f0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.540 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.537+0000 7f09da159640 1 -- 172.21.15.188:0/2341297000 shutdown_connections 2024-09-15T23:11:50.540 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.537+0000 7f09da159640 1 --2- 172.21.15.188:0/2341297000 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f09d4072bc0 0x7f09d4163410 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.540 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.537+0000 7f09da159640 1 --2- 172.21.15.188:0/2341297000 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f09d40cfea0 0x7f09d4162ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.540 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.537+0000 7f09da159640 1 -- 172.21.15.188:0/2341297000 >> 172.21.15.188:0/2341297000 conn(0x7f09d40b2890 msgr2=0x7f09d40b2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:50.541 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.537+0000 7f09da159640 1 -- 172.21.15.188:0/2341297000 shutdown_connections 2024-09-15T23:11:50.541 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.537+0000 7f09da159640 1 -- 172.21.15.188:0/2341297000 wait complete. 2024-09-15T23:11:50.543 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.538+0000 7f09da159640 1 Processor -- start 2024-09-15T23:11:50.543 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.538+0000 7f09da159640 1 -- start start 2024-09-15T23:11:50.543 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.539+0000 7f09da159640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f09d4072bc0 0x7f09d41551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:50.543 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.539+0000 7f09da159640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09d40c78a0 0x7f09d406cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:50.543 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.539+0000 7f09da159640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f09d40cfea0 0x7f09d406d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:50.544 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.539+0000 7f09da159640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f09d406e790 con 0x7f09d40c78a0 2024-09-15T23:11:50.544 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.539+0000 7f09da159640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f09d406e4a0 con 0x7f09d40cfea0 2024-09-15T23:11:50.544 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.539+0000 7f09da159640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f09d4067950 con 0x7f09d4072bc0 2024-09-15T23:11:50.544 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.539+0000 7f09d3fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f09d40cfea0 0x7f09d406d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:50.544 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.539+0000 7f09d37fe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f09d4072bc0 0x7f09d41551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:50.544 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.539+0000 7f09d3fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f09d40cfea0 0x7f09d406d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:39756/0 (socket says 172.21.15.188:39756) 2024-09-15T23:11:50.544 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.539+0000 7f09d37fe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f09d4072bc0 0x7f09d41551a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.188:45818/0 (socket says 172.21.15.188:45818) 2024-09-15T23:11:50.544 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.539+0000 7f09d3fff640 1 -- 172.21.15.188:0/1658821050 learned_addr learned my addr 172.21.15.188:0/1658821050 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-09-15T23:11:50.545 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.539+0000 7f09d2ffd640 1 --2- 172.21.15.188:0/1658821050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09d40c78a0 0x7f09d406cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:50.545 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.539+0000 7f09d37fe640 1 -- 172.21.15.188:0/1658821050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f09d40cfea0 msgr2=0x7f09d406d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:50.545 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.539+0000 7f09d37fe640 1 --2- 172.21.15.188:0/1658821050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f09d40cfea0 0x7f09d406d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.545 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.539+0000 7f09d37fe640 1 -- 172.21.15.188:0/1658821050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09d40c78a0 msgr2=0x7f09d406cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:50.545 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.539+0000 7f09d37fe640 1 --2- 172.21.15.188:0/1658821050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09d40c78a0 0x7f09d406cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.545 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.539+0000 7f09d37fe640 1 -- 172.21.15.188:0/1658821050 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09d40c7210 con 0x7f09d4072bc0 2024-09-15T23:11:50.545 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.539+0000 7f09d3fff640 1 --2- 172.21.15.188:0/1658821050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f09d40cfea0 0x7f09d406d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:11:50.545 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.540+0000 7f09d37fe640 1 --2- 172.21.15.188:0/1658821050 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f09d4072bc0 0x7f09d41551a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f09c400e860 tx=0x7f09c400ed20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:50.545 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.540+0000 7f09bbfff640 1 -- 172.21.15.188:0/1658821050 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c4004030 con 0x7f09d4072bc0 2024-09-15T23:11:50.545 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.540+0000 7f09bbfff640 1 -- 172.21.15.188:0/1658821050 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09c40041d0 con 0x7f09d4072bc0 2024-09-15T23:11:50.545 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.540+0000 7f09da159640 1 -- 172.21.15.188:0/1658821050 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09d40c74f0 con 0x7f09d4072bc0 2024-09-15T23:11:50.545 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.540+0000 7f09bbfff640 1 -- 172.21.15.188:0/1658821050 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c400c940 con 0x7f09d4072bc0 2024-09-15T23:11:50.545 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.540+0000 7f09da159640 1 -- 172.21.15.188:0/1658821050 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f09d41556e0 con 0x7f09d4072bc0 2024-09-15T23:11:50.545 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.540+0000 7f09bbfff640 1 -- 172.21.15.188:0/1658821050 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f09c4005990 con 0x7f09d4072bc0 2024-09-15T23:11:50.546 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.540+0000 7f09bbfff640 1 -- 172.21.15.188:0/1658821050 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f09c4003c00 con 0x7f09d4072bc0 2024-09-15T23:11:50.546 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.541+0000 7f09da159640 1 -- 172.21.15.188:0/1658821050 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09d4152e20 con 0x7f09d4072bc0 2024-09-15T23:11:50.546 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.543+0000 7f09bbfff640 1 -- 172.21.15.188:0/1658821050 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f09c4017020 con 0x7f09d4072bc0 2024-09-15T23:11:50.592 INFO:tasks.ceph.mgr.x.smithi188.stderr:2024-09-15T23:11:50.591+0000 7f71d549b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T23:11:50.613 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.613+0000 7f09da159640 1 -- 172.21.15.188:0/1658821050 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c", "id": 2} v 0) -- 0x7f09d40d0280 con 0x7f09d4072bc0 2024-09-15T23:11:50.619 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.618+0000 7f09bbfff640 1 -- 172.21.15.188:0/1658821050 <== mon.2 v2:172.21.15.188:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f09c40093b0 con 0x7f09d4072bc0 2024-09-15T23:11:50.619 INFO:teuthology.orchestra.run.smithi188.stdout:2 2024-09-15T23:11:50.621 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.619+0000 7f09da159640 1 -- 172.21.15.188:0/1658821050 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f09d4072bc0 msgr2=0x7f09d41551a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:50.621 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.619+0000 7f09da159640 1 --2- 172.21.15.188:0/1658821050 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f09d4072bc0 0x7f09d41551a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f09c400e860 tx=0x7f09c400ed20 comp rx=0 tx=0).stop 2024-09-15T23:11:50.621 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.619+0000 7f09da159640 1 -- 172.21.15.188:0/1658821050 shutdown_connections 2024-09-15T23:11:50.621 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.619+0000 7f09da159640 1 --2- 172.21.15.188:0/1658821050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f09d40cfea0 0x7f09d406d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.621 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.619+0000 7f09da159640 1 --2- 172.21.15.188:0/1658821050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09d40c78a0 0x7f09d406cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.621 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.619+0000 7f09da159640 1 --2- 172.21.15.188:0/1658821050 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f09d4072bc0 0x7f09d41551a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.621 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.619+0000 7f09da159640 1 -- 172.21.15.188:0/1658821050 >> 172.21.15.188:0/1658821050 conn(0x7f09d40b2890 msgr2=0x7f09d40b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:50.621 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.619+0000 7f09da159640 1 -- 172.21.15.188:0/1658821050 shutdown_connections 2024-09-15T23:11:50.621 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.619+0000 7f09da159640 1 -- 172.21.15.188:0/1658821050 wait complete. 2024-09-15T23:11:50.622 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-15T23:11:50.619+0000 7f6b06df9040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T23:11:50.631 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new 3d9bcd26-9d4b-427e-b655-e6f90ff495e2 3 2024-09-15T23:11:50.730 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.729+0000 7f0750f98640 1 Processor -- start 2024-09-15T23:11:50.731 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.729+0000 7f0750f98640 1 -- start start 2024-09-15T23:11:50.739 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.730+0000 7f0750f98640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f074c15eca0 0x7f074c06e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:50.739 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.730+0000 7f0750f98640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f074c0d10f0 0x7f074c06e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:50.739 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.730+0000 7f0750f98640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f074c0d22c0 con 0x7f074c0ccaa0 2024-09-15T23:11:50.739 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.730+0000 7f0750f98640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f074c0cf100 con 0x7f074c15eca0 2024-09-15T23:11:50.740 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.730+0000 7f0750f98640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f074c0cbd20 con 0x7f074c0d10f0 2024-09-15T23:11:50.740 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.730+0000 7f0749d9b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f074c0d10f0 0x7f074c06e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:50.740 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.730+0000 7f0749d9b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f074c0d10f0 0x7f074c06e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:39758/0 (socket says 172.21.15.188:39758) 2024-09-15T23:11:50.740 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.730+0000 7f0749d9b640 1 -- 172.21.15.188:0/1945572507 learned_addr learned my addr 172.21.15.188:0/1945572507 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-09-15T23:11:50.740 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.731+0000 7f074a59c640 1 --2- 172.21.15.188:0/1945572507 >> v2:172.21.15.123:3300/0 conn(0x7f074c15eca0 0x7f074c06e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:50.741 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.731+0000 7f0749d9b640 1 -- 172.21.15.188:0/1945572507 >> v2:172.21.15.123:3300/0 conn(0x7f074c15eca0 msgr2=0x7f074c06e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:11:50.741 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.731+0000 7f0749d9b640 1 --2- 172.21.15.188:0/1945572507 >> v2:172.21.15.123:3300/0 conn(0x7f074c15eca0 0x7f074c06e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.741 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.731+0000 7f0749d9b640 1 -- 172.21.15.188:0/1945572507 >> v1:172.21.15.123:6789/0 conn(0x7f074c0ccaa0 legacy=0x7f074c15f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:50.741 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.731+0000 7f0749d9b640 1 -- 172.21.15.188:0/1945572507 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f074c0cf350 con 0x7f074c0d10f0 2024-09-15T23:11:50.741 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.731+0000 7f074a59c640 1 --2- 172.21.15.188:0/1945572507 >> v2:172.21.15.123:3300/0 conn(0x7f074c15eca0 0x7f074c06e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:11:50.741 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.731+0000 7f0749d9b640 1 --2- 172.21.15.188:0/1945572507 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f074c0d10f0 0x7f074c06e630 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f074c0cf280 tx=0x7f073c02a140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=446238ec8786c69b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:50.742 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.732+0000 7f074959a640 1 -- 172.21.15.188:0/1945572507 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073c037070 con 0x7f074c0d10f0 2024-09-15T23:11:50.742 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.732+0000 7f074959a640 1 -- 172.21.15.188:0/1945572507 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f073c032440 con 0x7f074c0d10f0 2024-09-15T23:11:50.742 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.732+0000 7f074959a640 1 -- 172.21.15.188:0/1945572507 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073c032810 con 0x7f074c0d10f0 2024-09-15T23:11:50.742 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.732+0000 7f0750f98640 1 -- 172.21.15.188:0/1945572507 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f074c0d10f0 msgr2=0x7f074c06e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:50.742 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.732+0000 7f0750f98640 1 --2- 172.21.15.188:0/1945572507 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f074c0d10f0 0x7f074c06e630 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f074c0cf280 tx=0x7f073c02a140 comp rx=0 tx=0).stop 2024-09-15T23:11:50.742 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.732+0000 7f0750f98640 1 -- 172.21.15.188:0/1945572507 shutdown_connections 2024-09-15T23:11:50.742 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.732+0000 7f0750f98640 1 --2- 172.21.15.188:0/1945572507 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f074c0d10f0 0x7f074c06e630 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.742 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.732+0000 7f0750f98640 1 --2- 172.21.15.188:0/1945572507 >> v2:172.21.15.123:3300/0 conn(0x7f074c15eca0 0x7f074c06e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.742 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.732+0000 7f0750f98640 1 -- 172.21.15.188:0/1945572507 >> 172.21.15.188:0/1945572507 conn(0x7f074c0d1530 msgr2=0x7f074c0d1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:50.742 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.732+0000 7f0750f98640 1 -- 172.21.15.188:0/1945572507 shutdown_connections 2024-09-15T23:11:50.742 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.732+0000 7f0750f98640 1 -- 172.21.15.188:0/1945572507 wait complete. 2024-09-15T23:11:50.742 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.734+0000 7f0750f98640 1 Processor -- start 2024-09-15T23:11:50.743 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.734+0000 7f0750f98640 1 -- start start 2024-09-15T23:11:50.743 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.734+0000 7f0750f98640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f074c0ccaa0 0x7f074c0aea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:50.743 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.734+0000 7f0750f98640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f074c0d10f0 0x7f074c073410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:50.743 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.734+0000 7f0750f98640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f074c15eca0 0x7f074c1f4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:50.743 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.734+0000 7f0750f98640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f074c0b0d40 con 0x7f074c0ccaa0 2024-09-15T23:11:50.743 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.734+0000 7f0750f98640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f074c0b0bc0 con 0x7f074c15eca0 2024-09-15T23:11:50.743 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.734+0000 7f0750f98640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f074c0d0880 con 0x7f074c0d10f0 2024-09-15T23:11:50.743 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.735+0000 7f074ad9d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f074c15eca0 0x7f074c1f4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:50.744 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.735+0000 7f0749d9b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f074c0d10f0 0x7f074c073410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:50.744 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.735+0000 7f074a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f074c0ccaa0 0x7f074c0aea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:50.744 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.735+0000 7f0749d9b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f074c0d10f0 0x7f074c073410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.188:45820/0 (socket says 172.21.15.188:45820) 2024-09-15T23:11:50.744 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.735+0000 7f074ad9d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f074c15eca0 0x7f074c1f4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:39774/0 (socket says 172.21.15.188:39774) 2024-09-15T23:11:50.744 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.735+0000 7f0749d9b640 1 -- 172.21.15.188:0/1245450986 learned_addr learned my addr 172.21.15.188:0/1245450986 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-09-15T23:11:50.744 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.735+0000 7f074a59c640 1 -- 172.21.15.188:0/1245450986 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f074c0d10f0 msgr2=0x7f074c073410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:50.744 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.735+0000 7f074a59c640 1 --2- 172.21.15.188:0/1245450986 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f074c0d10f0 0x7f074c073410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.744 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.735+0000 7f074a59c640 1 -- 172.21.15.188:0/1245450986 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f074c15eca0 msgr2=0x7f074c1f4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:50.744 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.735+0000 7f074a59c640 1 --2- 172.21.15.188:0/1245450986 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f074c15eca0 0x7f074c1f4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.744 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.735+0000 7f074a59c640 1 -- 172.21.15.188:0/1245450986 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f074c0af190 con 0x7f074c0ccaa0 2024-09-15T23:11:50.744 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.735+0000 7f0749d9b640 1 --2- 172.21.15.188:0/1245450986 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f074c0d10f0 0x7f074c073410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:11:50.744 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.735+0000 7f074ad9d640 1 --2- 172.21.15.188:0/1245450986 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f074c15eca0 0x7f074c1f4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:11:50.745 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.735+0000 7f074a59c640 1 --2- 172.21.15.188:0/1245450986 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f074c0ccaa0 0x7f074c0aea90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f074000d5c0 tx=0x7f074000da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:50.745 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.735+0000 7f073affd640 1 -- 172.21.15.188:0/1245450986 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0740004030 con 0x7f074c0ccaa0 2024-09-15T23:11:50.745 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.735+0000 7f073affd640 1 -- 172.21.15.188:0/1245450986 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07400041d0 con 0x7f074c0ccaa0 2024-09-15T23:11:50.745 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.735+0000 7f0750f98640 1 -- 172.21.15.188:0/1245450986 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f074c0af470 con 0x7f074c0ccaa0 2024-09-15T23:11:50.745 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.735+0000 7f073affd640 1 -- 172.21.15.188:0/1245450986 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0740014620 con 0x7f074c0ccaa0 2024-09-15T23:11:50.745 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.735+0000 7f0750f98640 1 -- 172.21.15.188:0/1245450986 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f074c0afa30 con 0x7f074c0ccaa0 2024-09-15T23:11:50.745 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.736+0000 7f073affd640 1 -- 172.21.15.188:0/1245450986 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0740014b50 con 0x7f074c0ccaa0 2024-09-15T23:11:50.745 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.736+0000 7f073affd640 1 -- 172.21.15.188:0/1245450986 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f0740003aa0 con 0x7f074c0ccaa0 2024-09-15T23:11:50.745 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.736+0000 7f0750f98640 1 -- 172.21.15.188:0/1245450986 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f074c0d0b20 con 0x7f074c0ccaa0 2024-09-15T23:11:50.746 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.739+0000 7f073affd640 1 -- 172.21.15.188:0/1245450986 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f0740003d80 con 0x7f074c0ccaa0 2024-09-15T23:11:50.809 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.808+0000 7f0750f98640 1 -- 172.21.15.188:0/1245450986 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3d9bcd26-9d4b-427e-b655-e6f90ff495e2", "id": 3} v 0) -- 0x7f074c0d0ed0 con 0x7f074c0ccaa0 2024-09-15T23:11:50.812 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.812+0000 7f073affd640 1 -- 172.21.15.188:0/1245450986 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3d9bcd26-9d4b-427e-b655-e6f90ff495e2", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f0740003610 con 0x7f074c0ccaa0 2024-09-15T23:11:50.813 INFO:teuthology.orchestra.run.smithi188.stdout:3 2024-09-15T23:11:50.814 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.813+0000 7f0750f98640 1 -- 172.21.15.188:0/1245450986 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f074c0ccaa0 msgr2=0x7f074c0aea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:50.814 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.813+0000 7f0750f98640 1 --2- 172.21.15.188:0/1245450986 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f074c0ccaa0 0x7f074c0aea90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f074000d5c0 tx=0x7f074000da80 comp rx=0 tx=0).stop 2024-09-15T23:11:50.814 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.813+0000 7f0750f98640 1 -- 172.21.15.188:0/1245450986 shutdown_connections 2024-09-15T23:11:50.815 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.813+0000 7f0750f98640 1 --2- 172.21.15.188:0/1245450986 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f074c15eca0 0x7f074c1f4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.815 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.813+0000 7f0750f98640 1 --2- 172.21.15.188:0/1245450986 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f074c0d10f0 0x7f074c073410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.815 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.813+0000 7f0750f98640 1 --2- 172.21.15.188:0/1245450986 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f074c0ccaa0 0x7f074c0aea90 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.815 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.813+0000 7f0750f98640 1 -- 172.21.15.188:0/1245450986 >> 172.21.15.188:0/1245450986 conn(0x7f074c0d1530 msgr2=0x7f074c15daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:50.815 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.813+0000 7f0750f98640 1 -- 172.21.15.188:0/1245450986 shutdown_connections 2024-09-15T23:11:50.815 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.813+0000 7f0750f98640 1 -- 172.21.15.188:0/1245450986 wait complete. 2024-09-15T23:11:50.824 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new 546e8ebe-0094-4902-95c7-3a90321218fd 4 2024-09-15T23:11:50.923 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.922+0000 7fd02c7e4640 1 Processor -- start 2024-09-15T23:11:50.924 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.922+0000 7fd02c7e4640 1 -- start start 2024-09-15T23:11:50.927 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.923+0000 7fd02c7e4640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd02406e800 0x7fd0240cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:50.927 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.923+0000 7fd02c7e4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd0240d10f0 0x7fd0240cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:50.928 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.923+0000 7fd02c7e4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0240d22c0 con 0x7fd02415eca0 2024-09-15T23:11:50.928 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.923+0000 7fd02c7e4640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fd0240cf100 con 0x7fd0240d10f0 2024-09-15T23:11:50.928 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.923+0000 7fd02c7e4640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fd0240cbd20 con 0x7fd02406e800 2024-09-15T23:11:50.928 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.923+0000 7fd029d7f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd02406e800 0x7fd0240cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:50.928 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.923+0000 7fd029d7f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd02406e800 0x7fd0240cf870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:39776/0 (socket says 172.21.15.188:39776) 2024-09-15T23:11:50.928 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.923+0000 7fd029d7f640 1 -- 172.21.15.188:0/1759134554 learned_addr learned my addr 172.21.15.188:0/1759134554 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-09-15T23:11:50.928 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.924+0000 7fd02ad81640 1 --2- 172.21.15.188:0/1759134554 >> v2:172.21.15.123:3300/0 conn(0x7fd0240d10f0 0x7fd0240cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:50.929 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.924+0000 7fd029d7f640 1 -- 172.21.15.188:0/1759134554 >> v2:172.21.15.123:3300/0 conn(0x7fd0240d10f0 msgr2=0x7fd0240cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:11:50.929 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.924+0000 7fd029d7f640 1 --2- 172.21.15.188:0/1759134554 >> v2:172.21.15.123:3300/0 conn(0x7fd0240d10f0 0x7fd0240cfdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.929 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.924+0000 7fd029d7f640 1 -- 172.21.15.188:0/1759134554 >> v1:172.21.15.123:6789/0 conn(0x7fd02415eca0 legacy=0x7fd02406e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:50.929 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.924+0000 7fd029d7f640 1 -- 172.21.15.188:0/1759134554 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0240cf350 con 0x7fd02406e800 2024-09-15T23:11:50.929 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.924+0000 7fd029d7f640 1 --2- 172.21.15.188:0/1759134554 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd02406e800 0x7fd0240cf870 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd0240b7460 tx=0x7fd02002a150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a83b589b7f81e934 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:50.929 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.925+0000 7fd02957e640 1 -- 172.21.15.188:0/1759134554 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd020037070 con 0x7fd02406e800 2024-09-15T23:11:50.930 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.925+0000 7fd02957e640 1 -- 172.21.15.188:0/1759134554 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd020032440 con 0x7fd02406e800 2024-09-15T23:11:50.930 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.925+0000 7fd02957e640 1 -- 172.21.15.188:0/1759134554 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd020032810 con 0x7fd02406e800 2024-09-15T23:11:50.930 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.925+0000 7fd02c7e4640 1 -- 172.21.15.188:0/1759134554 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd02406e800 msgr2=0x7fd0240cf870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:50.930 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.925+0000 7fd02c7e4640 1 --2- 172.21.15.188:0/1759134554 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd02406e800 0x7fd0240cf870 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd0240b7460 tx=0x7fd02002a150 comp rx=0 tx=0).stop 2024-09-15T23:11:50.930 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.925+0000 7fd02c7e4640 1 -- 172.21.15.188:0/1759134554 shutdown_connections 2024-09-15T23:11:50.930 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.926+0000 7fd02c7e4640 1 --2- 172.21.15.188:0/1759134554 >> v2:172.21.15.123:3300/0 conn(0x7fd0240d10f0 0x7fd0240cfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.930 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.926+0000 7fd02c7e4640 1 --2- 172.21.15.188:0/1759134554 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd02406e800 0x7fd0240cf870 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.930 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.926+0000 7fd02c7e4640 1 -- 172.21.15.188:0/1759134554 >> 172.21.15.188:0/1759134554 conn(0x7fd0240d1530 msgr2=0x7fd0240d1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:50.930 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.926+0000 7fd02c7e4640 1 -- 172.21.15.188:0/1759134554 shutdown_connections 2024-09-15T23:11:50.930 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.926+0000 7fd02c7e4640 1 -- 172.21.15.188:0/1759134554 wait complete. 2024-09-15T23:11:50.934 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.927+0000 7fd02c7e4640 1 Processor -- start 2024-09-15T23:11:50.934 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.927+0000 7fd02c7e4640 1 -- start start 2024-09-15T23:11:50.934 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.927+0000 7fd02c7e4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd02406e800 0x7fd024157950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:50.934 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.927+0000 7fd02c7e4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0240d10f0 0x7fd024072190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:50.934 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.927+0000 7fd02c7e4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd02415eca0 0x7fd0240726d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:50.934 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.927+0000 7fd02c7e4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd0240b0d40 con 0x7fd02415eca0 2024-09-15T23:11:50.934 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.927+0000 7fd02c7e4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd0240b0bc0 con 0x7fd0240d10f0 2024-09-15T23:11:50.934 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.927+0000 7fd02c7e4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd0240ccaa0 con 0x7fd02406e800 2024-09-15T23:11:50.934 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.928+0000 7fd029d7f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0240d10f0 0x7fd024072190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:50.934 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.928+0000 7fd02a580640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd02406e800 0x7fd024157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:50.935 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.928+0000 7fd029d7f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0240d10f0 0x7fd024072190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:39782/0 (socket says 172.21.15.188:39782) 2024-09-15T23:11:50.935 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.928+0000 7fd029d7f640 1 -- 172.21.15.188:0/2465155608 learned_addr learned my addr 172.21.15.188:0/2465155608 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-09-15T23:11:50.935 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.928+0000 7fd02ad81640 1 --2- 172.21.15.188:0/2465155608 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd02415eca0 0x7fd0240726d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:50.935 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.928+0000 7fd029d7f640 1 -- 172.21.15.188:0/2465155608 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd02406e800 msgr2=0x7fd024157950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:50.935 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.928+0000 7fd029d7f640 1 --2- 172.21.15.188:0/2465155608 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd02406e800 0x7fd024157950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.935 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.928+0000 7fd029d7f640 1 -- 172.21.15.188:0/2465155608 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd02415eca0 msgr2=0x7fd0240726d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:50.935 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.928+0000 7fd029d7f640 1 --2- 172.21.15.188:0/2465155608 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd02415eca0 0x7fd0240726d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:50.935 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.928+0000 7fd029d7f640 1 -- 172.21.15.188:0/2465155608 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd02414e530 con 0x7fd0240d10f0 2024-09-15T23:11:50.935 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.928+0000 7fd02a580640 1 --2- 172.21.15.188:0/2465155608 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd02406e800 0x7fd024157950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:11:50.936 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.928+0000 7fd029d7f640 1 --2- 172.21.15.188:0/2465155608 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0240d10f0 0x7fd024072190 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd02002a190 tx=0x7fd0200046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:50.936 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.928+0000 7fd01affd640 1 -- 172.21.15.188:0/2465155608 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd020037040 con 0x7fd0240d10f0 2024-09-15T23:11:50.936 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.928+0000 7fd01affd640 1 -- 172.21.15.188:0/2465155608 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd020042070 con 0x7fd0240d10f0 2024-09-15T23:11:50.936 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.928+0000 7fd02c7e4640 1 -- 172.21.15.188:0/2465155608 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd02414e810 con 0x7fd0240d10f0 2024-09-15T23:11:50.936 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.928+0000 7fd01affd640 1 -- 172.21.15.188:0/2465155608 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd020030920 con 0x7fd0240d10f0 2024-09-15T23:11:50.936 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.928+0000 7fd02c7e4640 1 -- 172.21.15.188:0/2465155608 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd02414edd0 con 0x7fd0240d10f0 2024-09-15T23:11:50.936 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.928+0000 7fd01affd640 1 -- 172.21.15.188:0/2465155608 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd020030ac0 con 0x7fd0240d10f0 2024-09-15T23:11:50.936 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.929+0000 7fd01affd640 1 -- 172.21.15.188:0/2465155608 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fd020047be0 con 0x7fd0240d10f0 2024-09-15T23:11:50.936 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.929+0000 7fd02c7e4640 1 -- 172.21.15.188:0/2465155608 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd02406e0f0 con 0x7fd0240d10f0 2024-09-15T23:11:50.936 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.931+0000 7fd01affd640 1 -- 172.21.15.188:0/2465155608 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd020047460 con 0x7fd0240d10f0 2024-09-15T23:11:51.000 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:50.999+0000 7fd02c7e4640 1 -- 172.21.15.188:0/2465155608 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd new", "uuid": "546e8ebe-0094-4902-95c7-3a90321218fd", "id": 4} v 0) -- 0x7fd0240d0ed0 con 0x7fd0240d10f0 2024-09-15T23:11:51.005 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.005+0000 7fd01affd640 1 -- 172.21.15.188:0/2465155608 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "546e8ebe-0094-4902-95c7-3a90321218fd", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fd020047640 con 0x7fd0240d10f0 2024-09-15T23:11:51.006 INFO:teuthology.orchestra.run.smithi188.stdout:4 2024-09-15T23:11:51.007 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.006+0000 7fd02c7e4640 1 -- 172.21.15.188:0/2465155608 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0240d10f0 msgr2=0x7fd024072190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:51.007 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.006+0000 7fd02c7e4640 1 --2- 172.21.15.188:0/2465155608 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0240d10f0 0x7fd024072190 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd02002a190 tx=0x7fd0200046c0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.007 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.006+0000 7fd02c7e4640 1 -- 172.21.15.188:0/2465155608 shutdown_connections 2024-09-15T23:11:51.007 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.006+0000 7fd02c7e4640 1 --2- 172.21.15.188:0/2465155608 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd02415eca0 0x7fd0240726d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.007 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.006+0000 7fd02c7e4640 1 --2- 172.21.15.188:0/2465155608 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0240d10f0 0x7fd024072190 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.007 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.006+0000 7fd02c7e4640 1 --2- 172.21.15.188:0/2465155608 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd02406e800 0x7fd024157950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.007 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.006+0000 7fd02c7e4640 1 -- 172.21.15.188:0/2465155608 >> 172.21.15.188:0/2465155608 conn(0x7fd0240d1530 msgr2=0x7fd02415da50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:51.007 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.006+0000 7fd02c7e4640 1 -- 172.21.15.188:0/2465155608 shutdown_connections 2024-09-15T23:11:51.007 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.006+0000 7fd02c7e4640 1 -- 172.21.15.188:0/2465155608 wait complete. 2024-09-15T23:11:51.017 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new 472bfb57-51b2-4e8d-9838-108a90fb9480 5 2024-09-15T23:11:51.115 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.114+0000 7f53d7731640 1 Processor -- start 2024-09-15T23:11:51.115 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.114+0000 7f53d7731640 1 -- start start 2024-09-15T23:11:51.117 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.115+0000 7f53d7731640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f53d006bc10 0x7f53d006bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:51.117 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.115+0000 7f53d7731640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53d00d0a50 con 0x7f53d006e660 2024-09-15T23:11:51.117 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.115+0000 7f53d7731640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53d0073910 con 0x7f53d00cc3d0 2024-09-15T23:11:51.117 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.115+0000 7f53d7731640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f53d006c530 con 0x7f53d006bc10 2024-09-15T23:11:51.117 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.115+0000 7f53d5cce640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f53d00cc3d0 0x7f53d00d0340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:34414/0 (socket says 172.21.15.188:34414) 2024-09-15T23:11:51.117 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.115+0000 7f53d5cce640 1 -- 172.21.15.188:0/335696178 learned_addr learned my addr 172.21.15.188:0/335696178 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-09-15T23:11:51.117 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.115+0000 7f53d54cd640 1 --2- 172.21.15.188:0/335696178 >> v2:172.21.15.123:3300/0 conn(0x7f53d006bc10 0x7f53d006bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:51.117 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.115+0000 7f53c7fff640 1 -- 172.21.15.188:0/335696178 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 792217571 0 0) 0x7f53d0073910 con 0x7f53d00cc3d0 2024-09-15T23:11:51.117 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.116+0000 7f53c7fff640 1 -- 172.21.15.188:0/335696178 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53bc003520 con 0x7f53d00cc3d0 2024-09-15T23:11:51.117 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.116+0000 7f53d54cd640 1 -- 172.21.15.188:0/335696178 >> v1:172.21.15.188:6789/0 conn(0x7f53d00cc3d0 legacy=0x7f53d00d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:51.117 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.116+0000 7f53d54cd640 1 -- 172.21.15.188:0/335696178 >> v1:172.21.15.123:6789/0 conn(0x7f53d006e660 legacy=0x7f53d00cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:51.117 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.116+0000 7f53d54cd640 1 -- 172.21.15.188:0/335696178 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d0160580 con 0x7f53d006bc10 2024-09-15T23:11:51.119 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.116+0000 7f53d54cd640 1 --2- 172.21.15.188:0/335696178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53d006bc10 0x7f53d006bff0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f53c00097a0 tx=0x7f53c002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb7866e6cd78c143 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:51.119 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.117+0000 7f53c7fff640 1 -- 172.21.15.188:0/335696178 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c0037070 con 0x7f53d006bc10 2024-09-15T23:11:51.119 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.117+0000 7f53c7fff640 1 -- 172.21.15.188:0/335696178 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53c002adc0 con 0x7f53d006bc10 2024-09-15T23:11:51.119 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.117+0000 7f53c7fff640 1 -- 172.21.15.188:0/335696178 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c0032660 con 0x7f53d006bc10 2024-09-15T23:11:51.119 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.117+0000 7f53d7731640 1 -- 172.21.15.188:0/335696178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53d006bc10 msgr2=0x7f53d006bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:51.119 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.117+0000 7f53d7731640 1 --2- 172.21.15.188:0/335696178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53d006bc10 0x7f53d006bff0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f53c00097a0 tx=0x7f53c002a130 comp rx=0 tx=0).stop 2024-09-15T23:11:51.119 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.117+0000 7f53d7731640 1 -- 172.21.15.188:0/335696178 shutdown_connections 2024-09-15T23:11:51.119 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.117+0000 7f53d7731640 1 --2- 172.21.15.188:0/335696178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53d006bc10 0x7f53d006bff0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.119 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.117+0000 7f53d7731640 1 -- 172.21.15.188:0/335696178 >> 172.21.15.188:0/335696178 conn(0x7f53d00b2890 msgr2=0x7f53d00b2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:51.119 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.117+0000 7f53d7731640 1 -- 172.21.15.188:0/335696178 shutdown_connections 2024-09-15T23:11:51.119 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.117+0000 7f53d7731640 1 -- 172.21.15.188:0/335696178 wait complete. 2024-09-15T23:11:51.121 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.118+0000 7f53d7731640 1 Processor -- start 2024-09-15T23:11:51.122 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.119+0000 7f53d7731640 1 -- start start 2024-09-15T23:11:51.122 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.119+0000 7f53d7731640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f53d006bc10 0x7f53d015f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:51.122 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.119+0000 7f53d7731640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53d006e660 0x7f53d015e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:51.122 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.119+0000 7f53d7731640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53d00cc3d0 0x7f53d00c6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:51.122 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.119+0000 7f53d7731640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f53d0160e20 con 0x7f53d00cc3d0 2024-09-15T23:11:51.122 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.119+0000 7f53d7731640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f53d0160b40 con 0x7f53d006e660 2024-09-15T23:11:51.122 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.119+0000 7f53d7731640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f53d0161100 con 0x7f53d006bc10 2024-09-15T23:11:51.122 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.119+0000 7f53d4ccc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53d006e660 0x7f53d015e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:51.122 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.119+0000 7f53d4ccc640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53d006e660 0x7f53d015e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:39784/0 (socket says 172.21.15.188:39784) 2024-09-15T23:11:51.122 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.119+0000 7f53d54cd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f53d006bc10 0x7f53d015f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:51.122 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.119+0000 7f53d4ccc640 1 -- 172.21.15.188:0/1963792271 learned_addr learned my addr 172.21.15.188:0/1963792271 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-09-15T23:11:51.122 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.120+0000 7f53d5cce640 1 --2- 172.21.15.188:0/1963792271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53d00cc3d0 0x7f53d00c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:51.123 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.120+0000 7f53d4ccc640 1 -- 172.21.15.188:0/1963792271 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f53d006bc10 msgr2=0x7f53d015f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:51.123 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.120+0000 7f53d4ccc640 1 --2- 172.21.15.188:0/1963792271 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f53d006bc10 0x7f53d015f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.123 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.120+0000 7f53d4ccc640 1 -- 172.21.15.188:0/1963792271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53d00cc3d0 msgr2=0x7f53d00c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:51.123 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.120+0000 7f53d4ccc640 1 --2- 172.21.15.188:0/1963792271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53d00cc3d0 0x7f53d00c6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.123 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.120+0000 7f53d4ccc640 1 -- 172.21.15.188:0/1963792271 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d0073630 con 0x7f53d006e660 2024-09-15T23:11:51.123 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.120+0000 7f53d4ccc640 1 --2- 172.21.15.188:0/1963792271 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53d006e660 0x7f53d015e300 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f53cc00c780 tx=0x7f53cc00cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:51.123 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.120+0000 7f53c5ffb640 1 -- 172.21.15.188:0/1963792271 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53cc017070 con 0x7f53d006e660 2024-09-15T23:11:51.123 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.120+0000 7f53c5ffb640 1 -- 172.21.15.188:0/1963792271 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53cc005290 con 0x7f53d006e660 2024-09-15T23:11:51.123 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.120+0000 7f53d7731640 1 -- 172.21.15.188:0/1963792271 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53d0073070 con 0x7f53d006e660 2024-09-15T23:11:51.123 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.120+0000 7f53c5ffb640 1 -- 172.21.15.188:0/1963792271 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53cc00a880 con 0x7f53d006e660 2024-09-15T23:11:51.123 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.120+0000 7f53d7731640 1 -- 172.21.15.188:0/1963792271 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53d015f880 con 0x7f53d006e660 2024-09-15T23:11:51.123 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.120+0000 7f53c5ffb640 1 -- 172.21.15.188:0/1963792271 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f53cc01a070 con 0x7f53d006e660 2024-09-15T23:11:51.123 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.120+0000 7f53c5ffb640 1 -- 172.21.15.188:0/1963792271 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f53cc0035f0 con 0x7f53d006e660 2024-09-15T23:11:51.124 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.122+0000 7f53d7731640 1 -- 172.21.15.188:0/1963792271 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53d0073460 con 0x7f53d006e660 2024-09-15T23:11:51.124 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.124+0000 7f53c5ffb640 1 -- 172.21.15.188:0/1963792271 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f53cc00aa20 con 0x7f53d006e660 2024-09-15T23:11:51.192 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.191+0000 7f53d7731640 1 -- 172.21.15.188:0/1963792271 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd new", "uuid": "472bfb57-51b2-4e8d-9838-108a90fb9480", "id": 5} v 0) -- 0x7f53d00cd310 con 0x7f53d006e660 2024-09-15T23:11:51.197 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.196+0000 7f53c5ffb640 1 -- 172.21.15.188:0/1963792271 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "472bfb57-51b2-4e8d-9838-108a90fb9480", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f53cc00ac00 con 0x7f53d006e660 2024-09-15T23:11:51.198 INFO:teuthology.orchestra.run.smithi188.stdout:5 2024-09-15T23:11:51.199 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.197+0000 7f53d7731640 1 -- 172.21.15.188:0/1963792271 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53d006e660 msgr2=0x7f53d015e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:51.199 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.197+0000 7f53d7731640 1 --2- 172.21.15.188:0/1963792271 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53d006e660 0x7f53d015e300 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f53cc00c780 tx=0x7f53cc00cc40 comp rx=0 tx=0).stop 2024-09-15T23:11:51.199 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.197+0000 7f53d7731640 1 -- 172.21.15.188:0/1963792271 shutdown_connections 2024-09-15T23:11:51.199 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.197+0000 7f53d7731640 1 --2- 172.21.15.188:0/1963792271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53d00cc3d0 0x7f53d00c6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.199 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.197+0000 7f53d7731640 1 --2- 172.21.15.188:0/1963792271 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53d006e660 0x7f53d015e300 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.199 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.197+0000 7f53d7731640 1 --2- 172.21.15.188:0/1963792271 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f53d006bc10 0x7f53d015f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.199 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.197+0000 7f53d7731640 1 -- 172.21.15.188:0/1963792271 >> 172.21.15.188:0/1963792271 conn(0x7f53d00b2890 msgr2=0x7f53d00b06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:51.199 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.198+0000 7f53d7731640 1 -- 172.21.15.188:0/1963792271 shutdown_connections 2024-09-15T23:11:51.199 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.198+0000 7f53d7731640 1 -- 172.21.15.188:0/1963792271 wait complete. 2024-09-15T23:11:51.208 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new 985819ed-52ac-4708-8d8f-22625ecba0f9 6 2024-09-15T23:11:51.307 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.306+0000 7fc395131640 1 Processor -- start 2024-09-15T23:11:51.307 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.306+0000 7fc395131640 1 -- start start 2024-09-15T23:11:51.308 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.307+0000 7fc395131640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc39006fdb0 0x7fc3900ced50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:51.308 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.307+0000 7fc395131640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc39006e650 con 0x7fc3900cf290 2024-09-15T23:11:51.308 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.307+0000 7fc395131640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc39006e920 con 0x7fc39015e810 2024-09-15T23:11:51.308 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.307+0000 7fc395131640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc3900cf6e0 con 0x7fc39006fdb0 2024-09-15T23:11:51.308 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.307+0000 7fc38e59c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc39006fdb0 0x7fc3900ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:51.308 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.307+0000 7fc38ed9d640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fc39015e810 0x7fc39006df40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:34428/0 (socket says 172.21.15.188:34428) 2024-09-15T23:11:51.309 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.307+0000 7fc38ed9d640 1 -- 172.21.15.188:0/2661312111 learned_addr learned my addr 172.21.15.188:0/2661312111 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-09-15T23:11:51.309 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.307+0000 7fc38dd9b640 1 -- 172.21.15.188:0/2661312111 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1761647990 0 0) 0x7fc39006e920 con 0x7fc39015e810 2024-09-15T23:11:51.309 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.307+0000 7fc38e59c640 1 -- 172.21.15.188:0/2661312111 >> v1:172.21.15.188:6789/0 conn(0x7fc39015e810 legacy=0x7fc39006df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:51.309 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.307+0000 7fc38e59c640 1 -- 172.21.15.188:0/2661312111 >> v1:172.21.15.123:6789/0 conn(0x7fc3900cf290 legacy=0x7fc3900d1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:51.309 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.307+0000 7fc38e59c640 1 -- 172.21.15.188:0/2661312111 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc39006ec00 con 0x7fc39006fdb0 2024-09-15T23:11:51.310 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.308+0000 7fc38e59c640 1 --2- 172.21.15.188:0/2661312111 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc39006fdb0 0x7fc3900ced50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc3800097d0 tx=0x7fc38002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73c000b5b5df1596 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:51.310 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.308+0000 7fc38dd9b640 1 -- 172.21.15.188:0/2661312111 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc380037070 con 0x7fc39006fdb0 2024-09-15T23:11:51.310 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.308+0000 7fc38dd9b640 1 -- 172.21.15.188:0/2661312111 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc380032440 con 0x7fc39006fdb0 2024-09-15T23:11:51.310 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.308+0000 7fc38dd9b640 1 -- 172.21.15.188:0/2661312111 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc380032810 con 0x7fc39006fdb0 2024-09-15T23:11:51.310 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.308+0000 7fc395131640 1 -- 172.21.15.188:0/2661312111 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc39006fdb0 msgr2=0x7fc3900ced50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:51.310 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.308+0000 7fc395131640 1 --2- 172.21.15.188:0/2661312111 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc39006fdb0 0x7fc3900ced50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc3800097d0 tx=0x7fc38002a180 comp rx=0 tx=0).stop 2024-09-15T23:11:51.310 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.308+0000 7fc395131640 1 -- 172.21.15.188:0/2661312111 shutdown_connections 2024-09-15T23:11:51.311 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.308+0000 7fc395131640 1 --2- 172.21.15.188:0/2661312111 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc39006fdb0 0x7fc3900ced50 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.311 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.308+0000 7fc395131640 1 -- 172.21.15.188:0/2661312111 >> 172.21.15.188:0/2661312111 conn(0x7fc390067f80 msgr2=0x7fc3900b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:51.311 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.309+0000 7fc395131640 1 -- 172.21.15.188:0/2661312111 shutdown_connections 2024-09-15T23:11:51.311 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.309+0000 7fc395131640 1 -- 172.21.15.188:0/2661312111 wait complete. 2024-09-15T23:11:51.311 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.310+0000 7fc395131640 1 Processor -- start 2024-09-15T23:11:51.311 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.310+0000 7fc395131640 1 -- start start 2024-09-15T23:11:51.314 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.311+0000 7fc395131640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc39006fdb0 0x7fc3900b7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:51.314 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.311+0000 7fc395131640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc3900cf290 0x7fc3901f8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:51.314 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.311+0000 7fc395131640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc39015e810 0x7fc3901f8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:51.314 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.311+0000 7fc395131640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc39006f890 con 0x7fc39015e810 2024-09-15T23:11:51.314 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.311+0000 7fc395131640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc39006f5b0 con 0x7fc3900cf290 2024-09-15T23:11:51.314 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.311+0000 7fc395131640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc3900ce990 con 0x7fc39006fdb0 2024-09-15T23:11:51.314 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.311+0000 7fc38e59c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc3900cf290 0x7fc3901f8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:51.314 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.311+0000 7fc38ed9d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc39006fdb0 0x7fc3900b7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:51.314 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.311+0000 7fc38ed9d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc39006fdb0 0x7fc3900b7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.188:45864/0 (socket says 172.21.15.188:45864) 2024-09-15T23:11:51.314 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.311+0000 7fc38e59c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc3900cf290 0x7fc3901f8030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.188:39798/0 (socket says 172.21.15.188:39798) 2024-09-15T23:11:51.314 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.311+0000 7fc38ed9d640 1 -- 172.21.15.188:0/40336214 learned_addr learned my addr 172.21.15.188:0/40336214 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-09-15T23:11:51.314 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.311+0000 7fc38f59e640 1 --2- 172.21.15.188:0/40336214 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc39015e810 0x7fc3901f8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:51.315 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.311+0000 7fc38ed9d640 1 -- 172.21.15.188:0/40336214 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc3900cf290 msgr2=0x7fc3901f8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:51.315 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.311+0000 7fc38ed9d640 1 --2- 172.21.15.188:0/40336214 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc3900cf290 0x7fc3901f8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.315 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.311+0000 7fc38ed9d640 1 -- 172.21.15.188:0/40336214 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc39015e810 msgr2=0x7fc3901f8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:51.315 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.311+0000 7fc38ed9d640 1 --2- 172.21.15.188:0/40336214 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc39015e810 0x7fc3901f8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.315 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.311+0000 7fc38ed9d640 1 -- 172.21.15.188:0/40336214 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc390160b00 con 0x7fc39006fdb0 2024-09-15T23:11:51.315 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.311+0000 7fc38e59c640 1 --2- 172.21.15.188:0/40336214 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc3900cf290 0x7fc3901f8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:11:51.315 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.311+0000 7fc38ed9d640 1 --2- 172.21.15.188:0/40336214 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc39006fdb0 0x7fc3900b7d50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc38400c390 tx=0x7fc38400c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:51.315 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.312+0000 7fc3777fe640 1 -- 172.21.15.188:0/40336214 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc384017070 con 0x7fc39006fdb0 2024-09-15T23:11:51.315 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.312+0000 7fc3777fe640 1 -- 172.21.15.188:0/40336214 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc384007500 con 0x7fc39006fdb0 2024-09-15T23:11:51.315 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.312+0000 7fc395131640 1 -- 172.21.15.188:0/40336214 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc390160de0 con 0x7fc39006fdb0 2024-09-15T23:11:51.315 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.312+0000 7fc3777fe640 1 -- 172.21.15.188:0/40336214 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3840059e0 con 0x7fc39006fdb0 2024-09-15T23:11:51.315 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.312+0000 7fc395131640 1 -- 172.21.15.188:0/40336214 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc390160720 con 0x7fc39006fdb0 2024-09-15T23:11:51.315 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.312+0000 7fc3777fe640 1 -- 172.21.15.188:0/40336214 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc38401a070 con 0x7fc39006fdb0 2024-09-15T23:11:51.315 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.312+0000 7fc3777fe640 1 -- 172.21.15.188:0/40336214 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fc3840129f0 con 0x7fc39006fdb0 2024-09-15T23:11:51.316 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.313+0000 7fc395131640 1 -- 172.21.15.188:0/40336214 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc390161300 con 0x7fc39006fdb0 2024-09-15T23:11:51.316 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.315+0000 7fc3777fe640 1 -- 172.21.15.188:0/40336214 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc390161300 con 0x7fc39006fdb0 2024-09-15T23:11:51.385 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.384+0000 7fc395131640 1 -- 172.21.15.188:0/40336214 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "osd new", "uuid": "985819ed-52ac-4708-8d8f-22625ecba0f9", "id": 6} v 0) -- 0x7fc3900ced50 con 0x7fc39006fdb0 2024-09-15T23:11:51.390 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.389+0000 7fc3777fe640 1 -- 172.21.15.188:0/40336214 <== mon.2 v2:172.21.15.188:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "985819ed-52ac-4708-8d8f-22625ecba0f9", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fc384021020 con 0x7fc39006fdb0 2024-09-15T23:11:51.390 INFO:teuthology.orchestra.run.smithi188.stdout:6 2024-09-15T23:11:51.391 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.390+0000 7fc395131640 1 -- 172.21.15.188:0/40336214 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc39006fdb0 msgr2=0x7fc3900b7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:51.391 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.390+0000 7fc395131640 1 --2- 172.21.15.188:0/40336214 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc39006fdb0 0x7fc3900b7d50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc38400c390 tx=0x7fc38400c850 comp rx=0 tx=0).stop 2024-09-15T23:11:51.391 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.390+0000 7fc395131640 1 -- 172.21.15.188:0/40336214 shutdown_connections 2024-09-15T23:11:51.392 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.390+0000 7fc395131640 1 --2- 172.21.15.188:0/40336214 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc39015e810 0x7fc3901f8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.392 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.390+0000 7fc395131640 1 --2- 172.21.15.188:0/40336214 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc3900cf290 0x7fc3901f8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.392 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.390+0000 7fc395131640 1 --2- 172.21.15.188:0/40336214 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc39006fdb0 0x7fc3900b7d50 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.392 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.390+0000 7fc395131640 1 -- 172.21.15.188:0/40336214 >> 172.21.15.188:0/40336214 conn(0x7fc390067f80 msgr2=0x7fc3900d2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:51.392 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.390+0000 7fc395131640 1 -- 172.21.15.188:0/40336214 shutdown_connections 2024-09-15T23:11:51.392 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.390+0000 7fc395131640 1 -- 172.21.15.188:0/40336214 wait complete. 2024-09-15T23:11:51.401 DEBUG:teuthology.orchestra.run.smithi188:> sudo ceph --cluster ceph osd new 629f5732-0148-4782-949d-abdcdcd5fa75 7 2024-09-15T23:11:51.501 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.500+0000 7f02cb30a640 1 Processor -- start 2024-09-15T23:11:51.501 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.500+0000 7f02cb30a640 1 -- start start 2024-09-15T23:11:51.503 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.501+0000 7f02cb30a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f02c40c78a0 0x7f02c4071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:51.503 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.501+0000 7f02cb30a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02c41635e0 0x7f02c40720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:51.503 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.501+0000 7f02cb30a640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02c40cc5d0 con 0x7f02c40cfea0 2024-09-15T23:11:51.503 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.501+0000 7f02cb30a640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f02c40af930 con 0x7f02c40c78a0 2024-09-15T23:11:51.503 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.501+0000 7f02cb30a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f02c40afc10 con 0x7f02c41635e0 2024-09-15T23:11:51.503 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.501+0000 7f02c98a7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02c41635e0 0x7f02c40720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:51.504 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.501+0000 7f02c98a7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02c41635e0 0x7f02c40720f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.188:45876/0 (socket says 172.21.15.188:45876) 2024-09-15T23:11:51.504 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.501+0000 7f02c98a7640 1 -- 172.21.15.188:0/17723298 learned_addr learned my addr 172.21.15.188:0/17723298 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-09-15T23:11:51.504 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.501+0000 7f02c88a5640 1 --2- 172.21.15.188:0/17723298 >> v2:172.21.15.123:3300/0 conn(0x7f02c40c78a0 0x7f02c4071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:51.504 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.501+0000 7f02c98a7640 1 -- 172.21.15.188:0/17723298 >> v2:172.21.15.123:3300/0 conn(0x7f02c40c78a0 msgr2=0x7f02c4071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:11:51.504 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.501+0000 7f02c98a7640 1 --2- 172.21.15.188:0/17723298 >> v2:172.21.15.123:3300/0 conn(0x7f02c40c78a0 0x7f02c4071bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.504 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.501+0000 7f02c98a7640 1 -- 172.21.15.188:0/17723298 >> v1:172.21.15.123:6789/0 conn(0x7f02c40cfea0 legacy=0x7f02c4162ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:51.504 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.501+0000 7f02c98a7640 1 -- 172.21.15.188:0/17723298 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c40afef0 con 0x7f02c41635e0 2024-09-15T23:11:51.504 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.502+0000 7f02c98a7640 1 --2- 172.21.15.188:0/17723298 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02c41635e0 0x7f02c40720f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f02bc009e50 tx=0x7f02bc02a7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7a8b6a3ec3e8794 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:51.504 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.502+0000 7f02b7fff640 1 -- 172.21.15.188:0/17723298 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc036070 con 0x7f02c41635e0 2024-09-15T23:11:51.504 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.502+0000 7f02b7fff640 1 -- 172.21.15.188:0/17723298 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02bc031600 con 0x7f02c41635e0 2024-09-15T23:11:51.504 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.502+0000 7f02b7fff640 1 -- 172.21.15.188:0/17723298 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc0319d0 con 0x7f02c41635e0 2024-09-15T23:11:51.507 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.503+0000 7f02cb30a640 1 -- 172.21.15.188:0/17723298 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02c41635e0 msgr2=0x7f02c40720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:51.507 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.503+0000 7f02cb30a640 1 --2- 172.21.15.188:0/17723298 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02c41635e0 0x7f02c40720f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f02bc009e50 tx=0x7f02bc02a7a0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.508 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.503+0000 7f02cb30a640 1 -- 172.21.15.188:0/17723298 shutdown_connections 2024-09-15T23:11:51.508 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.503+0000 7f02cb30a640 1 --2- 172.21.15.188:0/17723298 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02c41635e0 0x7f02c40720f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.508 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.503+0000 7f02cb30a640 1 --2- 172.21.15.188:0/17723298 >> v2:172.21.15.123:3300/0 conn(0x7f02c40c78a0 0x7f02c4071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.508 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.503+0000 7f02cb30a640 1 -- 172.21.15.188:0/17723298 >> 172.21.15.188:0/17723298 conn(0x7f02c40b2890 msgr2=0x7f02c40b2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:51.508 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.503+0000 7f02cb30a640 1 -- 172.21.15.188:0/17723298 shutdown_connections 2024-09-15T23:11:51.508 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.503+0000 7f02cb30a640 1 -- 172.21.15.188:0/17723298 wait complete. 2024-09-15T23:11:51.508 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.504+0000 7f02cb30a640 1 Processor -- start 2024-09-15T23:11:51.508 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.504+0000 7f02cb30a640 1 -- start start 2024-09-15T23:11:51.508 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.505+0000 7f02cb30a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02c40c78a0 0x7f02c41f5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:51.508 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.505+0000 7f02cb30a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f02c40cfea0 0x7f02c415de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:51.508 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.505+0000 7f02cb30a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02c41635e0 0x7f02c415fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:51.508 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.505+0000 7f02cb30a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f02c406e790 con 0x7f02c40c78a0 2024-09-15T23:11:51.509 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.505+0000 7f02cb30a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f02c406e4a0 con 0x7f02c40cfea0 2024-09-15T23:11:51.509 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.505+0000 7f02cb30a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f02c4067950 con 0x7f02c41635e0 2024-09-15T23:11:51.509 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.505+0000 7f02c98a7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02c41635e0 0x7f02c415fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:51.509 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.505+0000 7f02c88a5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f02c40cfea0 0x7f02c415de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:51.509 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.505+0000 7f02c98a7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02c41635e0 0x7f02c415fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.188:45890/0 (socket says 172.21.15.188:45890) 2024-09-15T23:11:51.509 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.505+0000 7f02c98a7640 1 -- 172.21.15.188:0/1063435381 learned_addr learned my addr 172.21.15.188:0/1063435381 (peer_addr_for_me v2:172.21.15.188:0/0) 2024-09-15T23:11:51.509 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.505+0000 7f02c90a6640 1 --2- 172.21.15.188:0/1063435381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02c40c78a0 0x7f02c41f5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:51.509 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.505+0000 7f02c98a7640 1 -- 172.21.15.188:0/1063435381 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f02c40cfea0 msgr2=0x7f02c415de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:51.509 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.505+0000 7f02c98a7640 1 --2- 172.21.15.188:0/1063435381 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f02c40cfea0 0x7f02c415de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.509 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.505+0000 7f02c98a7640 1 -- 172.21.15.188:0/1063435381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02c40c78a0 msgr2=0x7f02c41f5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:51.509 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.505+0000 7f02c98a7640 1 --2- 172.21.15.188:0/1063435381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02c40c78a0 0x7f02c41f5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.509 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.505+0000 7f02c98a7640 1 -- 172.21.15.188:0/1063435381 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c40b40e0 con 0x7f02c41635e0 2024-09-15T23:11:51.509 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.505+0000 7f02c98a7640 1 --2- 172.21.15.188:0/1063435381 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02c41635e0 0x7f02c415fe50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f02bc009e50 tx=0x7f02bc004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:51.510 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.506+0000 7f02b5ffb640 1 -- 172.21.15.188:0/1063435381 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc041020 con 0x7f02c41635e0 2024-09-15T23:11:51.510 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.506+0000 7f02b5ffb640 1 -- 172.21.15.188:0/1063435381 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02bc007720 con 0x7f02c41635e0 2024-09-15T23:11:51.510 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.506+0000 7f02cb30a640 1 -- 172.21.15.188:0/1063435381 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02c40b43c0 con 0x7f02c41635e0 2024-09-15T23:11:51.510 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.506+0000 7f02b5ffb640 1 -- 172.21.15.188:0/1063435381 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc036040 con 0x7f02c41635e0 2024-09-15T23:11:51.510 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.506+0000 7f02cb30a640 1 -- 172.21.15.188:0/1063435381 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f02c40b4980 con 0x7f02c41635e0 2024-09-15T23:11:51.510 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.506+0000 7f02b5ffb640 1 -- 172.21.15.188:0/1063435381 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f02bc044020 con 0x7f02c41635e0 2024-09-15T23:11:51.510 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.506+0000 7f02b5ffb640 1 -- 172.21.15.188:0/1063435381 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f02bc03cc60 con 0x7f02c41635e0 2024-09-15T23:11:51.510 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.507+0000 7f02cb30a640 1 -- 172.21.15.188:0/1063435381 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02c415c440 con 0x7f02c41635e0 2024-09-15T23:11:51.510 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.509+0000 7f02b5ffb640 1 -- 172.21.15.188:0/1063435381 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f02bc04b030 con 0x7f02c41635e0 2024-09-15T23:11:51.562 INFO:tasks.ceph.mgr.x.smithi188.stderr:2024-09-15T23:11:51.561+0000 7f71d549b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T23:11:51.576 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-15T23:11:51.574+0000 7f6b06df9040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T23:11:51.579 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.579+0000 7f02cb30a640 1 -- 172.21.15.188:0/1063435381 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "osd new", "uuid": "629f5732-0148-4782-949d-abdcdcd5fa75", "id": 7} v 0) -- 0x7f02c40d0280 con 0x7f02c41635e0 2024-09-15T23:11:51.584 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.583+0000 7f02b5ffb640 1 -- 172.21.15.188:0/1063435381 <== mon.2 v2:172.21.15.188:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "629f5732-0148-4782-949d-abdcdcd5fa75", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f02bc007b10 con 0x7f02c41635e0 2024-09-15T23:11:51.584 INFO:teuthology.orchestra.run.smithi188.stdout:7 2024-09-15T23:11:51.585 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.584+0000 7f02cb30a640 1 -- 172.21.15.188:0/1063435381 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02c41635e0 msgr2=0x7f02c415fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:51.586 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.584+0000 7f02cb30a640 1 --2- 172.21.15.188:0/1063435381 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02c41635e0 0x7f02c415fe50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f02bc009e50 tx=0x7f02bc004a40 comp rx=0 tx=0).stop 2024-09-15T23:11:51.586 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.584+0000 7f02cb30a640 1 -- 172.21.15.188:0/1063435381 shutdown_connections 2024-09-15T23:11:51.586 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.584+0000 7f02cb30a640 1 --2- 172.21.15.188:0/1063435381 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02c41635e0 0x7f02c415fe50 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.586 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.584+0000 7f02cb30a640 1 --2- 172.21.15.188:0/1063435381 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f02c40cfea0 0x7f02c415de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.586 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.584+0000 7f02cb30a640 1 --2- 172.21.15.188:0/1063435381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02c40c78a0 0x7f02c41f5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.586 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.584+0000 7f02cb30a640 1 -- 172.21.15.188:0/1063435381 >> 172.21.15.188:0/1063435381 conn(0x7f02c40b2890 msgr2=0x7f02c40b11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:51.586 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.584+0000 7f02cb30a640 1 -- 172.21.15.188:0/1063435381 shutdown_connections 2024-09-15T23:11:51.586 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:11:51.584+0000 7f02cb30a640 1 -- 172.21.15.188:0/1063435381 wait complete. 2024-09-15T23:11:51.596 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-15T23:11:51.596 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-15T23:11:51.598 INFO:tasks.ceph.osd.0:Started 2024-09-15T23:11:51.598 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-15T23:11:51.599 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-15T23:11:51.600 INFO:tasks.ceph.osd.1:Started 2024-09-15T23:11:51.601 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-15T23:11:51.601 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-15T23:11:51.603 INFO:tasks.ceph.osd.2:Started 2024-09-15T23:11:51.603 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-15T23:11:51.603 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-15T23:11:51.605 INFO:tasks.ceph.osd.3:Started 2024-09-15T23:11:51.605 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-15T23:11:51.605 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-15T23:11:51.607 INFO:tasks.ceph.osd.4:Started 2024-09-15T23:11:51.608 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-15T23:11:51.608 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-15T23:11:51.610 INFO:tasks.ceph.osd.5:Started 2024-09-15T23:11:51.610 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-15T23:11:51.610 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-15T23:11:51.612 INFO:tasks.ceph.osd.6:Started 2024-09-15T23:11:51.612 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-15T23:11:51.612 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-15T23:11:51.615 INFO:tasks.ceph.osd.7:Started 2024-09-15T23:11:51.615 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:11:51.620 INFO:tasks.ceph.mgr.x.smithi188.stderr:2024-09-15T23:11:51.619+0000 7f71d549b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T23:11:51.646 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-15T23:11:51.645+0000 7f6b06df9040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T23:11:51.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.742+0000 7f9f3c3c6640 1 Processor -- start 2024-09-15T23:11:51.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.742+0000 7f9f3c3c6640 1 -- start start 2024-09-15T23:11:51.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.743+0000 7f9f3c3c6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9f3406c320 0x7f9f340b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:51.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.743+0000 7f9f3c3c6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f9f340b5100 0x7f9f340b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:51.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.743+0000 7f9f3c3c6640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f340b5770 con 0x7f9f34148420 2024-09-15T23:11:51.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.743+0000 7f9f3c3c6640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f9f340b1070 con 0x7f9f3406c320 2024-09-15T23:11:51.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.743+0000 7f9f3c3c6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f9f340b5530 con 0x7f9f340b5100 2024-09-15T23:11:51.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.743+0000 7f9f39961640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9f3406c320 0x7f9f340b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:51.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.743+0000 7f9f39961640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9f3406c320 0x7f9f340b4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35596/0 (socket says 172.21.15.123:35596) 2024-09-15T23:11:51.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.743+0000 7f9f39961640 1 -- 172.21.15.123:0/1710145214 learned_addr learned my addr 172.21.15.123:0/1710145214 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:11:51.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.743+0000 7f9f3a963640 1 --2- 172.21.15.123:0/1710145214 >> v2:172.21.15.188:3300/0 conn(0x7f9f340b5100 0x7f9f340b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:51.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.743+0000 7f9f39961640 1 -- 172.21.15.123:0/1710145214 >> v2:172.21.15.188:3300/0 conn(0x7f9f340b5100 msgr2=0x7f9f340b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:11:51.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.743+0000 7f9f39961640 1 --2- 172.21.15.123:0/1710145214 >> v2:172.21.15.188:3300/0 conn(0x7f9f340b5100 0x7f9f340b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.743+0000 7f9f39961640 1 -- 172.21.15.123:0/1710145214 >> v1:172.21.15.188:6789/0 conn(0x7f9f34148420 legacy=0x7f9f3406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:51.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.743+0000 7f9f39961640 1 -- 172.21.15.123:0/1710145214 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f340b5a50 con 0x7f9f3406c320 2024-09-15T23:11:51.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.743+0000 7f9f3a963640 1 --2- 172.21.15.123:0/1710145214 >> v2:172.21.15.188:3300/0 conn(0x7f9f340b5100 0x7f9f340b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:11:51.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.744+0000 7f9f39961640 1 --2- 172.21.15.123:0/1710145214 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f3406c320 0x7f9f340b4ab0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9f340b1310 tx=0x7f9f3002a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7092ba9d9fea45be server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:51.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.744+0000 7f9f39160640 1 -- 172.21.15.123:0/1710145214 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f30037070 con 0x7f9f3406c320 2024-09-15T23:11:51.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.744+0000 7f9f39160640 1 -- 172.21.15.123:0/1710145214 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f30032440 con 0x7f9f3406c320 2024-09-15T23:11:51.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.744+0000 7f9f39160640 1 -- 172.21.15.123:0/1710145214 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f30032810 con 0x7f9f3406c320 2024-09-15T23:11:51.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.745+0000 7f9f3c3c6640 1 -- 172.21.15.123:0/1710145214 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f3406c320 msgr2=0x7f9f340b4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:51.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.745+0000 7f9f3c3c6640 1 --2- 172.21.15.123:0/1710145214 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f3406c320 0x7f9f340b4ab0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9f340b1310 tx=0x7f9f3002a200 comp rx=0 tx=0).stop 2024-09-15T23:11:51.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.745+0000 7f9f3c3c6640 1 -- 172.21.15.123:0/1710145214 shutdown_connections 2024-09-15T23:11:51.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.745+0000 7f9f3c3c6640 1 --2- 172.21.15.123:0/1710145214 >> v2:172.21.15.188:3300/0 conn(0x7f9f340b5100 0x7f9f340b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.745+0000 7f9f3c3c6640 1 --2- 172.21.15.123:0/1710145214 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f3406c320 0x7f9f340b4ab0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.745+0000 7f9f3c3c6640 1 -- 172.21.15.123:0/1710145214 >> 172.21.15.123:0/1710145214 conn(0x7f9f3406cd20 msgr2=0x7f9f3406d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:51.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.745+0000 7f9f3c3c6640 1 -- 172.21.15.123:0/1710145214 shutdown_connections 2024-09-15T23:11:51.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.745+0000 7f9f3c3c6640 1 -- 172.21.15.123:0/1710145214 wait complete. 2024-09-15T23:11:51.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.747+0000 7f9f3c3c6640 1 Processor -- start 2024-09-15T23:11:51.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.747+0000 7f9f3c3c6640 1 -- start start 2024-09-15T23:11:51.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.747+0000 7f9f3c3c6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f3406c320 0x7f9f340c6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:51.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.747+0000 7f9f3c3c6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9f340b5100 0x7f9f341f8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:51.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.747+0000 7f9f3c3c6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9f34148420 0x7f9f34154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:51.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.747+0000 7f9f3c3c6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9f340b6010 con 0x7f9f3406c320 2024-09-15T23:11:51.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.747+0000 7f9f3c3c6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9f340b13e0 con 0x7f9f340b5100 2024-09-15T23:11:51.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.747+0000 7f9f3c3c6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9f340b1db0 con 0x7f9f34148420 2024-09-15T23:11:51.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.747+0000 7f9f3a162640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f3406c320 0x7f9f340c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:51.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.747+0000 7f9f3a162640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f3406c320 0x7f9f340c6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35608/0 (socket says 172.21.15.123:35608) 2024-09-15T23:11:51.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.747+0000 7f9f3a162640 1 -- 172.21.15.123:0/242892225 learned_addr learned my addr 172.21.15.123:0/242892225 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:11:51.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.747+0000 7f9f39961640 1 --2- 172.21.15.123:0/242892225 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9f340b5100 0x7f9f341f8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:51.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.747+0000 7f9f3a963640 1 --2- 172.21.15.123:0/242892225 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9f34148420 0x7f9f34154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:51.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.747+0000 7f9f3a162640 1 -- 172.21.15.123:0/242892225 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9f34148420 msgr2=0x7f9f34154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:51.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.747+0000 7f9f3a162640 1 --2- 172.21.15.123:0/242892225 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9f34148420 0x7f9f34154150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.747+0000 7f9f3a162640 1 -- 172.21.15.123:0/242892225 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9f340b5100 msgr2=0x7f9f341f8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:51.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.747+0000 7f9f3a162640 1 --2- 172.21.15.123:0/242892225 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9f340b5100 0x7f9f341f8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.747+0000 7f9f3a162640 1 -- 172.21.15.123:0/242892225 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f34154690 con 0x7f9f3406c320 2024-09-15T23:11:51.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.747+0000 7f9f39961640 1 --2- 172.21.15.123:0/242892225 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9f340b5100 0x7f9f341f8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:11:51.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.748+0000 7f9f3a162640 1 --2- 172.21.15.123:0/242892225 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f3406c320 0x7f9f340c6700 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9f2400c3f0 tx=0x7f9f2400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:51.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.748+0000 7f9f2affd640 1 -- 172.21.15.123:0/242892225 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f240052d0 con 0x7f9f3406c320 2024-09-15T23:11:51.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.748+0000 7f9f2affd640 1 -- 172.21.15.123:0/242892225 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f24005490 con 0x7f9f3406c320 2024-09-15T23:11:51.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.748+0000 7f9f3c3c6640 1 -- 172.21.15.123:0/242892225 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f341e8490 con 0x7f9f3406c320 2024-09-15T23:11:51.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.748+0000 7f9f2affd640 1 -- 172.21.15.123:0/242892225 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f24007260 con 0x7f9f3406c320 2024-09-15T23:11:51.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.748+0000 7f9f3c3c6640 1 -- 172.21.15.123:0/242892225 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f341e8a10 con 0x7f9f3406c320 2024-09-15T23:11:51.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.748+0000 7f9f2affd640 1 -- 172.21.15.123:0/242892225 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9f24007480 con 0x7f9f3406c320 2024-09-15T23:11:51.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.748+0000 7f9f2affd640 1 -- 172.21.15.123:0/242892225 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f9f240035f0 con 0x7f9f3406c320 2024-09-15T23:11:51.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.749+0000 7f9f3c3c6640 1 -- 172.21.15.123:0/242892225 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f340b4ab0 con 0x7f9f3406c320 2024-09-15T23:11:51.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.751+0000 7f9f2affd640 1 -- 172.21.15.123:0/242892225 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f9f24003c70 con 0x7f9f3406c320 2024-09-15T23:11:51.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.809+0000 7f9f3c3c6640 1 -- 172.21.15.123:0/242892225 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9f340b28e0 con 0x7f9f3406c320 2024-09-15T23:11:51.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.810+0000 7f9f2affd640 1 -- 172.21.15.123:0/242892225 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f9f240067d0 con 0x7f9f3406c320 2024-09-15T23:11:51.812 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:11:51.812 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":10,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:11:51.580838+0000","last_up_change":"0.000000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:11:51.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.811+0000 7f9f3c3c6640 1 -- 172.21.15.123:0/242892225 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f3406c320 msgr2=0x7f9f340c6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:51.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.811+0000 7f9f3c3c6640 1 --2- 172.21.15.123:0/242892225 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f3406c320 0x7f9f340c6700 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9f2400c3f0 tx=0x7f9f2400c8b0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.811+0000 7f9f3c3c6640 1 -- 172.21.15.123:0/242892225 shutdown_connections 2024-09-15T23:11:51.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.811+0000 7f9f3c3c6640 1 --2- 172.21.15.123:0/242892225 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9f34148420 0x7f9f34154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.811+0000 7f9f3c3c6640 1 --2- 172.21.15.123:0/242892225 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9f340b5100 0x7f9f341f8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.811+0000 7f9f3c3c6640 1 --2- 172.21.15.123:0/242892225 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f3406c320 0x7f9f340c6700 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:51.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.811+0000 7f9f3c3c6640 1 -- 172.21.15.123:0/242892225 >> 172.21.15.123:0/242892225 conn(0x7f9f3406cd20 msgr2=0x7f9f3406df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:51.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.811+0000 7f9f3c3c6640 1 -- 172.21.15.123:0/242892225 shutdown_connections 2024-09-15T23:11:51.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:11:51.811+0000 7f9f3c3c6640 1 -- 172.21.15.123:0/242892225 wait complete. 2024-09-15T23:11:51.823 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-15T23:11:51.823 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-15T23:11:52.012 INFO:tasks.ceph.mgr.x.smithi188.stderr:2024-09-15T23:11:52.011+0000 7f71d549b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T23:11:52.037 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-15T23:11:52.035+0000 7f6b06df9040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T23:11:52.097 INFO:tasks.ceph.mgr.x.smithi188.stderr:2024-09-15T23:11:52.096+0000 7f71d549b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T23:11:52.122 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-15T23:11:52.121+0000 7f6b06df9040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T23:11:52.203 INFO:tasks.ceph.mgr.x.smithi188.stderr:2024-09-15T23:11:52.201+0000 7f71d549b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:11:52.230 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-15T23:11:52.228+0000 7f6b06df9040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:11:52.249 INFO:tasks.ceph.mgr.x.smithi188.stderr:2024-09-15T23:11:52.248+0000 7f71d549b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T23:11:52.277 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-15T23:11:52.275+0000 7f6b06df9040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T23:11:52.363 INFO:tasks.ceph.mgr.x.smithi188.stderr:2024-09-15T23:11:52.362+0000 7f71d549b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T23:11:52.389 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-15T23:11:52.389+0000 7f6b06df9040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T23:11:52.415 INFO:tasks.ceph.mgr.x.smithi188.stderr:2024-09-15T23:11:52.414+0000 7f71d549b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T23:11:52.442 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-15T23:11:52.441+0000 7f6b06df9040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T23:11:52.461 INFO:tasks.ceph.mgr.x.smithi188.stderr:2024-09-15T23:11:52.460+0000 7f71d549b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T23:11:52.489 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-15T23:11:52.488+0000 7f6b06df9040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T23:11:52.574 INFO:tasks.ceph.mgr.x.smithi188.stderr:2024-09-15T23:11:52.573+0000 7f71d549b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T23:11:52.602 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-15T23:11:52.601+0000 7f6b06df9040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T23:11:52.624 INFO:tasks.ceph.mgr.x.smithi188.stderr:2024-09-15T23:11:52.624+0000 7f71d549b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T23:11:52.629 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-15T23:11:52.653 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-15T23:11:52.653+0000 7f6b06df9040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T23:11:52.675 INFO:tasks.ceph.mgr.x.smithi188.stderr:2024-09-15T23:11:52.674+0000 7f71d549b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T23:11:52.707 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-15T23:11:52.706+0000 7f6b06df9040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T23:11:52.720 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.719+0000 7f1cf4386640 1 Processor -- start 2024-09-15T23:11:52.720 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.719+0000 7f1cf4386640 1 -- start start 2024-09-15T23:11:52.722 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.720+0000 7f1cf4386640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1cec0d0310 0x7f1cec15f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:52.722 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.720+0000 7f1cf4386640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cec15fd90 con 0x7f1cec0b4400 2024-09-15T23:11:52.722 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.720+0000 7f1cf4386640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cec071e10 con 0x7f1cec0718a0 2024-09-15T23:11:52.723 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.720+0000 7f1cf4386640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f1cec0720f0 con 0x7f1cec0d0310 2024-09-15T23:11:52.723 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.721+0000 7f1cf2923640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1cec0b4400 0x7f1cec0ae8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49596/0 (socket says 172.21.15.123:49596) 2024-09-15T23:11:52.723 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.721+0000 7f1cf2923640 1 -- 172.21.15.123:0/3516120229 learned_addr learned my addr 172.21.15.123:0/3516120229 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:11:52.723 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.721+0000 7f1cf2122640 1 --2- 172.21.15.123:0/3516120229 >> v2:172.21.15.188:3300/0 conn(0x7f1cec0d0310 0x7f1cec15f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:52.723 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.721+0000 7f1cf1120640 1 -- 172.21.15.123:0/3516120229 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3265205784 0 0) 0x7f1ce4001490 con 0x7f1cec0b4400 2024-09-15T23:11:52.723 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.721+0000 7f1cf1120640 1 -- 172.21.15.123:0/3516120229 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1cd8003520 con 0x7f1cec0b4400 2024-09-15T23:11:52.723 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.721+0000 7f1cf1120640 1 -- 172.21.15.123:0/3516120229 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 992853550 0 0) 0x7f1cec071e10 con 0x7f1cec0718a0 2024-09-15T23:11:52.723 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.721+0000 7f1cf1120640 1 -- 172.21.15.123:0/3516120229 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ce4001490 con 0x7f1cec0718a0 2024-09-15T23:11:52.723 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.721+0000 7f1cf2122640 1 -- 172.21.15.123:0/3516120229 >> v1:172.21.15.188:6789/0 conn(0x7f1cec0718a0 legacy=0x7f1cec0b3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:52.723 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.721+0000 7f1cf2122640 1 -- 172.21.15.123:0/3516120229 >> v1:172.21.15.123:6789/0 conn(0x7f1cec0b4400 legacy=0x7f1cec0ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:52.723 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.721+0000 7f1cf1120640 1 -- 172.21.15.123:0/3516120229 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1984340113 0 0) 0x7f1cd8003520 con 0x7f1cec0b4400 2024-09-15T23:11:52.724 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.721+0000 7f1cf2122640 1 -- 172.21.15.123:0/3516120229 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cec0723d0 con 0x7f1cec0d0310 2024-09-15T23:11:52.725 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.722+0000 7f1cf2122640 1 --2- 172.21.15.123:0/3516120229 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1cec0d0310 0x7f1cec15f850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1ce80097a0 tx=0x7f1ce802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e4d0fe2316a704 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:52.725 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.722+0000 7f1cf1120640 1 -- 172.21.15.123:0/3516120229 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce8037070 con 0x7f1cec0d0310 2024-09-15T23:11:52.725 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.722+0000 7f1cf1120640 1 -- 172.21.15.123:0/3516120229 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ce802ac50 con 0x7f1cec0d0310 2024-09-15T23:11:52.725 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.722+0000 7f1cf1120640 1 -- 172.21.15.123:0/3516120229 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4001bc0 con 0x7f1cec0d0310 2024-09-15T23:11:52.725 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.723+0000 7f1cf4386640 1 -- 172.21.15.123:0/3516120229 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1cec0d0310 msgr2=0x7f1cec15f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:52.726 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.723+0000 7f1cf4386640 1 --2- 172.21.15.123:0/3516120229 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1cec0d0310 0x7f1cec15f850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1ce80097a0 tx=0x7f1ce802a1c0 comp rx=0 tx=0).stop 2024-09-15T23:11:52.726 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.723+0000 7f1cf4386640 1 -- 172.21.15.123:0/3516120229 shutdown_connections 2024-09-15T23:11:52.726 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.723+0000 7f1cf4386640 1 --2- 172.21.15.123:0/3516120229 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1cec0d0310 0x7f1cec15f850 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:52.726 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.723+0000 7f1cf4386640 1 -- 172.21.15.123:0/3516120229 >> 172.21.15.123:0/3516120229 conn(0x7f1cec06bc10 msgr2=0x7f1cec06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:52.726 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.723+0000 7f1cf4386640 1 -- 172.21.15.123:0/3516120229 shutdown_connections 2024-09-15T23:11:52.726 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.723+0000 7f1cf4386640 1 -- 172.21.15.123:0/3516120229 wait complete. 2024-09-15T23:11:52.726 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.724+0000 7f1cf4386640 1 Processor -- start 2024-09-15T23:11:52.726 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.724+0000 7f1cf4386640 1 -- start start 2024-09-15T23:11:52.728 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.725+0000 7f1cf4386640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1cec0718a0 0x7f1cec1583c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:52.728 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.725+0000 7f1cf4386640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cec0b4400 0x7f1cec14b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:52.728 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.725+0000 7f1cf4386640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1cec0d0310 0x7f1cec1568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:52.729 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.725+0000 7f1cf4386640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1cec0d06f0 con 0x7f1cec0b4400 2024-09-15T23:11:52.729 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.725+0000 7f1cf4386640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1cec072990 con 0x7f1cec0718a0 2024-09-15T23:11:52.729 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.725+0000 7f1cf4386640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1cec0aefd0 con 0x7f1cec0d0310 2024-09-15T23:11:52.729 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.725+0000 7f1cf1921640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cec0b4400 0x7f1cec14b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:52.729 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.725+0000 7f1cf2122640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1cec0718a0 0x7f1cec1583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:52.729 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.725+0000 7f1cf1921640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cec0b4400 0x7f1cec14b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35622/0 (socket says 172.21.15.123:35622) 2024-09-15T23:11:52.729 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.725+0000 7f1cf1921640 1 -- 172.21.15.123:0/902660102 learned_addr learned my addr 172.21.15.123:0/902660102 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:11:52.729 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.725+0000 7f1cf2923640 1 --2- 172.21.15.123:0/902660102 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1cec0d0310 0x7f1cec1568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:52.729 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.725+0000 7f1cf1921640 1 -- 172.21.15.123:0/902660102 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1cec0d0310 msgr2=0x7f1cec1568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:52.729 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.725+0000 7f1cf1921640 1 --2- 172.21.15.123:0/902660102 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1cec0d0310 0x7f1cec1568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:52.729 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.725+0000 7f1cf1921640 1 -- 172.21.15.123:0/902660102 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1cec0718a0 msgr2=0x7f1cec1583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:52.730 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.725+0000 7f1cf1921640 1 --2- 172.21.15.123:0/902660102 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1cec0718a0 0x7f1cec1583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:52.730 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.725+0000 7f1cf1921640 1 -- 172.21.15.123:0/902660102 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cec1555a0 con 0x7f1cec0b4400 2024-09-15T23:11:52.730 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.725+0000 7f1cf2122640 1 --2- 172.21.15.123:0/902660102 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1cec0718a0 0x7f1cec1583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:11:52.730 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.725+0000 7f1cf1921640 1 --2- 172.21.15.123:0/902660102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cec0b4400 0x7f1cec14b680 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00c490 tx=0x7f1cdc00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:52.730 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.725+0000 7f1ce2ffd640 1 -- 172.21.15.123:0/902660102 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc0052d0 con 0x7f1cec0b4400 2024-09-15T23:11:52.730 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.725+0000 7f1ce2ffd640 1 -- 172.21.15.123:0/902660102 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cdc005470 con 0x7f1cec0b4400 2024-09-15T23:11:52.730 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.725+0000 7f1ce2ffd640 1 -- 172.21.15.123:0/902660102 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc012850 con 0x7f1cec0b4400 2024-09-15T23:11:52.730 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.725+0000 7f1cf4386640 1 -- 172.21.15.123:0/902660102 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cec158900 con 0x7f1cec0b4400 2024-09-15T23:11:52.730 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.725+0000 7f1cf4386640 1 -- 172.21.15.123:0/902660102 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cec155b20 con 0x7f1cec0b4400 2024-09-15T23:11:52.730 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.726+0000 7f1ce2ffd640 1 -- 172.21.15.123:0/902660102 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1cdc0129f0 con 0x7f1cec0b4400 2024-09-15T23:11:52.730 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.726+0000 7f1ce2ffd640 1 -- 172.21.15.123:0/902660102 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f1cdc01bbc0 con 0x7f1cec0b4400 2024-09-15T23:11:52.731 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.726+0000 7f1cf4386640 1 -- 172.21.15.123:0/902660102 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cec0760f0 con 0x7f1cec0b4400 2024-09-15T23:11:52.731 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.728+0000 7f1ce2ffd640 1 -- 172.21.15.123:0/902660102 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f1cec0760f0 con 0x7f1cec0b4400 2024-09-15T23:11:52.742 INFO:tasks.ceph.mgr.x.smithi188.stderr:2024-09-15T23:11:52.741+0000 7f71d549b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T23:11:52.778 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-15T23:11:52.777+0000 7f6b06df9040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T23:11:52.786 INFO:tasks.ceph.mgr.x.smithi188.stderr:2024-09-15T23:11:52.786+0000 7f71d549b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T23:11:52.788 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.787+0000 7f1cf4386640 1 -- 172.21.15.123:0/902660102 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1cec073da0 con 0x7f1cec0b4400 2024-09-15T23:11:52.789 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.788+0000 7f1ce2ffd640 1 -- 172.21.15.123:0/902660102 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f1cdc01b4f0 con 0x7f1cec0b4400 2024-09-15T23:11:52.789 INFO:teuthology.misc.health.smithi123.stdout: 2024-09-15T23:11:52.789 INFO:teuthology.misc.health.smithi123.stdout:{"epoch":10,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:11:51.580838+0000","last_up_change":"0.000000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:11:52.790 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.789+0000 7f1cf4386640 1 -- 172.21.15.123:0/902660102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cec0b4400 msgr2=0x7f1cec14b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:52.790 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.789+0000 7f1cf4386640 1 --2- 172.21.15.123:0/902660102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cec0b4400 0x7f1cec14b680 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00c490 tx=0x7f1cdc00c950 comp rx=0 tx=0).stop 2024-09-15T23:11:52.790 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.789+0000 7f1cf4386640 1 -- 172.21.15.123:0/902660102 shutdown_connections 2024-09-15T23:11:52.790 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.789+0000 7f1cf4386640 1 --2- 172.21.15.123:0/902660102 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1cec0d0310 0x7f1cec1568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:52.790 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.789+0000 7f1cf4386640 1 --2- 172.21.15.123:0/902660102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cec0b4400 0x7f1cec14b680 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:52.791 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.789+0000 7f1cf4386640 1 --2- 172.21.15.123:0/902660102 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1cec0718a0 0x7f1cec1583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:52.791 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.789+0000 7f1cf4386640 1 -- 172.21.15.123:0/902660102 >> 172.21.15.123:0/902660102 conn(0x7f1cec06bc10 msgr2=0x7f1cec161220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:52.791 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.789+0000 7f1cf4386640 1 -- 172.21.15.123:0/902660102 shutdown_connections 2024-09-15T23:11:52.791 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:52.789+0000 7f1cf4386640 1 -- 172.21.15.123:0/902660102 wait complete. 2024-09-15T23:11:52.799 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-15T23:11:52.825 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-15T23:11:52.824+0000 7f6b06df9040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T23:11:52.832 INFO:tasks.ceph.mgr.x.smithi188.stderr:2024-09-15T23:11:52.831+0000 7f71d549b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T23:11:52.870 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-15T23:11:52.869+0000 7f6b06df9040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T23:11:53.093 INFO:tasks.ceph.osd.4.smithi188.stderr:2024-09-15T23:11:53.092+0000 7f6d4afc5640 -1 Falling back to public interface 2024-09-15T23:11:53.317 INFO:tasks.ceph.osd.5.smithi188.stderr:2024-09-15T23:11:53.316+0000 7f8e673d7640 -1 Falling back to public interface 2024-09-15T23:11:53.322 INFO:tasks.ceph.osd.2.smithi123.stderr:2024-09-15T23:11:53.321+0000 7f90ef814640 -1 Falling back to public interface 2024-09-15T23:11:53.346 INFO:tasks.ceph.osd.6.smithi188.stderr:2024-09-15T23:11:53.346+0000 7efe11a11640 -1 Falling back to public interface 2024-09-15T23:11:53.358 INFO:tasks.ceph.osd.1.smithi123.stderr:2024-09-15T23:11:53.357+0000 7f75812d8640 -1 Falling back to public interface 2024-09-15T23:11:53.489 INFO:tasks.ceph.mgr.x.smithi188.stderr:2024-09-15T23:11:53.488+0000 7f71d549b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T23:11:53.530 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-09-15T23:11:53.530+0000 7f6b06df9040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T23:11:53.566 INFO:tasks.ceph.osd.0.smithi123.stderr:2024-09-15T23:11:53.565+0000 7f93998d4640 -1 Falling back to public interface 2024-09-15T23:11:53.575 INFO:tasks.ceph.osd.3.smithi123.stderr:2024-09-15T23:11:53.574+0000 7f1f3562a640 -1 Falling back to public interface 2024-09-15T23:11:53.587 INFO:tasks.ceph.osd.7.smithi188.stderr:2024-09-15T23:11:53.586+0000 7f6b01a2e640 -1 Falling back to public interface 2024-09-15T23:11:54.504 INFO:tasks.ceph.mgr.x.smithi188.stderr:2024-09-15T23:11:54.503+0000 7f7175d67640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-15T23:11:54.505 INFO:tasks.ceph.mgr.x.smithi188.stderr:2024-09-15T23:11:54.504+0000 7f7175d67640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-15T23:11:57.103 INFO:tasks.ceph.osd.5.smithi188.stderr:2024-09-15T23:11:57.102+0000 7f8e673d7640 -1 osd.5 0 log_to_monitors true 2024-09-15T23:11:57.172 INFO:tasks.ceph.osd.4.smithi188.stderr:2024-09-15T23:11:57.171+0000 7f6d4afc5640 -1 osd.4 0 log_to_monitors true 2024-09-15T23:11:57.607 INFO:tasks.ceph.osd.0.smithi123.stderr:2024-09-15T23:11:57.605+0000 7f93998d4640 -1 osd.0 0 log_to_monitors true 2024-09-15T23:11:57.639 INFO:tasks.ceph.osd.6.smithi188.stderr:2024-09-15T23:11:57.636+0000 7efe11a11640 -1 osd.6 0 log_to_monitors true 2024-09-15T23:11:57.646 INFO:tasks.ceph.osd.3.smithi123.stderr:2024-09-15T23:11:57.645+0000 7f1f3562a640 -1 osd.3 0 log_to_monitors true 2024-09-15T23:11:57.863 INFO:tasks.ceph.osd.7.smithi188.stderr:2024-09-15T23:11:57.862+0000 7f6b01a2e640 -1 osd.7 0 log_to_monitors true 2024-09-15T23:11:57.908 INFO:tasks.ceph.osd.1.smithi123.stderr:2024-09-15T23:11:57.906+0000 7f75812d8640 -1 osd.1 0 log_to_monitors true 2024-09-15T23:11:57.915 INFO:tasks.ceph.osd.2.smithi123.stderr:2024-09-15T23:11:57.913+0000 7f90ef814640 -1 osd.2 0 log_to_monitors true 2024-09-15T23:11:59.605 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-15T23:11:59.708 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.707+0000 7f9794166640 1 Processor -- start 2024-09-15T23:11:59.708 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.707+0000 7f9794166640 1 -- start start 2024-09-15T23:11:59.710 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.708+0000 7f9794166640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f978c0d1740 0x7f978c0d1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:59.710 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.708+0000 7f9794166640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f978c0d3cd0 0x7f978c160590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:59.710 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.708+0000 7f9794166640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f978c0d2060 con 0x7f978c0d3890 2024-09-15T23:11:59.710 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.708+0000 7f9794166640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f978c15fc60 con 0x7f978c0d1740 2024-09-15T23:11:59.710 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.708+0000 7f9794166640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f978c0d3400 con 0x7f978c0d3cd0 2024-09-15T23:11:59.710 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.708+0000 7f9791f02640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f978c0d1740 0x7f978c0d1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:59.710 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.708+0000 7f9791f02640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f978c0d1740 0x7f978c0d1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33450/0 (socket says 172.21.15.123:33450) 2024-09-15T23:11:59.710 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.708+0000 7f9791f02640 1 -- 172.21.15.123:0/48967065 learned_addr learned my addr 172.21.15.123:0/48967065 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:11:59.711 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.708+0000 7f9792703640 1 --2- 172.21.15.123:0/48967065 >> v2:172.21.15.188:3300/0 conn(0x7f978c0d3cd0 0x7f978c160590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:59.711 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.708+0000 7f9791f02640 1 -- 172.21.15.123:0/48967065 >> v2:172.21.15.188:3300/0 conn(0x7f978c0d3cd0 msgr2=0x7f978c160590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:11:59.711 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.708+0000 7f9791f02640 1 --2- 172.21.15.123:0/48967065 >> v2:172.21.15.188:3300/0 conn(0x7f978c0d3cd0 0x7f978c160590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:59.711 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.708+0000 7f9791f02640 1 -- 172.21.15.123:0/48967065 >> v1:172.21.15.188:6789/0 conn(0x7f978c0d3890 legacy=0x7f978c15fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:59.711 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.708+0000 7f9791f02640 1 -- 172.21.15.123:0/48967065 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f978c0d2ad0 con 0x7f978c0d1740 2024-09-15T23:11:59.711 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.709+0000 7f9791f02640 1 --2- 172.21.15.123:0/48967065 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f978c0d1740 0x7f978c0d1b20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f978c0b72a0 tx=0x7f978802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f88ff377834f79b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:59.711 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.709+0000 7f9790f00640 1 -- 172.21.15.123:0/48967065 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9788037070 con 0x7f978c0d1740 2024-09-15T23:11:59.711 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.709+0000 7f9790f00640 1 -- 172.21.15.123:0/48967065 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9788032440 con 0x7f978c0d1740 2024-09-15T23:11:59.711 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.709+0000 7f9790f00640 1 -- 172.21.15.123:0/48967065 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9788032810 con 0x7f978c0d1740 2024-09-15T23:11:59.712 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.710+0000 7f9794166640 1 -- 172.21.15.123:0/48967065 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f978c0d1740 msgr2=0x7f978c0d1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:59.712 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.710+0000 7f9794166640 1 --2- 172.21.15.123:0/48967065 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f978c0d1740 0x7f978c0d1b20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f978c0b72a0 tx=0x7f978802a1e0 comp rx=0 tx=0).stop 2024-09-15T23:11:59.712 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.710+0000 7f9794166640 1 -- 172.21.15.123:0/48967065 shutdown_connections 2024-09-15T23:11:59.713 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.710+0000 7f9794166640 1 --2- 172.21.15.123:0/48967065 >> v2:172.21.15.188:3300/0 conn(0x7f978c0d3cd0 0x7f978c160590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:59.713 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.710+0000 7f9794166640 1 --2- 172.21.15.123:0/48967065 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f978c0d1740 0x7f978c0d1b20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:59.713 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.710+0000 7f9794166640 1 -- 172.21.15.123:0/48967065 >> 172.21.15.123:0/48967065 conn(0x7f978c067cf0 msgr2=0x7f978c068100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:59.713 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.710+0000 7f9794166640 1 -- 172.21.15.123:0/48967065 shutdown_connections 2024-09-15T23:11:59.713 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.710+0000 7f9794166640 1 -- 172.21.15.123:0/48967065 wait complete. 2024-09-15T23:11:59.713 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.711+0000 7f9794166640 1 Processor -- start 2024-09-15T23:11:59.713 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.711+0000 7f9794166640 1 -- start start 2024-09-15T23:11:59.715 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.712+0000 7f9794166640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f978c0d1740 0x7f978c14cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:59.715 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.712+0000 7f9794166640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f978c0d3890 0x7f978c156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:59.715 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.712+0000 7f9791701640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f978c0d3890 0x7f978c156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:59.715 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.712+0000 7f9791701640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f978c0d3890 0x7f978c156630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33456/0 (socket says 172.21.15.123:33456) 2024-09-15T23:11:59.715 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.712+0000 7f9791701640 1 -- 172.21.15.123:0/2942518420 learned_addr learned my addr 172.21.15.123:0/2942518420 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:11:59.716 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.712+0000 7f9794166640 1 --2- 172.21.15.123:0/2942518420 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f978c0d3cd0 0x7f978c15d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:59.716 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.712+0000 7f9794166640 1 -- 172.21.15.123:0/2942518420 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f978c15e9c0 con 0x7f978c0d3890 2024-09-15T23:11:59.716 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.712+0000 7f9794166640 1 -- 172.21.15.123:0/2942518420 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f978c0d3090 con 0x7f978c0d3cd0 2024-09-15T23:11:59.716 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.712+0000 7f9794166640 1 -- 172.21.15.123:0/2942518420 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f978c15eb40 con 0x7f978c0d1740 2024-09-15T23:11:59.716 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.712+0000 7f9791f02640 1 --2- 172.21.15.123:0/2942518420 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f978c0d1740 0x7f978c14cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:59.716 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.712+0000 7f9792703640 1 --2- 172.21.15.123:0/2942518420 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f978c0d3cd0 0x7f978c15d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:59.716 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.712+0000 7f9791701640 1 -- 172.21.15.123:0/2942518420 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f978c0d1740 msgr2=0x7f978c14cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:59.716 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.712+0000 7f9791701640 1 --2- 172.21.15.123:0/2942518420 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f978c0d1740 0x7f978c14cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:59.716 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.712+0000 7f9791701640 1 -- 172.21.15.123:0/2942518420 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f978c0d3cd0 msgr2=0x7f978c15d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:59.716 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.712+0000 7f9791701640 1 --2- 172.21.15.123:0/2942518420 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f978c0d3cd0 0x7f978c15d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:59.716 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.712+0000 7f9791701640 1 -- 172.21.15.123:0/2942518420 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f978c157080 con 0x7f978c0d3890 2024-09-15T23:11:59.716 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.712+0000 7f9792703640 1 --2- 172.21.15.123:0/2942518420 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f978c0d3cd0 0x7f978c15d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:11:59.716 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.712+0000 7f9791701640 1 --2- 172.21.15.123:0/2942518420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f978c0d3890 0x7f978c156630 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f977c00c430 tx=0x7f977c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:59.717 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.713+0000 7f97827fc640 1 -- 172.21.15.123:0/2942518420 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977c0052d0 con 0x7f978c0d3890 2024-09-15T23:11:59.717 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.713+0000 7f97827fc640 1 -- 172.21.15.123:0/2942518420 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f977c005490 con 0x7f978c0d3890 2024-09-15T23:11:59.717 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.713+0000 7f9794166640 1 -- 172.21.15.123:0/2942518420 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f978c157360 con 0x7f978c0d3890 2024-09-15T23:11:59.717 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.713+0000 7f97827fc640 1 -- 172.21.15.123:0/2942518420 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977c007260 con 0x7f978c0d3890 2024-09-15T23:11:59.717 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.713+0000 7f9794166640 1 -- 172.21.15.123:0/2942518420 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f978c157920 con 0x7f978c0d3890 2024-09-15T23:11:59.717 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.714+0000 7f9794166640 1 -- 172.21.15.123:0/2942518420 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f978c0691c0 con 0x7f978c0d3890 2024-09-15T23:11:59.717 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.714+0000 7f97827fc640 1 -- 172.21.15.123:0/2942518420 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 4) ==== 90790+0+0 (secure 0 0 0) 0x7f977c007400 con 0x7f978c0d3890 2024-09-15T23:11:59.718 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.715+0000 7f97827fc640 1 --2- 172.21.15.123:0/2942518420 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f977006c220 0x7f977006e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:11:59.718 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.715+0000 7f97827fc640 1 -- 172.21.15.123:0/2942518420 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2231+0+0 (secure 0 0 0) 0x7f977c0899f0 con 0x7f978c0d3890 2024-09-15T23:11:59.718 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.715+0000 7f9791f02640 1 --2- 172.21.15.123:0/2942518420 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f977006c220 0x7f977006e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:11:59.718 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.716+0000 7f9791f02640 1 --2- 172.21.15.123:0/2942518420 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f977006c220 0x7f977006e6e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9788034000 tx=0x7f978802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:11:59.720 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.720+0000 7f97827fc640 1 -- 172.21.15.123:0/2942518420 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f977c058980 con 0x7f978c0d3890 2024-09-15T23:11:59.909 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.908+0000 7f9794166640 1 -- 172.21.15.123:0/2942518420 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f978c0cf3f0 con 0x7f978c0d3890 2024-09-15T23:11:59.910 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.909+0000 7f97827fc640 1 -- 172.21.15.123:0/2942518420 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7058 (secure 0 0 0) 0x7f977c05cc80 con 0x7f978c0d3890 2024-09-15T23:11:59.910 INFO:teuthology.misc.health.smithi123.stdout: 2024-09-15T23:11:59.910 INFO:teuthology.misc.health.smithi123.stdout:{"epoch":13,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:11:59.510077+0000","last_up_change":"0.000000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:11:59.912 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.910+0000 7f9794166640 1 -- 172.21.15.123:0/2942518420 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f977006c220 msgr2=0x7f977006e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:59.912 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.911+0000 7f9794166640 1 --2- 172.21.15.123:0/2942518420 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f977006c220 0x7f977006e6e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9788034000 tx=0x7f978802e000 comp rx=0 tx=0).stop 2024-09-15T23:11:59.912 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.911+0000 7f9794166640 1 -- 172.21.15.123:0/2942518420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f978c0d3890 msgr2=0x7f978c156630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:11:59.912 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.911+0000 7f9794166640 1 --2- 172.21.15.123:0/2942518420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f978c0d3890 0x7f978c156630 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f977c00c430 tx=0x7f977c00c8f0 comp rx=0 tx=0).stop 2024-09-15T23:11:59.912 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.911+0000 7f9794166640 1 -- 172.21.15.123:0/2942518420 shutdown_connections 2024-09-15T23:11:59.912 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.911+0000 7f9794166640 1 --2- 172.21.15.123:0/2942518420 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f978c0d3cd0 0x7f978c15d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:59.913 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.911+0000 7f9794166640 1 --2- 172.21.15.123:0/2942518420 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f977006c220 0x7f977006e6e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:59.913 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.911+0000 7f9794166640 1 --2- 172.21.15.123:0/2942518420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f978c0d3890 0x7f978c156630 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:59.913 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.911+0000 7f9794166640 1 --2- 172.21.15.123:0/2942518420 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f978c0d1740 0x7f978c14cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:11:59.913 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.911+0000 7f9794166640 1 -- 172.21.15.123:0/2942518420 >> 172.21.15.123:0/2942518420 conn(0x7f978c067cf0 msgr2=0x7f978c0cf6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:11:59.913 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.911+0000 7f9794166640 1 -- 172.21.15.123:0/2942518420 shutdown_connections 2024-09-15T23:11:59.913 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:11:59.911+0000 7f9794166640 1 -- 172.21.15.123:0/2942518420 wait complete. 2024-09-15T23:11:59.921 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-15T23:11:59.968 INFO:tasks.ceph.osd.4.smithi188.stderr:2024-09-15T23:11:59.967+0000 7f6d47768640 -1 osd.4 0 waiting for initial osdmap 2024-09-15T23:11:59.987 INFO:tasks.ceph.osd.4.smithi188.stderr:2024-09-15T23:11:59.986+0000 7f6d3ed63640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:12:00.132 INFO:tasks.ceph.osd.5.smithi188.stderr:2024-09-15T23:12:00.131+0000 7f8e62b43640 -1 osd.5 0 waiting for initial osdmap 2024-09-15T23:12:00.215 INFO:tasks.ceph.osd.5.smithi188.stderr:2024-09-15T23:12:00.214+0000 7f8e5b175640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:12:00.792 INFO:tasks.ceph.osd.7.smithi188.stderr:2024-09-15T23:12:00.791+0000 7f6afc817640 -1 osd.7 0 waiting for initial osdmap 2024-09-15T23:12:00.800 INFO:tasks.ceph.osd.7.smithi188.stderr:2024-09-15T23:12:00.800+0000 7f6af4e49640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:12:00.835 INFO:tasks.ceph.osd.6.smithi188.stderr:2024-09-15T23:12:00.834+0000 7efe0cbf9640 -1 osd.6 0 waiting for initial osdmap 2024-09-15T23:12:00.845 INFO:tasks.ceph.osd.6.smithi188.stderr:2024-09-15T23:12:00.844+0000 7efe0522b640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:12:02.526 INFO:tasks.ceph.osd.0.smithi123.stderr:2024-09-15T23:12:02.525+0000 7f9395040640 -1 osd.0 0 waiting for initial osdmap 2024-09-15T23:12:02.536 INFO:tasks.ceph.osd.3.smithi123.stderr:2024-09-15T23:12:02.535+0000 7f1f30d96640 -1 osd.3 0 waiting for initial osdmap 2024-09-15T23:12:02.537 INFO:tasks.ceph.osd.0.smithi123.stderr:2024-09-15T23:12:02.537+0000 7f938d672640 -1 osd.0 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:12:02.552 INFO:tasks.ceph.osd.3.smithi123.stderr:2024-09-15T23:12:02.551+0000 7f1f293c8640 -1 osd.3 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:12:02.557 INFO:tasks.ceph.osd.2.smithi123.stderr:2024-09-15T23:12:02.556+0000 7f90eb98e640 -1 osd.2 0 waiting for initial osdmap 2024-09-15T23:12:02.567 INFO:tasks.ceph.osd.2.smithi123.stderr:2024-09-15T23:12:02.567+0000 7f90e2f89640 -1 osd.2 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:12:02.583 INFO:tasks.ceph.osd.1.smithi123.stderr:2024-09-15T23:12:02.583+0000 7f757da7b640 -1 osd.1 0 waiting for initial osdmap 2024-09-15T23:12:02.597 INFO:tasks.ceph.osd.1.smithi123.stderr:2024-09-15T23:12:02.597+0000 7f7575076640 -1 osd.1 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:12:06.729 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-15T23:12:06.827 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.826+0000 7f47cdc47640 1 Processor -- start 2024-09-15T23:12:06.827 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.826+0000 7f47cdc47640 1 -- start start 2024-09-15T23:12:06.830 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.826+0000 7f47cdc47640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47c80d3890 0x7f47c815fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:06.831 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.826+0000 7f47cdc47640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f47c80d3cd0 0x7f47c81603c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:06.831 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.826+0000 7f47cdc47640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47c8160900 con 0x7f47c80d1740 2024-09-15T23:12:06.831 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.826+0000 7f47cdc47640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f47c815fc60 con 0x7f47c80d3cd0 2024-09-15T23:12:06.831 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.826+0000 7f47cdc47640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f47c80d3400 con 0x7f47c80d3890 2024-09-15T23:12:06.831 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.827+0000 7f47c77fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f47c80d1740 0x7f47c80d1b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:44706/0 (socket says 172.21.15.123:44706) 2024-09-15T23:12:06.831 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.827+0000 7f47c77fe640 1 -- 172.21.15.123:0/3011955186 learned_addr learned my addr 172.21.15.123:0/3011955186 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:06.831 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.827+0000 7f47c67fc640 1 -- 172.21.15.123:0/3011955186 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2115861991 0 0) 0x7f47c8160900 con 0x7f47c80d1740 2024-09-15T23:12:06.831 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.827+0000 7f47c67fc640 1 -- 172.21.15.123:0/3011955186 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47b4003520 con 0x7f47c80d1740 2024-09-15T23:12:06.831 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.827+0000 7f47c7fff640 1 --2- 172.21.15.123:0/3011955186 >> v2:172.21.15.188:3300/0 conn(0x7f47c80d3cd0 0x7f47c81603c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:06.831 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.827+0000 7f47c6ffd640 1 --2- 172.21.15.123:0/3011955186 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47c80d3890 0x7f47c815fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:06.831 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.827+0000 7f47c67fc640 1 -- 172.21.15.123:0/3011955186 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2362875830 0 0) 0x7f47b4003520 con 0x7f47c80d1740 2024-09-15T23:12:06.831 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.827+0000 7f47c67fc640 1 -- 172.21.15.123:0/3011955186 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47c80d3890 msgr2=0x7f47c815fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:06.832 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.827+0000 7f47c67fc640 1 --2- 172.21.15.123:0/3011955186 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47c80d3890 0x7f47c815fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:06.832 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.827+0000 7f47c67fc640 1 -- 172.21.15.123:0/3011955186 >> v2:172.21.15.188:3300/0 conn(0x7f47c80d3cd0 msgr2=0x7f47c81603c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:06.832 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.827+0000 7f47c67fc640 1 --2- 172.21.15.123:0/3011955186 >> v2:172.21.15.188:3300/0 conn(0x7f47c80d3cd0 0x7f47c81603c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:06.832 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.827+0000 7f47c67fc640 1 -- 172.21.15.123:0/3011955186 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c80d2ad0 con 0x7f47c80d1740 2024-09-15T23:12:06.832 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.827+0000 7f47c67fc640 1 -- 172.21.15.123:0/3011955186 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f47b80019f0 con 0x7f47c80d1740 2024-09-15T23:12:06.832 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.827+0000 7f47c67fc640 1 -- 172.21.15.123:0/3011955186 >> v1:172.21.15.123:6789/0 conn(0x7f47c80d1740 legacy=0x7f47c80d1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:06.832 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.827+0000 7f47c67fc640 1 --2- 172.21.15.123:0/3011955186 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47b40039b0 0x7f47b4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:06.832 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.827+0000 7f47c67fc640 1 --2- 172.21.15.123:0/3011955186 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47b4004800 0x7f47b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:06.832 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.827+0000 7f47c67fc640 1 --2- 172.21.15.123:0/3011955186 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47b40051c0 0x7f47b400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:06.832 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.827+0000 7f47c67fc640 1 -- 172.21.15.123:0/3011955186 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f47c815fc60 con 0x7f47b40051c0 2024-09-15T23:12:06.832 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.827+0000 7f47c67fc640 1 -- 172.21.15.123:0/3011955186 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f47c80d3400 con 0x7f47b40039b0 2024-09-15T23:12:06.832 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.827+0000 7f47c67fc640 1 -- 172.21.15.123:0/3011955186 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f47b400c090 con 0x7f47b4004800 2024-09-15T23:12:06.833 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.827+0000 7f47c6ffd640 1 --2- 172.21.15.123:0/3011955186 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47c80d3890 0x7f47c815fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:06.833 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.827+0000 7f47c7fff640 1 --2- 172.21.15.123:0/3011955186 >> v2:172.21.15.188:3300/0 conn(0x7f47c80d3cd0 0x7f47c81603c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:06.833 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.827+0000 7f47c7fff640 1 --2- 172.21.15.123:0/3011955186 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47b40051c0 0x7f47b400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:06.833 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.827+0000 7f47c77fe640 1 --2- 172.21.15.123:0/3011955186 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47b40039b0 0x7f47b4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:06.833 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.828+0000 7f47c6ffd640 1 --2- 172.21.15.123:0/3011955186 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47b4004800 0x7f47b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:06.833 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.828+0000 7f47c7fff640 1 -- 172.21.15.123:0/3011955186 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47b4004800 msgr2=0x7f47b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:06.833 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.828+0000 7f47c7fff640 1 --2- 172.21.15.123:0/3011955186 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47b4004800 0x7f47b4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:06.833 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.828+0000 7f47c7fff640 1 -- 172.21.15.123:0/3011955186 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47b40039b0 msgr2=0x7f47b4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:06.833 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.828+0000 7f47c7fff640 1 --2- 172.21.15.123:0/3011955186 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47b40039b0 0x7f47b4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:06.833 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.828+0000 7f47c7fff640 1 -- 172.21.15.123:0/3011955186 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b4003520 con 0x7f47b40051c0 2024-09-15T23:12:06.833 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.828+0000 7f47c7fff640 1 --2- 172.21.15.123:0/3011955186 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47b40051c0 0x7f47b400b9c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f47c80b64a0 tx=0x7f47b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1807d45b73ee8f40 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:06.833 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.829+0000 7f47c67fc640 1 -- 172.21.15.123:0/3011955186 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c0037070 con 0x7f47b40051c0 2024-09-15T23:12:06.833 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.829+0000 7f47c67fc640 1 -- 172.21.15.123:0/3011955186 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47c002ad00 con 0x7f47b40051c0 2024-09-15T23:12:06.834 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.829+0000 7f47c67fc640 1 -- 172.21.15.123:0/3011955186 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c000f040 con 0x7f47b40051c0 2024-09-15T23:12:06.834 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.829+0000 7f47cdc47640 1 -- 172.21.15.123:0/3011955186 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47b40051c0 msgr2=0x7f47b400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:06.834 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.829+0000 7f47cdc47640 1 --2- 172.21.15.123:0/3011955186 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47b40051c0 0x7f47b400b9c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f47c80b64a0 tx=0x7f47b4005830 comp rx=0 tx=0).stop 2024-09-15T23:12:06.834 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.829+0000 7f47c7fff640 1 -- 172.21.15.123:0/3011955186 reap_dead start 2024-09-15T23:12:06.834 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.829+0000 7f47cdc47640 1 -- 172.21.15.123:0/3011955186 shutdown_connections 2024-09-15T23:12:06.834 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.829+0000 7f47cdc47640 1 -- 172.21.15.123:0/3011955186 >> 172.21.15.123:0/3011955186 conn(0x7f47c8067cf0 msgr2=0x7f47c8068100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:06.834 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.829+0000 7f47cdc47640 1 -- 172.21.15.123:0/3011955186 shutdown_connections 2024-09-15T23:12:06.834 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.829+0000 7f47cdc47640 1 -- 172.21.15.123:0/3011955186 wait complete. 2024-09-15T23:12:06.837 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.830+0000 7f47cdc47640 1 Processor -- start 2024-09-15T23:12:06.837 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.831+0000 7f47cdc47640 1 -- start start 2024-09-15T23:12:06.837 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.831+0000 7f47cdc47640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47b40051c0 0x7f47c8157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:06.837 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.831+0000 7f47cdc47640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47c8148d60 0x7f47c80cda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:06.837 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.831+0000 7f47cdc47640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47c81491e0 0x7f47c80cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:06.837 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.831+0000 7f47cdc47640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f47c815e9c0 con 0x7f47c8148d60 2024-09-15T23:12:06.837 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.831+0000 7f47cdc47640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f47c80d3090 con 0x7f47c81491e0 2024-09-15T23:12:06.838 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.831+0000 7f47cdc47640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f47c815eb40 con 0x7f47b40051c0 2024-09-15T23:12:06.838 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.831+0000 7f47c6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47c8148d60 0x7f47c80cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:06.838 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.831+0000 7f47c6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47c8148d60 0x7f47c80cda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56146/0 (socket says 172.21.15.123:56146) 2024-09-15T23:12:06.838 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.831+0000 7f47c6ffd640 1 -- 172.21.15.123:0/3194844210 learned_addr learned my addr 172.21.15.123:0/3194844210 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:06.838 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.832+0000 7f47c7fff640 1 --2- 172.21.15.123:0/3194844210 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47c81491e0 0x7f47c80cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:06.838 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.832+0000 7f47c77fe640 1 --2- 172.21.15.123:0/3194844210 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47b40051c0 0x7f47c8157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:06.838 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.832+0000 7f47c6ffd640 1 -- 172.21.15.123:0/3194844210 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47b40051c0 msgr2=0x7f47c8157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:06.838 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.832+0000 7f47c6ffd640 1 --2- 172.21.15.123:0/3194844210 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47b40051c0 0x7f47c8157d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:06.838 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.832+0000 7f47c6ffd640 1 -- 172.21.15.123:0/3194844210 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47c81491e0 msgr2=0x7f47c80cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:06.838 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.832+0000 7f47c6ffd640 1 --2- 172.21.15.123:0/3194844210 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47c81491e0 0x7f47c80cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:06.838 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.832+0000 7f47c6ffd640 1 -- 172.21.15.123:0/3194844210 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c814bb40 con 0x7f47c8148d60 2024-09-15T23:12:06.838 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.832+0000 7f47c7fff640 1 --2- 172.21.15.123:0/3194844210 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47c81491e0 0x7f47c80cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:06.838 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.832+0000 7f47c6ffd640 1 --2- 172.21.15.123:0/3194844210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47c8148d60 0x7f47c80cda50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f47b00115a0 tx=0x7f47b0011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:06.839 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.832+0000 7f47bffff640 1 -- 172.21.15.123:0/3194844210 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b0019070 con 0x7f47c8148d60 2024-09-15T23:12:06.839 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.832+0000 7f47bffff640 1 -- 172.21.15.123:0/3194844210 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b0015930 con 0x7f47c8148d60 2024-09-15T23:12:06.839 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.832+0000 7f47cdc47640 1 -- 172.21.15.123:0/3194844210 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47c80c9ee0 con 0x7f47c8148d60 2024-09-15T23:12:06.839 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.832+0000 7f47bffff640 1 -- 172.21.15.123:0/3194844210 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b000f040 con 0x7f47c8148d60 2024-09-15T23:12:06.839 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.832+0000 7f47cdc47640 1 -- 172.21.15.123:0/3194844210 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47c80ca4a0 con 0x7f47c8148d60 2024-09-15T23:12:06.839 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.833+0000 7f47cdc47640 1 -- 172.21.15.123:0/3194844210 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47c80691c0 con 0x7f47c8148d60 2024-09-15T23:12:06.839 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.834+0000 7f47bffff640 1 -- 172.21.15.123:0/3194844210 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f47b001c070 con 0x7f47c8148d60 2024-09-15T23:12:06.839 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.834+0000 7f47bffff640 1 --2- 172.21.15.123:0/3194844210 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f47a806c2b0 0x7f47a806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:06.839 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.834+0000 7f47bffff640 1 -- 172.21.15.123:0/3194844210 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f47b008b2c0 con 0x7f47c8148d60 2024-09-15T23:12:06.839 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.834+0000 7f47c77fe640 1 --2- 172.21.15.123:0/3194844210 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f47a806c2b0 0x7f47a806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:06.839 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.835+0000 7f47c77fe640 1 --2- 172.21.15.123:0/3194844210 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f47a806c2b0 0x7f47a806e770 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f47b8004d00 tx=0x7f47b8006040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:06.840 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:06.839+0000 7f47bffff640 1 -- 172.21.15.123:0/3194844210 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f47b0059d80 con 0x7f47c8148d60 2024-09-15T23:12:07.006 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:07.005+0000 7f47cdc47640 1 -- 172.21.15.123:0/3194844210 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f47c80d1b20 con 0x7f47c8148d60 2024-09-15T23:12:07.007 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:07.006+0000 7f47bffff640 1 -- 172.21.15.123:0/3194844210 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12920 (secure 0 0 0) 0x7f47b008b0e0 con 0x7f47c8148d60 2024-09-15T23:12:07.007 INFO:teuthology.misc.health.smithi123.stdout: 2024-09-15T23:12:07.008 INFO:teuthology.misc.health.smithi123.stdout:{"epoch":18,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:12:04.992310+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:12:07.009 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:07.008+0000 7f47cdc47640 1 -- 172.21.15.123:0/3194844210 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f47a806c2b0 msgr2=0x7f47a806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:07.009 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:07.008+0000 7f47cdc47640 1 --2- 172.21.15.123:0/3194844210 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f47a806c2b0 0x7f47a806e770 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f47b8004d00 tx=0x7f47b8006040 comp rx=0 tx=0).stop 2024-09-15T23:12:07.010 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:07.008+0000 7f47cdc47640 1 -- 172.21.15.123:0/3194844210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47c8148d60 msgr2=0x7f47c80cda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:07.010 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:07.008+0000 7f47cdc47640 1 --2- 172.21.15.123:0/3194844210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47c8148d60 0x7f47c80cda50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f47b00115a0 tx=0x7f47b0011a60 comp rx=0 tx=0).stop 2024-09-15T23:12:07.010 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:07.008+0000 7f47cdc47640 1 -- 172.21.15.123:0/3194844210 shutdown_connections 2024-09-15T23:12:07.010 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:07.008+0000 7f47cdc47640 1 --2- 172.21.15.123:0/3194844210 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47c81491e0 0x7f47c80cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:07.010 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:07.008+0000 7f47cdc47640 1 --2- 172.21.15.123:0/3194844210 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f47a806c2b0 0x7f47a806e770 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:07.010 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:07.008+0000 7f47cdc47640 1 --2- 172.21.15.123:0/3194844210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47c8148d60 0x7f47c80cda50 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:07.010 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:07.008+0000 7f47cdc47640 1 --2- 172.21.15.123:0/3194844210 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47b40051c0 0x7f47c8157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:07.010 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:07.008+0000 7f47cdc47640 1 -- 172.21.15.123:0/3194844210 >> 172.21.15.123:0/3194844210 conn(0x7f47c8067cf0 msgr2=0x7f47c806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:07.010 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:07.008+0000 7f47cdc47640 1 -- 172.21.15.123:0/3194844210 shutdown_connections 2024-09-15T23:12:07.010 INFO:teuthology.misc.health.smithi123.stderr:2024-09-15T23:12:07.008+0000 7f47cdc47640 1 -- 172.21.15.123:0/3194844210 wait complete. 2024-09-15T23:12:07.019 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-15T23:12:07.019 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-15T23:12:07.020 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T23:12:07.020 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T23:12:07.022 INFO:tasks.ceph.mds.a:Started 2024-09-15T23:12:07.023 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T23:12:07.023 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T23:12:07.025 INFO:tasks.ceph.mds.c:Started 2024-09-15T23:12:07.025 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T23:12:07.025 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T23:12:07.027 INFO:tasks.ceph.mds.b:Started 2024-09-15T23:12:07.028 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T23:12:07.028 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T23:12:07.030 INFO:tasks.ceph.mds.d:Started 2024-09-15T23:12:07.031 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-15T23:12:07.031 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:12:07.061 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:12:07.076 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:12:07.098 INFO:tasks.ceph.mds.a.smithi123.stdout:starting mds.a at 2024-09-15T23:12:07.098 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-15T23:12:07.114 INFO:tasks.ceph.mds.b.smithi188.stdout:starting mds.b at 2024-09-15T23:12:07.114 INFO:tasks.ceph.mds.d.smithi188.stdout:starting mds.d at 2024-09-15T23:12:07.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.135+0000 7f7feec47640 1 Processor -- start 2024-09-15T23:12:07.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.135+0000 7f7feec47640 1 -- start start 2024-09-15T23:12:07.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.136+0000 7f7feec47640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7fe8161c10 0x7f7fe80b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:07.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.136+0000 7f7feec47640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fe80b6680 con 0x7f7fe8072ce0 2024-09-15T23:12:07.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.136+0000 7f7feec47640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fe80b6960 con 0x7f7fe80b5f10 2024-09-15T23:12:07.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.136+0000 7f7feec47640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7fe8161ff0 con 0x7f7fe8161c10 2024-09-15T23:12:07.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.136+0000 7f7fed1e4640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7fe8072ce0 0x7f7fe806edc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:44710/0 (socket says 172.21.15.123:44710) 2024-09-15T23:12:07.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.136+0000 7f7fed1e4640 1 -- 172.21.15.123:0/4287963303 learned_addr learned my addr 172.21.15.123:0/4287963303 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:07.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.136+0000 7f7fec9e3640 1 --2- 172.21.15.123:0/4287963303 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7fe8161c10 0x7f7fe80b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:07.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.136+0000 7f7fe77fe640 1 -- 172.21.15.123:0/4287963303 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1855259328 0 0) 0x7f7fe80b6680 con 0x7f7fe8072ce0 2024-09-15T23:12:07.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.136+0000 7f7fe77fe640 1 -- 172.21.15.123:0/4287963303 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fd8003520 con 0x7f7fe8072ce0 2024-09-15T23:12:07.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.137+0000 7f7fe77fe640 1 -- 172.21.15.123:0/4287963303 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 646071600 0 0) 0x7f7fe80b6960 con 0x7f7fe80b5f10 2024-09-15T23:12:07.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.137+0000 7f7fe77fe640 1 -- 172.21.15.123:0/4287963303 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fe80b6680 con 0x7f7fe80b5f10 2024-09-15T23:12:07.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.137+0000 7f7fec9e3640 1 -- 172.21.15.123:0/4287963303 >> v1:172.21.15.188:6789/0 conn(0x7f7fe80b5f10 legacy=0x7f7fe80725d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:07.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.137+0000 7f7fec9e3640 1 -- 172.21.15.123:0/4287963303 >> v1:172.21.15.123:6789/0 conn(0x7f7fe8072ce0 legacy=0x7f7fe806edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:07.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.137+0000 7f7fec9e3640 1 -- 172.21.15.123:0/4287963303 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe80b6c40 con 0x7f7fe8161c10 2024-09-15T23:12:07.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.137+0000 7f7fec9e3640 1 --2- 172.21.15.123:0/4287963303 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7fe8161c10 0x7f7fe80b00e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc0097d0 tx=0x7f7fdc02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c42a6a0ce88a66d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:07.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.138+0000 7f7fe77fe640 1 -- 172.21.15.123:0/4287963303 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc037070 con 0x7f7fe8161c10 2024-09-15T23:12:07.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.138+0000 7f7fe77fe640 1 -- 172.21.15.123:0/4287963303 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fdc032440 con 0x7f7fe8161c10 2024-09-15T23:12:07.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.138+0000 7f7fe77fe640 1 -- 172.21.15.123:0/4287963303 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc0327f0 con 0x7f7fe8161c10 2024-09-15T23:12:07.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.138+0000 7f7feec47640 1 -- 172.21.15.123:0/4287963303 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7fe8161c10 msgr2=0x7f7fe80b00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:07.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.138+0000 7f7feec47640 1 --2- 172.21.15.123:0/4287963303 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7fe8161c10 0x7f7fe80b00e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc0097d0 tx=0x7f7fdc02a210 comp rx=0 tx=0).stop 2024-09-15T23:12:07.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.138+0000 7f7feec47640 1 -- 172.21.15.123:0/4287963303 shutdown_connections 2024-09-15T23:12:07.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.138+0000 7f7feec47640 1 --2- 172.21.15.123:0/4287963303 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7fe8161c10 0x7f7fe80b00e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:07.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.138+0000 7f7feec47640 1 -- 172.21.15.123:0/4287963303 >> 172.21.15.123:0/4287963303 conn(0x7f7fe806d140 msgr2=0x7f7fe806d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:07.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.138+0000 7f7feec47640 1 -- 172.21.15.123:0/4287963303 shutdown_connections 2024-09-15T23:12:07.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.138+0000 7f7feec47640 1 -- 172.21.15.123:0/4287963303 wait complete. 2024-09-15T23:12:07.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.139+0000 7f7feec47640 1 Processor -- start 2024-09-15T23:12:07.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.139+0000 7f7feec47640 1 -- start start 2024-09-15T23:12:07.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.140+0000 7f7feec47640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7fe8072ce0 0x7f7fe80cf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:07.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.140+0000 7f7feec47640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7fe80b5f10 0x7f7fe814cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:07.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.140+0000 7f7feec47640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fe8161c10 0x7f7fe814ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:07.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.140+0000 7f7feec47640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe806e4c0 con 0x7f7fe8161c10 2024-09-15T23:12:07.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.140+0000 7f7feec47640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe80b6350 con 0x7f7fe8072ce0 2024-09-15T23:12:07.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.140+0000 7f7feec47640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7fe806e640 con 0x7f7fe80b5f10 2024-09-15T23:12:07.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.140+0000 7f7fed1e4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fe8161c10 0x7f7fe814ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:07.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.140+0000 7f7fed1e4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fe8161c10 0x7f7fe814ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56188/0 (socket says 172.21.15.123:56188) 2024-09-15T23:12:07.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.140+0000 7f7fed1e4640 1 -- 172.21.15.123:0/1792196725 learned_addr learned my addr 172.21.15.123:0/1792196725 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:07.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.140+0000 7f7fec9e3640 1 --2- 172.21.15.123:0/1792196725 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7fe8072ce0 0x7f7fe80cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:07.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.140+0000 7f7fe7fff640 1 --2- 172.21.15.123:0/1792196725 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7fe80b5f10 0x7f7fe814cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:07.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.140+0000 7f7fed1e4640 1 -- 172.21.15.123:0/1792196725 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7fe80b5f10 msgr2=0x7f7fe814cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:07.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.140+0000 7f7fed1e4640 1 --2- 172.21.15.123:0/1792196725 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7fe80b5f10 0x7f7fe814cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:07.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.141+0000 7f7fed1e4640 1 -- 172.21.15.123:0/1792196725 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7fe8072ce0 msgr2=0x7f7fe80cf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:07.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.141+0000 7f7fed1e4640 1 --2- 172.21.15.123:0/1792196725 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7fe8072ce0 0x7f7fe80cf430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:07.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.141+0000 7f7fed1e4640 1 -- 172.21.15.123:0/1792196725 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe8150450 con 0x7f7fe8161c10 2024-09-15T23:12:07.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.141+0000 7f7fed1e4640 1 --2- 172.21.15.123:0/1792196725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fe8161c10 0x7f7fe814ff10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7fe000cb90 tx=0x7f7fe000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:07.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.141+0000 7f7fe57fa640 1 -- 172.21.15.123:0/1792196725 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe0017070 con 0x7f7fe8161c10 2024-09-15T23:12:07.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.141+0000 7f7fe57fa640 1 -- 172.21.15.123:0/1792196725 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fe000ace0 con 0x7f7fe8161c10 2024-09-15T23:12:07.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.141+0000 7f7feec47640 1 -- 172.21.15.123:0/1792196725 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fe80cfa30 con 0x7f7fe8161c10 2024-09-15T23:12:07.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.141+0000 7f7fe57fa640 1 -- 172.21.15.123:0/1792196725 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe0012600 con 0x7f7fe8161c10 2024-09-15T23:12:07.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.141+0000 7f7feec47640 1 -- 172.21.15.123:0/1792196725 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fe80cfff0 con 0x7f7fe8161c10 2024-09-15T23:12:07.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.142+0000 7f7feec47640 1 -- 172.21.15.123:0/1792196725 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fe80b00e0 con 0x7f7fe8161c10 2024-09-15T23:12:07.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.142+0000 7f7fe57fa640 1 -- 172.21.15.123:0/1792196725 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7fe001a070 con 0x7f7fe8161c10 2024-09-15T23:12:07.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.143+0000 7f7fe57fa640 1 --2- 172.21.15.123:0/1792196725 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7fcc06c2b0 0x7f7fcc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:07.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.143+0000 7f7fe57fa640 1 -- 172.21.15.123:0/1792196725 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f7fe008ade0 con 0x7f7fe8161c10 2024-09-15T23:12:07.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.143+0000 7f7fec9e3640 1 --2- 172.21.15.123:0/1792196725 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7fcc06c2b0 0x7f7fcc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:07.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.143+0000 7f7fec9e3640 1 --2- 172.21.15.123:0/1792196725 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7fcc06c2b0 0x7f7fcc06e770 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc034000 tx=0x7f7fdc02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:07.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.147+0000 7f7fe57fa640 1 -- 172.21.15.123:0/1792196725 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7fe0059260 con 0x7f7fe8161c10 2024-09-15T23:12:07.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.349+0000 7f7feec47640 1 -- 172.21.15.123:0/1792196725 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7fe8072aa0 con 0x7f7fe8161c10 2024-09-15T23:12:07.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.350+0000 7f7fe57fa640 1 -- 172.21.15.123:0/1792196725 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1437 (secure 0 0 0) 0x7f7fe005d560 con 0x7f7fe8161c10 2024-09-15T23:12:07.351 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:07.351 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":2,"btime":"2024-09-15T23:12:07:102731+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3721978283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":3721978283},{"type":"v1","addr":"172.21.15.123:6835","nonce":3721978283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-15T23:12:07.351 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 2 2024-09-15T23:12:07.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.352+0000 7f7feec47640 1 -- 172.21.15.123:0/1792196725 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7fcc06c2b0 msgr2=0x7f7fcc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:07.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.352+0000 7f7feec47640 1 --2- 172.21.15.123:0/1792196725 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7fcc06c2b0 0x7f7fcc06e770 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc034000 tx=0x7f7fdc02e000 comp rx=0 tx=0).stop 2024-09-15T23:12:07.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.352+0000 7f7feec47640 1 -- 172.21.15.123:0/1792196725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fe8161c10 msgr2=0x7f7fe814ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:07.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.352+0000 7f7feec47640 1 --2- 172.21.15.123:0/1792196725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fe8161c10 0x7f7fe814ff10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7fe000cb90 tx=0x7f7fe000a430 comp rx=0 tx=0).stop 2024-09-15T23:12:07.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.352+0000 7f7feec47640 1 -- 172.21.15.123:0/1792196725 shutdown_connections 2024-09-15T23:12:07.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.352+0000 7f7feec47640 1 --2- 172.21.15.123:0/1792196725 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7fcc06c2b0 0x7f7fcc06e770 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:07.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.352+0000 7f7feec47640 1 --2- 172.21.15.123:0/1792196725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fe8161c10 0x7f7fe814ff10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:07.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.352+0000 7f7feec47640 1 --2- 172.21.15.123:0/1792196725 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7fe80b5f10 0x7f7fe814cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:07.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.352+0000 7f7feec47640 1 --2- 172.21.15.123:0/1792196725 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7fe8072ce0 0x7f7fe80cf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:07.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.352+0000 7f7feec47640 1 -- 172.21.15.123:0/1792196725 >> 172.21.15.123:0/1792196725 conn(0x7f7fe806d140 msgr2=0x7f7fe80b3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:07.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.352+0000 7f7feec47640 1 -- 172.21.15.123:0/1792196725 shutdown_connections 2024-09-15T23:12:07.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:07.352+0000 7f7feec47640 1 -- 172.21.15.123:0/1792196725 wait complete. 2024-09-15T23:12:09.364 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:12:09.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.476+0000 7ff55b903640 1 Processor -- start 2024-09-15T23:12:09.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.477+0000 7ff55b903640 1 -- start start 2024-09-15T23:12:09.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.478+0000 7ff55b903640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff5540b4ab0 0x7ff5540b5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:09.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.478+0000 7ff55b903640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5540b5770 con 0x7ff554148420 2024-09-15T23:12:09.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.478+0000 7ff55b903640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5540b5a50 con 0x7ff55406c320 2024-09-15T23:12:09.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.478+0000 7ff55b903640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7ff5540b1070 con 0x7ff5540b4ab0 2024-09-15T23:12:09.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.478+0000 7ff559ea0640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff5540b4ab0 0x7ff5540b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:09.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.478+0000 7ff559ea0640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff5540b4ab0 0x7ff5540b5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56202/0 (socket says 172.21.15.123:56202) 2024-09-15T23:12:09.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.478+0000 7ff559ea0640 1 -- 172.21.15.123:0/2277798159 learned_addr learned my addr 172.21.15.123:0/2277798159 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:09.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.478+0000 7ff55969f640 1 --1- 172.21.15.123:0/2277798159 >> v1:172.21.15.123:6789/0 conn(0x7ff554148420 0x7ff55406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:44716/0 (socket says 172.21.15.123:44716) 2024-09-15T23:12:09.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.478+0000 7ff559ea0640 1 -- 172.21.15.123:0/2277798159 >> v1:172.21.15.188:6789/0 conn(0x7ff55406c320 legacy=0x7ff5540b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:09.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.478+0000 7ff559ea0640 1 -- 172.21.15.123:0/2277798159 >> v1:172.21.15.123:6789/0 conn(0x7ff554148420 legacy=0x7ff55406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:09.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.478+0000 7ff559ea0640 1 -- 172.21.15.123:0/2277798159 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5540b5d30 con 0x7ff5540b4ab0 2024-09-15T23:12:09.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.479+0000 7ff559ea0640 1 --2- 172.21.15.123:0/2277798159 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5540b4ab0 0x7ff5540b5100 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff54c009e50 tx=0x7ff54c02a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5311b6aa139b343 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:09.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.479+0000 7ff54bfff640 1 -- 172.21.15.123:0/2277798159 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff54c036070 con 0x7ff5540b4ab0 2024-09-15T23:12:09.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.479+0000 7ff54bfff640 1 -- 172.21.15.123:0/2277798159 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff54c031600 con 0x7ff5540b4ab0 2024-09-15T23:12:09.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.479+0000 7ff54bfff640 1 -- 172.21.15.123:0/2277798159 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff54c0319d0 con 0x7ff5540b4ab0 2024-09-15T23:12:09.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.479+0000 7ff55b903640 1 -- 172.21.15.123:0/2277798159 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5540b4ab0 msgr2=0x7ff5540b5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:09.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.479+0000 7ff55b903640 1 --2- 172.21.15.123:0/2277798159 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5540b4ab0 0x7ff5540b5100 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff54c009e50 tx=0x7ff54c02a6d0 comp rx=0 tx=0).stop 2024-09-15T23:12:09.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.479+0000 7ff55b903640 1 -- 172.21.15.123:0/2277798159 shutdown_connections 2024-09-15T23:12:09.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.479+0000 7ff55b903640 1 --2- 172.21.15.123:0/2277798159 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5540b4ab0 0x7ff5540b5100 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:09.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.480+0000 7ff55b903640 1 -- 172.21.15.123:0/2277798159 >> 172.21.15.123:0/2277798159 conn(0x7ff55406cd20 msgr2=0x7ff55406d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:09.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.480+0000 7ff55b903640 1 -- 172.21.15.123:0/2277798159 shutdown_connections 2024-09-15T23:12:09.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.480+0000 7ff55b903640 1 -- 172.21.15.123:0/2277798159 wait complete. 2024-09-15T23:12:09.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.481+0000 7ff55b903640 1 Processor -- start 2024-09-15T23:12:09.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.481+0000 7ff55b903640 1 -- start start 2024-09-15T23:12:09.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.481+0000 7ff55b903640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff55406c320 0x7ff5540aed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:09.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.482+0000 7ff55b903640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5540b4ab0 0x7ff5541f7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:09.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.482+0000 7ff55b903640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff554148420 0x7ff5541f8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:09.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.482+0000 7ff55b903640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff5540b13e0 con 0x7ff5540b4ab0 2024-09-15T23:12:09.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.482+0000 7ff55b903640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff5540b4ee0 con 0x7ff55406c320 2024-09-15T23:12:09.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.482+0000 7ff55b903640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ff5540b1f80 con 0x7ff554148420 2024-09-15T23:12:09.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.482+0000 7ff558e9e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5540b4ab0 0x7ff5541f7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:09.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.482+0000 7ff558e9e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5540b4ab0 0x7ff5541f7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56208/0 (socket says 172.21.15.123:56208) 2024-09-15T23:12:09.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.482+0000 7ff558e9e640 1 -- 172.21.15.123:0/628818849 learned_addr learned my addr 172.21.15.123:0/628818849 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:09.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.482+0000 7ff55969f640 1 --2- 172.21.15.123:0/628818849 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff55406c320 0x7ff5540aed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:09.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.482+0000 7ff559ea0640 1 --2- 172.21.15.123:0/628818849 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff554148420 0x7ff5541f8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:09.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.482+0000 7ff558e9e640 1 -- 172.21.15.123:0/628818849 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff554148420 msgr2=0x7ff5541f8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:09.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.482+0000 7ff558e9e640 1 --2- 172.21.15.123:0/628818849 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff554148420 0x7ff5541f8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:09.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.482+0000 7ff558e9e640 1 -- 172.21.15.123:0/628818849 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff55406c320 msgr2=0x7ff5540aed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:09.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.482+0000 7ff558e9e640 1 --2- 172.21.15.123:0/628818849 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff55406c320 0x7ff5540aed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:09.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.482+0000 7ff558e9e640 1 -- 172.21.15.123:0/628818849 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5541f88a0 con 0x7ff5540b4ab0 2024-09-15T23:12:09.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.482+0000 7ff55969f640 1 --2- 172.21.15.123:0/628818849 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff55406c320 0x7ff5540aed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:09.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.482+0000 7ff558e9e640 1 --2- 172.21.15.123:0/628818849 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5540b4ab0 0x7ff5541f7d50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff54400c430 tx=0x7ff54400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:09.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.482+0000 7ff549ffb640 1 -- 172.21.15.123:0/628818849 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff544011790 con 0x7ff5540b4ab0 2024-09-15T23:12:09.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.482+0000 7ff549ffb640 1 -- 172.21.15.123:0/628818849 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff544017070 con 0x7ff5540b4ab0 2024-09-15T23:12:09.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.482+0000 7ff55b903640 1 -- 172.21.15.123:0/628818849 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5541f8b80 con 0x7ff5540b4ab0 2024-09-15T23:12:09.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.482+0000 7ff549ffb640 1 -- 172.21.15.123:0/628818849 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff544011bb0 con 0x7ff5540b4ab0 2024-09-15T23:12:09.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.483+0000 7ff55b903640 1 -- 172.21.15.123:0/628818849 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5541e7400 con 0x7ff5540b4ab0 2024-09-15T23:12:09.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.483+0000 7ff55b903640 1 -- 172.21.15.123:0/628818849 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5540b5100 con 0x7ff5540b4ab0 2024-09-15T23:12:09.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.484+0000 7ff549ffb640 1 -- 172.21.15.123:0/628818849 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff54401c460 con 0x7ff5540b4ab0 2024-09-15T23:12:09.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.484+0000 7ff549ffb640 1 --2- 172.21.15.123:0/628818849 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff53806c2b0 0x7ff53806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:09.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.485+0000 7ff549ffb640 1 -- 172.21.15.123:0/628818849 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7ff54408af30 con 0x7ff5540b4ab0 2024-09-15T23:12:09.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.485+0000 7ff55969f640 1 --2- 172.21.15.123:0/628818849 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff53806c2b0 0x7ff53806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:09.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.485+0000 7ff55969f640 1 --2- 172.21.15.123:0/628818849 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff53806c2b0 0x7ff53806e770 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff550007fd0 tx=0x7ff550007d60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:09.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.489+0000 7ff549ffb640 1 -- 172.21.15.123:0/628818849 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff5440599f0 con 0x7ff5540b4ab0 2024-09-15T23:12:09.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.689+0000 7ff55b903640 1 -- 172.21.15.123:0/628818849 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff5540b0e30 con 0x7ff5540b4ab0 2024-09-15T23:12:09.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.689+0000 7ff549ffb640 1 -- 172.21.15.123:0/628818849 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3915 (secure 0 0 0) 0x7ff5440592f0 con 0x7ff5540b4ab0 2024-09-15T23:12:09.691 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:09.691 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":3,"btime":"2024-09-15T23:12:08:103725+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2663395388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2663395388},{"type":"v1","addr":"172.21.15.188:6837","nonce":2663395388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2375280105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2375280105},{"type":"v1","addr":"172.21.15.188:6836","nonce":2375280105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/477765723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":477765723},{"type":"v1","addr":"172.21.15.123:6834","nonce":477765723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3721978283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":3721978283},{"type":"v1","addr":"172.21.15.123:6835","nonce":3721978283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-15T23:12:09.691 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 3 2024-09-15T23:12:09.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.691+0000 7ff55b903640 1 -- 172.21.15.123:0/628818849 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff53806c2b0 msgr2=0x7ff53806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:09.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.691+0000 7ff55b903640 1 --2- 172.21.15.123:0/628818849 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff53806c2b0 0x7ff53806e770 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff550007fd0 tx=0x7ff550007d60 comp rx=0 tx=0).stop 2024-09-15T23:12:09.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.691+0000 7ff55b903640 1 -- 172.21.15.123:0/628818849 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5540b4ab0 msgr2=0x7ff5541f7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:09.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.691+0000 7ff55b903640 1 --2- 172.21.15.123:0/628818849 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5540b4ab0 0x7ff5541f7d50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff54400c430 tx=0x7ff54400c8f0 comp rx=0 tx=0).stop 2024-09-15T23:12:09.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.691+0000 7ff55b903640 1 -- 172.21.15.123:0/628818849 shutdown_connections 2024-09-15T23:12:09.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.691+0000 7ff55b903640 1 --2- 172.21.15.123:0/628818849 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff554148420 0x7ff5541f8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:09.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.691+0000 7ff55b903640 1 --2- 172.21.15.123:0/628818849 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff53806c2b0 0x7ff53806e770 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:09.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.691+0000 7ff55b903640 1 --2- 172.21.15.123:0/628818849 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5540b4ab0 0x7ff5541f7d50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:09.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.691+0000 7ff55b903640 1 --2- 172.21.15.123:0/628818849 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff55406c320 0x7ff5540aed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:09.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.691+0000 7ff55b903640 1 -- 172.21.15.123:0/628818849 >> 172.21.15.123:0/628818849 conn(0x7ff55406cd20 msgr2=0x7ff55406de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:09.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.691+0000 7ff55b903640 1 -- 172.21.15.123:0/628818849 shutdown_connections 2024-09-15T23:12:09.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.691+0000 7ff55b903640 1 -- 172.21.15.123:0/628818849 wait complete. 2024-09-15T23:12:09.703 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T23:12:09.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.799+0000 7f64a2749640 1 Processor -- start 2024-09-15T23:12:09.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.799+0000 7f64a2749640 1 -- start start 2024-09-15T23:12:09.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.800+0000 7f64a2749640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f649c06cd20 0x7f649c0b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:09.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.800+0000 7f64a2749640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f649c070b80 0x7f649c0b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:09.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.800+0000 7f64a2749640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f649c15eab0 con 0x7f649c15e6d0 2024-09-15T23:12:09.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.800+0000 7f64a2749640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f649c0b77e0 con 0x7f649c06cd20 2024-09-15T23:12:09.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.800+0000 7f64a2749640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f649c15ed70 con 0x7f649c070b80 2024-09-15T23:12:09.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.800+0000 7f649bfff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f649c15e6d0 0x7f649c071390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:44728/0 (socket says 172.21.15.123:44728) 2024-09-15T23:12:09.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.800+0000 7f649bfff640 1 -- 172.21.15.123:0/4116062294 learned_addr learned my addr 172.21.15.123:0/4116062294 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:09.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.800+0000 7f649b7fe640 1 --2- 172.21.15.123:0/4116062294 >> v2:172.21.15.188:3300/0 conn(0x7f649c06cd20 0x7f649c0b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:09.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.800+0000 7f64a0ce6640 1 --2- 172.21.15.123:0/4116062294 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f649c070b80 0x7f649c0b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:09.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.800+0000 7f649affd640 1 -- 172.21.15.123:0/4116062294 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1635449069 0 0) 0x7f649c15eab0 con 0x7f649c15e6d0 2024-09-15T23:12:09.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.800+0000 7f649affd640 1 -- 172.21.15.123:0/4116062294 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6484003520 con 0x7f649c15e6d0 2024-09-15T23:12:09.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.800+0000 7f649affd640 1 -- 172.21.15.123:0/4116062294 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3586012437 0 0) 0x7f6484003520 con 0x7f649c15e6d0 2024-09-15T23:12:09.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.800+0000 7f649affd640 1 -- 172.21.15.123:0/4116062294 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f649c070b80 msgr2=0x7f649c0b72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:09.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.800+0000 7f649affd640 1 --2- 172.21.15.123:0/4116062294 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f649c070b80 0x7f649c0b72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:09.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.800+0000 7f649affd640 1 -- 172.21.15.123:0/4116062294 >> v2:172.21.15.188:3300/0 conn(0x7f649c06cd20 msgr2=0x7f649c0b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:09.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.800+0000 7f649affd640 1 --2- 172.21.15.123:0/4116062294 >> v2:172.21.15.188:3300/0 conn(0x7f649c06cd20 0x7f649c0b6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:09.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.800+0000 7f649affd640 1 -- 172.21.15.123:0/4116062294 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f649c15f050 con 0x7f649c15e6d0 2024-09-15T23:12:09.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.800+0000 7f649affd640 1 -- 172.21.15.123:0/4116062294 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f648c001670 con 0x7f649c15e6d0 2024-09-15T23:12:09.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.800+0000 7f649affd640 1 -- 172.21.15.123:0/4116062294 >> v1:172.21.15.123:6789/0 conn(0x7f649c15e6d0 legacy=0x7f649c071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:09.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.800+0000 7f649affd640 1 --2- 172.21.15.123:0/4116062294 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f64840039b0 0x7f6484003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:09.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.800+0000 7f649affd640 1 --2- 172.21.15.123:0/4116062294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64840043a0 0x7f6484004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:09.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.800+0000 7f649affd640 1 --2- 172.21.15.123:0/4116062294 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6484004ef0 0x7f648400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:09.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.801+0000 7f649affd640 1 -- 172.21.15.123:0/4116062294 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f649c15ed70 con 0x7f64840043a0 2024-09-15T23:12:09.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.801+0000 7f649affd640 1 -- 172.21.15.123:0/4116062294 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f648400bf00 con 0x7f6484004ef0 2024-09-15T23:12:09.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.801+0000 7f649affd640 1 -- 172.21.15.123:0/4116062294 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f648400c080 con 0x7f64840039b0 2024-09-15T23:12:09.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.801+0000 7f649b7fe640 1 --2- 172.21.15.123:0/4116062294 >> v2:172.21.15.188:3300/0 conn(0x7f649c06cd20 0x7f649c0b6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:12:09.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.801+0000 7f64a0ce6640 1 --2- 172.21.15.123:0/4116062294 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f649c070b80 0x7f649c0b72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:12:09.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.801+0000 7f649b7fe640 1 --2- 172.21.15.123:0/4116062294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64840043a0 0x7f6484004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:09.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.801+0000 7f649bfff640 1 --2- 172.21.15.123:0/4116062294 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f64840039b0 0x7f6484003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:09.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.801+0000 7f64a0ce6640 1 --2- 172.21.15.123:0/4116062294 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6484004ef0 0x7f648400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:09.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.801+0000 7f649b7fe640 1 -- 172.21.15.123:0/4116062294 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f64840039b0 msgr2=0x7f6484003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:09.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.801+0000 7f649b7fe640 1 --2- 172.21.15.123:0/4116062294 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f64840039b0 0x7f6484003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:09.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.801+0000 7f649b7fe640 1 -- 172.21.15.123:0/4116062294 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6484004ef0 msgr2=0x7f648400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:09.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.801+0000 7f649b7fe640 1 --2- 172.21.15.123:0/4116062294 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6484004ef0 0x7f648400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:09.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.801+0000 7f649b7fe640 1 -- 172.21.15.123:0/4116062294 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6484003520 con 0x7f64840043a0 2024-09-15T23:12:09.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.802+0000 7f649b7fe640 1 --2- 172.21.15.123:0/4116062294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64840043a0 0x7f6484004880 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6490009c40 tx=0x7f6484005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad287a9e44750a7a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:09.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.802+0000 7f649affd640 1 -- 172.21.15.123:0/4116062294 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6490009840 con 0x7f64840043a0 2024-09-15T23:12:09.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.802+0000 7f649affd640 1 -- 172.21.15.123:0/4116062294 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6490004020 con 0x7f64840043a0 2024-09-15T23:12:09.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.802+0000 7f649affd640 1 -- 172.21.15.123:0/4116062294 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64900043d0 con 0x7f64840043a0 2024-09-15T23:12:09.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.802+0000 7f64a2749640 1 -- 172.21.15.123:0/4116062294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64840043a0 msgr2=0x7f6484004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:09.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.802+0000 7f64a2749640 1 --2- 172.21.15.123:0/4116062294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64840043a0 0x7f6484004880 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6490009c40 tx=0x7f6484005830 comp rx=0 tx=0).stop 2024-09-15T23:12:09.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.802+0000 7f64a0ce6640 1 -- 172.21.15.123:0/4116062294 reap_dead start 2024-09-15T23:12:09.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.802+0000 7f64a2749640 1 -- 172.21.15.123:0/4116062294 shutdown_connections 2024-09-15T23:12:09.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.802+0000 7f64a2749640 1 -- 172.21.15.123:0/4116062294 >> 172.21.15.123:0/4116062294 conn(0x7f649c067fb0 msgr2=0x7f649c06f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:09.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.802+0000 7f64a2749640 1 -- 172.21.15.123:0/4116062294 shutdown_connections 2024-09-15T23:12:09.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.802+0000 7f64a2749640 1 -- 172.21.15.123:0/4116062294 wait complete. 2024-09-15T23:12:09.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.803+0000 7f64a2749640 1 Processor -- start 2024-09-15T23:12:09.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.804+0000 7f64a2749640 1 -- start start 2024-09-15T23:12:09.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.804+0000 7f64a2749640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f64840043a0 0x7f649c158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:09.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.804+0000 7f64a2749640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f649c1f4f40 0x7f649c159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:09.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.804+0000 7f64a2749640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f649c15a1e0 0x7f649c15a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:09.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.804+0000 7f64a2749640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f649c15f8f0 con 0x7f649c15a1e0 2024-09-15T23:12:09.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.804+0000 7f64a2749640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f649c15f610 con 0x7f64840043a0 2024-09-15T23:12:09.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.804+0000 7f64a2749640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f649c0b72a0 con 0x7f649c1f4f40 2024-09-15T23:12:09.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.804+0000 7f64a0ce6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f649c15a1e0 0x7f649c15a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:09.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.804+0000 7f64a0ce6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f649c15a1e0 0x7f649c15a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56234/0 (socket says 172.21.15.123:56234) 2024-09-15T23:12:09.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.804+0000 7f64a0ce6640 1 -- 172.21.15.123:0/4008278378 learned_addr learned my addr 172.21.15.123:0/4008278378 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:09.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.804+0000 7f649b7fe640 1 --2- 172.21.15.123:0/4008278378 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f649c1f4f40 0x7f649c159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:09.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.805+0000 7f649bfff640 1 --2- 172.21.15.123:0/4008278378 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f64840043a0 0x7f649c158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:09.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.805+0000 7f64a0ce6640 1 -- 172.21.15.123:0/4008278378 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f649c1f4f40 msgr2=0x7f649c159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:09.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.805+0000 7f64a0ce6640 1 --2- 172.21.15.123:0/4008278378 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f649c1f4f40 0x7f649c159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:09.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.805+0000 7f64a0ce6640 1 -- 172.21.15.123:0/4008278378 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f64840043a0 msgr2=0x7f649c158da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:09.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.805+0000 7f64a0ce6640 1 --2- 172.21.15.123:0/4008278378 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f64840043a0 0x7f649c158da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:09.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.805+0000 7f64a0ce6640 1 -- 172.21.15.123:0/4008278378 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f649c157d00 con 0x7f649c15a1e0 2024-09-15T23:12:09.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.805+0000 7f64a0ce6640 1 --2- 172.21.15.123:0/4008278378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f649c15a1e0 0x7f649c15a5f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f649c070f60 tx=0x7f649400f870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:09.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.805+0000 7f6498ff9640 1 -- 172.21.15.123:0/4008278378 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649401e070 con 0x7f649c15a1e0 2024-09-15T23:12:09.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.805+0000 7f6498ff9640 1 -- 172.21.15.123:0/4008278378 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6494003b90 con 0x7f649c15a1e0 2024-09-15T23:12:09.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.805+0000 7f64a2749640 1 -- 172.21.15.123:0/4008278378 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f649c157fe0 con 0x7f649c15a1e0 2024-09-15T23:12:09.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.805+0000 7f6498ff9640 1 -- 172.21.15.123:0/4008278378 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6494009e30 con 0x7f649c15a1e0 2024-09-15T23:12:09.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.805+0000 7f64a2749640 1 -- 172.21.15.123:0/4008278378 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f649c1585a0 con 0x7f649c15a1e0 2024-09-15T23:12:09.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.806+0000 7f64a2749640 1 -- 172.21.15.123:0/4008278378 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f649c0b7660 con 0x7f649c15a1e0 2024-09-15T23:12:09.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.807+0000 7f6498ff9640 1 -- 172.21.15.123:0/4008278378 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6494021070 con 0x7f649c15a1e0 2024-09-15T23:12:09.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.807+0000 7f6498ff9640 1 --2- 172.21.15.123:0/4008278378 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f648806c2b0 0x7f648806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:09.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.807+0000 7f6498ff9640 1 -- 172.21.15.123:0/4008278378 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f649408b060 con 0x7f649c15a1e0 2024-09-15T23:12:09.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.807+0000 7f649bfff640 1 --2- 172.21.15.123:0/4008278378 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f648806c2b0 0x7f648806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:09.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.808+0000 7f649bfff640 1 --2- 172.21.15.123:0/4008278378 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f648806c2b0 0x7f648806e770 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f648c000c00 tx=0x7f648c0078f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:09.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.811+0000 7f6498ff9640 1 -- 172.21.15.123:0/4008278378 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6494010040 con 0x7f649c15a1e0 2024-09-15T23:12:09.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.978+0000 7f64a2749640 1 -- 172.21.15.123:0/4008278378 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f649c15fd00 con 0x7f649c15a1e0 2024-09-15T23:12:09.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.979+0000 7f6498ff9640 1 -- 172.21.15.123:0/4008278378 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7f6494059560 con 0x7f649c15a1e0 2024-09-15T23:12:09.980 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:09.980 INFO:teuthology.orchestra.run.smithi123.stdout:[ 2024-09-15T23:12:09.980 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:12:09.980 INFO:teuthology.orchestra.run.smithi123.stdout: "poolnum": 1, 2024-09-15T23:12:09.980 INFO:teuthology.orchestra.run.smithi123.stdout: "poolname": ".mgr" 2024-09-15T23:12:09.980 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:12:09.980 INFO:teuthology.orchestra.run.smithi123.stdout:] 2024-09-15T23:12:09.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.981+0000 7f64a2749640 1 -- 172.21.15.123:0/4008278378 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f648806c2b0 msgr2=0x7f648806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:09.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.981+0000 7f64a2749640 1 --2- 172.21.15.123:0/4008278378 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f648806c2b0 0x7f648806e770 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f648c000c00 tx=0x7f648c0078f0 comp rx=0 tx=0).stop 2024-09-15T23:12:09.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.981+0000 7f64a2749640 1 -- 172.21.15.123:0/4008278378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f649c15a1e0 msgr2=0x7f649c15a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:09.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.981+0000 7f64a2749640 1 --2- 172.21.15.123:0/4008278378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f649c15a1e0 0x7f649c15a5f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f649c070f60 tx=0x7f649400f870 comp rx=0 tx=0).stop 2024-09-15T23:12:09.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.981+0000 7f64a2749640 1 -- 172.21.15.123:0/4008278378 shutdown_connections 2024-09-15T23:12:09.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.981+0000 7f64a2749640 1 --2- 172.21.15.123:0/4008278378 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f648806c2b0 0x7f648806e770 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:09.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.981+0000 7f64a2749640 1 --2- 172.21.15.123:0/4008278378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f649c15a1e0 0x7f649c15a5f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:09.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.981+0000 7f64a2749640 1 --2- 172.21.15.123:0/4008278378 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f649c1f4f40 0x7f649c159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:09.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.981+0000 7f64a2749640 1 --2- 172.21.15.123:0/4008278378 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f64840043a0 0x7f649c158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:09.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.981+0000 7f64a2749640 1 -- 172.21.15.123:0/4008278378 >> 172.21.15.123:0/4008278378 conn(0x7f649c067fb0 msgr2=0x7f649c06e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:09.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.981+0000 7f64a2749640 1 -- 172.21.15.123:0/4008278378 shutdown_connections 2024-09-15T23:12:09.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:09.981+0000 7f64a2749640 1 -- 172.21.15.123:0/4008278378 wait complete. 2024-09-15T23:12:09.992 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T23:12:09.992 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T23:12:10.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.093+0000 7fe4071d8640 1 Processor -- start 2024-09-15T23:12:10.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.093+0000 7fe4071d8640 1 -- start start 2024-09-15T23:12:10.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.094+0000 7fe4071d8640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe4000b6980 0x7fe4000d23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:10.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.094+0000 7fe4071d8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe400162fe0 0x7fe4000d32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:10.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.094+0000 7fe4071d8640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4000b7920 con 0x7fe40015ec10 2024-09-15T23:12:10.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.094+0000 7fe4071d8640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fe4000b3c00 con 0x7fe400162fe0 2024-09-15T23:12:10.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.094+0000 7fe4071d8640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe4000cf7c0 con 0x7fe4000b6980 2024-09-15T23:12:10.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.094+0000 7fe404f74640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe40015ec10 0x7fe4000b6270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:44736/0 (socket says 172.21.15.123:44736) 2024-09-15T23:12:10.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.094+0000 7fe404f74640 1 -- 172.21.15.123:0/834703308 learned_addr learned my addr 172.21.15.123:0/834703308 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:10.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.094+0000 7fe3f7fff640 1 --2- 172.21.15.123:0/834703308 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe4000b6980 0x7fe4000d23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:10.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.094+0000 7fe405775640 1 --2- 172.21.15.123:0/834703308 >> v2:172.21.15.188:3300/0 conn(0x7fe400162fe0 0x7fe4000d32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:10.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.094+0000 7fe3f77fe640 1 -- 172.21.15.123:0/834703308 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3540000020 0 0) 0x7fe3fc001110 con 0x7fe40015ec10 2024-09-15T23:12:10.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.094+0000 7fe3f77fe640 1 -- 172.21.15.123:0/834703308 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3e8003520 con 0x7fe40015ec10 2024-09-15T23:12:10.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.094+0000 7fe3f77fe640 1 -- 172.21.15.123:0/834703308 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3656725517 0 0) 0x7fe3e8003520 con 0x7fe40015ec10 2024-09-15T23:12:10.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.094+0000 7fe3f77fe640 1 -- 172.21.15.123:0/834703308 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe4000b6980 msgr2=0x7fe4000d23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:10.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.094+0000 7fe3f77fe640 1 --2- 172.21.15.123:0/834703308 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe4000b6980 0x7fe4000d23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:10.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.094+0000 7fe3f77fe640 1 -- 172.21.15.123:0/834703308 >> v2:172.21.15.188:3300/0 conn(0x7fe400162fe0 msgr2=0x7fe4000d32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:10.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.094+0000 7fe3f77fe640 1 --2- 172.21.15.123:0/834703308 >> v2:172.21.15.188:3300/0 conn(0x7fe400162fe0 0x7fe4000d32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:10.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.094+0000 7fe3f77fe640 1 -- 172.21.15.123:0/834703308 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4000cfaa0 con 0x7fe40015ec10 2024-09-15T23:12:10.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.094+0000 7fe3f77fe640 1 -- 172.21.15.123:0/834703308 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fe3fc001840 con 0x7fe40015ec10 2024-09-15T23:12:10.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.094+0000 7fe3f7fff640 1 --2- 172.21.15.123:0/834703308 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe4000b6980 0x7fe4000d23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:12:10.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.094+0000 7fe3f77fe640 1 -- 172.21.15.123:0/834703308 >> v1:172.21.15.123:6789/0 conn(0x7fe40015ec10 legacy=0x7fe4000b6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:10.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.094+0000 7fe3f77fe640 1 --2- 172.21.15.123:0/834703308 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe4000b6980 0x7fe3e80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:10.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.094+0000 7fe3f77fe640 1 --2- 172.21.15.123:0/834703308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3e8003ef0 0x7fe3e8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:10.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.094+0000 7fe3f77fe640 1 --2- 172.21.15.123:0/834703308 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe3e8004d40 0x7fe3e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:10.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.094+0000 7fe3f77fe640 1 -- 172.21.15.123:0/834703308 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe4000cf7c0 con 0x7fe3e8003ef0 2024-09-15T23:12:10.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.094+0000 7fe3f77fe640 1 -- 172.21.15.123:0/834703308 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e800b9c0 con 0x7fe3e8004d40 2024-09-15T23:12:10.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.094+0000 7fe3f77fe640 1 -- 172.21.15.123:0/834703308 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe3e800bb40 con 0x7fe4000b6980 2024-09-15T23:12:10.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.094+0000 7fe405775640 1 --2- 172.21.15.123:0/834703308 >> v2:172.21.15.188:3300/0 conn(0x7fe400162fe0 0x7fe4000d32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:12:10.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.095+0000 7fe3f7fff640 1 --2- 172.21.15.123:0/834703308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3e8003ef0 0x7fe3e8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:10.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.095+0000 7fe404f74640 1 --2- 172.21.15.123:0/834703308 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe4000b6980 0x7fe3e80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:10.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.095+0000 7fe405775640 1 --2- 172.21.15.123:0/834703308 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe3e8004d40 0x7fe3e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:10.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.095+0000 7fe3f7fff640 1 -- 172.21.15.123:0/834703308 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe4000b6980 msgr2=0x7fe3e80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:10.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.095+0000 7fe3f7fff640 1 --2- 172.21.15.123:0/834703308 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe4000b6980 0x7fe3e80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:10.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.095+0000 7fe3f7fff640 1 -- 172.21.15.123:0/834703308 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe3e8004d40 msgr2=0x7fe3e80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:10.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.095+0000 7fe3f7fff640 1 --2- 172.21.15.123:0/834703308 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe3e8004d40 0x7fe3e80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:10.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.095+0000 7fe3f7fff640 1 -- 172.21.15.123:0/834703308 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3e8003520 con 0x7fe3e8003ef0 2024-09-15T23:12:10.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.095+0000 7fe405775640 1 --2- 172.21.15.123:0/834703308 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe3e8004d40 0x7fe3e80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:10.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.096+0000 7fe3f7fff640 1 --2- 172.21.15.123:0/834703308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3e8003ef0 0x7fe3e8004800 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0009c90 tx=0x7fe3e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c06a580c09ceed54 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:10.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.096+0000 7fe3f77fe640 1 -- 172.21.15.123:0/834703308 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0036070 con 0x7fe3e8003ef0 2024-09-15T23:12:10.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.096+0000 7fe3f77fe640 1 -- 172.21.15.123:0/834703308 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3f0031400 con 0x7fe3e8003ef0 2024-09-15T23:12:10.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.096+0000 7fe3f77fe640 1 -- 172.21.15.123:0/834703308 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0009860 con 0x7fe3e8003ef0 2024-09-15T23:12:10.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.096+0000 7fe4071d8640 1 -- 172.21.15.123:0/834703308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3e8003ef0 msgr2=0x7fe3e8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:10.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.096+0000 7fe4071d8640 1 --2- 172.21.15.123:0/834703308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3e8003ef0 0x7fe3e8004800 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0009c90 tx=0x7fe3e8005830 comp rx=0 tx=0).stop 2024-09-15T23:12:10.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.096+0000 7fe405775640 1 -- 172.21.15.123:0/834703308 reap_dead start 2024-09-15T23:12:10.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.096+0000 7fe4071d8640 1 -- 172.21.15.123:0/834703308 shutdown_connections 2024-09-15T23:12:10.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.096+0000 7fe4071d8640 1 -- 172.21.15.123:0/834703308 >> 172.21.15.123:0/834703308 conn(0x7fe4000d1450 msgr2=0x7fe4000d1860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:10.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.096+0000 7fe4071d8640 1 -- 172.21.15.123:0/834703308 shutdown_connections 2024-09-15T23:12:10.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.096+0000 7fe4071d8640 1 -- 172.21.15.123:0/834703308 wait complete. 2024-09-15T23:12:10.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.097+0000 7fe4071d8640 1 Processor -- start 2024-09-15T23:12:10.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.097+0000 7fe4071d8640 1 -- start start 2024-09-15T23:12:10.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.098+0000 7fe4071d8640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe3e8003ef0 0x7fe400159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:10.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.098+0000 7fe4071d8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe40015a330 0x7fe4001600f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:10.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.098+0000 7fe4071d8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe400160630 0x7fe4001f4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:10.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.098+0000 7fe4071d8640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe4000d2540 con 0x7fe400160630 2024-09-15T23:12:10.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.098+0000 7fe4071d8640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe4000d23c0 con 0x7fe40015a330 2024-09-15T23:12:10.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.098+0000 7fe4071d8640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe4000d26c0 con 0x7fe3e8003ef0 2024-09-15T23:12:10.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.098+0000 7fe405775640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe400160630 0x7fe4001f4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:10.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.098+0000 7fe405775640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe400160630 0x7fe4001f4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56242/0 (socket says 172.21.15.123:56242) 2024-09-15T23:12:10.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.098+0000 7fe405775640 1 -- 172.21.15.123:0/851315209 learned_addr learned my addr 172.21.15.123:0/851315209 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:10.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.098+0000 7fe404f74640 1 --2- 172.21.15.123:0/851315209 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe3e8003ef0 0x7fe400159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:10.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.099+0000 7fe3f7fff640 1 --2- 172.21.15.123:0/851315209 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe40015a330 0x7fe4001600f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:10.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.099+0000 7fe405775640 1 -- 172.21.15.123:0/851315209 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe3e8003ef0 msgr2=0x7fe400159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:10.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.099+0000 7fe405775640 1 --2- 172.21.15.123:0/851315209 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe3e8003ef0 0x7fe400159aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:10.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.099+0000 7fe405775640 1 -- 172.21.15.123:0/851315209 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe40015a330 msgr2=0x7fe4001600f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:10.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.099+0000 7fe405775640 1 --2- 172.21.15.123:0/851315209 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe40015a330 0x7fe4001600f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:10.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.099+0000 7fe405775640 1 -- 172.21.15.123:0/851315209 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe40015f090 con 0x7fe400160630 2024-09-15T23:12:10.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.099+0000 7fe405775640 1 --2- 172.21.15.123:0/851315209 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe400160630 0x7fe4001f4750 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe4000b3db0 tx=0x7fe3f80115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:10.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.099+0000 7fe3f57fa640 1 -- 172.21.15.123:0/851315209 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f8003990 con 0x7fe400160630 2024-09-15T23:12:10.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.099+0000 7fe3f57fa640 1 -- 172.21.15.123:0/851315209 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3f801b070 con 0x7fe400160630 2024-09-15T23:12:10.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.099+0000 7fe4071d8640 1 -- 172.21.15.123:0/851315209 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe40015f330 con 0x7fe400160630 2024-09-15T23:12:10.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.099+0000 7fe3f57fa640 1 -- 172.21.15.123:0/851315209 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f8003b30 con 0x7fe400160630 2024-09-15T23:12:10.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.099+0000 7fe4071d8640 1 -- 172.21.15.123:0/851315209 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe40015f8f0 con 0x7fe400160630 2024-09-15T23:12:10.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.100+0000 7fe4071d8640 1 -- 172.21.15.123:0/851315209 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4000d1030 con 0x7fe400160630 2024-09-15T23:12:10.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.100+0000 7fe3f57fa640 1 -- 172.21.15.123:0/851315209 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe3f8005d10 con 0x7fe400160630 2024-09-15T23:12:10.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.101+0000 7fe3f57fa640 1 --2- 172.21.15.123:0/851315209 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe3ec06c2e0 0x7fe3ec06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:10.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.101+0000 7fe3f57fa640 1 -- 172.21.15.123:0/851315209 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7fe3f808b6a0 con 0x7fe400160630 2024-09-15T23:12:10.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.101+0000 7fe404f74640 1 --2- 172.21.15.123:0/851315209 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe3ec06c2e0 0x7fe3ec06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:10.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.101+0000 7fe404f74640 1 --2- 172.21.15.123:0/851315209 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe3ec06c2e0 0x7fe3ec06e7a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc0012f0 tx=0x7fe3fc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:10.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.105+0000 7fe3f57fa640 1 -- 172.21.15.123:0/851315209 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe4000d1030 con 0x7fe400160630 2024-09-15T23:12:10.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:10.271+0000 7fe4071d8640 1 -- 172.21.15.123:0/851315209 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fe4000b6270 con 0x7fe400160630 2024-09-15T23:12:11.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.270+0000 7fe3f57fa640 1 -- 172.21.15.123:0/851315209 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7fe3f805a160 con 0x7fe400160630 2024-09-15T23:12:11.271 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' created 2024-09-15T23:12:11.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.272+0000 7fe4071d8640 1 -- 172.21.15.123:0/851315209 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe3ec06c2e0 msgr2=0x7fe3ec06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:11.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.272+0000 7fe4071d8640 1 --2- 172.21.15.123:0/851315209 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe3ec06c2e0 0x7fe3ec06e7a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc0012f0 tx=0x7fe3fc009040 comp rx=0 tx=0).stop 2024-09-15T23:12:11.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.272+0000 7fe4071d8640 1 -- 172.21.15.123:0/851315209 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe400160630 msgr2=0x7fe4001f4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:11.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.272+0000 7fe4071d8640 1 --2- 172.21.15.123:0/851315209 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe400160630 0x7fe4001f4750 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe4000b3db0 tx=0x7fe3f80115a0 comp rx=0 tx=0).stop 2024-09-15T23:12:11.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.273+0000 7fe4071d8640 1 -- 172.21.15.123:0/851315209 shutdown_connections 2024-09-15T23:12:11.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.273+0000 7fe4071d8640 1 --2- 172.21.15.123:0/851315209 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe3ec06c2e0 0x7fe3ec06e7a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:11.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.273+0000 7fe4071d8640 1 --2- 172.21.15.123:0/851315209 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe400160630 0x7fe4001f4750 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:11.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.273+0000 7fe4071d8640 1 --2- 172.21.15.123:0/851315209 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe40015a330 0x7fe4001600f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:11.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.273+0000 7fe4071d8640 1 --2- 172.21.15.123:0/851315209 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe3e8003ef0 0x7fe400159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:11.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.273+0000 7fe4071d8640 1 -- 172.21.15.123:0/851315209 >> 172.21.15.123:0/851315209 conn(0x7fe4000d1450 msgr2=0x7fe4000d1860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:11.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.273+0000 7fe4071d8640 1 -- 172.21.15.123:0/851315209 shutdown_connections 2024-09-15T23:12:11.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.274+0000 7fe4071d8640 1 -- 172.21.15.123:0/851315209 wait complete. 2024-09-15T23:12:11.290 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T23:12:11.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.398+0000 7fbdd65f6640 1 Processor -- start 2024-09-15T23:12:11.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.398+0000 7fbdd65f6640 1 -- start start 2024-09-15T23:12:11.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.398+0000 7fbdd65f6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fbdd015ea50 0x7fbdd0072f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:11.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.398+0000 7fbdd65f6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbdd0073c40 0x7fbdd00b4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:11.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.398+0000 7fbdd65f6640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdd00734f0 con 0x7fbdd00b45a0 2024-09-15T23:12:11.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.398+0000 7fbdd65f6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fbdd00ccb20 con 0x7fbdd015ea50 2024-09-15T23:12:11.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.398+0000 7fbdd65f6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbdd015ee30 con 0x7fbdd0073c40 2024-09-15T23:12:11.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.399+0000 7fbdd4b93640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fbdd00b45a0 0x7fbdd00709a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:44738/0 (socket says 172.21.15.123:44738) 2024-09-15T23:12:11.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.399+0000 7fbdd4b93640 1 -- 172.21.15.123:0/3516754564 learned_addr learned my addr 172.21.15.123:0/3516754564 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:11.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.399+0000 7fbdceffd640 1 -- 172.21.15.123:0/3516754564 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2045194975 0 0) 0x7fbdd00734f0 con 0x7fbdd00b45a0 2024-09-15T23:12:11.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.399+0000 7fbdcffff640 1 --2- 172.21.15.123:0/3516754564 >> v2:172.21.15.188:3300/0 conn(0x7fbdd015ea50 0x7fbdd0072f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:11.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.399+0000 7fbdcf7fe640 1 --2- 172.21.15.123:0/3516754564 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbdd0073c40 0x7fbdd00b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:11.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.399+0000 7fbdceffd640 1 -- 172.21.15.123:0/3516754564 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdb8003520 con 0x7fbdd00b45a0 2024-09-15T23:12:11.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.399+0000 7fbdceffd640 1 -- 172.21.15.123:0/3516754564 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1644689029 0 0) 0x7fbdb8003520 con 0x7fbdd00b45a0 2024-09-15T23:12:11.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.399+0000 7fbdceffd640 1 -- 172.21.15.123:0/3516754564 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbdd0073c40 msgr2=0x7fbdd00b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:11.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.399+0000 7fbdceffd640 1 --2- 172.21.15.123:0/3516754564 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbdd0073c40 0x7fbdd00b4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:11.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.399+0000 7fbdceffd640 1 -- 172.21.15.123:0/3516754564 >> v2:172.21.15.188:3300/0 conn(0x7fbdd015ea50 msgr2=0x7fbdd0072f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:11.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.399+0000 7fbdceffd640 1 --2- 172.21.15.123:0/3516754564 >> v2:172.21.15.188:3300/0 conn(0x7fbdd015ea50 0x7fbdd0072f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:11.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.399+0000 7fbdceffd640 1 -- 172.21.15.123:0/3516754564 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd00d1810 con 0x7fbdd00b45a0 2024-09-15T23:12:11.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.399+0000 7fbdceffd640 1 -- 172.21.15.123:0/3516754564 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fbdc80019f0 con 0x7fbdd00b45a0 2024-09-15T23:12:11.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.399+0000 7fbdceffd640 1 -- 172.21.15.123:0/3516754564 >> v1:172.21.15.123:6789/0 conn(0x7fbdd00b45a0 legacy=0x7fbdd00709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:11.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.399+0000 7fbdceffd640 1 --2- 172.21.15.123:0/3516754564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdb80039b0 0x7fbdb8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:11.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.399+0000 7fbdceffd640 1 --2- 172.21.15.123:0/3516754564 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdb8004800 0x7fbdb8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:11.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.399+0000 7fbdceffd640 1 --2- 172.21.15.123:0/3516754564 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbdd0073c40 0x7fbdb80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:11.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.399+0000 7fbdceffd640 1 -- 172.21.15.123:0/3516754564 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd015ee30 con 0x7fbdb80039b0 2024-09-15T23:12:11.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.399+0000 7fbdceffd640 1 -- 172.21.15.123:0/3516754564 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb800b9c0 con 0x7fbdb8004800 2024-09-15T23:12:11.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.399+0000 7fbdceffd640 1 -- 172.21.15.123:0/3516754564 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbdb800bb40 con 0x7fbdd0073c40 2024-09-15T23:12:11.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.399+0000 7fbdcffff640 1 --2- 172.21.15.123:0/3516754564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdb80039b0 0x7fbdb8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:11.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.399+0000 7fbdcf7fe640 1 --2- 172.21.15.123:0/3516754564 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdb8004800 0x7fbdb8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:11.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.399+0000 7fbdd4b93640 1 --2- 172.21.15.123:0/3516754564 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbdd0073c40 0x7fbdb80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:11.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.400+0000 7fbdcffff640 1 -- 172.21.15.123:0/3516754564 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbdd0073c40 msgr2=0x7fbdb80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:11.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.400+0000 7fbdcffff640 1 --2- 172.21.15.123:0/3516754564 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbdd0073c40 0x7fbdb80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:11.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.400+0000 7fbdcffff640 1 -- 172.21.15.123:0/3516754564 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdb8004800 msgr2=0x7fbdb8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:11.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.400+0000 7fbdcffff640 1 --2- 172.21.15.123:0/3516754564 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdb8004800 0x7fbdb8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:11.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.400+0000 7fbdcffff640 1 -- 172.21.15.123:0/3516754564 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdb8003520 con 0x7fbdb80039b0 2024-09-15T23:12:11.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.400+0000 7fbdcffff640 1 --2- 172.21.15.123:0/3516754564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdb80039b0 0x7fbdb8003dd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0009ab0 tx=0x7fbdb8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b9a98c3b6dce309 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:11.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.400+0000 7fbdceffd640 1 -- 172.21.15.123:0/3516754564 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc0036070 con 0x7fbdb80039b0 2024-09-15T23:12:11.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.400+0000 7fbdceffd640 1 -- 172.21.15.123:0/3516754564 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc0005990 con 0x7fbdb80039b0 2024-09-15T23:12:11.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.400+0000 7fbdceffd640 1 -- 172.21.15.123:0/3516754564 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc0009680 con 0x7fbdb80039b0 2024-09-15T23:12:11.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.401+0000 7fbdd65f6640 1 -- 172.21.15.123:0/3516754564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdb80039b0 msgr2=0x7fbdb8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:11.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.401+0000 7fbdd65f6640 1 --2- 172.21.15.123:0/3516754564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdb80039b0 0x7fbdb8003dd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0009ab0 tx=0x7fbdb8005830 comp rx=0 tx=0).stop 2024-09-15T23:12:11.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.401+0000 7fbdd4b93640 1 -- 172.21.15.123:0/3516754564 reap_dead start 2024-09-15T23:12:11.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.401+0000 7fbdd65f6640 1 -- 172.21.15.123:0/3516754564 shutdown_connections 2024-09-15T23:12:11.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.401+0000 7fbdd65f6640 1 -- 172.21.15.123:0/3516754564 >> 172.21.15.123:0/3516754564 conn(0x7fbdd00cefe0 msgr2=0x7fbdd00cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:11.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.401+0000 7fbdd65f6640 1 -- 172.21.15.123:0/3516754564 shutdown_connections 2024-09-15T23:12:11.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.401+0000 7fbdd65f6640 1 -- 172.21.15.123:0/3516754564 wait complete. 2024-09-15T23:12:11.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.402+0000 7fbdd65f6640 1 Processor -- start 2024-09-15T23:12:11.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.402+0000 7fbdd65f6640 1 -- start start 2024-09-15T23:12:11.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.403+0000 7fbdd65f6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdb80039b0 0x7fbdd00b1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:11.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.403+0000 7fbdd65f6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbdd00c95a0 0x7fbdd01f37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:11.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.403+0000 7fbdd65f6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdd00b0430 0x7fbdd00b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:11.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.403+0000 7fbdd65f6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd00d22f0 con 0x7fbdb80039b0 2024-09-15T23:12:11.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.403+0000 7fbdd65f6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd00d1dd0 con 0x7fbdd00b0430 2024-09-15T23:12:11.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.403+0000 7fbdd65f6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbdd0074080 con 0x7fbdd00c95a0 2024-09-15T23:12:11.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.403+0000 7fbdcffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdb80039b0 0x7fbdd00b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:11.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.403+0000 7fbdcffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdb80039b0 0x7fbdd00b1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56264/0 (socket says 172.21.15.123:56264) 2024-09-15T23:12:11.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.403+0000 7fbdcffff640 1 -- 172.21.15.123:0/2459422042 learned_addr learned my addr 172.21.15.123:0/2459422042 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:11.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.403+0000 7fbdcf7fe640 1 --2- 172.21.15.123:0/2459422042 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbdd00c95a0 0x7fbdd01f37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:11.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.403+0000 7fbdd4b93640 1 --2- 172.21.15.123:0/2459422042 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdd00b0430 0x7fbdd00b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:11.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.403+0000 7fbdcffff640 1 -- 172.21.15.123:0/2459422042 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbdd00c95a0 msgr2=0x7fbdd01f37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:11.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.403+0000 7fbdcffff640 1 --2- 172.21.15.123:0/2459422042 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbdd00c95a0 0x7fbdd01f37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:11.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.403+0000 7fbdcffff640 1 -- 172.21.15.123:0/2459422042 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdd00b0430 msgr2=0x7fbdd00b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:11.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.403+0000 7fbdcffff640 1 --2- 172.21.15.123:0/2459422042 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdd00b0430 0x7fbdd00b08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:11.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.403+0000 7fbdcffff640 1 -- 172.21.15.123:0/2459422042 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd00c9a20 con 0x7fbdb80039b0 2024-09-15T23:12:11.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.404+0000 7fbdcffff640 1 --2- 172.21.15.123:0/2459422042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdb80039b0 0x7fbdd00b1370 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0009bd0 tx=0x7fbdc0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:11.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.404+0000 7fbdccff9640 1 -- 172.21.15.123:0/2459422042 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc0041020 con 0x7fbdb80039b0 2024-09-15T23:12:11.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.404+0000 7fbdccff9640 1 -- 172.21.15.123:0/2459422042 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc0037040 con 0x7fbdb80039b0 2024-09-15T23:12:11.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.404+0000 7fbdccff9640 1 -- 172.21.15.123:0/2459422042 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc0036070 con 0x7fbdb80039b0 2024-09-15T23:12:11.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.404+0000 7fbdd65f6640 1 -- 172.21.15.123:0/2459422042 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdd00af670 con 0x7fbdb80039b0 2024-09-15T23:12:11.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.404+0000 7fbdd65f6640 1 -- 172.21.15.123:0/2459422042 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdd00afc30 con 0x7fbdb80039b0 2024-09-15T23:12:11.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.405+0000 7fbdd65f6640 1 -- 172.21.15.123:0/2459422042 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdd00d1430 con 0x7fbdb80039b0 2024-09-15T23:12:11.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.405+0000 7fbdccff9640 1 -- 172.21.15.123:0/2459422042 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbdc0044020 con 0x7fbdb80039b0 2024-09-15T23:12:11.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.406+0000 7fbdccff9640 1 --2- 172.21.15.123:0/2459422042 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbdbc06c2e0 0x7fbdbc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:11.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.406+0000 7fbdccff9640 1 -- 172.21.15.123:0/2459422042 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7fbdc00ab7f0 con 0x7fbdb80039b0 2024-09-15T23:12:11.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.406+0000 7fbdcf7fe640 1 --2- 172.21.15.123:0/2459422042 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbdbc06c2e0 0x7fbdbc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:11.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.407+0000 7fbdcf7fe640 1 --2- 172.21.15.123:0/2459422042 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbdbc06c2e0 0x7fbdbc06e7a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbdd00ae9a0 tx=0x7fbdc4009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:11.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.410+0000 7fbdccff9640 1 -- 172.21.15.123:0/2459422042 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbdc004b030 con 0x7fbdb80039b0 2024-09-15T23:12:11.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:11.576+0000 7fbdd65f6640 1 -- 172.21.15.123:0/2459422042 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fbdd006d9e0 con 0x7fbdb80039b0 2024-09-15T23:12:12.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.275+0000 7fbdccff9640 1 -- 172.21.15.123:0/2459422042 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) ==== 170+0+0 (secure 0 0 0) 0x7fbdc007a320 con 0x7fbdb80039b0 2024-09-15T23:12:12.277 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' created 2024-09-15T23:12:12.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.278+0000 7fbdd65f6640 1 -- 172.21.15.123:0/2459422042 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbdbc06c2e0 msgr2=0x7fbdbc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:12.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.278+0000 7fbdd65f6640 1 --2- 172.21.15.123:0/2459422042 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbdbc06c2e0 0x7fbdbc06e7a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbdd00ae9a0 tx=0x7fbdc4009190 comp rx=0 tx=0).stop 2024-09-15T23:12:12.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.278+0000 7fbdd65f6640 1 -- 172.21.15.123:0/2459422042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdb80039b0 msgr2=0x7fbdd00b1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:12.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.278+0000 7fbdd65f6640 1 --2- 172.21.15.123:0/2459422042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdb80039b0 0x7fbdd00b1370 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0009bd0 tx=0x7fbdc0004730 comp rx=0 tx=0).stop 2024-09-15T23:12:12.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.278+0000 7fbdd65f6640 1 -- 172.21.15.123:0/2459422042 shutdown_connections 2024-09-15T23:12:12.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.278+0000 7fbdd65f6640 1 --2- 172.21.15.123:0/2459422042 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdd00b0430 0x7fbdd00b08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:12.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.278+0000 7fbdd65f6640 1 --2- 172.21.15.123:0/2459422042 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbdd00c95a0 0x7fbdd01f37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:12.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.278+0000 7fbdd65f6640 1 --2- 172.21.15.123:0/2459422042 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbdbc06c2e0 0x7fbdbc06e7a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:12.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.278+0000 7fbdd65f6640 1 --2- 172.21.15.123:0/2459422042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdb80039b0 0x7fbdd00b1370 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:12.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.278+0000 7fbdd65f6640 1 -- 172.21.15.123:0/2459422042 >> 172.21.15.123:0/2459422042 conn(0x7fbdd00cefe0 msgr2=0x7fbdd00b2310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:12.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.279+0000 7fbdd65f6640 1 -- 172.21.15.123:0/2459422042 shutdown_connections 2024-09-15T23:12:12.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.279+0000 7fbdd65f6640 1 -- 172.21.15.123:0/2459422042 wait complete. 2024-09-15T23:12:12.305 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T23:12:12.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.409+0000 7f15d2247640 1 Processor -- start 2024-09-15T23:12:12.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.409+0000 7f15d2247640 1 -- start start 2024-09-15T23:12:12.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.410+0000 7f15d2247640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f15cc0ccf30 0x7f15cc0b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:12.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.410+0000 7f15d2247640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f15cc0cead0 0x7f15cc071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:12.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.410+0000 7f15d2247640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15cc0cf2e0 con 0x7f15cc15b7c0 2024-09-15T23:12:12.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.410+0000 7f15d2247640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f15cc070fe0 con 0x7f15cc0cead0 2024-09-15T23:12:12.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.410+0000 7f15d2247640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f15cc0712c0 con 0x7f15cc0ccf30 2024-09-15T23:12:12.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.410+0000 7f15cbfff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f15cc0cead0 0x7f15cc071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:12.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.410+0000 7f15cbfff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f15cc0cead0 0x7f15cc071ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56272/0 (socket says 172.21.15.123:56272) 2024-09-15T23:12:12.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.410+0000 7f15cbfff640 1 -- 172.21.15.123:0/1562243156 learned_addr learned my addr 172.21.15.123:0/1562243156 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:12.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.410+0000 7f15cbfff640 1 -- 172.21.15.123:0/1562243156 >> v2:172.21.15.188:3300/0 conn(0x7f15cc0ccf30 msgr2=0x7f15cc0b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:12.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.410+0000 7f15cb7fe640 1 --2- 172.21.15.123:0/1562243156 >> v2:172.21.15.188:3300/0 conn(0x7f15cc0ccf30 0x7f15cc0b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:12.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.410+0000 7f15cbfff640 1 --2- 172.21.15.123:0/1562243156 >> v2:172.21.15.188:3300/0 conn(0x7f15cc0ccf30 0x7f15cc0b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:12.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.410+0000 7f15cbfff640 1 -- 172.21.15.123:0/1562243156 >> v1:172.21.15.188:6789/0 conn(0x7f15cc15b7c0 legacy=0x7f15cc0cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:12.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.410+0000 7f15cbfff640 1 -- 172.21.15.123:0/1562243156 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15cc0715a0 con 0x7f15cc0cead0 2024-09-15T23:12:12.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.411+0000 7f15cbfff640 1 --2- 172.21.15.123:0/1562243156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15cc0cead0 0x7f15cc071ac0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f15cc06f1c0 tx=0x7f15c402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fa7e69ad18abe66 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:12.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.411+0000 7f15ca7fc640 1 -- 172.21.15.123:0/1562243156 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c4037070 con 0x7f15cc0cead0 2024-09-15T23:12:12.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.411+0000 7f15ca7fc640 1 -- 172.21.15.123:0/1562243156 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15c4032440 con 0x7f15cc0cead0 2024-09-15T23:12:12.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.411+0000 7f15ca7fc640 1 -- 172.21.15.123:0/1562243156 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c4032810 con 0x7f15cc0cead0 2024-09-15T23:12:12.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.412+0000 7f15d2247640 1 -- 172.21.15.123:0/1562243156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15cc0cead0 msgr2=0x7f15cc071ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:12.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.412+0000 7f15d2247640 1 --2- 172.21.15.123:0/1562243156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15cc0cead0 0x7f15cc071ac0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f15cc06f1c0 tx=0x7f15c402a1a0 comp rx=0 tx=0).stop 2024-09-15T23:12:12.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.412+0000 7f15d2247640 1 -- 172.21.15.123:0/1562243156 shutdown_connections 2024-09-15T23:12:12.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.412+0000 7f15d2247640 1 --2- 172.21.15.123:0/1562243156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15cc0cead0 0x7f15cc071ac0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:12.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.412+0000 7f15d2247640 1 --2- 172.21.15.123:0/1562243156 >> v2:172.21.15.188:3300/0 conn(0x7f15cc0ccf30 0x7f15cc0b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:12.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.412+0000 7f15d2247640 1 -- 172.21.15.123:0/1562243156 >> 172.21.15.123:0/1562243156 conn(0x7f15cc06d0f0 msgr2=0x7f15cc06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:12.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.412+0000 7f15d2247640 1 -- 172.21.15.123:0/1562243156 shutdown_connections 2024-09-15T23:12:12.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.412+0000 7f15d2247640 1 -- 172.21.15.123:0/1562243156 wait complete. 2024-09-15T23:12:12.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.413+0000 7f15d2247640 1 Processor -- start 2024-09-15T23:12:12.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.413+0000 7f15d2247640 1 -- start start 2024-09-15T23:12:12.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.414+0000 7f15d2247640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15cc0ccf30 0x7f15cc158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:12.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.414+0000 7f15d2247640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f15cc0cead0 0x7f15cc142d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:12.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.414+0000 7f15d2247640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f15cc15b7c0 0x7f15cc1569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:12.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.414+0000 7f15d2247640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f15cc0cf080 con 0x7f15cc0ccf30 2024-09-15T23:12:12.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.414+0000 7f15d2247640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f15cc0cef00 con 0x7f15cc15b7c0 2024-09-15T23:12:12.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.414+0000 7f15d2247640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f15cc072000 con 0x7f15cc0cead0 2024-09-15T23:12:12.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.414+0000 7f15cb7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15cc0ccf30 0x7f15cc158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:12.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.414+0000 7f15cb7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15cc0ccf30 0x7f15cc158db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56276/0 (socket says 172.21.15.123:56276) 2024-09-15T23:12:12.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.414+0000 7f15cb7fe640 1 -- 172.21.15.123:0/984275400 learned_addr learned my addr 172.21.15.123:0/984275400 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:12.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.414+0000 7f15cbfff640 1 --2- 172.21.15.123:0/984275400 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f15cc15b7c0 0x7f15cc1569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:12.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.414+0000 7f15caffd640 1 --2- 172.21.15.123:0/984275400 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f15cc0cead0 0x7f15cc142d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:12.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.414+0000 7f15cb7fe640 1 -- 172.21.15.123:0/984275400 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f15cc0cead0 msgr2=0x7f15cc142d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:12.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.414+0000 7f15cb7fe640 1 --2- 172.21.15.123:0/984275400 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f15cc0cead0 0x7f15cc142d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:12.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.414+0000 7f15cb7fe640 1 -- 172.21.15.123:0/984275400 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f15cc15b7c0 msgr2=0x7f15cc1569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:12.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.414+0000 7f15cb7fe640 1 --2- 172.21.15.123:0/984275400 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f15cc15b7c0 0x7f15cc1569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:12.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.414+0000 7f15cb7fe640 1 -- 172.21.15.123:0/984275400 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15cc159390 con 0x7f15cc0ccf30 2024-09-15T23:12:12.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.414+0000 7f15cb7fe640 1 --2- 172.21.15.123:0/984275400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15cc0ccf30 0x7f15cc158db0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00ce10 tx=0x7f15bc00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:12.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.414+0000 7f15b3fff640 1 -- 172.21.15.123:0/984275400 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15bc003b90 con 0x7f15cc0ccf30 2024-09-15T23:12:12.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.414+0000 7f15b3fff640 1 -- 172.21.15.123:0/984275400 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15bc003d30 con 0x7f15cc0ccf30 2024-09-15T23:12:12.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.414+0000 7f15d2247640 1 -- 172.21.15.123:0/984275400 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15cc159670 con 0x7f15cc0ccf30 2024-09-15T23:12:12.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.414+0000 7f15b3fff640 1 -- 172.21.15.123:0/984275400 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15bc004240 con 0x7f15cc0ccf30 2024-09-15T23:12:12.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.414+0000 7f15d2247640 1 -- 172.21.15.123:0/984275400 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15cc159c30 con 0x7f15cc0ccf30 2024-09-15T23:12:12.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.415+0000 7f15d2247640 1 -- 172.21.15.123:0/984275400 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15cc0b2c50 con 0x7f15cc0ccf30 2024-09-15T23:12:12.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.416+0000 7f15b3fff640 1 -- 172.21.15.123:0/984275400 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f15bc0043e0 con 0x7f15cc0ccf30 2024-09-15T23:12:12.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.416+0000 7f15b3fff640 1 --2- 172.21.15.123:0/984275400 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f15b806c2b0 0x7f15b806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:12.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.416+0000 7f15b3fff640 1 -- 172.21.15.123:0/984275400 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5609+0+0 (secure 0 0 0) 0x7f15bc08bed0 con 0x7f15cc0ccf30 2024-09-15T23:12:12.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.417+0000 7f15caffd640 1 --2- 172.21.15.123:0/984275400 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f15b806c2b0 0x7f15b806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:12.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.417+0000 7f15caffd640 1 --2- 172.21.15.123:0/984275400 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f15b806c2b0 0x7f15b806e770 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f15c0006fd0 tx=0x7f15c0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:12.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.421+0000 7f15b3fff640 1 -- 172.21.15.123:0/984275400 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f15bc01d340 con 0x7f15cc0ccf30 2024-09-15T23:12:12.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:12.621+0000 7f15d2247640 1 -- 172.21.15.123:0/984275400 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f15cc1576a0 con 0x7f15cc0ccf30 2024-09-15T23:12:13.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.277+0000 7f15b3fff640 1 -- 172.21.15.123:0/984275400 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f15bc05a730 con 0x7f15cc0ccf30 2024-09-15T23:12:13.280 INFO:teuthology.orchestra.run.smithi123.stderr:new fs with metadata pool 2 and data pool 3 2024-09-15T23:12:13.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.282+0000 7f15d2247640 1 -- 172.21.15.123:0/984275400 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f15b806c2b0 msgr2=0x7f15b806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:13.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.282+0000 7f15d2247640 1 --2- 172.21.15.123:0/984275400 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f15b806c2b0 0x7f15b806e770 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f15c0006fd0 tx=0x7f15c0008040 comp rx=0 tx=0).stop 2024-09-15T23:12:13.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.282+0000 7f15d2247640 1 -- 172.21.15.123:0/984275400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15cc0ccf30 msgr2=0x7f15cc158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:13.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.282+0000 7f15d2247640 1 --2- 172.21.15.123:0/984275400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15cc0ccf30 0x7f15cc158db0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00ce10 tx=0x7f15bc00a660 comp rx=0 tx=0).stop 2024-09-15T23:12:13.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.282+0000 7f15d2247640 1 -- 172.21.15.123:0/984275400 shutdown_connections 2024-09-15T23:12:13.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.282+0000 7f15d2247640 1 --2- 172.21.15.123:0/984275400 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f15cc15b7c0 0x7f15cc1569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:13.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.282+0000 7f15d2247640 1 --2- 172.21.15.123:0/984275400 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f15cc0cead0 0x7f15cc142d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:13.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.282+0000 7f15d2247640 1 --2- 172.21.15.123:0/984275400 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f15b806c2b0 0x7f15b806e770 secure :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f15c0006fd0 tx=0x7f15c0008040 comp rx=0 tx=0).stop 2024-09-15T23:12:13.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.282+0000 7f15d2247640 1 --2- 172.21.15.123:0/984275400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15cc0ccf30 0x7f15cc158db0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:13.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.282+0000 7f15d2247640 1 -- 172.21.15.123:0/984275400 >> 172.21.15.123:0/984275400 conn(0x7f15cc06d0f0 msgr2=0x7f15cc0cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:13.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.285+0000 7f15d2247640 1 -- 172.21.15.123:0/984275400 shutdown_connections 2024-09-15T23:12:13.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.288+0000 7f15d2247640 1 -- 172.21.15.123:0/984275400 wait complete. 2024-09-15T23:12:13.316 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:12:13.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.413+0000 7fe9c2a50640 1 Processor -- start 2024-09-15T23:12:13.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.413+0000 7fe9c2a50640 1 -- start start 2024-09-15T23:12:13.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.414+0000 7fe9c2a50640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe9bc15eab0 0x7fe9bc15ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:13.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.414+0000 7fe9c2a50640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe9bc162490 0x7fe9bc0d2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:13.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.414+0000 7fe9c2a50640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9bc15f570 con 0x7fe9bc0b66b0 2024-09-15T23:12:13.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.414+0000 7fe9c2a50640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe9bc15f850 con 0x7fe9bc162490 2024-09-15T23:12:13.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.414+0000 7fe9c2a50640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe9bc15fb30 con 0x7fe9bc15eab0 2024-09-15T23:12:13.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.414+0000 7fe9bb7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe9bc162490 0x7fe9bc0d2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:13.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.414+0000 7fe9bb7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe9bc162490 0x7fe9bc0d2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56280/0 (socket says 172.21.15.123:56280) 2024-09-15T23:12:13.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.414+0000 7fe9c0fed640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe9bc0b66b0 0x7fe9bc0d35e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:44750/0 (socket says 172.21.15.123:44750) 2024-09-15T23:12:13.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.414+0000 7fe9bb7fe640 1 -- 172.21.15.123:0/4184226795 learned_addr learned my addr 172.21.15.123:0/4184226795 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:13.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.414+0000 7fe9bbfff640 1 --2- 172.21.15.123:0/4184226795 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe9bc15eab0 0x7fe9bc15ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:13.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.414+0000 7fe9bb7fe640 1 -- 172.21.15.123:0/4184226795 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe9bc15eab0 msgr2=0x7fe9bc15ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:13.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.414+0000 7fe9bb7fe640 1 --2- 172.21.15.123:0/4184226795 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe9bc15eab0 0x7fe9bc15ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:13.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.415+0000 7fe9bb7fe640 1 -- 172.21.15.123:0/4184226795 >> v1:172.21.15.123:6789/0 conn(0x7fe9bc0b66b0 legacy=0x7fe9bc0d35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:13.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.414+0000 7fe9baffd640 1 -- 172.21.15.123:0/4184226795 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1895638120 0 0) 0x7fe9bc15f570 con 0x7fe9bc0b66b0 2024-09-15T23:12:13.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.415+0000 7fe9bb7fe640 1 -- 172.21.15.123:0/4184226795 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9bc15fe10 con 0x7fe9bc162490 2024-09-15T23:12:13.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.415+0000 7fe9bbfff640 1 --2- 172.21.15.123:0/4184226795 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe9bc15eab0 0x7fe9bc15ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:13.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.415+0000 7fe9bb7fe640 1 --2- 172.21.15.123:0/4184226795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9bc162490 0x7fe9bc0d2c30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0009870 tx=0x7fe9b002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=885ace4e61d4259a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:13.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.415+0000 7fe9baffd640 1 -- 172.21.15.123:0/4184226795 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b0037070 con 0x7fe9bc162490 2024-09-15T23:12:13.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.415+0000 7fe9baffd640 1 -- 172.21.15.123:0/4184226795 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9b0032440 con 0x7fe9bc162490 2024-09-15T23:12:13.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.415+0000 7fe9baffd640 1 -- 172.21.15.123:0/4184226795 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b0032810 con 0x7fe9bc162490 2024-09-15T23:12:13.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.416+0000 7fe9c2a50640 1 -- 172.21.15.123:0/4184226795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9bc162490 msgr2=0x7fe9bc0d2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:13.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.416+0000 7fe9c2a50640 1 --2- 172.21.15.123:0/4184226795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9bc162490 0x7fe9bc0d2c30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0009870 tx=0x7fe9b002a270 comp rx=0 tx=0).stop 2024-09-15T23:12:13.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.416+0000 7fe9c2a50640 1 -- 172.21.15.123:0/4184226795 shutdown_connections 2024-09-15T23:12:13.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.416+0000 7fe9c2a50640 1 --2- 172.21.15.123:0/4184226795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9bc162490 0x7fe9bc0d2c30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:13.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.416+0000 7fe9c2a50640 1 --2- 172.21.15.123:0/4184226795 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe9bc15eab0 0x7fe9bc15ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:13.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.416+0000 7fe9c2a50640 1 -- 172.21.15.123:0/4184226795 >> 172.21.15.123:0/4184226795 conn(0x7fe9bc0d16d0 msgr2=0x7fe9bc0d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:13.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.416+0000 7fe9c2a50640 1 -- 172.21.15.123:0/4184226795 shutdown_connections 2024-09-15T23:12:13.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.416+0000 7fe9c2a50640 1 -- 172.21.15.123:0/4184226795 wait complete. 2024-09-15T23:12:13.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.417+0000 7fe9c2a50640 1 Processor -- start 2024-09-15T23:12:13.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.417+0000 7fe9c2a50640 1 -- start start 2024-09-15T23:12:13.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.418+0000 7fe9c2a50640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe9bc0b66b0 0x7fe9bc1575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:13.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.418+0000 7fe9c2a50640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9bc15eab0 0x7fe9bc0c9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:13.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.418+0000 7fe9c2a50640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe9bc162490 0x7fe9bc0c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:13.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.418+0000 7fe9c2a50640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe9bc0d4460 con 0x7fe9bc15eab0 2024-09-15T23:12:13.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.418+0000 7fe9c2a50640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe9bc0d3170 con 0x7fe9bc162490 2024-09-15T23:12:13.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.418+0000 7fe9c2a50640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe9bc0d45e0 con 0x7fe9bc0b66b0 2024-09-15T23:12:13.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.418+0000 7fe9bb7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9bc15eab0 0x7fe9bc0c9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:13.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.418+0000 7fe9bb7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9bc15eab0 0x7fe9bc0c9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56286/0 (socket says 172.21.15.123:56286) 2024-09-15T23:12:13.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.418+0000 7fe9bb7fe640 1 -- 172.21.15.123:0/3329984701 learned_addr learned my addr 172.21.15.123:0/3329984701 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:13.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.418+0000 7fe9bbfff640 1 --2- 172.21.15.123:0/3329984701 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe9bc0b66b0 0x7fe9bc1575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:13.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.418+0000 7fe9c0fed640 1 --2- 172.21.15.123:0/3329984701 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe9bc162490 0x7fe9bc0c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:13.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.418+0000 7fe9bb7fe640 1 -- 172.21.15.123:0/3329984701 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe9bc0b66b0 msgr2=0x7fe9bc1575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:13.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.418+0000 7fe9bb7fe640 1 --2- 172.21.15.123:0/3329984701 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe9bc0b66b0 0x7fe9bc1575c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:13.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.418+0000 7fe9bb7fe640 1 -- 172.21.15.123:0/3329984701 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe9bc162490 msgr2=0x7fe9bc0c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:13.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.418+0000 7fe9bb7fe640 1 --2- 172.21.15.123:0/3329984701 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe9bc162490 0x7fe9bc0c9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:13.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.418+0000 7fe9bb7fe640 1 -- 172.21.15.123:0/3329984701 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9bc0ca850 con 0x7fe9bc15eab0 2024-09-15T23:12:13.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.419+0000 7fe9bb7fe640 1 --2- 172.21.15.123:0/3329984701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9bc15eab0 0x7fe9bc0c9940 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0000c00 tx=0x7fe9b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:13.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.419+0000 7fe9b8ff9640 1 -- 172.21.15.123:0/3329984701 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b0037040 con 0x7fe9bc15eab0 2024-09-15T23:12:13.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.419+0000 7fe9b8ff9640 1 -- 172.21.15.123:0/3329984701 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9b0030770 con 0x7fe9bc15eab0 2024-09-15T23:12:13.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.419+0000 7fe9c2a50640 1 -- 172.21.15.123:0/3329984701 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9bc0cab30 con 0x7fe9bc15eab0 2024-09-15T23:12:13.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.419+0000 7fe9b8ff9640 1 -- 172.21.15.123:0/3329984701 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b0030b40 con 0x7fe9bc15eab0 2024-09-15T23:12:13.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.419+0000 7fe9c2a50640 1 -- 172.21.15.123:0/3329984701 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9bc157cd0 con 0x7fe9bc15eab0 2024-09-15T23:12:13.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.420+0000 7fe9c2a50640 1 -- 172.21.15.123:0/3329984701 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9bc0cebb0 con 0x7fe9bc15eab0 2024-09-15T23:12:13.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.420+0000 7fe9b8ff9640 1 -- 172.21.15.123:0/3329984701 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe9b0044020 con 0x7fe9bc15eab0 2024-09-15T23:12:13.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.421+0000 7fe9b8ff9640 1 --2- 172.21.15.123:0/3329984701 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe9a806c2b0 0x7fe9a806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:13.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.421+0000 7fe9b8ff9640 1 -- 172.21.15.123:0/3329984701 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe9b00ab850 con 0x7fe9bc15eab0 2024-09-15T23:12:13.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.421+0000 7fe9bbfff640 1 --2- 172.21.15.123:0/3329984701 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe9a806c2b0 0x7fe9a806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:13.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.421+0000 7fe9bbfff640 1 --2- 172.21.15.123:0/3329984701 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe9a806c2b0 0x7fe9a806e770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac00b840 tx=0x7fe9ac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:13.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.425+0000 7fe9b8ff9640 1 -- 172.21.15.123:0/3329984701 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe9b004b020 con 0x7fe9bc15eab0 2024-09-15T23:12:13.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.593+0000 7fe9c2a50640 1 -- 172.21.15.123:0/3329984701 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe9bc0d2500 con 0x7fe9bc15eab0 2024-09-15T23:12:13.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.595+0000 7fe9b8ff9640 1 -- 172.21.15.123:0/3329984701 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16706 (secure 0 0 0) 0x7fe9b0079f30 con 0x7fe9bc15eab0 2024-09-15T23:12:13.596 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:13.596 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":21,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:12:12.622302+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:12:10.289254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:12:11.594152+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:12:13.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.597+0000 7fe9c2a50640 1 -- 172.21.15.123:0/3329984701 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe9a806c2b0 msgr2=0x7fe9a806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:13.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.597+0000 7fe9c2a50640 1 --2- 172.21.15.123:0/3329984701 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe9a806c2b0 0x7fe9a806e770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac00b840 tx=0x7fe9ac008040 comp rx=0 tx=0).stop 2024-09-15T23:12:13.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.597+0000 7fe9c2a50640 1 -- 172.21.15.123:0/3329984701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9bc15eab0 msgr2=0x7fe9bc0c9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:13.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.597+0000 7fe9c2a50640 1 --2- 172.21.15.123:0/3329984701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9bc15eab0 0x7fe9bc0c9940 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0000c00 tx=0x7fe9b00046c0 comp rx=0 tx=0).stop 2024-09-15T23:12:13.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.597+0000 7fe9c2a50640 1 -- 172.21.15.123:0/3329984701 shutdown_connections 2024-09-15T23:12:13.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.597+0000 7fe9c2a50640 1 --2- 172.21.15.123:0/3329984701 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe9bc162490 0x7fe9bc0c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:13.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.597+0000 7fe9c2a50640 1 --2- 172.21.15.123:0/3329984701 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe9a806c2b0 0x7fe9a806e770 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:13.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.597+0000 7fe9c2a50640 1 --2- 172.21.15.123:0/3329984701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9bc15eab0 0x7fe9bc0c9940 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:13.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.597+0000 7fe9c2a50640 1 --2- 172.21.15.123:0/3329984701 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe9bc0b66b0 0x7fe9bc1575c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:13.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.597+0000 7fe9c2a50640 1 -- 172.21.15.123:0/3329984701 >> 172.21.15.123:0/3329984701 conn(0x7fe9bc0d16d0 msgr2=0x7fe9bc0b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:13.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.597+0000 7fe9c2a50640 1 -- 172.21.15.123:0/3329984701 shutdown_connections 2024-09-15T23:12:13.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.597+0000 7fe9c2a50640 1 -- 172.21.15.123:0/3329984701 wait complete. 2024-09-15T23:12:13.608 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:12:13.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.705+0000 7fc4adcf8640 1 Processor -- start 2024-09-15T23:12:13.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.705+0000 7fc4adcf8640 1 -- start start 2024-09-15T23:12:13.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.706+0000 7fc4adcf8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc4a815c420 0x7fc4a8160a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:13.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.706+0000 7fc4adcf8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc4a80d2c30 0x7fc4a80d0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:13.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.706+0000 7fc4adcf8640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4a8071b60 con 0x7fc4a80b1990 2024-09-15T23:12:13.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.706+0000 7fc4adcf8640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc4a80d04c0 con 0x7fc4a815c420 2024-09-15T23:12:13.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.706+0000 7fc4adcf8640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fc4a80715a0 con 0x7fc4a80d2c30 2024-09-15T23:12:13.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.706+0000 7fc4a77fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc4a815c420 0x7fc4a8160a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:13.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.706+0000 7fc4a77fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc4a815c420 0x7fc4a8160a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56298/0 (socket says 172.21.15.123:56298) 2024-09-15T23:12:13.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.706+0000 7fc4a77fe640 1 -- 172.21.15.123:0/1524453787 learned_addr learned my addr 172.21.15.123:0/1524453787 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:13.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.706+0000 7fc4a77fe640 1 -- 172.21.15.123:0/1524453787 >> v2:172.21.15.188:3300/0 conn(0x7fc4a80d2c30 msgr2=0x7fc4a80d0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:13.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.706+0000 7fc4a77fe640 1 --2- 172.21.15.123:0/1524453787 >> v2:172.21.15.188:3300/0 conn(0x7fc4a80d2c30 0x7fc4a80d0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:13.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.706+0000 7fc4a77fe640 1 -- 172.21.15.123:0/1524453787 >> v1:172.21.15.188:6789/0 conn(0x7fc4a80b1990 legacy=0x7fc4a80d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:13.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.706+0000 7fc4a77fe640 1 -- 172.21.15.123:0/1524453787 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4a8071880 con 0x7fc4a815c420 2024-09-15T23:12:13.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.707+0000 7fc4a77fe640 1 --2- 172.21.15.123:0/1524453787 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4a815c420 0x7fc4a8160a40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc4a80d0640 tx=0x7fc49802a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2039c28cdf6e2a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:13.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.707+0000 7fc4a67fc640 1 -- 172.21.15.123:0/1524453787 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc498036070 con 0x7fc4a815c420 2024-09-15T23:12:13.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.707+0000 7fc4a67fc640 1 -- 172.21.15.123:0/1524453787 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc498031600 con 0x7fc4a815c420 2024-09-15T23:12:13.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.707+0000 7fc4a67fc640 1 -- 172.21.15.123:0/1524453787 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4980319d0 con 0x7fc4a815c420 2024-09-15T23:12:13.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.708+0000 7fc4adcf8640 1 -- 172.21.15.123:0/1524453787 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4a815c420 msgr2=0x7fc4a8160a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:13.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.708+0000 7fc4adcf8640 1 --2- 172.21.15.123:0/1524453787 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4a815c420 0x7fc4a8160a40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc4a80d0640 tx=0x7fc49802a640 comp rx=0 tx=0).stop 2024-09-15T23:12:13.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.708+0000 7fc4adcf8640 1 -- 172.21.15.123:0/1524453787 shutdown_connections 2024-09-15T23:12:13.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.708+0000 7fc4adcf8640 1 --2- 172.21.15.123:0/1524453787 >> v2:172.21.15.188:3300/0 conn(0x7fc4a80d2c30 0x7fc4a80d0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:13.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.708+0000 7fc4adcf8640 1 --2- 172.21.15.123:0/1524453787 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4a815c420 0x7fc4a8160a40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:13.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.708+0000 7fc4adcf8640 1 -- 172.21.15.123:0/1524453787 >> 172.21.15.123:0/1524453787 conn(0x7fc4a8067fb0 msgr2=0x7fc4a806f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:13.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.708+0000 7fc4adcf8640 1 -- 172.21.15.123:0/1524453787 shutdown_connections 2024-09-15T23:12:13.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.708+0000 7fc4adcf8640 1 -- 172.21.15.123:0/1524453787 wait complete. 2024-09-15T23:12:13.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.709+0000 7fc4adcf8640 1 Processor -- start 2024-09-15T23:12:13.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.709+0000 7fc4adcf8640 1 -- start start 2024-09-15T23:12:13.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.710+0000 7fc4adcf8640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4a80b1990 0x7fc4a814dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:13.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.710+0000 7fc4adcf8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4a80d2c30 0x7fc4a815b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:13.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.710+0000 7fc4adcf8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4a815c420 0x7fc4a815b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:13.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.710+0000 7fc4adcf8640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a80d0e90 con 0x7fc4a815c420 2024-09-15T23:12:13.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.710+0000 7fc4adcf8640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a815c800 con 0x7fc4a80d2c30 2024-09-15T23:12:13.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.710+0000 7fc4adcf8640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc4a80d1010 con 0x7fc4a80b1990 2024-09-15T23:12:13.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.710+0000 7fc4a7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4a815c420 0x7fc4a815b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:13.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.710+0000 7fc4a7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4a815c420 0x7fc4a815b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56302/0 (socket says 172.21.15.123:56302) 2024-09-15T23:12:13.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.710+0000 7fc4a7fff640 1 -- 172.21.15.123:0/685259986 learned_addr learned my addr 172.21.15.123:0/685259986 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:13.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.710+0000 7fc4a6ffd640 1 --2- 172.21.15.123:0/685259986 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4a80d2c30 0x7fc4a815b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:13.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.710+0000 7fc4a7fff640 1 -- 172.21.15.123:0/685259986 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4a80b1990 msgr2=0x7fc4a814dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:13.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.710+0000 7fc4a7fff640 1 --2- 172.21.15.123:0/685259986 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4a80b1990 0x7fc4a814dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:13.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.710+0000 7fc4a7fff640 1 -- 172.21.15.123:0/685259986 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4a80d2c30 msgr2=0x7fc4a815b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:13.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.710+0000 7fc4a7fff640 1 --2- 172.21.15.123:0/685259986 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4a80d2c30 0x7fc4a815b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:13.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.710+0000 7fc4a7fff640 1 -- 172.21.15.123:0/685259986 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4a814e000 con 0x7fc4a815c420 2024-09-15T23:12:13.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.710+0000 7fc4a6ffd640 1 --2- 172.21.15.123:0/685259986 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4a80d2c30 0x7fc4a815b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:13.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.711+0000 7fc4a7fff640 1 --2- 172.21.15.123:0/685259986 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4a815c420 0x7fc4a815b8d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0009fd0 tx=0x7fc4a000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:13.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.711+0000 7fc48ffff640 1 -- 172.21.15.123:0/685259986 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a0011830 con 0x7fc4a815c420 2024-09-15T23:12:13.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.711+0000 7fc48ffff640 1 -- 172.21.15.123:0/685259986 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4a0016070 con 0x7fc4a815c420 2024-09-15T23:12:13.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.711+0000 7fc48ffff640 1 -- 172.21.15.123:0/685259986 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a0011bf0 con 0x7fc4a815c420 2024-09-15T23:12:13.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.711+0000 7fc4adcf8640 1 -- 172.21.15.123:0/685259986 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4a8151ce0 con 0x7fc4a815c420 2024-09-15T23:12:13.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.711+0000 7fc4adcf8640 1 -- 172.21.15.123:0/685259986 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4a81522a0 con 0x7fc4a815c420 2024-09-15T23:12:13.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.712+0000 7fc4adcf8640 1 -- 172.21.15.123:0/685259986 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4a80d0930 con 0x7fc4a815c420 2024-09-15T23:12:13.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.712+0000 7fc48ffff640 1 -- 172.21.15.123:0/685259986 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc4a001b460 con 0x7fc4a815c420 2024-09-15T23:12:13.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.712+0000 7fc48ffff640 1 --2- 172.21.15.123:0/685259986 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc49406c2b0 0x7fc49406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:13.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.713+0000 7fc48ffff640 1 -- 172.21.15.123:0/685259986 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc4a008b0c0 con 0x7fc4a815c420 2024-09-15T23:12:13.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.713+0000 7fc4a77fe640 1 --2- 172.21.15.123:0/685259986 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc49406c2b0 0x7fc49406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:13.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.713+0000 7fc4a77fe640 1 --2- 172.21.15.123:0/685259986 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc49406c2b0 0x7fc49406e770 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc498033000 tx=0x7fc49802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:13.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.717+0000 7fc48ffff640 1 -- 172.21.15.123:0/685259986 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc4a00598c0 con 0x7fc4a815c420 2024-09-15T23:12:13.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.884+0000 7fc4adcf8640 1 -- 172.21.15.123:0/685259986 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc4a80b77f0 con 0x7fc4a815c420 2024-09-15T23:12:13.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.885+0000 7fc48ffff640 1 -- 172.21.15.123:0/685259986 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16706 (secure 0 0 0) 0x7fc4a00591c0 con 0x7fc4a815c420 2024-09-15T23:12:13.887 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:13.887 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":21,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:12:12.622302+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:12:10.289254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:12:11.594152+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:12:13.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.887+0000 7fc4adcf8640 1 -- 172.21.15.123:0/685259986 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc49406c2b0 msgr2=0x7fc49406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:13.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.887+0000 7fc4adcf8640 1 --2- 172.21.15.123:0/685259986 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc49406c2b0 0x7fc49406e770 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc498033000 tx=0x7fc49802e000 comp rx=0 tx=0).stop 2024-09-15T23:12:13.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.888+0000 7fc4adcf8640 1 -- 172.21.15.123:0/685259986 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4a815c420 msgr2=0x7fc4a815b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:13.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.888+0000 7fc4adcf8640 1 --2- 172.21.15.123:0/685259986 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4a815c420 0x7fc4a815b8d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0009fd0 tx=0x7fc4a000b8e0 comp rx=0 tx=0).stop 2024-09-15T23:12:13.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.888+0000 7fc4adcf8640 1 -- 172.21.15.123:0/685259986 shutdown_connections 2024-09-15T23:12:13.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.888+0000 7fc4adcf8640 1 --2- 172.21.15.123:0/685259986 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc49406c2b0 0x7fc49406e770 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:13.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.888+0000 7fc4adcf8640 1 --2- 172.21.15.123:0/685259986 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4a815c420 0x7fc4a815b8d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:13.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.888+0000 7fc4adcf8640 1 --2- 172.21.15.123:0/685259986 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4a80d2c30 0x7fc4a815b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:13.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.888+0000 7fc4adcf8640 1 --2- 172.21.15.123:0/685259986 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4a80b1990 0x7fc4a814dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:13.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.888+0000 7fc4adcf8640 1 -- 172.21.15.123:0/685259986 >> 172.21.15.123:0/685259986 conn(0x7fc4a8067fb0 msgr2=0x7fc4a80d1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:13.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.888+0000 7fc4adcf8640 1 -- 172.21.15.123:0/685259986 shutdown_connections 2024-09-15T23:12:13.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.888+0000 7fc4adcf8640 1 -- 172.21.15.123:0/685259986 wait complete. 2024-09-15T23:12:13.899 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T23:12:14.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.999+0000 7f4b26427640 1 Processor -- start 2024-09-15T23:12:14.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:13.999+0000 7f4b26427640 1 -- start start 2024-09-15T23:12:14.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.000+0000 7f4b26427640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4b20158920 0x7f4b20073ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:14.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.000+0000 7f4b26427640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b20158d00 con 0x7f4b2006c320 2024-09-15T23:12:14.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.000+0000 7f4b26427640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b200ce0f0 con 0x7f4b20070f40 2024-09-15T23:12:14.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.000+0000 7f4b26427640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f4b20072130 con 0x7f4b20158920 2024-09-15T23:12:14.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.000+0000 7f4b1ffff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4b20158920 0x7f4b20073ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:14.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.000+0000 7f4b249c4640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f4b2006c320 0x7f4b2015b2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:44754/0 (socket says 172.21.15.123:44754) 2024-09-15T23:12:14.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.000+0000 7f4b1ffff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4b20158920 0x7f4b20073ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56316/0 (socket says 172.21.15.123:56316) 2024-09-15T23:12:14.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.000+0000 7f4b249c4640 1 -- 172.21.15.123:0/325695339 learned_addr learned my addr 172.21.15.123:0/325695339 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:14.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.001+0000 7f4b1ffff640 1 -- 172.21.15.123:0/325695339 >> v1:172.21.15.188:6789/0 conn(0x7f4b20070f40 legacy=0x7f4b2006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:14.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.001+0000 7f4b1ffff640 1 -- 172.21.15.123:0/325695339 >> v1:172.21.15.123:6789/0 conn(0x7f4b2006c320 legacy=0x7f4b2015b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:14.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.001+0000 7f4b1ffff640 1 -- 172.21.15.123:0/325695339 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b20071500 con 0x7f4b20158920 2024-09-15T23:12:14.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.001+0000 7f4b1effd640 1 -- 172.21.15.123:0/325695339 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3848906738 0 0) 0x7f4b18001490 con 0x7f4b2006c320 2024-09-15T23:12:14.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.001+0000 7f4b1ffff640 1 --2- 172.21.15.123:0/325695339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b20158920 0x7f4b20073ac0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4b1000a940 tx=0x7f4b1002b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c26c6cbbaf1a290 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:14.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.001+0000 7f4b1effd640 1 -- 172.21.15.123:0/325695339 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1000b040 con 0x7f4b20158920 2024-09-15T23:12:14.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.001+0000 7f4b1effd640 1 -- 172.21.15.123:0/325695339 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b10030710 con 0x7f4b20158920 2024-09-15T23:12:14.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.001+0000 7f4b1effd640 1 -- 172.21.15.123:0/325695339 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b10030ae0 con 0x7f4b20158920 2024-09-15T23:12:14.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.002+0000 7f4b26427640 1 -- 172.21.15.123:0/325695339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b20158920 msgr2=0x7f4b20073ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:14.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.002+0000 7f4b26427640 1 --2- 172.21.15.123:0/325695339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b20158920 0x7f4b20073ac0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4b1000a940 tx=0x7f4b1002b480 comp rx=0 tx=0).stop 2024-09-15T23:12:14.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.002+0000 7f4b26427640 1 -- 172.21.15.123:0/325695339 shutdown_connections 2024-09-15T23:12:14.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.002+0000 7f4b26427640 1 --2- 172.21.15.123:0/325695339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b20158920 0x7f4b20073ac0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:14.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.002+0000 7f4b26427640 1 -- 172.21.15.123:0/325695339 >> 172.21.15.123:0/325695339 conn(0x7f4b2006d0f0 msgr2=0x7f4b2006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:14.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.002+0000 7f4b26427640 1 -- 172.21.15.123:0/325695339 shutdown_connections 2024-09-15T23:12:14.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.002+0000 7f4b26427640 1 -- 172.21.15.123:0/325695339 wait complete. 2024-09-15T23:12:14.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.003+0000 7f4b26427640 1 Processor -- start 2024-09-15T23:12:14.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.003+0000 7f4b26427640 1 -- start start 2024-09-15T23:12:14.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.004+0000 7f4b26427640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4b2006c320 0x7f4b20151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:14.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.004+0000 7f4b26427640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b20070f40 0x7f4b20154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:14.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.004+0000 7f4b26427640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b20158920 0x7f4b2015d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:14.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.004+0000 7f4b26427640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2006cc30 con 0x7f4b20070f40 2024-09-15T23:12:14.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.004+0000 7f4b26427640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4b20071dc0 con 0x7f4b20158920 2024-09-15T23:12:14.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.004+0000 7f4b26427640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4b200725c0 con 0x7f4b2006c320 2024-09-15T23:12:14.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.004+0000 7f4b1f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b20070f40 0x7f4b20154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:14.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.004+0000 7f4b1f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b20070f40 0x7f4b20154de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56328/0 (socket says 172.21.15.123:56328) 2024-09-15T23:12:14.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.004+0000 7f4b1f7fe640 1 -- 172.21.15.123:0/283495174 learned_addr learned my addr 172.21.15.123:0/283495174 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:14.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.004+0000 7f4b249c4640 1 --2- 172.21.15.123:0/283495174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b20158920 0x7f4b2015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:14.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.004+0000 7f4b1ffff640 1 --2- 172.21.15.123:0/283495174 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4b2006c320 0x7f4b20151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:14.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.004+0000 7f4b1f7fe640 1 -- 172.21.15.123:0/283495174 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4b2006c320 msgr2=0x7f4b20151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:14.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.004+0000 7f4b1f7fe640 1 --2- 172.21.15.123:0/283495174 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4b2006c320 0x7f4b20151810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:14.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.004+0000 7f4b1f7fe640 1 -- 172.21.15.123:0/283495174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b20158920 msgr2=0x7f4b2015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:14.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.004+0000 7f4b1f7fe640 1 --2- 172.21.15.123:0/283495174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b20158920 0x7f4b2015d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:14.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.004+0000 7f4b1f7fe640 1 -- 172.21.15.123:0/283495174 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b20155320 con 0x7f4b20070f40 2024-09-15T23:12:14.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.004+0000 7f4b249c4640 1 --2- 172.21.15.123:0/283495174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b20158920 0x7f4b2015d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:14.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.005+0000 7f4b1f7fe640 1 --2- 172.21.15.123:0/283495174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b20070f40 0x7f4b20154de0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400c430 tx=0x7f4b1400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:14.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.005+0000 7f4b1cff9640 1 -- 172.21.15.123:0/283495174 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b14011790 con 0x7f4b20070f40 2024-09-15T23:12:14.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.005+0000 7f4b1cff9640 1 -- 172.21.15.123:0/283495174 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b14017070 con 0x7f4b20070f40 2024-09-15T23:12:14.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.005+0000 7f4b26427640 1 -- 172.21.15.123:0/283495174 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b20151ed0 con 0x7f4b20070f40 2024-09-15T23:12:14.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.005+0000 7f4b1cff9640 1 -- 172.21.15.123:0/283495174 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b14011bb0 con 0x7f4b20070f40 2024-09-15T23:12:14.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.005+0000 7f4b26427640 1 -- 172.21.15.123:0/283495174 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b20152490 con 0x7f4b20070f40 2024-09-15T23:12:14.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.006+0000 7f4b26427640 1 -- 172.21.15.123:0/283495174 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b20073ac0 con 0x7f4b20070f40 2024-09-15T23:12:14.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.006+0000 7f4b1cff9640 1 -- 172.21.15.123:0/283495174 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4b1401c460 con 0x7f4b20070f40 2024-09-15T23:12:14.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.007+0000 7f4b1cff9640 1 --2- 172.21.15.123:0/283495174 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4b0c06c2e0 0x7f4b0c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:14.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.007+0000 7f4b1cff9640 1 -- 172.21.15.123:0/283495174 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4b1408b2e0 con 0x7f4b20070f40 2024-09-15T23:12:14.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.007+0000 7f4b1ffff640 1 --2- 172.21.15.123:0/283495174 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4b0c06c2e0 0x7f4b0c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:14.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.007+0000 7f4b1ffff640 1 --2- 172.21.15.123:0/283495174 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4b0c06c2e0 0x7f4b0c06e7a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4b10035000 tx=0x7f4b1000c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:14.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.011+0000 7f4b1cff9640 1 -- 172.21.15.123:0/283495174 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4b14059a50 con 0x7f4b20070f40 2024-09-15T23:12:14.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.210+0000 7f4b26427640 1 -- 172.21.15.123:0/283495174 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f4b20153620 con 0x7f4b20070f40 2024-09-15T23:12:14.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.297+0000 7f4b1cff9640 1 -- 172.21.15.123:0/283495174 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7f4b14059350 con 0x7f4b20070f40 2024-09-15T23:12:14.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.300+0000 7f4b26427640 1 -- 172.21.15.123:0/283495174 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4b0c06c2e0 msgr2=0x7f4b0c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:14.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.300+0000 7f4b26427640 1 --2- 172.21.15.123:0/283495174 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4b0c06c2e0 0x7f4b0c06e7a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4b10035000 tx=0x7f4b1000c040 comp rx=0 tx=0).stop 2024-09-15T23:12:14.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.300+0000 7f4b26427640 1 -- 172.21.15.123:0/283495174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b20070f40 msgr2=0x7f4b20154de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:14.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.300+0000 7f4b26427640 1 --2- 172.21.15.123:0/283495174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b20070f40 0x7f4b20154de0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400c430 tx=0x7f4b1400c8f0 comp rx=0 tx=0).stop 2024-09-15T23:12:14.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.300+0000 7f4b26427640 1 -- 172.21.15.123:0/283495174 shutdown_connections 2024-09-15T23:12:14.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.300+0000 7f4b26427640 1 --2- 172.21.15.123:0/283495174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b20158920 0x7f4b2015d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:14.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.300+0000 7f4b26427640 1 --2- 172.21.15.123:0/283495174 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4b0c06c2e0 0x7f4b0c06e7a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:14.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.300+0000 7f4b26427640 1 --2- 172.21.15.123:0/283495174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b20070f40 0x7f4b20154de0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:14.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.300+0000 7f4b26427640 1 --2- 172.21.15.123:0/283495174 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4b2006c320 0x7f4b20151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:14.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.300+0000 7f4b26427640 1 -- 172.21.15.123:0/283495174 >> 172.21.15.123:0/283495174 conn(0x7f4b2006d0f0 msgr2=0x7f4b200b2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:14.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.300+0000 7f4b26427640 1 -- 172.21.15.123:0/283495174 shutdown_connections 2024-09-15T23:12:14.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.300+0000 7f4b26427640 1 -- 172.21.15.123:0/283495174 wait complete. 2024-09-15T23:12:14.312 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T23:12:14.312 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T23:12:14.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.411+0000 7f91c7f98640 1 Processor -- start 2024-09-15T23:12:14.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.411+0000 7f91c7f98640 1 -- start start 2024-09-15T23:12:14.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.412+0000 7f91c7f98640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f91c015b7c0 0x7f91c0072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:14.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.412+0000 7f91c7f98640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f91c0073800 0x7f91c00cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:14.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.412+0000 7f91c7f98640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f91c006e200 0x7f91c006e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:14.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.412+0000 7f91c7f98640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f91c006eb50 con 0x7f91c015b7c0 2024-09-15T23:12:14.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.412+0000 7f91c7f98640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f91c0072760 con 0x7f91c0073800 2024-09-15T23:12:14.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.412+0000 7f91c7f98640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f91c0072a40 con 0x7f91c006e200 2024-09-15T23:12:14.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.412+0000 7f91c5d34640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f91c015b7c0 0x7f91c0072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:14.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.412+0000 7f91c5d34640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f91c015b7c0 0x7f91c0072160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56336/0 (socket says 172.21.15.123:56336) 2024-09-15T23:12:14.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.412+0000 7f91c5d34640 1 -- 172.21.15.123:0/61808280 learned_addr learned my addr 172.21.15.123:0/61808280 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:14.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.412+0000 7f91c5533640 1 --2- 172.21.15.123:0/61808280 >> v2:172.21.15.188:3300/0 conn(0x7f91c0073800 0x7f91c00cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:14.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.412+0000 7f91c6535640 1 --2- 172.21.15.123:0/61808280 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f91c006e200 0x7f91c006e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:14.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.412+0000 7f91c5d34640 1 -- 172.21.15.123:0/61808280 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f91c006e200 msgr2=0x7f91c006e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:14.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.412+0000 7f91c5d34640 1 --2- 172.21.15.123:0/61808280 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f91c006e200 0x7f91c006e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:14.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.412+0000 7f91c5d34640 1 -- 172.21.15.123:0/61808280 >> v2:172.21.15.188:3300/0 conn(0x7f91c0073800 msgr2=0x7f91c00cc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:14.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.412+0000 7f91c5d34640 1 --2- 172.21.15.123:0/61808280 >> v2:172.21.15.188:3300/0 conn(0x7f91c0073800 0x7f91c00cc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:14.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.412+0000 7f91c5d34640 1 -- 172.21.15.123:0/61808280 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c0072d20 con 0x7f91c015b7c0 2024-09-15T23:12:14.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.412+0000 7f91c6535640 1 --2- 172.21.15.123:0/61808280 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f91c006e200 0x7f91c006e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:14.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.413+0000 7f91c5d34640 1 --2- 172.21.15.123:0/61808280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91c015b7c0 0x7f91c0072160 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f91c00c8530 tx=0x7f91bc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5e435cb3b812508 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:14.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.413+0000 7f91c4d32640 1 -- 172.21.15.123:0/61808280 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91bc037070 con 0x7f91c015b7c0 2024-09-15T23:12:14.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.413+0000 7f91c4d32640 1 -- 172.21.15.123:0/61808280 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91bc032440 con 0x7f91c015b7c0 2024-09-15T23:12:14.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.413+0000 7f91c4d32640 1 -- 172.21.15.123:0/61808280 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91bc032810 con 0x7f91c015b7c0 2024-09-15T23:12:14.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.414+0000 7f91c7f98640 1 -- 172.21.15.123:0/61808280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91c015b7c0 msgr2=0x7f91c0072160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:14.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.414+0000 7f91c7f98640 1 --2- 172.21.15.123:0/61808280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91c015b7c0 0x7f91c0072160 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f91c00c8530 tx=0x7f91bc02a1e0 comp rx=0 tx=0).stop 2024-09-15T23:12:14.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.414+0000 7f91c7f98640 1 -- 172.21.15.123:0/61808280 shutdown_connections 2024-09-15T23:12:14.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.414+0000 7f91c7f98640 1 --2- 172.21.15.123:0/61808280 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f91c006e200 0x7f91c006e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:14.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.414+0000 7f91c7f98640 1 --2- 172.21.15.123:0/61808280 >> v2:172.21.15.188:3300/0 conn(0x7f91c0073800 0x7f91c00cc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:14.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.414+0000 7f91c7f98640 1 --2- 172.21.15.123:0/61808280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91c015b7c0 0x7f91c0072160 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:14.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.414+0000 7f91c7f98640 1 -- 172.21.15.123:0/61808280 >> 172.21.15.123:0/61808280 conn(0x7f91c00d14d0 msgr2=0x7f91c00d18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:14.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.414+0000 7f91c7f98640 1 -- 172.21.15.123:0/61808280 shutdown_connections 2024-09-15T23:12:14.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.414+0000 7f91c7f98640 1 -- 172.21.15.123:0/61808280 wait complete. 2024-09-15T23:12:14.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.415+0000 7f91c7f98640 1 Processor -- start 2024-09-15T23:12:14.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.415+0000 7f91c7f98640 1 -- start start 2024-09-15T23:12:14.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.416+0000 7f91c7f98640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f91c006e200 0x7f91c00cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:14.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.416+0000 7f91c7f98640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91c0073800 0x7f91c0159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:14.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.416+0000 7f91c7f98640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f91c015b7c0 0x7f91c00b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:14.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.416+0000 7f91c7f98640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f91c00ccae0 con 0x7f91c0073800 2024-09-15T23:12:14.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.416+0000 7f91c7f98640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f91c00732e0 con 0x7f91c015b7c0 2024-09-15T23:12:14.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.416+0000 7f91c7f98640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f91c00ccc60 con 0x7f91c006e200 2024-09-15T23:12:14.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.416+0000 7f91c5533640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91c0073800 0x7f91c0159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:14.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.416+0000 7f91c5533640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91c0073800 0x7f91c0159a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56348/0 (socket says 172.21.15.123:56348) 2024-09-15T23:12:14.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.416+0000 7f91c5533640 1 -- 172.21.15.123:0/2407069987 learned_addr learned my addr 172.21.15.123:0/2407069987 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:14.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.416+0000 7f91c5d34640 1 --2- 172.21.15.123:0/2407069987 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f91c006e200 0x7f91c00cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:14.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.416+0000 7f91c6535640 1 --2- 172.21.15.123:0/2407069987 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f91c015b7c0 0x7f91c00b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:14.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.416+0000 7f91c5533640 1 -- 172.21.15.123:0/2407069987 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f91c006e200 msgr2=0x7f91c00cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:14.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.416+0000 7f91c5533640 1 --2- 172.21.15.123:0/2407069987 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f91c006e200 0x7f91c00cbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:14.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.416+0000 7f91c5533640 1 -- 172.21.15.123:0/2407069987 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f91c015b7c0 msgr2=0x7f91c00b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:14.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.416+0000 7f91c5533640 1 --2- 172.21.15.123:0/2407069987 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f91c015b7c0 0x7f91c00b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:14.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.416+0000 7f91c5533640 1 -- 172.21.15.123:0/2407069987 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c015e9b0 con 0x7f91c0073800 2024-09-15T23:12:14.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.416+0000 7f91c5533640 1 --2- 172.21.15.123:0/2407069987 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91c0073800 0x7f91c0159a60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f91b0006e80 tx=0x7f91b000ff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:14.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.416+0000 7f91b67fc640 1 -- 172.21.15.123:0/2407069987 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b0007c90 con 0x7f91c0073800 2024-09-15T23:12:14.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.416+0000 7f91b67fc640 1 -- 172.21.15.123:0/2407069987 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91b0017070 con 0x7f91c0073800 2024-09-15T23:12:14.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.416+0000 7f91b67fc640 1 -- 172.21.15.123:0/2407069987 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b0011690 con 0x7f91c0073800 2024-09-15T23:12:14.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.416+0000 7f91c7f98640 1 -- 172.21.15.123:0/2407069987 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91c015ec90 con 0x7f91c0073800 2024-09-15T23:12:14.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.416+0000 7f91c7f98640 1 -- 172.21.15.123:0/2407069987 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91c015ab00 con 0x7f91c0073800 2024-09-15T23:12:14.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.417+0000 7f91c7f98640 1 -- 172.21.15.123:0/2407069987 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91c00cc5a0 con 0x7f91c0073800 2024-09-15T23:12:14.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.418+0000 7f91b67fc640 1 -- 172.21.15.123:0/2407069987 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f91b0011830 con 0x7f91c0073800 2024-09-15T23:12:14.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.418+0000 7f91b67fc640 1 --2- 172.21.15.123:0/2407069987 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f91a406c2b0 0x7f91a406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:14.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.418+0000 7f91b67fc640 1 -- 172.21.15.123:0/2407069987 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f91b008db10 con 0x7f91c0073800 2024-09-15T23:12:14.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.418+0000 7f91c5d34640 1 --2- 172.21.15.123:0/2407069987 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f91a406c2b0 0x7f91a406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:14.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.419+0000 7f91c5d34640 1 --2- 172.21.15.123:0/2407069987 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f91a406c2b0 0x7f91a406e770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f91bc034000 tx=0x7f91bc02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:14.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.422+0000 7f91b67fc640 1 -- 172.21.15.123:0/2407069987 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f91b005bc30 con 0x7f91c0073800 2024-09-15T23:12:14.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:14.621+0000 7f91c7f98640 1 -- 172.21.15.123:0/2407069987 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f91c00741d0 con 0x7f91c0073800 2024-09-15T23:12:15.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.307+0000 7f91b67fc640 1 -- 172.21.15.123:0/2407069987 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7f91b005ff30 con 0x7f91c0073800 2024-09-15T23:12:15.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.310+0000 7f91c7f98640 1 -- 172.21.15.123:0/2407069987 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f91a406c2b0 msgr2=0x7f91a406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:15.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.310+0000 7f91c7f98640 1 --2- 172.21.15.123:0/2407069987 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f91a406c2b0 0x7f91a406e770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f91bc034000 tx=0x7f91bc02e000 comp rx=0 tx=0).stop 2024-09-15T23:12:15.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.310+0000 7f91c7f98640 1 -- 172.21.15.123:0/2407069987 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91c0073800 msgr2=0x7f91c0159a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:15.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.310+0000 7f91c7f98640 1 --2- 172.21.15.123:0/2407069987 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91c0073800 0x7f91c0159a60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f91b0006e80 tx=0x7f91b000ff00 comp rx=0 tx=0).stop 2024-09-15T23:12:15.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.310+0000 7f91c7f98640 1 -- 172.21.15.123:0/2407069987 shutdown_connections 2024-09-15T23:12:15.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.310+0000 7f91c7f98640 1 --2- 172.21.15.123:0/2407069987 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f91c015b7c0 0x7f91c00b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:15.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.310+0000 7f91c7f98640 1 --2- 172.21.15.123:0/2407069987 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f91a406c2b0 0x7f91a406e770 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:15.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.310+0000 7f91c7f98640 1 --2- 172.21.15.123:0/2407069987 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91c0073800 0x7f91c0159a60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:15.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.310+0000 7f91c7f98640 1 --2- 172.21.15.123:0/2407069987 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f91c006e200 0x7f91c00cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:15.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.310+0000 7f91c7f98640 1 -- 172.21.15.123:0/2407069987 >> 172.21.15.123:0/2407069987 conn(0x7f91c00d14d0 msgr2=0x7f91c00b4ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:15.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.310+0000 7f91c7f98640 1 -- 172.21.15.123:0/2407069987 shutdown_connections 2024-09-15T23:12:15.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.310+0000 7f91c7f98640 1 -- 172.21.15.123:0/2407069987 wait complete. 2024-09-15T23:12:15.324 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T23:12:15.324 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:12:15.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.428+0000 7f5ec4103640 1 Processor -- start 2024-09-15T23:12:15.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.428+0000 7f5ec4103640 1 -- start start 2024-09-15T23:12:15.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.429+0000 7f5ec4103640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f5ebc162490 0x7f5ebc15ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:15.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.429+0000 7f5ec4103640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5ebc0b66b0 0x7f5ebc0b6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:15.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.429+0000 7f5ec4103640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ebc0b7000 con 0x7f5ebc15eab0 2024-09-15T23:12:15.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.429+0000 7f5ec4103640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f5ebc15f570 con 0x7f5ebc0b66b0 2024-09-15T23:12:15.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.429+0000 7f5ec4103640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f5ebc15f850 con 0x7f5ebc162490 2024-09-15T23:12:15.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.429+0000 7f5ec1e9f640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f5ebc15eab0 0x7f5ebc0d2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:44762/0 (socket says 172.21.15.123:44762) 2024-09-15T23:12:15.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.429+0000 7f5ec1e9f640 1 -- 172.21.15.123:0/4025204484 learned_addr learned my addr 172.21.15.123:0/4025204484 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:15.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.429+0000 7f5ec26a0640 1 --2- 172.21.15.123:0/4025204484 >> v2:172.21.15.123:3300/0 conn(0x7f5ebc0b66b0 0x7f5ebc0b6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:15.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.429+0000 7f5ec169e640 1 --2- 172.21.15.123:0/4025204484 >> v2:172.21.15.188:3300/0 conn(0x7f5ebc162490 0x7f5ebc15ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:15.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.429+0000 7f5ec0e9d640 1 -- 172.21.15.123:0/4025204484 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3184247596 0 0) 0x7f5eb8001110 con 0x7f5ebc15eab0 2024-09-15T23:12:15.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.429+0000 7f5ec0e9d640 1 -- 172.21.15.123:0/4025204484 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ea8003520 con 0x7f5ebc15eab0 2024-09-15T23:12:15.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.429+0000 7f5ec26a0640 1 -- 172.21.15.123:0/4025204484 >> v2:172.21.15.188:3300/0 conn(0x7f5ebc162490 msgr2=0x7f5ebc15ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:15.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.429+0000 7f5ec26a0640 1 --2- 172.21.15.123:0/4025204484 >> v2:172.21.15.188:3300/0 conn(0x7f5ebc162490 0x7f5ebc15ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:15.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.429+0000 7f5ec26a0640 1 -- 172.21.15.123:0/4025204484 >> v1:172.21.15.123:6789/0 conn(0x7f5ebc15eab0 legacy=0x7f5ebc0d2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:15.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.429+0000 7f5ec26a0640 1 -- 172.21.15.123:0/4025204484 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ebc15fb30 con 0x7f5ebc0b66b0 2024-09-15T23:12:15.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.429+0000 7f5ec169e640 1 --2- 172.21.15.123:0/4025204484 >> v2:172.21.15.188:3300/0 conn(0x7f5ebc162490 0x7f5ebc15ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:15.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.430+0000 7f5ec26a0640 1 --2- 172.21.15.123:0/4025204484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ebc0b66b0 0x7f5ebc0b6ac0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc068890 tx=0x7f5eb402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9a59785666aef4d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:15.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.430+0000 7f5ec0e9d640 1 -- 172.21.15.123:0/4025204484 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb4007740 con 0x7f5ebc0b66b0 2024-09-15T23:12:15.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.430+0000 7f5ec0e9d640 1 -- 172.21.15.123:0/4025204484 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5eb40078e0 con 0x7f5ebc0b66b0 2024-09-15T23:12:15.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.430+0000 7f5ec0e9d640 1 -- 172.21.15.123:0/4025204484 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb4007c90 con 0x7f5ebc0b66b0 2024-09-15T23:12:15.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.431+0000 7f5ec4103640 1 -- 172.21.15.123:0/4025204484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ebc0b66b0 msgr2=0x7f5ebc0b6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:15.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.431+0000 7f5ec4103640 1 --2- 172.21.15.123:0/4025204484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ebc0b66b0 0x7f5ebc0b6ac0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc068890 tx=0x7f5eb402a680 comp rx=0 tx=0).stop 2024-09-15T23:12:15.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.431+0000 7f5ec4103640 1 -- 172.21.15.123:0/4025204484 shutdown_connections 2024-09-15T23:12:15.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.431+0000 7f5ec4103640 1 --2- 172.21.15.123:0/4025204484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ebc0b66b0 0x7f5ebc0b6ac0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:15.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.431+0000 7f5ec4103640 1 --2- 172.21.15.123:0/4025204484 >> v2:172.21.15.188:3300/0 conn(0x7f5ebc162490 0x7f5ebc15ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:15.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.431+0000 7f5ec4103640 1 -- 172.21.15.123:0/4025204484 >> 172.21.15.123:0/4025204484 conn(0x7f5ebc0d16d0 msgr2=0x7f5ebc0d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:15.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.431+0000 7f5ec4103640 1 -- 172.21.15.123:0/4025204484 shutdown_connections 2024-09-15T23:12:15.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.431+0000 7f5ec4103640 1 -- 172.21.15.123:0/4025204484 wait complete. 2024-09-15T23:12:15.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.432+0000 7f5ec4103640 1 Processor -- start 2024-09-15T23:12:15.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.432+0000 7f5ec4103640 1 -- start start 2024-09-15T23:12:15.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.433+0000 7f5ec4103640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5ebc0b66b0 0x7f5ebc0ce480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:15.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.433+0000 7f5ec4103640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ebc15eab0 0x7f5ebc06d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:15.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.433+0000 7f5ec4103640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5ebc162490 0x7f5ebc06de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:15.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.433+0000 7f5ec4103640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5ebc0d4460 con 0x7f5ebc15eab0 2024-09-15T23:12:15.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.433+0000 7f5ec4103640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5ebc0cef20 con 0x7f5ebc0b66b0 2024-09-15T23:12:15.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.433+0000 7f5ec4103640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5ebc0d45e0 con 0x7f5ebc162490 2024-09-15T23:12:15.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.433+0000 7f5ec169e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ebc15eab0 0x7f5ebc06d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:15.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.433+0000 7f5ec169e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ebc15eab0 0x7f5ebc06d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56374/0 (socket says 172.21.15.123:56374) 2024-09-15T23:12:15.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.433+0000 7f5ec169e640 1 -- 172.21.15.123:0/3221398431 learned_addr learned my addr 172.21.15.123:0/3221398431 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:15.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.433+0000 7f5ec1e9f640 1 --2- 172.21.15.123:0/3221398431 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5ebc0b66b0 0x7f5ebc0ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:15.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.433+0000 7f5ec26a0640 1 --2- 172.21.15.123:0/3221398431 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5ebc162490 0x7f5ebc06de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:15.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.433+0000 7f5ec169e640 1 -- 172.21.15.123:0/3221398431 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5ebc162490 msgr2=0x7f5ebc06de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:15.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.433+0000 7f5ec169e640 1 --2- 172.21.15.123:0/3221398431 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5ebc162490 0x7f5ebc06de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:15.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.433+0000 7f5ec169e640 1 -- 172.21.15.123:0/3221398431 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5ebc0b66b0 msgr2=0x7f5ebc0ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:15.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.433+0000 7f5ec169e640 1 --2- 172.21.15.123:0/3221398431 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5ebc0b66b0 0x7f5ebc0ce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:15.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.433+0000 7f5ec169e640 1 -- 172.21.15.123:0/3221398431 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ebc0cba30 con 0x7f5ebc15eab0 2024-09-15T23:12:15.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.433+0000 7f5ec26a0640 1 --2- 172.21.15.123:0/3221398431 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5ebc162490 0x7f5ebc06de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:15.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.433+0000 7f5ec169e640 1 --2- 172.21.15.123:0/3221398431 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ebc15eab0 0x7f5ebc06d930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5eac00e7e0 tx=0x7f5eac00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:15.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.433+0000 7f5eb27fc640 1 -- 172.21.15.123:0/3221398431 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eac00f040 con 0x7f5ebc15eab0 2024-09-15T23:12:15.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.433+0000 7f5eb27fc640 1 -- 172.21.15.123:0/3221398431 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5eac004030 con 0x7f5ebc15eab0 2024-09-15T23:12:15.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.433+0000 7f5ec4103640 1 -- 172.21.15.123:0/3221398431 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ebc0cbd10 con 0x7f5ebc15eab0 2024-09-15T23:12:15.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.433+0000 7f5eb27fc640 1 -- 172.21.15.123:0/3221398431 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eac004400 con 0x7f5ebc15eab0 2024-09-15T23:12:15.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.434+0000 7f5ec4103640 1 -- 172.21.15.123:0/3221398431 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ebc0cc2d0 con 0x7f5ebc15eab0 2024-09-15T23:12:15.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.434+0000 7f5ec4103640 1 -- 172.21.15.123:0/3221398431 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ebc0b6ac0 con 0x7f5ebc15eab0 2024-09-15T23:12:15.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.435+0000 7f5eb27fc640 1 -- 172.21.15.123:0/3221398431 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5eac00c670 con 0x7f5ebc15eab0 2024-09-15T23:12:15.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.435+0000 7f5eb27fc640 1 --2- 172.21.15.123:0/3221398431 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5ea006c2b0 0x7f5ea006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:15.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.436+0000 7f5eb27fc640 1 -- 172.21.15.123:0/3221398431 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f5eac08b0b0 con 0x7f5ebc15eab0 2024-09-15T23:12:15.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.436+0000 7f5ec1e9f640 1 --2- 172.21.15.123:0/3221398431 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5ea006c2b0 0x7f5ea006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:15.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.436+0000 7f5ec1e9f640 1 --2- 172.21.15.123:0/3221398431 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5ea006c2b0 0x7f5ea006e770 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8005880 tx=0x7f5eb8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:15.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.440+0000 7f5eb27fc640 1 -- 172.21.15.123:0/3221398431 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5eac017020 con 0x7f5ebc15eab0 2024-09-15T23:12:15.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.640+0000 7f5ec4103640 1 -- 172.21.15.123:0/3221398431 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ebc0d2500 con 0x7f5ebc15eab0 2024-09-15T23:12:15.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.640+0000 7f5eb27fc640 1 -- 172.21.15.123:0/3221398431 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5226 (secure 0 0 0) 0x7f5eac059260 con 0x7f5ebc15eab0 2024-09-15T23:12:15.642 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:15.642 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":6,"btime":"2024-09-15T23:12:15:299077+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2663395388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2663395388},{"type":"v1","addr":"172.21.15.188:6837","nonce":2663395388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2375280105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2375280105},{"type":"v1","addr":"172.21.15.188:6836","nonce":2375280105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/477765723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":477765723},{"type":"v1","addr":"172.21.15.123:6834","nonce":477765723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:12:12.622666+0000","modified":"2024-09-15T23:12:14.622706+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/3721978283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":3721978283},{"type":"v1","addr":"172.21.15.123:6835","nonce":3721978283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-09-15T23:12:15.642 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 6 2024-09-15T23:12:15.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.642+0000 7f5ec4103640 1 -- 172.21.15.123:0/3221398431 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5ea006c2b0 msgr2=0x7f5ea006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:15.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.642+0000 7f5ec4103640 1 --2- 172.21.15.123:0/3221398431 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5ea006c2b0 0x7f5ea006e770 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8005880 tx=0x7f5eb8009040 comp rx=0 tx=0).stop 2024-09-15T23:12:15.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.642+0000 7f5ec4103640 1 -- 172.21.15.123:0/3221398431 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ebc15eab0 msgr2=0x7f5ebc06d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:15.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.642+0000 7f5ec4103640 1 --2- 172.21.15.123:0/3221398431 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ebc15eab0 0x7f5ebc06d930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5eac00e7e0 tx=0x7f5eac00eca0 comp rx=0 tx=0).stop 2024-09-15T23:12:15.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.642+0000 7f5ec4103640 1 -- 172.21.15.123:0/3221398431 shutdown_connections 2024-09-15T23:12:15.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.642+0000 7f5ec4103640 1 --2- 172.21.15.123:0/3221398431 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5ebc162490 0x7f5ebc06de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:15.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.642+0000 7f5ec4103640 1 --2- 172.21.15.123:0/3221398431 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5ea006c2b0 0x7f5ea006e770 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:15.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.642+0000 7f5ec4103640 1 --2- 172.21.15.123:0/3221398431 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ebc15eab0 0x7f5ebc06d930 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:15.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.642+0000 7f5ec4103640 1 --2- 172.21.15.123:0/3221398431 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5ebc0b66b0 0x7f5ebc0ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:15.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.642+0000 7f5ec4103640 1 -- 172.21.15.123:0/3221398431 >> 172.21.15.123:0/3221398431 conn(0x7f5ebc0d16d0 msgr2=0x7f5ebc0b4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:15.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.643+0000 7f5ec4103640 1 -- 172.21.15.123:0/3221398431 shutdown_connections 2024-09-15T23:12:15.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.643+0000 7f5ec4103640 1 -- 172.21.15.123:0/3221398431 wait complete. 2024-09-15T23:12:15.655 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:12:15.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.752+0000 7ffa864e4640 1 Processor -- start 2024-09-15T23:12:15.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.752+0000 7ffa864e4640 1 -- start start 2024-09-15T23:12:15.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.753+0000 7ffa864e4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa80073890 0x7ffa800b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:15.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.753+0000 7ffa864e4640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ffa800b5880 0x7ffa800b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:15.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.753+0000 7ffa864e4640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa800b4020 con 0x7ffa80145ed0 2024-09-15T23:12:15.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.753+0000 7ffa864e4640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7ffa800b42c0 con 0x7ffa800b5880 2024-09-15T23:12:15.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.753+0000 7ffa864e4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ffa800b45a0 con 0x7ffa80073890 2024-09-15T23:12:15.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.753+0000 7ffa84a81640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ffa800b5880 0x7ffa800b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:15.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.753+0000 7ffa7f7fe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa80073890 0x7ffa800b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:15.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.753+0000 7ffa84a81640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ffa800b5880 0x7ffa800b5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:48322/0 (socket says 172.21.15.123:48322) 2024-09-15T23:12:15.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.753+0000 7ffa84a81640 1 -- 172.21.15.123:0/2703847814 learned_addr learned my addr 172.21.15.123:0/2703847814 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:15.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.753+0000 7ffa7ffff640 1 --1- 172.21.15.123:0/2703847814 >> v1:172.21.15.188:6789/0 conn(0x7ffa80145ed0 0x7ffa80073180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:45584/0 (socket says 172.21.15.123:45584) 2024-09-15T23:12:15.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.754+0000 7ffa84a81640 1 -- 172.21.15.123:0/2703847814 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa80073890 msgr2=0x7ffa800b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:15.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.754+0000 7ffa84a81640 1 --2- 172.21.15.123:0/2703847814 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa80073890 0x7ffa800b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:15.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.754+0000 7ffa84a81640 1 -- 172.21.15.123:0/2703847814 >> v1:172.21.15.188:6789/0 conn(0x7ffa80145ed0 legacy=0x7ffa80073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:15.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.754+0000 7ffa84a81640 1 -- 172.21.15.123:0/2703847814 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa800b4880 con 0x7ffa800b5880 2024-09-15T23:12:15.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.754+0000 7ffa7f7fe640 1 --2- 172.21.15.123:0/2703847814 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa80073890 0x7ffa800b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:12:15.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.754+0000 7ffa84a81640 1 --2- 172.21.15.123:0/2703847814 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa800b5880 0x7ffa800b5d30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffa78009e50 tx=0x7ffa7802a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a858f6862ff40bf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:15.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.755+0000 7ffa7effd640 1 -- 172.21.15.123:0/2703847814 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa78036070 con 0x7ffa800b5880 2024-09-15T23:12:15.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.755+0000 7ffa7effd640 1 -- 172.21.15.123:0/2703847814 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa78031600 con 0x7ffa800b5880 2024-09-15T23:12:15.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.755+0000 7ffa7effd640 1 -- 172.21.15.123:0/2703847814 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa780319d0 con 0x7ffa800b5880 2024-09-15T23:12:15.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.755+0000 7ffa864e4640 1 -- 172.21.15.123:0/2703847814 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa800b5880 msgr2=0x7ffa800b5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:15.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.755+0000 7ffa864e4640 1 --2- 172.21.15.123:0/2703847814 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa800b5880 0x7ffa800b5d30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffa78009e50 tx=0x7ffa7802a710 comp rx=0 tx=0).stop 2024-09-15T23:12:15.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.755+0000 7ffa864e4640 1 -- 172.21.15.123:0/2703847814 shutdown_connections 2024-09-15T23:12:15.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.755+0000 7ffa864e4640 1 --2- 172.21.15.123:0/2703847814 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa800b5880 0x7ffa800b5d30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:15.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.755+0000 7ffa864e4640 1 --2- 172.21.15.123:0/2703847814 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa80073890 0x7ffa800b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:15.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.755+0000 7ffa864e4640 1 -- 172.21.15.123:0/2703847814 >> 172.21.15.123:0/2703847814 conn(0x7ffa800ccec0 msgr2=0x7ffa800cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:15.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.755+0000 7ffa864e4640 1 -- 172.21.15.123:0/2703847814 shutdown_connections 2024-09-15T23:12:15.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.755+0000 7ffa864e4640 1 -- 172.21.15.123:0/2703847814 wait complete. 2024-09-15T23:12:15.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.756+0000 7ffa864e4640 1 Processor -- start 2024-09-15T23:12:15.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.756+0000 7ffa864e4640 1 -- start start 2024-09-15T23:12:15.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.757+0000 7ffa864e4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa80073890 0x7ffa8015c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:15.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.757+0000 7ffa864e4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa800b5880 0x7ffa80154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:15.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.757+0000 7ffa864e4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa80145ed0 0x7ffa800c6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:15.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.757+0000 7ffa864e4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ffa800b6270 con 0x7ffa80145ed0 2024-09-15T23:12:15.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.757+0000 7ffa864e4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ffa801462b0 con 0x7ffa800b5880 2024-09-15T23:12:15.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.757+0000 7ffa864e4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ffa800c73c0 con 0x7ffa80073890 2024-09-15T23:12:15.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.757+0000 7ffa84a81640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa80145ed0 0x7ffa800c6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:15.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.757+0000 7ffa84a81640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa80145ed0 0x7ffa800c6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56388/0 (socket says 172.21.15.123:56388) 2024-09-15T23:12:15.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.757+0000 7ffa84a81640 1 -- 172.21.15.123:0/831662772 learned_addr learned my addr 172.21.15.123:0/831662772 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:15.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.757+0000 7ffa7ffff640 1 --2- 172.21.15.123:0/831662772 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa80073890 0x7ffa8015c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:15.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.757+0000 7ffa7f7fe640 1 --2- 172.21.15.123:0/831662772 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa800b5880 0x7ffa80154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:15.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.758+0000 7ffa84a81640 1 -- 172.21.15.123:0/831662772 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa80073890 msgr2=0x7ffa8015c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:15.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.758+0000 7ffa84a81640 1 --2- 172.21.15.123:0/831662772 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa80073890 0x7ffa8015c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:15.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.758+0000 7ffa84a81640 1 -- 172.21.15.123:0/831662772 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa800b5880 msgr2=0x7ffa80154170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:15.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.758+0000 7ffa84a81640 1 --2- 172.21.15.123:0/831662772 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa800b5880 0x7ffa80154170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:15.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.758+0000 7ffa84a81640 1 -- 172.21.15.123:0/831662772 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa800c7660 con 0x7ffa80145ed0 2024-09-15T23:12:15.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.758+0000 7ffa84a81640 1 --2- 172.21.15.123:0/831662772 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa80145ed0 0x7ffa800c6e80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffa78034040 tx=0x7ffa78004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:15.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.758+0000 7ffa7cff9640 1 -- 172.21.15.123:0/831662772 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa78036050 con 0x7ffa80145ed0 2024-09-15T23:12:15.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.758+0000 7ffa7cff9640 1 -- 172.21.15.123:0/831662772 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa78042070 con 0x7ffa80145ed0 2024-09-15T23:12:15.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.758+0000 7ffa7cff9640 1 -- 172.21.15.123:0/831662772 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa78009510 con 0x7ffa80145ed0 2024-09-15T23:12:15.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.758+0000 7ffa864e4640 1 -- 172.21.15.123:0/831662772 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa800c7940 con 0x7ffa80145ed0 2024-09-15T23:12:15.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.758+0000 7ffa864e4640 1 -- 172.21.15.123:0/831662772 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa800cb900 con 0x7ffa80145ed0 2024-09-15T23:12:15.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.759+0000 7ffa864e4640 1 -- 172.21.15.123:0/831662772 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa800c7e60 con 0x7ffa80145ed0 2024-09-15T23:12:15.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.759+0000 7ffa7cff9640 1 -- 172.21.15.123:0/831662772 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ffa78007bf0 con 0x7ffa80145ed0 2024-09-15T23:12:15.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.760+0000 7ffa7cff9640 1 --2- 172.21.15.123:0/831662772 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ffa6c06c2b0 0x7ffa6c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:15.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.760+0000 7ffa7cff9640 1 -- 172.21.15.123:0/831662772 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ffa780ac040 con 0x7ffa80145ed0 2024-09-15T23:12:15.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.760+0000 7ffa7ffff640 1 --2- 172.21.15.123:0/831662772 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ffa6c06c2b0 0x7ffa6c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:15.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.760+0000 7ffa7ffff640 1 --2- 172.21.15.123:0/831662772 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ffa6c06c2b0 0x7ffa6c06e770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffa70007fd0 tx=0x7ffa70007e80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:15.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.764+0000 7ffa7cff9640 1 -- 172.21.15.123:0/831662772 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffa7807a1f0 con 0x7ffa80145ed0 2024-09-15T23:12:15.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.929+0000 7ffa864e4640 1 -- 172.21.15.123:0/831662772 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffa800b5080 con 0x7ffa80145ed0 2024-09-15T23:12:15.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.930+0000 7ffa7cff9640 1 -- 172.21.15.123:0/831662772 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16693 (secure 0 0 0) 0x7ffa7807e4f0 con 0x7ffa80145ed0 2024-09-15T23:12:15.931 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:15.932 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":22,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:12:14.277829+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:12:10.289254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:12:11.594152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:12:15.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.932+0000 7ffa864e4640 1 -- 172.21.15.123:0/831662772 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ffa6c06c2b0 msgr2=0x7ffa6c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:15.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.932+0000 7ffa864e4640 1 --2- 172.21.15.123:0/831662772 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ffa6c06c2b0 0x7ffa6c06e770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffa70007fd0 tx=0x7ffa70007e80 comp rx=0 tx=0).stop 2024-09-15T23:12:15.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.932+0000 7ffa864e4640 1 -- 172.21.15.123:0/831662772 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa80145ed0 msgr2=0x7ffa800c6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:15.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.932+0000 7ffa864e4640 1 --2- 172.21.15.123:0/831662772 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa80145ed0 0x7ffa800c6e80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffa78034040 tx=0x7ffa78004a40 comp rx=0 tx=0).stop 2024-09-15T23:12:15.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.932+0000 7ffa864e4640 1 -- 172.21.15.123:0/831662772 shutdown_connections 2024-09-15T23:12:15.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.932+0000 7ffa864e4640 1 --2- 172.21.15.123:0/831662772 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ffa6c06c2b0 0x7ffa6c06e770 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:15.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.932+0000 7ffa864e4640 1 --2- 172.21.15.123:0/831662772 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa80145ed0 0x7ffa800c6e80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:15.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.932+0000 7ffa864e4640 1 --2- 172.21.15.123:0/831662772 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa800b5880 0x7ffa80154170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:15.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.932+0000 7ffa864e4640 1 --2- 172.21.15.123:0/831662772 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa80073890 0x7ffa8015c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:15.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.932+0000 7ffa864e4640 1 -- 172.21.15.123:0/831662772 >> 172.21.15.123:0/831662772 conn(0x7ffa800ccec0 msgr2=0x7ffa80142bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:15.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.932+0000 7ffa864e4640 1 -- 172.21.15.123:0/831662772 shutdown_connections 2024-09-15T23:12:15.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:15.932+0000 7ffa864e4640 1 -- 172.21.15.123:0/831662772 wait complete. 2024-09-15T23:12:15.944 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T23:12:15.945 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:12:16.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.042+0000 7f625aeb7640 1 Processor -- start 2024-09-15T23:12:16.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.042+0000 7f625aeb7640 1 -- start start 2024-09-15T23:12:16.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.043+0000 7f625aeb7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f625415eab0 0x7f625415ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:16.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.043+0000 7f625aeb7640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f625415f570 con 0x7f6254162490 2024-09-15T23:12:16.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.043+0000 7f625aeb7640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f625415f850 con 0x7f62540b66b0 2024-09-15T23:12:16.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.043+0000 7f625aeb7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f625415fb30 con 0x7f625415eab0 2024-09-15T23:12:16.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.043+0000 7f624bfff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6254162490 0x7f62540d2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:44772/0 (socket says 172.21.15.123:44772) 2024-09-15T23:12:16.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.043+0000 7f624bfff640 1 -- 172.21.15.123:0/1059020988 learned_addr learned my addr 172.21.15.123:0/1059020988 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:16.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.044+0000 7f6258c53640 1 --2- 172.21.15.123:0/1059020988 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f625415eab0 0x7f625415ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:16.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.044+0000 7f624b7fe640 1 -- 172.21.15.123:0/1059020988 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1384946320 0 0) 0x7f625415f570 con 0x7f6254162490 2024-09-15T23:12:16.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.044+0000 7f624b7fe640 1 -- 172.21.15.123:0/1059020988 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f623c003520 con 0x7f6254162490 2024-09-15T23:12:16.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.044+0000 7f624b7fe640 1 -- 172.21.15.123:0/1059020988 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 774053359 0 0) 0x7f625415f850 con 0x7f62540b66b0 2024-09-15T23:12:16.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.044+0000 7f624b7fe640 1 -- 172.21.15.123:0/1059020988 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f625415f570 con 0x7f62540b66b0 2024-09-15T23:12:16.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.044+0000 7f6258c53640 1 -- 172.21.15.123:0/1059020988 >> v1:172.21.15.188:6789/0 conn(0x7f62540b66b0 legacy=0x7f62540d35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:16.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.044+0000 7f6258c53640 1 -- 172.21.15.123:0/1059020988 >> v1:172.21.15.123:6789/0 conn(0x7f6254162490 legacy=0x7f62540d2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:16.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.044+0000 7f6258c53640 1 -- 172.21.15.123:0/1059020988 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f625415fe10 con 0x7f625415eab0 2024-09-15T23:12:16.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.045+0000 7f6258c53640 1 --2- 172.21.15.123:0/1059020988 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f625415eab0 0x7f625415ee90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f62500097d0 tx=0x7f625002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4f1ea27f8c2ddf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:16.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.045+0000 7f624b7fe640 1 -- 172.21.15.123:0/1059020988 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6250037070 con 0x7f625415eab0 2024-09-15T23:12:16.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.045+0000 7f624b7fe640 1 -- 172.21.15.123:0/1059020988 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6250032440 con 0x7f625415eab0 2024-09-15T23:12:16.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.045+0000 7f624b7fe640 1 -- 172.21.15.123:0/1059020988 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62500327f0 con 0x7f625415eab0 2024-09-15T23:12:16.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.045+0000 7f625aeb7640 1 -- 172.21.15.123:0/1059020988 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f625415eab0 msgr2=0x7f625415ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:16.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.045+0000 7f625aeb7640 1 --2- 172.21.15.123:0/1059020988 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f625415eab0 0x7f625415ee90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f62500097d0 tx=0x7f625002a210 comp rx=0 tx=0).stop 2024-09-15T23:12:16.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.045+0000 7f625aeb7640 1 -- 172.21.15.123:0/1059020988 shutdown_connections 2024-09-15T23:12:16.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.045+0000 7f625aeb7640 1 --2- 172.21.15.123:0/1059020988 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f625415eab0 0x7f625415ee90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:16.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.045+0000 7f625aeb7640 1 -- 172.21.15.123:0/1059020988 >> 172.21.15.123:0/1059020988 conn(0x7f62540d16d0 msgr2=0x7f62540d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:16.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.045+0000 7f625aeb7640 1 -- 172.21.15.123:0/1059020988 shutdown_connections 2024-09-15T23:12:16.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.045+0000 7f625aeb7640 1 -- 172.21.15.123:0/1059020988 wait complete. 2024-09-15T23:12:16.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.047+0000 7f625aeb7640 1 Processor -- start 2024-09-15T23:12:16.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.047+0000 7f625aeb7640 1 -- start start 2024-09-15T23:12:16.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.047+0000 7f625aeb7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f62540b66b0 0x7f62541e94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:16.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.047+0000 7f625aeb7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f625415eab0 0x7f62540cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:16.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.047+0000 7f625aeb7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6254162490 0x7f625414a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:16.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.047+0000 7f625aeb7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f62540d45e0 con 0x7f625415eab0 2024-09-15T23:12:16.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.047+0000 7f625aeb7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f62540d4460 con 0x7f6254162490 2024-09-15T23:12:16.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.047+0000 7f625aeb7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f62540d3cf0 con 0x7f62540b66b0 2024-09-15T23:12:16.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.048+0000 7f624bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f625415eab0 0x7f62540cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:16.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.048+0000 7f624bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f625415eab0 0x7f62540cbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56394/0 (socket says 172.21.15.123:56394) 2024-09-15T23:12:16.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.048+0000 7f624bfff640 1 -- 172.21.15.123:0/1459268167 learned_addr learned my addr 172.21.15.123:0/1459268167 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:16.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.048+0000 7f6258c53640 1 --2- 172.21.15.123:0/1459268167 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f62540b66b0 0x7f62541e94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:16.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.048+0000 7f6259454640 1 --2- 172.21.15.123:0/1459268167 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6254162490 0x7f625414a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:16.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.048+0000 7f624bfff640 1 -- 172.21.15.123:0/1459268167 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f62540b66b0 msgr2=0x7f62541e94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:16.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.048+0000 7f624bfff640 1 --2- 172.21.15.123:0/1459268167 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f62540b66b0 0x7f62541e94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:16.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.048+0000 7f624bfff640 1 -- 172.21.15.123:0/1459268167 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6254162490 msgr2=0x7f625414a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:16.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.048+0000 7f624bfff640 1 --2- 172.21.15.123:0/1459268167 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6254162490 0x7f625414a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:16.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.048+0000 7f624bfff640 1 -- 172.21.15.123:0/1459268167 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62541eade0 con 0x7f625415eab0 2024-09-15T23:12:16.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.048+0000 7f624bfff640 1 --2- 172.21.15.123:0/1459268167 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f625415eab0 0x7f62540cbb70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f624400c440 tx=0x7f624400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:16.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.048+0000 7f62497fa640 1 -- 172.21.15.123:0/1459268167 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6244017070 con 0x7f625415eab0 2024-09-15T23:12:16.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.048+0000 7f62497fa640 1 -- 172.21.15.123:0/1459268167 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6244005ce0 con 0x7f625415eab0 2024-09-15T23:12:16.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.048+0000 7f625aeb7640 1 -- 172.21.15.123:0/1459268167 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62541e9d40 con 0x7f625415eab0 2024-09-15T23:12:16.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.048+0000 7f62497fa640 1 -- 172.21.15.123:0/1459268167 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6244007270 con 0x7f625415eab0 2024-09-15T23:12:16.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.048+0000 7f625aeb7640 1 -- 172.21.15.123:0/1459268167 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62541ea300 con 0x7f625415eab0 2024-09-15T23:12:16.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.049+0000 7f625aeb7640 1 -- 172.21.15.123:0/1459268167 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f625415f850 con 0x7f625415eab0 2024-09-15T23:12:16.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.050+0000 7f62497fa640 1 -- 172.21.15.123:0/1459268167 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f624401a070 con 0x7f625415eab0 2024-09-15T23:12:16.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.050+0000 7f62497fa640 1 --2- 172.21.15.123:0/1459268167 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f624006c2b0 0x7f624006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:16.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.050+0000 7f62497fa640 1 -- 172.21.15.123:0/1459268167 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f624408a630 con 0x7f625415eab0 2024-09-15T23:12:16.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.050+0000 7f6258c53640 1 --2- 172.21.15.123:0/1459268167 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f624006c2b0 0x7f624006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:16.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.051+0000 7f6258c53640 1 --2- 172.21.15.123:0/1459268167 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f624006c2b0 0x7f624006e770 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6250034000 tx=0x7f625002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:16.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.054+0000 7f62497fa640 1 -- 172.21.15.123:0/1459268167 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6244058750 con 0x7f625415eab0 2024-09-15T23:12:16.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.219+0000 7f625aeb7640 1 -- 172.21.15.123:0/1459268167 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f62540ba7b0 con 0x7f624006c2b0 2024-09-15T23:12:16.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.225+0000 7f62497fa640 1 -- 172.21.15.123:0/1459268167 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246394 (secure 0 0 0) 0x7f62540ba7b0 con 0x7f624006c2b0 2024-09-15T23:12:16.229 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:16.231 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:12:16.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.228+0000 7f625aeb7640 1 -- 172.21.15.123:0/1459268167 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f624006c2b0 msgr2=0x7f624006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:16.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.228+0000 7f625aeb7640 1 --2- 172.21.15.123:0/1459268167 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f624006c2b0 0x7f624006e770 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6250034000 tx=0x7f625002e000 comp rx=0 tx=0).stop 2024-09-15T23:12:16.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.228+0000 7f625aeb7640 1 -- 172.21.15.123:0/1459268167 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f625415eab0 msgr2=0x7f62540cbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:16.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.228+0000 7f625aeb7640 1 --2- 172.21.15.123:0/1459268167 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f625415eab0 0x7f62540cbb70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f624400c440 tx=0x7f624400c900 comp rx=0 tx=0).stop 2024-09-15T23:12:16.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.228+0000 7f625aeb7640 1 -- 172.21.15.123:0/1459268167 shutdown_connections 2024-09-15T23:12:16.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.228+0000 7f625aeb7640 1 --2- 172.21.15.123:0/1459268167 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6254162490 0x7f625414a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:16.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.228+0000 7f625aeb7640 1 --2- 172.21.15.123:0/1459268167 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f624006c2b0 0x7f624006e770 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:16.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.228+0000 7f625aeb7640 1 --2- 172.21.15.123:0/1459268167 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f625415eab0 0x7f62540cbb70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:16.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.228+0000 7f625aeb7640 1 --2- 172.21.15.123:0/1459268167 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f62540b66b0 0x7f62541e94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:16.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.228+0000 7f625aeb7640 1 -- 172.21.15.123:0/1459268167 >> 172.21.15.123:0/1459268167 conn(0x7f62540d16d0 msgr2=0x7f62540b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:16.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.228+0000 7f625aeb7640 1 -- 172.21.15.123:0/1459268167 shutdown_connections 2024-09-15T23:12:16.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.228+0000 7f625aeb7640 1 -- 172.21.15.123:0/1459268167 wait complete. 2024-09-15T23:12:16.240 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-15T23:12:15.502629+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592002,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":176,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":136,"acting":136,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":53,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219444,"kb_used_data":2568,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755276,"statfs":{"total":773094113280,"available":772869402624,"internally_reserved":0,"allocated":2629632,"data_stored":1639480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1634,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.230780"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.307270+0000","last_change":"2024-09-15T23:12:13.304372+0000","last_active":"2024-09-15T23:12:13.307270+0000","last_peered":"2024-09-15T23:12:13.307270+0000","last_clean":"2024-09-15T23:12:13.307270+0000","last_became_active":"2024-09-15T23:12:13.304067+0000","last_became_peered":"2024-09-15T23:12:13.304067+0000","last_unstale":"2024-09-15T23:12:13.307270+0000","last_undegraded":"2024-09-15T23:12:13.307270+0000","last_fullsized":"2024-09-15T23:12:13.307270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:44.688079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306250+0000","last_change":"2024-09-15T23:12:13.302730+0000","last_active":"2024-09-15T23:12:13.306250+0000","last_peered":"2024-09-15T23:12:13.306250+0000","last_clean":"2024-09-15T23:12:13.306250+0000","last_became_active":"2024-09-15T23:12:13.302301+0000","last_became_peered":"2024-09-15T23:12:13.302301+0000","last_unstale":"2024-09-15T23:12:13.306250+0000","last_undegraded":"2024-09-15T23:12:13.306250+0000","last_fullsized":"2024-09-15T23:12:13.306250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:18.794107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306036+0000","last_change":"2024-09-15T23:12:13.298592+0000","last_active":"2024-09-15T23:12:13.306036+0000","last_peered":"2024-09-15T23:12:13.306036+0000","last_clean":"2024-09-15T23:12:13.306036+0000","last_became_active":"2024-09-15T23:12:13.298358+0000","last_became_peered":"2024-09-15T23:12:13.298358+0000","last_unstale":"2024-09-15T23:12:13.306036+0000","last_undegraded":"2024-09-15T23:12:13.306036+0000","last_fullsized":"2024-09-15T23:12:13.306036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:26:22.310337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306639+0000","last_change":"2024-09-15T23:12:13.302119+0000","last_active":"2024-09-15T23:12:13.306639+0000","last_peered":"2024-09-15T23:12:13.306639+0000","last_clean":"2024-09-15T23:12:13.306639+0000","last_became_active":"2024-09-15T23:12:13.301671+0000","last_became_peered":"2024-09-15T23:12:13.301671+0000","last_unstale":"2024-09-15T23:12:13.306639+0000","last_undegraded":"2024-09-15T23:12:13.306639+0000","last_fullsized":"2024-09-15T23:12:13.306639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:07:55.135427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306124+0000","last_change":"2024-09-15T23:12:13.301523+0000","last_active":"2024-09-15T23:12:13.306124+0000","last_peered":"2024-09-15T23:12:13.306124+0000","last_clean":"2024-09-15T23:12:13.306124+0000","last_became_active":"2024-09-15T23:12:13.301272+0000","last_became_peered":"2024-09-15T23:12:13.301272+0000","last_unstale":"2024-09-15T23:12:13.306124+0000","last_undegraded":"2024-09-15T23:12:13.306124+0000","last_fullsized":"2024-09-15T23:12:13.306124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:10:44.616598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.298276+0000","last_change":"2024-09-15T23:12:13.295501+0000","last_active":"2024-09-15T23:12:13.298276+0000","last_peered":"2024-09-15T23:12:13.298276+0000","last_clean":"2024-09-15T23:12:13.298276+0000","last_became_active":"2024-09-15T23:12:13.294470+0000","last_became_peered":"2024-09-15T23:12:13.294470+0000","last_unstale":"2024-09-15T23:12:13.298276+0000","last_undegraded":"2024-09-15T23:12:13.298276+0000","last_fullsized":"2024-09-15T23:12:13.298276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:12.050480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305974+0000","last_change":"2024-09-15T23:12:13.300057+0000","last_active":"2024-09-15T23:12:13.305974+0000","last_peered":"2024-09-15T23:12:13.305974+0000","last_clean":"2024-09-15T23:12:13.305974+0000","last_became_active":"2024-09-15T23:12:13.299762+0000","last_became_peered":"2024-09-15T23:12:13.299762+0000","last_unstale":"2024-09-15T23:12:13.305974+0000","last_undegraded":"2024-09-15T23:12:13.305974+0000","last_fullsized":"2024-09-15T23:12:13.305974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:04.822487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306016+0000","last_change":"2024-09-15T23:12:13.296975+0000","last_active":"2024-09-15T23:12:13.306016+0000","last_peered":"2024-09-15T23:12:13.306016+0000","last_clean":"2024-09-15T23:12:13.306016+0000","last_became_active":"2024-09-15T23:12:13.296726+0000","last_became_peered":"2024-09-15T23:12:13.296726+0000","last_unstale":"2024-09-15T23:12:13.306016+0000","last_undegraded":"2024-09-15T23:12:13.306016+0000","last_fullsized":"2024-09-15T23:12:13.306016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:08:51.159156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306882+0000","last_change":"2024-09-15T23:12:13.299790+0000","last_active":"2024-09-15T23:12:13.306882+0000","last_peered":"2024-09-15T23:12:13.306882+0000","last_clean":"2024-09-15T23:12:13.306882+0000","last_became_active":"2024-09-15T23:12:13.299446+0000","last_became_peered":"2024-09-15T23:12:13.299446+0000","last_unstale":"2024-09-15T23:12:13.306882+0000","last_undegraded":"2024-09-15T23:12:13.306882+0000","last_fullsized":"2024-09-15T23:12:13.306882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:03.932670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305700+0000","last_change":"2024-09-15T23:12:13.302744+0000","last_active":"2024-09-15T23:12:13.305700+0000","last_peered":"2024-09-15T23:12:13.305700+0000","last_clean":"2024-09-15T23:12:13.305700+0000","last_became_active":"2024-09-15T23:12:13.302439+0000","last_became_peered":"2024-09-15T23:12:13.302439+0000","last_unstale":"2024-09-15T23:12:13.305700+0000","last_undegraded":"2024-09-15T23:12:13.305700+0000","last_fullsized":"2024-09-15T23:12:13.305700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:02.914486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.303650+0000","last_change":"2024-09-15T23:12:13.298338+0000","last_active":"2024-09-15T23:12:13.303650+0000","last_peered":"2024-09-15T23:12:13.303650+0000","last_clean":"2024-09-15T23:12:13.303650+0000","last_became_active":"2024-09-15T23:12:13.297884+0000","last_became_peered":"2024-09-15T23:12:13.297884+0000","last_unstale":"2024-09-15T23:12:13.303650+0000","last_undegraded":"2024-09-15T23:12:13.303650+0000","last_fullsized":"2024-09-15T23:12:13.303650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:11.528380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.303721+0000","last_change":"2024-09-15T23:12:13.300688+0000","last_active":"2024-09-15T23:12:13.303721+0000","last_peered":"2024-09-15T23:12:13.303721+0000","last_clean":"2024-09-15T23:12:13.303721+0000","last_became_active":"2024-09-15T23:12:13.300388+0000","last_became_peered":"2024-09-15T23:12:13.300388+0000","last_unstale":"2024-09-15T23:12:13.303721+0000","last_undegraded":"2024-09-15T23:12:13.303721+0000","last_fullsized":"2024-09-15T23:12:13.303721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:25.899342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305775+0000","last_change":"2024-09-15T23:12:13.295852+0000","last_active":"2024-09-15T23:12:13.305775+0000","last_peered":"2024-09-15T23:12:13.305775+0000","last_clean":"2024-09-15T23:12:13.305775+0000","last_became_active":"2024-09-15T23:12:13.295536+0000","last_became_peered":"2024-09-15T23:12:13.295536+0000","last_unstale":"2024-09-15T23:12:13.305775+0000","last_undegraded":"2024-09-15T23:12:13.305775+0000","last_fullsized":"2024-09-15T23:12:13.305775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:27:22.925825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.298303+0000","last_change":"2024-09-15T23:12:13.296548+0000","last_active":"2024-09-15T23:12:13.298303+0000","last_peered":"2024-09-15T23:12:13.298303+0000","last_clean":"2024-09-15T23:12:13.298303+0000","last_became_active":"2024-09-15T23:12:13.294814+0000","last_became_peered":"2024-09-15T23:12:13.294814+0000","last_unstale":"2024-09-15T23:12:13.298303+0000","last_undegraded":"2024-09-15T23:12:13.298303+0000","last_fullsized":"2024-09-15T23:12:13.298303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:26.936337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.295166+0000","last_change":"2024-09-15T23:12:13.293872+0000","last_active":"2024-09-15T23:12:13.295166+0000","last_peered":"2024-09-15T23:12:13.295166+0000","last_clean":"2024-09-15T23:12:13.295166+0000","last_became_active":"2024-09-15T23:12:13.293608+0000","last_became_peered":"2024-09-15T23:12:13.293608+0000","last_unstale":"2024-09-15T23:12:13.295166+0000","last_undegraded":"2024-09-15T23:12:13.295166+0000","last_fullsized":"2024-09-15T23:12:13.295166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:44.688079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305427+0000","last_change":"2024-09-15T23:12:13.299195+0000","last_active":"2024-09-15T23:12:13.305427+0000","last_peered":"2024-09-15T23:12:13.305427+0000","last_clean":"2024-09-15T23:12:13.305427+0000","last_became_active":"2024-09-15T23:12:13.298466+0000","last_became_peered":"2024-09-15T23:12:13.298466+0000","last_unstale":"2024-09-15T23:12:13.305427+0000","last_undegraded":"2024-09-15T23:12:13.305427+0000","last_fullsized":"2024-09-15T23:12:13.305427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:12.050480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.294094+0000","last_change":"2024-09-15T23:12:13.291856+0000","last_active":"2024-09-15T23:12:13.294094+0000","last_peered":"2024-09-15T23:12:13.294094+0000","last_clean":"2024-09-15T23:12:13.294094+0000","last_became_active":"2024-09-15T23:12:13.291050+0000","last_became_peered":"2024-09-15T23:12:13.291050+0000","last_unstale":"2024-09-15T23:12:13.294094+0000","last_undegraded":"2024-09-15T23:12:13.294094+0000","last_fullsized":"2024-09-15T23:12:13.294094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:03.932670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306973+0000","last_change":"2024-09-15T23:12:13.300877+0000","last_active":"2024-09-15T23:12:13.306973+0000","last_peered":"2024-09-15T23:12:13.306973+0000","last_clean":"2024-09-15T23:12:13.306973+0000","last_became_active":"2024-09-15T23:12:13.300604+0000","last_became_peered":"2024-09-15T23:12:13.300604+0000","last_unstale":"2024-09-15T23:12:13.306973+0000","last_undegraded":"2024-09-15T23:12:13.306973+0000","last_fullsized":"2024-09-15T23:12:13.306973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:26.936337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.292269+0000","last_change":"2024-09-15T23:12:13.290806+0000","last_active":"2024-09-15T23:12:13.292269+0000","last_peered":"2024-09-15T23:12:13.292269+0000","last_clean":"2024-09-15T23:12:13.292269+0000","last_became_active":"2024-09-15T23:12:13.290534+0000","last_became_peered":"2024-09-15T23:12:13.290534+0000","last_unstale":"2024-09-15T23:12:13.292269+0000","last_undegraded":"2024-09-15T23:12:13.292269+0000","last_fullsized":"2024-09-15T23:12:13.292269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:55.317051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.278188+0000","last_change":"2024-09-15T23:12:11.278188+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.278188+0000","last_undegraded":"2024-09-15T23:12:11.278188+0000","last_fullsized":"2024-09-15T23:12:11.278188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.308359+0000","last_change":"2024-09-15T23:12:12.297601+0000","last_active":"2024-09-15T23:12:13.308359+0000","last_peered":"2024-09-15T23:12:13.308359+0000","last_clean":"2024-09-15T23:12:13.308359+0000","last_became_active":"2024-09-15T23:12:12.297353+0000","last_became_peered":"2024-09-15T23:12:12.297353+0000","last_unstale":"2024-09-15T23:12:13.308359+0000","last_undegraded":"2024-09-15T23:12:13.308359+0000","last_fullsized":"2024-09-15T23:12:13.308359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:27.285153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.276572+0000","last_change":"2024-09-15T23:12:11.276572+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.276572+0000","last_undegraded":"2024-09-15T23:12:11.276572+0000","last_fullsized":"2024-09-15T23:12:11.276572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.281818+0000","last_change":"2024-09-15T23:12:12.294030+0000","last_active":"2024-09-15T23:12:13.281818+0000","last_peered":"2024-09-15T23:12:13.281818+0000","last_clean":"2024-09-15T23:12:13.281818+0000","last_became_active":"2024-09-15T23:12:12.293252+0000","last_became_peered":"2024-09-15T23:12:12.293252+0000","last_unstale":"2024-09-15T23:12:13.281818+0000","last_undegraded":"2024-09-15T23:12:13.281818+0000","last_fullsized":"2024-09-15T23:12:13.281818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:29.072753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.280716+0000","last_change":"2024-09-15T23:12:12.296404+0000","last_active":"2024-09-15T23:12:13.280716+0000","last_peered":"2024-09-15T23:12:13.280716+0000","last_clean":"2024-09-15T23:12:13.280716+0000","last_became_active":"2024-09-15T23:12:12.296128+0000","last_became_peered":"2024-09-15T23:12:12.296128+0000","last_unstale":"2024-09-15T23:12:13.280716+0000","last_undegraded":"2024-09-15T23:12:13.280716+0000","last_fullsized":"2024-09-15T23:12:13.280716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:43.458579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305382+0000","last_change":"2024-09-15T23:12:13.298997+0000","last_active":"2024-09-15T23:12:13.305382+0000","last_peered":"2024-09-15T23:12:13.305382+0000","last_clean":"2024-09-15T23:12:13.305382+0000","last_became_active":"2024-09-15T23:12:13.298225+0000","last_became_peered":"2024-09-15T23:12:13.298225+0000","last_unstale":"2024-09-15T23:12:13.305382+0000","last_undegraded":"2024-09-15T23:12:13.305382+0000","last_fullsized":"2024-09-15T23:12:13.305382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:55.317051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.288734+0000","last_change":"2024-09-15T23:12:12.294378+0000","last_active":"2024-09-15T23:12:13.288734+0000","last_peered":"2024-09-15T23:12:13.288734+0000","last_clean":"2024-09-15T23:12:13.288734+0000","last_became_active":"2024-09-15T23:12:12.294028+0000","last_became_peered":"2024-09-15T23:12:12.294028+0000","last_unstale":"2024-09-15T23:12:13.288734+0000","last_undegraded":"2024-09-15T23:12:13.288734+0000","last_fullsized":"2024-09-15T23:12:13.288734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:29.072753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.278408+0000","last_change":"2024-09-15T23:12:11.278408+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.278408+0000","last_undegraded":"2024-09-15T23:12:11.278408+0000","last_fullsized":"2024-09-15T23:12:11.278408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305259+0000","last_change":"2024-09-15T23:12:13.302380+0000","last_active":"2024-09-15T23:12:13.305259+0000","last_peered":"2024-09-15T23:12:13.305259+0000","last_clean":"2024-09-15T23:12:13.305259+0000","last_became_active":"2024-09-15T23:12:13.302131+0000","last_became_peered":"2024-09-15T23:12:13.302131+0000","last_unstale":"2024-09-15T23:12:13.305259+0000","last_undegraded":"2024-09-15T23:12:13.305259+0000","last_fullsized":"2024-09-15T23:12:13.305259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:10.513438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.310296+0000","last_change":"2024-09-15T23:12:12.298778+0000","last_active":"2024-09-15T23:12:13.310296+0000","last_peered":"2024-09-15T23:12:13.310296+0000","last_clean":"2024-09-15T23:12:13.310296+0000","last_became_active":"2024-09-15T23:12:12.298501+0000","last_became_peered":"2024-09-15T23:12:12.298501+0000","last_unstale":"2024-09-15T23:12:13.310296+0000","last_undegraded":"2024-09-15T23:12:13.310296+0000","last_fullsized":"2024-09-15T23:12:13.310296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:50:38.455575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306151+0000","last_change":"2024-09-15T23:12:13.303512+0000","last_active":"2024-09-15T23:12:13.306151+0000","last_peered":"2024-09-15T23:12:13.306151+0000","last_clean":"2024-09-15T23:12:13.306151+0000","last_became_active":"2024-09-15T23:12:13.303210+0000","last_became_peered":"2024-09-15T23:12:13.303210+0000","last_unstale":"2024-09-15T23:12:13.306151+0000","last_undegraded":"2024-09-15T23:12:13.306151+0000","last_fullsized":"2024-09-15T23:12:13.306151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:28.842608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.278465+0000","last_change":"2024-09-15T23:12:11.278465+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.278465+0000","last_undegraded":"2024-09-15T23:12:11.278465+0000","last_fullsized":"2024-09-15T23:12:11.278465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.282126+0000","last_change":"2024-09-15T23:12:12.295626+0000","last_active":"2024-09-15T23:12:13.282126+0000","last_peered":"2024-09-15T23:12:13.282126+0000","last_clean":"2024-09-15T23:12:13.282126+0000","last_became_active":"2024-09-15T23:12:12.295333+0000","last_became_peered":"2024-09-15T23:12:12.295333+0000","last_unstale":"2024-09-15T23:12:13.282126+0000","last_undegraded":"2024-09-15T23:12:13.282126+0000","last_fullsized":"2024-09-15T23:12:13.282126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:27:21.918750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.300128+0000","last_change":"2024-09-15T23:12:13.296636+0000","last_active":"2024-09-15T23:12:13.300128+0000","last_peered":"2024-09-15T23:12:13.300128+0000","last_clean":"2024-09-15T23:12:13.300128+0000","last_became_active":"2024-09-15T23:12:13.296172+0000","last_became_peered":"2024-09-15T23:12:13.296172+0000","last_unstale":"2024-09-15T23:12:13.300128+0000","last_undegraded":"2024-09-15T23:12:13.300128+0000","last_fullsized":"2024-09-15T23:12:13.300128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:54:01.331747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.287227+0000","last_change":"2024-09-15T23:12:12.296543+0000","last_active":"2024-09-15T23:12:13.287227+0000","last_peered":"2024-09-15T23:12:13.287227+0000","last_clean":"2024-09-15T23:12:13.287227+0000","last_became_active":"2024-09-15T23:12:12.296293+0000","last_became_peered":"2024-09-15T23:12:12.296293+0000","last_unstale":"2024-09-15T23:12:13.287227+0000","last_undegraded":"2024-09-15T23:12:13.287227+0000","last_fullsized":"2024-09-15T23:12:13.287227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:07:54.128353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.298710+0000","last_change":"2024-09-15T23:12:13.297331+0000","last_active":"2024-09-15T23:12:13.298710+0000","last_peered":"2024-09-15T23:12:13.298710+0000","last_clean":"2024-09-15T23:12:13.298710+0000","last_became_active":"2024-09-15T23:12:13.297036+0000","last_became_peered":"2024-09-15T23:12:13.297036+0000","last_unstale":"2024-09-15T23:12:13.298710+0000","last_undegraded":"2024-09-15T23:12:13.298710+0000","last_fullsized":"2024-09-15T23:12:13.298710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:07:55.135427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.276379+0000","last_change":"2024-09-15T23:12:11.276379+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.276379+0000","last_undegraded":"2024-09-15T23:12:11.276379+0000","last_fullsized":"2024-09-15T23:12:11.276379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.304776+0000","last_change":"2024-09-15T23:12:13.301636+0000","last_active":"2024-09-15T23:12:13.304776+0000","last_peered":"2024-09-15T23:12:13.304776+0000","last_clean":"2024-09-15T23:12:13.304776+0000","last_became_active":"2024-09-15T23:12:13.301390+0000","last_became_peered":"2024-09-15T23:12:13.301390+0000","last_unstale":"2024-09-15T23:12:13.304776+0000","last_undegraded":"2024-09-15T23:12:13.304776+0000","last_fullsized":"2024-09-15T23:12:13.304776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:29.584475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305413+0000","last_change":"2024-09-15T23:12:12.294164+0000","last_active":"2024-09-15T23:12:13.305413+0000","last_peered":"2024-09-15T23:12:13.305413+0000","last_clean":"2024-09-15T23:12:13.305413+0000","last_became_active":"2024-09-15T23:12:12.293619+0000","last_became_peered":"2024-09-15T23:12:12.293619+0000","last_unstale":"2024-09-15T23:12:13.305413+0000","last_undegraded":"2024-09-15T23:12:13.305413+0000","last_fullsized":"2024-09-15T23:12:13.305413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:46.714431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305317+0000","last_change":"2024-09-15T23:12:13.298781+0000","last_active":"2024-09-15T23:12:13.305317+0000","last_peered":"2024-09-15T23:12:13.305317+0000","last_clean":"2024-09-15T23:12:13.305317+0000","last_became_active":"2024-09-15T23:12:13.297968+0000","last_became_peered":"2024-09-15T23:12:13.297968+0000","last_unstale":"2024-09-15T23:12:13.305317+0000","last_undegraded":"2024-09-15T23:12:13.305317+0000","last_fullsized":"2024-09-15T23:12:13.305317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:44.465654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.278792+0000","last_change":"2024-09-15T23:12:11.278792+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.278792+0000","last_undegraded":"2024-09-15T23:12:11.278792+0000","last_fullsized":"2024-09-15T23:12:11.278792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305469+0000","last_change":"2024-09-15T23:12:13.296707+0000","last_active":"2024-09-15T23:12:13.305469+0000","last_peered":"2024-09-15T23:12:13.305469+0000","last_clean":"2024-09-15T23:12:13.305469+0000","last_became_active":"2024-09-15T23:12:13.296450+0000","last_became_peered":"2024-09-15T23:12:13.296450+0000","last_unstale":"2024-09-15T23:12:13.305469+0000","last_undegraded":"2024-09-15T23:12:13.305469+0000","last_fullsized":"2024-09-15T23:12:13.305469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:10:04.877140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.278550+0000","last_change":"2024-09-15T23:12:11.278550+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.278550+0000","last_undegraded":"2024-09-15T23:12:11.278550+0000","last_fullsized":"2024-09-15T23:12:11.278550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.307884+0000","last_change":"2024-09-15T23:12:13.306601+0000","last_active":"2024-09-15T23:12:13.307884+0000","last_peered":"2024-09-15T23:12:13.307884+0000","last_clean":"2024-09-15T23:12:13.307884+0000","last_became_active":"2024-09-15T23:12:13.306342+0000","last_became_peered":"2024-09-15T23:12:13.306342+0000","last_unstale":"2024-09-15T23:12:13.307884+0000","last_undegraded":"2024-09-15T23:12:13.307884+0000","last_fullsized":"2024-09-15T23:12:13.307884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:23:11.450569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.276618+0000","last_change":"2024-09-15T23:12:11.276618+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.276618+0000","last_undegraded":"2024-09-15T23:12:11.276618+0000","last_fullsized":"2024-09-15T23:12:11.276618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.294002+0000","last_change":"2024-09-15T23:12:13.292019+0000","last_active":"2024-09-15T23:12:13.294002+0000","last_peered":"2024-09-15T23:12:13.294002+0000","last_clean":"2024-09-15T23:12:13.294002+0000","last_became_active":"2024-09-15T23:12:13.290585+0000","last_became_peered":"2024-09-15T23:12:13.290585+0000","last_unstale":"2024-09-15T23:12:13.294002+0000","last_undegraded":"2024-09-15T23:12:13.294002+0000","last_fullsized":"2024-09-15T23:12:13.294002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:10:44.616598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.281241+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:12:13.281241+0000","last_peered":"2024-09-15T23:12:13.281241+0000","last_clean":"2024-09-15T23:12:13.281241+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:12:13.281241+0000","last_undegraded":"2024-09-15T23:12:13.281241+0000","last_fullsized":"2024-09-15T23:12:13.281241+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.283904+0000","last_change":"2024-09-15T23:12:12.295819+0000","last_active":"2024-09-15T23:12:13.283904+0000","last_peered":"2024-09-15T23:12:13.283904+0000","last_clean":"2024-09-15T23:12:13.283904+0000","last_became_active":"2024-09-15T23:12:12.295320+0000","last_became_peered":"2024-09-15T23:12:12.295320+0000","last_unstale":"2024-09-15T23:12:13.283904+0000","last_undegraded":"2024-09-15T23:12:13.283904+0000","last_fullsized":"2024-09-15T23:12:13.283904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:13.348463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.281967+0000","last_change":"2024-09-15T23:12:12.293545+0000","last_active":"2024-09-15T23:12:13.281967+0000","last_peered":"2024-09-15T23:12:13.281967+0000","last_clean":"2024-09-15T23:12:13.281967+0000","last_became_active":"2024-09-15T23:12:12.292903+0000","last_became_peered":"2024-09-15T23:12:12.292903+0000","last_unstale":"2024-09-15T23:12:13.281967+0000","last_undegraded":"2024-09-15T23:12:13.281967+0000","last_fullsized":"2024-09-15T23:12:13.281967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:46.714431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.278080+0000","last_change":"2024-09-15T23:12:11.278080+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.278080+0000","last_undegraded":"2024-09-15T23:12:11.278080+0000","last_fullsized":"2024-09-15T23:12:11.278080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.282268+0000","last_change":"2024-09-15T23:12:12.300290+0000","last_active":"2024-09-15T23:12:13.282268+0000","last_peered":"2024-09-15T23:12:13.282268+0000","last_clean":"2024-09-15T23:12:13.282268+0000","last_became_active":"2024-09-15T23:12:12.300024+0000","last_became_peered":"2024-09-15T23:12:12.300024+0000","last_unstale":"2024-09-15T23:12:13.282268+0000","last_undegraded":"2024-09-15T23:12:13.282268+0000","last_fullsized":"2024-09-15T23:12:13.282268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:10:03.870065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306057+0000","last_change":"2024-09-15T23:12:13.300590+0000","last_active":"2024-09-15T23:12:13.306057+0000","last_peered":"2024-09-15T23:12:13.306057+0000","last_clean":"2024-09-15T23:12:13.306057+0000","last_became_active":"2024-09-15T23:12:13.300376+0000","last_became_peered":"2024-09-15T23:12:13.300376+0000","last_unstale":"2024-09-15T23:12:13.306057+0000","last_undegraded":"2024-09-15T23:12:13.306057+0000","last_fullsized":"2024-09-15T23:12:13.306057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:14.355538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.279105+0000","last_change":"2024-09-15T23:12:11.279105+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.279105+0000","last_undegraded":"2024-09-15T23:12:11.279105+0000","last_fullsized":"2024-09-15T23:12:11.279105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305592+0000","last_change":"2024-09-15T23:12:13.300154+0000","last_active":"2024-09-15T23:12:13.305592+0000","last_peered":"2024-09-15T23:12:13.305592+0000","last_clean":"2024-09-15T23:12:13.305592+0000","last_became_active":"2024-09-15T23:12:13.299919+0000","last_became_peered":"2024-09-15T23:12:13.299919+0000","last_unstale":"2024-09-15T23:12:13.305592+0000","last_undegraded":"2024-09-15T23:12:13.305592+0000","last_fullsized":"2024-09-15T23:12:13.305592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:42:51.295319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.282980+0000","last_change":"2024-09-15T23:12:12.296791+0000","last_active":"2024-09-15T23:12:13.282980+0000","last_peered":"2024-09-15T23:12:13.282980+0000","last_clean":"2024-09-15T23:12:13.282980+0000","last_became_active":"2024-09-15T23:12:12.296507+0000","last_became_peered":"2024-09-15T23:12:12.296507+0000","last_unstale":"2024-09-15T23:12:13.282980+0000","last_undegraded":"2024-09-15T23:12:13.282980+0000","last_fullsized":"2024-09-15T23:12:13.282980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:08:50.152082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.276797+0000","last_change":"2024-09-15T23:12:11.276797+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.276797+0000","last_undegraded":"2024-09-15T23:12:11.276797+0000","last_fullsized":"2024-09-15T23:12:11.276797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.307939+0000","last_change":"2024-09-15T23:12:12.297628+0000","last_active":"2024-09-15T23:12:13.307939+0000","last_peered":"2024-09-15T23:12:13.307939+0000","last_clean":"2024-09-15T23:12:13.307939+0000","last_became_active":"2024-09-15T23:12:12.297392+0000","last_became_peered":"2024-09-15T23:12:12.297392+0000","last_unstale":"2024-09-15T23:12:13.307939+0000","last_undegraded":"2024-09-15T23:12:13.307939+0000","last_fullsized":"2024-09-15T23:12:13.307939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:26:21.303262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.286852+0000","last_change":"2024-09-15T23:12:12.292922+0000","last_active":"2024-09-15T23:12:13.286852+0000","last_peered":"2024-09-15T23:12:13.286852+0000","last_clean":"2024-09-15T23:12:13.286852+0000","last_became_active":"2024-09-15T23:12:12.292606+0000","last_became_peered":"2024-09-15T23:12:12.292606+0000","last_unstale":"2024-09-15T23:12:13.286852+0000","last_undegraded":"2024-09-15T23:12:13.286852+0000","last_fullsized":"2024-09-15T23:12:13.286852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:25.929262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.304754+0000","last_change":"2024-09-15T23:12:13.300968+0000","last_active":"2024-09-15T23:12:13.304754+0000","last_peered":"2024-09-15T23:12:13.304754+0000","last_clean":"2024-09-15T23:12:13.304754+0000","last_became_active":"2024-09-15T23:12:13.300679+0000","last_became_peered":"2024-09-15T23:12:13.300679+0000","last_unstale":"2024-09-15T23:12:13.304754+0000","last_undegraded":"2024-09-15T23:12:13.304754+0000","last_fullsized":"2024-09-15T23:12:13.304754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:10.165586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.277263+0000","last_change":"2024-09-15T23:12:11.277263+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.277263+0000","last_undegraded":"2024-09-15T23:12:11.277263+0000","last_fullsized":"2024-09-15T23:12:11.277263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.276820+0000","last_change":"2024-09-15T23:12:11.276820+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.276820+0000","last_undegraded":"2024-09-15T23:12:11.276820+0000","last_fullsized":"2024-09-15T23:12:11.276820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306625+0000","last_change":"2024-09-15T23:12:12.295599+0000","last_active":"2024-09-15T23:12:13.306625+0000","last_peered":"2024-09-15T23:12:13.306625+0000","last_clean":"2024-09-15T23:12:13.306625+0000","last_became_active":"2024-09-15T23:12:12.295036+0000","last_became_peered":"2024-09-15T23:12:12.295036+0000","last_unstale":"2024-09-15T23:12:13.306625+0000","last_undegraded":"2024-09-15T23:12:13.306625+0000","last_fullsized":"2024-09-15T23:12:13.306625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:03.815413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.294113+0000","last_change":"2024-09-15T23:12:13.292087+0000","last_active":"2024-09-15T23:12:13.294113+0000","last_peered":"2024-09-15T23:12:13.294113+0000","last_clean":"2024-09-15T23:12:13.294113+0000","last_became_active":"2024-09-15T23:12:13.291588+0000","last_became_peered":"2024-09-15T23:12:13.291588+0000","last_unstale":"2024-09-15T23:12:13.294113+0000","last_undegraded":"2024-09-15T23:12:13.294113+0000","last_fullsized":"2024-09-15T23:12:13.294113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:28.842608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.300062+0000","last_change":"2024-09-15T23:12:13.295583+0000","last_active":"2024-09-15T23:12:13.300062+0000","last_peered":"2024-09-15T23:12:13.300062+0000","last_clean":"2024-09-15T23:12:13.300062+0000","last_became_active":"2024-09-15T23:12:13.295285+0000","last_became_peered":"2024-09-15T23:12:13.295285+0000","last_unstale":"2024-09-15T23:12:13.300062+0000","last_undegraded":"2024-09-15T23:12:13.300062+0000","last_fullsized":"2024-09-15T23:12:13.300062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:23:11.450569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305733+0000","last_change":"2024-09-15T23:12:12.293704+0000","last_active":"2024-09-15T23:12:13.305733+0000","last_peered":"2024-09-15T23:12:13.305733+0000","last_clean":"2024-09-15T23:12:13.305733+0000","last_became_active":"2024-09-15T23:12:12.292898+0000","last_became_peered":"2024-09-15T23:12:12.292898+0000","last_unstale":"2024-09-15T23:12:13.305733+0000","last_undegraded":"2024-09-15T23:12:13.305733+0000","last_fullsized":"2024-09-15T23:12:13.305733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:27.285153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.298233+0000","last_change":"2024-09-15T23:12:13.295743+0000","last_active":"2024-09-15T23:12:13.298233+0000","last_peered":"2024-09-15T23:12:13.298233+0000","last_clean":"2024-09-15T23:12:13.298233+0000","last_became_active":"2024-09-15T23:12:13.295104+0000","last_became_peered":"2024-09-15T23:12:13.295104+0000","last_unstale":"2024-09-15T23:12:13.298233+0000","last_undegraded":"2024-09-15T23:12:13.298233+0000","last_fullsized":"2024-09-15T23:12:13.298233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:42:51.295319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.302127+0000","last_change":"2024-09-15T23:12:12.293296+0000","last_active":"2024-09-15T23:12:13.302127+0000","last_peered":"2024-09-15T23:12:13.302127+0000","last_clean":"2024-09-15T23:12:13.302127+0000","last_became_active":"2024-09-15T23:12:12.292920+0000","last_became_peered":"2024-09-15T23:12:12.292920+0000","last_unstale":"2024-09-15T23:12:13.302127+0000","last_undegraded":"2024-09-15T23:12:13.302127+0000","last_fullsized":"2024-09-15T23:12:13.302127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:17.787033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.278380+0000","last_change":"2024-09-15T23:12:11.278380+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.278380+0000","last_undegraded":"2024-09-15T23:12:11.278380+0000","last_fullsized":"2024-09-15T23:12:11.278380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.276392+0000","last_change":"2024-09-15T23:12:11.276392+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.276392+0000","last_undegraded":"2024-09-15T23:12:11.276392+0000","last_fullsized":"2024-09-15T23:12:11.276392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":70,"acting":70,"num_store_stats":4},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1634,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476743,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":192512,"data_stored":63389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476740,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":192512,"data_stored":63389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476742,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":786432,"data_stored":653757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476742,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":192512,"data_stored":63389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":167936,"data_stored":51297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":167936,"data_stored":51297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542147,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28396,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343444,"statfs":{"total":96636764160,"available":96607686656,"internally_reserved":0,"allocated":761856,"data_stored":641665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":167936,"data_stored":51297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:12:16.244 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:12:16.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.377+0000 7f3016453640 1 Processor -- start 2024-09-15T23:12:16.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.377+0000 7f3016453640 1 -- start start 2024-09-15T23:12:16.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.378+0000 7f3016453640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f301015eab0 0x7f301015ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:16.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.378+0000 7f3016453640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3010162490 0x7f30100d2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:16.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.378+0000 7f3016453640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f301015f570 con 0x7f30100b66b0 2024-09-15T23:12:16.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.378+0000 7f3016453640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f301015f850 con 0x7f3010162490 2024-09-15T23:12:16.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.378+0000 7f3016453640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f301015fb30 con 0x7f301015eab0 2024-09-15T23:12:16.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.378+0000 7f300f7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3010162490 0x7f30100d2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:16.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.378+0000 7f30149f0640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f30100b66b0 0x7f30100d35e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38998/0 (socket says 172.21.15.123:38998) 2024-09-15T23:12:16.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.378+0000 7f30149f0640 1 -- 172.21.15.123:0/1386511590 learned_addr learned my addr 172.21.15.123:0/1386511590 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:16.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.378+0000 7f300f7fe640 1 --2- 172.21.15.123:0/1386511590 >> v2:172.21.15.123:3300/0 conn(0x7f3010162490 0x7f30100d2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36046/0 (socket says 172.21.15.123:36046) 2024-09-15T23:12:16.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.378+0000 7f300ffff640 1 --2- 172.21.15.123:0/1386511590 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f301015eab0 0x7f301015ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:16.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.378+0000 7f300f7fe640 1 -- 172.21.15.123:0/1386511590 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f301015eab0 msgr2=0x7f301015ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:16.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.378+0000 7f300f7fe640 1 --2- 172.21.15.123:0/1386511590 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f301015eab0 0x7f301015ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:16.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.378+0000 7f300f7fe640 1 -- 172.21.15.123:0/1386511590 >> v1:172.21.15.123:6789/0 conn(0x7f30100b66b0 legacy=0x7f30100d35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:16.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.378+0000 7f300effd640 1 -- 172.21.15.123:0/1386511590 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1728882977 0 0) 0x7f301015f570 con 0x7f30100b66b0 2024-09-15T23:12:16.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.378+0000 7f300f7fe640 1 -- 172.21.15.123:0/1386511590 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f301015fe10 con 0x7f3010162490 2024-09-15T23:12:16.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.379+0000 7f300f7fe640 1 --2- 172.21.15.123:0/1386511590 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3010162490 0x7f30100d2c30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f30040097a0 tx=0x7f300402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62cf98ac4b23d351 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:16.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.379+0000 7f300effd640 1 -- 172.21.15.123:0/1386511590 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3004037070 con 0x7f3010162490 2024-09-15T23:12:16.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.379+0000 7f300effd640 1 -- 172.21.15.123:0/1386511590 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3004032440 con 0x7f3010162490 2024-09-15T23:12:16.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.379+0000 7f300effd640 1 -- 172.21.15.123:0/1386511590 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3004032810 con 0x7f3010162490 2024-09-15T23:12:16.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.380+0000 7f3016453640 1 -- 172.21.15.123:0/1386511590 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3010162490 msgr2=0x7f30100d2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:16.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.380+0000 7f3016453640 1 --2- 172.21.15.123:0/1386511590 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3010162490 0x7f30100d2c30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f30040097a0 tx=0x7f300402a180 comp rx=0 tx=0).stop 2024-09-15T23:12:16.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.380+0000 7f3016453640 1 -- 172.21.15.123:0/1386511590 shutdown_connections 2024-09-15T23:12:16.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.380+0000 7f3016453640 1 --2- 172.21.15.123:0/1386511590 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3010162490 0x7f30100d2c30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:16.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.380+0000 7f3016453640 1 --2- 172.21.15.123:0/1386511590 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f301015eab0 0x7f301015ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:16.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.380+0000 7f3016453640 1 -- 172.21.15.123:0/1386511590 >> 172.21.15.123:0/1386511590 conn(0x7f30100d16d0 msgr2=0x7f30100d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:16.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.380+0000 7f3016453640 1 -- 172.21.15.123:0/1386511590 shutdown_connections 2024-09-15T23:12:16.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.380+0000 7f3016453640 1 -- 172.21.15.123:0/1386511590 wait complete. 2024-09-15T23:12:16.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.381+0000 7f3016453640 1 Processor -- start 2024-09-15T23:12:16.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.381+0000 7f3016453640 1 -- start start 2024-09-15T23:12:16.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.382+0000 7f3016453640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30100b66b0 0x7f30100b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:16.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.382+0000 7f3016453640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f301015eab0 0x7f30100ca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:16.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.382+0000 7f3016453640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3010162490 0x7f30101f4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:16.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.382+0000 7f3016453640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f30100d4460 con 0x7f30100b66b0 2024-09-15T23:12:16.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.382+0000 7f3016453640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f30100d3170 con 0x7f301015eab0 2024-09-15T23:12:16.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.382+0000 7f3016453640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f30100d45e0 con 0x7f3010162490 2024-09-15T23:12:16.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.382+0000 7f300ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30100b66b0 0x7f30100b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:16.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.382+0000 7f300ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30100b66b0 0x7f30100b2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36060/0 (socket says 172.21.15.123:36060) 2024-09-15T23:12:16.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.382+0000 7f300ffff640 1 -- 172.21.15.123:0/858694015 learned_addr learned my addr 172.21.15.123:0/858694015 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:16.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.382+0000 7f30149f0640 1 --2- 172.21.15.123:0/858694015 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3010162490 0x7f30101f4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:16.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.382+0000 7f300f7fe640 1 --2- 172.21.15.123:0/858694015 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f301015eab0 0x7f30100ca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:16.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.382+0000 7f300ffff640 1 -- 172.21.15.123:0/858694015 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3010162490 msgr2=0x7f30101f4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:16.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.382+0000 7f300ffff640 1 --2- 172.21.15.123:0/858694015 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3010162490 0x7f30101f4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:16.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.382+0000 7f300ffff640 1 -- 172.21.15.123:0/858694015 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f301015eab0 msgr2=0x7f30100ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:16.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.382+0000 7f300ffff640 1 --2- 172.21.15.123:0/858694015 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f301015eab0 0x7f30100ca3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:16.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.382+0000 7f300ffff640 1 -- 172.21.15.123:0/858694015 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30100cab20 con 0x7f30100b66b0 2024-09-15T23:12:16.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.382+0000 7f30149f0640 1 --2- 172.21.15.123:0/858694015 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3010162490 0x7f30101f4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:16.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.382+0000 7f300f7fe640 1 --2- 172.21.15.123:0/858694015 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f301015eab0 0x7f30100ca3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:16.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.382+0000 7f300ffff640 1 --2- 172.21.15.123:0/858694015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30100b66b0 0x7f30100b2de0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f300000d5f0 tx=0x7f300000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:16.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.383+0000 7f300cff9640 1 -- 172.21.15.123:0/858694015 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30000125f0 con 0x7f30100b66b0 2024-09-15T23:12:16.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.383+0000 7f300cff9640 1 -- 172.21.15.123:0/858694015 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3000019070 con 0x7f30100b66b0 2024-09-15T23:12:16.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.383+0000 7f3016453640 1 -- 172.21.15.123:0/858694015 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30100cae00 con 0x7f30100b66b0 2024-09-15T23:12:16.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.383+0000 7f300cff9640 1 -- 172.21.15.123:0/858694015 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30000129d0 con 0x7f30100b66b0 2024-09-15T23:12:16.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.383+0000 7f3016453640 1 -- 172.21.15.123:0/858694015 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30101f48e0 con 0x7f30100b66b0 2024-09-15T23:12:16.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.384+0000 7f3016453640 1 -- 172.21.15.123:0/858694015 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30100d2500 con 0x7f30100b66b0 2024-09-15T23:12:16.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.384+0000 7f300cff9640 1 -- 172.21.15.123:0/858694015 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3000012b70 con 0x7f30100b66b0 2024-09-15T23:12:16.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.384+0000 7f300cff9640 1 --2- 172.21.15.123:0/858694015 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2ffc06c2b0 0x7f2ffc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:16.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.385+0000 7f300cff9640 1 -- 172.21.15.123:0/858694015 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f300008b7b0 con 0x7f30100b66b0 2024-09-15T23:12:16.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.385+0000 7f300f7fe640 1 --2- 172.21.15.123:0/858694015 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2ffc06c2b0 0x7f2ffc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:16.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.385+0000 7f300f7fe640 1 --2- 172.21.15.123:0/858694015 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2ffc06c2b0 0x7f2ffc06e770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3004034000 tx=0x7f300402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:16.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.389+0000 7f300cff9640 1 -- 172.21.15.123:0/858694015 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3000059fb0 con 0x7f30100b66b0 2024-09-15T23:12:16.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.552+0000 7f3016453640 1 -- 172.21.15.123:0/858694015 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f30100ba7b0 con 0x7f2ffc06c2b0 2024-09-15T23:12:16.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.559+0000 7f300cff9640 1 -- 172.21.15.123:0/858694015 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246394 (secure 0 0 0) 0x7f30100ba7b0 con 0x7f2ffc06c2b0 2024-09-15T23:12:16.563 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:16.564 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:12:16.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.562+0000 7f3016453640 1 -- 172.21.15.123:0/858694015 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2ffc06c2b0 msgr2=0x7f2ffc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:16.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.562+0000 7f3016453640 1 --2- 172.21.15.123:0/858694015 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2ffc06c2b0 0x7f2ffc06e770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3004034000 tx=0x7f300402e000 comp rx=0 tx=0).stop 2024-09-15T23:12:16.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.562+0000 7f3016453640 1 -- 172.21.15.123:0/858694015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30100b66b0 msgr2=0x7f30100b2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:16.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.562+0000 7f3016453640 1 --2- 172.21.15.123:0/858694015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30100b66b0 0x7f30100b2de0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f300000d5f0 tx=0x7f300000dab0 comp rx=0 tx=0).stop 2024-09-15T23:12:16.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.562+0000 7f3016453640 1 -- 172.21.15.123:0/858694015 shutdown_connections 2024-09-15T23:12:16.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.562+0000 7f3016453640 1 --2- 172.21.15.123:0/858694015 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3010162490 0x7f30101f4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:16.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.562+0000 7f3016453640 1 --2- 172.21.15.123:0/858694015 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f301015eab0 0x7f30100ca3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:16.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.562+0000 7f3016453640 1 --2- 172.21.15.123:0/858694015 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2ffc06c2b0 0x7f2ffc06e770 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:16.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.562+0000 7f3016453640 1 --2- 172.21.15.123:0/858694015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30100b66b0 0x7f30100b2de0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:16.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.562+0000 7f3016453640 1 -- 172.21.15.123:0/858694015 >> 172.21.15.123:0/858694015 conn(0x7f30100d16d0 msgr2=0x7f301006e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:16.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.562+0000 7f3016453640 1 -- 172.21.15.123:0/858694015 shutdown_connections 2024-09-15T23:12:16.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.562+0000 7f3016453640 1 -- 172.21.15.123:0/858694015 wait complete. 2024-09-15T23:12:16.573 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-15T23:12:15.502629+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592002,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":176,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":136,"acting":136,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":53,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219444,"kb_used_data":2568,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755276,"statfs":{"total":773094113280,"available":772869402624,"internally_reserved":0,"allocated":2629632,"data_stored":1639480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1634,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.230780"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.307270+0000","last_change":"2024-09-15T23:12:13.304372+0000","last_active":"2024-09-15T23:12:13.307270+0000","last_peered":"2024-09-15T23:12:13.307270+0000","last_clean":"2024-09-15T23:12:13.307270+0000","last_became_active":"2024-09-15T23:12:13.304067+0000","last_became_peered":"2024-09-15T23:12:13.304067+0000","last_unstale":"2024-09-15T23:12:13.307270+0000","last_undegraded":"2024-09-15T23:12:13.307270+0000","last_fullsized":"2024-09-15T23:12:13.307270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:44.688079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306250+0000","last_change":"2024-09-15T23:12:13.302730+0000","last_active":"2024-09-15T23:12:13.306250+0000","last_peered":"2024-09-15T23:12:13.306250+0000","last_clean":"2024-09-15T23:12:13.306250+0000","last_became_active":"2024-09-15T23:12:13.302301+0000","last_became_peered":"2024-09-15T23:12:13.302301+0000","last_unstale":"2024-09-15T23:12:13.306250+0000","last_undegraded":"2024-09-15T23:12:13.306250+0000","last_fullsized":"2024-09-15T23:12:13.306250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:18.794107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306036+0000","last_change":"2024-09-15T23:12:13.298592+0000","last_active":"2024-09-15T23:12:13.306036+0000","last_peered":"2024-09-15T23:12:13.306036+0000","last_clean":"2024-09-15T23:12:13.306036+0000","last_became_active":"2024-09-15T23:12:13.298358+0000","last_became_peered":"2024-09-15T23:12:13.298358+0000","last_unstale":"2024-09-15T23:12:13.306036+0000","last_undegraded":"2024-09-15T23:12:13.306036+0000","last_fullsized":"2024-09-15T23:12:13.306036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:26:22.310337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306639+0000","last_change":"2024-09-15T23:12:13.302119+0000","last_active":"2024-09-15T23:12:13.306639+0000","last_peered":"2024-09-15T23:12:13.306639+0000","last_clean":"2024-09-15T23:12:13.306639+0000","last_became_active":"2024-09-15T23:12:13.301671+0000","last_became_peered":"2024-09-15T23:12:13.301671+0000","last_unstale":"2024-09-15T23:12:13.306639+0000","last_undegraded":"2024-09-15T23:12:13.306639+0000","last_fullsized":"2024-09-15T23:12:13.306639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:07:55.135427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306124+0000","last_change":"2024-09-15T23:12:13.301523+0000","last_active":"2024-09-15T23:12:13.306124+0000","last_peered":"2024-09-15T23:12:13.306124+0000","last_clean":"2024-09-15T23:12:13.306124+0000","last_became_active":"2024-09-15T23:12:13.301272+0000","last_became_peered":"2024-09-15T23:12:13.301272+0000","last_unstale":"2024-09-15T23:12:13.306124+0000","last_undegraded":"2024-09-15T23:12:13.306124+0000","last_fullsized":"2024-09-15T23:12:13.306124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:10:44.616598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.298276+0000","last_change":"2024-09-15T23:12:13.295501+0000","last_active":"2024-09-15T23:12:13.298276+0000","last_peered":"2024-09-15T23:12:13.298276+0000","last_clean":"2024-09-15T23:12:13.298276+0000","last_became_active":"2024-09-15T23:12:13.294470+0000","last_became_peered":"2024-09-15T23:12:13.294470+0000","last_unstale":"2024-09-15T23:12:13.298276+0000","last_undegraded":"2024-09-15T23:12:13.298276+0000","last_fullsized":"2024-09-15T23:12:13.298276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:12.050480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305974+0000","last_change":"2024-09-15T23:12:13.300057+0000","last_active":"2024-09-15T23:12:13.305974+0000","last_peered":"2024-09-15T23:12:13.305974+0000","last_clean":"2024-09-15T23:12:13.305974+0000","last_became_active":"2024-09-15T23:12:13.299762+0000","last_became_peered":"2024-09-15T23:12:13.299762+0000","last_unstale":"2024-09-15T23:12:13.305974+0000","last_undegraded":"2024-09-15T23:12:13.305974+0000","last_fullsized":"2024-09-15T23:12:13.305974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:04.822487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306016+0000","last_change":"2024-09-15T23:12:13.296975+0000","last_active":"2024-09-15T23:12:13.306016+0000","last_peered":"2024-09-15T23:12:13.306016+0000","last_clean":"2024-09-15T23:12:13.306016+0000","last_became_active":"2024-09-15T23:12:13.296726+0000","last_became_peered":"2024-09-15T23:12:13.296726+0000","last_unstale":"2024-09-15T23:12:13.306016+0000","last_undegraded":"2024-09-15T23:12:13.306016+0000","last_fullsized":"2024-09-15T23:12:13.306016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:08:51.159156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306882+0000","last_change":"2024-09-15T23:12:13.299790+0000","last_active":"2024-09-15T23:12:13.306882+0000","last_peered":"2024-09-15T23:12:13.306882+0000","last_clean":"2024-09-15T23:12:13.306882+0000","last_became_active":"2024-09-15T23:12:13.299446+0000","last_became_peered":"2024-09-15T23:12:13.299446+0000","last_unstale":"2024-09-15T23:12:13.306882+0000","last_undegraded":"2024-09-15T23:12:13.306882+0000","last_fullsized":"2024-09-15T23:12:13.306882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:03.932670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305700+0000","last_change":"2024-09-15T23:12:13.302744+0000","last_active":"2024-09-15T23:12:13.305700+0000","last_peered":"2024-09-15T23:12:13.305700+0000","last_clean":"2024-09-15T23:12:13.305700+0000","last_became_active":"2024-09-15T23:12:13.302439+0000","last_became_peered":"2024-09-15T23:12:13.302439+0000","last_unstale":"2024-09-15T23:12:13.305700+0000","last_undegraded":"2024-09-15T23:12:13.305700+0000","last_fullsized":"2024-09-15T23:12:13.305700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:02.914486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.303650+0000","last_change":"2024-09-15T23:12:13.298338+0000","last_active":"2024-09-15T23:12:13.303650+0000","last_peered":"2024-09-15T23:12:13.303650+0000","last_clean":"2024-09-15T23:12:13.303650+0000","last_became_active":"2024-09-15T23:12:13.297884+0000","last_became_peered":"2024-09-15T23:12:13.297884+0000","last_unstale":"2024-09-15T23:12:13.303650+0000","last_undegraded":"2024-09-15T23:12:13.303650+0000","last_fullsized":"2024-09-15T23:12:13.303650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:11.528380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.303721+0000","last_change":"2024-09-15T23:12:13.300688+0000","last_active":"2024-09-15T23:12:13.303721+0000","last_peered":"2024-09-15T23:12:13.303721+0000","last_clean":"2024-09-15T23:12:13.303721+0000","last_became_active":"2024-09-15T23:12:13.300388+0000","last_became_peered":"2024-09-15T23:12:13.300388+0000","last_unstale":"2024-09-15T23:12:13.303721+0000","last_undegraded":"2024-09-15T23:12:13.303721+0000","last_fullsized":"2024-09-15T23:12:13.303721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:25.899342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305775+0000","last_change":"2024-09-15T23:12:13.295852+0000","last_active":"2024-09-15T23:12:13.305775+0000","last_peered":"2024-09-15T23:12:13.305775+0000","last_clean":"2024-09-15T23:12:13.305775+0000","last_became_active":"2024-09-15T23:12:13.295536+0000","last_became_peered":"2024-09-15T23:12:13.295536+0000","last_unstale":"2024-09-15T23:12:13.305775+0000","last_undegraded":"2024-09-15T23:12:13.305775+0000","last_fullsized":"2024-09-15T23:12:13.305775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:27:22.925825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.298303+0000","last_change":"2024-09-15T23:12:13.296548+0000","last_active":"2024-09-15T23:12:13.298303+0000","last_peered":"2024-09-15T23:12:13.298303+0000","last_clean":"2024-09-15T23:12:13.298303+0000","last_became_active":"2024-09-15T23:12:13.294814+0000","last_became_peered":"2024-09-15T23:12:13.294814+0000","last_unstale":"2024-09-15T23:12:13.298303+0000","last_undegraded":"2024-09-15T23:12:13.298303+0000","last_fullsized":"2024-09-15T23:12:13.298303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:26.936337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.295166+0000","last_change":"2024-09-15T23:12:13.293872+0000","last_active":"2024-09-15T23:12:13.295166+0000","last_peered":"2024-09-15T23:12:13.295166+0000","last_clean":"2024-09-15T23:12:13.295166+0000","last_became_active":"2024-09-15T23:12:13.293608+0000","last_became_peered":"2024-09-15T23:12:13.293608+0000","last_unstale":"2024-09-15T23:12:13.295166+0000","last_undegraded":"2024-09-15T23:12:13.295166+0000","last_fullsized":"2024-09-15T23:12:13.295166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:44.688079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305427+0000","last_change":"2024-09-15T23:12:13.299195+0000","last_active":"2024-09-15T23:12:13.305427+0000","last_peered":"2024-09-15T23:12:13.305427+0000","last_clean":"2024-09-15T23:12:13.305427+0000","last_became_active":"2024-09-15T23:12:13.298466+0000","last_became_peered":"2024-09-15T23:12:13.298466+0000","last_unstale":"2024-09-15T23:12:13.305427+0000","last_undegraded":"2024-09-15T23:12:13.305427+0000","last_fullsized":"2024-09-15T23:12:13.305427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:12.050480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.294094+0000","last_change":"2024-09-15T23:12:13.291856+0000","last_active":"2024-09-15T23:12:13.294094+0000","last_peered":"2024-09-15T23:12:13.294094+0000","last_clean":"2024-09-15T23:12:13.294094+0000","last_became_active":"2024-09-15T23:12:13.291050+0000","last_became_peered":"2024-09-15T23:12:13.291050+0000","last_unstale":"2024-09-15T23:12:13.294094+0000","last_undegraded":"2024-09-15T23:12:13.294094+0000","last_fullsized":"2024-09-15T23:12:13.294094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:03.932670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306973+0000","last_change":"2024-09-15T23:12:13.300877+0000","last_active":"2024-09-15T23:12:13.306973+0000","last_peered":"2024-09-15T23:12:13.306973+0000","last_clean":"2024-09-15T23:12:13.306973+0000","last_became_active":"2024-09-15T23:12:13.300604+0000","last_became_peered":"2024-09-15T23:12:13.300604+0000","last_unstale":"2024-09-15T23:12:13.306973+0000","last_undegraded":"2024-09-15T23:12:13.306973+0000","last_fullsized":"2024-09-15T23:12:13.306973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:26.936337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.292269+0000","last_change":"2024-09-15T23:12:13.290806+0000","last_active":"2024-09-15T23:12:13.292269+0000","last_peered":"2024-09-15T23:12:13.292269+0000","last_clean":"2024-09-15T23:12:13.292269+0000","last_became_active":"2024-09-15T23:12:13.290534+0000","last_became_peered":"2024-09-15T23:12:13.290534+0000","last_unstale":"2024-09-15T23:12:13.292269+0000","last_undegraded":"2024-09-15T23:12:13.292269+0000","last_fullsized":"2024-09-15T23:12:13.292269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:55.317051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.278188+0000","last_change":"2024-09-15T23:12:11.278188+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.278188+0000","last_undegraded":"2024-09-15T23:12:11.278188+0000","last_fullsized":"2024-09-15T23:12:11.278188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.308359+0000","last_change":"2024-09-15T23:12:12.297601+0000","last_active":"2024-09-15T23:12:13.308359+0000","last_peered":"2024-09-15T23:12:13.308359+0000","last_clean":"2024-09-15T23:12:13.308359+0000","last_became_active":"2024-09-15T23:12:12.297353+0000","last_became_peered":"2024-09-15T23:12:12.297353+0000","last_unstale":"2024-09-15T23:12:13.308359+0000","last_undegraded":"2024-09-15T23:12:13.308359+0000","last_fullsized":"2024-09-15T23:12:13.308359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:27.285153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.276572+0000","last_change":"2024-09-15T23:12:11.276572+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.276572+0000","last_undegraded":"2024-09-15T23:12:11.276572+0000","last_fullsized":"2024-09-15T23:12:11.276572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.281818+0000","last_change":"2024-09-15T23:12:12.294030+0000","last_active":"2024-09-15T23:12:13.281818+0000","last_peered":"2024-09-15T23:12:13.281818+0000","last_clean":"2024-09-15T23:12:13.281818+0000","last_became_active":"2024-09-15T23:12:12.293252+0000","last_became_peered":"2024-09-15T23:12:12.293252+0000","last_unstale":"2024-09-15T23:12:13.281818+0000","last_undegraded":"2024-09-15T23:12:13.281818+0000","last_fullsized":"2024-09-15T23:12:13.281818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:29.072753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.280716+0000","last_change":"2024-09-15T23:12:12.296404+0000","last_active":"2024-09-15T23:12:13.280716+0000","last_peered":"2024-09-15T23:12:13.280716+0000","last_clean":"2024-09-15T23:12:13.280716+0000","last_became_active":"2024-09-15T23:12:12.296128+0000","last_became_peered":"2024-09-15T23:12:12.296128+0000","last_unstale":"2024-09-15T23:12:13.280716+0000","last_undegraded":"2024-09-15T23:12:13.280716+0000","last_fullsized":"2024-09-15T23:12:13.280716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:43.458579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305382+0000","last_change":"2024-09-15T23:12:13.298997+0000","last_active":"2024-09-15T23:12:13.305382+0000","last_peered":"2024-09-15T23:12:13.305382+0000","last_clean":"2024-09-15T23:12:13.305382+0000","last_became_active":"2024-09-15T23:12:13.298225+0000","last_became_peered":"2024-09-15T23:12:13.298225+0000","last_unstale":"2024-09-15T23:12:13.305382+0000","last_undegraded":"2024-09-15T23:12:13.305382+0000","last_fullsized":"2024-09-15T23:12:13.305382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:55.317051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.288734+0000","last_change":"2024-09-15T23:12:12.294378+0000","last_active":"2024-09-15T23:12:13.288734+0000","last_peered":"2024-09-15T23:12:13.288734+0000","last_clean":"2024-09-15T23:12:13.288734+0000","last_became_active":"2024-09-15T23:12:12.294028+0000","last_became_peered":"2024-09-15T23:12:12.294028+0000","last_unstale":"2024-09-15T23:12:13.288734+0000","last_undegraded":"2024-09-15T23:12:13.288734+0000","last_fullsized":"2024-09-15T23:12:13.288734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:29.072753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.278408+0000","last_change":"2024-09-15T23:12:11.278408+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.278408+0000","last_undegraded":"2024-09-15T23:12:11.278408+0000","last_fullsized":"2024-09-15T23:12:11.278408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305259+0000","last_change":"2024-09-15T23:12:13.302380+0000","last_active":"2024-09-15T23:12:13.305259+0000","last_peered":"2024-09-15T23:12:13.305259+0000","last_clean":"2024-09-15T23:12:13.305259+0000","last_became_active":"2024-09-15T23:12:13.302131+0000","last_became_peered":"2024-09-15T23:12:13.302131+0000","last_unstale":"2024-09-15T23:12:13.305259+0000","last_undegraded":"2024-09-15T23:12:13.305259+0000","last_fullsized":"2024-09-15T23:12:13.305259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:10.513438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.310296+0000","last_change":"2024-09-15T23:12:12.298778+0000","last_active":"2024-09-15T23:12:13.310296+0000","last_peered":"2024-09-15T23:12:13.310296+0000","last_clean":"2024-09-15T23:12:13.310296+0000","last_became_active":"2024-09-15T23:12:12.298501+0000","last_became_peered":"2024-09-15T23:12:12.298501+0000","last_unstale":"2024-09-15T23:12:13.310296+0000","last_undegraded":"2024-09-15T23:12:13.310296+0000","last_fullsized":"2024-09-15T23:12:13.310296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:50:38.455575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306151+0000","last_change":"2024-09-15T23:12:13.303512+0000","last_active":"2024-09-15T23:12:13.306151+0000","last_peered":"2024-09-15T23:12:13.306151+0000","last_clean":"2024-09-15T23:12:13.306151+0000","last_became_active":"2024-09-15T23:12:13.303210+0000","last_became_peered":"2024-09-15T23:12:13.303210+0000","last_unstale":"2024-09-15T23:12:13.306151+0000","last_undegraded":"2024-09-15T23:12:13.306151+0000","last_fullsized":"2024-09-15T23:12:13.306151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:28.842608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.278465+0000","last_change":"2024-09-15T23:12:11.278465+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.278465+0000","last_undegraded":"2024-09-15T23:12:11.278465+0000","last_fullsized":"2024-09-15T23:12:11.278465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.282126+0000","last_change":"2024-09-15T23:12:12.295626+0000","last_active":"2024-09-15T23:12:13.282126+0000","last_peered":"2024-09-15T23:12:13.282126+0000","last_clean":"2024-09-15T23:12:13.282126+0000","last_became_active":"2024-09-15T23:12:12.295333+0000","last_became_peered":"2024-09-15T23:12:12.295333+0000","last_unstale":"2024-09-15T23:12:13.282126+0000","last_undegraded":"2024-09-15T23:12:13.282126+0000","last_fullsized":"2024-09-15T23:12:13.282126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:27:21.918750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.300128+0000","last_change":"2024-09-15T23:12:13.296636+0000","last_active":"2024-09-15T23:12:13.300128+0000","last_peered":"2024-09-15T23:12:13.300128+0000","last_clean":"2024-09-15T23:12:13.300128+0000","last_became_active":"2024-09-15T23:12:13.296172+0000","last_became_peered":"2024-09-15T23:12:13.296172+0000","last_unstale":"2024-09-15T23:12:13.300128+0000","last_undegraded":"2024-09-15T23:12:13.300128+0000","last_fullsized":"2024-09-15T23:12:13.300128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:54:01.331747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.287227+0000","last_change":"2024-09-15T23:12:12.296543+0000","last_active":"2024-09-15T23:12:13.287227+0000","last_peered":"2024-09-15T23:12:13.287227+0000","last_clean":"2024-09-15T23:12:13.287227+0000","last_became_active":"2024-09-15T23:12:12.296293+0000","last_became_peered":"2024-09-15T23:12:12.296293+0000","last_unstale":"2024-09-15T23:12:13.287227+0000","last_undegraded":"2024-09-15T23:12:13.287227+0000","last_fullsized":"2024-09-15T23:12:13.287227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:07:54.128353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.298710+0000","last_change":"2024-09-15T23:12:13.297331+0000","last_active":"2024-09-15T23:12:13.298710+0000","last_peered":"2024-09-15T23:12:13.298710+0000","last_clean":"2024-09-15T23:12:13.298710+0000","last_became_active":"2024-09-15T23:12:13.297036+0000","last_became_peered":"2024-09-15T23:12:13.297036+0000","last_unstale":"2024-09-15T23:12:13.298710+0000","last_undegraded":"2024-09-15T23:12:13.298710+0000","last_fullsized":"2024-09-15T23:12:13.298710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:07:55.135427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.276379+0000","last_change":"2024-09-15T23:12:11.276379+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.276379+0000","last_undegraded":"2024-09-15T23:12:11.276379+0000","last_fullsized":"2024-09-15T23:12:11.276379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.304776+0000","last_change":"2024-09-15T23:12:13.301636+0000","last_active":"2024-09-15T23:12:13.304776+0000","last_peered":"2024-09-15T23:12:13.304776+0000","last_clean":"2024-09-15T23:12:13.304776+0000","last_became_active":"2024-09-15T23:12:13.301390+0000","last_became_peered":"2024-09-15T23:12:13.301390+0000","last_unstale":"2024-09-15T23:12:13.304776+0000","last_undegraded":"2024-09-15T23:12:13.304776+0000","last_fullsized":"2024-09-15T23:12:13.304776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:29.584475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305413+0000","last_change":"2024-09-15T23:12:12.294164+0000","last_active":"2024-09-15T23:12:13.305413+0000","last_peered":"2024-09-15T23:12:13.305413+0000","last_clean":"2024-09-15T23:12:13.305413+0000","last_became_active":"2024-09-15T23:12:12.293619+0000","last_became_peered":"2024-09-15T23:12:12.293619+0000","last_unstale":"2024-09-15T23:12:13.305413+0000","last_undegraded":"2024-09-15T23:12:13.305413+0000","last_fullsized":"2024-09-15T23:12:13.305413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:46.714431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305317+0000","last_change":"2024-09-15T23:12:13.298781+0000","last_active":"2024-09-15T23:12:13.305317+0000","last_peered":"2024-09-15T23:12:13.305317+0000","last_clean":"2024-09-15T23:12:13.305317+0000","last_became_active":"2024-09-15T23:12:13.297968+0000","last_became_peered":"2024-09-15T23:12:13.297968+0000","last_unstale":"2024-09-15T23:12:13.305317+0000","last_undegraded":"2024-09-15T23:12:13.305317+0000","last_fullsized":"2024-09-15T23:12:13.305317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:44.465654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.278792+0000","last_change":"2024-09-15T23:12:11.278792+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.278792+0000","last_undegraded":"2024-09-15T23:12:11.278792+0000","last_fullsized":"2024-09-15T23:12:11.278792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305469+0000","last_change":"2024-09-15T23:12:13.296707+0000","last_active":"2024-09-15T23:12:13.305469+0000","last_peered":"2024-09-15T23:12:13.305469+0000","last_clean":"2024-09-15T23:12:13.305469+0000","last_became_active":"2024-09-15T23:12:13.296450+0000","last_became_peered":"2024-09-15T23:12:13.296450+0000","last_unstale":"2024-09-15T23:12:13.305469+0000","last_undegraded":"2024-09-15T23:12:13.305469+0000","last_fullsized":"2024-09-15T23:12:13.305469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:10:04.877140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.278550+0000","last_change":"2024-09-15T23:12:11.278550+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.278550+0000","last_undegraded":"2024-09-15T23:12:11.278550+0000","last_fullsized":"2024-09-15T23:12:11.278550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.307884+0000","last_change":"2024-09-15T23:12:13.306601+0000","last_active":"2024-09-15T23:12:13.307884+0000","last_peered":"2024-09-15T23:12:13.307884+0000","last_clean":"2024-09-15T23:12:13.307884+0000","last_became_active":"2024-09-15T23:12:13.306342+0000","last_became_peered":"2024-09-15T23:12:13.306342+0000","last_unstale":"2024-09-15T23:12:13.307884+0000","last_undegraded":"2024-09-15T23:12:13.307884+0000","last_fullsized":"2024-09-15T23:12:13.307884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:23:11.450569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.276618+0000","last_change":"2024-09-15T23:12:11.276618+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.276618+0000","last_undegraded":"2024-09-15T23:12:11.276618+0000","last_fullsized":"2024-09-15T23:12:11.276618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.294002+0000","last_change":"2024-09-15T23:12:13.292019+0000","last_active":"2024-09-15T23:12:13.294002+0000","last_peered":"2024-09-15T23:12:13.294002+0000","last_clean":"2024-09-15T23:12:13.294002+0000","last_became_active":"2024-09-15T23:12:13.290585+0000","last_became_peered":"2024-09-15T23:12:13.290585+0000","last_unstale":"2024-09-15T23:12:13.294002+0000","last_undegraded":"2024-09-15T23:12:13.294002+0000","last_fullsized":"2024-09-15T23:12:13.294002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:10:44.616598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.281241+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:12:13.281241+0000","last_peered":"2024-09-15T23:12:13.281241+0000","last_clean":"2024-09-15T23:12:13.281241+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:12:13.281241+0000","last_undegraded":"2024-09-15T23:12:13.281241+0000","last_fullsized":"2024-09-15T23:12:13.281241+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.283904+0000","last_change":"2024-09-15T23:12:12.295819+0000","last_active":"2024-09-15T23:12:13.283904+0000","last_peered":"2024-09-15T23:12:13.283904+0000","last_clean":"2024-09-15T23:12:13.283904+0000","last_became_active":"2024-09-15T23:12:12.295320+0000","last_became_peered":"2024-09-15T23:12:12.295320+0000","last_unstale":"2024-09-15T23:12:13.283904+0000","last_undegraded":"2024-09-15T23:12:13.283904+0000","last_fullsized":"2024-09-15T23:12:13.283904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:13.348463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.281967+0000","last_change":"2024-09-15T23:12:12.293545+0000","last_active":"2024-09-15T23:12:13.281967+0000","last_peered":"2024-09-15T23:12:13.281967+0000","last_clean":"2024-09-15T23:12:13.281967+0000","last_became_active":"2024-09-15T23:12:12.292903+0000","last_became_peered":"2024-09-15T23:12:12.292903+0000","last_unstale":"2024-09-15T23:12:13.281967+0000","last_undegraded":"2024-09-15T23:12:13.281967+0000","last_fullsized":"2024-09-15T23:12:13.281967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:46.714431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.278080+0000","last_change":"2024-09-15T23:12:11.278080+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.278080+0000","last_undegraded":"2024-09-15T23:12:11.278080+0000","last_fullsized":"2024-09-15T23:12:11.278080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.282268+0000","last_change":"2024-09-15T23:12:12.300290+0000","last_active":"2024-09-15T23:12:13.282268+0000","last_peered":"2024-09-15T23:12:13.282268+0000","last_clean":"2024-09-15T23:12:13.282268+0000","last_became_active":"2024-09-15T23:12:12.300024+0000","last_became_peered":"2024-09-15T23:12:12.300024+0000","last_unstale":"2024-09-15T23:12:13.282268+0000","last_undegraded":"2024-09-15T23:12:13.282268+0000","last_fullsized":"2024-09-15T23:12:13.282268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:10:03.870065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306057+0000","last_change":"2024-09-15T23:12:13.300590+0000","last_active":"2024-09-15T23:12:13.306057+0000","last_peered":"2024-09-15T23:12:13.306057+0000","last_clean":"2024-09-15T23:12:13.306057+0000","last_became_active":"2024-09-15T23:12:13.300376+0000","last_became_peered":"2024-09-15T23:12:13.300376+0000","last_unstale":"2024-09-15T23:12:13.306057+0000","last_undegraded":"2024-09-15T23:12:13.306057+0000","last_fullsized":"2024-09-15T23:12:13.306057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:14.355538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.279105+0000","last_change":"2024-09-15T23:12:11.279105+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.279105+0000","last_undegraded":"2024-09-15T23:12:11.279105+0000","last_fullsized":"2024-09-15T23:12:11.279105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305592+0000","last_change":"2024-09-15T23:12:13.300154+0000","last_active":"2024-09-15T23:12:13.305592+0000","last_peered":"2024-09-15T23:12:13.305592+0000","last_clean":"2024-09-15T23:12:13.305592+0000","last_became_active":"2024-09-15T23:12:13.299919+0000","last_became_peered":"2024-09-15T23:12:13.299919+0000","last_unstale":"2024-09-15T23:12:13.305592+0000","last_undegraded":"2024-09-15T23:12:13.305592+0000","last_fullsized":"2024-09-15T23:12:13.305592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:42:51.295319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.282980+0000","last_change":"2024-09-15T23:12:12.296791+0000","last_active":"2024-09-15T23:12:13.282980+0000","last_peered":"2024-09-15T23:12:13.282980+0000","last_clean":"2024-09-15T23:12:13.282980+0000","last_became_active":"2024-09-15T23:12:12.296507+0000","last_became_peered":"2024-09-15T23:12:12.296507+0000","last_unstale":"2024-09-15T23:12:13.282980+0000","last_undegraded":"2024-09-15T23:12:13.282980+0000","last_fullsized":"2024-09-15T23:12:13.282980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:08:50.152082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.276797+0000","last_change":"2024-09-15T23:12:11.276797+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.276797+0000","last_undegraded":"2024-09-15T23:12:11.276797+0000","last_fullsized":"2024-09-15T23:12:11.276797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.307939+0000","last_change":"2024-09-15T23:12:12.297628+0000","last_active":"2024-09-15T23:12:13.307939+0000","last_peered":"2024-09-15T23:12:13.307939+0000","last_clean":"2024-09-15T23:12:13.307939+0000","last_became_active":"2024-09-15T23:12:12.297392+0000","last_became_peered":"2024-09-15T23:12:12.297392+0000","last_unstale":"2024-09-15T23:12:13.307939+0000","last_undegraded":"2024-09-15T23:12:13.307939+0000","last_fullsized":"2024-09-15T23:12:13.307939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:26:21.303262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.286852+0000","last_change":"2024-09-15T23:12:12.292922+0000","last_active":"2024-09-15T23:12:13.286852+0000","last_peered":"2024-09-15T23:12:13.286852+0000","last_clean":"2024-09-15T23:12:13.286852+0000","last_became_active":"2024-09-15T23:12:12.292606+0000","last_became_peered":"2024-09-15T23:12:12.292606+0000","last_unstale":"2024-09-15T23:12:13.286852+0000","last_undegraded":"2024-09-15T23:12:13.286852+0000","last_fullsized":"2024-09-15T23:12:13.286852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:25.929262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.304754+0000","last_change":"2024-09-15T23:12:13.300968+0000","last_active":"2024-09-15T23:12:13.304754+0000","last_peered":"2024-09-15T23:12:13.304754+0000","last_clean":"2024-09-15T23:12:13.304754+0000","last_became_active":"2024-09-15T23:12:13.300679+0000","last_became_peered":"2024-09-15T23:12:13.300679+0000","last_unstale":"2024-09-15T23:12:13.304754+0000","last_undegraded":"2024-09-15T23:12:13.304754+0000","last_fullsized":"2024-09-15T23:12:13.304754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:10.165586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.277263+0000","last_change":"2024-09-15T23:12:11.277263+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.277263+0000","last_undegraded":"2024-09-15T23:12:11.277263+0000","last_fullsized":"2024-09-15T23:12:11.277263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.276820+0000","last_change":"2024-09-15T23:12:11.276820+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.276820+0000","last_undegraded":"2024-09-15T23:12:11.276820+0000","last_fullsized":"2024-09-15T23:12:11.276820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306625+0000","last_change":"2024-09-15T23:12:12.295599+0000","last_active":"2024-09-15T23:12:13.306625+0000","last_peered":"2024-09-15T23:12:13.306625+0000","last_clean":"2024-09-15T23:12:13.306625+0000","last_became_active":"2024-09-15T23:12:12.295036+0000","last_became_peered":"2024-09-15T23:12:12.295036+0000","last_unstale":"2024-09-15T23:12:13.306625+0000","last_undegraded":"2024-09-15T23:12:13.306625+0000","last_fullsized":"2024-09-15T23:12:13.306625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:03.815413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.294113+0000","last_change":"2024-09-15T23:12:13.292087+0000","last_active":"2024-09-15T23:12:13.294113+0000","last_peered":"2024-09-15T23:12:13.294113+0000","last_clean":"2024-09-15T23:12:13.294113+0000","last_became_active":"2024-09-15T23:12:13.291588+0000","last_became_peered":"2024-09-15T23:12:13.291588+0000","last_unstale":"2024-09-15T23:12:13.294113+0000","last_undegraded":"2024-09-15T23:12:13.294113+0000","last_fullsized":"2024-09-15T23:12:13.294113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:28.842608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.300062+0000","last_change":"2024-09-15T23:12:13.295583+0000","last_active":"2024-09-15T23:12:13.300062+0000","last_peered":"2024-09-15T23:12:13.300062+0000","last_clean":"2024-09-15T23:12:13.300062+0000","last_became_active":"2024-09-15T23:12:13.295285+0000","last_became_peered":"2024-09-15T23:12:13.295285+0000","last_unstale":"2024-09-15T23:12:13.300062+0000","last_undegraded":"2024-09-15T23:12:13.300062+0000","last_fullsized":"2024-09-15T23:12:13.300062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:23:11.450569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305733+0000","last_change":"2024-09-15T23:12:12.293704+0000","last_active":"2024-09-15T23:12:13.305733+0000","last_peered":"2024-09-15T23:12:13.305733+0000","last_clean":"2024-09-15T23:12:13.305733+0000","last_became_active":"2024-09-15T23:12:12.292898+0000","last_became_peered":"2024-09-15T23:12:12.292898+0000","last_unstale":"2024-09-15T23:12:13.305733+0000","last_undegraded":"2024-09-15T23:12:13.305733+0000","last_fullsized":"2024-09-15T23:12:13.305733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:27.285153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.298233+0000","last_change":"2024-09-15T23:12:13.295743+0000","last_active":"2024-09-15T23:12:13.298233+0000","last_peered":"2024-09-15T23:12:13.298233+0000","last_clean":"2024-09-15T23:12:13.298233+0000","last_became_active":"2024-09-15T23:12:13.295104+0000","last_became_peered":"2024-09-15T23:12:13.295104+0000","last_unstale":"2024-09-15T23:12:13.298233+0000","last_undegraded":"2024-09-15T23:12:13.298233+0000","last_fullsized":"2024-09-15T23:12:13.298233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:42:51.295319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.302127+0000","last_change":"2024-09-15T23:12:12.293296+0000","last_active":"2024-09-15T23:12:13.302127+0000","last_peered":"2024-09-15T23:12:13.302127+0000","last_clean":"2024-09-15T23:12:13.302127+0000","last_became_active":"2024-09-15T23:12:12.292920+0000","last_became_peered":"2024-09-15T23:12:12.292920+0000","last_unstale":"2024-09-15T23:12:13.302127+0000","last_undegraded":"2024-09-15T23:12:13.302127+0000","last_fullsized":"2024-09-15T23:12:13.302127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:17.787033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.278380+0000","last_change":"2024-09-15T23:12:11.278380+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.278380+0000","last_undegraded":"2024-09-15T23:12:11.278380+0000","last_fullsized":"2024-09-15T23:12:11.278380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.276392+0000","last_change":"2024-09-15T23:12:11.276392+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.276392+0000","last_undegraded":"2024-09-15T23:12:11.276392+0000","last_fullsized":"2024-09-15T23:12:11.276392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":70,"acting":70,"num_store_stats":4},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1634,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476743,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":192512,"data_stored":63389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476740,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":192512,"data_stored":63389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476742,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":786432,"data_stored":653757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476742,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":192512,"data_stored":63389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":167936,"data_stored":51297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":167936,"data_stored":51297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542147,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28396,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343444,"statfs":{"total":96636764160,"available":96607686656,"internally_reserved":0,"allocated":761856,"data_stored":641665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":167936,"data_stored":51297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:12:16.577 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:12:16.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.711+0000 7fa88b58d640 1 Processor -- start 2024-09-15T23:12:16.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.712+0000 7fa88b58d640 1 -- start start 2024-09-15T23:12:16.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.712+0000 7fa88b58d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa884158f80 0x7fa884071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:16.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.712+0000 7fa88b58d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa88415b9a0 0x7fa8840b6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:16.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.712+0000 7fa88b58d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa8840b70a0 0x7fa88415ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:16.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.712+0000 7fa88b58d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fa8840b74d0 con 0x7fa88415b9a0 2024-09-15T23:12:16.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.712+0000 7fa88b58d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fa884072930 con 0x7fa8840b70a0 2024-09-15T23:12:16.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.712+0000 7fa88b58d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa884072c10 con 0x7fa884158f80 2024-09-15T23:12:16.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.712+0000 7fa888b28640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa88415b9a0 0x7fa8840b6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:16.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.712+0000 7fa888b28640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa88415b9a0 0x7fa8840b6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36070/0 (socket says 172.21.15.123:36070) 2024-09-15T23:12:16.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.712+0000 7fa888b28640 1 -- 172.21.15.123:0/1095876965 learned_addr learned my addr 172.21.15.123:0/1095876965 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:16.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.713+0000 7fa888b28640 1 -- 172.21.15.123:0/1095876965 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa884158f80 msgr2=0x7fa884071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:16.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.713+0000 7fa889b2a640 1 --2- 172.21.15.123:0/1095876965 >> v2:172.21.15.188:3300/0 conn(0x7fa8840b70a0 0x7fa88415ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:16.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.713+0000 7fa889329640 1 --2- 172.21.15.123:0/1095876965 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa884158f80 0x7fa884071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:16.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.713+0000 7fa888b28640 1 --2- 172.21.15.123:0/1095876965 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa884158f80 0x7fa884071fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:16.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.713+0000 7fa888b28640 1 -- 172.21.15.123:0/1095876965 >> v2:172.21.15.188:3300/0 conn(0x7fa8840b70a0 msgr2=0x7fa88415ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:16.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.713+0000 7fa888b28640 1 --2- 172.21.15.123:0/1095876965 >> v2:172.21.15.188:3300/0 conn(0x7fa8840b70a0 0x7fa88415ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:16.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.713+0000 7fa888b28640 1 -- 172.21.15.123:0/1095876965 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa884072ef0 con 0x7fa88415b9a0 2024-09-15T23:12:16.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.713+0000 7fa889b2a640 1 --2- 172.21.15.123:0/1095876965 >> v2:172.21.15.188:3300/0 conn(0x7fa8840b70a0 0x7fa88415ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:16.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.713+0000 7fa889329640 1 --2- 172.21.15.123:0/1095876965 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa884158f80 0x7fa884071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:16.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.713+0000 7fa888b28640 1 --2- 172.21.15.123:0/1095876965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa88415b9a0 0x7fa8840b6b60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa8840b1200 tx=0x7fa87402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf571c05e287fd31 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:16.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.714+0000 7fa87bfff640 1 -- 172.21.15.123:0/1095876965 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa874037070 con 0x7fa88415b9a0 2024-09-15T23:12:16.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.714+0000 7fa87bfff640 1 -- 172.21.15.123:0/1095876965 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa874032440 con 0x7fa88415b9a0 2024-09-15T23:12:16.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.714+0000 7fa87bfff640 1 -- 172.21.15.123:0/1095876965 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa874032810 con 0x7fa88415b9a0 2024-09-15T23:12:16.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.714+0000 7fa88b58d640 1 -- 172.21.15.123:0/1095876965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa88415b9a0 msgr2=0x7fa8840b6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:16.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.714+0000 7fa88b58d640 1 --2- 172.21.15.123:0/1095876965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa88415b9a0 0x7fa8840b6b60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa8840b1200 tx=0x7fa87402a1e0 comp rx=0 tx=0).stop 2024-09-15T23:12:16.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.714+0000 7fa88b58d640 1 -- 172.21.15.123:0/1095876965 shutdown_connections 2024-09-15T23:12:16.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.714+0000 7fa88b58d640 1 --2- 172.21.15.123:0/1095876965 >> v2:172.21.15.188:3300/0 conn(0x7fa8840b70a0 0x7fa88415ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:16.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.714+0000 7fa88b58d640 1 --2- 172.21.15.123:0/1095876965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa88415b9a0 0x7fa8840b6b60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:16.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.714+0000 7fa88b58d640 1 --2- 172.21.15.123:0/1095876965 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa884158f80 0x7fa884071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:16.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.714+0000 7fa88b58d640 1 -- 172.21.15.123:0/1095876965 >> 172.21.15.123:0/1095876965 conn(0x7fa88406cd20 msgr2=0x7fa88406d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:16.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.714+0000 7fa88b58d640 1 -- 172.21.15.123:0/1095876965 shutdown_connections 2024-09-15T23:12:16.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.714+0000 7fa88b58d640 1 -- 172.21.15.123:0/1095876965 wait complete. 2024-09-15T23:12:16.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.715+0000 7fa88b58d640 1 Processor -- start 2024-09-15T23:12:16.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.715+0000 7fa88b58d640 1 -- start start 2024-09-15T23:12:16.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.716+0000 7fa88b58d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8840b70a0 0x7fa8840cf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:16.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.716+0000 7fa88b58d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa884158f80 0x7fa884153e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:16.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.716+0000 7fa88b58d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa88415b9a0 0x7fa884142b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:16.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.716+0000 7fa88b58d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa884072500 con 0x7fa88415b9a0 2024-09-15T23:12:16.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.716+0000 7fa88b58d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa8840734b0 con 0x7fa884158f80 2024-09-15T23:12:16.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.716+0000 7fa88b58d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa884072680 con 0x7fa8840b70a0 2024-09-15T23:12:16.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.716+0000 7fa889b2a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa88415b9a0 0x7fa884142b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:16.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.716+0000 7fa889b2a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa88415b9a0 0x7fa884142b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36078/0 (socket says 172.21.15.123:36078) 2024-09-15T23:12:16.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.716+0000 7fa889b2a640 1 -- 172.21.15.123:0/1388274398 learned_addr learned my addr 172.21.15.123:0/1388274398 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:16.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.716+0000 7fa888b28640 1 --2- 172.21.15.123:0/1388274398 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa884158f80 0x7fa884153e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:16.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.716+0000 7fa889b2a640 1 -- 172.21.15.123:0/1388274398 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8840b70a0 msgr2=0x7fa8840cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:16.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.716+0000 7fa889329640 1 --2- 172.21.15.123:0/1388274398 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8840b70a0 0x7fa8840cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:16.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.716+0000 7fa889b2a640 1 --2- 172.21.15.123:0/1388274398 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8840b70a0 0x7fa8840cf700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:16.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.717+0000 7fa889b2a640 1 -- 172.21.15.123:0/1388274398 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa884158f80 msgr2=0x7fa884153e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:16.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.717+0000 7fa889b2a640 1 --2- 172.21.15.123:0/1388274398 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa884158f80 0x7fa884153e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:16.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.717+0000 7fa889b2a640 1 -- 172.21.15.123:0/1388274398 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa88415cd40 con 0x7fa88415b9a0 2024-09-15T23:12:16.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.717+0000 7fa888b28640 1 --2- 172.21.15.123:0/1388274398 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa884158f80 0x7fa884153e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:16.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.717+0000 7fa889329640 1 --2- 172.21.15.123:0/1388274398 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8840b70a0 0x7fa8840cf700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:16.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.717+0000 7fa889b2a640 1 --2- 172.21.15.123:0/1388274398 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa88415b9a0 0x7fa884142b10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa87c00cd80 tx=0x7fa87c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:16.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.717+0000 7fa879ffb640 1 -- 172.21.15.123:0/1388274398 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa87c00f680 con 0x7fa88415b9a0 2024-09-15T23:12:16.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.717+0000 7fa879ffb640 1 -- 172.21.15.123:0/1388274398 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa87c00f840 con 0x7fa88415b9a0 2024-09-15T23:12:16.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.717+0000 7fa88b58d640 1 -- 172.21.15.123:0/1388274398 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8841548b0 con 0x7fa88415b9a0 2024-09-15T23:12:16.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.717+0000 7fa879ffb640 1 -- 172.21.15.123:0/1388274398 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa87c00fc30 con 0x7fa88415b9a0 2024-09-15T23:12:16.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.717+0000 7fa88b58d640 1 -- 172.21.15.123:0/1388274398 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa88415d000 con 0x7fa88415b9a0 2024-09-15T23:12:16.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.718+0000 7fa88b58d640 1 -- 172.21.15.123:0/1388274398 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa884073a60 con 0x7fa88415b9a0 2024-09-15T23:12:16.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.718+0000 7fa879ffb640 1 -- 172.21.15.123:0/1388274398 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa87c0213f0 con 0x7fa88415b9a0 2024-09-15T23:12:16.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.719+0000 7fa879ffb640 1 --2- 172.21.15.123:0/1388274398 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa86806c2b0 0x7fa86806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:16.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.719+0000 7fa879ffb640 1 -- 172.21.15.123:0/1388274398 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fa87c08c140 con 0x7fa88415b9a0 2024-09-15T23:12:16.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.719+0000 7fa889329640 1 --2- 172.21.15.123:0/1388274398 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa86806c2b0 0x7fa86806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:16.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.719+0000 7fa889329640 1 --2- 172.21.15.123:0/1388274398 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa86806c2b0 0x7fa86806e770 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa880006fd0 tx=0x7fa880008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:16.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.723+0000 7fa879ffb640 1 -- 172.21.15.123:0/1388274398 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa8841548b0 con 0x7fa88415b9a0 2024-09-15T23:12:16.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.884+0000 7fa88b58d640 1 -- 172.21.15.123:0/1388274398 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa88415d200 con 0x7fa86806c2b0 2024-09-15T23:12:16.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.890+0000 7fa879ffb640 1 -- 172.21.15.123:0/1388274398 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246394 (secure 0 0 0) 0x7fa88415d200 con 0x7fa86806c2b0 2024-09-15T23:12:16.893 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:16.894 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:12:16.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.893+0000 7fa88b58d640 1 -- 172.21.15.123:0/1388274398 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa86806c2b0 msgr2=0x7fa86806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:16.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.893+0000 7fa88b58d640 1 --2- 172.21.15.123:0/1388274398 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa86806c2b0 0x7fa86806e770 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa880006fd0 tx=0x7fa880008040 comp rx=0 tx=0).stop 2024-09-15T23:12:16.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.893+0000 7fa88b58d640 1 -- 172.21.15.123:0/1388274398 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa88415b9a0 msgr2=0x7fa884142b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:16.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.893+0000 7fa88b58d640 1 --2- 172.21.15.123:0/1388274398 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa88415b9a0 0x7fa884142b10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa87c00cd80 tx=0x7fa87c00a650 comp rx=0 tx=0).stop 2024-09-15T23:12:16.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.893+0000 7fa88b58d640 1 -- 172.21.15.123:0/1388274398 shutdown_connections 2024-09-15T23:12:16.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.893+0000 7fa88b58d640 1 --2- 172.21.15.123:0/1388274398 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa86806c2b0 0x7fa86806e770 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:16.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.893+0000 7fa88b58d640 1 --2- 172.21.15.123:0/1388274398 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa88415b9a0 0x7fa884142b10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:16.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.893+0000 7fa88b58d640 1 --2- 172.21.15.123:0/1388274398 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa884158f80 0x7fa884153e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:16.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.893+0000 7fa88b58d640 1 --2- 172.21.15.123:0/1388274398 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8840b70a0 0x7fa8840cf700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:16.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.893+0000 7fa88b58d640 1 -- 172.21.15.123:0/1388274398 >> 172.21.15.123:0/1388274398 conn(0x7fa88406cd20 msgr2=0x7fa8840b2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:16.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.893+0000 7fa88b58d640 1 -- 172.21.15.123:0/1388274398 shutdown_connections 2024-09-15T23:12:16.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:16.893+0000 7fa88b58d640 1 -- 172.21.15.123:0/1388274398 wait complete. 2024-09-15T23:12:16.904 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-15T23:12:15.502629+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592002,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":176,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":136,"acting":136,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":53,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219444,"kb_used_data":2568,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755276,"statfs":{"total":773094113280,"available":772869402624,"internally_reserved":0,"allocated":2629632,"data_stored":1639480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1634,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.230780"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.307270+0000","last_change":"2024-09-15T23:12:13.304372+0000","last_active":"2024-09-15T23:12:13.307270+0000","last_peered":"2024-09-15T23:12:13.307270+0000","last_clean":"2024-09-15T23:12:13.307270+0000","last_became_active":"2024-09-15T23:12:13.304067+0000","last_became_peered":"2024-09-15T23:12:13.304067+0000","last_unstale":"2024-09-15T23:12:13.307270+0000","last_undegraded":"2024-09-15T23:12:13.307270+0000","last_fullsized":"2024-09-15T23:12:13.307270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:44.688079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306250+0000","last_change":"2024-09-15T23:12:13.302730+0000","last_active":"2024-09-15T23:12:13.306250+0000","last_peered":"2024-09-15T23:12:13.306250+0000","last_clean":"2024-09-15T23:12:13.306250+0000","last_became_active":"2024-09-15T23:12:13.302301+0000","last_became_peered":"2024-09-15T23:12:13.302301+0000","last_unstale":"2024-09-15T23:12:13.306250+0000","last_undegraded":"2024-09-15T23:12:13.306250+0000","last_fullsized":"2024-09-15T23:12:13.306250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:18.794107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306036+0000","last_change":"2024-09-15T23:12:13.298592+0000","last_active":"2024-09-15T23:12:13.306036+0000","last_peered":"2024-09-15T23:12:13.306036+0000","last_clean":"2024-09-15T23:12:13.306036+0000","last_became_active":"2024-09-15T23:12:13.298358+0000","last_became_peered":"2024-09-15T23:12:13.298358+0000","last_unstale":"2024-09-15T23:12:13.306036+0000","last_undegraded":"2024-09-15T23:12:13.306036+0000","last_fullsized":"2024-09-15T23:12:13.306036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:26:22.310337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306639+0000","last_change":"2024-09-15T23:12:13.302119+0000","last_active":"2024-09-15T23:12:13.306639+0000","last_peered":"2024-09-15T23:12:13.306639+0000","last_clean":"2024-09-15T23:12:13.306639+0000","last_became_active":"2024-09-15T23:12:13.301671+0000","last_became_peered":"2024-09-15T23:12:13.301671+0000","last_unstale":"2024-09-15T23:12:13.306639+0000","last_undegraded":"2024-09-15T23:12:13.306639+0000","last_fullsized":"2024-09-15T23:12:13.306639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:07:55.135427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306124+0000","last_change":"2024-09-15T23:12:13.301523+0000","last_active":"2024-09-15T23:12:13.306124+0000","last_peered":"2024-09-15T23:12:13.306124+0000","last_clean":"2024-09-15T23:12:13.306124+0000","last_became_active":"2024-09-15T23:12:13.301272+0000","last_became_peered":"2024-09-15T23:12:13.301272+0000","last_unstale":"2024-09-15T23:12:13.306124+0000","last_undegraded":"2024-09-15T23:12:13.306124+0000","last_fullsized":"2024-09-15T23:12:13.306124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:10:44.616598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.298276+0000","last_change":"2024-09-15T23:12:13.295501+0000","last_active":"2024-09-15T23:12:13.298276+0000","last_peered":"2024-09-15T23:12:13.298276+0000","last_clean":"2024-09-15T23:12:13.298276+0000","last_became_active":"2024-09-15T23:12:13.294470+0000","last_became_peered":"2024-09-15T23:12:13.294470+0000","last_unstale":"2024-09-15T23:12:13.298276+0000","last_undegraded":"2024-09-15T23:12:13.298276+0000","last_fullsized":"2024-09-15T23:12:13.298276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:12.050480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305974+0000","last_change":"2024-09-15T23:12:13.300057+0000","last_active":"2024-09-15T23:12:13.305974+0000","last_peered":"2024-09-15T23:12:13.305974+0000","last_clean":"2024-09-15T23:12:13.305974+0000","last_became_active":"2024-09-15T23:12:13.299762+0000","last_became_peered":"2024-09-15T23:12:13.299762+0000","last_unstale":"2024-09-15T23:12:13.305974+0000","last_undegraded":"2024-09-15T23:12:13.305974+0000","last_fullsized":"2024-09-15T23:12:13.305974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:04.822487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306016+0000","last_change":"2024-09-15T23:12:13.296975+0000","last_active":"2024-09-15T23:12:13.306016+0000","last_peered":"2024-09-15T23:12:13.306016+0000","last_clean":"2024-09-15T23:12:13.306016+0000","last_became_active":"2024-09-15T23:12:13.296726+0000","last_became_peered":"2024-09-15T23:12:13.296726+0000","last_unstale":"2024-09-15T23:12:13.306016+0000","last_undegraded":"2024-09-15T23:12:13.306016+0000","last_fullsized":"2024-09-15T23:12:13.306016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:08:51.159156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306882+0000","last_change":"2024-09-15T23:12:13.299790+0000","last_active":"2024-09-15T23:12:13.306882+0000","last_peered":"2024-09-15T23:12:13.306882+0000","last_clean":"2024-09-15T23:12:13.306882+0000","last_became_active":"2024-09-15T23:12:13.299446+0000","last_became_peered":"2024-09-15T23:12:13.299446+0000","last_unstale":"2024-09-15T23:12:13.306882+0000","last_undegraded":"2024-09-15T23:12:13.306882+0000","last_fullsized":"2024-09-15T23:12:13.306882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:03.932670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305700+0000","last_change":"2024-09-15T23:12:13.302744+0000","last_active":"2024-09-15T23:12:13.305700+0000","last_peered":"2024-09-15T23:12:13.305700+0000","last_clean":"2024-09-15T23:12:13.305700+0000","last_became_active":"2024-09-15T23:12:13.302439+0000","last_became_peered":"2024-09-15T23:12:13.302439+0000","last_unstale":"2024-09-15T23:12:13.305700+0000","last_undegraded":"2024-09-15T23:12:13.305700+0000","last_fullsized":"2024-09-15T23:12:13.305700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:02.914486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.303650+0000","last_change":"2024-09-15T23:12:13.298338+0000","last_active":"2024-09-15T23:12:13.303650+0000","last_peered":"2024-09-15T23:12:13.303650+0000","last_clean":"2024-09-15T23:12:13.303650+0000","last_became_active":"2024-09-15T23:12:13.297884+0000","last_became_peered":"2024-09-15T23:12:13.297884+0000","last_unstale":"2024-09-15T23:12:13.303650+0000","last_undegraded":"2024-09-15T23:12:13.303650+0000","last_fullsized":"2024-09-15T23:12:13.303650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:11.528380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.303721+0000","last_change":"2024-09-15T23:12:13.300688+0000","last_active":"2024-09-15T23:12:13.303721+0000","last_peered":"2024-09-15T23:12:13.303721+0000","last_clean":"2024-09-15T23:12:13.303721+0000","last_became_active":"2024-09-15T23:12:13.300388+0000","last_became_peered":"2024-09-15T23:12:13.300388+0000","last_unstale":"2024-09-15T23:12:13.303721+0000","last_undegraded":"2024-09-15T23:12:13.303721+0000","last_fullsized":"2024-09-15T23:12:13.303721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:25.899342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305775+0000","last_change":"2024-09-15T23:12:13.295852+0000","last_active":"2024-09-15T23:12:13.305775+0000","last_peered":"2024-09-15T23:12:13.305775+0000","last_clean":"2024-09-15T23:12:13.305775+0000","last_became_active":"2024-09-15T23:12:13.295536+0000","last_became_peered":"2024-09-15T23:12:13.295536+0000","last_unstale":"2024-09-15T23:12:13.305775+0000","last_undegraded":"2024-09-15T23:12:13.305775+0000","last_fullsized":"2024-09-15T23:12:13.305775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:27:22.925825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.298303+0000","last_change":"2024-09-15T23:12:13.296548+0000","last_active":"2024-09-15T23:12:13.298303+0000","last_peered":"2024-09-15T23:12:13.298303+0000","last_clean":"2024-09-15T23:12:13.298303+0000","last_became_active":"2024-09-15T23:12:13.294814+0000","last_became_peered":"2024-09-15T23:12:13.294814+0000","last_unstale":"2024-09-15T23:12:13.298303+0000","last_undegraded":"2024-09-15T23:12:13.298303+0000","last_fullsized":"2024-09-15T23:12:13.298303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:26.936337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.295166+0000","last_change":"2024-09-15T23:12:13.293872+0000","last_active":"2024-09-15T23:12:13.295166+0000","last_peered":"2024-09-15T23:12:13.295166+0000","last_clean":"2024-09-15T23:12:13.295166+0000","last_became_active":"2024-09-15T23:12:13.293608+0000","last_became_peered":"2024-09-15T23:12:13.293608+0000","last_unstale":"2024-09-15T23:12:13.295166+0000","last_undegraded":"2024-09-15T23:12:13.295166+0000","last_fullsized":"2024-09-15T23:12:13.295166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:44.688079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305427+0000","last_change":"2024-09-15T23:12:13.299195+0000","last_active":"2024-09-15T23:12:13.305427+0000","last_peered":"2024-09-15T23:12:13.305427+0000","last_clean":"2024-09-15T23:12:13.305427+0000","last_became_active":"2024-09-15T23:12:13.298466+0000","last_became_peered":"2024-09-15T23:12:13.298466+0000","last_unstale":"2024-09-15T23:12:13.305427+0000","last_undegraded":"2024-09-15T23:12:13.305427+0000","last_fullsized":"2024-09-15T23:12:13.305427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:12.050480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.294094+0000","last_change":"2024-09-15T23:12:13.291856+0000","last_active":"2024-09-15T23:12:13.294094+0000","last_peered":"2024-09-15T23:12:13.294094+0000","last_clean":"2024-09-15T23:12:13.294094+0000","last_became_active":"2024-09-15T23:12:13.291050+0000","last_became_peered":"2024-09-15T23:12:13.291050+0000","last_unstale":"2024-09-15T23:12:13.294094+0000","last_undegraded":"2024-09-15T23:12:13.294094+0000","last_fullsized":"2024-09-15T23:12:13.294094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:03.932670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306973+0000","last_change":"2024-09-15T23:12:13.300877+0000","last_active":"2024-09-15T23:12:13.306973+0000","last_peered":"2024-09-15T23:12:13.306973+0000","last_clean":"2024-09-15T23:12:13.306973+0000","last_became_active":"2024-09-15T23:12:13.300604+0000","last_became_peered":"2024-09-15T23:12:13.300604+0000","last_unstale":"2024-09-15T23:12:13.306973+0000","last_undegraded":"2024-09-15T23:12:13.306973+0000","last_fullsized":"2024-09-15T23:12:13.306973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:26.936337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.292269+0000","last_change":"2024-09-15T23:12:13.290806+0000","last_active":"2024-09-15T23:12:13.292269+0000","last_peered":"2024-09-15T23:12:13.292269+0000","last_clean":"2024-09-15T23:12:13.292269+0000","last_became_active":"2024-09-15T23:12:13.290534+0000","last_became_peered":"2024-09-15T23:12:13.290534+0000","last_unstale":"2024-09-15T23:12:13.292269+0000","last_undegraded":"2024-09-15T23:12:13.292269+0000","last_fullsized":"2024-09-15T23:12:13.292269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:55.317051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.278188+0000","last_change":"2024-09-15T23:12:11.278188+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.278188+0000","last_undegraded":"2024-09-15T23:12:11.278188+0000","last_fullsized":"2024-09-15T23:12:11.278188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.308359+0000","last_change":"2024-09-15T23:12:12.297601+0000","last_active":"2024-09-15T23:12:13.308359+0000","last_peered":"2024-09-15T23:12:13.308359+0000","last_clean":"2024-09-15T23:12:13.308359+0000","last_became_active":"2024-09-15T23:12:12.297353+0000","last_became_peered":"2024-09-15T23:12:12.297353+0000","last_unstale":"2024-09-15T23:12:13.308359+0000","last_undegraded":"2024-09-15T23:12:13.308359+0000","last_fullsized":"2024-09-15T23:12:13.308359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:27.285153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.276572+0000","last_change":"2024-09-15T23:12:11.276572+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.276572+0000","last_undegraded":"2024-09-15T23:12:11.276572+0000","last_fullsized":"2024-09-15T23:12:11.276572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.281818+0000","last_change":"2024-09-15T23:12:12.294030+0000","last_active":"2024-09-15T23:12:13.281818+0000","last_peered":"2024-09-15T23:12:13.281818+0000","last_clean":"2024-09-15T23:12:13.281818+0000","last_became_active":"2024-09-15T23:12:12.293252+0000","last_became_peered":"2024-09-15T23:12:12.293252+0000","last_unstale":"2024-09-15T23:12:13.281818+0000","last_undegraded":"2024-09-15T23:12:13.281818+0000","last_fullsized":"2024-09-15T23:12:13.281818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:29.072753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.280716+0000","last_change":"2024-09-15T23:12:12.296404+0000","last_active":"2024-09-15T23:12:13.280716+0000","last_peered":"2024-09-15T23:12:13.280716+0000","last_clean":"2024-09-15T23:12:13.280716+0000","last_became_active":"2024-09-15T23:12:12.296128+0000","last_became_peered":"2024-09-15T23:12:12.296128+0000","last_unstale":"2024-09-15T23:12:13.280716+0000","last_undegraded":"2024-09-15T23:12:13.280716+0000","last_fullsized":"2024-09-15T23:12:13.280716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:43.458579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305382+0000","last_change":"2024-09-15T23:12:13.298997+0000","last_active":"2024-09-15T23:12:13.305382+0000","last_peered":"2024-09-15T23:12:13.305382+0000","last_clean":"2024-09-15T23:12:13.305382+0000","last_became_active":"2024-09-15T23:12:13.298225+0000","last_became_peered":"2024-09-15T23:12:13.298225+0000","last_unstale":"2024-09-15T23:12:13.305382+0000","last_undegraded":"2024-09-15T23:12:13.305382+0000","last_fullsized":"2024-09-15T23:12:13.305382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:55.317051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.288734+0000","last_change":"2024-09-15T23:12:12.294378+0000","last_active":"2024-09-15T23:12:13.288734+0000","last_peered":"2024-09-15T23:12:13.288734+0000","last_clean":"2024-09-15T23:12:13.288734+0000","last_became_active":"2024-09-15T23:12:12.294028+0000","last_became_peered":"2024-09-15T23:12:12.294028+0000","last_unstale":"2024-09-15T23:12:13.288734+0000","last_undegraded":"2024-09-15T23:12:13.288734+0000","last_fullsized":"2024-09-15T23:12:13.288734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:29.072753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.278408+0000","last_change":"2024-09-15T23:12:11.278408+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.278408+0000","last_undegraded":"2024-09-15T23:12:11.278408+0000","last_fullsized":"2024-09-15T23:12:11.278408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305259+0000","last_change":"2024-09-15T23:12:13.302380+0000","last_active":"2024-09-15T23:12:13.305259+0000","last_peered":"2024-09-15T23:12:13.305259+0000","last_clean":"2024-09-15T23:12:13.305259+0000","last_became_active":"2024-09-15T23:12:13.302131+0000","last_became_peered":"2024-09-15T23:12:13.302131+0000","last_unstale":"2024-09-15T23:12:13.305259+0000","last_undegraded":"2024-09-15T23:12:13.305259+0000","last_fullsized":"2024-09-15T23:12:13.305259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:10.513438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.310296+0000","last_change":"2024-09-15T23:12:12.298778+0000","last_active":"2024-09-15T23:12:13.310296+0000","last_peered":"2024-09-15T23:12:13.310296+0000","last_clean":"2024-09-15T23:12:13.310296+0000","last_became_active":"2024-09-15T23:12:12.298501+0000","last_became_peered":"2024-09-15T23:12:12.298501+0000","last_unstale":"2024-09-15T23:12:13.310296+0000","last_undegraded":"2024-09-15T23:12:13.310296+0000","last_fullsized":"2024-09-15T23:12:13.310296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:50:38.455575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306151+0000","last_change":"2024-09-15T23:12:13.303512+0000","last_active":"2024-09-15T23:12:13.306151+0000","last_peered":"2024-09-15T23:12:13.306151+0000","last_clean":"2024-09-15T23:12:13.306151+0000","last_became_active":"2024-09-15T23:12:13.303210+0000","last_became_peered":"2024-09-15T23:12:13.303210+0000","last_unstale":"2024-09-15T23:12:13.306151+0000","last_undegraded":"2024-09-15T23:12:13.306151+0000","last_fullsized":"2024-09-15T23:12:13.306151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:28.842608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.278465+0000","last_change":"2024-09-15T23:12:11.278465+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.278465+0000","last_undegraded":"2024-09-15T23:12:11.278465+0000","last_fullsized":"2024-09-15T23:12:11.278465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.282126+0000","last_change":"2024-09-15T23:12:12.295626+0000","last_active":"2024-09-15T23:12:13.282126+0000","last_peered":"2024-09-15T23:12:13.282126+0000","last_clean":"2024-09-15T23:12:13.282126+0000","last_became_active":"2024-09-15T23:12:12.295333+0000","last_became_peered":"2024-09-15T23:12:12.295333+0000","last_unstale":"2024-09-15T23:12:13.282126+0000","last_undegraded":"2024-09-15T23:12:13.282126+0000","last_fullsized":"2024-09-15T23:12:13.282126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:27:21.918750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.300128+0000","last_change":"2024-09-15T23:12:13.296636+0000","last_active":"2024-09-15T23:12:13.300128+0000","last_peered":"2024-09-15T23:12:13.300128+0000","last_clean":"2024-09-15T23:12:13.300128+0000","last_became_active":"2024-09-15T23:12:13.296172+0000","last_became_peered":"2024-09-15T23:12:13.296172+0000","last_unstale":"2024-09-15T23:12:13.300128+0000","last_undegraded":"2024-09-15T23:12:13.300128+0000","last_fullsized":"2024-09-15T23:12:13.300128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:54:01.331747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.287227+0000","last_change":"2024-09-15T23:12:12.296543+0000","last_active":"2024-09-15T23:12:13.287227+0000","last_peered":"2024-09-15T23:12:13.287227+0000","last_clean":"2024-09-15T23:12:13.287227+0000","last_became_active":"2024-09-15T23:12:12.296293+0000","last_became_peered":"2024-09-15T23:12:12.296293+0000","last_unstale":"2024-09-15T23:12:13.287227+0000","last_undegraded":"2024-09-15T23:12:13.287227+0000","last_fullsized":"2024-09-15T23:12:13.287227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:07:54.128353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.298710+0000","last_change":"2024-09-15T23:12:13.297331+0000","last_active":"2024-09-15T23:12:13.298710+0000","last_peered":"2024-09-15T23:12:13.298710+0000","last_clean":"2024-09-15T23:12:13.298710+0000","last_became_active":"2024-09-15T23:12:13.297036+0000","last_became_peered":"2024-09-15T23:12:13.297036+0000","last_unstale":"2024-09-15T23:12:13.298710+0000","last_undegraded":"2024-09-15T23:12:13.298710+0000","last_fullsized":"2024-09-15T23:12:13.298710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:07:55.135427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.276379+0000","last_change":"2024-09-15T23:12:11.276379+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.276379+0000","last_undegraded":"2024-09-15T23:12:11.276379+0000","last_fullsized":"2024-09-15T23:12:11.276379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.304776+0000","last_change":"2024-09-15T23:12:13.301636+0000","last_active":"2024-09-15T23:12:13.304776+0000","last_peered":"2024-09-15T23:12:13.304776+0000","last_clean":"2024-09-15T23:12:13.304776+0000","last_became_active":"2024-09-15T23:12:13.301390+0000","last_became_peered":"2024-09-15T23:12:13.301390+0000","last_unstale":"2024-09-15T23:12:13.304776+0000","last_undegraded":"2024-09-15T23:12:13.304776+0000","last_fullsized":"2024-09-15T23:12:13.304776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:29.584475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305413+0000","last_change":"2024-09-15T23:12:12.294164+0000","last_active":"2024-09-15T23:12:13.305413+0000","last_peered":"2024-09-15T23:12:13.305413+0000","last_clean":"2024-09-15T23:12:13.305413+0000","last_became_active":"2024-09-15T23:12:12.293619+0000","last_became_peered":"2024-09-15T23:12:12.293619+0000","last_unstale":"2024-09-15T23:12:13.305413+0000","last_undegraded":"2024-09-15T23:12:13.305413+0000","last_fullsized":"2024-09-15T23:12:13.305413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:46.714431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305317+0000","last_change":"2024-09-15T23:12:13.298781+0000","last_active":"2024-09-15T23:12:13.305317+0000","last_peered":"2024-09-15T23:12:13.305317+0000","last_clean":"2024-09-15T23:12:13.305317+0000","last_became_active":"2024-09-15T23:12:13.297968+0000","last_became_peered":"2024-09-15T23:12:13.297968+0000","last_unstale":"2024-09-15T23:12:13.305317+0000","last_undegraded":"2024-09-15T23:12:13.305317+0000","last_fullsized":"2024-09-15T23:12:13.305317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:44.465654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.278792+0000","last_change":"2024-09-15T23:12:11.278792+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.278792+0000","last_undegraded":"2024-09-15T23:12:11.278792+0000","last_fullsized":"2024-09-15T23:12:11.278792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305469+0000","last_change":"2024-09-15T23:12:13.296707+0000","last_active":"2024-09-15T23:12:13.305469+0000","last_peered":"2024-09-15T23:12:13.305469+0000","last_clean":"2024-09-15T23:12:13.305469+0000","last_became_active":"2024-09-15T23:12:13.296450+0000","last_became_peered":"2024-09-15T23:12:13.296450+0000","last_unstale":"2024-09-15T23:12:13.305469+0000","last_undegraded":"2024-09-15T23:12:13.305469+0000","last_fullsized":"2024-09-15T23:12:13.305469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:10:04.877140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.278550+0000","last_change":"2024-09-15T23:12:11.278550+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.278550+0000","last_undegraded":"2024-09-15T23:12:11.278550+0000","last_fullsized":"2024-09-15T23:12:11.278550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.307884+0000","last_change":"2024-09-15T23:12:13.306601+0000","last_active":"2024-09-15T23:12:13.307884+0000","last_peered":"2024-09-15T23:12:13.307884+0000","last_clean":"2024-09-15T23:12:13.307884+0000","last_became_active":"2024-09-15T23:12:13.306342+0000","last_became_peered":"2024-09-15T23:12:13.306342+0000","last_unstale":"2024-09-15T23:12:13.307884+0000","last_undegraded":"2024-09-15T23:12:13.307884+0000","last_fullsized":"2024-09-15T23:12:13.307884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:23:11.450569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.276618+0000","last_change":"2024-09-15T23:12:11.276618+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.276618+0000","last_undegraded":"2024-09-15T23:12:11.276618+0000","last_fullsized":"2024-09-15T23:12:11.276618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.294002+0000","last_change":"2024-09-15T23:12:13.292019+0000","last_active":"2024-09-15T23:12:13.294002+0000","last_peered":"2024-09-15T23:12:13.294002+0000","last_clean":"2024-09-15T23:12:13.294002+0000","last_became_active":"2024-09-15T23:12:13.290585+0000","last_became_peered":"2024-09-15T23:12:13.290585+0000","last_unstale":"2024-09-15T23:12:13.294002+0000","last_undegraded":"2024-09-15T23:12:13.294002+0000","last_fullsized":"2024-09-15T23:12:13.294002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:10:44.616598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.281241+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:12:13.281241+0000","last_peered":"2024-09-15T23:12:13.281241+0000","last_clean":"2024-09-15T23:12:13.281241+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:12:13.281241+0000","last_undegraded":"2024-09-15T23:12:13.281241+0000","last_fullsized":"2024-09-15T23:12:13.281241+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.283904+0000","last_change":"2024-09-15T23:12:12.295819+0000","last_active":"2024-09-15T23:12:13.283904+0000","last_peered":"2024-09-15T23:12:13.283904+0000","last_clean":"2024-09-15T23:12:13.283904+0000","last_became_active":"2024-09-15T23:12:12.295320+0000","last_became_peered":"2024-09-15T23:12:12.295320+0000","last_unstale":"2024-09-15T23:12:13.283904+0000","last_undegraded":"2024-09-15T23:12:13.283904+0000","last_fullsized":"2024-09-15T23:12:13.283904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:13.348463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.281967+0000","last_change":"2024-09-15T23:12:12.293545+0000","last_active":"2024-09-15T23:12:13.281967+0000","last_peered":"2024-09-15T23:12:13.281967+0000","last_clean":"2024-09-15T23:12:13.281967+0000","last_became_active":"2024-09-15T23:12:12.292903+0000","last_became_peered":"2024-09-15T23:12:12.292903+0000","last_unstale":"2024-09-15T23:12:13.281967+0000","last_undegraded":"2024-09-15T23:12:13.281967+0000","last_fullsized":"2024-09-15T23:12:13.281967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:46.714431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.278080+0000","last_change":"2024-09-15T23:12:11.278080+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.278080+0000","last_undegraded":"2024-09-15T23:12:11.278080+0000","last_fullsized":"2024-09-15T23:12:11.278080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.282268+0000","last_change":"2024-09-15T23:12:12.300290+0000","last_active":"2024-09-15T23:12:13.282268+0000","last_peered":"2024-09-15T23:12:13.282268+0000","last_clean":"2024-09-15T23:12:13.282268+0000","last_became_active":"2024-09-15T23:12:12.300024+0000","last_became_peered":"2024-09-15T23:12:12.300024+0000","last_unstale":"2024-09-15T23:12:13.282268+0000","last_undegraded":"2024-09-15T23:12:13.282268+0000","last_fullsized":"2024-09-15T23:12:13.282268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:10:03.870065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306057+0000","last_change":"2024-09-15T23:12:13.300590+0000","last_active":"2024-09-15T23:12:13.306057+0000","last_peered":"2024-09-15T23:12:13.306057+0000","last_clean":"2024-09-15T23:12:13.306057+0000","last_became_active":"2024-09-15T23:12:13.300376+0000","last_became_peered":"2024-09-15T23:12:13.300376+0000","last_unstale":"2024-09-15T23:12:13.306057+0000","last_undegraded":"2024-09-15T23:12:13.306057+0000","last_fullsized":"2024-09-15T23:12:13.306057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:14.355538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.279105+0000","last_change":"2024-09-15T23:12:11.279105+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.279105+0000","last_undegraded":"2024-09-15T23:12:11.279105+0000","last_fullsized":"2024-09-15T23:12:11.279105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305592+0000","last_change":"2024-09-15T23:12:13.300154+0000","last_active":"2024-09-15T23:12:13.305592+0000","last_peered":"2024-09-15T23:12:13.305592+0000","last_clean":"2024-09-15T23:12:13.305592+0000","last_became_active":"2024-09-15T23:12:13.299919+0000","last_became_peered":"2024-09-15T23:12:13.299919+0000","last_unstale":"2024-09-15T23:12:13.305592+0000","last_undegraded":"2024-09-15T23:12:13.305592+0000","last_fullsized":"2024-09-15T23:12:13.305592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:42:51.295319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.282980+0000","last_change":"2024-09-15T23:12:12.296791+0000","last_active":"2024-09-15T23:12:13.282980+0000","last_peered":"2024-09-15T23:12:13.282980+0000","last_clean":"2024-09-15T23:12:13.282980+0000","last_became_active":"2024-09-15T23:12:12.296507+0000","last_became_peered":"2024-09-15T23:12:12.296507+0000","last_unstale":"2024-09-15T23:12:13.282980+0000","last_undegraded":"2024-09-15T23:12:13.282980+0000","last_fullsized":"2024-09-15T23:12:13.282980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:08:50.152082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.276797+0000","last_change":"2024-09-15T23:12:11.276797+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.276797+0000","last_undegraded":"2024-09-15T23:12:11.276797+0000","last_fullsized":"2024-09-15T23:12:11.276797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.307939+0000","last_change":"2024-09-15T23:12:12.297628+0000","last_active":"2024-09-15T23:12:13.307939+0000","last_peered":"2024-09-15T23:12:13.307939+0000","last_clean":"2024-09-15T23:12:13.307939+0000","last_became_active":"2024-09-15T23:12:12.297392+0000","last_became_peered":"2024-09-15T23:12:12.297392+0000","last_unstale":"2024-09-15T23:12:13.307939+0000","last_undegraded":"2024-09-15T23:12:13.307939+0000","last_fullsized":"2024-09-15T23:12:13.307939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:26:21.303262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.286852+0000","last_change":"2024-09-15T23:12:12.292922+0000","last_active":"2024-09-15T23:12:13.286852+0000","last_peered":"2024-09-15T23:12:13.286852+0000","last_clean":"2024-09-15T23:12:13.286852+0000","last_became_active":"2024-09-15T23:12:12.292606+0000","last_became_peered":"2024-09-15T23:12:12.292606+0000","last_unstale":"2024-09-15T23:12:13.286852+0000","last_undegraded":"2024-09-15T23:12:13.286852+0000","last_fullsized":"2024-09-15T23:12:13.286852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:25.929262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.304754+0000","last_change":"2024-09-15T23:12:13.300968+0000","last_active":"2024-09-15T23:12:13.304754+0000","last_peered":"2024-09-15T23:12:13.304754+0000","last_clean":"2024-09-15T23:12:13.304754+0000","last_became_active":"2024-09-15T23:12:13.300679+0000","last_became_peered":"2024-09-15T23:12:13.300679+0000","last_unstale":"2024-09-15T23:12:13.304754+0000","last_undegraded":"2024-09-15T23:12:13.304754+0000","last_fullsized":"2024-09-15T23:12:13.304754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:10.165586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.277263+0000","last_change":"2024-09-15T23:12:11.277263+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.277263+0000","last_undegraded":"2024-09-15T23:12:11.277263+0000","last_fullsized":"2024-09-15T23:12:11.277263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.276820+0000","last_change":"2024-09-15T23:12:11.276820+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.276820+0000","last_undegraded":"2024-09-15T23:12:11.276820+0000","last_fullsized":"2024-09-15T23:12:11.276820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306625+0000","last_change":"2024-09-15T23:12:12.295599+0000","last_active":"2024-09-15T23:12:13.306625+0000","last_peered":"2024-09-15T23:12:13.306625+0000","last_clean":"2024-09-15T23:12:13.306625+0000","last_became_active":"2024-09-15T23:12:12.295036+0000","last_became_peered":"2024-09-15T23:12:12.295036+0000","last_unstale":"2024-09-15T23:12:13.306625+0000","last_undegraded":"2024-09-15T23:12:13.306625+0000","last_fullsized":"2024-09-15T23:12:13.306625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:03.815413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.294113+0000","last_change":"2024-09-15T23:12:13.292087+0000","last_active":"2024-09-15T23:12:13.294113+0000","last_peered":"2024-09-15T23:12:13.294113+0000","last_clean":"2024-09-15T23:12:13.294113+0000","last_became_active":"2024-09-15T23:12:13.291588+0000","last_became_peered":"2024-09-15T23:12:13.291588+0000","last_unstale":"2024-09-15T23:12:13.294113+0000","last_undegraded":"2024-09-15T23:12:13.294113+0000","last_fullsized":"2024-09-15T23:12:13.294113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:28.842608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.300062+0000","last_change":"2024-09-15T23:12:13.295583+0000","last_active":"2024-09-15T23:12:13.300062+0000","last_peered":"2024-09-15T23:12:13.300062+0000","last_clean":"2024-09-15T23:12:13.300062+0000","last_became_active":"2024-09-15T23:12:13.295285+0000","last_became_peered":"2024-09-15T23:12:13.295285+0000","last_unstale":"2024-09-15T23:12:13.300062+0000","last_undegraded":"2024-09-15T23:12:13.300062+0000","last_fullsized":"2024-09-15T23:12:13.300062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:23:11.450569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305733+0000","last_change":"2024-09-15T23:12:12.293704+0000","last_active":"2024-09-15T23:12:13.305733+0000","last_peered":"2024-09-15T23:12:13.305733+0000","last_clean":"2024-09-15T23:12:13.305733+0000","last_became_active":"2024-09-15T23:12:12.292898+0000","last_became_peered":"2024-09-15T23:12:12.292898+0000","last_unstale":"2024-09-15T23:12:13.305733+0000","last_undegraded":"2024-09-15T23:12:13.305733+0000","last_fullsized":"2024-09-15T23:12:13.305733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:27.285153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.298233+0000","last_change":"2024-09-15T23:12:13.295743+0000","last_active":"2024-09-15T23:12:13.298233+0000","last_peered":"2024-09-15T23:12:13.298233+0000","last_clean":"2024-09-15T23:12:13.298233+0000","last_became_active":"2024-09-15T23:12:13.295104+0000","last_became_peered":"2024-09-15T23:12:13.295104+0000","last_unstale":"2024-09-15T23:12:13.298233+0000","last_undegraded":"2024-09-15T23:12:13.298233+0000","last_fullsized":"2024-09-15T23:12:13.298233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:42:51.295319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.302127+0000","last_change":"2024-09-15T23:12:12.293296+0000","last_active":"2024-09-15T23:12:13.302127+0000","last_peered":"2024-09-15T23:12:13.302127+0000","last_clean":"2024-09-15T23:12:13.302127+0000","last_became_active":"2024-09-15T23:12:12.292920+0000","last_became_peered":"2024-09-15T23:12:12.292920+0000","last_unstale":"2024-09-15T23:12:13.302127+0000","last_undegraded":"2024-09-15T23:12:13.302127+0000","last_fullsized":"2024-09-15T23:12:13.302127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:17.787033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.278380+0000","last_change":"2024-09-15T23:12:11.278380+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.278380+0000","last_undegraded":"2024-09-15T23:12:11.278380+0000","last_fullsized":"2024-09-15T23:12:11.278380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:12.271628+0000","last_change":"2024-09-15T23:12:12.271628+0000","last_active":"2024-09-15T23:12:12.271628+0000","last_peered":"2024-09-15T23:12:12.271628+0000","last_clean":"2024-09-15T23:12:12.271628+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:12.271628+0000","last_undegraded":"2024-09-15T23:12:12.271628+0000","last_fullsized":"2024-09-15T23:12:12.271628+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-15T23:12:11.276392+0000","last_change":"2024-09-15T23:12:11.276392+0000","last_active":"2024-09-15T23:12:11.264553+0000","last_peered":"2024-09-15T23:12:11.264553+0000","last_clean":"2024-09-15T23:12:11.264553+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:11.276392+0000","last_undegraded":"2024-09-15T23:12:11.276392+0000","last_fullsized":"2024-09-15T23:12:11.276392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":70,"acting":70,"num_store_stats":4},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1634,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476743,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":192512,"data_stored":63389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476740,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":192512,"data_stored":63389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476742,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":786432,"data_stored":653757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476742,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":192512,"data_stored":63389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":167936,"data_stored":51297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":167936,"data_stored":51297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542147,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28396,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343444,"statfs":{"total":96636764160,"available":96607686656,"internally_reserved":0,"allocated":761856,"data_stored":641665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":167936,"data_stored":51297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:12:16.908 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3e is not active+clean 2024-09-15T23:12:16.908 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:12:12.271628+0000', 'last_change': '2024-09-15T23:12:12.271628+0000', 'last_active': '2024-09-15T23:12:12.271628+0000', 'last_peered': '2024-09-15T23:12:12.271628+0000', 'last_clean': '2024-09-15T23:12:12.271628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:12.271628+0000', 'last_undegraded': '2024-09-15T23:12:12.271628+0000', 'last_fullsized': '2024-09-15T23:12:12.271628+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:12:16.908 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3d is not active+clean 2024-09-15T23:12:16.908 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:12:12.271628+0000', 'last_change': '2024-09-15T23:12:12.271628+0000', 'last_active': '2024-09-15T23:12:12.271628+0000', 'last_peered': '2024-09-15T23:12:12.271628+0000', 'last_clean': '2024-09-15T23:12:12.271628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:12.271628+0000', 'last_undegraded': '2024-09-15T23:12:12.271628+0000', 'last_fullsized': '2024-09-15T23:12:12.271628+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:12:16.908 INFO:tasks.ceph.ceph_manager.ceph:PG 3.38 is not active+clean 2024-09-15T23:12:16.908 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:12:12.271628+0000', 'last_change': '2024-09-15T23:12:12.271628+0000', 'last_active': '2024-09-15T23:12:12.271628+0000', 'last_peered': '2024-09-15T23:12:12.271628+0000', 'last_clean': '2024-09-15T23:12:12.271628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:12.271628+0000', 'last_undegraded': '2024-09-15T23:12:12.271628+0000', 'last_fullsized': '2024-09-15T23:12:12.271628+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:12:16.909 INFO:tasks.ceph.ceph_manager.ceph:PG 3.33 is not active+clean 2024-09-15T23:12:16.909 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:12:12.271628+0000', 'last_change': '2024-09-15T23:12:12.271628+0000', 'last_active': '2024-09-15T23:12:12.271628+0000', 'last_peered': '2024-09-15T23:12:12.271628+0000', 'last_clean': '2024-09-15T23:12:12.271628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:12.271628+0000', 'last_undegraded': '2024-09-15T23:12:12.271628+0000', 'last_fullsized': '2024-09-15T23:12:12.271628+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:12:16.909 INFO:tasks.ceph.ceph_manager.ceph:PG 3.32 is not active+clean 2024-09-15T23:12:16.909 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:12:12.271628+0000', 'last_change': '2024-09-15T23:12:12.271628+0000', 'last_active': '2024-09-15T23:12:12.271628+0000', 'last_peered': '2024-09-15T23:12:12.271628+0000', 'last_clean': '2024-09-15T23:12:12.271628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:12.271628+0000', 'last_undegraded': '2024-09-15T23:12:12.271628+0000', 'last_fullsized': '2024-09-15T23:12:12.271628+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:12:16.909 INFO:tasks.ceph.ceph_manager.ceph:PG 3.31 is not active+clean 2024-09-15T23:12:16.909 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:12:12.271628+0000', 'last_change': '2024-09-15T23:12:12.271628+0000', 'last_active': '2024-09-15T23:12:12.271628+0000', 'last_peered': '2024-09-15T23:12:12.271628+0000', 'last_clean': '2024-09-15T23:12:12.271628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:12.271628+0000', 'last_undegraded': '2024-09-15T23:12:12.271628+0000', 'last_fullsized': '2024-09-15T23:12:12.271628+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:12:16.909 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2e is not active+clean 2024-09-15T23:12:16.909 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:12:12.271628+0000', 'last_change': '2024-09-15T23:12:12.271628+0000', 'last_active': '2024-09-15T23:12:12.271628+0000', 'last_peered': '2024-09-15T23:12:12.271628+0000', 'last_clean': '2024-09-15T23:12:12.271628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:12.271628+0000', 'last_undegraded': '2024-09-15T23:12:12.271628+0000', 'last_fullsized': '2024-09-15T23:12:12.271628+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:12:16.909 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2b is not active+clean 2024-09-15T23:12:16.909 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:12:12.271628+0000', 'last_change': '2024-09-15T23:12:12.271628+0000', 'last_active': '2024-09-15T23:12:12.271628+0000', 'last_peered': '2024-09-15T23:12:12.271628+0000', 'last_clean': '2024-09-15T23:12:12.271628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:12.271628+0000', 'last_undegraded': '2024-09-15T23:12:12.271628+0000', 'last_fullsized': '2024-09-15T23:12:12.271628+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:12:16.909 INFO:tasks.ceph.ceph_manager.ceph:PG 3.29 is not active+clean 2024-09-15T23:12:16.910 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:12:12.271628+0000', 'last_change': '2024-09-15T23:12:12.271628+0000', 'last_active': '2024-09-15T23:12:12.271628+0000', 'last_peered': '2024-09-15T23:12:12.271628+0000', 'last_clean': '2024-09-15T23:12:12.271628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:12.271628+0000', 'last_undegraded': '2024-09-15T23:12:12.271628+0000', 'last_fullsized': '2024-09-15T23:12:12.271628+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:12:16.910 INFO:tasks.ceph.ceph_manager.ceph:PG 3.27 is not active+clean 2024-09-15T23:12:16.910 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:12:12.271628+0000', 'last_change': '2024-09-15T23:12:12.271628+0000', 'last_active': '2024-09-15T23:12:12.271628+0000', 'last_peered': '2024-09-15T23:12:12.271628+0000', 'last_clean': '2024-09-15T23:12:12.271628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:12.271628+0000', 'last_undegraded': '2024-09-15T23:12:12.271628+0000', 'last_fullsized': '2024-09-15T23:12:12.271628+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:12:16.910 INFO:tasks.ceph.ceph_manager.ceph:PG 3.25 is not active+clean 2024-09-15T23:12:16.910 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:12:12.271628+0000', 'last_change': '2024-09-15T23:12:12.271628+0000', 'last_active': '2024-09-15T23:12:12.271628+0000', 'last_peered': '2024-09-15T23:12:12.271628+0000', 'last_clean': '2024-09-15T23:12:12.271628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:12.271628+0000', 'last_undegraded': '2024-09-15T23:12:12.271628+0000', 'last_fullsized': '2024-09-15T23:12:12.271628+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:12:16.910 INFO:tasks.ceph.ceph_manager.ceph:PG 3.24 is not active+clean 2024-09-15T23:12:16.910 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:12:12.271628+0000', 'last_change': '2024-09-15T23:12:12.271628+0000', 'last_active': '2024-09-15T23:12:12.271628+0000', 'last_peered': '2024-09-15T23:12:12.271628+0000', 'last_clean': '2024-09-15T23:12:12.271628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:12.271628+0000', 'last_undegraded': '2024-09-15T23:12:12.271628+0000', 'last_fullsized': '2024-09-15T23:12:12.271628+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:12:16.910 INFO:tasks.ceph.ceph_manager.ceph:PG 3.23 is not active+clean 2024-09-15T23:12:16.910 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:12:12.271628+0000', 'last_change': '2024-09-15T23:12:12.271628+0000', 'last_active': '2024-09-15T23:12:12.271628+0000', 'last_peered': '2024-09-15T23:12:12.271628+0000', 'last_clean': '2024-09-15T23:12:12.271628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:12.271628+0000', 'last_undegraded': '2024-09-15T23:12:12.271628+0000', 'last_fullsized': '2024-09-15T23:12:12.271628+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:12:16.910 INFO:tasks.ceph.ceph_manager.ceph:PG 3.21 is not active+clean 2024-09-15T23:12:16.910 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:12:12.271628+0000', 'last_change': '2024-09-15T23:12:12.271628+0000', 'last_active': '2024-09-15T23:12:12.271628+0000', 'last_peered': '2024-09-15T23:12:12.271628+0000', 'last_clean': '2024-09-15T23:12:12.271628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:12.271628+0000', 'last_undegraded': '2024-09-15T23:12:12.271628+0000', 'last_fullsized': '2024-09-15T23:12:12.271628+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:12:16.910 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1b is not active+clean 2024-09-15T23:12:16.911 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:11.278188+0000', 'last_change': '2024-09-15T23:12:11.278188+0000', 'last_active': '2024-09-15T23:12:11.264553+0000', 'last_peered': '2024-09-15T23:12:11.264553+0000', 'last_clean': '2024-09-15T23:12:11.264553+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:11.278188+0000', 'last_undegraded': '2024-09-15T23:12:11.278188+0000', 'last_fullsized': '2024-09-15T23:12:11.278188+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T23:12:16.911 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1b is not active+clean 2024-09-15T23:12:16.911 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:12:12.271628+0000', 'last_change': '2024-09-15T23:12:12.271628+0000', 'last_active': '2024-09-15T23:12:12.271628+0000', 'last_peered': '2024-09-15T23:12:12.271628+0000', 'last_clean': '2024-09-15T23:12:12.271628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:12.271628+0000', 'last_undegraded': '2024-09-15T23:12:12.271628+0000', 'last_fullsized': '2024-09-15T23:12:12.271628+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:12:16.911 INFO:tasks.ceph.ceph_manager.ceph:PG 2.19 is not active+clean 2024-09-15T23:12:16.911 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:11.276572+0000', 'last_change': '2024-09-15T23:12:11.276572+0000', 'last_active': '2024-09-15T23:12:11.264553+0000', 'last_peered': '2024-09-15T23:12:11.264553+0000', 'last_clean': '2024-09-15T23:12:11.264553+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:11.276572+0000', 'last_undegraded': '2024-09-15T23:12:11.276572+0000', 'last_fullsized': '2024-09-15T23:12:11.276572+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T23:12:16.911 INFO:tasks.ceph.ceph_manager.ceph:PG 3.18 is not active+clean 2024-09-15T23:12:16.911 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:12:12.271628+0000', 'last_change': '2024-09-15T23:12:12.271628+0000', 'last_active': '2024-09-15T23:12:12.271628+0000', 'last_peered': '2024-09-15T23:12:12.271628+0000', 'last_clean': '2024-09-15T23:12:12.271628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:12.271628+0000', 'last_undegraded': '2024-09-15T23:12:12.271628+0000', 'last_fullsized': '2024-09-15T23:12:12.271628+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:12:16.911 INFO:tasks.ceph.ceph_manager.ceph:PG 3.19 is not active+clean 2024-09-15T23:12:16.911 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:12:12.271628+0000', 'last_change': '2024-09-15T23:12:12.271628+0000', 'last_active': '2024-09-15T23:12:12.271628+0000', 'last_peered': '2024-09-15T23:12:12.271628+0000', 'last_clean': '2024-09-15T23:12:12.271628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:12.271628+0000', 'last_undegraded': '2024-09-15T23:12:12.271628+0000', 'last_fullsized': '2024-09-15T23:12:12.271628+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:12:16.911 INFO:tasks.ceph.ceph_manager.ceph:PG 3.17 is not active+clean 2024-09-15T23:12:16.912 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:12:12.271628+0000', 'last_change': '2024-09-15T23:12:12.271628+0000', 'last_active': '2024-09-15T23:12:12.271628+0000', 'last_peered': '2024-09-15T23:12:12.271628+0000', 'last_clean': '2024-09-15T23:12:12.271628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:12.271628+0000', 'last_undegraded': '2024-09-15T23:12:12.271628+0000', 'last_fullsized': '2024-09-15T23:12:12.271628+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:12:16.912 INFO:tasks.ceph.ceph_manager.ceph:PG 2.15 is not active+clean 2024-09-15T23:12:16.912 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:11.278408+0000', 'last_change': '2024-09-15T23:12:11.278408+0000', 'last_active': '2024-09-15T23:12:11.264553+0000', 'last_peered': '2024-09-15T23:12:11.264553+0000', 'last_clean': '2024-09-15T23:12:11.264553+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:11.278408+0000', 'last_undegraded': '2024-09-15T23:12:11.278408+0000', 'last_fullsized': '2024-09-15T23:12:11.278408+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T23:12:16.912 INFO:tasks.ceph.ceph_manager.ceph:PG 2.13 is not active+clean 2024-09-15T23:12:16.912 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:11.278465+0000', 'last_change': '2024-09-15T23:12:11.278465+0000', 'last_active': '2024-09-15T23:12:11.264553+0000', 'last_peered': '2024-09-15T23:12:11.264553+0000', 'last_clean': '2024-09-15T23:12:11.264553+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:11.278465+0000', 'last_undegraded': '2024-09-15T23:12:11.278465+0000', 'last_fullsized': '2024-09-15T23:12:11.278465+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T23:12:16.912 INFO:tasks.ceph.ceph_manager.ceph:PG 3.12 is not active+clean 2024-09-15T23:12:16.912 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:12:12.271628+0000', 'last_change': '2024-09-15T23:12:12.271628+0000', 'last_active': '2024-09-15T23:12:12.271628+0000', 'last_peered': '2024-09-15T23:12:12.271628+0000', 'last_clean': '2024-09-15T23:12:12.271628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:12.271628+0000', 'last_undegraded': '2024-09-15T23:12:12.271628+0000', 'last_fullsized': '2024-09-15T23:12:12.271628+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:12:16.912 INFO:tasks.ceph.ceph_manager.ceph:PG 2.10 is not active+clean 2024-09-15T23:12:16.912 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:11.276379+0000', 'last_change': '2024-09-15T23:12:11.276379+0000', 'last_active': '2024-09-15T23:12:11.264553+0000', 'last_peered': '2024-09-15T23:12:11.264553+0000', 'last_clean': '2024-09-15T23:12:11.264553+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:11.276379+0000', 'last_undegraded': '2024-09-15T23:12:11.276379+0000', 'last_fullsized': '2024-09-15T23:12:11.276379+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T23:12:16.912 INFO:tasks.ceph.ceph_manager.ceph:PG 2.e is not active+clean 2024-09-15T23:12:16.912 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:11.278792+0000', 'last_change': '2024-09-15T23:12:11.278792+0000', 'last_active': '2024-09-15T23:12:11.264553+0000', 'last_peered': '2024-09-15T23:12:11.264553+0000', 'last_clean': '2024-09-15T23:12:11.264553+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:11.278792+0000', 'last_undegraded': '2024-09-15T23:12:11.278792+0000', 'last_fullsized': '2024-09-15T23:12:11.278792+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T23:12:16.913 INFO:tasks.ceph.ceph_manager.ceph:PG 2.d is not active+clean 2024-09-15T23:12:16.913 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:11.278550+0000', 'last_change': '2024-09-15T23:12:11.278550+0000', 'last_active': '2024-09-15T23:12:11.264553+0000', 'last_peered': '2024-09-15T23:12:11.264553+0000', 'last_clean': '2024-09-15T23:12:11.264553+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:11.278550+0000', 'last_undegraded': '2024-09-15T23:12:11.278550+0000', 'last_fullsized': '2024-09-15T23:12:11.278550+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T23:12:16.913 INFO:tasks.ceph.ceph_manager.ceph:PG 2.c is not active+clean 2024-09-15T23:12:16.913 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:11.276618+0000', 'last_change': '2024-09-15T23:12:11.276618+0000', 'last_active': '2024-09-15T23:12:11.264553+0000', 'last_peered': '2024-09-15T23:12:11.264553+0000', 'last_clean': '2024-09-15T23:12:11.264553+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:11.276618+0000', 'last_undegraded': '2024-09-15T23:12:11.276618+0000', 'last_fullsized': '2024-09-15T23:12:11.276618+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T23:12:16.913 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2 is not active+clean 2024-09-15T23:12:16.913 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:12:12.271628+0000', 'last_change': '2024-09-15T23:12:12.271628+0000', 'last_active': '2024-09-15T23:12:12.271628+0000', 'last_peered': '2024-09-15T23:12:12.271628+0000', 'last_clean': '2024-09-15T23:12:12.271628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:12.271628+0000', 'last_undegraded': '2024-09-15T23:12:12.271628+0000', 'last_fullsized': '2024-09-15T23:12:12.271628+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:12:16.913 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1 is not active+clean 2024-09-15T23:12:16.913 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:12:12.271628+0000', 'last_change': '2024-09-15T23:12:12.271628+0000', 'last_active': '2024-09-15T23:12:12.271628+0000', 'last_peered': '2024-09-15T23:12:12.271628+0000', 'last_clean': '2024-09-15T23:12:12.271628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:12.271628+0000', 'last_undegraded': '2024-09-15T23:12:12.271628+0000', 'last_fullsized': '2024-09-15T23:12:12.271628+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:12:16.913 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1 is not active+clean 2024-09-15T23:12:16.913 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:11.278080+0000', 'last_change': '2024-09-15T23:12:11.278080+0000', 'last_active': '2024-09-15T23:12:11.264553+0000', 'last_peered': '2024-09-15T23:12:11.264553+0000', 'last_clean': '2024-09-15T23:12:11.264553+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:11.278080+0000', 'last_undegraded': '2024-09-15T23:12:11.278080+0000', 'last_fullsized': '2024-09-15T23:12:11.278080+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T23:12:16.913 INFO:tasks.ceph.ceph_manager.ceph:PG 3.0 is not active+clean 2024-09-15T23:12:16.913 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:12:12.271628+0000', 'last_change': '2024-09-15T23:12:12.271628+0000', 'last_active': '2024-09-15T23:12:12.271628+0000', 'last_peered': '2024-09-15T23:12:12.271628+0000', 'last_clean': '2024-09-15T23:12:12.271628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:12.271628+0000', 'last_undegraded': '2024-09-15T23:12:12.271628+0000', 'last_fullsized': '2024-09-15T23:12:12.271628+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:12:16.914 INFO:tasks.ceph.ceph_manager.ceph:PG 2.4 is not active+clean 2024-09-15T23:12:16.914 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:11.279105+0000', 'last_change': '2024-09-15T23:12:11.279105+0000', 'last_active': '2024-09-15T23:12:11.264553+0000', 'last_peered': '2024-09-15T23:12:11.264553+0000', 'last_clean': '2024-09-15T23:12:11.264553+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:11.279105+0000', 'last_undegraded': '2024-09-15T23:12:11.279105+0000', 'last_fullsized': '2024-09-15T23:12:11.279105+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T23:12:16.914 INFO:tasks.ceph.ceph_manager.ceph:PG 3.4 is not active+clean 2024-09-15T23:12:16.914 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:12:12.271628+0000', 'last_change': '2024-09-15T23:12:12.271628+0000', 'last_active': '2024-09-15T23:12:12.271628+0000', 'last_peered': '2024-09-15T23:12:12.271628+0000', 'last_clean': '2024-09-15T23:12:12.271628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:12.271628+0000', 'last_undegraded': '2024-09-15T23:12:12.271628+0000', 'last_fullsized': '2024-09-15T23:12:12.271628+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:12:16.914 INFO:tasks.ceph.ceph_manager.ceph:PG 2.6 is not active+clean 2024-09-15T23:12:16.914 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:11.276797+0000', 'last_change': '2024-09-15T23:12:11.276797+0000', 'last_active': '2024-09-15T23:12:11.264553+0000', 'last_peered': '2024-09-15T23:12:11.264553+0000', 'last_clean': '2024-09-15T23:12:11.264553+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:11.276797+0000', 'last_undegraded': '2024-09-15T23:12:11.276797+0000', 'last_fullsized': '2024-09-15T23:12:11.276797+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T23:12:16.914 INFO:tasks.ceph.ceph_manager.ceph:PG 3.7 is not active+clean 2024-09-15T23:12:16.914 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:12:12.271628+0000', 'last_change': '2024-09-15T23:12:12.271628+0000', 'last_active': '2024-09-15T23:12:12.271628+0000', 'last_peered': '2024-09-15T23:12:12.271628+0000', 'last_clean': '2024-09-15T23:12:12.271628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:12.271628+0000', 'last_undegraded': '2024-09-15T23:12:12.271628+0000', 'last_fullsized': '2024-09-15T23:12:12.271628+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:12:16.914 INFO:tasks.ceph.ceph_manager.ceph:PG 3.6 is not active+clean 2024-09-15T23:12:16.914 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:12:12.271628+0000', 'last_change': '2024-09-15T23:12:12.271628+0000', 'last_active': '2024-09-15T23:12:12.271628+0000', 'last_peered': '2024-09-15T23:12:12.271628+0000', 'last_clean': '2024-09-15T23:12:12.271628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:12.271628+0000', 'last_undegraded': '2024-09-15T23:12:12.271628+0000', 'last_fullsized': '2024-09-15T23:12:12.271628+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:12:16.914 INFO:tasks.ceph.ceph_manager.ceph:PG 2.9 is not active+clean 2024-09-15T23:12:16.915 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:11.277263+0000', 'last_change': '2024-09-15T23:12:11.277263+0000', 'last_active': '2024-09-15T23:12:11.264553+0000', 'last_peered': '2024-09-15T23:12:11.264553+0000', 'last_clean': '2024-09-15T23:12:11.264553+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:11.277263+0000', 'last_undegraded': '2024-09-15T23:12:11.277263+0000', 'last_fullsized': '2024-09-15T23:12:11.277263+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T23:12:16.915 INFO:tasks.ceph.ceph_manager.ceph:PG 3.8 is not active+clean 2024-09-15T23:12:16.915 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:12:12.271628+0000', 'last_change': '2024-09-15T23:12:12.271628+0000', 'last_active': '2024-09-15T23:12:12.271628+0000', 'last_peered': '2024-09-15T23:12:12.271628+0000', 'last_clean': '2024-09-15T23:12:12.271628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:12.271628+0000', 'last_undegraded': '2024-09-15T23:12:12.271628+0000', 'last_fullsized': '2024-09-15T23:12:12.271628+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:12:16.915 INFO:tasks.ceph.ceph_manager.ceph:PG 2.a is not active+clean 2024-09-15T23:12:16.915 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:11.276820+0000', 'last_change': '2024-09-15T23:12:11.276820+0000', 'last_active': '2024-09-15T23:12:11.264553+0000', 'last_peered': '2024-09-15T23:12:11.264553+0000', 'last_clean': '2024-09-15T23:12:11.264553+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:11.276820+0000', 'last_undegraded': '2024-09-15T23:12:11.276820+0000', 'last_fullsized': '2024-09-15T23:12:11.276820+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T23:12:16.915 INFO:tasks.ceph.ceph_manager.ceph:PG 3.b is not active+clean 2024-09-15T23:12:16.915 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:12:12.271628+0000', 'last_change': '2024-09-15T23:12:12.271628+0000', 'last_active': '2024-09-15T23:12:12.271628+0000', 'last_peered': '2024-09-15T23:12:12.271628+0000', 'last_clean': '2024-09-15T23:12:12.271628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:12.271628+0000', 'last_undegraded': '2024-09-15T23:12:12.271628+0000', 'last_fullsized': '2024-09-15T23:12:12.271628+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:12:16.915 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1f is not active+clean 2024-09-15T23:12:16.915 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:12:12.271628+0000', 'last_change': '2024-09-15T23:12:12.271628+0000', 'last_active': '2024-09-15T23:12:12.271628+0000', 'last_peered': '2024-09-15T23:12:12.271628+0000', 'last_clean': '2024-09-15T23:12:12.271628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:12.271628+0000', 'last_undegraded': '2024-09-15T23:12:12.271628+0000', 'last_fullsized': '2024-09-15T23:12:12.271628+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:12:16.915 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1e is not active+clean 2024-09-15T23:12:16.915 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:11.278380+0000', 'last_change': '2024-09-15T23:12:11.278380+0000', 'last_active': '2024-09-15T23:12:11.264553+0000', 'last_peered': '2024-09-15T23:12:11.264553+0000', 'last_clean': '2024-09-15T23:12:11.264553+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:11.278380+0000', 'last_undegraded': '2024-09-15T23:12:11.278380+0000', 'last_fullsized': '2024-09-15T23:12:11.278380+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T23:12:16.916 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1e is not active+clean 2024-09-15T23:12:16.916 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:12:12.271628+0000', 'last_change': '2024-09-15T23:12:12.271628+0000', 'last_active': '2024-09-15T23:12:12.271628+0000', 'last_peered': '2024-09-15T23:12:12.271628+0000', 'last_clean': '2024-09-15T23:12:12.271628+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:12.271628+0000', 'last_undegraded': '2024-09-15T23:12:12.271628+0000', 'last_fullsized': '2024-09-15T23:12:12.271628+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:12.271628+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:12:16.916 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1f is not active+clean 2024-09-15T23:12:16.916 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:11.276392+0000', 'last_change': '2024-09-15T23:12:11.276392+0000', 'last_active': '2024-09-15T23:12:11.264553+0000', 'last_peered': '2024-09-15T23:12:11.264553+0000', 'last_clean': '2024-09-15T23:12:11.264553+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:11.276392+0000', 'last_undegraded': '2024-09-15T23:12:11.276392+0000', 'last_fullsized': '2024-09-15T23:12:11.276392+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:11.264553+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T23:12:16.916 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:12:17.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.040+0000 7f55ae766640 1 Processor -- start 2024-09-15T23:12:17.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.040+0000 7f55ae766640 1 -- start start 2024-09-15T23:12:17.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.041+0000 7f55ae766640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f55a80b2d40 0x7f55a806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:17.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.041+0000 7f55ae766640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f55a806c150 0x7f55a815c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:17.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.041+0000 7f55ae766640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55a8071180 con 0x7f55a813eb20 2024-09-15T23:12:17.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.041+0000 7f55ae766640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f55a8071ab0 con 0x7f55a80b2d40 2024-09-15T23:12:17.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.041+0000 7f55ae766640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f55a8071460 con 0x7f55a806c150 2024-09-15T23:12:17.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.041+0000 7f55a7fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f55a80b2d40 0x7f55a806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:17.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.041+0000 7f55a7fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f55a80b2d40 0x7f55a806bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36082/0 (socket says 172.21.15.123:36082) 2024-09-15T23:12:17.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.041+0000 7f55a7fff640 1 -- 172.21.15.123:0/60043227 learned_addr learned my addr 172.21.15.123:0/60043227 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:17.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.041+0000 7f55acd03640 1 --2- 172.21.15.123:0/60043227 >> v2:172.21.15.188:3300/0 conn(0x7f55a806c150 0x7f55a815c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:17.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.041+0000 7f55a7fff640 1 -- 172.21.15.123:0/60043227 >> v2:172.21.15.188:3300/0 conn(0x7f55a806c150 msgr2=0x7f55a815c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:17.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.041+0000 7f55a7fff640 1 --2- 172.21.15.123:0/60043227 >> v2:172.21.15.188:3300/0 conn(0x7f55a806c150 0x7f55a815c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:17.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.041+0000 7f55a7fff640 1 -- 172.21.15.123:0/60043227 >> v1:172.21.15.188:6789/0 conn(0x7f55a813eb20 legacy=0x7f55a815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:17.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.041+0000 7f55a7fff640 1 -- 172.21.15.123:0/60043227 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a8071740 con 0x7f55a80b2d40 2024-09-15T23:12:17.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.042+0000 7f55a7fff640 1 --2- 172.21.15.123:0/60043227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55a80b2d40 0x7f55a806bc10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f55a8070d30 tx=0x7f559802c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecde7dedd2c4f5e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:17.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.042+0000 7f55a6ffd640 1 -- 172.21.15.123:0/60043227 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55980325a0 con 0x7f55a80b2d40 2024-09-15T23:12:17.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.042+0000 7f55a6ffd640 1 -- 172.21.15.123:0/60043227 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5598038070 con 0x7f55a80b2d40 2024-09-15T23:12:17.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.042+0000 7f55a6ffd640 1 -- 172.21.15.123:0/60043227 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5598032960 con 0x7f55a80b2d40 2024-09-15T23:12:17.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.043+0000 7f55ae766640 1 -- 172.21.15.123:0/60043227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55a80b2d40 msgr2=0x7f55a806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:17.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.043+0000 7f55ae766640 1 --2- 172.21.15.123:0/60043227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55a80b2d40 0x7f55a806bc10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f55a8070d30 tx=0x7f559802c8e0 comp rx=0 tx=0).stop 2024-09-15T23:12:17.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.043+0000 7f55ae766640 1 -- 172.21.15.123:0/60043227 shutdown_connections 2024-09-15T23:12:17.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.043+0000 7f55ae766640 1 --2- 172.21.15.123:0/60043227 >> v2:172.21.15.188:3300/0 conn(0x7f55a806c150 0x7f55a815c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:17.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.043+0000 7f55ae766640 1 --2- 172.21.15.123:0/60043227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55a80b2d40 0x7f55a806bc10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:17.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.043+0000 7f55ae766640 1 -- 172.21.15.123:0/60043227 >> 172.21.15.123:0/60043227 conn(0x7f55a80ccec0 msgr2=0x7f55a80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:17.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.043+0000 7f55ae766640 1 -- 172.21.15.123:0/60043227 shutdown_connections 2024-09-15T23:12:17.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.043+0000 7f55ae766640 1 -- 172.21.15.123:0/60043227 wait complete. 2024-09-15T23:12:17.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.044+0000 7f55ae766640 1 Processor -- start 2024-09-15T23:12:17.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.044+0000 7f55ae766640 1 -- start start 2024-09-15T23:12:17.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.045+0000 7f55ae766640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f55a806c150 0x7f55a815ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:17.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.045+0000 7f55ae766640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55a80b2d40 0x7f55a815b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:17.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.045+0000 7f55ae766640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f55a813eb20 0x7f55a8159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:17.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.045+0000 7f55ae766640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f55a80722d0 con 0x7f55a80b2d40 2024-09-15T23:12:17.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.045+0000 7f55ae766640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f55a8072150 con 0x7f55a813eb20 2024-09-15T23:12:17.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.045+0000 7f55ae766640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f55a8072450 con 0x7f55a806c150 2024-09-15T23:12:17.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.045+0000 7f55a77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55a80b2d40 0x7f55a815b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:17.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.045+0000 7f55a77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55a80b2d40 0x7f55a815b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36084/0 (socket says 172.21.15.123:36084) 2024-09-15T23:12:17.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.045+0000 7f55a77fe640 1 -- 172.21.15.123:0/129053752 learned_addr learned my addr 172.21.15.123:0/129053752 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:17.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.045+0000 7f55acd03640 1 --2- 172.21.15.123:0/129053752 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f55a813eb20 0x7f55a8159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:17.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.045+0000 7f55a7fff640 1 --2- 172.21.15.123:0/129053752 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f55a806c150 0x7f55a815ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:17.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.045+0000 7f55a77fe640 1 -- 172.21.15.123:0/129053752 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f55a806c150 msgr2=0x7f55a815ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:17.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.045+0000 7f55a77fe640 1 --2- 172.21.15.123:0/129053752 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f55a806c150 0x7f55a815ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:17.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.045+0000 7f55a77fe640 1 -- 172.21.15.123:0/129053752 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f55a813eb20 msgr2=0x7f55a8159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:17.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.045+0000 7f55a77fe640 1 --2- 172.21.15.123:0/129053752 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f55a813eb20 0x7f55a8159bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:17.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.045+0000 7f55a77fe640 1 -- 172.21.15.123:0/129053752 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a81f11d0 con 0x7f55a80b2d40 2024-09-15T23:12:17.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.045+0000 7f55a77fe640 1 --2- 172.21.15.123:0/129053752 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55a80b2d40 0x7f55a815b1b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f559c00b3c0 tx=0x7f559c00b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:17.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.045+0000 7f55a4ff9640 1 -- 172.21.15.123:0/129053752 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559c011830 con 0x7f55a80b2d40 2024-09-15T23:12:17.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.045+0000 7f55a4ff9640 1 -- 172.21.15.123:0/129053752 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f559c016070 con 0x7f55a80b2d40 2024-09-15T23:12:17.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.045+0000 7f55ae766640 1 -- 172.21.15.123:0/129053752 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55a81f14b0 con 0x7f55a80b2d40 2024-09-15T23:12:17.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.045+0000 7f55a4ff9640 1 -- 172.21.15.123:0/129053752 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559c011c50 con 0x7f55a80b2d40 2024-09-15T23:12:17.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.045+0000 7f55ae766640 1 -- 172.21.15.123:0/129053752 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55a81f1a70 con 0x7f55a80b2d40 2024-09-15T23:12:17.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.046+0000 7f55ae766640 1 -- 172.21.15.123:0/129053752 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55a806bc10 con 0x7f55a80b2d40 2024-09-15T23:12:17.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.047+0000 7f55a4ff9640 1 -- 172.21.15.123:0/129053752 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f559c01b460 con 0x7f55a80b2d40 2024-09-15T23:12:17.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.047+0000 7f55a4ff9640 1 --2- 172.21.15.123:0/129053752 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f559406c2b0 0x7f559406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:17.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.047+0000 7f55a4ff9640 1 -- 172.21.15.123:0/129053752 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f559c08ad50 con 0x7f55a80b2d40 2024-09-15T23:12:17.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.047+0000 7f55a7fff640 1 --2- 172.21.15.123:0/129053752 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f559406c2b0 0x7f559406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:17.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.048+0000 7f55a7fff640 1 --2- 172.21.15.123:0/129053752 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f559406c2b0 0x7f559406e770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5598037000 tx=0x7f559803e040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:17.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.052+0000 7f55a4ff9640 1 -- 172.21.15.123:0/129053752 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f559c08e030 con 0x7f55a80b2d40 2024-09-15T23:12:17.110 INFO:tasks.ceph.mds.c.smithi123.stderr:2024-09-15T23:12:17.109+0000 7ff96d5e3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:12:17.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.281+0000 7f55ae766640 1 -- 172.21.15.123:0/129053752 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f55a8141810 con 0x7f55a80b2d40 2024-09-15T23:12:17.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.282+0000 7f55a4ff9640 1 -- 172.21.15.123:0/129053752 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1214 (secure 0 0 0) 0x7f559c020020 con 0x7f55a80b2d40 2024-09-15T23:12:17.283 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:17.283 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":27,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":22,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":53},{"state_name":"unknown","count":29},{"state_name":"creating+peering","count":15}],"num_pgs":97,"num_pools":3,"num_objects":11,"data_bytes":592002,"bytes_used":224710656,"bytes_avail":772869402624,"bytes_total":773094113280,"unknown_pgs_ratio":0.29896906018257141,"inactive_pgs_ratio":0.15463916957378387,"write_bytes_sec":968,"read_op_per_sec":0,"write_op_per_sec":4},"fsmap":{"epoch":6,"btime":"2024-09-15T23:12:15:299077+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"c","status":"up:active","gid":4290}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-15T23:11:49.433169+0000","services":{}},"progress_events":{}} 2024-09-15T23:12:17.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.284+0000 7f55ae766640 1 -- 172.21.15.123:0/129053752 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f559406c2b0 msgr2=0x7f559406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:17.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.284+0000 7f55ae766640 1 --2- 172.21.15.123:0/129053752 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f559406c2b0 0x7f559406e770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5598037000 tx=0x7f559803e040 comp rx=0 tx=0).stop 2024-09-15T23:12:17.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.284+0000 7f55ae766640 1 -- 172.21.15.123:0/129053752 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55a80b2d40 msgr2=0x7f55a815b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:17.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.284+0000 7f55ae766640 1 --2- 172.21.15.123:0/129053752 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55a80b2d40 0x7f55a815b1b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f559c00b3c0 tx=0x7f559c00b880 comp rx=0 tx=0).stop 2024-09-15T23:12:17.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.284+0000 7f55ae766640 1 -- 172.21.15.123:0/129053752 shutdown_connections 2024-09-15T23:12:17.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.284+0000 7f55ae766640 1 --2- 172.21.15.123:0/129053752 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f55a813eb20 0x7f55a8159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:17.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.284+0000 7f55ae766640 1 --2- 172.21.15.123:0/129053752 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f559406c2b0 0x7f559406e770 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:17.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.284+0000 7f55ae766640 1 --2- 172.21.15.123:0/129053752 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55a80b2d40 0x7f55a815b1b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:17.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.284+0000 7f55ae766640 1 --2- 172.21.15.123:0/129053752 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f55a806c150 0x7f55a815ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:17.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.284+0000 7f55ae766640 1 -- 172.21.15.123:0/129053752 >> 172.21.15.123:0/129053752 conn(0x7f55a80ccec0 msgr2=0x7f55a8156810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:17.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.284+0000 7f55ae766640 1 -- 172.21.15.123:0/129053752 shutdown_connections 2024-09-15T23:12:17.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.284+0000 7f55ae766640 1 -- 172.21.15.123:0/129053752 wait complete. 2024-09-15T23:12:17.295 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-15T23:12:17.295 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:12:17.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.392+0000 7ff21f4f1640 1 Processor -- start 2024-09-15T23:12:17.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.393+0000 7ff21f4f1640 1 -- start start 2024-09-15T23:12:17.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.393+0000 7ff21f4f1640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff218160040 0x7ff2180d0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:17.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.393+0000 7ff21f4f1640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff21815d150 0x7ff21815d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:17.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.394+0000 7ff21f4f1640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2180cdbc0 con 0x7ff2180b42c0 2024-09-15T23:12:17.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.394+0000 7ff21f4f1640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7ff2181606d0 con 0x7ff218160040 2024-09-15T23:12:17.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.394+0000 7ff21f4f1640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7ff2181609b0 con 0x7ff21815d150 2024-09-15T23:12:17.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.394+0000 7ff21ca8c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff218160040 0x7ff2180d0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:17.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.394+0000 7ff21d28d640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff2180b42c0 0x7ff2180b46a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39014/0 (socket says 172.21.15.123:39014) 2024-09-15T23:12:17.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.394+0000 7ff21d28d640 1 -- 172.21.15.123:0/294126201 learned_addr learned my addr 172.21.15.123:0/294126201 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:17.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.394+0000 7ff21ca8c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff218160040 0x7ff2180d0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36088/0 (socket says 172.21.15.123:36088) 2024-09-15T23:12:17.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.394+0000 7ff21da8e640 1 --2- 172.21.15.123:0/294126201 >> v2:172.21.15.188:3300/0 conn(0x7ff21815d150 0x7ff21815d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:17.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.394+0000 7ff21ca8c640 1 -- 172.21.15.123:0/294126201 >> v2:172.21.15.188:3300/0 conn(0x7ff21815d150 msgr2=0x7ff21815d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:17.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.394+0000 7ff21ca8c640 1 --2- 172.21.15.123:0/294126201 >> v2:172.21.15.188:3300/0 conn(0x7ff21815d150 0x7ff21815d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:17.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.394+0000 7ff21ca8c640 1 -- 172.21.15.123:0/294126201 >> v1:172.21.15.123:6789/0 conn(0x7ff2180b42c0 legacy=0x7ff2180b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:17.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.394+0000 7ff21ca8c640 1 -- 172.21.15.123:0/294126201 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff218160c90 con 0x7ff218160040 2024-09-15T23:12:17.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.394+0000 7ff217fff640 1 -- 172.21.15.123:0/294126201 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 564771624 0 0) 0x7ff210001110 con 0x7ff2180b42c0 2024-09-15T23:12:17.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.394+0000 7ff21da8e640 1 --2- 172.21.15.123:0/294126201 >> v2:172.21.15.188:3300/0 conn(0x7ff21815d150 0x7ff21815d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:17.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.395+0000 7ff21ca8c640 1 --2- 172.21.15.123:0/294126201 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff218160040 0x7ff2180d0230 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff218074370 tx=0x7ff20c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc99416a70c936ee server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:17.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.395+0000 7ff217fff640 1 -- 172.21.15.123:0/294126201 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff20c037070 con 0x7ff218160040 2024-09-15T23:12:17.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.395+0000 7ff217fff640 1 -- 172.21.15.123:0/294126201 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff20c032440 con 0x7ff218160040 2024-09-15T23:12:17.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.395+0000 7ff217fff640 1 -- 172.21.15.123:0/294126201 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff20c032810 con 0x7ff218160040 2024-09-15T23:12:17.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.395+0000 7ff21f4f1640 1 -- 172.21.15.123:0/294126201 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff218160040 msgr2=0x7ff2180d0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:17.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.395+0000 7ff21f4f1640 1 --2- 172.21.15.123:0/294126201 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff218160040 0x7ff2180d0230 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff218074370 tx=0x7ff20c02a1a0 comp rx=0 tx=0).stop 2024-09-15T23:12:17.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.395+0000 7ff21f4f1640 1 -- 172.21.15.123:0/294126201 shutdown_connections 2024-09-15T23:12:17.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.395+0000 7ff21f4f1640 1 --2- 172.21.15.123:0/294126201 >> v2:172.21.15.188:3300/0 conn(0x7ff21815d150 0x7ff21815d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:17.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.395+0000 7ff21f4f1640 1 --2- 172.21.15.123:0/294126201 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff218160040 0x7ff2180d0230 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:17.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.395+0000 7ff21f4f1640 1 -- 172.21.15.123:0/294126201 >> 172.21.15.123:0/294126201 conn(0x7ff218067950 msgr2=0x7ff218067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:17.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.395+0000 7ff21f4f1640 1 -- 172.21.15.123:0/294126201 shutdown_connections 2024-09-15T23:12:17.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.395+0000 7ff21f4f1640 1 -- 172.21.15.123:0/294126201 wait complete. 2024-09-15T23:12:17.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.396+0000 7ff21f4f1640 1 Processor -- start 2024-09-15T23:12:17.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.397+0000 7ff21f4f1640 1 -- start start 2024-09-15T23:12:17.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.397+0000 7ff21f4f1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2180b42c0 0x7ff2180b75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:17.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.397+0000 7ff21f4f1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff21815d150 0x7ff21814b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:17.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.397+0000 7ff21f4f1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff218160040 0x7ff21814d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:17.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.397+0000 7ff21f4f1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff2180ce4e0 con 0x7ff2180b42c0 2024-09-15T23:12:17.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.397+0000 7ff21f4f1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff2180ce360 con 0x7ff21815d150 2024-09-15T23:12:17.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.397+0000 7ff21f4f1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ff2180ce660 con 0x7ff218160040 2024-09-15T23:12:17.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.397+0000 7ff21d28d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2180b42c0 0x7ff2180b75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:17.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.397+0000 7ff21d28d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2180b42c0 0x7ff2180b75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36102/0 (socket says 172.21.15.123:36102) 2024-09-15T23:12:17.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.397+0000 7ff21d28d640 1 -- 172.21.15.123:0/727941495 learned_addr learned my addr 172.21.15.123:0/727941495 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:17.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.397+0000 7ff21ca8c640 1 --2- 172.21.15.123:0/727941495 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff21815d150 0x7ff21814b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:17.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.398+0000 7ff21da8e640 1 --2- 172.21.15.123:0/727941495 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff218160040 0x7ff21814d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:17.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.398+0000 7ff21d28d640 1 -- 172.21.15.123:0/727941495 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff218160040 msgr2=0x7ff21814d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:17.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.398+0000 7ff21d28d640 1 --2- 172.21.15.123:0/727941495 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff218160040 0x7ff21814d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:17.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.398+0000 7ff21d28d640 1 -- 172.21.15.123:0/727941495 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff21815d150 msgr2=0x7ff21814b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:17.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.398+0000 7ff21d28d640 1 --2- 172.21.15.123:0/727941495 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff21815d150 0x7ff21814b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:17.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.398+0000 7ff21d28d640 1 -- 172.21.15.123:0/727941495 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2181e6910 con 0x7ff2180b42c0 2024-09-15T23:12:17.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.398+0000 7ff21ca8c640 1 --2- 172.21.15.123:0/727941495 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff21815d150 0x7ff21814b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:17.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.398+0000 7ff21d28d640 1 --2- 172.21.15.123:0/727941495 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2180b42c0 0x7ff2180b75b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff21000c780 tx=0x7ff21000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:17.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.398+0000 7ff215ffb640 1 -- 172.21.15.123:0/727941495 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff210018070 con 0x7ff2180b42c0 2024-09-15T23:12:17.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.398+0000 7ff215ffb640 1 -- 172.21.15.123:0/727941495 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2100072d0 con 0x7ff2180b42c0 2024-09-15T23:12:17.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.398+0000 7ff21f4f1640 1 -- 172.21.15.123:0/727941495 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2181e6bd0 con 0x7ff2180b42c0 2024-09-15T23:12:17.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.398+0000 7ff215ffb640 1 -- 172.21.15.123:0/727941495 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2100047e0 con 0x7ff2180b42c0 2024-09-15T23:12:17.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.398+0000 7ff21f4f1640 1 -- 172.21.15.123:0/727941495 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2181e7190 con 0x7ff2180b42c0 2024-09-15T23:12:17.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.399+0000 7ff21f4f1640 1 -- 172.21.15.123:0/727941495 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff21815d5e0 con 0x7ff2180b42c0 2024-09-15T23:12:17.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.399+0000 7ff215ffb640 1 -- 172.21.15.123:0/727941495 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff21001b070 con 0x7ff2180b42c0 2024-09-15T23:12:17.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.400+0000 7ff215ffb640 1 --2- 172.21.15.123:0/727941495 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff20406c2b0 0x7ff20406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:17.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.400+0000 7ff215ffb640 1 -- 172.21.15.123:0/727941495 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff21008a760 con 0x7ff2180b42c0 2024-09-15T23:12:17.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.400+0000 7ff21ca8c640 1 --2- 172.21.15.123:0/727941495 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff20406c2b0 0x7ff20406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:17.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.401+0000 7ff21ca8c640 1 --2- 172.21.15.123:0/727941495 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff20406c2b0 0x7ff20406e770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff20c034000 tx=0x7ff20c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:17.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.404+0000 7ff215ffb640 1 -- 172.21.15.123:0/727941495 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff2180cdbc0 con 0x7ff2180b42c0 2024-09-15T23:12:17.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.569+0000 7ff21f4f1640 1 -- 172.21.15.123:0/727941495 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff2180cf3c0 con 0x7ff20406c2b0 2024-09-15T23:12:17.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.575+0000 7ff215ffb640 1 -- 172.21.15.123:0/727941495 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251908 (secure 0 0 0) 0x7ff2180cf3c0 con 0x7ff20406c2b0 2024-09-15T23:12:17.578 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:17.579 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:12:17.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.578+0000 7ff21f4f1640 1 -- 172.21.15.123:0/727941495 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff20406c2b0 msgr2=0x7ff20406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:17.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.578+0000 7ff21f4f1640 1 --2- 172.21.15.123:0/727941495 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff20406c2b0 0x7ff20406e770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff20c034000 tx=0x7ff20c02e000 comp rx=0 tx=0).stop 2024-09-15T23:12:17.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.578+0000 7ff21f4f1640 1 -- 172.21.15.123:0/727941495 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2180b42c0 msgr2=0x7ff2180b75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:17.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.578+0000 7ff21f4f1640 1 --2- 172.21.15.123:0/727941495 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2180b42c0 0x7ff2180b75b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff21000c780 tx=0x7ff21000cc40 comp rx=0 tx=0).stop 2024-09-15T23:12:17.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.578+0000 7ff21f4f1640 1 -- 172.21.15.123:0/727941495 shutdown_connections 2024-09-15T23:12:17.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.578+0000 7ff21f4f1640 1 --2- 172.21.15.123:0/727941495 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff218160040 0x7ff21814d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:17.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.578+0000 7ff21f4f1640 1 --2- 172.21.15.123:0/727941495 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff21815d150 0x7ff21814b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:17.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.578+0000 7ff21f4f1640 1 --2- 172.21.15.123:0/727941495 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff20406c2b0 0x7ff20406e770 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:17.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.578+0000 7ff21f4f1640 1 --2- 172.21.15.123:0/727941495 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2180b42c0 0x7ff2180b75b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:17.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.578+0000 7ff21f4f1640 1 -- 172.21.15.123:0/727941495 >> 172.21.15.123:0/727941495 conn(0x7ff218067950 msgr2=0x7ff21815e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:17.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.578+0000 7ff21f4f1640 1 -- 172.21.15.123:0/727941495 shutdown_connections 2024-09-15T23:12:17.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:17.578+0000 7ff21f4f1640 1 -- 172.21.15.123:0/727941495 wait complete. 2024-09-15T23:12:17.590 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-15T23:12:17.503164+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":138,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219044,"kb_used_data":2796,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755676,"statfs":{"total":773094113280,"available":772869812224,"internally_reserved":0,"allocated":2863104,"data_stored":1742648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001556"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.307270+0000","last_change":"2024-09-15T23:12:13.304372+0000","last_active":"2024-09-15T23:12:13.307270+0000","last_peered":"2024-09-15T23:12:13.307270+0000","last_clean":"2024-09-15T23:12:13.307270+0000","last_became_active":"2024-09-15T23:12:13.304067+0000","last_became_peered":"2024-09-15T23:12:13.304067+0000","last_unstale":"2024-09-15T23:12:13.307270+0000","last_undegraded":"2024-09-15T23:12:13.307270+0000","last_fullsized":"2024-09-15T23:12:13.307270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:44.688079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277385+0000","last_change":"2024-09-15T23:12:13.302592+0000","last_active":"2024-09-15T23:12:15.277385+0000","last_peered":"2024-09-15T23:12:15.277385+0000","last_clean":"2024-09-15T23:12:15.277385+0000","last_became_active":"2024-09-15T23:12:13.301990+0000","last_became_peered":"2024-09-15T23:12:13.301990+0000","last_unstale":"2024-09-15T23:12:15.277385+0000","last_undegraded":"2024-09-15T23:12:15.277385+0000","last_fullsized":"2024-09-15T23:12:15.277385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:10:09.891348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277323+0000","last_change":"2024-09-15T23:12:13.301292+0000","last_active":"2024-09-15T23:12:15.277323+0000","last_peered":"2024-09-15T23:12:15.277323+0000","last_clean":"2024-09-15T23:12:15.277323+0000","last_became_active":"2024-09-15T23:12:13.301019+0000","last_became_peered":"2024-09-15T23:12:13.301019+0000","last_unstale":"2024-09-15T23:12:15.277323+0000","last_undegraded":"2024-09-15T23:12:15.277323+0000","last_fullsized":"2024-09-15T23:12:15.277323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:45:01.842037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306250+0000","last_change":"2024-09-15T23:12:13.302730+0000","last_active":"2024-09-15T23:12:13.306250+0000","last_peered":"2024-09-15T23:12:13.306250+0000","last_clean":"2024-09-15T23:12:13.306250+0000","last_became_active":"2024-09-15T23:12:13.302301+0000","last_became_peered":"2024-09-15T23:12:13.302301+0000","last_unstale":"2024-09-15T23:12:13.306250+0000","last_undegraded":"2024-09-15T23:12:13.306250+0000","last_fullsized":"2024-09-15T23:12:13.306250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:18.794107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306036+0000","last_change":"2024-09-15T23:12:13.298592+0000","last_active":"2024-09-15T23:12:13.306036+0000","last_peered":"2024-09-15T23:12:13.306036+0000","last_clean":"2024-09-15T23:12:13.306036+0000","last_became_active":"2024-09-15T23:12:13.298358+0000","last_became_peered":"2024-09-15T23:12:13.298358+0000","last_unstale":"2024-09-15T23:12:13.306036+0000","last_undegraded":"2024-09-15T23:12:13.306036+0000","last_fullsized":"2024-09-15T23:12:13.306036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:26:22.310337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306639+0000","last_change":"2024-09-15T23:12:13.302119+0000","last_active":"2024-09-15T23:12:13.306639+0000","last_peered":"2024-09-15T23:12:13.306639+0000","last_clean":"2024-09-15T23:12:13.306639+0000","last_became_active":"2024-09-15T23:12:13.301671+0000","last_became_peered":"2024-09-15T23:12:13.301671+0000","last_unstale":"2024-09-15T23:12:13.306639+0000","last_undegraded":"2024-09-15T23:12:13.306639+0000","last_fullsized":"2024-09-15T23:12:13.306639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:07:55.135427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306124+0000","last_change":"2024-09-15T23:12:13.301523+0000","last_active":"2024-09-15T23:12:13.306124+0000","last_peered":"2024-09-15T23:12:13.306124+0000","last_clean":"2024-09-15T23:12:13.306124+0000","last_became_active":"2024-09-15T23:12:13.301272+0000","last_became_peered":"2024-09-15T23:12:13.301272+0000","last_unstale":"2024-09-15T23:12:13.306124+0000","last_undegraded":"2024-09-15T23:12:13.306124+0000","last_fullsized":"2024-09-15T23:12:13.306124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:10:44.616598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277112+0000","last_change":"2024-09-15T23:12:13.297810+0000","last_active":"2024-09-15T23:12:15.277112+0000","last_peered":"2024-09-15T23:12:15.277112+0000","last_clean":"2024-09-15T23:12:15.277112+0000","last_became_active":"2024-09-15T23:12:13.295627+0000","last_became_peered":"2024-09-15T23:12:13.295627+0000","last_unstale":"2024-09-15T23:12:15.277112+0000","last_undegraded":"2024-09-15T23:12:15.277112+0000","last_fullsized":"2024-09-15T23:12:15.277112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:40.921752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.298276+0000","last_change":"2024-09-15T23:12:13.295501+0000","last_active":"2024-09-15T23:12:13.298276+0000","last_peered":"2024-09-15T23:12:13.298276+0000","last_clean":"2024-09-15T23:12:13.298276+0000","last_became_active":"2024-09-15T23:12:13.294470+0000","last_became_peered":"2024-09-15T23:12:13.294470+0000","last_unstale":"2024-09-15T23:12:13.298276+0000","last_undegraded":"2024-09-15T23:12:13.298276+0000","last_fullsized":"2024-09-15T23:12:13.298276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:12.050480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305974+0000","last_change":"2024-09-15T23:12:13.300057+0000","last_active":"2024-09-15T23:12:13.305974+0000","last_peered":"2024-09-15T23:12:13.305974+0000","last_clean":"2024-09-15T23:12:13.305974+0000","last_became_active":"2024-09-15T23:12:13.299762+0000","last_became_peered":"2024-09-15T23:12:13.299762+0000","last_unstale":"2024-09-15T23:12:13.305974+0000","last_undegraded":"2024-09-15T23:12:13.305974+0000","last_fullsized":"2024-09-15T23:12:13.305974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:04.822487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306016+0000","last_change":"2024-09-15T23:12:13.296975+0000","last_active":"2024-09-15T23:12:13.306016+0000","last_peered":"2024-09-15T23:12:13.306016+0000","last_clean":"2024-09-15T23:12:13.306016+0000","last_became_active":"2024-09-15T23:12:13.296726+0000","last_became_peered":"2024-09-15T23:12:13.296726+0000","last_unstale":"2024-09-15T23:12:13.306016+0000","last_undegraded":"2024-09-15T23:12:13.306016+0000","last_fullsized":"2024-09-15T23:12:13.306016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:08:51.159156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306882+0000","last_change":"2024-09-15T23:12:13.299790+0000","last_active":"2024-09-15T23:12:13.306882+0000","last_peered":"2024-09-15T23:12:13.306882+0000","last_clean":"2024-09-15T23:12:13.306882+0000","last_became_active":"2024-09-15T23:12:13.299446+0000","last_became_peered":"2024-09-15T23:12:13.299446+0000","last_unstale":"2024-09-15T23:12:13.306882+0000","last_undegraded":"2024-09-15T23:12:13.306882+0000","last_fullsized":"2024-09-15T23:12:13.306882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:03.932670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142410+0000","last_change":"2024-09-15T23:12:13.303570+0000","last_active":"2024-09-15T23:12:15.142410+0000","last_peered":"2024-09-15T23:12:15.142410+0000","last_clean":"2024-09-15T23:12:15.142410+0000","last_became_active":"2024-09-15T23:12:13.303303+0000","last_became_peered":"2024-09-15T23:12:13.303303+0000","last_unstale":"2024-09-15T23:12:15.142410+0000","last_undegraded":"2024-09-15T23:12:15.142410+0000","last_fullsized":"2024-09-15T23:12:15.142410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:14.355538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142296+0000","last_change":"2024-09-15T23:12:13.297459+0000","last_active":"2024-09-15T23:12:15.142296+0000","last_peered":"2024-09-15T23:12:15.142296+0000","last_clean":"2024-09-15T23:12:15.142296+0000","last_became_active":"2024-09-15T23:12:13.293984+0000","last_became_peered":"2024-09-15T23:12:13.293984+0000","last_unstale":"2024-09-15T23:12:15.142296+0000","last_undegraded":"2024-09-15T23:12:15.142296+0000","last_fullsized":"2024-09-15T23:12:15.142296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:26:22.310337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277181+0000","last_change":"2024-09-15T23:12:13.296112+0000","last_active":"2024-09-15T23:12:15.277181+0000","last_peered":"2024-09-15T23:12:15.277181+0000","last_clean":"2024-09-15T23:12:15.277181+0000","last_became_active":"2024-09-15T23:12:13.295405+0000","last_became_peered":"2024-09-15T23:12:13.295405+0000","last_unstale":"2024-09-15T23:12:15.277181+0000","last_undegraded":"2024-09-15T23:12:15.277181+0000","last_fullsized":"2024-09-15T23:12:15.277181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:53.919348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305700+0000","last_change":"2024-09-15T23:12:13.302744+0000","last_active":"2024-09-15T23:12:13.305700+0000","last_peered":"2024-09-15T23:12:13.305700+0000","last_clean":"2024-09-15T23:12:13.305700+0000","last_became_active":"2024-09-15T23:12:13.302439+0000","last_became_peered":"2024-09-15T23:12:13.302439+0000","last_unstale":"2024-09-15T23:12:13.305700+0000","last_undegraded":"2024-09-15T23:12:13.305700+0000","last_fullsized":"2024-09-15T23:12:13.305700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:02.914486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.303650+0000","last_change":"2024-09-15T23:12:13.298338+0000","last_active":"2024-09-15T23:12:13.303650+0000","last_peered":"2024-09-15T23:12:13.303650+0000","last_clean":"2024-09-15T23:12:13.303650+0000","last_became_active":"2024-09-15T23:12:13.297884+0000","last_became_peered":"2024-09-15T23:12:13.297884+0000","last_unstale":"2024-09-15T23:12:13.303650+0000","last_undegraded":"2024-09-15T23:12:13.303650+0000","last_fullsized":"2024-09-15T23:12:13.303650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:11.528380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282638+0000","last_change":"2024-09-15T23:12:13.306391+0000","last_active":"2024-09-15T23:12:14.282638+0000","last_peered":"2024-09-15T23:12:14.282638+0000","last_clean":"2024-09-15T23:12:14.282638+0000","last_became_active":"2024-09-15T23:12:13.306106+0000","last_became_peered":"2024-09-15T23:12:13.306106+0000","last_unstale":"2024-09-15T23:12:14.282638+0000","last_undegraded":"2024-09-15T23:12:14.282638+0000","last_fullsized":"2024-09-15T23:12:14.282638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:28.292228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.303721+0000","last_change":"2024-09-15T23:12:13.300688+0000","last_active":"2024-09-15T23:12:13.303721+0000","last_peered":"2024-09-15T23:12:13.303721+0000","last_clean":"2024-09-15T23:12:13.303721+0000","last_became_active":"2024-09-15T23:12:13.300388+0000","last_became_peered":"2024-09-15T23:12:13.300388+0000","last_unstale":"2024-09-15T23:12:13.303721+0000","last_undegraded":"2024-09-15T23:12:13.303721+0000","last_fullsized":"2024-09-15T23:12:13.303721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:25.899342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305775+0000","last_change":"2024-09-15T23:12:13.295852+0000","last_active":"2024-09-15T23:12:13.305775+0000","last_peered":"2024-09-15T23:12:13.305775+0000","last_clean":"2024-09-15T23:12:13.305775+0000","last_became_active":"2024-09-15T23:12:13.295536+0000","last_became_peered":"2024-09-15T23:12:13.295536+0000","last_unstale":"2024-09-15T23:12:13.305775+0000","last_undegraded":"2024-09-15T23:12:13.305775+0000","last_fullsized":"2024-09-15T23:12:13.305775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:27:22.925825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776770+0000","last_change":"2024-09-15T23:12:13.302978+0000","last_active":"2024-09-15T23:12:14.776770+0000","last_peered":"2024-09-15T23:12:14.776770+0000","last_clean":"2024-09-15T23:12:14.776770+0000","last_became_active":"2024-09-15T23:12:13.302474+0000","last_became_peered":"2024-09-15T23:12:13.302474+0000","last_unstale":"2024-09-15T23:12:14.776770+0000","last_undegraded":"2024-09-15T23:12:14.776770+0000","last_fullsized":"2024-09-15T23:12:14.776770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:13:52.918855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.298303+0000","last_change":"2024-09-15T23:12:13.296548+0000","last_active":"2024-09-15T23:12:13.298303+0000","last_peered":"2024-09-15T23:12:13.298303+0000","last_clean":"2024-09-15T23:12:13.298303+0000","last_became_active":"2024-09-15T23:12:13.294814+0000","last_became_peered":"2024-09-15T23:12:13.294814+0000","last_unstale":"2024-09-15T23:12:13.298303+0000","last_undegraded":"2024-09-15T23:12:13.298303+0000","last_fullsized":"2024-09-15T23:12:13.298303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:26.936337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277175+0000","last_change":"2024-09-15T23:12:13.298250+0000","last_active":"2024-09-15T23:12:15.277175+0000","last_peered":"2024-09-15T23:12:15.277175+0000","last_clean":"2024-09-15T23:12:15.277175+0000","last_became_active":"2024-09-15T23:12:13.297923+0000","last_became_peered":"2024-09-15T23:12:13.297923+0000","last_unstale":"2024-09-15T23:12:15.277175+0000","last_undegraded":"2024-09-15T23:12:15.277175+0000","last_fullsized":"2024-09-15T23:12:15.277175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:32.902323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.295166+0000","last_change":"2024-09-15T23:12:13.293872+0000","last_active":"2024-09-15T23:12:13.295166+0000","last_peered":"2024-09-15T23:12:13.295166+0000","last_clean":"2024-09-15T23:12:13.295166+0000","last_became_active":"2024-09-15T23:12:13.293608+0000","last_became_peered":"2024-09-15T23:12:13.293608+0000","last_unstale":"2024-09-15T23:12:13.295166+0000","last_undegraded":"2024-09-15T23:12:13.295166+0000","last_fullsized":"2024-09-15T23:12:13.295166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:44.688079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277371+0000","last_change":"2024-09-15T23:12:13.297603+0000","last_active":"2024-09-15T23:12:15.277371+0000","last_peered":"2024-09-15T23:12:15.277371+0000","last_clean":"2024-09-15T23:12:15.277371+0000","last_became_active":"2024-09-15T23:12:13.297090+0000","last_became_peered":"2024-09-15T23:12:13.297090+0000","last_unstale":"2024-09-15T23:12:15.277371+0000","last_undegraded":"2024-09-15T23:12:15.277371+0000","last_fullsized":"2024-09-15T23:12:15.277371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:20:45.209892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305427+0000","last_change":"2024-09-15T23:12:13.299195+0000","last_active":"2024-09-15T23:12:13.305427+0000","last_peered":"2024-09-15T23:12:13.305427+0000","last_clean":"2024-09-15T23:12:13.305427+0000","last_became_active":"2024-09-15T23:12:13.298466+0000","last_became_peered":"2024-09-15T23:12:13.298466+0000","last_unstale":"2024-09-15T23:12:13.305427+0000","last_undegraded":"2024-09-15T23:12:13.305427+0000","last_fullsized":"2024-09-15T23:12:13.305427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:12.050480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142578+0000","last_change":"2024-09-15T23:12:13.293831+0000","last_active":"2024-09-15T23:12:15.142578+0000","last_peered":"2024-09-15T23:12:15.142578+0000","last_clean":"2024-09-15T23:12:15.142578+0000","last_became_active":"2024-09-15T23:12:13.293105+0000","last_became_peered":"2024-09-15T23:12:13.293105+0000","last_unstale":"2024-09-15T23:12:15.142578+0000","last_undegraded":"2024-09-15T23:12:15.142578+0000","last_fullsized":"2024-09-15T23:12:15.142578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:10:44.616598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142320+0000","last_change":"2024-09-15T23:12:13.304201+0000","last_active":"2024-09-15T23:12:15.142320+0000","last_peered":"2024-09-15T23:12:15.142320+0000","last_clean":"2024-09-15T23:12:15.142320+0000","last_became_active":"2024-09-15T23:12:13.303927+0000","last_became_peered":"2024-09-15T23:12:13.303927+0000","last_unstale":"2024-09-15T23:12:15.142320+0000","last_undegraded":"2024-09-15T23:12:15.142320+0000","last_fullsized":"2024-09-15T23:12:15.142320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:04.822487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277367+0000","last_change":"2024-09-15T23:12:13.306673+0000","last_active":"2024-09-15T23:12:15.277367+0000","last_peered":"2024-09-15T23:12:15.277367+0000","last_clean":"2024-09-15T23:12:15.277367+0000","last_became_active":"2024-09-15T23:12:13.306402+0000","last_became_peered":"2024-09-15T23:12:13.306402+0000","last_unstale":"2024-09-15T23:12:15.277367+0000","last_undegraded":"2024-09-15T23:12:15.277367+0000","last_fullsized":"2024-09-15T23:12:15.277367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:38.511766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.294094+0000","last_change":"2024-09-15T23:12:13.291856+0000","last_active":"2024-09-15T23:12:13.294094+0000","last_peered":"2024-09-15T23:12:13.294094+0000","last_clean":"2024-09-15T23:12:13.294094+0000","last_became_active":"2024-09-15T23:12:13.291050+0000","last_became_peered":"2024-09-15T23:12:13.291050+0000","last_unstale":"2024-09-15T23:12:13.294094+0000","last_undegraded":"2024-09-15T23:12:13.294094+0000","last_fullsized":"2024-09-15T23:12:13.294094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:03.932670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282338+0000","last_change":"2024-09-15T23:12:13.303266+0000","last_active":"2024-09-15T23:12:14.282338+0000","last_peered":"2024-09-15T23:12:14.282338+0000","last_clean":"2024-09-15T23:12:14.282338+0000","last_became_active":"2024-09-15T23:12:13.302500+0000","last_became_peered":"2024-09-15T23:12:13.302500+0000","last_unstale":"2024-09-15T23:12:14.282338+0000","last_undegraded":"2024-09-15T23:12:14.282338+0000","last_fullsized":"2024-09-15T23:12:14.282338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:30.079827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306973+0000","last_change":"2024-09-15T23:12:13.300877+0000","last_active":"2024-09-15T23:12:13.306973+0000","last_peered":"2024-09-15T23:12:13.306973+0000","last_clean":"2024-09-15T23:12:13.306973+0000","last_became_active":"2024-09-15T23:12:13.300604+0000","last_became_peered":"2024-09-15T23:12:13.300604+0000","last_unstale":"2024-09-15T23:12:13.306973+0000","last_undegraded":"2024-09-15T23:12:13.306973+0000","last_fullsized":"2024-09-15T23:12:13.306973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:26.936337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.292269+0000","last_change":"2024-09-15T23:12:13.290806+0000","last_active":"2024-09-15T23:12:13.292269+0000","last_peered":"2024-09-15T23:12:13.292269+0000","last_clean":"2024-09-15T23:12:13.292269+0000","last_became_active":"2024-09-15T23:12:13.290534+0000","last_became_peered":"2024-09-15T23:12:13.290534+0000","last_unstale":"2024-09-15T23:12:13.292269+0000","last_undegraded":"2024-09-15T23:12:13.292269+0000","last_fullsized":"2024-09-15T23:12:13.292269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:55.317051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277101+0000","last_change":"2024-09-15T23:12:12.299410+0000","last_active":"2024-09-15T23:12:15.277101+0000","last_peered":"2024-09-15T23:12:15.277101+0000","last_clean":"2024-09-15T23:12:15.277101+0000","last_became_active":"2024-09-15T23:12:12.299149+0000","last_became_peered":"2024-09-15T23:12:12.299149+0000","last_unstale":"2024-09-15T23:12:15.277101+0000","last_undegraded":"2024-09-15T23:12:15.277101+0000","last_fullsized":"2024-09-15T23:12:15.277101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:28.555228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776858+0000","last_change":"2024-09-15T23:12:13.293900+0000","last_active":"2024-09-15T23:12:14.776858+0000","last_peered":"2024-09-15T23:12:14.776858+0000","last_clean":"2024-09-15T23:12:14.776858+0000","last_became_active":"2024-09-15T23:12:13.293602+0000","last_became_peered":"2024-09-15T23:12:13.293602+0000","last_unstale":"2024-09-15T23:12:14.776858+0000","last_undegraded":"2024-09-15T23:12:14.776858+0000","last_fullsized":"2024-09-15T23:12:14.776858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:32.902323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.308359+0000","last_change":"2024-09-15T23:12:12.297601+0000","last_active":"2024-09-15T23:12:13.308359+0000","last_peered":"2024-09-15T23:12:13.308359+0000","last_clean":"2024-09-15T23:12:13.308359+0000","last_became_active":"2024-09-15T23:12:12.297353+0000","last_became_peered":"2024-09-15T23:12:12.297353+0000","last_unstale":"2024-09-15T23:12:13.308359+0000","last_undegraded":"2024-09-15T23:12:13.308359+0000","last_fullsized":"2024-09-15T23:12:13.308359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:27.285153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142086+0000","last_change":"2024-09-15T23:12:12.301058+0000","last_active":"2024-09-15T23:12:15.142086+0000","last_peered":"2024-09-15T23:12:15.142086+0000","last_clean":"2024-09-15T23:12:15.142086+0000","last_became_active":"2024-09-15T23:12:12.300744+0000","last_became_peered":"2024-09-15T23:12:12.300744+0000","last_unstale":"2024-09-15T23:12:15.142086+0000","last_undegraded":"2024-09-15T23:12:15.142086+0000","last_fullsized":"2024-09-15T23:12:15.142086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:54.309977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277506+0000","last_change":"2024-09-15T23:12:13.302358+0000","last_active":"2024-09-15T23:12:15.277506+0000","last_peered":"2024-09-15T23:12:15.277506+0000","last_clean":"2024-09-15T23:12:15.277506+0000","last_became_active":"2024-09-15T23:12:13.301840+0000","last_became_peered":"2024-09-15T23:12:13.301840+0000","last_unstale":"2024-09-15T23:12:15.277506+0000","last_undegraded":"2024-09-15T23:12:15.277506+0000","last_fullsized":"2024-09-15T23:12:15.277506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:45:58.241079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.281818+0000","last_change":"2024-09-15T23:12:12.294030+0000","last_active":"2024-09-15T23:12:13.281818+0000","last_peered":"2024-09-15T23:12:13.281818+0000","last_clean":"2024-09-15T23:12:13.281818+0000","last_became_active":"2024-09-15T23:12:12.293252+0000","last_became_peered":"2024-09-15T23:12:12.293252+0000","last_unstale":"2024-09-15T23:12:13.281818+0000","last_undegraded":"2024-09-15T23:12:13.281818+0000","last_fullsized":"2024-09-15T23:12:13.281818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:29.072753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776750+0000","last_change":"2024-09-15T23:12:13.302350+0000","last_active":"2024-09-15T23:12:14.776750+0000","last_peered":"2024-09-15T23:12:14.776750+0000","last_clean":"2024-09-15T23:12:14.776750+0000","last_became_active":"2024-09-15T23:12:13.301761+0000","last_became_peered":"2024-09-15T23:12:13.301761+0000","last_unstale":"2024-09-15T23:12:14.776750+0000","last_undegraded":"2024-09-15T23:12:14.776750+0000","last_fullsized":"2024-09-15T23:12:14.776750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:29.428355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.280716+0000","last_change":"2024-09-15T23:12:12.296404+0000","last_active":"2024-09-15T23:12:13.280716+0000","last_peered":"2024-09-15T23:12:13.280716+0000","last_clean":"2024-09-15T23:12:13.280716+0000","last_became_active":"2024-09-15T23:12:12.296128+0000","last_became_peered":"2024-09-15T23:12:12.296128+0000","last_unstale":"2024-09-15T23:12:13.280716+0000","last_undegraded":"2024-09-15T23:12:13.280716+0000","last_fullsized":"2024-09-15T23:12:13.280716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:43.458579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305382+0000","last_change":"2024-09-15T23:12:13.298997+0000","last_active":"2024-09-15T23:12:13.305382+0000","last_peered":"2024-09-15T23:12:13.305382+0000","last_clean":"2024-09-15T23:12:13.305382+0000","last_became_active":"2024-09-15T23:12:13.298225+0000","last_became_peered":"2024-09-15T23:12:13.298225+0000","last_unstale":"2024-09-15T23:12:13.305382+0000","last_undegraded":"2024-09-15T23:12:13.305382+0000","last_fullsized":"2024-09-15T23:12:13.305382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:55.317051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.288734+0000","last_change":"2024-09-15T23:12:12.294378+0000","last_active":"2024-09-15T23:12:13.288734+0000","last_peered":"2024-09-15T23:12:13.288734+0000","last_clean":"2024-09-15T23:12:13.288734+0000","last_became_active":"2024-09-15T23:12:12.294028+0000","last_became_peered":"2024-09-15T23:12:12.294028+0000","last_unstale":"2024-09-15T23:12:13.288734+0000","last_undegraded":"2024-09-15T23:12:13.288734+0000","last_fullsized":"2024-09-15T23:12:13.288734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:29.072753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277559+0000","last_change":"2024-09-15T23:12:13.295768+0000","last_active":"2024-09-15T23:12:15.277559+0000","last_peered":"2024-09-15T23:12:15.277559+0000","last_clean":"2024-09-15T23:12:15.277559+0000","last_became_active":"2024-09-15T23:12:13.295379+0000","last_became_peered":"2024-09-15T23:12:13.295379+0000","last_unstale":"2024-09-15T23:12:15.277559+0000","last_undegraded":"2024-09-15T23:12:15.277559+0000","last_fullsized":"2024-09-15T23:12:15.277559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:47.011102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282465+0000","last_change":"2024-09-15T23:12:12.296690+0000","last_active":"2024-09-15T23:12:14.282465+0000","last_peered":"2024-09-15T23:12:14.282465+0000","last_clean":"2024-09-15T23:12:14.282465+0000","last_became_active":"2024-09-15T23:12:12.295787+0000","last_became_peered":"2024-09-15T23:12:12.295787+0000","last_unstale":"2024-09-15T23:12:14.282465+0000","last_undegraded":"2024-09-15T23:12:14.282465+0000","last_fullsized":"2024-09-15T23:12:14.282465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:11.043406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305259+0000","last_change":"2024-09-15T23:12:13.302380+0000","last_active":"2024-09-15T23:12:13.305259+0000","last_peered":"2024-09-15T23:12:13.305259+0000","last_clean":"2024-09-15T23:12:13.305259+0000","last_became_active":"2024-09-15T23:12:13.302131+0000","last_became_peered":"2024-09-15T23:12:13.302131+0000","last_unstale":"2024-09-15T23:12:13.305259+0000","last_undegraded":"2024-09-15T23:12:13.305259+0000","last_fullsized":"2024-09-15T23:12:13.305259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:10.513438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.310296+0000","last_change":"2024-09-15T23:12:12.298778+0000","last_active":"2024-09-15T23:12:13.310296+0000","last_peered":"2024-09-15T23:12:13.310296+0000","last_clean":"2024-09-15T23:12:13.310296+0000","last_became_active":"2024-09-15T23:12:12.298501+0000","last_became_peered":"2024-09-15T23:12:12.298501+0000","last_unstale":"2024-09-15T23:12:13.310296+0000","last_undegraded":"2024-09-15T23:12:13.310296+0000","last_fullsized":"2024-09-15T23:12:13.310296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:50:38.455575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306151+0000","last_change":"2024-09-15T23:12:13.303512+0000","last_active":"2024-09-15T23:12:13.306151+0000","last_peered":"2024-09-15T23:12:13.306151+0000","last_clean":"2024-09-15T23:12:13.306151+0000","last_became_active":"2024-09-15T23:12:13.303210+0000","last_became_peered":"2024-09-15T23:12:13.303210+0000","last_unstale":"2024-09-15T23:12:13.306151+0000","last_undegraded":"2024-09-15T23:12:13.306151+0000","last_fullsized":"2024-09-15T23:12:13.306151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:28.842608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282483+0000","last_change":"2024-09-15T23:12:12.300595+0000","last_active":"2024-09-15T23:12:14.282483+0000","last_peered":"2024-09-15T23:12:14.282483+0000","last_clean":"2024-09-15T23:12:14.282483+0000","last_became_active":"2024-09-15T23:12:12.300327+0000","last_became_peered":"2024-09-15T23:12:12.300327+0000","last_unstale":"2024-09-15T23:12:14.282483+0000","last_undegraded":"2024-09-15T23:12:14.282483+0000","last_fullsized":"2024-09-15T23:12:14.282483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:43.458579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142286+0000","last_change":"2024-09-15T23:12:13.295028+0000","last_active":"2024-09-15T23:12:15.142286+0000","last_peered":"2024-09-15T23:12:15.142286+0000","last_clean":"2024-09-15T23:12:15.142286+0000","last_became_active":"2024-09-15T23:12:13.294725+0000","last_became_peered":"2024-09-15T23:12:13.294725+0000","last_unstale":"2024-09-15T23:12:15.142286+0000","last_undegraded":"2024-09-15T23:12:15.142286+0000","last_fullsized":"2024-09-15T23:12:15.142286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:08:51.159156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.282126+0000","last_change":"2024-09-15T23:12:12.295626+0000","last_active":"2024-09-15T23:12:13.282126+0000","last_peered":"2024-09-15T23:12:13.282126+0000","last_clean":"2024-09-15T23:12:13.282126+0000","last_became_active":"2024-09-15T23:12:12.295333+0000","last_became_peered":"2024-09-15T23:12:12.295333+0000","last_unstale":"2024-09-15T23:12:13.282126+0000","last_undegraded":"2024-09-15T23:12:13.282126+0000","last_fullsized":"2024-09-15T23:12:13.282126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:27:21.918750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.300128+0000","last_change":"2024-09-15T23:12:13.296636+0000","last_active":"2024-09-15T23:12:13.300128+0000","last_peered":"2024-09-15T23:12:13.300128+0000","last_clean":"2024-09-15T23:12:13.300128+0000","last_became_active":"2024-09-15T23:12:13.296172+0000","last_became_peered":"2024-09-15T23:12:13.296172+0000","last_unstale":"2024-09-15T23:12:13.300128+0000","last_undegraded":"2024-09-15T23:12:13.300128+0000","last_fullsized":"2024-09-15T23:12:13.300128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:54:01.331747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.287227+0000","last_change":"2024-09-15T23:12:12.296543+0000","last_active":"2024-09-15T23:12:13.287227+0000","last_peered":"2024-09-15T23:12:13.287227+0000","last_clean":"2024-09-15T23:12:13.287227+0000","last_became_active":"2024-09-15T23:12:12.296293+0000","last_became_peered":"2024-09-15T23:12:12.296293+0000","last_unstale":"2024-09-15T23:12:13.287227+0000","last_undegraded":"2024-09-15T23:12:13.287227+0000","last_fullsized":"2024-09-15T23:12:13.287227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:07:54.128353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.298710+0000","last_change":"2024-09-15T23:12:13.297331+0000","last_active":"2024-09-15T23:12:13.298710+0000","last_peered":"2024-09-15T23:12:13.298710+0000","last_clean":"2024-09-15T23:12:13.298710+0000","last_became_active":"2024-09-15T23:12:13.297036+0000","last_became_peered":"2024-09-15T23:12:13.297036+0000","last_unstale":"2024-09-15T23:12:13.298710+0000","last_undegraded":"2024-09-15T23:12:13.298710+0000","last_fullsized":"2024-09-15T23:12:13.298710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:07:55.135427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776416+0000","last_change":"2024-09-15T23:12:12.297599+0000","last_active":"2024-09-15T23:12:14.776416+0000","last_peered":"2024-09-15T23:12:14.776416+0000","last_clean":"2024-09-15T23:12:14.776416+0000","last_became_active":"2024-09-15T23:12:12.297309+0000","last_became_peered":"2024-09-15T23:12:12.297309+0000","last_unstale":"2024-09-15T23:12:14.776416+0000","last_undegraded":"2024-09-15T23:12:14.776416+0000","last_fullsized":"2024-09-15T23:12:14.776416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:28.555228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.304776+0000","last_change":"2024-09-15T23:12:13.301636+0000","last_active":"2024-09-15T23:12:13.304776+0000","last_peered":"2024-09-15T23:12:13.304776+0000","last_clean":"2024-09-15T23:12:13.304776+0000","last_became_active":"2024-09-15T23:12:13.301390+0000","last_became_peered":"2024-09-15T23:12:13.301390+0000","last_unstale":"2024-09-15T23:12:13.304776+0000","last_undegraded":"2024-09-15T23:12:13.304776+0000","last_fullsized":"2024-09-15T23:12:13.304776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:29.584475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305413+0000","last_change":"2024-09-15T23:12:12.294164+0000","last_active":"2024-09-15T23:12:13.305413+0000","last_peered":"2024-09-15T23:12:13.305413+0000","last_clean":"2024-09-15T23:12:13.305413+0000","last_became_active":"2024-09-15T23:12:12.293619+0000","last_became_peered":"2024-09-15T23:12:12.293619+0000","last_unstale":"2024-09-15T23:12:13.305413+0000","last_undegraded":"2024-09-15T23:12:13.305413+0000","last_fullsized":"2024-09-15T23:12:13.305413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:46.714431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305317+0000","last_change":"2024-09-15T23:12:13.298781+0000","last_active":"2024-09-15T23:12:13.305317+0000","last_peered":"2024-09-15T23:12:13.305317+0000","last_clean":"2024-09-15T23:12:13.305317+0000","last_became_active":"2024-09-15T23:12:13.297968+0000","last_became_peered":"2024-09-15T23:12:13.297968+0000","last_unstale":"2024-09-15T23:12:13.305317+0000","last_undegraded":"2024-09-15T23:12:13.305317+0000","last_fullsized":"2024-09-15T23:12:13.305317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:44.465654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776841+0000","last_change":"2024-09-15T23:12:12.299042+0000","last_active":"2024-09-15T23:12:14.776841+0000","last_peered":"2024-09-15T23:12:14.776841+0000","last_clean":"2024-09-15T23:12:14.776841+0000","last_became_active":"2024-09-15T23:12:12.298781+0000","last_became_peered":"2024-09-15T23:12:12.298781+0000","last_unstale":"2024-09-15T23:12:14.776841+0000","last_undegraded":"2024-09-15T23:12:14.776841+0000","last_fullsized":"2024-09-15T23:12:14.776841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:12.407756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305469+0000","last_change":"2024-09-15T23:12:13.296707+0000","last_active":"2024-09-15T23:12:13.305469+0000","last_peered":"2024-09-15T23:12:13.305469+0000","last_clean":"2024-09-15T23:12:13.305469+0000","last_became_active":"2024-09-15T23:12:13.296450+0000","last_became_peered":"2024-09-15T23:12:13.296450+0000","last_unstale":"2024-09-15T23:12:13.305469+0000","last_undegraded":"2024-09-15T23:12:13.305469+0000","last_fullsized":"2024-09-15T23:12:13.305469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:10:04.877140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277145+0000","last_change":"2024-09-15T23:12:12.296505+0000","last_active":"2024-09-15T23:12:15.277145+0000","last_peered":"2024-09-15T23:12:15.277145+0000","last_clean":"2024-09-15T23:12:15.277145+0000","last_became_active":"2024-09-15T23:12:12.296249+0000","last_became_peered":"2024-09-15T23:12:12.296249+0000","last_unstale":"2024-09-15T23:12:15.277145+0000","last_undegraded":"2024-09-15T23:12:15.277145+0000","last_fullsized":"2024-09-15T23:12:15.277145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:22.552069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.307884+0000","last_change":"2024-09-15T23:12:13.306601+0000","last_active":"2024-09-15T23:12:13.307884+0000","last_peered":"2024-09-15T23:12:13.307884+0000","last_clean":"2024-09-15T23:12:13.307884+0000","last_became_active":"2024-09-15T23:12:13.306342+0000","last_became_peered":"2024-09-15T23:12:13.306342+0000","last_unstale":"2024-09-15T23:12:13.307884+0000","last_undegraded":"2024-09-15T23:12:13.307884+0000","last_fullsized":"2024-09-15T23:12:13.307884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:23:11.450569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142541+0000","last_change":"2024-09-15T23:12:12.305855+0000","last_active":"2024-09-15T23:12:15.142541+0000","last_peered":"2024-09-15T23:12:15.142541+0000","last_clean":"2024-09-15T23:12:15.142541+0000","last_became_active":"2024-09-15T23:12:12.305533+0000","last_became_peered":"2024-09-15T23:12:12.305533+0000","last_unstale":"2024-09-15T23:12:15.142541+0000","last_undegraded":"2024-09-15T23:12:15.142541+0000","last_fullsized":"2024-09-15T23:12:15.142541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:11.043406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.294002+0000","last_change":"2024-09-15T23:12:13.292019+0000","last_active":"2024-09-15T23:12:13.294002+0000","last_peered":"2024-09-15T23:12:13.294002+0000","last_clean":"2024-09-15T23:12:13.294002+0000","last_became_active":"2024-09-15T23:12:13.290585+0000","last_became_peered":"2024-09-15T23:12:13.290585+0000","last_unstale":"2024-09-15T23:12:13.294002+0000","last_undegraded":"2024-09-15T23:12:13.294002+0000","last_fullsized":"2024-09-15T23:12:13.294002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:10:44.616598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.281241+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:12:13.281241+0000","last_peered":"2024-09-15T23:12:13.281241+0000","last_clean":"2024-09-15T23:12:13.281241+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:12:13.281241+0000","last_undegraded":"2024-09-15T23:12:13.281241+0000","last_fullsized":"2024-09-15T23:12:13.281241+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.283904+0000","last_change":"2024-09-15T23:12:12.295819+0000","last_active":"2024-09-15T23:12:13.283904+0000","last_peered":"2024-09-15T23:12:13.283904+0000","last_clean":"2024-09-15T23:12:13.283904+0000","last_became_active":"2024-09-15T23:12:12.295320+0000","last_became_peered":"2024-09-15T23:12:12.295320+0000","last_unstale":"2024-09-15T23:12:13.283904+0000","last_undegraded":"2024-09-15T23:12:13.283904+0000","last_fullsized":"2024-09-15T23:12:13.283904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:13.348463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776701+0000","last_change":"2024-09-15T23:12:13.292512+0000","last_active":"2024-09-15T23:12:14.776701+0000","last_peered":"2024-09-15T23:12:14.776701+0000","last_clean":"2024-09-15T23:12:14.776701+0000","last_became_active":"2024-09-15T23:12:13.292230+0000","last_became_peered":"2024-09-15T23:12:13.292230+0000","last_unstale":"2024-09-15T23:12:14.776701+0000","last_undegraded":"2024-09-15T23:12:14.776701+0000","last_fullsized":"2024-09-15T23:12:14.776701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:51.115293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.281967+0000","last_change":"2024-09-15T23:12:12.293545+0000","last_active":"2024-09-15T23:12:13.281967+0000","last_peered":"2024-09-15T23:12:13.281967+0000","last_clean":"2024-09-15T23:12:13.281967+0000","last_became_active":"2024-09-15T23:12:12.292903+0000","last_became_peered":"2024-09-15T23:12:12.292903+0000","last_unstale":"2024-09-15T23:12:13.281967+0000","last_undegraded":"2024-09-15T23:12:13.281967+0000","last_fullsized":"2024-09-15T23:12:13.281967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:46.714431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142240+0000","last_change":"2024-09-15T23:12:13.298677+0000","last_active":"2024-09-15T23:12:15.142240+0000","last_peered":"2024-09-15T23:12:15.142240+0000","last_clean":"2024-09-15T23:12:15.142240+0000","last_became_active":"2024-09-15T23:12:13.298386+0000","last_became_peered":"2024-09-15T23:12:13.298386+0000","last_unstale":"2024-09-15T23:12:15.142240+0000","last_undegraded":"2024-09-15T23:12:15.142240+0000","last_fullsized":"2024-09-15T23:12:15.142240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:10:04.877140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282158+0000","last_change":"2024-09-15T23:12:12.296394+0000","last_active":"2024-09-15T23:12:14.282158+0000","last_peered":"2024-09-15T23:12:14.282158+0000","last_clean":"2024-09-15T23:12:14.282158+0000","last_became_active":"2024-09-15T23:12:12.296110+0000","last_became_peered":"2024-09-15T23:12:12.296110+0000","last_unstale":"2024-09-15T23:12:14.282158+0000","last_undegraded":"2024-09-15T23:12:14.282158+0000","last_fullsized":"2024-09-15T23:12:14.282158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:54.309977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277322+0000","last_change":"2024-09-15T23:12:13.294854+0000","last_active":"2024-09-15T23:12:15.277322+0000","last_peered":"2024-09-15T23:12:15.277322+0000","last_clean":"2024-09-15T23:12:15.277322+0000","last_became_active":"2024-09-15T23:12:13.294539+0000","last_became_peered":"2024-09-15T23:12:13.294539+0000","last_unstale":"2024-09-15T23:12:15.277322+0000","last_undegraded":"2024-09-15T23:12:15.277322+0000","last_fullsized":"2024-09-15T23:12:15.277322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:43:07.769498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.282268+0000","last_change":"2024-09-15T23:12:12.300290+0000","last_active":"2024-09-15T23:12:13.282268+0000","last_peered":"2024-09-15T23:12:13.282268+0000","last_clean":"2024-09-15T23:12:13.282268+0000","last_became_active":"2024-09-15T23:12:12.300024+0000","last_became_peered":"2024-09-15T23:12:12.300024+0000","last_unstale":"2024-09-15T23:12:13.282268+0000","last_undegraded":"2024-09-15T23:12:13.282268+0000","last_fullsized":"2024-09-15T23:12:13.282268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:10:03.870065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306057+0000","last_change":"2024-09-15T23:12:13.300590+0000","last_active":"2024-09-15T23:12:13.306057+0000","last_peered":"2024-09-15T23:12:13.306057+0000","last_clean":"2024-09-15T23:12:13.306057+0000","last_became_active":"2024-09-15T23:12:13.300376+0000","last_became_peered":"2024-09-15T23:12:13.300376+0000","last_unstale":"2024-09-15T23:12:13.306057+0000","last_undegraded":"2024-09-15T23:12:13.306057+0000","last_fullsized":"2024-09-15T23:12:13.306057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:14.355538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277032+0000","last_change":"2024-09-15T23:12:12.297859+0000","last_active":"2024-09-15T23:12:15.277032+0000","last_peered":"2024-09-15T23:12:15.277032+0000","last_clean":"2024-09-15T23:12:15.277032+0000","last_became_active":"2024-09-15T23:12:12.297520+0000","last_became_peered":"2024-09-15T23:12:12.297520+0000","last_unstale":"2024-09-15T23:12:15.277032+0000","last_undegraded":"2024-09-15T23:12:15.277032+0000","last_fullsized":"2024-09-15T23:12:15.277032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:12.407756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305592+0000","last_change":"2024-09-15T23:12:13.300154+0000","last_active":"2024-09-15T23:12:13.305592+0000","last_peered":"2024-09-15T23:12:13.305592+0000","last_clean":"2024-09-15T23:12:13.305592+0000","last_became_active":"2024-09-15T23:12:13.299919+0000","last_became_peered":"2024-09-15T23:12:13.299919+0000","last_unstale":"2024-09-15T23:12:13.305592+0000","last_undegraded":"2024-09-15T23:12:13.305592+0000","last_fullsized":"2024-09-15T23:12:13.305592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:42:51.295319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.282980+0000","last_change":"2024-09-15T23:12:12.296791+0000","last_active":"2024-09-15T23:12:13.282980+0000","last_peered":"2024-09-15T23:12:13.282980+0000","last_clean":"2024-09-15T23:12:13.282980+0000","last_became_active":"2024-09-15T23:12:12.296507+0000","last_became_peered":"2024-09-15T23:12:12.296507+0000","last_unstale":"2024-09-15T23:12:13.282980+0000","last_undegraded":"2024-09-15T23:12:13.282980+0000","last_fullsized":"2024-09-15T23:12:13.282980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:08:50.152082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142523+0000","last_change":"2024-09-15T23:12:13.296540+0000","last_active":"2024-09-15T23:12:15.142523+0000","last_peered":"2024-09-15T23:12:15.142523+0000","last_clean":"2024-09-15T23:12:15.142523+0000","last_became_active":"2024-09-15T23:12:13.295765+0000","last_became_peered":"2024-09-15T23:12:13.295765+0000","last_unstale":"2024-09-15T23:12:15.142523+0000","last_undegraded":"2024-09-15T23:12:15.142523+0000","last_fullsized":"2024-09-15T23:12:15.142523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:03.932670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776948+0000","last_change":"2024-09-15T23:12:12.300784+0000","last_active":"2024-09-15T23:12:14.776948+0000","last_peered":"2024-09-15T23:12:14.776948+0000","last_clean":"2024-09-15T23:12:14.776948+0000","last_became_active":"2024-09-15T23:12:12.300267+0000","last_became_peered":"2024-09-15T23:12:12.300267+0000","last_unstale":"2024-09-15T23:12:14.776948+0000","last_undegraded":"2024-09-15T23:12:14.776948+0000","last_fullsized":"2024-09-15T23:12:14.776948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:01:57.256014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776957+0000","last_change":"2024-09-15T23:12:13.304126+0000","last_active":"2024-09-15T23:12:14.776957+0000","last_peered":"2024-09-15T23:12:14.776957+0000","last_clean":"2024-09-15T23:12:14.776957+0000","last_became_active":"2024-09-15T23:12:13.303461+0000","last_became_peered":"2024-09-15T23:12:13.303461+0000","last_unstale":"2024-09-15T23:12:14.776957+0000","last_undegraded":"2024-09-15T23:12:14.776957+0000","last_fullsized":"2024-09-15T23:12:14.776957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:43:07.769498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.307939+0000","last_change":"2024-09-15T23:12:12.297628+0000","last_active":"2024-09-15T23:12:13.307939+0000","last_peered":"2024-09-15T23:12:13.307939+0000","last_clean":"2024-09-15T23:12:13.307939+0000","last_became_active":"2024-09-15T23:12:12.297392+0000","last_became_peered":"2024-09-15T23:12:12.297392+0000","last_unstale":"2024-09-15T23:12:13.307939+0000","last_undegraded":"2024-09-15T23:12:13.307939+0000","last_fullsized":"2024-09-15T23:12:13.307939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:26:21.303262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776864+0000","last_change":"2024-09-15T23:12:13.305087+0000","last_active":"2024-09-15T23:12:14.776864+0000","last_peered":"2024-09-15T23:12:14.776864+0000","last_clean":"2024-09-15T23:12:14.776864+0000","last_became_active":"2024-09-15T23:12:13.304851+0000","last_became_peered":"2024-09-15T23:12:13.304851+0000","last_unstale":"2024-09-15T23:12:14.776864+0000","last_undegraded":"2024-09-15T23:12:14.776864+0000","last_fullsized":"2024-09-15T23:12:14.776864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:53.919348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.286852+0000","last_change":"2024-09-15T23:12:12.292922+0000","last_active":"2024-09-15T23:12:13.286852+0000","last_peered":"2024-09-15T23:12:13.286852+0000","last_clean":"2024-09-15T23:12:13.286852+0000","last_became_active":"2024-09-15T23:12:12.292606+0000","last_became_peered":"2024-09-15T23:12:12.292606+0000","last_unstale":"2024-09-15T23:12:13.286852+0000","last_undegraded":"2024-09-15T23:12:13.286852+0000","last_fullsized":"2024-09-15T23:12:13.286852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:25.929262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.304754+0000","last_change":"2024-09-15T23:12:13.300968+0000","last_active":"2024-09-15T23:12:13.304754+0000","last_peered":"2024-09-15T23:12:13.304754+0000","last_clean":"2024-09-15T23:12:13.304754+0000","last_became_active":"2024-09-15T23:12:13.300679+0000","last_became_peered":"2024-09-15T23:12:13.300679+0000","last_unstale":"2024-09-15T23:12:13.304754+0000","last_undegraded":"2024-09-15T23:12:13.304754+0000","last_fullsized":"2024-09-15T23:12:13.304754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:10.165586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776598+0000","last_change":"2024-09-15T23:12:12.300647+0000","last_active":"2024-09-15T23:12:14.776598+0000","last_peered":"2024-09-15T23:12:14.776598+0000","last_clean":"2024-09-15T23:12:14.776598+0000","last_became_active":"2024-09-15T23:12:12.300181+0000","last_became_peered":"2024-09-15T23:12:12.300181+0000","last_unstale":"2024-09-15T23:12:14.776598+0000","last_undegraded":"2024-09-15T23:12:14.776598+0000","last_fullsized":"2024-09-15T23:12:14.776598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:22.552069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776822+0000","last_change":"2024-09-15T23:12:13.300864+0000","last_active":"2024-09-15T23:12:14.776822+0000","last_peered":"2024-09-15T23:12:14.776822+0000","last_clean":"2024-09-15T23:12:14.776822+0000","last_became_active":"2024-09-15T23:12:13.300258+0000","last_became_peered":"2024-09-15T23:12:13.300258+0000","last_unstale":"2024-09-15T23:12:14.776822+0000","last_undegraded":"2024-09-15T23:12:14.776822+0000","last_fullsized":"2024-09-15T23:12:14.776822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:40.921752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142436+0000","last_change":"2024-09-15T23:12:12.304706+0000","last_active":"2024-09-15T23:12:15.142436+0000","last_peered":"2024-09-15T23:12:15.142436+0000","last_clean":"2024-09-15T23:12:15.142436+0000","last_became_active":"2024-09-15T23:12:12.304384+0000","last_became_peered":"2024-09-15T23:12:12.304384+0000","last_unstale":"2024-09-15T23:12:15.142436+0000","last_undegraded":"2024-09-15T23:12:15.142436+0000","last_fullsized":"2024-09-15T23:12:15.142436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:43.458579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282456+0000","last_change":"2024-09-15T23:12:13.305512+0000","last_active":"2024-09-15T23:12:14.282456+0000","last_peered":"2024-09-15T23:12:14.282456+0000","last_clean":"2024-09-15T23:12:14.282456+0000","last_became_active":"2024-09-15T23:12:13.305192+0000","last_became_peered":"2024-09-15T23:12:13.305192+0000","last_unstale":"2024-09-15T23:12:14.282456+0000","last_undegraded":"2024-09-15T23:12:14.282456+0000","last_fullsized":"2024-09-15T23:12:14.282456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:47.721506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.306625+0000","last_change":"2024-09-15T23:12:12.295599+0000","last_active":"2024-09-15T23:12:13.306625+0000","last_peered":"2024-09-15T23:12:13.306625+0000","last_clean":"2024-09-15T23:12:13.306625+0000","last_became_active":"2024-09-15T23:12:12.295036+0000","last_became_peered":"2024-09-15T23:12:12.295036+0000","last_unstale":"2024-09-15T23:12:13.306625+0000","last_undegraded":"2024-09-15T23:12:13.306625+0000","last_fullsized":"2024-09-15T23:12:13.306625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:03.815413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.294113+0000","last_change":"2024-09-15T23:12:13.292087+0000","last_active":"2024-09-15T23:12:13.294113+0000","last_peered":"2024-09-15T23:12:13.294113+0000","last_clean":"2024-09-15T23:12:13.294113+0000","last_became_active":"2024-09-15T23:12:13.291588+0000","last_became_peered":"2024-09-15T23:12:13.291588+0000","last_unstale":"2024-09-15T23:12:13.294113+0000","last_undegraded":"2024-09-15T23:12:13.294113+0000","last_fullsized":"2024-09-15T23:12:13.294113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:28.842608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.300062+0000","last_change":"2024-09-15T23:12:13.295583+0000","last_active":"2024-09-15T23:12:13.300062+0000","last_peered":"2024-09-15T23:12:13.300062+0000","last_clean":"2024-09-15T23:12:13.300062+0000","last_became_active":"2024-09-15T23:12:13.295285+0000","last_became_peered":"2024-09-15T23:12:13.295285+0000","last_unstale":"2024-09-15T23:12:13.300062+0000","last_undegraded":"2024-09-15T23:12:13.300062+0000","last_fullsized":"2024-09-15T23:12:13.300062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:23:11.450569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.305733+0000","last_change":"2024-09-15T23:12:12.293704+0000","last_active":"2024-09-15T23:12:13.305733+0000","last_peered":"2024-09-15T23:12:13.305733+0000","last_clean":"2024-09-15T23:12:13.305733+0000","last_became_active":"2024-09-15T23:12:12.292898+0000","last_became_peered":"2024-09-15T23:12:12.292898+0000","last_unstale":"2024-09-15T23:12:13.305733+0000","last_undegraded":"2024-09-15T23:12:13.305733+0000","last_fullsized":"2024-09-15T23:12:13.305733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:27.285153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.298233+0000","last_change":"2024-09-15T23:12:13.295743+0000","last_active":"2024-09-15T23:12:13.298233+0000","last_peered":"2024-09-15T23:12:13.298233+0000","last_clean":"2024-09-15T23:12:13.298233+0000","last_became_active":"2024-09-15T23:12:13.295104+0000","last_became_peered":"2024-09-15T23:12:13.295104+0000","last_unstale":"2024-09-15T23:12:13.298233+0000","last_undegraded":"2024-09-15T23:12:13.298233+0000","last_fullsized":"2024-09-15T23:12:13.298233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:42:51.295319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-15T23:12:13.302127+0000","last_change":"2024-09-15T23:12:12.293296+0000","last_active":"2024-09-15T23:12:13.302127+0000","last_peered":"2024-09-15T23:12:13.302127+0000","last_clean":"2024-09-15T23:12:13.302127+0000","last_became_active":"2024-09-15T23:12:12.292920+0000","last_became_peered":"2024-09-15T23:12:12.292920+0000","last_unstale":"2024-09-15T23:12:13.302127+0000","last_undegraded":"2024-09-15T23:12:13.302127+0000","last_fullsized":"2024-09-15T23:12:13.302127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:17.787033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277421+0000","last_change":"2024-09-15T23:12:13.297368+0000","last_active":"2024-09-15T23:12:15.277421+0000","last_peered":"2024-09-15T23:12:15.277421+0000","last_clean":"2024-09-15T23:12:15.277421+0000","last_became_active":"2024-09-15T23:12:13.296735+0000","last_became_peered":"2024-09-15T23:12:13.296735+0000","last_unstale":"2024-09-15T23:12:15.277421+0000","last_undegraded":"2024-09-15T23:12:15.277421+0000","last_fullsized":"2024-09-15T23:12:15.277421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:11.250902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277466+0000","last_change":"2024-09-15T23:12:12.295645+0000","last_active":"2024-09-15T23:12:15.277466+0000","last_peered":"2024-09-15T23:12:15.277466+0000","last_clean":"2024-09-15T23:12:15.277466+0000","last_became_active":"2024-09-15T23:12:12.295359+0000","last_became_peered":"2024-09-15T23:12:12.295359+0000","last_unstale":"2024-09-15T23:12:15.277466+0000","last_undegraded":"2024-09-15T23:12:15.277466+0000","last_fullsized":"2024-09-15T23:12:15.277466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:01:57.256014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277490+0000","last_change":"2024-09-15T23:12:13.302910+0000","last_active":"2024-09-15T23:12:15.277490+0000","last_peered":"2024-09-15T23:12:15.277490+0000","last_clean":"2024-09-15T23:12:15.277490+0000","last_became_active":"2024-09-15T23:12:13.302457+0000","last_became_peered":"2024-09-15T23:12:13.302457+0000","last_unstale":"2024-09-15T23:12:15.277490+0000","last_undegraded":"2024-09-15T23:12:15.277490+0000","last_fullsized":"2024-09-15T23:12:15.277490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:17:08.108114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776995+0000","last_change":"2024-09-15T23:12:12.295905+0000","last_active":"2024-09-15T23:12:14.776995+0000","last_peered":"2024-09-15T23:12:14.776995+0000","last_clean":"2024-09-15T23:12:14.776995+0000","last_became_active":"2024-09-15T23:12:12.295619+0000","last_became_peered":"2024-09-15T23:12:12.295619+0000","last_unstale":"2024-09-15T23:12:14.776995+0000","last_undegraded":"2024-09-15T23:12:14.776995+0000","last_fullsized":"2024-09-15T23:12:14.776995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:11.550515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476743,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":192512,"data_stored":63389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476740,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":192512,"data_stored":63389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476742,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":786432,"data_stored":653757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476742,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":192512,"data_stored":63389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":76464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":819200,"data_stored":666924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":78748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:12:20.595 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:12:20.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.704+0000 7fed8796d640 1 Processor -- start 2024-09-15T23:12:20.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.704+0000 7fed8796d640 1 -- start start 2024-09-15T23:12:20.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.705+0000 7fed8796d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fed800b6830 0x7fed8006e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:20.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.705+0000 7fed8796d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed800b02b0 0x7fed8006e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:20.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.705+0000 7fed8796d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed80067b50 con 0x7fed8015c4b0 2024-09-15T23:12:20.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.705+0000 7fed8796d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fed800ce860 con 0x7fed800b6830 2024-09-15T23:12:20.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.705+0000 7fed8796d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fed80070130 con 0x7fed800b02b0 2024-09-15T23:12:20.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.705+0000 7fed85709640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fed8015c4b0 0x7fed800b6120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39026/0 (socket says 172.21.15.123:39026) 2024-09-15T23:12:20.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.705+0000 7fed85709640 1 -- 172.21.15.123:0/4172867796 learned_addr learned my addr 172.21.15.123:0/4172867796 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:20.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.705+0000 7fed84f08640 1 --2- 172.21.15.123:0/4172867796 >> v2:172.21.15.188:3300/0 conn(0x7fed800b6830 0x7fed8006e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:20.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.706+0000 7fed85f0a640 1 --2- 172.21.15.123:0/4172867796 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed800b02b0 0x7fed8006e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:20.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.706+0000 7fed77fff640 1 -- 172.21.15.123:0/4172867796 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2575491595 0 0) 0x7fed7c001110 con 0x7fed8015c4b0 2024-09-15T23:12:20.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.706+0000 7fed77fff640 1 -- 172.21.15.123:0/4172867796 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed6c003520 con 0x7fed8015c4b0 2024-09-15T23:12:20.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.706+0000 7fed77fff640 1 -- 172.21.15.123:0/4172867796 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2808748939 0 0) 0x7fed6c003520 con 0x7fed8015c4b0 2024-09-15T23:12:20.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.706+0000 7fed77fff640 1 -- 172.21.15.123:0/4172867796 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed800b02b0 msgr2=0x7fed8006e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:20.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.706+0000 7fed77fff640 1 --2- 172.21.15.123:0/4172867796 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed800b02b0 0x7fed8006e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:20.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.706+0000 7fed77fff640 1 -- 172.21.15.123:0/4172867796 >> v2:172.21.15.188:3300/0 conn(0x7fed800b6830 msgr2=0x7fed8006e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:20.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.706+0000 7fed77fff640 1 --2- 172.21.15.123:0/4172867796 >> v2:172.21.15.188:3300/0 conn(0x7fed800b6830 0x7fed8006e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:20.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.706+0000 7fed77fff640 1 -- 172.21.15.123:0/4172867796 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed8006fe50 con 0x7fed8015c4b0 2024-09-15T23:12:20.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.706+0000 7fed77fff640 1 -- 172.21.15.123:0/4172867796 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fed7c001840 con 0x7fed8015c4b0 2024-09-15T23:12:20.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.706+0000 7fed77fff640 1 -- 172.21.15.123:0/4172867796 >> v1:172.21.15.123:6789/0 conn(0x7fed8015c4b0 legacy=0x7fed800b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:20.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.706+0000 7fed77fff640 1 --2- 172.21.15.123:0/4172867796 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed800b02b0 0x7fed6c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:20.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.706+0000 7fed77fff640 1 --2- 172.21.15.123:0/4172867796 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed6c003f30 0x7fed6c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:20.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.706+0000 7fed77fff640 1 --2- 172.21.15.123:0/4172867796 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed6c004d40 0x7fed6c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:20.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.706+0000 7fed77fff640 1 -- 172.21.15.123:0/4172867796 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fed800ce860 con 0x7fed6c003f30 2024-09-15T23:12:20.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.706+0000 7fed77fff640 1 -- 172.21.15.123:0/4172867796 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fed80070130 con 0x7fed6c004d40 2024-09-15T23:12:20.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.706+0000 7fed77fff640 1 -- 172.21.15.123:0/4172867796 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fed6c00b9c0 con 0x7fed800b02b0 2024-09-15T23:12:20.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.706+0000 7fed84f08640 1 --2- 172.21.15.123:0/4172867796 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed6c003f30 0x7fed6c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:20.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.706+0000 7fed85709640 1 --2- 172.21.15.123:0/4172867796 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed800b02b0 0x7fed6c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:20.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.706+0000 7fed85f0a640 1 --2- 172.21.15.123:0/4172867796 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed6c004d40 0x7fed6c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:20.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.706+0000 7fed84f08640 1 -- 172.21.15.123:0/4172867796 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed800b02b0 msgr2=0x7fed6c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:20.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.706+0000 7fed84f08640 1 --2- 172.21.15.123:0/4172867796 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed800b02b0 0x7fed6c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:20.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.706+0000 7fed84f08640 1 -- 172.21.15.123:0/4172867796 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed6c004d40 msgr2=0x7fed6c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:20.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.706+0000 7fed84f08640 1 --2- 172.21.15.123:0/4172867796 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed6c004d40 0x7fed6c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:20.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.706+0000 7fed84f08640 1 -- 172.21.15.123:0/4172867796 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed6c003520 con 0x7fed6c003f30 2024-09-15T23:12:20.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.707+0000 7fed84f08640 1 --2- 172.21.15.123:0/4172867796 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed6c003f30 0x7fed6c004800 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fed70009ac0 tx=0x7fed6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5be86f50824a63 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:20.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.707+0000 7fed77fff640 1 -- 172.21.15.123:0/4172867796 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed70036070 con 0x7fed6c003f30 2024-09-15T23:12:20.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.707+0000 7fed77fff640 1 -- 172.21.15.123:0/4172867796 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed70031400 con 0x7fed6c003f30 2024-09-15T23:12:20.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.707+0000 7fed77fff640 1 -- 172.21.15.123:0/4172867796 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed70009690 con 0x7fed6c003f30 2024-09-15T23:12:20.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.708+0000 7fed8796d640 1 -- 172.21.15.123:0/4172867796 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed6c003f30 msgr2=0x7fed6c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:20.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.708+0000 7fed8796d640 1 --2- 172.21.15.123:0/4172867796 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed6c003f30 0x7fed6c004800 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fed70009ac0 tx=0x7fed6c005830 comp rx=0 tx=0).stop 2024-09-15T23:12:20.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.708+0000 7fed85f0a640 1 -- 172.21.15.123:0/4172867796 reap_dead start 2024-09-15T23:12:20.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.708+0000 7fed8796d640 1 -- 172.21.15.123:0/4172867796 shutdown_connections 2024-09-15T23:12:20.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.708+0000 7fed8796d640 1 -- 172.21.15.123:0/4172867796 >> 172.21.15.123:0/4172867796 conn(0x7fed800b0a80 msgr2=0x7fed800b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:20.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.708+0000 7fed8796d640 1 -- 172.21.15.123:0/4172867796 shutdown_connections 2024-09-15T23:12:20.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.708+0000 7fed8796d640 1 -- 172.21.15.123:0/4172867796 wait complete. 2024-09-15T23:12:20.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.709+0000 7fed8796d640 1 Processor -- start 2024-09-15T23:12:20.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.709+0000 7fed8796d640 1 -- start start 2024-09-15T23:12:20.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.710+0000 7fed8796d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed6c003f30 0x7fed800af950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:20.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.710+0000 7fed8796d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed8015aac0 0x7fed8015af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:20.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.710+0000 7fed8796d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed801f2ac0 0x7fed801f2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:20.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.710+0000 7fed8796d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fed8006dcc0 con 0x7fed801f2ac0 2024-09-15T23:12:20.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.710+0000 7fed8796d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fed800ce580 con 0x7fed6c003f30 2024-09-15T23:12:20.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.710+0000 7fed8796d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fed8015c890 con 0x7fed8015aac0 2024-09-15T23:12:20.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.710+0000 7fed85709640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed6c003f30 0x7fed800af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:20.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.710+0000 7fed85f0a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed801f2ac0 0x7fed801f2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:20.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.710+0000 7fed84f08640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed8015aac0 0x7fed8015af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:20.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.710+0000 7fed84f08640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed8015aac0 0x7fed8015af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:41120/0 (socket says 172.21.15.123:41120) 2024-09-15T23:12:20.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.710+0000 7fed85f0a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed801f2ac0 0x7fed801f2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36120/0 (socket says 172.21.15.123:36120) 2024-09-15T23:12:20.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.710+0000 7fed84f08640 1 -- 172.21.15.123:0/921304015 learned_addr learned my addr 172.21.15.123:0/921304015 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:20.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.710+0000 7fed85f0a640 1 -- 172.21.15.123:0/921304015 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed8015aac0 msgr2=0x7fed8015af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:20.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.710+0000 7fed85f0a640 1 --2- 172.21.15.123:0/921304015 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed8015aac0 0x7fed8015af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:20.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.710+0000 7fed85f0a640 1 -- 172.21.15.123:0/921304015 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed6c003f30 msgr2=0x7fed800af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:20.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.710+0000 7fed85f0a640 1 --2- 172.21.15.123:0/921304015 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed6c003f30 0x7fed800af950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:20.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.710+0000 7fed85f0a640 1 -- 172.21.15.123:0/921304015 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed801f3480 con 0x7fed801f2ac0 2024-09-15T23:12:20.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.711+0000 7fed85f0a640 1 --2- 172.21.15.123:0/921304015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed801f2ac0 0x7fed801f2f40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fed80069d00 tx=0x7fed7800f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:20.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.711+0000 7fed75ffb640 1 -- 172.21.15.123:0/921304015 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7800fce0 con 0x7fed801f2ac0 2024-09-15T23:12:20.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.711+0000 7fed75ffb640 1 -- 172.21.15.123:0/921304015 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed7801d070 con 0x7fed801f2ac0 2024-09-15T23:12:20.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.711+0000 7fed8796d640 1 -- 172.21.15.123:0/921304015 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed801f3960 con 0x7fed801f2ac0 2024-09-15T23:12:20.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.711+0000 7fed75ffb640 1 -- 172.21.15.123:0/921304015 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed78015670 con 0x7fed801f2ac0 2024-09-15T23:12:20.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.711+0000 7fed8796d640 1 -- 172.21.15.123:0/921304015 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed80158680 con 0x7fed801f2ac0 2024-09-15T23:12:20.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.712+0000 7fed8796d640 1 -- 172.21.15.123:0/921304015 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed800d08e0 con 0x7fed801f2ac0 2024-09-15T23:12:20.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.712+0000 7fed75ffb640 1 -- 172.21.15.123:0/921304015 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fed78015810 con 0x7fed801f2ac0 2024-09-15T23:12:20.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.713+0000 7fed75ffb640 1 --2- 172.21.15.123:0/921304015 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fed6406c2b0 0x7fed6406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:20.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.713+0000 7fed75ffb640 1 -- 172.21.15.123:0/921304015 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fed7808bad0 con 0x7fed801f2ac0 2024-09-15T23:12:20.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.713+0000 7fed85709640 1 --2- 172.21.15.123:0/921304015 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fed6406c2b0 0x7fed6406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:20.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.713+0000 7fed85709640 1 --2- 172.21.15.123:0/921304015 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fed6406c2b0 0x7fed6406e770 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fed7c001050 tx=0x7fed7c007ae0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:20.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.717+0000 7fed75ffb640 1 -- 172.21.15.123:0/921304015 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fed801f3480 con 0x7fed801f2ac0 2024-09-15T23:12:20.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.879+0000 7fed8796d640 1 -- 172.21.15.123:0/921304015 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fed800b0070 con 0x7fed6406c2b0 2024-09-15T23:12:20.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.886+0000 7fed75ffb640 1 -- 172.21.15.123:0/921304015 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251908 (secure 0 0 0) 0x7fed800b0070 con 0x7fed6406c2b0 2024-09-15T23:12:20.891 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:20.893 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:12:20.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.889+0000 7fed8796d640 1 -- 172.21.15.123:0/921304015 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fed6406c2b0 msgr2=0x7fed6406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:20.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.889+0000 7fed8796d640 1 --2- 172.21.15.123:0/921304015 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fed6406c2b0 0x7fed6406e770 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fed7c001050 tx=0x7fed7c007ae0 comp rx=0 tx=0).stop 2024-09-15T23:12:20.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.889+0000 7fed8796d640 1 -- 172.21.15.123:0/921304015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed801f2ac0 msgr2=0x7fed801f2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:20.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.889+0000 7fed8796d640 1 --2- 172.21.15.123:0/921304015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed801f2ac0 0x7fed801f2f40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fed80069d00 tx=0x7fed7800f1b0 comp rx=0 tx=0).stop 2024-09-15T23:12:20.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.889+0000 7fed8796d640 1 -- 172.21.15.123:0/921304015 shutdown_connections 2024-09-15T23:12:20.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.889+0000 7fed8796d640 1 --2- 172.21.15.123:0/921304015 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fed6406c2b0 0x7fed6406e770 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:20.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.889+0000 7fed8796d640 1 --2- 172.21.15.123:0/921304015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed801f2ac0 0x7fed801f2f40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:20.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.889+0000 7fed8796d640 1 --2- 172.21.15.123:0/921304015 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed8015aac0 0x7fed8015af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:20.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.889+0000 7fed8796d640 1 --2- 172.21.15.123:0/921304015 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed6c003f30 0x7fed800af950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:20.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.889+0000 7fed8796d640 1 -- 172.21.15.123:0/921304015 >> 172.21.15.123:0/921304015 conn(0x7fed800b0a80 msgr2=0x7fed8006eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:20.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.889+0000 7fed8796d640 1 -- 172.21.15.123:0/921304015 shutdown_connections 2024-09-15T23:12:20.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:20.889+0000 7fed8796d640 1 -- 172.21.15.123:0/921304015 wait complete. 2024-09-15T23:12:20.901 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-15T23:12:19.503688+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219176,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755544,"statfs":{"total":773094113280,"available":772869677056,"internally_reserved":0,"allocated":2990080,"data_stored":1797268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.221049"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.278230+0000","last_change":"2024-09-15T23:12:13.304372+0000","last_active":"2024-09-15T23:12:15.278230+0000","last_peered":"2024-09-15T23:12:15.278230+0000","last_clean":"2024-09-15T23:12:15.278230+0000","last_became_active":"2024-09-15T23:12:13.304067+0000","last_became_peered":"2024-09-15T23:12:13.304067+0000","last_unstale":"2024-09-15T23:12:15.278230+0000","last_undegraded":"2024-09-15T23:12:15.278230+0000","last_fullsized":"2024-09-15T23:12:15.278230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:16.349500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277385+0000","last_change":"2024-09-15T23:12:13.302592+0000","last_active":"2024-09-15T23:12:15.277385+0000","last_peered":"2024-09-15T23:12:15.277385+0000","last_clean":"2024-09-15T23:12:15.277385+0000","last_became_active":"2024-09-15T23:12:13.301990+0000","last_became_peered":"2024-09-15T23:12:13.301990+0000","last_unstale":"2024-09-15T23:12:15.277385+0000","last_undegraded":"2024-09-15T23:12:15.277385+0000","last_fullsized":"2024-09-15T23:12:15.277385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:10:09.891348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277323+0000","last_change":"2024-09-15T23:12:13.301292+0000","last_active":"2024-09-15T23:12:15.277323+0000","last_peered":"2024-09-15T23:12:15.277323+0000","last_clean":"2024-09-15T23:12:15.277323+0000","last_became_active":"2024-09-15T23:12:13.301019+0000","last_became_peered":"2024-09-15T23:12:13.301019+0000","last_unstale":"2024-09-15T23:12:15.277323+0000","last_undegraded":"2024-09-15T23:12:15.277323+0000","last_fullsized":"2024-09-15T23:12:15.277323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:45:01.842037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.278258+0000","last_change":"2024-09-15T23:12:13.302730+0000","last_active":"2024-09-15T23:12:15.278258+0000","last_peered":"2024-09-15T23:12:15.278258+0000","last_clean":"2024-09-15T23:12:15.278258+0000","last_became_active":"2024-09-15T23:12:13.302301+0000","last_became_peered":"2024-09-15T23:12:13.302301+0000","last_unstale":"2024-09-15T23:12:15.278258+0000","last_undegraded":"2024-09-15T23:12:15.278258+0000","last_fullsized":"2024-09-15T23:12:15.278258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:08:51.159156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277829+0000","last_change":"2024-09-15T23:12:13.298592+0000","last_active":"2024-09-15T23:12:15.277829+0000","last_peered":"2024-09-15T23:12:15.277829+0000","last_clean":"2024-09-15T23:12:15.277829+0000","last_became_active":"2024-09-15T23:12:13.298358+0000","last_became_peered":"2024-09-15T23:12:13.298358+0000","last_unstale":"2024-09-15T23:12:15.277829+0000","last_undegraded":"2024-09-15T23:12:15.277829+0000","last_fullsized":"2024-09-15T23:12:15.277829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:10.513438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277736+0000","last_change":"2024-09-15T23:12:13.302119+0000","last_active":"2024-09-15T23:12:15.277736+0000","last_peered":"2024-09-15T23:12:15.277736+0000","last_clean":"2024-09-15T23:12:15.277736+0000","last_became_active":"2024-09-15T23:12:13.301671+0000","last_became_peered":"2024-09-15T23:12:13.301671+0000","last_unstale":"2024-09-15T23:12:15.277736+0000","last_undegraded":"2024-09-15T23:12:15.277736+0000","last_fullsized":"2024-09-15T23:12:15.277736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:47.721506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277474+0000","last_change":"2024-09-15T23:12:13.301523+0000","last_active":"2024-09-15T23:12:15.277474+0000","last_peered":"2024-09-15T23:12:15.277474+0000","last_clean":"2024-09-15T23:12:15.277474+0000","last_became_active":"2024-09-15T23:12:13.301272+0000","last_became_peered":"2024-09-15T23:12:13.301272+0000","last_unstale":"2024-09-15T23:12:15.277474+0000","last_undegraded":"2024-09-15T23:12:15.277474+0000","last_fullsized":"2024-09-15T23:12:15.277474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:11.528380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277112+0000","last_change":"2024-09-15T23:12:13.297810+0000","last_active":"2024-09-15T23:12:15.277112+0000","last_peered":"2024-09-15T23:12:15.277112+0000","last_clean":"2024-09-15T23:12:15.277112+0000","last_became_active":"2024-09-15T23:12:13.295627+0000","last_became_peered":"2024-09-15T23:12:13.295627+0000","last_unstale":"2024-09-15T23:12:15.277112+0000","last_undegraded":"2024-09-15T23:12:15.277112+0000","last_fullsized":"2024-09-15T23:12:15.277112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:40.921752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.281209+0000","last_change":"2024-09-15T23:12:13.295501+0000","last_active":"2024-09-15T23:12:14.281209+0000","last_peered":"2024-09-15T23:12:14.281209+0000","last_clean":"2024-09-15T23:12:14.281209+0000","last_became_active":"2024-09-15T23:12:13.294470+0000","last_became_peered":"2024-09-15T23:12:13.294470+0000","last_unstale":"2024-09-15T23:12:14.281209+0000","last_undegraded":"2024-09-15T23:12:14.281209+0000","last_fullsized":"2024-09-15T23:12:14.281209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:27:22.925825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.278281+0000","last_change":"2024-09-15T23:12:13.300057+0000","last_active":"2024-09-15T23:12:15.278281+0000","last_peered":"2024-09-15T23:12:15.278281+0000","last_clean":"2024-09-15T23:12:15.278281+0000","last_became_active":"2024-09-15T23:12:13.299762+0000","last_became_peered":"2024-09-15T23:12:13.299762+0000","last_unstale":"2024-09-15T23:12:15.278281+0000","last_undegraded":"2024-09-15T23:12:15.278281+0000","last_fullsized":"2024-09-15T23:12:15.278281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:09:30.105488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277451+0000","last_change":"2024-09-15T23:12:13.296975+0000","last_active":"2024-09-15T23:12:15.277451+0000","last_peered":"2024-09-15T23:12:15.277451+0000","last_clean":"2024-09-15T23:12:15.277451+0000","last_became_active":"2024-09-15T23:12:13.296726+0000","last_became_peered":"2024-09-15T23:12:13.296726+0000","last_unstale":"2024-09-15T23:12:15.277451+0000","last_undegraded":"2024-09-15T23:12:15.277451+0000","last_fullsized":"2024-09-15T23:12:15.277451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:54:01.331747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277641+0000","last_change":"2024-09-15T23:12:13.299790+0000","last_active":"2024-09-15T23:12:15.277641+0000","last_peered":"2024-09-15T23:12:15.277641+0000","last_clean":"2024-09-15T23:12:15.277641+0000","last_became_active":"2024-09-15T23:12:13.299446+0000","last_became_peered":"2024-09-15T23:12:13.299446+0000","last_unstale":"2024-09-15T23:12:15.277641+0000","last_undegraded":"2024-09-15T23:12:15.277641+0000","last_fullsized":"2024-09-15T23:12:15.277641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:25.899342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142410+0000","last_change":"2024-09-15T23:12:13.303570+0000","last_active":"2024-09-15T23:12:15.142410+0000","last_peered":"2024-09-15T23:12:15.142410+0000","last_clean":"2024-09-15T23:12:15.142410+0000","last_became_active":"2024-09-15T23:12:13.303303+0000","last_became_peered":"2024-09-15T23:12:13.303303+0000","last_unstale":"2024-09-15T23:12:15.142410+0000","last_undegraded":"2024-09-15T23:12:15.142410+0000","last_fullsized":"2024-09-15T23:12:15.142410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:14.355538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142296+0000","last_change":"2024-09-15T23:12:13.297459+0000","last_active":"2024-09-15T23:12:15.142296+0000","last_peered":"2024-09-15T23:12:15.142296+0000","last_clean":"2024-09-15T23:12:15.142296+0000","last_became_active":"2024-09-15T23:12:13.293984+0000","last_became_peered":"2024-09-15T23:12:13.293984+0000","last_unstale":"2024-09-15T23:12:15.142296+0000","last_undegraded":"2024-09-15T23:12:15.142296+0000","last_fullsized":"2024-09-15T23:12:15.142296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:26:22.310337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277181+0000","last_change":"2024-09-15T23:12:13.296112+0000","last_active":"2024-09-15T23:12:15.277181+0000","last_peered":"2024-09-15T23:12:15.277181+0000","last_clean":"2024-09-15T23:12:15.277181+0000","last_became_active":"2024-09-15T23:12:13.295405+0000","last_became_peered":"2024-09-15T23:12:13.295405+0000","last_unstale":"2024-09-15T23:12:15.277181+0000","last_undegraded":"2024-09-15T23:12:15.277181+0000","last_fullsized":"2024-09-15T23:12:15.277181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:53.919348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282130+0000","last_change":"2024-09-15T23:12:13.302744+0000","last_active":"2024-09-15T23:12:14.282130+0000","last_peered":"2024-09-15T23:12:14.282130+0000","last_clean":"2024-09-15T23:12:14.282130+0000","last_became_active":"2024-09-15T23:12:13.302439+0000","last_became_peered":"2024-09-15T23:12:13.302439+0000","last_unstale":"2024-09-15T23:12:14.282130+0000","last_undegraded":"2024-09-15T23:12:14.282130+0000","last_fullsized":"2024-09-15T23:12:14.282130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:16.349500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282569+0000","last_change":"2024-09-15T23:12:13.298338+0000","last_active":"2024-09-15T23:12:14.282569+0000","last_peered":"2024-09-15T23:12:14.282569+0000","last_clean":"2024-09-15T23:12:14.282569+0000","last_became_active":"2024-09-15T23:12:13.297884+0000","last_became_peered":"2024-09-15T23:12:13.297884+0000","last_unstale":"2024-09-15T23:12:14.282569+0000","last_undegraded":"2024-09-15T23:12:14.282569+0000","last_fullsized":"2024-09-15T23:12:14.282569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:41:23.354555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282638+0000","last_change":"2024-09-15T23:12:13.306391+0000","last_active":"2024-09-15T23:12:14.282638+0000","last_peered":"2024-09-15T23:12:14.282638+0000","last_clean":"2024-09-15T23:12:14.282638+0000","last_became_active":"2024-09-15T23:12:13.306106+0000","last_became_peered":"2024-09-15T23:12:13.306106+0000","last_unstale":"2024-09-15T23:12:14.282638+0000","last_undegraded":"2024-09-15T23:12:14.282638+0000","last_fullsized":"2024-09-15T23:12:14.282638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:28.292228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282623+0000","last_change":"2024-09-15T23:12:13.300688+0000","last_active":"2024-09-15T23:12:14.282623+0000","last_peered":"2024-09-15T23:12:14.282623+0000","last_clean":"2024-09-15T23:12:14.282623+0000","last_became_active":"2024-09-15T23:12:13.300388+0000","last_became_peered":"2024-09-15T23:12:13.300388+0000","last_unstale":"2024-09-15T23:12:14.282623+0000","last_undegraded":"2024-09-15T23:12:14.282623+0000","last_fullsized":"2024-09-15T23:12:14.282623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:48.197999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277699+0000","last_change":"2024-09-15T23:12:13.295852+0000","last_active":"2024-09-15T23:12:15.277699+0000","last_peered":"2024-09-15T23:12:15.277699+0000","last_clean":"2024-09-15T23:12:15.277699+0000","last_became_active":"2024-09-15T23:12:13.295536+0000","last_became_peered":"2024-09-15T23:12:13.295536+0000","last_unstale":"2024-09-15T23:12:15.277699+0000","last_undegraded":"2024-09-15T23:12:15.277699+0000","last_fullsized":"2024-09-15T23:12:15.277699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:10.165586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776770+0000","last_change":"2024-09-15T23:12:13.302978+0000","last_active":"2024-09-15T23:12:14.776770+0000","last_peered":"2024-09-15T23:12:14.776770+0000","last_clean":"2024-09-15T23:12:14.776770+0000","last_became_active":"2024-09-15T23:12:13.302474+0000","last_became_peered":"2024-09-15T23:12:13.302474+0000","last_unstale":"2024-09-15T23:12:14.776770+0000","last_undegraded":"2024-09-15T23:12:14.776770+0000","last_fullsized":"2024-09-15T23:12:14.776770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:13:52.918855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.280957+0000","last_change":"2024-09-15T23:12:13.296548+0000","last_active":"2024-09-15T23:12:14.280957+0000","last_peered":"2024-09-15T23:12:14.280957+0000","last_clean":"2024-09-15T23:12:14.280957+0000","last_became_active":"2024-09-15T23:12:13.294814+0000","last_became_peered":"2024-09-15T23:12:13.294814+0000","last_unstale":"2024-09-15T23:12:14.280957+0000","last_undegraded":"2024-09-15T23:12:14.280957+0000","last_fullsized":"2024-09-15T23:12:14.280957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:30.079827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277175+0000","last_change":"2024-09-15T23:12:13.298250+0000","last_active":"2024-09-15T23:12:15.277175+0000","last_peered":"2024-09-15T23:12:15.277175+0000","last_clean":"2024-09-15T23:12:15.277175+0000","last_became_active":"2024-09-15T23:12:13.297923+0000","last_became_peered":"2024-09-15T23:12:13.297923+0000","last_unstale":"2024-09-15T23:12:15.277175+0000","last_undegraded":"2024-09-15T23:12:15.277175+0000","last_fullsized":"2024-09-15T23:12:15.277175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:32.902323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282119+0000","last_change":"2024-09-15T23:12:13.293872+0000","last_active":"2024-09-15T23:12:14.282119+0000","last_peered":"2024-09-15T23:12:14.282119+0000","last_clean":"2024-09-15T23:12:14.282119+0000","last_became_active":"2024-09-15T23:12:13.293608+0000","last_became_peered":"2024-09-15T23:12:13.293608+0000","last_unstale":"2024-09-15T23:12:14.282119+0000","last_undegraded":"2024-09-15T23:12:14.282119+0000","last_fullsized":"2024-09-15T23:12:14.282119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:05.614358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277371+0000","last_change":"2024-09-15T23:12:13.297603+0000","last_active":"2024-09-15T23:12:15.277371+0000","last_peered":"2024-09-15T23:12:15.277371+0000","last_clean":"2024-09-15T23:12:15.277371+0000","last_became_active":"2024-09-15T23:12:13.297090+0000","last_became_peered":"2024-09-15T23:12:13.297090+0000","last_unstale":"2024-09-15T23:12:15.277371+0000","last_undegraded":"2024-09-15T23:12:15.277371+0000","last_fullsized":"2024-09-15T23:12:15.277371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:20:45.209892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277872+0000","last_change":"2024-09-15T23:12:13.299195+0000","last_active":"2024-09-15T23:12:15.277872+0000","last_peered":"2024-09-15T23:12:15.277872+0000","last_clean":"2024-09-15T23:12:15.277872+0000","last_became_active":"2024-09-15T23:12:13.298466+0000","last_became_peered":"2024-09-15T23:12:13.298466+0000","last_unstale":"2024-09-15T23:12:15.277872+0000","last_undegraded":"2024-09-15T23:12:15.277872+0000","last_fullsized":"2024-09-15T23:12:15.277872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:28.292228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142578+0000","last_change":"2024-09-15T23:12:13.293831+0000","last_active":"2024-09-15T23:12:15.142578+0000","last_peered":"2024-09-15T23:12:15.142578+0000","last_clean":"2024-09-15T23:12:15.142578+0000","last_became_active":"2024-09-15T23:12:13.293105+0000","last_became_peered":"2024-09-15T23:12:13.293105+0000","last_unstale":"2024-09-15T23:12:15.142578+0000","last_undegraded":"2024-09-15T23:12:15.142578+0000","last_fullsized":"2024-09-15T23:12:15.142578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:10:44.616598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142320+0000","last_change":"2024-09-15T23:12:13.304201+0000","last_active":"2024-09-15T23:12:15.142320+0000","last_peered":"2024-09-15T23:12:15.142320+0000","last_clean":"2024-09-15T23:12:15.142320+0000","last_became_active":"2024-09-15T23:12:13.303927+0000","last_became_peered":"2024-09-15T23:12:13.303927+0000","last_unstale":"2024-09-15T23:12:15.142320+0000","last_undegraded":"2024-09-15T23:12:15.142320+0000","last_fullsized":"2024-09-15T23:12:15.142320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:04.822487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277367+0000","last_change":"2024-09-15T23:12:13.306673+0000","last_active":"2024-09-15T23:12:15.277367+0000","last_peered":"2024-09-15T23:12:15.277367+0000","last_clean":"2024-09-15T23:12:15.277367+0000","last_became_active":"2024-09-15T23:12:13.306402+0000","last_became_peered":"2024-09-15T23:12:13.306402+0000","last_unstale":"2024-09-15T23:12:15.277367+0000","last_undegraded":"2024-09-15T23:12:15.277367+0000","last_fullsized":"2024-09-15T23:12:15.277367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:38.511766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282237+0000","last_change":"2024-09-15T23:12:13.291856+0000","last_active":"2024-09-15T23:12:14.282237+0000","last_peered":"2024-09-15T23:12:14.282237+0000","last_clean":"2024-09-15T23:12:14.282237+0000","last_became_active":"2024-09-15T23:12:13.291050+0000","last_became_peered":"2024-09-15T23:12:13.291050+0000","last_unstale":"2024-09-15T23:12:14.282237+0000","last_undegraded":"2024-09-15T23:12:14.282237+0000","last_fullsized":"2024-09-15T23:12:14.282237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:14:14.059613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282338+0000","last_change":"2024-09-15T23:12:13.303266+0000","last_active":"2024-09-15T23:12:14.282338+0000","last_peered":"2024-09-15T23:12:14.282338+0000","last_clean":"2024-09-15T23:12:14.282338+0000","last_became_active":"2024-09-15T23:12:13.302500+0000","last_became_peered":"2024-09-15T23:12:13.302500+0000","last_unstale":"2024-09-15T23:12:14.282338+0000","last_undegraded":"2024-09-15T23:12:14.282338+0000","last_fullsized":"2024-09-15T23:12:14.282338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:30.079827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277224+0000","last_change":"2024-09-15T23:12:13.300877+0000","last_active":"2024-09-15T23:12:15.277224+0000","last_peered":"2024-09-15T23:12:15.277224+0000","last_clean":"2024-09-15T23:12:15.277224+0000","last_became_active":"2024-09-15T23:12:13.300604+0000","last_became_peered":"2024-09-15T23:12:13.300604+0000","last_unstale":"2024-09-15T23:12:15.277224+0000","last_undegraded":"2024-09-15T23:12:15.277224+0000","last_fullsized":"2024-09-15T23:12:15.277224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:30.079827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.280979+0000","last_change":"2024-09-15T23:12:13.290806+0000","last_active":"2024-09-15T23:12:14.280979+0000","last_peered":"2024-09-15T23:12:14.280979+0000","last_clean":"2024-09-15T23:12:14.280979+0000","last_became_active":"2024-09-15T23:12:13.290534+0000","last_became_peered":"2024-09-15T23:12:13.290534+0000","last_unstale":"2024-09-15T23:12:14.280979+0000","last_undegraded":"2024-09-15T23:12:14.280979+0000","last_fullsized":"2024-09-15T23:12:14.280979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:47.721506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277101+0000","last_change":"2024-09-15T23:12:12.299410+0000","last_active":"2024-09-15T23:12:15.277101+0000","last_peered":"2024-09-15T23:12:15.277101+0000","last_clean":"2024-09-15T23:12:15.277101+0000","last_became_active":"2024-09-15T23:12:12.299149+0000","last_became_peered":"2024-09-15T23:12:12.299149+0000","last_unstale":"2024-09-15T23:12:15.277101+0000","last_undegraded":"2024-09-15T23:12:15.277101+0000","last_fullsized":"2024-09-15T23:12:15.277101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:28.555228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776858+0000","last_change":"2024-09-15T23:12:13.293900+0000","last_active":"2024-09-15T23:12:14.776858+0000","last_peered":"2024-09-15T23:12:14.776858+0000","last_clean":"2024-09-15T23:12:14.776858+0000","last_became_active":"2024-09-15T23:12:13.293602+0000","last_became_peered":"2024-09-15T23:12:13.293602+0000","last_unstale":"2024-09-15T23:12:14.776858+0000","last_undegraded":"2024-09-15T23:12:14.776858+0000","last_fullsized":"2024-09-15T23:12:14.776858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:32.902323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282397+0000","last_change":"2024-09-15T23:12:12.297601+0000","last_active":"2024-09-15T23:12:14.282397+0000","last_peered":"2024-09-15T23:12:14.282397+0000","last_clean":"2024-09-15T23:12:14.282397+0000","last_became_active":"2024-09-15T23:12:12.297353+0000","last_became_peered":"2024-09-15T23:12:12.297353+0000","last_unstale":"2024-09-15T23:12:14.282397+0000","last_undegraded":"2024-09-15T23:12:14.282397+0000","last_fullsized":"2024-09-15T23:12:14.282397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:27.285153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142086+0000","last_change":"2024-09-15T23:12:12.301058+0000","last_active":"2024-09-15T23:12:15.142086+0000","last_peered":"2024-09-15T23:12:15.142086+0000","last_clean":"2024-09-15T23:12:15.142086+0000","last_became_active":"2024-09-15T23:12:12.300744+0000","last_became_peered":"2024-09-15T23:12:12.300744+0000","last_unstale":"2024-09-15T23:12:15.142086+0000","last_undegraded":"2024-09-15T23:12:15.142086+0000","last_fullsized":"2024-09-15T23:12:15.142086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:54.309977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277506+0000","last_change":"2024-09-15T23:12:13.302358+0000","last_active":"2024-09-15T23:12:15.277506+0000","last_peered":"2024-09-15T23:12:15.277506+0000","last_clean":"2024-09-15T23:12:15.277506+0000","last_became_active":"2024-09-15T23:12:13.301840+0000","last_became_peered":"2024-09-15T23:12:13.301840+0000","last_unstale":"2024-09-15T23:12:15.277506+0000","last_undegraded":"2024-09-15T23:12:15.277506+0000","last_fullsized":"2024-09-15T23:12:15.277506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:45:58.241079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282269+0000","last_change":"2024-09-15T23:12:12.294030+0000","last_active":"2024-09-15T23:12:14.282269+0000","last_peered":"2024-09-15T23:12:14.282269+0000","last_clean":"2024-09-15T23:12:14.282269+0000","last_became_active":"2024-09-15T23:12:12.293252+0000","last_became_peered":"2024-09-15T23:12:12.293252+0000","last_unstale":"2024-09-15T23:12:14.282269+0000","last_undegraded":"2024-09-15T23:12:14.282269+0000","last_fullsized":"2024-09-15T23:12:14.282269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:29.072753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776750+0000","last_change":"2024-09-15T23:12:13.302350+0000","last_active":"2024-09-15T23:12:14.776750+0000","last_peered":"2024-09-15T23:12:14.776750+0000","last_clean":"2024-09-15T23:12:14.776750+0000","last_became_active":"2024-09-15T23:12:13.301761+0000","last_became_peered":"2024-09-15T23:12:13.301761+0000","last_unstale":"2024-09-15T23:12:14.776750+0000","last_undegraded":"2024-09-15T23:12:14.776750+0000","last_fullsized":"2024-09-15T23:12:14.776750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:29.428355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.281250+0000","last_change":"2024-09-15T23:12:12.296404+0000","last_active":"2024-09-15T23:12:14.281250+0000","last_peered":"2024-09-15T23:12:14.281250+0000","last_clean":"2024-09-15T23:12:14.281250+0000","last_became_active":"2024-09-15T23:12:12.296128+0000","last_became_peered":"2024-09-15T23:12:12.296128+0000","last_unstale":"2024-09-15T23:12:14.281250+0000","last_undegraded":"2024-09-15T23:12:14.281250+0000","last_fullsized":"2024-09-15T23:12:14.281250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:43.458579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.278041+0000","last_change":"2024-09-15T23:12:13.298997+0000","last_active":"2024-09-15T23:12:15.278041+0000","last_peered":"2024-09-15T23:12:15.278041+0000","last_clean":"2024-09-15T23:12:15.278041+0000","last_became_active":"2024-09-15T23:12:13.298225+0000","last_became_peered":"2024-09-15T23:12:13.298225+0000","last_unstale":"2024-09-15T23:12:15.278041+0000","last_undegraded":"2024-09-15T23:12:15.278041+0000","last_fullsized":"2024-09-15T23:12:15.278041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:27:22.925825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.278252+0000","last_change":"2024-09-15T23:12:12.294378+0000","last_active":"2024-09-15T23:12:15.278252+0000","last_peered":"2024-09-15T23:12:15.278252+0000","last_clean":"2024-09-15T23:12:15.278252+0000","last_became_active":"2024-09-15T23:12:12.294028+0000","last_became_peered":"2024-09-15T23:12:12.294028+0000","last_unstale":"2024-09-15T23:12:15.278252+0000","last_undegraded":"2024-09-15T23:12:15.278252+0000","last_fullsized":"2024-09-15T23:12:15.278252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:29.072753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277559+0000","last_change":"2024-09-15T23:12:13.295768+0000","last_active":"2024-09-15T23:12:15.277559+0000","last_peered":"2024-09-15T23:12:15.277559+0000","last_clean":"2024-09-15T23:12:15.277559+0000","last_became_active":"2024-09-15T23:12:13.295379+0000","last_became_peered":"2024-09-15T23:12:13.295379+0000","last_unstale":"2024-09-15T23:12:15.277559+0000","last_undegraded":"2024-09-15T23:12:15.277559+0000","last_fullsized":"2024-09-15T23:12:15.277559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:47.011102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282465+0000","last_change":"2024-09-15T23:12:12.296690+0000","last_active":"2024-09-15T23:12:14.282465+0000","last_peered":"2024-09-15T23:12:14.282465+0000","last_clean":"2024-09-15T23:12:14.282465+0000","last_became_active":"2024-09-15T23:12:12.295787+0000","last_became_peered":"2024-09-15T23:12:12.295787+0000","last_unstale":"2024-09-15T23:12:14.282465+0000","last_undegraded":"2024-09-15T23:12:14.282465+0000","last_fullsized":"2024-09-15T23:12:14.282465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:11.043406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282394+0000","last_change":"2024-09-15T23:12:13.302380+0000","last_active":"2024-09-15T23:12:14.282394+0000","last_peered":"2024-09-15T23:12:14.282394+0000","last_clean":"2024-09-15T23:12:14.282394+0000","last_became_active":"2024-09-15T23:12:13.302131+0000","last_became_peered":"2024-09-15T23:12:13.302131+0000","last_unstale":"2024-09-15T23:12:14.282394+0000","last_undegraded":"2024-09-15T23:12:14.282394+0000","last_fullsized":"2024-09-15T23:12:14.282394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:29.884341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.278328+0000","last_change":"2024-09-15T23:12:12.298778+0000","last_active":"2024-09-15T23:12:15.278328+0000","last_peered":"2024-09-15T23:12:15.278328+0000","last_clean":"2024-09-15T23:12:15.278328+0000","last_became_active":"2024-09-15T23:12:12.298501+0000","last_became_peered":"2024-09-15T23:12:12.298501+0000","last_unstale":"2024-09-15T23:12:15.278328+0000","last_undegraded":"2024-09-15T23:12:15.278328+0000","last_fullsized":"2024-09-15T23:12:15.278328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:50:38.455575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.278015+0000","last_change":"2024-09-15T23:12:13.303512+0000","last_active":"2024-09-15T23:12:15.278015+0000","last_peered":"2024-09-15T23:12:15.278015+0000","last_clean":"2024-09-15T23:12:15.278015+0000","last_became_active":"2024-09-15T23:12:13.303210+0000","last_became_peered":"2024-09-15T23:12:13.303210+0000","last_unstale":"2024-09-15T23:12:15.278015+0000","last_undegraded":"2024-09-15T23:12:15.278015+0000","last_fullsized":"2024-09-15T23:12:15.278015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:05.614358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282483+0000","last_change":"2024-09-15T23:12:12.300595+0000","last_active":"2024-09-15T23:12:14.282483+0000","last_peered":"2024-09-15T23:12:14.282483+0000","last_clean":"2024-09-15T23:12:14.282483+0000","last_became_active":"2024-09-15T23:12:12.300327+0000","last_became_peered":"2024-09-15T23:12:12.300327+0000","last_unstale":"2024-09-15T23:12:14.282483+0000","last_undegraded":"2024-09-15T23:12:14.282483+0000","last_fullsized":"2024-09-15T23:12:14.282483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:43.458579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142286+0000","last_change":"2024-09-15T23:12:13.295028+0000","last_active":"2024-09-15T23:12:15.142286+0000","last_peered":"2024-09-15T23:12:15.142286+0000","last_clean":"2024-09-15T23:12:15.142286+0000","last_became_active":"2024-09-15T23:12:13.294725+0000","last_became_peered":"2024-09-15T23:12:13.294725+0000","last_unstale":"2024-09-15T23:12:15.142286+0000","last_undegraded":"2024-09-15T23:12:15.142286+0000","last_fullsized":"2024-09-15T23:12:15.142286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:08:51.159156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282517+0000","last_change":"2024-09-15T23:12:12.295626+0000","last_active":"2024-09-15T23:12:14.282517+0000","last_peered":"2024-09-15T23:12:14.282517+0000","last_clean":"2024-09-15T23:12:14.282517+0000","last_became_active":"2024-09-15T23:12:12.295333+0000","last_became_peered":"2024-09-15T23:12:12.295333+0000","last_unstale":"2024-09-15T23:12:14.282517+0000","last_undegraded":"2024-09-15T23:12:14.282517+0000","last_fullsized":"2024-09-15T23:12:14.282517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:27:21.918750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282376+0000","last_change":"2024-09-15T23:12:13.296636+0000","last_active":"2024-09-15T23:12:14.282376+0000","last_peered":"2024-09-15T23:12:14.282376+0000","last_clean":"2024-09-15T23:12:14.282376+0000","last_became_active":"2024-09-15T23:12:13.296172+0000","last_became_peered":"2024-09-15T23:12:13.296172+0000","last_unstale":"2024-09-15T23:12:14.282376+0000","last_undegraded":"2024-09-15T23:12:14.282376+0000","last_fullsized":"2024-09-15T23:12:14.282376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:16.832075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277437+0000","last_change":"2024-09-15T23:12:12.296543+0000","last_active":"2024-09-15T23:12:15.277437+0000","last_peered":"2024-09-15T23:12:15.277437+0000","last_clean":"2024-09-15T23:12:15.277437+0000","last_became_active":"2024-09-15T23:12:12.296293+0000","last_became_peered":"2024-09-15T23:12:12.296293+0000","last_unstale":"2024-09-15T23:12:15.277437+0000","last_undegraded":"2024-09-15T23:12:15.277437+0000","last_fullsized":"2024-09-15T23:12:15.277437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:07:54.128353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.280809+0000","last_change":"2024-09-15T23:12:13.297331+0000","last_active":"2024-09-15T23:12:14.280809+0000","last_peered":"2024-09-15T23:12:14.280809+0000","last_clean":"2024-09-15T23:12:14.280809+0000","last_became_active":"2024-09-15T23:12:13.297036+0000","last_became_peered":"2024-09-15T23:12:13.297036+0000","last_unstale":"2024-09-15T23:12:14.280809+0000","last_undegraded":"2024-09-15T23:12:14.280809+0000","last_fullsized":"2024-09-15T23:12:14.280809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:18.794107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776416+0000","last_change":"2024-09-15T23:12:12.297599+0000","last_active":"2024-09-15T23:12:14.776416+0000","last_peered":"2024-09-15T23:12:14.776416+0000","last_clean":"2024-09-15T23:12:14.776416+0000","last_became_active":"2024-09-15T23:12:12.297309+0000","last_became_peered":"2024-09-15T23:12:12.297309+0000","last_unstale":"2024-09-15T23:12:14.776416+0000","last_undegraded":"2024-09-15T23:12:14.776416+0000","last_fullsized":"2024-09-15T23:12:14.776416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:28.555228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282174+0000","last_change":"2024-09-15T23:12:13.301636+0000","last_active":"2024-09-15T23:12:14.282174+0000","last_peered":"2024-09-15T23:12:14.282174+0000","last_clean":"2024-09-15T23:12:14.282174+0000","last_became_active":"2024-09-15T23:12:13.301390+0000","last_became_peered":"2024-09-15T23:12:13.301390+0000","last_unstale":"2024-09-15T23:12:14.282174+0000","last_undegraded":"2024-09-15T23:12:14.282174+0000","last_fullsized":"2024-09-15T23:12:14.282174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:09:30.105488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.278395+0000","last_change":"2024-09-15T23:12:12.294164+0000","last_active":"2024-09-15T23:12:15.278395+0000","last_peered":"2024-09-15T23:12:15.278395+0000","last_clean":"2024-09-15T23:12:15.278395+0000","last_became_active":"2024-09-15T23:12:12.293619+0000","last_became_peered":"2024-09-15T23:12:12.293619+0000","last_unstale":"2024-09-15T23:12:15.278395+0000","last_undegraded":"2024-09-15T23:12:15.278395+0000","last_fullsized":"2024-09-15T23:12:15.278395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:46.714431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.278200+0000","last_change":"2024-09-15T23:12:13.298781+0000","last_active":"2024-09-15T23:12:15.278200+0000","last_peered":"2024-09-15T23:12:15.278200+0000","last_clean":"2024-09-15T23:12:15.278200+0000","last_became_active":"2024-09-15T23:12:13.297968+0000","last_became_peered":"2024-09-15T23:12:13.297968+0000","last_unstale":"2024-09-15T23:12:15.278200+0000","last_undegraded":"2024-09-15T23:12:15.278200+0000","last_fullsized":"2024-09-15T23:12:15.278200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:26:22.310337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776841+0000","last_change":"2024-09-15T23:12:12.299042+0000","last_active":"2024-09-15T23:12:14.776841+0000","last_peered":"2024-09-15T23:12:14.776841+0000","last_clean":"2024-09-15T23:12:14.776841+0000","last_became_active":"2024-09-15T23:12:12.298781+0000","last_became_peered":"2024-09-15T23:12:12.298781+0000","last_unstale":"2024-09-15T23:12:14.776841+0000","last_undegraded":"2024-09-15T23:12:14.776841+0000","last_fullsized":"2024-09-15T23:12:14.776841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:12.407756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.278420+0000","last_change":"2024-09-15T23:12:13.296707+0000","last_active":"2024-09-15T23:12:15.278420+0000","last_peered":"2024-09-15T23:12:15.278420+0000","last_clean":"2024-09-15T23:12:15.278420+0000","last_became_active":"2024-09-15T23:12:13.296450+0000","last_became_peered":"2024-09-15T23:12:13.296450+0000","last_unstale":"2024-09-15T23:12:15.278420+0000","last_undegraded":"2024-09-15T23:12:15.278420+0000","last_fullsized":"2024-09-15T23:12:15.278420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:51:37.808404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277145+0000","last_change":"2024-09-15T23:12:12.296505+0000","last_active":"2024-09-15T23:12:15.277145+0000","last_peered":"2024-09-15T23:12:15.277145+0000","last_clean":"2024-09-15T23:12:15.277145+0000","last_became_active":"2024-09-15T23:12:12.296249+0000","last_became_peered":"2024-09-15T23:12:12.296249+0000","last_unstale":"2024-09-15T23:12:15.277145+0000","last_undegraded":"2024-09-15T23:12:15.277145+0000","last_fullsized":"2024-09-15T23:12:15.277145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:22.552069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277847+0000","last_change":"2024-09-15T23:12:13.306601+0000","last_active":"2024-09-15T23:12:15.277847+0000","last_peered":"2024-09-15T23:12:15.277847+0000","last_clean":"2024-09-15T23:12:15.277847+0000","last_became_active":"2024-09-15T23:12:13.306342+0000","last_became_peered":"2024-09-15T23:12:13.306342+0000","last_unstale":"2024-09-15T23:12:15.277847+0000","last_undegraded":"2024-09-15T23:12:15.277847+0000","last_fullsized":"2024-09-15T23:12:15.277847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:29.584475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142541+0000","last_change":"2024-09-15T23:12:12.305855+0000","last_active":"2024-09-15T23:12:15.142541+0000","last_peered":"2024-09-15T23:12:15.142541+0000","last_clean":"2024-09-15T23:12:15.142541+0000","last_became_active":"2024-09-15T23:12:12.305533+0000","last_became_peered":"2024-09-15T23:12:12.305533+0000","last_unstale":"2024-09-15T23:12:15.142541+0000","last_undegraded":"2024-09-15T23:12:15.142541+0000","last_fullsized":"2024-09-15T23:12:15.142541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:11.043406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282621+0000","last_change":"2024-09-15T23:12:13.292019+0000","last_active":"2024-09-15T23:12:14.282621+0000","last_peered":"2024-09-15T23:12:14.282621+0000","last_clean":"2024-09-15T23:12:14.282621+0000","last_became_active":"2024-09-15T23:12:13.290585+0000","last_became_peered":"2024-09-15T23:12:13.290585+0000","last_unstale":"2024-09-15T23:12:14.282621+0000","last_undegraded":"2024-09-15T23:12:14.282621+0000","last_fullsized":"2024-09-15T23:12:14.282621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:49:31.867792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.280816+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:12:14.280816+0000","last_peered":"2024-09-15T23:12:14.280816+0000","last_clean":"2024-09-15T23:12:14.280816+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:12:14.280816+0000","last_undegraded":"2024-09-15T23:12:14.280816+0000","last_fullsized":"2024-09-15T23:12:14.280816+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282421+0000","last_change":"2024-09-15T23:12:12.295819+0000","last_active":"2024-09-15T23:12:14.282421+0000","last_peered":"2024-09-15T23:12:14.282421+0000","last_clean":"2024-09-15T23:12:14.282421+0000","last_became_active":"2024-09-15T23:12:12.295320+0000","last_became_peered":"2024-09-15T23:12:12.295320+0000","last_unstale":"2024-09-15T23:12:14.282421+0000","last_undegraded":"2024-09-15T23:12:14.282421+0000","last_fullsized":"2024-09-15T23:12:14.282421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:13.348463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776701+0000","last_change":"2024-09-15T23:12:13.292512+0000","last_active":"2024-09-15T23:12:14.776701+0000","last_peered":"2024-09-15T23:12:14.776701+0000","last_clean":"2024-09-15T23:12:14.776701+0000","last_became_active":"2024-09-15T23:12:13.292230+0000","last_became_peered":"2024-09-15T23:12:13.292230+0000","last_unstale":"2024-09-15T23:12:14.776701+0000","last_undegraded":"2024-09-15T23:12:14.776701+0000","last_fullsized":"2024-09-15T23:12:14.776701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:51.115293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282228+0000","last_change":"2024-09-15T23:12:12.293545+0000","last_active":"2024-09-15T23:12:14.282228+0000","last_peered":"2024-09-15T23:12:14.282228+0000","last_clean":"2024-09-15T23:12:14.282228+0000","last_became_active":"2024-09-15T23:12:12.292903+0000","last_became_peered":"2024-09-15T23:12:12.292903+0000","last_unstale":"2024-09-15T23:12:14.282228+0000","last_undegraded":"2024-09-15T23:12:14.282228+0000","last_fullsized":"2024-09-15T23:12:14.282228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:46.714431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142240+0000","last_change":"2024-09-15T23:12:13.298677+0000","last_active":"2024-09-15T23:12:15.142240+0000","last_peered":"2024-09-15T23:12:15.142240+0000","last_clean":"2024-09-15T23:12:15.142240+0000","last_became_active":"2024-09-15T23:12:13.298386+0000","last_became_peered":"2024-09-15T23:12:13.298386+0000","last_unstale":"2024-09-15T23:12:15.142240+0000","last_undegraded":"2024-09-15T23:12:15.142240+0000","last_fullsized":"2024-09-15T23:12:15.142240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:10:04.877140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282158+0000","last_change":"2024-09-15T23:12:12.296394+0000","last_active":"2024-09-15T23:12:14.282158+0000","last_peered":"2024-09-15T23:12:14.282158+0000","last_clean":"2024-09-15T23:12:14.282158+0000","last_became_active":"2024-09-15T23:12:12.296110+0000","last_became_peered":"2024-09-15T23:12:12.296110+0000","last_unstale":"2024-09-15T23:12:14.282158+0000","last_undegraded":"2024-09-15T23:12:14.282158+0000","last_fullsized":"2024-09-15T23:12:14.282158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:54.309977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277322+0000","last_change":"2024-09-15T23:12:13.294854+0000","last_active":"2024-09-15T23:12:15.277322+0000","last_peered":"2024-09-15T23:12:15.277322+0000","last_clean":"2024-09-15T23:12:15.277322+0000","last_became_active":"2024-09-15T23:12:13.294539+0000","last_became_peered":"2024-09-15T23:12:13.294539+0000","last_unstale":"2024-09-15T23:12:15.277322+0000","last_undegraded":"2024-09-15T23:12:15.277322+0000","last_fullsized":"2024-09-15T23:12:15.277322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:43:07.769498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282544+0000","last_change":"2024-09-15T23:12:12.300290+0000","last_active":"2024-09-15T23:12:14.282544+0000","last_peered":"2024-09-15T23:12:14.282544+0000","last_clean":"2024-09-15T23:12:14.282544+0000","last_became_active":"2024-09-15T23:12:12.300024+0000","last_became_peered":"2024-09-15T23:12:12.300024+0000","last_unstale":"2024-09-15T23:12:14.282544+0000","last_undegraded":"2024-09-15T23:12:14.282544+0000","last_fullsized":"2024-09-15T23:12:14.282544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:10:03.870065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277903+0000","last_change":"2024-09-15T23:12:13.300590+0000","last_active":"2024-09-15T23:12:15.277903+0000","last_peered":"2024-09-15T23:12:15.277903+0000","last_clean":"2024-09-15T23:12:15.277903+0000","last_became_active":"2024-09-15T23:12:13.300376+0000","last_became_peered":"2024-09-15T23:12:13.300376+0000","last_unstale":"2024-09-15T23:12:15.277903+0000","last_undegraded":"2024-09-15T23:12:15.277903+0000","last_fullsized":"2024-09-15T23:12:15.277903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:02.914486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277032+0000","last_change":"2024-09-15T23:12:12.297859+0000","last_active":"2024-09-15T23:12:15.277032+0000","last_peered":"2024-09-15T23:12:15.277032+0000","last_clean":"2024-09-15T23:12:15.277032+0000","last_became_active":"2024-09-15T23:12:12.297520+0000","last_became_peered":"2024-09-15T23:12:12.297520+0000","last_unstale":"2024-09-15T23:12:15.277032+0000","last_undegraded":"2024-09-15T23:12:15.277032+0000","last_fullsized":"2024-09-15T23:12:15.277032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:12.407756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.278068+0000","last_change":"2024-09-15T23:12:13.300154+0000","last_active":"2024-09-15T23:12:15.278068+0000","last_peered":"2024-09-15T23:12:15.278068+0000","last_clean":"2024-09-15T23:12:15.278068+0000","last_became_active":"2024-09-15T23:12:13.299919+0000","last_became_peered":"2024-09-15T23:12:13.299919+0000","last_unstale":"2024-09-15T23:12:15.278068+0000","last_undegraded":"2024-09-15T23:12:15.278068+0000","last_fullsized":"2024-09-15T23:12:15.278068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:10:04.877140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282692+0000","last_change":"2024-09-15T23:12:12.296791+0000","last_active":"2024-09-15T23:12:14.282692+0000","last_peered":"2024-09-15T23:12:14.282692+0000","last_clean":"2024-09-15T23:12:14.282692+0000","last_became_active":"2024-09-15T23:12:12.296507+0000","last_became_peered":"2024-09-15T23:12:12.296507+0000","last_unstale":"2024-09-15T23:12:14.282692+0000","last_undegraded":"2024-09-15T23:12:14.282692+0000","last_fullsized":"2024-09-15T23:12:14.282692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:08:50.152082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142523+0000","last_change":"2024-09-15T23:12:13.296540+0000","last_active":"2024-09-15T23:12:15.142523+0000","last_peered":"2024-09-15T23:12:15.142523+0000","last_clean":"2024-09-15T23:12:15.142523+0000","last_became_active":"2024-09-15T23:12:13.295765+0000","last_became_peered":"2024-09-15T23:12:13.295765+0000","last_unstale":"2024-09-15T23:12:15.142523+0000","last_undegraded":"2024-09-15T23:12:15.142523+0000","last_fullsized":"2024-09-15T23:12:15.142523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:03.932670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776948+0000","last_change":"2024-09-15T23:12:12.300784+0000","last_active":"2024-09-15T23:12:14.776948+0000","last_peered":"2024-09-15T23:12:14.776948+0000","last_clean":"2024-09-15T23:12:14.776948+0000","last_became_active":"2024-09-15T23:12:12.300267+0000","last_became_peered":"2024-09-15T23:12:12.300267+0000","last_unstale":"2024-09-15T23:12:14.776948+0000","last_undegraded":"2024-09-15T23:12:14.776948+0000","last_fullsized":"2024-09-15T23:12:14.776948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:01:57.256014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776957+0000","last_change":"2024-09-15T23:12:13.304126+0000","last_active":"2024-09-15T23:12:14.776957+0000","last_peered":"2024-09-15T23:12:14.776957+0000","last_clean":"2024-09-15T23:12:14.776957+0000","last_became_active":"2024-09-15T23:12:13.303461+0000","last_became_peered":"2024-09-15T23:12:13.303461+0000","last_unstale":"2024-09-15T23:12:14.776957+0000","last_undegraded":"2024-09-15T23:12:14.776957+0000","last_fullsized":"2024-09-15T23:12:14.776957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:43:07.769498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282577+0000","last_change":"2024-09-15T23:12:12.297628+0000","last_active":"2024-09-15T23:12:14.282577+0000","last_peered":"2024-09-15T23:12:14.282577+0000","last_clean":"2024-09-15T23:12:14.282577+0000","last_became_active":"2024-09-15T23:12:12.297392+0000","last_became_peered":"2024-09-15T23:12:12.297392+0000","last_unstale":"2024-09-15T23:12:14.282577+0000","last_undegraded":"2024-09-15T23:12:14.282577+0000","last_fullsized":"2024-09-15T23:12:14.282577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:26:21.303262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776864+0000","last_change":"2024-09-15T23:12:13.305087+0000","last_active":"2024-09-15T23:12:14.776864+0000","last_peered":"2024-09-15T23:12:14.776864+0000","last_clean":"2024-09-15T23:12:14.776864+0000","last_became_active":"2024-09-15T23:12:13.304851+0000","last_became_peered":"2024-09-15T23:12:13.304851+0000","last_unstale":"2024-09-15T23:12:14.776864+0000","last_undegraded":"2024-09-15T23:12:14.776864+0000","last_fullsized":"2024-09-15T23:12:14.776864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:53.919348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277272+0000","last_change":"2024-09-15T23:12:12.292922+0000","last_active":"2024-09-15T23:12:15.277272+0000","last_peered":"2024-09-15T23:12:15.277272+0000","last_clean":"2024-09-15T23:12:15.277272+0000","last_became_active":"2024-09-15T23:12:12.292606+0000","last_became_peered":"2024-09-15T23:12:12.292606+0000","last_unstale":"2024-09-15T23:12:15.277272+0000","last_undegraded":"2024-09-15T23:12:15.277272+0000","last_fullsized":"2024-09-15T23:12:15.277272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:25.929262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282187+0000","last_change":"2024-09-15T23:12:13.300968+0000","last_active":"2024-09-15T23:12:14.282187+0000","last_peered":"2024-09-15T23:12:14.282187+0000","last_clean":"2024-09-15T23:12:14.282187+0000","last_became_active":"2024-09-15T23:12:13.300679+0000","last_became_peered":"2024-09-15T23:12:13.300679+0000","last_unstale":"2024-09-15T23:12:14.282187+0000","last_undegraded":"2024-09-15T23:12:14.282187+0000","last_fullsized":"2024-09-15T23:12:14.282187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:51:37.808404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776598+0000","last_change":"2024-09-15T23:12:12.300647+0000","last_active":"2024-09-15T23:12:14.776598+0000","last_peered":"2024-09-15T23:12:14.776598+0000","last_clean":"2024-09-15T23:12:14.776598+0000","last_became_active":"2024-09-15T23:12:12.300181+0000","last_became_peered":"2024-09-15T23:12:12.300181+0000","last_unstale":"2024-09-15T23:12:14.776598+0000","last_undegraded":"2024-09-15T23:12:14.776598+0000","last_fullsized":"2024-09-15T23:12:14.776598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:22.552069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776822+0000","last_change":"2024-09-15T23:12:13.300864+0000","last_active":"2024-09-15T23:12:14.776822+0000","last_peered":"2024-09-15T23:12:14.776822+0000","last_clean":"2024-09-15T23:12:14.776822+0000","last_became_active":"2024-09-15T23:12:13.300258+0000","last_became_peered":"2024-09-15T23:12:13.300258+0000","last_unstale":"2024-09-15T23:12:14.776822+0000","last_undegraded":"2024-09-15T23:12:14.776822+0000","last_fullsized":"2024-09-15T23:12:14.776822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:40.921752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142436+0000","last_change":"2024-09-15T23:12:12.304706+0000","last_active":"2024-09-15T23:12:15.142436+0000","last_peered":"2024-09-15T23:12:15.142436+0000","last_clean":"2024-09-15T23:12:15.142436+0000","last_became_active":"2024-09-15T23:12:12.304384+0000","last_became_peered":"2024-09-15T23:12:12.304384+0000","last_unstale":"2024-09-15T23:12:15.142436+0000","last_undegraded":"2024-09-15T23:12:15.142436+0000","last_fullsized":"2024-09-15T23:12:15.142436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:43.458579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282456+0000","last_change":"2024-09-15T23:12:13.305512+0000","last_active":"2024-09-15T23:12:14.282456+0000","last_peered":"2024-09-15T23:12:14.282456+0000","last_clean":"2024-09-15T23:12:14.282456+0000","last_became_active":"2024-09-15T23:12:13.305192+0000","last_became_peered":"2024-09-15T23:12:13.305192+0000","last_unstale":"2024-09-15T23:12:14.282456+0000","last_undegraded":"2024-09-15T23:12:14.282456+0000","last_fullsized":"2024-09-15T23:12:14.282456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:47.721506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282310+0000","last_change":"2024-09-15T23:12:12.295599+0000","last_active":"2024-09-15T23:12:14.282310+0000","last_peered":"2024-09-15T23:12:14.282310+0000","last_clean":"2024-09-15T23:12:14.282310+0000","last_became_active":"2024-09-15T23:12:12.295036+0000","last_became_peered":"2024-09-15T23:12:12.295036+0000","last_unstale":"2024-09-15T23:12:14.282310+0000","last_undegraded":"2024-09-15T23:12:14.282310+0000","last_fullsized":"2024-09-15T23:12:14.282310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:03.815413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282296+0000","last_change":"2024-09-15T23:12:13.292087+0000","last_active":"2024-09-15T23:12:14.282296+0000","last_peered":"2024-09-15T23:12:14.282296+0000","last_clean":"2024-09-15T23:12:14.282296+0000","last_became_active":"2024-09-15T23:12:13.291588+0000","last_became_peered":"2024-09-15T23:12:13.291588+0000","last_unstale":"2024-09-15T23:12:14.282296+0000","last_undegraded":"2024-09-15T23:12:14.282296+0000","last_fullsized":"2024-09-15T23:12:14.282296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:19:59.394904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282457+0000","last_change":"2024-09-15T23:12:13.295583+0000","last_active":"2024-09-15T23:12:14.282457+0000","last_peered":"2024-09-15T23:12:14.282457+0000","last_clean":"2024-09-15T23:12:14.282457+0000","last_became_active":"2024-09-15T23:12:13.295285+0000","last_became_peered":"2024-09-15T23:12:13.295285+0000","last_unstale":"2024-09-15T23:12:14.282457+0000","last_undegraded":"2024-09-15T23:12:14.282457+0000","last_fullsized":"2024-09-15T23:12:14.282457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:12.748141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277815+0000","last_change":"2024-09-15T23:12:12.293704+0000","last_active":"2024-09-15T23:12:15.277815+0000","last_peered":"2024-09-15T23:12:15.277815+0000","last_clean":"2024-09-15T23:12:15.277815+0000","last_became_active":"2024-09-15T23:12:12.292898+0000","last_became_peered":"2024-09-15T23:12:12.292898+0000","last_unstale":"2024-09-15T23:12:15.277815+0000","last_undegraded":"2024-09-15T23:12:15.277815+0000","last_fullsized":"2024-09-15T23:12:15.277815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:27.285153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.281075+0000","last_change":"2024-09-15T23:12:13.295743+0000","last_active":"2024-09-15T23:12:14.281075+0000","last_peered":"2024-09-15T23:12:14.281075+0000","last_clean":"2024-09-15T23:12:14.281075+0000","last_became_active":"2024-09-15T23:12:13.295104+0000","last_became_peered":"2024-09-15T23:12:13.295104+0000","last_unstale":"2024-09-15T23:12:14.281075+0000","last_undegraded":"2024-09-15T23:12:14.281075+0000","last_fullsized":"2024-09-15T23:12:14.281075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:28.292228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.278033+0000","last_change":"2024-09-15T23:12:12.293296+0000","last_active":"2024-09-15T23:12:15.278033+0000","last_peered":"2024-09-15T23:12:15.278033+0000","last_clean":"2024-09-15T23:12:15.278033+0000","last_became_active":"2024-09-15T23:12:12.292920+0000","last_became_peered":"2024-09-15T23:12:12.292920+0000","last_unstale":"2024-09-15T23:12:15.278033+0000","last_undegraded":"2024-09-15T23:12:15.278033+0000","last_fullsized":"2024-09-15T23:12:15.278033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:17.787033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277421+0000","last_change":"2024-09-15T23:12:13.297368+0000","last_active":"2024-09-15T23:12:15.277421+0000","last_peered":"2024-09-15T23:12:15.277421+0000","last_clean":"2024-09-15T23:12:15.277421+0000","last_became_active":"2024-09-15T23:12:13.296735+0000","last_became_peered":"2024-09-15T23:12:13.296735+0000","last_unstale":"2024-09-15T23:12:15.277421+0000","last_undegraded":"2024-09-15T23:12:15.277421+0000","last_fullsized":"2024-09-15T23:12:15.277421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:11.250902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277466+0000","last_change":"2024-09-15T23:12:12.295645+0000","last_active":"2024-09-15T23:12:15.277466+0000","last_peered":"2024-09-15T23:12:15.277466+0000","last_clean":"2024-09-15T23:12:15.277466+0000","last_became_active":"2024-09-15T23:12:12.295359+0000","last_became_peered":"2024-09-15T23:12:12.295359+0000","last_unstale":"2024-09-15T23:12:15.277466+0000","last_undegraded":"2024-09-15T23:12:15.277466+0000","last_fullsized":"2024-09-15T23:12:15.277466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:01:57.256014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277490+0000","last_change":"2024-09-15T23:12:13.302910+0000","last_active":"2024-09-15T23:12:15.277490+0000","last_peered":"2024-09-15T23:12:15.277490+0000","last_clean":"2024-09-15T23:12:15.277490+0000","last_became_active":"2024-09-15T23:12:13.302457+0000","last_became_peered":"2024-09-15T23:12:13.302457+0000","last_unstale":"2024-09-15T23:12:15.277490+0000","last_undegraded":"2024-09-15T23:12:15.277490+0000","last_fullsized":"2024-09-15T23:12:15.277490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:17:08.108114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776995+0000","last_change":"2024-09-15T23:12:12.295905+0000","last_active":"2024-09-15T23:12:14.776995+0000","last_peered":"2024-09-15T23:12:14.776995+0000","last_clean":"2024-09-15T23:12:14.776995+0000","last_became_active":"2024-09-15T23:12:12.295619+0000","last_became_peered":"2024-09-15T23:12:12.295619+0000","last_unstale":"2024-09-15T23:12:14.776995+0000","last_undegraded":"2024-09-15T23:12:14.776995+0000","last_fullsized":"2024-09-15T23:12:14.776995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:11.550515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476744,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":77046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476741,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":229376,"data_stored":78076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476743,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":666902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476743,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":76464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":819200,"data_stored":666924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":78748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:12:20.910 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T23:12:20.910 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-15T23:12:20.910 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-15T23:12:20.910 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-15T23:12:20.911 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-15T23:12:21.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.038+0000 7f6c1ad6f640 1 Processor -- start 2024-09-15T23:12:21.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.038+0000 7f6c1ad6f640 1 -- start start 2024-09-15T23:12:21.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.039+0000 7f6c1ad6f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6c140cef60 0x7f6c1415eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:21.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.039+0000 7f6c1ad6f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6c140b3790 0x7f6c141624e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:21.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.039+0000 7f6c1ad6f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c1415f060 con 0x7f6c1406bc10 2024-09-15T23:12:21.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.039+0000 7f6c1ad6f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f6c140cd690 con 0x7f6c140cef60 2024-09-15T23:12:21.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.039+0000 7f6c1ad6f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6c140d06f0 con 0x7f6c140b3790 2024-09-15T23:12:21.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.039+0000 7f6c0bfff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6c140cef60 0x7f6c1415eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:21.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.039+0000 7f6c0bfff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6c140cef60 0x7f6c1415eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36132/0 (socket says 172.21.15.123:36132) 2024-09-15T23:12:21.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.039+0000 7f6c0bfff640 1 -- 172.21.15.123:0/3869942663 learned_addr learned my addr 172.21.15.123:0/3869942663 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:21.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.039+0000 7f6c0bfff640 1 -- 172.21.15.123:0/3869942663 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6c140b3790 msgr2=0x7f6c141624e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:21.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.039+0000 7f6c0bfff640 1 --2- 172.21.15.123:0/3869942663 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6c140b3790 0x7f6c141624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.039+0000 7f6c0bfff640 1 -- 172.21.15.123:0/3869942663 >> v1:172.21.15.188:6789/0 conn(0x7f6c1406bc10 legacy=0x7f6c1406bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:21.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.039+0000 7f6c0bfff640 1 -- 172.21.15.123:0/3869942663 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c140b4090 con 0x7f6c140cef60 2024-09-15T23:12:21.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.040+0000 7f6c0bfff640 1 --2- 172.21.15.123:0/3869942663 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6c140cef60 0x7f6c1415eb20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6c040098a0 tx=0x7f6c0402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea37aee23299f5b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:21.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.040+0000 7f6c0b7fe640 1 -- 172.21.15.123:0/3869942663 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c04037070 con 0x7f6c140cef60 2024-09-15T23:12:21.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.040+0000 7f6c0b7fe640 1 -- 172.21.15.123:0/3869942663 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c04032440 con 0x7f6c140cef60 2024-09-15T23:12:21.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.040+0000 7f6c0b7fe640 1 -- 172.21.15.123:0/3869942663 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c04032810 con 0x7f6c140cef60 2024-09-15T23:12:21.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.041+0000 7f6c1ad6f640 1 -- 172.21.15.123:0/3869942663 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6c140cef60 msgr2=0x7f6c1415eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:21.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.041+0000 7f6c1ad6f640 1 --2- 172.21.15.123:0/3869942663 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6c140cef60 0x7f6c1415eb20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6c040098a0 tx=0x7f6c0402a250 comp rx=0 tx=0).stop 2024-09-15T23:12:21.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.041+0000 7f6c1ad6f640 1 -- 172.21.15.123:0/3869942663 shutdown_connections 2024-09-15T23:12:21.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.041+0000 7f6c1ad6f640 1 --2- 172.21.15.123:0/3869942663 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6c140cef60 0x7f6c1415eb20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.041+0000 7f6c1ad6f640 1 --2- 172.21.15.123:0/3869942663 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6c140b3790 0x7f6c141624e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.041+0000 7f6c1ad6f640 1 -- 172.21.15.123:0/3869942663 >> 172.21.15.123:0/3869942663 conn(0x7f6c1406cd20 msgr2=0x7f6c1406d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:21.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.041+0000 7f6c1ad6f640 1 -- 172.21.15.123:0/3869942663 shutdown_connections 2024-09-15T23:12:21.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.041+0000 7f6c1ad6f640 1 -- 172.21.15.123:0/3869942663 wait complete. 2024-09-15T23:12:21.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.042+0000 7f6c1ad6f640 1 Processor -- start 2024-09-15T23:12:21.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.042+0000 7f6c1ad6f640 1 -- start start 2024-09-15T23:12:21.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.043+0000 7f6c1ad6f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6c1406bc10 0x7f6c14149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:21.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.043+0000 7f6c1ad6f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6c140b3790 0x7f6c1415bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:21.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.043+0000 7f6c1ad6f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6c140cef60 0x7f6c14156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:21.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.043+0000 7f6c1ad6f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6c140d0f10 con 0x7f6c140cef60 2024-09-15T23:12:21.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.043+0000 7f6c1ad6f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6c140d0c30 con 0x7f6c140b3790 2024-09-15T23:12:21.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.043+0000 7f6c1ad6f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6c140b3c20 con 0x7f6c1406bc10 2024-09-15T23:12:21.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.043+0000 7f6c1930c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6c140cef60 0x7f6c14156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:21.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.043+0000 7f6c1930c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6c140cef60 0x7f6c14156ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36140/0 (socket says 172.21.15.123:36140) 2024-09-15T23:12:21.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.043+0000 7f6c1930c640 1 -- 172.21.15.123:0/2679770725 learned_addr learned my addr 172.21.15.123:0/2679770725 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:21.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.043+0000 7f6c0bfff640 1 --2- 172.21.15.123:0/2679770725 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6c140b3790 0x7f6c1415bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:21.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.043+0000 7f6c18b0b640 1 --2- 172.21.15.123:0/2679770725 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6c1406bc10 0x7f6c14149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:21.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.043+0000 7f6c1930c640 1 -- 172.21.15.123:0/2679770725 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6c1406bc10 msgr2=0x7f6c14149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:21.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.043+0000 7f6c1930c640 1 --2- 172.21.15.123:0/2679770725 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6c1406bc10 0x7f6c14149040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.043+0000 7f6c1930c640 1 -- 172.21.15.123:0/2679770725 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6c140b3790 msgr2=0x7f6c1415bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:21.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.043+0000 7f6c1930c640 1 --2- 172.21.15.123:0/2679770725 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6c140b3790 0x7f6c1415bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.043+0000 7f6c1930c640 1 -- 172.21.15.123:0/2679770725 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c14149580 con 0x7f6c140cef60 2024-09-15T23:12:21.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.043+0000 7f6c1930c640 1 --2- 172.21.15.123:0/2679770725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6c140cef60 0x7f6c14156ae0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c00b970 tx=0x7f6c0c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:21.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.044+0000 7f6c097fa640 1 -- 172.21.15.123:0/2679770725 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c019070 con 0x7f6c140cef60 2024-09-15T23:12:21.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.044+0000 7f6c097fa640 1 -- 172.21.15.123:0/2679770725 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c0c00cb60 con 0x7f6c140cef60 2024-09-15T23:12:21.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.044+0000 7f6c1ad6f640 1 -- 172.21.15.123:0/2679770725 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c1415ac10 con 0x7f6c140cef60 2024-09-15T23:12:21.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.044+0000 7f6c097fa640 1 -- 172.21.15.123:0/2679770725 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c014440 con 0x7f6c140cef60 2024-09-15T23:12:21.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.044+0000 7f6c1ad6f640 1 -- 172.21.15.123:0/2679770725 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c1415b1d0 con 0x7f6c140cef60 2024-09-15T23:12:21.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.045+0000 7f6c1ad6f640 1 -- 172.21.15.123:0/2679770725 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c1415eb20 con 0x7f6c140cef60 2024-09-15T23:12:21.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.045+0000 7f6c097fa640 1 -- 172.21.15.123:0/2679770725 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6c0c01c070 con 0x7f6c140cef60 2024-09-15T23:12:21.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.046+0000 7f6c097fa640 1 --2- 172.21.15.123:0/2679770725 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6c0006c2b0 0x7f6c0006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:21.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.046+0000 7f6c097fa640 1 -- 172.21.15.123:0/2679770725 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f6c0c08b050 con 0x7f6c140cef60 2024-09-15T23:12:21.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.046+0000 7f6c18b0b640 1 --2- 172.21.15.123:0/2679770725 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6c0006c2b0 0x7f6c0006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:21.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.046+0000 7f6c18b0b640 1 --2- 172.21.15.123:0/2679770725 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6c0006c2b0 0x7f6c0006e770 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6c10006fd0 tx=0x7f6c10009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:21.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.050+0000 7f6c097fa640 1 -- 172.21.15.123:0/2679770725 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6c14149580 con 0x7f6c140cef60 2024-09-15T23:12:21.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.260+0000 7f6c1ad6f640 1 -- 172.21.15.123:0/2679770725 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f6c14072f20 con 0x7f6c140cef60 2024-09-15T23:12:21.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.263+0000 7f6c097fa640 1 -- 172.21.15.123:0/2679770725 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+173511 (secure 0 0 0) 0x7f6c0c059200 con 0x7f6c140cef60 2024-09-15T23:12:21.266 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:21.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.265+0000 7f6c1ad6f640 1 -- 172.21.15.123:0/2679770725 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6c0006c2b0 msgr2=0x7f6c0006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:21.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.265+0000 7f6c1ad6f640 1 --2- 172.21.15.123:0/2679770725 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6c0006c2b0 0x7f6c0006e770 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6c10006fd0 tx=0x7f6c10009060 comp rx=0 tx=0).stop 2024-09-15T23:12:21.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.265+0000 7f6c1ad6f640 1 -- 172.21.15.123:0/2679770725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6c140cef60 msgr2=0x7f6c14156ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:21.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.265+0000 7f6c1ad6f640 1 --2- 172.21.15.123:0/2679770725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6c140cef60 0x7f6c14156ae0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c00b970 tx=0x7f6c0c00be30 comp rx=0 tx=0).stop 2024-09-15T23:12:21.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.265+0000 7f6c1ad6f640 1 -- 172.21.15.123:0/2679770725 shutdown_connections 2024-09-15T23:12:21.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.265+0000 7f6c1ad6f640 1 --2- 172.21.15.123:0/2679770725 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6c0006c2b0 0x7f6c0006e770 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.265+0000 7f6c1ad6f640 1 --2- 172.21.15.123:0/2679770725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6c140cef60 0x7f6c14156ae0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.265+0000 7f6c1ad6f640 1 --2- 172.21.15.123:0/2679770725 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6c140b3790 0x7f6c1415bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.265+0000 7f6c1ad6f640 1 --2- 172.21.15.123:0/2679770725 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6c1406bc10 0x7f6c14149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.265+0000 7f6c1ad6f640 1 -- 172.21.15.123:0/2679770725 >> 172.21.15.123:0/2679770725 conn(0x7f6c1406cd20 msgr2=0x7f6c14160840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:21.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.265+0000 7f6c1ad6f640 1 -- 172.21.15.123:0/2679770725 shutdown_connections 2024-09-15T23:12:21.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.265+0000 7f6c1ad6f640 1 -- 172.21.15.123:0/2679770725 wait complete. 2024-09-15T23:12:21.277 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6824","nonce":2945144488},{"type":"v1","addr":"172.21.15.188:6825","nonce":2945144488}]},"active_addr":"172.21.15.188:6825/2945144488","active_change":"2024-09-15T23:11:53.491305+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.188:0","nonce":1402965923}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.188:0","nonce":2264011894}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.188:0","nonce":3467422522}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.188:0","nonce":414143418}]}]} 2024-09-15T23:12:21.281 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-15T23:12:21.281 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-15T23:12:21.281 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:12:21.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.380+0000 7fb0e63b7640 1 Processor -- start 2024-09-15T23:12:21.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.380+0000 7fb0e63b7640 1 -- start start 2024-09-15T23:12:21.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.381+0000 7fb0e63b7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0e00cf6b0 0x7fb0e00cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:21.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.381+0000 7fb0e63b7640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0e006d080 con 0x7fb0e00cc1c0 2024-09-15T23:12:21.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.381+0000 7fb0e63b7640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0e006d360 con 0x7fb0e015e960 2024-09-15T23:12:21.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.381+0000 7fb0e63b7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb0e006d640 con 0x7fb0e00cf6b0 2024-09-15T23:12:21.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.381+0000 7fb0df7fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb0e00cc1c0 0x7fb0e00cefa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39036/0 (socket says 172.21.15.123:39036) 2024-09-15T23:12:21.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.381+0000 7fb0df7fe640 1 -- 172.21.15.123:0/3268727191 learned_addr learned my addr 172.21.15.123:0/3268727191 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:21.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.381+0000 7fb0e4954640 1 --2- 172.21.15.123:0/3268727191 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0e00cf6b0 0x7fb0e00cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:21.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.381+0000 7fb0deffd640 1 -- 172.21.15.123:0/3268727191 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1261214440 0 0) 0x7fb0e006d080 con 0x7fb0e00cc1c0 2024-09-15T23:12:21.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.381+0000 7fb0deffd640 1 -- 172.21.15.123:0/3268727191 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0c8003520 con 0x7fb0e00cc1c0 2024-09-15T23:12:21.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.382+0000 7fb0deffd640 1 -- 172.21.15.123:0/3268727191 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 352746884 0 0) 0x7fb0e006d360 con 0x7fb0e015e960 2024-09-15T23:12:21.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.382+0000 7fb0deffd640 1 -- 172.21.15.123:0/3268727191 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0e006d080 con 0x7fb0e015e960 2024-09-15T23:12:21.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.382+0000 7fb0deffd640 1 -- 172.21.15.123:0/3268727191 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3910780030 0 0) 0x7fb0c8003520 con 0x7fb0e00cc1c0 2024-09-15T23:12:21.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.382+0000 7fb0deffd640 1 -- 172.21.15.123:0/3268727191 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0e00cf6b0 msgr2=0x7fb0e00cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:21.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.382+0000 7fb0deffd640 1 --2- 172.21.15.123:0/3268727191 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0e00cf6b0 0x7fb0e00cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.382+0000 7fb0deffd640 1 -- 172.21.15.123:0/3268727191 >> v1:172.21.15.188:6789/0 conn(0x7fb0e015e960 legacy=0x7fb0e00d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:21.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.382+0000 7fb0deffd640 1 -- 172.21.15.123:0/3268727191 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0e006d920 con 0x7fb0e00cc1c0 2024-09-15T23:12:21.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.382+0000 7fb0deffd640 1 -- 172.21.15.123:0/3268727191 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fb0d4001670 con 0x7fb0e00cc1c0 2024-09-15T23:12:21.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.382+0000 7fb0deffd640 1 -- 172.21.15.123:0/3268727191 >> v1:172.21.15.123:6789/0 conn(0x7fb0e00cc1c0 legacy=0x7fb0e00cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:21.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.382+0000 7fb0deffd640 1 --2- 172.21.15.123:0/3268727191 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0e00cf6b0 0x7fb0c8003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:21.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.382+0000 7fb0deffd640 1 --2- 172.21.15.123:0/3268727191 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0c8004120 0x7fb0c8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:21.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.382+0000 7fb0deffd640 1 --2- 172.21.15.123:0/3268727191 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0c8004d40 0x7fb0c80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:21.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.382+0000 7fb0deffd640 1 -- 172.21.15.123:0/3268727191 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e006d640 con 0x7fb0c8004d40 2024-09-15T23:12:21.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.382+0000 7fb0deffd640 1 -- 172.21.15.123:0/3268727191 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c800bb80 con 0x7fb0c8004120 2024-09-15T23:12:21.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.382+0000 7fb0deffd640 1 -- 172.21.15.123:0/3268727191 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb0c800bd80 con 0x7fb0e00cf6b0 2024-09-15T23:12:21.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.382+0000 7fb0e4954640 1 --2- 172.21.15.123:0/3268727191 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0c8004d40 0x7fb0c80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:21.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.382+0000 7fb0dffff640 1 --2- 172.21.15.123:0/3268727191 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0e00cf6b0 0x7fb0c8003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:21.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.382+0000 7fb0df7fe640 1 --2- 172.21.15.123:0/3268727191 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0c8004120 0x7fb0c8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:21.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.382+0000 7fb0e4954640 1 -- 172.21.15.123:0/3268727191 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0e00cf6b0 msgr2=0x7fb0c8003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:21.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.382+0000 7fb0e4954640 1 --2- 172.21.15.123:0/3268727191 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0e00cf6b0 0x7fb0c8003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.382+0000 7fb0e4954640 1 -- 172.21.15.123:0/3268727191 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0c8004120 msgr2=0x7fb0c8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:21.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.382+0000 7fb0e4954640 1 --2- 172.21.15.123:0/3268727191 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0c8004120 0x7fb0c8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.382+0000 7fb0e4954640 1 -- 172.21.15.123:0/3268727191 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c8003520 con 0x7fb0c8004d40 2024-09-15T23:12:21.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.383+0000 7fb0e4954640 1 --2- 172.21.15.123:0/3268727191 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0c8004d40 0x7fb0c80051c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb0d8009f90 tx=0x7fb0c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=383c95b64220673d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:21.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.383+0000 7fb0deffd640 1 -- 172.21.15.123:0/3268727191 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d8009c10 con 0x7fb0c8004d40 2024-09-15T23:12:21.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.383+0000 7fb0deffd640 1 -- 172.21.15.123:0/3268727191 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0d8036070 con 0x7fb0c8004d40 2024-09-15T23:12:21.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.383+0000 7fb0deffd640 1 -- 172.21.15.123:0/3268727191 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d8031810 con 0x7fb0c8004d40 2024-09-15T23:12:21.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.383+0000 7fb0e63b7640 1 -- 172.21.15.123:0/3268727191 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0c8004d40 msgr2=0x7fb0c80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:21.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.383+0000 7fb0e63b7640 1 --2- 172.21.15.123:0/3268727191 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0c8004d40 0x7fb0c80051c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb0d8009f90 tx=0x7fb0c8005830 comp rx=0 tx=0).stop 2024-09-15T23:12:21.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.383+0000 7fb0e4954640 1 -- 172.21.15.123:0/3268727191 reap_dead start 2024-09-15T23:12:21.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.384+0000 7fb0e63b7640 1 -- 172.21.15.123:0/3268727191 shutdown_connections 2024-09-15T23:12:21.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.384+0000 7fb0e63b7640 1 -- 172.21.15.123:0/3268727191 >> 172.21.15.123:0/3268727191 conn(0x7fb0e00b4300 msgr2=0x7fb0e00b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:21.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.384+0000 7fb0e63b7640 1 -- 172.21.15.123:0/3268727191 shutdown_connections 2024-09-15T23:12:21.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.384+0000 7fb0e63b7640 1 -- 172.21.15.123:0/3268727191 wait complete. 2024-09-15T23:12:21.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.385+0000 7fb0e63b7640 1 Processor -- start 2024-09-15T23:12:21.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.385+0000 7fb0e63b7640 1 -- start start 2024-09-15T23:12:21.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.386+0000 7fb0e63b7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0c8004d40 0x7fb0e014b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:21.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.386+0000 7fb0e63b7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0e00b7060 0x7fb0e0154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:21.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.386+0000 7fb0e63b7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0e00b74e0 0x7fb0e0155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:21.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.386+0000 7fb0e63b7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e00cc610 con 0x7fb0e00b7060 2024-09-15T23:12:21.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.386+0000 7fb0e63b7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e00d0a10 con 0x7fb0e00b74e0 2024-09-15T23:12:21.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.386+0000 7fb0e63b7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb0e00cc790 con 0x7fb0c8004d40 2024-09-15T23:12:21.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.386+0000 7fb0df7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0e00b7060 0x7fb0e0154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:21.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.386+0000 7fb0df7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0e00b7060 0x7fb0e0154f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36162/0 (socket says 172.21.15.123:36162) 2024-09-15T23:12:21.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.386+0000 7fb0df7fe640 1 -- 172.21.15.123:0/3031391029 learned_addr learned my addr 172.21.15.123:0/3031391029 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:21.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.386+0000 7fb0dffff640 1 --2- 172.21.15.123:0/3031391029 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0c8004d40 0x7fb0e014b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:21.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.386+0000 7fb0e4954640 1 --2- 172.21.15.123:0/3031391029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0e00b74e0 0x7fb0e0155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:21.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.386+0000 7fb0df7fe640 1 -- 172.21.15.123:0/3031391029 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0c8004d40 msgr2=0x7fb0e014b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:21.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.386+0000 7fb0df7fe640 1 --2- 172.21.15.123:0/3031391029 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0c8004d40 0x7fb0e014b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.386+0000 7fb0df7fe640 1 -- 172.21.15.123:0/3031391029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0e00b74e0 msgr2=0x7fb0e0155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:21.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.386+0000 7fb0df7fe640 1 --2- 172.21.15.123:0/3031391029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0e00b74e0 0x7fb0e0155490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.386+0000 7fb0df7fe640 1 -- 172.21.15.123:0/3031391029 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0e015fc80 con 0x7fb0e00b7060 2024-09-15T23:12:21.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.386+0000 7fb0df7fe640 1 --2- 172.21.15.123:0/3031391029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0e00b7060 0x7fb0e0154f50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4004ea0 tx=0x7fb0d4004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:21.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.386+0000 7fb0dcff9640 1 -- 172.21.15.123:0/3031391029 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d400f680 con 0x7fb0e00b7060 2024-09-15T23:12:21.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.386+0000 7fb0dcff9640 1 -- 172.21.15.123:0/3031391029 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0d4018070 con 0x7fb0e00b7060 2024-09-15T23:12:21.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.386+0000 7fb0dcff9640 1 -- 172.21.15.123:0/3031391029 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d400fa60 con 0x7fb0e00b7060 2024-09-15T23:12:21.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.386+0000 7fb0e63b7640 1 -- 172.21.15.123:0/3031391029 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0e00b7ab0 con 0x7fb0e00b7060 2024-09-15T23:12:21.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.386+0000 7fb0e63b7640 1 -- 172.21.15.123:0/3031391029 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0e015ff40 con 0x7fb0e00b7060 2024-09-15T23:12:21.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.387+0000 7fb0e63b7640 1 -- 172.21.15.123:0/3031391029 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0e0160140 con 0x7fb0e00b7060 2024-09-15T23:12:21.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.388+0000 7fb0dcff9640 1 -- 172.21.15.123:0/3031391029 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb0d400fc00 con 0x7fb0e00b7060 2024-09-15T23:12:21.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.388+0000 7fb0dcff9640 1 --2- 172.21.15.123:0/3031391029 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb0cc06c2e0 0x7fb0cc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:21.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.388+0000 7fb0dcff9640 1 -- 172.21.15.123:0/3031391029 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb0d408b1b0 con 0x7fb0e00b7060 2024-09-15T23:12:21.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.389+0000 7fb0dffff640 1 --2- 172.21.15.123:0/3031391029 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb0cc06c2e0 0x7fb0cc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:21.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.389+0000 7fb0dffff640 1 --2- 172.21.15.123:0/3031391029 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb0cc06c2e0 0x7fb0cc06e7a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0000c00 tx=0x7fb0d0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:21.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.393+0000 7fb0dcff9640 1 -- 172.21.15.123:0/3031391029 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb0e0160140 con 0x7fb0e00b7060 2024-09-15T23:12:21.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.559+0000 7fb0e63b7640 1 -- 172.21.15.123:0/3031391029 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb0e00cefa0 con 0x7fb0e00b7060 2024-09-15T23:12:21.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.560+0000 7fb0dcff9640 1 -- 172.21.15.123:0/3031391029 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16693 (secure 0 0 0) 0x7fb0d4059390 con 0x7fb0e00b7060 2024-09-15T23:12:21.561 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:21.561 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":22,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:12:14.277829+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:12:10.289254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:12:11.594152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:12:21.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.562+0000 7fb0e63b7640 1 -- 172.21.15.123:0/3031391029 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb0cc06c2e0 msgr2=0x7fb0cc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:21.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.562+0000 7fb0e63b7640 1 --2- 172.21.15.123:0/3031391029 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb0cc06c2e0 0x7fb0cc06e7a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0000c00 tx=0x7fb0d0009040 comp rx=0 tx=0).stop 2024-09-15T23:12:21.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.562+0000 7fb0e63b7640 1 -- 172.21.15.123:0/3031391029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0e00b7060 msgr2=0x7fb0e0154f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:21.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.562+0000 7fb0e63b7640 1 --2- 172.21.15.123:0/3031391029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0e00b7060 0x7fb0e0154f50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4004ea0 tx=0x7fb0d4004f90 comp rx=0 tx=0).stop 2024-09-15T23:12:21.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.562+0000 7fb0e63b7640 1 -- 172.21.15.123:0/3031391029 shutdown_connections 2024-09-15T23:12:21.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.562+0000 7fb0e63b7640 1 --2- 172.21.15.123:0/3031391029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb0e00b74e0 0x7fb0e0155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.562+0000 7fb0e63b7640 1 --2- 172.21.15.123:0/3031391029 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb0cc06c2e0 0x7fb0cc06e7a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.562+0000 7fb0e63b7640 1 --2- 172.21.15.123:0/3031391029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0e00b7060 0x7fb0e0154f50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.562+0000 7fb0e63b7640 1 --2- 172.21.15.123:0/3031391029 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0c8004d40 0x7fb0e014b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.562+0000 7fb0e63b7640 1 -- 172.21.15.123:0/3031391029 >> 172.21.15.123:0/3031391029 conn(0x7fb0e00b4300 msgr2=0x7fb0e0073400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:21.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.562+0000 7fb0e63b7640 1 -- 172.21.15.123:0/3031391029 shutdown_connections 2024-09-15T23:12:21.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.562+0000 7fb0e63b7640 1 -- 172.21.15.123:0/3031391029 wait complete. 2024-09-15T23:12:21.574 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-15T23:12:21.574 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:12:21.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.671+0000 7f75a30b7640 1 Processor -- start 2024-09-15T23:12:21.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.671+0000 7f75a30b7640 1 -- start start 2024-09-15T23:12:21.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.672+0000 7f75a30b7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f759c06c320 0x7f759c15bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:21.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.672+0000 7f75a30b7640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f759c13eb20 0x7f759c15c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:21.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.672+0000 7f75a30b7640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f759c071180 con 0x7f759c0b2d40 2024-09-15T23:12:21.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.672+0000 7f75a30b7640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f759c071ab0 con 0x7f759c06c320 2024-09-15T23:12:21.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.672+0000 7f75a30b7640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f759c071460 con 0x7f759c13eb20 2024-09-15T23:12:21.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.672+0000 7f759bfff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f759c06c320 0x7f759c15bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:21.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.672+0000 7f759bfff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f759c06c320 0x7f759c15bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36166/0 (socket says 172.21.15.123:36166) 2024-09-15T23:12:21.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.672+0000 7f759bfff640 1 -- 172.21.15.123:0/4155594670 learned_addr learned my addr 172.21.15.123:0/4155594670 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:21.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.672+0000 7f759bfff640 1 -- 172.21.15.123:0/4155594670 >> v2:172.21.15.188:3300/0 conn(0x7f759c13eb20 msgr2=0x7f759c15c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:21.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.672+0000 7f75a1654640 1 --2- 172.21.15.123:0/4155594670 >> v2:172.21.15.188:3300/0 conn(0x7f759c13eb20 0x7f759c15c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:21.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.672+0000 7f759bfff640 1 --2- 172.21.15.123:0/4155594670 >> v2:172.21.15.188:3300/0 conn(0x7f759c13eb20 0x7f759c15c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.672+0000 7f759bfff640 1 -- 172.21.15.123:0/4155594670 >> v1:172.21.15.188:6789/0 conn(0x7f759c0b2d40 legacy=0x7f759c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:21.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.672+0000 7f759bfff640 1 -- 172.21.15.123:0/4155594670 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f759c071740 con 0x7f759c06c320 2024-09-15T23:12:21.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.672+0000 7f75a1654640 1 --2- 172.21.15.123:0/4155594670 >> v2:172.21.15.188:3300/0 conn(0x7f759c13eb20 0x7f759c15c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:21.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.673+0000 7f759bfff640 1 --2- 172.21.15.123:0/4155594670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f759c06c320 0x7f759c15bcf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f759c1595c0 tx=0x7f758802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2097038cb2b65e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:21.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.673+0000 7f759b7fe640 1 -- 172.21.15.123:0/4155594670 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7588037070 con 0x7f759c06c320 2024-09-15T23:12:21.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.673+0000 7f759b7fe640 1 -- 172.21.15.123:0/4155594670 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7588032440 con 0x7f759c06c320 2024-09-15T23:12:21.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.673+0000 7f759b7fe640 1 -- 172.21.15.123:0/4155594670 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7588032810 con 0x7f759c06c320 2024-09-15T23:12:21.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.674+0000 7f75a30b7640 1 -- 172.21.15.123:0/4155594670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f759c06c320 msgr2=0x7f759c15bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:21.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.674+0000 7f75a30b7640 1 --2- 172.21.15.123:0/4155594670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f759c06c320 0x7f759c15bcf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f759c1595c0 tx=0x7f758802a230 comp rx=0 tx=0).stop 2024-09-15T23:12:21.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.674+0000 7f75a30b7640 1 -- 172.21.15.123:0/4155594670 shutdown_connections 2024-09-15T23:12:21.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.674+0000 7f75a30b7640 1 --2- 172.21.15.123:0/4155594670 >> v2:172.21.15.188:3300/0 conn(0x7f759c13eb20 0x7f759c15c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.674+0000 7f75a30b7640 1 --2- 172.21.15.123:0/4155594670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f759c06c320 0x7f759c15bcf0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.674+0000 7f75a30b7640 1 -- 172.21.15.123:0/4155594670 >> 172.21.15.123:0/4155594670 conn(0x7f759c0ccec0 msgr2=0x7f759c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:21.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.674+0000 7f75a30b7640 1 -- 172.21.15.123:0/4155594670 shutdown_connections 2024-09-15T23:12:21.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.674+0000 7f75a30b7640 1 -- 172.21.15.123:0/4155594670 wait complete. 2024-09-15T23:12:21.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.675+0000 7f75a30b7640 1 Processor -- start 2024-09-15T23:12:21.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.675+0000 7f75a30b7640 1 -- start start 2024-09-15T23:12:21.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.676+0000 7f75a30b7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f759c06c320 0x7f759c13e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:21.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.676+0000 7f75a30b7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f759c0b2d40 0x7f759c0c7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:21.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.676+0000 7f75a30b7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f759c13eb20 0x7f759c0c5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:21.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.676+0000 7f75a30b7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f759c0720c0 con 0x7f759c06c320 2024-09-15T23:12:21.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.676+0000 7f75a30b7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f759c071f40 con 0x7f759c13eb20 2024-09-15T23:12:21.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.676+0000 7f75a30b7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f759c072240 con 0x7f759c0b2d40 2024-09-15T23:12:21.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.676+0000 7f75a0e53640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f759c06c320 0x7f759c13e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:21.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.676+0000 7f75a0e53640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f759c06c320 0x7f759c13e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36170/0 (socket says 172.21.15.123:36170) 2024-09-15T23:12:21.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.676+0000 7f75a0e53640 1 -- 172.21.15.123:0/3156906007 learned_addr learned my addr 172.21.15.123:0/3156906007 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:21.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.676+0000 7f75a1654640 1 --2- 172.21.15.123:0/3156906007 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f759c13eb20 0x7f759c0c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:21.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.676+0000 7f759bfff640 1 --2- 172.21.15.123:0/3156906007 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f759c0b2d40 0x7f759c0c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:21.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.676+0000 7f75a0e53640 1 -- 172.21.15.123:0/3156906007 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f759c0b2d40 msgr2=0x7f759c0c7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:21.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.676+0000 7f75a0e53640 1 --2- 172.21.15.123:0/3156906007 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f759c0b2d40 0x7f759c0c7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.676+0000 7f75a0e53640 1 -- 172.21.15.123:0/3156906007 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f759c13eb20 msgr2=0x7f759c0c5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:21.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.676+0000 7f75a0e53640 1 --2- 172.21.15.123:0/3156906007 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f759c13eb20 0x7f759c0c5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.676+0000 7f75a0e53640 1 -- 172.21.15.123:0/3156906007 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f759c0c5fc0 con 0x7f759c06c320 2024-09-15T23:12:21.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.676+0000 7f75a0e53640 1 --2- 172.21.15.123:0/3156906007 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f759c06c320 0x7f759c13e010 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f759000c430 tx=0x7f759000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:21.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.677+0000 7f75997fa640 1 -- 172.21.15.123:0/3156906007 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7590011790 con 0x7f759c06c320 2024-09-15T23:12:21.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.677+0000 7f75997fa640 1 -- 172.21.15.123:0/3156906007 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7590017070 con 0x7f759c06c320 2024-09-15T23:12:21.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.677+0000 7f75a30b7640 1 -- 172.21.15.123:0/3156906007 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f759c0c62a0 con 0x7f759c06c320 2024-09-15T23:12:21.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.677+0000 7f75997fa640 1 -- 172.21.15.123:0/3156906007 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7590011bb0 con 0x7f759c06c320 2024-09-15T23:12:21.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.677+0000 7f75a30b7640 1 -- 172.21.15.123:0/3156906007 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f759c0c6860 con 0x7f759c06c320 2024-09-15T23:12:21.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.678+0000 7f75a30b7640 1 -- 172.21.15.123:0/3156906007 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f759c06bc10 con 0x7f759c06c320 2024-09-15T23:12:21.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.678+0000 7f75997fa640 1 -- 172.21.15.123:0/3156906007 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f759001c460 con 0x7f759c06c320 2024-09-15T23:12:21.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.678+0000 7f75997fa640 1 --2- 172.21.15.123:0/3156906007 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f758006c2b0 0x7f758006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:21.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.679+0000 7f75997fa640 1 -- 172.21.15.123:0/3156906007 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f759008b250 con 0x7f759c06c320 2024-09-15T23:12:21.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.679+0000 7f759bfff640 1 --2- 172.21.15.123:0/3156906007 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f758006c2b0 0x7f758006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:21.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.679+0000 7f759bfff640 1 --2- 172.21.15.123:0/3156906007 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f758006c2b0 0x7f758006e770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7588034000 tx=0x7f758802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:21.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.683+0000 7f75997fa640 1 -- 172.21.15.123:0/3156906007 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7590059370 con 0x7f759c06c320 2024-09-15T23:12:21.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.846+0000 7f75a30b7640 1 -- 172.21.15.123:0/3156906007 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f759c06c9c0 con 0x7f759c06c320 2024-09-15T23:12:21.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.848+0000 7f75997fa640 1 -- 172.21.15.123:0/3156906007 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16693 (secure 0 0 0) 0x7f759005d670 con 0x7f759c06c320 2024-09-15T23:12:21.849 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:21.849 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":22,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:12:14.277829+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:12:10.289254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:12:11.594152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:12:21.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.850+0000 7f75a30b7640 1 -- 172.21.15.123:0/3156906007 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f758006c2b0 msgr2=0x7f758006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:21.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.850+0000 7f75a30b7640 1 --2- 172.21.15.123:0/3156906007 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f758006c2b0 0x7f758006e770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7588034000 tx=0x7f758802e000 comp rx=0 tx=0).stop 2024-09-15T23:12:21.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.850+0000 7f75a30b7640 1 -- 172.21.15.123:0/3156906007 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f759c06c320 msgr2=0x7f759c13e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:21.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.850+0000 7f75a30b7640 1 --2- 172.21.15.123:0/3156906007 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f759c06c320 0x7f759c13e010 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f759000c430 tx=0x7f759000c8f0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.850+0000 7f75a30b7640 1 -- 172.21.15.123:0/3156906007 shutdown_connections 2024-09-15T23:12:21.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.850+0000 7f75a30b7640 1 --2- 172.21.15.123:0/3156906007 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f759c13eb20 0x7f759c0c5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.850+0000 7f75a30b7640 1 --2- 172.21.15.123:0/3156906007 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f759c0b2d40 0x7f759c0c7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.850+0000 7f75a30b7640 1 --2- 172.21.15.123:0/3156906007 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f758006c2b0 0x7f758006e770 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.850+0000 7f75a30b7640 1 --2- 172.21.15.123:0/3156906007 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f759c06c320 0x7f759c13e010 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:21.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.850+0000 7f75a30b7640 1 -- 172.21.15.123:0/3156906007 >> 172.21.15.123:0/3156906007 conn(0x7f759c0ccec0 msgr2=0x7f759c0cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:21.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.850+0000 7f75a30b7640 1 -- 172.21.15.123:0/3156906007 shutdown_connections 2024-09-15T23:12:21.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:21.850+0000 7f75a30b7640 1 -- 172.21.15.123:0/3156906007 wait complete. 2024-09-15T23:12:21.862 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-15T23:12:21.862 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-15T23:12:21.863 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-15T23:12:21.863 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-15T23:12:21.864 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-15T23:12:21.864 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-15T23:12:21.865 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-15T23:12:21.865 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-15T23:12:22.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.029+0000 7fa592ffa640 1 Processor -- start 2024-09-15T23:12:22.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.029+0000 7fa592ffa640 1 -- start start 2024-09-15T23:12:22.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.030+0000 7ff7b948b640 1 Processor -- start 2024-09-15T23:12:22.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.030+0000 7fdfb8826640 1 Processor -- start 2024-09-15T23:12:22.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.030+0000 7ff7b948b640 1 -- start start 2024-09-15T23:12:22.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.030+0000 7fa592ffa640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa58c0b2980 0x7fa58c0714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.030+0000 7fa592ffa640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa58c070c50 0x7fa58c06d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.030+0000 7fa592ffa640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa58c071100 con 0x7fa58c0ccc60 2024-09-15T23:12:22.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.030+0000 7fa592ffa640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fa58c071d70 con 0x7fa58c070c50 2024-09-15T23:12:22.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.030+0000 7fa592ffa640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fa58c072050 con 0x7fa58c0b2980 2024-09-15T23:12:22.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.030+0000 7fdfb8826640 1 -- start start 2024-09-15T23:12:22.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.032+0000 7fdfb8826640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdfac051490 0x7fdfac038220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.032+0000 7fdfb8826640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fdfac038760 0x7fdfac054370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.031+0000 7ff7b948b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff7b415a710 0x7ff7b40714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.031+0000 7ff7b948b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff7b406d770 0x7ff7b4070c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.031+0000 7ff7b948b640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7b4071a90 con 0x7ff7b40ccc60 2024-09-15T23:12:22.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.031+0000 7ff7b948b640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7ff7b4071d70 con 0x7ff7b415a710 2024-09-15T23:12:22.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.031+0000 7ff7b948b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ff7b4072050 con 0x7ff7b406d770 2024-09-15T23:12:22.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.032+0000 7ff7b3fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff7b415a710 0x7ff7b40714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.032+0000 7ff7b8c8a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff7b406d770 0x7ff7b4070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.032+0000 7ff7b8c8a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff7b406d770 0x7ff7b4070c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:41176/0 (socket says 172.21.15.123:41176) 2024-09-15T23:12:22.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.032+0000 7ff7b8c8a640 1 -- 172.21.15.123:0/2305607786 learned_addr learned my addr 172.21.15.123:0/2305607786 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:22.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.032+0000 7ff7b37fe640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7ff7b40ccc60 0x7ff7b406d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:48808/0 (socket says 172.21.15.123:48808) 2024-09-15T23:12:22.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.032+0000 7ff7b3fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff7b415a710 0x7ff7b40714b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:50700/0 (socket says 172.21.15.123:50700) 2024-09-15T23:12:22.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.031+0000 7fa5927f9640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa58c070c50 0x7fa58c06d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.031+0000 7fa591ff8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa58c0b2980 0x7fa58c0714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.031+0000 7fa591ff8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa58c0b2980 0x7fa58c0714b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:50688/0 (socket says 172.21.15.123:50688) 2024-09-15T23:12:22.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.031+0000 7fa591ff8640 1 -- 172.21.15.123:0/3395292513 learned_addr learned my addr 172.21.15.123:0/3395292513 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:22.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.031+0000 7fa591ff8640 1 -- 172.21.15.123:0/3395292513 >> v2:172.21.15.123:3300/0 conn(0x7fa58c070c50 msgr2=0x7fa58c06d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:22.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.031+0000 7fa591ff8640 1 --2- 172.21.15.123:0/3395292513 >> v2:172.21.15.123:3300/0 conn(0x7fa58c070c50 0x7fa58c06d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.031+0000 7fa591ff8640 1 -- 172.21.15.123:0/3395292513 >> v1:172.21.15.188:6789/0 conn(0x7fa58c0ccc60 legacy=0x7fa58c15a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.031+0000 7fa591ff8640 1 -- 172.21.15.123:0/3395292513 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa58c0b40d0 con 0x7fa58c0b2980 2024-09-15T23:12:22.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.031+0000 7f884759e640 1 Processor -- start 2024-09-15T23:12:22.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.031+0000 7f884759e640 1 -- start start 2024-09-15T23:12:22.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.032+0000 7fc5cc277640 1 Processor -- start 2024-09-15T23:12:22.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.032+0000 7fdfb8826640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfac0575f0 con 0x7fdfac0e1450 2024-09-15T23:12:22.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.032+0000 7fdfb8826640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fdfac051a50 con 0x7fdfac038760 2024-09-15T23:12:22.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.032+0000 7fdfb8826640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fdfac051d30 con 0x7fdfac051490 2024-09-15T23:12:22.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.032+0000 7fdfb259c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdfac051490 0x7fdfac038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.032+0000 7fdfb259c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdfac051490 0x7fdfac038220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:41180/0 (socket says 172.21.15.123:41180) 2024-09-15T23:12:22.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.032+0000 7fdfb259c640 1 -- 172.21.15.123:0/722289699 learned_addr learned my addr 172.21.15.123:0/722289699 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:22.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.032+0000 7fdfb359e640 1 --2- 172.21.15.123:0/722289699 >> v2:172.21.15.188:3300/0 conn(0x7fdfac038760 0x7fdfac054370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.032+0000 7fdfb259c640 1 -- 172.21.15.123:0/722289699 >> v2:172.21.15.188:3300/0 conn(0x7fdfac038760 msgr2=0x7fdfac054370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:22.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.032+0000 7fdfb259c640 1 --2- 172.21.15.123:0/722289699 >> v2:172.21.15.188:3300/0 conn(0x7fdfac038760 0x7fdfac054370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.032+0000 7fdfb259c640 1 -- 172.21.15.123:0/722289699 >> v1:172.21.15.188:6789/0 conn(0x7fdfac0e1450 legacy=0x7fdfac0e1830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:12:22.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.032+0000 7fdfb259c640 1 -- 172.21.15.123:0/722289699 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfac052010 con 0x7fdfac051490 2024-09-15T23:12:22.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.032+0000 7ff7b3fff640 1 -- 172.21.15.123:0/2305607786 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff7b406d770 msgr2=0x7ff7b4070c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:22.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.032+0000 7ff7b3fff640 1 --2- 172.21.15.123:0/2305607786 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff7b406d770 0x7ff7b4070c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.032+0000 7ff7b3fff640 1 -- 172.21.15.123:0/2305607786 >> v1:172.21.15.188:6789/0 conn(0x7ff7b40ccc60 legacy=0x7ff7b406d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.032+0000 7ff7b3fff640 1 -- 172.21.15.123:0/2305607786 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b40b40d0 con 0x7ff7b415a710 2024-09-15T23:12:22.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.032+0000 7fc5cc277640 1 -- start start 2024-09-15T23:12:22.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.033+0000 7fa591ff8640 1 --2- 172.21.15.123:0/3395292513 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa58c0b2980 0x7fa58c0714b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa58c0d12d0 tx=0x7fa58802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55329a8b85b76cd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.033+0000 7fa590ff6640 1 -- 172.21.15.123:0/3395292513 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa588037070 con 0x7fa58c0b2980 2024-09-15T23:12:22.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.033+0000 7fa590ff6640 1 -- 172.21.15.123:0/3395292513 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa588032440 con 0x7fa58c0b2980 2024-09-15T23:12:22.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.033+0000 7fa590ff6640 1 -- 172.21.15.123:0/3395292513 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa588032810 con 0x7fa58c0b2980 2024-09-15T23:12:22.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.033+0000 7f884759e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f8848070c50 0x7f884816b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.033+0000 7fdfb259c640 1 --2- 172.21.15.123:0/722289699 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdfac051490 0x7fdfac038220 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdfa400f9e0 tx=0x7fdfa402e530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc753a3316ae4df4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.033+0000 7f884759e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f884816bb90 0x7f884806cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.033+0000 7f884759e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f884806d670 con 0x7f884806d260 2024-09-15T23:12:22.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.033+0000 7f884759e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f8848073f00 con 0x7f884816bb90 2024-09-15T23:12:22.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.033+0000 7f884759e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f88480714b0 con 0x7f8848070c50 2024-09-15T23:12:22.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.034+0000 7f8845d9b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f884816bb90 0x7f884806cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.034+0000 7f8845d9b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f884816bb90 0x7f884806cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36196/0 (socket says 172.21.15.123:36196) 2024-09-15T23:12:22.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.034+0000 7f8845d9b640 1 -- 172.21.15.123:0/3653179448 learned_addr learned my addr 172.21.15.123:0/3653179448 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:22.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.034+0000 7ff7b3fff640 1 --2- 172.21.15.123:0/2305607786 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7b415a710 0x7ff7b40714b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff7a40097a0 tx=0x7ff7a402c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e691b21b345b5ae server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.034+0000 7fc5cc277640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5bc03ce40 0x7fc5bc005d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.034+0000 7fc5cc277640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc5bc006260 0x7fc5bc0066f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.034+0000 7fc5cc277640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5bc0e2f60 con 0x7fc5bc0e2b80 2024-09-15T23:12:22.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.034+0000 7fc5cc277640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fc5bc057790 con 0x7fc5bc006260 2024-09-15T23:12:22.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.034+0000 7fc5cc277640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc5bc057a50 con 0x7fc5bc03ce40 2024-09-15T23:12:22.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.034+0000 7f9610b82640 1 Processor -- start 2024-09-15T23:12:22.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.034+0000 7f9610b82640 1 -- start start 2024-09-15T23:12:22.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.034+0000 7fdfb1d9b640 1 -- 172.21.15.123:0/722289699 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa403a070 con 0x7fdfac051490 2024-09-15T23:12:22.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.034+0000 7fdfb1d9b640 1 -- 172.21.15.123:0/722289699 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa4033710 con 0x7fdfac051490 2024-09-15T23:12:22.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.034+0000 7ff7b2ffd640 1 -- 172.21.15.123:0/2305607786 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4039070 con 0x7ff7b415a710 2024-09-15T23:12:22.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.034+0000 7ff7b2ffd640 1 -- 172.21.15.123:0/2305607786 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7a4034640 con 0x7ff7b415a710 2024-09-15T23:12:22.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7ff7b2ffd640 1 -- 172.21.15.123:0/2305607786 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a402ce60 con 0x7ff7b415a710 2024-09-15T23:12:22.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.034+0000 7fa592ffa640 1 -- 172.21.15.123:0/3395292513 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa58c0b2980 msgr2=0x7fa58c0714b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.034+0000 7fa592ffa640 1 --2- 172.21.15.123:0/3395292513 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa58c0b2980 0x7fa58c0714b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa58c0d12d0 tx=0x7fa58802a230 comp rx=0 tx=0).stop 2024-09-15T23:12:22.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.034+0000 7fa592ffa640 1 -- 172.21.15.123:0/3395292513 shutdown_connections 2024-09-15T23:12:22.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.034+0000 7fa592ffa640 1 --2- 172.21.15.123:0/3395292513 >> v2:172.21.15.123:3300/0 conn(0x7fa58c070c50 0x7fa58c06d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.034+0000 7fa592ffa640 1 --2- 172.21.15.123:0/3395292513 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa58c0b2980 0x7fa58c0714b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.034+0000 7fa592ffa640 1 -- 172.21.15.123:0/3395292513 >> 172.21.15.123:0/3395292513 conn(0x7fa58c0b1e60 msgr2=0x7fa58c0b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:22.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.034+0000 7fca29798640 1 Processor -- start 2024-09-15T23:12:22.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.034+0000 7fca29798640 1 -- start start 2024-09-15T23:12:22.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.034+0000 7fc5ca013640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc5bc0e2b80 0x7fc5bc0539f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39058/0 (socket says 172.21.15.123:39058) 2024-09-15T23:12:22.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.034+0000 7fc5ca013640 1 -- 172.21.15.123:0/3670680522 learned_addr learned my addr 172.21.15.123:0/3670680522 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:22.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.034+0000 7fc5c9011640 1 -- 172.21.15.123:0/3670680522 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3349208898 0 0) 0x7fc5bc0e2f60 con 0x7fc5bc0e2b80 2024-09-15T23:12:22.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7fc5c9011640 1 -- 172.21.15.123:0/3670680522 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5b0003520 con 0x7fc5bc0e2b80 2024-09-15T23:12:22.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7fc5c9011640 1 -- 172.21.15.123:0/3670680522 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2806031305 0 0) 0x7fc5b0003520 con 0x7fc5bc0e2b80 2024-09-15T23:12:22.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7fc5c9011640 1 -- 172.21.15.123:0/3670680522 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5bc03ce40 msgr2=0x7fc5bc005d20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:12:22.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7fc5c9011640 1 --2- 172.21.15.123:0/3670680522 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5bc03ce40 0x7fc5bc005d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7fc5c9011640 1 -- 172.21.15.123:0/3670680522 >> v2:172.21.15.188:3300/0 conn(0x7fc5bc006260 msgr2=0x7fc5bc0066f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:22.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7fc5ca814640 1 --2- 172.21.15.123:0/3670680522 >> v2:172.21.15.188:3300/0 conn(0x7fc5bc006260 0x7fc5bc0066f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7fc5c9011640 1 --2- 172.21.15.123:0/3670680522 >> v2:172.21.15.188:3300/0 conn(0x7fc5bc006260 0x7fc5bc0066f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7fc5c9011640 1 -- 172.21.15.123:0/3670680522 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5bc057d30 con 0x7fc5bc0e2b80 2024-09-15T23:12:22.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7fc5c9011640 1 -- 172.21.15.123:0/3670680522 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fc5c4050800 con 0x7fc5bc0e2b80 2024-09-15T23:12:22.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7fc5c9011640 1 -- 172.21.15.123:0/3670680522 >> v1:172.21.15.123:6789/0 conn(0x7fc5bc0e2b80 legacy=0x7fc5bc0539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7fdfb8826640 1 -- 172.21.15.123:0/722289699 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdfac051490 msgr2=0x7fdfac038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7fdfb8826640 1 --2- 172.21.15.123:0/722289699 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdfac051490 0x7fdfac038220 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdfa400f9e0 tx=0x7fdfa402e530 comp rx=0 tx=0).stop 2024-09-15T23:12:22.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.034+0000 7f884659c640 1 --2- 172.21.15.123:0/3653179448 >> v2:172.21.15.188:3300/0 conn(0x7f8848070c50 0x7f884816b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.034+0000 7f8845d9b640 1 -- 172.21.15.123:0/3653179448 >> v2:172.21.15.188:3300/0 conn(0x7f8848070c50 msgr2=0x7f884816b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:22.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.034+0000 7f8845d9b640 1 --2- 172.21.15.123:0/3653179448 >> v2:172.21.15.188:3300/0 conn(0x7f8848070c50 0x7f884816b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.034+0000 7f8845d9b640 1 -- 172.21.15.123:0/3653179448 >> v1:172.21.15.123:6789/0 conn(0x7f884806d260 legacy=0x7f884806e350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:12:22.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.034+0000 7f8845d9b640 1 -- 172.21.15.123:0/3653179448 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8848071790 con 0x7f884816bb90 2024-09-15T23:12:22.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7fc5c9011640 1 --2- 172.21.15.123:0/3670680522 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc5b00039b0 0x7fc5b0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7fc5c9011640 1 --2- 172.21.15.123:0/3670680522 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5b0004800 0x7fc5b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7fc5c9011640 1 --2- 172.21.15.123:0/3670680522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5b00052e0 0x7fc5b000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7fc5c9011640 1 -- 172.21.15.123:0/3670680522 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc5bc057790 con 0x7fc5b00052e0 2024-09-15T23:12:22.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7fc5c9011640 1 -- 172.21.15.123:0/3670680522 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc5bc057a50 con 0x7fc5b00039b0 2024-09-15T23:12:22.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7fc5c9011640 1 -- 172.21.15.123:0/3670680522 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc5b000c230 con 0x7fc5b0004800 2024-09-15T23:12:22.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7fa592ffa640 1 -- 172.21.15.123:0/3395292513 shutdown_connections 2024-09-15T23:12:22.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7fdfb8826640 1 -- 172.21.15.123:0/722289699 shutdown_connections 2024-09-15T23:12:22.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7fdfb8826640 1 --2- 172.21.15.123:0/722289699 >> v2:172.21.15.188:3300/0 conn(0x7fdfac038760 0x7fdfac054370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7fdfb8826640 1 --2- 172.21.15.123:0/722289699 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdfac051490 0x7fdfac038220 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7fdfb8826640 1 -- 172.21.15.123:0/722289699 >> 172.21.15.123:0/722289699 conn(0x7fdfac0567a0 msgr2=0x7fdfac056bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:22.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7ff7b948b640 1 -- 172.21.15.123:0/2305607786 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7b415a710 msgr2=0x7ff7b40714b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7ff7b948b640 1 --2- 172.21.15.123:0/2305607786 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7b415a710 0x7ff7b40714b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff7a40097a0 tx=0x7ff7a402c310 comp rx=0 tx=0).stop 2024-09-15T23:12:22.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7f0941776640 1 Processor -- start 2024-09-15T23:12:22.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7fca29798640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fca24160800 0x7fca24167340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7fca29798640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca24160be0 con 0x7fca240b3470 2024-09-15T23:12:22.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7fca29798640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca241634e0 con 0x7fca240d09c0 2024-09-15T23:12:22.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7fca29798640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fca241637c0 con 0x7fca24160800 2024-09-15T23:12:22.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7fc5c9812640 1 --2- 172.21.15.123:0/3670680522 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5b0004800 0x7fc5b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7fc5ca814640 1 --2- 172.21.15.123:0/3670680522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5b00052e0 0x7fc5b000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7ff7b948b640 1 -- 172.21.15.123:0/2305607786 shutdown_connections 2024-09-15T23:12:22.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.036+0000 7f9610b82640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f960c1490b0 0x7f960c1497d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7ff7b948b640 1 --2- 172.21.15.123:0/2305607786 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff7b406d770 0x7ff7b4070c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7ff7b948b640 1 --2- 172.21.15.123:0/2305607786 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7b415a710 0x7ff7b40714b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7ff7b948b640 1 -- 172.21.15.123:0/2305607786 >> 172.21.15.123:0/2305607786 conn(0x7ff7b40b1e60 msgr2=0x7ff7b40b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:22.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.036+0000 7fdfb8826640 1 -- 172.21.15.123:0/722289699 shutdown_connections 2024-09-15T23:12:22.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7f0941776640 1 -- start start 2024-09-15T23:12:22.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7f8845d9b640 1 --2- 172.21.15.123:0/3653179448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f884816bb90 0x7f884806cd20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f88480b2d10 tx=0x7f883c02a490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb9a38de25b3eba server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.036+0000 7fca237fe640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fca240d09c0 0x7fca240b5060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:48828/0 (socket says 172.21.15.123:48828) 2024-09-15T23:12:22.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.036+0000 7fca237fe640 1 -- 172.21.15.123:0/4204545169 learned_addr learned my addr 172.21.15.123:0/4204545169 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:22.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.036+0000 7f9610b82640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f960c0b36f0 con 0x7f960c0b2c70 2024-09-15T23:12:22.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.036+0000 7fc5ca013640 1 --2- 172.21.15.123:0/3670680522 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc5b00039b0 0x7fc5b0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.036+0000 7f9610b82640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f960c149490 con 0x7f960c0cdc80 2024-09-15T23:12:22.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.036+0000 7f960bfff640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f960c0cdc80 0x7f960c0b4490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:48836/0 (socket says 172.21.15.123:48836) 2024-09-15T23:12:22.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.036+0000 7f960bfff640 1 -- 172.21.15.123:0/891646789 learned_addr learned my addr 172.21.15.123:0/891646789 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:22.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.036+0000 7fc5c9812640 1 -- 172.21.15.123:0/3670680522 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc5b00039b0 msgr2=0x7fc5b0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:22.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.036+0000 7fc5c9812640 1 --2- 172.21.15.123:0/3670680522 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc5b00039b0 0x7fc5b0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.036+0000 7fc5c9812640 1 -- 172.21.15.123:0/3670680522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5b00052e0 msgr2=0x7fc5b000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:22.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.036+0000 7fc5c9812640 1 --2- 172.21.15.123:0/3670680522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5b00052e0 0x7fc5b000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.036+0000 7fc5c9812640 1 -- 172.21.15.123:0/3670680522 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5bc057d30 con 0x7fc5b0004800 2024-09-15T23:12:22.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.036+0000 7f9610b82640 1 -- 172.21.15.123:0/891646789 --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f960c0b4000 con 0x7f960c1490b0 2024-09-15T23:12:22.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.036+0000 7f960a7fc640 1 -- 172.21.15.123:0/891646789 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1145676023 0 0) 0x7f960c149490 con 0x7f960c0cdc80 2024-09-15T23:12:22.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.036+0000 7f960a7fc640 1 -- 172.21.15.123:0/891646789 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95f4003520 con 0x7f960c0cdc80 2024-09-15T23:12:22.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.036+0000 7f960b7fe640 1 --2- 172.21.15.123:0/891646789 >> v2:172.21.15.123:3300/0 conn(0x7f960c1490b0 0x7f960c1497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.036+0000 7f960a7fc640 1 -- 172.21.15.123:0/891646789 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3268314593 0 0) 0x7f95f4003520 con 0x7f960c0cdc80 2024-09-15T23:12:22.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.036+0000 7f960a7fc640 1 -- 172.21.15.123:0/891646789 >> v2:172.21.15.123:3300/0 conn(0x7f960c1490b0 msgr2=0x7f960c1497d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:22.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7f960a7fc640 1 --2- 172.21.15.123:0/891646789 >> v2:172.21.15.123:3300/0 conn(0x7f960c1490b0 0x7f960c1497d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7f960a7fc640 1 -- 172.21.15.123:0/891646789 >> v1:172.21.15.123:6789/0 conn(0x7f960c0b2c70 legacy=0x7f960c0b6250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:12:22.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7f960a7fc640 1 -- 172.21.15.123:0/891646789 --> v1:172.21.15.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f960c0b31e0 con 0x7f960c0cdc80 2024-09-15T23:12:22.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7f960a7fc640 1 -- 172.21.15.123:0/891646789 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f96040019f0 con 0x7f960c0cdc80 2024-09-15T23:12:22.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.036+0000 7ff7b948b640 1 -- 172.21.15.123:0/2305607786 shutdown_connections 2024-09-15T23:12:22.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.036+0000 7ff7b948b640 1 -- 172.21.15.123:0/2305607786 wait complete. 2024-09-15T23:12:22.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.036+0000 7fca21ffb640 1 -- 172.21.15.123:0/4204545169 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2586280485 0 0) 0x7fca241634e0 con 0x7fca240d09c0 2024-09-15T23:12:22.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.036+0000 7fca21ffb640 1 -- 172.21.15.123:0/4204545169 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca0c003520 con 0x7fca240d09c0 2024-09-15T23:12:22.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7f884559a640 1 -- 172.21.15.123:0/3653179448 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883c036070 con 0x7f884816bb90 2024-09-15T23:12:22.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7f884559a640 1 -- 172.21.15.123:0/3653179448 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f883c031600 con 0x7f884816bb90 2024-09-15T23:12:22.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7f960a7fc640 1 -- 172.21.15.123:0/891646789 >> v1:172.21.15.188:6789/0 conn(0x7f960c0cdc80 legacy=0x7f960c0b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7f960a7fc640 1 --2- 172.21.15.123:0/891646789 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f95f40039b0 0x7f95f4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7f960a7fc640 1 --2- 172.21.15.123:0/891646789 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95f4004800 0x7f95f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7f960a7fc640 1 --2- 172.21.15.123:0/891646789 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95f40051c0 0x7f95f400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7f960a7fc640 1 -- 172.21.15.123:0/891646789 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f960c0b4000 con 0x7f95f40051c0 2024-09-15T23:12:22.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7f960a7fc640 1 -- 172.21.15.123:0/891646789 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f95f400c0f0 con 0x7f95f4004800 2024-09-15T23:12:22.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7f960a7fc640 1 -- 172.21.15.123:0/891646789 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f95f400c2f0 con 0x7f95f40039b0 2024-09-15T23:12:22.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.035+0000 7fa592ffa640 1 -- 172.21.15.123:0/3395292513 wait complete. 2024-09-15T23:12:22.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7fa592ffa640 1 Processor -- start 2024-09-15T23:12:22.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7fa592ffa640 1 -- start start 2024-09-15T23:12:22.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7fca22ffd640 1 --2- 172.21.15.123:0/4204545169 >> v2:172.21.15.188:3300/0 conn(0x7fca24160800 0x7fca24167340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7fca21ffb640 1 -- 172.21.15.123:0/4204545169 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1492569910 0 0) 0x7fca24160be0 con 0x7fca240b3470 2024-09-15T23:12:22.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7fca21ffb640 1 -- 172.21.15.123:0/4204545169 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca241634e0 con 0x7fca240b3470 2024-09-15T23:12:22.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7fca21ffb640 1 -- 172.21.15.123:0/4204545169 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3134606206 0 0) 0x7fca0c003520 con 0x7fca240d09c0 2024-09-15T23:12:22.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7fca21ffb640 1 -- 172.21.15.123:0/4204545169 >> v2:172.21.15.188:3300/0 conn(0x7fca24160800 msgr2=0x7fca24167340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:22.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7fca21ffb640 1 --2- 172.21.15.123:0/4204545169 >> v2:172.21.15.188:3300/0 conn(0x7fca24160800 0x7fca24167340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7fca21ffb640 1 -- 172.21.15.123:0/4204545169 >> v1:172.21.15.123:6789/0 conn(0x7fca240b3470 legacy=0x7fca240d02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7fca21ffb640 1 -- 172.21.15.123:0/4204545169 --> v1:172.21.15.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca24163aa0 con 0x7fca240d09c0 2024-09-15T23:12:22.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7fca21ffb640 1 -- 172.21.15.123:0/4204545169 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fca1c0019f0 con 0x7fca240d09c0 2024-09-15T23:12:22.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7fca21ffb640 1 -- 172.21.15.123:0/4204545169 >> v1:172.21.15.188:6789/0 conn(0x7fca240d09c0 legacy=0x7fca240b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7fca21ffb640 1 --2- 172.21.15.123:0/4204545169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca0c003b40 0x7fca0c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7fca21ffb640 1 --2- 172.21.15.123:0/4204545169 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca0c004800 0x7fca0c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7fca21ffb640 1 --2- 172.21.15.123:0/4204545169 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fca0c0051c0 0x7fca0c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7fca21ffb640 1 -- 172.21.15.123:0/4204545169 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fca241637c0 con 0x7fca0c003b40 2024-09-15T23:12:22.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7fca21ffb640 1 -- 172.21.15.123:0/4204545169 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fca0c00c0f0 con 0x7fca0c004800 2024-09-15T23:12:22.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7fca21ffb640 1 -- 172.21.15.123:0/4204545169 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fca0c00c2f0 con 0x7fca0c0051c0 2024-09-15T23:12:22.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7f0941776640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f0934054cb0 0x7f093400a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7f0941776640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0934036730 0x7f093404ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7f0941776640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0934039910 con 0x7f09340551b0 2024-09-15T23:12:22.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7f0941776640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f0934039bf0 con 0x7f0934054cb0 2024-09-15T23:12:22.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7f0941776640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0934039ed0 con 0x7f0934036730 2024-09-15T23:12:22.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7f093b7fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f09340551b0 0x7f0934036020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39076/0 (socket says 172.21.15.123:39076) 2024-09-15T23:12:22.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7f093b7fe640 1 -- 172.21.15.123:0/2337131739 learned_addr learned my addr 172.21.15.123:0/2337131739 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:22.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7f884559a640 1 -- 172.21.15.123:0/3653179448 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883c0319d0 con 0x7f884816bb90 2024-09-15T23:12:22.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.038+0000 7fc5c9812640 1 --2- 172.21.15.123:0/3670680522 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5b0004800 0x7fc5b0004c80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4006fd0 tx=0x7fc5b0005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=495b16b350f37a95 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.038+0000 7f884759e640 1 -- 172.21.15.123:0/3653179448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f884816bb90 msgr2=0x7f884806cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.038+0000 7fca237fe640 1 --2- 172.21.15.123:0/4204545169 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fca0c0051c0 0x7fca0c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.037+0000 7f960bfff640 1 --2- 172.21.15.123:0/891646789 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95f40051c0 0x7f95f400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.038+0000 7f960b7fe640 1 --2- 172.21.15.123:0/891646789 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f95f40039b0 0x7f95f4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.038+0000 7f960affd640 1 --2- 172.21.15.123:0/891646789 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95f4004800 0x7f95f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.036+0000 7fdfb8826640 1 -- 172.21.15.123:0/722289699 wait complete. 2024-09-15T23:12:22.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.038+0000 7fdfb8826640 1 Processor -- start 2024-09-15T23:12:22.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.038+0000 7fdfb8826640 1 -- start start 2024-09-15T23:12:22.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.038+0000 7ff7b948b640 1 Processor -- start 2024-09-15T23:12:22.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.038+0000 7fca22ffd640 1 --2- 172.21.15.123:0/4204545169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca0c003b40 0x7fca0c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.038+0000 7fca227fc640 1 --2- 172.21.15.123:0/4204545169 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca0c004800 0x7fca0c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.038+0000 7f884759e640 1 --2- 172.21.15.123:0/3653179448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f884816bb90 0x7f884806cd20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f88480b2d10 tx=0x7f883c02a490 comp rx=0 tx=0).stop 2024-09-15T23:12:22.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.038+0000 7f884759e640 1 -- 172.21.15.123:0/3653179448 shutdown_connections 2024-09-15T23:12:22.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.038+0000 7f884759e640 1 --2- 172.21.15.123:0/3653179448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f884816bb90 0x7f884806cd20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.038+0000 7f884759e640 1 --2- 172.21.15.123:0/3653179448 >> v2:172.21.15.188:3300/0 conn(0x7f8848070c50 0x7f884816b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.038+0000 7f884759e640 1 -- 172.21.15.123:0/3653179448 >> 172.21.15.123:0/3653179448 conn(0x7f88480b1e60 msgr2=0x7f88480b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:22.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.038+0000 7fc5c9011640 1 -- 172.21.15.123:0/3670680522 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4037070 con 0x7fc5b0004800 2024-09-15T23:12:22.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.038+0000 7fc5c9011640 1 -- 172.21.15.123:0/3670680522 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5b402a8f0 con 0x7fc5b0004800 2024-09-15T23:12:22.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.038+0000 7fc5c9011640 1 -- 172.21.15.123:0/3670680522 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4037070 con 0x7fc5b0004800 2024-09-15T23:12:22.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.038+0000 7f093bfff640 1 --2- 172.21.15.123:0/2337131739 >> v2:172.21.15.188:3300/0 conn(0x7f0934054cb0 0x7f093400a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.038+0000 7f960b7fe640 1 -- 172.21.15.123:0/891646789 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95f4004800 msgr2=0x7f95f4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:22.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.038+0000 7f960b7fe640 1 --2- 172.21.15.123:0/891646789 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95f4004800 0x7f95f4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.038+0000 7f960b7fe640 1 -- 172.21.15.123:0/891646789 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95f40051c0 msgr2=0x7f95f400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:22.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.038+0000 7f960b7fe640 1 --2- 172.21.15.123:0/891646789 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95f40051c0 0x7f95f400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.038+0000 7f960b7fe640 1 -- 172.21.15.123:0/891646789 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95f4003520 con 0x7f95f40039b0 2024-09-15T23:12:22.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.039+0000 7fa592ffa640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa58c070c50 0x7fa58c13f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.039+0000 7fa592ffa640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa58c0b2980 0x7fa58c0ca840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.039+0000 7fc5cc277640 1 -- 172.21.15.123:0/3670680522 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5b0004800 msgr2=0x7fc5b0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.039+0000 7fc5cc277640 1 --2- 172.21.15.123:0/3670680522 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5b0004800 0x7fc5b0004c80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4006fd0 tx=0x7fc5b0005830 comp rx=0 tx=0).stop 2024-09-15T23:12:22.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.039+0000 7fa592ffa640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa58c0ccc60 0x7fa58c0cad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.039+0000 7fa592ffa640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa58c06d720 con 0x7fa58c070c50 2024-09-15T23:12:22.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.038+0000 7f884759e640 1 -- 172.21.15.123:0/3653179448 shutdown_connections 2024-09-15T23:12:22.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.038+0000 7f884759e640 1 -- 172.21.15.123:0/3653179448 wait complete. 2024-09-15T23:12:22.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.039+0000 7fa592ffa640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa58c06d5a0 con 0x7fa58c0b2980 2024-09-15T23:12:22.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.038+0000 7fca22ffd640 1 -- 172.21.15.123:0/4204545169 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fca0c0051c0 msgr2=0x7fca0c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:22.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.038+0000 7fca22ffd640 1 --2- 172.21.15.123:0/4204545169 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fca0c0051c0 0x7fca0c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.038+0000 7fca22ffd640 1 -- 172.21.15.123:0/4204545169 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca0c004800 msgr2=0x7fca0c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:22.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.038+0000 7fca22ffd640 1 --2- 172.21.15.123:0/4204545169 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca0c004800 0x7fca0c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.038+0000 7fca22ffd640 1 -- 172.21.15.123:0/4204545169 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca24163aa0 con 0x7fca0c003b40 2024-09-15T23:12:22.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.039+0000 7fa5917f7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa58c0b2980 0x7fa58c0ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.039+0000 7fa5917f7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa58c0b2980 0x7fa58c0ca840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:50768/0 (socket says 172.21.15.123:50768) 2024-09-15T23:12:22.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.039+0000 7fa5917f7640 1 -- 172.21.15.123:0/2351695928 learned_addr learned my addr 172.21.15.123:0/2351695928 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:22.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.039+0000 7fca237fe640 1 -- 172.21.15.123:0/4204545169 reap_dead start 2024-09-15T23:12:22.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.039+0000 7fa592ffa640 1 -- 172.21.15.123:0/2351695928 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa58c06d8a0 con 0x7fa58c0ccc60 2024-09-15T23:12:22.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.038+0000 7ff7b948b640 1 -- start start 2024-09-15T23:12:22.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.039+0000 7fa5927f9640 1 --2- 172.21.15.123:0/2351695928 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa58c0ccc60 0x7fa58c0cad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.039+0000 7fc5ca814640 1 -- 172.21.15.123:0/3670680522 reap_dead start 2024-09-15T23:12:22.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.039+0000 7f0940f75640 1 --2- 172.21.15.123:0/2337131739 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0934036730 0x7f093404ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.039+0000 7f093affd640 1 -- 172.21.15.123:0/2337131739 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2537701391 0 0) 0x7f0934039910 con 0x7f09340551b0 2024-09-15T23:12:22.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.039+0000 7f093affd640 1 -- 172.21.15.123:0/2337131739 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f092c007930 con 0x7f09340551b0 2024-09-15T23:12:22.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.039+0000 7fc5cc277640 1 -- 172.21.15.123:0/3670680522 shutdown_connections 2024-09-15T23:12:22.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.039+0000 7fc5cc277640 1 -- 172.21.15.123:0/3670680522 >> 172.21.15.123:0/3670680522 conn(0x7fc5bc03a510 msgr2=0x7fc5bc03a920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:22.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.039+0000 7fdfb8826640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfac038760 0x7fdfac0da7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7ff7b948b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7b406d770 0x7ff7b414d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7fa5917f7640 1 -- 172.21.15.123:0/2351695928 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa58c0ccc60 msgr2=0x7fa58c0cad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.039+0000 7fdfb8826640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdfac051490 0x7fdfac04e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.039+0000 7fdfb8826640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdfac0e1450 0x7fdfac04ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.039+0000 7fdfb2d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfac038760 0x7fdfac0da7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.039+0000 7fdfb2d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfac038760 0x7fdfac0da7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36270/0 (socket says 172.21.15.123:36270) 2024-09-15T23:12:22.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.039+0000 7fdfb2d9d640 1 -- 172.21.15.123:0/423949007 learned_addr learned my addr 172.21.15.123:0/423949007 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:22.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.039+0000 7fdfb8826640 1 -- 172.21.15.123:0/423949007 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdfac0548b0 con 0x7fdfac038760 2024-09-15T23:12:22.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.039+0000 7fdfb8826640 1 -- 172.21.15.123:0/423949007 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fdfac0525d0 con 0x7fdfac0e1450 2024-09-15T23:12:22.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.039+0000 7fdfb8826640 1 -- 172.21.15.123:0/423949007 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fdfac054a30 con 0x7fdfac051490 2024-09-15T23:12:22.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.039+0000 7fdfb259c640 1 --2- 172.21.15.123:0/423949007 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdfac051490 0x7fdfac04e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7ff7b948b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff7b40ccc60 0x7ff7b40cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7fc5cc277640 1 -- 172.21.15.123:0/3670680522 shutdown_connections 2024-09-15T23:12:22.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7fc5cc277640 1 -- 172.21.15.123:0/3670680522 wait complete. 2024-09-15T23:12:22.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7f960b7fe640 1 --2- 172.21.15.123:0/891646789 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f95f40039b0 0x7f95f4003d90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f960000ba30 tx=0x7f95f4005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4887d4d4f92dd591 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7fdfb359e640 1 --2- 172.21.15.123:0/423949007 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdfac0e1450 0x7fdfac04ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7ff7b948b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7b415a710 0x7ff7b40cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7ff7b948b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b40b2b00 con 0x7ff7b415a710 2024-09-15T23:12:22.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7ff7b948b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b40b2980 con 0x7ff7b406d770 2024-09-15T23:12:22.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7ff7b948b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ff7b40b48d0 con 0x7ff7b40ccc60 2024-09-15T23:12:22.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7ff7b8c8a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7b415a710 0x7ff7b40cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7fa5917f7640 1 --2- 172.21.15.123:0/2351695928 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa58c0ccc60 0x7fa58c0cad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7fa5917f7640 1 -- 172.21.15.123:0/2351695928 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa58c070c50 msgr2=0x7fa58c13f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7fa5917f7640 1 --2- 172.21.15.123:0/2351695928 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa58c070c50 0x7fa58c13f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7fa5917f7640 1 -- 172.21.15.123:0/2351695928 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa58c0cb390 con 0x7fa58c0b2980 2024-09-15T23:12:22.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7fa5927f9640 1 --2- 172.21.15.123:0/2351695928 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa58c0ccc60 0x7fa58c0cad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:22.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7f093affd640 1 -- 172.21.15.123:0/2337131739 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4057725401 0 0) 0x7f092c007930 con 0x7f09340551b0 2024-09-15T23:12:22.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7f093affd640 1 -- 172.21.15.123:0/2337131739 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0934036730 msgr2=0x7f093404ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:22.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7f093affd640 1 --2- 172.21.15.123:0/2337131739 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0934036730 0x7f093404ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7f093affd640 1 -- 172.21.15.123:0/2337131739 >> v2:172.21.15.188:3300/0 conn(0x7f0934054cb0 msgr2=0x7f093400a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:22.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7f093affd640 1 --2- 172.21.15.123:0/2337131739 >> v2:172.21.15.188:3300/0 conn(0x7f0934054cb0 0x7f093400a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7f093affd640 1 -- 172.21.15.123:0/2337131739 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0934039250 con 0x7f09340551b0 2024-09-15T23:12:22.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7f960bfff640 1 -- 172.21.15.123:0/891646789 reap_dead start 2024-09-15T23:12:22.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7f960a7fc640 1 -- 172.21.15.123:0/891646789 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9600030070 con 0x7f95f40039b0 2024-09-15T23:12:22.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7f960a7fc640 1 -- 172.21.15.123:0/891646789 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f960002ae30 con 0x7f95f40039b0 2024-09-15T23:12:22.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7fdfb259c640 1 -- 172.21.15.123:0/423949007 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdfac0e1450 msgr2=0x7fdfac04ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7fdfb259c640 1 --2- 172.21.15.123:0/423949007 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdfac0e1450 0x7fdfac04ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7fdfb259c640 1 -- 172.21.15.123:0/423949007 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfac038760 msgr2=0x7fdfac0da7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7fdfb259c640 1 --2- 172.21.15.123:0/423949007 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfac038760 0x7fdfac0da7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7fdfb259c640 1 -- 172.21.15.123:0/423949007 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfac04f6f0 con 0x7fdfac051490 2024-09-15T23:12:22.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7ff7b3fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7b406d770 0x7ff7b414d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7ff7b8c8a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7b415a710 0x7ff7b40cf7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36274/0 (socket says 172.21.15.123:36274) 2024-09-15T23:12:22.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7ff7b3fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7b406d770 0x7ff7b414d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:50794/0 (socket says 172.21.15.123:50794) 2024-09-15T23:12:22.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7ff7b3fff640 1 -- 172.21.15.123:0/1040877977 learned_addr learned my addr 172.21.15.123:0/1040877977 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:22.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7ff7b37fe640 1 --2- 172.21.15.123:0/1040877977 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff7b40ccc60 0x7ff7b40cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7fa5917f7640 1 --2- 172.21.15.123:0/2351695928 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa58c0b2980 0x7fa58c0ca840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa58400c8e0 tx=0x7fa58400cda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7fa5827fc640 1 -- 172.21.15.123:0/2351695928 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa584017070 con 0x7fa58c0b2980 2024-09-15T23:12:22.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7fca22ffd640 1 --2- 172.21.15.123:0/4204545169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca0c003b40 0x7fca0c003f40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fca1800b9e0 tx=0x7fca0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a7e6d1e7a62d534 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7f884759e640 1 Processor -- start 2024-09-15T23:12:22.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7fa5827fc640 1 -- 172.21.15.123:0/2351695928 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa584005070 con 0x7fa58c0b2980 2024-09-15T23:12:22.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7fa5827fc640 1 -- 172.21.15.123:0/2351695928 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa584003e60 con 0x7fa58c0b2980 2024-09-15T23:12:22.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7f093affd640 1 -- 172.21.15.123:0/2337131739 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f0930001670 con 0x7f09340551b0 2024-09-15T23:12:22.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7f093affd640 1 -- 172.21.15.123:0/2337131739 >> v1:172.21.15.123:6789/0 conn(0x7f09340551b0 legacy=0x7f0934036020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7f093affd640 1 --2- 172.21.15.123:0/2337131739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f092c007e40 0x7f092c008220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7f093affd640 1 --2- 172.21.15.123:0/2337131739 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0934036730 0x7f092c008c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7f093affd640 1 --2- 172.21.15.123:0/2337131739 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f092c009150 0x7f092c0095d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7f093affd640 1 -- 172.21.15.123:0/2337131739 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0934039bf0 con 0x7f092c009150 2024-09-15T23:12:22.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7f093affd640 1 -- 172.21.15.123:0/2337131739 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0934039ed0 con 0x7f092c007e40 2024-09-15T23:12:22.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7f093affd640 1 -- 172.21.15.123:0/2337131739 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f092c00fdd0 con 0x7f0934036730 2024-09-15T23:12:22.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.041+0000 7fca21ffb640 1 -- 172.21.15.123:0/4204545169 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca18030070 con 0x7fca0c003b40 2024-09-15T23:12:22.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.041+0000 7ff7b3fff640 1 -- 172.21.15.123:0/1040877977 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff7b40ccc60 msgr2=0x7ff7b40cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.041+0000 7ff7b3fff640 1 --2- 172.21.15.123:0/1040877977 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff7b40ccc60 0x7ff7b40cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.041+0000 7ff7b3fff640 1 -- 172.21.15.123:0/1040877977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7b415a710 msgr2=0x7ff7b40cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.041+0000 7ff7b3fff640 1 --2- 172.21.15.123:0/1040877977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7b415a710 0x7ff7b40cf7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.041+0000 7ff7b3fff640 1 -- 172.21.15.123:0/1040877977 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b415d3e0 con 0x7ff7b406d770 2024-09-15T23:12:22.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.041+0000 7f093bfff640 1 --2- 172.21.15.123:0/2337131739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f092c007e40 0x7f092c008220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.041+0000 7f0940f75640 1 --2- 172.21.15.123:0/2337131739 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f092c009150 0x7f092c0095d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.041+0000 7ff7b3fff640 1 --2- 172.21.15.123:0/1040877977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7b406d770 0x7ff7b414d990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4009800 tx=0x7ff7a40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.041+0000 7f9610b82640 1 -- 172.21.15.123:0/891646789 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f95f40039b0 msgr2=0x7f95f4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.041+0000 7f960a7fc640 1 -- 172.21.15.123:0/891646789 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9600030070 con 0x7f95f40039b0 2024-09-15T23:12:22.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.041+0000 7f9610b82640 1 --2- 172.21.15.123:0/891646789 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f95f40039b0 0x7f95f4003d90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f960000ba30 tx=0x7f95f4005830 comp rx=0 tx=0).stop 2024-09-15T23:12:22.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.041+0000 7ff7b0ff9640 1 -- 172.21.15.123:0/1040877977 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a402ce60 con 0x7ff7b406d770 2024-09-15T23:12:22.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.042+0000 7ff7b0ff9640 1 -- 172.21.15.123:0/1040877977 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7a4042070 con 0x7ff7b406d770 2024-09-15T23:12:22.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.042+0000 7ff7b0ff9640 1 -- 172.21.15.123:0/1040877977 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4039040 con 0x7ff7b406d770 2024-09-15T23:12:22.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7fa592ffa640 1 -- 172.21.15.123:0/2351695928 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa58c0cb670 con 0x7fa58c0b2980 2024-09-15T23:12:22.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.041+0000 7fa592ffa640 1 -- 172.21.15.123:0/2351695928 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa58c0cbc30 con 0x7fa58c0b2980 2024-09-15T23:12:22.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.041+0000 7fca21ffb640 1 -- 172.21.15.123:0/4204545169 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca1802adc0 con 0x7fca0c003b40 2024-09-15T23:12:22.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.041+0000 7f093bfff640 1 -- 172.21.15.123:0/2337131739 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0934036730 msgr2=0x7f092c008c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:22.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.041+0000 7f093bfff640 1 --2- 172.21.15.123:0/2337131739 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0934036730 0x7f092c008c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.041+0000 7f093bfff640 1 -- 172.21.15.123:0/2337131739 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f092c009150 msgr2=0x7f092c0095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:22.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.041+0000 7fc5cc277640 1 Processor -- start 2024-09-15T23:12:22.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.041+0000 7fc5cc277640 1 -- start start 2024-09-15T23:12:22.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.042+0000 7ff7b948b640 1 -- 172.21.15.123:0/1040877977 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7b414e7e0 con 0x7ff7b406d770 2024-09-15T23:12:22.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.042+0000 7ff7b948b640 1 -- 172.21.15.123:0/1040877977 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7b414eda0 con 0x7ff7b406d770 2024-09-15T23:12:22.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.042+0000 7fca21ffb640 1 -- 172.21.15.123:0/4204545169 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1800b5e0 con 0x7fca0c003b40 2024-09-15T23:12:22.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.040+0000 7f884759e640 1 -- start start 2024-09-15T23:12:22.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.042+0000 7f884759e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f884806d260 0x7f884815e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.042+0000 7f884759e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8848070c50 0x7f88480abc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.042+0000 7f884759e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f884816bb90 0x7f884808b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.042+0000 7f884759e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f88480b4120 con 0x7f8848070c50 2024-09-15T23:12:22.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.042+0000 7f884759e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f88480b3e40 con 0x7f884806d260 2024-09-15T23:12:22.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.042+0000 7f884759e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8848071030 con 0x7f884816bb90 2024-09-15T23:12:22.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.042+0000 7fa592ffa640 1 -- 172.21.15.123:0/2351695928 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa574001030 con 0x7fa58c0b2980 2024-09-15T23:12:22.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.042+0000 7fca29798640 1 -- 172.21.15.123:0/4204545169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca0c003b40 msgr2=0x7fca0c003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.042+0000 7f9610b82640 1 -- 172.21.15.123:0/891646789 shutdown_connections 2024-09-15T23:12:22.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.042+0000 7f9610b82640 1 --2- 172.21.15.123:0/891646789 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f95f40039b0 0x7f95f4003d90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.042+0000 7f093bfff640 1 --2- 172.21.15.123:0/2337131739 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f092c009150 0x7f092c0095d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.042+0000 7f093bfff640 1 -- 172.21.15.123:0/2337131739 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f092c007930 con 0x7f092c007e40 2024-09-15T23:12:22.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.042+0000 7f9610b82640 1 -- 172.21.15.123:0/891646789 >> 172.21.15.123:0/891646789 conn(0x7f960c06c240 msgr2=0x7f960c06d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:22.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.042+0000 7f0940f75640 1 --2- 172.21.15.123:0/2337131739 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f092c009150 0x7f092c0095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:12:22.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.042+0000 7fca29798640 1 --2- 172.21.15.123:0/4204545169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca0c003b40 0x7fca0c003f40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fca1800b9e0 tx=0x7fca0c005830 comp rx=0 tx=0).stop 2024-09-15T23:12:22.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.042+0000 7f9610b82640 1 -- 172.21.15.123:0/891646789 shutdown_connections 2024-09-15T23:12:22.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.042+0000 7fca29798640 1 -- 172.21.15.123:0/4204545169 shutdown_connections 2024-09-15T23:12:22.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.042+0000 7fca29798640 1 --2- 172.21.15.123:0/4204545169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca0c003b40 0x7fca0c003f40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.042+0000 7fca29798640 1 -- 172.21.15.123:0/4204545169 >> 172.21.15.123:0/4204545169 conn(0x7fca2406d0f0 msgr2=0x7fca2406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:22.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.042+0000 7fdfb259c640 1 --2- 172.21.15.123:0/423949007 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdfac051490 0x7fdfac04e1f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4035000 tx=0x7fdfa40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.042+0000 7f884659c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f884806d260 0x7f884815e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.042+0000 7f884659c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f884806d260 0x7f884815e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:50812/0 (socket says 172.21.15.123:50812) 2024-09-15T23:12:22.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.042+0000 7f884659c640 1 -- 172.21.15.123:0/3811890361 learned_addr learned my addr 172.21.15.123:0/3811890361 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:22.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.042+0000 7fca29798640 1 -- 172.21.15.123:0/4204545169 shutdown_connections 2024-09-15T23:12:22.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.042+0000 7fca29798640 1 -- 172.21.15.123:0/4204545169 wait complete. 2024-09-15T23:12:22.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.042+0000 7fdf9b7fe640 1 -- 172.21.15.123:0/423949007 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa403a030 con 0x7fdfac051490 2024-09-15T23:12:22.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.043+0000 7fc5cc277640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc5bc0e4420 0x7fc5bc0ddd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.043+0000 7f9610b82640 1 -- 172.21.15.123:0/891646789 wait complete. 2024-09-15T23:12:22.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.043+0000 7fdfb8826640 1 -- 172.21.15.123:0/423949007 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfac04f9d0 con 0x7fdfac051490 2024-09-15T23:12:22.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.043+0000 7fdfb8826640 1 -- 172.21.15.123:0/423949007 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfac0504b0 con 0x7fdfac051490 2024-09-15T23:12:22.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.043+0000 7fdf9b7fe640 1 -- 172.21.15.123:0/423949007 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa403c070 con 0x7fdfac051490 2024-09-15T23:12:22.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.043+0000 7fc5cc277640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5bc0e4800 0x7fc5bc0de240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.043+0000 7fc5cc277640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5bc0dfe80 0x7fc5bc0e0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.043+0000 7fc5cc277640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc5bc054100 con 0x7fc5bc0dfe80 2024-09-15T23:12:22.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.043+0000 7fc5cc277640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc5bc0582f0 con 0x7fc5bc0e4420 2024-09-15T23:12:22.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.043+0000 7fc5cc277640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc5bc054280 con 0x7fc5bc0e4800 2024-09-15T23:12:22.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.043+0000 7f093bfff640 1 --2- 172.21.15.123:0/2337131739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f092c007e40 0x7f092c008220 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0928009ab0 tx=0x7f092c009c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5760a66db71bc606 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.043+0000 7f093affd640 1 -- 172.21.15.123:0/2337131739 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0928036070 con 0x7f092c007e40 2024-09-15T23:12:22.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.043+0000 7f093affd640 1 -- 172.21.15.123:0/2337131739 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0928005990 con 0x7f092c007e40 2024-09-15T23:12:22.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.043+0000 7ff7b948b640 1 -- 172.21.15.123:0/1040877977 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff7b414e590 con 0x7ff7b406d770 2024-09-15T23:12:22.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.042+0000 7f8845d9b640 1 --2- 172.21.15.123:0/3811890361 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8848070c50 0x7f88480abc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.042+0000 7f8846d9d640 1 --2- 172.21.15.123:0/3811890361 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f884816bb90 0x7f884808b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.043+0000 7f884659c640 1 -- 172.21.15.123:0/3811890361 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f884816bb90 msgr2=0x7f884808b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.043+0000 7f884659c640 1 --2- 172.21.15.123:0/3811890361 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f884816bb90 0x7f884808b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.043+0000 7f884659c640 1 -- 172.21.15.123:0/3811890361 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8848070c50 msgr2=0x7f88480abc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.043+0000 7f884659c640 1 --2- 172.21.15.123:0/3811890361 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8848070c50 0x7f88480abc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.043+0000 7f884659c640 1 -- 172.21.15.123:0/3811890361 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f884815c270 con 0x7f884806d260 2024-09-15T23:12:22.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.043+0000 7f8845d9b640 1 --2- 172.21.15.123:0/3811890361 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8848070c50 0x7f88480abc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:22.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.043+0000 7fc5ca013640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc5bc0e4420 0x7fc5bc0ddd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.043+0000 7fc5ca013640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc5bc0e4420 0x7fc5bc0ddd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:50818/0 (socket says 172.21.15.123:50818) 2024-09-15T23:12:22.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.043+0000 7f093affd640 1 -- 172.21.15.123:0/2337131739 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0928009680 con 0x7f092c007e40 2024-09-15T23:12:22.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.043+0000 7fc5ca013640 1 -- 172.21.15.123:0/358120655 learned_addr learned my addr 172.21.15.123:0/358120655 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:22.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.043+0000 7fc5c9812640 1 --2- 172.21.15.123:0/358120655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5bc0e4800 0x7fc5bc0de240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.044+0000 7f884659c640 1 --2- 172.21.15.123:0/3811890361 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f884806d260 0x7f884815e680 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f883800d830 tx=0x7f883800dcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.043+0000 7fc5ca814640 1 --2- 172.21.15.123:0/358120655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5bc0dfe80 0x7fc5bc0e0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.044+0000 7fc5c9812640 1 -- 172.21.15.123:0/358120655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc5bc0e4420 msgr2=0x7fc5bc0ddd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.044+0000 7fc5c9812640 1 --2- 172.21.15.123:0/358120655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc5bc0e4420 0x7fc5bc0ddd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.044+0000 7fc5c9812640 1 -- 172.21.15.123:0/358120655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5bc0dfe80 msgr2=0x7fc5bc0e0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.044+0000 7f0941776640 1 -- 172.21.15.123:0/2337131739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f092c007e40 msgr2=0x7f092c008220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.044+0000 7f0941776640 1 --2- 172.21.15.123:0/2337131739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f092c007e40 0x7f092c008220 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0928009ab0 tx=0x7f092c009c40 comp rx=0 tx=0).stop 2024-09-15T23:12:22.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.044+0000 7f8836ffd640 1 -- 172.21.15.123:0/3811890361 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883800b6c0 con 0x7f884806d260 2024-09-15T23:12:22.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.044+0000 7f8836ffd640 1 -- 172.21.15.123:0/3811890361 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8838019070 con 0x7f884806d260 2024-09-15T23:12:22.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.044+0000 7f8836ffd640 1 -- 172.21.15.123:0/3811890361 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883800ba80 con 0x7f884806d260 2024-09-15T23:12:22.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.044+0000 7fc5c9812640 1 --2- 172.21.15.123:0/358120655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5bc0dfe80 0x7fc5bc0e0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.044+0000 7fc5c9812640 1 -- 172.21.15.123:0/358120655 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5bc0c8a20 con 0x7fc5bc0e4800 2024-09-15T23:12:22.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.044+0000 7fa5827fc640 1 -- 172.21.15.123:0/2351695928 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa584005420 con 0x7fa58c0b2980 2024-09-15T23:12:22.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.044+0000 7fa5827fc640 1 --2- 172.21.15.123:0/2351695928 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa57006c380 0x7fa57006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.044+0000 7f0940f75640 1 -- 172.21.15.123:0/2337131739 reap_dead start 2024-09-15T23:12:22.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.044+0000 7fa5827fc640 1 -- 172.21.15.123:0/2351695928 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fa58408b3d0 con 0x7fa58c0b2980 2024-09-15T23:12:22.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.045+0000 7fca29798640 1 Processor -- start 2024-09-15T23:12:22.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.045+0000 7f0941776640 1 -- 172.21.15.123:0/2337131739 shutdown_connections 2024-09-15T23:12:22.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.045+0000 7fa5827fc640 1 --2- 172.21.15.123:0/2351695928 >> [v2:172.21.15.123:6824/829220507,v1:172.21.15.123:6825/829220507] conn(0x7fa5700745a0 0x7fa5700769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.045+0000 7fa5827fc640 1 -- 172.21.15.123:0/2351695928 --> [v2:172.21.15.123:6824/829220507,v1:172.21.15.123:6825/829220507] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa570077070 con 0x7fa5700745a0 2024-09-15T23:12:22.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.045+0000 7fa5827fc640 1 -- 172.21.15.123:0/2351695928 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fa58408b7c0 con 0x7fa58c0b2980 2024-09-15T23:12:22.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.045+0000 7fca29798640 1 -- start start 2024-09-15T23:12:22.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.045+0000 7f0941776640 1 -- 172.21.15.123:0/2337131739 >> 172.21.15.123:0/2337131739 conn(0x7f093401d930 msgr2=0x7f09340545a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:22.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.043+0000 7fdf9b7fe640 1 -- 172.21.15.123:0/423949007 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4035d90 con 0x7fdfac051490 2024-09-15T23:12:22.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.045+0000 7f0941776640 1 -- 172.21.15.123:0/2337131739 shutdown_connections 2024-09-15T23:12:22.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.045+0000 7fc5c9812640 1 --2- 172.21.15.123:0/358120655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5bc0e4800 0x7fc5bc0de240 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc5b000c400 tx=0x7fc5b40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.045+0000 7fa5927f9640 1 --2- 172.21.15.123:0/2351695928 >> [v2:172.21.15.123:6824/829220507,v1:172.21.15.123:6825/829220507] conn(0x7fa5700745a0 0x7fa5700769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.045+0000 7fa591ff8640 1 --2- 172.21.15.123:0/2351695928 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa57006c380 0x7fa57006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.045+0000 7f0941776640 1 -- 172.21.15.123:0/2337131739 wait complete. 2024-09-15T23:12:22.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.045+0000 7f9610b82640 1 Processor -- start 2024-09-15T23:12:22.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.045+0000 7ff7b0ff9640 1 -- 172.21.15.123:0/1040877977 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff7a4003810 con 0x7ff7b406d770 2024-09-15T23:12:22.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.045+0000 7f884759e640 1 -- 172.21.15.123:0/3811890361 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f884815c550 con 0x7f884806d260 2024-09-15T23:12:22.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.045+0000 7f884759e640 1 -- 172.21.15.123:0/3811890361 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f884815cb10 con 0x7f884806d260 2024-09-15T23:12:22.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.045+0000 7f9610b82640 1 -- start start 2024-09-15T23:12:22.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.045+0000 7fa5927f9640 1 --2- 172.21.15.123:0/2351695928 >> [v2:172.21.15.123:6824/829220507,v1:172.21.15.123:6825/829220507] conn(0x7fa5700745a0 0x7fa5700769c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.046+0000 7fca29798640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca0c003b40 0x7fca241469a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.046+0000 7fca29798640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fca240c74d0 0x7fca24148380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.046+0000 7ff7b0ff9640 1 --2- 172.21.15.123:0/1040877977 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff7a006c380 0x7ff7a006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.046+0000 7fca29798640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca240c7930 0x7fca241488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.046+0000 7fca29798640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fca240b3890 con 0x7fca240c7930 2024-09-15T23:12:22.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.046+0000 7fca29798640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fca241631f0 con 0x7fca0c003b40 2024-09-15T23:12:22.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.046+0000 7fdfb8826640 1 -- 172.21.15.123:0/423949007 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdf94001030 con 0x7fdfac051490 2024-09-15T23:12:22.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.046+0000 7fca29798640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fca240b3a10 con 0x7fca240c74d0 2024-09-15T23:12:22.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.046+0000 7fca237fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca240c7930 0x7fca241488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.046+0000 7ff7b0ff9640 1 -- 172.21.15.123:0/1040877977 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff7a40ab7d0 con 0x7ff7b406d770 2024-09-15T23:12:22.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.046+0000 7fca237fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca240c7930 0x7fca241488c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36314/0 (socket says 172.21.15.123:36314) 2024-09-15T23:12:22.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.046+0000 7fca237fe640 1 -- 172.21.15.123:0/3901071933 learned_addr learned my addr 172.21.15.123:0/3901071933 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:22.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.046+0000 7ff7b0ff9640 1 --2- 172.21.15.123:0/1040877977 >> [v2:172.21.15.123:6800/256503513,v1:172.21.15.123:6801/256503513] conn(0x7ff7a0074600 0x7ff7a0076a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.046+0000 7ff7b0ff9640 1 -- 172.21.15.123:0/1040877977 --> [v2:172.21.15.123:6800/256503513,v1:172.21.15.123:6801/256503513] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff7a4042e70 con 0x7ff7a0074600 2024-09-15T23:12:22.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.046+0000 7ff7b0ff9640 1 -- 172.21.15.123:0/1040877977 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7ff7a40abbc0 con 0x7ff7b406d770 2024-09-15T23:12:22.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.046+0000 7fca227fc640 1 --2- 172.21.15.123:0/3901071933 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fca240c74d0 0x7fca24148380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.046+0000 7ff7b8c8a640 1 --2- 172.21.15.123:0/1040877977 >> [v2:172.21.15.123:6800/256503513,v1:172.21.15.123:6801/256503513] conn(0x7ff7a0074600 0x7ff7a0076a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.047+0000 7fdf9b7fe640 1 -- 172.21.15.123:0/423949007 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdfa403e070 con 0x7fdfac051490 2024-09-15T23:12:22.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.047+0000 7ff7b37fe640 1 --2- 172.21.15.123:0/1040877977 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff7a006c380 0x7ff7a006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.047+0000 7fa5827fc640 1 -- 172.21.15.123:0/2351695928 <== osd.3 v2:172.21.15.123:6824/829220507 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa570077070 con 0x7fa5700745a0 2024-09-15T23:12:22.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.047+0000 7fca22ffd640 1 --2- 172.21.15.123:0/3901071933 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca0c003b40 0x7fca241469a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.047+0000 7fca227fc640 1 -- 172.21.15.123:0/3901071933 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca0c003b40 msgr2=0x7fca241469a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.047+0000 7fca227fc640 1 --2- 172.21.15.123:0/3901071933 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca0c003b40 0x7fca241469a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.047+0000 7fca227fc640 1 -- 172.21.15.123:0/3901071933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca240c7930 msgr2=0x7fca241488c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.047+0000 7fca227fc640 1 --2- 172.21.15.123:0/3901071933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca240c7930 0x7fca241488c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.047+0000 7fca227fc640 1 -- 172.21.15.123:0/3901071933 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca241f88a0 con 0x7fca240c74d0 2024-09-15T23:12:22.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.047+0000 7fca22ffd640 1 --2- 172.21.15.123:0/3901071933 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca0c003b40 0x7fca241469a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:22.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.047+0000 7f0941776640 1 Processor -- start 2024-09-15T23:12:22.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.046+0000 7fc5ca814640 1 --2- 172.21.15.123:0/358120655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5bc0dfe80 0x7fc5bc0e0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:12:22.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.047+0000 7ff7b8c8a640 1 --2- 172.21.15.123:0/1040877977 >> [v2:172.21.15.123:6800/256503513,v1:172.21.15.123:6801/256503513] conn(0x7ff7a0074600 0x7ff7a0076a20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.047+0000 7f884759e640 1 -- 172.21.15.123:0/3811890361 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f884808cbd0 con 0x7f884806d260 2024-09-15T23:12:22.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.047+0000 7f9610b82640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95f40039b0 0x7f960c140390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.047+0000 7fca227fc640 1 --2- 172.21.15.123:0/3901071933 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fca240c74d0 0x7fca24148380 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fca2402dd50 tx=0x7fca1400e8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.048+0000 7fdf9b7fe640 1 --2- 172.21.15.123:0/423949007 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdfa006c380 0x7fdfa006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.048+0000 7f8836ffd640 1 -- 172.21.15.123:0/3811890361 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f883800bc20 con 0x7f884806d260 2024-09-15T23:12:22.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.048+0000 7f9610b82640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f960c13f4a0 0x7f960c162320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.048+0000 7f9610b82640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f960c1f9590 0x7f960c1f9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.048+0000 7fdf9b7fe640 1 -- 172.21.15.123:0/423949007 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fdfa40ab760 con 0x7fdfac051490 2024-09-15T23:12:22.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.048+0000 7f9610b82640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f960c1497d0 con 0x7f95f40039b0 2024-09-15T23:12:22.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.048+0000 7f9610b82640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f960c0b3c90 con 0x7f960c13f4a0 2024-09-15T23:12:22.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.048+0000 7fdf9b7fe640 1 --2- 172.21.15.123:0/423949007 >> [v2:172.21.15.123:6808/290001388,v1:172.21.15.123:6809/290001388] conn(0x7fdfa0074600 0x7fdfa0076a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.048+0000 7fdfb2d9d640 1 --2- 172.21.15.123:0/423949007 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdfa006c380 0x7fdfa006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.048+0000 7f960bfff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f960c1f9590 0x7f960c1f9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.048+0000 7f8836ffd640 1 --2- 172.21.15.123:0/3811890361 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f882806c2b0 0x7f882806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.048+0000 7fca0b7fe640 1 -- 172.21.15.123:0/3901071933 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca14019070 con 0x7fca240c74d0 2024-09-15T23:12:22.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.048+0000 7fca0b7fe640 1 -- 172.21.15.123:0/3901071933 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca140052e0 con 0x7fca240c74d0 2024-09-15T23:12:22.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.048+0000 7fca0b7fe640 1 -- 172.21.15.123:0/3901071933 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca14003810 con 0x7fca240c74d0 2024-09-15T23:12:22.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.048+0000 7f960b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95f40039b0 0x7f960c140390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.048+0000 7ff7b0ff9640 1 -- 172.21.15.123:0/1040877977 <== osd.2 v2:172.21.15.123:6800/256503513 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff7a4042e70 con 0x7ff7a0074600 2024-09-15T23:12:22.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.048+0000 7f960b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95f40039b0 0x7f960c140390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36324/0 (socket says 172.21.15.123:36324) 2024-09-15T23:12:22.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.048+0000 7f960b7fe640 1 -- 172.21.15.123:0/2045332108 learned_addr learned my addr 172.21.15.123:0/2045332108 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:22.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.048+0000 7f9610b82640 1 -- 172.21.15.123:0/2045332108 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f960c149950 con 0x7f960c1f9590 2024-09-15T23:12:22.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.048+0000 7ff7b37fe640 1 --2- 172.21.15.123:0/1040877977 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff7a006c380 0x7ff7a006e840 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff7b414e4b0 tx=0x7ff7a8007c80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.048+0000 7fca29798640 1 -- 172.21.15.123:0/3901071933 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca241f8b60 con 0x7fca240c74d0 2024-09-15T23:12:22.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.048+0000 7fca29798640 1 -- 172.21.15.123:0/3901071933 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fca241f9120 con 0x7fca240c74d0 2024-09-15T23:12:22.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.048+0000 7fdfb359e640 1 --2- 172.21.15.123:0/423949007 >> [v2:172.21.15.123:6808/290001388,v1:172.21.15.123:6809/290001388] conn(0x7fdfa0074600 0x7fdfa0076a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.049+0000 7f8836ffd640 1 -- 172.21.15.123:0/3811890361 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f883808b970 con 0x7f884806d260 2024-09-15T23:12:22.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.049+0000 7f8845d9b640 1 --2- 172.21.15.123:0/3811890361 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f882806c2b0 0x7f882806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.049+0000 7f8836ffd640 1 --2- 172.21.15.123:0/3811890361 >> [v2:172.21.15.188:6808/1860798982,v1:172.21.15.188:6809/1860798982] conn(0x7f8828074530 0x7f8828076950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.046+0000 7fc5baffd640 1 -- 172.21.15.123:0/358120655 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4037050 con 0x7fc5bc0e4800 2024-09-15T23:12:22.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.046+0000 7fc5baffd640 1 -- 172.21.15.123:0/358120655 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5b4043070 con 0x7fc5bc0e4800 2024-09-15T23:12:22.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.046+0000 7fc5baffd640 1 -- 172.21.15.123:0/358120655 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4009370 con 0x7fc5bc0e4800 2024-09-15T23:12:22.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.046+0000 7fc5cc277640 1 -- 172.21.15.123:0/358120655 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5bc180aa0 con 0x7fc5bc0e4800 2024-09-15T23:12:22.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.046+0000 7fc5cc277640 1 -- 172.21.15.123:0/358120655 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5bc181060 con 0x7fc5bc0e4800 2024-09-15T23:12:22.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.049+0000 7f8836ffd640 1 -- 172.21.15.123:0/3811890361 --> [v2:172.21.15.188:6808/1860798982,v1:172.21.15.188:6809/1860798982] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8828077000 con 0x7f8828074530 2024-09-15T23:12:22.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.049+0000 7f8836ffd640 1 -- 172.21.15.123:0/3811890361 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f88380902a0 con 0x7f884806d260 2024-09-15T23:12:22.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.048+0000 7f0941776640 1 -- start start 2024-09-15T23:12:22.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.049+0000 7f0941776640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f092c007e40 0x7f093417be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.049+0000 7f0941776640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f093404c810 0x7f093404cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.049+0000 7f0941776640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f093404d2b0 0x7f093404d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.049+0000 7f0941776640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0934007280 con 0x7f092c007e40 2024-09-15T23:12:22.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.049+0000 7f0941776640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f093404ef40 con 0x7f093404c810 2024-09-15T23:12:22.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.049+0000 7f0941776640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f093404b5e0 con 0x7f093404d2b0 2024-09-15T23:12:22.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.049+0000 7f960b7fe640 1 -- 172.21.15.123:0/2045332108 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f960c1f9590 msgr2=0x7f960c1f9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.049+0000 7f960b7fe640 1 --2- 172.21.15.123:0/2045332108 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f960c1f9590 0x7f960c1f9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.049+0000 7f093b7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f093404c810 0x7f093404cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.049+0000 7f093b7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f093404c810 0x7f093404cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:50830/0 (socket says 172.21.15.123:50830) 2024-09-15T23:12:22.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.049+0000 7f093b7fe640 1 -- 172.21.15.123:0/2284536813 learned_addr learned my addr 172.21.15.123:0/2284536813 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:22.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.049+0000 7fc5cc277640 1 -- 172.21.15.123:0/358120655 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc5bc005d20 con 0x7fc5bc0e4800 2024-09-15T23:12:22.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.049+0000 7f960b7fe640 1 -- 172.21.15.123:0/2045332108 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f960c13f4a0 msgr2=0x7f960c162320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:12:22.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.049+0000 7f960b7fe640 1 --2- 172.21.15.123:0/2045332108 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f960c13f4a0 0x7f960c162320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.049+0000 7f960b7fe640 1 -- 172.21.15.123:0/2045332108 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f960c1635e0 con 0x7f95f40039b0 2024-09-15T23:12:22.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.050+0000 7f8845d9b640 1 --2- 172.21.15.123:0/3811890361 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f882806c2b0 0x7f882806e770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f883c033000 tx=0x7f883c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.049+0000 7fa591ff8640 1 --2- 172.21.15.123:0/2351695928 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa57006c380 0x7fa57006e840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa588034000 tx=0x7fa58802c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.049+0000 7fdfb359e640 1 --2- 172.21.15.123:0/423949007 >> [v2:172.21.15.123:6808/290001388,v1:172.21.15.123:6809/290001388] conn(0x7fdfa0074600 0x7fdfa0076a20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.050+0000 7fdf9b7fe640 1 -- 172.21.15.123:0/423949007 --> [v2:172.21.15.123:6808/290001388,v1:172.21.15.123:6809/290001388] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdfa4046e50 con 0x7fdfa0074600 2024-09-15T23:12:22.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.050+0000 7f093bfff640 1 --2- 172.21.15.123:0/2284536813 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f092c007e40 0x7f093417be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.050+0000 7fdf9b7fe640 1 -- 172.21.15.123:0/423949007 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fdfa40b2050 con 0x7fdfac051490 2024-09-15T23:12:22.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.050+0000 7fca29798640 1 -- 172.21.15.123:0/3901071933 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fca04001030 con 0x7fca240c74d0 2024-09-15T23:12:22.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.050+0000 7f093bfff640 1 -- 172.21.15.123:0/2284536813 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f093404d2b0 msgr2=0x7f093404d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.050+0000 7f093bfff640 1 --2- 172.21.15.123:0/2284536813 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f093404d2b0 0x7f093404d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.050+0000 7f093bfff640 1 -- 172.21.15.123:0/2284536813 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f093404c810 msgr2=0x7f093404cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.050+0000 7f093bfff640 1 --2- 172.21.15.123:0/2284536813 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f093404c810 0x7f093404cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.050+0000 7f093bfff640 1 -- 172.21.15.123:0/2284536813 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f093404b8c0 con 0x7f092c007e40 2024-09-15T23:12:22.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.050+0000 7f8846d9d640 1 --2- 172.21.15.123:0/3811890361 >> [v2:172.21.15.188:6808/1860798982,v1:172.21.15.188:6809/1860798982] conn(0x7f8828074530 0x7f8828076950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.051+0000 7fc5baffd640 1 -- 172.21.15.123:0/358120655 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc5b4048460 con 0x7fc5bc0e4800 2024-09-15T23:12:22.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.051+0000 7f093bfff640 1 --2- 172.21.15.123:0/2284536813 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f092c007e40 0x7f093417be80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0928006000 tx=0x7f0928004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.051+0000 7fdfb2d9d640 1 --2- 172.21.15.123:0/423949007 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdfa006c380 0x7fdfa006e840 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdfb406a530 tx=0x7fdfb408cf90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.051+0000 7f0938ff9640 1 -- 172.21.15.123:0/2284536813 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0928041020 con 0x7f092c007e40 2024-09-15T23:12:22.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.051+0000 7f0938ff9640 1 -- 172.21.15.123:0/2284536813 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0928037040 con 0x7f092c007e40 2024-09-15T23:12:22.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.051+0000 7f0938ff9640 1 -- 172.21.15.123:0/2284536813 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0928036070 con 0x7f092c007e40 2024-09-15T23:12:22.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.051+0000 7fdf9b7fe640 1 -- 172.21.15.123:0/423949007 <== osd.1 v2:172.21.15.123:6808/290001388 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdfa4046e50 con 0x7fdfa0074600 2024-09-15T23:12:22.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.051+0000 7fc5baffd640 1 --2- 172.21.15.123:0/358120655 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc5a806c330 0x7fc5a806e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.051+0000 7fc5baffd640 1 -- 172.21.15.123:0/358120655 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc5b40ab700 con 0x7fc5bc0e4800 2024-09-15T23:12:22.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.051+0000 7fca0b7fe640 1 -- 172.21.15.123:0/3901071933 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fca1401c070 con 0x7fca240c74d0 2024-09-15T23:12:22.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.052+0000 7fc5baffd640 1 --2- 172.21.15.123:0/358120655 >> [v2:172.21.15.188:6826/1725565174,v1:172.21.15.188:6827/1725565174] conn(0x7fc5a8074530 0x7fc5a8076950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.052+0000 7fc5baffd640 1 -- 172.21.15.123:0/358120655 --> [v2:172.21.15.188:6826/1725565174,v1:172.21.15.188:6827/1725565174] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc5b4040e50 con 0x7fc5a8074530 2024-09-15T23:12:22.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.052+0000 7fc5ca814640 1 --2- 172.21.15.123:0/358120655 >> [v2:172.21.15.188:6826/1725565174,v1:172.21.15.188:6827/1725565174] conn(0x7fc5a8074530 0x7fc5a8076950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.052+0000 7fc5baffd640 1 -- 172.21.15.123:0/358120655 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fc5b40b2050 con 0x7fc5bc0e4800 2024-09-15T23:12:22.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.051+0000 7f960b7fe640 1 --2- 172.21.15.123:0/2045332108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95f40039b0 0x7f960c140390 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f960002a920 tx=0x7f9600004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.051+0000 7f95f3fff640 1 -- 172.21.15.123:0/2045332108 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9600043020 con 0x7f95f40039b0 2024-09-15T23:12:22.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.051+0000 7f95f3fff640 1 -- 172.21.15.123:0/2045332108 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f960003f680 con 0x7f95f40039b0 2024-09-15T23:12:22.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.051+0000 7f95f3fff640 1 -- 172.21.15.123:0/2045332108 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9600043020 con 0x7f95f40039b0 2024-09-15T23:12:22.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.052+0000 7f9610b82640 1 -- 172.21.15.123:0/2045332108 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f960c1638c0 con 0x7f95f40039b0 2024-09-15T23:12:22.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.052+0000 7f0941776640 1 -- 172.21.15.123:0/2284536813 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f093404bba0 con 0x7f092c007e40 2024-09-15T23:12:22.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.052+0000 7f0941776640 1 -- 172.21.15.123:0/2284536813 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f093404c160 con 0x7f092c007e40 2024-09-15T23:12:22.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.052+0000 7f9610b82640 1 -- 172.21.15.123:0/2045332108 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f960c163e80 con 0x7f95f40039b0 2024-09-15T23:12:22.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.052+0000 7fca0b7fe640 1 --2- 172.21.15.123:0/3901071933 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fca1006c3b0 0x7fca1006e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.052+0000 7fca0b7fe640 1 -- 172.21.15.123:0/3901071933 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fca1408a820 con 0x7fca240c74d0 2024-09-15T23:12:22.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.052+0000 7fca0b7fe640 1 --2- 172.21.15.123:0/3901071933 >> [v2:172.21.15.188:6800/3901678408,v1:172.21.15.188:6801/3901678408] conn(0x7fca10074550 0x7fca10076970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.052+0000 7fca0b7fe640 1 -- 172.21.15.123:0/3901071933 --> [v2:172.21.15.188:6800/3901678408,v1:172.21.15.188:6801/3901678408] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca14011e50 con 0x7fca10074550 2024-09-15T23:12:22.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.052+0000 7fca22ffd640 1 --2- 172.21.15.123:0/3901071933 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fca1006c3b0 0x7fca1006e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.053+0000 7f8846d9d640 1 --2- 172.21.15.123:0/3811890361 >> [v2:172.21.15.188:6808/1860798982,v1:172.21.15.188:6809/1860798982] conn(0x7f8828074530 0x7f8828076950 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.053+0000 7fca237fe640 1 --2- 172.21.15.123:0/3901071933 >> [v2:172.21.15.188:6800/3901678408,v1:172.21.15.188:6801/3901678408] conn(0x7fca10074550 0x7fca10076970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.053+0000 7fca0b7fe640 1 -- 172.21.15.123:0/3901071933 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fca14054c50 con 0x7fca240c74d0 2024-09-15T23:12:22.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.053+0000 7fca237fe640 1 --2- 172.21.15.123:0/3901071933 >> [v2:172.21.15.188:6800/3901678408,v1:172.21.15.188:6801/3901678408] conn(0x7fca10074550 0x7fca10076970 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.053+0000 7fc5ca814640 1 --2- 172.21.15.123:0/358120655 >> [v2:172.21.15.188:6826/1725565174,v1:172.21.15.188:6827/1725565174] conn(0x7fc5a8074530 0x7fc5a8076950 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.053+0000 7fc5ca013640 1 --2- 172.21.15.123:0/358120655 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc5a806c330 0x7fc5a806e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.054+0000 7f8836ffd640 1 -- 172.21.15.123:0/3811890361 <== osd.5 v2:172.21.15.188:6808/1860798982 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8828077000 con 0x7f8828074530 2024-09-15T23:12:22.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.053+0000 7fc5ca013640 1 --2- 172.21.15.123:0/358120655 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc5a806c330 0x7fc5a806e7f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc5c4075fa0 tx=0x7fc5c406e040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.054+0000 7f0941776640 1 -- 172.21.15.123:0/2284536813 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0934039910 con 0x7f092c007e40 2024-09-15T23:12:22.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.054+0000 7fc5baffd640 1 -- 172.21.15.123:0/358120655 <== osd.7 v2:172.21.15.188:6826/1725565174 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc5b4040e50 con 0x7fc5a8074530 2024-09-15T23:12:22.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.054+0000 7f9610b82640 1 -- 172.21.15.123:0/2045332108 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f960c164260 con 0x7f95f40039b0 2024-09-15T23:12:22.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.055+0000 7fca0b7fe640 1 -- 172.21.15.123:0/3901071933 <== osd.4 v2:172.21.15.188:6800/3901678408 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fca14011e50 con 0x7fca10074550 2024-09-15T23:12:22.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.055+0000 7f95f3fff640 1 -- 172.21.15.123:0/2045332108 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9600046020 con 0x7f95f40039b0 2024-09-15T23:12:22.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.055+0000 7f95f3fff640 1 --2- 172.21.15.123:0/2045332108 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f95f806c6b0 0x7f95f806eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.056+0000 7f95f3fff640 1 -- 172.21.15.123:0/2045332108 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f960002ac30 con 0x7f95f40039b0 2024-09-15T23:12:22.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.056+0000 7f95f3fff640 1 --2- 172.21.15.123:0/2045332108 >> [v2:172.21.15.123:6816/2610756058,v1:172.21.15.123:6817/2610756058] conn(0x7f95f80753e0 0x7f95f8077880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.056+0000 7f95f3fff640 1 -- 172.21.15.123:0/2045332108 --> [v2:172.21.15.123:6816/2610756058,v1:172.21.15.123:6817/2610756058] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f95f8077f50 con 0x7f95f80753e0 2024-09-15T23:12:22.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.056+0000 7f960bfff640 1 --2- 172.21.15.123:0/2045332108 >> [v2:172.21.15.123:6816/2610756058,v1:172.21.15.123:6817/2610756058] conn(0x7f95f80753e0 0x7f95f8077880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.056+0000 7f95f3fff640 1 -- 172.21.15.123:0/2045332108 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f96000766d0 con 0x7f95f40039b0 2024-09-15T23:12:22.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.055+0000 7f0938ff9640 1 -- 172.21.15.123:0/2284536813 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0928044020 con 0x7f092c007e40 2024-09-15T23:12:22.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.056+0000 7f960affd640 1 --2- 172.21.15.123:0/2045332108 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f95f806c6b0 0x7f95f806eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.056+0000 7f0938ff9640 1 --2- 172.21.15.123:0/2284536813 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f092006c380 0x7f092006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.056+0000 7f0938ff9640 1 -- 172.21.15.123:0/2284536813 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f09280abf60 con 0x7f092c007e40 2024-09-15T23:12:22.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.056+0000 7f0938ff9640 1 --2- 172.21.15.123:0/2284536813 >> [v2:172.21.15.188:6816/226100332,v1:172.21.15.188:6817/226100332] conn(0x7f0920074600 0x7f0920076a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.057+0000 7f0938ff9640 1 -- 172.21.15.123:0/2284536813 --> [v2:172.21.15.188:6816/226100332,v1:172.21.15.188:6817/226100332] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f092800e020 con 0x7f0920074600 2024-09-15T23:12:22.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.057+0000 7f0938ff9640 1 -- 172.21.15.123:0/2284536813 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f09280ac350 con 0x7f092c007e40 2024-09-15T23:12:22.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.057+0000 7f960bfff640 1 --2- 172.21.15.123:0/2045332108 >> [v2:172.21.15.123:6816/2610756058,v1:172.21.15.123:6817/2610756058] conn(0x7f95f80753e0 0x7f95f8077880 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.056+0000 7fca22ffd640 1 --2- 172.21.15.123:0/3901071933 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fca1006c3b0 0x7fca1006e870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fca0c0057e0 tx=0x7fca18030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.057+0000 7f0940f75640 1 --2- 172.21.15.123:0/2284536813 >> [v2:172.21.15.188:6816/226100332,v1:172.21.15.188:6817/226100332] conn(0x7f0920074600 0x7f0920076a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.057+0000 7f093b7fe640 1 --2- 172.21.15.123:0/2284536813 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f092006c380 0x7f092006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.058+0000 7f0940f75640 1 --2- 172.21.15.123:0/2284536813 >> [v2:172.21.15.188:6816/226100332,v1:172.21.15.188:6817/226100332] conn(0x7f0920074600 0x7f0920076a20 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.058+0000 7f093b7fe640 1 --2- 172.21.15.123:0/2284536813 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f092006c380 0x7f092006e840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0930005fd0 tx=0x7f0930001c50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.057+0000 7f960affd640 1 --2- 172.21.15.123:0/2045332108 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f95f806c6b0 0x7f95f806eb70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f960c13e180 tx=0x7f95fc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.058+0000 7f95f3fff640 1 -- 172.21.15.123:0/2045332108 <== osd.0 v2:172.21.15.123:6816/2610756058 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f95f8077f50 con 0x7f95f80753e0 2024-09-15T23:12:22.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.058+0000 7f0938ff9640 1 -- 172.21.15.123:0/2284536813 <== osd.6 v2:172.21.15.188:6816/226100332 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f092800e020 con 0x7f0920074600 2024-09-15T23:12:22.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.075+0000 7fa592ffa640 1 -- 172.21.15.123:0/2351695928 --> [v2:172.21.15.123:6824/829220507,v1:172.21.15.123:6825/829220507] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa574002d50 con 0x7fa5700745a0 2024-09-15T23:12:22.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.075+0000 7fa5827fc640 1 -- 172.21.15.123:0/2351695928 <== osd.3 v2:172.21.15.123:6824/829220507 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa574002d50 con 0x7fa5700745a0 2024-09-15T23:12:22.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.076+0000 7fa592ffa640 1 -- 172.21.15.123:0/2351695928 >> [v2:172.21.15.123:6824/829220507,v1:172.21.15.123:6825/829220507] conn(0x7fa5700745a0 msgr2=0x7fa5700769c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.076+0000 7fa592ffa640 1 --2- 172.21.15.123:0/2351695928 >> [v2:172.21.15.123:6824/829220507,v1:172.21.15.123:6825/829220507] conn(0x7fa5700745a0 0x7fa5700769c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.076+0000 7fa592ffa640 1 -- 172.21.15.123:0/2351695928 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa57006c380 msgr2=0x7fa57006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.076+0000 7fa592ffa640 1 --2- 172.21.15.123:0/2351695928 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa57006c380 0x7fa57006e840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa588034000 tx=0x7fa58802c000 comp rx=0 tx=0).stop 2024-09-15T23:12:22.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.076+0000 7fa592ffa640 1 -- 172.21.15.123:0/2351695928 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa58c0b2980 msgr2=0x7fa58c0ca840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.076+0000 7fa592ffa640 1 --2- 172.21.15.123:0/2351695928 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa58c0b2980 0x7fa58c0ca840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa58400c8e0 tx=0x7fa58400cda0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.076+0000 7fa5927f9640 1 -- 172.21.15.123:0/2351695928 reap_dead start 2024-09-15T23:12:22.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.077+0000 7fa592ffa640 1 -- 172.21.15.123:0/2351695928 shutdown_connections 2024-09-15T23:12:22.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.077+0000 7fa592ffa640 1 -- 172.21.15.123:0/2351695928 >> 172.21.15.123:0/2351695928 conn(0x7fa58c0b1e60 msgr2=0x7fa58c15a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:22.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.077+0000 7fa592ffa640 1 -- 172.21.15.123:0/2351695928 shutdown_connections 2024-09-15T23:12:22.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.077+0000 7fa592ffa640 1 -- 172.21.15.123:0/2351695928 wait complete. 2024-09-15T23:12:22.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.079+0000 7fdfb8826640 1 -- 172.21.15.123:0/423949007 --> [v2:172.21.15.123:6808/290001388,v1:172.21.15.123:6809/290001388] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdf94002dd0 con 0x7fdfa0074600 2024-09-15T23:12:22.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.080+0000 7fdf9b7fe640 1 -- 172.21.15.123:0/423949007 <== osd.1 v2:172.21.15.123:6808/290001388 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdf94002dd0 con 0x7fdfa0074600 2024-09-15T23:12:22.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.080+0000 7fdf997fa640 1 -- 172.21.15.123:0/423949007 >> [v2:172.21.15.123:6808/290001388,v1:172.21.15.123:6809/290001388] conn(0x7fdfa0074600 msgr2=0x7fdfa0076a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.080+0000 7fdf997fa640 1 --2- 172.21.15.123:0/423949007 >> [v2:172.21.15.123:6808/290001388,v1:172.21.15.123:6809/290001388] conn(0x7fdfa0074600 0x7fdfa0076a20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.080+0000 7fdf997fa640 1 -- 172.21.15.123:0/423949007 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdfa006c380 msgr2=0x7fdfa006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.080+0000 7fdf997fa640 1 --2- 172.21.15.123:0/423949007 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdfa006c380 0x7fdfa006e840 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdfb406a530 tx=0x7fdfb408cf90 comp rx=0 tx=0).stop 2024-09-15T23:12:22.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.081+0000 7fdf997fa640 1 -- 172.21.15.123:0/423949007 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdfac051490 msgr2=0x7fdfac04e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.081+0000 7fdf997fa640 1 --2- 172.21.15.123:0/423949007 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdfac051490 0x7fdfac04e1f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4035000 tx=0x7fdfa40046c0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.081+0000 7fdfb359e640 1 -- 172.21.15.123:0/423949007 reap_dead start 2024-09-15T23:12:22.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.081+0000 7fdf997fa640 1 -- 172.21.15.123:0/423949007 shutdown_connections 2024-09-15T23:12:22.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.081+0000 7fdf997fa640 1 -- 172.21.15.123:0/423949007 >> 172.21.15.123:0/423949007 conn(0x7fdfac0567a0 msgr2=0x7fdfac009220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:22.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.081+0000 7ff7b948b640 1 -- 172.21.15.123:0/1040877977 --> [v2:172.21.15.123:6800/256503513,v1:172.21.15.123:6801/256503513] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff7b40714b0 con 0x7ff7a0074600 2024-09-15T23:12:22.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.082+0000 7ff7b0ff9640 1 -- 172.21.15.123:0/1040877977 <== osd.2 v2:172.21.15.123:6800/256503513 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff7b40714b0 con 0x7ff7a0074600 2024-09-15T23:12:22.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.081+0000 7fdf997fa640 1 -- 172.21.15.123:0/423949007 shutdown_connections 2024-09-15T23:12:22.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.081+0000 7fdf997fa640 1 -- 172.21.15.123:0/423949007 wait complete. 2024-09-15T23:12:22.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.083+0000 7ff7b948b640 1 -- 172.21.15.123:0/1040877977 >> [v2:172.21.15.123:6800/256503513,v1:172.21.15.123:6801/256503513] conn(0x7ff7a0074600 msgr2=0x7ff7a0076a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.083+0000 7ff7b948b640 1 --2- 172.21.15.123:0/1040877977 >> [v2:172.21.15.123:6800/256503513,v1:172.21.15.123:6801/256503513] conn(0x7ff7a0074600 0x7ff7a0076a20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.083+0000 7ff7b948b640 1 -- 172.21.15.123:0/1040877977 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff7a006c380 msgr2=0x7ff7a006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.083+0000 7ff7b948b640 1 --2- 172.21.15.123:0/1040877977 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff7a006c380 0x7ff7a006e840 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff7b414e4b0 tx=0x7ff7a8007c80 comp rx=0 tx=0).stop 2024-09-15T23:12:22.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.083+0000 7ff7b948b640 1 -- 172.21.15.123:0/1040877977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7b406d770 msgr2=0x7ff7b414d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.083+0000 7ff7b948b640 1 --2- 172.21.15.123:0/1040877977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7b406d770 0x7ff7b414d990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4009800 tx=0x7ff7a40046c0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.083+0000 7ff7b8c8a640 1 -- 172.21.15.123:0/1040877977 reap_dead start 2024-09-15T23:12:22.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.084+0000 7f884759e640 1 -- 172.21.15.123:0/3811890361 --> [v2:172.21.15.188:6808/1860798982,v1:172.21.15.188:6809/1860798982] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f884816e120 con 0x7f8828074530 2024-09-15T23:12:22.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.084+0000 7ff7b948b640 1 -- 172.21.15.123:0/1040877977 shutdown_connections 2024-09-15T23:12:22.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.084+0000 7ff7b948b640 1 -- 172.21.15.123:0/1040877977 >> 172.21.15.123:0/1040877977 conn(0x7ff7b40b1e60 msgr2=0x7ff7b40b0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:22.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.084+0000 7ff7b948b640 1 -- 172.21.15.123:0/1040877977 shutdown_connections 2024-09-15T23:12:22.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.084+0000 7ff7b948b640 1 -- 172.21.15.123:0/1040877977 wait complete. 2024-09-15T23:12:22.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.084+0000 7fc5cc277640 1 -- 172.21.15.123:0/358120655 --> [v2:172.21.15.188:6826/1725565174,v1:172.21.15.188:6827/1725565174] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc5bc053e60 con 0x7fc5a8074530 2024-09-15T23:12:22.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.084+0000 7f8836ffd640 1 -- 172.21.15.123:0/3811890361 <== osd.5 v2:172.21.15.188:6808/1860798982 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f884816e120 con 0x7f8828074530 2024-09-15T23:12:22.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.084+0000 7fc5baffd640 1 -- 172.21.15.123:0/358120655 <== osd.7 v2:172.21.15.188:6826/1725565174 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc5bc053e60 con 0x7fc5a8074530 2024-09-15T23:12:22.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.085+0000 7fc5b8ff9640 1 -- 172.21.15.123:0/358120655 >> [v2:172.21.15.188:6826/1725565174,v1:172.21.15.188:6827/1725565174] conn(0x7fc5a8074530 msgr2=0x7fc5a8076950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.085+0000 7fc5b8ff9640 1 --2- 172.21.15.123:0/358120655 >> [v2:172.21.15.188:6826/1725565174,v1:172.21.15.188:6827/1725565174] conn(0x7fc5a8074530 0x7fc5a8076950 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.086+0000 7fca29798640 1 -- 172.21.15.123:0/3901071933 --> [v2:172.21.15.188:6800/3901678408,v1:172.21.15.188:6801/3901678408] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fca04002dd0 con 0x7fca10074550 2024-09-15T23:12:22.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.085+0000 7f884759e640 1 -- 172.21.15.123:0/3811890361 >> [v2:172.21.15.188:6808/1860798982,v1:172.21.15.188:6809/1860798982] conn(0x7f8828074530 msgr2=0x7f8828076950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.085+0000 7f884759e640 1 --2- 172.21.15.123:0/3811890361 >> [v2:172.21.15.188:6808/1860798982,v1:172.21.15.188:6809/1860798982] conn(0x7f8828074530 0x7f8828076950 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.085+0000 7f884759e640 1 -- 172.21.15.123:0/3811890361 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f882806c2b0 msgr2=0x7f882806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.085+0000 7f884759e640 1 --2- 172.21.15.123:0/3811890361 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f882806c2b0 0x7f882806e770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f883c033000 tx=0x7f883c008030 comp rx=0 tx=0).stop 2024-09-15T23:12:22.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.085+0000 7f884759e640 1 -- 172.21.15.123:0/3811890361 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f884806d260 msgr2=0x7f884815e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.085+0000 7f884759e640 1 --2- 172.21.15.123:0/3811890361 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f884806d260 0x7f884815e680 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f883800d830 tx=0x7f883800dcf0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.086+0000 7f8846d9d640 1 -- 172.21.15.123:0/3811890361 reap_dead start 2024-09-15T23:12:22.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.085+0000 7fc5b8ff9640 1 -- 172.21.15.123:0/358120655 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc5a806c330 msgr2=0x7fc5a806e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.085+0000 7fc5b8ff9640 1 --2- 172.21.15.123:0/358120655 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc5a806c330 0x7fc5a806e7f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc5c4075fa0 tx=0x7fc5c406e040 comp rx=0 tx=0).stop 2024-09-15T23:12:22.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.085+0000 7fc5b8ff9640 1 -- 172.21.15.123:0/358120655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5bc0e4800 msgr2=0x7fc5bc0de240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.085+0000 7fc5b8ff9640 1 --2- 172.21.15.123:0/358120655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5bc0e4800 0x7fc5bc0de240 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc5b000c400 tx=0x7fc5b40046c0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.085+0000 7fc5ca814640 1 -- 172.21.15.123:0/358120655 reap_dead start 2024-09-15T23:12:22.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.086+0000 7f884759e640 1 -- 172.21.15.123:0/3811890361 shutdown_connections 2024-09-15T23:12:22.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.086+0000 7f884759e640 1 -- 172.21.15.123:0/3811890361 >> 172.21.15.123:0/3811890361 conn(0x7f88480b1e60 msgr2=0x7f88480b2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:22.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.086+0000 7f884759e640 1 -- 172.21.15.123:0/3811890361 shutdown_connections 2024-09-15T23:12:22.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.086+0000 7fc5b8ff9640 1 -- 172.21.15.123:0/358120655 shutdown_connections 2024-09-15T23:12:22.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.086+0000 7fc5b8ff9640 1 -- 172.21.15.123:0/358120655 >> 172.21.15.123:0/358120655 conn(0x7fc5bc03a510 msgr2=0x7fc5bc038a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:22.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.086+0000 7f884759e640 1 -- 172.21.15.123:0/3811890361 wait complete. 2024-09-15T23:12:22.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.086+0000 7fc5b8ff9640 1 -- 172.21.15.123:0/358120655 shutdown_connections 2024-09-15T23:12:22.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.086+0000 7fc5b8ff9640 1 -- 172.21.15.123:0/358120655 wait complete. 2024-09-15T23:12:22.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.086+0000 7fca0b7fe640 1 -- 172.21.15.123:0/3901071933 <== osd.4 v2:172.21.15.188:6800/3901678408 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fca04002dd0 con 0x7fca10074550 2024-09-15T23:12:22.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.087+0000 7f9610b82640 1 -- 172.21.15.123:0/2045332108 --> [v2:172.21.15.123:6816/2610756058,v1:172.21.15.123:6817/2610756058] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f960c069400 con 0x7f95f80753e0 2024-09-15T23:12:22.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.087+0000 7f95f3fff640 1 -- 172.21.15.123:0/2045332108 <== osd.0 v2:172.21.15.123:6816/2610756058 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f960c069400 con 0x7f95f80753e0 2024-09-15T23:12:22.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.088+0000 7f0941776640 1 -- 172.21.15.123:0/2284536813 --> [v2:172.21.15.188:6816/226100332,v1:172.21.15.188:6817/226100332] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0934039910 con 0x7f0920074600 2024-09-15T23:12:22.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.088+0000 7f0938ff9640 1 -- 172.21.15.123:0/2284536813 <== osd.6 v2:172.21.15.188:6816/226100332 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0934039910 con 0x7f0920074600 2024-09-15T23:12:22.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.088+0000 7f95f1ffb640 1 -- 172.21.15.123:0/2045332108 >> [v2:172.21.15.123:6816/2610756058,v1:172.21.15.123:6817/2610756058] conn(0x7f95f80753e0 msgr2=0x7f95f8077880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.088+0000 7f95f1ffb640 1 --2- 172.21.15.123:0/2045332108 >> [v2:172.21.15.123:6816/2610756058,v1:172.21.15.123:6817/2610756058] conn(0x7f95f80753e0 0x7f95f8077880 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.088+0000 7fca29798640 1 -- 172.21.15.123:0/3901071933 >> [v2:172.21.15.188:6800/3901678408,v1:172.21.15.188:6801/3901678408] conn(0x7fca10074550 msgr2=0x7fca10076970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.088+0000 7fca29798640 1 --2- 172.21.15.123:0/3901071933 >> [v2:172.21.15.188:6800/3901678408,v1:172.21.15.188:6801/3901678408] conn(0x7fca10074550 0x7fca10076970 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.089+0000 7fca29798640 1 -- 172.21.15.123:0/3901071933 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fca1006c3b0 msgr2=0x7fca1006e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.089+0000 7fca29798640 1 --2- 172.21.15.123:0/3901071933 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fca1006c3b0 0x7fca1006e870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fca0c0057e0 tx=0x7fca18030000 comp rx=0 tx=0).stop 2024-09-15T23:12:22.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.089+0000 7fca29798640 1 -- 172.21.15.123:0/3901071933 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fca240c74d0 msgr2=0x7fca24148380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.089+0000 7fca29798640 1 --2- 172.21.15.123:0/3901071933 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fca240c74d0 0x7fca24148380 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fca2402dd50 tx=0x7fca1400e8a0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.088+0000 7f95f1ffb640 1 -- 172.21.15.123:0/2045332108 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f95f806c6b0 msgr2=0x7f95f806eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.088+0000 7f95f1ffb640 1 --2- 172.21.15.123:0/2045332108 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f95f806c6b0 0x7f95f806eb70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f960c13e180 tx=0x7f95fc008040 comp rx=0 tx=0).stop 2024-09-15T23:12:22.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.088+0000 7f95f1ffb640 1 -- 172.21.15.123:0/2045332108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95f40039b0 msgr2=0x7f960c140390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.088+0000 7f95f1ffb640 1 --2- 172.21.15.123:0/2045332108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95f40039b0 0x7f960c140390 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f960002a920 tx=0x7f9600004730 comp rx=0 tx=0).stop 2024-09-15T23:12:22.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.089+0000 7fca237fe640 1 -- 172.21.15.123:0/3901071933 reap_dead start 2024-09-15T23:12:22.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.089+0000 7f960bfff640 1 -- 172.21.15.123:0/2045332108 reap_dead start 2024-09-15T23:12:22.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.089+0000 7f95f1ffb640 1 -- 172.21.15.123:0/2045332108 shutdown_connections 2024-09-15T23:12:22.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.089+0000 7f95f1ffb640 1 -- 172.21.15.123:0/2045332108 >> 172.21.15.123:0/2045332108 conn(0x7f960c06c240 msgr2=0x7f960c0b6100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:22.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.089+0000 7fca29798640 1 -- 172.21.15.123:0/3901071933 shutdown_connections 2024-09-15T23:12:22.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.089+0000 7fca29798640 1 -- 172.21.15.123:0/3901071933 >> 172.21.15.123:0/3901071933 conn(0x7fca2406d0f0 msgr2=0x7fca24161b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:22.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.089+0000 7f95f1ffb640 1 -- 172.21.15.123:0/2045332108 shutdown_connections 2024-09-15T23:12:22.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.089+0000 7fca29798640 1 -- 172.21.15.123:0/3901071933 shutdown_connections 2024-09-15T23:12:22.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.089+0000 7f09267fc640 1 -- 172.21.15.123:0/2284536813 >> [v2:172.21.15.188:6816/226100332,v1:172.21.15.188:6817/226100332] conn(0x7f0920074600 msgr2=0x7f0920076a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.089+0000 7fca29798640 1 -- 172.21.15.123:0/3901071933 wait complete. 2024-09-15T23:12:22.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.089+0000 7f09267fc640 1 --2- 172.21.15.123:0/2284536813 >> [v2:172.21.15.188:6816/226100332,v1:172.21.15.188:6817/226100332] conn(0x7f0920074600 0x7f0920076a20 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.089+0000 7f09267fc640 1 -- 172.21.15.123:0/2284536813 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f092006c380 msgr2=0x7f092006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.089+0000 7f09267fc640 1 --2- 172.21.15.123:0/2284536813 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f092006c380 0x7f092006e840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0930005fd0 tx=0x7f0930001c50 comp rx=0 tx=0).stop 2024-09-15T23:12:22.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.089+0000 7f95f1ffb640 1 -- 172.21.15.123:0/2045332108 wait complete. 2024-09-15T23:12:22.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.090+0000 7f09267fc640 1 -- 172.21.15.123:0/2284536813 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f092c007e40 msgr2=0x7f093417be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.090+0000 7f09267fc640 1 --2- 172.21.15.123:0/2284536813 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f092c007e40 0x7f093417be80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0928006000 tx=0x7f0928004730 comp rx=0 tx=0).stop 2024-09-15T23:12:22.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.090+0000 7f0940f75640 1 -- 172.21.15.123:0/2284536813 reap_dead start 2024-09-15T23:12:22.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.090+0000 7f09267fc640 1 -- 172.21.15.123:0/2284536813 shutdown_connections 2024-09-15T23:12:22.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.090+0000 7f09267fc640 1 -- 172.21.15.123:0/2284536813 >> 172.21.15.123:0/2284536813 conn(0x7f093401d930 msgr2=0x7f0934032e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:22.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.090+0000 7f09267fc640 1 -- 172.21.15.123:0/2284536813 shutdown_connections 2024-09-15T23:12:22.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.090+0000 7f09267fc640 1 -- 172.21.15.123:0/2284536813 wait complete. 2024-09-15T23:12:22.157 INFO:teuthology.orchestra.run.smithi123.stdout:68719476745 2024-09-15T23:12:22.157 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-15T23:12:22.158 INFO:teuthology.orchestra.run.smithi123.stdout:68719476744 2024-09-15T23:12:22.158 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-15T23:12:22.159 INFO:teuthology.orchestra.run.smithi123.stdout:68719476742 2024-09-15T23:12:22.159 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-15T23:12:22.160 INFO:teuthology.orchestra.run.smithi123.stdout:60129542152 2024-09-15T23:12:22.160 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-15T23:12:22.161 INFO:teuthology.orchestra.run.smithi123.stdout:60129542151 2024-09-15T23:12:22.161 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-15T23:12:22.162 INFO:teuthology.orchestra.run.smithi123.stdout:60129542150 2024-09-15T23:12:22.162 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-15T23:12:22.163 INFO:teuthology.orchestra.run.smithi123.stdout:60129542151 2024-09-15T23:12:22.163 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-15T23:12:22.164 INFO:teuthology.orchestra.run.smithi123.stdout:68719476744 2024-09-15T23:12:22.164 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-15T23:12:22.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.363+0000 7f26f5fb0640 1 Processor -- start 2024-09-15T23:12:22.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.363+0000 7fd6a4dbd640 1 Processor -- start 2024-09-15T23:12:22.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.363+0000 7fd6a4dbd640 1 -- start start 2024-09-15T23:12:22.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.363+0000 7f26f5fb0640 1 -- start start 2024-09-15T23:12:22.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.364+0000 7faa2759e640 1 Processor -- start 2024-09-15T23:12:22.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.364+0000 7faa2759e640 1 -- start start 2024-09-15T23:12:22.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.364+0000 7fd6a4dbd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6a0162c30 0x7fd6a00b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.365+0000 7f26f5fb0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26f015e950 0x7f26f00d1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.365+0000 7f26f5fb0640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26f00d47e0 con 0x7f26f00d1bd0 2024-09-15T23:12:22.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.365+0000 7f26f5fb0640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26f00d4a80 con 0x7f26f00cf9c0 2024-09-15T23:12:22.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.365+0000 7f26f5fb0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f26f015ed30 con 0x7f26f015e950 2024-09-15T23:12:22.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.364+0000 7fd6a4dbd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd6a00b1c30 0x7fd6a00b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.364+0000 7fd6a4dbd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd6a00b3df0 0x7fd6a00720c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.365+0000 7fd6a4dbd640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fd6a00b23b0 con 0x7fd6a00b3df0 2024-09-15T23:12:22.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.365+0000 7fd6a4dbd640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fd6a01641a0 con 0x7fd6a00b1c30 2024-09-15T23:12:22.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.365+0000 7f26eeffd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f26f00d1bd0 0x7f26f00cf2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39080/0 (socket says 172.21.15.123:39080) 2024-09-15T23:12:22.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.365+0000 7f26eeffd640 1 -- 172.21.15.123:0/2167983204 learned_addr learned my addr 172.21.15.123:0/2167983204 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:22.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.365+0000 7fd6a4dbd640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd6a01633e0 con 0x7fd6a0162c30 2024-09-15T23:12:22.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.365+0000 7fd69ed9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd6a00b3df0 0x7fd6a00720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.365+0000 7f26ef7fe640 1 --2- 172.21.15.123:0/2167983204 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26f015e950 0x7f26f00d1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.365+0000 7fd69ed9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd6a00b3df0 0x7fd6a00720c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36336/0 (socket says 172.21.15.123:36336) 2024-09-15T23:12:22.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.365+0000 7fd69ed9d640 1 -- 172.21.15.123:0/3980885308 learned_addr learned my addr 172.21.15.123:0/3980885308 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:22.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.365+0000 7fd69dd9b640 1 --2- 172.21.15.123:0/3980885308 >> v2:172.21.15.188:3300/0 conn(0x7fd6a00b1c30 0x7fd6a00b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.365+0000 7fd69ed9d640 1 -- 172.21.15.123:0/3980885308 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6a0162c30 msgr2=0x7fd6a00b16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:22.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.365+0000 7faa2759e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7faa2806c320 0x7faa280cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.365+0000 7faa2759e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faa280cf120 0x7faa28067950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.365+0000 7faa2759e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa2806db70 con 0x7faa281443e0 2024-09-15T23:12:22.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.365+0000 7faa2759e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7faa280cf970 con 0x7faa2806c320 2024-09-15T23:12:22.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.365+0000 7faa2759e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7faa280cfc50 con 0x7faa280cf120 2024-09-15T23:12:22.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.365+0000 7f26ee7fc640 1 -- 172.21.15.123:0/2167983204 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2666068797 0 0) 0x7f26f00d47e0 con 0x7f26f00d1bd0 2024-09-15T23:12:22.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.366+0000 7f26ee7fc640 1 -- 172.21.15.123:0/2167983204 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26dc003520 con 0x7f26f00d1bd0 2024-09-15T23:12:22.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.366+0000 7f26ee7fc640 1 -- 172.21.15.123:0/2167983204 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3274905817 0 0) 0x7f26f00d4a80 con 0x7f26f00cf9c0 2024-09-15T23:12:22.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.366+0000 7f26ee7fc640 1 -- 172.21.15.123:0/2167983204 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26f00d47e0 con 0x7f26f00cf9c0 2024-09-15T23:12:22.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.366+0000 7fd6e60c8640 1 Processor -- start 2024-09-15T23:12:22.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.366+0000 7fd6e60c8640 1 -- start start 2024-09-15T23:12:22.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.365+0000 7fd69ed9d640 1 --2- 172.21.15.123:0/3980885308 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6a0162c30 0x7fd6a00b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.365+0000 7fd69ed9d640 1 -- 172.21.15.123:0/3980885308 >> v2:172.21.15.188:3300/0 conn(0x7fd6a00b1c30 msgr2=0x7fd6a00b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:22.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.365+0000 7fd69ed9d640 1 --2- 172.21.15.123:0/3980885308 >> v2:172.21.15.188:3300/0 conn(0x7fd6a00b1c30 0x7fd6a00b38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.365+0000 7fd69ed9d640 1 -- 172.21.15.123:0/3980885308 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a01636c0 con 0x7fd6a00b3df0 2024-09-15T23:12:22.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.366+0000 7f10b7fff640 1 Processor -- start 2024-09-15T23:12:22.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.366+0000 7f10b7fff640 1 -- start start 2024-09-15T23:12:22.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.366+0000 7f26ef7fe640 1 -- 172.21.15.123:0/2167983204 >> v1:172.21.15.188:6789/0 conn(0x7f26f00cf9c0 legacy=0x7f26f00b77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.366+0000 7f26ef7fe640 1 -- 172.21.15.123:0/2167983204 >> v1:172.21.15.123:6789/0 conn(0x7f26f00d1bd0 legacy=0x7f26f00cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.366+0000 7f26ef7fe640 1 -- 172.21.15.123:0/2167983204 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f00d4d60 con 0x7f26f015e950 2024-09-15T23:12:22.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.366+0000 7f6ace1c4640 1 Processor -- start 2024-09-15T23:12:22.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.367+0000 7f6ace1c4640 1 -- start start 2024-09-15T23:12:22.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.366+0000 7fd69ed9d640 1 --2- 172.21.15.123:0/3980885308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6a00b3df0 0x7fd6a00720c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0073170 tx=0x7fd69802a690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=759f974f2a912c61 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.367+0000 7fd69d59a640 1 -- 172.21.15.123:0/3980885308 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd698036070 con 0x7fd6a00b3df0 2024-09-15T23:12:22.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.367+0000 7fd69d59a640 1 -- 172.21.15.123:0/3980885308 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd698031600 con 0x7fd6a00b3df0 2024-09-15T23:12:22.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.367+0000 7fd69d59a640 1 -- 172.21.15.123:0/3980885308 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6980319d0 con 0x7fd6a00b3df0 2024-09-15T23:12:22.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.367+0000 7f10b7fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f10b00e1860 0x7f10b0056ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.367+0000 7f10b7fff640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10b00516f0 con 0x7f10b0057400 2024-09-15T23:12:22.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.367+0000 7f10b7fff640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10b00519d0 con 0x7f10b0053600 2024-09-15T23:12:22.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.367+0000 7f10b7fff640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f10b0052020 con 0x7f10b00e1860 2024-09-15T23:12:22.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.367+0000 7f26ef7fe640 1 --2- 172.21.15.123:0/2167983204 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26f015e950 0x7f26f00d1690 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f26e0009dc0 tx=0x7f26e002a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cec938d8be449cae server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.366+0000 7f3504423640 1 Processor -- start 2024-09-15T23:12:22.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.367+0000 7f10b6ffd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f10b00e1860 0x7f10b0056ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.367+0000 7f10b6ffd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f10b00e1860 0x7f10b0056ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:50854/0 (socket says 172.21.15.123:50854) 2024-09-15T23:12:22.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.367+0000 7f10b6ffd640 1 -- 172.21.15.123:0/3407187113 learned_addr learned my addr 172.21.15.123:0/3407187113 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:22.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.366+0000 7faa26d9d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faa280cf120 0x7faa28067950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.366+0000 7faa2659c640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7faa281443e0 0x7faa2806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:48864/0 (socket says 172.21.15.123:48864) 2024-09-15T23:12:22.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.367+0000 7f26ee7fc640 1 -- 172.21.15.123:0/2167983204 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e002ae60 con 0x7f26f015e950 2024-09-15T23:12:22.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.366+0000 7faa2659c640 1 -- 172.21.15.123:0/656069246 learned_addr learned my addr 172.21.15.123:0/656069246 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:22.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.366+0000 7faa25d9b640 1 --2- 172.21.15.123:0/656069246 >> v2:172.21.15.188:3300/0 conn(0x7faa2806c320 0x7faa280cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.367+0000 7faa26d9d640 1 -- 172.21.15.123:0/656069246 >> v2:172.21.15.188:3300/0 conn(0x7faa2806c320 msgr2=0x7faa280cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:22.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.367+0000 7faa26d9d640 1 --2- 172.21.15.123:0/656069246 >> v2:172.21.15.188:3300/0 conn(0x7faa2806c320 0x7faa280cebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.367+0000 7faa26d9d640 1 -- 172.21.15.123:0/656069246 >> v1:172.21.15.188:6789/0 conn(0x7faa281443e0 legacy=0x7faa2806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.367+0000 7faa26d9d640 1 -- 172.21.15.123:0/656069246 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa280cff30 con 0x7faa280cf120 2024-09-15T23:12:22.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.368+0000 7f26ee7fc640 1 -- 172.21.15.123:0/2167983204 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26e0007740 con 0x7f26f015e950 2024-09-15T23:12:22.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.368+0000 7f3504423640 1 -- start start 2024-09-15T23:12:22.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.367+0000 7fd6e60c8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd6e00cef50 0x7fd6e0162b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.367+0000 7fd6e60c8640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6e00cf5e0 con 0x7fd6e00b6790 2024-09-15T23:12:22.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.367+0000 7fd6e60c8640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6e00cf8c0 con 0x7fd6e015e4c0 2024-09-15T23:12:22.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.367+0000 7fd6e60c8640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fd6e01630b0 con 0x7fd6e00cef50 2024-09-15T23:12:22.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.367+0000 7fd6e50c6640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fd6e015e4c0 0x7fd6e00b6080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:48892/0 (socket says 172.21.15.123:48892) 2024-09-15T23:12:22.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.367+0000 7fd6e50c6640 1 -- 172.21.15.123:0/3466425998 learned_addr learned my addr 172.21.15.123:0/3466425998 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:22.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.368+0000 7f10b6ffd640 1 -- 172.21.15.123:0/3407187113 >> v1:172.21.15.188:6789/0 conn(0x7f10b0053600 legacy=0x7f10b0054380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:22.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.368+0000 7f10b6ffd640 1 -- 172.21.15.123:0/3407187113 >> v1:172.21.15.123:6789/0 conn(0x7f10b0057400 legacy=0x7f10b0052ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:22.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.368+0000 7f10b6ffd640 1 -- 172.21.15.123:0/3407187113 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b0051cb0 con 0x7f10b00e1860 2024-09-15T23:12:22.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.368+0000 7fd6d7fff640 1 -- 172.21.15.123:0/3466425998 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1957447682 0 0) 0x7fd6e00cf5e0 con 0x7fd6e00b6790 2024-09-15T23:12:22.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.368+0000 7fd6d7fff640 1 -- 172.21.15.123:0/3466425998 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6cc003520 con 0x7fd6e00b6790 2024-09-15T23:12:22.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.368+0000 7f6ace1c4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ac8144300 0x7f6ac806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.368+0000 7f6ace1c4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6ac806c150 0x7f6ac8073730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.368+0000 7f26ee7fc640 1 -- 172.21.15.123:0/2167983204 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e0007b10 con 0x7f26f015e950 2024-09-15T23:12:22.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.368+0000 7faa26d9d640 1 --2- 172.21.15.123:0/656069246 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faa280cf120 0x7faa28067950 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7faa20009d90 tx=0x7faa2002a550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cffaa38b604cc10 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.368+0000 7fd6a4dbd640 1 -- 172.21.15.123:0/3980885308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6a00b3df0 msgr2=0x7fd6a00720c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.368+0000 7fd6a4dbd640 1 --2- 172.21.15.123:0/3980885308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6a00b3df0 0x7fd6a00720c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0073170 tx=0x7fd69802a690 comp rx=0 tx=0).stop 2024-09-15T23:12:22.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.368+0000 7fd6e58c7640 1 --2- 172.21.15.123:0/3466425998 >> v2:172.21.15.188:3300/0 conn(0x7fd6e00cef50 0x7fd6e0162b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.368+0000 7f6ac77fe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ac8144300 0x7f6ac806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.368+0000 7f6ac6ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6ac806c150 0x7f6ac8073730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.368+0000 7f6ac6ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6ac806c150 0x7f6ac8073730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36350/0 (socket says 172.21.15.123:36350) 2024-09-15T23:12:22.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.368+0000 7f6ac77fe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ac8144300 0x7f6ac806bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:41346/0 (socket says 172.21.15.123:41346) 2024-09-15T23:12:22.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.368+0000 7f6ac6ffd640 1 -- 172.21.15.123:0/1132596279 learned_addr learned my addr 172.21.15.123:0/1132596279 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:22.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.368+0000 7fd6a4dbd640 1 -- 172.21.15.123:0/3980885308 shutdown_connections 2024-09-15T23:12:22.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.368+0000 7fd6a4dbd640 1 --2- 172.21.15.123:0/3980885308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6a00b3df0 0x7fd6a00720c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.368+0000 7f6ace1c4640 1 -- 172.21.15.123:0/1132596279 --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ac806c570 con 0x7f6ac8073c70 2024-09-15T23:12:22.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.368+0000 7fd6a4dbd640 1 --2- 172.21.15.123:0/3980885308 >> v2:172.21.15.188:3300/0 conn(0x7fd6a00b1c30 0x7fd6a00b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.368+0000 7fd6a4dbd640 1 --2- 172.21.15.123:0/3980885308 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6a0162c30 0x7fd6a00b16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.368+0000 7fd6a4dbd640 1 -- 172.21.15.123:0/3980885308 >> 172.21.15.123:0/3980885308 conn(0x7fd6a006cd20 msgr2=0x7fd6a006d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:22.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.369+0000 7f6ace1c4640 1 -- 172.21.15.123:0/1132596279 --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f6ac80720b0 con 0x7f6ac806c150 2024-09-15T23:12:22.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.369+0000 7f6ace1c4640 1 -- 172.21.15.123:0/1132596279 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6ac8071c20 con 0x7f6ac8144300 2024-09-15T23:12:22.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.368+0000 7fd6d7fff640 1 -- 172.21.15.123:0/3466425998 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 341964856 0 0) 0x7fd6cc003520 con 0x7fd6e00b6790 2024-09-15T23:12:22.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.368+0000 7fd6d7fff640 1 -- 172.21.15.123:0/3466425998 >> v2:172.21.15.188:3300/0 conn(0x7fd6e00cef50 msgr2=0x7fd6e0162b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:22.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.368+0000 7fd6d7fff640 1 --2- 172.21.15.123:0/3466425998 >> v2:172.21.15.188:3300/0 conn(0x7fd6e00cef50 0x7fd6e0162b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.369+0000 7fd6d7fff640 1 -- 172.21.15.123:0/3466425998 >> v1:172.21.15.188:6789/0 conn(0x7fd6e015e4c0 legacy=0x7fd6e00b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.369+0000 7fd6d7fff640 1 -- 172.21.15.123:0/3466425998 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e00d2980 con 0x7fd6e00b6790 2024-09-15T23:12:22.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.369+0000 7fd6d7fff640 1 -- 172.21.15.123:0/3466425998 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fd6d80019f0 con 0x7fd6e00b6790 2024-09-15T23:12:22.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.369+0000 7fd6d7fff640 1 -- 172.21.15.123:0/3466425998 >> v1:172.21.15.123:6789/0 conn(0x7fd6e00b6790 legacy=0x7fd6e00d3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.369+0000 7faa2559a640 1 -- 172.21.15.123:0/656069246 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa20007740 con 0x7faa280cf120 2024-09-15T23:12:22.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.369+0000 7faa2559a640 1 -- 172.21.15.123:0/656069246 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa200078e0 con 0x7faa280cf120 2024-09-15T23:12:22.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.369+0000 7fd6d7fff640 1 --2- 172.21.15.123:0/3466425998 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6cc003a00 0x7fd6cc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.369+0000 7fd6d7fff640 1 --2- 172.21.15.123:0/3466425998 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6cc004800 0x7fd6cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.369+0000 7fd6d7fff640 1 --2- 172.21.15.123:0/3466425998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6cc005210 0x7fd6cc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.369+0000 7fd6d7fff640 1 -- 172.21.15.123:0/3466425998 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e01630b0 con 0x7fd6cc005210 2024-09-15T23:12:22.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.369+0000 7fd6a4dbd640 1 -- 172.21.15.123:0/3980885308 shutdown_connections 2024-09-15T23:12:22.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.369+0000 7fd6d7fff640 1 -- 172.21.15.123:0/3466425998 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd6cc00c160 con 0x7fd6cc004800 2024-09-15T23:12:22.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.369+0000 7fd6d7fff640 1 -- 172.21.15.123:0/3466425998 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd6cc00c360 con 0x7fd6cc003a00 2024-09-15T23:12:22.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.369+0000 7fd6a4dbd640 1 -- 172.21.15.123:0/3980885308 wait complete. 2024-09-15T23:12:22.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.369+0000 7f10b6ffd640 1 --2- 172.21.15.123:0/3407187113 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f10b00e1860 0x7f10b0056ec0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f10a8009870 tx=0x7f10a802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d16e99f3a2c38233 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.369+0000 7fd6e48c5640 1 --2- 172.21.15.123:0/3466425998 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6cc004800 0x7fd6cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.369+0000 7fd6e58c7640 1 --2- 172.21.15.123:0/3466425998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6cc005210 0x7fd6cc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.369+0000 7fd6e50c6640 1 --2- 172.21.15.123:0/3466425998 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6cc003a00 0x7fd6cc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.369+0000 7f10b5ffb640 1 -- 172.21.15.123:0/3407187113 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a8037070 con 0x7f10b00e1860 2024-09-15T23:12:22.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.369+0000 7f10b5ffb640 1 -- 172.21.15.123:0/3407187113 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10a8032440 con 0x7f10b00e1860 2024-09-15T23:12:22.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.369+0000 7f10b5ffb640 1 -- 172.21.15.123:0/3407187113 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a8032810 con 0x7f10b00e1860 2024-09-15T23:12:22.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.369+0000 7f3504423640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f34fc144170 0x7f34fc15aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.369+0000 7fd6e58c7640 1 -- 172.21.15.123:0/3466425998 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6cc003a00 msgr2=0x7fd6cc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:22.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.369+0000 7fd6e58c7640 1 --2- 172.21.15.123:0/3466425998 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6cc003a00 0x7fd6cc003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.369+0000 7fd6e58c7640 1 -- 172.21.15.123:0/3466425998 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6cc004800 msgr2=0x7fd6cc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:22.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.369+0000 7fd6e58c7640 1 --2- 172.21.15.123:0/3466425998 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6cc004800 0x7fd6cc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.369+0000 7fd6e58c7640 1 -- 172.21.15.123:0/3466425998 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6cc003520 con 0x7fd6cc005210 2024-09-15T23:12:22.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.369+0000 7f3504423640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f34fc15b430 0x7f34fc072740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.369+0000 7f3504423640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34fc072c80 0x7f34fc0d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.369+0000 7f3504423640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f34fc0722b0 con 0x7f34fc15b430 2024-09-15T23:12:22.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.370+0000 7f3504423640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f34fc073080 con 0x7f34fc144170 2024-09-15T23:12:22.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.370+0000 7f3504423640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f34fc0b4160 con 0x7f34fc072c80 2024-09-15T23:12:22.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.370+0000 7f26f5fb0640 1 -- 172.21.15.123:0/2167983204 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26f015e950 msgr2=0x7f26f00d1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.370+0000 7f26f5fb0640 1 --2- 172.21.15.123:0/2167983204 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26f015e950 0x7f26f00d1690 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f26e0009dc0 tx=0x7f26e002a640 comp rx=0 tx=0).stop 2024-09-15T23:12:22.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.370+0000 7f6ac6ffd640 1 -- 172.21.15.123:0/1132596279 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ac8144300 msgr2=0x7f6ac806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:22.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.370+0000 7f6ac6ffd640 1 --2- 172.21.15.123:0/1132596279 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ac8144300 0x7f6ac806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.370+0000 7f26f5fb0640 1 -- 172.21.15.123:0/2167983204 shutdown_connections 2024-09-15T23:12:22.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.370+0000 7f26f5fb0640 1 --2- 172.21.15.123:0/2167983204 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26f015e950 0x7f26f00d1690 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.370+0000 7f26f5fb0640 1 -- 172.21.15.123:0/2167983204 >> 172.21.15.123:0/2167983204 conn(0x7f26f0067b30 msgr2=0x7f26f0067f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:22.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.370+0000 7f26f5fb0640 1 -- 172.21.15.123:0/2167983204 shutdown_connections 2024-09-15T23:12:22.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.370+0000 7f26f5fb0640 1 -- 172.21.15.123:0/2167983204 wait complete. 2024-09-15T23:12:22.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.370+0000 7f35021bf640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f34fc144170 0x7f34fc15aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.370+0000 7f35021bf640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f34fc144170 0x7f34fc15aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:50880/0 (socket says 172.21.15.123:50880) 2024-09-15T23:12:22.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.370+0000 7f35021bf640 1 -- 172.21.15.123:0/277791099 learned_addr learned my addr 172.21.15.123:0/277791099 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:22.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.370+0000 7f10b7fff640 1 -- 172.21.15.123:0/3407187113 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f10b00e1860 msgr2=0x7f10b0056ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.370+0000 7f10b7fff640 1 --2- 172.21.15.123:0/3407187113 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f10b00e1860 0x7f10b0056ec0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f10a8009870 tx=0x7f10a802a270 comp rx=0 tx=0).stop 2024-09-15T23:12:22.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.370+0000 7fd6e48c5640 1 --2- 172.21.15.123:0/3466425998 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6cc004800 0x7fd6cc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:12:22.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.370+0000 7faa2759e640 1 -- 172.21.15.123:0/656069246 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faa280cf120 msgr2=0x7faa28067950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.370+0000 7faa2759e640 1 --2- 172.21.15.123:0/656069246 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faa280cf120 0x7faa28067950 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7faa20009d90 tx=0x7faa2002a550 comp rx=0 tx=0).stop 2024-09-15T23:12:22.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.370+0000 7f10b7fff640 1 -- 172.21.15.123:0/3407187113 shutdown_connections 2024-09-15T23:12:22.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.370+0000 7f10b7fff640 1 --2- 172.21.15.123:0/3407187113 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f10b00e1860 0x7f10b0056ec0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.370+0000 7f10b7fff640 1 -- 172.21.15.123:0/3407187113 >> 172.21.15.123:0/3407187113 conn(0x7f10b001fb40 msgr2=0x7f10b00567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:22.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.370+0000 7f35029c0640 1 --2- 172.21.15.123:0/277791099 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34fc072c80 0x7f34fc0d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.370+0000 7f10b7fff640 1 -- 172.21.15.123:0/3407187113 shutdown_connections 2024-09-15T23:12:22.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.370+0000 7f35019be640 1 --2- 172.21.15.123:0/277791099 >> v2:172.21.15.123:3300/0 conn(0x7f34fc15b430 0x7f34fc072740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.370+0000 7faa2759e640 1 -- 172.21.15.123:0/656069246 shutdown_connections 2024-09-15T23:12:22.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.370+0000 7faa2759e640 1 --2- 172.21.15.123:0/656069246 >> v2:172.21.15.188:3300/0 conn(0x7faa2806c320 0x7faa280cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.370+0000 7faa2759e640 1 --2- 172.21.15.123:0/656069246 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faa280cf120 0x7faa28067950 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.370+0000 7faa2759e640 1 -- 172.21.15.123:0/656069246 >> 172.21.15.123:0/656069246 conn(0x7faa28071620 msgr2=0x7faa280b3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:22.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.370+0000 7f10b7fff640 1 -- 172.21.15.123:0/3407187113 wait complete. 2024-09-15T23:12:22.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.371+0000 7faa2759e640 1 -- 172.21.15.123:0/656069246 shutdown_connections 2024-09-15T23:12:22.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.371+0000 7f35021bf640 1 -- 172.21.15.123:0/277791099 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34fc072c80 msgr2=0x7f34fc0d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:22.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.371+0000 7f35021bf640 1 --2- 172.21.15.123:0/277791099 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34fc072c80 0x7f34fc0d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.371+0000 7f35021bf640 1 -- 172.21.15.123:0/277791099 >> v2:172.21.15.123:3300/0 conn(0x7f34fc15b430 msgr2=0x7f34fc072740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:22.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.371+0000 7f35021bf640 1 --2- 172.21.15.123:0/277791099 >> v2:172.21.15.123:3300/0 conn(0x7f34fc15b430 0x7f34fc072740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.371+0000 7faa2759e640 1 -- 172.21.15.123:0/656069246 wait complete. 2024-09-15T23:12:22.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.371+0000 7f35021bf640 1 -- 172.21.15.123:0/277791099 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34fc071c60 con 0x7f34fc144170 2024-09-15T23:12:22.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.371+0000 7fd6a4dbd640 1 Processor -- start 2024-09-15T23:12:22.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.371+0000 7fd6a4dbd640 1 -- start start 2024-09-15T23:12:22.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.371+0000 7f35019be640 1 --2- 172.21.15.123:0/277791099 >> v2:172.21.15.123:3300/0 conn(0x7f34fc15b430 0x7f34fc072740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:12:22.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.370+0000 7f6ac6ffd640 1 -- 172.21.15.123:0/1132596279 >> v1:172.21.15.188:6789/0 conn(0x7f6ac8073c70 legacy=0x7f6ac80b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.370+0000 7f6ac6ffd640 1 -- 172.21.15.123:0/1132596279 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac8071010 con 0x7f6ac806c150 2024-09-15T23:12:22.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.372+0000 7f6ac77fe640 1 --2- 172.21.15.123:0/1132596279 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ac8144300 0x7f6ac806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:22.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.372+0000 7f26f5fb0640 1 Processor -- start 2024-09-15T23:12:22.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.372+0000 7fd6e58c7640 1 --2- 172.21.15.123:0/3466425998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6cc005210 0x7fd6cc00b9c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc00ba30 tx=0x7fd6cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db8410f408ed1a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.372+0000 7fd6e58c7640 1 -- 172.21.15.123:0/3466425998 reap_dead start 2024-09-15T23:12:22.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.372+0000 7f35021bf640 1 --2- 172.21.15.123:0/277791099 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34fc144170 0x7f34fc15aef0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f34fc0d0360 tx=0x7f34f402a6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=621b767d6993e402 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.372+0000 7f26f5fb0640 1 -- start start 2024-09-15T23:12:22.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.372+0000 7f6ac6ffd640 1 --2- 172.21.15.123:0/1132596279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ac806c150 0x7f6ac8073730 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6abc009870 tx=0x7f6abc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de890c6274f770ba server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.372+0000 7f10b7fff640 1 Processor -- start 2024-09-15T23:12:22.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.372+0000 7f6ac67fc640 1 -- 172.21.15.123:0/1132596279 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6abc037070 con 0x7f6ac806c150 2024-09-15T23:12:22.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.372+0000 7f6ac67fc640 1 -- 172.21.15.123:0/1132596279 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6abc02ae10 con 0x7f6ac806c150 2024-09-15T23:12:22.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.372+0000 7f6ac67fc640 1 -- 172.21.15.123:0/1132596279 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6abc032660 con 0x7f6ac806c150 2024-09-15T23:12:22.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.372+0000 7fd6d7fff640 1 -- 172.21.15.123:0/3466425998 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d800c0e0 con 0x7fd6cc005210 2024-09-15T23:12:22.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.373+0000 7fd6d7fff640 1 -- 172.21.15.123:0/3466425998 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6dc02ae30 con 0x7fd6cc005210 2024-09-15T23:12:22.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.373+0000 7fd6d7fff640 1 -- 172.21.15.123:0/3466425998 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc030070 con 0x7fd6cc005210 2024-09-15T23:12:22.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.373+0000 7fd6a4dbd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6a00b1c30 0x7fd6a0151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.373+0000 7f35011bd640 1 -- 172.21.15.123:0/277791099 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f4036070 con 0x7f34fc144170 2024-09-15T23:12:22.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.373+0000 7f35011bd640 1 -- 172.21.15.123:0/277791099 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34f4031600 con 0x7f34fc144170 2024-09-15T23:12:22.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.373+0000 7fd6a4dbd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6a00b3df0 0x7fd6a0160220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.373+0000 7fd69e59c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6a00b1c30 0x7fd6a0151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.373+0000 7fd69e59c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6a00b1c30 0x7fd6a0151020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:41372/0 (socket says 172.21.15.123:41372) 2024-09-15T23:12:22.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.373+0000 7fd69e59c640 1 -- 172.21.15.123:0/1611456264 learned_addr learned my addr 172.21.15.123:0/1611456264 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:22.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.373+0000 7fd69dd9b640 1 --2- 172.21.15.123:0/1611456264 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6a00b3df0 0x7fd6a0160220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.373+0000 7fd6a4dbd640 1 --2- 172.21.15.123:0/1611456264 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6a0162c30 0x7fd6a014f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.373+0000 7faa2759e640 1 Processor -- start 2024-09-15T23:12:22.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.373+0000 7faa2759e640 1 -- start start 2024-09-15T23:12:22.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.373+0000 7fd69ed9d640 1 --2- 172.21.15.123:0/1611456264 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6a0162c30 0x7fd6a014f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.373+0000 7f1bb5a77640 1 Processor -- start 2024-09-15T23:12:22.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.373+0000 7fd6a4dbd640 1 -- 172.21.15.123:0/1611456264 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a00b2070 con 0x7fd6a0162c30 2024-09-15T23:12:22.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.373+0000 7fd6a4dbd640 1 -- 172.21.15.123:0/1611456264 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd6a0163c80 con 0x7fd6a00b3df0 2024-09-15T23:12:22.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.373+0000 7fd6a4dbd640 1 -- 172.21.15.123:0/1611456264 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd6a00b4220 con 0x7fd6a00b1c30 2024-09-15T23:12:22.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.373+0000 7f26f5fb0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26f00cf9c0 0x7f26f01f71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.373+0000 7f1bb5a77640 1 -- start start 2024-09-15T23:12:22.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7f26f5fb0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26f00d1bd0 0x7f26f01f53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7f3504423640 1 -- 172.21.15.123:0/277791099 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34fc144170 msgr2=0x7f34fc15aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7f35011bd640 1 -- 172.21.15.123:0/277791099 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f4036070 con 0x7f34fc144170 2024-09-15T23:12:22.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7f6ace1c4640 1 -- 172.21.15.123:0/1132596279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ac806c150 msgr2=0x7f6ac8073730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7f6ace1c4640 1 --2- 172.21.15.123:0/1132596279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ac806c150 0x7f6ac8073730 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6abc009870 tx=0x7f6abc02a180 comp rx=0 tx=0).stop 2024-09-15T23:12:22.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7f3504423640 1 --2- 172.21.15.123:0/277791099 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34fc144170 0x7f34fc15aef0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f34fc0d0360 tx=0x7f34f402a6b0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7fd6e60c8640 1 -- 172.21.15.123:0/3466425998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6cc005210 msgr2=0x7fd6cc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7fd6e60c8640 1 --2- 172.21.15.123:0/3466425998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6cc005210 0x7fd6cc00b9c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc00ba30 tx=0x7fd6cc005830 comp rx=0 tx=0).stop 2024-09-15T23:12:22.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7fd6e60c8640 1 -- 172.21.15.123:0/3466425998 shutdown_connections 2024-09-15T23:12:22.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7faa2759e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa2806c320 0x7faa28159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7fd6e60c8640 1 --2- 172.21.15.123:0/3466425998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6cc005210 0x7fd6cc00b9c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7fd6e60c8640 1 -- 172.21.15.123:0/3466425998 >> 172.21.15.123:0/3466425998 conn(0x7fd6e00d1080 msgr2=0x7fd6e00d1460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:22.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7fd69e59c640 1 -- 172.21.15.123:0/1611456264 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6a00b3df0 msgr2=0x7fd6a0160220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7fd69e59c640 1 --2- 172.21.15.123:0/1611456264 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6a00b3df0 0x7fd6a0160220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7f3504423640 1 -- 172.21.15.123:0/277791099 shutdown_connections 2024-09-15T23:12:22.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7f3504423640 1 --2- 172.21.15.123:0/277791099 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34fc072c80 0x7f34fc0d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7fd69e59c640 1 -- 172.21.15.123:0/1611456264 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6a0162c30 msgr2=0x7fd6a014f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7fd69e59c640 1 --2- 172.21.15.123:0/1611456264 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6a0162c30 0x7fd6a014f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7fd69e59c640 1 -- 172.21.15.123:0/1611456264 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a0160a70 con 0x7fd6a00b1c30 2024-09-15T23:12:22.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7f3504423640 1 --2- 172.21.15.123:0/277791099 >> v2:172.21.15.123:3300/0 conn(0x7f34fc15b430 0x7f34fc072740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7f3504423640 1 --2- 172.21.15.123:0/277791099 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34fc144170 0x7f34fc15aef0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7f3504423640 1 -- 172.21.15.123:0/277791099 >> 172.21.15.123:0/277791099 conn(0x7f34fc06d0f0 msgr2=0x7f34fc06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:22.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7faa2759e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa280cf120 0x7faa2813fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.372+0000 7f10b7fff640 1 -- start start 2024-09-15T23:12:22.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7faa2659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa2806c320 0x7faa28159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7f26ef7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26f00cf9c0 0x7f26f01f71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7f26ef7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26f00cf9c0 0x7f26f01f71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36386/0 (socket says 172.21.15.123:36386) 2024-09-15T23:12:22.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7f26eeffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26f00d1bd0 0x7f26f01f53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7faa2659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa2806c320 0x7faa28159d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36398/0 (socket says 172.21.15.123:36398) 2024-09-15T23:12:22.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7fd69ed9d640 1 --2- 172.21.15.123:0/1611456264 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6a0162c30 0x7fd6a014f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:12:22.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7faa2759e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faa281443e0 0x7faa2806e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7f26eeffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26f00d1bd0 0x7f26f01f53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:50898/0 (socket says 172.21.15.123:50898) 2024-09-15T23:12:22.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7f26eeffd640 1 -- 172.21.15.123:0/177389021 learned_addr learned my addr 172.21.15.123:0/177389021 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:22.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7faa25d9b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa280cf120 0x7faa2813fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7f26f5fb0640 1 --2- 172.21.15.123:0/177389021 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26f015e950 0x7f26f00cd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7faa25d9b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa280cf120 0x7faa2813fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:50914/0 (socket says 172.21.15.123:50914) 2024-09-15T23:12:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7fd69e59c640 1 --2- 172.21.15.123:0/1611456264 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6a00b1c30 0x7fd6a0151020 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd69000b4d0 tx=0x7fd69000b990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7f6ace1c4640 1 -- 172.21.15.123:0/1132596279 shutdown_connections 2024-09-15T23:12:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7f26f5fb0640 1 -- 172.21.15.123:0/177389021 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f26f00d2010 con 0x7f26f00cf9c0 2024-09-15T23:12:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7f26f5fb0640 1 -- 172.21.15.123:0/177389021 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f26f00cfe10 con 0x7f26f00d1bd0 2024-09-15T23:12:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7f26f5fb0640 1 -- 172.21.15.123:0/177389021 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f26f00b7ee0 con 0x7f26f015e950 2024-09-15T23:12:22.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7faa2759e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7faa280cf590 con 0x7faa2806c320 2024-09-15T23:12:22.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7faa2759e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7faa281447c0 con 0x7faa280cf120 2024-09-15T23:12:22.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7faa2759e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7faa280cf710 con 0x7faa281443e0 2024-09-15T23:12:22.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7faa26d9d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faa281443e0 0x7faa2806e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7faa2659c640 1 -- 172.21.15.123:0/450408110 learned_addr learned my addr 172.21.15.123:0/450408110 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:22.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7fd6e60c8640 1 -- 172.21.15.123:0/3466425998 shutdown_connections 2024-09-15T23:12:22.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7f3504423640 1 -- 172.21.15.123:0/277791099 shutdown_connections 2024-09-15T23:12:22.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7f26effff640 1 --2- 172.21.15.123:0/177389021 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26f015e950 0x7f26f00cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7f3504423640 1 -- 172.21.15.123:0/277791099 wait complete. 2024-09-15T23:12:22.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7f6ace1c4640 1 --2- 172.21.15.123:0/1132596279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ac806c150 0x7f6ac8073730 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7f6ace1c4640 1 --2- 172.21.15.123:0/1132596279 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ac8144300 0x7f6ac806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7f1bb5a77640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1bb00b3d80 0x7f1bb0144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7f1bb5a77640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1bb015b1a0 0x7f1bb0067950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7f6ace1c4640 1 -- 172.21.15.123:0/1132596279 >> 172.21.15.123:0/1132596279 conn(0x7f6ac80ccec0 msgr2=0x7f6ac80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:22.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7f1bb5a77640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1bb00b4bc0 0x7f1bb006dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7f1bb5a77640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f1bb00b5530 con 0x7f1bb00b3d80 2024-09-15T23:12:22.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7f1bb5a77640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f1bb0071830 con 0x7f1bb00b4bc0 2024-09-15T23:12:22.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7f1bb5a77640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb0071b10 con 0x7f1bb015b1a0 2024-09-15T23:12:22.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7f1baf7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1bb00b3d80 0x7f1bb0144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7f1baf7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1bb00b3d80 0x7f1bb0144720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36412/0 (socket says 172.21.15.123:36412) 2024-09-15T23:12:22.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7f1baf7fe640 1 -- 172.21.15.123:0/1281718515 learned_addr learned my addr 172.21.15.123:0/1281718515 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:22.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7f26ef7fe640 1 -- 172.21.15.123:0/177389021 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26f015e950 msgr2=0x7f26f00cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7f26ef7fe640 1 --2- 172.21.15.123:0/177389021 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26f015e950 0x7f26f00cd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7f26ef7fe640 1 -- 172.21.15.123:0/177389021 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26f00d1bd0 msgr2=0x7f26f01f53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7f26ef7fe640 1 --2- 172.21.15.123:0/177389021 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26f00d1bd0 0x7f26f01f53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7f26ef7fe640 1 -- 172.21.15.123:0/177389021 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f00abea0 con 0x7f26f00cf9c0 2024-09-15T23:12:22.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7f26eeffd640 1 --2- 172.21.15.123:0/177389021 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26f00d1bd0 0x7f26f01f53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:12:22.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7f1baf7fe640 1 -- 172.21.15.123:0/1281718515 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1bb015b1a0 msgr2=0x7f1bb0067950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:22.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7f1baf7fe640 1 --2- 172.21.15.123:0/1281718515 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1bb015b1a0 0x7f1bb0067950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7f1baf7fe640 1 -- 172.21.15.123:0/1281718515 >> v2:172.21.15.188:3300/0 conn(0x7f1bb00b4bc0 msgr2=0x7f1bb006dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:22.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7f1baf7fe640 1 --2- 172.21.15.123:0/1281718515 >> v2:172.21.15.188:3300/0 conn(0x7f1bb00b4bc0 0x7f1bb006dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7f1baf7fe640 1 -- 172.21.15.123:0/1281718515 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb0071df0 con 0x7f1bb00b3d80 2024-09-15T23:12:22.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7f10b7fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f10b0053600 0x7f10b003b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7f10b7fff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f10b0057400 0x7f10b000c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7f10b7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10b00e1860 0x7f10b004b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7faa25d9b640 1 -- 172.21.15.123:0/450408110 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faa281443e0 msgr2=0x7faa2806e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7faa25d9b640 1 --2- 172.21.15.123:0/450408110 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faa281443e0 0x7faa2806e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7faa25d9b640 1 -- 172.21.15.123:0/450408110 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa2806c320 msgr2=0x7faa28159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7faa25d9b640 1 --2- 172.21.15.123:0/450408110 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa2806c320 0x7faa28159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7faa25d9b640 1 -- 172.21.15.123:0/450408110 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa28166b10 con 0x7faa280cf120 2024-09-15T23:12:22.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7faa25d9b640 1 --2- 172.21.15.123:0/450408110 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa280cf120 0x7faa2813fda0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00e840 tx=0x7faa1c00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7f10b7fff640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f10b00e1dc0 con 0x7f10b00e1860 2024-09-15T23:12:22.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7f10b7fff640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f10b00e1c40 con 0x7f10b0053600 2024-09-15T23:12:22.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7f10b7fff640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f10b00524b0 con 0x7f10b0057400 2024-09-15T23:12:22.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7faa16ffd640 1 -- 172.21.15.123:0/450408110 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c017070 con 0x7faa280cf120 2024-09-15T23:12:22.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7faa16ffd640 1 -- 172.21.15.123:0/450408110 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa1c00c940 con 0x7faa280cf120 2024-09-15T23:12:22.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7faa16ffd640 1 -- 172.21.15.123:0/450408110 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa1c00cd30 con 0x7faa280cf120 2024-09-15T23:12:22.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7faa2759e640 1 -- 172.21.15.123:0/450408110 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa28166df0 con 0x7faa280cf120 2024-09-15T23:12:22.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.376+0000 7f26ef7fe640 1 --2- 172.21.15.123:0/177389021 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26f00cf9c0 0x7f26f01f71f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f26e0031000 tx=0x7f26e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.374+0000 7fd6e60c8640 1 -- 172.21.15.123:0/3466425998 wait complete. 2024-09-15T23:12:22.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.376+0000 7fd6e60c8640 1 Processor -- start 2024-09-15T23:12:22.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7fd68effd640 1 -- 172.21.15.123:0/1611456264 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd690014070 con 0x7fd6a00b1c30 2024-09-15T23:12:22.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7fd68effd640 1 -- 172.21.15.123:0/1611456264 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd690010870 con 0x7fd6a00b1c30 2024-09-15T23:12:22.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7fd68effd640 1 -- 172.21.15.123:0/1611456264 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd690010c60 con 0x7fd6a00b1c30 2024-09-15T23:12:22.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7fd6a4dbd640 1 -- 172.21.15.123:0/1611456264 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6a0160d50 con 0x7fd6a00b1c30 2024-09-15T23:12:22.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.375+0000 7fd6a4dbd640 1 -- 172.21.15.123:0/1611456264 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6a0159970 con 0x7fd6a00b1c30 2024-09-15T23:12:22.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.376+0000 7f3504423640 1 Processor -- start 2024-09-15T23:12:22.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.376+0000 7f10b67fc640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f10b0057400 0x7f10b000c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.376+0000 7f10b77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10b00e1860 0x7f10b004b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.376+0000 7f10b77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10b00e1860 0x7f10b004b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36414/0 (socket says 172.21.15.123:36414) 2024-09-15T23:12:22.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.376+0000 7f10b77fe640 1 -- 172.21.15.123:0/493633953 learned_addr learned my addr 172.21.15.123:0/493633953 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:22.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.376+0000 7f10b6ffd640 1 --2- 172.21.15.123:0/493633953 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f10b0053600 0x7f10b003b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.376+0000 7f10b77fe640 1 -- 172.21.15.123:0/493633953 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f10b0057400 msgr2=0x7f10b000c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.376+0000 7f10b77fe640 1 --2- 172.21.15.123:0/493633953 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f10b0057400 0x7f10b000c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.376+0000 7f10b77fe640 1 -- 172.21.15.123:0/493633953 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f10b0053600 msgr2=0x7f10b003b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.376+0000 7f10b77fe640 1 --2- 172.21.15.123:0/493633953 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f10b0053600 0x7f10b003b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.376+0000 7f10b77fe640 1 -- 172.21.15.123:0/493633953 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b00e0cf0 con 0x7f10b00e1860 2024-09-15T23:12:22.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.376+0000 7f10b67fc640 1 --2- 172.21.15.123:0/493633953 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f10b0057400 0x7f10b000c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:22.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.377+0000 7f26e7fff640 1 -- 172.21.15.123:0/177389021 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e003f070 con 0x7f26f00cf9c0 2024-09-15T23:12:22.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.377+0000 7faa2759e640 1 -- 172.21.15.123:0/450408110 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa2815a2c0 con 0x7faa280cf120 2024-09-15T23:12:22.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.377+0000 7f6ace1c4640 1 -- 172.21.15.123:0/1132596279 shutdown_connections 2024-09-15T23:12:22.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.377+0000 7f1baf7fe640 1 --2- 172.21.15.123:0/1281718515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb00b3d80 0x7f1bb0144720 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0070380 tx=0x7f1ba002a1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74599e117dcc6526 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.377+0000 7f26e7fff640 1 -- 172.21.15.123:0/177389021 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26e002ae60 con 0x7f26f00cf9c0 2024-09-15T23:12:22.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.377+0000 7f26e7fff640 1 -- 172.21.15.123:0/177389021 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e003f070 con 0x7f26f00cf9c0 2024-09-15T23:12:22.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.377+0000 7f26f5fb0640 1 -- 172.21.15.123:0/177389021 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26f00b1570 con 0x7f26f00cf9c0 2024-09-15T23:12:22.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.377+0000 7f10b77fe640 1 --2- 172.21.15.123:0/493633953 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10b00e1860 0x7f10b004b330 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f10b80745e0 tx=0x7f10b80697d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.377+0000 7f26f5fb0640 1 -- 172.21.15.123:0/177389021 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26f00b1b30 con 0x7f26f00cf9c0 2024-09-15T23:12:22.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.377+0000 7f109f7fe640 1 -- 172.21.15.123:0/493633953 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b8074260 con 0x7f10b00e1860 2024-09-15T23:12:22.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.377+0000 7f109f7fe640 1 -- 172.21.15.123:0/493633953 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10b80733d0 con 0x7f10b00e1860 2024-09-15T23:12:22.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.377+0000 7f109f7fe640 1 -- 172.21.15.123:0/493633953 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b8073840 con 0x7f10b00e1860 2024-09-15T23:12:22.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.377+0000 7f10b7fff640 1 -- 172.21.15.123:0/493633953 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10b004bf10 con 0x7f10b00e1860 2024-09-15T23:12:22.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.378+0000 7f10b7fff640 1 -- 172.21.15.123:0/493633953 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10b003afa0 con 0x7f10b00e1860 2024-09-15T23:12:22.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.376+0000 7f3504423640 1 -- start start 2024-09-15T23:12:22.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.378+0000 7f3504423640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34fc072c80 0x7f34fc1f4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.378+0000 7f3504423640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34fc144170 0x7f34fc12bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.378+0000 7f3504423640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34fc15b430 0x7f34fc12c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.378+0000 7f3504423640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f34fc0b4440 con 0x7f34fc144170 2024-09-15T23:12:22.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.378+0000 7f3504423640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f34fc144550 con 0x7f34fc072c80 2024-09-15T23:12:22.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.378+0000 7f3504423640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f34fc0b45c0 con 0x7f34fc15b430 2024-09-15T23:12:22.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.378+0000 7fd68effd640 1 -- 172.21.15.123:0/1611456264 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd690017070 con 0x7fd6a00b1c30 2024-09-15T23:12:22.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.377+0000 7fd6a4dbd640 1 -- 172.21.15.123:0/1611456264 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6a0159b70 con 0x7fd6a00b1c30 2024-09-15T23:12:22.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.377+0000 7fd6e60c8640 1 -- start start 2024-09-15T23:12:22.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.378+0000 7fd68effd640 1 --2- 172.21.15.123:0/1611456264 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd68006c3b0 0x7fd68006e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.378+0000 7fd6e60c8640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6cc005210 0x7fd6e0200c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.379+0000 7fd68effd640 1 -- 172.21.15.123:0/1611456264 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd69008b140 con 0x7fd6a00b1c30 2024-09-15T23:12:22.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.378+0000 7fd6e60c8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6e00cc0e0 0x7fd6e0159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.378+0000 7fd6e60c8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6e00cd5f0 0x7fd6e00cda70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.378+0000 7fd6e60c8640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e015e8a0 con 0x7fd6e00cc0e0 2024-09-15T23:12:22.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.378+0000 7fd6e60c8640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e00cfba0 con 0x7fd6e00cd5f0 2024-09-15T23:12:22.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.378+0000 7fd6e60c8640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd6e015ea20 con 0x7fd6cc005210 2024-09-15T23:12:22.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.379+0000 7fd6e50c6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6cc005210 0x7fd6e0200c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.379+0000 7fd6e50c6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6cc005210 0x7fd6e0200c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:41424/0 (socket says 172.21.15.123:41424) 2024-09-15T23:12:22.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.379+0000 7fd6e50c6640 1 -- 172.21.15.123:0/3806137885 learned_addr learned my addr 172.21.15.123:0/3806137885 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:22.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.379+0000 7fd69dd9b640 1 --2- 172.21.15.123:0/1611456264 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd68006c3b0 0x7fd68006e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.379+0000 7f35029c0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34fc15b430 0x7f34fc12c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.379+0000 7f35029c0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34fc15b430 0x7f34fc12c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:41436/0 (socket says 172.21.15.123:41436) 2024-09-15T23:12:22.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.379+0000 7f35029c0640 1 -- 172.21.15.123:0/230214652 learned_addr learned my addr 172.21.15.123:0/230214652 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:22.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.379+0000 7f35021bf640 1 --2- 172.21.15.123:0/230214652 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34fc072c80 0x7f34fc1f4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.379+0000 7f10b7fff640 1 -- 172.21.15.123:0/493633953 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10b003adb0 con 0x7f10b00e1860 2024-09-15T23:12:22.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.379+0000 7f1baeffd640 1 -- 172.21.15.123:0/1281718515 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0037070 con 0x7f1bb00b3d80 2024-09-15T23:12:22.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.379+0000 7f1baeffd640 1 -- 172.21.15.123:0/1281718515 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ba0032440 con 0x7f1bb00b3d80 2024-09-15T23:12:22.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.379+0000 7f1baeffd640 1 -- 172.21.15.123:0/1281718515 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0032810 con 0x7f1bb00b3d80 2024-09-15T23:12:22.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.379+0000 7faa16ffd640 1 -- 172.21.15.123:0/450408110 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7faa1c01a070 con 0x7faa280cf120 2024-09-15T23:12:22.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.379+0000 7faa16ffd640 1 --2- 172.21.15.123:0/450408110 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7faa0806c3b0 0x7faa0806e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.379+0000 7faa16ffd640 1 -- 172.21.15.123:0/450408110 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7faa1c08ad00 con 0x7faa280cf120 2024-09-15T23:12:22.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.380+0000 7faa2759e640 1 -- 172.21.15.123:0/450408110 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa280cebe0 con 0x7faa280cf120 2024-09-15T23:12:22.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.380+0000 7faa2659c640 1 --2- 172.21.15.123:0/450408110 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7faa0806c3b0 0x7faa0806e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.379+0000 7f6ace1c4640 1 -- 172.21.15.123:0/1132596279 wait complete. 2024-09-15T23:12:22.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.379+0000 7fd6e58c7640 1 --2- 172.21.15.123:0/3806137885 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6e00cd5f0 0x7fd6e00cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.379+0000 7fd6e48c5640 1 --2- 172.21.15.123:0/3806137885 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6e00cc0e0 0x7fd6e0159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.380+0000 7f35029c0640 1 -- 172.21.15.123:0/230214652 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34fc072c80 msgr2=0x7f34fc1f4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.380+0000 7f35029c0640 1 --2- 172.21.15.123:0/230214652 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34fc072c80 0x7f34fc1f4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.380+0000 7f35029c0640 1 -- 172.21.15.123:0/230214652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34fc144170 msgr2=0x7f34fc12bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.380+0000 7f35029c0640 1 --2- 172.21.15.123:0/230214652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34fc144170 0x7f34fc12bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.380+0000 7f35029c0640 1 -- 172.21.15.123:0/230214652 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34fc1f4590 con 0x7f34fc15b430 2024-09-15T23:12:22.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.379+0000 7f26f5fb0640 1 -- 172.21.15.123:0/177389021 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26f00b1d30 con 0x7f26f00cf9c0 2024-09-15T23:12:22.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.380+0000 7f26e7fff640 1 -- 172.21.15.123:0/177389021 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f26e00319c0 con 0x7f26f00cf9c0 2024-09-15T23:12:22.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.380+0000 7fd6e48c5640 1 -- 172.21.15.123:0/3806137885 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6cc005210 msgr2=0x7fd6e0200c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.380+0000 7fd6e48c5640 1 --2- 172.21.15.123:0/3806137885 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6cc005210 0x7fd6e0200c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.380+0000 7fd6e48c5640 1 -- 172.21.15.123:0/3806137885 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6e00cd5f0 msgr2=0x7fd6e00cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.380+0000 7fd6e48c5640 1 --2- 172.21.15.123:0/3806137885 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6e00cd5f0 0x7fd6e00cda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.380+0000 7fd6e48c5640 1 -- 172.21.15.123:0/3806137885 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e00cc6a0 con 0x7fd6e00cc0e0 2024-09-15T23:12:22.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.380+0000 7f26e7fff640 1 --2- 172.21.15.123:0/177389021 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f26d006c4b0 0x7f26d006e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.380+0000 7f35029c0640 1 --2- 172.21.15.123:0/230214652 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34fc15b430 0x7f34fc12c310 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f34ec00f9d0 tx=0x7f34ec00fe90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.380+0000 7fd6e48c5640 1 --2- 172.21.15.123:0/3806137885 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6e00cc0e0 0x7fd6e0159c20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd6d800fae0 tx=0x7fd6d80021c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.380+0000 7f1bb5a77640 1 -- 172.21.15.123:0/1281718515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb00b3d80 msgr2=0x7f1bb0144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.380+0000 7f1bb5a77640 1 --2- 172.21.15.123:0/1281718515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb00b3d80 0x7f1bb0144720 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0070380 tx=0x7f1ba002a1d0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.380+0000 7f1bb5a77640 1 -- 172.21.15.123:0/1281718515 shutdown_connections 2024-09-15T23:12:22.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.380+0000 7f1bb5a77640 1 --2- 172.21.15.123:0/1281718515 >> v2:172.21.15.188:3300/0 conn(0x7f1bb00b4bc0 0x7f1bb006dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.380+0000 7f1bb5a77640 1 --2- 172.21.15.123:0/1281718515 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1bb015b1a0 0x7f1bb0067950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.380+0000 7f1bb5a77640 1 --2- 172.21.15.123:0/1281718515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb00b3d80 0x7f1bb0144720 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.380+0000 7f1bb5a77640 1 -- 172.21.15.123:0/1281718515 >> 172.21.15.123:0/1281718515 conn(0x7f1bb00d1050 msgr2=0x7f1bb00d1460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:22.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.380+0000 7f26e7fff640 1 -- 172.21.15.123:0/177389021 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f26e00ac340 con 0x7f26f00cf9c0 2024-09-15T23:12:22.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.380+0000 7faa2659c640 1 --2- 172.21.15.123:0/450408110 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7faa0806c3b0 0x7faa0806e870 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faa18000f60 tx=0x7faa18009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.380+0000 7f109f7fe640 1 -- 172.21.15.123:0/493633953 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f10b8094030 con 0x7f10b00e1860 2024-09-15T23:12:22.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.381+0000 7f26eeffd640 1 --2- 172.21.15.123:0/177389021 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f26d006c4b0 0x7f26d006e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.381+0000 7f1bb5a77640 1 -- 172.21.15.123:0/1281718515 shutdown_connections 2024-09-15T23:12:22.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.381+0000 7f1bb5a77640 1 -- 172.21.15.123:0/1281718515 wait complete. 2024-09-15T23:12:22.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.381+0000 7fd69dd9b640 1 --2- 172.21.15.123:0/1611456264 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd68006c3b0 0x7fd68006e870 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd6a015ffc0 tx=0x7fd694008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.381+0000 7f109f7fe640 1 --2- 172.21.15.123:0/493633953 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f10a406c380 0x7f10a406e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.381+0000 7f26eeffd640 1 --2- 172.21.15.123:0/177389021 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f26d006c4b0 0x7f26d006e970 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f26f00cb740 tx=0x7f26e8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.381+0000 7f6ace1c4640 1 Processor -- start 2024-09-15T23:12:22.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.381+0000 7f109f7fe640 1 -- 172.21.15.123:0/493633953 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f10b8107540 con 0x7f10b00e1860 2024-09-15T23:12:22.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.381+0000 7f10b6ffd640 1 --2- 172.21.15.123:0/493633953 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f10a406c380 0x7f10a406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.381+0000 7f6ace1c4640 1 -- start start 2024-09-15T23:12:22.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.382+0000 7f10b6ffd640 1 --2- 172.21.15.123:0/493633953 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f10a406c380 0x7f10a406e840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f10a8034000 tx=0x7f10a802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.382+0000 7f1bb5a77640 1 Processor -- start 2024-09-15T23:12:22.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.382+0000 7f1bb5a77640 1 -- start start 2024-09-15T23:12:22.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.382+0000 7f6ace1c4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ac806c150 0x7f6ac8151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.382+0000 7f6ace1c4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ac8073c70 0x7f6ac8154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.382+0000 7f6ace1c4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ac8144300 0x7f6ac8154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.382+0000 7f6ace1c4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac80718b0 con 0x7f6ac806c150 2024-09-15T23:12:22.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.382+0000 7f6ace1c4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac80715d0 con 0x7f6ac8144300 2024-09-15T23:12:22.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.382+0000 7f6ace1c4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6ac8074100 con 0x7f6ac8073c70 2024-09-15T23:12:22.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.382+0000 7f6ac77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ac806c150 0x7f6ac8151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.382+0000 7f6ac77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ac806c150 0x7f6ac8151e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36432/0 (socket says 172.21.15.123:36432) 2024-09-15T23:12:22.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.382+0000 7f6ac77fe640 1 -- 172.21.15.123:0/3864354101 learned_addr learned my addr 172.21.15.123:0/3864354101 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:22.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.382+0000 7f6ac6ffd640 1 --2- 172.21.15.123:0/3864354101 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ac8073c70 0x7f6ac8154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.383+0000 7f6ac77fe640 1 -- 172.21.15.123:0/3864354101 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ac8073c70 msgr2=0x7f6ac8154320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.383+0000 7f6ac77fe640 1 --2- 172.21.15.123:0/3864354101 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ac8073c70 0x7f6ac8154320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.383+0000 7f6ac77fe640 1 -- 172.21.15.123:0/3864354101 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ac8144300 msgr2=0x7f6ac8154860 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T23:12:22.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.383+0000 7f6ac77fe640 1 --2- 172.21.15.123:0/3864354101 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ac8144300 0x7f6ac8154860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.383+0000 7f6ac77fe640 1 -- 172.21.15.123:0/3864354101 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac8152ca0 con 0x7f6ac806c150 2024-09-15T23:12:22.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.383+0000 7f6ac6ffd640 1 --2- 172.21.15.123:0/3864354101 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ac8073c70 0x7f6ac8154320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:12:22.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.383+0000 7f6ac77fe640 1 --2- 172.21.15.123:0/3864354101 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ac806c150 0x7f6ac8151e20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6ab800bfd0 tx=0x7f6ab800df60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.383+0000 7f1bb5a77640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb00b4bc0 0x7f1bb0140a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.383+0000 7f1bb5a77640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1bb015b1a0 0x7f1bb00cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.383+0000 7f1bb5a77640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1bb013d690 0x7f1bb0143430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.383+0000 7f1baf7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb00b4bc0 0x7f1bb0140a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.383+0000 7f1bb5a77640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb0068010 con 0x7f1bb00b4bc0 2024-09-15T23:12:22.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.383+0000 7f1bb5a77640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb0067e90 con 0x7f1bb015b1a0 2024-09-15T23:12:22.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.383+0000 7f1baf7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb00b4bc0 0x7f1bb0140a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36440/0 (socket says 172.21.15.123:36440) 2024-09-15T23:12:22.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.383+0000 7f1baf7fe640 1 -- 172.21.15.123:0/4249234236 learned_addr learned my addr 172.21.15.123:0/4249234236 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:22.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.383+0000 7f1bb5a77640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb015b5e0 con 0x7f1bb013d690 2024-09-15T23:12:22.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.383+0000 7f1ba7fff640 1 --2- 172.21.15.123:0/4249234236 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1bb015b1a0 0x7f1bb00cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.383+0000 7f1baffff640 1 --2- 172.21.15.123:0/4249234236 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1bb013d690 0x7f1bb0143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.383+0000 7f1baf7fe640 1 -- 172.21.15.123:0/4249234236 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1bb013d690 msgr2=0x7f1bb0143430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.383+0000 7f1baf7fe640 1 --2- 172.21.15.123:0/4249234236 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1bb013d690 0x7f1bb0143430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.383+0000 7f1baf7fe640 1 -- 172.21.15.123:0/4249234236 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1bb015b1a0 msgr2=0x7f1bb00cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.383+0000 7f1baf7fe640 1 --2- 172.21.15.123:0/4249234236 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1bb015b1a0 0x7f1bb00cfdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.383+0000 7f1baf7fe640 1 -- 172.21.15.123:0/4249234236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb0140fb0 con 0x7f1bb00b4bc0 2024-09-15T23:12:22.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.384+0000 7f1baf7fe640 1 --2- 172.21.15.123:0/4249234236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb00b4bc0 0x7f1bb0140a70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1ba002a740 tx=0x7f1ba00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.384+0000 7f34f2ffd640 1 -- 172.21.15.123:0/230214652 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ec009bf0 con 0x7f34fc15b430 2024-09-15T23:12:22.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.384+0000 7f34f2ffd640 1 -- 172.21.15.123:0/230214652 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34ec009d90 con 0x7f34fc15b430 2024-09-15T23:12:22.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.384+0000 7fd68effd640 1 -- 172.21.15.123:0/1611456264 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd6a0159b70 con 0x7fd6a00b1c30 2024-09-15T23:12:22.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.385+0000 7f34f2ffd640 1 -- 172.21.15.123:0/230214652 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ec011670 con 0x7f34fc15b430 2024-09-15T23:12:22.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.385+0000 7f3504423640 1 -- 172.21.15.123:0/230214652 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34fc0ac450 con 0x7f34fc15b430 2024-09-15T23:12:22.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.385+0000 7f3504423640 1 -- 172.21.15.123:0/230214652 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f34fc12cc20 con 0x7f34fc15b430 2024-09-15T23:12:22.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.385+0000 7f109f7fe640 1 -- 172.21.15.123:0/493633953 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f10b809b020 con 0x7f10b00e1860 2024-09-15T23:12:22.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.386+0000 7faa16ffd640 1 -- 172.21.15.123:0/450408110 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faa1c059450 con 0x7faa280cf120 2024-09-15T23:12:22.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.386+0000 7f3504423640 1 -- 172.21.15.123:0/230214652 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34fc0b3d00 con 0x7f34fc15b430 2024-09-15T23:12:22.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.387+0000 7f34f2ffd640 1 -- 172.21.15.123:0/230214652 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f34ec011810 con 0x7f34fc15b430 2024-09-15T23:12:22.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.387+0000 7f34f2ffd640 1 --2- 172.21.15.123:0/230214652 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f34e006c300 0x7f34e006e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.387+0000 7f34f2ffd640 1 -- 172.21.15.123:0/230214652 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f34ec08d880 con 0x7f34fc15b430 2024-09-15T23:12:22.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.388+0000 7f35021bf640 1 --2- 172.21.15.123:0/230214652 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f34e006c300 0x7f34e006e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.388+0000 7f35021bf640 1 --2- 172.21.15.123:0/230214652 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f34e006c300 0x7f34e006e7c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f34f4033000 tx=0x7f34f4009000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.392+0000 7f34f2ffd640 1 -- 172.21.15.123:0/230214652 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f34fc1f4590 con 0x7f34fc15b430 2024-09-15T23:12:22.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.394+0000 7f6aaffff640 1 -- 172.21.15.123:0/3864354101 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab801a070 con 0x7f6ac806c150 2024-09-15T23:12:22.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.394+0000 7f6ace1c4640 1 -- 172.21.15.123:0/3864354101 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac81566d0 con 0x7f6ac806c150 2024-09-15T23:12:22.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.394+0000 7f6ace1c4640 1 -- 172.21.15.123:0/3864354101 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac8156c90 con 0x7f6ac806c150 2024-09-15T23:12:22.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.394+0000 7f26e7fff640 1 -- 172.21.15.123:0/177389021 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f26f00b1d30 con 0x7f26f00cf9c0 2024-09-15T23:12:22.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.394+0000 7f1bacff9640 1 -- 172.21.15.123:0/4249234236 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0041070 con 0x7f1bb00b4bc0 2024-09-15T23:12:22.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.394+0000 7f1bacff9640 1 -- 172.21.15.123:0/4249234236 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ba0030850 con 0x7f1bb00b4bc0 2024-09-15T23:12:22.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.394+0000 7f1bacff9640 1 -- 172.21.15.123:0/4249234236 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0037040 con 0x7f1bb00b4bc0 2024-09-15T23:12:22.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.394+0000 7f1bb5a77640 1 -- 172.21.15.123:0/4249234236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bb0158a10 con 0x7f1bb00b4bc0 2024-09-15T23:12:22.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.394+0000 7f1bb5a77640 1 -- 172.21.15.123:0/4249234236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bb0158c90 con 0x7f1bb00b4bc0 2024-09-15T23:12:22.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.394+0000 7fd6d5ffb640 1 -- 172.21.15.123:0/3806137885 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d8003c40 con 0x7fd6e00cc0e0 2024-09-15T23:12:22.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.394+0000 7fd6e60c8640 1 -- 172.21.15.123:0/3806137885 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6e00cc980 con 0x7fd6e00cc0e0 2024-09-15T23:12:22.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.394+0000 7fd6e60c8640 1 -- 172.21.15.123:0/3806137885 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6e0201160 con 0x7fd6e00cc0e0 2024-09-15T23:12:22.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.395+0000 7fd6e60c8640 1 -- 172.21.15.123:0/3806137885 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6e0162b70 con 0x7fd6e00cc0e0 2024-09-15T23:12:22.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.396+0000 7f6aaffff640 1 -- 172.21.15.123:0/3864354101 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ab800aaf0 con 0x7f6ac806c150 2024-09-15T23:12:22.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.396+0000 7f6aaffff640 1 -- 172.21.15.123:0/3864354101 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab8004030 con 0x7f6ac806c150 2024-09-15T23:12:22.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.397+0000 7f6aadffb640 1 -- 172.21.15.123:0/3864354101 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ac8068480 con 0x7f6ac806c150 2024-09-15T23:12:22.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.395+0000 7fd6d5ffb640 1 -- 172.21.15.123:0/3806137885 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6d8018070 con 0x7fd6e00cc0e0 2024-09-15T23:12:22.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.395+0000 7fd6d5ffb640 1 -- 172.21.15.123:0/3806137885 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d800d820 con 0x7fd6e00cc0e0 2024-09-15T23:12:22.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.398+0000 7f1bb5a77640 1 -- 172.21.15.123:0/4249234236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b94005290 con 0x7f1bb00b4bc0 2024-09-15T23:12:22.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.399+0000 7fd6d5ffb640 1 -- 172.21.15.123:0/3806137885 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd6d800d9c0 con 0x7fd6e00cc0e0 2024-09-15T23:12:22.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.400+0000 7fd6d5ffb640 1 --2- 172.21.15.123:0/3806137885 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd6c406c300 0x7fd6c406e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.400+0000 7fd6e50c6640 1 --2- 172.21.15.123:0/3806137885 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd6c406c300 0x7fd6c406e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.400+0000 7fd6d5ffb640 1 -- 172.21.15.123:0/3806137885 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd6d808bfb0 con 0x7fd6e00cc0e0 2024-09-15T23:12:22.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.400+0000 7fd6e50c6640 1 --2- 172.21.15.123:0/3806137885 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd6c406c300 0x7fd6c406e7c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0007d40 tx=0x7fd6d0007d70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.405+0000 7fd6d5ffb640 1 -- 172.21.15.123:0/3806137885 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd6d80bad50 con 0x7fd6e00cc0e0 2024-09-15T23:12:22.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.409+0000 7f6aaffff640 1 -- 172.21.15.123:0/3864354101 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6ab801d070 con 0x7f6ac806c150 2024-09-15T23:12:22.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.410+0000 7f6aaffff640 1 --2- 172.21.15.123:0/3864354101 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6ab406c2b0 0x7f6ab406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.410+0000 7f6aaffff640 1 -- 172.21.15.123:0/3864354101 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f6ab808b5d0 con 0x7f6ac806c150 2024-09-15T23:12:22.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.410+0000 7f1bacff9640 1 -- 172.21.15.123:0/4249234236 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1ba0044070 con 0x7f1bb00b4bc0 2024-09-15T23:12:22.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.410+0000 7f1bacff9640 1 --2- 172.21.15.123:0/4249234236 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1b9006c380 0x7f1b9006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:22.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.410+0000 7f1bacff9640 1 -- 172.21.15.123:0/4249234236 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1ba00ac250 con 0x7f1bb00b4bc0 2024-09-15T23:12:22.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.411+0000 7f6ac6ffd640 1 --2- 172.21.15.123:0/3864354101 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6ab406c2b0 0x7f6ab406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.411+0000 7f1ba7fff640 1 --2- 172.21.15.123:0/4249234236 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1b9006c380 0x7f1b9006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:22.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.412+0000 7f6ac6ffd640 1 --2- 172.21.15.123:0/3864354101 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6ab406c2b0 0x7f6ab406e770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6abc034000 tx=0x7f6abc02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.412+0000 7f1ba7fff640 1 --2- 172.21.15.123:0/4249234236 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1b9006c380 0x7f1b9006e840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1b980098e0 tx=0x7f1b98009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:22.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.416+0000 7f6aaffff640 1 -- 172.21.15.123:0/3864354101 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6ab80596d0 con 0x7f6ac806c150 2024-09-15T23:12:22.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.425+0000 7f1bacff9640 1 -- 172.21.15.123:0/4249234236 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1bb0158a10 con 0x7f1bb00b4bc0 2024-09-15T23:12:22.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.765+0000 7fd6a4dbd640 1 -- 172.21.15.123:0/1611456264 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fd6a015b5e0 con 0x7fd6a00b1c30 2024-09-15T23:12:22.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.766+0000 7fd68effd640 1 -- 172.21.15.123:0/1611456264 <== mon.2 v2:172.21.15.188:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd690059240 con 0x7fd6a00b1c30 2024-09-15T23:12:22.767 INFO:teuthology.orchestra.run.smithi123.stdout:60129542148 2024-09-15T23:12:22.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.767+0000 7f10b7fff640 1 -- 172.21.15.123:0/493633953 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f10b0056790 con 0x7f10b00e1860 2024-09-15T23:12:22.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.768+0000 7f109f7fe640 1 -- 172.21.15.123:0/493633953 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f10b80d5d20 con 0x7f10b00e1860 2024-09-15T23:12:22.769 INFO:teuthology.orchestra.run.smithi123.stdout:68719476743 2024-09-15T23:12:22.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.769+0000 7fd68cff9640 1 -- 172.21.15.123:0/1611456264 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd68006c3b0 msgr2=0x7fd68006e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.769+0000 7fd68cff9640 1 --2- 172.21.15.123:0/1611456264 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd68006c3b0 0x7fd68006e870 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd6a015ffc0 tx=0x7fd694008040 comp rx=0 tx=0).stop 2024-09-15T23:12:22.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.769+0000 7fd68cff9640 1 -- 172.21.15.123:0/1611456264 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6a00b1c30 msgr2=0x7fd6a0151020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.770+0000 7fd68cff9640 1 --2- 172.21.15.123:0/1611456264 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6a00b1c30 0x7fd6a0151020 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd69000b4d0 tx=0x7fd69000b990 comp rx=0 tx=0).stop 2024-09-15T23:12:22.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.770+0000 7fd68cff9640 1 -- 172.21.15.123:0/1611456264 shutdown_connections 2024-09-15T23:12:22.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.770+0000 7fd68cff9640 1 --2- 172.21.15.123:0/1611456264 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd68006c3b0 0x7fd68006e870 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.770+0000 7fd68cff9640 1 --2- 172.21.15.123:0/1611456264 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6a0162c30 0x7fd6a014f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.770+0000 7fd68cff9640 1 --2- 172.21.15.123:0/1611456264 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6a00b3df0 0x7fd6a0160220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.770+0000 7fd68cff9640 1 --2- 172.21.15.123:0/1611456264 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6a00b1c30 0x7fd6a0151020 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.770+0000 7fd68cff9640 1 -- 172.21.15.123:0/1611456264 >> 172.21.15.123:0/1611456264 conn(0x7fd6a006cd20 msgr2=0x7fd6a00b60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:22.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.770+0000 7fd68cff9640 1 -- 172.21.15.123:0/1611456264 shutdown_connections 2024-09-15T23:12:22.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.770+0000 7fd68cff9640 1 -- 172.21.15.123:0/1611456264 wait complete. 2024-09-15T23:12:22.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.770+0000 7faa2759e640 1 -- 172.21.15.123:0/450408110 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7faa281419e0 con 0x7faa280cf120 2024-09-15T23:12:22.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.771+0000 7faa16ffd640 1 -- 172.21.15.123:0/450408110 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faa1c058d50 con 0x7faa280cf120 2024-09-15T23:12:22.773 INFO:teuthology.orchestra.run.smithi123.stdout:68719476743 2024-09-15T23:12:22.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.771+0000 7f10b7fff640 1 -- 172.21.15.123:0/493633953 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f10a406c380 msgr2=0x7f10a406e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.771+0000 7f10b7fff640 1 --2- 172.21.15.123:0/493633953 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f10a406c380 0x7f10a406e840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f10a8034000 tx=0x7f10a802e000 comp rx=0 tx=0).stop 2024-09-15T23:12:22.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.772+0000 7f10b7fff640 1 -- 172.21.15.123:0/493633953 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10b00e1860 msgr2=0x7f10b004b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.772+0000 7f10b7fff640 1 --2- 172.21.15.123:0/493633953 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10b00e1860 0x7f10b004b330 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f10b80745e0 tx=0x7f10b80697d0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.772+0000 7f10b7fff640 1 -- 172.21.15.123:0/493633953 shutdown_connections 2024-09-15T23:12:22.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.772+0000 7f10b7fff640 1 --2- 172.21.15.123:0/493633953 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f10a406c380 0x7f10a406e840 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.772+0000 7f10b7fff640 1 --2- 172.21.15.123:0/493633953 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10b00e1860 0x7f10b004b330 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.772+0000 7f10b7fff640 1 --2- 172.21.15.123:0/493633953 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f10b0057400 0x7f10b000c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.772+0000 7f10b7fff640 1 --2- 172.21.15.123:0/493633953 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f10b0053600 0x7f10b003b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.772+0000 7f10b7fff640 1 -- 172.21.15.123:0/493633953 >> 172.21.15.123:0/493633953 conn(0x7f10b001fb40 msgr2=0x7f10b0054300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:22.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.773+0000 7f10b7fff640 1 -- 172.21.15.123:0/493633953 shutdown_connections 2024-09-15T23:12:22.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.773+0000 7f10b7fff640 1 -- 172.21.15.123:0/493633953 wait complete. 2024-09-15T23:12:22.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.774+0000 7faa14ff9640 1 -- 172.21.15.123:0/450408110 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7faa0806c3b0 msgr2=0x7faa0806e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.775+0000 7faa14ff9640 1 --2- 172.21.15.123:0/450408110 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7faa0806c3b0 0x7faa0806e870 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faa18000f60 tx=0x7faa18009040 comp rx=0 tx=0).stop 2024-09-15T23:12:22.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.775+0000 7faa14ff9640 1 -- 172.21.15.123:0/450408110 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa280cf120 msgr2=0x7faa2813fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.775+0000 7faa14ff9640 1 --2- 172.21.15.123:0/450408110 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa280cf120 0x7faa2813fda0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00e840 tx=0x7faa1c00ed00 comp rx=0 tx=0).stop 2024-09-15T23:12:22.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.775+0000 7faa14ff9640 1 -- 172.21.15.123:0/450408110 shutdown_connections 2024-09-15T23:12:22.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.775+0000 7faa14ff9640 1 --2- 172.21.15.123:0/450408110 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faa281443e0 0x7faa2806e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.775+0000 7faa14ff9640 1 --2- 172.21.15.123:0/450408110 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faa280cf120 0x7faa2813fda0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.775+0000 7faa14ff9640 1 --2- 172.21.15.123:0/450408110 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7faa0806c3b0 0x7faa0806e870 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faa18000f60 tx=0x7faa18009040 comp rx=0 tx=0).stop 2024-09-15T23:12:22.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.775+0000 7faa14ff9640 1 --2- 172.21.15.123:0/450408110 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa2806c320 0x7faa28159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.775+0000 7faa14ff9640 1 -- 172.21.15.123:0/450408110 >> 172.21.15.123:0/450408110 conn(0x7faa28071620 msgr2=0x7faa28073060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:22.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.776+0000 7faa14ff9640 1 -- 172.21.15.123:0/450408110 shutdown_connections 2024-09-15T23:12:22.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.776+0000 7faa14ff9640 1 -- 172.21.15.123:0/450408110 wait complete. 2024-09-15T23:12:22.791 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476744 got 68719476743 for osd.0 2024-09-15T23:12:22.792 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.5 2024-09-15T23:12:22.794 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476744 got 68719476743 for osd.1 2024-09-15T23:12:22.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.795+0000 7f26f5fb0640 1 -- 172.21.15.123:0/177389021 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f26f00d1690 con 0x7f26f00cf9c0 2024-09-15T23:12:22.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.795+0000 7f26e7fff640 1 -- 172.21.15.123:0/177389021 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f26f00b1d30 con 0x7f26f00cf9c0 2024-09-15T23:12:22.797 INFO:teuthology.orchestra.run.smithi123.stdout:68719476741 2024-09-15T23:12:22.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.796+0000 7f3504423640 1 -- 172.21.15.123:0/230214652 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f34fc0aa500 con 0x7f34fc15b430 2024-09-15T23:12:22.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.796+0000 7f34f2ffd640 1 -- 172.21.15.123:0/230214652 <== mon.2 v2:172.21.15.188:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f34ec05c160 con 0x7f34fc15b430 2024-09-15T23:12:22.797 INFO:teuthology.orchestra.run.smithi123.stdout:60129542149 2024-09-15T23:12:22.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.797+0000 7fd6e60c8640 1 -- 172.21.15.123:0/3806137885 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fd6e00ba2b0 con 0x7fd6e00cc0e0 2024-09-15T23:12:22.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.798+0000 7fd6d5ffb640 1 -- 172.21.15.123:0/3806137885 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd6d805a790 con 0x7fd6e00cc0e0 2024-09-15T23:12:22.799 INFO:teuthology.orchestra.run.smithi123.stdout:60129542149 2024-09-15T23:12:22.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.799+0000 7f26f5fb0640 1 -- 172.21.15.123:0/177389021 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f26d006c4b0 msgr2=0x7f26d006e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.799+0000 7f26f5fb0640 1 --2- 172.21.15.123:0/177389021 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f26d006c4b0 0x7f26d006e970 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f26f00cb740 tx=0x7f26e8009040 comp rx=0 tx=0).stop 2024-09-15T23:12:22.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.799+0000 7f26f5fb0640 1 -- 172.21.15.123:0/177389021 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26f00cf9c0 msgr2=0x7f26f01f71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.799+0000 7f26f5fb0640 1 --2- 172.21.15.123:0/177389021 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26f00cf9c0 0x7f26f01f71f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f26e0031000 tx=0x7f26e0004a40 comp rx=0 tx=0).stop 2024-09-15T23:12:22.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.799+0000 7f26f5fb0640 1 -- 172.21.15.123:0/177389021 shutdown_connections 2024-09-15T23:12:22.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.799+0000 7f26f5fb0640 1 --2- 172.21.15.123:0/177389021 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26f015e950 0x7f26f00cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.799+0000 7f26f5fb0640 1 --2- 172.21.15.123:0/177389021 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26f00d1bd0 0x7f26f01f53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.799+0000 7f26f5fb0640 1 --2- 172.21.15.123:0/177389021 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f26d006c4b0 0x7f26d006e970 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.799+0000 7f26f5fb0640 1 --2- 172.21.15.123:0/177389021 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26f00cf9c0 0x7f26f01f71f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.799+0000 7f26f5fb0640 1 -- 172.21.15.123:0/177389021 >> 172.21.15.123:0/177389021 conn(0x7f26f0067b30 msgr2=0x7f26f00b57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:22.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.799+0000 7f26f5fb0640 1 -- 172.21.15.123:0/177389021 shutdown_connections 2024-09-15T23:12:22.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.799+0000 7f26f5fb0640 1 -- 172.21.15.123:0/177389021 wait complete. 2024-09-15T23:12:22.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.800+0000 7f3504423640 1 -- 172.21.15.123:0/230214652 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f34e006c300 msgr2=0x7f34e006e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.800+0000 7f3504423640 1 --2- 172.21.15.123:0/230214652 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f34e006c300 0x7f34e006e7c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f34f4033000 tx=0x7f34f4009000 comp rx=0 tx=0).stop 2024-09-15T23:12:22.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.800+0000 7f3504423640 1 -- 172.21.15.123:0/230214652 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34fc15b430 msgr2=0x7f34fc12c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.800+0000 7f3504423640 1 --2- 172.21.15.123:0/230214652 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34fc15b430 0x7f34fc12c310 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f34ec00f9d0 tx=0x7f34ec00fe90 comp rx=0 tx=0).stop 2024-09-15T23:12:22.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.800+0000 7f3504423640 1 -- 172.21.15.123:0/230214652 shutdown_connections 2024-09-15T23:12:22.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.800+0000 7f3504423640 1 --2- 172.21.15.123:0/230214652 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34fc15b430 0x7f34fc12c310 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.800+0000 7f3504423640 1 --2- 172.21.15.123:0/230214652 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f34e006c300 0x7f34e006e7c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.800+0000 7f3504423640 1 --2- 172.21.15.123:0/230214652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34fc144170 0x7f34fc12bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.800+0000 7f3504423640 1 --2- 172.21.15.123:0/230214652 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34fc072c80 0x7f34fc1f4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.800+0000 7f3504423640 1 -- 172.21.15.123:0/230214652 >> 172.21.15.123:0/230214652 conn(0x7f34fc06d0f0 msgr2=0x7f34fc0b3470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:22.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.800+0000 7f3504423640 1 -- 172.21.15.123:0/230214652 shutdown_connections 2024-09-15T23:12:22.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.800+0000 7f3504423640 1 -- 172.21.15.123:0/230214652 wait complete. 2024-09-15T23:12:22.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.800+0000 7fd6e60c8640 1 -- 172.21.15.123:0/3806137885 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd6c406c300 msgr2=0x7fd6c406e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.801+0000 7fd6e60c8640 1 --2- 172.21.15.123:0/3806137885 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd6c406c300 0x7fd6c406e7c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0007d40 tx=0x7fd6d0007d70 comp rx=0 tx=0).stop 2024-09-15T23:12:22.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.801+0000 7fd6e60c8640 1 -- 172.21.15.123:0/3806137885 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6e00cc0e0 msgr2=0x7fd6e0159c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.801+0000 7fd6e60c8640 1 --2- 172.21.15.123:0/3806137885 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6e00cc0e0 0x7fd6e0159c20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd6d800fae0 tx=0x7fd6d80021c0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.801+0000 7fd6e60c8640 1 -- 172.21.15.123:0/3806137885 shutdown_connections 2024-09-15T23:12:22.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.801+0000 7fd6e60c8640 1 --2- 172.21.15.123:0/3806137885 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6e00cd5f0 0x7fd6e00cda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.801+0000 7fd6e60c8640 1 --2- 172.21.15.123:0/3806137885 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd6c406c300 0x7fd6c406e7c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.801+0000 7fd6e60c8640 1 --2- 172.21.15.123:0/3806137885 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6e00cc0e0 0x7fd6e0159c20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.801+0000 7fd6e60c8640 1 --2- 172.21.15.123:0/3806137885 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6cc005210 0x7fd6e0200c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.801+0000 7fd6e60c8640 1 -- 172.21.15.123:0/3806137885 >> 172.21.15.123:0/3806137885 conn(0x7fd6e00d1080 msgr2=0x7fd6e00d14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:22.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.801+0000 7fd6e60c8640 1 -- 172.21.15.123:0/3806137885 shutdown_connections 2024-09-15T23:12:22.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.801+0000 7fd6e60c8640 1 -- 172.21.15.123:0/3806137885 wait complete. 2024-09-15T23:12:22.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.801+0000 7f6aadffb640 1 -- 172.21.15.123:0/3864354101 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f6ac80cf510 con 0x7f6ac806c150 2024-09-15T23:12:22.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.802+0000 7f6aaffff640 1 -- 172.21.15.123:0/3864354101 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6ab805d9d0 con 0x7f6ac806c150 2024-09-15T23:12:22.805 INFO:teuthology.orchestra.run.smithi123.stdout:68719476744 2024-09-15T23:12:22.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.804+0000 7f6aadffb640 1 -- 172.21.15.123:0/3864354101 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6ab406c2b0 msgr2=0x7f6ab406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.804+0000 7f6aadffb640 1 --2- 172.21.15.123:0/3864354101 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6ab406c2b0 0x7f6ab406e770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6abc034000 tx=0x7f6abc02e000 comp rx=0 tx=0).stop 2024-09-15T23:12:22.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.804+0000 7f6aadffb640 1 -- 172.21.15.123:0/3864354101 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ac806c150 msgr2=0x7f6ac8151e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.804+0000 7f6aadffb640 1 --2- 172.21.15.123:0/3864354101 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ac806c150 0x7f6ac8151e20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6ab800bfd0 tx=0x7f6ab800df60 comp rx=0 tx=0).stop 2024-09-15T23:12:22.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.804+0000 7f6aadffb640 1 -- 172.21.15.123:0/3864354101 shutdown_connections 2024-09-15T23:12:22.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.804+0000 7f6aadffb640 1 --2- 172.21.15.123:0/3864354101 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ac8144300 0x7f6ac8154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.804+0000 7f6aadffb640 1 --2- 172.21.15.123:0/3864354101 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ac8073c70 0x7f6ac8154320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.804+0000 7f6aadffb640 1 --2- 172.21.15.123:0/3864354101 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6ab406c2b0 0x7f6ab406e770 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.804+0000 7f6aadffb640 1 --2- 172.21.15.123:0/3864354101 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ac806c150 0x7f6ac8151e20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.804+0000 7f6aadffb640 1 -- 172.21.15.123:0/3864354101 >> 172.21.15.123:0/3864354101 conn(0x7f6ac80ccec0 msgr2=0x7f6ac80ce6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:22.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.804+0000 7f6aadffb640 1 -- 172.21.15.123:0/3864354101 shutdown_connections 2024-09-15T23:12:22.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.804+0000 7f6aadffb640 1 -- 172.21.15.123:0/3864354101 wait complete. 2024-09-15T23:12:22.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.807+0000 7f1bb5a77640 1 -- 172.21.15.123:0/4249234236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f1b94005850 con 0x7f1bb00b4bc0 2024-09-15T23:12:22.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.807+0000 7f1bacff9640 1 -- 172.21.15.123:0/4249234236 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1ba007a350 con 0x7f1bb00b4bc0 2024-09-15T23:12:22.808 INFO:teuthology.orchestra.run.smithi123.stdout:60129542150 2024-09-15T23:12:22.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.809+0000 7f1bb5a77640 1 -- 172.21.15.123:0/4249234236 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1b9006c380 msgr2=0x7f1b9006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.809+0000 7f1bb5a77640 1 --2- 172.21.15.123:0/4249234236 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1b9006c380 0x7f1b9006e840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1b980098e0 tx=0x7f1b98009060 comp rx=0 tx=0).stop 2024-09-15T23:12:22.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.809+0000 7f1bb5a77640 1 -- 172.21.15.123:0/4249234236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb00b4bc0 msgr2=0x7f1bb0140a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:22.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.809+0000 7f1bb5a77640 1 --2- 172.21.15.123:0/4249234236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb00b4bc0 0x7f1bb0140a70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1ba002a740 tx=0x7f1ba00046c0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.810+0000 7f1bb5a77640 1 -- 172.21.15.123:0/4249234236 shutdown_connections 2024-09-15T23:12:22.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.810+0000 7f1bb5a77640 1 --2- 172.21.15.123:0/4249234236 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1bb013d690 0x7f1bb0143430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.810+0000 7f1bb5a77640 1 --2- 172.21.15.123:0/4249234236 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1bb015b1a0 0x7f1bb00cfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.810+0000 7f1bb5a77640 1 --2- 172.21.15.123:0/4249234236 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1b9006c380 0x7f1b9006e840 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.810+0000 7f1bb5a77640 1 --2- 172.21.15.123:0/4249234236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bb00b4bc0 0x7f1bb0140a70 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1ba002a740 tx=0x7f1ba00046c0 comp rx=0 tx=0).stop 2024-09-15T23:12:22.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.810+0000 7f1bb5a77640 1 -- 172.21.15.123:0/4249234236 >> 172.21.15.123:0/4249234236 conn(0x7f1bb00d1050 msgr2=0x7f1bb00725f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:22.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.810+0000 7f1bb5a77640 1 -- 172.21.15.123:0/4249234236 shutdown_connections 2024-09-15T23:12:22.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:22.810+0000 7f1bb5a77640 1 -- 172.21.15.123:0/4249234236 wait complete. 2024-09-15T23:12:22.817 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542149 for osd.7 2024-09-15T23:12:22.820 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476742 got 68719476741 for osd.2 2024-09-15T23:12:22.821 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476745 got 68719476744 for osd.3 2024-09-15T23:12:22.821 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542149 for osd.6 2024-09-15T23:12:22.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542150 for osd.4 2024-09-15T23:12:23.792 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-15T23:12:23.793 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-15T23:12:23.795 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-15T23:12:23.817 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-15T23:12:23.821 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-15T23:12:23.821 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-15T23:12:23.822 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-15T23:12:23.824 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-15T23:12:23.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.951+0000 7f6363d5f640 1 Processor -- start 2024-09-15T23:12:23.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.951+0000 7f6363d5f640 1 -- start start 2024-09-15T23:12:23.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.952+0000 7f296d8b7640 1 Processor -- start 2024-09-15T23:12:23.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.952+0000 7f6363d5f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f635c072630 0x7f635c072aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:23.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.953+0000 7fddf9ef1640 1 Processor -- start 2024-09-15T23:12:23.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.952+0000 7f6363d5f640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f635c0b38e0 con 0x7f635c0d0350 2024-09-15T23:12:23.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.952+0000 7f6363d5f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f635c0b3bc0 con 0x7f635c0b6150 2024-09-15T23:12:23.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.952+0000 7f6363d5f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f635c0b3ea0 con 0x7f635c072630 2024-09-15T23:12:23.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.953+0000 7f63612fa640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f635c0b6150 0x7f635c071f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:48916/0 (socket says 172.21.15.123:48916) 2024-09-15T23:12:23.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.953+0000 7f63612fa640 1 -- 172.21.15.123:0/377234084 learned_addr learned my addr 172.21.15.123:0/377234084 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:23.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.953+0000 7f63622fc640 1 --2- 172.21.15.123:0/377234084 >> v2:172.21.15.123:3300/0 conn(0x7f635c072630 0x7f635c072aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:23.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.952+0000 7f296d8b7640 1 -- start start 2024-09-15T23:12:23.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.953+0000 7f296d8b7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2968072740 0x7f2968072b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:23.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.953+0000 7f296d8b7640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29680b4160 con 0x7f29680d0390 2024-09-15T23:12:23.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.953+0000 7f296d8b7640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2968071c60 con 0x7f2968144170 2024-09-15T23:12:23.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.953+0000 7f296d8b7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f29680730c0 con 0x7f2968072740 2024-09-15T23:12:23.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.954+0000 7f2966ffd640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f2968144170 0x7f296815aef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:48930/0 (socket says 172.21.15.123:48930) 2024-09-15T23:12:23.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.954+0000 7f2966ffd640 1 -- 172.21.15.123:0/188105768 learned_addr learned my addr 172.21.15.123:0/188105768 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:23.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.954+0000 7f29667fc640 1 --2- 172.21.15.123:0/188105768 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2968072740 0x7f2968072b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:23.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.953+0000 7fddf9ef1640 1 -- start start 2024-09-15T23:12:23.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.954+0000 7fddf9ef1640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fddf414c480 0x7fddf4163be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:23.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.954+0000 7fddf9ef1640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fddf4073750 0x7fddf4073bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:23.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.954+0000 7fddf9ef1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fddf4164650 0x7fddf4164ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:23.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.954+0000 7fddf9ef1640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fddf40732c0 con 0x7fddf4073750 2024-09-15T23:12:23.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.954+0000 7fddf9ef1640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fddf4164120 con 0x7fddf414c480 2024-09-15T23:12:23.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.954+0000 7fddf9ef1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fddf40712a0 con 0x7fddf4164650 2024-09-15T23:12:23.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.954+0000 7f2965ffb640 1 -- 172.21.15.123:0/188105768 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2348029281 0 0) 0x7f2968071c60 con 0x7f2968144170 2024-09-15T23:12:23.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.955+0000 7fddf3fff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fddf4164650 0x7fddf4164ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:23.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.955+0000 7fddf3fff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fddf4164650 0x7fddf4164ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:41472/0 (socket says 172.21.15.123:41472) 2024-09-15T23:12:23.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.955+0000 7fddf3fff640 1 -- 172.21.15.123:0/3465537304 learned_addr learned my addr 172.21.15.123:0/3465537304 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:23.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.954+0000 7f29667fc640 1 -- 172.21.15.123:0/188105768 >> v1:172.21.15.188:6789/0 conn(0x7f2968144170 legacy=0x7f296815aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:23.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.954+0000 7f29667fc640 1 -- 172.21.15.123:0/188105768 >> v1:172.21.15.123:6789/0 conn(0x7f29680d0390 legacy=0x7f29680b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:23.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.954+0000 7f29667fc640 1 -- 172.21.15.123:0/188105768 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2968071f40 con 0x7f2968072740 2024-09-15T23:12:23.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.955+0000 7fddf37fe640 1 --2- 172.21.15.123:0/3465537304 >> v2:172.21.15.188:3300/0 conn(0x7fddf414c480 0x7fddf4163be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:23.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.955+0000 7fddf3fff640 1 -- 172.21.15.123:0/3465537304 >> v2:172.21.15.188:3300/0 conn(0x7fddf414c480 msgr2=0x7fddf4163be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:23.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.955+0000 7fddf3fff640 1 --2- 172.21.15.123:0/3465537304 >> v2:172.21.15.188:3300/0 conn(0x7fddf414c480 0x7fddf4163be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:23.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.955+0000 7fddf3fff640 1 -- 172.21.15.123:0/3465537304 >> v2:172.21.15.123:3300/0 conn(0x7fddf4073750 msgr2=0x7fddf4073bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:23.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.956+0000 7fddf3fff640 1 --2- 172.21.15.123:0/3465537304 >> v2:172.21.15.123:3300/0 conn(0x7fddf4073750 0x7fddf4073bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:23.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.956+0000 7f29667fc640 1 --2- 172.21.15.123:0/188105768 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2968072740 0x7f2968072b80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f295c0097d0 tx=0x7f295c02c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c62c261160410fad server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:23.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.956+0000 7fddf3fff640 1 -- 172.21.15.123:0/3465537304 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf4072c70 con 0x7fddf4164650 2024-09-15T23:12:23.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.954+0000 7f63622fc640 1 -- 172.21.15.123:0/377234084 >> v1:172.21.15.188:6789/0 conn(0x7f635c0b6150 legacy=0x7f635c071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:23.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.954+0000 7f63622fc640 1 -- 172.21.15.123:0/377234084 >> v1:172.21.15.123:6789/0 conn(0x7f635c0d0350 legacy=0x7f635c0d0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:23.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.954+0000 7f63622fc640 1 -- 172.21.15.123:0/377234084 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f635c0735e0 con 0x7f635c072630 2024-09-15T23:12:23.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.955+0000 7f63622fc640 1 --2- 172.21.15.123:0/377234084 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f635c072630 0x7f635c072aa0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f63580097a0 tx=0x7f635802b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3aeeb1252dcde4a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:23.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.956+0000 7f2965ffb640 1 -- 172.21.15.123:0/188105768 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f295c039070 con 0x7f2968072740 2024-09-15T23:12:23.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.956+0000 7f2965ffb640 1 -- 172.21.15.123:0/188105768 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f295c034640 con 0x7f2968072740 2024-09-15T23:12:23.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.956+0000 7f2965ffb640 1 -- 172.21.15.123:0/188105768 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f295c034a10 con 0x7f2968072740 2024-09-15T23:12:23.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.956+0000 7f6360af9640 1 -- 172.21.15.123:0/377234084 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6358037070 con 0x7f635c072630 2024-09-15T23:12:23.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.956+0000 7f6360af9640 1 -- 172.21.15.123:0/377234084 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6358030710 con 0x7f635c072630 2024-09-15T23:12:23.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.956+0000 7f6360af9640 1 -- 172.21.15.123:0/377234084 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6358030ae0 con 0x7f635c072630 2024-09-15T23:12:23.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.957+0000 7fddf37fe640 1 --2- 172.21.15.123:0/3465537304 >> v2:172.21.15.188:3300/0 conn(0x7fddf414c480 0x7fddf4163be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:23.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.957+0000 7f296d8b7640 1 -- 172.21.15.123:0/188105768 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2968072740 msgr2=0x7f2968072b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:23.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.957+0000 7f296d8b7640 1 --2- 172.21.15.123:0/188105768 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2968072740 0x7f2968072b80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f295c0097d0 tx=0x7f295c02c3f0 comp rx=0 tx=0).stop 2024-09-15T23:12:23.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.957+0000 7f296d8b7640 1 -- 172.21.15.123:0/188105768 shutdown_connections 2024-09-15T23:12:23.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.957+0000 7f296d8b7640 1 --2- 172.21.15.123:0/188105768 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2968072740 0x7f2968072b80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:23.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.957+0000 7f296d8b7640 1 -- 172.21.15.123:0/188105768 >> 172.21.15.123:0/188105768 conn(0x7f296806d0f0 msgr2=0x7f296806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:23.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.957+0000 7f296d8b7640 1 -- 172.21.15.123:0/188105768 shutdown_connections 2024-09-15T23:12:23.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.957+0000 7fddf3fff640 1 --2- 172.21.15.123:0/3465537304 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fddf4164650 0x7fddf4164ae0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fddf4069be0 tx=0x7fddec02a630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0c15152048240cb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:23.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.957+0000 7f296d8b7640 1 -- 172.21.15.123:0/188105768 wait complete. 2024-09-15T23:12:23.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.958+0000 7fddf27fc640 1 -- 172.21.15.123:0/3465537304 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddec036070 con 0x7fddf4164650 2024-09-15T23:12:23.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.958+0000 7f6363d5f640 1 -- 172.21.15.123:0/377234084 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f635c072630 msgr2=0x7f635c072aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:23.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.958+0000 7f6363d5f640 1 --2- 172.21.15.123:0/377234084 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f635c072630 0x7f635c072aa0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f63580097a0 tx=0x7f635802b460 comp rx=0 tx=0).stop 2024-09-15T23:12:23.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.958+0000 7fddf27fc640 1 -- 172.21.15.123:0/3465537304 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddec02ae50 con 0x7fddf4164650 2024-09-15T23:12:23.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.958+0000 7f6363d5f640 1 -- 172.21.15.123:0/377234084 shutdown_connections 2024-09-15T23:12:23.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.958+0000 7f6363d5f640 1 --2- 172.21.15.123:0/377234084 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f635c072630 0x7f635c072aa0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:23.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.958+0000 7f6363d5f640 1 -- 172.21.15.123:0/377234084 >> 172.21.15.123:0/377234084 conn(0x7f635c06d0f0 msgr2=0x7f635c06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:23.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.959+0000 7fddf27fc640 1 -- 172.21.15.123:0/3465537304 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddec031800 con 0x7fddf4164650 2024-09-15T23:12:23.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.959+0000 7fddf9ef1640 1 -- 172.21.15.123:0/3465537304 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fddf4164650 msgr2=0x7fddf4164ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:23.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.959+0000 7fddf9ef1640 1 --2- 172.21.15.123:0/3465537304 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fddf4164650 0x7fddf4164ae0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fddf4069be0 tx=0x7fddec02a630 comp rx=0 tx=0).stop 2024-09-15T23:12:23.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.959+0000 7fddf9ef1640 1 -- 172.21.15.123:0/3465537304 shutdown_connections 2024-09-15T23:12:23.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.959+0000 7fddf9ef1640 1 --2- 172.21.15.123:0/3465537304 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fddf4164650 0x7fddf4164ae0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:23.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.959+0000 7fddf9ef1640 1 --2- 172.21.15.123:0/3465537304 >> v2:172.21.15.123:3300/0 conn(0x7fddf4073750 0x7fddf4073bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:23.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.959+0000 7f296d8b7640 1 Processor -- start 2024-09-15T23:12:23.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.959+0000 7fddf9ef1640 1 --2- 172.21.15.123:0/3465537304 >> v2:172.21.15.188:3300/0 conn(0x7fddf414c480 0x7fddf4163be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:23.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.959+0000 7fddf9ef1640 1 -- 172.21.15.123:0/3465537304 >> 172.21.15.123:0/3465537304 conn(0x7fddf40ccec0 msgr2=0x7fddf40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:23.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.959+0000 7f6363d5f640 1 -- 172.21.15.123:0/377234084 shutdown_connections 2024-09-15T23:12:23.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.959+0000 7f6363d5f640 1 -- 172.21.15.123:0/377234084 wait complete. 2024-09-15T23:12:23.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.960+0000 7fddf9ef1640 1 -- 172.21.15.123:0/3465537304 shutdown_connections 2024-09-15T23:12:23.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.960+0000 7f296d8b7640 1 -- start start 2024-09-15T23:12:23.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.961+0000 7f296d8b7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2968072740 0x7f29680cf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:23.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.961+0000 7f296d8b7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f29680d0390 0x7f29680c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:23.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.961+0000 7f296d8b7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2968144170 0x7f29680cbf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:23.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.961+0000 7f2966ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2968072740 0x7f29680cf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:23.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.961+0000 7f2966ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2968072740 0x7f29680cf1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:50982/0 (socket says 172.21.15.123:50982) 2024-09-15T23:12:23.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.962+0000 7f29667fc640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f29680d0390 0x7f29680c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:23.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.960+0000 7fddf9ef1640 1 -- 172.21.15.123:0/3465537304 wait complete. 2024-09-15T23:12:23.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.962+0000 7fddf9ef1640 1 Processor -- start 2024-09-15T23:12:23.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.962+0000 7f29667fc640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f29680d0390 0x7f29680c8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:41484/0 (socket says 172.21.15.123:41484) 2024-09-15T23:12:23.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.962+0000 7fddf9ef1640 1 -- start start 2024-09-15T23:12:23.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.961+0000 7f6363d5f640 1 Processor -- start 2024-09-15T23:12:23.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.961+0000 7f6363d5f640 1 -- start start 2024-09-15T23:12:23.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.962+0000 7f29677fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2968144170 0x7f29680cbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:23.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.962+0000 7f6363d5f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f635c072630 0x7f635c0c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:23.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.962+0000 7f6363d5f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f635c0b6150 0x7f635c0c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:23.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.962+0000 7f6363d5f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f635c0d0350 0x7f635c209990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:23.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.962+0000 7f6363d5f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f635c0b35f0 con 0x7f635c0b6150 2024-09-15T23:12:23.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.962+0000 7f6363d5f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f635c0b3470 con 0x7f635c0d0350 2024-09-15T23:12:23.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.962+0000 7f6363d5f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f635c072fe0 con 0x7f635c072630 2024-09-15T23:12:23.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.962+0000 7f63612fa640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f635c0b6150 0x7f635c0c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:23.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.962+0000 7f29677fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2968144170 0x7f29680cbf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36476/0 (socket says 172.21.15.123:36476) 2024-09-15T23:12:23.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.962+0000 7f2966ffd640 1 -- 172.21.15.123:0/4134278670 learned_addr learned my addr 172.21.15.123:0/4134278670 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:23.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.962+0000 7f296d8b7640 1 -- 172.21.15.123:0/4134278670 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f296815b600 con 0x7f2968144170 2024-09-15T23:12:23.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.962+0000 7f296d8b7640 1 -- 172.21.15.123:0/4134278670 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f29680722b0 con 0x7f2968072740 2024-09-15T23:12:23.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.962+0000 7f296d8b7640 1 -- 172.21.15.123:0/4134278670 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f29680b4440 con 0x7f29680d0390 2024-09-15T23:12:23.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.963+0000 7f29677fe640 1 -- 172.21.15.123:0/4134278670 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f29680d0390 msgr2=0x7f29680c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:23.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.963+0000 7f29677fe640 1 --2- 172.21.15.123:0/4134278670 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f29680d0390 0x7f29680c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:23.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.963+0000 7f29677fe640 1 -- 172.21.15.123:0/4134278670 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2968072740 msgr2=0x7f29680cf1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:23.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.963+0000 7f29677fe640 1 --2- 172.21.15.123:0/4134278670 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2968072740 0x7f29680cf1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:23.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.963+0000 7f29677fe640 1 -- 172.21.15.123:0/4134278670 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29680caef0 con 0x7f2968144170 2024-09-15T23:12:23.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.964+0000 7fddf9ef1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fddf4073750 0x7fddf40c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:23.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.964+0000 7f29677fe640 1 --2- 172.21.15.123:0/4134278670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2968144170 0x7f29680cbf90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f295800c4b0 tx=0x7f295800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:23.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.964+0000 7fddf9ef1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fddf414c480 0x7fddf40c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:23.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.962+0000 7f63612fa640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f635c0b6150 0x7f635c0c9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36484/0 (socket says 172.21.15.123:36484) 2024-09-15T23:12:23.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.962+0000 7f63612fa640 1 -- 172.21.15.123:0/2207001177 learned_addr learned my addr 172.21.15.123:0/2207001177 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:23.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.963+0000 7f6361afb640 1 --2- 172.21.15.123:0/2207001177 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f635c072630 0x7f635c0c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:23.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.963+0000 7f63612fa640 1 -- 172.21.15.123:0/2207001177 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f635c072630 msgr2=0x7f635c0c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:23.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.963+0000 7f63612fa640 1 --2- 172.21.15.123:0/2207001177 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f635c072630 0x7f635c0c79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:23.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.963+0000 7f63612fa640 1 -- 172.21.15.123:0/2207001177 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f635c0d0350 msgr2=0x7f635c209990 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T23:12:23.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.963+0000 7f63612fa640 1 --2- 172.21.15.123:0/2207001177 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f635c0d0350 0x7f635c209990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:23.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.963+0000 7f63612fa640 1 -- 172.21.15.123:0/2207001177 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f635c0c6640 con 0x7f635c0b6150 2024-09-15T23:12:23.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.964+0000 7f63612fa640 1 --2- 172.21.15.123:0/2207001177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f635c0b6150 0x7f635c0c9d80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6354001a50 tx=0x7f6354001f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:23.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.964+0000 7fddf9ef1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fddf4164650 0x7fddf4204cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:23.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.964+0000 7f63527fc640 1 -- 172.21.15.123:0/2207001177 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6354018070 con 0x7f635c0b6150 2024-09-15T23:12:23.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.964+0000 7fddf9ef1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fddf4071580 con 0x7fddf414c480 2024-09-15T23:12:23.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.964+0000 7f63527fc640 1 -- 172.21.15.123:0/2207001177 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f635400d6c0 con 0x7f635c0b6150 2024-09-15T23:12:23.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.964+0000 7f63527fc640 1 -- 172.21.15.123:0/2207001177 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f635400da70 con 0x7f635c0b6150 2024-09-15T23:12:23.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.964+0000 7fddf9ef1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fddf4070f70 con 0x7fddf4073750 2024-09-15T23:12:23.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.965+0000 7f294ffff640 1 -- 172.21.15.123:0/4134278670 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2958005270 con 0x7f2968144170 2024-09-15T23:12:23.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.965+0000 7f294ffff640 1 -- 172.21.15.123:0/4134278670 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2958019070 con 0x7f2968144170 2024-09-15T23:12:23.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.964+0000 7f6363d5f640 1 -- 172.21.15.123:0/2207001177 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f635c0c6920 con 0x7f635c0b6150 2024-09-15T23:12:23.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.965+0000 7f6363d5f640 1 -- 172.21.15.123:0/2207001177 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f635c0c6ee0 con 0x7f635c0b6150 2024-09-15T23:12:23.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.966+0000 7f296d8b7640 1 -- 172.21.15.123:0/4134278670 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29680cb1d0 con 0x7f2968144170 2024-09-15T23:12:23.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.966+0000 7f296d8b7640 1 -- 172.21.15.123:0/4134278670 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29680cb790 con 0x7f2968144170 2024-09-15T23:12:23.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.966+0000 7f294ffff640 1 -- 172.21.15.123:0/4134278670 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2958015a20 con 0x7f2968144170 2024-09-15T23:12:23.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.968+0000 7f296d8b7640 1 -- 172.21.15.123:0/4134278670 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29680cbc80 con 0x7f2968144170 2024-09-15T23:12:23.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.966+0000 7fddf37fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fddf4073750 0x7fddf40c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:23.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.966+0000 7fddf37fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fddf4073750 0x7fddf40c5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:50996/0 (socket says 172.21.15.123:50996) 2024-09-15T23:12:23.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.966+0000 7fddf37fe640 1 -- 172.21.15.123:0/1790458015 learned_addr learned my addr 172.21.15.123:0/1790458015 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:23.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.966+0000 7fddf2ffd640 1 --2- 172.21.15.123:0/1790458015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fddf414c480 0x7fddf40c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:23.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.966+0000 7fddf9ef1640 1 -- 172.21.15.123:0/1790458015 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fddf40b6350 con 0x7fddf4164650 2024-09-15T23:12:23.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.967+0000 7fddf3fff640 1 --2- 172.21.15.123:0/1790458015 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fddf4164650 0x7fddf4204cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:23.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.967+0000 7fddf2ffd640 1 -- 172.21.15.123:0/1790458015 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fddf4164650 msgr2=0x7fddf4204cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:23.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.967+0000 7fddf2ffd640 1 --2- 172.21.15.123:0/1790458015 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fddf4164650 0x7fddf4204cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:23.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.967+0000 7fddf2ffd640 1 -- 172.21.15.123:0/1790458015 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fddf4073750 msgr2=0x7fddf40c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:23.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.967+0000 7fddf2ffd640 1 --2- 172.21.15.123:0/1790458015 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fddf4073750 0x7fddf40c5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:23.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.967+0000 7fddf2ffd640 1 -- 172.21.15.123:0/1790458015 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf40c5fd0 con 0x7fddf414c480 2024-09-15T23:12:23.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.967+0000 7fddf2ffd640 1 --2- 172.21.15.123:0/1790458015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fddf414c480 0x7fddf40c8440 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdde400b410 tx=0x7fdde400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:23.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.967+0000 7f6363d5f640 1 -- 172.21.15.123:0/2207001177 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f635c0cfd90 con 0x7f635c0b6150 2024-09-15T23:12:23.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.968+0000 7fddebfff640 1 -- 172.21.15.123:0/1790458015 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde4015020 con 0x7fddf414c480 2024-09-15T23:12:23.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.969+0000 7fddf9ef1640 1 -- 172.21.15.123:0/1790458015 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddf40c6670 con 0x7fddf414c480 2024-09-15T23:12:23.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.969+0000 7f294ffff640 1 -- 172.21.15.123:0/4134278670 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2958015bc0 con 0x7f2968144170 2024-09-15T23:12:23.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.969+0000 7f294ffff640 1 --2- 172.21.15.123:0/4134278670 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f295406c380 0x7f295406e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:23.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.970+0000 7f294ffff640 1 -- 172.21.15.123:0/4134278670 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f2958093170 con 0x7f2968144170 2024-09-15T23:12:23.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.971+0000 7f2966ffd640 1 --2- 172.21.15.123:0/4134278670 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f295406c380 0x7f295406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:23.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.969+0000 7f63527fc640 1 -- 172.21.15.123:0/2207001177 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f635401b070 con 0x7f635c0b6150 2024-09-15T23:12:23.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.970+0000 7f63527fc640 1 --2- 172.21.15.123:0/2207001177 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f634006c380 0x7f634006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:23.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.970+0000 7f63527fc640 1 -- 172.21.15.123:0/2207001177 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f635408a9f0 con 0x7f635c0b6150 2024-09-15T23:12:23.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.971+0000 7f6361afb640 1 --2- 172.21.15.123:0/2207001177 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f634006c380 0x7f634006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:23.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.972+0000 7f2966ffd640 1 --2- 172.21.15.123:0/4134278670 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f295406c380 0x7f295406e840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2960001cc0 tx=0x7f2960001c50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:23.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.970+0000 7fddebfff640 1 -- 172.21.15.123:0/1790458015 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdde4011850 con 0x7fddf414c480 2024-09-15T23:12:23.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.971+0000 7fddebfff640 1 -- 172.21.15.123:0/1790458015 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde4011c40 con 0x7fddf414c480 2024-09-15T23:12:23.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.971+0000 7fddf9ef1640 1 -- 172.21.15.123:0/1790458015 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddf40c6c30 con 0x7fddf414c480 2024-09-15T23:12:23.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.972+0000 7f6361afb640 1 --2- 172.21.15.123:0/2207001177 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f634006c380 0x7f634006e840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f634c000f60 tx=0x7f634c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:23.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.973+0000 7fddf9ef1640 1 -- 172.21.15.123:0/1790458015 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddf4073bc0 con 0x7fddf414c480 2024-09-15T23:12:23.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.978+0000 7f294ffff640 1 -- 172.21.15.123:0/4134278670 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f29580618c0 con 0x7f2968144170 2024-09-15T23:12:23.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.990+0000 7f63527fc640 1 -- 172.21.15.123:0/2207001177 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f635c0cfd90 con 0x7f635c0b6150 2024-09-15T23:12:23.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.992+0000 7fddebfff640 1 -- 172.21.15.123:0/1790458015 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdde4018020 con 0x7fddf414c480 2024-09-15T23:12:23.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.992+0000 7fddebfff640 1 --2- 172.21.15.123:0/1790458015 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fddd406c300 0x7fddd406e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:23.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.992+0000 7fddebfff640 1 -- 172.21.15.123:0/1790458015 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fdde408b320 con 0x7fddf414c480 2024-09-15T23:12:23.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.993+0000 7fddebfff640 1 -- 172.21.15.123:0/1790458015 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdde401f030 con 0x7fddf414c480 2024-09-15T23:12:23.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.993+0000 7fddf37fe640 1 --2- 172.21.15.123:0/1790458015 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fddd406c300 0x7fddd406e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:23.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:23.994+0000 7fddf37fe640 1 --2- 172.21.15.123:0/1790458015 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fddd406c300 0x7fddd406e7c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdddc00ab80 tx=0x7fdddc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:24.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.000+0000 7f6035f6d640 1 Processor -- start 2024-09-15T23:12:24.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.000+0000 7f6035f6d640 1 -- start start 2024-09-15T23:12:24.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.002+0000 7f6035f6d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f603015aec0 0x7f603015b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.002+0000 7f6035f6d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f6030072740 0x7f6030072b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.002+0000 7f6035f6d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6030144610 con 0x7f603006dbe0 2024-09-15T23:12:24.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.002+0000 7f6035f6d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f60300722b0 con 0x7f6030072740 2024-09-15T23:12:24.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.002+0000 7f6035f6d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6030071c60 con 0x7f603015aec0 2024-09-15T23:12:24.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.002+0000 7f602ffff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f6030072740 0x7f6030072b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.002+0000 7f602ffff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f6030072740 0x7f6030072b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:51012/0 (socket says 172.21.15.123:51012) 2024-09-15T23:12:24.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.002+0000 7f602ffff640 1 -- 172.21.15.123:0/909643166 learned_addr learned my addr 172.21.15.123:0/909643166 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:24.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.003+0000 7f602effd640 1 --2- 172.21.15.123:0/909643166 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f603015aec0 0x7f603015b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.003+0000 7f602ffff640 1 -- 172.21.15.123:0/909643166 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f603015aec0 msgr2=0x7f603015b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:24.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.003+0000 7f602ffff640 1 --2- 172.21.15.123:0/909643166 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f603015aec0 0x7f603015b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.003+0000 7f602ffff640 1 -- 172.21.15.123:0/909643166 >> v1:172.21.15.123:6789/0 conn(0x7f603006dbe0 legacy=0x7f6030143f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:12:24.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.003+0000 7f602ffff640 1 -- 172.21.15.123:0/909643166 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6030071f40 con 0x7f6030072740 2024-09-15T23:12:24.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.004+0000 7f602effd640 1 --2- 172.21.15.123:0/909643166 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f603015aec0 0x7f603015b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:24.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.004+0000 7f912b282640 1 Processor -- start 2024-09-15T23:12:24.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.004+0000 7f602ffff640 1 --2- 172.21.15.123:0/909643166 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6030072740 0x7f6030072b90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6028009e50 tx=0x7f602802a760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9a28d39d7444c5f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:24.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.004+0000 7f912b282640 1 -- start start 2024-09-15T23:12:24.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.005+0000 7f602e7fc640 1 -- 172.21.15.123:0/909643166 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6028036070 con 0x7f6030072740 2024-09-15T23:12:24.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.005+0000 7f602e7fc640 1 -- 172.21.15.123:0/909643166 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6028031600 con 0x7f6030072740 2024-09-15T23:12:24.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.006+0000 7f6035f6d640 1 -- 172.21.15.123:0/909643166 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6030072740 msgr2=0x7f6030072b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.006+0000 7f6035f6d640 1 --2- 172.21.15.123:0/909643166 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6030072740 0x7f6030072b90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6028009e50 tx=0x7f602802a760 comp rx=0 tx=0).stop 2024-09-15T23:12:24.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.006+0000 7f6035f6d640 1 -- 172.21.15.123:0/909643166 shutdown_connections 2024-09-15T23:12:24.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.006+0000 7f6035f6d640 1 --2- 172.21.15.123:0/909643166 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6030072740 0x7f6030072b90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.006+0000 7f6035f6d640 1 --2- 172.21.15.123:0/909643166 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f603015aec0 0x7f603015b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.006+0000 7f6035f6d640 1 -- 172.21.15.123:0/909643166 >> 172.21.15.123:0/909643166 conn(0x7f603006d0f0 msgr2=0x7f603006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:24.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.007+0000 7f6035f6d640 1 -- 172.21.15.123:0/909643166 shutdown_connections 2024-09-15T23:12:24.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.007+0000 7f912b282640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9124072e50 0x7f9124144170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.007+0000 7f912b282640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91240b4160 con 0x7f91240d0390 2024-09-15T23:12:24.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.007+0000 7f912b282640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9124071c60 con 0x7f912406dbe0 2024-09-15T23:12:24.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.007+0000 7f912b282640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f91240722b0 con 0x7f9124072e50 2024-09-15T23:12:24.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.007+0000 7f912901e640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f912406dbe0 0x7f9124072740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:48940/0 (socket says 172.21.15.123:48940) 2024-09-15T23:12:24.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.007+0000 7f912901e640 1 -- 172.21.15.123:0/1569421452 learned_addr learned my addr 172.21.15.123:0/1569421452 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:24.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.007+0000 7f6035f6d640 1 -- 172.21.15.123:0/909643166 wait complete. 2024-09-15T23:12:24.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.007+0000 7f912881d640 1 --2- 172.21.15.123:0/1569421452 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9124072e50 0x7f9124144170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.008+0000 7f912881d640 1 -- 172.21.15.123:0/1569421452 >> v1:172.21.15.188:6789/0 conn(0x7f912406dbe0 legacy=0x7f9124072740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.008+0000 7f912881d640 1 -- 172.21.15.123:0/1569421452 >> v1:172.21.15.123:6789/0 conn(0x7f91240d0390 legacy=0x7f91240b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.008+0000 7f912881d640 1 -- 172.21.15.123:0/1569421452 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9124071f40 con 0x7f9124072e50 2024-09-15T23:12:24.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.009+0000 7f6035f6d640 1 Processor -- start 2024-09-15T23:12:24.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.009+0000 7f912881d640 1 --2- 172.21.15.123:0/1569421452 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9124072e50 0x7f9124144170 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9124072430 tx=0x7f912002b340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f43e867998e6d84a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:24.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.009+0000 7f6035f6d640 1 -- start start 2024-09-15T23:12:24.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.011+0000 7f6035f6d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f603006dbe0 0x7f60300c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.010+0000 7f911bfff640 1 -- 172.21.15.123:0/1569421452 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9120038070 con 0x7f9124072e50 2024-09-15T23:12:24.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.010+0000 7f911bfff640 1 -- 172.21.15.123:0/1569421452 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9120033440 con 0x7f9124072e50 2024-09-15T23:12:24.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.011+0000 7f912b282640 1 -- 172.21.15.123:0/1569421452 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9124072e50 msgr2=0x7f9124144170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.010+0000 7f24edb86640 1 Processor -- start 2024-09-15T23:12:24.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.010+0000 7f24edb86640 1 -- start start 2024-09-15T23:12:24.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.011+0000 7f24edb86640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f24e0047e90 0x7f24e0034640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.011+0000 7f6035f6d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6030072740 0x7f6030153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.011+0000 7f602f7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f603006dbe0 0x7f60300c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.011+0000 7f602f7fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f603006dbe0 0x7f60300c6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:51014/0 (socket says 172.21.15.123:51014) 2024-09-15T23:12:24.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.011+0000 7f602f7fe640 1 -- 172.21.15.123:0/2183409869 learned_addr learned my addr 172.21.15.123:0/2183409869 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:24.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.011+0000 7f24edb86640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24e0055790 0x7f24e0053a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.011+0000 7f24edb86640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24e00532c0 con 0x7f24e0033ba0 2024-09-15T23:12:24.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.011+0000 7f24edb86640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f24e003ae20 con 0x7f24e0047e90 2024-09-15T23:12:24.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.011+0000 7f24edb86640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f24e0053560 con 0x7f24e0055790 2024-09-15T23:12:24.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.011+0000 7f602effd640 1 --2- 172.21.15.123:0/2183409869 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6030072740 0x7f6030153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.011+0000 7f912b282640 1 --2- 172.21.15.123:0/1569421452 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9124072e50 0x7f9124144170 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9124072430 tx=0x7f912002b340 comp rx=0 tx=0).stop 2024-09-15T23:12:24.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.011+0000 7f912b282640 1 -- 172.21.15.123:0/1569421452 shutdown_connections 2024-09-15T23:12:24.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.011+0000 7f912b282640 1 --2- 172.21.15.123:0/1569421452 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9124072e50 0x7f9124144170 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.011+0000 7f912b282640 1 -- 172.21.15.123:0/1569421452 >> 172.21.15.123:0/1569421452 conn(0x7f912406d0f0 msgr2=0x7f912406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:24.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.011+0000 7f6035f6d640 1 --2- 172.21.15.123:0/2183409869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f603015aec0 0x7f60300cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.011+0000 7f24e7fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f24e0033ba0 0x7f24e0048270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39144/0 (socket says 172.21.15.123:39144) 2024-09-15T23:12:24.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.011+0000 7f24e7fff640 1 -- 172.21.15.123:0/3228379000 learned_addr learned my addr 172.21.15.123:0/3228379000 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:24.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.012+0000 7f6035f6d640 1 -- 172.21.15.123:0/2183409869 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f60300d0510 con 0x7f603015aec0 2024-09-15T23:12:24.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.012+0000 7f6035f6d640 1 -- 172.21.15.123:0/2183409869 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f60300d0390 con 0x7f603006dbe0 2024-09-15T23:12:24.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.012+0000 7f6035f6d640 1 -- 172.21.15.123:0/2183409869 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f60300d0690 con 0x7f6030072740 2024-09-15T23:12:24.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.012+0000 7f602ffff640 1 --2- 172.21.15.123:0/2183409869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f603015aec0 0x7f60300cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.012+0000 7f24e77fe640 1 -- 172.21.15.123:0/3228379000 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2094800092 0 0) 0x7f24e00532c0 con 0x7f24e0033ba0 2024-09-15T23:12:24.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.012+0000 7f24e77fe640 1 -- 172.21.15.123:0/3228379000 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24d0003520 con 0x7f24e0033ba0 2024-09-15T23:12:24.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.012+0000 7f912b282640 1 -- 172.21.15.123:0/1569421452 shutdown_connections 2024-09-15T23:12:24.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.012+0000 7f912b282640 1 -- 172.21.15.123:0/1569421452 wait complete. 2024-09-15T23:12:24.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.012+0000 7f602ffff640 1 -- 172.21.15.123:0/2183409869 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6030072740 msgr2=0x7f6030153560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.012+0000 7f602ffff640 1 --2- 172.21.15.123:0/2183409869 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6030072740 0x7f6030153560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.012+0000 7f602ffff640 1 -- 172.21.15.123:0/2183409869 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f603006dbe0 msgr2=0x7f60300c6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.012+0000 7f602ffff640 1 --2- 172.21.15.123:0/2183409869 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f603006dbe0 0x7f60300c6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.012+0000 7f602ffff640 1 -- 172.21.15.123:0/2183409869 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60300c6060 con 0x7f603015aec0 2024-09-15T23:12:24.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.013+0000 7f602ffff640 1 --2- 172.21.15.123:0/2183409869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f603015aec0 0x7f60300cf0f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6028030000 tx=0x7f6028004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:24.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.013+0000 7f6017fff640 1 -- 172.21.15.123:0/2183409869 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6028041020 con 0x7f603015aec0 2024-09-15T23:12:24.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.013+0000 7f6035f6d640 1 -- 172.21.15.123:0/2183409869 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60300c6340 con 0x7f603015aec0 2024-09-15T23:12:24.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.013+0000 7f6035f6d640 1 -- 172.21.15.123:0/2183409869 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60300cb850 con 0x7f603015aec0 2024-09-15T23:12:24.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.013+0000 7f24e77fe640 1 -- 172.21.15.123:0/3228379000 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1566493525 0 0) 0x7f24d0003520 con 0x7f24e0033ba0 2024-09-15T23:12:24.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.013+0000 7f24e77fe640 1 -- 172.21.15.123:0/3228379000 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24e0055790 msgr2=0x7f24e0053a40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:12:24.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.013+0000 7f24e77fe640 1 --2- 172.21.15.123:0/3228379000 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24e0055790 0x7f24e0053a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.013+0000 7f24e77fe640 1 -- 172.21.15.123:0/3228379000 >> v2:172.21.15.188:3300/0 conn(0x7f24e0047e90 msgr2=0x7f24e0034640 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:12:24.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.013+0000 7f24e77fe640 1 --2- 172.21.15.123:0/3228379000 >> v2:172.21.15.188:3300/0 conn(0x7f24e0047e90 0x7f24e0034640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.013+0000 7f24e77fe640 1 -- 172.21.15.123:0/3228379000 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e003a580 con 0x7f24e0033ba0 2024-09-15T23:12:24.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.013+0000 7f24e77fe640 1 -- 172.21.15.123:0/3228379000 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f24d8001670 con 0x7f24e0033ba0 2024-09-15T23:12:24.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.013+0000 7f24e77fe640 1 -- 172.21.15.123:0/3228379000 >> v1:172.21.15.123:6789/0 conn(0x7f24e0033ba0 legacy=0x7f24e0048270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.013+0000 7f24e77fe640 1 --2- 172.21.15.123:0/3228379000 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24d00039b0 0x7f24d0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.013+0000 7f24e77fe640 1 --2- 172.21.15.123:0/3228379000 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24d0004800 0x7f24d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.013+0000 7f24e77fe640 1 --2- 172.21.15.123:0/3228379000 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f24d00052e0 0x7f24d000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.013+0000 7f24e77fe640 1 -- 172.21.15.123:0/3228379000 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f24e003ae20 con 0x7f24d0004800 2024-09-15T23:12:24.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.013+0000 7f24e77fe640 1 -- 172.21.15.123:0/3228379000 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f24e0053560 con 0x7f24d00052e0 2024-09-15T23:12:24.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.013+0000 7f24ecb84640 1 --2- 172.21.15.123:0/3228379000 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24d00039b0 0x7f24d0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.013+0000 7f24e77fe640 1 -- 172.21.15.123:0/3228379000 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f24d000c210 con 0x7f24d00039b0 2024-09-15T23:12:24.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.014+0000 7f6017fff640 1 -- 172.21.15.123:0/2183409869 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f602803c470 con 0x7f603015aec0 2024-09-15T23:12:24.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.014+0000 7f24e7fff640 1 --2- 172.21.15.123:0/3228379000 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24d0004800 0x7f24d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.014+0000 7f24ecb84640 1 -- 172.21.15.123:0/3228379000 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f24d00052e0 msgr2=0x7f24d000b9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:12:24.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.014+0000 7f24ecb84640 1 --2- 172.21.15.123:0/3228379000 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f24d00052e0 0x7f24d000b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.014+0000 7f24ecb84640 1 -- 172.21.15.123:0/3228379000 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24d0004800 msgr2=0x7f24d0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:24.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.014+0000 7f912b282640 1 Processor -- start 2024-09-15T23:12:24.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.014+0000 7f912b282640 1 -- start start 2024-09-15T23:12:24.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.013+0000 7f8b25103640 1 Processor -- start 2024-09-15T23:12:24.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.013+0000 7f8b25103640 1 -- start start 2024-09-15T23:12:24.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.014+0000 7f24ecb84640 1 --2- 172.21.15.123:0/3228379000 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24d0004800 0x7f24d0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.014+0000 7f24ecb84640 1 -- 172.21.15.123:0/3228379000 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d0003520 con 0x7f24d00039b0 2024-09-15T23:12:24.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.015+0000 7f6017fff640 1 -- 172.21.15.123:0/2183409869 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6028036040 con 0x7f603015aec0 2024-09-15T23:12:24.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.015+0000 7f912b282640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f912406dbe0 0x7f9124152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.015+0000 7f24ecb84640 1 --2- 172.21.15.123:0/3228379000 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24d00039b0 0x7f24d0003dd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f24e8050d60 tx=0x7f24d0005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6333c93aacf2c869 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:24.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.015+0000 7f912b282640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f91240d0390 0x7f91240cded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.015+0000 7f912b282640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f912413f7d0 0x7f91240ce410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.015+0000 7f912881d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f91240d0390 0x7f91240cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.015+0000 7f8b25103640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8b2016b540 0x7f8b200b6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.015+0000 7f912881d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f91240d0390 0x7f91240cded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:51032/0 (socket says 172.21.15.123:51032) 2024-09-15T23:12:24.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.015+0000 7f8b25103640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b200b3bc0 con 0x7f8b200d0a60 2024-09-15T23:12:24.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.016+0000 7f912881d640 1 -- 172.21.15.123:0/540953004 learned_addr learned my addr 172.21.15.123:0/540953004 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:24.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.015+0000 7f8b25103640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b200b3ea0 con 0x7f8b200c53e0 2024-09-15T23:12:24.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.016+0000 7f912b282640 1 -- 172.21.15.123:0/540953004 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f91240b3d00 con 0x7f912406dbe0 2024-09-15T23:12:24.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.015+0000 7f8b25103640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8b2016b980 con 0x7f8b2016b540 2024-09-15T23:12:24.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.016+0000 7f912981f640 1 --2- 172.21.15.123:0/540953004 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f912413f7d0 0x7f91240ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.016+0000 7f912b282640 1 -- 172.21.15.123:0/540953004 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f91240b3b80 con 0x7f91240d0390 2024-09-15T23:12:24.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.016+0000 7f912b282640 1 -- 172.21.15.123:0/540953004 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f91240b3e80 con 0x7f912413f7d0 2024-09-15T23:12:24.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.015+0000 7f8b1e59c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8b200d0a60 0x7f8b20071f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39146/0 (socket says 172.21.15.123:39146) 2024-09-15T23:12:24.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.015+0000 7f8b1e59c640 1 -- 172.21.15.123:0/3221072630 learned_addr learned my addr 172.21.15.123:0/3221072630 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:24.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.015+0000 7f8b1f59e640 1 --2- 172.21.15.123:0/3221072630 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8b2016b540 0x7f8b200b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.016+0000 7f8b1dd9b640 1 -- 172.21.15.123:0/3221072630 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2122635456 0 0) 0x7f8b200b3ea0 con 0x7f8b200c53e0 2024-09-15T23:12:24.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.016+0000 7f8b1dd9b640 1 -- 172.21.15.123:0/3221072630 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b08003520 con 0x7f8b200c53e0 2024-09-15T23:12:24.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.016+0000 7f912981f640 1 -- 172.21.15.123:0/540953004 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f91240d0390 msgr2=0x7f91240cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.016+0000 7f912981f640 1 --2- 172.21.15.123:0/540953004 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f91240d0390 0x7f91240cded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.016+0000 7f912981f640 1 -- 172.21.15.123:0/540953004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f912406dbe0 msgr2=0x7f9124152800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:12:24.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.017+0000 7f6035f6d640 1 -- 172.21.15.123:0/2183409869 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6010005290 con 0x7f603015aec0 2024-09-15T23:12:24.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.017+0000 7f912901e640 1 --2- 172.21.15.123:0/540953004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f912406dbe0 0x7f9124152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.017+0000 7f24e77fe640 1 -- 172.21.15.123:0/3228379000 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e80b2070 con 0x7f24d00039b0 2024-09-15T23:12:24.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.017+0000 7f24e77fe640 1 -- 172.21.15.123:0/3228379000 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24e80ad640 con 0x7f24d00039b0 2024-09-15T23:12:24.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.017+0000 7f24e77fe640 1 -- 172.21.15.123:0/3228379000 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e8050f00 con 0x7f24d00039b0 2024-09-15T23:12:24.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.017+0000 7f912981f640 1 --2- 172.21.15.123:0/540953004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f912406dbe0 0x7f9124152800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.017+0000 7f912981f640 1 -- 172.21.15.123:0/540953004 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9124154b00 con 0x7f912413f7d0 2024-09-15T23:12:24.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.016+0000 7f8b1f59e640 1 -- 172.21.15.123:0/3221072630 >> v1:172.21.15.188:6789/0 conn(0x7f8b200c53e0 legacy=0x7f8b200d0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.017+0000 7f912981f640 1 --2- 172.21.15.123:0/540953004 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f912413f7d0 0x7f91240ce410 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f911c00c750 tx=0x7f911c00cc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:24.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.017+0000 7f912901e640 1 --2- 172.21.15.123:0/540953004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f912406dbe0 0x7f9124152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:24.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.016+0000 7f8b1f59e640 1 -- 172.21.15.123:0/3221072630 >> v1:172.21.15.123:6789/0 conn(0x7f8b200d0a60 legacy=0x7f8b20071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.016+0000 7f8b1f59e640 1 -- 172.21.15.123:0/3221072630 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b20172050 con 0x7f8b2016b540 2024-09-15T23:12:24.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.017+0000 7f6017fff640 1 -- 172.21.15.123:0/2183409869 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6028044020 con 0x7f603015aec0 2024-09-15T23:12:24.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.018+0000 7f8b1f59e640 1 --2- 172.21.15.123:0/3221072630 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8b2016b540 0x7f8b200b6150 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8b140097d0 tx=0x7f8b1402a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f8e61e87b42a8ba server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:24.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.018+0000 7f24edb86640 1 -- 172.21.15.123:0/3228379000 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24d00039b0 msgr2=0x7f24d0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.018+0000 7f24edb86640 1 --2- 172.21.15.123:0/3228379000 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24d00039b0 0x7f24d0003dd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f24e8050d60 tx=0x7f24d0005830 comp rx=0 tx=0).stop 2024-09-15T23:12:24.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.018+0000 7f6017fff640 1 --2- 172.21.15.123:0/2183409869 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f601c06c3b0 0x7f601c06e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.018+0000 7f24ed385640 1 -- 172.21.15.123:0/3228379000 reap_dead start 2024-09-15T23:12:24.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.018+0000 7f602f7fe640 1 --2- 172.21.15.123:0/2183409869 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f601c06c3b0 0x7f601c06e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.019+0000 7f6017fff640 1 -- 172.21.15.123:0/2183409869 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f60280ac8a0 con 0x7f603015aec0 2024-09-15T23:12:24.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.019+0000 7f602f7fe640 1 --2- 172.21.15.123:0/2183409869 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f601c06c3b0 0x7f601c06e870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6020006fd0 tx=0x7f6020008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:24.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.019+0000 7f24edb86640 1 -- 172.21.15.123:0/3228379000 shutdown_connections 2024-09-15T23:12:24.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.018+0000 7f9119ffb640 1 -- 172.21.15.123:0/540953004 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911c017070 con 0x7f912413f7d0 2024-09-15T23:12:24.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.018+0000 7f9119ffb640 1 -- 172.21.15.123:0/540953004 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f911c003da0 con 0x7f912413f7d0 2024-09-15T23:12:24.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.018+0000 7f9119ffb640 1 -- 172.21.15.123:0/540953004 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911c00ce60 con 0x7f912413f7d0 2024-09-15T23:12:24.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.018+0000 7f8b1dd9b640 1 -- 172.21.15.123:0/3221072630 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b14037070 con 0x7f8b2016b540 2024-09-15T23:12:24.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.018+0000 7f8b1dd9b640 1 -- 172.21.15.123:0/3221072630 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b14032440 con 0x7f8b2016b540 2024-09-15T23:12:24.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.019+0000 7f8b25103640 1 -- 172.21.15.123:0/3221072630 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8b2016b540 msgr2=0x7f8b200b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.019+0000 7f8b25103640 1 --2- 172.21.15.123:0/3221072630 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8b2016b540 0x7f8b200b6150 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8b140097d0 tx=0x7f8b1402a290 comp rx=0 tx=0).stop 2024-09-15T23:12:24.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.019+0000 7f24edb86640 1 -- 172.21.15.123:0/3228379000 >> 172.21.15.123:0/3228379000 conn(0x7f24e001e190 msgr2=0x7f24e0054ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:24.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.019+0000 7f912b282640 1 -- 172.21.15.123:0/540953004 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9124154de0 con 0x7f912413f7d0 2024-09-15T23:12:24.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.019+0000 7f229fdbd640 1 Processor -- start 2024-09-15T23:12:24.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.019+0000 7f912b282640 1 -- 172.21.15.123:0/540953004 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9124156350 con 0x7f912413f7d0 2024-09-15T23:12:24.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.019+0000 7f24edb86640 1 -- 172.21.15.123:0/3228379000 shutdown_connections 2024-09-15T23:12:24.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.020+0000 7f24edb86640 1 -- 172.21.15.123:0/3228379000 wait complete. 2024-09-15T23:12:24.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.020+0000 7f229fdbd640 1 -- start start 2024-09-15T23:12:24.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.020+0000 7f8b25103640 1 -- 172.21.15.123:0/3221072630 shutdown_connections 2024-09-15T23:12:24.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.020+0000 7f8b25103640 1 --2- 172.21.15.123:0/3221072630 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8b2016b540 0x7f8b200b6150 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.020+0000 7f8b25103640 1 -- 172.21.15.123:0/3221072630 >> 172.21.15.123:0/3221072630 conn(0x7f8b2006d0f0 msgr2=0x7f8b2006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:24.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.021+0000 7f229fdbd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f22981606e0 0x7f22980d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.021+0000 7f229fdbd640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2298072e80 con 0x7f229815c5d0 2024-09-15T23:12:24.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.021+0000 7f229fdbd640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22980cfeb0 con 0x7f22980afda0 2024-09-15T23:12:24.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.021+0000 7f229fdbd640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f22980cf6c0 con 0x7f22981606e0 2024-09-15T23:12:24.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.021+0000 7f229db59640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f229815c5d0 0x7f2298072770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39158/0 (socket says 172.21.15.123:39158) 2024-09-15T23:12:24.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.021+0000 7f229db59640 1 -- 172.21.15.123:0/2350262327 learned_addr learned my addr 172.21.15.123:0/2350262327 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:24.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.022+0000 7f24edb86640 1 Processor -- start 2024-09-15T23:12:24.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.021+0000 7f8b25103640 1 -- 172.21.15.123:0/3221072630 shutdown_connections 2024-09-15T23:12:24.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.021+0000 7f8b25103640 1 -- 172.21.15.123:0/3221072630 wait complete. 2024-09-15T23:12:24.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.022+0000 7f24edb86640 1 -- start start 2024-09-15T23:12:24.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.022+0000 7f229e35a640 1 --2- 172.21.15.123:0/2350262327 >> v2:172.21.15.188:3300/0 conn(0x7f22981606e0 0x7f22980d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.022+0000 7f9119ffb640 1 -- 172.21.15.123:0/540953004 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f911c01a070 con 0x7f912413f7d0 2024-09-15T23:12:24.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.022+0000 7f912b282640 1 -- 172.21.15.123:0/540953004 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9124144170 con 0x7f912413f7d0 2024-09-15T23:12:24.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.023+0000 7f229cb57640 1 -- 172.21.15.123:0/2350262327 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 540961017 0 0) 0x7f22980cfeb0 con 0x7f22980afda0 2024-09-15T23:12:24.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.023+0000 7f229cb57640 1 -- 172.21.15.123:0/2350262327 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2284003520 con 0x7f22980afda0 2024-09-15T23:12:24.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.023+0000 7f229cb57640 1 -- 172.21.15.123:0/2350262327 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2762760923 0 0) 0x7f2284003520 con 0x7f22980afda0 2024-09-15T23:12:24.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.023+0000 7f229cb57640 1 -- 172.21.15.123:0/2350262327 >> v2:172.21.15.188:3300/0 conn(0x7f22981606e0 msgr2=0x7f22980d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:24.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.023+0000 7f229cb57640 1 --2- 172.21.15.123:0/2350262327 >> v2:172.21.15.188:3300/0 conn(0x7f22981606e0 0x7f22980d00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.023+0000 7f229cb57640 1 -- 172.21.15.123:0/2350262327 >> v1:172.21.15.123:6789/0 conn(0x7f229815c5d0 legacy=0x7f2298072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.023+0000 7f229cb57640 1 -- 172.21.15.123:0/2350262327 --> v1:172.21.15.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22980cf8f0 con 0x7f22980afda0 2024-09-15T23:12:24.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.023+0000 7f229cb57640 1 -- 172.21.15.123:0/2350262327 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f22900019f0 con 0x7f22980afda0 2024-09-15T23:12:24.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.023+0000 7f229cb57640 1 -- 172.21.15.123:0/2350262327 >> v1:172.21.15.188:6789/0 conn(0x7f22980afda0 legacy=0x7f229815ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.023+0000 7f8b25103640 1 Processor -- start 2024-09-15T23:12:24.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.023+0000 7f229cb57640 1 --2- 172.21.15.123:0/2350262327 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2284003a00 0x7f2284003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.023+0000 7f229cb57640 1 --2- 172.21.15.123:0/2350262327 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2284004800 0x7f2284004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.023+0000 7f229cb57640 1 --2- 172.21.15.123:0/2350262327 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2284005210 0x7f228400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.023+0000 7f229cb57640 1 -- 172.21.15.123:0/2350262327 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f228400c130 con 0x7f2284003a00 2024-09-15T23:12:24.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.023+0000 7f229cb57640 1 -- 172.21.15.123:0/2350262327 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f228400c2e0 con 0x7f2284004800 2024-09-15T23:12:24.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.023+0000 7f229cb57640 1 -- 172.21.15.123:0/2350262327 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f228400c4e0 con 0x7f2284005210 2024-09-15T23:12:24.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.023+0000 7f9119ffb640 1 --2- 172.21.15.123:0/540953004 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f910806c380 0x7f910806e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.023+0000 7f8b25103640 1 -- start start 2024-09-15T23:12:24.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.023+0000 7f229db59640 1 --2- 172.21.15.123:0/2350262327 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2284003a00 0x7f2284003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.024+0000 7f24edb86640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f24d00039b0 0x7f24e0005960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.024+0000 7f229d358640 1 --2- 172.21.15.123:0/2350262327 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2284004800 0x7f2284004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.024+0000 7f912901e640 1 --2- 172.21.15.123:0/540953004 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f910806c380 0x7f910806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.024+0000 7f229e35a640 1 --2- 172.21.15.123:0/2350262327 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2284005210 0x7f228400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.024+0000 7f24edb86640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24e0005ea0 0x7f24e0180670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.024+0000 7f24ecb84640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f24d00039b0 0x7f24e0005960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.024+0000 7f24ecb84640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f24d00039b0 0x7f24e0005960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:51064/0 (socket says 172.21.15.123:51064) 2024-09-15T23:12:24.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.024+0000 7f9119ffb640 1 -- 172.21.15.123:0/540953004 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f911c08a9f0 con 0x7f912413f7d0 2024-09-15T23:12:24.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.024+0000 7f24ecb84640 1 -- 172.21.15.123:0/620669699 learned_addr learned my addr 172.21.15.123:0/620669699 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:24.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.024+0000 7f24e7fff640 1 --2- 172.21.15.123:0/620669699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24e0005ea0 0x7f24e0180670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.024+0000 7f24edb86640 1 --2- 172.21.15.123:0/620669699 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24e0180bb0 0x7f24e004a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.024+0000 7f24edb86640 1 -- 172.21.15.123:0/620669699 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f24e0055c20 con 0x7f24e0005ea0 2024-09-15T23:12:24.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.024+0000 7f912901e640 1 --2- 172.21.15.123:0/540953004 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f910806c380 0x7f910806e840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9114007fd0 tx=0x7f9114009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:24.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.025+0000 7f24ed385640 1 --2- 172.21.15.123:0/620669699 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24e0180bb0 0x7f24e004a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.025+0000 7f8b25103640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8b200c53e0 0x7f8b20204d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.025+0000 7f8b25103640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b200d0a60 0x7f8b2015f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.025+0000 7f24edb86640 1 -- 172.21.15.123:0/620669699 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f24e003ab40 con 0x7f24d00039b0 2024-09-15T23:12:24.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.025+0000 7f24edb86640 1 -- 172.21.15.123:0/620669699 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f24e0055da0 con 0x7f24e0180bb0 2024-09-15T23:12:24.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.025+0000 7f8b1ed9d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8b200c53e0 0x7f8b20204d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.025+0000 7f8b1ed9d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8b200c53e0 0x7f8b20204d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:41568/0 (socket says 172.21.15.123:41568) 2024-09-15T23:12:24.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.025+0000 7f8b1ed9d640 1 -- 172.21.15.123:0/296217641 learned_addr learned my addr 172.21.15.123:0/296217641 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:24.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.025+0000 7f8b25103640 1 --2- 172.21.15.123:0/296217641 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b2016b540 0x7f8b200cf150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.025+0000 7f8b25103640 1 -- 172.21.15.123:0/296217641 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8b200b35f0 con 0x7f8b200d0a60 2024-09-15T23:12:24.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.025+0000 7f8b25103640 1 -- 172.21.15.123:0/296217641 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8b200b3470 con 0x7f8b2016b540 2024-09-15T23:12:24.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.025+0000 7f8b1f59e640 1 --2- 172.21.15.123:0/296217641 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b2016b540 0x7f8b200cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.025+0000 7f8b25103640 1 -- 172.21.15.123:0/296217641 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8b20072630 con 0x7f8b200c53e0 2024-09-15T23:12:24.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.024+0000 7f229e35a640 1 -- 172.21.15.123:0/2350262327 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2284004800 msgr2=0x7f2284004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:24.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.024+0000 7f229e35a640 1 --2- 172.21.15.123:0/2350262327 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2284004800 0x7f2284004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.024+0000 7f229e35a640 1 -- 172.21.15.123:0/2350262327 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2284003a00 msgr2=0x7f2284003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:24.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.024+0000 7f229e35a640 1 --2- 172.21.15.123:0/2350262327 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2284003a00 0x7f2284003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.024+0000 7f229e35a640 1 -- 172.21.15.123:0/2350262327 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2284003520 con 0x7f2284005210 2024-09-15T23:12:24.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.025+0000 7f229e35a640 1 -- 172.21.15.123:0/2350262327 reap_dead start 2024-09-15T23:12:24.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.025+0000 7f8b1e59c640 1 --2- 172.21.15.123:0/296217641 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b200d0a60 0x7f8b2015f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.026+0000 7f24ecb84640 1 -- 172.21.15.123:0/620669699 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24e0180bb0 msgr2=0x7f24e004a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.026+0000 7f229e35a640 1 --2- 172.21.15.123:0/2350262327 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2284005210 0x7f228400b9c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f22980738b0 tx=0x7f2284005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9bf44e4118e6838 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:24.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.026+0000 7f24ecb84640 1 --2- 172.21.15.123:0/620669699 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24e0180bb0 0x7f24e004a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.026+0000 7f8b1ed9d640 1 -- 172.21.15.123:0/296217641 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b2016b540 msgr2=0x7f8b200cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.026+0000 7f8b1ed9d640 1 --2- 172.21.15.123:0/296217641 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b2016b540 0x7f8b200cf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.026+0000 7f8b1ed9d640 1 -- 172.21.15.123:0/296217641 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b200d0a60 msgr2=0x7f8b2015f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.026+0000 7f8b1ed9d640 1 --2- 172.21.15.123:0/296217641 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b200d0a60 0x7f8b2015f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.026+0000 7f8b1ed9d640 1 -- 172.21.15.123:0/296217641 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b202052b0 con 0x7f8b200c53e0 2024-09-15T23:12:24.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.026+0000 7f24ecb84640 1 -- 172.21.15.123:0/620669699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24e0005ea0 msgr2=0x7f24e0180670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.026+0000 7f24ecb84640 1 --2- 172.21.15.123:0/620669699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24e0005ea0 0x7f24e0180670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.026+0000 7f24ecb84640 1 -- 172.21.15.123:0/620669699 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e00e6ac0 con 0x7f24d00039b0 2024-09-15T23:12:24.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.026+0000 7f24ecb84640 1 --2- 172.21.15.123:0/620669699 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f24d00039b0 0x7f24e0005960 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f24e8065710 tx=0x7f24e8069a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:24.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.026+0000 7f24e57fa640 1 -- 172.21.15.123:0/620669699 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e80c1070 con 0x7f24d00039b0 2024-09-15T23:12:24.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.026+0000 7f24e57fa640 1 -- 172.21.15.123:0/620669699 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24e80b9870 con 0x7f24d00039b0 2024-09-15T23:12:24.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.026+0000 7f8b1ed9d640 1 --2- 172.21.15.123:0/296217641 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8b200c53e0 0x7f8b20204d70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8b1000c490 tx=0x7f8b1000c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:24.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.026+0000 7f24e57fa640 1 -- 172.21.15.123:0/620669699 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e80b2040 con 0x7f24d00039b0 2024-09-15T23:12:24.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.026+0000 7f24ed385640 1 --2- 172.21.15.123:0/620669699 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24e0180bb0 0x7f24e004a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:24.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.026+0000 7f24edb86640 1 -- 172.21.15.123:0/620669699 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24e0006340 con 0x7f24d00039b0 2024-09-15T23:12:24.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.026+0000 7f24edb86640 1 -- 172.21.15.123:0/620669699 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24e0006900 con 0x7f24d00039b0 2024-09-15T23:12:24.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.027+0000 7f6017fff640 1 -- 172.21.15.123:0/2183409869 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f602807aff0 con 0x7f603015aec0 2024-09-15T23:12:24.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.028+0000 7f24edb86640 1 -- 172.21.15.123:0/620669699 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24e0180fc0 con 0x7f24d00039b0 2024-09-15T23:12:24.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.028+0000 7f9119ffb640 1 -- 172.21.15.123:0/540953004 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f911c058b80 con 0x7f912413f7d0 2024-09-15T23:12:24.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.028+0000 7f8b077fe640 1 -- 172.21.15.123:0/296217641 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b100052d0 con 0x7f8b200c53e0 2024-09-15T23:12:24.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.028+0000 7f8b25103640 1 -- 172.21.15.123:0/296217641 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b200ce290 con 0x7f8b200c53e0 2024-09-15T23:12:24.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.028+0000 7f8b25103640 1 -- 172.21.15.123:0/296217641 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b200cd4d0 con 0x7f8b200c53e0 2024-09-15T23:12:24.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.028+0000 7f8b077fe640 1 -- 172.21.15.123:0/296217641 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b10005470 con 0x7f8b200c53e0 2024-09-15T23:12:24.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.028+0000 7f8b077fe640 1 -- 172.21.15.123:0/296217641 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b10012850 con 0x7f8b200c53e0 2024-09-15T23:12:24.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.029+0000 7f24e57fa640 1 -- 172.21.15.123:0/620669699 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f24e80b5040 con 0x7f24d00039b0 2024-09-15T23:12:24.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.029+0000 7f24e57fa640 1 --2- 172.21.15.123:0/620669699 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f24d406c2e0 0x7f24d406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.029+0000 7f24e57fa640 1 -- 172.21.15.123:0/620669699 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f24e8127160 con 0x7f24d00039b0 2024-09-15T23:12:24.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.031+0000 7f24e7fff640 1 --2- 172.21.15.123:0/620669699 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f24d406c2e0 0x7f24d406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.028+0000 7f229cb57640 1 -- 172.21.15.123:0/2350262327 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2288036070 con 0x7f2284005210 2024-09-15T23:12:24.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.028+0000 7f229cb57640 1 -- 172.21.15.123:0/2350262327 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2288031400 con 0x7f2284005210 2024-09-15T23:12:24.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.028+0000 7f229cb57640 1 -- 172.21.15.123:0/2350262327 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2288009690 con 0x7f2284005210 2024-09-15T23:12:24.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.029+0000 7f229fdbd640 1 -- 172.21.15.123:0/2350262327 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2284005210 msgr2=0x7f228400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.029+0000 7f229fdbd640 1 --2- 172.21.15.123:0/2350262327 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2284005210 0x7f228400b9c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f22980738b0 tx=0x7f2284005830 comp rx=0 tx=0).stop 2024-09-15T23:12:24.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.029+0000 7f229fdbd640 1 -- 172.21.15.123:0/2350262327 shutdown_connections 2024-09-15T23:12:24.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.029+0000 7f229fdbd640 1 --2- 172.21.15.123:0/2350262327 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2284005210 0x7f228400b9c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.029+0000 7f229fdbd640 1 -- 172.21.15.123:0/2350262327 >> 172.21.15.123:0/2350262327 conn(0x7f229806c240 msgr2=0x7f22980b2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:24.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.030+0000 7f229fdbd640 1 -- 172.21.15.123:0/2350262327 shutdown_connections 2024-09-15T23:12:24.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.030+0000 7f229fdbd640 1 -- 172.21.15.123:0/2350262327 wait complete. 2024-09-15T23:12:24.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.031+0000 7f8b077fe640 1 -- 172.21.15.123:0/296217641 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8b100129f0 con 0x7f8b200c53e0 2024-09-15T23:12:24.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.031+0000 7f8b077fe640 1 --2- 172.21.15.123:0/296217641 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8b0c06c3b0 0x7f8b0c06e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.032+0000 7f229fdbd640 1 Processor -- start 2024-09-15T23:12:24.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.032+0000 7f8b1e59c640 1 --2- 172.21.15.123:0/296217641 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8b0c06c3b0 0x7f8b0c06e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.032+0000 7f24e7fff640 1 --2- 172.21.15.123:0/620669699 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f24d406c2e0 0x7f24d406e7a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f24e00e2420 tx=0x7f24d8001e30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:24.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.032+0000 7f8b077fe640 1 -- 172.21.15.123:0/296217641 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8b1008af60 con 0x7f8b200c53e0 2024-09-15T23:12:24.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.032+0000 7f8b25103640 1 -- 172.21.15.123:0/296217641 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b00005290 con 0x7f8b200c53e0 2024-09-15T23:12:24.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.032+0000 7f8b1e59c640 1 --2- 172.21.15.123:0/296217641 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8b0c06c3b0 0x7f8b0c06e870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8b200c6510 tx=0x7f8b18012040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:24.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.032+0000 7f229fdbd640 1 -- start start 2024-09-15T23:12:24.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.033+0000 7f229fdbd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2284005210 0x7f22980aef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.033+0000 7f229fdbd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2298201b00 0x7f2298152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.033+0000 7f229fdbd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f229815f670 0x7f22980aa460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.033+0000 7f229fdbd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2298072250 con 0x7f2284005210 2024-09-15T23:12:24.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.033+0000 7f229fdbd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2298071f70 con 0x7f229815f670 2024-09-15T23:12:24.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.033+0000 7f229fdbd640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f22980d00d0 con 0x7f2298201b00 2024-09-15T23:12:24.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.033+0000 7f229db59640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2284005210 0x7f22980aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.033+0000 7f229db59640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2284005210 0x7f22980aef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36550/0 (socket says 172.21.15.123:36550) 2024-09-15T23:12:24.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.033+0000 7f229db59640 1 -- 172.21.15.123:0/3893951037 learned_addr learned my addr 172.21.15.123:0/3893951037 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:24.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.033+0000 7f229d358640 1 --2- 172.21.15.123:0/3893951037 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2298201b00 0x7f2298152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.033+0000 7f24e57fa640 1 -- 172.21.15.123:0/620669699 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f24e0180fc0 con 0x7f24d00039b0 2024-09-15T23:12:24.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.033+0000 7f229e35a640 1 --2- 172.21.15.123:0/3893951037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f229815f670 0x7f22980aa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.033+0000 7f229db59640 1 -- 172.21.15.123:0/3893951037 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2298201b00 msgr2=0x7f2298152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.033+0000 7f229db59640 1 --2- 172.21.15.123:0/3893951037 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2298201b00 0x7f2298152210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.034+0000 7f229db59640 1 -- 172.21.15.123:0/3893951037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f229815f670 msgr2=0x7f22980aa460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.034+0000 7f229db59640 1 --2- 172.21.15.123:0/3893951037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f229815f670 0x7f22980aa460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.034+0000 7f229db59640 1 -- 172.21.15.123:0/3893951037 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22980ae1e0 con 0x7f2284005210 2024-09-15T23:12:24.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.034+0000 7f229e35a640 1 --2- 172.21.15.123:0/3893951037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f229815f670 0x7f22980aa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:24.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.034+0000 7f229d358640 1 --2- 172.21.15.123:0/3893951037 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2298201b00 0x7f2298152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:24.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.034+0000 7f229db59640 1 --2- 172.21.15.123:0/3893951037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2284005210 0x7f22980aef30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2294001600 tx=0x7f2294001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:24.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.034+0000 7f228e7fc640 1 -- 172.21.15.123:0/3893951037 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229400f7b0 con 0x7f2284005210 2024-09-15T23:12:24.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.034+0000 7f229fdbd640 1 -- 172.21.15.123:0/3893951037 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2298152750 con 0x7f2284005210 2024-09-15T23:12:24.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.034+0000 7f229fdbd640 1 -- 172.21.15.123:0/3893951037 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22980ae730 con 0x7f2284005210 2024-09-15T23:12:24.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.036+0000 7f228e7fc640 1 -- 172.21.15.123:0/3893951037 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2294018070 con 0x7f2284005210 2024-09-15T23:12:24.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.036+0000 7f229fdbd640 1 -- 172.21.15.123:0/3893951037 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22980d0460 con 0x7f2284005210 2024-09-15T23:12:24.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.038+0000 7f228e7fc640 1 -- 172.21.15.123:0/3893951037 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229400fb50 con 0x7f2284005210 2024-09-15T23:12:24.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.038+0000 7f228e7fc640 1 -- 172.21.15.123:0/3893951037 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f229401d460 con 0x7f2284005210 2024-09-15T23:12:24.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.039+0000 7f228e7fc640 1 --2- 172.21.15.123:0/3893951037 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f227c06c3b0 0x7f227c06e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.040+0000 7f229d358640 1 --2- 172.21.15.123:0/3893951037 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f227c06c3b0 0x7f227c06e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.040+0000 7f228e7fc640 1 -- 172.21.15.123:0/3893951037 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f229408be80 con 0x7f2284005210 2024-09-15T23:12:24.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.040+0000 7f229d358640 1 --2- 172.21.15.123:0/3893951037 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f227c06c3b0 0x7f227c06e870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2290002230 tx=0x7f2290009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:24.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.041+0000 7f8b077fe640 1 -- 172.21.15.123:0/296217641 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8b100b9d50 con 0x7f8b200c53e0 2024-09-15T23:12:24.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.046+0000 7f228e7fc640 1 -- 172.21.15.123:0/3893951037 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2298152750 con 0x7f2284005210 2024-09-15T23:12:24.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.362+0000 7f296d8b7640 1 -- 172.21.15.123:0/4134278670 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f296806dbe0 con 0x7f2968144170 2024-09-15T23:12:24.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.363+0000 7f294ffff640 1 -- 172.21.15.123:0/4134278670 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f29580611c0 con 0x7f2968144170 2024-09-15T23:12:24.364 INFO:teuthology.orchestra.run.smithi123.stdout:60129542150 2024-09-15T23:12:24.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.367+0000 7f294dffb640 1 -- 172.21.15.123:0/4134278670 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f295406c380 msgr2=0x7f295406e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.367+0000 7f294dffb640 1 --2- 172.21.15.123:0/4134278670 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f295406c380 0x7f295406e840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2960001cc0 tx=0x7f2960001c50 comp rx=0 tx=0).stop 2024-09-15T23:12:24.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.367+0000 7f294dffb640 1 -- 172.21.15.123:0/4134278670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2968144170 msgr2=0x7f29680cbf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.367+0000 7f294dffb640 1 --2- 172.21.15.123:0/4134278670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2968144170 0x7f29680cbf90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f295800c4b0 tx=0x7f295800c970 comp rx=0 tx=0).stop 2024-09-15T23:12:24.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.368+0000 7f294dffb640 1 -- 172.21.15.123:0/4134278670 shutdown_connections 2024-09-15T23:12:24.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.368+0000 7f294dffb640 1 --2- 172.21.15.123:0/4134278670 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f295406c380 0x7f295406e840 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.368+0000 7f294dffb640 1 --2- 172.21.15.123:0/4134278670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2968144170 0x7f29680cbf90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.368+0000 7f294dffb640 1 --2- 172.21.15.123:0/4134278670 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f29680d0390 0x7f29680c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.368+0000 7f294dffb640 1 --2- 172.21.15.123:0/4134278670 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2968072740 0x7f29680cf1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.368+0000 7f294dffb640 1 -- 172.21.15.123:0/4134278670 >> 172.21.15.123:0/4134278670 conn(0x7f296806d0f0 msgr2=0x7f296815d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:24.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.368+0000 7f294dffb640 1 -- 172.21.15.123:0/4134278670 shutdown_connections 2024-09-15T23:12:24.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.368+0000 7f294dffb640 1 -- 172.21.15.123:0/4134278670 wait complete. 2024-09-15T23:12:24.382 INFO:teuthology.orchestra.run.smithi123.stdout:68719476744 2024-09-15T23:12:24.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.380+0000 7fddf9ef1640 1 -- 172.21.15.123:0/1790458015 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fddf40c62a0 con 0x7fddf414c480 2024-09-15T23:12:24.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.381+0000 7fddebfff640 1 -- 172.21.15.123:0/1790458015 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fddf40c62a0 con 0x7fddf414c480 2024-09-15T23:12:24.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.384+0000 7fddf9ef1640 1 -- 172.21.15.123:0/1790458015 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fddd406c300 msgr2=0x7fddd406e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.384+0000 7fddf9ef1640 1 --2- 172.21.15.123:0/1790458015 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fddd406c300 0x7fddd406e7c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdddc00ab80 tx=0x7fdddc008040 comp rx=0 tx=0).stop 2024-09-15T23:12:24.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.384+0000 7fddf9ef1640 1 -- 172.21.15.123:0/1790458015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fddf414c480 msgr2=0x7fddf40c8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.384+0000 7fddf9ef1640 1 --2- 172.21.15.123:0/1790458015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fddf414c480 0x7fddf40c8440 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdde400b410 tx=0x7fdde400b8d0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.384+0000 7fddf9ef1640 1 -- 172.21.15.123:0/1790458015 shutdown_connections 2024-09-15T23:12:24.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.384+0000 7fddf9ef1640 1 --2- 172.21.15.123:0/1790458015 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fddf4164650 0x7fddf4204cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.384+0000 7fddf9ef1640 1 --2- 172.21.15.123:0/1790458015 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fddd406c300 0x7fddd406e7c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.384+0000 7fddf9ef1640 1 --2- 172.21.15.123:0/1790458015 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fddf414c480 0x7fddf40c8440 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.384+0000 7fddf9ef1640 1 --2- 172.21.15.123:0/1790458015 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fddf4073750 0x7fddf40c5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.384+0000 7fddf9ef1640 1 -- 172.21.15.123:0/1790458015 >> 172.21.15.123:0/1790458015 conn(0x7fddf40ccec0 msgr2=0x7fddf40cf250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:24.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.384+0000 7fddf9ef1640 1 -- 172.21.15.123:0/1790458015 shutdown_connections 2024-09-15T23:12:24.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.384+0000 7fddf9ef1640 1 -- 172.21.15.123:0/1790458015 wait complete. 2024-09-15T23:12:24.388 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.5 2024-09-15T23:12:24.388 DEBUG:teuthology.parallel:result is None 2024-09-15T23:12:24.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.388+0000 7f6363d5f640 1 -- 172.21.15.123:0/2207001177 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f635c0c53e0 con 0x7f635c0b6150 2024-09-15T23:12:24.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.389+0000 7f63527fc640 1 -- 172.21.15.123:0/2207001177 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6354058af0 con 0x7f635c0b6150 2024-09-15T23:12:24.390 INFO:teuthology.orchestra.run.smithi123.stdout:68719476744 2024-09-15T23:12:24.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.392+0000 7f6363d5f640 1 -- 172.21.15.123:0/2207001177 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f634006c380 msgr2=0x7f634006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.392+0000 7f6363d5f640 1 --2- 172.21.15.123:0/2207001177 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f634006c380 0x7f634006e840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f634c000f60 tx=0x7f634c009040 comp rx=0 tx=0).stop 2024-09-15T23:12:24.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.392+0000 7f6363d5f640 1 -- 172.21.15.123:0/2207001177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f635c0b6150 msgr2=0x7f635c0c9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.392+0000 7f6363d5f640 1 --2- 172.21.15.123:0/2207001177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f635c0b6150 0x7f635c0c9d80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6354001a50 tx=0x7f6354001f10 comp rx=0 tx=0).stop 2024-09-15T23:12:24.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.392+0000 7f6363d5f640 1 -- 172.21.15.123:0/2207001177 shutdown_connections 2024-09-15T23:12:24.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.392+0000 7f6363d5f640 1 --2- 172.21.15.123:0/2207001177 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f635c0d0350 0x7f635c209990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.392+0000 7f6363d5f640 1 --2- 172.21.15.123:0/2207001177 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f634006c380 0x7f634006e840 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.392+0000 7f6363d5f640 1 --2- 172.21.15.123:0/2207001177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f635c0b6150 0x7f635c0c9d80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.392+0000 7f6363d5f640 1 --2- 172.21.15.123:0/2207001177 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f635c072630 0x7f635c0c79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.392+0000 7f6363d5f640 1 -- 172.21.15.123:0/2207001177 >> 172.21.15.123:0/2207001177 conn(0x7f635c06d0f0 msgr2=0x7f635c16a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:24.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.393+0000 7f6363d5f640 1 -- 172.21.15.123:0/2207001177 shutdown_connections 2024-09-15T23:12:24.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.393+0000 7f6363d5f640 1 -- 172.21.15.123:0/2207001177 wait complete. 2024-09-15T23:12:24.402 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476744 got 68719476744 for osd.1 2024-09-15T23:12:24.402 DEBUG:teuthology.parallel:result is None 2024-09-15T23:12:24.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476744 got 68719476744 for osd.0 2024-09-15T23:12:24.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.408+0000 7f912b282640 1 -- 172.21.15.123:0/540953004 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f9124166290 con 0x7f912413f7d0 2024-09-15T23:12:24.410 DEBUG:teuthology.parallel:result is None 2024-09-15T23:12:24.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.409+0000 7f9119ffb640 1 -- 172.21.15.123:0/540953004 <== mon.2 v2:172.21.15.188:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f911c05ce80 con 0x7f912413f7d0 2024-09-15T23:12:24.410 INFO:teuthology.orchestra.run.smithi123.stdout:60129542151 2024-09-15T23:12:24.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.411+0000 7f912b282640 1 -- 172.21.15.123:0/540953004 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f910806c380 msgr2=0x7f910806e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.411+0000 7f912b282640 1 --2- 172.21.15.123:0/540953004 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f910806c380 0x7f910806e840 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9114007fd0 tx=0x7f9114009040 comp rx=0 tx=0).stop 2024-09-15T23:12:24.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.411+0000 7f912b282640 1 -- 172.21.15.123:0/540953004 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f912413f7d0 msgr2=0x7f91240ce410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.411+0000 7f912b282640 1 --2- 172.21.15.123:0/540953004 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f912413f7d0 0x7f91240ce410 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f911c00c750 tx=0x7f911c00cc10 comp rx=0 tx=0).stop 2024-09-15T23:12:24.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.411+0000 7f912b282640 1 -- 172.21.15.123:0/540953004 shutdown_connections 2024-09-15T23:12:24.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.411+0000 7f912b282640 1 --2- 172.21.15.123:0/540953004 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f912413f7d0 0x7f91240ce410 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.411+0000 7f912b282640 1 --2- 172.21.15.123:0/540953004 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f91240d0390 0x7f91240cded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.411+0000 7f912b282640 1 --2- 172.21.15.123:0/540953004 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f910806c380 0x7f910806e840 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.411+0000 7f912b282640 1 --2- 172.21.15.123:0/540953004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f912406dbe0 0x7f9124152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.411+0000 7f912b282640 1 -- 172.21.15.123:0/540953004 >> 172.21.15.123:0/540953004 conn(0x7f912406d0f0 msgr2=0x7f91240b3470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:24.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.411+0000 7f912b282640 1 -- 172.21.15.123:0/540953004 shutdown_connections 2024-09-15T23:12:24.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.411+0000 7f912b282640 1 -- 172.21.15.123:0/540953004 wait complete. 2024-09-15T23:12:24.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.414+0000 7f6035f6d640 1 -- 172.21.15.123:0/2183409869 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f6010005580 con 0x7f603015aec0 2024-09-15T23:12:24.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.414+0000 7f6017fff640 1 -- 172.21.15.123:0/2183409869 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f602807a8f0 con 0x7f603015aec0 2024-09-15T23:12:24.415 INFO:teuthology.orchestra.run.smithi123.stdout:60129542151 2024-09-15T23:12:24.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.415+0000 7f229fdbd640 1 -- 172.21.15.123:0/3893951037 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f2298169640 con 0x7f2284005210 2024-09-15T23:12:24.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.415+0000 7f228e7fc640 1 -- 172.21.15.123:0/3893951037 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f229405a5d0 con 0x7f2284005210 2024-09-15T23:12:24.416 INFO:teuthology.orchestra.run.smithi123.stdout:68719476745 2024-09-15T23:12:24.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.417+0000 7f6035f6d640 1 -- 172.21.15.123:0/2183409869 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f601c06c3b0 msgr2=0x7f601c06e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.417+0000 7f6035f6d640 1 --2- 172.21.15.123:0/2183409869 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f601c06c3b0 0x7f601c06e870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6020006fd0 tx=0x7f6020008040 comp rx=0 tx=0).stop 2024-09-15T23:12:24.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.417+0000 7f6035f6d640 1 -- 172.21.15.123:0/2183409869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f603015aec0 msgr2=0x7f60300cf0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.417+0000 7f6035f6d640 1 --2- 172.21.15.123:0/2183409869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f603015aec0 0x7f60300cf0f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6028030000 tx=0x7f6028004a40 comp rx=0 tx=0).stop 2024-09-15T23:12:24.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.417+0000 7f6035f6d640 1 -- 172.21.15.123:0/2183409869 shutdown_connections 2024-09-15T23:12:24.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.417+0000 7f6035f6d640 1 --2- 172.21.15.123:0/2183409869 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f601c06c3b0 0x7f601c06e870 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.417+0000 7f6035f6d640 1 --2- 172.21.15.123:0/2183409869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f603015aec0 0x7f60300cf0f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.417+0000 7f6035f6d640 1 --2- 172.21.15.123:0/2183409869 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6030072740 0x7f6030153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.417+0000 7f6035f6d640 1 --2- 172.21.15.123:0/2183409869 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f603006dbe0 0x7f60300c6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.417+0000 7f6035f6d640 1 -- 172.21.15.123:0/2183409869 >> 172.21.15.123:0/2183409869 conn(0x7f603006d0f0 msgr2=0x7f603006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:24.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.417+0000 7f6035f6d640 1 -- 172.21.15.123:0/2183409869 shutdown_connections 2024-09-15T23:12:24.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.417+0000 7f6035f6d640 1 -- 172.21.15.123:0/2183409869 wait complete. 2024-09-15T23:12:24.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.418+0000 7f229fdbd640 1 -- 172.21.15.123:0/3893951037 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f227c06c3b0 msgr2=0x7f227c06e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.418+0000 7f229fdbd640 1 --2- 172.21.15.123:0/3893951037 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f227c06c3b0 0x7f227c06e870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2290002230 tx=0x7f2290009040 comp rx=0 tx=0).stop 2024-09-15T23:12:24.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.418+0000 7f229fdbd640 1 -- 172.21.15.123:0/3893951037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2284005210 msgr2=0x7f22980aef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.418+0000 7f229fdbd640 1 --2- 172.21.15.123:0/3893951037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2284005210 0x7f22980aef30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2294001600 tx=0x7f2294001ac0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.418+0000 7f229fdbd640 1 -- 172.21.15.123:0/3893951037 shutdown_connections 2024-09-15T23:12:24.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.418+0000 7f229fdbd640 1 --2- 172.21.15.123:0/3893951037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f229815f670 0x7f22980aa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.418+0000 7f229fdbd640 1 --2- 172.21.15.123:0/3893951037 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2298201b00 0x7f2298152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.418+0000 7f229fdbd640 1 --2- 172.21.15.123:0/3893951037 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f227c06c3b0 0x7f227c06e870 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.418+0000 7f229fdbd640 1 --2- 172.21.15.123:0/3893951037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2284005210 0x7f22980aef30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.418+0000 7f229fdbd640 1 -- 172.21.15.123:0/3893951037 >> 172.21.15.123:0/3893951037 conn(0x7f229806c240 msgr2=0x7f22980b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:24.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.418+0000 7f229fdbd640 1 -- 172.21.15.123:0/3893951037 shutdown_connections 2024-09-15T23:12:24.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.418+0000 7f229fdbd640 1 -- 172.21.15.123:0/3893951037 wait complete. 2024-09-15T23:12:24.425 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.6 2024-09-15T23:12:24.425 DEBUG:teuthology.parallel:result is None 2024-09-15T23:12:24.431 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.7 2024-09-15T23:12:24.431 DEBUG:teuthology.parallel:result is None 2024-09-15T23:12:24.432 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476745 got 68719476745 for osd.3 2024-09-15T23:12:24.432 DEBUG:teuthology.parallel:result is None 2024-09-15T23:12:24.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.437+0000 7f24edb86640 1 -- 172.21.15.123:0/620669699 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f24e0007f60 con 0x7f24d00039b0 2024-09-15T23:12:24.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.438+0000 7f24e57fa640 1 -- 172.21.15.123:0/620669699 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f24e80f5300 con 0x7f24d00039b0 2024-09-15T23:12:24.439 INFO:teuthology.orchestra.run.smithi123.stdout:68719476742 2024-09-15T23:12:24.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.441+0000 7f24edb86640 1 -- 172.21.15.123:0/620669699 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f24d406c2e0 msgr2=0x7f24d406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.441+0000 7f24edb86640 1 --2- 172.21.15.123:0/620669699 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f24d406c2e0 0x7f24d406e7a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f24e00e2420 tx=0x7f24d8001e30 comp rx=0 tx=0).stop 2024-09-15T23:12:24.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.441+0000 7f24edb86640 1 -- 172.21.15.123:0/620669699 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f24d00039b0 msgr2=0x7f24e0005960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.441+0000 7f24edb86640 1 --2- 172.21.15.123:0/620669699 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f24d00039b0 0x7f24e0005960 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f24e8065710 tx=0x7f24e8069a70 comp rx=0 tx=0).stop 2024-09-15T23:12:24.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.441+0000 7f24edb86640 1 -- 172.21.15.123:0/620669699 shutdown_connections 2024-09-15T23:12:24.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.441+0000 7f24edb86640 1 --2- 172.21.15.123:0/620669699 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24e0180bb0 0x7f24e004a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.441+0000 7f24edb86640 1 --2- 172.21.15.123:0/620669699 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f24d406c2e0 0x7f24d406e7a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.441+0000 7f24edb86640 1 --2- 172.21.15.123:0/620669699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24e0005ea0 0x7f24e0180670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.441+0000 7f24edb86640 1 --2- 172.21.15.123:0/620669699 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f24d00039b0 0x7f24e0005960 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.441+0000 7f24edb86640 1 -- 172.21.15.123:0/620669699 >> 172.21.15.123:0/620669699 conn(0x7f24e001e190 msgr2=0x7f24e0031af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:24.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.441+0000 7f24edb86640 1 -- 172.21.15.123:0/620669699 shutdown_connections 2024-09-15T23:12:24.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.441+0000 7f24edb86640 1 -- 172.21.15.123:0/620669699 wait complete. 2024-09-15T23:12:24.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.443+0000 7f8b25103640 1 -- 172.21.15.123:0/296217641 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f8b00005580 con 0x7f8b200c53e0 2024-09-15T23:12:24.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.444+0000 7f8b077fe640 1 -- 172.21.15.123:0/296217641 <== mon.2 v2:172.21.15.188:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8b10059060 con 0x7f8b200c53e0 2024-09-15T23:12:24.445 INFO:teuthology.orchestra.run.smithi123.stdout:60129542152 2024-09-15T23:12:24.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.447+0000 7f8b25103640 1 -- 172.21.15.123:0/296217641 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8b0c06c3b0 msgr2=0x7f8b0c06e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.447+0000 7f8b25103640 1 --2- 172.21.15.123:0/296217641 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8b0c06c3b0 0x7f8b0c06e870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8b200c6510 tx=0x7f8b18012040 comp rx=0 tx=0).stop 2024-09-15T23:12:24.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.447+0000 7f8b25103640 1 -- 172.21.15.123:0/296217641 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8b200c53e0 msgr2=0x7f8b20204d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.447+0000 7f8b25103640 1 --2- 172.21.15.123:0/296217641 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8b200c53e0 0x7f8b20204d70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8b1000c490 tx=0x7f8b1000c950 comp rx=0 tx=0).stop 2024-09-15T23:12:24.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.447+0000 7f8b25103640 1 -- 172.21.15.123:0/296217641 shutdown_connections 2024-09-15T23:12:24.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.447+0000 7f8b25103640 1 --2- 172.21.15.123:0/296217641 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b2016b540 0x7f8b200cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.447+0000 7f8b25103640 1 --2- 172.21.15.123:0/296217641 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8b0c06c3b0 0x7f8b0c06e870 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.447+0000 7f8b25103640 1 --2- 172.21.15.123:0/296217641 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b200d0a60 0x7f8b2015f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.447+0000 7f8b25103640 1 --2- 172.21.15.123:0/296217641 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8b200c53e0 0x7f8b20204d70 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.447+0000 7f8b25103640 1 -- 172.21.15.123:0/296217641 >> 172.21.15.123:0/296217641 conn(0x7f8b2006d0f0 msgr2=0x7f8b20171310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:24.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.447+0000 7f8b25103640 1 -- 172.21.15.123:0/296217641 shutdown_connections 2024-09-15T23:12:24.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.447+0000 7f8b25103640 1 -- 172.21.15.123:0/296217641 wait complete. 2024-09-15T23:12:24.457 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476742 got 68719476742 for osd.2 2024-09-15T23:12:24.457 DEBUG:teuthology.parallel:result is None 2024-09-15T23:12:24.461 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.4 2024-09-15T23:12:24.461 DEBUG:teuthology.parallel:result is None 2024-09-15T23:12:24.461 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T23:12:24.461 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:12:24.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.598+0000 7f6bf2166640 1 Processor -- start 2024-09-15T23:12:24.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.598+0000 7f6bf2166640 1 -- start start 2024-09-15T23:12:24.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.598+0000 7f6bf2166640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6bec0b2d40 0x7f6bec06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.598+0000 7f6bf2166640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6bec13eb20 0x7f6bec06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.598+0000 7f6bf2166640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bec071180 con 0x7f6bec15bcf0 2024-09-15T23:12:24.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.598+0000 7f6bf2166640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f6bec071ab0 con 0x7f6bec13eb20 2024-09-15T23:12:24.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.598+0000 7f6bf2166640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6bec071460 con 0x7f6bec0b2d40 2024-09-15T23:12:24.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.599+0000 7f6beaffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6bec13eb20 0x7f6bec06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.599+0000 7f6bebfff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6bec15bcf0 0x7f6bec15c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39174/0 (socket says 172.21.15.123:39174) 2024-09-15T23:12:24.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.599+0000 7f6beaffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6bec13eb20 0x7f6bec06c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36560/0 (socket says 172.21.15.123:36560) 2024-09-15T23:12:24.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.599+0000 7f6bebfff640 1 -- 172.21.15.123:0/828243362 learned_addr learned my addr 172.21.15.123:0/828243362 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:24.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.599+0000 7f6beaffd640 1 -- 172.21.15.123:0/828243362 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6bec0b2d40 msgr2=0x7f6bec06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:24.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.599+0000 7f6beb7fe640 1 --2- 172.21.15.123:0/828243362 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6bec0b2d40 0x7f6bec06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.599+0000 7f6bea7fc640 1 -- 172.21.15.123:0/828243362 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3544041592 0 0) 0x7f6bec071180 con 0x7f6bec15bcf0 2024-09-15T23:12:24.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.599+0000 7f6beaffd640 1 --2- 172.21.15.123:0/828243362 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6bec0b2d40 0x7f6bec06bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.599+0000 7f6beaffd640 1 -- 172.21.15.123:0/828243362 >> v1:172.21.15.123:6789/0 conn(0x7f6bec15bcf0 legacy=0x7f6bec15c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.599+0000 7f6beaffd640 1 -- 172.21.15.123:0/828243362 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bec071740 con 0x7f6bec13eb20 2024-09-15T23:12:24.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.600+0000 7f6beaffd640 1 --2- 172.21.15.123:0/828243362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bec13eb20 0x7f6bec06c150 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6bec071c30 tx=0x7f6bdc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd91fb3cffc5a646 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:24.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.600+0000 7f6bea7fc640 1 -- 172.21.15.123:0/828243362 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc037070 con 0x7f6bec13eb20 2024-09-15T23:12:24.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.600+0000 7f6bea7fc640 1 -- 172.21.15.123:0/828243362 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bdc032440 con 0x7f6bec13eb20 2024-09-15T23:12:24.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.600+0000 7f6bea7fc640 1 -- 172.21.15.123:0/828243362 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc032810 con 0x7f6bec13eb20 2024-09-15T23:12:24.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.600+0000 7f6bf2166640 1 -- 172.21.15.123:0/828243362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bec13eb20 msgr2=0x7f6bec06c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.600+0000 7f6bf2166640 1 --2- 172.21.15.123:0/828243362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bec13eb20 0x7f6bec06c150 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6bec071c30 tx=0x7f6bdc02a180 comp rx=0 tx=0).stop 2024-09-15T23:12:24.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.600+0000 7f6bf2166640 1 -- 172.21.15.123:0/828243362 shutdown_connections 2024-09-15T23:12:24.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.600+0000 7f6bf2166640 1 --2- 172.21.15.123:0/828243362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bec13eb20 0x7f6bec06c150 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.600+0000 7f6bf2166640 1 --2- 172.21.15.123:0/828243362 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6bec0b2d40 0x7f6bec06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.600+0000 7f6bf2166640 1 -- 172.21.15.123:0/828243362 >> 172.21.15.123:0/828243362 conn(0x7f6bec0ccec0 msgr2=0x7f6bec0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:24.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.600+0000 7f6bf2166640 1 -- 172.21.15.123:0/828243362 shutdown_connections 2024-09-15T23:12:24.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.600+0000 7f6bf2166640 1 -- 172.21.15.123:0/828243362 wait complete. 2024-09-15T23:12:24.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.601+0000 7f6bf2166640 1 Processor -- start 2024-09-15T23:12:24.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.602+0000 7f6bf2166640 1 -- start start 2024-09-15T23:12:24.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.602+0000 7f6bf2166640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6bec0b2d40 0x7f6bec0b5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.602+0000 7f6bf2166640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bec13eb20 0x7f6bec154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.602+0000 7f6bf2166640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6bec15bcf0 0x7f6bec154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.602+0000 7f6bf2166640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6bec0722d0 con 0x7f6bec13eb20 2024-09-15T23:12:24.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.602+0000 7f6bf2166640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6bec072150 con 0x7f6bec0b2d40 2024-09-15T23:12:24.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.602+0000 7f6bf2166640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6bec072450 con 0x7f6bec15bcf0 2024-09-15T23:12:24.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.602+0000 7f6beaffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bec13eb20 0x7f6bec154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.602+0000 7f6beaffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bec13eb20 0x7f6bec154310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36562/0 (socket says 172.21.15.123:36562) 2024-09-15T23:12:24.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.602+0000 7f6beaffd640 1 -- 172.21.15.123:0/2288847581 learned_addr learned my addr 172.21.15.123:0/2288847581 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:24.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.603+0000 7f6beb7fe640 1 --2- 172.21.15.123:0/2288847581 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6bec0b2d40 0x7f6bec0b5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.603+0000 7f6bebfff640 1 --2- 172.21.15.123:0/2288847581 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6bec15bcf0 0x7f6bec154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.603+0000 7f6beaffd640 1 -- 172.21.15.123:0/2288847581 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6bec15bcf0 msgr2=0x7f6bec154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.603+0000 7f6beaffd640 1 --2- 172.21.15.123:0/2288847581 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6bec15bcf0 0x7f6bec154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.603+0000 7f6beaffd640 1 -- 172.21.15.123:0/2288847581 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6bec0b2d40 msgr2=0x7f6bec0b5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.603+0000 7f6beaffd640 1 --2- 172.21.15.123:0/2288847581 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6bec0b2d40 0x7f6bec0b5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.603+0000 7f6beaffd640 1 -- 172.21.15.123:0/2288847581 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bec156340 con 0x7f6bec13eb20 2024-09-15T23:12:24.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.603+0000 7f6beb7fe640 1 --2- 172.21.15.123:0/2288847581 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6bec0b2d40 0x7f6bec0b5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:24.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.603+0000 7f6beaffd640 1 --2- 172.21.15.123:0/2288847581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bec13eb20 0x7f6bec154310 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc000c00 tx=0x7f6bdc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:24.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.603+0000 7f6be3fff640 1 -- 172.21.15.123:0/2288847581 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc037050 con 0x7f6bec13eb20 2024-09-15T23:12:24.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.603+0000 7f6be3fff640 1 -- 172.21.15.123:0/2288847581 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bdc038040 con 0x7f6bec13eb20 2024-09-15T23:12:24.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.603+0000 7f6be3fff640 1 -- 172.21.15.123:0/2288847581 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc004450 con 0x7f6bec13eb20 2024-09-15T23:12:24.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.603+0000 7f6bf2166640 1 -- 172.21.15.123:0/2288847581 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bec156620 con 0x7f6bec13eb20 2024-09-15T23:12:24.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.603+0000 7f6bf2166640 1 -- 172.21.15.123:0/2288847581 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bec0b5630 con 0x7f6bec13eb20 2024-09-15T23:12:24.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.604+0000 7f6bf2166640 1 -- 172.21.15.123:0/2288847581 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bec0b5180 con 0x7f6bec13eb20 2024-09-15T23:12:24.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.604+0000 7f6be3fff640 1 -- 172.21.15.123:0/2288847581 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6bdc030980 con 0x7f6bec13eb20 2024-09-15T23:12:24.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.605+0000 7f6be3fff640 1 --2- 172.21.15.123:0/2288847581 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6bcc06c2b0 0x7f6bcc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.605+0000 7f6be3fff640 1 -- 172.21.15.123:0/2288847581 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f6bdc0ac130 con 0x7f6bec13eb20 2024-09-15T23:12:24.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.605+0000 7f6beb7fe640 1 --2- 172.21.15.123:0/2288847581 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6bcc06c2b0 0x7f6bcc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.605+0000 7f6beb7fe640 1 --2- 172.21.15.123:0/2288847581 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6bcc06c2b0 0x7f6bcc06e770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6bec13f410 tx=0x7f6bd4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:24.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.609+0000 7f6be3fff640 1 -- 172.21.15.123:0/2288847581 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6bdc07a9c0 con 0x7f6bec13eb20 2024-09-15T23:12:24.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.770+0000 7f6bf2166640 1 -- 172.21.15.123:0/2288847581 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6bec071280 con 0x7f6bcc06c2b0 2024-09-15T23:12:24.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.777+0000 7f6be3fff640 1 -- 172.21.15.123:0/2288847581 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251833 (secure 0 0 0) 0x7f6bec071280 con 0x7f6bcc06c2b0 2024-09-15T23:12:24.780 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:24.781 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:12:24.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.779+0000 7f6bf2166640 1 -- 172.21.15.123:0/2288847581 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6bcc06c2b0 msgr2=0x7f6bcc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.779+0000 7f6bf2166640 1 --2- 172.21.15.123:0/2288847581 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6bcc06c2b0 0x7f6bcc06e770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6bec13f410 tx=0x7f6bd4008040 comp rx=0 tx=0).stop 2024-09-15T23:12:24.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.779+0000 7f6bf2166640 1 -- 172.21.15.123:0/2288847581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bec13eb20 msgr2=0x7f6bec154310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.779+0000 7f6bf2166640 1 --2- 172.21.15.123:0/2288847581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bec13eb20 0x7f6bec154310 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc000c00 tx=0x7f6bdc0046c0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.779+0000 7f6bf2166640 1 -- 172.21.15.123:0/2288847581 shutdown_connections 2024-09-15T23:12:24.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.779+0000 7f6bf2166640 1 --2- 172.21.15.123:0/2288847581 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6bec15bcf0 0x7f6bec154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.779+0000 7f6bf2166640 1 --2- 172.21.15.123:0/2288847581 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6bcc06c2b0 0x7f6bcc06e770 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.779+0000 7f6bf2166640 1 --2- 172.21.15.123:0/2288847581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bec13eb20 0x7f6bec154310 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.779+0000 7f6bf2166640 1 --2- 172.21.15.123:0/2288847581 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6bec0b2d40 0x7f6bec0b5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.779+0000 7f6bf2166640 1 -- 172.21.15.123:0/2288847581 >> 172.21.15.123:0/2288847581 conn(0x7f6bec0ccec0 msgr2=0x7f6bec15a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:24.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.779+0000 7f6bf2166640 1 -- 172.21.15.123:0/2288847581 shutdown_connections 2024-09-15T23:12:24.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.779+0000 7f6bf2166640 1 -- 172.21.15.123:0/2288847581 wait complete. 2024-09-15T23:12:24.790 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-15T23:12:23.504663+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219176,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755544,"statfs":{"total":773094113280,"available":772869677056,"internally_reserved":0,"allocated":2990080,"data_stored":1797268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002619"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.278230+0000","last_change":"2024-09-15T23:12:13.304372+0000","last_active":"2024-09-15T23:12:15.278230+0000","last_peered":"2024-09-15T23:12:15.278230+0000","last_clean":"2024-09-15T23:12:15.278230+0000","last_became_active":"2024-09-15T23:12:13.304067+0000","last_became_peered":"2024-09-15T23:12:13.304067+0000","last_unstale":"2024-09-15T23:12:15.278230+0000","last_undegraded":"2024-09-15T23:12:15.278230+0000","last_fullsized":"2024-09-15T23:12:15.278230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:16.349500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277385+0000","last_change":"2024-09-15T23:12:13.302592+0000","last_active":"2024-09-15T23:12:15.277385+0000","last_peered":"2024-09-15T23:12:15.277385+0000","last_clean":"2024-09-15T23:12:15.277385+0000","last_became_active":"2024-09-15T23:12:13.301990+0000","last_became_peered":"2024-09-15T23:12:13.301990+0000","last_unstale":"2024-09-15T23:12:15.277385+0000","last_undegraded":"2024-09-15T23:12:15.277385+0000","last_fullsized":"2024-09-15T23:12:15.277385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:10:09.891348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277323+0000","last_change":"2024-09-15T23:12:13.301292+0000","last_active":"2024-09-15T23:12:15.277323+0000","last_peered":"2024-09-15T23:12:15.277323+0000","last_clean":"2024-09-15T23:12:15.277323+0000","last_became_active":"2024-09-15T23:12:13.301019+0000","last_became_peered":"2024-09-15T23:12:13.301019+0000","last_unstale":"2024-09-15T23:12:15.277323+0000","last_undegraded":"2024-09-15T23:12:15.277323+0000","last_fullsized":"2024-09-15T23:12:15.277323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:45:01.842037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.278258+0000","last_change":"2024-09-15T23:12:13.302730+0000","last_active":"2024-09-15T23:12:15.278258+0000","last_peered":"2024-09-15T23:12:15.278258+0000","last_clean":"2024-09-15T23:12:15.278258+0000","last_became_active":"2024-09-15T23:12:13.302301+0000","last_became_peered":"2024-09-15T23:12:13.302301+0000","last_unstale":"2024-09-15T23:12:15.278258+0000","last_undegraded":"2024-09-15T23:12:15.278258+0000","last_fullsized":"2024-09-15T23:12:15.278258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:08:51.159156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277829+0000","last_change":"2024-09-15T23:12:13.298592+0000","last_active":"2024-09-15T23:12:15.277829+0000","last_peered":"2024-09-15T23:12:15.277829+0000","last_clean":"2024-09-15T23:12:15.277829+0000","last_became_active":"2024-09-15T23:12:13.298358+0000","last_became_peered":"2024-09-15T23:12:13.298358+0000","last_unstale":"2024-09-15T23:12:15.277829+0000","last_undegraded":"2024-09-15T23:12:15.277829+0000","last_fullsized":"2024-09-15T23:12:15.277829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:10.513438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277736+0000","last_change":"2024-09-15T23:12:13.302119+0000","last_active":"2024-09-15T23:12:15.277736+0000","last_peered":"2024-09-15T23:12:15.277736+0000","last_clean":"2024-09-15T23:12:15.277736+0000","last_became_active":"2024-09-15T23:12:13.301671+0000","last_became_peered":"2024-09-15T23:12:13.301671+0000","last_unstale":"2024-09-15T23:12:15.277736+0000","last_undegraded":"2024-09-15T23:12:15.277736+0000","last_fullsized":"2024-09-15T23:12:15.277736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:47.721506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277474+0000","last_change":"2024-09-15T23:12:13.301523+0000","last_active":"2024-09-15T23:12:15.277474+0000","last_peered":"2024-09-15T23:12:15.277474+0000","last_clean":"2024-09-15T23:12:15.277474+0000","last_became_active":"2024-09-15T23:12:13.301272+0000","last_became_peered":"2024-09-15T23:12:13.301272+0000","last_unstale":"2024-09-15T23:12:15.277474+0000","last_undegraded":"2024-09-15T23:12:15.277474+0000","last_fullsized":"2024-09-15T23:12:15.277474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:11.528380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277112+0000","last_change":"2024-09-15T23:12:13.297810+0000","last_active":"2024-09-15T23:12:15.277112+0000","last_peered":"2024-09-15T23:12:15.277112+0000","last_clean":"2024-09-15T23:12:15.277112+0000","last_became_active":"2024-09-15T23:12:13.295627+0000","last_became_peered":"2024-09-15T23:12:13.295627+0000","last_unstale":"2024-09-15T23:12:15.277112+0000","last_undegraded":"2024-09-15T23:12:15.277112+0000","last_fullsized":"2024-09-15T23:12:15.277112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:40.921752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.281209+0000","last_change":"2024-09-15T23:12:13.295501+0000","last_active":"2024-09-15T23:12:14.281209+0000","last_peered":"2024-09-15T23:12:14.281209+0000","last_clean":"2024-09-15T23:12:14.281209+0000","last_became_active":"2024-09-15T23:12:13.294470+0000","last_became_peered":"2024-09-15T23:12:13.294470+0000","last_unstale":"2024-09-15T23:12:14.281209+0000","last_undegraded":"2024-09-15T23:12:14.281209+0000","last_fullsized":"2024-09-15T23:12:14.281209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:27:22.925825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.278281+0000","last_change":"2024-09-15T23:12:13.300057+0000","last_active":"2024-09-15T23:12:15.278281+0000","last_peered":"2024-09-15T23:12:15.278281+0000","last_clean":"2024-09-15T23:12:15.278281+0000","last_became_active":"2024-09-15T23:12:13.299762+0000","last_became_peered":"2024-09-15T23:12:13.299762+0000","last_unstale":"2024-09-15T23:12:15.278281+0000","last_undegraded":"2024-09-15T23:12:15.278281+0000","last_fullsized":"2024-09-15T23:12:15.278281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:09:30.105488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277451+0000","last_change":"2024-09-15T23:12:13.296975+0000","last_active":"2024-09-15T23:12:15.277451+0000","last_peered":"2024-09-15T23:12:15.277451+0000","last_clean":"2024-09-15T23:12:15.277451+0000","last_became_active":"2024-09-15T23:12:13.296726+0000","last_became_peered":"2024-09-15T23:12:13.296726+0000","last_unstale":"2024-09-15T23:12:15.277451+0000","last_undegraded":"2024-09-15T23:12:15.277451+0000","last_fullsized":"2024-09-15T23:12:15.277451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:54:01.331747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277641+0000","last_change":"2024-09-15T23:12:13.299790+0000","last_active":"2024-09-15T23:12:15.277641+0000","last_peered":"2024-09-15T23:12:15.277641+0000","last_clean":"2024-09-15T23:12:15.277641+0000","last_became_active":"2024-09-15T23:12:13.299446+0000","last_became_peered":"2024-09-15T23:12:13.299446+0000","last_unstale":"2024-09-15T23:12:15.277641+0000","last_undegraded":"2024-09-15T23:12:15.277641+0000","last_fullsized":"2024-09-15T23:12:15.277641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:25.899342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142410+0000","last_change":"2024-09-15T23:12:13.303570+0000","last_active":"2024-09-15T23:12:15.142410+0000","last_peered":"2024-09-15T23:12:15.142410+0000","last_clean":"2024-09-15T23:12:15.142410+0000","last_became_active":"2024-09-15T23:12:13.303303+0000","last_became_peered":"2024-09-15T23:12:13.303303+0000","last_unstale":"2024-09-15T23:12:15.142410+0000","last_undegraded":"2024-09-15T23:12:15.142410+0000","last_fullsized":"2024-09-15T23:12:15.142410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:14.355538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142296+0000","last_change":"2024-09-15T23:12:13.297459+0000","last_active":"2024-09-15T23:12:15.142296+0000","last_peered":"2024-09-15T23:12:15.142296+0000","last_clean":"2024-09-15T23:12:15.142296+0000","last_became_active":"2024-09-15T23:12:13.293984+0000","last_became_peered":"2024-09-15T23:12:13.293984+0000","last_unstale":"2024-09-15T23:12:15.142296+0000","last_undegraded":"2024-09-15T23:12:15.142296+0000","last_fullsized":"2024-09-15T23:12:15.142296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:26:22.310337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277181+0000","last_change":"2024-09-15T23:12:13.296112+0000","last_active":"2024-09-15T23:12:15.277181+0000","last_peered":"2024-09-15T23:12:15.277181+0000","last_clean":"2024-09-15T23:12:15.277181+0000","last_became_active":"2024-09-15T23:12:13.295405+0000","last_became_peered":"2024-09-15T23:12:13.295405+0000","last_unstale":"2024-09-15T23:12:15.277181+0000","last_undegraded":"2024-09-15T23:12:15.277181+0000","last_fullsized":"2024-09-15T23:12:15.277181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:53.919348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282130+0000","last_change":"2024-09-15T23:12:13.302744+0000","last_active":"2024-09-15T23:12:14.282130+0000","last_peered":"2024-09-15T23:12:14.282130+0000","last_clean":"2024-09-15T23:12:14.282130+0000","last_became_active":"2024-09-15T23:12:13.302439+0000","last_became_peered":"2024-09-15T23:12:13.302439+0000","last_unstale":"2024-09-15T23:12:14.282130+0000","last_undegraded":"2024-09-15T23:12:14.282130+0000","last_fullsized":"2024-09-15T23:12:14.282130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:16.349500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282569+0000","last_change":"2024-09-15T23:12:13.298338+0000","last_active":"2024-09-15T23:12:14.282569+0000","last_peered":"2024-09-15T23:12:14.282569+0000","last_clean":"2024-09-15T23:12:14.282569+0000","last_became_active":"2024-09-15T23:12:13.297884+0000","last_became_peered":"2024-09-15T23:12:13.297884+0000","last_unstale":"2024-09-15T23:12:14.282569+0000","last_undegraded":"2024-09-15T23:12:14.282569+0000","last_fullsized":"2024-09-15T23:12:14.282569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:41:23.354555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282638+0000","last_change":"2024-09-15T23:12:13.306391+0000","last_active":"2024-09-15T23:12:14.282638+0000","last_peered":"2024-09-15T23:12:14.282638+0000","last_clean":"2024-09-15T23:12:14.282638+0000","last_became_active":"2024-09-15T23:12:13.306106+0000","last_became_peered":"2024-09-15T23:12:13.306106+0000","last_unstale":"2024-09-15T23:12:14.282638+0000","last_undegraded":"2024-09-15T23:12:14.282638+0000","last_fullsized":"2024-09-15T23:12:14.282638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:28.292228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282623+0000","last_change":"2024-09-15T23:12:13.300688+0000","last_active":"2024-09-15T23:12:14.282623+0000","last_peered":"2024-09-15T23:12:14.282623+0000","last_clean":"2024-09-15T23:12:14.282623+0000","last_became_active":"2024-09-15T23:12:13.300388+0000","last_became_peered":"2024-09-15T23:12:13.300388+0000","last_unstale":"2024-09-15T23:12:14.282623+0000","last_undegraded":"2024-09-15T23:12:14.282623+0000","last_fullsized":"2024-09-15T23:12:14.282623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:48.197999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277699+0000","last_change":"2024-09-15T23:12:13.295852+0000","last_active":"2024-09-15T23:12:15.277699+0000","last_peered":"2024-09-15T23:12:15.277699+0000","last_clean":"2024-09-15T23:12:15.277699+0000","last_became_active":"2024-09-15T23:12:13.295536+0000","last_became_peered":"2024-09-15T23:12:13.295536+0000","last_unstale":"2024-09-15T23:12:15.277699+0000","last_undegraded":"2024-09-15T23:12:15.277699+0000","last_fullsized":"2024-09-15T23:12:15.277699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:10.165586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776770+0000","last_change":"2024-09-15T23:12:13.302978+0000","last_active":"2024-09-15T23:12:14.776770+0000","last_peered":"2024-09-15T23:12:14.776770+0000","last_clean":"2024-09-15T23:12:14.776770+0000","last_became_active":"2024-09-15T23:12:13.302474+0000","last_became_peered":"2024-09-15T23:12:13.302474+0000","last_unstale":"2024-09-15T23:12:14.776770+0000","last_undegraded":"2024-09-15T23:12:14.776770+0000","last_fullsized":"2024-09-15T23:12:14.776770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:13:52.918855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.280957+0000","last_change":"2024-09-15T23:12:13.296548+0000","last_active":"2024-09-15T23:12:14.280957+0000","last_peered":"2024-09-15T23:12:14.280957+0000","last_clean":"2024-09-15T23:12:14.280957+0000","last_became_active":"2024-09-15T23:12:13.294814+0000","last_became_peered":"2024-09-15T23:12:13.294814+0000","last_unstale":"2024-09-15T23:12:14.280957+0000","last_undegraded":"2024-09-15T23:12:14.280957+0000","last_fullsized":"2024-09-15T23:12:14.280957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:30.079827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277175+0000","last_change":"2024-09-15T23:12:13.298250+0000","last_active":"2024-09-15T23:12:15.277175+0000","last_peered":"2024-09-15T23:12:15.277175+0000","last_clean":"2024-09-15T23:12:15.277175+0000","last_became_active":"2024-09-15T23:12:13.297923+0000","last_became_peered":"2024-09-15T23:12:13.297923+0000","last_unstale":"2024-09-15T23:12:15.277175+0000","last_undegraded":"2024-09-15T23:12:15.277175+0000","last_fullsized":"2024-09-15T23:12:15.277175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:32.902323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282119+0000","last_change":"2024-09-15T23:12:13.293872+0000","last_active":"2024-09-15T23:12:14.282119+0000","last_peered":"2024-09-15T23:12:14.282119+0000","last_clean":"2024-09-15T23:12:14.282119+0000","last_became_active":"2024-09-15T23:12:13.293608+0000","last_became_peered":"2024-09-15T23:12:13.293608+0000","last_unstale":"2024-09-15T23:12:14.282119+0000","last_undegraded":"2024-09-15T23:12:14.282119+0000","last_fullsized":"2024-09-15T23:12:14.282119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:05.614358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277371+0000","last_change":"2024-09-15T23:12:13.297603+0000","last_active":"2024-09-15T23:12:15.277371+0000","last_peered":"2024-09-15T23:12:15.277371+0000","last_clean":"2024-09-15T23:12:15.277371+0000","last_became_active":"2024-09-15T23:12:13.297090+0000","last_became_peered":"2024-09-15T23:12:13.297090+0000","last_unstale":"2024-09-15T23:12:15.277371+0000","last_undegraded":"2024-09-15T23:12:15.277371+0000","last_fullsized":"2024-09-15T23:12:15.277371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:20:45.209892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277872+0000","last_change":"2024-09-15T23:12:13.299195+0000","last_active":"2024-09-15T23:12:15.277872+0000","last_peered":"2024-09-15T23:12:15.277872+0000","last_clean":"2024-09-15T23:12:15.277872+0000","last_became_active":"2024-09-15T23:12:13.298466+0000","last_became_peered":"2024-09-15T23:12:13.298466+0000","last_unstale":"2024-09-15T23:12:15.277872+0000","last_undegraded":"2024-09-15T23:12:15.277872+0000","last_fullsized":"2024-09-15T23:12:15.277872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:28.292228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142578+0000","last_change":"2024-09-15T23:12:13.293831+0000","last_active":"2024-09-15T23:12:15.142578+0000","last_peered":"2024-09-15T23:12:15.142578+0000","last_clean":"2024-09-15T23:12:15.142578+0000","last_became_active":"2024-09-15T23:12:13.293105+0000","last_became_peered":"2024-09-15T23:12:13.293105+0000","last_unstale":"2024-09-15T23:12:15.142578+0000","last_undegraded":"2024-09-15T23:12:15.142578+0000","last_fullsized":"2024-09-15T23:12:15.142578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:10:44.616598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142320+0000","last_change":"2024-09-15T23:12:13.304201+0000","last_active":"2024-09-15T23:12:15.142320+0000","last_peered":"2024-09-15T23:12:15.142320+0000","last_clean":"2024-09-15T23:12:15.142320+0000","last_became_active":"2024-09-15T23:12:13.303927+0000","last_became_peered":"2024-09-15T23:12:13.303927+0000","last_unstale":"2024-09-15T23:12:15.142320+0000","last_undegraded":"2024-09-15T23:12:15.142320+0000","last_fullsized":"2024-09-15T23:12:15.142320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:04.822487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277367+0000","last_change":"2024-09-15T23:12:13.306673+0000","last_active":"2024-09-15T23:12:15.277367+0000","last_peered":"2024-09-15T23:12:15.277367+0000","last_clean":"2024-09-15T23:12:15.277367+0000","last_became_active":"2024-09-15T23:12:13.306402+0000","last_became_peered":"2024-09-15T23:12:13.306402+0000","last_unstale":"2024-09-15T23:12:15.277367+0000","last_undegraded":"2024-09-15T23:12:15.277367+0000","last_fullsized":"2024-09-15T23:12:15.277367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:38.511766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282237+0000","last_change":"2024-09-15T23:12:13.291856+0000","last_active":"2024-09-15T23:12:14.282237+0000","last_peered":"2024-09-15T23:12:14.282237+0000","last_clean":"2024-09-15T23:12:14.282237+0000","last_became_active":"2024-09-15T23:12:13.291050+0000","last_became_peered":"2024-09-15T23:12:13.291050+0000","last_unstale":"2024-09-15T23:12:14.282237+0000","last_undegraded":"2024-09-15T23:12:14.282237+0000","last_fullsized":"2024-09-15T23:12:14.282237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:14:14.059613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282338+0000","last_change":"2024-09-15T23:12:13.303266+0000","last_active":"2024-09-15T23:12:14.282338+0000","last_peered":"2024-09-15T23:12:14.282338+0000","last_clean":"2024-09-15T23:12:14.282338+0000","last_became_active":"2024-09-15T23:12:13.302500+0000","last_became_peered":"2024-09-15T23:12:13.302500+0000","last_unstale":"2024-09-15T23:12:14.282338+0000","last_undegraded":"2024-09-15T23:12:14.282338+0000","last_fullsized":"2024-09-15T23:12:14.282338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:30.079827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277224+0000","last_change":"2024-09-15T23:12:13.300877+0000","last_active":"2024-09-15T23:12:15.277224+0000","last_peered":"2024-09-15T23:12:15.277224+0000","last_clean":"2024-09-15T23:12:15.277224+0000","last_became_active":"2024-09-15T23:12:13.300604+0000","last_became_peered":"2024-09-15T23:12:13.300604+0000","last_unstale":"2024-09-15T23:12:15.277224+0000","last_undegraded":"2024-09-15T23:12:15.277224+0000","last_fullsized":"2024-09-15T23:12:15.277224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:30.079827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.280979+0000","last_change":"2024-09-15T23:12:13.290806+0000","last_active":"2024-09-15T23:12:14.280979+0000","last_peered":"2024-09-15T23:12:14.280979+0000","last_clean":"2024-09-15T23:12:14.280979+0000","last_became_active":"2024-09-15T23:12:13.290534+0000","last_became_peered":"2024-09-15T23:12:13.290534+0000","last_unstale":"2024-09-15T23:12:14.280979+0000","last_undegraded":"2024-09-15T23:12:14.280979+0000","last_fullsized":"2024-09-15T23:12:14.280979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:47.721506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277101+0000","last_change":"2024-09-15T23:12:12.299410+0000","last_active":"2024-09-15T23:12:15.277101+0000","last_peered":"2024-09-15T23:12:15.277101+0000","last_clean":"2024-09-15T23:12:15.277101+0000","last_became_active":"2024-09-15T23:12:12.299149+0000","last_became_peered":"2024-09-15T23:12:12.299149+0000","last_unstale":"2024-09-15T23:12:15.277101+0000","last_undegraded":"2024-09-15T23:12:15.277101+0000","last_fullsized":"2024-09-15T23:12:15.277101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:28.555228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776858+0000","last_change":"2024-09-15T23:12:13.293900+0000","last_active":"2024-09-15T23:12:14.776858+0000","last_peered":"2024-09-15T23:12:14.776858+0000","last_clean":"2024-09-15T23:12:14.776858+0000","last_became_active":"2024-09-15T23:12:13.293602+0000","last_became_peered":"2024-09-15T23:12:13.293602+0000","last_unstale":"2024-09-15T23:12:14.776858+0000","last_undegraded":"2024-09-15T23:12:14.776858+0000","last_fullsized":"2024-09-15T23:12:14.776858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:32.902323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282397+0000","last_change":"2024-09-15T23:12:12.297601+0000","last_active":"2024-09-15T23:12:14.282397+0000","last_peered":"2024-09-15T23:12:14.282397+0000","last_clean":"2024-09-15T23:12:14.282397+0000","last_became_active":"2024-09-15T23:12:12.297353+0000","last_became_peered":"2024-09-15T23:12:12.297353+0000","last_unstale":"2024-09-15T23:12:14.282397+0000","last_undegraded":"2024-09-15T23:12:14.282397+0000","last_fullsized":"2024-09-15T23:12:14.282397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:27.285153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142086+0000","last_change":"2024-09-15T23:12:12.301058+0000","last_active":"2024-09-15T23:12:15.142086+0000","last_peered":"2024-09-15T23:12:15.142086+0000","last_clean":"2024-09-15T23:12:15.142086+0000","last_became_active":"2024-09-15T23:12:12.300744+0000","last_became_peered":"2024-09-15T23:12:12.300744+0000","last_unstale":"2024-09-15T23:12:15.142086+0000","last_undegraded":"2024-09-15T23:12:15.142086+0000","last_fullsized":"2024-09-15T23:12:15.142086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:54.309977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277506+0000","last_change":"2024-09-15T23:12:13.302358+0000","last_active":"2024-09-15T23:12:15.277506+0000","last_peered":"2024-09-15T23:12:15.277506+0000","last_clean":"2024-09-15T23:12:15.277506+0000","last_became_active":"2024-09-15T23:12:13.301840+0000","last_became_peered":"2024-09-15T23:12:13.301840+0000","last_unstale":"2024-09-15T23:12:15.277506+0000","last_undegraded":"2024-09-15T23:12:15.277506+0000","last_fullsized":"2024-09-15T23:12:15.277506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:45:58.241079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282269+0000","last_change":"2024-09-15T23:12:12.294030+0000","last_active":"2024-09-15T23:12:14.282269+0000","last_peered":"2024-09-15T23:12:14.282269+0000","last_clean":"2024-09-15T23:12:14.282269+0000","last_became_active":"2024-09-15T23:12:12.293252+0000","last_became_peered":"2024-09-15T23:12:12.293252+0000","last_unstale":"2024-09-15T23:12:14.282269+0000","last_undegraded":"2024-09-15T23:12:14.282269+0000","last_fullsized":"2024-09-15T23:12:14.282269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:29.072753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776750+0000","last_change":"2024-09-15T23:12:13.302350+0000","last_active":"2024-09-15T23:12:14.776750+0000","last_peered":"2024-09-15T23:12:14.776750+0000","last_clean":"2024-09-15T23:12:14.776750+0000","last_became_active":"2024-09-15T23:12:13.301761+0000","last_became_peered":"2024-09-15T23:12:13.301761+0000","last_unstale":"2024-09-15T23:12:14.776750+0000","last_undegraded":"2024-09-15T23:12:14.776750+0000","last_fullsized":"2024-09-15T23:12:14.776750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:29.428355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.281250+0000","last_change":"2024-09-15T23:12:12.296404+0000","last_active":"2024-09-15T23:12:14.281250+0000","last_peered":"2024-09-15T23:12:14.281250+0000","last_clean":"2024-09-15T23:12:14.281250+0000","last_became_active":"2024-09-15T23:12:12.296128+0000","last_became_peered":"2024-09-15T23:12:12.296128+0000","last_unstale":"2024-09-15T23:12:14.281250+0000","last_undegraded":"2024-09-15T23:12:14.281250+0000","last_fullsized":"2024-09-15T23:12:14.281250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:43.458579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.278041+0000","last_change":"2024-09-15T23:12:13.298997+0000","last_active":"2024-09-15T23:12:15.278041+0000","last_peered":"2024-09-15T23:12:15.278041+0000","last_clean":"2024-09-15T23:12:15.278041+0000","last_became_active":"2024-09-15T23:12:13.298225+0000","last_became_peered":"2024-09-15T23:12:13.298225+0000","last_unstale":"2024-09-15T23:12:15.278041+0000","last_undegraded":"2024-09-15T23:12:15.278041+0000","last_fullsized":"2024-09-15T23:12:15.278041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:27:22.925825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.278252+0000","last_change":"2024-09-15T23:12:12.294378+0000","last_active":"2024-09-15T23:12:15.278252+0000","last_peered":"2024-09-15T23:12:15.278252+0000","last_clean":"2024-09-15T23:12:15.278252+0000","last_became_active":"2024-09-15T23:12:12.294028+0000","last_became_peered":"2024-09-15T23:12:12.294028+0000","last_unstale":"2024-09-15T23:12:15.278252+0000","last_undegraded":"2024-09-15T23:12:15.278252+0000","last_fullsized":"2024-09-15T23:12:15.278252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:29.072753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277559+0000","last_change":"2024-09-15T23:12:13.295768+0000","last_active":"2024-09-15T23:12:15.277559+0000","last_peered":"2024-09-15T23:12:15.277559+0000","last_clean":"2024-09-15T23:12:15.277559+0000","last_became_active":"2024-09-15T23:12:13.295379+0000","last_became_peered":"2024-09-15T23:12:13.295379+0000","last_unstale":"2024-09-15T23:12:15.277559+0000","last_undegraded":"2024-09-15T23:12:15.277559+0000","last_fullsized":"2024-09-15T23:12:15.277559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:47.011102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282465+0000","last_change":"2024-09-15T23:12:12.296690+0000","last_active":"2024-09-15T23:12:14.282465+0000","last_peered":"2024-09-15T23:12:14.282465+0000","last_clean":"2024-09-15T23:12:14.282465+0000","last_became_active":"2024-09-15T23:12:12.295787+0000","last_became_peered":"2024-09-15T23:12:12.295787+0000","last_unstale":"2024-09-15T23:12:14.282465+0000","last_undegraded":"2024-09-15T23:12:14.282465+0000","last_fullsized":"2024-09-15T23:12:14.282465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:11.043406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282394+0000","last_change":"2024-09-15T23:12:13.302380+0000","last_active":"2024-09-15T23:12:14.282394+0000","last_peered":"2024-09-15T23:12:14.282394+0000","last_clean":"2024-09-15T23:12:14.282394+0000","last_became_active":"2024-09-15T23:12:13.302131+0000","last_became_peered":"2024-09-15T23:12:13.302131+0000","last_unstale":"2024-09-15T23:12:14.282394+0000","last_undegraded":"2024-09-15T23:12:14.282394+0000","last_fullsized":"2024-09-15T23:12:14.282394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:29.884341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.278328+0000","last_change":"2024-09-15T23:12:12.298778+0000","last_active":"2024-09-15T23:12:15.278328+0000","last_peered":"2024-09-15T23:12:15.278328+0000","last_clean":"2024-09-15T23:12:15.278328+0000","last_became_active":"2024-09-15T23:12:12.298501+0000","last_became_peered":"2024-09-15T23:12:12.298501+0000","last_unstale":"2024-09-15T23:12:15.278328+0000","last_undegraded":"2024-09-15T23:12:15.278328+0000","last_fullsized":"2024-09-15T23:12:15.278328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:50:38.455575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.278015+0000","last_change":"2024-09-15T23:12:13.303512+0000","last_active":"2024-09-15T23:12:15.278015+0000","last_peered":"2024-09-15T23:12:15.278015+0000","last_clean":"2024-09-15T23:12:15.278015+0000","last_became_active":"2024-09-15T23:12:13.303210+0000","last_became_peered":"2024-09-15T23:12:13.303210+0000","last_unstale":"2024-09-15T23:12:15.278015+0000","last_undegraded":"2024-09-15T23:12:15.278015+0000","last_fullsized":"2024-09-15T23:12:15.278015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:05.614358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282483+0000","last_change":"2024-09-15T23:12:12.300595+0000","last_active":"2024-09-15T23:12:14.282483+0000","last_peered":"2024-09-15T23:12:14.282483+0000","last_clean":"2024-09-15T23:12:14.282483+0000","last_became_active":"2024-09-15T23:12:12.300327+0000","last_became_peered":"2024-09-15T23:12:12.300327+0000","last_unstale":"2024-09-15T23:12:14.282483+0000","last_undegraded":"2024-09-15T23:12:14.282483+0000","last_fullsized":"2024-09-15T23:12:14.282483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:43.458579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142286+0000","last_change":"2024-09-15T23:12:13.295028+0000","last_active":"2024-09-15T23:12:15.142286+0000","last_peered":"2024-09-15T23:12:15.142286+0000","last_clean":"2024-09-15T23:12:15.142286+0000","last_became_active":"2024-09-15T23:12:13.294725+0000","last_became_peered":"2024-09-15T23:12:13.294725+0000","last_unstale":"2024-09-15T23:12:15.142286+0000","last_undegraded":"2024-09-15T23:12:15.142286+0000","last_fullsized":"2024-09-15T23:12:15.142286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:08:51.159156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282517+0000","last_change":"2024-09-15T23:12:12.295626+0000","last_active":"2024-09-15T23:12:14.282517+0000","last_peered":"2024-09-15T23:12:14.282517+0000","last_clean":"2024-09-15T23:12:14.282517+0000","last_became_active":"2024-09-15T23:12:12.295333+0000","last_became_peered":"2024-09-15T23:12:12.295333+0000","last_unstale":"2024-09-15T23:12:14.282517+0000","last_undegraded":"2024-09-15T23:12:14.282517+0000","last_fullsized":"2024-09-15T23:12:14.282517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:27:21.918750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282376+0000","last_change":"2024-09-15T23:12:13.296636+0000","last_active":"2024-09-15T23:12:14.282376+0000","last_peered":"2024-09-15T23:12:14.282376+0000","last_clean":"2024-09-15T23:12:14.282376+0000","last_became_active":"2024-09-15T23:12:13.296172+0000","last_became_peered":"2024-09-15T23:12:13.296172+0000","last_unstale":"2024-09-15T23:12:14.282376+0000","last_undegraded":"2024-09-15T23:12:14.282376+0000","last_fullsized":"2024-09-15T23:12:14.282376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:16.832075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277437+0000","last_change":"2024-09-15T23:12:12.296543+0000","last_active":"2024-09-15T23:12:15.277437+0000","last_peered":"2024-09-15T23:12:15.277437+0000","last_clean":"2024-09-15T23:12:15.277437+0000","last_became_active":"2024-09-15T23:12:12.296293+0000","last_became_peered":"2024-09-15T23:12:12.296293+0000","last_unstale":"2024-09-15T23:12:15.277437+0000","last_undegraded":"2024-09-15T23:12:15.277437+0000","last_fullsized":"2024-09-15T23:12:15.277437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:07:54.128353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.280809+0000","last_change":"2024-09-15T23:12:13.297331+0000","last_active":"2024-09-15T23:12:14.280809+0000","last_peered":"2024-09-15T23:12:14.280809+0000","last_clean":"2024-09-15T23:12:14.280809+0000","last_became_active":"2024-09-15T23:12:13.297036+0000","last_became_peered":"2024-09-15T23:12:13.297036+0000","last_unstale":"2024-09-15T23:12:14.280809+0000","last_undegraded":"2024-09-15T23:12:14.280809+0000","last_fullsized":"2024-09-15T23:12:14.280809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:18.794107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776416+0000","last_change":"2024-09-15T23:12:12.297599+0000","last_active":"2024-09-15T23:12:14.776416+0000","last_peered":"2024-09-15T23:12:14.776416+0000","last_clean":"2024-09-15T23:12:14.776416+0000","last_became_active":"2024-09-15T23:12:12.297309+0000","last_became_peered":"2024-09-15T23:12:12.297309+0000","last_unstale":"2024-09-15T23:12:14.776416+0000","last_undegraded":"2024-09-15T23:12:14.776416+0000","last_fullsized":"2024-09-15T23:12:14.776416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:28.555228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282174+0000","last_change":"2024-09-15T23:12:13.301636+0000","last_active":"2024-09-15T23:12:14.282174+0000","last_peered":"2024-09-15T23:12:14.282174+0000","last_clean":"2024-09-15T23:12:14.282174+0000","last_became_active":"2024-09-15T23:12:13.301390+0000","last_became_peered":"2024-09-15T23:12:13.301390+0000","last_unstale":"2024-09-15T23:12:14.282174+0000","last_undegraded":"2024-09-15T23:12:14.282174+0000","last_fullsized":"2024-09-15T23:12:14.282174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:09:30.105488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.278395+0000","last_change":"2024-09-15T23:12:12.294164+0000","last_active":"2024-09-15T23:12:15.278395+0000","last_peered":"2024-09-15T23:12:15.278395+0000","last_clean":"2024-09-15T23:12:15.278395+0000","last_became_active":"2024-09-15T23:12:12.293619+0000","last_became_peered":"2024-09-15T23:12:12.293619+0000","last_unstale":"2024-09-15T23:12:15.278395+0000","last_undegraded":"2024-09-15T23:12:15.278395+0000","last_fullsized":"2024-09-15T23:12:15.278395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:46.714431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.278200+0000","last_change":"2024-09-15T23:12:13.298781+0000","last_active":"2024-09-15T23:12:15.278200+0000","last_peered":"2024-09-15T23:12:15.278200+0000","last_clean":"2024-09-15T23:12:15.278200+0000","last_became_active":"2024-09-15T23:12:13.297968+0000","last_became_peered":"2024-09-15T23:12:13.297968+0000","last_unstale":"2024-09-15T23:12:15.278200+0000","last_undegraded":"2024-09-15T23:12:15.278200+0000","last_fullsized":"2024-09-15T23:12:15.278200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:26:22.310337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776841+0000","last_change":"2024-09-15T23:12:12.299042+0000","last_active":"2024-09-15T23:12:14.776841+0000","last_peered":"2024-09-15T23:12:14.776841+0000","last_clean":"2024-09-15T23:12:14.776841+0000","last_became_active":"2024-09-15T23:12:12.298781+0000","last_became_peered":"2024-09-15T23:12:12.298781+0000","last_unstale":"2024-09-15T23:12:14.776841+0000","last_undegraded":"2024-09-15T23:12:14.776841+0000","last_fullsized":"2024-09-15T23:12:14.776841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:12.407756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.278420+0000","last_change":"2024-09-15T23:12:13.296707+0000","last_active":"2024-09-15T23:12:15.278420+0000","last_peered":"2024-09-15T23:12:15.278420+0000","last_clean":"2024-09-15T23:12:15.278420+0000","last_became_active":"2024-09-15T23:12:13.296450+0000","last_became_peered":"2024-09-15T23:12:13.296450+0000","last_unstale":"2024-09-15T23:12:15.278420+0000","last_undegraded":"2024-09-15T23:12:15.278420+0000","last_fullsized":"2024-09-15T23:12:15.278420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:51:37.808404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277145+0000","last_change":"2024-09-15T23:12:12.296505+0000","last_active":"2024-09-15T23:12:15.277145+0000","last_peered":"2024-09-15T23:12:15.277145+0000","last_clean":"2024-09-15T23:12:15.277145+0000","last_became_active":"2024-09-15T23:12:12.296249+0000","last_became_peered":"2024-09-15T23:12:12.296249+0000","last_unstale":"2024-09-15T23:12:15.277145+0000","last_undegraded":"2024-09-15T23:12:15.277145+0000","last_fullsized":"2024-09-15T23:12:15.277145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:22.552069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277847+0000","last_change":"2024-09-15T23:12:13.306601+0000","last_active":"2024-09-15T23:12:15.277847+0000","last_peered":"2024-09-15T23:12:15.277847+0000","last_clean":"2024-09-15T23:12:15.277847+0000","last_became_active":"2024-09-15T23:12:13.306342+0000","last_became_peered":"2024-09-15T23:12:13.306342+0000","last_unstale":"2024-09-15T23:12:15.277847+0000","last_undegraded":"2024-09-15T23:12:15.277847+0000","last_fullsized":"2024-09-15T23:12:15.277847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:29.584475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142541+0000","last_change":"2024-09-15T23:12:12.305855+0000","last_active":"2024-09-15T23:12:15.142541+0000","last_peered":"2024-09-15T23:12:15.142541+0000","last_clean":"2024-09-15T23:12:15.142541+0000","last_became_active":"2024-09-15T23:12:12.305533+0000","last_became_peered":"2024-09-15T23:12:12.305533+0000","last_unstale":"2024-09-15T23:12:15.142541+0000","last_undegraded":"2024-09-15T23:12:15.142541+0000","last_fullsized":"2024-09-15T23:12:15.142541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:11.043406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282621+0000","last_change":"2024-09-15T23:12:13.292019+0000","last_active":"2024-09-15T23:12:14.282621+0000","last_peered":"2024-09-15T23:12:14.282621+0000","last_clean":"2024-09-15T23:12:14.282621+0000","last_became_active":"2024-09-15T23:12:13.290585+0000","last_became_peered":"2024-09-15T23:12:13.290585+0000","last_unstale":"2024-09-15T23:12:14.282621+0000","last_undegraded":"2024-09-15T23:12:14.282621+0000","last_fullsized":"2024-09-15T23:12:14.282621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:49:31.867792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.280816+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:12:14.280816+0000","last_peered":"2024-09-15T23:12:14.280816+0000","last_clean":"2024-09-15T23:12:14.280816+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:12:14.280816+0000","last_undegraded":"2024-09-15T23:12:14.280816+0000","last_fullsized":"2024-09-15T23:12:14.280816+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282421+0000","last_change":"2024-09-15T23:12:12.295819+0000","last_active":"2024-09-15T23:12:14.282421+0000","last_peered":"2024-09-15T23:12:14.282421+0000","last_clean":"2024-09-15T23:12:14.282421+0000","last_became_active":"2024-09-15T23:12:12.295320+0000","last_became_peered":"2024-09-15T23:12:12.295320+0000","last_unstale":"2024-09-15T23:12:14.282421+0000","last_undegraded":"2024-09-15T23:12:14.282421+0000","last_fullsized":"2024-09-15T23:12:14.282421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:13.348463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776701+0000","last_change":"2024-09-15T23:12:13.292512+0000","last_active":"2024-09-15T23:12:14.776701+0000","last_peered":"2024-09-15T23:12:14.776701+0000","last_clean":"2024-09-15T23:12:14.776701+0000","last_became_active":"2024-09-15T23:12:13.292230+0000","last_became_peered":"2024-09-15T23:12:13.292230+0000","last_unstale":"2024-09-15T23:12:14.776701+0000","last_undegraded":"2024-09-15T23:12:14.776701+0000","last_fullsized":"2024-09-15T23:12:14.776701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:51.115293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282228+0000","last_change":"2024-09-15T23:12:12.293545+0000","last_active":"2024-09-15T23:12:14.282228+0000","last_peered":"2024-09-15T23:12:14.282228+0000","last_clean":"2024-09-15T23:12:14.282228+0000","last_became_active":"2024-09-15T23:12:12.292903+0000","last_became_peered":"2024-09-15T23:12:12.292903+0000","last_unstale":"2024-09-15T23:12:14.282228+0000","last_undegraded":"2024-09-15T23:12:14.282228+0000","last_fullsized":"2024-09-15T23:12:14.282228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:46.714431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142240+0000","last_change":"2024-09-15T23:12:13.298677+0000","last_active":"2024-09-15T23:12:15.142240+0000","last_peered":"2024-09-15T23:12:15.142240+0000","last_clean":"2024-09-15T23:12:15.142240+0000","last_became_active":"2024-09-15T23:12:13.298386+0000","last_became_peered":"2024-09-15T23:12:13.298386+0000","last_unstale":"2024-09-15T23:12:15.142240+0000","last_undegraded":"2024-09-15T23:12:15.142240+0000","last_fullsized":"2024-09-15T23:12:15.142240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:10:04.877140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282158+0000","last_change":"2024-09-15T23:12:12.296394+0000","last_active":"2024-09-15T23:12:14.282158+0000","last_peered":"2024-09-15T23:12:14.282158+0000","last_clean":"2024-09-15T23:12:14.282158+0000","last_became_active":"2024-09-15T23:12:12.296110+0000","last_became_peered":"2024-09-15T23:12:12.296110+0000","last_unstale":"2024-09-15T23:12:14.282158+0000","last_undegraded":"2024-09-15T23:12:14.282158+0000","last_fullsized":"2024-09-15T23:12:14.282158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:54.309977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277322+0000","last_change":"2024-09-15T23:12:13.294854+0000","last_active":"2024-09-15T23:12:15.277322+0000","last_peered":"2024-09-15T23:12:15.277322+0000","last_clean":"2024-09-15T23:12:15.277322+0000","last_became_active":"2024-09-15T23:12:13.294539+0000","last_became_peered":"2024-09-15T23:12:13.294539+0000","last_unstale":"2024-09-15T23:12:15.277322+0000","last_undegraded":"2024-09-15T23:12:15.277322+0000","last_fullsized":"2024-09-15T23:12:15.277322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:43:07.769498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282544+0000","last_change":"2024-09-15T23:12:12.300290+0000","last_active":"2024-09-15T23:12:14.282544+0000","last_peered":"2024-09-15T23:12:14.282544+0000","last_clean":"2024-09-15T23:12:14.282544+0000","last_became_active":"2024-09-15T23:12:12.300024+0000","last_became_peered":"2024-09-15T23:12:12.300024+0000","last_unstale":"2024-09-15T23:12:14.282544+0000","last_undegraded":"2024-09-15T23:12:14.282544+0000","last_fullsized":"2024-09-15T23:12:14.282544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:10:03.870065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277903+0000","last_change":"2024-09-15T23:12:13.300590+0000","last_active":"2024-09-15T23:12:15.277903+0000","last_peered":"2024-09-15T23:12:15.277903+0000","last_clean":"2024-09-15T23:12:15.277903+0000","last_became_active":"2024-09-15T23:12:13.300376+0000","last_became_peered":"2024-09-15T23:12:13.300376+0000","last_unstale":"2024-09-15T23:12:15.277903+0000","last_undegraded":"2024-09-15T23:12:15.277903+0000","last_fullsized":"2024-09-15T23:12:15.277903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:02.914486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277032+0000","last_change":"2024-09-15T23:12:12.297859+0000","last_active":"2024-09-15T23:12:15.277032+0000","last_peered":"2024-09-15T23:12:15.277032+0000","last_clean":"2024-09-15T23:12:15.277032+0000","last_became_active":"2024-09-15T23:12:12.297520+0000","last_became_peered":"2024-09-15T23:12:12.297520+0000","last_unstale":"2024-09-15T23:12:15.277032+0000","last_undegraded":"2024-09-15T23:12:15.277032+0000","last_fullsized":"2024-09-15T23:12:15.277032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:12.407756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.278068+0000","last_change":"2024-09-15T23:12:13.300154+0000","last_active":"2024-09-15T23:12:15.278068+0000","last_peered":"2024-09-15T23:12:15.278068+0000","last_clean":"2024-09-15T23:12:15.278068+0000","last_became_active":"2024-09-15T23:12:13.299919+0000","last_became_peered":"2024-09-15T23:12:13.299919+0000","last_unstale":"2024-09-15T23:12:15.278068+0000","last_undegraded":"2024-09-15T23:12:15.278068+0000","last_fullsized":"2024-09-15T23:12:15.278068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:10:04.877140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282692+0000","last_change":"2024-09-15T23:12:12.296791+0000","last_active":"2024-09-15T23:12:14.282692+0000","last_peered":"2024-09-15T23:12:14.282692+0000","last_clean":"2024-09-15T23:12:14.282692+0000","last_became_active":"2024-09-15T23:12:12.296507+0000","last_became_peered":"2024-09-15T23:12:12.296507+0000","last_unstale":"2024-09-15T23:12:14.282692+0000","last_undegraded":"2024-09-15T23:12:14.282692+0000","last_fullsized":"2024-09-15T23:12:14.282692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:08:50.152082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142523+0000","last_change":"2024-09-15T23:12:13.296540+0000","last_active":"2024-09-15T23:12:15.142523+0000","last_peered":"2024-09-15T23:12:15.142523+0000","last_clean":"2024-09-15T23:12:15.142523+0000","last_became_active":"2024-09-15T23:12:13.295765+0000","last_became_peered":"2024-09-15T23:12:13.295765+0000","last_unstale":"2024-09-15T23:12:15.142523+0000","last_undegraded":"2024-09-15T23:12:15.142523+0000","last_fullsized":"2024-09-15T23:12:15.142523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:03.932670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776948+0000","last_change":"2024-09-15T23:12:12.300784+0000","last_active":"2024-09-15T23:12:14.776948+0000","last_peered":"2024-09-15T23:12:14.776948+0000","last_clean":"2024-09-15T23:12:14.776948+0000","last_became_active":"2024-09-15T23:12:12.300267+0000","last_became_peered":"2024-09-15T23:12:12.300267+0000","last_unstale":"2024-09-15T23:12:14.776948+0000","last_undegraded":"2024-09-15T23:12:14.776948+0000","last_fullsized":"2024-09-15T23:12:14.776948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:01:57.256014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776957+0000","last_change":"2024-09-15T23:12:13.304126+0000","last_active":"2024-09-15T23:12:14.776957+0000","last_peered":"2024-09-15T23:12:14.776957+0000","last_clean":"2024-09-15T23:12:14.776957+0000","last_became_active":"2024-09-15T23:12:13.303461+0000","last_became_peered":"2024-09-15T23:12:13.303461+0000","last_unstale":"2024-09-15T23:12:14.776957+0000","last_undegraded":"2024-09-15T23:12:14.776957+0000","last_fullsized":"2024-09-15T23:12:14.776957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:43:07.769498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282577+0000","last_change":"2024-09-15T23:12:12.297628+0000","last_active":"2024-09-15T23:12:14.282577+0000","last_peered":"2024-09-15T23:12:14.282577+0000","last_clean":"2024-09-15T23:12:14.282577+0000","last_became_active":"2024-09-15T23:12:12.297392+0000","last_became_peered":"2024-09-15T23:12:12.297392+0000","last_unstale":"2024-09-15T23:12:14.282577+0000","last_undegraded":"2024-09-15T23:12:14.282577+0000","last_fullsized":"2024-09-15T23:12:14.282577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:26:21.303262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776864+0000","last_change":"2024-09-15T23:12:13.305087+0000","last_active":"2024-09-15T23:12:14.776864+0000","last_peered":"2024-09-15T23:12:14.776864+0000","last_clean":"2024-09-15T23:12:14.776864+0000","last_became_active":"2024-09-15T23:12:13.304851+0000","last_became_peered":"2024-09-15T23:12:13.304851+0000","last_unstale":"2024-09-15T23:12:14.776864+0000","last_undegraded":"2024-09-15T23:12:14.776864+0000","last_fullsized":"2024-09-15T23:12:14.776864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:53.919348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277272+0000","last_change":"2024-09-15T23:12:12.292922+0000","last_active":"2024-09-15T23:12:15.277272+0000","last_peered":"2024-09-15T23:12:15.277272+0000","last_clean":"2024-09-15T23:12:15.277272+0000","last_became_active":"2024-09-15T23:12:12.292606+0000","last_became_peered":"2024-09-15T23:12:12.292606+0000","last_unstale":"2024-09-15T23:12:15.277272+0000","last_undegraded":"2024-09-15T23:12:15.277272+0000","last_fullsized":"2024-09-15T23:12:15.277272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:25.929262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282187+0000","last_change":"2024-09-15T23:12:13.300968+0000","last_active":"2024-09-15T23:12:14.282187+0000","last_peered":"2024-09-15T23:12:14.282187+0000","last_clean":"2024-09-15T23:12:14.282187+0000","last_became_active":"2024-09-15T23:12:13.300679+0000","last_became_peered":"2024-09-15T23:12:13.300679+0000","last_unstale":"2024-09-15T23:12:14.282187+0000","last_undegraded":"2024-09-15T23:12:14.282187+0000","last_fullsized":"2024-09-15T23:12:14.282187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:51:37.808404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776598+0000","last_change":"2024-09-15T23:12:12.300647+0000","last_active":"2024-09-15T23:12:14.776598+0000","last_peered":"2024-09-15T23:12:14.776598+0000","last_clean":"2024-09-15T23:12:14.776598+0000","last_became_active":"2024-09-15T23:12:12.300181+0000","last_became_peered":"2024-09-15T23:12:12.300181+0000","last_unstale":"2024-09-15T23:12:14.776598+0000","last_undegraded":"2024-09-15T23:12:14.776598+0000","last_fullsized":"2024-09-15T23:12:14.776598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:22.552069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776822+0000","last_change":"2024-09-15T23:12:13.300864+0000","last_active":"2024-09-15T23:12:14.776822+0000","last_peered":"2024-09-15T23:12:14.776822+0000","last_clean":"2024-09-15T23:12:14.776822+0000","last_became_active":"2024-09-15T23:12:13.300258+0000","last_became_peered":"2024-09-15T23:12:13.300258+0000","last_unstale":"2024-09-15T23:12:14.776822+0000","last_undegraded":"2024-09-15T23:12:14.776822+0000","last_fullsized":"2024-09-15T23:12:14.776822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:40.921752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142436+0000","last_change":"2024-09-15T23:12:12.304706+0000","last_active":"2024-09-15T23:12:15.142436+0000","last_peered":"2024-09-15T23:12:15.142436+0000","last_clean":"2024-09-15T23:12:15.142436+0000","last_became_active":"2024-09-15T23:12:12.304384+0000","last_became_peered":"2024-09-15T23:12:12.304384+0000","last_unstale":"2024-09-15T23:12:15.142436+0000","last_undegraded":"2024-09-15T23:12:15.142436+0000","last_fullsized":"2024-09-15T23:12:15.142436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:43.458579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282456+0000","last_change":"2024-09-15T23:12:13.305512+0000","last_active":"2024-09-15T23:12:14.282456+0000","last_peered":"2024-09-15T23:12:14.282456+0000","last_clean":"2024-09-15T23:12:14.282456+0000","last_became_active":"2024-09-15T23:12:13.305192+0000","last_became_peered":"2024-09-15T23:12:13.305192+0000","last_unstale":"2024-09-15T23:12:14.282456+0000","last_undegraded":"2024-09-15T23:12:14.282456+0000","last_fullsized":"2024-09-15T23:12:14.282456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:47.721506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282310+0000","last_change":"2024-09-15T23:12:12.295599+0000","last_active":"2024-09-15T23:12:14.282310+0000","last_peered":"2024-09-15T23:12:14.282310+0000","last_clean":"2024-09-15T23:12:14.282310+0000","last_became_active":"2024-09-15T23:12:12.295036+0000","last_became_peered":"2024-09-15T23:12:12.295036+0000","last_unstale":"2024-09-15T23:12:14.282310+0000","last_undegraded":"2024-09-15T23:12:14.282310+0000","last_fullsized":"2024-09-15T23:12:14.282310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:03.815413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282296+0000","last_change":"2024-09-15T23:12:13.292087+0000","last_active":"2024-09-15T23:12:14.282296+0000","last_peered":"2024-09-15T23:12:14.282296+0000","last_clean":"2024-09-15T23:12:14.282296+0000","last_became_active":"2024-09-15T23:12:13.291588+0000","last_became_peered":"2024-09-15T23:12:13.291588+0000","last_unstale":"2024-09-15T23:12:14.282296+0000","last_undegraded":"2024-09-15T23:12:14.282296+0000","last_fullsized":"2024-09-15T23:12:14.282296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:19:59.394904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282457+0000","last_change":"2024-09-15T23:12:13.295583+0000","last_active":"2024-09-15T23:12:14.282457+0000","last_peered":"2024-09-15T23:12:14.282457+0000","last_clean":"2024-09-15T23:12:14.282457+0000","last_became_active":"2024-09-15T23:12:13.295285+0000","last_became_peered":"2024-09-15T23:12:13.295285+0000","last_unstale":"2024-09-15T23:12:14.282457+0000","last_undegraded":"2024-09-15T23:12:14.282457+0000","last_fullsized":"2024-09-15T23:12:14.282457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:12.748141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277815+0000","last_change":"2024-09-15T23:12:12.293704+0000","last_active":"2024-09-15T23:12:15.277815+0000","last_peered":"2024-09-15T23:12:15.277815+0000","last_clean":"2024-09-15T23:12:15.277815+0000","last_became_active":"2024-09-15T23:12:12.292898+0000","last_became_peered":"2024-09-15T23:12:12.292898+0000","last_unstale":"2024-09-15T23:12:15.277815+0000","last_undegraded":"2024-09-15T23:12:15.277815+0000","last_fullsized":"2024-09-15T23:12:15.277815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:27.285153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.281075+0000","last_change":"2024-09-15T23:12:13.295743+0000","last_active":"2024-09-15T23:12:14.281075+0000","last_peered":"2024-09-15T23:12:14.281075+0000","last_clean":"2024-09-15T23:12:14.281075+0000","last_became_active":"2024-09-15T23:12:13.295104+0000","last_became_peered":"2024-09-15T23:12:13.295104+0000","last_unstale":"2024-09-15T23:12:14.281075+0000","last_undegraded":"2024-09-15T23:12:14.281075+0000","last_fullsized":"2024-09-15T23:12:14.281075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:28.292228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.278033+0000","last_change":"2024-09-15T23:12:12.293296+0000","last_active":"2024-09-15T23:12:15.278033+0000","last_peered":"2024-09-15T23:12:15.278033+0000","last_clean":"2024-09-15T23:12:15.278033+0000","last_became_active":"2024-09-15T23:12:12.292920+0000","last_became_peered":"2024-09-15T23:12:12.292920+0000","last_unstale":"2024-09-15T23:12:15.278033+0000","last_undegraded":"2024-09-15T23:12:15.278033+0000","last_fullsized":"2024-09-15T23:12:15.278033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:17.787033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277421+0000","last_change":"2024-09-15T23:12:13.297368+0000","last_active":"2024-09-15T23:12:15.277421+0000","last_peered":"2024-09-15T23:12:15.277421+0000","last_clean":"2024-09-15T23:12:15.277421+0000","last_became_active":"2024-09-15T23:12:13.296735+0000","last_became_peered":"2024-09-15T23:12:13.296735+0000","last_unstale":"2024-09-15T23:12:15.277421+0000","last_undegraded":"2024-09-15T23:12:15.277421+0000","last_fullsized":"2024-09-15T23:12:15.277421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:11.250902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277466+0000","last_change":"2024-09-15T23:12:12.295645+0000","last_active":"2024-09-15T23:12:15.277466+0000","last_peered":"2024-09-15T23:12:15.277466+0000","last_clean":"2024-09-15T23:12:15.277466+0000","last_became_active":"2024-09-15T23:12:12.295359+0000","last_became_peered":"2024-09-15T23:12:12.295359+0000","last_unstale":"2024-09-15T23:12:15.277466+0000","last_undegraded":"2024-09-15T23:12:15.277466+0000","last_fullsized":"2024-09-15T23:12:15.277466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:01:57.256014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277490+0000","last_change":"2024-09-15T23:12:13.302910+0000","last_active":"2024-09-15T23:12:15.277490+0000","last_peered":"2024-09-15T23:12:15.277490+0000","last_clean":"2024-09-15T23:12:15.277490+0000","last_became_active":"2024-09-15T23:12:13.302457+0000","last_became_peered":"2024-09-15T23:12:13.302457+0000","last_unstale":"2024-09-15T23:12:15.277490+0000","last_undegraded":"2024-09-15T23:12:15.277490+0000","last_fullsized":"2024-09-15T23:12:15.277490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:17:08.108114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776995+0000","last_change":"2024-09-15T23:12:12.295905+0000","last_active":"2024-09-15T23:12:14.776995+0000","last_peered":"2024-09-15T23:12:14.776995+0000","last_clean":"2024-09-15T23:12:14.776995+0000","last_became_active":"2024-09-15T23:12:12.295619+0000","last_became_peered":"2024-09-15T23:12:12.295619+0000","last_unstale":"2024-09-15T23:12:14.776995+0000","last_undegraded":"2024-09-15T23:12:14.776995+0000","last_fullsized":"2024-09-15T23:12:14.776995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:11.550515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476745,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":77046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476742,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":229376,"data_stored":78076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476744,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":666902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476744,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":76464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":819200,"data_stored":666924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":78748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:12:24.795 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:12:24.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.928+0000 7f6944711640 1 Processor -- start 2024-09-15T23:12:24.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.928+0000 7f6944711640 1 -- start start 2024-09-15T23:12:24.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.929+0000 7f6944711640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f693c06c320 0x7f693c15bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.929+0000 7f6944711640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f693c13eb20 0x7f693c15c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.929+0000 7f6944711640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f693c071180 con 0x7f693c0b2d40 2024-09-15T23:12:24.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.929+0000 7f6944711640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f693c071ab0 con 0x7f693c06c320 2024-09-15T23:12:24.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.929+0000 7f6944711640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f693c071460 con 0x7f693c13eb20 2024-09-15T23:12:24.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.929+0000 7f6942cae640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f693c13eb20 0x7f693c15c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.929+0000 7f6941cac640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f693c06c320 0x7f693c15bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.929+0000 7f6942cae640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f693c13eb20 0x7f693c15c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:41612/0 (socket says 172.21.15.123:41612) 2024-09-15T23:12:24.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.929+0000 7f6942cae640 1 -- 172.21.15.123:0/167724750 learned_addr learned my addr 172.21.15.123:0/167724750 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:24.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.929+0000 7f69424ad640 1 --1- 172.21.15.123:0/167724750 >> v1:172.21.15.188:6789/0 conn(0x7f693c0b2d40 0x7f693c06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:48962/0 (socket says 172.21.15.123:48962) 2024-09-15T23:12:24.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.930+0000 7f6941cac640 1 -- 172.21.15.123:0/167724750 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f693c13eb20 msgr2=0x7f693c15c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:24.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.930+0000 7f6941cac640 1 --2- 172.21.15.123:0/167724750 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f693c13eb20 0x7f693c15c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.930+0000 7f6941cac640 1 -- 172.21.15.123:0/167724750 >> v1:172.21.15.188:6789/0 conn(0x7f693c0b2d40 legacy=0x7f693c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.930+0000 7f69414ab640 1 -- 172.21.15.123:0/167724750 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 169176322 0 0) 0x7f693c071180 con 0x7f693c0b2d40 2024-09-15T23:12:24.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.930+0000 7f6941cac640 1 -- 172.21.15.123:0/167724750 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f693c071740 con 0x7f693c06c320 2024-09-15T23:12:24.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.930+0000 7f6942cae640 1 --2- 172.21.15.123:0/167724750 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f693c13eb20 0x7f693c15c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:12:24.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.930+0000 7f6941cac640 1 --2- 172.21.15.123:0/167724750 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f693c06c320 0x7f693c15bcf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f692c0097a0 tx=0x7f692c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51cf7054cc73d57 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:24.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.931+0000 7f69414ab640 1 -- 172.21.15.123:0/167724750 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692c037070 con 0x7f693c06c320 2024-09-15T23:12:24.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.931+0000 7f69414ab640 1 -- 172.21.15.123:0/167724750 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f692c032440 con 0x7f693c06c320 2024-09-15T23:12:24.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.931+0000 7f69414ab640 1 -- 172.21.15.123:0/167724750 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692c032810 con 0x7f693c06c320 2024-09-15T23:12:24.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.931+0000 7f6944711640 1 -- 172.21.15.123:0/167724750 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f693c06c320 msgr2=0x7f693c15bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.931+0000 7f6944711640 1 --2- 172.21.15.123:0/167724750 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f693c06c320 0x7f693c15bcf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f692c0097a0 tx=0x7f692c02a180 comp rx=0 tx=0).stop 2024-09-15T23:12:24.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.931+0000 7f6944711640 1 -- 172.21.15.123:0/167724750 shutdown_connections 2024-09-15T23:12:24.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.931+0000 7f6944711640 1 --2- 172.21.15.123:0/167724750 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f693c06c320 0x7f693c15bcf0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.931+0000 7f6944711640 1 --2- 172.21.15.123:0/167724750 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f693c13eb20 0x7f693c15c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.931+0000 7f6944711640 1 -- 172.21.15.123:0/167724750 >> 172.21.15.123:0/167724750 conn(0x7f693c0ccec0 msgr2=0x7f693c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:24.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.931+0000 7f6944711640 1 -- 172.21.15.123:0/167724750 shutdown_connections 2024-09-15T23:12:24.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.931+0000 7f6944711640 1 -- 172.21.15.123:0/167724750 wait complete. 2024-09-15T23:12:24.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.932+0000 7f6944711640 1 Processor -- start 2024-09-15T23:12:24.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.933+0000 7f6944711640 1 -- start start 2024-09-15T23:12:24.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.933+0000 7f6944711640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f693c06c320 0x7f693c0b5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.933+0000 7f6944711640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f693c0b2d40 0x7f693c13d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.933+0000 7f6944711640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f693c13eb20 0x7f693c15ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.933+0000 7f6944711640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f693c0720c0 con 0x7f693c0b2d40 2024-09-15T23:12:24.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.933+0000 7f6944711640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f693c071f40 con 0x7f693c13eb20 2024-09-15T23:12:24.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.933+0000 7f6944711640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f693c072240 con 0x7f693c06c320 2024-09-15T23:12:24.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.933+0000 7f6941cac640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f693c0b2d40 0x7f693c13d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.933+0000 7f6941cac640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f693c0b2d40 0x7f693c13d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36570/0 (socket says 172.21.15.123:36570) 2024-09-15T23:12:24.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.933+0000 7f6941cac640 1 -- 172.21.15.123:0/398050892 learned_addr learned my addr 172.21.15.123:0/398050892 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:24.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.934+0000 7f6942cae640 1 --2- 172.21.15.123:0/398050892 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f693c13eb20 0x7f693c15ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.934+0000 7f69424ad640 1 --2- 172.21.15.123:0/398050892 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f693c06c320 0x7f693c0b5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.934+0000 7f6941cac640 1 -- 172.21.15.123:0/398050892 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f693c06c320 msgr2=0x7f693c0b5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.934+0000 7f6941cac640 1 --2- 172.21.15.123:0/398050892 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f693c06c320 0x7f693c0b5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.934+0000 7f6941cac640 1 -- 172.21.15.123:0/398050892 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f693c13eb20 msgr2=0x7f693c15ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:24.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.934+0000 7f6941cac640 1 --2- 172.21.15.123:0/398050892 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f693c13eb20 0x7f693c15ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:24.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.934+0000 7f6941cac640 1 -- 172.21.15.123:0/398050892 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f693c15e030 con 0x7f693c0b2d40 2024-09-15T23:12:24.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.934+0000 7f6942cae640 1 --2- 172.21.15.123:0/398050892 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f693c13eb20 0x7f693c15ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:24.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.934+0000 7f69424ad640 1 --2- 172.21.15.123:0/398050892 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f693c06c320 0x7f693c0b5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:24.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.934+0000 7f6941cac640 1 --2- 172.21.15.123:0/398050892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f693c0b2d40 0x7f693c13d870 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f692c0097a0 tx=0x7f692c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:24.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.934+0000 7f6932ffd640 1 -- 172.21.15.123:0/398050892 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692c037050 con 0x7f693c0b2d40 2024-09-15T23:12:24.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.934+0000 7f6932ffd640 1 -- 172.21.15.123:0/398050892 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f692c038040 con 0x7f693c0b2d40 2024-09-15T23:12:24.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.934+0000 7f6944711640 1 -- 172.21.15.123:0/398050892 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f693c0b4120 con 0x7f693c0b2d40 2024-09-15T23:12:24.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.934+0000 7f6932ffd640 1 -- 172.21.15.123:0/398050892 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f692c004490 con 0x7f693c0b2d40 2024-09-15T23:12:24.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.934+0000 7f6944711640 1 -- 172.21.15.123:0/398050892 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f693c0b6440 con 0x7f693c0b2d40 2024-09-15T23:12:24.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.935+0000 7f6944711640 1 -- 172.21.15.123:0/398050892 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f693c06bc10 con 0x7f693c0b2d40 2024-09-15T23:12:24.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.935+0000 7f6932ffd640 1 -- 172.21.15.123:0/398050892 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f692c03c6d0 con 0x7f693c0b2d40 2024-09-15T23:12:24.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.936+0000 7f6932ffd640 1 --2- 172.21.15.123:0/398050892 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f692006c2b0 0x7f692006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:24.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.936+0000 7f6932ffd640 1 -- 172.21.15.123:0/398050892 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f692c0abdf0 con 0x7f693c0b2d40 2024-09-15T23:12:24.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.936+0000 7f69424ad640 1 --2- 172.21.15.123:0/398050892 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f692006c2b0 0x7f692006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:24.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.936+0000 7f69424ad640 1 --2- 172.21.15.123:0/398050892 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f692006c2b0 0x7f692006e770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f69380012e0 tx=0x7f6938009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:24.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:24.940+0000 7f6932ffd640 1 -- 172.21.15.123:0/398050892 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f692c07a5f0 con 0x7f693c0b2d40 2024-09-15T23:12:25.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.102+0000 7f6944711640 1 -- 172.21.15.123:0/398050892 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f693c06c9c0 con 0x7f692006c2b0 2024-09-15T23:12:25.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.108+0000 7f6932ffd640 1 -- 172.21.15.123:0/398050892 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251833 (secure 0 0 0) 0x7f693c06c9c0 con 0x7f692006c2b0 2024-09-15T23:12:25.112 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:25.113 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:12:25.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.111+0000 7f6944711640 1 -- 172.21.15.123:0/398050892 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f692006c2b0 msgr2=0x7f692006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:25.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.111+0000 7f6944711640 1 --2- 172.21.15.123:0/398050892 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f692006c2b0 0x7f692006e770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f69380012e0 tx=0x7f6938009040 comp rx=0 tx=0).stop 2024-09-15T23:12:25.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.111+0000 7f6944711640 1 -- 172.21.15.123:0/398050892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f693c0b2d40 msgr2=0x7f693c13d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:25.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.111+0000 7f6944711640 1 --2- 172.21.15.123:0/398050892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f693c0b2d40 0x7f693c13d870 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f692c0097a0 tx=0x7f692c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.111+0000 7f6944711640 1 -- 172.21.15.123:0/398050892 shutdown_connections 2024-09-15T23:12:25.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.111+0000 7f6944711640 1 --2- 172.21.15.123:0/398050892 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f693c13eb20 0x7f693c15ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.111+0000 7f6944711640 1 --2- 172.21.15.123:0/398050892 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f692006c2b0 0x7f692006e770 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.111+0000 7f6944711640 1 --2- 172.21.15.123:0/398050892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f693c0b2d40 0x7f693c13d870 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.111+0000 7f6944711640 1 --2- 172.21.15.123:0/398050892 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f693c06c320 0x7f693c0b5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.111+0000 7f6944711640 1 -- 172.21.15.123:0/398050892 >> 172.21.15.123:0/398050892 conn(0x7f693c0ccec0 msgr2=0x7f693c0cd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:25.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.111+0000 7f6944711640 1 -- 172.21.15.123:0/398050892 shutdown_connections 2024-09-15T23:12:25.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.111+0000 7f6944711640 1 -- 172.21.15.123:0/398050892 wait complete. 2024-09-15T23:12:25.123 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-09-15T23:12:23.504663+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219176,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755544,"statfs":{"total":773094113280,"available":772869677056,"internally_reserved":0,"allocated":2990080,"data_stored":1797268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002619"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.278230+0000","last_change":"2024-09-15T23:12:13.304372+0000","last_active":"2024-09-15T23:12:15.278230+0000","last_peered":"2024-09-15T23:12:15.278230+0000","last_clean":"2024-09-15T23:12:15.278230+0000","last_became_active":"2024-09-15T23:12:13.304067+0000","last_became_peered":"2024-09-15T23:12:13.304067+0000","last_unstale":"2024-09-15T23:12:15.278230+0000","last_undegraded":"2024-09-15T23:12:15.278230+0000","last_fullsized":"2024-09-15T23:12:15.278230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:16.349500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277385+0000","last_change":"2024-09-15T23:12:13.302592+0000","last_active":"2024-09-15T23:12:15.277385+0000","last_peered":"2024-09-15T23:12:15.277385+0000","last_clean":"2024-09-15T23:12:15.277385+0000","last_became_active":"2024-09-15T23:12:13.301990+0000","last_became_peered":"2024-09-15T23:12:13.301990+0000","last_unstale":"2024-09-15T23:12:15.277385+0000","last_undegraded":"2024-09-15T23:12:15.277385+0000","last_fullsized":"2024-09-15T23:12:15.277385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:10:09.891348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277323+0000","last_change":"2024-09-15T23:12:13.301292+0000","last_active":"2024-09-15T23:12:15.277323+0000","last_peered":"2024-09-15T23:12:15.277323+0000","last_clean":"2024-09-15T23:12:15.277323+0000","last_became_active":"2024-09-15T23:12:13.301019+0000","last_became_peered":"2024-09-15T23:12:13.301019+0000","last_unstale":"2024-09-15T23:12:15.277323+0000","last_undegraded":"2024-09-15T23:12:15.277323+0000","last_fullsized":"2024-09-15T23:12:15.277323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:45:01.842037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.278258+0000","last_change":"2024-09-15T23:12:13.302730+0000","last_active":"2024-09-15T23:12:15.278258+0000","last_peered":"2024-09-15T23:12:15.278258+0000","last_clean":"2024-09-15T23:12:15.278258+0000","last_became_active":"2024-09-15T23:12:13.302301+0000","last_became_peered":"2024-09-15T23:12:13.302301+0000","last_unstale":"2024-09-15T23:12:15.278258+0000","last_undegraded":"2024-09-15T23:12:15.278258+0000","last_fullsized":"2024-09-15T23:12:15.278258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:08:51.159156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277829+0000","last_change":"2024-09-15T23:12:13.298592+0000","last_active":"2024-09-15T23:12:15.277829+0000","last_peered":"2024-09-15T23:12:15.277829+0000","last_clean":"2024-09-15T23:12:15.277829+0000","last_became_active":"2024-09-15T23:12:13.298358+0000","last_became_peered":"2024-09-15T23:12:13.298358+0000","last_unstale":"2024-09-15T23:12:15.277829+0000","last_undegraded":"2024-09-15T23:12:15.277829+0000","last_fullsized":"2024-09-15T23:12:15.277829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:10.513438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277736+0000","last_change":"2024-09-15T23:12:13.302119+0000","last_active":"2024-09-15T23:12:15.277736+0000","last_peered":"2024-09-15T23:12:15.277736+0000","last_clean":"2024-09-15T23:12:15.277736+0000","last_became_active":"2024-09-15T23:12:13.301671+0000","last_became_peered":"2024-09-15T23:12:13.301671+0000","last_unstale":"2024-09-15T23:12:15.277736+0000","last_undegraded":"2024-09-15T23:12:15.277736+0000","last_fullsized":"2024-09-15T23:12:15.277736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:47.721506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277474+0000","last_change":"2024-09-15T23:12:13.301523+0000","last_active":"2024-09-15T23:12:15.277474+0000","last_peered":"2024-09-15T23:12:15.277474+0000","last_clean":"2024-09-15T23:12:15.277474+0000","last_became_active":"2024-09-15T23:12:13.301272+0000","last_became_peered":"2024-09-15T23:12:13.301272+0000","last_unstale":"2024-09-15T23:12:15.277474+0000","last_undegraded":"2024-09-15T23:12:15.277474+0000","last_fullsized":"2024-09-15T23:12:15.277474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:11.528380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277112+0000","last_change":"2024-09-15T23:12:13.297810+0000","last_active":"2024-09-15T23:12:15.277112+0000","last_peered":"2024-09-15T23:12:15.277112+0000","last_clean":"2024-09-15T23:12:15.277112+0000","last_became_active":"2024-09-15T23:12:13.295627+0000","last_became_peered":"2024-09-15T23:12:13.295627+0000","last_unstale":"2024-09-15T23:12:15.277112+0000","last_undegraded":"2024-09-15T23:12:15.277112+0000","last_fullsized":"2024-09-15T23:12:15.277112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:40.921752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.281209+0000","last_change":"2024-09-15T23:12:13.295501+0000","last_active":"2024-09-15T23:12:14.281209+0000","last_peered":"2024-09-15T23:12:14.281209+0000","last_clean":"2024-09-15T23:12:14.281209+0000","last_became_active":"2024-09-15T23:12:13.294470+0000","last_became_peered":"2024-09-15T23:12:13.294470+0000","last_unstale":"2024-09-15T23:12:14.281209+0000","last_undegraded":"2024-09-15T23:12:14.281209+0000","last_fullsized":"2024-09-15T23:12:14.281209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:27:22.925825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.278281+0000","last_change":"2024-09-15T23:12:13.300057+0000","last_active":"2024-09-15T23:12:15.278281+0000","last_peered":"2024-09-15T23:12:15.278281+0000","last_clean":"2024-09-15T23:12:15.278281+0000","last_became_active":"2024-09-15T23:12:13.299762+0000","last_became_peered":"2024-09-15T23:12:13.299762+0000","last_unstale":"2024-09-15T23:12:15.278281+0000","last_undegraded":"2024-09-15T23:12:15.278281+0000","last_fullsized":"2024-09-15T23:12:15.278281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:09:30.105488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277451+0000","last_change":"2024-09-15T23:12:13.296975+0000","last_active":"2024-09-15T23:12:15.277451+0000","last_peered":"2024-09-15T23:12:15.277451+0000","last_clean":"2024-09-15T23:12:15.277451+0000","last_became_active":"2024-09-15T23:12:13.296726+0000","last_became_peered":"2024-09-15T23:12:13.296726+0000","last_unstale":"2024-09-15T23:12:15.277451+0000","last_undegraded":"2024-09-15T23:12:15.277451+0000","last_fullsized":"2024-09-15T23:12:15.277451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:54:01.331747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277641+0000","last_change":"2024-09-15T23:12:13.299790+0000","last_active":"2024-09-15T23:12:15.277641+0000","last_peered":"2024-09-15T23:12:15.277641+0000","last_clean":"2024-09-15T23:12:15.277641+0000","last_became_active":"2024-09-15T23:12:13.299446+0000","last_became_peered":"2024-09-15T23:12:13.299446+0000","last_unstale":"2024-09-15T23:12:15.277641+0000","last_undegraded":"2024-09-15T23:12:15.277641+0000","last_fullsized":"2024-09-15T23:12:15.277641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:25.899342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142410+0000","last_change":"2024-09-15T23:12:13.303570+0000","last_active":"2024-09-15T23:12:15.142410+0000","last_peered":"2024-09-15T23:12:15.142410+0000","last_clean":"2024-09-15T23:12:15.142410+0000","last_became_active":"2024-09-15T23:12:13.303303+0000","last_became_peered":"2024-09-15T23:12:13.303303+0000","last_unstale":"2024-09-15T23:12:15.142410+0000","last_undegraded":"2024-09-15T23:12:15.142410+0000","last_fullsized":"2024-09-15T23:12:15.142410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:14.355538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142296+0000","last_change":"2024-09-15T23:12:13.297459+0000","last_active":"2024-09-15T23:12:15.142296+0000","last_peered":"2024-09-15T23:12:15.142296+0000","last_clean":"2024-09-15T23:12:15.142296+0000","last_became_active":"2024-09-15T23:12:13.293984+0000","last_became_peered":"2024-09-15T23:12:13.293984+0000","last_unstale":"2024-09-15T23:12:15.142296+0000","last_undegraded":"2024-09-15T23:12:15.142296+0000","last_fullsized":"2024-09-15T23:12:15.142296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:26:22.310337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277181+0000","last_change":"2024-09-15T23:12:13.296112+0000","last_active":"2024-09-15T23:12:15.277181+0000","last_peered":"2024-09-15T23:12:15.277181+0000","last_clean":"2024-09-15T23:12:15.277181+0000","last_became_active":"2024-09-15T23:12:13.295405+0000","last_became_peered":"2024-09-15T23:12:13.295405+0000","last_unstale":"2024-09-15T23:12:15.277181+0000","last_undegraded":"2024-09-15T23:12:15.277181+0000","last_fullsized":"2024-09-15T23:12:15.277181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:53.919348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282130+0000","last_change":"2024-09-15T23:12:13.302744+0000","last_active":"2024-09-15T23:12:14.282130+0000","last_peered":"2024-09-15T23:12:14.282130+0000","last_clean":"2024-09-15T23:12:14.282130+0000","last_became_active":"2024-09-15T23:12:13.302439+0000","last_became_peered":"2024-09-15T23:12:13.302439+0000","last_unstale":"2024-09-15T23:12:14.282130+0000","last_undegraded":"2024-09-15T23:12:14.282130+0000","last_fullsized":"2024-09-15T23:12:14.282130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:16.349500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282569+0000","last_change":"2024-09-15T23:12:13.298338+0000","last_active":"2024-09-15T23:12:14.282569+0000","last_peered":"2024-09-15T23:12:14.282569+0000","last_clean":"2024-09-15T23:12:14.282569+0000","last_became_active":"2024-09-15T23:12:13.297884+0000","last_became_peered":"2024-09-15T23:12:13.297884+0000","last_unstale":"2024-09-15T23:12:14.282569+0000","last_undegraded":"2024-09-15T23:12:14.282569+0000","last_fullsized":"2024-09-15T23:12:14.282569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:41:23.354555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282638+0000","last_change":"2024-09-15T23:12:13.306391+0000","last_active":"2024-09-15T23:12:14.282638+0000","last_peered":"2024-09-15T23:12:14.282638+0000","last_clean":"2024-09-15T23:12:14.282638+0000","last_became_active":"2024-09-15T23:12:13.306106+0000","last_became_peered":"2024-09-15T23:12:13.306106+0000","last_unstale":"2024-09-15T23:12:14.282638+0000","last_undegraded":"2024-09-15T23:12:14.282638+0000","last_fullsized":"2024-09-15T23:12:14.282638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:28.292228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282623+0000","last_change":"2024-09-15T23:12:13.300688+0000","last_active":"2024-09-15T23:12:14.282623+0000","last_peered":"2024-09-15T23:12:14.282623+0000","last_clean":"2024-09-15T23:12:14.282623+0000","last_became_active":"2024-09-15T23:12:13.300388+0000","last_became_peered":"2024-09-15T23:12:13.300388+0000","last_unstale":"2024-09-15T23:12:14.282623+0000","last_undegraded":"2024-09-15T23:12:14.282623+0000","last_fullsized":"2024-09-15T23:12:14.282623+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:48.197999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277699+0000","last_change":"2024-09-15T23:12:13.295852+0000","last_active":"2024-09-15T23:12:15.277699+0000","last_peered":"2024-09-15T23:12:15.277699+0000","last_clean":"2024-09-15T23:12:15.277699+0000","last_became_active":"2024-09-15T23:12:13.295536+0000","last_became_peered":"2024-09-15T23:12:13.295536+0000","last_unstale":"2024-09-15T23:12:15.277699+0000","last_undegraded":"2024-09-15T23:12:15.277699+0000","last_fullsized":"2024-09-15T23:12:15.277699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:10.165586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776770+0000","last_change":"2024-09-15T23:12:13.302978+0000","last_active":"2024-09-15T23:12:14.776770+0000","last_peered":"2024-09-15T23:12:14.776770+0000","last_clean":"2024-09-15T23:12:14.776770+0000","last_became_active":"2024-09-15T23:12:13.302474+0000","last_became_peered":"2024-09-15T23:12:13.302474+0000","last_unstale":"2024-09-15T23:12:14.776770+0000","last_undegraded":"2024-09-15T23:12:14.776770+0000","last_fullsized":"2024-09-15T23:12:14.776770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:13:52.918855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.280957+0000","last_change":"2024-09-15T23:12:13.296548+0000","last_active":"2024-09-15T23:12:14.280957+0000","last_peered":"2024-09-15T23:12:14.280957+0000","last_clean":"2024-09-15T23:12:14.280957+0000","last_became_active":"2024-09-15T23:12:13.294814+0000","last_became_peered":"2024-09-15T23:12:13.294814+0000","last_unstale":"2024-09-15T23:12:14.280957+0000","last_undegraded":"2024-09-15T23:12:14.280957+0000","last_fullsized":"2024-09-15T23:12:14.280957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:30.079827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277175+0000","last_change":"2024-09-15T23:12:13.298250+0000","last_active":"2024-09-15T23:12:15.277175+0000","last_peered":"2024-09-15T23:12:15.277175+0000","last_clean":"2024-09-15T23:12:15.277175+0000","last_became_active":"2024-09-15T23:12:13.297923+0000","last_became_peered":"2024-09-15T23:12:13.297923+0000","last_unstale":"2024-09-15T23:12:15.277175+0000","last_undegraded":"2024-09-15T23:12:15.277175+0000","last_fullsized":"2024-09-15T23:12:15.277175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:32.902323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282119+0000","last_change":"2024-09-15T23:12:13.293872+0000","last_active":"2024-09-15T23:12:14.282119+0000","last_peered":"2024-09-15T23:12:14.282119+0000","last_clean":"2024-09-15T23:12:14.282119+0000","last_became_active":"2024-09-15T23:12:13.293608+0000","last_became_peered":"2024-09-15T23:12:13.293608+0000","last_unstale":"2024-09-15T23:12:14.282119+0000","last_undegraded":"2024-09-15T23:12:14.282119+0000","last_fullsized":"2024-09-15T23:12:14.282119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:05.614358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277371+0000","last_change":"2024-09-15T23:12:13.297603+0000","last_active":"2024-09-15T23:12:15.277371+0000","last_peered":"2024-09-15T23:12:15.277371+0000","last_clean":"2024-09-15T23:12:15.277371+0000","last_became_active":"2024-09-15T23:12:13.297090+0000","last_became_peered":"2024-09-15T23:12:13.297090+0000","last_unstale":"2024-09-15T23:12:15.277371+0000","last_undegraded":"2024-09-15T23:12:15.277371+0000","last_fullsized":"2024-09-15T23:12:15.277371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:20:45.209892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277872+0000","last_change":"2024-09-15T23:12:13.299195+0000","last_active":"2024-09-15T23:12:15.277872+0000","last_peered":"2024-09-15T23:12:15.277872+0000","last_clean":"2024-09-15T23:12:15.277872+0000","last_became_active":"2024-09-15T23:12:13.298466+0000","last_became_peered":"2024-09-15T23:12:13.298466+0000","last_unstale":"2024-09-15T23:12:15.277872+0000","last_undegraded":"2024-09-15T23:12:15.277872+0000","last_fullsized":"2024-09-15T23:12:15.277872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:28.292228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142578+0000","last_change":"2024-09-15T23:12:13.293831+0000","last_active":"2024-09-15T23:12:15.142578+0000","last_peered":"2024-09-15T23:12:15.142578+0000","last_clean":"2024-09-15T23:12:15.142578+0000","last_became_active":"2024-09-15T23:12:13.293105+0000","last_became_peered":"2024-09-15T23:12:13.293105+0000","last_unstale":"2024-09-15T23:12:15.142578+0000","last_undegraded":"2024-09-15T23:12:15.142578+0000","last_fullsized":"2024-09-15T23:12:15.142578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:10:44.616598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142320+0000","last_change":"2024-09-15T23:12:13.304201+0000","last_active":"2024-09-15T23:12:15.142320+0000","last_peered":"2024-09-15T23:12:15.142320+0000","last_clean":"2024-09-15T23:12:15.142320+0000","last_became_active":"2024-09-15T23:12:13.303927+0000","last_became_peered":"2024-09-15T23:12:13.303927+0000","last_unstale":"2024-09-15T23:12:15.142320+0000","last_undegraded":"2024-09-15T23:12:15.142320+0000","last_fullsized":"2024-09-15T23:12:15.142320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:04.822487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277367+0000","last_change":"2024-09-15T23:12:13.306673+0000","last_active":"2024-09-15T23:12:15.277367+0000","last_peered":"2024-09-15T23:12:15.277367+0000","last_clean":"2024-09-15T23:12:15.277367+0000","last_became_active":"2024-09-15T23:12:13.306402+0000","last_became_peered":"2024-09-15T23:12:13.306402+0000","last_unstale":"2024-09-15T23:12:15.277367+0000","last_undegraded":"2024-09-15T23:12:15.277367+0000","last_fullsized":"2024-09-15T23:12:15.277367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:38.511766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282237+0000","last_change":"2024-09-15T23:12:13.291856+0000","last_active":"2024-09-15T23:12:14.282237+0000","last_peered":"2024-09-15T23:12:14.282237+0000","last_clean":"2024-09-15T23:12:14.282237+0000","last_became_active":"2024-09-15T23:12:13.291050+0000","last_became_peered":"2024-09-15T23:12:13.291050+0000","last_unstale":"2024-09-15T23:12:14.282237+0000","last_undegraded":"2024-09-15T23:12:14.282237+0000","last_fullsized":"2024-09-15T23:12:14.282237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:14:14.059613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282338+0000","last_change":"2024-09-15T23:12:13.303266+0000","last_active":"2024-09-15T23:12:14.282338+0000","last_peered":"2024-09-15T23:12:14.282338+0000","last_clean":"2024-09-15T23:12:14.282338+0000","last_became_active":"2024-09-15T23:12:13.302500+0000","last_became_peered":"2024-09-15T23:12:13.302500+0000","last_unstale":"2024-09-15T23:12:14.282338+0000","last_undegraded":"2024-09-15T23:12:14.282338+0000","last_fullsized":"2024-09-15T23:12:14.282338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:30.079827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277224+0000","last_change":"2024-09-15T23:12:13.300877+0000","last_active":"2024-09-15T23:12:15.277224+0000","last_peered":"2024-09-15T23:12:15.277224+0000","last_clean":"2024-09-15T23:12:15.277224+0000","last_became_active":"2024-09-15T23:12:13.300604+0000","last_became_peered":"2024-09-15T23:12:13.300604+0000","last_unstale":"2024-09-15T23:12:15.277224+0000","last_undegraded":"2024-09-15T23:12:15.277224+0000","last_fullsized":"2024-09-15T23:12:15.277224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:30.079827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.280979+0000","last_change":"2024-09-15T23:12:13.290806+0000","last_active":"2024-09-15T23:12:14.280979+0000","last_peered":"2024-09-15T23:12:14.280979+0000","last_clean":"2024-09-15T23:12:14.280979+0000","last_became_active":"2024-09-15T23:12:13.290534+0000","last_became_peered":"2024-09-15T23:12:13.290534+0000","last_unstale":"2024-09-15T23:12:14.280979+0000","last_undegraded":"2024-09-15T23:12:14.280979+0000","last_fullsized":"2024-09-15T23:12:14.280979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:47.721506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277101+0000","last_change":"2024-09-15T23:12:12.299410+0000","last_active":"2024-09-15T23:12:15.277101+0000","last_peered":"2024-09-15T23:12:15.277101+0000","last_clean":"2024-09-15T23:12:15.277101+0000","last_became_active":"2024-09-15T23:12:12.299149+0000","last_became_peered":"2024-09-15T23:12:12.299149+0000","last_unstale":"2024-09-15T23:12:15.277101+0000","last_undegraded":"2024-09-15T23:12:15.277101+0000","last_fullsized":"2024-09-15T23:12:15.277101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:28.555228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776858+0000","last_change":"2024-09-15T23:12:13.293900+0000","last_active":"2024-09-15T23:12:14.776858+0000","last_peered":"2024-09-15T23:12:14.776858+0000","last_clean":"2024-09-15T23:12:14.776858+0000","last_became_active":"2024-09-15T23:12:13.293602+0000","last_became_peered":"2024-09-15T23:12:13.293602+0000","last_unstale":"2024-09-15T23:12:14.776858+0000","last_undegraded":"2024-09-15T23:12:14.776858+0000","last_fullsized":"2024-09-15T23:12:14.776858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:32.902323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282397+0000","last_change":"2024-09-15T23:12:12.297601+0000","last_active":"2024-09-15T23:12:14.282397+0000","last_peered":"2024-09-15T23:12:14.282397+0000","last_clean":"2024-09-15T23:12:14.282397+0000","last_became_active":"2024-09-15T23:12:12.297353+0000","last_became_peered":"2024-09-15T23:12:12.297353+0000","last_unstale":"2024-09-15T23:12:14.282397+0000","last_undegraded":"2024-09-15T23:12:14.282397+0000","last_fullsized":"2024-09-15T23:12:14.282397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:27.285153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142086+0000","last_change":"2024-09-15T23:12:12.301058+0000","last_active":"2024-09-15T23:12:15.142086+0000","last_peered":"2024-09-15T23:12:15.142086+0000","last_clean":"2024-09-15T23:12:15.142086+0000","last_became_active":"2024-09-15T23:12:12.300744+0000","last_became_peered":"2024-09-15T23:12:12.300744+0000","last_unstale":"2024-09-15T23:12:15.142086+0000","last_undegraded":"2024-09-15T23:12:15.142086+0000","last_fullsized":"2024-09-15T23:12:15.142086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:54.309977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277506+0000","last_change":"2024-09-15T23:12:13.302358+0000","last_active":"2024-09-15T23:12:15.277506+0000","last_peered":"2024-09-15T23:12:15.277506+0000","last_clean":"2024-09-15T23:12:15.277506+0000","last_became_active":"2024-09-15T23:12:13.301840+0000","last_became_peered":"2024-09-15T23:12:13.301840+0000","last_unstale":"2024-09-15T23:12:15.277506+0000","last_undegraded":"2024-09-15T23:12:15.277506+0000","last_fullsized":"2024-09-15T23:12:15.277506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:45:58.241079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282269+0000","last_change":"2024-09-15T23:12:12.294030+0000","last_active":"2024-09-15T23:12:14.282269+0000","last_peered":"2024-09-15T23:12:14.282269+0000","last_clean":"2024-09-15T23:12:14.282269+0000","last_became_active":"2024-09-15T23:12:12.293252+0000","last_became_peered":"2024-09-15T23:12:12.293252+0000","last_unstale":"2024-09-15T23:12:14.282269+0000","last_undegraded":"2024-09-15T23:12:14.282269+0000","last_fullsized":"2024-09-15T23:12:14.282269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:29.072753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776750+0000","last_change":"2024-09-15T23:12:13.302350+0000","last_active":"2024-09-15T23:12:14.776750+0000","last_peered":"2024-09-15T23:12:14.776750+0000","last_clean":"2024-09-15T23:12:14.776750+0000","last_became_active":"2024-09-15T23:12:13.301761+0000","last_became_peered":"2024-09-15T23:12:13.301761+0000","last_unstale":"2024-09-15T23:12:14.776750+0000","last_undegraded":"2024-09-15T23:12:14.776750+0000","last_fullsized":"2024-09-15T23:12:14.776750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:29.428355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.281250+0000","last_change":"2024-09-15T23:12:12.296404+0000","last_active":"2024-09-15T23:12:14.281250+0000","last_peered":"2024-09-15T23:12:14.281250+0000","last_clean":"2024-09-15T23:12:14.281250+0000","last_became_active":"2024-09-15T23:12:12.296128+0000","last_became_peered":"2024-09-15T23:12:12.296128+0000","last_unstale":"2024-09-15T23:12:14.281250+0000","last_undegraded":"2024-09-15T23:12:14.281250+0000","last_fullsized":"2024-09-15T23:12:14.281250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:43.458579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.278041+0000","last_change":"2024-09-15T23:12:13.298997+0000","last_active":"2024-09-15T23:12:15.278041+0000","last_peered":"2024-09-15T23:12:15.278041+0000","last_clean":"2024-09-15T23:12:15.278041+0000","last_became_active":"2024-09-15T23:12:13.298225+0000","last_became_peered":"2024-09-15T23:12:13.298225+0000","last_unstale":"2024-09-15T23:12:15.278041+0000","last_undegraded":"2024-09-15T23:12:15.278041+0000","last_fullsized":"2024-09-15T23:12:15.278041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:27:22.925825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.278252+0000","last_change":"2024-09-15T23:12:12.294378+0000","last_active":"2024-09-15T23:12:15.278252+0000","last_peered":"2024-09-15T23:12:15.278252+0000","last_clean":"2024-09-15T23:12:15.278252+0000","last_became_active":"2024-09-15T23:12:12.294028+0000","last_became_peered":"2024-09-15T23:12:12.294028+0000","last_unstale":"2024-09-15T23:12:15.278252+0000","last_undegraded":"2024-09-15T23:12:15.278252+0000","last_fullsized":"2024-09-15T23:12:15.278252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:29.072753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277559+0000","last_change":"2024-09-15T23:12:13.295768+0000","last_active":"2024-09-15T23:12:15.277559+0000","last_peered":"2024-09-15T23:12:15.277559+0000","last_clean":"2024-09-15T23:12:15.277559+0000","last_became_active":"2024-09-15T23:12:13.295379+0000","last_became_peered":"2024-09-15T23:12:13.295379+0000","last_unstale":"2024-09-15T23:12:15.277559+0000","last_undegraded":"2024-09-15T23:12:15.277559+0000","last_fullsized":"2024-09-15T23:12:15.277559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:47.011102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282465+0000","last_change":"2024-09-15T23:12:12.296690+0000","last_active":"2024-09-15T23:12:14.282465+0000","last_peered":"2024-09-15T23:12:14.282465+0000","last_clean":"2024-09-15T23:12:14.282465+0000","last_became_active":"2024-09-15T23:12:12.295787+0000","last_became_peered":"2024-09-15T23:12:12.295787+0000","last_unstale":"2024-09-15T23:12:14.282465+0000","last_undegraded":"2024-09-15T23:12:14.282465+0000","last_fullsized":"2024-09-15T23:12:14.282465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:11.043406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282394+0000","last_change":"2024-09-15T23:12:13.302380+0000","last_active":"2024-09-15T23:12:14.282394+0000","last_peered":"2024-09-15T23:12:14.282394+0000","last_clean":"2024-09-15T23:12:14.282394+0000","last_became_active":"2024-09-15T23:12:13.302131+0000","last_became_peered":"2024-09-15T23:12:13.302131+0000","last_unstale":"2024-09-15T23:12:14.282394+0000","last_undegraded":"2024-09-15T23:12:14.282394+0000","last_fullsized":"2024-09-15T23:12:14.282394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:29.884341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.278328+0000","last_change":"2024-09-15T23:12:12.298778+0000","last_active":"2024-09-15T23:12:15.278328+0000","last_peered":"2024-09-15T23:12:15.278328+0000","last_clean":"2024-09-15T23:12:15.278328+0000","last_became_active":"2024-09-15T23:12:12.298501+0000","last_became_peered":"2024-09-15T23:12:12.298501+0000","last_unstale":"2024-09-15T23:12:15.278328+0000","last_undegraded":"2024-09-15T23:12:15.278328+0000","last_fullsized":"2024-09-15T23:12:15.278328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:50:38.455575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.278015+0000","last_change":"2024-09-15T23:12:13.303512+0000","last_active":"2024-09-15T23:12:15.278015+0000","last_peered":"2024-09-15T23:12:15.278015+0000","last_clean":"2024-09-15T23:12:15.278015+0000","last_became_active":"2024-09-15T23:12:13.303210+0000","last_became_peered":"2024-09-15T23:12:13.303210+0000","last_unstale":"2024-09-15T23:12:15.278015+0000","last_undegraded":"2024-09-15T23:12:15.278015+0000","last_fullsized":"2024-09-15T23:12:15.278015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:05.614358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282483+0000","last_change":"2024-09-15T23:12:12.300595+0000","last_active":"2024-09-15T23:12:14.282483+0000","last_peered":"2024-09-15T23:12:14.282483+0000","last_clean":"2024-09-15T23:12:14.282483+0000","last_became_active":"2024-09-15T23:12:12.300327+0000","last_became_peered":"2024-09-15T23:12:12.300327+0000","last_unstale":"2024-09-15T23:12:14.282483+0000","last_undegraded":"2024-09-15T23:12:14.282483+0000","last_fullsized":"2024-09-15T23:12:14.282483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:43.458579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142286+0000","last_change":"2024-09-15T23:12:13.295028+0000","last_active":"2024-09-15T23:12:15.142286+0000","last_peered":"2024-09-15T23:12:15.142286+0000","last_clean":"2024-09-15T23:12:15.142286+0000","last_became_active":"2024-09-15T23:12:13.294725+0000","last_became_peered":"2024-09-15T23:12:13.294725+0000","last_unstale":"2024-09-15T23:12:15.142286+0000","last_undegraded":"2024-09-15T23:12:15.142286+0000","last_fullsized":"2024-09-15T23:12:15.142286+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:08:51.159156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282517+0000","last_change":"2024-09-15T23:12:12.295626+0000","last_active":"2024-09-15T23:12:14.282517+0000","last_peered":"2024-09-15T23:12:14.282517+0000","last_clean":"2024-09-15T23:12:14.282517+0000","last_became_active":"2024-09-15T23:12:12.295333+0000","last_became_peered":"2024-09-15T23:12:12.295333+0000","last_unstale":"2024-09-15T23:12:14.282517+0000","last_undegraded":"2024-09-15T23:12:14.282517+0000","last_fullsized":"2024-09-15T23:12:14.282517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:27:21.918750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282376+0000","last_change":"2024-09-15T23:12:13.296636+0000","last_active":"2024-09-15T23:12:14.282376+0000","last_peered":"2024-09-15T23:12:14.282376+0000","last_clean":"2024-09-15T23:12:14.282376+0000","last_became_active":"2024-09-15T23:12:13.296172+0000","last_became_peered":"2024-09-15T23:12:13.296172+0000","last_unstale":"2024-09-15T23:12:14.282376+0000","last_undegraded":"2024-09-15T23:12:14.282376+0000","last_fullsized":"2024-09-15T23:12:14.282376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:16.832075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277437+0000","last_change":"2024-09-15T23:12:12.296543+0000","last_active":"2024-09-15T23:12:15.277437+0000","last_peered":"2024-09-15T23:12:15.277437+0000","last_clean":"2024-09-15T23:12:15.277437+0000","last_became_active":"2024-09-15T23:12:12.296293+0000","last_became_peered":"2024-09-15T23:12:12.296293+0000","last_unstale":"2024-09-15T23:12:15.277437+0000","last_undegraded":"2024-09-15T23:12:15.277437+0000","last_fullsized":"2024-09-15T23:12:15.277437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:07:54.128353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.280809+0000","last_change":"2024-09-15T23:12:13.297331+0000","last_active":"2024-09-15T23:12:14.280809+0000","last_peered":"2024-09-15T23:12:14.280809+0000","last_clean":"2024-09-15T23:12:14.280809+0000","last_became_active":"2024-09-15T23:12:13.297036+0000","last_became_peered":"2024-09-15T23:12:13.297036+0000","last_unstale":"2024-09-15T23:12:14.280809+0000","last_undegraded":"2024-09-15T23:12:14.280809+0000","last_fullsized":"2024-09-15T23:12:14.280809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:18.794107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776416+0000","last_change":"2024-09-15T23:12:12.297599+0000","last_active":"2024-09-15T23:12:14.776416+0000","last_peered":"2024-09-15T23:12:14.776416+0000","last_clean":"2024-09-15T23:12:14.776416+0000","last_became_active":"2024-09-15T23:12:12.297309+0000","last_became_peered":"2024-09-15T23:12:12.297309+0000","last_unstale":"2024-09-15T23:12:14.776416+0000","last_undegraded":"2024-09-15T23:12:14.776416+0000","last_fullsized":"2024-09-15T23:12:14.776416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:28.555228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282174+0000","last_change":"2024-09-15T23:12:13.301636+0000","last_active":"2024-09-15T23:12:14.282174+0000","last_peered":"2024-09-15T23:12:14.282174+0000","last_clean":"2024-09-15T23:12:14.282174+0000","last_became_active":"2024-09-15T23:12:13.301390+0000","last_became_peered":"2024-09-15T23:12:13.301390+0000","last_unstale":"2024-09-15T23:12:14.282174+0000","last_undegraded":"2024-09-15T23:12:14.282174+0000","last_fullsized":"2024-09-15T23:12:14.282174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:09:30.105488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.278395+0000","last_change":"2024-09-15T23:12:12.294164+0000","last_active":"2024-09-15T23:12:15.278395+0000","last_peered":"2024-09-15T23:12:15.278395+0000","last_clean":"2024-09-15T23:12:15.278395+0000","last_became_active":"2024-09-15T23:12:12.293619+0000","last_became_peered":"2024-09-15T23:12:12.293619+0000","last_unstale":"2024-09-15T23:12:15.278395+0000","last_undegraded":"2024-09-15T23:12:15.278395+0000","last_fullsized":"2024-09-15T23:12:15.278395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:46.714431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.278200+0000","last_change":"2024-09-15T23:12:13.298781+0000","last_active":"2024-09-15T23:12:15.278200+0000","last_peered":"2024-09-15T23:12:15.278200+0000","last_clean":"2024-09-15T23:12:15.278200+0000","last_became_active":"2024-09-15T23:12:13.297968+0000","last_became_peered":"2024-09-15T23:12:13.297968+0000","last_unstale":"2024-09-15T23:12:15.278200+0000","last_undegraded":"2024-09-15T23:12:15.278200+0000","last_fullsized":"2024-09-15T23:12:15.278200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:26:22.310337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776841+0000","last_change":"2024-09-15T23:12:12.299042+0000","last_active":"2024-09-15T23:12:14.776841+0000","last_peered":"2024-09-15T23:12:14.776841+0000","last_clean":"2024-09-15T23:12:14.776841+0000","last_became_active":"2024-09-15T23:12:12.298781+0000","last_became_peered":"2024-09-15T23:12:12.298781+0000","last_unstale":"2024-09-15T23:12:14.776841+0000","last_undegraded":"2024-09-15T23:12:14.776841+0000","last_fullsized":"2024-09-15T23:12:14.776841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:12.407756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.278420+0000","last_change":"2024-09-15T23:12:13.296707+0000","last_active":"2024-09-15T23:12:15.278420+0000","last_peered":"2024-09-15T23:12:15.278420+0000","last_clean":"2024-09-15T23:12:15.278420+0000","last_became_active":"2024-09-15T23:12:13.296450+0000","last_became_peered":"2024-09-15T23:12:13.296450+0000","last_unstale":"2024-09-15T23:12:15.278420+0000","last_undegraded":"2024-09-15T23:12:15.278420+0000","last_fullsized":"2024-09-15T23:12:15.278420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:51:37.808404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277145+0000","last_change":"2024-09-15T23:12:12.296505+0000","last_active":"2024-09-15T23:12:15.277145+0000","last_peered":"2024-09-15T23:12:15.277145+0000","last_clean":"2024-09-15T23:12:15.277145+0000","last_became_active":"2024-09-15T23:12:12.296249+0000","last_became_peered":"2024-09-15T23:12:12.296249+0000","last_unstale":"2024-09-15T23:12:15.277145+0000","last_undegraded":"2024-09-15T23:12:15.277145+0000","last_fullsized":"2024-09-15T23:12:15.277145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:22.552069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277847+0000","last_change":"2024-09-15T23:12:13.306601+0000","last_active":"2024-09-15T23:12:15.277847+0000","last_peered":"2024-09-15T23:12:15.277847+0000","last_clean":"2024-09-15T23:12:15.277847+0000","last_became_active":"2024-09-15T23:12:13.306342+0000","last_became_peered":"2024-09-15T23:12:13.306342+0000","last_unstale":"2024-09-15T23:12:15.277847+0000","last_undegraded":"2024-09-15T23:12:15.277847+0000","last_fullsized":"2024-09-15T23:12:15.277847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:29.584475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142541+0000","last_change":"2024-09-15T23:12:12.305855+0000","last_active":"2024-09-15T23:12:15.142541+0000","last_peered":"2024-09-15T23:12:15.142541+0000","last_clean":"2024-09-15T23:12:15.142541+0000","last_became_active":"2024-09-15T23:12:12.305533+0000","last_became_peered":"2024-09-15T23:12:12.305533+0000","last_unstale":"2024-09-15T23:12:15.142541+0000","last_undegraded":"2024-09-15T23:12:15.142541+0000","last_fullsized":"2024-09-15T23:12:15.142541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:11.043406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282621+0000","last_change":"2024-09-15T23:12:13.292019+0000","last_active":"2024-09-15T23:12:14.282621+0000","last_peered":"2024-09-15T23:12:14.282621+0000","last_clean":"2024-09-15T23:12:14.282621+0000","last_became_active":"2024-09-15T23:12:13.290585+0000","last_became_peered":"2024-09-15T23:12:13.290585+0000","last_unstale":"2024-09-15T23:12:14.282621+0000","last_undegraded":"2024-09-15T23:12:14.282621+0000","last_fullsized":"2024-09-15T23:12:14.282621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:49:31.867792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.280816+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:12:14.280816+0000","last_peered":"2024-09-15T23:12:14.280816+0000","last_clean":"2024-09-15T23:12:14.280816+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:12:14.280816+0000","last_undegraded":"2024-09-15T23:12:14.280816+0000","last_fullsized":"2024-09-15T23:12:14.280816+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282421+0000","last_change":"2024-09-15T23:12:12.295819+0000","last_active":"2024-09-15T23:12:14.282421+0000","last_peered":"2024-09-15T23:12:14.282421+0000","last_clean":"2024-09-15T23:12:14.282421+0000","last_became_active":"2024-09-15T23:12:12.295320+0000","last_became_peered":"2024-09-15T23:12:12.295320+0000","last_unstale":"2024-09-15T23:12:14.282421+0000","last_undegraded":"2024-09-15T23:12:14.282421+0000","last_fullsized":"2024-09-15T23:12:14.282421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:13.348463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776701+0000","last_change":"2024-09-15T23:12:13.292512+0000","last_active":"2024-09-15T23:12:14.776701+0000","last_peered":"2024-09-15T23:12:14.776701+0000","last_clean":"2024-09-15T23:12:14.776701+0000","last_became_active":"2024-09-15T23:12:13.292230+0000","last_became_peered":"2024-09-15T23:12:13.292230+0000","last_unstale":"2024-09-15T23:12:14.776701+0000","last_undegraded":"2024-09-15T23:12:14.776701+0000","last_fullsized":"2024-09-15T23:12:14.776701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:51.115293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282228+0000","last_change":"2024-09-15T23:12:12.293545+0000","last_active":"2024-09-15T23:12:14.282228+0000","last_peered":"2024-09-15T23:12:14.282228+0000","last_clean":"2024-09-15T23:12:14.282228+0000","last_became_active":"2024-09-15T23:12:12.292903+0000","last_became_peered":"2024-09-15T23:12:12.292903+0000","last_unstale":"2024-09-15T23:12:14.282228+0000","last_undegraded":"2024-09-15T23:12:14.282228+0000","last_fullsized":"2024-09-15T23:12:14.282228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:46.714431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142240+0000","last_change":"2024-09-15T23:12:13.298677+0000","last_active":"2024-09-15T23:12:15.142240+0000","last_peered":"2024-09-15T23:12:15.142240+0000","last_clean":"2024-09-15T23:12:15.142240+0000","last_became_active":"2024-09-15T23:12:13.298386+0000","last_became_peered":"2024-09-15T23:12:13.298386+0000","last_unstale":"2024-09-15T23:12:15.142240+0000","last_undegraded":"2024-09-15T23:12:15.142240+0000","last_fullsized":"2024-09-15T23:12:15.142240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:10:04.877140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282158+0000","last_change":"2024-09-15T23:12:12.296394+0000","last_active":"2024-09-15T23:12:14.282158+0000","last_peered":"2024-09-15T23:12:14.282158+0000","last_clean":"2024-09-15T23:12:14.282158+0000","last_became_active":"2024-09-15T23:12:12.296110+0000","last_became_peered":"2024-09-15T23:12:12.296110+0000","last_unstale":"2024-09-15T23:12:14.282158+0000","last_undegraded":"2024-09-15T23:12:14.282158+0000","last_fullsized":"2024-09-15T23:12:14.282158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:54.309977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277322+0000","last_change":"2024-09-15T23:12:13.294854+0000","last_active":"2024-09-15T23:12:15.277322+0000","last_peered":"2024-09-15T23:12:15.277322+0000","last_clean":"2024-09-15T23:12:15.277322+0000","last_became_active":"2024-09-15T23:12:13.294539+0000","last_became_peered":"2024-09-15T23:12:13.294539+0000","last_unstale":"2024-09-15T23:12:15.277322+0000","last_undegraded":"2024-09-15T23:12:15.277322+0000","last_fullsized":"2024-09-15T23:12:15.277322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:43:07.769498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282544+0000","last_change":"2024-09-15T23:12:12.300290+0000","last_active":"2024-09-15T23:12:14.282544+0000","last_peered":"2024-09-15T23:12:14.282544+0000","last_clean":"2024-09-15T23:12:14.282544+0000","last_became_active":"2024-09-15T23:12:12.300024+0000","last_became_peered":"2024-09-15T23:12:12.300024+0000","last_unstale":"2024-09-15T23:12:14.282544+0000","last_undegraded":"2024-09-15T23:12:14.282544+0000","last_fullsized":"2024-09-15T23:12:14.282544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:10:03.870065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277903+0000","last_change":"2024-09-15T23:12:13.300590+0000","last_active":"2024-09-15T23:12:15.277903+0000","last_peered":"2024-09-15T23:12:15.277903+0000","last_clean":"2024-09-15T23:12:15.277903+0000","last_became_active":"2024-09-15T23:12:13.300376+0000","last_became_peered":"2024-09-15T23:12:13.300376+0000","last_unstale":"2024-09-15T23:12:15.277903+0000","last_undegraded":"2024-09-15T23:12:15.277903+0000","last_fullsized":"2024-09-15T23:12:15.277903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:02.914486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277032+0000","last_change":"2024-09-15T23:12:12.297859+0000","last_active":"2024-09-15T23:12:15.277032+0000","last_peered":"2024-09-15T23:12:15.277032+0000","last_clean":"2024-09-15T23:12:15.277032+0000","last_became_active":"2024-09-15T23:12:12.297520+0000","last_became_peered":"2024-09-15T23:12:12.297520+0000","last_unstale":"2024-09-15T23:12:15.277032+0000","last_undegraded":"2024-09-15T23:12:15.277032+0000","last_fullsized":"2024-09-15T23:12:15.277032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:12.407756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.278068+0000","last_change":"2024-09-15T23:12:13.300154+0000","last_active":"2024-09-15T23:12:15.278068+0000","last_peered":"2024-09-15T23:12:15.278068+0000","last_clean":"2024-09-15T23:12:15.278068+0000","last_became_active":"2024-09-15T23:12:13.299919+0000","last_became_peered":"2024-09-15T23:12:13.299919+0000","last_unstale":"2024-09-15T23:12:15.278068+0000","last_undegraded":"2024-09-15T23:12:15.278068+0000","last_fullsized":"2024-09-15T23:12:15.278068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:10:04.877140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282692+0000","last_change":"2024-09-15T23:12:12.296791+0000","last_active":"2024-09-15T23:12:14.282692+0000","last_peered":"2024-09-15T23:12:14.282692+0000","last_clean":"2024-09-15T23:12:14.282692+0000","last_became_active":"2024-09-15T23:12:12.296507+0000","last_became_peered":"2024-09-15T23:12:12.296507+0000","last_unstale":"2024-09-15T23:12:14.282692+0000","last_undegraded":"2024-09-15T23:12:14.282692+0000","last_fullsized":"2024-09-15T23:12:14.282692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:08:50.152082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142523+0000","last_change":"2024-09-15T23:12:13.296540+0000","last_active":"2024-09-15T23:12:15.142523+0000","last_peered":"2024-09-15T23:12:15.142523+0000","last_clean":"2024-09-15T23:12:15.142523+0000","last_became_active":"2024-09-15T23:12:13.295765+0000","last_became_peered":"2024-09-15T23:12:13.295765+0000","last_unstale":"2024-09-15T23:12:15.142523+0000","last_undegraded":"2024-09-15T23:12:15.142523+0000","last_fullsized":"2024-09-15T23:12:15.142523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:03.932670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776948+0000","last_change":"2024-09-15T23:12:12.300784+0000","last_active":"2024-09-15T23:12:14.776948+0000","last_peered":"2024-09-15T23:12:14.776948+0000","last_clean":"2024-09-15T23:12:14.776948+0000","last_became_active":"2024-09-15T23:12:12.300267+0000","last_became_peered":"2024-09-15T23:12:12.300267+0000","last_unstale":"2024-09-15T23:12:14.776948+0000","last_undegraded":"2024-09-15T23:12:14.776948+0000","last_fullsized":"2024-09-15T23:12:14.776948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:01:57.256014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776957+0000","last_change":"2024-09-15T23:12:13.304126+0000","last_active":"2024-09-15T23:12:14.776957+0000","last_peered":"2024-09-15T23:12:14.776957+0000","last_clean":"2024-09-15T23:12:14.776957+0000","last_became_active":"2024-09-15T23:12:13.303461+0000","last_became_peered":"2024-09-15T23:12:13.303461+0000","last_unstale":"2024-09-15T23:12:14.776957+0000","last_undegraded":"2024-09-15T23:12:14.776957+0000","last_fullsized":"2024-09-15T23:12:14.776957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:43:07.769498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282577+0000","last_change":"2024-09-15T23:12:12.297628+0000","last_active":"2024-09-15T23:12:14.282577+0000","last_peered":"2024-09-15T23:12:14.282577+0000","last_clean":"2024-09-15T23:12:14.282577+0000","last_became_active":"2024-09-15T23:12:12.297392+0000","last_became_peered":"2024-09-15T23:12:12.297392+0000","last_unstale":"2024-09-15T23:12:14.282577+0000","last_undegraded":"2024-09-15T23:12:14.282577+0000","last_fullsized":"2024-09-15T23:12:14.282577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:26:21.303262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776864+0000","last_change":"2024-09-15T23:12:13.305087+0000","last_active":"2024-09-15T23:12:14.776864+0000","last_peered":"2024-09-15T23:12:14.776864+0000","last_clean":"2024-09-15T23:12:14.776864+0000","last_became_active":"2024-09-15T23:12:13.304851+0000","last_became_peered":"2024-09-15T23:12:13.304851+0000","last_unstale":"2024-09-15T23:12:14.776864+0000","last_undegraded":"2024-09-15T23:12:14.776864+0000","last_fullsized":"2024-09-15T23:12:14.776864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:57:53.919348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277272+0000","last_change":"2024-09-15T23:12:12.292922+0000","last_active":"2024-09-15T23:12:15.277272+0000","last_peered":"2024-09-15T23:12:15.277272+0000","last_clean":"2024-09-15T23:12:15.277272+0000","last_became_active":"2024-09-15T23:12:12.292606+0000","last_became_peered":"2024-09-15T23:12:12.292606+0000","last_unstale":"2024-09-15T23:12:15.277272+0000","last_undegraded":"2024-09-15T23:12:15.277272+0000","last_fullsized":"2024-09-15T23:12:15.277272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:25.929262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282187+0000","last_change":"2024-09-15T23:12:13.300968+0000","last_active":"2024-09-15T23:12:14.282187+0000","last_peered":"2024-09-15T23:12:14.282187+0000","last_clean":"2024-09-15T23:12:14.282187+0000","last_became_active":"2024-09-15T23:12:13.300679+0000","last_became_peered":"2024-09-15T23:12:13.300679+0000","last_unstale":"2024-09-15T23:12:14.282187+0000","last_undegraded":"2024-09-15T23:12:14.282187+0000","last_fullsized":"2024-09-15T23:12:14.282187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:51:37.808404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776598+0000","last_change":"2024-09-15T23:12:12.300647+0000","last_active":"2024-09-15T23:12:14.776598+0000","last_peered":"2024-09-15T23:12:14.776598+0000","last_clean":"2024-09-15T23:12:14.776598+0000","last_became_active":"2024-09-15T23:12:12.300181+0000","last_became_peered":"2024-09-15T23:12:12.300181+0000","last_unstale":"2024-09-15T23:12:14.776598+0000","last_undegraded":"2024-09-15T23:12:14.776598+0000","last_fullsized":"2024-09-15T23:12:14.776598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:22.552069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776822+0000","last_change":"2024-09-15T23:12:13.300864+0000","last_active":"2024-09-15T23:12:14.776822+0000","last_peered":"2024-09-15T23:12:14.776822+0000","last_clean":"2024-09-15T23:12:14.776822+0000","last_became_active":"2024-09-15T23:12:13.300258+0000","last_became_peered":"2024-09-15T23:12:13.300258+0000","last_unstale":"2024-09-15T23:12:14.776822+0000","last_undegraded":"2024-09-15T23:12:14.776822+0000","last_fullsized":"2024-09-15T23:12:14.776822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:40.921752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.142436+0000","last_change":"2024-09-15T23:12:12.304706+0000","last_active":"2024-09-15T23:12:15.142436+0000","last_peered":"2024-09-15T23:12:15.142436+0000","last_clean":"2024-09-15T23:12:15.142436+0000","last_became_active":"2024-09-15T23:12:12.304384+0000","last_became_peered":"2024-09-15T23:12:12.304384+0000","last_unstale":"2024-09-15T23:12:15.142436+0000","last_undegraded":"2024-09-15T23:12:15.142436+0000","last_fullsized":"2024-09-15T23:12:15.142436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:43.458579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282456+0000","last_change":"2024-09-15T23:12:13.305512+0000","last_active":"2024-09-15T23:12:14.282456+0000","last_peered":"2024-09-15T23:12:14.282456+0000","last_clean":"2024-09-15T23:12:14.282456+0000","last_became_active":"2024-09-15T23:12:13.305192+0000","last_became_peered":"2024-09-15T23:12:13.305192+0000","last_unstale":"2024-09-15T23:12:14.282456+0000","last_undegraded":"2024-09-15T23:12:14.282456+0000","last_fullsized":"2024-09-15T23:12:14.282456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:47.721506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282310+0000","last_change":"2024-09-15T23:12:12.295599+0000","last_active":"2024-09-15T23:12:14.282310+0000","last_peered":"2024-09-15T23:12:14.282310+0000","last_clean":"2024-09-15T23:12:14.282310+0000","last_became_active":"2024-09-15T23:12:12.295036+0000","last_became_peered":"2024-09-15T23:12:12.295036+0000","last_unstale":"2024-09-15T23:12:14.282310+0000","last_undegraded":"2024-09-15T23:12:14.282310+0000","last_fullsized":"2024-09-15T23:12:14.282310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:03.815413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282296+0000","last_change":"2024-09-15T23:12:13.292087+0000","last_active":"2024-09-15T23:12:14.282296+0000","last_peered":"2024-09-15T23:12:14.282296+0000","last_clean":"2024-09-15T23:12:14.282296+0000","last_became_active":"2024-09-15T23:12:13.291588+0000","last_became_peered":"2024-09-15T23:12:13.291588+0000","last_unstale":"2024-09-15T23:12:14.282296+0000","last_undegraded":"2024-09-15T23:12:14.282296+0000","last_fullsized":"2024-09-15T23:12:14.282296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:19:59.394904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.282457+0000","last_change":"2024-09-15T23:12:13.295583+0000","last_active":"2024-09-15T23:12:14.282457+0000","last_peered":"2024-09-15T23:12:14.282457+0000","last_clean":"2024-09-15T23:12:14.282457+0000","last_became_active":"2024-09-15T23:12:13.295285+0000","last_became_peered":"2024-09-15T23:12:13.295285+0000","last_unstale":"2024-09-15T23:12:14.282457+0000","last_undegraded":"2024-09-15T23:12:14.282457+0000","last_fullsized":"2024-09-15T23:12:14.282457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:12.748141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277815+0000","last_change":"2024-09-15T23:12:12.293704+0000","last_active":"2024-09-15T23:12:15.277815+0000","last_peered":"2024-09-15T23:12:15.277815+0000","last_clean":"2024-09-15T23:12:15.277815+0000","last_became_active":"2024-09-15T23:12:12.292898+0000","last_became_peered":"2024-09-15T23:12:12.292898+0000","last_unstale":"2024-09-15T23:12:15.277815+0000","last_undegraded":"2024-09-15T23:12:15.277815+0000","last_fullsized":"2024-09-15T23:12:15.277815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:27.285153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.281075+0000","last_change":"2024-09-15T23:12:13.295743+0000","last_active":"2024-09-15T23:12:14.281075+0000","last_peered":"2024-09-15T23:12:14.281075+0000","last_clean":"2024-09-15T23:12:14.281075+0000","last_became_active":"2024-09-15T23:12:13.295104+0000","last_became_peered":"2024-09-15T23:12:13.295104+0000","last_unstale":"2024-09-15T23:12:14.281075+0000","last_undegraded":"2024-09-15T23:12:14.281075+0000","last_fullsized":"2024-09-15T23:12:14.281075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:28.292228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.278033+0000","last_change":"2024-09-15T23:12:12.293296+0000","last_active":"2024-09-15T23:12:15.278033+0000","last_peered":"2024-09-15T23:12:15.278033+0000","last_clean":"2024-09-15T23:12:15.278033+0000","last_became_active":"2024-09-15T23:12:12.292920+0000","last_became_peered":"2024-09-15T23:12:12.292920+0000","last_unstale":"2024-09-15T23:12:15.278033+0000","last_undegraded":"2024-09-15T23:12:15.278033+0000","last_fullsized":"2024-09-15T23:12:15.278033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:17.787033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277421+0000","last_change":"2024-09-15T23:12:13.297368+0000","last_active":"2024-09-15T23:12:15.277421+0000","last_peered":"2024-09-15T23:12:15.277421+0000","last_clean":"2024-09-15T23:12:15.277421+0000","last_became_active":"2024-09-15T23:12:13.296735+0000","last_became_peered":"2024-09-15T23:12:13.296735+0000","last_unstale":"2024-09-15T23:12:15.277421+0000","last_undegraded":"2024-09-15T23:12:15.277421+0000","last_fullsized":"2024-09-15T23:12:15.277421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:11.250902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277466+0000","last_change":"2024-09-15T23:12:12.295645+0000","last_active":"2024-09-15T23:12:15.277466+0000","last_peered":"2024-09-15T23:12:15.277466+0000","last_clean":"2024-09-15T23:12:15.277466+0000","last_became_active":"2024-09-15T23:12:12.295359+0000","last_became_peered":"2024-09-15T23:12:12.295359+0000","last_unstale":"2024-09-15T23:12:15.277466+0000","last_undegraded":"2024-09-15T23:12:15.277466+0000","last_fullsized":"2024-09-15T23:12:15.277466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:01:57.256014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:15.277490+0000","last_change":"2024-09-15T23:12:13.302910+0000","last_active":"2024-09-15T23:12:15.277490+0000","last_peered":"2024-09-15T23:12:15.277490+0000","last_clean":"2024-09-15T23:12:15.277490+0000","last_became_active":"2024-09-15T23:12:13.302457+0000","last_became_peered":"2024-09-15T23:12:13.302457+0000","last_unstale":"2024-09-15T23:12:15.277490+0000","last_undegraded":"2024-09-15T23:12:15.277490+0000","last_fullsized":"2024-09-15T23:12:15.277490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:12.271628+0000","last_clean_scrub_stamp":"2024-09-15T23:12:12.271628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:17:08.108114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T23:12:14.776995+0000","last_change":"2024-09-15T23:12:12.295905+0000","last_active":"2024-09-15T23:12:14.776995+0000","last_peered":"2024-09-15T23:12:14.776995+0000","last_clean":"2024-09-15T23:12:14.776995+0000","last_became_active":"2024-09-15T23:12:12.295619+0000","last_became_peered":"2024-09-15T23:12:12.295619+0000","last_unstale":"2024-09-15T23:12:14.776995+0000","last_undegraded":"2024-09-15T23:12:14.776995+0000","last_fullsized":"2024-09-15T23:12:14.776995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:11.264553+0000","last_clean_scrub_stamp":"2024-09-15T23:12:11.264553+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:11.550515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476745,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":77046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476742,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":229376,"data_stored":78076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476744,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":666902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476744,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":76520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":76588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":76464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":819200,"data_stored":666924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":78748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:12:25.126 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T23:12:25.126 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-15T23:12:25.127 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-15T23:12:25.127 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-15T23:12:25.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.259+0000 7f3788b96640 1 Processor -- start 2024-09-15T23:12:25.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.259+0000 7f3788b96640 1 -- start start 2024-09-15T23:12:25.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.260+0000 7f3788b96640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f378415e6d0 0x7f3784071390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:25.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.260+0000 7f3788b96640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f378406cd20 0x7f37840b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:25.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.260+0000 7f3788b96640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f378415eab0 con 0x7f3784070b80 2024-09-15T23:12:25.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.260+0000 7f3788b96640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f378415ed70 con 0x7f378415e6d0 2024-09-15T23:12:25.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.260+0000 7f3788b96640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f378415f050 con 0x7f378406cd20 2024-09-15T23:12:25.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.260+0000 7f378259c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f378415e6d0 0x7f3784071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:25.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.260+0000 7f377bfff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f378406cd20 0x7f37840b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:25.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.260+0000 7f3782d9d640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f3784070b80 0x7f37840731a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:48972/0 (socket says 172.21.15.123:48972) 2024-09-15T23:12:25.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.260+0000 7f3782d9d640 1 -- 172.21.15.123:0/364275687 learned_addr learned my addr 172.21.15.123:0/364275687 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:25.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.260+0000 7f378259c640 1 -- 172.21.15.123:0/364275687 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f378406cd20 msgr2=0x7f37840b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:25.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.260+0000 7f378259c640 1 --2- 172.21.15.123:0/364275687 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f378406cd20 0x7f37840b6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.260+0000 7f378259c640 1 -- 172.21.15.123:0/364275687 >> v1:172.21.15.188:6789/0 conn(0x7f3784070b80 legacy=0x7f37840731a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:25.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.260+0000 7f378259c640 1 -- 172.21.15.123:0/364275687 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f378415f330 con 0x7f378415e6d0 2024-09-15T23:12:25.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.260+0000 7f377bfff640 1 --2- 172.21.15.123:0/364275687 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f378406cd20 0x7f37840b6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:12:25.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.261+0000 7f378259c640 1 --2- 172.21.15.123:0/364275687 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f378415e6d0 0x7f3784071390 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f37740097a0 tx=0x7f377402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5186399940478d18 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:25.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.261+0000 7f3781d9b640 1 -- 172.21.15.123:0/364275687 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3774037070 con 0x7f378415e6d0 2024-09-15T23:12:25.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.261+0000 7f3781d9b640 1 -- 172.21.15.123:0/364275687 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3774032440 con 0x7f378415e6d0 2024-09-15T23:12:25.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.261+0000 7f3781d9b640 1 -- 172.21.15.123:0/364275687 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3774032810 con 0x7f378415e6d0 2024-09-15T23:12:25.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.262+0000 7f3788b96640 1 -- 172.21.15.123:0/364275687 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f378415e6d0 msgr2=0x7f3784071390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:25.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.262+0000 7f3788b96640 1 --2- 172.21.15.123:0/364275687 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f378415e6d0 0x7f3784071390 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f37740097a0 tx=0x7f377402a180 comp rx=0 tx=0).stop 2024-09-15T23:12:25.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.262+0000 7f3788b96640 1 -- 172.21.15.123:0/364275687 shutdown_connections 2024-09-15T23:12:25.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.262+0000 7f3788b96640 1 --2- 172.21.15.123:0/364275687 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f378406cd20 0x7f37840b6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.262+0000 7f3788b96640 1 --2- 172.21.15.123:0/364275687 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f378415e6d0 0x7f3784071390 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.262+0000 7f3788b96640 1 -- 172.21.15.123:0/364275687 >> 172.21.15.123:0/364275687 conn(0x7f3784067fb0 msgr2=0x7f378406f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:25.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.262+0000 7f3788b96640 1 -- 172.21.15.123:0/364275687 shutdown_connections 2024-09-15T23:12:25.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.262+0000 7f3788b96640 1 -- 172.21.15.123:0/364275687 wait complete. 2024-09-15T23:12:25.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.263+0000 7f3788b96640 1 Processor -- start 2024-09-15T23:12:25.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.263+0000 7f3788b96640 1 -- start start 2024-09-15T23:12:25.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.264+0000 7f3788b96640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f378406cd20 0x7f378414ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:25.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.264+0000 7f3788b96640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3784070b80 0x7f3784149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:25.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.264+0000 7f3788b96640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f378415e6d0 0x7f3784160800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:25.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.264+0000 7f3788b96640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f37840718d0 con 0x7f3784070b80 2024-09-15T23:12:25.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.264+0000 7f3788b96640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f378415f8f0 con 0x7f378415e6d0 2024-09-15T23:12:25.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.264+0000 7f3788b96640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f3784071a50 con 0x7f378406cd20 2024-09-15T23:12:25.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.264+0000 7f377bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3784070b80 0x7f3784149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:25.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.264+0000 7f377bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3784070b80 0x7f3784149dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36572/0 (socket says 172.21.15.123:36572) 2024-09-15T23:12:25.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.264+0000 7f377bfff640 1 -- 172.21.15.123:0/2287983771 learned_addr learned my addr 172.21.15.123:0/2287983771 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:25.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.264+0000 7f3782d9d640 1 --2- 172.21.15.123:0/2287983771 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f378415e6d0 0x7f3784160800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:25.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.264+0000 7f378259c640 1 --2- 172.21.15.123:0/2287983771 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f378406cd20 0x7f378414ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:25.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.264+0000 7f377bfff640 1 -- 172.21.15.123:0/2287983771 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f378406cd20 msgr2=0x7f378414ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:25.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.264+0000 7f377bfff640 1 --2- 172.21.15.123:0/2287983771 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f378406cd20 0x7f378414ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.264+0000 7f377bfff640 1 -- 172.21.15.123:0/2287983771 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f378415e6d0 msgr2=0x7f3784160800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:25.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.264+0000 7f377bfff640 1 --2- 172.21.15.123:0/2287983771 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f378415e6d0 0x7f3784160800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.264+0000 7f377bfff640 1 -- 172.21.15.123:0/2287983771 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f378414e2d0 con 0x7f3784070b80 2024-09-15T23:12:25.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.265+0000 7f377bfff640 1 --2- 172.21.15.123:0/2287983771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3784070b80 0x7f3784149dd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f376c00e980 tx=0x7f376c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:25.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.265+0000 7f377affd640 1 -- 172.21.15.123:0/2287983771 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376c017070 con 0x7f3784070b80 2024-09-15T23:12:25.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.265+0000 7f377affd640 1 -- 172.21.15.123:0/2287983771 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f376c00ca00 con 0x7f3784070b80 2024-09-15T23:12:25.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.265+0000 7f3788b96640 1 -- 172.21.15.123:0/2287983771 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f378414fb40 con 0x7f3784070b80 2024-09-15T23:12:25.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.265+0000 7f377affd640 1 -- 172.21.15.123:0/2287983771 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376c00cdf0 con 0x7f3784070b80 2024-09-15T23:12:25.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.265+0000 7f3788b96640 1 -- 172.21.15.123:0/2287983771 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3784150100 con 0x7f3784070b80 2024-09-15T23:12:25.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.266+0000 7f3788b96640 1 -- 172.21.15.123:0/2287983771 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3784071390 con 0x7f3784070b80 2024-09-15T23:12:25.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.266+0000 7f377affd640 1 -- 172.21.15.123:0/2287983771 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f376c01a070 con 0x7f3784070b80 2024-09-15T23:12:25.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.267+0000 7f377affd640 1 --2- 172.21.15.123:0/2287983771 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f376406c2b0 0x7f376406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:25.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.267+0000 7f377affd640 1 -- 172.21.15.123:0/2287983771 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f376c08b350 con 0x7f3784070b80 2024-09-15T23:12:25.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.267+0000 7f378259c640 1 --2- 172.21.15.123:0/2287983771 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f376406c2b0 0x7f376406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:25.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.267+0000 7f378259c640 1 --2- 172.21.15.123:0/2287983771 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f376406c2b0 0x7f376406e770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3774034000 tx=0x7f377402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:25.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.271+0000 7f377affd640 1 -- 172.21.15.123:0/2287983771 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f376c0593f0 con 0x7f3784070b80 2024-09-15T23:12:25.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.474+0000 7f3788b96640 1 -- 172.21.15.123:0/2287983771 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f37840d2f90 con 0x7f3784070b80 2024-09-15T23:12:25.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.475+0000 7f377affd640 1 -- 172.21.15.123:0/2287983771 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f376c05d6f0 con 0x7f3784070b80 2024-09-15T23:12:25.476 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:25.476 INFO:teuthology.orchestra.run.smithi123.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-15T23:12:25.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.477+0000 7f3788b96640 1 -- 172.21.15.123:0/2287983771 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f376406c2b0 msgr2=0x7f376406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:25.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.477+0000 7f3788b96640 1 --2- 172.21.15.123:0/2287983771 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f376406c2b0 0x7f376406e770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3774034000 tx=0x7f377402e000 comp rx=0 tx=0).stop 2024-09-15T23:12:25.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.477+0000 7f3788b96640 1 -- 172.21.15.123:0/2287983771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3784070b80 msgr2=0x7f3784149dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:25.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.477+0000 7f3788b96640 1 --2- 172.21.15.123:0/2287983771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3784070b80 0x7f3784149dd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f376c00e980 tx=0x7f376c00ee40 comp rx=0 tx=0).stop 2024-09-15T23:12:25.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.477+0000 7f3788b96640 1 -- 172.21.15.123:0/2287983771 shutdown_connections 2024-09-15T23:12:25.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.477+0000 7f3788b96640 1 --2- 172.21.15.123:0/2287983771 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f378415e6d0 0x7f3784160800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.477+0000 7f3788b96640 1 --2- 172.21.15.123:0/2287983771 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f376406c2b0 0x7f376406e770 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.477+0000 7f3788b96640 1 --2- 172.21.15.123:0/2287983771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3784070b80 0x7f3784149dd0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.477+0000 7f3788b96640 1 --2- 172.21.15.123:0/2287983771 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f378406cd20 0x7f378414ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.477+0000 7f3788b96640 1 -- 172.21.15.123:0/2287983771 >> 172.21.15.123:0/2287983771 conn(0x7f3784067fb0 msgr2=0x7f378406d170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:25.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.477+0000 7f3788b96640 1 -- 172.21.15.123:0/2287983771 shutdown_connections 2024-09-15T23:12:25.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.477+0000 7f3788b96640 1 -- 172.21.15.123:0/2287983771 wait complete. 2024-09-15T23:12:25.489 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-15T23:12:25.489 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:12:25.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.586+0000 7fb26e19f640 1 Processor -- start 2024-09-15T23:12:25.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.586+0000 7fb26e19f640 1 -- start start 2024-09-15T23:12:25.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.587+0000 7fb26e19f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb26806cd20 0x7fb2680b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:25.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.587+0000 7fb26e19f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb268070b80 0x7fb2680b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:25.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.587+0000 7fb26e19f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb26815eab0 con 0x7fb26815e6d0 2024-09-15T23:12:25.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.587+0000 7fb26e19f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fb2680b77e0 con 0x7fb26806cd20 2024-09-15T23:12:25.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.587+0000 7fb26e19f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb26815ed70 con 0x7fb268070b80 2024-09-15T23:12:25.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.587+0000 7fb266ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb26806cd20 0x7fb2680b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:25.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.587+0000 7fb266ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb26806cd20 0x7fb2680b6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36588/0 (socket says 172.21.15.123:36588) 2024-09-15T23:12:25.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.587+0000 7fb266ffd640 1 -- 172.21.15.123:0/55276952 learned_addr learned my addr 172.21.15.123:0/55276952 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:25.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.587+0000 7fb267fff640 1 --2- 172.21.15.123:0/55276952 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb268070b80 0x7fb2680b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:25.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.587+0000 7fb266ffd640 1 -- 172.21.15.123:0/55276952 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb268070b80 msgr2=0x7fb2680b72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:25.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.587+0000 7fb266ffd640 1 --2- 172.21.15.123:0/55276952 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb268070b80 0x7fb2680b72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.587+0000 7fb266ffd640 1 -- 172.21.15.123:0/55276952 >> v1:172.21.15.188:6789/0 conn(0x7fb26815e6d0 legacy=0x7fb268071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:25.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.587+0000 7fb266ffd640 1 -- 172.21.15.123:0/55276952 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb26815f050 con 0x7fb26806cd20 2024-09-15T23:12:25.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.588+0000 7fb266ffd640 1 --2- 172.21.15.123:0/55276952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb26806cd20 0x7fb2680b6d60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb25c009870 tx=0x7fb25c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=736cb36dfd3ee670 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:25.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.588+0000 7fb2667fc640 1 -- 172.21.15.123:0/55276952 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25c037070 con 0x7fb26806cd20 2024-09-15T23:12:25.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.588+0000 7fb2667fc640 1 -- 172.21.15.123:0/55276952 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb25c032440 con 0x7fb26806cd20 2024-09-15T23:12:25.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.588+0000 7fb2667fc640 1 -- 172.21.15.123:0/55276952 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25c032810 con 0x7fb26806cd20 2024-09-15T23:12:25.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.588+0000 7fb26e19f640 1 -- 172.21.15.123:0/55276952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb26806cd20 msgr2=0x7fb2680b6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:25.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.588+0000 7fb26e19f640 1 --2- 172.21.15.123:0/55276952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb26806cd20 0x7fb2680b6d60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb25c009870 tx=0x7fb25c02a210 comp rx=0 tx=0).stop 2024-09-15T23:12:25.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.588+0000 7fb26e19f640 1 -- 172.21.15.123:0/55276952 shutdown_connections 2024-09-15T23:12:25.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.589+0000 7fb26e19f640 1 --2- 172.21.15.123:0/55276952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb26806cd20 0x7fb2680b6d60 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.589+0000 7fb26e19f640 1 --2- 172.21.15.123:0/55276952 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb268070b80 0x7fb2680b72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.589+0000 7fb26e19f640 1 -- 172.21.15.123:0/55276952 >> 172.21.15.123:0/55276952 conn(0x7fb268067fb0 msgr2=0x7fb26806f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:25.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.589+0000 7fb26e19f640 1 -- 172.21.15.123:0/55276952 shutdown_connections 2024-09-15T23:12:25.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.589+0000 7fb26e19f640 1 -- 172.21.15.123:0/55276952 wait complete. 2024-09-15T23:12:25.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.590+0000 7fb26e19f640 1 Processor -- start 2024-09-15T23:12:25.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.590+0000 7fb26e19f640 1 -- start start 2024-09-15T23:12:25.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.591+0000 7fb26e19f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb26806cd20 0x7fb26813d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:25.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.591+0000 7fb26e19f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb268070b80 0x7fb2681602d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:25.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.591+0000 7fb26e19f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb26815e6d0 0x7fb268160810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:25.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.591+0000 7fb26e19f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb26815f8f0 con 0x7fb26806cd20 2024-09-15T23:12:25.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.591+0000 7fb26e19f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb26815f610 con 0x7fb26815e6d0 2024-09-15T23:12:25.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.591+0000 7fb26e19f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb2681622a0 con 0x7fb268070b80 2024-09-15T23:12:25.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.591+0000 7fb2677fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb26806cd20 0x7fb26813d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:25.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.591+0000 7fb2677fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb26806cd20 0x7fb26813d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36592/0 (socket says 172.21.15.123:36592) 2024-09-15T23:12:25.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.591+0000 7fb2677fe640 1 -- 172.21.15.123:0/1320076977 learned_addr learned my addr 172.21.15.123:0/1320076977 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:25.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.591+0000 7fb266ffd640 1 --2- 172.21.15.123:0/1320076977 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb268070b80 0x7fb2681602d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:25.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.591+0000 7fb267fff640 1 --2- 172.21.15.123:0/1320076977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb26815e6d0 0x7fb268160810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:25.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.591+0000 7fb2677fe640 1 -- 172.21.15.123:0/1320076977 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb268070b80 msgr2=0x7fb2681602d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:25.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.591+0000 7fb2677fe640 1 --2- 172.21.15.123:0/1320076977 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb268070b80 0x7fb2681602d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.591+0000 7fb2677fe640 1 -- 172.21.15.123:0/1320076977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb26815e6d0 msgr2=0x7fb268160810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:25.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.591+0000 7fb2677fe640 1 --2- 172.21.15.123:0/1320076977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb26815e6d0 0x7fb268160810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.591+0000 7fb2677fe640 1 -- 172.21.15.123:0/1320076977 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb26813d690 con 0x7fb26806cd20 2024-09-15T23:12:25.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.591+0000 7fb2677fe640 1 --2- 172.21.15.123:0/1320076977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb26806cd20 0x7fb26813d150 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb25800b3f0 tx=0x7fb25800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:25.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.591+0000 7fb24ffff640 1 -- 172.21.15.123:0/1320076977 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb258015020 con 0x7fb26806cd20 2024-09-15T23:12:25.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.591+0000 7fb24ffff640 1 -- 172.21.15.123:0/1320076977 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb258011830 con 0x7fb26806cd20 2024-09-15T23:12:25.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.591+0000 7fb26e19f640 1 -- 172.21.15.123:0/1320076977 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb268151050 con 0x7fb26806cd20 2024-09-15T23:12:25.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.591+0000 7fb24ffff640 1 -- 172.21.15.123:0/1320076977 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb258011c20 con 0x7fb26806cd20 2024-09-15T23:12:25.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.591+0000 7fb26e19f640 1 -- 172.21.15.123:0/1320076977 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb268155260 con 0x7fb26806cd20 2024-09-15T23:12:25.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.592+0000 7fb26e19f640 1 -- 172.21.15.123:0/1320076977 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb268071390 con 0x7fb26806cd20 2024-09-15T23:12:25.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.593+0000 7fb24ffff640 1 -- 172.21.15.123:0/1320076977 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb258018020 con 0x7fb26806cd20 2024-09-15T23:12:25.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.593+0000 7fb24ffff640 1 --2- 172.21.15.123:0/1320076977 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb25406c2b0 0x7fb25406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:25.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.593+0000 7fb24ffff640 1 -- 172.21.15.123:0/1320076977 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb25808b1b0 con 0x7fb26806cd20 2024-09-15T23:12:25.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.593+0000 7fb266ffd640 1 --2- 172.21.15.123:0/1320076977 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb25406c2b0 0x7fb25406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:25.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.594+0000 7fb266ffd640 1 --2- 172.21.15.123:0/1320076977 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb25406c2b0 0x7fb25406e770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb25c034000 tx=0x7fb25c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:25.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.597+0000 7fb24ffff640 1 -- 172.21.15.123:0/1320076977 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb25801f020 con 0x7fb26806cd20 2024-09-15T23:12:25.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.792+0000 7fb26e19f640 1 -- 172.21.15.123:0/1320076977 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb2681619d0 con 0x7fb26806cd20 2024-09-15T23:12:25.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.793+0000 7fb24ffff640 1 -- 172.21.15.123:0/1320076977 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5226 (secure 0 0 0) 0x7fb26813d690 con 0x7fb26806cd20 2024-09-15T23:12:25.794 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:25.794 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":6,"btime":"2024-09-15T23:12:15:299077+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2663395388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2663395388},{"type":"v1","addr":"172.21.15.188:6837","nonce":2663395388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2375280105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2375280105},{"type":"v1","addr":"172.21.15.188:6836","nonce":2375280105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/477765723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":477765723},{"type":"v1","addr":"172.21.15.123:6834","nonce":477765723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:12:12.622666+0000","modified":"2024-09-15T23:12:14.622706+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/3721978283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":3721978283},{"type":"v1","addr":"172.21.15.123:6835","nonce":3721978283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-09-15T23:12:25.795 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 6 2024-09-15T23:12:25.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.795+0000 7fb26e19f640 1 -- 172.21.15.123:0/1320076977 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb25406c2b0 msgr2=0x7fb25406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:25.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.795+0000 7fb26e19f640 1 --2- 172.21.15.123:0/1320076977 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb25406c2b0 0x7fb25406e770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb25c034000 tx=0x7fb25c02e000 comp rx=0 tx=0).stop 2024-09-15T23:12:25.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.795+0000 7fb26e19f640 1 -- 172.21.15.123:0/1320076977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb26806cd20 msgr2=0x7fb26813d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:25.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.795+0000 7fb26e19f640 1 --2- 172.21.15.123:0/1320076977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb26806cd20 0x7fb26813d150 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb25800b3f0 tx=0x7fb25800b8b0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.795+0000 7fb26e19f640 1 -- 172.21.15.123:0/1320076977 shutdown_connections 2024-09-15T23:12:25.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.795+0000 7fb26e19f640 1 --2- 172.21.15.123:0/1320076977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb26815e6d0 0x7fb268160810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.795+0000 7fb26e19f640 1 --2- 172.21.15.123:0/1320076977 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb268070b80 0x7fb2681602d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.795+0000 7fb26e19f640 1 --2- 172.21.15.123:0/1320076977 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb25406c2b0 0x7fb25406e770 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.795+0000 7fb26e19f640 1 --2- 172.21.15.123:0/1320076977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb26806cd20 0x7fb26813d150 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.795+0000 7fb26e19f640 1 -- 172.21.15.123:0/1320076977 >> 172.21.15.123:0/1320076977 conn(0x7fb268067fb0 msgr2=0x7fb26806f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:25.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.795+0000 7fb26e19f640 1 -- 172.21.15.123:0/1320076977 shutdown_connections 2024-09-15T23:12:25.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.795+0000 7fb26e19f640 1 -- 172.21.15.123:0/1320076977 wait complete. 2024-09-15T23:12:25.807 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:12:25.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.903+0000 7efe5d16d640 1 Processor -- start 2024-09-15T23:12:25.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.903+0000 7efe5d16d640 1 -- start start 2024-09-15T23:12:25.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.904+0000 7efe5d16d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efe58145860 0x7efe580cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:25.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.904+0000 7efe5d16d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7efe580b6d30 0x7efe5806c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:25.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.904+0000 7efe5d16d640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe580b4a40 con 0x7efe5806bc10 2024-09-15T23:12:25.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.904+0000 7efe5d16d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7efe5806c590 con 0x7efe580b6d30 2024-09-15T23:12:25.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.904+0000 7efe5d16d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7efe580b4d20 con 0x7efe58145860 2024-09-15T23:12:25.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.905+0000 7efe56d9d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efe58145860 0x7efe580cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:25.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.905+0000 7efe5759e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7efe580b6d30 0x7efe5806c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:25.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.905+0000 7efe5659c640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7efe5806bc10 0x7efe5815ff70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:48986/0 (socket says 172.21.15.123:48986) 2024-09-15T23:12:25.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.905+0000 7efe5659c640 1 -- 172.21.15.123:0/2060822562 learned_addr learned my addr 172.21.15.123:0/2060822562 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:25.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.905+0000 7efe56d9d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efe58145860 0x7efe580cea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:41674/0 (socket says 172.21.15.123:41674) 2024-09-15T23:12:25.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.905+0000 7efe56d9d640 1 -- 172.21.15.123:0/2060822562 >> v2:172.21.15.188:3300/0 conn(0x7efe580b6d30 msgr2=0x7efe5806c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:25.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.905+0000 7efe56d9d640 1 --2- 172.21.15.123:0/2060822562 >> v2:172.21.15.188:3300/0 conn(0x7efe580b6d30 0x7efe5806c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.905+0000 7efe56d9d640 1 -- 172.21.15.123:0/2060822562 >> v1:172.21.15.188:6789/0 conn(0x7efe5806bc10 legacy=0x7efe5815ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:25.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.905+0000 7efe56d9d640 1 -- 172.21.15.123:0/2060822562 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe580b5000 con 0x7efe58145860 2024-09-15T23:12:25.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.905+0000 7efe5759e640 1 --2- 172.21.15.123:0/2060822562 >> v2:172.21.15.188:3300/0 conn(0x7efe580b6d30 0x7efe5806c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:12:25.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.906+0000 7efe56d9d640 1 --2- 172.21.15.123:0/2060822562 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efe58145860 0x7efe580cea30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efe500097a0 tx=0x7efe5002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a1919d8437d59a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:25.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.906+0000 7efe55d9b640 1 -- 172.21.15.123:0/2060822562 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe50037070 con 0x7efe58145860 2024-09-15T23:12:25.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.906+0000 7efe55d9b640 1 -- 172.21.15.123:0/2060822562 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe50032440 con 0x7efe58145860 2024-09-15T23:12:25.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.906+0000 7efe55d9b640 1 -- 172.21.15.123:0/2060822562 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe50032810 con 0x7efe58145860 2024-09-15T23:12:25.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.906+0000 7efe5d16d640 1 -- 172.21.15.123:0/2060822562 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efe58145860 msgr2=0x7efe580cea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:25.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.906+0000 7efe5d16d640 1 --2- 172.21.15.123:0/2060822562 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efe58145860 0x7efe580cea30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efe500097a0 tx=0x7efe5002a180 comp rx=0 tx=0).stop 2024-09-15T23:12:25.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.906+0000 7efe5d16d640 1 -- 172.21.15.123:0/2060822562 shutdown_connections 2024-09-15T23:12:25.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.906+0000 7efe5d16d640 1 --2- 172.21.15.123:0/2060822562 >> v2:172.21.15.188:3300/0 conn(0x7efe580b6d30 0x7efe5806c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.906+0000 7efe5d16d640 1 --2- 172.21.15.123:0/2060822562 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efe58145860 0x7efe580cea30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.906+0000 7efe5d16d640 1 -- 172.21.15.123:0/2060822562 >> 172.21.15.123:0/2060822562 conn(0x7efe5806cd20 msgr2=0x7efe5806d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:25.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.906+0000 7efe5d16d640 1 -- 172.21.15.123:0/2060822562 shutdown_connections 2024-09-15T23:12:25.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.906+0000 7efe5d16d640 1 -- 172.21.15.123:0/2060822562 wait complete. 2024-09-15T23:12:25.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.908+0000 7efe5d16d640 1 Processor -- start 2024-09-15T23:12:25.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.908+0000 7efe5d16d640 1 -- start start 2024-09-15T23:12:25.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.908+0000 7efe5d16d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efe5806bc10 0x7efe580afea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:25.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.909+0000 7efe5d16d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efe580b6d30 0x7efe580ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:25.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.909+0000 7efe5d16d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe58145860 0x7efe580cd000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:25.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.909+0000 7efe5d16d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efe58145c40 con 0x7efe58145860 2024-09-15T23:12:25.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.909+0000 7efe5d16d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7efe580b55c0 con 0x7efe5806bc10 2024-09-15T23:12:25.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.909+0000 7efe5d16d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7efe580cef70 con 0x7efe580b6d30 2024-09-15T23:12:25.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.909+0000 7efe5759e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe58145860 0x7efe580cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:25.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.909+0000 7efe5759e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe58145860 0x7efe580cd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36598/0 (socket says 172.21.15.123:36598) 2024-09-15T23:12:25.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.909+0000 7efe5759e640 1 -- 172.21.15.123:0/1192083448 learned_addr learned my addr 172.21.15.123:0/1192083448 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:25.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.909+0000 7efe56d9d640 1 --2- 172.21.15.123:0/1192083448 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efe5806bc10 0x7efe580afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:25.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.909+0000 7efe5659c640 1 --2- 172.21.15.123:0/1192083448 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efe580b6d30 0x7efe580ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:25.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.909+0000 7efe5759e640 1 -- 172.21.15.123:0/1192083448 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efe580b6d30 msgr2=0x7efe580ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:25.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.909+0000 7efe5759e640 1 --2- 172.21.15.123:0/1192083448 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efe580b6d30 0x7efe580ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.909+0000 7efe5759e640 1 -- 172.21.15.123:0/1192083448 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efe5806bc10 msgr2=0x7efe580afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:25.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.909+0000 7efe5759e640 1 --2- 172.21.15.123:0/1192083448 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efe5806bc10 0x7efe580afea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:25.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.909+0000 7efe5759e640 1 -- 172.21.15.123:0/1192083448 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe580b1b60 con 0x7efe58145860 2024-09-15T23:12:25.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.909+0000 7efe5759e640 1 --2- 172.21.15.123:0/1192083448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe58145860 0x7efe580cd000 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efe4800e900 tx=0x7efe4800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:25.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.909+0000 7efe3f7fe640 1 -- 172.21.15.123:0/1192083448 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe48017070 con 0x7efe58145860 2024-09-15T23:12:25.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.909+0000 7efe3f7fe640 1 -- 172.21.15.123:0/1192083448 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe4800ca00 con 0x7efe58145860 2024-09-15T23:12:25.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.909+0000 7efe5d16d640 1 -- 172.21.15.123:0/1192083448 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe580b1e30 con 0x7efe58145860 2024-09-15T23:12:25.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.909+0000 7efe3f7fe640 1 -- 172.21.15.123:0/1192083448 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe4800cdb0 con 0x7efe58145860 2024-09-15T23:12:25.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.909+0000 7efe5d16d640 1 -- 172.21.15.123:0/1192083448 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe580b23f0 con 0x7efe58145860 2024-09-15T23:12:25.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.910+0000 7efe5d16d640 1 -- 172.21.15.123:0/1192083448 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe580b4660 con 0x7efe58145860 2024-09-15T23:12:25.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.911+0000 7efe3f7fe640 1 -- 172.21.15.123:0/1192083448 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7efe4801a070 con 0x7efe58145860 2024-09-15T23:12:25.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.911+0000 7efe3f7fe640 1 --2- 172.21.15.123:0/1192083448 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efe4406c2b0 0x7efe4406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:25.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.911+0000 7efe3f7fe640 1 -- 172.21.15.123:0/1192083448 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7efe4808b2b0 con 0x7efe58145860 2024-09-15T23:12:25.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.911+0000 7efe56d9d640 1 --2- 172.21.15.123:0/1192083448 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efe4406c2b0 0x7efe4406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:25.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.912+0000 7efe56d9d640 1 --2- 172.21.15.123:0/1192083448 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efe4406c2b0 0x7efe4406e770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efe50034000 tx=0x7efe5002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:25.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:25.916+0000 7efe3f7fe640 1 -- 172.21.15.123:0/1192083448 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efe480593d0 con 0x7efe58145860 2024-09-15T23:12:26.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.116+0000 7efe5d16d640 1 -- 172.21.15.123:0/1192083448 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe5815f940 con 0x7efe58145860 2024-09-15T23:12:26.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.117+0000 7efe3f7fe640 1 -- 172.21.15.123:0/1192083448 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5226 (secure 0 0 0) 0x7efe4805d6d0 con 0x7efe58145860 2024-09-15T23:12:26.118 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:26.118 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":6,"btime":"2024-09-15T23:12:15:299077+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2663395388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2663395388},{"type":"v1","addr":"172.21.15.188:6837","nonce":2663395388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2375280105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2375280105},{"type":"v1","addr":"172.21.15.188:6836","nonce":2375280105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/477765723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":477765723},{"type":"v1","addr":"172.21.15.123:6834","nonce":477765723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:12:12.622666+0000","modified":"2024-09-15T23:12:14.622706+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/3721978283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":3721978283},{"type":"v1","addr":"172.21.15.123:6835","nonce":3721978283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-09-15T23:12:26.118 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 6 2024-09-15T23:12:26.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.119+0000 7efe5d16d640 1 -- 172.21.15.123:0/1192083448 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efe4406c2b0 msgr2=0x7efe4406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:26.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.119+0000 7efe5d16d640 1 --2- 172.21.15.123:0/1192083448 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efe4406c2b0 0x7efe4406e770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efe50034000 tx=0x7efe5002e000 comp rx=0 tx=0).stop 2024-09-15T23:12:26.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.119+0000 7efe5d16d640 1 -- 172.21.15.123:0/1192083448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe58145860 msgr2=0x7efe580cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:26.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.119+0000 7efe5d16d640 1 --2- 172.21.15.123:0/1192083448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe58145860 0x7efe580cd000 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efe4800e900 tx=0x7efe4800edc0 comp rx=0 tx=0).stop 2024-09-15T23:12:26.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.119+0000 7efe5d16d640 1 -- 172.21.15.123:0/1192083448 shutdown_connections 2024-09-15T23:12:26.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.119+0000 7efe5d16d640 1 --2- 172.21.15.123:0/1192083448 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efe4406c2b0 0x7efe4406e770 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:26.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.119+0000 7efe5d16d640 1 --2- 172.21.15.123:0/1192083448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe58145860 0x7efe580cd000 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:26.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.119+0000 7efe5d16d640 1 --2- 172.21.15.123:0/1192083448 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efe580b6d30 0x7efe580ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:26.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.119+0000 7efe5d16d640 1 --2- 172.21.15.123:0/1192083448 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efe5806bc10 0x7efe580afea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:26.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.119+0000 7efe5d16d640 1 -- 172.21.15.123:0/1192083448 >> 172.21.15.123:0/1192083448 conn(0x7efe5806cd20 msgr2=0x7efe58074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:26.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.119+0000 7efe5d16d640 1 -- 172.21.15.123:0/1192083448 shutdown_connections 2024-09-15T23:12:26.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.119+0000 7efe5d16d640 1 -- 172.21.15.123:0/1192083448 wait complete. 2024-09-15T23:12:26.131 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:12:26.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.227+0000 7f403f39f640 1 Processor -- start 2024-09-15T23:12:26.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.227+0000 7f403f39f640 1 -- start start 2024-09-15T23:12:26.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.228+0000 7f403f39f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f403815e6d0 0x7f4038071390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:26.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.228+0000 7f403f39f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f403806cd20 0x7f40380b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:26.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.228+0000 7f403f39f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4038070b80 0x7f40380b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:26.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.228+0000 7f403f39f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f40380b77e0 con 0x7f403815e6d0 2024-09-15T23:12:26.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.228+0000 7f403f39f640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f403815eab0 con 0x7f4038070b80 2024-09-15T23:12:26.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.228+0000 7f403f39f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f403815ed70 con 0x7f403806cd20 2024-09-15T23:12:26.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.228+0000 7f403d13b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f403815e6d0 0x7f4038071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:26.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.228+0000 7f403d13b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f403815e6d0 0x7f4038071390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48220/0 (socket says 172.21.15.123:48220) 2024-09-15T23:12:26.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.228+0000 7f403d13b640 1 -- 172.21.15.123:0/3778805049 learned_addr learned my addr 172.21.15.123:0/3778805049 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:26.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.228+0000 7f403d93c640 1 --2- 172.21.15.123:0/3778805049 >> v2:172.21.15.188:3300/0 conn(0x7f4038070b80 0x7f40380b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:26.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.228+0000 7f403c93a640 1 --2- 172.21.15.123:0/3778805049 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f403806cd20 0x7f40380b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:26.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.229+0000 7f403d13b640 1 -- 172.21.15.123:0/3778805049 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f403806cd20 msgr2=0x7f40380b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:26.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.229+0000 7f403d13b640 1 --2- 172.21.15.123:0/3778805049 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f403806cd20 0x7f40380b6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:26.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.229+0000 7f403d13b640 1 -- 172.21.15.123:0/3778805049 >> v2:172.21.15.188:3300/0 conn(0x7f4038070b80 msgr2=0x7f40380b72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:26.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.229+0000 7f403d13b640 1 --2- 172.21.15.123:0/3778805049 >> v2:172.21.15.188:3300/0 conn(0x7f4038070b80 0x7f40380b72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:26.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.229+0000 7f403d13b640 1 -- 172.21.15.123:0/3778805049 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f403815f050 con 0x7f403815e6d0 2024-09-15T23:12:26.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.229+0000 7f403d93c640 1 --2- 172.21.15.123:0/3778805049 >> v2:172.21.15.188:3300/0 conn(0x7f4038070b80 0x7f40380b72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:26.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.229+0000 7f403d13b640 1 --2- 172.21.15.123:0/3778805049 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f403815e6d0 0x7f4038071390 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4038070420 tx=0x7f403402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e904a9c33e3b9c85 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:26.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.229+0000 7f402ffff640 1 -- 172.21.15.123:0/3778805049 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4034037070 con 0x7f403815e6d0 2024-09-15T23:12:26.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.229+0000 7f402ffff640 1 -- 172.21.15.123:0/3778805049 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4034032440 con 0x7f403815e6d0 2024-09-15T23:12:26.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.229+0000 7f402ffff640 1 -- 172.21.15.123:0/3778805049 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4034032810 con 0x7f403815e6d0 2024-09-15T23:12:26.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.230+0000 7f403f39f640 1 -- 172.21.15.123:0/3778805049 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f403815e6d0 msgr2=0x7f4038071390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:26.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.230+0000 7f403f39f640 1 --2- 172.21.15.123:0/3778805049 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f403815e6d0 0x7f4038071390 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4038070420 tx=0x7f403402a1e0 comp rx=0 tx=0).stop 2024-09-15T23:12:26.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.230+0000 7f403f39f640 1 -- 172.21.15.123:0/3778805049 shutdown_connections 2024-09-15T23:12:26.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.230+0000 7f403f39f640 1 --2- 172.21.15.123:0/3778805049 >> v2:172.21.15.188:3300/0 conn(0x7f4038070b80 0x7f40380b72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:26.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.230+0000 7f403f39f640 1 --2- 172.21.15.123:0/3778805049 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f403806cd20 0x7f40380b6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:26.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.230+0000 7f403f39f640 1 --2- 172.21.15.123:0/3778805049 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f403815e6d0 0x7f4038071390 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:26.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.230+0000 7f403f39f640 1 -- 172.21.15.123:0/3778805049 >> 172.21.15.123:0/3778805049 conn(0x7f4038067fb0 msgr2=0x7f403806f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:26.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.230+0000 7f403f39f640 1 -- 172.21.15.123:0/3778805049 shutdown_connections 2024-09-15T23:12:26.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.230+0000 7f403f39f640 1 -- 172.21.15.123:0/3778805049 wait complete. 2024-09-15T23:12:26.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.231+0000 7f403f39f640 1 Processor -- start 2024-09-15T23:12:26.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.231+0000 7f403f39f640 1 -- start start 2024-09-15T23:12:26.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.232+0000 7f403f39f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f403806cd20 0x7f40380afaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:26.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.232+0000 7f403f39f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4038070b80 0x7f40380b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:26.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.232+0000 7f403f39f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f403815e6d0 0x7f40381539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:26.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.232+0000 7f403f39f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f403815f8f0 con 0x7f4038070b80 2024-09-15T23:12:26.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.232+0000 7f403f39f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f403815f610 con 0x7f403806cd20 2024-09-15T23:12:26.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.232+0000 7f403f39f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f40380718d0 con 0x7f403815e6d0 2024-09-15T23:12:26.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.232+0000 7f403c93a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4038070b80 0x7f40380b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:26.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.232+0000 7f403c93a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4038070b80 0x7f40380b0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48224/0 (socket says 172.21.15.123:48224) 2024-09-15T23:12:26.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.232+0000 7f403c93a640 1 -- 172.21.15.123:0/1167839824 learned_addr learned my addr 172.21.15.123:0/1167839824 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:26.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.232+0000 7f403d93c640 1 --2- 172.21.15.123:0/1167839824 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f403815e6d0 0x7f40381539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:26.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.232+0000 7f403d13b640 1 --2- 172.21.15.123:0/1167839824 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f403806cd20 0x7f40380afaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:26.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.232+0000 7f403c93a640 1 -- 172.21.15.123:0/1167839824 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f403815e6d0 msgr2=0x7f40381539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:26.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.232+0000 7f403c93a640 1 --2- 172.21.15.123:0/1167839824 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f403815e6d0 0x7f40381539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:26.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.232+0000 7f403c93a640 1 -- 172.21.15.123:0/1167839824 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f403806cd20 msgr2=0x7f40380afaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:26.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.232+0000 7f403c93a640 1 --2- 172.21.15.123:0/1167839824 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f403806cd20 0x7f40380afaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:26.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.232+0000 7f403c93a640 1 -- 172.21.15.123:0/1167839824 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40380b1040 con 0x7f4038070b80 2024-09-15T23:12:26.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.232+0000 7f403d93c640 1 --2- 172.21.15.123:0/1167839824 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f403815e6d0 0x7f40381539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:26.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.232+0000 7f403c93a640 1 --2- 172.21.15.123:0/1167839824 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4038070b80 0x7f40380b0b00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f402800d5a0 tx=0x7f402800da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:26.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.233+0000 7f402dffb640 1 -- 172.21.15.123:0/1167839824 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4028018020 con 0x7f4038070b80 2024-09-15T23:12:26.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.233+0000 7f402dffb640 1 -- 172.21.15.123:0/1167839824 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4028014620 con 0x7f4038070b80 2024-09-15T23:12:26.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.233+0000 7f403f39f640 1 -- 172.21.15.123:0/1167839824 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40380b12f0 con 0x7f4038070b80 2024-09-15T23:12:26.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.233+0000 7f402dffb640 1 -- 172.21.15.123:0/1167839824 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40280149f0 con 0x7f4038070b80 2024-09-15T23:12:26.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.233+0000 7f403f39f640 1 -- 172.21.15.123:0/1167839824 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40380cc180 con 0x7f4038070b80 2024-09-15T23:12:26.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.234+0000 7f403f39f640 1 -- 172.21.15.123:0/1167839824 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4038071390 con 0x7f4038070b80 2024-09-15T23:12:26.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.234+0000 7f402dffb640 1 -- 172.21.15.123:0/1167839824 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f402801b020 con 0x7f4038070b80 2024-09-15T23:12:26.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.235+0000 7f402dffb640 1 --2- 172.21.15.123:0/1167839824 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f401c06c2b0 0x7f401c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:26.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.235+0000 7f402dffb640 1 -- 172.21.15.123:0/1167839824 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f402808b7c0 con 0x7f4038070b80 2024-09-15T23:12:26.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.235+0000 7f403d13b640 1 --2- 172.21.15.123:0/1167839824 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f401c06c2b0 0x7f401c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:26.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.235+0000 7f403d13b640 1 --2- 172.21.15.123:0/1167839824 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f401c06c2b0 0x7f401c06e770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4034034000 tx=0x7f403402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:26.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.239+0000 7f402dffb640 1 -- 172.21.15.123:0/1167839824 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4028022020 con 0x7f4038070b80 2024-09-15T23:12:26.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.404+0000 7f403f39f640 1 -- 172.21.15.123:0/1167839824 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f40380cbbe0 con 0x7f4038070b80 2024-09-15T23:12:26.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.405+0000 7f402dffb640 1 -- 172.21.15.123:0/1167839824 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16693 (secure 0 0 0) 0x7f4028059f30 con 0x7f4038070b80 2024-09-15T23:12:26.407 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:26.407 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":22,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:12:14.277829+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:12:10.289254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:12:11.594152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:12:26.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.408+0000 7f403f39f640 1 -- 172.21.15.123:0/1167839824 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f401c06c2b0 msgr2=0x7f401c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:26.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.408+0000 7f403f39f640 1 --2- 172.21.15.123:0/1167839824 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f401c06c2b0 0x7f401c06e770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4034034000 tx=0x7f403402e000 comp rx=0 tx=0).stop 2024-09-15T23:12:26.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.408+0000 7f403f39f640 1 -- 172.21.15.123:0/1167839824 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4038070b80 msgr2=0x7f40380b0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:26.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.408+0000 7f403f39f640 1 --2- 172.21.15.123:0/1167839824 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4038070b80 0x7f40380b0b00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f402800d5a0 tx=0x7f402800da60 comp rx=0 tx=0).stop 2024-09-15T23:12:26.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.408+0000 7f403f39f640 1 -- 172.21.15.123:0/1167839824 shutdown_connections 2024-09-15T23:12:26.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.408+0000 7f403f39f640 1 --2- 172.21.15.123:0/1167839824 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f403815e6d0 0x7f40381539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:26.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.408+0000 7f403f39f640 1 --2- 172.21.15.123:0/1167839824 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f401c06c2b0 0x7f401c06e770 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:26.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.408+0000 7f403f39f640 1 --2- 172.21.15.123:0/1167839824 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4038070b80 0x7f40380b0b00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:26.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.408+0000 7f403f39f640 1 --2- 172.21.15.123:0/1167839824 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f403806cd20 0x7f40380afaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:26.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.408+0000 7f403f39f640 1 -- 172.21.15.123:0/1167839824 >> 172.21.15.123:0/1167839824 conn(0x7f4038067fb0 msgr2=0x7f403806f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:26.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.408+0000 7f403f39f640 1 -- 172.21.15.123:0/1167839824 shutdown_connections 2024-09-15T23:12:26.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.408+0000 7f403f39f640 1 -- 172.21.15.123:0/1167839824 wait complete. 2024-09-15T23:12:26.420 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:12:26.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.517+0000 7fa93e427640 1 Processor -- start 2024-09-15T23:12:26.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.517+0000 7fa93e427640 1 -- start start 2024-09-15T23:12:26.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.517+0000 7fa93e427640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa93815c4f0 0x7fa93815d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:26.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.517+0000 7fa93e427640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa9380d0200 0x7fa9380d0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:26.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.517+0000 7fa93e427640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa938073400 con 0x7fa938160100 2024-09-15T23:12:26.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.517+0000 7fa93e427640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fa9380d0b80 con 0x7fa9380d0200 2024-09-15T23:12:26.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.518+0000 7fa93e427640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa9380736e0 con 0x7fa93815c4f0 2024-09-15T23:12:26.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.518+0000 7fa9377fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa9380d0200 0x7fa9380d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:26.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.518+0000 7fa9377fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa9380d0200 0x7fa9380d0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48232/0 (socket says 172.21.15.123:48232) 2024-09-15T23:12:26.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.518+0000 7fa9377fe640 1 -- 172.21.15.123:0/887426966 learned_addr learned my addr 172.21.15.123:0/887426966 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:26.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.518+0000 7fa937fff640 1 --2- 172.21.15.123:0/887426966 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa93815c4f0 0x7fa93815d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:26.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.518+0000 7fa9377fe640 1 -- 172.21.15.123:0/887426966 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa93815c4f0 msgr2=0x7fa93815d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:26.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.518+0000 7fa9377fe640 1 --2- 172.21.15.123:0/887426966 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa93815c4f0 0x7fa93815d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:26.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.518+0000 7fa9377fe640 1 -- 172.21.15.123:0/887426966 >> v1:172.21.15.188:6789/0 conn(0x7fa938160100 legacy=0x7fa938160530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:26.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.518+0000 7fa9377fe640 1 -- 172.21.15.123:0/887426966 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9380739c0 con 0x7fa9380d0200 2024-09-15T23:12:26.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.519+0000 7fa9377fe640 1 --2- 172.21.15.123:0/887426966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9380d0200 0x7fa9380d0640 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa92c009870 tx=0x7fa92c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2027b5769d56bc09 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:26.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.519+0000 7fa936ffd640 1 -- 172.21.15.123:0/887426966 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa92c037070 con 0x7fa9380d0200 2024-09-15T23:12:26.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.519+0000 7fa936ffd640 1 -- 172.21.15.123:0/887426966 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa92c032440 con 0x7fa9380d0200 2024-09-15T23:12:26.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.519+0000 7fa936ffd640 1 -- 172.21.15.123:0/887426966 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa92c032810 con 0x7fa9380d0200 2024-09-15T23:12:26.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.519+0000 7fa93e427640 1 -- 172.21.15.123:0/887426966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9380d0200 msgr2=0x7fa9380d0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:26.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.519+0000 7fa93e427640 1 --2- 172.21.15.123:0/887426966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9380d0200 0x7fa9380d0640 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa92c009870 tx=0x7fa92c02a270 comp rx=0 tx=0).stop 2024-09-15T23:12:26.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.519+0000 7fa93e427640 1 -- 172.21.15.123:0/887426966 shutdown_connections 2024-09-15T23:12:26.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.519+0000 7fa93e427640 1 --2- 172.21.15.123:0/887426966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9380d0200 0x7fa9380d0640 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:26.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.519+0000 7fa93e427640 1 --2- 172.21.15.123:0/887426966 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa93815c4f0 0x7fa93815d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:26.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.519+0000 7fa93e427640 1 -- 172.21.15.123:0/887426966 >> 172.21.15.123:0/887426966 conn(0x7fa93806f400 msgr2=0x7fa93806f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:26.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.519+0000 7fa93e427640 1 -- 172.21.15.123:0/887426966 shutdown_connections 2024-09-15T23:12:26.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.519+0000 7fa93e427640 1 -- 172.21.15.123:0/887426966 wait complete. 2024-09-15T23:12:26.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.520+0000 7fa93e427640 1 Processor -- start 2024-09-15T23:12:26.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.521+0000 7fa93e427640 1 -- start start 2024-09-15T23:12:26.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.521+0000 7fa93e427640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa9380d0200 0x7fa93814da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:26.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.521+0000 7fa93e427640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa93815c4f0 0x7fa9380cb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:26.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.521+0000 7fa93e427640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa938160100 0x7fa9380b6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:26.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.521+0000 7fa93e427640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa9380d0fa0 con 0x7fa93815c4f0 2024-09-15T23:12:26.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.521+0000 7fa93e427640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa938073f80 con 0x7fa938160100 2024-09-15T23:12:26.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.521+0000 7fa93e427640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa93815c8d0 con 0x7fa9380d0200 2024-09-15T23:12:26.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.521+0000 7fa9377fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa93815c4f0 0x7fa9380cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:26.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.522+0000 7fa9377fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa93815c4f0 0x7fa9380cb590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48236/0 (socket says 172.21.15.123:48236) 2024-09-15T23:12:26.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.522+0000 7fa9377fe640 1 -- 172.21.15.123:0/124081946 learned_addr learned my addr 172.21.15.123:0/124081946 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:26.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.522+0000 7fa937fff640 1 --2- 172.21.15.123:0/124081946 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa9380d0200 0x7fa93814da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:26.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.522+0000 7fa93c9c4640 1 --2- 172.21.15.123:0/124081946 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa938160100 0x7fa9380b6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:26.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.522+0000 7fa9377fe640 1 -- 172.21.15.123:0/124081946 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa9380d0200 msgr2=0x7fa93814da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:26.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.522+0000 7fa9377fe640 1 --2- 172.21.15.123:0/124081946 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa9380d0200 0x7fa93814da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:26.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.522+0000 7fa9377fe640 1 -- 172.21.15.123:0/124081946 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa938160100 msgr2=0x7fa9380b6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:26.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.522+0000 7fa9377fe640 1 --2- 172.21.15.123:0/124081946 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa938160100 0x7fa9380b6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:26.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.522+0000 7fa9377fe640 1 -- 172.21.15.123:0/124081946 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9380ab1f0 con 0x7fa93815c4f0 2024-09-15T23:12:26.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.522+0000 7fa937fff640 1 --2- 172.21.15.123:0/124081946 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa9380d0200 0x7fa93814da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:26.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.522+0000 7fa93c9c4640 1 --2- 172.21.15.123:0/124081946 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa938160100 0x7fa9380b6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:26.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.522+0000 7fa9377fe640 1 --2- 172.21.15.123:0/124081946 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa93815c4f0 0x7fa9380cb590 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa92c000c00 tx=0x7fa92c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:26.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.522+0000 7fa934ff9640 1 -- 172.21.15.123:0/124081946 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa92c041020 con 0x7fa93815c4f0 2024-09-15T23:12:26.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.522+0000 7fa934ff9640 1 -- 172.21.15.123:0/124081946 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa92c0306c0 con 0x7fa93815c4f0 2024-09-15T23:12:26.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.522+0000 7fa934ff9640 1 -- 172.21.15.123:0/124081946 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa92c037040 con 0x7fa93815c4f0 2024-09-15T23:12:26.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.522+0000 7fa93e427640 1 -- 172.21.15.123:0/124081946 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9380ab4d0 con 0x7fa93815c4f0 2024-09-15T23:12:26.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.522+0000 7fa93e427640 1 -- 172.21.15.123:0/124081946 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9380aba90 con 0x7fa93815c4f0 2024-09-15T23:12:26.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.523+0000 7fa93e427640 1 -- 172.21.15.123:0/124081946 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa938073080 con 0x7fa93815c4f0 2024-09-15T23:12:26.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.523+0000 7fa934ff9640 1 -- 172.21.15.123:0/124081946 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa92c044020 con 0x7fa93815c4f0 2024-09-15T23:12:26.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.524+0000 7fa934ff9640 1 --2- 172.21.15.123:0/124081946 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa92406c2b0 0x7fa92406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:26.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.524+0000 7fa934ff9640 1 -- 172.21.15.123:0/124081946 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fa92c0abc30 con 0x7fa93815c4f0 2024-09-15T23:12:26.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.524+0000 7fa937fff640 1 --2- 172.21.15.123:0/124081946 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa92406c2b0 0x7fa92406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:26.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.525+0000 7fa937fff640 1 --2- 172.21.15.123:0/124081946 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa92406c2b0 0x7fa92406e770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa928006fd0 tx=0x7fa928008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:26.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.528+0000 7fa934ff9640 1 -- 172.21.15.123:0/124081946 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa92c04b030 con 0x7fa93815c4f0 2024-09-15T23:12:26.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.726+0000 7fa93e427640 1 -- 172.21.15.123:0/124081946 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa9380cdfa0 con 0x7fa93815c4f0 2024-09-15T23:12:26.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.726+0000 7fa934ff9640 1 -- 172.21.15.123:0/124081946 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5226 (secure 0 0 0) 0x7fa92c07a3a0 con 0x7fa93815c4f0 2024-09-15T23:12:26.727 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:26.728 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":6,"btime":"2024-09-15T23:12:15:299077+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2663395388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2663395388},{"type":"v1","addr":"172.21.15.188:6837","nonce":2663395388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2375280105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2375280105},{"type":"v1","addr":"172.21.15.188:6836","nonce":2375280105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/477765723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":477765723},{"type":"v1","addr":"172.21.15.123:6834","nonce":477765723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:12:12.622666+0000","modified":"2024-09-15T23:12:14.622706+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/3721978283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":3721978283},{"type":"v1","addr":"172.21.15.123:6835","nonce":3721978283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-09-15T23:12:26.728 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 6 2024-09-15T23:12:26.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.728+0000 7fa93e427640 1 -- 172.21.15.123:0/124081946 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa92406c2b0 msgr2=0x7fa92406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:26.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.728+0000 7fa93e427640 1 --2- 172.21.15.123:0/124081946 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa92406c2b0 0x7fa92406e770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa928006fd0 tx=0x7fa928008040 comp rx=0 tx=0).stop 2024-09-15T23:12:26.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.728+0000 7fa93e427640 1 -- 172.21.15.123:0/124081946 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa93815c4f0 msgr2=0x7fa9380cb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:26.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.728+0000 7fa93e427640 1 --2- 172.21.15.123:0/124081946 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa93815c4f0 0x7fa9380cb590 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa92c000c00 tx=0x7fa92c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:12:26.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.728+0000 7fa93e427640 1 -- 172.21.15.123:0/124081946 shutdown_connections 2024-09-15T23:12:26.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.728+0000 7fa93e427640 1 --2- 172.21.15.123:0/124081946 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa938160100 0x7fa9380b6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:26.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.728+0000 7fa93e427640 1 --2- 172.21.15.123:0/124081946 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa92406c2b0 0x7fa92406e770 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:26.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.728+0000 7fa93e427640 1 --2- 172.21.15.123:0/124081946 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa93815c4f0 0x7fa9380cb590 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:26.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.728+0000 7fa93e427640 1 --2- 172.21.15.123:0/124081946 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa9380d0200 0x7fa93814da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:26.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.728+0000 7fa93e427640 1 -- 172.21.15.123:0/124081946 >> 172.21.15.123:0/124081946 conn(0x7fa93806f400 msgr2=0x7fa938160510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:26.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.728+0000 7fa93e427640 1 -- 172.21.15.123:0/124081946 shutdown_connections 2024-09-15T23:12:26.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:26.728+0000 7fa93e427640 1 -- 172.21.15.123:0/124081946 wait complete. 2024-09-15T23:12:27.143 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:12:12.622666+0000', 'modified': '2024-09-15T23:12:14.622706+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4290}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4290': {'gid': 4290, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.123:6835/3721978283', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6833', 'nonce': 3721978283}, {'type': 'v1', 'addr': '172.21.15.123:6835', 'nonce': 3721978283}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4290, 'qdb_cluster': [4290]} 2024-09-15T23:12:27.143 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:12:27.143 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-15T23:12:27.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.243+0000 7fe2fef6f640 1 Processor -- start 2024-09-15T23:12:27.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.243+0000 7fe2fef6f640 1 -- start start 2024-09-15T23:12:27.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.244+0000 7fe2fef6f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe2f80d2c30 0x7fe2f8160a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:27.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.244+0000 7fe2fef6f640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2f8071b60 con 0x7fe2f815c420 2024-09-15T23:12:27.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.244+0000 7fe2fef6f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2f80b1e20 con 0x7fe2f80b1990 2024-09-15T23:12:27.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.244+0000 7fe2fef6f640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fe2f80d04c0 con 0x7fe2f80d2c30 2024-09-15T23:12:27.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.244+0000 7fe2fcd0b640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe2f815c420 0x7fe2f80d2520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:48062/0 (socket says 172.21.15.123:48062) 2024-09-15T23:12:27.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.244+0000 7fe2fcd0b640 1 -- 172.21.15.123:0/1477595129 learned_addr learned my addr 172.21.15.123:0/1477595129 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:27.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.244+0000 7fe2f7fff640 1 --2- 172.21.15.123:0/1477595129 >> v2:172.21.15.188:3300/0 conn(0x7fe2f80d2c30 0x7fe2f8160a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:27.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.244+0000 7fe2f77fe640 1 -- 172.21.15.123:0/1477595129 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3027568566 0 0) 0x7fe2f8071b60 con 0x7fe2f815c420 2024-09-15T23:12:27.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.244+0000 7fe2f77fe640 1 -- 172.21.15.123:0/1477595129 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2e8003520 con 0x7fe2f815c420 2024-09-15T23:12:27.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.244+0000 7fe2f77fe640 1 -- 172.21.15.123:0/1477595129 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1954281895 0 0) 0x7fe2e8003520 con 0x7fe2f815c420 2024-09-15T23:12:27.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.244+0000 7fe2f77fe640 1 -- 172.21.15.123:0/1477595129 >> v2:172.21.15.188:3300/0 conn(0x7fe2f80d2c30 msgr2=0x7fe2f8160a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:27.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.244+0000 7fe2f77fe640 1 --2- 172.21.15.123:0/1477595129 >> v2:172.21.15.188:3300/0 conn(0x7fe2f80d2c30 0x7fe2f8160a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.244+0000 7fe2f77fe640 1 -- 172.21.15.123:0/1477595129 >> v1:172.21.15.188:6789/0 conn(0x7fe2f80b1990 legacy=0x7fe2f80d0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:27.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.244+0000 7fe2f77fe640 1 -- 172.21.15.123:0/1477595129 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f80715a0 con 0x7fe2f815c420 2024-09-15T23:12:27.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.244+0000 7fe2f77fe640 1 -- 172.21.15.123:0/1477595129 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fe2ec001670 con 0x7fe2f815c420 2024-09-15T23:12:27.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.244+0000 7fe2f77fe640 1 -- 172.21.15.123:0/1477595129 >> v1:172.21.15.123:6789/0 conn(0x7fe2f815c420 legacy=0x7fe2f80d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:27.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.244+0000 7fe2f77fe640 1 --2- 172.21.15.123:0/1477595129 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe2e80039b0 0x7fe2e8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:27.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.244+0000 7fe2f77fe640 1 --2- 172.21.15.123:0/1477595129 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe2e8004800 0x7fe2e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:27.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.245+0000 7fe2f77fe640 1 --2- 172.21.15.123:0/1477595129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2e80052e0 0x7fe2e800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:27.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.245+0000 7fe2f77fe640 1 -- 172.21.15.123:0/1477595129 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f80d04c0 con 0x7fe2e80052e0 2024-09-15T23:12:27.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.245+0000 7fe2f77fe640 1 -- 172.21.15.123:0/1477595129 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e800c1b0 con 0x7fe2e80039b0 2024-09-15T23:12:27.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.245+0000 7fe2f77fe640 1 -- 172.21.15.123:0/1477595129 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe2e800c3b0 con 0x7fe2e8004800 2024-09-15T23:12:27.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.245+0000 7fe2fd50c640 1 --2- 172.21.15.123:0/1477595129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2e80052e0 0x7fe2e800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:27.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.245+0000 7fe2fcd0b640 1 --2- 172.21.15.123:0/1477595129 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe2e80039b0 0x7fe2e8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:27.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.245+0000 7fe2f7fff640 1 --2- 172.21.15.123:0/1477595129 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe2e8004800 0x7fe2e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:27.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.245+0000 7fe2fd50c640 1 -- 172.21.15.123:0/1477595129 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe2e8004800 msgr2=0x7fe2e8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:27.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.245+0000 7fe2fd50c640 1 --2- 172.21.15.123:0/1477595129 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe2e8004800 0x7fe2e8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.245+0000 7fe2fd50c640 1 -- 172.21.15.123:0/1477595129 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe2e80039b0 msgr2=0x7fe2e8003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:27.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.245+0000 7fe2fd50c640 1 --2- 172.21.15.123:0/1477595129 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe2e80039b0 0x7fe2e8003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.245+0000 7fe2fd50c640 1 -- 172.21.15.123:0/1477595129 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e8003520 con 0x7fe2e80052e0 2024-09-15T23:12:27.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.245+0000 7fe2f7fff640 1 --2- 172.21.15.123:0/1477595129 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe2e8004800 0x7fe2e8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:27.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.245+0000 7fe2fd50c640 1 -- 172.21.15.123:0/1477595129 reap_dead start 2024-09-15T23:12:27.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.246+0000 7fe2fd50c640 1 --2- 172.21.15.123:0/1477595129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2e80052e0 0x7fe2e800b9c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0001e50 tx=0x7fe2e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f1fa0840e4a509 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:27.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.246+0000 7fe2f77fe640 1 -- 172.21.15.123:0/1477595129 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f0001a70 con 0x7fe2e80052e0 2024-09-15T23:12:27.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.246+0000 7fe2f77fe640 1 -- 172.21.15.123:0/1477595129 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2f0003970 con 0x7fe2e80052e0 2024-09-15T23:12:27.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.246+0000 7fe2f77fe640 1 -- 172.21.15.123:0/1477595129 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f0003d60 con 0x7fe2e80052e0 2024-09-15T23:12:27.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.246+0000 7fe2fef6f640 1 -- 172.21.15.123:0/1477595129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2e80052e0 msgr2=0x7fe2e800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:27.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.246+0000 7fe2fef6f640 1 --2- 172.21.15.123:0/1477595129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2e80052e0 0x7fe2e800b9c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0001e50 tx=0x7fe2e8005830 comp rx=0 tx=0).stop 2024-09-15T23:12:27.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.246+0000 7fe2fef6f640 1 -- 172.21.15.123:0/1477595129 shutdown_connections 2024-09-15T23:12:27.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.246+0000 7fe2fef6f640 1 --2- 172.21.15.123:0/1477595129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2e80052e0 0x7fe2e800b9c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.246+0000 7fe2fef6f640 1 -- 172.21.15.123:0/1477595129 >> 172.21.15.123:0/1477595129 conn(0x7fe2f8067fb0 msgr2=0x7fe2f806f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:27.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.246+0000 7fe2fef6f640 1 -- 172.21.15.123:0/1477595129 shutdown_connections 2024-09-15T23:12:27.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.246+0000 7fe2fef6f640 1 -- 172.21.15.123:0/1477595129 wait complete. 2024-09-15T23:12:27.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.247+0000 7fe2fef6f640 1 Processor -- start 2024-09-15T23:12:27.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.247+0000 7fe2fef6f640 1 -- start start 2024-09-15T23:12:27.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.248+0000 7fe2fef6f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2e80052e0 0x7fe2f814cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:27.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.248+0000 7fe2fef6f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe2f8159d20 0x7fe2f814f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:27.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.248+0000 7fe2fef6f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe2f815a1a0 0x7fe2f814f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:27.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.248+0000 7fe2fef6f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f8160a40 con 0x7fe2e80052e0 2024-09-15T23:12:27.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.248+0000 7fe2fef6f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f815c800 con 0x7fe2f8159d20 2024-09-15T23:12:27.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.248+0000 7fe2fef6f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe2f8160bc0 con 0x7fe2f815a1a0 2024-09-15T23:12:27.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.248+0000 7fe2fcd0b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2e80052e0 0x7fe2f814cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:27.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.248+0000 7fe2fcd0b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2e80052e0 0x7fe2f814cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48254/0 (socket says 172.21.15.123:48254) 2024-09-15T23:12:27.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.248+0000 7fe2fcd0b640 1 -- 172.21.15.123:0/2550731379 learned_addr learned my addr 172.21.15.123:0/2550731379 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:27.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.249+0000 7fe2fcd0b640 1 -- 172.21.15.123:0/2550731379 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe2f815a1a0 msgr2=0x7fe2f814f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:27.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.249+0000 7fe2fcd0b640 1 --2- 172.21.15.123:0/2550731379 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe2f815a1a0 0x7fe2f814f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.249+0000 7fe2fcd0b640 1 -- 172.21.15.123:0/2550731379 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe2f8159d20 msgr2=0x7fe2f814f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:27.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.249+0000 7fe2fcd0b640 1 --2- 172.21.15.123:0/2550731379 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe2f8159d20 0x7fe2f814f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.249+0000 7fe2fcd0b640 1 -- 172.21.15.123:0/2550731379 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f814e910 con 0x7fe2e80052e0 2024-09-15T23:12:27.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.249+0000 7fe2fcd0b640 1 --2- 172.21.15.123:0/2550731379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2e80052e0 0x7fe2f814cce0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0072c0 tx=0x7fe2ec007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:27.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.249+0000 7fe2f57fa640 1 -- 172.21.15.123:0/2550731379 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec00f8e0 con 0x7fe2e80052e0 2024-09-15T23:12:27.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.249+0000 7fe2f57fa640 1 -- 172.21.15.123:0/2550731379 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2ec018070 con 0x7fe2e80052e0 2024-09-15T23:12:27.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.249+0000 7fe2f57fa640 1 -- 172.21.15.123:0/2550731379 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec00fce0 con 0x7fe2e80052e0 2024-09-15T23:12:27.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.249+0000 7fe2fef6f640 1 -- 172.21.15.123:0/2550731379 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2f815a700 con 0x7fe2e80052e0 2024-09-15T23:12:27.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.249+0000 7fe2fef6f640 1 -- 172.21.15.123:0/2550731379 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2f815acc0 con 0x7fe2e80052e0 2024-09-15T23:12:27.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.250+0000 7fe2f57fa640 1 -- 172.21.15.123:0/2550731379 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe2ec01d460 con 0x7fe2e80052e0 2024-09-15T23:12:27.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.251+0000 7fe2f57fa640 1 --2- 172.21.15.123:0/2550731379 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe2dc06c2e0 0x7fe2dc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:27.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.251+0000 7fe2f57fa640 1 -- 172.21.15.123:0/2550731379 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe2ec08b420 con 0x7fe2e80052e0 2024-09-15T23:12:27.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.251+0000 7fe2f7fff640 1 --2- 172.21.15.123:0/2550731379 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe2dc06c2e0 0x7fe2dc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:27.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.251+0000 7fe2f7fff640 1 --2- 172.21.15.123:0/2550731379 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe2dc06c2e0 0x7fe2dc06e7a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe2f815b140 tx=0x7fe2e4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:27.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.252+0000 7fe301de1740 1 Processor -- start 2024-09-15T23:12:27.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.252+0000 7fe301de1740 1 -- start start 2024-09-15T23:12:27.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.252+0000 7fe301de1740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5608e903c2c0 0x5608e9081a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:27.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.252+0000 7fe301de1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5608e9039a80 0x5608e903c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:27.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.252+0000 7fe301de1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608e903da50 0x5608e90368b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:27.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.252+0000 7fe301de1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5608e8f9e520 con 0x5608e903da50 2024-09-15T23:12:27.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.252+0000 7fe301de1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5608e8f463e0 con 0x5608e9039a80 2024-09-15T23:12:27.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.252+0000 7fe301de1740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5608e8f9a4e0 con 0x5608e903c2c0 2024-09-15T23:12:27.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.253+0000 7fe2fd50c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608e903da50 0x5608e90368b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:27.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.253+0000 7fe2fd50c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608e903da50 0x5608e90368b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48260/0 (socket says 172.21.15.123:48260) 2024-09-15T23:12:27.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.253+0000 7fe2fd50c640 1 -- 172.21.15.123:0/2572894587 learned_addr learned my addr 172.21.15.123:0/2572894587 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:27.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.253+0000 7fe2f7fff640 1 --2- 172.21.15.123:0/2572894587 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5608e9039a80 0x5608e903c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:27.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.253+0000 7fe2fcd0b640 1 --2- 172.21.15.123:0/2572894587 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5608e903c2c0 0x5608e9081a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:27.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.253+0000 7fe2fd50c640 1 -- 172.21.15.123:0/2572894587 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5608e903c2c0 msgr2=0x5608e9081a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:27.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.253+0000 7fe2fd50c640 1 --2- 172.21.15.123:0/2572894587 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5608e903c2c0 0x5608e9081a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.253+0000 7fe2fd50c640 1 -- 172.21.15.123:0/2572894587 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5608e9039a80 msgr2=0x5608e903c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:27.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.253+0000 7fe2fd50c640 1 --2- 172.21.15.123:0/2572894587 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5608e9039a80 0x5608e903c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.253+0000 7fe2fd50c640 1 -- 172.21.15.123:0/2572894587 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608e8f612f0 con 0x5608e903da50 2024-09-15T23:12:27.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.253+0000 7fe2fd50c640 1 --2- 172.21.15.123:0/2572894587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608e903da50 0x5608e90368b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0001f40 tx=0x7fe2f002c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b73ec61c1788613f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:27.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.253+0000 7fe2e27fc640 1 -- 172.21.15.123:0/2572894587 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f0001a70 con 0x5608e903da50 2024-09-15T23:12:27.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.253+0000 7fe2e27fc640 1 -- 172.21.15.123:0/2572894587 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2f0006b50 con 0x5608e903da50 2024-09-15T23:12:27.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.253+0000 7fe2e27fc640 1 -- 172.21.15.123:0/2572894587 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f0003970 con 0x5608e903da50 2024-09-15T23:12:27.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.254+0000 7fe301de1740 1 -- 172.21.15.123:0/2572894587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608e903da50 msgr2=0x5608e90368b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:27.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.254+0000 7fe301de1740 1 --2- 172.21.15.123:0/2572894587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608e903da50 0x5608e90368b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0001f40 tx=0x7fe2f002c070 comp rx=0 tx=0).stop 2024-09-15T23:12:27.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.254+0000 7fe301de1740 1 -- 172.21.15.123:0/2572894587 shutdown_connections 2024-09-15T23:12:27.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.254+0000 7fe301de1740 1 --2- 172.21.15.123:0/2572894587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608e903da50 0x5608e90368b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.254+0000 7fe301de1740 1 --2- 172.21.15.123:0/2572894587 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5608e9039a80 0x5608e903c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.254+0000 7fe301de1740 1 --2- 172.21.15.123:0/2572894587 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5608e903c2c0 0x5608e9081a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.254+0000 7fe301de1740 1 -- 172.21.15.123:0/2572894587 >> 172.21.15.123:0/2572894587 conn(0x5608e9038a80 msgr2=0x5608e9080f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:27.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.254+0000 7fe301de1740 1 -- 172.21.15.123:0/2572894587 shutdown_connections 2024-09-15T23:12:27.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.254+0000 7fe301de1740 1 -- 172.21.15.123:0/2572894587 wait complete. 2024-09-15T23:12:27.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.254+0000 7fe301de1740 1 -- start start 2024-09-15T23:12:27.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.255+0000 7fe301de1740 1 Processor -- start 2024-09-15T23:12:27.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.255+0000 7fe301de1740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5608e903c2c0 0x5608e9036d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:27.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.255+0000 7fe301de1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5608e903da50 0x5608e905c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:27.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.255+0000 7fe301de1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608e905d2e0 0x5608e903a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:27.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.255+0000 7fe301de1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5608e9037f20 con 0x5608e905d2e0 2024-09-15T23:12:27.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.255+0000 7fe301de1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5608e8f27450 con 0x5608e903da50 2024-09-15T23:12:27.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.255+0000 7fe301de1740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5608e9082290 con 0x5608e903c2c0 2024-09-15T23:12:27.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.255+0000 7fe301de1740 10 client.0 _ll_register_callbacks cb 0x5608e8cb0ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:12:27.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.255+0000 7fe2fd50c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608e905d2e0 0x5608e903a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:27.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.255+0000 7fe2fd50c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608e905d2e0 0x5608e903a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48264/0 (socket says 172.21.15.123:48264) 2024-09-15T23:12:27.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.255+0000 7fe2fd50c640 1 -- 172.21.15.123:0/2254669106 learned_addr learned my addr 172.21.15.123:0/2254669106 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:27.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.255+0000 7fe2f7fff640 1 --2- 172.21.15.123:0/2254669106 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5608e903da50 0x5608e905c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:27.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.255+0000 7fe2fcd0b640 1 --2- 172.21.15.123:0/2254669106 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5608e903c2c0 0x5608e9036d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:27.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.256+0000 7fe2fd50c640 1 -- 172.21.15.123:0/2254669106 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5608e903c2c0 msgr2=0x5608e9036d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:27.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.256+0000 7fe2fd50c640 1 --2- 172.21.15.123:0/2254669106 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5608e903c2c0 0x5608e9036d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.256+0000 7fe2fd50c640 1 -- 172.21.15.123:0/2254669106 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5608e903da50 msgr2=0x5608e905c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:27.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.256+0000 7fe2fd50c640 1 --2- 172.21.15.123:0/2254669106 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5608e903da50 0x5608e905c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.256+0000 7fe2fd50c640 1 -- 172.21.15.123:0/2254669106 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608e8cb12d0 con 0x5608e905d2e0 2024-09-15T23:12:27.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.256+0000 7fe2fd50c640 1 --2- 172.21.15.123:0/2254669106 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608e905d2e0 0x5608e903a9c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0005040 tx=0x7fe2f0001510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c45c577203902c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:27.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.256+0000 7fe2d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:12:27.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.256+0000 7fe2d77fe640 1 -- 172.21.15.123:0/2254669106 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f0006d00 con 0x5608e905d2e0 2024-09-15T23:12:27.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.256+0000 7fe2d77fe640 1 -- 172.21.15.123:0/2254669106 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe2f0039040 con 0x5608e905d2e0 2024-09-15T23:12:27.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.256+0000 7fe301de1740 1 -- 172.21.15.123:0/2254669106 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2f0006b50 con 0x5608e905d2e0 2024-09-15T23:12:27.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.256+0000 7fe2d77fe640 1 -- 172.21.15.123:0/2254669106 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fe2f004d050 con 0x5608e905d2e0 2024-09-15T23:12:27.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.256+0000 7fe301de1740 10 client.4599 fetch_fsmap learned FSMap version 6 2024-09-15T23:12:27.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.256+0000 7fe301de1740 1 -- 172.21.15.123:0/2254669106 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x5608e8d7b6b0 con 0x5608e905d2e0 2024-09-15T23:12:27.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.256+0000 7fe2d77fe640 1 -- 172.21.15.123:0/2254669106 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2f0006b50 con 0x5608e905d2e0 2024-09-15T23:12:27.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.256+0000 7fe2d77fe640 1 -- 172.21.15.123:0/2254669106 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7fe2f0050020 con 0x5608e905d2e0 2024-09-15T23:12:27.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.256+0000 7fe301de1740 10 client.4599 fetch_fsmap finished waiting for FSMap version 6 2024-09-15T23:12:27.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.256+0000 7fe301de1740 10 client.4599 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T23:12:27.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.256+0000 7fe301de1740 20 client.4599 populate_metadata read hostname 'smithi123' 2024-09-15T23:12:27.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.256+0000 7fe301de1740 1 --2- 172.21.15.123:0/2254669106 >> [v2:172.21.15.123:6833/3721978283,v1:172.21.15.123:6835/3721978283] conn(0x5608e90357d0 0x5608e9035bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:27.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.256+0000 7fe301de1740 4 client.4599 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:12:27.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.256+0000 7fe301de1740 1 -- 172.21.15.123:0/2254669106 --> [v2:172.21.15.123:6833/3721978283,v1:172.21.15.123:6835/3721978283] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608e8fabc50 con 0x5608e90357d0 2024-09-15T23:12:27.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.257+0000 7fe2fcd0b640 1 --2- 172.21.15.123:0/2254669106 >> [v2:172.21.15.123:6833/3721978283,v1:172.21.15.123:6835/3721978283] conn(0x5608e90357d0 0x5608e9035bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:27.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.257+0000 7fe2d77fe640 10 client.4599 ms_handle_connect on v2:172.21.15.123:6833/3721978283 2024-09-15T23:12:27.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.257+0000 7fe2fcd0b640 1 --2- 172.21.15.123:0/2254669106 >> [v2:172.21.15.123:6833/3721978283,v1:172.21.15.123:6835/3721978283] conn(0x5608e90357d0 0x5608e9035bb0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16806ba538352713 server_cookie=7c5e7d564d754652 in_seq=0 out_seq=0 2024-09-15T23:12:27.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.257+0000 7fe2d77fe640 1 -- 172.21.15.123:0/2254669106 <== mds.0 v2:172.21.15.123:6833/3721978283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5608e8fabc50 con 0x5608e90357d0 2024-09-15T23:12:27.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.257+0000 7fe2d77fe640 10 client.4599 handle_command_reply: tid=0 2024-09-15T23:12:27.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.257+0000 7fe301de1740 1 client.4599 shutdown 2024-09-15T23:12:27.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.258+0000 7fe301de1740 1 -- 172.21.15.123:0/2254669106 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608e905d2e0 msgr2=0x5608e903a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:27.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.258+0000 7fe301de1740 1 --2- 172.21.15.123:0/2254669106 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608e905d2e0 0x5608e903a9c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0005040 tx=0x7fe2f0001510 comp rx=0 tx=0).stop 2024-09-15T23:12:27.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.258+0000 7fe301de1740 1 -- 172.21.15.123:0/2254669106 shutdown_connections 2024-09-15T23:12:27.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.258+0000 7fe301de1740 1 --2- 172.21.15.123:0/2254669106 >> [v2:172.21.15.123:6833/3721978283,v1:172.21.15.123:6835/3721978283] conn(0x5608e90357d0 0x5608e9035bb0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.258+0000 7fe301de1740 1 --2- 172.21.15.123:0/2254669106 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608e905d2e0 0x5608e903a9c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.258+0000 7fe2d77fe640 0 client.4599 ms_handle_reset on v2:172.21.15.123:6833/3721978283 2024-09-15T23:12:27.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.258+0000 7fe301de1740 1 --2- 172.21.15.123:0/2254669106 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5608e903da50 0x5608e905c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.258+0000 7fe301de1740 1 --2- 172.21.15.123:0/2254669106 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5608e903c2c0 0x5608e9036d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.258+0000 7fe301de1740 1 -- 172.21.15.123:0/2254669106 >> 172.21.15.123:0/2254669106 conn(0x5608e9039a80 msgr2=0x5608e907eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:27.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.258+0000 7fe301de1740 1 -- 172.21.15.123:0/2254669106 shutdown_connections 2024-09-15T23:12:27.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.258+0000 7fe301de1740 1 -- 172.21.15.123:0/2254669106 wait complete. 2024-09-15T23:12:27.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.258+0000 7fe301de1740 20 client.4599 trim_cache size 0 max 16384 2024-09-15T23:12:27.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.275+0000 7fe301de1740 1 Processor -- start 2024-09-15T23:12:27.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.275+0000 7fe301de1740 1 -- start start 2024-09-15T23:12:27.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.276+0000 7fe301de1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608e903c2c0 0x5608e9093610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:27.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.276+0000 7fe301de1740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5608e903da50 0x5608e9093b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:27.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.276+0000 7fe301de1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5608e905d2e0 0x5608e907fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:27.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.276+0000 7fe301de1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f81fe090 con 0x5608e903c2c0 2024-09-15T23:12:27.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.276+0000 7fe301de1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f8154640 con 0x5608e905d2e0 2024-09-15T23:12:27.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.276+0000 7fe301de1740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe2f81fdaa0 con 0x5608e903da50 2024-09-15T23:12:27.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.276+0000 7fe2fcd0b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608e903c2c0 0x5608e9093610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:27.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.276+0000 7fe2fcd0b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608e903c2c0 0x5608e9093610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48280/0 (socket says 172.21.15.123:48280) 2024-09-15T23:12:27.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.276+0000 7fe2fcd0b640 1 -- 172.21.15.123:0/4280107287 learned_addr learned my addr 172.21.15.123:0/4280107287 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:27.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.276+0000 7fe2f7fff640 1 --2- 172.21.15.123:0/4280107287 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5608e903da50 0x5608e9093b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:27.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.276+0000 7fe2fd50c640 1 --2- 172.21.15.123:0/4280107287 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5608e905d2e0 0x5608e907fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:27.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.276+0000 7fe2fcd0b640 1 -- 172.21.15.123:0/4280107287 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5608e903da50 msgr2=0x5608e9093b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:27.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.276+0000 7fe2fcd0b640 1 --2- 172.21.15.123:0/4280107287 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5608e903da50 0x5608e9093b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.276+0000 7fe2fcd0b640 1 -- 172.21.15.123:0/4280107287 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5608e905d2e0 msgr2=0x5608e907fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:27.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.276+0000 7fe2fcd0b640 1 --2- 172.21.15.123:0/4280107287 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5608e905d2e0 0x5608e907fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.276+0000 7fe2fcd0b640 1 -- 172.21.15.123:0/4280107287 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608e903b930 con 0x5608e903c2c0 2024-09-15T23:12:27.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.276+0000 7fe2f7fff640 1 --2- 172.21.15.123:0/4280107287 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5608e903da50 0x5608e9093b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:27.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.276+0000 7fe2fd50c640 1 --2- 172.21.15.123:0/4280107287 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5608e905d2e0 0x5608e907fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:27.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.276+0000 7fe2fcd0b640 1 --2- 172.21.15.123:0/4280107287 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608e903c2c0 0x5608e9093610 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec00f5a0 tx=0x7fe2ec055920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf6b49cc7bfae7e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:27.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.277+0000 7fe2e1ffb640 1 -- 172.21.15.123:0/4280107287 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec076070 con 0x5608e903c2c0 2024-09-15T23:12:27.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.277+0000 7fe2e1ffb640 1 -- 172.21.15.123:0/4280107287 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2ec062130 con 0x5608e903c2c0 2024-09-15T23:12:27.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.277+0000 7fe2e1ffb640 1 -- 172.21.15.123:0/4280107287 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec057850 con 0x5608e903c2c0 2024-09-15T23:12:27.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.277+0000 7fe301de1740 1 -- 172.21.15.123:0/4280107287 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608e903c2c0 msgr2=0x5608e9093610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:27.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.277+0000 7fe301de1740 1 --2- 172.21.15.123:0/4280107287 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608e903c2c0 0x5608e9093610 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec00f5a0 tx=0x7fe2ec055920 comp rx=0 tx=0).stop 2024-09-15T23:12:27.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.277+0000 7fe301de1740 1 -- 172.21.15.123:0/4280107287 shutdown_connections 2024-09-15T23:12:27.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.277+0000 7fe301de1740 1 --2- 172.21.15.123:0/4280107287 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5608e905d2e0 0x5608e907fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.277+0000 7fe301de1740 1 --2- 172.21.15.123:0/4280107287 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5608e903da50 0x5608e9093b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.277+0000 7fe301de1740 1 --2- 172.21.15.123:0/4280107287 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608e903c2c0 0x5608e9093610 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.277+0000 7fe301de1740 1 -- 172.21.15.123:0/4280107287 >> 172.21.15.123:0/4280107287 conn(0x5608e9039a80 msgr2=0x5608e905a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:27.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.277+0000 7fe301de1740 1 -- 172.21.15.123:0/4280107287 shutdown_connections 2024-09-15T23:12:27.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.277+0000 7fe301de1740 1 -- 172.21.15.123:0/4280107287 wait complete. 2024-09-15T23:12:27.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.278+0000 7fe301de1740 1 -- start start 2024-09-15T23:12:27.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.278+0000 7fe301de1740 1 Processor -- start 2024-09-15T23:12:27.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.279+0000 7fe301de1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5608e903c2c0 0x5608e90e43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:27.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.279+0000 7fe301de1740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5608e903da50 0x5608e9061610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:27.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.279+0000 7fe301de1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608e905d2e0 0x5608e9061b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:27.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.279+0000 7fe301de1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5608e907bee0 con 0x5608e905d2e0 2024-09-15T23:12:27.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.279+0000 7fe301de1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5608e9037f20 con 0x5608e903c2c0 2024-09-15T23:12:27.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.279+0000 7fe301de1740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5608e90646f0 con 0x5608e903da50 2024-09-15T23:12:27.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.279+0000 7fe301de1740 10 client.0 _ll_register_callbacks cb 0x7fe2e4009500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:12:27.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.279+0000 7fe2fd50c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608e905d2e0 0x5608e9061b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:27.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.279+0000 7fe2fd50c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608e905d2e0 0x5608e9061b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48282/0 (socket says 172.21.15.123:48282) 2024-09-15T23:12:27.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.279+0000 7fe2fcd0b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5608e903c2c0 0x5608e90e43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:27.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.279+0000 7fe2fd50c640 1 -- 172.21.15.123:0/2912263961 learned_addr learned my addr 172.21.15.123:0/2912263961 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:27.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.279+0000 7fe2f7fff640 1 --2- 172.21.15.123:0/2912263961 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5608e903da50 0x5608e9061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:27.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.279+0000 7fe2fd50c640 1 -- 172.21.15.123:0/2912263961 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5608e903da50 msgr2=0x5608e9061610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:27.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.279+0000 7fe2fd50c640 1 --2- 172.21.15.123:0/2912263961 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5608e903da50 0x5608e9061610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.279+0000 7fe2fd50c640 1 -- 172.21.15.123:0/2912263961 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5608e903c2c0 msgr2=0x5608e90e43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:27.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.279+0000 7fe2fd50c640 1 --2- 172.21.15.123:0/2912263961 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5608e903c2c0 0x5608e90e43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.279+0000 7fe2fd50c640 1 -- 172.21.15.123:0/2912263961 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608e905adc0 con 0x5608e905d2e0 2024-09-15T23:12:27.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.279+0000 7fe2fd50c640 1 --2- 172.21.15.123:0/2912263961 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608e905d2e0 0x5608e9061b50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0000f80 tx=0x7fe2f002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4be162a444d927f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:27.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.279+0000 7fe2d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:12:27.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.279+0000 7fe2d77fe640 1 -- 172.21.15.123:0/2912263961 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f0056060 con 0x5608e905d2e0 2024-09-15T23:12:27.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.279+0000 7fe2d77fe640 1 -- 172.21.15.123:0/2912263961 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe2f0039070 con 0x5608e905d2e0 2024-09-15T23:12:27.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.279+0000 7fe301de1740 1 -- 172.21.15.123:0/2912263961 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2ec062130 con 0x5608e905d2e0 2024-09-15T23:12:27.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.280+0000 7fe2d77fe640 1 -- 172.21.15.123:0/2912263961 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fe2f005c050 con 0x5608e905d2e0 2024-09-15T23:12:27.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.280+0000 7fe301de1740 10 client.4605 fetch_fsmap learned FSMap version 6 2024-09-15T23:12:27.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.280+0000 7fe301de1740 1 -- 172.21.15.123:0/2912263961 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x5608e90e4970 con 0x5608e905d2e0 2024-09-15T23:12:27.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.280+0000 7fe2d77fe640 1 -- 172.21.15.123:0/2912263961 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2ec062130 con 0x5608e905d2e0 2024-09-15T23:12:27.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.280+0000 7fe2d77fe640 1 -- 172.21.15.123:0/2912263961 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7fe2f0050040 con 0x5608e905d2e0 2024-09-15T23:12:27.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.280+0000 7fe301de1740 10 client.4605 fetch_fsmap finished waiting for FSMap version 6 2024-09-15T23:12:27.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.280+0000 7fe301de1740 10 client.4605 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T23:12:27.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.280+0000 7fe301de1740 20 client.4605 populate_metadata read hostname 'smithi123' 2024-09-15T23:12:27.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.280+0000 7fe301de1740 1 --2- 172.21.15.123:0/2912263961 >> [v2:172.21.15.123:6833/3721978283,v1:172.21.15.123:6835/3721978283] conn(0x5608e90600b0 0x5608e9101e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:27.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.280+0000 7fe301de1740 4 client.4605 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:12:27.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.280+0000 7fe301de1740 1 -- 172.21.15.123:0/2912263961 --> [v2:172.21.15.123:6833/3721978283,v1:172.21.15.123:6835/3721978283] -- command(tid 0: {"prefix": "status"}) -- 0x5608e8fa5fa0 con 0x5608e90600b0 2024-09-15T23:12:27.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.280+0000 7fe2fcd0b640 1 --2- 172.21.15.123:0/2912263961 >> [v2:172.21.15.123:6833/3721978283,v1:172.21.15.123:6835/3721978283] conn(0x5608e90600b0 0x5608e9101e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:27.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.280+0000 7fe2d77fe640 10 client.4605 ms_handle_connect on v2:172.21.15.123:6833/3721978283 2024-09-15T23:12:27.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.280+0000 7fe2fcd0b640 1 --2- 172.21.15.123:0/2912263961 >> [v2:172.21.15.123:6833/3721978283,v1:172.21.15.123:6835/3721978283] conn(0x5608e90600b0 0x5608e9101e70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=174f0d6c30ba4a6 server_cookie=80e861792d0f67bf in_seq=0 out_seq=0 2024-09-15T23:12:27.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.280+0000 7fe2d77fe640 1 -- 172.21.15.123:0/2912263961 <== mds.0 v2:172.21.15.123:6833/3721978283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x5608e8fa5fa0 con 0x5608e90600b0 2024-09-15T23:12:27.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.280+0000 7fe2d77fe640 10 client.4605 handle_command_reply: tid=0 2024-09-15T23:12:27.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.280+0000 7fe301de1740 1 client.4605 shutdown 2024-09-15T23:12:27.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.280+0000 7fe301de1740 1 -- 172.21.15.123:0/2912263961 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608e905d2e0 msgr2=0x5608e9061b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:27.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.280+0000 7fe301de1740 1 --2- 172.21.15.123:0/2912263961 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608e905d2e0 0x5608e9061b50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0000f80 tx=0x7fe2f002c000 comp rx=0 tx=0).stop 2024-09-15T23:12:27.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.281+0000 7fe301de1740 1 -- 172.21.15.123:0/2912263961 shutdown_connections 2024-09-15T23:12:27.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.281+0000 7fe301de1740 1 --2- 172.21.15.123:0/2912263961 >> [v2:172.21.15.123:6833/3721978283,v1:172.21.15.123:6835/3721978283] conn(0x5608e90600b0 0x5608e9101e70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.281+0000 7fe301de1740 1 --2- 172.21.15.123:0/2912263961 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5608e905d2e0 0x5608e9061b50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.281+0000 7fe301de1740 1 --2- 172.21.15.123:0/2912263961 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5608e903da50 0x5608e9061610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.281+0000 7fe301de1740 1 --2- 172.21.15.123:0/2912263961 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5608e903c2c0 0x5608e90e43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.281+0000 7fe301de1740 1 -- 172.21.15.123:0/2912263961 >> 172.21.15.123:0/2912263961 conn(0x5608e9039a80 msgr2=0x5608e9093ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:27.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.281+0000 7fe2d77fe640 0 client.4605 ms_handle_reset on v2:172.21.15.123:6833/3721978283 2024-09-15T23:12:27.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.281+0000 7fe301de1740 1 -- 172.21.15.123:0/2912263961 shutdown_connections 2024-09-15T23:12:27.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.281+0000 7fe301de1740 1 -- 172.21.15.123:0/2912263961 wait complete. 2024-09-15T23:12:27.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.281+0000 7fe301de1740 20 client.4605 trim_cache size 0 max 16384 2024-09-15T23:12:27.290 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:12:27.290 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "cb968ac4-8d3a-4b17-a673-6177aeaea589", 2024-09-15T23:12:27.290 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2024-09-15T23:12:27.290 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 4290, 2024-09-15T23:12:27.290 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-09-15T23:12:27.290 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-09-15T23:12:27.290 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-09-15T23:12:27.290 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 14.004152766000001, 2024-09-15T23:12:27.290 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 6, 2024-09-15T23:12:27.290 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 22, 2024-09-15T23:12:27.290 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 22, 2024-09-15T23:12:27.291 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 20.182535236 2024-09-15T23:12:27.291 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:12:27.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.281+0000 7fe2fef6f640 1 -- 172.21.15.123:0/2550731379 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe2dc06c2e0 msgr2=0x7fe2dc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:27.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.281+0000 7fe2fef6f640 1 --2- 172.21.15.123:0/2550731379 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe2dc06c2e0 0x7fe2dc06e7a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe2f815b140 tx=0x7fe2e4008040 comp rx=0 tx=0).stop 2024-09-15T23:12:27.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.281+0000 7fe2fef6f640 1 -- 172.21.15.123:0/2550731379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2e80052e0 msgr2=0x7fe2f814cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:27.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.281+0000 7fe2fef6f640 1 --2- 172.21.15.123:0/2550731379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2e80052e0 0x7fe2f814cce0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0072c0 tx=0x7fe2ec007780 comp rx=0 tx=0).stop 2024-09-15T23:12:27.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.281+0000 7fe2fef6f640 1 -- 172.21.15.123:0/2550731379 shutdown_connections 2024-09-15T23:12:27.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.281+0000 7fe2fef6f640 1 --2- 172.21.15.123:0/2550731379 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe2f815a1a0 0x7fe2f814f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.281+0000 7fe2fef6f640 1 --2- 172.21.15.123:0/2550731379 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe2f8159d20 0x7fe2f814f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.281+0000 7fe2fef6f640 1 --2- 172.21.15.123:0/2550731379 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe2dc06c2e0 0x7fe2dc06e7a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.281+0000 7fe2fef6f640 1 --2- 172.21.15.123:0/2550731379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2e80052e0 0x7fe2f814cce0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.281+0000 7fe2fef6f640 1 -- 172.21.15.123:0/2550731379 >> 172.21.15.123:0/2550731379 conn(0x7fe2f8067fb0 msgr2=0x7fe2f80b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:27.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.281+0000 7fe2fef6f640 1 -- 172.21.15.123:0/2550731379 shutdown_connections 2024-09-15T23:12:27.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.281+0000 7fe2fef6f640 1 -- 172.21.15.123:0/2550731379 wait complete. 2024-09-15T23:12:27.294 INFO:teuthology.run_tasks:Running task sequential... 2024-09-15T23:12:27.305 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-15T23:12:27.305 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-15T23:12:27.305 INFO:teuthology.task.print:Enabling mgr modules 2024-09-15T23:12:27.306 INFO:teuthology.run_tasks:Running task kclient... 2024-09-15T23:12:27.335 INFO:tasks.kclient:Mounting kernel clients... 2024-09-15T23:12:27.335 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-15T23:12:27.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:27.336 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-09-15T23:12:27.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:27.352 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link delete ceph-brx 2024-09-15T23:12:27.418 INFO:teuthology.orchestra.run.smithi123.stderr:Cannot find device "ceph-brx" 2024-09-15T23:12:27.419 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:12:27.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:27.420 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-09-15T23:12:27.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:27.476 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link delete ceph-brx 2024-09-15T23:12:27.541 INFO:teuthology.orchestra.run.smithi123.stderr:Cannot find device "ceph-brx" 2024-09-15T23:12:27.542 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:12:27.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:27.543 DEBUG:teuthology.orchestra.run.smithi188:> ip netns list 2024-09-15T23:12:27.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:27.562 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link delete ceph-brx 2024-09-15T23:12:27.635 INFO:teuthology.orchestra.run.smithi188.stderr:Cannot find device "ceph-brx" 2024-09-15T23:12:27.636 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:12:27.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:27.637 DEBUG:teuthology.orchestra.run.smithi188:> ip netns list 2024-09-15T23:12:27.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:27.694 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link delete ceph-brx 2024-09-15T23:12:27.763 INFO:teuthology.orchestra.run.smithi188.stderr:Cannot find device "ceph-brx" 2024-09-15T23:12:27.764 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:12:27.765 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-15T23:12:27.765 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T23:12:27.765 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T23:12:27.765 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:12:27.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.861+0000 7f11ba2b7640 1 Processor -- start 2024-09-15T23:12:27.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.861+0000 7f11ba2b7640 1 -- start start 2024-09-15T23:12:27.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.862+0000 7f11ba2b7640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f11b415e960 0x7f11b40d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:27.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.862+0000 7f11ba2b7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f11b40d0840 0x7f11b40cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:27.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.862+0000 7f11ba2b7640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11b406d080 con 0x7f11b40cc700 2024-09-15T23:12:27.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.862+0000 7f11ba2b7640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f11b406d360 con 0x7f11b415e960 2024-09-15T23:12:27.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.862+0000 7f11ba2b7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f11b406d640 con 0x7f11b40d0840 2024-09-15T23:12:27.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.863+0000 7f11b37fe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f11b40d0840 0x7f11b40cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:27.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.863+0000 7f11b3fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f11b415e960 0x7f11b40d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:27.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.863+0000 7f11b37fe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f11b40d0840 0x7f11b40cc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:44642/0 (socket says 172.21.15.123:44642) 2024-09-15T23:12:27.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.863+0000 7f11b37fe640 1 -- 172.21.15.123:0/1892652691 learned_addr learned my addr 172.21.15.123:0/1892652691 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:27.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.863+0000 7f11b37fe640 1 -- 172.21.15.123:0/1892652691 >> v2:172.21.15.188:3300/0 conn(0x7f11b415e960 msgr2=0x7f11b40d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:27.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.863+0000 7f11b37fe640 1 --2- 172.21.15.123:0/1892652691 >> v2:172.21.15.188:3300/0 conn(0x7f11b415e960 0x7f11b40d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.863+0000 7f11b37fe640 1 -- 172.21.15.123:0/1892652691 >> v1:172.21.15.188:6789/0 conn(0x7f11b40cc700 legacy=0x7f11b40cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:27.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.863+0000 7f11b37fe640 1 -- 172.21.15.123:0/1892652691 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11b406d920 con 0x7f11b40d0840 2024-09-15T23:12:27.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.864+0000 7f11b37fe640 1 --2- 172.21.15.123:0/1892652691 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f11b40d0840 0x7f11b40cc1c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009870 tx=0x7f11a802a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e05d08f8767f37f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:27.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.864+0000 7f11b2ffd640 1 -- 172.21.15.123:0/1892652691 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a8037070 con 0x7f11b40d0840 2024-09-15T23:12:27.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.864+0000 7f11b2ffd640 1 -- 172.21.15.123:0/1892652691 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11a8032440 con 0x7f11b40d0840 2024-09-15T23:12:27.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.864+0000 7f11b2ffd640 1 -- 172.21.15.123:0/1892652691 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a8032810 con 0x7f11b40d0840 2024-09-15T23:12:27.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.865+0000 7f11ba2b7640 1 -- 172.21.15.123:0/1892652691 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f11b40d0840 msgr2=0x7f11b40cc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:27.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.865+0000 7f11ba2b7640 1 --2- 172.21.15.123:0/1892652691 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f11b40d0840 0x7f11b40cc1c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009870 tx=0x7f11a802a1c0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.865+0000 7f11ba2b7640 1 -- 172.21.15.123:0/1892652691 shutdown_connections 2024-09-15T23:12:27.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.865+0000 7f11ba2b7640 1 --2- 172.21.15.123:0/1892652691 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f11b40d0840 0x7f11b40cc1c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.865+0000 7f11ba2b7640 1 --2- 172.21.15.123:0/1892652691 >> v2:172.21.15.188:3300/0 conn(0x7f11b415e960 0x7f11b40d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.865+0000 7f11ba2b7640 1 -- 172.21.15.123:0/1892652691 >> 172.21.15.123:0/1892652691 conn(0x7f11b40b4300 msgr2=0x7f11b40b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:27.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.865+0000 7f11ba2b7640 1 -- 172.21.15.123:0/1892652691 shutdown_connections 2024-09-15T23:12:27.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.865+0000 7f11ba2b7640 1 -- 172.21.15.123:0/1892652691 wait complete. 2024-09-15T23:12:27.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.866+0000 7f11ba2b7640 1 Processor -- start 2024-09-15T23:12:27.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.866+0000 7f11ba2b7640 1 -- start start 2024-09-15T23:12:27.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.867+0000 7f11ba2b7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11b40cc700 0x7f11b415c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:27.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.867+0000 7f11ba2b7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f11b40d0840 0x7f11b4150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:27.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.867+0000 7f11ba2b7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f11b415e960 0x7f11b415a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:27.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.867+0000 7f11ba2b7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f11b40cf830 con 0x7f11b40cc700 2024-09-15T23:12:27.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.867+0000 7f11ba2b7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f11b40cf6b0 con 0x7f11b40d0840 2024-09-15T23:12:27.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.867+0000 7f11ba2b7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f11b4073520 con 0x7f11b415e960 2024-09-15T23:12:27.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.867+0000 7f11b3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11b40cc700 0x7f11b415c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:27.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.867+0000 7f11b3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11b40cc700 0x7f11b415c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48284/0 (socket says 172.21.15.123:48284) 2024-09-15T23:12:27.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.867+0000 7f11b3fff640 1 -- 172.21.15.123:0/1831201689 learned_addr learned my addr 172.21.15.123:0/1831201689 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:27.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.867+0000 7f11b8854640 1 --2- 172.21.15.123:0/1831201689 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f11b415e960 0x7f11b415a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:27.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.867+0000 7f11b37fe640 1 --2- 172.21.15.123:0/1831201689 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f11b40d0840 0x7f11b4150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:27.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.867+0000 7f11b3fff640 1 -- 172.21.15.123:0/1831201689 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f11b415e960 msgr2=0x7f11b415a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:27.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.867+0000 7f11b3fff640 1 --2- 172.21.15.123:0/1831201689 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f11b415e960 0x7f11b415a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.867+0000 7f11b3fff640 1 -- 172.21.15.123:0/1831201689 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f11b40d0840 msgr2=0x7f11b4150f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:27.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.867+0000 7f11b3fff640 1 --2- 172.21.15.123:0/1831201689 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f11b40d0840 0x7f11b4150f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:27.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.867+0000 7f11b3fff640 1 -- 172.21.15.123:0/1831201689 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11b415b240 con 0x7f11b40cc700 2024-09-15T23:12:27.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.867+0000 7f11b3fff640 1 --2- 172.21.15.123:0/1831201689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11b40cc700 0x7f11b415c000 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f11a400e870 tx=0x7f11a400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:27.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.867+0000 7f11b0ff9640 1 -- 172.21.15.123:0/1831201689 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a4017070 con 0x7f11b40cc700 2024-09-15T23:12:27.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.867+0000 7f11b0ff9640 1 -- 172.21.15.123:0/1831201689 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11a400c940 con 0x7f11b40cc700 2024-09-15T23:12:27.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.867+0000 7f11ba2b7640 1 -- 172.21.15.123:0/1831201689 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11b415b520 con 0x7f11b40cc700 2024-09-15T23:12:27.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.868+0000 7f11b0ff9640 1 -- 172.21.15.123:0/1831201689 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a400cd30 con 0x7f11b40cc700 2024-09-15T23:12:27.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.868+0000 7f11ba2b7640 1 -- 172.21.15.123:0/1831201689 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11b415bae0 con 0x7f11b40cc700 2024-09-15T23:12:27.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.868+0000 7f11ba2b7640 1 -- 172.21.15.123:0/1831201689 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11b40d1dc0 con 0x7f11b40cc700 2024-09-15T23:12:27.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.869+0000 7f11b0ff9640 1 -- 172.21.15.123:0/1831201689 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f11a401a070 con 0x7f11b40cc700 2024-09-15T23:12:27.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.869+0000 7f11b0ff9640 1 --2- 172.21.15.123:0/1831201689 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f11a006c2b0 0x7f11a006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:27.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.870+0000 7f11b0ff9640 1 -- 172.21.15.123:0/1831201689 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f11a408b560 con 0x7f11b40cc700 2024-09-15T23:12:27.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.870+0000 7f11b37fe640 1 --2- 172.21.15.123:0/1831201689 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f11a006c2b0 0x7f11a006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:27.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.870+0000 7f11b37fe640 1 --2- 172.21.15.123:0/1831201689 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f11a006c2b0 0x7f11a006e770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f11a8034000 tx=0x7f11a802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:27.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:27.874+0000 7f11b0ff9640 1 -- 172.21.15.123:0/1831201689 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f11a4059710 con 0x7f11b40cc700 2024-09-15T23:12:28.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:28.073+0000 7f11ba2b7640 1 -- 172.21.15.123:0/1831201689 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f11b4151520 con 0x7f11b40cc700 2024-09-15T23:12:28.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:28.074+0000 7f11b0ff9640 1 -- 172.21.15.123:0/1831201689 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f11a405da10 con 0x7f11b40cc700 2024-09-15T23:12:28.076 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:12:28.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:28.075+0000 7f11ba2b7640 1 -- 172.21.15.123:0/1831201689 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f11a006c2b0 msgr2=0x7f11a006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:28.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:28.075+0000 7f11ba2b7640 1 --2- 172.21.15.123:0/1831201689 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f11a006c2b0 0x7f11a006e770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f11a8034000 tx=0x7f11a802e000 comp rx=0 tx=0).stop 2024-09-15T23:12:28.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:28.075+0000 7f11ba2b7640 1 -- 172.21.15.123:0/1831201689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11b40cc700 msgr2=0x7f11b415c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:28.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:28.075+0000 7f11ba2b7640 1 --2- 172.21.15.123:0/1831201689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11b40cc700 0x7f11b415c000 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f11a400e870 tx=0x7f11a400ed30 comp rx=0 tx=0).stop 2024-09-15T23:12:28.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:28.075+0000 7f11ba2b7640 1 -- 172.21.15.123:0/1831201689 shutdown_connections 2024-09-15T23:12:28.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:28.075+0000 7f11ba2b7640 1 --2- 172.21.15.123:0/1831201689 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f11b415e960 0x7f11b415a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:28.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:28.075+0000 7f11ba2b7640 1 --2- 172.21.15.123:0/1831201689 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f11b40d0840 0x7f11b4150f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:28.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:28.075+0000 7f11ba2b7640 1 --2- 172.21.15.123:0/1831201689 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f11a006c2b0 0x7f11a006e770 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:28.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:28.075+0000 7f11ba2b7640 1 --2- 172.21.15.123:0/1831201689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11b40cc700 0x7f11b415c000 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:28.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:28.075+0000 7f11ba2b7640 1 -- 172.21.15.123:0/1831201689 >> 172.21.15.123:0/1831201689 conn(0x7f11b40b4300 msgr2=0x7f11b4153160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:28.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:28.076+0000 7f11ba2b7640 1 -- 172.21.15.123:0/1831201689 shutdown_connections 2024-09-15T23:12:28.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:28.076+0000 7f11ba2b7640 1 -- 172.21.15.123:0/1831201689 wait complete. 2024-09-15T23:12:28.088 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T23:12:28.088 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:12:28.088 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-09-15T23:12:28.089 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T23:12:28.089 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T23:12:28.089 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T23:12:28.089 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T23:12:28.089 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:12:28.089 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:12:28.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:28.089 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-09-15T23:12:28.104 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:12:28.105 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:12:28.105 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:12:28.105 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:12:28.105 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-09-15T23:12:28.105 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:12:28.105 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:12:28.105 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-09-15T23:12:28.105 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f0 2024-09-15T23:12:28.105 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:12:28.105 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:12:28.105 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f1 2024-09-15T23:12:28.105 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:12:28.106 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:12:28.106 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:12:28.106 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:12:28.106 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T23:12:28.106 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42792sec preferred_lft 42792sec 2024-09-15T23:12:28.106 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link noprefixroute 2024-09-15T23:12:28.106 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:12:28.106 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-15T23:12:28.106 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:12:28.106 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:12:28.107 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link add name ceph-brx type bridge 2024-09-15T23:12:28.107 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip addr flush dev ceph-brx 2024-09-15T23:12:28.107 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set ceph-brx up 2024-09-15T23:12:28.107 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-15T23:12:28.107 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:12:28.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:12:28.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:12:28.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:28.315 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:12:28.359 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-09-15T23:12:28.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:28.361 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-09-15T23:12:28.439 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-09-15T23:12:28.439 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:12:28.439 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:12:28.440 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:12:28.440 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:12:28.440 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:12:28.440 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:12:28.441 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:12:28.441 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:12:28.441 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:12:28.441 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:12:28.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:12:28.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:12:28.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:28.734 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-09-15T23:12:28.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:28.750 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list-id 2024-09-15T23:12:28.808 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:12:28.808 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:12:28.808 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:12:28.808 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-15T23:12:28.808 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:12:28.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:12:28.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:12:28.926 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-15T23:12:28.926 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:12:28.926 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:12:28.926 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-15T23:12:28.926 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-15T23:12:28.926 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-15T23:12:28.927 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-15T23:12:28.927 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-15T23:12:28.927 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:12:28.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:12:29.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:12:29.070 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:12:29.070 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:12:29.070 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2024-09-15T23:12:29.070 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set dev brx.0 master ceph-brx 2024-09-15T23:12:29.070 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:12:29.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:12:29.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:12:29.152 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:12:29.152 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T23:12:29.167 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:12:29.167 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:12:29.167 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:12:29.224 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T23:12:29.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:29.224 DEBUG:teuthology.orchestra.run.smithi123:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:12:29.337 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:12:29.337 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:12:29.337 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:12:29.470 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:12:29.471 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:12:29.471 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:12:29.471 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.188:3300,172.21.15.188:3301" 2024-09-15T23:12:29.471 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T23:12:29.475 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:12:29.475 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:12:29.475 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:12:29.475 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.188:3300,172.21.15.188:3301" 2024-09-15T23:12:29.476 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T23:12:29.476 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:6789,172.21.15.188:6789,172.21.15.188:6790" 2024-09-15T23:12:29.476 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.123:6789,172.21.15.188:6789,172.21.15.188:6790:/ 2024-09-15T23:12:29.476 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=cb968ac4-8d3a-4b17-a673-6177aeaea589" will pass to kernel 2024-09-15T23:12:29.476 INFO:teuthology.orchestra.run.smithi123.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-15T23:12:29.476 INFO:teuthology.orchestra.run.smithi123.stdout: You just mounted a file system that supports labels which does not 2024-09-15T23:12:29.476 INFO:teuthology.orchestra.run.smithi123.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T23:12:29.476 INFO:teuthology.orchestra.run.smithi123.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T23:12:29.477 INFO:teuthology.orchestra.run.smithi123.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T23:12:29.478 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T23:12:29.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:29.478 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:12:29.504 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T23:12:29.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:12:29.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:12:29.604 INFO:teuthology.orchestra.run.smithi123.stdout:client4611 2024-09-15T23:12:29.604 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:12:29.604 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:12:29.620 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T23:12:29.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:12:29.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:12:29.720 INFO:teuthology.orchestra.run.smithi123.stdout:client4611 2024-09-15T23:12:29.721 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T23:12:29.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:12:29.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:12:29.780 INFO:teuthology.orchestra.run.smithi123.stdout:client4611 2024-09-15T23:12:29.781 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/cb968ac4-8d3a-4b17-a673-6177aeaea589.client4611/status') 2024-09-15T23:12:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:12:29.842 INFO:teuthology.orchestra.run.smithi123.stdout:instance: client.4611 (3)192.168.0.1:0/1137158230 2024-09-15T23:12:29.842 INFO:teuthology.orchestra.run.smithi123.stdout:blocklisted: false 2024-09-15T23:12:29.842 INFO:teuthology.orchestra.run.smithi123.stderr:0+1 records in 2024-09-15T23:12:29.842 INFO:teuthology.orchestra.run.smithi123.stderr:0+1 records out 2024-09-15T23:12:29.842 INFO:teuthology.orchestra.run.smithi123.stderr:69 bytes copied, 2.5549e-05 s, 2.7 MB/s 2024-09-15T23:12:29.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:12:29.849 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-09-15T23:12:29.849 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T23:12:29.849 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-15T23:12:29.849 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:12:29.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.945+0000 7fe7f41df640 1 Processor -- start 2024-09-15T23:12:29.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.945+0000 7fe7f41df640 1 -- start start 2024-09-15T23:12:29.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.946+0000 7fe7f41df640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe7ec06c6a0 0x7fe7ec0720b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:29.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.946+0000 7fe7f41df640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe7ec15af20 0x7fe7ec15b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:29.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.946+0000 7fe7f41df640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7ec071010 con 0x7fe7ec15ab40 2024-09-15T23:12:29.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.946+0000 7fe7f41df640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe7ec06cb10 con 0x7fe7ec15af20 2024-09-15T23:12:29.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.946+0000 7fe7f41df640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fe7ec0712f0 con 0x7fe7ec06c6a0 2024-09-15T23:12:29.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.946+0000 7fe7f277c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe7ec15af20 0x7fe7ec15b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:29.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.946+0000 7fe7f1f7b640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe7ec15ab40 0x7fe7ec073990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:48072/0 (socket says 172.21.15.123:48072) 2024-09-15T23:12:29.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.946+0000 7fe7f1f7b640 1 -- 172.21.15.123:0/3891394040 learned_addr learned my addr 172.21.15.123:0/3891394040 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:29.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.946+0000 7fe7f277c640 1 -- 172.21.15.123:0/3891394040 >> v2:172.21.15.188:3300/0 conn(0x7fe7ec06c6a0 msgr2=0x7fe7ec0720b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:29.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.946+0000 7fe7f277c640 1 --2- 172.21.15.123:0/3891394040 >> v2:172.21.15.188:3300/0 conn(0x7fe7ec06c6a0 0x7fe7ec0720b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:29.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.946+0000 7fe7f277c640 1 -- 172.21.15.123:0/3891394040 >> v1:172.21.15.123:6789/0 conn(0x7fe7ec15ab40 legacy=0x7fe7ec073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:29.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.946+0000 7fe7f277c640 1 -- 172.21.15.123:0/3891394040 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7ec0715d0 con 0x7fe7ec15af20 2024-09-15T23:12:29.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.946+0000 7fe7f0f79640 1 -- 172.21.15.123:0/3891394040 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1431864490 0 0) 0x7fe7ec071010 con 0x7fe7ec15ab40 2024-09-15T23:12:29.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.947+0000 7fe7f277c640 1 --2- 172.21.15.123:0/3891394040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7ec15af20 0x7fe7ec15b370 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec0cded0 tx=0x7fe7e402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8f5c7247bf6ad16 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:29.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.947+0000 7fe7f0f79640 1 -- 172.21.15.123:0/3891394040 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e4007740 con 0x7fe7ec15af20 2024-09-15T23:12:29.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.947+0000 7fe7f0f79640 1 -- 172.21.15.123:0/3891394040 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7e40078e0 con 0x7fe7ec15af20 2024-09-15T23:12:29.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.947+0000 7fe7f0f79640 1 -- 172.21.15.123:0/3891394040 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e4007cb0 con 0x7fe7ec15af20 2024-09-15T23:12:29.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.947+0000 7fe7f41df640 1 -- 172.21.15.123:0/3891394040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7ec15af20 msgr2=0x7fe7ec15b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:29.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.947+0000 7fe7f41df640 1 --2- 172.21.15.123:0/3891394040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7ec15af20 0x7fe7ec15b370 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec0cded0 tx=0x7fe7e402a5f0 comp rx=0 tx=0).stop 2024-09-15T23:12:29.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.947+0000 7fe7f41df640 1 -- 172.21.15.123:0/3891394040 shutdown_connections 2024-09-15T23:12:29.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.947+0000 7fe7f41df640 1 --2- 172.21.15.123:0/3891394040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7ec15af20 0x7fe7ec15b370 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:29.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.947+0000 7fe7f41df640 1 --2- 172.21.15.123:0/3891394040 >> v2:172.21.15.188:3300/0 conn(0x7fe7ec06c6a0 0x7fe7ec0720b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:29.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.947+0000 7fe7f41df640 1 -- 172.21.15.123:0/3891394040 >> 172.21.15.123:0/3891394040 conn(0x7fe7ec0ccec0 msgr2=0x7fe7ec0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:29.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.948+0000 7fe7f41df640 1 -- 172.21.15.123:0/3891394040 shutdown_connections 2024-09-15T23:12:29.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.948+0000 7fe7f41df640 1 -- 172.21.15.123:0/3891394040 wait complete. 2024-09-15T23:12:29.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.949+0000 7fe7f41df640 1 Processor -- start 2024-09-15T23:12:29.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.949+0000 7fe7f41df640 1 -- start start 2024-09-15T23:12:29.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.949+0000 7fe7f41df640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7ec06c6a0 0x7fe7ec152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:29.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.949+0000 7fe7f41df640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe7ec15ab40 0x7fe7ec14cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:29.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.949+0000 7fe7f41df640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe7ec15af20 0x7fe7ec14d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:29.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.949+0000 7fe7f41df640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ec15ba30 con 0x7fe7ec06c6a0 2024-09-15T23:12:29.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.949+0000 7fe7f41df640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ec15b8b0 con 0x7fe7ec15af20 2024-09-15T23:12:29.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.949+0000 7fe7f41df640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe7ec06bc10 con 0x7fe7ec15ab40 2024-09-15T23:12:29.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.949+0000 7fe7f1f7b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7ec06c6a0 0x7fe7ec152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:29.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.950+0000 7fe7f1f7b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7ec06c6a0 0x7fe7ec152800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48312/0 (socket says 172.21.15.123:48312) 2024-09-15T23:12:29.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.950+0000 7fe7f1f7b640 1 -- 172.21.15.123:0/2775293768 learned_addr learned my addr 172.21.15.123:0/2775293768 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:29.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.950+0000 7fe7f1f7b640 1 -- 172.21.15.123:0/2775293768 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe7ec15ab40 msgr2=0x7fe7ec14cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:29.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.950+0000 7fe7f1f7b640 1 --2- 172.21.15.123:0/2775293768 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe7ec15ab40 0x7fe7ec14cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:29.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.950+0000 7fe7f1f7b640 1 -- 172.21.15.123:0/2775293768 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe7ec15af20 msgr2=0x7fe7ec14d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:29.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.950+0000 7fe7f277c640 1 --2- 172.21.15.123:0/2775293768 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe7ec15af20 0x7fe7ec14d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:29.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.950+0000 7fe7f1f7b640 1 --2- 172.21.15.123:0/2775293768 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe7ec15af20 0x7fe7ec14d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:29.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.950+0000 7fe7f1f7b640 1 -- 172.21.15.123:0/2775293768 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7ec0cb410 con 0x7fe7ec06c6a0 2024-09-15T23:12:29.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.950+0000 7fe7f1f7b640 1 --2- 172.21.15.123:0/2775293768 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7ec06c6a0 0x7fe7ec152800 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe7e800c4d0 tx=0x7fe7e800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:29.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.950+0000 7fe7e27fc640 1 -- 172.21.15.123:0/2775293768 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e8018070 con 0x7fe7ec06c6a0 2024-09-15T23:12:29.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.950+0000 7fe7e27fc640 1 -- 172.21.15.123:0/2775293768 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7e8007500 con 0x7fe7ec06c6a0 2024-09-15T23:12:29.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.950+0000 7fe7f41df640 1 -- 172.21.15.123:0/2775293768 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7ec151d20 con 0x7fe7ec06c6a0 2024-09-15T23:12:29.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.950+0000 7fe7e27fc640 1 -- 172.21.15.123:0/2775293768 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e8004a20 con 0x7fe7ec06c6a0 2024-09-15T23:12:29.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.950+0000 7fe7f41df640 1 -- 172.21.15.123:0/2775293768 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7ec1522e0 con 0x7fe7ec06c6a0 2024-09-15T23:12:29.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.951+0000 7fe7f41df640 1 -- 172.21.15.123:0/2775293768 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7ec06bfd0 con 0x7fe7ec06c6a0 2024-09-15T23:12:29.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.951+0000 7fe7e27fc640 1 -- 172.21.15.123:0/2775293768 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe7e801b070 con 0x7fe7ec06c6a0 2024-09-15T23:12:29.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.952+0000 7fe7e27fc640 1 --2- 172.21.15.123:0/2775293768 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe7d006c2e0 0x7fe7d006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:29.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.952+0000 7fe7e27fc640 1 -- 172.21.15.123:0/2775293768 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe7e808a640 con 0x7fe7ec06c6a0 2024-09-15T23:12:29.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.952+0000 7fe7f177a640 1 --2- 172.21.15.123:0/2775293768 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe7d006c2e0 0x7fe7d006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:29.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.953+0000 7fe7f177a640 1 --2- 172.21.15.123:0/2775293768 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe7d006c2e0 0x7fe7d006e7a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec0cd5c0 tx=0x7fe7dc006c90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:29.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:29.956+0000 7fe7e27fc640 1 -- 172.21.15.123:0/2775293768 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe7e8058e40 con 0x7fe7ec06c6a0 2024-09-15T23:12:30.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:30.157+0000 7fe7f41df640 1 -- 172.21.15.123:0/2775293768 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe7ec0caa40 con 0x7fe7ec06c6a0 2024-09-15T23:12:30.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:30.157+0000 7fe7e27fc640 1 -- 172.21.15.123:0/2775293768 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7fe7e8058740 con 0x7fe7ec06c6a0 2024-09-15T23:12:30.160 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:12:30.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:30.159+0000 7fe7f41df640 1 -- 172.21.15.123:0/2775293768 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe7d006c2e0 msgr2=0x7fe7d006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:30.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:30.159+0000 7fe7f41df640 1 --2- 172.21.15.123:0/2775293768 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe7d006c2e0 0x7fe7d006e7a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec0cd5c0 tx=0x7fe7dc006c90 comp rx=0 tx=0).stop 2024-09-15T23:12:30.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:30.159+0000 7fe7f41df640 1 -- 172.21.15.123:0/2775293768 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7ec06c6a0 msgr2=0x7fe7ec152800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:30.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:30.159+0000 7fe7f41df640 1 --2- 172.21.15.123:0/2775293768 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7ec06c6a0 0x7fe7ec152800 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe7e800c4d0 tx=0x7fe7e800c990 comp rx=0 tx=0).stop 2024-09-15T23:12:30.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:30.159+0000 7fe7f41df640 1 -- 172.21.15.123:0/2775293768 shutdown_connections 2024-09-15T23:12:30.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:30.159+0000 7fe7f41df640 1 --2- 172.21.15.123:0/2775293768 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe7ec15af20 0x7fe7ec14d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:30.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:30.159+0000 7fe7f41df640 1 --2- 172.21.15.123:0/2775293768 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe7ec15ab40 0x7fe7ec14cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:30.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:30.159+0000 7fe7f41df640 1 --2- 172.21.15.123:0/2775293768 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe7d006c2e0 0x7fe7d006e7a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:30.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:30.159+0000 7fe7f41df640 1 --2- 172.21.15.123:0/2775293768 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7ec06c6a0 0x7fe7ec152800 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:30.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:30.159+0000 7fe7f41df640 1 -- 172.21.15.123:0/2775293768 >> 172.21.15.123:0/2775293768 conn(0x7fe7ec0ccec0 msgr2=0x7fe7ec0b2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:30.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:30.159+0000 7fe7f41df640 1 -- 172.21.15.123:0/2775293768 shutdown_connections 2024-09-15T23:12:30.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:30.160+0000 7fe7f41df640 1 -- 172.21.15.123:0/2775293768 wait complete. 2024-09-15T23:12:30.172 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T23:12:30.172 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:12:30.172 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-09-15T23:12:30.172 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-15T23:12:30.172 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-15T23:12:30.172 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T23:12:30.173 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T23:12:30.173 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:12:30.173 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-15T23:12:30.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:30.173 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-09-15T23:12:30.189 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:12:30.189 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:12:30.189 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:12:30.189 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:12:30.189 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-09-15T23:12:30.189 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:12:30.189 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:12:30.189 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-09-15T23:12:30.189 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f0 2024-09-15T23:12:30.189 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:12:30.189 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:12:30.190 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f1 2024-09-15T23:12:30.190 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:12:30.190 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:12:30.190 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:12:30.190 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:12:30.190 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T23:12:30.190 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42790sec preferred_lft 42790sec 2024-09-15T23:12:30.190 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link noprefixroute 2024-09-15T23:12:30.190 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:12:30.191 INFO:teuthology.orchestra.run.smithi123.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:12:30.191 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 46:55:5a:e0:32:4d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:12:30.191 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:12:30.191 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:12:30.191 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::1c6f:d5ff:fe19:ff05/64 scope link 2024-09-15T23:12:30.191 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:12:30.191 INFO:teuthology.orchestra.run.smithi123.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:12:30.191 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 46:55:5a:e0:32:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:12:30.191 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::4455:5aff:fee0:324d/64 scope link tentative 2024-09-15T23:12:30.191 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:12:30.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:30.192 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:12:30.252 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-09-15T23:12:30.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:30.253 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-09-15T23:12:30.311 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-09-15T23:12:30.311 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:12:30.311 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:12:30.311 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:12:30.311 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:12:30.311 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:12:30.311 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:12:30.311 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:12:30.312 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:12:30.312 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:12:30.312 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:12:30.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:12:30.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:12:30.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:30.436 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-09-15T23:12:30.451 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:12:30.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:30.452 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list-id 2024-09-15T23:12:30.507 INFO:teuthology.orchestra.run.smithi123.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-15T23:12:30.508 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:12:30.508 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:12:30.509 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:12:30.509 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-15T23:12:30.509 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:12:30.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:12:30.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:12:30.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:30.625 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-15T23:12:30.648 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:12:30.648 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:12:30.649 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:12:30.649 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:12:30.649 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-09-15T23:12:30.649 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:12:30.649 INFO:teuthology.orchestra.run.smithi123.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:12:30.649 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether b2:ae:64:25:1f:77 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-15T23:12:30.649 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-15T23:12:30.649 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:12:30.649 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::b0ae:64ff:fe25:1f77/64 scope link tentative 2024-09-15T23:12:30.649 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:12:30.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:30.650 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-15T23:12:30.715 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:12:30.715 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:12:30.715 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:12:30.715 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:12:30.715 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-09-15T23:12:30.715 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:12:30.715 INFO:teuthology.orchestra.run.smithi123.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:12:30.715 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether b2:ae:64:25:1f:77 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-15T23:12:30.715 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-15T23:12:30.716 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:12:30.716 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::b0ae:64ff:fe25:1f77/64 scope link tentative 2024-09-15T23:12:30.716 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:12:30.717 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-15T23:12:30.717 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:12:30.717 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:12:30.717 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-15T23:12:30.717 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-15T23:12:30.717 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-15T23:12:30.718 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-15T23:12:30.718 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-15T23:12:30.718 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:12:30.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:12:30.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:12:30.868 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:12:30.868 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:12:30.868 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.1 up 2024-09-15T23:12:30.869 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set dev brx.1 master ceph-brx 2024-09-15T23:12:30.869 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:12:30.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:12:30.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:12:30.944 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:12:30.945 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-15T23:12:30.959 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-15T23:12:30.960 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:12:30.960 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-15T23:12:31.015 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T23:12:31.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:31.015 DEBUG:teuthology.orchestra.run.smithi123:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-15T23:12:31.097 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-15T23:12:31.098 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-15T23:12:31.098 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:12:31.106 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-15T23:12:31.106 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-15T23:12:31.106 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:12:31.107 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.188:3300,172.21.15.188:3301" 2024-09-15T23:12:31.107 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T23:12:31.115 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-15T23:12:31.116 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-15T23:12:31.116 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:12:31.116 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.188:3300,172.21.15.188:3301" 2024-09-15T23:12:31.116 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T23:12:31.116 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:6789,172.21.15.188:6789,172.21.15.188:6790" 2024-09-15T23:12:31.116 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.123:6789,172.21.15.188:6789,172.21.15.188:6790:/ 2024-09-15T23:12:31.116 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=cb968ac4-8d3a-4b17-a673-6177aeaea589" will pass to kernel 2024-09-15T23:12:31.116 INFO:teuthology.orchestra.run.smithi123.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-15T23:12:31.117 INFO:teuthology.orchestra.run.smithi123.stdout: You just mounted a file system that supports labels which does not 2024-09-15T23:12:31.117 INFO:teuthology.orchestra.run.smithi123.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T23:12:31.117 INFO:teuthology.orchestra.run.smithi123.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T23:12:31.117 INFO:teuthology.orchestra.run.smithi123.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T23:12:31.118 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T23:12:31.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:31.118 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-15T23:12:31.183 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T23:12:31.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:12:31.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:12:31.279 INFO:teuthology.orchestra.run.smithi123.stdout:client4466 2024-09-15T23:12:31.279 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:12:31.279 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:12:31.296 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T23:12:31.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:12:31.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:12:31.391 INFO:teuthology.orchestra.run.smithi123.stdout:client4466 2024-09-15T23:12:31.391 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T23:12:31.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:12:31.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:12:31.446 INFO:teuthology.orchestra.run.smithi123.stdout:client4466 2024-09-15T23:12:31.446 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/cb968ac4-8d3a-4b17-a673-6177aeaea589.client4466/status') 2024-09-15T23:12:31.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:12:31.504 INFO:teuthology.orchestra.run.smithi123.stdout:instance: client.4466 (3)172.21.15.123:0/3772394016 2024-09-15T23:12:31.504 INFO:teuthology.orchestra.run.smithi123.stdout:blocklisted: false 2024-09-15T23:12:31.504 INFO:teuthology.orchestra.run.smithi123.stderr:0+1 records in 2024-09-15T23:12:31.504 INFO:teuthology.orchestra.run.smithi123.stderr:0+1 records out 2024-09-15T23:12:31.505 INFO:teuthology.orchestra.run.smithi123.stderr:71 bytes copied, 2.2969e-05 s, 3.1 MB/s 2024-09-15T23:12:31.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:12:31.511 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-15T23:12:31.511 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T23:12:31.511 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-15T23:12:31.511 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:12:31.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.607+0000 7f29f648b640 1 Processor -- start 2024-09-15T23:12:31.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.607+0000 7f29f648b640 1 -- start start 2024-09-15T23:12:31.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.608+0000 7f29f648b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f29f015c4b0 0x7f29f00b6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:31.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.608+0000 7f29f648b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f29f00b02b0 0x7f29f00b6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:31.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.608+0000 7f29f648b640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29f0067b50 con 0x7f29f00d08e0 2024-09-15T23:12:31.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.608+0000 7f29f648b640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f29f00ce860 con 0x7f29f00b02b0 2024-09-15T23:12:31.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.608+0000 7f29f648b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f29f0070130 con 0x7f29f015c4b0 2024-09-15T23:12:31.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.608+0000 7f29effff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f29f015c4b0 0x7f29f00b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:31.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.608+0000 7f29ef7fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f29f00b02b0 0x7f29f00b6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:31.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.608+0000 7f29effff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f29f015c4b0 0x7f29f00b6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:44672/0 (socket says 172.21.15.123:44672) 2024-09-15T23:12:31.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.608+0000 7f29effff640 1 -- 172.21.15.123:0/2028240967 learned_addr learned my addr 172.21.15.123:0/2028240967 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:31.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.609+0000 7f29ef7fe640 1 -- 172.21.15.123:0/2028240967 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f29f015c4b0 msgr2=0x7f29f00b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:31.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.609+0000 7f29ef7fe640 1 --2- 172.21.15.123:0/2028240967 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f29f015c4b0 0x7f29f00b6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:31.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.609+0000 7f29ef7fe640 1 -- 172.21.15.123:0/2028240967 >> v1:172.21.15.188:6789/0 conn(0x7f29f00d08e0 legacy=0x7f29f0160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:31.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.609+0000 7f29ef7fe640 1 -- 172.21.15.123:0/2028240967 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f006fe50 con 0x7f29f00b02b0 2024-09-15T23:12:31.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.609+0000 7f29effff640 1 --2- 172.21.15.123:0/2028240967 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f29f015c4b0 0x7f29f00b6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:12:31.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.609+0000 7f29ef7fe640 1 --2- 172.21.15.123:0/2028240967 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f29f00b02b0 0x7f29f00b6660 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f29e40097a0 tx=0x7f29e402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4dd93a62a9d66b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:31.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.609+0000 7f29eeffd640 1 -- 172.21.15.123:0/2028240967 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e4037070 con 0x7f29f00b02b0 2024-09-15T23:12:31.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.610+0000 7f29eeffd640 1 -- 172.21.15.123:0/2028240967 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29e4032440 con 0x7f29f00b02b0 2024-09-15T23:12:31.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.610+0000 7f29eeffd640 1 -- 172.21.15.123:0/2028240967 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e4032810 con 0x7f29f00b02b0 2024-09-15T23:12:31.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.610+0000 7f29f648b640 1 -- 172.21.15.123:0/2028240967 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f29f00b02b0 msgr2=0x7f29f00b6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:31.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.610+0000 7f29f648b640 1 --2- 172.21.15.123:0/2028240967 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f29f00b02b0 0x7f29f00b6660 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f29e40097a0 tx=0x7f29e402a180 comp rx=0 tx=0).stop 2024-09-15T23:12:31.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.610+0000 7f29f648b640 1 -- 172.21.15.123:0/2028240967 shutdown_connections 2024-09-15T23:12:31.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.610+0000 7f29f648b640 1 --2- 172.21.15.123:0/2028240967 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f29f00b02b0 0x7f29f00b6660 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:31.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.610+0000 7f29f648b640 1 --2- 172.21.15.123:0/2028240967 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f29f015c4b0 0x7f29f00b6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:31.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.610+0000 7f29f648b640 1 -- 172.21.15.123:0/2028240967 >> 172.21.15.123:0/2028240967 conn(0x7f29f00b0a80 msgr2=0x7f29f00b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:31.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.610+0000 7f29f648b640 1 -- 172.21.15.123:0/2028240967 shutdown_connections 2024-09-15T23:12:31.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.610+0000 7f29f648b640 1 -- 172.21.15.123:0/2028240967 wait complete. 2024-09-15T23:12:31.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.611+0000 7f29f648b640 1 Processor -- start 2024-09-15T23:12:31.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.611+0000 7f29f648b640 1 -- start start 2024-09-15T23:12:31.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.612+0000 7f29f648b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f29f00b02b0 0x7f29f014b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:31.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.612+0000 7f29f648b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29f00d08e0 0x7f29f014e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:31.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.612+0000 7f29f648b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f29f015c4b0 0x7f29f015f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:31.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.612+0000 7f29f648b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f29f006dcc0 con 0x7f29f00d08e0 2024-09-15T23:12:31.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.612+0000 7f29f648b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f29f00ce580 con 0x7f29f015c4b0 2024-09-15T23:12:31.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.612+0000 7f29f648b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f29f015c890 con 0x7f29f00b02b0 2024-09-15T23:12:31.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.612+0000 7f29ef7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29f00d08e0 0x7f29f014e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:31.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.612+0000 7f29ef7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29f00d08e0 0x7f29f014e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48328/0 (socket says 172.21.15.123:48328) 2024-09-15T23:12:31.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.612+0000 7f29ef7fe640 1 -- 172.21.15.123:0/198394832 learned_addr learned my addr 172.21.15.123:0/198394832 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:31.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.612+0000 7f29effff640 1 --2- 172.21.15.123:0/198394832 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f29f00b02b0 0x7f29f014b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:31.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.612+0000 7f29f4a28640 1 --2- 172.21.15.123:0/198394832 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f29f015c4b0 0x7f29f015f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:31.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.613+0000 7f29ef7fe640 1 -- 172.21.15.123:0/198394832 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f29f00b02b0 msgr2=0x7f29f014b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:31.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.613+0000 7f29ef7fe640 1 --2- 172.21.15.123:0/198394832 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f29f00b02b0 0x7f29f014b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:31.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.613+0000 7f29ef7fe640 1 -- 172.21.15.123:0/198394832 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f29f015c4b0 msgr2=0x7f29f015f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:31.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.613+0000 7f29ef7fe640 1 --2- 172.21.15.123:0/198394832 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f29f015c4b0 0x7f29f015f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:31.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.613+0000 7f29ef7fe640 1 -- 172.21.15.123:0/198394832 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f014d7d0 con 0x7f29f00d08e0 2024-09-15T23:12:31.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.613+0000 7f29effff640 1 --2- 172.21.15.123:0/198394832 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f29f00b02b0 0x7f29f014b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:31.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.613+0000 7f29ef7fe640 1 --2- 172.21.15.123:0/198394832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29f00d08e0 0x7f29f014e590 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f29e4035040 tx=0x7f29e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:31.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.613+0000 7f29ecff9640 1 -- 172.21.15.123:0/198394832 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e4037040 con 0x7f29f00d08e0 2024-09-15T23:12:31.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.613+0000 7f29ecff9640 1 -- 172.21.15.123:0/198394832 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29e4030500 con 0x7f29f00d08e0 2024-09-15T23:12:31.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.613+0000 7f29f648b640 1 -- 172.21.15.123:0/198394832 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29f014dab0 con 0x7f29f00d08e0 2024-09-15T23:12:31.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.613+0000 7f29ecff9640 1 -- 172.21.15.123:0/198394832 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e4030910 con 0x7f29f00d08e0 2024-09-15T23:12:31.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.613+0000 7f29f648b640 1 -- 172.21.15.123:0/198394832 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29f014e070 con 0x7f29f00d08e0 2024-09-15T23:12:31.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.614+0000 7f29f648b640 1 -- 172.21.15.123:0/198394832 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29f00b6120 con 0x7f29f00d08e0 2024-09-15T23:12:31.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.614+0000 7f29ecff9640 1 -- 172.21.15.123:0/198394832 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f29e4044020 con 0x7f29f00d08e0 2024-09-15T23:12:31.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.615+0000 7f29ecff9640 1 --2- 172.21.15.123:0/198394832 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f29dc06c2b0 0x7f29dc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:31.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.615+0000 7f29ecff9640 1 -- 172.21.15.123:0/198394832 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f29e40ab6a0 con 0x7f29f00d08e0 2024-09-15T23:12:31.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.615+0000 7f29effff640 1 --2- 172.21.15.123:0/198394832 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f29dc06c2b0 0x7f29dc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:31.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.616+0000 7f29effff640 1 --2- 172.21.15.123:0/198394832 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f29dc06c2b0 0x7f29dc06e770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f29f00afc10 tx=0x7f29e0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:31.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.619+0000 7f29ecff9640 1 -- 172.21.15.123:0/198394832 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f29e4079e10 con 0x7f29f00d08e0 2024-09-15T23:12:31.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.820+0000 7f29f648b640 1 -- 172.21.15.123:0/198394832 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f29f0073450 con 0x7f29f00d08e0 2024-09-15T23:12:31.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.820+0000 7f29ecff9640 1 -- 172.21.15.123:0/198394832 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f29e4079710 con 0x7f29f00d08e0 2024-09-15T23:12:31.822 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:12:31.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.822+0000 7f29f648b640 1 -- 172.21.15.123:0/198394832 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f29dc06c2b0 msgr2=0x7f29dc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:31.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.822+0000 7f29f648b640 1 --2- 172.21.15.123:0/198394832 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f29dc06c2b0 0x7f29dc06e770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f29f00afc10 tx=0x7f29e0008040 comp rx=0 tx=0).stop 2024-09-15T23:12:31.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.822+0000 7f29f648b640 1 -- 172.21.15.123:0/198394832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29f00d08e0 msgr2=0x7f29f014e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:31.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.822+0000 7f29f648b640 1 --2- 172.21.15.123:0/198394832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29f00d08e0 0x7f29f014e590 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f29e4035040 tx=0x7f29e40046c0 comp rx=0 tx=0).stop 2024-09-15T23:12:31.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.822+0000 7f29f648b640 1 -- 172.21.15.123:0/198394832 shutdown_connections 2024-09-15T23:12:31.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.822+0000 7f29f648b640 1 --2- 172.21.15.123:0/198394832 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f29f015c4b0 0x7f29f015f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:31.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.822+0000 7f29f648b640 1 --2- 172.21.15.123:0/198394832 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f29dc06c2b0 0x7f29dc06e770 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:31.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.822+0000 7f29f648b640 1 --2- 172.21.15.123:0/198394832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29f00d08e0 0x7f29f014e590 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:31.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.822+0000 7f29f648b640 1 --2- 172.21.15.123:0/198394832 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f29f00b02b0 0x7f29f014b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:31.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.822+0000 7f29f648b640 1 -- 172.21.15.123:0/198394832 >> 172.21.15.123:0/198394832 conn(0x7f29f00b0a80 msgr2=0x7f29f0071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:31.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.823+0000 7f29f648b640 1 -- 172.21.15.123:0/198394832 shutdown_connections 2024-09-15T23:12:31.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:31.823+0000 7f29f648b640 1 -- 172.21.15.123:0/198394832 wait complete. 2024-09-15T23:12:31.835 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T23:12:31.835 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:12:31.835 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi188.front.sepia.ceph.com 2024-09-15T23:12:31.835 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-15T23:12:31.835 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-15T23:12:31.835 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T23:12:31.835 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T23:12:31.835 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:12:31.836 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T23:12:31.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:31.836 DEBUG:teuthology.orchestra.run.smithi188:> ip addr 2024-09-15T23:12:31.855 INFO:teuthology.orchestra.run.smithi188.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:12:31.855 INFO:teuthology.orchestra.run.smithi188.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:12:31.856 INFO:teuthology.orchestra.run.smithi188.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:12:31.856 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:12:31.856 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 ::1/128 scope host 2024-09-15T23:12:31.856 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:12:31.856 INFO:teuthology.orchestra.run.smithi188.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:12:31.856 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:d9:37:48 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:12:31.856 INFO:teuthology.orchestra.run.smithi188.stdout: altname enp7s0f0 2024-09-15T23:12:31.856 INFO:teuthology.orchestra.run.smithi188.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:12:31.856 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:d9:37:49 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:12:31.856 INFO:teuthology.orchestra.run.smithi188.stdout: altname enp7s0f1 2024-09-15T23:12:31.856 INFO:teuthology.orchestra.run.smithi188.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:12:31.856 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:88:80:38 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:12:31.857 INFO:teuthology.orchestra.run.smithi188.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:12:31.857 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:88:80:39 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:12:31.857 INFO:teuthology.orchestra.run.smithi188.stdout: inet 172.21.15.188/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T23:12:31.857 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft 42777sec preferred_lft 42777sec 2024-09-15T23:12:31.857 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 fe80::ec4:7aff:fe88:8039/64 scope link noprefixroute 2024-09-15T23:12:31.857 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:12:31.857 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-15T23:12:31.857 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:12:31.857 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2024-09-15T23:12:31.857 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link add name ceph-brx type bridge 2024-09-15T23:12:31.858 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip addr flush dev ceph-brx 2024-09-15T23:12:31.858 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link set ceph-brx up 2024-09-15T23:12:31.858 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-15T23:12:31.858 DEBUG:teuthology.orchestra.run.smithi188:> ') 2024-09-15T23:12:31.951 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:12:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:12:32.067 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:12:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:12:32.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:32.074 DEBUG:teuthology.orchestra.run.smithi188:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:12:32.099 INFO:teuthology.orchestra.run.smithi188.stdout:1 2024-09-15T23:12:32.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:32.101 DEBUG:teuthology.orchestra.run.smithi188:> route 2024-09-15T23:12:32.172 INFO:teuthology.orchestra.run.smithi188.stdout:Kernel IP routing table 2024-09-15T23:12:32.172 INFO:teuthology.orchestra.run.smithi188.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:12:32.172 INFO:teuthology.orchestra.run.smithi188.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:12:32.172 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:12:32.173 INFO:teuthology.orchestra.run.smithi188.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:12:32.173 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:12:32.173 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2024-09-15T23:12:32.173 DEBUG:teuthology.orchestra.run.smithi188:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:12:32.173 DEBUG:teuthology.orchestra.run.smithi188:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:12:32.173 DEBUG:teuthology.orchestra.run.smithi188:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:12:32.173 DEBUG:teuthology.orchestra.run.smithi188:> ') 2024-09-15T23:12:32.260 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:12:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:12:32.454 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:12:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:12:32.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:32.460 DEBUG:teuthology.orchestra.run.smithi188:> ip netns list 2024-09-15T23:12:32.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:32.476 DEBUG:teuthology.orchestra.run.smithi188:> ip netns list-id 2024-09-15T23:12:32.531 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:12:32.531 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2024-09-15T23:12:32.532 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:12:32.532 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-15T23:12:32.532 DEBUG:teuthology.orchestra.run.smithi188:> ') 2024-09-15T23:12:32.619 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:12:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:12:32.642 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:12:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:12:32.648 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-15T23:12:32.649 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:12:32.649 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2024-09-15T23:12:32.649 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-15T23:12:32.649 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-15T23:12:32.649 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-15T23:12:32.649 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-15T23:12:32.649 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-15T23:12:32.649 DEBUG:teuthology.orchestra.run.smithi188:> ') 2024-09-15T23:12:32.697 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:12:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:12:32.766 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:12:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:12:32.772 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:12:32.772 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2024-09-15T23:12:32.772 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link set brx.0 up 2024-09-15T23:12:32.772 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link set dev brx.0 master ceph-brx 2024-09-15T23:12:32.772 DEBUG:teuthology.orchestra.run.smithi188:> ') 2024-09-15T23:12:32.820 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:12:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:12:32.842 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:12:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:12:32.849 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:12:32.849 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-15T23:12:32.863 INFO:teuthology.orchestra.run.smithi188.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-15T23:12:32.864 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:12:32.864 DEBUG:teuthology.orchestra.run.smithi188:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-15T23:12:32.919 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T23:12:32.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:32.919 DEBUG:teuthology.orchestra.run.smithi188:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T23:12:33.011 INFO:teuthology.orchestra.run.smithi188.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T23:12:33.011 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T23:12:33.011 INFO:teuthology.orchestra.run.smithi188.stdout:invalid new device string format 2024-09-15T23:12:33.155 INFO:teuthology.orchestra.run.smithi188.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T23:12:33.155 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T23:12:33.155 INFO:teuthology.orchestra.run.smithi188.stdout:invalid new device string format 2024-09-15T23:12:33.155 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.188:3300,172.21.15.188:3301" 2024-09-15T23:12:33.155 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T23:12:33.160 INFO:teuthology.orchestra.run.smithi188.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T23:12:33.160 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T23:12:33.160 INFO:teuthology.orchestra.run.smithi188.stdout:invalid new device string format 2024-09-15T23:12:33.160 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.188:3300,172.21.15.188:3301" 2024-09-15T23:12:33.161 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T23:12:33.161 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: resolved to: "172.21.15.123:6789,172.21.15.188:6789,172.21.15.188:6790" 2024-09-15T23:12:33.161 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.123:6789,172.21.15.188:6789,172.21.15.188:6790:/ 2024-09-15T23:12:33.161 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=cb968ac4-8d3a-4b17-a673-6177aeaea589" will pass to kernel 2024-09-15T23:12:33.161 INFO:teuthology.orchestra.run.smithi188.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-15T23:12:33.161 INFO:teuthology.orchestra.run.smithi188.stdout: You just mounted a file system that supports labels which does not 2024-09-15T23:12:33.161 INFO:teuthology.orchestra.run.smithi188.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T23:12:33.161 INFO:teuthology.orchestra.run.smithi188.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T23:12:33.161 INFO:teuthology.orchestra.run.smithi188.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T23:12:33.163 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T23:12:33.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:33.163 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-15T23:12:33.187 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T23:12:33.276 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:12:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:12:33.278 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:12:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:12:33.284 INFO:teuthology.orchestra.run.smithi188.stdout:client4582 2024-09-15T23:12:33.284 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:12:33.284 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:12:33.300 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T23:12:33.389 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:12:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:12:33.391 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:12:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:12:33.396 INFO:teuthology.orchestra.run.smithi188.stdout:client4582 2024-09-15T23:12:33.397 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T23:12:33.445 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:12:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:12:33.446 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:12:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:12:33.452 INFO:teuthology.orchestra.run.smithi188.stdout:client4582 2024-09-15T23:12:33.452 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/cb968ac4-8d3a-4b17-a673-6177aeaea589.client4582/status') 2024-09-15T23:12:33.500 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:12:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:12:33.510 INFO:teuthology.orchestra.run.smithi188.stdout:instance: client.4582 (3)192.168.0.1:0/568089768 2024-09-15T23:12:33.510 INFO:teuthology.orchestra.run.smithi188.stdout:blocklisted: false 2024-09-15T23:12:33.510 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records in 2024-09-15T23:12:33.510 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records out 2024-09-15T23:12:33.510 INFO:teuthology.orchestra.run.smithi188.stderr:68 bytes copied, 2.2851e-05 s, 3.0 MB/s 2024-09-15T23:12:33.511 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:12:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:12:33.517 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-09-15T23:12:33.517 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T23:12:33.518 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-15T23:12:33.518 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:12:33.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.626+0000 7f3508bb7640 1 Processor -- start 2024-09-15T23:12:33.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.626+0000 7f3508bb7640 1 -- start start 2024-09-15T23:12:33.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.627+0000 7f3508bb7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f350415e960 0x7f35040d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:33.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.627+0000 7f3508bb7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f35040cefa0 0x7f35040cf410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:33.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.627+0000 7f3508bb7640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f350406d080 con 0x7f35040d0840 2024-09-15T23:12:33.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.627+0000 7f3508bb7640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f35040cf950 con 0x7f35040cefa0 2024-09-15T23:12:33.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.627+0000 7f3508bb7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f350406d360 con 0x7f350415e960 2024-09-15T23:12:33.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.627+0000 7f3502d9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f35040cefa0 0x7f35040cf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:33.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.627+0000 7f3502d9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f35040cefa0 0x7f35040cf410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48332/0 (socket says 172.21.15.123:48332) 2024-09-15T23:12:33.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.627+0000 7f3502d9d640 1 -- 172.21.15.123:0/1786931678 learned_addr learned my addr 172.21.15.123:0/1786931678 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:33.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.628+0000 7f350259c640 1 --2- 172.21.15.123:0/1786931678 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f350415e960 0x7f35040d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:33.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.628+0000 7f3502d9d640 1 -- 172.21.15.123:0/1786931678 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f350415e960 msgr2=0x7f35040d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:33.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.628+0000 7f3502d9d640 1 --2- 172.21.15.123:0/1786931678 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f350415e960 0x7f35040d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:33.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.628+0000 7f3502d9d640 1 -- 172.21.15.123:0/1786931678 >> v1:172.21.15.188:6789/0 conn(0x7f35040d0840 legacy=0x7f35040cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:33.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.628+0000 7f3502d9d640 1 -- 172.21.15.123:0/1786931678 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f350406d640 con 0x7f35040cefa0 2024-09-15T23:12:33.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.628+0000 7f350259c640 1 --2- 172.21.15.123:0/1786931678 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f350415e960 0x7f35040d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:33.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.628+0000 7f3502d9d640 1 --2- 172.21.15.123:0/1786931678 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35040cefa0 0x7f35040cf410 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f34fc009870 tx=0x7f34fc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bac53e9dec11c071 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:33.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.629+0000 7f350159a640 1 -- 172.21.15.123:0/1786931678 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc037070 con 0x7f35040cefa0 2024-09-15T23:12:33.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.629+0000 7f350159a640 1 -- 172.21.15.123:0/1786931678 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34fc032440 con 0x7f35040cefa0 2024-09-15T23:12:33.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.629+0000 7f350159a640 1 -- 172.21.15.123:0/1786931678 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34fc032810 con 0x7f35040cefa0 2024-09-15T23:12:33.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.629+0000 7f3508bb7640 1 -- 172.21.15.123:0/1786931678 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35040cefa0 msgr2=0x7f35040cf410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:33.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.629+0000 7f3508bb7640 1 --2- 172.21.15.123:0/1786931678 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35040cefa0 0x7f35040cf410 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f34fc009870 tx=0x7f34fc02a1c0 comp rx=0 tx=0).stop 2024-09-15T23:12:33.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.629+0000 7f3508bb7640 1 -- 172.21.15.123:0/1786931678 shutdown_connections 2024-09-15T23:12:33.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.629+0000 7f3508bb7640 1 --2- 172.21.15.123:0/1786931678 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35040cefa0 0x7f35040cf410 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:33.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.629+0000 7f3508bb7640 1 --2- 172.21.15.123:0/1786931678 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f350415e960 0x7f35040d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:33.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.629+0000 7f3508bb7640 1 -- 172.21.15.123:0/1786931678 >> 172.21.15.123:0/1786931678 conn(0x7f35040b4300 msgr2=0x7f35040b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:33.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.629+0000 7f3508bb7640 1 -- 172.21.15.123:0/1786931678 shutdown_connections 2024-09-15T23:12:33.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.629+0000 7f3508bb7640 1 -- 172.21.15.123:0/1786931678 wait complete. 2024-09-15T23:12:33.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.631+0000 7f3508bb7640 1 Processor -- start 2024-09-15T23:12:33.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.631+0000 7f3508bb7640 1 -- start start 2024-09-15T23:12:33.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.631+0000 7f3508bb7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35040cefa0 0x7f35041e7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:33.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.631+0000 7f3508bb7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f35040d0840 0x7f3504160ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:33.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.631+0000 7f3508bb7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f350415e960 0x7f350414fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:33.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.631+0000 7f3508bb7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f35040cc8d0 con 0x7f35040cefa0 2024-09-15T23:12:33.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.631+0000 7f3508bb7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f350415ed40 con 0x7f35040d0840 2024-09-15T23:12:33.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.631+0000 7f3508bb7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f35040cca50 con 0x7f350415e960 2024-09-15T23:12:33.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.631+0000 7f350259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35040cefa0 0x7f35041e7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:33.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.631+0000 7f350259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35040cefa0 0x7f35041e7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48338/0 (socket says 172.21.15.123:48338) 2024-09-15T23:12:33.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.631+0000 7f350259c640 1 -- 172.21.15.123:0/3784015298 learned_addr learned my addr 172.21.15.123:0/3784015298 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:33.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.631+0000 7f3501d9b640 1 --2- 172.21.15.123:0/3784015298 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f35040d0840 0x7f3504160ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:33.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.632+0000 7f3502d9d640 1 --2- 172.21.15.123:0/3784015298 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f350415e960 0x7f350414fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:33.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.632+0000 7f350259c640 1 -- 172.21.15.123:0/3784015298 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f350415e960 msgr2=0x7f350414fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:33.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.632+0000 7f350259c640 1 --2- 172.21.15.123:0/3784015298 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f350415e960 0x7f350414fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:33.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.632+0000 7f350259c640 1 -- 172.21.15.123:0/3784015298 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f35040d0840 msgr2=0x7f3504160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:33.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.632+0000 7f350259c640 1 --2- 172.21.15.123:0/3784015298 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f35040d0840 0x7f3504160ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:33.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.632+0000 7f350259c640 1 -- 172.21.15.123:0/3784015298 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f350415f970 con 0x7f35040cefa0 2024-09-15T23:12:33.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.632+0000 7f350259c640 1 --2- 172.21.15.123:0/3784015298 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35040cefa0 0x7f35041e7180 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f34f4007fa0 tx=0x7f34f400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:33.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.632+0000 7f34f2ffd640 1 -- 172.21.15.123:0/3784015298 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f401a070 con 0x7f35040cefa0 2024-09-15T23:12:33.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.632+0000 7f34f2ffd640 1 -- 172.21.15.123:0/3784015298 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34f4003b90 con 0x7f35040cefa0 2024-09-15T23:12:33.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.632+0000 7f3508bb7640 1 -- 172.21.15.123:0/3784015298 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f350415fc50 con 0x7f35040cefa0 2024-09-15T23:12:33.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.632+0000 7f34f2ffd640 1 -- 172.21.15.123:0/3784015298 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f4004030 con 0x7f35040cefa0 2024-09-15T23:12:33.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.632+0000 7f3508bb7640 1 -- 172.21.15.123:0/3784015298 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3504160210 con 0x7f35040cefa0 2024-09-15T23:12:33.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.633+0000 7f3508bb7640 1 -- 172.21.15.123:0/3784015298 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35040cf410 con 0x7f35040cefa0 2024-09-15T23:12:33.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.634+0000 7f34f2ffd640 1 -- 172.21.15.123:0/3784015298 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f34f401d070 con 0x7f35040cefa0 2024-09-15T23:12:33.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.634+0000 7f34f2ffd640 1 --2- 172.21.15.123:0/3784015298 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f34e406c2b0 0x7f34e406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:33.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.634+0000 7f34f2ffd640 1 -- 172.21.15.123:0/3784015298 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f34f408b730 con 0x7f35040cefa0 2024-09-15T23:12:33.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.634+0000 7f3501d9b640 1 --2- 172.21.15.123:0/3784015298 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f34e406c2b0 0x7f34e406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:33.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.635+0000 7f3501d9b640 1 --2- 172.21.15.123:0/3784015298 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f34e406c2b0 0x7f34e406e770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f35041e9f10 tx=0x7f34f8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:33.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.638+0000 7f34f2ffd640 1 -- 172.21.15.123:0/3784015298 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f34f4010070 con 0x7f35040cefa0 2024-09-15T23:12:33.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.834+0000 7f3508bb7640 1 -- 172.21.15.123:0/3784015298 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f35040cbe40 con 0x7f35040cefa0 2024-09-15T23:12:33.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.835+0000 7f34f2ffd640 1 -- 172.21.15.123:0/3784015298 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f34f40597c0 con 0x7f35040cefa0 2024-09-15T23:12:33.837 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:12:33.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.836+0000 7f3508bb7640 1 -- 172.21.15.123:0/3784015298 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f34e406c2b0 msgr2=0x7f34e406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:33.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.836+0000 7f3508bb7640 1 --2- 172.21.15.123:0/3784015298 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f34e406c2b0 0x7f34e406e770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f35041e9f10 tx=0x7f34f8009040 comp rx=0 tx=0).stop 2024-09-15T23:12:33.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.836+0000 7f3508bb7640 1 -- 172.21.15.123:0/3784015298 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35040cefa0 msgr2=0x7f35041e7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:33.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.836+0000 7f3508bb7640 1 --2- 172.21.15.123:0/3784015298 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35040cefa0 0x7f35041e7180 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f34f4007fa0 tx=0x7f34f400d560 comp rx=0 tx=0).stop 2024-09-15T23:12:33.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.836+0000 7f3508bb7640 1 -- 172.21.15.123:0/3784015298 shutdown_connections 2024-09-15T23:12:33.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.836+0000 7f3508bb7640 1 --2- 172.21.15.123:0/3784015298 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f350415e960 0x7f350414fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:33.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.836+0000 7f3508bb7640 1 --2- 172.21.15.123:0/3784015298 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f35040d0840 0x7f3504160ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:33.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.837+0000 7f3508bb7640 1 --2- 172.21.15.123:0/3784015298 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f34e406c2b0 0x7f34e406e770 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:33.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.837+0000 7f3508bb7640 1 --2- 172.21.15.123:0/3784015298 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35040cefa0 0x7f35041e7180 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:33.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.837+0000 7f3508bb7640 1 -- 172.21.15.123:0/3784015298 >> 172.21.15.123:0/3784015298 conn(0x7f35040b4300 msgr2=0x7f350415d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:33.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.837+0000 7f3508bb7640 1 -- 172.21.15.123:0/3784015298 shutdown_connections 2024-09-15T23:12:33.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:33.837+0000 7f3508bb7640 1 -- 172.21.15.123:0/3784015298 wait complete. 2024-09-15T23:12:33.849 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T23:12:33.849 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:12:33.850 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi188.front.sepia.ceph.com 2024-09-15T23:12:33.850 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-15T23:12:33.850 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-15T23:12:33.850 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T23:12:33.850 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T23:12:33.850 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:12:33.850 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-15T23:12:33.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:33.850 DEBUG:teuthology.orchestra.run.smithi188:> ip addr 2024-09-15T23:12:33.867 INFO:teuthology.orchestra.run.smithi188.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:12:33.868 INFO:teuthology.orchestra.run.smithi188.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:12:33.868 INFO:teuthology.orchestra.run.smithi188.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:12:33.868 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:12:33.868 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 ::1/128 scope host 2024-09-15T23:12:33.868 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:12:33.868 INFO:teuthology.orchestra.run.smithi188.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:12:33.868 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:d9:37:48 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:12:33.868 INFO:teuthology.orchestra.run.smithi188.stdout: altname enp7s0f0 2024-09-15T23:12:33.869 INFO:teuthology.orchestra.run.smithi188.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:12:33.869 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:d9:37:49 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:12:33.869 INFO:teuthology.orchestra.run.smithi188.stdout: altname enp7s0f1 2024-09-15T23:12:33.869 INFO:teuthology.orchestra.run.smithi188.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:12:33.869 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:88:80:38 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:12:33.869 INFO:teuthology.orchestra.run.smithi188.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:12:33.869 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:88:80:39 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:12:33.869 INFO:teuthology.orchestra.run.smithi188.stdout: inet 172.21.15.188/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T23:12:33.869 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft 42775sec preferred_lft 42775sec 2024-09-15T23:12:33.869 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 fe80::ec4:7aff:fe88:8039/64 scope link noprefixroute 2024-09-15T23:12:33.869 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:12:33.869 INFO:teuthology.orchestra.run.smithi188.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:12:33.869 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 1e:48:23:40:41:33 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:12:33.870 INFO:teuthology.orchestra.run.smithi188.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:12:33.870 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:12:33.870 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 fe80::24e3:76ff:fec1:80cf/64 scope link 2024-09-15T23:12:33.870 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:12:33.870 INFO:teuthology.orchestra.run.smithi188.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:12:33.870 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 1e:48:23:40:41:33 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:12:33.870 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 fe80::1c48:23ff:fe40:4133/64 scope link tentative 2024-09-15T23:12:33.870 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:12:33.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:33.871 DEBUG:teuthology.orchestra.run.smithi188:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:12:33.932 INFO:teuthology.orchestra.run.smithi188.stdout:1 2024-09-15T23:12:33.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:33.934 DEBUG:teuthology.orchestra.run.smithi188:> route 2024-09-15T23:12:33.990 INFO:teuthology.orchestra.run.smithi188.stdout:Kernel IP routing table 2024-09-15T23:12:33.990 INFO:teuthology.orchestra.run.smithi188.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:12:33.990 INFO:teuthology.orchestra.run.smithi188.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:12:33.990 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:12:33.990 INFO:teuthology.orchestra.run.smithi188.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:12:33.990 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:12:33.991 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2024-09-15T23:12:33.991 DEBUG:teuthology.orchestra.run.smithi188:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:12:33.991 DEBUG:teuthology.orchestra.run.smithi188:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:12:33.991 DEBUG:teuthology.orchestra.run.smithi188:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:12:33.991 DEBUG:teuthology.orchestra.run.smithi188:> ') 2024-09-15T23:12:34.078 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:12:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:12:34.110 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:12:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:12:34.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:34.116 DEBUG:teuthology.orchestra.run.smithi188:> ip netns list 2024-09-15T23:12:34.131 INFO:teuthology.orchestra.run.smithi188.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-15T23:12:34.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:34.132 DEBUG:teuthology.orchestra.run.smithi188:> ip netns list-id 2024-09-15T23:12:34.187 INFO:teuthology.orchestra.run.smithi188.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-15T23:12:34.187 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:12:34.187 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2024-09-15T23:12:34.187 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-15T23:12:34.188 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-15T23:12:34.188 DEBUG:teuthology.orchestra.run.smithi188:> ') 2024-09-15T23:12:34.275 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:12:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:12:34.297 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:12:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:12:34.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:34.304 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-15T23:12:34.328 INFO:teuthology.orchestra.run.smithi188.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:12:34.328 INFO:teuthology.orchestra.run.smithi188.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:12:34.329 INFO:teuthology.orchestra.run.smithi188.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:12:34.329 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:12:34.329 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 ::1/128 scope host 2024-09-15T23:12:34.329 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:12:34.329 INFO:teuthology.orchestra.run.smithi188.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:12:34.329 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0e:89:5f:33:0c:8f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-15T23:12:34.329 INFO:teuthology.orchestra.run.smithi188.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-15T23:12:34.329 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:12:34.329 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 fe80::c89:5fff:fe33:c8f/64 scope link tentative 2024-09-15T23:12:34.329 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:12:34.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:34.330 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-15T23:12:34.396 INFO:teuthology.orchestra.run.smithi188.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:12:34.396 INFO:teuthology.orchestra.run.smithi188.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:12:34.396 INFO:teuthology.orchestra.run.smithi188.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:12:34.396 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:12:34.396 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 ::1/128 scope host 2024-09-15T23:12:34.396 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:12:34.396 INFO:teuthology.orchestra.run.smithi188.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:12:34.397 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0e:89:5f:33:0c:8f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-15T23:12:34.397 INFO:teuthology.orchestra.run.smithi188.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-15T23:12:34.397 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:12:34.397 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 fe80::c89:5fff:fe33:c8f/64 scope link tentative 2024-09-15T23:12:34.397 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:12:34.398 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-15T23:12:34.398 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:12:34.398 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2024-09-15T23:12:34.398 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-15T23:12:34.398 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-15T23:12:34.399 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-15T23:12:34.399 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-15T23:12:34.399 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-15T23:12:34.399 DEBUG:teuthology.orchestra.run.smithi188:> ') 2024-09-15T23:12:34.486 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:12:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:12:34.544 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:12:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:12:34.550 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:12:34.550 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2024-09-15T23:12:34.550 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link set brx.1 up 2024-09-15T23:12:34.550 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link set dev brx.1 master ceph-brx 2024-09-15T23:12:34.550 DEBUG:teuthology.orchestra.run.smithi188:> ') 2024-09-15T23:12:34.600 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:12:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:12:34.632 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:12:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:12:34.638 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:12:34.638 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-15T23:12:34.653 INFO:teuthology.orchestra.run.smithi188.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-15T23:12:34.653 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:12:34.654 DEBUG:teuthology.orchestra.run.smithi188:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-15T23:12:34.708 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T23:12:34.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:34.709 DEBUG:teuthology.orchestra.run.smithi188:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-15T23:12:34.792 INFO:teuthology.orchestra.run.smithi188.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-15T23:12:34.792 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-15T23:12:34.792 INFO:teuthology.orchestra.run.smithi188.stdout:invalid new device string format 2024-09-15T23:12:34.801 INFO:teuthology.orchestra.run.smithi188.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-15T23:12:34.801 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-15T23:12:34.801 INFO:teuthology.orchestra.run.smithi188.stdout:invalid new device string format 2024-09-15T23:12:34.801 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.188:3300,172.21.15.188:3301" 2024-09-15T23:12:34.801 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T23:12:34.805 INFO:teuthology.orchestra.run.smithi188.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-15T23:12:34.806 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-15T23:12:34.806 INFO:teuthology.orchestra.run.smithi188.stdout:invalid new device string format 2024-09-15T23:12:34.806 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.188:3300,172.21.15.188:3301" 2024-09-15T23:12:34.806 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T23:12:34.806 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: resolved to: "172.21.15.123:6789,172.21.15.188:6789,172.21.15.188:6790" 2024-09-15T23:12:34.807 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.123:6789,172.21.15.188:6789,172.21.15.188:6790:/ 2024-09-15T23:12:34.807 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=cb968ac4-8d3a-4b17-a673-6177aeaea589" will pass to kernel 2024-09-15T23:12:34.807 INFO:teuthology.orchestra.run.smithi188.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-15T23:12:34.807 INFO:teuthology.orchestra.run.smithi188.stdout: You just mounted a file system that supports labels which does not 2024-09-15T23:12:34.808 INFO:teuthology.orchestra.run.smithi188.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T23:12:34.808 INFO:teuthology.orchestra.run.smithi188.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T23:12:34.808 INFO:teuthology.orchestra.run.smithi188.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T23:12:34.809 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T23:12:34.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:34.810 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-15T23:12:34.875 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T23:12:34.963 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:12:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:12:34.965 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:12:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:12:34.971 INFO:teuthology.orchestra.run.smithi188.stdout:client4478 2024-09-15T23:12:34.971 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:12:34.971 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:12:34.988 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T23:12:35.075 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:12:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:12:35.077 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:12:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:12:35.083 INFO:teuthology.orchestra.run.smithi188.stdout:client4478 2024-09-15T23:12:35.084 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T23:12:35.132 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:12:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:12:35.133 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:12:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:12:35.139 INFO:teuthology.orchestra.run.smithi188.stdout:client4478 2024-09-15T23:12:35.139 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/cb968ac4-8d3a-4b17-a673-6177aeaea589.client4478/status') 2024-09-15T23:12:35.187 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:12:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:12:35.196 INFO:teuthology.orchestra.run.smithi188.stdout:instance: client.4478 (3)192.168.0.2:0/4261536749 2024-09-15T23:12:35.197 INFO:teuthology.orchestra.run.smithi188.stdout:blocklisted: false 2024-09-15T23:12:35.197 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records in 2024-09-15T23:12:35.197 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records out 2024-09-15T23:12:35.197 INFO:teuthology.orchestra.run.smithi188.stderr:69 bytes copied, 2.1714e-05 s, 3.2 MB/s 2024-09-15T23:12:35.197 INFO:teuthology.orchestra.run.smithi188.stderr:2024-09-15T23:12:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:12:35.204 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-15T23:12:35.263 INFO:tasks.cephfs_test_runner:Starting test: test_flag_scrub_mdsdir (tasks.cephfs.test_scrub_checks.TestScrubChecks) test flag scrub_mdsdir 2024-09-15T23:12:35.263 INFO:tasks.cephfs_test_runner:test_flag_scrub_mdsdir (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-15T23:12:35.263 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:12:35.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.382+0000 7f69e97c6640 1 Processor -- start 2024-09-15T23:12:35.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.382+0000 7f69e97c6640 1 -- start start 2024-09-15T23:12:35.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.382+0000 7f69e97c6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69e40cfd00 0x7f69e40b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:35.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.382+0000 7f69e97c6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f69e40b4800 0x7f69e40d0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:35.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.382+0000 7f69e97c6640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69e40d22a0 con 0x7f69e415e910 2024-09-15T23:12:35.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.383+0000 7f69e97c6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f69e415ecf0 con 0x7f69e40b4800 2024-09-15T23:12:35.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.383+0000 7f69e97c6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f69e40d2e70 con 0x7f69e40cfd00 2024-09-15T23:12:35.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.383+0000 7f69e37fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f69e40b4800 0x7f69e40d0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:35.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.383+0000 7f69dbfff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69e40cfd00 0x7f69e40b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:35.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.383+0000 7f69e2ffd640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f69e415e910 0x7f69e40731a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:58518/0 (socket says 172.21.15.123:58518) 2024-09-15T23:12:35.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.383+0000 7f69e2ffd640 1 -- 172.21.15.123:0/4289489148 learned_addr learned my addr 172.21.15.123:0/4289489148 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:35.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.383+0000 7f69e37fe640 1 -- 172.21.15.123:0/4289489148 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69e40cfd00 msgr2=0x7f69e40b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:35.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.383+0000 7f69e37fe640 1 --2- 172.21.15.123:0/4289489148 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69e40cfd00 0x7f69e40b42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:35.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.383+0000 7f69e37fe640 1 -- 172.21.15.123:0/4289489148 >> v1:172.21.15.188:6789/0 conn(0x7f69e415e910 legacy=0x7f69e40731a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:35.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.383+0000 7f69e27fc640 1 -- 172.21.15.123:0/4289489148 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1540072146 0 0) 0x7f69e40d22a0 con 0x7f69e415e910 2024-09-15T23:12:35.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.383+0000 7f69e37fe640 1 -- 172.21.15.123:0/4289489148 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e40d2540 con 0x7f69e40b4800 2024-09-15T23:12:35.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.383+0000 7f69dbfff640 1 --2- 172.21.15.123:0/4289489148 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69e40cfd00 0x7f69e40b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:12:35.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.384+0000 7f69e37fe640 1 --2- 172.21.15.123:0/4289489148 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69e40b4800 0x7f69e40d0230 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f69dc009d90 tx=0x7f69dc02a530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7713de7196c76d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:35.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.384+0000 7f69e27fc640 1 -- 172.21.15.123:0/4289489148 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc007740 con 0x7f69e40b4800 2024-09-15T23:12:35.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.384+0000 7f69e27fc640 1 -- 172.21.15.123:0/4289489148 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69dc0078e0 con 0x7f69e40b4800 2024-09-15T23:12:35.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.384+0000 7f69e27fc640 1 -- 172.21.15.123:0/4289489148 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc007cb0 con 0x7f69e40b4800 2024-09-15T23:12:35.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.385+0000 7f69e97c6640 1 -- 172.21.15.123:0/4289489148 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69e40b4800 msgr2=0x7f69e40d0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:35.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.385+0000 7f69e97c6640 1 --2- 172.21.15.123:0/4289489148 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69e40b4800 0x7f69e40d0230 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f69dc009d90 tx=0x7f69dc02a530 comp rx=0 tx=0).stop 2024-09-15T23:12:35.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.385+0000 7f69e97c6640 1 -- 172.21.15.123:0/4289489148 shutdown_connections 2024-09-15T23:12:35.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.385+0000 7f69e97c6640 1 --2- 172.21.15.123:0/4289489148 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69e40b4800 0x7f69e40d0230 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:35.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.385+0000 7f69e97c6640 1 --2- 172.21.15.123:0/4289489148 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69e40cfd00 0x7f69e40b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:35.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.385+0000 7f69e97c6640 1 -- 172.21.15.123:0/4289489148 >> 172.21.15.123:0/4289489148 conn(0x7f69e4067950 msgr2=0x7f69e4067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:35.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.385+0000 7f69e97c6640 1 -- 172.21.15.123:0/4289489148 shutdown_connections 2024-09-15T23:12:35.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.385+0000 7f69e97c6640 1 -- 172.21.15.123:0/4289489148 wait complete. 2024-09-15T23:12:35.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.387+0000 7f69e97c6640 1 Processor -- start 2024-09-15T23:12:35.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.387+0000 7f69e97c6640 1 -- start start 2024-09-15T23:12:35.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.387+0000 7f69e97c6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69e40b4800 0x7f69e4158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:35.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.387+0000 7f69e97c6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69e40cfd00 0x7f69e406f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:35.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.387+0000 7f69e97c6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69e415e910 0x7f69e406f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:35.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.387+0000 7f69e97c6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f69e40d3300 con 0x7f69e40cfd00 2024-09-15T23:12:35.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.387+0000 7f69e97c6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f69e40d2b00 con 0x7f69e40b4800 2024-09-15T23:12:35.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.387+0000 7f69e97c6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f69e40d3480 con 0x7f69e415e910 2024-09-15T23:12:35.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.387+0000 7f69dbfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69e40cfd00 0x7f69e406f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:35.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.388+0000 7f69dbfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69e40cfd00 0x7f69e406f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48346/0 (socket says 172.21.15.123:48346) 2024-09-15T23:12:35.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.388+0000 7f69dbfff640 1 -- 172.21.15.123:0/3086795826 learned_addr learned my addr 172.21.15.123:0/3086795826 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:35.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.388+0000 7f69e37fe640 1 --2- 172.21.15.123:0/3086795826 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69e415e910 0x7f69e406f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:35.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.388+0000 7f69e2ffd640 1 --2- 172.21.15.123:0/3086795826 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69e40b4800 0x7f69e4158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:35.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.388+0000 7f69dbfff640 1 -- 172.21.15.123:0/3086795826 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69e415e910 msgr2=0x7f69e406f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:35.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.388+0000 7f69dbfff640 1 --2- 172.21.15.123:0/3086795826 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69e415e910 0x7f69e406f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:35.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.388+0000 7f69dbfff640 1 -- 172.21.15.123:0/3086795826 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69e40b4800 msgr2=0x7f69e4158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:35.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.388+0000 7f69dbfff640 1 --2- 172.21.15.123:0/3086795826 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69e40b4800 0x7f69e4158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:35.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.388+0000 7f69dbfff640 1 -- 172.21.15.123:0/3086795826 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e40b65b0 con 0x7f69e40cfd00 2024-09-15T23:12:35.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.388+0000 7f69dbfff640 1 --2- 172.21.15.123:0/3086795826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69e40cfd00 0x7f69e406f400 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f69cc00ebb0 tx=0x7f69cc00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:35.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.388+0000 7f69db7fe640 1 -- 172.21.15.123:0/3086795826 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69cc017070 con 0x7f69e40cfd00 2024-09-15T23:12:35.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.388+0000 7f69db7fe640 1 -- 172.21.15.123:0/3086795826 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69cc00cc30 con 0x7f69e40cfd00 2024-09-15T23:12:35.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.388+0000 7f69e97c6640 1 -- 172.21.15.123:0/3086795826 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69e415fd10 con 0x7f69e40cfd00 2024-09-15T23:12:35.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.388+0000 7f69db7fe640 1 -- 172.21.15.123:0/3086795826 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69cc013470 con 0x7f69e40cfd00 2024-09-15T23:12:35.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.388+0000 7f69e97c6640 1 -- 172.21.15.123:0/3086795826 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69e4158570 con 0x7f69e40cfd00 2024-09-15T23:12:35.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.389+0000 7f69e97c6640 1 -- 172.21.15.123:0/3086795826 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69e40b42c0 con 0x7f69e40cfd00 2024-09-15T23:12:35.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.390+0000 7f69db7fe640 1 -- 172.21.15.123:0/3086795826 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f69cc01a070 con 0x7f69e40cfd00 2024-09-15T23:12:35.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.390+0000 7f69db7fe640 1 --2- 172.21.15.123:0/3086795826 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f69c406c2b0 0x7f69c406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:35.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.390+0000 7f69db7fe640 1 -- 172.21.15.123:0/3086795826 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f69cc08b720 con 0x7f69e40cfd00 2024-09-15T23:12:35.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.391+0000 7f69e2ffd640 1 --2- 172.21.15.123:0/3086795826 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f69c406c2b0 0x7f69c406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:35.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.391+0000 7f69e2ffd640 1 --2- 172.21.15.123:0/3086795826 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f69c406c2b0 0x7f69c406e770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f69d4000f60 tx=0x7f69d4007b50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:35.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.395+0000 7f69db7fe640 1 -- 172.21.15.123:0/3086795826 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f69cc059ea0 con 0x7f69e40cfd00 2024-09-15T23:12:35.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.563+0000 7f69e97c6640 1 -- 172.21.15.123:0/3086795826 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f69e40d1220 con 0x7f69e40cfd00 2024-09-15T23:12:35.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.565+0000 7f69db7fe640 1 -- 172.21.15.123:0/3086795826 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16693 (secure 0 0 0) 0x7f69cc0597a0 con 0x7f69e40cfd00 2024-09-15T23:12:35.566 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:35.566 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":22,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:12:14.277829+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:12:10.289254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:12:11.594152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:12:35.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.567+0000 7f69e97c6640 1 -- 172.21.15.123:0/3086795826 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f69c406c2b0 msgr2=0x7f69c406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:35.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.567+0000 7f69e97c6640 1 --2- 172.21.15.123:0/3086795826 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f69c406c2b0 0x7f69c406e770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f69d4000f60 tx=0x7f69d4007b50 comp rx=0 tx=0).stop 2024-09-15T23:12:35.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.567+0000 7f69e97c6640 1 -- 172.21.15.123:0/3086795826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69e40cfd00 msgr2=0x7f69e406f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:35.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.567+0000 7f69e97c6640 1 --2- 172.21.15.123:0/3086795826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69e40cfd00 0x7f69e406f400 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f69cc00ebb0 tx=0x7f69cc00c520 comp rx=0 tx=0).stop 2024-09-15T23:12:35.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.567+0000 7f69e97c6640 1 -- 172.21.15.123:0/3086795826 shutdown_connections 2024-09-15T23:12:35.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.567+0000 7f69e97c6640 1 --2- 172.21.15.123:0/3086795826 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69e415e910 0x7f69e406f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:35.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.567+0000 7f69e97c6640 1 --2- 172.21.15.123:0/3086795826 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f69c406c2b0 0x7f69c406e770 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:35.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.567+0000 7f69e97c6640 1 --2- 172.21.15.123:0/3086795826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69e40cfd00 0x7f69e406f400 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:35.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.567+0000 7f69e97c6640 1 --2- 172.21.15.123:0/3086795826 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69e40b4800 0x7f69e4158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:35.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.567+0000 7f69e97c6640 1 -- 172.21.15.123:0/3086795826 >> 172.21.15.123:0/3086795826 conn(0x7f69e4067950 msgr2=0x7f69e40cf0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:35.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.567+0000 7f69e97c6640 1 -- 172.21.15.123:0/3086795826 shutdown_connections 2024-09-15T23:12:35.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.567+0000 7f69e97c6640 1 -- 172.21.15.123:0/3086795826 wait complete. 2024-09-15T23:12:35.579 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T23:12:01.531886+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-15T23:12:10.289254+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-15T23:12:11.594152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T23:12:35.579 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T23:12:35.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.680+0000 7f33bd733640 1 Processor -- start 2024-09-15T23:12:35.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.680+0000 7f33bd733640 1 -- start start 2024-09-15T23:12:35.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.681+0000 7f33bd733640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33b806bfd0 0x7f33b806c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:35.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.681+0000 7f33bd733640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f33b80d3930 0x7f33b8162ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:35.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.681+0000 7f33bd733640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33b806c8f0 con 0x7f33b80b3350 2024-09-15T23:12:35.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.681+0000 7f33bd733640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f33b80b78a0 con 0x7f33b80d3930 2024-09-15T23:12:35.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.681+0000 7f33bd733640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f33b80cffb0 con 0x7f33b806bfd0 2024-09-15T23:12:35.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.681+0000 7f33b77fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f33b80d3930 0x7f33b8162ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:35.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.681+0000 7f33b77fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f33b80d3930 0x7f33b8162ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48352/0 (socket says 172.21.15.123:48352) 2024-09-15T23:12:35.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.681+0000 7f33b77fe640 1 -- 172.21.15.123:0/3968152220 learned_addr learned my addr 172.21.15.123:0/3968152220 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:35.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.681+0000 7f33b6ffd640 1 --2- 172.21.15.123:0/3968152220 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33b806bfd0 0x7f33b806c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:35.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.681+0000 7f33b5ffb640 1 -- 172.21.15.123:0/3968152220 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1881807958 0 0) 0x7f33b806c8f0 con 0x7f33b80b3350 2024-09-15T23:12:35.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.681+0000 7f33b77fe640 1 -- 172.21.15.123:0/3968152220 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33b806bfd0 msgr2=0x7f33b806c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:35.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.681+0000 7f33b77fe640 1 --2- 172.21.15.123:0/3968152220 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33b806bfd0 0x7f33b806c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:35.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.681+0000 7f33b77fe640 1 -- 172.21.15.123:0/3968152220 >> v1:172.21.15.188:6789/0 conn(0x7f33b80b3350 legacy=0x7f33b81623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:35.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.681+0000 7f33b77fe640 1 -- 172.21.15.123:0/3968152220 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b80cf710 con 0x7f33b80d3930 2024-09-15T23:12:35.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.682+0000 7f33b77fe640 1 --2- 172.21.15.123:0/3968152220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33b80d3930 0x7f33b8162ab0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f33b0009e80 tx=0x7f33b002a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af96c68ce9529cd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:35.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.682+0000 7f33b5ffb640 1 -- 172.21.15.123:0/3968152220 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b0036070 con 0x7f33b80d3930 2024-09-15T23:12:35.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.682+0000 7f33b5ffb640 1 -- 172.21.15.123:0/3968152220 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33b0031600 con 0x7f33b80d3930 2024-09-15T23:12:35.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.682+0000 7f33b5ffb640 1 -- 172.21.15.123:0/3968152220 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b00319d0 con 0x7f33b80d3930 2024-09-15T23:12:35.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.682+0000 7f33bd733640 1 -- 172.21.15.123:0/3968152220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33b80d3930 msgr2=0x7f33b8162ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:35.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.682+0000 7f33bd733640 1 --2- 172.21.15.123:0/3968152220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33b80d3930 0x7f33b8162ab0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f33b0009e80 tx=0x7f33b002a760 comp rx=0 tx=0).stop 2024-09-15T23:12:35.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.682+0000 7f33bd733640 1 -- 172.21.15.123:0/3968152220 shutdown_connections 2024-09-15T23:12:35.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.682+0000 7f33bd733640 1 --2- 172.21.15.123:0/3968152220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33b80d3930 0x7f33b8162ab0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:35.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.682+0000 7f33bd733640 1 --2- 172.21.15.123:0/3968152220 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33b806bfd0 0x7f33b806c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:35.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.682+0000 7f33bd733640 1 -- 172.21.15.123:0/3968152220 >> 172.21.15.123:0/3968152220 conn(0x7f33b80d11c0 msgr2=0x7f33b80d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:35.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.682+0000 7f33bd733640 1 -- 172.21.15.123:0/3968152220 shutdown_connections 2024-09-15T23:12:35.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.682+0000 7f33bd733640 1 -- 172.21.15.123:0/3968152220 wait complete. 2024-09-15T23:12:35.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.684+0000 7f33bd733640 1 Processor -- start 2024-09-15T23:12:35.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.684+0000 7f33bd733640 1 -- start start 2024-09-15T23:12:35.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.684+0000 7f33bd733640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33b806bfd0 0x7f33b8160de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:35.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.684+0000 7f33bd733640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33b80b3350 0x7f33b815ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:35.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.684+0000 7f33bd733640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33b80d3930 0x7f33b815dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:35.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.684+0000 7f33bd733640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f33b80d2400 con 0x7f33b806bfd0 2024-09-15T23:12:35.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.684+0000 7f33bd733640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f33b80cfcd0 con 0x7f33b80d3930 2024-09-15T23:12:35.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.684+0000 7f33bd733640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f33b806cd50 con 0x7f33b80b3350 2024-09-15T23:12:35.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.685+0000 7f33b6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33b806bfd0 0x7f33b8160de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:35.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.685+0000 7f33b6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33b806bfd0 0x7f33b8160de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48366/0 (socket says 172.21.15.123:48366) 2024-09-15T23:12:35.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.685+0000 7f33b6ffd640 1 -- 172.21.15.123:0/176915403 learned_addr learned my addr 172.21.15.123:0/176915403 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:35.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.685+0000 7f33b67fc640 1 --2- 172.21.15.123:0/176915403 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33b80b3350 0x7f33b815ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:35.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.685+0000 7f33b77fe640 1 --2- 172.21.15.123:0/176915403 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33b80d3930 0x7f33b815dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:35.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.685+0000 7f33b6ffd640 1 -- 172.21.15.123:0/176915403 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33b80b3350 msgr2=0x7f33b815ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:35.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.685+0000 7f33b6ffd640 1 --2- 172.21.15.123:0/176915403 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33b80b3350 0x7f33b815ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:35.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.685+0000 7f33b6ffd640 1 -- 172.21.15.123:0/176915403 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33b80d3930 msgr2=0x7f33b815dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:35.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.685+0000 7f33b6ffd640 1 --2- 172.21.15.123:0/176915403 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33b80d3930 0x7f33b815dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:35.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.685+0000 7f33b6ffd640 1 -- 172.21.15.123:0/176915403 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b815f230 con 0x7f33b806bfd0 2024-09-15T23:12:35.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.685+0000 7f33b6ffd640 1 --2- 172.21.15.123:0/176915403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33b806bfd0 0x7f33b8160de0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f33a800e9b0 tx=0x7f33a800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:35.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.685+0000 7f339f7fe640 1 -- 172.21.15.123:0/176915403 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a8017070 con 0x7f33b806bfd0 2024-09-15T23:12:35.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.685+0000 7f339f7fe640 1 -- 172.21.15.123:0/176915403 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33a800c9a0 con 0x7f33b806bfd0 2024-09-15T23:12:35.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.685+0000 7f33bd733640 1 -- 172.21.15.123:0/176915403 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33b815f4d0 con 0x7f33b806bfd0 2024-09-15T23:12:35.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.685+0000 7f339f7fe640 1 -- 172.21.15.123:0/176915403 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a800cd90 con 0x7f33b806bfd0 2024-09-15T23:12:35.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.685+0000 7f33bd733640 1 -- 172.21.15.123:0/176915403 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33b815fa90 con 0x7f33b806bfd0 2024-09-15T23:12:35.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.686+0000 7f33bd733640 1 -- 172.21.15.123:0/176915403 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33b815eae0 con 0x7f33b806bfd0 2024-09-15T23:12:35.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.687+0000 7f339f7fe640 1 -- 172.21.15.123:0/176915403 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f33a801a070 con 0x7f33b806bfd0 2024-09-15T23:12:35.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.687+0000 7f339f7fe640 1 --2- 172.21.15.123:0/176915403 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f33a406c2b0 0x7f33a406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:35.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.687+0000 7f339f7fe640 1 -- 172.21.15.123:0/176915403 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f33a808b320 con 0x7f33b806bfd0 2024-09-15T23:12:35.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.687+0000 7f33b67fc640 1 --2- 172.21.15.123:0/176915403 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f33a406c2b0 0x7f33a406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:35.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.688+0000 7f33b67fc640 1 --2- 172.21.15.123:0/176915403 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f33a406c2b0 0x7f33a406e770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f33b8076410 tx=0x7f33ac009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:35.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.691+0000 7f339f7fe640 1 -- 172.21.15.123:0/176915403 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f33a80594d0 con 0x7f33b806bfd0 2024-09-15T23:12:35.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.856+0000 7f33bd733640 1 -- 172.21.15.123:0/176915403 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f33b80d0cf0 con 0x7f33b806bfd0 2024-09-15T23:12:35.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.857+0000 7f339f7fe640 1 -- 172.21.15.123:0/176915403 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f33a805d7d0 con 0x7f33b806bfd0 2024-09-15T23:12:35.858 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-15T23:12:35.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.859+0000 7f33bd733640 1 -- 172.21.15.123:0/176915403 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f33a406c2b0 msgr2=0x7f33a406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:35.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.859+0000 7f33bd733640 1 --2- 172.21.15.123:0/176915403 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f33a406c2b0 0x7f33a406e770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f33b8076410 tx=0x7f33ac009040 comp rx=0 tx=0).stop 2024-09-15T23:12:35.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.859+0000 7f33bd733640 1 -- 172.21.15.123:0/176915403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33b806bfd0 msgr2=0x7f33b8160de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:35.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.859+0000 7f33bd733640 1 --2- 172.21.15.123:0/176915403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33b806bfd0 0x7f33b8160de0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f33a800e9b0 tx=0x7f33a800ee70 comp rx=0 tx=0).stop 2024-09-15T23:12:35.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.859+0000 7f33bd733640 1 -- 172.21.15.123:0/176915403 shutdown_connections 2024-09-15T23:12:35.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.859+0000 7f33bd733640 1 --2- 172.21.15.123:0/176915403 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33b80d3930 0x7f33b815dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:35.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.859+0000 7f33bd733640 1 --2- 172.21.15.123:0/176915403 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33b80b3350 0x7f33b815ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:35.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.859+0000 7f33bd733640 1 --2- 172.21.15.123:0/176915403 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f33a406c2b0 0x7f33a406e770 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:35.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.859+0000 7f33bd733640 1 --2- 172.21.15.123:0/176915403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33b806bfd0 0x7f33b8160de0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:35.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.859+0000 7f33bd733640 1 -- 172.21.15.123:0/176915403 >> 172.21.15.123:0/176915403 conn(0x7f33b80d11c0 msgr2=0x7f33b80b5820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:35.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.859+0000 7f33bd733640 1 -- 172.21.15.123:0/176915403 shutdown_connections 2024-09-15T23:12:35.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.859+0000 7f33bd733640 1 -- 172.21.15.123:0/176915403 wait complete. 2024-09-15T23:12:35.871 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-15T23:12:35.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.971+0000 7f35354fa640 1 Processor -- start 2024-09-15T23:12:35.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.971+0000 7f35354fa640 1 -- start start 2024-09-15T23:12:35.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.972+0000 7f35354fa640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f353006bfd0 0x7f353006c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:35.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.972+0000 7f35354fa640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f35300b3350 0x7f35301623a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:35.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.972+0000 7f35354fa640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f353006c8f0 con 0x7f35300b38a0 2024-09-15T23:12:35.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.972+0000 7f35354fa640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f35300b78a0 con 0x7f35300b3350 2024-09-15T23:12:35.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.972+0000 7f35354fa640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f35300cffb0 con 0x7f353006bfd0 2024-09-15T23:12:35.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.972+0000 7f352f7fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f35300b38a0 0x7f35301628e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:48076/0 (socket says 172.21.15.123:48076) 2024-09-15T23:12:35.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.972+0000 7f352f7fe640 1 -- 172.21.15.123:0/140245557 learned_addr learned my addr 172.21.15.123:0/140245557 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:35.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.972+0000 7f352e7fc640 1 --2- 172.21.15.123:0/140245557 >> v2:172.21.15.188:3300/0 conn(0x7f35300b3350 0x7f35301623a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:35.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.972+0000 7f352dffb640 1 -- 172.21.15.123:0/140245557 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4122749954 0 0) 0x7f353006c8f0 con 0x7f35300b38a0 2024-09-15T23:12:35.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.972+0000 7f352dffb640 1 -- 172.21.15.123:0/140245557 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3518003520 con 0x7f35300b38a0 2024-09-15T23:12:35.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.972+0000 7f352effd640 1 --2- 172.21.15.123:0/140245557 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f353006bfd0 0x7f353006c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:35.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.973+0000 7f352dffb640 1 -- 172.21.15.123:0/140245557 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2744437925 0 0) 0x7f3518003520 con 0x7f35300b38a0 2024-09-15T23:12:35.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.973+0000 7f352dffb640 1 -- 172.21.15.123:0/140245557 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f353006bfd0 msgr2=0x7f353006c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:35.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.973+0000 7f352dffb640 1 --2- 172.21.15.123:0/140245557 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f353006bfd0 0x7f353006c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:35.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.973+0000 7f352dffb640 1 -- 172.21.15.123:0/140245557 >> v2:172.21.15.188:3300/0 conn(0x7f35300b3350 msgr2=0x7f35301623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:35.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.973+0000 7f352dffb640 1 --2- 172.21.15.123:0/140245557 >> v2:172.21.15.188:3300/0 conn(0x7f35300b3350 0x7f35301623a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:35.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.973+0000 7f352dffb640 1 -- 172.21.15.123:0/140245557 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35300cf710 con 0x7f35300b38a0 2024-09-15T23:12:35.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.973+0000 7f352dffb640 1 -- 172.21.15.123:0/140245557 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f35280019f0 con 0x7f35300b38a0 2024-09-15T23:12:35.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.973+0000 7f352effd640 1 --2- 172.21.15.123:0/140245557 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f353006bfd0 0x7f353006c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:35.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.973+0000 7f352dffb640 1 -- 172.21.15.123:0/140245557 >> v1:172.21.15.123:6789/0 conn(0x7f35300b38a0 legacy=0x7f35301628e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:35.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.973+0000 7f352dffb640 1 --2- 172.21.15.123:0/140245557 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35180039e0 0x7f3518003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:35.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.973+0000 7f352dffb640 1 --2- 172.21.15.123:0/140245557 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f353006bfd0 0x7f3518004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:35.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.973+0000 7f352dffb640 1 --2- 172.21.15.123:0/140245557 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3518004d40 0x7f35180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:35.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.973+0000 7f352dffb640 1 -- 172.21.15.123:0/140245557 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f35300cffb0 con 0x7f35180039e0 2024-09-15T23:12:35.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.973+0000 7f352dffb640 1 -- 172.21.15.123:0/140245557 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f351800b9c0 con 0x7f3518004d40 2024-09-15T23:12:35.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.973+0000 7f352dffb640 1 -- 172.21.15.123:0/140245557 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f351800bb70 con 0x7f353006bfd0 2024-09-15T23:12:35.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.973+0000 7f352effd640 1 --2- 172.21.15.123:0/140245557 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35180039e0 0x7f3518003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:35.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.973+0000 7f352e7fc640 1 --2- 172.21.15.123:0/140245557 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f353006bfd0 0x7f3518004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:35.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.973+0000 7f352f7fe640 1 --2- 172.21.15.123:0/140245557 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3518004d40 0x7f35180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:35.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.973+0000 7f352effd640 1 -- 172.21.15.123:0/140245557 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f353006bfd0 msgr2=0x7f3518004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:35.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.973+0000 7f352effd640 1 --2- 172.21.15.123:0/140245557 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f353006bfd0 0x7f3518004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:35.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.973+0000 7f352effd640 1 -- 172.21.15.123:0/140245557 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3518004d40 msgr2=0x7f35180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:35.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.973+0000 7f352effd640 1 --2- 172.21.15.123:0/140245557 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3518004d40 0x7f35180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:35.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.973+0000 7f352effd640 1 -- 172.21.15.123:0/140245557 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3518003520 con 0x7f35180039e0 2024-09-15T23:12:35.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.974+0000 7f352effd640 1 --2- 172.21.15.123:0/140245557 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35180039e0 0x7f3518003e00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f35200098a0 tx=0x7f3518005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adc15d032c802b49 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:35.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.974+0000 7f352dffb640 1 -- 172.21.15.123:0/140245557 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352000f040 con 0x7f35180039e0 2024-09-15T23:12:35.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.974+0000 7f352dffb640 1 -- 172.21.15.123:0/140245557 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f352002ace0 con 0x7f35180039e0 2024-09-15T23:12:35.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.974+0000 7f352dffb640 1 -- 172.21.15.123:0/140245557 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3520004250 con 0x7f35180039e0 2024-09-15T23:12:35.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.974+0000 7f35354fa640 1 -- 172.21.15.123:0/140245557 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35180039e0 msgr2=0x7f3518003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:35.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.974+0000 7f35354fa640 1 --2- 172.21.15.123:0/140245557 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f35180039e0 0x7f3518003e00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f35200098a0 tx=0x7f3518005830 comp rx=0 tx=0).stop 2024-09-15T23:12:35.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.975+0000 7f352f7fe640 1 -- 172.21.15.123:0/140245557 reap_dead start 2024-09-15T23:12:35.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.975+0000 7f35354fa640 1 -- 172.21.15.123:0/140245557 shutdown_connections 2024-09-15T23:12:35.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.975+0000 7f35354fa640 1 -- 172.21.15.123:0/140245557 >> 172.21.15.123:0/140245557 conn(0x7f35300d11c0 msgr2=0x7f35300d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:35.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.975+0000 7f35354fa640 1 -- 172.21.15.123:0/140245557 shutdown_connections 2024-09-15T23:12:35.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.975+0000 7f35354fa640 1 -- 172.21.15.123:0/140245557 wait complete. 2024-09-15T23:12:35.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.976+0000 7f35354fa640 1 Processor -- start 2024-09-15T23:12:35.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.976+0000 7f35354fa640 1 -- start start 2024-09-15T23:12:35.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.977+0000 7f35354fa640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f35180039e0 0x7f3530160260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:35.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.977+0000 7f35354fa640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3530155570 0x7f3530156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:35.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.977+0000 7f35354fa640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3530156aa0 0x7f35301e8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:35.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.977+0000 7f35354fa640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f35300d2400 con 0x7f3530155570 2024-09-15T23:12:35.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.977+0000 7f35354fa640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f35300cfcd0 con 0x7f3530156aa0 2024-09-15T23:12:35.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.977+0000 7f35354fa640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f353006cd50 con 0x7f35180039e0 2024-09-15T23:12:35.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.977+0000 7f352e7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3530155570 0x7f3530156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:35.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.977+0000 7f352e7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3530155570 0x7f3530156560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48394/0 (socket says 172.21.15.123:48394) 2024-09-15T23:12:35.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.977+0000 7f352e7fc640 1 -- 172.21.15.123:0/1561980126 learned_addr learned my addr 172.21.15.123:0/1561980126 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:35.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.977+0000 7f352effd640 1 --2- 172.21.15.123:0/1561980126 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f35180039e0 0x7f3530160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:35.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.977+0000 7f352f7fe640 1 --2- 172.21.15.123:0/1561980126 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3530156aa0 0x7f35301e8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:35.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.977+0000 7f352e7fc640 1 -- 172.21.15.123:0/1561980126 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f35180039e0 msgr2=0x7f3530160260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:35.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.977+0000 7f352e7fc640 1 --2- 172.21.15.123:0/1561980126 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f35180039e0 0x7f3530160260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:35.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.977+0000 7f352e7fc640 1 -- 172.21.15.123:0/1561980126 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3530156aa0 msgr2=0x7f35301e8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:35.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.977+0000 7f352e7fc640 1 --2- 172.21.15.123:0/1561980126 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3530156aa0 0x7f35301e8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:35.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.977+0000 7f352e7fc640 1 -- 172.21.15.123:0/1561980126 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35301f4aa0 con 0x7f3530155570 2024-09-15T23:12:35.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.977+0000 7f352e7fc640 1 --2- 172.21.15.123:0/1561980126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3530155570 0x7f3530156560 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3524011990 tx=0x7f3524011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:35.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.977+0000 7f35177fe640 1 -- 172.21.15.123:0/1561980126 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3524019070 con 0x7f3530155570 2024-09-15T23:12:35.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.977+0000 7f35177fe640 1 -- 172.21.15.123:0/1561980126 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3524004240 con 0x7f3530155570 2024-09-15T23:12:35.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.977+0000 7f35354fa640 1 -- 172.21.15.123:0/1561980126 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f353015f1c0 con 0x7f3530155570 2024-09-15T23:12:35.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.977+0000 7f35177fe640 1 -- 172.21.15.123:0/1561980126 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352400f820 con 0x7f3530155570 2024-09-15T23:12:35.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.977+0000 7f35354fa640 1 -- 172.21.15.123:0/1561980126 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f353015f780 con 0x7f3530155570 2024-09-15T23:12:35.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.978+0000 7f35354fa640 1 -- 172.21.15.123:0/1561980126 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f353015eae0 con 0x7f3530155570 2024-09-15T23:12:35.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.979+0000 7f35177fe640 1 -- 172.21.15.123:0/1561980126 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f352401c070 con 0x7f3530155570 2024-09-15T23:12:35.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.979+0000 7f35177fe640 1 --2- 172.21.15.123:0/1561980126 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f351c06c2b0 0x7f351c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:35.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.979+0000 7f35177fe640 1 -- 172.21.15.123:0/1561980126 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f352408b570 con 0x7f3530155570 2024-09-15T23:12:35.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.980+0000 7f352effd640 1 --2- 172.21.15.123:0/1561980126 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f351c06c2b0 0x7f351c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:35.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.980+0000 7f352effd640 1 --2- 172.21.15.123:0/1561980126 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f351c06c2b0 0x7f351c06e770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3520033000 tx=0x7f352002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:35.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:35.984+0000 7f35177fe640 1 -- 172.21.15.123:0/1561980126 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3524059720 con 0x7f3530155570 2024-09-15T23:12:36.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.147+0000 7f35354fa640 1 -- 172.21.15.123:0/1561980126 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f35300d0cf0 con 0x7f3530155570 2024-09-15T23:12:36.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.147+0000 7f35177fe640 1 -- 172.21.15.123:0/1561980126 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f352405da20 con 0x7f3530155570 2024-09-15T23:12:36.148 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-09-15T23:12:36.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.149+0000 7f35354fa640 1 -- 172.21.15.123:0/1561980126 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f351c06c2b0 msgr2=0x7f351c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:36.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.149+0000 7f35354fa640 1 --2- 172.21.15.123:0/1561980126 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f351c06c2b0 0x7f351c06e770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3520033000 tx=0x7f352002e000 comp rx=0 tx=0).stop 2024-09-15T23:12:36.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.149+0000 7f35354fa640 1 -- 172.21.15.123:0/1561980126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3530155570 msgr2=0x7f3530156560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:36.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.149+0000 7f35354fa640 1 --2- 172.21.15.123:0/1561980126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3530155570 0x7f3530156560 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3524011990 tx=0x7f3524011d90 comp rx=0 tx=0).stop 2024-09-15T23:12:36.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.149+0000 7f35354fa640 1 -- 172.21.15.123:0/1561980126 shutdown_connections 2024-09-15T23:12:36.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.149+0000 7f35354fa640 1 --2- 172.21.15.123:0/1561980126 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3530156aa0 0x7f35301e8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:36.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.149+0000 7f35354fa640 1 --2- 172.21.15.123:0/1561980126 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f351c06c2b0 0x7f351c06e770 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:36.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.149+0000 7f35354fa640 1 --2- 172.21.15.123:0/1561980126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3530155570 0x7f3530156560 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:36.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.149+0000 7f35354fa640 1 --2- 172.21.15.123:0/1561980126 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f35180039e0 0x7f3530160260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:36.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.149+0000 7f35354fa640 1 -- 172.21.15.123:0/1561980126 >> 172.21.15.123:0/1561980126 conn(0x7f35300d11c0 msgr2=0x7f35300b82c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:36.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.149+0000 7f35354fa640 1 -- 172.21.15.123:0/1561980126 shutdown_connections 2024-09-15T23:12:36.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.149+0000 7f35354fa640 1 -- 172.21.15.123:0/1561980126 wait complete. 2024-09-15T23:12:36.161 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-15T23:12:36.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.261+0000 7f25f73c0640 1 Processor -- start 2024-09-15T23:12:36.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.261+0000 7f25f73c0640 1 -- start start 2024-09-15T23:12:36.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.262+0000 7f25f73c0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f25f00732e0 0x7f25f00736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:36.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.262+0000 7f25f73c0640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f25f00cd270 0x7f25f015c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:36.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.262+0000 7f25f73c0640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25f00714b0 con 0x7f25f00cce30 2024-09-15T23:12:36.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.262+0000 7f25f73c0640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f25f0073c00 con 0x7f25f00cd270 2024-09-15T23:12:36.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.262+0000 7f25f73c0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f25f00cd880 con 0x7f25f00732e0 2024-09-15T23:12:36.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.262+0000 7f25f595d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f25f00cd270 0x7f25f015c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:36.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.262+0000 7f25f515c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f25f00732e0 0x7f25f00736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:36.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.262+0000 7f25f495b640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f25f00cce30 0x7f25f0071c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:58712/0 (socket says 172.21.15.123:58712) 2024-09-15T23:12:36.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.263+0000 7f25f495b640 1 -- 172.21.15.123:0/963587263 learned_addr learned my addr 172.21.15.123:0/963587263 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:36.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.263+0000 7f25f515c640 1 -- 172.21.15.123:0/963587263 >> v2:172.21.15.188:3300/0 conn(0x7f25f00cd270 msgr2=0x7f25f015c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:36.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.263+0000 7f25f515c640 1 --2- 172.21.15.123:0/963587263 >> v2:172.21.15.188:3300/0 conn(0x7f25f00cd270 0x7f25f015c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:36.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.263+0000 7f25f515c640 1 -- 172.21.15.123:0/963587263 >> v1:172.21.15.188:6789/0 conn(0x7f25f00cce30 legacy=0x7f25f0071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:36.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.263+0000 7f25f515c640 1 -- 172.21.15.123:0/963587263 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25f00cdb60 con 0x7f25f00732e0 2024-09-15T23:12:36.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.264+0000 7f25f515c640 1 --2- 172.21.15.123:0/963587263 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f25f00732e0 0x7f25f00736c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f25ec0097a0 tx=0x7f25ec02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f6592a7ad69d56d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:36.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.264+0000 7f25e7fff640 1 -- 172.21.15.123:0/963587263 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ec037070 con 0x7f25f00732e0 2024-09-15T23:12:36.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.264+0000 7f25e7fff640 1 -- 172.21.15.123:0/963587263 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25ec02ae50 con 0x7f25f00732e0 2024-09-15T23:12:36.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.264+0000 7f25e7fff640 1 -- 172.21.15.123:0/963587263 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ec032660 con 0x7f25f00732e0 2024-09-15T23:12:36.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.264+0000 7f25f73c0640 1 -- 172.21.15.123:0/963587263 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f25f00732e0 msgr2=0x7f25f00736c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:36.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.264+0000 7f25f73c0640 1 --2- 172.21.15.123:0/963587263 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f25f00732e0 0x7f25f00736c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f25ec0097a0 tx=0x7f25ec02a100 comp rx=0 tx=0).stop 2024-09-15T23:12:36.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.264+0000 7f25f73c0640 1 -- 172.21.15.123:0/963587263 shutdown_connections 2024-09-15T23:12:36.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.264+0000 7f25f73c0640 1 --2- 172.21.15.123:0/963587263 >> v2:172.21.15.188:3300/0 conn(0x7f25f00cd270 0x7f25f015c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:36.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.264+0000 7f25f73c0640 1 --2- 172.21.15.123:0/963587263 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f25f00732e0 0x7f25f00736c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:36.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.264+0000 7f25f73c0640 1 -- 172.21.15.123:0/963587263 >> 172.21.15.123:0/963587263 conn(0x7f25f006d0f0 msgr2=0x7f25f006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:36.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.264+0000 7f25f73c0640 1 -- 172.21.15.123:0/963587263 shutdown_connections 2024-09-15T23:12:36.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.264+0000 7f25f73c0640 1 -- 172.21.15.123:0/963587263 wait complete. 2024-09-15T23:12:36.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.265+0000 7f25f73c0640 1 Processor -- start 2024-09-15T23:12:36.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.265+0000 7f25f73c0640 1 -- start start 2024-09-15T23:12:36.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.266+0000 7f25f73c0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f25f00732e0 0x7f25f0157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:36.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.266+0000 7f25f73c0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f25f00cce30 0x7f25f0156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:36.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.266+0000 7f25f73c0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25f00cd270 0x7f25f014b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:36.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.266+0000 7f25f73c0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f25f006bf70 con 0x7f25f00cd270 2024-09-15T23:12:36.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.266+0000 7f25f73c0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f25f006bdf0 con 0x7f25f00cce30 2024-09-15T23:12:36.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.266+0000 7f25f73c0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f25f0072380 con 0x7f25f00732e0 2024-09-15T23:12:36.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.266+0000 7f25f595d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25f00cd270 0x7f25f014b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:36.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.266+0000 7f25f595d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25f00cd270 0x7f25f014b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46098/0 (socket says 172.21.15.123:46098) 2024-09-15T23:12:36.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.266+0000 7f25f595d640 1 -- 172.21.15.123:0/4269337923 learned_addr learned my addr 172.21.15.123:0/4269337923 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:36.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.266+0000 7f25f515c640 1 --2- 172.21.15.123:0/4269337923 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f25f00732e0 0x7f25f0157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:36.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.266+0000 7f25f495b640 1 --2- 172.21.15.123:0/4269337923 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f25f00cce30 0x7f25f0156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:36.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.267+0000 7f25f595d640 1 -- 172.21.15.123:0/4269337923 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f25f00732e0 msgr2=0x7f25f0157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:36.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.267+0000 7f25f595d640 1 --2- 172.21.15.123:0/4269337923 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f25f00732e0 0x7f25f0157760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:36.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.267+0000 7f25f595d640 1 -- 172.21.15.123:0/4269337923 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f25f00cce30 msgr2=0x7f25f0156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:36.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.267+0000 7f25f595d640 1 --2- 172.21.15.123:0/4269337923 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f25f00cce30 0x7f25f0156560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:36.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.267+0000 7f25f595d640 1 -- 172.21.15.123:0/4269337923 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25f0157ca0 con 0x7f25f00cd270 2024-09-15T23:12:36.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.267+0000 7f25f595d640 1 --2- 172.21.15.123:0/4269337923 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25f00cd270 0x7f25f014b280 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f25e8009dd0 tx=0x7f25e800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:36.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.267+0000 7f25e5ffb640 1 -- 172.21.15.123:0/4269337923 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e8018020 con 0x7f25f00cd270 2024-09-15T23:12:36.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.267+0000 7f25e5ffb640 1 -- 172.21.15.123:0/4269337923 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25e8014480 con 0x7f25f00cd270 2024-09-15T23:12:36.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.267+0000 7f25e5ffb640 1 -- 172.21.15.123:0/4269337923 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e8014870 con 0x7f25f00cd270 2024-09-15T23:12:36.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.267+0000 7f25f73c0640 1 -- 172.21.15.123:0/4269337923 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25f01594d0 con 0x7f25f00cd270 2024-09-15T23:12:36.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.267+0000 7f25f73c0640 1 -- 172.21.15.123:0/4269337923 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25f00ca9d0 con 0x7f25f00cd270 2024-09-15T23:12:36.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.268+0000 7f25f73c0640 1 -- 172.21.15.123:0/4269337923 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25f00736c0 con 0x7f25f00cd270 2024-09-15T23:12:36.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.268+0000 7f25e5ffb640 1 -- 172.21.15.123:0/4269337923 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f25e8005d10 con 0x7f25f00cd270 2024-09-15T23:12:36.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.269+0000 7f25e5ffb640 1 --2- 172.21.15.123:0/4269337923 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f25d406c2e0 0x7f25d406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:36.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.269+0000 7f25e5ffb640 1 -- 172.21.15.123:0/4269337923 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f25e808be60 con 0x7f25f00cd270 2024-09-15T23:12:36.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.269+0000 7f25f515c640 1 --2- 172.21.15.123:0/4269337923 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f25d406c2e0 0x7f25d406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:36.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.270+0000 7f25f515c640 1 --2- 172.21.15.123:0/4269337923 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f25d406c2e0 0x7f25d406e7a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f25ec034000 tx=0x7f25ec02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:36.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.273+0000 7f25e5ffb640 1 -- 172.21.15.123:0/4269337923 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f25e8022070 con 0x7f25f00cd270 2024-09-15T23:12:36.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.442+0000 7f25f73c0640 1 -- 172.21.15.123:0/4269337923 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f25f00b5600 con 0x7f25f00cd270 2024-09-15T23:12:36.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.442+0000 7f25e5ffb640 1 -- 172.21.15.123:0/4269337923 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f25e8010040 con 0x7f25f00cd270 2024-09-15T23:12:36.444 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-09-15T23:12:36.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.444+0000 7f25f73c0640 1 -- 172.21.15.123:0/4269337923 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f25d406c2e0 msgr2=0x7f25d406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:36.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.444+0000 7f25f73c0640 1 --2- 172.21.15.123:0/4269337923 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f25d406c2e0 0x7f25d406e7a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f25ec034000 tx=0x7f25ec02e000 comp rx=0 tx=0).stop 2024-09-15T23:12:36.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.444+0000 7f25f73c0640 1 -- 172.21.15.123:0/4269337923 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25f00cd270 msgr2=0x7f25f014b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:36.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.444+0000 7f25f73c0640 1 --2- 172.21.15.123:0/4269337923 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25f00cd270 0x7f25f014b280 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f25e8009dd0 tx=0x7f25e800c490 comp rx=0 tx=0).stop 2024-09-15T23:12:36.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.445+0000 7f25f73c0640 1 -- 172.21.15.123:0/4269337923 shutdown_connections 2024-09-15T23:12:36.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.445+0000 7f25f73c0640 1 --2- 172.21.15.123:0/4269337923 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f25d406c2e0 0x7f25d406e7a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:36.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.445+0000 7f25f73c0640 1 --2- 172.21.15.123:0/4269337923 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25f00cd270 0x7f25f014b280 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:36.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.445+0000 7f25f73c0640 1 --2- 172.21.15.123:0/4269337923 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f25f00cce30 0x7f25f0156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:36.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.445+0000 7f25f73c0640 1 --2- 172.21.15.123:0/4269337923 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f25f00732e0 0x7f25f0157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:36.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.445+0000 7f25f73c0640 1 -- 172.21.15.123:0/4269337923 >> 172.21.15.123:0/4269337923 conn(0x7f25f006d0f0 msgr2=0x7f25f0071c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:36.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.445+0000 7f25f73c0640 1 -- 172.21.15.123:0/4269337923 shutdown_connections 2024-09-15T23:12:36.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.445+0000 7f25f73c0640 1 -- 172.21.15.123:0/4269337923 wait complete. 2024-09-15T23:12:36.457 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir' 2024-09-15T23:12:36.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.553+0000 7fbafb7b9640 1 Processor -- start 2024-09-15T23:12:36.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.554+0000 7fbafb7b9640 1 -- start start 2024-09-15T23:12:36.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.554+0000 7fbafb7b9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbaf415c4f0 0x7fbaf415d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:36.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.554+0000 7fbafb7b9640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fbaf40d0200 0x7fbaf40d0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:36.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.554+0000 7fbafb7b9640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbaf4160100 0x7fbaf4160530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:36.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.554+0000 7fbafb7b9640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fbaf40d0b80 con 0x7fbaf4160100 2024-09-15T23:12:36.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.554+0000 7fbafb7b9640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fbaf4073400 con 0x7fbaf40d0200 2024-09-15T23:12:36.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.554+0000 7fbafb7b9640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbaf40736e0 con 0x7fbaf415c4f0 2024-09-15T23:12:36.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.555+0000 7fbaf9d56640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbaf4160100 0x7fbaf4160530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:36.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.555+0000 7fbaf9d56640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbaf4160100 0x7fbaf4160530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46114/0 (socket says 172.21.15.123:46114) 2024-09-15T23:12:36.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.555+0000 7fbaf9d56640 1 -- 172.21.15.123:0/4155357874 learned_addr learned my addr 172.21.15.123:0/4155357874 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:36.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.555+0000 7fbaf9d56640 1 -- 172.21.15.123:0/4155357874 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbaf415c4f0 msgr2=0x7fbaf415d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:36.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.555+0000 7fbaf9d56640 1 --2- 172.21.15.123:0/4155357874 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbaf415c4f0 0x7fbaf415d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:36.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.555+0000 7fbaf9d56640 1 -- 172.21.15.123:0/4155357874 >> v2:172.21.15.188:3300/0 conn(0x7fbaf40d0200 msgr2=0x7fbaf40d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:36.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.555+0000 7fbaf9d56640 1 --2- 172.21.15.123:0/4155357874 >> v2:172.21.15.188:3300/0 conn(0x7fbaf40d0200 0x7fbaf40d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:36.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.555+0000 7fbaf9d56640 1 -- 172.21.15.123:0/4155357874 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf40739c0 con 0x7fbaf4160100 2024-09-15T23:12:36.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.555+0000 7fbaf9d56640 1 --2- 172.21.15.123:0/4155357874 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbaf4160100 0x7fbaf4160530 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4075980 tx=0x7fbaec02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12f9c7afcd631dfe server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:36.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.556+0000 7fbae7fff640 1 -- 172.21.15.123:0/4155357874 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaec036070 con 0x7fbaf4160100 2024-09-15T23:12:36.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.556+0000 7fbae7fff640 1 -- 172.21.15.123:0/4155357874 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaec031600 con 0x7fbaf4160100 2024-09-15T23:12:36.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.556+0000 7fbae7fff640 1 -- 172.21.15.123:0/4155357874 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaec0319d0 con 0x7fbaf4160100 2024-09-15T23:12:36.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.556+0000 7fbafb7b9640 1 -- 172.21.15.123:0/4155357874 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbaf4160100 msgr2=0x7fbaf4160530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:36.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.556+0000 7fbafb7b9640 1 --2- 172.21.15.123:0/4155357874 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbaf4160100 0x7fbaf4160530 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4075980 tx=0x7fbaec02a6a0 comp rx=0 tx=0).stop 2024-09-15T23:12:36.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.556+0000 7fbafb7b9640 1 -- 172.21.15.123:0/4155357874 shutdown_connections 2024-09-15T23:12:36.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.556+0000 7fbafb7b9640 1 --2- 172.21.15.123:0/4155357874 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbaf4160100 0x7fbaf4160530 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:36.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.556+0000 7fbafb7b9640 1 --2- 172.21.15.123:0/4155357874 >> v2:172.21.15.188:3300/0 conn(0x7fbaf40d0200 0x7fbaf40d0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:36.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.556+0000 7fbafb7b9640 1 --2- 172.21.15.123:0/4155357874 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbaf415c4f0 0x7fbaf415d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:36.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.556+0000 7fbafb7b9640 1 -- 172.21.15.123:0/4155357874 >> 172.21.15.123:0/4155357874 conn(0x7fbaf406f400 msgr2=0x7fbaf406f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:36.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.556+0000 7fbafb7b9640 1 -- 172.21.15.123:0/4155357874 shutdown_connections 2024-09-15T23:12:36.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.556+0000 7fbafb7b9640 1 -- 172.21.15.123:0/4155357874 wait complete. 2024-09-15T23:12:36.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.557+0000 7fbafb7b9640 1 Processor -- start 2024-09-15T23:12:36.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.557+0000 7fbafb7b9640 1 -- start start 2024-09-15T23:12:36.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.558+0000 7fbafb7b9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbaf40d0200 0x7fbaf4151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:36.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.558+0000 7fbafb7b9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbaf415c4f0 0x7fbaf41f2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:36.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.558+0000 7fbafb7b9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbaf4160100 0x7fbaf40b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:36.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.558+0000 7fbafb7b9640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf40d0fa0 con 0x7fbaf415c4f0 2024-09-15T23:12:36.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.558+0000 7fbafb7b9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf4073f80 con 0x7fbaf40d0200 2024-09-15T23:12:36.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.558+0000 7fbafb7b9640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbaf415c8d0 con 0x7fbaf4160100 2024-09-15T23:12:36.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.558+0000 7fbaf8d54640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbaf415c4f0 0x7fbaf41f2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:36.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.558+0000 7fbaf8d54640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbaf415c4f0 0x7fbaf41f2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46118/0 (socket says 172.21.15.123:46118) 2024-09-15T23:12:36.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.558+0000 7fbaf8d54640 1 -- 172.21.15.123:0/326792080 learned_addr learned my addr 172.21.15.123:0/326792080 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:36.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.559+0000 7fbaf8d54640 1 -- 172.21.15.123:0/326792080 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbaf4160100 msgr2=0x7fbaf40b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:36.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.559+0000 7fbaf8d54640 1 --2- 172.21.15.123:0/326792080 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbaf4160100 0x7fbaf40b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:36.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.559+0000 7fbaf8d54640 1 -- 172.21.15.123:0/326792080 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbaf40d0200 msgr2=0x7fbaf4151800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:36.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.559+0000 7fbaf8d54640 1 --2- 172.21.15.123:0/326792080 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbaf40d0200 0x7fbaf4151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:36.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.559+0000 7fbaf8d54640 1 -- 172.21.15.123:0/326792080 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf41f29a0 con 0x7fbaf415c4f0 2024-09-15T23:12:36.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.559+0000 7fbaf8d54640 1 --2- 172.21.15.123:0/326792080 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbaf415c4f0 0x7fbaf41f2460 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbae800b440 tx=0x7fbae800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:36.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.559+0000 7fbae5ffb640 1 -- 172.21.15.123:0/326792080 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae8015020 con 0x7fbaf415c4f0 2024-09-15T23:12:36.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.559+0000 7fbae5ffb640 1 -- 172.21.15.123:0/326792080 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbae80118b0 con 0x7fbaf415c4f0 2024-09-15T23:12:36.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.559+0000 7fbafb7b9640 1 -- 172.21.15.123:0/326792080 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaf41f2c40 con 0x7fbaf415c4f0 2024-09-15T23:12:36.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.559+0000 7fbae5ffb640 1 -- 172.21.15.123:0/326792080 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae8011ca0 con 0x7fbaf415c4f0 2024-09-15T23:12:36.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.559+0000 7fbafb7b9640 1 -- 172.21.15.123:0/326792080 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaf41f3200 con 0x7fbaf415c4f0 2024-09-15T23:12:36.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.560+0000 7fbafb7b9640 1 -- 172.21.15.123:0/326792080 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaf40cff70 con 0x7fbaf415c4f0 2024-09-15T23:12:36.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.560+0000 7fbae5ffb640 1 -- 172.21.15.123:0/326792080 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbae8018020 con 0x7fbaf415c4f0 2024-09-15T23:12:36.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.561+0000 7fbae5ffb640 1 --2- 172.21.15.123:0/326792080 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbad806c2b0 0x7fbad806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:36.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.561+0000 7fbae5ffb640 1 -- 172.21.15.123:0/326792080 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fbae808b4f0 con 0x7fbaf415c4f0 2024-09-15T23:12:36.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.561+0000 7fbaf9555640 1 --2- 172.21.15.123:0/326792080 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbad806c2b0 0x7fbad806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:36.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.562+0000 7fbaf9555640 1 --2- 172.21.15.123:0/326792080 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbad806c2b0 0x7fbad806e770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4158630 tx=0x7fbaf0006bf0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:36.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.565+0000 7fbae5ffb640 1 -- 172.21.15.123:0/326792080 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbaf40cff70 con 0x7fbaf415c4f0 2024-09-15T23:12:36.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:36.793+0000 7fbafb7b9640 1 -- 172.21.15.123:0/326792080 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]} v 0) -- 0x7fbaf40b35c0 con 0x7fbaf415c4f0 2024-09-15T23:12:37.219 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:12:37.222 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:12:37.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.371+0000 7fbae5ffb640 1 -- 172.21.15.123:0/326792080 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]}]=0 v46) ==== 151+0+0 (secure 0 0 0) 0x7fbae801f020 con 0x7fbaf415c4f0 2024-09-15T23:12:37.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.373+0000 7fbafb7b9640 1 -- 172.21.15.123:0/326792080 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbad806c2b0 msgr2=0x7fbad806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:37.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.373+0000 7fbafb7b9640 1 --2- 172.21.15.123:0/326792080 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbad806c2b0 0x7fbad806e770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4158630 tx=0x7fbaf0006bf0 comp rx=0 tx=0).stop 2024-09-15T23:12:37.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.373+0000 7fbafb7b9640 1 -- 172.21.15.123:0/326792080 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbaf415c4f0 msgr2=0x7fbaf41f2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:37.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.373+0000 7fbafb7b9640 1 --2- 172.21.15.123:0/326792080 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbaf415c4f0 0x7fbaf41f2460 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbae800b440 tx=0x7fbae800b900 comp rx=0 tx=0).stop 2024-09-15T23:12:37.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.373+0000 7fbafb7b9640 1 -- 172.21.15.123:0/326792080 shutdown_connections 2024-09-15T23:12:37.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.373+0000 7fbafb7b9640 1 --2- 172.21.15.123:0/326792080 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbaf4160100 0x7fbaf40b37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:37.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.373+0000 7fbafb7b9640 1 --2- 172.21.15.123:0/326792080 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbad806c2b0 0x7fbad806e770 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:37.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.373+0000 7fbafb7b9640 1 --2- 172.21.15.123:0/326792080 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbaf415c4f0 0x7fbaf41f2460 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:37.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.373+0000 7fbafb7b9640 1 --2- 172.21.15.123:0/326792080 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbaf40d0200 0x7fbaf4151800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:37.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.373+0000 7fbafb7b9640 1 -- 172.21.15.123:0/326792080 >> 172.21.15.123:0/326792080 conn(0x7fbaf406f400 msgr2=0x7fbaf40b5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:37.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.373+0000 7fbafb7b9640 1 -- 172.21.15.123:0/326792080 shutdown_connections 2024-09-15T23:12:37.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.373+0000 7fbafb7b9640 1 -- 172.21.15.123:0/326792080 wait complete. 2024-09-15T23:12:37.385 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T23:12:37.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.486+0000 7fbb8dbf6640 1 Processor -- start 2024-09-15T23:12:37.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.486+0000 7fbb8dbf6640 1 -- start start 2024-09-15T23:12:37.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.487+0000 7fbb8dbf6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbb880ccf30 0x7fbb880b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:37.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.487+0000 7fbb8dbf6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbb8815b7c0 0x7fbb880cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:37.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.487+0000 7fbb8dbf6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fbb880cead0 0x7fbb8815f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:37.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.487+0000 7fbb8dbf6640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fbb880cd850 con 0x7fbb8815b7c0 2024-09-15T23:12:37.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.487+0000 7fbb8dbf6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fbb880cf2e0 con 0x7fbb880cead0 2024-09-15T23:12:37.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.487+0000 7fbb8dbf6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbb88070fe0 con 0x7fbb880ccf30 2024-09-15T23:12:37.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.487+0000 7fbb86ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbb8815b7c0 0x7fbb880cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:37.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.487+0000 7fbb86ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbb8815b7c0 0x7fbb880cd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46130/0 (socket says 172.21.15.123:46130) 2024-09-15T23:12:37.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.487+0000 7fbb86ffd640 1 -- 172.21.15.123:0/2754891955 learned_addr learned my addr 172.21.15.123:0/2754891955 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:37.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.487+0000 7fbb87fff640 1 --2- 172.21.15.123:0/2754891955 >> v2:172.21.15.188:3300/0 conn(0x7fbb880cead0 0x7fbb8815f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:37.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.487+0000 7fbb877fe640 1 --2- 172.21.15.123:0/2754891955 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbb880ccf30 0x7fbb880b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:37.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.487+0000 7fbb86ffd640 1 -- 172.21.15.123:0/2754891955 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbb880ccf30 msgr2=0x7fbb880b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:37.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.487+0000 7fbb86ffd640 1 --2- 172.21.15.123:0/2754891955 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbb880ccf30 0x7fbb880b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:37.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.487+0000 7fbb86ffd640 1 -- 172.21.15.123:0/2754891955 >> v2:172.21.15.188:3300/0 conn(0x7fbb880cead0 msgr2=0x7fbb8815f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:37.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.487+0000 7fbb86ffd640 1 --2- 172.21.15.123:0/2754891955 >> v2:172.21.15.188:3300/0 conn(0x7fbb880cead0 0x7fbb8815f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:37.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.487+0000 7fbb86ffd640 1 -- 172.21.15.123:0/2754891955 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb880712c0 con 0x7fbb8815b7c0 2024-09-15T23:12:37.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.488+0000 7fbb86ffd640 1 --2- 172.21.15.123:0/2754891955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb8815b7c0 0x7fbb880cd310 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbb8806dc70 tx=0x7fbb7c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c3008881a7572c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:37.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.488+0000 7fbb867fc640 1 -- 172.21.15.123:0/2754891955 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c037070 con 0x7fbb8815b7c0 2024-09-15T23:12:37.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.488+0000 7fbb867fc640 1 -- 172.21.15.123:0/2754891955 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb7c032440 con 0x7fbb8815b7c0 2024-09-15T23:12:37.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.488+0000 7fbb867fc640 1 -- 172.21.15.123:0/2754891955 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c032810 con 0x7fbb8815b7c0 2024-09-15T23:12:37.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.489+0000 7fbb8dbf6640 1 -- 172.21.15.123:0/2754891955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb8815b7c0 msgr2=0x7fbb880cd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:37.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.489+0000 7fbb8dbf6640 1 --2- 172.21.15.123:0/2754891955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb8815b7c0 0x7fbb880cd310 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbb8806dc70 tx=0x7fbb7c02a140 comp rx=0 tx=0).stop 2024-09-15T23:12:37.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.489+0000 7fbb8dbf6640 1 -- 172.21.15.123:0/2754891955 shutdown_connections 2024-09-15T23:12:37.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.489+0000 7fbb8dbf6640 1 --2- 172.21.15.123:0/2754891955 >> v2:172.21.15.188:3300/0 conn(0x7fbb880cead0 0x7fbb8815f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:37.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.489+0000 7fbb8dbf6640 1 --2- 172.21.15.123:0/2754891955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb8815b7c0 0x7fbb880cd310 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:37.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.489+0000 7fbb8dbf6640 1 --2- 172.21.15.123:0/2754891955 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbb880ccf30 0x7fbb880b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:37.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.489+0000 7fbb8dbf6640 1 -- 172.21.15.123:0/2754891955 >> 172.21.15.123:0/2754891955 conn(0x7fbb8806d0f0 msgr2=0x7fbb8806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:37.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.489+0000 7fbb8dbf6640 1 -- 172.21.15.123:0/2754891955 shutdown_connections 2024-09-15T23:12:37.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.489+0000 7fbb8dbf6640 1 -- 172.21.15.123:0/2754891955 wait complete. 2024-09-15T23:12:37.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.490+0000 7fbb8dbf6640 1 Processor -- start 2024-09-15T23:12:37.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.490+0000 7fbb8dbf6640 1 -- start start 2024-09-15T23:12:37.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.491+0000 7fbb8dbf6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbb880ccf30 0x7fbb8814a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:37.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.491+0000 7fbb8dbf6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbb880cead0 0x7fbb8815eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:37.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.491+0000 7fbb8dbf6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb8815b7c0 0x7fbb8815f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:37.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.491+0000 7fbb8dbf6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbb880cef40 con 0x7fbb8815b7c0 2024-09-15T23:12:37.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.491+0000 7fbb8dbf6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbb880cf5c0 con 0x7fbb880cead0 2024-09-15T23:12:37.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.491+0000 7fbb8dbf6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbb880cf0c0 con 0x7fbb880ccf30 2024-09-15T23:12:37.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.491+0000 7fbb87fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb8815b7c0 0x7fbb8815f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:37.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.491+0000 7fbb87fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb8815b7c0 0x7fbb8815f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46138/0 (socket says 172.21.15.123:46138) 2024-09-15T23:12:37.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.491+0000 7fbb87fff640 1 -- 172.21.15.123:0/3729423285 learned_addr learned my addr 172.21.15.123:0/3729423285 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:37.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.491+0000 7fbb86ffd640 1 --2- 172.21.15.123:0/3729423285 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbb880cead0 0x7fbb8815eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:37.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.491+0000 7fbb877fe640 1 --2- 172.21.15.123:0/3729423285 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbb880ccf30 0x7fbb8814a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:37.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.491+0000 7fbb87fff640 1 -- 172.21.15.123:0/3729423285 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbb880ccf30 msgr2=0x7fbb8814a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:37.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.491+0000 7fbb87fff640 1 --2- 172.21.15.123:0/3729423285 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbb880ccf30 0x7fbb8814a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:37.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.491+0000 7fbb87fff640 1 -- 172.21.15.123:0/3729423285 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbb880cead0 msgr2=0x7fbb8815eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:37.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.491+0000 7fbb87fff640 1 --2- 172.21.15.123:0/3729423285 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbb880cead0 0x7fbb8815eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:37.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.491+0000 7fbb87fff640 1 -- 172.21.15.123:0/3729423285 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb8814aaa0 con 0x7fbb8815b7c0 2024-09-15T23:12:37.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.491+0000 7fbb87fff640 1 --2- 172.21.15.123:0/3729423285 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb8815b7c0 0x7fbb8815f400 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbb80007e70 tx=0x7fbb8000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:37.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.492+0000 7fbb6ffff640 1 -- 172.21.15.123:0/3729423285 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb80014620 con 0x7fbb8815b7c0 2024-09-15T23:12:37.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.492+0000 7fbb6ffff640 1 -- 172.21.15.123:0/3729423285 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb80019070 con 0x7fbb8815b7c0 2024-09-15T23:12:37.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.492+0000 7fbb6ffff640 1 -- 172.21.15.123:0/3729423285 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb80014a20 con 0x7fbb8815b7c0 2024-09-15T23:12:37.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.492+0000 7fbb8dbf6640 1 -- 172.21.15.123:0/3729423285 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb8814e150 con 0x7fbb8815b7c0 2024-09-15T23:12:37.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.492+0000 7fbb8dbf6640 1 -- 172.21.15.123:0/3729423285 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb8815cf30 con 0x7fbb8815b7c0 2024-09-15T23:12:37.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.493+0000 7fbb8dbf6640 1 -- 172.21.15.123:0/3729423285 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb880b2c50 con 0x7fbb8815b7c0 2024-09-15T23:12:37.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.493+0000 7fbb6ffff640 1 -- 172.21.15.123:0/3729423285 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbb80014bc0 con 0x7fbb8815b7c0 2024-09-15T23:12:37.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.493+0000 7fbb6ffff640 1 --2- 172.21.15.123:0/3729423285 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbb7406c2b0 0x7fbb7406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:37.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.494+0000 7fbb6ffff640 1 -- 172.21.15.123:0/3729423285 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fbb8008bc20 con 0x7fbb8815b7c0 2024-09-15T23:12:37.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.494+0000 7fbb877fe640 1 --2- 172.21.15.123:0/3729423285 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbb7406c2b0 0x7fbb7406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:37.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.494+0000 7fbb877fe640 1 --2- 172.21.15.123:0/3729423285 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbb7406c2b0 0x7fbb7406e770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbb78003610 tx=0x7fbb78008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:37.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.498+0000 7fbb6ffff640 1 -- 172.21.15.123:0/3729423285 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbb80059d40 con 0x7fbb8815b7c0 2024-09-15T23:12:37.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.663+0000 7fbb8dbf6640 1 -- 172.21.15.123:0/3729423285 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fbb880d0290 con 0x7fbb8815b7c0 2024-09-15T23:12:37.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.667+0000 7fbb6ffff640 1 -- 172.21.15.123:0/3729423285 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fbb8005e040 con 0x7fbb8815b7c0 2024-09-15T23:12:37.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.669+0000 7fbb8dbf6640 1 -- 172.21.15.123:0/3729423285 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbb7406c2b0 msgr2=0x7fbb7406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:37.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.669+0000 7fbb8dbf6640 1 --2- 172.21.15.123:0/3729423285 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbb7406c2b0 0x7fbb7406e770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbb78003610 tx=0x7fbb78008040 comp rx=0 tx=0).stop 2024-09-15T23:12:37.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.669+0000 7fbb8dbf6640 1 -- 172.21.15.123:0/3729423285 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb8815b7c0 msgr2=0x7fbb8815f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:37.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.669+0000 7fbb8dbf6640 1 --2- 172.21.15.123:0/3729423285 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb8815b7c0 0x7fbb8815f400 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbb80007e70 tx=0x7fbb8000e4b0 comp rx=0 tx=0).stop 2024-09-15T23:12:37.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.669+0000 7fbb8dbf6640 1 -- 172.21.15.123:0/3729423285 shutdown_connections 2024-09-15T23:12:37.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.669+0000 7fbb8dbf6640 1 --2- 172.21.15.123:0/3729423285 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbb7406c2b0 0x7fbb7406e770 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:37.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.669+0000 7fbb8dbf6640 1 --2- 172.21.15.123:0/3729423285 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb8815b7c0 0x7fbb8815f400 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:37.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.669+0000 7fbb8dbf6640 1 --2- 172.21.15.123:0/3729423285 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbb880cead0 0x7fbb8815eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:37.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.669+0000 7fbb8dbf6640 1 --2- 172.21.15.123:0/3729423285 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbb880ccf30 0x7fbb8814a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:37.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.669+0000 7fbb8dbf6640 1 -- 172.21.15.123:0/3729423285 >> 172.21.15.123:0/3729423285 conn(0x7fbb8806d0f0 msgr2=0x7fbb8814e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:37.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.669+0000 7fbb8dbf6640 1 -- 172.21.15.123:0/3729423285 shutdown_connections 2024-09-15T23:12:37.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:37.669+0000 7fbb8dbf6640 1 -- 172.21.15.123:0/3729423285 wait complete. 2024-09-15T23:12:37.681 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:12:37.681 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:12:37.723 DEBUG:teuthology.orchestra.run.smithi188:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:12:37.766 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:12:37.766 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:12:37.767 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:12:37.782 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:12:37.783 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:12:37.838 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:12:37.838 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:12:37.893 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:12:38.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.030+0000 7fa6b93d8640 1 Processor -- start 2024-09-15T23:12:38.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.030+0000 7fa6b93d8640 1 -- start start 2024-09-15T23:12:38.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.031+0000 7fa6b93d8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa6b4145ed0 0x7fa6b40b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:38.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.031+0000 7fa6b93d8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa6b4073180 0x7fa6b40735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:38.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.031+0000 7fa6b93d8640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa6b40b5880 0x7fa6b40b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:38.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.031+0000 7fa6b93d8640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fa6b4073b00 con 0x7fa6b4073180 2024-09-15T23:12:38.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.031+0000 7fa6b93d8640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fa6b40b4020 con 0x7fa6b4145ed0 2024-09-15T23:12:38.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.031+0000 7fa6b93d8640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa6b40b42c0 con 0x7fa6b40b5880 2024-09-15T23:12:38.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.031+0000 7fa6b27fc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa6b4073180 0x7fa6b40735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:38.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.031+0000 7fa6b27fc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa6b4073180 0x7fa6b40735c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46150/0 (socket says 172.21.15.123:46150) 2024-09-15T23:12:38.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.031+0000 7fa6b27fc640 1 -- 172.21.15.123:0/1610464586 learned_addr learned my addr 172.21.15.123:0/1610464586 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:38.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.031+0000 7fa6b27fc640 1 -- 172.21.15.123:0/1610464586 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa6b40b5880 msgr2=0x7fa6b40b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:38.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.031+0000 7fa6b27fc640 1 --2- 172.21.15.123:0/1610464586 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa6b40b5880 0x7fa6b40b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:38.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.031+0000 7fa6b27fc640 1 -- 172.21.15.123:0/1610464586 >> v2:172.21.15.188:3300/0 conn(0x7fa6b4145ed0 msgr2=0x7fa6b40b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:38.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.031+0000 7fa6b27fc640 1 --2- 172.21.15.123:0/1610464586 >> v2:172.21.15.188:3300/0 conn(0x7fa6b4145ed0 0x7fa6b40b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:38.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.031+0000 7fa6b27fc640 1 -- 172.21.15.123:0/1610464586 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6b40b45a0 con 0x7fa6b4073180 2024-09-15T23:12:38.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.032+0000 7fa6b27fc640 1 --2- 172.21.15.123:0/1610464586 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6b4073180 0x7fa6b40735c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4069cd0 tx=0x7fa6a802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=181f504eff263ff server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:38.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.032+0000 7fa6b1ffb640 1 -- 172.21.15.123:0/1610464586 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a8037070 con 0x7fa6b4073180 2024-09-15T23:12:38.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.032+0000 7fa6b1ffb640 1 -- 172.21.15.123:0/1610464586 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6a8032440 con 0x7fa6b4073180 2024-09-15T23:12:38.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.032+0000 7fa6b1ffb640 1 -- 172.21.15.123:0/1610464586 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a8032810 con 0x7fa6b4073180 2024-09-15T23:12:38.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.033+0000 7fa6b93d8640 1 -- 172.21.15.123:0/1610464586 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6b4073180 msgr2=0x7fa6b40735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:38.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.033+0000 7fa6b93d8640 1 --2- 172.21.15.123:0/1610464586 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6b4073180 0x7fa6b40735c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4069cd0 tx=0x7fa6a802a1e0 comp rx=0 tx=0).stop 2024-09-15T23:12:38.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.033+0000 7fa6b93d8640 1 -- 172.21.15.123:0/1610464586 shutdown_connections 2024-09-15T23:12:38.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.033+0000 7fa6b93d8640 1 --2- 172.21.15.123:0/1610464586 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa6b40b5880 0x7fa6b40b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:38.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.033+0000 7fa6b93d8640 1 --2- 172.21.15.123:0/1610464586 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6b4073180 0x7fa6b40735c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:38.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.033+0000 7fa6b93d8640 1 --2- 172.21.15.123:0/1610464586 >> v2:172.21.15.188:3300/0 conn(0x7fa6b4145ed0 0x7fa6b40b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:38.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.033+0000 7fa6b93d8640 1 -- 172.21.15.123:0/1610464586 >> 172.21.15.123:0/1610464586 conn(0x7fa6b40ccec0 msgr2=0x7fa6b40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:38.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.033+0000 7fa6b93d8640 1 -- 172.21.15.123:0/1610464586 shutdown_connections 2024-09-15T23:12:38.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.033+0000 7fa6b93d8640 1 -- 172.21.15.123:0/1610464586 wait complete. 2024-09-15T23:12:38.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.034+0000 7fa6b93d8640 1 Processor -- start 2024-09-15T23:12:38.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.034+0000 7fa6b93d8640 1 -- start start 2024-09-15T23:12:38.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.035+0000 7fa6b93d8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6b4073180 0x7fa6b41f1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:38.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.035+0000 7fa6b93d8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa6b40b5880 0x7fa6b4141e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:38.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.035+0000 7fa6b93d8640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa6b4145ed0 0x7fa6b413d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:38.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.035+0000 7fa6b93d8640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa6b40b6250 con 0x7fa6b4073180 2024-09-15T23:12:38.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.035+0000 7fa6b93d8640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa6b40b4b60 con 0x7fa6b40b5880 2024-09-15T23:12:38.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.035+0000 7fa6b93d8640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa6b40b63d0 con 0x7fa6b4145ed0 2024-09-15T23:12:38.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.035+0000 7fa6b2ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6b4073180 0x7fa6b41f1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:38.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.035+0000 7fa6b2ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6b4073180 0x7fa6b41f1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46162/0 (socket says 172.21.15.123:46162) 2024-09-15T23:12:38.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.035+0000 7fa6b2ffd640 1 -- 172.21.15.123:0/1371055960 learned_addr learned my addr 172.21.15.123:0/1371055960 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:38.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.035+0000 7fa6b27fc640 1 --2- 172.21.15.123:0/1371055960 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa6b40b5880 0x7fa6b4141e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:38.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.035+0000 7fa6b2ffd640 1 -- 172.21.15.123:0/1371055960 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa6b4145ed0 msgr2=0x7fa6b413d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:38.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.035+0000 7fa6b37fe640 1 --2- 172.21.15.123:0/1371055960 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa6b4145ed0 0x7fa6b413d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:38.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.035+0000 7fa6b2ffd640 1 --2- 172.21.15.123:0/1371055960 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa6b4145ed0 0x7fa6b413d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:38.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.035+0000 7fa6b2ffd640 1 -- 172.21.15.123:0/1371055960 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa6b40b5880 msgr2=0x7fa6b4141e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:38.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.035+0000 7fa6b2ffd640 1 --2- 172.21.15.123:0/1371055960 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa6b40b5880 0x7fa6b4141e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:38.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.035+0000 7fa6b2ffd640 1 -- 172.21.15.123:0/1371055960 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6b4155b90 con 0x7fa6b4073180 2024-09-15T23:12:38.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.035+0000 7fa6b27fc640 1 --2- 172.21.15.123:0/1371055960 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa6b40b5880 0x7fa6b4141e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:38.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.035+0000 7fa6b37fe640 1 --2- 172.21.15.123:0/1371055960 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa6b4145ed0 0x7fa6b413d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:38.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.036+0000 7fa6b2ffd640 1 --2- 172.21.15.123:0/1371055960 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6b4073180 0x7fa6b41f1db0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa6a400b410 tx=0x7fa6a400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:38.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.036+0000 7fa69b7fe640 1 -- 172.21.15.123:0/1371055960 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a4015020 con 0x7fa6b4073180 2024-09-15T23:12:38.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.036+0000 7fa69b7fe640 1 -- 172.21.15.123:0/1371055960 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6a4011850 con 0x7fa6b4073180 2024-09-15T23:12:38.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.036+0000 7fa69b7fe640 1 -- 172.21.15.123:0/1371055960 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a4011c40 con 0x7fa6b4073180 2024-09-15T23:12:38.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.036+0000 7fa6b93d8640 1 -- 172.21.15.123:0/1371055960 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6b4155e00 con 0x7fa6b4073180 2024-09-15T23:12:38.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.036+0000 7fa6b93d8640 1 -- 172.21.15.123:0/1371055960 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6b41427e0 con 0x7fa6b4073180 2024-09-15T23:12:38.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.037+0000 7fa6b93d8640 1 -- 172.21.15.123:0/1371055960 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6b41462b0 con 0x7fa6b4073180 2024-09-15T23:12:38.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.037+0000 7fa69b7fe640 1 -- 172.21.15.123:0/1371055960 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa6a4018020 con 0x7fa6b4073180 2024-09-15T23:12:38.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.038+0000 7fa69b7fe640 1 --2- 172.21.15.123:0/1371055960 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa6a006c2b0 0x7fa6a006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:38.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.038+0000 7fa69b7fe640 1 -- 172.21.15.123:0/1371055960 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fa6a408b370 con 0x7fa6b4073180 2024-09-15T23:12:38.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.038+0000 7fa6b27fc640 1 --2- 172.21.15.123:0/1371055960 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa6a006c2b0 0x7fa6a006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:38.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.038+0000 7fa6b27fc640 1 --2- 172.21.15.123:0/1371055960 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa6a006c2b0 0x7fa6a006e770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8034000 tx=0x7fa6a802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:38.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.042+0000 7fa69b7fe640 1 -- 172.21.15.123:0/1371055960 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa6a401f020 con 0x7fa6b4073180 2024-09-15T23:12:38.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.219+0000 7fa6b93d8640 1 -- 172.21.15.123:0/1371055960 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa6b40d04e0 con 0x7fa6b4073180 2024-09-15T23:12:38.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.220+0000 7fa69b7fe640 1 -- 172.21.15.123:0/1371055960 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7fa6a40172c0 con 0x7fa6b4073180 2024-09-15T23:12:38.221 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-15T23:12:38.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.221+0000 7fa6b93d8640 1 -- 172.21.15.123:0/1371055960 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa6a006c2b0 msgr2=0x7fa6a006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:38.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.221+0000 7fa6b93d8640 1 --2- 172.21.15.123:0/1371055960 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa6a006c2b0 0x7fa6a006e770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8034000 tx=0x7fa6a802e000 comp rx=0 tx=0).stop 2024-09-15T23:12:38.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.221+0000 7fa6b93d8640 1 -- 172.21.15.123:0/1371055960 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6b4073180 msgr2=0x7fa6b41f1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:38.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.221+0000 7fa6b93d8640 1 --2- 172.21.15.123:0/1371055960 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6b4073180 0x7fa6b41f1db0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa6a400b410 tx=0x7fa6a400b8d0 comp rx=0 tx=0).stop 2024-09-15T23:12:38.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.221+0000 7fa6b93d8640 1 -- 172.21.15.123:0/1371055960 shutdown_connections 2024-09-15T23:12:38.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.222+0000 7fa6b93d8640 1 --2- 172.21.15.123:0/1371055960 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa6b4145ed0 0x7fa6b413d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:38.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.222+0000 7fa6b93d8640 1 --2- 172.21.15.123:0/1371055960 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa6b40b5880 0x7fa6b4141e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:38.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.222+0000 7fa6b93d8640 1 --2- 172.21.15.123:0/1371055960 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa6a006c2b0 0x7fa6a006e770 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:38.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.222+0000 7fa6b93d8640 1 --2- 172.21.15.123:0/1371055960 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6b4073180 0x7fa6b41f1db0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:38.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.222+0000 7fa6b93d8640 1 -- 172.21.15.123:0/1371055960 >> 172.21.15.123:0/1371055960 conn(0x7fa6b40ccec0 msgr2=0x7fa6b40ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:38.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.222+0000 7fa6b93d8640 1 -- 172.21.15.123:0/1371055960 shutdown_connections 2024-09-15T23:12:38.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.222+0000 7fa6b93d8640 1 -- 172.21.15.123:0/1371055960 wait complete. 2024-09-15T23:12:38.234 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-15T23:12:38.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:38.234 DEBUG:teuthology.orchestra.run.smithi123:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-15T23:12:38.260 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-09-15T23:12:38.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:38.260 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T23:12:38.330 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:12:38.330 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:12:38.349 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:12:38.350 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:12:38.408 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:12:38.408 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:12:38.465 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:12:38.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.564+0000 7f4a1ef33640 1 Processor -- start 2024-09-15T23:12:38.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.564+0000 7f4a1ef33640 1 -- start start 2024-09-15T23:12:38.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.565+0000 7f4a1ef33640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a180d2c30 0x7f4a18160a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:38.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.565+0000 7f4a1ef33640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4a180b1990 0x7f4a180d0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:38.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.565+0000 7f4a1ef33640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a18071b60 con 0x7f4a1815c420 2024-09-15T23:12:38.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.565+0000 7f4a1ef33640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f4a180d04c0 con 0x7f4a180b1990 2024-09-15T23:12:38.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.565+0000 7f4a1ef33640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4a180b1e20 con 0x7f4a180d2c30 2024-09-15T23:12:38.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.565+0000 7f4a1cccf640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f4a1815c420 0x7f4a180d2520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53564/0 (socket says 172.21.15.123:53564) 2024-09-15T23:12:38.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.565+0000 7f4a1cccf640 1 -- 172.21.15.123:0/357859297 learned_addr learned my addr 172.21.15.123:0/357859297 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:38.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.565+0000 7f4a17fff640 1 --2- 172.21.15.123:0/357859297 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a180d2c30 0x7f4a18160a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:38.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.565+0000 7f4a1d4d0640 1 --2- 172.21.15.123:0/357859297 >> v2:172.21.15.188:3300/0 conn(0x7f4a180b1990 0x7f4a180d0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:38.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.565+0000 7f4a177fe640 1 -- 172.21.15.123:0/357859297 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2503727215 0 0) 0x7f4a18071b60 con 0x7f4a1815c420 2024-09-15T23:12:38.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.565+0000 7f4a177fe640 1 -- 172.21.15.123:0/357859297 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a08003520 con 0x7f4a1815c420 2024-09-15T23:12:38.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.565+0000 7f4a177fe640 1 -- 172.21.15.123:0/357859297 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2030512520 0 0) 0x7f4a08003520 con 0x7f4a1815c420 2024-09-15T23:12:38.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.565+0000 7f4a177fe640 1 -- 172.21.15.123:0/357859297 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a180d2c30 msgr2=0x7f4a18160a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:38.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.565+0000 7f4a177fe640 1 --2- 172.21.15.123:0/357859297 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a180d2c30 0x7f4a18160a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:38.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.565+0000 7f4a177fe640 1 -- 172.21.15.123:0/357859297 >> v2:172.21.15.188:3300/0 conn(0x7f4a180b1990 msgr2=0x7f4a180d0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:38.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.565+0000 7f4a177fe640 1 --2- 172.21.15.123:0/357859297 >> v2:172.21.15.188:3300/0 conn(0x7f4a180b1990 0x7f4a180d0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:38.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.565+0000 7f4a177fe640 1 -- 172.21.15.123:0/357859297 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a180715a0 con 0x7f4a1815c420 2024-09-15T23:12:38.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.565+0000 7f4a177fe640 1 -- 172.21.15.123:0/357859297 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f4a0c001670 con 0x7f4a1815c420 2024-09-15T23:12:38.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.566+0000 7f4a177fe640 1 -- 172.21.15.123:0/357859297 >> v1:172.21.15.123:6789/0 conn(0x7f4a1815c420 legacy=0x7f4a180d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:38.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.566+0000 7f4a177fe640 1 --2- 172.21.15.123:0/357859297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a080039b0 0x7f4a08003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:38.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.566+0000 7f4a177fe640 1 --2- 172.21.15.123:0/357859297 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a08004800 0x7f4a08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:38.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.566+0000 7f4a177fe640 1 --2- 172.21.15.123:0/357859297 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a180d2c30 0x7f4a080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:38.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.566+0000 7f4a177fe640 1 -- 172.21.15.123:0/357859297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4a180d04c0 con 0x7f4a080039b0 2024-09-15T23:12:38.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.566+0000 7f4a177fe640 1 -- 172.21.15.123:0/357859297 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4a180b1e20 con 0x7f4a08004800 2024-09-15T23:12:38.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.566+0000 7f4a177fe640 1 -- 172.21.15.123:0/357859297 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4a0800ba70 con 0x7f4a180d2c30 2024-09-15T23:12:38.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.566+0000 7f4a1cccf640 1 --2- 172.21.15.123:0/357859297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a080039b0 0x7f4a08003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:38.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.566+0000 7f4a17fff640 1 --2- 172.21.15.123:0/357859297 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a08004800 0x7f4a08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:38.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.566+0000 7f4a1d4d0640 1 --2- 172.21.15.123:0/357859297 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a180d2c30 0x7f4a080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:38.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.566+0000 7f4a1cccf640 1 -- 172.21.15.123:0/357859297 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a180d2c30 msgr2=0x7f4a080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:38.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.566+0000 7f4a1cccf640 1 --2- 172.21.15.123:0/357859297 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a180d2c30 0x7f4a080051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:38.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.566+0000 7f4a1cccf640 1 -- 172.21.15.123:0/357859297 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a08004800 msgr2=0x7f4a08004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:38.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.566+0000 7f4a1cccf640 1 --2- 172.21.15.123:0/357859297 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a08004800 0x7f4a08004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:38.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.566+0000 7f4a1cccf640 1 -- 172.21.15.123:0/357859297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a08003520 con 0x7f4a080039b0 2024-09-15T23:12:38.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.566+0000 7f4a1d4d0640 1 --2- 172.21.15.123:0/357859297 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a180d2c30 0x7f4a080051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:38.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.567+0000 7f4a1cccf640 1 --2- 172.21.15.123:0/357859297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a080039b0 0x7f4a08003dd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c007fd0 tx=0x7f4a08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a329ceaf8ef000c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:38.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.567+0000 7f4a177fe640 1 -- 172.21.15.123:0/357859297 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c007d50 con 0x7f4a080039b0 2024-09-15T23:12:38.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.567+0000 7f4a177fe640 1 -- 172.21.15.123:0/357859297 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a0c005ad0 con 0x7f4a080039b0 2024-09-15T23:12:38.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.567+0000 7f4a177fe640 1 -- 172.21.15.123:0/357859297 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c007070 con 0x7f4a080039b0 2024-09-15T23:12:38.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.567+0000 7f4a1ef33640 1 -- 172.21.15.123:0/357859297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a080039b0 msgr2=0x7f4a08003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:38.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.567+0000 7f4a1ef33640 1 --2- 172.21.15.123:0/357859297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a080039b0 0x7f4a08003dd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c007fd0 tx=0x7f4a08005830 comp rx=0 tx=0).stop 2024-09-15T23:12:38.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.567+0000 7f4a1d4d0640 1 -- 172.21.15.123:0/357859297 reap_dead start 2024-09-15T23:12:38.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.567+0000 7f4a1ef33640 1 -- 172.21.15.123:0/357859297 shutdown_connections 2024-09-15T23:12:38.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.567+0000 7f4a1ef33640 1 -- 172.21.15.123:0/357859297 >> 172.21.15.123:0/357859297 conn(0x7f4a18067fb0 msgr2=0x7f4a1806f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:38.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.567+0000 7f4a1ef33640 1 -- 172.21.15.123:0/357859297 shutdown_connections 2024-09-15T23:12:38.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.567+0000 7f4a1ef33640 1 -- 172.21.15.123:0/357859297 wait complete. 2024-09-15T23:12:38.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.568+0000 7f4a1ef33640 1 Processor -- start 2024-09-15T23:12:38.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.569+0000 7f4a1ef33640 1 -- start start 2024-09-15T23:12:38.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.569+0000 7f4a1ef33640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a080039b0 0x7f4a1813e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:38.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.569+0000 7f4a1ef33640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a18152670 0x7f4a18152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:38.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.569+0000 7f4a1ef33640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a181f24f0 0x7f4a181f2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:38.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.569+0000 7f4a1ef33640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4a18160a40 con 0x7f4a18152670 2024-09-15T23:12:38.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.569+0000 7f4a1ef33640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1815c800 con 0x7f4a080039b0 2024-09-15T23:12:38.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.569+0000 7f4a1ef33640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4a18160bc0 con 0x7f4a181f24f0 2024-09-15T23:12:38.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.570+0000 7f4a17fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a18152670 0x7f4a18152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:38.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.570+0000 7f4a17fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a18152670 0x7f4a18152af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46170/0 (socket says 172.21.15.123:46170) 2024-09-15T23:12:38.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.570+0000 7f4a17fff640 1 -- 172.21.15.123:0/3981692106 learned_addr learned my addr 172.21.15.123:0/3981692106 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:38.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.570+0000 7f4a1cccf640 1 --2- 172.21.15.123:0/3981692106 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a080039b0 0x7f4a1813e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:38.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.570+0000 7f4a1d4d0640 1 --2- 172.21.15.123:0/3981692106 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a181f24f0 0x7f4a181f2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:38.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.570+0000 7f4a17fff640 1 -- 172.21.15.123:0/3981692106 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a181f24f0 msgr2=0x7f4a181f2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:38.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.570+0000 7f4a17fff640 1 --2- 172.21.15.123:0/3981692106 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a181f24f0 0x7f4a181f2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:38.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.570+0000 7f4a17fff640 1 -- 172.21.15.123:0/3981692106 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a080039b0 msgr2=0x7f4a1813e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:38.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.570+0000 7f4a17fff640 1 --2- 172.21.15.123:0/3981692106 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a080039b0 0x7f4a1813e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:38.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.570+0000 7f4a17fff640 1 -- 172.21.15.123:0/3981692106 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a18155730 con 0x7f4a18152670 2024-09-15T23:12:38.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.570+0000 7f4a17fff640 1 --2- 172.21.15.123:0/3981692106 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a18152670 0x7f4a18152af0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4a04011930 tx=0x7f4a04011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:38.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.570+0000 7f4a157fa640 1 -- 172.21.15.123:0/3981692106 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a04019070 con 0x7f4a18152670 2024-09-15T23:12:38.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.570+0000 7f4a157fa640 1 -- 172.21.15.123:0/3981692106 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a04004300 con 0x7f4a18152670 2024-09-15T23:12:38.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.570+0000 7f4a157fa640 1 -- 172.21.15.123:0/3981692106 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0400f9e0 con 0x7f4a18152670 2024-09-15T23:12:38.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.570+0000 7f4a1ef33640 1 -- 172.21.15.123:0/3981692106 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a1815db00 con 0x7f4a18152670 2024-09-15T23:12:38.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.570+0000 7f4a1ef33640 1 -- 172.21.15.123:0/3981692106 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a1815e0c0 con 0x7f4a18152670 2024-09-15T23:12:38.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.571+0000 7f4a1ef33640 1 -- 172.21.15.123:0/3981692106 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a18153030 con 0x7f4a18152670 2024-09-15T23:12:38.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.572+0000 7f4a157fa640 1 -- 172.21.15.123:0/3981692106 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4a0401c070 con 0x7f4a18152670 2024-09-15T23:12:38.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.572+0000 7f4a157fa640 1 --2- 172.21.15.123:0/3981692106 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f49fc06c2e0 0x7f49fc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:38.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.572+0000 7f4a157fa640 1 -- 172.21.15.123:0/3981692106 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f4a0408b790 con 0x7f4a18152670 2024-09-15T23:12:38.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.572+0000 7f4a1cccf640 1 --2- 172.21.15.123:0/3981692106 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f49fc06c2e0 0x7f49fc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:38.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.573+0000 7f4a1cccf640 1 --2- 172.21.15.123:0/3981692106 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f49fc06c2e0 0x7f49fc06e7a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c033000 tx=0x7f4a0c009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:38.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.576+0000 7f4a157fa640 1 -- 172.21.15.123:0/3981692106 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4a18153030 con 0x7f4a18152670 2024-09-15T23:12:38.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.750+0000 7f4a1ef33640 1 -- 172.21.15.123:0/3981692106 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4a180b3710 con 0x7f4a18152670 2024-09-15T23:12:38.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.750+0000 7f4a157fa640 1 -- 172.21.15.123:0/3981692106 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f4a04059820 con 0x7f4a18152670 2024-09-15T23:12:38.751 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-15T23:12:38.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.752+0000 7f4a1ef33640 1 -- 172.21.15.123:0/3981692106 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f49fc06c2e0 msgr2=0x7f49fc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:38.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.752+0000 7f4a1ef33640 1 --2- 172.21.15.123:0/3981692106 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f49fc06c2e0 0x7f49fc06e7a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c033000 tx=0x7f4a0c009030 comp rx=0 tx=0).stop 2024-09-15T23:12:38.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.752+0000 7f4a1ef33640 1 -- 172.21.15.123:0/3981692106 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a18152670 msgr2=0x7f4a18152af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:38.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.752+0000 7f4a1ef33640 1 --2- 172.21.15.123:0/3981692106 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a18152670 0x7f4a18152af0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4a04011930 tx=0x7f4a04011df0 comp rx=0 tx=0).stop 2024-09-15T23:12:38.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.752+0000 7f4a1ef33640 1 -- 172.21.15.123:0/3981692106 shutdown_connections 2024-09-15T23:12:38.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.752+0000 7f4a1ef33640 1 --2- 172.21.15.123:0/3981692106 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a181f24f0 0x7f4a181f2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:38.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.752+0000 7f4a1ef33640 1 --2- 172.21.15.123:0/3981692106 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f49fc06c2e0 0x7f49fc06e7a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:38.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.752+0000 7f4a1ef33640 1 --2- 172.21.15.123:0/3981692106 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a18152670 0x7f4a18152af0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:38.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.752+0000 7f4a1ef33640 1 --2- 172.21.15.123:0/3981692106 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a080039b0 0x7f4a1813e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:38.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.752+0000 7f4a1ef33640 1 -- 172.21.15.123:0/3981692106 >> 172.21.15.123:0/3981692106 conn(0x7f4a18067fb0 msgr2=0x7f4a180b73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:38.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.752+0000 7f4a1ef33640 1 -- 172.21.15.123:0/3981692106 shutdown_connections 2024-09-15T23:12:38.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:38.752+0000 7f4a1ef33640 1 -- 172.21.15.123:0/3981692106 wait complete. 2024-09-15T23:12:38.764 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-15T23:12:38.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:38.764 DEBUG:teuthology.orchestra.run.smithi188:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-15T23:12:38.795 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi188.front.sepia.ceph.com 2024-09-15T23:12:38.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:38.795 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-15T23:12:38.865 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:12:38.865 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:12:38.881 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:12:38.881 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:12:38.937 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:12:38.937 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:12:38.992 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:12:39.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.129+0000 7fbee0aba640 1 Processor -- start 2024-09-15T23:12:39.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.129+0000 7fbee0aba640 1 -- start start 2024-09-15T23:12:39.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.130+0000 7fbee0aba640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbedc15e6d0 0x7fbedc071390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:39.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.130+0000 7fbee0aba640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbedc15eab0 con 0x7fbedc06cd20 2024-09-15T23:12:39.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.130+0000 7fbee0aba640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbedc15ed70 con 0x7fbedc070b80 2024-09-15T23:12:39.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.130+0000 7fbee0aba640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fbedc15f050 con 0x7fbedc15e6d0 2024-09-15T23:12:39.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.130+0000 7fbeda59c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbedc15e6d0 0x7fbedc071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:39.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.130+0000 7fbed9d9b640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fbedc06cd20 0x7fbedc0b6d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53580/0 (socket says 172.21.15.123:53580) 2024-09-15T23:12:39.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.130+0000 7fbed9d9b640 1 -- 172.21.15.123:0/2788617888 learned_addr learned my addr 172.21.15.123:0/2788617888 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:39.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.130+0000 7fbeda59c640 1 -- 172.21.15.123:0/2788617888 >> v1:172.21.15.188:6789/0 conn(0x7fbedc070b80 legacy=0x7fbedc1622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:39.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.130+0000 7fbeda59c640 1 -- 172.21.15.123:0/2788617888 >> v1:172.21.15.123:6789/0 conn(0x7fbedc06cd20 legacy=0x7fbedc0b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:39.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.130+0000 7fbed959a640 1 -- 172.21.15.123:0/2788617888 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3018730657 0 0) 0x7fbedc15eab0 con 0x7fbedc06cd20 2024-09-15T23:12:39.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.130+0000 7fbeda59c640 1 -- 172.21.15.123:0/2788617888 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbedc15f330 con 0x7fbedc15e6d0 2024-09-15T23:12:39.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.131+0000 7fbeda59c640 1 --2- 172.21.15.123:0/2788617888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbedc15e6d0 0x7fbedc071390 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbecc0097a0 tx=0x7fbecc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cadb1ac1c20a2100 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:39.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.131+0000 7fbed959a640 1 -- 172.21.15.123:0/2788617888 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbecc037070 con 0x7fbedc15e6d0 2024-09-15T23:12:39.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.131+0000 7fbed959a640 1 -- 172.21.15.123:0/2788617888 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbecc032440 con 0x7fbedc15e6d0 2024-09-15T23:12:39.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.131+0000 7fbed959a640 1 -- 172.21.15.123:0/2788617888 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbecc032810 con 0x7fbedc15e6d0 2024-09-15T23:12:39.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.132+0000 7fbee0aba640 1 -- 172.21.15.123:0/2788617888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbedc15e6d0 msgr2=0x7fbedc071390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:39.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.132+0000 7fbee0aba640 1 --2- 172.21.15.123:0/2788617888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbedc15e6d0 0x7fbedc071390 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbecc0097a0 tx=0x7fbecc02a230 comp rx=0 tx=0).stop 2024-09-15T23:12:39.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.132+0000 7fbee0aba640 1 -- 172.21.15.123:0/2788617888 shutdown_connections 2024-09-15T23:12:39.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.132+0000 7fbee0aba640 1 --2- 172.21.15.123:0/2788617888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbedc15e6d0 0x7fbedc071390 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:39.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.132+0000 7fbee0aba640 1 -- 172.21.15.123:0/2788617888 >> 172.21.15.123:0/2788617888 conn(0x7fbedc067fb0 msgr2=0x7fbedc06f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:39.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.132+0000 7fbee0aba640 1 -- 172.21.15.123:0/2788617888 shutdown_connections 2024-09-15T23:12:39.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.132+0000 7fbee0aba640 1 -- 172.21.15.123:0/2788617888 wait complete. 2024-09-15T23:12:39.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.133+0000 7fbee0aba640 1 Processor -- start 2024-09-15T23:12:39.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.133+0000 7fbee0aba640 1 -- start start 2024-09-15T23:12:39.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.134+0000 7fbee0aba640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbedc06cd20 0x7fbedc1f3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:39.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.134+0000 7fbee0aba640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbedc070b80 0x7fbedc0b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:39.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.134+0000 7fbee0aba640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbedc15e6d0 0x7fbedc0b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:39.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.134+0000 7fbee0aba640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc0718d0 con 0x7fbedc070b80 2024-09-15T23:12:39.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.134+0000 7fbee0aba640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbedc15f8f0 con 0x7fbedc06cd20 2024-09-15T23:12:39.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.134+0000 7fbee0aba640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbedc071a50 con 0x7fbedc15e6d0 2024-09-15T23:12:39.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.134+0000 7fbed9d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbedc070b80 0x7fbedc0b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:39.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.134+0000 7fbed9d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbedc070b80 0x7fbedc0b38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46190/0 (socket says 172.21.15.123:46190) 2024-09-15T23:12:39.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.134+0000 7fbed9d9b640 1 -- 172.21.15.123:0/970310050 learned_addr learned my addr 172.21.15.123:0/970310050 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:39.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.134+0000 7fbeda59c640 1 --2- 172.21.15.123:0/970310050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbedc06cd20 0x7fbedc1f3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:39.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.134+0000 7fbed9d9b640 1 -- 172.21.15.123:0/970310050 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbedc15e6d0 msgr2=0x7fbedc0b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:39.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.134+0000 7fbedad9d640 1 --2- 172.21.15.123:0/970310050 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbedc15e6d0 0x7fbedc0b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:39.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.134+0000 7fbed9d9b640 1 --2- 172.21.15.123:0/970310050 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbedc15e6d0 0x7fbedc0b3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:39.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.134+0000 7fbed9d9b640 1 -- 172.21.15.123:0/970310050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbedc06cd20 msgr2=0x7fbedc1f3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:39.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.134+0000 7fbed9d9b640 1 --2- 172.21.15.123:0/970310050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbedc06cd20 0x7fbedc1f3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:39.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.134+0000 7fbed9d9b640 1 -- 172.21.15.123:0/970310050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbedc14ce30 con 0x7fbedc070b80 2024-09-15T23:12:39.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.134+0000 7fbeda59c640 1 --2- 172.21.15.123:0/970310050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbedc06cd20 0x7fbedc1f3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:39.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.134+0000 7fbed9d9b640 1 --2- 172.21.15.123:0/970310050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbedc070b80 0x7fbedc0b38b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbed000c460 tx=0x7fbed000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:39.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.134+0000 7fbecaffd640 1 -- 172.21.15.123:0/970310050 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed00074e0 con 0x7fbedc070b80 2024-09-15T23:12:39.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.135+0000 7fbecaffd640 1 -- 172.21.15.123:0/970310050 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbed00047e0 con 0x7fbedc070b80 2024-09-15T23:12:39.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.135+0000 7fbee0aba640 1 -- 172.21.15.123:0/970310050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbedc14d110 con 0x7fbedc070b80 2024-09-15T23:12:39.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.135+0000 7fbecaffd640 1 -- 172.21.15.123:0/970310050 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed0004bd0 con 0x7fbedc070b80 2024-09-15T23:12:39.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.135+0000 7fbee0aba640 1 -- 172.21.15.123:0/970310050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbedc14d6d0 con 0x7fbedc070b80 2024-09-15T23:12:39.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.135+0000 7fbee0aba640 1 -- 172.21.15.123:0/970310050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbedc071390 con 0x7fbedc070b80 2024-09-15T23:12:39.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.136+0000 7fbecaffd640 1 -- 172.21.15.123:0/970310050 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbed0011070 con 0x7fbedc070b80 2024-09-15T23:12:39.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.136+0000 7fbecaffd640 1 --2- 172.21.15.123:0/970310050 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbebc06c2b0 0x7fbebc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:39.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.137+0000 7fbecaffd640 1 -- 172.21.15.123:0/970310050 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fbed008b020 con 0x7fbedc070b80 2024-09-15T23:12:39.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.137+0000 7fbeda59c640 1 --2- 172.21.15.123:0/970310050 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbebc06c2b0 0x7fbebc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:39.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.137+0000 7fbeda59c640 1 --2- 172.21.15.123:0/970310050 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbebc06c2b0 0x7fbebc06e770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbecc034000 tx=0x7fbecc02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:39.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.141+0000 7fbecaffd640 1 -- 172.21.15.123:0/970310050 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbed001a2b0 con 0x7fbedc070b80 2024-09-15T23:12:39.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.318+0000 7fbee0aba640 1 -- 172.21.15.123:0/970310050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbedc1f3ff0 con 0x7fbedc070b80 2024-09-15T23:12:39.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.319+0000 7fbecaffd640 1 -- 172.21.15.123:0/970310050 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7fbed0059820 con 0x7fbedc070b80 2024-09-15T23:12:39.320 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-15T23:12:39.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.321+0000 7fbee0aba640 1 -- 172.21.15.123:0/970310050 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbebc06c2b0 msgr2=0x7fbebc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:39.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.321+0000 7fbee0aba640 1 --2- 172.21.15.123:0/970310050 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbebc06c2b0 0x7fbebc06e770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbecc034000 tx=0x7fbecc02e000 comp rx=0 tx=0).stop 2024-09-15T23:12:39.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.321+0000 7fbee0aba640 1 -- 172.21.15.123:0/970310050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbedc070b80 msgr2=0x7fbedc0b38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:39.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.321+0000 7fbee0aba640 1 --2- 172.21.15.123:0/970310050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbedc070b80 0x7fbedc0b38b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbed000c460 tx=0x7fbed000c920 comp rx=0 tx=0).stop 2024-09-15T23:12:39.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.321+0000 7fbee0aba640 1 -- 172.21.15.123:0/970310050 shutdown_connections 2024-09-15T23:12:39.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.321+0000 7fbee0aba640 1 --2- 172.21.15.123:0/970310050 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbedc15e6d0 0x7fbedc0b3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:39.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.321+0000 7fbee0aba640 1 --2- 172.21.15.123:0/970310050 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbebc06c2b0 0x7fbebc06e770 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:39.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.321+0000 7fbee0aba640 1 --2- 172.21.15.123:0/970310050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbedc070b80 0x7fbedc0b38b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:39.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.321+0000 7fbee0aba640 1 --2- 172.21.15.123:0/970310050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbedc06cd20 0x7fbedc1f3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:39.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.321+0000 7fbee0aba640 1 -- 172.21.15.123:0/970310050 >> 172.21.15.123:0/970310050 conn(0x7fbedc067fb0 msgr2=0x7fbedc161fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:39.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.321+0000 7fbee0aba640 1 -- 172.21.15.123:0/970310050 shutdown_connections 2024-09-15T23:12:39.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.321+0000 7fbee0aba640 1 -- 172.21.15.123:0/970310050 wait complete. 2024-09-15T23:12:39.332 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-15T23:12:39.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:39.333 DEBUG:teuthology.orchestra.run.smithi123:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-15T23:12:39.359 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-09-15T23:12:39.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:39.359 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-15T23:12:39.414 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:12:39.415 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:12:39.434 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:12:39.434 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:12:39.493 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:12:39.493 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:12:39.552 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:12:39.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.651+0000 7fd31f733640 1 Processor -- start 2024-09-15T23:12:39.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.651+0000 7fd31f733640 1 -- start start 2024-09-15T23:12:39.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.652+0000 7fd31f733640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd3180b6970 0x7fd3180b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:39.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.652+0000 7fd31f733640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3180d0e70 con 0x7fd31815ed20 2024-09-15T23:12:39.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.652+0000 7fd31f733640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3180d41c0 con 0x7fd3180d23b0 2024-09-15T23:12:39.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.652+0000 7fd31f733640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fd3180d35b0 con 0x7fd3180b6970 2024-09-15T23:12:39.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.652+0000 7fd31d4cf640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd31815ed20 0x7fd3180b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53590/0 (socket says 172.21.15.123:53590) 2024-09-15T23:12:39.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.652+0000 7fd31d4cf640 1 -- 172.21.15.123:0/4089507223 learned_addr learned my addr 172.21.15.123:0/4089507223 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:39.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.653+0000 7fd31ccce640 1 --2- 172.21.15.123:0/4089507223 >> v2:172.21.15.188:3300/0 conn(0x7fd3180b6970 0x7fd3180b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:39.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.653+0000 7fd30ffff640 1 -- 172.21.15.123:0/4089507223 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2840652715 0 0) 0x7fd314001110 con 0x7fd31815ed20 2024-09-15T23:12:39.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.653+0000 7fd30ffff640 1 -- 172.21.15.123:0/4089507223 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd304003520 con 0x7fd31815ed20 2024-09-15T23:12:39.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.653+0000 7fd30ffff640 1 -- 172.21.15.123:0/4089507223 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 741221694 0 0) 0x7fd304003520 con 0x7fd31815ed20 2024-09-15T23:12:39.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.653+0000 7fd30ffff640 1 -- 172.21.15.123:0/4089507223 >> v2:172.21.15.188:3300/0 conn(0x7fd3180b6970 msgr2=0x7fd3180b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:39.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.653+0000 7fd30ffff640 1 --2- 172.21.15.123:0/4089507223 >> v2:172.21.15.188:3300/0 conn(0x7fd3180b6970 0x7fd3180b80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:39.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.653+0000 7fd30ffff640 1 -- 172.21.15.123:0/4089507223 >> v1:172.21.15.188:6789/0 conn(0x7fd3180d23b0 legacy=0x7fd3180b8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:39.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.653+0000 7fd30ffff640 1 -- 172.21.15.123:0/4089507223 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3180d3890 con 0x7fd31815ed20 2024-09-15T23:12:39.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.653+0000 7fd30ffff640 1 -- 172.21.15.123:0/4089507223 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fd314001840 con 0x7fd31815ed20 2024-09-15T23:12:39.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.653+0000 7fd30ffff640 1 -- 172.21.15.123:0/4089507223 >> v1:172.21.15.123:6789/0 conn(0x7fd31815ed20 legacy=0x7fd3180b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:39.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.653+0000 7fd30ffff640 1 --2- 172.21.15.123:0/4089507223 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd3040039b0 0x7fd304003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:39.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.653+0000 7fd30ffff640 1 --2- 172.21.15.123:0/4089507223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd304004800 0x7fd304004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:39.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.653+0000 7fd30ffff640 1 --2- 172.21.15.123:0/4089507223 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd3040051c0 0x7fd30400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:39.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.653+0000 7fd30ffff640 1 -- 172.21.15.123:0/4089507223 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd3180d35b0 con 0x7fd304004800 2024-09-15T23:12:39.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.653+0000 7fd30ffff640 1 -- 172.21.15.123:0/4089507223 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd30400c160 con 0x7fd3040039b0 2024-09-15T23:12:39.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.653+0000 7fd30ffff640 1 -- 172.21.15.123:0/4089507223 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd30400c360 con 0x7fd3040051c0 2024-09-15T23:12:39.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.653+0000 7fd31ccce640 1 --2- 172.21.15.123:0/4089507223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd304004800 0x7fd304004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:39.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.653+0000 7fd31d4cf640 1 --2- 172.21.15.123:0/4089507223 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd3040039b0 0x7fd304003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:39.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.653+0000 7fd31dcd0640 1 --2- 172.21.15.123:0/4089507223 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd3040051c0 0x7fd30400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:39.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.653+0000 7fd31ccce640 1 -- 172.21.15.123:0/4089507223 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd3040051c0 msgr2=0x7fd30400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:39.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.653+0000 7fd31ccce640 1 --2- 172.21.15.123:0/4089507223 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd3040051c0 0x7fd30400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:39.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.653+0000 7fd31ccce640 1 -- 172.21.15.123:0/4089507223 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd3040039b0 msgr2=0x7fd304003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:39.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.653+0000 7fd31ccce640 1 --2- 172.21.15.123:0/4089507223 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd3040039b0 0x7fd304003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:39.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.653+0000 7fd31ccce640 1 -- 172.21.15.123:0/4089507223 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd304003520 con 0x7fd304004800 2024-09-15T23:12:39.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.653+0000 7fd31dcd0640 1 -- 172.21.15.123:0/4089507223 reap_dead start 2024-09-15T23:12:39.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.654+0000 7fd31ccce640 1 --2- 172.21.15.123:0/4089507223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd304004800 0x7fd304004c80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd308009ac0 tx=0x7fd304005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=145ee78073e60331 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:39.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.654+0000 7fd30ffff640 1 -- 172.21.15.123:0/4089507223 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd308036070 con 0x7fd304004800 2024-09-15T23:12:39.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.654+0000 7fd30ffff640 1 -- 172.21.15.123:0/4089507223 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd308031400 con 0x7fd304004800 2024-09-15T23:12:39.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.654+0000 7fd30ffff640 1 -- 172.21.15.123:0/4089507223 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd308009690 con 0x7fd304004800 2024-09-15T23:12:39.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.655+0000 7fd31f733640 1 -- 172.21.15.123:0/4089507223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd304004800 msgr2=0x7fd304004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:39.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.655+0000 7fd31f733640 1 --2- 172.21.15.123:0/4089507223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd304004800 0x7fd304004c80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd308009ac0 tx=0x7fd304005830 comp rx=0 tx=0).stop 2024-09-15T23:12:39.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.655+0000 7fd31f733640 1 -- 172.21.15.123:0/4089507223 shutdown_connections 2024-09-15T23:12:39.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.655+0000 7fd31f733640 1 --2- 172.21.15.123:0/4089507223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd304004800 0x7fd304004c80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:39.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.655+0000 7fd31f733640 1 -- 172.21.15.123:0/4089507223 >> 172.21.15.123:0/4089507223 conn(0x7fd3180d1260 msgr2=0x7fd3180d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:39.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.655+0000 7fd31f733640 1 -- 172.21.15.123:0/4089507223 shutdown_connections 2024-09-15T23:12:39.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.655+0000 7fd31f733640 1 -- 172.21.15.123:0/4089507223 wait complete. 2024-09-15T23:12:39.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.656+0000 7fd31f733640 1 Processor -- start 2024-09-15T23:12:39.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.656+0000 7fd31f733640 1 -- start start 2024-09-15T23:12:39.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.657+0000 7fd31f733640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd304004800 0x7fd31814dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:39.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.657+0000 7fd31f733640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd31815d010 0x7fd3180cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:39.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.657+0000 7fd31f733640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd3180cdf40 0x7fd3181e72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:39.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.657+0000 7fd31f733640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd3180d32a0 con 0x7fd31815d010 2024-09-15T23:12:39.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.657+0000 7fd31f733640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd3180d3e50 con 0x7fd304004800 2024-09-15T23:12:39.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.657+0000 7fd31f733640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd31815f100 con 0x7fd3180cdf40 2024-09-15T23:12:39.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.657+0000 7fd31ccce640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd31815d010 0x7fd3180cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:39.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.657+0000 7fd31ccce640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd31815d010 0x7fd3180cc5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46198/0 (socket says 172.21.15.123:46198) 2024-09-15T23:12:39.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.657+0000 7fd31ccce640 1 -- 172.21.15.123:0/1815592615 learned_addr learned my addr 172.21.15.123:0/1815592615 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:39.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.657+0000 7fd31dcd0640 1 --2- 172.21.15.123:0/1815592615 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd3180cdf40 0x7fd3181e72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:39.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.657+0000 7fd31d4cf640 1 --2- 172.21.15.123:0/1815592615 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd304004800 0x7fd31814dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:39.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.657+0000 7fd31ccce640 1 -- 172.21.15.123:0/1815592615 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd3180cdf40 msgr2=0x7fd3181e72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:39.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.657+0000 7fd31ccce640 1 --2- 172.21.15.123:0/1815592615 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd3180cdf40 0x7fd3181e72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:39.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.657+0000 7fd31ccce640 1 -- 172.21.15.123:0/1815592615 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd304004800 msgr2=0x7fd31814dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:39.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.657+0000 7fd31ccce640 1 --2- 172.21.15.123:0/1815592615 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd304004800 0x7fd31814dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:39.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.657+0000 7fd31ccce640 1 -- 172.21.15.123:0/1815592615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31814e150 con 0x7fd31815d010 2024-09-15T23:12:39.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.657+0000 7fd31ccce640 1 --2- 172.21.15.123:0/1815592615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd31815d010 0x7fd3180cc5c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd308009be0 tx=0x7fd308004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:39.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.657+0000 7fd30dffb640 1 -- 172.21.15.123:0/1815592615 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30803f020 con 0x7fd31815d010 2024-09-15T23:12:39.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.657+0000 7fd30dffb640 1 -- 172.21.15.123:0/1815592615 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd308037040 con 0x7fd31815d010 2024-09-15T23:12:39.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.657+0000 7fd30dffb640 1 -- 172.21.15.123:0/1815592615 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd308036070 con 0x7fd31815d010 2024-09-15T23:12:39.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.657+0000 7fd31f733640 1 -- 172.21.15.123:0/1815592615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3180ccea0 con 0x7fd31815d010 2024-09-15T23:12:39.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.658+0000 7fd31f733640 1 -- 172.21.15.123:0/1815592615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3180cd460 con 0x7fd31815d010 2024-09-15T23:12:39.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.659+0000 7fd31f733640 1 -- 172.21.15.123:0/1815592615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3180b7010 con 0x7fd31815d010 2024-09-15T23:12:39.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.659+0000 7fd30dffb640 1 -- 172.21.15.123:0/1815592615 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd308042020 con 0x7fd31815d010 2024-09-15T23:12:39.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.659+0000 7fd30dffb640 1 --2- 172.21.15.123:0/1815592615 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd2fc06c2e0 0x7fd2fc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:39.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.660+0000 7fd30dffb640 1 -- 172.21.15.123:0/1815592615 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd3080ab400 con 0x7fd31815d010 2024-09-15T23:12:39.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.660+0000 7fd31d4cf640 1 --2- 172.21.15.123:0/1815592615 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd2fc06c2e0 0x7fd2fc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:39.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.660+0000 7fd31d4cf640 1 --2- 172.21.15.123:0/1815592615 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd2fc06c2e0 0x7fd2fc06e7a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd314007f60 tx=0x7fd314007ef0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:39.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.664+0000 7fd30dffb640 1 -- 172.21.15.123:0/1815592615 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd308049030 con 0x7fd31815d010 2024-09-15T23:12:39.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.842+0000 7fd31f733640 1 -- 172.21.15.123:0/1815592615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd3180d0a90 con 0x7fd31815d010 2024-09-15T23:12:39.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.843+0000 7fd30dffb640 1 -- 172.21.15.123:0/1815592615 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7fd31814e150 con 0x7fd31815d010 2024-09-15T23:12:39.844 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-15T23:12:39.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.845+0000 7fd31f733640 1 -- 172.21.15.123:0/1815592615 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd2fc06c2e0 msgr2=0x7fd2fc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:39.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.845+0000 7fd31f733640 1 --2- 172.21.15.123:0/1815592615 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd2fc06c2e0 0x7fd2fc06e7a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd314007f60 tx=0x7fd314007ef0 comp rx=0 tx=0).stop 2024-09-15T23:12:39.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.845+0000 7fd31f733640 1 -- 172.21.15.123:0/1815592615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd31815d010 msgr2=0x7fd3180cc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:39.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.845+0000 7fd31f733640 1 --2- 172.21.15.123:0/1815592615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd31815d010 0x7fd3180cc5c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd308009be0 tx=0x7fd308004730 comp rx=0 tx=0).stop 2024-09-15T23:12:39.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.845+0000 7fd31f733640 1 -- 172.21.15.123:0/1815592615 shutdown_connections 2024-09-15T23:12:39.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.845+0000 7fd31f733640 1 --2- 172.21.15.123:0/1815592615 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd3180cdf40 0x7fd3181e72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:39.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.845+0000 7fd31f733640 1 --2- 172.21.15.123:0/1815592615 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd2fc06c2e0 0x7fd2fc06e7a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:39.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.845+0000 7fd31f733640 1 --2- 172.21.15.123:0/1815592615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd31815d010 0x7fd3180cc5c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:39.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.845+0000 7fd31f733640 1 --2- 172.21.15.123:0/1815592615 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd304004800 0x7fd31814dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:39.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.845+0000 7fd31f733640 1 -- 172.21.15.123:0/1815592615 >> 172.21.15.123:0/1815592615 conn(0x7fd3180d1260 msgr2=0x7fd3180b5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:39.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.845+0000 7fd31f733640 1 -- 172.21.15.123:0/1815592615 shutdown_connections 2024-09-15T23:12:39.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:39.845+0000 7fd31f733640 1 -- 172.21.15.123:0/1815592615 wait complete. 2024-09-15T23:12:39.857 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-15T23:12:39.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:39.857 DEBUG:teuthology.orchestra.run.smithi188:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-15T23:12:39.889 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi188.front.sepia.ceph.com 2024-09-15T23:12:39.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:12:39.890 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-15T23:12:39.948 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-15T23:12:39.949 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:12:40.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.046+0000 7f49de89b640 1 Processor -- start 2024-09-15T23:12:40.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.046+0000 7f49de89b640 1 -- start start 2024-09-15T23:12:40.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.047+0000 7f49de89b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f49d8145ed0 0x7f49d80b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:40.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.047+0000 7f49de89b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f49d80b5f90 0x7f49d80735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:40.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.047+0000 7f49de89b640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49d80b4020 con 0x7f49d8073180 2024-09-15T23:12:40.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.047+0000 7f49de89b640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f49d8073b00 con 0x7f49d80b5f90 2024-09-15T23:12:40.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.047+0000 7f49de89b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f49d80b42c0 con 0x7f49d8145ed0 2024-09-15T23:12:40.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.047+0000 7f49dce38640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f49d80b5f90 0x7f49d80735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:40.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.047+0000 7f49cffff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f49d8073180 0x7f49d80b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53594/0 (socket says 172.21.15.123:53594) 2024-09-15T23:12:40.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.047+0000 7f49cffff640 1 -- 172.21.15.123:0/2464170486 learned_addr learned my addr 172.21.15.123:0/2464170486 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:40.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.047+0000 7f49dce38640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f49d80b5f90 0x7f49d80735c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46204/0 (socket says 172.21.15.123:46204) 2024-09-15T23:12:40.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.048+0000 7f49dce38640 1 -- 172.21.15.123:0/2464170486 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f49d8145ed0 msgr2=0x7f49d80b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:40.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.048+0000 7f49d7fff640 1 --2- 172.21.15.123:0/2464170486 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f49d8145ed0 0x7f49d80b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:40.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.048+0000 7f49d77fe640 1 -- 172.21.15.123:0/2464170486 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1474694481 0 0) 0x7f49d80b4020 con 0x7f49d8073180 2024-09-15T23:12:40.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.048+0000 7f49dce38640 1 --2- 172.21.15.123:0/2464170486 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f49d8145ed0 0x7f49d80b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.048+0000 7f49dce38640 1 -- 172.21.15.123:0/2464170486 >> v1:172.21.15.123:6789/0 conn(0x7f49d8073180 legacy=0x7f49d80b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:40.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.048+0000 7f49dce38640 1 -- 172.21.15.123:0/2464170486 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49d80b45a0 con 0x7f49d80b5f90 2024-09-15T23:12:40.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.048+0000 7f49d7fff640 1 --2- 172.21.15.123:0/2464170486 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f49d8145ed0 0x7f49d80b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:40.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.048+0000 7f49dce38640 1 --2- 172.21.15.123:0/2464170486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49d80b5f90 0x7f49d80735c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f49d0009d90 tx=0x7f49d002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3df66a0301b4620 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:40.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.049+0000 7f49d77fe640 1 -- 172.21.15.123:0/2464170486 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d0007740 con 0x7f49d80b5f90 2024-09-15T23:12:40.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.049+0000 7f49d77fe640 1 -- 172.21.15.123:0/2464170486 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49d00078e0 con 0x7f49d80b5f90 2024-09-15T23:12:40.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.049+0000 7f49d77fe640 1 -- 172.21.15.123:0/2464170486 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d0007cb0 con 0x7f49d80b5f90 2024-09-15T23:12:40.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.049+0000 7f49de89b640 1 -- 172.21.15.123:0/2464170486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49d80b5f90 msgr2=0x7f49d80735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:40.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.049+0000 7f49de89b640 1 --2- 172.21.15.123:0/2464170486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49d80b5f90 0x7f49d80735c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f49d0009d90 tx=0x7f49d002a660 comp rx=0 tx=0).stop 2024-09-15T23:12:40.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.049+0000 7f49de89b640 1 -- 172.21.15.123:0/2464170486 shutdown_connections 2024-09-15T23:12:40.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.049+0000 7f49de89b640 1 --2- 172.21.15.123:0/2464170486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49d80b5f90 0x7f49d80735c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.049+0000 7f49de89b640 1 --2- 172.21.15.123:0/2464170486 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f49d8145ed0 0x7f49d80b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.049+0000 7f49de89b640 1 -- 172.21.15.123:0/2464170486 >> 172.21.15.123:0/2464170486 conn(0x7f49d80ccec0 msgr2=0x7f49d80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:40.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.049+0000 7f49de89b640 1 -- 172.21.15.123:0/2464170486 shutdown_connections 2024-09-15T23:12:40.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.049+0000 7f49de89b640 1 -- 172.21.15.123:0/2464170486 wait complete. 2024-09-15T23:12:40.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.050+0000 7f49de89b640 1 Processor -- start 2024-09-15T23:12:40.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.050+0000 7f49de89b640 1 -- start start 2024-09-15T23:12:40.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.051+0000 7f49de89b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49d8073180 0x7f49d80ce610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:40.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.051+0000 7f49de89b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f49d80b5f90 0x7f49d80cb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:40.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.051+0000 7f49de89b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f49d8145ed0 0x7f49d80cb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:40.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.051+0000 7f49de89b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f49d81462b0 con 0x7f49d8073180 2024-09-15T23:12:40.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.051+0000 7f49de89b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f49d80b4b60 con 0x7f49d80b5f90 2024-09-15T23:12:40.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.051+0000 7f49de89b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f49d8146430 con 0x7f49d8145ed0 2024-09-15T23:12:40.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.051+0000 7f49d7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49d8073180 0x7f49d80ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:40.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.051+0000 7f49d7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49d8073180 0x7f49d80ce610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46220/0 (socket says 172.21.15.123:46220) 2024-09-15T23:12:40.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.051+0000 7f49d7fff640 1 -- 172.21.15.123:0/1039145192 learned_addr learned my addr 172.21.15.123:0/1039145192 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:40.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.051+0000 7f49dce38640 1 --2- 172.21.15.123:0/1039145192 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f49d8145ed0 0x7f49d80cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:40.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.051+0000 7f49cffff640 1 --2- 172.21.15.123:0/1039145192 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f49d80b5f90 0x7f49d80cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:40.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.051+0000 7f49d7fff640 1 -- 172.21.15.123:0/1039145192 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f49d8145ed0 msgr2=0x7f49d80cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:40.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.051+0000 7f49d7fff640 1 --2- 172.21.15.123:0/1039145192 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f49d8145ed0 0x7f49d80cb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.051+0000 7f49d7fff640 1 -- 172.21.15.123:0/1039145192 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f49d80b5f90 msgr2=0x7f49d80cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:40.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.051+0000 7f49d7fff640 1 --2- 172.21.15.123:0/1039145192 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f49d80b5f90 0x7f49d80cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.051+0000 7f49d7fff640 1 -- 172.21.15.123:0/1039145192 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49d81f7770 con 0x7f49d8073180 2024-09-15T23:12:40.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.052+0000 7f49cffff640 1 --2- 172.21.15.123:0/1039145192 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f49d80b5f90 0x7f49d80cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:40.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.052+0000 7f49d7fff640 1 --2- 172.21.15.123:0/1039145192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49d8073180 0x7f49d80ce610 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f49c800c7f0 tx=0x7f49c800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:40.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.052+0000 7f49d57fa640 1 -- 172.21.15.123:0/1039145192 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c8015070 con 0x7f49d8073180 2024-09-15T23:12:40.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.052+0000 7f49d57fa640 1 -- 172.21.15.123:0/1039145192 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49c8007820 con 0x7f49d8073180 2024-09-15T23:12:40.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.052+0000 7f49d57fa640 1 -- 172.21.15.123:0/1039145192 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c8007bd0 con 0x7f49d8073180 2024-09-15T23:12:40.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.052+0000 7f49de89b640 1 -- 172.21.15.123:0/1039145192 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49d81f7a50 con 0x7f49d8073180 2024-09-15T23:12:40.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.052+0000 7f49de89b640 1 -- 172.21.15.123:0/1039145192 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49d81f8010 con 0x7f49d8073180 2024-09-15T23:12:40.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.053+0000 7f49de89b640 1 -- 172.21.15.123:0/1039145192 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49d80735c0 con 0x7f49d8073180 2024-09-15T23:12:40.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.053+0000 7f49d57fa640 1 -- 172.21.15.123:0/1039145192 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f49c8018070 con 0x7f49d8073180 2024-09-15T23:12:40.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.054+0000 7f49d57fa640 1 --2- 172.21.15.123:0/1039145192 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f49b806c2b0 0x7f49b806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:40.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.054+0000 7f49d57fa640 1 -- 172.21.15.123:0/1039145192 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f49c808b4e0 con 0x7f49d8073180 2024-09-15T23:12:40.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.054+0000 7f49cffff640 1 --2- 172.21.15.123:0/1039145192 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f49b806c2b0 0x7f49b806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:40.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.055+0000 7f49cffff640 1 --2- 172.21.15.123:0/1039145192 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f49b806c2b0 0x7f49b806e770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f49d81416f0 tx=0x7f49c0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:40.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.058+0000 7f49d57fa640 1 -- 172.21.15.123:0/1039145192 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f49c8059ce0 con 0x7f49d8073180 2024-09-15T23:12:40.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.259+0000 7f49de89b640 1 -- 172.21.15.123:0/1039145192 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f49d8141160 con 0x7f49d8073180 2024-09-15T23:12:40.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.259+0000 7f49d57fa640 1 -- 172.21.15.123:0/1039145192 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5226 (secure 0 0 0) 0x7f49c80595e0 con 0x7f49d8073180 2024-09-15T23:12:40.261 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:40.261 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":6,"btime":"2024-09-15T23:12:15:299077+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2663395388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2663395388},{"type":"v1","addr":"172.21.15.188:6837","nonce":2663395388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2375280105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2375280105},{"type":"v1","addr":"172.21.15.188:6836","nonce":2375280105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/477765723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":477765723},{"type":"v1","addr":"172.21.15.123:6834","nonce":477765723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:12:12.622666+0000","modified":"2024-09-15T23:12:14.622706+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/3721978283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":3721978283},{"type":"v1","addr":"172.21.15.123:6835","nonce":3721978283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-09-15T23:12:40.261 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 6 2024-09-15T23:12:40.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.261+0000 7f49de89b640 1 -- 172.21.15.123:0/1039145192 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f49b806c2b0 msgr2=0x7f49b806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:40.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.261+0000 7f49de89b640 1 --2- 172.21.15.123:0/1039145192 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f49b806c2b0 0x7f49b806e770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f49d81416f0 tx=0x7f49c0009040 comp rx=0 tx=0).stop 2024-09-15T23:12:40.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.261+0000 7f49de89b640 1 -- 172.21.15.123:0/1039145192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49d8073180 msgr2=0x7f49d80ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:40.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.261+0000 7f49de89b640 1 --2- 172.21.15.123:0/1039145192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49d8073180 0x7f49d80ce610 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f49c800c7f0 tx=0x7f49c800ccb0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.261+0000 7f49de89b640 1 -- 172.21.15.123:0/1039145192 shutdown_connections 2024-09-15T23:12:40.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.261+0000 7f49de89b640 1 --2- 172.21.15.123:0/1039145192 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f49d8145ed0 0x7f49d80cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.261+0000 7f49de89b640 1 --2- 172.21.15.123:0/1039145192 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f49d80b5f90 0x7f49d80cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.261+0000 7f49de89b640 1 --2- 172.21.15.123:0/1039145192 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f49b806c2b0 0x7f49b806e770 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.261+0000 7f49de89b640 1 --2- 172.21.15.123:0/1039145192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f49d8073180 0x7f49d80ce610 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.261+0000 7f49de89b640 1 -- 172.21.15.123:0/1039145192 >> 172.21.15.123:0/1039145192 conn(0x7f49d80ccec0 msgr2=0x7f49d8143970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:40.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.261+0000 7f49de89b640 1 -- 172.21.15.123:0/1039145192 shutdown_connections 2024-09-15T23:12:40.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.261+0000 7f49de89b640 1 -- 172.21.15.123:0/1039145192 wait complete. 2024-09-15T23:12:40.277 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:12:40.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.375+0000 7f8e9333a640 1 Processor -- start 2024-09-15T23:12:40.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.375+0000 7f8e9333a640 1 -- start start 2024-09-15T23:12:40.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.376+0000 7f8e9333a640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f8e8c06cd20 0x7f8e8c0b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:40.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.376+0000 7f8e9333a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8e8c070b80 0x7f8e8c0b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:40.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.376+0000 7f8e9333a640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e8c15eab0 con 0x7f8e8c15e6d0 2024-09-15T23:12:40.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.376+0000 7f8e9333a640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f8e8c0b77e0 con 0x7f8e8c070b80 2024-09-15T23:12:40.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.376+0000 7f8e9333a640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f8e8c15ed70 con 0x7f8e8c06cd20 2024-09-15T23:12:40.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.376+0000 7f8e918d7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8e8c070b80 0x7f8e8c0b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:40.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.376+0000 7f8e910d6640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8e8c15e6d0 0x7f8e8c071390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53602/0 (socket says 172.21.15.123:53602) 2024-09-15T23:12:40.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.376+0000 7f8e910d6640 1 -- 172.21.15.123:0/1240273588 learned_addr learned my addr 172.21.15.123:0/1240273588 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:40.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.376+0000 7f8e908d5640 1 --2- 172.21.15.123:0/1240273588 >> v2:172.21.15.188:3300/0 conn(0x7f8e8c06cd20 0x7f8e8c0b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:40.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.376+0000 7f8e918d7640 1 -- 172.21.15.123:0/1240273588 >> v2:172.21.15.188:3300/0 conn(0x7f8e8c06cd20 msgr2=0x7f8e8c0b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:40.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.376+0000 7f8e918d7640 1 --2- 172.21.15.123:0/1240273588 >> v2:172.21.15.188:3300/0 conn(0x7f8e8c06cd20 0x7f8e8c0b6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.376+0000 7f8e918d7640 1 -- 172.21.15.123:0/1240273588 >> v1:172.21.15.123:6789/0 conn(0x7f8e8c15e6d0 legacy=0x7f8e8c071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:40.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.376+0000 7f8e918d7640 1 -- 172.21.15.123:0/1240273588 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e8c15f050 con 0x7f8e8c070b80 2024-09-15T23:12:40.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.377+0000 7f8e918d7640 1 --2- 172.21.15.123:0/1240273588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e8c070b80 0x7f8e8c0b72a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c072f80 tx=0x7f8e8402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4262dda7c802139c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:40.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.377+0000 7f8e83fff640 1 -- 172.21.15.123:0/1240273588 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e84007740 con 0x7f8e8c070b80 2024-09-15T23:12:40.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.377+0000 7f8e83fff640 1 -- 172.21.15.123:0/1240273588 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e840078e0 con 0x7f8e8c070b80 2024-09-15T23:12:40.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.377+0000 7f8e83fff640 1 -- 172.21.15.123:0/1240273588 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e84007cb0 con 0x7f8e8c070b80 2024-09-15T23:12:40.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.378+0000 7f8e9333a640 1 -- 172.21.15.123:0/1240273588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e8c070b80 msgr2=0x7f8e8c0b72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:40.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.378+0000 7f8e9333a640 1 --2- 172.21.15.123:0/1240273588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e8c070b80 0x7f8e8c0b72a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c072f80 tx=0x7f8e8402a680 comp rx=0 tx=0).stop 2024-09-15T23:12:40.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.378+0000 7f8e9333a640 1 -- 172.21.15.123:0/1240273588 shutdown_connections 2024-09-15T23:12:40.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.378+0000 7f8e9333a640 1 --2- 172.21.15.123:0/1240273588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e8c070b80 0x7f8e8c0b72a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.378+0000 7f8e9333a640 1 --2- 172.21.15.123:0/1240273588 >> v2:172.21.15.188:3300/0 conn(0x7f8e8c06cd20 0x7f8e8c0b6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.378+0000 7f8e9333a640 1 -- 172.21.15.123:0/1240273588 >> 172.21.15.123:0/1240273588 conn(0x7f8e8c067fb0 msgr2=0x7f8e8c06f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:40.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.378+0000 7f8e9333a640 1 -- 172.21.15.123:0/1240273588 shutdown_connections 2024-09-15T23:12:40.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.378+0000 7f8e9333a640 1 -- 172.21.15.123:0/1240273588 wait complete. 2024-09-15T23:12:40.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.379+0000 7f8e9333a640 1 Processor -- start 2024-09-15T23:12:40.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.379+0000 7f8e9333a640 1 -- start start 2024-09-15T23:12:40.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.380+0000 7f8e9333a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e8c06cd20 0x7f8e8c0b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:40.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.380+0000 7f8e9333a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8e8c070b80 0x7f8e8c145b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:40.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.380+0000 7f8e9333a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e8c15e6d0 0x7f8e8c152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:40.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.380+0000 7f8e9333a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8c15f8f0 con 0x7f8e8c06cd20 2024-09-15T23:12:40.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.380+0000 7f8e9333a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8c15f610 con 0x7f8e8c15e6d0 2024-09-15T23:12:40.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.380+0000 7f8e9333a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8e8c1622a0 con 0x7f8e8c070b80 2024-09-15T23:12:40.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.380+0000 7f8e910d6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e8c06cd20 0x7f8e8c0b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:40.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.380+0000 7f8e910d6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e8c06cd20 0x7f8e8c0b38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46232/0 (socket says 172.21.15.123:46232) 2024-09-15T23:12:40.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.380+0000 7f8e910d6640 1 -- 172.21.15.123:0/1726392029 learned_addr learned my addr 172.21.15.123:0/1726392029 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:40.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.380+0000 7f8e908d5640 1 --2- 172.21.15.123:0/1726392029 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8e8c070b80 0x7f8e8c145b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:40.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.380+0000 7f8e918d7640 1 --2- 172.21.15.123:0/1726392029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e8c15e6d0 0x7f8e8c152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:40.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.380+0000 7f8e910d6640 1 -- 172.21.15.123:0/1726392029 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8e8c070b80 msgr2=0x7f8e8c145b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:40.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.380+0000 7f8e910d6640 1 --2- 172.21.15.123:0/1726392029 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8e8c070b80 0x7f8e8c145b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.380+0000 7f8e910d6640 1 -- 172.21.15.123:0/1726392029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e8c15e6d0 msgr2=0x7f8e8c152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:40.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.380+0000 7f8e910d6640 1 --2- 172.21.15.123:0/1726392029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e8c15e6d0 0x7f8e8c152e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.380+0000 7f8e910d6640 1 -- 172.21.15.123:0/1726392029 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e8c0b2cd0 con 0x7f8e8c06cd20 2024-09-15T23:12:40.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.381+0000 7f8e918d7640 1 --2- 172.21.15.123:0/1726392029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e8c15e6d0 0x7f8e8c152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:40.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.381+0000 7f8e910d6640 1 --2- 172.21.15.123:0/1726392029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e8c06cd20 0x7f8e8c0b38f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8e8800c3c0 tx=0x7f8e8800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:40.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.381+0000 7f8e81ffb640 1 -- 172.21.15.123:0/1726392029 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e88017070 con 0x7f8e8c06cd20 2024-09-15T23:12:40.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.381+0000 7f8e81ffb640 1 -- 172.21.15.123:0/1726392029 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e88005ce0 con 0x7f8e8c06cd20 2024-09-15T23:12:40.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.381+0000 7f8e9333a640 1 -- 172.21.15.123:0/1726392029 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e8c15a170 con 0x7f8e8c06cd20 2024-09-15T23:12:40.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.381+0000 7f8e81ffb640 1 -- 172.21.15.123:0/1726392029 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e880072f0 con 0x7f8e8c06cd20 2024-09-15T23:12:40.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.381+0000 7f8e9333a640 1 -- 172.21.15.123:0/1726392029 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e8c146040 con 0x7f8e8c06cd20 2024-09-15T23:12:40.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.382+0000 7f8e9333a640 1 -- 172.21.15.123:0/1726392029 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e8c071390 con 0x7f8e8c06cd20 2024-09-15T23:12:40.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.382+0000 7f8e81ffb640 1 -- 172.21.15.123:0/1726392029 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8e8801a070 con 0x7f8e8c06cd20 2024-09-15T23:12:40.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.383+0000 7f8e81ffb640 1 --2- 172.21.15.123:0/1726392029 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8e7006c2b0 0x7f8e7006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:40.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.383+0000 7f8e81ffb640 1 -- 172.21.15.123:0/1726392029 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8e8808a6e0 con 0x7f8e8c06cd20 2024-09-15T23:12:40.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.383+0000 7f8e908d5640 1 --2- 172.21.15.123:0/1726392029 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8e7006c2b0 0x7f8e7006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:40.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.383+0000 7f8e908d5640 1 --2- 172.21.15.123:0/1726392029 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8e7006c2b0 0x7f8e7006e770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c158540 tx=0x7f8e7c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:40.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.388+0000 7f8e81ffb640 1 -- 172.21.15.123:0/1726392029 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8e88058800 con 0x7f8e8c06cd20 2024-09-15T23:12:40.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.590+0000 7f8e9333a640 1 -- 172.21.15.123:0/1726392029 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e8c0707c0 con 0x7f8e8c06cd20 2024-09-15T23:12:40.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.590+0000 7f8e81ffb640 1 -- 172.21.15.123:0/1726392029 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5226 (secure 0 0 0) 0x7f8e8805cb00 con 0x7f8e8c06cd20 2024-09-15T23:12:40.591 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:40.592 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":6,"btime":"2024-09-15T23:12:15:299077+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2663395388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2663395388},{"type":"v1","addr":"172.21.15.188:6837","nonce":2663395388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2375280105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2375280105},{"type":"v1","addr":"172.21.15.188:6836","nonce":2375280105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/477765723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":477765723},{"type":"v1","addr":"172.21.15.123:6834","nonce":477765723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:12:12.622666+0000","modified":"2024-09-15T23:12:14.622706+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/3721978283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":3721978283},{"type":"v1","addr":"172.21.15.123:6835","nonce":3721978283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-09-15T23:12:40.592 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 6 2024-09-15T23:12:40.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.592+0000 7f8e9333a640 1 -- 172.21.15.123:0/1726392029 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8e7006c2b0 msgr2=0x7f8e7006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:40.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.592+0000 7f8e9333a640 1 --2- 172.21.15.123:0/1726392029 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8e7006c2b0 0x7f8e7006e770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c158540 tx=0x7f8e7c008040 comp rx=0 tx=0).stop 2024-09-15T23:12:40.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.592+0000 7f8e9333a640 1 -- 172.21.15.123:0/1726392029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e8c06cd20 msgr2=0x7f8e8c0b38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:40.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.592+0000 7f8e9333a640 1 --2- 172.21.15.123:0/1726392029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e8c06cd20 0x7f8e8c0b38f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8e8800c3c0 tx=0x7f8e8800c880 comp rx=0 tx=0).stop 2024-09-15T23:12:40.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.592+0000 7f8e9333a640 1 -- 172.21.15.123:0/1726392029 shutdown_connections 2024-09-15T23:12:40.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.592+0000 7f8e9333a640 1 --2- 172.21.15.123:0/1726392029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e8c15e6d0 0x7f8e8c152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.592+0000 7f8e9333a640 1 --2- 172.21.15.123:0/1726392029 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8e8c070b80 0x7f8e8c145b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.592+0000 7f8e9333a640 1 --2- 172.21.15.123:0/1726392029 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8e7006c2b0 0x7f8e7006e770 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.592+0000 7f8e9333a640 1 --2- 172.21.15.123:0/1726392029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e8c06cd20 0x7f8e8c0b38f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.592+0000 7f8e9333a640 1 -- 172.21.15.123:0/1726392029 >> 172.21.15.123:0/1726392029 conn(0x7f8e8c067fb0 msgr2=0x7f8e8c160580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:40.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.592+0000 7f8e9333a640 1 -- 172.21.15.123:0/1726392029 shutdown_connections 2024-09-15T23:12:40.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.592+0000 7f8e9333a640 1 -- 172.21.15.123:0/1726392029 wait complete. 2024-09-15T23:12:40.604 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:12:40.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.702+0000 7f985c053640 1 Processor -- start 2024-09-15T23:12:40.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.702+0000 7f985c053640 1 -- start start 2024-09-15T23:12:40.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.703+0000 7f985c053640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f985415ab40 0x7f985406c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:40.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.703+0000 7f985c053640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f98540720b0 0x7f9854073990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:40.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.703+0000 7f985c053640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98540724f0 con 0x7f985415af20 2024-09-15T23:12:40.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.703+0000 7f985c053640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f9854071010 con 0x7f98540720b0 2024-09-15T23:12:40.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.703+0000 7f985c053640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f98540712f0 con 0x7f985415ab40 2024-09-15T23:12:40.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.703+0000 7f9859def640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f985415ab40 0x7f985406c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:40.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.703+0000 7f98595ee640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f98540720b0 0x7f9854073990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:40.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.703+0000 7f985a5f0640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f985415af20 0x7f985415b370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:58736/0 (socket says 172.21.15.123:58736) 2024-09-15T23:12:40.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.703+0000 7f985a5f0640 1 -- 172.21.15.123:0/2834016541 learned_addr learned my addr 172.21.15.123:0/2834016541 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:40.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.703+0000 7f9858ded640 1 -- 172.21.15.123:0/2834016541 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 685717026 0 0) 0x7f98540724f0 con 0x7f985415af20 2024-09-15T23:12:40.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.703+0000 7f9858ded640 1 -- 172.21.15.123:0/2834016541 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9840004630 con 0x7f985415af20 2024-09-15T23:12:40.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.704+0000 7f9859def640 1 -- 172.21.15.123:0/2834016541 >> v2:172.21.15.188:3300/0 conn(0x7f98540720b0 msgr2=0x7f9854073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:40.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.704+0000 7f9859def640 1 --2- 172.21.15.123:0/2834016541 >> v2:172.21.15.188:3300/0 conn(0x7f98540720b0 0x7f9854073990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.704+0000 7f9859def640 1 -- 172.21.15.123:0/2834016541 >> v1:172.21.15.188:6789/0 conn(0x7f985415af20 legacy=0x7f985415b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:40.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.704+0000 7f9859def640 1 -- 172.21.15.123:0/2834016541 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98540715d0 con 0x7f985415ab40 2024-09-15T23:12:40.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.704+0000 7f98595ee640 1 --2- 172.21.15.123:0/2834016541 >> v2:172.21.15.188:3300/0 conn(0x7f98540720b0 0x7f9854073990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:12:40.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.704+0000 7f9859def640 1 --2- 172.21.15.123:0/2834016541 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f985415ab40 0x7f985406c6a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f98500097a0 tx=0x7f985002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acf1fc64d21d62c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:40.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.704+0000 7f9858ded640 1 -- 172.21.15.123:0/2834016541 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9850037070 con 0x7f985415ab40 2024-09-15T23:12:40.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.704+0000 7f9858ded640 1 -- 172.21.15.123:0/2834016541 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f985002ae50 con 0x7f985415ab40 2024-09-15T23:12:40.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.704+0000 7f9858ded640 1 -- 172.21.15.123:0/2834016541 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9850032640 con 0x7f985415ab40 2024-09-15T23:12:40.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.705+0000 7f985c053640 1 -- 172.21.15.123:0/2834016541 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f985415ab40 msgr2=0x7f985406c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:40.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.705+0000 7f985c053640 1 --2- 172.21.15.123:0/2834016541 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f985415ab40 0x7f985406c6a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f98500097a0 tx=0x7f985002a100 comp rx=0 tx=0).stop 2024-09-15T23:12:40.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.705+0000 7f985c053640 1 -- 172.21.15.123:0/2834016541 shutdown_connections 2024-09-15T23:12:40.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.705+0000 7f985c053640 1 --2- 172.21.15.123:0/2834016541 >> v2:172.21.15.188:3300/0 conn(0x7f98540720b0 0x7f9854073990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.705+0000 7f985c053640 1 --2- 172.21.15.123:0/2834016541 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f985415ab40 0x7f985406c6a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.705+0000 7f985c053640 1 -- 172.21.15.123:0/2834016541 >> 172.21.15.123:0/2834016541 conn(0x7f98540ccec0 msgr2=0x7f98540cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:40.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.705+0000 7f985c053640 1 -- 172.21.15.123:0/2834016541 shutdown_connections 2024-09-15T23:12:40.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.705+0000 7f985c053640 1 -- 172.21.15.123:0/2834016541 wait complete. 2024-09-15T23:12:40.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.706+0000 7f985c053640 1 Processor -- start 2024-09-15T23:12:40.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.706+0000 7f985c053640 1 -- start start 2024-09-15T23:12:40.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.707+0000 7f985c053640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f98540720b0 0x7f98540aeb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:40.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.707+0000 7f985c053640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f985415ab40 0x7f98540b0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:40.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.707+0000 7f985c053640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f985415af20 0x7f98541584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:40.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.707+0000 7f985c053640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9854073ed0 con 0x7f985415ab40 2024-09-15T23:12:40.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.707+0000 7f985c053640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f985415ba80 con 0x7f98540720b0 2024-09-15T23:12:40.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.707+0000 7f985c053640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f985406bc10 con 0x7f985415af20 2024-09-15T23:12:40.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.707+0000 7f98595ee640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f985415ab40 0x7f98540b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:40.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.707+0000 7f9859def640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f98540720b0 0x7f98540aeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:40.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.707+0000 7f98595ee640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f985415ab40 0x7f98540b0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46234/0 (socket says 172.21.15.123:46234) 2024-09-15T23:12:40.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.707+0000 7f98595ee640 1 -- 172.21.15.123:0/2698742808 learned_addr learned my addr 172.21.15.123:0/2698742808 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:40.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.707+0000 7f985a5f0640 1 --2- 172.21.15.123:0/2698742808 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f985415af20 0x7f98541584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:40.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.707+0000 7f98595ee640 1 -- 172.21.15.123:0/2698742808 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f985415af20 msgr2=0x7f98541584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:40.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.707+0000 7f98595ee640 1 --2- 172.21.15.123:0/2698742808 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f985415af20 0x7f98541584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.707+0000 7f98595ee640 1 -- 172.21.15.123:0/2698742808 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f98540720b0 msgr2=0x7f98540aeb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:40.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.707+0000 7f98595ee640 1 --2- 172.21.15.123:0/2698742808 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f98540720b0 0x7f98540aeb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.707+0000 7f98595ee640 1 -- 172.21.15.123:0/2698742808 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98540b0cf0 con 0x7f985415ab40 2024-09-15T23:12:40.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.708+0000 7f98595ee640 1 --2- 172.21.15.123:0/2698742808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f985415ab40 0x7f98540b0480 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f984400ebe0 tx=0x7f984400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:40.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.708+0000 7f984a7fc640 1 -- 172.21.15.123:0/2698742808 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9844017070 con 0x7f985415ab40 2024-09-15T23:12:40.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.708+0000 7f984a7fc640 1 -- 172.21.15.123:0/2698742808 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f984400cc30 con 0x7f985415ab40 2024-09-15T23:12:40.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.708+0000 7f985c053640 1 -- 172.21.15.123:0/2698742808 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98540b0fd0 con 0x7f985415ab40 2024-09-15T23:12:40.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.708+0000 7f984a7fc640 1 -- 172.21.15.123:0/2698742808 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9844013470 con 0x7f985415ab40 2024-09-15T23:12:40.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.708+0000 7f985c053640 1 -- 172.21.15.123:0/2698742808 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98540b1590 con 0x7f985415ab40 2024-09-15T23:12:40.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.709+0000 7f985c053640 1 -- 172.21.15.123:0/2698742808 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f985406bff0 con 0x7f985415ab40 2024-09-15T23:12:40.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.709+0000 7f984a7fc640 1 -- 172.21.15.123:0/2698742808 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f984401a070 con 0x7f985415ab40 2024-09-15T23:12:40.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.710+0000 7f984a7fc640 1 --2- 172.21.15.123:0/2698742808 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f983806c2b0 0x7f983806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:40.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.710+0000 7f984a7fc640 1 -- 172.21.15.123:0/2698742808 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f984408b610 con 0x7f985415ab40 2024-09-15T23:12:40.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.710+0000 7f9859def640 1 --2- 172.21.15.123:0/2698742808 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f983806c2b0 0x7f983806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:40.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.710+0000 7f9859def640 1 --2- 172.21.15.123:0/2698742808 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f983806c2b0 0x7f983806e770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9850034000 tx=0x7f985002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:40.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.714+0000 7f984a7fc640 1 -- 172.21.15.123:0/2698742808 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f98440597c0 con 0x7f985415ab40 2024-09-15T23:12:40.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.880+0000 7f985c053640 1 -- 172.21.15.123:0/2698742808 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f98540b09c0 con 0x7f985415ab40 2024-09-15T23:12:40.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.881+0000 7f984a7fc640 1 -- 172.21.15.123:0/2698742808 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16693 (secure 0 0 0) 0x7f984405dac0 con 0x7f985415ab40 2024-09-15T23:12:40.882 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:40.882 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":22,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:12:14.277829+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:12:10.289254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:12:11.594152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:12:40.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.883+0000 7f985c053640 1 -- 172.21.15.123:0/2698742808 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f983806c2b0 msgr2=0x7f983806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:40.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.883+0000 7f985c053640 1 --2- 172.21.15.123:0/2698742808 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f983806c2b0 0x7f983806e770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9850034000 tx=0x7f985002e000 comp rx=0 tx=0).stop 2024-09-15T23:12:40.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.883+0000 7f985c053640 1 -- 172.21.15.123:0/2698742808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f985415ab40 msgr2=0x7f98540b0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:40.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.883+0000 7f985c053640 1 --2- 172.21.15.123:0/2698742808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f985415ab40 0x7f98540b0480 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f984400ebe0 tx=0x7f984400c520 comp rx=0 tx=0).stop 2024-09-15T23:12:40.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.883+0000 7f985c053640 1 -- 172.21.15.123:0/2698742808 shutdown_connections 2024-09-15T23:12:40.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.883+0000 7f985c053640 1 --2- 172.21.15.123:0/2698742808 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f985415af20 0x7f98541584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.883+0000 7f985c053640 1 --2- 172.21.15.123:0/2698742808 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f983806c2b0 0x7f983806e770 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.883+0000 7f985c053640 1 --2- 172.21.15.123:0/2698742808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f985415ab40 0x7f98540b0480 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.883+0000 7f985c053640 1 --2- 172.21.15.123:0/2698742808 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f98540720b0 0x7f98540aeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.883+0000 7f985c053640 1 -- 172.21.15.123:0/2698742808 >> 172.21.15.123:0/2698742808 conn(0x7f98540ccec0 msgr2=0x7f985406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:40.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.883+0000 7f985c053640 1 -- 172.21.15.123:0/2698742808 shutdown_connections 2024-09-15T23:12:40.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.883+0000 7f985c053640 1 -- 172.21.15.123:0/2698742808 wait complete. 2024-09-15T23:12:40.895 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T23:12:40.896 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:12:40.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.992+0000 7fd6f5ca4640 1 Processor -- start 2024-09-15T23:12:40.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.992+0000 7fd6f5ca4640 1 -- start start 2024-09-15T23:12:40.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.993+0000 7fd6f5ca4640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd6f015e790 0x7fd6f0073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:40.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.993+0000 7fd6f5ca4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6f0162c60 0x7fd6f00b5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:40.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.993+0000 7fd6f5ca4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd6f00b5970 0x7fd6f006f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:40.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.993+0000 7fd6f5ca4640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fd6f015eb70 con 0x7fd6f00b5970 2024-09-15T23:12:40.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.993+0000 7fd6f5ca4640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fd6f01631c0 con 0x7fd6f015e790 2024-09-15T23:12:40.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.993+0000 7fd6f5ca4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd6f00ae9a0 con 0x7fd6f0162c60 2024-09-15T23:12:40.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.993+0000 7fd6effff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd6f00b5970 0x7fd6f006f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:40.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.993+0000 7fd6effff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd6f00b5970 0x7fd6f006f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46242/0 (socket says 172.21.15.123:46242) 2024-09-15T23:12:40.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.993+0000 7fd6effff640 1 -- 172.21.15.123:0/2408008690 learned_addr learned my addr 172.21.15.123:0/2408008690 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:40.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.993+0000 7fd6ef7fe640 1 --2- 172.21.15.123:0/2408008690 >> v2:172.21.15.188:3300/0 conn(0x7fd6f015e790 0x7fd6f0073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:40.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.993+0000 7fd6eeffd640 1 --2- 172.21.15.123:0/2408008690 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6f0162c60 0x7fd6f00b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:40.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.993+0000 7fd6effff640 1 -- 172.21.15.123:0/2408008690 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6f0162c60 msgr2=0x7fd6f00b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:40.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.993+0000 7fd6effff640 1 --2- 172.21.15.123:0/2408008690 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6f0162c60 0x7fd6f00b5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.993+0000 7fd6effff640 1 -- 172.21.15.123:0/2408008690 >> v2:172.21.15.188:3300/0 conn(0x7fd6f015e790 msgr2=0x7fd6f0073a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:40.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.993+0000 7fd6effff640 1 --2- 172.21.15.123:0/2408008690 >> v2:172.21.15.188:3300/0 conn(0x7fd6f015e790 0x7fd6f0073a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:40.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.993+0000 7fd6effff640 1 -- 172.21.15.123:0/2408008690 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f00aec40 con 0x7fd6f00b5970 2024-09-15T23:12:40.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.993+0000 7fd6ef7fe640 1 --2- 172.21.15.123:0/2408008690 >> v2:172.21.15.188:3300/0 conn(0x7fd6f015e790 0x7fd6f0073a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:40.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.994+0000 7fd6effff640 1 --2- 172.21.15.123:0/2408008690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6f00b5970 0x7fd6f006f730 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd6f00b27d0 tx=0x7fd6e802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16fa9530dec78c63 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:40.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.994+0000 7fd6ee7fc640 1 -- 172.21.15.123:0/2408008690 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8036070 con 0x7fd6f00b5970 2024-09-15T23:12:40.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.994+0000 7fd6ee7fc640 1 -- 172.21.15.123:0/2408008690 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6e8031600 con 0x7fd6f00b5970 2024-09-15T23:12:40.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.994+0000 7fd6ee7fc640 1 -- 172.21.15.123:0/2408008690 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e80319d0 con 0x7fd6f00b5970 2024-09-15T23:12:40.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.995+0000 7fd6f5ca4640 1 -- 172.21.15.123:0/2408008690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6f00b5970 msgr2=0x7fd6f006f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:41.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.995+0000 7fd6f5ca4640 1 --2- 172.21.15.123:0/2408008690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6f00b5970 0x7fd6f006f730 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd6f00b27d0 tx=0x7fd6e802a610 comp rx=0 tx=0).stop 2024-09-15T23:12:41.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.995+0000 7fd6f5ca4640 1 -- 172.21.15.123:0/2408008690 shutdown_connections 2024-09-15T23:12:41.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.995+0000 7fd6f5ca4640 1 --2- 172.21.15.123:0/2408008690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6f00b5970 0x7fd6f006f730 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:41.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.995+0000 7fd6f5ca4640 1 --2- 172.21.15.123:0/2408008690 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6f0162c60 0x7fd6f00b5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:41.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.995+0000 7fd6f5ca4640 1 --2- 172.21.15.123:0/2408008690 >> v2:172.21.15.188:3300/0 conn(0x7fd6f015e790 0x7fd6f0073a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:41.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.995+0000 7fd6f5ca4640 1 -- 172.21.15.123:0/2408008690 >> 172.21.15.123:0/2408008690 conn(0x7fd6f00b0a80 msgr2=0x7fd6f00b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:41.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.995+0000 7fd6f5ca4640 1 -- 172.21.15.123:0/2408008690 shutdown_connections 2024-09-15T23:12:41.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.995+0000 7fd6f5ca4640 1 -- 172.21.15.123:0/2408008690 wait complete. 2024-09-15T23:12:41.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.996+0000 7fd6f5ca4640 1 Processor -- start 2024-09-15T23:12:41.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.996+0000 7fd6f5ca4640 1 -- start start 2024-09-15T23:12:41.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.997+0000 7fd6f5ca4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6f00b5970 0x7fd6f01617d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:41.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.997+0000 7fd6f5ca4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6f015e790 0x7fd6f014ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:41.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.997+0000 7fd6f5ca4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6f0162c60 0x7fd6f0160260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:41.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.997+0000 7fd6f5ca4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f006f430 con 0x7fd6f0162c60 2024-09-15T23:12:41.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.997+0000 7fd6f5ca4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f00af200 con 0x7fd6f00b5970 2024-09-15T23:12:41.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.997+0000 7fd6f5ca4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd6f006fc70 con 0x7fd6f015e790 2024-09-15T23:12:41.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.997+0000 7fd6effff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6f0162c60 0x7fd6f0160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:41.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.997+0000 7fd6effff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6f0162c60 0x7fd6f0160260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46256/0 (socket says 172.21.15.123:46256) 2024-09-15T23:12:41.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.997+0000 7fd6effff640 1 -- 172.21.15.123:0/1073391072 learned_addr learned my addr 172.21.15.123:0/1073391072 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:41.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.997+0000 7fd6ef7fe640 1 --2- 172.21.15.123:0/1073391072 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6f00b5970 0x7fd6f01617d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:41.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.997+0000 7fd6eeffd640 1 --2- 172.21.15.123:0/1073391072 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6f015e790 0x7fd6f014ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:41.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.997+0000 7fd6effff640 1 -- 172.21.15.123:0/1073391072 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6f015e790 msgr2=0x7fd6f014ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:41.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.997+0000 7fd6effff640 1 --2- 172.21.15.123:0/1073391072 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6f015e790 0x7fd6f014ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:41.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.997+0000 7fd6effff640 1 -- 172.21.15.123:0/1073391072 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6f00b5970 msgr2=0x7fd6f01617d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:41.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.997+0000 7fd6effff640 1 --2- 172.21.15.123:0/1073391072 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6f00b5970 0x7fd6f01617d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:41.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.997+0000 7fd6effff640 1 -- 172.21.15.123:0/1073391072 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f015b8b0 con 0x7fd6f0162c60 2024-09-15T23:12:41.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.998+0000 7fd6effff640 1 --2- 172.21.15.123:0/1073391072 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6f0162c60 0x7fd6f0160260 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8009f40 tx=0x7fd6e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:41.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.998+0000 7fd6d7fff640 1 -- 172.21.15.123:0/1073391072 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8041020 con 0x7fd6f0162c60 2024-09-15T23:12:41.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.998+0000 7fd6d7fff640 1 -- 172.21.15.123:0/1073391072 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6e8007780 con 0x7fd6f0162c60 2024-09-15T23:12:41.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.998+0000 7fd6f5ca4640 1 -- 172.21.15.123:0/1073391072 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6f015d2a0 con 0x7fd6f0162c60 2024-09-15T23:12:41.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.998+0000 7fd6d7fff640 1 -- 172.21.15.123:0/1073391072 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8036040 con 0x7fd6f0162c60 2024-09-15T23:12:41.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.998+0000 7fd6f5ca4640 1 -- 172.21.15.123:0/1073391072 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6f014f1b0 con 0x7fd6f0162c60 2024-09-15T23:12:41.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.999+0000 7fd6f5ca4640 1 -- 172.21.15.123:0/1073391072 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6f015dd60 con 0x7fd6f0162c60 2024-09-15T23:12:41.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:40.999+0000 7fd6d7fff640 1 -- 172.21.15.123:0/1073391072 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd6e8044020 con 0x7fd6f0162c60 2024-09-15T23:12:41.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.000+0000 7fd6d7fff640 1 --2- 172.21.15.123:0/1073391072 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd6dc06c2b0 0x7fd6dc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:41.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.000+0000 7fd6d7fff640 1 -- 172.21.15.123:0/1073391072 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd6e80ac010 con 0x7fd6f0162c60 2024-09-15T23:12:41.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.000+0000 7fd6ef7fe640 1 --2- 172.21.15.123:0/1073391072 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd6dc06c2b0 0x7fd6dc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:41.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.000+0000 7fd6ef7fe640 1 --2- 172.21.15.123:0/1073391072 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd6dc06c2b0 0x7fd6dc06e770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0006b10 tx=0x7fd6e0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:41.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.004+0000 7fd6d7fff640 1 -- 172.21.15.123:0/1073391072 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd6f015dd60 con 0x7fd6f0162c60 2024-09-15T23:12:41.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.203+0000 7fd6f5ca4640 1 -- 172.21.15.123:0/1073391072 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6f015d0a0 con 0x7fd6f0162c60 2024-09-15T23:12:41.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.203+0000 7fd6d7fff640 1 -- 172.21.15.123:0/1073391072 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5226 (secure 0 0 0) 0x7fd6e804b030 con 0x7fd6f0162c60 2024-09-15T23:12:41.205 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:41.205 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":6,"btime":"2024-09-15T23:12:15:299077+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2663395388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2663395388},{"type":"v1","addr":"172.21.15.188:6837","nonce":2663395388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2375280105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2375280105},{"type":"v1","addr":"172.21.15.188:6836","nonce":2375280105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/477765723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":477765723},{"type":"v1","addr":"172.21.15.123:6834","nonce":477765723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:12:12.622666+0000","modified":"2024-09-15T23:12:14.622706+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/3721978283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":3721978283},{"type":"v1","addr":"172.21.15.123:6835","nonce":3721978283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-09-15T23:12:41.205 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 6 2024-09-15T23:12:41.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.205+0000 7fd6f5ca4640 1 -- 172.21.15.123:0/1073391072 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd6dc06c2b0 msgr2=0x7fd6dc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:41.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.205+0000 7fd6f5ca4640 1 --2- 172.21.15.123:0/1073391072 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd6dc06c2b0 0x7fd6dc06e770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0006b10 tx=0x7fd6e0008040 comp rx=0 tx=0).stop 2024-09-15T23:12:41.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.205+0000 7fd6f5ca4640 1 -- 172.21.15.123:0/1073391072 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6f0162c60 msgr2=0x7fd6f0160260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:41.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.205+0000 7fd6f5ca4640 1 --2- 172.21.15.123:0/1073391072 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6f0162c60 0x7fd6f0160260 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8009f40 tx=0x7fd6e8004a40 comp rx=0 tx=0).stop 2024-09-15T23:12:41.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.205+0000 7fd6f5ca4640 1 -- 172.21.15.123:0/1073391072 shutdown_connections 2024-09-15T23:12:41.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.205+0000 7fd6f5ca4640 1 --2- 172.21.15.123:0/1073391072 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd6dc06c2b0 0x7fd6dc06e770 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:41.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.205+0000 7fd6f5ca4640 1 --2- 172.21.15.123:0/1073391072 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6f0162c60 0x7fd6f0160260 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:41.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.205+0000 7fd6f5ca4640 1 --2- 172.21.15.123:0/1073391072 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6f015e790 0x7fd6f014ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:41.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.205+0000 7fd6f5ca4640 1 --2- 172.21.15.123:0/1073391072 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6f00b5970 0x7fd6f01617d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:41.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.205+0000 7fd6f5ca4640 1 -- 172.21.15.123:0/1073391072 >> 172.21.15.123:0/1073391072 conn(0x7fd6f00b0a80 msgr2=0x7fd6f00af720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:41.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.205+0000 7fd6f5ca4640 1 -- 172.21.15.123:0/1073391072 shutdown_connections 2024-09-15T23:12:41.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.205+0000 7fd6f5ca4640 1 -- 172.21.15.123:0/1073391072 wait complete. 2024-09-15T23:12:41.217 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:12:41.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.315+0000 7f9839ced640 1 Processor -- start 2024-09-15T23:12:41.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.315+0000 7f9839ced640 1 -- start start 2024-09-15T23:12:41.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.315+0000 7f9839ced640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f98341461a0 0x7f983415d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:41.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.315+0000 7f9839ced640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f98340720c0 0x7f983406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:41.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.315+0000 7f9839ced640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f983406c150 0x7f98340b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:41.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.315+0000 7f9839ced640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f983415ddc0 con 0x7f98341461a0 2024-09-15T23:12:41.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.315+0000 7f9839ced640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f9834146580 con 0x7f98340720c0 2024-09-15T23:12:41.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.315+0000 7f9839ced640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f983406c580 con 0x7f983406c150 2024-09-15T23:12:41.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.316+0000 7f98337fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f98341461a0 0x7f983415d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:41.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.316+0000 7f98337fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f98341461a0 0x7f983415d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46270/0 (socket says 172.21.15.123:46270) 2024-09-15T23:12:41.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.316+0000 7f98337fe640 1 -- 172.21.15.123:0/309877733 learned_addr learned my addr 172.21.15.123:0/309877733 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:41.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.316+0000 7f98337fe640 1 -- 172.21.15.123:0/309877733 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f983406c150 msgr2=0x7f98340b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:41.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.316+0000 7f9832ffd640 1 --2- 172.21.15.123:0/309877733 >> v2:172.21.15.188:3300/0 conn(0x7f98340720c0 0x7f983406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:41.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.316+0000 7f9833fff640 1 --2- 172.21.15.123:0/309877733 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f983406c150 0x7f98340b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:41.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.316+0000 7f98337fe640 1 --2- 172.21.15.123:0/309877733 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f983406c150 0x7f98340b67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:41.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.316+0000 7f98337fe640 1 -- 172.21.15.123:0/309877733 >> v2:172.21.15.188:3300/0 conn(0x7f98340720c0 msgr2=0x7f983406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:41.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.316+0000 7f98337fe640 1 --2- 172.21.15.123:0/309877733 >> v2:172.21.15.188:3300/0 conn(0x7f98340720c0 0x7f983406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:41.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.316+0000 7f98337fe640 1 -- 172.21.15.123:0/309877733 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98340728d0 con 0x7f98341461a0 2024-09-15T23:12:41.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.317+0000 7f98337fe640 1 --2- 172.21.15.123:0/309877733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98341461a0 0x7f983415d840 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9834071f30 tx=0x7f982402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c5d13c9341ca70 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:41.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.317+0000 7f98327fc640 1 -- 172.21.15.123:0/309877733 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9824037070 con 0x7f98341461a0 2024-09-15T23:12:41.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.317+0000 7f98327fc640 1 -- 172.21.15.123:0/309877733 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9824032440 con 0x7f98341461a0 2024-09-15T23:12:41.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.317+0000 7f98327fc640 1 -- 172.21.15.123:0/309877733 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9824032810 con 0x7f98341461a0 2024-09-15T23:12:41.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.317+0000 7f9839ced640 1 -- 172.21.15.123:0/309877733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98341461a0 msgr2=0x7f983415d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:41.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.317+0000 7f9839ced640 1 --2- 172.21.15.123:0/309877733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98341461a0 0x7f983415d840 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9834071f30 tx=0x7f982402a210 comp rx=0 tx=0).stop 2024-09-15T23:12:41.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.317+0000 7f9839ced640 1 -- 172.21.15.123:0/309877733 shutdown_connections 2024-09-15T23:12:41.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.317+0000 7f9839ced640 1 --2- 172.21.15.123:0/309877733 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f983406c150 0x7f98340b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:41.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.317+0000 7f9839ced640 1 --2- 172.21.15.123:0/309877733 >> v2:172.21.15.188:3300/0 conn(0x7f98340720c0 0x7f983406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:41.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.317+0000 7f9839ced640 1 --2- 172.21.15.123:0/309877733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98341461a0 0x7f983415d840 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:41.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.317+0000 7f9839ced640 1 -- 172.21.15.123:0/309877733 >> 172.21.15.123:0/309877733 conn(0x7f983406cd20 msgr2=0x7f983406d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:41.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.317+0000 7f9839ced640 1 -- 172.21.15.123:0/309877733 shutdown_connections 2024-09-15T23:12:41.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.317+0000 7f9839ced640 1 -- 172.21.15.123:0/309877733 wait complete. 2024-09-15T23:12:41.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.318+0000 7f9839ced640 1 Processor -- start 2024-09-15T23:12:41.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.319+0000 7f9839ced640 1 -- start start 2024-09-15T23:12:41.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.319+0000 7f9839ced640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f983406c150 0x7f9834141880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:41.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.319+0000 7f9839ced640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f98340720c0 0x7f98340cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:41.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.319+0000 7f9839ced640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98341461a0 0x7f98341423a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:41.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.319+0000 7f9839ced640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9834073170 con 0x7f98341461a0 2024-09-15T23:12:41.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.319+0000 7f9839ced640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9834072e90 con 0x7f98340720c0 2024-09-15T23:12:41.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.319+0000 7f9839ced640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9834072530 con 0x7f983406c150 2024-09-15T23:12:41.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.319+0000 7f9833fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98341461a0 0x7f98341423a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:41.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.319+0000 7f9833fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98341461a0 0x7f98341423a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46280/0 (socket says 172.21.15.123:46280) 2024-09-15T23:12:41.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.319+0000 7f9833fff640 1 -- 172.21.15.123:0/3711878797 learned_addr learned my addr 172.21.15.123:0/3711878797 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:41.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.320+0000 7f98337fe640 1 --2- 172.21.15.123:0/3711878797 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f983406c150 0x7f9834141880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:41.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.320+0000 7f9832ffd640 1 --2- 172.21.15.123:0/3711878797 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f98340720c0 0x7f98340cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:41.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.320+0000 7f9833fff640 1 -- 172.21.15.123:0/3711878797 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f983406c150 msgr2=0x7f9834141880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:41.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.320+0000 7f9833fff640 1 --2- 172.21.15.123:0/3711878797 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f983406c150 0x7f9834141880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:41.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.320+0000 7f9833fff640 1 -- 172.21.15.123:0/3711878797 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f98340720c0 msgr2=0x7f98340cbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:41.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.320+0000 7f9833fff640 1 --2- 172.21.15.123:0/3711878797 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f98340720c0 0x7f98340cbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:41.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.320+0000 7f9833fff640 1 -- 172.21.15.123:0/3711878797 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98340cc800 con 0x7f98341461a0 2024-09-15T23:12:41.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.320+0000 7f9833fff640 1 --2- 172.21.15.123:0/3711878797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98341461a0 0x7f98341423a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f982c00cb80 tx=0x7f982c00a4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:41.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.320+0000 7f981bfff640 1 -- 172.21.15.123:0/3711878797 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982c015070 con 0x7f98341461a0 2024-09-15T23:12:41.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.320+0000 7f981bfff640 1 -- 172.21.15.123:0/3711878797 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f982c00abd0 con 0x7f98341461a0 2024-09-15T23:12:41.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.320+0000 7f9839ced640 1 -- 172.21.15.123:0/3711878797 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98340ccae0 con 0x7f98341461a0 2024-09-15T23:12:41.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.320+0000 7f981bfff640 1 -- 172.21.15.123:0/3711878797 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982c00d040 con 0x7f98341461a0 2024-09-15T23:12:41.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.320+0000 7f9839ced640 1 -- 172.21.15.123:0/3711878797 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98340cd0a0 con 0x7f98341461a0 2024-09-15T23:12:41.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.321+0000 7f9839ced640 1 -- 172.21.15.123:0/3711878797 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f983406bc10 con 0x7f98341461a0 2024-09-15T23:12:41.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.322+0000 7f981bfff640 1 -- 172.21.15.123:0/3711878797 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f982c018070 con 0x7f98341461a0 2024-09-15T23:12:41.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.322+0000 7f981bfff640 1 --2- 172.21.15.123:0/3711878797 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f982006c2b0 0x7f982006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:41.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.322+0000 7f981bfff640 1 -- 172.21.15.123:0/3711878797 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f982c08b380 con 0x7f98341461a0 2024-09-15T23:12:41.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.322+0000 7f98337fe640 1 --2- 172.21.15.123:0/3711878797 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f982006c2b0 0x7f982006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:41.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.323+0000 7f98337fe640 1 --2- 172.21.15.123:0/3711878797 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f982006c2b0 0x7f982006e770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9824034000 tx=0x7f982402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:41.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.326+0000 7f981bfff640 1 -- 172.21.15.123:0/3711878797 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f982c0594a0 con 0x7f98341461a0 2024-09-15T23:12:41.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.527+0000 7f9839ced640 1 -- 172.21.15.123:0/3711878797 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f983415b860 con 0x7f98341461a0 2024-09-15T23:12:41.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.528+0000 7f981bfff640 1 -- 172.21.15.123:0/3711878797 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5226 (secure 0 0 0) 0x7f982c05d7a0 con 0x7f98341461a0 2024-09-15T23:12:41.529 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:41.529 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":6,"btime":"2024-09-15T23:12:15:299077+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2663395388","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2663395388},{"type":"v1","addr":"172.21.15.188:6837","nonce":2663395388}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2375280105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2375280105},{"type":"v1","addr":"172.21.15.188:6836","nonce":2375280105}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/477765723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":477765723},{"type":"v1","addr":"172.21.15.123:6834","nonce":477765723}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:12:12.622666+0000","modified":"2024-09-15T23:12:14.622706+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/3721978283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":3721978283},{"type":"v1","addr":"172.21.15.123:6835","nonce":3721978283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-09-15T23:12:41.529 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 6 2024-09-15T23:12:41.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.530+0000 7f9839ced640 1 -- 172.21.15.123:0/3711878797 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f982006c2b0 msgr2=0x7f982006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:41.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.530+0000 7f9839ced640 1 --2- 172.21.15.123:0/3711878797 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f982006c2b0 0x7f982006e770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9824034000 tx=0x7f982402e000 comp rx=0 tx=0).stop 2024-09-15T23:12:41.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.530+0000 7f9839ced640 1 -- 172.21.15.123:0/3711878797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98341461a0 msgr2=0x7f98341423a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:41.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.530+0000 7f9839ced640 1 --2- 172.21.15.123:0/3711878797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98341461a0 0x7f98341423a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f982c00cb80 tx=0x7f982c00a4c0 comp rx=0 tx=0).stop 2024-09-15T23:12:41.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.530+0000 7f9839ced640 1 -- 172.21.15.123:0/3711878797 shutdown_connections 2024-09-15T23:12:41.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.530+0000 7f9839ced640 1 --2- 172.21.15.123:0/3711878797 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f982006c2b0 0x7f982006e770 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:41.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.530+0000 7f9839ced640 1 --2- 172.21.15.123:0/3711878797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98341461a0 0x7f98341423a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:41.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.530+0000 7f9839ced640 1 --2- 172.21.15.123:0/3711878797 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f98340720c0 0x7f98340cbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:41.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.530+0000 7f9839ced640 1 --2- 172.21.15.123:0/3711878797 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f983406c150 0x7f9834141880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:41.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.530+0000 7f9839ced640 1 -- 172.21.15.123:0/3711878797 >> 172.21.15.123:0/3711878797 conn(0x7f983406cd20 msgr2=0x7f983415d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:41.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.530+0000 7f9839ced640 1 -- 172.21.15.123:0/3711878797 shutdown_connections 2024-09-15T23:12:41.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.530+0000 7f9839ced640 1 -- 172.21.15.123:0/3711878797 wait complete. 2024-09-15T23:12:41.542 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:12:41.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.638+0000 7f052219f640 1 Processor -- start 2024-09-15T23:12:41.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.638+0000 7f052219f640 1 -- start start 2024-09-15T23:12:41.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.639+0000 7f052219f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f051c15c6b0 0x7f051c073b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:41.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.639+0000 7f052219f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f051c0cf300 0x7f051c0713e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:41.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.639+0000 7f052219f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f051c0d1770 con 0x7f051c070fa0 2024-09-15T23:12:41.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.639+0000 7f052219f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f051c0cdec0 con 0x7f051c15c6b0 2024-09-15T23:12:41.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.639+0000 7f052219f640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f051c071920 con 0x7f051c0cf300 2024-09-15T23:12:41.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.639+0000 7f051b7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f051c15c6b0 0x7f051c073b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:41.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.639+0000 7f051b7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f051c15c6b0 0x7f051c073b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46294/0 (socket says 172.21.15.123:46294) 2024-09-15T23:12:41.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.639+0000 7f051b7fe640 1 -- 172.21.15.123:0/1862648932 learned_addr learned my addr 172.21.15.123:0/1862648932 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:41.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.640+0000 7f051b7fe640 1 -- 172.21.15.123:0/1862648932 >> v2:172.21.15.188:3300/0 conn(0x7f051c0cf300 msgr2=0x7f051c0713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:41.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.640+0000 7f051b7fe640 1 --2- 172.21.15.123:0/1862648932 >> v2:172.21.15.188:3300/0 conn(0x7f051c0cf300 0x7f051c0713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:41.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.640+0000 7f051b7fe640 1 -- 172.21.15.123:0/1862648932 >> v1:172.21.15.188:6789/0 conn(0x7f051c070fa0 legacy=0x7f051c0d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:41.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.640+0000 7f051b7fe640 1 -- 172.21.15.123:0/1862648932 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f051c0d1a50 con 0x7f051c15c6b0 2024-09-15T23:12:41.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.640+0000 7f051b7fe640 1 --2- 172.21.15.123:0/1862648932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f051c15c6b0 0x7f051c073b70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f051c071aa0 tx=0x7f050c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a14888a8bd0c120 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:41.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.640+0000 7f051a7fc640 1 -- 172.21.15.123:0/1862648932 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050c037070 con 0x7f051c15c6b0 2024-09-15T23:12:41.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.640+0000 7f051a7fc640 1 -- 172.21.15.123:0/1862648932 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f050c032440 con 0x7f051c15c6b0 2024-09-15T23:12:41.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.640+0000 7f051a7fc640 1 -- 172.21.15.123:0/1862648932 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050c032810 con 0x7f051c15c6b0 2024-09-15T23:12:41.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.641+0000 7f052219f640 1 -- 172.21.15.123:0/1862648932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f051c15c6b0 msgr2=0x7f051c073b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:41.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.641+0000 7f052219f640 1 --2- 172.21.15.123:0/1862648932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f051c15c6b0 0x7f051c073b70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f051c071aa0 tx=0x7f050c02a210 comp rx=0 tx=0).stop 2024-09-15T23:12:41.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.641+0000 7f052219f640 1 -- 172.21.15.123:0/1862648932 shutdown_connections 2024-09-15T23:12:41.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.641+0000 7f052219f640 1 --2- 172.21.15.123:0/1862648932 >> v2:172.21.15.188:3300/0 conn(0x7f051c0cf300 0x7f051c0713e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:41.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.641+0000 7f052219f640 1 --2- 172.21.15.123:0/1862648932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f051c15c6b0 0x7f051c073b70 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:41.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.641+0000 7f052219f640 1 -- 172.21.15.123:0/1862648932 >> 172.21.15.123:0/1862648932 conn(0x7f051c0b4300 msgr2=0x7f051c0b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:41.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.641+0000 7f052219f640 1 -- 172.21.15.123:0/1862648932 shutdown_connections 2024-09-15T23:12:41.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.641+0000 7f052219f640 1 -- 172.21.15.123:0/1862648932 wait complete. 2024-09-15T23:12:41.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.642+0000 7f052219f640 1 Processor -- start 2024-09-15T23:12:41.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.642+0000 7f052219f640 1 -- start start 2024-09-15T23:12:41.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.643+0000 7f052219f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f051c070fa0 0x7f051c1f6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:41.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.643+0000 7f052219f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f051c0cf300 0x7f051c15b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:41.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.643+0000 7f052219f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f051c15c6b0 0x7f051c15ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:41.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.643+0000 7f052219f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f051c15ca90 con 0x7f051c0cf300 2024-09-15T23:12:41.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.643+0000 7f052219f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f051c0d2010 con 0x7f051c15c6b0 2024-09-15T23:12:41.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.643+0000 7f052219f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f051c0d22f0 con 0x7f051c070fa0 2024-09-15T23:12:41.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.643+0000 7f051affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f051c0cf300 0x7f051c15b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:41.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.643+0000 7f051affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f051c0cf300 0x7f051c15b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46296/0 (socket says 172.21.15.123:46296) 2024-09-15T23:12:41.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.643+0000 7f051affd640 1 -- 172.21.15.123:0/4056347273 learned_addr learned my addr 172.21.15.123:0/4056347273 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:41.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.643+0000 7f051bfff640 1 --2- 172.21.15.123:0/4056347273 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f051c15c6b0 0x7f051c15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:41.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.643+0000 7f051affd640 1 -- 172.21.15.123:0/4056347273 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f051c070fa0 msgr2=0x7f051c1f6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:41.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.643+0000 7f051b7fe640 1 --2- 172.21.15.123:0/4056347273 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f051c070fa0 0x7f051c1f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:41.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.643+0000 7f051affd640 1 --2- 172.21.15.123:0/4056347273 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f051c070fa0 0x7f051c1f6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:41.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.643+0000 7f051affd640 1 -- 172.21.15.123:0/4056347273 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f051c15c6b0 msgr2=0x7f051c15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:41.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.643+0000 7f051affd640 1 --2- 172.21.15.123:0/4056347273 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f051c15c6b0 0x7f051c15ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:41.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.644+0000 7f051affd640 1 -- 172.21.15.123:0/4056347273 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f051c15f670 con 0x7f051c0cf300 2024-09-15T23:12:41.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.644+0000 7f051bfff640 1 --2- 172.21.15.123:0/4056347273 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f051c15c6b0 0x7f051c15ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:41.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.644+0000 7f051affd640 1 --2- 172.21.15.123:0/4056347273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f051c0cf300 0x7f051c15b630 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f051000c410 tx=0x7f051000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:41.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.644+0000 7f0503fff640 1 -- 172.21.15.123:0/4056347273 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0510017070 con 0x7f051c0cf300 2024-09-15T23:12:41.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.644+0000 7f0503fff640 1 -- 172.21.15.123:0/4056347273 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05100035f0 con 0x7f051c0cf300 2024-09-15T23:12:41.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.644+0000 7f052219f640 1 -- 172.21.15.123:0/4056347273 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f051c15f950 con 0x7f051c0cf300 2024-09-15T23:12:41.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.644+0000 7f0503fff640 1 -- 172.21.15.123:0/4056347273 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0510003a20 con 0x7f051c0cf300 2024-09-15T23:12:41.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.644+0000 7f052219f640 1 -- 172.21.15.123:0/4056347273 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f051c15bb70 con 0x7f051c0cf300 2024-09-15T23:12:41.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.645+0000 7f052219f640 1 -- 172.21.15.123:0/4056347273 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f051c0b40b0 con 0x7f051c0cf300 2024-09-15T23:12:41.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.645+0000 7f0503fff640 1 -- 172.21.15.123:0/4056347273 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f051001a070 con 0x7f051c0cf300 2024-09-15T23:12:41.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.646+0000 7f0503fff640 1 --2- 172.21.15.123:0/4056347273 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f050806c2b0 0x7f050806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:41.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.646+0000 7f0503fff640 1 -- 172.21.15.123:0/4056347273 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f051008a910 con 0x7f051c0cf300 2024-09-15T23:12:41.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.646+0000 7f051b7fe640 1 --2- 172.21.15.123:0/4056347273 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f050806c2b0 0x7f050806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:41.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.647+0000 7f051b7fe640 1 --2- 172.21.15.123:0/4056347273 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f050806c2b0 0x7f050806e770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f050c034000 tx=0x7f050c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:41.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.650+0000 7f0503fff640 1 -- 172.21.15.123:0/4056347273 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f051c0b40b0 con 0x7f051c0cf300 2024-09-15T23:12:41.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.816+0000 7f052219f640 1 -- 172.21.15.123:0/4056347273 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f051c1f5c40 con 0x7f051c0cf300 2024-09-15T23:12:41.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.817+0000 7f0503fff640 1 -- 172.21.15.123:0/4056347273 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16693 (secure 0 0 0) 0x7f0510059080 con 0x7f051c0cf300 2024-09-15T23:12:41.819 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:41.819 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":22,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:12:14.277829+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:12:10.289254+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:12:11.594152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:12:41.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.819+0000 7f052219f640 1 -- 172.21.15.123:0/4056347273 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f050806c2b0 msgr2=0x7f050806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:41.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.819+0000 7f052219f640 1 --2- 172.21.15.123:0/4056347273 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f050806c2b0 0x7f050806e770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f050c034000 tx=0x7f050c02e000 comp rx=0 tx=0).stop 2024-09-15T23:12:41.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.819+0000 7f052219f640 1 -- 172.21.15.123:0/4056347273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f051c0cf300 msgr2=0x7f051c15b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:41.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.819+0000 7f052219f640 1 --2- 172.21.15.123:0/4056347273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f051c0cf300 0x7f051c15b630 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f051000c410 tx=0x7f051000c8d0 comp rx=0 tx=0).stop 2024-09-15T23:12:41.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.820+0000 7f052219f640 1 -- 172.21.15.123:0/4056347273 shutdown_connections 2024-09-15T23:12:41.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.820+0000 7f052219f640 1 --2- 172.21.15.123:0/4056347273 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f051c15c6b0 0x7f051c15ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:41.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.820+0000 7f052219f640 1 --2- 172.21.15.123:0/4056347273 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f050806c2b0 0x7f050806e770 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:41.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.820+0000 7f052219f640 1 --2- 172.21.15.123:0/4056347273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f051c0cf300 0x7f051c15b630 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:41.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.820+0000 7f052219f640 1 --2- 172.21.15.123:0/4056347273 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f051c070fa0 0x7f051c1f6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:41.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.820+0000 7f052219f640 1 -- 172.21.15.123:0/4056347273 >> 172.21.15.123:0/4056347273 conn(0x7f051c0b4300 msgr2=0x7f051c0b39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:41.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.820+0000 7f052219f640 1 -- 172.21.15.123:0/4056347273 shutdown_connections 2024-09-15T23:12:41.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.820+0000 7f052219f640 1 -- 172.21.15.123:0/4056347273 wait complete. 2024-09-15T23:12:41.832 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T23:12:41.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.930+0000 7f6199e53640 1 Processor -- start 2024-09-15T23:12:41.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.930+0000 7f6199e53640 1 -- start start 2024-09-15T23:12:41.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.931+0000 7f6199e53640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f619415e790 0x7f6194073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:41.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.931+0000 7f6199e53640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61941631c0 con 0x7f619406f730 2024-09-15T23:12:41.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.931+0000 7f6199e53640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61940ae9a0 con 0x7f6194162c60 2024-09-15T23:12:41.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.931+0000 7f6199e53640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f619415eb70 con 0x7f619415e790 2024-09-15T23:12:41.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.931+0000 7f61937fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f619415e790 0x7f6194073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:41.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.931+0000 7f6193fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f619406f730 0x7f619406fb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53614/0 (socket says 172.21.15.123:53614) 2024-09-15T23:12:41.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.931+0000 7f6193fff640 1 -- 172.21.15.123:0/996202032 learned_addr learned my addr 172.21.15.123:0/996202032 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:41.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.931+0000 7f61937fe640 1 -- 172.21.15.123:0/996202032 >> v1:172.21.15.188:6789/0 conn(0x7f6194162c60 legacy=0x7f61940b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:41.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.931+0000 7f61937fe640 1 -- 172.21.15.123:0/996202032 >> v1:172.21.15.123:6789/0 conn(0x7f619406f730 legacy=0x7f619406fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:41.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.931+0000 7f61937fe640 1 -- 172.21.15.123:0/996202032 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61940aec40 con 0x7f619415e790 2024-09-15T23:12:41.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.932+0000 7f61937fe640 1 --2- 172.21.15.123:0/996202032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f619415e790 0x7f6194073a40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f61940aeb70 tx=0x7f618402a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e244a17c8681382 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:41.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.932+0000 7f61927fc640 1 -- 172.21.15.123:0/996202032 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6184037070 con 0x7f619415e790 2024-09-15T23:12:41.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.932+0000 7f61927fc640 1 -- 172.21.15.123:0/996202032 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f618402adb0 con 0x7f619415e790 2024-09-15T23:12:41.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.932+0000 7f61927fc640 1 -- 172.21.15.123:0/996202032 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6184032660 con 0x7f619415e790 2024-09-15T23:12:41.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.933+0000 7f6199e53640 1 -- 172.21.15.123:0/996202032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f619415e790 msgr2=0x7f6194073a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:41.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.933+0000 7f6199e53640 1 --2- 172.21.15.123:0/996202032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f619415e790 0x7f6194073a40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f61940aeb70 tx=0x7f618402a0a0 comp rx=0 tx=0).stop 2024-09-15T23:12:41.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.933+0000 7f6199e53640 1 -- 172.21.15.123:0/996202032 shutdown_connections 2024-09-15T23:12:41.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.933+0000 7f6199e53640 1 --2- 172.21.15.123:0/996202032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f619415e790 0x7f6194073a40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:41.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.933+0000 7f6199e53640 1 -- 172.21.15.123:0/996202032 >> 172.21.15.123:0/996202032 conn(0x7f61940b0a80 msgr2=0x7f61940b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:41.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.933+0000 7f6199e53640 1 -- 172.21.15.123:0/996202032 shutdown_connections 2024-09-15T23:12:41.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.933+0000 7f6199e53640 1 -- 172.21.15.123:0/996202032 wait complete. 2024-09-15T23:12:41.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.934+0000 7f6199e53640 1 Processor -- start 2024-09-15T23:12:41.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.934+0000 7f6199e53640 1 -- start start 2024-09-15T23:12:41.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.935+0000 7f6199e53640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f619406f730 0x7f619414cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:41.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.935+0000 7f6199e53640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f619415e790 0x7f61941f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:41.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.935+0000 7f6199e53640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6194162c60 0x7f61941f8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:41.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.935+0000 7f6199e53640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f61940b5b40 con 0x7f619415e790 2024-09-15T23:12:41.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.935+0000 7f6199e53640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f61940af200 con 0x7f619406f730 2024-09-15T23:12:41.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.935+0000 7f6199e53640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f619406f430 con 0x7f6194162c60 2024-09-15T23:12:41.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.935+0000 7f6192ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f619415e790 0x7f61941f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:41.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.935+0000 7f6192ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f619415e790 0x7f61941f83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46312/0 (socket says 172.21.15.123:46312) 2024-09-15T23:12:41.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.935+0000 7f6192ffd640 1 -- 172.21.15.123:0/1824279108 learned_addr learned my addr 172.21.15.123:0/1824279108 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:41.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.935+0000 7f61937fe640 1 --2- 172.21.15.123:0/1824279108 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f619406f730 0x7f619414cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:41.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.935+0000 7f6193fff640 1 --2- 172.21.15.123:0/1824279108 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6194162c60 0x7f61941f8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:41.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.935+0000 7f6192ffd640 1 -- 172.21.15.123:0/1824279108 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6194162c60 msgr2=0x7f61941f8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:41.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.935+0000 7f6192ffd640 1 --2- 172.21.15.123:0/1824279108 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6194162c60 0x7f61941f8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:41.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.935+0000 7f6192ffd640 1 -- 172.21.15.123:0/1824279108 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f619406f730 msgr2=0x7f619414cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:41.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.935+0000 7f6192ffd640 1 --2- 172.21.15.123:0/1824279108 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f619406f730 0x7f619414cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:41.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.935+0000 7f6192ffd640 1 -- 172.21.15.123:0/1824279108 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f619414d640 con 0x7f619415e790 2024-09-15T23:12:41.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.935+0000 7f6193fff640 1 --2- 172.21.15.123:0/1824279108 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6194162c60 0x7f61941f8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:41.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.935+0000 7f6192ffd640 1 --2- 172.21.15.123:0/1824279108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f619415e790 0x7f61941f83c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f618800b3f0 tx=0x7f618800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:41.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.935+0000 7f617bfff640 1 -- 172.21.15.123:0/1824279108 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6188015020 con 0x7f619415e790 2024-09-15T23:12:41.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.936+0000 7f617bfff640 1 -- 172.21.15.123:0/1824279108 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6188011830 con 0x7f619415e790 2024-09-15T23:12:41.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.936+0000 7f6199e53640 1 -- 172.21.15.123:0/1824279108 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f619414d920 con 0x7f619415e790 2024-09-15T23:12:41.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.936+0000 7f617bfff640 1 -- 172.21.15.123:0/1824279108 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6188011c20 con 0x7f619415e790 2024-09-15T23:12:41.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.936+0000 7f6199e53640 1 -- 172.21.15.123:0/1824279108 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f619414dee0 con 0x7f619415e790 2024-09-15T23:12:41.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.937+0000 7f6199e53640 1 -- 172.21.15.123:0/1824279108 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6194073a40 con 0x7f619415e790 2024-09-15T23:12:41.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.937+0000 7f617bfff640 1 -- 172.21.15.123:0/1824279108 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6188018020 con 0x7f619415e790 2024-09-15T23:12:41.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.938+0000 7f617bfff640 1 --2- 172.21.15.123:0/1824279108 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f618006c2b0 0x7f618006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:41.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.938+0000 7f617bfff640 1 -- 172.21.15.123:0/1824279108 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f618808b050 con 0x7f619415e790 2024-09-15T23:12:41.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.938+0000 7f61937fe640 1 --2- 172.21.15.123:0/1824279108 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f618006c2b0 0x7f618006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:41.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.938+0000 7f61937fe640 1 --2- 172.21.15.123:0/1824279108 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f618006c2b0 0x7f618006e770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6184034000 tx=0x7f618402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:41.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:41.942+0000 7f617bfff640 1 -- 172.21.15.123:0/1824279108 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f618801f030 con 0x7f619415e790 2024-09-15T23:12:42.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.140+0000 7f6199e53640 1 -- 172.21.15.123:0/1824279108 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f619406dd50 con 0x7f619415e790 2024-09-15T23:12:42.142 INFO:tasks.ceph.mon.a.smithi123.stderr:2024-09-15T23:12:42.141+0000 7f8a6ccf0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:12:42.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.142+0000 7f617bfff640 1 -- 172.21.15.123:0/1824279108 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) ==== 161+0+0 (secure 0 0 0) 0x7f61880597c0 con 0x7f619415e790 2024-09-15T23:12:42.143 INFO:teuthology.orchestra.run.smithi123.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T23:12:42.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.147+0000 7f6199e53640 1 -- 172.21.15.123:0/1824279108 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f618006c2b0 msgr2=0x7f618006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:42.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.147+0000 7f6199e53640 1 --2- 172.21.15.123:0/1824279108 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f618006c2b0 0x7f618006e770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6184034000 tx=0x7f618402e000 comp rx=0 tx=0).stop 2024-09-15T23:12:42.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.147+0000 7f6199e53640 1 -- 172.21.15.123:0/1824279108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f619415e790 msgr2=0x7f61941f83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:42.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.147+0000 7f6199e53640 1 --2- 172.21.15.123:0/1824279108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f619415e790 0x7f61941f83c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f618800b3f0 tx=0x7f618800b8b0 comp rx=0 tx=0).stop 2024-09-15T23:12:42.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.147+0000 7f6199e53640 1 -- 172.21.15.123:0/1824279108 shutdown_connections 2024-09-15T23:12:42.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.147+0000 7f6199e53640 1 --2- 172.21.15.123:0/1824279108 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6194162c60 0x7f61941f8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:42.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.147+0000 7f6199e53640 1 --2- 172.21.15.123:0/1824279108 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f618006c2b0 0x7f618006e770 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:42.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.147+0000 7f6199e53640 1 --2- 172.21.15.123:0/1824279108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f619415e790 0x7f61941f83c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:42.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.147+0000 7f6199e53640 1 --2- 172.21.15.123:0/1824279108 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f619406f730 0x7f619414cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:42.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.147+0000 7f6199e53640 1 -- 172.21.15.123:0/1824279108 >> 172.21.15.123:0/1824279108 conn(0x7f61940b0a80 msgr2=0x7f6194072480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:42.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.147+0000 7f6199e53640 1 -- 172.21.15.123:0/1824279108 shutdown_connections 2024-09-15T23:12:42.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.147+0000 7f6199e53640 1 -- 172.21.15.123:0/1824279108 wait complete. 2024-09-15T23:12:42.149 INFO:tasks.ceph.mds.c.smithi123.stderr: -6627> 2024-09-15T23:12:17.109+0000 7ff96d5e3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:12:42.160 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T23:12:42.180 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-15T23:12:42.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.260+0000 7f433e718640 1 Processor -- start 2024-09-15T23:12:42.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.260+0000 7f433e718640 1 -- start start 2024-09-15T23:12:42.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.261+0000 7f433e718640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f433806f730 0x7f43380d1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:42.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.261+0000 7f433e718640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f433815cc60 con 0x7f433815c880 2024-09-15T23:12:42.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.261+0000 7f433e718640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43380713a0 con 0x7f433806f2f0 2024-09-15T23:12:42.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.261+0000 7f433e718640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f43380d0c70 con 0x7f433806f730 2024-09-15T23:12:42.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.261+0000 7f4337fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f433815c880 0x7f4338070830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53630/0 (socket says 172.21.15.123:53630) 2024-09-15T23:12:42.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.261+0000 7f4337fff640 1 -- 172.21.15.123:0/3557313382 learned_addr learned my addr 172.21.15.123:0/3557313382 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:42.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.261+0000 7f4336ffd640 1 -- 172.21.15.123:0/3557313382 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2682588830 0 0) 0x7f433815cc60 con 0x7f433815c880 2024-09-15T23:12:42.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.261+0000 7f4336ffd640 1 -- 172.21.15.123:0/3557313382 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4320003520 con 0x7f433815c880 2024-09-15T23:12:42.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.261+0000 7f433ccb5640 1 --2- 172.21.15.123:0/3557313382 >> v2:172.21.15.188:3300/0 conn(0x7f433806f730 0x7f43380d1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:42.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.261+0000 7f4336ffd640 1 -- 172.21.15.123:0/3557313382 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1249671365 0 0) 0x7f4320003520 con 0x7f433815c880 2024-09-15T23:12:42.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.261+0000 7f4336ffd640 1 -- 172.21.15.123:0/3557313382 >> v2:172.21.15.188:3300/0 conn(0x7f433806f730 msgr2=0x7f43380d1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:42.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.261+0000 7f4336ffd640 1 --2- 172.21.15.123:0/3557313382 >> v2:172.21.15.188:3300/0 conn(0x7f433806f730 0x7f43380d1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:42.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.261+0000 7f4336ffd640 1 -- 172.21.15.123:0/3557313382 >> v1:172.21.15.188:6789/0 conn(0x7f433806f2f0 legacy=0x7f43380d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:42.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.261+0000 7f4336ffd640 1 -- 172.21.15.123:0/3557313382 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4338071680 con 0x7f433815c880 2024-09-15T23:12:42.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.261+0000 7f4336ffd640 1 -- 172.21.15.123:0/3557313382 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f4328001670 con 0x7f433815c880 2024-09-15T23:12:42.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.261+0000 7f4336ffd640 1 -- 172.21.15.123:0/3557313382 >> v1:172.21.15.123:6789/0 conn(0x7f433815c880 legacy=0x7f4338070830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:42.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.261+0000 7f4336ffd640 1 --2- 172.21.15.123:0/3557313382 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43200039b0 0x7f4320003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:42.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.261+0000 7f4336ffd640 1 --2- 172.21.15.123:0/3557313382 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4320004800 0x7f4320004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:42.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.261+0000 7f4336ffd640 1 --2- 172.21.15.123:0/3557313382 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43200051c0 0x7f432000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:42.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.261+0000 7f4336ffd640 1 -- 172.21.15.123:0/3557313382 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f43380d0c70 con 0x7f43200039b0 2024-09-15T23:12:42.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.261+0000 7f4336ffd640 1 -- 172.21.15.123:0/3557313382 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f432000c060 con 0x7f4320004800 2024-09-15T23:12:42.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.261+0000 7f4336ffd640 1 -- 172.21.15.123:0/3557313382 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f432000c260 con 0x7f43200051c0 2024-09-15T23:12:42.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.261+0000 7f4337fff640 1 --2- 172.21.15.123:0/3557313382 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43200039b0 0x7f4320003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:42.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.261+0000 7f43377fe640 1 --2- 172.21.15.123:0/3557313382 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4320004800 0x7f4320004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:42.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.262+0000 7f433ccb5640 1 --2- 172.21.15.123:0/3557313382 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43200051c0 0x7f432000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:42.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.262+0000 7f4337fff640 1 -- 172.21.15.123:0/3557313382 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43200051c0 msgr2=0x7f432000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:42.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.262+0000 7f4337fff640 1 --2- 172.21.15.123:0/3557313382 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43200051c0 0x7f432000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:42.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.262+0000 7f4337fff640 1 -- 172.21.15.123:0/3557313382 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4320004800 msgr2=0x7f4320004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:42.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.262+0000 7f4337fff640 1 --2- 172.21.15.123:0/3557313382 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4320004800 0x7f4320004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:42.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.262+0000 7f4337fff640 1 -- 172.21.15.123:0/3557313382 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4320003520 con 0x7f43200039b0 2024-09-15T23:12:42.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.262+0000 7f433ccb5640 1 -- 172.21.15.123:0/3557313382 reap_dead start 2024-09-15T23:12:42.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.262+0000 7f43377fe640 1 --2- 172.21.15.123:0/3557313382 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4320004800 0x7f4320004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:42.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.262+0000 7f4337fff640 1 --2- 172.21.15.123:0/3557313382 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43200039b0 0x7f4320003dd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f432800c240 tx=0x7f4320005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f11ebb73ecd254ff server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:42.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.262+0000 7f4336ffd640 1 -- 172.21.15.123:0/3557313382 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4328007d10 con 0x7f43200039b0 2024-09-15T23:12:42.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.262+0000 7f4336ffd640 1 -- 172.21.15.123:0/3557313382 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43280058d0 con 0x7f43200039b0 2024-09-15T23:12:42.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.262+0000 7f4336ffd640 1 -- 172.21.15.123:0/3557313382 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4328005d40 con 0x7f43200039b0 2024-09-15T23:12:42.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.263+0000 7f433e718640 1 -- 172.21.15.123:0/3557313382 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43200039b0 msgr2=0x7f4320003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:42.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.263+0000 7f433e718640 1 --2- 172.21.15.123:0/3557313382 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43200039b0 0x7f4320003dd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f432800c240 tx=0x7f4320005830 comp rx=0 tx=0).stop 2024-09-15T23:12:42.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.263+0000 7f433e718640 1 -- 172.21.15.123:0/3557313382 shutdown_connections 2024-09-15T23:12:42.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.263+0000 7f433e718640 1 --2- 172.21.15.123:0/3557313382 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43200039b0 0x7f4320003dd0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:42.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.263+0000 7f433e718640 1 -- 172.21.15.123:0/3557313382 >> 172.21.15.123:0/3557313382 conn(0x7f43380d2550 msgr2=0x7f43380d2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:42.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.263+0000 7f433e718640 1 -- 172.21.15.123:0/3557313382 shutdown_connections 2024-09-15T23:12:42.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.263+0000 7f433e718640 1 -- 172.21.15.123:0/3557313382 wait complete. 2024-09-15T23:12:42.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.264+0000 7f433e718640 1 Processor -- start 2024-09-15T23:12:42.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.264+0000 7f433e718640 1 -- start start 2024-09-15T23:12:42.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.265+0000 7f433e718640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43200039b0 0x7f43381f2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:42.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.265+0000 7f433e718640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f433815ea50 0x7f43381f5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:42.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.265+0000 7f433e718640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f433815eeb0 0x7f43381f5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:42.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.265+0000 7f433e718640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f433806fbc0 con 0x7f433815ea50 2024-09-15T23:12:42.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.265+0000 7f433e718640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f43380d32f0 con 0x7f433815eeb0 2024-09-15T23:12:42.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.265+0000 7f433e718640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f43380d05b0 con 0x7f43200039b0 2024-09-15T23:12:42.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.265+0000 7f43377fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f433815ea50 0x7f43381f5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:42.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.265+0000 7f43377fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f433815ea50 0x7f43381f5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46362/0 (socket says 172.21.15.123:46362) 2024-09-15T23:12:42.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.265+0000 7f43377fe640 1 -- 172.21.15.123:0/1762511741 learned_addr learned my addr 172.21.15.123:0/1762511741 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:42.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.265+0000 7f43377fe640 1 -- 172.21.15.123:0/1762511741 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43200039b0 msgr2=0x7f43381f2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:42.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.265+0000 7f433ccb5640 1 --2- 172.21.15.123:0/1762511741 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f433815eeb0 0x7f43381f5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:42.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.265+0000 7f4337fff640 1 --2- 172.21.15.123:0/1762511741 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43200039b0 0x7f43381f2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:42.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.266+0000 7f43377fe640 1 --2- 172.21.15.123:0/1762511741 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43200039b0 0x7f43381f2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:42.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.266+0000 7f43377fe640 1 -- 172.21.15.123:0/1762511741 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f433815eeb0 msgr2=0x7f43381f5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:42.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.266+0000 7f43377fe640 1 --2- 172.21.15.123:0/1762511741 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f433815eeb0 0x7f43381f5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:42.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.266+0000 7f43377fe640 1 -- 172.21.15.123:0/1762511741 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f433815d9b0 con 0x7f433815ea50 2024-09-15T23:12:42.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.266+0000 7f43377fe640 1 --2- 172.21.15.123:0/1762511741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f433815ea50 0x7f43381f5720 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f432c000c00 tx=0x7f432c00e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:42.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.266+0000 7f4334ff9640 1 -- 172.21.15.123:0/1762511741 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f432c019070 con 0x7f433815ea50 2024-09-15T23:12:42.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.266+0000 7f4334ff9640 1 -- 172.21.15.123:0/1762511741 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f432c0052e0 con 0x7f433815ea50 2024-09-15T23:12:42.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.266+0000 7f433e718640 1 -- 172.21.15.123:0/1762511741 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f433815dc90 con 0x7f433815ea50 2024-09-15T23:12:42.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.266+0000 7f4334ff9640 1 -- 172.21.15.123:0/1762511741 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f432c003830 con 0x7f433815ea50 2024-09-15T23:12:42.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.266+0000 7f433e718640 1 -- 172.21.15.123:0/1762511741 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f433815e250 con 0x7f433815ea50 2024-09-15T23:12:42.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.267+0000 7f433e718640 1 -- 172.21.15.123:0/1762511741 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4338070830 con 0x7f433815ea50 2024-09-15T23:12:42.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.267+0000 7f4334ff9640 1 -- 172.21.15.123:0/1762511741 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f432c01c070 con 0x7f433815ea50 2024-09-15T23:12:42.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.268+0000 7f4334ff9640 1 --2- 172.21.15.123:0/1762511741 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f432406c2b0 0x7f432406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:42.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.268+0000 7f4334ff9640 1 -- 172.21.15.123:0/1762511741 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5795+0+0 (secure 0 0 0) 0x7f432c08aa70 con 0x7f433815ea50 2024-09-15T23:12:42.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.268+0000 7f4337fff640 1 --2- 172.21.15.123:0/1762511741 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f432406c2b0 0x7f432406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:42.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.268+0000 7f4337fff640 1 --2- 172.21.15.123:0/1762511741 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f432406c2b0 0x7f432406e770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4328033000 tx=0x7f4328035040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:42.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.272+0000 7f4334ff9640 1 -- 172.21.15.123:0/1762511741 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f432c058b30 con 0x7f433815ea50 2024-09-15T23:12:42.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:42.475+0000 7f433e718640 1 -- 172.21.15.123:0/1762511741 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f43380b27f0 con 0x7f433815ea50 2024-09-15T23:12:43.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.144+0000 7f4334ff9640 1 -- 172.21.15.123:0/1762511741 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) ==== 104+0+0 (secure 0 0 0) 0x7f432c05ce30 con 0x7f433815ea50 2024-09-15T23:12:43.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.147+0000 7f433e718640 1 -- 172.21.15.123:0/1762511741 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f432406c2b0 msgr2=0x7f432406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:43.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.147+0000 7f433e718640 1 --2- 172.21.15.123:0/1762511741 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f432406c2b0 0x7f432406e770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4328033000 tx=0x7f4328035040 comp rx=0 tx=0).stop 2024-09-15T23:12:43.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.147+0000 7f433e718640 1 -- 172.21.15.123:0/1762511741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f433815ea50 msgr2=0x7f43381f5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:43.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.147+0000 7f433e718640 1 --2- 172.21.15.123:0/1762511741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f433815ea50 0x7f43381f5720 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f432c000c00 tx=0x7f432c00e910 comp rx=0 tx=0).stop 2024-09-15T23:12:43.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.147+0000 7f433e718640 1 -- 172.21.15.123:0/1762511741 shutdown_connections 2024-09-15T23:12:43.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.147+0000 7f433e718640 1 --2- 172.21.15.123:0/1762511741 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f433815eeb0 0x7f43381f5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:43.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.147+0000 7f433e718640 1 --2- 172.21.15.123:0/1762511741 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f432406c2b0 0x7f432406e770 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:43.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.147+0000 7f433e718640 1 --2- 172.21.15.123:0/1762511741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f433815ea50 0x7f43381f5720 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:43.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.147+0000 7f433e718640 1 --2- 172.21.15.123:0/1762511741 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43200039b0 0x7f43381f2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:43.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.147+0000 7f433e718640 1 -- 172.21.15.123:0/1762511741 >> 172.21.15.123:0/1762511741 conn(0x7f43380d2550 msgr2=0x7f43380d1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:43.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.147+0000 7f433e718640 1 -- 172.21.15.123:0/1762511741 shutdown_connections 2024-09-15T23:12:43.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.148+0000 7f433e718640 1 -- 172.21.15.123:0/1762511741 wait complete. 2024-09-15T23:12:43.161 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T23:12:43.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.306+0000 7ff0fbdc4640 1 Processor -- start 2024-09-15T23:12:43.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.306+0000 7ff0fbdc4640 1 -- start start 2024-09-15T23:12:43.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.307+0000 7ff0fbdc4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff0f40d23c0 0x7ff0f4162fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:43.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.307+0000 7ff0fbdc4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0f40b7920 con 0x7ff0f415ec10 2024-09-15T23:12:43.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.307+0000 7ff0fbdc4640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0f40cf7c0 con 0x7ff0f40b6980 2024-09-15T23:12:43.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.307+0000 7ff0fbdc4640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7ff0f40b3c00 con 0x7ff0f40d23c0 2024-09-15T23:12:43.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.307+0000 7ff0f9b60640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff0f415ec10 0x7ff0f40b6270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53634/0 (socket says 172.21.15.123:53634) 2024-09-15T23:12:43.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.307+0000 7ff0f9b60640 1 -- 172.21.15.123:0/78098400 learned_addr learned my addr 172.21.15.123:0/78098400 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:43.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.307+0000 7ff0fa361640 1 --2- 172.21.15.123:0/78098400 >> v2:172.21.15.123:3300/0 conn(0x7ff0f40d23c0 0x7ff0f4162fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:43.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.308+0000 7ff0fa361640 1 -- 172.21.15.123:0/78098400 >> v1:172.21.15.188:6789/0 conn(0x7ff0f40b6980 legacy=0x7ff0f40d32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:43.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.308+0000 7ff0fa361640 1 -- 172.21.15.123:0/78098400 >> v1:172.21.15.123:6789/0 conn(0x7ff0f415ec10 legacy=0x7ff0f40b6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:43.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.308+0000 7ff0fa361640 1 -- 172.21.15.123:0/78098400 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f40cfaa0 con 0x7ff0f40d23c0 2024-09-15T23:12:43.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.308+0000 7ff0f8b5e640 1 -- 172.21.15.123:0/78098400 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 277606218 0 0) 0x7ff0ec001110 con 0x7ff0f415ec10 2024-09-15T23:12:43.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.308+0000 7ff0fa361640 1 --2- 172.21.15.123:0/78098400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0f40d23c0 0x7ff0f4162fe0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4009d90 tx=0x7ff0e402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22567f88306ead8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:43.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.308+0000 7ff0f8b5e640 1 -- 172.21.15.123:0/78098400 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4031600 con 0x7ff0f40d23c0 2024-09-15T23:12:43.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.308+0000 7ff0f8b5e640 1 -- 172.21.15.123:0/78098400 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0e40317a0 con 0x7ff0f40d23c0 2024-09-15T23:12:43.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.308+0000 7ff0f8b5e640 1 -- 172.21.15.123:0/78098400 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4031b70 con 0x7ff0f40d23c0 2024-09-15T23:12:43.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.309+0000 7ff0fbdc4640 1 -- 172.21.15.123:0/78098400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0f40d23c0 msgr2=0x7ff0f4162fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:43.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.309+0000 7ff0fbdc4640 1 --2- 172.21.15.123:0/78098400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0f40d23c0 0x7ff0f4162fe0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4009d90 tx=0x7ff0e402a610 comp rx=0 tx=0).stop 2024-09-15T23:12:43.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.309+0000 7ff0fbdc4640 1 -- 172.21.15.123:0/78098400 shutdown_connections 2024-09-15T23:12:43.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.309+0000 7ff0fbdc4640 1 --2- 172.21.15.123:0/78098400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0f40d23c0 0x7ff0f4162fe0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:43.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.309+0000 7ff0fbdc4640 1 -- 172.21.15.123:0/78098400 >> 172.21.15.123:0/78098400 conn(0x7ff0f40d1450 msgr2=0x7ff0f40d1860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:43.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.309+0000 7ff0fbdc4640 1 -- 172.21.15.123:0/78098400 shutdown_connections 2024-09-15T23:12:43.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.309+0000 7ff0fbdc4640 1 -- 172.21.15.123:0/78098400 wait complete. 2024-09-15T23:12:43.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.310+0000 7ff0fbdc4640 1 Processor -- start 2024-09-15T23:12:43.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.310+0000 7ff0fbdc4640 1 -- start start 2024-09-15T23:12:43.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.311+0000 7ff0fbdc4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0f40b6980 0x7ff0f4156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:43.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.311+0000 7ff0fbdc4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0f40d23c0 0x7ff0f40b5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:43.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.311+0000 7ff0fbdc4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0f415ec10 0x7ff0f40b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:43.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.311+0000 7ff0fbdc4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f40d3b80 con 0x7ff0f415ec10 2024-09-15T23:12:43.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.311+0000 7ff0fbdc4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f40d3a00 con 0x7ff0f40b6980 2024-09-15T23:12:43.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.311+0000 7ff0fbdc4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ff0f40d3d00 con 0x7ff0f40d23c0 2024-09-15T23:12:43.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.311+0000 7ff0fa361640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0f415ec10 0x7ff0f40b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:43.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.311+0000 7ff0fa361640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0f415ec10 0x7ff0f40b5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46386/0 (socket says 172.21.15.123:46386) 2024-09-15T23:12:43.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.311+0000 7ff0fa361640 1 -- 172.21.15.123:0/763579127 learned_addr learned my addr 172.21.15.123:0/763579127 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:43.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.311+0000 7ff0fa361640 1 -- 172.21.15.123:0/763579127 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0f40d23c0 msgr2=0x7ff0f40b5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:43.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.311+0000 7ff0fa361640 1 --2- 172.21.15.123:0/763579127 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0f40d23c0 0x7ff0f40b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:43.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.311+0000 7ff0fa361640 1 -- 172.21.15.123:0/763579127 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0f40b6980 msgr2=0x7ff0f4156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:43.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.311+0000 7ff0fa361640 1 --2- 172.21.15.123:0/763579127 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0f40b6980 0x7ff0f4156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:43.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.311+0000 7ff0fa361640 1 -- 172.21.15.123:0/763579127 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f40cd7f0 con 0x7ff0f415ec10 2024-09-15T23:12:43.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.311+0000 7ff0fa361640 1 --2- 172.21.15.123:0/763579127 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0f415ec10 0x7ff0f40b5eb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4009d90 tx=0x7ff0e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:43.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.312+0000 7ff0f27fc640 1 -- 172.21.15.123:0/763579127 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4040070 con 0x7ff0f415ec10 2024-09-15T23:12:43.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.312+0000 7ff0f27fc640 1 -- 172.21.15.123:0/763579127 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0e4030be0 con 0x7ff0f415ec10 2024-09-15T23:12:43.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.312+0000 7ff0f27fc640 1 -- 172.21.15.123:0/763579127 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4009450 con 0x7ff0f415ec10 2024-09-15T23:12:43.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.312+0000 7ff0fbdc4640 1 -- 172.21.15.123:0/763579127 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0f40cdad0 con 0x7ff0f415ec10 2024-09-15T23:12:43.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.312+0000 7ff0fbdc4640 1 -- 172.21.15.123:0/763579127 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0f40ce090 con 0x7ff0f415ec10 2024-09-15T23:12:43.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.313+0000 7ff0fbdc4640 1 -- 172.21.15.123:0/763579127 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0f4162fe0 con 0x7ff0f415ec10 2024-09-15T23:12:43.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.313+0000 7ff0f27fc640 1 -- 172.21.15.123:0/763579127 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff0e4039040 con 0x7ff0f415ec10 2024-09-15T23:12:43.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.314+0000 7ff0f27fc640 1 --2- 172.21.15.123:0/763579127 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff0e006c2b0 0x7ff0e006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:43.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.314+0000 7ff0f27fc640 1 -- 172.21.15.123:0/763579127 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5795+0+0 (secure 0 0 0) 0x7ff0e40ac300 con 0x7ff0f415ec10 2024-09-15T23:12:43.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.314+0000 7ff0f9b60640 1 --2- 172.21.15.123:0/763579127 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff0e006c2b0 0x7ff0e006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:43.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.314+0000 7ff0f9b60640 1 --2- 172.21.15.123:0/763579127 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff0e006c2b0 0x7ff0e006e770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec007fd0 tx=0x7ff0ec007960 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:43.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.318+0000 7ff0f27fc640 1 -- 172.21.15.123:0/763579127 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff0e407aa10 con 0x7ff0f415ec10 2024-09-15T23:12:43.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:43.484+0000 7ff0fbdc4640 1 -- 172.21.15.123:0/763579127 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff0f40d19d0 con 0x7ff0f415ec10 2024-09-15T23:12:44.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.398+0000 7ff0f27fc640 1 -- 172.21.15.123:0/763579127 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) ==== 181+0+0 (secure 0 0 0) 0x7ff0e407a310 con 0x7ff0f415ec10 2024-09-15T23:12:44.399 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' removed 2024-09-15T23:12:44.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.401+0000 7ff0fbdc4640 1 -- 172.21.15.123:0/763579127 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff0e006c2b0 msgr2=0x7ff0e006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:44.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.401+0000 7ff0fbdc4640 1 --2- 172.21.15.123:0/763579127 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff0e006c2b0 0x7ff0e006e770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec007fd0 tx=0x7ff0ec007960 comp rx=0 tx=0).stop 2024-09-15T23:12:44.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.401+0000 7ff0fbdc4640 1 -- 172.21.15.123:0/763579127 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0f415ec10 msgr2=0x7ff0f40b5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:44.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.401+0000 7ff0fbdc4640 1 --2- 172.21.15.123:0/763579127 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0f415ec10 0x7ff0f40b5eb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4009d90 tx=0x7ff0e4004a40 comp rx=0 tx=0).stop 2024-09-15T23:12:44.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.401+0000 7ff0fbdc4640 1 -- 172.21.15.123:0/763579127 shutdown_connections 2024-09-15T23:12:44.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.401+0000 7ff0fbdc4640 1 --2- 172.21.15.123:0/763579127 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff0e006c2b0 0x7ff0e006e770 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:44.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.401+0000 7ff0fbdc4640 1 --2- 172.21.15.123:0/763579127 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0f415ec10 0x7ff0f40b5eb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:44.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.401+0000 7ff0fbdc4640 1 --2- 172.21.15.123:0/763579127 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0f40d23c0 0x7ff0f40b5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:44.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.401+0000 7ff0fbdc4640 1 --2- 172.21.15.123:0/763579127 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0f40b6980 0x7ff0f4156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:44.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.401+0000 7ff0fbdc4640 1 -- 172.21.15.123:0/763579127 >> 172.21.15.123:0/763579127 conn(0x7ff0f40d1450 msgr2=0x7ff0f40b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:44.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.401+0000 7ff0fbdc4640 1 -- 172.21.15.123:0/763579127 shutdown_connections 2024-09-15T23:12:44.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.401+0000 7ff0fbdc4640 1 -- 172.21.15.123:0/763579127 wait complete. 2024-09-15T23:12:44.415 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T23:12:44.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.518+0000 7fa12c54b640 1 Processor -- start 2024-09-15T23:12:44.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.518+0000 7fa12c54b640 1 -- start start 2024-09-15T23:12:44.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.519+0000 7fa12c54b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa12415ea90 0x7fa1240d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:44.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.519+0000 7fa12c54b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa1240d40b0 0x7fa1240d0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:44.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.519+0000 7fa12c54b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa1240d1510 0x7fa1240b6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:44.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.519+0000 7fa12c54b640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fa1240d1980 con 0x7fa1240d40b0 2024-09-15T23:12:44.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.519+0000 7fa12c54b640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fa1240d34c0 con 0x7fa1240d1510 2024-09-15T23:12:44.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.519+0000 7fa12c54b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa1240cf060 con 0x7fa12415ea90 2024-09-15T23:12:44.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.519+0000 7fa129ae6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa1240d40b0 0x7fa1240d0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:44.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.519+0000 7fa129ae6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa1240d40b0 0x7fa1240d0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46398/0 (socket says 172.21.15.123:46398) 2024-09-15T23:12:44.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.519+0000 7fa129ae6640 1 -- 172.21.15.123:0/2919910559 learned_addr learned my addr 172.21.15.123:0/2919910559 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:44.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.519+0000 7fa12a2e7640 1 --2- 172.21.15.123:0/2919910559 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa12415ea90 0x7fa1240d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:44.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.519+0000 7fa12aae8640 1 --2- 172.21.15.123:0/2919910559 >> v2:172.21.15.188:3300/0 conn(0x7fa1240d1510 0x7fa1240b6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:44.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.520+0000 7fa129ae6640 1 -- 172.21.15.123:0/2919910559 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa12415ea90 msgr2=0x7fa1240d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:44.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.520+0000 7fa129ae6640 1 --2- 172.21.15.123:0/2919910559 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa12415ea90 0x7fa1240d2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:44.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.520+0000 7fa129ae6640 1 -- 172.21.15.123:0/2919910559 >> v2:172.21.15.188:3300/0 conn(0x7fa1240d1510 msgr2=0x7fa1240b6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:44.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.520+0000 7fa129ae6640 1 --2- 172.21.15.123:0/2919910559 >> v2:172.21.15.188:3300/0 conn(0x7fa1240d1510 0x7fa1240b6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:44.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.520+0000 7fa129ae6640 1 -- 172.21.15.123:0/2919910559 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1240cf340 con 0x7fa1240d40b0 2024-09-15T23:12:44.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.520+0000 7fa12a2e7640 1 --2- 172.21.15.123:0/2919910559 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa12415ea90 0x7fa1240d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:44.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.520+0000 7fa12aae8640 1 --2- 172.21.15.123:0/2919910559 >> v2:172.21.15.188:3300/0 conn(0x7fa1240d1510 0x7fa1240b6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:44.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.520+0000 7fa129ae6640 1 --2- 172.21.15.123:0/2919910559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1240d40b0 0x7fa1240d0fd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa1240cecf0 tx=0x7fa11402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e24dd7c93ff5db5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:44.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.520+0000 7fa1292e5640 1 -- 172.21.15.123:0/2919910559 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa114037070 con 0x7fa1240d40b0 2024-09-15T23:12:44.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.520+0000 7fa1292e5640 1 -- 172.21.15.123:0/2919910559 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa114032440 con 0x7fa1240d40b0 2024-09-15T23:12:44.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.520+0000 7fa1292e5640 1 -- 172.21.15.123:0/2919910559 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa114032810 con 0x7fa1240d40b0 2024-09-15T23:12:44.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.521+0000 7fa12c54b640 1 -- 172.21.15.123:0/2919910559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1240d40b0 msgr2=0x7fa1240d0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:44.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.521+0000 7fa12c54b640 1 --2- 172.21.15.123:0/2919910559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1240d40b0 0x7fa1240d0fd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa1240cecf0 tx=0x7fa11402a1e0 comp rx=0 tx=0).stop 2024-09-15T23:12:44.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.521+0000 7fa12c54b640 1 -- 172.21.15.123:0/2919910559 shutdown_connections 2024-09-15T23:12:44.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.521+0000 7fa12c54b640 1 --2- 172.21.15.123:0/2919910559 >> v2:172.21.15.188:3300/0 conn(0x7fa1240d1510 0x7fa1240b6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:44.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.521+0000 7fa12c54b640 1 --2- 172.21.15.123:0/2919910559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1240d40b0 0x7fa1240d0fd0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:44.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.521+0000 7fa12c54b640 1 --2- 172.21.15.123:0/2919910559 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa12415ea90 0x7fa1240d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:44.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.521+0000 7fa12c54b640 1 -- 172.21.15.123:0/2919910559 >> 172.21.15.123:0/2919910559 conn(0x7fa12406c0e0 msgr2=0x7fa12406c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:44.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.521+0000 7fa12c54b640 1 -- 172.21.15.123:0/2919910559 shutdown_connections 2024-09-15T23:12:44.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.521+0000 7fa12c54b640 1 -- 172.21.15.123:0/2919910559 wait complete. 2024-09-15T23:12:44.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.522+0000 7fa12c54b640 1 Processor -- start 2024-09-15T23:12:44.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.522+0000 7fa12c54b640 1 -- start start 2024-09-15T23:12:44.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.523+0000 7fa12c54b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa1240d1510 0x7fa1240cba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:44.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.523+0000 7fa12c54b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1240d40b0 0x7fa1240ca620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:44.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.523+0000 7fa12c54b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa12415ea90 0x7fa124154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:44.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.523+0000 7fa12c54b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa1240cfbe0 con 0x7fa1240d40b0 2024-09-15T23:12:44.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.523+0000 7fa12c54b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa1240cf900 con 0x7fa1240d1510 2024-09-15T23:12:44.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.523+0000 7fa12c54b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa12415ee70 con 0x7fa12415ea90 2024-09-15T23:12:44.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.523+0000 7fa129ae6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1240d40b0 0x7fa1240ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:44.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.523+0000 7fa129ae6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1240d40b0 0x7fa1240ca620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46402/0 (socket says 172.21.15.123:46402) 2024-09-15T23:12:44.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.523+0000 7fa129ae6640 1 -- 172.21.15.123:0/3107534718 learned_addr learned my addr 172.21.15.123:0/3107534718 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:44.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.523+0000 7fa129ae6640 1 -- 172.21.15.123:0/3107534718 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa12415ea90 msgr2=0x7fa124154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:44.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.523+0000 7fa129ae6640 1 --2- 172.21.15.123:0/3107534718 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa12415ea90 0x7fa124154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:44.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.523+0000 7fa129ae6640 1 -- 172.21.15.123:0/3107534718 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa1240d1510 msgr2=0x7fa1240cba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:44.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.523+0000 7fa12a2e7640 1 --2- 172.21.15.123:0/3107534718 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa1240d1510 0x7fa1240cba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:44.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.523+0000 7fa129ae6640 1 --2- 172.21.15.123:0/3107534718 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa1240d1510 0x7fa1240cba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:44.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.523+0000 7fa129ae6640 1 -- 172.21.15.123:0/3107534718 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1240cb100 con 0x7fa1240d40b0 2024-09-15T23:12:44.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.523+0000 7fa12a2e7640 1 --2- 172.21.15.123:0/3107534718 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa1240d1510 0x7fa1240cba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:44.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.523+0000 7fa129ae6640 1 --2- 172.21.15.123:0/3107534718 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1240d40b0 0x7fa1240ca620 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa11402a220 tx=0x7fa1140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:44.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.524+0000 7fa11affd640 1 -- 172.21.15.123:0/3107534718 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa114037040 con 0x7fa1240d40b0 2024-09-15T23:12:44.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.524+0000 7fa11affd640 1 -- 172.21.15.123:0/3107534718 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa114042070 con 0x7fa1240d40b0 2024-09-15T23:12:44.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.524+0000 7fa12c54b640 1 -- 172.21.15.123:0/3107534718 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1240b4320 con 0x7fa1240d40b0 2024-09-15T23:12:44.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.524+0000 7fa11affd640 1 -- 172.21.15.123:0/3107534718 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa114030bb0 con 0x7fa1240d40b0 2024-09-15T23:12:44.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.524+0000 7fa12c54b640 1 -- 172.21.15.123:0/3107534718 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1240b48e0 con 0x7fa1240d40b0 2024-09-15T23:12:44.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.525+0000 7fa12c54b640 1 -- 172.21.15.123:0/3107534718 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1240d0fd0 con 0x7fa1240d40b0 2024-09-15T23:12:44.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.525+0000 7fa11affd640 1 -- 172.21.15.123:0/3107534718 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa114047460 con 0x7fa1240d40b0 2024-09-15T23:12:44.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.526+0000 7fa11affd640 1 --2- 172.21.15.123:0/3107534718 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa10806c2b0 0x7fa10806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:44.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.526+0000 7fa11affd640 1 -- 172.21.15.123:0/3107534718 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5357+0+0 (secure 0 0 0) 0x7fa1140abf50 con 0x7fa1240d40b0 2024-09-15T23:12:44.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.526+0000 7fa12a2e7640 1 --2- 172.21.15.123:0/3107534718 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa10806c2b0 0x7fa10806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:44.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.527+0000 7fa12a2e7640 1 --2- 172.21.15.123:0/3107534718 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa10806c2b0 0x7fa10806e770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa120007f40 tx=0x7fa120007490 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:44.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.530+0000 7fa11affd640 1 -- 172.21.15.123:0/3107534718 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa114045360 con 0x7fa1240d40b0 2024-09-15T23:12:44.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:44.696+0000 7fa12c54b640 1 -- 172.21.15.123:0/3107534718 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa1240d2760 con 0x7fa1240d40b0 2024-09-15T23:12:45.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.403+0000 7fa11affd640 1 -- 172.21.15.123:0/3107534718 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) ==== 169+0+0 (secure 0 0 0) 0x7fa11407a820 con 0x7fa1240d40b0 2024-09-15T23:12:45.404 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' removed 2024-09-15T23:12:45.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.406+0000 7fa12c54b640 1 -- 172.21.15.123:0/3107534718 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa10806c2b0 msgr2=0x7fa10806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:45.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.406+0000 7fa12c54b640 1 --2- 172.21.15.123:0/3107534718 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa10806c2b0 0x7fa10806e770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa120007f40 tx=0x7fa120007490 comp rx=0 tx=0).stop 2024-09-15T23:12:45.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.406+0000 7fa12c54b640 1 -- 172.21.15.123:0/3107534718 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1240d40b0 msgr2=0x7fa1240ca620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:45.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.406+0000 7fa12c54b640 1 --2- 172.21.15.123:0/3107534718 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1240d40b0 0x7fa1240ca620 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa11402a220 tx=0x7fa1140046c0 comp rx=0 tx=0).stop 2024-09-15T23:12:45.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.406+0000 7fa12c54b640 1 -- 172.21.15.123:0/3107534718 shutdown_connections 2024-09-15T23:12:45.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.406+0000 7fa12c54b640 1 --2- 172.21.15.123:0/3107534718 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa12415ea90 0x7fa124154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:45.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.406+0000 7fa12c54b640 1 --2- 172.21.15.123:0/3107534718 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa10806c2b0 0x7fa10806e770 secure :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa120007f40 tx=0x7fa120007490 comp rx=0 tx=0).stop 2024-09-15T23:12:45.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.406+0000 7fa12c54b640 1 --2- 172.21.15.123:0/3107534718 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1240d40b0 0x7fa1240ca620 secure :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa11402a220 tx=0x7fa1140046c0 comp rx=0 tx=0).stop 2024-09-15T23:12:45.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.406+0000 7fa12c54b640 1 --2- 172.21.15.123:0/3107534718 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa1240d1510 0x7fa1240cba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:45.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.406+0000 7fa12c54b640 1 -- 172.21.15.123:0/3107534718 >> 172.21.15.123:0/3107534718 conn(0x7fa12406c0e0 msgr2=0x7fa12415ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:45.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.408+0000 7fa12c54b640 1 -- 172.21.15.123:0/3107534718 shutdown_connections 2024-09-15T23:12:45.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.408+0000 7fa12c54b640 1 -- 172.21.15.123:0/3107534718 wait complete. 2024-09-15T23:12:45.423 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T23:12:45.423 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T23:12:45.423 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T23:12:45.424 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:12:45.424 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T23:12:45.424 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T23:12:45.424 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T23:12:45.424 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:12:45.424 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T23:12:45.424 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T23:12:45.425 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T23:12:45.425 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:12:45.425 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T23:12:45.425 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T23:12:45.425 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T23:12:45.425 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:12:45.434 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T23:12:45.434 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T23:12:45.435 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T23:12:45.435 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T23:12:45.436 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T23:12:45.437 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T23:12:45.437 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T23:12:45.438 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T23:12:45.477 INFO:tasks.ceph.mds.a:Started 2024-09-15T23:12:45.477 DEBUG:teuthology.parallel:result is None 2024-09-15T23:12:45.478 INFO:tasks.ceph.mds.c:Started 2024-09-15T23:12:45.478 DEBUG:teuthology.parallel:result is None 2024-09-15T23:12:45.479 INFO:tasks.ceph.mds.d:Started 2024-09-15T23:12:45.479 DEBUG:teuthology.parallel:result is None 2024-09-15T23:12:45.480 INFO:tasks.ceph.mds.b:Started 2024-09-15T23:12:45.480 DEBUG:teuthology.parallel:result is None 2024-09-15T23:12:45.480 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T23:12:45.552 INFO:tasks.ceph.mds.a.smithi123.stdout:starting mds.a at 2024-09-15T23:12:45.553 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-15T23:12:45.561 INFO:tasks.ceph.mds.d.smithi188.stdout:starting mds.d at 2024-09-15T23:12:45.561 INFO:tasks.ceph.mds.b.smithi188.stdout:starting mds.b at 2024-09-15T23:12:45.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.584+0000 7fe75b277640 1 Processor -- start 2024-09-15T23:12:45.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.584+0000 7fe75b277640 1 -- start start 2024-09-15T23:12:45.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.585+0000 7fe75b277640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe75406c320 0x7fe754073730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:45.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.585+0000 7fe75b277640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe754073c70 0x7fe754164320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:45.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.585+0000 7fe75b277640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe754071010 con 0x7fe754144300 2024-09-15T23:12:45.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.585+0000 7fe75b277640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe7540720b0 con 0x7fe754073c70 2024-09-15T23:12:45.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.585+0000 7fe75b277640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe754071c20 con 0x7fe75406c320 2024-09-15T23:12:45.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.585+0000 7fe759814640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe754073c70 0x7fe754164320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:45.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.585+0000 7fe759814640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe754073c70 0x7fe754164320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46444/0 (socket says 172.21.15.123:46444) 2024-09-15T23:12:45.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.585+0000 7fe759814640 1 -- 172.21.15.123:0/216048000 learned_addr learned my addr 172.21.15.123:0/216048000 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:45.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.585+0000 7fe758812640 1 --2- 172.21.15.123:0/216048000 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe75406c320 0x7fe754073730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:45.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.585+0000 7fe759814640 1 -- 172.21.15.123:0/216048000 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe75406c320 msgr2=0x7fe754073730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:45.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.585+0000 7fe759814640 1 --2- 172.21.15.123:0/216048000 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe75406c320 0x7fe754073730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:45.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.585+0000 7fe759814640 1 -- 172.21.15.123:0/216048000 >> v1:172.21.15.188:6789/0 conn(0x7fe754144300 legacy=0x7fe75406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:45.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.585+0000 7fe74bfff640 1 -- 172.21.15.123:0/216048000 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3410611527 0 0) 0x7fe754071010 con 0x7fe754144300 2024-09-15T23:12:45.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.585+0000 7fe759814640 1 -- 172.21.15.123:0/216048000 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7540712f0 con 0x7fe754073c70 2024-09-15T23:12:45.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.586+0000 7fe759814640 1 --2- 172.21.15.123:0/216048000 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe754073c70 0x7fe754164320 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe74c009e50 tx=0x7fe74c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d94c440856df7357 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:45.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.586+0000 7fe74bfff640 1 -- 172.21.15.123:0/216048000 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74c036070 con 0x7fe754073c70 2024-09-15T23:12:45.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.586+0000 7fe74bfff640 1 -- 172.21.15.123:0/216048000 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe74c031600 con 0x7fe754073c70 2024-09-15T23:12:45.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.586+0000 7fe74bfff640 1 -- 172.21.15.123:0/216048000 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74c0319d0 con 0x7fe754073c70 2024-09-15T23:12:45.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.587+0000 7fe75b277640 1 -- 172.21.15.123:0/216048000 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe754073c70 msgr2=0x7fe754164320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:45.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.587+0000 7fe75b277640 1 --2- 172.21.15.123:0/216048000 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe754073c70 0x7fe754164320 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe74c009e50 tx=0x7fe74c02a710 comp rx=0 tx=0).stop 2024-09-15T23:12:45.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.587+0000 7fe75b277640 1 -- 172.21.15.123:0/216048000 shutdown_connections 2024-09-15T23:12:45.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.587+0000 7fe75b277640 1 --2- 172.21.15.123:0/216048000 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe754073c70 0x7fe754164320 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:45.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.587+0000 7fe75b277640 1 --2- 172.21.15.123:0/216048000 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe75406c320 0x7fe754073730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:45.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.587+0000 7fe75b277640 1 -- 172.21.15.123:0/216048000 >> 172.21.15.123:0/216048000 conn(0x7fe7540ccec0 msgr2=0x7fe7540cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:45.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.587+0000 7fe75b277640 1 -- 172.21.15.123:0/216048000 shutdown_connections 2024-09-15T23:12:45.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.587+0000 7fe75b277640 1 -- 172.21.15.123:0/216048000 wait complete. 2024-09-15T23:12:45.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.588+0000 7fe75b277640 1 Processor -- start 2024-09-15T23:12:45.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.588+0000 7fe75b277640 1 -- start start 2024-09-15T23:12:45.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.589+0000 7fe75b277640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe75406c320 0x7fe754138900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:45.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.589+0000 7fe75b277640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe754073c70 0x7fe7541553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:45.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.589+0000 7fe75b277640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe754144300 0x7fe754155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:45.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.589+0000 7fe75b277640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe7540b4480 con 0x7fe754144300 2024-09-15T23:12:45.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.589+0000 7fe75b277640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe7540718b0 con 0x7fe75406c320 2024-09-15T23:12:45.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.589+0000 7fe75b277640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe754074100 con 0x7fe754073c70 2024-09-15T23:12:45.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.589+0000 7fe759814640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe754144300 0x7fe754155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:45.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.589+0000 7fe759814640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe754144300 0x7fe754155900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46460/0 (socket says 172.21.15.123:46460) 2024-09-15T23:12:45.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.589+0000 7fe758812640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe754073c70 0x7fe7541553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:45.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.589+0000 7fe759013640 1 --2- 172.21.15.123:0/249023518 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe75406c320 0x7fe754138900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:45.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.589+0000 7fe759814640 1 -- 172.21.15.123:0/249023518 learned_addr learned my addr 172.21.15.123:0/249023518 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:45.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.589+0000 7fe758812640 1 -- 172.21.15.123:0/249023518 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe75406c320 msgr2=0x7fe754138900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:45.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.589+0000 7fe758812640 1 --2- 172.21.15.123:0/249023518 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe75406c320 0x7fe754138900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:45.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.589+0000 7fe758812640 1 -- 172.21.15.123:0/249023518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe754144300 msgr2=0x7fe754155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:45.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.589+0000 7fe758812640 1 --2- 172.21.15.123:0/249023518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe754144300 0x7fe754155900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:45.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.589+0000 7fe758812640 1 -- 172.21.15.123:0/249023518 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe754155f40 con 0x7fe754073c70 2024-09-15T23:12:45.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.590+0000 7fe758812640 1 --2- 172.21.15.123:0/249023518 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe754073c70 0x7fe7541553c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe74400e720 tx=0x7fe74400ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:45.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.590+0000 7fe749ffb640 1 -- 172.21.15.123:0/249023518 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74400c890 con 0x7fe754073c70 2024-09-15T23:12:45.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.590+0000 7fe749ffb640 1 -- 172.21.15.123:0/249023518 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe744019070 con 0x7fe754073c70 2024-09-15T23:12:45.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.590+0000 7fe749ffb640 1 -- 172.21.15.123:0/249023518 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe74400cc50 con 0x7fe754073c70 2024-09-15T23:12:45.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.590+0000 7fe75b277640 1 -- 172.21.15.123:0/249023518 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe754156220 con 0x7fe754073c70 2024-09-15T23:12:45.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.590+0000 7fe75b277640 1 -- 172.21.15.123:0/249023518 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7541567e0 con 0x7fe754073c70 2024-09-15T23:12:45.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.591+0000 7fe75b277640 1 -- 172.21.15.123:0/249023518 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7540b2950 con 0x7fe754073c70 2024-09-15T23:12:45.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.591+0000 7fe749ffb640 1 -- 172.21.15.123:0/249023518 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe74401e460 con 0x7fe754073c70 2024-09-15T23:12:45.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.592+0000 7fe749ffb640 1 --2- 172.21.15.123:0/249023518 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe73806c2b0 0x7fe73806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:45.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.592+0000 7fe749ffb640 1 -- 172.21.15.123:0/249023518 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 4943+0+0 (secure 0 0 0) 0x7fe74408af70 con 0x7fe754073c70 2024-09-15T23:12:45.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.592+0000 7fe759013640 1 --2- 172.21.15.123:0/249023518 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe73806c2b0 0x7fe73806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:45.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.592+0000 7fe759013640 1 --2- 172.21.15.123:0/249023518 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe73806c2b0 0x7fe73806e770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe750000f60 tx=0x7fe750009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:45.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.596+0000 7fe749ffb640 1 -- 172.21.15.123:0/249023518 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe7540b2950 con 0x7fe754073c70 2024-09-15T23:12:45.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:45.773+0000 7fe75b277640 1 -- 172.21.15.123:0/249023518 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fe75413fcf0 con 0x7fe754073c70 2024-09-15T23:12:46.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.417+0000 7fe749ffb640 1 -- 172.21.15.123:0/249023518 <== mon.2 v2:172.21.15.188:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) ==== 97+0+0 (secure 0 0 0) 0x7fe744011070 con 0x7fe754073c70 2024-09-15T23:12:46.419 INFO:teuthology.orchestra.run.smithi123.stderr: removed all blocklist entries 2024-09-15T23:12:46.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.420+0000 7fe75b277640 1 -- 172.21.15.123:0/249023518 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe73806c2b0 msgr2=0x7fe73806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:46.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.420+0000 7fe75b277640 1 --2- 172.21.15.123:0/249023518 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe73806c2b0 0x7fe73806e770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe750000f60 tx=0x7fe750009040 comp rx=0 tx=0).stop 2024-09-15T23:12:46.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.420+0000 7fe75b277640 1 -- 172.21.15.123:0/249023518 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe754073c70 msgr2=0x7fe7541553c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:46.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.420+0000 7fe75b277640 1 --2- 172.21.15.123:0/249023518 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe754073c70 0x7fe7541553c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe74400e720 tx=0x7fe74400ebe0 comp rx=0 tx=0).stop 2024-09-15T23:12:46.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.420+0000 7fe75b277640 1 -- 172.21.15.123:0/249023518 shutdown_connections 2024-09-15T23:12:46.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.420+0000 7fe75b277640 1 --2- 172.21.15.123:0/249023518 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe73806c2b0 0x7fe73806e770 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:46.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.420+0000 7fe75b277640 1 --2- 172.21.15.123:0/249023518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe754144300 0x7fe754155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:46.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.420+0000 7fe75b277640 1 --2- 172.21.15.123:0/249023518 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe754073c70 0x7fe7541553c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:46.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.420+0000 7fe75b277640 1 --2- 172.21.15.123:0/249023518 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe75406c320 0x7fe754138900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:46.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.420+0000 7fe75b277640 1 -- 172.21.15.123:0/249023518 >> 172.21.15.123:0/249023518 conn(0x7fe7540ccec0 msgr2=0x7fe7540cdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:46.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.420+0000 7fe75b277640 1 -- 172.21.15.123:0/249023518 shutdown_connections 2024-09-15T23:12:46.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.420+0000 7fe75b277640 1 -- 172.21.15.123:0/249023518 wait complete. 2024-09-15T23:12:46.434 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T23:12:46.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.532+0000 7f534ef68640 1 Processor -- start 2024-09-15T23:12:46.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.532+0000 7f534ef68640 1 -- start start 2024-09-15T23:12:46.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.533+0000 7f534ef68640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f534815e6d0 0x7f5348071390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:46.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.533+0000 7f534ef68640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f534806cd20 0x7f53480b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:46.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.533+0000 7f534ef68640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f534815eab0 con 0x7f5348070b80 2024-09-15T23:12:46.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.533+0000 7f534ef68640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f534815ed70 con 0x7f534815e6d0 2024-09-15T23:12:46.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.533+0000 7f534ef68640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f534815f050 con 0x7f534806cd20 2024-09-15T23:12:46.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.533+0000 7f534cd04640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f534815e6d0 0x7f5348071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:46.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.533+0000 7f534cd04640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f534815e6d0 0x7f5348071390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54898/0 (socket says 172.21.15.123:54898) 2024-09-15T23:12:46.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.533+0000 7f534cd04640 1 -- 172.21.15.123:0/1001708084 learned_addr learned my addr 172.21.15.123:0/1001708084 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:46.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.533+0000 7f534d505640 1 --1- 172.21.15.123:0/1001708084 >> v1:172.21.15.123:6789/0 conn(0x7f5348070b80 0x7f53480731a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41132/0 (socket says 172.21.15.123:41132) 2024-09-15T23:12:46.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.533+0000 7f5347fff640 1 --2- 172.21.15.123:0/1001708084 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f534806cd20 0x7f53480b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:46.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.533+0000 7f534cd04640 1 -- 172.21.15.123:0/1001708084 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f534806cd20 msgr2=0x7f53480b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:46.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.533+0000 7f534cd04640 1 --2- 172.21.15.123:0/1001708084 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f534806cd20 0x7f53480b6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:46.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.533+0000 7f534cd04640 1 -- 172.21.15.123:0/1001708084 >> v1:172.21.15.123:6789/0 conn(0x7f5348070b80 legacy=0x7f53480731a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:46.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.533+0000 7f534cd04640 1 -- 172.21.15.123:0/1001708084 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f534815f330 con 0x7f534815e6d0 2024-09-15T23:12:46.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.533+0000 7f53477fe640 1 -- 172.21.15.123:0/1001708084 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2399085062 0 0) 0x7f534815eab0 con 0x7f5348070b80 2024-09-15T23:12:46.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.533+0000 7f5347fff640 1 --2- 172.21.15.123:0/1001708084 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f534806cd20 0x7f53480b6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:46.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.534+0000 7f534cd04640 1 --2- 172.21.15.123:0/1001708084 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f534815e6d0 0x7f5348071390 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f533c009870 tx=0x7f533c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de59768d0d8a21f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:46.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.534+0000 7f53477fe640 1 -- 172.21.15.123:0/1001708084 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c037070 con 0x7f534815e6d0 2024-09-15T23:12:46.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.534+0000 7f53477fe640 1 -- 172.21.15.123:0/1001708084 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f533c032440 con 0x7f534815e6d0 2024-09-15T23:12:46.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.534+0000 7f53477fe640 1 -- 172.21.15.123:0/1001708084 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c032810 con 0x7f534815e6d0 2024-09-15T23:12:46.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.534+0000 7f534ef68640 1 -- 172.21.15.123:0/1001708084 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f534815e6d0 msgr2=0x7f5348071390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:46.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.534+0000 7f534ef68640 1 --2- 172.21.15.123:0/1001708084 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f534815e6d0 0x7f5348071390 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f533c009870 tx=0x7f533c02a270 comp rx=0 tx=0).stop 2024-09-15T23:12:46.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.535+0000 7f534ef68640 1 -- 172.21.15.123:0/1001708084 shutdown_connections 2024-09-15T23:12:46.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.535+0000 7f534ef68640 1 --2- 172.21.15.123:0/1001708084 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f534806cd20 0x7f53480b6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:46.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.535+0000 7f534ef68640 1 --2- 172.21.15.123:0/1001708084 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f534815e6d0 0x7f5348071390 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:46.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.535+0000 7f534ef68640 1 -- 172.21.15.123:0/1001708084 >> 172.21.15.123:0/1001708084 conn(0x7f5348067fb0 msgr2=0x7f534806f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:46.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.535+0000 7f534ef68640 1 -- 172.21.15.123:0/1001708084 shutdown_connections 2024-09-15T23:12:46.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.535+0000 7f534ef68640 1 -- 172.21.15.123:0/1001708084 wait complete. 2024-09-15T23:12:46.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.536+0000 7f534ef68640 1 Processor -- start 2024-09-15T23:12:46.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.536+0000 7f534ef68640 1 -- start start 2024-09-15T23:12:46.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.537+0000 7f534ef68640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f534806cd20 0x7f53481f6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:46.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.537+0000 7f534ef68640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5348070b80 0x7f534814ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:46.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.537+0000 7f534ef68640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f534815e6d0 0x7f53481f7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:46.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.537+0000 7f534ef68640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f53480718d0 con 0x7f5348070b80 2024-09-15T23:12:46.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.537+0000 7f534ef68640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f534815f8f0 con 0x7f534806cd20 2024-09-15T23:12:46.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.537+0000 7f534ef68640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5348071a50 con 0x7f534815e6d0 2024-09-15T23:12:46.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.537+0000 7f5347fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5348070b80 0x7f534814ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:46.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.537+0000 7f5347fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5348070b80 0x7f534814ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54906/0 (socket says 172.21.15.123:54906) 2024-09-15T23:12:46.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.537+0000 7f5347fff640 1 -- 172.21.15.123:0/3722276834 learned_addr learned my addr 172.21.15.123:0/3722276834 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:46.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.537+0000 7f534d505640 1 --2- 172.21.15.123:0/3722276834 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f534815e6d0 0x7f53481f7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:46.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.537+0000 7f534cd04640 1 --2- 172.21.15.123:0/3722276834 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f534806cd20 0x7f53481f6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:46.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.537+0000 7f5347fff640 1 -- 172.21.15.123:0/3722276834 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f534815e6d0 msgr2=0x7f53481f7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:46.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.537+0000 7f5347fff640 1 --2- 172.21.15.123:0/3722276834 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f534815e6d0 0x7f53481f7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:46.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.537+0000 7f5347fff640 1 -- 172.21.15.123:0/3722276834 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f534806cd20 msgr2=0x7f53481f6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:46.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.537+0000 7f5347fff640 1 --2- 172.21.15.123:0/3722276834 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f534806cd20 0x7f53481f6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:46.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.537+0000 7f5347fff640 1 -- 172.21.15.123:0/3722276834 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f534814f380 con 0x7f5348070b80 2024-09-15T23:12:46.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.537+0000 7f534d505640 1 --2- 172.21.15.123:0/3722276834 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f534815e6d0 0x7f53481f7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:46.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.537+0000 7f534cd04640 1 --2- 172.21.15.123:0/3722276834 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f534806cd20 0x7f53481f6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:46.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.537+0000 7f5347fff640 1 --2- 172.21.15.123:0/3722276834 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5348070b80 0x7f534814ea80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f533400c7f0 tx=0x7f533400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:46.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.537+0000 7f53457fa640 1 -- 172.21.15.123:0/3722276834 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5334015070 con 0x7f5348070b80 2024-09-15T23:12:46.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.537+0000 7f53457fa640 1 -- 172.21.15.123:0/3722276834 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5334007820 con 0x7f5348070b80 2024-09-15T23:12:46.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.537+0000 7f53457fa640 1 -- 172.21.15.123:0/3722276834 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5334007bf0 con 0x7f5348070b80 2024-09-15T23:12:46.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.537+0000 7f534ef68640 1 -- 172.21.15.123:0/3722276834 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f534814f660 con 0x7f5348070b80 2024-09-15T23:12:46.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.537+0000 7f534ef68640 1 -- 172.21.15.123:0/3722276834 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f534814fc20 con 0x7f5348070b80 2024-09-15T23:12:46.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.538+0000 7f534ef68640 1 -- 172.21.15.123:0/3722276834 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5348071390 con 0x7f5348070b80 2024-09-15T23:12:46.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.539+0000 7f53457fa640 1 -- 172.21.15.123:0/3722276834 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5334018070 con 0x7f5348070b80 2024-09-15T23:12:46.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.539+0000 7f53457fa640 1 --2- 172.21.15.123:0/3722276834 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f532c06c2b0 0x7f532c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:46.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.539+0000 7f53457fa640 1 -- 172.21.15.123:0/3722276834 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f533408b220 con 0x7f5348070b80 2024-09-15T23:12:46.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.540+0000 7f534cd04640 1 --2- 172.21.15.123:0/3722276834 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f532c06c2b0 0x7f532c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:46.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.540+0000 7f534cd04640 1 --2- 172.21.15.123:0/3722276834 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f532c06c2b0 0x7f532c06e770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f533c034000 tx=0x7f533c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:46.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.544+0000 7f53457fa640 1 -- 172.21.15.123:0/3722276834 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5334059d70 con 0x7f5348070b80 2024-09-15T23:12:46.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.774+0000 7f534ef68640 1 -- 172.21.15.123:0/3722276834 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f534806e670 con 0x7f5348070b80 2024-09-15T23:12:46.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.775+0000 7f53457fa640 1 -- 172.21.15.123:0/3722276834 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+6645 (secure 0 0 0) 0x7f5334059670 con 0x7f5348070b80 2024-09-15T23:12:46.776 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:46.776 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:12:46.776 INFO:teuthology.orchestra.run.smithi123.stdout: "auth_dump": [ 2024-09-15T23:12:46.776 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:12:46.776 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.a", 2024-09-15T23:12:46.777 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm9ATVDhAAnukyZogTuG4YCbzRXSCkiQ==", 2024-09-15T23:12:46.777 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:12:46.777 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:12:46.777 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:12:46.777 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:12:46.777 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:12:46.777 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:12:46.777 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:12:46.777 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:12:46.777 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.b", 2024-09-15T23:12:46.777 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm4KmaGhAAbf6vcffqiJTOYXK5DCXcZA==", 2024-09-15T23:12:46.777 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:12:46.778 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:12:46.778 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:12:46.778 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:12:46.778 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:12:46.778 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:12:46.778 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:12:46.778 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:12:46.778 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.c", 2024-09-15T23:12:46.778 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmua/VFRAAwbPm2TslrfQkrvHiO8oeLg==", 2024-09-15T23:12:46.778 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:12:46.778 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:12:46.778 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:12:46.779 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:12:46.779 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:12:46.779 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:12:46.779 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:12:46.779 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:12:46.779 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.d", 2024-09-15T23:12:46.779 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmzw3eIRAAaE+5y9USwp+xM3MTAndn7Q==", 2024-09-15T23:12:46.779 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:12:46.779 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:12:46.779 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:12:46.779 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:12:46.779 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:12:46.779 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:12:46.780 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:12:46.780 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:12:46.780 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.0", 2024-09-15T23:12:46.780 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCRaedmFrHGAxAAy/jTkothESNn2DC9xcHDAQ==", 2024-09-15T23:12:46.780 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:12:46.780 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:12:46.780 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:12:46.780 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:12:46.780 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:12:46.780 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:12:46.780 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:12:46.780 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.1", 2024-09-15T23:12:46.780 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCUaedm6vZlIxAAdsnLqFSng6SRpCT6UZKGsw==", 2024-09-15T23:12:46.781 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:12:46.781 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:12:46.781 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:12:46.781 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:12:46.781 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:12:46.781 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:12:46.781 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:12:46.781 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.2", 2024-09-15T23:12:46.781 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCYaedmXgVwFRAA1mOzzRafhKMsU7kTAT6TqA==", 2024-09-15T23:12:46.781 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:12:46.781 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:12:46.781 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:12:46.781 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:12:46.782 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:12:46.782 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:12:46.782 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:12:46.782 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.3", 2024-09-15T23:12:46.782 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCcaedm+APAFhAAb8blNFzswwHriSmCrMuA0A==", 2024-09-15T23:12:46.782 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:12:46.782 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:12:46.782 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:12:46.782 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:12:46.782 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:12:46.782 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:12:46.782 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:12:46.782 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.4", 2024-09-15T23:12:46.783 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCjaedmReUmABAAXpxsK7osxn/ZelVXKiCLOw==", 2024-09-15T23:12:46.783 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:12:46.783 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:12:46.783 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:12:46.783 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:12:46.783 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:12:46.783 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:12:46.783 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:12:46.783 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.5", 2024-09-15T23:12:46.783 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCnaedmtbdmARAAdxguBdtwBmtiaIx/y992GA==", 2024-09-15T23:12:46.783 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:12:46.783 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:12:46.783 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:12:46.783 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:12:46.784 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:12:46.784 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:12:46.784 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:12:46.784 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.6", 2024-09-15T23:12:46.784 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCraedmkR+NAxAAd2GAAH0BgOMonU8iTSn+Fw==", 2024-09-15T23:12:46.784 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:12:46.784 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:12:46.784 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:12:46.784 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:12:46.784 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:12:46.784 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:12:46.784 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:12:46.784 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.7", 2024-09-15T23:12:46.785 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCvaedmAaCwBBAAdpDtCbXchArmy019wiOdSQ==", 2024-09-15T23:12:46.785 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:12:46.785 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:12:46.785 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:12:46.785 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:12:46.785 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:12:46.785 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:12:46.785 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:12:46.785 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.0", 2024-09-15T23:12:46.785 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmzQPqJRAAhUf1dnVYohN4obCfeu8+7g==", 2024-09-15T23:12:46.785 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:12:46.785 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:12:46.785 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:12:46.786 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:12:46.786 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:12:46.786 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:12:46.786 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:12:46.786 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:12:46.786 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.1", 2024-09-15T23:12:46.786 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmdKK0LhAAXXmUkxVwMEjRTRXUh9CL/g==", 2024-09-15T23:12:46.786 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:12:46.786 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:12:46.786 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:12:46.786 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:12:46.786 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:12:46.786 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:12:46.786 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:12:46.787 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:12:46.787 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.2", 2024-09-15T23:12:46.787 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmRz55KxAARi7B4WYOY1QqH1CK81z9pA==", 2024-09-15T23:12:46.787 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:12:46.787 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:12:46.787 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:12:46.787 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:12:46.787 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:12:46.787 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:12:46.788 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:12:46.788 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:12:46.788 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.3", 2024-09-15T23:12:46.788 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmbWo8NBAAR1qGX1bs35ojx6lMxftcfg==", 2024-09-15T23:12:46.788 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:12:46.788 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:12:46.788 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:12:46.788 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:12:46.788 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:12:46.788 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:12:46.788 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:12:46.788 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:12:46.788 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.admin", 2024-09-15T23:12:46.789 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCMaedmVUW0LhAAqgPFk1HtxsZXcIStNN43pA==", 2024-09-15T23:12:46.789 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:12:46.789 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:12:46.789 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:12:46.789 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:12:46.789 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:12:46.789 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:12:46.789 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:12:46.789 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:12:46.789 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.bootstrap-mds", 2024-09-15T23:12:46.789 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQC1aedmvIvHGRAA1eqGvq1WcuS/FuRhMq/4vg==", 2024-09-15T23:12:46.789 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:12:46.789 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile bootstrap-mds" 2024-09-15T23:12:46.790 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:12:46.790 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:12:46.790 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:12:46.790 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.bootstrap-mgr", 2024-09-15T23:12:46.790 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQC1aedmKpTHGRAAdkoBYQqMBjkalte9IqNeVw==", 2024-09-15T23:12:46.790 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:12:46.790 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-15T23:12:46.790 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:12:46.790 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:12:46.790 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:12:46.790 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.bootstrap-osd", 2024-09-15T23:12:46.790 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQC1aedm2JrHGRAAjXmODXfG0OXGrC5jrg40ig==", 2024-09-15T23:12:46.790 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:12:46.791 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile bootstrap-osd" 2024-09-15T23:12:46.791 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:12:46.791 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:12:46.791 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:12:46.791 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.bootstrap-rbd", 2024-09-15T23:12:46.791 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQC1aedmYKHHGRAA3OYaAC7m9T373Gd6hTQBrA==", 2024-09-15T23:12:46.791 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:12:46.791 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-15T23:12:46.791 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:12:46.791 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:12:46.791 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:12:46.791 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-15T23:12:46.791 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQC1aedmi6nHGRAAXI7+2dw+Ofodkt6fXOU//A==", 2024-09-15T23:12:46.791 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:12:46.791 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-15T23:12:46.792 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:12:46.792 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:12:46.792 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:12:46.792 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.bootstrap-rgw", 2024-09-15T23:12:46.792 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQC1aedmN7HHGRAACo6XD9H8x0Mxk7oruTRcbg==", 2024-09-15T23:12:46.792 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:12:46.792 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-15T23:12:46.792 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:12:46.792 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:12:46.792 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:12:46.792 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.x", 2024-09-15T23:12:46.793 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmGPSBCxAAHAhXQERogdAOm0ZPNtlxpw==", 2024-09-15T23:12:46.793 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:12:46.793 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:12:46.793 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-15T23:12:46.793 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:12:46.793 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:12:46.794 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:12:46.794 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:12:46.794 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.y", 2024-09-15T23:12:46.794 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm5Om4BxAA/7ZtMMlbUA3bvMCfaNMQyg==", 2024-09-15T23:12:46.794 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:12:46.794 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:12:46.794 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-15T23:12:46.794 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:12:46.794 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:12:46.794 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:12:46.794 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-15T23:12:46.794 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:12:46.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.777+0000 7f534ef68640 1 -- 172.21.15.123:0/3722276834 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f532c06c2b0 msgr2=0x7f532c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:46.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.777+0000 7f534ef68640 1 --2- 172.21.15.123:0/3722276834 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f532c06c2b0 0x7f532c06e770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f533c034000 tx=0x7f533c02e000 comp rx=0 tx=0).stop 2024-09-15T23:12:46.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.777+0000 7f534ef68640 1 -- 172.21.15.123:0/3722276834 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5348070b80 msgr2=0x7f534814ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:46.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.777+0000 7f534ef68640 1 --2- 172.21.15.123:0/3722276834 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5348070b80 0x7f534814ea80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f533400c7f0 tx=0x7f533400ccb0 comp rx=0 tx=0).stop 2024-09-15T23:12:46.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.777+0000 7f534ef68640 1 -- 172.21.15.123:0/3722276834 shutdown_connections 2024-09-15T23:12:46.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.777+0000 7f534ef68640 1 --2- 172.21.15.123:0/3722276834 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f534815e6d0 0x7f53481f7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:46.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.777+0000 7f534ef68640 1 --2- 172.21.15.123:0/3722276834 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f532c06c2b0 0x7f532c06e770 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:46.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.777+0000 7f534ef68640 1 --2- 172.21.15.123:0/3722276834 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5348070b80 0x7f534814ea80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:46.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.777+0000 7f534ef68640 1 --2- 172.21.15.123:0/3722276834 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f534806cd20 0x7f53481f6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:46.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.777+0000 7f534ef68640 1 -- 172.21.15.123:0/3722276834 >> 172.21.15.123:0/3722276834 conn(0x7f5348067fb0 msgr2=0x7f534806d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:46.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.777+0000 7f534ef68640 1 -- 172.21.15.123:0/3722276834 shutdown_connections 2024-09-15T23:12:46.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.777+0000 7f534ef68640 1 -- 172.21.15.123:0/3722276834 wait complete. 2024-09-15T23:12:46.797 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-15T23:12:46.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.899+0000 7f7064f4b640 1 Processor -- start 2024-09-15T23:12:46.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.899+0000 7f7064f4b640 1 -- start start 2024-09-15T23:12:46.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.900+0000 7f7064f4b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f706015f3d0 0x7f70600cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:46.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.900+0000 7f7064f4b640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7060159330 con 0x7f706015ef80 2024-09-15T23:12:46.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.900+0000 7f7064f4b640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f706006f1b0 con 0x7f7060158f50 2024-09-15T23:12:46.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.900+0000 7f7064f4b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f706006f490 con 0x7f706015f3d0 2024-09-15T23:12:46.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.900+0000 7f705dd9b640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f706015ef80 0x7f70600cebe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41136/0 (socket says 172.21.15.123:41136) 2024-09-15T23:12:46.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.900+0000 7f705dd9b640 1 -- 172.21.15.123:0/1075091595 learned_addr learned my addr 172.21.15.123:0/1075091595 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:46.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.900+0000 7f705ed9d640 1 --2- 172.21.15.123:0/1075091595 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f706015f3d0 0x7f70600cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:46.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.900+0000 7f705d59a640 1 -- 172.21.15.123:0/1075091595 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1193450582 0 0) 0x7f7060159330 con 0x7f706015ef80 2024-09-15T23:12:46.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.900+0000 7f705d59a640 1 -- 172.21.15.123:0/1075091595 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f704c003520 con 0x7f706015ef80 2024-09-15T23:12:46.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.901+0000 7f705d59a640 1 -- 172.21.15.123:0/1075091595 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 846933893 0 0) 0x7f706006f1b0 con 0x7f7060158f50 2024-09-15T23:12:46.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.901+0000 7f705d59a640 1 -- 172.21.15.123:0/1075091595 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7060159330 con 0x7f7060158f50 2024-09-15T23:12:46.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.901+0000 7f705d59a640 1 -- 172.21.15.123:0/1075091595 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3680810605 0 0) 0x7f704c003520 con 0x7f706015ef80 2024-09-15T23:12:46.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.901+0000 7f705d59a640 1 -- 172.21.15.123:0/1075091595 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f706015f3d0 msgr2=0x7f70600cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:46.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.901+0000 7f705d59a640 1 --2- 172.21.15.123:0/1075091595 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f706015f3d0 0x7f70600cf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:46.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.901+0000 7f705d59a640 1 -- 172.21.15.123:0/1075091595 >> v1:172.21.15.188:6789/0 conn(0x7f7060158f50 legacy=0x7f706006e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:46.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.901+0000 7f705d59a640 1 -- 172.21.15.123:0/1075091595 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f706006f770 con 0x7f706015ef80 2024-09-15T23:12:46.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.901+0000 7f705d59a640 1 -- 172.21.15.123:0/1075091595 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f7048001670 con 0x7f706015ef80 2024-09-15T23:12:46.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.901+0000 7f705d59a640 1 -- 172.21.15.123:0/1075091595 >> v1:172.21.15.123:6789/0 conn(0x7f706015ef80 legacy=0x7f70600cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:46.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.901+0000 7f705d59a640 1 --2- 172.21.15.123:0/1075091595 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f706015f3d0 0x7f704c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:46.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.901+0000 7f705d59a640 1 --2- 172.21.15.123:0/1075091595 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f704c0040d0 0x7f704c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:46.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.901+0000 7f705d59a640 1 --2- 172.21.15.123:0/1075091595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f704c004d40 0x7f704c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:46.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.901+0000 7f705d59a640 1 -- 172.21.15.123:0/1075091595 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f706006f490 con 0x7f704c004d40 2024-09-15T23:12:46.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.901+0000 7f705d59a640 1 -- 172.21.15.123:0/1075091595 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f704c00baa0 con 0x7f704c0040d0 2024-09-15T23:12:46.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.901+0000 7f705d59a640 1 -- 172.21.15.123:0/1075091595 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f704c00bca0 con 0x7f706015f3d0 2024-09-15T23:12:46.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.901+0000 7f705ed9d640 1 --2- 172.21.15.123:0/1075091595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f704c004d40 0x7f704c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:46.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.901+0000 7f705e59c640 1 --2- 172.21.15.123:0/1075091595 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f706015f3d0 0x7f704c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:46.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.901+0000 7f705dd9b640 1 --2- 172.21.15.123:0/1075091595 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f704c0040d0 0x7f704c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:46.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.901+0000 7f705ed9d640 1 -- 172.21.15.123:0/1075091595 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f706015f3d0 msgr2=0x7f704c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:46.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.901+0000 7f705ed9d640 1 --2- 172.21.15.123:0/1075091595 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f706015f3d0 0x7f704c003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:46.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.901+0000 7f705ed9d640 1 -- 172.21.15.123:0/1075091595 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f704c0040d0 msgr2=0x7f704c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:46.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.901+0000 7f705ed9d640 1 --2- 172.21.15.123:0/1075091595 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f704c0040d0 0x7f704c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:46.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.901+0000 7f705ed9d640 1 -- 172.21.15.123:0/1075091595 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f704c003520 con 0x7f704c004d40 2024-09-15T23:12:46.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.902+0000 7f705ed9d640 1 --2- 172.21.15.123:0/1075091595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f704c004d40 0x7f704c0051c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7058009fc0 tx=0x7f704c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8b04dfedb1def5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:46.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.902+0000 7f705d59a640 1 -- 172.21.15.123:0/1075091595 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7058009c10 con 0x7f704c004d40 2024-09-15T23:12:46.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.902+0000 7f705d59a640 1 -- 172.21.15.123:0/1075091595 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7058036070 con 0x7f704c004d40 2024-09-15T23:12:46.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.902+0000 7f705d59a640 1 -- 172.21.15.123:0/1075091595 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7058031880 con 0x7f704c004d40 2024-09-15T23:12:46.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.903+0000 7f7064f4b640 1 -- 172.21.15.123:0/1075091595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f704c004d40 msgr2=0x7f704c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:46.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.903+0000 7f7064f4b640 1 --2- 172.21.15.123:0/1075091595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f704c004d40 0x7f704c0051c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7058009fc0 tx=0x7f704c005830 comp rx=0 tx=0).stop 2024-09-15T23:12:46.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.903+0000 7f705ed9d640 1 -- 172.21.15.123:0/1075091595 reap_dead start 2024-09-15T23:12:46.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.903+0000 7f7064f4b640 1 -- 172.21.15.123:0/1075091595 shutdown_connections 2024-09-15T23:12:46.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.903+0000 7f7064f4b640 1 -- 172.21.15.123:0/1075091595 >> 172.21.15.123:0/1075091595 conn(0x7f706006cb50 msgr2=0x7f706006cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:46.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.903+0000 7f7064f4b640 1 -- 172.21.15.123:0/1075091595 shutdown_connections 2024-09-15T23:12:46.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.903+0000 7f7064f4b640 1 -- 172.21.15.123:0/1075091595 wait complete. 2024-09-15T23:12:46.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.904+0000 7f7064f4b640 1 Processor -- start 2024-09-15T23:12:46.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.904+0000 7f7064f4b640 1 -- start start 2024-09-15T23:12:46.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.905+0000 7f7064f4b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f704c004d40 0x7f70600aa460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:46.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.905+0000 7f7064f4b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70600afe10 0x7f70601548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:46.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.905+0000 7f7064f4b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7060157bc0 0x7f7060158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:46.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.905+0000 7f7064f4b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f706006eea0 con 0x7f70600afe10 2024-09-15T23:12:46.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.905+0000 7f7064f4b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f706006fd30 con 0x7f704c004d40 2024-09-15T23:12:46.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.905+0000 7f7064f4b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f706015f840 con 0x7f7060157bc0 2024-09-15T23:12:46.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.905+0000 7f705dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70600afe10 0x7f70601548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:46.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.905+0000 7f705dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70600afe10 0x7f70601548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54922/0 (socket says 172.21.15.123:54922) 2024-09-15T23:12:46.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.905+0000 7f705dd9b640 1 -- 172.21.15.123:0/1015961533 learned_addr learned my addr 172.21.15.123:0/1015961533 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:46.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.905+0000 7f705e59c640 1 --2- 172.21.15.123:0/1015961533 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f704c004d40 0x7f70600aa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:46.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.905+0000 7f705ed9d640 1 --2- 172.21.15.123:0/1015961533 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7060157bc0 0x7f7060158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:46.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.905+0000 7f705dd9b640 1 -- 172.21.15.123:0/1015961533 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7060157bc0 msgr2=0x7f7060158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:46.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.906+0000 7f705dd9b640 1 --2- 172.21.15.123:0/1015961533 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7060157bc0 0x7f7060158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:46.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.906+0000 7f705dd9b640 1 -- 172.21.15.123:0/1015961533 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f704c004d40 msgr2=0x7f70600aa460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:46.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.906+0000 7f705dd9b640 1 --2- 172.21.15.123:0/1015961533 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f704c004d40 0x7f70600aa460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:46.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.906+0000 7f705dd9b640 1 -- 172.21.15.123:0/1015961533 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70600ae110 con 0x7f70600afe10 2024-09-15T23:12:46.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.906+0000 7f705e59c640 1 --2- 172.21.15.123:0/1015961533 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f704c004d40 0x7f70600aa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:46.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.906+0000 7f705dd9b640 1 --2- 172.21.15.123:0/1015961533 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70600afe10 0x7f70601548c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f704800e7b0 tx=0x7f704800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:46.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.906+0000 7f7056ffd640 1 -- 172.21.15.123:0/1015961533 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f704800c870 con 0x7f70600afe10 2024-09-15T23:12:46.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.906+0000 7f7056ffd640 1 -- 172.21.15.123:0/1015961533 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7048018070 con 0x7f70600afe10 2024-09-15T23:12:46.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.906+0000 7f7056ffd640 1 -- 172.21.15.123:0/1015961533 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f704800cc70 con 0x7f70600afe10 2024-09-15T23:12:46.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.906+0000 7f7064f4b640 1 -- 172.21.15.123:0/1015961533 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70600aad20 con 0x7f70600afe10 2024-09-15T23:12:46.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.906+0000 7f7064f4b640 1 -- 172.21.15.123:0/1015961533 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70600ab2e0 con 0x7f70600afe10 2024-09-15T23:12:46.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.907+0000 7f7064f4b640 1 -- 172.21.15.123:0/1015961533 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f706015fd50 con 0x7f70600afe10 2024-09-15T23:12:46.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.908+0000 7f7056ffd640 1 -- 172.21.15.123:0/1015961533 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f704801d460 con 0x7f70600afe10 2024-09-15T23:12:46.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.908+0000 7f7056ffd640 1 --2- 172.21.15.123:0/1015961533 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f704006c2e0 0x7f704006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:46.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.908+0000 7f7056ffd640 1 -- 172.21.15.123:0/1015961533 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f704808aea0 con 0x7f70600afe10 2024-09-15T23:12:46.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.908+0000 7f705e59c640 1 --2- 172.21.15.123:0/1015961533 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f704006c2e0 0x7f704006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:46.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.909+0000 7f705e59c640 1 --2- 172.21.15.123:0/1015961533 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f704006c2e0 0x7f704006e7a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7050007ae0 tx=0x7f7050009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:46.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:46.912+0000 7f7056ffd640 1 -- 172.21.15.123:0/1015961533 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f70600ae110 con 0x7f70600afe10 2024-09-15T23:12:47.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.152+0000 7f7064f4b640 1 -- 172.21.15.123:0/1015961533 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f70600ced80 con 0x7f70600afe10 2024-09-15T23:12:47.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.154+0000 7f7056ffd640 1 -- 172.21.15.123:0/1015961533 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f70480599f0 con 0x7f70600afe10 2024-09-15T23:12:47.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.156+0000 7f7064f4b640 1 -- 172.21.15.123:0/1015961533 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f704006c2e0 msgr2=0x7f704006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:47.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.156+0000 7f7064f4b640 1 --2- 172.21.15.123:0/1015961533 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f704006c2e0 0x7f704006e7a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7050007ae0 tx=0x7f7050009040 comp rx=0 tx=0).stop 2024-09-15T23:12:47.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.156+0000 7f7064f4b640 1 -- 172.21.15.123:0/1015961533 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70600afe10 msgr2=0x7f70601548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:47.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.156+0000 7f7064f4b640 1 --2- 172.21.15.123:0/1015961533 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70600afe10 0x7f70601548c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f704800e7b0 tx=0x7f704800ec70 comp rx=0 tx=0).stop 2024-09-15T23:12:47.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.156+0000 7f7064f4b640 1 -- 172.21.15.123:0/1015961533 shutdown_connections 2024-09-15T23:12:47.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.156+0000 7f7064f4b640 1 --2- 172.21.15.123:0/1015961533 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7060157bc0 0x7f7060158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:47.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.156+0000 7f7064f4b640 1 --2- 172.21.15.123:0/1015961533 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f704006c2e0 0x7f704006e7a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:47.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.156+0000 7f7064f4b640 1 --2- 172.21.15.123:0/1015961533 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70600afe10 0x7f70601548c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:47.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.156+0000 7f7064f4b640 1 --2- 172.21.15.123:0/1015961533 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f704c004d40 0x7f70600aa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:47.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.156+0000 7f7064f4b640 1 -- 172.21.15.123:0/1015961533 >> 172.21.15.123:0/1015961533 conn(0x7f706006cb50 msgr2=0x7f706006cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:47.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.156+0000 7f7064f4b640 1 -- 172.21.15.123:0/1015961533 shutdown_connections 2024-09-15T23:12:47.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.156+0000 7f7064f4b640 1 -- 172.21.15.123:0/1015961533 wait complete. 2024-09-15T23:12:47.168 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-15T23:12:47.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.269+0000 7f08bcb03640 1 Processor -- start 2024-09-15T23:12:47.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.269+0000 7f08bcb03640 1 -- start start 2024-09-15T23:12:47.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.270+0000 7f08bcb03640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f08b806c320 0x7f08b815bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:47.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.270+0000 7f08bcb03640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f08b813eb20 0x7f08b815c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:47.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.270+0000 7f08bcb03640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08b8071180 con 0x7f08b80b2d40 2024-09-15T23:12:47.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.270+0000 7f08bcb03640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f08b8071ab0 con 0x7f08b806c320 2024-09-15T23:12:47.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.270+0000 7f08bcb03640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f08b8071460 con 0x7f08b813eb20 2024-09-15T23:12:47.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.270+0000 7f08affff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f08b806c320 0x7f08b815bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:47.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.270+0000 7f08affff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f08b806c320 0x7f08b815bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54934/0 (socket says 172.21.15.123:54934) 2024-09-15T23:12:47.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.270+0000 7f08affff640 1 -- 172.21.15.123:0/2671761751 learned_addr learned my addr 172.21.15.123:0/2671761751 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:47.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.270+0000 7f08b659c640 1 --1- 172.21.15.123:0/2671761751 >> v1:172.21.15.123:6789/0 conn(0x7f08b80b2d40 0x7f08b806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41140/0 (socket says 172.21.15.123:41140) 2024-09-15T23:12:47.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.270+0000 7f08affff640 1 -- 172.21.15.123:0/2671761751 >> v2:172.21.15.188:3300/0 conn(0x7f08b813eb20 msgr2=0x7f08b815c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:47.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.270+0000 7f08b6d9d640 1 --2- 172.21.15.123:0/2671761751 >> v2:172.21.15.188:3300/0 conn(0x7f08b813eb20 0x7f08b815c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:47.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.270+0000 7f08affff640 1 --2- 172.21.15.123:0/2671761751 >> v2:172.21.15.188:3300/0 conn(0x7f08b813eb20 0x7f08b815c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:47.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.270+0000 7f08affff640 1 -- 172.21.15.123:0/2671761751 >> v1:172.21.15.123:6789/0 conn(0x7f08b80b2d40 legacy=0x7f08b806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:47.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.270+0000 7f08b5d9b640 1 -- 172.21.15.123:0/2671761751 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 294021451 0 0) 0x7f08b8071180 con 0x7f08b80b2d40 2024-09-15T23:12:47.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.270+0000 7f08affff640 1 -- 172.21.15.123:0/2671761751 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b8071740 con 0x7f08b806c320 2024-09-15T23:12:47.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.271+0000 7f08affff640 1 --2- 172.21.15.123:0/2671761751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08b806c320 0x7f08b815bcf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f08b81595c0 tx=0x7f08a002c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3cd353d5b93566f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:47.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.271+0000 7f08b5d9b640 1 -- 172.21.15.123:0/2671761751 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a0036020 con 0x7f08b806c320 2024-09-15T23:12:47.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.271+0000 7f08b5d9b640 1 -- 172.21.15.123:0/2671761751 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08a0032640 con 0x7f08b806c320 2024-09-15T23:12:47.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.271+0000 7f08b5d9b640 1 -- 172.21.15.123:0/2671761751 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a0032a10 con 0x7f08b806c320 2024-09-15T23:12:47.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.272+0000 7f08bcb03640 1 -- 172.21.15.123:0/2671761751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08b806c320 msgr2=0x7f08b815bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:47.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.272+0000 7f08bcb03640 1 --2- 172.21.15.123:0/2671761751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08b806c320 0x7f08b815bcf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f08b81595c0 tx=0x7f08a002c940 comp rx=0 tx=0).stop 2024-09-15T23:12:47.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.272+0000 7f08bcb03640 1 -- 172.21.15.123:0/2671761751 shutdown_connections 2024-09-15T23:12:47.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.272+0000 7f08bcb03640 1 --2- 172.21.15.123:0/2671761751 >> v2:172.21.15.188:3300/0 conn(0x7f08b813eb20 0x7f08b815c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:47.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.272+0000 7f08bcb03640 1 --2- 172.21.15.123:0/2671761751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08b806c320 0x7f08b815bcf0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:47.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.272+0000 7f08bcb03640 1 -- 172.21.15.123:0/2671761751 >> 172.21.15.123:0/2671761751 conn(0x7f08b80ccec0 msgr2=0x7f08b80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:47.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.272+0000 7f08bcb03640 1 -- 172.21.15.123:0/2671761751 shutdown_connections 2024-09-15T23:12:47.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.272+0000 7f08bcb03640 1 -- 172.21.15.123:0/2671761751 wait complete. 2024-09-15T23:12:47.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.274+0000 7f08bcb03640 1 Processor -- start 2024-09-15T23:12:47.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.274+0000 7f08bcb03640 1 -- start start 2024-09-15T23:12:47.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.275+0000 7f08bcb03640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08b806c320 0x7f08b81587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:47.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.275+0000 7f08bcb03640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08b80b2d40 0x7f08b8157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:47.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.275+0000 7f08bcb03640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08b813eb20 0x7f08b81543c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:47.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.275+0000 7f08bcb03640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f08b80720c0 con 0x7f08b806c320 2024-09-15T23:12:47.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.275+0000 7f08bcb03640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f08b8071f40 con 0x7f08b80b2d40 2024-09-15T23:12:47.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.275+0000 7f08bcb03640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f08b8072240 con 0x7f08b813eb20 2024-09-15T23:12:47.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.275+0000 7f08b659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08b806c320 0x7f08b81587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:47.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.275+0000 7f08b659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08b806c320 0x7f08b81587f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54940/0 (socket says 172.21.15.123:54940) 2024-09-15T23:12:47.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.275+0000 7f08b659c640 1 -- 172.21.15.123:0/522547915 learned_addr learned my addr 172.21.15.123:0/522547915 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:47.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.276+0000 7f08affff640 1 --2- 172.21.15.123:0/522547915 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08b80b2d40 0x7f08b8157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:47.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.276+0000 7f08b6d9d640 1 --2- 172.21.15.123:0/522547915 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08b813eb20 0x7f08b81543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:47.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.276+0000 7f08b659c640 1 -- 172.21.15.123:0/522547915 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08b813eb20 msgr2=0x7f08b81543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:47.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.276+0000 7f08b659c640 1 --2- 172.21.15.123:0/522547915 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08b813eb20 0x7f08b81543c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:47.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.276+0000 7f08b659c640 1 -- 172.21.15.123:0/522547915 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08b80b2d40 msgr2=0x7f08b8157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:47.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.276+0000 7f08b659c640 1 --2- 172.21.15.123:0/522547915 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08b80b2d40 0x7f08b8157a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:47.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.276+0000 7f08b659c640 1 -- 172.21.15.123:0/522547915 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b8154900 con 0x7f08b806c320 2024-09-15T23:12:47.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.276+0000 7f08b6d9d640 1 --2- 172.21.15.123:0/522547915 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08b813eb20 0x7f08b81543c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:47.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.276+0000 7f08b659c640 1 --2- 172.21.15.123:0/522547915 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08b806c320 0x7f08b81587f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f08a800c500 tx=0x7f08a800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:47.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.276+0000 7f08aeffd640 1 -- 172.21.15.123:0/522547915 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a8018070 con 0x7f08b806c320 2024-09-15T23:12:47.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.276+0000 7f08aeffd640 1 -- 172.21.15.123:0/522547915 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08a8007580 con 0x7f08b806c320 2024-09-15T23:12:47.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.276+0000 7f08aeffd640 1 -- 172.21.15.123:0/522547915 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a8004a20 con 0x7f08b806c320 2024-09-15T23:12:47.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.276+0000 7f08bcb03640 1 -- 172.21.15.123:0/522547915 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08b8158ed0 con 0x7f08b806c320 2024-09-15T23:12:47.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.276+0000 7f08bcb03640 1 -- 172.21.15.123:0/522547915 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08b8159490 con 0x7f08b806c320 2024-09-15T23:12:47.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.277+0000 7f08bcb03640 1 -- 172.21.15.123:0/522547915 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08b806bc10 con 0x7f08b806c320 2024-09-15T23:12:47.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.278+0000 7f08aeffd640 1 -- 172.21.15.123:0/522547915 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f08a801b070 con 0x7f08b806c320 2024-09-15T23:12:47.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.278+0000 7f08aeffd640 1 --2- 172.21.15.123:0/522547915 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f089806c2b0 0x7f089806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:47.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.278+0000 7f08aeffd640 1 -- 172.21.15.123:0/522547915 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f08a808a350 con 0x7f08b806c320 2024-09-15T23:12:47.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.278+0000 7f08affff640 1 --2- 172.21.15.123:0/522547915 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f089806c2b0 0x7f089806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:47.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.279+0000 7f08affff640 1 --2- 172.21.15.123:0/522547915 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f089806c2b0 0x7f089806e770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f08a0037000 tx=0x7f08a0032000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:47.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.282+0000 7f08aeffd640 1 -- 172.21.15.123:0/522547915 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f08b8154900 con 0x7f08b806c320 2024-09-15T23:12:47.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.523+0000 7f08bcb03640 1 -- 172.21.15.123:0/522547915 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f08b806c9c0 con 0x7f08b806c320 2024-09-15T23:12:47.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.525+0000 7f08aeffd640 1 -- 172.21.15.123:0/522547915 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f08a8058ea0 con 0x7f08b806c320 2024-09-15T23:12:47.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.526+0000 7f08bcb03640 1 -- 172.21.15.123:0/522547915 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f089806c2b0 msgr2=0x7f089806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:47.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.526+0000 7f08bcb03640 1 --2- 172.21.15.123:0/522547915 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f089806c2b0 0x7f089806e770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f08a0037000 tx=0x7f08a0032000 comp rx=0 tx=0).stop 2024-09-15T23:12:47.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.526+0000 7f08bcb03640 1 -- 172.21.15.123:0/522547915 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08b806c320 msgr2=0x7f08b81587f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:47.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.526+0000 7f08bcb03640 1 --2- 172.21.15.123:0/522547915 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08b806c320 0x7f08b81587f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f08a800c500 tx=0x7f08a800c9c0 comp rx=0 tx=0).stop 2024-09-15T23:12:47.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.527+0000 7f08bcb03640 1 -- 172.21.15.123:0/522547915 shutdown_connections 2024-09-15T23:12:47.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.527+0000 7f08bcb03640 1 --2- 172.21.15.123:0/522547915 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08b813eb20 0x7f08b81543c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:47.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.527+0000 7f08bcb03640 1 --2- 172.21.15.123:0/522547915 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f08b80b2d40 0x7f08b8157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:47.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.527+0000 7f08bcb03640 1 --2- 172.21.15.123:0/522547915 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f089806c2b0 0x7f089806e770 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:47.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.527+0000 7f08bcb03640 1 --2- 172.21.15.123:0/522547915 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08b806c320 0x7f08b81587f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:47.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.527+0000 7f08bcb03640 1 -- 172.21.15.123:0/522547915 >> 172.21.15.123:0/522547915 conn(0x7f08b80ccec0 msgr2=0x7f08b8156120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:47.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.527+0000 7f08bcb03640 1 -- 172.21.15.123:0/522547915 shutdown_connections 2024-09-15T23:12:47.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.527+0000 7f08bcb03640 1 -- 172.21.15.123:0/522547915 wait complete. 2024-09-15T23:12:47.538 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-15T23:12:47.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.638+0000 7f5f23e5e640 1 Processor -- start 2024-09-15T23:12:47.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.638+0000 7f5f23e5e640 1 -- start start 2024-09-15T23:12:47.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.639+0000 7f5f23e5e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5f1c0d1da0 0x7f5f1c0cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:47.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.639+0000 7f5f23e5e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f1c0d47e0 con 0x7f5f1c15e950 2024-09-15T23:12:47.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.639+0000 7f5f23e5e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f1c0d4a80 con 0x7f5f1c0cf7f0 2024-09-15T23:12:47.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.639+0000 7f5f23e5e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f5f1c15ed30 con 0x7f5f1c0d1da0 2024-09-15T23:12:47.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.639+0000 7f5f213f9640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5f1c0d1da0 0x7f5f1c0cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:47.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.639+0000 7f5f213f9640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5f1c0d1da0 0x7f5f1c0cf2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54956/0 (socket says 172.21.15.123:54956) 2024-09-15T23:12:47.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.639+0000 7f5f213f9640 1 -- 172.21.15.123:0/2217064786 learned_addr learned my addr 172.21.15.123:0/2217064786 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:47.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.639+0000 7f5f21bfa640 1 --1- 172.21.15.123:0/2217064786 >> v1:172.21.15.123:6789/0 conn(0x7f5f1c15e950 0x7f5f1c0d1690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41142/0 (socket says 172.21.15.123:41142) 2024-09-15T23:12:47.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.639+0000 7f5f213f9640 1 -- 172.21.15.123:0/2217064786 >> v1:172.21.15.188:6789/0 conn(0x7f5f1c0cf7f0 legacy=0x7f5f1c0b77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:47.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.639+0000 7f5f213f9640 1 -- 172.21.15.123:0/2217064786 >> v1:172.21.15.123:6789/0 conn(0x7f5f1c15e950 legacy=0x7f5f1c0d1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:47.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.639+0000 7f5f213f9640 1 -- 172.21.15.123:0/2217064786 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f1c0d4d60 con 0x7f5f1c0d1da0 2024-09-15T23:12:47.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.640+0000 7f5f213f9640 1 --2- 172.21.15.123:0/2217064786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f1c0d1da0 0x7f5f1c0cf2b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c009870 tx=0x7f5f0c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=442087d856ec18ea server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:47.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.640+0000 7f5f20bf8640 1 -- 172.21.15.123:0/2217064786 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c037070 con 0x7f5f1c0d1da0 2024-09-15T23:12:47.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.640+0000 7f5f20bf8640 1 -- 172.21.15.123:0/2217064786 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f0c032440 con 0x7f5f1c0d1da0 2024-09-15T23:12:47.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.640+0000 7f5f20bf8640 1 -- 172.21.15.123:0/2217064786 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c032810 con 0x7f5f1c0d1da0 2024-09-15T23:12:47.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.641+0000 7f5f23e5e640 1 -- 172.21.15.123:0/2217064786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f1c0d1da0 msgr2=0x7f5f1c0cf2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:47.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.641+0000 7f5f23e5e640 1 --2- 172.21.15.123:0/2217064786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f1c0d1da0 0x7f5f1c0cf2b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c009870 tx=0x7f5f0c02a210 comp rx=0 tx=0).stop 2024-09-15T23:12:47.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.641+0000 7f5f23e5e640 1 -- 172.21.15.123:0/2217064786 shutdown_connections 2024-09-15T23:12:47.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.641+0000 7f5f23e5e640 1 --2- 172.21.15.123:0/2217064786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f1c0d1da0 0x7f5f1c0cf2b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:47.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.641+0000 7f5f23e5e640 1 -- 172.21.15.123:0/2217064786 >> 172.21.15.123:0/2217064786 conn(0x7f5f1c067b30 msgr2=0x7f5f1c067f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:47.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.641+0000 7f5f23e5e640 1 -- 172.21.15.123:0/2217064786 shutdown_connections 2024-09-15T23:12:47.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.641+0000 7f5f23e5e640 1 -- 172.21.15.123:0/2217064786 wait complete. 2024-09-15T23:12:47.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.642+0000 7f5f23e5e640 1 Processor -- start 2024-09-15T23:12:47.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.642+0000 7f5f23e5e640 1 -- start start 2024-09-15T23:12:47.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.643+0000 7f5f23e5e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5f1c0cf7f0 0x7f5f1c0cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:47.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.643+0000 7f5f23e5e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f1c0d1da0 0x7f5f1c14bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:47.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.643+0000 7f5f23e5e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5f1c15e950 0x7f5f1c0d2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:47.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.643+0000 7f5f23e5e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5f1c0cfde0 con 0x7f5f1c0d1da0 2024-09-15T23:12:47.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.643+0000 7f5f23e5e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5f1c0cfc60 con 0x7f5f1c0cf7f0 2024-09-15T23:12:47.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.643+0000 7f5f23e5e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5f1c0b7ee0 con 0x7f5f1c15e950 2024-09-15T23:12:47.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.643+0000 7f5f213f9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f1c0d1da0 0x7f5f1c14bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:47.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.643+0000 7f5f213f9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f1c0d1da0 0x7f5f1c14bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54966/0 (socket says 172.21.15.123:54966) 2024-09-15T23:12:47.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.643+0000 7f5f213f9640 1 -- 172.21.15.123:0/4000992339 learned_addr learned my addr 172.21.15.123:0/4000992339 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:47.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.643+0000 7f5f21bfa640 1 --2- 172.21.15.123:0/4000992339 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5f1c0cf7f0 0x7f5f1c0cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:47.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.644+0000 7f5f213f9640 1 -- 172.21.15.123:0/4000992339 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5f1c15e950 msgr2=0x7f5f1c0d2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:47.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.644+0000 7f5f223fb640 1 --2- 172.21.15.123:0/4000992339 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5f1c15e950 0x7f5f1c0d2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:47.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.644+0000 7f5f213f9640 1 --2- 172.21.15.123:0/4000992339 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5f1c15e950 0x7f5f1c0d2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:47.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.644+0000 7f5f213f9640 1 -- 172.21.15.123:0/4000992339 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5f1c0cf7f0 msgr2=0x7f5f1c0cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:47.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.644+0000 7f5f213f9640 1 --2- 172.21.15.123:0/4000992339 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5f1c0cf7f0 0x7f5f1c0cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:47.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.644+0000 7f5f213f9640 1 -- 172.21.15.123:0/4000992339 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f1c14c2e0 con 0x7f5f1c0d1da0 2024-09-15T23:12:47.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.644+0000 7f5f21bfa640 1 --2- 172.21.15.123:0/4000992339 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5f1c0cf7f0 0x7f5f1c0cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:47.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.644+0000 7f5f223fb640 1 --2- 172.21.15.123:0/4000992339 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5f1c15e950 0x7f5f1c0d2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:47.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.644+0000 7f5f213f9640 1 --2- 172.21.15.123:0/4000992339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f1c0d1da0 0x7f5f1c14bda0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c009870 tx=0x7f5f0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:47.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.644+0000 7f5f127fc640 1 -- 172.21.15.123:0/4000992339 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c041020 con 0x7f5f1c0d1da0 2024-09-15T23:12:47.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.644+0000 7f5f127fc640 1 -- 172.21.15.123:0/4000992339 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f0c030970 con 0x7f5f1c0d1da0 2024-09-15T23:12:47.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.644+0000 7f5f127fc640 1 -- 172.21.15.123:0/4000992339 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c037040 con 0x7f5f1c0d1da0 2024-09-15T23:12:47.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.644+0000 7f5f23e5e640 1 -- 172.21.15.123:0/4000992339 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f1c159e30 con 0x7f5f1c0d1da0 2024-09-15T23:12:47.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.644+0000 7f5f23e5e640 1 -- 172.21.15.123:0/4000992339 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f1c1f5300 con 0x7f5f1c0d1da0 2024-09-15T23:12:47.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.645+0000 7f5f23e5e640 1 -- 172.21.15.123:0/4000992339 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f1c0cf2b0 con 0x7f5f1c0d1da0 2024-09-15T23:12:47.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.646+0000 7f5f127fc640 1 -- 172.21.15.123:0/4000992339 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5f0c044020 con 0x7f5f1c0d1da0 2024-09-15T23:12:47.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.646+0000 7f5f127fc640 1 --2- 172.21.15.123:0/4000992339 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5f0006c2e0 0x7f5f0006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:47.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.646+0000 7f5f127fc640 1 -- 172.21.15.123:0/4000992339 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f5f0c0ab740 con 0x7f5f1c0d1da0 2024-09-15T23:12:47.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.646+0000 7f5f21bfa640 1 --2- 172.21.15.123:0/4000992339 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5f0006c2e0 0x7f5f0006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:47.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.647+0000 7f5f21bfa640 1 --2- 172.21.15.123:0/4000992339 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5f0006c2e0 0x7f5f0006e7a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5f18000f60 tx=0x7f5f18009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:47.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.650+0000 7f5f127fc640 1 -- 172.21.15.123:0/4000992339 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5f0c04b070 con 0x7f5f1c0d1da0 2024-09-15T23:12:47.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.888+0000 7f5f23e5e640 1 -- 172.21.15.123:0/4000992339 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f5f1c0b50b0 con 0x7f5f1c0d1da0 2024-09-15T23:12:47.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.890+0000 7f5f127fc640 1 -- 172.21.15.123:0/4000992339 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f5f1c14c2e0 con 0x7f5f1c0d1da0 2024-09-15T23:12:47.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.892+0000 7f5f23e5e640 1 -- 172.21.15.123:0/4000992339 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5f0006c2e0 msgr2=0x7f5f0006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:47.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.892+0000 7f5f23e5e640 1 --2- 172.21.15.123:0/4000992339 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5f0006c2e0 0x7f5f0006e7a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5f18000f60 tx=0x7f5f18009040 comp rx=0 tx=0).stop 2024-09-15T23:12:47.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.892+0000 7f5f23e5e640 1 -- 172.21.15.123:0/4000992339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f1c0d1da0 msgr2=0x7f5f1c14bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:47.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.892+0000 7f5f23e5e640 1 --2- 172.21.15.123:0/4000992339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f1c0d1da0 0x7f5f1c14bda0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c009870 tx=0x7f5f0c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:12:47.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.892+0000 7f5f23e5e640 1 -- 172.21.15.123:0/4000992339 shutdown_connections 2024-09-15T23:12:47.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.892+0000 7f5f23e5e640 1 --2- 172.21.15.123:0/4000992339 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5f1c15e950 0x7f5f1c0d2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:47.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.892+0000 7f5f23e5e640 1 --2- 172.21.15.123:0/4000992339 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5f0006c2e0 0x7f5f0006e7a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:47.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.892+0000 7f5f23e5e640 1 --2- 172.21.15.123:0/4000992339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f1c0d1da0 0x7f5f1c14bda0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:47.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.892+0000 7f5f23e5e640 1 --2- 172.21.15.123:0/4000992339 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5f1c0cf7f0 0x7f5f1c0cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:47.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.892+0000 7f5f23e5e640 1 -- 172.21.15.123:0/4000992339 >> 172.21.15.123:0/4000992339 conn(0x7f5f1c067b30 msgr2=0x7f5f1c0b98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:47.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.892+0000 7f5f23e5e640 1 -- 172.21.15.123:0/4000992339 shutdown_connections 2024-09-15T23:12:47.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:47.892+0000 7f5f23e5e640 1 -- 172.21.15.123:0/4000992339 wait complete. 2024-09-15T23:12:47.903 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-15T23:12:48.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.003+0000 7efc62c8d640 1 Processor -- start 2024-09-15T23:12:48.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.003+0000 7efc62c8d640 1 -- start start 2024-09-15T23:12:48.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.004+0000 7efc62c8d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7efc5c06c320 0x7efc5c15bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:48.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.004+0000 7efc62c8d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efc5c13eb20 0x7efc5c15c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:48.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.004+0000 7efc62c8d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc5c071180 con 0x7efc5c0b2d40 2024-09-15T23:12:48.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.004+0000 7efc62c8d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7efc5c071ab0 con 0x7efc5c13eb20 2024-09-15T23:12:48.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.004+0000 7efc62c8d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7efc5c071460 con 0x7efc5c06c320 2024-09-15T23:12:48.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.004+0000 7efc6122a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efc5c13eb20 0x7efc5c15c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:48.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.004+0000 7efc60a29640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7efc5c0b2d40 0x7efc5c06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41158/0 (socket says 172.21.15.123:41158) 2024-09-15T23:12:48.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.004+0000 7efc6122a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efc5c13eb20 0x7efc5c15c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54978/0 (socket says 172.21.15.123:54978) 2024-09-15T23:12:48.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.004+0000 7efc60a29640 1 -- 172.21.15.123:0/1160728278 learned_addr learned my addr 172.21.15.123:0/1160728278 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:48.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.004+0000 7efc53fff640 1 --2- 172.21.15.123:0/1160728278 >> v2:172.21.15.188:3300/0 conn(0x7efc5c06c320 0x7efc5c15bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:48.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.004+0000 7efc6122a640 1 -- 172.21.15.123:0/1160728278 >> v2:172.21.15.188:3300/0 conn(0x7efc5c06c320 msgr2=0x7efc5c15bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:48.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.004+0000 7efc6122a640 1 --2- 172.21.15.123:0/1160728278 >> v2:172.21.15.188:3300/0 conn(0x7efc5c06c320 0x7efc5c15bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:48.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.004+0000 7efc6122a640 1 -- 172.21.15.123:0/1160728278 >> v1:172.21.15.123:6789/0 conn(0x7efc5c0b2d40 legacy=0x7efc5c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:48.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.004+0000 7efc6122a640 1 -- 172.21.15.123:0/1160728278 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc5c071740 con 0x7efc5c13eb20 2024-09-15T23:12:48.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.004+0000 7efc537fe640 1 -- 172.21.15.123:0/1160728278 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 874180702 0 0) 0x7efc5c071180 con 0x7efc5c0b2d40 2024-09-15T23:12:48.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.005+0000 7efc6122a640 1 --2- 172.21.15.123:0/1160728278 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc5c13eb20 0x7efc5c15c230 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efc5c0d1500 tx=0x7efc5402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=926942f2afb1d352 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:48.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.005+0000 7efc537fe640 1 -- 172.21.15.123:0/1160728278 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc54007740 con 0x7efc5c13eb20 2024-09-15T23:12:48.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.005+0000 7efc537fe640 1 -- 172.21.15.123:0/1160728278 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc540078e0 con 0x7efc5c13eb20 2024-09-15T23:12:48.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.005+0000 7efc537fe640 1 -- 172.21.15.123:0/1160728278 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc54007cb0 con 0x7efc5c13eb20 2024-09-15T23:12:48.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.006+0000 7efc62c8d640 1 -- 172.21.15.123:0/1160728278 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc5c13eb20 msgr2=0x7efc5c15c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:48.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.006+0000 7efc62c8d640 1 --2- 172.21.15.123:0/1160728278 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc5c13eb20 0x7efc5c15c230 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efc5c0d1500 tx=0x7efc5402a680 comp rx=0 tx=0).stop 2024-09-15T23:12:48.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.006+0000 7efc62c8d640 1 -- 172.21.15.123:0/1160728278 shutdown_connections 2024-09-15T23:12:48.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.006+0000 7efc62c8d640 1 --2- 172.21.15.123:0/1160728278 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc5c13eb20 0x7efc5c15c230 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:48.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.006+0000 7efc62c8d640 1 --2- 172.21.15.123:0/1160728278 >> v2:172.21.15.188:3300/0 conn(0x7efc5c06c320 0x7efc5c15bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:48.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.006+0000 7efc62c8d640 1 -- 172.21.15.123:0/1160728278 >> 172.21.15.123:0/1160728278 conn(0x7efc5c0ccec0 msgr2=0x7efc5c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:48.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.006+0000 7efc62c8d640 1 -- 172.21.15.123:0/1160728278 shutdown_connections 2024-09-15T23:12:48.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.006+0000 7efc62c8d640 1 -- 172.21.15.123:0/1160728278 wait complete. 2024-09-15T23:12:48.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.007+0000 7efc62c8d640 1 Processor -- start 2024-09-15T23:12:48.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.007+0000 7efc62c8d640 1 -- start start 2024-09-15T23:12:48.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.008+0000 7efc62c8d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc5c06c320 0x7efc5c0cf370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:48.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.008+0000 7efc62c8d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc5c0b2d40 0x7efc5c0cf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:48.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.008+0000 7efc62c8d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc5c13eb20 0x7efc5c1548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:48.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.008+0000 7efc62c8d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efc5c0720c0 con 0x7efc5c06c320 2024-09-15T23:12:48.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.008+0000 7efc62c8d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7efc5c071f40 con 0x7efc5c13eb20 2024-09-15T23:12:48.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.008+0000 7efc62c8d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7efc5c072240 con 0x7efc5c0b2d40 2024-09-15T23:12:48.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.008+0000 7efc60a29640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc5c06c320 0x7efc5c0cf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:48.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.008+0000 7efc60a29640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc5c06c320 0x7efc5c0cf370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54994/0 (socket says 172.21.15.123:54994) 2024-09-15T23:12:48.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.008+0000 7efc60a29640 1 -- 172.21.15.123:0/4081510835 learned_addr learned my addr 172.21.15.123:0/4081510835 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:48.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.008+0000 7efc6122a640 1 --2- 172.21.15.123:0/4081510835 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc5c13eb20 0x7efc5c1548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:48.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.008+0000 7efc53fff640 1 --2- 172.21.15.123:0/4081510835 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc5c0b2d40 0x7efc5c0cf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:48.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.008+0000 7efc60a29640 1 -- 172.21.15.123:0/4081510835 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc5c0b2d40 msgr2=0x7efc5c0cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:48.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.008+0000 7efc60a29640 1 --2- 172.21.15.123:0/4081510835 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc5c0b2d40 0x7efc5c0cf8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:48.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.008+0000 7efc60a29640 1 -- 172.21.15.123:0/4081510835 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc5c13eb20 msgr2=0x7efc5c1548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:48.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.008+0000 7efc60a29640 1 --2- 172.21.15.123:0/4081510835 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc5c13eb20 0x7efc5c1548f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:48.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.008+0000 7efc60a29640 1 -- 172.21.15.123:0/4081510835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc5c0b5be0 con 0x7efc5c06c320 2024-09-15T23:12:48.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.008+0000 7efc53fff640 1 --2- 172.21.15.123:0/4081510835 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc5c0b2d40 0x7efc5c0cf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:48.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.008+0000 7efc60a29640 1 --2- 172.21.15.123:0/4081510835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc5c06c320 0x7efc5c0cf370 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efc5800c4d0 tx=0x7efc5800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:48.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.008+0000 7efc517fa640 1 -- 172.21.15.123:0/4081510835 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc58018070 con 0x7efc5c06c320 2024-09-15T23:12:48.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.008+0000 7efc517fa640 1 -- 172.21.15.123:0/4081510835 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc58007500 con 0x7efc5c06c320 2024-09-15T23:12:48.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.008+0000 7efc62c8d640 1 -- 172.21.15.123:0/4081510835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc5c1596f0 con 0x7efc5c06c320 2024-09-15T23:12:48.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.008+0000 7efc517fa640 1 -- 172.21.15.123:0/4081510835 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc58004a20 con 0x7efc5c06c320 2024-09-15T23:12:48.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.008+0000 7efc62c8d640 1 -- 172.21.15.123:0/4081510835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc5c0b5900 con 0x7efc5c06c320 2024-09-15T23:12:48.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.010+0000 7efc62c8d640 1 -- 172.21.15.123:0/4081510835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc5c071280 con 0x7efc5c06c320 2024-09-15T23:12:48.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.010+0000 7efc517fa640 1 -- 172.21.15.123:0/4081510835 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7efc5801b070 con 0x7efc5c06c320 2024-09-15T23:12:48.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.010+0000 7efc517fa640 1 --2- 172.21.15.123:0/4081510835 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efc4806c2e0 0x7efc4806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:48.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.010+0000 7efc517fa640 1 -- 172.21.15.123:0/4081510835 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7efc5808a2f0 con 0x7efc5c06c320 2024-09-15T23:12:48.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.011+0000 7efc53fff640 1 --2- 172.21.15.123:0/4081510835 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efc4806c2e0 0x7efc4806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:48.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.011+0000 7efc53fff640 1 --2- 172.21.15.123:0/4081510835 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efc4806c2e0 0x7efc4806e7a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efc5c13e770 tx=0x7efc4c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:48.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.015+0000 7efc517fa640 1 -- 172.21.15.123:0/4081510835 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efc5c071280 con 0x7efc5c06c320 2024-09-15T23:12:48.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.244+0000 7efc62c8d640 1 -- 172.21.15.123:0/4081510835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7efc5c06c9c0 con 0x7efc5c06c320 2024-09-15T23:12:48.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.246+0000 7efc517fa640 1 -- 172.21.15.123:0/4081510835 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7efc580587f0 con 0x7efc5c06c320 2024-09-15T23:12:48.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.249+0000 7efc62c8d640 1 -- 172.21.15.123:0/4081510835 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efc4806c2e0 msgr2=0x7efc4806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:48.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.249+0000 7efc62c8d640 1 --2- 172.21.15.123:0/4081510835 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efc4806c2e0 0x7efc4806e7a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7efc5c13e770 tx=0x7efc4c008040 comp rx=0 tx=0).stop 2024-09-15T23:12:48.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.249+0000 7efc62c8d640 1 -- 172.21.15.123:0/4081510835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc5c06c320 msgr2=0x7efc5c0cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:48.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.249+0000 7efc62c8d640 1 --2- 172.21.15.123:0/4081510835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc5c06c320 0x7efc5c0cf370 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efc5800c4d0 tx=0x7efc5800c990 comp rx=0 tx=0).stop 2024-09-15T23:12:48.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.249+0000 7efc62c8d640 1 -- 172.21.15.123:0/4081510835 shutdown_connections 2024-09-15T23:12:48.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.249+0000 7efc62c8d640 1 --2- 172.21.15.123:0/4081510835 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc5c13eb20 0x7efc5c1548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:48.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.249+0000 7efc62c8d640 1 --2- 172.21.15.123:0/4081510835 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc5c0b2d40 0x7efc5c0cf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:48.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.249+0000 7efc62c8d640 1 --2- 172.21.15.123:0/4081510835 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efc4806c2e0 0x7efc4806e7a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:48.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.249+0000 7efc62c8d640 1 --2- 172.21.15.123:0/4081510835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc5c06c320 0x7efc5c0cf370 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:48.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.249+0000 7efc62c8d640 1 -- 172.21.15.123:0/4081510835 >> 172.21.15.123:0/4081510835 conn(0x7efc5c0ccec0 msgr2=0x7efc5c13f950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:48.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.249+0000 7efc62c8d640 1 -- 172.21.15.123:0/4081510835 shutdown_connections 2024-09-15T23:12:48.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.249+0000 7efc62c8d640 1 -- 172.21.15.123:0/4081510835 wait complete. 2024-09-15T23:12:48.260 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-15T23:12:48.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.358+0000 7f2837482640 1 Processor -- start 2024-09-15T23:12:48.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.359+0000 7f2837482640 1 -- start start 2024-09-15T23:12:48.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.359+0000 7f2837482640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f283015ed20 0x7f28300b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:48.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.359+0000 7f2837482640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f28300b90e0 0x7f28300b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:48.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.359+0000 7f2837482640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28300d0e70 con 0x7f28300d23b0 2024-09-15T23:12:48.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.359+0000 7f2837482640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f28300d41c0 con 0x7f28300b90e0 2024-09-15T23:12:48.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.359+0000 7f2837482640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f28300d35b0 con 0x7f283015ed20 2024-09-15T23:12:48.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.360+0000 7f2835a1f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f28300b90e0 0x7f28300b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:48.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.360+0000 7f2835a1f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f28300b90e0 0x7f28300b67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55006/0 (socket says 172.21.15.123:55006) 2024-09-15T23:12:48.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.360+0000 7f2835a1f640 1 -- 172.21.15.123:0/947712496 learned_addr learned my addr 172.21.15.123:0/947712496 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:48.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.360+0000 7f283521e640 1 --2- 172.21.15.123:0/947712496 >> v2:172.21.15.188:3300/0 conn(0x7f283015ed20 0x7f28300b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:48.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.360+0000 7f2835a1f640 1 -- 172.21.15.123:0/947712496 >> v2:172.21.15.188:3300/0 conn(0x7f283015ed20 msgr2=0x7f28300b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:48.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.360+0000 7f2835a1f640 1 --2- 172.21.15.123:0/947712496 >> v2:172.21.15.188:3300/0 conn(0x7f283015ed20 0x7f28300b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:48.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.360+0000 7f2835a1f640 1 -- 172.21.15.123:0/947712496 >> v1:172.21.15.188:6789/0 conn(0x7f28300d23b0 legacy=0x7f28300cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:48.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.360+0000 7f2835a1f640 1 -- 172.21.15.123:0/947712496 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28300d3890 con 0x7f28300b90e0 2024-09-15T23:12:48.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.360+0000 7f283521e640 1 --2- 172.21.15.123:0/947712496 >> v2:172.21.15.188:3300/0 conn(0x7f283015ed20 0x7f28300b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:48.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.361+0000 7f2835a1f640 1 --2- 172.21.15.123:0/947712496 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28300b90e0 0x7f28300b67a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f28300d47b0 tx=0x7f282c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d386a8c10d57436 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:48.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.361+0000 7f2827fff640 1 -- 172.21.15.123:0/947712496 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f282c037070 con 0x7f28300b90e0 2024-09-15T23:12:48.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.361+0000 7f2827fff640 1 -- 172.21.15.123:0/947712496 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f282c032440 con 0x7f28300b90e0 2024-09-15T23:12:48.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.361+0000 7f2827fff640 1 -- 172.21.15.123:0/947712496 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f282c032810 con 0x7f28300b90e0 2024-09-15T23:12:48.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.361+0000 7f2837482640 1 -- 172.21.15.123:0/947712496 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28300b90e0 msgr2=0x7f28300b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:48.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.361+0000 7f2837482640 1 --2- 172.21.15.123:0/947712496 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28300b90e0 0x7f28300b67a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f28300d47b0 tx=0x7f282c02a1a0 comp rx=0 tx=0).stop 2024-09-15T23:12:48.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.361+0000 7f2837482640 1 -- 172.21.15.123:0/947712496 shutdown_connections 2024-09-15T23:12:48.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.361+0000 7f2837482640 1 --2- 172.21.15.123:0/947712496 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f28300b90e0 0x7f28300b67a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:48.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.361+0000 7f2837482640 1 --2- 172.21.15.123:0/947712496 >> v2:172.21.15.188:3300/0 conn(0x7f283015ed20 0x7f28300b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:48.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.361+0000 7f2837482640 1 -- 172.21.15.123:0/947712496 >> 172.21.15.123:0/947712496 conn(0x7f28300d1260 msgr2=0x7f28300d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:48.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.361+0000 7f2837482640 1 -- 172.21.15.123:0/947712496 shutdown_connections 2024-09-15T23:12:48.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.361+0000 7f2837482640 1 -- 172.21.15.123:0/947712496 wait complete. 2024-09-15T23:12:48.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.363+0000 7f2837482640 1 Processor -- start 2024-09-15T23:12:48.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.363+0000 7f2837482640 1 -- start start 2024-09-15T23:12:48.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.363+0000 7f2837482640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f28300b90e0 0x7f28300ca820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:48.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.363+0000 7f2837482640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f28300d23b0 0x7f28301f57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:48.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.363+0000 7f2837482640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f283015ed20 0x7f28300b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:48.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.363+0000 7f2837482640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f28300d32a0 con 0x7f283015ed20 2024-09-15T23:12:48.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.363+0000 7f2837482640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f28300d3e50 con 0x7f28300b90e0 2024-09-15T23:12:48.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.363+0000 7f2837482640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f283015f100 con 0x7f28300d23b0 2024-09-15T23:12:48.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.363+0000 7f2835a1f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f283015ed20 0x7f28300b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:48.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.363+0000 7f2835a1f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f283015ed20 0x7f28300b23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55008/0 (socket says 172.21.15.123:55008) 2024-09-15T23:12:48.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.363+0000 7f2835a1f640 1 -- 172.21.15.123:0/2957360931 learned_addr learned my addr 172.21.15.123:0/2957360931 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:48.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.364+0000 7f2834a1d640 1 --2- 172.21.15.123:0/2957360931 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f28300d23b0 0x7f28301f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:48.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.364+0000 7f283521e640 1 --2- 172.21.15.123:0/2957360931 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f28300b90e0 0x7f28300ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:48.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.364+0000 7f2835a1f640 1 -- 172.21.15.123:0/2957360931 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f28300d23b0 msgr2=0x7f28301f57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:48.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.364+0000 7f2835a1f640 1 --2- 172.21.15.123:0/2957360931 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f28300d23b0 0x7f28301f57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:48.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.364+0000 7f2835a1f640 1 -- 172.21.15.123:0/2957360931 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f28300b90e0 msgr2=0x7f28300ca820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:48.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.364+0000 7f2835a1f640 1 --2- 172.21.15.123:0/2957360931 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f28300b90e0 0x7f28300ca820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:48.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.364+0000 7f2835a1f640 1 -- 172.21.15.123:0/2957360931 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28301f5000 con 0x7f283015ed20 2024-09-15T23:12:48.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.364+0000 7f2835a1f640 1 --2- 172.21.15.123:0/2957360931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f283015ed20 0x7f28300b23d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f282c0090b0 tx=0x7f282c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:48.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.364+0000 7f2825ffb640 1 -- 172.21.15.123:0/2957360931 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f282c041020 con 0x7f283015ed20 2024-09-15T23:12:48.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.364+0000 7f2825ffb640 1 -- 172.21.15.123:0/2957360931 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f282c030990 con 0x7f283015ed20 2024-09-15T23:12:48.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.364+0000 7f2837482640 1 -- 172.21.15.123:0/2957360931 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28300cc380 con 0x7f283015ed20 2024-09-15T23:12:48.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.364+0000 7f2825ffb640 1 -- 172.21.15.123:0/2957360931 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f282c037040 con 0x7f283015ed20 2024-09-15T23:12:48.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.364+0000 7f2837482640 1 -- 172.21.15.123:0/2957360931 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28300cc940 con 0x7f283015ed20 2024-09-15T23:12:48.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.365+0000 7f2837482640 1 -- 172.21.15.123:0/2957360931 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28300b7010 con 0x7f283015ed20 2024-09-15T23:12:48.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.366+0000 7f2825ffb640 1 -- 172.21.15.123:0/2957360931 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f282c044020 con 0x7f283015ed20 2024-09-15T23:12:48.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.366+0000 7f2825ffb640 1 --2- 172.21.15.123:0/2957360931 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f281406c2b0 0x7f281406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:48.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.366+0000 7f2825ffb640 1 -- 172.21.15.123:0/2957360931 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f282c0aba60 con 0x7f283015ed20 2024-09-15T23:12:48.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.367+0000 7f283521e640 1 --2- 172.21.15.123:0/2957360931 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f281406c2b0 0x7f281406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:48.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.367+0000 7f283521e640 1 --2- 172.21.15.123:0/2957360931 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f281406c2b0 0x7f281406e770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f28301622a0 tx=0x7f2828008450 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:48.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.371+0000 7f2825ffb640 1 -- 172.21.15.123:0/2957360931 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f282c04b030 con 0x7f283015ed20 2024-09-15T23:12:48.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.600+0000 7f2837482640 1 -- 172.21.15.123:0/2957360931 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f28300d03f0 con 0x7f283015ed20 2024-09-15T23:12:48.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.602+0000 7f2825ffb640 1 -- 172.21.15.123:0/2957360931 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7f28301f5000 con 0x7f283015ed20 2024-09-15T23:12:48.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.604+0000 7f2837482640 1 -- 172.21.15.123:0/2957360931 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f281406c2b0 msgr2=0x7f281406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:48.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.604+0000 7f2837482640 1 --2- 172.21.15.123:0/2957360931 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f281406c2b0 0x7f281406e770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f28301622a0 tx=0x7f2828008450 comp rx=0 tx=0).stop 2024-09-15T23:12:48.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.604+0000 7f2837482640 1 -- 172.21.15.123:0/2957360931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f283015ed20 msgr2=0x7f28300b23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:48.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.604+0000 7f2837482640 1 --2- 172.21.15.123:0/2957360931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f283015ed20 0x7f28300b23d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f282c0090b0 tx=0x7f282c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:12:48.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.604+0000 7f2837482640 1 -- 172.21.15.123:0/2957360931 shutdown_connections 2024-09-15T23:12:48.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.604+0000 7f2837482640 1 --2- 172.21.15.123:0/2957360931 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f281406c2b0 0x7f281406e770 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:48.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.604+0000 7f2837482640 1 --2- 172.21.15.123:0/2957360931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f283015ed20 0x7f28300b23d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:48.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.604+0000 7f2837482640 1 --2- 172.21.15.123:0/2957360931 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f28300d23b0 0x7f28301f57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:48.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.604+0000 7f2837482640 1 --2- 172.21.15.123:0/2957360931 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f28300b90e0 0x7f28300ca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:48.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.604+0000 7f2837482640 1 -- 172.21.15.123:0/2957360931 >> 172.21.15.123:0/2957360931 conn(0x7f28300d1260 msgr2=0x7f28300b6510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:48.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.604+0000 7f2837482640 1 -- 172.21.15.123:0/2957360931 shutdown_connections 2024-09-15T23:12:48.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.604+0000 7f2837482640 1 -- 172.21.15.123:0/2957360931 wait complete. 2024-09-15T23:12:48.616 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-15T23:12:48.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.715+0000 7f0d5661e640 1 Processor -- start 2024-09-15T23:12:48.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.715+0000 7f0d5661e640 1 -- start start 2024-09-15T23:12:48.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.716+0000 7f0d5661e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d5006bc10 0x7f0d5006bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:48.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.716+0000 7f0d5661e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f0d500b3790 0x7f0d501624e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:48.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.716+0000 7f0d5661e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d5006c530 con 0x7f0d500cef60 2024-09-15T23:12:48.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.716+0000 7f0d5661e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f0d500cd690 con 0x7f0d500b3790 2024-09-15T23:12:48.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.716+0000 7f0d5661e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0d500d06f0 con 0x7f0d5006bc10 2024-09-15T23:12:48.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.716+0000 7f0d4f7fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f0d500cef60 0x7f0d5015eb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41174/0 (socket says 172.21.15.123:41174) 2024-09-15T23:12:48.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.716+0000 7f0d4f7fe640 1 -- 172.21.15.123:0/3012976464 learned_addr learned my addr 172.21.15.123:0/3012976464 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:48.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.716+0000 7f0d4ffff640 1 --2- 172.21.15.123:0/3012976464 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d5006bc10 0x7f0d5006bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:48.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.716+0000 7f0d54bbb640 1 --2- 172.21.15.123:0/3012976464 >> v2:172.21.15.188:3300/0 conn(0x7f0d500b3790 0x7f0d501624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:48.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.716+0000 7f0d4effd640 1 -- 172.21.15.123:0/3012976464 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2018296610 0 0) 0x7f0d5006c530 con 0x7f0d500cef60 2024-09-15T23:12:48.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.716+0000 7f0d4effd640 1 -- 172.21.15.123:0/3012976464 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d38003520 con 0x7f0d500cef60 2024-09-15T23:12:48.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.716+0000 7f0d4effd640 1 -- 172.21.15.123:0/3012976464 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2299230487 0 0) 0x7f0d38003520 con 0x7f0d500cef60 2024-09-15T23:12:48.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.716+0000 7f0d4effd640 1 -- 172.21.15.123:0/3012976464 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d5006bc10 msgr2=0x7f0d5006bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:48.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.716+0000 7f0d4effd640 1 --2- 172.21.15.123:0/3012976464 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d5006bc10 0x7f0d5006bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:48.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.716+0000 7f0d4effd640 1 -- 172.21.15.123:0/3012976464 >> v2:172.21.15.188:3300/0 conn(0x7f0d500b3790 msgr2=0x7f0d501624e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:48.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.716+0000 7f0d4effd640 1 --2- 172.21.15.123:0/3012976464 >> v2:172.21.15.188:3300/0 conn(0x7f0d500b3790 0x7f0d501624e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:48.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.716+0000 7f0d4effd640 1 -- 172.21.15.123:0/3012976464 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d500b4090 con 0x7f0d500cef60 2024-09-15T23:12:48.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.716+0000 7f0d4effd640 1 -- 172.21.15.123:0/3012976464 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f0d44001670 con 0x7f0d500cef60 2024-09-15T23:12:48.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.716+0000 7f0d4effd640 1 -- 172.21.15.123:0/3012976464 >> v1:172.21.15.123:6789/0 conn(0x7f0d500cef60 legacy=0x7f0d5015eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:48.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.716+0000 7f0d4effd640 1 --2- 172.21.15.123:0/3012976464 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d5006bc10 0x7f0d380039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:48.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.716+0000 7f0d4effd640 1 --2- 172.21.15.123:0/3012976464 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0d38003f60 0x7f0d38004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:48.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.716+0000 7f0d4effd640 1 --2- 172.21.15.123:0/3012976464 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d38004d40 0x7f0d380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:48.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.716+0000 7f0d4effd640 1 -- 172.21.15.123:0/3012976464 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0d500cd690 con 0x7f0d38004d40 2024-09-15T23:12:48.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.716+0000 7f0d4effd640 1 -- 172.21.15.123:0/3012976464 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0d500d06f0 con 0x7f0d38003f60 2024-09-15T23:12:48.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.716+0000 7f0d4effd640 1 -- 172.21.15.123:0/3012976464 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0d3800b9c0 con 0x7f0d5006bc10 2024-09-15T23:12:48.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.716+0000 7f0d54bbb640 1 --2- 172.21.15.123:0/3012976464 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d38004d40 0x7f0d380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:48.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.717+0000 7f0d4f7fe640 1 --2- 172.21.15.123:0/3012976464 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0d38003f60 0x7f0d38004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:48.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.717+0000 7f0d4ffff640 1 --2- 172.21.15.123:0/3012976464 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d5006bc10 0x7f0d380039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:48.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.717+0000 7f0d54bbb640 1 -- 172.21.15.123:0/3012976464 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d5006bc10 msgr2=0x7f0d380039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:48.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.717+0000 7f0d54bbb640 1 --2- 172.21.15.123:0/3012976464 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d5006bc10 0x7f0d380039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:48.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.717+0000 7f0d54bbb640 1 -- 172.21.15.123:0/3012976464 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0d38003f60 msgr2=0x7f0d38004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:48.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.717+0000 7f0d54bbb640 1 --2- 172.21.15.123:0/3012976464 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0d38003f60 0x7f0d38004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:48.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.717+0000 7f0d54bbb640 1 -- 172.21.15.123:0/3012976464 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d38003520 con 0x7f0d38004d40 2024-09-15T23:12:48.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.717+0000 7f0d54bbb640 1 --2- 172.21.15.123:0/3012976464 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d38004d40 0x7f0d380051c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0d48009fc0 tx=0x7f0d38005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f0ec3aa28783ac server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:48.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.718+0000 7f0d4effd640 1 -- 172.21.15.123:0/3012976464 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d48009c10 con 0x7f0d38004d40 2024-09-15T23:12:48.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.718+0000 7f0d4effd640 1 -- 172.21.15.123:0/3012976464 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d48036070 con 0x7f0d38004d40 2024-09-15T23:12:48.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.718+0000 7f0d4effd640 1 -- 172.21.15.123:0/3012976464 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4802d070 con 0x7f0d38004d40 2024-09-15T23:12:48.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.718+0000 7f0d5661e640 1 -- 172.21.15.123:0/3012976464 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d38004d40 msgr2=0x7f0d380051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:48.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.718+0000 7f0d5661e640 1 --2- 172.21.15.123:0/3012976464 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d38004d40 0x7f0d380051c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0d48009fc0 tx=0x7f0d38005830 comp rx=0 tx=0).stop 2024-09-15T23:12:48.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.718+0000 7f0d54bbb640 1 -- 172.21.15.123:0/3012976464 reap_dead start 2024-09-15T23:12:48.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.718+0000 7f0d5661e640 1 -- 172.21.15.123:0/3012976464 shutdown_connections 2024-09-15T23:12:48.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.718+0000 7f0d5661e640 1 -- 172.21.15.123:0/3012976464 >> 172.21.15.123:0/3012976464 conn(0x7f0d5006cd20 msgr2=0x7f0d5006d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:48.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.718+0000 7f0d5661e640 1 -- 172.21.15.123:0/3012976464 shutdown_connections 2024-09-15T23:12:48.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.718+0000 7f0d5661e640 1 -- 172.21.15.123:0/3012976464 wait complete. 2024-09-15T23:12:48.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.719+0000 7f0d5661e640 1 Processor -- start 2024-09-15T23:12:48.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.719+0000 7f0d5661e640 1 -- start start 2024-09-15T23:12:48.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.720+0000 7f0d5661e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d38004d40 0x7f0d50159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:48.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.720+0000 7f0d5661e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0d50157160 0x7f0d500cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:48.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.720+0000 7f0d5661e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d50149240 0x7f0d500cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:48.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.720+0000 7f0d5661e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0d500d0f10 con 0x7f0d38004d40 2024-09-15T23:12:48.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.720+0000 7f0d5661e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0d500d0c30 con 0x7f0d50157160 2024-09-15T23:12:48.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.720+0000 7f0d5661e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0d500b3c40 con 0x7f0d50149240 2024-09-15T23:12:48.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.720+0000 7f0d4ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d38004d40 0x7f0d50159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:48.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.720+0000 7f0d4ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d38004d40 0x7f0d50159f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55030/0 (socket says 172.21.15.123:55030) 2024-09-15T23:12:48.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.720+0000 7f0d4ffff640 1 -- 172.21.15.123:0/3693584437 learned_addr learned my addr 172.21.15.123:0/3693584437 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:48.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.720+0000 7f0d4f7fe640 1 --2- 172.21.15.123:0/3693584437 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0d50157160 0x7f0d500cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:48.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.720+0000 7f0d54bbb640 1 --2- 172.21.15.123:0/3693584437 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d50149240 0x7f0d500cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:48.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.721+0000 7f0d4ffff640 1 -- 172.21.15.123:0/3693584437 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d50149240 msgr2=0x7f0d500cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:48.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.721+0000 7f0d4ffff640 1 --2- 172.21.15.123:0/3693584437 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d50149240 0x7f0d500cc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:48.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.721+0000 7f0d4ffff640 1 -- 172.21.15.123:0/3693584437 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0d50157160 msgr2=0x7f0d500cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:48.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.721+0000 7f0d4ffff640 1 --2- 172.21.15.123:0/3693584437 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0d50157160 0x7f0d500cbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:48.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.721+0000 7f0d4ffff640 1 -- 172.21.15.123:0/3693584437 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d501f7d30 con 0x7f0d38004d40 2024-09-15T23:12:48.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.721+0000 7f0d4ffff640 1 --2- 172.21.15.123:0/3693584437 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d38004d40 0x7f0d50159f40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0d400119d0 tx=0x7f0d40011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:48.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.721+0000 7f0d4cff9640 1 -- 172.21.15.123:0/3693584437 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4000faf0 con 0x7f0d38004d40 2024-09-15T23:12:48.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.721+0000 7f0d4cff9640 1 -- 172.21.15.123:0/3693584437 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d4000fc90 con 0x7f0d38004d40 2024-09-15T23:12:48.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.721+0000 7f0d5661e640 1 -- 172.21.15.123:0/3693584437 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d501f8010 con 0x7f0d38004d40 2024-09-15T23:12:48.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.721+0000 7f0d4cff9640 1 -- 172.21.15.123:0/3693584437 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d40014440 con 0x7f0d38004d40 2024-09-15T23:12:48.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.721+0000 7f0d5661e640 1 -- 172.21.15.123:0/3693584437 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d501f85d0 con 0x7f0d38004d40 2024-09-15T23:12:48.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.722+0000 7f0d5661e640 1 -- 172.21.15.123:0/3693584437 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d5006bff0 con 0x7f0d38004d40 2024-09-15T23:12:48.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.722+0000 7f0d4cff9640 1 -- 172.21.15.123:0/3693584437 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0d40012040 con 0x7f0d38004d40 2024-09-15T23:12:48.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.723+0000 7f0d4cff9640 1 --2- 172.21.15.123:0/3693584437 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0d3c06c2e0 0x7f0d3c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:48.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.723+0000 7f0d4cff9640 1 -- 172.21.15.123:0/3693584437 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7f0d4008b4b0 con 0x7f0d38004d40 2024-09-15T23:12:48.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.723+0000 7f0d4f7fe640 1 --2- 172.21.15.123:0/3693584437 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0d3c06c2e0 0x7f0d3c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:48.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.724+0000 7f0d4f7fe640 1 --2- 172.21.15.123:0/3693584437 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0d3c06c2e0 0x7f0d3c06e7a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0d5006c6d0 tx=0x7f0d44000fa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:48.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.727+0000 7f0d4cff9640 1 -- 172.21.15.123:0/3693584437 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0d40019030 con 0x7f0d38004d40 2024-09-15T23:12:48.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.951+0000 7f0d5661e640 1 -- 172.21.15.123:0/3693584437 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f0d50072f20 con 0x7f0d38004d40 2024-09-15T23:12:48.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.954+0000 7f0d4cff9640 1 -- 172.21.15.123:0/3693584437 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f0d400599b0 con 0x7f0d38004d40 2024-09-15T23:12:48.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.956+0000 7f0d5661e640 1 -- 172.21.15.123:0/3693584437 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0d3c06c2e0 msgr2=0x7f0d3c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:48.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.956+0000 7f0d5661e640 1 --2- 172.21.15.123:0/3693584437 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0d3c06c2e0 0x7f0d3c06e7a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0d5006c6d0 tx=0x7f0d44000fa0 comp rx=0 tx=0).stop 2024-09-15T23:12:48.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.956+0000 7f0d5661e640 1 -- 172.21.15.123:0/3693584437 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d38004d40 msgr2=0x7f0d50159f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:48.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.956+0000 7f0d5661e640 1 --2- 172.21.15.123:0/3693584437 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d38004d40 0x7f0d50159f40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0d400119d0 tx=0x7f0d40011e90 comp rx=0 tx=0).stop 2024-09-15T23:12:48.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.956+0000 7f0d5661e640 1 -- 172.21.15.123:0/3693584437 shutdown_connections 2024-09-15T23:12:48.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.956+0000 7f0d5661e640 1 --2- 172.21.15.123:0/3693584437 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d50149240 0x7f0d500cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:48.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.956+0000 7f0d5661e640 1 --2- 172.21.15.123:0/3693584437 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0d50157160 0x7f0d500cbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:48.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.956+0000 7f0d5661e640 1 --2- 172.21.15.123:0/3693584437 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0d3c06c2e0 0x7f0d3c06e7a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:48.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.956+0000 7f0d5661e640 1 --2- 172.21.15.123:0/3693584437 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d38004d40 0x7f0d50159f40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:48.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.956+0000 7f0d5661e640 1 -- 172.21.15.123:0/3693584437 >> 172.21.15.123:0/3693584437 conn(0x7f0d5006cd20 msgr2=0x7f0d50160080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:48.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.956+0000 7f0d5661e640 1 -- 172.21.15.123:0/3693584437 shutdown_connections 2024-09-15T23:12:48.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:48.956+0000 7f0d5661e640 1 -- 172.21.15.123:0/3693584437 wait complete. 2024-09-15T23:12:48.968 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T23:12:49.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.066+0000 7fc0c2a4c640 1 Processor -- start 2024-09-15T23:12:49.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.066+0000 7fc0c2a4c640 1 -- start start 2024-09-15T23:12:49.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.066+0000 7fc0c2a4c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc0bc0d0200 0x7fc0bc0d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:49.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.066+0000 7fc0c2a4c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc0bc0d1620 0x7fc0bc0d1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:49.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.066+0000 7fc0c2a4c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0bc073400 con 0x7fc0bc15c4f0 2024-09-15T23:12:49.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.066+0000 7fc0c2a4c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fc0bc0d0bb0 con 0x7fc0bc0d0200 2024-09-15T23:12:49.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.066+0000 7fc0c2a4c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc0bc0736e0 con 0x7fc0bc0d1620 2024-09-15T23:12:49.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.067+0000 7fc0c0fe9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc0bc0d1620 0x7fc0bc0d1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:49.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.067+0000 7fc0bb7fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc0bc0d0200 0x7fc0bc0d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:49.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.067+0000 7fc0c0fe9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc0bc0d1620 0x7fc0bc0d1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:52760/0 (socket says 172.21.15.123:52760) 2024-09-15T23:12:49.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.067+0000 7fc0c0fe9640 1 -- 172.21.15.123:0/3412615799 learned_addr learned my addr 172.21.15.123:0/3412615799 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:49.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.067+0000 7fc0bbfff640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fc0bc15c4f0 0x7fc0bc15d4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:33062/0 (socket says 172.21.15.123:33062) 2024-09-15T23:12:49.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.067+0000 7fc0c0fe9640 1 -- 172.21.15.123:0/3412615799 >> v2:172.21.15.188:3300/0 conn(0x7fc0bc0d0200 msgr2=0x7fc0bc0d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:49.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.067+0000 7fc0c0fe9640 1 --2- 172.21.15.123:0/3412615799 >> v2:172.21.15.188:3300/0 conn(0x7fc0bc0d0200 0x7fc0bc0d0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:49.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.067+0000 7fc0c0fe9640 1 -- 172.21.15.123:0/3412615799 >> v1:172.21.15.188:6789/0 conn(0x7fc0bc15c4f0 legacy=0x7fc0bc15d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:49.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.067+0000 7fc0c0fe9640 1 -- 172.21.15.123:0/3412615799 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0bc0739c0 con 0x7fc0bc0d1620 2024-09-15T23:12:49.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.068+0000 7fc0c0fe9640 1 --2- 172.21.15.123:0/3412615799 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc0bc0d1620 0x7fc0bc0d1a70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4009e50 tx=0x7fc0b402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96ab8283d15fac40 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:49.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.068+0000 7fc0baffd640 1 -- 172.21.15.123:0/3412615799 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4036070 con 0x7fc0bc0d1620 2024-09-15T23:12:49.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.068+0000 7fc0baffd640 1 -- 172.21.15.123:0/3412615799 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0b4031600 con 0x7fc0bc0d1620 2024-09-15T23:12:49.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.068+0000 7fc0baffd640 1 -- 172.21.15.123:0/3412615799 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b40319d0 con 0x7fc0bc0d1620 2024-09-15T23:12:49.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.069+0000 7fc0c2a4c640 1 -- 172.21.15.123:0/3412615799 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc0bc0d1620 msgr2=0x7fc0bc0d1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:49.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.069+0000 7fc0c2a4c640 1 --2- 172.21.15.123:0/3412615799 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc0bc0d1620 0x7fc0bc0d1a70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4009e50 tx=0x7fc0b402a710 comp rx=0 tx=0).stop 2024-09-15T23:12:49.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.069+0000 7fc0c2a4c640 1 -- 172.21.15.123:0/3412615799 shutdown_connections 2024-09-15T23:12:49.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.069+0000 7fc0c2a4c640 1 --2- 172.21.15.123:0/3412615799 >> v2:172.21.15.188:3300/0 conn(0x7fc0bc0d0200 0x7fc0bc0d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:49.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.069+0000 7fc0c2a4c640 1 --2- 172.21.15.123:0/3412615799 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc0bc0d1620 0x7fc0bc0d1a70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:49.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.069+0000 7fc0c2a4c640 1 -- 172.21.15.123:0/3412615799 >> 172.21.15.123:0/3412615799 conn(0x7fc0bc06f400 msgr2=0x7fc0bc06f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:49.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.069+0000 7fc0c2a4c640 1 -- 172.21.15.123:0/3412615799 shutdown_connections 2024-09-15T23:12:49.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.069+0000 7fc0c2a4c640 1 -- 172.21.15.123:0/3412615799 wait complete. 2024-09-15T23:12:49.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.070+0000 7fc0c2a4c640 1 Processor -- start 2024-09-15T23:12:49.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.070+0000 7fc0c2a4c640 1 -- start start 2024-09-15T23:12:49.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.071+0000 7fc0c2a4c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc0bc0d0200 0x7fc0bc152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:49.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.071+0000 7fc0c2a4c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc0bc0d1620 0x7fc0bc0acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:49.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.071+0000 7fc0c2a4c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0bc15c4f0 0x7fc0bc0ad040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:49.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.071+0000 7fc0c2a4c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc0bc0d0fa0 con 0x7fc0bc15c4f0 2024-09-15T23:12:49.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.071+0000 7fc0c2a4c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc0bc073f80 con 0x7fc0bc0d1620 2024-09-15T23:12:49.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.071+0000 7fc0c2a4c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc0bc15c8d0 con 0x7fc0bc0d0200 2024-09-15T23:12:49.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.071+0000 7fc0c0fe9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0bc15c4f0 0x7fc0bc0ad040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:49.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.071+0000 7fc0c0fe9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0bc15c4f0 0x7fc0bc0ad040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55042/0 (socket says 172.21.15.123:55042) 2024-09-15T23:12:49.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.071+0000 7fc0c0fe9640 1 -- 172.21.15.123:0/4260716760 learned_addr learned my addr 172.21.15.123:0/4260716760 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:49.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.071+0000 7fc0bbfff640 1 --2- 172.21.15.123:0/4260716760 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc0bc0d0200 0x7fc0bc152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:49.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.071+0000 7fc0bb7fe640 1 --2- 172.21.15.123:0/4260716760 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc0bc0d1620 0x7fc0bc0acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:49.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.071+0000 7fc0c0fe9640 1 -- 172.21.15.123:0/4260716760 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc0bc0d0200 msgr2=0x7fc0bc152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:49.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.071+0000 7fc0c0fe9640 1 --2- 172.21.15.123:0/4260716760 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc0bc0d0200 0x7fc0bc152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:49.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.071+0000 7fc0c0fe9640 1 -- 172.21.15.123:0/4260716760 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc0bc0d1620 msgr2=0x7fc0bc0acb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:49.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.071+0000 7fc0c0fe9640 1 --2- 172.21.15.123:0/4260716760 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc0bc0d1620 0x7fc0bc0acb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:49.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.071+0000 7fc0c0fe9640 1 -- 172.21.15.123:0/4260716760 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0bc0aa650 con 0x7fc0bc15c4f0 2024-09-15T23:12:49.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.071+0000 7fc0c0fe9640 1 --2- 172.21.15.123:0/4260716760 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0bc15c4f0 0x7fc0bc0ad040 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4034040 tx=0x7fc0b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:49.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.071+0000 7fc0b8ff9640 1 -- 172.21.15.123:0/4260716760 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4036050 con 0x7fc0bc15c4f0 2024-09-15T23:12:49.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.071+0000 7fc0b8ff9640 1 -- 172.21.15.123:0/4260716760 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0b4042070 con 0x7fc0bc15c4f0 2024-09-15T23:12:49.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.072+0000 7fc0c2a4c640 1 -- 172.21.15.123:0/4260716760 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0bc0aa930 con 0x7fc0bc15c4f0 2024-09-15T23:12:49.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.072+0000 7fc0b8ff9640 1 -- 172.21.15.123:0/4260716760 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4009510 con 0x7fc0bc15c4f0 2024-09-15T23:12:49.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.072+0000 7fc0c2a4c640 1 -- 172.21.15.123:0/4260716760 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0bc0aaef0 con 0x7fc0bc15c4f0 2024-09-15T23:12:49.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.073+0000 7fc0c2a4c640 1 -- 172.21.15.123:0/4260716760 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0bc073080 con 0x7fc0bc15c4f0 2024-09-15T23:12:49.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.073+0000 7fc0b8ff9640 1 -- 172.21.15.123:0/4260716760 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc0b4007bf0 con 0x7fc0bc15c4f0 2024-09-15T23:12:49.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.073+0000 7fc0b8ff9640 1 --2- 172.21.15.123:0/4260716760 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc0a806c2b0 0x7fc0a806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:49.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.074+0000 7fc0b8ff9640 1 -- 172.21.15.123:0/4260716760 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fc0b40abd80 con 0x7fc0bc15c4f0 2024-09-15T23:12:49.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.074+0000 7fc0bbfff640 1 --2- 172.21.15.123:0/4260716760 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc0a806c2b0 0x7fc0a806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:49.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.074+0000 7fc0bbfff640 1 --2- 172.21.15.123:0/4260716760 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc0a806c2b0 0x7fc0a806e770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac000f60 tx=0x7fc0ac007e20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:49.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.078+0000 7fc0b8ff9640 1 -- 172.21.15.123:0/4260716760 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc0b407a1f0 con 0x7fc0bc15c4f0 2024-09-15T23:12:49.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.245+0000 7fc0c2a4c640 1 -- 172.21.15.123:0/4260716760 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fc0bc0cca60 con 0x7fc0bc15c4f0 2024-09-15T23:12:49.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.246+0000 7fc0b8ff9640 1 -- 172.21.15.123:0/4260716760 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) ==== 84+0+65 (secure 0 0 0) 0x7fc0b407e4f0 con 0x7fc0bc15c4f0 2024-09-15T23:12:49.247 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:49.247 INFO:teuthology.orchestra.run.smithi123.stdout:[ 2024-09-15T23:12:49.247 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:12:49.247 INFO:teuthology.orchestra.run.smithi123.stdout: "poolnum": 1, 2024-09-15T23:12:49.247 INFO:teuthology.orchestra.run.smithi123.stdout: "poolname": ".mgr" 2024-09-15T23:12:49.247 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:12:49.247 INFO:teuthology.orchestra.run.smithi123.stdout:] 2024-09-15T23:12:49.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.247+0000 7fc0c2a4c640 1 -- 172.21.15.123:0/4260716760 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc0a806c2b0 msgr2=0x7fc0a806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:49.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.247+0000 7fc0c2a4c640 1 --2- 172.21.15.123:0/4260716760 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc0a806c2b0 0x7fc0a806e770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac000f60 tx=0x7fc0ac007e20 comp rx=0 tx=0).stop 2024-09-15T23:12:49.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.247+0000 7fc0c2a4c640 1 -- 172.21.15.123:0/4260716760 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0bc15c4f0 msgr2=0x7fc0bc0ad040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:49.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.247+0000 7fc0c2a4c640 1 --2- 172.21.15.123:0/4260716760 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0bc15c4f0 0x7fc0bc0ad040 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4034040 tx=0x7fc0b4004a40 comp rx=0 tx=0).stop 2024-09-15T23:12:49.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.248+0000 7fc0c2a4c640 1 -- 172.21.15.123:0/4260716760 shutdown_connections 2024-09-15T23:12:49.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.248+0000 7fc0c2a4c640 1 --2- 172.21.15.123:0/4260716760 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc0a806c2b0 0x7fc0a806e770 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:49.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.248+0000 7fc0c2a4c640 1 --2- 172.21.15.123:0/4260716760 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0bc15c4f0 0x7fc0bc0ad040 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:49.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.248+0000 7fc0c2a4c640 1 --2- 172.21.15.123:0/4260716760 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc0bc0d1620 0x7fc0bc0acb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:49.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.248+0000 7fc0c2a4c640 1 --2- 172.21.15.123:0/4260716760 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc0bc0d0200 0x7fc0bc152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:49.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.248+0000 7fc0c2a4c640 1 -- 172.21.15.123:0/4260716760 >> 172.21.15.123:0/4260716760 conn(0x7fc0bc06f400 msgr2=0x7fc0bc0d2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:49.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.248+0000 7fc0c2a4c640 1 -- 172.21.15.123:0/4260716760 shutdown_connections 2024-09-15T23:12:49.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.248+0000 7fc0c2a4c640 1 -- 172.21.15.123:0/4260716760 wait complete. 2024-09-15T23:12:49.259 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T23:12:49.259 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T23:12:49.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.361+0000 7fcc81617640 1 Processor -- start 2024-09-15T23:12:49.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.361+0000 7fcc81617640 1 -- start start 2024-09-15T23:12:49.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.361+0000 7fcc81617640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fcc7c15ea90 0x7fcc7c0d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:49.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.361+0000 7fcc81617640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcc7c0d16e0 0x7fcc7c0b7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:49.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.361+0000 7fcc81617640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc7c0cf060 con 0x7fcc7c0d40b0 2024-09-15T23:12:49.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.361+0000 7fcc81617640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fcc7c0d34c0 con 0x7fcc7c0d16e0 2024-09-15T23:12:49.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.361+0000 7fcc81617640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fcc7c0cf340 con 0x7fcc7c15ea90 2024-09-15T23:12:49.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.362+0000 7fcc7b7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcc7c0d16e0 0x7fcc7c0b7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:49.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.362+0000 7fcc7b7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcc7c0d16e0 0x7fcc7c0b7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55054/0 (socket says 172.21.15.123:55054) 2024-09-15T23:12:49.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.362+0000 7fcc7b7fe640 1 -- 172.21.15.123:0/3247883132 learned_addr learned my addr 172.21.15.123:0/3247883132 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:49.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.362+0000 7fcc7affd640 1 --2- 172.21.15.123:0/3247883132 >> v2:172.21.15.188:3300/0 conn(0x7fcc7c15ea90 0x7fcc7c0d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:49.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.362+0000 7fcc7b7fe640 1 -- 172.21.15.123:0/3247883132 >> v2:172.21.15.188:3300/0 conn(0x7fcc7c15ea90 msgr2=0x7fcc7c0d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:49.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.362+0000 7fcc7b7fe640 1 --2- 172.21.15.123:0/3247883132 >> v2:172.21.15.188:3300/0 conn(0x7fcc7c15ea90 0x7fcc7c0d2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:49.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.362+0000 7fcc7b7fe640 1 -- 172.21.15.123:0/3247883132 >> v1:172.21.15.188:6789/0 conn(0x7fcc7c0d40b0 legacy=0x7fcc7c0d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:49.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.362+0000 7fcc7b7fe640 1 -- 172.21.15.123:0/3247883132 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc7c0cf620 con 0x7fcc7c0d16e0 2024-09-15T23:12:49.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.363+0000 7fcc7b7fe640 1 --2- 172.21.15.123:0/3247883132 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc7c0d16e0 0x7fcc7c0b7ac0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c0698a0 tx=0x7fcc7402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8d292b98df71713 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:49.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.363+0000 7fcc79ffb640 1 -- 172.21.15.123:0/3247883132 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc74037070 con 0x7fcc7c0d16e0 2024-09-15T23:12:49.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.363+0000 7fcc79ffb640 1 -- 172.21.15.123:0/3247883132 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc74032440 con 0x7fcc7c0d16e0 2024-09-15T23:12:49.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.363+0000 7fcc79ffb640 1 -- 172.21.15.123:0/3247883132 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc74032810 con 0x7fcc7c0d16e0 2024-09-15T23:12:49.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.363+0000 7fcc81617640 1 -- 172.21.15.123:0/3247883132 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc7c0d16e0 msgr2=0x7fcc7c0b7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:49.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.363+0000 7fcc81617640 1 --2- 172.21.15.123:0/3247883132 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc7c0d16e0 0x7fcc7c0b7ac0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c0698a0 tx=0x7fcc7402a1a0 comp rx=0 tx=0).stop 2024-09-15T23:12:49.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.363+0000 7fcc81617640 1 -- 172.21.15.123:0/3247883132 shutdown_connections 2024-09-15T23:12:49.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.363+0000 7fcc81617640 1 --2- 172.21.15.123:0/3247883132 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc7c0d16e0 0x7fcc7c0b7ac0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:49.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.363+0000 7fcc81617640 1 --2- 172.21.15.123:0/3247883132 >> v2:172.21.15.188:3300/0 conn(0x7fcc7c15ea90 0x7fcc7c0d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:49.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.363+0000 7fcc81617640 1 -- 172.21.15.123:0/3247883132 >> 172.21.15.123:0/3247883132 conn(0x7fcc7c06c0e0 msgr2=0x7fcc7c06c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:49.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.363+0000 7fcc81617640 1 -- 172.21.15.123:0/3247883132 shutdown_connections 2024-09-15T23:12:49.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.363+0000 7fcc81617640 1 -- 172.21.15.123:0/3247883132 wait complete. 2024-09-15T23:12:49.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.365+0000 7fcc81617640 1 Processor -- start 2024-09-15T23:12:49.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.365+0000 7fcc81617640 1 -- start start 2024-09-15T23:12:49.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.365+0000 7fcc81617640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc7c0d16e0 0x7fcc7c1f7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:49.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.365+0000 7fcc81617640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc7c0d40b0 0x7fcc7c1607d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:49.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.365+0000 7fcc81617640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcc7c15ea90 0x7fcc7c0cda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:49.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.365+0000 7fcc81617640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcc7c15ee70 con 0x7fcc7c0d40b0 2024-09-15T23:12:49.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.365+0000 7fcc81617640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fcc7c0cfbe0 con 0x7fcc7c0d16e0 2024-09-15T23:12:49.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.365+0000 7fcc81617640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fcc7c0b8000 con 0x7fcc7c15ea90 2024-09-15T23:12:49.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.365+0000 7fcc7a7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc7c0d40b0 0x7fcc7c1607d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:49.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.366+0000 7fcc7a7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc7c0d40b0 0x7fcc7c1607d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55056/0 (socket says 172.21.15.123:55056) 2024-09-15T23:12:49.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.366+0000 7fcc7a7fc640 1 -- 172.21.15.123:0/777026289 learned_addr learned my addr 172.21.15.123:0/777026289 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:49.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.366+0000 7fcc7affd640 1 --2- 172.21.15.123:0/777026289 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc7c0d16e0 0x7fcc7c1f7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:49.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.366+0000 7fcc7b7fe640 1 --2- 172.21.15.123:0/777026289 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcc7c15ea90 0x7fcc7c0cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:49.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.366+0000 7fcc7a7fc640 1 -- 172.21.15.123:0/777026289 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcc7c15ea90 msgr2=0x7fcc7c0cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:49.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.366+0000 7fcc7a7fc640 1 --2- 172.21.15.123:0/777026289 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcc7c15ea90 0x7fcc7c0cda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:49.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.366+0000 7fcc7a7fc640 1 -- 172.21.15.123:0/777026289 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc7c0d16e0 msgr2=0x7fcc7c1f7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:49.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.366+0000 7fcc7a7fc640 1 --2- 172.21.15.123:0/777026289 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc7c0d16e0 0x7fcc7c1f7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:49.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.366+0000 7fcc7a7fc640 1 -- 172.21.15.123:0/777026289 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc7c161220 con 0x7fcc7c0d40b0 2024-09-15T23:12:49.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.366+0000 7fcc7a7fc640 1 --2- 172.21.15.123:0/777026289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc7c0d40b0 0x7fcc7c1607d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcc7000c430 tx=0x7fcc7000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:49.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.366+0000 7fcc637fe640 1 -- 172.21.15.123:0/777026289 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc70011790 con 0x7fcc7c0d40b0 2024-09-15T23:12:49.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.366+0000 7fcc637fe640 1 -- 172.21.15.123:0/777026289 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc70017070 con 0x7fcc7c0d40b0 2024-09-15T23:12:49.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.366+0000 7fcc81617640 1 -- 172.21.15.123:0/777026289 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc7c161500 con 0x7fcc7c0d40b0 2024-09-15T23:12:49.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.366+0000 7fcc637fe640 1 -- 172.21.15.123:0/777026289 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc70011b70 con 0x7fcc7c0d40b0 2024-09-15T23:12:49.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.366+0000 7fcc81617640 1 -- 172.21.15.123:0/777026289 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc7c161ac0 con 0x7fcc7c0d40b0 2024-09-15T23:12:49.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.367+0000 7fcc81617640 1 -- 172.21.15.123:0/777026289 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc7c0b7ac0 con 0x7fcc7c0d40b0 2024-09-15T23:12:49.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.368+0000 7fcc637fe640 1 -- 172.21.15.123:0/777026289 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcc70011d10 con 0x7fcc7c0d40b0 2024-09-15T23:12:49.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.368+0000 7fcc637fe640 1 --2- 172.21.15.123:0/777026289 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcc6806c2b0 0x7fcc6806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:49.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.368+0000 7fcc637fe640 1 -- 172.21.15.123:0/777026289 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 4857+0+0 (secure 0 0 0) 0x7fcc7008af50 con 0x7fcc7c0d40b0 2024-09-15T23:12:49.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.368+0000 7fcc7affd640 1 --2- 172.21.15.123:0/777026289 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcc6806c2b0 0x7fcc6806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:49.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.369+0000 7fcc7affd640 1 --2- 172.21.15.123:0/777026289 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcc6806c2b0 0x7fcc6806e770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c0adea0 tx=0x7fcc6c0039b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:49.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.373+0000 7fcc637fe640 1 -- 172.21.15.123:0/777026289 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcc70059a10 con 0x7fcc7c0d40b0 2024-09-15T23:12:49.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:49.540+0000 7fcc81617640 1 -- 172.21.15.123:0/777026289 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fcc7c069d20 con 0x7fcc7c0d40b0 2024-09-15T23:12:50.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.429+0000 7fcc637fe640 1 -- 172.21.15.123:0/777026289 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) ==== 138+0+0 (secure 0 0 0) 0x7fcc70059310 con 0x7fcc7c0d40b0 2024-09-15T23:12:50.430 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' created 2024-09-15T23:12:50.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.432+0000 7fcc81617640 1 -- 172.21.15.123:0/777026289 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcc6806c2b0 msgr2=0x7fcc6806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:50.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.432+0000 7fcc81617640 1 --2- 172.21.15.123:0/777026289 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcc6806c2b0 0x7fcc6806e770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c0adea0 tx=0x7fcc6c0039b0 comp rx=0 tx=0).stop 2024-09-15T23:12:50.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.432+0000 7fcc81617640 1 -- 172.21.15.123:0/777026289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc7c0d40b0 msgr2=0x7fcc7c1607d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:50.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.432+0000 7fcc81617640 1 --2- 172.21.15.123:0/777026289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc7c0d40b0 0x7fcc7c1607d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcc7000c430 tx=0x7fcc7000c8f0 comp rx=0 tx=0).stop 2024-09-15T23:12:50.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.432+0000 7fcc81617640 1 -- 172.21.15.123:0/777026289 shutdown_connections 2024-09-15T23:12:50.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.432+0000 7fcc81617640 1 --2- 172.21.15.123:0/777026289 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcc7c15ea90 0x7fcc7c0cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:50.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.432+0000 7fcc81617640 1 --2- 172.21.15.123:0/777026289 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcc6806c2b0 0x7fcc6806e770 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:50.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.432+0000 7fcc81617640 1 --2- 172.21.15.123:0/777026289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc7c0d40b0 0x7fcc7c1607d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:50.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.432+0000 7fcc81617640 1 --2- 172.21.15.123:0/777026289 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc7c0d16e0 0x7fcc7c1f7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:50.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.432+0000 7fcc81617640 1 -- 172.21.15.123:0/777026289 >> 172.21.15.123:0/777026289 conn(0x7fcc7c06c0e0 msgr2=0x7fcc7c0c9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:50.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.435+0000 7fcc81617640 1 -- 172.21.15.123:0/777026289 shutdown_connections 2024-09-15T23:12:50.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.435+0000 7fcc81617640 1 -- 172.21.15.123:0/777026289 wait complete. 2024-09-15T23:12:50.450 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T23:12:50.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.559+0000 7f015ddd6640 1 Processor -- start 2024-09-15T23:12:50.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.559+0000 7f015ddd6640 1 -- start start 2024-09-15T23:12:50.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.560+0000 7f015ddd6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0158153550 0x7f015815d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:50.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.560+0000 7f015ddd6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f01580b3e80 0x7f01580b58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:50.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.560+0000 7f015ddd6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f01580b53b0 0x7f01580b5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:50.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.560+0000 7f015ddd6640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f01580b4310 con 0x7f0158153550 2024-09-15T23:12:50.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.560+0000 7f015ddd6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f01580b45f0 con 0x7f01580b3e80 2024-09-15T23:12:50.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.560+0000 7f015ddd6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f01580b48d0 con 0x7f01580b53b0 2024-09-15T23:12:50.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.560+0000 7f01577fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0158153550 0x7f015815d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:50.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.560+0000 7f01577fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0158153550 0x7f015815d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55070/0 (socket says 172.21.15.123:55070) 2024-09-15T23:12:50.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.560+0000 7f01577fe640 1 -- 172.21.15.123:0/1582072265 learned_addr learned my addr 172.21.15.123:0/1582072265 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:50.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.561+0000 7f0156ffd640 1 --2- 172.21.15.123:0/1582072265 >> v2:172.21.15.188:3300/0 conn(0x7f01580b3e80 0x7f01580b58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:50.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.561+0000 7f01577fe640 1 -- 172.21.15.123:0/1582072265 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f01580b53b0 msgr2=0x7f01580b5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:50.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.561+0000 7f0157fff640 1 --2- 172.21.15.123:0/1582072265 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f01580b53b0 0x7f01580b5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:50.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.561+0000 7f01577fe640 1 --2- 172.21.15.123:0/1582072265 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f01580b53b0 0x7f01580b5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:50.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.561+0000 7f01577fe640 1 -- 172.21.15.123:0/1582072265 >> v2:172.21.15.188:3300/0 conn(0x7f01580b3e80 msgr2=0x7f01580b58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:50.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.561+0000 7f01577fe640 1 --2- 172.21.15.123:0/1582072265 >> v2:172.21.15.188:3300/0 conn(0x7f01580b3e80 0x7f01580b58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:50.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.561+0000 7f01577fe640 1 -- 172.21.15.123:0/1582072265 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01580b4bb0 con 0x7f0158153550 2024-09-15T23:12:50.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.561+0000 7f0156ffd640 1 --2- 172.21.15.123:0/1582072265 >> v2:172.21.15.188:3300/0 conn(0x7f01580b3e80 0x7f01580b58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:50.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.561+0000 7f01577fe640 1 --2- 172.21.15.123:0/1582072265 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0158153550 0x7f015815d5a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f01580719b0 tx=0x7f014802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca84471a3adf441 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:50.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.561+0000 7f01567fc640 1 -- 172.21.15.123:0/1582072265 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0148036070 con 0x7f0158153550 2024-09-15T23:12:50.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.562+0000 7f01567fc640 1 -- 172.21.15.123:0/1582072265 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0148031600 con 0x7f0158153550 2024-09-15T23:12:50.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.562+0000 7f01567fc640 1 -- 172.21.15.123:0/1582072265 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01480319d0 con 0x7f0158153550 2024-09-15T23:12:50.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.562+0000 7f015ddd6640 1 -- 172.21.15.123:0/1582072265 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0158153550 msgr2=0x7f015815d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:50.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.562+0000 7f015ddd6640 1 --2- 172.21.15.123:0/1582072265 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0158153550 0x7f015815d5a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f01580719b0 tx=0x7f014802a6a0 comp rx=0 tx=0).stop 2024-09-15T23:12:50.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.562+0000 7f015ddd6640 1 -- 172.21.15.123:0/1582072265 shutdown_connections 2024-09-15T23:12:50.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.562+0000 7f015ddd6640 1 --2- 172.21.15.123:0/1582072265 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f01580b53b0 0x7f01580b5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:50.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.562+0000 7f015ddd6640 1 --2- 172.21.15.123:0/1582072265 >> v2:172.21.15.188:3300/0 conn(0x7f01580b3e80 0x7f01580b58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:50.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.562+0000 7f015ddd6640 1 --2- 172.21.15.123:0/1582072265 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0158153550 0x7f015815d5a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:50.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.562+0000 7f015ddd6640 1 -- 172.21.15.123:0/1582072265 >> 172.21.15.123:0/1582072265 conn(0x7f015806db30 msgr2=0x7f015806df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:50.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.562+0000 7f015ddd6640 1 -- 172.21.15.123:0/1582072265 shutdown_connections 2024-09-15T23:12:50.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.562+0000 7f015ddd6640 1 -- 172.21.15.123:0/1582072265 wait complete. 2024-09-15T23:12:50.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.563+0000 7f015ddd6640 1 Processor -- start 2024-09-15T23:12:50.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.563+0000 7f015ddd6640 1 -- start start 2024-09-15T23:12:50.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.564+0000 7f015ddd6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f01580b53b0 0x7f01580c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:50.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.564+0000 7f015ddd6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0158153550 0x7f015806be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:50.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.564+0000 7f015ddd6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f015814d290 0x7f015814b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:50.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.564+0000 7f015ddd6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0158070120 con 0x7f015814d290 2024-09-15T23:12:50.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.564+0000 7f015ddd6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0158153930 con 0x7f01580b53b0 2024-09-15T23:12:50.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.564+0000 7f015ddd6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f01580cfe90 con 0x7f0158153550 2024-09-15T23:12:50.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.564+0000 7f0157fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f015814d290 0x7f015814b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:50.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.564+0000 7f0157fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f015814d290 0x7f015814b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55072/0 (socket says 172.21.15.123:55072) 2024-09-15T23:12:50.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.564+0000 7f0157fff640 1 -- 172.21.15.123:0/4241490172 learned_addr learned my addr 172.21.15.123:0/4241490172 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:50.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.564+0000 7f01577fe640 1 --2- 172.21.15.123:0/4241490172 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f01580b53b0 0x7f01580c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:50.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.564+0000 7f0156ffd640 1 --2- 172.21.15.123:0/4241490172 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0158153550 0x7f015806be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:50.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.565+0000 7f0157fff640 1 -- 172.21.15.123:0/4241490172 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0158153550 msgr2=0x7f015806be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:50.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.565+0000 7f0157fff640 1 --2- 172.21.15.123:0/4241490172 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0158153550 0x7f015806be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:50.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.565+0000 7f0157fff640 1 -- 172.21.15.123:0/4241490172 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f01580b53b0 msgr2=0x7f01580c7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:50.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.565+0000 7f0157fff640 1 --2- 172.21.15.123:0/4241490172 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f01580b53b0 0x7f01580c7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:50.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.565+0000 7f0157fff640 1 -- 172.21.15.123:0/4241490172 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f015814ebd0 con 0x7f015814d290 2024-09-15T23:12:50.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.565+0000 7f0157fff640 1 --2- 172.21.15.123:0/4241490172 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f015814d290 0x7f015814b240 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f015000c7f0 tx=0x7f015000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:50.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.565+0000 7f013ffff640 1 -- 172.21.15.123:0/4241490172 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0150015070 con 0x7f015814d290 2024-09-15T23:12:50.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.565+0000 7f013ffff640 1 -- 172.21.15.123:0/4241490172 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0150004220 con 0x7f015814d290 2024-09-15T23:12:50.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.565+0000 7f015ddd6640 1 -- 172.21.15.123:0/4241490172 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f015814d720 con 0x7f015814d290 2024-09-15T23:12:50.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.565+0000 7f013ffff640 1 -- 172.21.15.123:0/4241490172 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0150007620 con 0x7f015814d290 2024-09-15T23:12:50.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.565+0000 7f015ddd6640 1 -- 172.21.15.123:0/4241490172 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f015814dce0 con 0x7f015814d290 2024-09-15T23:12:50.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.566+0000 7f015ddd6640 1 -- 172.21.15.123:0/4241490172 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f015815d5a0 con 0x7f015814d290 2024-09-15T23:12:50.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.566+0000 7f013ffff640 1 -- 172.21.15.123:0/4241490172 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f01500077c0 con 0x7f015814d290 2024-09-15T23:12:50.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.567+0000 7f013ffff640 1 --2- 172.21.15.123:0/4241490172 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f014406c2b0 0x7f014406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:50.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.567+0000 7f013ffff640 1 -- 172.21.15.123:0/4241490172 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5227+0+0 (secure 0 0 0) 0x7f015008b000 con 0x7f015814d290 2024-09-15T23:12:50.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.567+0000 7f01577fe640 1 --2- 172.21.15.123:0/4241490172 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f014406c2b0 0x7f014406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:50.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.567+0000 7f01577fe640 1 --2- 172.21.15.123:0/4241490172 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f014406c2b0 0x7f014406e770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0148033000 tx=0x7f0148009000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:50.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.571+0000 7f013ffff640 1 -- 172.21.15.123:0/4241490172 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f01500599e0 con 0x7f015814d290 2024-09-15T23:12:50.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:50.736+0000 7f015ddd6640 1 -- 172.21.15.123:0/4241490172 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f015814fa10 con 0x7f015814d290 2024-09-15T23:12:51.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.431+0000 7f013ffff640 1 -- 172.21.15.123:0/4241490172 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) ==== 170+0+0 (secure 0 0 0) 0x7f01500592e0 con 0x7f015814d290 2024-09-15T23:12:51.432 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' created 2024-09-15T23:12:51.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.433+0000 7f015ddd6640 1 -- 172.21.15.123:0/4241490172 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f014406c2b0 msgr2=0x7f014406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:51.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.433+0000 7f015ddd6640 1 --2- 172.21.15.123:0/4241490172 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f014406c2b0 0x7f014406e770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0148033000 tx=0x7f0148009000 comp rx=0 tx=0).stop 2024-09-15T23:12:51.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.433+0000 7f015ddd6640 1 -- 172.21.15.123:0/4241490172 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f015814d290 msgr2=0x7f015814b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:51.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.433+0000 7f015ddd6640 1 --2- 172.21.15.123:0/4241490172 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f015814d290 0x7f015814b240 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f015000c7f0 tx=0x7f015000ccb0 comp rx=0 tx=0).stop 2024-09-15T23:12:51.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.433+0000 7f015ddd6640 1 -- 172.21.15.123:0/4241490172 shutdown_connections 2024-09-15T23:12:51.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.433+0000 7f015ddd6640 1 --2- 172.21.15.123:0/4241490172 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f014406c2b0 0x7f014406e770 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:51.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.433+0000 7f015ddd6640 1 --2- 172.21.15.123:0/4241490172 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f015814d290 0x7f015814b240 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:51.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.433+0000 7f015ddd6640 1 --2- 172.21.15.123:0/4241490172 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0158153550 0x7f015806be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:51.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.433+0000 7f015ddd6640 1 --2- 172.21.15.123:0/4241490172 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f01580b53b0 0x7f01580c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:51.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.433+0000 7f015ddd6640 1 -- 172.21.15.123:0/4241490172 >> 172.21.15.123:0/4241490172 conn(0x7f015806db30 msgr2=0x7f015815d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:51.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.434+0000 7f015ddd6640 1 -- 172.21.15.123:0/4241490172 shutdown_connections 2024-09-15T23:12:51.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.434+0000 7f015ddd6640 1 -- 172.21.15.123:0/4241490172 wait complete. 2024-09-15T23:12:51.458 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T23:12:51.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.558+0000 7f04a5d8d640 1 Processor -- start 2024-09-15T23:12:51.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.558+0000 7f04a5d8d640 1 -- start start 2024-09-15T23:12:51.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.559+0000 7f04a5d8d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04a00ccf30 0x7f04a00b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:51.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.559+0000 7f04a5d8d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f04a015b7c0 0x7f04a00cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:51.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.559+0000 7f04a5d8d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04a00cd850 con 0x7f04a00cead0 2024-09-15T23:12:51.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.559+0000 7f04a5d8d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f04a00cf2e0 con 0x7f04a015b7c0 2024-09-15T23:12:51.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.559+0000 7f04a5d8d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f04a0070fe0 con 0x7f04a00ccf30 2024-09-15T23:12:51.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.559+0000 7f049ffff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f04a00cead0 0x7f04a015f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41186/0 (socket says 172.21.15.123:41186) 2024-09-15T23:12:51.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.559+0000 7f049ffff640 1 -- 172.21.15.123:0/2456817764 learned_addr learned my addr 172.21.15.123:0/2456817764 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:51.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.559+0000 7f049e7fc640 1 -- 172.21.15.123:0/2456817764 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2088125444 0 0) 0x7f04a00cd850 con 0x7f04a00cead0 2024-09-15T23:12:51.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.559+0000 7f049effd640 1 --2- 172.21.15.123:0/2456817764 >> v2:172.21.15.188:3300/0 conn(0x7f04a015b7c0 0x7f04a00cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:51.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.559+0000 7f049f7fe640 1 --2- 172.21.15.123:0/2456817764 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04a00ccf30 0x7f04a00b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:51.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.559+0000 7f049e7fc640 1 -- 172.21.15.123:0/2456817764 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f048c003520 con 0x7f04a00cead0 2024-09-15T23:12:51.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.559+0000 7f049e7fc640 1 -- 172.21.15.123:0/2456817764 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4170430130 0 0) 0x7f048c003520 con 0x7f04a00cead0 2024-09-15T23:12:51.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.559+0000 7f049e7fc640 1 -- 172.21.15.123:0/2456817764 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04a00ccf30 msgr2=0x7f04a00b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:51.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.559+0000 7f049e7fc640 1 --2- 172.21.15.123:0/2456817764 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04a00ccf30 0x7f04a00b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:51.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.559+0000 7f049e7fc640 1 -- 172.21.15.123:0/2456817764 >> v2:172.21.15.188:3300/0 conn(0x7f04a015b7c0 msgr2=0x7f04a00cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:51.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.559+0000 7f049e7fc640 1 --2- 172.21.15.123:0/2456817764 >> v2:172.21.15.188:3300/0 conn(0x7f04a015b7c0 0x7f04a00cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:51.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.559+0000 7f049e7fc640 1 -- 172.21.15.123:0/2456817764 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a00712c0 con 0x7f04a00cead0 2024-09-15T23:12:51.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.559+0000 7f049e7fc640 1 -- 172.21.15.123:0/2456817764 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f04980019f0 con 0x7f04a00cead0 2024-09-15T23:12:51.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.559+0000 7f049e7fc640 1 -- 172.21.15.123:0/2456817764 >> v1:172.21.15.123:6789/0 conn(0x7f04a00cead0 legacy=0x7f04a015f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:51.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.559+0000 7f049e7fc640 1 --2- 172.21.15.123:0/2456817764 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f048c0039b0 0x7f048c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:51.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.559+0000 7f049e7fc640 1 --2- 172.21.15.123:0/2456817764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f048c004800 0x7f048c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:51.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.559+0000 7f049e7fc640 1 --2- 172.21.15.123:0/2456817764 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04a00ccf30 0x7f048c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:51.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.559+0000 7f049e7fc640 1 -- 172.21.15.123:0/2456817764 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f04a00cf2e0 con 0x7f048c004800 2024-09-15T23:12:51.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.559+0000 7f049e7fc640 1 -- 172.21.15.123:0/2456817764 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f04a0070fe0 con 0x7f048c0039b0 2024-09-15T23:12:51.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.559+0000 7f049e7fc640 1 -- 172.21.15.123:0/2456817764 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f048c00ba10 con 0x7f04a00ccf30 2024-09-15T23:12:51.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.560+0000 7f049effd640 1 --2- 172.21.15.123:0/2456817764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f048c004800 0x7f048c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:51.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.560+0000 7f049f7fe640 1 --2- 172.21.15.123:0/2456817764 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f048c0039b0 0x7f048c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:51.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.560+0000 7f049ffff640 1 --2- 172.21.15.123:0/2456817764 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04a00ccf30 0x7f048c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:51.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.560+0000 7f049effd640 1 -- 172.21.15.123:0/2456817764 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04a00ccf30 msgr2=0x7f048c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:51.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.560+0000 7f049effd640 1 --2- 172.21.15.123:0/2456817764 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04a00ccf30 0x7f048c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:51.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.560+0000 7f049effd640 1 -- 172.21.15.123:0/2456817764 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f048c0039b0 msgr2=0x7f048c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:51.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.560+0000 7f049effd640 1 --2- 172.21.15.123:0/2456817764 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f048c0039b0 0x7f048c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:51.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.560+0000 7f049effd640 1 -- 172.21.15.123:0/2456817764 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f048c003520 con 0x7f048c004800 2024-09-15T23:12:51.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.561+0000 7f049effd640 1 --2- 172.21.15.123:0/2456817764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f048c004800 0x7f048c004c80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0488009a90 tx=0x7f048c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3515558545ab19 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:51.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.561+0000 7f049e7fc640 1 -- 172.21.15.123:0/2456817764 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488036070 con 0x7f048c004800 2024-09-15T23:12:51.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.561+0000 7f049e7fc640 1 -- 172.21.15.123:0/2456817764 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0488031400 con 0x7f048c004800 2024-09-15T23:12:51.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.561+0000 7f049e7fc640 1 -- 172.21.15.123:0/2456817764 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488009690 con 0x7f048c004800 2024-09-15T23:12:51.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.561+0000 7f04a5d8d640 1 -- 172.21.15.123:0/2456817764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f048c004800 msgr2=0x7f048c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:51.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.561+0000 7f04a5d8d640 1 --2- 172.21.15.123:0/2456817764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f048c004800 0x7f048c004c80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0488009a90 tx=0x7f048c005830 comp rx=0 tx=0).stop 2024-09-15T23:12:51.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.561+0000 7f049ffff640 1 -- 172.21.15.123:0/2456817764 reap_dead start 2024-09-15T23:12:51.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.561+0000 7f04a5d8d640 1 -- 172.21.15.123:0/2456817764 shutdown_connections 2024-09-15T23:12:51.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.561+0000 7f04a5d8d640 1 -- 172.21.15.123:0/2456817764 >> 172.21.15.123:0/2456817764 conn(0x7f04a006d0f0 msgr2=0x7f04a006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:51.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.561+0000 7f04a5d8d640 1 -- 172.21.15.123:0/2456817764 shutdown_connections 2024-09-15T23:12:51.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.561+0000 7f04a5d8d640 1 -- 172.21.15.123:0/2456817764 wait complete. 2024-09-15T23:12:51.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.562+0000 7f04a5d8d640 1 Processor -- start 2024-09-15T23:12:51.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.563+0000 7f04a5d8d640 1 -- start start 2024-09-15T23:12:51.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.563+0000 7f04a5d8d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f048c004800 0x7f04a0153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:51.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.563+0000 7f04a5d8d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04a0150220 0x7f04a013d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:51.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.563+0000 7f04a5d8d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04a0150d70 0x7f04a01e71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:51.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.563+0000 7f04a5d8d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f04a00cef40 con 0x7f048c004800 2024-09-15T23:12:51.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.563+0000 7f04a5d8d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f04a00cf5c0 con 0x7f04a0150220 2024-09-15T23:12:51.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.563+0000 7f04a5d8d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f04a00cf0c0 con 0x7f04a0150d70 2024-09-15T23:12:51.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.563+0000 7f049f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f048c004800 0x7f04a0153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:51.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.563+0000 7f049f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f048c004800 0x7f04a0153c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55098/0 (socket says 172.21.15.123:55098) 2024-09-15T23:12:51.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.563+0000 7f049f7fe640 1 -- 172.21.15.123:0/1878801538 learned_addr learned my addr 172.21.15.123:0/1878801538 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:51.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.564+0000 7f049ffff640 1 --2- 172.21.15.123:0/1878801538 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04a0150d70 0x7f04a01e71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:51.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.564+0000 7f049effd640 1 --2- 172.21.15.123:0/1878801538 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04a0150220 0x7f04a013d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:51.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.564+0000 7f049f7fe640 1 -- 172.21.15.123:0/1878801538 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04a0150d70 msgr2=0x7f04a01e71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:51.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.564+0000 7f049f7fe640 1 --2- 172.21.15.123:0/1878801538 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04a0150d70 0x7f04a01e71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:51.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.564+0000 7f049f7fe640 1 -- 172.21.15.123:0/1878801538 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04a0150220 msgr2=0x7f04a013d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:51.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.564+0000 7f049f7fe640 1 --2- 172.21.15.123:0/1878801538 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04a0150220 0x7f04a013d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:51.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.564+0000 7f049f7fe640 1 -- 172.21.15.123:0/1878801538 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a0152bc0 con 0x7f048c004800 2024-09-15T23:12:51.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.564+0000 7f049ffff640 1 --2- 172.21.15.123:0/1878801538 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04a0150d70 0x7f04a01e71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:51.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.564+0000 7f049effd640 1 --2- 172.21.15.123:0/1878801538 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04a0150220 0x7f04a013d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:51.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.564+0000 7f049f7fe640 1 --2- 172.21.15.123:0/1878801538 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f048c004800 0x7f04a0153c60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f04900118e0 tx=0x7f0490011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:51.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.564+0000 7f0497fff640 1 -- 172.21.15.123:0/1878801538 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f049000faf0 con 0x7f048c004800 2024-09-15T23:12:51.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.564+0000 7f0497fff640 1 -- 172.21.15.123:0/1878801538 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f049000fc90 con 0x7f048c004800 2024-09-15T23:12:51.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.564+0000 7f04a5d8d640 1 -- 172.21.15.123:0/1878801538 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04a0152ea0 con 0x7f048c004800 2024-09-15T23:12:51.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.564+0000 7f0497fff640 1 -- 172.21.15.123:0/1878801538 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0490014440 con 0x7f048c004800 2024-09-15T23:12:51.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.564+0000 7f04a5d8d640 1 -- 172.21.15.123:0/1878801538 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04a0153460 con 0x7f048c004800 2024-09-15T23:12:51.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.565+0000 7f04a5d8d640 1 -- 172.21.15.123:0/1878801538 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04a015af80 con 0x7f048c004800 2024-09-15T23:12:51.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.566+0000 7f0497fff640 1 -- 172.21.15.123:0/1878801538 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0490012040 con 0x7f048c004800 2024-09-15T23:12:51.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.566+0000 7f0497fff640 1 --2- 172.21.15.123:0/1878801538 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f048006c2b0 0x7f048006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:51.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.566+0000 7f0497fff640 1 -- 172.21.15.123:0/1878801538 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5609+0+0 (secure 0 0 0) 0x7f049008ba60 con 0x7f048c004800 2024-09-15T23:12:51.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.566+0000 7f049effd640 1 --2- 172.21.15.123:0/1878801538 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f048006c2b0 0x7f048006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:51.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.567+0000 7f049effd640 1 --2- 172.21.15.123:0/1878801538 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f048006c2b0 0x7f048006e770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0488033000 tx=0x7f0488008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:51.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.571+0000 7f0497fff640 1 -- 172.21.15.123:0/1878801538 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f04a015af80 con 0x7f048c004800 2024-09-15T23:12:51.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:51.771+0000 7f04a5d8d640 1 -- 172.21.15.123:0/1878801538 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f04a00ce8b0 con 0x7f048c004800 2024-09-15T23:12:52.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.443+0000 7f0497fff640 1 -- 172.21.15.123:0/1878801538 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) ==== 172+0+0 (secure 0 0 0) 0x7f0490019030 con 0x7f048c004800 2024-09-15T23:12:52.445 INFO:teuthology.orchestra.run.smithi123.stderr:new fs with metadata pool 4 and data pool 5 2024-09-15T23:12:52.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.449+0000 7f04a5d8d640 1 -- 172.21.15.123:0/1878801538 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f048006c2b0 msgr2=0x7f048006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:52.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.449+0000 7f04a5d8d640 1 --2- 172.21.15.123:0/1878801538 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f048006c2b0 0x7f048006e770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0488033000 tx=0x7f0488008030 comp rx=0 tx=0).stop 2024-09-15T23:12:52.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.449+0000 7f04a5d8d640 1 -- 172.21.15.123:0/1878801538 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f048c004800 msgr2=0x7f04a0153c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:52.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.449+0000 7f04a5d8d640 1 --2- 172.21.15.123:0/1878801538 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f048c004800 0x7f04a0153c60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f04900118e0 tx=0x7f0490011da0 comp rx=0 tx=0).stop 2024-09-15T23:12:52.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.451+0000 7f04a5d8d640 1 -- 172.21.15.123:0/1878801538 shutdown_connections 2024-09-15T23:12:52.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.451+0000 7f04a5d8d640 1 --2- 172.21.15.123:0/1878801538 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04a0150d70 0x7f04a01e71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:52.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.451+0000 7f04a5d8d640 1 --2- 172.21.15.123:0/1878801538 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04a0150220 0x7f04a013d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:52.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.451+0000 7f04a5d8d640 1 --2- 172.21.15.123:0/1878801538 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f048006c2b0 0x7f048006e770 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:52.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.451+0000 7f04a5d8d640 1 --2- 172.21.15.123:0/1878801538 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f048c004800 0x7f04a0153c60 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:52.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.451+0000 7f04a5d8d640 1 -- 172.21.15.123:0/1878801538 >> 172.21.15.123:0/1878801538 conn(0x7f04a006d0f0 msgr2=0x7f04a015e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:52.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.455+0000 7f04a5d8d640 1 -- 172.21.15.123:0/1878801538 shutdown_connections 2024-09-15T23:12:52.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.460+0000 7f04a5d8d640 1 -- 172.21.15.123:0/1878801538 wait complete. 2024-09-15T23:12:52.480 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:12:52.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.576+0000 7fc31919f640 1 Processor -- start 2024-09-15T23:12:52.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.576+0000 7fc31919f640 1 -- start start 2024-09-15T23:12:52.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.577+0000 7fc31919f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc3140b6970 0x7fc3140b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:52.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.577+0000 7fc31919f640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3140d0e70 con 0x7fc31415ed20 2024-09-15T23:12:52.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.577+0000 7fc31919f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3140d41c0 con 0x7fc3140d23b0 2024-09-15T23:12:52.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.577+0000 7fc31919f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc3140d35b0 con 0x7fc3140b6970 2024-09-15T23:12:52.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.577+0000 7fc31259c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc3140b6970 0x7fc3140b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:52.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.577+0000 7fc31259c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc3140b6970 0x7fc3140b80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55106/0 (socket says 172.21.15.123:55106) 2024-09-15T23:12:52.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.577+0000 7fc31259c640 1 -- 172.21.15.123:0/2728798845 learned_addr learned my addr 172.21.15.123:0/2728798845 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:52.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.577+0000 7fc312d9d640 1 --1- 172.21.15.123:0/2728798845 >> v1:172.21.15.123:6789/0 conn(0x7fc31415ed20 0x7fc3140b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41200/0 (socket says 172.21.15.123:41200) 2024-09-15T23:12:52.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.578+0000 7fc31259c640 1 -- 172.21.15.123:0/2728798845 >> v1:172.21.15.188:6789/0 conn(0x7fc3140d23b0 legacy=0x7fc3140b8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:52.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.578+0000 7fc311d9b640 1 -- 172.21.15.123:0/2728798845 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4223509349 0 0) 0x7fc30c001110 con 0x7fc31415ed20 2024-09-15T23:12:52.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.578+0000 7fc31259c640 1 -- 172.21.15.123:0/2728798845 >> v1:172.21.15.123:6789/0 conn(0x7fc31415ed20 legacy=0x7fc3140b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:52.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.578+0000 7fc31259c640 1 -- 172.21.15.123:0/2728798845 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3140d3890 con 0x7fc3140b6970 2024-09-15T23:12:52.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.578+0000 7fc31259c640 1 --2- 172.21.15.123:0/2728798845 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3140b6970 0x7fc3140b80d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc009e50 tx=0x7fc2fc02a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b10cb1192c4dbf06 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:52.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.578+0000 7fc311d9b640 1 -- 172.21.15.123:0/2728798845 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc036070 con 0x7fc3140b6970 2024-09-15T23:12:52.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.579+0000 7fc311d9b640 1 -- 172.21.15.123:0/2728798845 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2fc031600 con 0x7fc3140b6970 2024-09-15T23:12:52.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.579+0000 7fc311d9b640 1 -- 172.21.15.123:0/2728798845 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc0319d0 con 0x7fc3140b6970 2024-09-15T23:12:52.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.579+0000 7fc31919f640 1 -- 172.21.15.123:0/2728798845 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3140b6970 msgr2=0x7fc3140b80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:52.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.579+0000 7fc31919f640 1 --2- 172.21.15.123:0/2728798845 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3140b6970 0x7fc3140b80d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc009e50 tx=0x7fc2fc02a6d0 comp rx=0 tx=0).stop 2024-09-15T23:12:52.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.579+0000 7fc31919f640 1 -- 172.21.15.123:0/2728798845 shutdown_connections 2024-09-15T23:12:52.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.579+0000 7fc31919f640 1 --2- 172.21.15.123:0/2728798845 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3140b6970 0x7fc3140b80d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:52.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.579+0000 7fc31919f640 1 -- 172.21.15.123:0/2728798845 >> 172.21.15.123:0/2728798845 conn(0x7fc3140d1260 msgr2=0x7fc3140d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:52.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.579+0000 7fc31919f640 1 -- 172.21.15.123:0/2728798845 shutdown_connections 2024-09-15T23:12:52.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.579+0000 7fc31919f640 1 -- 172.21.15.123:0/2728798845 wait complete. 2024-09-15T23:12:52.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.580+0000 7fc31919f640 1 Processor -- start 2024-09-15T23:12:52.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.581+0000 7fc31919f640 1 -- start start 2024-09-15T23:12:52.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.581+0000 7fc31919f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc3140b6970 0x7fc3140ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:52.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.581+0000 7fc31919f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc3140d23b0 0x7fc3140ce500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:52.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.581+0000 7fc31919f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc31415ed20 0x7fc314154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:52.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.581+0000 7fc31919f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc3140d32a0 con 0x7fc31415ed20 2024-09-15T23:12:52.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.581+0000 7fc31919f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc3140d3e50 con 0x7fc3140d23b0 2024-09-15T23:12:52.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.581+0000 7fc31919f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc31415f100 con 0x7fc3140b6970 2024-09-15T23:12:52.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.581+0000 7fc31359e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc31415ed20 0x7fc314154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:52.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.581+0000 7fc31359e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc31415ed20 0x7fc314154c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55114/0 (socket says 172.21.15.123:55114) 2024-09-15T23:12:52.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.581+0000 7fc31359e640 1 -- 172.21.15.123:0/2464408659 learned_addr learned my addr 172.21.15.123:0/2464408659 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:52.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.581+0000 7fc31259c640 1 --2- 172.21.15.123:0/2464408659 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc3140d23b0 0x7fc3140ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:52.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.582+0000 7fc312d9d640 1 --2- 172.21.15.123:0/2464408659 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc3140b6970 0x7fc3140ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:52.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.582+0000 7fc31359e640 1 -- 172.21.15.123:0/2464408659 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc3140b6970 msgr2=0x7fc3140ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:52.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.582+0000 7fc31359e640 1 --2- 172.21.15.123:0/2464408659 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc3140b6970 0x7fc3140ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:52.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.582+0000 7fc31359e640 1 -- 172.21.15.123:0/2464408659 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc3140d23b0 msgr2=0x7fc3140ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:52.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.582+0000 7fc31359e640 1 --2- 172.21.15.123:0/2464408659 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc3140d23b0 0x7fc3140ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:52.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.582+0000 7fc31359e640 1 -- 172.21.15.123:0/2464408659 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc314156620 con 0x7fc31415ed20 2024-09-15T23:12:52.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.582+0000 7fc31259c640 1 --2- 172.21.15.123:0/2464408659 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc3140d23b0 0x7fc3140ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:52.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.582+0000 7fc31359e640 1 --2- 172.21.15.123:0/2464408659 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc31415ed20 0x7fc314154c80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc30400c410 tx=0x7fc30400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:52.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.582+0000 7fc30b7fe640 1 -- 172.21.15.123:0/2464408659 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc304011790 con 0x7fc31415ed20 2024-09-15T23:12:52.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.582+0000 7fc30b7fe640 1 -- 172.21.15.123:0/2464408659 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc304017070 con 0x7fc31415ed20 2024-09-15T23:12:52.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.582+0000 7fc31919f640 1 -- 172.21.15.123:0/2464408659 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc314156900 con 0x7fc31415ed20 2024-09-15T23:12:52.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.582+0000 7fc30b7fe640 1 -- 172.21.15.123:0/2464408659 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc304011bb0 con 0x7fc31415ed20 2024-09-15T23:12:52.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.582+0000 7fc31919f640 1 -- 172.21.15.123:0/2464408659 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3140cc7f0 con 0x7fc31415ed20 2024-09-15T23:12:52.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.583+0000 7fc31919f640 1 -- 172.21.15.123:0/2464408659 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3140cc9f0 con 0x7fc31415ed20 2024-09-15T23:12:52.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.583+0000 7fc30b7fe640 1 -- 172.21.15.123:0/2464408659 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc30401c460 con 0x7fc31415ed20 2024-09-15T23:12:52.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.584+0000 7fc30b7fe640 1 --2- 172.21.15.123:0/2464408659 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc2f406c2b0 0x7fc2f406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:52.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.584+0000 7fc30b7fe640 1 -- 172.21.15.123:0/2464408659 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fc30408afb0 con 0x7fc31415ed20 2024-09-15T23:12:52.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.584+0000 7fc312d9d640 1 --2- 172.21.15.123:0/2464408659 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc2f406c2b0 0x7fc2f406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:52.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.585+0000 7fc312d9d640 1 --2- 172.21.15.123:0/2464408659 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc2f406c2b0 0x7fc2f406e770 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc30c000f60 tx=0x7fc30c007970 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:52.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.588+0000 7fc30b7fe640 1 -- 172.21.15.123:0/2464408659 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc3140cc9f0 con 0x7fc31415ed20 2024-09-15T23:12:52.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.755+0000 7fc31919f640 1 -- 172.21.15.123:0/2464408659 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc3140d0260 con 0x7fc31415ed20 2024-09-15T23:12:52.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.756+0000 7fc30b7fe640 1 -- 172.21.15.123:0/2464408659 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16706 (secure 0 0 0) 0x7fc304021020 con 0x7fc31415ed20 2024-09-15T23:12:52.757 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:52.757 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":32,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:12:51.772230+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:12:49.560175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-15T23:12:50.754784+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:12:52.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.758+0000 7fc31919f640 1 -- 172.21.15.123:0/2464408659 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc2f406c2b0 msgr2=0x7fc2f406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:52.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.758+0000 7fc31919f640 1 --2- 172.21.15.123:0/2464408659 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc2f406c2b0 0x7fc2f406e770 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc30c000f60 tx=0x7fc30c007970 comp rx=0 tx=0).stop 2024-09-15T23:12:52.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.758+0000 7fc31919f640 1 -- 172.21.15.123:0/2464408659 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc31415ed20 msgr2=0x7fc314154c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:52.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.758+0000 7fc31919f640 1 --2- 172.21.15.123:0/2464408659 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc31415ed20 0x7fc314154c80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc30400c410 tx=0x7fc30400c8d0 comp rx=0 tx=0).stop 2024-09-15T23:12:52.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.758+0000 7fc31919f640 1 -- 172.21.15.123:0/2464408659 shutdown_connections 2024-09-15T23:12:52.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.758+0000 7fc31919f640 1 --2- 172.21.15.123:0/2464408659 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc2f406c2b0 0x7fc2f406e770 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:52.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.758+0000 7fc31919f640 1 --2- 172.21.15.123:0/2464408659 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc31415ed20 0x7fc314154c80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:52.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.758+0000 7fc31919f640 1 --2- 172.21.15.123:0/2464408659 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc3140d23b0 0x7fc3140ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:52.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.758+0000 7fc31919f640 1 --2- 172.21.15.123:0/2464408659 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc3140b6970 0x7fc3140ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:52.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.758+0000 7fc31919f640 1 -- 172.21.15.123:0/2464408659 >> 172.21.15.123:0/2464408659 conn(0x7fc3140d1260 msgr2=0x7fc3140b5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:52.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.758+0000 7fc31919f640 1 -- 172.21.15.123:0/2464408659 shutdown_connections 2024-09-15T23:12:52.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.758+0000 7fc31919f640 1 -- 172.21.15.123:0/2464408659 wait complete. 2024-09-15T23:12:52.770 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:12:52.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.867+0000 7fe722877640 1 Processor -- start 2024-09-15T23:12:52.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.867+0000 7fe722877640 1 -- start start 2024-09-15T23:12:52.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.868+0000 7fe722877640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe71c13eb20 0x7fe71c15c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:52.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.868+0000 7fe722877640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe71c071180 con 0x7fe71c0b2d40 2024-09-15T23:12:52.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.868+0000 7fe722877640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe71c071460 con 0x7fe71c06c320 2024-09-15T23:12:52.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.868+0000 7fe722877640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe71c071ab0 con 0x7fe71c13eb20 2024-09-15T23:12:52.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.868+0000 7fe720e14640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe71c13eb20 0x7fe71c15c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:52.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.868+0000 7fe720e14640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe71c13eb20 0x7fe71c15c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55128/0 (socket says 172.21.15.123:55128) 2024-09-15T23:12:52.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.868+0000 7fe71bfff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe71c0b2d40 0x7fe71c06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41202/0 (socket says 172.21.15.123:41202) 2024-09-15T23:12:52.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.868+0000 7fe720e14640 1 -- 172.21.15.123:0/506457335 learned_addr learned my addr 172.21.15.123:0/506457335 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:52.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.868+0000 7fe720e14640 1 -- 172.21.15.123:0/506457335 >> v1:172.21.15.188:6789/0 conn(0x7fe71c06c320 legacy=0x7fe71c15bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:52.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.868+0000 7fe720e14640 1 -- 172.21.15.123:0/506457335 >> v1:172.21.15.123:6789/0 conn(0x7fe71c0b2d40 legacy=0x7fe71c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:52.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.868+0000 7fe720e14640 1 -- 172.21.15.123:0/506457335 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe71c071740 con 0x7fe71c13eb20 2024-09-15T23:12:52.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.869+0000 7fe720e14640 1 --2- 172.21.15.123:0/506457335 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe71c13eb20 0x7fe71c15c400 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe71400d150 tx=0x7fe71402c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a66d20aff351762 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:52.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.869+0000 7fe71affd640 1 -- 172.21.15.123:0/506457335 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe714035020 con 0x7fe71c13eb20 2024-09-15T23:12:52.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.869+0000 7fe71affd640 1 -- 172.21.15.123:0/506457335 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe71400b2d0 con 0x7fe71c13eb20 2024-09-15T23:12:52.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.869+0000 7fe71affd640 1 -- 172.21.15.123:0/506457335 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71400b480 con 0x7fe71c13eb20 2024-09-15T23:12:52.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.870+0000 7fe722877640 1 -- 172.21.15.123:0/506457335 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe71c13eb20 msgr2=0x7fe71c15c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:52.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.870+0000 7fe722877640 1 --2- 172.21.15.123:0/506457335 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe71c13eb20 0x7fe71c15c400 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe71400d150 tx=0x7fe71402c9c0 comp rx=0 tx=0).stop 2024-09-15T23:12:52.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.870+0000 7fe722877640 1 -- 172.21.15.123:0/506457335 shutdown_connections 2024-09-15T23:12:52.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.870+0000 7fe722877640 1 --2- 172.21.15.123:0/506457335 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe71c13eb20 0x7fe71c15c400 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:52.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.870+0000 7fe722877640 1 -- 172.21.15.123:0/506457335 >> 172.21.15.123:0/506457335 conn(0x7fe71c0ccec0 msgr2=0x7fe71c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:52.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.870+0000 7fe722877640 1 -- 172.21.15.123:0/506457335 shutdown_connections 2024-09-15T23:12:52.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.870+0000 7fe722877640 1 -- 172.21.15.123:0/506457335 wait complete. 2024-09-15T23:12:52.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.871+0000 7fe722877640 1 Processor -- start 2024-09-15T23:12:52.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.871+0000 7fe722877640 1 -- start start 2024-09-15T23:12:52.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.872+0000 7fe722877640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe71c06c320 0x7fe71c1f15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:52.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.872+0000 7fe722877640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe71c0b2d40 0x7fe71c1f3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:52.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.872+0000 7fe722877640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe71c13eb20 0x7fe71c15d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:52.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.872+0000 7fe722877640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe71c0b3980 con 0x7fe71c06c320 2024-09-15T23:12:52.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.872+0000 7fe722877640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe71c0b3800 con 0x7fe71c13eb20 2024-09-15T23:12:52.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.872+0000 7fe722877640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe71c0b3b00 con 0x7fe71c0b2d40 2024-09-15T23:12:52.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.872+0000 7fe71bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe71c06c320 0x7fe71c1f15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:52.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.872+0000 7fe71bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe71c06c320 0x7fe71c1f15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55142/0 (socket says 172.21.15.123:55142) 2024-09-15T23:12:52.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.872+0000 7fe71bfff640 1 -- 172.21.15.123:0/2174727210 learned_addr learned my addr 172.21.15.123:0/2174727210 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:52.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.872+0000 7fe720e14640 1 --2- 172.21.15.123:0/2174727210 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe71c13eb20 0x7fe71c15d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:52.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.872+0000 7fe71bfff640 1 -- 172.21.15.123:0/2174727210 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe71c0b2d40 msgr2=0x7fe71c1f3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:52.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.872+0000 7fe71b7fe640 1 --2- 172.21.15.123:0/2174727210 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe71c0b2d40 0x7fe71c1f3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:52.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.872+0000 7fe71bfff640 1 --2- 172.21.15.123:0/2174727210 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe71c0b2d40 0x7fe71c1f3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:52.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.872+0000 7fe71bfff640 1 -- 172.21.15.123:0/2174727210 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe71c13eb20 msgr2=0x7fe71c15d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:52.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.872+0000 7fe71bfff640 1 --2- 172.21.15.123:0/2174727210 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe71c13eb20 0x7fe71c15d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:52.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.872+0000 7fe71bfff640 1 -- 172.21.15.123:0/2174727210 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe71c1f1f80 con 0x7fe71c06c320 2024-09-15T23:12:52.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.872+0000 7fe720e14640 1 --2- 172.21.15.123:0/2174727210 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe71c13eb20 0x7fe71c15d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:52.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.872+0000 7fe71b7fe640 1 --2- 172.21.15.123:0/2174727210 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe71c0b2d40 0x7fe71c1f3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:52.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.872+0000 7fe71bfff640 1 --2- 172.21.15.123:0/2174727210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe71c06c320 0x7fe71c1f15c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00c4d0 tx=0x7fe70c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:52.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.872+0000 7fe718ff9640 1 -- 172.21.15.123:0/2174727210 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe70c018070 con 0x7fe71c06c320 2024-09-15T23:12:52.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.872+0000 7fe718ff9640 1 -- 172.21.15.123:0/2174727210 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe70c007480 con 0x7fe71c06c320 2024-09-15T23:12:52.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.872+0000 7fe722877640 1 -- 172.21.15.123:0/2174727210 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe71c1f2260 con 0x7fe71c06c320 2024-09-15T23:12:52.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.872+0000 7fe718ff9640 1 -- 172.21.15.123:0/2174727210 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe70c0047e0 con 0x7fe71c06c320 2024-09-15T23:12:52.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.872+0000 7fe722877640 1 -- 172.21.15.123:0/2174727210 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe71c1f2820 con 0x7fe71c06c320 2024-09-15T23:12:52.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.873+0000 7fe722877640 1 -- 172.21.15.123:0/2174727210 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe71c06bc10 con 0x7fe71c06c320 2024-09-15T23:12:52.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.874+0000 7fe718ff9640 1 -- 172.21.15.123:0/2174727210 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe70c01b070 con 0x7fe71c06c320 2024-09-15T23:12:52.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.874+0000 7fe718ff9640 1 --2- 172.21.15.123:0/2174727210 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe70806c2b0 0x7fe70806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:52.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.874+0000 7fe718ff9640 1 -- 172.21.15.123:0/2174727210 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fe70c08a750 con 0x7fe71c06c320 2024-09-15T23:12:52.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.875+0000 7fe71b7fe640 1 --2- 172.21.15.123:0/2174727210 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe70806c2b0 0x7fe70806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:52.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.875+0000 7fe71b7fe640 1 --2- 172.21.15.123:0/2174727210 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe70806c2b0 0x7fe70806e770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe71c15d250 tx=0x7fe710009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:52.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:52.878+0000 7fe718ff9640 1 -- 172.21.15.123:0/2174727210 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe70c058ec0 con 0x7fe71c06c320 2024-09-15T23:12:53.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.046+0000 7fe722877640 1 -- 172.21.15.123:0/2174727210 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe71c06c9c0 con 0x7fe71c06c320 2024-09-15T23:12:53.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.047+0000 7fe718ff9640 1 -- 172.21.15.123:0/2174727210 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16706 (secure 0 0 0) 0x7fe70c0587c0 con 0x7fe71c06c320 2024-09-15T23:12:53.049 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:53.049 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":32,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:12:51.772230+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:12:49.560175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-15T23:12:50.754784+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:12:53.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.049+0000 7fe722877640 1 -- 172.21.15.123:0/2174727210 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe70806c2b0 msgr2=0x7fe70806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:53.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.049+0000 7fe722877640 1 --2- 172.21.15.123:0/2174727210 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe70806c2b0 0x7fe70806e770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe71c15d250 tx=0x7fe710009040 comp rx=0 tx=0).stop 2024-09-15T23:12:53.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.049+0000 7fe722877640 1 -- 172.21.15.123:0/2174727210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe71c06c320 msgr2=0x7fe71c1f15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:53.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.049+0000 7fe722877640 1 --2- 172.21.15.123:0/2174727210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe71c06c320 0x7fe71c1f15c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00c4d0 tx=0x7fe70c00c990 comp rx=0 tx=0).stop 2024-09-15T23:12:53.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.049+0000 7fe722877640 1 -- 172.21.15.123:0/2174727210 shutdown_connections 2024-09-15T23:12:53.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.049+0000 7fe722877640 1 --2- 172.21.15.123:0/2174727210 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe71c13eb20 0x7fe71c15d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:53.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.049+0000 7fe722877640 1 --2- 172.21.15.123:0/2174727210 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe71c0b2d40 0x7fe71c1f3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:53.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.049+0000 7fe722877640 1 --2- 172.21.15.123:0/2174727210 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe70806c2b0 0x7fe70806e770 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:53.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.049+0000 7fe722877640 1 --2- 172.21.15.123:0/2174727210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe71c06c320 0x7fe71c1f15c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:53.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.049+0000 7fe722877640 1 -- 172.21.15.123:0/2174727210 >> 172.21.15.123:0/2174727210 conn(0x7fe71c0ccec0 msgr2=0x7fe71c0b5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:53.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.050+0000 7fe722877640 1 -- 172.21.15.123:0/2174727210 shutdown_connections 2024-09-15T23:12:53.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.050+0000 7fe722877640 1 -- 172.21.15.123:0/2174727210 wait complete. 2024-09-15T23:12:53.062 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T23:12:53.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.162+0000 7f2cb7d03640 1 Processor -- start 2024-09-15T23:12:53.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.162+0000 7f2cb7d03640 1 -- start start 2024-09-15T23:12:53.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.163+0000 7f2cb7d03640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2cb00ccf30 0x7f2cb00b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:53.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.163+0000 7f2cb7d03640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cb00cf2e0 con 0x7f2cb015b7c0 2024-09-15T23:12:53.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.163+0000 7f2cb7d03640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cb0070fe0 con 0x7f2cb00cead0 2024-09-15T23:12:53.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.163+0000 7f2cb7d03640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f2cb00712c0 con 0x7f2cb00ccf30 2024-09-15T23:12:53.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.163+0000 7f2cb5a9f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2cb00ccf30 0x7f2cb00b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:53.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.163+0000 7f2cb529e640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f2cb015b7c0 0x7f2cb00cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41216/0 (socket says 172.21.15.123:41216) 2024-09-15T23:12:53.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.163+0000 7f2cb5a9f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2cb00ccf30 0x7f2cb00b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55158/0 (socket says 172.21.15.123:55158) 2024-09-15T23:12:53.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.163+0000 7f2cb529e640 1 -- 172.21.15.123:0/3704214066 learned_addr learned my addr 172.21.15.123:0/3704214066 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:53.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.163+0000 7f2cb5a9f640 1 -- 172.21.15.123:0/3704214066 >> v1:172.21.15.188:6789/0 conn(0x7f2cb00cead0 legacy=0x7f2cb0071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:53.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.163+0000 7f2cb5a9f640 1 -- 172.21.15.123:0/3704214066 >> v1:172.21.15.123:6789/0 conn(0x7f2cb015b7c0 legacy=0x7f2cb00cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:53.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.163+0000 7f2cb4a9d640 1 -- 172.21.15.123:0/3704214066 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3761759122 0 0) 0x7f2cb00cf2e0 con 0x7f2cb015b7c0 2024-09-15T23:12:53.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.163+0000 7f2cb5a9f640 1 -- 172.21.15.123:0/3704214066 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb00715a0 con 0x7f2cb00ccf30 2024-09-15T23:12:53.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.164+0000 7f2cb5a9f640 1 --2- 172.21.15.123:0/3704214066 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cb00ccf30 0x7f2cb00b2c50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2cac0097a0 tx=0x7f2cac02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d173e650db30af server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:53.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.164+0000 7f2cb4a9d640 1 -- 172.21.15.123:0/3704214066 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cac037070 con 0x7f2cb00ccf30 2024-09-15T23:12:53.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.164+0000 7f2cb4a9d640 1 -- 172.21.15.123:0/3704214066 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cac032440 con 0x7f2cb00ccf30 2024-09-15T23:12:53.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.164+0000 7f2cb4a9d640 1 -- 172.21.15.123:0/3704214066 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cac032810 con 0x7f2cb00ccf30 2024-09-15T23:12:53.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.164+0000 7f2cb7d03640 1 -- 172.21.15.123:0/3704214066 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cb00ccf30 msgr2=0x7f2cb00b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:53.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.164+0000 7f2cb7d03640 1 --2- 172.21.15.123:0/3704214066 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cb00ccf30 0x7f2cb00b2c50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2cac0097a0 tx=0x7f2cac02a1a0 comp rx=0 tx=0).stop 2024-09-15T23:12:53.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.165+0000 7f2cb7d03640 1 -- 172.21.15.123:0/3704214066 shutdown_connections 2024-09-15T23:12:53.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.165+0000 7f2cb7d03640 1 --2- 172.21.15.123:0/3704214066 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cb00ccf30 0x7f2cb00b2c50 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:53.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.165+0000 7f2cb7d03640 1 -- 172.21.15.123:0/3704214066 >> 172.21.15.123:0/3704214066 conn(0x7f2cb006d0f0 msgr2=0x7f2cb006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:53.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.165+0000 7f2cb7d03640 1 -- 172.21.15.123:0/3704214066 shutdown_connections 2024-09-15T23:12:53.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.165+0000 7f2cb7d03640 1 -- 172.21.15.123:0/3704214066 wait complete. 2024-09-15T23:12:53.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.166+0000 7f2cb7d03640 1 Processor -- start 2024-09-15T23:12:53.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.166+0000 7f2cb7d03640 1 -- start start 2024-09-15T23:12:53.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.166+0000 7f2cb7d03640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2cb00ccf30 0x7f2cb0150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:53.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.166+0000 7f2cb7d03640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2cb00cead0 0x7f2cb01f61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:53.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.167+0000 7f2cb7d03640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cb015b7c0 0x7f2cb0159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:53.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.167+0000 7f2cb7d03640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb00cf080 con 0x7f2cb015b7c0 2024-09-15T23:12:53.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.167+0000 7f2cb7d03640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb00cef00 con 0x7f2cb00ccf30 2024-09-15T23:12:53.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.167+0000 7f2cb7d03640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f2cb00721d0 con 0x7f2cb00cead0 2024-09-15T23:12:53.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.167+0000 7f2cb62a0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cb015b7c0 0x7f2cb0159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:53.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.167+0000 7f2cb62a0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cb015b7c0 0x7f2cb0159a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55168/0 (socket says 172.21.15.123:55168) 2024-09-15T23:12:53.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.167+0000 7f2cb62a0640 1 -- 172.21.15.123:0/2421968477 learned_addr learned my addr 172.21.15.123:0/2421968477 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:53.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.167+0000 7f2cb5a9f640 1 --2- 172.21.15.123:0/2421968477 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2cb00ccf30 0x7f2cb0150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:53.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.167+0000 7f2cb529e640 1 --2- 172.21.15.123:0/2421968477 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2cb00cead0 0x7f2cb01f61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:53.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.167+0000 7f2cb62a0640 1 -- 172.21.15.123:0/2421968477 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2cb00cead0 msgr2=0x7f2cb01f61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:53.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.167+0000 7f2cb62a0640 1 --2- 172.21.15.123:0/2421968477 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2cb00cead0 0x7f2cb01f61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:53.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.167+0000 7f2cb62a0640 1 -- 172.21.15.123:0/2421968477 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2cb00ccf30 msgr2=0x7f2cb0150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:53.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.167+0000 7f2cb62a0640 1 --2- 172.21.15.123:0/2421968477 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2cb00ccf30 0x7f2cb0150350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:53.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.167+0000 7f2cb62a0640 1 -- 172.21.15.123:0/2421968477 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb015ace0 con 0x7f2cb015b7c0 2024-09-15T23:12:53.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.167+0000 7f2cb62a0640 1 --2- 172.21.15.123:0/2421968477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cb015b7c0 0x7f2cb0159a60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2ca800c7d0 tx=0x7f2ca800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:53.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.167+0000 7f2ca67fc640 1 -- 172.21.15.123:0/2421968477 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8003b70 con 0x7f2cb015b7c0 2024-09-15T23:12:53.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.167+0000 7f2ca67fc640 1 -- 172.21.15.123:0/2421968477 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ca8003d30 con 0x7f2cb015b7c0 2024-09-15T23:12:53.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.167+0000 7f2cb7d03640 1 -- 172.21.15.123:0/2421968477 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cb015a440 con 0x7f2cb015b7c0 2024-09-15T23:12:53.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.167+0000 7f2ca67fc640 1 -- 172.21.15.123:0/2421968477 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca800aa90 con 0x7f2cb015b7c0 2024-09-15T23:12:53.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.167+0000 7f2cb7d03640 1 -- 172.21.15.123:0/2421968477 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cb015aa00 con 0x7f2cb015b7c0 2024-09-15T23:12:53.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.168+0000 7f2cb7d03640 1 -- 172.21.15.123:0/2421968477 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cb00b2c50 con 0x7f2cb015b7c0 2024-09-15T23:12:53.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.169+0000 7f2ca67fc640 1 -- 172.21.15.123:0/2421968477 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2ca800ac30 con 0x7f2cb015b7c0 2024-09-15T23:12:53.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.169+0000 7f2ca67fc640 1 --2- 172.21.15.123:0/2421968477 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2c9406c2b0 0x7f2c9406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:53.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.169+0000 7f2ca67fc640 1 -- 172.21.15.123:0/2421968477 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f2ca808b1d0 con 0x7f2cb015b7c0 2024-09-15T23:12:53.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.169+0000 7f2cb5a9f640 1 --2- 172.21.15.123:0/2421968477 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2c9406c2b0 0x7f2c9406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:53.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.170+0000 7f2cb5a9f640 1 --2- 172.21.15.123:0/2421968477 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2c9406c2b0 0x7f2c9406e770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2cac034000 tx=0x7f2cac02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:53.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.173+0000 7f2ca67fc640 1 -- 172.21.15.123:0/2421968477 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2ca80592f0 con 0x7f2cb015b7c0 2024-09-15T23:12:53.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.375+0000 7f2cb7d03640 1 -- 172.21.15.123:0/2421968477 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f2cb00cc960 con 0x7f2cb015b7c0 2024-09-15T23:12:53.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.454+0000 7f2ca67fc640 1 -- 172.21.15.123:0/2421968477 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v12) ==== 118+0+0 (secure 0 0 0) 0x7f2ca805d5f0 con 0x7f2cb015b7c0 2024-09-15T23:12:53.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.457+0000 7f2cb7d03640 1 -- 172.21.15.123:0/2421968477 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2c9406c2b0 msgr2=0x7f2c9406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:53.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.457+0000 7f2cb7d03640 1 --2- 172.21.15.123:0/2421968477 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2c9406c2b0 0x7f2c9406e770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2cac034000 tx=0x7f2cac02e000 comp rx=0 tx=0).stop 2024-09-15T23:12:53.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.457+0000 7f2cb7d03640 1 -- 172.21.15.123:0/2421968477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cb015b7c0 msgr2=0x7f2cb0159a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:53.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.457+0000 7f2cb7d03640 1 --2- 172.21.15.123:0/2421968477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cb015b7c0 0x7f2cb0159a60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2ca800c7d0 tx=0x7f2ca800cc90 comp rx=0 tx=0).stop 2024-09-15T23:12:53.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.457+0000 7f2cb7d03640 1 -- 172.21.15.123:0/2421968477 shutdown_connections 2024-09-15T23:12:53.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.457+0000 7f2cb7d03640 1 --2- 172.21.15.123:0/2421968477 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2c9406c2b0 0x7f2c9406e770 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:53.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.457+0000 7f2cb7d03640 1 --2- 172.21.15.123:0/2421968477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2cb015b7c0 0x7f2cb0159a60 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:53.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.457+0000 7f2cb7d03640 1 --2- 172.21.15.123:0/2421968477 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2cb00cead0 0x7f2cb01f61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:53.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.457+0000 7f2cb7d03640 1 --2- 172.21.15.123:0/2421968477 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2cb00ccf30 0x7f2cb0150350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:53.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.457+0000 7f2cb7d03640 1 -- 172.21.15.123:0/2421968477 >> 172.21.15.123:0/2421968477 conn(0x7f2cb006d0f0 msgr2=0x7f2cb00725c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:53.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.457+0000 7f2cb7d03640 1 -- 172.21.15.123:0/2421968477 shutdown_connections 2024-09-15T23:12:53.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.457+0000 7f2cb7d03640 1 -- 172.21.15.123:0/2421968477 wait complete. 2024-09-15T23:12:53.470 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T23:12:53.470 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T23:12:53.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.571+0000 7f20f959f640 1 Processor -- start 2024-09-15T23:12:53.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.571+0000 7f20f959f640 1 -- start start 2024-09-15T23:12:53.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.572+0000 7f20f959f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20f415e990 0x7f20f415ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:53.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.572+0000 7f20f959f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f20f40b5520 0x7f20f406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:53.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.572+0000 7f20f959f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20f415f2b0 con 0x7f20f406d260 2024-09-15T23:12:53.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.572+0000 7f20f959f640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f20f415f550 con 0x7f20f40b5520 2024-09-15T23:12:53.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.572+0000 7f20f959f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f20f415f830 con 0x7f20f415e990 2024-09-15T23:12:53.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.572+0000 7f20f2ffd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20f415e990 0x7f20f415ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:53.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.572+0000 7f20ea7fc640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f20f40b5520 0x7f20f406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:53.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.572+0000 7f20f2ffd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20f415e990 0x7f20f415ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:52860/0 (socket says 172.21.15.123:52860) 2024-09-15T23:12:53.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.572+0000 7f20f37fe640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f20f406d260 0x7f20f4162a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:33096/0 (socket says 172.21.15.123:33096) 2024-09-15T23:12:53.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.572+0000 7f20f2ffd640 1 -- 172.21.15.123:0/3931956874 learned_addr learned my addr 172.21.15.123:0/3931956874 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:53.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.573+0000 7f20f27fc640 1 -- 172.21.15.123:0/3931956874 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1444035484 0 0) 0x7f20f415f2b0 con 0x7f20f406d260 2024-09-15T23:12:53.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.573+0000 7f20f27fc640 1 -- 172.21.15.123:0/3931956874 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20e0003520 con 0x7f20f406d260 2024-09-15T23:12:53.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.573+0000 7f20f2ffd640 1 -- 172.21.15.123:0/3931956874 >> v2:172.21.15.188:3300/0 conn(0x7f20f40b5520 msgr2=0x7f20f406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:53.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.573+0000 7f20f2ffd640 1 --2- 172.21.15.123:0/3931956874 >> v2:172.21.15.188:3300/0 conn(0x7f20f40b5520 0x7f20f406cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:53.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.573+0000 7f20f2ffd640 1 -- 172.21.15.123:0/3931956874 >> v1:172.21.15.188:6789/0 conn(0x7f20f406d260 legacy=0x7f20f4162a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:53.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.573+0000 7f20f2ffd640 1 -- 172.21.15.123:0/3931956874 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f415fb10 con 0x7f20f415e990 2024-09-15T23:12:53.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.573+0000 7f20ea7fc640 1 --2- 172.21.15.123:0/3931956874 >> v2:172.21.15.188:3300/0 conn(0x7f20f40b5520 0x7f20f406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:12:53.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.574+0000 7f20f2ffd640 1 --2- 172.21.15.123:0/3931956874 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20f415e990 0x7f20f415ed70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f20e4009870 tx=0x7f20e402a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f3fe8ebfcabe2fd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:53.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.574+0000 7f20f27fc640 1 -- 172.21.15.123:0/3931956874 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e4037070 con 0x7f20f415e990 2024-09-15T23:12:53.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.574+0000 7f20f27fc640 1 -- 172.21.15.123:0/3931956874 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20e4032440 con 0x7f20f415e990 2024-09-15T23:12:53.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.574+0000 7f20f27fc640 1 -- 172.21.15.123:0/3931956874 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e40327f0 con 0x7f20f415e990 2024-09-15T23:12:53.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.574+0000 7f20f959f640 1 -- 172.21.15.123:0/3931956874 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20f415e990 msgr2=0x7f20f415ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:53.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.574+0000 7f20f959f640 1 --2- 172.21.15.123:0/3931956874 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20f415e990 0x7f20f415ed70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f20e4009870 tx=0x7f20e402a250 comp rx=0 tx=0).stop 2024-09-15T23:12:53.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.574+0000 7f20f959f640 1 -- 172.21.15.123:0/3931956874 shutdown_connections 2024-09-15T23:12:53.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.574+0000 7f20f959f640 1 --2- 172.21.15.123:0/3931956874 >> v2:172.21.15.188:3300/0 conn(0x7f20f40b5520 0x7f20f406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:53.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.574+0000 7f20f959f640 1 --2- 172.21.15.123:0/3931956874 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20f415e990 0x7f20f415ed70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:53.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.574+0000 7f20f959f640 1 -- 172.21.15.123:0/3931956874 >> 172.21.15.123:0/3931956874 conn(0x7f20f40d25d0 msgr2=0x7f20f40d29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:53.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.574+0000 7f20f959f640 1 -- 172.21.15.123:0/3931956874 shutdown_connections 2024-09-15T23:12:53.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.574+0000 7f20f959f640 1 -- 172.21.15.123:0/3931956874 wait complete. 2024-09-15T23:12:53.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.575+0000 7f20f959f640 1 Processor -- start 2024-09-15T23:12:53.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.576+0000 7f20f959f640 1 -- start start 2024-09-15T23:12:53.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.576+0000 7f20f959f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20f406d260 0x7f20f4153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:53.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.576+0000 7f20f959f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20f40b5520 0x7f20f4154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:53.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.576+0000 7f20f959f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20f415e990 0x7f20f4155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:53.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.576+0000 7f20f959f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f20f4163290 con 0x7f20f415e990 2024-09-15T23:12:53.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.576+0000 7f20f959f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f20f4163110 con 0x7f20f40b5520 2024-09-15T23:12:53.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.576+0000 7f20f959f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f20f40b6ff0 con 0x7f20f406d260 2024-09-15T23:12:53.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.577+0000 7f20f37fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20f415e990 0x7f20f4155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:53.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.577+0000 7f20f37fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20f415e990 0x7f20f4155020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55176/0 (socket says 172.21.15.123:55176) 2024-09-15T23:12:53.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.577+0000 7f20f37fe640 1 -- 172.21.15.123:0/1317104077 learned_addr learned my addr 172.21.15.123:0/1317104077 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:53.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.577+0000 7f20ea7fc640 1 --2- 172.21.15.123:0/1317104077 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20f40b5520 0x7f20f4154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:53.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.577+0000 7f20f2ffd640 1 --2- 172.21.15.123:0/1317104077 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20f406d260 0x7f20f4153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:53.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.577+0000 7f20f37fe640 1 -- 172.21.15.123:0/1317104077 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20f406d260 msgr2=0x7f20f4153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:53.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.577+0000 7f20f37fe640 1 --2- 172.21.15.123:0/1317104077 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20f406d260 0x7f20f4153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:53.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.577+0000 7f20f37fe640 1 -- 172.21.15.123:0/1317104077 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20f40b5520 msgr2=0x7f20f4154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:53.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.577+0000 7f20f37fe640 1 --2- 172.21.15.123:0/1317104077 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20f40b5520 0x7f20f4154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:53.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.577+0000 7f20f37fe640 1 -- 172.21.15.123:0/1317104077 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f4157cd0 con 0x7f20f415e990 2024-09-15T23:12:53.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.577+0000 7f20f37fe640 1 --2- 172.21.15.123:0/1317104077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20f415e990 0x7f20f4155020 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f20ec00c7b0 tx=0x7f20ec00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:53.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.577+0000 7f20ebfff640 1 -- 172.21.15.123:0/1317104077 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec017070 con 0x7f20f415e990 2024-09-15T23:12:53.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.577+0000 7f20ebfff640 1 -- 172.21.15.123:0/1317104077 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20ec00a640 con 0x7f20f415e990 2024-09-15T23:12:53.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.577+0000 7f20f959f640 1 -- 172.21.15.123:0/1317104077 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20f4156c30 con 0x7f20f415e990 2024-09-15T23:12:53.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.577+0000 7f20ebfff640 1 -- 172.21.15.123:0/1317104077 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec00aa10 con 0x7f20f415e990 2024-09-15T23:12:53.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.577+0000 7f20f959f640 1 -- 172.21.15.123:0/1317104077 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20f41571f0 con 0x7f20f415e990 2024-09-15T23:12:53.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.578+0000 7f20f959f640 1 -- 172.21.15.123:0/1317104077 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20f406cd20 con 0x7f20f415e990 2024-09-15T23:12:53.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.579+0000 7f20ebfff640 1 -- 172.21.15.123:0/1317104077 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f20ec01a070 con 0x7f20f415e990 2024-09-15T23:12:53.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.579+0000 7f20ebfff640 1 --2- 172.21.15.123:0/1317104077 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f20d406c2b0 0x7f20d406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:53.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.579+0000 7f20ebfff640 1 -- 172.21.15.123:0/1317104077 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f20ec08aa20 con 0x7f20f415e990 2024-09-15T23:12:53.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.579+0000 7f20f2ffd640 1 --2- 172.21.15.123:0/1317104077 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f20d406c2b0 0x7f20d406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:53.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.580+0000 7f20f2ffd640 1 --2- 172.21.15.123:0/1317104077 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f20d406c2b0 0x7f20d406e770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f20e4034000 tx=0x7f20e402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:53.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.583+0000 7f20ebfff640 1 -- 172.21.15.123:0/1317104077 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f20f4157cd0 con 0x7f20f415e990 2024-09-15T23:12:53.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:53.780+0000 7f20f959f640 1 -- 172.21.15.123:0/1317104077 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f20f40b1e70 con 0x7f20f415e990 2024-09-15T23:12:54.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.466+0000 7f20ebfff640 1 -- 172.21.15.123:0/1317104077 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v13) ==== 122+0+0 (secure 0 0 0) 0x7f20ec058b40 con 0x7f20f415e990 2024-09-15T23:12:54.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.468+0000 7f20f959f640 1 -- 172.21.15.123:0/1317104077 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f20d406c2b0 msgr2=0x7f20d406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:54.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.468+0000 7f20f959f640 1 --2- 172.21.15.123:0/1317104077 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f20d406c2b0 0x7f20d406e770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f20e4034000 tx=0x7f20e402e000 comp rx=0 tx=0).stop 2024-09-15T23:12:54.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.468+0000 7f20f959f640 1 -- 172.21.15.123:0/1317104077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20f415e990 msgr2=0x7f20f4155020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:54.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.468+0000 7f20f959f640 1 --2- 172.21.15.123:0/1317104077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20f415e990 0x7f20f4155020 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f20ec00c7b0 tx=0x7f20ec00cc70 comp rx=0 tx=0).stop 2024-09-15T23:12:54.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.468+0000 7f20f959f640 1 -- 172.21.15.123:0/1317104077 shutdown_connections 2024-09-15T23:12:54.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.468+0000 7f20f959f640 1 --2- 172.21.15.123:0/1317104077 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f20d406c2b0 0x7f20d406e770 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:54.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.468+0000 7f20f959f640 1 --2- 172.21.15.123:0/1317104077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20f415e990 0x7f20f4155020 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:54.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.468+0000 7f20f959f640 1 --2- 172.21.15.123:0/1317104077 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20f40b5520 0x7f20f4154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:54.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.468+0000 7f20f959f640 1 --2- 172.21.15.123:0/1317104077 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20f406d260 0x7f20f4153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:54.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.468+0000 7f20f959f640 1 -- 172.21.15.123:0/1317104077 >> 172.21.15.123:0/1317104077 conn(0x7f20f40d25d0 msgr2=0x7f20f4074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:54.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.468+0000 7f20f959f640 1 -- 172.21.15.123:0/1317104077 shutdown_connections 2024-09-15T23:12:54.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.468+0000 7f20f959f640 1 -- 172.21.15.123:0/1317104077 wait complete. 2024-09-15T23:12:54.481 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T23:12:54.481 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:12:54.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.579+0000 7f2348280640 1 Processor -- start 2024-09-15T23:12:54.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.579+0000 7f2348280640 1 -- start start 2024-09-15T23:12:54.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.580+0000 7f2348280640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f234015ed20 0x7f23400b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:54.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.580+0000 7f2348280640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23400d0e70 con 0x7f23400b90e0 2024-09-15T23:12:54.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.581+0000 7f2348280640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23400d00f0 con 0x7f23400d23b0 2024-09-15T23:12:54.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.581+0000 7f2348280640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f23400d41c0 con 0x7f234015ed20 2024-09-15T23:12:54.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.581+0000 7f234681d640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f23400b90e0 0x7f23400cf9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41222/0 (socket says 172.21.15.123:41222) 2024-09-15T23:12:54.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.581+0000 7f234681d640 1 -- 172.21.15.123:0/22950624 learned_addr learned my addr 172.21.15.123:0/22950624 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:54.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.581+0000 7f234601c640 1 --2- 172.21.15.123:0/22950624 >> v2:172.21.15.188:3300/0 conn(0x7f234015ed20 0x7f23400b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:54.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.581+0000 7f234501a640 1 -- 172.21.15.123:0/22950624 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2199245175 0 0) 0x7f2338001490 con 0x7f23400b90e0 2024-09-15T23:12:54.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.581+0000 7f234501a640 1 -- 172.21.15.123:0/22950624 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f232c003520 con 0x7f23400b90e0 2024-09-15T23:12:54.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.581+0000 7f234501a640 1 -- 172.21.15.123:0/22950624 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1166191918 0 0) 0x7f232c003520 con 0x7f23400b90e0 2024-09-15T23:12:54.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.581+0000 7f234501a640 1 -- 172.21.15.123:0/22950624 >> v2:172.21.15.188:3300/0 conn(0x7f234015ed20 msgr2=0x7f23400b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:54.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.581+0000 7f234501a640 1 --2- 172.21.15.123:0/22950624 >> v2:172.21.15.188:3300/0 conn(0x7f234015ed20 0x7f23400b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:54.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.581+0000 7f234501a640 1 -- 172.21.15.123:0/22950624 >> v1:172.21.15.188:6789/0 conn(0x7f23400d23b0 legacy=0x7f23400cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:54.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.581+0000 7f234501a640 1 -- 172.21.15.123:0/22950624 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23400d35b0 con 0x7f23400b90e0 2024-09-15T23:12:54.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.581+0000 7f234501a640 1 -- 172.21.15.123:0/22950624 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f2338001bc0 con 0x7f23400b90e0 2024-09-15T23:12:54.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.581+0000 7f234501a640 1 -- 172.21.15.123:0/22950624 >> v1:172.21.15.123:6789/0 conn(0x7f23400b90e0 legacy=0x7f23400cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:54.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.581+0000 7f234501a640 1 --2- 172.21.15.123:0/22950624 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f232c0039b0 0x7f232c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:54.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.581+0000 7f234501a640 1 --2- 172.21.15.123:0/22950624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f232c004800 0x7f232c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:54.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.581+0000 7f234501a640 1 --2- 172.21.15.123:0/22950624 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f232c0051c0 0x7f232c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:54.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.581+0000 7f234501a640 1 -- 172.21.15.123:0/22950624 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f23400d41c0 con 0x7f232c004800 2024-09-15T23:12:54.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.581+0000 7f234501a640 1 -- 172.21.15.123:0/22950624 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f232c00c160 con 0x7f232c0039b0 2024-09-15T23:12:54.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.581+0000 7f234501a640 1 -- 172.21.15.123:0/22950624 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f232c00c360 con 0x7f232c0051c0 2024-09-15T23:12:54.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.581+0000 7f234581b640 1 --2- 172.21.15.123:0/22950624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f232c004800 0x7f232c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:54.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.581+0000 7f234601c640 1 --2- 172.21.15.123:0/22950624 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f232c0039b0 0x7f232c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:54.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.581+0000 7f234681d640 1 --2- 172.21.15.123:0/22950624 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f232c0051c0 0x7f232c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:54.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.582+0000 7f234581b640 1 -- 172.21.15.123:0/22950624 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f232c0051c0 msgr2=0x7f232c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:54.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.582+0000 7f234581b640 1 --2- 172.21.15.123:0/22950624 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f232c0051c0 0x7f232c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:54.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.582+0000 7f234581b640 1 -- 172.21.15.123:0/22950624 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f232c0039b0 msgr2=0x7f232c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:54.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.582+0000 7f234581b640 1 --2- 172.21.15.123:0/22950624 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f232c0039b0 0x7f232c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:54.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.582+0000 7f234581b640 1 -- 172.21.15.123:0/22950624 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f232c003520 con 0x7f232c004800 2024-09-15T23:12:54.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.582+0000 7f234681d640 1 --2- 172.21.15.123:0/22950624 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f232c0051c0 0x7f232c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:54.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.582+0000 7f234681d640 1 -- 172.21.15.123:0/22950624 reap_dead start 2024-09-15T23:12:54.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.582+0000 7f234581b640 1 --2- 172.21.15.123:0/22950624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f232c004800 0x7f232c004c80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f233c001750 tx=0x7f232c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eef2adf9413c89b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:54.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.582+0000 7f234501a640 1 -- 172.21.15.123:0/22950624 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233c001370 con 0x7f232c004800 2024-09-15T23:12:54.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.582+0000 7f234501a640 1 -- 172.21.15.123:0/22950624 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f233c0052d0 con 0x7f232c004800 2024-09-15T23:12:54.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.582+0000 7f234501a640 1 -- 172.21.15.123:0/22950624 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233c02abc0 con 0x7f232c004800 2024-09-15T23:12:54.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.583+0000 7f2348280640 1 -- 172.21.15.123:0/22950624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f232c004800 msgr2=0x7f232c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:54.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.583+0000 7f2348280640 1 --2- 172.21.15.123:0/22950624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f232c004800 0x7f232c004c80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f233c001750 tx=0x7f232c005830 comp rx=0 tx=0).stop 2024-09-15T23:12:54.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.583+0000 7f2348280640 1 -- 172.21.15.123:0/22950624 shutdown_connections 2024-09-15T23:12:54.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.583+0000 7f2348280640 1 --2- 172.21.15.123:0/22950624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f232c004800 0x7f232c004c80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:54.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.583+0000 7f2348280640 1 -- 172.21.15.123:0/22950624 >> 172.21.15.123:0/22950624 conn(0x7f23400d1260 msgr2=0x7f23400d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:54.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.583+0000 7f2348280640 1 -- 172.21.15.123:0/22950624 shutdown_connections 2024-09-15T23:12:54.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.583+0000 7f2348280640 1 -- 172.21.15.123:0/22950624 wait complete. 2024-09-15T23:12:54.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.584+0000 7f2348280640 1 Processor -- start 2024-09-15T23:12:54.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.584+0000 7f2348280640 1 -- start start 2024-09-15T23:12:54.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.585+0000 7f2348280640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f232c004800 0x7f2340157580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:54.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.585+0000 7f2348280640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23401e7ce0 0x7f23401f8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:54.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.585+0000 7f2348280640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f23401e8160 0x7f23401f8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:54.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.585+0000 7f2348280640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f23400d3e50 con 0x7f23401e7ce0 2024-09-15T23:12:54.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.585+0000 7f2348280640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f23400d3b70 con 0x7f23401e8160 2024-09-15T23:12:54.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.585+0000 7f2348280640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f23400d32a0 con 0x7f232c004800 2024-09-15T23:12:54.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.585+0000 7f234581b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23401e7ce0 0x7f23401f8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:54.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.585+0000 7f234581b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23401e7ce0 0x7f23401f8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55196/0 (socket says 172.21.15.123:55196) 2024-09-15T23:12:54.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.585+0000 7f234581b640 1 -- 172.21.15.123:0/4003060825 learned_addr learned my addr 172.21.15.123:0/4003060825 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:54.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.585+0000 7f234581b640 1 -- 172.21.15.123:0/4003060825 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f232c004800 msgr2=0x7f2340157580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:54.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.585+0000 7f234581b640 1 --2- 172.21.15.123:0/4003060825 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f232c004800 0x7f2340157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:54.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.585+0000 7f234581b640 1 -- 172.21.15.123:0/4003060825 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f23401e8160 msgr2=0x7f23401f8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:54.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.585+0000 7f234581b640 1 --2- 172.21.15.123:0/4003060825 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f23401e8160 0x7f23401f8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:54.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.585+0000 7f234581b640 1 -- 172.21.15.123:0/4003060825 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23400ccb70 con 0x7f23401e7ce0 2024-09-15T23:12:54.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.585+0000 7f234581b640 1 --2- 172.21.15.123:0/4003060825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23401e7ce0 0x7f23401f8150 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f233c000c00 tx=0x7f233c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:54.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.586+0000 7f2332ffd640 1 -- 172.21.15.123:0/4003060825 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233c040030 con 0x7f23401e7ce0 2024-09-15T23:12:54.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.586+0000 7f2332ffd640 1 -- 172.21.15.123:0/4003060825 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f233c02be50 con 0x7f23401e7ce0 2024-09-15T23:12:54.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.586+0000 7f2348280640 1 -- 172.21.15.123:0/4003060825 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23400cce50 con 0x7f23401e7ce0 2024-09-15T23:12:54.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.586+0000 7f2332ffd640 1 -- 172.21.15.123:0/4003060825 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233c001370 con 0x7f23401e7ce0 2024-09-15T23:12:54.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.586+0000 7f2348280640 1 -- 172.21.15.123:0/4003060825 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23400cd410 con 0x7f23401e7ce0 2024-09-15T23:12:54.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.587+0000 7f2348280640 1 -- 172.21.15.123:0/4003060825 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f234015f100 con 0x7f23401e7ce0 2024-09-15T23:12:54.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.587+0000 7f2332ffd640 1 -- 172.21.15.123:0/4003060825 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f233c043070 con 0x7f23401e7ce0 2024-09-15T23:12:54.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.588+0000 7f2332ffd640 1 --2- 172.21.15.123:0/4003060825 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f232406c2b0 0x7f232406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:54.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.588+0000 7f2332ffd640 1 -- 172.21.15.123:0/4003060825 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f233c0aabe0 con 0x7f23401e7ce0 2024-09-15T23:12:54.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.588+0000 7f234601c640 1 --2- 172.21.15.123:0/4003060825 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f232406c2b0 0x7f232406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:54.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.588+0000 7f234601c640 1 --2- 172.21.15.123:0/4003060825 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f232406c2b0 0x7f232406e770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2334006e80 tx=0x7f2334006df0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:54.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.592+0000 7f2332ffd640 1 -- 172.21.15.123:0/4003060825 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f233c04b020 con 0x7f23401e7ce0 2024-09-15T23:12:54.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.789+0000 7f2348280640 1 -- 172.21.15.123:0/4003060825 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23400d1820 con 0x7f23401e7ce0 2024-09-15T23:12:54.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.790+0000 7f2332ffd640 1 -- 172.21.15.123:0/4003060825 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5231 (secure 0 0 0) 0x7f233c03a360 con 0x7f23401e7ce0 2024-09-15T23:12:54.791 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:54.792 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":13,"btime":"2024-09-15T23:12:54:460875+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/324550176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":324550176},{"type":"v1","addr":"172.21.15.188:6837","nonce":324550176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4696,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2893461525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2893461525},{"type":"v1","addr":"172.21.15.188:6836","nonce":2893461525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4773,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/4033133132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":4033133132},{"type":"v1","addr":"172.21.15.123:6833","nonce":4033133132}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:12:51.772541+0000","modified":"2024-09-15T23:12:53.781227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4776},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4776":{"gid":4776,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/1577644605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1577644605},{"type":"v1","addr":"172.21.15.123:6835","nonce":1577644605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4776,"qdb_cluster":[4776]},"id":2}]} 2024-09-15T23:12:54.792 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 13 2024-09-15T23:12:54.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.792+0000 7f2348280640 1 -- 172.21.15.123:0/4003060825 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f232406c2b0 msgr2=0x7f232406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:54.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.792+0000 7f2348280640 1 --2- 172.21.15.123:0/4003060825 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f232406c2b0 0x7f232406e770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2334006e80 tx=0x7f2334006df0 comp rx=0 tx=0).stop 2024-09-15T23:12:54.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.792+0000 7f2348280640 1 -- 172.21.15.123:0/4003060825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23401e7ce0 msgr2=0x7f23401f8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:54.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.792+0000 7f2348280640 1 --2- 172.21.15.123:0/4003060825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23401e7ce0 0x7f23401f8150 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f233c000c00 tx=0x7f233c001120 comp rx=0 tx=0).stop 2024-09-15T23:12:54.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.792+0000 7f2348280640 1 -- 172.21.15.123:0/4003060825 shutdown_connections 2024-09-15T23:12:54.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.792+0000 7f2348280640 1 --2- 172.21.15.123:0/4003060825 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f23401e8160 0x7f23401f8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:54.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.792+0000 7f2348280640 1 --2- 172.21.15.123:0/4003060825 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f232406c2b0 0x7f232406e770 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:54.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.792+0000 7f2348280640 1 --2- 172.21.15.123:0/4003060825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23401e7ce0 0x7f23401f8150 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:54.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.792+0000 7f2348280640 1 --2- 172.21.15.123:0/4003060825 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f232c004800 0x7f2340157580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:54.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.792+0000 7f2348280640 1 -- 172.21.15.123:0/4003060825 >> 172.21.15.123:0/4003060825 conn(0x7f23400d1260 msgr2=0x7f23400b95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:54.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.792+0000 7f2348280640 1 -- 172.21.15.123:0/4003060825 shutdown_connections 2024-09-15T23:12:54.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.792+0000 7f2348280640 1 -- 172.21.15.123:0/4003060825 wait complete. 2024-09-15T23:12:54.803 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:12:54.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.900+0000 7f9787d98640 1 Processor -- start 2024-09-15T23:12:54.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.901+0000 7f9787d98640 1 -- start start 2024-09-15T23:12:54.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.901+0000 7f9787d98640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f978015ed20 0x7f97800b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:54.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.901+0000 7f9787d98640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f97800d23b0 0x7f97800b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:54.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.901+0000 7f9787d98640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97800d0e70 con 0x7f97800cf2d0 2024-09-15T23:12:54.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.901+0000 7f9787d98640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f97800d41c0 con 0x7f97800d23b0 2024-09-15T23:12:54.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.901+0000 7f9787d98640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f97800d35b0 con 0x7f978015ed20 2024-09-15T23:12:54.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.902+0000 7f9785333640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f97800d23b0 0x7f97800b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:54.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.902+0000 7f9786335640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f97800cf2d0 0x7f97800cf700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41238/0 (socket says 172.21.15.123:41238) 2024-09-15T23:12:54.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.902+0000 7f9786335640 1 -- 172.21.15.123:0/2028166559 learned_addr learned my addr 172.21.15.123:0/2028166559 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:54.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.902+0000 7f9785b34640 1 --2- 172.21.15.123:0/2028166559 >> v2:172.21.15.188:3300/0 conn(0x7f978015ed20 0x7f97800b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:54.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.902+0000 7f9785333640 1 -- 172.21.15.123:0/2028166559 >> v2:172.21.15.188:3300/0 conn(0x7f978015ed20 msgr2=0x7f97800b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:54.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.902+0000 7f9785333640 1 --2- 172.21.15.123:0/2028166559 >> v2:172.21.15.188:3300/0 conn(0x7f978015ed20 0x7f97800b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:54.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.902+0000 7f9785333640 1 -- 172.21.15.123:0/2028166559 >> v1:172.21.15.123:6789/0 conn(0x7f97800cf2d0 legacy=0x7f97800cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:54.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.902+0000 7f9785333640 1 -- 172.21.15.123:0/2028166559 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97800d3890 con 0x7f97800d23b0 2024-09-15T23:12:54.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.902+0000 7f9784b32640 1 -- 172.21.15.123:0/2028166559 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3040045648 0 0) 0x7f9778001490 con 0x7f97800cf2d0 2024-09-15T23:12:54.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.903+0000 7f9785333640 1 --2- 172.21.15.123:0/2028166559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97800d23b0 0x7f97800b67a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f97800d47b0 tx=0x7f977c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faf1bf003ea24b30 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:54.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.903+0000 7f9784b32640 1 -- 172.21.15.123:0/2028166559 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977c037070 con 0x7f97800d23b0 2024-09-15T23:12:54.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.903+0000 7f9784b32640 1 -- 172.21.15.123:0/2028166559 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f977c032440 con 0x7f97800d23b0 2024-09-15T23:12:54.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.903+0000 7f9784b32640 1 -- 172.21.15.123:0/2028166559 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977c02ae60 con 0x7f97800d23b0 2024-09-15T23:12:54.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.903+0000 7f9787d98640 1 -- 172.21.15.123:0/2028166559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97800d23b0 msgr2=0x7f97800b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:54.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.903+0000 7f9787d98640 1 --2- 172.21.15.123:0/2028166559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97800d23b0 0x7f97800b67a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f97800d47b0 tx=0x7f977c02a110 comp rx=0 tx=0).stop 2024-09-15T23:12:54.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.903+0000 7f9787d98640 1 -- 172.21.15.123:0/2028166559 shutdown_connections 2024-09-15T23:12:54.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.903+0000 7f9787d98640 1 --2- 172.21.15.123:0/2028166559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97800d23b0 0x7f97800b67a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:54.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.903+0000 7f9787d98640 1 --2- 172.21.15.123:0/2028166559 >> v2:172.21.15.188:3300/0 conn(0x7f978015ed20 0x7f97800b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:54.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.903+0000 7f9787d98640 1 -- 172.21.15.123:0/2028166559 >> 172.21.15.123:0/2028166559 conn(0x7f97800d1260 msgr2=0x7f97800d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:54.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.903+0000 7f9787d98640 1 -- 172.21.15.123:0/2028166559 shutdown_connections 2024-09-15T23:12:54.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.903+0000 7f9787d98640 1 -- 172.21.15.123:0/2028166559 wait complete. 2024-09-15T23:12:54.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.904+0000 7f9787d98640 1 Processor -- start 2024-09-15T23:12:54.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.905+0000 7f9787d98640 1 -- start start 2024-09-15T23:12:54.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.905+0000 7f9787d98640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f97800cf2d0 0x7f97801f4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:54.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.905+0000 7f9787d98640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97800d23b0 0x7f97801614b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:54.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.905+0000 7f9787d98640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f978015ed20 0x7f97801619f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:54.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.905+0000 7f9787d98640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f97800d32a0 con 0x7f97800d23b0 2024-09-15T23:12:54.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.905+0000 7f9787d98640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f97800d3e50 con 0x7f97800cf2d0 2024-09-15T23:12:54.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.905+0000 7f9787d98640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f978015f100 con 0x7f978015ed20 2024-09-15T23:12:54.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.905+0000 7f9785333640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97800d23b0 0x7f97801614b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:54.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.905+0000 7f9785333640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97800d23b0 0x7f97801614b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55204/0 (socket says 172.21.15.123:55204) 2024-09-15T23:12:54.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.905+0000 7f9785333640 1 -- 172.21.15.123:0/1647498399 learned_addr learned my addr 172.21.15.123:0/1647498399 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:54.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.905+0000 7f9785b34640 1 --2- 172.21.15.123:0/1647498399 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f97800cf2d0 0x7f97801f4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:54.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.906+0000 7f9786335640 1 --2- 172.21.15.123:0/1647498399 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f978015ed20 0x7f97801619f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:54.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.906+0000 7f9785333640 1 -- 172.21.15.123:0/1647498399 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f978015ed20 msgr2=0x7f97801619f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:54.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.906+0000 7f9785333640 1 --2- 172.21.15.123:0/1647498399 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f978015ed20 0x7f97801619f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:54.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.906+0000 7f9785333640 1 -- 172.21.15.123:0/1647498399 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f97800cf2d0 msgr2=0x7f97801f4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:54.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.906+0000 7f9785333640 1 --2- 172.21.15.123:0/1647498399 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f97800cf2d0 0x7f97801f4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:54.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.906+0000 7f9785333640 1 -- 172.21.15.123:0/1647498399 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97800c8370 con 0x7f97800d23b0 2024-09-15T23:12:54.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.906+0000 7f9786335640 1 --2- 172.21.15.123:0/1647498399 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f978015ed20 0x7f97801619f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:54.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.906+0000 7f9785333640 1 --2- 172.21.15.123:0/1647498399 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97800d23b0 0x7f97801614b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f977c000c00 tx=0x7f977c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:54.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.906+0000 7f97727fc640 1 -- 172.21.15.123:0/1647498399 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977c037040 con 0x7f97800d23b0 2024-09-15T23:12:54.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.906+0000 7f97727fc640 1 -- 172.21.15.123:0/1647498399 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f977c042070 con 0x7f97800d23b0 2024-09-15T23:12:54.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.906+0000 7f9787d98640 1 -- 172.21.15.123:0/1647498399 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97800c8650 con 0x7f97800d23b0 2024-09-15T23:12:54.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.906+0000 7f97727fc640 1 -- 172.21.15.123:0/1647498399 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977c030bd0 con 0x7f97800d23b0 2024-09-15T23:12:54.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.906+0000 7f9787d98640 1 -- 172.21.15.123:0/1647498399 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97800c8c10 con 0x7f97800d23b0 2024-09-15T23:12:54.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.907+0000 7f9787d98640 1 -- 172.21.15.123:0/1647498399 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97800b7010 con 0x7f97800d23b0 2024-09-15T23:12:54.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.907+0000 7f97727fc640 1 -- 172.21.15.123:0/1647498399 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f977c047460 con 0x7f97800d23b0 2024-09-15T23:12:54.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.908+0000 7f97727fc640 1 --2- 172.21.15.123:0/1647498399 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f976406c2e0 0x7f976406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:54.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.908+0000 7f97727fc640 1 -- 172.21.15.123:0/1647498399 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f977c0ac000 con 0x7f97800d23b0 2024-09-15T23:12:54.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.908+0000 7f9785b34640 1 --2- 172.21.15.123:0/1647498399 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f976406c2e0 0x7f976406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:54.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.909+0000 7f9785b34640 1 --2- 172.21.15.123:0/1647498399 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f976406c2e0 0x7f976406e7a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9774006fd0 tx=0x7f9774008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:54.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:54.912+0000 7f97727fc640 1 -- 172.21.15.123:0/1647498399 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f977c032e20 con 0x7f97800d23b0 2024-09-15T23:12:55.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.076+0000 7f9787d98640 1 -- 172.21.15.123:0/1647498399 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f97800b3f20 con 0x7f97800d23b0 2024-09-15T23:12:55.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.077+0000 7f97727fc640 1 -- 172.21.15.123:0/1647498399 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16693 (secure 0 0 0) 0x7f977c07a770 con 0x7f97800d23b0 2024-09-15T23:12:55.079 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:55.079 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":33,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:12:53.444686+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:12:49.560175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-15T23:12:50.754784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:12:55.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.079+0000 7f9787d98640 1 -- 172.21.15.123:0/1647498399 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f976406c2e0 msgr2=0x7f976406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:55.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.079+0000 7f9787d98640 1 --2- 172.21.15.123:0/1647498399 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f976406c2e0 0x7f976406e7a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9774006fd0 tx=0x7f9774008040 comp rx=0 tx=0).stop 2024-09-15T23:12:55.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.079+0000 7f9787d98640 1 -- 172.21.15.123:0/1647498399 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97800d23b0 msgr2=0x7f97801614b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:55.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.079+0000 7f9787d98640 1 --2- 172.21.15.123:0/1647498399 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97800d23b0 0x7f97801614b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f977c000c00 tx=0x7f977c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.079+0000 7f9787d98640 1 -- 172.21.15.123:0/1647498399 shutdown_connections 2024-09-15T23:12:55.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.079+0000 7f9787d98640 1 --2- 172.21.15.123:0/1647498399 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f978015ed20 0x7f97801619f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.079+0000 7f9787d98640 1 --2- 172.21.15.123:0/1647498399 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f976406c2e0 0x7f976406e7a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.079+0000 7f9787d98640 1 --2- 172.21.15.123:0/1647498399 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97800d23b0 0x7f97801614b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.079+0000 7f9787d98640 1 --2- 172.21.15.123:0/1647498399 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f97800cf2d0 0x7f97801f4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.080+0000 7f9787d98640 1 -- 172.21.15.123:0/1647498399 >> 172.21.15.123:0/1647498399 conn(0x7f97800d1260 msgr2=0x7f9780155150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:55.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.080+0000 7f9787d98640 1 -- 172.21.15.123:0/1647498399 shutdown_connections 2024-09-15T23:12:55.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.080+0000 7f9787d98640 1 -- 172.21.15.123:0/1647498399 wait complete. 2024-09-15T23:12:55.091 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T23:12:55.091 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:12:55.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.188+0000 7f05bbd1a640 1 Processor -- start 2024-09-15T23:12:55.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.188+0000 7f05bbd1a640 1 -- start start 2024-09-15T23:12:55.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.189+0000 7f05bbd1a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05b413eb20 0x7f05b415c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:55.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.189+0000 7f05bbd1a640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05b4071180 con 0x7f05b406c320 2024-09-15T23:12:55.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.189+0000 7f05bbd1a640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05b4071460 con 0x7f05b40b2d40 2024-09-15T23:12:55.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.189+0000 7f05bbd1a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f05b4071ab0 con 0x7f05b413eb20 2024-09-15T23:12:55.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.189+0000 7f05b92b5640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f05b406c320 0x7f05b415bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41244/0 (socket says 172.21.15.123:41244) 2024-09-15T23:12:55.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.189+0000 7f05b92b5640 1 -- 172.21.15.123:0/3529307492 learned_addr learned my addr 172.21.15.123:0/3529307492 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:55.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.189+0000 7f05ba2b7640 1 --2- 172.21.15.123:0/3529307492 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05b413eb20 0x7f05b415c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:55.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.189+0000 7f05b8ab4640 1 -- 172.21.15.123:0/3529307492 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2199747454 0 0) 0x7f05b4071180 con 0x7f05b406c320 2024-09-15T23:12:55.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.189+0000 7f05b8ab4640 1 -- 172.21.15.123:0/3529307492 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05a0003520 con 0x7f05b406c320 2024-09-15T23:12:55.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.190+0000 7f05b8ab4640 1 -- 172.21.15.123:0/3529307492 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3796671356 0 0) 0x7f05a0003520 con 0x7f05b406c320 2024-09-15T23:12:55.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.190+0000 7f05b8ab4640 1 -- 172.21.15.123:0/3529307492 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05b413eb20 msgr2=0x7f05b415c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:55.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.190+0000 7f05b8ab4640 1 --2- 172.21.15.123:0/3529307492 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05b413eb20 0x7f05b415c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.190+0000 7f05b8ab4640 1 -- 172.21.15.123:0/3529307492 >> v1:172.21.15.188:6789/0 conn(0x7f05b40b2d40 legacy=0x7f05b406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:55.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.190+0000 7f05b8ab4640 1 -- 172.21.15.123:0/3529307492 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05b4071740 con 0x7f05b406c320 2024-09-15T23:12:55.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.190+0000 7f05b8ab4640 1 -- 172.21.15.123:0/3529307492 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f05a4001670 con 0x7f05b406c320 2024-09-15T23:12:55.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.190+0000 7f05b8ab4640 1 -- 172.21.15.123:0/3529307492 >> v1:172.21.15.123:6789/0 conn(0x7f05b406c320 legacy=0x7f05b415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:55.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.190+0000 7f05b8ab4640 1 --2- 172.21.15.123:0/3529307492 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05b413eb20 0x7f05a00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:55.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.190+0000 7f05b8ab4640 1 --2- 172.21.15.123:0/3529307492 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f05a0003f60 0x7f05a0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:55.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.190+0000 7f05b8ab4640 1 --2- 172.21.15.123:0/3529307492 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05a0004d40 0x7f05a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:55.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.190+0000 7f05b8ab4640 1 -- 172.21.15.123:0/3529307492 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f05b4071ab0 con 0x7f05a0004d40 2024-09-15T23:12:55.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.190+0000 7f05b8ab4640 1 -- 172.21.15.123:0/3529307492 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f05a000baa0 con 0x7f05a0003f60 2024-09-15T23:12:55.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.190+0000 7f05b8ab4640 1 -- 172.21.15.123:0/3529307492 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f05a000bca0 con 0x7f05b413eb20 2024-09-15T23:12:55.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.190+0000 7f05ba2b7640 1 --2- 172.21.15.123:0/3529307492 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05a0004d40 0x7f05a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:55.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.190+0000 7f05b92b5640 1 --2- 172.21.15.123:0/3529307492 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f05a0003f60 0x7f05a0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:55.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.190+0000 7f05b9ab6640 1 --2- 172.21.15.123:0/3529307492 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05b413eb20 0x7f05a00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:55.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.190+0000 7f05ba2b7640 1 -- 172.21.15.123:0/3529307492 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05b413eb20 msgr2=0x7f05a00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:55.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.190+0000 7f05ba2b7640 1 --2- 172.21.15.123:0/3529307492 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05b413eb20 0x7f05a00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.190+0000 7f05ba2b7640 1 -- 172.21.15.123:0/3529307492 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f05a0003f60 msgr2=0x7f05a0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:55.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.190+0000 7f05ba2b7640 1 --2- 172.21.15.123:0/3529307492 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f05a0003f60 0x7f05a0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.190+0000 7f05ba2b7640 1 -- 172.21.15.123:0/3529307492 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a0003520 con 0x7f05a0004d40 2024-09-15T23:12:55.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.190+0000 7f05b9ab6640 1 --2- 172.21.15.123:0/3529307492 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05b413eb20 0x7f05a00039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:55.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.191+0000 7f05ba2b7640 1 --2- 172.21.15.123:0/3529307492 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05a0004d40 0x7f05a00051c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f05ac009fc0 tx=0x7f05a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a630f86d19fb40 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:55.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.191+0000 7f05b8ab4640 1 -- 172.21.15.123:0/3529307492 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ac009c10 con 0x7f05a0004d40 2024-09-15T23:12:55.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.191+0000 7f05b8ab4640 1 -- 172.21.15.123:0/3529307492 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05ac036070 con 0x7f05a0004d40 2024-09-15T23:12:55.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.191+0000 7f05b8ab4640 1 -- 172.21.15.123:0/3529307492 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ac031880 con 0x7f05a0004d40 2024-09-15T23:12:55.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.191+0000 7f05bbd1a640 1 -- 172.21.15.123:0/3529307492 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05a0004d40 msgr2=0x7f05a00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:55.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.191+0000 7f05bbd1a640 1 --2- 172.21.15.123:0/3529307492 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05a0004d40 0x7f05a00051c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f05ac009fc0 tx=0x7f05a0005830 comp rx=0 tx=0).stop 2024-09-15T23:12:55.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.191+0000 7f05ba2b7640 1 -- 172.21.15.123:0/3529307492 reap_dead start 2024-09-15T23:12:55.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.191+0000 7f05bbd1a640 1 -- 172.21.15.123:0/3529307492 shutdown_connections 2024-09-15T23:12:55.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.191+0000 7f05bbd1a640 1 -- 172.21.15.123:0/3529307492 >> 172.21.15.123:0/3529307492 conn(0x7f05b40ccec0 msgr2=0x7f05b40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:55.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.191+0000 7f05bbd1a640 1 -- 172.21.15.123:0/3529307492 shutdown_connections 2024-09-15T23:12:55.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.192+0000 7f05bbd1a640 1 -- 172.21.15.123:0/3529307492 wait complete. 2024-09-15T23:12:55.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.193+0000 7f05bbd1a640 1 Processor -- start 2024-09-15T23:12:55.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.193+0000 7f05bbd1a640 1 -- start start 2024-09-15T23:12:55.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.193+0000 7f05bbd1a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f05a0004d40 0x7f05b41418c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:55.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.193+0000 7f05bbd1a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05b4160460 0x7f05b413dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:55.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.193+0000 7f05bbd1a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05b415f460 0x7f05b413d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:55.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.193+0000 7f05bbd1a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f05b415c790 con 0x7f05b415f460 2024-09-15T23:12:55.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.193+0000 7f05bbd1a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f05b415c610 con 0x7f05a0004d40 2024-09-15T23:12:55.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.193+0000 7f05bbd1a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f05b4164340 con 0x7f05b4160460 2024-09-15T23:12:55.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.193+0000 7f05ba2b7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05b415f460 0x7f05b413d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:55.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.193+0000 7f05ba2b7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05b415f460 0x7f05b413d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55218/0 (socket says 172.21.15.123:55218) 2024-09-15T23:12:55.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.193+0000 7f05ba2b7640 1 -- 172.21.15.123:0/1134557485 learned_addr learned my addr 172.21.15.123:0/1134557485 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:55.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.194+0000 7f05b9ab6640 1 --2- 172.21.15.123:0/1134557485 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f05a0004d40 0x7f05b41418c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:55.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.194+0000 7f05b92b5640 1 --2- 172.21.15.123:0/1134557485 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05b4160460 0x7f05b413dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:55.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.194+0000 7f05ba2b7640 1 -- 172.21.15.123:0/1134557485 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05b4160460 msgr2=0x7f05b413dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:55.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.194+0000 7f05ba2b7640 1 --2- 172.21.15.123:0/1134557485 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05b4160460 0x7f05b413dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.194+0000 7f05ba2b7640 1 -- 172.21.15.123:0/1134557485 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f05a0004d40 msgr2=0x7f05b41418c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:55.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.194+0000 7f05ba2b7640 1 --2- 172.21.15.123:0/1134557485 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f05a0004d40 0x7f05b41418c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.194+0000 7f05ba2b7640 1 -- 172.21.15.123:0/1134557485 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05b413e4f0 con 0x7f05b415f460 2024-09-15T23:12:55.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.194+0000 7f05b92b5640 1 --2- 172.21.15.123:0/1134557485 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05b4160460 0x7f05b413dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:12:55.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.194+0000 7f05ba2b7640 1 --2- 172.21.15.123:0/1134557485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05b415f460 0x7f05b413d190 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f05ac033040 tx=0x7f05ac009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:55.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.194+0000 7f05aa7fc640 1 -- 172.21.15.123:0/1134557485 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ac009c10 con 0x7f05b415f460 2024-09-15T23:12:55.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.194+0000 7f05aa7fc640 1 -- 172.21.15.123:0/1134557485 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05ac031dd0 con 0x7f05b415f460 2024-09-15T23:12:55.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.194+0000 7f05aa7fc640 1 -- 172.21.15.123:0/1134557485 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ac003bd0 con 0x7f05b415f460 2024-09-15T23:12:55.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.194+0000 7f05bbd1a640 1 -- 172.21.15.123:0/1134557485 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05b4141f50 con 0x7f05b415f460 2024-09-15T23:12:55.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.194+0000 7f05bbd1a640 1 -- 172.21.15.123:0/1134557485 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05b4142510 con 0x7f05b415f460 2024-09-15T23:12:55.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.195+0000 7f05bbd1a640 1 -- 172.21.15.123:0/1134557485 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05b415bcf0 con 0x7f05b415f460 2024-09-15T23:12:55.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.195+0000 7f05aa7fc640 1 -- 172.21.15.123:0/1134557485 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f05ac005d10 con 0x7f05b415f460 2024-09-15T23:12:55.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.196+0000 7f05aa7fc640 1 --2- 172.21.15.123:0/1134557485 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f059806c2e0 0x7f059806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:55.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.196+0000 7f05aa7fc640 1 -- 172.21.15.123:0/1134557485 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f05ac0aca90 con 0x7f05b415f460 2024-09-15T23:12:55.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.196+0000 7f05b9ab6640 1 --2- 172.21.15.123:0/1134557485 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f059806c2e0 0x7f059806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:55.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.197+0000 7f05b9ab6640 1 --2- 172.21.15.123:0/1134557485 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f059806c2e0 0x7f059806e7a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f05b0001750 tx=0x7f05b0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:55.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.200+0000 7f05aa7fc640 1 -- 172.21.15.123:0/1134557485 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f05ac04a060 con 0x7f05b415f460 2024-09-15T23:12:55.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.362+0000 7f05bbd1a640 1 -- 172.21.15.123:0/1134557485 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f05b40d0ab0 con 0x7f059806c2e0 2024-09-15T23:12:55.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.369+0000 7f05aa7fc640 1 -- 172.21.15.123:0/1134557485 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242078 (secure 0 0 0) 0x7f05b40d0ab0 con 0x7f059806c2e0 2024-09-15T23:12:55.372 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:55.373 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:12:55.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.372+0000 7f05bbd1a640 1 -- 172.21.15.123:0/1134557485 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f059806c2e0 msgr2=0x7f059806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:55.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.372+0000 7f05bbd1a640 1 --2- 172.21.15.123:0/1134557485 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f059806c2e0 0x7f059806e7a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f05b0001750 tx=0x7f05b0009040 comp rx=0 tx=0).stop 2024-09-15T23:12:55.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.372+0000 7f05bbd1a640 1 -- 172.21.15.123:0/1134557485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05b415f460 msgr2=0x7f05b413d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:55.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.372+0000 7f05bbd1a640 1 --2- 172.21.15.123:0/1134557485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05b415f460 0x7f05b413d190 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f05ac033040 tx=0x7f05ac009750 comp rx=0 tx=0).stop 2024-09-15T23:12:55.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.372+0000 7f05bbd1a640 1 -- 172.21.15.123:0/1134557485 shutdown_connections 2024-09-15T23:12:55.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.372+0000 7f05bbd1a640 1 --2- 172.21.15.123:0/1134557485 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f059806c2e0 0x7f059806e7a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.372+0000 7f05bbd1a640 1 --2- 172.21.15.123:0/1134557485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05b415f460 0x7f05b413d190 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.372+0000 7f05bbd1a640 1 --2- 172.21.15.123:0/1134557485 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05b4160460 0x7f05b413dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.372+0000 7f05bbd1a640 1 --2- 172.21.15.123:0/1134557485 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f05a0004d40 0x7f05b41418c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.372+0000 7f05bbd1a640 1 -- 172.21.15.123:0/1134557485 >> 172.21.15.123:0/1134557485 conn(0x7f05b40ccec0 msgr2=0x7f05b41403e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:55.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.372+0000 7f05bbd1a640 1 -- 172.21.15.123:0/1134557485 shutdown_connections 2024-09-15T23:12:55.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.372+0000 7f05bbd1a640 1 -- 172.21.15.123:0/1134557485 wait complete. 2024-09-15T23:12:55.383 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-09-15T23:12:53.511718+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":98,"acting":98,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":219888,"kb_used_data":3640,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754832,"statfs":{"total":773094113280,"available":772868947968,"internally_reserved":0,"allocated":3727360,"data_stored":2119980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000737"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:51.429763+0000","last_change":"2024-09-15T23:12:51.429763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.429763+0000","last_undegraded":"2024-09-15T23:12:51.429763+0000","last_fullsized":"2024-09-15T23:12:51.429763+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.446214+0000","last_change":"2024-09-15T23:12:51.446214+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.446214+0000","last_undegraded":"2024-09-15T23:12:51.446214+0000","last_fullsized":"2024-09-15T23:12:51.446214+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:51.429763+0000","last_change":"2024-09-15T23:12:51.429763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.429763+0000","last_undegraded":"2024-09-15T23:12:51.429763+0000","last_fullsized":"2024-09-15T23:12:51.429763+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.440720+0000","last_change":"2024-09-15T23:12:51.440720+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.440720+0000","last_undegraded":"2024-09-15T23:12:51.440720+0000","last_fullsized":"2024-09-15T23:12:51.440720+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.445209+0000","last_change":"2024-09-15T23:12:51.445209+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.445209+0000","last_undegraded":"2024-09-15T23:12:51.445209+0000","last_fullsized":"2024-09-15T23:12:51.445209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.435722+0000","last_change":"2024-09-15T23:12:51.435722+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.435722+0000","last_undegraded":"2024-09-15T23:12:51.435722+0000","last_fullsized":"2024-09-15T23:12:51.435722+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:51.429763+0000","last_change":"2024-09-15T23:12:51.429763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.429763+0000","last_undegraded":"2024-09-15T23:12:51.429763+0000","last_fullsized":"2024-09-15T23:12:51.429763+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:51.429763+0000","last_change":"2024-09-15T23:12:51.429763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.429763+0000","last_undegraded":"2024-09-15T23:12:51.429763+0000","last_fullsized":"2024-09-15T23:12:51.429763+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:51.429763+0000","last_change":"2024-09-15T23:12:51.429763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.429763+0000","last_undegraded":"2024-09-15T23:12:51.429763+0000","last_fullsized":"2024-09-15T23:12:51.429763+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.439885+0000","last_change":"2024-09-15T23:12:51.439885+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.439885+0000","last_undegraded":"2024-09-15T23:12:51.439885+0000","last_fullsized":"2024-09-15T23:12:51.439885+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:51.429763+0000","last_change":"2024-09-15T23:12:51.429763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.429763+0000","last_undegraded":"2024-09-15T23:12:51.429763+0000","last_fullsized":"2024-09-15T23:12:51.429763+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:51.429763+0000","last_change":"2024-09-15T23:12:51.429763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.429763+0000","last_undegraded":"2024-09-15T23:12:51.429763+0000","last_fullsized":"2024-09-15T23:12:51.429763+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.440839+0000","last_change":"2024-09-15T23:12:51.440839+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.440839+0000","last_undegraded":"2024-09-15T23:12:51.440839+0000","last_fullsized":"2024-09-15T23:12:51.440839+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.438090+0000","last_change":"2024-09-15T23:12:51.438090+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.438090+0000","last_undegraded":"2024-09-15T23:12:51.438090+0000","last_fullsized":"2024-09-15T23:12:51.438090+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:51.429763+0000","last_change":"2024-09-15T23:12:51.429763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.429763+0000","last_undegraded":"2024-09-15T23:12:51.429763+0000","last_fullsized":"2024-09-15T23:12:51.429763+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:51.429763+0000","last_change":"2024-09-15T23:12:51.429763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.429763+0000","last_undegraded":"2024-09-15T23:12:51.429763+0000","last_fullsized":"2024-09-15T23:12:51.429763+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:51.429763+0000","last_change":"2024-09-15T23:12:51.429763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.429763+0000","last_undegraded":"2024-09-15T23:12:51.429763+0000","last_fullsized":"2024-09-15T23:12:51.429763+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.436838+0000","last_change":"2024-09-15T23:12:51.436838+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.436838+0000","last_undegraded":"2024-09-15T23:12:51.436838+0000","last_fullsized":"2024-09-15T23:12:51.436838+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.438314+0000","last_change":"2024-09-15T23:12:51.438314+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.438314+0000","last_undegraded":"2024-09-15T23:12:51.438314+0000","last_fullsized":"2024-09-15T23:12:51.438314+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.442999+0000","last_change":"2024-09-15T23:12:51.442999+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.442999+0000","last_undegraded":"2024-09-15T23:12:51.442999+0000","last_fullsized":"2024-09-15T23:12:51.442999+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:51.429763+0000","last_change":"2024-09-15T23:12:51.429763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.429763+0000","last_undegraded":"2024-09-15T23:12:51.429763+0000","last_fullsized":"2024-09-15T23:12:51.429763+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:51.429763+0000","last_change":"2024-09-15T23:12:51.429763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.429763+0000","last_undegraded":"2024-09-15T23:12:51.429763+0000","last_fullsized":"2024-09-15T23:12:51.429763+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.441120+0000","last_change":"2024-09-15T23:12:51.441120+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.441120+0000","last_undegraded":"2024-09-15T23:12:51.441120+0000","last_fullsized":"2024-09-15T23:12:51.441120+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:51.429763+0000","last_change":"2024-09-15T23:12:51.429763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.429763+0000","last_undegraded":"2024-09-15T23:12:51.429763+0000","last_fullsized":"2024-09-15T23:12:51.429763+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.441100+0000","last_change":"2024-09-15T23:12:51.441100+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.441100+0000","last_undegraded":"2024-09-15T23:12:51.441100+0000","last_fullsized":"2024-09-15T23:12:51.441100+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.438323+0000","last_change":"2024-09-15T23:12:51.438323+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.438323+0000","last_undegraded":"2024-09-15T23:12:51.438323+0000","last_fullsized":"2024-09-15T23:12:51.438323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.449796+0000","last_change":"2024-09-15T23:12:51.449796+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.449796+0000","last_undegraded":"2024-09-15T23:12:51.449796+0000","last_fullsized":"2024-09-15T23:12:51.449796+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:51.429763+0000","last_change":"2024-09-15T23:12:51.429763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.429763+0000","last_undegraded":"2024-09-15T23:12:51.429763+0000","last_fullsized":"2024-09-15T23:12:51.429763+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:51.429763+0000","last_change":"2024-09-15T23:12:51.429763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.429763+0000","last_undegraded":"2024-09-15T23:12:51.429763+0000","last_fullsized":"2024-09-15T23:12:51.429763+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:51.429763+0000","last_change":"2024-09-15T23:12:51.429763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.429763+0000","last_undegraded":"2024-09-15T23:12:51.429763+0000","last_fullsized":"2024-09-15T23:12:51.429763+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:51.429763+0000","last_change":"2024-09-15T23:12:51.429763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.429763+0000","last_undegraded":"2024-09-15T23:12:51.429763+0000","last_fullsized":"2024-09-15T23:12:51.429763+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:51.429763+0000","last_change":"2024-09-15T23:12:51.429763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.429763+0000","last_undegraded":"2024-09-15T23:12:51.429763+0000","last_fullsized":"2024-09-15T23:12:51.429763+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.440761+0000","last_change":"2024-09-15T23:12:51.440761+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.440761+0000","last_undegraded":"2024-09-15T23:12:51.440761+0000","last_fullsized":"2024-09-15T23:12:51.440761+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:50.423120+0000","last_change":"2024-09-15T23:12:50.423120+0000","last_active":"2024-09-15T23:12:50.423120+0000","last_peered":"2024-09-15T23:12:50.423120+0000","last_clean":"2024-09-15T23:12:50.423120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:50.423120+0000","last_undegraded":"2024-09-15T23:12:50.423120+0000","last_fullsized":"2024-09-15T23:12:50.423120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:51.429763+0000","last_change":"2024-09-15T23:12:51.429763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.429763+0000","last_undegraded":"2024-09-15T23:12:51.429763+0000","last_fullsized":"2024-09-15T23:12:51.429763+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.451189+0000","last_change":"2024-09-15T23:12:51.446041+0000","last_active":"2024-09-15T23:12:51.451189+0000","last_peered":"2024-09-15T23:12:51.451189+0000","last_clean":"2024-09-15T23:12:51.451189+0000","last_became_active":"2024-09-15T23:12:51.445760+0000","last_became_peered":"2024-09-15T23:12:51.445760+0000","last_unstale":"2024-09-15T23:12:51.451189+0000","last_undegraded":"2024-09-15T23:12:51.451189+0000","last_fullsized":"2024-09-15T23:12:51.451189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:56.067201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:51.429763+0000","last_change":"2024-09-15T23:12:51.429763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.429763+0000","last_undegraded":"2024-09-15T23:12:51.429763+0000","last_fullsized":"2024-09-15T23:12:51.429763+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.461516+0000","last_change":"2024-09-15T23:12:51.456559+0000","last_active":"2024-09-15T23:12:51.461516+0000","last_peered":"2024-09-15T23:12:51.461516+0000","last_clean":"2024-09-15T23:12:51.461516+0000","last_became_active":"2024-09-15T23:12:51.456278+0000","last_became_peered":"2024-09-15T23:12:51.456278+0000","last_unstale":"2024-09-15T23:12:51.461516+0000","last_undegraded":"2024-09-15T23:12:51.461516+0000","last_fullsized":"2024-09-15T23:12:51.461516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:54:39.483240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.439175+0000","last_change":"2024-09-15T23:12:51.439175+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.439175+0000","last_undegraded":"2024-09-15T23:12:51.439175+0000","last_fullsized":"2024-09-15T23:12:51.439175+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.453564+0000","last_change":"2024-09-15T23:12:51.449436+0000","last_active":"2024-09-15T23:12:51.453564+0000","last_peered":"2024-09-15T23:12:51.453564+0000","last_clean":"2024-09-15T23:12:51.453564+0000","last_became_active":"2024-09-15T23:12:51.448706+0000","last_became_peered":"2024-09-15T23:12:51.448706+0000","last_unstale":"2024-09-15T23:12:51.453564+0000","last_undegraded":"2024-09-15T23:12:51.453564+0000","last_fullsized":"2024-09-15T23:12:51.453564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:14.541750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:51.429763+0000","last_change":"2024-09-15T23:12:51.429763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.429763+0000","last_undegraded":"2024-09-15T23:12:51.429763+0000","last_fullsized":"2024-09-15T23:12:51.429763+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:50.423120+0000","last_change":"2024-09-15T23:12:50.423120+0000","last_active":"2024-09-15T23:12:50.423120+0000","last_peered":"2024-09-15T23:12:50.423120+0000","last_clean":"2024-09-15T23:12:50.423120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:50.423120+0000","last_undegraded":"2024-09-15T23:12:50.423120+0000","last_fullsized":"2024-09-15T23:12:50.423120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:51.429763+0000","last_change":"2024-09-15T23:12:51.429763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.429763+0000","last_undegraded":"2024-09-15T23:12:51.429763+0000","last_fullsized":"2024-09-15T23:12:51.429763+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:50.423120+0000","last_change":"2024-09-15T23:12:50.423120+0000","last_active":"2024-09-15T23:12:50.423120+0000","last_peered":"2024-09-15T23:12:50.423120+0000","last_clean":"2024-09-15T23:12:50.423120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:50.423120+0000","last_undegraded":"2024-09-15T23:12:50.423120+0000","last_fullsized":"2024-09-15T23:12:50.423120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:51.429763+0000","last_change":"2024-09-15T23:12:51.429763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.429763+0000","last_undegraded":"2024-09-15T23:12:51.429763+0000","last_fullsized":"2024-09-15T23:12:51.429763+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.450316+0000","last_change":"2024-09-15T23:12:51.444721+0000","last_active":"2024-09-15T23:12:51.450316+0000","last_peered":"2024-09-15T23:12:51.450316+0000","last_clean":"2024-09-15T23:12:51.450316+0000","last_became_active":"2024-09-15T23:12:51.444442+0000","last_became_peered":"2024-09-15T23:12:51.444442+0000","last_unstale":"2024-09-15T23:12:51.450316+0000","last_undegraded":"2024-09-15T23:12:51.450316+0000","last_fullsized":"2024-09-15T23:12:51.450316+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:06.994100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.438261+0000","last_change":"2024-09-15T23:12:51.438261+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.438261+0000","last_undegraded":"2024-09-15T23:12:51.438261+0000","last_fullsized":"2024-09-15T23:12:51.438261+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:50.423120+0000","last_change":"2024-09-15T23:12:50.423120+0000","last_active":"2024-09-15T23:12:50.423120+0000","last_peered":"2024-09-15T23:12:50.423120+0000","last_clean":"2024-09-15T23:12:50.423120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:50.423120+0000","last_undegraded":"2024-09-15T23:12:50.423120+0000","last_fullsized":"2024-09-15T23:12:50.423120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:51.429763+0000","last_change":"2024-09-15T23:12:51.429763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.429763+0000","last_undegraded":"2024-09-15T23:12:51.429763+0000","last_fullsized":"2024-09-15T23:12:51.429763+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.461399+0000","last_change":"2024-09-15T23:12:51.453452+0000","last_active":"2024-09-15T23:12:51.461399+0000","last_peered":"2024-09-15T23:12:51.461399+0000","last_clean":"2024-09-15T23:12:51.461399+0000","last_became_active":"2024-09-15T23:12:51.452973+0000","last_became_peered":"2024-09-15T23:12:51.452973+0000","last_unstale":"2024-09-15T23:12:51.461399+0000","last_undegraded":"2024-09-15T23:12:51.461399+0000","last_fullsized":"2024-09-15T23:12:51.461399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:05.785498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.440634+0000","last_change":"2024-09-15T23:12:51.440634+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.440634+0000","last_undegraded":"2024-09-15T23:12:51.440634+0000","last_fullsized":"2024-09-15T23:12:51.440634+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.461485+0000","last_change":"2024-09-15T23:12:51.454019+0000","last_active":"2024-09-15T23:12:51.461485+0000","last_peered":"2024-09-15T23:12:51.461485+0000","last_clean":"2024-09-15T23:12:51.461485+0000","last_became_active":"2024-09-15T23:12:51.453772+0000","last_became_peered":"2024-09-15T23:12:51.453772+0000","last_unstale":"2024-09-15T23:12:51.461485+0000","last_undegraded":"2024-09-15T23:12:51.461485+0000","last_fullsized":"2024-09-15T23:12:51.461485+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:25.384320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.439554+0000","last_change":"2024-09-15T23:12:51.439554+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.439554+0000","last_undegraded":"2024-09-15T23:12:51.439554+0000","last_fullsized":"2024-09-15T23:12:51.439554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:50.423120+0000","last_change":"2024-09-15T23:12:50.423120+0000","last_active":"2024-09-15T23:12:50.423120+0000","last_peered":"2024-09-15T23:12:50.423120+0000","last_clean":"2024-09-15T23:12:50.423120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:50.423120+0000","last_undegraded":"2024-09-15T23:12:50.423120+0000","last_fullsized":"2024-09-15T23:12:50.423120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:51.429763+0000","last_change":"2024-09-15T23:12:51.429763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.429763+0000","last_undegraded":"2024-09-15T23:12:51.429763+0000","last_fullsized":"2024-09-15T23:12:51.429763+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.456070+0000","last_change":"2024-09-15T23:12:51.452177+0000","last_active":"2024-09-15T23:12:51.456070+0000","last_peered":"2024-09-15T23:12:51.456070+0000","last_clean":"2024-09-15T23:12:51.456070+0000","last_became_active":"2024-09-15T23:12:51.451878+0000","last_became_peered":"2024-09-15T23:12:51.451878+0000","last_unstale":"2024-09-15T23:12:51.456070+0000","last_undegraded":"2024-09-15T23:12:51.456070+0000","last_fullsized":"2024-09-15T23:12:51.456070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:15.959896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.442415+0000","last_change":"2024-09-15T23:12:51.442415+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.442415+0000","last_undegraded":"2024-09-15T23:12:51.442415+0000","last_fullsized":"2024-09-15T23:12:51.442415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:50.423120+0000","last_change":"2024-09-15T23:12:50.423120+0000","last_active":"2024-09-15T23:12:50.423120+0000","last_peered":"2024-09-15T23:12:50.423120+0000","last_clean":"2024-09-15T23:12:50.423120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:50.423120+0000","last_undegraded":"2024-09-15T23:12:50.423120+0000","last_fullsized":"2024-09-15T23:12:50.423120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.439007+0000","last_change":"2024-09-15T23:12:51.439007+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.439007+0000","last_undegraded":"2024-09-15T23:12:51.439007+0000","last_fullsized":"2024-09-15T23:12:51.439007+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.455944+0000","last_change":"2024-09-15T23:12:51.450186+0000","last_active":"2024-09-15T23:12:51.455944+0000","last_peered":"2024-09-15T23:12:51.455944+0000","last_clean":"2024-09-15T23:12:51.455944+0000","last_became_active":"2024-09-15T23:12:51.449900+0000","last_became_peered":"2024-09-15T23:12:51.449900+0000","last_unstale":"2024-09-15T23:12:51.455944+0000","last_undegraded":"2024-09-15T23:12:51.455944+0000","last_fullsized":"2024-09-15T23:12:51.455944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:46:42.615226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:51.429763+0000","last_change":"2024-09-15T23:12:51.429763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.429763+0000","last_undegraded":"2024-09-15T23:12:51.429763+0000","last_fullsized":"2024-09-15T23:12:51.429763+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.451163+0000","last_change":"2024-09-15T23:12:51.445393+0000","last_active":"2024-09-15T23:12:51.451163+0000","last_peered":"2024-09-15T23:12:51.451163+0000","last_clean":"2024-09-15T23:12:51.451163+0000","last_became_active":"2024-09-15T23:12:51.444942+0000","last_became_peered":"2024-09-15T23:12:51.444942+0000","last_unstale":"2024-09-15T23:12:51.451163+0000","last_undegraded":"2024-09-15T23:12:51.451163+0000","last_fullsized":"2024-09-15T23:12:51.451163+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:14.255788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:51.429763+0000","last_change":"2024-09-15T23:12:51.429763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.429763+0000","last_undegraded":"2024-09-15T23:12:51.429763+0000","last_fullsized":"2024-09-15T23:12:51.429763+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.450300+0000","last_change":"2024-09-15T23:12:51.445263+0000","last_active":"2024-09-15T23:12:51.450300+0000","last_peered":"2024-09-15T23:12:51.450300+0000","last_clean":"2024-09-15T23:12:51.450300+0000","last_became_active":"2024-09-15T23:12:51.444994+0000","last_became_peered":"2024-09-15T23:12:51.444994+0000","last_unstale":"2024-09-15T23:12:51.450300+0000","last_undegraded":"2024-09-15T23:12:51.450300+0000","last_fullsized":"2024-09-15T23:12:51.450300+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:22.839572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:51.429763+0000","last_change":"2024-09-15T23:12:51.429763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.429763+0000","last_undegraded":"2024-09-15T23:12:51.429763+0000","last_fullsized":"2024-09-15T23:12:51.429763+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.455860+0000","last_change":"2024-09-15T23:12:51.452056+0000","last_active":"2024-09-15T23:12:51.455860+0000","last_peered":"2024-09-15T23:12:51.455860+0000","last_clean":"2024-09-15T23:12:51.455860+0000","last_became_active":"2024-09-15T23:12:51.451778+0000","last_became_peered":"2024-09-15T23:12:51.451778+0000","last_unstale":"2024-09-15T23:12:51.455860+0000","last_undegraded":"2024-09-15T23:12:51.455860+0000","last_fullsized":"2024-09-15T23:12:51.455860+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:23:49.602062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:51.429763+0000","last_change":"2024-09-15T23:12:51.429763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.429763+0000","last_undegraded":"2024-09-15T23:12:51.429763+0000","last_fullsized":"2024-09-15T23:12:51.429763+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:50.423120+0000","last_change":"2024-09-15T23:12:50.423120+0000","last_active":"2024-09-15T23:12:50.423120+0000","last_peered":"2024-09-15T23:12:50.423120+0000","last_clean":"2024-09-15T23:12:50.423120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:50.423120+0000","last_undegraded":"2024-09-15T23:12:50.423120+0000","last_fullsized":"2024-09-15T23:12:50.423120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.450082+0000","last_change":"2024-09-15T23:12:51.450082+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.450082+0000","last_undegraded":"2024-09-15T23:12:51.450082+0000","last_fullsized":"2024-09-15T23:12:51.450082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:50.423120+0000","last_change":"2024-09-15T23:12:50.423120+0000","last_active":"2024-09-15T23:12:50.423120+0000","last_peered":"2024-09-15T23:12:50.423120+0000","last_clean":"2024-09-15T23:12:50.423120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:50.423120+0000","last_undegraded":"2024-09-15T23:12:50.423120+0000","last_fullsized":"2024-09-15T23:12:50.423120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.435763+0000","last_change":"2024-09-15T23:12:51.435763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.435763+0000","last_undegraded":"2024-09-15T23:12:51.435763+0000","last_fullsized":"2024-09-15T23:12:51.435763+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:50.423120+0000","last_change":"2024-09-15T23:12:50.423120+0000","last_active":"2024-09-15T23:12:50.423120+0000","last_peered":"2024-09-15T23:12:50.423120+0000","last_clean":"2024-09-15T23:12:50.423120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:50.423120+0000","last_undegraded":"2024-09-15T23:12:50.423120+0000","last_fullsized":"2024-09-15T23:12:50.423120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.441874+0000","last_change":"2024-09-15T23:12:51.441874+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.441874+0000","last_undegraded":"2024-09-15T23:12:51.441874+0000","last_fullsized":"2024-09-15T23:12:51.441874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.456015+0000","last_change":"2024-09-15T23:12:51.452451+0000","last_active":"2024-09-15T23:12:51.456015+0000","last_peered":"2024-09-15T23:12:51.456015+0000","last_clean":"2024-09-15T23:12:51.456015+0000","last_became_active":"2024-09-15T23:12:51.452150+0000","last_became_peered":"2024-09-15T23:12:51.452150+0000","last_unstale":"2024-09-15T23:12:51.456015+0000","last_undegraded":"2024-09-15T23:12:51.456015+0000","last_fullsized":"2024-09-15T23:12:51.456015+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:45:17.640002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.444709+0000","last_change":"2024-09-15T23:12:51.444709+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.444709+0000","last_undegraded":"2024-09-15T23:12:51.444709+0000","last_fullsized":"2024-09-15T23:12:51.444709+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:50.423120+0000","last_change":"2024-09-15T23:12:50.423120+0000","last_active":"2024-09-15T23:12:50.423120+0000","last_peered":"2024-09-15T23:12:50.423120+0000","last_clean":"2024-09-15T23:12:50.423120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:50.423120+0000","last_undegraded":"2024-09-15T23:12:50.423120+0000","last_fullsized":"2024-09-15T23:12:50.423120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.440109+0000","last_change":"2024-09-15T23:12:51.440109+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.440109+0000","last_undegraded":"2024-09-15T23:12:51.440109+0000","last_fullsized":"2024-09-15T23:12:51.440109+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:50.423120+0000","last_change":"2024-09-15T23:12:50.423120+0000","last_active":"2024-09-15T23:12:50.423120+0000","last_peered":"2024-09-15T23:12:50.423120+0000","last_clean":"2024-09-15T23:12:50.423120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:50.423120+0000","last_undegraded":"2024-09-15T23:12:50.423120+0000","last_fullsized":"2024-09-15T23:12:50.423120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:51.429763+0000","last_change":"2024-09-15T23:12:51.429763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.429763+0000","last_undegraded":"2024-09-15T23:12:51.429763+0000","last_fullsized":"2024-09-15T23:12:51.429763+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:50.423120+0000","last_change":"2024-09-15T23:12:50.423120+0000","last_active":"2024-09-15T23:12:50.423120+0000","last_peered":"2024-09-15T23:12:50.423120+0000","last_clean":"2024-09-15T23:12:50.423120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:50.423120+0000","last_undegraded":"2024-09-15T23:12:50.423120+0000","last_fullsized":"2024-09-15T23:12:50.423120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.435582+0000","last_change":"2024-09-15T23:12:51.435582+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.435582+0000","last_undegraded":"2024-09-15T23:12:51.435582+0000","last_fullsized":"2024-09-15T23:12:51.435582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.450759+0000","last_change":"2024-09-15T23:12:51.445595+0000","last_active":"2024-09-15T23:12:51.450759+0000","last_peered":"2024-09-15T23:12:51.450759+0000","last_clean":"2024-09-15T23:12:51.450759+0000","last_became_active":"2024-09-15T23:12:51.445293+0000","last_became_peered":"2024-09-15T23:12:51.445293+0000","last_unstale":"2024-09-15T23:12:51.450759+0000","last_undegraded":"2024-09-15T23:12:51.450759+0000","last_fullsized":"2024-09-15T23:12:51.450759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:41.065979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:51.429763+0000","last_change":"2024-09-15T23:12:51.429763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.429763+0000","last_undegraded":"2024-09-15T23:12:51.429763+0000","last_fullsized":"2024-09-15T23:12:51.429763+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.461464+0000","last_change":"2024-09-15T23:12:51.453993+0000","last_active":"2024-09-15T23:12:51.461464+0000","last_peered":"2024-09-15T23:12:51.461464+0000","last_clean":"2024-09-15T23:12:51.461464+0000","last_became_active":"2024-09-15T23:12:51.453649+0000","last_became_peered":"2024-09-15T23:12:51.453649+0000","last_unstale":"2024-09-15T23:12:51.461464+0000","last_undegraded":"2024-09-15T23:12:51.461464+0000","last_fullsized":"2024-09-15T23:12:51.461464+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:46.454750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.435253+0000","last_change":"2024-09-15T23:12:51.435253+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.435253+0000","last_undegraded":"2024-09-15T23:12:51.435253+0000","last_fullsized":"2024-09-15T23:12:51.435253+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.450784+0000","last_change":"2024-09-15T23:12:51.445705+0000","last_active":"2024-09-15T23:12:51.450784+0000","last_peered":"2024-09-15T23:12:51.450784+0000","last_clean":"2024-09-15T23:12:51.450784+0000","last_became_active":"2024-09-15T23:12:51.445207+0000","last_became_peered":"2024-09-15T23:12:51.445207+0000","last_unstale":"2024-09-15T23:12:51.450784+0000","last_undegraded":"2024-09-15T23:12:51.450784+0000","last_fullsized":"2024-09-15T23:12:51.450784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:43.765850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:51.429763+0000","last_change":"2024-09-15T23:12:51.429763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.429763+0000","last_undegraded":"2024-09-15T23:12:51.429763+0000","last_fullsized":"2024-09-15T23:12:51.429763+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.453484+0000","last_change":"2024-09-15T23:12:51.447186+0000","last_active":"2024-09-15T23:12:51.453484+0000","last_peered":"2024-09-15T23:12:51.453484+0000","last_clean":"2024-09-15T23:12:51.453484+0000","last_became_active":"2024-09-15T23:12:51.446834+0000","last_became_peered":"2024-09-15T23:12:51.446834+0000","last_unstale":"2024-09-15T23:12:51.453484+0000","last_undegraded":"2024-09-15T23:12:51.453484+0000","last_fullsized":"2024-09-15T23:12:51.453484+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:54.500993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.438521+0000","last_change":"2024-09-15T23:12:51.438521+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.438521+0000","last_undegraded":"2024-09-15T23:12:51.438521+0000","last_fullsized":"2024-09-15T23:12:51.438521+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.453522+0000","last_change":"2024-09-15T23:12:51.447976+0000","last_active":"2024-09-15T23:12:51.453522+0000","last_peered":"2024-09-15T23:12:51.453522+0000","last_clean":"2024-09-15T23:12:51.453522+0000","last_became_active":"2024-09-15T23:12:51.447643+0000","last_became_peered":"2024-09-15T23:12:51.447643+0000","last_unstale":"2024-09-15T23:12:51.453522+0000","last_undegraded":"2024-09-15T23:12:51.453522+0000","last_fullsized":"2024-09-15T23:12:51.453522+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:08.256981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.439243+0000","last_change":"2024-09-15T23:12:51.439243+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.439243+0000","last_undegraded":"2024-09-15T23:12:51.439243+0000","last_fullsized":"2024-09-15T23:12:51.439243+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:50.423120+0000","last_change":"2024-09-15T23:12:50.423120+0000","last_active":"2024-09-15T23:12:50.423120+0000","last_peered":"2024-09-15T23:12:50.423120+0000","last_clean":"2024-09-15T23:12:50.423120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:50.423120+0000","last_undegraded":"2024-09-15T23:12:50.423120+0000","last_fullsized":"2024-09-15T23:12:50.423120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:51.429763+0000","last_change":"2024-09-15T23:12:51.429763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.429763+0000","last_undegraded":"2024-09-15T23:12:51.429763+0000","last_fullsized":"2024-09-15T23:12:51.429763+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.451324+0000","last_change":"2024-09-15T23:12:51.447791+0000","last_active":"2024-09-15T23:12:51.451324+0000","last_peered":"2024-09-15T23:12:51.451324+0000","last_clean":"2024-09-15T23:12:51.451324+0000","last_became_active":"2024-09-15T23:12:51.447535+0000","last_became_peered":"2024-09-15T23:12:51.447535+0000","last_unstale":"2024-09-15T23:12:51.451324+0000","last_undegraded":"2024-09-15T23:12:51.451324+0000","last_fullsized":"2024-09-15T23:12:51.451324+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:04:52.338722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:51.429763+0000","last_change":"2024-09-15T23:12:51.429763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.429763+0000","last_undegraded":"2024-09-15T23:12:51.429763+0000","last_fullsized":"2024-09-15T23:12:51.429763+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:12:50.423120+0000","last_change":"2024-09-15T23:12:50.423120+0000","last_active":"2024-09-15T23:12:50.423120+0000","last_peered":"2024-09-15T23:12:50.423120+0000","last_clean":"2024-09-15T23:12:50.423120+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:50.423120+0000","last_undegraded":"2024-09-15T23:12:50.423120+0000","last_fullsized":"2024-09-15T23:12:50.423120+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":183,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-15T23:12:46.816199+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:12:46.816199+0000","last_peered":"2024-09-15T23:12:46.816199+0000","last_clean":"2024-09-15T23:12:46.816199+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:12:46.816199+0000","last_undegraded":"2024-09-15T23:12:46.816199+0000","last_fullsized":"2024-09-15T23:12:46.816199+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":60,"acting":60,"num_store_stats":4},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476751,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27340,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":311296,"data_stored":114497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476748,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27332,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":311296,"data_stored":114497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476750,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":905216,"data_stored":704865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476750,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27336,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":311296,"data_stored":114497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":323584,"data_stored":120314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":323584,"data_stored":120314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542156,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":917504,"data_stored":710682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":323584,"data_stored":120314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:12:55.387 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:12:55.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.522+0000 7fcba39d8640 1 Processor -- start 2024-09-15T23:12:55.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.522+0000 7fcba39d8640 1 -- start start 2024-09-15T23:12:55.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.523+0000 7fcba39d8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fcb9c0b2d40 0x7fcb9c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:55.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.523+0000 7fcba39d8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcb9c06c150 0x7fcb9c15c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:55.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.523+0000 7fcba39d8640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb9c071180 con 0x7fcb9c13eb20 2024-09-15T23:12:55.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.523+0000 7fcba39d8640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fcb9c071ab0 con 0x7fcb9c06c150 2024-09-15T23:12:55.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.523+0000 7fcba39d8640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fcb9c071460 con 0x7fcb9c0b2d40 2024-09-15T23:12:55.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.523+0000 7fcba1f75640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcb9c06c150 0x7fcb9c15c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:55.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.523+0000 7fcba0f73640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fcb9c13eb20 0x7fcb9c15bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41246/0 (socket says 172.21.15.123:41246) 2024-09-15T23:12:55.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.523+0000 7fcba0f73640 1 -- 172.21.15.123:0/1980563348 learned_addr learned my addr 172.21.15.123:0/1980563348 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:55.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.523+0000 7fcba1f75640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcb9c06c150 0x7fcb9c15c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55232/0 (socket says 172.21.15.123:55232) 2024-09-15T23:12:55.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.523+0000 7fcba1774640 1 --2- 172.21.15.123:0/1980563348 >> v2:172.21.15.188:3300/0 conn(0x7fcb9c0b2d40 0x7fcb9c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:55.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.523+0000 7fcb93fff640 1 -- 172.21.15.123:0/1980563348 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2490928477 0 0) 0x7fcb9c071180 con 0x7fcb9c13eb20 2024-09-15T23:12:55.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.523+0000 7fcb93fff640 1 -- 172.21.15.123:0/1980563348 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb88003520 con 0x7fcb9c13eb20 2024-09-15T23:12:55.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.523+0000 7fcba1f75640 1 -- 172.21.15.123:0/1980563348 >> v2:172.21.15.188:3300/0 conn(0x7fcb9c0b2d40 msgr2=0x7fcb9c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:55.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.523+0000 7fcba1f75640 1 --2- 172.21.15.123:0/1980563348 >> v2:172.21.15.188:3300/0 conn(0x7fcb9c0b2d40 0x7fcb9c06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.523+0000 7fcba1f75640 1 -- 172.21.15.123:0/1980563348 >> v1:172.21.15.123:6789/0 conn(0x7fcb9c13eb20 legacy=0x7fcb9c15bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:55.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.523+0000 7fcba1f75640 1 -- 172.21.15.123:0/1980563348 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb9c071740 con 0x7fcb9c06c150 2024-09-15T23:12:55.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.524+0000 7fcba1f75640 1 --2- 172.21.15.123:0/1980563348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb9c06c150 0x7fcb9c15c400 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c069be0 tx=0x7fcb9402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af5a97360b9318ab server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:55.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.524+0000 7fcb93fff640 1 -- 172.21.15.123:0/1980563348 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb94007740 con 0x7fcb9c06c150 2024-09-15T23:12:55.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.524+0000 7fcb93fff640 1 -- 172.21.15.123:0/1980563348 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb940078e0 con 0x7fcb9c06c150 2024-09-15T23:12:55.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.524+0000 7fcb93fff640 1 -- 172.21.15.123:0/1980563348 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb94007cb0 con 0x7fcb9c06c150 2024-09-15T23:12:55.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.524+0000 7fcba39d8640 1 -- 172.21.15.123:0/1980563348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb9c06c150 msgr2=0x7fcb9c15c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:55.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.524+0000 7fcba39d8640 1 --2- 172.21.15.123:0/1980563348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb9c06c150 0x7fcb9c15c400 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c069be0 tx=0x7fcb9402a680 comp rx=0 tx=0).stop 2024-09-15T23:12:55.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.525+0000 7fcba39d8640 1 -- 172.21.15.123:0/1980563348 shutdown_connections 2024-09-15T23:12:55.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.525+0000 7fcba39d8640 1 --2- 172.21.15.123:0/1980563348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb9c06c150 0x7fcb9c15c400 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.525+0000 7fcba39d8640 1 --2- 172.21.15.123:0/1980563348 >> v2:172.21.15.188:3300/0 conn(0x7fcb9c0b2d40 0x7fcb9c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.525+0000 7fcba39d8640 1 -- 172.21.15.123:0/1980563348 >> 172.21.15.123:0/1980563348 conn(0x7fcb9c0ccec0 msgr2=0x7fcb9c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:55.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.525+0000 7fcba39d8640 1 -- 172.21.15.123:0/1980563348 shutdown_connections 2024-09-15T23:12:55.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.525+0000 7fcba39d8640 1 -- 172.21.15.123:0/1980563348 wait complete. 2024-09-15T23:12:55.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.526+0000 7fcba39d8640 1 Processor -- start 2024-09-15T23:12:55.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.526+0000 7fcba39d8640 1 -- start start 2024-09-15T23:12:55.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.526+0000 7fcba39d8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb9c06c150 0x7fcb9c153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:55.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.526+0000 7fcba39d8640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcb9c0b2d40 0x7fcb9c134990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:55.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.526+0000 7fcba39d8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb9c13eb20 0x7fcb9c151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:55.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.527+0000 7fcba39d8640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcb9c0722b0 con 0x7fcb9c13eb20 2024-09-15T23:12:55.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.527+0000 7fcba39d8640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fcb9c072130 con 0x7fcb9c06c150 2024-09-15T23:12:55.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.527+0000 7fcba39d8640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fcb9c072430 con 0x7fcb9c0b2d40 2024-09-15T23:12:55.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.527+0000 7fcba1f75640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb9c13eb20 0x7fcb9c151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:55.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.527+0000 7fcba1f75640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb9c13eb20 0x7fcb9c151100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55238/0 (socket says 172.21.15.123:55238) 2024-09-15T23:12:55.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.527+0000 7fcba1f75640 1 -- 172.21.15.123:0/3063165848 learned_addr learned my addr 172.21.15.123:0/3063165848 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:55.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.527+0000 7fcba1774640 1 --2- 172.21.15.123:0/3063165848 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb9c06c150 0x7fcb9c153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:55.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.527+0000 7fcba0f73640 1 --2- 172.21.15.123:0/3063165848 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcb9c0b2d40 0x7fcb9c134990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:55.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.527+0000 7fcba1f75640 1 -- 172.21.15.123:0/3063165848 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcb9c0b2d40 msgr2=0x7fcb9c134990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:55.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.527+0000 7fcba1f75640 1 --2- 172.21.15.123:0/3063165848 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcb9c0b2d40 0x7fcb9c134990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.527+0000 7fcba1f75640 1 -- 172.21.15.123:0/3063165848 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb9c06c150 msgr2=0x7fcb9c153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:55.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.527+0000 7fcba1f75640 1 --2- 172.21.15.123:0/3063165848 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb9c06c150 0x7fcb9c153ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.527+0000 7fcba1f75640 1 -- 172.21.15.123:0/3063165848 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb9c134ed0 con 0x7fcb9c13eb20 2024-09-15T23:12:55.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.527+0000 7fcba1f75640 1 --2- 172.21.15.123:0/3063165848 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb9c13eb20 0x7fcb9c151100 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcb9402ac70 tx=0x7fcb94004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:55.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.527+0000 7fcb91ffb640 1 -- 172.21.15.123:0/3063165848 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb94040070 con 0x7fcb9c13eb20 2024-09-15T23:12:55.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.527+0000 7fcb91ffb640 1 -- 172.21.15.123:0/3063165848 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb94031bc0 con 0x7fcb9c13eb20 2024-09-15T23:12:55.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.527+0000 7fcba39d8640 1 -- 172.21.15.123:0/3063165848 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb9c135170 con 0x7fcb9c13eb20 2024-09-15T23:12:55.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.527+0000 7fcb91ffb640 1 -- 172.21.15.123:0/3063165848 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb94009450 con 0x7fcb9c13eb20 2024-09-15T23:12:55.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.528+0000 7fcba39d8640 1 -- 172.21.15.123:0/3063165848 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb9c135730 con 0x7fcb9c13eb20 2024-09-15T23:12:55.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.528+0000 7fcba39d8640 1 -- 172.21.15.123:0/3063165848 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb9c06bc10 con 0x7fcb9c13eb20 2024-09-15T23:12:55.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.529+0000 7fcb91ffb640 1 -- 172.21.15.123:0/3063165848 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcb94039040 con 0x7fcb9c13eb20 2024-09-15T23:12:55.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.529+0000 7fcb91ffb640 1 --2- 172.21.15.123:0/3063165848 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcb8006c2b0 0x7fcb8006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:55.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.529+0000 7fcb91ffb640 1 -- 172.21.15.123:0/3063165848 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fcb940acad0 con 0x7fcb9c13eb20 2024-09-15T23:12:55.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.530+0000 7fcba1774640 1 --2- 172.21.15.123:0/3063165848 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcb8006c2b0 0x7fcb8006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:55.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.530+0000 7fcba1774640 1 --2- 172.21.15.123:0/3063165848 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcb8006c2b0 0x7fcb8006e770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c0cfd70 tx=0x7fcb98009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:55.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.533+0000 7fcb91ffb640 1 -- 172.21.15.123:0/3063165848 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcb9407ad10 con 0x7fcb9c13eb20 2024-09-15T23:12:55.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.696+0000 7fcba39d8640 1 -- 172.21.15.123:0/3063165848 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcb9c0cfdc0 con 0x7fcb8006c2b0 2024-09-15T23:12:55.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.703+0000 7fcb91ffb640 1 -- 172.21.15.123:0/3063165848 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249436 (secure 0 0 0) 0x7fcb9c0cfdc0 con 0x7fcb8006c2b0 2024-09-15T23:12:55.707 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:55.708 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:12:55.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.706+0000 7fcba39d8640 1 -- 172.21.15.123:0/3063165848 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcb8006c2b0 msgr2=0x7fcb8006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:55.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.706+0000 7fcba39d8640 1 --2- 172.21.15.123:0/3063165848 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcb8006c2b0 0x7fcb8006e770 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c0cfd70 tx=0x7fcb98009190 comp rx=0 tx=0).stop 2024-09-15T23:12:55.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.706+0000 7fcba39d8640 1 -- 172.21.15.123:0/3063165848 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb9c13eb20 msgr2=0x7fcb9c151100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:55.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.706+0000 7fcba39d8640 1 --2- 172.21.15.123:0/3063165848 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb9c13eb20 0x7fcb9c151100 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcb9402ac70 tx=0x7fcb94004a40 comp rx=0 tx=0).stop 2024-09-15T23:12:55.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.706+0000 7fcba39d8640 1 -- 172.21.15.123:0/3063165848 shutdown_connections 2024-09-15T23:12:55.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.706+0000 7fcba39d8640 1 --2- 172.21.15.123:0/3063165848 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcb8006c2b0 0x7fcb8006e770 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.706+0000 7fcba39d8640 1 --2- 172.21.15.123:0/3063165848 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb9c13eb20 0x7fcb9c151100 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.706+0000 7fcba39d8640 1 --2- 172.21.15.123:0/3063165848 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcb9c0b2d40 0x7fcb9c134990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.706+0000 7fcba39d8640 1 --2- 172.21.15.123:0/3063165848 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb9c06c150 0x7fcb9c153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.706+0000 7fcba39d8640 1 -- 172.21.15.123:0/3063165848 >> 172.21.15.123:0/3063165848 conn(0x7fcb9c0ccec0 msgr2=0x7fcb9c157e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:55.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.706+0000 7fcba39d8640 1 -- 172.21.15.123:0/3063165848 shutdown_connections 2024-09-15T23:12:55.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.706+0000 7fcba39d8640 1 -- 172.21.15.123:0/3063165848 wait complete. 2024-09-15T23:12:55.718 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-09-15T23:12:55.512066+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591144,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":174,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":57,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220040,"kb_used_data":3812,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754680,"statfs":{"total":773094113280,"available":772868792320,"internally_reserved":0,"allocated":3903488,"data_stored":2196418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":776,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.081252"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.454163+0000","last_change":"2024-09-15T23:12:52.453105+0000","last_active":"2024-09-15T23:12:52.454163+0000","last_peered":"2024-09-15T23:12:52.454163+0000","last_clean":"2024-09-15T23:12:52.454163+0000","last_became_active":"2024-09-15T23:12:52.452616+0000","last_became_peered":"2024-09-15T23:12:52.452616+0000","last_unstale":"2024-09-15T23:12:52.454163+0000","last_undegraded":"2024-09-15T23:12:52.454163+0000","last_fullsized":"2024-09-15T23:12:52.454163+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:02.512690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.446214+0000","last_change":"2024-09-15T23:12:51.446214+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.446214+0000","last_undegraded":"2024-09-15T23:12:51.446214+0000","last_fullsized":"2024-09-15T23:12:51.446214+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.448132+0000","last_change":"2024-09-15T23:12:52.466279+0000","last_active":"2024-09-15T23:12:53.448132+0000","last_peered":"2024-09-15T23:12:53.448132+0000","last_clean":"2024-09-15T23:12:53.448132+0000","last_became_active":"2024-09-15T23:12:52.466029+0000","last_became_peered":"2024-09-15T23:12:52.466029+0000","last_unstale":"2024-09-15T23:12:53.448132+0000","last_undegraded":"2024-09-15T23:12:53.448132+0000","last_fullsized":"2024-09-15T23:12:53.448132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:20:38.553039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.440720+0000","last_change":"2024-09-15T23:12:51.440720+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.440720+0000","last_undegraded":"2024-09-15T23:12:51.440720+0000","last_fullsized":"2024-09-15T23:12:51.440720+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.445209+0000","last_change":"2024-09-15T23:12:51.445209+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.445209+0000","last_undegraded":"2024-09-15T23:12:51.445209+0000","last_fullsized":"2024-09-15T23:12:51.445209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.435722+0000","last_change":"2024-09-15T23:12:51.435722+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.435722+0000","last_undegraded":"2024-09-15T23:12:51.435722+0000","last_fullsized":"2024-09-15T23:12:51.435722+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.459287+0000","last_change":"2024-09-15T23:12:52.457860+0000","last_active":"2024-09-15T23:12:52.459287+0000","last_peered":"2024-09-15T23:12:52.459287+0000","last_clean":"2024-09-15T23:12:52.459287+0000","last_became_active":"2024-09-15T23:12:52.457618+0000","last_became_peered":"2024-09-15T23:12:52.457618+0000","last_unstale":"2024-09-15T23:12:52.459287+0000","last_undegraded":"2024-09-15T23:12:52.459287+0000","last_fullsized":"2024-09-15T23:12:52.459287+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:52:27.356135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.474855+0000","last_change":"2024-09-15T23:12:52.463834+0000","last_active":"2024-09-15T23:12:52.474855+0000","last_peered":"2024-09-15T23:12:52.474855+0000","last_clean":"2024-09-15T23:12:52.474855+0000","last_became_active":"2024-09-15T23:12:52.463539+0000","last_became_peered":"2024-09-15T23:12:52.463539+0000","last_unstale":"2024-09-15T23:12:52.474855+0000","last_undegraded":"2024-09-15T23:12:52.474855+0000","last_fullsized":"2024-09-15T23:12:52.474855+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:19:31.718835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.448340+0000","last_change":"2024-09-15T23:12:52.463487+0000","last_active":"2024-09-15T23:12:53.448340+0000","last_peered":"2024-09-15T23:12:53.448340+0000","last_clean":"2024-09-15T23:12:53.448340+0000","last_became_active":"2024-09-15T23:12:52.463207+0000","last_became_peered":"2024-09-15T23:12:52.463207+0000","last_unstale":"2024-09-15T23:12:53.448340+0000","last_undegraded":"2024-09-15T23:12:53.448340+0000","last_fullsized":"2024-09-15T23:12:53.448340+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:14:53.217748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.439885+0000","last_change":"2024-09-15T23:12:51.439885+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.439885+0000","last_undegraded":"2024-09-15T23:12:51.439885+0000","last_fullsized":"2024-09-15T23:12:51.439885+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451170+0000","last_change":"2024-09-15T23:12:52.458033+0000","last_active":"2024-09-15T23:12:53.451170+0000","last_peered":"2024-09-15T23:12:53.451170+0000","last_clean":"2024-09-15T23:12:53.451170+0000","last_became_active":"2024-09-15T23:12:52.457545+0000","last_became_peered":"2024-09-15T23:12:52.457545+0000","last_unstale":"2024-09-15T23:12:53.451170+0000","last_undegraded":"2024-09-15T23:12:53.451170+0000","last_fullsized":"2024-09-15T23:12:53.451170+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:34.053910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.448205+0000","last_change":"2024-09-15T23:12:52.467341+0000","last_active":"2024-09-15T23:12:53.448205+0000","last_peered":"2024-09-15T23:12:53.448205+0000","last_clean":"2024-09-15T23:12:53.448205+0000","last_became_active":"2024-09-15T23:12:52.467027+0000","last_became_peered":"2024-09-15T23:12:52.467027+0000","last_unstale":"2024-09-15T23:12:53.448205+0000","last_undegraded":"2024-09-15T23:12:53.448205+0000","last_fullsized":"2024-09-15T23:12:53.448205+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:55.990210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.440839+0000","last_change":"2024-09-15T23:12:51.440839+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.440839+0000","last_undegraded":"2024-09-15T23:12:51.440839+0000","last_fullsized":"2024-09-15T23:12:51.440839+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.438090+0000","last_change":"2024-09-15T23:12:51.438090+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.438090+0000","last_undegraded":"2024-09-15T23:12:51.438090+0000","last_fullsized":"2024-09-15T23:12:51.438090+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.455115+0000","last_change":"2024-09-15T23:12:52.453291+0000","last_active":"2024-09-15T23:12:52.455115+0000","last_peered":"2024-09-15T23:12:52.455115+0000","last_clean":"2024-09-15T23:12:52.455115+0000","last_became_active":"2024-09-15T23:12:52.453043+0000","last_became_peered":"2024-09-15T23:12:52.453043+0000","last_unstale":"2024-09-15T23:12:52.455115+0000","last_undegraded":"2024-09-15T23:12:52.455115+0000","last_fullsized":"2024-09-15T23:12:52.455115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:25:44.857457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.465371+0000","last_change":"2024-09-15T23:12:52.460235+0000","last_active":"2024-09-15T23:12:52.465371+0000","last_peered":"2024-09-15T23:12:52.465371+0000","last_clean":"2024-09-15T23:12:52.465371+0000","last_became_active":"2024-09-15T23:12:52.459117+0000","last_became_peered":"2024-09-15T23:12:52.459117+0000","last_unstale":"2024-09-15T23:12:52.465371+0000","last_undegraded":"2024-09-15T23:12:52.465371+0000","last_fullsized":"2024-09-15T23:12:52.465371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:05.135809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451265+0000","last_change":"2024-09-15T23:12:52.461872+0000","last_active":"2024-09-15T23:12:53.451265+0000","last_peered":"2024-09-15T23:12:53.451265+0000","last_clean":"2024-09-15T23:12:53.451265+0000","last_became_active":"2024-09-15T23:12:52.460948+0000","last_became_peered":"2024-09-15T23:12:52.460948+0000","last_unstale":"2024-09-15T23:12:53.451265+0000","last_undegraded":"2024-09-15T23:12:53.451265+0000","last_fullsized":"2024-09-15T23:12:53.451265+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:19.030595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.436838+0000","last_change":"2024-09-15T23:12:51.436838+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.436838+0000","last_undegraded":"2024-09-15T23:12:51.436838+0000","last_fullsized":"2024-09-15T23:12:51.436838+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.438314+0000","last_change":"2024-09-15T23:12:51.438314+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.438314+0000","last_undegraded":"2024-09-15T23:12:51.438314+0000","last_fullsized":"2024-09-15T23:12:51.438314+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.442999+0000","last_change":"2024-09-15T23:12:51.442999+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.442999+0000","last_undegraded":"2024-09-15T23:12:51.442999+0000","last_fullsized":"2024-09-15T23:12:51.442999+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.468019+0000","last_change":"2024-09-15T23:12:52.464198+0000","last_active":"2024-09-15T23:12:52.468019+0000","last_peered":"2024-09-15T23:12:52.468019+0000","last_clean":"2024-09-15T23:12:52.468019+0000","last_became_active":"2024-09-15T23:12:52.463937+0000","last_became_peered":"2024-09-15T23:12:52.463937+0000","last_unstale":"2024-09-15T23:12:52.468019+0000","last_undegraded":"2024-09-15T23:12:52.468019+0000","last_fullsized":"2024-09-15T23:12:52.468019+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:57.664093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.474689+0000","last_change":"2024-09-15T23:12:52.464338+0000","last_active":"2024-09-15T23:12:52.474689+0000","last_peered":"2024-09-15T23:12:52.474689+0000","last_clean":"2024-09-15T23:12:52.474689+0000","last_became_active":"2024-09-15T23:12:52.464092+0000","last_became_peered":"2024-09-15T23:12:52.464092+0000","last_unstale":"2024-09-15T23:12:52.474689+0000","last_undegraded":"2024-09-15T23:12:52.474689+0000","last_fullsized":"2024-09-15T23:12:52.474689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:12.512486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.441120+0000","last_change":"2024-09-15T23:12:51.441120+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.441120+0000","last_undegraded":"2024-09-15T23:12:51.441120+0000","last_fullsized":"2024-09-15T23:12:51.441120+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.469898+0000","last_change":"2024-09-15T23:12:52.462708+0000","last_active":"2024-09-15T23:12:52.469898+0000","last_peered":"2024-09-15T23:12:52.469898+0000","last_clean":"2024-09-15T23:12:52.469898+0000","last_became_active":"2024-09-15T23:12:52.462438+0000","last_became_peered":"2024-09-15T23:12:52.462438+0000","last_unstale":"2024-09-15T23:12:52.469898+0000","last_undegraded":"2024-09-15T23:12:52.469898+0000","last_fullsized":"2024-09-15T23:12:52.469898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:57.420799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.441100+0000","last_change":"2024-09-15T23:12:51.441100+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.441100+0000","last_undegraded":"2024-09-15T23:12:51.441100+0000","last_fullsized":"2024-09-15T23:12:51.441100+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.438323+0000","last_change":"2024-09-15T23:12:51.438323+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.438323+0000","last_undegraded":"2024-09-15T23:12:51.438323+0000","last_fullsized":"2024-09-15T23:12:51.438323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.449796+0000","last_change":"2024-09-15T23:12:51.449796+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.449796+0000","last_undegraded":"2024-09-15T23:12:51.449796+0000","last_fullsized":"2024-09-15T23:12:51.449796+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.477316+0000","last_change":"2024-09-15T23:12:52.471955+0000","last_active":"2024-09-15T23:12:52.477316+0000","last_peered":"2024-09-15T23:12:52.477316+0000","last_clean":"2024-09-15T23:12:52.477316+0000","last_became_active":"2024-09-15T23:12:52.471618+0000","last_became_peered":"2024-09-15T23:12:52.471618+0000","last_unstale":"2024-09-15T23:12:52.477316+0000","last_undegraded":"2024-09-15T23:12:52.477316+0000","last_fullsized":"2024-09-15T23:12:52.477316+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:46:23.379877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.465420+0000","last_change":"2024-09-15T23:12:52.462544+0000","last_active":"2024-09-15T23:12:52.465420+0000","last_peered":"2024-09-15T23:12:52.465420+0000","last_clean":"2024-09-15T23:12:52.465420+0000","last_became_active":"2024-09-15T23:12:52.462270+0000","last_became_peered":"2024-09-15T23:12:52.462270+0000","last_unstale":"2024-09-15T23:12:52.465420+0000","last_undegraded":"2024-09-15T23:12:52.465420+0000","last_fullsized":"2024-09-15T23:12:52.465420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:55.053081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.455761+0000","last_change":"2024-09-15T23:12:52.453929+0000","last_active":"2024-09-15T23:12:52.455761+0000","last_peered":"2024-09-15T23:12:52.455761+0000","last_clean":"2024-09-15T23:12:52.455761+0000","last_became_active":"2024-09-15T23:12:52.453664+0000","last_became_peered":"2024-09-15T23:12:52.453664+0000","last_unstale":"2024-09-15T23:12:52.455761+0000","last_undegraded":"2024-09-15T23:12:52.455761+0000","last_fullsized":"2024-09-15T23:12:52.455761+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:57:16.075690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.459816+0000","last_change":"2024-09-15T23:12:52.458926+0000","last_active":"2024-09-15T23:12:52.459816+0000","last_peered":"2024-09-15T23:12:52.459816+0000","last_clean":"2024-09-15T23:12:52.459816+0000","last_became_active":"2024-09-15T23:12:52.458667+0000","last_became_peered":"2024-09-15T23:12:52.458667+0000","last_unstale":"2024-09-15T23:12:52.459816+0000","last_undegraded":"2024-09-15T23:12:52.459816+0000","last_fullsized":"2024-09-15T23:12:52.459816+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:05:21.680105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.450898+0000","last_change":"2024-09-15T23:12:52.461349+0000","last_active":"2024-09-15T23:12:53.450898+0000","last_peered":"2024-09-15T23:12:53.450898+0000","last_clean":"2024-09-15T23:12:53.450898+0000","last_became_active":"2024-09-15T23:12:52.461083+0000","last_became_peered":"2024-09-15T23:12:52.461083+0000","last_unstale":"2024-09-15T23:12:53.450898+0000","last_undegraded":"2024-09-15T23:12:53.450898+0000","last_fullsized":"2024-09-15T23:12:53.450898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:08.491182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.440761+0000","last_change":"2024-09-15T23:12:51.440761+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.440761+0000","last_undegraded":"2024-09-15T23:12:51.440761+0000","last_fullsized":"2024-09-15T23:12:51.440761+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451306+0000","last_change":"2024-09-15T23:12:51.449922+0000","last_active":"2024-09-15T23:12:53.451306+0000","last_peered":"2024-09-15T23:12:53.451306+0000","last_clean":"2024-09-15T23:12:53.451306+0000","last_became_active":"2024-09-15T23:12:51.449687+0000","last_became_peered":"2024-09-15T23:12:51.449687+0000","last_unstale":"2024-09-15T23:12:53.451306+0000","last_undegraded":"2024-09-15T23:12:53.451306+0000","last_fullsized":"2024-09-15T23:12:53.451306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:38:04.702016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.474854+0000","last_change":"2024-09-15T23:12:52.468916+0000","last_active":"2024-09-15T23:12:52.474854+0000","last_peered":"2024-09-15T23:12:52.474854+0000","last_clean":"2024-09-15T23:12:52.474854+0000","last_became_active":"2024-09-15T23:12:52.468595+0000","last_became_peered":"2024-09-15T23:12:52.468595+0000","last_unstale":"2024-09-15T23:12:52.474854+0000","last_undegraded":"2024-09-15T23:12:52.474854+0000","last_fullsized":"2024-09-15T23:12:52.474854+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:37:59.504730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.451189+0000","last_change":"2024-09-15T23:12:51.446041+0000","last_active":"2024-09-15T23:12:51.451189+0000","last_peered":"2024-09-15T23:12:51.451189+0000","last_clean":"2024-09-15T23:12:51.451189+0000","last_became_active":"2024-09-15T23:12:51.445760+0000","last_became_peered":"2024-09-15T23:12:51.445760+0000","last_unstale":"2024-09-15T23:12:51.451189+0000","last_undegraded":"2024-09-15T23:12:51.451189+0000","last_fullsized":"2024-09-15T23:12:51.451189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:56.067201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.469810+0000","last_change":"2024-09-15T23:12:52.462039+0000","last_active":"2024-09-15T23:12:52.469810+0000","last_peered":"2024-09-15T23:12:52.469810+0000","last_clean":"2024-09-15T23:12:52.469810+0000","last_became_active":"2024-09-15T23:12:52.461736+0000","last_became_peered":"2024-09-15T23:12:52.461736+0000","last_unstale":"2024-09-15T23:12:52.469810+0000","last_undegraded":"2024-09-15T23:12:52.469810+0000","last_fullsized":"2024-09-15T23:12:52.469810+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:19.961647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.461516+0000","last_change":"2024-09-15T23:12:51.456559+0000","last_active":"2024-09-15T23:12:51.461516+0000","last_peered":"2024-09-15T23:12:51.461516+0000","last_clean":"2024-09-15T23:12:51.461516+0000","last_became_active":"2024-09-15T23:12:51.456278+0000","last_became_peered":"2024-09-15T23:12:51.456278+0000","last_unstale":"2024-09-15T23:12:51.461516+0000","last_undegraded":"2024-09-15T23:12:51.461516+0000","last_fullsized":"2024-09-15T23:12:51.461516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:54:39.483240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.439175+0000","last_change":"2024-09-15T23:12:51.439175+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.439175+0000","last_undegraded":"2024-09-15T23:12:51.439175+0000","last_fullsized":"2024-09-15T23:12:51.439175+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.453564+0000","last_change":"2024-09-15T23:12:51.449436+0000","last_active":"2024-09-15T23:12:51.453564+0000","last_peered":"2024-09-15T23:12:51.453564+0000","last_clean":"2024-09-15T23:12:51.453564+0000","last_became_active":"2024-09-15T23:12:51.448706+0000","last_became_peered":"2024-09-15T23:12:51.448706+0000","last_unstale":"2024-09-15T23:12:51.453564+0000","last_undegraded":"2024-09-15T23:12:51.453564+0000","last_fullsized":"2024-09-15T23:12:51.453564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:14.541750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.448160+0000","last_change":"2024-09-15T23:12:52.464069+0000","last_active":"2024-09-15T23:12:53.448160+0000","last_peered":"2024-09-15T23:12:53.448160+0000","last_clean":"2024-09-15T23:12:53.448160+0000","last_became_active":"2024-09-15T23:12:52.463781+0000","last_became_peered":"2024-09-15T23:12:52.463781+0000","last_unstale":"2024-09-15T23:12:53.448160+0000","last_undegraded":"2024-09-15T23:12:53.448160+0000","last_fullsized":"2024-09-15T23:12:53.448160+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:09.042477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.468517+0000","last_change":"2024-09-15T23:12:51.451652+0000","last_active":"2024-09-15T23:12:52.468517+0000","last_peered":"2024-09-15T23:12:52.468517+0000","last_clean":"2024-09-15T23:12:52.468517+0000","last_became_active":"2024-09-15T23:12:51.451402+0000","last_became_peered":"2024-09-15T23:12:51.451402+0000","last_unstale":"2024-09-15T23:12:52.468517+0000","last_undegraded":"2024-09-15T23:12:52.468517+0000","last_fullsized":"2024-09-15T23:12:52.468517+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:14:52.211105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.459799+0000","last_change":"2024-09-15T23:12:52.458843+0000","last_active":"2024-09-15T23:12:52.459799+0000","last_peered":"2024-09-15T23:12:52.459799+0000","last_clean":"2024-09-15T23:12:52.459799+0000","last_became_active":"2024-09-15T23:12:52.457773+0000","last_became_peered":"2024-09-15T23:12:52.457773+0000","last_unstale":"2024-09-15T23:12:52.459799+0000","last_undegraded":"2024-09-15T23:12:52.459799+0000","last_fullsized":"2024-09-15T23:12:52.459799+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:18.533270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.475046+0000","last_change":"2024-09-15T23:12:51.448418+0000","last_active":"2024-09-15T23:12:52.475046+0000","last_peered":"2024-09-15T23:12:52.475046+0000","last_clean":"2024-09-15T23:12:52.475046+0000","last_became_active":"2024-09-15T23:12:51.448149+0000","last_became_peered":"2024-09-15T23:12:51.448149+0000","last_unstale":"2024-09-15T23:12:52.475046+0000","last_undegraded":"2024-09-15T23:12:52.475046+0000","last_fullsized":"2024-09-15T23:12:52.475046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:15.959896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.448032+0000","last_change":"2024-09-15T23:12:52.462387+0000","last_active":"2024-09-15T23:12:53.448032+0000","last_peered":"2024-09-15T23:12:53.448032+0000","last_clean":"2024-09-15T23:12:53.448032+0000","last_became_active":"2024-09-15T23:12:52.462139+0000","last_became_peered":"2024-09-15T23:12:52.462139+0000","last_unstale":"2024-09-15T23:12:53.448032+0000","last_undegraded":"2024-09-15T23:12:53.448032+0000","last_fullsized":"2024-09-15T23:12:53.448032+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:09.263624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.450316+0000","last_change":"2024-09-15T23:12:51.444721+0000","last_active":"2024-09-15T23:12:51.450316+0000","last_peered":"2024-09-15T23:12:51.450316+0000","last_clean":"2024-09-15T23:12:51.450316+0000","last_became_active":"2024-09-15T23:12:51.444442+0000","last_became_peered":"2024-09-15T23:12:51.444442+0000","last_unstale":"2024-09-15T23:12:51.450316+0000","last_undegraded":"2024-09-15T23:12:51.450316+0000","last_fullsized":"2024-09-15T23:12:51.450316+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:06.994100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.438261+0000","last_change":"2024-09-15T23:12:51.438261+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.438261+0000","last_undegraded":"2024-09-15T23:12:51.438261+0000","last_fullsized":"2024-09-15T23:12:51.438261+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.450212+0000","last_change":"2024-09-15T23:12:51.451873+0000","last_active":"2024-09-15T23:12:52.450212+0000","last_peered":"2024-09-15T23:12:52.450212+0000","last_clean":"2024-09-15T23:12:52.450212+0000","last_became_active":"2024-09-15T23:12:51.451643+0000","last_became_peered":"2024-09-15T23:12:51.451643+0000","last_unstale":"2024-09-15T23:12:52.450212+0000","last_undegraded":"2024-09-15T23:12:52.450212+0000","last_fullsized":"2024-09-15T23:12:52.450212+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:54.983567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451272+0000","last_change":"2024-09-15T23:12:52.468640+0000","last_active":"2024-09-15T23:12:53.451272+0000","last_peered":"2024-09-15T23:12:53.451272+0000","last_clean":"2024-09-15T23:12:53.451272+0000","last_became_active":"2024-09-15T23:12:52.468384+0000","last_became_peered":"2024-09-15T23:12:52.468384+0000","last_unstale":"2024-09-15T23:12:53.451272+0000","last_undegraded":"2024-09-15T23:12:53.451272+0000","last_fullsized":"2024-09-15T23:12:53.451272+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:55.136613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.461399+0000","last_change":"2024-09-15T23:12:51.453452+0000","last_active":"2024-09-15T23:12:51.461399+0000","last_peered":"2024-09-15T23:12:51.461399+0000","last_clean":"2024-09-15T23:12:51.461399+0000","last_became_active":"2024-09-15T23:12:51.452973+0000","last_became_peered":"2024-09-15T23:12:51.452973+0000","last_unstale":"2024-09-15T23:12:51.461399+0000","last_undegraded":"2024-09-15T23:12:51.461399+0000","last_fullsized":"2024-09-15T23:12:51.461399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:05.785498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.440634+0000","last_change":"2024-09-15T23:12:51.440634+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.440634+0000","last_undegraded":"2024-09-15T23:12:51.440634+0000","last_fullsized":"2024-09-15T23:12:51.440634+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.461485+0000","last_change":"2024-09-15T23:12:51.454019+0000","last_active":"2024-09-15T23:12:51.461485+0000","last_peered":"2024-09-15T23:12:51.461485+0000","last_clean":"2024-09-15T23:12:51.461485+0000","last_became_active":"2024-09-15T23:12:51.453772+0000","last_became_peered":"2024-09-15T23:12:51.453772+0000","last_unstale":"2024-09-15T23:12:51.461485+0000","last_undegraded":"2024-09-15T23:12:51.461485+0000","last_fullsized":"2024-09-15T23:12:51.461485+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:25.384320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.439554+0000","last_change":"2024-09-15T23:12:51.439554+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.439554+0000","last_undegraded":"2024-09-15T23:12:51.439554+0000","last_fullsized":"2024-09-15T23:12:51.439554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451007+0000","last_change":"2024-09-15T23:12:51.446980+0000","last_active":"2024-09-15T23:12:53.451007+0000","last_peered":"2024-09-15T23:12:53.451007+0000","last_clean":"2024-09-15T23:12:53.451007+0000","last_became_active":"2024-09-15T23:12:51.446719+0000","last_became_peered":"2024-09-15T23:12:51.446719+0000","last_unstale":"2024-09-15T23:12:53.451007+0000","last_undegraded":"2024-09-15T23:12:53.451007+0000","last_fullsized":"2024-09-15T23:12:53.451007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:11.359265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451018+0000","last_change":"2024-09-15T23:12:52.457789+0000","last_active":"2024-09-15T23:12:53.451018+0000","last_peered":"2024-09-15T23:12:53.451018+0000","last_clean":"2024-09-15T23:12:53.451018+0000","last_became_active":"2024-09-15T23:12:52.457195+0000","last_became_peered":"2024-09-15T23:12:52.457195+0000","last_unstale":"2024-09-15T23:12:53.451018+0000","last_undegraded":"2024-09-15T23:12:53.451018+0000","last_fullsized":"2024-09-15T23:12:53.451018+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:13.992297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.456070+0000","last_change":"2024-09-15T23:12:51.452177+0000","last_active":"2024-09-15T23:12:51.456070+0000","last_peered":"2024-09-15T23:12:51.456070+0000","last_clean":"2024-09-15T23:12:51.456070+0000","last_became_active":"2024-09-15T23:12:51.451878+0000","last_became_peered":"2024-09-15T23:12:51.451878+0000","last_unstale":"2024-09-15T23:12:51.456070+0000","last_undegraded":"2024-09-15T23:12:51.456070+0000","last_fullsized":"2024-09-15T23:12:51.456070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:15.959896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.442415+0000","last_change":"2024-09-15T23:12:51.442415+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.442415+0000","last_undegraded":"2024-09-15T23:12:51.442415+0000","last_fullsized":"2024-09-15T23:12:51.442415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.465541+0000","last_change":"2024-09-15T23:12:51.454218+0000","last_active":"2024-09-15T23:12:52.465541+0000","last_peered":"2024-09-15T23:12:52.465541+0000","last_clean":"2024-09-15T23:12:52.465541+0000","last_became_active":"2024-09-15T23:12:51.453793+0000","last_became_peered":"2024-09-15T23:12:51.453793+0000","last_unstale":"2024-09-15T23:12:52.465541+0000","last_undegraded":"2024-09-15T23:12:52.465541+0000","last_fullsized":"2024-09-15T23:12:52.465541+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:50.899634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.439007+0000","last_change":"2024-09-15T23:12:51.439007+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.439007+0000","last_undegraded":"2024-09-15T23:12:51.439007+0000","last_fullsized":"2024-09-15T23:12:51.439007+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.455944+0000","last_change":"2024-09-15T23:12:51.450186+0000","last_active":"2024-09-15T23:12:51.455944+0000","last_peered":"2024-09-15T23:12:51.455944+0000","last_clean":"2024-09-15T23:12:51.455944+0000","last_became_active":"2024-09-15T23:12:51.449900+0000","last_became_peered":"2024-09-15T23:12:51.449900+0000","last_unstale":"2024-09-15T23:12:51.455944+0000","last_undegraded":"2024-09-15T23:12:51.455944+0000","last_fullsized":"2024-09-15T23:12:51.455944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:46:42.615226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.459280+0000","last_change":"2024-09-15T23:12:52.457841+0000","last_active":"2024-09-15T23:12:52.459280+0000","last_peered":"2024-09-15T23:12:52.459280+0000","last_clean":"2024-09-15T23:12:52.459280+0000","last_became_active":"2024-09-15T23:12:52.457579+0000","last_became_peered":"2024-09-15T23:12:52.457579+0000","last_unstale":"2024-09-15T23:12:52.459280+0000","last_undegraded":"2024-09-15T23:12:52.459280+0000","last_fullsized":"2024-09-15T23:12:52.459280+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:11.025928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.451163+0000","last_change":"2024-09-15T23:12:51.445393+0000","last_active":"2024-09-15T23:12:51.451163+0000","last_peered":"2024-09-15T23:12:51.451163+0000","last_clean":"2024-09-15T23:12:51.451163+0000","last_became_active":"2024-09-15T23:12:51.444942+0000","last_became_peered":"2024-09-15T23:12:51.444942+0000","last_unstale":"2024-09-15T23:12:51.451163+0000","last_undegraded":"2024-09-15T23:12:51.451163+0000","last_fullsized":"2024-09-15T23:12:51.451163+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:14.255788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.450961+0000","last_change":"2024-09-15T23:12:52.461401+0000","last_active":"2024-09-15T23:12:53.450961+0000","last_peered":"2024-09-15T23:12:53.450961+0000","last_clean":"2024-09-15T23:12:53.450961+0000","last_became_active":"2024-09-15T23:12:52.460897+0000","last_became_peered":"2024-09-15T23:12:52.460897+0000","last_unstale":"2024-09-15T23:12:53.450961+0000","last_undegraded":"2024-09-15T23:12:53.450961+0000","last_fullsized":"2024-09-15T23:12:53.450961+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:05.522026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.450300+0000","last_change":"2024-09-15T23:12:51.445263+0000","last_active":"2024-09-15T23:12:51.450300+0000","last_peered":"2024-09-15T23:12:51.450300+0000","last_clean":"2024-09-15T23:12:51.450300+0000","last_became_active":"2024-09-15T23:12:51.444994+0000","last_became_peered":"2024-09-15T23:12:51.444994+0000","last_unstale":"2024-09-15T23:12:51.450300+0000","last_undegraded":"2024-09-15T23:12:51.450300+0000","last_fullsized":"2024-09-15T23:12:51.450300+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:22.839572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451271+0000","last_change":"2024-09-15T23:12:52.462194+0000","last_active":"2024-09-15T23:12:53.451271+0000","last_peered":"2024-09-15T23:12:53.451271+0000","last_clean":"2024-09-15T23:12:53.451271+0000","last_became_active":"2024-09-15T23:12:52.461911+0000","last_became_peered":"2024-09-15T23:12:52.461911+0000","last_unstale":"2024-09-15T23:12:53.451271+0000","last_undegraded":"2024-09-15T23:12:53.451271+0000","last_fullsized":"2024-09-15T23:12:53.451271+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:13:28.058279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.455860+0000","last_change":"2024-09-15T23:12:51.452056+0000","last_active":"2024-09-15T23:12:51.455860+0000","last_peered":"2024-09-15T23:12:51.455860+0000","last_clean":"2024-09-15T23:12:51.455860+0000","last_became_active":"2024-09-15T23:12:51.451778+0000","last_became_peered":"2024-09-15T23:12:51.451778+0000","last_unstale":"2024-09-15T23:12:51.455860+0000","last_undegraded":"2024-09-15T23:12:51.455860+0000","last_fullsized":"2024-09-15T23:12:51.455860+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:23:49.602062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.448397+0000","last_change":"2024-09-15T23:12:52.460169+0000","last_active":"2024-09-15T23:12:53.448397+0000","last_peered":"2024-09-15T23:12:53.448397+0000","last_clean":"2024-09-15T23:12:53.448397+0000","last_became_active":"2024-09-15T23:12:52.459908+0000","last_became_peered":"2024-09-15T23:12:52.459908+0000","last_unstale":"2024-09-15T23:12:53.448397+0000","last_undegraded":"2024-09-15T23:12:53.448397+0000","last_fullsized":"2024-09-15T23:12:53.448397+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:51.906277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.465663+0000","last_change":"2024-09-15T23:12:51.449713+0000","last_active":"2024-09-15T23:12:52.465663+0000","last_peered":"2024-09-15T23:12:52.465663+0000","last_clean":"2024-09-15T23:12:52.465663+0000","last_became_active":"2024-09-15T23:12:51.449482+0000","last_became_peered":"2024-09-15T23:12:51.449482+0000","last_unstale":"2024-09-15T23:12:52.465663+0000","last_undegraded":"2024-09-15T23:12:52.465663+0000","last_fullsized":"2024-09-15T23:12:52.465663+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:08.256981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.450082+0000","last_change":"2024-09-15T23:12:51.450082+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.450082+0000","last_undegraded":"2024-09-15T23:12:51.450082+0000","last_fullsized":"2024-09-15T23:12:51.450082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451122+0000","last_change":"2024-09-15T23:12:51.444768+0000","last_active":"2024-09-15T23:12:53.451122+0000","last_peered":"2024-09-15T23:12:53.451122+0000","last_clean":"2024-09-15T23:12:53.451122+0000","last_became_active":"2024-09-15T23:12:51.444487+0000","last_became_peered":"2024-09-15T23:12:51.444487+0000","last_unstale":"2024-09-15T23:12:53.451122+0000","last_undegraded":"2024-09-15T23:12:53.451122+0000","last_fullsized":"2024-09-15T23:12:53.451122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:59:54.899240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.435763+0000","last_change":"2024-09-15T23:12:51.435763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.435763+0000","last_undegraded":"2024-09-15T23:12:51.435763+0000","last_fullsized":"2024-09-15T23:12:51.435763+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.448333+0000","last_change":"2024-09-15T23:12:51.442708+0000","last_active":"2024-09-15T23:12:52.448333+0000","last_peered":"2024-09-15T23:12:52.448333+0000","last_clean":"2024-09-15T23:12:52.448333+0000","last_became_active":"2024-09-15T23:12:51.442436+0000","last_became_peered":"2024-09-15T23:12:51.442436+0000","last_unstale":"2024-09-15T23:12:52.448333+0000","last_undegraded":"2024-09-15T23:12:52.448333+0000","last_fullsized":"2024-09-15T23:12:52.448333+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:46:22.373234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.441874+0000","last_change":"2024-09-15T23:12:51.441874+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.441874+0000","last_undegraded":"2024-09-15T23:12:51.441874+0000","last_fullsized":"2024-09-15T23:12:51.441874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.456015+0000","last_change":"2024-09-15T23:12:51.452451+0000","last_active":"2024-09-15T23:12:51.456015+0000","last_peered":"2024-09-15T23:12:51.456015+0000","last_clean":"2024-09-15T23:12:51.456015+0000","last_became_active":"2024-09-15T23:12:51.452150+0000","last_became_peered":"2024-09-15T23:12:51.452150+0000","last_unstale":"2024-09-15T23:12:51.456015+0000","last_undegraded":"2024-09-15T23:12:51.456015+0000","last_fullsized":"2024-09-15T23:12:51.456015+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:45:17.640002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.444709+0000","last_change":"2024-09-15T23:12:51.444709+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.444709+0000","last_undegraded":"2024-09-15T23:12:51.444709+0000","last_fullsized":"2024-09-15T23:12:51.444709+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.449606+0000","last_change":"2024-09-15T23:12:51.449350+0000","last_active":"2024-09-15T23:12:52.449606+0000","last_peered":"2024-09-15T23:12:52.449606+0000","last_clean":"2024-09-15T23:12:52.449606+0000","last_became_active":"2024-09-15T23:12:51.449105+0000","last_became_peered":"2024-09-15T23:12:51.449105+0000","last_unstale":"2024-09-15T23:12:52.449606+0000","last_undegraded":"2024-09-15T23:12:52.449606+0000","last_fullsized":"2024-09-15T23:12:52.449606+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:20:37.546396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.440109+0000","last_change":"2024-09-15T23:12:51.440109+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.440109+0000","last_undegraded":"2024-09-15T23:12:51.440109+0000","last_fullsized":"2024-09-15T23:12:51.440109+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.448187+0000","last_change":"2024-09-15T23:12:51.454629+0000","last_active":"2024-09-15T23:12:53.448187+0000","last_peered":"2024-09-15T23:12:53.448187+0000","last_clean":"2024-09-15T23:12:53.448187+0000","last_became_active":"2024-09-15T23:12:51.454271+0000","last_became_peered":"2024-09-15T23:12:51.454271+0000","last_unstale":"2024-09-15T23:12:53.448187+0000","last_undegraded":"2024-09-15T23:12:53.448187+0000","last_fullsized":"2024-09-15T23:12:53.448187+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:49.679873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.448093+0000","last_change":"2024-09-15T23:12:52.460487+0000","last_active":"2024-09-15T23:12:53.448093+0000","last_peered":"2024-09-15T23:12:53.448093+0000","last_clean":"2024-09-15T23:12:53.448093+0000","last_became_active":"2024-09-15T23:12:52.460214+0000","last_became_peered":"2024-09-15T23:12:52.460214+0000","last_unstale":"2024-09-15T23:12:53.448093+0000","last_undegraded":"2024-09-15T23:12:53.448093+0000","last_fullsized":"2024-09-15T23:12:53.448093+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:16.966539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.450880+0000","last_change":"2024-09-15T23:12:51.445540+0000","last_active":"2024-09-15T23:12:53.450880+0000","last_peered":"2024-09-15T23:12:53.450880+0000","last_clean":"2024-09-15T23:12:53.450880+0000","last_became_active":"2024-09-15T23:12:51.445291+0000","last_became_peered":"2024-09-15T23:12:51.445291+0000","last_unstale":"2024-09-15T23:12:53.450880+0000","last_undegraded":"2024-09-15T23:12:53.450880+0000","last_fullsized":"2024-09-15T23:12:53.450880+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:02.023125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.435582+0000","last_change":"2024-09-15T23:12:51.435582+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.435582+0000","last_undegraded":"2024-09-15T23:12:51.435582+0000","last_fullsized":"2024-09-15T23:12:51.435582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.450759+0000","last_change":"2024-09-15T23:12:51.445595+0000","last_active":"2024-09-15T23:12:51.450759+0000","last_peered":"2024-09-15T23:12:51.450759+0000","last_clean":"2024-09-15T23:12:51.450759+0000","last_became_active":"2024-09-15T23:12:51.445293+0000","last_became_peered":"2024-09-15T23:12:51.445293+0000","last_unstale":"2024-09-15T23:12:51.450759+0000","last_undegraded":"2024-09-15T23:12:51.450759+0000","last_fullsized":"2024-09-15T23:12:51.450759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:41.065979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451253+0000","last_change":"2024-09-15T23:12:52.461733+0000","last_active":"2024-09-15T23:12:53.451253+0000","last_peered":"2024-09-15T23:12:53.451253+0000","last_clean":"2024-09-15T23:12:53.451253+0000","last_became_active":"2024-09-15T23:12:52.461107+0000","last_became_peered":"2024-09-15T23:12:52.461107+0000","last_unstale":"2024-09-15T23:12:53.451253+0000","last_undegraded":"2024-09-15T23:12:53.451253+0000","last_fullsized":"2024-09-15T23:12:53.451253+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:19.983333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.461464+0000","last_change":"2024-09-15T23:12:51.453993+0000","last_active":"2024-09-15T23:12:51.461464+0000","last_peered":"2024-09-15T23:12:51.461464+0000","last_clean":"2024-09-15T23:12:51.461464+0000","last_became_active":"2024-09-15T23:12:51.453649+0000","last_became_peered":"2024-09-15T23:12:51.453649+0000","last_unstale":"2024-09-15T23:12:51.461464+0000","last_undegraded":"2024-09-15T23:12:51.461464+0000","last_fullsized":"2024-09-15T23:12:51.461464+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:46.454750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.435253+0000","last_change":"2024-09-15T23:12:51.435253+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.435253+0000","last_undegraded":"2024-09-15T23:12:51.435253+0000","last_fullsized":"2024-09-15T23:12:51.435253+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.450784+0000","last_change":"2024-09-15T23:12:51.445705+0000","last_active":"2024-09-15T23:12:51.450784+0000","last_peered":"2024-09-15T23:12:51.450784+0000","last_clean":"2024-09-15T23:12:51.450784+0000","last_became_active":"2024-09-15T23:12:51.445207+0000","last_became_peered":"2024-09-15T23:12:51.445207+0000","last_unstale":"2024-09-15T23:12:51.450784+0000","last_undegraded":"2024-09-15T23:12:51.450784+0000","last_fullsized":"2024-09-15T23:12:51.450784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:43.765850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.464898+0000","last_change":"2024-09-15T23:12:52.459515+0000","last_active":"2024-09-15T23:12:52.464898+0000","last_peered":"2024-09-15T23:12:52.464898+0000","last_clean":"2024-09-15T23:12:52.464898+0000","last_became_active":"2024-09-15T23:12:52.459221+0000","last_became_peered":"2024-09-15T23:12:52.459221+0000","last_unstale":"2024-09-15T23:12:52.464898+0000","last_undegraded":"2024-09-15T23:12:52.464898+0000","last_fullsized":"2024-09-15T23:12:52.464898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:16:55.796328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.453484+0000","last_change":"2024-09-15T23:12:51.447186+0000","last_active":"2024-09-15T23:12:51.453484+0000","last_peered":"2024-09-15T23:12:51.453484+0000","last_clean":"2024-09-15T23:12:51.453484+0000","last_became_active":"2024-09-15T23:12:51.446834+0000","last_became_peered":"2024-09-15T23:12:51.446834+0000","last_unstale":"2024-09-15T23:12:51.453484+0000","last_undegraded":"2024-09-15T23:12:51.453484+0000","last_fullsized":"2024-09-15T23:12:51.453484+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:54.500993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.438521+0000","last_change":"2024-09-15T23:12:51.438521+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.438521+0000","last_undegraded":"2024-09-15T23:12:51.438521+0000","last_fullsized":"2024-09-15T23:12:51.438521+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.453522+0000","last_change":"2024-09-15T23:12:51.447976+0000","last_active":"2024-09-15T23:12:51.453522+0000","last_peered":"2024-09-15T23:12:51.453522+0000","last_clean":"2024-09-15T23:12:51.453522+0000","last_became_active":"2024-09-15T23:12:51.447643+0000","last_became_peered":"2024-09-15T23:12:51.447643+0000","last_unstale":"2024-09-15T23:12:51.453522+0000","last_undegraded":"2024-09-15T23:12:51.453522+0000","last_fullsized":"2024-09-15T23:12:51.453522+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:08.256981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.439243+0000","last_change":"2024-09-15T23:12:51.439243+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.439243+0000","last_undegraded":"2024-09-15T23:12:51.439243+0000","last_fullsized":"2024-09-15T23:12:51.439243+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.449992+0000","last_change":"2024-09-15T23:12:51.450580+0000","last_active":"2024-09-15T23:12:52.449992+0000","last_peered":"2024-09-15T23:12:52.449992+0000","last_clean":"2024-09-15T23:12:52.449992+0000","last_became_active":"2024-09-15T23:12:51.450307+0000","last_became_peered":"2024-09-15T23:12:51.450307+0000","last_unstale":"2024-09-15T23:12:52.449992+0000","last_undegraded":"2024-09-15T23:12:52.449992+0000","last_fullsized":"2024-09-15T23:12:52.449992+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:08.035834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451018+0000","last_change":"2024-09-15T23:12:52.461956+0000","last_active":"2024-09-15T23:12:53.451018+0000","last_peered":"2024-09-15T23:12:53.451018+0000","last_clean":"2024-09-15T23:12:53.451018+0000","last_became_active":"2024-09-15T23:12:52.461667+0000","last_became_peered":"2024-09-15T23:12:52.461667+0000","last_unstale":"2024-09-15T23:12:53.451018+0000","last_undegraded":"2024-09-15T23:12:53.451018+0000","last_fullsized":"2024-09-15T23:12:53.451018+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:38.741524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.451324+0000","last_change":"2024-09-15T23:12:51.447791+0000","last_active":"2024-09-15T23:12:51.451324+0000","last_peered":"2024-09-15T23:12:51.451324+0000","last_clean":"2024-09-15T23:12:51.451324+0000","last_became_active":"2024-09-15T23:12:51.447535+0000","last_became_peered":"2024-09-15T23:12:51.447535+0000","last_unstale":"2024-09-15T23:12:51.451324+0000","last_undegraded":"2024-09-15T23:12:51.451324+0000","last_fullsized":"2024-09-15T23:12:51.451324+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:04:52.338722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.466438+0000","last_change":"2024-09-15T23:12:52.460091+0000","last_active":"2024-09-15T23:12:52.466438+0000","last_peered":"2024-09-15T23:12:52.466438+0000","last_clean":"2024-09-15T23:12:52.466438+0000","last_became_active":"2024-09-15T23:12:52.459808+0000","last_became_peered":"2024-09-15T23:12:52.459808+0000","last_unstale":"2024-09-15T23:12:52.466438+0000","last_undegraded":"2024-09-15T23:12:52.466438+0000","last_fullsized":"2024-09-15T23:12:52.466438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:36:44.036378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451212+0000","last_change":"2024-09-15T23:12:51.442341+0000","last_active":"2024-09-15T23:12:53.451212+0000","last_peered":"2024-09-15T23:12:53.451212+0000","last_clean":"2024-09-15T23:12:53.451212+0000","last_became_active":"2024-09-15T23:12:51.442068+0000","last_became_peered":"2024-09-15T23:12:51.442068+0000","last_unstale":"2024-09-15T23:12:53.451212+0000","last_undegraded":"2024-09-15T23:12:53.451212+0000","last_fullsized":"2024-09-15T23:12:53.451212+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:52.665963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":191,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.448247+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:12:53.448247+0000","last_peered":"2024-09-15T23:12:53.448247+0000","last_clean":"2024-09-15T23:12:53.448247+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:12:53.448247+0000","last_undegraded":"2024-09-15T23:12:53.448247+0000","last_fullsized":"2024-09-15T23:12:53.448247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":776,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476752,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":364544,"data_stored":134140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476749,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":133398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476751,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":946176,"data_stored":723802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476751,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":133454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":323584,"data_stored":120314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":323584,"data_stored":120314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542156,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":917504,"data_stored":710682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":323584,"data_stored":120314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:12:55.722 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:12:55.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.855+0000 7f559e2ba640 1 Processor -- start 2024-09-15T23:12:55.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.855+0000 7f559e2ba640 1 -- start start 2024-09-15T23:12:55.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.856+0000 7f559e2ba640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f55981461a0 0x7f559815d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:55.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.856+0000 7f559e2ba640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55980728d0 con 0x7f559806c320 2024-09-15T23:12:55.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.856+0000 7f559e2ba640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5598072bb0 con 0x7f55980720c0 2024-09-15T23:12:55.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.856+0000 7f559e2ba640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f559815ddc0 con 0x7f55981461a0 2024-09-15T23:12:55.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.856+0000 7f5597fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f55981461a0 0x7f559815d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:55.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.856+0000 7f5597fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f55981461a0 0x7f559815d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55246/0 (socket says 172.21.15.123:55246) 2024-09-15T23:12:55.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.856+0000 7f5597fff640 1 -- 172.21.15.123:0/4191772773 learned_addr learned my addr 172.21.15.123:0/4191772773 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:55.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.856+0000 7f559c857640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f559806c320 0x7f559806e550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41254/0 (socket says 172.21.15.123:41254) 2024-09-15T23:12:55.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.856+0000 7f5597fff640 1 -- 172.21.15.123:0/4191772773 >> v1:172.21.15.188:6789/0 conn(0x7f55980720c0 legacy=0x7f559806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:55.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.856+0000 7f5597fff640 1 -- 172.21.15.123:0/4191772773 >> v1:172.21.15.123:6789/0 conn(0x7f559806c320 legacy=0x7f559806e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:55.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.856+0000 7f5597fff640 1 -- 172.21.15.123:0/4191772773 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5598072e90 con 0x7f55981461a0 2024-09-15T23:12:55.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.856+0000 7f5596ffd640 1 -- 172.21.15.123:0/4191772773 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2929204796 0 0) 0x7f55980728d0 con 0x7f559806c320 2024-09-15T23:12:55.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.857+0000 7f5597fff640 1 --2- 172.21.15.123:0/4191772773 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55981461a0 0x7f559815d840 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5588009870 tx=0x7f558802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e03b86c3c72eb727 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:55.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.857+0000 7f5596ffd640 1 -- 172.21.15.123:0/4191772773 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5588037070 con 0x7f55981461a0 2024-09-15T23:12:55.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.857+0000 7f5596ffd640 1 -- 172.21.15.123:0/4191772773 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5588032440 con 0x7f55981461a0 2024-09-15T23:12:55.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.857+0000 7f5596ffd640 1 -- 172.21.15.123:0/4191772773 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5588032810 con 0x7f55981461a0 2024-09-15T23:12:55.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.858+0000 7f559e2ba640 1 -- 172.21.15.123:0/4191772773 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55981461a0 msgr2=0x7f559815d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:55.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.858+0000 7f559e2ba640 1 --2- 172.21.15.123:0/4191772773 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55981461a0 0x7f559815d840 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5588009870 tx=0x7f558802a2a0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.858+0000 7f559e2ba640 1 -- 172.21.15.123:0/4191772773 shutdown_connections 2024-09-15T23:12:55.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.858+0000 7f559e2ba640 1 --2- 172.21.15.123:0/4191772773 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55981461a0 0x7f559815d840 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.858+0000 7f559e2ba640 1 -- 172.21.15.123:0/4191772773 >> 172.21.15.123:0/4191772773 conn(0x7f559806cd20 msgr2=0x7f559806d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:55.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.858+0000 7f559e2ba640 1 -- 172.21.15.123:0/4191772773 shutdown_connections 2024-09-15T23:12:55.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.858+0000 7f559e2ba640 1 -- 172.21.15.123:0/4191772773 wait complete. 2024-09-15T23:12:55.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.859+0000 7f559e2ba640 1 Processor -- start 2024-09-15T23:12:55.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.859+0000 7f559e2ba640 1 -- start start 2024-09-15T23:12:55.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.860+0000 7f559e2ba640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f559806c320 0x7f5598145050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:55.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.860+0000 7f559e2ba640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f55980720c0 0x7f55980cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:55.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.860+0000 7f559e2ba640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f55981461a0 0x7f5598159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:55.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.860+0000 7f559e2ba640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5598072530 con 0x7f559806c320 2024-09-15T23:12:55.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.860+0000 7f559e2ba640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5598146580 con 0x7f55981461a0 2024-09-15T23:12:55.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.860+0000 7f559e2ba640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f55980726b0 con 0x7f55980720c0 2024-09-15T23:12:55.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.860+0000 7f5597fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f559806c320 0x7f5598145050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:55.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.860+0000 7f5597fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f559806c320 0x7f5598145050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55256/0 (socket says 172.21.15.123:55256) 2024-09-15T23:12:55.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.860+0000 7f5597fff640 1 -- 172.21.15.123:0/3626265789 learned_addr learned my addr 172.21.15.123:0/3626265789 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:55.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.860+0000 7f559c857640 1 --2- 172.21.15.123:0/3626265789 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f55981461a0 0x7f5598159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:55.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.860+0000 7f55977fe640 1 --2- 172.21.15.123:0/3626265789 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f55980720c0 0x7f55980cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:55.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.860+0000 7f5597fff640 1 -- 172.21.15.123:0/3626265789 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f55980720c0 msgr2=0x7f55980cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:55.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.860+0000 7f5597fff640 1 --2- 172.21.15.123:0/3626265789 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f55980720c0 0x7f55980cb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.860+0000 7f5597fff640 1 -- 172.21.15.123:0/3626265789 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f55981461a0 msgr2=0x7f5598159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:55.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.860+0000 7f5597fff640 1 --2- 172.21.15.123:0/3626265789 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f55981461a0 0x7f5598159490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:55.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.860+0000 7f5597fff640 1 -- 172.21.15.123:0/3626265789 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55980cc280 con 0x7f559806c320 2024-09-15T23:12:55.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.860+0000 7f559c857640 1 --2- 172.21.15.123:0/3626265789 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f55981461a0 0x7f5598159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:55.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.860+0000 7f55977fe640 1 --2- 172.21.15.123:0/3626265789 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f55980720c0 0x7f55980cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:12:55.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.860+0000 7f5597fff640 1 --2- 172.21.15.123:0/3626265789 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f559806c320 0x7f5598145050 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5588009870 tx=0x7f55880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:55.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.861+0000 7f5594ff9640 1 -- 172.21.15.123:0/3626265789 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5588041020 con 0x7f559806c320 2024-09-15T23:12:55.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.861+0000 7f5594ff9640 1 -- 172.21.15.123:0/3626265789 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5588030970 con 0x7f559806c320 2024-09-15T23:12:55.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.861+0000 7f559e2ba640 1 -- 172.21.15.123:0/3626265789 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55980c91f0 con 0x7f559806c320 2024-09-15T23:12:55.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.861+0000 7f5594ff9640 1 -- 172.21.15.123:0/3626265789 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5588037040 con 0x7f559806c320 2024-09-15T23:12:55.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.861+0000 7f559e2ba640 1 -- 172.21.15.123:0/3626265789 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55980c97b0 con 0x7f559806c320 2024-09-15T23:12:55.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.861+0000 7f559e2ba640 1 -- 172.21.15.123:0/3626265789 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55980c9010 con 0x7f559806c320 2024-09-15T23:12:55.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.862+0000 7f5594ff9640 1 -- 172.21.15.123:0/3626265789 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5588044020 con 0x7f559806c320 2024-09-15T23:12:55.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.862+0000 7f5594ff9640 1 --2- 172.21.15.123:0/3626265789 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f558406c2b0 0x7f558406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:55.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.863+0000 7f5594ff9640 1 -- 172.21.15.123:0/3626265789 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f55880abd60 con 0x7f559806c320 2024-09-15T23:12:55.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.863+0000 7f55977fe640 1 --2- 172.21.15.123:0/3626265789 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f558406c2b0 0x7f558406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:55.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.863+0000 7f55977fe640 1 --2- 172.21.15.123:0/3626265789 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f558406c2b0 0x7f558406e770 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f558c007fd0 tx=0x7f558c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:55.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:55.867+0000 7f5594ff9640 1 -- 172.21.15.123:0/3626265789 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f55980c9010 con 0x7f559806c320 2024-09-15T23:12:56.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.026+0000 7f559e2ba640 1 -- 172.21.15.123:0/3626265789 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5598145590 con 0x7f558406c2b0 2024-09-15T23:12:56.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.033+0000 7f5594ff9640 1 -- 172.21.15.123:0/3626265789 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249436 (secure 0 0 0) 0x7f558c001c80 con 0x7f558406c2b0 2024-09-15T23:12:56.036 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:56.038 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:12:56.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.036+0000 7f559e2ba640 1 -- 172.21.15.123:0/3626265789 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f558406c2b0 msgr2=0x7f558406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:56.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.036+0000 7f559e2ba640 1 --2- 172.21.15.123:0/3626265789 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f558406c2b0 0x7f558406e770 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f558c007fd0 tx=0x7f558c009040 comp rx=0 tx=0).stop 2024-09-15T23:12:56.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.036+0000 7f559e2ba640 1 -- 172.21.15.123:0/3626265789 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f559806c320 msgr2=0x7f5598145050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:56.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.036+0000 7f559e2ba640 1 --2- 172.21.15.123:0/3626265789 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f559806c320 0x7f5598145050 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5588009870 tx=0x7f55880046c0 comp rx=0 tx=0).stop 2024-09-15T23:12:56.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.036+0000 7f559e2ba640 1 -- 172.21.15.123:0/3626265789 shutdown_connections 2024-09-15T23:12:56.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.036+0000 7f559e2ba640 1 --2- 172.21.15.123:0/3626265789 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f55981461a0 0x7f5598159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:56.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.036+0000 7f559e2ba640 1 --2- 172.21.15.123:0/3626265789 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f55980720c0 0x7f55980cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:56.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.036+0000 7f559e2ba640 1 --2- 172.21.15.123:0/3626265789 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f558406c2b0 0x7f558406e770 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:56.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.036+0000 7f559e2ba640 1 --2- 172.21.15.123:0/3626265789 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f559806c320 0x7f5598145050 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:56.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.036+0000 7f559e2ba640 1 -- 172.21.15.123:0/3626265789 >> 172.21.15.123:0/3626265789 conn(0x7f559806cd20 msgr2=0x7f559806d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:56.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.036+0000 7f559e2ba640 1 -- 172.21.15.123:0/3626265789 shutdown_connections 2024-09-15T23:12:56.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.036+0000 7f559e2ba640 1 -- 172.21.15.123:0/3626265789 wait complete. 2024-09-15T23:12:56.047 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-09-15T23:12:55.512066+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591144,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":174,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":57,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220040,"kb_used_data":3812,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754680,"statfs":{"total":773094113280,"available":772868792320,"internally_reserved":0,"allocated":3903488,"data_stored":2196418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":776,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.081252"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.454163+0000","last_change":"2024-09-15T23:12:52.453105+0000","last_active":"2024-09-15T23:12:52.454163+0000","last_peered":"2024-09-15T23:12:52.454163+0000","last_clean":"2024-09-15T23:12:52.454163+0000","last_became_active":"2024-09-15T23:12:52.452616+0000","last_became_peered":"2024-09-15T23:12:52.452616+0000","last_unstale":"2024-09-15T23:12:52.454163+0000","last_undegraded":"2024-09-15T23:12:52.454163+0000","last_fullsized":"2024-09-15T23:12:52.454163+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:02.512690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.446214+0000","last_change":"2024-09-15T23:12:51.446214+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.446214+0000","last_undegraded":"2024-09-15T23:12:51.446214+0000","last_fullsized":"2024-09-15T23:12:51.446214+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.448132+0000","last_change":"2024-09-15T23:12:52.466279+0000","last_active":"2024-09-15T23:12:53.448132+0000","last_peered":"2024-09-15T23:12:53.448132+0000","last_clean":"2024-09-15T23:12:53.448132+0000","last_became_active":"2024-09-15T23:12:52.466029+0000","last_became_peered":"2024-09-15T23:12:52.466029+0000","last_unstale":"2024-09-15T23:12:53.448132+0000","last_undegraded":"2024-09-15T23:12:53.448132+0000","last_fullsized":"2024-09-15T23:12:53.448132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:20:38.553039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.440720+0000","last_change":"2024-09-15T23:12:51.440720+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.440720+0000","last_undegraded":"2024-09-15T23:12:51.440720+0000","last_fullsized":"2024-09-15T23:12:51.440720+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.445209+0000","last_change":"2024-09-15T23:12:51.445209+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.445209+0000","last_undegraded":"2024-09-15T23:12:51.445209+0000","last_fullsized":"2024-09-15T23:12:51.445209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.435722+0000","last_change":"2024-09-15T23:12:51.435722+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.435722+0000","last_undegraded":"2024-09-15T23:12:51.435722+0000","last_fullsized":"2024-09-15T23:12:51.435722+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.459287+0000","last_change":"2024-09-15T23:12:52.457860+0000","last_active":"2024-09-15T23:12:52.459287+0000","last_peered":"2024-09-15T23:12:52.459287+0000","last_clean":"2024-09-15T23:12:52.459287+0000","last_became_active":"2024-09-15T23:12:52.457618+0000","last_became_peered":"2024-09-15T23:12:52.457618+0000","last_unstale":"2024-09-15T23:12:52.459287+0000","last_undegraded":"2024-09-15T23:12:52.459287+0000","last_fullsized":"2024-09-15T23:12:52.459287+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:52:27.356135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.474855+0000","last_change":"2024-09-15T23:12:52.463834+0000","last_active":"2024-09-15T23:12:52.474855+0000","last_peered":"2024-09-15T23:12:52.474855+0000","last_clean":"2024-09-15T23:12:52.474855+0000","last_became_active":"2024-09-15T23:12:52.463539+0000","last_became_peered":"2024-09-15T23:12:52.463539+0000","last_unstale":"2024-09-15T23:12:52.474855+0000","last_undegraded":"2024-09-15T23:12:52.474855+0000","last_fullsized":"2024-09-15T23:12:52.474855+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:19:31.718835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.448340+0000","last_change":"2024-09-15T23:12:52.463487+0000","last_active":"2024-09-15T23:12:53.448340+0000","last_peered":"2024-09-15T23:12:53.448340+0000","last_clean":"2024-09-15T23:12:53.448340+0000","last_became_active":"2024-09-15T23:12:52.463207+0000","last_became_peered":"2024-09-15T23:12:52.463207+0000","last_unstale":"2024-09-15T23:12:53.448340+0000","last_undegraded":"2024-09-15T23:12:53.448340+0000","last_fullsized":"2024-09-15T23:12:53.448340+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:14:53.217748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.439885+0000","last_change":"2024-09-15T23:12:51.439885+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.439885+0000","last_undegraded":"2024-09-15T23:12:51.439885+0000","last_fullsized":"2024-09-15T23:12:51.439885+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451170+0000","last_change":"2024-09-15T23:12:52.458033+0000","last_active":"2024-09-15T23:12:53.451170+0000","last_peered":"2024-09-15T23:12:53.451170+0000","last_clean":"2024-09-15T23:12:53.451170+0000","last_became_active":"2024-09-15T23:12:52.457545+0000","last_became_peered":"2024-09-15T23:12:52.457545+0000","last_unstale":"2024-09-15T23:12:53.451170+0000","last_undegraded":"2024-09-15T23:12:53.451170+0000","last_fullsized":"2024-09-15T23:12:53.451170+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:34.053910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.448205+0000","last_change":"2024-09-15T23:12:52.467341+0000","last_active":"2024-09-15T23:12:53.448205+0000","last_peered":"2024-09-15T23:12:53.448205+0000","last_clean":"2024-09-15T23:12:53.448205+0000","last_became_active":"2024-09-15T23:12:52.467027+0000","last_became_peered":"2024-09-15T23:12:52.467027+0000","last_unstale":"2024-09-15T23:12:53.448205+0000","last_undegraded":"2024-09-15T23:12:53.448205+0000","last_fullsized":"2024-09-15T23:12:53.448205+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:55.990210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.440839+0000","last_change":"2024-09-15T23:12:51.440839+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.440839+0000","last_undegraded":"2024-09-15T23:12:51.440839+0000","last_fullsized":"2024-09-15T23:12:51.440839+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.438090+0000","last_change":"2024-09-15T23:12:51.438090+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.438090+0000","last_undegraded":"2024-09-15T23:12:51.438090+0000","last_fullsized":"2024-09-15T23:12:51.438090+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.455115+0000","last_change":"2024-09-15T23:12:52.453291+0000","last_active":"2024-09-15T23:12:52.455115+0000","last_peered":"2024-09-15T23:12:52.455115+0000","last_clean":"2024-09-15T23:12:52.455115+0000","last_became_active":"2024-09-15T23:12:52.453043+0000","last_became_peered":"2024-09-15T23:12:52.453043+0000","last_unstale":"2024-09-15T23:12:52.455115+0000","last_undegraded":"2024-09-15T23:12:52.455115+0000","last_fullsized":"2024-09-15T23:12:52.455115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:25:44.857457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.465371+0000","last_change":"2024-09-15T23:12:52.460235+0000","last_active":"2024-09-15T23:12:52.465371+0000","last_peered":"2024-09-15T23:12:52.465371+0000","last_clean":"2024-09-15T23:12:52.465371+0000","last_became_active":"2024-09-15T23:12:52.459117+0000","last_became_peered":"2024-09-15T23:12:52.459117+0000","last_unstale":"2024-09-15T23:12:52.465371+0000","last_undegraded":"2024-09-15T23:12:52.465371+0000","last_fullsized":"2024-09-15T23:12:52.465371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:05.135809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451265+0000","last_change":"2024-09-15T23:12:52.461872+0000","last_active":"2024-09-15T23:12:53.451265+0000","last_peered":"2024-09-15T23:12:53.451265+0000","last_clean":"2024-09-15T23:12:53.451265+0000","last_became_active":"2024-09-15T23:12:52.460948+0000","last_became_peered":"2024-09-15T23:12:52.460948+0000","last_unstale":"2024-09-15T23:12:53.451265+0000","last_undegraded":"2024-09-15T23:12:53.451265+0000","last_fullsized":"2024-09-15T23:12:53.451265+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:19.030595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.436838+0000","last_change":"2024-09-15T23:12:51.436838+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.436838+0000","last_undegraded":"2024-09-15T23:12:51.436838+0000","last_fullsized":"2024-09-15T23:12:51.436838+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.438314+0000","last_change":"2024-09-15T23:12:51.438314+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.438314+0000","last_undegraded":"2024-09-15T23:12:51.438314+0000","last_fullsized":"2024-09-15T23:12:51.438314+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.442999+0000","last_change":"2024-09-15T23:12:51.442999+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.442999+0000","last_undegraded":"2024-09-15T23:12:51.442999+0000","last_fullsized":"2024-09-15T23:12:51.442999+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.468019+0000","last_change":"2024-09-15T23:12:52.464198+0000","last_active":"2024-09-15T23:12:52.468019+0000","last_peered":"2024-09-15T23:12:52.468019+0000","last_clean":"2024-09-15T23:12:52.468019+0000","last_became_active":"2024-09-15T23:12:52.463937+0000","last_became_peered":"2024-09-15T23:12:52.463937+0000","last_unstale":"2024-09-15T23:12:52.468019+0000","last_undegraded":"2024-09-15T23:12:52.468019+0000","last_fullsized":"2024-09-15T23:12:52.468019+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:57.664093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.474689+0000","last_change":"2024-09-15T23:12:52.464338+0000","last_active":"2024-09-15T23:12:52.474689+0000","last_peered":"2024-09-15T23:12:52.474689+0000","last_clean":"2024-09-15T23:12:52.474689+0000","last_became_active":"2024-09-15T23:12:52.464092+0000","last_became_peered":"2024-09-15T23:12:52.464092+0000","last_unstale":"2024-09-15T23:12:52.474689+0000","last_undegraded":"2024-09-15T23:12:52.474689+0000","last_fullsized":"2024-09-15T23:12:52.474689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:12.512486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.441120+0000","last_change":"2024-09-15T23:12:51.441120+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.441120+0000","last_undegraded":"2024-09-15T23:12:51.441120+0000","last_fullsized":"2024-09-15T23:12:51.441120+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.469898+0000","last_change":"2024-09-15T23:12:52.462708+0000","last_active":"2024-09-15T23:12:52.469898+0000","last_peered":"2024-09-15T23:12:52.469898+0000","last_clean":"2024-09-15T23:12:52.469898+0000","last_became_active":"2024-09-15T23:12:52.462438+0000","last_became_peered":"2024-09-15T23:12:52.462438+0000","last_unstale":"2024-09-15T23:12:52.469898+0000","last_undegraded":"2024-09-15T23:12:52.469898+0000","last_fullsized":"2024-09-15T23:12:52.469898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:57.420799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.441100+0000","last_change":"2024-09-15T23:12:51.441100+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.441100+0000","last_undegraded":"2024-09-15T23:12:51.441100+0000","last_fullsized":"2024-09-15T23:12:51.441100+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.438323+0000","last_change":"2024-09-15T23:12:51.438323+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.438323+0000","last_undegraded":"2024-09-15T23:12:51.438323+0000","last_fullsized":"2024-09-15T23:12:51.438323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.449796+0000","last_change":"2024-09-15T23:12:51.449796+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.449796+0000","last_undegraded":"2024-09-15T23:12:51.449796+0000","last_fullsized":"2024-09-15T23:12:51.449796+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.477316+0000","last_change":"2024-09-15T23:12:52.471955+0000","last_active":"2024-09-15T23:12:52.477316+0000","last_peered":"2024-09-15T23:12:52.477316+0000","last_clean":"2024-09-15T23:12:52.477316+0000","last_became_active":"2024-09-15T23:12:52.471618+0000","last_became_peered":"2024-09-15T23:12:52.471618+0000","last_unstale":"2024-09-15T23:12:52.477316+0000","last_undegraded":"2024-09-15T23:12:52.477316+0000","last_fullsized":"2024-09-15T23:12:52.477316+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:46:23.379877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.465420+0000","last_change":"2024-09-15T23:12:52.462544+0000","last_active":"2024-09-15T23:12:52.465420+0000","last_peered":"2024-09-15T23:12:52.465420+0000","last_clean":"2024-09-15T23:12:52.465420+0000","last_became_active":"2024-09-15T23:12:52.462270+0000","last_became_peered":"2024-09-15T23:12:52.462270+0000","last_unstale":"2024-09-15T23:12:52.465420+0000","last_undegraded":"2024-09-15T23:12:52.465420+0000","last_fullsized":"2024-09-15T23:12:52.465420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:55.053081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.455761+0000","last_change":"2024-09-15T23:12:52.453929+0000","last_active":"2024-09-15T23:12:52.455761+0000","last_peered":"2024-09-15T23:12:52.455761+0000","last_clean":"2024-09-15T23:12:52.455761+0000","last_became_active":"2024-09-15T23:12:52.453664+0000","last_became_peered":"2024-09-15T23:12:52.453664+0000","last_unstale":"2024-09-15T23:12:52.455761+0000","last_undegraded":"2024-09-15T23:12:52.455761+0000","last_fullsized":"2024-09-15T23:12:52.455761+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:57:16.075690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.459816+0000","last_change":"2024-09-15T23:12:52.458926+0000","last_active":"2024-09-15T23:12:52.459816+0000","last_peered":"2024-09-15T23:12:52.459816+0000","last_clean":"2024-09-15T23:12:52.459816+0000","last_became_active":"2024-09-15T23:12:52.458667+0000","last_became_peered":"2024-09-15T23:12:52.458667+0000","last_unstale":"2024-09-15T23:12:52.459816+0000","last_undegraded":"2024-09-15T23:12:52.459816+0000","last_fullsized":"2024-09-15T23:12:52.459816+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:05:21.680105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.450898+0000","last_change":"2024-09-15T23:12:52.461349+0000","last_active":"2024-09-15T23:12:53.450898+0000","last_peered":"2024-09-15T23:12:53.450898+0000","last_clean":"2024-09-15T23:12:53.450898+0000","last_became_active":"2024-09-15T23:12:52.461083+0000","last_became_peered":"2024-09-15T23:12:52.461083+0000","last_unstale":"2024-09-15T23:12:53.450898+0000","last_undegraded":"2024-09-15T23:12:53.450898+0000","last_fullsized":"2024-09-15T23:12:53.450898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:08.491182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.440761+0000","last_change":"2024-09-15T23:12:51.440761+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.440761+0000","last_undegraded":"2024-09-15T23:12:51.440761+0000","last_fullsized":"2024-09-15T23:12:51.440761+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451306+0000","last_change":"2024-09-15T23:12:51.449922+0000","last_active":"2024-09-15T23:12:53.451306+0000","last_peered":"2024-09-15T23:12:53.451306+0000","last_clean":"2024-09-15T23:12:53.451306+0000","last_became_active":"2024-09-15T23:12:51.449687+0000","last_became_peered":"2024-09-15T23:12:51.449687+0000","last_unstale":"2024-09-15T23:12:53.451306+0000","last_undegraded":"2024-09-15T23:12:53.451306+0000","last_fullsized":"2024-09-15T23:12:53.451306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:38:04.702016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.474854+0000","last_change":"2024-09-15T23:12:52.468916+0000","last_active":"2024-09-15T23:12:52.474854+0000","last_peered":"2024-09-15T23:12:52.474854+0000","last_clean":"2024-09-15T23:12:52.474854+0000","last_became_active":"2024-09-15T23:12:52.468595+0000","last_became_peered":"2024-09-15T23:12:52.468595+0000","last_unstale":"2024-09-15T23:12:52.474854+0000","last_undegraded":"2024-09-15T23:12:52.474854+0000","last_fullsized":"2024-09-15T23:12:52.474854+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:37:59.504730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.451189+0000","last_change":"2024-09-15T23:12:51.446041+0000","last_active":"2024-09-15T23:12:51.451189+0000","last_peered":"2024-09-15T23:12:51.451189+0000","last_clean":"2024-09-15T23:12:51.451189+0000","last_became_active":"2024-09-15T23:12:51.445760+0000","last_became_peered":"2024-09-15T23:12:51.445760+0000","last_unstale":"2024-09-15T23:12:51.451189+0000","last_undegraded":"2024-09-15T23:12:51.451189+0000","last_fullsized":"2024-09-15T23:12:51.451189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:56.067201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.469810+0000","last_change":"2024-09-15T23:12:52.462039+0000","last_active":"2024-09-15T23:12:52.469810+0000","last_peered":"2024-09-15T23:12:52.469810+0000","last_clean":"2024-09-15T23:12:52.469810+0000","last_became_active":"2024-09-15T23:12:52.461736+0000","last_became_peered":"2024-09-15T23:12:52.461736+0000","last_unstale":"2024-09-15T23:12:52.469810+0000","last_undegraded":"2024-09-15T23:12:52.469810+0000","last_fullsized":"2024-09-15T23:12:52.469810+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:19.961647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.461516+0000","last_change":"2024-09-15T23:12:51.456559+0000","last_active":"2024-09-15T23:12:51.461516+0000","last_peered":"2024-09-15T23:12:51.461516+0000","last_clean":"2024-09-15T23:12:51.461516+0000","last_became_active":"2024-09-15T23:12:51.456278+0000","last_became_peered":"2024-09-15T23:12:51.456278+0000","last_unstale":"2024-09-15T23:12:51.461516+0000","last_undegraded":"2024-09-15T23:12:51.461516+0000","last_fullsized":"2024-09-15T23:12:51.461516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:54:39.483240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.439175+0000","last_change":"2024-09-15T23:12:51.439175+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.439175+0000","last_undegraded":"2024-09-15T23:12:51.439175+0000","last_fullsized":"2024-09-15T23:12:51.439175+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.453564+0000","last_change":"2024-09-15T23:12:51.449436+0000","last_active":"2024-09-15T23:12:51.453564+0000","last_peered":"2024-09-15T23:12:51.453564+0000","last_clean":"2024-09-15T23:12:51.453564+0000","last_became_active":"2024-09-15T23:12:51.448706+0000","last_became_peered":"2024-09-15T23:12:51.448706+0000","last_unstale":"2024-09-15T23:12:51.453564+0000","last_undegraded":"2024-09-15T23:12:51.453564+0000","last_fullsized":"2024-09-15T23:12:51.453564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:14.541750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.448160+0000","last_change":"2024-09-15T23:12:52.464069+0000","last_active":"2024-09-15T23:12:53.448160+0000","last_peered":"2024-09-15T23:12:53.448160+0000","last_clean":"2024-09-15T23:12:53.448160+0000","last_became_active":"2024-09-15T23:12:52.463781+0000","last_became_peered":"2024-09-15T23:12:52.463781+0000","last_unstale":"2024-09-15T23:12:53.448160+0000","last_undegraded":"2024-09-15T23:12:53.448160+0000","last_fullsized":"2024-09-15T23:12:53.448160+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:09.042477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.468517+0000","last_change":"2024-09-15T23:12:51.451652+0000","last_active":"2024-09-15T23:12:52.468517+0000","last_peered":"2024-09-15T23:12:52.468517+0000","last_clean":"2024-09-15T23:12:52.468517+0000","last_became_active":"2024-09-15T23:12:51.451402+0000","last_became_peered":"2024-09-15T23:12:51.451402+0000","last_unstale":"2024-09-15T23:12:52.468517+0000","last_undegraded":"2024-09-15T23:12:52.468517+0000","last_fullsized":"2024-09-15T23:12:52.468517+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:14:52.211105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.459799+0000","last_change":"2024-09-15T23:12:52.458843+0000","last_active":"2024-09-15T23:12:52.459799+0000","last_peered":"2024-09-15T23:12:52.459799+0000","last_clean":"2024-09-15T23:12:52.459799+0000","last_became_active":"2024-09-15T23:12:52.457773+0000","last_became_peered":"2024-09-15T23:12:52.457773+0000","last_unstale":"2024-09-15T23:12:52.459799+0000","last_undegraded":"2024-09-15T23:12:52.459799+0000","last_fullsized":"2024-09-15T23:12:52.459799+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:18.533270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.475046+0000","last_change":"2024-09-15T23:12:51.448418+0000","last_active":"2024-09-15T23:12:52.475046+0000","last_peered":"2024-09-15T23:12:52.475046+0000","last_clean":"2024-09-15T23:12:52.475046+0000","last_became_active":"2024-09-15T23:12:51.448149+0000","last_became_peered":"2024-09-15T23:12:51.448149+0000","last_unstale":"2024-09-15T23:12:52.475046+0000","last_undegraded":"2024-09-15T23:12:52.475046+0000","last_fullsized":"2024-09-15T23:12:52.475046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:15.959896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.448032+0000","last_change":"2024-09-15T23:12:52.462387+0000","last_active":"2024-09-15T23:12:53.448032+0000","last_peered":"2024-09-15T23:12:53.448032+0000","last_clean":"2024-09-15T23:12:53.448032+0000","last_became_active":"2024-09-15T23:12:52.462139+0000","last_became_peered":"2024-09-15T23:12:52.462139+0000","last_unstale":"2024-09-15T23:12:53.448032+0000","last_undegraded":"2024-09-15T23:12:53.448032+0000","last_fullsized":"2024-09-15T23:12:53.448032+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:09.263624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.450316+0000","last_change":"2024-09-15T23:12:51.444721+0000","last_active":"2024-09-15T23:12:51.450316+0000","last_peered":"2024-09-15T23:12:51.450316+0000","last_clean":"2024-09-15T23:12:51.450316+0000","last_became_active":"2024-09-15T23:12:51.444442+0000","last_became_peered":"2024-09-15T23:12:51.444442+0000","last_unstale":"2024-09-15T23:12:51.450316+0000","last_undegraded":"2024-09-15T23:12:51.450316+0000","last_fullsized":"2024-09-15T23:12:51.450316+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:06.994100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.438261+0000","last_change":"2024-09-15T23:12:51.438261+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.438261+0000","last_undegraded":"2024-09-15T23:12:51.438261+0000","last_fullsized":"2024-09-15T23:12:51.438261+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.450212+0000","last_change":"2024-09-15T23:12:51.451873+0000","last_active":"2024-09-15T23:12:52.450212+0000","last_peered":"2024-09-15T23:12:52.450212+0000","last_clean":"2024-09-15T23:12:52.450212+0000","last_became_active":"2024-09-15T23:12:51.451643+0000","last_became_peered":"2024-09-15T23:12:51.451643+0000","last_unstale":"2024-09-15T23:12:52.450212+0000","last_undegraded":"2024-09-15T23:12:52.450212+0000","last_fullsized":"2024-09-15T23:12:52.450212+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:54.983567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451272+0000","last_change":"2024-09-15T23:12:52.468640+0000","last_active":"2024-09-15T23:12:53.451272+0000","last_peered":"2024-09-15T23:12:53.451272+0000","last_clean":"2024-09-15T23:12:53.451272+0000","last_became_active":"2024-09-15T23:12:52.468384+0000","last_became_peered":"2024-09-15T23:12:52.468384+0000","last_unstale":"2024-09-15T23:12:53.451272+0000","last_undegraded":"2024-09-15T23:12:53.451272+0000","last_fullsized":"2024-09-15T23:12:53.451272+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:55.136613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.461399+0000","last_change":"2024-09-15T23:12:51.453452+0000","last_active":"2024-09-15T23:12:51.461399+0000","last_peered":"2024-09-15T23:12:51.461399+0000","last_clean":"2024-09-15T23:12:51.461399+0000","last_became_active":"2024-09-15T23:12:51.452973+0000","last_became_peered":"2024-09-15T23:12:51.452973+0000","last_unstale":"2024-09-15T23:12:51.461399+0000","last_undegraded":"2024-09-15T23:12:51.461399+0000","last_fullsized":"2024-09-15T23:12:51.461399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:05.785498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.440634+0000","last_change":"2024-09-15T23:12:51.440634+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.440634+0000","last_undegraded":"2024-09-15T23:12:51.440634+0000","last_fullsized":"2024-09-15T23:12:51.440634+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.461485+0000","last_change":"2024-09-15T23:12:51.454019+0000","last_active":"2024-09-15T23:12:51.461485+0000","last_peered":"2024-09-15T23:12:51.461485+0000","last_clean":"2024-09-15T23:12:51.461485+0000","last_became_active":"2024-09-15T23:12:51.453772+0000","last_became_peered":"2024-09-15T23:12:51.453772+0000","last_unstale":"2024-09-15T23:12:51.461485+0000","last_undegraded":"2024-09-15T23:12:51.461485+0000","last_fullsized":"2024-09-15T23:12:51.461485+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:25.384320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.439554+0000","last_change":"2024-09-15T23:12:51.439554+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.439554+0000","last_undegraded":"2024-09-15T23:12:51.439554+0000","last_fullsized":"2024-09-15T23:12:51.439554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451007+0000","last_change":"2024-09-15T23:12:51.446980+0000","last_active":"2024-09-15T23:12:53.451007+0000","last_peered":"2024-09-15T23:12:53.451007+0000","last_clean":"2024-09-15T23:12:53.451007+0000","last_became_active":"2024-09-15T23:12:51.446719+0000","last_became_peered":"2024-09-15T23:12:51.446719+0000","last_unstale":"2024-09-15T23:12:53.451007+0000","last_undegraded":"2024-09-15T23:12:53.451007+0000","last_fullsized":"2024-09-15T23:12:53.451007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:11.359265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451018+0000","last_change":"2024-09-15T23:12:52.457789+0000","last_active":"2024-09-15T23:12:53.451018+0000","last_peered":"2024-09-15T23:12:53.451018+0000","last_clean":"2024-09-15T23:12:53.451018+0000","last_became_active":"2024-09-15T23:12:52.457195+0000","last_became_peered":"2024-09-15T23:12:52.457195+0000","last_unstale":"2024-09-15T23:12:53.451018+0000","last_undegraded":"2024-09-15T23:12:53.451018+0000","last_fullsized":"2024-09-15T23:12:53.451018+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:13.992297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.456070+0000","last_change":"2024-09-15T23:12:51.452177+0000","last_active":"2024-09-15T23:12:51.456070+0000","last_peered":"2024-09-15T23:12:51.456070+0000","last_clean":"2024-09-15T23:12:51.456070+0000","last_became_active":"2024-09-15T23:12:51.451878+0000","last_became_peered":"2024-09-15T23:12:51.451878+0000","last_unstale":"2024-09-15T23:12:51.456070+0000","last_undegraded":"2024-09-15T23:12:51.456070+0000","last_fullsized":"2024-09-15T23:12:51.456070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:15.959896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.442415+0000","last_change":"2024-09-15T23:12:51.442415+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.442415+0000","last_undegraded":"2024-09-15T23:12:51.442415+0000","last_fullsized":"2024-09-15T23:12:51.442415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.465541+0000","last_change":"2024-09-15T23:12:51.454218+0000","last_active":"2024-09-15T23:12:52.465541+0000","last_peered":"2024-09-15T23:12:52.465541+0000","last_clean":"2024-09-15T23:12:52.465541+0000","last_became_active":"2024-09-15T23:12:51.453793+0000","last_became_peered":"2024-09-15T23:12:51.453793+0000","last_unstale":"2024-09-15T23:12:52.465541+0000","last_undegraded":"2024-09-15T23:12:52.465541+0000","last_fullsized":"2024-09-15T23:12:52.465541+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:50.899634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.439007+0000","last_change":"2024-09-15T23:12:51.439007+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.439007+0000","last_undegraded":"2024-09-15T23:12:51.439007+0000","last_fullsized":"2024-09-15T23:12:51.439007+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.455944+0000","last_change":"2024-09-15T23:12:51.450186+0000","last_active":"2024-09-15T23:12:51.455944+0000","last_peered":"2024-09-15T23:12:51.455944+0000","last_clean":"2024-09-15T23:12:51.455944+0000","last_became_active":"2024-09-15T23:12:51.449900+0000","last_became_peered":"2024-09-15T23:12:51.449900+0000","last_unstale":"2024-09-15T23:12:51.455944+0000","last_undegraded":"2024-09-15T23:12:51.455944+0000","last_fullsized":"2024-09-15T23:12:51.455944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:46:42.615226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.459280+0000","last_change":"2024-09-15T23:12:52.457841+0000","last_active":"2024-09-15T23:12:52.459280+0000","last_peered":"2024-09-15T23:12:52.459280+0000","last_clean":"2024-09-15T23:12:52.459280+0000","last_became_active":"2024-09-15T23:12:52.457579+0000","last_became_peered":"2024-09-15T23:12:52.457579+0000","last_unstale":"2024-09-15T23:12:52.459280+0000","last_undegraded":"2024-09-15T23:12:52.459280+0000","last_fullsized":"2024-09-15T23:12:52.459280+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:11.025928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.451163+0000","last_change":"2024-09-15T23:12:51.445393+0000","last_active":"2024-09-15T23:12:51.451163+0000","last_peered":"2024-09-15T23:12:51.451163+0000","last_clean":"2024-09-15T23:12:51.451163+0000","last_became_active":"2024-09-15T23:12:51.444942+0000","last_became_peered":"2024-09-15T23:12:51.444942+0000","last_unstale":"2024-09-15T23:12:51.451163+0000","last_undegraded":"2024-09-15T23:12:51.451163+0000","last_fullsized":"2024-09-15T23:12:51.451163+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:14.255788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.450961+0000","last_change":"2024-09-15T23:12:52.461401+0000","last_active":"2024-09-15T23:12:53.450961+0000","last_peered":"2024-09-15T23:12:53.450961+0000","last_clean":"2024-09-15T23:12:53.450961+0000","last_became_active":"2024-09-15T23:12:52.460897+0000","last_became_peered":"2024-09-15T23:12:52.460897+0000","last_unstale":"2024-09-15T23:12:53.450961+0000","last_undegraded":"2024-09-15T23:12:53.450961+0000","last_fullsized":"2024-09-15T23:12:53.450961+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:05.522026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.450300+0000","last_change":"2024-09-15T23:12:51.445263+0000","last_active":"2024-09-15T23:12:51.450300+0000","last_peered":"2024-09-15T23:12:51.450300+0000","last_clean":"2024-09-15T23:12:51.450300+0000","last_became_active":"2024-09-15T23:12:51.444994+0000","last_became_peered":"2024-09-15T23:12:51.444994+0000","last_unstale":"2024-09-15T23:12:51.450300+0000","last_undegraded":"2024-09-15T23:12:51.450300+0000","last_fullsized":"2024-09-15T23:12:51.450300+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:22.839572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451271+0000","last_change":"2024-09-15T23:12:52.462194+0000","last_active":"2024-09-15T23:12:53.451271+0000","last_peered":"2024-09-15T23:12:53.451271+0000","last_clean":"2024-09-15T23:12:53.451271+0000","last_became_active":"2024-09-15T23:12:52.461911+0000","last_became_peered":"2024-09-15T23:12:52.461911+0000","last_unstale":"2024-09-15T23:12:53.451271+0000","last_undegraded":"2024-09-15T23:12:53.451271+0000","last_fullsized":"2024-09-15T23:12:53.451271+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:13:28.058279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.455860+0000","last_change":"2024-09-15T23:12:51.452056+0000","last_active":"2024-09-15T23:12:51.455860+0000","last_peered":"2024-09-15T23:12:51.455860+0000","last_clean":"2024-09-15T23:12:51.455860+0000","last_became_active":"2024-09-15T23:12:51.451778+0000","last_became_peered":"2024-09-15T23:12:51.451778+0000","last_unstale":"2024-09-15T23:12:51.455860+0000","last_undegraded":"2024-09-15T23:12:51.455860+0000","last_fullsized":"2024-09-15T23:12:51.455860+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:23:49.602062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.448397+0000","last_change":"2024-09-15T23:12:52.460169+0000","last_active":"2024-09-15T23:12:53.448397+0000","last_peered":"2024-09-15T23:12:53.448397+0000","last_clean":"2024-09-15T23:12:53.448397+0000","last_became_active":"2024-09-15T23:12:52.459908+0000","last_became_peered":"2024-09-15T23:12:52.459908+0000","last_unstale":"2024-09-15T23:12:53.448397+0000","last_undegraded":"2024-09-15T23:12:53.448397+0000","last_fullsized":"2024-09-15T23:12:53.448397+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:51.906277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.465663+0000","last_change":"2024-09-15T23:12:51.449713+0000","last_active":"2024-09-15T23:12:52.465663+0000","last_peered":"2024-09-15T23:12:52.465663+0000","last_clean":"2024-09-15T23:12:52.465663+0000","last_became_active":"2024-09-15T23:12:51.449482+0000","last_became_peered":"2024-09-15T23:12:51.449482+0000","last_unstale":"2024-09-15T23:12:52.465663+0000","last_undegraded":"2024-09-15T23:12:52.465663+0000","last_fullsized":"2024-09-15T23:12:52.465663+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:08.256981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.450082+0000","last_change":"2024-09-15T23:12:51.450082+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.450082+0000","last_undegraded":"2024-09-15T23:12:51.450082+0000","last_fullsized":"2024-09-15T23:12:51.450082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451122+0000","last_change":"2024-09-15T23:12:51.444768+0000","last_active":"2024-09-15T23:12:53.451122+0000","last_peered":"2024-09-15T23:12:53.451122+0000","last_clean":"2024-09-15T23:12:53.451122+0000","last_became_active":"2024-09-15T23:12:51.444487+0000","last_became_peered":"2024-09-15T23:12:51.444487+0000","last_unstale":"2024-09-15T23:12:53.451122+0000","last_undegraded":"2024-09-15T23:12:53.451122+0000","last_fullsized":"2024-09-15T23:12:53.451122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:59:54.899240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.435763+0000","last_change":"2024-09-15T23:12:51.435763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.435763+0000","last_undegraded":"2024-09-15T23:12:51.435763+0000","last_fullsized":"2024-09-15T23:12:51.435763+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.448333+0000","last_change":"2024-09-15T23:12:51.442708+0000","last_active":"2024-09-15T23:12:52.448333+0000","last_peered":"2024-09-15T23:12:52.448333+0000","last_clean":"2024-09-15T23:12:52.448333+0000","last_became_active":"2024-09-15T23:12:51.442436+0000","last_became_peered":"2024-09-15T23:12:51.442436+0000","last_unstale":"2024-09-15T23:12:52.448333+0000","last_undegraded":"2024-09-15T23:12:52.448333+0000","last_fullsized":"2024-09-15T23:12:52.448333+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:46:22.373234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.441874+0000","last_change":"2024-09-15T23:12:51.441874+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.441874+0000","last_undegraded":"2024-09-15T23:12:51.441874+0000","last_fullsized":"2024-09-15T23:12:51.441874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.456015+0000","last_change":"2024-09-15T23:12:51.452451+0000","last_active":"2024-09-15T23:12:51.456015+0000","last_peered":"2024-09-15T23:12:51.456015+0000","last_clean":"2024-09-15T23:12:51.456015+0000","last_became_active":"2024-09-15T23:12:51.452150+0000","last_became_peered":"2024-09-15T23:12:51.452150+0000","last_unstale":"2024-09-15T23:12:51.456015+0000","last_undegraded":"2024-09-15T23:12:51.456015+0000","last_fullsized":"2024-09-15T23:12:51.456015+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:45:17.640002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.444709+0000","last_change":"2024-09-15T23:12:51.444709+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.444709+0000","last_undegraded":"2024-09-15T23:12:51.444709+0000","last_fullsized":"2024-09-15T23:12:51.444709+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.449606+0000","last_change":"2024-09-15T23:12:51.449350+0000","last_active":"2024-09-15T23:12:52.449606+0000","last_peered":"2024-09-15T23:12:52.449606+0000","last_clean":"2024-09-15T23:12:52.449606+0000","last_became_active":"2024-09-15T23:12:51.449105+0000","last_became_peered":"2024-09-15T23:12:51.449105+0000","last_unstale":"2024-09-15T23:12:52.449606+0000","last_undegraded":"2024-09-15T23:12:52.449606+0000","last_fullsized":"2024-09-15T23:12:52.449606+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:20:37.546396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.440109+0000","last_change":"2024-09-15T23:12:51.440109+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.440109+0000","last_undegraded":"2024-09-15T23:12:51.440109+0000","last_fullsized":"2024-09-15T23:12:51.440109+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.448187+0000","last_change":"2024-09-15T23:12:51.454629+0000","last_active":"2024-09-15T23:12:53.448187+0000","last_peered":"2024-09-15T23:12:53.448187+0000","last_clean":"2024-09-15T23:12:53.448187+0000","last_became_active":"2024-09-15T23:12:51.454271+0000","last_became_peered":"2024-09-15T23:12:51.454271+0000","last_unstale":"2024-09-15T23:12:53.448187+0000","last_undegraded":"2024-09-15T23:12:53.448187+0000","last_fullsized":"2024-09-15T23:12:53.448187+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:49.679873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.448093+0000","last_change":"2024-09-15T23:12:52.460487+0000","last_active":"2024-09-15T23:12:53.448093+0000","last_peered":"2024-09-15T23:12:53.448093+0000","last_clean":"2024-09-15T23:12:53.448093+0000","last_became_active":"2024-09-15T23:12:52.460214+0000","last_became_peered":"2024-09-15T23:12:52.460214+0000","last_unstale":"2024-09-15T23:12:53.448093+0000","last_undegraded":"2024-09-15T23:12:53.448093+0000","last_fullsized":"2024-09-15T23:12:53.448093+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:16.966539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.450880+0000","last_change":"2024-09-15T23:12:51.445540+0000","last_active":"2024-09-15T23:12:53.450880+0000","last_peered":"2024-09-15T23:12:53.450880+0000","last_clean":"2024-09-15T23:12:53.450880+0000","last_became_active":"2024-09-15T23:12:51.445291+0000","last_became_peered":"2024-09-15T23:12:51.445291+0000","last_unstale":"2024-09-15T23:12:53.450880+0000","last_undegraded":"2024-09-15T23:12:53.450880+0000","last_fullsized":"2024-09-15T23:12:53.450880+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:02.023125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.435582+0000","last_change":"2024-09-15T23:12:51.435582+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.435582+0000","last_undegraded":"2024-09-15T23:12:51.435582+0000","last_fullsized":"2024-09-15T23:12:51.435582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.450759+0000","last_change":"2024-09-15T23:12:51.445595+0000","last_active":"2024-09-15T23:12:51.450759+0000","last_peered":"2024-09-15T23:12:51.450759+0000","last_clean":"2024-09-15T23:12:51.450759+0000","last_became_active":"2024-09-15T23:12:51.445293+0000","last_became_peered":"2024-09-15T23:12:51.445293+0000","last_unstale":"2024-09-15T23:12:51.450759+0000","last_undegraded":"2024-09-15T23:12:51.450759+0000","last_fullsized":"2024-09-15T23:12:51.450759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:41.065979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451253+0000","last_change":"2024-09-15T23:12:52.461733+0000","last_active":"2024-09-15T23:12:53.451253+0000","last_peered":"2024-09-15T23:12:53.451253+0000","last_clean":"2024-09-15T23:12:53.451253+0000","last_became_active":"2024-09-15T23:12:52.461107+0000","last_became_peered":"2024-09-15T23:12:52.461107+0000","last_unstale":"2024-09-15T23:12:53.451253+0000","last_undegraded":"2024-09-15T23:12:53.451253+0000","last_fullsized":"2024-09-15T23:12:53.451253+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:19.983333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.461464+0000","last_change":"2024-09-15T23:12:51.453993+0000","last_active":"2024-09-15T23:12:51.461464+0000","last_peered":"2024-09-15T23:12:51.461464+0000","last_clean":"2024-09-15T23:12:51.461464+0000","last_became_active":"2024-09-15T23:12:51.453649+0000","last_became_peered":"2024-09-15T23:12:51.453649+0000","last_unstale":"2024-09-15T23:12:51.461464+0000","last_undegraded":"2024-09-15T23:12:51.461464+0000","last_fullsized":"2024-09-15T23:12:51.461464+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:46.454750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.435253+0000","last_change":"2024-09-15T23:12:51.435253+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.435253+0000","last_undegraded":"2024-09-15T23:12:51.435253+0000","last_fullsized":"2024-09-15T23:12:51.435253+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.450784+0000","last_change":"2024-09-15T23:12:51.445705+0000","last_active":"2024-09-15T23:12:51.450784+0000","last_peered":"2024-09-15T23:12:51.450784+0000","last_clean":"2024-09-15T23:12:51.450784+0000","last_became_active":"2024-09-15T23:12:51.445207+0000","last_became_peered":"2024-09-15T23:12:51.445207+0000","last_unstale":"2024-09-15T23:12:51.450784+0000","last_undegraded":"2024-09-15T23:12:51.450784+0000","last_fullsized":"2024-09-15T23:12:51.450784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:43.765850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.464898+0000","last_change":"2024-09-15T23:12:52.459515+0000","last_active":"2024-09-15T23:12:52.464898+0000","last_peered":"2024-09-15T23:12:52.464898+0000","last_clean":"2024-09-15T23:12:52.464898+0000","last_became_active":"2024-09-15T23:12:52.459221+0000","last_became_peered":"2024-09-15T23:12:52.459221+0000","last_unstale":"2024-09-15T23:12:52.464898+0000","last_undegraded":"2024-09-15T23:12:52.464898+0000","last_fullsized":"2024-09-15T23:12:52.464898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:16:55.796328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.453484+0000","last_change":"2024-09-15T23:12:51.447186+0000","last_active":"2024-09-15T23:12:51.453484+0000","last_peered":"2024-09-15T23:12:51.453484+0000","last_clean":"2024-09-15T23:12:51.453484+0000","last_became_active":"2024-09-15T23:12:51.446834+0000","last_became_peered":"2024-09-15T23:12:51.446834+0000","last_unstale":"2024-09-15T23:12:51.453484+0000","last_undegraded":"2024-09-15T23:12:51.453484+0000","last_fullsized":"2024-09-15T23:12:51.453484+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:54.500993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.438521+0000","last_change":"2024-09-15T23:12:51.438521+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.438521+0000","last_undegraded":"2024-09-15T23:12:51.438521+0000","last_fullsized":"2024-09-15T23:12:51.438521+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.453522+0000","last_change":"2024-09-15T23:12:51.447976+0000","last_active":"2024-09-15T23:12:51.453522+0000","last_peered":"2024-09-15T23:12:51.453522+0000","last_clean":"2024-09-15T23:12:51.453522+0000","last_became_active":"2024-09-15T23:12:51.447643+0000","last_became_peered":"2024-09-15T23:12:51.447643+0000","last_unstale":"2024-09-15T23:12:51.453522+0000","last_undegraded":"2024-09-15T23:12:51.453522+0000","last_fullsized":"2024-09-15T23:12:51.453522+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:08.256981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.439243+0000","last_change":"2024-09-15T23:12:51.439243+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.439243+0000","last_undegraded":"2024-09-15T23:12:51.439243+0000","last_fullsized":"2024-09-15T23:12:51.439243+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.449992+0000","last_change":"2024-09-15T23:12:51.450580+0000","last_active":"2024-09-15T23:12:52.449992+0000","last_peered":"2024-09-15T23:12:52.449992+0000","last_clean":"2024-09-15T23:12:52.449992+0000","last_became_active":"2024-09-15T23:12:51.450307+0000","last_became_peered":"2024-09-15T23:12:51.450307+0000","last_unstale":"2024-09-15T23:12:52.449992+0000","last_undegraded":"2024-09-15T23:12:52.449992+0000","last_fullsized":"2024-09-15T23:12:52.449992+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:08.035834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451018+0000","last_change":"2024-09-15T23:12:52.461956+0000","last_active":"2024-09-15T23:12:53.451018+0000","last_peered":"2024-09-15T23:12:53.451018+0000","last_clean":"2024-09-15T23:12:53.451018+0000","last_became_active":"2024-09-15T23:12:52.461667+0000","last_became_peered":"2024-09-15T23:12:52.461667+0000","last_unstale":"2024-09-15T23:12:53.451018+0000","last_undegraded":"2024-09-15T23:12:53.451018+0000","last_fullsized":"2024-09-15T23:12:53.451018+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:38.741524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.451324+0000","last_change":"2024-09-15T23:12:51.447791+0000","last_active":"2024-09-15T23:12:51.451324+0000","last_peered":"2024-09-15T23:12:51.451324+0000","last_clean":"2024-09-15T23:12:51.451324+0000","last_became_active":"2024-09-15T23:12:51.447535+0000","last_became_peered":"2024-09-15T23:12:51.447535+0000","last_unstale":"2024-09-15T23:12:51.451324+0000","last_undegraded":"2024-09-15T23:12:51.451324+0000","last_fullsized":"2024-09-15T23:12:51.451324+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:04:52.338722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.466438+0000","last_change":"2024-09-15T23:12:52.460091+0000","last_active":"2024-09-15T23:12:52.466438+0000","last_peered":"2024-09-15T23:12:52.466438+0000","last_clean":"2024-09-15T23:12:52.466438+0000","last_became_active":"2024-09-15T23:12:52.459808+0000","last_became_peered":"2024-09-15T23:12:52.459808+0000","last_unstale":"2024-09-15T23:12:52.466438+0000","last_undegraded":"2024-09-15T23:12:52.466438+0000","last_fullsized":"2024-09-15T23:12:52.466438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:36:44.036378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451212+0000","last_change":"2024-09-15T23:12:51.442341+0000","last_active":"2024-09-15T23:12:53.451212+0000","last_peered":"2024-09-15T23:12:53.451212+0000","last_clean":"2024-09-15T23:12:53.451212+0000","last_became_active":"2024-09-15T23:12:51.442068+0000","last_became_peered":"2024-09-15T23:12:51.442068+0000","last_unstale":"2024-09-15T23:12:53.451212+0000","last_undegraded":"2024-09-15T23:12:53.451212+0000","last_fullsized":"2024-09-15T23:12:53.451212+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:52.665963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":191,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.448247+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:12:53.448247+0000","last_peered":"2024-09-15T23:12:53.448247+0000","last_clean":"2024-09-15T23:12:53.448247+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:12:53.448247+0000","last_undegraded":"2024-09-15T23:12:53.448247+0000","last_fullsized":"2024-09-15T23:12:53.448247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":776,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476752,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":364544,"data_stored":134140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476749,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":133398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476751,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":946176,"data_stored":723802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476751,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":133454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":323584,"data_stored":120314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":323584,"data_stored":120314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542156,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":917504,"data_stored":710682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":323584,"data_stored":120314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:12:56.051 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3e is not active+clean 2024-09-15T23:12:56.051 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:51.446214+0000', 'last_change': '2024-09-15T23:12:51.446214+0000', 'last_active': '2024-09-15T23:12:51.429763+0000', 'last_peered': '2024-09-15T23:12:51.429763+0000', 'last_clean': '2024-09-15T23:12:51.429763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:51.446214+0000', 'last_undegraded': '2024-09-15T23:12:51.446214+0000', 'last_fullsized': '2024-09-15T23:12:51.446214+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T23:12:56.051 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3c is not active+clean 2024-09-15T23:12:56.051 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:51.440720+0000', 'last_change': '2024-09-15T23:12:51.440720+0000', 'last_active': '2024-09-15T23:12:51.429763+0000', 'last_peered': '2024-09-15T23:12:51.429763+0000', 'last_clean': '2024-09-15T23:12:51.429763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:51.440720+0000', 'last_undegraded': '2024-09-15T23:12:51.440720+0000', 'last_fullsized': '2024-09-15T23:12:51.440720+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T23:12:56.051 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3b is not active+clean 2024-09-15T23:12:56.051 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:51.445209+0000', 'last_change': '2024-09-15T23:12:51.445209+0000', 'last_active': '2024-09-15T23:12:51.429763+0000', 'last_peered': '2024-09-15T23:12:51.429763+0000', 'last_clean': '2024-09-15T23:12:51.429763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:51.445209+0000', 'last_undegraded': '2024-09-15T23:12:51.445209+0000', 'last_fullsized': '2024-09-15T23:12:51.445209+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T23:12:56.051 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3a is not active+clean 2024-09-15T23:12:56.051 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:51.435722+0000', 'last_change': '2024-09-15T23:12:51.435722+0000', 'last_active': '2024-09-15T23:12:51.429763+0000', 'last_peered': '2024-09-15T23:12:51.429763+0000', 'last_clean': '2024-09-15T23:12:51.429763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:51.435722+0000', 'last_undegraded': '2024-09-15T23:12:51.435722+0000', 'last_fullsized': '2024-09-15T23:12:51.435722+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T23:12:56.051 INFO:tasks.ceph.ceph_manager.ceph:PG 5.36 is not active+clean 2024-09-15T23:12:56.051 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:51.439885+0000', 'last_change': '2024-09-15T23:12:51.439885+0000', 'last_active': '2024-09-15T23:12:51.429763+0000', 'last_peered': '2024-09-15T23:12:51.429763+0000', 'last_clean': '2024-09-15T23:12:51.429763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:51.439885+0000', 'last_undegraded': '2024-09-15T23:12:51.439885+0000', 'last_fullsized': '2024-09-15T23:12:51.439885+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T23:12:56.052 INFO:tasks.ceph.ceph_manager.ceph:PG 5.33 is not active+clean 2024-09-15T23:12:56.052 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:51.440839+0000', 'last_change': '2024-09-15T23:12:51.440839+0000', 'last_active': '2024-09-15T23:12:51.429763+0000', 'last_peered': '2024-09-15T23:12:51.429763+0000', 'last_clean': '2024-09-15T23:12:51.429763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:51.440839+0000', 'last_undegraded': '2024-09-15T23:12:51.440839+0000', 'last_fullsized': '2024-09-15T23:12:51.440839+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T23:12:56.052 INFO:tasks.ceph.ceph_manager.ceph:PG 5.32 is not active+clean 2024-09-15T23:12:56.052 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:51.438090+0000', 'last_change': '2024-09-15T23:12:51.438090+0000', 'last_active': '2024-09-15T23:12:51.429763+0000', 'last_peered': '2024-09-15T23:12:51.429763+0000', 'last_clean': '2024-09-15T23:12:51.429763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:51.438090+0000', 'last_undegraded': '2024-09-15T23:12:51.438090+0000', 'last_fullsized': '2024-09-15T23:12:51.438090+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T23:12:56.052 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2e is not active+clean 2024-09-15T23:12:56.052 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:51.436838+0000', 'last_change': '2024-09-15T23:12:51.436838+0000', 'last_active': '2024-09-15T23:12:51.429763+0000', 'last_peered': '2024-09-15T23:12:51.429763+0000', 'last_clean': '2024-09-15T23:12:51.429763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:51.436838+0000', 'last_undegraded': '2024-09-15T23:12:51.436838+0000', 'last_fullsized': '2024-09-15T23:12:51.436838+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T23:12:56.052 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2d is not active+clean 2024-09-15T23:12:56.052 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:51.438314+0000', 'last_change': '2024-09-15T23:12:51.438314+0000', 'last_active': '2024-09-15T23:12:51.429763+0000', 'last_peered': '2024-09-15T23:12:51.429763+0000', 'last_clean': '2024-09-15T23:12:51.429763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:51.438314+0000', 'last_undegraded': '2024-09-15T23:12:51.438314+0000', 'last_fullsized': '2024-09-15T23:12:51.438314+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T23:12:56.052 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2c is not active+clean 2024-09-15T23:12:56.052 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:51.442999+0000', 'last_change': '2024-09-15T23:12:51.442999+0000', 'last_active': '2024-09-15T23:12:51.429763+0000', 'last_peered': '2024-09-15T23:12:51.429763+0000', 'last_clean': '2024-09-15T23:12:51.429763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:51.442999+0000', 'last_undegraded': '2024-09-15T23:12:51.442999+0000', 'last_fullsized': '2024-09-15T23:12:51.442999+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T23:12:56.053 INFO:tasks.ceph.ceph_manager.ceph:PG 5.29 is not active+clean 2024-09-15T23:12:56.053 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:51.441120+0000', 'last_change': '2024-09-15T23:12:51.441120+0000', 'last_active': '2024-09-15T23:12:51.429763+0000', 'last_peered': '2024-09-15T23:12:51.429763+0000', 'last_clean': '2024-09-15T23:12:51.429763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:51.441120+0000', 'last_undegraded': '2024-09-15T23:12:51.441120+0000', 'last_fullsized': '2024-09-15T23:12:51.441120+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T23:12:56.053 INFO:tasks.ceph.ceph_manager.ceph:PG 5.27 is not active+clean 2024-09-15T23:12:56.053 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:51.441100+0000', 'last_change': '2024-09-15T23:12:51.441100+0000', 'last_active': '2024-09-15T23:12:51.429763+0000', 'last_peered': '2024-09-15T23:12:51.429763+0000', 'last_clean': '2024-09-15T23:12:51.429763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:51.441100+0000', 'last_undegraded': '2024-09-15T23:12:51.441100+0000', 'last_fullsized': '2024-09-15T23:12:51.441100+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T23:12:56.053 INFO:tasks.ceph.ceph_manager.ceph:PG 5.26 is not active+clean 2024-09-15T23:12:56.053 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:51.438323+0000', 'last_change': '2024-09-15T23:12:51.438323+0000', 'last_active': '2024-09-15T23:12:51.429763+0000', 'last_peered': '2024-09-15T23:12:51.429763+0000', 'last_clean': '2024-09-15T23:12:51.429763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:51.438323+0000', 'last_undegraded': '2024-09-15T23:12:51.438323+0000', 'last_fullsized': '2024-09-15T23:12:51.438323+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T23:12:56.053 INFO:tasks.ceph.ceph_manager.ceph:PG 5.25 is not active+clean 2024-09-15T23:12:56.053 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:51.449796+0000', 'last_change': '2024-09-15T23:12:51.449796+0000', 'last_active': '2024-09-15T23:12:51.429763+0000', 'last_peered': '2024-09-15T23:12:51.429763+0000', 'last_clean': '2024-09-15T23:12:51.429763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:51.449796+0000', 'last_undegraded': '2024-09-15T23:12:51.449796+0000', 'last_fullsized': '2024-09-15T23:12:51.449796+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T23:12:56.053 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1e is not active+clean 2024-09-15T23:12:56.053 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:51.440761+0000', 'last_change': '2024-09-15T23:12:51.440761+0000', 'last_active': '2024-09-15T23:12:51.429763+0000', 'last_peered': '2024-09-15T23:12:51.429763+0000', 'last_clean': '2024-09-15T23:12:51.429763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:51.440761+0000', 'last_undegraded': '2024-09-15T23:12:51.440761+0000', 'last_fullsized': '2024-09-15T23:12:51.440761+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T23:12:56.053 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1d is not active+clean 2024-09-15T23:12:56.054 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:51.439175+0000', 'last_change': '2024-09-15T23:12:51.439175+0000', 'last_active': '2024-09-15T23:12:51.429763+0000', 'last_peered': '2024-09-15T23:12:51.429763+0000', 'last_clean': '2024-09-15T23:12:51.429763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:51.439175+0000', 'last_undegraded': '2024-09-15T23:12:51.439175+0000', 'last_fullsized': '2024-09-15T23:12:51.439175+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T23:12:56.054 INFO:tasks.ceph.ceph_manager.ceph:PG 5.19 is not active+clean 2024-09-15T23:12:56.054 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:51.438261+0000', 'last_change': '2024-09-15T23:12:51.438261+0000', 'last_active': '2024-09-15T23:12:51.429763+0000', 'last_peered': '2024-09-15T23:12:51.429763+0000', 'last_clean': '2024-09-15T23:12:51.429763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:51.438261+0000', 'last_undegraded': '2024-09-15T23:12:51.438261+0000', 'last_fullsized': '2024-09-15T23:12:51.438261+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T23:12:56.054 INFO:tasks.ceph.ceph_manager.ceph:PG 5.17 is not active+clean 2024-09-15T23:12:56.054 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:51.440634+0000', 'last_change': '2024-09-15T23:12:51.440634+0000', 'last_active': '2024-09-15T23:12:51.429763+0000', 'last_peered': '2024-09-15T23:12:51.429763+0000', 'last_clean': '2024-09-15T23:12:51.429763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:51.440634+0000', 'last_undegraded': '2024-09-15T23:12:51.440634+0000', 'last_fullsized': '2024-09-15T23:12:51.440634+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T23:12:56.054 INFO:tasks.ceph.ceph_manager.ceph:PG 5.14 is not active+clean 2024-09-15T23:12:56.054 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:51.439554+0000', 'last_change': '2024-09-15T23:12:51.439554+0000', 'last_active': '2024-09-15T23:12:51.429763+0000', 'last_peered': '2024-09-15T23:12:51.429763+0000', 'last_clean': '2024-09-15T23:12:51.429763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:51.439554+0000', 'last_undegraded': '2024-09-15T23:12:51.439554+0000', 'last_fullsized': '2024-09-15T23:12:51.439554+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T23:12:56.054 INFO:tasks.ceph.ceph_manager.ceph:PG 5.12 is not active+clean 2024-09-15T23:12:56.054 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:51.442415+0000', 'last_change': '2024-09-15T23:12:51.442415+0000', 'last_active': '2024-09-15T23:12:51.429763+0000', 'last_peered': '2024-09-15T23:12:51.429763+0000', 'last_clean': '2024-09-15T23:12:51.429763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:51.442415+0000', 'last_undegraded': '2024-09-15T23:12:51.442415+0000', 'last_fullsized': '2024-09-15T23:12:51.442415+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T23:12:56.054 INFO:tasks.ceph.ceph_manager.ceph:PG 5.13 is not active+clean 2024-09-15T23:12:56.054 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:51.439007+0000', 'last_change': '2024-09-15T23:12:51.439007+0000', 'last_active': '2024-09-15T23:12:51.429763+0000', 'last_peered': '2024-09-15T23:12:51.429763+0000', 'last_clean': '2024-09-15T23:12:51.429763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:51.439007+0000', 'last_undegraded': '2024-09-15T23:12:51.439007+0000', 'last_fullsized': '2024-09-15T23:12:51.439007+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T23:12:56.055 INFO:tasks.ceph.ceph_manager.ceph:PG 5.c is not active+clean 2024-09-15T23:12:56.055 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:51.450082+0000', 'last_change': '2024-09-15T23:12:51.450082+0000', 'last_active': '2024-09-15T23:12:51.429763+0000', 'last_peered': '2024-09-15T23:12:51.429763+0000', 'last_clean': '2024-09-15T23:12:51.429763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:51.450082+0000', 'last_undegraded': '2024-09-15T23:12:51.450082+0000', 'last_fullsized': '2024-09-15T23:12:51.450082+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T23:12:56.055 INFO:tasks.ceph.ceph_manager.ceph:PG 5.d is not active+clean 2024-09-15T23:12:56.055 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:51.435763+0000', 'last_change': '2024-09-15T23:12:51.435763+0000', 'last_active': '2024-09-15T23:12:51.429763+0000', 'last_peered': '2024-09-15T23:12:51.429763+0000', 'last_clean': '2024-09-15T23:12:51.429763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:51.435763+0000', 'last_undegraded': '2024-09-15T23:12:51.435763+0000', 'last_fullsized': '2024-09-15T23:12:51.435763+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T23:12:56.055 INFO:tasks.ceph.ceph_manager.ceph:PG 5.a is not active+clean 2024-09-15T23:12:56.055 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:51.441874+0000', 'last_change': '2024-09-15T23:12:51.441874+0000', 'last_active': '2024-09-15T23:12:51.429763+0000', 'last_peered': '2024-09-15T23:12:51.429763+0000', 'last_clean': '2024-09-15T23:12:51.429763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:51.441874+0000', 'last_undegraded': '2024-09-15T23:12:51.441874+0000', 'last_fullsized': '2024-09-15T23:12:51.441874+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T23:12:56.055 INFO:tasks.ceph.ceph_manager.ceph:PG 5.b is not active+clean 2024-09-15T23:12:56.055 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:51.444709+0000', 'last_change': '2024-09-15T23:12:51.444709+0000', 'last_active': '2024-09-15T23:12:51.429763+0000', 'last_peered': '2024-09-15T23:12:51.429763+0000', 'last_clean': '2024-09-15T23:12:51.429763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:51.444709+0000', 'last_undegraded': '2024-09-15T23:12:51.444709+0000', 'last_fullsized': '2024-09-15T23:12:51.444709+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T23:12:56.055 INFO:tasks.ceph.ceph_manager.ceph:PG 5.8 is not active+clean 2024-09-15T23:12:56.055 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:51.440109+0000', 'last_change': '2024-09-15T23:12:51.440109+0000', 'last_active': '2024-09-15T23:12:51.429763+0000', 'last_peered': '2024-09-15T23:12:51.429763+0000', 'last_clean': '2024-09-15T23:12:51.429763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:51.440109+0000', 'last_undegraded': '2024-09-15T23:12:51.440109+0000', 'last_fullsized': '2024-09-15T23:12:51.440109+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T23:12:56.055 INFO:tasks.ceph.ceph_manager.ceph:PG 5.6 is not active+clean 2024-09-15T23:12:56.055 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:51.435582+0000', 'last_change': '2024-09-15T23:12:51.435582+0000', 'last_active': '2024-09-15T23:12:51.429763+0000', 'last_peered': '2024-09-15T23:12:51.429763+0000', 'last_clean': '2024-09-15T23:12:51.429763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:51.435582+0000', 'last_undegraded': '2024-09-15T23:12:51.435582+0000', 'last_fullsized': '2024-09-15T23:12:51.435582+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T23:12:56.056 INFO:tasks.ceph.ceph_manager.ceph:PG 5.5 is not active+clean 2024-09-15T23:12:56.056 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:51.435253+0000', 'last_change': '2024-09-15T23:12:51.435253+0000', 'last_active': '2024-09-15T23:12:51.429763+0000', 'last_peered': '2024-09-15T23:12:51.429763+0000', 'last_clean': '2024-09-15T23:12:51.429763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:51.435253+0000', 'last_undegraded': '2024-09-15T23:12:51.435253+0000', 'last_fullsized': '2024-09-15T23:12:51.435253+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T23:12:56.056 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3 is not active+clean 2024-09-15T23:12:56.056 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:51.438521+0000', 'last_change': '2024-09-15T23:12:51.438521+0000', 'last_active': '2024-09-15T23:12:51.429763+0000', 'last_peered': '2024-09-15T23:12:51.429763+0000', 'last_clean': '2024-09-15T23:12:51.429763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:51.438521+0000', 'last_undegraded': '2024-09-15T23:12:51.438521+0000', 'last_fullsized': '2024-09-15T23:12:51.438521+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T23:12:56.056 INFO:tasks.ceph.ceph_manager.ceph:PG 5.0 is not active+clean 2024-09-15T23:12:56.056 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:12:51.439243+0000', 'last_change': '2024-09-15T23:12:51.439243+0000', 'last_active': '2024-09-15T23:12:51.429763+0000', 'last_peered': '2024-09-15T23:12:51.429763+0000', 'last_clean': '2024-09-15T23:12:51.429763+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:12:51.439243+0000', 'last_undegraded': '2024-09-15T23:12:51.439243+0000', 'last_fullsized': '2024-09-15T23:12:51.439243+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'last_clean_scrub_stamp': '2024-09-15T23:12:51.429763+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T23:12:56.056 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:12:56.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.184+0000 7fb36e19d640 1 Processor -- start 2024-09-15T23:12:56.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.185+0000 7fb36e19d640 1 -- start start 2024-09-15T23:12:56.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.185+0000 7fb36e19d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb36815b470 0x7fb36806e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:56.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.185+0000 7fb36e19d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb368071d60 0x7fb3680cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:56.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.185+0000 7fb36e19d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3680cf140 con 0x7fb3680c7850 2024-09-15T23:12:56.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.185+0000 7fb36e19d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fb368072ee0 con 0x7fb36815b470 2024-09-15T23:12:56.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.185+0000 7fb36e19d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb3680722d0 con 0x7fb368071d60 2024-09-15T23:12:56.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.186+0000 7fb36d19b640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb3680c7850 0x7fb3680c7c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41260/0 (socket says 172.21.15.123:41260) 2024-09-15T23:12:56.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.186+0000 7fb36d19b640 1 -- 172.21.15.123:0/1453961487 learned_addr learned my addr 172.21.15.123:0/1453961487 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:56.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.186+0000 7fb36c99a640 1 --2- 172.21.15.123:0/1453961487 >> v2:172.21.15.188:3300/0 conn(0x7fb36815b470 0x7fb36806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:56.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.186+0000 7fb36d99c640 1 --2- 172.21.15.123:0/1453961487 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb368071d60 0x7fb3680cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:56.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.186+0000 7fb35ffff640 1 -- 172.21.15.123:0/1453961487 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 694758482 0 0) 0x7fb3680cf140 con 0x7fb3680c7850 2024-09-15T23:12:56.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.186+0000 7fb35ffff640 1 -- 172.21.15.123:0/1453961487 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb354003520 con 0x7fb3680c7850 2024-09-15T23:12:56.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.186+0000 7fb35ffff640 1 -- 172.21.15.123:0/1453961487 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1138555289 0 0) 0x7fb354003520 con 0x7fb3680c7850 2024-09-15T23:12:56.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.186+0000 7fb35ffff640 1 -- 172.21.15.123:0/1453961487 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb368071d60 msgr2=0x7fb3680cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:56.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.186+0000 7fb35ffff640 1 --2- 172.21.15.123:0/1453961487 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb368071d60 0x7fb3680cbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:56.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.186+0000 7fb35ffff640 1 -- 172.21.15.123:0/1453961487 >> v2:172.21.15.188:3300/0 conn(0x7fb36815b470 msgr2=0x7fb36806e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:56.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.186+0000 7fb35ffff640 1 --2- 172.21.15.123:0/1453961487 >> v2:172.21.15.188:3300/0 conn(0x7fb36815b470 0x7fb36806e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:56.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.186+0000 7fb35ffff640 1 -- 172.21.15.123:0/1453961487 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3680725b0 con 0x7fb3680c7850 2024-09-15T23:12:56.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.186+0000 7fb35ffff640 1 -- 172.21.15.123:0/1453961487 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fb3600019f0 con 0x7fb3680c7850 2024-09-15T23:12:56.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.186+0000 7fb36c99a640 1 --2- 172.21.15.123:0/1453961487 >> v2:172.21.15.188:3300/0 conn(0x7fb36815b470 0x7fb36806e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:12:56.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.186+0000 7fb35ffff640 1 -- 172.21.15.123:0/1453961487 >> v1:172.21.15.123:6789/0 conn(0x7fb3680c7850 legacy=0x7fb3680c7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:56.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.186+0000 7fb35ffff640 1 --2- 172.21.15.123:0/1453961487 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb368071d60 0x7fb3540039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:56.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.186+0000 7fb35ffff640 1 --2- 172.21.15.123:0/1453961487 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb354003f30 0x7fb354004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:56.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.186+0000 7fb35ffff640 1 --2- 172.21.15.123:0/1453961487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb354004d40 0x7fb3540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:56.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.186+0000 7fb35ffff640 1 -- 172.21.15.123:0/1453961487 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb368072ee0 con 0x7fb354004d40 2024-09-15T23:12:56.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.186+0000 7fb35ffff640 1 -- 172.21.15.123:0/1453961487 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb3680722d0 con 0x7fb354003f30 2024-09-15T23:12:56.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.186+0000 7fb35ffff640 1 -- 172.21.15.123:0/1453961487 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb35400b9c0 con 0x7fb368071d60 2024-09-15T23:12:56.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.186+0000 7fb36d99c640 1 --2- 172.21.15.123:0/1453961487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb354004d40 0x7fb3540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:56.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.186+0000 7fb36d19b640 1 --2- 172.21.15.123:0/1453961487 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb368071d60 0x7fb3540039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:56.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.186+0000 7fb36c99a640 1 --2- 172.21.15.123:0/1453961487 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb354003f30 0x7fb354004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:56.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.186+0000 7fb36d99c640 1 -- 172.21.15.123:0/1453961487 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb368071d60 msgr2=0x7fb3540039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:56.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.186+0000 7fb36d99c640 1 --2- 172.21.15.123:0/1453961487 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb368071d60 0x7fb3540039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:56.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.186+0000 7fb36d99c640 1 -- 172.21.15.123:0/1453961487 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb354003f30 msgr2=0x7fb354004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:56.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.186+0000 7fb36d99c640 1 --2- 172.21.15.123:0/1453961487 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb354003f30 0x7fb354004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:56.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.187+0000 7fb36d99c640 1 -- 172.21.15.123:0/1453961487 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb354003520 con 0x7fb354004d40 2024-09-15T23:12:56.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.187+0000 7fb36d99c640 1 --2- 172.21.15.123:0/1453961487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb354004d40 0x7fb3540051c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb364009ac0 tx=0x7fb354005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31c48ec177defec8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:56.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.187+0000 7fb35ffff640 1 -- 172.21.15.123:0/1453961487 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb364036070 con 0x7fb354004d40 2024-09-15T23:12:56.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.187+0000 7fb35ffff640 1 -- 172.21.15.123:0/1453961487 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb364031400 con 0x7fb354004d40 2024-09-15T23:12:56.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.187+0000 7fb35ffff640 1 -- 172.21.15.123:0/1453961487 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb364009690 con 0x7fb354004d40 2024-09-15T23:12:56.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.188+0000 7fb36e19d640 1 -- 172.21.15.123:0/1453961487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb354004d40 msgr2=0x7fb3540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:56.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.188+0000 7fb36e19d640 1 --2- 172.21.15.123:0/1453961487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb354004d40 0x7fb3540051c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb364009ac0 tx=0x7fb354005830 comp rx=0 tx=0).stop 2024-09-15T23:12:56.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.188+0000 7fb36d99c640 1 -- 172.21.15.123:0/1453961487 reap_dead start 2024-09-15T23:12:56.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.188+0000 7fb36e19d640 1 -- 172.21.15.123:0/1453961487 shutdown_connections 2024-09-15T23:12:56.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.188+0000 7fb36e19d640 1 -- 172.21.15.123:0/1453961487 >> 172.21.15.123:0/1453961487 conn(0x7fb36806d350 msgr2=0x7fb3680b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:56.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.188+0000 7fb36e19d640 1 -- 172.21.15.123:0/1453961487 shutdown_connections 2024-09-15T23:12:56.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.188+0000 7fb36e19d640 1 -- 172.21.15.123:0/1453961487 wait complete. 2024-09-15T23:12:56.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.189+0000 7fb36e19d640 1 Processor -- start 2024-09-15T23:12:56.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.189+0000 7fb36e19d640 1 -- start start 2024-09-15T23:12:56.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.190+0000 7fb36e19d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb354004d40 0x7fb3680b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:56.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.190+0000 7fb36e19d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb368152380 0x7fb3680b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:56.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.190+0000 7fb36e19d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb368151da0 0x7fb368149cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:56.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.190+0000 7fb36e19d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb3680cbb00 con 0x7fb368152380 2024-09-15T23:12:56.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.190+0000 7fb36e19d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb368072b70 con 0x7fb354004d40 2024-09-15T23:12:56.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.190+0000 7fb36e19d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb3680cbc80 con 0x7fb368151da0 2024-09-15T23:12:56.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.190+0000 7fb36c99a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb368152380 0x7fb3680b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:56.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.190+0000 7fb36c99a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb368152380 0x7fb3680b6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55284/0 (socket says 172.21.15.123:55284) 2024-09-15T23:12:56.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.190+0000 7fb36c99a640 1 -- 172.21.15.123:0/2295323736 learned_addr learned my addr 172.21.15.123:0/2295323736 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:56.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.190+0000 7fb36d19b640 1 --2- 172.21.15.123:0/2295323736 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb354004d40 0x7fb3680b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:56.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.190+0000 7fb36d99c640 1 --2- 172.21.15.123:0/2295323736 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb368151da0 0x7fb368149cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:56.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.190+0000 7fb36c99a640 1 -- 172.21.15.123:0/2295323736 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb368151da0 msgr2=0x7fb368149cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:56.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.190+0000 7fb36c99a640 1 --2- 172.21.15.123:0/2295323736 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb368151da0 0x7fb368149cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:56.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.190+0000 7fb36c99a640 1 -- 172.21.15.123:0/2295323736 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb354004d40 msgr2=0x7fb3680b5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:56.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.190+0000 7fb36c99a640 1 --2- 172.21.15.123:0/2295323736 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb354004d40 0x7fb3680b5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:56.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.190+0000 7fb36c99a640 1 -- 172.21.15.123:0/2295323736 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3680b5be0 con 0x7fb368152380 2024-09-15T23:12:56.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.191+0000 7fb36c99a640 1 --2- 172.21.15.123:0/2295323736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb368152380 0x7fb3680b6c80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb358011cd0 tx=0x7fb35800f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:56.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.191+0000 7fb35dffb640 1 -- 172.21.15.123:0/2295323736 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb358011d00 con 0x7fb368152380 2024-09-15T23:12:56.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.191+0000 7fb35dffb640 1 -- 172.21.15.123:0/2295323736 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb358004030 con 0x7fb368152380 2024-09-15T23:12:56.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.191+0000 7fb36e19d640 1 -- 172.21.15.123:0/2295323736 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3680b5ec0 con 0x7fb368152380 2024-09-15T23:12:56.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.191+0000 7fb35dffb640 1 -- 172.21.15.123:0/2295323736 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb358011ea0 con 0x7fb368152380 2024-09-15T23:12:56.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.191+0000 7fb36e19d640 1 -- 172.21.15.123:0/2295323736 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3680b6480 con 0x7fb368152380 2024-09-15T23:12:56.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.192+0000 7fb36e19d640 1 -- 172.21.15.123:0/2295323736 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb36806e840 con 0x7fb368152380 2024-09-15T23:12:56.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.192+0000 7fb35dffb640 1 -- 172.21.15.123:0/2295323736 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb358012040 con 0x7fb368152380 2024-09-15T23:12:56.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.193+0000 7fb35dffb640 1 --2- 172.21.15.123:0/2295323736 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb34c06c2b0 0x7fb34c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:56.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.193+0000 7fb35dffb640 1 -- 172.21.15.123:0/2295323736 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fb35808b820 con 0x7fb368152380 2024-09-15T23:12:56.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.193+0000 7fb36d19b640 1 --2- 172.21.15.123:0/2295323736 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb34c06c2b0 0x7fb34c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:56.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.193+0000 7fb36d19b640 1 --2- 172.21.15.123:0/2295323736 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb34c06c2b0 0x7fb34c06e770 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb360004dc0 tx=0x7fb360006040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:56.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.197+0000 7fb35dffb640 1 -- 172.21.15.123:0/2295323736 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb358019070 con 0x7fb368152380 2024-09-15T23:12:56.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.425+0000 7fb36e19d640 1 -- 172.21.15.123:0/2295323736 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fb36806c540 con 0x7fb368152380 2024-09-15T23:12:56.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.426+0000 7fb35dffb640 1 -- 172.21.15.123:0/2295323736 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1151 (secure 0 0 0) 0x7fb3580599d0 con 0x7fb368152380 2024-09-15T23:12:56.427 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:56.427 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":66,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":33,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":48},{"state_name":"creating+peering","count":30},{"state_name":"active+clean","count":19}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":225165312,"bytes_avail":772868947968,"bytes_total":773094113280,"unknown_pgs_ratio":0.49484536051750183,"inactive_pgs_ratio":0.30927833914756775},"fsmap":{"epoch":13,"btime":"2024-09-15T23:12:54:460875+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":4776}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-15T23:11:49.433169+0000","services":{}},"progress_events":{}} 2024-09-15T23:12:56.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.428+0000 7fb36e19d640 1 -- 172.21.15.123:0/2295323736 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb34c06c2b0 msgr2=0x7fb34c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:56.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.428+0000 7fb36e19d640 1 --2- 172.21.15.123:0/2295323736 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb34c06c2b0 0x7fb34c06e770 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb360004dc0 tx=0x7fb360006040 comp rx=0 tx=0).stop 2024-09-15T23:12:56.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.428+0000 7fb36e19d640 1 -- 172.21.15.123:0/2295323736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb368152380 msgr2=0x7fb3680b6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:56.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.428+0000 7fb36e19d640 1 --2- 172.21.15.123:0/2295323736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb368152380 0x7fb3680b6c80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb358011cd0 tx=0x7fb35800f610 comp rx=0 tx=0).stop 2024-09-15T23:12:56.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.428+0000 7fb36e19d640 1 -- 172.21.15.123:0/2295323736 shutdown_connections 2024-09-15T23:12:56.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.428+0000 7fb36e19d640 1 --2- 172.21.15.123:0/2295323736 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb368151da0 0x7fb368149cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:56.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.428+0000 7fb36e19d640 1 --2- 172.21.15.123:0/2295323736 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb34c06c2b0 0x7fb34c06e770 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:56.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.428+0000 7fb36e19d640 1 --2- 172.21.15.123:0/2295323736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb368152380 0x7fb3680b6c80 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:56.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.428+0000 7fb36e19d640 1 --2- 172.21.15.123:0/2295323736 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb354004d40 0x7fb3680b5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:56.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.428+0000 7fb36e19d640 1 -- 172.21.15.123:0/2295323736 >> 172.21.15.123:0/2295323736 conn(0x7fb36806d350 msgr2=0x7fb3680b0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:56.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.428+0000 7fb36e19d640 1 -- 172.21.15.123:0/2295323736 shutdown_connections 2024-09-15T23:12:56.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.428+0000 7fb36e19d640 1 -- 172.21.15.123:0/2295323736 wait complete. 2024-09-15T23:12:56.439 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-15T23:12:56.440 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:12:56.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.537+0000 7f0a445d6640 1 Processor -- start 2024-09-15T23:12:56.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.537+0000 7f0a445d6640 1 -- start start 2024-09-15T23:12:56.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.538+0000 7f0a445d6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0a3c1461a0 0x7f0a3c15d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:56.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.538+0000 7f0a445d6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f0a3c0720c0 0x7f0a3c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:56.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.538+0000 7f0a445d6640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a3c06c560 con 0x7f0a3c06c150 2024-09-15T23:12:56.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.538+0000 7f0a445d6640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f0a3c15ddc0 con 0x7f0a3c1461a0 2024-09-15T23:12:56.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.538+0000 7f0a445d6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f0a3c146580 con 0x7f0a3c0720c0 2024-09-15T23:12:56.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.538+0000 7f0a42372640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0a3c1461a0 0x7f0a3c15d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:56.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.538+0000 7f0a42b73640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f0a3c06c150 0x7f0a3c0b67a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38316/0 (socket says 172.21.15.123:38316) 2024-09-15T23:12:56.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.538+0000 7f0a42372640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0a3c1461a0 0x7f0a3c15d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41556/0 (socket says 172.21.15.123:41556) 2024-09-15T23:12:56.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.538+0000 7f0a42b73640 1 -- 172.21.15.123:0/2018902305 learned_addr learned my addr 172.21.15.123:0/2018902305 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:56.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.538+0000 7f0a42372640 1 -- 172.21.15.123:0/2018902305 >> v2:172.21.15.188:3300/0 conn(0x7f0a3c0720c0 msgr2=0x7f0a3c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:12:56.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.538+0000 7f0a42372640 1 --2- 172.21.15.123:0/2018902305 >> v2:172.21.15.188:3300/0 conn(0x7f0a3c0720c0 0x7f0a3c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:56.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.538+0000 7f0a42372640 1 -- 172.21.15.123:0/2018902305 >> v1:172.21.15.123:6789/0 conn(0x7f0a3c06c150 legacy=0x7f0a3c0b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:56.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.539+0000 7f0a42372640 1 -- 172.21.15.123:0/2018902305 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a3c0728d0 con 0x7f0a3c1461a0 2024-09-15T23:12:56.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.539+0000 7f0a41370640 1 -- 172.21.15.123:0/2018902305 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 32305235 0 0) 0x7f0a34001490 con 0x7f0a3c06c150 2024-09-15T23:12:56.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.539+0000 7f0a42372640 1 --2- 172.21.15.123:0/2018902305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a3c1461a0 0x7f0a3c15d840 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c071f30 tx=0x7f0a3802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d2834b3c0981a10 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:56.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.539+0000 7f0a41370640 1 -- 172.21.15.123:0/2018902305 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a38037070 con 0x7f0a3c1461a0 2024-09-15T23:12:56.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.539+0000 7f0a41370640 1 -- 172.21.15.123:0/2018902305 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a38032440 con 0x7f0a3c1461a0 2024-09-15T23:12:56.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.539+0000 7f0a41370640 1 -- 172.21.15.123:0/2018902305 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a38032810 con 0x7f0a3c1461a0 2024-09-15T23:12:56.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.540+0000 7f0a445d6640 1 -- 172.21.15.123:0/2018902305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a3c1461a0 msgr2=0x7f0a3c15d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:56.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.540+0000 7f0a445d6640 1 --2- 172.21.15.123:0/2018902305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a3c1461a0 0x7f0a3c15d840 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c071f30 tx=0x7f0a3802a1a0 comp rx=0 tx=0).stop 2024-09-15T23:12:56.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.540+0000 7f0a445d6640 1 -- 172.21.15.123:0/2018902305 shutdown_connections 2024-09-15T23:12:56.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.540+0000 7f0a445d6640 1 --2- 172.21.15.123:0/2018902305 >> v2:172.21.15.188:3300/0 conn(0x7f0a3c0720c0 0x7f0a3c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:56.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.540+0000 7f0a445d6640 1 --2- 172.21.15.123:0/2018902305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a3c1461a0 0x7f0a3c15d840 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:56.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.540+0000 7f0a445d6640 1 -- 172.21.15.123:0/2018902305 >> 172.21.15.123:0/2018902305 conn(0x7f0a3c06cd20 msgr2=0x7f0a3c06d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:56.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.540+0000 7f0a445d6640 1 -- 172.21.15.123:0/2018902305 shutdown_connections 2024-09-15T23:12:56.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.540+0000 7f0a445d6640 1 -- 172.21.15.123:0/2018902305 wait complete. 2024-09-15T23:12:56.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.541+0000 7f0a445d6640 1 Processor -- start 2024-09-15T23:12:56.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.541+0000 7f0a445d6640 1 -- start start 2024-09-15T23:12:56.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.542+0000 7f0a445d6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0a3c06c150 0x7f0a3c0b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:56.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.542+0000 7f0a445d6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a3c0720c0 0x7f0a3c0c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:56.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.542+0000 7f0a445d6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a3c1461a0 0x7f0a3c0b6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:56.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.542+0000 7f0a445d6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3c073170 con 0x7f0a3c0720c0 2024-09-15T23:12:56.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.542+0000 7f0a445d6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3c072e90 con 0x7f0a3c1461a0 2024-09-15T23:12:56.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.542+0000 7f0a445d6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0a3c072530 con 0x7f0a3c06c150 2024-09-15T23:12:56.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.542+0000 7f0a41b71640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a3c0720c0 0x7f0a3c0c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:56.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.542+0000 7f0a41b71640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a3c0720c0 0x7f0a3c0c8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41562/0 (socket says 172.21.15.123:41562) 2024-09-15T23:12:56.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.542+0000 7f0a41b71640 1 -- 172.21.15.123:0/153213793 learned_addr learned my addr 172.21.15.123:0/153213793 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:56.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.542+0000 7f0a42b73640 1 --2- 172.21.15.123:0/153213793 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a3c1461a0 0x7f0a3c0b6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:56.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.542+0000 7f0a42372640 1 --2- 172.21.15.123:0/153213793 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0a3c06c150 0x7f0a3c0b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:56.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.542+0000 7f0a41b71640 1 -- 172.21.15.123:0/153213793 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0a3c06c150 msgr2=0x7f0a3c0b53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:56.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.542+0000 7f0a41b71640 1 --2- 172.21.15.123:0/153213793 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0a3c06c150 0x7f0a3c0b53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:56.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.542+0000 7f0a41b71640 1 -- 172.21.15.123:0/153213793 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a3c1461a0 msgr2=0x7f0a3c0b6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:56.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.542+0000 7f0a41b71640 1 --2- 172.21.15.123:0/153213793 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a3c1461a0 0x7f0a3c0b6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:56.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.542+0000 7f0a41b71640 1 -- 172.21.15.123:0/153213793 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a3c0c8a80 con 0x7f0a3c0720c0 2024-09-15T23:12:56.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.542+0000 7f0a41b71640 1 --2- 172.21.15.123:0/153213793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a3c0720c0 0x7f0a3c0c8540 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c00b4d0 tx=0x7f0a2c00b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:56.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.543+0000 7f0a32ffd640 1 -- 172.21.15.123:0/153213793 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c014070 con 0x7f0a3c0720c0 2024-09-15T23:12:56.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.543+0000 7f0a32ffd640 1 -- 172.21.15.123:0/153213793 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a2c010870 con 0x7f0a3c0720c0 2024-09-15T23:12:56.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.543+0000 7f0a32ffd640 1 -- 172.21.15.123:0/153213793 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c010c60 con 0x7f0a3c0720c0 2024-09-15T23:12:56.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.543+0000 7f0a445d6640 1 -- 172.21.15.123:0/153213793 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a3c157420 con 0x7f0a3c0720c0 2024-09-15T23:12:56.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.543+0000 7f0a445d6640 1 -- 172.21.15.123:0/153213793 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a3c1579e0 con 0x7f0a3c0720c0 2024-09-15T23:12:56.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.544+0000 7f0a445d6640 1 -- 172.21.15.123:0/153213793 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a3c06bc10 con 0x7f0a3c0720c0 2024-09-15T23:12:56.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.544+0000 7f0a32ffd640 1 -- 172.21.15.123:0/153213793 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0a2c017070 con 0x7f0a3c0720c0 2024-09-15T23:12:56.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.544+0000 7f0a32ffd640 1 --2- 172.21.15.123:0/153213793 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0a2006c2b0 0x7f0a2006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:56.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.545+0000 7f0a32ffd640 1 -- 172.21.15.123:0/153213793 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f0a2c08b200 con 0x7f0a3c0720c0 2024-09-15T23:12:56.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.545+0000 7f0a42372640 1 --2- 172.21.15.123:0/153213793 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0a2006c2b0 0x7f0a2006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:56.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.545+0000 7f0a42372640 1 --2- 172.21.15.123:0/153213793 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0a2006c2b0 0x7f0a2006e770 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0a38034000 tx=0x7f0a3802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:56.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.549+0000 7f0a32ffd640 1 -- 172.21.15.123:0/153213793 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0a2c059a00 con 0x7f0a3c0720c0 2024-09-15T23:12:56.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.710+0000 7f0a445d6640 1 -- 172.21.15.123:0/153213793 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0a3c0b6a40 con 0x7f0a2006c2b0 2024-09-15T23:12:56.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.716+0000 7f0a32ffd640 1 -- 172.21.15.123:0/153213793 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249436 (secure 0 0 0) 0x7f0a3c0b6a40 con 0x7f0a2006c2b0 2024-09-15T23:12:56.719 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:12:56.721 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:12:56.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.719+0000 7f0a445d6640 1 -- 172.21.15.123:0/153213793 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0a2006c2b0 msgr2=0x7f0a2006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:56.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.719+0000 7f0a445d6640 1 --2- 172.21.15.123:0/153213793 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0a2006c2b0 0x7f0a2006e770 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0a38034000 tx=0x7f0a3802e000 comp rx=0 tx=0).stop 2024-09-15T23:12:56.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.719+0000 7f0a445d6640 1 -- 172.21.15.123:0/153213793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a3c0720c0 msgr2=0x7f0a3c0c8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:56.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.719+0000 7f0a445d6640 1 --2- 172.21.15.123:0/153213793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a3c0720c0 0x7f0a3c0c8540 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c00b4d0 tx=0x7f0a2c00b990 comp rx=0 tx=0).stop 2024-09-15T23:12:56.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.719+0000 7f0a445d6640 1 -- 172.21.15.123:0/153213793 shutdown_connections 2024-09-15T23:12:56.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.719+0000 7f0a445d6640 1 --2- 172.21.15.123:0/153213793 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a3c1461a0 0x7f0a3c0b6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:56.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.719+0000 7f0a445d6640 1 --2- 172.21.15.123:0/153213793 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0a2006c2b0 0x7f0a2006e770 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:56.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.719+0000 7f0a445d6640 1 --2- 172.21.15.123:0/153213793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a3c0720c0 0x7f0a3c0c8540 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:56.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.719+0000 7f0a445d6640 1 --2- 172.21.15.123:0/153213793 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0a3c06c150 0x7f0a3c0b53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:56.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.719+0000 7f0a445d6640 1 -- 172.21.15.123:0/153213793 >> 172.21.15.123:0/153213793 conn(0x7f0a3c06cd20 msgr2=0x7f0a3c15c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:56.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.719+0000 7f0a445d6640 1 -- 172.21.15.123:0/153213793 shutdown_connections 2024-09-15T23:12:56.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:56.719+0000 7f0a445d6640 1 -- 172.21.15.123:0/153213793 wait complete. 2024-09-15T23:12:56.731 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-09-15T23:12:55.512066+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591144,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":174,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":57,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220040,"kb_used_data":3812,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754680,"statfs":{"total":773094113280,"available":772868792320,"internally_reserved":0,"allocated":3903488,"data_stored":2196418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":776,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.081252"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.454163+0000","last_change":"2024-09-15T23:12:52.453105+0000","last_active":"2024-09-15T23:12:52.454163+0000","last_peered":"2024-09-15T23:12:52.454163+0000","last_clean":"2024-09-15T23:12:52.454163+0000","last_became_active":"2024-09-15T23:12:52.452616+0000","last_became_peered":"2024-09-15T23:12:52.452616+0000","last_unstale":"2024-09-15T23:12:52.454163+0000","last_undegraded":"2024-09-15T23:12:52.454163+0000","last_fullsized":"2024-09-15T23:12:52.454163+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:02.512690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.446214+0000","last_change":"2024-09-15T23:12:51.446214+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.446214+0000","last_undegraded":"2024-09-15T23:12:51.446214+0000","last_fullsized":"2024-09-15T23:12:51.446214+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.448132+0000","last_change":"2024-09-15T23:12:52.466279+0000","last_active":"2024-09-15T23:12:53.448132+0000","last_peered":"2024-09-15T23:12:53.448132+0000","last_clean":"2024-09-15T23:12:53.448132+0000","last_became_active":"2024-09-15T23:12:52.466029+0000","last_became_peered":"2024-09-15T23:12:52.466029+0000","last_unstale":"2024-09-15T23:12:53.448132+0000","last_undegraded":"2024-09-15T23:12:53.448132+0000","last_fullsized":"2024-09-15T23:12:53.448132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:20:38.553039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.440720+0000","last_change":"2024-09-15T23:12:51.440720+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.440720+0000","last_undegraded":"2024-09-15T23:12:51.440720+0000","last_fullsized":"2024-09-15T23:12:51.440720+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.445209+0000","last_change":"2024-09-15T23:12:51.445209+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.445209+0000","last_undegraded":"2024-09-15T23:12:51.445209+0000","last_fullsized":"2024-09-15T23:12:51.445209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.435722+0000","last_change":"2024-09-15T23:12:51.435722+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.435722+0000","last_undegraded":"2024-09-15T23:12:51.435722+0000","last_fullsized":"2024-09-15T23:12:51.435722+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.459287+0000","last_change":"2024-09-15T23:12:52.457860+0000","last_active":"2024-09-15T23:12:52.459287+0000","last_peered":"2024-09-15T23:12:52.459287+0000","last_clean":"2024-09-15T23:12:52.459287+0000","last_became_active":"2024-09-15T23:12:52.457618+0000","last_became_peered":"2024-09-15T23:12:52.457618+0000","last_unstale":"2024-09-15T23:12:52.459287+0000","last_undegraded":"2024-09-15T23:12:52.459287+0000","last_fullsized":"2024-09-15T23:12:52.459287+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:52:27.356135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.474855+0000","last_change":"2024-09-15T23:12:52.463834+0000","last_active":"2024-09-15T23:12:52.474855+0000","last_peered":"2024-09-15T23:12:52.474855+0000","last_clean":"2024-09-15T23:12:52.474855+0000","last_became_active":"2024-09-15T23:12:52.463539+0000","last_became_peered":"2024-09-15T23:12:52.463539+0000","last_unstale":"2024-09-15T23:12:52.474855+0000","last_undegraded":"2024-09-15T23:12:52.474855+0000","last_fullsized":"2024-09-15T23:12:52.474855+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:19:31.718835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.448340+0000","last_change":"2024-09-15T23:12:52.463487+0000","last_active":"2024-09-15T23:12:53.448340+0000","last_peered":"2024-09-15T23:12:53.448340+0000","last_clean":"2024-09-15T23:12:53.448340+0000","last_became_active":"2024-09-15T23:12:52.463207+0000","last_became_peered":"2024-09-15T23:12:52.463207+0000","last_unstale":"2024-09-15T23:12:53.448340+0000","last_undegraded":"2024-09-15T23:12:53.448340+0000","last_fullsized":"2024-09-15T23:12:53.448340+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:14:53.217748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.439885+0000","last_change":"2024-09-15T23:12:51.439885+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.439885+0000","last_undegraded":"2024-09-15T23:12:51.439885+0000","last_fullsized":"2024-09-15T23:12:51.439885+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451170+0000","last_change":"2024-09-15T23:12:52.458033+0000","last_active":"2024-09-15T23:12:53.451170+0000","last_peered":"2024-09-15T23:12:53.451170+0000","last_clean":"2024-09-15T23:12:53.451170+0000","last_became_active":"2024-09-15T23:12:52.457545+0000","last_became_peered":"2024-09-15T23:12:52.457545+0000","last_unstale":"2024-09-15T23:12:53.451170+0000","last_undegraded":"2024-09-15T23:12:53.451170+0000","last_fullsized":"2024-09-15T23:12:53.451170+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:34.053910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.448205+0000","last_change":"2024-09-15T23:12:52.467341+0000","last_active":"2024-09-15T23:12:53.448205+0000","last_peered":"2024-09-15T23:12:53.448205+0000","last_clean":"2024-09-15T23:12:53.448205+0000","last_became_active":"2024-09-15T23:12:52.467027+0000","last_became_peered":"2024-09-15T23:12:52.467027+0000","last_unstale":"2024-09-15T23:12:53.448205+0000","last_undegraded":"2024-09-15T23:12:53.448205+0000","last_fullsized":"2024-09-15T23:12:53.448205+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:55.990210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.440839+0000","last_change":"2024-09-15T23:12:51.440839+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.440839+0000","last_undegraded":"2024-09-15T23:12:51.440839+0000","last_fullsized":"2024-09-15T23:12:51.440839+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.438090+0000","last_change":"2024-09-15T23:12:51.438090+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.438090+0000","last_undegraded":"2024-09-15T23:12:51.438090+0000","last_fullsized":"2024-09-15T23:12:51.438090+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.455115+0000","last_change":"2024-09-15T23:12:52.453291+0000","last_active":"2024-09-15T23:12:52.455115+0000","last_peered":"2024-09-15T23:12:52.455115+0000","last_clean":"2024-09-15T23:12:52.455115+0000","last_became_active":"2024-09-15T23:12:52.453043+0000","last_became_peered":"2024-09-15T23:12:52.453043+0000","last_unstale":"2024-09-15T23:12:52.455115+0000","last_undegraded":"2024-09-15T23:12:52.455115+0000","last_fullsized":"2024-09-15T23:12:52.455115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:25:44.857457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.465371+0000","last_change":"2024-09-15T23:12:52.460235+0000","last_active":"2024-09-15T23:12:52.465371+0000","last_peered":"2024-09-15T23:12:52.465371+0000","last_clean":"2024-09-15T23:12:52.465371+0000","last_became_active":"2024-09-15T23:12:52.459117+0000","last_became_peered":"2024-09-15T23:12:52.459117+0000","last_unstale":"2024-09-15T23:12:52.465371+0000","last_undegraded":"2024-09-15T23:12:52.465371+0000","last_fullsized":"2024-09-15T23:12:52.465371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:05.135809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451265+0000","last_change":"2024-09-15T23:12:52.461872+0000","last_active":"2024-09-15T23:12:53.451265+0000","last_peered":"2024-09-15T23:12:53.451265+0000","last_clean":"2024-09-15T23:12:53.451265+0000","last_became_active":"2024-09-15T23:12:52.460948+0000","last_became_peered":"2024-09-15T23:12:52.460948+0000","last_unstale":"2024-09-15T23:12:53.451265+0000","last_undegraded":"2024-09-15T23:12:53.451265+0000","last_fullsized":"2024-09-15T23:12:53.451265+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:19.030595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.436838+0000","last_change":"2024-09-15T23:12:51.436838+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.436838+0000","last_undegraded":"2024-09-15T23:12:51.436838+0000","last_fullsized":"2024-09-15T23:12:51.436838+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.438314+0000","last_change":"2024-09-15T23:12:51.438314+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.438314+0000","last_undegraded":"2024-09-15T23:12:51.438314+0000","last_fullsized":"2024-09-15T23:12:51.438314+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.442999+0000","last_change":"2024-09-15T23:12:51.442999+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.442999+0000","last_undegraded":"2024-09-15T23:12:51.442999+0000","last_fullsized":"2024-09-15T23:12:51.442999+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.468019+0000","last_change":"2024-09-15T23:12:52.464198+0000","last_active":"2024-09-15T23:12:52.468019+0000","last_peered":"2024-09-15T23:12:52.468019+0000","last_clean":"2024-09-15T23:12:52.468019+0000","last_became_active":"2024-09-15T23:12:52.463937+0000","last_became_peered":"2024-09-15T23:12:52.463937+0000","last_unstale":"2024-09-15T23:12:52.468019+0000","last_undegraded":"2024-09-15T23:12:52.468019+0000","last_fullsized":"2024-09-15T23:12:52.468019+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:57.664093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.474689+0000","last_change":"2024-09-15T23:12:52.464338+0000","last_active":"2024-09-15T23:12:52.474689+0000","last_peered":"2024-09-15T23:12:52.474689+0000","last_clean":"2024-09-15T23:12:52.474689+0000","last_became_active":"2024-09-15T23:12:52.464092+0000","last_became_peered":"2024-09-15T23:12:52.464092+0000","last_unstale":"2024-09-15T23:12:52.474689+0000","last_undegraded":"2024-09-15T23:12:52.474689+0000","last_fullsized":"2024-09-15T23:12:52.474689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:12.512486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.441120+0000","last_change":"2024-09-15T23:12:51.441120+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.441120+0000","last_undegraded":"2024-09-15T23:12:51.441120+0000","last_fullsized":"2024-09-15T23:12:51.441120+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.469898+0000","last_change":"2024-09-15T23:12:52.462708+0000","last_active":"2024-09-15T23:12:52.469898+0000","last_peered":"2024-09-15T23:12:52.469898+0000","last_clean":"2024-09-15T23:12:52.469898+0000","last_became_active":"2024-09-15T23:12:52.462438+0000","last_became_peered":"2024-09-15T23:12:52.462438+0000","last_unstale":"2024-09-15T23:12:52.469898+0000","last_undegraded":"2024-09-15T23:12:52.469898+0000","last_fullsized":"2024-09-15T23:12:52.469898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:57.420799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.441100+0000","last_change":"2024-09-15T23:12:51.441100+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.441100+0000","last_undegraded":"2024-09-15T23:12:51.441100+0000","last_fullsized":"2024-09-15T23:12:51.441100+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.438323+0000","last_change":"2024-09-15T23:12:51.438323+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.438323+0000","last_undegraded":"2024-09-15T23:12:51.438323+0000","last_fullsized":"2024-09-15T23:12:51.438323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.449796+0000","last_change":"2024-09-15T23:12:51.449796+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.449796+0000","last_undegraded":"2024-09-15T23:12:51.449796+0000","last_fullsized":"2024-09-15T23:12:51.449796+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.477316+0000","last_change":"2024-09-15T23:12:52.471955+0000","last_active":"2024-09-15T23:12:52.477316+0000","last_peered":"2024-09-15T23:12:52.477316+0000","last_clean":"2024-09-15T23:12:52.477316+0000","last_became_active":"2024-09-15T23:12:52.471618+0000","last_became_peered":"2024-09-15T23:12:52.471618+0000","last_unstale":"2024-09-15T23:12:52.477316+0000","last_undegraded":"2024-09-15T23:12:52.477316+0000","last_fullsized":"2024-09-15T23:12:52.477316+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:46:23.379877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.465420+0000","last_change":"2024-09-15T23:12:52.462544+0000","last_active":"2024-09-15T23:12:52.465420+0000","last_peered":"2024-09-15T23:12:52.465420+0000","last_clean":"2024-09-15T23:12:52.465420+0000","last_became_active":"2024-09-15T23:12:52.462270+0000","last_became_peered":"2024-09-15T23:12:52.462270+0000","last_unstale":"2024-09-15T23:12:52.465420+0000","last_undegraded":"2024-09-15T23:12:52.465420+0000","last_fullsized":"2024-09-15T23:12:52.465420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:55.053081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.455761+0000","last_change":"2024-09-15T23:12:52.453929+0000","last_active":"2024-09-15T23:12:52.455761+0000","last_peered":"2024-09-15T23:12:52.455761+0000","last_clean":"2024-09-15T23:12:52.455761+0000","last_became_active":"2024-09-15T23:12:52.453664+0000","last_became_peered":"2024-09-15T23:12:52.453664+0000","last_unstale":"2024-09-15T23:12:52.455761+0000","last_undegraded":"2024-09-15T23:12:52.455761+0000","last_fullsized":"2024-09-15T23:12:52.455761+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:57:16.075690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.459816+0000","last_change":"2024-09-15T23:12:52.458926+0000","last_active":"2024-09-15T23:12:52.459816+0000","last_peered":"2024-09-15T23:12:52.459816+0000","last_clean":"2024-09-15T23:12:52.459816+0000","last_became_active":"2024-09-15T23:12:52.458667+0000","last_became_peered":"2024-09-15T23:12:52.458667+0000","last_unstale":"2024-09-15T23:12:52.459816+0000","last_undegraded":"2024-09-15T23:12:52.459816+0000","last_fullsized":"2024-09-15T23:12:52.459816+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:05:21.680105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.450898+0000","last_change":"2024-09-15T23:12:52.461349+0000","last_active":"2024-09-15T23:12:53.450898+0000","last_peered":"2024-09-15T23:12:53.450898+0000","last_clean":"2024-09-15T23:12:53.450898+0000","last_became_active":"2024-09-15T23:12:52.461083+0000","last_became_peered":"2024-09-15T23:12:52.461083+0000","last_unstale":"2024-09-15T23:12:53.450898+0000","last_undegraded":"2024-09-15T23:12:53.450898+0000","last_fullsized":"2024-09-15T23:12:53.450898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:08.491182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.440761+0000","last_change":"2024-09-15T23:12:51.440761+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.440761+0000","last_undegraded":"2024-09-15T23:12:51.440761+0000","last_fullsized":"2024-09-15T23:12:51.440761+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451306+0000","last_change":"2024-09-15T23:12:51.449922+0000","last_active":"2024-09-15T23:12:53.451306+0000","last_peered":"2024-09-15T23:12:53.451306+0000","last_clean":"2024-09-15T23:12:53.451306+0000","last_became_active":"2024-09-15T23:12:51.449687+0000","last_became_peered":"2024-09-15T23:12:51.449687+0000","last_unstale":"2024-09-15T23:12:53.451306+0000","last_undegraded":"2024-09-15T23:12:53.451306+0000","last_fullsized":"2024-09-15T23:12:53.451306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:38:04.702016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.474854+0000","last_change":"2024-09-15T23:12:52.468916+0000","last_active":"2024-09-15T23:12:52.474854+0000","last_peered":"2024-09-15T23:12:52.474854+0000","last_clean":"2024-09-15T23:12:52.474854+0000","last_became_active":"2024-09-15T23:12:52.468595+0000","last_became_peered":"2024-09-15T23:12:52.468595+0000","last_unstale":"2024-09-15T23:12:52.474854+0000","last_undegraded":"2024-09-15T23:12:52.474854+0000","last_fullsized":"2024-09-15T23:12:52.474854+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:37:59.504730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.451189+0000","last_change":"2024-09-15T23:12:51.446041+0000","last_active":"2024-09-15T23:12:51.451189+0000","last_peered":"2024-09-15T23:12:51.451189+0000","last_clean":"2024-09-15T23:12:51.451189+0000","last_became_active":"2024-09-15T23:12:51.445760+0000","last_became_peered":"2024-09-15T23:12:51.445760+0000","last_unstale":"2024-09-15T23:12:51.451189+0000","last_undegraded":"2024-09-15T23:12:51.451189+0000","last_fullsized":"2024-09-15T23:12:51.451189+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:56.067201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.469810+0000","last_change":"2024-09-15T23:12:52.462039+0000","last_active":"2024-09-15T23:12:52.469810+0000","last_peered":"2024-09-15T23:12:52.469810+0000","last_clean":"2024-09-15T23:12:52.469810+0000","last_became_active":"2024-09-15T23:12:52.461736+0000","last_became_peered":"2024-09-15T23:12:52.461736+0000","last_unstale":"2024-09-15T23:12:52.469810+0000","last_undegraded":"2024-09-15T23:12:52.469810+0000","last_fullsized":"2024-09-15T23:12:52.469810+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:19.961647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.461516+0000","last_change":"2024-09-15T23:12:51.456559+0000","last_active":"2024-09-15T23:12:51.461516+0000","last_peered":"2024-09-15T23:12:51.461516+0000","last_clean":"2024-09-15T23:12:51.461516+0000","last_became_active":"2024-09-15T23:12:51.456278+0000","last_became_peered":"2024-09-15T23:12:51.456278+0000","last_unstale":"2024-09-15T23:12:51.461516+0000","last_undegraded":"2024-09-15T23:12:51.461516+0000","last_fullsized":"2024-09-15T23:12:51.461516+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:54:39.483240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.439175+0000","last_change":"2024-09-15T23:12:51.439175+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.439175+0000","last_undegraded":"2024-09-15T23:12:51.439175+0000","last_fullsized":"2024-09-15T23:12:51.439175+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.453564+0000","last_change":"2024-09-15T23:12:51.449436+0000","last_active":"2024-09-15T23:12:51.453564+0000","last_peered":"2024-09-15T23:12:51.453564+0000","last_clean":"2024-09-15T23:12:51.453564+0000","last_became_active":"2024-09-15T23:12:51.448706+0000","last_became_peered":"2024-09-15T23:12:51.448706+0000","last_unstale":"2024-09-15T23:12:51.453564+0000","last_undegraded":"2024-09-15T23:12:51.453564+0000","last_fullsized":"2024-09-15T23:12:51.453564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:14.541750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.448160+0000","last_change":"2024-09-15T23:12:52.464069+0000","last_active":"2024-09-15T23:12:53.448160+0000","last_peered":"2024-09-15T23:12:53.448160+0000","last_clean":"2024-09-15T23:12:53.448160+0000","last_became_active":"2024-09-15T23:12:52.463781+0000","last_became_peered":"2024-09-15T23:12:52.463781+0000","last_unstale":"2024-09-15T23:12:53.448160+0000","last_undegraded":"2024-09-15T23:12:53.448160+0000","last_fullsized":"2024-09-15T23:12:53.448160+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:09.042477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.468517+0000","last_change":"2024-09-15T23:12:51.451652+0000","last_active":"2024-09-15T23:12:52.468517+0000","last_peered":"2024-09-15T23:12:52.468517+0000","last_clean":"2024-09-15T23:12:52.468517+0000","last_became_active":"2024-09-15T23:12:51.451402+0000","last_became_peered":"2024-09-15T23:12:51.451402+0000","last_unstale":"2024-09-15T23:12:52.468517+0000","last_undegraded":"2024-09-15T23:12:52.468517+0000","last_fullsized":"2024-09-15T23:12:52.468517+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:14:52.211105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.459799+0000","last_change":"2024-09-15T23:12:52.458843+0000","last_active":"2024-09-15T23:12:52.459799+0000","last_peered":"2024-09-15T23:12:52.459799+0000","last_clean":"2024-09-15T23:12:52.459799+0000","last_became_active":"2024-09-15T23:12:52.457773+0000","last_became_peered":"2024-09-15T23:12:52.457773+0000","last_unstale":"2024-09-15T23:12:52.459799+0000","last_undegraded":"2024-09-15T23:12:52.459799+0000","last_fullsized":"2024-09-15T23:12:52.459799+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:40:18.533270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.475046+0000","last_change":"2024-09-15T23:12:51.448418+0000","last_active":"2024-09-15T23:12:52.475046+0000","last_peered":"2024-09-15T23:12:52.475046+0000","last_clean":"2024-09-15T23:12:52.475046+0000","last_became_active":"2024-09-15T23:12:51.448149+0000","last_became_peered":"2024-09-15T23:12:51.448149+0000","last_unstale":"2024-09-15T23:12:52.475046+0000","last_undegraded":"2024-09-15T23:12:52.475046+0000","last_fullsized":"2024-09-15T23:12:52.475046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:15.959896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.448032+0000","last_change":"2024-09-15T23:12:52.462387+0000","last_active":"2024-09-15T23:12:53.448032+0000","last_peered":"2024-09-15T23:12:53.448032+0000","last_clean":"2024-09-15T23:12:53.448032+0000","last_became_active":"2024-09-15T23:12:52.462139+0000","last_became_peered":"2024-09-15T23:12:52.462139+0000","last_unstale":"2024-09-15T23:12:53.448032+0000","last_undegraded":"2024-09-15T23:12:53.448032+0000","last_fullsized":"2024-09-15T23:12:53.448032+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:09.263624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.450316+0000","last_change":"2024-09-15T23:12:51.444721+0000","last_active":"2024-09-15T23:12:51.450316+0000","last_peered":"2024-09-15T23:12:51.450316+0000","last_clean":"2024-09-15T23:12:51.450316+0000","last_became_active":"2024-09-15T23:12:51.444442+0000","last_became_peered":"2024-09-15T23:12:51.444442+0000","last_unstale":"2024-09-15T23:12:51.450316+0000","last_undegraded":"2024-09-15T23:12:51.450316+0000","last_fullsized":"2024-09-15T23:12:51.450316+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:32:06.994100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.438261+0000","last_change":"2024-09-15T23:12:51.438261+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.438261+0000","last_undegraded":"2024-09-15T23:12:51.438261+0000","last_fullsized":"2024-09-15T23:12:51.438261+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.450212+0000","last_change":"2024-09-15T23:12:51.451873+0000","last_active":"2024-09-15T23:12:52.450212+0000","last_peered":"2024-09-15T23:12:52.450212+0000","last_clean":"2024-09-15T23:12:52.450212+0000","last_became_active":"2024-09-15T23:12:51.451643+0000","last_became_peered":"2024-09-15T23:12:51.451643+0000","last_unstale":"2024-09-15T23:12:52.450212+0000","last_undegraded":"2024-09-15T23:12:52.450212+0000","last_fullsized":"2024-09-15T23:12:52.450212+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:54.983567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451272+0000","last_change":"2024-09-15T23:12:52.468640+0000","last_active":"2024-09-15T23:12:53.451272+0000","last_peered":"2024-09-15T23:12:53.451272+0000","last_clean":"2024-09-15T23:12:53.451272+0000","last_became_active":"2024-09-15T23:12:52.468384+0000","last_became_peered":"2024-09-15T23:12:52.468384+0000","last_unstale":"2024-09-15T23:12:53.451272+0000","last_undegraded":"2024-09-15T23:12:53.451272+0000","last_fullsized":"2024-09-15T23:12:53.451272+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:55.136613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.461399+0000","last_change":"2024-09-15T23:12:51.453452+0000","last_active":"2024-09-15T23:12:51.461399+0000","last_peered":"2024-09-15T23:12:51.461399+0000","last_clean":"2024-09-15T23:12:51.461399+0000","last_became_active":"2024-09-15T23:12:51.452973+0000","last_became_peered":"2024-09-15T23:12:51.452973+0000","last_unstale":"2024-09-15T23:12:51.461399+0000","last_undegraded":"2024-09-15T23:12:51.461399+0000","last_fullsized":"2024-09-15T23:12:51.461399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:05.785498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.440634+0000","last_change":"2024-09-15T23:12:51.440634+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.440634+0000","last_undegraded":"2024-09-15T23:12:51.440634+0000","last_fullsized":"2024-09-15T23:12:51.440634+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.461485+0000","last_change":"2024-09-15T23:12:51.454019+0000","last_active":"2024-09-15T23:12:51.461485+0000","last_peered":"2024-09-15T23:12:51.461485+0000","last_clean":"2024-09-15T23:12:51.461485+0000","last_became_active":"2024-09-15T23:12:51.453772+0000","last_became_peered":"2024-09-15T23:12:51.453772+0000","last_unstale":"2024-09-15T23:12:51.461485+0000","last_undegraded":"2024-09-15T23:12:51.461485+0000","last_fullsized":"2024-09-15T23:12:51.461485+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:25.384320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.439554+0000","last_change":"2024-09-15T23:12:51.439554+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.439554+0000","last_undegraded":"2024-09-15T23:12:51.439554+0000","last_fullsized":"2024-09-15T23:12:51.439554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451007+0000","last_change":"2024-09-15T23:12:51.446980+0000","last_active":"2024-09-15T23:12:53.451007+0000","last_peered":"2024-09-15T23:12:53.451007+0000","last_clean":"2024-09-15T23:12:53.451007+0000","last_became_active":"2024-09-15T23:12:51.446719+0000","last_became_peered":"2024-09-15T23:12:51.446719+0000","last_unstale":"2024-09-15T23:12:53.451007+0000","last_undegraded":"2024-09-15T23:12:53.451007+0000","last_fullsized":"2024-09-15T23:12:53.451007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:11.359265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451018+0000","last_change":"2024-09-15T23:12:52.457789+0000","last_active":"2024-09-15T23:12:53.451018+0000","last_peered":"2024-09-15T23:12:53.451018+0000","last_clean":"2024-09-15T23:12:53.451018+0000","last_became_active":"2024-09-15T23:12:52.457195+0000","last_became_peered":"2024-09-15T23:12:52.457195+0000","last_unstale":"2024-09-15T23:12:53.451018+0000","last_undegraded":"2024-09-15T23:12:53.451018+0000","last_fullsized":"2024-09-15T23:12:53.451018+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:13.992297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.456070+0000","last_change":"2024-09-15T23:12:51.452177+0000","last_active":"2024-09-15T23:12:51.456070+0000","last_peered":"2024-09-15T23:12:51.456070+0000","last_clean":"2024-09-15T23:12:51.456070+0000","last_became_active":"2024-09-15T23:12:51.451878+0000","last_became_peered":"2024-09-15T23:12:51.451878+0000","last_unstale":"2024-09-15T23:12:51.456070+0000","last_undegraded":"2024-09-15T23:12:51.456070+0000","last_fullsized":"2024-09-15T23:12:51.456070+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:15.959896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.442415+0000","last_change":"2024-09-15T23:12:51.442415+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.442415+0000","last_undegraded":"2024-09-15T23:12:51.442415+0000","last_fullsized":"2024-09-15T23:12:51.442415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.465541+0000","last_change":"2024-09-15T23:12:51.454218+0000","last_active":"2024-09-15T23:12:52.465541+0000","last_peered":"2024-09-15T23:12:52.465541+0000","last_clean":"2024-09-15T23:12:52.465541+0000","last_became_active":"2024-09-15T23:12:51.453793+0000","last_became_peered":"2024-09-15T23:12:51.453793+0000","last_unstale":"2024-09-15T23:12:52.465541+0000","last_undegraded":"2024-09-15T23:12:52.465541+0000","last_fullsized":"2024-09-15T23:12:52.465541+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:50.899634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.439007+0000","last_change":"2024-09-15T23:12:51.439007+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.439007+0000","last_undegraded":"2024-09-15T23:12:51.439007+0000","last_fullsized":"2024-09-15T23:12:51.439007+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.455944+0000","last_change":"2024-09-15T23:12:51.450186+0000","last_active":"2024-09-15T23:12:51.455944+0000","last_peered":"2024-09-15T23:12:51.455944+0000","last_clean":"2024-09-15T23:12:51.455944+0000","last_became_active":"2024-09-15T23:12:51.449900+0000","last_became_peered":"2024-09-15T23:12:51.449900+0000","last_unstale":"2024-09-15T23:12:51.455944+0000","last_undegraded":"2024-09-15T23:12:51.455944+0000","last_fullsized":"2024-09-15T23:12:51.455944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:46:42.615226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.459280+0000","last_change":"2024-09-15T23:12:52.457841+0000","last_active":"2024-09-15T23:12:52.459280+0000","last_peered":"2024-09-15T23:12:52.459280+0000","last_clean":"2024-09-15T23:12:52.459280+0000","last_became_active":"2024-09-15T23:12:52.457579+0000","last_became_peered":"2024-09-15T23:12:52.457579+0000","last_unstale":"2024-09-15T23:12:52.459280+0000","last_undegraded":"2024-09-15T23:12:52.459280+0000","last_fullsized":"2024-09-15T23:12:52.459280+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:11.025928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.451163+0000","last_change":"2024-09-15T23:12:51.445393+0000","last_active":"2024-09-15T23:12:51.451163+0000","last_peered":"2024-09-15T23:12:51.451163+0000","last_clean":"2024-09-15T23:12:51.451163+0000","last_became_active":"2024-09-15T23:12:51.444942+0000","last_became_peered":"2024-09-15T23:12:51.444942+0000","last_unstale":"2024-09-15T23:12:51.451163+0000","last_undegraded":"2024-09-15T23:12:51.451163+0000","last_fullsized":"2024-09-15T23:12:51.451163+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:14.255788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.450961+0000","last_change":"2024-09-15T23:12:52.461401+0000","last_active":"2024-09-15T23:12:53.450961+0000","last_peered":"2024-09-15T23:12:53.450961+0000","last_clean":"2024-09-15T23:12:53.450961+0000","last_became_active":"2024-09-15T23:12:52.460897+0000","last_became_peered":"2024-09-15T23:12:52.460897+0000","last_unstale":"2024-09-15T23:12:53.450961+0000","last_undegraded":"2024-09-15T23:12:53.450961+0000","last_fullsized":"2024-09-15T23:12:53.450961+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:05.522026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.450300+0000","last_change":"2024-09-15T23:12:51.445263+0000","last_active":"2024-09-15T23:12:51.450300+0000","last_peered":"2024-09-15T23:12:51.450300+0000","last_clean":"2024-09-15T23:12:51.450300+0000","last_became_active":"2024-09-15T23:12:51.444994+0000","last_became_peered":"2024-09-15T23:12:51.444994+0000","last_unstale":"2024-09-15T23:12:51.450300+0000","last_undegraded":"2024-09-15T23:12:51.450300+0000","last_fullsized":"2024-09-15T23:12:51.450300+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:22.839572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451271+0000","last_change":"2024-09-15T23:12:52.462194+0000","last_active":"2024-09-15T23:12:53.451271+0000","last_peered":"2024-09-15T23:12:53.451271+0000","last_clean":"2024-09-15T23:12:53.451271+0000","last_became_active":"2024-09-15T23:12:52.461911+0000","last_became_peered":"2024-09-15T23:12:52.461911+0000","last_unstale":"2024-09-15T23:12:53.451271+0000","last_undegraded":"2024-09-15T23:12:53.451271+0000","last_fullsized":"2024-09-15T23:12:53.451271+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:13:28.058279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.455860+0000","last_change":"2024-09-15T23:12:51.452056+0000","last_active":"2024-09-15T23:12:51.455860+0000","last_peered":"2024-09-15T23:12:51.455860+0000","last_clean":"2024-09-15T23:12:51.455860+0000","last_became_active":"2024-09-15T23:12:51.451778+0000","last_became_peered":"2024-09-15T23:12:51.451778+0000","last_unstale":"2024-09-15T23:12:51.455860+0000","last_undegraded":"2024-09-15T23:12:51.455860+0000","last_fullsized":"2024-09-15T23:12:51.455860+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:23:49.602062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.448397+0000","last_change":"2024-09-15T23:12:52.460169+0000","last_active":"2024-09-15T23:12:53.448397+0000","last_peered":"2024-09-15T23:12:53.448397+0000","last_clean":"2024-09-15T23:12:53.448397+0000","last_became_active":"2024-09-15T23:12:52.459908+0000","last_became_peered":"2024-09-15T23:12:52.459908+0000","last_unstale":"2024-09-15T23:12:53.448397+0000","last_undegraded":"2024-09-15T23:12:53.448397+0000","last_fullsized":"2024-09-15T23:12:53.448397+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:51.906277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.465663+0000","last_change":"2024-09-15T23:12:51.449713+0000","last_active":"2024-09-15T23:12:52.465663+0000","last_peered":"2024-09-15T23:12:52.465663+0000","last_clean":"2024-09-15T23:12:52.465663+0000","last_became_active":"2024-09-15T23:12:51.449482+0000","last_became_peered":"2024-09-15T23:12:51.449482+0000","last_unstale":"2024-09-15T23:12:52.465663+0000","last_undegraded":"2024-09-15T23:12:52.465663+0000","last_fullsized":"2024-09-15T23:12:52.465663+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:08.256981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.450082+0000","last_change":"2024-09-15T23:12:51.450082+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.450082+0000","last_undegraded":"2024-09-15T23:12:51.450082+0000","last_fullsized":"2024-09-15T23:12:51.450082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451122+0000","last_change":"2024-09-15T23:12:51.444768+0000","last_active":"2024-09-15T23:12:53.451122+0000","last_peered":"2024-09-15T23:12:53.451122+0000","last_clean":"2024-09-15T23:12:53.451122+0000","last_became_active":"2024-09-15T23:12:51.444487+0000","last_became_peered":"2024-09-15T23:12:51.444487+0000","last_unstale":"2024-09-15T23:12:53.451122+0000","last_undegraded":"2024-09-15T23:12:53.451122+0000","last_fullsized":"2024-09-15T23:12:53.451122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:59:54.899240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.435763+0000","last_change":"2024-09-15T23:12:51.435763+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.435763+0000","last_undegraded":"2024-09-15T23:12:51.435763+0000","last_fullsized":"2024-09-15T23:12:51.435763+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.448333+0000","last_change":"2024-09-15T23:12:51.442708+0000","last_active":"2024-09-15T23:12:52.448333+0000","last_peered":"2024-09-15T23:12:52.448333+0000","last_clean":"2024-09-15T23:12:52.448333+0000","last_became_active":"2024-09-15T23:12:51.442436+0000","last_became_peered":"2024-09-15T23:12:51.442436+0000","last_unstale":"2024-09-15T23:12:52.448333+0000","last_undegraded":"2024-09-15T23:12:52.448333+0000","last_fullsized":"2024-09-15T23:12:52.448333+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:46:22.373234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.441874+0000","last_change":"2024-09-15T23:12:51.441874+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.441874+0000","last_undegraded":"2024-09-15T23:12:51.441874+0000","last_fullsized":"2024-09-15T23:12:51.441874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.456015+0000","last_change":"2024-09-15T23:12:51.452451+0000","last_active":"2024-09-15T23:12:51.456015+0000","last_peered":"2024-09-15T23:12:51.456015+0000","last_clean":"2024-09-15T23:12:51.456015+0000","last_became_active":"2024-09-15T23:12:51.452150+0000","last_became_peered":"2024-09-15T23:12:51.452150+0000","last_unstale":"2024-09-15T23:12:51.456015+0000","last_undegraded":"2024-09-15T23:12:51.456015+0000","last_fullsized":"2024-09-15T23:12:51.456015+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:45:17.640002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.444709+0000","last_change":"2024-09-15T23:12:51.444709+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.444709+0000","last_undegraded":"2024-09-15T23:12:51.444709+0000","last_fullsized":"2024-09-15T23:12:51.444709+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.449606+0000","last_change":"2024-09-15T23:12:51.449350+0000","last_active":"2024-09-15T23:12:52.449606+0000","last_peered":"2024-09-15T23:12:52.449606+0000","last_clean":"2024-09-15T23:12:52.449606+0000","last_became_active":"2024-09-15T23:12:51.449105+0000","last_became_peered":"2024-09-15T23:12:51.449105+0000","last_unstale":"2024-09-15T23:12:52.449606+0000","last_undegraded":"2024-09-15T23:12:52.449606+0000","last_fullsized":"2024-09-15T23:12:52.449606+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:20:37.546396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.440109+0000","last_change":"2024-09-15T23:12:51.440109+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.440109+0000","last_undegraded":"2024-09-15T23:12:51.440109+0000","last_fullsized":"2024-09-15T23:12:51.440109+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.448187+0000","last_change":"2024-09-15T23:12:51.454629+0000","last_active":"2024-09-15T23:12:53.448187+0000","last_peered":"2024-09-15T23:12:53.448187+0000","last_clean":"2024-09-15T23:12:53.448187+0000","last_became_active":"2024-09-15T23:12:51.454271+0000","last_became_peered":"2024-09-15T23:12:51.454271+0000","last_unstale":"2024-09-15T23:12:53.448187+0000","last_undegraded":"2024-09-15T23:12:53.448187+0000","last_fullsized":"2024-09-15T23:12:53.448187+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:49.679873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.448093+0000","last_change":"2024-09-15T23:12:52.460487+0000","last_active":"2024-09-15T23:12:53.448093+0000","last_peered":"2024-09-15T23:12:53.448093+0000","last_clean":"2024-09-15T23:12:53.448093+0000","last_became_active":"2024-09-15T23:12:52.460214+0000","last_became_peered":"2024-09-15T23:12:52.460214+0000","last_unstale":"2024-09-15T23:12:53.448093+0000","last_undegraded":"2024-09-15T23:12:53.448093+0000","last_fullsized":"2024-09-15T23:12:53.448093+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:16.966539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.450880+0000","last_change":"2024-09-15T23:12:51.445540+0000","last_active":"2024-09-15T23:12:53.450880+0000","last_peered":"2024-09-15T23:12:53.450880+0000","last_clean":"2024-09-15T23:12:53.450880+0000","last_became_active":"2024-09-15T23:12:51.445291+0000","last_became_peered":"2024-09-15T23:12:51.445291+0000","last_unstale":"2024-09-15T23:12:53.450880+0000","last_undegraded":"2024-09-15T23:12:53.450880+0000","last_fullsized":"2024-09-15T23:12:53.450880+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:02.023125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.435582+0000","last_change":"2024-09-15T23:12:51.435582+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.435582+0000","last_undegraded":"2024-09-15T23:12:51.435582+0000","last_fullsized":"2024-09-15T23:12:51.435582+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.450759+0000","last_change":"2024-09-15T23:12:51.445595+0000","last_active":"2024-09-15T23:12:51.450759+0000","last_peered":"2024-09-15T23:12:51.450759+0000","last_clean":"2024-09-15T23:12:51.450759+0000","last_became_active":"2024-09-15T23:12:51.445293+0000","last_became_peered":"2024-09-15T23:12:51.445293+0000","last_unstale":"2024-09-15T23:12:51.450759+0000","last_undegraded":"2024-09-15T23:12:51.450759+0000","last_fullsized":"2024-09-15T23:12:51.450759+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:41.065979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451253+0000","last_change":"2024-09-15T23:12:52.461733+0000","last_active":"2024-09-15T23:12:53.451253+0000","last_peered":"2024-09-15T23:12:53.451253+0000","last_clean":"2024-09-15T23:12:53.451253+0000","last_became_active":"2024-09-15T23:12:52.461107+0000","last_became_peered":"2024-09-15T23:12:52.461107+0000","last_unstale":"2024-09-15T23:12:53.451253+0000","last_undegraded":"2024-09-15T23:12:53.451253+0000","last_fullsized":"2024-09-15T23:12:53.451253+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:19.983333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.461464+0000","last_change":"2024-09-15T23:12:51.453993+0000","last_active":"2024-09-15T23:12:51.461464+0000","last_peered":"2024-09-15T23:12:51.461464+0000","last_clean":"2024-09-15T23:12:51.461464+0000","last_became_active":"2024-09-15T23:12:51.453649+0000","last_became_peered":"2024-09-15T23:12:51.453649+0000","last_unstale":"2024-09-15T23:12:51.461464+0000","last_undegraded":"2024-09-15T23:12:51.461464+0000","last_fullsized":"2024-09-15T23:12:51.461464+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:46.454750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.435253+0000","last_change":"2024-09-15T23:12:51.435253+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.435253+0000","last_undegraded":"2024-09-15T23:12:51.435253+0000","last_fullsized":"2024-09-15T23:12:51.435253+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.450784+0000","last_change":"2024-09-15T23:12:51.445705+0000","last_active":"2024-09-15T23:12:51.450784+0000","last_peered":"2024-09-15T23:12:51.450784+0000","last_clean":"2024-09-15T23:12:51.450784+0000","last_became_active":"2024-09-15T23:12:51.445207+0000","last_became_peered":"2024-09-15T23:12:51.445207+0000","last_unstale":"2024-09-15T23:12:51.450784+0000","last_undegraded":"2024-09-15T23:12:51.450784+0000","last_fullsized":"2024-09-15T23:12:51.450784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:43.765850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.464898+0000","last_change":"2024-09-15T23:12:52.459515+0000","last_active":"2024-09-15T23:12:52.464898+0000","last_peered":"2024-09-15T23:12:52.464898+0000","last_clean":"2024-09-15T23:12:52.464898+0000","last_became_active":"2024-09-15T23:12:52.459221+0000","last_became_peered":"2024-09-15T23:12:52.459221+0000","last_unstale":"2024-09-15T23:12:52.464898+0000","last_undegraded":"2024-09-15T23:12:52.464898+0000","last_fullsized":"2024-09-15T23:12:52.464898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:16:55.796328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.453484+0000","last_change":"2024-09-15T23:12:51.447186+0000","last_active":"2024-09-15T23:12:51.453484+0000","last_peered":"2024-09-15T23:12:51.453484+0000","last_clean":"2024-09-15T23:12:51.453484+0000","last_became_active":"2024-09-15T23:12:51.446834+0000","last_became_peered":"2024-09-15T23:12:51.446834+0000","last_unstale":"2024-09-15T23:12:51.453484+0000","last_undegraded":"2024-09-15T23:12:51.453484+0000","last_fullsized":"2024-09-15T23:12:51.453484+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:54.500993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.438521+0000","last_change":"2024-09-15T23:12:51.438521+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.438521+0000","last_undegraded":"2024-09-15T23:12:51.438521+0000","last_fullsized":"2024-09-15T23:12:51.438521+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.453522+0000","last_change":"2024-09-15T23:12:51.447976+0000","last_active":"2024-09-15T23:12:51.453522+0000","last_peered":"2024-09-15T23:12:51.453522+0000","last_clean":"2024-09-15T23:12:51.453522+0000","last_became_active":"2024-09-15T23:12:51.447643+0000","last_became_peered":"2024-09-15T23:12:51.447643+0000","last_unstale":"2024-09-15T23:12:51.453522+0000","last_undegraded":"2024-09-15T23:12:51.453522+0000","last_fullsized":"2024-09-15T23:12:51.453522+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:08.256981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-15T23:12:51.439243+0000","last_change":"2024-09-15T23:12:51.439243+0000","last_active":"2024-09-15T23:12:51.429763+0000","last_peered":"2024-09-15T23:12:51.429763+0000","last_clean":"2024-09-15T23:12:51.429763+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:12:51.439243+0000","last_undegraded":"2024-09-15T23:12:51.439243+0000","last_fullsized":"2024-09-15T23:12:51.439243+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.449992+0000","last_change":"2024-09-15T23:12:51.450580+0000","last_active":"2024-09-15T23:12:52.449992+0000","last_peered":"2024-09-15T23:12:52.449992+0000","last_clean":"2024-09-15T23:12:52.449992+0000","last_became_active":"2024-09-15T23:12:51.450307+0000","last_became_peered":"2024-09-15T23:12:51.450307+0000","last_unstale":"2024-09-15T23:12:52.449992+0000","last_undegraded":"2024-09-15T23:12:52.449992+0000","last_fullsized":"2024-09-15T23:12:52.449992+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:08.035834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451018+0000","last_change":"2024-09-15T23:12:52.461956+0000","last_active":"2024-09-15T23:12:53.451018+0000","last_peered":"2024-09-15T23:12:53.451018+0000","last_clean":"2024-09-15T23:12:53.451018+0000","last_became_active":"2024-09-15T23:12:52.461667+0000","last_became_peered":"2024-09-15T23:12:52.461667+0000","last_unstale":"2024-09-15T23:12:53.451018+0000","last_undegraded":"2024-09-15T23:12:53.451018+0000","last_fullsized":"2024-09-15T23:12:53.451018+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:38.741524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-15T23:12:51.451324+0000","last_change":"2024-09-15T23:12:51.447791+0000","last_active":"2024-09-15T23:12:51.451324+0000","last_peered":"2024-09-15T23:12:51.451324+0000","last_clean":"2024-09-15T23:12:51.451324+0000","last_became_active":"2024-09-15T23:12:51.447535+0000","last_became_peered":"2024-09-15T23:12:51.447535+0000","last_unstale":"2024-09-15T23:12:51.451324+0000","last_undegraded":"2024-09-15T23:12:51.451324+0000","last_fullsized":"2024-09-15T23:12:51.451324+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:04:52.338722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-15T23:12:52.466438+0000","last_change":"2024-09-15T23:12:52.460091+0000","last_active":"2024-09-15T23:12:52.466438+0000","last_peered":"2024-09-15T23:12:52.466438+0000","last_clean":"2024-09-15T23:12:52.466438+0000","last_became_active":"2024-09-15T23:12:52.459808+0000","last_became_peered":"2024-09-15T23:12:52.459808+0000","last_unstale":"2024-09-15T23:12:52.466438+0000","last_undegraded":"2024-09-15T23:12:52.466438+0000","last_fullsized":"2024-09-15T23:12:52.466438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:36:44.036378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451212+0000","last_change":"2024-09-15T23:12:51.442341+0000","last_active":"2024-09-15T23:12:53.451212+0000","last_peered":"2024-09-15T23:12:53.451212+0000","last_clean":"2024-09-15T23:12:53.451212+0000","last_became_active":"2024-09-15T23:12:51.442068+0000","last_became_peered":"2024-09-15T23:12:51.442068+0000","last_unstale":"2024-09-15T23:12:53.451212+0000","last_undegraded":"2024-09-15T23:12:53.451212+0000","last_fullsized":"2024-09-15T23:12:53.451212+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:52.665963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":191,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.448247+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:12:53.448247+0000","last_peered":"2024-09-15T23:12:53.448247+0000","last_clean":"2024-09-15T23:12:53.448247+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:12:53.448247+0000","last_undegraded":"2024-09-15T23:12:53.448247+0000","last_fullsized":"2024-09-15T23:12:53.448247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":776,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476752,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":364544,"data_stored":134140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476749,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":133398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476751,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":946176,"data_stored":723802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476751,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":352256,"data_stored":133454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":323584,"data_stored":120314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542157,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":323584,"data_stored":120314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542156,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":917504,"data_stored":710682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542158,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":323584,"data_stored":120314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:12:57.422 INFO:tasks.ceph.mds.c.smithi123.stderr:2024-09-15T23:12:57.421+0000 7f45a95e5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:12:59.736 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:12:59.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.845+0000 7f6f4f023640 1 Processor -- start 2024-09-15T23:12:59.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.846+0000 7f6f4f023640 1 -- start start 2024-09-15T23:12:59.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.846+0000 7f6f4f023640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f4806c320 0x7f6f480ae870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:59.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.846+0000 7f6f4f023640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f480b07c0 con 0x7f6f48148090 2024-09-15T23:12:59.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.846+0000 7f6f4f023640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f480af7a0 con 0x7f6f480731e0 2024-09-15T23:12:59.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.846+0000 7f6f4f023640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6f480b52c0 con 0x7f6f4806c320 2024-09-15T23:12:59.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.847+0000 7f6f4cdbf640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6f48148090 0x7f6f4806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38330/0 (socket says 172.21.15.123:38330) 2024-09-15T23:12:59.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.847+0000 7f6f4cdbf640 1 -- 172.21.15.123:0/1213951550 learned_addr learned my addr 172.21.15.123:0/1213951550 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:12:59.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.847+0000 7f6f47fff640 1 --2- 172.21.15.123:0/1213951550 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f4806c320 0x7f6f480ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:59.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.847+0000 7f6f477fe640 1 -- 172.21.15.123:0/1213951550 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 246976887 0 0) 0x7f6f480b07c0 con 0x7f6f48148090 2024-09-15T23:12:59.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.847+0000 7f6f477fe640 1 -- 172.21.15.123:0/1213951550 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f34003520 con 0x7f6f48148090 2024-09-15T23:12:59.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.847+0000 7f6f477fe640 1 -- 172.21.15.123:0/1213951550 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 152321641 0 0) 0x7f6f480af7a0 con 0x7f6f480731e0 2024-09-15T23:12:59.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.847+0000 7f6f477fe640 1 -- 172.21.15.123:0/1213951550 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f480b07c0 con 0x7f6f480731e0 2024-09-15T23:12:59.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.847+0000 7f6f477fe640 1 -- 172.21.15.123:0/1213951550 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3280146837 0 0) 0x7f6f34003520 con 0x7f6f48148090 2024-09-15T23:12:59.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.847+0000 7f6f47fff640 1 -- 172.21.15.123:0/1213951550 >> v1:172.21.15.188:6789/0 conn(0x7f6f480731e0 legacy=0x7f6f480b5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:59.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.847+0000 7f6f47fff640 1 -- 172.21.15.123:0/1213951550 >> v1:172.21.15.123:6789/0 conn(0x7f6f48148090 legacy=0x7f6f4806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:59.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.847+0000 7f6f47fff640 1 -- 172.21.15.123:0/1213951550 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f480aef00 con 0x7f6f4806c320 2024-09-15T23:12:59.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.848+0000 7f6f47fff640 1 --2- 172.21.15.123:0/1213951550 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f4806c320 0x7f6f480ae870 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6f38009dc0 tx=0x7f6f3802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62d0a5a4d514bca7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:59.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.848+0000 7f6f477fe640 1 -- 172.21.15.123:0/1213951550 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f40001670 con 0x7f6f4806c320 2024-09-15T23:12:59.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.848+0000 7f6f477fe640 1 -- 172.21.15.123:0/1213951550 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f38007540 con 0x7f6f4806c320 2024-09-15T23:12:59.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.848+0000 7f6f477fe640 1 -- 172.21.15.123:0/1213951550 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f380078f0 con 0x7f6f4806c320 2024-09-15T23:12:59.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.849+0000 7f6f4f023640 1 -- 172.21.15.123:0/1213951550 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f4806c320 msgr2=0x7f6f480ae870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:59.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.849+0000 7f6f4f023640 1 --2- 172.21.15.123:0/1213951550 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f4806c320 0x7f6f480ae870 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6f38009dc0 tx=0x7f6f3802a660 comp rx=0 tx=0).stop 2024-09-15T23:12:59.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.849+0000 7f6f4f023640 1 -- 172.21.15.123:0/1213951550 shutdown_connections 2024-09-15T23:12:59.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.849+0000 7f6f4f023640 1 --2- 172.21.15.123:0/1213951550 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f4806c320 0x7f6f480ae870 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:59.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.849+0000 7f6f4f023640 1 -- 172.21.15.123:0/1213951550 >> 172.21.15.123:0/1213951550 conn(0x7f6f4806cd20 msgr2=0x7f6f4806d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:12:59.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.849+0000 7f6f4f023640 1 -- 172.21.15.123:0/1213951550 shutdown_connections 2024-09-15T23:12:59.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.849+0000 7f6f4f023640 1 -- 172.21.15.123:0/1213951550 wait complete. 2024-09-15T23:12:59.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.850+0000 7f6f4f023640 1 Processor -- start 2024-09-15T23:12:59.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.850+0000 7f6f4f023640 1 -- start start 2024-09-15T23:12:59.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.851+0000 7f6f4f023640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f4806c320 0x7f6f480cff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:59.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.851+0000 7f6f4f023640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6f480731e0 0x7f6f48141db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:59.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.851+0000 7f6f4f023640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f48148090 0x7f6f480b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:59.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.851+0000 7f6f4f023640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6f480b5580 con 0x7f6f4806c320 2024-09-15T23:12:59.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.851+0000 7f6f4f023640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6f48148470 con 0x7f6f480731e0 2024-09-15T23:12:59.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.851+0000 7f6f4f023640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6f480af4c0 con 0x7f6f48148090 2024-09-15T23:12:59.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.851+0000 7f6f4cdbf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f4806c320 0x7f6f480cff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:59.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.851+0000 7f6f4cdbf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f4806c320 0x7f6f480cff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41572/0 (socket says 172.21.15.123:41572) 2024-09-15T23:12:59.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.851+0000 7f6f4cdbf640 1 -- 172.21.15.123:0/620372331 learned_addr learned my addr 172.21.15.123:0/620372331 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:12:59.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.851+0000 7f6f47fff640 1 --2- 172.21.15.123:0/620372331 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6f480731e0 0x7f6f48141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:59.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.851+0000 7f6f4d5c0640 1 --2- 172.21.15.123:0/620372331 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f48148090 0x7f6f480b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:59.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.851+0000 7f6f4cdbf640 1 -- 172.21.15.123:0/620372331 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f48148090 msgr2=0x7f6f480b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:59.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.851+0000 7f6f4cdbf640 1 --2- 172.21.15.123:0/620372331 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f48148090 0x7f6f480b23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:59.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.851+0000 7f6f4cdbf640 1 -- 172.21.15.123:0/620372331 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6f480731e0 msgr2=0x7f6f48141db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:12:59.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.851+0000 7f6f4cdbf640 1 --2- 172.21.15.123:0/620372331 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6f480731e0 0x7f6f48141db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:12:59.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.851+0000 7f6f4cdbf640 1 -- 172.21.15.123:0/620372331 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f48142600 con 0x7f6f4806c320 2024-09-15T23:12:59.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.851+0000 7f6f4cdbf640 1 --2- 172.21.15.123:0/620372331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f4806c320 0x7f6f480cff50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6f4000c5a0 tx=0x7f6f4000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:59.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.852+0000 7f6f457fa640 1 -- 172.21.15.123:0/620372331 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f40017070 con 0x7f6f4806c320 2024-09-15T23:12:59.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.852+0000 7f6f457fa640 1 -- 172.21.15.123:0/620372331 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f40005ce0 con 0x7f6f4806c320 2024-09-15T23:12:59.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.852+0000 7f6f4f023640 1 -- 172.21.15.123:0/620372331 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f481428e0 con 0x7f6f4806c320 2024-09-15T23:12:59.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.852+0000 7f6f457fa640 1 -- 172.21.15.123:0/620372331 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f400072b0 con 0x7f6f4806c320 2024-09-15T23:12:59.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.852+0000 7f6f4f023640 1 -- 172.21.15.123:0/620372331 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f48142ea0 con 0x7f6f4806c320 2024-09-15T23:12:59.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.853+0000 7f6f4f023640 1 -- 172.21.15.123:0/620372331 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f480ae870 con 0x7f6f4806c320 2024-09-15T23:12:59.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.853+0000 7f6f457fa640 1 -- 172.21.15.123:0/620372331 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6f4001a070 con 0x7f6f4806c320 2024-09-15T23:12:59.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.854+0000 7f6f457fa640 1 --2- 172.21.15.123:0/620372331 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6f2806c2e0 0x7f6f2806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:12:59.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.854+0000 7f6f457fa640 1 -- 172.21.15.123:0/620372331 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f6f4008a8a0 con 0x7f6f4806c320 2024-09-15T23:12:59.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.854+0000 7f6f47fff640 1 --2- 172.21.15.123:0/620372331 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6f2806c2e0 0x7f6f2806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:12:59.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.854+0000 7f6f47fff640 1 --2- 172.21.15.123:0/620372331 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6f2806c2e0 0x7f6f2806e7a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6f38034000 tx=0x7f6f38033040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:12:59.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:12:59.858+0000 7f6f457fa640 1 -- 172.21.15.123:0/620372331 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6f400590a0 con 0x7f6f4806c320 2024-09-15T23:13:00.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.021+0000 7f6f4f023640 1 -- 172.21.15.123:0/620372331 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6f48067db0 con 0x7f6f2806c2e0 2024-09-15T23:13:00.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.027+0000 7f6f457fa640 1 -- 172.21.15.123:0/620372331 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251907 (secure 0 0 0) 0x7f6f48067db0 con 0x7f6f2806c2e0 2024-09-15T23:13:00.031 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:13:00.032 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:13:00.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.031+0000 7f6f4f023640 1 -- 172.21.15.123:0/620372331 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6f2806c2e0 msgr2=0x7f6f2806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:00.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.031+0000 7f6f4f023640 1 --2- 172.21.15.123:0/620372331 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6f2806c2e0 0x7f6f2806e7a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6f38034000 tx=0x7f6f38033040 comp rx=0 tx=0).stop 2024-09-15T23:13:00.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.031+0000 7f6f4f023640 1 -- 172.21.15.123:0/620372331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f4806c320 msgr2=0x7f6f480cff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:00.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.031+0000 7f6f4f023640 1 --2- 172.21.15.123:0/620372331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f4806c320 0x7f6f480cff50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6f4000c5a0 tx=0x7f6f4000ca60 comp rx=0 tx=0).stop 2024-09-15T23:13:00.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.031+0000 7f6f4f023640 1 -- 172.21.15.123:0/620372331 shutdown_connections 2024-09-15T23:13:00.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.031+0000 7f6f4f023640 1 --2- 172.21.15.123:0/620372331 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f48148090 0x7f6f480b23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:00.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.031+0000 7f6f4f023640 1 --2- 172.21.15.123:0/620372331 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6f480731e0 0x7f6f48141db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:00.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.031+0000 7f6f4f023640 1 --2- 172.21.15.123:0/620372331 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6f2806c2e0 0x7f6f2806e7a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:00.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.031+0000 7f6f4f023640 1 --2- 172.21.15.123:0/620372331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f4806c320 0x7f6f480cff50 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:00.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.031+0000 7f6f4f023640 1 -- 172.21.15.123:0/620372331 >> 172.21.15.123:0/620372331 conn(0x7f6f4806cd20 msgr2=0x7f6f4806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:00.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.031+0000 7f6f4f023640 1 -- 172.21.15.123:0/620372331 shutdown_connections 2024-09-15T23:13:00.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.031+0000 7f6f4f023640 1 -- 172.21.15.123:0/620372331 wait complete. 2024-09-15T23:13:00.043 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-09-15T23:12:59.513007+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":181,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220288,"kb_used_data":4040,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754432,"statfs":{"total":773094113280,"available":772868538368,"internally_reserved":0,"allocated":4136960,"data_stored":2302868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001643"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.023658+0000","last_change":"2024-09-15T23:12:52.453105+0000","last_active":"2024-09-15T23:12:54.023658+0000","last_peered":"2024-09-15T23:12:54.023658+0000","last_clean":"2024-09-15T23:12:54.023658+0000","last_became_active":"2024-09-15T23:12:52.452616+0000","last_became_peered":"2024-09-15T23:12:52.452616+0000","last_unstale":"2024-09-15T23:12:54.023658+0000","last_undegraded":"2024-09-15T23:12:54.023658+0000","last_fullsized":"2024-09-15T23:12:54.023658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:53.672606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.813455+0000","last_change":"2024-09-15T23:12:52.468389+0000","last_active":"2024-09-15T23:12:53.813455+0000","last_peered":"2024-09-15T23:12:53.813455+0000","last_clean":"2024-09-15T23:12:53.813455+0000","last_became_active":"2024-09-15T23:12:52.468095+0000","last_became_peered":"2024-09-15T23:12:52.468095+0000","last_unstale":"2024-09-15T23:12:53.813455+0000","last_undegraded":"2024-09-15T23:12:53.813455+0000","last_fullsized":"2024-09-15T23:12:53.813455+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:28:02.320888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.448132+0000","last_change":"2024-09-15T23:12:52.466279+0000","last_active":"2024-09-15T23:12:53.448132+0000","last_peered":"2024-09-15T23:12:53.448132+0000","last_clean":"2024-09-15T23:12:53.448132+0000","last_became_active":"2024-09-15T23:12:52.466029+0000","last_became_peered":"2024-09-15T23:12:52.466029+0000","last_unstale":"2024-09-15T23:12:53.448132+0000","last_undegraded":"2024-09-15T23:12:53.448132+0000","last_fullsized":"2024-09-15T23:12:53.448132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:20:38.553039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.856267+0000","last_change":"2024-09-15T23:12:52.472223+0000","last_active":"2024-09-15T23:12:54.856267+0000","last_peered":"2024-09-15T23:12:54.856267+0000","last_clean":"2024-09-15T23:12:54.856267+0000","last_became_active":"2024-09-15T23:12:52.470486+0000","last_became_peered":"2024-09-15T23:12:52.470486+0000","last_unstale":"2024-09-15T23:12:54.856267+0000","last_undegraded":"2024-09-15T23:12:54.856267+0000","last_fullsized":"2024-09-15T23:12:54.856267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:05:00.965093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.813336+0000","last_change":"2024-09-15T23:12:52.475840+0000","last_active":"2024-09-15T23:12:53.813336+0000","last_peered":"2024-09-15T23:12:53.813336+0000","last_clean":"2024-09-15T23:12:53.813336+0000","last_became_active":"2024-09-15T23:12:52.475507+0000","last_became_peered":"2024-09-15T23:12:52.475507+0000","last_unstale":"2024-09-15T23:12:53.813336+0000","last_undegraded":"2024-09-15T23:12:53.813336+0000","last_fullsized":"2024-09-15T23:12:53.813336+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:27.083486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451744+0000","last_change":"2024-09-15T23:12:52.462049+0000","last_active":"2024-09-15T23:12:53.451744+0000","last_peered":"2024-09-15T23:12:53.451744+0000","last_clean":"2024-09-15T23:12:53.451744+0000","last_became_active":"2024-09-15T23:12:52.461735+0000","last_became_peered":"2024-09-15T23:12:52.461735+0000","last_unstale":"2024-09-15T23:12:53.451744+0000","last_undegraded":"2024-09-15T23:12:53.451744+0000","last_fullsized":"2024-09-15T23:12:53.451744+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:09.042477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.023627+0000","last_change":"2024-09-15T23:12:52.457860+0000","last_active":"2024-09-15T23:12:54.023627+0000","last_peered":"2024-09-15T23:12:54.023627+0000","last_clean":"2024-09-15T23:12:54.023627+0000","last_became_active":"2024-09-15T23:12:52.457618+0000","last_became_peered":"2024-09-15T23:12:52.457618+0000","last_unstale":"2024-09-15T23:12:54.023627+0000","last_undegraded":"2024-09-15T23:12:54.023627+0000","last_fullsized":"2024-09-15T23:12:54.023627+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:03.029768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.023322+0000","last_change":"2024-09-15T23:12:52.463834+0000","last_active":"2024-09-15T23:12:54.023322+0000","last_peered":"2024-09-15T23:12:54.023322+0000","last_clean":"2024-09-15T23:12:54.023322+0000","last_became_active":"2024-09-15T23:12:52.463539+0000","last_became_peered":"2024-09-15T23:12:52.463539+0000","last_unstale":"2024-09-15T23:12:54.023322+0000","last_undegraded":"2024-09-15T23:12:54.023322+0000","last_fullsized":"2024-09-15T23:12:54.023322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:57:16.075690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.448340+0000","last_change":"2024-09-15T23:12:52.463487+0000","last_active":"2024-09-15T23:12:53.448340+0000","last_peered":"2024-09-15T23:12:53.448340+0000","last_clean":"2024-09-15T23:12:53.448340+0000","last_became_active":"2024-09-15T23:12:52.463207+0000","last_became_peered":"2024-09-15T23:12:52.463207+0000","last_unstale":"2024-09-15T23:12:53.448340+0000","last_undegraded":"2024-09-15T23:12:53.448340+0000","last_fullsized":"2024-09-15T23:12:53.448340+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:14:53.217748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.856656+0000","last_change":"2024-09-15T23:12:52.470737+0000","last_active":"2024-09-15T23:12:54.856656+0000","last_peered":"2024-09-15T23:12:54.856656+0000","last_clean":"2024-09-15T23:12:54.856656+0000","last_became_active":"2024-09-15T23:12:52.470268+0000","last_became_peered":"2024-09-15T23:12:52.470268+0000","last_unstale":"2024-09-15T23:12:54.856656+0000","last_undegraded":"2024-09-15T23:12:54.856656+0000","last_fullsized":"2024-09-15T23:12:54.856656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:54.799662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451170+0000","last_change":"2024-09-15T23:12:52.458033+0000","last_active":"2024-09-15T23:12:53.451170+0000","last_peered":"2024-09-15T23:12:53.451170+0000","last_clean":"2024-09-15T23:12:53.451170+0000","last_became_active":"2024-09-15T23:12:52.457545+0000","last_became_peered":"2024-09-15T23:12:52.457545+0000","last_unstale":"2024-09-15T23:12:53.451170+0000","last_undegraded":"2024-09-15T23:12:53.451170+0000","last_fullsized":"2024-09-15T23:12:53.451170+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:34.053910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.448205+0000","last_change":"2024-09-15T23:12:52.467341+0000","last_active":"2024-09-15T23:12:53.448205+0000","last_peered":"2024-09-15T23:12:53.448205+0000","last_clean":"2024-09-15T23:12:53.448205+0000","last_became_active":"2024-09-15T23:12:52.467027+0000","last_became_peered":"2024-09-15T23:12:52.467027+0000","last_unstale":"2024-09-15T23:12:53.448205+0000","last_undegraded":"2024-09-15T23:12:53.448205+0000","last_fullsized":"2024-09-15T23:12:53.448205+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:55.990210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.855557+0000","last_change":"2024-09-15T23:12:52.466388+0000","last_active":"2024-09-15T23:12:54.855557+0000","last_peered":"2024-09-15T23:12:54.855557+0000","last_clean":"2024-09-15T23:12:54.855557+0000","last_became_active":"2024-09-15T23:12:52.466113+0000","last_became_peered":"2024-09-15T23:12:52.466113+0000","last_unstale":"2024-09-15T23:12:54.855557+0000","last_undegraded":"2024-09-15T23:12:54.855557+0000","last_fullsized":"2024-09-15T23:12:54.855557+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:25:44.857457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.856037+0000","last_change":"2024-09-15T23:12:52.469878+0000","last_active":"2024-09-15T23:12:54.856037+0000","last_peered":"2024-09-15T23:12:54.856037+0000","last_clean":"2024-09-15T23:12:54.856037+0000","last_became_active":"2024-09-15T23:12:52.469552+0000","last_became_peered":"2024-09-15T23:12:52.469552+0000","last_unstale":"2024-09-15T23:12:54.856037+0000","last_undegraded":"2024-09-15T23:12:54.856037+0000","last_fullsized":"2024-09-15T23:12:54.856037+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:58.157375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.855147+0000","last_change":"2024-09-15T23:12:52.453291+0000","last_active":"2024-09-15T23:12:54.855147+0000","last_peered":"2024-09-15T23:12:54.855147+0000","last_clean":"2024-09-15T23:12:54.855147+0000","last_became_active":"2024-09-15T23:12:52.453043+0000","last_became_peered":"2024-09-15T23:12:52.453043+0000","last_unstale":"2024-09-15T23:12:54.855147+0000","last_undegraded":"2024-09-15T23:12:54.855147+0000","last_fullsized":"2024-09-15T23:12:54.855147+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:19:59.983755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.854986+0000","last_change":"2024-09-15T23:12:52.460235+0000","last_active":"2024-09-15T23:12:54.854986+0000","last_peered":"2024-09-15T23:12:54.854986+0000","last_clean":"2024-09-15T23:12:54.854986+0000","last_became_active":"2024-09-15T23:12:52.459117+0000","last_became_peered":"2024-09-15T23:12:52.459117+0000","last_unstale":"2024-09-15T23:12:54.854986+0000","last_undegraded":"2024-09-15T23:12:54.854986+0000","last_fullsized":"2024-09-15T23:12:54.854986+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:12.365909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451265+0000","last_change":"2024-09-15T23:12:52.461872+0000","last_active":"2024-09-15T23:12:53.451265+0000","last_peered":"2024-09-15T23:12:53.451265+0000","last_clean":"2024-09-15T23:12:53.451265+0000","last_became_active":"2024-09-15T23:12:52.460948+0000","last_became_peered":"2024-09-15T23:12:52.460948+0000","last_unstale":"2024-09-15T23:12:53.451265+0000","last_undegraded":"2024-09-15T23:12:53.451265+0000","last_fullsized":"2024-09-15T23:12:53.451265+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:06:19.030595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.452135+0000","last_change":"2024-09-15T23:12:52.472287+0000","last_active":"2024-09-15T23:12:53.452135+0000","last_peered":"2024-09-15T23:12:53.452135+0000","last_clean":"2024-09-15T23:12:53.452135+0000","last_became_active":"2024-09-15T23:12:52.471818+0000","last_became_peered":"2024-09-15T23:12:52.471818+0000","last_unstale":"2024-09-15T23:12:53.452135+0000","last_undegraded":"2024-09-15T23:12:53.452135+0000","last_fullsized":"2024-09-15T23:12:53.452135+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:02.512690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451789+0000","last_change":"2024-09-15T23:12:52.463463+0000","last_active":"2024-09-15T23:12:53.451789+0000","last_peered":"2024-09-15T23:12:53.451789+0000","last_clean":"2024-09-15T23:12:53.451789+0000","last_became_active":"2024-09-15T23:12:52.463187+0000","last_became_peered":"2024-09-15T23:12:52.463187+0000","last_unstale":"2024-09-15T23:12:53.451789+0000","last_undegraded":"2024-09-15T23:12:53.451789+0000","last_fullsized":"2024-09-15T23:12:53.451789+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:55.990210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.855963+0000","last_change":"2024-09-15T23:12:52.470739+0000","last_active":"2024-09-15T23:12:54.855963+0000","last_peered":"2024-09-15T23:12:54.855963+0000","last_clean":"2024-09-15T23:12:54.855963+0000","last_became_active":"2024-09-15T23:12:52.470469+0000","last_became_peered":"2024-09-15T23:12:52.470469+0000","last_unstale":"2024-09-15T23:12:54.855963+0000","last_undegraded":"2024-09-15T23:12:54.855963+0000","last_fullsized":"2024-09-15T23:12:54.855963+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:16:55.796328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.855098+0000","last_change":"2024-09-15T23:12:52.464198+0000","last_active":"2024-09-15T23:12:54.855098+0000","last_peered":"2024-09-15T23:12:54.855098+0000","last_clean":"2024-09-15T23:12:54.855098+0000","last_became_active":"2024-09-15T23:12:52.463937+0000","last_became_peered":"2024-09-15T23:12:52.463937+0000","last_unstale":"2024-09-15T23:12:54.855098+0000","last_undegraded":"2024-09-15T23:12:54.855098+0000","last_fullsized":"2024-09-15T23:12:54.855098+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:38:05.708659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.023333+0000","last_change":"2024-09-15T23:12:52.464338+0000","last_active":"2024-09-15T23:12:54.023333+0000","last_peered":"2024-09-15T23:12:54.023333+0000","last_clean":"2024-09-15T23:12:54.023333+0000","last_became_active":"2024-09-15T23:12:52.464092+0000","last_became_peered":"2024-09-15T23:12:52.464092+0000","last_unstale":"2024-09-15T23:12:54.023333+0000","last_undegraded":"2024-09-15T23:12:54.023333+0000","last_fullsized":"2024-09-15T23:12:54.023333+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:16:55.796328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.855363+0000","last_change":"2024-09-15T23:12:52.460561+0000","last_active":"2024-09-15T23:12:54.855363+0000","last_peered":"2024-09-15T23:12:54.855363+0000","last_clean":"2024-09-15T23:12:54.855363+0000","last_became_active":"2024-09-15T23:12:52.460269+0000","last_became_peered":"2024-09-15T23:12:52.460269+0000","last_unstale":"2024-09-15T23:12:54.855363+0000","last_undegraded":"2024-09-15T23:12:54.855363+0000","last_fullsized":"2024-09-15T23:12:54.855363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:37:59.504730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.023464+0000","last_change":"2024-09-15T23:12:52.462708+0000","last_active":"2024-09-15T23:12:54.023464+0000","last_peered":"2024-09-15T23:12:54.023464+0000","last_clean":"2024-09-15T23:12:54.023464+0000","last_became_active":"2024-09-15T23:12:52.462438+0000","last_became_peered":"2024-09-15T23:12:52.462438+0000","last_unstale":"2024-09-15T23:12:54.023464+0000","last_undegraded":"2024-09-15T23:12:54.023464+0000","last_fullsized":"2024-09-15T23:12:54.023464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:36:44.036378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.856465+0000","last_change":"2024-09-15T23:12:52.463711+0000","last_active":"2024-09-15T23:12:54.856465+0000","last_peered":"2024-09-15T23:12:54.856465+0000","last_clean":"2024-09-15T23:12:54.856465+0000","last_became_active":"2024-09-15T23:12:52.463420+0000","last_became_peered":"2024-09-15T23:12:52.463420+0000","last_unstale":"2024-09-15T23:12:54.856465+0000","last_undegraded":"2024-09-15T23:12:54.856465+0000","last_fullsized":"2024-09-15T23:12:54.856465+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:15:18.718180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.856664+0000","last_change":"2024-09-15T23:12:52.466340+0000","last_active":"2024-09-15T23:12:54.856664+0000","last_peered":"2024-09-15T23:12:54.856664+0000","last_clean":"2024-09-15T23:12:54.856664+0000","last_became_active":"2024-09-15T23:12:52.466002+0000","last_became_peered":"2024-09-15T23:12:52.466002+0000","last_unstale":"2024-09-15T23:12:54.856664+0000","last_undegraded":"2024-09-15T23:12:54.856664+0000","last_fullsized":"2024-09-15T23:12:54.856664+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:11.605875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.813467+0000","last_change":"2024-09-15T23:12:52.465516+0000","last_active":"2024-09-15T23:12:53.813467+0000","last_peered":"2024-09-15T23:12:53.813467+0000","last_clean":"2024-09-15T23:12:53.813467+0000","last_became_active":"2024-09-15T23:12:52.465239+0000","last_became_peered":"2024-09-15T23:12:52.465239+0000","last_unstale":"2024-09-15T23:12:53.813467+0000","last_undegraded":"2024-09-15T23:12:53.813467+0000","last_fullsized":"2024-09-15T23:12:53.813467+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:33:26.062740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.023624+0000","last_change":"2024-09-15T23:12:52.471955+0000","last_active":"2024-09-15T23:12:54.023624+0000","last_peered":"2024-09-15T23:12:54.023624+0000","last_clean":"2024-09-15T23:12:54.023624+0000","last_became_active":"2024-09-15T23:12:52.471618+0000","last_became_peered":"2024-09-15T23:12:52.471618+0000","last_unstale":"2024-09-15T23:12:54.023624+0000","last_undegraded":"2024-09-15T23:12:54.023624+0000","last_fullsized":"2024-09-15T23:12:54.023624+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:59:55.905883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.855245+0000","last_change":"2024-09-15T23:12:52.462544+0000","last_active":"2024-09-15T23:12:54.855245+0000","last_peered":"2024-09-15T23:12:54.855245+0000","last_clean":"2024-09-15T23:12:54.855245+0000","last_became_active":"2024-09-15T23:12:52.462270+0000","last_became_peered":"2024-09-15T23:12:52.462270+0000","last_unstale":"2024-09-15T23:12:54.855245+0000","last_undegraded":"2024-09-15T23:12:54.855245+0000","last_fullsized":"2024-09-15T23:12:54.855245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:53:11.506447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.855259+0000","last_change":"2024-09-15T23:12:52.453929+0000","last_active":"2024-09-15T23:12:54.855259+0000","last_peered":"2024-09-15T23:12:54.855259+0000","last_clean":"2024-09-15T23:12:54.855259+0000","last_became_active":"2024-09-15T23:12:52.453664+0000","last_became_peered":"2024-09-15T23:12:52.453664+0000","last_unstale":"2024-09-15T23:12:54.855259+0000","last_undegraded":"2024-09-15T23:12:54.855259+0000","last_fullsized":"2024-09-15T23:12:54.855259+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:17:31.245415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.023499+0000","last_change":"2024-09-15T23:12:52.458926+0000","last_active":"2024-09-15T23:12:54.023499+0000","last_peered":"2024-09-15T23:12:54.023499+0000","last_clean":"2024-09-15T23:12:54.023499+0000","last_became_active":"2024-09-15T23:12:52.458667+0000","last_became_peered":"2024-09-15T23:12:52.458667+0000","last_unstale":"2024-09-15T23:12:54.023499+0000","last_undegraded":"2024-09-15T23:12:54.023499+0000","last_fullsized":"2024-09-15T23:12:54.023499+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:55.053081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.450898+0000","last_change":"2024-09-15T23:12:52.461349+0000","last_active":"2024-09-15T23:12:53.450898+0000","last_peered":"2024-09-15T23:12:53.450898+0000","last_clean":"2024-09-15T23:12:53.450898+0000","last_became_active":"2024-09-15T23:12:52.461083+0000","last_became_peered":"2024-09-15T23:12:52.461083+0000","last_unstale":"2024-09-15T23:12:53.450898+0000","last_undegraded":"2024-09-15T23:12:53.450898+0000","last_fullsized":"2024-09-15T23:12:53.450898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:08.491182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.855905+0000","last_change":"2024-09-15T23:12:52.465204+0000","last_active":"2024-09-15T23:12:54.855905+0000","last_peered":"2024-09-15T23:12:54.855905+0000","last_clean":"2024-09-15T23:12:54.855905+0000","last_became_active":"2024-09-15T23:12:52.464939+0000","last_became_peered":"2024-09-15T23:12:52.464939+0000","last_unstale":"2024-09-15T23:12:54.855905+0000","last_undegraded":"2024-09-15T23:12:54.855905+0000","last_fullsized":"2024-09-15T23:12:54.855905+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:57:16.075690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451306+0000","last_change":"2024-09-15T23:12:51.449922+0000","last_active":"2024-09-15T23:12:53.451306+0000","last_peered":"2024-09-15T23:12:53.451306+0000","last_clean":"2024-09-15T23:12:53.451306+0000","last_became_active":"2024-09-15T23:12:51.449687+0000","last_became_peered":"2024-09-15T23:12:51.449687+0000","last_unstale":"2024-09-15T23:12:53.451306+0000","last_undegraded":"2024-09-15T23:12:53.451306+0000","last_fullsized":"2024-09-15T23:12:53.451306+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:38:04.702016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.023670+0000","last_change":"2024-09-15T23:12:52.468916+0000","last_active":"2024-09-15T23:12:54.023670+0000","last_peered":"2024-09-15T23:12:54.023670+0000","last_clean":"2024-09-15T23:12:54.023670+0000","last_became_active":"2024-09-15T23:12:52.468595+0000","last_became_peered":"2024-09-15T23:12:52.468595+0000","last_unstale":"2024-09-15T23:12:54.023670+0000","last_undegraded":"2024-09-15T23:12:54.023670+0000","last_fullsized":"2024-09-15T23:12:54.023670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:38:05.708659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.856734+0000","last_change":"2024-09-15T23:12:51.446041+0000","last_active":"2024-09-15T23:12:54.856734+0000","last_peered":"2024-09-15T23:12:54.856734+0000","last_clean":"2024-09-15T23:12:54.856734+0000","last_became_active":"2024-09-15T23:12:51.445760+0000","last_became_peered":"2024-09-15T23:12:51.445760+0000","last_unstale":"2024-09-15T23:12:54.856734+0000","last_undegraded":"2024-09-15T23:12:54.856734+0000","last_fullsized":"2024-09-15T23:12:54.856734+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:25.384320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.023562+0000","last_change":"2024-09-15T23:12:52.462039+0000","last_active":"2024-09-15T23:12:54.023562+0000","last_peered":"2024-09-15T23:12:54.023562+0000","last_clean":"2024-09-15T23:12:54.023562+0000","last_became_active":"2024-09-15T23:12:52.461736+0000","last_became_peered":"2024-09-15T23:12:52.461736+0000","last_unstale":"2024-09-15T23:12:54.023562+0000","last_undegraded":"2024-09-15T23:12:54.023562+0000","last_fullsized":"2024-09-15T23:12:54.023562+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:12.365909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.452081+0000","last_change":"2024-09-15T23:12:51.456559+0000","last_active":"2024-09-15T23:12:53.452081+0000","last_peered":"2024-09-15T23:12:53.452081+0000","last_clean":"2024-09-15T23:12:53.452081+0000","last_became_active":"2024-09-15T23:12:51.456278+0000","last_became_peered":"2024-09-15T23:12:51.456278+0000","last_unstale":"2024-09-15T23:12:53.452081+0000","last_undegraded":"2024-09-15T23:12:53.452081+0000","last_fullsized":"2024-09-15T23:12:53.452081+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:48.664930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.856591+0000","last_change":"2024-09-15T23:12:52.468512+0000","last_active":"2024-09-15T23:12:54.856591+0000","last_peered":"2024-09-15T23:12:54.856591+0000","last_clean":"2024-09-15T23:12:54.856591+0000","last_became_active":"2024-09-15T23:12:52.468206+0000","last_became_peered":"2024-09-15T23:12:52.468206+0000","last_unstale":"2024-09-15T23:12:54.856591+0000","last_undegraded":"2024-09-15T23:12:54.856591+0000","last_fullsized":"2024-09-15T23:12:54.856591+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:25:47.487245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.856552+0000","last_change":"2024-09-15T23:12:51.449436+0000","last_active":"2024-09-15T23:12:54.856552+0000","last_peered":"2024-09-15T23:12:54.856552+0000","last_clean":"2024-09-15T23:12:54.856552+0000","last_became_active":"2024-09-15T23:12:51.448706+0000","last_became_peered":"2024-09-15T23:12:51.448706+0000","last_unstale":"2024-09-15T23:12:54.856552+0000","last_undegraded":"2024-09-15T23:12:54.856552+0000","last_fullsized":"2024-09-15T23:12:54.856552+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:49.011505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.448160+0000","last_change":"2024-09-15T23:12:52.464069+0000","last_active":"2024-09-15T23:12:53.448160+0000","last_peered":"2024-09-15T23:12:53.448160+0000","last_clean":"2024-09-15T23:12:53.448160+0000","last_became_active":"2024-09-15T23:12:52.463781+0000","last_became_peered":"2024-09-15T23:12:52.463781+0000","last_unstale":"2024-09-15T23:12:53.448160+0000","last_undegraded":"2024-09-15T23:12:53.448160+0000","last_fullsized":"2024-09-15T23:12:53.448160+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:09.042477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.023682+0000","last_change":"2024-09-15T23:12:51.451652+0000","last_active":"2024-09-15T23:12:54.023682+0000","last_peered":"2024-09-15T23:12:54.023682+0000","last_clean":"2024-09-15T23:12:54.023682+0000","last_became_active":"2024-09-15T23:12:51.451402+0000","last_became_peered":"2024-09-15T23:12:51.451402+0000","last_unstale":"2024-09-15T23:12:54.023682+0000","last_undegraded":"2024-09-15T23:12:54.023682+0000","last_fullsized":"2024-09-15T23:12:54.023682+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:14:52.211105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.023436+0000","last_change":"2024-09-15T23:12:52.458843+0000","last_active":"2024-09-15T23:12:54.023436+0000","last_peered":"2024-09-15T23:12:54.023436+0000","last_clean":"2024-09-15T23:12:54.023436+0000","last_became_active":"2024-09-15T23:12:52.457773+0000","last_became_peered":"2024-09-15T23:12:52.457773+0000","last_unstale":"2024-09-15T23:12:54.023436+0000","last_undegraded":"2024-09-15T23:12:54.023436+0000","last_fullsized":"2024-09-15T23:12:54.023436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:57.664093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.023352+0000","last_change":"2024-09-15T23:12:51.448418+0000","last_active":"2024-09-15T23:12:54.023352+0000","last_peered":"2024-09-15T23:12:54.023352+0000","last_clean":"2024-09-15T23:12:54.023352+0000","last_became_active":"2024-09-15T23:12:51.448149+0000","last_became_peered":"2024-09-15T23:12:51.448149+0000","last_unstale":"2024-09-15T23:12:54.023352+0000","last_undegraded":"2024-09-15T23:12:54.023352+0000","last_fullsized":"2024-09-15T23:12:54.023352+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:15.959896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.448032+0000","last_change":"2024-09-15T23:12:52.462387+0000","last_active":"2024-09-15T23:12:53.448032+0000","last_peered":"2024-09-15T23:12:53.448032+0000","last_clean":"2024-09-15T23:12:53.448032+0000","last_became_active":"2024-09-15T23:12:52.462139+0000","last_became_peered":"2024-09-15T23:12:52.462139+0000","last_unstale":"2024-09-15T23:12:53.448032+0000","last_undegraded":"2024-09-15T23:12:53.448032+0000","last_fullsized":"2024-09-15T23:12:53.448032+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:09.263624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451637+0000","last_change":"2024-09-15T23:12:51.444721+0000","last_active":"2024-09-15T23:12:53.451637+0000","last_peered":"2024-09-15T23:12:53.451637+0000","last_clean":"2024-09-15T23:12:53.451637+0000","last_became_active":"2024-09-15T23:12:51.444442+0000","last_became_peered":"2024-09-15T23:12:51.444442+0000","last_unstale":"2024-09-15T23:12:53.451637+0000","last_undegraded":"2024-09-15T23:12:53.451637+0000","last_fullsized":"2024-09-15T23:12:53.451637+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:48.317078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.856149+0000","last_change":"2024-09-15T23:12:52.463950+0000","last_active":"2024-09-15T23:12:54.856149+0000","last_peered":"2024-09-15T23:12:54.856149+0000","last_clean":"2024-09-15T23:12:54.856149+0000","last_became_active":"2024-09-15T23:12:52.463629+0000","last_became_peered":"2024-09-15T23:12:52.463629+0000","last_unstale":"2024-09-15T23:12:54.856149+0000","last_undegraded":"2024-09-15T23:12:54.856149+0000","last_fullsized":"2024-09-15T23:12:54.856149+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:59:23.654598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.023563+0000","last_change":"2024-09-15T23:12:51.451873+0000","last_active":"2024-09-15T23:12:54.023563+0000","last_peered":"2024-09-15T23:12:54.023563+0000","last_clean":"2024-09-15T23:12:54.023563+0000","last_became_active":"2024-09-15T23:12:51.451643+0000","last_became_peered":"2024-09-15T23:12:51.451643+0000","last_unstale":"2024-09-15T23:12:54.023563+0000","last_undegraded":"2024-09-15T23:12:54.023563+0000","last_fullsized":"2024-09-15T23:12:54.023563+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:54.983567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451272+0000","last_change":"2024-09-15T23:12:52.468640+0000","last_active":"2024-09-15T23:12:53.451272+0000","last_peered":"2024-09-15T23:12:53.451272+0000","last_clean":"2024-09-15T23:12:53.451272+0000","last_became_active":"2024-09-15T23:12:52.468384+0000","last_became_peered":"2024-09-15T23:12:52.468384+0000","last_unstale":"2024-09-15T23:12:53.451272+0000","last_undegraded":"2024-09-15T23:12:53.451272+0000","last_fullsized":"2024-09-15T23:12:53.451272+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:55.136613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.813618+0000","last_change":"2024-09-15T23:12:51.453452+0000","last_active":"2024-09-15T23:12:53.813618+0000","last_peered":"2024-09-15T23:12:53.813618+0000","last_clean":"2024-09-15T23:12:53.813618+0000","last_became_active":"2024-09-15T23:12:51.452973+0000","last_became_peered":"2024-09-15T23:12:51.452973+0000","last_unstale":"2024-09-15T23:12:53.813618+0000","last_undegraded":"2024-09-15T23:12:53.813618+0000","last_fullsized":"2024-09-15T23:12:53.813618+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:29:06.168212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.856652+0000","last_change":"2024-09-15T23:12:52.471465+0000","last_active":"2024-09-15T23:12:54.856652+0000","last_peered":"2024-09-15T23:12:54.856652+0000","last_clean":"2024-09-15T23:12:54.856652+0000","last_became_active":"2024-09-15T23:12:52.471120+0000","last_became_peered":"2024-09-15T23:12:52.471120+0000","last_unstale":"2024-09-15T23:12:54.856652+0000","last_undegraded":"2024-09-15T23:12:54.856652+0000","last_fullsized":"2024-09-15T23:12:54.856652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:20.633782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.813420+0000","last_change":"2024-09-15T23:12:51.454019+0000","last_active":"2024-09-15T23:12:53.813420+0000","last_peered":"2024-09-15T23:12:53.813420+0000","last_clean":"2024-09-15T23:12:53.813420+0000","last_became_active":"2024-09-15T23:12:51.453772+0000","last_became_peered":"2024-09-15T23:12:51.453772+0000","last_unstale":"2024-09-15T23:12:53.813420+0000","last_undegraded":"2024-09-15T23:12:53.813420+0000","last_fullsized":"2024-09-15T23:12:53.813420+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:11:37.541756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.856306+0000","last_change":"2024-09-15T23:12:52.464043+0000","last_active":"2024-09-15T23:12:54.856306+0000","last_peered":"2024-09-15T23:12:54.856306+0000","last_clean":"2024-09-15T23:12:54.856306+0000","last_became_active":"2024-09-15T23:12:52.463701+0000","last_became_peered":"2024-09-15T23:12:52.463701+0000","last_unstale":"2024-09-15T23:12:54.856306+0000","last_undegraded":"2024-09-15T23:12:54.856306+0000","last_fullsized":"2024-09-15T23:12:54.856306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:13:02.794020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451007+0000","last_change":"2024-09-15T23:12:51.446980+0000","last_active":"2024-09-15T23:12:53.451007+0000","last_peered":"2024-09-15T23:12:53.451007+0000","last_clean":"2024-09-15T23:12:53.451007+0000","last_became_active":"2024-09-15T23:12:51.446719+0000","last_became_peered":"2024-09-15T23:12:51.446719+0000","last_unstale":"2024-09-15T23:12:53.451007+0000","last_undegraded":"2024-09-15T23:12:53.451007+0000","last_fullsized":"2024-09-15T23:12:53.451007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:11.359265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451018+0000","last_change":"2024-09-15T23:12:52.457789+0000","last_active":"2024-09-15T23:12:53.451018+0000","last_peered":"2024-09-15T23:12:53.451018+0000","last_clean":"2024-09-15T23:12:53.451018+0000","last_became_active":"2024-09-15T23:12:52.457195+0000","last_became_peered":"2024-09-15T23:12:52.457195+0000","last_unstale":"2024-09-15T23:12:53.451018+0000","last_undegraded":"2024-09-15T23:12:53.451018+0000","last_fullsized":"2024-09-15T23:12:53.451018+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:13.992297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.856130+0000","last_change":"2024-09-15T23:12:51.452177+0000","last_active":"2024-09-15T23:12:54.856130+0000","last_peered":"2024-09-15T23:12:54.856130+0000","last_clean":"2024-09-15T23:12:54.856130+0000","last_became_active":"2024-09-15T23:12:51.451878+0000","last_became_peered":"2024-09-15T23:12:51.451878+0000","last_unstale":"2024-09-15T23:12:54.856130+0000","last_undegraded":"2024-09-15T23:12:54.856130+0000","last_fullsized":"2024-09-15T23:12:54.856130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:50.899634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.855484+0000","last_change":"2024-09-15T23:12:52.468707+0000","last_active":"2024-09-15T23:12:54.855484+0000","last_peered":"2024-09-15T23:12:54.855484+0000","last_clean":"2024-09-15T23:12:54.855484+0000","last_became_active":"2024-09-15T23:12:52.468409+0000","last_became_peered":"2024-09-15T23:12:52.468409+0000","last_unstale":"2024-09-15T23:12:54.855484+0000","last_undegraded":"2024-09-15T23:12:54.855484+0000","last_fullsized":"2024-09-15T23:12:54.855484+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:12.512486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.023681+0000","last_change":"2024-09-15T23:12:51.454218+0000","last_active":"2024-09-15T23:12:54.023681+0000","last_peered":"2024-09-15T23:12:54.023681+0000","last_clean":"2024-09-15T23:12:54.023681+0000","last_became_active":"2024-09-15T23:12:51.453793+0000","last_became_peered":"2024-09-15T23:12:51.453793+0000","last_unstale":"2024-09-15T23:12:54.023681+0000","last_undegraded":"2024-09-15T23:12:54.023681+0000","last_fullsized":"2024-09-15T23:12:54.023681+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:50.899634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.856276+0000","last_change":"2024-09-15T23:12:52.469996+0000","last_active":"2024-09-15T23:12:54.856276+0000","last_peered":"2024-09-15T23:12:54.856276+0000","last_clean":"2024-09-15T23:12:54.856276+0000","last_became_active":"2024-09-15T23:12:52.468463+0000","last_became_peered":"2024-09-15T23:12:52.468463+0000","last_unstale":"2024-09-15T23:12:54.856276+0000","last_undegraded":"2024-09-15T23:12:54.856276+0000","last_fullsized":"2024-09-15T23:12:54.856276+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:00.802194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.856052+0000","last_change":"2024-09-15T23:12:51.450186+0000","last_active":"2024-09-15T23:12:54.856052+0000","last_peered":"2024-09-15T23:12:54.856052+0000","last_clean":"2024-09-15T23:12:54.856052+0000","last_became_active":"2024-09-15T23:12:51.449900+0000","last_became_peered":"2024-09-15T23:12:51.449900+0000","last_unstale":"2024-09-15T23:12:54.856052+0000","last_undegraded":"2024-09-15T23:12:54.856052+0000","last_fullsized":"2024-09-15T23:12:54.856052+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:46.454750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.023486+0000","last_change":"2024-09-15T23:12:52.457841+0000","last_active":"2024-09-15T23:12:54.023486+0000","last_peered":"2024-09-15T23:12:54.023486+0000","last_clean":"2024-09-15T23:12:54.023486+0000","last_became_active":"2024-09-15T23:12:52.457579+0000","last_became_peered":"2024-09-15T23:12:52.457579+0000","last_unstale":"2024-09-15T23:12:54.023486+0000","last_undegraded":"2024-09-15T23:12:54.023486+0000","last_fullsized":"2024-09-15T23:12:54.023486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:05.135809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.855842+0000","last_change":"2024-09-15T23:12:51.445393+0000","last_active":"2024-09-15T23:12:54.855842+0000","last_peered":"2024-09-15T23:12:54.855842+0000","last_clean":"2024-09-15T23:12:54.855842+0000","last_became_active":"2024-09-15T23:12:51.444942+0000","last_became_peered":"2024-09-15T23:12:51.444942+0000","last_unstale":"2024-09-15T23:12:54.855842+0000","last_undegraded":"2024-09-15T23:12:54.855842+0000","last_fullsized":"2024-09-15T23:12:54.855842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:11:37.541756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.450961+0000","last_change":"2024-09-15T23:12:52.461401+0000","last_active":"2024-09-15T23:12:53.450961+0000","last_peered":"2024-09-15T23:12:53.450961+0000","last_clean":"2024-09-15T23:12:53.450961+0000","last_became_active":"2024-09-15T23:12:52.460897+0000","last_became_peered":"2024-09-15T23:12:52.460897+0000","last_unstale":"2024-09-15T23:12:53.450961+0000","last_undegraded":"2024-09-15T23:12:53.450961+0000","last_fullsized":"2024-09-15T23:12:53.450961+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:05.522026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451485+0000","last_change":"2024-09-15T23:12:51.445263+0000","last_active":"2024-09-15T23:12:53.451485+0000","last_peered":"2024-09-15T23:12:53.451485+0000","last_clean":"2024-09-15T23:12:53.451485+0000","last_became_active":"2024-09-15T23:12:51.444994+0000","last_became_peered":"2024-09-15T23:12:51.444994+0000","last_unstale":"2024-09-15T23:12:53.451485+0000","last_undegraded":"2024-09-15T23:12:53.451485+0000","last_fullsized":"2024-09-15T23:12:53.451485+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:04.050835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451271+0000","last_change":"2024-09-15T23:12:52.462194+0000","last_active":"2024-09-15T23:12:53.451271+0000","last_peered":"2024-09-15T23:12:53.451271+0000","last_clean":"2024-09-15T23:12:53.451271+0000","last_became_active":"2024-09-15T23:12:52.461911+0000","last_became_peered":"2024-09-15T23:12:52.461911+0000","last_unstale":"2024-09-15T23:12:53.451271+0000","last_undegraded":"2024-09-15T23:12:53.451271+0000","last_fullsized":"2024-09-15T23:12:53.451271+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:13:28.058279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.452044+0000","last_change":"2024-09-15T23:12:51.452056+0000","last_active":"2024-09-15T23:12:53.452044+0000","last_peered":"2024-09-15T23:12:53.452044+0000","last_clean":"2024-09-15T23:12:53.452044+0000","last_became_active":"2024-09-15T23:12:51.451778+0000","last_became_peered":"2024-09-15T23:12:51.451778+0000","last_unstale":"2024-09-15T23:12:53.452044+0000","last_undegraded":"2024-09-15T23:12:53.452044+0000","last_fullsized":"2024-09-15T23:12:53.452044+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:14:07.735968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.448397+0000","last_change":"2024-09-15T23:12:52.460169+0000","last_active":"2024-09-15T23:12:53.448397+0000","last_peered":"2024-09-15T23:12:53.448397+0000","last_clean":"2024-09-15T23:12:53.448397+0000","last_became_active":"2024-09-15T23:12:52.459908+0000","last_became_peered":"2024-09-15T23:12:52.459908+0000","last_unstale":"2024-09-15T23:12:53.448397+0000","last_undegraded":"2024-09-15T23:12:53.448397+0000","last_fullsized":"2024-09-15T23:12:53.448397+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:51.906277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.023446+0000","last_change":"2024-09-15T23:12:51.449713+0000","last_active":"2024-09-15T23:12:54.023446+0000","last_peered":"2024-09-15T23:12:54.023446+0000","last_clean":"2024-09-15T23:12:54.023446+0000","last_became_active":"2024-09-15T23:12:51.449482+0000","last_became_peered":"2024-09-15T23:12:51.449482+0000","last_unstale":"2024-09-15T23:12:54.023446+0000","last_undegraded":"2024-09-15T23:12:54.023446+0000","last_fullsized":"2024-09-15T23:12:54.023446+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:08.256981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.813465+0000","last_change":"2024-09-15T23:12:52.466799+0000","last_active":"2024-09-15T23:12:53.813465+0000","last_peered":"2024-09-15T23:12:53.813465+0000","last_clean":"2024-09-15T23:12:53.813465+0000","last_became_active":"2024-09-15T23:12:52.466476+0000","last_became_peered":"2024-09-15T23:12:52.466476+0000","last_unstale":"2024-09-15T23:12:53.813465+0000","last_undegraded":"2024-09-15T23:12:53.813465+0000","last_fullsized":"2024-09-15T23:12:53.813465+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:14.995661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451122+0000","last_change":"2024-09-15T23:12:51.444768+0000","last_active":"2024-09-15T23:12:53.451122+0000","last_peered":"2024-09-15T23:12:53.451122+0000","last_clean":"2024-09-15T23:12:53.451122+0000","last_became_active":"2024-09-15T23:12:51.444487+0000","last_became_peered":"2024-09-15T23:12:51.444487+0000","last_unstale":"2024-09-15T23:12:53.451122+0000","last_undegraded":"2024-09-15T23:12:53.451122+0000","last_fullsized":"2024-09-15T23:12:53.451122+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:59:54.899240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451945+0000","last_change":"2024-09-15T23:12:52.466942+0000","last_active":"2024-09-15T23:12:53.451945+0000","last_peered":"2024-09-15T23:12:53.451945+0000","last_clean":"2024-09-15T23:12:53.451945+0000","last_became_active":"2024-09-15T23:12:52.466671+0000","last_became_peered":"2024-09-15T23:12:52.466671+0000","last_unstale":"2024-09-15T23:12:53.451945+0000","last_undegraded":"2024-09-15T23:12:53.451945+0000","last_fullsized":"2024-09-15T23:12:53.451945+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:51.906277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.855077+0000","last_change":"2024-09-15T23:12:51.442708+0000","last_active":"2024-09-15T23:12:54.855077+0000","last_peered":"2024-09-15T23:12:54.855077+0000","last_clean":"2024-09-15T23:12:54.855077+0000","last_became_active":"2024-09-15T23:12:51.442436+0000","last_became_peered":"2024-09-15T23:12:51.442436+0000","last_unstale":"2024-09-15T23:12:54.855077+0000","last_undegraded":"2024-09-15T23:12:54.855077+0000","last_fullsized":"2024-09-15T23:12:54.855077+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:46:22.373234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.855524+0000","last_change":"2024-09-15T23:12:52.469986+0000","last_active":"2024-09-15T23:12:54.855524+0000","last_peered":"2024-09-15T23:12:54.855524+0000","last_clean":"2024-09-15T23:12:54.855524+0000","last_became_active":"2024-09-15T23:12:52.469480+0000","last_became_peered":"2024-09-15T23:12:52.469480+0000","last_unstale":"2024-09-15T23:12:54.855524+0000","last_undegraded":"2024-09-15T23:12:54.855524+0000","last_fullsized":"2024-09-15T23:12:54.855524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:46:23.379877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.813517+0000","last_change":"2024-09-15T23:12:51.452451+0000","last_active":"2024-09-15T23:12:53.813517+0000","last_peered":"2024-09-15T23:12:53.813517+0000","last_clean":"2024-09-15T23:12:53.813517+0000","last_became_active":"2024-09-15T23:12:51.452150+0000","last_became_peered":"2024-09-15T23:12:51.452150+0000","last_unstale":"2024-09-15T23:12:53.813517+0000","last_undegraded":"2024-09-15T23:12:53.813517+0000","last_fullsized":"2024-09-15T23:12:53.813517+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:49.011505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.813596+0000","last_change":"2024-09-15T23:12:52.464872+0000","last_active":"2024-09-15T23:12:53.813596+0000","last_peered":"2024-09-15T23:12:53.813596+0000","last_clean":"2024-09-15T23:12:53.813596+0000","last_became_active":"2024-09-15T23:12:52.464543+0000","last_became_peered":"2024-09-15T23:12:52.464543+0000","last_unstale":"2024-09-15T23:12:53.813596+0000","last_undegraded":"2024-09-15T23:12:53.813596+0000","last_fullsized":"2024-09-15T23:12:53.813596+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:58.157375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.023480+0000","last_change":"2024-09-15T23:12:51.449350+0000","last_active":"2024-09-15T23:12:54.023480+0000","last_peered":"2024-09-15T23:12:54.023480+0000","last_clean":"2024-09-15T23:12:54.023480+0000","last_became_active":"2024-09-15T23:12:51.449105+0000","last_became_peered":"2024-09-15T23:12:51.449105+0000","last_unstale":"2024-09-15T23:12:54.023480+0000","last_undegraded":"2024-09-15T23:12:54.023480+0000","last_fullsized":"2024-09-15T23:12:54.023480+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:20:37.546396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.855351+0000","last_change":"2024-09-15T23:12:52.466466+0000","last_active":"2024-09-15T23:12:54.855351+0000","last_peered":"2024-09-15T23:12:54.855351+0000","last_clean":"2024-09-15T23:12:54.855351+0000","last_became_active":"2024-09-15T23:12:52.466143+0000","last_became_peered":"2024-09-15T23:12:52.466143+0000","last_unstale":"2024-09-15T23:12:54.855351+0000","last_undegraded":"2024-09-15T23:12:54.855351+0000","last_fullsized":"2024-09-15T23:12:54.855351+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:19:31.718835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.448187+0000","last_change":"2024-09-15T23:12:51.454629+0000","last_active":"2024-09-15T23:12:53.448187+0000","last_peered":"2024-09-15T23:12:53.448187+0000","last_clean":"2024-09-15T23:12:53.448187+0000","last_became_active":"2024-09-15T23:12:51.454271+0000","last_became_peered":"2024-09-15T23:12:51.454271+0000","last_unstale":"2024-09-15T23:12:53.448187+0000","last_undegraded":"2024-09-15T23:12:53.448187+0000","last_fullsized":"2024-09-15T23:12:53.448187+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:49.679873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.448093+0000","last_change":"2024-09-15T23:12:52.460487+0000","last_active":"2024-09-15T23:12:53.448093+0000","last_peered":"2024-09-15T23:12:53.448093+0000","last_clean":"2024-09-15T23:12:53.448093+0000","last_became_active":"2024-09-15T23:12:52.460214+0000","last_became_peered":"2024-09-15T23:12:52.460214+0000","last_unstale":"2024-09-15T23:12:53.448093+0000","last_undegraded":"2024-09-15T23:12:53.448093+0000","last_fullsized":"2024-09-15T23:12:53.448093+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:16.966539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.450880+0000","last_change":"2024-09-15T23:12:51.445540+0000","last_active":"2024-09-15T23:12:53.450880+0000","last_peered":"2024-09-15T23:12:53.450880+0000","last_clean":"2024-09-15T23:12:53.450880+0000","last_became_active":"2024-09-15T23:12:51.445291+0000","last_became_peered":"2024-09-15T23:12:51.445291+0000","last_unstale":"2024-09-15T23:12:53.450880+0000","last_undegraded":"2024-09-15T23:12:53.450880+0000","last_fullsized":"2024-09-15T23:12:53.450880+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:37:02.023125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.452233+0000","last_change":"2024-09-15T23:12:52.466220+0000","last_active":"2024-09-15T23:12:53.452233+0000","last_peered":"2024-09-15T23:12:53.452233+0000","last_clean":"2024-09-15T23:12:53.452233+0000","last_became_active":"2024-09-15T23:12:52.465909+0000","last_became_peered":"2024-09-15T23:12:52.465909+0000","last_unstale":"2024-09-15T23:12:53.452233+0000","last_undegraded":"2024-09-15T23:12:53.452233+0000","last_fullsized":"2024-09-15T23:12:53.452233+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:50:11.025928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.856051+0000","last_change":"2024-09-15T23:12:51.445595+0000","last_active":"2024-09-15T23:12:54.856051+0000","last_peered":"2024-09-15T23:12:54.856051+0000","last_clean":"2024-09-15T23:12:54.856051+0000","last_became_active":"2024-09-15T23:12:51.445293+0000","last_became_peered":"2024-09-15T23:12:51.445293+0000","last_unstale":"2024-09-15T23:12:54.856051+0000","last_undegraded":"2024-09-15T23:12:54.856051+0000","last_fullsized":"2024-09-15T23:12:54.856051+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:01.506047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451253+0000","last_change":"2024-09-15T23:12:52.461733+0000","last_active":"2024-09-15T23:12:53.451253+0000","last_peered":"2024-09-15T23:12:53.451253+0000","last_clean":"2024-09-15T23:12:53.451253+0000","last_became_active":"2024-09-15T23:12:52.461107+0000","last_became_peered":"2024-09-15T23:12:52.461107+0000","last_unstale":"2024-09-15T23:12:53.451253+0000","last_undegraded":"2024-09-15T23:12:53.451253+0000","last_fullsized":"2024-09-15T23:12:53.451253+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:19.983333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.813626+0000","last_change":"2024-09-15T23:12:51.453993+0000","last_active":"2024-09-15T23:12:53.813626+0000","last_peered":"2024-09-15T23:12:53.813626+0000","last_clean":"2024-09-15T23:12:53.813626+0000","last_became_active":"2024-09-15T23:12:51.453649+0000","last_became_peered":"2024-09-15T23:12:51.453649+0000","last_unstale":"2024-09-15T23:12:53.813626+0000","last_undegraded":"2024-09-15T23:12:53.813626+0000","last_fullsized":"2024-09-15T23:12:53.813626+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:29:04.227986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451957+0000","last_change":"2024-09-15T23:12:52.468016+0000","last_active":"2024-09-15T23:12:53.451957+0000","last_peered":"2024-09-15T23:12:53.451957+0000","last_clean":"2024-09-15T23:12:53.451957+0000","last_became_active":"2024-09-15T23:12:52.467620+0000","last_became_peered":"2024-09-15T23:12:52.467620+0000","last_unstale":"2024-09-15T23:12:53.451957+0000","last_undegraded":"2024-09-15T23:12:53.451957+0000","last_fullsized":"2024-09-15T23:12:53.451957+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:14:53.217748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.856088+0000","last_change":"2024-09-15T23:12:51.445705+0000","last_active":"2024-09-15T23:12:54.856088+0000","last_peered":"2024-09-15T23:12:54.856088+0000","last_clean":"2024-09-15T23:12:54.856088+0000","last_became_active":"2024-09-15T23:12:51.445207+0000","last_became_peered":"2024-09-15T23:12:51.445207+0000","last_unstale":"2024-09-15T23:12:54.856088+0000","last_undegraded":"2024-09-15T23:12:54.856088+0000","last_fullsized":"2024-09-15T23:12:54.856088+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:14:52.211105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.855059+0000","last_change":"2024-09-15T23:12:52.459515+0000","last_active":"2024-09-15T23:12:54.855059+0000","last_peered":"2024-09-15T23:12:54.855059+0000","last_clean":"2024-09-15T23:12:54.855059+0000","last_became_active":"2024-09-15T23:12:52.459221+0000","last_became_peered":"2024-09-15T23:12:52.459221+0000","last_unstale":"2024-09-15T23:12:54.855059+0000","last_undegraded":"2024-09-15T23:12:54.855059+0000","last_fullsized":"2024-09-15T23:12:54.855059+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:59:55.905883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.856000+0000","last_change":"2024-09-15T23:12:51.447186+0000","last_active":"2024-09-15T23:12:54.856000+0000","last_peered":"2024-09-15T23:12:54.856000+0000","last_clean":"2024-09-15T23:12:54.856000+0000","last_became_active":"2024-09-15T23:12:51.446834+0000","last_became_peered":"2024-09-15T23:12:51.446834+0000","last_unstale":"2024-09-15T23:12:54.856000+0000","last_undegraded":"2024-09-15T23:12:54.856000+0000","last_fullsized":"2024-09-15T23:12:54.856000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:08.035834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.856425+0000","last_change":"2024-09-15T23:12:52.469661+0000","last_active":"2024-09-15T23:12:54.856425+0000","last_peered":"2024-09-15T23:12:54.856425+0000","last_clean":"2024-09-15T23:12:54.856425+0000","last_became_active":"2024-09-15T23:12:52.468123+0000","last_became_peered":"2024-09-15T23:12:52.468123+0000","last_unstale":"2024-09-15T23:12:54.856425+0000","last_undegraded":"2024-09-15T23:12:54.856425+0000","last_fullsized":"2024-09-15T23:12:54.856425+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:10:49.155580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.855616+0000","last_change":"2024-09-15T23:12:51.447976+0000","last_active":"2024-09-15T23:12:54.855616+0000","last_peered":"2024-09-15T23:12:54.855616+0000","last_clean":"2024-09-15T23:12:54.855616+0000","last_became_active":"2024-09-15T23:12:51.447643+0000","last_became_peered":"2024-09-15T23:12:51.447643+0000","last_unstale":"2024-09-15T23:12:54.855616+0000","last_undegraded":"2024-09-15T23:12:54.855616+0000","last_fullsized":"2024-09-15T23:12:54.855616+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:20:37.546396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.855751+0000","last_change":"2024-09-15T23:12:52.456867+0000","last_active":"2024-09-15T23:12:54.855751+0000","last_peered":"2024-09-15T23:12:54.855751+0000","last_clean":"2024-09-15T23:12:54.855751+0000","last_became_active":"2024-09-15T23:12:52.456593+0000","last_became_peered":"2024-09-15T23:12:52.456593+0000","last_unstale":"2024-09-15T23:12:54.855751+0000","last_undegraded":"2024-09-15T23:12:54.855751+0000","last_fullsized":"2024-09-15T23:12:54.855751+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:33:26.062740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.023594+0000","last_change":"2024-09-15T23:12:51.450580+0000","last_active":"2024-09-15T23:12:54.023594+0000","last_peered":"2024-09-15T23:12:54.023594+0000","last_clean":"2024-09-15T23:12:54.023594+0000","last_became_active":"2024-09-15T23:12:51.450307+0000","last_became_peered":"2024-09-15T23:12:51.450307+0000","last_unstale":"2024-09-15T23:12:54.023594+0000","last_undegraded":"2024-09-15T23:12:54.023594+0000","last_fullsized":"2024-09-15T23:12:54.023594+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:30:08.035834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451018+0000","last_change":"2024-09-15T23:12:52.461956+0000","last_active":"2024-09-15T23:12:53.451018+0000","last_peered":"2024-09-15T23:12:53.451018+0000","last_clean":"2024-09-15T23:12:53.451018+0000","last_became_active":"2024-09-15T23:12:52.461667+0000","last_became_peered":"2024-09-15T23:12:52.461667+0000","last_unstale":"2024-09-15T23:12:53.451018+0000","last_undegraded":"2024-09-15T23:12:53.451018+0000","last_fullsized":"2024-09-15T23:12:53.451018+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:38.741524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.855723+0000","last_change":"2024-09-15T23:12:51.447791+0000","last_active":"2024-09-15T23:12:54.855723+0000","last_peered":"2024-09-15T23:12:54.855723+0000","last_clean":"2024-09-15T23:12:54.855723+0000","last_became_active":"2024-09-15T23:12:51.447535+0000","last_became_peered":"2024-09-15T23:12:51.447535+0000","last_unstale":"2024-09-15T23:12:54.855723+0000","last_undegraded":"2024-09-15T23:12:54.855723+0000","last_fullsized":"2024-09-15T23:12:54.855723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:05.785498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:54.855083+0000","last_change":"2024-09-15T23:12:52.460091+0000","last_active":"2024-09-15T23:12:54.855083+0000","last_peered":"2024-09-15T23:12:54.855083+0000","last_clean":"2024-09-15T23:12:54.855083+0000","last_became_active":"2024-09-15T23:12:52.459808+0000","last_became_peered":"2024-09-15T23:12:52.459808+0000","last_unstale":"2024-09-15T23:12:54.855083+0000","last_undegraded":"2024-09-15T23:12:54.855083+0000","last_fullsized":"2024-09-15T23:12:54.855083+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:51.429763+0000","last_clean_scrub_stamp":"2024-09-15T23:12:51.429763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:53.672606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.451212+0000","last_change":"2024-09-15T23:12:51.442341+0000","last_active":"2024-09-15T23:12:53.451212+0000","last_peered":"2024-09-15T23:12:53.451212+0000","last_clean":"2024-09-15T23:12:53.451212+0000","last_became_active":"2024-09-15T23:12:51.442068+0000","last_became_peered":"2024-09-15T23:12:51.442068+0000","last_unstale":"2024-09-15T23:12:53.451212+0000","last_undegraded":"2024-09-15T23:12:53.451212+0000","last_fullsized":"2024-09-15T23:12:53.451212+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:50.423120+0000","last_clean_scrub_stamp":"2024-09-15T23:12:50.423120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:52.665963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":191,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-15T23:12:53.448247+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:12:53.448247+0000","last_peered":"2024-09-15T23:12:53.448247+0000","last_clean":"2024-09-15T23:12:53.448247+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:12:53.448247+0000","last_undegraded":"2024-09-15T23:12:53.448247+0000","last_fullsized":"2024-09-15T23:12:53.448247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476753,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":376832,"data_stored":140440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476750,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":364544,"data_stored":139698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476752,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":958464,"data_stored":730102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476752,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":364544,"data_stored":139754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":364544,"data_stored":139686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":372736,"data_stored":141276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542157,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":958464,"data_stored":730614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542159,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":141298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:13:00.046 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T23:13:00.046 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T23:13:00.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.188+0000 7fe7e8bfd640 1 Processor -- start 2024-09-15T23:13:00.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.188+0000 7fe7e8bfd640 1 -- start start 2024-09-15T23:13:00.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.189+0000 7fe7e8bfd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe7e4072ad0 0x7fe7e40b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:00.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.189+0000 7fe7e8bfd640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7e40cf2e0 con 0x7fe7e40ccf30 2024-09-15T23:13:00.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.189+0000 7fe7e8bfd640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7e4070fe0 con 0x7fe7e415b7c0 2024-09-15T23:13:00.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.189+0000 7fe7e8bfd640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe7e40712c0 con 0x7fe7e4072ad0 2024-09-15T23:13:00.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.189+0000 7fe7e259c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe7e40ccf30 0x7fe7e40cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38334/0 (socket says 172.21.15.123:38334) 2024-09-15T23:13:00.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.189+0000 7fe7e259c640 1 -- 172.21.15.123:0/913328426 learned_addr learned my addr 172.21.15.123:0/913328426 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:13:00.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.189+0000 7fe7e2d9d640 1 --2- 172.21.15.123:0/913328426 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe7e4072ad0 0x7fe7e40b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:00.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.189+0000 7fe7e1d9b640 1 -- 172.21.15.123:0/913328426 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1403131724 0 0) 0x7fe7e40cf2e0 con 0x7fe7e40ccf30 2024-09-15T23:13:00.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.189+0000 7fe7e1d9b640 1 -- 172.21.15.123:0/913328426 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7d0003520 con 0x7fe7e40ccf30 2024-09-15T23:13:00.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.189+0000 7fe7e1d9b640 1 -- 172.21.15.123:0/913328426 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3637166148 0 0) 0x7fe7d0003520 con 0x7fe7e40ccf30 2024-09-15T23:13:00.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.189+0000 7fe7e1d9b640 1 -- 172.21.15.123:0/913328426 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe7e4072ad0 msgr2=0x7fe7e40b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:00.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.189+0000 7fe7e1d9b640 1 --2- 172.21.15.123:0/913328426 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe7e4072ad0 0x7fe7e40b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:00.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.189+0000 7fe7e1d9b640 1 -- 172.21.15.123:0/913328426 >> v1:172.21.15.188:6789/0 conn(0x7fe7e415b7c0 legacy=0x7fe7e40cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:00.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.189+0000 7fe7e1d9b640 1 -- 172.21.15.123:0/913328426 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7e40715a0 con 0x7fe7e40ccf30 2024-09-15T23:13:00.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.189+0000 7fe7e1d9b640 1 -- 172.21.15.123:0/913328426 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fe7d4001670 con 0x7fe7e40ccf30 2024-09-15T23:13:00.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.189+0000 7fe7e1d9b640 1 -- 172.21.15.123:0/913328426 >> v1:172.21.15.123:6789/0 conn(0x7fe7e40ccf30 legacy=0x7fe7e40cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:00.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.189+0000 7fe7e1d9b640 1 --2- 172.21.15.123:0/913328426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7d00039e0 0x7fe7d0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:00.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.189+0000 7fe7e1d9b640 1 --2- 172.21.15.123:0/913328426 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe7d0004800 0x7fe7d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:00.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.189+0000 7fe7e1d9b640 1 --2- 172.21.15.123:0/913328426 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe7e4072ad0 0x7fe7d0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:00.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.189+0000 7fe7e1d9b640 1 -- 172.21.15.123:0/913328426 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e40712c0 con 0x7fe7d00039e0 2024-09-15T23:13:00.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.189+0000 7fe7e1d9b640 1 -- 172.21.15.123:0/913328426 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d000baf0 con 0x7fe7d0004800 2024-09-15T23:13:00.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.189+0000 7fe7e1d9b640 1 -- 172.21.15.123:0/913328426 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe7d000df00 con 0x7fe7e4072ad0 2024-09-15T23:13:00.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.189+0000 7fe7e259c640 1 --2- 172.21.15.123:0/913328426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7d00039e0 0x7fe7d0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:00.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.189+0000 7fe7d9d9b640 1 --2- 172.21.15.123:0/913328426 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe7d0004800 0x7fe7d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:00.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.190+0000 7fe7e2d9d640 1 --2- 172.21.15.123:0/913328426 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe7e4072ad0 0x7fe7d0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:00.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.190+0000 7fe7e259c640 1 -- 172.21.15.123:0/913328426 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe7e4072ad0 msgr2=0x7fe7d0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:00.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.190+0000 7fe7e259c640 1 --2- 172.21.15.123:0/913328426 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe7e4072ad0 0x7fe7d0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:00.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.190+0000 7fe7e259c640 1 -- 172.21.15.123:0/913328426 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe7d0004800 msgr2=0x7fe7d0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:00.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.190+0000 7fe7e259c640 1 --2- 172.21.15.123:0/913328426 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe7d0004800 0x7fe7d0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:00.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.190+0000 7fe7e259c640 1 -- 172.21.15.123:0/913328426 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7d0003520 con 0x7fe7d00039e0 2024-09-15T23:13:00.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.190+0000 7fe7e2d9d640 1 --2- 172.21.15.123:0/913328426 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe7e4072ad0 0x7fe7d0005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:13:00.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.190+0000 7fe7e259c640 1 --2- 172.21.15.123:0/913328426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7d00039e0 0x7fe7d0003e00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe7d400c290 tx=0x7fe7d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18965038868074b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:00.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.190+0000 7fe7e1d9b640 1 -- 172.21.15.123:0/913328426 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d4007d30 con 0x7fe7d00039e0 2024-09-15T23:13:00.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.190+0000 7fe7e1d9b640 1 -- 172.21.15.123:0/913328426 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7d40058d0 con 0x7fe7d00039e0 2024-09-15T23:13:00.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.190+0000 7fe7e1d9b640 1 -- 172.21.15.123:0/913328426 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d4005ca0 con 0x7fe7d00039e0 2024-09-15T23:13:00.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.191+0000 7fe7e8bfd640 1 -- 172.21.15.123:0/913328426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7d00039e0 msgr2=0x7fe7d0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:00.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.191+0000 7fe7e8bfd640 1 --2- 172.21.15.123:0/913328426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7d00039e0 0x7fe7d0003e00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe7d400c290 tx=0x7fe7d0005830 comp rx=0 tx=0).stop 2024-09-15T23:13:00.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.191+0000 7fe7e2d9d640 1 -- 172.21.15.123:0/913328426 reap_dead start 2024-09-15T23:13:00.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.191+0000 7fe7e8bfd640 1 -- 172.21.15.123:0/913328426 shutdown_connections 2024-09-15T23:13:00.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.191+0000 7fe7e8bfd640 1 -- 172.21.15.123:0/913328426 >> 172.21.15.123:0/913328426 conn(0x7fe7e406d0f0 msgr2=0x7fe7e406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:00.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.191+0000 7fe7e8bfd640 1 -- 172.21.15.123:0/913328426 shutdown_connections 2024-09-15T23:13:00.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.191+0000 7fe7e8bfd640 1 -- 172.21.15.123:0/913328426 wait complete. 2024-09-15T23:13:00.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.192+0000 7fe7e8bfd640 1 Processor -- start 2024-09-15T23:13:00.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.192+0000 7fe7e8bfd640 1 -- start start 2024-09-15T23:13:00.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.193+0000 7fe7e8bfd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe7d00039e0 0x7fe7e41f7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:00.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.193+0000 7fe7e8bfd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe7e41566c0 0x7fe7e4156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:00.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.193+0000 7fe7e8bfd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7e4159520 0x7fe7e41599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:00.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.193+0000 7fe7e8bfd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e40b2dd0 con 0x7fe7e4159520 2024-09-15T23:13:00.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.193+0000 7fe7e8bfd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e40b2c50 con 0x7fe7d00039e0 2024-09-15T23:13:00.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.193+0000 7fe7e8bfd640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe7e40b2f50 con 0x7fe7e41566c0 2024-09-15T23:13:00.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.193+0000 7fe7e2d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7e4159520 0x7fe7e41599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:00.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.193+0000 7fe7e2d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7e4159520 0x7fe7e41599a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41590/0 (socket says 172.21.15.123:41590) 2024-09-15T23:13:00.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.193+0000 7fe7e2d9d640 1 -- 172.21.15.123:0/2284881017 learned_addr learned my addr 172.21.15.123:0/2284881017 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:13:00.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.194+0000 7fe7e259c640 1 --2- 172.21.15.123:0/2284881017 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe7d00039e0 0x7fe7e41f7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:00.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.194+0000 7fe7d9d9b640 1 --2- 172.21.15.123:0/2284881017 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe7e41566c0 0x7fe7e4156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:00.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.194+0000 7fe7e2d9d640 1 -- 172.21.15.123:0/2284881017 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe7e41566c0 msgr2=0x7fe7e4156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:00.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.194+0000 7fe7e2d9d640 1 --2- 172.21.15.123:0/2284881017 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe7e41566c0 0x7fe7e4156b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:00.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.194+0000 7fe7e2d9d640 1 -- 172.21.15.123:0/2284881017 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe7d00039e0 msgr2=0x7fe7e41f7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:00.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.194+0000 7fe7e2d9d640 1 --2- 172.21.15.123:0/2284881017 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe7d00039e0 0x7fe7e41f7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:00.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.194+0000 7fe7e2d9d640 1 -- 172.21.15.123:0/2284881017 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7e40c57f0 con 0x7fe7e4159520 2024-09-15T23:13:00.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.194+0000 7fe7e2d9d640 1 --2- 172.21.15.123:0/2284881017 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7e4159520 0x7fe7e41599a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe7e40cce40 tx=0x7fe7dc009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:00.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.194+0000 7fe7db7fe640 1 -- 172.21.15.123:0/2284881017 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc01a030 con 0x7fe7e4159520 2024-09-15T23:13:00.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.194+0000 7fe7db7fe640 1 -- 172.21.15.123:0/2284881017 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7dc010e50 con 0x7fe7e4159520 2024-09-15T23:13:00.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.194+0000 7fe7e8bfd640 1 -- 172.21.15.123:0/2284881017 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7e41f7e70 con 0x7fe7e4159520 2024-09-15T23:13:00.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.194+0000 7fe7db7fe640 1 -- 172.21.15.123:0/2284881017 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc003bd0 con 0x7fe7e4159520 2024-09-15T23:13:00.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.194+0000 7fe7e8bfd640 1 -- 172.21.15.123:0/2284881017 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7e415a3e0 con 0x7fe7e4159520 2024-09-15T23:13:00.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.195+0000 7fe7e8bfd640 1 -- 172.21.15.123:0/2284881017 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7e40cd310 con 0x7fe7e4159520 2024-09-15T23:13:00.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.195+0000 7fe7db7fe640 1 -- 172.21.15.123:0/2284881017 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe7dc01d070 con 0x7fe7e4159520 2024-09-15T23:13:00.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.196+0000 7fe7db7fe640 1 --2- 172.21.15.123:0/2284881017 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe7c406c2e0 0x7fe7c406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:00.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.196+0000 7fe7db7fe640 1 -- 172.21.15.123:0/2284881017 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fe7dc08b9d0 con 0x7fe7e4159520 2024-09-15T23:13:00.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.196+0000 7fe7e259c640 1 --2- 172.21.15.123:0/2284881017 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe7c406c2e0 0x7fe7c406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:00.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.196+0000 7fe7e259c640 1 --2- 172.21.15.123:0/2284881017 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe7c406c2e0 0x7fe7c406e7a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4033000 tx=0x7fe7d4009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:00.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.200+0000 7fe7db7fe640 1 -- 172.21.15.123:0/2284881017 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe7e40c57f0 con 0x7fe7e4159520 2024-09-15T23:13:00.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.431+0000 7fe7e8bfd640 1 -- 172.21.15.123:0/2284881017 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fe7e40cc960 con 0x7fe7e4159520 2024-09-15T23:13:00.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.433+0000 7fe7db7fe640 1 -- 172.21.15.123:0/2284881017 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7fe7dc05a1d0 con 0x7fe7e4159520 2024-09-15T23:13:00.435 INFO:teuthology.orchestra.run.smithi123.stdout:[client.0] 2024-09-15T23:13:00.435 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCNaedmzQPqJRAAhUf1dnVYohN4obCfeu8+7g== 2024-09-15T23:13:00.435 INFO:teuthology.orchestra.run.smithi123.stdout: caps mds = "allow" 2024-09-15T23:13:00.435 INFO:teuthology.orchestra.run.smithi123.stdout: caps mon = "allow r" 2024-09-15T23:13:00.435 INFO:teuthology.orchestra.run.smithi123.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T23:13:00.435 INFO:teuthology.orchestra.run.smithi123.stderr:updated caps for client.0 2024-09-15T23:13:00.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.436+0000 7fe7e8bfd640 1 -- 172.21.15.123:0/2284881017 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe7c406c2e0 msgr2=0x7fe7c406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:00.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.436+0000 7fe7e8bfd640 1 --2- 172.21.15.123:0/2284881017 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe7c406c2e0 0x7fe7c406e7a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4033000 tx=0x7fe7d4009030 comp rx=0 tx=0).stop 2024-09-15T23:13:00.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.436+0000 7fe7e8bfd640 1 -- 172.21.15.123:0/2284881017 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7e4159520 msgr2=0x7fe7e41599a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:00.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.436+0000 7fe7e8bfd640 1 --2- 172.21.15.123:0/2284881017 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7e4159520 0x7fe7e41599a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe7e40cce40 tx=0x7fe7dc009f90 comp rx=0 tx=0).stop 2024-09-15T23:13:00.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.436+0000 7fe7e8bfd640 1 -- 172.21.15.123:0/2284881017 shutdown_connections 2024-09-15T23:13:00.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.436+0000 7fe7e8bfd640 1 --2- 172.21.15.123:0/2284881017 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe7c406c2e0 0x7fe7c406e7a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:00.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.436+0000 7fe7e8bfd640 1 --2- 172.21.15.123:0/2284881017 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7e4159520 0x7fe7e41599a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:00.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.436+0000 7fe7e8bfd640 1 --2- 172.21.15.123:0/2284881017 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe7e41566c0 0x7fe7e4156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:00.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.436+0000 7fe7e8bfd640 1 --2- 172.21.15.123:0/2284881017 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe7d00039e0 0x7fe7e41f7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:00.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.436+0000 7fe7e8bfd640 1 -- 172.21.15.123:0/2284881017 >> 172.21.15.123:0/2284881017 conn(0x7fe7e406d0f0 msgr2=0x7fe7e40b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:00.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.436+0000 7fe7e8bfd640 1 -- 172.21.15.123:0/2284881017 shutdown_connections 2024-09-15T23:13:00.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.436+0000 7fe7e8bfd640 1 -- 172.21.15.123:0/2284881017 wait complete. 2024-09-15T23:13:00.448 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:13:00.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.547+0000 7f563a19f640 1 Processor -- start 2024-09-15T23:13:00.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.547+0000 7f563a19f640 1 -- start start 2024-09-15T23:13:00.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.548+0000 7f563a19f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f56340cf450 0x7f56340d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:00.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.548+0000 7f563a19f640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56340d3990 con 0x7f56340b6710 2024-09-15T23:13:00.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.548+0000 7f563a19f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56340d3c70 con 0x7f563415e440 2024-09-15T23:13:00.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.548+0000 7f563a19f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f56340d3f50 con 0x7f56340cf450 2024-09-15T23:13:00.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.548+0000 7f563999e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f56340cf450 0x7f56340d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:00.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.548+0000 7f563999e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f56340cf450 0x7f56340d3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41598/0 (socket says 172.21.15.123:41598) 2024-09-15T23:13:00.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.548+0000 7f563899c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f56340b6710 0x7f56340b7b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38344/0 (socket says 172.21.15.123:38344) 2024-09-15T23:13:00.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.548+0000 7f563999e640 1 -- 172.21.15.123:0/3254248007 learned_addr learned my addr 172.21.15.123:0/3254248007 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:13:00.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.548+0000 7f563999e640 1 -- 172.21.15.123:0/3254248007 >> v1:172.21.15.188:6789/0 conn(0x7f563415e440 legacy=0x7f56340b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:00.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.548+0000 7f563999e640 1 -- 172.21.15.123:0/3254248007 >> v1:172.21.15.123:6789/0 conn(0x7f56340b6710 legacy=0x7f56340b7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:00.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.548+0000 7f563999e640 1 -- 172.21.15.123:0/3254248007 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56340d4230 con 0x7f56340cf450 2024-09-15T23:13:00.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.549+0000 7f563999e640 1 --2- 172.21.15.123:0/3254248007 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56340cf450 0x7f56340d3240 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f562c009e50 tx=0x7f562c02a810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e66b02875d3d8e82 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:00.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.549+0000 7f562bfff640 1 -- 172.21.15.123:0/3254248007 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562c033610 con 0x7f56340cf450 2024-09-15T23:13:00.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.549+0000 7f562bfff640 1 -- 172.21.15.123:0/3254248007 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f562c02f070 con 0x7f56340cf450 2024-09-15T23:13:00.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.549+0000 7f562bfff640 1 -- 172.21.15.123:0/3254248007 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562c0339d0 con 0x7f56340cf450 2024-09-15T23:13:00.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.549+0000 7f563a19f640 1 -- 172.21.15.123:0/3254248007 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56340cf450 msgr2=0x7f56340d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:00.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.549+0000 7f563a19f640 1 --2- 172.21.15.123:0/3254248007 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56340cf450 0x7f56340d3240 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f562c009e50 tx=0x7f562c02a810 comp rx=0 tx=0).stop 2024-09-15T23:13:00.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.550+0000 7f563a19f640 1 -- 172.21.15.123:0/3254248007 shutdown_connections 2024-09-15T23:13:00.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.550+0000 7f563a19f640 1 --2- 172.21.15.123:0/3254248007 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56340cf450 0x7f56340d3240 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:00.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.550+0000 7f563a19f640 1 -- 172.21.15.123:0/3254248007 >> 172.21.15.123:0/3254248007 conn(0x7f5634067f80 msgr2=0x7f56340d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:00.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.550+0000 7f563a19f640 1 -- 172.21.15.123:0/3254248007 shutdown_connections 2024-09-15T23:13:00.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.550+0000 7f563a19f640 1 -- 172.21.15.123:0/3254248007 wait complete. 2024-09-15T23:13:00.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.551+0000 7f563a19f640 1 Processor -- start 2024-09-15T23:13:00.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.551+0000 7f563a19f640 1 -- start start 2024-09-15T23:13:00.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.551+0000 7f563a19f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56340b6710 0x7f5634154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:00.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.551+0000 7f563a19f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56340cf450 0x7f56340cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:00.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.551+0000 7f563a19f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f563415e440 0x7f56341e59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:00.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.551+0000 7f563a19f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f56340b76c0 con 0x7f56340b6710 2024-09-15T23:13:00.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.551+0000 7f563a19f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f56340b7540 con 0x7f563415e440 2024-09-15T23:13:00.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.551+0000 7f563a19f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f56340b8270 con 0x7f56340cf450 2024-09-15T23:13:00.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.552+0000 7f563919d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56340b6710 0x7f5634154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:00.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.552+0000 7f563919d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56340b6710 0x7f5634154c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41602/0 (socket says 172.21.15.123:41602) 2024-09-15T23:13:00.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.552+0000 7f563919d640 1 -- 172.21.15.123:0/3360734136 learned_addr learned my addr 172.21.15.123:0/3360734136 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:13:00.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.552+0000 7f563999e640 1 --2- 172.21.15.123:0/3360734136 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f563415e440 0x7f56341e59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:00.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.552+0000 7f563899c640 1 --2- 172.21.15.123:0/3360734136 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56340cf450 0x7f56340cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:00.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.552+0000 7f563919d640 1 -- 172.21.15.123:0/3360734136 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56340cf450 msgr2=0x7f56340cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:00.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.552+0000 7f563919d640 1 --2- 172.21.15.123:0/3360734136 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56340cf450 0x7f56340cc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:00.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.552+0000 7f563919d640 1 -- 172.21.15.123:0/3360734136 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f563415e440 msgr2=0x7f56341e59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:00.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.552+0000 7f563919d640 1 --2- 172.21.15.123:0/3360734136 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f563415e440 0x7f56341e59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:00.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.552+0000 7f563919d640 1 -- 172.21.15.123:0/3360734136 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56340cd480 con 0x7f56340b6710 2024-09-15T23:13:00.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.552+0000 7f563899c640 1 --2- 172.21.15.123:0/3360734136 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56340cf450 0x7f56340cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:13:00.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.552+0000 7f563919d640 1 --2- 172.21.15.123:0/3360734136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56340b6710 0x7f5634154c40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f563000b3f0 tx=0x7f563000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:00.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.552+0000 7f5629ffb640 1 -- 172.21.15.123:0/3360734136 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630015020 con 0x7f56340b6710 2024-09-15T23:13:00.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.552+0000 7f5629ffb640 1 -- 172.21.15.123:0/3360734136 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5630011830 con 0x7f56340b6710 2024-09-15T23:13:00.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.552+0000 7f563a19f640 1 -- 172.21.15.123:0/3360734136 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56340cd760 con 0x7f56340b6710 2024-09-15T23:13:00.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.552+0000 7f5629ffb640 1 -- 172.21.15.123:0/3360734136 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630011c20 con 0x7f56340b6710 2024-09-15T23:13:00.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.553+0000 7f563a19f640 1 -- 172.21.15.123:0/3360734136 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56340cdd20 con 0x7f56340b6710 2024-09-15T23:13:00.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.553+0000 7f563a19f640 1 -- 172.21.15.123:0/3360734136 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56340d3240 con 0x7f56340b6710 2024-09-15T23:13:00.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.554+0000 7f5629ffb640 1 -- 172.21.15.123:0/3360734136 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5630018020 con 0x7f56340b6710 2024-09-15T23:13:00.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.554+0000 7f5629ffb640 1 --2- 172.21.15.123:0/3360734136 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f561806c2b0 0x7f561806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:00.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.554+0000 7f5629ffb640 1 -- 172.21.15.123:0/3360734136 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f563008b150 con 0x7f56340b6710 2024-09-15T23:13:00.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.554+0000 7f563899c640 1 --2- 172.21.15.123:0/3360734136 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f561806c2b0 0x7f561806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:00.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.555+0000 7f563899c640 1 --2- 172.21.15.123:0/3360734136 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f561806c2b0 0x7f561806e770 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f56340b4100 tx=0x7f5624009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:00.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.558+0000 7f5629ffb640 1 -- 172.21.15.123:0/3360734136 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f563001f030 con 0x7f56340b6710 2024-09-15T23:13:00.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.760+0000 7f563a19f640 1 -- 172.21.15.123:0/3360734136 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56340b9f50 con 0x7f56340b6710 2024-09-15T23:13:00.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.761+0000 7f5629ffb640 1 -- 172.21.15.123:0/3360734136 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5231 (secure 0 0 0) 0x7f56300172c0 con 0x7f56340b6710 2024-09-15T23:13:00.762 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:13:00.762 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":13,"btime":"2024-09-15T23:12:54:460875+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/324550176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":324550176},{"type":"v1","addr":"172.21.15.188:6837","nonce":324550176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4696,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2893461525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2893461525},{"type":"v1","addr":"172.21.15.188:6836","nonce":2893461525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4773,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/4033133132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":4033133132},{"type":"v1","addr":"172.21.15.123:6833","nonce":4033133132}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:12:51.772541+0000","modified":"2024-09-15T23:12:53.781227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4776},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4776":{"gid":4776,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/1577644605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1577644605},{"type":"v1","addr":"172.21.15.123:6835","nonce":1577644605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4776,"qdb_cluster":[4776]},"id":2}]} 2024-09-15T23:13:00.762 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 13 2024-09-15T23:13:00.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.763+0000 7f563a19f640 1 -- 172.21.15.123:0/3360734136 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f561806c2b0 msgr2=0x7f561806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:00.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.763+0000 7f563a19f640 1 --2- 172.21.15.123:0/3360734136 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f561806c2b0 0x7f561806e770 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f56340b4100 tx=0x7f5624009040 comp rx=0 tx=0).stop 2024-09-15T23:13:00.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.763+0000 7f563a19f640 1 -- 172.21.15.123:0/3360734136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56340b6710 msgr2=0x7f5634154c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:00.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.763+0000 7f563a19f640 1 --2- 172.21.15.123:0/3360734136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56340b6710 0x7f5634154c40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f563000b3f0 tx=0x7f563000b8b0 comp rx=0 tx=0).stop 2024-09-15T23:13:00.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.763+0000 7f563a19f640 1 -- 172.21.15.123:0/3360734136 shutdown_connections 2024-09-15T23:13:00.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.763+0000 7f563a19f640 1 --2- 172.21.15.123:0/3360734136 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f563415e440 0x7f56341e59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:00.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.763+0000 7f563a19f640 1 --2- 172.21.15.123:0/3360734136 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56340cf450 0x7f56340cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:00.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.763+0000 7f563a19f640 1 --2- 172.21.15.123:0/3360734136 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f561806c2b0 0x7f561806e770 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:00.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.763+0000 7f563a19f640 1 --2- 172.21.15.123:0/3360734136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56340b6710 0x7f5634154c40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:00.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.763+0000 7f563a19f640 1 -- 172.21.15.123:0/3360734136 >> 172.21.15.123:0/3360734136 conn(0x7f5634067f80 msgr2=0x7f56340b4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:00.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.763+0000 7f563a19f640 1 -- 172.21.15.123:0/3360734136 shutdown_connections 2024-09-15T23:13:00.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:00.763+0000 7f563a19f640 1 -- 172.21.15.123:0/3360734136 wait complete. 2024-09-15T23:13:01.177 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:12:51.772541+0000', 'modified': '2024-09-15T23:12:53.781227+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4776}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4776': {'gid': 4776, 'name': 'c', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.123:6835/1577644605', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6834', 'nonce': 1577644605}, {'type': 'v1', 'addr': '172.21.15.123:6835', 'nonce': 1577644605}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4776, 'qdb_cluster': [4776]} 2024-09-15T23:13:01.178 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:13:01.178 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-15T23:13:01.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.280+0000 7f47be778640 1 Processor -- start 2024-09-15T23:13:01.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.280+0000 7f47be778640 1 -- start start 2024-09-15T23:13:01.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.280+0000 7f47be778640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f47b815b9a0 0x7f47b80b6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:01.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.280+0000 7f47be778640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f47b80b70a0 0x7f47b80cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:01.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.280+0000 7f47be778640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47b80b74c0 con 0x7f47b8158f80 2024-09-15T23:13:01.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.280+0000 7f47be778640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f47b80726d0 con 0x7f47b815b9a0 2024-09-15T23:13:01.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.280+0000 7f47be778640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f47b8072930 con 0x7f47b80b70a0 2024-09-15T23:13:01.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.281+0000 7f47b77fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f47b815b9a0 0x7f47b80b6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:01.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.281+0000 7f47b77fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f47b815b9a0 0x7f47b80b6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41610/0 (socket says 172.21.15.123:41610) 2024-09-15T23:13:01.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.281+0000 7f47b77fe640 1 -- 172.21.15.123:0/1259320309 learned_addr learned my addr 172.21.15.123:0/1259320309 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:13:01.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.281+0000 7f47b77fe640 1 -- 172.21.15.123:0/1259320309 >> v2:172.21.15.188:3300/0 conn(0x7f47b80b70a0 msgr2=0x7f47b80cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:01.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.281+0000 7f47bcd15640 1 --2- 172.21.15.123:0/1259320309 >> v2:172.21.15.188:3300/0 conn(0x7f47b80b70a0 0x7f47b80cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:01.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.281+0000 7f47b77fe640 1 --2- 172.21.15.123:0/1259320309 >> v2:172.21.15.188:3300/0 conn(0x7f47b80b70a0 0x7f47b80cf4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.281+0000 7f47b77fe640 1 -- 172.21.15.123:0/1259320309 >> v1:172.21.15.188:6789/0 conn(0x7f47b8158f80 legacy=0x7f47b8071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:01.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.281+0000 7f47b77fe640 1 -- 172.21.15.123:0/1259320309 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b8072c10 con 0x7f47b815b9a0 2024-09-15T23:13:01.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.282+0000 7f47b77fe640 1 --2- 172.21.15.123:0/1259320309 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47b815b9a0 0x7f47b80b6b60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f47b80b07e0 tx=0x7f47ac02c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d84f77ed3164a1d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:01.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.282+0000 7f47b6ffd640 1 -- 172.21.15.123:0/1259320309 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac0325a0 con 0x7f47b815b9a0 2024-09-15T23:13:01.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.282+0000 7f47b6ffd640 1 -- 172.21.15.123:0/1259320309 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47ac038070 con 0x7f47b815b9a0 2024-09-15T23:13:01.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.282+0000 7f47b6ffd640 1 -- 172.21.15.123:0/1259320309 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac032960 con 0x7f47b815b9a0 2024-09-15T23:13:01.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.282+0000 7f47be778640 1 -- 172.21.15.123:0/1259320309 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47b815b9a0 msgr2=0x7f47b80b6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:01.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.282+0000 7f47be778640 1 --2- 172.21.15.123:0/1259320309 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47b815b9a0 0x7f47b80b6b60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f47b80b07e0 tx=0x7f47ac02c8e0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.282+0000 7f47be778640 1 -- 172.21.15.123:0/1259320309 shutdown_connections 2024-09-15T23:13:01.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.282+0000 7f47be778640 1 --2- 172.21.15.123:0/1259320309 >> v2:172.21.15.188:3300/0 conn(0x7f47b80b70a0 0x7f47b80cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.282+0000 7f47be778640 1 --2- 172.21.15.123:0/1259320309 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47b815b9a0 0x7f47b80b6b60 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.282+0000 7f47be778640 1 -- 172.21.15.123:0/1259320309 >> 172.21.15.123:0/1259320309 conn(0x7f47b806cd20 msgr2=0x7f47b806d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:01.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.282+0000 7f47be778640 1 -- 172.21.15.123:0/1259320309 shutdown_connections 2024-09-15T23:13:01.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.282+0000 7f47be778640 1 -- 172.21.15.123:0/1259320309 wait complete. 2024-09-15T23:13:01.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.284+0000 7f47be778640 1 Processor -- start 2024-09-15T23:13:01.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.284+0000 7f47be778640 1 -- start start 2024-09-15T23:13:01.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.284+0000 7f47be778640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47b80b70a0 0x7f47b814cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:01.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.284+0000 7f47be778640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47b8158f80 0x7f47b814eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:01.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.284+0000 7f47be778640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47b815b9a0 0x7f47b8154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:01.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.284+0000 7f47be778640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f47b80734b0 con 0x7f47b8158f80 2024-09-15T23:13:01.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.284+0000 7f47be778640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f47b80731d0 con 0x7f47b80b70a0 2024-09-15T23:13:01.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.284+0000 7f47be778640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f47b80739d0 con 0x7f47b815b9a0 2024-09-15T23:13:01.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.285+0000 7f47b77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47b8158f80 0x7f47b814eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:01.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.285+0000 7f47b77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47b8158f80 0x7f47b814eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41622/0 (socket says 172.21.15.123:41622) 2024-09-15T23:13:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.285+0000 7f47b77fe640 1 -- 172.21.15.123:0/12508264 learned_addr learned my addr 172.21.15.123:0/12508264 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:13:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.285+0000 7f47b7fff640 1 --2- 172.21.15.123:0/12508264 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47b80b70a0 0x7f47b814cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.285+0000 7f47bcd15640 1 --2- 172.21.15.123:0/12508264 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47b815b9a0 0x7f47b8154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.285+0000 7f47b77fe640 1 -- 172.21.15.123:0/12508264 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47b815b9a0 msgr2=0x7f47b8154670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.285+0000 7f47b77fe640 1 --2- 172.21.15.123:0/12508264 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47b815b9a0 0x7f47b8154670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.285+0000 7f47b77fe640 1 -- 172.21.15.123:0/12508264 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47b80b70a0 msgr2=0x7f47b814cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.285+0000 7f47b77fe640 1 --2- 172.21.15.123:0/12508264 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47b80b70a0 0x7f47b814cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.285+0000 7f47b77fe640 1 -- 172.21.15.123:0/12508264 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b814d0d0 con 0x7f47b8158f80 2024-09-15T23:13:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.285+0000 7f47b77fe640 1 --2- 172.21.15.123:0/12508264 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47b8158f80 0x7f47b814eb40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f47ac02c920 tx=0x7f47ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.285+0000 7f47b4ff9640 1 -- 172.21.15.123:0/12508264 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac033840 con 0x7f47b8158f80 2024-09-15T23:13:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.285+0000 7f47b4ff9640 1 -- 172.21.15.123:0/12508264 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47ac033a00 con 0x7f47b8158f80 2024-09-15T23:13:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.285+0000 7f47be778640 1 -- 172.21.15.123:0/12508264 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47b814f390 con 0x7f47b8158f80 2024-09-15T23:13:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.285+0000 7f47b4ff9640 1 -- 172.21.15.123:0/12508264 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac033df0 con 0x7f47b8158f80 2024-09-15T23:13:01.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.285+0000 7f47be778640 1 -- 172.21.15.123:0/12508264 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47b814f950 con 0x7f47b8158f80 2024-09-15T23:13:01.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.287+0000 7f47b4ff9640 1 -- 172.21.15.123:0/12508264 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f47ac03c3f0 con 0x7f47b8158f80 2024-09-15T23:13:01.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.287+0000 7f47b4ff9640 1 --2- 172.21.15.123:0/12508264 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f47a406c2e0 0x7f47a406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:01.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.288+0000 7f47b4ff9640 1 -- 172.21.15.123:0/12508264 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f47ac030030 con 0x7f47b8158f80 2024-09-15T23:13:01.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.288+0000 7f47b7fff640 1 --2- 172.21.15.123:0/12508264 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f47a406c2e0 0x7f47a406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:01.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.288+0000 7f47b7fff640 1 --2- 172.21.15.123:0/12508264 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f47a406c2e0 0x7f47a406e7a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f47a8007fd0 tx=0x7f47a8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:01.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.288+0000 7f47c15f0740 1 Processor -- start 2024-09-15T23:13:01.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.288+0000 7f47c15f0740 1 -- start start 2024-09-15T23:13:01.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.289+0000 7f47c15f0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e426a7e120 0x55e426a7e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:01.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.289+0000 7f47c15f0740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e426a98ae0 0x55e426a9a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:01.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.289+0000 7f47c15f0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e426a51a80 0x55e426a9a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:01.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.289+0000 7f47c15f0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55e4269b6520 con 0x55e426a7e120 2024-09-15T23:13:01.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.289+0000 7f47c15f0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55e42695e3e0 con 0x55e426a51a80 2024-09-15T23:13:01.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.289+0000 7f47c15f0740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55e4269b24e0 con 0x55e426a98ae0 2024-09-15T23:13:01.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.289+0000 7f47b7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e426a7e120 0x55e426a7e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:01.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.289+0000 7f47b7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e426a7e120 0x55e426a7e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41632/0 (socket says 172.21.15.123:41632) 2024-09-15T23:13:01.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.289+0000 7f47b7fff640 1 -- 172.21.15.123:0/1878801050 learned_addr learned my addr 172.21.15.123:0/1878801050 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:13:01.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.289+0000 7f47b77fe640 1 --2- 172.21.15.123:0/1878801050 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e426a98ae0 0x55e426a9a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:01.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.289+0000 7f47bcd15640 1 --2- 172.21.15.123:0/1878801050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e426a51a80 0x55e426a9a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:01.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.289+0000 7f47b7fff640 1 -- 172.21.15.123:0/1878801050 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e426a98ae0 msgr2=0x55e426a9a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:01.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.289+0000 7f47b7fff640 1 --2- 172.21.15.123:0/1878801050 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e426a98ae0 0x55e426a9a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.289+0000 7f47b7fff640 1 -- 172.21.15.123:0/1878801050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e426a51a80 msgr2=0x55e426a9a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:01.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.289+0000 7f47b7fff640 1 --2- 172.21.15.123:0/1878801050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e426a51a80 0x55e426a9a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.289+0000 7f47b7fff640 1 -- 172.21.15.123:0/1878801050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4269792f0 con 0x55e426a7e120 2024-09-15T23:13:01.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.289+0000 7f47bcd15640 1 --2- 172.21.15.123:0/1878801050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e426a51a80 0x55e426a9a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:13:01.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.290+0000 7f47b7fff640 1 --2- 172.21.15.123:0/1878801050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e426a7e120 0x55e426a7e500 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f47a8001e90 tx=0x7f47a8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104a49e2b94b25e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:01.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.290+0000 7f479dffb640 1 -- 172.21.15.123:0/1878801050 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a80035f0 con 0x55e426a7e120 2024-09-15T23:13:01.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.290+0000 7f479dffb640 1 -- 172.21.15.123:0/1878801050 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47a8003790 con 0x55e426a7e120 2024-09-15T23:13:01.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.290+0000 7f479dffb640 1 -- 172.21.15.123:0/1878801050 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a8003b80 con 0x55e426a7e120 2024-09-15T23:13:01.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.290+0000 7f47c15f0740 1 -- 172.21.15.123:0/1878801050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e426a7e120 msgr2=0x55e426a7e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:01.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.290+0000 7f47c15f0740 1 --2- 172.21.15.123:0/1878801050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e426a7e120 0x55e426a7e500 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f47a8001e90 tx=0x7f47a8011000 comp rx=0 tx=0).stop 2024-09-15T23:13:01.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.290+0000 7f47c15f0740 1 -- 172.21.15.123:0/1878801050 shutdown_connections 2024-09-15T23:13:01.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.290+0000 7f47c15f0740 1 --2- 172.21.15.123:0/1878801050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e426a51a80 0x55e426a9a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.290+0000 7f47c15f0740 1 --2- 172.21.15.123:0/1878801050 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e426a98ae0 0x55e426a9a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.290+0000 7f47c15f0740 1 --2- 172.21.15.123:0/1878801050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e426a7e120 0x55e426a7e500 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.290+0000 7f47c15f0740 1 -- 172.21.15.123:0/1878801050 >> 172.21.15.123:0/1878801050 conn(0x55e426a50a80 msgr2=0x55e426a98f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:01.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.290+0000 7f47c15f0740 1 -- 172.21.15.123:0/1878801050 shutdown_connections 2024-09-15T23:13:01.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.290+0000 7f47c15f0740 1 -- 172.21.15.123:0/1878801050 wait complete. 2024-09-15T23:13:01.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.291+0000 7f47c15f0740 1 -- start start 2024-09-15T23:13:01.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.291+0000 7f47c15f0740 1 Processor -- start 2024-09-15T23:13:01.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.292+0000 7f47c15f0740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e426a7e120 0x55e426aa2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:01.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.292+0000 7f47c15f0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e426a98ae0 0x55e426a7f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:01.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.292+0000 7f47c15f0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e426aad800 0x55e426a799b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:01.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.292+0000 7f47c15f0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55e426a7eee0 con 0x55e426aad800 2024-09-15T23:13:01.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.292+0000 7f47c15f0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55e42693f450 con 0x55e426a98ae0 2024-09-15T23:13:01.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.292+0000 7f47c15f0740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55e426a99770 con 0x55e426a7e120 2024-09-15T23:13:01.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.292+0000 7f47c15f0740 10 client.0 _ll_register_callbacks cb 0x55e4266c8ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:13:01.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.292+0000 7f47bcd15640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e426aad800 0x55e426a799b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:01.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.292+0000 7f47bcd15640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e426aad800 0x55e426a799b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41646/0 (socket says 172.21.15.123:41646) 2024-09-15T23:13:01.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.292+0000 7f47bcd15640 1 -- 172.21.15.123:0/888968441 learned_addr learned my addr 172.21.15.123:0/888968441 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:13:01.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.292+0000 7f47b7fff640 1 --2- 172.21.15.123:0/888968441 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e426a7e120 0x55e426aa2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:01.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.292+0000 7f47b77fe640 1 --2- 172.21.15.123:0/888968441 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e426a98ae0 0x55e426a7f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:01.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.292+0000 7f47bcd15640 1 -- 172.21.15.123:0/888968441 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e426a7e120 msgr2=0x55e426aa2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:01.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.292+0000 7f47bcd15640 1 --2- 172.21.15.123:0/888968441 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e426a7e120 0x55e426aa2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.292+0000 7f47bcd15640 1 -- 172.21.15.123:0/888968441 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e426a98ae0 msgr2=0x55e426a7f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:01.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.292+0000 7f47bcd15640 1 --2- 172.21.15.123:0/888968441 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e426a98ae0 0x55e426a7f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.292+0000 7f47bcd15640 1 -- 172.21.15.123:0/888968441 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4266c92d0 con 0x55e426aad800 2024-09-15T23:13:01.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.292+0000 7f47b77fe640 1 --2- 172.21.15.123:0/888968441 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e426a98ae0 0x55e426a7f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:13:01.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.292+0000 7f47bcd15640 1 --2- 172.21.15.123:0/888968441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e426aad800 0x55e426a799b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f47b0010a40 tx=0x7f47b0010f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=865587e71946d31c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:01.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.292+0000 7f4796ffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:13:01.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.293+0000 7f4796ffd640 1 -- 172.21.15.123:0/888968441 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b000ec00 con 0x55e426aad800 2024-09-15T23:13:01.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.293+0000 7f4796ffd640 1 -- 172.21.15.123:0/888968441 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f47b000eda0 con 0x55e426aad800 2024-09-15T23:13:01.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.293+0000 7f47c15f0740 1 -- 172.21.15.123:0/888968441 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47a8003790 con 0x55e426aad800 2024-09-15T23:13:01.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.293+0000 7f4796ffd640 1 -- 172.21.15.123:0/888968441 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f47b0024050 con 0x55e426aad800 2024-09-15T23:13:01.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.293+0000 7f47c15f0740 10 client.4983 fetch_fsmap learned FSMap version 13 2024-09-15T23:13:01.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.293+0000 7f47c15f0740 1 -- 172.21.15.123:0/888968441 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x55e4267936b0 con 0x55e426aad800 2024-09-15T23:13:01.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.293+0000 7f4796ffd640 1 -- 172.21.15.123:0/888968441 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47a8003790 con 0x55e426aad800 2024-09-15T23:13:01.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.293+0000 7f4796ffd640 1 -- 172.21.15.123:0/888968441 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 13) ==== 3502+0+0 (secure 0 0 0) 0x7f47b0027020 con 0x55e426aad800 2024-09-15T23:13:01.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.293+0000 7f47c15f0740 10 client.4983 fetch_fsmap finished waiting for FSMap version 13 2024-09-15T23:13:01.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.293+0000 7f47c15f0740 10 client.4983 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T23:13:01.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.293+0000 7f47c15f0740 20 client.4983 populate_metadata read hostname 'smithi123' 2024-09-15T23:13:01.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.293+0000 7f47c15f0740 1 --2- 172.21.15.123:0/888968441 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x55e426a52020 0x55e426a52400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:01.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.293+0000 7f47c15f0740 4 client.4983 mds_command: new command op to 4776 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:13:01.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.293+0000 7f47c15f0740 1 -- 172.21.15.123:0/888968441 --> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e4269c3c50 con 0x55e426a52020 2024-09-15T23:13:01.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.293+0000 7f47b7fff640 1 --2- 172.21.15.123:0/888968441 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x55e426a52020 0x55e426a52400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:01.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.293+0000 7f4796ffd640 10 client.4983 ms_handle_connect on v2:172.21.15.123:6834/1577644605 2024-09-15T23:13:01.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.293+0000 7f47b7fff640 1 --2- 172.21.15.123:0/888968441 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x55e426a52020 0x55e426a52400 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=199c79d3f9930f34 server_cookie=e69cf8987c99a445 in_seq=0 out_seq=0 2024-09-15T23:13:01.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.294+0000 7f4796ffd640 1 -- 172.21.15.123:0/888968441 <== mds.0 v2:172.21.15.123:6834/1577644605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e4269c3c50 con 0x55e426a52020 2024-09-15T23:13:01.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.294+0000 7f4796ffd640 10 client.4983 handle_command_reply: tid=0 2024-09-15T23:13:01.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.294+0000 7f47c15f0740 1 client.4983 shutdown 2024-09-15T23:13:01.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.294+0000 7f47c15f0740 1 -- 172.21.15.123:0/888968441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e426aad800 msgr2=0x55e426a799b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:01.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.294+0000 7f47c15f0740 1 --2- 172.21.15.123:0/888968441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e426aad800 0x55e426a799b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f47b0010a40 tx=0x7f47b0010f00 comp rx=0 tx=0).stop 2024-09-15T23:13:01.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.294+0000 7f47c15f0740 1 -- 172.21.15.123:0/888968441 shutdown_connections 2024-09-15T23:13:01.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.294+0000 7f47c15f0740 1 --2- 172.21.15.123:0/888968441 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x55e426a52020 0x55e426a52400 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.294+0000 7f47c15f0740 1 --2- 172.21.15.123:0/888968441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e426aad800 0x55e426a799b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.294+0000 7f4796ffd640 0 client.4983 ms_handle_reset on v2:172.21.15.123:6834/1577644605 2024-09-15T23:13:01.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.294+0000 7f47c15f0740 1 --2- 172.21.15.123:0/888968441 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e426a98ae0 0x55e426a7f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.294+0000 7f47c15f0740 1 --2- 172.21.15.123:0/888968441 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e426a7e120 0x55e426aa2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.294+0000 7f47c15f0740 1 -- 172.21.15.123:0/888968441 >> 172.21.15.123:0/888968441 conn(0x55e426a51a80 msgr2=0x55e426aa28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:01.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.294+0000 7f47c15f0740 1 -- 172.21.15.123:0/888968441 shutdown_connections 2024-09-15T23:13:01.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.294+0000 7f47c15f0740 1 -- 172.21.15.123:0/888968441 wait complete. 2024-09-15T23:13:01.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.295+0000 7f47c15f0740 20 client.4983 trim_cache size 0 max 16384 2024-09-15T23:13:01.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.312+0000 7f47c15f0740 1 Processor -- start 2024-09-15T23:13:01.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.312+0000 7f47c15f0740 1 -- start start 2024-09-15T23:13:01.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.313+0000 7f47c15f0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e426a52020 0x55e426aa1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:01.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.313+0000 7f47c15f0740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e426a7e120 0x55e426aa2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:01.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.313+0000 7f47c15f0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e426a98ae0 0x55e426a94ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:01.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.313+0000 7f47c15f0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f47b814e530 con 0x55e426a98ae0 2024-09-15T23:13:01.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.313+0000 7f47c15f0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f47b814d890 con 0x55e426a52020 2024-09-15T23:13:01.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.313+0000 7f47c15f0740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f47b814dee0 con 0x55e426a7e120 2024-09-15T23:13:01.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.313+0000 7f47bcd15640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e426a98ae0 0x55e426a94ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:01.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.313+0000 7f47bcd15640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e426a98ae0 0x55e426a94ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41656/0 (socket says 172.21.15.123:41656) 2024-09-15T23:13:01.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.313+0000 7f47bcd15640 1 -- 172.21.15.123:0/1657450960 learned_addr learned my addr 172.21.15.123:0/1657450960 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:13:01.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.313+0000 7f47b77fe640 1 --2- 172.21.15.123:0/1657450960 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e426a7e120 0x55e426aa2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:01.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.313+0000 7f47bcd15640 1 -- 172.21.15.123:0/1657450960 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e426a7e120 msgr2=0x55e426aa2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:01.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.313+0000 7f47b7fff640 1 --2- 172.21.15.123:0/1657450960 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e426a52020 0x55e426aa1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:01.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.313+0000 7f47bcd15640 1 --2- 172.21.15.123:0/1657450960 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e426a7e120 0x55e426aa2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.313+0000 7f47bcd15640 1 -- 172.21.15.123:0/1657450960 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e426a52020 msgr2=0x55e426aa1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:01.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.313+0000 7f47bcd15640 1 --2- 172.21.15.123:0/1657450960 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e426a52020 0x55e426aa1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.313+0000 7f47bcd15640 1 -- 172.21.15.123:0/1657450960 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e426a7e870 con 0x55e426a98ae0 2024-09-15T23:13:01.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.313+0000 7f47bcd15640 1 --2- 172.21.15.123:0/1657450960 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e426a98ae0 0x55e426a94ce0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f47b00070b0 tx=0x7f47b0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb78c785ff0712d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:01.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.314+0000 7f479d7fa640 1 -- 172.21.15.123:0/1657450960 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b002c070 con 0x55e426a98ae0 2024-09-15T23:13:01.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.314+0000 7f479d7fa640 1 -- 172.21.15.123:0/1657450960 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b0012450 con 0x55e426a98ae0 2024-09-15T23:13:01.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.314+0000 7f479d7fa640 1 -- 172.21.15.123:0/1657450960 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b000ec00 con 0x55e426a98ae0 2024-09-15T23:13:01.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.314+0000 7f47c15f0740 1 -- 172.21.15.123:0/1657450960 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e426a98ae0 msgr2=0x55e426a94ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:01.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.314+0000 7f47c15f0740 1 --2- 172.21.15.123:0/1657450960 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e426a98ae0 0x55e426a94ce0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f47b00070b0 tx=0x7f47b0016000 comp rx=0 tx=0).stop 2024-09-15T23:13:01.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.314+0000 7f47c15f0740 1 -- 172.21.15.123:0/1657450960 shutdown_connections 2024-09-15T23:13:01.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.314+0000 7f47c15f0740 1 --2- 172.21.15.123:0/1657450960 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e426a98ae0 0x55e426a94ce0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.314+0000 7f47c15f0740 1 --2- 172.21.15.123:0/1657450960 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e426a7e120 0x55e426aa2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.314+0000 7f47c15f0740 1 --2- 172.21.15.123:0/1657450960 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e426a52020 0x55e426aa1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.314+0000 7f47c15f0740 1 -- 172.21.15.123:0/1657450960 >> 172.21.15.123:0/1657450960 conn(0x55e426a51a80 msgr2=0x55e426a4a100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:01.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.314+0000 7f47c15f0740 1 -- 172.21.15.123:0/1657450960 shutdown_connections 2024-09-15T23:13:01.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.314+0000 7f47c15f0740 1 -- 172.21.15.123:0/1657450960 wait complete. 2024-09-15T23:13:01.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.315+0000 7f47c15f0740 1 -- start start 2024-09-15T23:13:01.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.315+0000 7f47c15f0740 1 Processor -- start 2024-09-15T23:13:01.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.316+0000 7f47c15f0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e426a52020 0x55e426b1b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:01.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.316+0000 7f47c15f0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e426a7e120 0x55e426aabf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:01.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.316+0000 7f47c15f0740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e426a98ae0 0x55e426aac460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:01.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.316+0000 7f47c15f0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55e426a53660 con 0x55e426a52020 2024-09-15T23:13:01.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.316+0000 7f47c15f0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55e426aadd50 con 0x55e426a7e120 2024-09-15T23:13:01.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.316+0000 7f47c15f0740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55e426a80c60 con 0x55e426a98ae0 2024-09-15T23:13:01.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.316+0000 7f47c15f0740 10 client.0 _ll_register_callbacks cb 0x7f47b0007650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:13:01.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.316+0000 7f47b7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e426a52020 0x55e426b1b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:01.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.316+0000 7f47b7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e426a52020 0x55e426b1b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41662/0 (socket says 172.21.15.123:41662) 2024-09-15T23:13:01.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.316+0000 7f47b7fff640 1 -- 172.21.15.123:0/2308099579 learned_addr learned my addr 172.21.15.123:0/2308099579 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:13:01.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.316+0000 7f47b77fe640 1 --2- 172.21.15.123:0/2308099579 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e426a7e120 0x55e426aabf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:01.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.316+0000 7f47bcd15640 1 --2- 172.21.15.123:0/2308099579 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e426a98ae0 0x55e426aac460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:01.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.316+0000 7f47b7fff640 1 -- 172.21.15.123:0/2308099579 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e426a98ae0 msgr2=0x55e426aac460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:01.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.316+0000 7f47b7fff640 1 --2- 172.21.15.123:0/2308099579 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e426a98ae0 0x55e426aac460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.316+0000 7f47b7fff640 1 -- 172.21.15.123:0/2308099579 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e426a7e120 msgr2=0x55e426aabf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:01.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.316+0000 7f47b7fff640 1 --2- 172.21.15.123:0/2308099579 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e426a7e120 0x55e426aabf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.316+0000 7f47b7fff640 1 -- 172.21.15.123:0/2308099579 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e426a52ae0 con 0x55e426a52020 2024-09-15T23:13:01.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.316+0000 7f47bcd15640 1 --2- 172.21.15.123:0/2308099579 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e426a98ae0 0x55e426aac460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:13:01.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.316+0000 7f47b7fff640 1 --2- 172.21.15.123:0/2308099579 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e426a52020 0x55e426b1b870 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009010 tx=0x7f47a8000fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e094bcbf8798465b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:01.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.316+0000 7f4796ffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:13:01.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.316+0000 7f4796ffd640 1 -- 172.21.15.123:0/2308099579 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a8003d30 con 0x55e426a52020 2024-09-15T23:13:01.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.316+0000 7f4796ffd640 1 -- 172.21.15.123:0/2308099579 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f47a802f420 con 0x55e426a52020 2024-09-15T23:13:01.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.316+0000 7f47c15f0740 1 -- 172.21.15.123:0/2308099579 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47b0012450 con 0x55e426a52020 2024-09-15T23:13:01.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.316+0000 7f4796ffd640 1 -- 172.21.15.123:0/2308099579 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f47a803d050 con 0x55e426a52020 2024-09-15T23:13:01.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.317+0000 7f47c15f0740 10 client.4989 fetch_fsmap learned FSMap version 13 2024-09-15T23:13:01.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.317+0000 7f47c15f0740 1 -- 172.21.15.123:0/2308099579 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x55e426a7ad70 con 0x55e426a52020 2024-09-15T23:13:01.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.317+0000 7f4796ffd640 1 -- 172.21.15.123:0/2308099579 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b0012450 con 0x55e426a52020 2024-09-15T23:13:01.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.317+0000 7f4796ffd640 1 -- 172.21.15.123:0/2308099579 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 13) ==== 3502+0+0 (secure 0 0 0) 0x7f47a8040020 con 0x55e426a52020 2024-09-15T23:13:01.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.317+0000 7f47c15f0740 10 client.4989 fetch_fsmap finished waiting for FSMap version 13 2024-09-15T23:13:01.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.317+0000 7f47c15f0740 10 client.4989 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T23:13:01.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.317+0000 7f47c15f0740 20 client.4989 populate_metadata read hostname 'smithi123' 2024-09-15T23:13:01.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.317+0000 7f47c15f0740 1 --2- 172.21.15.123:0/2308099579 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x55e426aad800 0x55e426a98010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:01.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.317+0000 7f47c15f0740 4 client.4989 mds_command: new command op to 4776 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:13:01.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.317+0000 7f47c15f0740 1 -- 172.21.15.123:0/2308099579 --> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] -- command(tid 0: {"prefix": "status"}) -- 0x55e426a9abb0 con 0x55e426aad800 2024-09-15T23:13:01.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.317+0000 7f47b77fe640 1 --2- 172.21.15.123:0/2308099579 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x55e426aad800 0x55e426a98010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:01.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.317+0000 7f4796ffd640 10 client.4989 ms_handle_connect on v2:172.21.15.123:6834/1577644605 2024-09-15T23:13:01.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.317+0000 7f47b77fe640 1 --2- 172.21.15.123:0/2308099579 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x55e426aad800 0x55e426a98010 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb3d7895147c28f8 server_cookie=da8a28ffdeee4aa8 in_seq=0 out_seq=0 2024-09-15T23:13:01.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.317+0000 7f4796ffd640 1 -- 172.21.15.123:0/2308099579 <== mds.0 v2:172.21.15.123:6834/1577644605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55e426a9abb0 con 0x55e426aad800 2024-09-15T23:13:01.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.317+0000 7f4796ffd640 10 client.4989 handle_command_reply: tid=0 2024-09-15T23:13:01.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.317+0000 7f47c15f0740 1 client.4989 shutdown 2024-09-15T23:13:01.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.318+0000 7f47c15f0740 1 -- 172.21.15.123:0/2308099579 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e426a52020 msgr2=0x55e426b1b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:01.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.318+0000 7f47c15f0740 1 --2- 172.21.15.123:0/2308099579 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e426a52020 0x55e426b1b870 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009010 tx=0x7f47a8000fb0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.318+0000 7f47c15f0740 1 -- 172.21.15.123:0/2308099579 shutdown_connections 2024-09-15T23:13:01.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.318+0000 7f47c15f0740 1 --2- 172.21.15.123:0/2308099579 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e426a98ae0 0x55e426aac460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.318+0000 7f47c15f0740 1 --2- 172.21.15.123:0/2308099579 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e426a7e120 0x55e426aabf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.318+0000 7f47c15f0740 1 --2- 172.21.15.123:0/2308099579 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x55e426aad800 0x55e426a98010 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.318+0000 7f47c15f0740 1 --2- 172.21.15.123:0/2308099579 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e426a52020 0x55e426b1b870 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.318+0000 7f47c15f0740 1 -- 172.21.15.123:0/2308099579 >> 172.21.15.123:0/2308099579 conn(0x55e426a51a80 msgr2=0x55e426a9c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:01.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.318+0000 7f4796ffd640 0 client.4989 ms_handle_reset on v2:172.21.15.123:6834/1577644605 2024-09-15T23:13:01.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.318+0000 7f47c15f0740 1 -- 172.21.15.123:0/2308099579 shutdown_connections 2024-09-15T23:13:01.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.318+0000 7f47c15f0740 1 -- 172.21.15.123:0/2308099579 wait complete. 2024-09-15T23:13:01.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.318+0000 7f47c15f0740 20 client.4989 trim_cache size 0 max 16384 2024-09-15T23:13:01.326 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:13:01.326 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "cb968ac4-8d3a-4b17-a673-6177aeaea589", 2024-09-15T23:13:01.326 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2024-09-15T23:13:01.326 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 4776, 2024-09-15T23:13:01.326 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-09-15T23:13:01.327 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-09-15T23:13:01.327 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-09-15T23:13:01.327 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 8.8733539409999995, 2024-09-15T23:13:01.327 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 13, 2024-09-15T23:13:01.327 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 33, 2024-09-15T23:13:01.327 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 33, 2024-09-15T23:13:01.327 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 15.764627592 2024-09-15T23:13:01.327 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:13:01.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.318+0000 7f47be778640 1 -- 172.21.15.123:0/12508264 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f47a406c2e0 msgr2=0x7f47a406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:01.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.318+0000 7f47be778640 1 --2- 172.21.15.123:0/12508264 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f47a406c2e0 0x7f47a406e7a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f47a8007fd0 tx=0x7f47a8009040 comp rx=0 tx=0).stop 2024-09-15T23:13:01.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.318+0000 7f47be778640 1 -- 172.21.15.123:0/12508264 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47b8158f80 msgr2=0x7f47b814eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:01.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.318+0000 7f47be778640 1 --2- 172.21.15.123:0/12508264 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47b8158f80 0x7f47b814eb40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f47ac02c920 tx=0x7f47ac0046c0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.318+0000 7f47be778640 1 -- 172.21.15.123:0/12508264 shutdown_connections 2024-09-15T23:13:01.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.318+0000 7f47be778640 1 --2- 172.21.15.123:0/12508264 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47b815b9a0 0x7f47b8154670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.318+0000 7f47be778640 1 --2- 172.21.15.123:0/12508264 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f47a406c2e0 0x7f47a406e7a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.318+0000 7f47be778640 1 --2- 172.21.15.123:0/12508264 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47b8158f80 0x7f47b814eb40 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.318+0000 7f47be778640 1 --2- 172.21.15.123:0/12508264 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f47b80b70a0 0x7f47b814cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.318+0000 7f47be778640 1 -- 172.21.15.123:0/12508264 >> 172.21.15.123:0/12508264 conn(0x7f47b806cd20 msgr2=0x7f47b806d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:01.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.318+0000 7f47be778640 1 -- 172.21.15.123:0/12508264 shutdown_connections 2024-09-15T23:13:01.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.318+0000 7f47be778640 1 -- 172.21.15.123:0/12508264 wait complete. 2024-09-15T23:13:01.330 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:13:01.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.427+0000 7f51da7c4640 1 Processor -- start 2024-09-15T23:13:01.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.427+0000 7f51da7c4640 1 -- start start 2024-09-15T23:13:01.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.428+0000 7f51da7c4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f51d415e6d0 0x7f51d4071390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:01.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.428+0000 7f51da7c4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f51d406cd20 0x7f51d40b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:01.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.428+0000 7f51da7c4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51d415eab0 con 0x7f51d4070b80 2024-09-15T23:13:01.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.428+0000 7f51da7c4640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f51d415ed70 con 0x7f51d406cd20 2024-09-15T23:13:01.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.428+0000 7f51da7c4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f51d415f050 con 0x7f51d415e6d0 2024-09-15T23:13:01.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.428+0000 7f51d37fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f51d406cd20 0x7f51d40b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:01.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.428+0000 7f51d8d61640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f51d4070b80 0x7f51d40731a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38360/0 (socket says 172.21.15.123:38360) 2024-09-15T23:13:01.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.428+0000 7f51d8d61640 1 -- 172.21.15.123:0/828669859 learned_addr learned my addr 172.21.15.123:0/828669859 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:13:01.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.428+0000 7f51d3fff640 1 --2- 172.21.15.123:0/828669859 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f51d415e6d0 0x7f51d4071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:01.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.428+0000 7f51d37fe640 1 -- 172.21.15.123:0/828669859 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f51d415e6d0 msgr2=0x7f51d4071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:01.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.428+0000 7f51d37fe640 1 --2- 172.21.15.123:0/828669859 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f51d415e6d0 0x7f51d4071390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.429+0000 7f51d37fe640 1 -- 172.21.15.123:0/828669859 >> v1:172.21.15.123:6789/0 conn(0x7f51d4070b80 legacy=0x7f51d40731a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:01.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.429+0000 7f51d37fe640 1 -- 172.21.15.123:0/828669859 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51d415f330 con 0x7f51d406cd20 2024-09-15T23:13:01.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.429+0000 7f51d2ffd640 1 -- 172.21.15.123:0/828669859 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1303266752 0 0) 0x7f51d415eab0 con 0x7f51d4070b80 2024-09-15T23:13:01.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.429+0000 7f51d37fe640 1 --2- 172.21.15.123:0/828669859 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51d406cd20 0x7f51d40b6d60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f51c80097a0 tx=0x7f51c802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c3a4f067f4d972c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:01.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.429+0000 7f51d2ffd640 1 -- 172.21.15.123:0/828669859 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c8037070 con 0x7f51d406cd20 2024-09-15T23:13:01.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.429+0000 7f51d2ffd640 1 -- 172.21.15.123:0/828669859 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51c8032440 con 0x7f51d406cd20 2024-09-15T23:13:01.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.429+0000 7f51d2ffd640 1 -- 172.21.15.123:0/828669859 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c8032810 con 0x7f51d406cd20 2024-09-15T23:13:01.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.430+0000 7f51da7c4640 1 -- 172.21.15.123:0/828669859 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51d406cd20 msgr2=0x7f51d40b6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:01.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.430+0000 7f51da7c4640 1 --2- 172.21.15.123:0/828669859 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51d406cd20 0x7f51d40b6d60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f51c80097a0 tx=0x7f51c802a180 comp rx=0 tx=0).stop 2024-09-15T23:13:01.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.430+0000 7f51da7c4640 1 -- 172.21.15.123:0/828669859 shutdown_connections 2024-09-15T23:13:01.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.430+0000 7f51da7c4640 1 --2- 172.21.15.123:0/828669859 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51d406cd20 0x7f51d40b6d60 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.430+0000 7f51da7c4640 1 --2- 172.21.15.123:0/828669859 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f51d415e6d0 0x7f51d4071390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.430+0000 7f51da7c4640 1 -- 172.21.15.123:0/828669859 >> 172.21.15.123:0/828669859 conn(0x7f51d4067fb0 msgr2=0x7f51d406f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:01.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.430+0000 7f51da7c4640 1 -- 172.21.15.123:0/828669859 shutdown_connections 2024-09-15T23:13:01.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.430+0000 7f51da7c4640 1 -- 172.21.15.123:0/828669859 wait complete. 2024-09-15T23:13:01.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.431+0000 7f51da7c4640 1 Processor -- start 2024-09-15T23:13:01.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.431+0000 7f51da7c4640 1 -- start start 2024-09-15T23:13:01.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.432+0000 7f51da7c4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51d406cd20 0x7f51d41f4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:01.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.432+0000 7f51da7c4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f51d4070b80 0x7f51d414f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:01.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.432+0000 7f51da7c4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51d415e6d0 0x7f51d4152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:01.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.432+0000 7f51da7c4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f51d40718d0 con 0x7f51d406cd20 2024-09-15T23:13:01.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.432+0000 7f51da7c4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f51d415f8f0 con 0x7f51d415e6d0 2024-09-15T23:13:01.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.432+0000 7f51da7c4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f51d4071a50 con 0x7f51d4070b80 2024-09-15T23:13:01.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.432+0000 7f51d3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51d406cd20 0x7f51d41f4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:01.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.432+0000 7f51d3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51d406cd20 0x7f51d41f4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41690/0 (socket says 172.21.15.123:41690) 2024-09-15T23:13:01.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.432+0000 7f51d3fff640 1 -- 172.21.15.123:0/2812255187 learned_addr learned my addr 172.21.15.123:0/2812255187 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:13:01.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.432+0000 7f51d37fe640 1 --2- 172.21.15.123:0/2812255187 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f51d4070b80 0x7f51d414f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:01.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.432+0000 7f51d3fff640 1 -- 172.21.15.123:0/2812255187 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f51d4070b80 msgr2=0x7f51d414f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:01.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.432+0000 7f51d3fff640 1 --2- 172.21.15.123:0/2812255187 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f51d4070b80 0x7f51d414f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.432+0000 7f51d8d61640 1 --2- 172.21.15.123:0/2812255187 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51d415e6d0 0x7f51d4152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:01.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.432+0000 7f51d3fff640 1 -- 172.21.15.123:0/2812255187 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51d415e6d0 msgr2=0x7f51d4152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:01.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.432+0000 7f51d3fff640 1 --2- 172.21.15.123:0/2812255187 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51d415e6d0 0x7f51d4152a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.432+0000 7f51d3fff640 1 -- 172.21.15.123:0/2812255187 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51d4153650 con 0x7f51d406cd20 2024-09-15T23:13:01.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.433+0000 7f51d3fff640 1 --2- 172.21.15.123:0/2812255187 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51d406cd20 0x7f51d41f4110 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f51c400d800 tx=0x7f51c400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:01.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.433+0000 7f51d0ff9640 1 -- 172.21.15.123:0/2812255187 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c400b6c0 con 0x7f51d406cd20 2024-09-15T23:13:01.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.433+0000 7f51d0ff9640 1 -- 172.21.15.123:0/2812255187 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51c4019070 con 0x7f51d406cd20 2024-09-15T23:13:01.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.433+0000 7f51da7c4640 1 -- 172.21.15.123:0/2812255187 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51d414fb40 con 0x7f51d406cd20 2024-09-15T23:13:01.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.433+0000 7f51d0ff9640 1 -- 172.21.15.123:0/2812255187 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c400ba80 con 0x7f51d406cd20 2024-09-15T23:13:01.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.433+0000 7f51da7c4640 1 -- 172.21.15.123:0/2812255187 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51d40b3a10 con 0x7f51d406cd20 2024-09-15T23:13:01.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.434+0000 7f51da7c4640 1 -- 172.21.15.123:0/2812255187 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51d4071390 con 0x7f51d406cd20 2024-09-15T23:13:01.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.434+0000 7f51d0ff9640 1 -- 172.21.15.123:0/2812255187 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f51c400bc20 con 0x7f51d406cd20 2024-09-15T23:13:01.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.435+0000 7f51d0ff9640 1 --2- 172.21.15.123:0/2812255187 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f51c006c2b0 0x7f51c006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:01.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.435+0000 7f51d0ff9640 1 -- 172.21.15.123:0/2812255187 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f51c408b8e0 con 0x7f51d406cd20 2024-09-15T23:13:01.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.435+0000 7f51d37fe640 1 --2- 172.21.15.123:0/2812255187 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f51c006c2b0 0x7f51c006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:01.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.435+0000 7f51d37fe640 1 --2- 172.21.15.123:0/2812255187 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f51c006c2b0 0x7f51c006e770 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f51c8034000 tx=0x7f51c802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:01.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.439+0000 7f51d0ff9640 1 -- 172.21.15.123:0/2812255187 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f51c405a050 con 0x7f51d406cd20 2024-09-15T23:13:01.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.640+0000 7f51da7c4640 1 -- 172.21.15.123:0/2812255187 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f51d406d250 con 0x7f51d406cd20 2024-09-15T23:13:01.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.640+0000 7f51d0ff9640 1 -- 172.21.15.123:0/2812255187 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) ==== 53+0+73 (secure 0 0 0) 0x7f51c4059950 con 0x7f51d406cd20 2024-09-15T23:13:01.642 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:13:01.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.642+0000 7f51da7c4640 1 -- 172.21.15.123:0/2812255187 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f51c006c2b0 msgr2=0x7f51c006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:01.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.642+0000 7f51da7c4640 1 --2- 172.21.15.123:0/2812255187 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f51c006c2b0 0x7f51c006e770 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f51c8034000 tx=0x7f51c802e000 comp rx=0 tx=0).stop 2024-09-15T23:13:01.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.642+0000 7f51da7c4640 1 -- 172.21.15.123:0/2812255187 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51d406cd20 msgr2=0x7f51d41f4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:01.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.642+0000 7f51da7c4640 1 --2- 172.21.15.123:0/2812255187 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51d406cd20 0x7f51d41f4110 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f51c400d800 tx=0x7f51c400dcc0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.642+0000 7f51da7c4640 1 -- 172.21.15.123:0/2812255187 shutdown_connections 2024-09-15T23:13:01.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.642+0000 7f51da7c4640 1 --2- 172.21.15.123:0/2812255187 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51d415e6d0 0x7f51d4152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.642+0000 7f51da7c4640 1 --2- 172.21.15.123:0/2812255187 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f51d4070b80 0x7f51d414f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.642+0000 7f51da7c4640 1 --2- 172.21.15.123:0/2812255187 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f51c006c2b0 0x7f51c006e770 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.642+0000 7f51da7c4640 1 --2- 172.21.15.123:0/2812255187 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51d406cd20 0x7f51d41f4110 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:01.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.642+0000 7f51da7c4640 1 -- 172.21.15.123:0/2812255187 >> 172.21.15.123:0/2812255187 conn(0x7f51d4067fb0 msgr2=0x7f51d41505c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:01.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.642+0000 7f51da7c4640 1 -- 172.21.15.123:0/2812255187 shutdown_connections 2024-09-15T23:13:01.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01.642+0000 7f51da7c4640 1 -- 172.21.15.123:0/2812255187 wait complete. 2024-09-15T23:13:01.654 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T23:13:01.654 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:13:01.654 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-09-15T23:13:01.654 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T23:13:01.654 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T23:13:01.654 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T23:13:01.654 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T23:13:01.654 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:13:01.655 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:13:01.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:13:01.655 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-09-15T23:13:01.671 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:13:01.671 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:13:01.671 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:13:01.671 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:13:01.671 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-09-15T23:13:01.671 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:13:01.671 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:13:01.671 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-09-15T23:13:01.671 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f0 2024-09-15T23:13:01.671 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:13:01.671 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:13:01.671 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f1 2024-09-15T23:13:01.672 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:13:01.672 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:13:01.672 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:13:01.672 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:13:01.672 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T23:13:01.672 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42759sec preferred_lft 42759sec 2024-09-15T23:13:01.672 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link noprefixroute 2024-09-15T23:13:01.672 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:13:01.672 INFO:teuthology.orchestra.run.smithi123.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:13:01.672 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 46:55:5a:e0:32:4d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:13:01.672 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:13:01.672 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:13:01.673 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::1c6f:d5ff:fe19:ff05/64 scope link 2024-09-15T23:13:01.673 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:13:01.673 INFO:teuthology.orchestra.run.smithi123.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:13:01.673 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 46:55:5a:e0:32:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:13:01.673 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::4455:5aff:fee0:324d/64 scope link 2024-09-15T23:13:01.673 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:13:01.673 INFO:teuthology.orchestra.run.smithi123.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:13:01.673 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether be:c1:f3:63:cb:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:13:01.673 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::bcc1:f3ff:fe63:cb24/64 scope link 2024-09-15T23:13:01.673 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:13:01.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:13:01.674 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:13:01.734 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-09-15T23:13:01.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:13:01.736 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-09-15T23:13:01.793 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-09-15T23:13:01.793 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:13:01.793 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:13:01.793 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:13:01.794 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:13:01.794 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:13:01.794 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:13:01.794 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:13:01.794 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:13:01.794 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:13:01.794 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:13:01.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:13:01.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:13:01.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:13:01.921 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-09-15T23:13:01.937 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T23:13:01.937 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:13:01.938 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:13:01.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:13:01.938 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2024-09-15T23:13:02.003 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:13:02.003 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T23:13:02.060 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:13:02.060 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:13:02.060 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:13:02.115 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T23:13:02.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:13:02.116 DEBUG:teuthology.orchestra.run.smithi123:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:13:02.200 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:13:02.200 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:13:02.200 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:13:02.209 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:13:02.209 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:13:02.209 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:13:02.209 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.188:3300,172.21.15.188:3301" 2024-09-15T23:13:02.209 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T23:13:02.214 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:13:02.214 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:13:02.214 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:13:02.214 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.188:3300,172.21.15.188:3301" 2024-09-15T23:13:02.214 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T23:13:02.214 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:6789,172.21.15.188:6789,172.21.15.188:6790" 2024-09-15T23:13:02.214 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.123:6789,172.21.15.188:6789,172.21.15.188:6790:/ 2024-09-15T23:13:02.214 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=cb968ac4-8d3a-4b17-a673-6177aeaea589" will pass to kernel 2024-09-15T23:13:02.215 INFO:teuthology.orchestra.run.smithi123.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-15T23:13:02.215 INFO:teuthology.orchestra.run.smithi123.stdout: You just mounted a file system that supports labels which does not 2024-09-15T23:13:02.215 INFO:teuthology.orchestra.run.smithi123.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T23:13:02.215 INFO:teuthology.orchestra.run.smithi123.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T23:13:02.215 INFO:teuthology.orchestra.run.smithi123.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T23:13:02.216 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T23:13:02.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:13:02.217 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:13:02.241 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T23:13:02.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:13:02.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:13:02.341 INFO:teuthology.orchestra.run.smithi123.stdout:client5001 2024-09-15T23:13:02.342 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:13:02.342 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:13:02.358 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2024-09-15T23:13:02.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.500+0000 7fc44be8d640 1 Processor -- start 2024-09-15T23:13:02.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.500+0000 7fc44be8d640 1 -- start start 2024-09-15T23:13:02.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.501+0000 7fc44be8d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc44406db30 0x7fc444072920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:02.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.501+0000 7fc44be8d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc444072e60 0x7fc44415cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:02.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.501+0000 7fc44be8d640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc44415a500 con 0x7fc44415a120 2024-09-15T23:13:02.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.501+0000 7fc44be8d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fc4440ce960 con 0x7fc444072e60 2024-09-15T23:13:02.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.501+0000 7fc44be8d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc44406df70 con 0x7fc44406db30 2024-09-15T23:13:02.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.501+0000 7fc449428640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc44406db30 0x7fc444072920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:02.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.501+0000 7fc44a42a640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc444072e60 0x7fc44415cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:02.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.501+0000 7fc449428640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc44406db30 0x7fc444072920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:38142/0 (socket says 172.21.15.123:38142) 2024-09-15T23:13:02.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.501+0000 7fc449428640 1 -- 172.21.15.123:0/1391776426 learned_addr learned my addr 172.21.15.123:0/1391776426 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:13:02.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.501+0000 7fc449428640 1 -- 172.21.15.123:0/1391776426 >> v2:172.21.15.188:3300/0 conn(0x7fc444072e60 msgr2=0x7fc44415cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:02.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.501+0000 7fc449428640 1 --2- 172.21.15.123:0/1391776426 >> v2:172.21.15.188:3300/0 conn(0x7fc444072e60 0x7fc44415cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:02.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.501+0000 7fc449428640 1 -- 172.21.15.123:0/1391776426 >> v1:172.21.15.188:6789/0 conn(0x7fc44415a120 legacy=0x7fc44406fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:02.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.502+0000 7fc449428640 1 -- 172.21.15.123:0/1391776426 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44406d510 con 0x7fc44406db30 2024-09-15T23:13:02.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.502+0000 7fc44a42a640 1 --2- 172.21.15.123:0/1391776426 >> v2:172.21.15.188:3300/0 conn(0x7fc444072e60 0x7fc44415cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:13:02.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.502+0000 7fc449428640 1 --2- 172.21.15.123:0/1391776426 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc44406db30 0x7fc444072920 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc434009870 tx=0x7fc43402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86f50604e4eaa26c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:02.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.502+0000 7fc448c27640 1 -- 172.21.15.123:0/1391776426 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc434037070 con 0x7fc44406db30 2024-09-15T23:13:02.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.502+0000 7fc448c27640 1 -- 172.21.15.123:0/1391776426 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc434032440 con 0x7fc44406db30 2024-09-15T23:13:02.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.502+0000 7fc448c27640 1 -- 172.21.15.123:0/1391776426 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc434032810 con 0x7fc44406db30 2024-09-15T23:13:02.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.503+0000 7fc44be8d640 1 -- 172.21.15.123:0/1391776426 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc44406db30 msgr2=0x7fc444072920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:02.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.503+0000 7fc44be8d640 1 --2- 172.21.15.123:0/1391776426 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc44406db30 0x7fc444072920 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc434009870 tx=0x7fc43402a270 comp rx=0 tx=0).stop 2024-09-15T23:13:02.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.503+0000 7fc44be8d640 1 -- 172.21.15.123:0/1391776426 shutdown_connections 2024-09-15T23:13:02.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.503+0000 7fc44be8d640 1 --2- 172.21.15.123:0/1391776426 >> v2:172.21.15.188:3300/0 conn(0x7fc444072e60 0x7fc44415cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:02.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.503+0000 7fc44be8d640 1 --2- 172.21.15.123:0/1391776426 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc44406db30 0x7fc444072920 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:02.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.503+0000 7fc44be8d640 1 -- 172.21.15.123:0/1391776426 >> 172.21.15.123:0/1391776426 conn(0x7fc44406c030 msgr2=0x7fc44406c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:02.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.503+0000 7fc44be8d640 1 -- 172.21.15.123:0/1391776426 shutdown_connections 2024-09-15T23:13:02.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.503+0000 7fc44be8d640 1 -- 172.21.15.123:0/1391776426 wait complete. 2024-09-15T23:13:02.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.504+0000 7fc44be8d640 1 Processor -- start 2024-09-15T23:13:02.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.504+0000 7fc44be8d640 1 -- start start 2024-09-15T23:13:02.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.505+0000 7fc44be8d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc44406db30 0x7fc444158150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:02.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.505+0000 7fc44be8d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc444072e60 0x7fc44414b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:02.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.505+0000 7fc44be8d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc44415a120 0x7fc44415f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:02.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.505+0000 7fc44be8d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc4440ce5f0 con 0x7fc444072e60 2024-09-15T23:13:02.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.505+0000 7fc44be8d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc4440ce350 con 0x7fc44406db30 2024-09-15T23:13:02.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.505+0000 7fc44be8d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc4440b08e0 con 0x7fc44415a120 2024-09-15T23:13:02.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.505+0000 7fc449428640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc444072e60 0x7fc44414b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:02.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.505+0000 7fc449428640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc444072e60 0x7fc44414b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41692/0 (socket says 172.21.15.123:41692) 2024-09-15T23:13:02.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.505+0000 7fc449428640 1 -- 172.21.15.123:0/3242416618 learned_addr learned my addr 172.21.15.123:0/3242416618 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:13:02.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.505+0000 7fc44a42a640 1 --2- 172.21.15.123:0/3242416618 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc44415a120 0x7fc44415f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:02.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.505+0000 7fc449c29640 1 --2- 172.21.15.123:0/3242416618 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc44406db30 0x7fc444158150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:02.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.505+0000 7fc449428640 1 -- 172.21.15.123:0/3242416618 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc44415a120 msgr2=0x7fc44415f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:02.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.505+0000 7fc449428640 1 --2- 172.21.15.123:0/3242416618 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc44415a120 0x7fc44415f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:02.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.505+0000 7fc449428640 1 -- 172.21.15.123:0/3242416618 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc44406db30 msgr2=0x7fc444158150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:02.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.505+0000 7fc449428640 1 --2- 172.21.15.123:0/3242416618 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc44406db30 0x7fc444158150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:02.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.505+0000 7fc449428640 1 -- 172.21.15.123:0/3242416618 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4441587e0 con 0x7fc444072e60 2024-09-15T23:13:02.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.506+0000 7fc449428640 1 --2- 172.21.15.123:0/3242416618 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc444072e60 0x7fc44414b890 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc434009870 tx=0x7fc4340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:02.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.506+0000 7fc43a7fc640 1 -- 172.21.15.123:0/3242416618 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc434041070 con 0x7fc444072e60 2024-09-15T23:13:02.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.506+0000 7fc43a7fc640 1 -- 172.21.15.123:0/3242416618 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc43403c890 con 0x7fc444072e60 2024-09-15T23:13:02.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.506+0000 7fc43a7fc640 1 -- 172.21.15.123:0/3242416618 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc434037040 con 0x7fc444072e60 2024-09-15T23:13:02.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.506+0000 7fc44be8d640 1 -- 172.21.15.123:0/3242416618 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc444158ac0 con 0x7fc444072e60 2024-09-15T23:13:02.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.506+0000 7fc44be8d640 1 -- 172.21.15.123:0/3242416618 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc44415d1c0 con 0x7fc444072e60 2024-09-15T23:13:02.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.507+0000 7fc44be8d640 1 -- 172.21.15.123:0/3242416618 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4440b0220 con 0x7fc444072e60 2024-09-15T23:13:02.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.507+0000 7fc43a7fc640 1 -- 172.21.15.123:0/3242416618 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc434044070 con 0x7fc444072e60 2024-09-15T23:13:02.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.508+0000 7fc43a7fc640 1 --2- 172.21.15.123:0/3242416618 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc42806c2b0 0x7fc42806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:02.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.508+0000 7fc43a7fc640 1 -- 172.21.15.123:0/3242416618 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fc4340abdc0 con 0x7fc444072e60 2024-09-15T23:13:02.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.508+0000 7fc449c29640 1 --2- 172.21.15.123:0/3242416618 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc42806c2b0 0x7fc42806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:02.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.508+0000 7fc449c29640 1 --2- 172.21.15.123:0/3242416618 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc42806c2b0 0x7fc42806e770 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc4441f7ce0 tx=0x7fc440009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:02.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.512+0000 7fc43a7fc640 1 -- 172.21.15.123:0/3242416618 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc43407a090 con 0x7fc444072e60 2024-09-15T23:13:02.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:02.713+0000 7fc44be8d640 1 -- 172.21.15.123:0/3242416618 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fc44415fcf0 con 0x7fc444072e60 2024-09-15T23:13:03.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:03.578+0000 7fc43a7fc640 1 -- 172.21.15.123:0/3242416618 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v14) ==== 167+0+0 (secure 0 0 0) 0x7fc43407e390 con 0x7fc444072e60 2024-09-15T23:13:03.579 INFO:teuthology.orchestra.run.smithi123.stderr:enabled new snapshots 2024-09-15T23:13:03.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:03.580+0000 7fc44be8d640 1 -- 172.21.15.123:0/3242416618 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc42806c2b0 msgr2=0x7fc42806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:03.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:03.580+0000 7fc44be8d640 1 --2- 172.21.15.123:0/3242416618 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc42806c2b0 0x7fc42806e770 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc4441f7ce0 tx=0x7fc440009040 comp rx=0 tx=0).stop 2024-09-15T23:13:03.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:03.580+0000 7fc44be8d640 1 -- 172.21.15.123:0/3242416618 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc444072e60 msgr2=0x7fc44414b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:03.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:03.580+0000 7fc44be8d640 1 --2- 172.21.15.123:0/3242416618 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc444072e60 0x7fc44414b890 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc434009870 tx=0x7fc4340046c0 comp rx=0 tx=0).stop 2024-09-15T23:13:03.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:03.580+0000 7fc44be8d640 1 -- 172.21.15.123:0/3242416618 shutdown_connections 2024-09-15T23:13:03.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:03.580+0000 7fc44be8d640 1 --2- 172.21.15.123:0/3242416618 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc44415a120 0x7fc44415f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:03.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:03.580+0000 7fc44be8d640 1 --2- 172.21.15.123:0/3242416618 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc42806c2b0 0x7fc42806e770 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:03.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:03.580+0000 7fc44be8d640 1 --2- 172.21.15.123:0/3242416618 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc444072e60 0x7fc44414b890 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:03.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:03.580+0000 7fc44be8d640 1 --2- 172.21.15.123:0/3242416618 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc44406db30 0x7fc444158150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:03.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:03.580+0000 7fc44be8d640 1 -- 172.21.15.123:0/3242416618 >> 172.21.15.123:0/3242416618 conn(0x7fc44406c030 msgr2=0x7fc4440b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:03.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:03.581+0000 7fc44be8d640 1 -- 172.21.15.123:0/3242416618 shutdown_connections 2024-09-15T23:13:03.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:03.581+0000 7fc44be8d640 1 -- 172.21.15.123:0/3242416618 wait complete. 2024-09-15T23:13:03.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:13:03.593 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir stray_eval_dir) 2024-09-15T23:13:03.614 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:13:03.615 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:13:03.671 DEBUG:teuthology.orchestra.run.smithi123:> stdin-killer -- python3 -c ' 2024-09-15T23:13:03.671 DEBUG:teuthology.orchestra.run.smithi123:> import os 2024-09-15T23:13:03.672 DEBUG:teuthology.orchestra.run.smithi123:> import uuid 2024-09-15T23:13:03.672 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-15T23:13:03.672 DEBUG:teuthology.orchestra.run.smithi123:> n = 2000 2024-09-15T23:13:03.672 DEBUG:teuthology.orchestra.run.smithi123:> create_hard_links = False 2024-09-15T23:13:03.672 DEBUG:teuthology.orchestra.run.smithi123:> if 3 > 0: 2024-09-15T23:13:03.672 DEBUG:teuthology.orchestra.run.smithi123:> create_hard_links = True 2024-09-15T23:13:03.672 DEBUG:teuthology.orchestra.run.smithi123:> path = "/home/ubuntu/cephtest/mnt.0/stray_eval_dir/file" 2024-09-15T23:13:03.672 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-15T23:13:03.672 DEBUG:teuthology.orchestra.run.smithi123:> dpath = os.path.dirname(path) 2024-09-15T23:13:03.672 DEBUG:teuthology.orchestra.run.smithi123:> fnameprefix = os.path.basename(path) 2024-09-15T23:13:03.672 DEBUG:teuthology.orchestra.run.smithi123:> os.makedirs(dpath, exist_ok=True) 2024-09-15T23:13:03.672 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-15T23:13:03.672 DEBUG:teuthology.orchestra.run.smithi123:> try: 2024-09-15T23:13:03.672 DEBUG:teuthology.orchestra.run.smithi123:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-15T23:13:03.672 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-15T23:13:03.673 DEBUG:teuthology.orchestra.run.smithi123:> for i in range(n): 2024-09-15T23:13:03.673 DEBUG:teuthology.orchestra.run.smithi123:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-15T23:13:03.673 DEBUG:teuthology.orchestra.run.smithi123:> with open(fpath, '"'"'w'"'"') as f: 2024-09-15T23:13:03.673 DEBUG:teuthology.orchestra.run.smithi123:> f.write(f"{i}") 2024-09-15T23:13:03.673 DEBUG:teuthology.orchestra.run.smithi123:> if False: 2024-09-15T23:13:03.673 DEBUG:teuthology.orchestra.run.smithi123:> f.flush() 2024-09-15T23:13:03.673 DEBUG:teuthology.orchestra.run.smithi123:> os.fsync(f.fileno()) 2024-09-15T23:13:03.673 DEBUG:teuthology.orchestra.run.smithi123:> if False: 2024-09-15T23:13:03.673 DEBUG:teuthology.orchestra.run.smithi123:> os.unlink(fpath) 2024-09-15T23:13:03.673 DEBUG:teuthology.orchestra.run.smithi123:> if False: 2024-09-15T23:13:03.673 DEBUG:teuthology.orchestra.run.smithi123:> os.fsync(dirfd) 2024-09-15T23:13:03.673 DEBUG:teuthology.orchestra.run.smithi123:> if create_hard_links: 2024-09-15T23:13:03.673 DEBUG:teuthology.orchestra.run.smithi123:> for j in range(3): 2024-09-15T23:13:03.673 DEBUG:teuthology.orchestra.run.smithi123:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-15T23:13:03.674 DEBUG:teuthology.orchestra.run.smithi123:> if False: 2024-09-15T23:13:03.674 DEBUG:teuthology.orchestra.run.smithi123:> os.fsync(dirfd) 2024-09-15T23:13:03.674 DEBUG:teuthology.orchestra.run.smithi123:> finally: 2024-09-15T23:13:03.674 DEBUG:teuthology.orchestra.run.smithi123:> os.close(dirfd) 2024-09-15T23:13:03.674 DEBUG:teuthology.orchestra.run.smithi123:> ' 2024-09-15T23:13:07.293 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:13:07.295 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:13:22.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:13:22.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:13:22.945 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-09-15T23:13:23.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:13:23.226 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec find /home/ubuntu/cephtest/mnt.0/stray_eval_dir/ -type f -delete) 2024-09-15T23:13:37.421 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:13:37.424 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:13:49.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:13:49.660 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-09-15T23:13:49.747 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 perf dump 2024-09-15T23:13:49.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.846+0000 7fae1d198640 1 Processor -- start 2024-09-15T23:13:49.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.846+0000 7fae1d198640 1 -- start start 2024-09-15T23:13:49.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.847+0000 7fae1d198640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fae1815ea80 0x7fae180d3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:49.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.847+0000 7fae1d198640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fae180b6d30 0x7fae180b7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:49.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.847+0000 7fae1d198640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae180d2c80 con 0x7fae180d4390 2024-09-15T23:13:49.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.847+0000 7fae1d198640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fae180d2f60 con 0x7fae1815ea80 2024-09-15T23:13:49.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.847+0000 7fae1d198640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fae180d3240 con 0x7fae180b6d30 2024-09-15T23:13:49.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.847+0000 7fae16d9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fae1815ea80 0x7fae180d3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:49.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.847+0000 7fae16d9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fae1815ea80 0x7fae180d3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47328/0 (socket says 172.21.15.123:47328) 2024-09-15T23:13:49.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.847+0000 7fae16d9d640 1 -- 172.21.15.123:0/1594590729 learned_addr learned my addr 172.21.15.123:0/1594590729 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:13:49.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.847+0000 7fae1759e640 1 --2- 172.21.15.123:0/1594590729 >> v2:172.21.15.188:3300/0 conn(0x7fae180b6d30 0x7fae180b7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:49.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.848+0000 7fae16d9d640 1 -- 172.21.15.123:0/1594590729 >> v2:172.21.15.188:3300/0 conn(0x7fae180b6d30 msgr2=0x7fae180b7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:49.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.848+0000 7fae16d9d640 1 --2- 172.21.15.123:0/1594590729 >> v2:172.21.15.188:3300/0 conn(0x7fae180b6d30 0x7fae180b7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.848+0000 7fae16d9d640 1 -- 172.21.15.123:0/1594590729 >> v1:172.21.15.188:6789/0 conn(0x7fae180d4390 legacy=0x7fae180b6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:49.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.848+0000 7fae16d9d640 1 -- 172.21.15.123:0/1594590729 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae180d3520 con 0x7fae1815ea80 2024-09-15T23:13:49.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.848+0000 7fae16d9d640 1 --2- 172.21.15.123:0/1594590729 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae1815ea80 0x7fae180d3e50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fae1808db20 tx=0x7fae0802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d77fa8f89e68deb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:49.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.848+0000 7fae15d9b640 1 -- 172.21.15.123:0/1594590729 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae08037070 con 0x7fae1815ea80 2024-09-15T23:13:49.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.848+0000 7fae15d9b640 1 -- 172.21.15.123:0/1594590729 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae0802ae50 con 0x7fae1815ea80 2024-09-15T23:13:49.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.848+0000 7fae15d9b640 1 -- 172.21.15.123:0/1594590729 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae08032860 con 0x7fae1815ea80 2024-09-15T23:13:49.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.849+0000 7fae1d198640 1 -- 172.21.15.123:0/1594590729 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae1815ea80 msgr2=0x7fae180d3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:49.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.849+0000 7fae1d198640 1 --2- 172.21.15.123:0/1594590729 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae1815ea80 0x7fae180d3e50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fae1808db20 tx=0x7fae0802a300 comp rx=0 tx=0).stop 2024-09-15T23:13:49.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.849+0000 7fae1d198640 1 -- 172.21.15.123:0/1594590729 shutdown_connections 2024-09-15T23:13:49.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.849+0000 7fae1d198640 1 --2- 172.21.15.123:0/1594590729 >> v2:172.21.15.188:3300/0 conn(0x7fae180b6d30 0x7fae180b7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.849+0000 7fae1d198640 1 --2- 172.21.15.123:0/1594590729 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae1815ea80 0x7fae180d3e50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.849+0000 7fae1d198640 1 -- 172.21.15.123:0/1594590729 >> 172.21.15.123:0/1594590729 conn(0x7fae180d1620 msgr2=0x7fae180d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:49.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.849+0000 7fae1d198640 1 -- 172.21.15.123:0/1594590729 shutdown_connections 2024-09-15T23:13:49.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.849+0000 7fae1d198640 1 -- 172.21.15.123:0/1594590729 wait complete. 2024-09-15T23:13:49.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.850+0000 7fae1d198640 1 Processor -- start 2024-09-15T23:13:49.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.850+0000 7fae1d198640 1 -- start start 2024-09-15T23:13:49.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.851+0000 7fae1d198640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fae180b6d30 0x7fae18160390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:49.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.851+0000 7fae1d198640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae1815ea80 0x7fae1815d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:49.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.851+0000 7fae1d198640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fae181560f0 0x7fae1815db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:49.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.851+0000 7fae1d198640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fae180d2810 con 0x7fae1815ea80 2024-09-15T23:13:49.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.851+0000 7fae1d198640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fae1815ee60 con 0x7fae181560f0 2024-09-15T23:13:49.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.851+0000 7fae1d198640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fae180d2990 con 0x7fae180b6d30 2024-09-15T23:13:49.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.851+0000 7fae1659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae1815ea80 0x7fae1815d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:49.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.851+0000 7fae1659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae1815ea80 0x7fae1815d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47334/0 (socket says 172.21.15.123:47334) 2024-09-15T23:13:49.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.851+0000 7fae1659c640 1 -- 172.21.15.123:0/4293259386 learned_addr learned my addr 172.21.15.123:0/4293259386 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:13:49.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.851+0000 7fae1759e640 1 --2- 172.21.15.123:0/4293259386 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fae181560f0 0x7fae1815db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:49.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.851+0000 7fae16d9d640 1 --2- 172.21.15.123:0/4293259386 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fae180b6d30 0x7fae18160390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:49.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.852+0000 7fae1659c640 1 -- 172.21.15.123:0/4293259386 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fae180b6d30 msgr2=0x7fae18160390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:49.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.852+0000 7fae1659c640 1 --2- 172.21.15.123:0/4293259386 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fae180b6d30 0x7fae18160390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.852+0000 7fae1659c640 1 -- 172.21.15.123:0/4293259386 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fae181560f0 msgr2=0x7fae1815db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:49.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.852+0000 7fae1659c640 1 --2- 172.21.15.123:0/4293259386 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fae181560f0 0x7fae1815db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.852+0000 7fae1659c640 1 -- 172.21.15.123:0/4293259386 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae18160ce0 con 0x7fae1815ea80 2024-09-15T23:13:49.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.852+0000 7fae1659c640 1 --2- 172.21.15.123:0/4293259386 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae1815ea80 0x7fae1815d640 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fae0c00c400 tx=0x7fae0c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:49.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.852+0000 7fadff7fe640 1 -- 172.21.15.123:0/4293259386 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c0052d0 con 0x7fae1815ea80 2024-09-15T23:13:49.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.852+0000 7fadff7fe640 1 -- 172.21.15.123:0/4293259386 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae0c0054b0 con 0x7fae1815ea80 2024-09-15T23:13:49.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.852+0000 7fae1d198640 1 -- 172.21.15.123:0/4293259386 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae18160fc0 con 0x7fae1815ea80 2024-09-15T23:13:49.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.852+0000 7fadff7fe640 1 -- 172.21.15.123:0/4293259386 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c006a40 con 0x7fae1815ea80 2024-09-15T23:13:49.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.852+0000 7fae1d198640 1 -- 172.21.15.123:0/4293259386 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae18161580 con 0x7fae1815ea80 2024-09-15T23:13:49.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.853+0000 7fadff7fe640 1 -- 172.21.15.123:0/4293259386 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fae0c006be0 con 0x7fae1815ea80 2024-09-15T23:13:49.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.854+0000 7fadff7fe640 1 --2- 172.21.15.123:0/4293259386 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fae0406c2b0 0x7fae0406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:49.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.854+0000 7fadff7fe640 1 -- 172.21.15.123:0/4293259386 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fae0c08a800 con 0x7fae1815ea80 2024-09-15T23:13:49.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.854+0000 7fae16d9d640 1 --2- 172.21.15.123:0/4293259386 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fae0406c2b0 0x7fae0406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:49.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.855+0000 7fae16d9d640 1 --2- 172.21.15.123:0/4293259386 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fae0406c2b0 0x7fae0406e770 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fae08034000 tx=0x7fae0802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:49.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.855+0000 7fae20013740 1 Processor -- start 2024-09-15T23:13:49.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.855+0000 7fae20013740 1 -- start start 2024-09-15T23:13:49.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.856+0000 7fae20013740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578200bd5e0 0x5578200bd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:49.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.856+0000 7fae20013740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578200bada0 0x5578200bc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:49.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.856+0000 7fae20013740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578200bb200 0x55782009d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:49.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.856+0000 7fae20013740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55781ffd98d0 con 0x5578200bada0 2024-09-15T23:13:49.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.856+0000 7fae20013740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55781ff81620 con 0x5578200bd5e0 2024-09-15T23:13:49.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.856+0000 7fae20013740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55781ffd5890 con 0x5578200bb200 2024-09-15T23:13:49.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.856+0000 7fae1659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578200bada0 0x5578200bc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:49.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.856+0000 7fae1659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578200bada0 0x5578200bc930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47348/0 (socket says 172.21.15.123:47348) 2024-09-15T23:13:49.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.856+0000 7fae1659c640 1 -- 172.21.15.123:0/2603841493 learned_addr learned my addr 172.21.15.123:0/2603841493 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:13:49.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.856+0000 7fae1759e640 1 --2- 172.21.15.123:0/2603841493 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578200bb200 0x55782009d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:49.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.856+0000 7fae16d9d640 1 --2- 172.21.15.123:0/2603841493 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578200bd5e0 0x5578200bd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:49.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.856+0000 7fae1659c640 1 -- 172.21.15.123:0/2603841493 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578200bb200 msgr2=0x55782009d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:49.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.856+0000 7fae1659c640 1 --2- 172.21.15.123:0/2603841493 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578200bb200 0x55782009d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.856+0000 7fae1659c640 1 -- 172.21.15.123:0/2603841493 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578200bd5e0 msgr2=0x5578200bd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:49.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.856+0000 7fae1659c640 1 --2- 172.21.15.123:0/2603841493 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578200bd5e0 0x5578200bd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.856+0000 7fae1659c640 1 -- 172.21.15.123:0/2603841493 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55781fdb67d0 con 0x5578200bada0 2024-09-15T23:13:49.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.856+0000 7fae1659c640 1 --2- 172.21.15.123:0/2603841493 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578200bada0 0x5578200bc930 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fae0c001f00 tx=0x7fae0c05cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a12d841961c3acbe server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:49.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.857+0000 7fadfcff9640 1 -- 172.21.15.123:0/2603841493 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c056c20 con 0x5578200bada0 2024-09-15T23:13:49.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.857+0000 7fadfcff9640 1 -- 172.21.15.123:0/2603841493 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae0c05f070 con 0x5578200bada0 2024-09-15T23:13:49.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.857+0000 7fadfcff9640 1 -- 172.21.15.123:0/2603841493 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c059ba0 con 0x5578200bada0 2024-09-15T23:13:49.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.857+0000 7fae20013740 1 -- 172.21.15.123:0/2603841493 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578200bada0 msgr2=0x5578200bc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:49.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.857+0000 7fae20013740 1 --2- 172.21.15.123:0/2603841493 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578200bada0 0x5578200bc930 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fae0c001f00 tx=0x7fae0c05cc20 comp rx=0 tx=0).stop 2024-09-15T23:13:49.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.857+0000 7fae20013740 1 -- 172.21.15.123:0/2603841493 shutdown_connections 2024-09-15T23:13:49.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.857+0000 7fae20013740 1 --2- 172.21.15.123:0/2603841493 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578200bb200 0x55782009d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.857+0000 7fae20013740 1 --2- 172.21.15.123:0/2603841493 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578200bada0 0x5578200bc930 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.857+0000 7fae20013740 1 --2- 172.21.15.123:0/2603841493 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578200bd5e0 0x5578200bd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.857+0000 7fae20013740 1 -- 172.21.15.123:0/2603841493 >> 172.21.15.123:0/2603841493 conn(0x557820073240 msgr2=0x5578200bb650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:49.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.857+0000 7fae20013740 1 -- 172.21.15.123:0/2603841493 shutdown_connections 2024-09-15T23:13:49.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.857+0000 7fae20013740 1 -- 172.21.15.123:0/2603841493 wait complete. 2024-09-15T23:13:49.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.858+0000 7fae20013740 1 -- start start 2024-09-15T23:13:49.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.858+0000 7fae20013740 1 Processor -- start 2024-09-15T23:13:49.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.859+0000 7fae20013740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578200bb200 0x55782009ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:49.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.859+0000 7fae20013740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578200bd5e0 0x5578200a04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:49.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.859+0000 7fae20013740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578200beb20 0x5578200bef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:49.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.859+0000 7fae20013740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55781ffd98d0 con 0x5578200beb20 2024-09-15T23:13:49.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.859+0000 7fae20013740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55781ff62750 con 0x5578200bb200 2024-09-15T23:13:49.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.859+0000 7fae20013740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5578200b9d00 con 0x5578200bd5e0 2024-09-15T23:13:49.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.859+0000 7fae20013740 10 client.0 _ll_register_callbacks cb 0x55781ff86780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:13:49.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.859+0000 7fae1759e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578200beb20 0x5578200bef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:49.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.859+0000 7fae1759e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578200beb20 0x5578200bef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47350/0 (socket says 172.21.15.123:47350) 2024-09-15T23:13:49.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.859+0000 7fae1759e640 1 -- 172.21.15.123:0/4142456279 learned_addr learned my addr 172.21.15.123:0/4142456279 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:13:49.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.859+0000 7fae16d9d640 1 --2- 172.21.15.123:0/4142456279 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578200bb200 0x55782009ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:49.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.859+0000 7fae1659c640 1 --2- 172.21.15.123:0/4142456279 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578200bd5e0 0x5578200a04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:49.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.859+0000 7fae1759e640 1 -- 172.21.15.123:0/4142456279 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578200bd5e0 msgr2=0x5578200a04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:49.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.859+0000 7fae1759e640 1 --2- 172.21.15.123:0/4142456279 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578200bd5e0 0x5578200a04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.859+0000 7fae1759e640 1 -- 172.21.15.123:0/4142456279 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578200bb200 msgr2=0x55782009ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:49.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.859+0000 7fae1759e640 1 --2- 172.21.15.123:0/4142456279 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578200bb200 0x55782009ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.859+0000 7fae1759e640 1 -- 172.21.15.123:0/4142456279 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55781fcac0f0 con 0x5578200beb20 2024-09-15T23:13:49.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.859+0000 7fae1659c640 1 --2- 172.21.15.123:0/4142456279 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578200bd5e0 0x5578200a04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:13:49.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.859+0000 7fae1759e640 1 --2- 172.21.15.123:0/4142456279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578200beb20 0x5578200bef80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fae10004690 tx=0x7fae10007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd3eea39260e948e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:49.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.859+0000 7fadf5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:13:49.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.859+0000 7fadf5ffb640 1 -- 172.21.15.123:0/4142456279 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1001b020 con 0x5578200beb20 2024-09-15T23:13:49.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.859+0000 7fadf5ffb640 1 -- 172.21.15.123:0/4142456279 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fae10004780 con 0x5578200beb20 2024-09-15T23:13:49.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.859+0000 7fae20013740 1 -- 172.21.15.123:0/4142456279 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae0c05f070 con 0x5578200beb20 2024-09-15T23:13:49.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.860+0000 7fadf5ffb640 1 -- 172.21.15.123:0/4142456279 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fae10025050 con 0x5578200beb20 2024-09-15T23:13:49.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.860+0000 7fae20013740 10 client.5016 fetch_fsmap learned FSMap version 14 2024-09-15T23:13:49.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.860+0000 7fae20013740 1 -- 172.21.15.123:0/4142456279 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55781fe16f60 con 0x5578200beb20 2024-09-15T23:13:49.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.860+0000 7fadf5ffb640 1 -- 172.21.15.123:0/4142456279 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae0c05f070 con 0x5578200beb20 2024-09-15T23:13:49.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.860+0000 7fadf5ffb640 1 -- 172.21.15.123:0/4142456279 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7fae10028020 con 0x5578200beb20 2024-09-15T23:13:49.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.860+0000 7fae20013740 10 client.5016 fetch_fsmap finished waiting for FSMap version 14 2024-09-15T23:13:49.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.860+0000 7fae20013740 10 client.5016 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-15T23:13:49.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.860+0000 7fae20013740 20 client.5016 populate_metadata read hostname 'smithi123' 2024-09-15T23:13:49.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.860+0000 7fae20013740 1 --2- 172.21.15.123:0/4142456279 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x55782009eb00 0x55782009ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:49.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.860+0000 7fae20013740 4 client.5016 mds_command: new command op to 4776 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:13:49.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.860+0000 7fae20013740 1 -- 172.21.15.123:0/4142456279 --> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55781ffe7000 con 0x55782009eb00 2024-09-15T23:13:49.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.860+0000 7fae16d9d640 1 --2- 172.21.15.123:0/4142456279 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x55782009eb00 0x55782009ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.860+0000 7fadf5ffb640 10 client.5016 ms_handle_connect on v2:172.21.15.123:6834/1577644605 2024-09-15T23:13:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.860+0000 7fae16d9d640 1 --2- 172.21.15.123:0/4142456279 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x55782009eb00 0x55782009ef10 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39bbee27db320e15 server_cookie=2a6058a38d35f887 in_seq=0 out_seq=0 2024-09-15T23:13:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.861+0000 7fadf5ffb640 1 -- 172.21.15.123:0/4142456279 <== mds.0 v2:172.21.15.123:6834/1577644605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55781ffe7000 con 0x55782009eb00 2024-09-15T23:13:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.861+0000 7fadf5ffb640 10 client.5016 handle_command_reply: tid=0 2024-09-15T23:13:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.861+0000 7fae20013740 1 client.5016 shutdown 2024-09-15T23:13:49.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.861+0000 7fae20013740 1 -- 172.21.15.123:0/4142456279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578200beb20 msgr2=0x5578200bef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:49.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.861+0000 7fae20013740 1 --2- 172.21.15.123:0/4142456279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578200beb20 0x5578200bef80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fae10004690 tx=0x7fae10007700 comp rx=0 tx=0).stop 2024-09-15T23:13:49.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.861+0000 7fae20013740 1 -- 172.21.15.123:0/4142456279 shutdown_connections 2024-09-15T23:13:49.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.861+0000 7fae20013740 1 --2- 172.21.15.123:0/4142456279 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x55782009eb00 0x55782009ef10 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.861+0000 7fae20013740 1 --2- 172.21.15.123:0/4142456279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578200beb20 0x5578200bef80 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.861+0000 7fae20013740 1 --2- 172.21.15.123:0/4142456279 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578200bd5e0 0x5578200a04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.861+0000 7fadf5ffb640 0 client.5016 ms_handle_reset on v2:172.21.15.123:6834/1577644605 2024-09-15T23:13:49.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.861+0000 7fae20013740 1 --2- 172.21.15.123:0/4142456279 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578200bb200 0x55782009ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.861+0000 7fae20013740 1 -- 172.21.15.123:0/4142456279 >> 172.21.15.123:0/4142456279 conn(0x5578200bada0 msgr2=0x55782009db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:49.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.861+0000 7fae20013740 1 -- 172.21.15.123:0/4142456279 shutdown_connections 2024-09-15T23:13:49.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.861+0000 7fae20013740 1 -- 172.21.15.123:0/4142456279 wait complete. 2024-09-15T23:13:49.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.861+0000 7fae20013740 20 client.5016 trim_cache size 0 max 16384 2024-09-15T23:13:49.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.877+0000 7fae20013740 1 Processor -- start 2024-09-15T23:13:49.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.877+0000 7fae20013740 1 -- start start 2024-09-15T23:13:49.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.877+0000 7fae20013740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578200bb200 0x557820133640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:49.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.877+0000 7fae20013740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578200bd5e0 0x5578200b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:49.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.877+0000 7fae20013740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578200beb20 0x5578200b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:49.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.877+0000 7fae20013740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fae18200c30 con 0x5578200beb20 2024-09-15T23:13:49.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.877+0000 7fae20013740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fae181ffd10 con 0x5578200bb200 2024-09-15T23:13:49.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.877+0000 7fae20013740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fae180ce1d0 con 0x5578200bd5e0 2024-09-15T23:13:49.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.878+0000 7fae1759e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578200beb20 0x5578200b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:49.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.878+0000 7fae1759e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578200beb20 0x5578200b29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47354/0 (socket says 172.21.15.123:47354) 2024-09-15T23:13:49.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.878+0000 7fae1759e640 1 -- 172.21.15.123:0/3527595795 learned_addr learned my addr 172.21.15.123:0/3527595795 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:13:49.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.878+0000 7fae1759e640 1 -- 172.21.15.123:0/3527595795 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578200bd5e0 msgr2=0x5578200b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:49.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.878+0000 7fae1759e640 1 --2- 172.21.15.123:0/3527595795 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578200bd5e0 0x5578200b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.878+0000 7fae1759e640 1 -- 172.21.15.123:0/3527595795 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578200bb200 msgr2=0x557820133640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:49.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.878+0000 7fae1759e640 1 --2- 172.21.15.123:0/3527595795 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578200bb200 0x557820133640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.878+0000 7fae1759e640 1 -- 172.21.15.123:0/3527595795 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55781fc851b0 con 0x5578200beb20 2024-09-15T23:13:49.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.878+0000 7fae1759e640 1 --2- 172.21.15.123:0/3527595795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578200beb20 0x5578200b29f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fae10000f80 tx=0x7fae1000e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c345b3df20b1e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:49.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.878+0000 7fadf7fff640 1 -- 172.21.15.123:0/3527595795 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1002e070 con 0x5578200beb20 2024-09-15T23:13:49.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.878+0000 7fadf7fff640 1 -- 172.21.15.123:0/3527595795 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae10017470 con 0x5578200beb20 2024-09-15T23:13:49.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.878+0000 7fadf7fff640 1 -- 172.21.15.123:0/3527595795 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae1001b040 con 0x5578200beb20 2024-09-15T23:13:49.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.879+0000 7fae20013740 1 -- 172.21.15.123:0/3527595795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578200beb20 msgr2=0x5578200b29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:49.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.879+0000 7fae20013740 1 --2- 172.21.15.123:0/3527595795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578200beb20 0x5578200b29f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fae10000f80 tx=0x7fae1000e000 comp rx=0 tx=0).stop 2024-09-15T23:13:49.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.879+0000 7fae20013740 1 -- 172.21.15.123:0/3527595795 shutdown_connections 2024-09-15T23:13:49.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.879+0000 7fae20013740 1 --2- 172.21.15.123:0/3527595795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578200beb20 0x5578200b29f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.879+0000 7fae20013740 1 --2- 172.21.15.123:0/3527595795 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578200bd5e0 0x5578200b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.879+0000 7fae20013740 1 --2- 172.21.15.123:0/3527595795 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578200bb200 0x557820133640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.879+0000 7fae20013740 1 -- 172.21.15.123:0/3527595795 >> 172.21.15.123:0/3527595795 conn(0x5578200bada0 msgr2=0x55782009ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:49.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.879+0000 7fae20013740 1 -- 172.21.15.123:0/3527595795 shutdown_connections 2024-09-15T23:13:49.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.879+0000 7fae20013740 1 -- 172.21.15.123:0/3527595795 wait complete. 2024-09-15T23:13:49.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.879+0000 7fae20013740 1 -- start start 2024-09-15T23:13:49.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.879+0000 7fae20013740 1 Processor -- start 2024-09-15T23:13:49.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.880+0000 7fae20013740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578200bb200 0x5578200b0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:49.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.880+0000 7fae20013740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578200bd5e0 0x557820130cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:49.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.880+0000 7fae20013740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578200beb20 0x55782009f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:49.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.880+0000 7fae20013740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5578200b5520 con 0x5578200bd5e0 2024-09-15T23:13:49.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.880+0000 7fae20013740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x557820139a90 con 0x5578200beb20 2024-09-15T23:13:49.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.880+0000 7fae20013740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x557820131520 con 0x5578200bb200 2024-09-15T23:13:49.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.880+0000 7fae20013740 10 client.0 _ll_register_callbacks cb 0x7fae10004270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:13:49.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.880+0000 7fae1659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578200bd5e0 0x557820130cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:49.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.880+0000 7fae1659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578200bd5e0 0x557820130cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47360/0 (socket says 172.21.15.123:47360) 2024-09-15T23:13:49.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.880+0000 7fae1659c640 1 -- 172.21.15.123:0/2121721184 learned_addr learned my addr 172.21.15.123:0/2121721184 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:13:49.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.880+0000 7fae16d9d640 1 --2- 172.21.15.123:0/2121721184 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578200bb200 0x5578200b0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:49.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.880+0000 7fae1759e640 1 --2- 172.21.15.123:0/2121721184 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578200beb20 0x55782009f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:49.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.880+0000 7fae1659c640 1 -- 172.21.15.123:0/2121721184 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578200bb200 msgr2=0x5578200b0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:49.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.880+0000 7fae1659c640 1 --2- 172.21.15.123:0/2121721184 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578200bb200 0x5578200b0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.880+0000 7fae1659c640 1 -- 172.21.15.123:0/2121721184 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578200beb20 msgr2=0x55782009f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:49.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.880+0000 7fae1659c640 1 --2- 172.21.15.123:0/2121721184 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578200beb20 0x55782009f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.880+0000 7fae1659c640 1 -- 172.21.15.123:0/2121721184 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578200ded80 con 0x5578200bd5e0 2024-09-15T23:13:49.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.880+0000 7fae1759e640 1 --2- 172.21.15.123:0/2121721184 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578200beb20 0x55782009f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:13:49.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.880+0000 7fae1659c640 1 --2- 172.21.15.123:0/2121721184 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578200bd5e0 0x557820130cd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fae0c058620 tx=0x7fae0c088c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e2a168cc1b50c5a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:49.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.880+0000 7fadf5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:13:49.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.881+0000 7fadf5ffb640 1 -- 172.21.15.123:0/2121721184 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c054f90 con 0x5578200bd5e0 2024-09-15T23:13:49.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.881+0000 7fadf5ffb640 1 -- 172.21.15.123:0/2121721184 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fae0c059ba0 con 0x5578200bd5e0 2024-09-15T23:13:49.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.881+0000 7fae20013740 1 -- 172.21.15.123:0/2121721184 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae10017470 con 0x5578200bd5e0 2024-09-15T23:13:49.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.881+0000 7fadf5ffb640 1 -- 172.21.15.123:0/2121721184 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fae0c055130 con 0x5578200bd5e0 2024-09-15T23:13:49.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.881+0000 7fae20013740 10 client.5022 fetch_fsmap learned FSMap version 14 2024-09-15T23:13:49.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.881+0000 7fae20013740 1 -- 172.21.15.123:0/2121721184 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55782009f080 con 0x5578200bd5e0 2024-09-15T23:13:49.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.881+0000 7fadf5ffb640 1 -- 172.21.15.123:0/2121721184 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae10017470 con 0x5578200bd5e0 2024-09-15T23:13:49.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.881+0000 7fadf5ffb640 1 -- 172.21.15.123:0/2121721184 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7fae0c057d70 con 0x5578200bd5e0 2024-09-15T23:13:49.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.881+0000 7fae20013740 10 client.5022 fetch_fsmap finished waiting for FSMap version 14 2024-09-15T23:13:49.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.881+0000 7fae20013740 10 client.5022 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-15T23:13:49.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.881+0000 7fae20013740 20 client.5022 populate_metadata read hostname 'smithi123' 2024-09-15T23:13:49.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.881+0000 7fae20013740 1 --2- 172.21.15.123:0/2121721184 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x55782009fab0 0x5578200767f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:49.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.881+0000 7fae20013740 4 client.5022 mds_command: new command op to 4776 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-09-15T23:13:49.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.881+0000 7fae20013740 1 -- 172.21.15.123:0/2121721184 --> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] -- command(tid 0: {"prefix": "perf dump"}) -- 0x5578200d5630 con 0x55782009fab0 2024-09-15T23:13:49.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.881+0000 7fae16d9d640 1 --2- 172.21.15.123:0/2121721184 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x55782009fab0 0x5578200767f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:49.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.881+0000 7fadf5ffb640 10 client.5022 ms_handle_connect on v2:172.21.15.123:6834/1577644605 2024-09-15T23:13:49.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.881+0000 7fae16d9d640 1 --2- 172.21.15.123:0/2121721184 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x55782009fab0 0x5578200767f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf3f37ff21f0bfb8 server_cookie=94d63adfa60fc751 in_seq=0 out_seq=0 2024-09-15T23:13:49.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.882+0000 7fadf5ffb640 1 -- 172.21.15.123:0/2121721184 <== mds.0 v2:172.21.15.123:6834/1577644605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+17987 (crc 0 0 0) 0x5578200d5630 con 0x55782009fab0 2024-09-15T23:13:49.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.882+0000 7fadf5ffb640 10 client.5022 handle_command_reply: tid=0 2024-09-15T23:13:49.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.882+0000 7fae20013740 1 client.5022 shutdown 2024-09-15T23:13:49.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.882+0000 7fae20013740 1 -- 172.21.15.123:0/2121721184 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578200bd5e0 msgr2=0x557820130cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:49.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.882+0000 7fae20013740 1 --2- 172.21.15.123:0/2121721184 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578200bd5e0 0x557820130cd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fae0c058620 tx=0x7fae0c088c00 comp rx=0 tx=0).stop 2024-09-15T23:13:49.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.882+0000 7fae20013740 1 -- 172.21.15.123:0/2121721184 shutdown_connections 2024-09-15T23:13:49.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.882+0000 7fae20013740 1 --2- 172.21.15.123:0/2121721184 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578200beb20 0x55782009f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.882+0000 7fae20013740 1 --2- 172.21.15.123:0/2121721184 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x55782009fab0 0x5578200767f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.882+0000 7fae20013740 1 --2- 172.21.15.123:0/2121721184 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578200bd5e0 0x557820130cd0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.882+0000 7fae20013740 1 --2- 172.21.15.123:0/2121721184 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578200bb200 0x5578200b0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.882+0000 7fadf5ffb640 0 client.5022 ms_handle_reset on v2:172.21.15.123:6834/1577644605 2024-09-15T23:13:49.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.882+0000 7fae20013740 1 -- 172.21.15.123:0/2121721184 >> 172.21.15.123:0/2121721184 conn(0x5578200bada0 msgr2=0x5578200722a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:49.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.882+0000 7fae20013740 1 -- 172.21.15.123:0/2121721184 shutdown_connections 2024-09-15T23:13:49.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.882+0000 7fae20013740 1 -- 172.21.15.123:0/2121721184 wait complete. 2024-09-15T23:13:49.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.882+0000 7fae20013740 20 client.5022 trim_cache size 0 max 16384 2024-09-15T23:13:49.890 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:13:49.890 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T23:13:49.890 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 28235, 2024-09-15T23:13:49.890 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 50495, 2024-09-15T23:13:49.890 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 9241386, 2024-09-15T23:13:49.890 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 53303459, 2024-09-15T23:13:49.890 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 11, 2024-09-15T23:13:49.890 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 3, 2024-09-15T23:13:49.890 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 2.740688091, 2024-09-15T23:13:49.891 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 2.083380295, 2024-09-15T23:13:49.891 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.798493399, 2024-09-15T23:13:49.891 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.050451450, 2024-09-15T23:13:49.891 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:13:49.891 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 50493, 2024-09-15T23:13:49.891 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 1.276398670, 2024-09-15T23:13:49.891 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000025278 2024-09-15T23:13:49.891 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.891 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:13:49.891 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 48589, 2024-09-15T23:13:49.891 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.008157566, 2024-09-15T23:13:49.891 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000167 2024-09-15T23:13:49.891 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.892 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T23:13:49.892 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T23:13:49.892 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.892 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T23:13:49.892 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 2178, 2024-09-15T23:13:49.892 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 2173, 2024-09-15T23:13:49.892 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 842219, 2024-09-15T23:13:49.892 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 41807791, 2024-09-15T23:13:49.892 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 5, 2024-09-15T23:13:49.892 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 4, 2024-09-15T23:13:49.892 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.284469010, 2024-09-15T23:13:49.892 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.165074490, 2024-09-15T23:13:49.892 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.049467276, 2024-09-15T23:13:49.893 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.064190504, 2024-09-15T23:13:49.893 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:13:49.893 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2172, 2024-09-15T23:13:49.893 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.381817500, 2024-09-15T23:13:49.893 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000175790 2024-09-15T23:13:49.893 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.893 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:13:49.893 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:13:49.893 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:13:49.893 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:13:49.893 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.893 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 116928, 2024-09-15T23:13:49.894 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 18768 2024-09-15T23:13:49.894 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.894 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T23:13:49.894 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 1125, 2024-09-15T23:13:49.894 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 1138, 2024-09-15T23:13:49.894 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 285382, 2024-09-15T23:13:49.894 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 16351247, 2024-09-15T23:13:49.894 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 6, 2024-09-15T23:13:49.894 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 4, 2024-09-15T23:13:49.894 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.160549587, 2024-09-15T23:13:49.894 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.089681628, 2024-09-15T23:13:49.894 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.028166444, 2024-09-15T23:13:49.894 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.036407786, 2024-09-15T23:13:49.894 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:13:49.894 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1137, 2024-09-15T23:13:49.895 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.273522820, 2024-09-15T23:13:49.895 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000240565 2024-09-15T23:13:49.895 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.895 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:13:49.895 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:13:49.895 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:13:49.895 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:13:49.895 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.895 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 1728, 2024-09-15T23:13:49.895 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 108768 2024-09-15T23:13:49.895 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.895 INFO:teuthology.orchestra.run.smithi123.stdout: "cct": { 2024-09-15T23:13:49.895 INFO:teuthology.orchestra.run.smithi123.stdout: "total_workers": 1, 2024-09-15T23:13:49.895 INFO:teuthology.orchestra.run.smithi123.stdout: "unhealthy_workers": 0 2024-09-15T23:13:49.896 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.896 INFO:teuthology.orchestra.run.smithi123.stdout: "finisher-MDSRank": { 2024-09-15T23:13:49.896 INFO:teuthology.orchestra.run.smithi123.stdout: "queue_len": 0, 2024-09-15T23:13:49.896 INFO:teuthology.orchestra.run.smithi123.stdout: "complete_latency": { 2024-09-15T23:13:49.896 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1189, 2024-09-15T23:13:49.896 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 16.030043021, 2024-09-15T23:13:49.896 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.013481953 2024-09-15T23:13:49.896 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:13:49.896 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.896 INFO:teuthology.orchestra.run.smithi123.stdout: "finisher-PurgeQueue": { 2024-09-15T23:13:49.896 INFO:teuthology.orchestra.run.smithi123.stdout: "queue_len": 0, 2024-09-15T23:13:49.896 INFO:teuthology.orchestra.run.smithi123.stdout: "complete_latency": { 2024-09-15T23:13:49.896 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2118, 2024-09-15T23:13:49.896 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 1.136855791, 2024-09-15T23:13:49.897 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000536759 2024-09-15T23:13:49.897 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:13:49.897 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.897 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-09-15T23:13:49.897 INFO:teuthology.orchestra.run.smithi123.stdout: "request": 25553, 2024-09-15T23:13:49.897 INFO:teuthology.orchestra.run.smithi123.stdout: "reply": 25553, 2024-09-15T23:13:49.897 INFO:teuthology.orchestra.run.smithi123.stdout: "reply_latency": { 2024-09-15T23:13:49.897 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 25553, 2024-09-15T23:13:49.897 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 319.230821341, 2024-09-15T23:13:49.897 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.012492890 2024-09-15T23:13:49.897 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.897 INFO:teuthology.orchestra.run.smithi123.stdout: "slow_reply": 0, 2024-09-15T23:13:49.897 INFO:teuthology.orchestra.run.smithi123.stdout: "forward": 0, 2024-09-15T23:13:49.897 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_fetch_complete": 0, 2024-09-15T23:13:49.898 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_fetch_keys": 0, 2024-09-15T23:13:49.898 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_commit": 12, 2024-09-15T23:13:49.898 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_split": 0, 2024-09-15T23:13:49.898 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_merge": 0, 2024-09-15T23:13:49.898 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes": 19900, 2024-09-15T23:13:49.898 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_top": 0, 2024-09-15T23:13:49.898 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_bottom": 19900, 2024-09-15T23:13:49.898 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_pin_tail": 0, 2024-09-15T23:13:49.898 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_pinned": 19899, 2024-09-15T23:13:49.898 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_expired": 0, 2024-09-15T23:13:49.898 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_with_caps": 166, 2024-09-15T23:13:49.898 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": 166, 2024-09-15T23:13:49.898 INFO:teuthology.orchestra.run.smithi123.stdout: "subtrees": 2, 2024-09-15T23:13:49.898 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse": 46266, 2024-09-15T23:13:49.899 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_hit": 45825, 2024-09-15T23:13:49.899 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_forward": 0, 2024-09-15T23:13:49.899 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_discover": 0, 2024-09-15T23:13:49.899 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_dir_fetch": 0, 2024-09-15T23:13:49.899 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_remote_ino": 0, 2024-09-15T23:13:49.899 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_lock": 90, 2024-09-15T23:13:49.899 INFO:teuthology.orchestra.run.smithi123.stdout: "load_cent": 0, 2024-09-15T23:13:49.899 INFO:teuthology.orchestra.run.smithi123.stdout: "q": 0, 2024-09-15T23:13:49.899 INFO:teuthology.orchestra.run.smithi123.stdout: "exported": 0, 2024-09-15T23:13:49.899 INFO:teuthology.orchestra.run.smithi123.stdout: "exported_inodes": 0, 2024-09-15T23:13:49.899 INFO:teuthology.orchestra.run.smithi123.stdout: "imported": 0, 2024-09-15T23:13:49.899 INFO:teuthology.orchestra.run.smithi123.stdout: "imported_inodes": 0, 2024-09-15T23:13:49.899 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_dir_fetch": 0, 2024-09-15T23:13:49.899 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_backtrace_fetch": 0, 2024-09-15T23:13:49.900 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_peer_discover": 0, 2024-09-15T23:13:49.900 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rfiles": 0, 2024-09-15T23:13:49.900 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rbytes": 0, 2024-09-15T23:13:49.900 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rsnaps": 0, 2024-09-15T23:13:49.900 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_backtrace_fetch": 0, 2024-09-15T23:13:49.900 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_set_tag": 0, 2024-09-15T23:13:49.900 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T23:13:49.900 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_inotable_repaired": 0, 2024-09-15T23:13:49.900 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dir_inodes": 0, 2024-09-15T23:13:49.900 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dir_base_inodes": 0, 2024-09-15T23:13:49.900 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dirfrag_rstats": 0, 2024-09-15T23:13:49.900 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_file_inodes": 0, 2024-09-15T23:13:49.900 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_inode_file_caps": 0, 2024-09-15T23:13:49.901 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_revoke": 1380, 2024-09-15T23:13:49.901 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_grant": 4040, 2024-09-15T23:13:49.901 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_trunc": 0, 2024-09-15T23:13:49.901 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T23:13:49.901 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T23:13:49.901 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_caps": 3382, 2024-09-15T23:13:49.901 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_caps_dirty": 2308, 2024-09-15T23:13:49.901 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_cap_release": 45, 2024-09-15T23:13:49.901 INFO:teuthology.orchestra.run.smithi123.stdout: "process_request_cap_release": 14064 2024-09-15T23:13:49.901 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.902 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_cache": { 2024-09-15T23:13:49.902 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_update": 0, 2024-09-15T23:13:49.902 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_update_receipt": 0, 2024-09-15T23:13:49.902 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_try_discover": 0, 2024-09-15T23:13:49.902 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_send_discover": 0, 2024-09-15T23:13:49.902 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_handle_discover": 0, 2024-09-15T23:13:49.902 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays": 2000, 2024-09-15T23:13:49.902 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays_delayed": 0, 2024-09-15T23:13:49.902 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays_enqueuing": 0, 2024-09-15T23:13:49.902 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_created": 4128, 2024-09-15T23:13:49.902 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_enqueued": 1836, 2024-09-15T23:13:49.902 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_reintegrated": 2212, 2024-09-15T23:13:49.902 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_migrated": 0, 2024-09-15T23:13:49.903 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_processing": 0, 2024-09-15T23:13:49.903 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_enqueued": 0, 2024-09-15T23:13:49.903 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_prioritized": 0, 2024-09-15T23:13:49.903 INFO:teuthology.orchestra.run.smithi123.stdout: "recovery_started": 0, 2024-09-15T23:13:49.903 INFO:teuthology.orchestra.run.smithi123.stdout: "recovery_completed": 0, 2024-09-15T23:13:49.903 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_quiesce_path": 0, 2024-09-15T23:13:49.903 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_quiesce_inode": 0, 2024-09-15T23:13:49.903 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_enqueue_scrub": 0, 2024-09-15T23:13:49.903 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_exportdir": 0, 2024-09-15T23:13:49.903 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_flush": 0, 2024-09-15T23:13:49.903 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_fragmentdir": 0, 2024-09-15T23:13:49.903 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_fragstats": 0, 2024-09-15T23:13:49.904 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_inodestats": 0 2024-09-15T23:13:49.904 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.904 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_log": { 2024-09-15T23:13:49.904 INFO:teuthology.orchestra.run.smithi123.stdout: "evlrg": 0, 2024-09-15T23:13:49.904 INFO:teuthology.orchestra.run.smithi123.stdout: "evadd": 25189, 2024-09-15T23:13:49.904 INFO:teuthology.orchestra.run.smithi123.stdout: "evex": 0, 2024-09-15T23:13:49.904 INFO:teuthology.orchestra.run.smithi123.stdout: "evtrm": 0, 2024-09-15T23:13:49.904 INFO:teuthology.orchestra.run.smithi123.stdout: "ev": 25189, 2024-09-15T23:13:49.904 INFO:teuthology.orchestra.run.smithi123.stdout: "evexg": 0, 2024-09-15T23:13:49.904 INFO:teuthology.orchestra.run.smithi123.stdout: "evexd": 0, 2024-09-15T23:13:49.904 INFO:teuthology.orchestra.run.smithi123.stdout: "segadd": 33, 2024-09-15T23:13:49.904 INFO:teuthology.orchestra.run.smithi123.stdout: "segex": 0, 2024-09-15T23:13:49.904 INFO:teuthology.orchestra.run.smithi123.stdout: "segtrm": 0, 2024-09-15T23:13:49.904 INFO:teuthology.orchestra.run.smithi123.stdout: "seg": 33, 2024-09-15T23:13:49.905 INFO:teuthology.orchestra.run.smithi123.stdout: "segmjr": 4, 2024-09-15T23:13:49.905 INFO:teuthology.orchestra.run.smithi123.stdout: "segexg": 0, 2024-09-15T23:13:49.905 INFO:teuthology.orchestra.run.smithi123.stdout: "segexd": 0, 2024-09-15T23:13:49.905 INFO:teuthology.orchestra.run.smithi123.stdout: "expos": 4194304, 2024-09-15T23:13:49.905 INFO:teuthology.orchestra.run.smithi123.stdout: "wrpos": 95330746, 2024-09-15T23:13:49.905 INFO:teuthology.orchestra.run.smithi123.stdout: "rdpos": 0, 2024-09-15T23:13:49.905 INFO:teuthology.orchestra.run.smithi123.stdout: "jlat": { 2024-09-15T23:13:49.905 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2579, 2024-09-15T23:13:49.905 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 90.506785375, 2024-09-15T23:13:49.905 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.035093751 2024-09-15T23:13:49.905 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.905 INFO:teuthology.orchestra.run.smithi123.stdout: "replayed": 0 2024-09-15T23:13:49.905 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.906 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_mem": { 2024-09-15T23:13:49.906 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 2014, 2024-09-15T23:13:49.906 INFO:teuthology.orchestra.run.smithi123.stdout: "ino+": 2014, 2024-09-15T23:13:49.906 INFO:teuthology.orchestra.run.smithi123.stdout: "ino-": 0, 2024-09-15T23:13:49.906 INFO:teuthology.orchestra.run.smithi123.stdout: "dir": 13, 2024-09-15T23:13:49.906 INFO:teuthology.orchestra.run.smithi123.stdout: "dir+": 13, 2024-09-15T23:13:49.906 INFO:teuthology.orchestra.run.smithi123.stdout: "dir-": 0, 2024-09-15T23:13:49.906 INFO:teuthology.orchestra.run.smithi123.stdout: "dn": 19900, 2024-09-15T23:13:49.906 INFO:teuthology.orchestra.run.smithi123.stdout: "dn+": 19901, 2024-09-15T23:13:49.906 INFO:teuthology.orchestra.run.smithi123.stdout: "dn-": 1, 2024-09-15T23:13:49.906 INFO:teuthology.orchestra.run.smithi123.stdout: "cap": 166, 2024-09-15T23:13:49.906 INFO:teuthology.orchestra.run.smithi123.stdout: "cap+": 6512, 2024-09-15T23:13:49.906 INFO:teuthology.orchestra.run.smithi123.stdout: "cap-": 6346, 2024-09-15T23:13:49.906 INFO:teuthology.orchestra.run.smithi123.stdout: "rss": 112772, 2024-09-15T23:13:49.907 INFO:teuthology.orchestra.run.smithi123.stdout: "heap": 231788 2024-09-15T23:13:49.907 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.907 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_server": { 2024-09-15T23:13:49.907 INFO:teuthology.orchestra.run.smithi123.stdout: "dispatch_client_request": 28364, 2024-09-15T23:13:49.907 INFO:teuthology.orchestra.run.smithi123.stdout: "dispatch_server_request": 0, 2024-09-15T23:13:49.907 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_request": 25553, 2024-09-15T23:13:49.907 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_session": 3, 2024-09-15T23:13:49.907 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_peer_request": 0, 2024-09-15T23:13:49.907 INFO:teuthology.orchestra.run.smithi123.stdout: "req_create_latency": { 2024-09-15T23:13:49.907 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2000, 2024-09-15T23:13:49.907 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 1.631874338, 2024-09-15T23:13:49.907 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000815937 2024-09-15T23:13:49.907 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.907 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getattr_latency": { 2024-09-15T23:13:49.908 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 30, 2024-09-15T23:13:49.908 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.004380140, 2024-09-15T23:13:49.908 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000146004 2024-09-15T23:13:49.908 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.908 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getfilelock_latency": { 2024-09-15T23:13:49.908 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:13:49.908 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:13:49.908 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:13:49.908 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.908 INFO:teuthology.orchestra.run.smithi123.stdout: "req_link_latency": { 2024-09-15T23:13:49.908 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 6000, 2024-09-15T23:13:49.908 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 7.672915706, 2024-09-15T23:13:49.908 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.001278819 2024-09-15T23:13:49.909 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.909 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookup_latency": { 2024-09-15T23:13:49.909 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 7297, 2024-09-15T23:13:49.909 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 5.748462426, 2024-09-15T23:13:49.909 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000787784 2024-09-15T23:13:49.909 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.909 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookuphash_latency": { 2024-09-15T23:13:49.909 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:13:49.909 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:13:49.909 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:13:49.909 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.909 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupino_latency": { 2024-09-15T23:13:49.910 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:13:49.910 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:13:49.910 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:13:49.910 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.910 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupname_latency": { 2024-09-15T23:13:49.910 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:13:49.910 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:13:49.910 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:13:49.910 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.910 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupparent_latency": { 2024-09-15T23:13:49.910 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:13:49.910 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:13:49.910 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:13:49.911 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.911 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupsnap_latency": { 2024-09-15T23:13:49.911 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1, 2024-09-15T23:13:49.911 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000043438, 2024-09-15T23:13:49.911 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000043438 2024-09-15T23:13:49.911 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.911 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lssnap_latency": { 2024-09-15T23:13:49.911 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:13:49.911 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:13:49.911 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:13:49.911 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.911 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mkdir_latency": { 2024-09-15T23:13:49.911 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1, 2024-09-15T23:13:49.912 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.002829817, 2024-09-15T23:13:49.912 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.002829817 2024-09-15T23:13:49.912 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.912 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mknod_latency": { 2024-09-15T23:13:49.912 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:13:49.912 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:13:49.912 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:13:49.912 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.912 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mksnap_latency": { 2024-09-15T23:13:49.912 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1, 2024-09-15T23:13:49.912 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.256602058, 2024-09-15T23:13:49.912 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.256602058 2024-09-15T23:13:49.912 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.913 INFO:teuthology.orchestra.run.smithi123.stdout: "req_open_latency": { 2024-09-15T23:13:49.913 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1, 2024-09-15T23:13:49.913 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000081221, 2024-09-15T23:13:49.913 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000081221 2024-09-15T23:13:49.913 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.913 INFO:teuthology.orchestra.run.smithi123.stdout: "req_readdir_latency": { 2024-09-15T23:13:49.913 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 8, 2024-09-15T23:13:49.913 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.271188650, 2024-09-15T23:13:49.913 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.033898581 2024-09-15T23:13:49.913 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.913 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rename_latency": { 2024-09-15T23:13:49.913 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2212, 2024-09-15T23:13:49.914 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 285.172683197, 2024-09-15T23:13:49.914 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.128920742 2024-09-15T23:13:49.914 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.914 INFO:teuthology.orchestra.run.smithi123.stdout: "req_renamesnap_latency": { 2024-09-15T23:13:49.914 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:13:49.914 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:13:49.914 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:13:49.914 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.914 INFO:teuthology.orchestra.run.smithi123.stdout: "req_snapdiff_latency": { 2024-09-15T23:13:49.914 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:13:49.914 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:13:49.914 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:13:49.914 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.915 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmdir_latency": { 2024-09-15T23:13:49.915 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:13:49.915 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:13:49.915 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:13:49.915 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.915 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmsnap_latency": { 2024-09-15T23:13:49.915 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1, 2024-09-15T23:13:49.915 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.062614101, 2024-09-15T23:13:49.915 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.062614101 2024-09-15T23:13:49.915 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.915 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmxattr_latency": { 2024-09-15T23:13:49.916 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:13:49.916 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:13:49.916 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:13:49.916 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.916 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setattr_latency": { 2024-09-15T23:13:49.916 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1, 2024-09-15T23:13:49.916 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000249553, 2024-09-15T23:13:49.916 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000249553 2024-09-15T23:13:49.916 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.916 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setdirlayout_latency": { 2024-09-15T23:13:49.916 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:13:49.916 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:13:49.916 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:13:49.917 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.917 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setfilelock_latency": { 2024-09-15T23:13:49.917 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:13:49.917 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:13:49.917 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:13:49.917 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.917 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setlayout_latency": { 2024-09-15T23:13:49.917 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:13:49.917 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:13:49.917 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:13:49.917 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.917 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setxattr_latency": { 2024-09-15T23:13:49.917 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:13:49.917 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:13:49.918 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:13:49.918 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.918 INFO:teuthology.orchestra.run.smithi123.stdout: "req_symlink_latency": { 2024-09-15T23:13:49.918 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:13:49.918 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:13:49.918 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:13:49.918 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.918 INFO:teuthology.orchestra.run.smithi123.stdout: "req_unlink_latency": { 2024-09-15T23:13:49.918 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 8000, 2024-09-15T23:13:49.918 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 18.406896696, 2024-09-15T23:13:49.918 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.002300862 2024-09-15T23:13:49.918 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.919 INFO:teuthology.orchestra.run.smithi123.stdout: "cap_revoke_eviction": 0, 2024-09-15T23:13:49.919 INFO:teuthology.orchestra.run.smithi123.stdout: "cap_acquisition_throttle": 0, 2024-09-15T23:13:49.919 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getvxattr_latency": { 2024-09-15T23:13:49.919 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:13:49.919 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:13:49.919 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:13:49.919 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:13:49.919 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.919 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_sessions": { 2024-09-15T23:13:49.919 INFO:teuthology.orchestra.run.smithi123.stdout: "session_count": 1, 2024-09-15T23:13:49.919 INFO:teuthology.orchestra.run.smithi123.stdout: "session_add": 1, 2024-09-15T23:13:49.919 INFO:teuthology.orchestra.run.smithi123.stdout: "session_remove": 0, 2024-09-15T23:13:49.919 INFO:teuthology.orchestra.run.smithi123.stdout: "sessions_open": 1, 2024-09-15T23:13:49.920 INFO:teuthology.orchestra.run.smithi123.stdout: "sessions_stale": 0, 2024-09-15T23:13:49.920 INFO:teuthology.orchestra.run.smithi123.stdout: "total_load": 18539, 2024-09-15T23:13:49.920 INFO:teuthology.orchestra.run.smithi123.stdout: "average_load": 18539, 2024-09-15T23:13:49.920 INFO:teuthology.orchestra.run.smithi123.stdout: "avg_session_uptime": 43, 2024-09-15T23:13:49.920 INFO:teuthology.orchestra.run.smithi123.stdout: "mdthresh_evicted": 0 2024-09-15T23:13:49.920 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.920 INFO:teuthology.orchestra.run.smithi123.stdout: "mempool": { 2024-09-15T23:13:49.920 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_bytes": 0, 2024-09-15T23:13:49.920 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_items": 0, 2024-09-15T23:13:49.920 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T23:13:49.920 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_items": 0, 2024-09-15T23:13:49.920 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T23:13:49.920 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_items": 0, 2024-09-15T23:13:49.920 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T23:13:49.921 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T23:13:49.921 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T23:13:49.921 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T23:13:49.921 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T23:13:49.921 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_items": 0, 2024-09-15T23:13:49.921 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T23:13:49.921 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T23:13:49.921 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_bytes": 0, 2024-09-15T23:13:49.921 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_items": 0, 2024-09-15T23:13:49.921 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_bytes": 0, 2024-09-15T23:13:49.921 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_items": 0, 2024-09-15T23:13:49.921 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T23:13:49.921 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T23:13:49.922 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T23:13:49.922 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T23:13:49.922 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T23:13:49.922 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_items": 0, 2024-09-15T23:13:49.922 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_bytes": 0, 2024-09-15T23:13:49.922 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_items": 0, 2024-09-15T23:13:49.922 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T23:13:49.922 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T23:13:49.922 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_bytes": 0, 2024-09-15T23:13:49.922 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_items": 0, 2024-09-15T23:13:49.922 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_bytes": 0, 2024-09-15T23:13:49.922 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_items": 0, 2024-09-15T23:13:49.922 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T23:13:49.922 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_items": 0, 2024-09-15T23:13:49.923 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T23:13:49.923 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_items": 0, 2024-09-15T23:13:49.923 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_bytes": 16954022, 2024-09-15T23:13:49.923 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_items": 6261, 2024-09-15T23:13:49.923 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_bytes": 440, 2024-09-15T23:13:49.923 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_items": 5, 2024-09-15T23:13:49.923 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_bytes": 0, 2024-09-15T23:13:49.923 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_items": 0, 2024-09-15T23:13:49.923 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_bytes": 0, 2024-09-15T23:13:49.923 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_items": 0, 2024-09-15T23:13:49.923 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_bytes": 0, 2024-09-15T23:13:49.923 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_items": 0, 2024-09-15T23:13:49.923 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_bytes": 5312, 2024-09-15T23:13:49.923 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_items": 75, 2024-09-15T23:13:49.924 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T23:13:49.924 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_items": 0, 2024-09-15T23:13:49.924 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_bytes": 0, 2024-09-15T23:13:49.924 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_items": 0, 2024-09-15T23:13:49.924 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_bytes": 20451153, 2024-09-15T23:13:49.924 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_items": 859049, 2024-09-15T23:13:49.924 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_bytes": 0, 2024-09-15T23:13:49.924 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_items": 0, 2024-09-15T23:13:49.924 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_bytes": 0, 2024-09-15T23:13:49.924 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_items": 0 2024-09-15T23:13:49.924 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.924 INFO:teuthology.orchestra.run.smithi123.stdout: "objecter": { 2024-09-15T23:13:49.924 INFO:teuthology.orchestra.run.smithi123.stdout: "op_active": 0, 2024-09-15T23:13:49.925 INFO:teuthology.orchestra.run.smithi123.stdout: "op_laggy": 0, 2024-09-15T23:13:49.925 INFO:teuthology.orchestra.run.smithi123.stdout: "op_send": 4640, 2024-09-15T23:13:49.925 INFO:teuthology.orchestra.run.smithi123.stdout: "op_send_bytes": 91610961, 2024-09-15T23:13:49.925 INFO:teuthology.orchestra.run.smithi123.stdout: "op_resend": 37, 2024-09-15T23:13:49.925 INFO:teuthology.orchestra.run.smithi123.stdout: "op_reply": 4640, 2024-09-15T23:13:49.925 INFO:teuthology.orchestra.run.smithi123.stdout: "op_latency": { 2024-09-15T23:13:49.925 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 4640, 2024-09-15T23:13:49.925 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 22.503469079, 2024-09-15T23:13:49.925 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.004849885 2024-09-15T23:13:49.925 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.925 INFO:teuthology.orchestra.run.smithi123.stdout: "op_inflight": 0, 2024-09-15T23:13:49.925 INFO:teuthology.orchestra.run.smithi123.stdout: "oplen_avg": { 2024-09-15T23:13:49.926 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 4640, 2024-09-15T23:13:49.926 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 4733 2024-09-15T23:13:49.926 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.926 INFO:teuthology.orchestra.run.smithi123.stdout: "op": 4640, 2024-09-15T23:13:49.926 INFO:teuthology.orchestra.run.smithi123.stdout: "op_r": 46, 2024-09-15T23:13:49.926 INFO:teuthology.orchestra.run.smithi123.stdout: "op_w": 4594, 2024-09-15T23:13:49.926 INFO:teuthology.orchestra.run.smithi123.stdout: "op_rmw": 0, 2024-09-15T23:13:49.926 INFO:teuthology.orchestra.run.smithi123.stdout: "op_pg": 0, 2024-09-15T23:13:49.926 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_stat": 0, 2024-09-15T23:13:49.926 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_create": 11, 2024-09-15T23:13:49.926 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_read": 46, 2024-09-15T23:13:49.926 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_write": 2625, 2024-09-15T23:13:49.927 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_writefull": 29, 2024-09-15T23:13:49.927 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_writesame": 0, 2024-09-15T23:13:49.927 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_append": 0, 2024-09-15T23:13:49.927 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_zero": 1836, 2024-09-15T23:13:49.927 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_truncate": 0, 2024-09-15T23:13:49.927 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_delete": 33, 2024-09-15T23:13:49.927 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_mapext": 0, 2024-09-15T23:13:49.927 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_sparse_read": 0, 2024-09-15T23:13:49.927 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_clonerange": 0, 2024-09-15T23:13:49.927 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_getxattr": 0, 2024-09-15T23:13:49.927 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_setxattr": 22, 2024-09-15T23:13:49.927 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_cmpxattr": 0, 2024-09-15T23:13:49.927 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_rmxattr": 0, 2024-09-15T23:13:49.927 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_resetxattrs": 0, 2024-09-15T23:13:49.928 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_call": 0, 2024-09-15T23:13:49.928 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_watch": 0, 2024-09-15T23:13:49.928 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_notify": 0, 2024-09-15T23:13:49.928 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T23:13:49.928 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_pgls": 0, 2024-09-15T23:13:49.928 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_pgls_filter": 0, 2024-09-15T23:13:49.928 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_other": 0, 2024-09-15T23:13:49.928 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_active": 0, 2024-09-15T23:13:49.928 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_send": 0, 2024-09-15T23:13:49.928 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_resend": 0, 2024-09-15T23:13:49.928 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_ping": 0, 2024-09-15T23:13:49.928 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_active": 0, 2024-09-15T23:13:49.928 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_send": 0, 2024-09-15T23:13:49.929 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_resend": 0, 2024-09-15T23:13:49.929 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_active": 0, 2024-09-15T23:13:49.929 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_send": 0, 2024-09-15T23:13:49.929 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_resend": 0, 2024-09-15T23:13:49.929 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_active": 0, 2024-09-15T23:13:49.929 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_send": 0, 2024-09-15T23:13:49.929 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_resend": 0, 2024-09-15T23:13:49.929 INFO:teuthology.orchestra.run.smithi123.stdout: "command_active": 0, 2024-09-15T23:13:49.929 INFO:teuthology.orchestra.run.smithi123.stdout: "command_send": 0, 2024-09-15T23:13:49.929 INFO:teuthology.orchestra.run.smithi123.stdout: "command_resend": 0, 2024-09-15T23:13:49.929 INFO:teuthology.orchestra.run.smithi123.stdout: "map_epoch": 33, 2024-09-15T23:13:49.929 INFO:teuthology.orchestra.run.smithi123.stdout: "map_full": 0, 2024-09-15T23:13:49.929 INFO:teuthology.orchestra.run.smithi123.stdout: "map_inc": 1, 2024-09-15T23:13:49.929 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_sessions": 8, 2024-09-15T23:13:49.929 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_session_open": 8, 2024-09-15T23:13:49.930 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_session_close": 0, 2024-09-15T23:13:49.930 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_laggy": 0, 2024-09-15T23:13:49.930 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_wr": 101, 2024-09-15T23:13:49.930 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_rd": 0, 2024-09-15T23:13:49.930 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_del": 30 2024-09-15T23:13:49.930 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.930 INFO:teuthology.orchestra.run.smithi123.stdout: "oft": { 2024-09-15T23:13:49.930 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_objs": 1, 2024-09-15T23:13:49.930 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_kv_pairs": 0, 2024-09-15T23:13:49.930 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_updates": 0, 2024-09-15T23:13:49.930 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_removes": 0 2024-09-15T23:13:49.930 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.930 INFO:teuthology.orchestra.run.smithi123.stdout: "osd-slow-ops": { 2024-09-15T23:13:49.930 INFO:teuthology.orchestra.run.smithi123.stdout: "slow_ops_count": 0 2024-09-15T23:13:49.931 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.931 INFO:teuthology.orchestra.run.smithi123.stdout: "purge_queue": { 2024-09-15T23:13:49.931 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_ops": 0, 2024-09-15T23:13:49.931 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_ops_high_water": 32, 2024-09-15T23:13:49.931 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing": 0, 2024-09-15T23:13:49.931 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_high_water": 32, 2024-09-15T23:13:49.931 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executed_ops": 1836, 2024-09-15T23:13:49.931 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executed": 1836, 2024-09-15T23:13:49.931 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_item_in_journal": 0 2024-09-15T23:13:49.931 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.931 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T23:13:49.931 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-15T23:13:49.931 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-09-15T23:13:49.932 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-15T23:13:49.932 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 31534, 2024-09-15T23:13:49.932 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 7955248, 2024-09-15T23:13:49.932 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-15T23:13:49.932 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 31534, 2024-09-15T23:13:49.932 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-15T23:13:49.932 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-15T23:13:49.932 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 31534, 2024-09-15T23:13:49.932 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 7955248, 2024-09-15T23:13:49.932 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-15T23:13:49.932 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:13:49.932 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:13:49.932 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:13:49.933 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:13:49.933 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.933 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-objecter_bytes": { 2024-09-15T23:13:49.933 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-15T23:13:49.933 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-09-15T23:13:49.933 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-15T23:13:49.933 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-15T23:13:49.933 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-15T23:13:49.933 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-15T23:13:49.933 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-15T23:13:49.933 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 4640, 2024-09-15T23:13:49.933 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 91811085, 2024-09-15T23:13:49.933 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 4640, 2024-09-15T23:13:49.934 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 91811085, 2024-09-15T23:13:49.934 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-15T23:13:49.934 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:13:49.934 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:13:49.934 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:13:49.934 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:13:49.934 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.934 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-objecter_ops": { 2024-09-15T23:13:49.934 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-15T23:13:49.934 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 1024, 2024-09-15T23:13:49.934 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-15T23:13:49.934 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-15T23:13:49.934 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-15T23:13:49.934 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-15T23:13:49.935 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-15T23:13:49.935 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 4640, 2024-09-15T23:13:49.935 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 4640, 2024-09-15T23:13:49.935 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 4640, 2024-09-15T23:13:49.935 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 4640, 2024-09-15T23:13:49.935 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-15T23:13:49.935 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:13:49.935 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:13:49.935 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:13:49.935 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:13:49.935 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.935 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-write_buf_throttle": { 2024-09-15T23:13:49.935 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-15T23:13:49.935 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 3758096384, 2024-09-15T23:13:49.936 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-15T23:13:49.936 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 1836, 2024-09-15T23:13:49.936 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 200124, 2024-09-15T23:13:49.936 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-15T23:13:49.936 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 1836, 2024-09-15T23:13:49.936 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-15T23:13:49.936 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-15T23:13:49.936 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 46, 2024-09-15T23:13:49.936 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 200124, 2024-09-15T23:13:49.936 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-15T23:13:49.936 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:13:49.936 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:13:49.936 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:13:49.937 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:13:49.937 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:13:49.937 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-write_buf_throttle-0x5578bd7ce500": { 2024-09-15T23:13:49.937 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 84, 2024-09-15T23:13:49.937 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 3758096384, 2024-09-15T23:13:49.937 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-15T23:13:49.937 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 25189, 2024-09-15T23:13:49.937 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 91136442, 2024-09-15T23:13:49.937 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-15T23:13:49.937 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 25189, 2024-09-15T23:13:49.937 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-15T23:13:49.937 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-15T23:13:49.937 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 2579, 2024-09-15T23:13:49.938 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 91136358, 2024-09-15T23:13:49.938 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-15T23:13:49.938 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:13:49.938 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:13:49.938 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:13:49.938 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:13:49.938 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:13:49.938 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:13:49.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.883+0000 7fae1d198640 1 -- 172.21.15.123:0/4293259386 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fae0406c2b0 msgr2=0x7fae0406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:49.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.883+0000 7fae1d198640 1 --2- 172.21.15.123:0/4293259386 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fae0406c2b0 0x7fae0406e770 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fae08034000 tx=0x7fae0802e000 comp rx=0 tx=0).stop 2024-09-15T23:13:49.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.883+0000 7fae1d198640 1 -- 172.21.15.123:0/4293259386 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae1815ea80 msgr2=0x7fae1815d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:49.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.883+0000 7fae1d198640 1 --2- 172.21.15.123:0/4293259386 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae1815ea80 0x7fae1815d640 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fae0c00c400 tx=0x7fae0c00c8c0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.883+0000 7fae1d198640 1 -- 172.21.15.123:0/4293259386 shutdown_connections 2024-09-15T23:13:49.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.883+0000 7fae1d198640 1 --2- 172.21.15.123:0/4293259386 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fae181560f0 0x7fae1815db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.883+0000 7fae1d198640 1 --2- 172.21.15.123:0/4293259386 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fae0406c2b0 0x7fae0406e770 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.883+0000 7fae1d198640 1 --2- 172.21.15.123:0/4293259386 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae1815ea80 0x7fae1815d640 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.883+0000 7fae1d198640 1 --2- 172.21.15.123:0/4293259386 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fae180b6d30 0x7fae18160390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:49.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.883+0000 7fae1d198640 1 -- 172.21.15.123:0/4293259386 >> 172.21.15.123:0/4293259386 conn(0x7fae180d1620 msgr2=0x7fae180d1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:49.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.883+0000 7fae1d198640 1 -- 172.21.15.123:0/4293259386 shutdown_connections 2024-09-15T23:13:49.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:49.883+0000 7fae1d198640 1 -- 172.21.15.123:0/4293259386 wait complete. 2024-09-15T23:13:49.941 INFO:tasks.cephfs.test_scrub_checks:num of strays: 2000 2024-09-15T23:13:49.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:13:49.941 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub start / recursive,scrub_mdsdir 2024-09-15T23:13:50.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.043+0000 7f1f5364c640 1 Processor -- start 2024-09-15T23:13:50.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.043+0000 7f1f5364c640 1 -- start start 2024-09-15T23:13:50.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.044+0000 7f1f5364c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1f4c158d60 0x7f1f4c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.044+0000 7f1f5364c640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f4c15efb0 con 0x7f1f4c06c150 2024-09-15T23:13:50.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.044+0000 7f1f5364c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f4c15f290 con 0x7f1f4c06fc80 2024-09-15T23:13:50.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.044+0000 7f1f5364c640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f1f4c06c5c0 con 0x7f1f4c158d60 2024-09-15T23:13:50.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.044+0000 7f1f513e8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1f4c158d60 0x7f1f4c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.044+0000 7f1f50be7640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1f4c06c150 0x7f1f4c06f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58338/0 (socket says 172.21.15.123:58338) 2024-09-15T23:13:50.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.044+0000 7f1f513e8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1f4c158d60 0x7f1f4c06bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47368/0 (socket says 172.21.15.123:47368) 2024-09-15T23:13:50.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.044+0000 7f1f50be7640 1 -- 172.21.15.123:0/1463554466 learned_addr learned my addr 172.21.15.123:0/1463554466 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:13:50.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.045+0000 7f1f513e8640 1 -- 172.21.15.123:0/1463554466 >> v1:172.21.15.188:6789/0 conn(0x7f1f4c06fc80 legacy=0x7f1f4c0b21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:50.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.045+0000 7f1f513e8640 1 -- 172.21.15.123:0/1463554466 >> v1:172.21.15.123:6789/0 conn(0x7f1f4c06c150 legacy=0x7f1f4c06f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:50.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.045+0000 7f1f4bfff640 1 -- 172.21.15.123:0/1463554466 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2756505478 0 0) 0x7f1f4c15efb0 con 0x7f1f4c06c150 2024-09-15T23:13:50.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.045+0000 7f1f513e8640 1 -- 172.21.15.123:0/1463554466 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f4c15f570 con 0x7f1f4c158d60 2024-09-15T23:13:50.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.045+0000 7f1f513e8640 1 --2- 172.21.15.123:0/1463554466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f4c158d60 0x7f1f4c06bc10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1f440097a0 tx=0x7f1f4402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d0f76c0707360e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:50.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.045+0000 7f1f4bfff640 1 -- 172.21.15.123:0/1463554466 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f44037070 con 0x7f1f4c158d60 2024-09-15T23:13:50.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.046+0000 7f1f4bfff640 1 -- 172.21.15.123:0/1463554466 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f44032440 con 0x7f1f4c158d60 2024-09-15T23:13:50.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.046+0000 7f1f4bfff640 1 -- 172.21.15.123:0/1463554466 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4402ae60 con 0x7f1f4c158d60 2024-09-15T23:13:50.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.046+0000 7f1f5364c640 1 -- 172.21.15.123:0/1463554466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f4c158d60 msgr2=0x7f1f4c06bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:50.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.046+0000 7f1f5364c640 1 --2- 172.21.15.123:0/1463554466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f4c158d60 0x7f1f4c06bc10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1f440097a0 tx=0x7f1f4402a110 comp rx=0 tx=0).stop 2024-09-15T23:13:50.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.046+0000 7f1f5364c640 1 -- 172.21.15.123:0/1463554466 shutdown_connections 2024-09-15T23:13:50.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.046+0000 7f1f5364c640 1 --2- 172.21.15.123:0/1463554466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f4c158d60 0x7f1f4c06bc10 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.046+0000 7f1f5364c640 1 -- 172.21.15.123:0/1463554466 >> 172.21.15.123:0/1463554466 conn(0x7f1f4c067da0 msgr2=0x7f1f4c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:50.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.046+0000 7f1f5364c640 1 -- 172.21.15.123:0/1463554466 shutdown_connections 2024-09-15T23:13:50.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.046+0000 7f1f5364c640 1 -- 172.21.15.123:0/1463554466 wait complete. 2024-09-15T23:13:50.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.047+0000 7f1f5364c640 1 Processor -- start 2024-09-15T23:13:50.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.047+0000 7f1f5364c640 1 -- start start 2024-09-15T23:13:50.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.048+0000 7f1f5364c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f4c06c150 0x7f1f4c14f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.048+0000 7f1f5364c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f4c06fc80 0x7f1f4c1f43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.048+0000 7f1f5364c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f4c158d60 0x7f1f4c156750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.048+0000 7f1f5364c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1f4c1592c0 con 0x7f1f4c06c150 2024-09-15T23:13:50.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.048+0000 7f1f5364c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1f4c159140 con 0x7f1f4c158d60 2024-09-15T23:13:50.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.048+0000 7f1f5364c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1f4c0b2900 con 0x7f1f4c06fc80 2024-09-15T23:13:50.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.048+0000 7f1f513e8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f4c06c150 0x7f1f4c14f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.048+0000 7f1f513e8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f4c06c150 0x7f1f4c14f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47380/0 (socket says 172.21.15.123:47380) 2024-09-15T23:13:50.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.048+0000 7f1f513e8640 1 -- 172.21.15.123:0/688696199 learned_addr learned my addr 172.21.15.123:0/688696199 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:13:50.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.048+0000 7f1f51be9640 1 --2- 172.21.15.123:0/688696199 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f4c158d60 0x7f1f4c156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.048+0000 7f1f50be7640 1 --2- 172.21.15.123:0/688696199 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f4c06fc80 0x7f1f4c1f43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.048+0000 7f1f513e8640 1 -- 172.21.15.123:0/688696199 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f4c06fc80 msgr2=0x7f1f4c1f43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:50.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.048+0000 7f1f513e8640 1 --2- 172.21.15.123:0/688696199 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f4c06fc80 0x7f1f4c1f43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.048+0000 7f1f513e8640 1 -- 172.21.15.123:0/688696199 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f4c158d60 msgr2=0x7f1f4c156750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:50.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.048+0000 7f1f513e8640 1 --2- 172.21.15.123:0/688696199 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f4c158d60 0x7f1f4c156750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.048+0000 7f1f513e8640 1 -- 172.21.15.123:0/688696199 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f4c15a610 con 0x7f1f4c06c150 2024-09-15T23:13:50.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.048+0000 7f1f50be7640 1 --2- 172.21.15.123:0/688696199 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f4c06fc80 0x7f1f4c1f43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:13:50.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.049+0000 7f1f513e8640 1 --2- 172.21.15.123:0/688696199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f4c06c150 0x7f1f4c14f010 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1f44000c00 tx=0x7f1f440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:50.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.049+0000 7f1f49ffb640 1 -- 172.21.15.123:0/688696199 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f44037040 con 0x7f1f4c06c150 2024-09-15T23:13:50.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.049+0000 7f1f49ffb640 1 -- 172.21.15.123:0/688696199 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f44042070 con 0x7f1f4c06c150 2024-09-15T23:13:50.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.049+0000 7f1f49ffb640 1 -- 172.21.15.123:0/688696199 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f44030a70 con 0x7f1f4c06c150 2024-09-15T23:13:50.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.049+0000 7f1f5364c640 1 -- 172.21.15.123:0/688696199 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f4c15a8f0 con 0x7f1f4c06c150 2024-09-15T23:13:50.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.049+0000 7f1f5364c640 1 -- 172.21.15.123:0/688696199 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f4c15aeb0 con 0x7f1f4c06c150 2024-09-15T23:13:50.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.050+0000 7f1f49ffb640 1 -- 172.21.15.123:0/688696199 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1f44030c10 con 0x7f1f4c06c150 2024-09-15T23:13:50.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.051+0000 7f1f49ffb640 1 --2- 172.21.15.123:0/688696199 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1f3806c2b0 0x7f1f3806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.051+0000 7f1f49ffb640 1 -- 172.21.15.123:0/688696199 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f1f440abf10 con 0x7f1f4c06c150 2024-09-15T23:13:50.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.051+0000 7f1f50be7640 1 --2- 172.21.15.123:0/688696199 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1f3806c2b0 0x7f1f3806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.052+0000 7f1f50be7640 1 --2- 172.21.15.123:0/688696199 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1f3806c2b0 0x7f1f3806e770 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1f40007fd0 tx=0x7f1f40005b70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:50.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.052+0000 7f1f563e6740 1 Processor -- start 2024-09-15T23:13:50.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.052+0000 7f1f563e6740 1 -- start start 2024-09-15T23:13:50.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.053+0000 7f1f563e6740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d60f5acb60 0x55d60f5f2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.053+0000 7f1f563e6740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d60f5aa320 0x55d60f5acf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.053+0000 7f1f563e6740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d60f5ae2f0 0x55d60f5a7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.053+0000 7f1f563e6740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d60f56e8c0 con 0x55d60f5ae2f0 2024-09-15T23:13:50.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.053+0000 7f1f563e6740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55d60f50f980 con 0x55d60f5aa320 2024-09-15T23:13:50.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.053+0000 7f1f563e6740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55d60f4b7670 con 0x55d60f5acb60 2024-09-15T23:13:50.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.053+0000 7f1f51be9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d60f5ae2f0 0x55d60f5a7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.053+0000 7f1f51be9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d60f5ae2f0 0x55d60f5a7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47386/0 (socket says 172.21.15.123:47386) 2024-09-15T23:13:50.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.053+0000 7f1f51be9640 1 -- 172.21.15.123:0/2308989647 learned_addr learned my addr 172.21.15.123:0/2308989647 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:13:50.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.053+0000 7f1f513e8640 1 --2- 172.21.15.123:0/2308989647 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d60f5acb60 0x55d60f5f2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.053+0000 7f1f50be7640 1 --2- 172.21.15.123:0/2308989647 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d60f5aa320 0x55d60f5acf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.053+0000 7f1f51be9640 1 -- 172.21.15.123:0/2308989647 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d60f5acb60 msgr2=0x55d60f5f2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:50.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.053+0000 7f1f51be9640 1 --2- 172.21.15.123:0/2308989647 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d60f5acb60 0x55d60f5f2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.053+0000 7f1f51be9640 1 -- 172.21.15.123:0/2308989647 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d60f5aa320 msgr2=0x55d60f5acf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:50.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.053+0000 7f1f51be9640 1 --2- 172.21.15.123:0/2308989647 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d60f5aa320 0x55d60f5acf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.053+0000 7f1f51be9640 1 -- 172.21.15.123:0/2308989647 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d60f2ee940 con 0x55d60f5ae2f0 2024-09-15T23:13:50.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.053+0000 7f1f51be9640 1 --2- 172.21.15.123:0/2308989647 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d60f5ae2f0 0x55d60f5a7150 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c001880 tx=0x7f1f3c007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a526203b3f8638a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:50.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.053+0000 7f1f32ffd640 1 -- 172.21.15.123:0/2308989647 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c0052e0 con 0x55d60f5ae2f0 2024-09-15T23:13:50.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.053+0000 7f1f32ffd640 1 -- 172.21.15.123:0/2308989647 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f3c018070 con 0x55d60f5ae2f0 2024-09-15T23:13:50.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.053+0000 7f1f32ffd640 1 -- 172.21.15.123:0/2308989647 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c00f9b0 con 0x55d60f5ae2f0 2024-09-15T23:13:50.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.054+0000 7f1f563e6740 1 -- 172.21.15.123:0/2308989647 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d60f5ae2f0 msgr2=0x55d60f5a7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:50.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.054+0000 7f1f563e6740 1 --2- 172.21.15.123:0/2308989647 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d60f5ae2f0 0x55d60f5a7150 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c001880 tx=0x7f1f3c007db0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.054+0000 7f1f563e6740 1 -- 172.21.15.123:0/2308989647 shutdown_connections 2024-09-15T23:13:50.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.054+0000 7f1f563e6740 1 --2- 172.21.15.123:0/2308989647 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d60f5ae2f0 0x55d60f5a7150 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.054+0000 7f1f563e6740 1 --2- 172.21.15.123:0/2308989647 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d60f5aa320 0x55d60f5acf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.054+0000 7f1f563e6740 1 --2- 172.21.15.123:0/2308989647 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d60f5acb60 0x55d60f5f2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.054+0000 7f1f563e6740 1 -- 172.21.15.123:0/2308989647 >> 172.21.15.123:0/2308989647 conn(0x55d60f5a9320 msgr2=0x55d60f5f17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:50.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.054+0000 7f1f563e6740 1 -- 172.21.15.123:0/2308989647 shutdown_connections 2024-09-15T23:13:50.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.054+0000 7f1f563e6740 1 -- 172.21.15.123:0/2308989647 wait complete. 2024-09-15T23:13:50.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.055+0000 7f1f563e6740 1 -- start start 2024-09-15T23:13:50.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.055+0000 7f1f563e6740 1 Processor -- start 2024-09-15T23:13:50.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.056+0000 7f1f563e6740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d60f5acb60 0x55d60f6058b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.056+0000 7f1f563e6740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d60f5ae2f0 0x55d60f5c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.056+0000 7f1f563e6740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d60f5d6ac0 0x55d60f5d6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.056+0000 7f1f563e6740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d60f498670 con 0x55d60f5ae2f0 2024-09-15T23:13:50.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.056+0000 7f1f563e6740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55d60f50b940 con 0x55d60f5acb60 2024-09-15T23:13:50.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.056+0000 7f1f563e6740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55d60f5a87c0 con 0x55d60f5d6ac0 2024-09-15T23:13:50.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.056+0000 7f1f563e6740 10 client.0 _ll_register_callbacks cb 0x55d60f221d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:13:50.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.056+0000 7f1f50be7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d60f5ae2f0 0x55d60f5c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.056+0000 7f1f513e8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d60f5acb60 0x55d60f6058b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.056+0000 7f1f513e8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d60f5acb60 0x55d60f6058b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:38446/0 (socket says 172.21.15.123:38446) 2024-09-15T23:13:50.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.056+0000 7f1f50be7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d60f5ae2f0 0x55d60f5c5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47398/0 (socket says 172.21.15.123:47398) 2024-09-15T23:13:50.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.056+0000 7f1f513e8640 1 -- 172.21.15.123:0/1931908665 learned_addr learned my addr 172.21.15.123:0/1931908665 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:13:50.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.056+0000 7f1f51be9640 1 --2- 172.21.15.123:0/1931908665 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d60f5d6ac0 0x55d60f5d6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.056+0000 7f1f513e8640 1 -- 172.21.15.123:0/1931908665 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d60f5d6ac0 msgr2=0x55d60f5d6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:50.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.056+0000 7f1f513e8640 1 --2- 172.21.15.123:0/1931908665 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d60f5d6ac0 0x55d60f5d6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.056+0000 7f1f513e8640 1 -- 172.21.15.123:0/1931908665 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d60f5ae2f0 msgr2=0x55d60f5c5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:50.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.056+0000 7f1f513e8640 1 --2- 172.21.15.123:0/1931908665 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d60f5ae2f0 0x55d60f5c5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.056+0000 7f1f513e8640 1 -- 172.21.15.123:0/1931908665 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d60f34f0d0 con 0x55d60f5acb60 2024-09-15T23:13:50.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.056+0000 7f1f50be7640 1 --2- 172.21.15.123:0/1931908665 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d60f5ae2f0 0x55d60f5c5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:13:50.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.056+0000 7f1f513e8640 1 --2- 172.21.15.123:0/1931908665 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d60f5acb60 0x55d60f6058b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1f4402a150 tx=0x7f1f44079b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79b0e3c8b1b3782c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:50.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.056+0000 7f1f27fff640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-09-15T23:13:50.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.056+0000 7f1f27fff640 1 -- 172.21.15.123:0/1931908665 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4407a360 con 0x55d60f5acb60 2024-09-15T23:13:50.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.056+0000 7f1f563e6740 1 -- 172.21.15.123:0/1931908665 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f3c018070 con 0x55d60f5acb60 2024-09-15T23:13:50.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.056+0000 7f1f27fff640 1 -- 172.21.15.123:0/1931908665 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f1f44082650 con 0x55d60f5acb60 2024-09-15T23:13:50.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.056+0000 7f1f27fff640 1 -- 172.21.15.123:0/1931908665 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f1f440aa050 con 0x55d60f5acb60 2024-09-15T23:13:50.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.057+0000 7f1f563e6740 10 client.4861 fetch_fsmap learned FSMap version 14 2024-09-15T23:13:50.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.057+0000 7f1f563e6740 1 -- 172.21.15.123:0/1931908665 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55d60f1e2230 con 0x55d60f5acb60 2024-09-15T23:13:50.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.057+0000 7f1f27fff640 1 -- 172.21.15.123:0/1931908665 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f3c018070 con 0x55d60f5acb60 2024-09-15T23:13:50.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.057+0000 7f1f27fff640 1 -- 172.21.15.123:0/1931908665 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7f1f4403a030 con 0x55d60f5acb60 2024-09-15T23:13:50.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.057+0000 7f1f563e6740 10 client.4861 fetch_fsmap finished waiting for FSMap version 14 2024-09-15T23:13:50.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.057+0000 7f1f563e6740 10 client.4861 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-15T23:13:50.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.057+0000 7f1f563e6740 20 client.4861 populate_metadata read hostname 'smithi123' 2024-09-15T23:13:50.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.057+0000 7f1f563e6740 1 --2- 172.21.15.123:0/1931908665 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x55d60f5d9850 0x55d60f5d9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.057+0000 7f1f563e6740 4 client.4861 mds_command: new command op to 4776 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:13:50.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.057+0000 7f1f563e6740 1 -- 172.21.15.123:0/1931908665 --> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d60f51d0b0 con 0x55d60f5d9850 2024-09-15T23:13:50.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.057+0000 7f1f50be7640 1 --2- 172.21.15.123:0/1931908665 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x55d60f5d9850 0x55d60f5d9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.057+0000 7f1f27fff640 10 client.4861 ms_handle_connect on v2:172.21.15.123:6834/1577644605 2024-09-15T23:13:50.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.057+0000 7f1f50be7640 1 --2- 172.21.15.123:0/1931908665 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x55d60f5d9850 0x55d60f5d9cb0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4231bc6215c7e4d3 server_cookie=81e3add60dc712a3 in_seq=0 out_seq=0 2024-09-15T23:13:50.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.058+0000 7f1f27fff640 1 -- 172.21.15.123:0/1931908665 <== mds.0 v2:172.21.15.123:6834/1577644605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d60f51d0b0 con 0x55d60f5d9850 2024-09-15T23:13:50.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.058+0000 7f1f27fff640 10 client.4861 handle_command_reply: tid=0 2024-09-15T23:13:50.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.058+0000 7f1f563e6740 1 client.4861 shutdown 2024-09-15T23:13:50.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.058+0000 7f1f563e6740 1 -- 172.21.15.123:0/1931908665 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d60f5acb60 msgr2=0x55d60f6058b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:50.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.058+0000 7f1f563e6740 1 --2- 172.21.15.123:0/1931908665 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d60f5acb60 0x55d60f6058b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1f4402a150 tx=0x7f1f44079b00 comp rx=0 tx=0).stop 2024-09-15T23:13:50.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.058+0000 7f1f563e6740 1 -- 172.21.15.123:0/1931908665 shutdown_connections 2024-09-15T23:13:50.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.058+0000 7f1f563e6740 1 --2- 172.21.15.123:0/1931908665 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d60f5d6ac0 0x55d60f5d6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.058+0000 7f1f563e6740 1 --2- 172.21.15.123:0/1931908665 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x55d60f5d9850 0x55d60f5d9cb0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.058+0000 7f1f563e6740 1 --2- 172.21.15.123:0/1931908665 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d60f5ae2f0 0x55d60f5c5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.058+0000 7f1f27fff640 0 client.4861 ms_handle_reset on v2:172.21.15.123:6834/1577644605 2024-09-15T23:13:50.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.058+0000 7f1f563e6740 1 --2- 172.21.15.123:0/1931908665 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d60f5acb60 0x55d60f6058b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.058+0000 7f1f563e6740 1 -- 172.21.15.123:0/1931908665 >> 172.21.15.123:0/1931908665 conn(0x55d60f5aa320 msgr2=0x55d60f5f3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:50.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.058+0000 7f1f563e6740 1 -- 172.21.15.123:0/1931908665 shutdown_connections 2024-09-15T23:13:50.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.058+0000 7f1f563e6740 1 -- 172.21.15.123:0/1931908665 wait complete. 2024-09-15T23:13:50.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.058+0000 7f1f563e6740 20 client.4861 trim_cache size 0 max 16384 2024-09-15T23:13:50.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.075+0000 7f1f563e6740 1 Processor -- start 2024-09-15T23:13:50.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.075+0000 7f1f563e6740 1 -- start start 2024-09-15T23:13:50.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.076+0000 7f1f563e6740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d60f5acb60 0x55d60f5d59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.076+0000 7f1f563e6740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d60f5ae2f0 0x55d60f603f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.076+0000 7f1f563e6740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d60f5d6ac0 0x55d60f604450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.076+0000 7f1f563e6740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1f4c200b10 con 0x55d60f5d6ac0 2024-09-15T23:13:50.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.076+0000 7f1f563e6740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1f4c1ffc80 con 0x55d60f5ae2f0 2024-09-15T23:13:50.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.076+0000 7f1f563e6740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1f4c1f7be0 con 0x55d60f5acb60 2024-09-15T23:13:50.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.076+0000 7f1f51be9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d60f5d6ac0 0x55d60f604450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.076+0000 7f1f51be9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d60f5d6ac0 0x55d60f604450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47414/0 (socket says 172.21.15.123:47414) 2024-09-15T23:13:50.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.076+0000 7f1f51be9640 1 -- 172.21.15.123:0/3629734856 learned_addr learned my addr 172.21.15.123:0/3629734856 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:13:50.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.076+0000 7f1f513e8640 1 --2- 172.21.15.123:0/3629734856 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d60f5acb60 0x55d60f5d59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.076+0000 7f1f50be7640 1 --2- 172.21.15.123:0/3629734856 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d60f5ae2f0 0x55d60f603f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.076+0000 7f1f51be9640 1 -- 172.21.15.123:0/3629734856 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d60f5acb60 msgr2=0x55d60f5d59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:50.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.076+0000 7f1f51be9640 1 --2- 172.21.15.123:0/3629734856 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d60f5acb60 0x55d60f5d59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.076+0000 7f1f51be9640 1 -- 172.21.15.123:0/3629734856 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d60f5ae2f0 msgr2=0x55d60f603f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:50.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.076+0000 7f1f51be9640 1 --2- 172.21.15.123:0/3629734856 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d60f5ae2f0 0x55d60f603f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.076+0000 7f1f51be9640 1 -- 172.21.15.123:0/3629734856 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d60f5a1b50 con 0x55d60f5d6ac0 2024-09-15T23:13:50.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.076+0000 7f1f51be9640 1 --2- 172.21.15.123:0/3629734856 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d60f5d6ac0 0x55d60f604450 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00f5a0 tx=0x7f1f3c00a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee2627e65d9f4a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:50.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.076+0000 7f1f327fc640 1 -- 172.21.15.123:0/3629734856 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c007020 con 0x55d60f5d6ac0 2024-09-15T23:13:50.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.077+0000 7f1f327fc640 1 -- 172.21.15.123:0/3629734856 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f3c018020 con 0x55d60f5d6ac0 2024-09-15T23:13:50.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.077+0000 7f1f327fc640 1 -- 172.21.15.123:0/3629734856 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c007420 con 0x55d60f5d6ac0 2024-09-15T23:13:50.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.077+0000 7f1f563e6740 1 -- 172.21.15.123:0/3629734856 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d60f5d6ac0 msgr2=0x55d60f604450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:50.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.077+0000 7f1f563e6740 1 --2- 172.21.15.123:0/3629734856 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d60f5d6ac0 0x55d60f604450 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00f5a0 tx=0x7f1f3c00a000 comp rx=0 tx=0).stop 2024-09-15T23:13:50.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.077+0000 7f1f563e6740 1 -- 172.21.15.123:0/3629734856 shutdown_connections 2024-09-15T23:13:50.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.077+0000 7f1f563e6740 1 --2- 172.21.15.123:0/3629734856 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d60f5d6ac0 0x55d60f604450 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.077+0000 7f1f563e6740 1 --2- 172.21.15.123:0/3629734856 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d60f5ae2f0 0x55d60f603f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.077+0000 7f1f563e6740 1 --2- 172.21.15.123:0/3629734856 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d60f5acb60 0x55d60f5d59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.077+0000 7f1f563e6740 1 -- 172.21.15.123:0/3629734856 >> 172.21.15.123:0/3629734856 conn(0x55d60f5aa320 msgr2=0x55d60f5a8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:50.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.077+0000 7f1f563e6740 1 -- 172.21.15.123:0/3629734856 shutdown_connections 2024-09-15T23:13:50.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.077+0000 7f1f563e6740 1 -- 172.21.15.123:0/3629734856 wait complete. 2024-09-15T23:13:50.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.078+0000 7f1f563e6740 1 -- start start 2024-09-15T23:13:50.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.078+0000 7f1f563e6740 1 Processor -- start 2024-09-15T23:13:50.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.079+0000 7f1f563e6740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d60f5acb60 0x55d60f66ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.079+0000 7f1f563e6740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d60f5ae2f0 0x55d60f66f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.079+0000 7f1f563e6740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d60f5d6ac0 0x55d60f604fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.079+0000 7f1f563e6740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1f4c1f8230 con 0x55d60f5ae2f0 2024-09-15T23:13:50.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.079+0000 7f1f563e6740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55d60f51d0b0 con 0x55d60f5d6ac0 2024-09-15T23:13:50.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.079+0000 7f1f563e6740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55d60f66f750 con 0x55d60f5acb60 2024-09-15T23:13:50.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.079+0000 7f1f563e6740 10 client.0 _ll_register_callbacks cb 0x7f1f44076270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:13:50.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.079+0000 7f1f50be7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d60f5ae2f0 0x55d60f66f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.079+0000 7f1f50be7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d60f5ae2f0 0x55d60f66f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47424/0 (socket says 172.21.15.123:47424) 2024-09-15T23:13:50.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.079+0000 7f1f50be7640 1 -- 172.21.15.123:0/2956163742 learned_addr learned my addr 172.21.15.123:0/2956163742 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:13:50.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.079+0000 7f1f513e8640 1 --2- 172.21.15.123:0/2956163742 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d60f5acb60 0x55d60f66ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.079+0000 7f1f51be9640 1 --2- 172.21.15.123:0/2956163742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d60f5d6ac0 0x55d60f604fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.079+0000 7f1f50be7640 1 -- 172.21.15.123:0/2956163742 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d60f5acb60 msgr2=0x55d60f66ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:50.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.079+0000 7f1f50be7640 1 --2- 172.21.15.123:0/2956163742 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d60f5acb60 0x55d60f66ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.079+0000 7f1f50be7640 1 -- 172.21.15.123:0/2956163742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d60f5d6ac0 msgr2=0x55d60f604fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:50.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.079+0000 7f1f50be7640 1 --2- 172.21.15.123:0/2956163742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d60f5d6ac0 0x55d60f604fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.079+0000 7f1f50be7640 1 -- 172.21.15.123:0/2956163742 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d60f5d0d20 con 0x55d60f5ae2f0 2024-09-15T23:13:50.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.079+0000 7f1f50be7640 1 --2- 172.21.15.123:0/2956163742 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d60f5ae2f0 0x55d60f66f1b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c1582d0 tx=0x7f1f40011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa1ec2c78a9436dd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:50.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.079+0000 7f1f27fff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:13:50.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.079+0000 7f1f27fff640 1 -- 172.21.15.123:0/2956163742 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f40025d40 con 0x55d60f5ae2f0 2024-09-15T23:13:50.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.079+0000 7f1f27fff640 1 -- 172.21.15.123:0/2956163742 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f1f40010040 con 0x55d60f5ae2f0 2024-09-15T23:13:50.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.079+0000 7f1f563e6740 1 -- 172.21.15.123:0/2956163742 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f3c018020 con 0x55d60f5ae2f0 2024-09-15T23:13:50.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.079+0000 7f1f27fff640 1 -- 172.21.15.123:0/2956163742 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f1f40035050 con 0x55d60f5ae2f0 2024-09-15T23:13:50.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.079+0000 7f1f563e6740 10 client.5043 fetch_fsmap learned FSMap version 14 2024-09-15T23:13:50.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.079+0000 7f1f563e6740 1 -- 172.21.15.123:0/2956163742 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55d60f604620 con 0x55d60f5ae2f0 2024-09-15T23:13:50.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.080+0000 7f1f27fff640 1 -- 172.21.15.123:0/2956163742 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f3c018020 con 0x55d60f5ae2f0 2024-09-15T23:13:50.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.080+0000 7f1f27fff640 1 -- 172.21.15.123:0/2956163742 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7f1f40038020 con 0x55d60f5ae2f0 2024-09-15T23:13:50.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.080+0000 7f1f563e6740 10 client.5043 fetch_fsmap finished waiting for FSMap version 14 2024-09-15T23:13:50.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.080+0000 7f1f563e6740 10 client.5043 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-15T23:13:50.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.080+0000 7f1f563e6740 20 client.5043 populate_metadata read hostname 'smithi123' 2024-09-15T23:13:50.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.080+0000 7f1f563e6740 1 --2- 172.21.15.123:0/2956163742 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x55d60f605520 0x55d60f5ef850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.080+0000 7f1f563e6740 4 client.5043 mds_command: new command op to 4776 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "scrub_mdsdir"]}] 2024-09-15T23:13:50.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.080+0000 7f1f563e6740 1 -- 172.21.15.123:0/2956163742 --> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "scrub_mdsdir"]}) -- 0x55d60f517400 con 0x55d60f605520 2024-09-15T23:13:50.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.080+0000 7f1f513e8640 1 --2- 172.21.15.123:0/2956163742 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x55d60f605520 0x55d60f5ef850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.080+0000 7f1f27fff640 10 client.5043 ms_handle_connect on v2:172.21.15.123:6834/1577644605 2024-09-15T23:13:50.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.080+0000 7f1f513e8640 1 --2- 172.21.15.123:0/2956163742 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x55d60f605520 0x55d60f5ef850 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42699b903d22f258 server_cookie=8b6c24a5a405a2e5 in_seq=0 out_seq=0 2024-09-15T23:13:50.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.085+0000 7f1f27fff640 1 -- 172.21.15.123:0/2956163742 <== mds.0 v2:172.21.15.123:6834/1577644605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d60f517400 con 0x55d60f605520 2024-09-15T23:13:50.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.085+0000 7f1f27fff640 10 client.5043 handle_command_reply: tid=0 2024-09-15T23:13:50.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.085+0000 7f1f563e6740 1 client.5043 shutdown 2024-09-15T23:13:50.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.085+0000 7f1f563e6740 1 -- 172.21.15.123:0/2956163742 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d60f5ae2f0 msgr2=0x55d60f66f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:50.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.085+0000 7f1f563e6740 1 --2- 172.21.15.123:0/2956163742 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d60f5ae2f0 0x55d60f66f1b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c1582d0 tx=0x7f1f40011000 comp rx=0 tx=0).stop 2024-09-15T23:13:50.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.085+0000 7f1f563e6740 1 -- 172.21.15.123:0/2956163742 shutdown_connections 2024-09-15T23:13:50.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.085+0000 7f1f563e6740 1 --2- 172.21.15.123:0/2956163742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d60f5d6ac0 0x55d60f604fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.085+0000 7f1f563e6740 1 --2- 172.21.15.123:0/2956163742 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x55d60f605520 0x55d60f5ef850 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.085+0000 7f1f563e6740 1 --2- 172.21.15.123:0/2956163742 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d60f5ae2f0 0x55d60f66f1b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.085+0000 7f1f563e6740 1 --2- 172.21.15.123:0/2956163742 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d60f5acb60 0x55d60f66ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.085+0000 7f1f27fff640 0 client.5043 ms_handle_reset on v2:172.21.15.123:6834/1577644605 2024-09-15T23:13:50.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.085+0000 7f1f563e6740 1 -- 172.21.15.123:0/2956163742 >> 172.21.15.123:0/2956163742 conn(0x55d60f5aa320 msgr2=0x55d60f603f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:50.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.085+0000 7f1f563e6740 1 -- 172.21.15.123:0/2956163742 shutdown_connections 2024-09-15T23:13:50.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.085+0000 7f1f563e6740 1 -- 172.21.15.123:0/2956163742 wait complete. 2024-09-15T23:13:50.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.085+0000 7f1f563e6740 20 client.5043 trim_cache size 0 max 16384 2024-09-15T23:13:50.089 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:13:50.089 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0, 2024-09-15T23:13:50.089 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_tag": "a619d348-da86-401e-af1b-706dcfc2a95a", 2024-09-15T23:13:50.089 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": "asynchronous" 2024-09-15T23:13:50.089 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:13:50.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.086+0000 7f1f5364c640 1 -- 172.21.15.123:0/688696199 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1f3806c2b0 msgr2=0x7f1f3806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:50.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.086+0000 7f1f5364c640 1 --2- 172.21.15.123:0/688696199 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1f3806c2b0 0x7f1f3806e770 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1f40007fd0 tx=0x7f1f40005b70 comp rx=0 tx=0).stop 2024-09-15T23:13:50.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.086+0000 7f1f5364c640 1 -- 172.21.15.123:0/688696199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f4c06c150 msgr2=0x7f1f4c14f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:50.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.086+0000 7f1f5364c640 1 --2- 172.21.15.123:0/688696199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f4c06c150 0x7f1f4c14f010 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1f44000c00 tx=0x7f1f440046c0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.086+0000 7f1f5364c640 1 -- 172.21.15.123:0/688696199 shutdown_connections 2024-09-15T23:13:50.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.086+0000 7f1f5364c640 1 --2- 172.21.15.123:0/688696199 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f4c158d60 0x7f1f4c156750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.086+0000 7f1f5364c640 1 --2- 172.21.15.123:0/688696199 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f4c06fc80 0x7f1f4c1f43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.086+0000 7f1f5364c640 1 --2- 172.21.15.123:0/688696199 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1f3806c2b0 0x7f1f3806e770 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.086+0000 7f1f5364c640 1 --2- 172.21.15.123:0/688696199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f4c06c150 0x7f1f4c14f010 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.086+0000 7f1f5364c640 1 -- 172.21.15.123:0/688696199 >> 172.21.15.123:0/688696199 conn(0x7f1f4c067da0 msgr2=0x7f1f4c0ae870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:50.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.086+0000 7f1f5364c640 1 -- 172.21.15.123:0/688696199 shutdown_connections 2024-09-15T23:13:50.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.086+0000 7f1f5364c640 1 -- 172.21.15.123:0/688696199 wait complete. 2024-09-15T23:13:50.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:13:50.098 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-09-15T23:13:50.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.220+0000 7f4709f52640 1 Processor -- start 2024-09-15T23:13:50.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.221+0000 7f4709f52640 1 -- start start 2024-09-15T23:13:50.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.222+0000 7f4709f52640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f470415e950 0x7f47040d3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.222+0000 7f4709f52640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f47040ba0d0 0x7f470406d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.222+0000 7f4709f52640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f470406e060 con 0x7f470406dc50 2024-09-15T23:13:50.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.222+0000 7f4709f52640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f47040d2f20 con 0x7f47040ba0d0 2024-09-15T23:13:50.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.222+0000 7f4709f52640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f47040d3200 con 0x7f470415e950 2024-09-15T23:13:50.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.222+0000 7f4702ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f47040ba0d0 0x7f470406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.222+0000 7f4703fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f470406dc50 0x7f47040b78e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58354/0 (socket says 172.21.15.123:58354) 2024-09-15T23:13:50.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.222+0000 7f4703fff640 1 -- 172.21.15.123:0/3112024595 learned_addr learned my addr 172.21.15.123:0/3112024595 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:13:50.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.222+0000 7f47037fe640 1 --2- 172.21.15.123:0/3112024595 >> v2:172.21.15.188:3300/0 conn(0x7f470415e950 0x7f47040d3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.222+0000 7f4702ffd640 1 -- 172.21.15.123:0/3112024595 >> v2:172.21.15.188:3300/0 conn(0x7f470415e950 msgr2=0x7f47040d3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:50.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.222+0000 7f4702ffd640 1 --2- 172.21.15.123:0/3112024595 >> v2:172.21.15.188:3300/0 conn(0x7f470415e950 0x7f47040d3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.222+0000 7f4702ffd640 1 -- 172.21.15.123:0/3112024595 >> v1:172.21.15.123:6789/0 conn(0x7f470406dc50 legacy=0x7f47040b78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:50.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.222+0000 7f4702ffd640 1 -- 172.21.15.123:0/3112024595 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47040d34e0 con 0x7f47040ba0d0 2024-09-15T23:13:50.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.223+0000 7f4702ffd640 1 --2- 172.21.15.123:0/3112024595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47040ba0d0 0x7f470406d710 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f47040b7240 tx=0x7f46f802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b0826e63c43f1fb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:50.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.224+0000 7f47027fc640 1 -- 172.21.15.123:0/3112024595 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f8037070 con 0x7f47040ba0d0 2024-09-15T23:13:50.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.224+0000 7f47027fc640 1 -- 172.21.15.123:0/3112024595 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46f8032440 con 0x7f47040ba0d0 2024-09-15T23:13:50.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.224+0000 7f47027fc640 1 -- 172.21.15.123:0/3112024595 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f8032810 con 0x7f47040ba0d0 2024-09-15T23:13:50.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.225+0000 7f4709f52640 1 -- 172.21.15.123:0/3112024595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47040ba0d0 msgr2=0x7f470406d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:50.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.225+0000 7f4709f52640 1 --2- 172.21.15.123:0/3112024595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47040ba0d0 0x7f470406d710 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f47040b7240 tx=0x7f46f802a1a0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.225+0000 7f4709f52640 1 -- 172.21.15.123:0/3112024595 shutdown_connections 2024-09-15T23:13:50.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.225+0000 7f4709f52640 1 --2- 172.21.15.123:0/3112024595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f47040ba0d0 0x7f470406d710 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.225+0000 7f4709f52640 1 --2- 172.21.15.123:0/3112024595 >> v2:172.21.15.188:3300/0 conn(0x7f470415e950 0x7f47040d3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.225+0000 7f4709f52640 1 -- 172.21.15.123:0/3112024595 >> 172.21.15.123:0/3112024595 conn(0x7f47040d4740 msgr2=0x7f47040d4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:50.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.225+0000 7f4709f52640 1 -- 172.21.15.123:0/3112024595 shutdown_connections 2024-09-15T23:13:50.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.225+0000 7f4709f52640 1 -- 172.21.15.123:0/3112024595 wait complete. 2024-09-15T23:13:50.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.227+0000 7f4709f52640 1 Processor -- start 2024-09-15T23:13:50.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.227+0000 7f4709f52640 1 -- start start 2024-09-15T23:13:50.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.228+0000 7f4709f52640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f470406dc50 0x7f4704161880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.228+0000 7f4709f52640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f470415e950 0x7f47040cb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.228+0000 7f4709f52640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47040ca680 0x7f47040cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.228+0000 7f4709f52640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f47040d2b80 con 0x7f470415e950 2024-09-15T23:13:50.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.228+0000 7f4709f52640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f470415ed30 con 0x7f470406dc50 2024-09-15T23:13:50.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.228+0000 7f4709f52640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f47040d2d00 con 0x7f47040ca680 2024-09-15T23:13:50.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.228+0000 7f47037fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f470406dc50 0x7f4704161880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.228+0000 7f4702ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f470415e950 0x7f47040cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.228+0000 7f47037fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f470406dc50 0x7f4704161880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:38482/0 (socket says 172.21.15.123:38482) 2024-09-15T23:13:50.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.228+0000 7f47037fe640 1 -- 172.21.15.123:0/585473076 learned_addr learned my addr 172.21.15.123:0/585473076 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:13:50.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.228+0000 7f4703fff640 1 --2- 172.21.15.123:0/585473076 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47040ca680 0x7f47040cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.229+0000 7f4702ffd640 1 -- 172.21.15.123:0/585473076 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47040ca680 msgr2=0x7f47040cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:50.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.229+0000 7f4702ffd640 1 --2- 172.21.15.123:0/585473076 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47040ca680 0x7f47040cbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.229+0000 7f4702ffd640 1 -- 172.21.15.123:0/585473076 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f470406dc50 msgr2=0x7f4704161880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:50.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.229+0000 7f4702ffd640 1 --2- 172.21.15.123:0/585473076 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f470406dc50 0x7f4704161880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.229+0000 7f4702ffd640 1 -- 172.21.15.123:0/585473076 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47040cd9c0 con 0x7f470415e950 2024-09-15T23:13:50.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.229+0000 7f47037fe640 1 --2- 172.21.15.123:0/585473076 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f470406dc50 0x7f4704161880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:13:50.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.229+0000 7f4702ffd640 1 --2- 172.21.15.123:0/585473076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f470415e950 0x7f47040cb810 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f46f8031000 tx=0x7f46f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:50.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.229+0000 7f46ebfff640 1 -- 172.21.15.123:0/585473076 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f8037040 con 0x7f470415e950 2024-09-15T23:13:50.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.229+0000 7f46ebfff640 1 -- 172.21.15.123:0/585473076 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46f8004230 con 0x7f470415e950 2024-09-15T23:13:50.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.229+0000 7f4709f52640 1 -- 172.21.15.123:0/585473076 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47040c9f80 con 0x7f470415e950 2024-09-15T23:13:50.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.229+0000 7f46ebfff640 1 -- 172.21.15.123:0/585473076 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f8006e10 con 0x7f470415e950 2024-09-15T23:13:50.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.229+0000 7f4709f52640 1 -- 172.21.15.123:0/585473076 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47040cdf40 con 0x7f470415e950 2024-09-15T23:13:50.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.232+0000 7f46ebfff640 1 -- 172.21.15.123:0/585473076 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f46f80306f0 con 0x7f470415e950 2024-09-15T23:13:50.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.232+0000 7f46ebfff640 1 --2- 172.21.15.123:0/585473076 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f46f006c2e0 0x7f46f006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.233+0000 7f47037fe640 1 --2- 172.21.15.123:0/585473076 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f46f006c2e0 0x7f46f006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.233+0000 7f46ebfff640 1 -- 172.21.15.123:0/585473076 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f46f80ab740 con 0x7f470415e950 2024-09-15T23:13:50.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.233+0000 7f47037fe640 1 --2- 172.21.15.123:0/585473076 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f46f006c2e0 0x7f46f006e7a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f46f4007e50 tx=0x7f46f4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:50.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.233+0000 7f470cdc9740 1 Processor -- start 2024-09-15T23:13:50.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.234+0000 7f470cdc9740 1 -- start start 2024-09-15T23:13:50.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.235+0000 7f470cdc9740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5584eb2c2920 0x5584eb3080c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.235+0000 7f470cdc9740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5584eb2c00e0 0x5584eb2c2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.235+0000 7f470cdc9740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5584eb2c40b0 0x5584eb2bd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.235+0000 7f470cdc9740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5584eb2256f0 con 0x5584eb2c2920 2024-09-15T23:13:50.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.235+0000 7f470cdc9740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5584eb1cd330 con 0x5584eb2c40b0 2024-09-15T23:13:50.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.235+0000 7f470cdc9740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5584eb2216b0 con 0x5584eb2c00e0 2024-09-15T23:13:50.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.235+0000 7f47037fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5584eb2c2920 0x5584eb3080c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.235+0000 7f4702ffd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5584eb2c00e0 0x5584eb2c2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.235+0000 7f4702ffd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5584eb2c00e0 0x5584eb2c2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:46292/0 (socket says 172.21.15.123:46292) 2024-09-15T23:13:50.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.235+0000 7f4703fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5584eb2c40b0 0x5584eb2bd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.235+0000 7f4702ffd640 1 -- 172.21.15.123:0/2762942625 learned_addr learned my addr 172.21.15.123:0/2762942625 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:13:50.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.235+0000 7f4702ffd640 1 -- 172.21.15.123:0/2762942625 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5584eb2c40b0 msgr2=0x5584eb2bd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:50.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.235+0000 7f4702ffd640 1 --2- 172.21.15.123:0/2762942625 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5584eb2c40b0 0x5584eb2bd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.235+0000 7f4702ffd640 1 -- 172.21.15.123:0/2762942625 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5584eb2c2920 msgr2=0x5584eb3080c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:50.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.236+0000 7f4702ffd640 1 --2- 172.21.15.123:0/2762942625 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5584eb2c2920 0x5584eb3080c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.236+0000 7f4702ffd640 1 -- 172.21.15.123:0/2762942625 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584eb1f30d0 con 0x5584eb2c00e0 2024-09-15T23:13:50.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.236+0000 7f4702ffd640 1 --2- 172.21.15.123:0/2762942625 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5584eb2c00e0 0x5584eb2c2d00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f46f8081ef0 tx=0x7f46f8009190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d1ed07d8f99d27b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:50.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.236+0000 7f46e97fa640 1 -- 172.21.15.123:0/2762942625 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f807dbf0 con 0x5584eb2c00e0 2024-09-15T23:13:50.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.236+0000 7f46e97fa640 1 -- 172.21.15.123:0/2762942625 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46f8082420 con 0x5584eb2c00e0 2024-09-15T23:13:50.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.236+0000 7f46e97fa640 1 -- 172.21.15.123:0/2762942625 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f8077bf0 con 0x5584eb2c00e0 2024-09-15T23:13:50.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.237+0000 7f470cdc9740 1 -- 172.21.15.123:0/2762942625 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5584eb2c00e0 msgr2=0x5584eb2c2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:50.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.237+0000 7f470cdc9740 1 --2- 172.21.15.123:0/2762942625 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5584eb2c00e0 0x5584eb2c2d00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f46f8081ef0 tx=0x7f46f8009190 comp rx=0 tx=0).stop 2024-09-15T23:13:50.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.237+0000 7f470cdc9740 1 -- 172.21.15.123:0/2762942625 shutdown_connections 2024-09-15T23:13:50.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.237+0000 7f470cdc9740 1 --2- 172.21.15.123:0/2762942625 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5584eb2c40b0 0x5584eb2bd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.237+0000 7f470cdc9740 1 --2- 172.21.15.123:0/2762942625 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5584eb2c00e0 0x5584eb2c2d00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.237+0000 7f470cdc9740 1 --2- 172.21.15.123:0/2762942625 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5584eb2c2920 0x5584eb3080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.237+0000 7f470cdc9740 1 -- 172.21.15.123:0/2762942625 >> 172.21.15.123:0/2762942625 conn(0x5584eb2bf370 msgr2=0x5584eb307590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:50.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.238+0000 7f470cdc9740 1 -- 172.21.15.123:0/2762942625 shutdown_connections 2024-09-15T23:13:50.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.238+0000 7f470cdc9740 1 -- 172.21.15.123:0/2762942625 wait complete. 2024-09-15T23:13:50.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.238+0000 7f470cdc9740 1 -- start start 2024-09-15T23:13:50.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.238+0000 7f470cdc9740 1 Processor -- start 2024-09-15T23:13:50.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.240+0000 7f470cdc9740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5584eb2c2920 0x5584eb2e26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.240+0000 7f470cdc9740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5584eb2c40b0 0x5584eb2e13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.240+0000 7f470cdc9740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5584eb2e3b10 0x5584eb2c1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.240+0000 7f470cdc9740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5584eb2216b0 con 0x5584eb2e3b10 2024-09-15T23:13:50.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.240+0000 7f470cdc9740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5584eb1ae4f0 con 0x5584eb2c40b0 2024-09-15T23:13:50.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.240+0000 7f470cdc9740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5584eb2be810 con 0x5584eb2c2920 2024-09-15T23:13:50.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.240+0000 7f470cdc9740 10 client.0 _ll_register_callbacks cb 0x5584eb1cfb50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:13:50.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.240+0000 7f4702ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5584eb2c40b0 0x5584eb2e13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.240+0000 7f4702ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5584eb2c40b0 0x5584eb2e13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:38502/0 (socket says 172.21.15.123:38502) 2024-09-15T23:13:50.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.240+0000 7f4702ffd640 1 -- 172.21.15.123:0/3942530737 learned_addr learned my addr 172.21.15.123:0/3942530737 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:13:50.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.240+0000 7f4703fff640 1 --2- 172.21.15.123:0/3942530737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5584eb2e3b10 0x5584eb2c1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.240+0000 7f47037fe640 1 --2- 172.21.15.123:0/3942530737 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5584eb2c2920 0x5584eb2e26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.240+0000 7f4702ffd640 1 -- 172.21.15.123:0/3942530737 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5584eb2c2920 msgr2=0x5584eb2e26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:50.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.240+0000 7f4702ffd640 1 --2- 172.21.15.123:0/3942530737 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5584eb2c2920 0x5584eb2e26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.240+0000 7f4702ffd640 1 -- 172.21.15.123:0/3942530737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5584eb2e3b10 msgr2=0x5584eb2c1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:50.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.240+0000 7f4702ffd640 1 --2- 172.21.15.123:0/3942530737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5584eb2e3b10 0x5584eb2c1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.240+0000 7f4702ffd640 1 -- 172.21.15.123:0/3942530737 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584eb0027d0 con 0x5584eb2c40b0 2024-09-15T23:13:50.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.240+0000 7f47037fe640 1 --2- 172.21.15.123:0/3942530737 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5584eb2c2920 0x5584eb2e26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:13:50.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.241+0000 7f4702ffd640 1 --2- 172.21.15.123:0/3942530737 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5584eb2c40b0 0x5584eb2e13d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f46f8079ab0 tx=0x7f46f802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a37f5575eb8c895c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:50.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.241+0000 7f46e27fc640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-09-15T23:13:50.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.241+0000 7f46e27fc640 1 -- 172.21.15.123:0/3942530737 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f807dbf0 con 0x5584eb2c40b0 2024-09-15T23:13:50.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.241+0000 7f470cdc9740 1 -- 172.21.15.123:0/3942530737 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46f8082420 con 0x5584eb2c40b0 2024-09-15T23:13:50.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.241+0000 7f46e27fc640 1 -- 172.21.15.123:0/3942530737 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f46f8075f60 con 0x5584eb2c40b0 2024-09-15T23:13:50.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.241+0000 7f46e27fc640 1 -- 172.21.15.123:0/3942530737 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f46f8081f90 con 0x5584eb2c40b0 2024-09-15T23:13:50.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.241+0000 7f470cdc9740 10 client.4873 fetch_fsmap learned FSMap version 14 2024-09-15T23:13:50.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.241+0000 7f470cdc9740 1 -- 172.21.15.123:0/3942530737 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x5584eaf383f0 con 0x5584eb2c40b0 2024-09-15T23:13:50.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.241+0000 7f46e27fc640 1 -- 172.21.15.123:0/3942530737 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46f8082420 con 0x5584eb2c40b0 2024-09-15T23:13:50.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.242+0000 7f46e27fc640 1 -- 172.21.15.123:0/3942530737 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7f46f8044030 con 0x5584eb2c40b0 2024-09-15T23:13:50.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.242+0000 7f470cdc9740 10 client.4873 fetch_fsmap finished waiting for FSMap version 14 2024-09-15T23:13:50.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.242+0000 7f470cdc9740 10 client.4873 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-15T23:13:50.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.242+0000 7f470cdc9740 20 client.4873 populate_metadata read hostname 'smithi123' 2024-09-15T23:13:50.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.242+0000 7f470cdc9740 1 --2- 172.21.15.123:0/3942530737 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x5584eb2ec920 0x5584eb2ecd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.242+0000 7f470cdc9740 4 client.4873 mds_command: new command op to 4776 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:13:50.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.242+0000 7f470cdc9740 1 -- 172.21.15.123:0/3942530737 --> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584eb232e20 con 0x5584eb2ec920 2024-09-15T23:13:50.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.242+0000 7f47037fe640 1 --2- 172.21.15.123:0/3942530737 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x5584eb2ec920 0x5584eb2ecd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.243+0000 7f47037fe640 1 --2- 172.21.15.123:0/3942530737 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x5584eb2ec920 0x5584eb2ecd30 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=628178faba56d532 server_cookie=1574cba1f7f71a7d in_seq=0 out_seq=0 2024-09-15T23:13:50.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.243+0000 7f46e27fc640 10 client.4873 ms_handle_connect on v2:172.21.15.123:6834/1577644605 2024-09-15T23:13:50.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.244+0000 7f46e27fc640 1 -- 172.21.15.123:0/3942530737 <== mds.0 v2:172.21.15.123:6834/1577644605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5584eb232e20 con 0x5584eb2ec920 2024-09-15T23:13:50.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.244+0000 7f46e27fc640 10 client.4873 handle_command_reply: tid=0 2024-09-15T23:13:50.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.244+0000 7f470cdc9740 1 client.4873 shutdown 2024-09-15T23:13:50.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.244+0000 7f470cdc9740 1 -- 172.21.15.123:0/3942530737 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5584eb2c40b0 msgr2=0x5584eb2e13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:50.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.244+0000 7f470cdc9740 1 --2- 172.21.15.123:0/3942530737 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5584eb2c40b0 0x5584eb2e13d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f46f8079ab0 tx=0x7f46f802a1a0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.244+0000 7f470cdc9740 1 -- 172.21.15.123:0/3942530737 shutdown_connections 2024-09-15T23:13:50.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.244+0000 7f470cdc9740 1 --2- 172.21.15.123:0/3942530737 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x5584eb2ec920 0x5584eb2ecd30 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.244+0000 7f470cdc9740 1 --2- 172.21.15.123:0/3942530737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5584eb2e3b10 0x5584eb2c1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.244+0000 7f470cdc9740 1 --2- 172.21.15.123:0/3942530737 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5584eb2c40b0 0x5584eb2e13d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.244+0000 7f470cdc9740 1 --2- 172.21.15.123:0/3942530737 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5584eb2c2920 0x5584eb2e26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.244+0000 7f46e27fc640 0 client.4873 ms_handle_reset on v2:172.21.15.123:6834/1577644605 2024-09-15T23:13:50.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.244+0000 7f470cdc9740 1 -- 172.21.15.123:0/3942530737 >> 172.21.15.123:0/3942530737 conn(0x5584eb2c00e0 msgr2=0x5584eb306db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:50.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.244+0000 7f470cdc9740 1 -- 172.21.15.123:0/3942530737 shutdown_connections 2024-09-15T23:13:50.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.244+0000 7f470cdc9740 1 -- 172.21.15.123:0/3942530737 wait complete. 2024-09-15T23:13:50.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.244+0000 7f470cdc9740 20 client.4873 trim_cache size 0 max 16384 2024-09-15T23:13:50.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.276+0000 7f470cdc9740 1 Processor -- start 2024-09-15T23:13:50.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.276+0000 7f470cdc9740 1 -- start start 2024-09-15T23:13:50.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.277+0000 7f470cdc9740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5584eb2c2920 0x5584eb3044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.277+0000 7f470cdc9740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5584eb2c40b0 0x5584eb3076f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.277+0000 7f470cdc9740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5584eb2c39a0 0x5584eb2e11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.277+0000 7f470cdc9740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4704205650 con 0x5584eb2c2920 2024-09-15T23:13:50.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.277+0000 7f470cdc9740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4704204650 con 0x5584eb2c39a0 2024-09-15T23:13:50.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.277+0000 7f470cdc9740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4704160110 con 0x5584eb2c40b0 2024-09-15T23:13:50.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.277+0000 7f47037fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5584eb2c2920 0x5584eb3044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.277+0000 7f47037fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5584eb2c2920 0x5584eb3044d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47462/0 (socket says 172.21.15.123:47462) 2024-09-15T23:13:50.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.277+0000 7f47037fe640 1 -- 172.21.15.123:0/1562171821 learned_addr learned my addr 172.21.15.123:0/1562171821 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:13:50.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.277+0000 7f4703fff640 1 --2- 172.21.15.123:0/1562171821 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5584eb2c39a0 0x5584eb2e11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.277+0000 7f4702ffd640 1 --2- 172.21.15.123:0/1562171821 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5584eb2c40b0 0x5584eb3076f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.277+0000 7f47037fe640 1 -- 172.21.15.123:0/1562171821 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5584eb2c40b0 msgr2=0x5584eb3076f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:50.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.277+0000 7f47037fe640 1 --2- 172.21.15.123:0/1562171821 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5584eb2c40b0 0x5584eb3076f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.277+0000 7f47037fe640 1 -- 172.21.15.123:0/1562171821 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5584eb2c39a0 msgr2=0x5584eb2e11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:50.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.277+0000 7f47037fe640 1 --2- 172.21.15.123:0/1562171821 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5584eb2c39a0 0x5584eb2e11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.277+0000 7f47037fe640 1 -- 172.21.15.123:0/1562171821 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584eaef80f0 con 0x5584eb2c2920 2024-09-15T23:13:50.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.277+0000 7f47037fe640 1 --2- 172.21.15.123:0/1562171821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5584eb2c2920 0x5584eb3044d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f46f4007c00 tx=0x7f46f4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dad908b4525460c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:50.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.278+0000 7f46e8ff9640 1 -- 172.21.15.123:0/1562171821 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f401c040 con 0x5584eb2c2920 2024-09-15T23:13:50.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.278+0000 7f46e8ff9640 1 -- 172.21.15.123:0/1562171821 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46f401d040 con 0x5584eb2c2920 2024-09-15T23:13:50.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.278+0000 7f46e8ff9640 1 -- 172.21.15.123:0/1562171821 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f4024700 con 0x5584eb2c2920 2024-09-15T23:13:50.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.279+0000 7f470cdc9740 1 -- 172.21.15.123:0/1562171821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5584eb2c2920 msgr2=0x5584eb3044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:50.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.279+0000 7f470cdc9740 1 --2- 172.21.15.123:0/1562171821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5584eb2c2920 0x5584eb3044d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f46f4007c00 tx=0x7f46f4016000 comp rx=0 tx=0).stop 2024-09-15T23:13:50.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.279+0000 7f470cdc9740 1 -- 172.21.15.123:0/1562171821 shutdown_connections 2024-09-15T23:13:50.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.279+0000 7f470cdc9740 1 --2- 172.21.15.123:0/1562171821 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5584eb2c39a0 0x5584eb2e11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.279+0000 7f470cdc9740 1 --2- 172.21.15.123:0/1562171821 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5584eb2c40b0 0x5584eb3076f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.279+0000 7f470cdc9740 1 --2- 172.21.15.123:0/1562171821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5584eb2c2920 0x5584eb3044d0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.279+0000 7f470cdc9740 1 -- 172.21.15.123:0/1562171821 >> 172.21.15.123:0/1562171821 conn(0x5584eb2c00e0 msgr2=0x5584eb2bdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:50.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.279+0000 7f470cdc9740 1 -- 172.21.15.123:0/1562171821 shutdown_connections 2024-09-15T23:13:50.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.279+0000 7f470cdc9740 1 -- 172.21.15.123:0/1562171821 wait complete. 2024-09-15T23:13:50.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.280+0000 7f470cdc9740 1 -- start start 2024-09-15T23:13:50.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.280+0000 7f470cdc9740 1 Processor -- start 2024-09-15T23:13:50.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.281+0000 7f470cdc9740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5584eb2c2920 0x5584eb302de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.281+0000 7f470cdc9740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5584eb2c39a0 0x5584eb319cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.281+0000 7f470cdc9740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5584eb2c40b0 0x5584eb31a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.281+0000 7f470cdc9740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4704204000 con 0x5584eb2c40b0 2024-09-15T23:13:50.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.281+0000 7f470cdc9740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5584eb2ec260 con 0x5584eb2c39a0 2024-09-15T23:13:50.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.281+0000 7f470cdc9740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5584eb386790 con 0x5584eb2c2920 2024-09-15T23:13:50.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.281+0000 7f470cdc9740 10 client.0 _ll_register_callbacks cb 0x7f46f8090070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:13:50.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.281+0000 7f4703fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5584eb2c40b0 0x5584eb31a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.281+0000 7f4703fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5584eb2c40b0 0x5584eb31a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47470/0 (socket says 172.21.15.123:47470) 2024-09-15T23:13:50.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.281+0000 7f4703fff640 1 -- 172.21.15.123:0/3477841461 learned_addr learned my addr 172.21.15.123:0/3477841461 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:13:50.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.281+0000 7f4702ffd640 1 --2- 172.21.15.123:0/3477841461 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5584eb2c39a0 0x5584eb319cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.281+0000 7f47037fe640 1 --2- 172.21.15.123:0/3477841461 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5584eb2c2920 0x5584eb302de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.281+0000 7f4703fff640 1 -- 172.21.15.123:0/3477841461 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5584eb2c2920 msgr2=0x5584eb302de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:50.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.281+0000 7f4703fff640 1 --2- 172.21.15.123:0/3477841461 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5584eb2c2920 0x5584eb302de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.281+0000 7f4703fff640 1 -- 172.21.15.123:0/3477841461 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5584eb2c39a0 msgr2=0x5584eb319cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:13:50.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.281+0000 7f4703fff640 1 --2- 172.21.15.123:0/3477841461 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5584eb2c39a0 0x5584eb319cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.281+0000 7f4703fff640 1 -- 172.21.15.123:0/3477841461 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584eb2c10c0 con 0x5584eb2c40b0 2024-09-15T23:13:50.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.282+0000 7f47037fe640 1 --2- 172.21.15.123:0/3477841461 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5584eb2c2920 0x5584eb302de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:13:50.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.282+0000 7f4703fff640 1 --2- 172.21.15.123:0/3477841461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5584eb2c40b0 0x5584eb31a210 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f46fc0075e0 tx=0x7f46fc007aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec1600a180df365 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:13:50.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.282+0000 7f46e27fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:13:50.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.282+0000 7f46e27fc640 1 -- 172.21.15.123:0/3477841461 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46fc017c60 con 0x5584eb2c40b0 2024-09-15T23:13:50.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.282+0000 7f470cdc9740 1 -- 172.21.15.123:0/3477841461 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46f401d040 con 0x5584eb2c40b0 2024-09-15T23:13:50.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.282+0000 7f46e27fc640 1 -- 172.21.15.123:0/3477841461 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f46fc017e00 con 0x5584eb2c40b0 2024-09-15T23:13:50.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.282+0000 7f46e27fc640 1 -- 172.21.15.123:0/3477841461 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f46fc026050 con 0x5584eb2c40b0 2024-09-15T23:13:50.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.282+0000 7f470cdc9740 10 client.5064 fetch_fsmap learned FSMap version 14 2024-09-15T23:13:50.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.282+0000 7f470cdc9740 1 -- 172.21.15.123:0/3477841461 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x5584eb2e07f0 con 0x5584eb2c40b0 2024-09-15T23:13:50.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.282+0000 7f46e27fc640 1 -- 172.21.15.123:0/3477841461 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46f401d040 con 0x5584eb2c40b0 2024-09-15T23:13:50.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.283+0000 7f46e27fc640 1 -- 172.21.15.123:0/3477841461 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7f46fc029020 con 0x5584eb2c40b0 2024-09-15T23:13:50.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.283+0000 7f470cdc9740 10 client.5064 fetch_fsmap finished waiting for FSMap version 14 2024-09-15T23:13:50.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.283+0000 7f470cdc9740 10 client.5064 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-15T23:13:50.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.283+0000 7f470cdc9740 20 client.5064 populate_metadata read hostname 'smithi123' 2024-09-15T23:13:50.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.283+0000 7f470cdc9740 1 --2- 172.21.15.123:0/3477841461 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x5584eb30ac30 0x5584eb30b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:13:50.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.283+0000 7f470cdc9740 4 client.5064 mds_command: new command op to 4776 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:13:50.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.283+0000 7f470cdc9740 1 -- 172.21.15.123:0/3477841461 --> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5584eb22d170 con 0x5584eb30ac30 2024-09-15T23:13:50.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.283+0000 7f47037fe640 1 --2- 172.21.15.123:0/3477841461 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x5584eb30ac30 0x5584eb30b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:13:50.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.283+0000 7f46e27fc640 10 client.5064 ms_handle_connect on v2:172.21.15.123:6834/1577644605 2024-09-15T23:13:50.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.283+0000 7f47037fe640 1 --2- 172.21.15.123:0/3477841461 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x5584eb30ac30 0x5584eb30b040 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=262a40ab274edce0 server_cookie=7a31ad693e1ae295 in_seq=0 out_seq=0 2024-09-15T23:13:50.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.284+0000 7f46e27fc640 1 -- 172.21.15.123:0/3477841461 <== mds.0 v2:172.21.15.123:6834/1577644605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+274 (crc 0 0 0) 0x5584eb22d170 con 0x5584eb30ac30 2024-09-15T23:13:50.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.284+0000 7f46e27fc640 10 client.5064 handle_command_reply: tid=0 2024-09-15T23:13:50.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.284+0000 7f470cdc9740 1 client.5064 shutdown 2024-09-15T23:13:50.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.284+0000 7f470cdc9740 1 -- 172.21.15.123:0/3477841461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5584eb2c40b0 msgr2=0x5584eb31a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:50.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.284+0000 7f470cdc9740 1 --2- 172.21.15.123:0/3477841461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5584eb2c40b0 0x5584eb31a210 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f46fc0075e0 tx=0x7f46fc007aa0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.284+0000 7f470cdc9740 1 -- 172.21.15.123:0/3477841461 shutdown_connections 2024-09-15T23:13:50.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.284+0000 7f470cdc9740 1 --2- 172.21.15.123:0/3477841461 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x5584eb30ac30 0x5584eb30b040 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.284+0000 7f470cdc9740 1 --2- 172.21.15.123:0/3477841461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5584eb2c40b0 0x5584eb31a210 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.284+0000 7f470cdc9740 1 --2- 172.21.15.123:0/3477841461 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5584eb2c39a0 0x5584eb319cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.284+0000 7f470cdc9740 1 --2- 172.21.15.123:0/3477841461 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5584eb2c2920 0x5584eb302de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.284+0000 7f470cdc9740 1 -- 172.21.15.123:0/3477841461 >> 172.21.15.123:0/3477841461 conn(0x5584eb2c00e0 msgr2=0x5584eb2e13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:50.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.284+0000 7f46e27fc640 0 client.5064 ms_handle_reset on v2:172.21.15.123:6834/1577644605 2024-09-15T23:13:50.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.284+0000 7f470cdc9740 1 -- 172.21.15.123:0/3477841461 shutdown_connections 2024-09-15T23:13:50.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.284+0000 7f470cdc9740 1 -- 172.21.15.123:0/3477841461 wait complete. 2024-09-15T23:13:50.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.285+0000 7f470cdc9740 20 client.5064 trim_cache size 0 max 16384 2024-09-15T23:13:50.290 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:13:50.290 INFO:teuthology.orchestra.run.smithi123.stdout: "status": "scrub active (573 inodes in the stack)", 2024-09-15T23:13:50.291 INFO:teuthology.orchestra.run.smithi123.stdout: "scrubs": { 2024-09-15T23:13:50.291 INFO:teuthology.orchestra.run.smithi123.stdout: "a619d348-da86-401e-af1b-706dcfc2a95a": { 2024-09-15T23:13:50.291 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/", 2024-09-15T23:13:50.291 INFO:teuthology.orchestra.run.smithi123.stdout: "tag": "a619d348-da86-401e-af1b-706dcfc2a95a", 2024-09-15T23:13:50.291 INFO:teuthology.orchestra.run.smithi123.stdout: "options": "recursive,scrub_mdsdir" 2024-09-15T23:13:50.291 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:13:50.291 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:13:50.291 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:13:50.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.285+0000 7f4709f52640 1 -- 172.21.15.123:0/585473076 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f46f006c2e0 msgr2=0x7f46f006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:50.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.285+0000 7f4709f52640 1 --2- 172.21.15.123:0/585473076 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f46f006c2e0 0x7f46f006e7a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f46f4007e50 tx=0x7f46f4008040 comp rx=0 tx=0).stop 2024-09-15T23:13:50.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.285+0000 7f4709f52640 1 -- 172.21.15.123:0/585473076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f470415e950 msgr2=0x7f47040cb810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:13:50.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.285+0000 7f4709f52640 1 --2- 172.21.15.123:0/585473076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f470415e950 0x7f47040cb810 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f46f8031000 tx=0x7f46f80046c0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.285+0000 7f4709f52640 1 -- 172.21.15.123:0/585473076 shutdown_connections 2024-09-15T23:13:50.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.285+0000 7f4709f52640 1 --2- 172.21.15.123:0/585473076 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f47040ca680 0x7f47040cbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.285+0000 7f4709f52640 1 --2- 172.21.15.123:0/585473076 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f46f006c2e0 0x7f46f006e7a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.285+0000 7f4709f52640 1 --2- 172.21.15.123:0/585473076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f470415e950 0x7f47040cb810 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.285+0000 7f4709f52640 1 --2- 172.21.15.123:0/585473076 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f470406dc50 0x7f4704161880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:13:50.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.285+0000 7f4709f52640 1 -- 172.21.15.123:0/585473076 >> 172.21.15.123:0/585473076 conn(0x7f47040d4740 msgr2=0x7f4704157800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:13:50.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.285+0000 7f4709f52640 1 -- 172.21.15.123:0/585473076 shutdown_connections 2024-09-15T23:13:50.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:13:50.285+0000 7f4709f52640 1 -- 172.21.15.123:0/585473076 wait complete. 2024-09-15T23:13:50.301 INFO:tasks.cephfs.filesystem:scrub status for tag:a619d348-da86-401e-af1b-706dcfc2a95a - {'path': '/', 'tag': 'a619d348-da86-401e-af1b-706dcfc2a95a', 'options': 'recursive,scrub_mdsdir'} 2024-09-15T23:14:07.525 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:14:07.528 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:14:20.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:14:20.302 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-09-15T23:14:20.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.413+0000 7fe0c232a640 1 Processor -- start 2024-09-15T23:14:20.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.413+0000 7fe0c232a640 1 -- start start 2024-09-15T23:14:20.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.414+0000 7fe0c232a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe0bc0cce30 0x7fe0bc0cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.414+0000 7fe0c232a640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0bc0714b0 con 0x7fe0bc0732e0 2024-09-15T23:14:20.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.414+0000 7fe0c232a640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0bc0cd880 con 0x7fe0bc071c70 2024-09-15T23:14:20.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.414+0000 7fe0c232a640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe0bc0cdb60 con 0x7fe0bc0cce30 2024-09-15T23:14:20.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.414+0000 7fe0bb7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe0bc0cce30 0x7fe0bc0cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.414+0000 7fe0bbfff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe0bc0732e0 0x7fe0bc0736c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38126/0 (socket says 172.21.15.123:38126) 2024-09-15T23:14:20.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.414+0000 7fe0bb7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe0bc0cce30 0x7fe0bc0cd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54904/0 (socket says 172.21.15.123:54904) 2024-09-15T23:14:20.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.414+0000 7fe0bbfff640 1 -- 172.21.15.123:0/2579473109 learned_addr learned my addr 172.21.15.123:0/2579473109 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:20.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.414+0000 7fe0bb7fe640 1 -- 172.21.15.123:0/2579473109 >> v1:172.21.15.188:6789/0 conn(0x7fe0bc071c70 legacy=0x7fe0bc15c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:20.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.414+0000 7fe0bb7fe640 1 -- 172.21.15.123:0/2579473109 >> v1:172.21.15.123:6789/0 conn(0x7fe0bc0732e0 legacy=0x7fe0bc0736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:20.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.414+0000 7fe0bb7fe640 1 -- 172.21.15.123:0/2579473109 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0bc0cde40 con 0x7fe0bc0cce30 2024-09-15T23:14:20.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.415+0000 7fe0bb7fe640 1 --2- 172.21.15.123:0/2579473109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0bc0cce30 0x7fe0bc0cd2a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe0b00097a0 tx=0x7fe0b002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36244bf0b95b0180 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:20.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.415+0000 7fe0baffd640 1 -- 172.21.15.123:0/2579473109 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0037070 con 0x7fe0bc0cce30 2024-09-15T23:14:20.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.415+0000 7fe0baffd640 1 -- 172.21.15.123:0/2579473109 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0b002ae50 con 0x7fe0bc0cce30 2024-09-15T23:14:20.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.415+0000 7fe0baffd640 1 -- 172.21.15.123:0/2579473109 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0032660 con 0x7fe0bc0cce30 2024-09-15T23:14:20.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.416+0000 7fe0c232a640 1 -- 172.21.15.123:0/2579473109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0bc0cce30 msgr2=0x7fe0bc0cd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:20.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.416+0000 7fe0c232a640 1 --2- 172.21.15.123:0/2579473109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0bc0cce30 0x7fe0bc0cd2a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe0b00097a0 tx=0x7fe0b002a140 comp rx=0 tx=0).stop 2024-09-15T23:14:20.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.416+0000 7fe0c232a640 1 -- 172.21.15.123:0/2579473109 shutdown_connections 2024-09-15T23:14:20.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.416+0000 7fe0c232a640 1 --2- 172.21.15.123:0/2579473109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0bc0cce30 0x7fe0bc0cd2a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.416+0000 7fe0c232a640 1 -- 172.21.15.123:0/2579473109 >> 172.21.15.123:0/2579473109 conn(0x7fe0bc06d0f0 msgr2=0x7fe0bc06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:20.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.416+0000 7fe0c232a640 1 -- 172.21.15.123:0/2579473109 shutdown_connections 2024-09-15T23:14:20.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.416+0000 7fe0c232a640 1 -- 172.21.15.123:0/2579473109 wait complete. 2024-09-15T23:14:20.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.417+0000 7fe0c232a640 1 Processor -- start 2024-09-15T23:14:20.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.417+0000 7fe0c232a640 1 -- start start 2024-09-15T23:14:20.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.418+0000 7fe0c232a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0bc071c70 0x7fe0bc156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.418+0000 7fe0c232a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0bc0732e0 0x7fe0bc1f3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.418+0000 7fe0c232a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0bc0cce30 0x7fe0bc1f4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.418+0000 7fe0c232a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe0bc15d160 con 0x7fe0bc0732e0 2024-09-15T23:14:20.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.418+0000 7fe0c232a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe0bc15cfe0 con 0x7fe0bc071c70 2024-09-15T23:14:20.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.418+0000 7fe0c232a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe0bc15d2e0 con 0x7fe0bc0cce30 2024-09-15T23:14:20.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.418+0000 7fe0bb7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0bc0732e0 0x7fe0bc1f3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.418+0000 7fe0bb7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0bc0732e0 0x7fe0bc1f3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54918/0 (socket says 172.21.15.123:54918) 2024-09-15T23:14:20.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.418+0000 7fe0bb7fe640 1 -- 172.21.15.123:0/3007485662 learned_addr learned my addr 172.21.15.123:0/3007485662 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:20.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.418+0000 7fe0bbfff640 1 --2- 172.21.15.123:0/3007485662 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0bc071c70 0x7fe0bc156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.418+0000 7fe0c08c7640 1 --2- 172.21.15.123:0/3007485662 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0bc0cce30 0x7fe0bc1f4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.418+0000 7fe0bb7fe640 1 -- 172.21.15.123:0/3007485662 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0bc0cce30 msgr2=0x7fe0bc1f4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:20.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.418+0000 7fe0bb7fe640 1 --2- 172.21.15.123:0/3007485662 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0bc0cce30 0x7fe0bc1f4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.418+0000 7fe0bb7fe640 1 -- 172.21.15.123:0/3007485662 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0bc071c70 msgr2=0x7fe0bc156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:20.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.418+0000 7fe0bb7fe640 1 --2- 172.21.15.123:0/3007485662 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0bc071c70 0x7fe0bc156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.418+0000 7fe0bb7fe640 1 -- 172.21.15.123:0/3007485662 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0bc1f4b10 con 0x7fe0bc0732e0 2024-09-15T23:14:20.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.418+0000 7fe0c08c7640 1 --2- 172.21.15.123:0/3007485662 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0bc0cce30 0x7fe0bc1f4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:20.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.419+0000 7fe0bb7fe640 1 --2- 172.21.15.123:0/3007485662 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0bc0732e0 0x7fe0bc1f3fd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe0b00098c0 tx=0x7fe0b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:20.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.419+0000 7fe0b8ff9640 1 -- 172.21.15.123:0/3007485662 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0042070 con 0x7fe0bc0732e0 2024-09-15T23:14:20.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.419+0000 7fe0b8ff9640 1 -- 172.21.15.123:0/3007485662 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0b003d650 con 0x7fe0bc0732e0 2024-09-15T23:14:20.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.419+0000 7fe0b8ff9640 1 -- 172.21.15.123:0/3007485662 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0037040 con 0x7fe0bc0732e0 2024-09-15T23:14:20.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.419+0000 7fe0c232a640 1 -- 172.21.15.123:0/3007485662 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0bc1f4df0 con 0x7fe0bc0732e0 2024-09-15T23:14:20.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.419+0000 7fe0c232a640 1 -- 172.21.15.123:0/3007485662 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0bc1f53b0 con 0x7fe0bc0732e0 2024-09-15T23:14:20.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.420+0000 7fe0b8ff9640 1 -- 172.21.15.123:0/3007485662 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe0b0045070 con 0x7fe0bc0732e0 2024-09-15T23:14:20.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.421+0000 7fe0b8ff9640 1 --2- 172.21.15.123:0/3007485662 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe0a806c2b0 0x7fe0a806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.421+0000 7fe0b8ff9640 1 -- 172.21.15.123:0/3007485662 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5853+0+0 (secure 0 0 0) 0x7fe0b00abb70 con 0x7fe0bc0732e0 2024-09-15T23:14:20.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.421+0000 7fe0bbfff640 1 --2- 172.21.15.123:0/3007485662 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe0a806c2b0 0x7fe0a806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.422+0000 7fe0c50c4740 1 Processor -- start 2024-09-15T23:14:20.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.422+0000 7fe0c50c4740 1 -- start start 2024-09-15T23:14:20.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.422+0000 7fe0bbfff640 1 --2- 172.21.15.123:0/3007485662 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe0a806c2b0 0x7fe0a806e770 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac007fd0 tx=0x7fe0ac007e80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:20.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.422+0000 7fe0c50c4740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b077ec2920 0x55b077f080c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.422+0000 7fe0c50c4740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b077ec00e0 0x55b077ec2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.422+0000 7fe0c50c4740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b077ec40b0 0x55b077ebd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.422+0000 7fe0c50c4740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55b077e256f0 con 0x55b077ec00e0 2024-09-15T23:14:20.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.422+0000 7fe0c50c4740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b077dcd330 con 0x55b077ec2920 2024-09-15T23:14:20.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.422+0000 7fe0c50c4740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55b077e216b0 con 0x55b077ec40b0 2024-09-15T23:14:20.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.423+0000 7fe0bb7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b077ec00e0 0x55b077ec2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.423+0000 7fe0bb7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b077ec00e0 0x55b077ec2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54934/0 (socket says 172.21.15.123:54934) 2024-09-15T23:14:20.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.423+0000 7fe0bb7fe640 1 -- 172.21.15.123:0/2818631739 learned_addr learned my addr 172.21.15.123:0/2818631739 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:20.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.423+0000 7fe0bbfff640 1 --2- 172.21.15.123:0/2818631739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b077ec2920 0x55b077f080c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.423+0000 7fe0c08c7640 1 --2- 172.21.15.123:0/2818631739 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b077ec40b0 0x55b077ebd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.423+0000 7fe0bb7fe640 1 -- 172.21.15.123:0/2818631739 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b077ec40b0 msgr2=0x55b077ebd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:20.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.423+0000 7fe0bb7fe640 1 --2- 172.21.15.123:0/2818631739 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b077ec40b0 0x55b077ebd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.423+0000 7fe0bb7fe640 1 -- 172.21.15.123:0/2818631739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b077ec2920 msgr2=0x55b077f080c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:20.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.423+0000 7fe0bb7fe640 1 --2- 172.21.15.123:0/2818631739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b077ec2920 0x55b077f080c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.423+0000 7fe0bb7fe640 1 -- 172.21.15.123:0/2818631739 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b077df30d0 con 0x55b077ec00e0 2024-09-15T23:14:20.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.423+0000 7fe0c08c7640 1 --2- 172.21.15.123:0/2818631739 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b077ec40b0 0x55b077ebd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:20.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.423+0000 7fe0bb7fe640 1 --2- 172.21.15.123:0/2818631739 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b077ec00e0 0x55b077ec2d00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe0b00a9f80 tx=0x7fe0b00797c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cee8e3defc14470 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:20.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.423+0000 7fe0a1ffb640 1 -- 172.21.15.123:0/2818631739 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b004c040 con 0x55b077ec00e0 2024-09-15T23:14:20.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.423+0000 7fe0a1ffb640 1 -- 172.21.15.123:0/2818631739 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0b002ae50 con 0x55b077ec00e0 2024-09-15T23:14:20.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.423+0000 7fe0a1ffb640 1 -- 172.21.15.123:0/2818631739 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b007df00 con 0x55b077ec00e0 2024-09-15T23:14:20.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.424+0000 7fe0c50c4740 1 -- 172.21.15.123:0/2818631739 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b077ec00e0 msgr2=0x55b077ec2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:20.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.424+0000 7fe0c50c4740 1 --2- 172.21.15.123:0/2818631739 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b077ec00e0 0x55b077ec2d00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe0b00a9f80 tx=0x7fe0b00797c0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.424+0000 7fe0c50c4740 1 -- 172.21.15.123:0/2818631739 shutdown_connections 2024-09-15T23:14:20.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.424+0000 7fe0c50c4740 1 --2- 172.21.15.123:0/2818631739 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b077ec40b0 0x55b077ebd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.424+0000 7fe0c50c4740 1 --2- 172.21.15.123:0/2818631739 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b077ec00e0 0x55b077ec2d00 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.424+0000 7fe0c50c4740 1 --2- 172.21.15.123:0/2818631739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b077ec2920 0x55b077f080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.424+0000 7fe0c50c4740 1 -- 172.21.15.123:0/2818631739 >> 172.21.15.123:0/2818631739 conn(0x55b077ebf370 msgr2=0x55b077f07590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:20.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.424+0000 7fe0c50c4740 1 -- 172.21.15.123:0/2818631739 shutdown_connections 2024-09-15T23:14:20.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.424+0000 7fe0c50c4740 1 -- 172.21.15.123:0/2818631739 wait complete. 2024-09-15T23:14:20.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.424+0000 7fe0c50c4740 1 -- start start 2024-09-15T23:14:20.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.425+0000 7fe0c50c4740 1 Processor -- start 2024-09-15T23:14:20.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.425+0000 7fe0c50c4740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b077ec2920 0x55b077f1b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.425+0000 7fe0c50c4740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b077ec40b0 0x55b077f1b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.425+0000 7fe0c50c4740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b077ebd750 0x55b077eea8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.425+0000 7fe0c50c4740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55b077e256f0 con 0x55b077ebd750 2024-09-15T23:14:20.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.425+0000 7fe0c50c4740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b077dae4f0 con 0x55b077ec40b0 2024-09-15T23:14:20.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.425+0000 7fe0c50c4740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55b077ebe810 con 0x55b077ec2920 2024-09-15T23:14:20.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.426+0000 7fe0c50c4740 10 client.0 _ll_register_callbacks cb 0x55b077dcfb50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:20.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.426+0000 7fe0c08c7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b077ebd750 0x55b077eea8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.426+0000 7fe0c08c7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b077ebd750 0x55b077eea8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54948/0 (socket says 172.21.15.123:54948) 2024-09-15T23:14:20.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.426+0000 7fe0c08c7640 1 -- 172.21.15.123:0/15042160 learned_addr learned my addr 172.21.15.123:0/15042160 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:20.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.426+0000 7fe0bb7fe640 1 --2- 172.21.15.123:0/15042160 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b077ec40b0 0x55b077f1b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.426+0000 7fe0bbfff640 1 --2- 172.21.15.123:0/15042160 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b077ec2920 0x55b077f1b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.426+0000 7fe0c08c7640 1 -- 172.21.15.123:0/15042160 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b077ec2920 msgr2=0x55b077f1b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:20.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.426+0000 7fe0c08c7640 1 --2- 172.21.15.123:0/15042160 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b077ec2920 0x55b077f1b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.426+0000 7fe0c08c7640 1 -- 172.21.15.123:0/15042160 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b077ec40b0 msgr2=0x55b077f1b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:20.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.426+0000 7fe0c08c7640 1 --2- 172.21.15.123:0/15042160 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b077ec40b0 0x55b077f1b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.426+0000 7fe0c08c7640 1 -- 172.21.15.123:0/15042160 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b077c027d0 con 0x55b077ebd750 2024-09-15T23:14:20.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.426+0000 7fe0bb7fe640 1 --2- 172.21.15.123:0/15042160 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b077ec40b0 0x55b077f1b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:20.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.426+0000 7fe0c08c7640 1 --2- 172.21.15.123:0/15042160 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b077ebd750 0x55b077eea8d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400acb0 tx=0x7fe0b4007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=615c5323e33cdedf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:20.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.426+0000 7fe09affd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:20.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.426+0000 7fe09affd640 1 -- 172.21.15.123:0/15042160 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b401b060 con 0x55b077ebd750 2024-09-15T23:14:20.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.426+0000 7fe09affd640 1 -- 172.21.15.123:0/15042160 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(40..40 src has 1..40) ==== 5853+0+0 (secure 0 0 0) 0x7fe0b40165f0 con 0x55b077ebd750 2024-09-15T23:14:20.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.426+0000 7fe0c50c4740 1 -- 172.21.15.123:0/15042160 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0b002ae50 con 0x55b077ebd750 2024-09-15T23:14:20.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.426+0000 7fe09affd640 1 -- 172.21.15.123:0/15042160 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fe0b4021050 con 0x55b077ebd750 2024-09-15T23:14:20.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.426+0000 7fe0c50c4740 10 client.5079 fetch_fsmap learned FSMap version 14 2024-09-15T23:14:20.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.426+0000 7fe0c50c4740 1 -- 172.21.15.123:0/15042160 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55b077b383f0 con 0x55b077ebd750 2024-09-15T23:14:20.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.426+0000 7fe09affd640 1 -- 172.21.15.123:0/15042160 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0b002ae50 con 0x55b077ebd750 2024-09-15T23:14:20.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.427+0000 7fe09affd640 1 -- 172.21.15.123:0/15042160 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7fe0b4024020 con 0x55b077ebd750 2024-09-15T23:14:20.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.427+0000 7fe0c50c4740 10 client.5079 fetch_fsmap finished waiting for FSMap version 14 2024-09-15T23:14:20.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.427+0000 7fe0c50c4740 10 client.5079 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-15T23:14:20.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.427+0000 7fe0c50c4740 20 client.5079 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:20.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.427+0000 7fe0c50c4740 1 --2- 172.21.15.123:0/15042160 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x55b077eeb2e0 0x55b077ee4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.427+0000 7fe0c50c4740 4 client.5079 mds_command: new command op to 4776 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:14:20.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.427+0000 7fe0c50c4740 1 -- 172.21.15.123:0/15042160 --> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b077e32e20 con 0x55b077eeb2e0 2024-09-15T23:14:20.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.427+0000 7fe0bbfff640 1 --2- 172.21.15.123:0/15042160 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x55b077eeb2e0 0x55b077ee4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.427+0000 7fe09affd640 10 client.5079 ms_handle_connect on v2:172.21.15.123:6834/1577644605 2024-09-15T23:14:20.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.427+0000 7fe0bbfff640 1 --2- 172.21.15.123:0/15042160 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x55b077eeb2e0 0x55b077ee4af0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=170bc321ae41271f server_cookie=49292aa336b90dc2 in_seq=0 out_seq=0 2024-09-15T23:14:20.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.428+0000 7fe09affd640 1 -- 172.21.15.123:0/15042160 <== mds.0 v2:172.21.15.123:6834/1577644605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b077e32e20 con 0x55b077eeb2e0 2024-09-15T23:14:20.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.428+0000 7fe09affd640 10 client.5079 handle_command_reply: tid=0 2024-09-15T23:14:20.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.428+0000 7fe0c50c4740 1 client.5079 shutdown 2024-09-15T23:14:20.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.428+0000 7fe0c50c4740 1 -- 172.21.15.123:0/15042160 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b077ebd750 msgr2=0x55b077eea8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:20.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.428+0000 7fe0c50c4740 1 --2- 172.21.15.123:0/15042160 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b077ebd750 0x55b077eea8d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400acb0 tx=0x7fe0b4007680 comp rx=0 tx=0).stop 2024-09-15T23:14:20.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.428+0000 7fe0c50c4740 1 -- 172.21.15.123:0/15042160 shutdown_connections 2024-09-15T23:14:20.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.428+0000 7fe0c50c4740 1 --2- 172.21.15.123:0/15042160 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x55b077eeb2e0 0x55b077ee4af0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.428+0000 7fe0c50c4740 1 --2- 172.21.15.123:0/15042160 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b077ebd750 0x55b077eea8d0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.428+0000 7fe0c50c4740 1 --2- 172.21.15.123:0/15042160 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b077ec40b0 0x55b077f1b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.428+0000 7fe0c50c4740 1 --2- 172.21.15.123:0/15042160 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b077ec2920 0x55b077f1b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.428+0000 7fe09affd640 0 client.5079 ms_handle_reset on v2:172.21.15.123:6834/1577644605 2024-09-15T23:14:20.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.428+0000 7fe0c50c4740 1 -- 172.21.15.123:0/15042160 >> 172.21.15.123:0/15042160 conn(0x55b077ec00e0 msgr2=0x55b077f06b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:20.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.428+0000 7fe0c50c4740 1 -- 172.21.15.123:0/15042160 shutdown_connections 2024-09-15T23:14:20.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.428+0000 7fe0c50c4740 1 -- 172.21.15.123:0/15042160 wait complete. 2024-09-15T23:14:20.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.428+0000 7fe0c50c4740 20 client.5079 trim_cache size 0 max 16384 2024-09-15T23:14:20.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.445+0000 7fe0c50c4740 1 Processor -- start 2024-09-15T23:14:20.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.445+0000 7fe0c50c4740 1 -- start start 2024-09-15T23:14:20.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.446+0000 7fe0c50c4740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b077ebd750 0x55b077f2b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.446+0000 7fe0c50c4740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b077ec2920 0x55b077f076b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.446+0000 7fe0c50c4740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b077ec40b0 0x55b077f0a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.446+0000 7fe0c50c4740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe0bc201040 con 0x55b077ec2920 2024-09-15T23:14:20.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.446+0000 7fe0c50c4740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe0bc2000a0 con 0x55b077ebd750 2024-09-15T23:14:20.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.446+0000 7fe0c50c4740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe0bc02d970 con 0x55b077ec40b0 2024-09-15T23:14:20.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.446+0000 7fe0bb7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b077ec2920 0x55b077f076b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.446+0000 7fe0bb7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b077ec2920 0x55b077f076b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54956/0 (socket says 172.21.15.123:54956) 2024-09-15T23:14:20.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.446+0000 7fe0bb7fe640 1 -- 172.21.15.123:0/3430081184 learned_addr learned my addr 172.21.15.123:0/3430081184 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:20.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.446+0000 7fe0bb7fe640 1 -- 172.21.15.123:0/3430081184 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b077ec40b0 msgr2=0x55b077f0a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:20.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.446+0000 7fe0bb7fe640 1 --2- 172.21.15.123:0/3430081184 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b077ec40b0 0x55b077f0a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.446+0000 7fe0bb7fe640 1 -- 172.21.15.123:0/3430081184 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b077ebd750 msgr2=0x55b077f2b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:20.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.446+0000 7fe0bb7fe640 1 --2- 172.21.15.123:0/3430081184 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b077ebd750 0x55b077f2b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.446+0000 7fe0bb7fe640 1 -- 172.21.15.123:0/3430081184 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b077af80f0 con 0x55b077ec2920 2024-09-15T23:14:20.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.446+0000 7fe0bb7fe640 1 --2- 172.21.15.123:0/3430081184 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b077ec2920 0x55b077f076b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0076010 tx=0x7fe0b007b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e16880ada211b400 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:20.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.447+0000 7fe0a17fa640 1 -- 172.21.15.123:0/3430081184 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b004c040 con 0x55b077ec2920 2024-09-15T23:14:20.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.447+0000 7fe0a17fa640 1 -- 172.21.15.123:0/3430081184 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0b002ae50 con 0x55b077ec2920 2024-09-15T23:14:20.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.447+0000 7fe0a17fa640 1 -- 172.21.15.123:0/3430081184 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b007df00 con 0x55b077ec2920 2024-09-15T23:14:20.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.447+0000 7fe0c50c4740 1 -- 172.21.15.123:0/3430081184 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b077ec2920 msgr2=0x55b077f076b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:20.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.447+0000 7fe0c50c4740 1 --2- 172.21.15.123:0/3430081184 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b077ec2920 0x55b077f076b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0076010 tx=0x7fe0b007b000 comp rx=0 tx=0).stop 2024-09-15T23:14:20.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.447+0000 7fe0c50c4740 1 -- 172.21.15.123:0/3430081184 shutdown_connections 2024-09-15T23:14:20.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.447+0000 7fe0c50c4740 1 --2- 172.21.15.123:0/3430081184 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b077ec40b0 0x55b077f0a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.447+0000 7fe0c50c4740 1 --2- 172.21.15.123:0/3430081184 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b077ec2920 0x55b077f076b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.447+0000 7fe0c50c4740 1 --2- 172.21.15.123:0/3430081184 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b077ebd750 0x55b077f2b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.447+0000 7fe0c50c4740 1 -- 172.21.15.123:0/3430081184 >> 172.21.15.123:0/3430081184 conn(0x55b077ec00e0 msgr2=0x55b077eeb760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:20.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.447+0000 7fe0c50c4740 1 -- 172.21.15.123:0/3430081184 shutdown_connections 2024-09-15T23:14:20.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.447+0000 7fe0c50c4740 1 -- 172.21.15.123:0/3430081184 wait complete. 2024-09-15T23:14:20.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.448+0000 7fe0c50c4740 1 -- start start 2024-09-15T23:14:20.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.448+0000 7fe0c50c4740 1 Processor -- start 2024-09-15T23:14:20.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.449+0000 7fe0c50c4740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b077ebd750 0x55b077f78a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.449+0000 7fe0c50c4740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b077ec2920 0x55b077f855c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.449+0000 7fe0c50c4740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b077ec40b0 0x55b077f85b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.449+0000 7fe0c50c4740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe0bc1ffa80 con 0x55b077ebd750 2024-09-15T23:14:20.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.449+0000 7fe0c50c4740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b077ee34e0 con 0x55b077ec2920 2024-09-15T23:14:20.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.449+0000 7fe0c50c4740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55b077f86410 con 0x55b077ec40b0 2024-09-15T23:14:20.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.449+0000 7fe0c50c4740 10 client.0 _ll_register_callbacks cb 0x7fe0b4009870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:20.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.449+0000 7fe0bbfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b077ebd750 0x55b077f78a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.449+0000 7fe0bbfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b077ebd750 0x55b077f78a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54960/0 (socket says 172.21.15.123:54960) 2024-09-15T23:14:20.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.449+0000 7fe0bbfff640 1 -- 172.21.15.123:0/1985617259 learned_addr learned my addr 172.21.15.123:0/1985617259 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:20.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.449+0000 7fe0c08c7640 1 --2- 172.21.15.123:0/1985617259 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b077ec40b0 0x55b077f85b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.449+0000 7fe0bb7fe640 1 --2- 172.21.15.123:0/1985617259 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b077ec2920 0x55b077f855c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.449+0000 7fe0bbfff640 1 -- 172.21.15.123:0/1985617259 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b077ec40b0 msgr2=0x55b077f85b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:20.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.449+0000 7fe0bbfff640 1 --2- 172.21.15.123:0/1985617259 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b077ec40b0 0x55b077f85b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.449+0000 7fe0bbfff640 1 -- 172.21.15.123:0/1985617259 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b077ec2920 msgr2=0x55b077f855c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:20.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.449+0000 7fe0bbfff640 1 --2- 172.21.15.123:0/1985617259 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b077ec2920 0x55b077f855c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.449+0000 7fe0bbfff640 1 -- 172.21.15.123:0/1985617259 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b077f05eb0 con 0x55b077ebd750 2024-09-15T23:14:20.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.449+0000 7fe0bb7fe640 1 --2- 172.21.15.123:0/1985617259 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b077ec2920 0x55b077f855c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:20.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.449+0000 7fe0bbfff640 1 --2- 172.21.15.123:0/1985617259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b077ebd750 0x55b077f78a80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac001c40 tx=0x7fe0ac000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e336a28da2fd209a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:20.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.449+0000 7fe09affd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:20.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.449+0000 7fe09affd640 1 -- 172.21.15.123:0/1985617259 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac001d30 con 0x55b077ebd750 2024-09-15T23:14:20.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.449+0000 7fe09affd640 1 -- 172.21.15.123:0/1985617259 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(40..40 src has 1..40) ==== 5853+0+0 (secure 0 0 0) 0x7fe0ac02fb50 con 0x55b077ebd750 2024-09-15T23:14:20.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.449+0000 7fe0c50c4740 1 -- 172.21.15.123:0/1985617259 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0b002ae50 con 0x55b077ebd750 2024-09-15T23:14:20.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.449+0000 7fe09affd640 1 -- 172.21.15.123:0/1985617259 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fe0ac02fd50 con 0x55b077ebd750 2024-09-15T23:14:20.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.449+0000 7fe0c50c4740 10 client.5085 fetch_fsmap learned FSMap version 14 2024-09-15T23:14:20.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.450+0000 7fe0c50c4740 1 -- 172.21.15.123:0/1985617259 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55b077f86100 con 0x55b077ebd750 2024-09-15T23:14:20.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.450+0000 7fe09affd640 1 -- 172.21.15.123:0/1985617259 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0b002ae50 con 0x55b077ebd750 2024-09-15T23:14:20.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.450+0000 7fe09affd640 1 -- 172.21.15.123:0/1985617259 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7fe0ac036050 con 0x55b077ebd750 2024-09-15T23:14:20.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.450+0000 7fe0c50c4740 10 client.5085 fetch_fsmap finished waiting for FSMap version 14 2024-09-15T23:14:20.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.450+0000 7fe0c50c4740 10 client.5085 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-15T23:14:20.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.450+0000 7fe0c50c4740 20 client.5085 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:20.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.450+0000 7fe0c50c4740 1 --2- 172.21.15.123:0/1985617259 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x55b077f09640 0x55b077f03bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.450+0000 7fe0c50c4740 4 client.5085 mds_command: new command op to 4776 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:14:20.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.450+0000 7fe0c50c4740 1 -- 172.21.15.123:0/1985617259 --> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b077f06930 con 0x55b077f09640 2024-09-15T23:14:20.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.450+0000 7fe0bb7fe640 1 --2- 172.21.15.123:0/1985617259 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x55b077f09640 0x55b077f03bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.450+0000 7fe09affd640 10 client.5085 ms_handle_connect on v2:172.21.15.123:6834/1577644605 2024-09-15T23:14:20.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.450+0000 7fe0bb7fe640 1 --2- 172.21.15.123:0/1985617259 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x55b077f09640 0x55b077f03bd0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1254300c60ec9d91 server_cookie=ffc6dd77b2d44530 in_seq=0 out_seq=0 2024-09-15T23:14:20.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.450+0000 7fe09affd640 1 -- 172.21.15.123:0/1985617259 <== mds.0 v2:172.21.15.123:6834/1577644605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b077f06930 con 0x55b077f09640 2024-09-15T23:14:20.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.450+0000 7fe09affd640 10 client.5085 handle_command_reply: tid=0 2024-09-15T23:14:20.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.450+0000 7fe0c50c4740 1 client.5085 shutdown 2024-09-15T23:14:20.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.451+0000 7fe0c50c4740 1 -- 172.21.15.123:0/1985617259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b077ebd750 msgr2=0x55b077f78a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:20.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.451+0000 7fe0c50c4740 1 --2- 172.21.15.123:0/1985617259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b077ebd750 0x55b077f78a80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac001c40 tx=0x7fe0ac000ed0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.451+0000 7fe0c50c4740 1 -- 172.21.15.123:0/1985617259 shutdown_connections 2024-09-15T23:14:20.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.451+0000 7fe0c50c4740 1 --2- 172.21.15.123:0/1985617259 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b077ec40b0 0x55b077f85b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.451+0000 7fe0c50c4740 1 --2- 172.21.15.123:0/1985617259 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b077ec2920 0x55b077f855c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.451+0000 7fe0c50c4740 1 --2- 172.21.15.123:0/1985617259 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x55b077f09640 0x55b077f03bd0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.451+0000 7fe0c50c4740 1 --2- 172.21.15.123:0/1985617259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b077ebd750 0x55b077f78a80 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.451+0000 7fe0c50c4740 1 -- 172.21.15.123:0/1985617259 >> 172.21.15.123:0/1985617259 conn(0x55b077ec00e0 msgr2=0x55b077ee9400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:20.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.451+0000 7fe09affd640 0 client.5085 ms_handle_reset on v2:172.21.15.123:6834/1577644605 2024-09-15T23:14:20.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.451+0000 7fe0c50c4740 1 -- 172.21.15.123:0/1985617259 shutdown_connections 2024-09-15T23:14:20.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.451+0000 7fe0c50c4740 1 -- 172.21.15.123:0/1985617259 wait complete. 2024-09-15T23:14:20.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.451+0000 7fe0c50c4740 20 client.5085 trim_cache size 0 max 16384 2024-09-15T23:14:20.459 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:14:20.459 INFO:teuthology.orchestra.run.smithi123.stdout: "status": "no active scrubs running", 2024-09-15T23:14:20.459 INFO:teuthology.orchestra.run.smithi123.stdout: "scrubs": {} 2024-09-15T23:14:20.459 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:14:20.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.451+0000 7fe0c232a640 1 -- 172.21.15.123:0/3007485662 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe0a806c2b0 msgr2=0x7fe0a806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:20.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.451+0000 7fe0c232a640 1 --2- 172.21.15.123:0/3007485662 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe0a806c2b0 0x7fe0a806e770 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac007fd0 tx=0x7fe0ac007e80 comp rx=0 tx=0).stop 2024-09-15T23:14:20.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.451+0000 7fe0c232a640 1 -- 172.21.15.123:0/3007485662 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0bc0732e0 msgr2=0x7fe0bc1f3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:20.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.451+0000 7fe0c232a640 1 --2- 172.21.15.123:0/3007485662 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0bc0732e0 0x7fe0bc1f3fd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe0b00098c0 tx=0x7fe0b00046c0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.451+0000 7fe0c232a640 1 -- 172.21.15.123:0/3007485662 shutdown_connections 2024-09-15T23:14:20.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.451+0000 7fe0c232a640 1 --2- 172.21.15.123:0/3007485662 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0bc0cce30 0x7fe0bc1f4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.451+0000 7fe0c232a640 1 --2- 172.21.15.123:0/3007485662 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe0a806c2b0 0x7fe0a806e770 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.451+0000 7fe0c232a640 1 --2- 172.21.15.123:0/3007485662 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0bc0732e0 0x7fe0bc1f3fd0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.451+0000 7fe0c232a640 1 --2- 172.21.15.123:0/3007485662 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0bc071c70 0x7fe0bc156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.451+0000 7fe0c232a640 1 -- 172.21.15.123:0/3007485662 >> 172.21.15.123:0/3007485662 conn(0x7fe0bc06d0f0 msgr2=0x7fe0bc0b2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:20.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.451+0000 7fe0c232a640 1 -- 172.21.15.123:0/3007485662 shutdown_connections 2024-09-15T23:14:20.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.451+0000 7fe0c232a640 1 -- 172.21.15.123:0/3007485662 wait complete. 2024-09-15T23:14:20.463 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T23:14:20.464 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 perf dump 2024-09-15T23:14:20.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.563+0000 7fca97b9f640 1 Processor -- start 2024-09-15T23:14:20.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.563+0000 7fca97b9f640 1 -- start start 2024-09-15T23:14:20.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.564+0000 7fca97b9f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fca90158c80 0x7fca90162230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.564+0000 7fca97b9f640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca90144090 con 0x7fca9006c320 2024-09-15T23:14:20.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.564+0000 7fca97b9f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca90144370 con 0x7fca900afb90 2024-09-15T23:14:20.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.564+0000 7fca97b9f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fca90141a00 con 0x7fca90158c80 2024-09-15T23:14:20.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.564+0000 7fca9593b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fca90158c80 0x7fca90162230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.564+0000 7fca9613c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fca9006c320 0x7fca9015ef90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38130/0 (socket says 172.21.15.123:38130) 2024-09-15T23:14:20.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.564+0000 7fca9613c640 1 -- 172.21.15.123:0/2052786464 learned_addr learned my addr 172.21.15.123:0/2052786464 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:20.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.564+0000 7fca9593b640 1 -- 172.21.15.123:0/2052786464 >> v1:172.21.15.188:6789/0 conn(0x7fca900afb90 legacy=0x7fca9006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:20.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.564+0000 7fca9593b640 1 -- 172.21.15.123:0/2052786464 >> v1:172.21.15.123:6789/0 conn(0x7fca9006c320 legacy=0x7fca9015ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:20.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.564+0000 7fca9593b640 1 -- 172.21.15.123:0/2052786464 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca90144650 con 0x7fca90158c80 2024-09-15T23:14:20.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.564+0000 7fca94939640 1 -- 172.21.15.123:0/2052786464 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2078590517 0 0) 0x7fca90144090 con 0x7fca9006c320 2024-09-15T23:14:20.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.565+0000 7fca9593b640 1 --2- 172.21.15.123:0/2052786464 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca90158c80 0x7fca90162230 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fca840097a0 tx=0x7fca8402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca123f8ebfcfaa74 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:20.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.565+0000 7fca94939640 1 -- 172.21.15.123:0/2052786464 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca84037070 con 0x7fca90158c80 2024-09-15T23:14:20.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.565+0000 7fca94939640 1 -- 172.21.15.123:0/2052786464 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca84032440 con 0x7fca90158c80 2024-09-15T23:14:20.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.565+0000 7fca94939640 1 -- 172.21.15.123:0/2052786464 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca84032810 con 0x7fca90158c80 2024-09-15T23:14:20.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.565+0000 7fca97b9f640 1 -- 172.21.15.123:0/2052786464 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca90158c80 msgr2=0x7fca90162230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:20.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.565+0000 7fca97b9f640 1 --2- 172.21.15.123:0/2052786464 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca90158c80 0x7fca90162230 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fca840097a0 tx=0x7fca8402a230 comp rx=0 tx=0).stop 2024-09-15T23:14:20.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.565+0000 7fca97b9f640 1 -- 172.21.15.123:0/2052786464 shutdown_connections 2024-09-15T23:14:20.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.565+0000 7fca97b9f640 1 --2- 172.21.15.123:0/2052786464 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca90158c80 0x7fca90162230 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.565+0000 7fca97b9f640 1 -- 172.21.15.123:0/2052786464 >> 172.21.15.123:0/2052786464 conn(0x7fca9006cd20 msgr2=0x7fca9006d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:20.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.565+0000 7fca97b9f640 1 -- 172.21.15.123:0/2052786464 shutdown_connections 2024-09-15T23:14:20.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.565+0000 7fca97b9f640 1 -- 172.21.15.123:0/2052786464 wait complete. 2024-09-15T23:14:20.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.567+0000 7fca97b9f640 1 Processor -- start 2024-09-15T23:14:20.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.567+0000 7fca97b9f640 1 -- start start 2024-09-15T23:14:20.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.567+0000 7fca97b9f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fca9006c320 0x7fca90161b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.567+0000 7fca97b9f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca900afb90 0x7fca900b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.567+0000 7fca97b9f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca90158c80 0x7fca9012c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.567+0000 7fca97b9f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fca90159060 con 0x7fca900afb90 2024-09-15T23:14:20.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.567+0000 7fca97b9f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fca90144c10 con 0x7fca90158c80 2024-09-15T23:14:20.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.567+0000 7fca97b9f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fca90143d20 con 0x7fca9006c320 2024-09-15T23:14:20.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.567+0000 7fca9513a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca900afb90 0x7fca900b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.567+0000 7fca9513a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca900afb90 0x7fca900b20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54988/0 (socket says 172.21.15.123:54988) 2024-09-15T23:14:20.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.567+0000 7fca9513a640 1 -- 172.21.15.123:0/2660916331 learned_addr learned my addr 172.21.15.123:0/2660916331 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:20.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.568+0000 7fca9593b640 1 --2- 172.21.15.123:0/2660916331 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fca9006c320 0x7fca90161b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.568+0000 7fca9613c640 1 --2- 172.21.15.123:0/2660916331 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca90158c80 0x7fca9012c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.568+0000 7fca9513a640 1 -- 172.21.15.123:0/2660916331 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fca9006c320 msgr2=0x7fca90161b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:20.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.568+0000 7fca9513a640 1 --2- 172.21.15.123:0/2660916331 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fca9006c320 0x7fca90161b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.568+0000 7fca9513a640 1 -- 172.21.15.123:0/2660916331 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca90158c80 msgr2=0x7fca9012c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:20.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.568+0000 7fca9513a640 1 --2- 172.21.15.123:0/2660916331 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca90158c80 0x7fca9012c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.568+0000 7fca9513a640 1 -- 172.21.15.123:0/2660916331 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca900b18f0 con 0x7fca900afb90 2024-09-15T23:14:20.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.568+0000 7fca9613c640 1 --2- 172.21.15.123:0/2660916331 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca90158c80 0x7fca9012c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:20.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.568+0000 7fca9513a640 1 --2- 172.21.15.123:0/2660916331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca900afb90 0x7fca900b20b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fca8c00c430 tx=0x7fca8c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:20.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.568+0000 7fca827fc640 1 -- 172.21.15.123:0/2660916331 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c017070 con 0x7fca900afb90 2024-09-15T23:14:20.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.568+0000 7fca827fc640 1 -- 172.21.15.123:0/2660916331 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca8c0052d0 con 0x7fca900afb90 2024-09-15T23:14:20.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.568+0000 7fca97b9f640 1 -- 172.21.15.123:0/2660916331 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca90141100 con 0x7fca900afb90 2024-09-15T23:14:20.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.568+0000 7fca827fc640 1 -- 172.21.15.123:0/2660916331 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c003830 con 0x7fca900afb90 2024-09-15T23:14:20.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.568+0000 7fca97b9f640 1 -- 172.21.15.123:0/2660916331 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca90159660 con 0x7fca900afb90 2024-09-15T23:14:20.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.569+0000 7fca827fc640 1 -- 172.21.15.123:0/2660916331 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fca8c01a070 con 0x7fca900afb90 2024-09-15T23:14:20.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.570+0000 7fca827fc640 1 --2- 172.21.15.123:0/2660916331 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fca7406c2b0 0x7fca7406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.570+0000 7fca827fc640 1 -- 172.21.15.123:0/2660916331 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5853+0+0 (secure 0 0 0) 0x7fca8c08a7a0 con 0x7fca900afb90 2024-09-15T23:14:20.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.570+0000 7fca9593b640 1 --2- 172.21.15.123:0/2660916331 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fca7406c2b0 0x7fca7406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.571+0000 7fca9593b640 1 --2- 172.21.15.123:0/2660916331 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fca7406c2b0 0x7fca7406e770 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fca84034000 tx=0x7fca8402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:20.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.571+0000 7fca9aa16740 1 Processor -- start 2024-09-15T23:14:20.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.571+0000 7fca9aa16740 1 -- start start 2024-09-15T23:14:20.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.572+0000 7fca9aa16740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5622dd9f35e0 0x5622dd9f39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.572+0000 7fca9aa16740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5622dd9f0da0 0x5622dd9f2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.572+0000 7fca9aa16740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5622dd9f1200 0x5622dd9d3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.572+0000 7fca9aa16740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5622dd90f8d0 con 0x5622dd9f0da0 2024-09-15T23:14:20.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.572+0000 7fca9aa16740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5622dd8b7620 con 0x5622dd9f1200 2024-09-15T23:14:20.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.572+0000 7fca9aa16740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5622dd90b890 con 0x5622dd9f35e0 2024-09-15T23:14:20.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.572+0000 7fca9513a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5622dd9f0da0 0x5622dd9f2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.572+0000 7fca9513a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5622dd9f0da0 0x5622dd9f2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54990/0 (socket says 172.21.15.123:54990) 2024-09-15T23:14:20.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.572+0000 7fca9513a640 1 -- 172.21.15.123:0/239773540 learned_addr learned my addr 172.21.15.123:0/239773540 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:20.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.572+0000 7fca9593b640 1 --2- 172.21.15.123:0/239773540 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5622dd9f35e0 0x5622dd9f39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.572+0000 7fca9613c640 1 --2- 172.21.15.123:0/239773540 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5622dd9f1200 0x5622dd9d3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.572+0000 7fca9513a640 1 -- 172.21.15.123:0/239773540 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5622dd9f35e0 msgr2=0x5622dd9f39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:20.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.572+0000 7fca9513a640 1 --2- 172.21.15.123:0/239773540 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5622dd9f35e0 0x5622dd9f39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.572+0000 7fca9513a640 1 -- 172.21.15.123:0/239773540 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5622dd9f1200 msgr2=0x5622dd9d3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:20.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.572+0000 7fca9513a640 1 --2- 172.21.15.123:0/239773540 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5622dd9f1200 0x5622dd9d3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.572+0000 7fca9513a640 1 -- 172.21.15.123:0/239773540 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622dd6ec7d0 con 0x5622dd9f0da0 2024-09-15T23:14:20.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.572+0000 7fca9613c640 1 --2- 172.21.15.123:0/239773540 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5622dd9f1200 0x5622dd9d3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:20.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.572+0000 7fca9513a640 1 --2- 172.21.15.123:0/239773540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5622dd9f0da0 0x5622dd9f2930 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fca8c088be0 tx=0x7fca8c007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=355da07b5630503d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:20.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.572+0000 7fca737fe640 1 -- 172.21.15.123:0/239773540 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c061360 con 0x5622dd9f0da0 2024-09-15T23:14:20.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.572+0000 7fca737fe640 1 -- 172.21.15.123:0/239773540 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca8c056b30 con 0x5622dd9f0da0 2024-09-15T23:14:20.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.572+0000 7fca737fe640 1 -- 172.21.15.123:0/239773540 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c057c80 con 0x5622dd9f0da0 2024-09-15T23:14:20.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.573+0000 7fca9aa16740 1 -- 172.21.15.123:0/239773540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5622dd9f0da0 msgr2=0x5622dd9f2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:20.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.573+0000 7fca9aa16740 1 --2- 172.21.15.123:0/239773540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5622dd9f0da0 0x5622dd9f2930 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fca8c088be0 tx=0x7fca8c007f90 comp rx=0 tx=0).stop 2024-09-15T23:14:20.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.573+0000 7fca9aa16740 1 -- 172.21.15.123:0/239773540 shutdown_connections 2024-09-15T23:14:20.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.573+0000 7fca9aa16740 1 --2- 172.21.15.123:0/239773540 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5622dd9f1200 0x5622dd9d3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.573+0000 7fca9aa16740 1 --2- 172.21.15.123:0/239773540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5622dd9f0da0 0x5622dd9f2930 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.573+0000 7fca9aa16740 1 --2- 172.21.15.123:0/239773540 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5622dd9f35e0 0x5622dd9f39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.573+0000 7fca9aa16740 1 -- 172.21.15.123:0/239773540 >> 172.21.15.123:0/239773540 conn(0x5622dd9a9240 msgr2=0x5622dd9f1650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:20.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.573+0000 7fca9aa16740 1 -- 172.21.15.123:0/239773540 shutdown_connections 2024-09-15T23:14:20.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.573+0000 7fca9aa16740 1 -- 172.21.15.123:0/239773540 wait complete. 2024-09-15T23:14:20.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.573+0000 7fca9aa16740 1 -- start start 2024-09-15T23:14:20.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.574+0000 7fca9aa16740 1 Processor -- start 2024-09-15T23:14:20.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.574+0000 7fca9aa16740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5622dd9f1200 0x5622dd9ed440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.574+0000 7fca9aa16740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5622dd9f35e0 0x5622dd9d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.574+0000 7fca9aa16740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5622dd9d7400 0x5622dd9a66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.574+0000 7fca9aa16740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5622dd9efd00 con 0x5622dd9d7400 2024-09-15T23:14:20.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.574+0000 7fca9aa16740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5622dd898750 con 0x5622dd9f1200 2024-09-15T23:14:20.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.574+0000 7fca9aa16740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5622dd9effe0 con 0x5622dd9f35e0 2024-09-15T23:14:20.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.574+0000 7fca9aa16740 10 client.0 _ll_register_callbacks cb 0x5622dd8bc780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:20.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.575+0000 7fca9613c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5622dd9d7400 0x5622dd9a66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.575+0000 7fca9613c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5622dd9d7400 0x5622dd9a66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55002/0 (socket says 172.21.15.123:55002) 2024-09-15T23:14:20.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.575+0000 7fca9613c640 1 -- 172.21.15.123:0/359740195 learned_addr learned my addr 172.21.15.123:0/359740195 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:20.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.575+0000 7fca9513a640 1 --2- 172.21.15.123:0/359740195 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5622dd9f35e0 0x5622dd9d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.575+0000 7fca9593b640 1 --2- 172.21.15.123:0/359740195 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5622dd9f1200 0x5622dd9ed440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.575+0000 7fca9613c640 1 -- 172.21.15.123:0/359740195 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5622dd9f35e0 msgr2=0x5622dd9d0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:20.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.575+0000 7fca9613c640 1 --2- 172.21.15.123:0/359740195 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5622dd9f35e0 0x5622dd9d0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.575+0000 7fca9613c640 1 -- 172.21.15.123:0/359740195 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5622dd9f1200 msgr2=0x5622dd9ed440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:20.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.575+0000 7fca9613c640 1 --2- 172.21.15.123:0/359740195 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5622dd9f1200 0x5622dd9ed440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.575+0000 7fca9613c640 1 -- 172.21.15.123:0/359740195 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622dd5e20f0 con 0x5622dd9d7400 2024-09-15T23:14:20.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.575+0000 7fca9613c640 1 --2- 172.21.15.123:0/359740195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5622dd9d7400 0x5622dd9a66b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fca88002070 tx=0x7fca88007420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d35dbbe21047098 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:20.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.575+0000 7fca70ff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:20.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.575+0000 7fca70ff9640 1 -- 172.21.15.123:0/359740195 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca88013570 con 0x5622dd9d7400 2024-09-15T23:14:20.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.575+0000 7fca70ff9640 1 -- 172.21.15.123:0/359740195 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(40..40 src has 1..40) ==== 5853+0+0 (secure 0 0 0) 0x7fca88013710 con 0x5622dd9d7400 2024-09-15T23:14:20.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.575+0000 7fca9aa16740 1 -- 172.21.15.123:0/359740195 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca8c056b30 con 0x5622dd9d7400 2024-09-15T23:14:20.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.575+0000 7fca70ff9640 1 -- 172.21.15.123:0/359740195 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fca88021050 con 0x5622dd9d7400 2024-09-15T23:14:20.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.575+0000 7fca9aa16740 10 client.5100 fetch_fsmap learned FSMap version 14 2024-09-15T23:14:20.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.575+0000 7fca9aa16740 1 -- 172.21.15.123:0/359740195 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x5622dd74cf60 con 0x5622dd9d7400 2024-09-15T23:14:20.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.575+0000 7fca70ff9640 1 -- 172.21.15.123:0/359740195 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca8c056b30 con 0x5622dd9d7400 2024-09-15T23:14:20.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.576+0000 7fca70ff9640 1 -- 172.21.15.123:0/359740195 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7fca88024020 con 0x5622dd9d7400 2024-09-15T23:14:20.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.576+0000 7fca9aa16740 10 client.5100 fetch_fsmap finished waiting for FSMap version 14 2024-09-15T23:14:20.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.576+0000 7fca9aa16740 10 client.5100 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-15T23:14:20.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.576+0000 7fca9aa16740 20 client.5100 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:20.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.576+0000 7fca9aa16740 1 --2- 172.21.15.123:0/359740195 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x5622dd9e89c0 0x5622dd9e8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.576+0000 7fca9aa16740 4 client.5100 mds_command: new command op to 4776 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:14:20.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.576+0000 7fca9aa16740 1 -- 172.21.15.123:0/359740195 --> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5622dd91d000 con 0x5622dd9e89c0 2024-09-15T23:14:20.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.576+0000 7fca9593b640 1 --2- 172.21.15.123:0/359740195 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x5622dd9e89c0 0x5622dd9e8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.576+0000 7fca70ff9640 10 client.5100 ms_handle_connect on v2:172.21.15.123:6834/1577644605 2024-09-15T23:14:20.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.576+0000 7fca9593b640 1 --2- 172.21.15.123:0/359740195 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x5622dd9e89c0 0x5622dd9e8df0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a5d37abd2707f02 server_cookie=e9baeb8e3697d1d in_seq=0 out_seq=0 2024-09-15T23:14:20.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.577+0000 7fca70ff9640 1 -- 172.21.15.123:0/359740195 <== mds.0 v2:172.21.15.123:6834/1577644605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5622dd91d000 con 0x5622dd9e89c0 2024-09-15T23:14:20.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.577+0000 7fca70ff9640 10 client.5100 handle_command_reply: tid=0 2024-09-15T23:14:20.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.577+0000 7fca9aa16740 1 client.5100 shutdown 2024-09-15T23:14:20.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.577+0000 7fca9aa16740 1 -- 172.21.15.123:0/359740195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5622dd9d7400 msgr2=0x5622dd9a66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:20.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.577+0000 7fca9aa16740 1 --2- 172.21.15.123:0/359740195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5622dd9d7400 0x5622dd9a66b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fca88002070 tx=0x7fca88007420 comp rx=0 tx=0).stop 2024-09-15T23:14:20.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.577+0000 7fca9aa16740 1 -- 172.21.15.123:0/359740195 shutdown_connections 2024-09-15T23:14:20.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.577+0000 7fca9aa16740 1 --2- 172.21.15.123:0/359740195 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x5622dd9e89c0 0x5622dd9e8df0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.577+0000 7fca9aa16740 1 --2- 172.21.15.123:0/359740195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5622dd9d7400 0x5622dd9a66b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.577+0000 7fca9aa16740 1 --2- 172.21.15.123:0/359740195 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5622dd9f35e0 0x5622dd9d0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.577+0000 7fca70ff9640 0 client.5100 ms_handle_reset on v2:172.21.15.123:6834/1577644605 2024-09-15T23:14:20.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.577+0000 7fca9aa16740 1 --2- 172.21.15.123:0/359740195 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5622dd9f1200 0x5622dd9ed440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.577+0000 7fca9aa16740 1 -- 172.21.15.123:0/359740195 >> 172.21.15.123:0/359740195 conn(0x5622dd9f0da0 msgr2=0x5622dd9f4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:20.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.577+0000 7fca9aa16740 1 -- 172.21.15.123:0/359740195 shutdown_connections 2024-09-15T23:14:20.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.577+0000 7fca9aa16740 1 -- 172.21.15.123:0/359740195 wait complete. 2024-09-15T23:14:20.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.577+0000 7fca9aa16740 20 client.5100 trim_cache size 0 max 16384 2024-09-15T23:14:20.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.592+0000 7fca9aa16740 1 Processor -- start 2024-09-15T23:14:20.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.593+0000 7fca9aa16740 1 -- start start 2024-09-15T23:14:20.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.593+0000 7fca9aa16740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5622dd9f1200 0x5622dda15090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.593+0000 7fca9aa16740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5622dd9f35e0 0x5622dd9f4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.593+0000 7fca9aa16740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5622dd9ad580 0x5622dd9f5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.593+0000 7fca9aa16740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fca90200c30 con 0x5622dd9ad580 2024-09-15T23:14:20.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.593+0000 7fca9aa16740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fca9012f6f0 con 0x5622dd9f1200 2024-09-15T23:14:20.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.593+0000 7fca9aa16740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fca9012ea50 con 0x5622dd9f35e0 2024-09-15T23:14:20.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.593+0000 7fca9613c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5622dd9ad580 0x5622dd9f5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.593+0000 7fca9613c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5622dd9ad580 0x5622dd9f5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55006/0 (socket says 172.21.15.123:55006) 2024-09-15T23:14:20.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.593+0000 7fca9613c640 1 -- 172.21.15.123:0/4188217965 learned_addr learned my addr 172.21.15.123:0/4188217965 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:20.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.593+0000 7fca9593b640 1 --2- 172.21.15.123:0/4188217965 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5622dd9f1200 0x5622dda15090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.594+0000 7fca9513a640 1 --2- 172.21.15.123:0/4188217965 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5622dd9f35e0 0x5622dd9f4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.594+0000 7fca9613c640 1 -- 172.21.15.123:0/4188217965 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5622dd9f35e0 msgr2=0x5622dd9f4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:20.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.594+0000 7fca9613c640 1 --2- 172.21.15.123:0/4188217965 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5622dd9f35e0 0x5622dd9f4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.594+0000 7fca9613c640 1 -- 172.21.15.123:0/4188217965 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5622dd9f1200 msgr2=0x5622dda15090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:20.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.594+0000 7fca9613c640 1 --2- 172.21.15.123:0/4188217965 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5622dd9f1200 0x5622dda15090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.594+0000 7fca9613c640 1 -- 172.21.15.123:0/4188217965 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622dd5bb1b0 con 0x5622dd9ad580 2024-09-15T23:14:20.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.594+0000 7fca9613c640 1 --2- 172.21.15.123:0/4188217965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5622dd9ad580 0x5622dd9f5060 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fca88000f80 tx=0x7fca8800e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=439487140a0f93b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:20.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.594+0000 7fca72ffd640 1 -- 172.21.15.123:0/4188217965 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca88007920 con 0x5622dd9ad580 2024-09-15T23:14:20.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.594+0000 7fca72ffd640 1 -- 172.21.15.123:0/4188217965 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca88029030 con 0x5622dd9ad580 2024-09-15T23:14:20.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.594+0000 7fca72ffd640 1 -- 172.21.15.123:0/4188217965 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca88013960 con 0x5622dd9ad580 2024-09-15T23:14:20.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.594+0000 7fca9aa16740 1 -- 172.21.15.123:0/4188217965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5622dd9ad580 msgr2=0x5622dd9f5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:20.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.594+0000 7fca9aa16740 1 --2- 172.21.15.123:0/4188217965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5622dd9ad580 0x5622dd9f5060 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fca88000f80 tx=0x7fca8800e000 comp rx=0 tx=0).stop 2024-09-15T23:14:20.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.595+0000 7fca9aa16740 1 -- 172.21.15.123:0/4188217965 shutdown_connections 2024-09-15T23:14:20.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.595+0000 7fca9aa16740 1 --2- 172.21.15.123:0/4188217965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5622dd9ad580 0x5622dd9f5060 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.595+0000 7fca9aa16740 1 --2- 172.21.15.123:0/4188217965 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5622dd9f35e0 0x5622dd9f4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.595+0000 7fca9aa16740 1 --2- 172.21.15.123:0/4188217965 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5622dd9f1200 0x5622dda15090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.595+0000 7fca9aa16740 1 -- 172.21.15.123:0/4188217965 >> 172.21.15.123:0/4188217965 conn(0x5622dd9f0da0 msgr2=0x5622dd9f2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:20.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.595+0000 7fca9aa16740 1 -- 172.21.15.123:0/4188217965 shutdown_connections 2024-09-15T23:14:20.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.595+0000 7fca9aa16740 1 -- 172.21.15.123:0/4188217965 wait complete. 2024-09-15T23:14:20.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.595+0000 7fca9aa16740 1 -- start start 2024-09-15T23:14:20.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.595+0000 7fca9aa16740 1 Processor -- start 2024-09-15T23:14:20.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.596+0000 7fca9aa16740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5622dd9f1200 0x5622dda70960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.596+0000 7fca9aa16740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5622dd9f35e0 0x5622dda59180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.596+0000 7fca9aa16740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5622dd9a7da0 0x5622dd9ffce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.596+0000 7fca9aa16740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5622dd9ee420 con 0x5622dd9f35e0 2024-09-15T23:14:20.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.596+0000 7fca9aa16740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fca9012f0a0 con 0x5622dd9a7da0 2024-09-15T23:14:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.596+0000 7fca9aa16740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5622dd9e8da0 con 0x5622dd9f1200 2024-09-15T23:14:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.596+0000 7fca9aa16740 10 client.0 _ll_register_callbacks cb 0x7fca88001c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.596+0000 7fca9513a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5622dd9f35e0 0x5622dda59180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.596+0000 7fca9513a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5622dd9f35e0 0x5622dda59180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55008/0 (socket says 172.21.15.123:55008) 2024-09-15T23:14:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.596+0000 7fca9513a640 1 -- 172.21.15.123:0/3864584805 learned_addr learned my addr 172.21.15.123:0/3864584805 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.596+0000 7fca9593b640 1 --2- 172.21.15.123:0/3864584805 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5622dd9f1200 0x5622dda70960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.596+0000 7fca9613c640 1 --2- 172.21.15.123:0/3864584805 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5622dd9a7da0 0x5622dd9ffce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.596+0000 7fca9513a640 1 -- 172.21.15.123:0/3864584805 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5622dd9f1200 msgr2=0x5622dda70960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.596+0000 7fca9513a640 1 --2- 172.21.15.123:0/3864584805 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5622dd9f1200 0x5622dda70960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.596+0000 7fca9513a640 1 -- 172.21.15.123:0/3864584805 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5622dd9a7da0 msgr2=0x5622dd9ffce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.596+0000 7fca9513a640 1 --2- 172.21.15.123:0/3864584805 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5622dd9a7da0 0x5622dd9ffce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.596+0000 7fca9513a640 1 -- 172.21.15.123:0/3864584805 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622dd9f51f0 con 0x5622dd9f35e0 2024-09-15T23:14:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.597+0000 7fca9513a640 1 --2- 172.21.15.123:0/3864584805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5622dd9f35e0 0x5622dda59180 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fca8c088c90 tx=0x7fca8c014070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d507f17aa4e64a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.597+0000 7fca70ff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:20.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.597+0000 7fca70ff9640 1 -- 172.21.15.123:0/3864584805 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c057c80 con 0x5622dd9f35e0 2024-09-15T23:14:20.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.597+0000 7fca70ff9640 1 -- 172.21.15.123:0/3864584805 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(40..40 src has 1..40) ==== 5853+0+0 (secure 0 0 0) 0x7fca8c057e20 con 0x5622dd9f35e0 2024-09-15T23:14:20.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.597+0000 7fca9aa16740 1 -- 172.21.15.123:0/3864584805 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca88029030 con 0x5622dd9f35e0 2024-09-15T23:14:20.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.597+0000 7fca70ff9640 1 -- 172.21.15.123:0/3864584805 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fca8c077b20 con 0x5622dd9f35e0 2024-09-15T23:14:20.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.597+0000 7fca9aa16740 10 client.5106 fetch_fsmap learned FSMap version 14 2024-09-15T23:14:20.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.597+0000 7fca9aa16740 1 -- 172.21.15.123:0/3864584805 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x5622dd9eba40 con 0x5622dd9f35e0 2024-09-15T23:14:20.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.597+0000 7fca70ff9640 1 -- 172.21.15.123:0/3864584805 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca88029030 con 0x5622dd9f35e0 2024-09-15T23:14:20.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.597+0000 7fca70ff9640 1 -- 172.21.15.123:0/3864584805 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7fca8c077cc0 con 0x5622dd9f35e0 2024-09-15T23:14:20.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.597+0000 7fca9aa16740 10 client.5106 fetch_fsmap finished waiting for FSMap version 14 2024-09-15T23:14:20.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.597+0000 7fca9aa16740 10 client.5106 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2024-09-15T23:14:20.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.597+0000 7fca9aa16740 20 client.5106 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:20.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.597+0000 7fca9aa16740 1 --2- 172.21.15.123:0/3864584805 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x5622dda00220 0x5622dda14c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.597+0000 7fca9aa16740 4 client.5106 mds_command: new command op to 4776 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-09-15T23:14:20.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.597+0000 7fca9aa16740 1 -- 172.21.15.123:0/3864584805 --> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] -- command(tid 0: {"prefix": "perf dump"}) -- 0x5622dd917350 con 0x5622dda00220 2024-09-15T23:14:20.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.597+0000 7fca9593b640 1 --2- 172.21.15.123:0/3864584805 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x5622dda00220 0x5622dda14c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.598+0000 7fca70ff9640 10 client.5106 ms_handle_connect on v2:172.21.15.123:6834/1577644605 2024-09-15T23:14:20.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.598+0000 7fca9593b640 1 --2- 172.21.15.123:0/3864584805 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x5622dda00220 0x5622dda14c60 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf2ad441cd028612 server_cookie=fcfff68e9d2c47fd in_seq=0 out_seq=0 2024-09-15T23:14:20.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.598+0000 7fca70ff9640 1 -- 172.21.15.123:0/3864584805 <== mds.0 v2:172.21.15.123:6834/1577644605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+17996 (crc 0 0 0) 0x5622dd917350 con 0x5622dda00220 2024-09-15T23:14:20.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.598+0000 7fca70ff9640 10 client.5106 handle_command_reply: tid=0 2024-09-15T23:14:20.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.598+0000 7fca9aa16740 1 client.5106 shutdown 2024-09-15T23:14:20.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.598+0000 7fca9aa16740 1 -- 172.21.15.123:0/3864584805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5622dd9f35e0 msgr2=0x5622dda59180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:20.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.598+0000 7fca9aa16740 1 --2- 172.21.15.123:0/3864584805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5622dd9f35e0 0x5622dda59180 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fca8c088c90 tx=0x7fca8c014070 comp rx=0 tx=0).stop 2024-09-15T23:14:20.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.598+0000 7fca9aa16740 1 -- 172.21.15.123:0/3864584805 shutdown_connections 2024-09-15T23:14:20.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.598+0000 7fca9aa16740 1 --2- 172.21.15.123:0/3864584805 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5622dd9a7da0 0x5622dd9ffce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.598+0000 7fca9aa16740 1 --2- 172.21.15.123:0/3864584805 >> [v2:172.21.15.123:6834/1577644605,v1:172.21.15.123:6835/1577644605] conn(0x5622dda00220 0x5622dda14c60 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.598+0000 7fca9aa16740 1 --2- 172.21.15.123:0/3864584805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5622dd9f35e0 0x5622dda59180 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.598+0000 7fca9aa16740 1 --2- 172.21.15.123:0/3864584805 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5622dd9f1200 0x5622dda70960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.598+0000 7fca70ff9640 0 client.5106 ms_handle_reset on v2:172.21.15.123:6834/1577644605 2024-09-15T23:14:20.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.598+0000 7fca9aa16740 1 -- 172.21.15.123:0/3864584805 >> 172.21.15.123:0/3864584805 conn(0x5622dd9f0da0 msgr2=0x5622dd9e7920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:20.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.598+0000 7fca9aa16740 1 -- 172.21.15.123:0/3864584805 shutdown_connections 2024-09-15T23:14:20.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.598+0000 7fca9aa16740 1 -- 172.21.15.123:0/3864584805 wait complete. 2024-09-15T23:14:20.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.599+0000 7fca9aa16740 20 client.5106 trim_cache size 0 max 16384 2024-09-15T23:14:20.606 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:14:20.606 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T23:14:20.606 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 29463, 2024-09-15T23:14:20.606 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 51691, 2024-09-15T23:14:20.606 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 9561370, 2024-09-15T23:14:20.607 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 53809739, 2024-09-15T23:14:20.607 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 19, 2024-09-15T23:14:20.607 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 6, 2024-09-15T23:14:20.607 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 2.808177398, 2024-09-15T23:14:20.607 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 2.103104014, 2024-09-15T23:14:20.607 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.817789940, 2024-09-15T23:14:20.607 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.073450239, 2024-09-15T23:14:20.607 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:14:20.607 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 51689, 2024-09-15T23:14:20.607 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 1.329576064, 2024-09-15T23:14:20.607 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000025722 2024-09-15T23:14:20.607 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.607 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:14:20.607 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 48642, 2024-09-15T23:14:20.608 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.008176966, 2024-09-15T23:14:20.608 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000168 2024-09-15T23:14:20.608 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.608 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T23:14:20.608 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T23:14:20.608 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.608 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T23:14:20.608 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 3731, 2024-09-15T23:14:20.608 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 3726, 2024-09-15T23:14:20.608 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 1440683, 2024-09-15T23:14:20.608 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 43730100, 2024-09-15T23:14:20.608 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 5, 2024-09-15T23:14:20.608 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 4, 2024-09-15T23:14:20.609 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.385987507, 2024-09-15T23:14:20.609 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.211359989, 2024-09-15T23:14:20.609 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.070388126, 2024-09-15T23:14:20.609 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.093668075, 2024-09-15T23:14:20.609 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:14:20.609 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 3725, 2024-09-15T23:14:20.609 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.468699590, 2024-09-15T23:14:20.609 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000125825 2024-09-15T23:14:20.609 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.609 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:14:20.609 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:14:20.609 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:14:20.609 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:14:20.609 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.610 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 123584, 2024-09-15T23:14:20.610 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 26624 2024-09-15T23:14:20.610 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.610 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T23:14:20.610 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 2446, 2024-09-15T23:14:20.610 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 2465, 2024-09-15T23:14:20.610 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 621600, 2024-09-15T23:14:20.610 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 16797238, 2024-09-15T23:14:20.610 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 6, 2024-09-15T23:14:20.610 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 4, 2024-09-15T23:14:20.610 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.243640631, 2024-09-15T23:14:20.610 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.124074032, 2024-09-15T23:14:20.610 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.045859838, 2024-09-15T23:14:20.610 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.062693847, 2024-09-15T23:14:20.611 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:14:20.611 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2464, 2024-09-15T23:14:20.611 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.363399834, 2024-09-15T23:14:20.611 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000147483 2024-09-15T23:14:20.611 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.611 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:14:20.611 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:14:20.611 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:14:20.611 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:14:20.611 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.611 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 1728, 2024-09-15T23:14:20.611 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 119664 2024-09-15T23:14:20.611 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.611 INFO:teuthology.orchestra.run.smithi123.stdout: "cct": { 2024-09-15T23:14:20.612 INFO:teuthology.orchestra.run.smithi123.stdout: "total_workers": 1, 2024-09-15T23:14:20.612 INFO:teuthology.orchestra.run.smithi123.stdout: "unhealthy_workers": 0 2024-09-15T23:14:20.612 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.612 INFO:teuthology.orchestra.run.smithi123.stdout: "finisher-MDSRank": { 2024-09-15T23:14:20.612 INFO:teuthology.orchestra.run.smithi123.stdout: "queue_len": 0, 2024-09-15T23:14:20.612 INFO:teuthology.orchestra.run.smithi123.stdout: "complete_latency": { 2024-09-15T23:14:20.612 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2683, 2024-09-15T23:14:20.612 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 16.426865937, 2024-09-15T23:14:20.612 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.006122573 2024-09-15T23:14:20.612 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:14:20.612 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.612 INFO:teuthology.orchestra.run.smithi123.stdout: "finisher-PurgeQueue": { 2024-09-15T23:14:20.612 INFO:teuthology.orchestra.run.smithi123.stdout: "queue_len": 0, 2024-09-15T23:14:20.612 INFO:teuthology.orchestra.run.smithi123.stdout: "complete_latency": { 2024-09-15T23:14:20.613 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 4315, 2024-09-15T23:14:20.613 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 1.324451772, 2024-09-15T23:14:20.613 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000306941 2024-09-15T23:14:20.613 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:14:20.613 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.613 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-09-15T23:14:20.613 INFO:teuthology.orchestra.run.smithi123.stdout: "request": 25553, 2024-09-15T23:14:20.613 INFO:teuthology.orchestra.run.smithi123.stdout: "reply": 25553, 2024-09-15T23:14:20.613 INFO:teuthology.orchestra.run.smithi123.stdout: "reply_latency": { 2024-09-15T23:14:20.613 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 25553, 2024-09-15T23:14:20.613 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 319.230821341, 2024-09-15T23:14:20.613 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.012492890 2024-09-15T23:14:20.613 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.613 INFO:teuthology.orchestra.run.smithi123.stdout: "slow_reply": 0, 2024-09-15T23:14:20.614 INFO:teuthology.orchestra.run.smithi123.stdout: "forward": 0, 2024-09-15T23:14:20.614 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_fetch_complete": 0, 2024-09-15T23:14:20.614 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_fetch_keys": 0, 2024-09-15T23:14:20.614 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_commit": 12, 2024-09-15T23:14:20.614 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_split": 0, 2024-09-15T23:14:20.614 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_merge": 0, 2024-09-15T23:14:20.614 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes": 17900, 2024-09-15T23:14:20.614 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_top": 0, 2024-09-15T23:14:20.614 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_bottom": 17900, 2024-09-15T23:14:20.614 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_pin_tail": 0, 2024-09-15T23:14:20.614 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_pinned": 17899, 2024-09-15T23:14:20.614 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_expired": 0, 2024-09-15T23:14:20.614 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_with_caps": 2, 2024-09-15T23:14:20.614 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": 2, 2024-09-15T23:14:20.615 INFO:teuthology.orchestra.run.smithi123.stdout: "subtrees": 2, 2024-09-15T23:14:20.615 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse": 46267, 2024-09-15T23:14:20.615 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_hit": 45826, 2024-09-15T23:14:20.615 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_forward": 0, 2024-09-15T23:14:20.615 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_discover": 0, 2024-09-15T23:14:20.615 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_dir_fetch": 0, 2024-09-15T23:14:20.615 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_remote_ino": 0, 2024-09-15T23:14:20.615 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_lock": 90, 2024-09-15T23:14:20.615 INFO:teuthology.orchestra.run.smithi123.stdout: "load_cent": 0, 2024-09-15T23:14:20.615 INFO:teuthology.orchestra.run.smithi123.stdout: "q": 0, 2024-09-15T23:14:20.615 INFO:teuthology.orchestra.run.smithi123.stdout: "exported": 0, 2024-09-15T23:14:20.615 INFO:teuthology.orchestra.run.smithi123.stdout: "exported_inodes": 0, 2024-09-15T23:14:20.615 INFO:teuthology.orchestra.run.smithi123.stdout: "imported": 0, 2024-09-15T23:14:20.615 INFO:teuthology.orchestra.run.smithi123.stdout: "imported_inodes": 0, 2024-09-15T23:14:20.616 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_dir_fetch": 0, 2024-09-15T23:14:20.616 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_backtrace_fetch": 2013, 2024-09-15T23:14:20.616 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_peer_discover": 0, 2024-09-15T23:14:20.616 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rfiles": 0, 2024-09-15T23:14:20.616 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rbytes": 0, 2024-09-15T23:14:20.616 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rsnaps": 0, 2024-09-15T23:14:20.616 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_backtrace_fetch": 2013, 2024-09-15T23:14:20.616 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_set_tag": 0, 2024-09-15T23:14:20.616 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T23:14:20.616 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_inotable_repaired": 0, 2024-09-15T23:14:20.616 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dir_inodes": 13, 2024-09-15T23:14:20.616 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dir_base_inodes": 2, 2024-09-15T23:14:20.616 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dirfrag_rstats": 11, 2024-09-15T23:14:20.616 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_file_inodes": 2000, 2024-09-15T23:14:20.617 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_inode_file_caps": 0, 2024-09-15T23:14:20.617 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_revoke": 1380, 2024-09-15T23:14:20.617 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_grant": 4040, 2024-09-15T23:14:20.617 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_trunc": 0, 2024-09-15T23:14:20.617 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T23:14:20.617 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T23:14:20.617 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_caps": 3382, 2024-09-15T23:14:20.617 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_caps_dirty": 2308, 2024-09-15T23:14:20.617 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_cap_release": 46, 2024-09-15T23:14:20.617 INFO:teuthology.orchestra.run.smithi123.stdout: "process_request_cap_release": 14064 2024-09-15T23:14:20.617 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.617 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_cache": { 2024-09-15T23:14:20.617 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_update": 0, 2024-09-15T23:14:20.618 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_update_receipt": 0, 2024-09-15T23:14:20.618 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_try_discover": 0, 2024-09-15T23:14:20.618 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_send_discover": 0, 2024-09-15T23:14:20.618 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_handle_discover": 0, 2024-09-15T23:14:20.618 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays": 0, 2024-09-15T23:14:20.618 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays_delayed": 0, 2024-09-15T23:14:20.618 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays_enqueuing": 0, 2024-09-15T23:14:20.618 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_created": 4128, 2024-09-15T23:14:20.618 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_enqueued": 3836, 2024-09-15T23:14:20.618 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_reintegrated": 2212, 2024-09-15T23:14:20.618 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_migrated": 0, 2024-09-15T23:14:20.618 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_processing": 0, 2024-09-15T23:14:20.618 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_enqueued": 0, 2024-09-15T23:14:20.618 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_prioritized": 0, 2024-09-15T23:14:20.618 INFO:teuthology.orchestra.run.smithi123.stdout: "recovery_started": 0, 2024-09-15T23:14:20.619 INFO:teuthology.orchestra.run.smithi123.stdout: "recovery_completed": 0, 2024-09-15T23:14:20.619 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_quiesce_path": 0, 2024-09-15T23:14:20.619 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_quiesce_inode": 0, 2024-09-15T23:14:20.619 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_enqueue_scrub": 1, 2024-09-15T23:14:20.619 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_exportdir": 0, 2024-09-15T23:14:20.619 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_flush": 0, 2024-09-15T23:14:20.619 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_fragmentdir": 0, 2024-09-15T23:14:20.619 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_fragstats": 0, 2024-09-15T23:14:20.619 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_inodestats": 0 2024-09-15T23:14:20.619 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.619 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_log": { 2024-09-15T23:14:20.619 INFO:teuthology.orchestra.run.smithi123.stdout: "evlrg": 0, 2024-09-15T23:14:20.619 INFO:teuthology.orchestra.run.smithi123.stdout: "evadd": 27197, 2024-09-15T23:14:20.619 INFO:teuthology.orchestra.run.smithi123.stdout: "evex": 0, 2024-09-15T23:14:20.620 INFO:teuthology.orchestra.run.smithi123.stdout: "evtrm": 0, 2024-09-15T23:14:20.620 INFO:teuthology.orchestra.run.smithi123.stdout: "ev": 27197, 2024-09-15T23:14:20.620 INFO:teuthology.orchestra.run.smithi123.stdout: "evexg": 0, 2024-09-15T23:14:20.620 INFO:teuthology.orchestra.run.smithi123.stdout: "evexd": 0, 2024-09-15T23:14:20.620 INFO:teuthology.orchestra.run.smithi123.stdout: "segadd": 36, 2024-09-15T23:14:20.620 INFO:teuthology.orchestra.run.smithi123.stdout: "segex": 0, 2024-09-15T23:14:20.620 INFO:teuthology.orchestra.run.smithi123.stdout: "segtrm": 0, 2024-09-15T23:14:20.620 INFO:teuthology.orchestra.run.smithi123.stdout: "seg": 36, 2024-09-15T23:14:20.620 INFO:teuthology.orchestra.run.smithi123.stdout: "segmjr": 4, 2024-09-15T23:14:20.620 INFO:teuthology.orchestra.run.smithi123.stdout: "segexg": 0, 2024-09-15T23:14:20.620 INFO:teuthology.orchestra.run.smithi123.stdout: "segexd": 0, 2024-09-15T23:14:20.620 INFO:teuthology.orchestra.run.smithi123.stdout: "expos": 4194304, 2024-09-15T23:14:20.620 INFO:teuthology.orchestra.run.smithi123.stdout: "wrpos": 96538654, 2024-09-15T23:14:20.620 INFO:teuthology.orchestra.run.smithi123.stdout: "rdpos": 0, 2024-09-15T23:14:20.621 INFO:teuthology.orchestra.run.smithi123.stdout: "jlat": { 2024-09-15T23:14:20.621 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2584, 2024-09-15T23:14:20.621 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 90.550667943, 2024-09-15T23:14:20.621 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.035042828 2024-09-15T23:14:20.621 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.621 INFO:teuthology.orchestra.run.smithi123.stdout: "replayed": 0 2024-09-15T23:14:20.621 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.621 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_mem": { 2024-09-15T23:14:20.621 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 14, 2024-09-15T23:14:20.621 INFO:teuthology.orchestra.run.smithi123.stdout: "ino+": 2016, 2024-09-15T23:14:20.621 INFO:teuthology.orchestra.run.smithi123.stdout: "ino-": 2002, 2024-09-15T23:14:20.621 INFO:teuthology.orchestra.run.smithi123.stdout: "dir": 13, 2024-09-15T23:14:20.621 INFO:teuthology.orchestra.run.smithi123.stdout: "dir+": 13, 2024-09-15T23:14:20.622 INFO:teuthology.orchestra.run.smithi123.stdout: "dir-": 0, 2024-09-15T23:14:20.622 INFO:teuthology.orchestra.run.smithi123.stdout: "dn": 17900, 2024-09-15T23:14:20.622 INFO:teuthology.orchestra.run.smithi123.stdout: "dn+": 19901, 2024-09-15T23:14:20.622 INFO:teuthology.orchestra.run.smithi123.stdout: "dn-": 2001, 2024-09-15T23:14:20.622 INFO:teuthology.orchestra.run.smithi123.stdout: "cap": 2, 2024-09-15T23:14:20.622 INFO:teuthology.orchestra.run.smithi123.stdout: "cap+": 6512, 2024-09-15T23:14:20.622 INFO:teuthology.orchestra.run.smithi123.stdout: "cap-": 6510, 2024-09-15T23:14:20.622 INFO:teuthology.orchestra.run.smithi123.stdout: "rss": 101192, 2024-09-15T23:14:20.622 INFO:teuthology.orchestra.run.smithi123.stdout: "heap": 231788 2024-09-15T23:14:20.622 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.622 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_server": { 2024-09-15T23:14:20.622 INFO:teuthology.orchestra.run.smithi123.stdout: "dispatch_client_request": 28364, 2024-09-15T23:14:20.622 INFO:teuthology.orchestra.run.smithi123.stdout: "dispatch_server_request": 0, 2024-09-15T23:14:20.622 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_request": 25553, 2024-09-15T23:14:20.622 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_session": 5, 2024-09-15T23:14:20.623 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_peer_request": 0, 2024-09-15T23:14:20.623 INFO:teuthology.orchestra.run.smithi123.stdout: "req_create_latency": { 2024-09-15T23:14:20.623 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2000, 2024-09-15T23:14:20.623 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 1.631874338, 2024-09-15T23:14:20.623 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000815937 2024-09-15T23:14:20.623 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.623 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getattr_latency": { 2024-09-15T23:14:20.623 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 30, 2024-09-15T23:14:20.623 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.004380140, 2024-09-15T23:14:20.623 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000146004 2024-09-15T23:14:20.623 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.623 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getfilelock_latency": { 2024-09-15T23:14:20.623 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:14:20.623 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:14:20.624 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:14:20.624 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.624 INFO:teuthology.orchestra.run.smithi123.stdout: "req_link_latency": { 2024-09-15T23:14:20.624 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 6000, 2024-09-15T23:14:20.624 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 7.672915706, 2024-09-15T23:14:20.624 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.001278819 2024-09-15T23:14:20.624 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.624 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookup_latency": { 2024-09-15T23:14:20.624 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 7297, 2024-09-15T23:14:20.624 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 5.748462426, 2024-09-15T23:14:20.624 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000787784 2024-09-15T23:14:20.624 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.624 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookuphash_latency": { 2024-09-15T23:14:20.624 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:14:20.625 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:14:20.625 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:14:20.625 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.625 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupino_latency": { 2024-09-15T23:14:20.625 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:14:20.625 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:14:20.625 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:14:20.625 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.625 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupname_latency": { 2024-09-15T23:14:20.625 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:14:20.625 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:14:20.625 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:14:20.625 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.625 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupparent_latency": { 2024-09-15T23:14:20.626 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:14:20.626 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:14:20.626 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:14:20.626 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.626 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupsnap_latency": { 2024-09-15T23:14:20.626 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1, 2024-09-15T23:14:20.626 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000043438, 2024-09-15T23:14:20.626 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000043438 2024-09-15T23:14:20.626 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.626 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lssnap_latency": { 2024-09-15T23:14:20.626 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:14:20.626 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:14:20.626 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:14:20.626 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.627 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mkdir_latency": { 2024-09-15T23:14:20.627 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1, 2024-09-15T23:14:20.627 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.002829817, 2024-09-15T23:14:20.627 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.002829817 2024-09-15T23:14:20.627 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.627 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mknod_latency": { 2024-09-15T23:14:20.627 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:14:20.627 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:14:20.627 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:14:20.627 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.627 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mksnap_latency": { 2024-09-15T23:14:20.627 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1, 2024-09-15T23:14:20.627 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.256602058, 2024-09-15T23:14:20.627 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.256602058 2024-09-15T23:14:20.628 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.628 INFO:teuthology.orchestra.run.smithi123.stdout: "req_open_latency": { 2024-09-15T23:14:20.628 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1, 2024-09-15T23:14:20.628 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000081221, 2024-09-15T23:14:20.628 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000081221 2024-09-15T23:14:20.628 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.628 INFO:teuthology.orchestra.run.smithi123.stdout: "req_readdir_latency": { 2024-09-15T23:14:20.628 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 8, 2024-09-15T23:14:20.628 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.271188650, 2024-09-15T23:14:20.628 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.033898581 2024-09-15T23:14:20.628 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.628 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rename_latency": { 2024-09-15T23:14:20.628 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2212, 2024-09-15T23:14:20.629 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 285.172683197, 2024-09-15T23:14:20.629 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.128920742 2024-09-15T23:14:20.629 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.629 INFO:teuthology.orchestra.run.smithi123.stdout: "req_renamesnap_latency": { 2024-09-15T23:14:20.629 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:14:20.629 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:14:20.629 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:14:20.629 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.629 INFO:teuthology.orchestra.run.smithi123.stdout: "req_snapdiff_latency": { 2024-09-15T23:14:20.629 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:14:20.629 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:14:20.629 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:14:20.629 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.630 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmdir_latency": { 2024-09-15T23:14:20.630 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:14:20.630 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:14:20.630 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:14:20.630 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.630 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmsnap_latency": { 2024-09-15T23:14:20.630 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1, 2024-09-15T23:14:20.630 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.062614101, 2024-09-15T23:14:20.630 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.062614101 2024-09-15T23:14:20.630 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.630 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmxattr_latency": { 2024-09-15T23:14:20.630 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:14:20.630 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:14:20.630 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:14:20.631 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.631 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setattr_latency": { 2024-09-15T23:14:20.631 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1, 2024-09-15T23:14:20.631 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000249553, 2024-09-15T23:14:20.631 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000249553 2024-09-15T23:14:20.631 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.631 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setdirlayout_latency": { 2024-09-15T23:14:20.631 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:14:20.631 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:14:20.631 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:14:20.631 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.631 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setfilelock_latency": { 2024-09-15T23:14:20.631 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:14:20.631 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:14:20.632 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:14:20.632 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.632 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setlayout_latency": { 2024-09-15T23:14:20.632 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:14:20.632 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:14:20.632 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:14:20.632 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.632 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setxattr_latency": { 2024-09-15T23:14:20.632 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:14:20.632 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:14:20.632 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:14:20.632 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.632 INFO:teuthology.orchestra.run.smithi123.stdout: "req_symlink_latency": { 2024-09-15T23:14:20.633 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:14:20.633 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:14:20.633 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:14:20.633 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.633 INFO:teuthology.orchestra.run.smithi123.stdout: "req_unlink_latency": { 2024-09-15T23:14:20.633 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 8000, 2024-09-15T23:14:20.633 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 18.406896696, 2024-09-15T23:14:20.633 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.002300862 2024-09-15T23:14:20.633 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.633 INFO:teuthology.orchestra.run.smithi123.stdout: "cap_revoke_eviction": 0, 2024-09-15T23:14:20.633 INFO:teuthology.orchestra.run.smithi123.stdout: "cap_acquisition_throttle": 0, 2024-09-15T23:14:20.633 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getvxattr_latency": { 2024-09-15T23:14:20.633 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:14:20.633 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:14:20.634 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:14:20.634 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:14:20.634 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.634 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_sessions": { 2024-09-15T23:14:20.634 INFO:teuthology.orchestra.run.smithi123.stdout: "session_count": 1, 2024-09-15T23:14:20.634 INFO:teuthology.orchestra.run.smithi123.stdout: "session_add": 1, 2024-09-15T23:14:20.634 INFO:teuthology.orchestra.run.smithi123.stdout: "session_remove": 0, 2024-09-15T23:14:20.634 INFO:teuthology.orchestra.run.smithi123.stdout: "sessions_open": 1, 2024-09-15T23:14:20.634 INFO:teuthology.orchestra.run.smithi123.stdout: "sessions_stale": 0, 2024-09-15T23:14:20.634 INFO:teuthology.orchestra.run.smithi123.stdout: "total_load": 18539, 2024-09-15T23:14:20.634 INFO:teuthology.orchestra.run.smithi123.stdout: "average_load": 18539, 2024-09-15T23:14:20.635 INFO:teuthology.orchestra.run.smithi123.stdout: "avg_session_uptime": 73, 2024-09-15T23:14:20.635 INFO:teuthology.orchestra.run.smithi123.stdout: "mdthresh_evicted": 0 2024-09-15T23:14:20.635 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.635 INFO:teuthology.orchestra.run.smithi123.stdout: "mempool": { 2024-09-15T23:14:20.635 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_bytes": 0, 2024-09-15T23:14:20.635 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_items": 0, 2024-09-15T23:14:20.635 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T23:14:20.635 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_items": 0, 2024-09-15T23:14:20.635 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T23:14:20.635 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_items": 0, 2024-09-15T23:14:20.635 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T23:14:20.635 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T23:14:20.635 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T23:14:20.636 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T23:14:20.636 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T23:14:20.636 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_items": 0, 2024-09-15T23:14:20.636 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T23:14:20.636 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T23:14:20.636 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_bytes": 0, 2024-09-15T23:14:20.636 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_items": 0, 2024-09-15T23:14:20.636 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_bytes": 0, 2024-09-15T23:14:20.636 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_items": 0, 2024-09-15T23:14:20.636 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T23:14:20.636 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T23:14:20.636 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T23:14:20.637 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T23:14:20.637 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T23:14:20.637 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_items": 0, 2024-09-15T23:14:20.637 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_bytes": 0, 2024-09-15T23:14:20.637 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_items": 0, 2024-09-15T23:14:20.637 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T23:14:20.637 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T23:14:20.637 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_bytes": 0, 2024-09-15T23:14:20.637 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_items": 0, 2024-09-15T23:14:20.637 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_bytes": 0, 2024-09-15T23:14:20.637 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_items": 0, 2024-09-15T23:14:20.637 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T23:14:20.637 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_items": 0, 2024-09-15T23:14:20.637 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T23:14:20.637 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_items": 0, 2024-09-15T23:14:20.638 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_bytes": 250761, 2024-09-15T23:14:20.638 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_items": 96, 2024-09-15T23:14:20.638 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_bytes": 440, 2024-09-15T23:14:20.638 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_items": 5, 2024-09-15T23:14:20.638 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_bytes": 0, 2024-09-15T23:14:20.638 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_items": 0, 2024-09-15T23:14:20.638 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_bytes": 0, 2024-09-15T23:14:20.638 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_items": 0, 2024-09-15T23:14:20.638 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_bytes": 0, 2024-09-15T23:14:20.638 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_items": 0, 2024-09-15T23:14:20.638 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_bytes": 5800, 2024-09-15T23:14:20.638 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_items": 85, 2024-09-15T23:14:20.638 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T23:14:20.639 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_items": 0, 2024-09-15T23:14:20.639 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_bytes": 0, 2024-09-15T23:14:20.639 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_items": 0, 2024-09-15T23:14:20.639 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_bytes": 13479397, 2024-09-15T23:14:20.639 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_items": 661540, 2024-09-15T23:14:20.639 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_bytes": 0, 2024-09-15T23:14:20.639 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_items": 0, 2024-09-15T23:14:20.639 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_bytes": 0, 2024-09-15T23:14:20.639 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_items": 0 2024-09-15T23:14:20.639 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.639 INFO:teuthology.orchestra.run.smithi123.stdout: "objecter": { 2024-09-15T23:14:20.639 INFO:teuthology.orchestra.run.smithi123.stdout: "op_active": 0, 2024-09-15T23:14:20.639 INFO:teuthology.orchestra.run.smithi123.stdout: "op_laggy": 0, 2024-09-15T23:14:20.639 INFO:teuthology.orchestra.run.smithi123.stdout: "op_send": 8681, 2024-09-15T23:14:20.640 INFO:teuthology.orchestra.run.smithi123.stdout: "op_send_bytes": 93033541, 2024-09-15T23:14:20.640 INFO:teuthology.orchestra.run.smithi123.stdout: "op_resend": 37, 2024-09-15T23:14:20.640 INFO:teuthology.orchestra.run.smithi123.stdout: "op_reply": 8681, 2024-09-15T23:14:20.640 INFO:teuthology.orchestra.run.smithi123.stdout: "op_latency": { 2024-09-15T23:14:20.640 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 8681, 2024-09-15T23:14:20.640 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 34.375189020, 2024-09-15T23:14:20.640 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.003959819 2024-09-15T23:14:20.640 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.640 INFO:teuthology.orchestra.run.smithi123.stdout: "op_inflight": 0, 2024-09-15T23:14:20.640 INFO:teuthology.orchestra.run.smithi123.stdout: "oplen_avg": { 2024-09-15T23:14:20.640 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 8681, 2024-09-15T23:14:20.640 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 8776 2024-09-15T23:14:20.640 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.640 INFO:teuthology.orchestra.run.smithi123.stdout: "op": 8681, 2024-09-15T23:14:20.641 INFO:teuthology.orchestra.run.smithi123.stdout: "op_r": 2069, 2024-09-15T23:14:20.641 INFO:teuthology.orchestra.run.smithi123.stdout: "op_w": 6612, 2024-09-15T23:14:20.641 INFO:teuthology.orchestra.run.smithi123.stdout: "op_rmw": 0, 2024-09-15T23:14:20.641 INFO:teuthology.orchestra.run.smithi123.stdout: "op_pg": 0, 2024-09-15T23:14:20.641 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_stat": 0, 2024-09-15T23:14:20.641 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_create": 11, 2024-09-15T23:14:20.641 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_read": 54, 2024-09-15T23:14:20.641 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_write": 2636, 2024-09-15T23:14:20.641 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_writefull": 32, 2024-09-15T23:14:20.641 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_writesame": 0, 2024-09-15T23:14:20.641 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_append": 0, 2024-09-15T23:14:20.641 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_zero": 1836, 2024-09-15T23:14:20.641 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_truncate": 0, 2024-09-15T23:14:20.641 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_delete": 2034, 2024-09-15T23:14:20.642 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_mapext": 0, 2024-09-15T23:14:20.642 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_sparse_read": 0, 2024-09-15T23:14:20.642 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_clonerange": 0, 2024-09-15T23:14:20.642 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_getxattr": 2015, 2024-09-15T23:14:20.642 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_setxattr": 22, 2024-09-15T23:14:20.642 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_cmpxattr": 0, 2024-09-15T23:14:20.642 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_rmxattr": 0, 2024-09-15T23:14:20.642 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_resetxattrs": 0, 2024-09-15T23:14:20.642 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_call": 0, 2024-09-15T23:14:20.642 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_watch": 0, 2024-09-15T23:14:20.642 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_notify": 0, 2024-09-15T23:14:20.642 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T23:14:20.642 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_pgls": 0, 2024-09-15T23:14:20.642 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_pgls_filter": 0, 2024-09-15T23:14:20.643 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_other": 0, 2024-09-15T23:14:20.643 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_active": 0, 2024-09-15T23:14:20.643 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_send": 0, 2024-09-15T23:14:20.643 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_resend": 0, 2024-09-15T23:14:20.643 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_ping": 0, 2024-09-15T23:14:20.643 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_active": 0, 2024-09-15T23:14:20.643 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_send": 0, 2024-09-15T23:14:20.643 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_resend": 0, 2024-09-15T23:14:20.643 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_active": 0, 2024-09-15T23:14:20.643 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_send": 0, 2024-09-15T23:14:20.643 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_resend": 0, 2024-09-15T23:14:20.643 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_active": 0, 2024-09-15T23:14:20.643 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_send": 0, 2024-09-15T23:14:20.643 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_resend": 0, 2024-09-15T23:14:20.644 INFO:teuthology.orchestra.run.smithi123.stdout: "command_active": 0, 2024-09-15T23:14:20.644 INFO:teuthology.orchestra.run.smithi123.stdout: "command_send": 0, 2024-09-15T23:14:20.644 INFO:teuthology.orchestra.run.smithi123.stdout: "command_resend": 0, 2024-09-15T23:14:20.644 INFO:teuthology.orchestra.run.smithi123.stdout: "map_epoch": 40, 2024-09-15T23:14:20.644 INFO:teuthology.orchestra.run.smithi123.stdout: "map_full": 0, 2024-09-15T23:14:20.644 INFO:teuthology.orchestra.run.smithi123.stdout: "map_inc": 8, 2024-09-15T23:14:20.644 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_sessions": 8, 2024-09-15T23:14:20.644 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_session_open": 8, 2024-09-15T23:14:20.644 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_session_close": 0, 2024-09-15T23:14:20.644 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_laggy": 0, 2024-09-15T23:14:20.644 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_wr": 105, 2024-09-15T23:14:20.644 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_rd": 0, 2024-09-15T23:14:20.644 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_del": 31 2024-09-15T23:14:20.644 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.645 INFO:teuthology.orchestra.run.smithi123.stdout: "oft": { 2024-09-15T23:14:20.645 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_objs": 1, 2024-09-15T23:14:20.645 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_kv_pairs": 0, 2024-09-15T23:14:20.645 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_updates": 0, 2024-09-15T23:14:20.645 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_removes": 0 2024-09-15T23:14:20.645 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.645 INFO:teuthology.orchestra.run.smithi123.stdout: "osd-slow-ops": { 2024-09-15T23:14:20.645 INFO:teuthology.orchestra.run.smithi123.stdout: "slow_ops_count": 0 2024-09-15T23:14:20.645 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.645 INFO:teuthology.orchestra.run.smithi123.stdout: "purge_queue": { 2024-09-15T23:14:20.645 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_ops": 0, 2024-09-15T23:14:20.645 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_ops_high_water": 32, 2024-09-15T23:14:20.645 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing": 0, 2024-09-15T23:14:20.646 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_high_water": 32, 2024-09-15T23:14:20.646 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executed_ops": 3836, 2024-09-15T23:14:20.646 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executed": 3836, 2024-09-15T23:14:20.646 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_item_in_journal": 0 2024-09-15T23:14:20.646 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.646 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T23:14:20.646 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-15T23:14:20.646 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-09-15T23:14:20.646 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-15T23:14:20.646 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 35636, 2024-09-15T23:14:20.646 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 8840379, 2024-09-15T23:14:20.646 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-15T23:14:20.646 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 35636, 2024-09-15T23:14:20.646 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-15T23:14:20.647 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-15T23:14:20.647 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 35636, 2024-09-15T23:14:20.647 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 8840379, 2024-09-15T23:14:20.647 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-15T23:14:20.647 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:14:20.647 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:14:20.647 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:14:20.647 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:14:20.647 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.647 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-objecter_bytes": { 2024-09-15T23:14:20.647 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-15T23:14:20.647 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-09-15T23:14:20.647 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-15T23:14:20.647 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-15T23:14:20.647 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-15T23:14:20.648 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-15T23:14:20.648 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-15T23:14:20.648 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 8681, 2024-09-15T23:14:20.648 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 93435665, 2024-09-15T23:14:20.648 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 8681, 2024-09-15T23:14:20.648 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 93435665, 2024-09-15T23:14:20.648 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-15T23:14:20.648 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:14:20.648 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:14:20.648 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:14:20.648 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:14:20.648 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.648 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-objecter_ops": { 2024-09-15T23:14:20.649 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-15T23:14:20.649 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 1024, 2024-09-15T23:14:20.649 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-15T23:14:20.649 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-15T23:14:20.649 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-15T23:14:20.649 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-15T23:14:20.649 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-15T23:14:20.649 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 8681, 2024-09-15T23:14:20.649 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 8681, 2024-09-15T23:14:20.649 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 8681, 2024-09-15T23:14:20.649 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 8681, 2024-09-15T23:14:20.649 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-15T23:14:20.649 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:14:20.649 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:14:20.650 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:14:20.650 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:14:20.650 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.650 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-write_buf_throttle": { 2024-09-15T23:14:20.650 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-15T23:14:20.650 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 3758096384, 2024-09-15T23:14:20.650 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-15T23:14:20.650 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 3836, 2024-09-15T23:14:20.650 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 402124, 2024-09-15T23:14:20.650 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-15T23:14:20.650 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 3836, 2024-09-15T23:14:20.650 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-15T23:14:20.650 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-15T23:14:20.650 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 52, 2024-09-15T23:14:20.651 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 402124, 2024-09-15T23:14:20.651 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-15T23:14:20.651 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:14:20.651 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:14:20.651 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:14:20.651 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:14:20.651 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:20.651 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-write_buf_throttle-0x5578bd7ce500": { 2024-09-15T23:14:20.651 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-15T23:14:20.651 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 3758096384, 2024-09-15T23:14:20.651 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-15T23:14:20.651 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 27197, 2024-09-15T23:14:20.651 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 92344350, 2024-09-15T23:14:20.651 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-15T23:14:20.652 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 27197, 2024-09-15T23:14:20.652 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-15T23:14:20.652 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-15T23:14:20.652 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 2584, 2024-09-15T23:14:20.652 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 92344350, 2024-09-15T23:14:20.652 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-15T23:14:20.652 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:14:20.652 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:14:20.652 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:14:20.652 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:14:20.652 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:14:20.652 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:14:20.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.599+0000 7fca97b9f640 1 -- 172.21.15.123:0/2660916331 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fca7406c2b0 msgr2=0x7fca7406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:20.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.599+0000 7fca97b9f640 1 --2- 172.21.15.123:0/2660916331 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fca7406c2b0 0x7fca7406e770 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fca84034000 tx=0x7fca8402e000 comp rx=0 tx=0).stop 2024-09-15T23:14:20.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.599+0000 7fca97b9f640 1 -- 172.21.15.123:0/2660916331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca900afb90 msgr2=0x7fca900b20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:20.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.599+0000 7fca97b9f640 1 --2- 172.21.15.123:0/2660916331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca900afb90 0x7fca900b20b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fca8c00c430 tx=0x7fca8c00c8f0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.599+0000 7fca97b9f640 1 -- 172.21.15.123:0/2660916331 shutdown_connections 2024-09-15T23:14:20.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.599+0000 7fca97b9f640 1 --2- 172.21.15.123:0/2660916331 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca90158c80 0x7fca9012c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.599+0000 7fca97b9f640 1 --2- 172.21.15.123:0/2660916331 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fca7406c2b0 0x7fca7406e770 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.599+0000 7fca97b9f640 1 --2- 172.21.15.123:0/2660916331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca900afb90 0x7fca900b20b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.599+0000 7fca97b9f640 1 --2- 172.21.15.123:0/2660916331 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fca9006c320 0x7fca90161b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.599+0000 7fca97b9f640 1 -- 172.21.15.123:0/2660916331 >> 172.21.15.123:0/2660916331 conn(0x7fca9006cd20 msgr2=0x7fca9006f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:20.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.599+0000 7fca97b9f640 1 -- 172.21.15.123:0/2660916331 shutdown_connections 2024-09-15T23:14:20.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.599+0000 7fca97b9f640 1 -- 172.21.15.123:0/2660916331 wait complete. 2024-09-15T23:14:20.655 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:14:20.655 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:14:20.701 DEBUG:teuthology.orchestra.run.smithi188:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:14:20.743 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:14:20.743 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:14:20.743 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:14:20.743 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:14:20.759 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:14:20.759 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:14:20.814 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:14:20.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.953+0000 7f3bde98d640 1 Processor -- start 2024-09-15T23:14:20.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.953+0000 7f3bde98d640 1 -- start start 2024-09-15T23:14:20.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.954+0000 7f3bde98d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3bd80b2d40 0x7f3bd806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.954+0000 7f3bde98d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f3bd813eb20 0x7f3bd806c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.954+0000 7f3bde98d640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bd8071180 con 0x7f3bd815bcf0 2024-09-15T23:14:20.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.954+0000 7f3bde98d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f3bd8071ab0 con 0x7f3bd813eb20 2024-09-15T23:14:20.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.954+0000 7f3bde98d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f3bd8071460 con 0x7f3bd80b2d40 2024-09-15T23:14:20.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.954+0000 7f3bd77fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f3bd813eb20 0x7f3bd806c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.954+0000 7f3bdcf2a640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f3bd815bcf0 0x7f3bd815c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:40308/0 (socket says 172.21.15.123:40308) 2024-09-15T23:14:20.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.954+0000 7f3bd77fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f3bd813eb20 0x7f3bd806c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:49548/0 (socket says 172.21.15.123:49548) 2024-09-15T23:14:20.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.954+0000 7f3bdcf2a640 1 -- 172.21.15.123:0/3698994145 learned_addr learned my addr 172.21.15.123:0/3698994145 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:20.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.955+0000 7f3bd7fff640 1 --2- 172.21.15.123:0/3698994145 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3bd80b2d40 0x7f3bd806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.955+0000 7f3bd77fe640 1 -- 172.21.15.123:0/3698994145 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3bd80b2d40 msgr2=0x7f3bd806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:20.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.955+0000 7f3bd77fe640 1 --2- 172.21.15.123:0/3698994145 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3bd80b2d40 0x7f3bd806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.955+0000 7f3bd77fe640 1 -- 172.21.15.123:0/3698994145 >> v1:172.21.15.188:6789/0 conn(0x7f3bd815bcf0 legacy=0x7f3bd815c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:20.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.955+0000 7f3bd77fe640 1 -- 172.21.15.123:0/3698994145 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd8071740 con 0x7f3bd813eb20 2024-09-15T23:14:20.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.955+0000 7f3bd7fff640 1 --2- 172.21.15.123:0/3698994145 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3bd80b2d40 0x7f3bd806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:20.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.956+0000 7f3bd77fe640 1 --2- 172.21.15.123:0/3698994145 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3bd813eb20 0x7f3bd806c150 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3bd8071c30 tx=0x7f3bcc02c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8dde6769d1377fb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:20.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.956+0000 7f3bd6ffd640 1 -- 172.21.15.123:0/3698994145 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc034620 con 0x7f3bd813eb20 2024-09-15T23:14:20.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.956+0000 7f3bd6ffd640 1 -- 172.21.15.123:0/3698994145 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bcc0347c0 con 0x7f3bd813eb20 2024-09-15T23:14:20.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.956+0000 7f3bd6ffd640 1 -- 172.21.15.123:0/3698994145 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc034b90 con 0x7f3bd813eb20 2024-09-15T23:14:20.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.956+0000 7f3bde98d640 1 -- 172.21.15.123:0/3698994145 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3bd813eb20 msgr2=0x7f3bd806c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:20.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.956+0000 7f3bde98d640 1 --2- 172.21.15.123:0/3698994145 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3bd813eb20 0x7f3bd806c150 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3bd8071c30 tx=0x7f3bcc02c830 comp rx=0 tx=0).stop 2024-09-15T23:14:20.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.956+0000 7f3bde98d640 1 -- 172.21.15.123:0/3698994145 shutdown_connections 2024-09-15T23:14:20.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.956+0000 7f3bde98d640 1 --2- 172.21.15.123:0/3698994145 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3bd813eb20 0x7f3bd806c150 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.956+0000 7f3bde98d640 1 --2- 172.21.15.123:0/3698994145 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3bd80b2d40 0x7f3bd806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.956+0000 7f3bde98d640 1 -- 172.21.15.123:0/3698994145 >> 172.21.15.123:0/3698994145 conn(0x7f3bd80ccec0 msgr2=0x7f3bd80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:20.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.956+0000 7f3bde98d640 1 -- 172.21.15.123:0/3698994145 shutdown_connections 2024-09-15T23:14:20.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.956+0000 7f3bde98d640 1 -- 172.21.15.123:0/3698994145 wait complete. 2024-09-15T23:14:20.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.957+0000 7f3bde98d640 1 Processor -- start 2024-09-15T23:14:20.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.958+0000 7f3bde98d640 1 -- start start 2024-09-15T23:14:20.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.958+0000 7f3bde98d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bd80b2d40 0x7f3bd813df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.958+0000 7f3bde98d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3bd813eb20 0x7f3bd813d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.958+0000 7f3bde98d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3bd815bcf0 0x7f3bd815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.958+0000 7f3bde98d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd80722d0 con 0x7f3bd80b2d40 2024-09-15T23:14:20.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.958+0000 7f3bde98d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd8072150 con 0x7f3bd815bcf0 2024-09-15T23:14:20.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.958+0000 7f3bde98d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f3bd8072450 con 0x7f3bd813eb20 2024-09-15T23:14:20.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.958+0000 7f3bd7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bd80b2d40 0x7f3bd813df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.959+0000 7f3bd7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bd80b2d40 0x7f3bd813df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55010/0 (socket says 172.21.15.123:55010) 2024-09-15T23:14:20.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.959+0000 7f3bd7fff640 1 -- 172.21.15.123:0/3094586645 learned_addr learned my addr 172.21.15.123:0/3094586645 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:20.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.959+0000 7f3bdcf2a640 1 --2- 172.21.15.123:0/3094586645 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3bd815bcf0 0x7f3bd815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.959+0000 7f3bd7fff640 1 -- 172.21.15.123:0/3094586645 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3bd813eb20 msgr2=0x7f3bd813d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:20.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.959+0000 7f3bd7fff640 1 --2- 172.21.15.123:0/3094586645 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3bd813eb20 0x7f3bd813d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.959+0000 7f3bd7fff640 1 -- 172.21.15.123:0/3094586645 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3bd815bcf0 msgr2=0x7f3bd815ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:20.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.959+0000 7f3bd7fff640 1 --2- 172.21.15.123:0/3094586645 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3bd815bcf0 0x7f3bd815ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:20.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.959+0000 7f3bd7fff640 1 -- 172.21.15.123:0/3094586645 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd813d7f0 con 0x7f3bd80b2d40 2024-09-15T23:14:20.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.959+0000 7f3bdcf2a640 1 --2- 172.21.15.123:0/3094586645 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3bd815bcf0 0x7f3bd815ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:20.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.959+0000 7f3bd7fff640 1 --2- 172.21.15.123:0/3094586645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bd80b2d40 0x7f3bd813df50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3bc800e7e0 tx=0x7f3bc800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:20.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.959+0000 7f3bd4ff9640 1 -- 172.21.15.123:0/3094586645 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc800f040 con 0x7f3bd80b2d40 2024-09-15T23:14:20.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.959+0000 7f3bd4ff9640 1 -- 172.21.15.123:0/3094586645 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bc8004030 con 0x7f3bd80b2d40 2024-09-15T23:14:20.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.959+0000 7f3bde98d640 1 -- 172.21.15.123:0/3094586645 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd8155d50 con 0x7f3bd80b2d40 2024-09-15T23:14:20.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.959+0000 7f3bd4ff9640 1 -- 172.21.15.123:0/3094586645 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc8004400 con 0x7f3bd80b2d40 2024-09-15T23:14:20.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.959+0000 7f3bde98d640 1 -- 172.21.15.123:0/3094586645 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd8156790 con 0x7f3bd80b2d40 2024-09-15T23:14:20.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.960+0000 7f3bde98d640 1 -- 172.21.15.123:0/3094586645 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bd8072890 con 0x7f3bd80b2d40 2024-09-15T23:14:20.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.961+0000 7f3bd4ff9640 1 -- 172.21.15.123:0/3094586645 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3bc800c6d0 con 0x7f3bd80b2d40 2024-09-15T23:14:20.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.961+0000 7f3bd4ff9640 1 --2- 172.21.15.123:0/3094586645 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3bc406c2b0 0x7f3bc406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:20.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.961+0000 7f3bd4ff9640 1 -- 172.21.15.123:0/3094586645 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5853+0+0 (secure 0 0 0) 0x7f3bc808b270 con 0x7f3bd80b2d40 2024-09-15T23:14:20.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.961+0000 7f3bd77fe640 1 --2- 172.21.15.123:0/3094586645 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3bc406c2b0 0x7f3bc406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:20.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.962+0000 7f3bd77fe640 1 --2- 172.21.15.123:0/3094586645 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3bc406c2b0 0x7f3bc406e770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc037000 tx=0x7f3bcc031000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:20.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:20.966+0000 7f3bd4ff9640 1 -- 172.21.15.123:0/3094586645 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3bc8017020 con 0x7f3bd80b2d40 2024-09-15T23:14:21.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.144+0000 7f3bde98d640 1 -- 172.21.15.123:0/3094586645 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3bd80b28b0 con 0x7f3bd80b2d40 2024-09-15T23:14:21.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.144+0000 7f3bd4ff9640 1 -- 172.21.15.123:0/3094586645 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v40) ==== 80+0+0 (secure 0 0 0) 0x7f3bc8059950 con 0x7f3bd80b2d40 2024-09-15T23:14:21.146 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-15T23:14:21.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.146+0000 7f3bde98d640 1 -- 172.21.15.123:0/3094586645 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3bc406c2b0 msgr2=0x7f3bc406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:21.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.146+0000 7f3bde98d640 1 --2- 172.21.15.123:0/3094586645 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3bc406c2b0 0x7f3bc406e770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc037000 tx=0x7f3bcc031000 comp rx=0 tx=0).stop 2024-09-15T23:14:21.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.146+0000 7f3bde98d640 1 -- 172.21.15.123:0/3094586645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bd80b2d40 msgr2=0x7f3bd813df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:21.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.146+0000 7f3bde98d640 1 --2- 172.21.15.123:0/3094586645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bd80b2d40 0x7f3bd813df50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3bc800e7e0 tx=0x7f3bc800eca0 comp rx=0 tx=0).stop 2024-09-15T23:14:21.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.146+0000 7f3bde98d640 1 -- 172.21.15.123:0/3094586645 shutdown_connections 2024-09-15T23:14:21.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.146+0000 7f3bde98d640 1 --2- 172.21.15.123:0/3094586645 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3bd815bcf0 0x7f3bd815ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:21.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.146+0000 7f3bde98d640 1 --2- 172.21.15.123:0/3094586645 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3bd813eb20 0x7f3bd813d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:21.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.146+0000 7f3bde98d640 1 --2- 172.21.15.123:0/3094586645 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3bc406c2b0 0x7f3bc406e770 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:21.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.146+0000 7f3bde98d640 1 --2- 172.21.15.123:0/3094586645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bd80b2d40 0x7f3bd813df50 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:21.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.146+0000 7f3bde98d640 1 -- 172.21.15.123:0/3094586645 >> 172.21.15.123:0/3094586645 conn(0x7f3bd80ccec0 msgr2=0x7f3bd8140300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:21.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.146+0000 7f3bde98d640 1 -- 172.21.15.123:0/3094586645 shutdown_connections 2024-09-15T23:14:21.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.146+0000 7f3bde98d640 1 -- 172.21.15.123:0/3094586645 wait complete. 2024-09-15T23:14:21.158 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-15T23:14:21.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:14:21.159 DEBUG:teuthology.orchestra.run.smithi123:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-15T23:14:21.206 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-09-15T23:14:21.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:14:21.206 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T23:14:21.233 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:14:21.234 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:14:21.234 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:14:21.252 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:14:21.252 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:14:21.252 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:14:21.252 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:14:21.293 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:14:21.293 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:14:21.293 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:14:21.293 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:14:21.310 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:14:21.310 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:14:21.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.432+0000 7f9366ed0640 1 Processor -- start 2024-09-15T23:14:21.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.432+0000 7f9366ed0640 1 -- start start 2024-09-15T23:14:21.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.433+0000 7f9366ed0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f936015e790 0x7f9360073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:21.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.433+0000 7f9366ed0640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f936006f730 0x7f936006fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:21.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.433+0000 7f9366ed0640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93601631c0 con 0x7f9360162c60 2024-09-15T23:14:21.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.433+0000 7f9366ed0640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f936015eb70 con 0x7f936006f730 2024-09-15T23:14:21.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.433+0000 7f9366ed0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f93600ae9a0 con 0x7f936015e790 2024-09-15T23:14:21.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.433+0000 7f936546d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f936006f730 0x7f936006fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:21.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.433+0000 7f936546d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f936006f730 0x7f936006fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55018/0 (socket says 172.21.15.123:55018) 2024-09-15T23:14:21.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.433+0000 7f936546d640 1 -- 172.21.15.123:0/2381524241 learned_addr learned my addr 172.21.15.123:0/2381524241 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:21.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.434+0000 7f936546d640 1 -- 172.21.15.123:0/2381524241 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f936015e790 msgr2=0x7f9360073a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:21.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.434+0000 7f936546d640 1 --2- 172.21.15.123:0/2381524241 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f936015e790 0x7f9360073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:21.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.434+0000 7f936546d640 1 -- 172.21.15.123:0/2381524241 >> v1:172.21.15.188:6789/0 conn(0x7f9360162c60 legacy=0x7f93600b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:21.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.434+0000 7f936546d640 1 -- 172.21.15.123:0/2381524241 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93600aec40 con 0x7f936006f730 2024-09-15T23:14:21.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.434+0000 7f936546d640 1 --2- 172.21.15.123:0/2381524241 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f936006f730 0x7f936006fbc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9358009e50 tx=0x7f935802a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9286a96a43a0da21 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:21.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.434+0000 7f93577fe640 1 -- 172.21.15.123:0/2381524241 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9358036070 con 0x7f936006f730 2024-09-15T23:14:21.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.434+0000 7f93577fe640 1 -- 172.21.15.123:0/2381524241 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9358031600 con 0x7f936006f730 2024-09-15T23:14:21.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.434+0000 7f93577fe640 1 -- 172.21.15.123:0/2381524241 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93580319d0 con 0x7f936006f730 2024-09-15T23:14:21.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.435+0000 7f9366ed0640 1 -- 172.21.15.123:0/2381524241 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f936006f730 msgr2=0x7f936006fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:21.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.435+0000 7f9366ed0640 1 --2- 172.21.15.123:0/2381524241 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f936006f730 0x7f936006fbc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9358009e50 tx=0x7f935802a630 comp rx=0 tx=0).stop 2024-09-15T23:14:21.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.435+0000 7f9366ed0640 1 -- 172.21.15.123:0/2381524241 shutdown_connections 2024-09-15T23:14:21.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.435+0000 7f9366ed0640 1 --2- 172.21.15.123:0/2381524241 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f936006f730 0x7f936006fbc0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:21.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.435+0000 7f9366ed0640 1 --2- 172.21.15.123:0/2381524241 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f936015e790 0x7f9360073a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:21.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.435+0000 7f9366ed0640 1 -- 172.21.15.123:0/2381524241 >> 172.21.15.123:0/2381524241 conn(0x7f93600b0a80 msgr2=0x7f93600b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:21.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.435+0000 7f9366ed0640 1 -- 172.21.15.123:0/2381524241 shutdown_connections 2024-09-15T23:14:21.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.435+0000 7f9366ed0640 1 -- 172.21.15.123:0/2381524241 wait complete. 2024-09-15T23:14:21.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.436+0000 7f9366ed0640 1 Processor -- start 2024-09-15T23:14:21.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.436+0000 7f9366ed0640 1 -- start start 2024-09-15T23:14:21.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.437+0000 7f9366ed0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f936006f730 0x7f93601512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:21.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.437+0000 7f9366ed0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f936015e790 0x7f93601e80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:21.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.437+0000 7f9366ed0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9360162c60 0x7f9360153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:21.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.437+0000 7f9366ed0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f93600b5b40 con 0x7f936015e790 2024-09-15T23:14:21.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.437+0000 7f9366ed0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f93600af200 con 0x7f936006f730 2024-09-15T23:14:21.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.437+0000 7f9366ed0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f936006f430 con 0x7f9360162c60 2024-09-15T23:14:21.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.437+0000 7f9357fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f936015e790 0x7f93601e80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:21.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.437+0000 7f9357fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f936015e790 0x7f93601e80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55030/0 (socket says 172.21.15.123:55030) 2024-09-15T23:14:21.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.437+0000 7f9357fff640 1 -- 172.21.15.123:0/4133640419 learned_addr learned my addr 172.21.15.123:0/4133640419 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:21.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.437+0000 7f9357fff640 1 -- 172.21.15.123:0/4133640419 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9360162c60 msgr2=0x7f9360153040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:21.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.437+0000 7f9357fff640 1 --2- 172.21.15.123:0/4133640419 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9360162c60 0x7f9360153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:21.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.437+0000 7f9357fff640 1 -- 172.21.15.123:0/4133640419 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f936006f730 msgr2=0x7f93601512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:21.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.437+0000 7f9364c6c640 1 --2- 172.21.15.123:0/4133640419 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f936006f730 0x7f93601512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:21.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.438+0000 7f9357fff640 1 --2- 172.21.15.123:0/4133640419 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f936006f730 0x7f93601512f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:21.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.438+0000 7f9357fff640 1 -- 172.21.15.123:0/4133640419 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f936014f650 con 0x7f936015e790 2024-09-15T23:14:21.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.438+0000 7f9364c6c640 1 --2- 172.21.15.123:0/4133640419 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f936006f730 0x7f93601512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:21.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.438+0000 7f9357fff640 1 --2- 172.21.15.123:0/4133640419 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f936015e790 0x7f93601e80c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f935000b3c0 tx=0x7f935000b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:21.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.438+0000 7f93557fa640 1 -- 172.21.15.123:0/4133640419 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9350011830 con 0x7f936015e790 2024-09-15T23:14:21.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.438+0000 7f93557fa640 1 -- 172.21.15.123:0/4133640419 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9350016070 con 0x7f936015e790 2024-09-15T23:14:21.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.438+0000 7f9366ed0640 1 -- 172.21.15.123:0/4133640419 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f936014f930 con 0x7f936015e790 2024-09-15T23:14:21.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.438+0000 7f93557fa640 1 -- 172.21.15.123:0/4133640419 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9350011c50 con 0x7f936015e790 2024-09-15T23:14:21.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.438+0000 7f9366ed0640 1 -- 172.21.15.123:0/4133640419 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9360150410 con 0x7f936015e790 2024-09-15T23:14:21.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.439+0000 7f9366ed0640 1 -- 172.21.15.123:0/4133640419 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9360073a40 con 0x7f936015e790 2024-09-15T23:14:21.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.439+0000 7f93557fa640 1 -- 172.21.15.123:0/4133640419 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f935001b460 con 0x7f936015e790 2024-09-15T23:14:21.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.440+0000 7f93557fa640 1 --2- 172.21.15.123:0/4133640419 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f934c06c2b0 0x7f934c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:21.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.440+0000 7f93557fa640 1 -- 172.21.15.123:0/4133640419 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5853+0+0 (secure 0 0 0) 0x7f935008af60 con 0x7f936015e790 2024-09-15T23:14:21.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.440+0000 7f9364c6c640 1 --2- 172.21.15.123:0/4133640419 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f934c06c2b0 0x7f934c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:21.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.440+0000 7f9364c6c640 1 --2- 172.21.15.123:0/4133640419 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f934c06c2b0 0x7f934c06e770 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f935c006fd0 tx=0x7f935c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:21.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.444+0000 7f93557fa640 1 -- 172.21.15.123:0/4133640419 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9350020020 con 0x7f936015e790 2024-09-15T23:14:21.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.645+0000 7f9366ed0640 1 -- 172.21.15.123:0/4133640419 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f93600b11e0 con 0x7f936015e790 2024-09-15T23:14:21.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.646+0000 7f93557fa640 1 -- 172.21.15.123:0/4133640419 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5231 (secure 0 0 0) 0x7f93500596d0 con 0x7f936015e790 2024-09-15T23:14:21.647 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:14:21.647 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":14,"btime":"2024-09-15T23:13:03:573893+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/324550176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":324550176},{"type":"v1","addr":"172.21.15.188:6837","nonce":324550176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4696,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2893461525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2893461525},{"type":"v1","addr":"172.21.15.188:6836","nonce":2893461525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4773,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/4033133132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":4033133132},{"type":"v1","addr":"172.21.15.123:6833","nonce":4033133132}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-15T23:12:51.772541+0000","modified":"2024-09-15T23:13:02.714790+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4776},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4776":{"gid":4776,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/1577644605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1577644605},{"type":"v1","addr":"172.21.15.123:6835","nonce":1577644605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4776,"qdb_cluster":[4776]},"id":2}]} 2024-09-15T23:14:21.647 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 14 2024-09-15T23:14:21.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.648+0000 7f9366ed0640 1 -- 172.21.15.123:0/4133640419 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f934c06c2b0 msgr2=0x7f934c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:21.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.648+0000 7f9366ed0640 1 --2- 172.21.15.123:0/4133640419 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f934c06c2b0 0x7f934c06e770 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f935c006fd0 tx=0x7f935c008040 comp rx=0 tx=0).stop 2024-09-15T23:14:21.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.648+0000 7f9366ed0640 1 -- 172.21.15.123:0/4133640419 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f936015e790 msgr2=0x7f93601e80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:21.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.648+0000 7f9366ed0640 1 --2- 172.21.15.123:0/4133640419 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f936015e790 0x7f93601e80c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f935000b3c0 tx=0x7f935000b880 comp rx=0 tx=0).stop 2024-09-15T23:14:21.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.648+0000 7f9366ed0640 1 -- 172.21.15.123:0/4133640419 shutdown_connections 2024-09-15T23:14:21.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.648+0000 7f9366ed0640 1 --2- 172.21.15.123:0/4133640419 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9360162c60 0x7f9360153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:21.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.648+0000 7f9366ed0640 1 --2- 172.21.15.123:0/4133640419 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f934c06c2b0 0x7f934c06e770 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:21.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.648+0000 7f9366ed0640 1 --2- 172.21.15.123:0/4133640419 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f936015e790 0x7f93601e80c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:21.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.648+0000 7f9366ed0640 1 --2- 172.21.15.123:0/4133640419 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f936006f730 0x7f93601512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:21.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.648+0000 7f9366ed0640 1 -- 172.21.15.123:0/4133640419 >> 172.21.15.123:0/4133640419 conn(0x7f93600b0a80 msgr2=0x7f93600af720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:21.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.648+0000 7f9366ed0640 1 -- 172.21.15.123:0/4133640419 shutdown_connections 2024-09-15T23:14:21.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.648+0000 7f9366ed0640 1 -- 172.21.15.123:0/4133640419 wait complete. 2024-09-15T23:14:21.659 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:14:21.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.756+0000 7fc6b1b1a640 1 Processor -- start 2024-09-15T23:14:21.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.756+0000 7fc6b1b1a640 1 -- start start 2024-09-15T23:14:21.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.756+0000 7fc6b1b1a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6ac15ab40 0x7fc6ac06c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:21.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.757+0000 7fc6b1b1a640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc6ac15af20 0x7fc6ac15b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:21.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.757+0000 7fc6b1b1a640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6ac0724f0 con 0x7fc6ac0720b0 2024-09-15T23:14:21.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.757+0000 7fc6b1b1a640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fc6ac071010 con 0x7fc6ac15af20 2024-09-15T23:14:21.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.757+0000 7fc6b1b1a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc6ac0712f0 con 0x7fc6ac15ab40 2024-09-15T23:14:21.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.757+0000 7fc6aaffd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc6ac0720b0 0x7fc6ac073990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38138/0 (socket says 172.21.15.123:38138) 2024-09-15T23:14:21.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.757+0000 7fc6aaffd640 1 -- 172.21.15.123:0/2281288063 learned_addr learned my addr 172.21.15.123:0/2281288063 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:21.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.757+0000 7fc6abfff640 1 --2- 172.21.15.123:0/2281288063 >> v2:172.21.15.188:3300/0 conn(0x7fc6ac15af20 0x7fc6ac15b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:21.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.757+0000 7fc6ab7fe640 1 --2- 172.21.15.123:0/2281288063 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6ac15ab40 0x7fc6ac06c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:21.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.757+0000 7fc6aa7fc640 1 -- 172.21.15.123:0/2281288063 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2653119103 0 0) 0x7fc6ac0724f0 con 0x7fc6ac0720b0 2024-09-15T23:14:21.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.757+0000 7fc6aa7fc640 1 -- 172.21.15.123:0/2281288063 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc694004630 con 0x7fc6ac0720b0 2024-09-15T23:14:21.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.757+0000 7fc6aa7fc640 1 -- 172.21.15.123:0/2281288063 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1508551911 0 0) 0x7fc694004630 con 0x7fc6ac0720b0 2024-09-15T23:14:21.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.757+0000 7fc6aa7fc640 1 -- 172.21.15.123:0/2281288063 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6ac15ab40 msgr2=0x7fc6ac06c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:21.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.757+0000 7fc6aa7fc640 1 --2- 172.21.15.123:0/2281288063 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6ac15ab40 0x7fc6ac06c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:21.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.757+0000 7fc6aa7fc640 1 -- 172.21.15.123:0/2281288063 >> v2:172.21.15.188:3300/0 conn(0x7fc6ac15af20 msgr2=0x7fc6ac15b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:21.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.757+0000 7fc6aa7fc640 1 --2- 172.21.15.123:0/2281288063 >> v2:172.21.15.188:3300/0 conn(0x7fc6ac15af20 0x7fc6ac15b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:21.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.757+0000 7fc6aa7fc640 1 -- 172.21.15.123:0/2281288063 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6ac0715d0 con 0x7fc6ac0720b0 2024-09-15T23:14:21.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.757+0000 7fc6aa7fc640 1 -- 172.21.15.123:0/2281288063 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fc6a00019f0 con 0x7fc6ac0720b0 2024-09-15T23:14:21.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.757+0000 7fc6aa7fc640 1 -- 172.21.15.123:0/2281288063 >> v1:172.21.15.123:6789/0 conn(0x7fc6ac0720b0 legacy=0x7fc6ac073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:21.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.757+0000 7fc6aa7fc640 1 --2- 172.21.15.123:0/2281288063 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc694004ac0 0x7fc694004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:21.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.757+0000 7fc6aa7fc640 1 --2- 172.21.15.123:0/2281288063 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6ac15ab40 0x7fc694005910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:21.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.757+0000 7fc6aa7fc640 1 --2- 172.21.15.123:0/2281288063 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc694005e50 0x7fc6940062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:21.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.757+0000 7fc6aa7fc640 1 -- 172.21.15.123:0/2281288063 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ac071010 con 0x7fc694005e50 2024-09-15T23:14:21.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.757+0000 7fc6aa7fc640 1 -- 172.21.15.123:0/2281288063 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ac0712f0 con 0x7fc694004ac0 2024-09-15T23:14:21.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.757+0000 7fc6aa7fc640 1 -- 172.21.15.123:0/2281288063 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc69400cad0 con 0x7fc6ac15ab40 2024-09-15T23:14:21.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.757+0000 7fc6abfff640 1 --2- 172.21.15.123:0/2281288063 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc694005e50 0x7fc6940062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:21.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.758+0000 7fc6ab7fe640 1 --2- 172.21.15.123:0/2281288063 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc694004ac0 0x7fc694004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:21.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.758+0000 7fc6aaffd640 1 --2- 172.21.15.123:0/2281288063 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6ac15ab40 0x7fc694005910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:21.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.758+0000 7fc6abfff640 1 -- 172.21.15.123:0/2281288063 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6ac15ab40 msgr2=0x7fc694005910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:21.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.758+0000 7fc6abfff640 1 --2- 172.21.15.123:0/2281288063 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6ac15ab40 0x7fc694005910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:21.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.758+0000 7fc6abfff640 1 -- 172.21.15.123:0/2281288063 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc694004ac0 msgr2=0x7fc694004ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:21.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.758+0000 7fc6abfff640 1 --2- 172.21.15.123:0/2281288063 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc694004ac0 0x7fc694004ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:21.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.758+0000 7fc6abfff640 1 -- 172.21.15.123:0/2281288063 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc694004630 con 0x7fc694005e50 2024-09-15T23:14:21.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.758+0000 7fc6ab7fe640 1 --2- 172.21.15.123:0/2281288063 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc694004ac0 0x7fc694004ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:21.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.758+0000 7fc6aaffd640 1 --2- 172.21.15.123:0/2281288063 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6ac15ab40 0x7fc694005910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:21.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.758+0000 7fc6abfff640 1 --2- 172.21.15.123:0/2281288063 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc694005e50 0x7fc6940062d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4009ac0 tx=0x7fc694006940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bffd1c5304abbcc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:21.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.758+0000 7fc6aa7fc640 1 -- 172.21.15.123:0/2281288063 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4036070 con 0x7fc694005e50 2024-09-15T23:14:21.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.758+0000 7fc6aa7fc640 1 -- 172.21.15.123:0/2281288063 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6a4031400 con 0x7fc694005e50 2024-09-15T23:14:21.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.758+0000 7fc6aa7fc640 1 -- 172.21.15.123:0/2281288063 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a4009690 con 0x7fc694005e50 2024-09-15T23:14:21.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.759+0000 7fc6b1b1a640 1 -- 172.21.15.123:0/2281288063 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc694005e50 msgr2=0x7fc6940062d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:21.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.759+0000 7fc6b1b1a640 1 --2- 172.21.15.123:0/2281288063 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc694005e50 0x7fc6940062d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4009ac0 tx=0x7fc694006940 comp rx=0 tx=0).stop 2024-09-15T23:14:21.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.759+0000 7fc6abfff640 1 -- 172.21.15.123:0/2281288063 reap_dead start 2024-09-15T23:14:21.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.759+0000 7fc6b1b1a640 1 -- 172.21.15.123:0/2281288063 shutdown_connections 2024-09-15T23:14:21.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.759+0000 7fc6b1b1a640 1 -- 172.21.15.123:0/2281288063 >> 172.21.15.123:0/2281288063 conn(0x7fc6ac0ccec0 msgr2=0x7fc6ac0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:21.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.759+0000 7fc6b1b1a640 1 -- 172.21.15.123:0/2281288063 shutdown_connections 2024-09-15T23:14:21.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.759+0000 7fc6b1b1a640 1 -- 172.21.15.123:0/2281288063 wait complete. 2024-09-15T23:14:21.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.760+0000 7fc6b1b1a640 1 Processor -- start 2024-09-15T23:14:21.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.760+0000 7fc6b1b1a640 1 -- start start 2024-09-15T23:14:21.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.761+0000 7fc6b1b1a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6ac144de0 0x7fc6ac155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:21.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.761+0000 7fc6b1b1a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6ac0cb280 0x7fc6ac0cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:21.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.761+0000 7fc6b1b1a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6ac0c8700 0x7fc6ac0c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:21.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.761+0000 7fc6b1b1a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ac15ba30 con 0x7fc6ac0cb280 2024-09-15T23:14:21.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.761+0000 7fc6b1b1a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ac15b8b0 con 0x7fc6ac144de0 2024-09-15T23:14:21.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.761+0000 7fc6b1b1a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc6ac06c6a0 con 0x7fc6ac0c8700 2024-09-15T23:14:21.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.761+0000 7fc6aaffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6ac0cb280 0x7fc6ac0cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:21.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.761+0000 7fc6aaffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6ac0cb280 0x7fc6ac0cb6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55054/0 (socket says 172.21.15.123:55054) 2024-09-15T23:14:21.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.761+0000 7fc6aaffd640 1 -- 172.21.15.123:0/1303796018 learned_addr learned my addr 172.21.15.123:0/1303796018 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:21.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.761+0000 7fc6ab7fe640 1 --2- 172.21.15.123:0/1303796018 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6ac144de0 0x7fc6ac155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:21.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.761+0000 7fc6abfff640 1 --2- 172.21.15.123:0/1303796018 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6ac0c8700 0x7fc6ac0c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:21.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.761+0000 7fc6aaffd640 1 -- 172.21.15.123:0/1303796018 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6ac0c8700 msgr2=0x7fc6ac0c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:21.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.761+0000 7fc6aaffd640 1 --2- 172.21.15.123:0/1303796018 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6ac0c8700 0x7fc6ac0c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:21.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.762+0000 7fc6aaffd640 1 -- 172.21.15.123:0/1303796018 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6ac144de0 msgr2=0x7fc6ac155710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:21.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.762+0000 7fc6aaffd640 1 --2- 172.21.15.123:0/1303796018 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6ac144de0 0x7fc6ac155710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:21.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.762+0000 7fc6aaffd640 1 -- 172.21.15.123:0/1303796018 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6ac0c90c0 con 0x7fc6ac0cb280 2024-09-15T23:14:21.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.762+0000 7fc6abfff640 1 --2- 172.21.15.123:0/1303796018 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6ac0c8700 0x7fc6ac0c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:21.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.762+0000 7fc6aaffd640 1 --2- 172.21.15.123:0/1303796018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6ac0cb280 0x7fc6ac0cb6e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc6a000e410 tx=0x7fc6a000e500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:21.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.762+0000 7fc693fff640 1 -- 172.21.15.123:0/1303796018 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0013420 con 0x7fc6ac0cb280 2024-09-15T23:14:21.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.762+0000 7fc693fff640 1 -- 172.21.15.123:0/1303796018 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6a0018070 con 0x7fc6ac0cb280 2024-09-15T23:14:21.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.762+0000 7fc6b1b1a640 1 -- 172.21.15.123:0/1303796018 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6ac154670 con 0x7fc6ac0cb280 2024-09-15T23:14:21.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.762+0000 7fc693fff640 1 -- 172.21.15.123:0/1303796018 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0013800 con 0x7fc6ac0cb280 2024-09-15T23:14:21.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.762+0000 7fc6b1b1a640 1 -- 172.21.15.123:0/1303796018 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6ac154c30 con 0x7fc6ac0cb280 2024-09-15T23:14:21.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.763+0000 7fc6b1b1a640 1 -- 172.21.15.123:0/1303796018 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6ac06ca30 con 0x7fc6ac0cb280 2024-09-15T23:14:21.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.763+0000 7fc693fff640 1 -- 172.21.15.123:0/1303796018 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc6a00139a0 con 0x7fc6ac0cb280 2024-09-15T23:14:21.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.764+0000 7fc693fff640 1 --2- 172.21.15.123:0/1303796018 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc69806c2b0 0x7fc69806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:21.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.764+0000 7fc693fff640 1 -- 172.21.15.123:0/1303796018 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5853+0+0 (secure 0 0 0) 0x7fc6a008bd40 con 0x7fc6ac0cb280 2024-09-15T23:14:21.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.764+0000 7fc6ab7fe640 1 --2- 172.21.15.123:0/1303796018 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc69806c2b0 0x7fc69806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:21.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.764+0000 7fc6ab7fe640 1 --2- 172.21.15.123:0/1303796018 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc69806c2b0 0x7fc69806e770 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc69c009990 tx=0x7fc69c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:21.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.768+0000 7fc693fff640 1 -- 172.21.15.123:0/1303796018 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc6a005a390 con 0x7fc6ac0cb280 2024-09-15T23:14:21.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.965+0000 7fc6b1b1a640 1 -- 172.21.15.123:0/1303796018 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6ac0cbd40 con 0x7fc6ac0cb280 2024-09-15T23:14:21.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.966+0000 7fc693fff640 1 -- 172.21.15.123:0/1303796018 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5231 (secure 0 0 0) 0x7fc6a0059c90 con 0x7fc6ac0cb280 2024-09-15T23:14:21.967 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:14:21.967 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":14,"btime":"2024-09-15T23:13:03:573893+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/324550176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":324550176},{"type":"v1","addr":"172.21.15.188:6837","nonce":324550176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4696,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2893461525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2893461525},{"type":"v1","addr":"172.21.15.188:6836","nonce":2893461525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4773,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/4033133132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":4033133132},{"type":"v1","addr":"172.21.15.123:6833","nonce":4033133132}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-15T23:12:51.772541+0000","modified":"2024-09-15T23:13:02.714790+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4776},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4776":{"gid":4776,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/1577644605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1577644605},{"type":"v1","addr":"172.21.15.123:6835","nonce":1577644605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4776,"qdb_cluster":[4776]},"id":2}]} 2024-09-15T23:14:21.967 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 14 2024-09-15T23:14:21.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.968+0000 7fc6b1b1a640 1 -- 172.21.15.123:0/1303796018 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc69806c2b0 msgr2=0x7fc69806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:21.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.968+0000 7fc6b1b1a640 1 --2- 172.21.15.123:0/1303796018 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc69806c2b0 0x7fc69806e770 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc69c009990 tx=0x7fc69c008040 comp rx=0 tx=0).stop 2024-09-15T23:14:21.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.968+0000 7fc6b1b1a640 1 -- 172.21.15.123:0/1303796018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6ac0cb280 msgr2=0x7fc6ac0cb6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:21.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.968+0000 7fc6b1b1a640 1 --2- 172.21.15.123:0/1303796018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6ac0cb280 0x7fc6ac0cb6e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc6a000e410 tx=0x7fc6a000e500 comp rx=0 tx=0).stop 2024-09-15T23:14:21.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.968+0000 7fc6b1b1a640 1 -- 172.21.15.123:0/1303796018 shutdown_connections 2024-09-15T23:14:21.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.968+0000 7fc6b1b1a640 1 --2- 172.21.15.123:0/1303796018 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6ac0c8700 0x7fc6ac0c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:21.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.968+0000 7fc6b1b1a640 1 --2- 172.21.15.123:0/1303796018 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc69806c2b0 0x7fc69806e770 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:21.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.968+0000 7fc6b1b1a640 1 --2- 172.21.15.123:0/1303796018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6ac0cb280 0x7fc6ac0cb6e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:21.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.968+0000 7fc6b1b1a640 1 --2- 172.21.15.123:0/1303796018 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6ac144de0 0x7fc6ac155710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:21.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.968+0000 7fc6b1b1a640 1 -- 172.21.15.123:0/1303796018 >> 172.21.15.123:0/1303796018 conn(0x7fc6ac0ccec0 msgr2=0x7fc6ac0b5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:21.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.968+0000 7fc6b1b1a640 1 -- 172.21.15.123:0/1303796018 shutdown_connections 2024-09-15T23:14:21.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:21.968+0000 7fc6b1b1a640 1 -- 172.21.15.123:0/1303796018 wait complete. 2024-09-15T23:14:21.979 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:14:22.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.077+0000 7f7e1292a640 1 Processor -- start 2024-09-15T23:14:22.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.077+0000 7f7e1292a640 1 -- start start 2024-09-15T23:14:22.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.078+0000 7f7e1292a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7e0c15ab40 0x7f7e0c06c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:22.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.078+0000 7f7e1292a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7e0c15af20 0x7f7e0c15b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:22.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.078+0000 7f7e1292a640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e0c0724f0 con 0x7f7e0c0720b0 2024-09-15T23:14:22.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.078+0000 7f7e1292a640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f7e0c071010 con 0x7f7e0c15af20 2024-09-15T23:14:22.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.078+0000 7f7e1292a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7e0c0712f0 con 0x7f7e0c15ab40 2024-09-15T23:14:22.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.078+0000 7f7e10ec7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7e0c15af20 0x7f7e0c15b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:22.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.078+0000 7f7e10ec7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7e0c15af20 0x7f7e0c15b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55068/0 (socket says 172.21.15.123:55068) 2024-09-15T23:14:22.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.078+0000 7f7e10ec7640 1 -- 172.21.15.123:0/2715039066 learned_addr learned my addr 172.21.15.123:0/2715039066 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:22.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.078+0000 7f7e0bfff640 1 --2- 172.21.15.123:0/2715039066 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7e0c15ab40 0x7f7e0c06c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:22.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.078+0000 7f7e10ec7640 1 -- 172.21.15.123:0/2715039066 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7e0c15ab40 msgr2=0x7f7e0c06c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:22.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.078+0000 7f7e10ec7640 1 --2- 172.21.15.123:0/2715039066 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7e0c15ab40 0x7f7e0c06c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:22.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.078+0000 7f7e10ec7640 1 -- 172.21.15.123:0/2715039066 >> v1:172.21.15.188:6789/0 conn(0x7f7e0c0720b0 legacy=0x7f7e0c073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:22.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.078+0000 7f7e10ec7640 1 -- 172.21.15.123:0/2715039066 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e0c0715d0 con 0x7f7e0c15af20 2024-09-15T23:14:22.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.078+0000 7f7e0bfff640 1 --2- 172.21.15.123:0/2715039066 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7e0c15ab40 0x7f7e0c06c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:22.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.079+0000 7f7e10ec7640 1 --2- 172.21.15.123:0/2715039066 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e0c15af20 0x7f7e0c15b370 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009e50 tx=0x7f7e0402a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d036d0ec3cc48e48 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:22.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.079+0000 7f7e0affd640 1 -- 172.21.15.123:0/2715039066 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e04036070 con 0x7f7e0c15af20 2024-09-15T23:14:22.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.079+0000 7f7e0affd640 1 -- 172.21.15.123:0/2715039066 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e04031600 con 0x7f7e0c15af20 2024-09-15T23:14:22.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.079+0000 7f7e0affd640 1 -- 172.21.15.123:0/2715039066 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e040319d0 con 0x7f7e0c15af20 2024-09-15T23:14:22.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.079+0000 7f7e1292a640 1 -- 172.21.15.123:0/2715039066 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e0c15af20 msgr2=0x7f7e0c15b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:22.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.079+0000 7f7e1292a640 1 --2- 172.21.15.123:0/2715039066 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e0c15af20 0x7f7e0c15b370 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009e50 tx=0x7f7e0402a640 comp rx=0 tx=0).stop 2024-09-15T23:14:22.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.079+0000 7f7e1292a640 1 -- 172.21.15.123:0/2715039066 shutdown_connections 2024-09-15T23:14:22.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.079+0000 7f7e1292a640 1 --2- 172.21.15.123:0/2715039066 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e0c15af20 0x7f7e0c15b370 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:22.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.079+0000 7f7e1292a640 1 --2- 172.21.15.123:0/2715039066 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7e0c15ab40 0x7f7e0c06c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:22.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.079+0000 7f7e1292a640 1 -- 172.21.15.123:0/2715039066 >> 172.21.15.123:0/2715039066 conn(0x7f7e0c0ccec0 msgr2=0x7f7e0c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:22.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.079+0000 7f7e1292a640 1 -- 172.21.15.123:0/2715039066 shutdown_connections 2024-09-15T23:14:22.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.079+0000 7f7e1292a640 1 -- 172.21.15.123:0/2715039066 wait complete. 2024-09-15T23:14:22.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.081+0000 7f7e1292a640 1 Processor -- start 2024-09-15T23:14:22.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.081+0000 7f7e1292a640 1 -- start start 2024-09-15T23:14:22.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.081+0000 7f7e1292a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e0c0720b0 0x7f7e0c154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:22.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.081+0000 7f7e1292a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7e0c15ab40 0x7f7e0c149c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:22.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.081+0000 7f7e1292a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7e0c15af20 0x7f7e0c166a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:22.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.081+0000 7f7e1292a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7e0c15ba30 con 0x7f7e0c0720b0 2024-09-15T23:14:22.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.081+0000 7f7e1292a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7e0c15b8b0 con 0x7f7e0c15ab40 2024-09-15T23:14:22.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.081+0000 7f7e1292a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7e0c06bc10 con 0x7f7e0c15af20 2024-09-15T23:14:22.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.082+0000 7f7e0bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e0c0720b0 0x7f7e0c154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:22.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.082+0000 7f7e0bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e0c0720b0 0x7f7e0c154560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55074/0 (socket says 172.21.15.123:55074) 2024-09-15T23:14:22.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.082+0000 7f7e0bfff640 1 -- 172.21.15.123:0/412723822 learned_addr learned my addr 172.21.15.123:0/412723822 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:22.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.082+0000 7f7e10ec7640 1 --2- 172.21.15.123:0/412723822 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7e0c15af20 0x7f7e0c166a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:22.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.082+0000 7f7e0b7fe640 1 --2- 172.21.15.123:0/412723822 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7e0c15ab40 0x7f7e0c149c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:22.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.082+0000 7f7e0bfff640 1 -- 172.21.15.123:0/412723822 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7e0c15af20 msgr2=0x7f7e0c166a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:22.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.082+0000 7f7e0bfff640 1 --2- 172.21.15.123:0/412723822 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7e0c15af20 0x7f7e0c166a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:22.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.082+0000 7f7e0bfff640 1 -- 172.21.15.123:0/412723822 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7e0c15ab40 msgr2=0x7f7e0c149c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:22.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.082+0000 7f7e0bfff640 1 --2- 172.21.15.123:0/412723822 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7e0c15ab40 0x7f7e0c149c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:22.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.082+0000 7f7e0bfff640 1 -- 172.21.15.123:0/412723822 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e0c14a370 con 0x7f7e0c0720b0 2024-09-15T23:14:22.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.082+0000 7f7e0bfff640 1 --2- 172.21.15.123:0/412723822 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e0c0720b0 0x7f7e0c154560 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc00c7f0 tx=0x7f7dfc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:22.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.082+0000 7f7e08ff9640 1 -- 172.21.15.123:0/412723822 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc015070 con 0x7f7e0c0720b0 2024-09-15T23:14:22.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.082+0000 7f7e08ff9640 1 -- 172.21.15.123:0/412723822 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dfc007a30 con 0x7f7e0c0720b0 2024-09-15T23:14:22.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.082+0000 7f7e08ff9640 1 -- 172.21.15.123:0/412723822 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc007e00 con 0x7f7e0c0720b0 2024-09-15T23:14:22.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.082+0000 7f7e1292a640 1 -- 172.21.15.123:0/412723822 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e0c136c10 con 0x7f7e0c0720b0 2024-09-15T23:14:22.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.082+0000 7f7e1292a640 1 -- 172.21.15.123:0/412723822 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e0c1371d0 con 0x7f7e0c0720b0 2024-09-15T23:14:22.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.083+0000 7f7e1292a640 1 -- 172.21.15.123:0/412723822 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e0c06c070 con 0x7f7e0c0720b0 2024-09-15T23:14:22.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.084+0000 7f7e08ff9640 1 -- 172.21.15.123:0/412723822 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7dfc018070 con 0x7f7e0c0720b0 2024-09-15T23:14:22.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.084+0000 7f7e08ff9640 1 --2- 172.21.15.123:0/412723822 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7df806c2b0 0x7f7df806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:22.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.084+0000 7f7e08ff9640 1 -- 172.21.15.123:0/412723822 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5853+0+0 (secure 0 0 0) 0x7f7dfc08b4b0 con 0x7f7e0c0720b0 2024-09-15T23:14:22.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.085+0000 7f7e0b7fe640 1 --2- 172.21.15.123:0/412723822 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7df806c2b0 0x7f7df806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:22.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.085+0000 7f7e0b7fe640 1 --2- 172.21.15.123:0/412723822 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7df806c2b0 0x7f7df806e770 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c14a950 tx=0x7f7e00009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:22.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.089+0000 7f7e08ff9640 1 -- 172.21.15.123:0/412723822 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7dfc059b90 con 0x7f7e0c0720b0 2024-09-15T23:14:22.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.254+0000 7f7e1292a640 1 -- 172.21.15.123:0/412723822 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7e0c158b40 con 0x7f7e0c0720b0 2024-09-15T23:14:22.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.256+0000 7f7e08ff9640 1 -- 172.21.15.123:0/412723822 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+17007 (secure 0 0 0) 0x7f7dfc059490 con 0x7f7e0c0720b0 2024-09-15T23:14:22.257 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:14:22.257 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":40,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:13:59.234815+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:12:49.560175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-15T23:12:50.754784+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":34,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.0","mappings":[{"from":4,"to":5}]},{"pgid":"5.23","mappings":[{"from":4,"to":5}]},{"pgid":"5.35","mappings":[{"from":4,"to":5}]},{"pgid":"5.3c","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:14:22.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.258+0000 7f7e1292a640 1 -- 172.21.15.123:0/412723822 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7df806c2b0 msgr2=0x7f7df806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:22.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.258+0000 7f7e1292a640 1 --2- 172.21.15.123:0/412723822 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7df806c2b0 0x7f7df806e770 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c14a950 tx=0x7f7e00009040 comp rx=0 tx=0).stop 2024-09-15T23:14:22.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.258+0000 7f7e1292a640 1 -- 172.21.15.123:0/412723822 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e0c0720b0 msgr2=0x7f7e0c154560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:22.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.258+0000 7f7e1292a640 1 --2- 172.21.15.123:0/412723822 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e0c0720b0 0x7f7e0c154560 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc00c7f0 tx=0x7f7dfc00cbf0 comp rx=0 tx=0).stop 2024-09-15T23:14:22.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.258+0000 7f7e1292a640 1 -- 172.21.15.123:0/412723822 shutdown_connections 2024-09-15T23:14:22.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.258+0000 7f7e1292a640 1 --2- 172.21.15.123:0/412723822 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7e0c15af20 0x7f7e0c166a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:22.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.258+0000 7f7e1292a640 1 --2- 172.21.15.123:0/412723822 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7e0c15ab40 0x7f7e0c149c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:22.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.258+0000 7f7e1292a640 1 --2- 172.21.15.123:0/412723822 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7df806c2b0 0x7f7df806e770 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:22.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.258+0000 7f7e1292a640 1 --2- 172.21.15.123:0/412723822 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e0c0720b0 0x7f7e0c154560 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:22.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.258+0000 7f7e1292a640 1 -- 172.21.15.123:0/412723822 >> 172.21.15.123:0/412723822 conn(0x7f7e0c0ccec0 msgr2=0x7f7e0c1581c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:22.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.258+0000 7f7e1292a640 1 -- 172.21.15.123:0/412723822 shutdown_connections 2024-09-15T23:14:22.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.258+0000 7f7e1292a640 1 -- 172.21.15.123:0/412723822 wait complete. 2024-09-15T23:14:22.270 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T23:14:22.270 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:14:22.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.367+0000 7f1823ac3640 1 Processor -- start 2024-09-15T23:14:22.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.367+0000 7f1823ac3640 1 -- start start 2024-09-15T23:14:22.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.368+0000 7f1823ac3640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f181c06c320 0x7f181c15bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:22.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.368+0000 7f1823ac3640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f181c13eb20 0x7f181c15c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:22.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.368+0000 7f1823ac3640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f181c071180 con 0x7f181c0b2d40 2024-09-15T23:14:22.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.368+0000 7f1823ac3640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f181c071ab0 con 0x7f181c13eb20 2024-09-15T23:14:22.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.368+0000 7f1823ac3640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f181c071460 con 0x7f181c06c320 2024-09-15T23:14:22.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.368+0000 7f1822060640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f181c13eb20 0x7f181c15c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:22.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.368+0000 7f1822060640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f181c13eb20 0x7f181c15c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55076/0 (socket says 172.21.15.123:55076) 2024-09-15T23:14:22.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.368+0000 7f1822060640 1 -- 172.21.15.123:0/411968452 learned_addr learned my addr 172.21.15.123:0/411968452 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:22.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.369+0000 7f182105e640 1 --2- 172.21.15.123:0/411968452 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f181c06c320 0x7f181c15bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:22.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.369+0000 7f1822060640 1 -- 172.21.15.123:0/411968452 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f181c06c320 msgr2=0x7f181c15bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:22.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.369+0000 7f1822060640 1 --2- 172.21.15.123:0/411968452 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f181c06c320 0x7f181c15bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:22.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.369+0000 7f1822060640 1 -- 172.21.15.123:0/411968452 >> v1:172.21.15.188:6789/0 conn(0x7f181c0b2d40 legacy=0x7f181c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:22.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.369+0000 7f1822060640 1 -- 172.21.15.123:0/411968452 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f181c071740 con 0x7f181c13eb20 2024-09-15T23:14:22.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.369+0000 7f1822060640 1 --2- 172.21.15.123:0/411968452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f181c13eb20 0x7f181c15c230 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1814009870 tx=0x7f181402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c72566f9b485926 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:22.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.369+0000 7f182085d640 1 -- 172.21.15.123:0/411968452 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1814037070 con 0x7f181c13eb20 2024-09-15T23:14:22.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.370+0000 7f182085d640 1 -- 172.21.15.123:0/411968452 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1814032440 con 0x7f181c13eb20 2024-09-15T23:14:22.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.370+0000 7f182085d640 1 -- 172.21.15.123:0/411968452 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1814032810 con 0x7f181c13eb20 2024-09-15T23:14:22.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.370+0000 7f1823ac3640 1 -- 172.21.15.123:0/411968452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f181c13eb20 msgr2=0x7f181c15c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:22.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.370+0000 7f1823ac3640 1 --2- 172.21.15.123:0/411968452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f181c13eb20 0x7f181c15c230 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1814009870 tx=0x7f181402a270 comp rx=0 tx=0).stop 2024-09-15T23:14:22.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.370+0000 7f1823ac3640 1 -- 172.21.15.123:0/411968452 shutdown_connections 2024-09-15T23:14:22.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.370+0000 7f1823ac3640 1 --2- 172.21.15.123:0/411968452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f181c13eb20 0x7f181c15c230 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:22.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.370+0000 7f1823ac3640 1 --2- 172.21.15.123:0/411968452 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f181c06c320 0x7f181c15bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:22.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.370+0000 7f1823ac3640 1 -- 172.21.15.123:0/411968452 >> 172.21.15.123:0/411968452 conn(0x7f181c0ccec0 msgr2=0x7f181c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:22.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.370+0000 7f1823ac3640 1 -- 172.21.15.123:0/411968452 shutdown_connections 2024-09-15T23:14:22.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.370+0000 7f1823ac3640 1 -- 172.21.15.123:0/411968452 wait complete. 2024-09-15T23:14:22.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.371+0000 7f1823ac3640 1 Processor -- start 2024-09-15T23:14:22.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.371+0000 7f1823ac3640 1 -- start start 2024-09-15T23:14:22.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.372+0000 7f1823ac3640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f181c06c320 0x7f181c15fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:22.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.372+0000 7f1823ac3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f181c0b2d40 0x7f181c130000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:22.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.372+0000 7f1823ac3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f181c13eb20 0x7f181c130540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:22.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.372+0000 7f1823ac3640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f181c0720c0 con 0x7f181c0b2d40 2024-09-15T23:14:22.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.372+0000 7f1823ac3640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f181c071f40 con 0x7f181c13eb20 2024-09-15T23:14:22.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.372+0000 7f1823ac3640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f181c072240 con 0x7f181c06c320 2024-09-15T23:14:22.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.372+0000 7f182105e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f181c0b2d40 0x7f181c130000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:22.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.372+0000 7f182105e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f181c0b2d40 0x7f181c130000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55082/0 (socket says 172.21.15.123:55082) 2024-09-15T23:14:22.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.372+0000 7f182105e640 1 -- 172.21.15.123:0/230212788 learned_addr learned my addr 172.21.15.123:0/230212788 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:22.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.372+0000 7f182185f640 1 --2- 172.21.15.123:0/230212788 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f181c06c320 0x7f181c15fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:22.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.372+0000 7f1822060640 1 --2- 172.21.15.123:0/230212788 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f181c13eb20 0x7f181c130540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:22.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.372+0000 7f182105e640 1 -- 172.21.15.123:0/230212788 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f181c06c320 msgr2=0x7f181c15fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:22.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.372+0000 7f182105e640 1 --2- 172.21.15.123:0/230212788 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f181c06c320 0x7f181c15fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:22.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.372+0000 7f182105e640 1 -- 172.21.15.123:0/230212788 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f181c13eb20 msgr2=0x7f181c130540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:22.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.372+0000 7f182105e640 1 --2- 172.21.15.123:0/230212788 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f181c13eb20 0x7f181c130540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:22.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.372+0000 7f182105e640 1 -- 172.21.15.123:0/230212788 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f181c0c5580 con 0x7f181c0b2d40 2024-09-15T23:14:22.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.372+0000 7f182185f640 1 --2- 172.21.15.123:0/230212788 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f181c06c320 0x7f181c15fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:22.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.372+0000 7f1822060640 1 --2- 172.21.15.123:0/230212788 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f181c13eb20 0x7f181c130540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:22.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.373+0000 7f182105e640 1 --2- 172.21.15.123:0/230212788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f181c0b2d40 0x7f181c130000 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f181000d800 tx=0x7f181000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:22.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.373+0000 7f181a7fc640 1 -- 172.21.15.123:0/230212788 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f181000b6c0 con 0x7f181c0b2d40 2024-09-15T23:14:22.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.373+0000 7f181a7fc640 1 -- 172.21.15.123:0/230212788 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1810019070 con 0x7f181c0b2d40 2024-09-15T23:14:22.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.373+0000 7f1823ac3640 1 -- 172.21.15.123:0/230212788 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f181c12dda0 con 0x7f181c0b2d40 2024-09-15T23:14:22.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.373+0000 7f181a7fc640 1 -- 172.21.15.123:0/230212788 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f181000baa0 con 0x7f181c0b2d40 2024-09-15T23:14:22.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.373+0000 7f1823ac3640 1 -- 172.21.15.123:0/230212788 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f181c12e360 con 0x7f181c0b2d40 2024-09-15T23:14:22.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.374+0000 7f1823ac3640 1 -- 172.21.15.123:0/230212788 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f181c12e560 con 0x7f181c0b2d40 2024-09-15T23:14:22.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.374+0000 7f181a7fc640 1 -- 172.21.15.123:0/230212788 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f181000bc40 con 0x7f181c0b2d40 2024-09-15T23:14:22.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.375+0000 7f181a7fc640 1 --2- 172.21.15.123:0/230212788 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f180806c2b0 0x7f180806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:22.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.375+0000 7f181a7fc640 1 -- 172.21.15.123:0/230212788 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5853+0+0 (secure 0 0 0) 0x7f181008b990 con 0x7f181c0b2d40 2024-09-15T23:14:22.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.375+0000 7f182185f640 1 --2- 172.21.15.123:0/230212788 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f180806c2b0 0x7f180806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:22.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.375+0000 7f182185f640 1 --2- 172.21.15.123:0/230212788 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f180806c2b0 0x7f180806e770 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f180c001e00 tx=0x7f180c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:22.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.379+0000 7f181a7fc640 1 -- 172.21.15.123:0/230212788 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f181c12e560 con 0x7f181c0b2d40 2024-09-15T23:14:22.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.579+0000 7f1823ac3640 1 -- 172.21.15.123:0/230212788 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f181c06c9c0 con 0x7f181c0b2d40 2024-09-15T23:14:22.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.580+0000 7f181a7fc640 1 -- 172.21.15.123:0/230212788 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5231 (secure 0 0 0) 0x7f181005a070 con 0x7f181c0b2d40 2024-09-15T23:14:22.581 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:14:22.581 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":14,"btime":"2024-09-15T23:13:03:573893+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/324550176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":324550176},{"type":"v1","addr":"172.21.15.188:6837","nonce":324550176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4696,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2893461525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2893461525},{"type":"v1","addr":"172.21.15.188:6836","nonce":2893461525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4773,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/4033133132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":4033133132},{"type":"v1","addr":"172.21.15.123:6833","nonce":4033133132}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-15T23:12:51.772541+0000","modified":"2024-09-15T23:13:02.714790+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4776},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4776":{"gid":4776,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/1577644605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1577644605},{"type":"v1","addr":"172.21.15.123:6835","nonce":1577644605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4776,"qdb_cluster":[4776]},"id":2}]} 2024-09-15T23:14:22.581 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 14 2024-09-15T23:14:22.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.582+0000 7f1823ac3640 1 -- 172.21.15.123:0/230212788 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f180806c2b0 msgr2=0x7f180806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:22.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.582+0000 7f1823ac3640 1 --2- 172.21.15.123:0/230212788 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f180806c2b0 0x7f180806e770 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f180c001e00 tx=0x7f180c009040 comp rx=0 tx=0).stop 2024-09-15T23:14:22.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.582+0000 7f1823ac3640 1 -- 172.21.15.123:0/230212788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f181c0b2d40 msgr2=0x7f181c130000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:22.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.582+0000 7f1823ac3640 1 --2- 172.21.15.123:0/230212788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f181c0b2d40 0x7f181c130000 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f181000d800 tx=0x7f181000dcc0 comp rx=0 tx=0).stop 2024-09-15T23:14:22.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.582+0000 7f1823ac3640 1 -- 172.21.15.123:0/230212788 shutdown_connections 2024-09-15T23:14:22.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.582+0000 7f1823ac3640 1 --2- 172.21.15.123:0/230212788 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f181c13eb20 0x7f181c130540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:22.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.582+0000 7f1823ac3640 1 --2- 172.21.15.123:0/230212788 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f180806c2b0 0x7f180806e770 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:22.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.582+0000 7f1823ac3640 1 --2- 172.21.15.123:0/230212788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f181c0b2d40 0x7f181c130000 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:22.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.582+0000 7f1823ac3640 1 --2- 172.21.15.123:0/230212788 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f181c06c320 0x7f181c15fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:22.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.582+0000 7f1823ac3640 1 -- 172.21.15.123:0/230212788 >> 172.21.15.123:0/230212788 conn(0x7f181c0ccec0 msgr2=0x7f181c13eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:22.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.582+0000 7f1823ac3640 1 -- 172.21.15.123:0/230212788 shutdown_connections 2024-09-15T23:14:22.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.582+0000 7f1823ac3640 1 -- 172.21.15.123:0/230212788 wait complete. 2024-09-15T23:14:22.593 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:14:22.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.691+0000 7fac7e75b640 1 Processor -- start 2024-09-15T23:14:22.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.691+0000 7fac7e75b640 1 -- start start 2024-09-15T23:14:22.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.692+0000 7fac7e75b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fac780b2d40 0x7fac7806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:22.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.692+0000 7fac7e75b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fac7813eb20 0x7fac7806c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:22.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.692+0000 7fac7e75b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac7815bcf0 0x7fac7815c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:22.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.692+0000 7fac7e75b640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fac78071ab0 con 0x7fac7813eb20 2024-09-15T23:14:22.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.692+0000 7fac7e75b640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fac78071180 con 0x7fac780b2d40 2024-09-15T23:14:22.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.692+0000 7fac7e75b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fac78071460 con 0x7fac7815bcf0 2024-09-15T23:14:22.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.692+0000 7fac777fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fac7813eb20 0x7fac7806c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:22.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.692+0000 7fac777fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fac7813eb20 0x7fac7806c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55094/0 (socket says 172.21.15.123:55094) 2024-09-15T23:14:22.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.692+0000 7fac777fe640 1 -- 172.21.15.123:0/2190985914 learned_addr learned my addr 172.21.15.123:0/2190985914 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:22.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.692+0000 7fac77fff640 1 --2- 172.21.15.123:0/2190985914 >> v2:172.21.15.188:3300/0 conn(0x7fac780b2d40 0x7fac7806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:22.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.692+0000 7fac7ccf8640 1 --2- 172.21.15.123:0/2190985914 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac7815bcf0 0x7fac7815c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:22.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.692+0000 7fac777fe640 1 -- 172.21.15.123:0/2190985914 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac7815bcf0 msgr2=0x7fac7815c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:22.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.692+0000 7fac777fe640 1 --2- 172.21.15.123:0/2190985914 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac7815bcf0 0x7fac7815c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:22.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.692+0000 7fac777fe640 1 -- 172.21.15.123:0/2190985914 >> v2:172.21.15.188:3300/0 conn(0x7fac780b2d40 msgr2=0x7fac7806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:22.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.692+0000 7fac777fe640 1 --2- 172.21.15.123:0/2190985914 >> v2:172.21.15.188:3300/0 conn(0x7fac780b2d40 0x7fac7806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:22.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.692+0000 7fac777fe640 1 -- 172.21.15.123:0/2190985914 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac78071740 con 0x7fac7813eb20 2024-09-15T23:14:22.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.693+0000 7fac777fe640 1 --2- 172.21.15.123:0/2190985914 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac7813eb20 0x7fac7806c150 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fac78069be0 tx=0x7fac6c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69e1a676136a34f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:22.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.693+0000 7fac76ffd640 1 -- 172.21.15.123:0/2190985914 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c037070 con 0x7fac7813eb20 2024-09-15T23:14:22.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.693+0000 7fac76ffd640 1 -- 172.21.15.123:0/2190985914 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac6c032440 con 0x7fac7813eb20 2024-09-15T23:14:22.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.693+0000 7fac76ffd640 1 -- 172.21.15.123:0/2190985914 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c032810 con 0x7fac7813eb20 2024-09-15T23:14:22.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.694+0000 7fac7e75b640 1 -- 172.21.15.123:0/2190985914 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac7813eb20 msgr2=0x7fac7806c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:22.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.694+0000 7fac7e75b640 1 --2- 172.21.15.123:0/2190985914 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac7813eb20 0x7fac7806c150 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fac78069be0 tx=0x7fac6c02a1e0 comp rx=0 tx=0).stop 2024-09-15T23:14:22.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.694+0000 7fac7e75b640 1 -- 172.21.15.123:0/2190985914 shutdown_connections 2024-09-15T23:14:22.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.694+0000 7fac7e75b640 1 --2- 172.21.15.123:0/2190985914 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac7815bcf0 0x7fac7815c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:22.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.694+0000 7fac7e75b640 1 --2- 172.21.15.123:0/2190985914 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac7813eb20 0x7fac7806c150 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:22.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.694+0000 7fac7e75b640 1 --2- 172.21.15.123:0/2190985914 >> v2:172.21.15.188:3300/0 conn(0x7fac780b2d40 0x7fac7806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:22.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.694+0000 7fac7e75b640 1 -- 172.21.15.123:0/2190985914 >> 172.21.15.123:0/2190985914 conn(0x7fac780ccec0 msgr2=0x7fac780cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:22.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.694+0000 7fac7e75b640 1 -- 172.21.15.123:0/2190985914 shutdown_connections 2024-09-15T23:14:22.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.694+0000 7fac7e75b640 1 -- 172.21.15.123:0/2190985914 wait complete. 2024-09-15T23:14:22.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.695+0000 7fac7e75b640 1 Processor -- start 2024-09-15T23:14:22.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.695+0000 7fac7e75b640 1 -- start start 2024-09-15T23:14:22.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.696+0000 7fac7e75b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac780b2d40 0x7fac781545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:22.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.696+0000 7fac7e75b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac7813eb20 0x7fac7815dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:22.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.696+0000 7fac7e75b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac7815bcf0 0x7fac7815e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:22.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.696+0000 7fac7e75b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fac7815f140 con 0x7fac7815bcf0 2024-09-15T23:14:22.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.696+0000 7fac7e75b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fac7815efc0 con 0x7fac7813eb20 2024-09-15T23:14:22.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.696+0000 7fac7e75b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fac7815f2c0 con 0x7fac780b2d40 2024-09-15T23:14:22.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.696+0000 7fac7ccf8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac7815bcf0 0x7fac7815e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:22.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.696+0000 7fac7ccf8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac7815bcf0 0x7fac7815e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55106/0 (socket says 172.21.15.123:55106) 2024-09-15T23:14:22.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.696+0000 7fac7ccf8640 1 -- 172.21.15.123:0/1968589982 learned_addr learned my addr 172.21.15.123:0/1968589982 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:22.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.696+0000 7fac77fff640 1 --2- 172.21.15.123:0/1968589982 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac780b2d40 0x7fac781545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:22.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.696+0000 7fac777fe640 1 --2- 172.21.15.123:0/1968589982 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac7813eb20 0x7fac7815dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:22.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.696+0000 7fac7ccf8640 1 -- 172.21.15.123:0/1968589982 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac780b2d40 msgr2=0x7fac781545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:22.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.696+0000 7fac7ccf8640 1 --2- 172.21.15.123:0/1968589982 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac780b2d40 0x7fac781545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:22.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.696+0000 7fac7ccf8640 1 -- 172.21.15.123:0/1968589982 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac7813eb20 msgr2=0x7fac7815dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:22.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.696+0000 7fac7ccf8640 1 --2- 172.21.15.123:0/1968589982 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac7813eb20 0x7fac7815dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:22.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.696+0000 7fac7ccf8640 1 -- 172.21.15.123:0/1968589982 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac7815d870 con 0x7fac7815bcf0 2024-09-15T23:14:22.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.697+0000 7fac7ccf8640 1 --2- 172.21.15.123:0/1968589982 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac7815bcf0 0x7fac7815e2b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fac70007e60 tx=0x7fac7000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:22.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.697+0000 7fac74ff9640 1 -- 172.21.15.123:0/1968589982 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac70014420 con 0x7fac7815bcf0 2024-09-15T23:14:22.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.697+0000 7fac74ff9640 1 -- 172.21.15.123:0/1968589982 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac70019070 con 0x7fac7815bcf0 2024-09-15T23:14:22.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.697+0000 7fac7e75b640 1 -- 172.21.15.123:0/1968589982 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac7813cab0 con 0x7fac7815bcf0 2024-09-15T23:14:22.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.697+0000 7fac74ff9640 1 -- 172.21.15.123:0/1968589982 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac70014820 con 0x7fac7815bcf0 2024-09-15T23:14:22.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.697+0000 7fac7e75b640 1 -- 172.21.15.123:0/1968589982 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac7813d070 con 0x7fac7815bcf0 2024-09-15T23:14:22.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.698+0000 7fac7e75b640 1 -- 172.21.15.123:0/1968589982 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac7815c1a0 con 0x7fac7815bcf0 2024-09-15T23:14:22.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.698+0000 7fac74ff9640 1 -- 172.21.15.123:0/1968589982 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fac700149c0 con 0x7fac7815bcf0 2024-09-15T23:14:22.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.699+0000 7fac74ff9640 1 --2- 172.21.15.123:0/1968589982 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fac6406c2b0 0x7fac6406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:22.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.699+0000 7fac74ff9640 1 -- 172.21.15.123:0/1968589982 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5853+0+0 (secure 0 0 0) 0x7fac7008bbb0 con 0x7fac7815bcf0 2024-09-15T23:14:22.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.699+0000 7fac77fff640 1 --2- 172.21.15.123:0/1968589982 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fac6406c2b0 0x7fac6406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:22.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.699+0000 7fac77fff640 1 --2- 172.21.15.123:0/1968589982 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fac6406c2b0 0x7fac6406e770 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fac68006fd0 tx=0x7fac68008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:22.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.703+0000 7fac74ff9640 1 -- 172.21.15.123:0/1968589982 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fac7005a320 con 0x7fac7815bcf0 2024-09-15T23:14:22.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.901+0000 7fac7e75b640 1 -- 172.21.15.123:0/1968589982 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac7806c9c0 con 0x7fac7815bcf0 2024-09-15T23:14:22.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.902+0000 7fac74ff9640 1 -- 172.21.15.123:0/1968589982 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5231 (secure 0 0 0) 0x7fac70059c20 con 0x7fac7815bcf0 2024-09-15T23:14:22.903 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:14:22.903 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":14,"btime":"2024-09-15T23:13:03:573893+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/324550176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":324550176},{"type":"v1","addr":"172.21.15.188:6837","nonce":324550176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4696,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2893461525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2893461525},{"type":"v1","addr":"172.21.15.188:6836","nonce":2893461525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4773,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/4033133132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":4033133132},{"type":"v1","addr":"172.21.15.123:6833","nonce":4033133132}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-15T23:12:51.772541+0000","modified":"2024-09-15T23:13:02.714790+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4776},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4776":{"gid":4776,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/1577644605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1577644605},{"type":"v1","addr":"172.21.15.123:6835","nonce":1577644605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4776,"qdb_cluster":[4776]},"id":2}]} 2024-09-15T23:14:22.903 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 14 2024-09-15T23:14:22.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.903+0000 7fac7e75b640 1 -- 172.21.15.123:0/1968589982 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fac6406c2b0 msgr2=0x7fac6406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:22.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.904+0000 7fac7e75b640 1 --2- 172.21.15.123:0/1968589982 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fac6406c2b0 0x7fac6406e770 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fac68006fd0 tx=0x7fac68008040 comp rx=0 tx=0).stop 2024-09-15T23:14:22.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.904+0000 7fac7e75b640 1 -- 172.21.15.123:0/1968589982 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac7815bcf0 msgr2=0x7fac7815e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:22.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.904+0000 7fac7e75b640 1 --2- 172.21.15.123:0/1968589982 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac7815bcf0 0x7fac7815e2b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fac70007e60 tx=0x7fac7000e4b0 comp rx=0 tx=0).stop 2024-09-15T23:14:22.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.904+0000 7fac7e75b640 1 -- 172.21.15.123:0/1968589982 shutdown_connections 2024-09-15T23:14:22.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.904+0000 7fac7e75b640 1 --2- 172.21.15.123:0/1968589982 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fac6406c2b0 0x7fac6406e770 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:22.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.904+0000 7fac7e75b640 1 --2- 172.21.15.123:0/1968589982 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac7815bcf0 0x7fac7815e2b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:22.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.904+0000 7fac7e75b640 1 --2- 172.21.15.123:0/1968589982 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac7813eb20 0x7fac7815dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:22.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.904+0000 7fac7e75b640 1 --2- 172.21.15.123:0/1968589982 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac780b2d40 0x7fac781545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:22.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.904+0000 7fac7e75b640 1 -- 172.21.15.123:0/1968589982 >> 172.21.15.123:0/1968589982 conn(0x7fac780ccec0 msgr2=0x7fac780cf830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:22.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.904+0000 7fac7e75b640 1 -- 172.21.15.123:0/1968589982 shutdown_connections 2024-09-15T23:14:22.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:22.904+0000 7fac7e75b640 1 -- 172.21.15.123:0/1968589982 wait complete. 2024-09-15T23:14:22.915 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:14:23.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.013+0000 7fae60b49640 1 Processor -- start 2024-09-15T23:14:23.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.013+0000 7fae60b49640 1 -- start start 2024-09-15T23:14:23.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.014+0000 7fae60b49640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fae5c0b5080 0x7fae5c0b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:23.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.014+0000 7fae60b49640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae5c0b4020 con 0x7fae5c073890 2024-09-15T23:14:23.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.014+0000 7fae60b49640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae5c0b42c0 con 0x7fae5c145ed0 2024-09-15T23:14:23.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.014+0000 7fae60b49640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fae5c0b45a0 con 0x7fae5c0b5080 2024-09-15T23:14:23.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.014+0000 7fae51d9b640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fae5c073890 0x7fae5c0b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38148/0 (socket says 172.21.15.123:38148) 2024-09-15T23:14:23.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.014+0000 7fae51d9b640 1 -- 172.21.15.123:0/2113541692 learned_addr learned my addr 172.21.15.123:0/2113541692 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:23.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.014+0000 7fae5ad9d640 1 --2- 172.21.15.123:0/2113541692 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fae5c0b5080 0x7fae5c0b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:23.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.014+0000 7fae59d9b640 1 -- 172.21.15.123:0/2113541692 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2686851546 0 0) 0x7fae5c0b4020 con 0x7fae5c073890 2024-09-15T23:14:23.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.014+0000 7fae59d9b640 1 -- 172.21.15.123:0/2113541692 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae48003520 con 0x7fae5c073890 2024-09-15T23:14:23.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.014+0000 7fae59d9b640 1 -- 172.21.15.123:0/2113541692 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 139348070 0 0) 0x7fae48003520 con 0x7fae5c073890 2024-09-15T23:14:23.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.014+0000 7fae59d9b640 1 -- 172.21.15.123:0/2113541692 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fae5c0b5080 msgr2=0x7fae5c0b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:23.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.014+0000 7fae59d9b640 1 --2- 172.21.15.123:0/2113541692 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fae5c0b5080 0x7fae5c0b5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.014+0000 7fae59d9b640 1 -- 172.21.15.123:0/2113541692 >> v1:172.21.15.188:6789/0 conn(0x7fae5c145ed0 legacy=0x7fae5c073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:23.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.014+0000 7fae59d9b640 1 -- 172.21.15.123:0/2113541692 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae5c0b4880 con 0x7fae5c073890 2024-09-15T23:14:23.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.014+0000 7fae59d9b640 1 -- 172.21.15.123:0/2113541692 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fae44001690 con 0x7fae5c073890 2024-09-15T23:14:23.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.014+0000 7fae59d9b640 1 -- 172.21.15.123:0/2113541692 >> v1:172.21.15.123:6789/0 conn(0x7fae5c073890 legacy=0x7fae5c0b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:23.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.014+0000 7fae59d9b640 1 --2- 172.21.15.123:0/2113541692 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fae5c0b5080 0x7fae480039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:23.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.014+0000 7fae59d9b640 1 --2- 172.21.15.123:0/2113541692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae48003f60 0x7fae48004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:23.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.014+0000 7fae59d9b640 1 --2- 172.21.15.123:0/2113541692 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fae48004d40 0x7fae480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:23.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.014+0000 7fae59d9b640 1 -- 172.21.15.123:0/2113541692 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fae5c0b45a0 con 0x7fae48003f60 2024-09-15T23:14:23.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.014+0000 7fae59d9b640 1 -- 172.21.15.123:0/2113541692 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fae4800bb30 con 0x7fae48004d40 2024-09-15T23:14:23.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.014+0000 7fae59d9b640 1 -- 172.21.15.123:0/2113541692 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fae4800bd30 con 0x7fae5c0b5080 2024-09-15T23:14:23.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.014+0000 7fae51d9b640 1 --2- 172.21.15.123:0/2113541692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae48003f60 0x7fae48004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:23.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.015+0000 7fae5a59c640 1 --2- 172.21.15.123:0/2113541692 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fae5c0b5080 0x7fae480039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:23.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.015+0000 7fae5ad9d640 1 --2- 172.21.15.123:0/2113541692 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fae48004d40 0x7fae480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:23.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.015+0000 7fae51d9b640 1 -- 172.21.15.123:0/2113541692 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fae5c0b5080 msgr2=0x7fae480039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:23.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.015+0000 7fae51d9b640 1 --2- 172.21.15.123:0/2113541692 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fae5c0b5080 0x7fae480039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.015+0000 7fae51d9b640 1 -- 172.21.15.123:0/2113541692 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fae48004d40 msgr2=0x7fae480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:23.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.015+0000 7fae51d9b640 1 --2- 172.21.15.123:0/2113541692 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fae48004d40 0x7fae480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.015+0000 7fae51d9b640 1 -- 172.21.15.123:0/2113541692 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae48003520 con 0x7fae48003f60 2024-09-15T23:14:23.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.015+0000 7fae51d9b640 1 --2- 172.21.15.123:0/2113541692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae48003f60 0x7fae48004800 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fae4400c210 tx=0x7fae48005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ee73321fdfff1a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:23.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.016+0000 7fae59d9b640 1 -- 172.21.15.123:0/2113541692 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae44007d10 con 0x7fae48003f60 2024-09-15T23:14:23.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.016+0000 7fae59d9b640 1 -- 172.21.15.123:0/2113541692 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae44005ad0 con 0x7fae48003f60 2024-09-15T23:14:23.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.016+0000 7fae59d9b640 1 -- 172.21.15.123:0/2113541692 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae44007070 con 0x7fae48003f60 2024-09-15T23:14:23.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.016+0000 7fae60b49640 1 -- 172.21.15.123:0/2113541692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae48003f60 msgr2=0x7fae48004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:23.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.016+0000 7fae60b49640 1 --2- 172.21.15.123:0/2113541692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae48003f60 0x7fae48004800 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fae4400c210 tx=0x7fae48005830 comp rx=0 tx=0).stop 2024-09-15T23:14:23.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.016+0000 7fae5ad9d640 1 -- 172.21.15.123:0/2113541692 reap_dead start 2024-09-15T23:14:23.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.016+0000 7fae60b49640 1 -- 172.21.15.123:0/2113541692 shutdown_connections 2024-09-15T23:14:23.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.016+0000 7fae60b49640 1 -- 172.21.15.123:0/2113541692 >> 172.21.15.123:0/2113541692 conn(0x7fae5c0ccec0 msgr2=0x7fae5c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:23.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.016+0000 7fae60b49640 1 -- 172.21.15.123:0/2113541692 shutdown_connections 2024-09-15T23:14:23.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.016+0000 7fae60b49640 1 -- 172.21.15.123:0/2113541692 wait complete. 2024-09-15T23:14:23.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.018+0000 7fae60b49640 1 Processor -- start 2024-09-15T23:14:23.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.018+0000 7fae60b49640 1 -- start start 2024-09-15T23:14:23.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.018+0000 7fae60b49640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fae48003f60 0x7fae5c1f2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:23.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.018+0000 7fae60b49640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae5c0c6470 0x7fae5c0c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:23.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.018+0000 7fae60b49640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fae5c0c68f0 0x7fae5c0c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:23.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.018+0000 7fae60b49640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fae5c146430 con 0x7fae5c0c6470 2024-09-15T23:14:23.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.018+0000 7fae60b49640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fae5c1462b0 con 0x7fae5c0c68f0 2024-09-15T23:14:23.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.018+0000 7fae60b49640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fae5c0b5f90 con 0x7fae48003f60 2024-09-15T23:14:23.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.018+0000 7fae51d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae5c0c6470 0x7fae5c0c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:23.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.018+0000 7fae51d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae5c0c6470 0x7fae5c0c8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55118/0 (socket says 172.21.15.123:55118) 2024-09-15T23:14:23.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.018+0000 7fae51d9b640 1 -- 172.21.15.123:0/1385309581 learned_addr learned my addr 172.21.15.123:0/1385309581 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:23.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.019+0000 7fae5a59c640 1 --2- 172.21.15.123:0/1385309581 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fae48003f60 0x7fae5c1f2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:23.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.019+0000 7fae5ad9d640 1 --2- 172.21.15.123:0/1385309581 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fae5c0c68f0 0x7fae5c0c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:23.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.019+0000 7fae51d9b640 1 -- 172.21.15.123:0/1385309581 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fae48003f60 msgr2=0x7fae5c1f2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:23.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.019+0000 7fae51d9b640 1 --2- 172.21.15.123:0/1385309581 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fae48003f60 0x7fae5c1f2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.019+0000 7fae51d9b640 1 -- 172.21.15.123:0/1385309581 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fae5c0c68f0 msgr2=0x7fae5c0c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:23.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.019+0000 7fae51d9b640 1 --2- 172.21.15.123:0/1385309581 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fae5c0c68f0 0x7fae5c0c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.019+0000 7fae51d9b640 1 -- 172.21.15.123:0/1385309581 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae5c0c6ec0 con 0x7fae5c0c6470 2024-09-15T23:14:23.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.019+0000 7fae51d9b640 1 --2- 172.21.15.123:0/1385309581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae5c0c6470 0x7fae5c0c8d30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fae4400c330 tx=0x7fae5c0c6400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:23.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.019+0000 7fae537fe640 1 -- 172.21.15.123:0/1385309581 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae44040020 con 0x7fae5c0c6470 2024-09-15T23:14:23.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.019+0000 7fae537fe640 1 -- 172.21.15.123:0/1385309581 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae44001450 con 0x7fae5c0c6470 2024-09-15T23:14:23.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.019+0000 7fae60b49640 1 -- 172.21.15.123:0/1385309581 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae5c0c71a0 con 0x7fae5c0c6470 2024-09-15T23:14:23.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.019+0000 7fae537fe640 1 -- 172.21.15.123:0/1385309581 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae44037040 con 0x7fae5c0c6470 2024-09-15T23:14:23.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.019+0000 7fae60b49640 1 -- 172.21.15.123:0/1385309581 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae5c0c7760 con 0x7fae5c0c6470 2024-09-15T23:14:23.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.020+0000 7fae60b49640 1 -- 172.21.15.123:0/1385309581 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae5c0b62e0 con 0x7fae5c0c6470 2024-09-15T23:14:23.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.020+0000 7fae537fe640 1 -- 172.21.15.123:0/1385309581 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fae44043020 con 0x7fae5c0c6470 2024-09-15T23:14:23.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.021+0000 7fae537fe640 1 --2- 172.21.15.123:0/1385309581 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fae3c06c2e0 0x7fae3c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:23.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.021+0000 7fae537fe640 1 -- 172.21.15.123:0/1385309581 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5853+0+0 (secure 0 0 0) 0x7fae440aa7b0 con 0x7fae5c0c6470 2024-09-15T23:14:23.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.021+0000 7fae5a59c640 1 --2- 172.21.15.123:0/1385309581 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fae3c06c2e0 0x7fae3c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:23.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.022+0000 7fae5a59c640 1 --2- 172.21.15.123:0/1385309581 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fae3c06c2e0 0x7fae3c06e7a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fae4c0017e0 tx=0x7fae4c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:23.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.025+0000 7fae537fe640 1 -- 172.21.15.123:0/1385309581 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fae44005aa0 con 0x7fae5c0c6470 2024-09-15T23:14:23.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.189+0000 7fae60b49640 1 -- 172.21.15.123:0/1385309581 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fae5c1446f0 con 0x7fae5c0c6470 2024-09-15T23:14:23.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.191+0000 7fae537fe640 1 -- 172.21.15.123:0/1385309581 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+17007 (secure 0 0 0) 0x7fae44078840 con 0x7fae5c0c6470 2024-09-15T23:14:23.192 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:14:23.192 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":40,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:13:59.234815+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:12:49.560175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-15T23:12:50.754784+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":34,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.0","mappings":[{"from":4,"to":5}]},{"pgid":"5.23","mappings":[{"from":4,"to":5}]},{"pgid":"5.35","mappings":[{"from":4,"to":5}]},{"pgid":"5.3c","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:14:23.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.192+0000 7fae60b49640 1 -- 172.21.15.123:0/1385309581 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fae3c06c2e0 msgr2=0x7fae3c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:23.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.193+0000 7fae60b49640 1 --2- 172.21.15.123:0/1385309581 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fae3c06c2e0 0x7fae3c06e7a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fae4c0017e0 tx=0x7fae4c009040 comp rx=0 tx=0).stop 2024-09-15T23:14:23.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.193+0000 7fae60b49640 1 -- 172.21.15.123:0/1385309581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae5c0c6470 msgr2=0x7fae5c0c8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:23.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.193+0000 7fae60b49640 1 --2- 172.21.15.123:0/1385309581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae5c0c6470 0x7fae5c0c8d30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fae4400c330 tx=0x7fae5c0c6400 comp rx=0 tx=0).stop 2024-09-15T23:14:23.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.193+0000 7fae60b49640 1 -- 172.21.15.123:0/1385309581 shutdown_connections 2024-09-15T23:14:23.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.193+0000 7fae60b49640 1 --2- 172.21.15.123:0/1385309581 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fae5c0c68f0 0x7fae5c0c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.193+0000 7fae60b49640 1 --2- 172.21.15.123:0/1385309581 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fae3c06c2e0 0x7fae3c06e7a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.193+0000 7fae60b49640 1 --2- 172.21.15.123:0/1385309581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae5c0c6470 0x7fae5c0c8d30 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.193+0000 7fae60b49640 1 --2- 172.21.15.123:0/1385309581 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fae48003f60 0x7fae5c1f2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.193+0000 7fae60b49640 1 -- 172.21.15.123:0/1385309581 >> 172.21.15.123:0/1385309581 conn(0x7fae5c0ccec0 msgr2=0x7fae5c143d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:23.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.193+0000 7fae60b49640 1 -- 172.21.15.123:0/1385309581 shutdown_connections 2024-09-15T23:14:23.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.193+0000 7fae60b49640 1 -- 172.21.15.123:0/1385309581 wait complete. 2024-09-15T23:14:23.205 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T23:14:23.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.302+0000 7f7487d5f640 1 Processor -- start 2024-09-15T23:14:23.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.302+0000 7f7487d5f640 1 -- start start 2024-09-15T23:14:23.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.303+0000 7f7487d5f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f748006f240 0x7f74800b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:23.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.303+0000 7f7487d5f640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f748015bbc0 con 0x7f74800b73c0 2024-09-15T23:14:23.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.303+0000 7f7487d5f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74800cfec0 con 0x7f748015b7e0 2024-09-15T23:14:23.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.303+0000 7f7487d5f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f748006e1a0 con 0x7f748006f240 2024-09-15T23:14:23.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.303+0000 7f74852fa640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f748006f240 0x7f74800b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:23.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.303+0000 7f74862fc640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f74800b73c0 0x7f74800b48f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38164/0 (socket says 172.21.15.123:38164) 2024-09-15T23:14:23.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.303+0000 7f74862fc640 1 -- 172.21.15.123:0/1610334480 learned_addr learned my addr 172.21.15.123:0/1610334480 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:23.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.303+0000 7f74852fa640 1 -- 172.21.15.123:0/1610334480 >> v1:172.21.15.188:6789/0 conn(0x7f748015b7e0 legacy=0x7f748006eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:23.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.303+0000 7f74852fa640 1 -- 172.21.15.123:0/1610334480 >> v1:172.21.15.123:6789/0 conn(0x7f74800b73c0 legacy=0x7f74800b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:23.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.303+0000 7f74852fa640 1 -- 172.21.15.123:0/1610334480 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f748006e480 con 0x7f748006f240 2024-09-15T23:14:23.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.303+0000 7f7484af9640 1 -- 172.21.15.123:0/1610334480 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 53389868 0 0) 0x7f748015bbc0 con 0x7f74800b73c0 2024-09-15T23:14:23.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.304+0000 7f74852fa640 1 --2- 172.21.15.123:0/1610334480 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f748006f240 0x7f74800b3f00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f747000ba40 tx=0x7f747002c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c8d95a09480bd9c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:23.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.304+0000 7f7484af9640 1 -- 172.21.15.123:0/1610334480 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7470036020 con 0x7f748006f240 2024-09-15T23:14:23.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.304+0000 7f7484af9640 1 -- 172.21.15.123:0/1610334480 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7470032870 con 0x7f748006f240 2024-09-15T23:14:23.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.304+0000 7f7484af9640 1 -- 172.21.15.123:0/1610334480 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7470032c40 con 0x7f748006f240 2024-09-15T23:14:23.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.305+0000 7f7487d5f640 1 -- 172.21.15.123:0/1610334480 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f748006f240 msgr2=0x7f74800b3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:23.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.305+0000 7f7487d5f640 1 --2- 172.21.15.123:0/1610334480 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f748006f240 0x7f74800b3f00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f747000ba40 tx=0x7f747002c970 comp rx=0 tx=0).stop 2024-09-15T23:14:23.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.305+0000 7f7487d5f640 1 -- 172.21.15.123:0/1610334480 shutdown_connections 2024-09-15T23:14:23.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.305+0000 7f7487d5f640 1 --2- 172.21.15.123:0/1610334480 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f748006f240 0x7f74800b3f00 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.305+0000 7f7487d5f640 1 -- 172.21.15.123:0/1610334480 >> 172.21.15.123:0/1610334480 conn(0x7f74800b3360 msgr2=0x7f74800b3740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:23.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.305+0000 7f7487d5f640 1 -- 172.21.15.123:0/1610334480 shutdown_connections 2024-09-15T23:14:23.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.305+0000 7f7487d5f640 1 -- 172.21.15.123:0/1610334480 wait complete. 2024-09-15T23:14:23.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.306+0000 7f7487d5f640 1 Processor -- start 2024-09-15T23:14:23.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.306+0000 7f7487d5f640 1 -- start start 2024-09-15T23:14:23.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.307+0000 7f7487d5f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f748006f240 0x7f748014a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:23.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.307+0000 7f7487d5f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f74800b73c0 0x7f748015c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:23.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.307+0000 7f7487d5f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f748015b7e0 0x7f74800aa460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:23.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.307+0000 7f7487d5f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f74800d1160 con 0x7f748015b7e0 2024-09-15T23:14:23.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.307+0000 7f7487d5f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f74800d0440 con 0x7f74800b73c0 2024-09-15T23:14:23.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.307+0000 7f7487d5f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f74800b5000 con 0x7f748006f240 2024-09-15T23:14:23.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.307+0000 7f74862fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f748015b7e0 0x7f74800aa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:23.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.307+0000 7f74862fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f748015b7e0 0x7f74800aa460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55136/0 (socket says 172.21.15.123:55136) 2024-09-15T23:14:23.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.307+0000 7f74862fc640 1 -- 172.21.15.123:0/720170076 learned_addr learned my addr 172.21.15.123:0/720170076 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:23.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.307+0000 7f74852fa640 1 --2- 172.21.15.123:0/720170076 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f74800b73c0 0x7f748015c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:23.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.307+0000 7f7485afb640 1 --2- 172.21.15.123:0/720170076 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f748006f240 0x7f748014a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:23.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.307+0000 7f74862fc640 1 -- 172.21.15.123:0/720170076 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f748006f240 msgr2=0x7f748014a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:23.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.307+0000 7f74862fc640 1 --2- 172.21.15.123:0/720170076 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f748006f240 0x7f748014a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.307+0000 7f74862fc640 1 -- 172.21.15.123:0/720170076 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f74800b73c0 msgr2=0x7f748015c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:23.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.307+0000 7f74862fc640 1 --2- 172.21.15.123:0/720170076 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f74800b73c0 0x7f748015c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.307+0000 7f74862fc640 1 -- 172.21.15.123:0/720170076 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f748015cd20 con 0x7f748015b7e0 2024-09-15T23:14:23.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.307+0000 7f74862fc640 1 --2- 172.21.15.123:0/720170076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f748015b7e0 0x7f74800aa460 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f747800c800 tx=0x7f747800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:23.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.307+0000 7f74767fc640 1 -- 172.21.15.123:0/720170076 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7478018070 con 0x7f748015b7e0 2024-09-15T23:14:23.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.307+0000 7f74767fc640 1 -- 172.21.15.123:0/720170076 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7478004d80 con 0x7f748015b7e0 2024-09-15T23:14:23.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.307+0000 7f74767fc640 1 -- 172.21.15.123:0/720170076 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747800a880 con 0x7f748015b7e0 2024-09-15T23:14:23.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.307+0000 7f7487d5f640 1 -- 172.21.15.123:0/720170076 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f748015d000 con 0x7f748015b7e0 2024-09-15T23:14:23.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.307+0000 7f7487d5f640 1 -- 172.21.15.123:0/720170076 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f748015d8a0 con 0x7f748015b7e0 2024-09-15T23:14:23.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.308+0000 7f7487d5f640 1 -- 172.21.15.123:0/720170076 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74800b0e50 con 0x7f748015b7e0 2024-09-15T23:14:23.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.309+0000 7f74767fc640 1 -- 172.21.15.123:0/720170076 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f747801b070 con 0x7f748015b7e0 2024-09-15T23:14:23.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.309+0000 7f74767fc640 1 --2- 172.21.15.123:0/720170076 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f746406c2e0 0x7f746406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:23.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.309+0000 7f74767fc640 1 -- 172.21.15.123:0/720170076 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 5853+0+0 (secure 0 0 0) 0x7f747808aa30 con 0x7f748015b7e0 2024-09-15T23:14:23.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.309+0000 7f7485afb640 1 --2- 172.21.15.123:0/720170076 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f746406c2e0 0x7f746406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:23.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.310+0000 7f7485afb640 1 --2- 172.21.15.123:0/720170076 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f746406c2e0 0x7f746406e7a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f747c000f60 tx=0x7f747c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:23.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.314+0000 7f74767fc640 1 -- 172.21.15.123:0/720170076 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7478058af0 con 0x7f748015b7e0 2024-09-15T23:14:23.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.513+0000 7f7487d5f640 1 -- 172.21.15.123:0/720170076 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f748015d1d0 con 0x7f748015b7e0 2024-09-15T23:14:23.515 INFO:tasks.ceph.mon.a.smithi123.stderr:2024-09-15T23:14:23.514+0000 7f8a6ccf0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:14:23.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.515+0000 7f74767fc640 1 -- 172.21.15.123:0/720170076 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v15) ==== 161+0+0 (secure 0 0 0) 0x7f747805cdf0 con 0x7f748015b7e0 2024-09-15T23:14:23.516 INFO:teuthology.orchestra.run.smithi123.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T23:14:23.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.518+0000 7f7487d5f640 1 -- 172.21.15.123:0/720170076 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f746406c2e0 msgr2=0x7f746406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:23.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.518+0000 7f7487d5f640 1 --2- 172.21.15.123:0/720170076 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f746406c2e0 0x7f746406e7a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f747c000f60 tx=0x7f747c009040 comp rx=0 tx=0).stop 2024-09-15T23:14:23.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.518+0000 7f7487d5f640 1 -- 172.21.15.123:0/720170076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f748015b7e0 msgr2=0x7f74800aa460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:23.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.518+0000 7f7487d5f640 1 --2- 172.21.15.123:0/720170076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f748015b7e0 0x7f74800aa460 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f747800c800 tx=0x7f747800ccc0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.518+0000 7f7487d5f640 1 -- 172.21.15.123:0/720170076 shutdown_connections 2024-09-15T23:14:23.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.518+0000 7f7487d5f640 1 --2- 172.21.15.123:0/720170076 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f746406c2e0 0x7f746406e7a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.518+0000 7f7487d5f640 1 --2- 172.21.15.123:0/720170076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f748015b7e0 0x7f74800aa460 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.518+0000 7f7487d5f640 1 --2- 172.21.15.123:0/720170076 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f74800b73c0 0x7f748015c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.518+0000 7f7487d5f640 1 --2- 172.21.15.123:0/720170076 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f748006f240 0x7f748014a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.518+0000 7f7487d5f640 1 -- 172.21.15.123:0/720170076 >> 172.21.15.123:0/720170076 conn(0x7f74800b3360 msgr2=0x7f748015a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:23.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.518+0000 7f7487d5f640 1 -- 172.21.15.123:0/720170076 shutdown_connections 2024-09-15T23:14:23.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.518+0000 7f7487d5f640 1 -- 172.21.15.123:0/720170076 wait complete. 2024-09-15T23:14:23.532 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T23:14:23.562 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-15T23:14:23.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.633+0000 7fd2b8931640 1 Processor -- start 2024-09-15T23:14:23.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.633+0000 7fd2b8931640 1 -- start start 2024-09-15T23:14:23.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.633+0000 7fd2b8931640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd2b406bfd0 0x7fd2b406c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:23.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.633+0000 7fd2b8931640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2b41631c0 con 0x7fd2b40b3350 2024-09-15T23:14:23.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.633+0000 7fd2b8931640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2b406c8f0 con 0x7fd2b40d3930 2024-09-15T23:14:23.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.633+0000 7fd2b8931640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fd2b40b78a0 con 0x7fd2b406bfd0 2024-09-15T23:14:23.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.633+0000 7fd2b259c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd2b406bfd0 0x7fd2b406c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:23.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.634+0000 7fd2abfff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd2b40b3350 0x7fd2b41623a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38174/0 (socket says 172.21.15.123:38174) 2024-09-15T23:14:23.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.634+0000 7fd2abfff640 1 -- 172.21.15.123:0/21348241 learned_addr learned my addr 172.21.15.123:0/21348241 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:23.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.634+0000 7fd2b259c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd2b406bfd0 0x7fd2b406c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55168/0 (socket says 172.21.15.123:55168) 2024-09-15T23:14:23.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.634+0000 7fd2b259c640 1 -- 172.21.15.123:0/21348241 >> v1:172.21.15.188:6789/0 conn(0x7fd2b40d3930 legacy=0x7fd2b4162ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:23.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.634+0000 7fd2b259c640 1 -- 172.21.15.123:0/21348241 >> v1:172.21.15.123:6789/0 conn(0x7fd2b40b3350 legacy=0x7fd2b41623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:23.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.634+0000 7fd2b259c640 1 -- 172.21.15.123:0/21348241 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b40cf710 con 0x7fd2b406bfd0 2024-09-15T23:14:23.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.634+0000 7fd2b259c640 1 --2- 172.21.15.123:0/21348241 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2b406bfd0 0x7fd2b406c3b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd2a40097a0 tx=0x7fd2a402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1a3e973d9daed00 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:23.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.635+0000 7fd2b1d9b640 1 -- 172.21.15.123:0/21348241 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4037070 con 0x7fd2b406bfd0 2024-09-15T23:14:23.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.635+0000 7fd2b1d9b640 1 -- 172.21.15.123:0/21348241 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a4032440 con 0x7fd2b406bfd0 2024-09-15T23:14:23.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.635+0000 7fd2b1d9b640 1 -- 172.21.15.123:0/21348241 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4032810 con 0x7fd2b406bfd0 2024-09-15T23:14:23.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.635+0000 7fd2b8931640 1 -- 172.21.15.123:0/21348241 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2b406bfd0 msgr2=0x7fd2b406c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:23.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.635+0000 7fd2b8931640 1 --2- 172.21.15.123:0/21348241 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2b406bfd0 0x7fd2b406c3b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd2a40097a0 tx=0x7fd2a402a1e0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.635+0000 7fd2b8931640 1 -- 172.21.15.123:0/21348241 shutdown_connections 2024-09-15T23:14:23.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.635+0000 7fd2b8931640 1 --2- 172.21.15.123:0/21348241 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2b406bfd0 0x7fd2b406c3b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.635+0000 7fd2b8931640 1 -- 172.21.15.123:0/21348241 >> 172.21.15.123:0/21348241 conn(0x7fd2b40d11c0 msgr2=0x7fd2b40d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:23.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.635+0000 7fd2b8931640 1 -- 172.21.15.123:0/21348241 shutdown_connections 2024-09-15T23:14:23.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.635+0000 7fd2b8931640 1 -- 172.21.15.123:0/21348241 wait complete. 2024-09-15T23:14:23.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.637+0000 7fd2b8931640 1 Processor -- start 2024-09-15T23:14:23.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.637+0000 7fd2b8931640 1 -- start start 2024-09-15T23:14:23.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.637+0000 7fd2b8931640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd2b406bfd0 0x7fd2b40ce450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:23.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.637+0000 7fd2b8931640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2b40b3350 0x7fd2b40cb780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:23.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.637+0000 7fd2b8931640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd2b40d3930 0x7fd2b4159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:23.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.637+0000 7fd2b8931640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b40cfcd0 con 0x7fd2b40b3350 2024-09-15T23:14:23.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.637+0000 7fd2b8931640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b40cffb0 con 0x7fd2b40d3930 2024-09-15T23:14:23.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.637+0000 7fd2b8931640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd2b40d2400 con 0x7fd2b406bfd0 2024-09-15T23:14:23.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.637+0000 7fd2abfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2b40b3350 0x7fd2b40cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:23.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.637+0000 7fd2abfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2b40b3350 0x7fd2b40cb780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55180/0 (socket says 172.21.15.123:55180) 2024-09-15T23:14:23.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.637+0000 7fd2abfff640 1 -- 172.21.15.123:0/2019982626 learned_addr learned my addr 172.21.15.123:0/2019982626 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:23.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.638+0000 7fd2abfff640 1 -- 172.21.15.123:0/2019982626 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd2b406bfd0 msgr2=0x7fd2b40ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:23.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.638+0000 7fd2abfff640 1 --2- 172.21.15.123:0/2019982626 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd2b406bfd0 0x7fd2b40ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.638+0000 7fd2abfff640 1 -- 172.21.15.123:0/2019982626 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd2b40d3930 msgr2=0x7fd2b4159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:23.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.638+0000 7fd2abfff640 1 --2- 172.21.15.123:0/2019982626 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd2b40d3930 0x7fd2b4159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:23.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.638+0000 7fd2abfff640 1 -- 172.21.15.123:0/2019982626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b40cbf00 con 0x7fd2b40b3350 2024-09-15T23:14:23.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.638+0000 7fd2abfff640 1 --2- 172.21.15.123:0/2019982626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2b40b3350 0x7fd2b40cb780 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd29c00c400 tx=0x7fd29c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:23.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.638+0000 7fd2aaffd640 1 -- 172.21.15.123:0/2019982626 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c017070 con 0x7fd2b40b3350 2024-09-15T23:14:23.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.638+0000 7fd2aaffd640 1 -- 172.21.15.123:0/2019982626 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd29c005ce0 con 0x7fd2b40b3350 2024-09-15T23:14:23.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.638+0000 7fd2aaffd640 1 -- 172.21.15.123:0/2019982626 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29c0072f0 con 0x7fd2b40b3350 2024-09-15T23:14:23.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.638+0000 7fd2b8931640 1 -- 172.21.15.123:0/2019982626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2b40cc1e0 con 0x7fd2b40b3350 2024-09-15T23:14:23.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.638+0000 7fd2b8931640 1 -- 172.21.15.123:0/2019982626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2b40cc7a0 con 0x7fd2b40b3350 2024-09-15T23:14:23.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.639+0000 7fd2b8931640 1 -- 172.21.15.123:0/2019982626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2b40ccb80 con 0x7fd2b40b3350 2024-09-15T23:14:23.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.639+0000 7fd2aaffd640 1 -- 172.21.15.123:0/2019982626 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd29c01a070 con 0x7fd2b40b3350 2024-09-15T23:14:23.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.640+0000 7fd2aaffd640 1 --2- 172.21.15.123:0/2019982626 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd29406c2b0 0x7fd29406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:23.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.640+0000 7fd2aaffd640 1 -- 172.21.15.123:0/2019982626 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5911+0+0 (secure 0 0 0) 0x7fd29c08a8a0 con 0x7fd2b40b3350 2024-09-15T23:14:23.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.640+0000 7fd2b259c640 1 --2- 172.21.15.123:0/2019982626 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd29406c2b0 0x7fd29406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:23.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.641+0000 7fd2b259c640 1 --2- 172.21.15.123:0/2019982626 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd29406c2b0 0x7fd29406e770 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4034000 tx=0x7fd2a402c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:23.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.644+0000 7fd2aaffd640 1 -- 172.21.15.123:0/2019982626 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd2b40ccb80 con 0x7fd2b40b3350 2024-09-15T23:14:23.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:23.846+0000 7fd2b8931640 1 -- 172.21.15.123:0/2019982626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fd2b40b3cd0 con 0x7fd2b40b3350 2024-09-15T23:14:24.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.524+0000 7fd2aaffd640 1 -- 172.21.15.123:0/2019982626 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v16) ==== 104+0+0 (secure 0 0 0) 0x7fd2b40b3cd0 con 0x7fd2b40b3350 2024-09-15T23:14:24.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.526+0000 7fd2b8931640 1 -- 172.21.15.123:0/2019982626 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd29406c2b0 msgr2=0x7fd29406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:24.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.526+0000 7fd2b8931640 1 --2- 172.21.15.123:0/2019982626 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd29406c2b0 0x7fd29406e770 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4034000 tx=0x7fd2a402c000 comp rx=0 tx=0).stop 2024-09-15T23:14:24.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.526+0000 7fd2b8931640 1 -- 172.21.15.123:0/2019982626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2b40b3350 msgr2=0x7fd2b40cb780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:24.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.526+0000 7fd2b8931640 1 --2- 172.21.15.123:0/2019982626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2b40b3350 0x7fd2b40cb780 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd29c00c400 tx=0x7fd29c00c8c0 comp rx=0 tx=0).stop 2024-09-15T23:14:24.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.526+0000 7fd2b8931640 1 -- 172.21.15.123:0/2019982626 shutdown_connections 2024-09-15T23:14:24.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.526+0000 7fd2b8931640 1 --2- 172.21.15.123:0/2019982626 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd2b40d3930 0x7fd2b4159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:24.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.526+0000 7fd2b8931640 1 --2- 172.21.15.123:0/2019982626 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd29406c2b0 0x7fd29406e770 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:24.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.526+0000 7fd2b8931640 1 --2- 172.21.15.123:0/2019982626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2b40b3350 0x7fd2b40cb780 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:24.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.526+0000 7fd2b8931640 1 --2- 172.21.15.123:0/2019982626 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd2b406bfd0 0x7fd2b40ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:24.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.526+0000 7fd2b8931640 1 -- 172.21.15.123:0/2019982626 >> 172.21.15.123:0/2019982626 conn(0x7fd2b40d11c0 msgr2=0x7fd2b40ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:24.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.527+0000 7fd2b8931640 1 -- 172.21.15.123:0/2019982626 shutdown_connections 2024-09-15T23:14:24.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.527+0000 7fd2b8931640 1 -- 172.21.15.123:0/2019982626 wait complete. 2024-09-15T23:14:24.539 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T23:14:24.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.681+0000 7fe19c8a5640 1 Processor -- start 2024-09-15T23:14:24.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.681+0000 7fe19c8a5640 1 -- start start 2024-09-15T23:14:24.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.682+0000 7fe19c8a5640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe1981454b0 0x7fe1980b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:24.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.682+0000 7fe19c8a5640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe1980b0e50 0x7fe1980b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:24.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.682+0000 7fe19c8a5640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe198146220 con 0x7fe1981459a0 2024-09-15T23:14:24.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.682+0000 7fe19c8a5640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fe1980b1920 con 0x7fe1981454b0 2024-09-15T23:14:24.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.682+0000 7fe19c8a5640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe1980cf640 con 0x7fe1980b0e50 2024-09-15T23:14:24.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.682+0000 7fe196d9d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe1980b0e50 0x7fe1980b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:24.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.682+0000 7fe196d9d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe1980b0e50 0x7fe1980b5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:45034/0 (socket says 172.21.15.123:45034) 2024-09-15T23:14:24.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.682+0000 7fe195d9b640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fe1981459a0 0x7fe1980b1db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:40384/0 (socket says 172.21.15.123:40384) 2024-09-15T23:14:24.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.682+0000 7fe196d9d640 1 -- 172.21.15.123:0/423591515 learned_addr learned my addr 172.21.15.123:0/423591515 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:24.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.682+0000 7fe19659c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe1981454b0 0x7fe1980b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:24.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.682+0000 7fe19559a640 1 -- 172.21.15.123:0/423591515 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 879135693 0 0) 0x7fe180001110 con 0x7fe1981459a0 2024-09-15T23:14:24.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.682+0000 7fe19559a640 1 -- 172.21.15.123:0/423591515 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe184003520 con 0x7fe1981459a0 2024-09-15T23:14:24.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.682+0000 7fe196d9d640 1 -- 172.21.15.123:0/423591515 >> v2:172.21.15.188:3300/0 conn(0x7fe1981454b0 msgr2=0x7fe1980b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:24.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.682+0000 7fe196d9d640 1 --2- 172.21.15.123:0/423591515 >> v2:172.21.15.188:3300/0 conn(0x7fe1981454b0 0x7fe1980b58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:24.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.682+0000 7fe196d9d640 1 -- 172.21.15.123:0/423591515 >> v1:172.21.15.188:6789/0 conn(0x7fe1981459a0 legacy=0x7fe1980b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:24.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.683+0000 7fe196d9d640 1 -- 172.21.15.123:0/423591515 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1980cf8e0 con 0x7fe1980b0e50 2024-09-15T23:14:24.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.683+0000 7fe19659c640 1 --2- 172.21.15.123:0/423591515 >> v2:172.21.15.188:3300/0 conn(0x7fe1981454b0 0x7fe1980b58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:14:24.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.683+0000 7fe196d9d640 1 --2- 172.21.15.123:0/423591515 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe1980b0e50 0x7fe1980b5e30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe190009870 tx=0x7fe19002a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ed2c1eba229ee9e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:24.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.683+0000 7fe19559a640 1 -- 172.21.15.123:0/423591515 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe190037070 con 0x7fe1980b0e50 2024-09-15T23:14:24.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.683+0000 7fe19559a640 1 -- 172.21.15.123:0/423591515 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe19002ae50 con 0x7fe1980b0e50 2024-09-15T23:14:24.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.683+0000 7fe19559a640 1 -- 172.21.15.123:0/423591515 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe190032860 con 0x7fe1980b0e50 2024-09-15T23:14:24.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.684+0000 7fe19c8a5640 1 -- 172.21.15.123:0/423591515 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe1980b0e50 msgr2=0x7fe1980b5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:24.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.684+0000 7fe19c8a5640 1 --2- 172.21.15.123:0/423591515 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe1980b0e50 0x7fe1980b5e30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe190009870 tx=0x7fe19002a300 comp rx=0 tx=0).stop 2024-09-15T23:14:24.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.684+0000 7fe19c8a5640 1 -- 172.21.15.123:0/423591515 shutdown_connections 2024-09-15T23:14:24.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.684+0000 7fe19c8a5640 1 --2- 172.21.15.123:0/423591515 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe1980b0e50 0x7fe1980b5e30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:24.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.684+0000 7fe19c8a5640 1 --2- 172.21.15.123:0/423591515 >> v2:172.21.15.188:3300/0 conn(0x7fe1981454b0 0x7fe1980b58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:24.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.684+0000 7fe19c8a5640 1 -- 172.21.15.123:0/423591515 >> 172.21.15.123:0/423591515 conn(0x7fe19806c240 msgr2=0x7fe19806d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:24.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.684+0000 7fe19c8a5640 1 -- 172.21.15.123:0/423591515 shutdown_connections 2024-09-15T23:14:24.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.684+0000 7fe19c8a5640 1 -- 172.21.15.123:0/423591515 wait complete. 2024-09-15T23:14:24.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.685+0000 7fe19c8a5640 1 Processor -- start 2024-09-15T23:14:24.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.685+0000 7fe19c8a5640 1 -- start start 2024-09-15T23:14:24.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.686+0000 7fe19c8a5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1980b0e50 0x7fe1981e65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:24.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.686+0000 7fe19c8a5640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe1981454b0 0x7fe19815bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:24.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.686+0000 7fe19c8a5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1981459a0 0x7fe19815c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:24.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.686+0000 7fe19c8a5640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe1980d0180 con 0x7fe1980b0e50 2024-09-15T23:14:24.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.686+0000 7fe19c8a5640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe1980cfea0 con 0x7fe1981459a0 2024-09-15T23:14:24.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.686+0000 7fe19c8a5640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe1980b24c0 con 0x7fe1981454b0 2024-09-15T23:14:24.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.686+0000 7fe19659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1980b0e50 0x7fe1981e65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:24.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.686+0000 7fe19659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1980b0e50 0x7fe1981e65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55196/0 (socket says 172.21.15.123:55196) 2024-09-15T23:14:24.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.686+0000 7fe19659c640 1 -- 172.21.15.123:0/1368001461 learned_addr learned my addr 172.21.15.123:0/1368001461 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:24.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.686+0000 7fe196d9d640 1 --2- 172.21.15.123:0/1368001461 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1981459a0 0x7fe19815c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:24.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.686+0000 7fe195d9b640 1 --2- 172.21.15.123:0/1368001461 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe1981454b0 0x7fe19815bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:24.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.687+0000 7fe19659c640 1 -- 172.21.15.123:0/1368001461 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe1981454b0 msgr2=0x7fe19815bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:24.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.687+0000 7fe19659c640 1 --2- 172.21.15.123:0/1368001461 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe1981454b0 0x7fe19815bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:24.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.687+0000 7fe19659c640 1 -- 172.21.15.123:0/1368001461 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1981459a0 msgr2=0x7fe19815c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:24.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.687+0000 7fe19659c640 1 --2- 172.21.15.123:0/1368001461 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1981459a0 0x7fe19815c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:24.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.687+0000 7fe19659c640 1 -- 172.21.15.123:0/1368001461 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe19813dad0 con 0x7fe1980b0e50 2024-09-15T23:14:24.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.687+0000 7fe195d9b640 1 --2- 172.21.15.123:0/1368001461 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe1981454b0 0x7fe19815bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:24.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.687+0000 7fe19659c640 1 --2- 172.21.15.123:0/1368001461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1980b0e50 0x7fe1981e65f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe18800efc0 tx=0x7fe18800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:24.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.687+0000 7fe18effd640 1 -- 172.21.15.123:0/1368001461 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe188018020 con 0x7fe1980b0e50 2024-09-15T23:14:24.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.687+0000 7fe19c8a5640 1 -- 172.21.15.123:0/1368001461 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe198140a50 con 0x7fe1980b0e50 2024-09-15T23:14:24.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.687+0000 7fe18effd640 1 -- 172.21.15.123:0/1368001461 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe188014680 con 0x7fe1980b0e50 2024-09-15T23:14:24.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.687+0000 7fe18effd640 1 -- 172.21.15.123:0/1368001461 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe188014a50 con 0x7fe1980b0e50 2024-09-15T23:14:24.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.687+0000 7fe19c8a5640 1 -- 172.21.15.123:0/1368001461 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe19813e050 con 0x7fe1980b0e50 2024-09-15T23:14:24.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.688+0000 7fe19c8a5640 1 -- 172.21.15.123:0/1368001461 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1980b1db0 con 0x7fe1980b0e50 2024-09-15T23:14:24.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.688+0000 7fe18effd640 1 -- 172.21.15.123:0/1368001461 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe188005d10 con 0x7fe1980b0e50 2024-09-15T23:14:24.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.689+0000 7fe18effd640 1 --2- 172.21.15.123:0/1368001461 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe17806c2b0 0x7fe17806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:24.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.689+0000 7fe18effd640 1 -- 172.21.15.123:0/1368001461 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 5911+0+0 (secure 0 0 0) 0x7fe18808c460 con 0x7fe1980b0e50 2024-09-15T23:14:24.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.689+0000 7fe195d9b640 1 --2- 172.21.15.123:0/1368001461 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe17806c2b0 0x7fe17806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:24.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.689+0000 7fe195d9b640 1 --2- 172.21.15.123:0/1368001461 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe17806c2b0 0x7fe17806e770 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe1981442f0 tx=0x7fe180009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:24.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.693+0000 7fe18effd640 1 -- 172.21.15.123:0/1368001461 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe188022030 con 0x7fe1980b0e50 2024-09-15T23:14:24.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:24.858+0000 7fe19c8a5640 1 -- 172.21.15.123:0/1368001461 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe1980cdd30 con 0x7fe1980b0e50 2024-09-15T23:14:25.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.527+0000 7fe18effd640 1 -- 172.21.15.123:0/1368001461 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v42) ==== 181+0+0 (secure 0 0 0) 0x7fe188010040 con 0x7fe1980b0e50 2024-09-15T23:14:25.529 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' removed 2024-09-15T23:14:25.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.530+0000 7fe19c8a5640 1 -- 172.21.15.123:0/1368001461 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe17806c2b0 msgr2=0x7fe17806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:25.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.530+0000 7fe19c8a5640 1 --2- 172.21.15.123:0/1368001461 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe17806c2b0 0x7fe17806e770 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe1981442f0 tx=0x7fe180009040 comp rx=0 tx=0).stop 2024-09-15T23:14:25.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.530+0000 7fe19c8a5640 1 -- 172.21.15.123:0/1368001461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1980b0e50 msgr2=0x7fe1981e65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:25.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.530+0000 7fe19c8a5640 1 --2- 172.21.15.123:0/1368001461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1980b0e50 0x7fe1981e65f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe18800efc0 tx=0x7fe18800c490 comp rx=0 tx=0).stop 2024-09-15T23:14:25.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.530+0000 7fe19c8a5640 1 -- 172.21.15.123:0/1368001461 shutdown_connections 2024-09-15T23:14:25.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.530+0000 7fe19c8a5640 1 --2- 172.21.15.123:0/1368001461 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1981459a0 0x7fe19815c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.530+0000 7fe19c8a5640 1 --2- 172.21.15.123:0/1368001461 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe1981454b0 0x7fe19815bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.530+0000 7fe19c8a5640 1 --2- 172.21.15.123:0/1368001461 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe17806c2b0 0x7fe17806e770 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.530+0000 7fe19c8a5640 1 --2- 172.21.15.123:0/1368001461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1980b0e50 0x7fe1981e65f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.530+0000 7fe19c8a5640 1 -- 172.21.15.123:0/1368001461 >> 172.21.15.123:0/1368001461 conn(0x7fe19806c240 msgr2=0x7fe198142fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:25.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.530+0000 7fe19c8a5640 1 -- 172.21.15.123:0/1368001461 shutdown_connections 2024-09-15T23:14:25.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.530+0000 7fe19c8a5640 1 -- 172.21.15.123:0/1368001461 wait complete. 2024-09-15T23:14:25.545 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T23:14:25.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.649+0000 7fe99c342640 1 Processor -- start 2024-09-15T23:14:25.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.649+0000 7fe99c342640 1 -- start start 2024-09-15T23:14:25.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.650+0000 7fe99c342640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe99415ea90 0x7fe9940d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:25.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.650+0000 7fe99c342640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe9940d40b0 0x7fe9940d0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:25.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.650+0000 7fe99c342640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe9940d1510 0x7fe9940b6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:25.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.650+0000 7fe99c342640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe9940d34c0 con 0x7fe9940d1510 2024-09-15T23:14:25.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.650+0000 7fe99c342640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fe9940d1960 con 0x7fe99415ea90 2024-09-15T23:14:25.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.650+0000 7fe99c342640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe9940cf060 con 0x7fe9940d40b0 2024-09-15T23:14:25.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.650+0000 7fe99a8df640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe9940d1510 0x7fe9940b6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:25.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.650+0000 7fe99a8df640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe9940d1510 0x7fe9940b6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55202/0 (socket says 172.21.15.123:55202) 2024-09-15T23:14:25.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.650+0000 7fe99a8df640 1 -- 172.21.15.123:0/1344033160 learned_addr learned my addr 172.21.15.123:0/1344033160 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:25.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.651+0000 7fe99a0de640 1 --2- 172.21.15.123:0/1344033160 >> v2:172.21.15.188:3300/0 conn(0x7fe99415ea90 0x7fe9940d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:25.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.651+0000 7fe9998dd640 1 --2- 172.21.15.123:0/1344033160 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe9940d40b0 0x7fe9940d0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:25.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.651+0000 7fe99a8df640 1 -- 172.21.15.123:0/1344033160 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe9940d40b0 msgr2=0x7fe9940d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:25.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.651+0000 7fe99a8df640 1 --2- 172.21.15.123:0/1344033160 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe9940d40b0 0x7fe9940d0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.651+0000 7fe99a8df640 1 -- 172.21.15.123:0/1344033160 >> v2:172.21.15.188:3300/0 conn(0x7fe99415ea90 msgr2=0x7fe9940d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:25.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.651+0000 7fe99a8df640 1 --2- 172.21.15.123:0/1344033160 >> v2:172.21.15.188:3300/0 conn(0x7fe99415ea90 0x7fe9940d2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.651+0000 7fe99a8df640 1 -- 172.21.15.123:0/1344033160 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9940cf340 con 0x7fe9940d1510 2024-09-15T23:14:25.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.651+0000 7fe99a8df640 1 --2- 172.21.15.123:0/1344033160 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9940d1510 0x7fe9940b6210 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe9940698a0 tx=0x7fe98c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=102c15dd3beebb1f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:25.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.652+0000 7fe9990dc640 1 -- 172.21.15.123:0/1344033160 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98c036070 con 0x7fe9940d1510 2024-09-15T23:14:25.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.652+0000 7fe9990dc640 1 -- 172.21.15.123:0/1344033160 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe98c031600 con 0x7fe9940d1510 2024-09-15T23:14:25.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.652+0000 7fe9990dc640 1 -- 172.21.15.123:0/1344033160 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98c0319d0 con 0x7fe9940d1510 2024-09-15T23:14:25.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.652+0000 7fe99c342640 1 -- 172.21.15.123:0/1344033160 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9940d1510 msgr2=0x7fe9940b6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:25.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.652+0000 7fe99c342640 1 --2- 172.21.15.123:0/1344033160 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9940d1510 0x7fe9940b6210 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe9940698a0 tx=0x7fe98c02a6a0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.652+0000 7fe99c342640 1 -- 172.21.15.123:0/1344033160 shutdown_connections 2024-09-15T23:14:25.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.652+0000 7fe99c342640 1 --2- 172.21.15.123:0/1344033160 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9940d1510 0x7fe9940b6210 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.652+0000 7fe99c342640 1 --2- 172.21.15.123:0/1344033160 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe9940d40b0 0x7fe9940d0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.652+0000 7fe99c342640 1 --2- 172.21.15.123:0/1344033160 >> v2:172.21.15.188:3300/0 conn(0x7fe99415ea90 0x7fe9940d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.652+0000 7fe99c342640 1 -- 172.21.15.123:0/1344033160 >> 172.21.15.123:0/1344033160 conn(0x7fe99406c0e0 msgr2=0x7fe99406c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:25.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.652+0000 7fe99c342640 1 -- 172.21.15.123:0/1344033160 shutdown_connections 2024-09-15T23:14:25.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.652+0000 7fe99c342640 1 -- 172.21.15.123:0/1344033160 wait complete. 2024-09-15T23:14:25.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.653+0000 7fe99c342640 1 Processor -- start 2024-09-15T23:14:25.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.653+0000 7fe99c342640 1 -- start start 2024-09-15T23:14:25.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.654+0000 7fe99c342640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9940d1510 0x7fe9940cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:25.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.654+0000 7fe99c342640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe9940d40b0 0x7fe9940cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:25.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.654+0000 7fe99c342640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe99415ea90 0x7fe9940c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:25.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.654+0000 7fe99c342640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe9940cfbe0 con 0x7fe9940d1510 2024-09-15T23:14:25.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.654+0000 7fe99c342640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe9940cf900 con 0x7fe99415ea90 2024-09-15T23:14:25.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.654+0000 7fe99c342640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe99415ee70 con 0x7fe9940d40b0 2024-09-15T23:14:25.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.654+0000 7fe99a0de640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9940d1510 0x7fe9940cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:25.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.654+0000 7fe99a0de640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9940d1510 0x7fe9940cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55208/0 (socket says 172.21.15.123:55208) 2024-09-15T23:14:25.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.654+0000 7fe99a0de640 1 -- 172.21.15.123:0/3416539331 learned_addr learned my addr 172.21.15.123:0/3416539331 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:25.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.654+0000 7fe9998dd640 1 --2- 172.21.15.123:0/3416539331 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe9940d40b0 0x7fe9940cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:25.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.654+0000 7fe99a8df640 1 --2- 172.21.15.123:0/3416539331 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe99415ea90 0x7fe9940c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:25.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.655+0000 7fe99a0de640 1 -- 172.21.15.123:0/3416539331 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe9940d40b0 msgr2=0x7fe9940cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:25.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.655+0000 7fe99a0de640 1 --2- 172.21.15.123:0/3416539331 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe9940d40b0 0x7fe9940cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.655+0000 7fe99a0de640 1 -- 172.21.15.123:0/3416539331 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe99415ea90 msgr2=0x7fe9940c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:25.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.655+0000 7fe99a0de640 1 --2- 172.21.15.123:0/3416539331 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe99415ea90 0x7fe9940c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:25.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.655+0000 7fe99a0de640 1 -- 172.21.15.123:0/3416539331 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9940ccdb0 con 0x7fe9940d1510 2024-09-15T23:14:25.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.655+0000 7fe99a8df640 1 --2- 172.21.15.123:0/3416539331 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe99415ea90 0x7fe9940c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:25.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.655+0000 7fe9998dd640 1 --2- 172.21.15.123:0/3416539331 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe9940d40b0 0x7fe9940cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:25.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.655+0000 7fe99a0de640 1 --2- 172.21.15.123:0/3416539331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9940d1510 0x7fe9940cbd30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe99000d5f0 tx=0x7fe99000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:25.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.655+0000 7fe98affd640 1 -- 172.21.15.123:0/3416539331 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9900125f0 con 0x7fe9940d1510 2024-09-15T23:14:25.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.655+0000 7fe98affd640 1 -- 172.21.15.123:0/3416539331 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe990019070 con 0x7fe9940d1510 2024-09-15T23:14:25.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.655+0000 7fe99c342640 1 -- 172.21.15.123:0/3416539331 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9940c9400 con 0x7fe9940d1510 2024-09-15T23:14:25.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.655+0000 7fe98affd640 1 -- 172.21.15.123:0/3416539331 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9900129d0 con 0x7fe9940d1510 2024-09-15T23:14:25.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.655+0000 7fe99c342640 1 -- 172.21.15.123:0/3416539331 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9940ccad0 con 0x7fe9940d1510 2024-09-15T23:14:25.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.656+0000 7fe99c342640 1 -- 172.21.15.123:0/3416539331 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9940d0fd0 con 0x7fe9940d1510 2024-09-15T23:14:25.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.656+0000 7fe98affd640 1 -- 172.21.15.123:0/3416539331 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe990012b70 con 0x7fe9940d1510 2024-09-15T23:14:25.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.657+0000 7fe98affd640 1 --2- 172.21.15.123:0/3416539331 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe97806c2b0 0x7fe97806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:25.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.657+0000 7fe98affd640 1 -- 172.21.15.123:0/3416539331 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5473+0+0 (secure 0 0 0) 0x7fe99008b6d0 con 0x7fe9940d1510 2024-09-15T23:14:25.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.657+0000 7fe9998dd640 1 --2- 172.21.15.123:0/3416539331 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe97806c2b0 0x7fe97806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:25.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.657+0000 7fe9998dd640 1 --2- 172.21.15.123:0/3416539331 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe97806c2b0 0x7fe97806e770 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe9940b6f00 tx=0x7fe984008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:25.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.661+0000 7fe98affd640 1 -- 172.21.15.123:0/3416539331 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe990059fb0 con 0x7fe9940d1510 2024-09-15T23:14:25.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:25.830+0000 7fe99c342640 1 -- 172.21.15.123:0/3416539331 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe9941605f0 con 0x7fe9940d1510 2024-09-15T23:14:26.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.535+0000 7fe98affd640 1 -- 172.21.15.123:0/3416539331 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v43) ==== 169+0+0 (secure 0 0 0) 0x7fe9900598b0 con 0x7fe9940d1510 2024-09-15T23:14:26.536 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' removed 2024-09-15T23:14:26.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.538+0000 7fe99c342640 1 -- 172.21.15.123:0/3416539331 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe97806c2b0 msgr2=0x7fe97806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:26.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.538+0000 7fe99c342640 1 --2- 172.21.15.123:0/3416539331 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe97806c2b0 0x7fe97806e770 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe9940b6f00 tx=0x7fe984008040 comp rx=0 tx=0).stop 2024-09-15T23:14:26.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.538+0000 7fe99c342640 1 -- 172.21.15.123:0/3416539331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9940d1510 msgr2=0x7fe9940cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:26.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.538+0000 7fe99c342640 1 --2- 172.21.15.123:0/3416539331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9940d1510 0x7fe9940cbd30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe99000d5f0 tx=0x7fe99000dab0 comp rx=0 tx=0).stop 2024-09-15T23:14:26.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.538+0000 7fe99c342640 1 -- 172.21.15.123:0/3416539331 shutdown_connections 2024-09-15T23:14:26.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.538+0000 7fe99c342640 1 --2- 172.21.15.123:0/3416539331 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe99415ea90 0x7fe9940c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:26.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.538+0000 7fe99c342640 1 --2- 172.21.15.123:0/3416539331 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe9940d40b0 0x7fe9940cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:26.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.538+0000 7fe99c342640 1 --2- 172.21.15.123:0/3416539331 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe97806c2b0 0x7fe97806e770 secure :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe9940b6f00 tx=0x7fe984008040 comp rx=0 tx=0).stop 2024-09-15T23:14:26.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.538+0000 7fe99c342640 1 --2- 172.21.15.123:0/3416539331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9940d1510 0x7fe9940cbd30 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:26.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.538+0000 7fe99c342640 1 -- 172.21.15.123:0/3416539331 >> 172.21.15.123:0/3416539331 conn(0x7fe99406c0e0 msgr2=0x7fe99415fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:26.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.539+0000 7fe99c342640 1 -- 172.21.15.123:0/3416539331 shutdown_connections 2024-09-15T23:14:26.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.539+0000 7fe99c342640 1 -- 172.21.15.123:0/3416539331 wait complete. 2024-09-15T23:14:26.559 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T23:14:26.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.660+0000 7f5b765bd640 1 Processor -- start 2024-09-15T23:14:26.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.660+0000 7f5b765bd640 1 -- start start 2024-09-15T23:14:26.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.661+0000 7f5b765bd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f5b70073f40 0x7f5b701624b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:26.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.661+0000 7f5b765bd640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b700cd370 con 0x7f5b7006bc10 2024-09-15T23:14:26.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.661+0000 7f5b765bd640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b700cd650 con 0x7f5b700d0320 2024-09-15T23:14:26.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.661+0000 7f5b765bd640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f5b700cd140 con 0x7f5b70073f40 2024-09-15T23:14:26.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.661+0000 7f5b6ffff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f5b7006bc10 0x7f5b7006bff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38774/0 (socket says 172.21.15.123:38774) 2024-09-15T23:14:26.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.661+0000 7f5b6ffff640 1 -- 172.21.15.123:0/1128922062 learned_addr learned my addr 172.21.15.123:0/1128922062 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:26.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.662+0000 7f5b6effd640 1 -- 172.21.15.123:0/1128922062 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4093221643 0 0) 0x7f5b700cd370 con 0x7f5b7006bc10 2024-09-15T23:14:26.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.662+0000 7f5b6effd640 1 -- 172.21.15.123:0/1128922062 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b58003520 con 0x7f5b7006bc10 2024-09-15T23:14:26.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.662+0000 7f5b6f7fe640 1 --2- 172.21.15.123:0/1128922062 >> v2:172.21.15.188:3300/0 conn(0x7f5b70073f40 0x7f5b701624b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:26.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.662+0000 7f5b6effd640 1 -- 172.21.15.123:0/1128922062 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 941706773 0 0) 0x7f5b58003520 con 0x7f5b7006bc10 2024-09-15T23:14:26.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.662+0000 7f5b6effd640 1 -- 172.21.15.123:0/1128922062 >> v2:172.21.15.188:3300/0 conn(0x7f5b70073f40 msgr2=0x7f5b701624b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:26.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.662+0000 7f5b6effd640 1 --2- 172.21.15.123:0/1128922062 >> v2:172.21.15.188:3300/0 conn(0x7f5b70073f40 0x7f5b701624b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:26.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.662+0000 7f5b6effd640 1 -- 172.21.15.123:0/1128922062 >> v1:172.21.15.188:6789/0 conn(0x7f5b700d0320 legacy=0x7f5b7006e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:26.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.662+0000 7f5b6effd640 1 -- 172.21.15.123:0/1128922062 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b700cd930 con 0x7f5b7006bc10 2024-09-15T23:14:26.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.662+0000 7f5b6effd640 1 -- 172.21.15.123:0/1128922062 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f5b60001670 con 0x7f5b7006bc10 2024-09-15T23:14:26.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.662+0000 7f5b6f7fe640 1 --2- 172.21.15.123:0/1128922062 >> v2:172.21.15.188:3300/0 conn(0x7f5b70073f40 0x7f5b701624b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:26.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.662+0000 7f5b6effd640 1 -- 172.21.15.123:0/1128922062 >> v1:172.21.15.123:6789/0 conn(0x7f5b7006bc10 legacy=0x7f5b7006bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:26.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.662+0000 7f5b6effd640 1 --2- 172.21.15.123:0/1128922062 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5b580039b0 0x7f5b58003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:26.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.662+0000 7f5b6effd640 1 --2- 172.21.15.123:0/1128922062 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b58004800 0x7f5b58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:26.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.662+0000 7f5b6effd640 1 --2- 172.21.15.123:0/1128922062 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5b580051c0 0x7f5b5800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:26.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.662+0000 7f5b6effd640 1 -- 172.21.15.123:0/1128922062 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5b5800c0e0 con 0x7f5b58004800 2024-09-15T23:14:26.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.662+0000 7f5b6effd640 1 -- 172.21.15.123:0/1128922062 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5b5800c290 con 0x7f5b580051c0 2024-09-15T23:14:26.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.662+0000 7f5b6effd640 1 -- 172.21.15.123:0/1128922062 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5b5800c490 con 0x7f5b580039b0 2024-09-15T23:14:26.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.662+0000 7f5b6f7fe640 1 --2- 172.21.15.123:0/1128922062 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b58004800 0x7f5b58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:26.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.662+0000 7f5b74b5a640 1 --2- 172.21.15.123:0/1128922062 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5b580051c0 0x7f5b5800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:26.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.662+0000 7f5b6ffff640 1 --2- 172.21.15.123:0/1128922062 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5b580039b0 0x7f5b58003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:26.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.662+0000 7f5b6f7fe640 1 -- 172.21.15.123:0/1128922062 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5b580039b0 msgr2=0x7f5b58003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:26.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.662+0000 7f5b6f7fe640 1 --2- 172.21.15.123:0/1128922062 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5b580039b0 0x7f5b58003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:26.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.662+0000 7f5b6f7fe640 1 -- 172.21.15.123:0/1128922062 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5b580051c0 msgr2=0x7f5b5800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:26.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.662+0000 7f5b6f7fe640 1 --2- 172.21.15.123:0/1128922062 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5b580051c0 0x7f5b5800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:26.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.662+0000 7f5b74b5a640 1 -- 172.21.15.123:0/1128922062 reap_dead start 2024-09-15T23:14:26.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.662+0000 7f5b6f7fe640 1 -- 172.21.15.123:0/1128922062 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b58003520 con 0x7f5b58004800 2024-09-15T23:14:26.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.662+0000 7f5b6ffff640 1 --2- 172.21.15.123:0/1128922062 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5b580039b0 0x7f5b58003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:26.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.663+0000 7f5b6f7fe640 1 --2- 172.21.15.123:0/1128922062 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b58004800 0x7f5b58004c80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5b640098a0 tx=0x7f5b58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69975d6ffa9306ee server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:26.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.663+0000 7f5b6effd640 1 -- 172.21.15.123:0/1128922062 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6400f040 con 0x7f5b58004800 2024-09-15T23:14:26.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.663+0000 7f5b6effd640 1 -- 172.21.15.123:0/1128922062 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b6402ace0 con 0x7f5b58004800 2024-09-15T23:14:26.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.663+0000 7f5b6effd640 1 -- 172.21.15.123:0/1128922062 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b64004250 con 0x7f5b58004800 2024-09-15T23:14:26.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.664+0000 7f5b765bd640 1 -- 172.21.15.123:0/1128922062 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b58004800 msgr2=0x7f5b58004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:26.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.664+0000 7f5b765bd640 1 --2- 172.21.15.123:0/1128922062 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b58004800 0x7f5b58004c80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5b640098a0 tx=0x7f5b58005830 comp rx=0 tx=0).stop 2024-09-15T23:14:26.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.664+0000 7f5b765bd640 1 -- 172.21.15.123:0/1128922062 shutdown_connections 2024-09-15T23:14:26.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.664+0000 7f5b765bd640 1 --2- 172.21.15.123:0/1128922062 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b58004800 0x7f5b58004c80 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:26.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.664+0000 7f5b765bd640 1 -- 172.21.15.123:0/1128922062 >> 172.21.15.123:0/1128922062 conn(0x7f5b700d1530 msgr2=0x7f5b700d1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:26.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.664+0000 7f5b765bd640 1 -- 172.21.15.123:0/1128922062 shutdown_connections 2024-09-15T23:14:26.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.664+0000 7f5b765bd640 1 -- 172.21.15.123:0/1128922062 wait complete. 2024-09-15T23:14:26.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.665+0000 7f5b765bd640 1 Processor -- start 2024-09-15T23:14:26.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.665+0000 7f5b765bd640 1 -- start start 2024-09-15T23:14:26.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.666+0000 7f5b765bd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5b58004800 0x7f5b700b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:26.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.666+0000 7f5b765bd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b70153ff0 0x7f5b701608a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:26.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.666+0000 7f5b765bd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5b700b4480 0x7f5b700b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:26.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.666+0000 7f5b765bd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5b700c4d50 con 0x7f5b70153ff0 2024-09-15T23:14:26.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.666+0000 7f5b765bd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5b7006e0f0 con 0x7f5b700b4480 2024-09-15T23:14:26.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.666+0000 7f5b765bd640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5b7015ec30 con 0x7f5b58004800 2024-09-15T23:14:26.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.666+0000 7f5b6f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b70153ff0 0x7f5b701608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:26.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.666+0000 7f5b6f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b70153ff0 0x7f5b701608a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35922/0 (socket says 172.21.15.123:35922) 2024-09-15T23:14:26.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.666+0000 7f5b6f7fe640 1 -- 172.21.15.123:0/1927833108 learned_addr learned my addr 172.21.15.123:0/1927833108 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:26.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.666+0000 7f5b6ffff640 1 --2- 172.21.15.123:0/1927833108 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5b58004800 0x7f5b700b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:26.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.666+0000 7f5b74b5a640 1 --2- 172.21.15.123:0/1927833108 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5b700b4480 0x7f5b700b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:26.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.666+0000 7f5b6f7fe640 1 -- 172.21.15.123:0/1927833108 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5b58004800 msgr2=0x7f5b700b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:26.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.666+0000 7f5b6f7fe640 1 --2- 172.21.15.123:0/1927833108 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5b58004800 0x7f5b700b0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:26.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.666+0000 7f5b6f7fe640 1 -- 172.21.15.123:0/1927833108 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5b700b4480 msgr2=0x7f5b700b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:26.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.666+0000 7f5b6f7fe640 1 --2- 172.21.15.123:0/1927833108 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5b700b4480 0x7f5b700b66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:26.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.666+0000 7f5b6f7fe640 1 -- 172.21.15.123:0/1927833108 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b701544f0 con 0x7f5b70153ff0 2024-09-15T23:14:26.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.667+0000 7f5b6f7fe640 1 --2- 172.21.15.123:0/1927833108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b70153ff0 0x7f5b701608a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5b64034040 tx=0x7f5b64004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:26.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.667+0000 7f5b6cff9640 1 -- 172.21.15.123:0/1927833108 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b64041070 con 0x7f5b70153ff0 2024-09-15T23:14:26.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.667+0000 7f5b6cff9640 1 -- 172.21.15.123:0/1927833108 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b6402aae0 con 0x7f5b70153ff0 2024-09-15T23:14:26.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.667+0000 7f5b6cff9640 1 -- 172.21.15.123:0/1927833108 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6403d430 con 0x7f5b70153ff0 2024-09-15T23:14:26.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.667+0000 7f5b765bd640 1 -- 172.21.15.123:0/1927833108 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b701547d0 con 0x7f5b70153ff0 2024-09-15T23:14:26.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.667+0000 7f5b765bd640 1 -- 172.21.15.123:0/1927833108 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b700b2fd0 con 0x7f5b70153ff0 2024-09-15T23:14:26.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.668+0000 7f5b765bd640 1 -- 172.21.15.123:0/1927833108 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b7006bff0 con 0x7f5b70153ff0 2024-09-15T23:14:26.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.668+0000 7f5b6cff9640 1 -- 172.21.15.123:0/1927833108 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5b64044070 con 0x7f5b70153ff0 2024-09-15T23:14:26.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.669+0000 7f5b6cff9640 1 --2- 172.21.15.123:0/1927833108 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5b5c06c2b0 0x7f5b5c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:26.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.669+0000 7f5b6cff9640 1 -- 172.21.15.123:0/1927833108 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4943+0+0 (secure 0 0 0) 0x7f5b640ab8f0 con 0x7f5b70153ff0 2024-09-15T23:14:26.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.669+0000 7f5b6ffff640 1 --2- 172.21.15.123:0/1927833108 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5b5c06c2b0 0x7f5b5c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:26.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.669+0000 7f5b6ffff640 1 --2- 172.21.15.123:0/1927833108 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5b5c06c2b0 0x7f5b5c06e770 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5b60001cc0 tx=0x7f5b60007040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:26.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.673+0000 7f5b6cff9640 1 -- 172.21.15.123:0/1927833108 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5b6402acb0 con 0x7f5b70153ff0 2024-09-15T23:14:26.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.844+0000 7f5b765bd640 1 -- 172.21.15.123:0/1927833108 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f5b700d0870 con 0x7f5b70153ff0 2024-09-15T23:14:26.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.847+0000 7f5b6cff9640 1 -- 172.21.15.123:0/1927833108 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f5b64079c80 con 0x7f5b70153ff0 2024-09-15T23:14:26.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.850+0000 7f5b765bd640 1 -- 172.21.15.123:0/1927833108 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5b5c06c2b0 msgr2=0x7f5b5c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:26.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.850+0000 7f5b765bd640 1 --2- 172.21.15.123:0/1927833108 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5b5c06c2b0 0x7f5b5c06e770 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5b60001cc0 tx=0x7f5b60007040 comp rx=0 tx=0).stop 2024-09-15T23:14:26.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.850+0000 7f5b765bd640 1 -- 172.21.15.123:0/1927833108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b70153ff0 msgr2=0x7f5b701608a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:26.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.850+0000 7f5b765bd640 1 --2- 172.21.15.123:0/1927833108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b70153ff0 0x7f5b701608a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5b64034040 tx=0x7f5b64004730 comp rx=0 tx=0).stop 2024-09-15T23:14:26.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.850+0000 7f5b765bd640 1 -- 172.21.15.123:0/1927833108 shutdown_connections 2024-09-15T23:14:26.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.850+0000 7f5b765bd640 1 --2- 172.21.15.123:0/1927833108 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5b700b4480 0x7f5b700b66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:26.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.850+0000 7f5b765bd640 1 --2- 172.21.15.123:0/1927833108 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5b5c06c2b0 0x7f5b5c06e770 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:26.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.850+0000 7f5b765bd640 1 --2- 172.21.15.123:0/1927833108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b70153ff0 0x7f5b701608a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:26.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.850+0000 7f5b765bd640 1 --2- 172.21.15.123:0/1927833108 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5b58004800 0x7f5b700b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:26.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.850+0000 7f5b765bd640 1 -- 172.21.15.123:0/1927833108 >> 172.21.15.123:0/1927833108 conn(0x7f5b700d1530 msgr2=0x7f5b700737d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:26.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.850+0000 7f5b765bd640 1 -- 172.21.15.123:0/1927833108 shutdown_connections 2024-09-15T23:14:26.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.850+0000 7f5b765bd640 1 -- 172.21.15.123:0/1927833108 wait complete. 2024-09-15T23:14:26.862 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir' 2024-09-15T23:14:26.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.959+0000 7fe3a39c4640 1 Processor -- start 2024-09-15T23:14:26.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.959+0000 7fe3a39c4640 1 -- start start 2024-09-15T23:14:26.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.960+0000 7fe3a39c4640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe39c15c4b0 0x7fe39c0b6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:26.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.960+0000 7fe3a39c4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe39c0d08e0 0x7fe39c0b6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:26.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.960+0000 7fe3a39c4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe39c067b50 con 0x7fe39c0b02b0 2024-09-15T23:14:26.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.960+0000 7fe3a39c4640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe39c0ce860 con 0x7fe39c0d08e0 2024-09-15T23:14:26.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.960+0000 7fe3a39c4640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fe39c070130 con 0x7fe39c15c4b0 2024-09-15T23:14:26.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.960+0000 7fe3a1f61640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe39c0d08e0 0x7fe39c0b6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:26.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.960+0000 7fe3a0f5f640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe39c0b02b0 0x7fe39c160120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38788/0 (socket says 172.21.15.123:38788) 2024-09-15T23:14:26.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.960+0000 7fe3a0f5f640 1 -- 172.21.15.123:0/2811505342 learned_addr learned my addr 172.21.15.123:0/2811505342 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:26.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.960+0000 7fe3a1f61640 1 --2- 172.21.15.123:0/2811505342 >> v2:172.21.15.123:3300/0 conn(0x7fe39c0d08e0 0x7fe39c0b6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35936/0 (socket says 172.21.15.123:35936) 2024-09-15T23:14:26.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.960+0000 7fe3a1760640 1 --2- 172.21.15.123:0/2811505342 >> v2:172.21.15.188:3300/0 conn(0x7fe39c15c4b0 0x7fe39c0b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:26.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.960+0000 7fe3a1f61640 1 -- 172.21.15.123:0/2811505342 >> v2:172.21.15.188:3300/0 conn(0x7fe39c15c4b0 msgr2=0x7fe39c0b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:26.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.960+0000 7fe3a1f61640 1 --2- 172.21.15.123:0/2811505342 >> v2:172.21.15.188:3300/0 conn(0x7fe39c15c4b0 0x7fe39c0b6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:26.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.960+0000 7fe3a1f61640 1 -- 172.21.15.123:0/2811505342 >> v1:172.21.15.123:6789/0 conn(0x7fe39c0b02b0 legacy=0x7fe39c160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:26.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.960+0000 7fe39bfff640 1 -- 172.21.15.123:0/2811505342 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2433673150 0 0) 0x7fe390001490 con 0x7fe39c0b02b0 2024-09-15T23:14:26.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.960+0000 7fe3a1f61640 1 -- 172.21.15.123:0/2811505342 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe39c06fe50 con 0x7fe39c0d08e0 2024-09-15T23:14:26.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.961+0000 7fe3a1f61640 1 --2- 172.21.15.123:0/2811505342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe39c0d08e0 0x7fe39c0b6660 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe39c069d90 tx=0x7fe39402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e35277d4e93f999 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:26.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.961+0000 7fe39bfff640 1 -- 172.21.15.123:0/2811505342 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe394037070 con 0x7fe39c0d08e0 2024-09-15T23:14:26.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.961+0000 7fe39bfff640 1 -- 172.21.15.123:0/2811505342 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe394032440 con 0x7fe39c0d08e0 2024-09-15T23:14:26.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.961+0000 7fe39bfff640 1 -- 172.21.15.123:0/2811505342 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe394032810 con 0x7fe39c0d08e0 2024-09-15T23:14:26.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.961+0000 7fe3a39c4640 1 -- 172.21.15.123:0/2811505342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe39c0d08e0 msgr2=0x7fe39c0b6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:26.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.961+0000 7fe3a39c4640 1 --2- 172.21.15.123:0/2811505342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe39c0d08e0 0x7fe39c0b6660 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fe39c069d90 tx=0x7fe39402a1a0 comp rx=0 tx=0).stop 2024-09-15T23:14:26.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.961+0000 7fe3a39c4640 1 -- 172.21.15.123:0/2811505342 shutdown_connections 2024-09-15T23:14:26.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.961+0000 7fe3a39c4640 1 --2- 172.21.15.123:0/2811505342 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe39c0d08e0 0x7fe39c0b6660 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:26.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.961+0000 7fe3a39c4640 1 --2- 172.21.15.123:0/2811505342 >> v2:172.21.15.188:3300/0 conn(0x7fe39c15c4b0 0x7fe39c0b6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:26.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.961+0000 7fe3a39c4640 1 -- 172.21.15.123:0/2811505342 >> 172.21.15.123:0/2811505342 conn(0x7fe39c0b0a80 msgr2=0x7fe39c0b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:26.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.962+0000 7fe3a39c4640 1 -- 172.21.15.123:0/2811505342 shutdown_connections 2024-09-15T23:14:26.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.962+0000 7fe3a39c4640 1 -- 172.21.15.123:0/2811505342 wait complete. 2024-09-15T23:14:26.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.963+0000 7fe3a39c4640 1 Processor -- start 2024-09-15T23:14:26.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.963+0000 7fe3a39c4640 1 -- start start 2024-09-15T23:14:26.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.963+0000 7fe3a39c4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe39c0b02b0 0x7fe39c0734a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:26.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.963+0000 7fe3a39c4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe39c0d08e0 0x7fe39c153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:26.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.963+0000 7fe3a39c4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe39c15c4b0 0x7fe39c1f67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:26.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.963+0000 7fe3a39c4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe39c06dcc0 con 0x7fe39c15c4b0 2024-09-15T23:14:26.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.963+0000 7fe3a39c4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe39c0ce580 con 0x7fe39c0d08e0 2024-09-15T23:14:26.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.963+0000 7fe3a39c4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe39c15c890 con 0x7fe39c0b02b0 2024-09-15T23:14:26.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.964+0000 7fe3a1f61640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe39c15c4b0 0x7fe39c1f67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:26.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.964+0000 7fe3a1f61640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe39c15c4b0 0x7fe39c1f67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35948/0 (socket says 172.21.15.123:35948) 2024-09-15T23:14:26.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.964+0000 7fe3a1f61640 1 -- 172.21.15.123:0/3281679539 learned_addr learned my addr 172.21.15.123:0/3281679539 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:26.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.964+0000 7fe3a0f5f640 1 --2- 172.21.15.123:0/3281679539 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe39c0d08e0 0x7fe39c153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:26.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.964+0000 7fe3a1760640 1 --2- 172.21.15.123:0/3281679539 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe39c0b02b0 0x7fe39c0734a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:26.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.964+0000 7fe3a1f61640 1 -- 172.21.15.123:0/3281679539 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe39c0b02b0 msgr2=0x7fe39c0734a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:26.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.964+0000 7fe3a1f61640 1 --2- 172.21.15.123:0/3281679539 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe39c0b02b0 0x7fe39c0734a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:26.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.964+0000 7fe3a1f61640 1 -- 172.21.15.123:0/3281679539 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe39c0d08e0 msgr2=0x7fe39c153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:26.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.964+0000 7fe3a1f61640 1 --2- 172.21.15.123:0/3281679539 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe39c0d08e0 0x7fe39c153f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:26.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.964+0000 7fe3a1f61640 1 -- 172.21.15.123:0/3281679539 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe39c1f6cf0 con 0x7fe39c15c4b0 2024-09-15T23:14:26.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.964+0000 7fe3a1f61640 1 --2- 172.21.15.123:0/3281679539 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe39c15c4b0 0x7fe39c1f67b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe39402a1e0 tx=0x7fe3940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:26.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.964+0000 7fe399ffb640 1 -- 172.21.15.123:0/3281679539 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe394037040 con 0x7fe39c15c4b0 2024-09-15T23:14:26.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.964+0000 7fe399ffb640 1 -- 172.21.15.123:0/3281679539 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe394042070 con 0x7fe39c15c4b0 2024-09-15T23:14:26.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.964+0000 7fe3a39c4640 1 -- 172.21.15.123:0/3281679539 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe39c1531b0 con 0x7fe39c15c4b0 2024-09-15T23:14:26.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.964+0000 7fe399ffb640 1 -- 172.21.15.123:0/3281679539 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe394030880 con 0x7fe39c15c4b0 2024-09-15T23:14:26.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.964+0000 7fe3a39c4640 1 -- 172.21.15.123:0/3281679539 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe39c153770 con 0x7fe39c15c4b0 2024-09-15T23:14:26.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.965+0000 7fe3a39c4640 1 -- 172.21.15.123:0/3281679539 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe39c0b6120 con 0x7fe39c15c4b0 2024-09-15T23:14:26.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.966+0000 7fe399ffb640 1 -- 172.21.15.123:0/3281679539 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe394030a20 con 0x7fe39c15c4b0 2024-09-15T23:14:26.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.966+0000 7fe399ffb640 1 --2- 172.21.15.123:0/3281679539 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe38806c2b0 0x7fe38806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:26.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.966+0000 7fe399ffb640 1 -- 172.21.15.123:0/3281679539 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4943+0+0 (secure 0 0 0) 0x7fe3940aba10 con 0x7fe39c15c4b0 2024-09-15T23:14:26.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.967+0000 7fe3a1760640 1 --2- 172.21.15.123:0/3281679539 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe38806c2b0 0x7fe38806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:26.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.970+0000 7fe3a1760640 1 --2- 172.21.15.123:0/3281679539 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe38806c2b0 0x7fe38806e770 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe38c009a30 tx=0x7fe38c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:26.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:26.970+0000 7fe399ffb640 1 -- 172.21.15.123:0/3281679539 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe39407a510 con 0x7fe39c15c4b0 2024-09-15T23:14:27.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.200+0000 7fe3a39c4640 1 -- 172.21.15.123:0/3281679539 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]} v 0) -- 0x7fe39c0b2390 con 0x7fe39c15c4b0 2024-09-15T23:14:27.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.536+0000 7fe399ffb640 1 -- 172.21.15.123:0/3281679539 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]}]=0 v120) ==== 148+0+0 (secure 0 0 0) 0x7fe394079e10 con 0x7fe39c15c4b0 2024-09-15T23:14:27.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.538+0000 7fe3a39c4640 1 -- 172.21.15.123:0/3281679539 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe38806c2b0 msgr2=0x7fe38806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:27.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.538+0000 7fe3a39c4640 1 --2- 172.21.15.123:0/3281679539 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe38806c2b0 0x7fe38806e770 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe38c009a30 tx=0x7fe38c008040 comp rx=0 tx=0).stop 2024-09-15T23:14:27.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.538+0000 7fe3a39c4640 1 -- 172.21.15.123:0/3281679539 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe39c15c4b0 msgr2=0x7fe39c1f67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:27.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.538+0000 7fe3a39c4640 1 --2- 172.21.15.123:0/3281679539 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe39c15c4b0 0x7fe39c1f67b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe39402a1e0 tx=0x7fe3940046c0 comp rx=0 tx=0).stop 2024-09-15T23:14:27.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.538+0000 7fe3a39c4640 1 -- 172.21.15.123:0/3281679539 shutdown_connections 2024-09-15T23:14:27.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.538+0000 7fe3a39c4640 1 --2- 172.21.15.123:0/3281679539 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe38806c2b0 0x7fe38806e770 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:27.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.538+0000 7fe3a39c4640 1 --2- 172.21.15.123:0/3281679539 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe39c15c4b0 0x7fe39c1f67b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:27.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.538+0000 7fe3a39c4640 1 --2- 172.21.15.123:0/3281679539 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe39c0d08e0 0x7fe39c153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:27.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.538+0000 7fe3a39c4640 1 --2- 172.21.15.123:0/3281679539 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe39c0b02b0 0x7fe39c0734a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:27.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.538+0000 7fe3a39c4640 1 -- 172.21.15.123:0/3281679539 >> 172.21.15.123:0/3281679539 conn(0x7fe39c0b0a80 msgr2=0x7fe39c158c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:27.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.538+0000 7fe3a39c4640 1 -- 172.21.15.123:0/3281679539 shutdown_connections 2024-09-15T23:14:27.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.538+0000 7fe3a39c4640 1 -- 172.21.15.123:0/3281679539 wait complete. 2024-09-15T23:14:27.551 INFO:tasks.cephfs_test_runner:test flag scrub_mdsdir ... ok 2024-09-15T23:14:27.551 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-15T23:14:27.551 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:14:27.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.649+0000 7fa781de4640 1 Processor -- start 2024-09-15T23:14:27.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.649+0000 7fa781de4640 1 -- start start 2024-09-15T23:14:27.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.650+0000 7fa781de4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa77c145ed0 0x7fa77c0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:27.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.650+0000 7fa781de4640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa77c073180 0x7fa77c0735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:27.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.650+0000 7fa781de4640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa77c0b4020 con 0x7fa77c0b5880 2024-09-15T23:14:27.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.650+0000 7fa781de4640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fa77c073b00 con 0x7fa77c145ed0 2024-09-15T23:14:27.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.650+0000 7fa781de4640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fa77c0b63d0 con 0x7fa77c073180 2024-09-15T23:14:27.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.650+0000 7fa77b7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa77c145ed0 0x7fa77c0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:27.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.650+0000 7fa77b7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa77c145ed0 0x7fa77c0b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35952/0 (socket says 172.21.15.123:35952) 2024-09-15T23:14:27.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.650+0000 7fa77b7fe640 1 -- 172.21.15.123:0/1817892338 learned_addr learned my addr 172.21.15.123:0/1817892338 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:27.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.650+0000 7fa77b7fe640 1 -- 172.21.15.123:0/1817892338 >> v2:172.21.15.188:3300/0 conn(0x7fa77c073180 msgr2=0x7fa77c0735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:27.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.650+0000 7fa77b7fe640 1 --2- 172.21.15.123:0/1817892338 >> v2:172.21.15.188:3300/0 conn(0x7fa77c073180 0x7fa77c0735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:27.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.650+0000 7fa77b7fe640 1 -- 172.21.15.123:0/1817892338 >> v1:172.21.15.188:6789/0 conn(0x7fa77c0b5880 legacy=0x7fa77c0b5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:27.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.650+0000 7fa77b7fe640 1 -- 172.21.15.123:0/1817892338 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa77c0b42c0 con 0x7fa77c145ed0 2024-09-15T23:14:27.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.651+0000 7fa77b7fe640 1 --2- 172.21.15.123:0/1817892338 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa77c145ed0 0x7fa77c0b5080 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa77c069cd0 tx=0x7fa76c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b60f9db11e37f01a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:27.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.651+0000 7fa77affd640 1 -- 172.21.15.123:0/1817892338 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76c037070 con 0x7fa77c145ed0 2024-09-15T23:14:27.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.651+0000 7fa77affd640 1 -- 172.21.15.123:0/1817892338 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa76c032440 con 0x7fa77c145ed0 2024-09-15T23:14:27.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.651+0000 7fa77affd640 1 -- 172.21.15.123:0/1817892338 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76c032810 con 0x7fa77c145ed0 2024-09-15T23:14:27.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.651+0000 7fa781de4640 1 -- 172.21.15.123:0/1817892338 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa77c145ed0 msgr2=0x7fa77c0b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:27.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.651+0000 7fa781de4640 1 --2- 172.21.15.123:0/1817892338 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa77c145ed0 0x7fa77c0b5080 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa77c069cd0 tx=0x7fa76c02a210 comp rx=0 tx=0).stop 2024-09-15T23:14:27.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.652+0000 7fa781de4640 1 -- 172.21.15.123:0/1817892338 shutdown_connections 2024-09-15T23:14:27.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.652+0000 7fa781de4640 1 --2- 172.21.15.123:0/1817892338 >> v2:172.21.15.188:3300/0 conn(0x7fa77c073180 0x7fa77c0735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:27.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.652+0000 7fa781de4640 1 --2- 172.21.15.123:0/1817892338 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa77c145ed0 0x7fa77c0b5080 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:27.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.652+0000 7fa781de4640 1 -- 172.21.15.123:0/1817892338 >> 172.21.15.123:0/1817892338 conn(0x7fa77c0ccec0 msgr2=0x7fa77c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:27.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.652+0000 7fa781de4640 1 -- 172.21.15.123:0/1817892338 shutdown_connections 2024-09-15T23:14:27.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.652+0000 7fa781de4640 1 -- 172.21.15.123:0/1817892338 wait complete. 2024-09-15T23:14:27.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.653+0000 7fa781de4640 1 Processor -- start 2024-09-15T23:14:27.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.653+0000 7fa781de4640 1 -- start start 2024-09-15T23:14:27.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.653+0000 7fa781de4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa77c073180 0x7fa77c13d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:27.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.653+0000 7fa781de4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa77c0b5880 0x7fa77c1419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:27.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.653+0000 7fa781de4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa77c145ed0 0x7fa77c15ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:27.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.653+0000 7fa781de4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa77c0b4b60 con 0x7fa77c073180 2024-09-15T23:14:27.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.653+0000 7fa781de4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa77c0b4880 con 0x7fa77c0b5880 2024-09-15T23:14:27.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.653+0000 7fa781de4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa77c1462b0 con 0x7fa77c145ed0 2024-09-15T23:14:27.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.654+0000 7fa77b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa77c073180 0x7fa77c13d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:27.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.654+0000 7fa77b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa77c073180 0x7fa77c13d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35968/0 (socket says 172.21.15.123:35968) 2024-09-15T23:14:27.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.654+0000 7fa77b7fe640 1 -- 172.21.15.123:0/3228862536 learned_addr learned my addr 172.21.15.123:0/3228862536 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:27.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.654+0000 7fa773fff640 1 --2- 172.21.15.123:0/3228862536 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa77c0b5880 0x7fa77c1419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:27.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.654+0000 7fa77bfff640 1 --2- 172.21.15.123:0/3228862536 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa77c145ed0 0x7fa77c15ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:27.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.654+0000 7fa77b7fe640 1 -- 172.21.15.123:0/3228862536 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa77c145ed0 msgr2=0x7fa77c15ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:27.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.654+0000 7fa77b7fe640 1 --2- 172.21.15.123:0/3228862536 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa77c145ed0 0x7fa77c15ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:27.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.654+0000 7fa77b7fe640 1 -- 172.21.15.123:0/3228862536 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa77c0b5880 msgr2=0x7fa77c1419d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:27.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.654+0000 7fa77b7fe640 1 --2- 172.21.15.123:0/3228862536 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa77c0b5880 0x7fa77c1419d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:27.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.654+0000 7fa77b7fe640 1 -- 172.21.15.123:0/3228862536 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa77c142350 con 0x7fa77c073180 2024-09-15T23:14:27.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.654+0000 7fa773fff640 1 --2- 172.21.15.123:0/3228862536 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa77c0b5880 0x7fa77c1419d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:27.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.654+0000 7fa77bfff640 1 --2- 172.21.15.123:0/3228862536 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa77c145ed0 0x7fa77c15ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:27.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.654+0000 7fa77b7fe640 1 --2- 172.21.15.123:0/3228862536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa77c073180 0x7fa77c13d9d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa76c000c00 tx=0x7fa76c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:27.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.654+0000 7fa778ff9640 1 -- 172.21.15.123:0/3228862536 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76c041070 con 0x7fa77c073180 2024-09-15T23:14:27.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.654+0000 7fa778ff9640 1 -- 172.21.15.123:0/3228862536 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa76c03c890 con 0x7fa77c073180 2024-09-15T23:14:27.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.654+0000 7fa781de4640 1 -- 172.21.15.123:0/3228862536 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa77c13ba10 con 0x7fa77c073180 2024-09-15T23:14:27.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.654+0000 7fa778ff9640 1 -- 172.21.15.123:0/3228862536 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76c037040 con 0x7fa77c073180 2024-09-15T23:14:27.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.654+0000 7fa781de4640 1 -- 172.21.15.123:0/3228862536 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa77c13bfd0 con 0x7fa77c073180 2024-09-15T23:14:27.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.655+0000 7fa781de4640 1 -- 172.21.15.123:0/3228862536 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa77c0735c0 con 0x7fa77c073180 2024-09-15T23:14:27.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.656+0000 7fa778ff9640 1 -- 172.21.15.123:0/3228862536 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa76c044070 con 0x7fa77c073180 2024-09-15T23:14:27.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.656+0000 7fa778ff9640 1 --2- 172.21.15.123:0/3228862536 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa75c06c2b0 0x7fa75c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:27.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.656+0000 7fa778ff9640 1 -- 172.21.15.123:0/3228862536 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4943+0+0 (secure 0 0 0) 0x7fa76c0abdb0 con 0x7fa77c073180 2024-09-15T23:14:27.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.657+0000 7fa773fff640 1 --2- 172.21.15.123:0/3228862536 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa75c06c2b0 0x7fa75c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:27.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.657+0000 7fa773fff640 1 --2- 172.21.15.123:0/3228862536 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa75c06c2b0 0x7fa75c06e770 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa77c156720 tx=0x7fa764008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:27.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.661+0000 7fa778ff9640 1 -- 172.21.15.123:0/3228862536 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa76c07a9d0 con 0x7fa77c073180 2024-09-15T23:14:27.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.827+0000 7fa781de4640 1 -- 172.21.15.123:0/3228862536 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa77c143530 con 0x7fa77c073180 2024-09-15T23:14:27.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.828+0000 7fa778ff9640 1 -- 172.21.15.123:0/3228862536 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+13058 (secure 0 0 0) 0x7fa76c07a2d0 con 0x7fa77c073180 2024-09-15T23:14:27.829 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:14:27.829 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":43,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:14:26.528745+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6835/1577644605":"2024-09-16T23:14:23.514756+0000","172.21.15.123:6834/1577644605":"2024-09-16T23:14:23.514756+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:14:27.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.830+0000 7fa781de4640 1 -- 172.21.15.123:0/3228862536 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa75c06c2b0 msgr2=0x7fa75c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:27.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.830+0000 7fa781de4640 1 --2- 172.21.15.123:0/3228862536 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa75c06c2b0 0x7fa75c06e770 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa77c156720 tx=0x7fa764008040 comp rx=0 tx=0).stop 2024-09-15T23:14:27.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.830+0000 7fa781de4640 1 -- 172.21.15.123:0/3228862536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa77c073180 msgr2=0x7fa77c13d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:27.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.830+0000 7fa781de4640 1 --2- 172.21.15.123:0/3228862536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa77c073180 0x7fa77c13d9d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa76c000c00 tx=0x7fa76c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:14:27.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.830+0000 7fa781de4640 1 -- 172.21.15.123:0/3228862536 shutdown_connections 2024-09-15T23:14:27.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.830+0000 7fa781de4640 1 --2- 172.21.15.123:0/3228862536 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa77c145ed0 0x7fa77c15ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:27.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.830+0000 7fa781de4640 1 --2- 172.21.15.123:0/3228862536 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa77c0b5880 0x7fa77c1419d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:27.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.830+0000 7fa781de4640 1 --2- 172.21.15.123:0/3228862536 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa75c06c2b0 0x7fa75c06e770 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:27.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.830+0000 7fa781de4640 1 --2- 172.21.15.123:0/3228862536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa77c073180 0x7fa77c13d9d0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:27.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.830+0000 7fa781de4640 1 -- 172.21.15.123:0/3228862536 >> 172.21.15.123:0/3228862536 conn(0x7fa77c0ccec0 msgr2=0x7fa77c144e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:27.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.830+0000 7fa781de4640 1 -- 172.21.15.123:0/3228862536 shutdown_connections 2024-09-15T23:14:27.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.830+0000 7fa781de4640 1 -- 172.21.15.123:0/3228862536 wait complete. 2024-09-15T23:14:27.842 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T23:12:01.531886+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T23:14:27.843 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T23:14:27.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.943+0000 7f3b68f5f640 1 Processor -- start 2024-09-15T23:14:27.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.943+0000 7f3b68f5f640 1 -- start start 2024-09-15T23:14:27.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.944+0000 7f3b68f5f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3b6415e990 0x7f3b6415ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:27.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.944+0000 7f3b68f5f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f3b640b5520 0x7f3b6406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:27.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.944+0000 7f3b68f5f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3b6406d260 0x7f3b64162a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:27.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.944+0000 7f3b68f5f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f3b6415f2b0 con 0x7f3b6406d260 2024-09-15T23:14:27.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.944+0000 7f3b68f5f640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f3b6415f550 con 0x7f3b640b5520 2024-09-15T23:14:27.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.944+0000 7f3b68f5f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f3b6415f830 con 0x7f3b6415e990 2024-09-15T23:14:27.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.944+0000 7f3b62d9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3b6406d260 0x7f3b64162a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:27.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.944+0000 7f3b62d9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3b6406d260 0x7f3b64162a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35980/0 (socket says 172.21.15.123:35980) 2024-09-15T23:14:27.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.944+0000 7f3b62d9d640 1 -- 172.21.15.123:0/559620933 learned_addr learned my addr 172.21.15.123:0/559620933 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:27.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.944+0000 7f3b5bfff640 1 --2- 172.21.15.123:0/559620933 >> v2:172.21.15.188:3300/0 conn(0x7f3b640b5520 0x7f3b6406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:27.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.944+0000 7f3b6259c640 1 --2- 172.21.15.123:0/559620933 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3b6415e990 0x7f3b6415ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:27.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.945+0000 7f3b62d9d640 1 -- 172.21.15.123:0/559620933 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3b6415e990 msgr2=0x7f3b6415ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:27.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.945+0000 7f3b62d9d640 1 --2- 172.21.15.123:0/559620933 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3b6415e990 0x7f3b6415ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:27.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.945+0000 7f3b62d9d640 1 -- 172.21.15.123:0/559620933 >> v2:172.21.15.188:3300/0 conn(0x7f3b640b5520 msgr2=0x7f3b6406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:27.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.945+0000 7f3b62d9d640 1 --2- 172.21.15.123:0/559620933 >> v2:172.21.15.188:3300/0 conn(0x7f3b640b5520 0x7f3b6406cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:27.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.945+0000 7f3b62d9d640 1 -- 172.21.15.123:0/559620933 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b6415fb10 con 0x7f3b6406d260 2024-09-15T23:14:27.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.945+0000 7f3b62d9d640 1 --2- 172.21.15.123:0/559620933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b6406d260 0x7f3b64162a00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3b640b51b0 tx=0x7f3b5c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43f8961cdaad460e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:27.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.945+0000 7f3b61d9b640 1 -- 172.21.15.123:0/559620933 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c036070 con 0x7f3b6406d260 2024-09-15T23:14:27.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.946+0000 7f3b61d9b640 1 -- 172.21.15.123:0/559620933 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b5c031600 con 0x7f3b6406d260 2024-09-15T23:14:27.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.946+0000 7f3b61d9b640 1 -- 172.21.15.123:0/559620933 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c0319d0 con 0x7f3b6406d260 2024-09-15T23:14:27.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.946+0000 7f3b68f5f640 1 -- 172.21.15.123:0/559620933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b6406d260 msgr2=0x7f3b64162a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:27.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.946+0000 7f3b68f5f640 1 --2- 172.21.15.123:0/559620933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b6406d260 0x7f3b64162a00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3b640b51b0 tx=0x7f3b5c02a6a0 comp rx=0 tx=0).stop 2024-09-15T23:14:27.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.946+0000 7f3b68f5f640 1 -- 172.21.15.123:0/559620933 shutdown_connections 2024-09-15T23:14:27.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.946+0000 7f3b68f5f640 1 --2- 172.21.15.123:0/559620933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b6406d260 0x7f3b64162a00 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:27.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.946+0000 7f3b68f5f640 1 --2- 172.21.15.123:0/559620933 >> v2:172.21.15.188:3300/0 conn(0x7f3b640b5520 0x7f3b6406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:27.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.946+0000 7f3b68f5f640 1 --2- 172.21.15.123:0/559620933 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3b6415e990 0x7f3b6415ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:27.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.946+0000 7f3b68f5f640 1 -- 172.21.15.123:0/559620933 >> 172.21.15.123:0/559620933 conn(0x7f3b640d25d0 msgr2=0x7f3b640d29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:27.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.946+0000 7f3b68f5f640 1 -- 172.21.15.123:0/559620933 shutdown_connections 2024-09-15T23:14:27.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.946+0000 7f3b68f5f640 1 -- 172.21.15.123:0/559620933 wait complete. 2024-09-15T23:14:27.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.947+0000 7f3b68f5f640 1 Processor -- start 2024-09-15T23:14:27.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.947+0000 7f3b68f5f640 1 -- start start 2024-09-15T23:14:27.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.948+0000 7f3b68f5f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b6406d260 0x7f3b64159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:27.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.948+0000 7f3b68f5f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3b640b5520 0x7f3b641f4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:27.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.948+0000 7f3b68f5f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3b6415e990 0x7f3b640cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:27.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.948+0000 7f3b68f5f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3b641630c0 con 0x7f3b6406d260 2024-09-15T23:14:27.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.948+0000 7f3b68f5f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3b64162f40 con 0x7f3b6415e990 2024-09-15T23:14:27.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.948+0000 7f3b68f5f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f3b64163240 con 0x7f3b640b5520 2024-09-15T23:14:27.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.948+0000 7f3b6259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b6406d260 0x7f3b64159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:27.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.948+0000 7f3b6259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b6406d260 0x7f3b64159700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35982/0 (socket says 172.21.15.123:35982) 2024-09-15T23:14:27.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.948+0000 7f3b6259c640 1 -- 172.21.15.123:0/2260162699 learned_addr learned my addr 172.21.15.123:0/2260162699 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:27.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.948+0000 7f3b62d9d640 1 --2- 172.21.15.123:0/2260162699 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3b6415e990 0x7f3b640cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:27.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.948+0000 7f3b5bfff640 1 --2- 172.21.15.123:0/2260162699 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3b640b5520 0x7f3b641f4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:27.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.948+0000 7f3b6259c640 1 -- 172.21.15.123:0/2260162699 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3b640b5520 msgr2=0x7f3b641f4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:27.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.949+0000 7f3b6259c640 1 --2- 172.21.15.123:0/2260162699 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3b640b5520 0x7f3b641f4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:27.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.949+0000 7f3b6259c640 1 -- 172.21.15.123:0/2260162699 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3b6415e990 msgr2=0x7f3b640cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:27.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.949+0000 7f3b6259c640 1 --2- 172.21.15.123:0/2260162699 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3b6415e990 0x7f3b640cccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:27.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.949+0000 7f3b6259c640 1 -- 172.21.15.123:0/2260162699 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b640cbc10 con 0x7f3b6406d260 2024-09-15T23:14:27.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.949+0000 7f3b6259c640 1 --2- 172.21.15.123:0/2260162699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b6406d260 0x7f3b64159700 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3b5400e9e0 tx=0x7f3b5400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:27.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.949+0000 7f3b5affd640 1 -- 172.21.15.123:0/2260162699 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b54017070 con 0x7f3b6406d260 2024-09-15T23:14:27.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.949+0000 7f3b5affd640 1 -- 172.21.15.123:0/2260162699 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b5400c9d0 con 0x7f3b6406d260 2024-09-15T23:14:27.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.949+0000 7f3b68f5f640 1 -- 172.21.15.123:0/2260162699 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b640cbef0 con 0x7f3b6406d260 2024-09-15T23:14:27.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.949+0000 7f3b5affd640 1 -- 172.21.15.123:0/2260162699 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5400cdc0 con 0x7f3b6406d260 2024-09-15T23:14:27.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.949+0000 7f3b68f5f640 1 -- 172.21.15.123:0/2260162699 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b640cc4b0 con 0x7f3b6406d260 2024-09-15T23:14:27.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.950+0000 7f3b68f5f640 1 -- 172.21.15.123:0/2260162699 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b6406cd20 con 0x7f3b6406d260 2024-09-15T23:14:27.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.950+0000 7f3b5affd640 1 -- 172.21.15.123:0/2260162699 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3b5401a070 con 0x7f3b6406d260 2024-09-15T23:14:27.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.951+0000 7f3b5affd640 1 --2- 172.21.15.123:0/2260162699 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3b4406c2b0 0x7f3b4406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:27.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.951+0000 7f3b5affd640 1 -- 172.21.15.123:0/2260162699 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4943+0+0 (secure 0 0 0) 0x7f3b5408b470 con 0x7f3b6406d260 2024-09-15T23:14:27.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.951+0000 7f3b5bfff640 1 --2- 172.21.15.123:0/2260162699 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3b4406c2b0 0x7f3b4406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:27.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.952+0000 7f3b5bfff640 1 --2- 172.21.15.123:0/2260162699 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3b4406c2b0 0x7f3b4406e770 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3b64075aa0 tx=0x7f3b4c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:27.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:27.955+0000 7f3b5affd640 1 -- 172.21.15.123:0/2260162699 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3b54059f70 con 0x7f3b6406d260 2024-09-15T23:14:28.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.120+0000 7f3b68f5f640 1 -- 172.21.15.123:0/2260162699 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3b640b1e70 con 0x7f3b6406d260 2024-09-15T23:14:28.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.120+0000 7f3b5affd640 1 -- 172.21.15.123:0/2260162699 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) ==== 93+0+10 (secure 0 0 0) 0x7f3b54059870 con 0x7f3b6406d260 2024-09-15T23:14:28.121 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-15T23:14:28.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.122+0000 7f3b68f5f640 1 -- 172.21.15.123:0/2260162699 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3b4406c2b0 msgr2=0x7f3b4406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:28.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.122+0000 7f3b68f5f640 1 --2- 172.21.15.123:0/2260162699 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3b4406c2b0 0x7f3b4406e770 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3b64075aa0 tx=0x7f3b4c008040 comp rx=0 tx=0).stop 2024-09-15T23:14:28.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.122+0000 7f3b68f5f640 1 -- 172.21.15.123:0/2260162699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b6406d260 msgr2=0x7f3b64159700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:28.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.122+0000 7f3b68f5f640 1 --2- 172.21.15.123:0/2260162699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b6406d260 0x7f3b64159700 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3b5400e9e0 tx=0x7f3b5400eea0 comp rx=0 tx=0).stop 2024-09-15T23:14:28.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.122+0000 7f3b68f5f640 1 -- 172.21.15.123:0/2260162699 shutdown_connections 2024-09-15T23:14:28.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.122+0000 7f3b68f5f640 1 --2- 172.21.15.123:0/2260162699 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3b6415e990 0x7f3b640cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:28.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.122+0000 7f3b68f5f640 1 --2- 172.21.15.123:0/2260162699 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3b640b5520 0x7f3b641f4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:28.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.122+0000 7f3b68f5f640 1 --2- 172.21.15.123:0/2260162699 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3b4406c2b0 0x7f3b4406e770 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:28.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.122+0000 7f3b68f5f640 1 --2- 172.21.15.123:0/2260162699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b6406d260 0x7f3b64159700 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:28.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.122+0000 7f3b68f5f640 1 -- 172.21.15.123:0/2260162699 >> 172.21.15.123:0/2260162699 conn(0x7f3b640d25d0 msgr2=0x7f3b6415ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:28.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.122+0000 7f3b68f5f640 1 -- 172.21.15.123:0/2260162699 shutdown_connections 2024-09-15T23:14:28.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.122+0000 7f3b68f5f640 1 -- 172.21.15.123:0/2260162699 wait complete. 2024-09-15T23:14:28.135 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks' 2024-09-15T23:14:28.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.231+0000 7f038398d640 1 Processor -- start 2024-09-15T23:14:28.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.232+0000 7f038398d640 1 -- start start 2024-09-15T23:14:28.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.232+0000 7f038398d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f037c0d23b0 0x7f037c0b87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:28.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.232+0000 7f038398d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f037c0d0e70 con 0x7f037c15ed20 2024-09-15T23:14:28.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.232+0000 7f038398d640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f037c0d41c0 con 0x7f037c0b6970 2024-09-15T23:14:28.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.232+0000 7f038398d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f037c0d35b0 con 0x7f037c0d23b0 2024-09-15T23:14:28.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.233+0000 7f0381f2a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f037c0d23b0 0x7f037c0b87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:28.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.233+0000 7f0381729640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f037c15ed20 0x7f037c0b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38796/0 (socket says 172.21.15.123:38796) 2024-09-15T23:14:28.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.233+0000 7f0381f2a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f037c0d23b0 0x7f037c0b87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35984/0 (socket says 172.21.15.123:35984) 2024-09-15T23:14:28.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.233+0000 7f0381729640 1 -- 172.21.15.123:0/1774838065 learned_addr learned my addr 172.21.15.123:0/1774838065 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:28.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.233+0000 7f0381f2a640 1 -- 172.21.15.123:0/1774838065 >> v1:172.21.15.188:6789/0 conn(0x7f037c0b6970 legacy=0x7f037c0b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:28.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.233+0000 7f0381f2a640 1 -- 172.21.15.123:0/1774838065 >> v1:172.21.15.123:6789/0 conn(0x7f037c15ed20 legacy=0x7f037c0b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:28.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.233+0000 7f0381f2a640 1 -- 172.21.15.123:0/1774838065 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f037c0d3890 con 0x7f037c0d23b0 2024-09-15T23:14:28.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.233+0000 7f037bfff640 1 -- 172.21.15.123:0/1774838065 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3553252592 0 0) 0x7f0374001110 con 0x7f037c15ed20 2024-09-15T23:14:28.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.234+0000 7f0381f2a640 1 --2- 172.21.15.123:0/1774838065 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f037c0d23b0 0x7f037c0b87e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f036c0097a0 tx=0x7f036c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aec30ede550ae89 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:28.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.234+0000 7f037bfff640 1 -- 172.21.15.123:0/1774838065 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c037070 con 0x7f037c0d23b0 2024-09-15T23:14:28.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.234+0000 7f037bfff640 1 -- 172.21.15.123:0/1774838065 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f036c02ae50 con 0x7f037c0d23b0 2024-09-15T23:14:28.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.234+0000 7f037bfff640 1 -- 172.21.15.123:0/1774838065 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c032660 con 0x7f037c0d23b0 2024-09-15T23:14:28.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.234+0000 7f038398d640 1 -- 172.21.15.123:0/1774838065 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f037c0d23b0 msgr2=0x7f037c0b87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:28.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.234+0000 7f038398d640 1 --2- 172.21.15.123:0/1774838065 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f037c0d23b0 0x7f037c0b87e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f036c0097a0 tx=0x7f036c02a140 comp rx=0 tx=0).stop 2024-09-15T23:14:28.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.234+0000 7f038398d640 1 -- 172.21.15.123:0/1774838065 shutdown_connections 2024-09-15T23:14:28.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.234+0000 7f038398d640 1 --2- 172.21.15.123:0/1774838065 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f037c0d23b0 0x7f037c0b87e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:28.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.234+0000 7f038398d640 1 -- 172.21.15.123:0/1774838065 >> 172.21.15.123:0/1774838065 conn(0x7f037c0d1260 msgr2=0x7f037c0d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:28.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.234+0000 7f038398d640 1 -- 172.21.15.123:0/1774838065 shutdown_connections 2024-09-15T23:14:28.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.234+0000 7f038398d640 1 -- 172.21.15.123:0/1774838065 wait complete. 2024-09-15T23:14:28.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.235+0000 7f038398d640 1 Processor -- start 2024-09-15T23:14:28.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.236+0000 7f038398d640 1 -- start start 2024-09-15T23:14:28.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.236+0000 7f038398d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f037c0b6970 0x7f037c0ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:28.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.236+0000 7f038398d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f037c0d23b0 0x7f037c0cc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:28.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.236+0000 7f038398d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f037c15ed20 0x7f037c0cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:28.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.236+0000 7f038398d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f037c0d32a0 con 0x7f037c0b6970 2024-09-15T23:14:28.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.236+0000 7f038398d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f037c0d3e50 con 0x7f037c0d23b0 2024-09-15T23:14:28.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.236+0000 7f038398d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f037c15f100 con 0x7f037c15ed20 2024-09-15T23:14:28.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.236+0000 7f0381729640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f037c0b6970 0x7f037c0ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:28.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.236+0000 7f0381729640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f037c0b6970 0x7f037c0ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35986/0 (socket says 172.21.15.123:35986) 2024-09-15T23:14:28.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.236+0000 7f0381729640 1 -- 172.21.15.123:0/2941751562 learned_addr learned my addr 172.21.15.123:0/2941751562 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:28.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.237+0000 7f0381f2a640 1 --2- 172.21.15.123:0/2941751562 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f037c15ed20 0x7f037c0cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:28.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.237+0000 7f0380f28640 1 --2- 172.21.15.123:0/2941751562 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f037c0d23b0 0x7f037c0cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:28.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.237+0000 7f0381729640 1 -- 172.21.15.123:0/2941751562 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f037c15ed20 msgr2=0x7f037c0cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:28.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.237+0000 7f0381729640 1 --2- 172.21.15.123:0/2941751562 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f037c15ed20 0x7f037c0cc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:28.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.237+0000 7f0381729640 1 -- 172.21.15.123:0/2941751562 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f037c0d23b0 msgr2=0x7f037c0cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:28.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.237+0000 7f0381729640 1 --2- 172.21.15.123:0/2941751562 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f037c0d23b0 0x7f037c0cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:28.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.237+0000 7f0381729640 1 -- 172.21.15.123:0/2941751562 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f037c160ce0 con 0x7f037c0b6970 2024-09-15T23:14:28.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.237+0000 7f0381f2a640 1 --2- 172.21.15.123:0/2941751562 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f037c15ed20 0x7f037c0cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:28.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.237+0000 7f0380f28640 1 --2- 172.21.15.123:0/2941751562 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f037c0d23b0 0x7f037c0cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:28.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.237+0000 7f0381729640 1 --2- 172.21.15.123:0/2941751562 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f037c0b6970 0x7f037c0ce0e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f037400c780 tx=0x7f037400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:28.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.237+0000 7f0379ffb640 1 -- 172.21.15.123:0/2941751562 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0374018070 con 0x7f037c0b6970 2024-09-15T23:14:28.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.237+0000 7f0379ffb640 1 -- 172.21.15.123:0/2941751562 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03740072d0 con 0x7f037c0b6970 2024-09-15T23:14:28.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.237+0000 7f038398d640 1 -- 172.21.15.123:0/2941751562 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f037c0cd080 con 0x7f037c0b6970 2024-09-15T23:14:28.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.237+0000 7f0379ffb640 1 -- 172.21.15.123:0/2941751562 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03740047e0 con 0x7f037c0b6970 2024-09-15T23:14:28.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.237+0000 7f038398d640 1 -- 172.21.15.123:0/2941751562 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f037c0cd8e0 con 0x7f037c0b6970 2024-09-15T23:14:28.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.238+0000 7f038398d640 1 -- 172.21.15.123:0/2941751562 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f037c0b7010 con 0x7f037c0b6970 2024-09-15T23:14:28.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.238+0000 7f0379ffb640 1 -- 172.21.15.123:0/2941751562 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f037401b070 con 0x7f037c0b6970 2024-09-15T23:14:28.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.239+0000 7f0379ffb640 1 --2- 172.21.15.123:0/2941751562 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f036806c2e0 0x7f036806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:28.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.239+0000 7f0379ffb640 1 -- 172.21.15.123:0/2941751562 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4943+0+0 (secure 0 0 0) 0x7f037408a460 con 0x7f037c0b6970 2024-09-15T23:14:28.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.239+0000 7f0380f28640 1 --2- 172.21.15.123:0/2941751562 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f036806c2e0 0x7f036806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:28.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.239+0000 7f0380f28640 1 --2- 172.21.15.123:0/2941751562 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f036806c2e0 0x7f036806e7a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f037c0ba470 tx=0x7f03700073a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:28.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.243+0000 7f0379ffb640 1 -- 172.21.15.123:0/2941751562 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f037c160ce0 con 0x7f037c0b6970 2024-09-15T23:14:28.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.473+0000 7f038398d640 1 -- 172.21.15.123:0/2941751562 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]} v 0) -- 0x7f037c0d0a90 con 0x7f037c0b6970 2024-09-15T23:14:28.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.537+0000 7f0379ffb640 1 -- 172.21.15.123:0/2941751562 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]}]=0 v121) ==== 146+0+0 (secure 0 0 0) 0x7f037c0d0e70 con 0x7f037c0b6970 2024-09-15T23:14:28.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.539+0000 7f038398d640 1 -- 172.21.15.123:0/2941751562 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f036806c2e0 msgr2=0x7f036806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:28.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.539+0000 7f038398d640 1 --2- 172.21.15.123:0/2941751562 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f036806c2e0 0x7f036806e7a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f037c0ba470 tx=0x7f03700073a0 comp rx=0 tx=0).stop 2024-09-15T23:14:28.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.539+0000 7f038398d640 1 -- 172.21.15.123:0/2941751562 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f037c0b6970 msgr2=0x7f037c0ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:28.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.539+0000 7f038398d640 1 --2- 172.21.15.123:0/2941751562 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f037c0b6970 0x7f037c0ce0e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f037400c780 tx=0x7f037400cc40 comp rx=0 tx=0).stop 2024-09-15T23:14:28.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.539+0000 7f038398d640 1 -- 172.21.15.123:0/2941751562 shutdown_connections 2024-09-15T23:14:28.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.539+0000 7f038398d640 1 --2- 172.21.15.123:0/2941751562 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f037c15ed20 0x7f037c0cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:28.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.539+0000 7f038398d640 1 --2- 172.21.15.123:0/2941751562 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f037c0d23b0 0x7f037c0cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:28.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.539+0000 7f038398d640 1 --2- 172.21.15.123:0/2941751562 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f036806c2e0 0x7f036806e7a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:28.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.539+0000 7f038398d640 1 --2- 172.21.15.123:0/2941751562 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f037c0b6970 0x7f037c0ce0e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:28.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.539+0000 7f038398d640 1 -- 172.21.15.123:0/2941751562 >> 172.21.15.123:0/2941751562 conn(0x7f037c0d1260 msgr2=0x7f037c0b5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:28.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.539+0000 7f038398d640 1 -- 172.21.15.123:0/2941751562 shutdown_connections 2024-09-15T23:14:28.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.539+0000 7f038398d640 1 -- 172.21.15.123:0/2941751562 wait complete. 2024-09-15T23:14:28.552 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T23:14:28.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.652+0000 7f5b8e6d0640 1 Processor -- start 2024-09-15T23:14:28.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.652+0000 7f5b8e6d0640 1 -- start start 2024-09-15T23:14:28.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.653+0000 7f5b8e6d0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5b881607d0 0x7f5b880cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:28.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.653+0000 7f5b8e6d0640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5b880cf6f0 0x7f5b880b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:28.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.653+0000 7f5b8e6d0640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b880b38b0 con 0x7f5b8806f8b0 2024-09-15T23:14:28.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.653+0000 7f5b8e6d0640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f5b880cfee0 con 0x7f5b880cf6f0 2024-09-15T23:14:28.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.653+0000 7f5b8e6d0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5b880d01c0 con 0x7f5b881607d0 2024-09-15T23:14:28.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.653+0000 7f5b8cc6d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5b880cf6f0 0x7f5b880b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:28.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.653+0000 7f5b8cc6d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5b880cf6f0 0x7f5b880b4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35998/0 (socket says 172.21.15.123:35998) 2024-09-15T23:14:28.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.653+0000 7f5b87fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f5b8806f8b0 0x7f5b881600c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38812/0 (socket says 172.21.15.123:38812) 2024-09-15T23:14:28.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.653+0000 7f5b8cc6d640 1 -- 172.21.15.123:0/3497843833 learned_addr learned my addr 172.21.15.123:0/3497843833 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:28.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.653+0000 7f5b877fe640 1 --2- 172.21.15.123:0/3497843833 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5b881607d0 0x7f5b880cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:28.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.653+0000 7f5b8cc6d640 1 -- 172.21.15.123:0/3497843833 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5b881607d0 msgr2=0x7f5b880cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:28.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.653+0000 7f5b8cc6d640 1 --2- 172.21.15.123:0/3497843833 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5b881607d0 0x7f5b880cf1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:28.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.653+0000 7f5b8cc6d640 1 -- 172.21.15.123:0/3497843833 >> v1:172.21.15.123:6789/0 conn(0x7f5b8806f8b0 legacy=0x7f5b881600c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:28.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.653+0000 7f5b8cc6d640 1 -- 172.21.15.123:0/3497843833 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b880b3b20 con 0x7f5b880cf6f0 2024-09-15T23:14:28.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.654+0000 7f5b8cc6d640 1 --2- 172.21.15.123:0/3497843833 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b880cf6f0 0x7f5b880b4040 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5b80009e50 tx=0x7f5b8002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124692a2656fdedf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:28.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.654+0000 7f5b86ffd640 1 -- 172.21.15.123:0/3497843833 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b80036070 con 0x7f5b880cf6f0 2024-09-15T23:14:28.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.654+0000 7f5b86ffd640 1 -- 172.21.15.123:0/3497843833 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b80031600 con 0x7f5b880cf6f0 2024-09-15T23:14:28.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.654+0000 7f5b86ffd640 1 -- 172.21.15.123:0/3497843833 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b800319d0 con 0x7f5b880cf6f0 2024-09-15T23:14:28.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.655+0000 7f5b8e6d0640 1 -- 172.21.15.123:0/3497843833 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b880cf6f0 msgr2=0x7f5b880b4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:28.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.655+0000 7f5b8e6d0640 1 --2- 172.21.15.123:0/3497843833 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b880cf6f0 0x7f5b880b4040 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5b80009e50 tx=0x7f5b8002a680 comp rx=0 tx=0).stop 2024-09-15T23:14:28.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.655+0000 7f5b8e6d0640 1 -- 172.21.15.123:0/3497843833 shutdown_connections 2024-09-15T23:14:28.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.655+0000 7f5b8e6d0640 1 --2- 172.21.15.123:0/3497843833 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b880cf6f0 0x7f5b880b4040 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:28.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.655+0000 7f5b8e6d0640 1 --2- 172.21.15.123:0/3497843833 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5b881607d0 0x7f5b880cf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:28.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.655+0000 7f5b8e6d0640 1 -- 172.21.15.123:0/3497843833 >> 172.21.15.123:0/3497843833 conn(0x7f5b880b2510 msgr2=0x7f5b880b28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:28.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.655+0000 7f5b8e6d0640 1 -- 172.21.15.123:0/3497843833 shutdown_connections 2024-09-15T23:14:28.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.655+0000 7f5b8e6d0640 1 -- 172.21.15.123:0/3497843833 wait complete. 2024-09-15T23:14:28.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.656+0000 7f5b8e6d0640 1 Processor -- start 2024-09-15T23:14:28.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.656+0000 7f5b8e6d0640 1 -- start start 2024-09-15T23:14:28.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.657+0000 7f5b8e6d0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b8806f8b0 0x7f5b880aade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:28.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.657+0000 7f5b8e6d0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5b880cf6f0 0x7f5b881f5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:28.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.657+0000 7f5b8e6d0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5b881607d0 0x7f5b881f5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:28.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.657+0000 7f5b8e6d0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5b880cfb80 con 0x7f5b8806f8b0 2024-09-15T23:14:28.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.657+0000 7f5b8e6d0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8806fc90 con 0x7f5b881607d0 2024-09-15T23:14:28.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.657+0000 7f5b8e6d0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5b880b4580 con 0x7f5b880cf6f0 2024-09-15T23:14:28.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.657+0000 7f5b87fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b8806f8b0 0x7f5b880aade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:28.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.657+0000 7f5b87fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b8806f8b0 0x7f5b880aade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36000/0 (socket says 172.21.15.123:36000) 2024-09-15T23:14:28.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.657+0000 7f5b87fff640 1 -- 172.21.15.123:0/2384171680 learned_addr learned my addr 172.21.15.123:0/2384171680 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:28.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.657+0000 7f5b87fff640 1 -- 172.21.15.123:0/2384171680 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5b880cf6f0 msgr2=0x7f5b881f5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:28.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.657+0000 7f5b87fff640 1 --2- 172.21.15.123:0/2384171680 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5b880cf6f0 0x7f5b881f5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:28.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.657+0000 7f5b87fff640 1 -- 172.21.15.123:0/2384171680 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5b881607d0 msgr2=0x7f5b881f5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:28.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.657+0000 7f5b87fff640 1 --2- 172.21.15.123:0/2384171680 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5b881607d0 0x7f5b881f5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:28.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.657+0000 7f5b87fff640 1 -- 172.21.15.123:0/2384171680 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b880ab6e0 con 0x7f5b8806f8b0 2024-09-15T23:14:28.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.657+0000 7f5b87fff640 1 --2- 172.21.15.123:0/2384171680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b8806f8b0 0x7f5b880aade0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5b7800c3c0 tx=0x7f5b7800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:28.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.658+0000 7f5b84ff9640 1 -- 172.21.15.123:0/2384171680 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b780074e0 con 0x7f5b8806f8b0 2024-09-15T23:14:28.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.658+0000 7f5b84ff9640 1 -- 172.21.15.123:0/2384171680 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b78007680 con 0x7f5b8806f8b0 2024-09-15T23:14:28.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.658+0000 7f5b8e6d0640 1 -- 172.21.15.123:0/2384171680 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b880ab9c0 con 0x7f5b8806f8b0 2024-09-15T23:14:28.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.658+0000 7f5b84ff9640 1 -- 172.21.15.123:0/2384171680 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b78004a00 con 0x7f5b8806f8b0 2024-09-15T23:14:28.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.658+0000 7f5b8e6d0640 1 -- 172.21.15.123:0/2384171680 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b880abf80 con 0x7f5b8806f8b0 2024-09-15T23:14:28.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.659+0000 7f5b8e6d0640 1 -- 172.21.15.123:0/2384171680 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b880b4040 con 0x7f5b8806f8b0 2024-09-15T23:14:28.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.659+0000 7f5b84ff9640 1 -- 172.21.15.123:0/2384171680 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5b7801a020 con 0x7f5b8806f8b0 2024-09-15T23:14:28.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.660+0000 7f5b84ff9640 1 --2- 172.21.15.123:0/2384171680 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5b7406c2b0 0x7f5b7406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:28.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.660+0000 7f5b84ff9640 1 -- 172.21.15.123:0/2384171680 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4943+0+0 (secure 0 0 0) 0x7f5b7808a8b0 con 0x7f5b8806f8b0 2024-09-15T23:14:28.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.660+0000 7f5b877fe640 1 --2- 172.21.15.123:0/2384171680 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5b7406c2b0 0x7f5b7406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:28.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.660+0000 7f5b877fe640 1 --2- 172.21.15.123:0/2384171680 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5b7406c2b0 0x7f5b7406e770 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5b8815c510 tx=0x7f5b7c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:28.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.664+0000 7f5b84ff9640 1 -- 172.21.15.123:0/2384171680 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5b78059320 con 0x7f5b8806f8b0 2024-09-15T23:14:28.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.833+0000 7f5b8e6d0640 1 -- 172.21.15.123:0/2384171680 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f5b880d1350 con 0x7f5b8806f8b0 2024-09-15T23:14:28.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.839+0000 7f5b84ff9640 1 -- 172.21.15.123:0/2384171680 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7f5b78058c20 con 0x7f5b8806f8b0 2024-09-15T23:14:28.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.841+0000 7f5b8e6d0640 1 -- 172.21.15.123:0/2384171680 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5b7406c2b0 msgr2=0x7f5b7406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:28.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.841+0000 7f5b8e6d0640 1 --2- 172.21.15.123:0/2384171680 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5b7406c2b0 0x7f5b7406e770 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5b8815c510 tx=0x7f5b7c008040 comp rx=0 tx=0).stop 2024-09-15T23:14:28.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.841+0000 7f5b8e6d0640 1 -- 172.21.15.123:0/2384171680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b8806f8b0 msgr2=0x7f5b880aade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:28.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.841+0000 7f5b8e6d0640 1 --2- 172.21.15.123:0/2384171680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b8806f8b0 0x7f5b880aade0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5b7800c3c0 tx=0x7f5b7800c880 comp rx=0 tx=0).stop 2024-09-15T23:14:28.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.841+0000 7f5b8e6d0640 1 -- 172.21.15.123:0/2384171680 shutdown_connections 2024-09-15T23:14:28.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.841+0000 7f5b8e6d0640 1 --2- 172.21.15.123:0/2384171680 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5b881607d0 0x7f5b881f5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:28.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.841+0000 7f5b8e6d0640 1 --2- 172.21.15.123:0/2384171680 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5b880cf6f0 0x7f5b881f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:28.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.841+0000 7f5b8e6d0640 1 --2- 172.21.15.123:0/2384171680 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5b7406c2b0 0x7f5b7406e770 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:28.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.841+0000 7f5b8e6d0640 1 --2- 172.21.15.123:0/2384171680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b8806f8b0 0x7f5b880aade0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:28.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.841+0000 7f5b8e6d0640 1 -- 172.21.15.123:0/2384171680 >> 172.21.15.123:0/2384171680 conn(0x7f5b880b2510 msgr2=0x7f5b8815f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:28.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.841+0000 7f5b8e6d0640 1 -- 172.21.15.123:0/2384171680 shutdown_connections 2024-09-15T23:14:28.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:28.841+0000 7f5b8e6d0640 1 -- 172.21.15.123:0/2384171680 wait complete. 2024-09-15T23:14:28.853 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:14:28.854 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:14:28.891 DEBUG:teuthology.orchestra.run.smithi188:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:14:28.932 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:14:28.932 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:14:28.932 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:14:28.948 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:14:28.948 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:14:28.948 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:14:28.990 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:14:28.990 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:14:28.990 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:14:29.005 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:14:29.006 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:14:29.006 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:14:29.049 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:14:29.049 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-15T23:14:29.050 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:14:29.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.147+0000 7fd688778640 1 Processor -- start 2024-09-15T23:14:29.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.147+0000 7fd688778640 1 -- start start 2024-09-15T23:14:29.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.147+0000 7fd688778640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd68015ed20 0x7fd6800b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:29.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.148+0000 7fd688778640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd6800b90e0 0x7fd6800b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:29.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.148+0000 7fd688778640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6800d0e70 con 0x7fd6800d23b0 2024-09-15T23:14:29.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.148+0000 7fd688778640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fd6800d41c0 con 0x7fd6800b90e0 2024-09-15T23:14:29.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.148+0000 7fd688778640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fd6800d35b0 con 0x7fd68015ed20 2024-09-15T23:14:29.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.148+0000 7fd686d15640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd6800b90e0 0x7fd6800b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:29.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.148+0000 7fd685d13640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd6800d23b0 0x7fd6800cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38826/0 (socket says 172.21.15.123:38826) 2024-09-15T23:14:29.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.148+0000 7fd685d13640 1 -- 172.21.15.123:0/2496175307 learned_addr learned my addr 172.21.15.123:0/2496175307 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:29.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.148+0000 7fd686514640 1 --2- 172.21.15.123:0/2496175307 >> v2:172.21.15.188:3300/0 conn(0x7fd68015ed20 0x7fd6800b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:29.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.148+0000 7fd686d15640 1 -- 172.21.15.123:0/2496175307 >> v2:172.21.15.188:3300/0 conn(0x7fd68015ed20 msgr2=0x7fd6800b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:29.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.148+0000 7fd686d15640 1 --2- 172.21.15.123:0/2496175307 >> v2:172.21.15.188:3300/0 conn(0x7fd68015ed20 0x7fd6800b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:29.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.148+0000 7fd686d15640 1 -- 172.21.15.123:0/2496175307 >> v1:172.21.15.123:6789/0 conn(0x7fd6800d23b0 legacy=0x7fd6800cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:29.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.148+0000 7fd686d15640 1 -- 172.21.15.123:0/2496175307 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6800d3890 con 0x7fd6800b90e0 2024-09-15T23:14:29.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.148+0000 7fd685512640 1 -- 172.21.15.123:0/2496175307 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 980823537 0 0) 0x7fd674001110 con 0x7fd6800d23b0 2024-09-15T23:14:29.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.149+0000 7fd686d15640 1 --2- 172.21.15.123:0/2496175307 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6800b90e0 0x7fd6800b67a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd6800d47b0 tx=0x7fd67002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ca6b56cf71938f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:29.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.149+0000 7fd685512640 1 -- 172.21.15.123:0/2496175307 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd670007740 con 0x7fd6800b90e0 2024-09-15T23:14:29.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.149+0000 7fd685512640 1 -- 172.21.15.123:0/2496175307 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6700078e0 con 0x7fd6800b90e0 2024-09-15T23:14:29.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.149+0000 7fd685512640 1 -- 172.21.15.123:0/2496175307 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd670007cb0 con 0x7fd6800b90e0 2024-09-15T23:14:29.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.149+0000 7fd688778640 1 -- 172.21.15.123:0/2496175307 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6800b90e0 msgr2=0x7fd6800b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:29.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.149+0000 7fd688778640 1 --2- 172.21.15.123:0/2496175307 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6800b90e0 0x7fd6800b67a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd6800d47b0 tx=0x7fd67002a5f0 comp rx=0 tx=0).stop 2024-09-15T23:14:29.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.149+0000 7fd688778640 1 -- 172.21.15.123:0/2496175307 shutdown_connections 2024-09-15T23:14:29.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.149+0000 7fd688778640 1 --2- 172.21.15.123:0/2496175307 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6800b90e0 0x7fd6800b67a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:29.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.149+0000 7fd688778640 1 --2- 172.21.15.123:0/2496175307 >> v2:172.21.15.188:3300/0 conn(0x7fd68015ed20 0x7fd6800b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:29.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.149+0000 7fd688778640 1 -- 172.21.15.123:0/2496175307 >> 172.21.15.123:0/2496175307 conn(0x7fd6800d1260 msgr2=0x7fd6800d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:29.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.149+0000 7fd688778640 1 -- 172.21.15.123:0/2496175307 shutdown_connections 2024-09-15T23:14:29.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.149+0000 7fd688778640 1 -- 172.21.15.123:0/2496175307 wait complete. 2024-09-15T23:14:29.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.151+0000 7fd688778640 1 Processor -- start 2024-09-15T23:14:29.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.151+0000 7fd688778640 1 -- start start 2024-09-15T23:14:29.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.151+0000 7fd688778640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6800b90e0 0x7fd680154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:29.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.151+0000 7fd688778640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6800d23b0 0x7fd6801e9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:29.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.151+0000 7fd688778640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd68015ed20 0x7fd6801e9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:29.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.151+0000 7fd688778640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd6800d32a0 con 0x7fd6800d23b0 2024-09-15T23:14:29.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.151+0000 7fd688778640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd6800d3e50 con 0x7fd68015ed20 2024-09-15T23:14:29.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.151+0000 7fd688778640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd68015f100 con 0x7fd6800b90e0 2024-09-15T23:14:29.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.151+0000 7fd685d13640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6800d23b0 0x7fd6801e9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:29.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.151+0000 7fd685d13640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6800d23b0 0x7fd6801e9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36026/0 (socket says 172.21.15.123:36026) 2024-09-15T23:14:29.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.151+0000 7fd685d13640 1 -- 172.21.15.123:0/3317793010 learned_addr learned my addr 172.21.15.123:0/3317793010 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:29.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.152+0000 7fd686d15640 1 --2- 172.21.15.123:0/3317793010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd68015ed20 0x7fd6801e9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:29.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.152+0000 7fd686514640 1 --2- 172.21.15.123:0/3317793010 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6800b90e0 0x7fd680154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:29.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.152+0000 7fd685d13640 1 -- 172.21.15.123:0/3317793010 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6800b90e0 msgr2=0x7fd680154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:29.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.152+0000 7fd685d13640 1 --2- 172.21.15.123:0/3317793010 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6800b90e0 0x7fd680154f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:29.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.152+0000 7fd685d13640 1 -- 172.21.15.123:0/3317793010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd68015ed20 msgr2=0x7fd6801e9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:29.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.152+0000 7fd685d13640 1 --2- 172.21.15.123:0/3317793010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd68015ed20 0x7fd6801e9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:29.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.152+0000 7fd685d13640 1 -- 172.21.15.123:0/3317793010 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd680155450 con 0x7fd6800d23b0 2024-09-15T23:14:29.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.152+0000 7fd685d13640 1 --2- 172.21.15.123:0/3317793010 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6800d23b0 0x7fd6801e9220 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd67400c780 tx=0x7fd67400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:29.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.152+0000 7fd67effd640 1 -- 172.21.15.123:0/3317793010 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd674018070 con 0x7fd6800d23b0 2024-09-15T23:14:29.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.152+0000 7fd67effd640 1 -- 172.21.15.123:0/3317793010 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6740072d0 con 0x7fd6800d23b0 2024-09-15T23:14:29.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.152+0000 7fd67effd640 1 -- 172.21.15.123:0/3317793010 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6740047e0 con 0x7fd6800d23b0 2024-09-15T23:14:29.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.152+0000 7fd688778640 1 -- 172.21.15.123:0/3317793010 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6801606c0 con 0x7fd6800d23b0 2024-09-15T23:14:29.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.152+0000 7fd688778640 1 -- 172.21.15.123:0/3317793010 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd680160c80 con 0x7fd6800d23b0 2024-09-15T23:14:29.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.153+0000 7fd688778640 1 -- 172.21.15.123:0/3317793010 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6800b7010 con 0x7fd6800d23b0 2024-09-15T23:14:29.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.153+0000 7fd67effd640 1 -- 172.21.15.123:0/3317793010 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd67401b070 con 0x7fd6800d23b0 2024-09-15T23:14:29.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.154+0000 7fd67effd640 1 --2- 172.21.15.123:0/3317793010 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd66c06c2e0 0x7fd66c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:29.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.154+0000 7fd67effd640 1 -- 172.21.15.123:0/3317793010 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4943+0+0 (secure 0 0 0) 0x7fd67408a3a0 con 0x7fd6800d23b0 2024-09-15T23:14:29.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.154+0000 7fd686514640 1 --2- 172.21.15.123:0/3317793010 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd66c06c2e0 0x7fd66c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:29.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.155+0000 7fd686514640 1 --2- 172.21.15.123:0/3317793010 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd66c06c2e0 0x7fd66c06e7a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd678006fd0 tx=0x7fd678008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:29.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.158+0000 7fd67effd640 1 -- 172.21.15.123:0/3317793010 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd680155450 con 0x7fd6800d23b0 2024-09-15T23:14:29.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.358+0000 7fd688778640 1 -- 172.21.15.123:0/3317793010 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6800b3f20 con 0x7fd6800d23b0 2024-09-15T23:14:29.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.358+0000 7fd67effd640 1 -- 172.21.15.123:0/3317793010 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+3916 (secure 0 0 0) 0x7fd6800d0e70 con 0x7fd6800d23b0 2024-09-15T23:14:29.359 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:14:29.360 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":16,"btime":"2024-09-15T23:14:24:516677+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/324550176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":324550176},{"type":"v1","addr":"172.21.15.188:6837","nonce":324550176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4696,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2893461525","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2893461525},{"type":"v1","addr":"172.21.15.188:6836","nonce":2893461525}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4773,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/4033133132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":4033133132},{"type":"v1","addr":"172.21.15.123:6833","nonce":4033133132}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":5160,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/613622167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":613622167},{"type":"v1","addr":"172.21.15.123:6835","nonce":613622167}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[]} 2024-09-15T23:14:29.360 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 16 2024-09-15T23:14:29.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.360+0000 7fd688778640 1 -- 172.21.15.123:0/3317793010 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd66c06c2e0 msgr2=0x7fd66c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:29.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.360+0000 7fd688778640 1 --2- 172.21.15.123:0/3317793010 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd66c06c2e0 0x7fd66c06e7a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd678006fd0 tx=0x7fd678008040 comp rx=0 tx=0).stop 2024-09-15T23:14:29.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.360+0000 7fd688778640 1 -- 172.21.15.123:0/3317793010 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6800d23b0 msgr2=0x7fd6801e9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:29.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.360+0000 7fd688778640 1 --2- 172.21.15.123:0/3317793010 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6800d23b0 0x7fd6801e9220 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd67400c780 tx=0x7fd67400cc40 comp rx=0 tx=0).stop 2024-09-15T23:14:29.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.360+0000 7fd688778640 1 -- 172.21.15.123:0/3317793010 shutdown_connections 2024-09-15T23:14:29.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.360+0000 7fd688778640 1 --2- 172.21.15.123:0/3317793010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd68015ed20 0x7fd6801e9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:29.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.360+0000 7fd688778640 1 --2- 172.21.15.123:0/3317793010 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd66c06c2e0 0x7fd66c06e7a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:29.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.360+0000 7fd688778640 1 --2- 172.21.15.123:0/3317793010 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6800d23b0 0x7fd6801e9220 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:29.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.360+0000 7fd688778640 1 --2- 172.21.15.123:0/3317793010 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6800b90e0 0x7fd680154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:29.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.360+0000 7fd688778640 1 -- 172.21.15.123:0/3317793010 >> 172.21.15.123:0/3317793010 conn(0x7fd6800d1260 msgr2=0x7fd6800b6510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:29.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.360+0000 7fd688778640 1 -- 172.21.15.123:0/3317793010 shutdown_connections 2024-09-15T23:14:29.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.360+0000 7fd688778640 1 -- 172.21.15.123:0/3317793010 wait complete. 2024-09-15T23:14:29.372 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T23:14:29.373 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T23:14:29.373 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T23:14:29.373 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:14:29.373 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T23:14:29.373 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T23:14:29.373 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T23:14:29.373 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:14:29.374 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T23:14:29.374 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T23:14:29.374 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T23:14:29.374 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:14:29.374 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T23:14:29.374 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T23:14:29.374 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T23:14:29.375 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:14:29.382 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T23:14:29.383 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T23:14:29.383 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T23:14:29.383 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T23:14:29.389 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T23:14:29.389 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T23:14:29.390 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T23:14:29.390 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T23:14:29.425 INFO:tasks.ceph.mds.a:Started 2024-09-15T23:14:29.425 DEBUG:teuthology.parallel:result is None 2024-09-15T23:14:29.426 INFO:tasks.ceph.mds.c:Started 2024-09-15T23:14:29.426 DEBUG:teuthology.parallel:result is None 2024-09-15T23:14:29.432 INFO:tasks.ceph.mds.b:Started 2024-09-15T23:14:29.432 DEBUG:teuthology.parallel:result is None 2024-09-15T23:14:29.433 INFO:tasks.ceph.mds.d:Started 2024-09-15T23:14:29.433 DEBUG:teuthology.parallel:result is None 2024-09-15T23:14:29.434 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T23:14:29.500 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-15T23:14:29.500 INFO:tasks.ceph.mds.a.smithi123.stdout:starting mds.a at 2024-09-15T23:14:29.518 INFO:tasks.ceph.mds.d.smithi188.stdout:starting mds.d at 2024-09-15T23:14:29.518 INFO:tasks.ceph.mds.b.smithi188.stdout:starting mds.b at 2024-09-15T23:14:29.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.537+0000 7f8b35586640 1 Processor -- start 2024-09-15T23:14:29.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.537+0000 7f8b35586640 1 -- start start 2024-09-15T23:14:29.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.538+0000 7f8b35586640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f8b3015e910 0x7f8b300731a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:29.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.538+0000 7f8b35586640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8b300cfd00 0x7f8b300b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:29.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.538+0000 7f8b35586640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b300d22a0 con 0x7f8b300b4800 2024-09-15T23:14:29.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.538+0000 7f8b35586640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f8b3015ecf0 con 0x7f8b3015e910 2024-09-15T23:14:29.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.538+0000 7f8b35586640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8b300d2e70 con 0x7f8b300cfd00 2024-09-15T23:14:29.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.538+0000 7f8b2f7fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8b300b4800 0x7f8b300cb9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38844/0 (socket says 172.21.15.123:38844) 2024-09-15T23:14:29.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.538+0000 7f8b2f7fe640 1 -- 172.21.15.123:0/39366515 learned_addr learned my addr 172.21.15.123:0/39366515 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:29.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.538+0000 7f8b2e7fc640 1 --2- 172.21.15.123:0/39366515 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8b300cfd00 0x7f8b300b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:29.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.538+0000 7f8b2effd640 1 --2- 172.21.15.123:0/39366515 >> v2:172.21.15.188:3300/0 conn(0x7f8b3015e910 0x7f8b300731a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:29.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.539+0000 7f8b2dffb640 1 -- 172.21.15.123:0/39366515 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1295578935 0 0) 0x7f8b300d22a0 con 0x7f8b300b4800 2024-09-15T23:14:29.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.539+0000 7f8b2dffb640 1 -- 172.21.15.123:0/39366515 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b1c003520 con 0x7f8b300b4800 2024-09-15T23:14:29.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.539+0000 7f8b2e7fc640 1 -- 172.21.15.123:0/39366515 >> v2:172.21.15.188:3300/0 conn(0x7f8b3015e910 msgr2=0x7f8b300731a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:29.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.539+0000 7f8b2e7fc640 1 --2- 172.21.15.123:0/39366515 >> v2:172.21.15.188:3300/0 conn(0x7f8b3015e910 0x7f8b300731a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:29.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.539+0000 7f8b2e7fc640 1 -- 172.21.15.123:0/39366515 >> v1:172.21.15.123:6789/0 conn(0x7f8b300b4800 legacy=0x7f8b300cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:29.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.539+0000 7f8b2e7fc640 1 -- 172.21.15.123:0/39366515 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b300736e0 con 0x7f8b300cfd00 2024-09-15T23:14:29.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.539+0000 7f8b2effd640 1 --2- 172.21.15.123:0/39366515 >> v2:172.21.15.188:3300/0 conn(0x7f8b3015e910 0x7f8b300731a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:14:29.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.539+0000 7f8b2e7fc640 1 --2- 172.21.15.123:0/39366515 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8b300cfd00 0x7f8b300b42c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8b180097a0 tx=0x7f8b1802a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5451f3b84f9e4f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:29.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.540+0000 7f8b2dffb640 1 -- 172.21.15.123:0/39366515 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b18037070 con 0x7f8b300cfd00 2024-09-15T23:14:29.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.540+0000 7f8b2dffb640 1 -- 172.21.15.123:0/39366515 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b1802adb0 con 0x7f8b300cfd00 2024-09-15T23:14:29.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.540+0000 7f8b2dffb640 1 -- 172.21.15.123:0/39366515 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b18032640 con 0x7f8b300cfd00 2024-09-15T23:14:29.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.540+0000 7f8b35586640 1 -- 172.21.15.123:0/39366515 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8b300cfd00 msgr2=0x7f8b300b42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:29.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.540+0000 7f8b35586640 1 --2- 172.21.15.123:0/39366515 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8b300cfd00 0x7f8b300b42c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8b180097a0 tx=0x7f8b1802a060 comp rx=0 tx=0).stop 2024-09-15T23:14:29.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.540+0000 7f8b35586640 1 -- 172.21.15.123:0/39366515 shutdown_connections 2024-09-15T23:14:29.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.540+0000 7f8b35586640 1 --2- 172.21.15.123:0/39366515 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8b300cfd00 0x7f8b300b42c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:29.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.540+0000 7f8b35586640 1 --2- 172.21.15.123:0/39366515 >> v2:172.21.15.188:3300/0 conn(0x7f8b3015e910 0x7f8b300731a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:29.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.540+0000 7f8b35586640 1 -- 172.21.15.123:0/39366515 >> 172.21.15.123:0/39366515 conn(0x7f8b30067950 msgr2=0x7f8b30067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:29.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.540+0000 7f8b35586640 1 -- 172.21.15.123:0/39366515 shutdown_connections 2024-09-15T23:14:29.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.540+0000 7f8b35586640 1 -- 172.21.15.123:0/39366515 wait complete. 2024-09-15T23:14:29.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.542+0000 7f8b35586640 1 Processor -- start 2024-09-15T23:14:29.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.542+0000 7f8b35586640 1 -- start start 2024-09-15T23:14:29.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.543+0000 7f8b35586640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b300b4800 0x7f8b300b6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:29.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.543+0000 7f8b35586640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8b300cfd00 0x7f8b30156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:29.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.543+0000 7f8b35586640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b3015e910 0x7f8b3014c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:29.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.543+0000 7f8b35586640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8b300d2820 con 0x7f8b300b4800 2024-09-15T23:14:29.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.543+0000 7f8b35586640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8b300d1240 con 0x7f8b3015e910 2024-09-15T23:14:29.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.543+0000 7f8b35586640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8b300d2b00 con 0x7f8b300cfd00 2024-09-15T23:14:29.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.543+0000 7f8b2effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b300b4800 0x7f8b300b6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:29.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.543+0000 7f8b2effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b300b4800 0x7f8b300b6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36056/0 (socket says 172.21.15.123:36056) 2024-09-15T23:14:29.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.543+0000 7f8b2effd640 1 -- 172.21.15.123:0/3209769271 learned_addr learned my addr 172.21.15.123:0/3209769271 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:29.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.543+0000 7f8b2f7fe640 1 --2- 172.21.15.123:0/3209769271 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b3015e910 0x7f8b3014c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:29.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.543+0000 7f8b2e7fc640 1 --2- 172.21.15.123:0/3209769271 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8b300cfd00 0x7f8b30156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:29.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.544+0000 7f8b2effd640 1 -- 172.21.15.123:0/3209769271 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8b300cfd00 msgr2=0x7f8b30156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:29.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.544+0000 7f8b2effd640 1 --2- 172.21.15.123:0/3209769271 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8b300cfd00 0x7f8b30156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:29.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.544+0000 7f8b2effd640 1 -- 172.21.15.123:0/3209769271 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b3015e910 msgr2=0x7f8b3014c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:29.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.544+0000 7f8b2effd640 1 --2- 172.21.15.123:0/3209769271 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b3015e910 0x7f8b3014c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:29.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.544+0000 7f8b2effd640 1 -- 172.21.15.123:0/3209769271 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b30156c50 con 0x7f8b300b4800 2024-09-15T23:14:29.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.544+0000 7f8b2effd640 1 --2- 172.21.15.123:0/3209769271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b300b4800 0x7f8b300b6e50 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8b2000ebe0 tx=0x7f8b2000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:29.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.548+0000 7f8b277fe640 1 -- 172.21.15.123:0/3209769271 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b20017070 con 0x7f8b300b4800 2024-09-15T23:14:29.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.548+0000 7f8b277fe640 1 -- 172.21.15.123:0/3209769271 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b2000cc30 con 0x7f8b300b4800 2024-09-15T23:14:29.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.548+0000 7f8b35586640 1 -- 172.21.15.123:0/3209769271 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b30157620 con 0x7f8b300b4800 2024-09-15T23:14:29.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.548+0000 7f8b277fe640 1 -- 172.21.15.123:0/3209769271 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b20013470 con 0x7f8b300b4800 2024-09-15T23:14:29.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.548+0000 7f8b35586640 1 -- 172.21.15.123:0/3209769271 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b30157be0 con 0x7f8b300b4800 2024-09-15T23:14:29.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.549+0000 7f8b35586640 1 -- 172.21.15.123:0/3209769271 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b300d3300 con 0x7f8b300b4800 2024-09-15T23:14:29.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.550+0000 7f8b277fe640 1 -- 172.21.15.123:0/3209769271 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8b2001a070 con 0x7f8b300b4800 2024-09-15T23:14:29.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.550+0000 7f8b277fe640 1 --2- 172.21.15.123:0/3209769271 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8b1006c2b0 0x7f8b1006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:29.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.550+0000 7f8b277fe640 1 -- 172.21.15.123:0/3209769271 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4943+0+0 (secure 0 0 0) 0x7f8b2008b030 con 0x7f8b300b4800 2024-09-15T23:14:29.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.551+0000 7f8b2e7fc640 1 --2- 172.21.15.123:0/3209769271 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8b1006c2b0 0x7f8b1006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:29.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.551+0000 7f8b2e7fc640 1 --2- 172.21.15.123:0/3209769271 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8b1006c2b0 0x7f8b1006e770 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8b18034000 tx=0x7f8b1802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:29.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.559+0000 7f8b277fe640 1 -- 172.21.15.123:0/3209769271 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8b20059450 con 0x7f8b300b4800 2024-09-15T23:14:29.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:29.741+0000 7f8b35586640 1 -- 172.21.15.123:0/3209769271 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f8b300d0ff0 con 0x7f8b300b4800 2024-09-15T23:14:30.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.567+0000 7f8b277fe640 1 -- 172.21.15.123:0/3209769271 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v48) ==== 97+0+0 (secure 0 0 0) 0x7f8b2005d750 con 0x7f8b300b4800 2024-09-15T23:14:30.568 INFO:teuthology.orchestra.run.smithi123.stderr: removed all blocklist entries 2024-09-15T23:14:30.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.570+0000 7f8b35586640 1 -- 172.21.15.123:0/3209769271 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8b1006c2b0 msgr2=0x7f8b1006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:30.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.570+0000 7f8b35586640 1 --2- 172.21.15.123:0/3209769271 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8b1006c2b0 0x7f8b1006e770 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8b18034000 tx=0x7f8b1802e000 comp rx=0 tx=0).stop 2024-09-15T23:14:30.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.570+0000 7f8b35586640 1 -- 172.21.15.123:0/3209769271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b300b4800 msgr2=0x7f8b300b6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:30.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.570+0000 7f8b35586640 1 --2- 172.21.15.123:0/3209769271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b300b4800 0x7f8b300b6e50 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8b2000ebe0 tx=0x7f8b2000c520 comp rx=0 tx=0).stop 2024-09-15T23:14:30.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.570+0000 7f8b35586640 1 -- 172.21.15.123:0/3209769271 shutdown_connections 2024-09-15T23:14:30.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.570+0000 7f8b35586640 1 --2- 172.21.15.123:0/3209769271 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8b3015e910 0x7f8b3014c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:30.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.570+0000 7f8b35586640 1 --2- 172.21.15.123:0/3209769271 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8b300cfd00 0x7f8b30156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:30.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.570+0000 7f8b35586640 1 --2- 172.21.15.123:0/3209769271 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8b1006c2b0 0x7f8b1006e770 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:30.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.570+0000 7f8b35586640 1 --2- 172.21.15.123:0/3209769271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8b300b4800 0x7f8b300b6e50 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:30.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.570+0000 7f8b35586640 1 -- 172.21.15.123:0/3209769271 >> 172.21.15.123:0/3209769271 conn(0x7f8b30067950 msgr2=0x7f8b3015bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:30.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.570+0000 7f8b35586640 1 -- 172.21.15.123:0/3209769271 shutdown_connections 2024-09-15T23:14:30.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.570+0000 7f8b35586640 1 -- 172.21.15.123:0/3209769271 wait complete. 2024-09-15T23:14:30.583 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T23:14:30.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.683+0000 7fb9337cf640 1 Processor -- start 2024-09-15T23:14:30.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.683+0000 7fb9337cf640 1 -- start start 2024-09-15T23:14:30.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.684+0000 7fb9337cf640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb92c15ab40 0x7fb92c06c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:30.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.684+0000 7fb9337cf640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb92c0724f0 con 0x7fb92c15af20 2024-09-15T23:14:30.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.684+0000 7fb9337cf640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb92c071010 con 0x7fb92c0720b0 2024-09-15T23:14:30.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.684+0000 7fb9337cf640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb92c0712f0 con 0x7fb92c15ab40 2024-09-15T23:14:30.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.684+0000 7fb931d6c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb92c15af20 0x7fb92c15b370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38848/0 (socket says 172.21.15.123:38848) 2024-09-15T23:14:30.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.684+0000 7fb931d6c640 1 -- 172.21.15.123:0/3329430483 learned_addr learned my addr 172.21.15.123:0/3329430483 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:30.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.684+0000 7fb923fff640 1 -- 172.21.15.123:0/3329430483 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2557465517 0 0) 0x7fb92c0724f0 con 0x7fb92c15af20 2024-09-15T23:14:30.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.684+0000 7fb923fff640 1 -- 172.21.15.123:0/3329430483 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb918003520 con 0x7fb92c15af20 2024-09-15T23:14:30.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.684+0000 7fb93156b640 1 --2- 172.21.15.123:0/3329430483 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb92c15ab40 0x7fb92c06c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:30.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.685+0000 7fb923fff640 1 -- 172.21.15.123:0/3329430483 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2600893138 0 0) 0x7fb918003520 con 0x7fb92c15af20 2024-09-15T23:14:30.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.685+0000 7fb923fff640 1 -- 172.21.15.123:0/3329430483 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb92c15ab40 msgr2=0x7fb92c06c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:30.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.685+0000 7fb923fff640 1 --2- 172.21.15.123:0/3329430483 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb92c15ab40 0x7fb92c06c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:30.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.685+0000 7fb923fff640 1 -- 172.21.15.123:0/3329430483 >> v1:172.21.15.188:6789/0 conn(0x7fb92c0720b0 legacy=0x7fb92c073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:30.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.685+0000 7fb923fff640 1 -- 172.21.15.123:0/3329430483 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb92c0715d0 con 0x7fb92c15af20 2024-09-15T23:14:30.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.685+0000 7fb923fff640 1 -- 172.21.15.123:0/3329430483 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fb924001670 con 0x7fb92c15af20 2024-09-15T23:14:30.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.685+0000 7fb923fff640 1 -- 172.21.15.123:0/3329430483 >> v1:172.21.15.123:6789/0 conn(0x7fb92c15af20 legacy=0x7fb92c15b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:30.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.685+0000 7fb923fff640 1 --2- 172.21.15.123:0/3329430483 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9180039e0 0x7fb918003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:30.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.685+0000 7fb923fff640 1 --2- 172.21.15.123:0/3329430483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb918004800 0x7fb918004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:30.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.685+0000 7fb923fff640 1 --2- 172.21.15.123:0/3329430483 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb92c15ab40 0x7fb918005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:30.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.685+0000 7fb923fff640 1 -- 172.21.15.123:0/3329430483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb92c0712f0 con 0x7fb918004800 2024-09-15T23:14:30.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.685+0000 7fb923fff640 1 -- 172.21.15.123:0/3329430483 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb91800bac0 con 0x7fb9180039e0 2024-09-15T23:14:30.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.685+0000 7fb923fff640 1 -- 172.21.15.123:0/3329430483 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb91800bcc0 con 0x7fb92c15ab40 2024-09-15T23:14:30.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.685+0000 7fb930d6a640 1 --2- 172.21.15.123:0/3329430483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb918004800 0x7fb918004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:30.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.685+0000 7fb93156b640 1 --2- 172.21.15.123:0/3329430483 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9180039e0 0x7fb918003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:30.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.685+0000 7fb931d6c640 1 --2- 172.21.15.123:0/3329430483 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb92c15ab40 0x7fb918005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:30.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.685+0000 7fb930d6a640 1 -- 172.21.15.123:0/3329430483 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb92c15ab40 msgr2=0x7fb918005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:30.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.685+0000 7fb930d6a640 1 --2- 172.21.15.123:0/3329430483 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb92c15ab40 0x7fb918005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:30.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.685+0000 7fb930d6a640 1 -- 172.21.15.123:0/3329430483 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9180039e0 msgr2=0x7fb918003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:30.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.685+0000 7fb930d6a640 1 --2- 172.21.15.123:0/3329430483 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9180039e0 0x7fb918003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:30.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.685+0000 7fb930d6a640 1 -- 172.21.15.123:0/3329430483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb918003520 con 0x7fb918004800 2024-09-15T23:14:30.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.686+0000 7fb930d6a640 1 --2- 172.21.15.123:0/3329430483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb918004800 0x7fb918004c80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb91c001750 tx=0x7fb918005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d5d8cdfdc2d011 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:30.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.686+0000 7fb923fff640 1 -- 172.21.15.123:0/3329430483 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c001370 con 0x7fb918004800 2024-09-15T23:14:30.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.686+0000 7fb923fff640 1 -- 172.21.15.123:0/3329430483 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb91c0052d0 con 0x7fb918004800 2024-09-15T23:14:30.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.686+0000 7fb923fff640 1 -- 172.21.15.123:0/3329430483 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c02abe0 con 0x7fb918004800 2024-09-15T23:14:30.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.686+0000 7fb9337cf640 1 -- 172.21.15.123:0/3329430483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb918004800 msgr2=0x7fb918004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:30.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.686+0000 7fb9337cf640 1 --2- 172.21.15.123:0/3329430483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb918004800 0x7fb918004c80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb91c001750 tx=0x7fb918005830 comp rx=0 tx=0).stop 2024-09-15T23:14:30.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.686+0000 7fb931d6c640 1 -- 172.21.15.123:0/3329430483 reap_dead start 2024-09-15T23:14:30.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.687+0000 7fb9337cf640 1 -- 172.21.15.123:0/3329430483 shutdown_connections 2024-09-15T23:14:30.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.687+0000 7fb9337cf640 1 -- 172.21.15.123:0/3329430483 >> 172.21.15.123:0/3329430483 conn(0x7fb92c0ccec0 msgr2=0x7fb92c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:30.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.687+0000 7fb9337cf640 1 -- 172.21.15.123:0/3329430483 shutdown_connections 2024-09-15T23:14:30.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.687+0000 7fb9337cf640 1 -- 172.21.15.123:0/3329430483 wait complete. 2024-09-15T23:14:30.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.688+0000 7fb9337cf640 1 Processor -- start 2024-09-15T23:14:30.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.688+0000 7fb9337cf640 1 -- start start 2024-09-15T23:14:30.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.688+0000 7fb9337cf640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb918004800 0x7fb92c14e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:30.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.688+0000 7fb9337cf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb92c0acce0 0x7fb92c0ad160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:30.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.688+0000 7fb9337cf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb92c0c8f70 0x7fb92c0c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:30.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.688+0000 7fb9337cf640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb92c06c6a0 con 0x7fb92c0acce0 2024-09-15T23:14:30.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.688+0000 7fb9337cf640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb92c15ba80 con 0x7fb92c0c8f70 2024-09-15T23:14:30.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.688+0000 7fb9337cf640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb92c06c820 con 0x7fb918004800 2024-09-15T23:14:30.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.689+0000 7fb930d6a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb92c0acce0 0x7fb92c0ad160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:30.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.689+0000 7fb930d6a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb92c0acce0 0x7fb92c0ad160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36074/0 (socket says 172.21.15.123:36074) 2024-09-15T23:14:30.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.689+0000 7fb930d6a640 1 -- 172.21.15.123:0/3267442670 learned_addr learned my addr 172.21.15.123:0/3267442670 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:30.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.689+0000 7fb93156b640 1 --2- 172.21.15.123:0/3267442670 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb918004800 0x7fb92c14e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:30.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.689+0000 7fb931d6c640 1 --2- 172.21.15.123:0/3267442670 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb92c0c8f70 0x7fb92c0c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:30.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.689+0000 7fb930d6a640 1 -- 172.21.15.123:0/3267442670 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb918004800 msgr2=0x7fb92c14e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:30.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.689+0000 7fb930d6a640 1 --2- 172.21.15.123:0/3267442670 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb918004800 0x7fb92c14e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:30.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.689+0000 7fb930d6a640 1 -- 172.21.15.123:0/3267442670 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb92c0c8f70 msgr2=0x7fb92c0c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:30.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.689+0000 7fb930d6a640 1 --2- 172.21.15.123:0/3267442670 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb92c0c8f70 0x7fb92c0c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:30.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.689+0000 7fb930d6a640 1 -- 172.21.15.123:0/3267442670 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb92c0c9d10 con 0x7fb92c0acce0 2024-09-15T23:14:30.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.689+0000 7fb930d6a640 1 --2- 172.21.15.123:0/3267442670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb92c0acce0 0x7fb92c0ad160 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb91c008fd0 tx=0x7fb91c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:30.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.689+0000 7fb921ffb640 1 -- 172.21.15.123:0/3267442670 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c037040 con 0x7fb92c0acce0 2024-09-15T23:14:30.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.689+0000 7fb921ffb640 1 -- 172.21.15.123:0/3267442670 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb91c005480 con 0x7fb92c0acce0 2024-09-15T23:14:30.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.689+0000 7fb9337cf640 1 -- 172.21.15.123:0/3267442670 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb92c0aa750 con 0x7fb92c0acce0 2024-09-15T23:14:30.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.689+0000 7fb921ffb640 1 -- 172.21.15.123:0/3267442670 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb91c007a30 con 0x7fb92c0acce0 2024-09-15T23:14:30.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.689+0000 7fb9337cf640 1 -- 172.21.15.123:0/3267442670 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb92c0aad10 con 0x7fb92c0acce0 2024-09-15T23:14:30.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.691+0000 7fb9337cf640 1 -- 172.21.15.123:0/3267442670 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb92c15b370 con 0x7fb92c0acce0 2024-09-15T23:14:30.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.691+0000 7fb921ffb640 1 -- 172.21.15.123:0/3267442670 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb91c044020 con 0x7fb92c0acce0 2024-09-15T23:14:30.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.691+0000 7fb921ffb640 1 --2- 172.21.15.123:0/3267442670 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb91006c2e0 0x7fb91006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:30.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.691+0000 7fb921ffb640 1 -- 172.21.15.123:0/3267442670 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 4857+0+0 (secure 0 0 0) 0x7fb91c0aac00 con 0x7fb92c0acce0 2024-09-15T23:14:30.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.692+0000 7fb93156b640 1 --2- 172.21.15.123:0/3267442670 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb91006c2e0 0x7fb91006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:30.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.692+0000 7fb93156b640 1 --2- 172.21.15.123:0/3267442670 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb91006c2e0 0x7fb91006e7a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb928014510 tx=0x7fb92800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:30.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.696+0000 7fb921ffb640 1 -- 172.21.15.123:0/3267442670 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb91c0b1080 con 0x7fb92c0acce0 2024-09-15T23:14:30.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.924+0000 7fb9337cf640 1 -- 172.21.15.123:0/3267442670 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fb92c1598c0 con 0x7fb92c0acce0 2024-09-15T23:14:30.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.925+0000 7fb921ffb640 1 -- 172.21.15.123:0/3267442670 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) ==== 80+0+5304 (secure 0 0 0) 0x7fb91c079070 con 0x7fb92c0acce0 2024-09-15T23:14:30.926 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:14:30.926 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:14:30.926 INFO:teuthology.orchestra.run.smithi123.stdout: "auth_dump": [ 2024-09-15T23:14:30.926 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:14:30.926 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.a", 2024-09-15T23:14:30.926 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm9ATVDhAAnukyZogTuG4YCbzRXSCkiQ==", 2024-09-15T23:14:30.926 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:14:30.926 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:14:30.926 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:14:30.927 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:14:30.927 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:14:30.927 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:14:30.927 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:30.927 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:14:30.927 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.b", 2024-09-15T23:14:30.927 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm4KmaGhAAbf6vcffqiJTOYXK5DCXcZA==", 2024-09-15T23:14:30.927 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:14:30.927 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:14:30.927 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:14:30.927 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:14:30.927 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:14:30.927 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:14:30.927 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:30.928 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:14:30.928 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.c", 2024-09-15T23:14:30.928 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmua/VFRAAwbPm2TslrfQkrvHiO8oeLg==", 2024-09-15T23:14:30.928 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:14:30.928 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:14:30.928 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:14:30.928 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:14:30.928 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:14:30.928 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:14:30.928 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:30.928 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:14:30.928 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.d", 2024-09-15T23:14:30.928 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmzw3eIRAAaE+5y9USwp+xM3MTAndn7Q==", 2024-09-15T23:14:30.929 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:14:30.929 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:14:30.929 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:14:30.929 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:14:30.929 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:14:30.929 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:14:30.929 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:30.929 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:14:30.929 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.0", 2024-09-15T23:14:30.929 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCRaedmFrHGAxAAy/jTkothESNn2DC9xcHDAQ==", 2024-09-15T23:14:30.929 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:14:30.929 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:14:30.929 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:14:30.930 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:14:30.930 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:14:30.930 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:30.930 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:14:30.930 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.1", 2024-09-15T23:14:30.930 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCUaedm6vZlIxAAdsnLqFSng6SRpCT6UZKGsw==", 2024-09-15T23:14:30.930 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:14:30.930 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:14:30.930 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:14:30.930 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:14:30.930 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:14:30.930 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:30.930 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:14:30.931 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.2", 2024-09-15T23:14:30.931 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCYaedmXgVwFRAA1mOzzRafhKMsU7kTAT6TqA==", 2024-09-15T23:14:30.931 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:14:30.931 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:14:30.931 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:14:30.931 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:14:30.931 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:14:30.931 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:30.931 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:14:30.931 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.3", 2024-09-15T23:14:30.931 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCcaedm+APAFhAAb8blNFzswwHriSmCrMuA0A==", 2024-09-15T23:14:30.931 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:14:30.931 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:14:30.932 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:14:30.932 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:14:30.932 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:14:30.932 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:30.932 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:14:30.932 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.4", 2024-09-15T23:14:30.932 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCjaedmReUmABAAXpxsK7osxn/ZelVXKiCLOw==", 2024-09-15T23:14:30.932 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:14:30.932 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:14:30.932 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:14:30.932 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:14:30.932 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:14:30.933 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:30.933 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:14:30.933 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.5", 2024-09-15T23:14:30.933 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCnaedmtbdmARAAdxguBdtwBmtiaIx/y992GA==", 2024-09-15T23:14:30.933 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:14:30.933 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:14:30.933 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:14:30.933 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:14:30.933 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:14:30.933 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:30.933 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:14:30.933 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.6", 2024-09-15T23:14:30.933 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCraedmkR+NAxAAd2GAAH0BgOMonU8iTSn+Fw==", 2024-09-15T23:14:30.934 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:14:30.934 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:14:30.934 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:14:30.934 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:14:30.934 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:14:30.934 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:30.934 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:14:30.934 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.7", 2024-09-15T23:14:30.934 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCvaedmAaCwBBAAdpDtCbXchArmy019wiOdSQ==", 2024-09-15T23:14:30.934 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:14:30.934 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:14:30.934 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:14:30.934 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:14:30.934 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:14:30.935 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:30.935 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:14:30.935 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.0", 2024-09-15T23:14:30.935 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmzQPqJRAAhUf1dnVYohN4obCfeu8+7g==", 2024-09-15T23:14:30.935 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:14:30.935 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:14:30.935 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow r", 2024-09-15T23:14:30.935 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-15T23:14:30.935 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:14:30.935 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:30.935 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:14:30.935 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.1", 2024-09-15T23:14:30.935 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmdKK0LhAAXXmUkxVwMEjRTRXUh9CL/g==", 2024-09-15T23:14:30.935 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:14:30.935 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:14:30.935 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:14:30.936 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:14:30.936 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:14:30.936 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:14:30.936 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:30.936 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:14:30.936 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.2", 2024-09-15T23:14:30.936 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmRz55KxAARi7B4WYOY1QqH1CK81z9pA==", 2024-09-15T23:14:30.936 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:14:30.936 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:14:30.936 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:14:30.936 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:14:30.936 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:14:30.936 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:14:30.936 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:30.937 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:14:30.937 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.3", 2024-09-15T23:14:30.937 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmbWo8NBAAR1qGX1bs35ojx6lMxftcfg==", 2024-09-15T23:14:30.937 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:14:30.937 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:14:30.937 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:14:30.937 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:14:30.937 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:14:30.937 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:14:30.937 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:30.937 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:14:30.937 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.admin", 2024-09-15T23:14:30.937 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCMaedmVUW0LhAAqgPFk1HtxsZXcIStNN43pA==", 2024-09-15T23:14:30.938 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:14:30.938 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:14:30.938 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:14:30.938 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:14:30.938 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:14:30.938 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:14:30.938 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:30.938 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:14:30.939 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.x", 2024-09-15T23:14:30.939 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmGPSBCxAAHAhXQERogdAOm0ZPNtlxpw==", 2024-09-15T23:14:30.939 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:14:30.939 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:14:30.939 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-15T23:14:30.939 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:14:30.939 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:14:30.939 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:30.939 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:14:30.939 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.y", 2024-09-15T23:14:30.939 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm5Om4BxAA/7ZtMMlbUA3bvMCfaNMQyg==", 2024-09-15T23:14:30.939 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:14:30.939 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:14:30.940 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-15T23:14:30.940 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:14:30.940 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:14:30.940 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:14:30.940 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-15T23:14:30.940 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:14:30.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.927+0000 7fb9337cf640 1 -- 172.21.15.123:0/3267442670 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb91006c2e0 msgr2=0x7fb91006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:30.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.927+0000 7fb9337cf640 1 --2- 172.21.15.123:0/3267442670 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb91006c2e0 0x7fb91006e7a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb928014510 tx=0x7fb92800b040 comp rx=0 tx=0).stop 2024-09-15T23:14:30.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.927+0000 7fb9337cf640 1 -- 172.21.15.123:0/3267442670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb92c0acce0 msgr2=0x7fb92c0ad160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:30.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.927+0000 7fb9337cf640 1 --2- 172.21.15.123:0/3267442670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb92c0acce0 0x7fb92c0ad160 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb91c008fd0 tx=0x7fb91c001120 comp rx=0 tx=0).stop 2024-09-15T23:14:30.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.927+0000 7fb9337cf640 1 -- 172.21.15.123:0/3267442670 shutdown_connections 2024-09-15T23:14:30.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.927+0000 7fb9337cf640 1 --2- 172.21.15.123:0/3267442670 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb92c0c8f70 0x7fb92c0c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:30.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.927+0000 7fb9337cf640 1 --2- 172.21.15.123:0/3267442670 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb91006c2e0 0x7fb91006e7a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:30.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.927+0000 7fb9337cf640 1 --2- 172.21.15.123:0/3267442670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb92c0acce0 0x7fb92c0ad160 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:30.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.927+0000 7fb9337cf640 1 --2- 172.21.15.123:0/3267442670 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb918004800 0x7fb92c14e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:30.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.927+0000 7fb9337cf640 1 -- 172.21.15.123:0/3267442670 >> 172.21.15.123:0/3267442670 conn(0x7fb92c0ccec0 msgr2=0x7fb92c0cf410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:30.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.927+0000 7fb9337cf640 1 -- 172.21.15.123:0/3267442670 shutdown_connections 2024-09-15T23:14:30.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:30.927+0000 7fb9337cf640 1 -- 172.21.15.123:0/3267442670 wait complete. 2024-09-15T23:14:30.943 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T23:14:31.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.040+0000 7f4d31142640 1 Processor -- start 2024-09-15T23:14:31.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.040+0000 7f4d31142640 1 -- start start 2024-09-15T23:14:31.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.041+0000 7f4d31142640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4d2c158f80 0x7f4d2c071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:31.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.041+0000 7f4d31142640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4d2c0b7270 0x7f4d2c0cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:31.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.041+0000 7f4d31142640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d2c072930 con 0x7f4d2c15b9a0 2024-09-15T23:14:31.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.041+0000 7f4d31142640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f4d2c072c10 con 0x7f4d2c158f80 2024-09-15T23:14:31.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.041+0000 7f4d31142640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4d2c072ef0 con 0x7f4d2c0b7270 2024-09-15T23:14:31.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.041+0000 7f4d2ad9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4d2c158f80 0x7f4d2c071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:31.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.041+0000 7f4d2ad9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4d2c158f80 0x7f4d2c071fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36076/0 (socket says 172.21.15.123:36076) 2024-09-15T23:14:31.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.041+0000 7f4d2ad9d640 1 -- 172.21.15.123:0/428853874 learned_addr learned my addr 172.21.15.123:0/428853874 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:31.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.041+0000 7f4d2a59c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f4d2c15b9a0 0x7f4d2c0b6b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38852/0 (socket says 172.21.15.123:38852) 2024-09-15T23:14:31.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.042+0000 7f4d2ad9d640 1 -- 172.21.15.123:0/428853874 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4d2c0b7270 msgr2=0x7f4d2c0cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:31.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.042+0000 7f4d2b59e640 1 --2- 172.21.15.123:0/428853874 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4d2c0b7270 0x7f4d2c0cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:31.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.042+0000 7f4d2ad9d640 1 --2- 172.21.15.123:0/428853874 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4d2c0b7270 0x7f4d2c0cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:31.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.042+0000 7f4d2ad9d640 1 -- 172.21.15.123:0/428853874 >> v1:172.21.15.123:6789/0 conn(0x7f4d2c15b9a0 legacy=0x7f4d2c0b6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:31.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.042+0000 7f4d2ad9d640 1 -- 172.21.15.123:0/428853874 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d2c0731d0 con 0x7f4d2c158f80 2024-09-15T23:14:31.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.042+0000 7f4d29d9b640 1 -- 172.21.15.123:0/428853874 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2124215354 0 0) 0x7f4d2c072930 con 0x7f4d2c15b9a0 2024-09-15T23:14:31.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.042+0000 7f4d2b59e640 1 --2- 172.21.15.123:0/428853874 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4d2c0b7270 0x7f4d2c0cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:31.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.042+0000 7f4d2ad9d640 1 --2- 172.21.15.123:0/428853874 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d2c158f80 0x7f4d2c071fc0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c009e50 tx=0x7f4d1c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4145a1af801a94e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:31.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.042+0000 7f4d29d9b640 1 -- 172.21.15.123:0/428853874 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c036070 con 0x7f4d2c158f80 2024-09-15T23:14:31.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.042+0000 7f4d29d9b640 1 -- 172.21.15.123:0/428853874 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d1c031600 con 0x7f4d2c158f80 2024-09-15T23:14:31.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.043+0000 7f4d29d9b640 1 -- 172.21.15.123:0/428853874 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c0319d0 con 0x7f4d2c158f80 2024-09-15T23:14:31.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.043+0000 7f4d31142640 1 -- 172.21.15.123:0/428853874 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d2c158f80 msgr2=0x7f4d2c071fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:31.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.043+0000 7f4d31142640 1 --2- 172.21.15.123:0/428853874 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d2c158f80 0x7f4d2c071fc0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c009e50 tx=0x7f4d1c02a710 comp rx=0 tx=0).stop 2024-09-15T23:14:31.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.043+0000 7f4d31142640 1 -- 172.21.15.123:0/428853874 shutdown_connections 2024-09-15T23:14:31.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.043+0000 7f4d31142640 1 --2- 172.21.15.123:0/428853874 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4d2c0b7270 0x7f4d2c0cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:31.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.043+0000 7f4d31142640 1 --2- 172.21.15.123:0/428853874 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d2c158f80 0x7f4d2c071fc0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:31.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.043+0000 7f4d31142640 1 -- 172.21.15.123:0/428853874 >> 172.21.15.123:0/428853874 conn(0x7f4d2c06cd20 msgr2=0x7f4d2c06d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:31.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.043+0000 7f4d31142640 1 -- 172.21.15.123:0/428853874 shutdown_connections 2024-09-15T23:14:31.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.043+0000 7f4d31142640 1 -- 172.21.15.123:0/428853874 wait complete. 2024-09-15T23:14:31.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.044+0000 7f4d31142640 1 Processor -- start 2024-09-15T23:14:31.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.045+0000 7f4d31142640 1 -- start start 2024-09-15T23:14:31.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.045+0000 7f4d31142640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4d2c0b7270 0x7f4d2c15cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:31.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.045+0000 7f4d31142640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d2c158f80 0x7f4d2c1f02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:31.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.045+0000 7f4d31142640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4d2c15b9a0 0x7f4d2c1542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:31.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.045+0000 7f4d31142640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2c072680 con 0x7f4d2c158f80 2024-09-15T23:14:31.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.045+0000 7f4d31142640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2c072500 con 0x7f4d2c0b7270 2024-09-15T23:14:31.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.045+0000 7f4d31142640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4d2c0739d0 con 0x7f4d2c15b9a0 2024-09-15T23:14:31.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.045+0000 7f4d2a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d2c158f80 0x7f4d2c1f02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:31.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.045+0000 7f4d2a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d2c158f80 0x7f4d2c1f02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36082/0 (socket says 172.21.15.123:36082) 2024-09-15T23:14:31.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.045+0000 7f4d2a59c640 1 -- 172.21.15.123:0/3201949768 learned_addr learned my addr 172.21.15.123:0/3201949768 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:31.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.046+0000 7f4d2ad9d640 1 --2- 172.21.15.123:0/3201949768 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4d2c0b7270 0x7f4d2c15cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:31.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.046+0000 7f4d2a59c640 1 -- 172.21.15.123:0/3201949768 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4d2c15b9a0 msgr2=0x7f4d2c1542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:31.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.046+0000 7f4d2b59e640 1 --2- 172.21.15.123:0/3201949768 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4d2c15b9a0 0x7f4d2c1542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:31.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.046+0000 7f4d2a59c640 1 --2- 172.21.15.123:0/3201949768 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4d2c15b9a0 0x7f4d2c1542e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:31.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.046+0000 7f4d2a59c640 1 -- 172.21.15.123:0/3201949768 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4d2c0b7270 msgr2=0x7f4d2c15cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:31.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.046+0000 7f4d2a59c640 1 --2- 172.21.15.123:0/3201949768 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4d2c0b7270 0x7f4d2c15cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:31.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.046+0000 7f4d2a59c640 1 -- 172.21.15.123:0/3201949768 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d2c15d320 con 0x7f4d2c158f80 2024-09-15T23:14:31.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.046+0000 7f4d2ad9d640 1 --2- 172.21.15.123:0/3201949768 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4d2c0b7270 0x7f4d2c15cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:31.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.046+0000 7f4d2a59c640 1 --2- 172.21.15.123:0/3201949768 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d2c158f80 0x7f4d2c1f02e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4d2000c460 tx=0x7f4d2000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:31.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.046+0000 7f4d137fe640 1 -- 172.21.15.123:0/3201949768 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d20018070 con 0x7f4d2c158f80 2024-09-15T23:14:31.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.046+0000 7f4d137fe640 1 -- 172.21.15.123:0/3201949768 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d20007500 con 0x7f4d2c158f80 2024-09-15T23:14:31.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.046+0000 7f4d137fe640 1 -- 172.21.15.123:0/3201949768 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d20004a20 con 0x7f4d2c158f80 2024-09-15T23:14:31.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.046+0000 7f4d31142640 1 -- 172.21.15.123:0/3201949768 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d2c156d40 con 0x7f4d2c158f80 2024-09-15T23:14:31.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.046+0000 7f4d31142640 1 -- 172.21.15.123:0/3201949768 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d2c157300 con 0x7f4d2c158f80 2024-09-15T23:14:31.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.047+0000 7f4d31142640 1 -- 172.21.15.123:0/3201949768 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d2c157500 con 0x7f4d2c158f80 2024-09-15T23:14:31.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.048+0000 7f4d137fe640 1 -- 172.21.15.123:0/3201949768 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4d2001b070 con 0x7f4d2c158f80 2024-09-15T23:14:31.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.048+0000 7f4d137fe640 1 --2- 172.21.15.123:0/3201949768 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4d1806c2b0 0x7f4d1806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:31.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.048+0000 7f4d137fe640 1 -- 172.21.15.123:0/3201949768 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 4857+0+0 (secure 0 0 0) 0x7f4d2008a300 con 0x7f4d2c158f80 2024-09-15T23:14:31.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.048+0000 7f4d2ad9d640 1 --2- 172.21.15.123:0/3201949768 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4d1806c2b0 0x7f4d1806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:31.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.049+0000 7f4d2ad9d640 1 --2- 172.21.15.123:0/3201949768 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4d1806c2b0 0x7f4d1806e770 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c033000 tx=0x7f4d1c009000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:31.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.052+0000 7f4d137fe640 1 -- 172.21.15.123:0/3201949768 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4d2c157500 con 0x7f4d2c158f80 2024-09-15T23:14:31.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.218+0000 7f4d31142640 1 -- 172.21.15.123:0/3201949768 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f4d2c071fc0 con 0x7f4d2c158f80 2024-09-15T23:14:31.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.218+0000 7f4d137fe640 1 -- 172.21.15.123:0/3201949768 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v48) ==== 84+0+65 (secure 0 0 0) 0x7f4d20058e50 con 0x7f4d2c158f80 2024-09-15T23:14:31.219 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:14:31.220 INFO:teuthology.orchestra.run.smithi123.stdout:[ 2024-09-15T23:14:31.220 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:14:31.220 INFO:teuthology.orchestra.run.smithi123.stdout: "poolnum": 1, 2024-09-15T23:14:31.220 INFO:teuthology.orchestra.run.smithi123.stdout: "poolname": ".mgr" 2024-09-15T23:14:31.220 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:14:31.220 INFO:teuthology.orchestra.run.smithi123.stdout:] 2024-09-15T23:14:31.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.220+0000 7f4d31142640 1 -- 172.21.15.123:0/3201949768 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4d1806c2b0 msgr2=0x7f4d1806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:31.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.220+0000 7f4d31142640 1 --2- 172.21.15.123:0/3201949768 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4d1806c2b0 0x7f4d1806e770 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c033000 tx=0x7f4d1c009000 comp rx=0 tx=0).stop 2024-09-15T23:14:31.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.220+0000 7f4d31142640 1 -- 172.21.15.123:0/3201949768 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d2c158f80 msgr2=0x7f4d2c1f02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:31.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.220+0000 7f4d31142640 1 --2- 172.21.15.123:0/3201949768 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d2c158f80 0x7f4d2c1f02e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4d2000c460 tx=0x7f4d2000c920 comp rx=0 tx=0).stop 2024-09-15T23:14:31.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.220+0000 7f4d31142640 1 -- 172.21.15.123:0/3201949768 shutdown_connections 2024-09-15T23:14:31.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.220+0000 7f4d31142640 1 --2- 172.21.15.123:0/3201949768 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4d2c15b9a0 0x7f4d2c1542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:31.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.220+0000 7f4d31142640 1 --2- 172.21.15.123:0/3201949768 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4d1806c2b0 0x7f4d1806e770 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:31.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.220+0000 7f4d31142640 1 --2- 172.21.15.123:0/3201949768 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d2c158f80 0x7f4d2c1f02e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:31.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.220+0000 7f4d31142640 1 --2- 172.21.15.123:0/3201949768 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4d2c0b7270 0x7f4d2c15cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:31.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.220+0000 7f4d31142640 1 -- 172.21.15.123:0/3201949768 >> 172.21.15.123:0/3201949768 conn(0x7f4d2c06cd20 msgr2=0x7f4d2c15bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:31.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.220+0000 7f4d31142640 1 -- 172.21.15.123:0/3201949768 shutdown_connections 2024-09-15T23:14:31.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.220+0000 7f4d31142640 1 -- 172.21.15.123:0/3201949768 wait complete. 2024-09-15T23:14:31.232 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T23:14:31.232 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T23:14:31.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.333+0000 7f9befa96640 1 Processor -- start 2024-09-15T23:14:31.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.333+0000 7f9befa96640 1 -- start start 2024-09-15T23:14:31.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.334+0000 7f9befa96640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f9be80cfb30 0x7f9be81660b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:31.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.334+0000 7f9befa96640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9be80b0680 con 0x7f9be80b2370 2024-09-15T23:14:31.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.334+0000 7f9befa96640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9be80ccf70 con 0x7f9be8155b20 2024-09-15T23:14:31.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.334+0000 7f9befa96640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f9be80b01e0 con 0x7f9be80cfb30 2024-09-15T23:14:31.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.334+0000 7f9bed031640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f9be80b2370 0x7f9be80cf420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38868/0 (socket says 172.21.15.123:38868) 2024-09-15T23:14:31.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.334+0000 7f9bed031640 1 -- 172.21.15.123:0/923014673 learned_addr learned my addr 172.21.15.123:0/923014673 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:31.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.334+0000 7f9bee033640 1 --2- 172.21.15.123:0/923014673 >> v2:172.21.15.188:3300/0 conn(0x7f9be80cfb30 0x7f9be81660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:31.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.334+0000 7f9bec830640 1 -- 172.21.15.123:0/923014673 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3407013731 0 0) 0x7f9be80b0680 con 0x7f9be80b2370 2024-09-15T23:14:31.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.334+0000 7f9bec830640 1 -- 172.21.15.123:0/923014673 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bd4003520 con 0x7f9be80b2370 2024-09-15T23:14:31.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.334+0000 7f9bec830640 1 -- 172.21.15.123:0/923014673 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3670748446 0 0) 0x7f9bd4003520 con 0x7f9be80b2370 2024-09-15T23:14:31.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.334+0000 7f9bec830640 1 -- 172.21.15.123:0/923014673 >> v2:172.21.15.188:3300/0 conn(0x7f9be80cfb30 msgr2=0x7f9be81660b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:31.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.334+0000 7f9bec830640 1 --2- 172.21.15.123:0/923014673 >> v2:172.21.15.188:3300/0 conn(0x7f9be80cfb30 0x7f9be81660b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:31.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.334+0000 7f9bec830640 1 -- 172.21.15.123:0/923014673 >> v1:172.21.15.188:6789/0 conn(0x7f9be8155b20 legacy=0x7f9be80b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:31.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.334+0000 7f9bec830640 1 -- 172.21.15.123:0/923014673 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9be80ce940 con 0x7f9be80b2370 2024-09-15T23:14:31.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.334+0000 7f9bec830640 1 -- 172.21.15.123:0/923014673 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f9bd8001670 con 0x7f9be80b2370 2024-09-15T23:14:31.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.334+0000 7f9bec830640 1 -- 172.21.15.123:0/923014673 >> v1:172.21.15.123:6789/0 conn(0x7f9be80b2370 legacy=0x7f9be80cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:31.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.334+0000 7f9bec830640 1 --2- 172.21.15.123:0/923014673 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9bd40039b0 0x7f9bd4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:31.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.334+0000 7f9bec830640 1 --2- 172.21.15.123:0/923014673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bd4004800 0x7f9bd4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:31.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.334+0000 7f9bec830640 1 --2- 172.21.15.123:0/923014673 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9bd40051c0 0x7f9bd400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:31.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.334+0000 7f9bec830640 1 -- 172.21.15.123:0/923014673 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9be80b01e0 con 0x7f9bd4004800 2024-09-15T23:14:31.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.334+0000 7f9bec830640 1 -- 172.21.15.123:0/923014673 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd400c060 con 0x7f9bd40051c0 2024-09-15T23:14:31.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.334+0000 7f9bec830640 1 -- 172.21.15.123:0/923014673 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd400c260 con 0x7f9bd40039b0 2024-09-15T23:14:31.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.334+0000 7f9bed031640 1 --2- 172.21.15.123:0/923014673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bd4004800 0x7f9bd4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:31.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.335+0000 7f9bed832640 1 --2- 172.21.15.123:0/923014673 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9bd40039b0 0x7f9bd4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:31.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.335+0000 7f9bee033640 1 --2- 172.21.15.123:0/923014673 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9bd40051c0 0x7f9bd400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:31.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.335+0000 7f9bed031640 1 -- 172.21.15.123:0/923014673 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9bd40039b0 msgr2=0x7f9bd4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:31.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.335+0000 7f9bed031640 1 --2- 172.21.15.123:0/923014673 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9bd40039b0 0x7f9bd4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:31.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.335+0000 7f9bed031640 1 -- 172.21.15.123:0/923014673 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9bd40051c0 msgr2=0x7f9bd400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:31.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.335+0000 7f9bed031640 1 --2- 172.21.15.123:0/923014673 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9bd40051c0 0x7f9bd400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:31.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.335+0000 7f9bee033640 1 -- 172.21.15.123:0/923014673 reap_dead start 2024-09-15T23:14:31.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.335+0000 7f9bed031640 1 -- 172.21.15.123:0/923014673 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd4003520 con 0x7f9bd4004800 2024-09-15T23:14:31.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.335+0000 7f9bed031640 1 --2- 172.21.15.123:0/923014673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bd4004800 0x7f9bd4004c80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9bd800c240 tx=0x7f9bd4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be8de3e530a5217e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:31.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.336+0000 7f9bec830640 1 -- 172.21.15.123:0/923014673 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd8007cf0 con 0x7f9bd4004800 2024-09-15T23:14:31.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.336+0000 7f9bec830640 1 -- 172.21.15.123:0/923014673 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bd8005af0 con 0x7f9bd4004800 2024-09-15T23:14:31.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.336+0000 7f9bec830640 1 -- 172.21.15.123:0/923014673 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd8007070 con 0x7f9bd4004800 2024-09-15T23:14:31.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.336+0000 7f9befa96640 1 -- 172.21.15.123:0/923014673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bd4004800 msgr2=0x7f9bd4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:31.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.336+0000 7f9befa96640 1 --2- 172.21.15.123:0/923014673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bd4004800 0x7f9bd4004c80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9bd800c240 tx=0x7f9bd4005830 comp rx=0 tx=0).stop 2024-09-15T23:14:31.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.336+0000 7f9befa96640 1 -- 172.21.15.123:0/923014673 shutdown_connections 2024-09-15T23:14:31.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.336+0000 7f9befa96640 1 --2- 172.21.15.123:0/923014673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bd4004800 0x7f9bd4004c80 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:31.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.336+0000 7f9befa96640 1 -- 172.21.15.123:0/923014673 >> 172.21.15.123:0/923014673 conn(0x7f9be806c240 msgr2=0x7f9be806d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:31.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.336+0000 7f9befa96640 1 -- 172.21.15.123:0/923014673 shutdown_connections 2024-09-15T23:14:31.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.336+0000 7f9befa96640 1 -- 172.21.15.123:0/923014673 wait complete. 2024-09-15T23:14:31.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.337+0000 7f9befa96640 1 Processor -- start 2024-09-15T23:14:31.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.337+0000 7f9befa96640 1 -- start start 2024-09-15T23:14:31.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.338+0000 7f9befa96640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9bd4004800 0x7f9be813f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:31.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.338+0000 7f9befa96640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9be8154470 0x7f9be8141e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:31.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.338+0000 7f9befa96640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9be81548b0 0x7f9be81423c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:31.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.338+0000 7f9befa96640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9be80ce610 con 0x7f9be81548b0 2024-09-15T23:14:31.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.338+0000 7f9befa96640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9be80cef00 con 0x7f9bd4004800 2024-09-15T23:14:31.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.338+0000 7f9befa96640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9be80ccb20 con 0x7f9be8154470 2024-09-15T23:14:31.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.338+0000 7f9bee033640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9be81548b0 0x7f9be81423c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:31.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.338+0000 7f9bee033640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9be81548b0 0x7f9be81423c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36100/0 (socket says 172.21.15.123:36100) 2024-09-15T23:14:31.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.338+0000 7f9bee033640 1 -- 172.21.15.123:0/1298973401 learned_addr learned my addr 172.21.15.123:0/1298973401 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:31.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.338+0000 7f9bed832640 1 --2- 172.21.15.123:0/1298973401 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9bd4004800 0x7f9be813f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:31.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.338+0000 7f9bed031640 1 --2- 172.21.15.123:0/1298973401 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9be8154470 0x7f9be8141e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:31.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.338+0000 7f9bee033640 1 -- 172.21.15.123:0/1298973401 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9be8154470 msgr2=0x7f9be8141e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:31.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.338+0000 7f9bee033640 1 --2- 172.21.15.123:0/1298973401 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9be8154470 0x7f9be8141e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:31.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.338+0000 7f9bee033640 1 -- 172.21.15.123:0/1298973401 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9bd4004800 msgr2=0x7f9be813f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:31.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.338+0000 7f9bee033640 1 --2- 172.21.15.123:0/1298973401 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9bd4004800 0x7f9be813f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:31.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.339+0000 7f9bee033640 1 -- 172.21.15.123:0/1298973401 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9be814fda0 con 0x7f9be81548b0 2024-09-15T23:14:31.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.339+0000 7f9bed031640 1 --2- 172.21.15.123:0/1298973401 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9be8154470 0x7f9be8141e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:31.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.339+0000 7f9bee033640 1 --2- 172.21.15.123:0/1298973401 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9be81548b0 0x7f9be81423c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9be80cd320 tx=0x7f9be000f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:31.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.339+0000 7f9bde7fc640 1 -- 172.21.15.123:0/1298973401 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be000fce0 con 0x7f9be81548b0 2024-09-15T23:14:31.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.339+0000 7f9bde7fc640 1 -- 172.21.15.123:0/1298973401 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9be000fe80 con 0x7f9be81548b0 2024-09-15T23:14:31.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.339+0000 7f9befa96640 1 -- 172.21.15.123:0/1298973401 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9be8150080 con 0x7f9be81548b0 2024-09-15T23:14:31.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.339+0000 7f9bde7fc640 1 -- 172.21.15.123:0/1298973401 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be0015670 con 0x7f9be81548b0 2024-09-15T23:14:31.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.339+0000 7f9befa96640 1 -- 172.21.15.123:0/1298973401 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9be8153f50 con 0x7f9be81548b0 2024-09-15T23:14:31.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.340+0000 7f9befa96640 1 -- 172.21.15.123:0/1298973401 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9be80cf420 con 0x7f9be81548b0 2024-09-15T23:14:31.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.340+0000 7f9bde7fc640 1 -- 172.21.15.123:0/1298973401 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9be0015810 con 0x7f9be81548b0 2024-09-15T23:14:31.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.340+0000 7f9bde7fc640 1 --2- 172.21.15.123:0/1298973401 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9bcc06c2b0 0x7f9bcc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:31.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.341+0000 7f9bde7fc640 1 -- 172.21.15.123:0/1298973401 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 4857+0+0 (secure 0 0 0) 0x7f9be008bf60 con 0x7f9be81548b0 2024-09-15T23:14:31.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.341+0000 7f9bed832640 1 --2- 172.21.15.123:0/1298973401 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9bcc06c2b0 0x7f9bcc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:31.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.341+0000 7f9bed832640 1 --2- 172.21.15.123:0/1298973401 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9bcc06c2b0 0x7f9bcc06e770 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9be4000c00 tx=0x7f9be4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:31.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.345+0000 7f9bde7fc640 1 -- 172.21.15.123:0/1298973401 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9be0019030 con 0x7f9be81548b0 2024-09-15T23:14:31.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.510+0000 7f9befa96640 1 -- 172.21.15.123:0/1298973401 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f9be8150250 con 0x7f9be81548b0 2024-09-15T23:14:31.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.572+0000 7f9bde7fc640 1 -- 172.21.15.123:0/1298973401 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v49) ==== 138+0+0 (secure 0 0 0) 0x7f9be0010040 con 0x7f9be81548b0 2024-09-15T23:14:31.573 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' created 2024-09-15T23:14:31.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.575+0000 7f9befa96640 1 -- 172.21.15.123:0/1298973401 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9bcc06c2b0 msgr2=0x7f9bcc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:31.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.575+0000 7f9befa96640 1 --2- 172.21.15.123:0/1298973401 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9bcc06c2b0 0x7f9bcc06e770 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9be4000c00 tx=0x7f9be4009040 comp rx=0 tx=0).stop 2024-09-15T23:14:31.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.575+0000 7f9befa96640 1 -- 172.21.15.123:0/1298973401 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9be81548b0 msgr2=0x7f9be81423c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:31.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.575+0000 7f9befa96640 1 --2- 172.21.15.123:0/1298973401 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9be81548b0 0x7f9be81423c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9be80cd320 tx=0x7f9be000f1b0 comp rx=0 tx=0).stop 2024-09-15T23:14:31.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.576+0000 7f9befa96640 1 -- 172.21.15.123:0/1298973401 shutdown_connections 2024-09-15T23:14:31.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.576+0000 7f9befa96640 1 --2- 172.21.15.123:0/1298973401 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9bcc06c2b0 0x7f9bcc06e770 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:31.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.576+0000 7f9befa96640 1 --2- 172.21.15.123:0/1298973401 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9be81548b0 0x7f9be81423c0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:31.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.576+0000 7f9befa96640 1 --2- 172.21.15.123:0/1298973401 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9be8154470 0x7f9be8141e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:31.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.576+0000 7f9befa96640 1 --2- 172.21.15.123:0/1298973401 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9bd4004800 0x7f9be813f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:31.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.576+0000 7f9befa96640 1 -- 172.21.15.123:0/1298973401 >> 172.21.15.123:0/1298973401 conn(0x7f9be806c240 msgr2=0x7f9be80b57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:31.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.577+0000 7f9befa96640 1 -- 172.21.15.123:0/1298973401 shutdown_connections 2024-09-15T23:14:31.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.577+0000 7f9befa96640 1 -- 172.21.15.123:0/1298973401 wait complete. 2024-09-15T23:14:31.590 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T23:14:31.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.694+0000 7f70fa52a640 1 Processor -- start 2024-09-15T23:14:31.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.694+0000 7f70fa52a640 1 -- start start 2024-09-15T23:14:31.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.695+0000 7f70fa52a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f70f40b5fc0 0x7f70f415d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:31.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.695+0000 7f70fa52a640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70f40b4310 con 0x7f70f4153550 2024-09-15T23:14:31.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.695+0000 7f70fa52a640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70f40b45f0 con 0x7f70f40b3e80 2024-09-15T23:14:31.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.695+0000 7f70fa52a640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f70f40b48d0 con 0x7f70f40b5fc0 2024-09-15T23:14:31.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.695+0000 7f70f8ac7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f70f40b5fc0 0x7f70f415d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:31.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.695+0000 7f70f3fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f70f4153550 0x7f70f40b58b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38880/0 (socket says 172.21.15.123:38880) 2024-09-15T23:14:31.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.695+0000 7f70f3fff640 1 -- 172.21.15.123:0/1533991902 learned_addr learned my addr 172.21.15.123:0/1533991902 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:31.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.696+0000 7f70f8ac7640 1 -- 172.21.15.123:0/1533991902 >> v1:172.21.15.188:6789/0 conn(0x7f70f40b3e80 legacy=0x7f70f40cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:31.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.696+0000 7f70f8ac7640 1 -- 172.21.15.123:0/1533991902 >> v1:172.21.15.123:6789/0 conn(0x7f70f4153550 legacy=0x7f70f40b58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:31.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.696+0000 7f70f2ffd640 1 -- 172.21.15.123:0/1533991902 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1566845702 0 0) 0x7f70f40b4310 con 0x7f70f4153550 2024-09-15T23:14:31.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.696+0000 7f70f8ac7640 1 -- 172.21.15.123:0/1533991902 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70f40b4bb0 con 0x7f70f40b5fc0 2024-09-15T23:14:31.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.696+0000 7f70f8ac7640 1 --2- 172.21.15.123:0/1533991902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f40b5fc0 0x7f70f415d5a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f70ec009d90 tx=0x7f70ec02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b8c84dd5e9c1e70 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:31.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.697+0000 7f70f2ffd640 1 -- 172.21.15.123:0/1533991902 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ec007740 con 0x7f70f40b5fc0 2024-09-15T23:14:31.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.697+0000 7f70f2ffd640 1 -- 172.21.15.123:0/1533991902 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70ec0078e0 con 0x7f70f40b5fc0 2024-09-15T23:14:31.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.697+0000 7f70f2ffd640 1 -- 172.21.15.123:0/1533991902 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ec007cb0 con 0x7f70f40b5fc0 2024-09-15T23:14:31.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.697+0000 7f70fa52a640 1 -- 172.21.15.123:0/1533991902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f40b5fc0 msgr2=0x7f70f415d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:31.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.697+0000 7f70fa52a640 1 --2- 172.21.15.123:0/1533991902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f40b5fc0 0x7f70f415d5a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f70ec009d90 tx=0x7f70ec02a6a0 comp rx=0 tx=0).stop 2024-09-15T23:14:31.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.697+0000 7f70fa52a640 1 -- 172.21.15.123:0/1533991902 shutdown_connections 2024-09-15T23:14:31.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.697+0000 7f70fa52a640 1 --2- 172.21.15.123:0/1533991902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f40b5fc0 0x7f70f415d5a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:31.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.697+0000 7f70fa52a640 1 -- 172.21.15.123:0/1533991902 >> 172.21.15.123:0/1533991902 conn(0x7f70f406db30 msgr2=0x7f70f406df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:31.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.697+0000 7f70fa52a640 1 -- 172.21.15.123:0/1533991902 shutdown_connections 2024-09-15T23:14:31.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.697+0000 7f70fa52a640 1 -- 172.21.15.123:0/1533991902 wait complete. 2024-09-15T23:14:31.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.698+0000 7f70fa52a640 1 Processor -- start 2024-09-15T23:14:31.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.699+0000 7f70fa52a640 1 -- start start 2024-09-15T23:14:31.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.699+0000 7f70fa52a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f70f40b5fc0 0x7f70f4142760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:31.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.699+0000 7f70fa52a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f4153550 0x7f70f4151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:31.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.699+0000 7f70fa52a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f70f4156800 0x7f70f4151c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:31.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.699+0000 7f70fa52a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f70f4070120 con 0x7f70f4153550 2024-09-15T23:14:31.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.699+0000 7f70fa52a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f70f4153930 con 0x7f70f4156800 2024-09-15T23:14:31.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.699+0000 7f70fa52a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f70f40b53b0 con 0x7f70f40b5fc0 2024-09-15T23:14:31.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.699+0000 7f70f37fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f4153550 0x7f70f4151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:31.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.699+0000 7f70f37fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f4153550 0x7f70f4151740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36126/0 (socket says 172.21.15.123:36126) 2024-09-15T23:14:31.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.699+0000 7f70f37fe640 1 -- 172.21.15.123:0/1812629089 learned_addr learned my addr 172.21.15.123:0/1812629089 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:31.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.700+0000 7f70f37fe640 1 -- 172.21.15.123:0/1812629089 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f70f40b5fc0 msgr2=0x7f70f4142760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:31.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.700+0000 7f70f37fe640 1 --2- 172.21.15.123:0/1812629089 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f70f40b5fc0 0x7f70f4142760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:31.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.700+0000 7f70f37fe640 1 -- 172.21.15.123:0/1812629089 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f70f4156800 msgr2=0x7f70f4151c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:31.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.700+0000 7f70f37fe640 1 --2- 172.21.15.123:0/1812629089 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f70f4156800 0x7f70f4151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:31.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.700+0000 7f70f37fe640 1 -- 172.21.15.123:0/1812629089 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70f4156ca0 con 0x7f70f4153550 2024-09-15T23:14:31.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.700+0000 7f70f37fe640 1 --2- 172.21.15.123:0/1812629089 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f4153550 0x7f70f4151740 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f70e800c400 tx=0x7f70e800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:31.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.700+0000 7f70f0ff9640 1 -- 172.21.15.123:0/1812629089 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e8011790 con 0x7f70f4153550 2024-09-15T23:14:31.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.700+0000 7f70f0ff9640 1 -- 172.21.15.123:0/1812629089 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e8017070 con 0x7f70f4153550 2024-09-15T23:14:31.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.700+0000 7f70fa52a640 1 -- 172.21.15.123:0/1812629089 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70f414d310 con 0x7f70f4153550 2024-09-15T23:14:31.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.700+0000 7f70f0ff9640 1 -- 172.21.15.123:0/1812629089 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e8011bb0 con 0x7f70f4153550 2024-09-15T23:14:31.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.700+0000 7f70fa52a640 1 -- 172.21.15.123:0/1812629089 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70f4142ca0 con 0x7f70f4153550 2024-09-15T23:14:31.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.701+0000 7f70fa52a640 1 -- 172.21.15.123:0/1812629089 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70f415d5a0 con 0x7f70f4153550 2024-09-15T23:14:31.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.702+0000 7f70f0ff9640 1 -- 172.21.15.123:0/1812629089 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f70e801c460 con 0x7f70f4153550 2024-09-15T23:14:31.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.702+0000 7f70f0ff9640 1 --2- 172.21.15.123:0/1812629089 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f70e006c2b0 0x7f70e006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:31.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.702+0000 7f70f0ff9640 1 -- 172.21.15.123:0/1812629089 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5227+0+0 (secure 0 0 0) 0x7f70e808b000 con 0x7f70f4153550 2024-09-15T23:14:31.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.703+0000 7f70f3fff640 1 --2- 172.21.15.123:0/1812629089 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f70e006c2b0 0x7f70e006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:31.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.703+0000 7f70f3fff640 1 --2- 172.21.15.123:0/1812629089 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f70e006c2b0 0x7f70e006e770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f70e4007fd0 tx=0x7f70e4007960 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:31.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.707+0000 7f70f0ff9640 1 -- 172.21.15.123:0/1812629089 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f70e80599e0 con 0x7f70f4153550 2024-09-15T23:14:31.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:31.872+0000 7f70fa52a640 1 -- 172.21.15.123:0/1812629089 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f70f40ce970 con 0x7f70f4153550 2024-09-15T23:14:32.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.574+0000 7f70f0ff9640 1 -- 172.21.15.123:0/1812629089 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v50) ==== 170+0+0 (secure 0 0 0) 0x7f70e80592e0 con 0x7f70f4153550 2024-09-15T23:14:32.575 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' created 2024-09-15T23:14:32.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.579+0000 7f70fa52a640 1 -- 172.21.15.123:0/1812629089 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f70e006c2b0 msgr2=0x7f70e006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:32.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.579+0000 7f70fa52a640 1 --2- 172.21.15.123:0/1812629089 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f70e006c2b0 0x7f70e006e770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f70e4007fd0 tx=0x7f70e4007960 comp rx=0 tx=0).stop 2024-09-15T23:14:32.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.579+0000 7f70fa52a640 1 -- 172.21.15.123:0/1812629089 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f4153550 msgr2=0x7f70f4151740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:32.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.579+0000 7f70fa52a640 1 --2- 172.21.15.123:0/1812629089 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f4153550 0x7f70f4151740 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f70e800c400 tx=0x7f70e800c8c0 comp rx=0 tx=0).stop 2024-09-15T23:14:32.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.580+0000 7f70fa52a640 1 -- 172.21.15.123:0/1812629089 shutdown_connections 2024-09-15T23:14:32.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.580+0000 7f70fa52a640 1 --2- 172.21.15.123:0/1812629089 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f70f4156800 0x7f70f4151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:32.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.580+0000 7f70fa52a640 1 --2- 172.21.15.123:0/1812629089 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f70e006c2b0 0x7f70e006e770 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:32.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.580+0000 7f70fa52a640 1 --2- 172.21.15.123:0/1812629089 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f4153550 0x7f70f4151740 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:32.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.580+0000 7f70fa52a640 1 --2- 172.21.15.123:0/1812629089 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f70f40b5fc0 0x7f70f4142760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:32.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.580+0000 7f70fa52a640 1 -- 172.21.15.123:0/1812629089 >> 172.21.15.123:0/1812629089 conn(0x7f70f406db30 msgr2=0x7f70f40d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:32.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.580+0000 7f70fa52a640 1 -- 172.21.15.123:0/1812629089 shutdown_connections 2024-09-15T23:14:32.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.580+0000 7f70fa52a640 1 -- 172.21.15.123:0/1812629089 wait complete. 2024-09-15T23:14:32.604 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T23:14:32.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.709+0000 7fab53cd9640 1 Processor -- start 2024-09-15T23:14:32.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.710+0000 7fab53cd9640 1 -- start start 2024-09-15T23:14:32.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.710+0000 7fab53cd9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fab4c06bfd0 0x7fab4c06c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:32.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.710+0000 7fab53cd9640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab4c1631c0 con 0x7fab4c0d3930 2024-09-15T23:14:32.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.710+0000 7fab53cd9640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab4c06c8f0 con 0x7fab4c0b3350 2024-09-15T23:14:32.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.710+0000 7fab53cd9640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fab4c0b78a0 con 0x7fab4c06bfd0 2024-09-15T23:14:32.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.711+0000 7fab52276640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fab4c0d3930 0x7fab4c162ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38894/0 (socket says 172.21.15.123:38894) 2024-09-15T23:14:32.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.711+0000 7fab52276640 1 -- 172.21.15.123:0/3843536936 learned_addr learned my addr 172.21.15.123:0/3843536936 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:32.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.711+0000 7fab51a75640 1 --2- 172.21.15.123:0/3843536936 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fab4c06bfd0 0x7fab4c06c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:32.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.711+0000 7fab50a73640 1 -- 172.21.15.123:0/3843536936 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1940102564 0 0) 0x7fab4c1631c0 con 0x7fab4c0d3930 2024-09-15T23:14:32.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.711+0000 7fab50a73640 1 -- 172.21.15.123:0/3843536936 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab34003520 con 0x7fab4c0d3930 2024-09-15T23:14:32.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.711+0000 7fab50a73640 1 -- 172.21.15.123:0/3843536936 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1229705558 0 0) 0x7fab4c06c8f0 con 0x7fab4c0b3350 2024-09-15T23:14:32.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.711+0000 7fab50a73640 1 -- 172.21.15.123:0/3843536936 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab4c1631c0 con 0x7fab4c0b3350 2024-09-15T23:14:32.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.711+0000 7fab50a73640 1 -- 172.21.15.123:0/3843536936 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 492279853 0 0) 0x7fab34003520 con 0x7fab4c0d3930 2024-09-15T23:14:32.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.711+0000 7fab50a73640 1 -- 172.21.15.123:0/3843536936 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fab4c06bfd0 msgr2=0x7fab4c06c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:32.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.711+0000 7fab50a73640 1 --2- 172.21.15.123:0/3843536936 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fab4c06bfd0 0x7fab4c06c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:32.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.711+0000 7fab50a73640 1 -- 172.21.15.123:0/3843536936 >> v1:172.21.15.188:6789/0 conn(0x7fab4c0b3350 legacy=0x7fab4c1623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:32.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.711+0000 7fab50a73640 1 -- 172.21.15.123:0/3843536936 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab4c0cf710 con 0x7fab4c0d3930 2024-09-15T23:14:32.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.711+0000 7fab50a73640 1 -- 172.21.15.123:0/3843536936 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fab440019f0 con 0x7fab4c0d3930 2024-09-15T23:14:32.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.711+0000 7fab50a73640 1 -- 172.21.15.123:0/3843536936 >> v1:172.21.15.123:6789/0 conn(0x7fab4c0d3930 legacy=0x7fab4c162ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:32.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.711+0000 7fab50a73640 1 --2- 172.21.15.123:0/3843536936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab34003b70 0x7fab34003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:32.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.711+0000 7fab50a73640 1 --2- 172.21.15.123:0/3843536936 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fab34004800 0x7fab34004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:32.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.711+0000 7fab50a73640 1 --2- 172.21.15.123:0/3843536936 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fab4c06bfd0 0x7fab340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:32.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.711+0000 7fab50a73640 1 -- 172.21.15.123:0/3843536936 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fab3400ba70 con 0x7fab34003b70 2024-09-15T23:14:32.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.711+0000 7fab50a73640 1 -- 172.21.15.123:0/3843536936 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fab3400bbf0 con 0x7fab34004800 2024-09-15T23:14:32.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.711+0000 7fab50a73640 1 -- 172.21.15.123:0/3843536936 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fab3400bdf0 con 0x7fab4c06bfd0 2024-09-15T23:14:32.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.711+0000 7fab51a75640 1 --2- 172.21.15.123:0/3843536936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab34003b70 0x7fab34003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:32.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.711+0000 7fab52276640 1 --2- 172.21.15.123:0/3843536936 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fab4c06bfd0 0x7fab340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:32.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.711+0000 7fab51274640 1 --2- 172.21.15.123:0/3843536936 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fab34004800 0x7fab34004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:32.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.712+0000 7fab51a75640 1 -- 172.21.15.123:0/3843536936 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fab4c06bfd0 msgr2=0x7fab340051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:32.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.712+0000 7fab51a75640 1 --2- 172.21.15.123:0/3843536936 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fab4c06bfd0 0x7fab340051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:32.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.712+0000 7fab51a75640 1 -- 172.21.15.123:0/3843536936 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fab34004800 msgr2=0x7fab34004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:32.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.712+0000 7fab51a75640 1 --2- 172.21.15.123:0/3843536936 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fab34004800 0x7fab34004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:32.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.712+0000 7fab51a75640 1 -- 172.21.15.123:0/3843536936 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab34003520 con 0x7fab34003b70 2024-09-15T23:14:32.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.712+0000 7fab52276640 1 --2- 172.21.15.123:0/3843536936 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fab4c06bfd0 0x7fab340051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:32.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.712+0000 7fab51a75640 1 --2- 172.21.15.123:0/3843536936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab34003b70 0x7fab34003f70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fab3c009ac0 tx=0x7fab34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f7aea789f852aed server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:32.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.712+0000 7fab50a73640 1 -- 172.21.15.123:0/3843536936 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3c036070 con 0x7fab34003b70 2024-09-15T23:14:32.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.712+0000 7fab50a73640 1 -- 172.21.15.123:0/3843536936 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab3c031400 con 0x7fab34003b70 2024-09-15T23:14:32.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.712+0000 7fab50a73640 1 -- 172.21.15.123:0/3843536936 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3c009690 con 0x7fab34003b70 2024-09-15T23:14:32.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.713+0000 7fab53cd9640 1 -- 172.21.15.123:0/3843536936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab34003b70 msgr2=0x7fab34003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:32.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.713+0000 7fab53cd9640 1 --2- 172.21.15.123:0/3843536936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab34003b70 0x7fab34003f70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fab3c009ac0 tx=0x7fab34005830 comp rx=0 tx=0).stop 2024-09-15T23:14:32.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.713+0000 7fab52276640 1 -- 172.21.15.123:0/3843536936 reap_dead start 2024-09-15T23:14:32.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.713+0000 7fab53cd9640 1 -- 172.21.15.123:0/3843536936 shutdown_connections 2024-09-15T23:14:32.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.713+0000 7fab53cd9640 1 -- 172.21.15.123:0/3843536936 >> 172.21.15.123:0/3843536936 conn(0x7fab4c0d11c0 msgr2=0x7fab4c0d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:32.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.713+0000 7fab53cd9640 1 -- 172.21.15.123:0/3843536936 shutdown_connections 2024-09-15T23:14:32.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.713+0000 7fab53cd9640 1 -- 172.21.15.123:0/3843536936 wait complete. 2024-09-15T23:14:32.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.714+0000 7fab53cd9640 1 Processor -- start 2024-09-15T23:14:32.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.714+0000 7fab53cd9640 1 -- start start 2024-09-15T23:14:32.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.715+0000 7fab53cd9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab34003b70 0x7fab4c1e9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:32.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.715+0000 7fab53cd9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fab4c1e8660 0x7fab4c1f58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:32.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.715+0000 7fab53cd9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fab4c153aa0 0x7fab4c0cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:32.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.715+0000 7fab53cd9640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fab4c0cfcd0 con 0x7fab34003b70 2024-09-15T23:14:32.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.715+0000 7fab53cd9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fab4c0cffb0 con 0x7fab4c1e8660 2024-09-15T23:14:32.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.715+0000 7fab53cd9640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fab4c0d2400 con 0x7fab4c153aa0 2024-09-15T23:14:32.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.715+0000 7fab51a75640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab34003b70 0x7fab4c1e9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:32.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.715+0000 7fab51a75640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab34003b70 0x7fab4c1e9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36146/0 (socket says 172.21.15.123:36146) 2024-09-15T23:14:32.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.715+0000 7fab51a75640 1 -- 172.21.15.123:0/4020882923 learned_addr learned my addr 172.21.15.123:0/4020882923 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:32.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.715+0000 7fab51274640 1 --2- 172.21.15.123:0/4020882923 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fab4c1e8660 0x7fab4c1f58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:32.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.715+0000 7fab52276640 1 --2- 172.21.15.123:0/4020882923 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fab4c153aa0 0x7fab4c0cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:32.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.715+0000 7fab51a75640 1 -- 172.21.15.123:0/4020882923 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fab4c153aa0 msgr2=0x7fab4c0cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:32.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.715+0000 7fab51a75640 1 --2- 172.21.15.123:0/4020882923 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fab4c153aa0 0x7fab4c0cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:32.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.715+0000 7fab51a75640 1 -- 172.21.15.123:0/4020882923 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fab4c1e8660 msgr2=0x7fab4c1f58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:32.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.715+0000 7fab51a75640 1 --2- 172.21.15.123:0/4020882923 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fab4c1e8660 0x7fab4c1f58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:32.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.715+0000 7fab51a75640 1 -- 172.21.15.123:0/4020882923 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab4c1f5e30 con 0x7fab34003b70 2024-09-15T23:14:32.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.715+0000 7fab51274640 1 --2- 172.21.15.123:0/4020882923 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fab4c1e8660 0x7fab4c1f58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:32.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.715+0000 7fab51a75640 1 --2- 172.21.15.123:0/4020882923 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab34003b70 0x7fab4c1e9c80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fab3c009ac0 tx=0x7fab3c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:32.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.716+0000 7fab4a7fc640 1 -- 172.21.15.123:0/4020882923 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3c040020 con 0x7fab34003b70 2024-09-15T23:14:32.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.716+0000 7fab4a7fc640 1 -- 172.21.15.123:0/4020882923 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab3c003bc0 con 0x7fab34003b70 2024-09-15T23:14:32.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.716+0000 7fab53cd9640 1 -- 172.21.15.123:0/4020882923 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab4c1e8be0 con 0x7fab34003b70 2024-09-15T23:14:32.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.716+0000 7fab4a7fc640 1 -- 172.21.15.123:0/4020882923 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab3c036040 con 0x7fab34003b70 2024-09-15T23:14:32.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.716+0000 7fab53cd9640 1 -- 172.21.15.123:0/4020882923 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab4c1e91a0 con 0x7fab34003b70 2024-09-15T23:14:32.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.717+0000 7fab53cd9640 1 -- 172.21.15.123:0/4020882923 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab4c0d0cf0 con 0x7fab34003b70 2024-09-15T23:14:32.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.717+0000 7fab4a7fc640 1 -- 172.21.15.123:0/4020882923 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fab3c043020 con 0x7fab34003b70 2024-09-15T23:14:32.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.718+0000 7fab4a7fc640 1 --2- 172.21.15.123:0/4020882923 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fab3806c2b0 0x7fab3806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:32.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.718+0000 7fab4a7fc640 1 -- 172.21.15.123:0/4020882923 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5609+0+0 (secure 0 0 0) 0x7fab3c0ab530 con 0x7fab34003b70 2024-09-15T23:14:32.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.718+0000 7fab51274640 1 --2- 172.21.15.123:0/4020882923 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fab3806c2b0 0x7fab3806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:32.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.719+0000 7fab51274640 1 --2- 172.21.15.123:0/4020882923 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fab3806c2b0 0x7fab3806e770 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fab40007fd0 tx=0x7fab40009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:32.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.723+0000 7fab4a7fc640 1 -- 172.21.15.123:0/4020882923 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fab3c04a070 con 0x7fab34003b70 2024-09-15T23:14:32.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:32.924+0000 7fab53cd9640 1 -- 172.21.15.123:0/4020882923 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fab4c0ba3d0 con 0x7fab34003b70 2024-09-15T23:14:33.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.590+0000 7fab4a7fc640 1 -- 172.21.15.123:0/4020882923 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v18) ==== 172+0+0 (secure 0 0 0) 0x7fab4c1f5e30 con 0x7fab34003b70 2024-09-15T23:14:33.593 INFO:teuthology.orchestra.run.smithi123.stderr:new fs with metadata pool 6 and data pool 7 2024-09-15T23:14:33.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.597+0000 7fab53cd9640 1 -- 172.21.15.123:0/4020882923 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fab3806c2b0 msgr2=0x7fab3806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:33.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.597+0000 7fab53cd9640 1 --2- 172.21.15.123:0/4020882923 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fab3806c2b0 0x7fab3806e770 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fab40007fd0 tx=0x7fab40009040 comp rx=0 tx=0).stop 2024-09-15T23:14:33.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.597+0000 7fab53cd9640 1 -- 172.21.15.123:0/4020882923 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab34003b70 msgr2=0x7fab4c1e9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:33.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.597+0000 7fab53cd9640 1 --2- 172.21.15.123:0/4020882923 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab34003b70 0x7fab4c1e9c80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fab3c009ac0 tx=0x7fab3c004730 comp rx=0 tx=0).stop 2024-09-15T23:14:33.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.599+0000 7fab53cd9640 1 -- 172.21.15.123:0/4020882923 shutdown_connections 2024-09-15T23:14:33.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.599+0000 7fab53cd9640 1 --2- 172.21.15.123:0/4020882923 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fab4c153aa0 0x7fab4c0cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:33.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.599+0000 7fab53cd9640 1 --2- 172.21.15.123:0/4020882923 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fab4c1e8660 0x7fab4c1f58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:33.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.599+0000 7fab53cd9640 1 --2- 172.21.15.123:0/4020882923 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fab3806c2b0 0x7fab3806e770 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:33.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.599+0000 7fab53cd9640 1 --2- 172.21.15.123:0/4020882923 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab34003b70 0x7fab4c1e9c80 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:33.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.599+0000 7fab53cd9640 1 -- 172.21.15.123:0/4020882923 >> 172.21.15.123:0/4020882923 conn(0x7fab4c0d11c0 msgr2=0x7fab4c0b8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:33.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.600+0000 7fab53cd9640 1 -- 172.21.15.123:0/4020882923 shutdown_connections 2024-09-15T23:14:33.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.600+0000 7fab53cd9640 1 -- 172.21.15.123:0/4020882923 wait complete. 2024-09-15T23:14:33.619 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:14:33.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.715+0000 7fbcad4d0640 1 Processor -- start 2024-09-15T23:14:33.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.715+0000 7fbcad4d0640 1 -- start start 2024-09-15T23:14:33.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.716+0000 7fbcad4d0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbca806c320 0x7fbca80ae870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:33.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.716+0000 7fbcad4d0640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fbca80731e0 0x7fbca80b5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:33.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.716+0000 7fbcad4d0640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbca80b07c0 con 0x7fbca8148090 2024-09-15T23:14:33.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.716+0000 7fbcad4d0640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fbca80b52c0 con 0x7fbca80731e0 2024-09-15T23:14:33.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.716+0000 7fbcad4d0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbca8148470 con 0x7fbca806c320 2024-09-15T23:14:33.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.716+0000 7fbca6ffd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fbca8148090 0x7fbca806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38904/0 (socket says 172.21.15.123:38904) 2024-09-15T23:14:33.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.716+0000 7fbca6ffd640 1 -- 172.21.15.123:0/4164421019 learned_addr learned my addr 172.21.15.123:0/4164421019 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:33.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.717+0000 7fbca67fc640 1 --2- 172.21.15.123:0/4164421019 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbca806c320 0x7fbca80ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:33.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.717+0000 7fbca77fe640 1 --2- 172.21.15.123:0/4164421019 >> v2:172.21.15.188:3300/0 conn(0x7fbca80731e0 0x7fbca80b5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:33.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.717+0000 7fbca5ffb640 1 -- 172.21.15.123:0/4164421019 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3061373589 0 0) 0x7fbca80b07c0 con 0x7fbca8148090 2024-09-15T23:14:33.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.717+0000 7fbca5ffb640 1 -- 172.21.15.123:0/4164421019 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc90003520 con 0x7fbca8148090 2024-09-15T23:14:33.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.717+0000 7fbca5ffb640 1 -- 172.21.15.123:0/4164421019 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2425541095 0 0) 0x7fbc90003520 con 0x7fbca8148090 2024-09-15T23:14:33.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.717+0000 7fbca5ffb640 1 -- 172.21.15.123:0/4164421019 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbca806c320 msgr2=0x7fbca80ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:33.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.717+0000 7fbca5ffb640 1 --2- 172.21.15.123:0/4164421019 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbca806c320 0x7fbca80ae870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:33.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.717+0000 7fbca5ffb640 1 -- 172.21.15.123:0/4164421019 >> v2:172.21.15.188:3300/0 conn(0x7fbca80731e0 msgr2=0x7fbca80b5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:33.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.717+0000 7fbca5ffb640 1 --2- 172.21.15.123:0/4164421019 >> v2:172.21.15.188:3300/0 conn(0x7fbca80731e0 0x7fbca80b5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:33.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.717+0000 7fbca5ffb640 1 -- 172.21.15.123:0/4164421019 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca80af7a0 con 0x7fbca8148090 2024-09-15T23:14:33.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.717+0000 7fbca5ffb640 1 -- 172.21.15.123:0/4164421019 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fbc980019f0 con 0x7fbca8148090 2024-09-15T23:14:33.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.717+0000 7fbca5ffb640 1 -- 172.21.15.123:0/4164421019 >> v1:172.21.15.123:6789/0 conn(0x7fbca8148090 legacy=0x7fbca806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:33.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.717+0000 7fbca5ffb640 1 --2- 172.21.15.123:0/4164421019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc900039b0 0x7fbc90003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:33.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.717+0000 7fbca5ffb640 1 --2- 172.21.15.123:0/4164421019 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc90004800 0x7fbc90004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:33.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.717+0000 7fbca5ffb640 1 --2- 172.21.15.123:0/4164421019 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbca806c320 0x7fbc900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:33.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.717+0000 7fbca5ffb640 1 -- 172.21.15.123:0/4164421019 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbca8148470 con 0x7fbc900039b0 2024-09-15T23:14:33.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.717+0000 7fbca5ffb640 1 -- 172.21.15.123:0/4164421019 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9000b9c0 con 0x7fbc90004800 2024-09-15T23:14:33.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.717+0000 7fbca5ffb640 1 -- 172.21.15.123:0/4164421019 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbc9000bb40 con 0x7fbca806c320 2024-09-15T23:14:33.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.717+0000 7fbca6ffd640 1 --2- 172.21.15.123:0/4164421019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc900039b0 0x7fbc90003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:33.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.717+0000 7fbca67fc640 1 --2- 172.21.15.123:0/4164421019 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc90004800 0x7fbc90004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:33.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.717+0000 7fbca77fe640 1 --2- 172.21.15.123:0/4164421019 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbca806c320 0x7fbc900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:33.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.717+0000 7fbca6ffd640 1 -- 172.21.15.123:0/4164421019 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbca806c320 msgr2=0x7fbc900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:33.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.717+0000 7fbca6ffd640 1 --2- 172.21.15.123:0/4164421019 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbca806c320 0x7fbc900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:33.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.717+0000 7fbca6ffd640 1 -- 172.21.15.123:0/4164421019 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc90004800 msgr2=0x7fbc90004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:33.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.717+0000 7fbca6ffd640 1 --2- 172.21.15.123:0/4164421019 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc90004800 0x7fbc90004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:33.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.717+0000 7fbca6ffd640 1 -- 172.21.15.123:0/4164421019 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc90003520 con 0x7fbc900039b0 2024-09-15T23:14:33.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.718+0000 7fbca6ffd640 1 --2- 172.21.15.123:0/4164421019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc900039b0 0x7fbc90003dd0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fbc9800a880 tx=0x7fbc90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fab0ee83014b170 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:33.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.718+0000 7fbca5ffb640 1 -- 172.21.15.123:0/4164421019 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9800a4a0 con 0x7fbc900039b0 2024-09-15T23:14:33.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.718+0000 7fbca5ffb640 1 -- 172.21.15.123:0/4164421019 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc9802f070 con 0x7fbc900039b0 2024-09-15T23:14:33.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.718+0000 7fbca5ffb640 1 -- 172.21.15.123:0/4164421019 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9802bce0 con 0x7fbc900039b0 2024-09-15T23:14:33.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.719+0000 7fbcad4d0640 1 -- 172.21.15.123:0/4164421019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc900039b0 msgr2=0x7fbc90003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:33.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.719+0000 7fbcad4d0640 1 --2- 172.21.15.123:0/4164421019 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc900039b0 0x7fbc90003dd0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fbc9800a880 tx=0x7fbc90005830 comp rx=0 tx=0).stop 2024-09-15T23:14:33.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.719+0000 7fbca77fe640 1 -- 172.21.15.123:0/4164421019 reap_dead start 2024-09-15T23:14:33.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.719+0000 7fbcad4d0640 1 -- 172.21.15.123:0/4164421019 shutdown_connections 2024-09-15T23:14:33.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.719+0000 7fbcad4d0640 1 -- 172.21.15.123:0/4164421019 >> 172.21.15.123:0/4164421019 conn(0x7fbca806cd20 msgr2=0x7fbca806d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:33.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.719+0000 7fbcad4d0640 1 -- 172.21.15.123:0/4164421019 shutdown_connections 2024-09-15T23:14:33.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.719+0000 7fbcad4d0640 1 -- 172.21.15.123:0/4164421019 wait complete. 2024-09-15T23:14:33.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.720+0000 7fbcad4d0640 1 Processor -- start 2024-09-15T23:14:33.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.720+0000 7fbcad4d0640 1 -- start start 2024-09-15T23:14:33.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.721+0000 7fbcad4d0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc900039b0 0x7fbca815e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:33.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.721+0000 7fbcad4d0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbca8144290 0x7fbca8144710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:33.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.721+0000 7fbcad4d0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbca8141a00 0x7fbca8141e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:33.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.721+0000 7fbcad4d0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbca80af1e0 con 0x7fbc900039b0 2024-09-15T23:14:33.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.721+0000 7fbcad4d0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbca80b5580 con 0x7fbca8141a00 2024-09-15T23:14:33.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.721+0000 7fbcad4d0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbca80af4c0 con 0x7fbca8144290 2024-09-15T23:14:33.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.721+0000 7fbca6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc900039b0 0x7fbca815e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:33.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.721+0000 7fbca6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc900039b0 0x7fbca815e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36162/0 (socket says 172.21.15.123:36162) 2024-09-15T23:14:33.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.721+0000 7fbca6ffd640 1 -- 172.21.15.123:0/3233262227 learned_addr learned my addr 172.21.15.123:0/3233262227 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:33.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.721+0000 7fbca6ffd640 1 -- 172.21.15.123:0/3233262227 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbca8144290 msgr2=0x7fbca8144710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:33.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.721+0000 7fbca6ffd640 1 --2- 172.21.15.123:0/3233262227 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbca8144290 0x7fbca8144710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:33.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.721+0000 7fbca6ffd640 1 -- 172.21.15.123:0/3233262227 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbca8141a00 msgr2=0x7fbca8141e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:33.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.721+0000 7fbca77fe640 1 --2- 172.21.15.123:0/3233262227 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbca8141a00 0x7fbca8141e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:33.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.721+0000 7fbca6ffd640 1 --2- 172.21.15.123:0/3233262227 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbca8141a00 0x7fbca8141e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:33.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.721+0000 7fbca6ffd640 1 -- 172.21.15.123:0/3233262227 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca8134860 con 0x7fbc900039b0 2024-09-15T23:14:33.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.721+0000 7fbca6ffd640 1 --2- 172.21.15.123:0/3233262227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc900039b0 0x7fbca815e060 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fbc9800a9a0 tx=0x7fbca8073650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:33.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.721+0000 7fbc8f7fe640 1 -- 172.21.15.123:0/3233262227 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc98045070 con 0x7fbc900039b0 2024-09-15T23:14:33.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.722+0000 7fbc8f7fe640 1 -- 172.21.15.123:0/3233262227 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc9802bcb0 con 0x7fbc900039b0 2024-09-15T23:14:33.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.722+0000 7fbcad4d0640 1 -- 172.21.15.123:0/3233262227 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbca81425e0 con 0x7fbc900039b0 2024-09-15T23:14:33.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.722+0000 7fbc8f7fe640 1 -- 172.21.15.123:0/3233262227 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9802be60 con 0x7fbc900039b0 2024-09-15T23:14:33.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.722+0000 7fbcad4d0640 1 -- 172.21.15.123:0/3233262227 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbca8142ba0 con 0x7fbc900039b0 2024-09-15T23:14:33.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.723+0000 7fbcad4d0640 1 -- 172.21.15.123:0/3233262227 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbca80aed20 con 0x7fbc900039b0 2024-09-15T23:14:33.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.723+0000 7fbc8f7fe640 1 -- 172.21.15.123:0/3233262227 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbc98048070 con 0x7fbc900039b0 2024-09-15T23:14:33.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.723+0000 7fbc8f7fe640 1 --2- 172.21.15.123:0/3233262227 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbc9406c2e0 0x7fbc9406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:33.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.724+0000 7fbc8f7fe640 1 -- 172.21.15.123:0/3233262227 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7fbc980ab730 con 0x7fbc900039b0 2024-09-15T23:14:33.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.724+0000 7fbca67fc640 1 --2- 172.21.15.123:0/3233262227 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbc9406c2e0 0x7fbc9406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:33.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.724+0000 7fbca67fc640 1 --2- 172.21.15.123:0/3233262227 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbc9406c2e0 0x7fbc9406e7a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbca80b6d90 tx=0x7fbc9c009320 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:33.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.728+0000 7fbc8f7fe640 1 -- 172.21.15.123:0/3233262227 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbca80aed20 con 0x7fbc900039b0 2024-09-15T23:14:33.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.893+0000 7fbcad4d0640 1 -- 172.21.15.123:0/3233262227 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbca80ae900 con 0x7fbc900039b0 2024-09-15T23:14:33.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.894+0000 7fbc8f7fe640 1 -- 172.21.15.123:0/3233262227 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+16706 (secure 0 0 0) 0x7fbc98079ea0 con 0x7fbc900039b0 2024-09-15T23:14:33.895 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:14:33.896 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":51,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:14:32.925966+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:14:31.528995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-15T23:14:31.891097+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:14:33.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.896+0000 7fbcad4d0640 1 -- 172.21.15.123:0/3233262227 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbc9406c2e0 msgr2=0x7fbc9406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:33.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.896+0000 7fbcad4d0640 1 --2- 172.21.15.123:0/3233262227 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbc9406c2e0 0x7fbc9406e7a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbca80b6d90 tx=0x7fbc9c009320 comp rx=0 tx=0).stop 2024-09-15T23:14:33.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.896+0000 7fbcad4d0640 1 -- 172.21.15.123:0/3233262227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc900039b0 msgr2=0x7fbca815e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:33.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.896+0000 7fbcad4d0640 1 --2- 172.21.15.123:0/3233262227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc900039b0 0x7fbca815e060 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fbc9800a9a0 tx=0x7fbca8073650 comp rx=0 tx=0).stop 2024-09-15T23:14:33.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.896+0000 7fbcad4d0640 1 -- 172.21.15.123:0/3233262227 shutdown_connections 2024-09-15T23:14:33.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.896+0000 7fbcad4d0640 1 --2- 172.21.15.123:0/3233262227 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbca8141a00 0x7fbca8141e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:33.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.896+0000 7fbcad4d0640 1 --2- 172.21.15.123:0/3233262227 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbca8144290 0x7fbca8144710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:33.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.896+0000 7fbcad4d0640 1 --2- 172.21.15.123:0/3233262227 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbc9406c2e0 0x7fbc9406e7a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:33.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.896+0000 7fbcad4d0640 1 --2- 172.21.15.123:0/3233262227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc900039b0 0x7fbca815e060 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:33.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.896+0000 7fbcad4d0640 1 -- 172.21.15.123:0/3233262227 >> 172.21.15.123:0/3233262227 conn(0x7fbca806cd20 msgr2=0x7fbca806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:33.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.897+0000 7fbcad4d0640 1 -- 172.21.15.123:0/3233262227 shutdown_connections 2024-09-15T23:14:33.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:33.897+0000 7fbcad4d0640 1 -- 172.21.15.123:0/3233262227 wait complete. 2024-09-15T23:14:33.909 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:14:34.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.006+0000 7fb1969d6640 1 Processor -- start 2024-09-15T23:14:34.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.006+0000 7fb1969d6640 1 -- start start 2024-09-15T23:14:34.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.006+0000 7fb1969d6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb1900b6970 0x7fb1900b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:34.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.006+0000 7fb1969d6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb1900d23b0 0x7fb1900b8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:34.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.006+0000 7fb1969d6640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1900d0e70 con 0x7fb19015ed20 2024-09-15T23:14:34.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.006+0000 7fb1969d6640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fb1900d41c0 con 0x7fb1900b6970 2024-09-15T23:14:34.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.006+0000 7fb1969d6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb1900d35b0 con 0x7fb1900d23b0 2024-09-15T23:14:34.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.007+0000 7fb187fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb1900b6970 0x7fb1900b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:34.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.007+0000 7fb18ffff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb19015ed20 0x7fb1900b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38906/0 (socket says 172.21.15.123:38906) 2024-09-15T23:14:34.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.007+0000 7fb18ffff640 1 -- 172.21.15.123:0/4270554571 learned_addr learned my addr 172.21.15.123:0/4270554571 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:34.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.007+0000 7fb187fff640 1 -- 172.21.15.123:0/4270554571 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb1900d23b0 msgr2=0x7fb1900b8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:34.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.007+0000 7fb187fff640 1 --2- 172.21.15.123:0/4270554571 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb1900d23b0 0x7fb1900b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:34.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.007+0000 7fb187fff640 1 -- 172.21.15.123:0/4270554571 >> v1:172.21.15.123:6789/0 conn(0x7fb19015ed20 legacy=0x7fb1900b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:34.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.007+0000 7fb18f7fe640 1 -- 172.21.15.123:0/4270554571 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 902697858 0 0) 0x7fb180001110 con 0x7fb19015ed20 2024-09-15T23:14:34.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.007+0000 7fb187fff640 1 -- 172.21.15.123:0/4270554571 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1900d3890 con 0x7fb1900b6970 2024-09-15T23:14:34.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.008+0000 7fb187fff640 1 --2- 172.21.15.123:0/4270554571 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1900b6970 0x7fb1900b80d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb1780097a0 tx=0x7fb17802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4cbddf4959b5c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:34.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.008+0000 7fb18f7fe640 1 -- 172.21.15.123:0/4270554571 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb178037070 con 0x7fb1900b6970 2024-09-15T23:14:34.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.008+0000 7fb18f7fe640 1 -- 172.21.15.123:0/4270554571 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb17802ae50 con 0x7fb1900b6970 2024-09-15T23:14:34.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.008+0000 7fb18f7fe640 1 -- 172.21.15.123:0/4270554571 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb178032660 con 0x7fb1900b6970 2024-09-15T23:14:34.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.008+0000 7fb1969d6640 1 -- 172.21.15.123:0/4270554571 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1900b6970 msgr2=0x7fb1900b80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:34.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.008+0000 7fb1969d6640 1 --2- 172.21.15.123:0/4270554571 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1900b6970 0x7fb1900b80d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb1780097a0 tx=0x7fb17802a100 comp rx=0 tx=0).stop 2024-09-15T23:14:34.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.008+0000 7fb1969d6640 1 -- 172.21.15.123:0/4270554571 shutdown_connections 2024-09-15T23:14:34.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.008+0000 7fb1969d6640 1 --2- 172.21.15.123:0/4270554571 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb1900d23b0 0x7fb1900b8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:34.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.008+0000 7fb1969d6640 1 --2- 172.21.15.123:0/4270554571 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1900b6970 0x7fb1900b80d0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:34.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.008+0000 7fb1969d6640 1 -- 172.21.15.123:0/4270554571 >> 172.21.15.123:0/4270554571 conn(0x7fb1900d1260 msgr2=0x7fb1900d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:34.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.008+0000 7fb1969d6640 1 -- 172.21.15.123:0/4270554571 shutdown_connections 2024-09-15T23:14:34.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.008+0000 7fb1969d6640 1 -- 172.21.15.123:0/4270554571 wait complete. 2024-09-15T23:14:34.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.009+0000 7fb1969d6640 1 Processor -- start 2024-09-15T23:14:34.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.010+0000 7fb1969d6640 1 -- start start 2024-09-15T23:14:34.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.010+0000 7fb1969d6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb1900b6970 0x7fb19015bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:34.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.010+0000 7fb1969d6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb1900d23b0 0x7fb1900cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:34.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.010+0000 7fb1969d6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb19015ed20 0x7fb1901f8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:34.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.010+0000 7fb1969d6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb1900d32a0 con 0x7fb19015ed20 2024-09-15T23:14:34.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.010+0000 7fb1969d6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb1900d3e50 con 0x7fb1900d23b0 2024-09-15T23:14:34.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.010+0000 7fb1969d6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb19015f100 con 0x7fb1900b6970 2024-09-15T23:14:34.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.010+0000 7fb194f73640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb19015ed20 0x7fb1901f8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:34.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.010+0000 7fb194f73640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb19015ed20 0x7fb1901f8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36170/0 (socket says 172.21.15.123:36170) 2024-09-15T23:14:34.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.010+0000 7fb194f73640 1 -- 172.21.15.123:0/1131904969 learned_addr learned my addr 172.21.15.123:0/1131904969 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:34.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.011+0000 7fb187fff640 1 --2- 172.21.15.123:0/1131904969 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb1900d23b0 0x7fb1900cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:34.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.011+0000 7fb18ffff640 1 --2- 172.21.15.123:0/1131904969 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb1900b6970 0x7fb19015bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:34.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.011+0000 7fb194f73640 1 -- 172.21.15.123:0/1131904969 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb1900b6970 msgr2=0x7fb19015bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:34.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.011+0000 7fb194f73640 1 --2- 172.21.15.123:0/1131904969 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb1900b6970 0x7fb19015bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:34.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.011+0000 7fb194f73640 1 -- 172.21.15.123:0/1131904969 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb1900d23b0 msgr2=0x7fb1900cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:34.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.011+0000 7fb194f73640 1 --2- 172.21.15.123:0/1131904969 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb1900d23b0 0x7fb1900cb8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:34.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.011+0000 7fb194f73640 1 -- 172.21.15.123:0/1131904969 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb190155890 con 0x7fb19015ed20 2024-09-15T23:14:34.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.011+0000 7fb194f73640 1 --2- 172.21.15.123:0/1131904969 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb19015ed20 0x7fb1901f8480 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb18800b970 tx=0x7fb18800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:34.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.011+0000 7fb18d7fa640 1 -- 172.21.15.123:0/1131904969 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb188019070 con 0x7fb19015ed20 2024-09-15T23:14:34.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.011+0000 7fb18d7fa640 1 -- 172.21.15.123:0/1131904969 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb18800cb60 con 0x7fb19015ed20 2024-09-15T23:14:34.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.011+0000 7fb1969d6640 1 -- 172.21.15.123:0/1131904969 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1901f8cd0 con 0x7fb19015ed20 2024-09-15T23:14:34.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.011+0000 7fb18d7fa640 1 -- 172.21.15.123:0/1131904969 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb188014440 con 0x7fb19015ed20 2024-09-15T23:14:34.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.011+0000 7fb1969d6640 1 -- 172.21.15.123:0/1131904969 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1901f89c0 con 0x7fb19015ed20 2024-09-15T23:14:34.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.012+0000 7fb1969d6640 1 -- 172.21.15.123:0/1131904969 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1900b7010 con 0x7fb19015ed20 2024-09-15T23:14:34.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.012+0000 7fb18d7fa640 1 -- 172.21.15.123:0/1131904969 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb18801c070 con 0x7fb19015ed20 2024-09-15T23:14:34.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.013+0000 7fb18d7fa640 1 --2- 172.21.15.123:0/1131904969 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb17006c2b0 0x7fb17006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:34.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.013+0000 7fb18d7fa640 1 -- 172.21.15.123:0/1131904969 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7fb18808b1a0 con 0x7fb19015ed20 2024-09-15T23:14:34.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.013+0000 7fb18ffff640 1 --2- 172.21.15.123:0/1131904969 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb17006c2b0 0x7fb17006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:34.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.013+0000 7fb18ffff640 1 --2- 172.21.15.123:0/1131904969 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb17006c2b0 0x7fb17006e770 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb180000f60 tx=0x7fb180009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:34.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.017+0000 7fb18d7fa640 1 -- 172.21.15.123:0/1131904969 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb188059910 con 0x7fb19015ed20 2024-09-15T23:14:34.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.183+0000 7fb1969d6640 1 -- 172.21.15.123:0/1131904969 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb1900d0a90 con 0x7fb19015ed20 2024-09-15T23:14:34.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.185+0000 7fb18d7fa640 1 -- 172.21.15.123:0/1131904969 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) ==== 74+0+16706 (secure 0 0 0) 0x7fb188059210 con 0x7fb19015ed20 2024-09-15T23:14:34.187 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:14:34.187 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":51,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:14:32.925966+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:14:31.528995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-15T23:14:31.891097+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:14:34.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.187+0000 7fb1969d6640 1 -- 172.21.15.123:0/1131904969 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb17006c2b0 msgr2=0x7fb17006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:34.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.187+0000 7fb1969d6640 1 --2- 172.21.15.123:0/1131904969 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb17006c2b0 0x7fb17006e770 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb180000f60 tx=0x7fb180009040 comp rx=0 tx=0).stop 2024-09-15T23:14:34.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.187+0000 7fb1969d6640 1 -- 172.21.15.123:0/1131904969 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb19015ed20 msgr2=0x7fb1901f8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:34.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.187+0000 7fb1969d6640 1 --2- 172.21.15.123:0/1131904969 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb19015ed20 0x7fb1901f8480 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb18800b970 tx=0x7fb18800be30 comp rx=0 tx=0).stop 2024-09-15T23:14:34.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.187+0000 7fb1969d6640 1 -- 172.21.15.123:0/1131904969 shutdown_connections 2024-09-15T23:14:34.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.187+0000 7fb1969d6640 1 --2- 172.21.15.123:0/1131904969 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb17006c2b0 0x7fb17006e770 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:34.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.187+0000 7fb1969d6640 1 --2- 172.21.15.123:0/1131904969 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb19015ed20 0x7fb1901f8480 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:34.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.187+0000 7fb1969d6640 1 --2- 172.21.15.123:0/1131904969 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb1900d23b0 0x7fb1900cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:34.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.187+0000 7fb1969d6640 1 --2- 172.21.15.123:0/1131904969 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb1900b6970 0x7fb19015bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:34.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.187+0000 7fb1969d6640 1 -- 172.21.15.123:0/1131904969 >> 172.21.15.123:0/1131904969 conn(0x7fb1900d1260 msgr2=0x7fb1901612f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:34.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.187+0000 7fb1969d6640 1 -- 172.21.15.123:0/1131904969 shutdown_connections 2024-09-15T23:14:34.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.187+0000 7fb1969d6640 1 -- 172.21.15.123:0/1131904969 wait complete. 2024-09-15T23:14:34.200 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T23:14:34.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.300+0000 7fd7d8bbd640 1 Processor -- start 2024-09-15T23:14:34.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.300+0000 7fd7d8bbd640 1 -- start start 2024-09-15T23:14:34.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.300+0000 7fd7d8bbd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd7d40b3350 0x7fd7d40d2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:34.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.300+0000 7fd7d8bbd640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7d40cf710 con 0x7fd7d40b38a0 2024-09-15T23:14:34.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.300+0000 7fd7d8bbd640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7d40cf9f0 con 0x7fd7d406bfd0 2024-09-15T23:14:34.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.300+0000 7fd7d8bbd640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fd7d40b78a0 con 0x7fd7d40b3350 2024-09-15T23:14:34.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.301+0000 7fd7d2d9d640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd7d40b38a0 0x7fd7d40d2e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38916/0 (socket says 172.21.15.123:38916) 2024-09-15T23:14:34.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.301+0000 7fd7d2d9d640 1 -- 172.21.15.123:0/1502107073 learned_addr learned my addr 172.21.15.123:0/1502107073 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:34.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.301+0000 7fd7cbfff640 1 --2- 172.21.15.123:0/1502107073 >> v2:172.21.15.188:3300/0 conn(0x7fd7d40b3350 0x7fd7d40d2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:34.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.301+0000 7fd7d1d9b640 1 -- 172.21.15.123:0/1502107073 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3146442316 0 0) 0x7fd7d40cf710 con 0x7fd7d40b38a0 2024-09-15T23:14:34.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.301+0000 7fd7d1d9b640 1 -- 172.21.15.123:0/1502107073 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7c0003520 con 0x7fd7d40b38a0 2024-09-15T23:14:34.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.301+0000 7fd7d1d9b640 1 -- 172.21.15.123:0/1502107073 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2191152105 0 0) 0x7fd7c0003520 con 0x7fd7d40b38a0 2024-09-15T23:14:34.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.301+0000 7fd7d1d9b640 1 -- 172.21.15.123:0/1502107073 >> v2:172.21.15.188:3300/0 conn(0x7fd7d40b3350 msgr2=0x7fd7d40d2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:34.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.301+0000 7fd7d1d9b640 1 --2- 172.21.15.123:0/1502107073 >> v2:172.21.15.188:3300/0 conn(0x7fd7d40b3350 0x7fd7d40d2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:34.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.301+0000 7fd7d1d9b640 1 -- 172.21.15.123:0/1502107073 >> v1:172.21.15.188:6789/0 conn(0x7fd7d406bfd0 legacy=0x7fd7d406c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:34.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.301+0000 7fd7d1d9b640 1 -- 172.21.15.123:0/1502107073 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d40cfcd0 con 0x7fd7d40b38a0 2024-09-15T23:14:34.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.301+0000 7fd7d1d9b640 1 -- 172.21.15.123:0/1502107073 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fd7cc0019f0 con 0x7fd7d40b38a0 2024-09-15T23:14:34.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.301+0000 7fd7d1d9b640 1 -- 172.21.15.123:0/1502107073 >> v1:172.21.15.123:6789/0 conn(0x7fd7d40b38a0 legacy=0x7fd7d40d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:34.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.301+0000 7fd7d1d9b640 1 --2- 172.21.15.123:0/1502107073 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd7c00039b0 0x7fd7c0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:34.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.301+0000 7fd7d1d9b640 1 --2- 172.21.15.123:0/1502107073 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7c0004800 0x7fd7c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:34.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.301+0000 7fd7d1d9b640 1 --2- 172.21.15.123:0/1502107073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7c00051c0 0x7fd7c000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:34.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.301+0000 7fd7d1d9b640 1 -- 172.21.15.123:0/1502107073 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c000c040 con 0x7fd7c00051c0 2024-09-15T23:14:34.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.301+0000 7fd7d1d9b640 1 -- 172.21.15.123:0/1502107073 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c000c1f0 con 0x7fd7c0004800 2024-09-15T23:14:34.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.301+0000 7fd7d1d9b640 1 -- 172.21.15.123:0/1502107073 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd7c000c3f0 con 0x7fd7c00039b0 2024-09-15T23:14:34.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.301+0000 7fd7d2d9d640 1 --2- 172.21.15.123:0/1502107073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7c00051c0 0x7fd7c000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:34.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.301+0000 7fd7d259c640 1 --2- 172.21.15.123:0/1502107073 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd7c00039b0 0x7fd7c0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:34.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.301+0000 7fd7cbfff640 1 --2- 172.21.15.123:0/1502107073 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7c0004800 0x7fd7c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:34.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.302+0000 7fd7d2d9d640 1 -- 172.21.15.123:0/1502107073 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd7c00039b0 msgr2=0x7fd7c0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:34.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.302+0000 7fd7d2d9d640 1 --2- 172.21.15.123:0/1502107073 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd7c00039b0 0x7fd7c0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:34.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.302+0000 7fd7d2d9d640 1 -- 172.21.15.123:0/1502107073 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7c0004800 msgr2=0x7fd7c0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:34.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.302+0000 7fd7d2d9d640 1 --2- 172.21.15.123:0/1502107073 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7c0004800 0x7fd7c0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:34.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.302+0000 7fd7d2d9d640 1 -- 172.21.15.123:0/1502107073 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c0003520 con 0x7fd7c00051c0 2024-09-15T23:14:34.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.302+0000 7fd7d2d9d640 1 -- 172.21.15.123:0/1502107073 reap_dead start 2024-09-15T23:14:34.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.302+0000 7fd7d2d9d640 1 --2- 172.21.15.123:0/1502107073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7c00051c0 0x7fd7c000b9c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc00a840 tx=0x7fd7c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98339715653c1461 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:34.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.302+0000 7fd7d1d9b640 1 -- 172.21.15.123:0/1502107073 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc00a460 con 0x7fd7c00051c0 2024-09-15T23:14:34.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.302+0000 7fd7d1d9b640 1 -- 172.21.15.123:0/1502107073 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7cc02f070 con 0x7fd7c00051c0 2024-09-15T23:14:34.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.302+0000 7fd7d1d9b640 1 -- 172.21.15.123:0/1502107073 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc02bcb0 con 0x7fd7c00051c0 2024-09-15T23:14:34.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.303+0000 7fd7d8bbd640 1 -- 172.21.15.123:0/1502107073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7c00051c0 msgr2=0x7fd7c000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:34.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.303+0000 7fd7d8bbd640 1 --2- 172.21.15.123:0/1502107073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7c00051c0 0x7fd7c000b9c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc00a840 tx=0x7fd7c0005830 comp rx=0 tx=0).stop 2024-09-15T23:14:34.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.303+0000 7fd7d8bbd640 1 -- 172.21.15.123:0/1502107073 shutdown_connections 2024-09-15T23:14:34.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.303+0000 7fd7d8bbd640 1 --2- 172.21.15.123:0/1502107073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7c00051c0 0x7fd7c000b9c0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:34.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.303+0000 7fd7d8bbd640 1 -- 172.21.15.123:0/1502107073 >> 172.21.15.123:0/1502107073 conn(0x7fd7d40d11c0 msgr2=0x7fd7d40d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:34.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.303+0000 7fd7d8bbd640 1 -- 172.21.15.123:0/1502107073 shutdown_connections 2024-09-15T23:14:34.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.303+0000 7fd7d8bbd640 1 -- 172.21.15.123:0/1502107073 wait complete. 2024-09-15T23:14:34.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.304+0000 7fd7d8bbd640 1 Processor -- start 2024-09-15T23:14:34.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.304+0000 7fd7d8bbd640 1 -- start start 2024-09-15T23:14:34.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.305+0000 7fd7d8bbd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7c00051c0 0x7fd7d4154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:34.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.305+0000 7fd7d8bbd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7d4159620 0x7fd7d4159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:34.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.305+0000 7fd7d8bbd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd7d40ce9c0 0x7fd7d40cee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:34.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.305+0000 7fd7d8bbd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d406cd50 con 0x7fd7c00051c0 2024-09-15T23:14:34.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.305+0000 7fd7d8bbd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d40cffb0 con 0x7fd7d4159620 2024-09-15T23:14:34.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.305+0000 7fd7d8bbd640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd7d415eae0 con 0x7fd7d40ce9c0 2024-09-15T23:14:34.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.305+0000 7fd7d259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7c00051c0 0x7fd7d4154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:34.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.305+0000 7fd7d259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7c00051c0 0x7fd7d4154be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36190/0 (socket says 172.21.15.123:36190) 2024-09-15T23:14:34.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.305+0000 7fd7d259c640 1 -- 172.21.15.123:0/3288921594 learned_addr learned my addr 172.21.15.123:0/3288921594 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:34.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.305+0000 7fd7d259c640 1 -- 172.21.15.123:0/3288921594 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd7d40ce9c0 msgr2=0x7fd7d40cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:34.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.305+0000 7fd7d259c640 1 --2- 172.21.15.123:0/3288921594 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd7d40ce9c0 0x7fd7d40cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:34.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.305+0000 7fd7d259c640 1 -- 172.21.15.123:0/3288921594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7d4159620 msgr2=0x7fd7d4159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:34.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.305+0000 7fd7d259c640 1 --2- 172.21.15.123:0/3288921594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7d4159620 0x7fd7d4159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:34.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.305+0000 7fd7d259c640 1 -- 172.21.15.123:0/3288921594 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d40b6bd0 con 0x7fd7c00051c0 2024-09-15T23:14:34.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.306+0000 7fd7d259c640 1 --2- 172.21.15.123:0/3288921594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7c00051c0 0x7fd7d4154be0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd7c400f5f0 tx=0x7fd7c400fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:34.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.306+0000 7fd7caffd640 1 -- 172.21.15.123:0/3288921594 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c40052e0 con 0x7fd7c00051c0 2024-09-15T23:14:34.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.306+0000 7fd7caffd640 1 -- 172.21.15.123:0/3288921594 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7c4018070 con 0x7fd7c00051c0 2024-09-15T23:14:34.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.306+0000 7fd7d8bbd640 1 -- 172.21.15.123:0/3288921594 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7d40b4240 con 0x7fd7c00051c0 2024-09-15T23:14:34.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.306+0000 7fd7caffd640 1 -- 172.21.15.123:0/3288921594 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c4003810 con 0x7fd7c00051c0 2024-09-15T23:14:34.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.306+0000 7fd7d8bbd640 1 -- 172.21.15.123:0/3288921594 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7d40b4800 con 0x7fd7c00051c0 2024-09-15T23:14:34.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.307+0000 7fd7d8bbd640 1 -- 172.21.15.123:0/3288921594 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7d406c3b0 con 0x7fd7c00051c0 2024-09-15T23:14:34.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.307+0000 7fd7caffd640 1 -- 172.21.15.123:0/3288921594 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd7c40039b0 con 0x7fd7c00051c0 2024-09-15T23:14:34.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.308+0000 7fd7caffd640 1 --2- 172.21.15.123:0/3288921594 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd7b406c2e0 0x7fd7b406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:34.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.308+0000 7fd7caffd640 1 -- 172.21.15.123:0/3288921594 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5709+0+0 (secure 0 0 0) 0x7fd7c408b1d0 con 0x7fd7c00051c0 2024-09-15T23:14:34.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.308+0000 7fd7cbfff640 1 --2- 172.21.15.123:0/3288921594 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd7b406c2e0 0x7fd7b406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:34.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.308+0000 7fd7cbfff640 1 --2- 172.21.15.123:0/3288921594 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd7b406c2e0 0x7fd7b406e7a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd7d41f8040 tx=0x7fd7bc009320 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:34.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.312+0000 7fd7caffd640 1 -- 172.21.15.123:0/3288921594 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd7c40599d0 con 0x7fd7c00051c0 2024-09-15T23:14:34.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:34.512+0000 7fd7d8bbd640 1 -- 172.21.15.123:0/3288921594 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fd7d40d0cf0 con 0x7fd7c00051c0 2024-09-15T23:14:34.848 INFO:tasks.ceph.mds.d.smithi188.stderr:2024-09-15T23:14:34.847+0000 7fe81a84d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:14:35.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.241+0000 7fd7caffd640 1 -- 172.21.15.123:0/3288921594 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v20) ==== 118+0+0 (secure 0 0 0) 0x7fd7c40592d0 con 0x7fd7c00051c0 2024-09-15T23:14:35.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.244+0000 7fd7d8bbd640 1 -- 172.21.15.123:0/3288921594 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd7b406c2e0 msgr2=0x7fd7b406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:35.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.244+0000 7fd7d8bbd640 1 --2- 172.21.15.123:0/3288921594 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd7b406c2e0 0x7fd7b406e7a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd7d41f8040 tx=0x7fd7bc009320 comp rx=0 tx=0).stop 2024-09-15T23:14:35.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.244+0000 7fd7d8bbd640 1 -- 172.21.15.123:0/3288921594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7c00051c0 msgr2=0x7fd7d4154be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:35.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.244+0000 7fd7d8bbd640 1 --2- 172.21.15.123:0/3288921594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7c00051c0 0x7fd7d4154be0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd7c400f5f0 tx=0x7fd7c400fab0 comp rx=0 tx=0).stop 2024-09-15T23:14:35.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.244+0000 7fd7d8bbd640 1 -- 172.21.15.123:0/3288921594 shutdown_connections 2024-09-15T23:14:35.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.244+0000 7fd7d8bbd640 1 --2- 172.21.15.123:0/3288921594 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd7d40ce9c0 0x7fd7d40cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:35.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.244+0000 7fd7d8bbd640 1 --2- 172.21.15.123:0/3288921594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7d4159620 0x7fd7d4159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:35.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.244+0000 7fd7d8bbd640 1 --2- 172.21.15.123:0/3288921594 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd7b406c2e0 0x7fd7b406e7a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:35.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.244+0000 7fd7d8bbd640 1 --2- 172.21.15.123:0/3288921594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7c00051c0 0x7fd7d4154be0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:35.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.244+0000 7fd7d8bbd640 1 -- 172.21.15.123:0/3288921594 >> 172.21.15.123:0/3288921594 conn(0x7fd7d40d11c0 msgr2=0x7fd7d40d37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:35.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.244+0000 7fd7d8bbd640 1 -- 172.21.15.123:0/3288921594 shutdown_connections 2024-09-15T23:14:35.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.244+0000 7fd7d8bbd640 1 -- 172.21.15.123:0/3288921594 wait complete. 2024-09-15T23:14:35.259 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T23:14:35.260 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T23:14:35.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.364+0000 7fed3fcc9640 1 Processor -- start 2024-09-15T23:14:35.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.364+0000 7fed3fcc9640 1 -- start start 2024-09-15T23:14:35.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.365+0000 7fed3fcc9640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fed3815e990 0x7fed3815ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:35.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.365+0000 7fed3fcc9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed380b5520 0x7fed3806cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:35.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.365+0000 7fed3fcc9640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fed3806d260 0x7fed38162a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:35.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.365+0000 7fed3fcc9640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fed3815f2b0 con 0x7fed3806d260 2024-09-15T23:14:35.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.365+0000 7fed3fcc9640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fed3815f550 con 0x7fed3815e990 2024-09-15T23:14:35.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.365+0000 7fed3fcc9640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fed3815f830 con 0x7fed380b5520 2024-09-15T23:14:35.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.365+0000 7fed3e266640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fed3806d260 0x7fed38162a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:35.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.365+0000 7fed3e266640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fed3806d260 0x7fed38162a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36198/0 (socket says 172.21.15.123:36198) 2024-09-15T23:14:35.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.365+0000 7fed3e266640 1 -- 172.21.15.123:0/2652104258 learned_addr learned my addr 172.21.15.123:0/2652104258 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:35.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.365+0000 7fed3d264640 1 --2- 172.21.15.123:0/2652104258 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed380b5520 0x7fed3806cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:35.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.365+0000 7fed3da65640 1 --2- 172.21.15.123:0/2652104258 >> v2:172.21.15.188:3300/0 conn(0x7fed3815e990 0x7fed3815ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:35.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.365+0000 7fed3e266640 1 -- 172.21.15.123:0/2652104258 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed380b5520 msgr2=0x7fed3806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:35.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.366+0000 7fed3e266640 1 --2- 172.21.15.123:0/2652104258 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed380b5520 0x7fed3806cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:35.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.366+0000 7fed3e266640 1 -- 172.21.15.123:0/2652104258 >> v2:172.21.15.188:3300/0 conn(0x7fed3815e990 msgr2=0x7fed3815ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:35.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.366+0000 7fed3e266640 1 --2- 172.21.15.123:0/2652104258 >> v2:172.21.15.188:3300/0 conn(0x7fed3815e990 0x7fed3815ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:35.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.366+0000 7fed3e266640 1 -- 172.21.15.123:0/2652104258 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed3815fb10 con 0x7fed3806d260 2024-09-15T23:14:35.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.366+0000 7fed3d264640 1 --2- 172.21.15.123:0/2652104258 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed380b5520 0x7fed3806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:35.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.366+0000 7fed3da65640 1 --2- 172.21.15.123:0/2652104258 >> v2:172.21.15.188:3300/0 conn(0x7fed3815e990 0x7fed3815ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:35.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.366+0000 7fed3e266640 1 --2- 172.21.15.123:0/2652104258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed3806d260 0x7fed38162a00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fed38068890 tx=0x7fed3002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cffa6541c03570e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:35.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.366+0000 7fed3ca63640 1 -- 172.21.15.123:0/2652104258 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed30036070 con 0x7fed3806d260 2024-09-15T23:14:35.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.366+0000 7fed3ca63640 1 -- 172.21.15.123:0/2652104258 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed30031600 con 0x7fed3806d260 2024-09-15T23:14:35.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.366+0000 7fed3ca63640 1 -- 172.21.15.123:0/2652104258 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed300319d0 con 0x7fed3806d260 2024-09-15T23:14:35.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.367+0000 7fed3fcc9640 1 -- 172.21.15.123:0/2652104258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed3806d260 msgr2=0x7fed38162a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:35.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.367+0000 7fed3fcc9640 1 --2- 172.21.15.123:0/2652104258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed3806d260 0x7fed38162a00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fed38068890 tx=0x7fed3002a6a0 comp rx=0 tx=0).stop 2024-09-15T23:14:35.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.367+0000 7fed3fcc9640 1 -- 172.21.15.123:0/2652104258 shutdown_connections 2024-09-15T23:14:35.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.367+0000 7fed3fcc9640 1 --2- 172.21.15.123:0/2652104258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed3806d260 0x7fed38162a00 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:35.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.367+0000 7fed3fcc9640 1 --2- 172.21.15.123:0/2652104258 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed380b5520 0x7fed3806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:35.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.367+0000 7fed3fcc9640 1 --2- 172.21.15.123:0/2652104258 >> v2:172.21.15.188:3300/0 conn(0x7fed3815e990 0x7fed3815ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:35.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.367+0000 7fed3fcc9640 1 -- 172.21.15.123:0/2652104258 >> 172.21.15.123:0/2652104258 conn(0x7fed380d25d0 msgr2=0x7fed380d29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:35.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.367+0000 7fed3fcc9640 1 -- 172.21.15.123:0/2652104258 shutdown_connections 2024-09-15T23:14:35.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.367+0000 7fed3fcc9640 1 -- 172.21.15.123:0/2652104258 wait complete. 2024-09-15T23:14:35.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.368+0000 7fed3fcc9640 1 Processor -- start 2024-09-15T23:14:35.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.368+0000 7fed3fcc9640 1 -- start start 2024-09-15T23:14:35.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.369+0000 7fed3fcc9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed3806d260 0x7fed381508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:35.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.369+0000 7fed3fcc9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed380b5520 0x7fed38150df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:35.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.369+0000 7fed3fcc9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed3815e990 0x7fed38153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:35.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.369+0000 7fed3fcc9640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fed381630c0 con 0x7fed3815e990 2024-09-15T23:14:35.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.369+0000 7fed3fcc9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fed38162f40 con 0x7fed380b5520 2024-09-15T23:14:35.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.369+0000 7fed3fcc9640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fed38163240 con 0x7fed3806d260 2024-09-15T23:14:35.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.369+0000 7fed3e266640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed3815e990 0x7fed38153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:35.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.369+0000 7fed3e266640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed3815e990 0x7fed38153170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36210/0 (socket says 172.21.15.123:36210) 2024-09-15T23:14:35.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.369+0000 7fed3e266640 1 -- 172.21.15.123:0/3875899417 learned_addr learned my addr 172.21.15.123:0/3875899417 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:35.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.369+0000 7fed3d264640 1 --2- 172.21.15.123:0/3875899417 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed380b5520 0x7fed38150df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:35.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.369+0000 7fed3da65640 1 --2- 172.21.15.123:0/3875899417 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed3806d260 0x7fed381508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:35.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.369+0000 7fed3e266640 1 -- 172.21.15.123:0/3875899417 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed3806d260 msgr2=0x7fed381508b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:35.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.369+0000 7fed3e266640 1 --2- 172.21.15.123:0/3875899417 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed3806d260 0x7fed381508b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:35.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.369+0000 7fed3e266640 1 -- 172.21.15.123:0/3875899417 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed380b5520 msgr2=0x7fed38150df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:35.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.369+0000 7fed3e266640 1 --2- 172.21.15.123:0/3875899417 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed380b5520 0x7fed38150df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:35.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.369+0000 7fed3e266640 1 -- 172.21.15.123:0/3875899417 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed38151330 con 0x7fed3815e990 2024-09-15T23:14:35.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.369+0000 7fed3da65640 1 --2- 172.21.15.123:0/3875899417 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed3806d260 0x7fed381508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:35.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.370+0000 7fed3e266640 1 --2- 172.21.15.123:0/3875899417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed3815e990 0x7fed38153170 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fed3002ac90 tx=0x7fed30004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:35.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.370+0000 7fed2e7fc640 1 -- 172.21.15.123:0/3875899417 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed30036050 con 0x7fed3815e990 2024-09-15T23:14:35.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.370+0000 7fed2e7fc640 1 -- 172.21.15.123:0/3875899417 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed30042070 con 0x7fed3815e990 2024-09-15T23:14:35.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.370+0000 7fed3fcc9640 1 -- 172.21.15.123:0/3875899417 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed38154120 con 0x7fed3815e990 2024-09-15T23:14:35.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.370+0000 7fed2e7fc640 1 -- 172.21.15.123:0/3875899417 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed30009510 con 0x7fed3815e990 2024-09-15T23:14:35.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.370+0000 7fed3fcc9640 1 -- 172.21.15.123:0/3875899417 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed381e8160 con 0x7fed3815e990 2024-09-15T23:14:35.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.371+0000 7fed3fcc9640 1 -- 172.21.15.123:0/3875899417 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed3806cd20 con 0x7fed3815e990 2024-09-15T23:14:35.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.371+0000 7fed2e7fc640 1 -- 172.21.15.123:0/3875899417 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fed30007bd0 con 0x7fed3815e990 2024-09-15T23:14:35.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.372+0000 7fed2e7fc640 1 --2- 172.21.15.123:0/3875899417 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fed1c06c2b0 0x7fed1c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:35.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.372+0000 7fed2e7fc640 1 -- 172.21.15.123:0/3875899417 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7fed300ac1d0 con 0x7fed3815e990 2024-09-15T23:14:35.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.372+0000 7fed3da65640 1 --2- 172.21.15.123:0/3875899417 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fed1c06c2b0 0x7fed1c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:35.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.372+0000 7fed3da65640 1 --2- 172.21.15.123:0/3875899417 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fed1c06c2b0 0x7fed1c06e770 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fed380b7ab0 tx=0x7fed34008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:35.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.376+0000 7fed2e7fc640 1 -- 172.21.15.123:0/3875899417 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fed3007a9d0 con 0x7fed3815e990 2024-09-15T23:14:35.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:35.575+0000 7fed3fcc9640 1 -- 172.21.15.123:0/3875899417 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fed38069bd0 con 0x7fed3815e990 2024-09-15T23:14:36.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.248+0000 7fed2e7fc640 1 -- 172.21.15.123:0/3875899417 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v21) ==== 122+0+0 (secure 0 0 0) 0x7fed3007a2d0 con 0x7fed3815e990 2024-09-15T23:14:36.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.251+0000 7fed3fcc9640 1 -- 172.21.15.123:0/3875899417 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fed1c06c2b0 msgr2=0x7fed1c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:36.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.251+0000 7fed3fcc9640 1 --2- 172.21.15.123:0/3875899417 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fed1c06c2b0 0x7fed1c06e770 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fed380b7ab0 tx=0x7fed34008040 comp rx=0 tx=0).stop 2024-09-15T23:14:36.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.251+0000 7fed3fcc9640 1 -- 172.21.15.123:0/3875899417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed3815e990 msgr2=0x7fed38153170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:36.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.251+0000 7fed3fcc9640 1 --2- 172.21.15.123:0/3875899417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed3815e990 0x7fed38153170 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fed3002ac90 tx=0x7fed30004a40 comp rx=0 tx=0).stop 2024-09-15T23:14:36.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.251+0000 7fed3fcc9640 1 -- 172.21.15.123:0/3875899417 shutdown_connections 2024-09-15T23:14:36.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.251+0000 7fed3fcc9640 1 --2- 172.21.15.123:0/3875899417 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fed1c06c2b0 0x7fed1c06e770 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:36.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.251+0000 7fed3fcc9640 1 --2- 172.21.15.123:0/3875899417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed3815e990 0x7fed38153170 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:36.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.251+0000 7fed3fcc9640 1 --2- 172.21.15.123:0/3875899417 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed380b5520 0x7fed38150df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:36.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.251+0000 7fed3fcc9640 1 --2- 172.21.15.123:0/3875899417 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed3806d260 0x7fed381508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:36.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.251+0000 7fed3fcc9640 1 -- 172.21.15.123:0/3875899417 >> 172.21.15.123:0/3875899417 conn(0x7fed380d25d0 msgr2=0x7fed381601d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:36.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.251+0000 7fed3fcc9640 1 -- 172.21.15.123:0/3875899417 shutdown_connections 2024-09-15T23:14:36.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.251+0000 7fed3fcc9640 1 -- 172.21.15.123:0/3875899417 wait complete. 2024-09-15T23:14:36.267 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T23:14:36.267 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:14:36.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.368+0000 7f3951723640 1 Processor -- start 2024-09-15T23:14:36.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.368+0000 7f3951723640 1 -- start start 2024-09-15T23:14:36.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.369+0000 7f3951723640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f394c15c540 0x7f394c0b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:36.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.369+0000 7f3951723640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f394c0ce000 0x7f394c0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:36.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.369+0000 7f3951723640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f394c15c920 con 0x7f394c0b53f0 2024-09-15T23:14:36.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.369+0000 7f3951723640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f394c0b0840 con 0x7f394c0ce000 2024-09-15T23:14:36.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.369+0000 7f3951723640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f394c0b5820 con 0x7f394c15c540 2024-09-15T23:14:36.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.369+0000 7f394a7fc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f394c0ce000 0x7f394c0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:36.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.369+0000 7f394a7fc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f394c0ce000 0x7f394c0b4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51562/0 (socket says 172.21.15.123:51562) 2024-09-15T23:14:36.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.369+0000 7f394a7fc640 1 -- 172.21.15.123:0/2071954112 learned_addr learned my addr 172.21.15.123:0/2071954112 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:36.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.369+0000 7f394affd640 1 --2- 172.21.15.123:0/2071954112 >> v2:172.21.15.188:3300/0 conn(0x7f394c15c540 0x7f394c0b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:36.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.369+0000 7f394a7fc640 1 -- 172.21.15.123:0/2071954112 >> v2:172.21.15.188:3300/0 conn(0x7f394c15c540 msgr2=0x7f394c0b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:36.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.369+0000 7f394a7fc640 1 --2- 172.21.15.123:0/2071954112 >> v2:172.21.15.188:3300/0 conn(0x7f394c15c540 0x7f394c0b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:36.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.369+0000 7f394a7fc640 1 -- 172.21.15.123:0/2071954112 >> v1:172.21.15.188:6789/0 conn(0x7f394c0b53f0 legacy=0x7f394c160070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:36.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.369+0000 7f394a7fc640 1 -- 172.21.15.123:0/2071954112 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f394c0ce8a0 con 0x7f394c0ce000 2024-09-15T23:14:36.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.369+0000 7f394affd640 1 --2- 172.21.15.123:0/2071954112 >> v2:172.21.15.188:3300/0 conn(0x7f394c15c540 0x7f394c0b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:36.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.370+0000 7f394a7fc640 1 --2- 172.21.15.123:0/2071954112 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f394c0ce000 0x7f394c0b4eb0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f394c06d700 tx=0x7f393402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51d2ff081f802ad7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:36.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.370+0000 7f3949ffb640 1 -- 172.21.15.123:0/2071954112 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3934037070 con 0x7f394c0ce000 2024-09-15T23:14:36.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.370+0000 7f3949ffb640 1 -- 172.21.15.123:0/2071954112 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3934032440 con 0x7f394c0ce000 2024-09-15T23:14:36.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.370+0000 7f3949ffb640 1 -- 172.21.15.123:0/2071954112 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3934032810 con 0x7f394c0ce000 2024-09-15T23:14:36.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.371+0000 7f3951723640 1 -- 172.21.15.123:0/2071954112 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f394c0ce000 msgr2=0x7f394c0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:36.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.371+0000 7f3951723640 1 --2- 172.21.15.123:0/2071954112 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f394c0ce000 0x7f394c0b4eb0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f394c06d700 tx=0x7f393402a270 comp rx=0 tx=0).stop 2024-09-15T23:14:36.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.371+0000 7f3951723640 1 -- 172.21.15.123:0/2071954112 shutdown_connections 2024-09-15T23:14:36.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.371+0000 7f3951723640 1 --2- 172.21.15.123:0/2071954112 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f394c0ce000 0x7f394c0b4eb0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:36.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.371+0000 7f3951723640 1 --2- 172.21.15.123:0/2071954112 >> v2:172.21.15.188:3300/0 conn(0x7f394c15c540 0x7f394c0b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:36.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.371+0000 7f3951723640 1 -- 172.21.15.123:0/2071954112 >> 172.21.15.123:0/2071954112 conn(0x7f394c06cb50 msgr2=0x7f394c06cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:36.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.371+0000 7f3951723640 1 -- 172.21.15.123:0/2071954112 shutdown_connections 2024-09-15T23:14:36.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.371+0000 7f3951723640 1 -- 172.21.15.123:0/2071954112 wait complete. 2024-09-15T23:14:36.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.372+0000 7f3951723640 1 Processor -- start 2024-09-15T23:14:36.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.372+0000 7f3951723640 1 -- start start 2024-09-15T23:14:36.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.373+0000 7f3951723640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f394c0b53f0 0x7f394c151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:36.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.373+0000 7f3951723640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f394c0ce000 0x7f394c14f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:36.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.373+0000 7f3951723640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f394c15c540 0x7f394c15ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:36.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.373+0000 7f3951723640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f394c06df70 con 0x7f394c0b53f0 2024-09-15T23:14:36.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.373+0000 7f3951723640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f394c06dc90 con 0x7f394c0ce000 2024-09-15T23:14:36.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.373+0000 7f3951723640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f394c06e250 con 0x7f394c15c540 2024-09-15T23:14:36.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.373+0000 7f394affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f394c0b53f0 0x7f394c151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:36.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.373+0000 7f394affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f394c0b53f0 0x7f394c151210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51576/0 (socket says 172.21.15.123:51576) 2024-09-15T23:14:36.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.373+0000 7f394affd640 1 -- 172.21.15.123:0/1702115843 learned_addr learned my addr 172.21.15.123:0/1702115843 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:36.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.373+0000 7f394a7fc640 1 --2- 172.21.15.123:0/1702115843 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f394c0ce000 0x7f394c14f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:36.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.373+0000 7f394b7fe640 1 --2- 172.21.15.123:0/1702115843 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f394c15c540 0x7f394c15ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:36.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.373+0000 7f394affd640 1 -- 172.21.15.123:0/1702115843 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f394c15c540 msgr2=0x7f394c15ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:36.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.373+0000 7f394affd640 1 --2- 172.21.15.123:0/1702115843 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f394c15c540 0x7f394c15ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:36.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.373+0000 7f394affd640 1 -- 172.21.15.123:0/1702115843 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f394c0ce000 msgr2=0x7f394c14f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:36.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.373+0000 7f394affd640 1 --2- 172.21.15.123:0/1702115843 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f394c0ce000 0x7f394c14f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:36.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.373+0000 7f394affd640 1 -- 172.21.15.123:0/1702115843 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f394c15f250 con 0x7f394c0b53f0 2024-09-15T23:14:36.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.373+0000 7f394affd640 1 --2- 172.21.15.123:0/1702115843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f394c0b53f0 0x7f394c151210 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f393c00ce30 tx=0x7f393c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:36.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.374+0000 7f39437fe640 1 -- 172.21.15.123:0/1702115843 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393c00f890 con 0x7f394c0b53f0 2024-09-15T23:14:36.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.374+0000 7f39437fe640 1 -- 172.21.15.123:0/1702115843 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f393c00fa30 con 0x7f394c0b53f0 2024-09-15T23:14:36.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.374+0000 7f3951723640 1 -- 172.21.15.123:0/1702115843 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f394c14fa00 con 0x7f394c0b53f0 2024-09-15T23:14:36.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.374+0000 7f39437fe640 1 -- 172.21.15.123:0/1702115843 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393c00fe00 con 0x7f394c0b53f0 2024-09-15T23:14:36.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.374+0000 7f3951723640 1 -- 172.21.15.123:0/1702115843 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f394c14ffc0 con 0x7f394c0b53f0 2024-09-15T23:14:36.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.375+0000 7f3951723640 1 -- 172.21.15.123:0/1702115843 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f394c0b4eb0 con 0x7f394c0b53f0 2024-09-15T23:14:36.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.375+0000 7f39437fe640 1 -- 172.21.15.123:0/1702115843 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f393c018400 con 0x7f394c0b53f0 2024-09-15T23:14:36.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.376+0000 7f39437fe640 1 --2- 172.21.15.123:0/1702115843 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f392c06c2e0 0x7f392c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:36.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.376+0000 7f39437fe640 1 -- 172.21.15.123:0/1702115843 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7f393c08c0e0 con 0x7f394c0b53f0 2024-09-15T23:14:36.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.376+0000 7f394a7fc640 1 --2- 172.21.15.123:0/1702115843 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f392c06c2e0 0x7f392c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:36.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.376+0000 7f394a7fc640 1 --2- 172.21.15.123:0/1702115843 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f392c06c2e0 0x7f392c06e7a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3934034000 tx=0x7f393402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:36.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.380+0000 7f39437fe640 1 -- 172.21.15.123:0/1702115843 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f393c014030 con 0x7f394c0b53f0 2024-09-15T23:14:36.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.578+0000 7f3951723640 1 -- 172.21.15.123:0/1702115843 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f394c15e4c0 con 0x7f394c0b53f0 2024-09-15T23:14:36.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.579+0000 7f39437fe640 1 -- 172.21.15.123:0/1702115843 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5229 (secure 0 0 0) 0x7f393c00ae20 con 0x7f394c0b53f0 2024-09-15T23:14:36.581 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:14:36.581 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":21,"btime":"2024-09-15T23:14:36:243751+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5014,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/354247514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":354247514},{"type":"v1","addr":"172.21.15.188:6837","nonce":354247514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2925346627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2925346627},{"type":"v1","addr":"172.21.15.123:6834","nonce":2925346627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/280703051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":280703051},{"type":"v1","addr":"172.21.15.123:6835","nonce":280703051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:14:32.926325+0000","modified":"2024-09-15T23:14:35.577957+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6836/1307575248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":1307575248},{"type":"v1","addr":"172.21.15.188:6836","nonce":1307575248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":3}]} 2024-09-15T23:14:36.581 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 21 2024-09-15T23:14:36.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.581+0000 7f3951723640 1 -- 172.21.15.123:0/1702115843 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f392c06c2e0 msgr2=0x7f392c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:36.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.581+0000 7f3951723640 1 --2- 172.21.15.123:0/1702115843 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f392c06c2e0 0x7f392c06e7a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3934034000 tx=0x7f393402e000 comp rx=0 tx=0).stop 2024-09-15T23:14:36.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.581+0000 7f3951723640 1 -- 172.21.15.123:0/1702115843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f394c0b53f0 msgr2=0x7f394c151210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:36.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.581+0000 7f3951723640 1 --2- 172.21.15.123:0/1702115843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f394c0b53f0 0x7f394c151210 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f393c00ce30 tx=0x7f393c00a650 comp rx=0 tx=0).stop 2024-09-15T23:14:36.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.581+0000 7f3951723640 1 -- 172.21.15.123:0/1702115843 shutdown_connections 2024-09-15T23:14:36.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.581+0000 7f3951723640 1 --2- 172.21.15.123:0/1702115843 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f394c15c540 0x7f394c15ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:36.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.581+0000 7f3951723640 1 --2- 172.21.15.123:0/1702115843 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f394c0ce000 0x7f394c14f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:36.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.581+0000 7f3951723640 1 --2- 172.21.15.123:0/1702115843 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f392c06c2e0 0x7f392c06e7a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:36.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.581+0000 7f3951723640 1 --2- 172.21.15.123:0/1702115843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f394c0b53f0 0x7f394c151210 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:36.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.581+0000 7f3951723640 1 -- 172.21.15.123:0/1702115843 >> 172.21.15.123:0/1702115843 conn(0x7f394c06cb50 msgr2=0x7f394c06cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:36.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.581+0000 7f3951723640 1 -- 172.21.15.123:0/1702115843 shutdown_connections 2024-09-15T23:14:36.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.581+0000 7f3951723640 1 -- 172.21.15.123:0/1702115843 wait complete. 2024-09-15T23:14:36.594 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:14:36.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.691+0000 7f580700a640 1 Processor -- start 2024-09-15T23:14:36.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.691+0000 7f580700a640 1 -- start start 2024-09-15T23:14:36.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.692+0000 7f580700a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f580006f7a0 0x7f58000b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:36.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.692+0000 7f580700a640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f58000b5bd0 0x7f58000b6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:36.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.692+0000 7f580700a640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5800144b90 con 0x7f58001447b0 2024-09-15T23:14:36.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.692+0000 7f580700a640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f58000b6580 con 0x7f580006f7a0 2024-09-15T23:14:36.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.692+0000 7f580700a640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f58000b3eb0 con 0x7f58000b5bd0 2024-09-15T23:14:36.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.692+0000 7f57fffff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f580006f7a0 0x7f58000b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:36.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.692+0000 7f5804da6640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f58001447b0 0x7f580015bbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:57442/0 (socket says 172.21.15.123:57442) 2024-09-15T23:14:36.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.692+0000 7f5804da6640 1 -- 172.21.15.123:0/225012076 learned_addr learned my addr 172.21.15.123:0/225012076 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:36.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.692+0000 7f58055a7640 1 --2- 172.21.15.123:0/225012076 >> v2:172.21.15.188:3300/0 conn(0x7f58000b5bd0 0x7f58000b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:36.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.692+0000 7f57fffff640 1 -- 172.21.15.123:0/225012076 >> v2:172.21.15.188:3300/0 conn(0x7f58000b5bd0 msgr2=0x7f58000b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:36.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.692+0000 7f57fffff640 1 --2- 172.21.15.123:0/225012076 >> v2:172.21.15.188:3300/0 conn(0x7f58000b5bd0 0x7f58000b6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:36.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.692+0000 7f57fffff640 1 -- 172.21.15.123:0/225012076 >> v1:172.21.15.123:6789/0 conn(0x7f58001447b0 legacy=0x7f580015bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:36.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.692+0000 7f57fffff640 1 -- 172.21.15.123:0/225012076 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58000b4190 con 0x7f580006f7a0 2024-09-15T23:14:36.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.692+0000 7f57ff7fe640 1 -- 172.21.15.123:0/225012076 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 967976318 0 0) 0x7f5800144b90 con 0x7f58001447b0 2024-09-15T23:14:36.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.692+0000 7f58055a7640 1 --2- 172.21.15.123:0/225012076 >> v2:172.21.15.188:3300/0 conn(0x7f58000b5bd0 0x7f58000b6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:36.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.693+0000 7f57fffff640 1 --2- 172.21.15.123:0/225012076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f580006f7a0 0x7f58000b4c50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f580015c330 tx=0x7f57ec02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e86eade7d56a88 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:36.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.693+0000 7f57ff7fe640 1 -- 172.21.15.123:0/225012076 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec037070 con 0x7f580006f7a0 2024-09-15T23:14:36.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.693+0000 7f57ff7fe640 1 -- 172.21.15.123:0/225012076 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57ec032440 con 0x7f580006f7a0 2024-09-15T23:14:36.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.693+0000 7f57ff7fe640 1 -- 172.21.15.123:0/225012076 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec02ae60 con 0x7f580006f7a0 2024-09-15T23:14:36.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.693+0000 7f580700a640 1 -- 172.21.15.123:0/225012076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f580006f7a0 msgr2=0x7f58000b4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:36.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.693+0000 7f580700a640 1 --2- 172.21.15.123:0/225012076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f580006f7a0 0x7f58000b4c50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f580015c330 tx=0x7f57ec02a110 comp rx=0 tx=0).stop 2024-09-15T23:14:36.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.693+0000 7f580700a640 1 -- 172.21.15.123:0/225012076 shutdown_connections 2024-09-15T23:14:36.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.693+0000 7f580700a640 1 --2- 172.21.15.123:0/225012076 >> v2:172.21.15.188:3300/0 conn(0x7f58000b5bd0 0x7f58000b6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:36.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.693+0000 7f580700a640 1 --2- 172.21.15.123:0/225012076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f580006f7a0 0x7f58000b4c50 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:36.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.693+0000 7f580700a640 1 -- 172.21.15.123:0/225012076 >> 172.21.15.123:0/225012076 conn(0x7f58000b0a80 msgr2=0x7f58000b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:36.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.693+0000 7f580700a640 1 -- 172.21.15.123:0/225012076 shutdown_connections 2024-09-15T23:14:36.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.693+0000 7f580700a640 1 -- 172.21.15.123:0/225012076 wait complete. 2024-09-15T23:14:36.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.695+0000 7f580700a640 1 Processor -- start 2024-09-15T23:14:36.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.695+0000 7f580700a640 1 -- start start 2024-09-15T23:14:36.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.695+0000 7f580700a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f580006f7a0 0x7f58001e5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:36.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.695+0000 7f580700a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f58000b5bd0 0x7f580015a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:36.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.695+0000 7f580700a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f58001447b0 0x7f5800072890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:36.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.695+0000 7f580700a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f580006fd40 con 0x7f580006f7a0 2024-09-15T23:14:36.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.695+0000 7f580700a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f58000b4750 con 0x7f58000b5bd0 2024-09-15T23:14:36.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.696+0000 7f580700a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5800067950 con 0x7f58001447b0 2024-09-15T23:14:36.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.696+0000 7f5804da6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f580006f7a0 0x7f58001e5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:36.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.696+0000 7f5804da6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f580006f7a0 0x7f58001e5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51592/0 (socket says 172.21.15.123:51592) 2024-09-15T23:14:36.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.696+0000 7f5804da6640 1 -- 172.21.15.123:0/919440801 learned_addr learned my addr 172.21.15.123:0/919440801 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:36.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.696+0000 7f5804da6640 1 -- 172.21.15.123:0/919440801 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f58001447b0 msgr2=0x7f5800072890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:36.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.696+0000 7f5804da6640 1 --2- 172.21.15.123:0/919440801 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f58001447b0 0x7f5800072890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:36.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.696+0000 7f57fffff640 1 --2- 172.21.15.123:0/919440801 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f58000b5bd0 0x7f580015a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:36.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.696+0000 7f5804da6640 1 -- 172.21.15.123:0/919440801 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f58000b5bd0 msgr2=0x7f580015a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:36.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.696+0000 7f5804da6640 1 --2- 172.21.15.123:0/919440801 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f58000b5bd0 0x7f580015a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:36.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.696+0000 7f5804da6640 1 -- 172.21.15.123:0/919440801 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58001e5540 con 0x7f580006f7a0 2024-09-15T23:14:36.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.696+0000 7f5804da6640 1 --2- 172.21.15.123:0/919440801 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f580006f7a0 0x7f58001e5000 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f57f400c460 tx=0x7f57f400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:36.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.696+0000 7f57fd7fa640 1 -- 172.21.15.123:0/919440801 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f4018070 con 0x7f580006f7a0 2024-09-15T23:14:36.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.696+0000 7f57fd7fa640 1 -- 172.21.15.123:0/919440801 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57f4007500 con 0x7f580006f7a0 2024-09-15T23:14:36.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.696+0000 7f580700a640 1 -- 172.21.15.123:0/919440801 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58001e7610 con 0x7f580006f7a0 2024-09-15T23:14:36.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.696+0000 7f57fd7fa640 1 -- 172.21.15.123:0/919440801 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f4004a20 con 0x7f580006f7a0 2024-09-15T23:14:36.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.696+0000 7f580700a640 1 -- 172.21.15.123:0/919440801 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5800132d80 con 0x7f580006f7a0 2024-09-15T23:14:36.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.697+0000 7f580700a640 1 -- 172.21.15.123:0/919440801 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5800067d10 con 0x7f580006f7a0 2024-09-15T23:14:36.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.698+0000 7f57fd7fa640 1 -- 172.21.15.123:0/919440801 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f57f401b070 con 0x7f580006f7a0 2024-09-15T23:14:36.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.698+0000 7f57fd7fa640 1 --2- 172.21.15.123:0/919440801 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f57e406c2b0 0x7f57e406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:36.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.698+0000 7f57fd7fa640 1 -- 172.21.15.123:0/919440801 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7f57f408a6e0 con 0x7f580006f7a0 2024-09-15T23:14:36.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.698+0000 7f57fffff640 1 --2- 172.21.15.123:0/919440801 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f57e406c2b0 0x7f57e406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:36.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.699+0000 7f57fffff640 1 --2- 172.21.15.123:0/919440801 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f57e406c2b0 0x7f57e406e770 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f57ec034000 tx=0x7f57ec02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:36.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.702+0000 7f57fd7fa640 1 -- 172.21.15.123:0/919440801 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f57f4058e50 con 0x7f580006f7a0 2024-09-15T23:14:36.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.867+0000 7f580700a640 1 -- 172.21.15.123:0/919440801 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f580015ad90 con 0x7f580006f7a0 2024-09-15T23:14:36.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.868+0000 7f57fd7fa640 1 -- 172.21.15.123:0/919440801 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) ==== 74+0+16693 (secure 0 0 0) 0x7f57f4058750 con 0x7f580006f7a0 2024-09-15T23:14:36.870 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:14:36.871 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":52,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:14:34.583894+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:14:31.528995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-15T23:14:31.891097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:14:36.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.870+0000 7f580700a640 1 -- 172.21.15.123:0/919440801 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f57e406c2b0 msgr2=0x7f57e406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:36.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.870+0000 7f580700a640 1 --2- 172.21.15.123:0/919440801 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f57e406c2b0 0x7f57e406e770 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f57ec034000 tx=0x7f57ec02e000 comp rx=0 tx=0).stop 2024-09-15T23:14:36.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.870+0000 7f580700a640 1 -- 172.21.15.123:0/919440801 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f580006f7a0 msgr2=0x7f58001e5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:36.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.870+0000 7f580700a640 1 --2- 172.21.15.123:0/919440801 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f580006f7a0 0x7f58001e5000 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f57f400c460 tx=0x7f57f400c920 comp rx=0 tx=0).stop 2024-09-15T23:14:36.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.870+0000 7f580700a640 1 -- 172.21.15.123:0/919440801 shutdown_connections 2024-09-15T23:14:36.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.870+0000 7f580700a640 1 --2- 172.21.15.123:0/919440801 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f58001447b0 0x7f5800072890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:36.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.870+0000 7f580700a640 1 --2- 172.21.15.123:0/919440801 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f58000b5bd0 0x7f580015a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:36.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.870+0000 7f580700a640 1 --2- 172.21.15.123:0/919440801 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f57e406c2b0 0x7f57e406e770 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:36.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.870+0000 7f580700a640 1 --2- 172.21.15.123:0/919440801 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f580006f7a0 0x7f58001e5000 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:36.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.870+0000 7f580700a640 1 -- 172.21.15.123:0/919440801 >> 172.21.15.123:0/919440801 conn(0x7f58000b0a80 msgr2=0x7f580015f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:36.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.870+0000 7f580700a640 1 -- 172.21.15.123:0/919440801 shutdown_connections 2024-09-15T23:14:36.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.870+0000 7f580700a640 1 -- 172.21.15.123:0/919440801 wait complete. 2024-09-15T23:14:36.883 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T23:14:36.884 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:14:36.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.979+0000 7f3310d03640 1 Processor -- start 2024-09-15T23:14:36.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.979+0000 7f3310d03640 1 -- start start 2024-09-15T23:14:36.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.980+0000 7f3310d03640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f330c15ed20 0x7f330c0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:36.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.980+0000 7f3310d03640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f330c0d23b0 0x7f330c0b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:36.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.980+0000 7f3310d03640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f330c0d0e70 con 0x7f330c0cf2d0 2024-09-15T23:14:36.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.980+0000 7f3310d03640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f330c0d41c0 con 0x7f330c15ed20 2024-09-15T23:14:36.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.980+0000 7f3310d03640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f330c0d35b0 con 0x7f330c0d23b0 2024-09-15T23:14:36.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.980+0000 7f330a59c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f330c15ed20 0x7f330c0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:36.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.980+0000 7f330a59c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f330c15ed20 0x7f330c0b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51604/0 (socket says 172.21.15.123:51604) 2024-09-15T23:14:36.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.980+0000 7f330a59c640 1 -- 172.21.15.123:0/888933683 learned_addr learned my addr 172.21.15.123:0/888933683 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:36.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.981+0000 7f330a59c640 1 -- 172.21.15.123:0/888933683 >> v2:172.21.15.188:3300/0 conn(0x7f330c0d23b0 msgr2=0x7f330c0b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:36.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.981+0000 7f330a59c640 1 --2- 172.21.15.123:0/888933683 >> v2:172.21.15.188:3300/0 conn(0x7f330c0d23b0 0x7f330c0b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:36.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.981+0000 7f330a59c640 1 -- 172.21.15.123:0/888933683 >> v1:172.21.15.188:6789/0 conn(0x7f330c0cf2d0 legacy=0x7f330c0cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:36.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.981+0000 7f330a59c640 1 -- 172.21.15.123:0/888933683 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f330c0d3890 con 0x7f330c15ed20 2024-09-15T23:14:36.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.981+0000 7f330a59c640 1 --2- 172.21.15.123:0/888933683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f330c15ed20 0x7f330c0b6260 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f330c0d4690 tx=0x7f32fc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24a6034d8bae45cb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:36.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.981+0000 7f3309d9b640 1 -- 172.21.15.123:0/888933683 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc037070 con 0x7f330c15ed20 2024-09-15T23:14:36.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.981+0000 7f3309d9b640 1 -- 172.21.15.123:0/888933683 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32fc032440 con 0x7f330c15ed20 2024-09-15T23:14:36.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.982+0000 7f3309d9b640 1 -- 172.21.15.123:0/888933683 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc032810 con 0x7f330c15ed20 2024-09-15T23:14:36.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.982+0000 7f3310d03640 1 -- 172.21.15.123:0/888933683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f330c15ed20 msgr2=0x7f330c0b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:36.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.982+0000 7f3310d03640 1 --2- 172.21.15.123:0/888933683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f330c15ed20 0x7f330c0b6260 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f330c0d4690 tx=0x7f32fc02a1a0 comp rx=0 tx=0).stop 2024-09-15T23:14:36.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.982+0000 7f3310d03640 1 -- 172.21.15.123:0/888933683 shutdown_connections 2024-09-15T23:14:36.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.982+0000 7f3310d03640 1 --2- 172.21.15.123:0/888933683 >> v2:172.21.15.188:3300/0 conn(0x7f330c0d23b0 0x7f330c0b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:36.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.982+0000 7f3310d03640 1 --2- 172.21.15.123:0/888933683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f330c15ed20 0x7f330c0b6260 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:36.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.982+0000 7f3310d03640 1 -- 172.21.15.123:0/888933683 >> 172.21.15.123:0/888933683 conn(0x7f330c0d1260 msgr2=0x7f330c0d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:36.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.982+0000 7f3310d03640 1 -- 172.21.15.123:0/888933683 shutdown_connections 2024-09-15T23:14:36.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.982+0000 7f3310d03640 1 -- 172.21.15.123:0/888933683 wait complete. 2024-09-15T23:14:36.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.983+0000 7f3310d03640 1 Processor -- start 2024-09-15T23:14:36.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.984+0000 7f3310d03640 1 -- start start 2024-09-15T23:14:36.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.984+0000 7f3310d03640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f330c0cf2d0 0x7f330c0ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:36.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.984+0000 7f3310d03640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f330c0d23b0 0x7f330c154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:36.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.984+0000 7f3310d03640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f330c15ed20 0x7f330c0c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:36.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.984+0000 7f3310d03640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f330c0d32a0 con 0x7f330c0cf2d0 2024-09-15T23:14:36.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.984+0000 7f3310d03640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f330c0d3e50 con 0x7f330c0d23b0 2024-09-15T23:14:36.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.984+0000 7f3310d03640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f330c15f100 con 0x7f330c15ed20 2024-09-15T23:14:36.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.984+0000 7f330a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f330c0cf2d0 0x7f330c0ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:36.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.984+0000 7f330a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f330c0cf2d0 0x7f330c0ccf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51612/0 (socket says 172.21.15.123:51612) 2024-09-15T23:14:36.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.984+0000 7f330a59c640 1 -- 172.21.15.123:0/1474068349 learned_addr learned my addr 172.21.15.123:0/1474068349 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:36.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.985+0000 7f3301d9b640 1 --2- 172.21.15.123:0/1474068349 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f330c0d23b0 0x7f330c154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:36.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.985+0000 7f330ad9d640 1 --2- 172.21.15.123:0/1474068349 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f330c15ed20 0x7f330c0c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:36.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.985+0000 7f330a59c640 1 -- 172.21.15.123:0/1474068349 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f330c15ed20 msgr2=0x7f330c0c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:36.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.985+0000 7f330a59c640 1 --2- 172.21.15.123:0/1474068349 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f330c15ed20 0x7f330c0c99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:36.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.985+0000 7f330a59c640 1 -- 172.21.15.123:0/1474068349 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f330c0d23b0 msgr2=0x7f330c154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:36.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.985+0000 7f330a59c640 1 --2- 172.21.15.123:0/1474068349 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f330c0d23b0 0x7f330c154150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:36.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.985+0000 7f330a59c640 1 -- 172.21.15.123:0/1474068349 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f330c0cb230 con 0x7f330c0cf2d0 2024-09-15T23:14:36.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.985+0000 7f330ad9d640 1 --2- 172.21.15.123:0/1474068349 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f330c15ed20 0x7f330c0c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:36.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.985+0000 7f330a59c640 1 --2- 172.21.15.123:0/1474068349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f330c0cf2d0 0x7f330c0ccf90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f32fc000c00 tx=0x7f32fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:36.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.985+0000 7f33037fe640 1 -- 172.21.15.123:0/1474068349 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc041070 con 0x7f330c0cf2d0 2024-09-15T23:14:36.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.985+0000 7f33037fe640 1 -- 172.21.15.123:0/1474068349 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32fc03c870 con 0x7f330c0cf2d0 2024-09-15T23:14:36.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.985+0000 7f3310d03640 1 -- 172.21.15.123:0/1474068349 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f330c0c9ef0 con 0x7f330c0cf2d0 2024-09-15T23:14:36.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.985+0000 7f33037fe640 1 -- 172.21.15.123:0/1474068349 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc037040 con 0x7f330c0cf2d0 2024-09-15T23:14:36.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.985+0000 7f3310d03640 1 -- 172.21.15.123:0/1474068349 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f330c0ca470 con 0x7f330c0cf2d0 2024-09-15T23:14:36.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.986+0000 7f3310d03640 1 -- 172.21.15.123:0/1474068349 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f330c0b7010 con 0x7f330c0cf2d0 2024-09-15T23:14:36.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.987+0000 7f33037fe640 1 -- 172.21.15.123:0/1474068349 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f32fc044070 con 0x7f330c0cf2d0 2024-09-15T23:14:36.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.987+0000 7f33037fe640 1 --2- 172.21.15.123:0/1474068349 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f32ec06c2b0 0x7f32ec06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:36.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.987+0000 7f33037fe640 1 -- 172.21.15.123:0/1474068349 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7f32fc0ac1c0 con 0x7f330c0cf2d0 2024-09-15T23:14:36.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.987+0000 7f3301d9b640 1 --2- 172.21.15.123:0/1474068349 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f32ec06c2b0 0x7f32ec06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:36.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.988+0000 7f3301d9b640 1 --2- 172.21.15.123:0/1474068349 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f32ec06c2b0 0x7f32ec06e770 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f330c0cec20 tx=0x7f32f4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:36.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:36.991+0000 7f33037fe640 1 -- 172.21.15.123:0/1474068349 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f330c0cb230 con 0x7f330c0cf2d0 2024-09-15T23:14:37.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.152+0000 7f3310d03640 1 -- 172.21.15.123:0/1474068349 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f330c0d0a90 con 0x7f32ec06c2b0 2024-09-15T23:14:37.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.158+0000 7f33037fe640 1 -- 172.21.15.123:0/1474068349 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241807 (secure 0 0 0) 0x7f330c0d0a90 con 0x7f32ec06c2b0 2024-09-15T23:14:37.163 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:14:37.165 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:14:37.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.161+0000 7f3310d03640 1 -- 172.21.15.123:0/1474068349 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f32ec06c2b0 msgr2=0x7f32ec06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:37.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.161+0000 7f3310d03640 1 --2- 172.21.15.123:0/1474068349 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f32ec06c2b0 0x7f32ec06e770 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f330c0cec20 tx=0x7f32f4008040 comp rx=0 tx=0).stop 2024-09-15T23:14:37.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.161+0000 7f3310d03640 1 -- 172.21.15.123:0/1474068349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f330c0cf2d0 msgr2=0x7f330c0ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:37.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.161+0000 7f3310d03640 1 --2- 172.21.15.123:0/1474068349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f330c0cf2d0 0x7f330c0ccf90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f32fc000c00 tx=0x7f32fc0046c0 comp rx=0 tx=0).stop 2024-09-15T23:14:37.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.161+0000 7f3310d03640 1 -- 172.21.15.123:0/1474068349 shutdown_connections 2024-09-15T23:14:37.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.161+0000 7f3310d03640 1 --2- 172.21.15.123:0/1474068349 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f330c15ed20 0x7f330c0c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:37.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.161+0000 7f3310d03640 1 --2- 172.21.15.123:0/1474068349 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f330c0d23b0 0x7f330c154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:37.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.161+0000 7f3310d03640 1 --2- 172.21.15.123:0/1474068349 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f32ec06c2b0 0x7f32ec06e770 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:37.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.161+0000 7f3310d03640 1 --2- 172.21.15.123:0/1474068349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f330c0cf2d0 0x7f330c0ccf90 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:37.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.161+0000 7f3310d03640 1 -- 172.21.15.123:0/1474068349 >> 172.21.15.123:0/1474068349 conn(0x7f330c0d1260 msgr2=0x7f330c0cf6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:37.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.161+0000 7f3310d03640 1 -- 172.21.15.123:0/1474068349 shutdown_connections 2024-09-15T23:14:37.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.161+0000 7f3310d03640 1 -- 172.21.15.123:0/1474068349 wait complete. 2024-09-15T23:14:37.174 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2024-09-15T23:14:35.535033+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":96,"acting":96,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":24,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":284208,"kb_used_data":5540,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754690512,"statfs":{"total":773094113280,"available":772803084288,"internally_reserved":0,"allocated":5672960,"data_stored":3026811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":285134384},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000749"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.585749+0000","last_change":"2024-09-15T23:14:32.585749+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.585749+0000","last_undegraded":"2024-09-15T23:14:32.585749+0000","last_fullsized":"2024-09-15T23:14:32.585749+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.579440+0000","last_change":"2024-09-15T23:14:32.579440+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.579440+0000","last_undegraded":"2024-09-15T23:14:32.579440+0000","last_fullsized":"2024-09-15T23:14:32.579440+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.586556+0000","last_change":"2024-09-15T23:14:32.586556+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.586556+0000","last_undegraded":"2024-09-15T23:14:32.586556+0000","last_fullsized":"2024-09-15T23:14:32.586556+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.585450+0000","last_change":"2024-09-15T23:14:32.585450+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.585450+0000","last_undegraded":"2024-09-15T23:14:32.585450+0000","last_fullsized":"2024-09-15T23:14:32.585450+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.582819+0000","last_change":"2024-09-15T23:14:32.582819+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.582819+0000","last_undegraded":"2024-09-15T23:14:32.582819+0000","last_fullsized":"2024-09-15T23:14:32.582819+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.580677+0000","last_change":"2024-09-15T23:14:32.580677+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.580677+0000","last_undegraded":"2024-09-15T23:14:32.580677+0000","last_fullsized":"2024-09-15T23:14:32.580677+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.585391+0000","last_change":"2024-09-15T23:14:32.585391+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.585391+0000","last_undegraded":"2024-09-15T23:14:32.585391+0000","last_fullsized":"2024-09-15T23:14:32.585391+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.578586+0000","last_change":"2024-09-15T23:14:32.578586+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.578586+0000","last_undegraded":"2024-09-15T23:14:32.578586+0000","last_fullsized":"2024-09-15T23:14:32.578586+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.585310+0000","last_change":"2024-09-15T23:14:32.585310+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.585310+0000","last_undegraded":"2024-09-15T23:14:32.585310+0000","last_fullsized":"2024-09-15T23:14:32.585310+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.585247+0000","last_change":"2024-09-15T23:14:32.585247+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.585247+0000","last_undegraded":"2024-09-15T23:14:32.585247+0000","last_fullsized":"2024-09-15T23:14:32.585247+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.581941+0000","last_change":"2024-09-15T23:14:32.581941+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.581941+0000","last_undegraded":"2024-09-15T23:14:32.581941+0000","last_fullsized":"2024-09-15T23:14:32.581941+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.579143+0000","last_change":"2024-09-15T23:14:32.579143+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.579143+0000","last_undegraded":"2024-09-15T23:14:32.579143+0000","last_fullsized":"2024-09-15T23:14:32.579143+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.585255+0000","last_change":"2024-09-15T23:14:32.585255+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.585255+0000","last_undegraded":"2024-09-15T23:14:32.585255+0000","last_fullsized":"2024-09-15T23:14:32.585255+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.583704+0000","last_change":"2024-09-15T23:14:32.583704+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.583704+0000","last_undegraded":"2024-09-15T23:14:32.583704+0000","last_fullsized":"2024-09-15T23:14:32.583704+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.580341+0000","last_change":"2024-09-15T23:14:32.580341+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.580341+0000","last_undegraded":"2024-09-15T23:14:32.580341+0000","last_fullsized":"2024-09-15T23:14:32.580341+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.582924+0000","last_change":"2024-09-15T23:14:32.582924+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.582924+0000","last_undegraded":"2024-09-15T23:14:32.582924+0000","last_fullsized":"2024-09-15T23:14:32.582924+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.578331+0000","last_change":"2024-09-15T23:14:32.578331+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.578331+0000","last_undegraded":"2024-09-15T23:14:32.578331+0000","last_fullsized":"2024-09-15T23:14:32.578331+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:31.568796+0000","last_change":"2024-09-15T23:14:31.568796+0000","last_active":"2024-09-15T23:14:31.568796+0000","last_peered":"2024-09-15T23:14:31.568796+0000","last_clean":"2024-09-15T23:14:31.568796+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:31.568796+0000","last_undegraded":"2024-09-15T23:14:31.568796+0000","last_fullsized":"2024-09-15T23:14:31.568796+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.582950+0000","last_change":"2024-09-15T23:14:32.582950+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.582950+0000","last_undegraded":"2024-09-15T23:14:32.582950+0000","last_fullsized":"2024-09-15T23:14:32.582950+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.598258+0000","last_change":"2024-09-15T23:14:32.594653+0000","last_active":"2024-09-15T23:14:32.598258+0000","last_peered":"2024-09-15T23:14:32.598258+0000","last_clean":"2024-09-15T23:14:32.598258+0000","last_became_active":"2024-09-15T23:14:32.594382+0000","last_became_peered":"2024-09-15T23:14:32.594382+0000","last_unstale":"2024-09-15T23:14:32.598258+0000","last_undegraded":"2024-09-15T23:14:32.598258+0000","last_fullsized":"2024-09-15T23:14:32.598258+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:59.858491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.580300+0000","last_change":"2024-09-15T23:14:32.580300+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.580300+0000","last_undegraded":"2024-09-15T23:14:32.580300+0000","last_fullsized":"2024-09-15T23:14:32.580300+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:31.568796+0000","last_change":"2024-09-15T23:14:31.568796+0000","last_active":"2024-09-15T23:14:31.568796+0000","last_peered":"2024-09-15T23:14:31.568796+0000","last_clean":"2024-09-15T23:14:31.568796+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:31.568796+0000","last_undegraded":"2024-09-15T23:14:31.568796+0000","last_fullsized":"2024-09-15T23:14:31.568796+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.592639+0000","last_change":"2024-09-15T23:14:32.585437+0000","last_active":"2024-09-15T23:14:32.592639+0000","last_peered":"2024-09-15T23:14:32.592639+0000","last_clean":"2024-09-15T23:14:32.592639+0000","last_became_active":"2024-09-15T23:14:32.585165+0000","last_became_peered":"2024-09-15T23:14:32.585165+0000","last_unstale":"2024-09-15T23:14:32.592639+0000","last_undegraded":"2024-09-15T23:14:32.592639+0000","last_fullsized":"2024-09-15T23:14:32.592639+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:28.868122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.581417+0000","last_change":"2024-09-15T23:14:32.581417+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.581417+0000","last_undegraded":"2024-09-15T23:14:32.581417+0000","last_fullsized":"2024-09-15T23:14:32.581417+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:31.568796+0000","last_change":"2024-09-15T23:14:31.568796+0000","last_active":"2024-09-15T23:14:31.568796+0000","last_peered":"2024-09-15T23:14:31.568796+0000","last_clean":"2024-09-15T23:14:31.568796+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:31.568796+0000","last_undegraded":"2024-09-15T23:14:31.568796+0000","last_fullsized":"2024-09-15T23:14:31.568796+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.592668+0000","last_change":"2024-09-15T23:14:32.586162+0000","last_active":"2024-09-15T23:14:32.592668+0000","last_peered":"2024-09-15T23:14:32.592668+0000","last_clean":"2024-09-15T23:14:32.592668+0000","last_became_active":"2024-09-15T23:14:32.585885+0000","last_became_peered":"2024-09-15T23:14:32.585885+0000","last_unstale":"2024-09-15T23:14:32.592668+0000","last_undegraded":"2024-09-15T23:14:32.592668+0000","last_fullsized":"2024-09-15T23:14:32.592668+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:13:57.451903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.600783+0000","last_change":"2024-09-15T23:14:32.598430+0000","last_active":"2024-09-15T23:14:32.600783+0000","last_peered":"2024-09-15T23:14:32.600783+0000","last_clean":"2024-09-15T23:14:32.600783+0000","last_became_active":"2024-09-15T23:14:32.598047+0000","last_became_peered":"2024-09-15T23:14:32.598047+0000","last_unstale":"2024-09-15T23:14:32.600783+0000","last_undegraded":"2024-09-15T23:14:32.600783+0000","last_fullsized":"2024-09-15T23:14:32.600783+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:48:25.091467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.582384+0000","last_change":"2024-09-15T23:14:32.582384+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.582384+0000","last_undegraded":"2024-09-15T23:14:32.582384+0000","last_fullsized":"2024-09-15T23:14:32.582384+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:31.568796+0000","last_change":"2024-09-15T23:14:31.568796+0000","last_active":"2024-09-15T23:14:31.568796+0000","last_peered":"2024-09-15T23:14:31.568796+0000","last_clean":"2024-09-15T23:14:31.568796+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:31.568796+0000","last_undegraded":"2024-09-15T23:14:31.568796+0000","last_fullsized":"2024-09-15T23:14:31.568796+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.584834+0000","last_change":"2024-09-15T23:14:32.584834+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.584834+0000","last_undegraded":"2024-09-15T23:14:32.584834+0000","last_fullsized":"2024-09-15T23:14:32.584834+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.594053+0000","last_change":"2024-09-15T23:14:32.591483+0000","last_active":"2024-09-15T23:14:32.594053+0000","last_peered":"2024-09-15T23:14:32.594053+0000","last_clean":"2024-09-15T23:14:32.594053+0000","last_became_active":"2024-09-15T23:14:32.591161+0000","last_became_peered":"2024-09-15T23:14:32.591161+0000","last_unstale":"2024-09-15T23:14:32.594053+0000","last_undegraded":"2024-09-15T23:14:32.594053+0000","last_fullsized":"2024-09-15T23:14:32.594053+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:54.131329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.583113+0000","last_change":"2024-09-15T23:14:32.583113+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.583113+0000","last_undegraded":"2024-09-15T23:14:32.583113+0000","last_fullsized":"2024-09-15T23:14:32.583113+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:31.568796+0000","last_change":"2024-09-15T23:14:31.568796+0000","last_active":"2024-09-15T23:14:31.568796+0000","last_peered":"2024-09-15T23:14:31.568796+0000","last_clean":"2024-09-15T23:14:31.568796+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:31.568796+0000","last_undegraded":"2024-09-15T23:14:31.568796+0000","last_fullsized":"2024-09-15T23:14:31.568796+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.592716+0000","last_change":"2024-09-15T23:14:32.589177+0000","last_active":"2024-09-15T23:14:32.592716+0000","last_peered":"2024-09-15T23:14:32.592716+0000","last_clean":"2024-09-15T23:14:32.592716+0000","last_became_active":"2024-09-15T23:14:32.588881+0000","last_became_peered":"2024-09-15T23:14:32.588881+0000","last_unstale":"2024-09-15T23:14:32.592716+0000","last_undegraded":"2024-09-15T23:14:32.592716+0000","last_fullsized":"2024-09-15T23:14:32.592716+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:50.416367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.583301+0000","last_change":"2024-09-15T23:14:32.583301+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.583301+0000","last_undegraded":"2024-09-15T23:14:32.583301+0000","last_fullsized":"2024-09-15T23:14:32.583301+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:31.568796+0000","last_change":"2024-09-15T23:14:31.568796+0000","last_active":"2024-09-15T23:14:31.568796+0000","last_peered":"2024-09-15T23:14:31.568796+0000","last_clean":"2024-09-15T23:14:31.568796+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:31.568796+0000","last_undegraded":"2024-09-15T23:14:31.568796+0000","last_fullsized":"2024-09-15T23:14:31.568796+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.584102+0000","last_change":"2024-09-15T23:14:32.584102+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.584102+0000","last_undegraded":"2024-09-15T23:14:32.584102+0000","last_fullsized":"2024-09-15T23:14:32.584102+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:31.568796+0000","last_change":"2024-09-15T23:14:31.568796+0000","last_active":"2024-09-15T23:14:31.568796+0000","last_peered":"2024-09-15T23:14:31.568796+0000","last_clean":"2024-09-15T23:14:31.568796+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:31.568796+0000","last_undegraded":"2024-09-15T23:14:31.568796+0000","last_fullsized":"2024-09-15T23:14:31.568796+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.594573+0000","last_change":"2024-09-15T23:14:32.588678+0000","last_active":"2024-09-15T23:14:32.594573+0000","last_peered":"2024-09-15T23:14:32.594573+0000","last_clean":"2024-09-15T23:14:32.594573+0000","last_became_active":"2024-09-15T23:14:32.588365+0000","last_became_peered":"2024-09-15T23:14:32.588365+0000","last_unstale":"2024-09-15T23:14:32.594573+0000","last_undegraded":"2024-09-15T23:14:32.594573+0000","last_fullsized":"2024-09-15T23:14:32.594573+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:50.416367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:31.568796+0000","last_change":"2024-09-15T23:14:31.568796+0000","last_active":"2024-09-15T23:14:31.568796+0000","last_peered":"2024-09-15T23:14:31.568796+0000","last_clean":"2024-09-15T23:14:31.568796+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:31.568796+0000","last_undegraded":"2024-09-15T23:14:31.568796+0000","last_fullsized":"2024-09-15T23:14:31.568796+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.580862+0000","last_change":"2024-09-15T23:14:32.580862+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.580862+0000","last_undegraded":"2024-09-15T23:14:32.580862+0000","last_fullsized":"2024-09-15T23:14:32.580862+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:31.568796+0000","last_change":"2024-09-15T23:14:31.568796+0000","last_active":"2024-09-15T23:14:31.568796+0000","last_peered":"2024-09-15T23:14:31.568796+0000","last_clean":"2024-09-15T23:14:31.568796+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:31.568796+0000","last_undegraded":"2024-09-15T23:14:31.568796+0000","last_fullsized":"2024-09-15T23:14:31.568796+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:31.568796+0000","last_change":"2024-09-15T23:14:31.568796+0000","last_active":"2024-09-15T23:14:31.568796+0000","last_peered":"2024-09-15T23:14:31.568796+0000","last_clean":"2024-09-15T23:14:31.568796+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:31.568796+0000","last_undegraded":"2024-09-15T23:14:31.568796+0000","last_fullsized":"2024-09-15T23:14:31.568796+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.595437+0000","last_change":"2024-09-15T23:14:32.592365+0000","last_active":"2024-09-15T23:14:32.595437+0000","last_peered":"2024-09-15T23:14:32.595437+0000","last_clean":"2024-09-15T23:14:32.595437+0000","last_became_active":"2024-09-15T23:14:32.592065+0000","last_became_peered":"2024-09-15T23:14:32.592065+0000","last_unstale":"2024-09-15T23:14:32.595437+0000","last_undegraded":"2024-09-15T23:14:32.595437+0000","last_fullsized":"2024-09-15T23:14:32.595437+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:01:18.880556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.579913+0000","last_change":"2024-09-15T23:14:32.579913+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.579913+0000","last_undegraded":"2024-09-15T23:14:32.579913+0000","last_fullsized":"2024-09-15T23:14:32.579913+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.596459+0000","last_change":"2024-09-15T23:14:32.593146+0000","last_active":"2024-09-15T23:14:32.596459+0000","last_peered":"2024-09-15T23:14:32.596459+0000","last_clean":"2024-09-15T23:14:32.596459+0000","last_became_active":"2024-09-15T23:14:32.592889+0000","last_became_peered":"2024-09-15T23:14:32.592889+0000","last_unstale":"2024-09-15T23:14:32.596459+0000","last_undegraded":"2024-09-15T23:14:32.596459+0000","last_fullsized":"2024-09-15T23:14:32.596459+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:14.192942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.586158+0000","last_change":"2024-09-15T23:14:32.586158+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.586158+0000","last_undegraded":"2024-09-15T23:14:32.586158+0000","last_fullsized":"2024-09-15T23:14:32.586158+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:31.568796+0000","last_change":"2024-09-15T23:14:31.568796+0000","last_active":"2024-09-15T23:14:31.568796+0000","last_peered":"2024-09-15T23:14:31.568796+0000","last_clean":"2024-09-15T23:14:31.568796+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:31.568796+0000","last_undegraded":"2024-09-15T23:14:31.568796+0000","last_fullsized":"2024-09-15T23:14:31.568796+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:31.568796+0000","last_change":"2024-09-15T23:14:31.568796+0000","last_active":"2024-09-15T23:14:31.568796+0000","last_peered":"2024-09-15T23:14:31.568796+0000","last_clean":"2024-09-15T23:14:31.568796+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:31.568796+0000","last_undegraded":"2024-09-15T23:14:31.568796+0000","last_fullsized":"2024-09-15T23:14:31.568796+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.594609+0000","last_change":"2024-09-15T23:14:32.589067+0000","last_active":"2024-09-15T23:14:32.594609+0000","last_peered":"2024-09-15T23:14:32.594609+0000","last_clean":"2024-09-15T23:14:32.594609+0000","last_became_active":"2024-09-15T23:14:32.588791+0000","last_became_peered":"2024-09-15T23:14:32.588791+0000","last_unstale":"2024-09-15T23:14:32.594609+0000","last_undegraded":"2024-09-15T23:14:32.594609+0000","last_fullsized":"2024-09-15T23:14:32.594609+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:12:56.537897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:31.568796+0000","last_change":"2024-09-15T23:14:31.568796+0000","last_active":"2024-09-15T23:14:31.568796+0000","last_peered":"2024-09-15T23:14:31.568796+0000","last_clean":"2024-09-15T23:14:31.568796+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:31.568796+0000","last_undegraded":"2024-09-15T23:14:31.568796+0000","last_fullsized":"2024-09-15T23:14:31.568796+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.592644+0000","last_change":"2024-09-15T23:14:32.591067+0000","last_active":"2024-09-15T23:14:32.592644+0000","last_peered":"2024-09-15T23:14:32.592644+0000","last_clean":"2024-09-15T23:14:32.592644+0000","last_became_active":"2024-09-15T23:14:32.590787+0000","last_became_peered":"2024-09-15T23:14:32.590787+0000","last_unstale":"2024-09-15T23:14:32.592644+0000","last_undegraded":"2024-09-15T23:14:32.592644+0000","last_fullsized":"2024-09-15T23:14:32.592644+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:35.886415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.581036+0000","last_change":"2024-09-15T23:14:32.581036+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.581036+0000","last_undegraded":"2024-09-15T23:14:32.581036+0000","last_fullsized":"2024-09-15T23:14:32.581036+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:31.568796+0000","last_change":"2024-09-15T23:14:31.568796+0000","last_active":"2024-09-15T23:14:31.568796+0000","last_peered":"2024-09-15T23:14:31.568796+0000","last_clean":"2024-09-15T23:14:31.568796+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:31.568796+0000","last_undegraded":"2024-09-15T23:14:31.568796+0000","last_fullsized":"2024-09-15T23:14:31.568796+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.594639+0000","last_change":"2024-09-15T23:14:32.593219+0000","last_active":"2024-09-15T23:14:32.594639+0000","last_peered":"2024-09-15T23:14:32.594639+0000","last_clean":"2024-09-15T23:14:32.594639+0000","last_became_active":"2024-09-15T23:14:32.592950+0000","last_became_peered":"2024-09-15T23:14:32.592950+0000","last_unstale":"2024-09-15T23:14:32.594639+0000","last_undegraded":"2024-09-15T23:14:32.594639+0000","last_fullsized":"2024-09-15T23:14:32.594639+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:38.090058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.582808+0000","last_change":"2024-09-15T23:14:32.582808+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.582808+0000","last_undegraded":"2024-09-15T23:14:32.582808+0000","last_fullsized":"2024-09-15T23:14:32.582808+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:31.568796+0000","last_change":"2024-09-15T23:14:31.568796+0000","last_active":"2024-09-15T23:14:31.568796+0000","last_peered":"2024-09-15T23:14:31.568796+0000","last_clean":"2024-09-15T23:14:31.568796+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:31.568796+0000","last_undegraded":"2024-09-15T23:14:31.568796+0000","last_fullsized":"2024-09-15T23:14:31.568796+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.600780+0000","last_change":"2024-09-15T23:14:32.598334+0000","last_active":"2024-09-15T23:14:32.600780+0000","last_peered":"2024-09-15T23:14:32.600780+0000","last_clean":"2024-09-15T23:14:32.600780+0000","last_became_active":"2024-09-15T23:14:32.598002+0000","last_became_peered":"2024-09-15T23:14:32.598002+0000","last_unstale":"2024-09-15T23:14:32.600780+0000","last_undegraded":"2024-09-15T23:14:32.600780+0000","last_fullsized":"2024-09-15T23:14:32.600780+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:33.040494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.592996+0000","last_change":"2024-09-15T23:14:32.591944+0000","last_active":"2024-09-15T23:14:32.592996+0000","last_peered":"2024-09-15T23:14:32.592996+0000","last_clean":"2024-09-15T23:14:32.592996+0000","last_became_active":"2024-09-15T23:14:32.591681+0000","last_became_peered":"2024-09-15T23:14:32.591681+0000","last_unstale":"2024-09-15T23:14:32.592996+0000","last_undegraded":"2024-09-15T23:14:32.592996+0000","last_fullsized":"2024-09-15T23:14:32.592996+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:33.623411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.583903+0000","last_change":"2024-09-15T23:14:32.583903+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.583903+0000","last_undegraded":"2024-09-15T23:14:32.583903+0000","last_fullsized":"2024-09-15T23:14:32.583903+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:31.568796+0000","last_change":"2024-09-15T23:14:31.568796+0000","last_active":"2024-09-15T23:14:31.568796+0000","last_peered":"2024-09-15T23:14:31.568796+0000","last_clean":"2024-09-15T23:14:31.568796+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:31.568796+0000","last_undegraded":"2024-09-15T23:14:31.568796+0000","last_fullsized":"2024-09-15T23:14:31.568796+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.579757+0000","last_change":"2024-09-15T23:14:32.579757+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.579757+0000","last_undegraded":"2024-09-15T23:14:32.579757+0000","last_fullsized":"2024-09-15T23:14:32.579757+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:31.568796+0000","last_change":"2024-09-15T23:14:31.568796+0000","last_active":"2024-09-15T23:14:31.568796+0000","last_peered":"2024-09-15T23:14:31.568796+0000","last_clean":"2024-09-15T23:14:31.568796+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:31.568796+0000","last_undegraded":"2024-09-15T23:14:31.568796+0000","last_fullsized":"2024-09-15T23:14:31.568796+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.600807+0000","last_change":"2024-09-15T23:14:32.599246+0000","last_active":"2024-09-15T23:14:32.600807+0000","last_peered":"2024-09-15T23:14:32.600807+0000","last_clean":"2024-09-15T23:14:32.600807+0000","last_became_active":"2024-09-15T23:14:32.598890+0000","last_became_peered":"2024-09-15T23:14:32.598890+0000","last_unstale":"2024-09-15T23:14:32.600807+0000","last_undegraded":"2024-09-15T23:14:32.600807+0000","last_fullsized":"2024-09-15T23:14:32.600807+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:55.095937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":223,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.584109+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:14:32.584109+0000","last_peered":"2024-09-15T23:14:32.584109+0000","last_clean":"2024-09-15T23:14:32.584109+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:14:32.584109+0000","last_undegraded":"2024-09-15T23:14:32.584109+0000","last_fullsized":"2024-09-15T23:14:32.584109+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":30,"acting":30,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476772,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35916,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335924,"statfs":{"total":96636764160,"available":96599986176,"internally_reserved":0,"allocated":577536,"data_stored":238730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35920,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335920,"statfs":{"total":96636764160,"available":96599982080,"internally_reserved":0,"allocated":577536,"data_stored":238730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476771,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36496,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335344,"statfs":{"total":96636764160,"available":96599392256,"internally_reserved":0,"allocated":1171456,"data_stored":829098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476771,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31760,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":577536,"data_stored":238730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542177,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35896,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335944,"statfs":{"total":96636764160,"available":96600006656,"internally_reserved":0,"allocated":552960,"data_stored":226638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542177,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35896,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335944,"statfs":{"total":96636764160,"available":96600006656,"internally_reserved":0,"allocated":552960,"data_stored":226638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542176,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36444,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335396,"statfs":{"total":96636764160,"available":96599445504,"internally_reserved":0,"allocated":1122304,"data_stored":806736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542178,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35880,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335960,"statfs":{"total":96636764160,"available":96600023040,"internally_reserved":0,"allocated":540672,"data_stored":221511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:14:37.178 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:14:37.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.310+0000 7f8eceed0640 1 Processor -- start 2024-09-15T23:14:37.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.310+0000 7f8eceed0640 1 -- start start 2024-09-15T23:14:37.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.310+0000 7f8eceed0640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8ec815ed20 0x7f8ec80b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:37.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.310+0000 7f8eceed0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8ec80d23b0 0x7f8ec80b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:37.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.310+0000 7f8eceed0640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ec80d0e70 con 0x7f8ec80cf2d0 2024-09-15T23:14:37.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.310+0000 7f8eceed0640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f8ec80d41c0 con 0x7f8ec815ed20 2024-09-15T23:14:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.310+0000 7f8eceed0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8ec80d35b0 con 0x7f8ec80d23b0 2024-09-15T23:14:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.311+0000 7f8eccc6c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8ec815ed20 0x7f8ec80b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.311+0000 7f8ecd46d640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8ec80cf2d0 0x7f8ec80cf760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:57446/0 (socket says 172.21.15.123:57446) 2024-09-15T23:14:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.311+0000 7f8ecd46d640 1 -- 172.21.15.123:0/898813085 learned_addr learned my addr 172.21.15.123:0/898813085 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.311+0000 7f8ec7fff640 1 --2- 172.21.15.123:0/898813085 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8ec80d23b0 0x7f8ec80b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.311+0000 7f8eccc6c640 1 -- 172.21.15.123:0/898813085 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8ec80d23b0 msgr2=0x7f8ec80b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.311+0000 7f8eccc6c640 1 --2- 172.21.15.123:0/898813085 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8ec80d23b0 0x7f8ec80b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.311+0000 7f8eccc6c640 1 -- 172.21.15.123:0/898813085 >> v1:172.21.15.123:6789/0 conn(0x7f8ec80cf2d0 legacy=0x7f8ec80cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.311+0000 7f8eccc6c640 1 -- 172.21.15.123:0/898813085 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ec80d3890 con 0x7f8ec815ed20 2024-09-15T23:14:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.311+0000 7f8ec7fff640 1 --2- 172.21.15.123:0/898813085 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8ec80d23b0 0x7f8ec80b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.311+0000 7f8eccc6c640 1 --2- 172.21.15.123:0/898813085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ec815ed20 0x7f8ec80b6260 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc0097a0 tx=0x7f8ebc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb319ebf20cb517 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.312+0000 7f8ec77fe640 1 -- 172.21.15.123:0/898813085 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc037070 con 0x7f8ec815ed20 2024-09-15T23:14:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.312+0000 7f8ec77fe640 1 -- 172.21.15.123:0/898813085 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ebc032440 con 0x7f8ec815ed20 2024-09-15T23:14:37.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.312+0000 7f8ec77fe640 1 -- 172.21.15.123:0/898813085 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc032810 con 0x7f8ec815ed20 2024-09-15T23:14:37.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.312+0000 7f8eceed0640 1 -- 172.21.15.123:0/898813085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ec815ed20 msgr2=0x7f8ec80b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:37.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.312+0000 7f8eceed0640 1 --2- 172.21.15.123:0/898813085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ec815ed20 0x7f8ec80b6260 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc0097a0 tx=0x7f8ebc02a180 comp rx=0 tx=0).stop 2024-09-15T23:14:37.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.312+0000 7f8eceed0640 1 -- 172.21.15.123:0/898813085 shutdown_connections 2024-09-15T23:14:37.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.312+0000 7f8eceed0640 1 --2- 172.21.15.123:0/898813085 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8ec80d23b0 0x7f8ec80b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:37.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.312+0000 7f8eceed0640 1 --2- 172.21.15.123:0/898813085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ec815ed20 0x7f8ec80b6260 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:37.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.312+0000 7f8eceed0640 1 -- 172.21.15.123:0/898813085 >> 172.21.15.123:0/898813085 conn(0x7f8ec80d1260 msgr2=0x7f8ec80d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:37.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.312+0000 7f8eceed0640 1 -- 172.21.15.123:0/898813085 shutdown_connections 2024-09-15T23:14:37.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.312+0000 7f8eceed0640 1 -- 172.21.15.123:0/898813085 wait complete. 2024-09-15T23:14:37.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.313+0000 7f8eceed0640 1 Processor -- start 2024-09-15T23:14:37.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.313+0000 7f8eceed0640 1 -- start start 2024-09-15T23:14:37.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.314+0000 7f8eceed0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ec80cf2d0 0x7f8ec815da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:37.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.314+0000 7f8eceed0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8ec80d23b0 0x7f8ec815d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:37.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.314+0000 7f8eceed0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ec815ed20 0x7f8ec81e94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:37.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.314+0000 7f8eceed0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec80d32a0 con 0x7f8ec815ed20 2024-09-15T23:14:37.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.314+0000 7f8eceed0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec80d3e50 con 0x7f8ec80cf2d0 2024-09-15T23:14:37.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.314+0000 7f8eceed0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8ec815f100 con 0x7f8ec80d23b0 2024-09-15T23:14:37.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.314+0000 7f8ecd46d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ec815ed20 0x7f8ec81e94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:37.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.314+0000 7f8ecd46d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ec815ed20 0x7f8ec81e94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51632/0 (socket says 172.21.15.123:51632) 2024-09-15T23:14:37.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.314+0000 7f8ecd46d640 1 -- 172.21.15.123:0/275916359 learned_addr learned my addr 172.21.15.123:0/275916359 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:37.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.315+0000 7f8eccc6c640 1 --2- 172.21.15.123:0/275916359 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ec80cf2d0 0x7f8ec815da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:37.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.315+0000 7f8ec7fff640 1 --2- 172.21.15.123:0/275916359 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8ec80d23b0 0x7f8ec815d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:37.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.315+0000 7f8ecd46d640 1 -- 172.21.15.123:0/275916359 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8ec80d23b0 msgr2=0x7f8ec815d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:37.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.315+0000 7f8ecd46d640 1 --2- 172.21.15.123:0/275916359 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8ec80d23b0 0x7f8ec815d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:37.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.315+0000 7f8ecd46d640 1 -- 172.21.15.123:0/275916359 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ec80cf2d0 msgr2=0x7f8ec815da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:37.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.315+0000 7f8ecd46d640 1 --2- 172.21.15.123:0/275916359 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ec80cf2d0 0x7f8ec815da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:37.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.315+0000 7f8ecd46d640 1 -- 172.21.15.123:0/275916359 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ec815d800 con 0x7f8ec815ed20 2024-09-15T23:14:37.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.315+0000 7f8eccc6c640 1 --2- 172.21.15.123:0/275916359 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ec80cf2d0 0x7f8ec815da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:37.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.315+0000 7f8ec7fff640 1 --2- 172.21.15.123:0/275916359 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8ec80d23b0 0x7f8ec815d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:37.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.315+0000 7f8ecd46d640 1 --2- 172.21.15.123:0/275916359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ec815ed20 0x7f8ec81e94a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8ec000cbf0 tx=0x7f8ec000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:37.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.315+0000 7f8ec57fa640 1 -- 172.21.15.123:0/275916359 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec0017070 con 0x7f8ec815ed20 2024-09-15T23:14:37.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.315+0000 7f8ec57fa640 1 -- 172.21.15.123:0/275916359 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ec000ad40 con 0x7f8ec815ed20 2024-09-15T23:14:37.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.315+0000 7f8eceed0640 1 -- 172.21.15.123:0/275916359 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ec80cc8a0 con 0x7f8ec815ed20 2024-09-15T23:14:37.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.315+0000 7f8ec57fa640 1 -- 172.21.15.123:0/275916359 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec0012600 con 0x7f8ec815ed20 2024-09-15T23:14:37.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.315+0000 7f8eceed0640 1 -- 172.21.15.123:0/275916359 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ec80cbf70 con 0x7f8ec815ed20 2024-09-15T23:14:37.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.316+0000 7f8eceed0640 1 -- 172.21.15.123:0/275916359 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ec80b7010 con 0x7f8ec815ed20 2024-09-15T23:14:37.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.316+0000 7f8ec57fa640 1 -- 172.21.15.123:0/275916359 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8ec001a070 con 0x7f8ec815ed20 2024-09-15T23:14:37.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.317+0000 7f8ec57fa640 1 --2- 172.21.15.123:0/275916359 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8eac06c2b0 0x7f8eac06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:37.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.317+0000 7f8ec57fa640 1 -- 172.21.15.123:0/275916359 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7f8ec008b060 con 0x7f8ec815ed20 2024-09-15T23:14:37.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.317+0000 7f8eccc6c640 1 --2- 172.21.15.123:0/275916359 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8eac06c2b0 0x7f8eac06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:37.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.318+0000 7f8eccc6c640 1 --2- 172.21.15.123:0/275916359 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8eac06c2b0 0x7f8eac06e770 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc034000 tx=0x7f8ebc02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:37.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.321+0000 7f8ec57fa640 1 -- 172.21.15.123:0/275916359 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8ec80d0e70 con 0x7f8ec815ed20 2024-09-15T23:14:37.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.483+0000 7f8eceed0640 1 -- 172.21.15.123:0/275916359 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8ec80b3f20 con 0x7f8eac06c2b0 2024-09-15T23:14:37.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.490+0000 7f8ec57fa640 1 -- 172.21.15.123:0/275916359 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241807 (secure 0 0 0) 0x7f8ec80b3f20 con 0x7f8eac06c2b0 2024-09-15T23:14:37.494 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:14:37.495 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:14:37.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.492+0000 7f8eceed0640 1 -- 172.21.15.123:0/275916359 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8eac06c2b0 msgr2=0x7f8eac06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:37.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.492+0000 7f8eceed0640 1 --2- 172.21.15.123:0/275916359 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8eac06c2b0 0x7f8eac06e770 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc034000 tx=0x7f8ebc02e000 comp rx=0 tx=0).stop 2024-09-15T23:14:37.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.492+0000 7f8eceed0640 1 -- 172.21.15.123:0/275916359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ec815ed20 msgr2=0x7f8ec81e94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:37.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.492+0000 7f8eceed0640 1 --2- 172.21.15.123:0/275916359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ec815ed20 0x7f8ec81e94a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8ec000cbf0 tx=0x7f8ec000a430 comp rx=0 tx=0).stop 2024-09-15T23:14:37.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.492+0000 7f8eceed0640 1 -- 172.21.15.123:0/275916359 shutdown_connections 2024-09-15T23:14:37.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.492+0000 7f8eceed0640 1 --2- 172.21.15.123:0/275916359 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8eac06c2b0 0x7f8eac06e770 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:37.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.492+0000 7f8eceed0640 1 --2- 172.21.15.123:0/275916359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ec815ed20 0x7f8ec81e94a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:37.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.492+0000 7f8eceed0640 1 --2- 172.21.15.123:0/275916359 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8ec80d23b0 0x7f8ec815d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:37.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.492+0000 7f8eceed0640 1 --2- 172.21.15.123:0/275916359 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8ec80cf2d0 0x7f8ec815da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:37.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.492+0000 7f8eceed0640 1 -- 172.21.15.123:0/275916359 >> 172.21.15.123:0/275916359 conn(0x7f8ec80d1260 msgr2=0x7f8ec8160f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:37.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.492+0000 7f8eceed0640 1 -- 172.21.15.123:0/275916359 shutdown_connections 2024-09-15T23:14:37.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.492+0000 7f8eceed0640 1 -- 172.21.15.123:0/275916359 wait complete. 2024-09-15T23:14:37.505 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2024-09-15T23:14:35.535033+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":96,"acting":96,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":24,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":284208,"kb_used_data":5540,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754690512,"statfs":{"total":773094113280,"available":772803084288,"internally_reserved":0,"allocated":5672960,"data_stored":3026811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":285134384},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000749"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.585749+0000","last_change":"2024-09-15T23:14:32.585749+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.585749+0000","last_undegraded":"2024-09-15T23:14:32.585749+0000","last_fullsized":"2024-09-15T23:14:32.585749+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.579440+0000","last_change":"2024-09-15T23:14:32.579440+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.579440+0000","last_undegraded":"2024-09-15T23:14:32.579440+0000","last_fullsized":"2024-09-15T23:14:32.579440+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.586556+0000","last_change":"2024-09-15T23:14:32.586556+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.586556+0000","last_undegraded":"2024-09-15T23:14:32.586556+0000","last_fullsized":"2024-09-15T23:14:32.586556+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.585450+0000","last_change":"2024-09-15T23:14:32.585450+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.585450+0000","last_undegraded":"2024-09-15T23:14:32.585450+0000","last_fullsized":"2024-09-15T23:14:32.585450+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.582819+0000","last_change":"2024-09-15T23:14:32.582819+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.582819+0000","last_undegraded":"2024-09-15T23:14:32.582819+0000","last_fullsized":"2024-09-15T23:14:32.582819+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.580677+0000","last_change":"2024-09-15T23:14:32.580677+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.580677+0000","last_undegraded":"2024-09-15T23:14:32.580677+0000","last_fullsized":"2024-09-15T23:14:32.580677+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.585391+0000","last_change":"2024-09-15T23:14:32.585391+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.585391+0000","last_undegraded":"2024-09-15T23:14:32.585391+0000","last_fullsized":"2024-09-15T23:14:32.585391+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.578586+0000","last_change":"2024-09-15T23:14:32.578586+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.578586+0000","last_undegraded":"2024-09-15T23:14:32.578586+0000","last_fullsized":"2024-09-15T23:14:32.578586+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.585310+0000","last_change":"2024-09-15T23:14:32.585310+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.585310+0000","last_undegraded":"2024-09-15T23:14:32.585310+0000","last_fullsized":"2024-09-15T23:14:32.585310+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.585247+0000","last_change":"2024-09-15T23:14:32.585247+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.585247+0000","last_undegraded":"2024-09-15T23:14:32.585247+0000","last_fullsized":"2024-09-15T23:14:32.585247+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.581941+0000","last_change":"2024-09-15T23:14:32.581941+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.581941+0000","last_undegraded":"2024-09-15T23:14:32.581941+0000","last_fullsized":"2024-09-15T23:14:32.581941+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.579143+0000","last_change":"2024-09-15T23:14:32.579143+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.579143+0000","last_undegraded":"2024-09-15T23:14:32.579143+0000","last_fullsized":"2024-09-15T23:14:32.579143+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.585255+0000","last_change":"2024-09-15T23:14:32.585255+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.585255+0000","last_undegraded":"2024-09-15T23:14:32.585255+0000","last_fullsized":"2024-09-15T23:14:32.585255+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.583704+0000","last_change":"2024-09-15T23:14:32.583704+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.583704+0000","last_undegraded":"2024-09-15T23:14:32.583704+0000","last_fullsized":"2024-09-15T23:14:32.583704+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.580341+0000","last_change":"2024-09-15T23:14:32.580341+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.580341+0000","last_undegraded":"2024-09-15T23:14:32.580341+0000","last_fullsized":"2024-09-15T23:14:32.580341+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.582924+0000","last_change":"2024-09-15T23:14:32.582924+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.582924+0000","last_undegraded":"2024-09-15T23:14:32.582924+0000","last_fullsized":"2024-09-15T23:14:32.582924+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.578331+0000","last_change":"2024-09-15T23:14:32.578331+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.578331+0000","last_undegraded":"2024-09-15T23:14:32.578331+0000","last_fullsized":"2024-09-15T23:14:32.578331+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:31.568796+0000","last_change":"2024-09-15T23:14:31.568796+0000","last_active":"2024-09-15T23:14:31.568796+0000","last_peered":"2024-09-15T23:14:31.568796+0000","last_clean":"2024-09-15T23:14:31.568796+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:31.568796+0000","last_undegraded":"2024-09-15T23:14:31.568796+0000","last_fullsized":"2024-09-15T23:14:31.568796+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.582950+0000","last_change":"2024-09-15T23:14:32.582950+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.582950+0000","last_undegraded":"2024-09-15T23:14:32.582950+0000","last_fullsized":"2024-09-15T23:14:32.582950+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.598258+0000","last_change":"2024-09-15T23:14:32.594653+0000","last_active":"2024-09-15T23:14:32.598258+0000","last_peered":"2024-09-15T23:14:32.598258+0000","last_clean":"2024-09-15T23:14:32.598258+0000","last_became_active":"2024-09-15T23:14:32.594382+0000","last_became_peered":"2024-09-15T23:14:32.594382+0000","last_unstale":"2024-09-15T23:14:32.598258+0000","last_undegraded":"2024-09-15T23:14:32.598258+0000","last_fullsized":"2024-09-15T23:14:32.598258+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:59.858491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.580300+0000","last_change":"2024-09-15T23:14:32.580300+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.580300+0000","last_undegraded":"2024-09-15T23:14:32.580300+0000","last_fullsized":"2024-09-15T23:14:32.580300+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:31.568796+0000","last_change":"2024-09-15T23:14:31.568796+0000","last_active":"2024-09-15T23:14:31.568796+0000","last_peered":"2024-09-15T23:14:31.568796+0000","last_clean":"2024-09-15T23:14:31.568796+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:31.568796+0000","last_undegraded":"2024-09-15T23:14:31.568796+0000","last_fullsized":"2024-09-15T23:14:31.568796+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.592639+0000","last_change":"2024-09-15T23:14:32.585437+0000","last_active":"2024-09-15T23:14:32.592639+0000","last_peered":"2024-09-15T23:14:32.592639+0000","last_clean":"2024-09-15T23:14:32.592639+0000","last_became_active":"2024-09-15T23:14:32.585165+0000","last_became_peered":"2024-09-15T23:14:32.585165+0000","last_unstale":"2024-09-15T23:14:32.592639+0000","last_undegraded":"2024-09-15T23:14:32.592639+0000","last_fullsized":"2024-09-15T23:14:32.592639+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:28.868122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.581417+0000","last_change":"2024-09-15T23:14:32.581417+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.581417+0000","last_undegraded":"2024-09-15T23:14:32.581417+0000","last_fullsized":"2024-09-15T23:14:32.581417+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:31.568796+0000","last_change":"2024-09-15T23:14:31.568796+0000","last_active":"2024-09-15T23:14:31.568796+0000","last_peered":"2024-09-15T23:14:31.568796+0000","last_clean":"2024-09-15T23:14:31.568796+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:31.568796+0000","last_undegraded":"2024-09-15T23:14:31.568796+0000","last_fullsized":"2024-09-15T23:14:31.568796+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.592668+0000","last_change":"2024-09-15T23:14:32.586162+0000","last_active":"2024-09-15T23:14:32.592668+0000","last_peered":"2024-09-15T23:14:32.592668+0000","last_clean":"2024-09-15T23:14:32.592668+0000","last_became_active":"2024-09-15T23:14:32.585885+0000","last_became_peered":"2024-09-15T23:14:32.585885+0000","last_unstale":"2024-09-15T23:14:32.592668+0000","last_undegraded":"2024-09-15T23:14:32.592668+0000","last_fullsized":"2024-09-15T23:14:32.592668+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:13:57.451903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.600783+0000","last_change":"2024-09-15T23:14:32.598430+0000","last_active":"2024-09-15T23:14:32.600783+0000","last_peered":"2024-09-15T23:14:32.600783+0000","last_clean":"2024-09-15T23:14:32.600783+0000","last_became_active":"2024-09-15T23:14:32.598047+0000","last_became_peered":"2024-09-15T23:14:32.598047+0000","last_unstale":"2024-09-15T23:14:32.600783+0000","last_undegraded":"2024-09-15T23:14:32.600783+0000","last_fullsized":"2024-09-15T23:14:32.600783+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:48:25.091467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.582384+0000","last_change":"2024-09-15T23:14:32.582384+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.582384+0000","last_undegraded":"2024-09-15T23:14:32.582384+0000","last_fullsized":"2024-09-15T23:14:32.582384+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:31.568796+0000","last_change":"2024-09-15T23:14:31.568796+0000","last_active":"2024-09-15T23:14:31.568796+0000","last_peered":"2024-09-15T23:14:31.568796+0000","last_clean":"2024-09-15T23:14:31.568796+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:31.568796+0000","last_undegraded":"2024-09-15T23:14:31.568796+0000","last_fullsized":"2024-09-15T23:14:31.568796+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.584834+0000","last_change":"2024-09-15T23:14:32.584834+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.584834+0000","last_undegraded":"2024-09-15T23:14:32.584834+0000","last_fullsized":"2024-09-15T23:14:32.584834+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.594053+0000","last_change":"2024-09-15T23:14:32.591483+0000","last_active":"2024-09-15T23:14:32.594053+0000","last_peered":"2024-09-15T23:14:32.594053+0000","last_clean":"2024-09-15T23:14:32.594053+0000","last_became_active":"2024-09-15T23:14:32.591161+0000","last_became_peered":"2024-09-15T23:14:32.591161+0000","last_unstale":"2024-09-15T23:14:32.594053+0000","last_undegraded":"2024-09-15T23:14:32.594053+0000","last_fullsized":"2024-09-15T23:14:32.594053+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:54.131329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.583113+0000","last_change":"2024-09-15T23:14:32.583113+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.583113+0000","last_undegraded":"2024-09-15T23:14:32.583113+0000","last_fullsized":"2024-09-15T23:14:32.583113+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:31.568796+0000","last_change":"2024-09-15T23:14:31.568796+0000","last_active":"2024-09-15T23:14:31.568796+0000","last_peered":"2024-09-15T23:14:31.568796+0000","last_clean":"2024-09-15T23:14:31.568796+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:31.568796+0000","last_undegraded":"2024-09-15T23:14:31.568796+0000","last_fullsized":"2024-09-15T23:14:31.568796+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.592716+0000","last_change":"2024-09-15T23:14:32.589177+0000","last_active":"2024-09-15T23:14:32.592716+0000","last_peered":"2024-09-15T23:14:32.592716+0000","last_clean":"2024-09-15T23:14:32.592716+0000","last_became_active":"2024-09-15T23:14:32.588881+0000","last_became_peered":"2024-09-15T23:14:32.588881+0000","last_unstale":"2024-09-15T23:14:32.592716+0000","last_undegraded":"2024-09-15T23:14:32.592716+0000","last_fullsized":"2024-09-15T23:14:32.592716+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:50.416367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.583301+0000","last_change":"2024-09-15T23:14:32.583301+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.583301+0000","last_undegraded":"2024-09-15T23:14:32.583301+0000","last_fullsized":"2024-09-15T23:14:32.583301+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:31.568796+0000","last_change":"2024-09-15T23:14:31.568796+0000","last_active":"2024-09-15T23:14:31.568796+0000","last_peered":"2024-09-15T23:14:31.568796+0000","last_clean":"2024-09-15T23:14:31.568796+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:31.568796+0000","last_undegraded":"2024-09-15T23:14:31.568796+0000","last_fullsized":"2024-09-15T23:14:31.568796+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.584102+0000","last_change":"2024-09-15T23:14:32.584102+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.584102+0000","last_undegraded":"2024-09-15T23:14:32.584102+0000","last_fullsized":"2024-09-15T23:14:32.584102+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:31.568796+0000","last_change":"2024-09-15T23:14:31.568796+0000","last_active":"2024-09-15T23:14:31.568796+0000","last_peered":"2024-09-15T23:14:31.568796+0000","last_clean":"2024-09-15T23:14:31.568796+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:31.568796+0000","last_undegraded":"2024-09-15T23:14:31.568796+0000","last_fullsized":"2024-09-15T23:14:31.568796+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.594573+0000","last_change":"2024-09-15T23:14:32.588678+0000","last_active":"2024-09-15T23:14:32.594573+0000","last_peered":"2024-09-15T23:14:32.594573+0000","last_clean":"2024-09-15T23:14:32.594573+0000","last_became_active":"2024-09-15T23:14:32.588365+0000","last_became_peered":"2024-09-15T23:14:32.588365+0000","last_unstale":"2024-09-15T23:14:32.594573+0000","last_undegraded":"2024-09-15T23:14:32.594573+0000","last_fullsized":"2024-09-15T23:14:32.594573+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:50.416367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:31.568796+0000","last_change":"2024-09-15T23:14:31.568796+0000","last_active":"2024-09-15T23:14:31.568796+0000","last_peered":"2024-09-15T23:14:31.568796+0000","last_clean":"2024-09-15T23:14:31.568796+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:31.568796+0000","last_undegraded":"2024-09-15T23:14:31.568796+0000","last_fullsized":"2024-09-15T23:14:31.568796+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.580862+0000","last_change":"2024-09-15T23:14:32.580862+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.580862+0000","last_undegraded":"2024-09-15T23:14:32.580862+0000","last_fullsized":"2024-09-15T23:14:32.580862+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:31.568796+0000","last_change":"2024-09-15T23:14:31.568796+0000","last_active":"2024-09-15T23:14:31.568796+0000","last_peered":"2024-09-15T23:14:31.568796+0000","last_clean":"2024-09-15T23:14:31.568796+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:31.568796+0000","last_undegraded":"2024-09-15T23:14:31.568796+0000","last_fullsized":"2024-09-15T23:14:31.568796+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:31.568796+0000","last_change":"2024-09-15T23:14:31.568796+0000","last_active":"2024-09-15T23:14:31.568796+0000","last_peered":"2024-09-15T23:14:31.568796+0000","last_clean":"2024-09-15T23:14:31.568796+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:31.568796+0000","last_undegraded":"2024-09-15T23:14:31.568796+0000","last_fullsized":"2024-09-15T23:14:31.568796+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.595437+0000","last_change":"2024-09-15T23:14:32.592365+0000","last_active":"2024-09-15T23:14:32.595437+0000","last_peered":"2024-09-15T23:14:32.595437+0000","last_clean":"2024-09-15T23:14:32.595437+0000","last_became_active":"2024-09-15T23:14:32.592065+0000","last_became_peered":"2024-09-15T23:14:32.592065+0000","last_unstale":"2024-09-15T23:14:32.595437+0000","last_undegraded":"2024-09-15T23:14:32.595437+0000","last_fullsized":"2024-09-15T23:14:32.595437+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:01:18.880556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.579913+0000","last_change":"2024-09-15T23:14:32.579913+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.579913+0000","last_undegraded":"2024-09-15T23:14:32.579913+0000","last_fullsized":"2024-09-15T23:14:32.579913+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.596459+0000","last_change":"2024-09-15T23:14:32.593146+0000","last_active":"2024-09-15T23:14:32.596459+0000","last_peered":"2024-09-15T23:14:32.596459+0000","last_clean":"2024-09-15T23:14:32.596459+0000","last_became_active":"2024-09-15T23:14:32.592889+0000","last_became_peered":"2024-09-15T23:14:32.592889+0000","last_unstale":"2024-09-15T23:14:32.596459+0000","last_undegraded":"2024-09-15T23:14:32.596459+0000","last_fullsized":"2024-09-15T23:14:32.596459+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:14.192942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.586158+0000","last_change":"2024-09-15T23:14:32.586158+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.586158+0000","last_undegraded":"2024-09-15T23:14:32.586158+0000","last_fullsized":"2024-09-15T23:14:32.586158+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:31.568796+0000","last_change":"2024-09-15T23:14:31.568796+0000","last_active":"2024-09-15T23:14:31.568796+0000","last_peered":"2024-09-15T23:14:31.568796+0000","last_clean":"2024-09-15T23:14:31.568796+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:31.568796+0000","last_undegraded":"2024-09-15T23:14:31.568796+0000","last_fullsized":"2024-09-15T23:14:31.568796+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:31.568796+0000","last_change":"2024-09-15T23:14:31.568796+0000","last_active":"2024-09-15T23:14:31.568796+0000","last_peered":"2024-09-15T23:14:31.568796+0000","last_clean":"2024-09-15T23:14:31.568796+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:31.568796+0000","last_undegraded":"2024-09-15T23:14:31.568796+0000","last_fullsized":"2024-09-15T23:14:31.568796+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.594609+0000","last_change":"2024-09-15T23:14:32.589067+0000","last_active":"2024-09-15T23:14:32.594609+0000","last_peered":"2024-09-15T23:14:32.594609+0000","last_clean":"2024-09-15T23:14:32.594609+0000","last_became_active":"2024-09-15T23:14:32.588791+0000","last_became_peered":"2024-09-15T23:14:32.588791+0000","last_unstale":"2024-09-15T23:14:32.594609+0000","last_undegraded":"2024-09-15T23:14:32.594609+0000","last_fullsized":"2024-09-15T23:14:32.594609+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:12:56.537897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:31.568796+0000","last_change":"2024-09-15T23:14:31.568796+0000","last_active":"2024-09-15T23:14:31.568796+0000","last_peered":"2024-09-15T23:14:31.568796+0000","last_clean":"2024-09-15T23:14:31.568796+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:31.568796+0000","last_undegraded":"2024-09-15T23:14:31.568796+0000","last_fullsized":"2024-09-15T23:14:31.568796+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.592644+0000","last_change":"2024-09-15T23:14:32.591067+0000","last_active":"2024-09-15T23:14:32.592644+0000","last_peered":"2024-09-15T23:14:32.592644+0000","last_clean":"2024-09-15T23:14:32.592644+0000","last_became_active":"2024-09-15T23:14:32.590787+0000","last_became_peered":"2024-09-15T23:14:32.590787+0000","last_unstale":"2024-09-15T23:14:32.592644+0000","last_undegraded":"2024-09-15T23:14:32.592644+0000","last_fullsized":"2024-09-15T23:14:32.592644+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:35.886415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.581036+0000","last_change":"2024-09-15T23:14:32.581036+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.581036+0000","last_undegraded":"2024-09-15T23:14:32.581036+0000","last_fullsized":"2024-09-15T23:14:32.581036+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:31.568796+0000","last_change":"2024-09-15T23:14:31.568796+0000","last_active":"2024-09-15T23:14:31.568796+0000","last_peered":"2024-09-15T23:14:31.568796+0000","last_clean":"2024-09-15T23:14:31.568796+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:31.568796+0000","last_undegraded":"2024-09-15T23:14:31.568796+0000","last_fullsized":"2024-09-15T23:14:31.568796+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.594639+0000","last_change":"2024-09-15T23:14:32.593219+0000","last_active":"2024-09-15T23:14:32.594639+0000","last_peered":"2024-09-15T23:14:32.594639+0000","last_clean":"2024-09-15T23:14:32.594639+0000","last_became_active":"2024-09-15T23:14:32.592950+0000","last_became_peered":"2024-09-15T23:14:32.592950+0000","last_unstale":"2024-09-15T23:14:32.594639+0000","last_undegraded":"2024-09-15T23:14:32.594639+0000","last_fullsized":"2024-09-15T23:14:32.594639+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:38.090058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.582808+0000","last_change":"2024-09-15T23:14:32.582808+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.582808+0000","last_undegraded":"2024-09-15T23:14:32.582808+0000","last_fullsized":"2024-09-15T23:14:32.582808+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:31.568796+0000","last_change":"2024-09-15T23:14:31.568796+0000","last_active":"2024-09-15T23:14:31.568796+0000","last_peered":"2024-09-15T23:14:31.568796+0000","last_clean":"2024-09-15T23:14:31.568796+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:31.568796+0000","last_undegraded":"2024-09-15T23:14:31.568796+0000","last_fullsized":"2024-09-15T23:14:31.568796+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.600780+0000","last_change":"2024-09-15T23:14:32.598334+0000","last_active":"2024-09-15T23:14:32.600780+0000","last_peered":"2024-09-15T23:14:32.600780+0000","last_clean":"2024-09-15T23:14:32.600780+0000","last_became_active":"2024-09-15T23:14:32.598002+0000","last_became_peered":"2024-09-15T23:14:32.598002+0000","last_unstale":"2024-09-15T23:14:32.600780+0000","last_undegraded":"2024-09-15T23:14:32.600780+0000","last_fullsized":"2024-09-15T23:14:32.600780+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:33.040494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.592996+0000","last_change":"2024-09-15T23:14:32.591944+0000","last_active":"2024-09-15T23:14:32.592996+0000","last_peered":"2024-09-15T23:14:32.592996+0000","last_clean":"2024-09-15T23:14:32.592996+0000","last_became_active":"2024-09-15T23:14:32.591681+0000","last_became_peered":"2024-09-15T23:14:32.591681+0000","last_unstale":"2024-09-15T23:14:32.592996+0000","last_undegraded":"2024-09-15T23:14:32.592996+0000","last_fullsized":"2024-09-15T23:14:32.592996+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:33.623411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.583903+0000","last_change":"2024-09-15T23:14:32.583903+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.583903+0000","last_undegraded":"2024-09-15T23:14:32.583903+0000","last_fullsized":"2024-09-15T23:14:32.583903+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:31.568796+0000","last_change":"2024-09-15T23:14:31.568796+0000","last_active":"2024-09-15T23:14:31.568796+0000","last_peered":"2024-09-15T23:14:31.568796+0000","last_clean":"2024-09-15T23:14:31.568796+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:31.568796+0000","last_undegraded":"2024-09-15T23:14:31.568796+0000","last_fullsized":"2024-09-15T23:14:31.568796+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.579757+0000","last_change":"2024-09-15T23:14:32.579757+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.579757+0000","last_undegraded":"2024-09-15T23:14:32.579757+0000","last_fullsized":"2024-09-15T23:14:32.579757+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:31.568796+0000","last_change":"2024-09-15T23:14:31.568796+0000","last_active":"2024-09-15T23:14:31.568796+0000","last_peered":"2024-09-15T23:14:31.568796+0000","last_clean":"2024-09-15T23:14:31.568796+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:31.568796+0000","last_undegraded":"2024-09-15T23:14:31.568796+0000","last_fullsized":"2024-09-15T23:14:31.568796+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:14:32.573018+0000","last_change":"2024-09-15T23:14:32.573018+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.573018+0000","last_undegraded":"2024-09-15T23:14:32.573018+0000","last_fullsized":"2024-09-15T23:14:32.573018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.600807+0000","last_change":"2024-09-15T23:14:32.599246+0000","last_active":"2024-09-15T23:14:32.600807+0000","last_peered":"2024-09-15T23:14:32.600807+0000","last_clean":"2024-09-15T23:14:32.600807+0000","last_became_active":"2024-09-15T23:14:32.598890+0000","last_became_peered":"2024-09-15T23:14:32.598890+0000","last_unstale":"2024-09-15T23:14:32.600807+0000","last_undegraded":"2024-09-15T23:14:32.600807+0000","last_fullsized":"2024-09-15T23:14:32.600807+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:55.095937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":223,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.584109+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:14:32.584109+0000","last_peered":"2024-09-15T23:14:32.584109+0000","last_clean":"2024-09-15T23:14:32.584109+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:14:32.584109+0000","last_undegraded":"2024-09-15T23:14:32.584109+0000","last_fullsized":"2024-09-15T23:14:32.584109+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":30,"acting":30,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476772,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35916,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335924,"statfs":{"total":96636764160,"available":96599986176,"internally_reserved":0,"allocated":577536,"data_stored":238730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35920,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335920,"statfs":{"total":96636764160,"available":96599982080,"internally_reserved":0,"allocated":577536,"data_stored":238730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476771,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36496,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335344,"statfs":{"total":96636764160,"available":96599392256,"internally_reserved":0,"allocated":1171456,"data_stored":829098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476771,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31760,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":577536,"data_stored":238730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542177,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35896,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335944,"statfs":{"total":96636764160,"available":96600006656,"internally_reserved":0,"allocated":552960,"data_stored":226638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542177,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35896,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335944,"statfs":{"total":96636764160,"available":96600006656,"internally_reserved":0,"allocated":552960,"data_stored":226638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542176,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36444,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335396,"statfs":{"total":96636764160,"available":96599445504,"internally_reserved":0,"allocated":1122304,"data_stored":806736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542178,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35880,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335960,"statfs":{"total":96636764160,"available":96600023040,"internally_reserved":0,"allocated":540672,"data_stored":221511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:14:37.509 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:14:37.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.642+0000 7f4b6d718640 1 Processor -- start 2024-09-15T23:14:37.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.642+0000 7f4b6d718640 1 -- start start 2024-09-15T23:14:37.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.643+0000 7f4b6d718640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4b6815ed20 0x7f4b680b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:37.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.643+0000 7f4b6d718640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4b680b90e0 0x7f4b680b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:37.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.643+0000 7f4b6d718640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b680d0e70 con 0x7f4b680d23b0 2024-09-15T23:14:37.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.643+0000 7f4b6d718640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f4b680d41c0 con 0x7f4b680b90e0 2024-09-15T23:14:37.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.643+0000 7f4b6d718640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4b680d35b0 con 0x7f4b6815ed20 2024-09-15T23:14:37.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.643+0000 7f4b677fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4b680b90e0 0x7f4b680b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:37.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.643+0000 7f4b677fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4b680b90e0 0x7f4b680b67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51642/0 (socket says 172.21.15.123:51642) 2024-09-15T23:14:37.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.643+0000 7f4b677fe640 1 -- 172.21.15.123:0/1027622973 learned_addr learned my addr 172.21.15.123:0/1027622973 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:37.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.643+0000 7f4b66ffd640 1 --2- 172.21.15.123:0/1027622973 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4b6815ed20 0x7f4b680b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:37.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.643+0000 7f4b677fe640 1 -- 172.21.15.123:0/1027622973 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4b6815ed20 msgr2=0x7f4b680b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:37.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.643+0000 7f4b677fe640 1 --2- 172.21.15.123:0/1027622973 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4b6815ed20 0x7f4b680b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:37.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.643+0000 7f4b677fe640 1 -- 172.21.15.123:0/1027622973 >> v1:172.21.15.188:6789/0 conn(0x7f4b680d23b0 legacy=0x7f4b680cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:37.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.643+0000 7f4b677fe640 1 -- 172.21.15.123:0/1027622973 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b680d3890 con 0x7f4b680b90e0 2024-09-15T23:14:37.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.644+0000 7f4b677fe640 1 --2- 172.21.15.123:0/1027622973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b680b90e0 0x7f4b680b67a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4b60009e50 tx=0x7f4b6002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=358aa7eeee04924e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:37.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.644+0000 7f4b667fc640 1 -- 172.21.15.123:0/1027622973 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b60036070 con 0x7f4b680b90e0 2024-09-15T23:14:37.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.644+0000 7f4b667fc640 1 -- 172.21.15.123:0/1027622973 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b60031600 con 0x7f4b680b90e0 2024-09-15T23:14:37.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.644+0000 7f4b667fc640 1 -- 172.21.15.123:0/1027622973 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b600319d0 con 0x7f4b680b90e0 2024-09-15T23:14:37.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.645+0000 7f4b6d718640 1 -- 172.21.15.123:0/1027622973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b680b90e0 msgr2=0x7f4b680b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:37.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.645+0000 7f4b6d718640 1 --2- 172.21.15.123:0/1027622973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b680b90e0 0x7f4b680b67a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4b60009e50 tx=0x7f4b6002a6c0 comp rx=0 tx=0).stop 2024-09-15T23:14:37.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.645+0000 7f4b6d718640 1 -- 172.21.15.123:0/1027622973 shutdown_connections 2024-09-15T23:14:37.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.645+0000 7f4b6d718640 1 --2- 172.21.15.123:0/1027622973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b680b90e0 0x7f4b680b67a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:37.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.645+0000 7f4b6d718640 1 --2- 172.21.15.123:0/1027622973 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4b6815ed20 0x7f4b680b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:37.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.645+0000 7f4b6d718640 1 -- 172.21.15.123:0/1027622973 >> 172.21.15.123:0/1027622973 conn(0x7f4b680d1260 msgr2=0x7f4b680d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:37.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.645+0000 7f4b6d718640 1 -- 172.21.15.123:0/1027622973 shutdown_connections 2024-09-15T23:14:37.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.645+0000 7f4b6d718640 1 -- 172.21.15.123:0/1027622973 wait complete. 2024-09-15T23:14:37.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.646+0000 7f4b6d718640 1 Processor -- start 2024-09-15T23:14:37.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.646+0000 7f4b6d718640 1 -- start start 2024-09-15T23:14:37.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.647+0000 7f4b6d718640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b680b90e0 0x7f4b68161f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:37.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.647+0000 7f4b6d718640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4b680d23b0 0x7f4b680ab900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:37.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.647+0000 7f4b6d718640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b6815ed20 0x7f4b6814c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:37.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.647+0000 7f4b6d718640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4b680d32a0 con 0x7f4b680b90e0 2024-09-15T23:14:37.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.647+0000 7f4b6d718640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4b680d3e50 con 0x7f4b6815ed20 2024-09-15T23:14:37.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.647+0000 7f4b6d718640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4b6815f100 con 0x7f4b680d23b0 2024-09-15T23:14:37.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.647+0000 7f4b66ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b680b90e0 0x7f4b68161f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:37.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.647+0000 7f4b66ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b680b90e0 0x7f4b68161f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51652/0 (socket says 172.21.15.123:51652) 2024-09-15T23:14:37.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.647+0000 7f4b66ffd640 1 -- 172.21.15.123:0/1544791541 learned_addr learned my addr 172.21.15.123:0/1544791541 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:37.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.647+0000 7f4b5e7fc640 1 --2- 172.21.15.123:0/1544791541 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4b680d23b0 0x7f4b680ab900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:37.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.647+0000 7f4b677fe640 1 --2- 172.21.15.123:0/1544791541 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b6815ed20 0x7f4b6814c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:37.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.647+0000 7f4b66ffd640 1 -- 172.21.15.123:0/1544791541 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4b680d23b0 msgr2=0x7f4b680ab900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:37.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.647+0000 7f4b66ffd640 1 --2- 172.21.15.123:0/1544791541 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4b680d23b0 0x7f4b680ab900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:37.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.647+0000 7f4b66ffd640 1 -- 172.21.15.123:0/1544791541 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b6815ed20 msgr2=0x7f4b6814c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:37.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.647+0000 7f4b66ffd640 1 --2- 172.21.15.123:0/1544791541 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b6815ed20 0x7f4b6814c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:37.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.647+0000 7f4b66ffd640 1 -- 172.21.15.123:0/1544791541 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b6814b270 con 0x7f4b680b90e0 2024-09-15T23:14:37.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.647+0000 7f4b677fe640 1 --2- 172.21.15.123:0/1544791541 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b6815ed20 0x7f4b6814c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:37.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.647+0000 7f4b66ffd640 1 --2- 172.21.15.123:0/1544791541 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b680b90e0 0x7f4b68161f90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800c7f0 tx=0x7f4b5800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:37.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.648+0000 7f4b5ffff640 1 -- 172.21.15.123:0/1544791541 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b58015070 con 0x7f4b680b90e0 2024-09-15T23:14:37.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.648+0000 7f4b5ffff640 1 -- 172.21.15.123:0/1544791541 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b58004220 con 0x7f4b680b90e0 2024-09-15T23:14:37.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.648+0000 7f4b6d718640 1 -- 172.21.15.123:0/1544791541 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b6814b550 con 0x7f4b680b90e0 2024-09-15T23:14:37.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.648+0000 7f4b5ffff640 1 -- 172.21.15.123:0/1544791541 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b58003610 con 0x7f4b680b90e0 2024-09-15T23:14:37.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.648+0000 7f4b6d718640 1 -- 172.21.15.123:0/1544791541 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b6814bb10 con 0x7f4b680b90e0 2024-09-15T23:14:37.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.649+0000 7f4b6d718640 1 -- 172.21.15.123:0/1544791541 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b680b7010 con 0x7f4b680b90e0 2024-09-15T23:14:37.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.649+0000 7f4b5ffff640 1 -- 172.21.15.123:0/1544791541 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4b580039c0 con 0x7f4b680b90e0 2024-09-15T23:14:37.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.649+0000 7f4b5ffff640 1 --2- 172.21.15.123:0/1544791541 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4b4806c2b0 0x7f4b4806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:37.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.650+0000 7f4b5ffff640 1 -- 172.21.15.123:0/1544791541 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7f4b5808b730 con 0x7f4b680b90e0 2024-09-15T23:14:37.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.650+0000 7f4b5e7fc640 1 --2- 172.21.15.123:0/1544791541 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4b4806c2b0 0x7f4b4806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:37.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.650+0000 7f4b5e7fc640 1 --2- 172.21.15.123:0/1544791541 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4b4806c2b0 0x7f4b4806e770 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4b6815cdc0 tx=0x7f4b50007e30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:37.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.654+0000 7f4b5ffff640 1 -- 172.21.15.123:0/1544791541 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4b58059850 con 0x7f4b680b90e0 2024-09-15T23:14:37.738 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:14:37.741 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:14:37.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.819+0000 7f4b6d718640 1 -- 172.21.15.123:0/1544791541 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4b680d0a90 con 0x7f4b4806c2b0 2024-09-15T23:14:37.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.826+0000 7f4b5ffff640 1 -- 172.21.15.123:0/1544791541 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249320 (secure 0 0 0) 0x7f4b680d0a90 con 0x7f4b4806c2b0 2024-09-15T23:14:37.830 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:14:37.831 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:14:37.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.828+0000 7f4b6d718640 1 -- 172.21.15.123:0/1544791541 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4b4806c2b0 msgr2=0x7f4b4806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:37.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.828+0000 7f4b6d718640 1 --2- 172.21.15.123:0/1544791541 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4b4806c2b0 0x7f4b4806e770 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4b6815cdc0 tx=0x7f4b50007e30 comp rx=0 tx=0).stop 2024-09-15T23:14:37.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.828+0000 7f4b6d718640 1 -- 172.21.15.123:0/1544791541 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b680b90e0 msgr2=0x7f4b68161f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:37.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.828+0000 7f4b6d718640 1 --2- 172.21.15.123:0/1544791541 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b680b90e0 0x7f4b68161f90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800c7f0 tx=0x7f4b5800ccb0 comp rx=0 tx=0).stop 2024-09-15T23:14:37.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.828+0000 7f4b6d718640 1 -- 172.21.15.123:0/1544791541 shutdown_connections 2024-09-15T23:14:37.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.828+0000 7f4b6d718640 1 --2- 172.21.15.123:0/1544791541 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b6815ed20 0x7f4b6814c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:37.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.828+0000 7f4b6d718640 1 --2- 172.21.15.123:0/1544791541 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4b680d23b0 0x7f4b680ab900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:37.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.828+0000 7f4b6d718640 1 --2- 172.21.15.123:0/1544791541 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4b4806c2b0 0x7f4b4806e770 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:37.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.828+0000 7f4b6d718640 1 --2- 172.21.15.123:0/1544791541 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b680b90e0 0x7f4b68161f90 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:37.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.828+0000 7f4b6d718640 1 -- 172.21.15.123:0/1544791541 >> 172.21.15.123:0/1544791541 conn(0x7f4b680d1260 msgr2=0x7f4b680b50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:37.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.828+0000 7f4b6d718640 1 -- 172.21.15.123:0/1544791541 shutdown_connections 2024-09-15T23:14:37.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.828+0000 7f4b6d718640 1 -- 172.21.15.123:0/1544791541 wait complete. 2024-09-15T23:14:37.841 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":123,"stamp":"2024-09-15T23:14:37.535470+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592618,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":190,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":284472,"kb_used_data":5804,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754690248,"statfs":{"total":773094113280,"available":772802813952,"internally_reserved":0,"allocated":5943296,"data_stored":3145252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":285134384},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2250,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.961604"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.585749+0000","last_change":"2024-09-15T23:14:32.585749+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.585749+0000","last_undegraded":"2024-09-15T23:14:32.585749+0000","last_fullsized":"2024-09-15T23:14:32.585749+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.579440+0000","last_change":"2024-09-15T23:14:32.579440+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.579440+0000","last_undegraded":"2024-09-15T23:14:32.579440+0000","last_fullsized":"2024-09-15T23:14:32.579440+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.586556+0000","last_change":"2024-09-15T23:14:32.586556+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.586556+0000","last_undegraded":"2024-09-15T23:14:32.586556+0000","last_fullsized":"2024-09-15T23:14:32.586556+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.599094+0000","last_change":"2024-09-15T23:14:33.611677+0000","last_active":"2024-09-15T23:14:34.599094+0000","last_peered":"2024-09-15T23:14:34.599094+0000","last_clean":"2024-09-15T23:14:34.599094+0000","last_became_active":"2024-09-15T23:14:33.611423+0000","last_became_peered":"2024-09-15T23:14:33.611423+0000","last_unstale":"2024-09-15T23:14:34.599094+0000","last_undegraded":"2024-09-15T23:14:34.599094+0000","last_fullsized":"2024-09-15T23:14:34.599094+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:30.257562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.585450+0000","last_change":"2024-09-15T23:14:32.585450+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.585450+0000","last_undegraded":"2024-09-15T23:14:32.585450+0000","last_fullsized":"2024-09-15T23:14:32.585450+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870653+0000","last_change":"2024-09-15T23:14:33.608732+0000","last_active":"2024-09-15T23:14:34.870653+0000","last_peered":"2024-09-15T23:14:34.870653+0000","last_clean":"2024-09-15T23:14:34.870653+0000","last_became_active":"2024-09-15T23:14:33.608470+0000","last_became_peered":"2024-09-15T23:14:33.608470+0000","last_unstale":"2024-09-15T23:14:34.870653+0000","last_undegraded":"2024-09-15T23:14:34.870653+0000","last_fullsized":"2024-09-15T23:14:34.870653+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:26:10.163510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.582819+0000","last_change":"2024-09-15T23:14:32.582819+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.582819+0000","last_undegraded":"2024-09-15T23:14:32.582819+0000","last_fullsized":"2024-09-15T23:14:32.582819+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.598781+0000","last_change":"2024-09-15T23:14:33.609154+0000","last_active":"2024-09-15T23:14:34.598781+0000","last_peered":"2024-09-15T23:14:34.598781+0000","last_clean":"2024-09-15T23:14:34.598781+0000","last_became_active":"2024-09-15T23:14:33.608469+0000","last_became_peered":"2024-09-15T23:14:33.608469+0000","last_unstale":"2024-09-15T23:14:34.598781+0000","last_undegraded":"2024-09-15T23:14:34.598781+0000","last_fullsized":"2024-09-15T23:14:34.598781+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:15:26.232677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870339+0000","last_change":"2024-09-15T23:14:33.611678+0000","last_active":"2024-09-15T23:14:34.870339+0000","last_peered":"2024-09-15T23:14:34.870339+0000","last_clean":"2024-09-15T23:14:34.870339+0000","last_became_active":"2024-09-15T23:14:33.611426+0000","last_became_peered":"2024-09-15T23:14:33.611426+0000","last_unstale":"2024-09-15T23:14:34.870339+0000","last_undegraded":"2024-09-15T23:14:34.870339+0000","last_fullsized":"2024-09-15T23:14:34.870339+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:34.886069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870494+0000","last_change":"2024-09-15T23:14:33.612170+0000","last_active":"2024-09-15T23:14:34.870494+0000","last_peered":"2024-09-15T23:14:34.870494+0000","last_clean":"2024-09-15T23:14:34.870494+0000","last_became_active":"2024-09-15T23:14:33.610919+0000","last_became_peered":"2024-09-15T23:14:33.610919+0000","last_unstale":"2024-09-15T23:14:34.870494+0000","last_undegraded":"2024-09-15T23:14:34.870494+0000","last_fullsized":"2024-09-15T23:14:34.870494+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:56.742964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.599226+0000","last_change":"2024-09-15T23:14:33.614240+0000","last_active":"2024-09-15T23:14:34.599226+0000","last_peered":"2024-09-15T23:14:34.599226+0000","last_clean":"2024-09-15T23:14:34.599226+0000","last_became_active":"2024-09-15T23:14:33.613971+0000","last_became_peered":"2024-09-15T23:14:33.613971+0000","last_unstale":"2024-09-15T23:14:34.599226+0000","last_undegraded":"2024-09-15T23:14:34.599226+0000","last_fullsized":"2024-09-15T23:14:34.599226+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:15:25.781472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.580677+0000","last_change":"2024-09-15T23:14:32.580677+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.580677+0000","last_undegraded":"2024-09-15T23:14:32.580677+0000","last_fullsized":"2024-09-15T23:14:32.580677+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870337+0000","last_change":"2024-09-15T23:14:33.610275+0000","last_active":"2024-09-15T23:14:34.870337+0000","last_peered":"2024-09-15T23:14:34.870337+0000","last_clean":"2024-09-15T23:14:34.870337+0000","last_became_active":"2024-09-15T23:14:33.609998+0000","last_became_peered":"2024-09-15T23:14:33.609998+0000","last_unstale":"2024-09-15T23:14:34.870337+0000","last_undegraded":"2024-09-15T23:14:34.870337+0000","last_fullsized":"2024-09-15T23:14:34.870337+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:55:06.246019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.598897+0000","last_change":"2024-09-15T23:14:33.616589+0000","last_active":"2024-09-15T23:14:34.598897+0000","last_peered":"2024-09-15T23:14:34.598897+0000","last_clean":"2024-09-15T23:14:34.598897+0000","last_became_active":"2024-09-15T23:14:33.616264+0000","last_became_peered":"2024-09-15T23:14:33.616264+0000","last_unstale":"2024-09-15T23:14:34.598897+0000","last_undegraded":"2024-09-15T23:14:34.598897+0000","last_fullsized":"2024-09-15T23:14:34.598897+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:22.799567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.598697+0000","last_change":"2024-09-15T23:14:33.611634+0000","last_active":"2024-09-15T23:14:34.598697+0000","last_peered":"2024-09-15T23:14:34.598697+0000","last_clean":"2024-09-15T23:14:34.598697+0000","last_became_active":"2024-09-15T23:14:33.611361+0000","last_became_peered":"2024-09-15T23:14:33.611361+0000","last_unstale":"2024-09-15T23:14:34.598697+0000","last_undegraded":"2024-09-15T23:14:34.598697+0000","last_fullsized":"2024-09-15T23:14:34.598697+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:25:24.021354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.585391+0000","last_change":"2024-09-15T23:14:32.585391+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.585391+0000","last_undegraded":"2024-09-15T23:14:32.585391+0000","last_fullsized":"2024-09-15T23:14:32.585391+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.578586+0000","last_change":"2024-09-15T23:14:32.578586+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.578586+0000","last_undegraded":"2024-09-15T23:14:32.578586+0000","last_fullsized":"2024-09-15T23:14:32.578586+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.585310+0000","last_change":"2024-09-15T23:14:32.585310+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.585310+0000","last_undegraded":"2024-09-15T23:14:32.585310+0000","last_fullsized":"2024-09-15T23:14:32.585310+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.585247+0000","last_change":"2024-09-15T23:14:32.585247+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.585247+0000","last_undegraded":"2024-09-15T23:14:32.585247+0000","last_fullsized":"2024-09-15T23:14:32.585247+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870715+0000","last_change":"2024-09-15T23:14:33.610179+0000","last_active":"2024-09-15T23:14:34.870715+0000","last_peered":"2024-09-15T23:14:34.870715+0000","last_clean":"2024-09-15T23:14:34.870715+0000","last_became_active":"2024-09-15T23:14:33.609915+0000","last_became_peered":"2024-09-15T23:14:33.609915+0000","last_unstale":"2024-09-15T23:14:34.870715+0000","last_undegraded":"2024-09-15T23:14:34.870715+0000","last_fullsized":"2024-09-15T23:14:34.870715+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:32:53.322424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.599246+0000","last_change":"2024-09-15T23:14:33.608714+0000","last_active":"2024-09-15T23:14:34.599246+0000","last_peered":"2024-09-15T23:14:34.599246+0000","last_clean":"2024-09-15T23:14:34.599246+0000","last_became_active":"2024-09-15T23:14:33.608493+0000","last_became_peered":"2024-09-15T23:14:33.608493+0000","last_unstale":"2024-09-15T23:14:34.599246+0000","last_undegraded":"2024-09-15T23:14:34.599246+0000","last_fullsized":"2024-09-15T23:14:34.599246+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:56:30.247595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870181+0000","last_change":"2024-09-15T23:14:33.593082+0000","last_active":"2024-09-15T23:14:34.870181+0000","last_peered":"2024-09-15T23:14:34.870181+0000","last_clean":"2024-09-15T23:14:34.870181+0000","last_became_active":"2024-09-15T23:14:33.592816+0000","last_became_peered":"2024-09-15T23:14:33.592816+0000","last_unstale":"2024-09-15T23:14:34.870181+0000","last_undegraded":"2024-09-15T23:14:34.870181+0000","last_fullsized":"2024-09-15T23:14:34.870181+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:27:28.548467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.581941+0000","last_change":"2024-09-15T23:14:32.581941+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.581941+0000","last_undegraded":"2024-09-15T23:14:32.581941+0000","last_fullsized":"2024-09-15T23:14:32.581941+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.579143+0000","last_change":"2024-09-15T23:14:32.579143+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.579143+0000","last_undegraded":"2024-09-15T23:14:32.579143+0000","last_fullsized":"2024-09-15T23:14:32.579143+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.585255+0000","last_change":"2024-09-15T23:14:32.585255+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.585255+0000","last_undegraded":"2024-09-15T23:14:32.585255+0000","last_fullsized":"2024-09-15T23:14:32.585255+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.599222+0000","last_change":"2024-09-15T23:14:33.618350+0000","last_active":"2024-09-15T23:14:34.599222+0000","last_peered":"2024-09-15T23:14:34.599222+0000","last_clean":"2024-09-15T23:14:34.599222+0000","last_became_active":"2024-09-15T23:14:33.618088+0000","last_became_peered":"2024-09-15T23:14:33.618088+0000","last_unstale":"2024-09-15T23:14:34.599222+0000","last_undegraded":"2024-09-15T23:14:34.599222+0000","last_fullsized":"2024-09-15T23:14:34.599222+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:05:44.443170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.583704+0000","last_change":"2024-09-15T23:14:32.583704+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.583704+0000","last_undegraded":"2024-09-15T23:14:32.583704+0000","last_fullsized":"2024-09-15T23:14:32.583704+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.580341+0000","last_change":"2024-09-15T23:14:32.580341+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.580341+0000","last_undegraded":"2024-09-15T23:14:32.580341+0000","last_fullsized":"2024-09-15T23:14:32.580341+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.582924+0000","last_change":"2024-09-15T23:14:32.582924+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.582924+0000","last_undegraded":"2024-09-15T23:14:32.582924+0000","last_fullsized":"2024-09-15T23:14:32.582924+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.578331+0000","last_change":"2024-09-15T23:14:32.578331+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.578331+0000","last_undegraded":"2024-09-15T23:14:32.578331+0000","last_fullsized":"2024-09-15T23:14:32.578331+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.869882+0000","last_change":"2024-09-15T23:14:33.596638+0000","last_active":"2024-09-15T23:14:34.869882+0000","last_peered":"2024-09-15T23:14:34.869882+0000","last_clean":"2024-09-15T23:14:34.869882+0000","last_became_active":"2024-09-15T23:14:33.596350+0000","last_became_peered":"2024-09-15T23:14:33.596350+0000","last_unstale":"2024-09-15T23:14:34.869882+0000","last_undegraded":"2024-09-15T23:14:34.869882+0000","last_fullsized":"2024-09-15T23:14:34.869882+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:02.724206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.598773+0000","last_change":"2024-09-15T23:14:33.608852+0000","last_active":"2024-09-15T23:14:34.598773+0000","last_peered":"2024-09-15T23:14:34.598773+0000","last_clean":"2024-09-15T23:14:34.598773+0000","last_became_active":"2024-09-15T23:14:33.608190+0000","last_became_peered":"2024-09-15T23:14:33.608190+0000","last_unstale":"2024-09-15T23:14:34.598773+0000","last_undegraded":"2024-09-15T23:14:34.598773+0000","last_fullsized":"2024-09-15T23:14:34.598773+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:12:06.375013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870523+0000","last_change":"2024-09-15T23:14:33.613017+0000","last_active":"2024-09-15T23:14:34.870523+0000","last_peered":"2024-09-15T23:14:34.870523+0000","last_clean":"2024-09-15T23:14:34.870523+0000","last_became_active":"2024-09-15T23:14:33.612686+0000","last_became_peered":"2024-09-15T23:14:33.612686+0000","last_unstale":"2024-09-15T23:14:34.870523+0000","last_undegraded":"2024-09-15T23:14:34.870523+0000","last_fullsized":"2024-09-15T23:14:34.870523+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:33:01.049973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"51'4","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870313+0000","last_change":"2024-09-15T23:14:32.594944+0000","last_active":"2024-09-15T23:14:34.870313+0000","last_peered":"2024-09-15T23:14:34.870313+0000","last_clean":"2024-09-15T23:14:34.870313+0000","last_became_active":"2024-09-15T23:14:32.594628+0000","last_became_peered":"2024-09-15T23:14:32.594628+0000","last_unstale":"2024-09-15T23:14:34.870313+0000","last_undegraded":"2024-09-15T23:14:34.870313+0000","last_fullsized":"2024-09-15T23:14:34.870313+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:50.778297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.582950+0000","last_change":"2024-09-15T23:14:32.582950+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.582950+0000","last_undegraded":"2024-09-15T23:14:32.582950+0000","last_fullsized":"2024-09-15T23:14:32.582950+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.598258+0000","last_change":"2024-09-15T23:14:32.594653+0000","last_active":"2024-09-15T23:14:32.598258+0000","last_peered":"2024-09-15T23:14:32.598258+0000","last_clean":"2024-09-15T23:14:32.598258+0000","last_became_active":"2024-09-15T23:14:32.594382+0000","last_became_peered":"2024-09-15T23:14:32.594382+0000","last_unstale":"2024-09-15T23:14:32.598258+0000","last_undegraded":"2024-09-15T23:14:32.598258+0000","last_fullsized":"2024-09-15T23:14:32.598258+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:59.858491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.580300+0000","last_change":"2024-09-15T23:14:32.580300+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.580300+0000","last_undegraded":"2024-09-15T23:14:32.580300+0000","last_fullsized":"2024-09-15T23:14:32.580300+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"51'2","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870188+0000","last_change":"2024-09-15T23:14:32.592604+0000","last_active":"2024-09-15T23:14:34.870188+0000","last_peered":"2024-09-15T23:14:34.870188+0000","last_clean":"2024-09-15T23:14:34.870188+0000","last_became_active":"2024-09-15T23:14:32.592310+0000","last_became_peered":"2024-09-15T23:14:32.592310+0000","last_unstale":"2024-09-15T23:14:34.870188+0000","last_undegraded":"2024-09-15T23:14:34.870188+0000","last_fullsized":"2024-09-15T23:14:34.870188+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:38.516357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.599290+0000","last_change":"2024-09-15T23:14:33.606518+0000","last_active":"2024-09-15T23:14:34.599290+0000","last_peered":"2024-09-15T23:14:34.599290+0000","last_clean":"2024-09-15T23:14:34.599290+0000","last_became_active":"2024-09-15T23:14:33.605858+0000","last_became_peered":"2024-09-15T23:14:33.605858+0000","last_unstale":"2024-09-15T23:14:34.599290+0000","last_undegraded":"2024-09-15T23:14:34.599290+0000","last_fullsized":"2024-09-15T23:14:34.599290+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:21:09.993053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.592639+0000","last_change":"2024-09-15T23:14:32.585437+0000","last_active":"2024-09-15T23:14:32.592639+0000","last_peered":"2024-09-15T23:14:32.592639+0000","last_clean":"2024-09-15T23:14:32.592639+0000","last_became_active":"2024-09-15T23:14:32.585165+0000","last_became_peered":"2024-09-15T23:14:32.585165+0000","last_unstale":"2024-09-15T23:14:32.592639+0000","last_undegraded":"2024-09-15T23:14:32.592639+0000","last_fullsized":"2024-09-15T23:14:32.592639+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:28.868122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.581417+0000","last_change":"2024-09-15T23:14:32.581417+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.581417+0000","last_undegraded":"2024-09-15T23:14:32.581417+0000","last_fullsized":"2024-09-15T23:14:32.581417+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"51'1","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870604+0000","last_change":"2024-09-15T23:14:32.590620+0000","last_active":"2024-09-15T23:14:34.870604+0000","last_peered":"2024-09-15T23:14:34.870604+0000","last_clean":"2024-09-15T23:14:34.870604+0000","last_became_active":"2024-09-15T23:14:32.590337+0000","last_became_peered":"2024-09-15T23:14:32.590337+0000","last_unstale":"2024-09-15T23:14:34.870604+0000","last_undegraded":"2024-09-15T23:14:34.870604+0000","last_fullsized":"2024-09-15T23:14:34.870604+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:50.416367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870487+0000","last_change":"2024-09-15T23:14:33.613593+0000","last_active":"2024-09-15T23:14:34.870487+0000","last_peered":"2024-09-15T23:14:34.870487+0000","last_clean":"2024-09-15T23:14:34.870487+0000","last_became_active":"2024-09-15T23:14:33.613330+0000","last_became_peered":"2024-09-15T23:14:33.613330+0000","last_unstale":"2024-09-15T23:14:34.870487+0000","last_undegraded":"2024-09-15T23:14:34.870487+0000","last_fullsized":"2024-09-15T23:14:34.870487+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:16.790009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.592668+0000","last_change":"2024-09-15T23:14:32.586162+0000","last_active":"2024-09-15T23:14:32.592668+0000","last_peered":"2024-09-15T23:14:32.592668+0000","last_clean":"2024-09-15T23:14:32.592668+0000","last_became_active":"2024-09-15T23:14:32.585885+0000","last_became_peered":"2024-09-15T23:14:32.585885+0000","last_unstale":"2024-09-15T23:14:32.592668+0000","last_undegraded":"2024-09-15T23:14:32.592668+0000","last_fullsized":"2024-09-15T23:14:32.592668+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:13:57.451903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.869756+0000","last_change":"2024-09-15T23:14:33.605072+0000","last_active":"2024-09-15T23:14:34.869756+0000","last_peered":"2024-09-15T23:14:34.869756+0000","last_clean":"2024-09-15T23:14:34.869756+0000","last_became_active":"2024-09-15T23:14:33.604220+0000","last_became_peered":"2024-09-15T23:14:33.604220+0000","last_unstale":"2024-09-15T23:14:34.869756+0000","last_undegraded":"2024-09-15T23:14:34.869756+0000","last_fullsized":"2024-09-15T23:14:34.869756+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:28:08.700705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.600783+0000","last_change":"2024-09-15T23:14:32.598430+0000","last_active":"2024-09-15T23:14:32.600783+0000","last_peered":"2024-09-15T23:14:32.600783+0000","last_clean":"2024-09-15T23:14:32.600783+0000","last_became_active":"2024-09-15T23:14:32.598047+0000","last_became_peered":"2024-09-15T23:14:32.598047+0000","last_unstale":"2024-09-15T23:14:32.600783+0000","last_undegraded":"2024-09-15T23:14:32.600783+0000","last_fullsized":"2024-09-15T23:14:32.600783+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:48:25.091467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.582384+0000","last_change":"2024-09-15T23:14:32.582384+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.582384+0000","last_undegraded":"2024-09-15T23:14:32.582384+0000","last_fullsized":"2024-09-15T23:14:32.582384+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870413+0000","last_change":"2024-09-15T23:14:32.599198+0000","last_active":"2024-09-15T23:14:34.870413+0000","last_peered":"2024-09-15T23:14:34.870413+0000","last_clean":"2024-09-15T23:14:34.870413+0000","last_became_active":"2024-09-15T23:14:32.598893+0000","last_became_peered":"2024-09-15T23:14:32.598893+0000","last_unstale":"2024-09-15T23:14:34.870413+0000","last_undegraded":"2024-09-15T23:14:34.870413+0000","last_fullsized":"2024-09-15T23:14:34.870413+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:24.096237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.584834+0000","last_change":"2024-09-15T23:14:32.584834+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.584834+0000","last_undegraded":"2024-09-15T23:14:32.584834+0000","last_fullsized":"2024-09-15T23:14:32.584834+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.594053+0000","last_change":"2024-09-15T23:14:32.591483+0000","last_active":"2024-09-15T23:14:32.594053+0000","last_peered":"2024-09-15T23:14:32.594053+0000","last_clean":"2024-09-15T23:14:32.594053+0000","last_became_active":"2024-09-15T23:14:32.591161+0000","last_became_peered":"2024-09-15T23:14:32.591161+0000","last_unstale":"2024-09-15T23:14:32.594053+0000","last_undegraded":"2024-09-15T23:14:32.594053+0000","last_fullsized":"2024-09-15T23:14:32.594053+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:54.131329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.583113+0000","last_change":"2024-09-15T23:14:32.583113+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.583113+0000","last_undegraded":"2024-09-15T23:14:32.583113+0000","last_fullsized":"2024-09-15T23:14:32.583113+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870542+0000","last_change":"2024-09-15T23:14:32.596138+0000","last_active":"2024-09-15T23:14:34.870542+0000","last_peered":"2024-09-15T23:14:34.870542+0000","last_clean":"2024-09-15T23:14:34.870542+0000","last_became_active":"2024-09-15T23:14:32.595823+0000","last_became_peered":"2024-09-15T23:14:32.595823+0000","last_unstale":"2024-09-15T23:14:34.870542+0000","last_undegraded":"2024-09-15T23:14:34.870542+0000","last_fullsized":"2024-09-15T23:14:34.870542+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:58.984248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.599217+0000","last_change":"2024-09-15T23:14:33.619533+0000","last_active":"2024-09-15T23:14:34.599217+0000","last_peered":"2024-09-15T23:14:34.599217+0000","last_clean":"2024-09-15T23:14:34.599217+0000","last_became_active":"2024-09-15T23:14:33.619229+0000","last_became_peered":"2024-09-15T23:14:33.619229+0000","last_unstale":"2024-09-15T23:14:34.599217+0000","last_undegraded":"2024-09-15T23:14:34.599217+0000","last_fullsized":"2024-09-15T23:14:34.599217+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:04:40.431817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.592716+0000","last_change":"2024-09-15T23:14:32.589177+0000","last_active":"2024-09-15T23:14:32.592716+0000","last_peered":"2024-09-15T23:14:32.592716+0000","last_clean":"2024-09-15T23:14:32.592716+0000","last_became_active":"2024-09-15T23:14:32.588881+0000","last_became_peered":"2024-09-15T23:14:32.588881+0000","last_unstale":"2024-09-15T23:14:32.592716+0000","last_undegraded":"2024-09-15T23:14:32.592716+0000","last_fullsized":"2024-09-15T23:14:32.592716+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:50.416367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.583301+0000","last_change":"2024-09-15T23:14:32.583301+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.583301+0000","last_undegraded":"2024-09-15T23:14:32.583301+0000","last_fullsized":"2024-09-15T23:14:32.583301+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"51'6","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870817+0000","last_change":"2024-09-15T23:14:32.594594+0000","last_active":"2024-09-15T23:14:34.870817+0000","last_peered":"2024-09-15T23:14:34.870817+0000","last_clean":"2024-09-15T23:14:34.870817+0000","last_became_active":"2024-09-15T23:14:32.594344+0000","last_became_peered":"2024-09-15T23:14:32.594344+0000","last_unstale":"2024-09-15T23:14:34.870817+0000","last_undegraded":"2024-09-15T23:14:34.870817+0000","last_fullsized":"2024-09-15T23:14:34.870817+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:05:43.438947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.584102+0000","last_change":"2024-09-15T23:14:32.584102+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.584102+0000","last_undegraded":"2024-09-15T23:14:32.584102+0000","last_fullsized":"2024-09-15T23:14:32.584102+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"51'2","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870315+0000","last_change":"2024-09-15T23:14:32.591239+0000","last_active":"2024-09-15T23:14:34.870315+0000","last_peered":"2024-09-15T23:14:34.870315+0000","last_clean":"2024-09-15T23:14:34.870315+0000","last_became_active":"2024-09-15T23:14:32.590754+0000","last_became_peered":"2024-09-15T23:14:32.590754+0000","last_unstale":"2024-09-15T23:14:34.870315+0000","last_undegraded":"2024-09-15T23:14:34.870315+0000","last_fullsized":"2024-09-15T23:14:34.870315+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:35.275646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870186+0000","last_change":"2024-09-15T23:14:33.598138+0000","last_active":"2024-09-15T23:14:34.870186+0000","last_peered":"2024-09-15T23:14:34.870186+0000","last_clean":"2024-09-15T23:14:34.870186+0000","last_became_active":"2024-09-15T23:14:33.597852+0000","last_became_peered":"2024-09-15T23:14:33.597852+0000","last_unstale":"2024-09-15T23:14:34.870186+0000","last_undegraded":"2024-09-15T23:14:34.870186+0000","last_fullsized":"2024-09-15T23:14:34.870186+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:59.153492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.594573+0000","last_change":"2024-09-15T23:14:32.588678+0000","last_active":"2024-09-15T23:14:32.594573+0000","last_peered":"2024-09-15T23:14:32.594573+0000","last_clean":"2024-09-15T23:14:32.594573+0000","last_became_active":"2024-09-15T23:14:32.588365+0000","last_became_peered":"2024-09-15T23:14:32.588365+0000","last_unstale":"2024-09-15T23:14:32.594573+0000","last_undegraded":"2024-09-15T23:14:32.594573+0000","last_fullsized":"2024-09-15T23:14:32.594573+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:50.416367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.869933+0000","last_change":"2024-09-15T23:14:33.606355+0000","last_active":"2024-09-15T23:14:34.869933+0000","last_peered":"2024-09-15T23:14:34.869933+0000","last_clean":"2024-09-15T23:14:34.869933+0000","last_became_active":"2024-09-15T23:14:33.606057+0000","last_became_peered":"2024-09-15T23:14:33.606057+0000","last_unstale":"2024-09-15T23:14:34.869933+0000","last_undegraded":"2024-09-15T23:14:34.869933+0000","last_fullsized":"2024-09-15T23:14:34.869933+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:40.113827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.869897+0000","last_change":"2024-09-15T23:14:32.593180+0000","last_active":"2024-09-15T23:14:34.869897+0000","last_peered":"2024-09-15T23:14:34.869897+0000","last_clean":"2024-09-15T23:14:34.869897+0000","last_became_active":"2024-09-15T23:14:32.592930+0000","last_became_peered":"2024-09-15T23:14:32.592930+0000","last_unstale":"2024-09-15T23:14:34.869897+0000","last_undegraded":"2024-09-15T23:14:34.869897+0000","last_fullsized":"2024-09-15T23:14:34.869897+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:33.716879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.580862+0000","last_change":"2024-09-15T23:14:32.580862+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.580862+0000","last_undegraded":"2024-09-15T23:14:32.580862+0000","last_fullsized":"2024-09-15T23:14:32.580862+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"51'8","reported_seq":22,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.869885+0000","last_change":"2024-09-15T23:14:32.594226+0000","last_active":"2024-09-15T23:14:34.869885+0000","last_peered":"2024-09-15T23:14:34.869885+0000","last_clean":"2024-09-15T23:14:34.869885+0000","last_became_active":"2024-09-15T23:14:32.593694+0000","last_became_peered":"2024-09-15T23:14:32.593694+0000","last_unstale":"2024-09-15T23:14:34.869885+0000","last_undegraded":"2024-09-15T23:14:34.869885+0000","last_fullsized":"2024-09-15T23:14:34.869885+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:04:39.427595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870664+0000","last_change":"2024-09-15T23:14:33.597118+0000","last_active":"2024-09-15T23:14:34.870664+0000","last_peered":"2024-09-15T23:14:34.870664+0000","last_clean":"2024-09-15T23:14:34.870664+0000","last_became_active":"2024-09-15T23:14:33.596748+0000","last_became_peered":"2024-09-15T23:14:33.596748+0000","last_unstale":"2024-09-15T23:14:34.870664+0000","last_undegraded":"2024-09-15T23:14:34.870664+0000","last_fullsized":"2024-09-15T23:14:34.870664+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:33:01.396335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"51'1","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.599258+0000","last_change":"2024-09-15T23:14:32.598464+0000","last_active":"2024-09-15T23:14:34.599258+0000","last_peered":"2024-09-15T23:14:34.599258+0000","last_clean":"2024-09-15T23:14:34.599258+0000","last_became_active":"2024-09-15T23:14:32.598145+0000","last_became_peered":"2024-09-15T23:14:32.598145+0000","last_unstale":"2024-09-15T23:14:34.599258+0000","last_undegraded":"2024-09-15T23:14:34.599258+0000","last_fullsized":"2024-09-15T23:14:34.599258+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:04.474623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870621+0000","last_change":"2024-09-15T23:14:33.608122+0000","last_active":"2024-09-15T23:14:34.870621+0000","last_peered":"2024-09-15T23:14:34.870621+0000","last_clean":"2024-09-15T23:14:34.870621+0000","last_became_active":"2024-09-15T23:14:33.607852+0000","last_became_peered":"2024-09-15T23:14:33.607852+0000","last_unstale":"2024-09-15T23:14:34.870621+0000","last_undegraded":"2024-09-15T23:14:34.870621+0000","last_fullsized":"2024-09-15T23:14:34.870621+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:14:33.024587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.595437+0000","last_change":"2024-09-15T23:14:32.592365+0000","last_active":"2024-09-15T23:14:32.595437+0000","last_peered":"2024-09-15T23:14:32.595437+0000","last_clean":"2024-09-15T23:14:32.595437+0000","last_became_active":"2024-09-15T23:14:32.592065+0000","last_became_peered":"2024-09-15T23:14:32.592065+0000","last_unstale":"2024-09-15T23:14:32.595437+0000","last_undegraded":"2024-09-15T23:14:32.595437+0000","last_fullsized":"2024-09-15T23:14:32.595437+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:01:18.880556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.579913+0000","last_change":"2024-09-15T23:14:32.579913+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.579913+0000","last_undegraded":"2024-09-15T23:14:32.579913+0000","last_fullsized":"2024-09-15T23:14:32.579913+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.596459+0000","last_change":"2024-09-15T23:14:32.593146+0000","last_active":"2024-09-15T23:14:32.596459+0000","last_peered":"2024-09-15T23:14:32.596459+0000","last_clean":"2024-09-15T23:14:32.596459+0000","last_became_active":"2024-09-15T23:14:32.592889+0000","last_became_peered":"2024-09-15T23:14:32.592889+0000","last_unstale":"2024-09-15T23:14:32.596459+0000","last_undegraded":"2024-09-15T23:14:32.596459+0000","last_fullsized":"2024-09-15T23:14:32.596459+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:14.192942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.586158+0000","last_change":"2024-09-15T23:14:32.586158+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.586158+0000","last_undegraded":"2024-09-15T23:14:32.586158+0000","last_fullsized":"2024-09-15T23:14:32.586158+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870961+0000","last_change":"2024-09-15T23:14:32.593808+0000","last_active":"2024-09-15T23:14:34.870961+0000","last_peered":"2024-09-15T23:14:34.870961+0000","last_clean":"2024-09-15T23:14:34.870961+0000","last_became_active":"2024-09-15T23:14:32.593493+0000","last_became_peered":"2024-09-15T23:14:32.593493+0000","last_unstale":"2024-09-15T23:14:34.870961+0000","last_undegraded":"2024-09-15T23:14:34.870961+0000","last_fullsized":"2024-09-15T23:14:34.870961+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:01:33.975383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.869950+0000","last_change":"2024-09-15T23:14:33.604826+0000","last_active":"2024-09-15T23:14:34.869950+0000","last_peered":"2024-09-15T23:14:34.869950+0000","last_clean":"2024-09-15T23:14:34.869950+0000","last_became_active":"2024-09-15T23:14:33.604515+0000","last_became_peered":"2024-09-15T23:14:33.604515+0000","last_unstale":"2024-09-15T23:14:34.869950+0000","last_undegraded":"2024-09-15T23:14:34.869950+0000","last_fullsized":"2024-09-15T23:14:34.869950+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:24.873653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"51'2","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870601+0000","last_change":"2024-09-15T23:14:32.596303+0000","last_active":"2024-09-15T23:14:34.870601+0000","last_peered":"2024-09-15T23:14:34.870601+0000","last_clean":"2024-09-15T23:14:34.870601+0000","last_became_active":"2024-09-15T23:14:32.595965+0000","last_became_peered":"2024-09-15T23:14:32.595965+0000","last_unstale":"2024-09-15T23:14:34.870601+0000","last_undegraded":"2024-09-15T23:14:34.870601+0000","last_fullsized":"2024-09-15T23:14:34.870601+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:29.253340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870498+0000","last_change":"2024-09-15T23:14:33.598114+0000","last_active":"2024-09-15T23:14:34.870498+0000","last_peered":"2024-09-15T23:14:34.870498+0000","last_clean":"2024-09-15T23:14:34.870498+0000","last_became_active":"2024-09-15T23:14:33.597762+0000","last_became_peered":"2024-09-15T23:14:33.597762+0000","last_unstale":"2024-09-15T23:14:34.870498+0000","last_undegraded":"2024-09-15T23:14:34.870498+0000","last_fullsized":"2024-09-15T23:14:34.870498+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:34:03.998649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.594609+0000","last_change":"2024-09-15T23:14:32.589067+0000","last_active":"2024-09-15T23:14:32.594609+0000","last_peered":"2024-09-15T23:14:32.594609+0000","last_clean":"2024-09-15T23:14:32.594609+0000","last_became_active":"2024-09-15T23:14:32.588791+0000","last_became_peered":"2024-09-15T23:14:32.588791+0000","last_unstale":"2024-09-15T23:14:32.594609+0000","last_undegraded":"2024-09-15T23:14:32.594609+0000","last_fullsized":"2024-09-15T23:14:32.594609+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:12:56.537897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.599058+0000","last_change":"2024-09-15T23:14:33.613028+0000","last_active":"2024-09-15T23:14:34.599058+0000","last_peered":"2024-09-15T23:14:34.599058+0000","last_clean":"2024-09-15T23:14:34.599058+0000","last_became_active":"2024-09-15T23:14:33.611983+0000","last_became_peered":"2024-09-15T23:14:33.611983+0000","last_unstale":"2024-09-15T23:14:34.599058+0000","last_undegraded":"2024-09-15T23:14:34.599058+0000","last_fullsized":"2024-09-15T23:14:34.599058+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:59.988471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.869825+0000","last_change":"2024-09-15T23:14:32.595982+0000","last_active":"2024-09-15T23:14:34.869825+0000","last_peered":"2024-09-15T23:14:34.869825+0000","last_clean":"2024-09-15T23:14:34.869825+0000","last_became_active":"2024-09-15T23:14:32.595688+0000","last_became_peered":"2024-09-15T23:14:32.595688+0000","last_unstale":"2024-09-15T23:14:34.869825+0000","last_undegraded":"2024-09-15T23:14:34.869825+0000","last_fullsized":"2024-09-15T23:14:34.869825+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:32.950554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.598777+0000","last_change":"2024-09-15T23:14:33.616040+0000","last_active":"2024-09-15T23:14:34.598777+0000","last_peered":"2024-09-15T23:14:34.598777+0000","last_clean":"2024-09-15T23:14:34.598777+0000","last_became_active":"2024-09-15T23:14:33.615753+0000","last_became_peered":"2024-09-15T23:14:33.615753+0000","last_unstale":"2024-09-15T23:14:34.598777+0000","last_undegraded":"2024-09-15T23:14:34.598777+0000","last_fullsized":"2024-09-15T23:14:34.598777+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:54.178061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.592644+0000","last_change":"2024-09-15T23:14:32.591067+0000","last_active":"2024-09-15T23:14:32.592644+0000","last_peered":"2024-09-15T23:14:32.592644+0000","last_clean":"2024-09-15T23:14:32.592644+0000","last_became_active":"2024-09-15T23:14:32.590787+0000","last_became_peered":"2024-09-15T23:14:32.590787+0000","last_unstale":"2024-09-15T23:14:32.592644+0000","last_undegraded":"2024-09-15T23:14:32.592644+0000","last_fullsized":"2024-09-15T23:14:32.592644+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:35.886415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.581036+0000","last_change":"2024-09-15T23:14:32.581036+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.581036+0000","last_undegraded":"2024-09-15T23:14:32.581036+0000","last_fullsized":"2024-09-15T23:14:32.581036+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"52'1","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.600656+0000","last_change":"2024-09-15T23:14:32.598482+0000","last_active":"2024-09-15T23:14:34.600656+0000","last_peered":"2024-09-15T23:14:34.600656+0000","last_clean":"2024-09-15T23:14:34.600656+0000","last_became_active":"2024-09-15T23:14:32.598103+0000","last_became_peered":"2024-09-15T23:14:32.598103+0000","last_unstale":"2024-09-15T23:14:34.600656+0000","last_undegraded":"2024-09-15T23:14:34.600656+0000","last_fullsized":"2024-09-15T23:14:34.600656+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:53.611115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870796+0000","last_change":"2024-09-15T23:14:33.611352+0000","last_active":"2024-09-15T23:14:34.870796+0000","last_peered":"2024-09-15T23:14:34.870796+0000","last_clean":"2024-09-15T23:14:34.870796+0000","last_became_active":"2024-09-15T23:14:33.604202+0000","last_became_peered":"2024-09-15T23:14:33.604202+0000","last_unstale":"2024-09-15T23:14:34.870796+0000","last_undegraded":"2024-09-15T23:14:34.870796+0000","last_fullsized":"2024-09-15T23:14:34.870796+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:51:52.572026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.594639+0000","last_change":"2024-09-15T23:14:32.593219+0000","last_active":"2024-09-15T23:14:32.594639+0000","last_peered":"2024-09-15T23:14:32.594639+0000","last_clean":"2024-09-15T23:14:32.594639+0000","last_became_active":"2024-09-15T23:14:32.592950+0000","last_became_peered":"2024-09-15T23:14:32.592950+0000","last_unstale":"2024-09-15T23:14:32.594639+0000","last_undegraded":"2024-09-15T23:14:32.594639+0000","last_fullsized":"2024-09-15T23:14:32.594639+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:38.090058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.582808+0000","last_change":"2024-09-15T23:14:32.582808+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.582808+0000","last_undegraded":"2024-09-15T23:14:32.582808+0000","last_fullsized":"2024-09-15T23:14:32.582808+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870370+0000","last_change":"2024-09-15T23:14:32.591220+0000","last_active":"2024-09-15T23:14:34.870370+0000","last_peered":"2024-09-15T23:14:34.870370+0000","last_clean":"2024-09-15T23:14:34.870370+0000","last_became_active":"2024-09-15T23:14:32.590921+0000","last_became_peered":"2024-09-15T23:14:32.590921+0000","last_unstale":"2024-09-15T23:14:34.870370+0000","last_undegraded":"2024-09-15T23:14:34.870370+0000","last_fullsized":"2024-09-15T23:14:34.870370+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:15:08.197312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870491+0000","last_change":"2024-09-15T23:14:33.604651+0000","last_active":"2024-09-15T23:14:34.870491+0000","last_peered":"2024-09-15T23:14:34.870491+0000","last_clean":"2024-09-15T23:14:34.870491+0000","last_became_active":"2024-09-15T23:14:33.604293+0000","last_became_peered":"2024-09-15T23:14:33.604293+0000","last_unstale":"2024-09-15T23:14:34.870491+0000","last_undegraded":"2024-09-15T23:14:34.870491+0000","last_fullsized":"2024-09-15T23:14:34.870491+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:35:55.174184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.600780+0000","last_change":"2024-09-15T23:14:32.598334+0000","last_active":"2024-09-15T23:14:32.600780+0000","last_peered":"2024-09-15T23:14:32.600780+0000","last_clean":"2024-09-15T23:14:32.600780+0000","last_became_active":"2024-09-15T23:14:32.598002+0000","last_became_peered":"2024-09-15T23:14:32.598002+0000","last_unstale":"2024-09-15T23:14:32.600780+0000","last_undegraded":"2024-09-15T23:14:32.600780+0000","last_fullsized":"2024-09-15T23:14:32.600780+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:33.040494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.598948+0000","last_change":"2024-09-15T23:14:33.613973+0000","last_active":"2024-09-15T23:14:34.598948+0000","last_peered":"2024-09-15T23:14:34.598948+0000","last_clean":"2024-09-15T23:14:34.598948+0000","last_became_active":"2024-09-15T23:14:33.613716+0000","last_became_peered":"2024-09-15T23:14:33.613716+0000","last_unstale":"2024-09-15T23:14:34.598948+0000","last_undegraded":"2024-09-15T23:14:34.598948+0000","last_fullsized":"2024-09-15T23:14:34.598948+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:33.954777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.592996+0000","last_change":"2024-09-15T23:14:32.591944+0000","last_active":"2024-09-15T23:14:32.592996+0000","last_peered":"2024-09-15T23:14:32.592996+0000","last_clean":"2024-09-15T23:14:32.592996+0000","last_became_active":"2024-09-15T23:14:32.591681+0000","last_became_peered":"2024-09-15T23:14:32.591681+0000","last_unstale":"2024-09-15T23:14:32.592996+0000","last_undegraded":"2024-09-15T23:14:32.592996+0000","last_fullsized":"2024-09-15T23:14:32.592996+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:33.623411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.583903+0000","last_change":"2024-09-15T23:14:32.583903+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.583903+0000","last_undegraded":"2024-09-15T23:14:32.583903+0000","last_fullsized":"2024-09-15T23:14:32.583903+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870001+0000","last_change":"2024-09-15T23:14:32.594660+0000","last_active":"2024-09-15T23:14:34.870001+0000","last_peered":"2024-09-15T23:14:34.870001+0000","last_clean":"2024-09-15T23:14:34.870001+0000","last_became_active":"2024-09-15T23:14:32.594416+0000","last_became_peered":"2024-09-15T23:14:32.594416+0000","last_unstale":"2024-09-15T23:14:34.870001+0000","last_undegraded":"2024-09-15T23:14:34.870001+0000","last_fullsized":"2024-09-15T23:14:34.870001+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:36.324104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.579757+0000","last_change":"2024-09-15T23:14:32.579757+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.579757+0000","last_undegraded":"2024-09-15T23:14:32.579757+0000","last_fullsized":"2024-09-15T23:14:32.579757+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870730+0000","last_change":"2024-09-15T23:14:32.592678+0000","last_active":"2024-09-15T23:14:34.870730+0000","last_peered":"2024-09-15T23:14:34.870730+0000","last_clean":"2024-09-15T23:14:34.870730+0000","last_became_active":"2024-09-15T23:14:32.592382+0000","last_became_peered":"2024-09-15T23:14:32.592382+0000","last_unstale":"2024-09-15T23:14:34.870730+0000","last_undegraded":"2024-09-15T23:14:34.870730+0000","last_fullsized":"2024-09-15T23:14:34.870730+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:59.169628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.599145+0000","last_change":"2024-09-15T23:14:33.611152+0000","last_active":"2024-09-15T23:14:34.599145+0000","last_peered":"2024-09-15T23:14:34.599145+0000","last_clean":"2024-09-15T23:14:34.599145+0000","last_became_active":"2024-09-15T23:14:33.610807+0000","last_became_peered":"2024-09-15T23:14:33.610807+0000","last_unstale":"2024-09-15T23:14:34.599145+0000","last_undegraded":"2024-09-15T23:14:34.599145+0000","last_fullsized":"2024-09-15T23:14:34.599145+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:25.100460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.600807+0000","last_change":"2024-09-15T23:14:32.599246+0000","last_active":"2024-09-15T23:14:32.600807+0000","last_peered":"2024-09-15T23:14:32.600807+0000","last_clean":"2024-09-15T23:14:32.600807+0000","last_became_active":"2024-09-15T23:14:32.598890+0000","last_became_peered":"2024-09-15T23:14:32.598890+0000","last_unstale":"2024-09-15T23:14:32.600807+0000","last_undegraded":"2024-09-15T23:14:32.600807+0000","last_fullsized":"2024-09-15T23:14:32.600807+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:55.095937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":223,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.584109+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:14:32.584109+0000","last_peered":"2024-09-15T23:14:32.584109+0000","last_clean":"2024-09-15T23:14:32.584109+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:14:32.584109+0000","last_undegraded":"2024-09-15T23:14:32.584109+0000","last_fullsized":"2024-09-15T23:14:32.584109+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2250,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27,"ondisk_log_size":27,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476772,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35916,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335924,"statfs":{"total":96636764160,"available":96599986176,"internally_reserved":0,"allocated":577536,"data_stored":238730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35920,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335920,"statfs":{"total":96636764160,"available":96599982080,"internally_reserved":0,"allocated":577536,"data_stored":238730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476771,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36496,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335344,"statfs":{"total":96636764160,"available":96599392256,"internally_reserved":0,"allocated":1171456,"data_stored":829098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476771,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31760,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":577536,"data_stored":238730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542178,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35948,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335892,"statfs":{"total":96636764160,"available":96599953408,"internally_reserved":0,"allocated":606208,"data_stored":251839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542178,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35952,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335888,"statfs":{"total":96636764160,"available":96599949312,"internally_reserved":0,"allocated":610304,"data_stored":252421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542177,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36520,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335320,"statfs":{"total":96636764160,"available":96599367680,"internally_reserved":0,"allocated":1200128,"data_stored":842195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542179,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35960,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335880,"statfs":{"total":96636764160,"available":96599941120,"internally_reserved":0,"allocated":622592,"data_stored":253509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:14:37.845 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3f is not active+clean 2024-09-15T23:14:37.845 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:14:32.585749+0000', 'last_change': '2024-09-15T23:14:32.585749+0000', 'last_active': '2024-09-15T23:14:32.573018+0000', 'last_peered': '2024-09-15T23:14:32.573018+0000', 'last_clean': '2024-09-15T23:14:32.573018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:14:32.585749+0000', 'last_undegraded': '2024-09-15T23:14:32.585749+0000', 'last_fullsized': '2024-09-15T23:14:32.585749+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_clean_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:14:37.845 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3e is not active+clean 2024-09-15T23:14:37.845 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:14:32.579440+0000', 'last_change': '2024-09-15T23:14:32.579440+0000', 'last_active': '2024-09-15T23:14:32.573018+0000', 'last_peered': '2024-09-15T23:14:32.573018+0000', 'last_clean': '2024-09-15T23:14:32.573018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:14:32.579440+0000', 'last_undegraded': '2024-09-15T23:14:32.579440+0000', 'last_fullsized': '2024-09-15T23:14:32.579440+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_clean_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:14:37.846 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3d is not active+clean 2024-09-15T23:14:37.846 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:14:32.586556+0000', 'last_change': '2024-09-15T23:14:32.586556+0000', 'last_active': '2024-09-15T23:14:32.573018+0000', 'last_peered': '2024-09-15T23:14:32.573018+0000', 'last_clean': '2024-09-15T23:14:32.573018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:14:32.586556+0000', 'last_undegraded': '2024-09-15T23:14:32.586556+0000', 'last_fullsized': '2024-09-15T23:14:32.586556+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_clean_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:14:37.846 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3b is not active+clean 2024-09-15T23:14:37.846 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:14:32.585450+0000', 'last_change': '2024-09-15T23:14:32.585450+0000', 'last_active': '2024-09-15T23:14:32.573018+0000', 'last_peered': '2024-09-15T23:14:32.573018+0000', 'last_clean': '2024-09-15T23:14:32.573018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:14:32.585450+0000', 'last_undegraded': '2024-09-15T23:14:32.585450+0000', 'last_fullsized': '2024-09-15T23:14:32.585450+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_clean_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:14:37.846 INFO:tasks.ceph.ceph_manager.ceph:PG 7.39 is not active+clean 2024-09-15T23:14:37.846 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:14:32.582819+0000', 'last_change': '2024-09-15T23:14:32.582819+0000', 'last_active': '2024-09-15T23:14:32.573018+0000', 'last_peered': '2024-09-15T23:14:32.573018+0000', 'last_clean': '2024-09-15T23:14:32.573018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:14:32.582819+0000', 'last_undegraded': '2024-09-15T23:14:32.582819+0000', 'last_fullsized': '2024-09-15T23:14:32.582819+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_clean_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:14:37.846 INFO:tasks.ceph.ceph_manager.ceph:PG 7.34 is not active+clean 2024-09-15T23:14:37.846 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:14:32.580677+0000', 'last_change': '2024-09-15T23:14:32.580677+0000', 'last_active': '2024-09-15T23:14:32.573018+0000', 'last_peered': '2024-09-15T23:14:32.573018+0000', 'last_clean': '2024-09-15T23:14:32.573018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:14:32.580677+0000', 'last_undegraded': '2024-09-15T23:14:32.580677+0000', 'last_fullsized': '2024-09-15T23:14:32.580677+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_clean_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:14:37.847 INFO:tasks.ceph.ceph_manager.ceph:PG 7.30 is not active+clean 2024-09-15T23:14:37.847 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:14:32.585391+0000', 'last_change': '2024-09-15T23:14:32.585391+0000', 'last_active': '2024-09-15T23:14:32.573018+0000', 'last_peered': '2024-09-15T23:14:32.573018+0000', 'last_clean': '2024-09-15T23:14:32.573018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:14:32.585391+0000', 'last_undegraded': '2024-09-15T23:14:32.585391+0000', 'last_fullsized': '2024-09-15T23:14:32.585391+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_clean_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:14:37.847 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2f is not active+clean 2024-09-15T23:14:37.847 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:14:32.578586+0000', 'last_change': '2024-09-15T23:14:32.578586+0000', 'last_active': '2024-09-15T23:14:32.573018+0000', 'last_peered': '2024-09-15T23:14:32.573018+0000', 'last_clean': '2024-09-15T23:14:32.573018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:14:32.578586+0000', 'last_undegraded': '2024-09-15T23:14:32.578586+0000', 'last_fullsized': '2024-09-15T23:14:32.578586+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_clean_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:14:37.847 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2e is not active+clean 2024-09-15T23:14:37.847 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:14:32.585310+0000', 'last_change': '2024-09-15T23:14:32.585310+0000', 'last_active': '2024-09-15T23:14:32.573018+0000', 'last_peered': '2024-09-15T23:14:32.573018+0000', 'last_clean': '2024-09-15T23:14:32.573018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:14:32.585310+0000', 'last_undegraded': '2024-09-15T23:14:32.585310+0000', 'last_fullsized': '2024-09-15T23:14:32.585310+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_clean_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:14:37.847 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2d is not active+clean 2024-09-15T23:14:37.847 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:14:32.585247+0000', 'last_change': '2024-09-15T23:14:32.585247+0000', 'last_active': '2024-09-15T23:14:32.573018+0000', 'last_peered': '2024-09-15T23:14:32.573018+0000', 'last_clean': '2024-09-15T23:14:32.573018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:14:32.585247+0000', 'last_undegraded': '2024-09-15T23:14:32.585247+0000', 'last_fullsized': '2024-09-15T23:14:32.585247+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_clean_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:14:37.847 INFO:tasks.ceph.ceph_manager.ceph:PG 7.29 is not active+clean 2024-09-15T23:14:37.847 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:14:32.581941+0000', 'last_change': '2024-09-15T23:14:32.581941+0000', 'last_active': '2024-09-15T23:14:32.573018+0000', 'last_peered': '2024-09-15T23:14:32.573018+0000', 'last_clean': '2024-09-15T23:14:32.573018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:14:32.581941+0000', 'last_undegraded': '2024-09-15T23:14:32.581941+0000', 'last_fullsized': '2024-09-15T23:14:32.581941+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_clean_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:14:37.848 INFO:tasks.ceph.ceph_manager.ceph:PG 7.28 is not active+clean 2024-09-15T23:14:37.848 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:14:32.579143+0000', 'last_change': '2024-09-15T23:14:32.579143+0000', 'last_active': '2024-09-15T23:14:32.573018+0000', 'last_peered': '2024-09-15T23:14:32.573018+0000', 'last_clean': '2024-09-15T23:14:32.573018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:14:32.579143+0000', 'last_undegraded': '2024-09-15T23:14:32.579143+0000', 'last_fullsized': '2024-09-15T23:14:32.579143+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_clean_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:14:37.848 INFO:tasks.ceph.ceph_manager.ceph:PG 7.27 is not active+clean 2024-09-15T23:14:37.848 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:14:32.585255+0000', 'last_change': '2024-09-15T23:14:32.585255+0000', 'last_active': '2024-09-15T23:14:32.573018+0000', 'last_peered': '2024-09-15T23:14:32.573018+0000', 'last_clean': '2024-09-15T23:14:32.573018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:14:32.585255+0000', 'last_undegraded': '2024-09-15T23:14:32.585255+0000', 'last_fullsized': '2024-09-15T23:14:32.585255+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_clean_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:14:37.848 INFO:tasks.ceph.ceph_manager.ceph:PG 7.25 is not active+clean 2024-09-15T23:14:37.848 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:14:32.583704+0000', 'last_change': '2024-09-15T23:14:32.583704+0000', 'last_active': '2024-09-15T23:14:32.573018+0000', 'last_peered': '2024-09-15T23:14:32.573018+0000', 'last_clean': '2024-09-15T23:14:32.573018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:14:32.583704+0000', 'last_undegraded': '2024-09-15T23:14:32.583704+0000', 'last_fullsized': '2024-09-15T23:14:32.583704+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_clean_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:14:37.848 INFO:tasks.ceph.ceph_manager.ceph:PG 7.24 is not active+clean 2024-09-15T23:14:37.848 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:14:32.580341+0000', 'last_change': '2024-09-15T23:14:32.580341+0000', 'last_active': '2024-09-15T23:14:32.573018+0000', 'last_peered': '2024-09-15T23:14:32.573018+0000', 'last_clean': '2024-09-15T23:14:32.573018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:14:32.580341+0000', 'last_undegraded': '2024-09-15T23:14:32.580341+0000', 'last_fullsized': '2024-09-15T23:14:32.580341+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_clean_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:14:37.848 INFO:tasks.ceph.ceph_manager.ceph:PG 7.23 is not active+clean 2024-09-15T23:14:37.848 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:14:32.582924+0000', 'last_change': '2024-09-15T23:14:32.582924+0000', 'last_active': '2024-09-15T23:14:32.573018+0000', 'last_peered': '2024-09-15T23:14:32.573018+0000', 'last_clean': '2024-09-15T23:14:32.573018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:14:32.582924+0000', 'last_undegraded': '2024-09-15T23:14:32.582924+0000', 'last_fullsized': '2024-09-15T23:14:32.582924+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_clean_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:14:37.848 INFO:tasks.ceph.ceph_manager.ceph:PG 7.22 is not active+clean 2024-09-15T23:14:37.849 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:14:32.578331+0000', 'last_change': '2024-09-15T23:14:32.578331+0000', 'last_active': '2024-09-15T23:14:32.573018+0000', 'last_peered': '2024-09-15T23:14:32.573018+0000', 'last_clean': '2024-09-15T23:14:32.573018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:14:32.578331+0000', 'last_undegraded': '2024-09-15T23:14:32.578331+0000', 'last_fullsized': '2024-09-15T23:14:32.578331+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_clean_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:14:37.849 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1f is not active+clean 2024-09-15T23:14:37.849 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:14:32.582950+0000', 'last_change': '2024-09-15T23:14:32.582950+0000', 'last_active': '2024-09-15T23:14:32.573018+0000', 'last_peered': '2024-09-15T23:14:32.573018+0000', 'last_clean': '2024-09-15T23:14:32.573018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:14:32.582950+0000', 'last_undegraded': '2024-09-15T23:14:32.582950+0000', 'last_fullsized': '2024-09-15T23:14:32.582950+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_clean_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:14:37.849 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1c is not active+clean 2024-09-15T23:14:37.849 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:14:32.580300+0000', 'last_change': '2024-09-15T23:14:32.580300+0000', 'last_active': '2024-09-15T23:14:32.573018+0000', 'last_peered': '2024-09-15T23:14:32.573018+0000', 'last_clean': '2024-09-15T23:14:32.573018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:14:32.580300+0000', 'last_undegraded': '2024-09-15T23:14:32.580300+0000', 'last_fullsized': '2024-09-15T23:14:32.580300+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_clean_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:14:37.849 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1a is not active+clean 2024-09-15T23:14:37.849 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:14:32.581417+0000', 'last_change': '2024-09-15T23:14:32.581417+0000', 'last_active': '2024-09-15T23:14:32.573018+0000', 'last_peered': '2024-09-15T23:14:32.573018+0000', 'last_clean': '2024-09-15T23:14:32.573018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:14:32.581417+0000', 'last_undegraded': '2024-09-15T23:14:32.581417+0000', 'last_fullsized': '2024-09-15T23:14:32.581417+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_clean_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:14:37.849 INFO:tasks.ceph.ceph_manager.ceph:PG 7.19 is not active+clean 2024-09-15T23:14:37.849 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:14:32.582384+0000', 'last_change': '2024-09-15T23:14:32.582384+0000', 'last_active': '2024-09-15T23:14:32.573018+0000', 'last_peered': '2024-09-15T23:14:32.573018+0000', 'last_clean': '2024-09-15T23:14:32.573018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:14:32.582384+0000', 'last_undegraded': '2024-09-15T23:14:32.582384+0000', 'last_fullsized': '2024-09-15T23:14:32.582384+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_clean_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:14:37.849 INFO:tasks.ceph.ceph_manager.ceph:PG 7.16 is not active+clean 2024-09-15T23:14:37.849 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:14:32.584834+0000', 'last_change': '2024-09-15T23:14:32.584834+0000', 'last_active': '2024-09-15T23:14:32.573018+0000', 'last_peered': '2024-09-15T23:14:32.573018+0000', 'last_clean': '2024-09-15T23:14:32.573018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:14:32.584834+0000', 'last_undegraded': '2024-09-15T23:14:32.584834+0000', 'last_fullsized': '2024-09-15T23:14:32.584834+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_clean_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:14:37.850 INFO:tasks.ceph.ceph_manager.ceph:PG 7.17 is not active+clean 2024-09-15T23:14:37.850 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:14:32.583113+0000', 'last_change': '2024-09-15T23:14:32.583113+0000', 'last_active': '2024-09-15T23:14:32.573018+0000', 'last_peered': '2024-09-15T23:14:32.573018+0000', 'last_clean': '2024-09-15T23:14:32.573018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:14:32.583113+0000', 'last_undegraded': '2024-09-15T23:14:32.583113+0000', 'last_fullsized': '2024-09-15T23:14:32.583113+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_clean_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:14:37.850 INFO:tasks.ceph.ceph_manager.ceph:PG 7.15 is not active+clean 2024-09-15T23:14:37.850 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:14:32.583301+0000', 'last_change': '2024-09-15T23:14:32.583301+0000', 'last_active': '2024-09-15T23:14:32.573018+0000', 'last_peered': '2024-09-15T23:14:32.573018+0000', 'last_clean': '2024-09-15T23:14:32.573018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:14:32.583301+0000', 'last_undegraded': '2024-09-15T23:14:32.583301+0000', 'last_fullsized': '2024-09-15T23:14:32.583301+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_clean_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:14:37.850 INFO:tasks.ceph.ceph_manager.ceph:PG 7.12 is not active+clean 2024-09-15T23:14:37.850 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:14:32.584102+0000', 'last_change': '2024-09-15T23:14:32.584102+0000', 'last_active': '2024-09-15T23:14:32.573018+0000', 'last_peered': '2024-09-15T23:14:32.573018+0000', 'last_clean': '2024-09-15T23:14:32.573018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:14:32.584102+0000', 'last_undegraded': '2024-09-15T23:14:32.584102+0000', 'last_fullsized': '2024-09-15T23:14:32.584102+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_clean_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:14:37.850 INFO:tasks.ceph.ceph_manager.ceph:PG 7.11 is not active+clean 2024-09-15T23:14:37.850 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:14:32.580862+0000', 'last_change': '2024-09-15T23:14:32.580862+0000', 'last_active': '2024-09-15T23:14:32.573018+0000', 'last_peered': '2024-09-15T23:14:32.573018+0000', 'last_clean': '2024-09-15T23:14:32.573018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:14:32.580862+0000', 'last_undegraded': '2024-09-15T23:14:32.580862+0000', 'last_fullsized': '2024-09-15T23:14:32.580862+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_clean_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:14:37.850 INFO:tasks.ceph.ceph_manager.ceph:PG 7.c is not active+clean 2024-09-15T23:14:37.850 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:14:32.579913+0000', 'last_change': '2024-09-15T23:14:32.579913+0000', 'last_active': '2024-09-15T23:14:32.573018+0000', 'last_peered': '2024-09-15T23:14:32.573018+0000', 'last_clean': '2024-09-15T23:14:32.573018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:14:32.579913+0000', 'last_undegraded': '2024-09-15T23:14:32.579913+0000', 'last_fullsized': '2024-09-15T23:14:32.579913+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_clean_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:14:37.850 INFO:tasks.ceph.ceph_manager.ceph:PG 7.d is not active+clean 2024-09-15T23:14:37.851 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:14:32.586158+0000', 'last_change': '2024-09-15T23:14:32.586158+0000', 'last_active': '2024-09-15T23:14:32.573018+0000', 'last_peered': '2024-09-15T23:14:32.573018+0000', 'last_clean': '2024-09-15T23:14:32.573018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:14:32.586158+0000', 'last_undegraded': '2024-09-15T23:14:32.586158+0000', 'last_fullsized': '2024-09-15T23:14:32.586158+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_clean_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:14:37.851 INFO:tasks.ceph.ceph_manager.ceph:PG 7.7 is not active+clean 2024-09-15T23:14:37.851 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:14:32.581036+0000', 'last_change': '2024-09-15T23:14:32.581036+0000', 'last_active': '2024-09-15T23:14:32.573018+0000', 'last_peered': '2024-09-15T23:14:32.573018+0000', 'last_clean': '2024-09-15T23:14:32.573018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:14:32.581036+0000', 'last_undegraded': '2024-09-15T23:14:32.581036+0000', 'last_fullsized': '2024-09-15T23:14:32.581036+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_clean_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:14:37.851 INFO:tasks.ceph.ceph_manager.ceph:PG 7.5 is not active+clean 2024-09-15T23:14:37.851 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:14:32.582808+0000', 'last_change': '2024-09-15T23:14:32.582808+0000', 'last_active': '2024-09-15T23:14:32.573018+0000', 'last_peered': '2024-09-15T23:14:32.573018+0000', 'last_clean': '2024-09-15T23:14:32.573018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:14:32.582808+0000', 'last_undegraded': '2024-09-15T23:14:32.582808+0000', 'last_fullsized': '2024-09-15T23:14:32.582808+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_clean_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:14:37.851 INFO:tasks.ceph.ceph_manager.ceph:PG 7.0 is not active+clean 2024-09-15T23:14:37.851 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:14:32.583903+0000', 'last_change': '2024-09-15T23:14:32.583903+0000', 'last_active': '2024-09-15T23:14:32.573018+0000', 'last_peered': '2024-09-15T23:14:32.573018+0000', 'last_clean': '2024-09-15T23:14:32.573018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:14:32.583903+0000', 'last_undegraded': '2024-09-15T23:14:32.583903+0000', 'last_fullsized': '2024-09-15T23:14:32.583903+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_clean_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:14:37.851 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1 is not active+clean 2024-09-15T23:14:37.851 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 50, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:14:32.579757+0000', 'last_change': '2024-09-15T23:14:32.579757+0000', 'last_active': '2024-09-15T23:14:32.573018+0000', 'last_peered': '2024-09-15T23:14:32.573018+0000', 'last_clean': '2024-09-15T23:14:32.573018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:14:32.579757+0000', 'last_undegraded': '2024-09-15T23:14:32.579757+0000', 'last_fullsized': '2024-09-15T23:14:32.579757+0000', 'mapping_epoch': 50, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 50, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'last_clean_scrub_stamp': '2024-09-15T23:14:32.573018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:14:37.852 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:14:37.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.977+0000 7f0a22b0a640 1 Processor -- start 2024-09-15T23:14:37.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.978+0000 7f0a22b0a640 1 -- start start 2024-09-15T23:14:37.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.978+0000 7f0a22b0a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0a1c0b6970 0x7f0a1c0b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:37.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.978+0000 7f0a22b0a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0a1c0d23b0 0x7f0a1c0b8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:37.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.978+0000 7f0a22b0a640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a1c0d0e70 con 0x7f0a1c15ed20 2024-09-15T23:14:37.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.978+0000 7f0a22b0a640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f0a1c0d41c0 con 0x7f0a1c0d23b0 2024-09-15T23:14:37.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.978+0000 7f0a22b0a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0a1c0d35b0 con 0x7f0a1c0b6970 2024-09-15T23:14:37.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.979+0000 7f0a210a7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0a1c0d23b0 0x7f0a1c0b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:37.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.979+0000 7f0a210a7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0a1c0d23b0 0x7f0a1c0b8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51666/0 (socket says 172.21.15.123:51666) 2024-09-15T23:14:37.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.979+0000 7f0a210a7640 1 -- 172.21.15.123:0/4176621937 learned_addr learned my addr 172.21.15.123:0/4176621937 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:37.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.979+0000 7f0a210a7640 1 -- 172.21.15.123:0/4176621937 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0a1c0b6970 msgr2=0x7f0a1c0b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:37.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.979+0000 7f0a1bfff640 1 --2- 172.21.15.123:0/4176621937 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0a1c0b6970 0x7f0a1c0b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:37.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.979+0000 7f0a210a7640 1 --2- 172.21.15.123:0/4176621937 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0a1c0b6970 0x7f0a1c0b80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:37.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.979+0000 7f0a210a7640 1 -- 172.21.15.123:0/4176621937 >> v1:172.21.15.188:6789/0 conn(0x7f0a1c15ed20 legacy=0x7f0a1c0b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:37.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.979+0000 7f0a210a7640 1 -- 172.21.15.123:0/4176621937 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a1c0d3890 con 0x7f0a1c0d23b0 2024-09-15T23:14:37.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.980+0000 7f0a210a7640 1 --2- 172.21.15.123:0/4176621937 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a1c0d23b0 0x7f0a1c0b8610 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0a14009e50 tx=0x7f0a1402a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cae7891ea21b9eef server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:37.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.980+0000 7f0a1b7fe640 1 -- 172.21.15.123:0/4176621937 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a14036070 con 0x7f0a1c0d23b0 2024-09-15T23:14:37.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.980+0000 7f0a1b7fe640 1 -- 172.21.15.123:0/4176621937 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a14031600 con 0x7f0a1c0d23b0 2024-09-15T23:14:37.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.980+0000 7f0a1b7fe640 1 -- 172.21.15.123:0/4176621937 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a140319d0 con 0x7f0a1c0d23b0 2024-09-15T23:14:37.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.980+0000 7f0a22b0a640 1 -- 172.21.15.123:0/4176621937 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a1c0d23b0 msgr2=0x7f0a1c0b8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:37.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.980+0000 7f0a22b0a640 1 --2- 172.21.15.123:0/4176621937 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a1c0d23b0 0x7f0a1c0b8610 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0a14009e50 tx=0x7f0a1402a630 comp rx=0 tx=0).stop 2024-09-15T23:14:37.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.980+0000 7f0a22b0a640 1 -- 172.21.15.123:0/4176621937 shutdown_connections 2024-09-15T23:14:37.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.980+0000 7f0a22b0a640 1 --2- 172.21.15.123:0/4176621937 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a1c0d23b0 0x7f0a1c0b8610 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:37.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.980+0000 7f0a22b0a640 1 --2- 172.21.15.123:0/4176621937 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0a1c0b6970 0x7f0a1c0b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:37.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.980+0000 7f0a22b0a640 1 -- 172.21.15.123:0/4176621937 >> 172.21.15.123:0/4176621937 conn(0x7f0a1c0d1260 msgr2=0x7f0a1c0d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:37.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.980+0000 7f0a22b0a640 1 -- 172.21.15.123:0/4176621937 shutdown_connections 2024-09-15T23:14:37.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.980+0000 7f0a22b0a640 1 -- 172.21.15.123:0/4176621937 wait complete. 2024-09-15T23:14:37.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.981+0000 7f0a22b0a640 1 Processor -- start 2024-09-15T23:14:37.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.981+0000 7f0a22b0a640 1 -- start start 2024-09-15T23:14:37.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.982+0000 7f0a22b0a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a1c0b6970 0x7f0a1c15f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:37.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.982+0000 7f0a22b0a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0a1c0d23b0 0x7f0a1c1549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:37.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.982+0000 7f0a22b0a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a1c15ed20 0x7f0a1c161000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:37.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.982+0000 7f0a22b0a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1c0d32a0 con 0x7f0a1c15ed20 2024-09-15T23:14:37.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.982+0000 7f0a22b0a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1c0d3e50 con 0x7f0a1c0b6970 2024-09-15T23:14:37.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.982+0000 7f0a22b0a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0a1c15f100 con 0x7f0a1c0d23b0 2024-09-15T23:14:37.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.982+0000 7f0a210a7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a1c15ed20 0x7f0a1c161000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:37.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.982+0000 7f0a210a7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a1c15ed20 0x7f0a1c161000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51672/0 (socket says 172.21.15.123:51672) 2024-09-15T23:14:37.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.982+0000 7f0a210a7640 1 -- 172.21.15.123:0/2323728115 learned_addr learned my addr 172.21.15.123:0/2323728115 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:37.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.983+0000 7f0a208a6640 1 --2- 172.21.15.123:0/2323728115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a1c0b6970 0x7f0a1c15f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:37.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.983+0000 7f0a1bfff640 1 --2- 172.21.15.123:0/2323728115 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0a1c0d23b0 0x7f0a1c1549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:37.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.983+0000 7f0a210a7640 1 -- 172.21.15.123:0/2323728115 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0a1c0d23b0 msgr2=0x7f0a1c1549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:37.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.983+0000 7f0a210a7640 1 --2- 172.21.15.123:0/2323728115 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0a1c0d23b0 0x7f0a1c1549c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:37.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.983+0000 7f0a210a7640 1 -- 172.21.15.123:0/2323728115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a1c0b6970 msgr2=0x7f0a1c15f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:37.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.983+0000 7f0a210a7640 1 --2- 172.21.15.123:0/2323728115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a1c0b6970 0x7f0a1c15f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:37.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.983+0000 7f0a210a7640 1 -- 172.21.15.123:0/2323728115 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a1c160bb0 con 0x7f0a1c15ed20 2024-09-15T23:14:37.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.983+0000 7f0a208a6640 1 --2- 172.21.15.123:0/2323728115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a1c0b6970 0x7f0a1c15f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:37.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.983+0000 7f0a1bfff640 1 --2- 172.21.15.123:0/2323728115 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0a1c0d23b0 0x7f0a1c1549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:37.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.983+0000 7f0a210a7640 1 --2- 172.21.15.123:0/2323728115 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a1c15ed20 0x7f0a1c161000 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0a14034040 tx=0x7f0a14004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:37.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.983+0000 7f0a197fa640 1 -- 172.21.15.123:0/2323728115 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a14036050 con 0x7f0a1c15ed20 2024-09-15T23:14:37.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.983+0000 7f0a197fa640 1 -- 172.21.15.123:0/2323728115 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a14042070 con 0x7f0a1c15ed20 2024-09-15T23:14:37.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.983+0000 7f0a22b0a640 1 -- 172.21.15.123:0/2323728115 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a1c0cbb90 con 0x7f0a1c15ed20 2024-09-15T23:14:37.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.983+0000 7f0a197fa640 1 -- 172.21.15.123:0/2323728115 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a14009510 con 0x7f0a1c15ed20 2024-09-15T23:14:37.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.983+0000 7f0a22b0a640 1 -- 172.21.15.123:0/2323728115 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a1c15fdf0 con 0x7f0a1c15ed20 2024-09-15T23:14:37.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.984+0000 7f0a22b0a640 1 -- 172.21.15.123:0/2323728115 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a1c0b7010 con 0x7f0a1c15ed20 2024-09-15T23:14:37.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.985+0000 7f0a197fa640 1 -- 172.21.15.123:0/2323728115 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0a14007bf0 con 0x7f0a1c15ed20 2024-09-15T23:14:37.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.985+0000 7f0a197fa640 1 --2- 172.21.15.123:0/2323728115 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0a0006c2b0 0x7f0a0006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:37.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.985+0000 7f0a197fa640 1 -- 172.21.15.123:0/2323728115 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7f0a140ac3a0 con 0x7f0a1c15ed20 2024-09-15T23:14:37.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.985+0000 7f0a208a6640 1 --2- 172.21.15.123:0/2323728115 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0a0006c2b0 0x7f0a0006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:37.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.986+0000 7f0a208a6640 1 --2- 172.21.15.123:0/2323728115 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0a0006c2b0 0x7f0a0006e770 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c0cb2b0 tx=0x7f0a10008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:37.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:37.989+0000 7f0a197fa640 1 -- 172.21.15.123:0/2323728115 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0a1c0d0e70 con 0x7f0a1c15ed20 2024-09-15T23:14:38.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.219+0000 7f0a22b0a640 1 -- 172.21.15.123:0/2323728115 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f0a1c0d0a90 con 0x7f0a1c15ed20 2024-09-15T23:14:38.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.220+0000 7f0a197fa640 1 -- 172.21.15.123:0/2323728115 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1152 (secure 0 0 0) 0x7f0a1407ab10 con 0x7f0a1c15ed20 2024-09-15T23:14:38.222 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:14:38.222 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":168,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":52,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":49},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":16}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":291028992,"bytes_avail":772803084288,"bytes_total":773094113280,"unknown_pgs_ratio":0.50515460968017578,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":21,"btime":"2024-09-15T23:14:36:243751+0000","id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"d","status":"up:active","gid":5256}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2024-09-15T23:14:23.532833+0000","services":{}},"progress_events":{}} 2024-09-15T23:14:38.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.222+0000 7f0a22b0a640 1 -- 172.21.15.123:0/2323728115 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0a0006c2b0 msgr2=0x7f0a0006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:38.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.222+0000 7f0a22b0a640 1 --2- 172.21.15.123:0/2323728115 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0a0006c2b0 0x7f0a0006e770 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c0cb2b0 tx=0x7f0a10008040 comp rx=0 tx=0).stop 2024-09-15T23:14:38.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.222+0000 7f0a22b0a640 1 -- 172.21.15.123:0/2323728115 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a1c15ed20 msgr2=0x7f0a1c161000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:38.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.222+0000 7f0a22b0a640 1 --2- 172.21.15.123:0/2323728115 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a1c15ed20 0x7f0a1c161000 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0a14034040 tx=0x7f0a14004a40 comp rx=0 tx=0).stop 2024-09-15T23:14:38.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.222+0000 7f0a22b0a640 1 -- 172.21.15.123:0/2323728115 shutdown_connections 2024-09-15T23:14:38.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.222+0000 7f0a22b0a640 1 --2- 172.21.15.123:0/2323728115 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0a0006c2b0 0x7f0a0006e770 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:38.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.222+0000 7f0a22b0a640 1 --2- 172.21.15.123:0/2323728115 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a1c15ed20 0x7f0a1c161000 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:38.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.222+0000 7f0a22b0a640 1 --2- 172.21.15.123:0/2323728115 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0a1c0d23b0 0x7f0a1c1549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:38.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.222+0000 7f0a22b0a640 1 --2- 172.21.15.123:0/2323728115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a1c0b6970 0x7f0a1c15f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:38.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.222+0000 7f0a22b0a640 1 -- 172.21.15.123:0/2323728115 >> 172.21.15.123:0/2323728115 conn(0x7f0a1c0d1260 msgr2=0x7f0a1c0b4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:38.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.222+0000 7f0a22b0a640 1 -- 172.21.15.123:0/2323728115 shutdown_connections 2024-09-15T23:14:38.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.222+0000 7f0a22b0a640 1 -- 172.21.15.123:0/2323728115 wait complete. 2024-09-15T23:14:38.235 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-15T23:14:38.235 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:14:38.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.331+0000 7fe1effc4640 1 Processor -- start 2024-09-15T23:14:38.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.332+0000 7fe1effc4640 1 -- start start 2024-09-15T23:14:38.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.332+0000 7fe1effc4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe1e80d23b0 0x7fe1e80b87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:38.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.332+0000 7fe1effc4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1e80d0e70 con 0x7fe1e815ed20 2024-09-15T23:14:38.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.332+0000 7fe1effc4640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1e80d41c0 con 0x7fe1e80b6970 2024-09-15T23:14:38.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.332+0000 7fe1effc4640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe1e80d35b0 con 0x7fe1e80d23b0 2024-09-15T23:14:38.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.333+0000 7fe1ee561640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe1e80d23b0 0x7fe1e80b87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:38.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.333+0000 7fe1edd60640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe1e815ed20 0x7fe1e80b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:57452/0 (socket says 172.21.15.123:57452) 2024-09-15T23:14:38.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.333+0000 7fe1edd60640 1 -- 172.21.15.123:0/2765535990 learned_addr learned my addr 172.21.15.123:0/2765535990 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:38.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.333+0000 7fe1ee561640 1 -- 172.21.15.123:0/2765535990 >> v1:172.21.15.188:6789/0 conn(0x7fe1e80b6970 legacy=0x7fe1e80b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:38.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.333+0000 7fe1ee561640 1 -- 172.21.15.123:0/2765535990 >> v1:172.21.15.123:6789/0 conn(0x7fe1e815ed20 legacy=0x7fe1e80b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:38.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.333+0000 7fe1ee561640 1 -- 172.21.15.123:0/2765535990 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e80d3890 con 0x7fe1e80d23b0 2024-09-15T23:14:38.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.334+0000 7fe1ee561640 1 --2- 172.21.15.123:0/2765535990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1e80d23b0 0x7fe1e80b87e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00097a0 tx=0x7fe1e002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34320577af42b587 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:38.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.334+0000 7fe1ecd5e640 1 -- 172.21.15.123:0/2765535990 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0037070 con 0x7fe1e80d23b0 2024-09-15T23:14:38.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.334+0000 7fe1ecd5e640 1 -- 172.21.15.123:0/2765535990 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1e002ae50 con 0x7fe1e80d23b0 2024-09-15T23:14:38.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.334+0000 7fe1ecd5e640 1 -- 172.21.15.123:0/2765535990 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0032660 con 0x7fe1e80d23b0 2024-09-15T23:14:38.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.334+0000 7fe1effc4640 1 -- 172.21.15.123:0/2765535990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1e80d23b0 msgr2=0x7fe1e80b87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:38.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.334+0000 7fe1effc4640 1 --2- 172.21.15.123:0/2765535990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1e80d23b0 0x7fe1e80b87e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00097a0 tx=0x7fe1e002a140 comp rx=0 tx=0).stop 2024-09-15T23:14:38.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.334+0000 7fe1effc4640 1 -- 172.21.15.123:0/2765535990 shutdown_connections 2024-09-15T23:14:38.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.334+0000 7fe1effc4640 1 --2- 172.21.15.123:0/2765535990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1e80d23b0 0x7fe1e80b87e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:38.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.334+0000 7fe1effc4640 1 -- 172.21.15.123:0/2765535990 >> 172.21.15.123:0/2765535990 conn(0x7fe1e80d1260 msgr2=0x7fe1e80d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:38.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.334+0000 7fe1effc4640 1 -- 172.21.15.123:0/2765535990 shutdown_connections 2024-09-15T23:14:38.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.334+0000 7fe1effc4640 1 -- 172.21.15.123:0/2765535990 wait complete. 2024-09-15T23:14:38.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.335+0000 7fe1effc4640 1 Processor -- start 2024-09-15T23:14:38.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.336+0000 7fe1effc4640 1 -- start start 2024-09-15T23:14:38.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.336+0000 7fe1effc4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1e80b6970 0x7fe1e8157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:38.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.336+0000 7fe1effc4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe1e80d23b0 0x7fe1e8155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:38.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.336+0000 7fe1effc4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1e815ed20 0x7fe1e81598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:38.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.336+0000 7fe1effc4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e80d32a0 con 0x7fe1e815ed20 2024-09-15T23:14:38.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.336+0000 7fe1effc4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e80d3e50 con 0x7fe1e80b6970 2024-09-15T23:14:38.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.336+0000 7fe1effc4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe1e815f100 con 0x7fe1e80d23b0 2024-09-15T23:14:38.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.336+0000 7fe1ee561640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1e815ed20 0x7fe1e81598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:38.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.336+0000 7fe1ee561640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1e815ed20 0x7fe1e81598f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51688/0 (socket says 172.21.15.123:51688) 2024-09-15T23:14:38.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.336+0000 7fe1ee561640 1 -- 172.21.15.123:0/927348634 learned_addr learned my addr 172.21.15.123:0/927348634 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:38.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.337+0000 7fe1edd60640 1 --2- 172.21.15.123:0/927348634 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1e80b6970 0x7fe1e8157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:38.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.337+0000 7fe1ed55f640 1 --2- 172.21.15.123:0/927348634 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe1e80d23b0 0x7fe1e8155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:38.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.337+0000 7fe1ee561640 1 -- 172.21.15.123:0/927348634 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe1e80d23b0 msgr2=0x7fe1e8155160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:38.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.337+0000 7fe1ee561640 1 --2- 172.21.15.123:0/927348634 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe1e80d23b0 0x7fe1e8155160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:38.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.337+0000 7fe1ee561640 1 -- 172.21.15.123:0/927348634 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1e80b6970 msgr2=0x7fe1e8157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:38.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.337+0000 7fe1ee561640 1 --2- 172.21.15.123:0/927348634 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1e80b6970 0x7fe1e8157bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:38.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.337+0000 7fe1ee561640 1 -- 172.21.15.123:0/927348634 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e81581e0 con 0x7fe1e815ed20 2024-09-15T23:14:38.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.337+0000 7fe1edd60640 1 --2- 172.21.15.123:0/927348634 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1e80b6970 0x7fe1e8157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:38.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.337+0000 7fe1ed55f640 1 --2- 172.21.15.123:0/927348634 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe1e80d23b0 0x7fe1e8155160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:38.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.337+0000 7fe1ee561640 1 --2- 172.21.15.123:0/927348634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1e815ed20 0x7fe1e81598f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00097a0 tx=0x7fe1e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:38.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.337+0000 7fe1e67fc640 1 -- 172.21.15.123:0/927348634 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0041070 con 0x7fe1e815ed20 2024-09-15T23:14:38.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.337+0000 7fe1e67fc640 1 -- 172.21.15.123:0/927348634 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1e0032e10 con 0x7fe1e815ed20 2024-09-15T23:14:38.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.337+0000 7fe1e67fc640 1 -- 172.21.15.123:0/927348634 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0037040 con 0x7fe1e815ed20 2024-09-15T23:14:38.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.337+0000 7fe1effc4640 1 -- 172.21.15.123:0/927348634 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1e80cbb00 con 0x7fe1e815ed20 2024-09-15T23:14:38.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.337+0000 7fe1effc4640 1 -- 172.21.15.123:0/927348634 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1e8156640 con 0x7fe1e815ed20 2024-09-15T23:14:38.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.338+0000 7fe1effc4640 1 -- 172.21.15.123:0/927348634 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1e80b7010 con 0x7fe1e815ed20 2024-09-15T23:14:38.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.339+0000 7fe1e67fc640 1 -- 172.21.15.123:0/927348634 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe1e0044070 con 0x7fe1e815ed20 2024-09-15T23:14:38.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.339+0000 7fe1e67fc640 1 --2- 172.21.15.123:0/927348634 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe1d406c2b0 0x7fe1d406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:38.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.339+0000 7fe1e67fc640 1 -- 172.21.15.123:0/927348634 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7fe1e00abb80 con 0x7fe1e815ed20 2024-09-15T23:14:38.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.339+0000 7fe1edd60640 1 --2- 172.21.15.123:0/927348634 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe1d406c2b0 0x7fe1d406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:38.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.340+0000 7fe1edd60640 1 --2- 172.21.15.123:0/927348634 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe1d406c2b0 0x7fe1d406e770 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8000f60 tx=0x7fe1d8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:38.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.343+0000 7fe1e67fc640 1 -- 172.21.15.123:0/927348634 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe1e007a380 con 0x7fe1e815ed20 2024-09-15T23:14:38.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.504+0000 7fe1effc4640 1 -- 172.21.15.123:0/927348634 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe1e80b3f20 con 0x7fe1d406c2b0 2024-09-15T23:14:38.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.511+0000 7fe1e67fc640 1 -- 172.21.15.123:0/927348634 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249320 (secure 0 0 0) 0x7fe1e80b3f20 con 0x7fe1d406c2b0 2024-09-15T23:14:38.515 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:14:38.516 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:14:38.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.513+0000 7fe1effc4640 1 -- 172.21.15.123:0/927348634 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe1d406c2b0 msgr2=0x7fe1d406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:38.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.513+0000 7fe1effc4640 1 --2- 172.21.15.123:0/927348634 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe1d406c2b0 0x7fe1d406e770 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8000f60 tx=0x7fe1d8009040 comp rx=0 tx=0).stop 2024-09-15T23:14:38.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.513+0000 7fe1effc4640 1 -- 172.21.15.123:0/927348634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1e815ed20 msgr2=0x7fe1e81598f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:38.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.513+0000 7fe1effc4640 1 --2- 172.21.15.123:0/927348634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1e815ed20 0x7fe1e81598f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00097a0 tx=0x7fe1e00046c0 comp rx=0 tx=0).stop 2024-09-15T23:14:38.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.513+0000 7fe1effc4640 1 -- 172.21.15.123:0/927348634 shutdown_connections 2024-09-15T23:14:38.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.513+0000 7fe1effc4640 1 --2- 172.21.15.123:0/927348634 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe1d406c2b0 0x7fe1d406e770 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:38.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.513+0000 7fe1effc4640 1 --2- 172.21.15.123:0/927348634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe1e815ed20 0x7fe1e81598f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:38.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.513+0000 7fe1effc4640 1 --2- 172.21.15.123:0/927348634 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe1e80d23b0 0x7fe1e8155160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:38.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.513+0000 7fe1effc4640 1 --2- 172.21.15.123:0/927348634 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1e80b6970 0x7fe1e8157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:38.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.513+0000 7fe1effc4640 1 -- 172.21.15.123:0/927348634 >> 172.21.15.123:0/927348634 conn(0x7fe1e80d1260 msgr2=0x7fe1e80b9cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:38.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.513+0000 7fe1effc4640 1 -- 172.21.15.123:0/927348634 shutdown_connections 2024-09-15T23:14:38.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:38.513+0000 7fe1effc4640 1 -- 172.21.15.123:0/927348634 wait complete. 2024-09-15T23:14:38.526 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":123,"stamp":"2024-09-15T23:14:37.535470+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592618,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":190,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":284472,"kb_used_data":5804,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754690248,"statfs":{"total":773094113280,"available":772802813952,"internally_reserved":0,"allocated":5943296,"data_stored":3145252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":285134384},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2250,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.961604"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.585749+0000","last_change":"2024-09-15T23:14:32.585749+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.585749+0000","last_undegraded":"2024-09-15T23:14:32.585749+0000","last_fullsized":"2024-09-15T23:14:32.585749+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.579440+0000","last_change":"2024-09-15T23:14:32.579440+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.579440+0000","last_undegraded":"2024-09-15T23:14:32.579440+0000","last_fullsized":"2024-09-15T23:14:32.579440+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.586556+0000","last_change":"2024-09-15T23:14:32.586556+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.586556+0000","last_undegraded":"2024-09-15T23:14:32.586556+0000","last_fullsized":"2024-09-15T23:14:32.586556+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.599094+0000","last_change":"2024-09-15T23:14:33.611677+0000","last_active":"2024-09-15T23:14:34.599094+0000","last_peered":"2024-09-15T23:14:34.599094+0000","last_clean":"2024-09-15T23:14:34.599094+0000","last_became_active":"2024-09-15T23:14:33.611423+0000","last_became_peered":"2024-09-15T23:14:33.611423+0000","last_unstale":"2024-09-15T23:14:34.599094+0000","last_undegraded":"2024-09-15T23:14:34.599094+0000","last_fullsized":"2024-09-15T23:14:34.599094+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:30.257562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.585450+0000","last_change":"2024-09-15T23:14:32.585450+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.585450+0000","last_undegraded":"2024-09-15T23:14:32.585450+0000","last_fullsized":"2024-09-15T23:14:32.585450+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870653+0000","last_change":"2024-09-15T23:14:33.608732+0000","last_active":"2024-09-15T23:14:34.870653+0000","last_peered":"2024-09-15T23:14:34.870653+0000","last_clean":"2024-09-15T23:14:34.870653+0000","last_became_active":"2024-09-15T23:14:33.608470+0000","last_became_peered":"2024-09-15T23:14:33.608470+0000","last_unstale":"2024-09-15T23:14:34.870653+0000","last_undegraded":"2024-09-15T23:14:34.870653+0000","last_fullsized":"2024-09-15T23:14:34.870653+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:26:10.163510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.582819+0000","last_change":"2024-09-15T23:14:32.582819+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.582819+0000","last_undegraded":"2024-09-15T23:14:32.582819+0000","last_fullsized":"2024-09-15T23:14:32.582819+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.598781+0000","last_change":"2024-09-15T23:14:33.609154+0000","last_active":"2024-09-15T23:14:34.598781+0000","last_peered":"2024-09-15T23:14:34.598781+0000","last_clean":"2024-09-15T23:14:34.598781+0000","last_became_active":"2024-09-15T23:14:33.608469+0000","last_became_peered":"2024-09-15T23:14:33.608469+0000","last_unstale":"2024-09-15T23:14:34.598781+0000","last_undegraded":"2024-09-15T23:14:34.598781+0000","last_fullsized":"2024-09-15T23:14:34.598781+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:15:26.232677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870339+0000","last_change":"2024-09-15T23:14:33.611678+0000","last_active":"2024-09-15T23:14:34.870339+0000","last_peered":"2024-09-15T23:14:34.870339+0000","last_clean":"2024-09-15T23:14:34.870339+0000","last_became_active":"2024-09-15T23:14:33.611426+0000","last_became_peered":"2024-09-15T23:14:33.611426+0000","last_unstale":"2024-09-15T23:14:34.870339+0000","last_undegraded":"2024-09-15T23:14:34.870339+0000","last_fullsized":"2024-09-15T23:14:34.870339+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:34.886069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870494+0000","last_change":"2024-09-15T23:14:33.612170+0000","last_active":"2024-09-15T23:14:34.870494+0000","last_peered":"2024-09-15T23:14:34.870494+0000","last_clean":"2024-09-15T23:14:34.870494+0000","last_became_active":"2024-09-15T23:14:33.610919+0000","last_became_peered":"2024-09-15T23:14:33.610919+0000","last_unstale":"2024-09-15T23:14:34.870494+0000","last_undegraded":"2024-09-15T23:14:34.870494+0000","last_fullsized":"2024-09-15T23:14:34.870494+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:56.742964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.599226+0000","last_change":"2024-09-15T23:14:33.614240+0000","last_active":"2024-09-15T23:14:34.599226+0000","last_peered":"2024-09-15T23:14:34.599226+0000","last_clean":"2024-09-15T23:14:34.599226+0000","last_became_active":"2024-09-15T23:14:33.613971+0000","last_became_peered":"2024-09-15T23:14:33.613971+0000","last_unstale":"2024-09-15T23:14:34.599226+0000","last_undegraded":"2024-09-15T23:14:34.599226+0000","last_fullsized":"2024-09-15T23:14:34.599226+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:15:25.781472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.580677+0000","last_change":"2024-09-15T23:14:32.580677+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.580677+0000","last_undegraded":"2024-09-15T23:14:32.580677+0000","last_fullsized":"2024-09-15T23:14:32.580677+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870337+0000","last_change":"2024-09-15T23:14:33.610275+0000","last_active":"2024-09-15T23:14:34.870337+0000","last_peered":"2024-09-15T23:14:34.870337+0000","last_clean":"2024-09-15T23:14:34.870337+0000","last_became_active":"2024-09-15T23:14:33.609998+0000","last_became_peered":"2024-09-15T23:14:33.609998+0000","last_unstale":"2024-09-15T23:14:34.870337+0000","last_undegraded":"2024-09-15T23:14:34.870337+0000","last_fullsized":"2024-09-15T23:14:34.870337+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:55:06.246019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.598897+0000","last_change":"2024-09-15T23:14:33.616589+0000","last_active":"2024-09-15T23:14:34.598897+0000","last_peered":"2024-09-15T23:14:34.598897+0000","last_clean":"2024-09-15T23:14:34.598897+0000","last_became_active":"2024-09-15T23:14:33.616264+0000","last_became_peered":"2024-09-15T23:14:33.616264+0000","last_unstale":"2024-09-15T23:14:34.598897+0000","last_undegraded":"2024-09-15T23:14:34.598897+0000","last_fullsized":"2024-09-15T23:14:34.598897+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:22.799567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.598697+0000","last_change":"2024-09-15T23:14:33.611634+0000","last_active":"2024-09-15T23:14:34.598697+0000","last_peered":"2024-09-15T23:14:34.598697+0000","last_clean":"2024-09-15T23:14:34.598697+0000","last_became_active":"2024-09-15T23:14:33.611361+0000","last_became_peered":"2024-09-15T23:14:33.611361+0000","last_unstale":"2024-09-15T23:14:34.598697+0000","last_undegraded":"2024-09-15T23:14:34.598697+0000","last_fullsized":"2024-09-15T23:14:34.598697+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:25:24.021354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.585391+0000","last_change":"2024-09-15T23:14:32.585391+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.585391+0000","last_undegraded":"2024-09-15T23:14:32.585391+0000","last_fullsized":"2024-09-15T23:14:32.585391+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.578586+0000","last_change":"2024-09-15T23:14:32.578586+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.578586+0000","last_undegraded":"2024-09-15T23:14:32.578586+0000","last_fullsized":"2024-09-15T23:14:32.578586+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.585310+0000","last_change":"2024-09-15T23:14:32.585310+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.585310+0000","last_undegraded":"2024-09-15T23:14:32.585310+0000","last_fullsized":"2024-09-15T23:14:32.585310+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.585247+0000","last_change":"2024-09-15T23:14:32.585247+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.585247+0000","last_undegraded":"2024-09-15T23:14:32.585247+0000","last_fullsized":"2024-09-15T23:14:32.585247+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870715+0000","last_change":"2024-09-15T23:14:33.610179+0000","last_active":"2024-09-15T23:14:34.870715+0000","last_peered":"2024-09-15T23:14:34.870715+0000","last_clean":"2024-09-15T23:14:34.870715+0000","last_became_active":"2024-09-15T23:14:33.609915+0000","last_became_peered":"2024-09-15T23:14:33.609915+0000","last_unstale":"2024-09-15T23:14:34.870715+0000","last_undegraded":"2024-09-15T23:14:34.870715+0000","last_fullsized":"2024-09-15T23:14:34.870715+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:32:53.322424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.599246+0000","last_change":"2024-09-15T23:14:33.608714+0000","last_active":"2024-09-15T23:14:34.599246+0000","last_peered":"2024-09-15T23:14:34.599246+0000","last_clean":"2024-09-15T23:14:34.599246+0000","last_became_active":"2024-09-15T23:14:33.608493+0000","last_became_peered":"2024-09-15T23:14:33.608493+0000","last_unstale":"2024-09-15T23:14:34.599246+0000","last_undegraded":"2024-09-15T23:14:34.599246+0000","last_fullsized":"2024-09-15T23:14:34.599246+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:56:30.247595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870181+0000","last_change":"2024-09-15T23:14:33.593082+0000","last_active":"2024-09-15T23:14:34.870181+0000","last_peered":"2024-09-15T23:14:34.870181+0000","last_clean":"2024-09-15T23:14:34.870181+0000","last_became_active":"2024-09-15T23:14:33.592816+0000","last_became_peered":"2024-09-15T23:14:33.592816+0000","last_unstale":"2024-09-15T23:14:34.870181+0000","last_undegraded":"2024-09-15T23:14:34.870181+0000","last_fullsized":"2024-09-15T23:14:34.870181+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:27:28.548467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.581941+0000","last_change":"2024-09-15T23:14:32.581941+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.581941+0000","last_undegraded":"2024-09-15T23:14:32.581941+0000","last_fullsized":"2024-09-15T23:14:32.581941+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.579143+0000","last_change":"2024-09-15T23:14:32.579143+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.579143+0000","last_undegraded":"2024-09-15T23:14:32.579143+0000","last_fullsized":"2024-09-15T23:14:32.579143+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.585255+0000","last_change":"2024-09-15T23:14:32.585255+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.585255+0000","last_undegraded":"2024-09-15T23:14:32.585255+0000","last_fullsized":"2024-09-15T23:14:32.585255+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.599222+0000","last_change":"2024-09-15T23:14:33.618350+0000","last_active":"2024-09-15T23:14:34.599222+0000","last_peered":"2024-09-15T23:14:34.599222+0000","last_clean":"2024-09-15T23:14:34.599222+0000","last_became_active":"2024-09-15T23:14:33.618088+0000","last_became_peered":"2024-09-15T23:14:33.618088+0000","last_unstale":"2024-09-15T23:14:34.599222+0000","last_undegraded":"2024-09-15T23:14:34.599222+0000","last_fullsized":"2024-09-15T23:14:34.599222+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:05:44.443170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.583704+0000","last_change":"2024-09-15T23:14:32.583704+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.583704+0000","last_undegraded":"2024-09-15T23:14:32.583704+0000","last_fullsized":"2024-09-15T23:14:32.583704+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.580341+0000","last_change":"2024-09-15T23:14:32.580341+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.580341+0000","last_undegraded":"2024-09-15T23:14:32.580341+0000","last_fullsized":"2024-09-15T23:14:32.580341+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.582924+0000","last_change":"2024-09-15T23:14:32.582924+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.582924+0000","last_undegraded":"2024-09-15T23:14:32.582924+0000","last_fullsized":"2024-09-15T23:14:32.582924+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.578331+0000","last_change":"2024-09-15T23:14:32.578331+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.578331+0000","last_undegraded":"2024-09-15T23:14:32.578331+0000","last_fullsized":"2024-09-15T23:14:32.578331+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.869882+0000","last_change":"2024-09-15T23:14:33.596638+0000","last_active":"2024-09-15T23:14:34.869882+0000","last_peered":"2024-09-15T23:14:34.869882+0000","last_clean":"2024-09-15T23:14:34.869882+0000","last_became_active":"2024-09-15T23:14:33.596350+0000","last_became_peered":"2024-09-15T23:14:33.596350+0000","last_unstale":"2024-09-15T23:14:34.869882+0000","last_undegraded":"2024-09-15T23:14:34.869882+0000","last_fullsized":"2024-09-15T23:14:34.869882+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:02.724206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.598773+0000","last_change":"2024-09-15T23:14:33.608852+0000","last_active":"2024-09-15T23:14:34.598773+0000","last_peered":"2024-09-15T23:14:34.598773+0000","last_clean":"2024-09-15T23:14:34.598773+0000","last_became_active":"2024-09-15T23:14:33.608190+0000","last_became_peered":"2024-09-15T23:14:33.608190+0000","last_unstale":"2024-09-15T23:14:34.598773+0000","last_undegraded":"2024-09-15T23:14:34.598773+0000","last_fullsized":"2024-09-15T23:14:34.598773+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:12:06.375013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870523+0000","last_change":"2024-09-15T23:14:33.613017+0000","last_active":"2024-09-15T23:14:34.870523+0000","last_peered":"2024-09-15T23:14:34.870523+0000","last_clean":"2024-09-15T23:14:34.870523+0000","last_became_active":"2024-09-15T23:14:33.612686+0000","last_became_peered":"2024-09-15T23:14:33.612686+0000","last_unstale":"2024-09-15T23:14:34.870523+0000","last_undegraded":"2024-09-15T23:14:34.870523+0000","last_fullsized":"2024-09-15T23:14:34.870523+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:33:01.049973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"51'4","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870313+0000","last_change":"2024-09-15T23:14:32.594944+0000","last_active":"2024-09-15T23:14:34.870313+0000","last_peered":"2024-09-15T23:14:34.870313+0000","last_clean":"2024-09-15T23:14:34.870313+0000","last_became_active":"2024-09-15T23:14:32.594628+0000","last_became_peered":"2024-09-15T23:14:32.594628+0000","last_unstale":"2024-09-15T23:14:34.870313+0000","last_undegraded":"2024-09-15T23:14:34.870313+0000","last_fullsized":"2024-09-15T23:14:34.870313+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:50.778297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.582950+0000","last_change":"2024-09-15T23:14:32.582950+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.582950+0000","last_undegraded":"2024-09-15T23:14:32.582950+0000","last_fullsized":"2024-09-15T23:14:32.582950+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.598258+0000","last_change":"2024-09-15T23:14:32.594653+0000","last_active":"2024-09-15T23:14:32.598258+0000","last_peered":"2024-09-15T23:14:32.598258+0000","last_clean":"2024-09-15T23:14:32.598258+0000","last_became_active":"2024-09-15T23:14:32.594382+0000","last_became_peered":"2024-09-15T23:14:32.594382+0000","last_unstale":"2024-09-15T23:14:32.598258+0000","last_undegraded":"2024-09-15T23:14:32.598258+0000","last_fullsized":"2024-09-15T23:14:32.598258+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:59.858491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.580300+0000","last_change":"2024-09-15T23:14:32.580300+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.580300+0000","last_undegraded":"2024-09-15T23:14:32.580300+0000","last_fullsized":"2024-09-15T23:14:32.580300+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"51'2","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870188+0000","last_change":"2024-09-15T23:14:32.592604+0000","last_active":"2024-09-15T23:14:34.870188+0000","last_peered":"2024-09-15T23:14:34.870188+0000","last_clean":"2024-09-15T23:14:34.870188+0000","last_became_active":"2024-09-15T23:14:32.592310+0000","last_became_peered":"2024-09-15T23:14:32.592310+0000","last_unstale":"2024-09-15T23:14:34.870188+0000","last_undegraded":"2024-09-15T23:14:34.870188+0000","last_fullsized":"2024-09-15T23:14:34.870188+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:38.516357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.599290+0000","last_change":"2024-09-15T23:14:33.606518+0000","last_active":"2024-09-15T23:14:34.599290+0000","last_peered":"2024-09-15T23:14:34.599290+0000","last_clean":"2024-09-15T23:14:34.599290+0000","last_became_active":"2024-09-15T23:14:33.605858+0000","last_became_peered":"2024-09-15T23:14:33.605858+0000","last_unstale":"2024-09-15T23:14:34.599290+0000","last_undegraded":"2024-09-15T23:14:34.599290+0000","last_fullsized":"2024-09-15T23:14:34.599290+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:21:09.993053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.592639+0000","last_change":"2024-09-15T23:14:32.585437+0000","last_active":"2024-09-15T23:14:32.592639+0000","last_peered":"2024-09-15T23:14:32.592639+0000","last_clean":"2024-09-15T23:14:32.592639+0000","last_became_active":"2024-09-15T23:14:32.585165+0000","last_became_peered":"2024-09-15T23:14:32.585165+0000","last_unstale":"2024-09-15T23:14:32.592639+0000","last_undegraded":"2024-09-15T23:14:32.592639+0000","last_fullsized":"2024-09-15T23:14:32.592639+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:28.868122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.581417+0000","last_change":"2024-09-15T23:14:32.581417+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.581417+0000","last_undegraded":"2024-09-15T23:14:32.581417+0000","last_fullsized":"2024-09-15T23:14:32.581417+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"51'1","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870604+0000","last_change":"2024-09-15T23:14:32.590620+0000","last_active":"2024-09-15T23:14:34.870604+0000","last_peered":"2024-09-15T23:14:34.870604+0000","last_clean":"2024-09-15T23:14:34.870604+0000","last_became_active":"2024-09-15T23:14:32.590337+0000","last_became_peered":"2024-09-15T23:14:32.590337+0000","last_unstale":"2024-09-15T23:14:34.870604+0000","last_undegraded":"2024-09-15T23:14:34.870604+0000","last_fullsized":"2024-09-15T23:14:34.870604+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:50.416367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870487+0000","last_change":"2024-09-15T23:14:33.613593+0000","last_active":"2024-09-15T23:14:34.870487+0000","last_peered":"2024-09-15T23:14:34.870487+0000","last_clean":"2024-09-15T23:14:34.870487+0000","last_became_active":"2024-09-15T23:14:33.613330+0000","last_became_peered":"2024-09-15T23:14:33.613330+0000","last_unstale":"2024-09-15T23:14:34.870487+0000","last_undegraded":"2024-09-15T23:14:34.870487+0000","last_fullsized":"2024-09-15T23:14:34.870487+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:16.790009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.592668+0000","last_change":"2024-09-15T23:14:32.586162+0000","last_active":"2024-09-15T23:14:32.592668+0000","last_peered":"2024-09-15T23:14:32.592668+0000","last_clean":"2024-09-15T23:14:32.592668+0000","last_became_active":"2024-09-15T23:14:32.585885+0000","last_became_peered":"2024-09-15T23:14:32.585885+0000","last_unstale":"2024-09-15T23:14:32.592668+0000","last_undegraded":"2024-09-15T23:14:32.592668+0000","last_fullsized":"2024-09-15T23:14:32.592668+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:13:57.451903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.869756+0000","last_change":"2024-09-15T23:14:33.605072+0000","last_active":"2024-09-15T23:14:34.869756+0000","last_peered":"2024-09-15T23:14:34.869756+0000","last_clean":"2024-09-15T23:14:34.869756+0000","last_became_active":"2024-09-15T23:14:33.604220+0000","last_became_peered":"2024-09-15T23:14:33.604220+0000","last_unstale":"2024-09-15T23:14:34.869756+0000","last_undegraded":"2024-09-15T23:14:34.869756+0000","last_fullsized":"2024-09-15T23:14:34.869756+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:28:08.700705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.600783+0000","last_change":"2024-09-15T23:14:32.598430+0000","last_active":"2024-09-15T23:14:32.600783+0000","last_peered":"2024-09-15T23:14:32.600783+0000","last_clean":"2024-09-15T23:14:32.600783+0000","last_became_active":"2024-09-15T23:14:32.598047+0000","last_became_peered":"2024-09-15T23:14:32.598047+0000","last_unstale":"2024-09-15T23:14:32.600783+0000","last_undegraded":"2024-09-15T23:14:32.600783+0000","last_fullsized":"2024-09-15T23:14:32.600783+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:48:25.091467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.582384+0000","last_change":"2024-09-15T23:14:32.582384+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.582384+0000","last_undegraded":"2024-09-15T23:14:32.582384+0000","last_fullsized":"2024-09-15T23:14:32.582384+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870413+0000","last_change":"2024-09-15T23:14:32.599198+0000","last_active":"2024-09-15T23:14:34.870413+0000","last_peered":"2024-09-15T23:14:34.870413+0000","last_clean":"2024-09-15T23:14:34.870413+0000","last_became_active":"2024-09-15T23:14:32.598893+0000","last_became_peered":"2024-09-15T23:14:32.598893+0000","last_unstale":"2024-09-15T23:14:34.870413+0000","last_undegraded":"2024-09-15T23:14:34.870413+0000","last_fullsized":"2024-09-15T23:14:34.870413+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:24.096237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.584834+0000","last_change":"2024-09-15T23:14:32.584834+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.584834+0000","last_undegraded":"2024-09-15T23:14:32.584834+0000","last_fullsized":"2024-09-15T23:14:32.584834+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.594053+0000","last_change":"2024-09-15T23:14:32.591483+0000","last_active":"2024-09-15T23:14:32.594053+0000","last_peered":"2024-09-15T23:14:32.594053+0000","last_clean":"2024-09-15T23:14:32.594053+0000","last_became_active":"2024-09-15T23:14:32.591161+0000","last_became_peered":"2024-09-15T23:14:32.591161+0000","last_unstale":"2024-09-15T23:14:32.594053+0000","last_undegraded":"2024-09-15T23:14:32.594053+0000","last_fullsized":"2024-09-15T23:14:32.594053+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:54.131329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.583113+0000","last_change":"2024-09-15T23:14:32.583113+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.583113+0000","last_undegraded":"2024-09-15T23:14:32.583113+0000","last_fullsized":"2024-09-15T23:14:32.583113+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870542+0000","last_change":"2024-09-15T23:14:32.596138+0000","last_active":"2024-09-15T23:14:34.870542+0000","last_peered":"2024-09-15T23:14:34.870542+0000","last_clean":"2024-09-15T23:14:34.870542+0000","last_became_active":"2024-09-15T23:14:32.595823+0000","last_became_peered":"2024-09-15T23:14:32.595823+0000","last_unstale":"2024-09-15T23:14:34.870542+0000","last_undegraded":"2024-09-15T23:14:34.870542+0000","last_fullsized":"2024-09-15T23:14:34.870542+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:58.984248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.599217+0000","last_change":"2024-09-15T23:14:33.619533+0000","last_active":"2024-09-15T23:14:34.599217+0000","last_peered":"2024-09-15T23:14:34.599217+0000","last_clean":"2024-09-15T23:14:34.599217+0000","last_became_active":"2024-09-15T23:14:33.619229+0000","last_became_peered":"2024-09-15T23:14:33.619229+0000","last_unstale":"2024-09-15T23:14:34.599217+0000","last_undegraded":"2024-09-15T23:14:34.599217+0000","last_fullsized":"2024-09-15T23:14:34.599217+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:04:40.431817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.592716+0000","last_change":"2024-09-15T23:14:32.589177+0000","last_active":"2024-09-15T23:14:32.592716+0000","last_peered":"2024-09-15T23:14:32.592716+0000","last_clean":"2024-09-15T23:14:32.592716+0000","last_became_active":"2024-09-15T23:14:32.588881+0000","last_became_peered":"2024-09-15T23:14:32.588881+0000","last_unstale":"2024-09-15T23:14:32.592716+0000","last_undegraded":"2024-09-15T23:14:32.592716+0000","last_fullsized":"2024-09-15T23:14:32.592716+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:50.416367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.583301+0000","last_change":"2024-09-15T23:14:32.583301+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.583301+0000","last_undegraded":"2024-09-15T23:14:32.583301+0000","last_fullsized":"2024-09-15T23:14:32.583301+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"51'6","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870817+0000","last_change":"2024-09-15T23:14:32.594594+0000","last_active":"2024-09-15T23:14:34.870817+0000","last_peered":"2024-09-15T23:14:34.870817+0000","last_clean":"2024-09-15T23:14:34.870817+0000","last_became_active":"2024-09-15T23:14:32.594344+0000","last_became_peered":"2024-09-15T23:14:32.594344+0000","last_unstale":"2024-09-15T23:14:34.870817+0000","last_undegraded":"2024-09-15T23:14:34.870817+0000","last_fullsized":"2024-09-15T23:14:34.870817+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:05:43.438947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.584102+0000","last_change":"2024-09-15T23:14:32.584102+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.584102+0000","last_undegraded":"2024-09-15T23:14:32.584102+0000","last_fullsized":"2024-09-15T23:14:32.584102+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"51'2","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870315+0000","last_change":"2024-09-15T23:14:32.591239+0000","last_active":"2024-09-15T23:14:34.870315+0000","last_peered":"2024-09-15T23:14:34.870315+0000","last_clean":"2024-09-15T23:14:34.870315+0000","last_became_active":"2024-09-15T23:14:32.590754+0000","last_became_peered":"2024-09-15T23:14:32.590754+0000","last_unstale":"2024-09-15T23:14:34.870315+0000","last_undegraded":"2024-09-15T23:14:34.870315+0000","last_fullsized":"2024-09-15T23:14:34.870315+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:35.275646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870186+0000","last_change":"2024-09-15T23:14:33.598138+0000","last_active":"2024-09-15T23:14:34.870186+0000","last_peered":"2024-09-15T23:14:34.870186+0000","last_clean":"2024-09-15T23:14:34.870186+0000","last_became_active":"2024-09-15T23:14:33.597852+0000","last_became_peered":"2024-09-15T23:14:33.597852+0000","last_unstale":"2024-09-15T23:14:34.870186+0000","last_undegraded":"2024-09-15T23:14:34.870186+0000","last_fullsized":"2024-09-15T23:14:34.870186+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:59.153492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.594573+0000","last_change":"2024-09-15T23:14:32.588678+0000","last_active":"2024-09-15T23:14:32.594573+0000","last_peered":"2024-09-15T23:14:32.594573+0000","last_clean":"2024-09-15T23:14:32.594573+0000","last_became_active":"2024-09-15T23:14:32.588365+0000","last_became_peered":"2024-09-15T23:14:32.588365+0000","last_unstale":"2024-09-15T23:14:32.594573+0000","last_undegraded":"2024-09-15T23:14:32.594573+0000","last_fullsized":"2024-09-15T23:14:32.594573+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:50.416367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.869933+0000","last_change":"2024-09-15T23:14:33.606355+0000","last_active":"2024-09-15T23:14:34.869933+0000","last_peered":"2024-09-15T23:14:34.869933+0000","last_clean":"2024-09-15T23:14:34.869933+0000","last_became_active":"2024-09-15T23:14:33.606057+0000","last_became_peered":"2024-09-15T23:14:33.606057+0000","last_unstale":"2024-09-15T23:14:34.869933+0000","last_undegraded":"2024-09-15T23:14:34.869933+0000","last_fullsized":"2024-09-15T23:14:34.869933+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:40.113827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.869897+0000","last_change":"2024-09-15T23:14:32.593180+0000","last_active":"2024-09-15T23:14:34.869897+0000","last_peered":"2024-09-15T23:14:34.869897+0000","last_clean":"2024-09-15T23:14:34.869897+0000","last_became_active":"2024-09-15T23:14:32.592930+0000","last_became_peered":"2024-09-15T23:14:32.592930+0000","last_unstale":"2024-09-15T23:14:34.869897+0000","last_undegraded":"2024-09-15T23:14:34.869897+0000","last_fullsized":"2024-09-15T23:14:34.869897+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:33.716879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.580862+0000","last_change":"2024-09-15T23:14:32.580862+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.580862+0000","last_undegraded":"2024-09-15T23:14:32.580862+0000","last_fullsized":"2024-09-15T23:14:32.580862+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"51'8","reported_seq":22,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.869885+0000","last_change":"2024-09-15T23:14:32.594226+0000","last_active":"2024-09-15T23:14:34.869885+0000","last_peered":"2024-09-15T23:14:34.869885+0000","last_clean":"2024-09-15T23:14:34.869885+0000","last_became_active":"2024-09-15T23:14:32.593694+0000","last_became_peered":"2024-09-15T23:14:32.593694+0000","last_unstale":"2024-09-15T23:14:34.869885+0000","last_undegraded":"2024-09-15T23:14:34.869885+0000","last_fullsized":"2024-09-15T23:14:34.869885+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:04:39.427595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870664+0000","last_change":"2024-09-15T23:14:33.597118+0000","last_active":"2024-09-15T23:14:34.870664+0000","last_peered":"2024-09-15T23:14:34.870664+0000","last_clean":"2024-09-15T23:14:34.870664+0000","last_became_active":"2024-09-15T23:14:33.596748+0000","last_became_peered":"2024-09-15T23:14:33.596748+0000","last_unstale":"2024-09-15T23:14:34.870664+0000","last_undegraded":"2024-09-15T23:14:34.870664+0000","last_fullsized":"2024-09-15T23:14:34.870664+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:33:01.396335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"51'1","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.599258+0000","last_change":"2024-09-15T23:14:32.598464+0000","last_active":"2024-09-15T23:14:34.599258+0000","last_peered":"2024-09-15T23:14:34.599258+0000","last_clean":"2024-09-15T23:14:34.599258+0000","last_became_active":"2024-09-15T23:14:32.598145+0000","last_became_peered":"2024-09-15T23:14:32.598145+0000","last_unstale":"2024-09-15T23:14:34.599258+0000","last_undegraded":"2024-09-15T23:14:34.599258+0000","last_fullsized":"2024-09-15T23:14:34.599258+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:04.474623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870621+0000","last_change":"2024-09-15T23:14:33.608122+0000","last_active":"2024-09-15T23:14:34.870621+0000","last_peered":"2024-09-15T23:14:34.870621+0000","last_clean":"2024-09-15T23:14:34.870621+0000","last_became_active":"2024-09-15T23:14:33.607852+0000","last_became_peered":"2024-09-15T23:14:33.607852+0000","last_unstale":"2024-09-15T23:14:34.870621+0000","last_undegraded":"2024-09-15T23:14:34.870621+0000","last_fullsized":"2024-09-15T23:14:34.870621+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:14:33.024587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.595437+0000","last_change":"2024-09-15T23:14:32.592365+0000","last_active":"2024-09-15T23:14:32.595437+0000","last_peered":"2024-09-15T23:14:32.595437+0000","last_clean":"2024-09-15T23:14:32.595437+0000","last_became_active":"2024-09-15T23:14:32.592065+0000","last_became_peered":"2024-09-15T23:14:32.592065+0000","last_unstale":"2024-09-15T23:14:32.595437+0000","last_undegraded":"2024-09-15T23:14:32.595437+0000","last_fullsized":"2024-09-15T23:14:32.595437+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:01:18.880556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.579913+0000","last_change":"2024-09-15T23:14:32.579913+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.579913+0000","last_undegraded":"2024-09-15T23:14:32.579913+0000","last_fullsized":"2024-09-15T23:14:32.579913+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.596459+0000","last_change":"2024-09-15T23:14:32.593146+0000","last_active":"2024-09-15T23:14:32.596459+0000","last_peered":"2024-09-15T23:14:32.596459+0000","last_clean":"2024-09-15T23:14:32.596459+0000","last_became_active":"2024-09-15T23:14:32.592889+0000","last_became_peered":"2024-09-15T23:14:32.592889+0000","last_unstale":"2024-09-15T23:14:32.596459+0000","last_undegraded":"2024-09-15T23:14:32.596459+0000","last_fullsized":"2024-09-15T23:14:32.596459+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:14.192942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.586158+0000","last_change":"2024-09-15T23:14:32.586158+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.586158+0000","last_undegraded":"2024-09-15T23:14:32.586158+0000","last_fullsized":"2024-09-15T23:14:32.586158+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870961+0000","last_change":"2024-09-15T23:14:32.593808+0000","last_active":"2024-09-15T23:14:34.870961+0000","last_peered":"2024-09-15T23:14:34.870961+0000","last_clean":"2024-09-15T23:14:34.870961+0000","last_became_active":"2024-09-15T23:14:32.593493+0000","last_became_peered":"2024-09-15T23:14:32.593493+0000","last_unstale":"2024-09-15T23:14:34.870961+0000","last_undegraded":"2024-09-15T23:14:34.870961+0000","last_fullsized":"2024-09-15T23:14:34.870961+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:01:33.975383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.869950+0000","last_change":"2024-09-15T23:14:33.604826+0000","last_active":"2024-09-15T23:14:34.869950+0000","last_peered":"2024-09-15T23:14:34.869950+0000","last_clean":"2024-09-15T23:14:34.869950+0000","last_became_active":"2024-09-15T23:14:33.604515+0000","last_became_peered":"2024-09-15T23:14:33.604515+0000","last_unstale":"2024-09-15T23:14:34.869950+0000","last_undegraded":"2024-09-15T23:14:34.869950+0000","last_fullsized":"2024-09-15T23:14:34.869950+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:24.873653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"51'2","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870601+0000","last_change":"2024-09-15T23:14:32.596303+0000","last_active":"2024-09-15T23:14:34.870601+0000","last_peered":"2024-09-15T23:14:34.870601+0000","last_clean":"2024-09-15T23:14:34.870601+0000","last_became_active":"2024-09-15T23:14:32.595965+0000","last_became_peered":"2024-09-15T23:14:32.595965+0000","last_unstale":"2024-09-15T23:14:34.870601+0000","last_undegraded":"2024-09-15T23:14:34.870601+0000","last_fullsized":"2024-09-15T23:14:34.870601+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:29.253340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870498+0000","last_change":"2024-09-15T23:14:33.598114+0000","last_active":"2024-09-15T23:14:34.870498+0000","last_peered":"2024-09-15T23:14:34.870498+0000","last_clean":"2024-09-15T23:14:34.870498+0000","last_became_active":"2024-09-15T23:14:33.597762+0000","last_became_peered":"2024-09-15T23:14:33.597762+0000","last_unstale":"2024-09-15T23:14:34.870498+0000","last_undegraded":"2024-09-15T23:14:34.870498+0000","last_fullsized":"2024-09-15T23:14:34.870498+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:34:03.998649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.594609+0000","last_change":"2024-09-15T23:14:32.589067+0000","last_active":"2024-09-15T23:14:32.594609+0000","last_peered":"2024-09-15T23:14:32.594609+0000","last_clean":"2024-09-15T23:14:32.594609+0000","last_became_active":"2024-09-15T23:14:32.588791+0000","last_became_peered":"2024-09-15T23:14:32.588791+0000","last_unstale":"2024-09-15T23:14:32.594609+0000","last_undegraded":"2024-09-15T23:14:32.594609+0000","last_fullsized":"2024-09-15T23:14:32.594609+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:12:56.537897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.599058+0000","last_change":"2024-09-15T23:14:33.613028+0000","last_active":"2024-09-15T23:14:34.599058+0000","last_peered":"2024-09-15T23:14:34.599058+0000","last_clean":"2024-09-15T23:14:34.599058+0000","last_became_active":"2024-09-15T23:14:33.611983+0000","last_became_peered":"2024-09-15T23:14:33.611983+0000","last_unstale":"2024-09-15T23:14:34.599058+0000","last_undegraded":"2024-09-15T23:14:34.599058+0000","last_fullsized":"2024-09-15T23:14:34.599058+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:59.988471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.869825+0000","last_change":"2024-09-15T23:14:32.595982+0000","last_active":"2024-09-15T23:14:34.869825+0000","last_peered":"2024-09-15T23:14:34.869825+0000","last_clean":"2024-09-15T23:14:34.869825+0000","last_became_active":"2024-09-15T23:14:32.595688+0000","last_became_peered":"2024-09-15T23:14:32.595688+0000","last_unstale":"2024-09-15T23:14:34.869825+0000","last_undegraded":"2024-09-15T23:14:34.869825+0000","last_fullsized":"2024-09-15T23:14:34.869825+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:32.950554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.598777+0000","last_change":"2024-09-15T23:14:33.616040+0000","last_active":"2024-09-15T23:14:34.598777+0000","last_peered":"2024-09-15T23:14:34.598777+0000","last_clean":"2024-09-15T23:14:34.598777+0000","last_became_active":"2024-09-15T23:14:33.615753+0000","last_became_peered":"2024-09-15T23:14:33.615753+0000","last_unstale":"2024-09-15T23:14:34.598777+0000","last_undegraded":"2024-09-15T23:14:34.598777+0000","last_fullsized":"2024-09-15T23:14:34.598777+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:54.178061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.592644+0000","last_change":"2024-09-15T23:14:32.591067+0000","last_active":"2024-09-15T23:14:32.592644+0000","last_peered":"2024-09-15T23:14:32.592644+0000","last_clean":"2024-09-15T23:14:32.592644+0000","last_became_active":"2024-09-15T23:14:32.590787+0000","last_became_peered":"2024-09-15T23:14:32.590787+0000","last_unstale":"2024-09-15T23:14:32.592644+0000","last_undegraded":"2024-09-15T23:14:32.592644+0000","last_fullsized":"2024-09-15T23:14:32.592644+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:35.886415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.581036+0000","last_change":"2024-09-15T23:14:32.581036+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.581036+0000","last_undegraded":"2024-09-15T23:14:32.581036+0000","last_fullsized":"2024-09-15T23:14:32.581036+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"52'1","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.600656+0000","last_change":"2024-09-15T23:14:32.598482+0000","last_active":"2024-09-15T23:14:34.600656+0000","last_peered":"2024-09-15T23:14:34.600656+0000","last_clean":"2024-09-15T23:14:34.600656+0000","last_became_active":"2024-09-15T23:14:32.598103+0000","last_became_peered":"2024-09-15T23:14:32.598103+0000","last_unstale":"2024-09-15T23:14:34.600656+0000","last_undegraded":"2024-09-15T23:14:34.600656+0000","last_fullsized":"2024-09-15T23:14:34.600656+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:53.611115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870796+0000","last_change":"2024-09-15T23:14:33.611352+0000","last_active":"2024-09-15T23:14:34.870796+0000","last_peered":"2024-09-15T23:14:34.870796+0000","last_clean":"2024-09-15T23:14:34.870796+0000","last_became_active":"2024-09-15T23:14:33.604202+0000","last_became_peered":"2024-09-15T23:14:33.604202+0000","last_unstale":"2024-09-15T23:14:34.870796+0000","last_undegraded":"2024-09-15T23:14:34.870796+0000","last_fullsized":"2024-09-15T23:14:34.870796+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:51:52.572026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.594639+0000","last_change":"2024-09-15T23:14:32.593219+0000","last_active":"2024-09-15T23:14:32.594639+0000","last_peered":"2024-09-15T23:14:32.594639+0000","last_clean":"2024-09-15T23:14:32.594639+0000","last_became_active":"2024-09-15T23:14:32.592950+0000","last_became_peered":"2024-09-15T23:14:32.592950+0000","last_unstale":"2024-09-15T23:14:32.594639+0000","last_undegraded":"2024-09-15T23:14:32.594639+0000","last_fullsized":"2024-09-15T23:14:32.594639+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:38.090058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.582808+0000","last_change":"2024-09-15T23:14:32.582808+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.582808+0000","last_undegraded":"2024-09-15T23:14:32.582808+0000","last_fullsized":"2024-09-15T23:14:32.582808+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870370+0000","last_change":"2024-09-15T23:14:32.591220+0000","last_active":"2024-09-15T23:14:34.870370+0000","last_peered":"2024-09-15T23:14:34.870370+0000","last_clean":"2024-09-15T23:14:34.870370+0000","last_became_active":"2024-09-15T23:14:32.590921+0000","last_became_peered":"2024-09-15T23:14:32.590921+0000","last_unstale":"2024-09-15T23:14:34.870370+0000","last_undegraded":"2024-09-15T23:14:34.870370+0000","last_fullsized":"2024-09-15T23:14:34.870370+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:15:08.197312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870491+0000","last_change":"2024-09-15T23:14:33.604651+0000","last_active":"2024-09-15T23:14:34.870491+0000","last_peered":"2024-09-15T23:14:34.870491+0000","last_clean":"2024-09-15T23:14:34.870491+0000","last_became_active":"2024-09-15T23:14:33.604293+0000","last_became_peered":"2024-09-15T23:14:33.604293+0000","last_unstale":"2024-09-15T23:14:34.870491+0000","last_undegraded":"2024-09-15T23:14:34.870491+0000","last_fullsized":"2024-09-15T23:14:34.870491+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:35:55.174184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.600780+0000","last_change":"2024-09-15T23:14:32.598334+0000","last_active":"2024-09-15T23:14:32.600780+0000","last_peered":"2024-09-15T23:14:32.600780+0000","last_clean":"2024-09-15T23:14:32.600780+0000","last_became_active":"2024-09-15T23:14:32.598002+0000","last_became_peered":"2024-09-15T23:14:32.598002+0000","last_unstale":"2024-09-15T23:14:32.600780+0000","last_undegraded":"2024-09-15T23:14:32.600780+0000","last_fullsized":"2024-09-15T23:14:32.600780+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:33.040494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.598948+0000","last_change":"2024-09-15T23:14:33.613973+0000","last_active":"2024-09-15T23:14:34.598948+0000","last_peered":"2024-09-15T23:14:34.598948+0000","last_clean":"2024-09-15T23:14:34.598948+0000","last_became_active":"2024-09-15T23:14:33.613716+0000","last_became_peered":"2024-09-15T23:14:33.613716+0000","last_unstale":"2024-09-15T23:14:34.598948+0000","last_undegraded":"2024-09-15T23:14:34.598948+0000","last_fullsized":"2024-09-15T23:14:34.598948+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:33.954777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.592996+0000","last_change":"2024-09-15T23:14:32.591944+0000","last_active":"2024-09-15T23:14:32.592996+0000","last_peered":"2024-09-15T23:14:32.592996+0000","last_clean":"2024-09-15T23:14:32.592996+0000","last_became_active":"2024-09-15T23:14:32.591681+0000","last_became_peered":"2024-09-15T23:14:32.591681+0000","last_unstale":"2024-09-15T23:14:32.592996+0000","last_undegraded":"2024-09-15T23:14:32.592996+0000","last_fullsized":"2024-09-15T23:14:32.592996+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:33.623411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.583903+0000","last_change":"2024-09-15T23:14:32.583903+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.583903+0000","last_undegraded":"2024-09-15T23:14:32.583903+0000","last_fullsized":"2024-09-15T23:14:32.583903+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870001+0000","last_change":"2024-09-15T23:14:32.594660+0000","last_active":"2024-09-15T23:14:34.870001+0000","last_peered":"2024-09-15T23:14:34.870001+0000","last_clean":"2024-09-15T23:14:34.870001+0000","last_became_active":"2024-09-15T23:14:32.594416+0000","last_became_peered":"2024-09-15T23:14:32.594416+0000","last_unstale":"2024-09-15T23:14:34.870001+0000","last_undegraded":"2024-09-15T23:14:34.870001+0000","last_fullsized":"2024-09-15T23:14:34.870001+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:36.324104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-09-15T23:14:32.579757+0000","last_change":"2024-09-15T23:14:32.579757+0000","last_active":"2024-09-15T23:14:32.573018+0000","last_peered":"2024-09-15T23:14:32.573018+0000","last_clean":"2024-09-15T23:14:32.573018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:14:32.579757+0000","last_undegraded":"2024-09-15T23:14:32.579757+0000","last_fullsized":"2024-09-15T23:14:32.579757+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870730+0000","last_change":"2024-09-15T23:14:32.592678+0000","last_active":"2024-09-15T23:14:34.870730+0000","last_peered":"2024-09-15T23:14:34.870730+0000","last_clean":"2024-09-15T23:14:34.870730+0000","last_became_active":"2024-09-15T23:14:32.592382+0000","last_became_peered":"2024-09-15T23:14:32.592382+0000","last_unstale":"2024-09-15T23:14:34.870730+0000","last_undegraded":"2024-09-15T23:14:34.870730+0000","last_fullsized":"2024-09-15T23:14:34.870730+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:59.169628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.599145+0000","last_change":"2024-09-15T23:14:33.611152+0000","last_active":"2024-09-15T23:14:34.599145+0000","last_peered":"2024-09-15T23:14:34.599145+0000","last_clean":"2024-09-15T23:14:34.599145+0000","last_became_active":"2024-09-15T23:14:33.610807+0000","last_became_peered":"2024-09-15T23:14:33.610807+0000","last_unstale":"2024-09-15T23:14:34.599145+0000","last_undegraded":"2024-09-15T23:14:34.599145+0000","last_fullsized":"2024-09-15T23:14:34.599145+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:25.100460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.600807+0000","last_change":"2024-09-15T23:14:32.599246+0000","last_active":"2024-09-15T23:14:32.600807+0000","last_peered":"2024-09-15T23:14:32.600807+0000","last_clean":"2024-09-15T23:14:32.600807+0000","last_became_active":"2024-09-15T23:14:32.598890+0000","last_became_peered":"2024-09-15T23:14:32.598890+0000","last_unstale":"2024-09-15T23:14:32.600807+0000","last_undegraded":"2024-09-15T23:14:32.600807+0000","last_fullsized":"2024-09-15T23:14:32.600807+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:55.095937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":223,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T23:14:32.584109+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:14:32.584109+0000","last_peered":"2024-09-15T23:14:32.584109+0000","last_clean":"2024-09-15T23:14:32.584109+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:14:32.584109+0000","last_undegraded":"2024-09-15T23:14:32.584109+0000","last_fullsized":"2024-09-15T23:14:32.584109+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2250,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":27,"ondisk_log_size":27,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476772,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35916,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335924,"statfs":{"total":96636764160,"available":96599986176,"internally_reserved":0,"allocated":577536,"data_stored":238730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476769,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35920,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335920,"statfs":{"total":96636764160,"available":96599982080,"internally_reserved":0,"allocated":577536,"data_stored":238730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476771,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36496,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335344,"statfs":{"total":96636764160,"available":96599392256,"internally_reserved":0,"allocated":1171456,"data_stored":829098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476771,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31760,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340080,"statfs":{"total":96636764160,"available":96604241920,"internally_reserved":0,"allocated":577536,"data_stored":238730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542178,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35948,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335892,"statfs":{"total":96636764160,"available":96599953408,"internally_reserved":0,"allocated":606208,"data_stored":251839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542178,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35952,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335888,"statfs":{"total":96636764160,"available":96599949312,"internally_reserved":0,"allocated":610304,"data_stored":252421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542177,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36520,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335320,"statfs":{"total":96636764160,"available":96599367680,"internally_reserved":0,"allocated":1200128,"data_stored":842195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542179,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35960,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335880,"statfs":{"total":96636764160,"available":96599941120,"internally_reserved":0,"allocated":622592,"data_stored":253509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:14:41.533 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:14:41.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.645+0000 7f8ab0f31640 1 Processor -- start 2024-09-15T23:14:41.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.645+0000 7f8ab0f31640 1 -- start start 2024-09-15T23:14:41.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.646+0000 7f8ab0f31640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8aac0b6970 0x7f8aac0b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:41.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.646+0000 7f8ab0f31640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f8aac0d23b0 0x7f8aac0b8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:41.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.646+0000 7f8ab0f31640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8aac0d0e70 con 0x7f8aac15ed20 2024-09-15T23:14:41.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.646+0000 7f8ab0f31640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f8aac0d41c0 con 0x7f8aac0b6970 2024-09-15T23:14:41.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.646+0000 7f8ab0f31640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f8aac0d35b0 con 0x7f8aac0d23b0 2024-09-15T23:14:41.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.647+0000 7f8aa9d9b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8aac0b6970 0x7f8aac0b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:41.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.647+0000 7f8aaa59c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8aac15ed20 0x7f8aac0b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:57460/0 (socket says 172.21.15.123:57460) 2024-09-15T23:14:41.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.647+0000 7f8aaa59c640 1 -- 172.21.15.123:0/518518306 learned_addr learned my addr 172.21.15.123:0/518518306 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:41.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.647+0000 7f8aaad9d640 1 --2- 172.21.15.123:0/518518306 >> v2:172.21.15.188:3300/0 conn(0x7f8aac0d23b0 0x7f8aac0b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:41.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.647+0000 7f8aa9d9b640 1 -- 172.21.15.123:0/518518306 >> v2:172.21.15.188:3300/0 conn(0x7f8aac0d23b0 msgr2=0x7f8aac0b8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:41.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.647+0000 7f8aa9d9b640 1 --2- 172.21.15.123:0/518518306 >> v2:172.21.15.188:3300/0 conn(0x7f8aac0d23b0 0x7f8aac0b8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:41.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.647+0000 7f8aa9d9b640 1 -- 172.21.15.123:0/518518306 >> v1:172.21.15.123:6789/0 conn(0x7f8aac15ed20 legacy=0x7f8aac0b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:41.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.647+0000 7f8aa9d9b640 1 -- 172.21.15.123:0/518518306 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aac0d3890 con 0x7f8aac0b6970 2024-09-15T23:14:41.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.647+0000 7f8aa959a640 1 -- 172.21.15.123:0/518518306 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1441069250 0 0) 0x7f8a9c001110 con 0x7f8aac15ed20 2024-09-15T23:14:41.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.648+0000 7f8aa9d9b640 1 --2- 172.21.15.123:0/518518306 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8aac0b6970 0x7f8aac0b80d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0d4130 tx=0x7f8aa002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fce544f46ca765a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:41.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.648+0000 7f8aa959a640 1 -- 172.21.15.123:0/518518306 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa0037070 con 0x7f8aac0b6970 2024-09-15T23:14:41.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.648+0000 7f8aa959a640 1 -- 172.21.15.123:0/518518306 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa0032440 con 0x7f8aac0b6970 2024-09-15T23:14:41.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.648+0000 7f8aa959a640 1 -- 172.21.15.123:0/518518306 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa002ae60 con 0x7f8aac0b6970 2024-09-15T23:14:41.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.648+0000 7f8ab0f31640 1 -- 172.21.15.123:0/518518306 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8aac0b6970 msgr2=0x7f8aac0b80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:41.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.648+0000 7f8ab0f31640 1 --2- 172.21.15.123:0/518518306 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8aac0b6970 0x7f8aac0b80d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0d4130 tx=0x7f8aa002a110 comp rx=0 tx=0).stop 2024-09-15T23:14:41.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.648+0000 7f8ab0f31640 1 -- 172.21.15.123:0/518518306 shutdown_connections 2024-09-15T23:14:41.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.648+0000 7f8ab0f31640 1 --2- 172.21.15.123:0/518518306 >> v2:172.21.15.188:3300/0 conn(0x7f8aac0d23b0 0x7f8aac0b8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:41.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.648+0000 7f8ab0f31640 1 --2- 172.21.15.123:0/518518306 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8aac0b6970 0x7f8aac0b80d0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:41.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.648+0000 7f8ab0f31640 1 -- 172.21.15.123:0/518518306 >> 172.21.15.123:0/518518306 conn(0x7f8aac0d1260 msgr2=0x7f8aac0d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:41.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.649+0000 7f8ab0f31640 1 -- 172.21.15.123:0/518518306 shutdown_connections 2024-09-15T23:14:41.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.649+0000 7f8ab0f31640 1 -- 172.21.15.123:0/518518306 wait complete. 2024-09-15T23:14:41.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.650+0000 7f8ab0f31640 1 Processor -- start 2024-09-15T23:14:41.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.650+0000 7f8ab0f31640 1 -- start start 2024-09-15T23:14:41.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.651+0000 7f8ab0f31640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8aac0b6970 0x7f8aac154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:41.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.651+0000 7f8ab0f31640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8aac0d23b0 0x7f8aac15b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:41.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.651+0000 7f8ab0f31640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8aac15ed20 0x7f8aac15b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:41.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.651+0000 7f8ab0f31640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac0d32a0 con 0x7f8aac0b6970 2024-09-15T23:14:41.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.651+0000 7f8ab0f31640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac0d3e50 con 0x7f8aac15ed20 2024-09-15T23:14:41.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.651+0000 7f8ab0f31640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8aac15f100 con 0x7f8aac0d23b0 2024-09-15T23:14:41.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.651+0000 7f8aaa59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8aac0b6970 0x7f8aac154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:41.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.651+0000 7f8aaa59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8aac0b6970 0x7f8aac154d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51710/0 (socket says 172.21.15.123:51710) 2024-09-15T23:14:41.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.651+0000 7f8aaa59c640 1 -- 172.21.15.123:0/1093678474 learned_addr learned my addr 172.21.15.123:0/1093678474 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:41.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.651+0000 7f8aaad9d640 1 --2- 172.21.15.123:0/1093678474 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8aac15ed20 0x7f8aac15b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:41.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.651+0000 7f8aa9d9b640 1 --2- 172.21.15.123:0/1093678474 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8aac0d23b0 0x7f8aac15b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:41.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.651+0000 7f8aaa59c640 1 -- 172.21.15.123:0/1093678474 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8aac0d23b0 msgr2=0x7f8aac15b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:41.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.651+0000 7f8aaa59c640 1 --2- 172.21.15.123:0/1093678474 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8aac0d23b0 0x7f8aac15b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:41.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.651+0000 7f8aaa59c640 1 -- 172.21.15.123:0/1093678474 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8aac15ed20 msgr2=0x7f8aac15b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:41.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.651+0000 7f8aaa59c640 1 --2- 172.21.15.123:0/1093678474 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8aac15ed20 0x7f8aac15b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:41.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.651+0000 7f8aaa59c640 1 -- 172.21.15.123:0/1093678474 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aac158f10 con 0x7f8aac0b6970 2024-09-15T23:14:41.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.651+0000 7f8aaa59c640 1 --2- 172.21.15.123:0/1093678474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8aac0b6970 0x7f8aac154d60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c00c780 tx=0x7f8a9c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:41.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.651+0000 7f8a9affd640 1 -- 172.21.15.123:0/1093678474 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c018070 con 0x7f8aac0b6970 2024-09-15T23:14:41.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.651+0000 7f8a9affd640 1 -- 172.21.15.123:0/1093678474 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a9c0072d0 con 0x7f8aac0b6970 2024-09-15T23:14:41.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.651+0000 7f8ab0f31640 1 -- 172.21.15.123:0/1093678474 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8aac0ce0c0 con 0x7f8aac0b6970 2024-09-15T23:14:41.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.651+0000 7f8a9affd640 1 -- 172.21.15.123:0/1093678474 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c0047e0 con 0x7f8aac0b6970 2024-09-15T23:14:41.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.652+0000 7f8ab0f31640 1 -- 172.21.15.123:0/1093678474 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8aac1591b0 con 0x7f8aac0b6970 2024-09-15T23:14:41.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.652+0000 7f8ab0f31640 1 -- 172.21.15.123:0/1093678474 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8aac0d0490 con 0x7f8aac0b6970 2024-09-15T23:14:41.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.653+0000 7f8a9affd640 1 -- 172.21.15.123:0/1093678474 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8a9c01b070 con 0x7f8aac0b6970 2024-09-15T23:14:41.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.653+0000 7f8a9affd640 1 --2- 172.21.15.123:0/1093678474 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8a8c06c2b0 0x7f8a8c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:41.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.653+0000 7f8a9affd640 1 -- 172.21.15.123:0/1093678474 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7f8a9c08a6b0 con 0x7f8aac0b6970 2024-09-15T23:14:41.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.654+0000 7f8aa9d9b640 1 --2- 172.21.15.123:0/1093678474 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8a8c06c2b0 0x7f8a8c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:41.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.654+0000 7f8aa9d9b640 1 --2- 172.21.15.123:0/1093678474 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8a8c06c2b0 0x7f8a8c06e770 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0034000 tx=0x7f8aa002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:41.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.658+0000 7f8a9affd640 1 -- 172.21.15.123:0/1093678474 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8aac0d0490 con 0x7f8aac0b6970 2024-09-15T23:14:41.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.821+0000 7f8ab0f31640 1 -- 172.21.15.123:0/1093678474 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8aac0b7010 con 0x7f8a8c06c2b0 2024-09-15T23:14:41.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.827+0000 7f8a9affd640 1 -- 172.21.15.123:0/1093678474 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251907 (secure 0 0 0) 0x7f8aac0b7010 con 0x7f8a8c06c2b0 2024-09-15T23:14:41.829 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:14:41.834 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:14:41.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.830+0000 7f8ab0f31640 1 -- 172.21.15.123:0/1093678474 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8a8c06c2b0 msgr2=0x7f8a8c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:41.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.830+0000 7f8ab0f31640 1 --2- 172.21.15.123:0/1093678474 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8a8c06c2b0 0x7f8a8c06e770 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0034000 tx=0x7f8aa002e000 comp rx=0 tx=0).stop 2024-09-15T23:14:41.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.830+0000 7f8ab0f31640 1 -- 172.21.15.123:0/1093678474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8aac0b6970 msgr2=0x7f8aac154d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:41.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.830+0000 7f8ab0f31640 1 --2- 172.21.15.123:0/1093678474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8aac0b6970 0x7f8aac154d60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c00c780 tx=0x7f8a9c00cc40 comp rx=0 tx=0).stop 2024-09-15T23:14:41.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.830+0000 7f8ab0f31640 1 -- 172.21.15.123:0/1093678474 shutdown_connections 2024-09-15T23:14:41.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.830+0000 7f8ab0f31640 1 --2- 172.21.15.123:0/1093678474 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8aac15ed20 0x7f8aac15b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:41.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.830+0000 7f8ab0f31640 1 --2- 172.21.15.123:0/1093678474 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8aac0d23b0 0x7f8aac15b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:41.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.830+0000 7f8ab0f31640 1 --2- 172.21.15.123:0/1093678474 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8a8c06c2b0 0x7f8a8c06e770 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:41.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.830+0000 7f8ab0f31640 1 --2- 172.21.15.123:0/1093678474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8aac0b6970 0x7f8aac154d60 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:41.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.830+0000 7f8ab0f31640 1 -- 172.21.15.123:0/1093678474 >> 172.21.15.123:0/1093678474 conn(0x7f8aac0d1260 msgr2=0x7f8aac0d1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:41.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.830+0000 7f8ab0f31640 1 -- 172.21.15.123:0/1093678474 shutdown_connections 2024-09-15T23:14:41.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.830+0000 7f8ab0f31640 1 -- 172.21.15.123:0/1093678474 wait complete. 2024-09-15T23:14:41.842 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2024-09-15T23:14:41.536441+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":288736,"kb_used_data":5928,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754685984,"statfs":{"total":773094113280,"available":772798447616,"internally_reserved":0,"allocated":6070272,"data_stored":3199996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":289394224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001854"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.587246+0000","last_change":"2024-09-15T23:14:33.601295+0000","last_active":"2024-09-15T23:14:34.587246+0000","last_peered":"2024-09-15T23:14:34.587246+0000","last_clean":"2024-09-15T23:14:34.587246+0000","last_became_active":"2024-09-15T23:14:33.600696+0000","last_became_peered":"2024-09-15T23:14:33.600696+0000","last_unstale":"2024-09-15T23:14:34.587246+0000","last_undegraded":"2024-09-15T23:14:34.587246+0000","last_fullsized":"2024-09-15T23:14:34.587246+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:22:28.937103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.588451+0000","last_change":"2024-09-15T23:14:33.612574+0000","last_active":"2024-09-15T23:14:34.588451+0000","last_peered":"2024-09-15T23:14:34.588451+0000","last_clean":"2024-09-15T23:14:34.588451+0000","last_became_active":"2024-09-15T23:14:33.612321+0000","last_became_peered":"2024-09-15T23:14:33.612321+0000","last_unstale":"2024-09-15T23:14:34.588451+0000","last_undegraded":"2024-09-15T23:14:34.588451+0000","last_fullsized":"2024-09-15T23:14:34.588451+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:20:45.559611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.869383+0000","last_change":"2024-09-15T23:14:33.608259+0000","last_active":"2024-09-15T23:14:34.869383+0000","last_peered":"2024-09-15T23:14:34.869383+0000","last_clean":"2024-09-15T23:14:34.869383+0000","last_became_active":"2024-09-15T23:14:33.607990+0000","last_became_peered":"2024-09-15T23:14:33.607990+0000","last_unstale":"2024-09-15T23:14:34.869383+0000","last_undegraded":"2024-09-15T23:14:34.869383+0000","last_fullsized":"2024-09-15T23:14:34.869383+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:59.153492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.599094+0000","last_change":"2024-09-15T23:14:33.611677+0000","last_active":"2024-09-15T23:14:34.599094+0000","last_peered":"2024-09-15T23:14:34.599094+0000","last_clean":"2024-09-15T23:14:34.599094+0000","last_became_active":"2024-09-15T23:14:33.611423+0000","last_became_peered":"2024-09-15T23:14:33.611423+0000","last_unstale":"2024-09-15T23:14:34.599094+0000","last_undegraded":"2024-09-15T23:14:34.599094+0000","last_fullsized":"2024-09-15T23:14:34.599094+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:30.257562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.587511+0000","last_change":"2024-09-15T23:14:33.599127+0000","last_active":"2024-09-15T23:14:34.587511+0000","last_peered":"2024-09-15T23:14:34.587511+0000","last_clean":"2024-09-15T23:14:34.587511+0000","last_became_active":"2024-09-15T23:14:33.598861+0000","last_became_peered":"2024-09-15T23:14:33.598861+0000","last_unstale":"2024-09-15T23:14:34.587511+0000","last_undegraded":"2024-09-15T23:14:34.587511+0000","last_fullsized":"2024-09-15T23:14:34.587511+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:10:51.508565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870653+0000","last_change":"2024-09-15T23:14:33.608732+0000","last_active":"2024-09-15T23:14:34.870653+0000","last_peered":"2024-09-15T23:14:34.870653+0000","last_clean":"2024-09-15T23:14:34.870653+0000","last_became_active":"2024-09-15T23:14:33.608470+0000","last_became_peered":"2024-09-15T23:14:33.608470+0000","last_unstale":"2024-09-15T23:14:34.870653+0000","last_undegraded":"2024-09-15T23:14:34.870653+0000","last_fullsized":"2024-09-15T23:14:34.870653+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:26:10.163510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.587634+0000","last_change":"2024-09-15T23:14:33.613433+0000","last_active":"2024-09-15T23:14:34.587634+0000","last_peered":"2024-09-15T23:14:34.587634+0000","last_clean":"2024-09-15T23:14:34.587634+0000","last_became_active":"2024-09-15T23:14:33.613121+0000","last_became_peered":"2024-09-15T23:14:33.613121+0000","last_unstale":"2024-09-15T23:14:34.587634+0000","last_undegraded":"2024-09-15T23:14:34.587634+0000","last_fullsized":"2024-09-15T23:14:34.587634+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:07:42.522250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.598781+0000","last_change":"2024-09-15T23:14:33.609154+0000","last_active":"2024-09-15T23:14:34.598781+0000","last_peered":"2024-09-15T23:14:34.598781+0000","last_clean":"2024-09-15T23:14:34.598781+0000","last_became_active":"2024-09-15T23:14:33.608469+0000","last_became_peered":"2024-09-15T23:14:33.608469+0000","last_unstale":"2024-09-15T23:14:34.598781+0000","last_undegraded":"2024-09-15T23:14:34.598781+0000","last_fullsized":"2024-09-15T23:14:34.598781+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:15:26.232677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870339+0000","last_change":"2024-09-15T23:14:33.611678+0000","last_active":"2024-09-15T23:14:34.870339+0000","last_peered":"2024-09-15T23:14:34.870339+0000","last_clean":"2024-09-15T23:14:34.870339+0000","last_became_active":"2024-09-15T23:14:33.611426+0000","last_became_peered":"2024-09-15T23:14:33.611426+0000","last_unstale":"2024-09-15T23:14:34.870339+0000","last_undegraded":"2024-09-15T23:14:34.870339+0000","last_fullsized":"2024-09-15T23:14:34.870339+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:34.886069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870494+0000","last_change":"2024-09-15T23:14:33.612170+0000","last_active":"2024-09-15T23:14:34.870494+0000","last_peered":"2024-09-15T23:14:34.870494+0000","last_clean":"2024-09-15T23:14:34.870494+0000","last_became_active":"2024-09-15T23:14:33.610919+0000","last_became_peered":"2024-09-15T23:14:33.610919+0000","last_unstale":"2024-09-15T23:14:34.870494+0000","last_undegraded":"2024-09-15T23:14:34.870494+0000","last_fullsized":"2024-09-15T23:14:34.870494+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:56.742964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.599226+0000","last_change":"2024-09-15T23:14:33.614240+0000","last_active":"2024-09-15T23:14:34.599226+0000","last_peered":"2024-09-15T23:14:34.599226+0000","last_clean":"2024-09-15T23:14:34.599226+0000","last_became_active":"2024-09-15T23:14:33.613971+0000","last_became_peered":"2024-09-15T23:14:33.613971+0000","last_unstale":"2024-09-15T23:14:34.599226+0000","last_undegraded":"2024-09-15T23:14:34.599226+0000","last_fullsized":"2024-09-15T23:14:34.599226+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:15:25.781472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.588588+0000","last_change":"2024-09-15T23:14:33.597986+0000","last_active":"2024-09-15T23:14:34.588588+0000","last_peered":"2024-09-15T23:14:34.588588+0000","last_clean":"2024-09-15T23:14:34.588588+0000","last_became_active":"2024-09-15T23:14:33.597720+0000","last_became_peered":"2024-09-15T23:14:33.597720+0000","last_unstale":"2024-09-15T23:14:34.588588+0000","last_undegraded":"2024-09-15T23:14:34.588588+0000","last_fullsized":"2024-09-15T23:14:34.588588+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:38:46.181273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870337+0000","last_change":"2024-09-15T23:14:33.610275+0000","last_active":"2024-09-15T23:14:34.870337+0000","last_peered":"2024-09-15T23:14:34.870337+0000","last_clean":"2024-09-15T23:14:34.870337+0000","last_became_active":"2024-09-15T23:14:33.609998+0000","last_became_peered":"2024-09-15T23:14:33.609998+0000","last_unstale":"2024-09-15T23:14:34.870337+0000","last_undegraded":"2024-09-15T23:14:34.870337+0000","last_fullsized":"2024-09-15T23:14:34.870337+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:55:06.246019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.598897+0000","last_change":"2024-09-15T23:14:33.616589+0000","last_active":"2024-09-15T23:14:34.598897+0000","last_peered":"2024-09-15T23:14:34.598897+0000","last_clean":"2024-09-15T23:14:34.598897+0000","last_became_active":"2024-09-15T23:14:33.616264+0000","last_became_peered":"2024-09-15T23:14:33.616264+0000","last_unstale":"2024-09-15T23:14:34.598897+0000","last_undegraded":"2024-09-15T23:14:34.598897+0000","last_fullsized":"2024-09-15T23:14:34.598897+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:22.799567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.598697+0000","last_change":"2024-09-15T23:14:33.611634+0000","last_active":"2024-09-15T23:14:34.598697+0000","last_peered":"2024-09-15T23:14:34.598697+0000","last_clean":"2024-09-15T23:14:34.598697+0000","last_became_active":"2024-09-15T23:14:33.611361+0000","last_became_peered":"2024-09-15T23:14:33.611361+0000","last_unstale":"2024-09-15T23:14:34.598697+0000","last_undegraded":"2024-09-15T23:14:34.598697+0000","last_fullsized":"2024-09-15T23:14:34.598697+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:25:24.021354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.586874+0000","last_change":"2024-09-15T23:14:33.610389+0000","last_active":"2024-09-15T23:14:34.586874+0000","last_peered":"2024-09-15T23:14:34.586874+0000","last_clean":"2024-09-15T23:14:34.586874+0000","last_became_active":"2024-09-15T23:14:33.610088+0000","last_became_peered":"2024-09-15T23:14:33.610088+0000","last_unstale":"2024-09-15T23:14:34.586874+0000","last_undegraded":"2024-09-15T23:14:34.586874+0000","last_fullsized":"2024-09-15T23:14:34.586874+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:21.054184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.588379+0000","last_change":"2024-09-15T23:14:33.598138+0000","last_active":"2024-09-15T23:14:34.588379+0000","last_peered":"2024-09-15T23:14:34.588379+0000","last_clean":"2024-09-15T23:14:34.588379+0000","last_became_active":"2024-09-15T23:14:33.597892+0000","last_became_peered":"2024-09-15T23:14:33.597892+0000","last_unstale":"2024-09-15T23:14:34.588379+0000","last_undegraded":"2024-09-15T23:14:34.588379+0000","last_fullsized":"2024-09-15T23:14:34.588379+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:48:20.602616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.869482+0000","last_change":"2024-09-15T23:14:33.615950+0000","last_active":"2024-09-15T23:14:34.869482+0000","last_peered":"2024-09-15T23:14:34.869482+0000","last_clean":"2024-09-15T23:14:34.869482+0000","last_became_active":"2024-09-15T23:14:33.615608+0000","last_became_peered":"2024-09-15T23:14:33.615608+0000","last_unstale":"2024-09-15T23:14:34.869482+0000","last_undegraded":"2024-09-15T23:14:34.869482+0000","last_fullsized":"2024-09-15T23:14:34.869482+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:14:33.024587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.587162+0000","last_change":"2024-09-15T23:14:33.598314+0000","last_active":"2024-09-15T23:14:34.587162+0000","last_peered":"2024-09-15T23:14:34.587162+0000","last_clean":"2024-09-15T23:14:34.587162+0000","last_became_active":"2024-09-15T23:14:33.598021+0000","last_became_peered":"2024-09-15T23:14:33.598021+0000","last_unstale":"2024-09-15T23:14:34.587162+0000","last_undegraded":"2024-09-15T23:14:34.587162+0000","last_fullsized":"2024-09-15T23:14:34.587162+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:39:14.382927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870715+0000","last_change":"2024-09-15T23:14:33.610179+0000","last_active":"2024-09-15T23:14:34.870715+0000","last_peered":"2024-09-15T23:14:34.870715+0000","last_clean":"2024-09-15T23:14:34.870715+0000","last_became_active":"2024-09-15T23:14:33.609915+0000","last_became_peered":"2024-09-15T23:14:33.609915+0000","last_unstale":"2024-09-15T23:14:34.870715+0000","last_undegraded":"2024-09-15T23:14:34.870715+0000","last_fullsized":"2024-09-15T23:14:34.870715+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:32:53.322424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.599246+0000","last_change":"2024-09-15T23:14:33.608714+0000","last_active":"2024-09-15T23:14:34.599246+0000","last_peered":"2024-09-15T23:14:34.599246+0000","last_clean":"2024-09-15T23:14:34.599246+0000","last_became_active":"2024-09-15T23:14:33.608493+0000","last_became_peered":"2024-09-15T23:14:33.608493+0000","last_unstale":"2024-09-15T23:14:34.599246+0000","last_undegraded":"2024-09-15T23:14:34.599246+0000","last_fullsized":"2024-09-15T23:14:34.599246+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:56:30.247595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870181+0000","last_change":"2024-09-15T23:14:33.593082+0000","last_active":"2024-09-15T23:14:34.870181+0000","last_peered":"2024-09-15T23:14:34.870181+0000","last_clean":"2024-09-15T23:14:34.870181+0000","last_became_active":"2024-09-15T23:14:33.592816+0000","last_became_peered":"2024-09-15T23:14:33.592816+0000","last_unstale":"2024-09-15T23:14:34.870181+0000","last_undegraded":"2024-09-15T23:14:34.870181+0000","last_fullsized":"2024-09-15T23:14:34.870181+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:27:28.548467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.587817+0000","last_change":"2024-09-15T23:14:33.591734+0000","last_active":"2024-09-15T23:14:34.587817+0000","last_peered":"2024-09-15T23:14:34.587817+0000","last_clean":"2024-09-15T23:14:34.587817+0000","last_became_active":"2024-09-15T23:14:33.591481+0000","last_became_peered":"2024-09-15T23:14:33.591481+0000","last_unstale":"2024-09-15T23:14:34.587817+0000","last_undegraded":"2024-09-15T23:14:34.587817+0000","last_fullsized":"2024-09-15T23:14:34.587817+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:41:31.003396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.588164+0000","last_change":"2024-09-15T23:14:33.609583+0000","last_active":"2024-09-15T23:14:34.588164+0000","last_peered":"2024-09-15T23:14:34.588164+0000","last_clean":"2024-09-15T23:14:34.588164+0000","last_became_active":"2024-09-15T23:14:33.609310+0000","last_became_peered":"2024-09-15T23:14:33.609310+0000","last_unstale":"2024-09-15T23:14:34.588164+0000","last_undegraded":"2024-09-15T23:14:34.588164+0000","last_fullsized":"2024-09-15T23:14:34.588164+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:24.627188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.587289+0000","last_change":"2024-09-15T23:14:33.599313+0000","last_active":"2024-09-15T23:14:34.587289+0000","last_peered":"2024-09-15T23:14:34.587289+0000","last_clean":"2024-09-15T23:14:34.587289+0000","last_became_active":"2024-09-15T23:14:33.599011+0000","last_became_peered":"2024-09-15T23:14:33.599011+0000","last_unstale":"2024-09-15T23:14:34.587289+0000","last_undegraded":"2024-09-15T23:14:34.587289+0000","last_fullsized":"2024-09-15T23:14:34.587289+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:55:30.059745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.599222+0000","last_change":"2024-09-15T23:14:33.618350+0000","last_active":"2024-09-15T23:14:34.599222+0000","last_peered":"2024-09-15T23:14:34.599222+0000","last_clean":"2024-09-15T23:14:34.599222+0000","last_became_active":"2024-09-15T23:14:33.618088+0000","last_became_peered":"2024-09-15T23:14:33.618088+0000","last_unstale":"2024-09-15T23:14:34.599222+0000","last_undegraded":"2024-09-15T23:14:34.599222+0000","last_fullsized":"2024-09-15T23:14:34.599222+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:05:44.443170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.588034+0000","last_change":"2024-09-15T23:14:33.596777+0000","last_active":"2024-09-15T23:14:34.588034+0000","last_peered":"2024-09-15T23:14:34.588034+0000","last_clean":"2024-09-15T23:14:34.588034+0000","last_became_active":"2024-09-15T23:14:33.596502+0000","last_became_peered":"2024-09-15T23:14:33.596502+0000","last_unstale":"2024-09-15T23:14:34.588034+0000","last_undegraded":"2024-09-15T23:14:34.588034+0000","last_fullsized":"2024-09-15T23:14:34.588034+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:33:43.110609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.588109+0000","last_change":"2024-09-15T23:14:33.598181+0000","last_active":"2024-09-15T23:14:34.588109+0000","last_peered":"2024-09-15T23:14:34.588109+0000","last_clean":"2024-09-15T23:14:34.588109+0000","last_became_active":"2024-09-15T23:14:33.597843+0000","last_became_peered":"2024-09-15T23:14:33.597843+0000","last_unstale":"2024-09-15T23:14:34.588109+0000","last_undegraded":"2024-09-15T23:14:34.588109+0000","last_fullsized":"2024-09-15T23:14:34.588109+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:52:32.843815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.587516+0000","last_change":"2024-09-15T23:14:33.610484+0000","last_active":"2024-09-15T23:14:34.587516+0000","last_peered":"2024-09-15T23:14:34.587516+0000","last_clean":"2024-09-15T23:14:34.587516+0000","last_became_active":"2024-09-15T23:14:33.610207+0000","last_became_peered":"2024-09-15T23:14:33.610207+0000","last_unstale":"2024-09-15T23:14:34.587516+0000","last_undegraded":"2024-09-15T23:14:34.587516+0000","last_fullsized":"2024-09-15T23:14:34.587516+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:34.742574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.588066+0000","last_change":"2024-09-15T23:14:33.597198+0000","last_active":"2024-09-15T23:14:34.588066+0000","last_peered":"2024-09-15T23:14:34.588066+0000","last_clean":"2024-09-15T23:14:34.588066+0000","last_became_active":"2024-09-15T23:14:33.596911+0000","last_became_peered":"2024-09-15T23:14:33.596911+0000","last_unstale":"2024-09-15T23:14:34.588066+0000","last_undegraded":"2024-09-15T23:14:34.588066+0000","last_fullsized":"2024-09-15T23:14:34.588066+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:26:10.163510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.869882+0000","last_change":"2024-09-15T23:14:33.596638+0000","last_active":"2024-09-15T23:14:34.869882+0000","last_peered":"2024-09-15T23:14:34.869882+0000","last_clean":"2024-09-15T23:14:34.869882+0000","last_became_active":"2024-09-15T23:14:33.596350+0000","last_became_peered":"2024-09-15T23:14:33.596350+0000","last_unstale":"2024-09-15T23:14:34.869882+0000","last_undegraded":"2024-09-15T23:14:34.869882+0000","last_fullsized":"2024-09-15T23:14:34.869882+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:02.724206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.598773+0000","last_change":"2024-09-15T23:14:33.608852+0000","last_active":"2024-09-15T23:14:34.598773+0000","last_peered":"2024-09-15T23:14:34.598773+0000","last_clean":"2024-09-15T23:14:34.598773+0000","last_became_active":"2024-09-15T23:14:33.608190+0000","last_became_peered":"2024-09-15T23:14:33.608190+0000","last_unstale":"2024-09-15T23:14:34.598773+0000","last_undegraded":"2024-09-15T23:14:34.598773+0000","last_fullsized":"2024-09-15T23:14:34.598773+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:12:06.375013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870523+0000","last_change":"2024-09-15T23:14:33.613017+0000","last_active":"2024-09-15T23:14:34.870523+0000","last_peered":"2024-09-15T23:14:34.870523+0000","last_clean":"2024-09-15T23:14:34.870523+0000","last_became_active":"2024-09-15T23:14:33.612686+0000","last_became_peered":"2024-09-15T23:14:33.612686+0000","last_unstale":"2024-09-15T23:14:34.870523+0000","last_undegraded":"2024-09-15T23:14:34.870523+0000","last_fullsized":"2024-09-15T23:14:34.870523+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:33:01.049973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"51'4","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870313+0000","last_change":"2024-09-15T23:14:32.594944+0000","last_active":"2024-09-15T23:14:34.870313+0000","last_peered":"2024-09-15T23:14:34.870313+0000","last_clean":"2024-09-15T23:14:34.870313+0000","last_became_active":"2024-09-15T23:14:32.594628+0000","last_became_peered":"2024-09-15T23:14:32.594628+0000","last_unstale":"2024-09-15T23:14:34.870313+0000","last_undegraded":"2024-09-15T23:14:34.870313+0000","last_fullsized":"2024-09-15T23:14:34.870313+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:50.778297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.587371+0000","last_change":"2024-09-15T23:14:33.599813+0000","last_active":"2024-09-15T23:14:34.587371+0000","last_peered":"2024-09-15T23:14:34.587371+0000","last_clean":"2024-09-15T23:14:34.587371+0000","last_became_active":"2024-09-15T23:14:33.599547+0000","last_became_peered":"2024-09-15T23:14:33.599547+0000","last_unstale":"2024-09-15T23:14:34.587371+0000","last_undegraded":"2024-09-15T23:14:34.587371+0000","last_fullsized":"2024-09-15T23:14:34.587371+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:03.282927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"51'1","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.587980+0000","last_change":"2024-09-15T23:14:32.594653+0000","last_active":"2024-09-15T23:14:34.587980+0000","last_peered":"2024-09-15T23:14:34.587980+0000","last_clean":"2024-09-15T23:14:34.587980+0000","last_became_active":"2024-09-15T23:14:32.594382+0000","last_became_peered":"2024-09-15T23:14:32.594382+0000","last_unstale":"2024-09-15T23:14:34.587980+0000","last_undegraded":"2024-09-15T23:14:34.587980+0000","last_fullsized":"2024-09-15T23:14:34.587980+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:35.739254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.588653+0000","last_change":"2024-09-15T23:14:33.609964+0000","last_active":"2024-09-15T23:14:34.588653+0000","last_peered":"2024-09-15T23:14:34.588653+0000","last_clean":"2024-09-15T23:14:34.588653+0000","last_became_active":"2024-09-15T23:14:33.609633+0000","last_became_peered":"2024-09-15T23:14:33.609633+0000","last_unstale":"2024-09-15T23:14:34.588653+0000","last_undegraded":"2024-09-15T23:14:34.588653+0000","last_fullsized":"2024-09-15T23:14:34.588653+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:21.054184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"51'2","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870188+0000","last_change":"2024-09-15T23:14:32.592604+0000","last_active":"2024-09-15T23:14:34.870188+0000","last_peered":"2024-09-15T23:14:34.870188+0000","last_clean":"2024-09-15T23:14:34.870188+0000","last_became_active":"2024-09-15T23:14:32.592310+0000","last_became_peered":"2024-09-15T23:14:32.592310+0000","last_unstale":"2024-09-15T23:14:34.870188+0000","last_undegraded":"2024-09-15T23:14:34.870188+0000","last_fullsized":"2024-09-15T23:14:34.870188+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:38.516357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.599290+0000","last_change":"2024-09-15T23:14:33.606518+0000","last_active":"2024-09-15T23:14:34.599290+0000","last_peered":"2024-09-15T23:14:34.599290+0000","last_clean":"2024-09-15T23:14:34.599290+0000","last_became_active":"2024-09-15T23:14:33.605858+0000","last_became_peered":"2024-09-15T23:14:33.605858+0000","last_unstale":"2024-09-15T23:14:34.599290+0000","last_undegraded":"2024-09-15T23:14:34.599290+0000","last_fullsized":"2024-09-15T23:14:34.599290+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:21:09.993053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"51'2","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.588198+0000","last_change":"2024-09-15T23:14:32.585437+0000","last_active":"2024-09-15T23:14:34.588198+0000","last_peered":"2024-09-15T23:14:34.588198+0000","last_clean":"2024-09-15T23:14:34.588198+0000","last_became_active":"2024-09-15T23:14:32.585165+0000","last_became_peered":"2024-09-15T23:14:32.585165+0000","last_unstale":"2024-09-15T23:14:34.588198+0000","last_undegraded":"2024-09-15T23:14:34.588198+0000","last_fullsized":"2024-09-15T23:14:34.588198+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:01.617179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.587706+0000","last_change":"2024-09-15T23:14:33.592854+0000","last_active":"2024-09-15T23:14:34.587706+0000","last_peered":"2024-09-15T23:14:34.587706+0000","last_clean":"2024-09-15T23:14:34.587706+0000","last_became_active":"2024-09-15T23:14:33.592545+0000","last_became_peered":"2024-09-15T23:14:33.592545+0000","last_unstale":"2024-09-15T23:14:34.587706+0000","last_undegraded":"2024-09-15T23:14:34.587706+0000","last_fullsized":"2024-09-15T23:14:34.587706+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:46.746544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"51'1","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870604+0000","last_change":"2024-09-15T23:14:32.590620+0000","last_active":"2024-09-15T23:14:34.870604+0000","last_peered":"2024-09-15T23:14:34.870604+0000","last_clean":"2024-09-15T23:14:34.870604+0000","last_became_active":"2024-09-15T23:14:32.590337+0000","last_became_peered":"2024-09-15T23:14:32.590337+0000","last_unstale":"2024-09-15T23:14:34.870604+0000","last_undegraded":"2024-09-15T23:14:34.870604+0000","last_fullsized":"2024-09-15T23:14:34.870604+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:50.416367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870487+0000","last_change":"2024-09-15T23:14:33.613593+0000","last_active":"2024-09-15T23:14:34.870487+0000","last_peered":"2024-09-15T23:14:34.870487+0000","last_clean":"2024-09-15T23:14:34.870487+0000","last_became_active":"2024-09-15T23:14:33.613330+0000","last_became_peered":"2024-09-15T23:14:33.613330+0000","last_unstale":"2024-09-15T23:14:34.870487+0000","last_undegraded":"2024-09-15T23:14:34.870487+0000","last_fullsized":"2024-09-15T23:14:34.870487+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:16.790009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"51'1","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.587788+0000","last_change":"2024-09-15T23:14:32.586162+0000","last_active":"2024-09-15T23:14:34.587788+0000","last_peered":"2024-09-15T23:14:34.587788+0000","last_clean":"2024-09-15T23:14:34.587788+0000","last_became_active":"2024-09-15T23:14:32.585885+0000","last_became_peered":"2024-09-15T23:14:32.585885+0000","last_unstale":"2024-09-15T23:14:34.587788+0000","last_undegraded":"2024-09-15T23:14:34.587788+0000","last_fullsized":"2024-09-15T23:14:34.587788+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:38:52.471003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.869756+0000","last_change":"2024-09-15T23:14:33.605072+0000","last_active":"2024-09-15T23:14:34.869756+0000","last_peered":"2024-09-15T23:14:34.869756+0000","last_clean":"2024-09-15T23:14:34.869756+0000","last_became_active":"2024-09-15T23:14:33.604220+0000","last_became_peered":"2024-09-15T23:14:33.604220+0000","last_unstale":"2024-09-15T23:14:34.869756+0000","last_undegraded":"2024-09-15T23:14:34.869756+0000","last_fullsized":"2024-09-15T23:14:34.869756+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:28:08.700705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.586976+0000","last_change":"2024-09-15T23:14:32.598430+0000","last_active":"2024-09-15T23:14:34.586976+0000","last_peered":"2024-09-15T23:14:34.586976+0000","last_clean":"2024-09-15T23:14:34.586976+0000","last_became_active":"2024-09-15T23:14:32.598047+0000","last_became_peered":"2024-09-15T23:14:32.598047+0000","last_unstale":"2024-09-15T23:14:34.586976+0000","last_undegraded":"2024-09-15T23:14:34.586976+0000","last_fullsized":"2024-09-15T23:14:34.586976+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:21:36.747323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.587680+0000","last_change":"2024-09-15T23:14:33.600704+0000","last_active":"2024-09-15T23:14:34.587680+0000","last_peered":"2024-09-15T23:14:34.587680+0000","last_clean":"2024-09-15T23:14:34.587680+0000","last_became_active":"2024-09-15T23:14:33.600157+0000","last_became_peered":"2024-09-15T23:14:33.600157+0000","last_unstale":"2024-09-15T23:14:34.587680+0000","last_undegraded":"2024-09-15T23:14:34.587680+0000","last_fullsized":"2024-09-15T23:14:34.587680+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:04:20.324017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870413+0000","last_change":"2024-09-15T23:14:32.599198+0000","last_active":"2024-09-15T23:14:34.870413+0000","last_peered":"2024-09-15T23:14:34.870413+0000","last_clean":"2024-09-15T23:14:34.870413+0000","last_became_active":"2024-09-15T23:14:32.598893+0000","last_became_peered":"2024-09-15T23:14:32.598893+0000","last_unstale":"2024-09-15T23:14:34.870413+0000","last_undegraded":"2024-09-15T23:14:34.870413+0000","last_fullsized":"2024-09-15T23:14:34.870413+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:24.096237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.869532+0000","last_change":"2024-09-15T23:14:33.591937+0000","last_active":"2024-09-15T23:14:34.869532+0000","last_peered":"2024-09-15T23:14:34.869532+0000","last_clean":"2024-09-15T23:14:34.869532+0000","last_became_active":"2024-09-15T23:14:33.591646+0000","last_became_peered":"2024-09-15T23:14:33.591646+0000","last_unstale":"2024-09-15T23:14:34.869532+0000","last_undegraded":"2024-09-15T23:14:34.869532+0000","last_fullsized":"2024-09-15T23:14:34.869532+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:15.328848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.869455+0000","last_change":"2024-09-15T23:14:32.591483+0000","last_active":"2024-09-15T23:14:34.869455+0000","last_peered":"2024-09-15T23:14:34.869455+0000","last_clean":"2024-09-15T23:14:34.869455+0000","last_became_active":"2024-09-15T23:14:32.591161+0000","last_became_peered":"2024-09-15T23:14:32.591161+0000","last_unstale":"2024-09-15T23:14:34.869455+0000","last_undegraded":"2024-09-15T23:14:34.869455+0000","last_fullsized":"2024-09-15T23:14:34.869455+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:00.122366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.869503+0000","last_change":"2024-09-15T23:14:33.591249+0000","last_active":"2024-09-15T23:14:34.869503+0000","last_peered":"2024-09-15T23:14:34.869503+0000","last_clean":"2024-09-15T23:14:34.869503+0000","last_became_active":"2024-09-15T23:14:33.590970+0000","last_became_peered":"2024-09-15T23:14:33.590970+0000","last_unstale":"2024-09-15T23:14:34.869503+0000","last_undegraded":"2024-09-15T23:14:34.869503+0000","last_fullsized":"2024-09-15T23:14:34.869503+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:33:01.396335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870542+0000","last_change":"2024-09-15T23:14:32.596138+0000","last_active":"2024-09-15T23:14:34.870542+0000","last_peered":"2024-09-15T23:14:34.870542+0000","last_clean":"2024-09-15T23:14:34.870542+0000","last_became_active":"2024-09-15T23:14:32.595823+0000","last_became_peered":"2024-09-15T23:14:32.595823+0000","last_unstale":"2024-09-15T23:14:34.870542+0000","last_undegraded":"2024-09-15T23:14:34.870542+0000","last_fullsized":"2024-09-15T23:14:34.870542+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:58.984248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.599217+0000","last_change":"2024-09-15T23:14:33.619533+0000","last_active":"2024-09-15T23:14:34.599217+0000","last_peered":"2024-09-15T23:14:34.599217+0000","last_clean":"2024-09-15T23:14:34.599217+0000","last_became_active":"2024-09-15T23:14:33.619229+0000","last_became_peered":"2024-09-15T23:14:33.619229+0000","last_unstale":"2024-09-15T23:14:34.599217+0000","last_undegraded":"2024-09-15T23:14:34.599217+0000","last_fullsized":"2024-09-15T23:14:34.599217+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:04:40.431817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"51'3","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.588120+0000","last_change":"2024-09-15T23:14:32.589177+0000","last_active":"2024-09-15T23:14:34.588120+0000","last_peered":"2024-09-15T23:14:34.588120+0000","last_clean":"2024-09-15T23:14:34.588120+0000","last_became_active":"2024-09-15T23:14:32.588881+0000","last_became_peered":"2024-09-15T23:14:32.588881+0000","last_unstale":"2024-09-15T23:14:34.588120+0000","last_undegraded":"2024-09-15T23:14:34.588120+0000","last_fullsized":"2024-09-15T23:14:34.588120+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:12:56.537897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.588060+0000","last_change":"2024-09-15T23:14:33.615748+0000","last_active":"2024-09-15T23:14:34.588060+0000","last_peered":"2024-09-15T23:14:34.588060+0000","last_clean":"2024-09-15T23:14:34.588060+0000","last_became_active":"2024-09-15T23:14:33.615535+0000","last_became_peered":"2024-09-15T23:14:33.615535+0000","last_unstale":"2024-09-15T23:14:34.588060+0000","last_undegraded":"2024-09-15T23:14:34.588060+0000","last_fullsized":"2024-09-15T23:14:34.588060+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:28.490123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"51'6","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870817+0000","last_change":"2024-09-15T23:14:32.594594+0000","last_active":"2024-09-15T23:14:34.870817+0000","last_peered":"2024-09-15T23:14:34.870817+0000","last_clean":"2024-09-15T23:14:34.870817+0000","last_became_active":"2024-09-15T23:14:32.594344+0000","last_became_peered":"2024-09-15T23:14:32.594344+0000","last_unstale":"2024-09-15T23:14:34.870817+0000","last_undegraded":"2024-09-15T23:14:34.870817+0000","last_fullsized":"2024-09-15T23:14:34.870817+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:05:43.438947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.869280+0000","last_change":"2024-09-15T23:14:33.612551+0000","last_active":"2024-09-15T23:14:34.869280+0000","last_peered":"2024-09-15T23:14:34.869280+0000","last_clean":"2024-09-15T23:14:34.869280+0000","last_became_active":"2024-09-15T23:14:33.612289+0000","last_became_peered":"2024-09-15T23:14:33.612289+0000","last_unstale":"2024-09-15T23:14:34.869280+0000","last_undegraded":"2024-09-15T23:14:34.869280+0000","last_fullsized":"2024-09-15T23:14:34.869280+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:27:28.548467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"51'2","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870315+0000","last_change":"2024-09-15T23:14:32.591239+0000","last_active":"2024-09-15T23:14:34.870315+0000","last_peered":"2024-09-15T23:14:34.870315+0000","last_clean":"2024-09-15T23:14:34.870315+0000","last_became_active":"2024-09-15T23:14:32.590754+0000","last_became_peered":"2024-09-15T23:14:32.590754+0000","last_unstale":"2024-09-15T23:14:34.870315+0000","last_undegraded":"2024-09-15T23:14:34.870315+0000","last_fullsized":"2024-09-15T23:14:34.870315+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:35.275646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870186+0000","last_change":"2024-09-15T23:14:33.598138+0000","last_active":"2024-09-15T23:14:34.870186+0000","last_peered":"2024-09-15T23:14:34.870186+0000","last_clean":"2024-09-15T23:14:34.870186+0000","last_became_active":"2024-09-15T23:14:33.597852+0000","last_became_peered":"2024-09-15T23:14:33.597852+0000","last_unstale":"2024-09-15T23:14:34.870186+0000","last_undegraded":"2024-09-15T23:14:34.870186+0000","last_fullsized":"2024-09-15T23:14:34.870186+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:59.153492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.587051+0000","last_change":"2024-09-15T23:14:32.588678+0000","last_active":"2024-09-15T23:14:34.587051+0000","last_peered":"2024-09-15T23:14:34.587051+0000","last_clean":"2024-09-15T23:14:34.587051+0000","last_became_active":"2024-09-15T23:14:32.588365+0000","last_became_peered":"2024-09-15T23:14:32.588365+0000","last_unstale":"2024-09-15T23:14:34.587051+0000","last_undegraded":"2024-09-15T23:14:34.587051+0000","last_fullsized":"2024-09-15T23:14:34.587051+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:55:05.241796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.869933+0000","last_change":"2024-09-15T23:14:33.606355+0000","last_active":"2024-09-15T23:14:34.869933+0000","last_peered":"2024-09-15T23:14:34.869933+0000","last_clean":"2024-09-15T23:14:34.869933+0000","last_became_active":"2024-09-15T23:14:33.606057+0000","last_became_peered":"2024-09-15T23:14:33.606057+0000","last_unstale":"2024-09-15T23:14:34.869933+0000","last_undegraded":"2024-09-15T23:14:34.869933+0000","last_fullsized":"2024-09-15T23:14:34.869933+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:40.113827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.869897+0000","last_change":"2024-09-15T23:14:32.593180+0000","last_active":"2024-09-15T23:14:34.869897+0000","last_peered":"2024-09-15T23:14:34.869897+0000","last_clean":"2024-09-15T23:14:34.869897+0000","last_became_active":"2024-09-15T23:14:32.592930+0000","last_became_peered":"2024-09-15T23:14:32.592930+0000","last_unstale":"2024-09-15T23:14:34.869897+0000","last_undegraded":"2024-09-15T23:14:34.869897+0000","last_fullsized":"2024-09-15T23:14:34.869897+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:33.716879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.588305+0000","last_change":"2024-09-15T23:14:33.599045+0000","last_active":"2024-09-15T23:14:34.588305+0000","last_peered":"2024-09-15T23:14:34.588305+0000","last_clean":"2024-09-15T23:14:34.588305+0000","last_became_active":"2024-09-15T23:14:33.598472+0000","last_became_peered":"2024-09-15T23:14:33.598472+0000","last_unstale":"2024-09-15T23:14:34.588305+0000","last_undegraded":"2024-09-15T23:14:34.588305+0000","last_fullsized":"2024-09-15T23:14:34.588305+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:45:18.979118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"51'8","reported_seq":22,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.869885+0000","last_change":"2024-09-15T23:14:32.594226+0000","last_active":"2024-09-15T23:14:34.869885+0000","last_peered":"2024-09-15T23:14:34.869885+0000","last_clean":"2024-09-15T23:14:34.869885+0000","last_became_active":"2024-09-15T23:14:32.593694+0000","last_became_peered":"2024-09-15T23:14:32.593694+0000","last_unstale":"2024-09-15T23:14:34.869885+0000","last_undegraded":"2024-09-15T23:14:34.869885+0000","last_fullsized":"2024-09-15T23:14:34.869885+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:04:39.427595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870664+0000","last_change":"2024-09-15T23:14:33.597118+0000","last_active":"2024-09-15T23:14:34.870664+0000","last_peered":"2024-09-15T23:14:34.870664+0000","last_clean":"2024-09-15T23:14:34.870664+0000","last_became_active":"2024-09-15T23:14:33.596748+0000","last_became_peered":"2024-09-15T23:14:33.596748+0000","last_unstale":"2024-09-15T23:14:34.870664+0000","last_undegraded":"2024-09-15T23:14:34.870664+0000","last_fullsized":"2024-09-15T23:14:34.870664+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:33:01.396335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"51'1","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.599258+0000","last_change":"2024-09-15T23:14:32.598464+0000","last_active":"2024-09-15T23:14:34.599258+0000","last_peered":"2024-09-15T23:14:34.599258+0000","last_clean":"2024-09-15T23:14:34.599258+0000","last_became_active":"2024-09-15T23:14:32.598145+0000","last_became_peered":"2024-09-15T23:14:32.598145+0000","last_unstale":"2024-09-15T23:14:34.599258+0000","last_undegraded":"2024-09-15T23:14:34.599258+0000","last_fullsized":"2024-09-15T23:14:34.599258+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:04.474623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870621+0000","last_change":"2024-09-15T23:14:33.608122+0000","last_active":"2024-09-15T23:14:34.870621+0000","last_peered":"2024-09-15T23:14:34.870621+0000","last_clean":"2024-09-15T23:14:34.870621+0000","last_became_active":"2024-09-15T23:14:33.607852+0000","last_became_peered":"2024-09-15T23:14:33.607852+0000","last_unstale":"2024-09-15T23:14:34.870621+0000","last_undegraded":"2024-09-15T23:14:34.870621+0000","last_fullsized":"2024-09-15T23:14:34.870621+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:14:33.024587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"51'2","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.869543+0000","last_change":"2024-09-15T23:14:32.592365+0000","last_active":"2024-09-15T23:14:34.869543+0000","last_peered":"2024-09-15T23:14:34.869543+0000","last_clean":"2024-09-15T23:14:34.869543+0000","last_became_active":"2024-09-15T23:14:32.592065+0000","last_became_peered":"2024-09-15T23:14:32.592065+0000","last_unstale":"2024-09-15T23:14:34.869543+0000","last_undegraded":"2024-09-15T23:14:34.869543+0000","last_fullsized":"2024-09-15T23:14:34.869543+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:35.275646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.588671+0000","last_change":"2024-09-15T23:14:33.608912+0000","last_active":"2024-09-15T23:14:34.588671+0000","last_peered":"2024-09-15T23:14:34.588671+0000","last_clean":"2024-09-15T23:14:34.588671+0000","last_became_active":"2024-09-15T23:14:33.608593+0000","last_became_peered":"2024-09-15T23:14:33.608593+0000","last_unstale":"2024-09-15T23:14:34.588671+0000","last_undegraded":"2024-09-15T23:14:34.588671+0000","last_fullsized":"2024-09-15T23:14:34.588671+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:39:14.382927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"51'1","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.869522+0000","last_change":"2024-09-15T23:14:32.593146+0000","last_active":"2024-09-15T23:14:34.869522+0000","last_peered":"2024-09-15T23:14:34.869522+0000","last_clean":"2024-09-15T23:14:34.869522+0000","last_became_active":"2024-09-15T23:14:32.592889+0000","last_became_peered":"2024-09-15T23:14:32.592889+0000","last_unstale":"2024-09-15T23:14:34.869522+0000","last_undegraded":"2024-09-15T23:14:34.869522+0000","last_fullsized":"2024-09-15T23:14:34.869522+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:59.169628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.869463+0000","last_change":"2024-09-15T23:14:33.608281+0000","last_active":"2024-09-15T23:14:34.869463+0000","last_peered":"2024-09-15T23:14:34.869463+0000","last_clean":"2024-09-15T23:14:34.869463+0000","last_became_active":"2024-09-15T23:14:33.607982+0000","last_became_peered":"2024-09-15T23:14:33.607982+0000","last_unstale":"2024-09-15T23:14:34.869463+0000","last_undegraded":"2024-09-15T23:14:34.869463+0000","last_fullsized":"2024-09-15T23:14:34.869463+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:33:01.049973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870961+0000","last_change":"2024-09-15T23:14:32.593808+0000","last_active":"2024-09-15T23:14:34.870961+0000","last_peered":"2024-09-15T23:14:34.870961+0000","last_clean":"2024-09-15T23:14:34.870961+0000","last_became_active":"2024-09-15T23:14:32.593493+0000","last_became_peered":"2024-09-15T23:14:32.593493+0000","last_unstale":"2024-09-15T23:14:34.870961+0000","last_undegraded":"2024-09-15T23:14:34.870961+0000","last_fullsized":"2024-09-15T23:14:34.870961+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:01:33.975383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.869950+0000","last_change":"2024-09-15T23:14:33.604826+0000","last_active":"2024-09-15T23:14:34.869950+0000","last_peered":"2024-09-15T23:14:34.869950+0000","last_clean":"2024-09-15T23:14:34.869950+0000","last_became_active":"2024-09-15T23:14:33.604515+0000","last_became_peered":"2024-09-15T23:14:33.604515+0000","last_unstale":"2024-09-15T23:14:34.869950+0000","last_undegraded":"2024-09-15T23:14:34.869950+0000","last_fullsized":"2024-09-15T23:14:34.869950+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:24.873653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"51'2","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870601+0000","last_change":"2024-09-15T23:14:32.596303+0000","last_active":"2024-09-15T23:14:34.870601+0000","last_peered":"2024-09-15T23:14:34.870601+0000","last_clean":"2024-09-15T23:14:34.870601+0000","last_became_active":"2024-09-15T23:14:32.595965+0000","last_became_peered":"2024-09-15T23:14:32.595965+0000","last_unstale":"2024-09-15T23:14:34.870601+0000","last_undegraded":"2024-09-15T23:14:34.870601+0000","last_fullsized":"2024-09-15T23:14:34.870601+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:29.253340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870498+0000","last_change":"2024-09-15T23:14:33.598114+0000","last_active":"2024-09-15T23:14:34.870498+0000","last_peered":"2024-09-15T23:14:34.870498+0000","last_clean":"2024-09-15T23:14:34.870498+0000","last_became_active":"2024-09-15T23:14:33.597762+0000","last_became_peered":"2024-09-15T23:14:33.597762+0000","last_unstale":"2024-09-15T23:14:34.870498+0000","last_undegraded":"2024-09-15T23:14:34.870498+0000","last_fullsized":"2024-09-15T23:14:34.870498+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:34:03.998649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.587059+0000","last_change":"2024-09-15T23:14:32.589067+0000","last_active":"2024-09-15T23:14:34.587059+0000","last_peered":"2024-09-15T23:14:34.587059+0000","last_clean":"2024-09-15T23:14:34.587059+0000","last_became_active":"2024-09-15T23:14:32.588791+0000","last_became_peered":"2024-09-15T23:14:32.588791+0000","last_unstale":"2024-09-15T23:14:34.587059+0000","last_undegraded":"2024-09-15T23:14:34.587059+0000","last_fullsized":"2024-09-15T23:14:34.587059+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:33.881847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.599058+0000","last_change":"2024-09-15T23:14:33.613028+0000","last_active":"2024-09-15T23:14:34.599058+0000","last_peered":"2024-09-15T23:14:34.599058+0000","last_clean":"2024-09-15T23:14:34.599058+0000","last_became_active":"2024-09-15T23:14:33.611983+0000","last_became_peered":"2024-09-15T23:14:33.611983+0000","last_unstale":"2024-09-15T23:14:34.599058+0000","last_undegraded":"2024-09-15T23:14:34.599058+0000","last_fullsized":"2024-09-15T23:14:34.599058+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:59.988471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.869825+0000","last_change":"2024-09-15T23:14:32.595982+0000","last_active":"2024-09-15T23:14:34.869825+0000","last_peered":"2024-09-15T23:14:34.869825+0000","last_clean":"2024-09-15T23:14:34.869825+0000","last_became_active":"2024-09-15T23:14:32.595688+0000","last_became_peered":"2024-09-15T23:14:32.595688+0000","last_unstale":"2024-09-15T23:14:34.869825+0000","last_undegraded":"2024-09-15T23:14:34.869825+0000","last_fullsized":"2024-09-15T23:14:34.869825+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:32.950554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.598777+0000","last_change":"2024-09-15T23:14:33.616040+0000","last_active":"2024-09-15T23:14:34.598777+0000","last_peered":"2024-09-15T23:14:34.598777+0000","last_clean":"2024-09-15T23:14:34.598777+0000","last_became_active":"2024-09-15T23:14:33.615753+0000","last_became_peered":"2024-09-15T23:14:33.615753+0000","last_unstale":"2024-09-15T23:14:34.598777+0000","last_undegraded":"2024-09-15T23:14:34.598777+0000","last_fullsized":"2024-09-15T23:14:34.598777+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:05:54.178061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.587546+0000","last_change":"2024-09-15T23:14:32.591067+0000","last_active":"2024-09-15T23:14:34.587546+0000","last_peered":"2024-09-15T23:14:34.587546+0000","last_clean":"2024-09-15T23:14:34.587546+0000","last_became_active":"2024-09-15T23:14:32.590787+0000","last_became_peered":"2024-09-15T23:14:32.590787+0000","last_unstale":"2024-09-15T23:14:34.587546+0000","last_undegraded":"2024-09-15T23:14:34.587546+0000","last_fullsized":"2024-09-15T23:14:34.587546+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:24.827613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.587968+0000","last_change":"2024-09-15T23:14:33.599643+0000","last_active":"2024-09-15T23:14:34.587968+0000","last_peered":"2024-09-15T23:14:34.587968+0000","last_clean":"2024-09-15T23:14:34.587968+0000","last_became_active":"2024-09-15T23:14:33.599385+0000","last_became_peered":"2024-09-15T23:14:33.599385+0000","last_unstale":"2024-09-15T23:14:34.587968+0000","last_undegraded":"2024-09-15T23:14:34.587968+0000","last_fullsized":"2024-09-15T23:14:34.587968+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:02.133926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"52'1","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.600656+0000","last_change":"2024-09-15T23:14:32.598482+0000","last_active":"2024-09-15T23:14:34.600656+0000","last_peered":"2024-09-15T23:14:34.600656+0000","last_clean":"2024-09-15T23:14:34.600656+0000","last_became_active":"2024-09-15T23:14:32.598103+0000","last_became_peered":"2024-09-15T23:14:32.598103+0000","last_unstale":"2024-09-15T23:14:34.600656+0000","last_undegraded":"2024-09-15T23:14:34.600656+0000","last_fullsized":"2024-09-15T23:14:34.600656+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:53.611115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870796+0000","last_change":"2024-09-15T23:14:33.611352+0000","last_active":"2024-09-15T23:14:34.870796+0000","last_peered":"2024-09-15T23:14:34.870796+0000","last_clean":"2024-09-15T23:14:34.870796+0000","last_became_active":"2024-09-15T23:14:33.604202+0000","last_became_peered":"2024-09-15T23:14:33.604202+0000","last_unstale":"2024-09-15T23:14:34.870796+0000","last_undegraded":"2024-09-15T23:14:34.870796+0000","last_fullsized":"2024-09-15T23:14:34.870796+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:51:52.572026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.587195+0000","last_change":"2024-09-15T23:14:32.593219+0000","last_active":"2024-09-15T23:14:34.587195+0000","last_peered":"2024-09-15T23:14:34.587195+0000","last_clean":"2024-09-15T23:14:34.587195+0000","last_became_active":"2024-09-15T23:14:32.592950+0000","last_became_peered":"2024-09-15T23:14:32.592950+0000","last_unstale":"2024-09-15T23:14:34.587195+0000","last_undegraded":"2024-09-15T23:14:34.587195+0000","last_fullsized":"2024-09-15T23:14:34.587195+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:01.719983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.588178+0000","last_change":"2024-09-15T23:14:33.612632+0000","last_active":"2024-09-15T23:14:34.588178+0000","last_peered":"2024-09-15T23:14:34.588178+0000","last_clean":"2024-09-15T23:14:34.588178+0000","last_became_active":"2024-09-15T23:14:33.612381+0000","last_became_peered":"2024-09-15T23:14:33.612381+0000","last_unstale":"2024-09-15T23:14:34.588178+0000","last_undegraded":"2024-09-15T23:14:34.588178+0000","last_fullsized":"2024-09-15T23:14:34.588178+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:30:02.046156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870370+0000","last_change":"2024-09-15T23:14:32.591220+0000","last_active":"2024-09-15T23:14:34.870370+0000","last_peered":"2024-09-15T23:14:34.870370+0000","last_clean":"2024-09-15T23:14:34.870370+0000","last_became_active":"2024-09-15T23:14:32.590921+0000","last_became_peered":"2024-09-15T23:14:32.590921+0000","last_unstale":"2024-09-15T23:14:34.870370+0000","last_undegraded":"2024-09-15T23:14:34.870370+0000","last_fullsized":"2024-09-15T23:14:34.870370+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:15:08.197312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870491+0000","last_change":"2024-09-15T23:14:33.604651+0000","last_active":"2024-09-15T23:14:34.870491+0000","last_peered":"2024-09-15T23:14:34.870491+0000","last_clean":"2024-09-15T23:14:34.870491+0000","last_became_active":"2024-09-15T23:14:33.604293+0000","last_became_peered":"2024-09-15T23:14:33.604293+0000","last_unstale":"2024-09-15T23:14:34.870491+0000","last_undegraded":"2024-09-15T23:14:34.870491+0000","last_fullsized":"2024-09-15T23:14:34.870491+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:35:55.174184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.587601+0000","last_change":"2024-09-15T23:14:32.598334+0000","last_active":"2024-09-15T23:14:34.587601+0000","last_peered":"2024-09-15T23:14:34.587601+0000","last_clean":"2024-09-15T23:14:34.587601+0000","last_became_active":"2024-09-15T23:14:32.598002+0000","last_became_peered":"2024-09-15T23:14:32.598002+0000","last_unstale":"2024-09-15T23:14:34.587601+0000","last_undegraded":"2024-09-15T23:14:34.587601+0000","last_fullsized":"2024-09-15T23:14:34.587601+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:34:02.994426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.598948+0000","last_change":"2024-09-15T23:14:33.613973+0000","last_active":"2024-09-15T23:14:34.598948+0000","last_peered":"2024-09-15T23:14:34.598948+0000","last_clean":"2024-09-15T23:14:34.598948+0000","last_became_active":"2024-09-15T23:14:33.613716+0000","last_became_peered":"2024-09-15T23:14:33.613716+0000","last_unstale":"2024-09-15T23:14:34.598948+0000","last_undegraded":"2024-09-15T23:14:34.598948+0000","last_fullsized":"2024-09-15T23:14:34.598948+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:33.954777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.587846+0000","last_change":"2024-09-15T23:14:32.591944+0000","last_active":"2024-09-15T23:14:34.587846+0000","last_peered":"2024-09-15T23:14:34.587846+0000","last_clean":"2024-09-15T23:14:34.587846+0000","last_became_active":"2024-09-15T23:14:32.591681+0000","last_became_peered":"2024-09-15T23:14:32.591681+0000","last_unstale":"2024-09-15T23:14:34.587846+0000","last_undegraded":"2024-09-15T23:14:34.587846+0000","last_fullsized":"2024-09-15T23:14:34.587846+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:03:53.942681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.869178+0000","last_change":"2024-09-15T23:14:33.613199+0000","last_active":"2024-09-15T23:14:34.869178+0000","last_peered":"2024-09-15T23:14:34.869178+0000","last_clean":"2024-09-15T23:14:34.869178+0000","last_became_active":"2024-09-15T23:14:33.612958+0000","last_became_peered":"2024-09-15T23:14:33.612958+0000","last_unstale":"2024-09-15T23:14:34.869178+0000","last_undegraded":"2024-09-15T23:14:34.869178+0000","last_fullsized":"2024-09-15T23:14:34.869178+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:40.113827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870001+0000","last_change":"2024-09-15T23:14:32.594660+0000","last_active":"2024-09-15T23:14:34.870001+0000","last_peered":"2024-09-15T23:14:34.870001+0000","last_clean":"2024-09-15T23:14:34.870001+0000","last_became_active":"2024-09-15T23:14:32.594416+0000","last_became_peered":"2024-09-15T23:14:32.594416+0000","last_unstale":"2024-09-15T23:14:34.870001+0000","last_undegraded":"2024-09-15T23:14:34.870001+0000","last_fullsized":"2024-09-15T23:14:34.870001+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:36.324104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.588348+0000","last_change":"2024-09-15T23:14:33.599241+0000","last_active":"2024-09-15T23:14:34.588348+0000","last_peered":"2024-09-15T23:14:34.588348+0000","last_clean":"2024-09-15T23:14:34.588348+0000","last_became_active":"2024-09-15T23:14:33.598785+0000","last_became_peered":"2024-09-15T23:14:33.598785+0000","last_unstale":"2024-09-15T23:14:34.588348+0000","last_undegraded":"2024-09-15T23:14:34.588348+0000","last_fullsized":"2024-09-15T23:14:34.588348+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:20:17.704319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.870730+0000","last_change":"2024-09-15T23:14:32.592678+0000","last_active":"2024-09-15T23:14:34.870730+0000","last_peered":"2024-09-15T23:14:34.870730+0000","last_clean":"2024-09-15T23:14:34.870730+0000","last_became_active":"2024-09-15T23:14:32.592382+0000","last_became_peered":"2024-09-15T23:14:32.592382+0000","last_unstale":"2024-09-15T23:14:34.870730+0000","last_undegraded":"2024-09-15T23:14:34.870730+0000","last_fullsized":"2024-09-15T23:14:34.870730+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:59.169628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.599145+0000","last_change":"2024-09-15T23:14:33.611152+0000","last_active":"2024-09-15T23:14:34.599145+0000","last_peered":"2024-09-15T23:14:34.599145+0000","last_clean":"2024-09-15T23:14:34.599145+0000","last_became_active":"2024-09-15T23:14:33.610807+0000","last_became_peered":"2024-09-15T23:14:33.610807+0000","last_unstale":"2024-09-15T23:14:34.599145+0000","last_undegraded":"2024-09-15T23:14:34.599145+0000","last_fullsized":"2024-09-15T23:14:34.599145+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:32.573018+0000","last_clean_scrub_stamp":"2024-09-15T23:14:32.573018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:25.100460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"51'2","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.588083+0000","last_change":"2024-09-15T23:14:32.599246+0000","last_active":"2024-09-15T23:14:34.588083+0000","last_peered":"2024-09-15T23:14:34.588083+0000","last_clean":"2024-09-15T23:14:34.588083+0000","last_became_active":"2024-09-15T23:14:32.598890+0000","last_became_peered":"2024-09-15T23:14:32.598890+0000","last_unstale":"2024-09-15T23:14:34.588083+0000","last_undegraded":"2024-09-15T23:14:34.588083+0000","last_fullsized":"2024-09-15T23:14:34.588083+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:14:31.568796+0000","last_clean_scrub_stamp":"2024-09-15T23:14:31.568796+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:18.350284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":227,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-09-15T23:14:34.869281+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:14:34.869281+0000","last_peered":"2024-09-15T23:14:34.869281+0000","last_clean":"2024-09-15T23:14:34.869281+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:14:34.869281+0000","last_undegraded":"2024-09-15T23:14:34.869281+0000","last_fullsized":"2024-09-15T23:14:34.869281+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476773,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40108,"kb_used_data":600,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331732,"statfs":{"total":96636764160,"available":96595693568,"internally_reserved":0,"allocated":614400,"data_stored":253417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476770,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35944,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335896,"statfs":{"total":96636764160,"available":96599957504,"internally_reserved":0,"allocated":606208,"data_stored":251895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476772,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36520,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335320,"statfs":{"total":96636764160,"available":96599367680,"internally_reserved":0,"allocated":1200128,"data_stored":842243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476772,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31784,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340056,"statfs":{"total":96636764160,"available":96604217344,"internally_reserved":0,"allocated":610304,"data_stored":252477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542179,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35948,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335892,"statfs":{"total":96636764160,"available":96599953408,"internally_reserved":0,"allocated":606208,"data_stored":251839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542179,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35952,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335888,"statfs":{"total":96636764160,"available":96599949312,"internally_reserved":0,"allocated":610304,"data_stored":252421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542178,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36520,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335320,"statfs":{"total":96636764160,"available":96599367680,"internally_reserved":0,"allocated":1200128,"data_stored":842195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542180,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35960,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335880,"statfs":{"total":96636764160,"available":96599941120,"internally_reserved":0,"allocated":622592,"data_stored":253509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:14:41.847 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T23:14:41.847 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T23:14:41.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.990+0000 7efe86ed7640 1 Processor -- start 2024-09-15T23:14:41.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.990+0000 7efe86ed7640 1 -- start start 2024-09-15T23:14:41.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.991+0000 7efe86ed7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efe800af5f0 0x7efe8006f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:41.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.991+0000 7efe86ed7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efe800b3810 0x7efe800b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:41.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.991+0000 7efe86ed7640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe800afe00 con 0x7efe8015fb10 2024-09-15T23:14:41.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.991+0000 7efe86ed7640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7efe800afbb0 con 0x7efe800af5f0 2024-09-15T23:14:41.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.991+0000 7efe86ed7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7efe800cf280 con 0x7efe800b3810 2024-09-15T23:14:41.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.991+0000 7efe77fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efe800af5f0 0x7efe8006f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:41.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.991+0000 7efe84c73640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7efe8015fb10 0x7efe8006edc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:57476/0 (socket says 172.21.15.123:57476) 2024-09-15T23:14:41.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.991+0000 7efe77fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efe800af5f0 0x7efe8006f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51724/0 (socket says 172.21.15.123:51724) 2024-09-15T23:14:41.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.991+0000 7efe84c73640 1 -- 172.21.15.123:0/2284104556 learned_addr learned my addr 172.21.15.123:0/2284104556 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:41.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.991+0000 7efe85474640 1 --2- 172.21.15.123:0/2284104556 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efe800b3810 0x7efe800b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:41.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.991+0000 7efe77fff640 1 -- 172.21.15.123:0/2284104556 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efe800b3810 msgr2=0x7efe800b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:41.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.991+0000 7efe77fff640 1 --2- 172.21.15.123:0/2284104556 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efe800b3810 0x7efe800b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:41.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.991+0000 7efe77fff640 1 -- 172.21.15.123:0/2284104556 >> v1:172.21.15.123:6789/0 conn(0x7efe8015fb10 legacy=0x7efe8006edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:41.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.991+0000 7efe77fff640 1 -- 172.21.15.123:0/2284104556 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe800cf560 con 0x7efe800af5f0 2024-09-15T23:14:41.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.991+0000 7efe777fe640 1 -- 172.21.15.123:0/2284104556 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3501882820 0 0) 0x7efe800afe00 con 0x7efe8015fb10 2024-09-15T23:14:41.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.991+0000 7efe85474640 1 --2- 172.21.15.123:0/2284104556 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efe800b3810 0x7efe800b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:41.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.992+0000 7efe77fff640 1 --2- 172.21.15.123:0/2284104556 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe800af5f0 0x7efe8006f4d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7efe700097a0 tx=0x7efe7002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9498190e48cc0da8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:41.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.992+0000 7efe777fe640 1 -- 172.21.15.123:0/2284104556 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe70037070 con 0x7efe800af5f0 2024-09-15T23:14:41.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.992+0000 7efe777fe640 1 -- 172.21.15.123:0/2284104556 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe7002ae50 con 0x7efe800af5f0 2024-09-15T23:14:41.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.992+0000 7efe777fe640 1 -- 172.21.15.123:0/2284104556 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe70032660 con 0x7efe800af5f0 2024-09-15T23:14:41.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.993+0000 7efe86ed7640 1 -- 172.21.15.123:0/2284104556 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe800af5f0 msgr2=0x7efe8006f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:41.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.993+0000 7efe86ed7640 1 --2- 172.21.15.123:0/2284104556 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe800af5f0 0x7efe8006f4d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7efe700097a0 tx=0x7efe7002a100 comp rx=0 tx=0).stop 2024-09-15T23:14:41.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.993+0000 7efe86ed7640 1 -- 172.21.15.123:0/2284104556 shutdown_connections 2024-09-15T23:14:41.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.993+0000 7efe86ed7640 1 --2- 172.21.15.123:0/2284104556 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efe800b3810 0x7efe800b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:41.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.993+0000 7efe86ed7640 1 --2- 172.21.15.123:0/2284104556 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe800af5f0 0x7efe8006f4d0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:41.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.993+0000 7efe86ed7640 1 -- 172.21.15.123:0/2284104556 >> 172.21.15.123:0/2284104556 conn(0x7efe800b2510 msgr2=0x7efe800b28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:41.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.993+0000 7efe86ed7640 1 -- 172.21.15.123:0/2284104556 shutdown_connections 2024-09-15T23:14:41.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.993+0000 7efe86ed7640 1 -- 172.21.15.123:0/2284104556 wait complete. 2024-09-15T23:14:41.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.994+0000 7efe86ed7640 1 Processor -- start 2024-09-15T23:14:41.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.994+0000 7efe86ed7640 1 -- start start 2024-09-15T23:14:41.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.995+0000 7efe86ed7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efe800af5f0 0x7efe801599b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:41.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.995+0000 7efe86ed7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe800b3810 0x7efe800aa460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:41.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.995+0000 7efe86ed7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efe8015fb10 0x7efe800ac540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:41.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.995+0000 7efe86ed7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efe800d0040 con 0x7efe800b3810 2024-09-15T23:14:41.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.995+0000 7efe86ed7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7efe800cfb20 con 0x7efe800af5f0 2024-09-15T23:14:41.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.995+0000 7efe86ed7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7efe800d01c0 con 0x7efe8015fb10 2024-09-15T23:14:41.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.995+0000 7efe77fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe800b3810 0x7efe800aa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:41.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.995+0000 7efe77fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe800b3810 0x7efe800aa460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51736/0 (socket says 172.21.15.123:51736) 2024-09-15T23:14:41.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.995+0000 7efe77fff640 1 -- 172.21.15.123:0/3118817724 learned_addr learned my addr 172.21.15.123:0/3118817724 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:41.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.995+0000 7efe84c73640 1 --2- 172.21.15.123:0/3118817724 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efe800af5f0 0x7efe801599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:41.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.995+0000 7efe77fff640 1 -- 172.21.15.123:0/3118817724 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efe8015fb10 msgr2=0x7efe800ac540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:41.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.995+0000 7efe77fff640 1 --2- 172.21.15.123:0/3118817724 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efe8015fb10 0x7efe800ac540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:41.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.995+0000 7efe77fff640 1 -- 172.21.15.123:0/3118817724 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efe800af5f0 msgr2=0x7efe801599b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:41.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.995+0000 7efe77fff640 1 --2- 172.21.15.123:0/3118817724 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efe800af5f0 0x7efe801599b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:41.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.995+0000 7efe77fff640 1 -- 172.21.15.123:0/3118817724 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe800af400 con 0x7efe800b3810 2024-09-15T23:14:41.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.995+0000 7efe77fff640 1 --2- 172.21.15.123:0/3118817724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe800b3810 0x7efe800aa460 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7efe70035040 tx=0x7efe700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:42.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.995+0000 7efe757fa640 1 -- 172.21.15.123:0/3118817724 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe70041070 con 0x7efe800b3810 2024-09-15T23:14:42.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.995+0000 7efe757fa640 1 -- 172.21.15.123:0/3118817724 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe7003c670 con 0x7efe800b3810 2024-09-15T23:14:42.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.995+0000 7efe86ed7640 1 -- 172.21.15.123:0/3118817724 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe801570f0 con 0x7efe800b3810 2024-09-15T23:14:42.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.995+0000 7efe757fa640 1 -- 172.21.15.123:0/3118817724 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe70037040 con 0x7efe800b3810 2024-09-15T23:14:42.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.996+0000 7efe86ed7640 1 -- 172.21.15.123:0/3118817724 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe801576b0 con 0x7efe800b3810 2024-09-15T23:14:42.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.997+0000 7efe86ed7640 1 -- 172.21.15.123:0/3118817724 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe800b3ca0 con 0x7efe800b3810 2024-09-15T23:14:42.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.997+0000 7efe757fa640 1 -- 172.21.15.123:0/3118817724 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7efe7003a070 con 0x7efe800b3810 2024-09-15T23:14:42.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.998+0000 7efe757fa640 1 --2- 172.21.15.123:0/3118817724 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efe6c06c2b0 0x7efe6c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:42.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.998+0000 7efe757fa640 1 -- 172.21.15.123:0/3118817724 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7efe700ab820 con 0x7efe800b3810 2024-09-15T23:14:42.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.998+0000 7efe84c73640 1 --2- 172.21.15.123:0/3118817724 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efe6c06c2b0 0x7efe6c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:42.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:41.998+0000 7efe84c73640 1 --2- 172.21.15.123:0/3118817724 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efe6c06c2b0 0x7efe6c06e770 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efe7c000f60 tx=0x7efe7c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:42.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.002+0000 7efe757fa640 1 -- 172.21.15.123:0/3118817724 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efe7007a0b0 con 0x7efe800b3810 2024-09-15T23:14:42.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.231+0000 7efe86ed7640 1 -- 172.21.15.123:0/3118817724 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7efe8015ef70 con 0x7efe800b3810 2024-09-15T23:14:42.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.233+0000 7efe757fa640 1 -- 172.21.15.123:0/3118817724 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) ==== 190+0+147 (secure 0 0 0) 0x7efe700799b0 con 0x7efe800b3810 2024-09-15T23:14:42.234 INFO:teuthology.orchestra.run.smithi123.stdout:[client.0] 2024-09-15T23:14:42.234 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCNaedmzQPqJRAAhUf1dnVYohN4obCfeu8+7g== 2024-09-15T23:14:42.234 INFO:teuthology.orchestra.run.smithi123.stdout: caps mds = "allow" 2024-09-15T23:14:42.234 INFO:teuthology.orchestra.run.smithi123.stdout: caps mon = "allow r" 2024-09-15T23:14:42.234 INFO:teuthology.orchestra.run.smithi123.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T23:14:42.234 INFO:teuthology.orchestra.run.smithi123.stderr:updated caps for client.0 2024-09-15T23:14:42.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.235+0000 7efe86ed7640 1 -- 172.21.15.123:0/3118817724 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efe6c06c2b0 msgr2=0x7efe6c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:42.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.235+0000 7efe86ed7640 1 --2- 172.21.15.123:0/3118817724 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efe6c06c2b0 0x7efe6c06e770 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efe7c000f60 tx=0x7efe7c009040 comp rx=0 tx=0).stop 2024-09-15T23:14:42.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.235+0000 7efe86ed7640 1 -- 172.21.15.123:0/3118817724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe800b3810 msgr2=0x7efe800aa460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:42.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.235+0000 7efe86ed7640 1 --2- 172.21.15.123:0/3118817724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe800b3810 0x7efe800aa460 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7efe70035040 tx=0x7efe700046c0 comp rx=0 tx=0).stop 2024-09-15T23:14:42.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.235+0000 7efe86ed7640 1 -- 172.21.15.123:0/3118817724 shutdown_connections 2024-09-15T23:14:42.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.235+0000 7efe86ed7640 1 --2- 172.21.15.123:0/3118817724 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efe8015fb10 0x7efe800ac540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:42.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.235+0000 7efe86ed7640 1 --2- 172.21.15.123:0/3118817724 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efe6c06c2b0 0x7efe6c06e770 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:42.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.235+0000 7efe86ed7640 1 --2- 172.21.15.123:0/3118817724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efe800b3810 0x7efe800aa460 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:42.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.235+0000 7efe86ed7640 1 --2- 172.21.15.123:0/3118817724 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efe800af5f0 0x7efe801599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:42.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.235+0000 7efe86ed7640 1 -- 172.21.15.123:0/3118817724 >> 172.21.15.123:0/3118817724 conn(0x7efe800b2510 msgr2=0x7efe8015e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:42.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.235+0000 7efe86ed7640 1 -- 172.21.15.123:0/3118817724 shutdown_connections 2024-09-15T23:14:42.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.235+0000 7efe86ed7640 1 -- 172.21.15.123:0/3118817724 wait complete. 2024-09-15T23:14:42.247 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:14:42.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.345+0000 7ff70d76d640 1 Processor -- start 2024-09-15T23:14:42.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.345+0000 7ff70d76d640 1 -- start start 2024-09-15T23:14:42.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.345+0000 7ff70d76d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff70815eb60 0x7ff70815ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:42.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.345+0000 7ff70d76d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff7081624b0 0x7ff7080d2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:42.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.345+0000 7ff70d76d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff7080b66a0 0x7ff7080b6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:42.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.345+0000 7ff70d76d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7ff70815f590 con 0x7ff7081624b0 2024-09-15T23:14:42.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.346+0000 7ff70d76d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7ff70815f870 con 0x7ff7080b66a0 2024-09-15T23:14:42.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.346+0000 7ff70d76d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ff70815fb50 con 0x7ff70815eb60 2024-09-15T23:14:42.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.346+0000 7ff6fe7fc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff7081624b0 0x7ff7080d2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:42.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.346+0000 7ff6fe7fc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff7081624b0 0x7ff7080d2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51748/0 (socket says 172.21.15.123:51748) 2024-09-15T23:14:42.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.346+0000 7ff6fe7fc640 1 -- 172.21.15.123:0/1774343420 learned_addr learned my addr 172.21.15.123:0/1774343420 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:42.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.346+0000 7ff6fe7fc640 1 -- 172.21.15.123:0/1774343420 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff70815eb60 msgr2=0x7ff70815ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:42.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.346+0000 7ff6fe7fc640 1 --2- 172.21.15.123:0/1774343420 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff70815eb60 0x7ff70815ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:42.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.346+0000 7ff6fe7fc640 1 -- 172.21.15.123:0/1774343420 >> v2:172.21.15.188:3300/0 conn(0x7ff7080b66a0 msgr2=0x7ff7080b6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:42.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.346+0000 7ff7077fe640 1 --2- 172.21.15.123:0/1774343420 >> v2:172.21.15.188:3300/0 conn(0x7ff7080b66a0 0x7ff7080b6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:42.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.346+0000 7ff6fe7fc640 1 --2- 172.21.15.123:0/1774343420 >> v2:172.21.15.188:3300/0 conn(0x7ff7080b66a0 0x7ff7080b6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:42.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.346+0000 7ff6fe7fc640 1 -- 172.21.15.123:0/1774343420 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff70815fe30 con 0x7ff7081624b0 2024-09-15T23:14:42.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.347+0000 7ff6fe7fc640 1 --2- 172.21.15.123:0/1774343420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7081624b0 0x7ff7080d2c50 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff7081623f0 tx=0x7ff6f002a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca679f2d086b6a1d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:42.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.347+0000 7ff7067fc640 1 -- 172.21.15.123:0/1774343420 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0037070 con 0x7ff7081624b0 2024-09-15T23:14:42.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.347+0000 7ff7067fc640 1 -- 172.21.15.123:0/1774343420 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6f002ae00 con 0x7ff7081624b0 2024-09-15T23:14:42.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.347+0000 7ff7067fc640 1 -- 172.21.15.123:0/1774343420 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0032660 con 0x7ff7081624b0 2024-09-15T23:14:42.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.347+0000 7ff70d76d640 1 -- 172.21.15.123:0/1774343420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7081624b0 msgr2=0x7ff7080d2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:42.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.347+0000 7ff70d76d640 1 --2- 172.21.15.123:0/1774343420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7081624b0 0x7ff7080d2c50 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff7081623f0 tx=0x7ff6f002a0b0 comp rx=0 tx=0).stop 2024-09-15T23:14:42.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.347+0000 7ff70d76d640 1 -- 172.21.15.123:0/1774343420 shutdown_connections 2024-09-15T23:14:42.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.347+0000 7ff70d76d640 1 --2- 172.21.15.123:0/1774343420 >> v2:172.21.15.188:3300/0 conn(0x7ff7080b66a0 0x7ff7080b6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:42.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.347+0000 7ff70d76d640 1 --2- 172.21.15.123:0/1774343420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7081624b0 0x7ff7080d2c50 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:42.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.347+0000 7ff70d76d640 1 --2- 172.21.15.123:0/1774343420 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff70815eb60 0x7ff70815ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:42.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.347+0000 7ff70d76d640 1 -- 172.21.15.123:0/1774343420 >> 172.21.15.123:0/1774343420 conn(0x7ff7080d16f0 msgr2=0x7ff7080d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:42.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.347+0000 7ff70d76d640 1 -- 172.21.15.123:0/1774343420 shutdown_connections 2024-09-15T23:14:42.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.347+0000 7ff70d76d640 1 -- 172.21.15.123:0/1774343420 wait complete. 2024-09-15T23:14:42.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.349+0000 7ff70d76d640 1 Processor -- start 2024-09-15T23:14:42.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.349+0000 7ff70d76d640 1 -- start start 2024-09-15T23:14:42.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.349+0000 7ff70d76d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7080b66a0 0x7ff7081f5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:42.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.349+0000 7ff70d76d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff70815eb60 0x7ff708154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:42.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.349+0000 7ff70d76d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7081624b0 0x7ff70815af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:42.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.349+0000 7ff70d76d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff7080d4480 con 0x7ff7081624b0 2024-09-15T23:14:42.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.349+0000 7ff70d76d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff7080d3190 con 0x7ff7080b66a0 2024-09-15T23:14:42.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.349+0000 7ff70d76d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ff7080d4600 con 0x7ff70815eb60 2024-09-15T23:14:42.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.350+0000 7ff7077fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7081624b0 0x7ff70815af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:42.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.350+0000 7ff7077fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7081624b0 0x7ff70815af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51750/0 (socket says 172.21.15.123:51750) 2024-09-15T23:14:42.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.350+0000 7ff7077fe640 1 -- 172.21.15.123:0/4241844255 learned_addr learned my addr 172.21.15.123:0/4241844255 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:42.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.350+0000 7ff6fe7fc640 1 --2- 172.21.15.123:0/4241844255 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff70815eb60 0x7ff708154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:42.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.350+0000 7ff706ffd640 1 --2- 172.21.15.123:0/4241844255 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7080b66a0 0x7ff7081f5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:42.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.350+0000 7ff7077fe640 1 -- 172.21.15.123:0/4241844255 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff70815eb60 msgr2=0x7ff708154a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:42.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.350+0000 7ff7077fe640 1 --2- 172.21.15.123:0/4241844255 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff70815eb60 0x7ff708154a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:42.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.350+0000 7ff7077fe640 1 -- 172.21.15.123:0/4241844255 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7080b66a0 msgr2=0x7ff7081f5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:42.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.350+0000 7ff7077fe640 1 --2- 172.21.15.123:0/4241844255 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7080b66a0 0x7ff7081f5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:42.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.350+0000 7ff7077fe640 1 -- 172.21.15.123:0/4241844255 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7081f6130 con 0x7ff7081624b0 2024-09-15T23:14:42.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.350+0000 7ff706ffd640 1 --2- 172.21.15.123:0/4241844255 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7080b66a0 0x7ff7081f5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:42.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.350+0000 7ff7077fe640 1 --2- 172.21.15.123:0/4241844255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7081624b0 0x7ff70815af20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff70000cd70 tx=0x7ff70000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:42.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.350+0000 7ff6fffff640 1 -- 172.21.15.123:0/4241844255 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff700003b90 con 0x7ff7081624b0 2024-09-15T23:14:42.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.350+0000 7ff6fffff640 1 -- 172.21.15.123:0/4241844255 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff700003d30 con 0x7ff7081624b0 2024-09-15T23:14:42.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.350+0000 7ff70d76d640 1 -- 172.21.15.123:0/4241844255 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff70815d9f0 con 0x7ff7081624b0 2024-09-15T23:14:42.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.350+0000 7ff6fffff640 1 -- 172.21.15.123:0/4241844255 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff700004240 con 0x7ff7081624b0 2024-09-15T23:14:42.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.350+0000 7ff70d76d640 1 -- 172.21.15.123:0/4241844255 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff70815c540 con 0x7ff7081624b0 2024-09-15T23:14:42.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.351+0000 7ff70d76d640 1 -- 172.21.15.123:0/4241844255 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff70815f060 con 0x7ff7081624b0 2024-09-15T23:14:42.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.352+0000 7ff6fffff640 1 -- 172.21.15.123:0/4241844255 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff7000043e0 con 0x7ff7081624b0 2024-09-15T23:14:42.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.352+0000 7ff6fffff640 1 --2- 172.21.15.123:0/4241844255 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff6e806c2b0 0x7ff6e806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:42.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.352+0000 7ff6fffff640 1 -- 172.21.15.123:0/4241844255 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7ff70008be90 con 0x7ff7081624b0 2024-09-15T23:14:42.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.352+0000 7ff706ffd640 1 --2- 172.21.15.123:0/4241844255 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff6e806c2b0 0x7ff6e806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:42.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.353+0000 7ff706ffd640 1 --2- 172.21.15.123:0/4241844255 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff6e806c2b0 0x7ff6e806e770 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff7080d0850 tx=0x7ff6f8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:42.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.356+0000 7ff6fffff640 1 -- 172.21.15.123:0/4241844255 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff7081f6130 con 0x7ff7081624b0 2024-09-15T23:14:42.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.555+0000 7ff70d76d640 1 -- 172.21.15.123:0/4241844255 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff7080cec80 con 0x7ff7081624b0 2024-09-15T23:14:42.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.556+0000 7ff6fffff640 1 -- 172.21.15.123:0/4241844255 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5229 (secure 0 0 0) 0x7ff70005a600 con 0x7ff7081624b0 2024-09-15T23:14:42.559 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:14:42.559 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":21,"btime":"2024-09-15T23:14:36:243751+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5014,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/354247514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":354247514},{"type":"v1","addr":"172.21.15.188:6837","nonce":354247514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2925346627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2925346627},{"type":"v1","addr":"172.21.15.123:6834","nonce":2925346627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/280703051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":280703051},{"type":"v1","addr":"172.21.15.123:6835","nonce":280703051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:14:32.926325+0000","modified":"2024-09-15T23:14:35.577957+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6836/1307575248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":1307575248},{"type":"v1","addr":"172.21.15.188:6836","nonce":1307575248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":3}]} 2024-09-15T23:14:42.560 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 21 2024-09-15T23:14:42.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.558+0000 7ff70d76d640 1 -- 172.21.15.123:0/4241844255 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff6e806c2b0 msgr2=0x7ff6e806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:42.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.558+0000 7ff70d76d640 1 --2- 172.21.15.123:0/4241844255 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff6e806c2b0 0x7ff6e806e770 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff7080d0850 tx=0x7ff6f8008040 comp rx=0 tx=0).stop 2024-09-15T23:14:42.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.558+0000 7ff70d76d640 1 -- 172.21.15.123:0/4241844255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7081624b0 msgr2=0x7ff70815af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:42.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.558+0000 7ff70d76d640 1 --2- 172.21.15.123:0/4241844255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7081624b0 0x7ff70815af20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff70000cd70 tx=0x7ff70000a660 comp rx=0 tx=0).stop 2024-09-15T23:14:42.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.558+0000 7ff70d76d640 1 -- 172.21.15.123:0/4241844255 shutdown_connections 2024-09-15T23:14:42.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.558+0000 7ff70d76d640 1 --2- 172.21.15.123:0/4241844255 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff6e806c2b0 0x7ff6e806e770 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:42.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.558+0000 7ff70d76d640 1 --2- 172.21.15.123:0/4241844255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7081624b0 0x7ff70815af20 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:42.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.558+0000 7ff70d76d640 1 --2- 172.21.15.123:0/4241844255 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff70815eb60 0x7ff708154a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:42.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.558+0000 7ff70d76d640 1 --2- 172.21.15.123:0/4241844255 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7080b66a0 0x7ff7081f5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:42.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.558+0000 7ff70d76d640 1 -- 172.21.15.123:0/4241844255 >> 172.21.15.123:0/4241844255 conn(0x7ff7080d16f0 msgr2=0x7ff7080b4710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:42.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.558+0000 7ff70d76d640 1 -- 172.21.15.123:0/4241844255 shutdown_connections 2024-09-15T23:14:42.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:42.558+0000 7ff70d76d640 1 -- 172.21.15.123:0/4241844255 wait complete. 2024-09-15T23:14:42.973 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:14:32.926325+0000', 'modified': '2024-09-15T23:14:35.577957+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5256}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5256': {'gid': 5256, 'name': 'd', 'rank': 0, 'incarnation': 18, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.188:6836/1307575248', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6834', 'nonce': 1307575248}, {'type': 'v1', 'addr': '172.21.15.188:6836', 'nonce': 1307575248}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5256, 'qdb_cluster': [5256]} 2024-09-15T23:14:42.973 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:14:42.973 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-15T23:14:43.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.072+0000 7fdc1ea7b640 1 Processor -- start 2024-09-15T23:14:43.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.072+0000 7fdc1ea7b640 1 -- start start 2024-09-15T23:14:43.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.073+0000 7fdc1ea7b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fdc1815e6d0 0x7fdc18071390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:43.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.073+0000 7fdc1ea7b640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc1815eab0 con 0x7fdc18070b80 2024-09-15T23:14:43.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.073+0000 7fdc1ea7b640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc1815ed70 con 0x7fdc1806cd20 2024-09-15T23:14:43.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.073+0000 7fdc1ea7b640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fdc1815f050 con 0x7fdc1815e6d0 2024-09-15T23:14:43.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.073+0000 7fdc1d018640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fdc18070b80 0x7fdc181622a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:57478/0 (socket says 172.21.15.123:57478) 2024-09-15T23:14:43.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.073+0000 7fdc1d018640 1 -- 172.21.15.123:0/2843388518 learned_addr learned my addr 172.21.15.123:0/2843388518 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:43.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.073+0000 7fdc1c817640 1 --2- 172.21.15.123:0/2843388518 >> v2:172.21.15.188:3300/0 conn(0x7fdc1815e6d0 0x7fdc18071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:43.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.073+0000 7fdc0f7fe640 1 -- 172.21.15.123:0/2843388518 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 148970834 0 0) 0x7fdc1815eab0 con 0x7fdc18070b80 2024-09-15T23:14:43.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.073+0000 7fdc0f7fe640 1 -- 172.21.15.123:0/2843388518 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc00003520 con 0x7fdc18070b80 2024-09-15T23:14:43.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.073+0000 7fdc0f7fe640 1 -- 172.21.15.123:0/2843388518 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3084598713 0 0) 0x7fdc00003520 con 0x7fdc18070b80 2024-09-15T23:14:43.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.073+0000 7fdc0f7fe640 1 -- 172.21.15.123:0/2843388518 >> v2:172.21.15.188:3300/0 conn(0x7fdc1815e6d0 msgr2=0x7fdc18071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:43.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.073+0000 7fdc0f7fe640 1 --2- 172.21.15.123:0/2843388518 >> v2:172.21.15.188:3300/0 conn(0x7fdc1815e6d0 0x7fdc18071390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.073+0000 7fdc0f7fe640 1 -- 172.21.15.123:0/2843388518 >> v1:172.21.15.188:6789/0 conn(0x7fdc1806cd20 legacy=0x7fdc180b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:43.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.073+0000 7fdc0f7fe640 1 -- 172.21.15.123:0/2843388518 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc1815f330 con 0x7fdc18070b80 2024-09-15T23:14:43.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.073+0000 7fdc0f7fe640 1 -- 172.21.15.123:0/2843388518 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fdc100019f0 con 0x7fdc18070b80 2024-09-15T23:14:43.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.073+0000 7fdc0f7fe640 1 -- 172.21.15.123:0/2843388518 >> v1:172.21.15.123:6789/0 conn(0x7fdc18070b80 legacy=0x7fdc181622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:43.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.074+0000 7fdc0f7fe640 1 --2- 172.21.15.123:0/2843388518 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc000039b0 0x7fdc00003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:43.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.074+0000 7fdc0f7fe640 1 --2- 172.21.15.123:0/2843388518 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc00004800 0x7fdc00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:43.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.074+0000 7fdc0f7fe640 1 --2- 172.21.15.123:0/2843388518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc000051c0 0x7fdc0000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:43.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.074+0000 7fdc0f7fe640 1 -- 172.21.15.123:0/2843388518 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdc1815f050 con 0x7fdc000051c0 2024-09-15T23:14:43.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.074+0000 7fdc0f7fe640 1 -- 172.21.15.123:0/2843388518 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0000c060 con 0x7fdc00004800 2024-09-15T23:14:43.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.074+0000 7fdc0f7fe640 1 -- 172.21.15.123:0/2843388518 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fdc0000c260 con 0x7fdc000039b0 2024-09-15T23:14:43.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.074+0000 7fdc1d018640 1 --2- 172.21.15.123:0/2843388518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc000051c0 0x7fdc0000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:43.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.074+0000 7fdc1c817640 1 --2- 172.21.15.123:0/2843388518 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc000039b0 0x7fdc00003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:43.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.074+0000 7fdc0ffff640 1 --2- 172.21.15.123:0/2843388518 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc00004800 0x7fdc00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:43.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.074+0000 7fdc1d018640 1 -- 172.21.15.123:0/2843388518 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc000039b0 msgr2=0x7fdc00003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:43.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.074+0000 7fdc1d018640 1 --2- 172.21.15.123:0/2843388518 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc000039b0 0x7fdc00003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.074+0000 7fdc1d018640 1 -- 172.21.15.123:0/2843388518 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc00004800 msgr2=0x7fdc00004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:43.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.074+0000 7fdc1d018640 1 --2- 172.21.15.123:0/2843388518 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc00004800 0x7fdc00004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.074+0000 7fdc1d018640 1 -- 172.21.15.123:0/2843388518 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc00003520 con 0x7fdc000051c0 2024-09-15T23:14:43.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.075+0000 7fdc1d018640 1 -- 172.21.15.123:0/2843388518 reap_dead start 2024-09-15T23:14:43.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.075+0000 7fdc1d018640 1 --2- 172.21.15.123:0/2843388518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc000051c0 0x7fdc0000b9c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdc1000a840 tx=0x7fdc00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=203aae03d802bbde server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:43.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.075+0000 7fdc0f7fe640 1 -- 172.21.15.123:0/2843388518 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1000a460 con 0x7fdc000051c0 2024-09-15T23:14:43.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.075+0000 7fdc0f7fe640 1 -- 172.21.15.123:0/2843388518 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc1002f070 con 0x7fdc000051c0 2024-09-15T23:14:43.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.075+0000 7fdc0f7fe640 1 -- 172.21.15.123:0/2843388518 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1002bcb0 con 0x7fdc000051c0 2024-09-15T23:14:43.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.075+0000 7fdc1ea7b640 1 -- 172.21.15.123:0/2843388518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc000051c0 msgr2=0x7fdc0000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:43.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.075+0000 7fdc1ea7b640 1 --2- 172.21.15.123:0/2843388518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc000051c0 0x7fdc0000b9c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdc1000a840 tx=0x7fdc00005830 comp rx=0 tx=0).stop 2024-09-15T23:14:43.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.075+0000 7fdc1ea7b640 1 -- 172.21.15.123:0/2843388518 shutdown_connections 2024-09-15T23:14:43.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.075+0000 7fdc1ea7b640 1 --2- 172.21.15.123:0/2843388518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc000051c0 0x7fdc0000b9c0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.075+0000 7fdc1ea7b640 1 -- 172.21.15.123:0/2843388518 >> 172.21.15.123:0/2843388518 conn(0x7fdc18067fb0 msgr2=0x7fdc1806f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:43.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.075+0000 7fdc1ea7b640 1 -- 172.21.15.123:0/2843388518 shutdown_connections 2024-09-15T23:14:43.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.075+0000 7fdc1ea7b640 1 -- 172.21.15.123:0/2843388518 wait complete. 2024-09-15T23:14:43.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.076+0000 7fdc1ea7b640 1 Processor -- start 2024-09-15T23:14:43.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.077+0000 7fdc1ea7b640 1 -- start start 2024-09-15T23:14:43.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.077+0000 7fdc1ea7b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc000051c0 0x7fdc181f6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:43.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.077+0000 7fdc1ea7b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc181f5280 0x7fdc1815d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:43.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.077+0000 7fdc1ea7b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc1815d810 0x7fdc181f42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:43.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.077+0000 7fdc1ea7b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdc18071390 con 0x7fdc000051c0 2024-09-15T23:14:43.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.077+0000 7fdc1ea7b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fdc1815f8f0 con 0x7fdc181f5280 2024-09-15T23:14:43.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.077+0000 7fdc1ea7b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fdc18071510 con 0x7fdc1815d810 2024-09-15T23:14:43.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.077+0000 7fdc1c817640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc000051c0 0x7fdc181f6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:43.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.077+0000 7fdc1c817640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc000051c0 0x7fdc181f6f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51772/0 (socket says 172.21.15.123:51772) 2024-09-15T23:14:43.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.078+0000 7fdc1c817640 1 -- 172.21.15.123:0/3774927061 learned_addr learned my addr 172.21.15.123:0/3774927061 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:43.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.078+0000 7fdc0ffff640 1 --2- 172.21.15.123:0/3774927061 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc181f5280 0x7fdc1815d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:43.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.078+0000 7fdc1d018640 1 --2- 172.21.15.123:0/3774927061 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc1815d810 0x7fdc181f42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:43.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.078+0000 7fdc1c817640 1 -- 172.21.15.123:0/3774927061 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc1815d810 msgr2=0x7fdc181f42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:43.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.078+0000 7fdc1c817640 1 --2- 172.21.15.123:0/3774927061 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc1815d810 0x7fdc181f42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.078+0000 7fdc1c817640 1 -- 172.21.15.123:0/3774927061 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc181f5280 msgr2=0x7fdc1815d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:43.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.078+0000 7fdc1c817640 1 --2- 172.21.15.123:0/3774927061 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc181f5280 0x7fdc1815d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.078+0000 7fdc1c817640 1 -- 172.21.15.123:0/3774927061 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc181f7460 con 0x7fdc000051c0 2024-09-15T23:14:43.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.078+0000 7fdc0ffff640 1 --2- 172.21.15.123:0/3774927061 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc181f5280 0x7fdc1815d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:43.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.078+0000 7fdc1c817640 1 --2- 172.21.15.123:0/3774927061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc000051c0 0x7fdc181f6f20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdc140118e0 tx=0x7fdc14011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:43.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.078+0000 7fdc0d7fa640 1 -- 172.21.15.123:0/3774927061 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1400faf0 con 0x7fdc000051c0 2024-09-15T23:14:43.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.078+0000 7fdc0d7fa640 1 -- 172.21.15.123:0/3774927061 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc1400fc90 con 0x7fdc000051c0 2024-09-15T23:14:43.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.078+0000 7fdc0d7fa640 1 -- 172.21.15.123:0/3774927061 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc14014440 con 0x7fdc000051c0 2024-09-15T23:14:43.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.078+0000 7fdc1ea7b640 1 -- 172.21.15.123:0/3774927061 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc181f5020 con 0x7fdc000051c0 2024-09-15T23:14:43.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.078+0000 7fdc1ea7b640 1 -- 172.21.15.123:0/3774927061 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc1815ae80 con 0x7fdc000051c0 2024-09-15T23:14:43.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.080+0000 7fdc0d7fa640 1 -- 172.21.15.123:0/3774927061 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdc14012040 con 0x7fdc000051c0 2024-09-15T23:14:43.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.080+0000 7fdc0d7fa640 1 --2- 172.21.15.123:0/3774927061 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdc0406c2e0 0x7fdc0406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:43.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.080+0000 7fdc0d7fa640 1 -- 172.21.15.123:0/3774927061 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7fdc1408bac0 con 0x7fdc000051c0 2024-09-15T23:14:43.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.080+0000 7fdc0ffff640 1 --2- 172.21.15.123:0/3774927061 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdc0406c2e0 0x7fdc0406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:43.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.081+0000 7fdc0ffff640 1 --2- 172.21.15.123:0/3774927061 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdc0406c2e0 0x7fdc0406e7a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdc180b7cb0 tx=0x7fdc08009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:43.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.081+0000 7fdc21818740 1 Processor -- start 2024-09-15T23:14:43.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.081+0000 7fdc21818740 1 -- start start 2024-09-15T23:14:43.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.082+0000 7fdc21818740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56043c8882c0 0x56043c8cda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:43.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.082+0000 7fdc21818740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56043c885a80 0x56043c8886a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:43.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.082+0000 7fdc21818740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56043c889a50 0x56043c8828b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:43.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.082+0000 7fdc21818740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56043c7ea520 con 0x56043c885a80 2024-09-15T23:14:43.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.082+0000 7fdc21818740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56043c7923e0 con 0x56043c889a50 2024-09-15T23:14:43.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.082+0000 7fdc21818740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x56043c7e64e0 con 0x56043c8882c0 2024-09-15T23:14:43.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.082+0000 7fdc0ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56043c885a80 0x56043c8886a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:43.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.082+0000 7fdc0ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56043c885a80 0x56043c8886a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51782/0 (socket says 172.21.15.123:51782) 2024-09-15T23:14:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.082+0000 7fdc0ffff640 1 -- 172.21.15.123:0/1073519169 learned_addr learned my addr 172.21.15.123:0/1073519169 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.082+0000 7fdc1c817640 1 --2- 172.21.15.123:0/1073519169 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56043c8882c0 0x56043c8cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.082+0000 7fdc1d018640 1 --2- 172.21.15.123:0/1073519169 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56043c889a50 0x56043c8828b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.082+0000 7fdc0ffff640 1 -- 172.21.15.123:0/1073519169 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56043c8882c0 msgr2=0x56043c8cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.082+0000 7fdc0ffff640 1 --2- 172.21.15.123:0/1073519169 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56043c8882c0 0x56043c8cda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.082+0000 7fdc0ffff640 1 -- 172.21.15.123:0/1073519169 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56043c889a50 msgr2=0x56043c8828b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.082+0000 7fdc0ffff640 1 --2- 172.21.15.123:0/1073519169 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56043c889a50 0x56043c8828b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.082+0000 7fdc0ffff640 1 -- 172.21.15.123:0/1073519169 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56043c7ad2f0 con 0x56043c885a80 2024-09-15T23:14:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.082+0000 7fdc0ffff640 1 --2- 172.21.15.123:0/1073519169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56043c885a80 0x56043c8886a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fdc08001680 tx=0x7fdc08013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac999951fdde05f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.082+0000 7fdbfe7fc640 1 -- 172.21.15.123:0/1073519169 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc08027070 con 0x56043c885a80 2024-09-15T23:14:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.082+0000 7fdbfe7fc640 1 -- 172.21.15.123:0/1073519169 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc08014840 con 0x56043c885a80 2024-09-15T23:14:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.082+0000 7fdbfe7fc640 1 -- 172.21.15.123:0/1073519169 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc08014bf0 con 0x56043c885a80 2024-09-15T23:14:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.083+0000 7fdc21818740 1 -- 172.21.15.123:0/1073519169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56043c885a80 msgr2=0x56043c8886a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.083+0000 7fdc21818740 1 --2- 172.21.15.123:0/1073519169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56043c885a80 0x56043c8886a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fdc08001680 tx=0x7fdc08013000 comp rx=0 tx=0).stop 2024-09-15T23:14:43.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.083+0000 7fdc21818740 1 -- 172.21.15.123:0/1073519169 shutdown_connections 2024-09-15T23:14:43.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.083+0000 7fdc21818740 1 --2- 172.21.15.123:0/1073519169 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56043c889a50 0x56043c8828b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.083+0000 7fdc21818740 1 --2- 172.21.15.123:0/1073519169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56043c885a80 0x56043c8886a0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.083+0000 7fdc21818740 1 --2- 172.21.15.123:0/1073519169 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56043c8882c0 0x56043c8cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.083+0000 7fdc21818740 1 -- 172.21.15.123:0/1073519169 >> 172.21.15.123:0/1073519169 conn(0x56043c884a80 msgr2=0x56043c8ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:43.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.083+0000 7fdc21818740 1 -- 172.21.15.123:0/1073519169 shutdown_connections 2024-09-15T23:14:43.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.083+0000 7fdc21818740 1 -- 172.21.15.123:0/1073519169 wait complete. 2024-09-15T23:14:43.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.084+0000 7fdc21818740 1 -- start start 2024-09-15T23:14:43.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.084+0000 7fdc21818740 1 Processor -- start 2024-09-15T23:14:43.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.085+0000 7fdc21818740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56043c8882c0 0x56043c8ac050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:43.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.085+0000 7fdc21818740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56043c889a50 0x56043c8a9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:43.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.085+0000 7fdc21818740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56043c8b1ca0 0x56043c8dd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:43.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.085+0000 7fdc21818740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56043c883f20 con 0x56043c889a50 2024-09-15T23:14:43.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.085+0000 7fdc21818740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56043c773450 con 0x56043c8b1ca0 2024-09-15T23:14:43.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.085+0000 7fdc21818740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x56043c8ce290 con 0x56043c8882c0 2024-09-15T23:14:43.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.085+0000 7fdc21818740 10 client.0 _ll_register_callbacks cb 0x56043c4fcac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:43.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.085+0000 7fdc0ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56043c889a50 0x56043c8a9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:43.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.085+0000 7fdc0ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56043c889a50 0x56043c8a9ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51784/0 (socket says 172.21.15.123:51784) 2024-09-15T23:14:43.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.085+0000 7fdc0ffff640 1 -- 172.21.15.123:0/88384842 learned_addr learned my addr 172.21.15.123:0/88384842 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:43.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.085+0000 7fdc1d018640 1 --2- 172.21.15.123:0/88384842 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56043c8b1ca0 0x56043c8dd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:43.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.085+0000 7fdc1c817640 1 --2- 172.21.15.123:0/88384842 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56043c8882c0 0x56043c8ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:43.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.085+0000 7fdc0ffff640 1 -- 172.21.15.123:0/88384842 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56043c8882c0 msgr2=0x56043c8ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:43.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.085+0000 7fdc0ffff640 1 --2- 172.21.15.123:0/88384842 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56043c8882c0 0x56043c8ac050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.085+0000 7fdc0ffff640 1 -- 172.21.15.123:0/88384842 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56043c8b1ca0 msgr2=0x56043c8dd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:43.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.085+0000 7fdc0ffff640 1 --2- 172.21.15.123:0/88384842 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56043c8b1ca0 0x56043c8dd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.085+0000 7fdc0ffff640 1 -- 172.21.15.123:0/88384842 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56043c4fd2d0 con 0x56043c889a50 2024-09-15T23:14:43.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.085+0000 7fdc0ffff640 1 --2- 172.21.15.123:0/88384842 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56043c889a50 0x56043c8a9ab0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fdc08005620 tx=0x7fdc08001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a61def1156010f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:43.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.085+0000 7fdbf77fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:43.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.085+0000 7fdbf77fe640 1 -- 172.21.15.123:0/88384842 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc08027040 con 0x56043c889a50 2024-09-15T23:14:43.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.085+0000 7fdbf77fe640 1 -- 172.21.15.123:0/88384842 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7fdc080216e0 con 0x56043c889a50 2024-09-15T23:14:43.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.085+0000 7fdc21818740 1 -- 172.21.15.123:0/88384842 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc08014840 con 0x56043c889a50 2024-09-15T23:14:43.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.085+0000 7fdbf77fe640 1 -- 172.21.15.123:0/88384842 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fdc08039050 con 0x56043c889a50 2024-09-15T23:14:43.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.085+0000 7fdc21818740 10 client.5415 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:43.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.085+0000 7fdc21818740 1 -- 172.21.15.123:0/88384842 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x56043c5c76b0 con 0x56043c889a50 2024-09-15T23:14:43.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.086+0000 7fdbf77fe640 1 -- 172.21.15.123:0/88384842 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc08014840 con 0x56043c889a50 2024-09-15T23:14:43.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.086+0000 7fdbf77fe640 1 -- 172.21.15.123:0/88384842 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7fdc0803c020 con 0x56043c889a50 2024-09-15T23:14:43.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.086+0000 7fdc21818740 10 client.5415 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:43.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.086+0000 7fdc21818740 10 client.5415 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-15T23:14:43.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.086+0000 7fdc21818740 20 client.5415 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:43.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.086+0000 7fdc21818740 1 --2- 172.21.15.123:0/88384842 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x56043c8e6e50 0x56043c8eb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:43.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.086+0000 7fdc21818740 4 client.5415 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:14:43.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.086+0000 7fdc21818740 1 -- 172.21.15.123:0/88384842 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56043c7f7c50 con 0x56043c8e6e50 2024-09-15T23:14:43.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.086+0000 7fdc1c817640 1 --2- 172.21.15.123:0/88384842 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x56043c8e6e50 0x56043c8eb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:43.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.086+0000 7fdbf77fe640 10 client.5415 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:43.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.086+0000 7fdc1c817640 1 --2- 172.21.15.123:0/88384842 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x56043c8e6e50 0x56043c8eb0f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cf674457cbf9923 server_cookie=2e112fe39c79f4d0 in_seq=0 out_seq=0 2024-09-15T23:14:43.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.087+0000 7fdbf77fe640 1 -- 172.21.15.123:0/88384842 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56043c7f7c50 con 0x56043c8e6e50 2024-09-15T23:14:43.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.087+0000 7fdbf77fe640 10 client.5415 handle_command_reply: tid=0 2024-09-15T23:14:43.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.087+0000 7fdc21818740 1 client.5415 shutdown 2024-09-15T23:14:43.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.087+0000 7fdc21818740 1 -- 172.21.15.123:0/88384842 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56043c889a50 msgr2=0x56043c8a9ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:43.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.087+0000 7fdc21818740 1 --2- 172.21.15.123:0/88384842 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56043c889a50 0x56043c8a9ab0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fdc08005620 tx=0x7fdc08001120 comp rx=0 tx=0).stop 2024-09-15T23:14:43.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.087+0000 7fdc21818740 1 -- 172.21.15.123:0/88384842 shutdown_connections 2024-09-15T23:14:43.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.087+0000 7fdc21818740 1 --2- 172.21.15.123:0/88384842 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x56043c8e6e50 0x56043c8eb0f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.087+0000 7fdc21818740 1 --2- 172.21.15.123:0/88384842 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56043c8b1ca0 0x56043c8dd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.087+0000 7fdc21818740 1 --2- 172.21.15.123:0/88384842 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56043c889a50 0x56043c8a9ab0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.087+0000 7fdbf77fe640 0 client.5415 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:43.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.087+0000 7fdc21818740 1 --2- 172.21.15.123:0/88384842 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56043c8882c0 0x56043c8ac050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.087+0000 7fdc21818740 1 -- 172.21.15.123:0/88384842 >> 172.21.15.123:0/88384842 conn(0x56043c885a80 msgr2=0x56043c8cc750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:43.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.088+0000 7fdc21818740 1 -- 172.21.15.123:0/88384842 shutdown_connections 2024-09-15T23:14:43.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.088+0000 7fdc21818740 1 -- 172.21.15.123:0/88384842 wait complete. 2024-09-15T23:14:43.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.088+0000 7fdc21818740 20 client.5415 trim_cache size 0 max 16384 2024-09-15T23:14:43.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.105+0000 7fdc21818740 1 Processor -- start 2024-09-15T23:14:43.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.105+0000 7fdc21818740 1 -- start start 2024-09-15T23:14:43.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.106+0000 7fdc21818740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56043c8882c0 0x56043c8cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:43.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.106+0000 7fdc21818740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56043c889a50 0x56043c8cc720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:43.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.106+0000 7fdc21818740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56043c8b1ca0 0x56043c947210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:43.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.106+0000 7fdc21818740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdc18200420 con 0x56043c889a50 2024-09-15T23:14:43.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.106+0000 7fdc21818740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fdc181ff900 con 0x56043c8b1ca0 2024-09-15T23:14:43.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.106+0000 7fdc21818740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fdc181ffe00 con 0x56043c8882c0 2024-09-15T23:14:43.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.106+0000 7fdc0ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56043c889a50 0x56043c8cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:43.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.106+0000 7fdc0ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56043c889a50 0x56043c8cc720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51786/0 (socket says 172.21.15.123:51786) 2024-09-15T23:14:43.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.106+0000 7fdc0ffff640 1 -- 172.21.15.123:0/3088280333 learned_addr learned my addr 172.21.15.123:0/3088280333 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:43.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.106+0000 7fdc1d018640 1 --2- 172.21.15.123:0/3088280333 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56043c8b1ca0 0x56043c947210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:43.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.106+0000 7fdc1c817640 1 --2- 172.21.15.123:0/3088280333 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56043c8882c0 0x56043c8cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:43.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.106+0000 7fdc0ffff640 1 -- 172.21.15.123:0/3088280333 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56043c8882c0 msgr2=0x56043c8cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:43.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.106+0000 7fdc0ffff640 1 --2- 172.21.15.123:0/3088280333 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56043c8882c0 0x56043c8cb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.106+0000 7fdc0ffff640 1 -- 172.21.15.123:0/3088280333 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56043c8b1ca0 msgr2=0x56043c947210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:43.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.106+0000 7fdc0ffff640 1 --2- 172.21.15.123:0/3088280333 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56043c8b1ca0 0x56043c947210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.106+0000 7fdc0ffff640 1 -- 172.21.15.123:0/3088280333 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56043c8aa900 con 0x56043c889a50 2024-09-15T23:14:43.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.106+0000 7fdc1c817640 1 --2- 172.21.15.123:0/3088280333 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56043c8882c0 0x56043c8cb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:43.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.106+0000 7fdc1d018640 1 --2- 172.21.15.123:0/3088280333 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56043c8b1ca0 0x56043c947210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:43.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.106+0000 7fdc0ffff640 1 --2- 172.21.15.123:0/3088280333 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56043c889a50 0x56043c8cc720 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fdc08001eb0 tx=0x7fdc0802b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a3ecac337ea0a2e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:43.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.106+0000 7fdbfdffb640 1 -- 172.21.15.123:0/3088280333 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc08027050 con 0x56043c889a50 2024-09-15T23:14:43.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.107+0000 7fdbfdffb640 1 -- 172.21.15.123:0/3088280333 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc080146c0 con 0x56043c889a50 2024-09-15T23:14:43.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.107+0000 7fdbfdffb640 1 -- 172.21.15.123:0/3088280333 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc08021720 con 0x56043c889a50 2024-09-15T23:14:43.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.107+0000 7fdc21818740 1 -- 172.21.15.123:0/3088280333 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56043c889a50 msgr2=0x56043c8cc720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:43.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.107+0000 7fdc21818740 1 --2- 172.21.15.123:0/3088280333 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56043c889a50 0x56043c8cc720 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fdc08001eb0 tx=0x7fdc0802b000 comp rx=0 tx=0).stop 2024-09-15T23:14:43.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.107+0000 7fdc21818740 1 -- 172.21.15.123:0/3088280333 shutdown_connections 2024-09-15T23:14:43.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.107+0000 7fdc21818740 1 --2- 172.21.15.123:0/3088280333 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56043c8b1ca0 0x56043c947210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.107+0000 7fdc21818740 1 --2- 172.21.15.123:0/3088280333 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56043c889a50 0x56043c8cc720 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.107+0000 7fdc21818740 1 --2- 172.21.15.123:0/3088280333 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56043c8882c0 0x56043c8cb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.107+0000 7fdc21818740 1 -- 172.21.15.123:0/3088280333 >> 172.21.15.123:0/3088280333 conn(0x56043c885a80 msgr2=0x56043c8aa1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:43.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.107+0000 7fdc21818740 1 -- 172.21.15.123:0/3088280333 shutdown_connections 2024-09-15T23:14:43.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.107+0000 7fdc21818740 1 -- 172.21.15.123:0/3088280333 wait complete. 2024-09-15T23:14:43.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.108+0000 7fdc21818740 1 -- start start 2024-09-15T23:14:43.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.108+0000 7fdc21818740 1 Processor -- start 2024-09-15T23:14:43.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.109+0000 7fdc21818740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56043c8882c0 0x56043c930650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:43.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.109+0000 7fdc21818740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56043c889a50 0x56043c8e5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:43.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.109+0000 7fdc21818740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56043c8b1ca0 0x56043c8e64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:43.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.109+0000 7fdc21818740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56043c8de6f0 con 0x56043c8882c0 2024-09-15T23:14:43.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.109+0000 7fdc21818740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56043c8de270 con 0x56043c8b1ca0 2024-09-15T23:14:43.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.109+0000 7fdc21818740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x56043c8e72f0 con 0x56043c889a50 2024-09-15T23:14:43.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.109+0000 7fdc21818740 10 client.0 _ll_register_callbacks cb 0x7fdc08025070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:43.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.109+0000 7fdc1c817640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56043c8882c0 0x56043c930650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:43.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.109+0000 7fdc1c817640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56043c8882c0 0x56043c930650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51802/0 (socket says 172.21.15.123:51802) 2024-09-15T23:14:43.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.109+0000 7fdc1c817640 1 -- 172.21.15.123:0/48593728 learned_addr learned my addr 172.21.15.123:0/48593728 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:43.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.109+0000 7fdc1d018640 1 --2- 172.21.15.123:0/48593728 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56043c8b1ca0 0x56043c8e64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:43.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.109+0000 7fdc0ffff640 1 --2- 172.21.15.123:0/48593728 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56043c889a50 0x56043c8e5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:43.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.109+0000 7fdc1c817640 1 -- 172.21.15.123:0/48593728 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56043c889a50 msgr2=0x56043c8e5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:43.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.109+0000 7fdc1c817640 1 --2- 172.21.15.123:0/48593728 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56043c889a50 0x56043c8e5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.109+0000 7fdc1c817640 1 -- 172.21.15.123:0/48593728 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56043c8b1ca0 msgr2=0x56043c8e64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:43.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.109+0000 7fdc1c817640 1 --2- 172.21.15.123:0/48593728 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56043c8b1ca0 0x56043c8e64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.109+0000 7fdc1c817640 1 -- 172.21.15.123:0/48593728 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56043c942ed0 con 0x56043c8882c0 2024-09-15T23:14:43.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.109+0000 7fdc0ffff640 1 --2- 172.21.15.123:0/48593728 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56043c889a50 0x56043c8e5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:43.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.109+0000 7fdc1c817640 1 --2- 172.21.15.123:0/48593728 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56043c8882c0 0x56043c930650 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fdc140118b0 tx=0x7fdc1405e030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc7964b5d9a3b140 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:43.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.109+0000 7fdbf77fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:43.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.109+0000 7fdbf77fe640 1 -- 172.21.15.123:0/48593728 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc14078020 con 0x56043c8882c0 2024-09-15T23:14:43.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.109+0000 7fdbf77fe640 1 -- 172.21.15.123:0/48593728 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7fdc14056230 con 0x56043c8882c0 2024-09-15T23:14:43.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.109+0000 7fdc21818740 1 -- 172.21.15.123:0/48593728 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc080146c0 con 0x56043c8882c0 2024-09-15T23:14:43.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.109+0000 7fdbf77fe640 1 -- 172.21.15.123:0/48593728 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fdc14062310 con 0x56043c8882c0 2024-09-15T23:14:43.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.109+0000 7fdc21818740 10 client.5421 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:43.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.109+0000 7fdc21818740 1 -- 172.21.15.123:0/48593728 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x56043c930bf0 con 0x56043c8882c0 2024-09-15T23:14:43.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.110+0000 7fdbf77fe640 1 -- 172.21.15.123:0/48593728 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc080146c0 con 0x56043c8882c0 2024-09-15T23:14:43.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.110+0000 7fdbf77fe640 1 -- 172.21.15.123:0/48593728 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7fdc14025030 con 0x56043c8882c0 2024-09-15T23:14:43.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.110+0000 7fdc21818740 10 client.5421 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:43.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.110+0000 7fdc21818740 10 client.5421 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-15T23:14:43.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.110+0000 7fdc21818740 20 client.5421 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:43.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.110+0000 7fdc21818740 1 --2- 172.21.15.123:0/48593728 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x56043c8b1090 0x56043c8e3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:43.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.110+0000 7fdc21818740 4 client.5421 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:14:43.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.110+0000 7fdc21818740 1 -- 172.21.15.123:0/48593728 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "status"}) -- 0x56043c7f1fa0 con 0x56043c8b1090 2024-09-15T23:14:43.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.110+0000 7fdc0ffff640 1 --2- 172.21.15.123:0/48593728 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x56043c8b1090 0x56043c8e3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:43.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.110+0000 7fdbf77fe640 10 client.5421 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:43.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.110+0000 7fdc0ffff640 1 --2- 172.21.15.123:0/48593728 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x56043c8b1090 0x56043c8e3080 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76d5ab1db05592d0 server_cookie=a7e59d5e87e9923a in_seq=0 out_seq=0 2024-09-15T23:14:43.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.110+0000 7fdbf77fe640 1 -- 172.21.15.123:0/48593728 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x56043c7f1fa0 con 0x56043c8b1090 2024-09-15T23:14:43.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.110+0000 7fdbf77fe640 10 client.5421 handle_command_reply: tid=0 2024-09-15T23:14:43.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.111+0000 7fdc21818740 1 client.5421 shutdown 2024-09-15T23:14:43.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.111+0000 7fdc21818740 1 -- 172.21.15.123:0/48593728 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56043c8882c0 msgr2=0x56043c930650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:43.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.111+0000 7fdc21818740 1 --2- 172.21.15.123:0/48593728 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56043c8882c0 0x56043c930650 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fdc140118b0 tx=0x7fdc1405e030 comp rx=0 tx=0).stop 2024-09-15T23:14:43.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.111+0000 7fdc21818740 1 -- 172.21.15.123:0/48593728 shutdown_connections 2024-09-15T23:14:43.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.111+0000 7fdc21818740 1 --2- 172.21.15.123:0/48593728 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x56043c8b1090 0x56043c8e3080 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.111+0000 7fdc21818740 1 --2- 172.21.15.123:0/48593728 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56043c8b1ca0 0x56043c8e64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.111+0000 7fdbf77fe640 0 client.5421 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:43.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.111+0000 7fdc21818740 1 --2- 172.21.15.123:0/48593728 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56043c889a50 0x56043c8e5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.111+0000 7fdc21818740 1 --2- 172.21.15.123:0/48593728 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56043c8882c0 0x56043c930650 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.111+0000 7fdc21818740 1 -- 172.21.15.123:0/48593728 >> 172.21.15.123:0/48593728 conn(0x56043c885a80 msgr2=0x56043c8cb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:43.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.111+0000 7fdc21818740 1 -- 172.21.15.123:0/48593728 shutdown_connections 2024-09-15T23:14:43.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.111+0000 7fdc21818740 1 -- 172.21.15.123:0/48593728 wait complete. 2024-09-15T23:14:43.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.111+0000 7fdc21818740 20 client.5421 trim_cache size 0 max 16384 2024-09-15T23:14:43.119 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:14:43.119 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "cb968ac4-8d3a-4b17-a673-6177aeaea589", 2024-09-15T23:14:43.119 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2024-09-15T23:14:43.119 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 5256, 2024-09-15T23:14:43.119 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-09-15T23:14:43.119 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-09-15T23:14:43.119 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-09-15T23:14:43.120 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 9.5191664209999995, 2024-09-15T23:14:43.120 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 21, 2024-09-15T23:14:43.120 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 52, 2024-09-15T23:14:43.120 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 52, 2024-09-15T23:14:43.120 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 13.592133672999999 2024-09-15T23:14:43.120 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:14:43.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.111+0000 7fdc1ea7b640 1 -- 172.21.15.123:0/3774927061 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdc0406c2e0 msgr2=0x7fdc0406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:43.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.111+0000 7fdc1ea7b640 1 --2- 172.21.15.123:0/3774927061 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdc0406c2e0 0x7fdc0406e7a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdc180b7cb0 tx=0x7fdc08009040 comp rx=0 tx=0).stop 2024-09-15T23:14:43.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.111+0000 7fdc1ea7b640 1 -- 172.21.15.123:0/3774927061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc000051c0 msgr2=0x7fdc181f6f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:43.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.111+0000 7fdc1ea7b640 1 --2- 172.21.15.123:0/3774927061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc000051c0 0x7fdc181f6f20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdc140118e0 tx=0x7fdc14011da0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.111+0000 7fdc1ea7b640 1 -- 172.21.15.123:0/3774927061 shutdown_connections 2024-09-15T23:14:43.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.111+0000 7fdc1ea7b640 1 --2- 172.21.15.123:0/3774927061 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc1815d810 0x7fdc181f42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.111+0000 7fdc1ea7b640 1 --2- 172.21.15.123:0/3774927061 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc181f5280 0x7fdc1815d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.111+0000 7fdc1ea7b640 1 --2- 172.21.15.123:0/3774927061 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdc0406c2e0 0x7fdc0406e7a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.111+0000 7fdc1ea7b640 1 --2- 172.21.15.123:0/3774927061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc000051c0 0x7fdc181f6f20 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.111+0000 7fdc1ea7b640 1 -- 172.21.15.123:0/3774927061 >> 172.21.15.123:0/3774927061 conn(0x7fdc18067fb0 msgr2=0x7fdc18159310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:43.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.111+0000 7fdc1ea7b640 1 -- 172.21.15.123:0/3774927061 shutdown_connections 2024-09-15T23:14:43.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.111+0000 7fdc1ea7b640 1 -- 172.21.15.123:0/3774927061 wait complete. 2024-09-15T23:14:43.123 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:14:43.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.220+0000 7ffa23ca5640 1 Processor -- start 2024-09-15T23:14:43.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.220+0000 7ffa23ca5640 1 -- start start 2024-09-15T23:14:43.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.221+0000 7ffa23ca5640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffa1c15ab40 0x7ffa1c06c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:43.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.221+0000 7ffa23ca5640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa1c15af20 0x7ffa1c15b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:43.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.221+0000 7ffa23ca5640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa1c072520 con 0x7ffa1c0720b0 2024-09-15T23:14:43.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.221+0000 7ffa23ca5640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7ffa1c071010 con 0x7ffa1c15ab40 2024-09-15T23:14:43.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.221+0000 7ffa23ca5640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ffa1c0712f0 con 0x7ffa1c15af20 2024-09-15T23:14:43.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.221+0000 7ffa21a41640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffa1c15ab40 0x7ffa1c06c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:43.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.221+0000 7ffa21a41640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffa1c15ab40 0x7ffa1c06c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51806/0 (socket says 172.21.15.123:51806) 2024-09-15T23:14:43.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.221+0000 7ffa21a41640 1 -- 172.21.15.123:0/3410840613 learned_addr learned my addr 172.21.15.123:0/3410840613 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:43.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.221+0000 7ffa22242640 1 --2- 172.21.15.123:0/3410840613 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa1c15af20 0x7ffa1c15b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:43.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.221+0000 7ffa21a41640 1 -- 172.21.15.123:0/3410840613 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa1c15af20 msgr2=0x7ffa1c15b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:43.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.221+0000 7ffa21a41640 1 --2- 172.21.15.123:0/3410840613 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa1c15af20 0x7ffa1c15b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.221+0000 7ffa21a41640 1 -- 172.21.15.123:0/3410840613 >> v1:172.21.15.188:6789/0 conn(0x7ffa1c0720b0 legacy=0x7ffa1c073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:43.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.221+0000 7ffa21a41640 1 -- 172.21.15.123:0/3410840613 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa1c0715d0 con 0x7ffa1c15ab40 2024-09-15T23:14:43.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.222+0000 7ffa21a41640 1 --2- 172.21.15.123:0/3410840613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa1c15ab40 0x7ffa1c06c6a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ffa18009e50 tx=0x7ffa1802a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a80290f7e0ef8937 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:43.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.222+0000 7ffa20a3f640 1 -- 172.21.15.123:0/3410840613 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa18036070 con 0x7ffa1c15ab40 2024-09-15T23:14:43.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.222+0000 7ffa20a3f640 1 -- 172.21.15.123:0/3410840613 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa18031600 con 0x7ffa1c15ab40 2024-09-15T23:14:43.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.222+0000 7ffa20a3f640 1 -- 172.21.15.123:0/3410840613 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa180319d0 con 0x7ffa1c15ab40 2024-09-15T23:14:43.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.222+0000 7ffa23ca5640 1 -- 172.21.15.123:0/3410840613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa1c15ab40 msgr2=0x7ffa1c06c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:43.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.222+0000 7ffa23ca5640 1 --2- 172.21.15.123:0/3410840613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa1c15ab40 0x7ffa1c06c6a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ffa18009e50 tx=0x7ffa1802a630 comp rx=0 tx=0).stop 2024-09-15T23:14:43.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.223+0000 7ffa23ca5640 1 -- 172.21.15.123:0/3410840613 shutdown_connections 2024-09-15T23:14:43.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.223+0000 7ffa23ca5640 1 --2- 172.21.15.123:0/3410840613 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa1c15af20 0x7ffa1c15b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.223+0000 7ffa23ca5640 1 --2- 172.21.15.123:0/3410840613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa1c15ab40 0x7ffa1c06c6a0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.223+0000 7ffa23ca5640 1 -- 172.21.15.123:0/3410840613 >> 172.21.15.123:0/3410840613 conn(0x7ffa1c0ccec0 msgr2=0x7ffa1c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:43.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.223+0000 7ffa23ca5640 1 -- 172.21.15.123:0/3410840613 shutdown_connections 2024-09-15T23:14:43.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.223+0000 7ffa23ca5640 1 -- 172.21.15.123:0/3410840613 wait complete. 2024-09-15T23:14:43.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.224+0000 7ffa23ca5640 1 Processor -- start 2024-09-15T23:14:43.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.224+0000 7ffa23ca5640 1 -- start start 2024-09-15T23:14:43.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.224+0000 7ffa23ca5640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa1c0720b0 0x7ffa1c159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:43.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.224+0000 7ffa23ca5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa1c15ab40 0x7ffa1c1e6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:43.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.224+0000 7ffa23ca5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa1c15af20 0x7ffa1c1e6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:43.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.224+0000 7ffa23ca5640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1c15ba30 con 0x7ffa1c15af20 2024-09-15T23:14:43.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.224+0000 7ffa23ca5640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1c15b8b0 con 0x7ffa1c15ab40 2024-09-15T23:14:43.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.224+0000 7ffa23ca5640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ffa1c15c1d0 con 0x7ffa1c0720b0 2024-09-15T23:14:43.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.225+0000 7ffa22242640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa1c15af20 0x7ffa1c1e6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:43.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.225+0000 7ffa22242640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa1c15af20 0x7ffa1c1e6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51818/0 (socket says 172.21.15.123:51818) 2024-09-15T23:14:43.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.225+0000 7ffa22242640 1 -- 172.21.15.123:0/2260296087 learned_addr learned my addr 172.21.15.123:0/2260296087 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:43.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.225+0000 7ffa21a41640 1 --2- 172.21.15.123:0/2260296087 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa1c0720b0 0x7ffa1c159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:43.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.225+0000 7ffa21240640 1 --2- 172.21.15.123:0/2260296087 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa1c15ab40 0x7ffa1c1e6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:43.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.225+0000 7ffa22242640 1 -- 172.21.15.123:0/2260296087 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa1c0720b0 msgr2=0x7ffa1c159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:43.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.225+0000 7ffa22242640 1 --2- 172.21.15.123:0/2260296087 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa1c0720b0 0x7ffa1c159230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.225+0000 7ffa22242640 1 -- 172.21.15.123:0/2260296087 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa1c15ab40 msgr2=0x7ffa1c1e6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:43.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.225+0000 7ffa22242640 1 --2- 172.21.15.123:0/2260296087 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa1c15ab40 0x7ffa1c1e6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.225+0000 7ffa22242640 1 -- 172.21.15.123:0/2260296087 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa1c1e2180 con 0x7ffa1c15af20 2024-09-15T23:14:43.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.225+0000 7ffa22242640 1 --2- 172.21.15.123:0/2260296087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa1c15af20 0x7ffa1c1e6bd0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ffa1400c550 tx=0x7ffa1400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:43.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.225+0000 7ffa127fc640 1 -- 172.21.15.123:0/2260296087 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa14015070 con 0x7ffa1c15af20 2024-09-15T23:14:43.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.225+0000 7ffa127fc640 1 -- 172.21.15.123:0/2260296087 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa14004220 con 0x7ffa1c15af20 2024-09-15T23:14:43.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.225+0000 7ffa23ca5640 1 -- 172.21.15.123:0/2260296087 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa1c1e2460 con 0x7ffa1c15af20 2024-09-15T23:14:43.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.225+0000 7ffa127fc640 1 -- 172.21.15.123:0/2260296087 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa14003610 con 0x7ffa1c15af20 2024-09-15T23:14:43.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.225+0000 7ffa23ca5640 1 -- 172.21.15.123:0/2260296087 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa1c1e2a20 con 0x7ffa1c15af20 2024-09-15T23:14:43.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.226+0000 7ffa23ca5640 1 -- 172.21.15.123:0/2260296087 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa1c0b5600 con 0x7ffa1c15af20 2024-09-15T23:14:43.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.227+0000 7ffa127fc640 1 -- 172.21.15.123:0/2260296087 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ffa140037b0 con 0x7ffa1c15af20 2024-09-15T23:14:43.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.227+0000 7ffa127fc640 1 --2- 172.21.15.123:0/2260296087 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ffa0006c2e0 0x7ffa0006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:43.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.227+0000 7ffa127fc640 1 -- 172.21.15.123:0/2260296087 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7ffa1408b110 con 0x7ffa1c15af20 2024-09-15T23:14:43.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.227+0000 7ffa21a41640 1 --2- 172.21.15.123:0/2260296087 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ffa0006c2e0 0x7ffa0006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:43.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.228+0000 7ffa21a41640 1 --2- 172.21.15.123:0/2260296087 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ffa0006c2e0 0x7ffa0006e7a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ffa18033000 tx=0x7ffa18009000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:43.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.232+0000 7ffa127fc640 1 -- 172.21.15.123:0/2260296087 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffa14059230 con 0x7ffa1c15af20 2024-09-15T23:14:43.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.433+0000 7ffa23ca5640 1 -- 172.21.15.123:0/2260296087 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ffa1c15b370 con 0x7ffa1c15af20 2024-09-15T23:14:43.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.433+0000 7ffa127fc640 1 -- 172.21.15.123:0/2260296087 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) ==== 53+0+73 (secure 0 0 0) 0x7ffa1405d530 con 0x7ffa1c15af20 2024-09-15T23:14:43.434 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:14:43.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.435+0000 7ffa23ca5640 1 -- 172.21.15.123:0/2260296087 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ffa0006c2e0 msgr2=0x7ffa0006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:43.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.435+0000 7ffa23ca5640 1 --2- 172.21.15.123:0/2260296087 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ffa0006c2e0 0x7ffa0006e7a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ffa18033000 tx=0x7ffa18009000 comp rx=0 tx=0).stop 2024-09-15T23:14:43.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.435+0000 7ffa23ca5640 1 -- 172.21.15.123:0/2260296087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa1c15af20 msgr2=0x7ffa1c1e6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:43.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.435+0000 7ffa23ca5640 1 --2- 172.21.15.123:0/2260296087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa1c15af20 0x7ffa1c1e6bd0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ffa1400c550 tx=0x7ffa1400ca10 comp rx=0 tx=0).stop 2024-09-15T23:14:43.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.435+0000 7ffa23ca5640 1 -- 172.21.15.123:0/2260296087 shutdown_connections 2024-09-15T23:14:43.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.435+0000 7ffa23ca5640 1 --2- 172.21.15.123:0/2260296087 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ffa0006c2e0 0x7ffa0006e7a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.435+0000 7ffa23ca5640 1 --2- 172.21.15.123:0/2260296087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa1c15af20 0x7ffa1c1e6bd0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.435+0000 7ffa23ca5640 1 --2- 172.21.15.123:0/2260296087 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa1c15ab40 0x7ffa1c1e6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.435+0000 7ffa23ca5640 1 --2- 172.21.15.123:0/2260296087 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa1c0720b0 0x7ffa1c159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:43.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.435+0000 7ffa23ca5640 1 -- 172.21.15.123:0/2260296087 >> 172.21.15.123:0/2260296087 conn(0x7ffa1c0ccec0 msgr2=0x7ffa1c1ead30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:43.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.435+0000 7ffa23ca5640 1 -- 172.21.15.123:0/2260296087 shutdown_connections 2024-09-15T23:14:43.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43.435+0000 7ffa23ca5640 1 -- 172.21.15.123:0/2260296087 wait complete. 2024-09-15T23:14:43.448 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T23:14:43.448 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:14:43.448 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-09-15T23:14:43.448 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T23:14:43.448 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T23:14:43.448 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T23:14:43.448 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T23:14:43.448 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:14:43.448 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:14:43.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:14:43.449 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-09-15T23:14:43.464 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:14:43.464 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:14:43.464 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:14:43.464 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:14:43.464 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-09-15T23:14:43.464 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:14:43.464 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:14:43.465 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-09-15T23:14:43.465 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f0 2024-09-15T23:14:43.465 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:14:43.465 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:14:43.465 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f1 2024-09-15T23:14:43.465 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:14:43.465 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:14:43.465 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:14:43.465 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:14:43.465 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T23:14:43.465 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42657sec preferred_lft 42657sec 2024-09-15T23:14:43.465 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link noprefixroute 2024-09-15T23:14:43.465 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:14:43.465 INFO:teuthology.orchestra.run.smithi123.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:14:43.466 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 46:55:5a:e0:32:4d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:14:43.466 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:14:43.466 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:14:43.466 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::1c6f:d5ff:fe19:ff05/64 scope link 2024-09-15T23:14:43.466 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:14:43.466 INFO:teuthology.orchestra.run.smithi123.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:14:43.466 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 46:55:5a:e0:32:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:14:43.466 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::4455:5aff:fee0:324d/64 scope link 2024-09-15T23:14:43.466 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:14:43.466 INFO:teuthology.orchestra.run.smithi123.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:14:43.466 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether be:c1:f3:63:cb:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:14:43.466 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::bcc1:f3ff:fe63:cb24/64 scope link 2024-09-15T23:14:43.466 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:14:43.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:14:43.467 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:14:43.528 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-09-15T23:14:43.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:14:43.529 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-09-15T23:14:43.586 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-09-15T23:14:43.586 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:14:43.586 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:14:43.586 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:14:43.586 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:14:43.587 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:14:43.587 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:14:43.587 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:14:43.587 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:14:43.587 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:14:43.587 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:14:43.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:14:43.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:14:43.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:14:43.711 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-09-15T23:14:43.726 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T23:14:43.726 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:14:43.726 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:14:43.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:14:43.726 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2024-09-15T23:14:43.790 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:14:43.791 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T23:14:43.846 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:14:43.846 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:14:43.846 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:14:43.901 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T23:14:43.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:14:43.902 DEBUG:teuthology.orchestra.run.smithi123:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:14:43.986 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:14:43.986 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:14:43.986 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:14:43.994 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:14:43.994 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:14:43.995 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:14:43.995 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.188:3300,172.21.15.188:3301" 2024-09-15T23:14:43.995 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T23:14:44.000 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:14:44.001 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:14:44.001 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:14:44.001 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.188:3300,172.21.15.188:3301" 2024-09-15T23:14:44.001 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T23:14:44.001 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:6789,172.21.15.188:6789,172.21.15.188:6790" 2024-09-15T23:14:44.001 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.123:6789,172.21.15.188:6789,172.21.15.188:6790:/ 2024-09-15T23:14:44.001 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=cb968ac4-8d3a-4b17-a673-6177aeaea589" will pass to kernel 2024-09-15T23:14:44.002 INFO:teuthology.orchestra.run.smithi123.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-15T23:14:44.002 INFO:teuthology.orchestra.run.smithi123.stdout: You just mounted a file system that supports labels which does not 2024-09-15T23:14:44.002 INFO:teuthology.orchestra.run.smithi123.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T23:14:44.002 INFO:teuthology.orchestra.run.smithi123.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T23:14:44.002 INFO:teuthology.orchestra.run.smithi123.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T23:14:44.003 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T23:14:44.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:14:44.004 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:14:44.028 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T23:14:44.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:14:44.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:14:44.130 INFO:teuthology.orchestra.run.smithi123.stdout:client5095 2024-09-15T23:14:44.131 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:14:44.131 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:14:44.147 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-09-15T23:14:44.147 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_test_path 2024-09-15T23:14:44.147 INFO:tasks.cephfs.test_scrub_checks:Cloning repo into place 2024-09-15T23:14:44.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:14:44.147 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p /home/ubuntu/cephtest/mnt.0/scrub_test_path) 2024-09-15T23:14:44.208 DEBUG:teuthology.orchestra.run.smithi123:> stdin-killer -- python3 -c ' 2024-09-15T23:14:44.208 DEBUG:teuthology.orchestra.run.smithi123:> import os 2024-09-15T23:14:44.208 DEBUG:teuthology.orchestra.run.smithi123:> import stat 2024-09-15T23:14:44.208 DEBUG:teuthology.orchestra.run.smithi123:> import json 2024-09-15T23:14:44.208 DEBUG:teuthology.orchestra.run.smithi123:> import sys 2024-09-15T23:14:44.208 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-15T23:14:44.208 DEBUG:teuthology.orchestra.run.smithi123:> try: 2024-09-15T23:14:44.208 DEBUG:teuthology.orchestra.run.smithi123:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'"'"') 2024-09-15T23:14:44.208 DEBUG:teuthology.orchestra.run.smithi123:> except OSError as e: 2024-09-15T23:14:44.208 DEBUG:teuthology.orchestra.run.smithi123:> sys.exit(e.errno) 2024-09-15T23:14:44.208 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-15T23:14:44.209 DEBUG:teuthology.orchestra.run.smithi123:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-15T23:14:44.209 DEBUG:teuthology.orchestra.run.smithi123:> print(json.dumps( 2024-09-15T23:14:44.209 DEBUG:teuthology.orchestra.run.smithi123:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-15T23:14:44.209 DEBUG:teuthology.orchestra.run.smithi123:> indent=2)) 2024-09-15T23:14:44.209 DEBUG:teuthology.orchestra.run.smithi123:> ' 2024-09-15T23:14:44.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:44 stdin-killer INFO: command exited with status 2: exiting normally with same code! 2024-09-15T23:14:44.323 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-15T23:14:44.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:14:44.324 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone --branch giant http://github.com/ceph/ceph-qa-suite /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite) 2024-09-15T23:14:44.382 INFO:teuthology.orchestra.run.smithi123.stderr:Cloning into '/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'... 2024-09-15T23:14:44.541 INFO:teuthology.orchestra.run.smithi123.stderr:warning: redirecting to https://github.com/ceph/ceph-qa-suite/ 2024-09-15T23:14:47.521 INFO:teuthology.orchestra.run.smithi123.stderr:Updating files: 45% (641/1398) Updating files: 46% (644/1398) Updating files: 47% (658/1398) Updating files: 48% (672/1398) Updating files: 49% (686/1398) Updating files: 50% (699/1398) Updating files: 51% (713/1398) Updating files: 52% (727/1398) Updating files: 53% (741/1398) Updating files: 54% (755/1398) Updating files: 55% (769/1398) Updating files: 56% (783/1398) Updating files: 57% (797/1398) Updating files: 58% (811/1398) Updating files: 59% (825/1398) Updating files: 60% (839/1398) Updating files: 61% (853/1398) Updating files: 62% (867/1398) Updating files: 63% (881/1398) Updating files: 64% (895/1398) Updating files: 65% (909/1398) Updating files: 66% (923/1398) Updating files: 67% (937/1398) Updating files: 68% (951/1398) Updating files: 69% (965/1398) Updating files: 70% (979/1398) Updating files: 71% (993/1398) Updating files: 72% (1007/1398) Updating files: 73% (1021/1398) Updating files: 74% (1035/1398) Updating files: 75% (1049/1398) Updating files: 76% (1063/1398) Updating files: 77% (1077/1398) Updating files: 78% (1091/1398) Updating files: 79% (1105/1398) Updating files: 80% (1119/1398) Updating files: 81% (1133/1398) Updating files: 82% (1147/1398) Updating files: 83% (1161/1398) Updating files: 84% (1175/1398) Updating files: 85% (1189/1398) Updating files: 86% (1203/1398) Updating files: 86% (1216/1398) Updating files: 87% (1217/1398) Updating files: 88% (1231/1398) Updating files: 89% (1245/1398) Updating files: 90% (1259/1398) Updating files: 91% (1273/1398) Updating files: 92% (1287/1398) Updating files: 93% (1301/1398) Updating files: 94% (1315/1398) Updating files: 95% (1329/1398) Updating files: 96% (1343/1398) Updating files: 97% (1357/1398) Updating files: 98% (1371/1398) Updating files: 99% (1385/1398) Updating files: 100% (1398/1398) Updating files: 100% (1398/1398), done. 2024-09-15T23:14:47.526 INFO:tasks.cephfs.test_scrub_checks:Initiating mds_scrub_checks on mds.0 test_path /scrub_test_path, run_seq 0 2024-09-15T23:14:47.526 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/i/dont/exist' 2024-09-15T23:14:47.526 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/i/dont/exist 2024-09-15T23:14:47.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.667+0000 7fe2511c4640 1 Processor -- start 2024-09-15T23:14:47.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.667+0000 7fe2511c4640 1 -- start start 2024-09-15T23:14:47.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.668+0000 7fe2511c4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe24c0b38a0 0x7fe24c0d3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.668+0000 7fe2511c4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe24c0cf710 con 0x7fe24c0b3350 2024-09-15T23:14:47.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.668+0000 7fe2511c4640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe24c0cf9f0 con 0x7fe24c06bfd0 2024-09-15T23:14:47.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.668+0000 7fe2511c4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe24c0b78a0 con 0x7fe24c0b38a0 2024-09-15T23:14:47.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.668+0000 7fe24a59c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe24c0b3350 0x7fe24c0d2920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41072/0 (socket says 172.21.15.123:41072) 2024-09-15T23:14:47.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.668+0000 7fe24a59c640 1 -- 172.21.15.123:0/1617392032 learned_addr learned my addr 172.21.15.123:0/1617392032 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:47.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.668+0000 7fe24b59e640 1 --2- 172.21.15.123:0/1617392032 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe24c0b38a0 0x7fe24c0d3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.668+0000 7fe249d9b640 1 -- 172.21.15.123:0/1617392032 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2671745305 0 0) 0x7fe24c0cf710 con 0x7fe24c0b3350 2024-09-15T23:14:47.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.669+0000 7fe249d9b640 1 -- 172.21.15.123:0/1617392032 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe238003520 con 0x7fe24c0b3350 2024-09-15T23:14:47.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.669+0000 7fe249d9b640 1 -- 172.21.15.123:0/1617392032 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4262401790 0 0) 0x7fe24c0cf9f0 con 0x7fe24c06bfd0 2024-09-15T23:14:47.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.669+0000 7fe249d9b640 1 -- 172.21.15.123:0/1617392032 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe24c0cf710 con 0x7fe24c06bfd0 2024-09-15T23:14:47.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.669+0000 7fe249d9b640 1 -- 172.21.15.123:0/1617392032 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 907512828 0 0) 0x7fe238003520 con 0x7fe24c0b3350 2024-09-15T23:14:47.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.669+0000 7fe249d9b640 1 -- 172.21.15.123:0/1617392032 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe24c0b38a0 msgr2=0x7fe24c0d3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:47.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.669+0000 7fe249d9b640 1 --2- 172.21.15.123:0/1617392032 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe24c0b38a0 0x7fe24c0d3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.669+0000 7fe249d9b640 1 -- 172.21.15.123:0/1617392032 >> v1:172.21.15.188:6789/0 conn(0x7fe24c06bfd0 legacy=0x7fe24c06c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:47.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.669+0000 7fe249d9b640 1 -- 172.21.15.123:0/1617392032 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe24c0cfcd0 con 0x7fe24c0b3350 2024-09-15T23:14:47.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.669+0000 7fe249d9b640 1 -- 172.21.15.123:0/1617392032 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fe234001670 con 0x7fe24c0b3350 2024-09-15T23:14:47.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.669+0000 7fe24b59e640 1 --2- 172.21.15.123:0/1617392032 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe24c0b38a0 0x7fe24c0d3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:14:47.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.669+0000 7fe249d9b640 1 -- 172.21.15.123:0/1617392032 >> v1:172.21.15.123:6789/0 conn(0x7fe24c0b3350 legacy=0x7fe24c0d2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:47.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.669+0000 7fe249d9b640 1 --2- 172.21.15.123:0/1617392032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe238003b70 0x7fe238003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.669+0000 7fe249d9b640 1 --2- 172.21.15.123:0/1617392032 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe24c0b38a0 0x7fe238004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.669+0000 7fe249d9b640 1 --2- 172.21.15.123:0/1617392032 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe238004d40 0x7fe2380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.669+0000 7fe249d9b640 1 -- 172.21.15.123:0/1617392032 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe23800ba70 con 0x7fe238003b70 2024-09-15T23:14:47.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.669+0000 7fe249d9b640 1 -- 172.21.15.123:0/1617392032 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe23800bc20 con 0x7fe238004d40 2024-09-15T23:14:47.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.669+0000 7fe249d9b640 1 -- 172.21.15.123:0/1617392032 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe23800be20 con 0x7fe24c0b38a0 2024-09-15T23:14:47.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.669+0000 7fe24ad9d640 1 --2- 172.21.15.123:0/1617392032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe238003b70 0x7fe238003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.669+0000 7fe24a59c640 1 --2- 172.21.15.123:0/1617392032 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe24c0b38a0 0x7fe238004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.669+0000 7fe24b59e640 1 --2- 172.21.15.123:0/1617392032 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe238004d40 0x7fe2380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.669+0000 7fe24ad9d640 1 -- 172.21.15.123:0/1617392032 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe24c0b38a0 msgr2=0x7fe238004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:47.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.669+0000 7fe24ad9d640 1 --2- 172.21.15.123:0/1617392032 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe24c0b38a0 0x7fe238004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.669+0000 7fe24ad9d640 1 -- 172.21.15.123:0/1617392032 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe238004d40 msgr2=0x7fe2380051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:47.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.669+0000 7fe24ad9d640 1 --2- 172.21.15.123:0/1617392032 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe238004d40 0x7fe2380051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.669+0000 7fe24ad9d640 1 -- 172.21.15.123:0/1617392032 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe238003520 con 0x7fe238003b70 2024-09-15T23:14:47.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.669+0000 7fe24b59e640 1 --2- 172.21.15.123:0/1617392032 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe238004d40 0x7fe2380051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:47.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.670+0000 7fe24ad9d640 1 --2- 172.21.15.123:0/1617392032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe238003b70 0x7fe238003f70 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe2440018d0 tx=0x7fe238005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac53013e49df525 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:47.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.670+0000 7fe249d9b640 1 -- 172.21.15.123:0/1617392032 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2440014f0 con 0x7fe238003b70 2024-09-15T23:14:47.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.670+0000 7fe249d9b640 1 -- 172.21.15.123:0/1617392032 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2440052d0 con 0x7fe238003b70 2024-09-15T23:14:47.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.670+0000 7fe249d9b640 1 -- 172.21.15.123:0/1617392032 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24402aca0 con 0x7fe238003b70 2024-09-15T23:14:47.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.671+0000 7fe2511c4640 1 -- 172.21.15.123:0/1617392032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe238003b70 msgr2=0x7fe238003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:47.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.671+0000 7fe2511c4640 1 --2- 172.21.15.123:0/1617392032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe238003b70 0x7fe238003f70 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe2440018d0 tx=0x7fe238005830 comp rx=0 tx=0).stop 2024-09-15T23:14:47.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.671+0000 7fe24b59e640 1 -- 172.21.15.123:0/1617392032 reap_dead start 2024-09-15T23:14:47.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.671+0000 7fe2511c4640 1 -- 172.21.15.123:0/1617392032 shutdown_connections 2024-09-15T23:14:47.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.671+0000 7fe2511c4640 1 -- 172.21.15.123:0/1617392032 >> 172.21.15.123:0/1617392032 conn(0x7fe24c0d11c0 msgr2=0x7fe24c0d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:47.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.671+0000 7fe2511c4640 1 -- 172.21.15.123:0/1617392032 shutdown_connections 2024-09-15T23:14:47.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.671+0000 7fe2511c4640 1 -- 172.21.15.123:0/1617392032 wait complete. 2024-09-15T23:14:47.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.672+0000 7fe2511c4640 1 Processor -- start 2024-09-15T23:14:47.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.672+0000 7fe2511c4640 1 -- start start 2024-09-15T23:14:47.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.673+0000 7fe2511c4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe238003b70 0x7fe24c159590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.673+0000 7fe2511c4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe24c0cae90 0x7fe24c1f89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.673+0000 7fe2511c4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe24c151dd0 0x7fe24c15a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.673+0000 7fe2511c4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe24c06cd50 con 0x7fe238003b70 2024-09-15T23:14:47.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.673+0000 7fe2511c4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe24c0cffb0 con 0x7fe24c0cae90 2024-09-15T23:14:47.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.673+0000 7fe2511c4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe24c15eae0 con 0x7fe24c151dd0 2024-09-15T23:14:47.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.673+0000 7fe24ad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe238003b70 0x7fe24c159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.673+0000 7fe24ad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe238003b70 0x7fe24c159590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47742/0 (socket says 172.21.15.123:47742) 2024-09-15T23:14:47.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.673+0000 7fe24ad9d640 1 -- 172.21.15.123:0/3601357744 learned_addr learned my addr 172.21.15.123:0/3601357744 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:47.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.673+0000 7fe24a59c640 1 --2- 172.21.15.123:0/3601357744 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe24c0cae90 0x7fe24c1f89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.673+0000 7fe24b59e640 1 --2- 172.21.15.123:0/3601357744 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe24c151dd0 0x7fe24c15a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.673+0000 7fe24ad9d640 1 -- 172.21.15.123:0/3601357744 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe24c151dd0 msgr2=0x7fe24c15a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:47.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.673+0000 7fe24ad9d640 1 --2- 172.21.15.123:0/3601357744 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe24c151dd0 0x7fe24c15a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.673+0000 7fe24ad9d640 1 -- 172.21.15.123:0/3601357744 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe24c0cae90 msgr2=0x7fe24c1f89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:47.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.673+0000 7fe24ad9d640 1 --2- 172.21.15.123:0/3601357744 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe24c0cae90 0x7fe24c1f89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.673+0000 7fe24ad9d640 1 -- 172.21.15.123:0/3601357744 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe24c153ef0 con 0x7fe238003b70 2024-09-15T23:14:47.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.673+0000 7fe24ad9d640 1 --2- 172.21.15.123:0/3601357744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe238003b70 0x7fe24c159590 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe2440019f0 tx=0x7fe2440012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:47.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.674+0000 7fe2437fe640 1 -- 172.21.15.123:0/3601357744 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24403f020 con 0x7fe238003b70 2024-09-15T23:14:47.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.674+0000 7fe2437fe640 1 -- 172.21.15.123:0/3601357744 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe244006e50 con 0x7fe238003b70 2024-09-15T23:14:47.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.674+0000 7fe2511c4640 1 -- 172.21.15.123:0/3601357744 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe24c0cb350 con 0x7fe238003b70 2024-09-15T23:14:47.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.674+0000 7fe2437fe640 1 -- 172.21.15.123:0/3601357744 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe244037040 con 0x7fe238003b70 2024-09-15T23:14:47.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.674+0000 7fe2511c4640 1 -- 172.21.15.123:0/3601357744 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe24c158d90 con 0x7fe238003b70 2024-09-15T23:14:47.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.675+0000 7fe2437fe640 1 -- 172.21.15.123:0/3601357744 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe244042020 con 0x7fe238003b70 2024-09-15T23:14:47.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.675+0000 7fe2437fe640 1 --2- 172.21.15.123:0/3601357744 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe22c06c2b0 0x7fe22c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.676+0000 7fe2437fe640 1 -- 172.21.15.123:0/3601357744 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7fe2440ab330 con 0x7fe238003b70 2024-09-15T23:14:47.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.676+0000 7fe24a59c640 1 --2- 172.21.15.123:0/3601357744 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe22c06c2b0 0x7fe22c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.676+0000 7fe24a59c640 1 --2- 172.21.15.123:0/3601357744 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe22c06c2b0 0x7fe22c06e770 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe24c06c6e0 tx=0x7fe234001d50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:47.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.677+0000 7fe254039740 1 Processor -- start 2024-09-15T23:14:47.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.677+0000 7fe254039740 1 -- start start 2024-09-15T23:14:47.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.677+0000 7fe254039740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561101df1420 0x561101e36bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.677+0000 7fe254039740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561101deebe0 0x561101df1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.677+0000 7fe254039740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561101df2bb0 0x561101deba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.677+0000 7fe254039740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x561101d54890 con 0x561101df1420 2024-09-15T23:14:47.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.677+0000 7fe254039740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x561101cfc6a0 con 0x561101df2bb0 2024-09-15T23:14:47.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.677+0000 7fe254039740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x561101d50850 con 0x561101deebe0 2024-09-15T23:14:47.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.678+0000 7fe24ad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561101df1420 0x561101e36bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.678+0000 7fe24ad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561101df1420 0x561101e36bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47750/0 (socket says 172.21.15.123:47750) 2024-09-15T23:14:47.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.678+0000 7fe24ad9d640 1 -- 172.21.15.123:0/3377841911 learned_addr learned my addr 172.21.15.123:0/3377841911 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:47.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.678+0000 7fe24b59e640 1 --2- 172.21.15.123:0/3377841911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561101df2bb0 0x561101deba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.678+0000 7fe24a59c640 1 --2- 172.21.15.123:0/3377841911 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561101deebe0 0x561101df1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.678+0000 7fe24ad9d640 1 -- 172.21.15.123:0/3377841911 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561101deebe0 msgr2=0x561101df1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:47.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.678+0000 7fe24ad9d640 1 --2- 172.21.15.123:0/3377841911 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561101deebe0 0x561101df1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.678+0000 7fe24ad9d640 1 -- 172.21.15.123:0/3377841911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561101df2bb0 msgr2=0x561101deba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:47.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.678+0000 7fe24ad9d640 1 --2- 172.21.15.123:0/3377841911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561101df2bb0 0x561101deba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.678+0000 7fe24ad9d640 1 -- 172.21.15.123:0/3377841911 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561101d22300 con 0x561101df1420 2024-09-15T23:14:47.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.678+0000 7fe24ad9d640 1 --2- 172.21.15.123:0/3377841911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561101df1420 0x561101e36bc0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe2440a9880 tx=0x7fe244079030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38fdb06e4a9e4933 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:47.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.678+0000 7fe240ff9640 1 -- 172.21.15.123:0/3377841911 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe244081f80 con 0x561101df1420 2024-09-15T23:14:47.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.678+0000 7fe240ff9640 1 -- 172.21.15.123:0/3377841911 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2440776c0 con 0x561101df1420 2024-09-15T23:14:47.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.678+0000 7fe240ff9640 1 -- 172.21.15.123:0/3377841911 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2440ab030 con 0x561101df1420 2024-09-15T23:14:47.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.679+0000 7fe254039740 1 -- 172.21.15.123:0/3377841911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561101df1420 msgr2=0x561101e36bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:47.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.679+0000 7fe254039740 1 --2- 172.21.15.123:0/3377841911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561101df1420 0x561101e36bc0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe2440a9880 tx=0x7fe244079030 comp rx=0 tx=0).stop 2024-09-15T23:14:47.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.679+0000 7fe254039740 1 -- 172.21.15.123:0/3377841911 shutdown_connections 2024-09-15T23:14:47.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.679+0000 7fe254039740 1 --2- 172.21.15.123:0/3377841911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561101df2bb0 0x561101deba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.679+0000 7fe254039740 1 --2- 172.21.15.123:0/3377841911 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561101deebe0 0x561101df1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.679+0000 7fe254039740 1 --2- 172.21.15.123:0/3377841911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561101df1420 0x561101e36bc0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.679+0000 7fe254039740 1 -- 172.21.15.123:0/3377841911 >> 172.21.15.123:0/3377841911 conn(0x561101dedbe0 msgr2=0x561101e36090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:47.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.679+0000 7fe254039740 1 -- 172.21.15.123:0/3377841911 shutdown_connections 2024-09-15T23:14:47.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.679+0000 7fe254039740 1 -- 172.21.15.123:0/3377841911 wait complete. 2024-09-15T23:14:47.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.679+0000 7fe254039740 1 -- start start 2024-09-15T23:14:47.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.680+0000 7fe254039740 1 Processor -- start 2024-09-15T23:14:47.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.680+0000 7fe254039740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561101df1420 0x561101e4a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.680+0000 7fe254039740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561101df2bb0 0x561101e3c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.680+0000 7fe254039740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561101e14a50 0x561101e3c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.680+0000 7fe254039740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x561101cfc6a0 con 0x561101e14a50 2024-09-15T23:14:47.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.680+0000 7fe254039740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x561101cdd520 con 0x561101df2bb0 2024-09-15T23:14:47.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.680+0000 7fe254039740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x561101d54890 con 0x561101df1420 2024-09-15T23:14:47.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.680+0000 7fe254039740 10 client.0 _ll_register_callbacks cb 0x561101a66d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:47.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.680+0000 7fe24b59e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561101e14a50 0x561101e3c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.680+0000 7fe24b59e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561101e14a50 0x561101e3c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47754/0 (socket says 172.21.15.123:47754) 2024-09-15T23:14:47.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.680+0000 7fe24b59e640 1 -- 172.21.15.123:0/324188263 learned_addr learned my addr 172.21.15.123:0/324188263 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:47.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.680+0000 7fe24ad9d640 1 --2- 172.21.15.123:0/324188263 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561101df1420 0x561101e4a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.680+0000 7fe24a59c640 1 --2- 172.21.15.123:0/324188263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561101df2bb0 0x561101e3c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.681+0000 7fe24b59e640 1 -- 172.21.15.123:0/324188263 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561101df1420 msgr2=0x561101e4a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:47.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.681+0000 7fe24b59e640 1 --2- 172.21.15.123:0/324188263 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561101df1420 0x561101e4a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.681+0000 7fe24b59e640 1 -- 172.21.15.123:0/324188263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561101df2bb0 msgr2=0x561101e3c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:47.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.681+0000 7fe24b59e640 1 --2- 172.21.15.123:0/324188263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561101df2bb0 0x561101e3c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.681+0000 7fe24b59e640 1 -- 172.21.15.123:0/324188263 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561101a4b590 con 0x561101e14a50 2024-09-15T23:14:47.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.681+0000 7fe24b59e640 1 --2- 172.21.15.123:0/324188263 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561101e14a50 0x561101e3c5e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe24c0b3c80 tx=0x7fe23c004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b48597368b05386 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:47.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.681+0000 7fe229ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:47.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.681+0000 7fe229ffb640 1 -- 172.21.15.123:0/324188263 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c01c070 con 0x561101e14a50 2024-09-15T23:14:47.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.681+0000 7fe229ffb640 1 -- 172.21.15.123:0/324188263 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7fe23c016a20 con 0x561101e14a50 2024-09-15T23:14:47.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.681+0000 7fe254039740 1 -- 172.21.15.123:0/324188263 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2440776c0 con 0x561101e14a50 2024-09-15T23:14:47.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.681+0000 7fe229ffb640 1 -- 172.21.15.123:0/324188263 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe23c029050 con 0x561101e14a50 2024-09-15T23:14:47.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.681+0000 7fe254039740 10 client.5439 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:47.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.681+0000 7fe254039740 1 -- 172.21.15.123:0/324188263 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x561101a67590 con 0x561101e14a50 2024-09-15T23:14:47.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.681+0000 7fe229ffb640 1 -- 172.21.15.123:0/324188263 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2440776c0 con 0x561101e14a50 2024-09-15T23:14:47.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.681+0000 7fe229ffb640 1 -- 172.21.15.123:0/324188263 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7fe23c02c020 con 0x561101e14a50 2024-09-15T23:14:47.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.681+0000 7fe254039740 10 client.5439 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:47.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.681+0000 7fe254039740 10 client.5439 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:47.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.681+0000 7fe254039740 20 client.5439 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:47.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.681+0000 7fe254039740 1 --2- 172.21.15.123:0/324188263 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x561101e1b1e0 0x561101e1b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.681+0000 7fe254039740 4 client.5439 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:14:47.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.681+0000 7fe254039740 1 -- 172.21.15.123:0/324188263 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561101d61fc0 con 0x561101e1b1e0 2024-09-15T23:14:47.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.682+0000 7fe24ad9d640 1 --2- 172.21.15.123:0/324188263 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x561101e1b1e0 0x561101e1b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.682+0000 7fe229ffb640 10 client.5439 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:47.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.682+0000 7fe24ad9d640 1 --2- 172.21.15.123:0/324188263 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x561101e1b1e0 0x561101e1b5c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f885600816bd1b3 server_cookie=7f0ab4cdb39f781b in_seq=0 out_seq=0 2024-09-15T23:14:47.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.683+0000 7fe229ffb640 1 -- 172.21.15.123:0/324188263 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561101d61fc0 con 0x561101e1b1e0 2024-09-15T23:14:47.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.683+0000 7fe229ffb640 10 client.5439 handle_command_reply: tid=0 2024-09-15T23:14:47.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.683+0000 7fe254039740 1 client.5439 shutdown 2024-09-15T23:14:47.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.683+0000 7fe254039740 1 -- 172.21.15.123:0/324188263 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561101e14a50 msgr2=0x561101e3c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:47.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.683+0000 7fe254039740 1 --2- 172.21.15.123:0/324188263 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561101e14a50 0x561101e3c5e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe24c0b3c80 tx=0x7fe23c004790 comp rx=0 tx=0).stop 2024-09-15T23:14:47.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.683+0000 7fe254039740 1 -- 172.21.15.123:0/324188263 shutdown_connections 2024-09-15T23:14:47.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.683+0000 7fe254039740 1 --2- 172.21.15.123:0/324188263 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x561101e1b1e0 0x561101e1b5c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.683+0000 7fe254039740 1 --2- 172.21.15.123:0/324188263 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561101e14a50 0x561101e3c5e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.683+0000 7fe229ffb640 0 client.5439 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:47.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.683+0000 7fe254039740 1 --2- 172.21.15.123:0/324188263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561101df2bb0 0x561101e3c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.683+0000 7fe254039740 1 --2- 172.21.15.123:0/324188263 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561101df1420 0x561101e4a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.683+0000 7fe254039740 1 -- 172.21.15.123:0/324188263 >> 172.21.15.123:0/324188263 conn(0x561101deebe0 msgr2=0x561101e35680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:47.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.683+0000 7fe254039740 1 -- 172.21.15.123:0/324188263 shutdown_connections 2024-09-15T23:14:47.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.683+0000 7fe254039740 1 -- 172.21.15.123:0/324188263 wait complete. 2024-09-15T23:14:47.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.683+0000 7fe254039740 20 client.5439 trim_cache size 0 max 16384 2024-09-15T23:14:47.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.698+0000 7fe254039740 1 Processor -- start 2024-09-15T23:14:47.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.698+0000 7fe254039740 1 -- start start 2024-09-15T23:14:47.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.698+0000 7fe254039740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561101df1420 0x561101e35f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.698+0000 7fe254039740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561101df2bb0 0x561101e1b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.698+0000 7fe254039740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561101e14a50 0x561101e49550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.698+0000 7fe254039740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe24c201350 con 0x561101df2bb0 2024-09-15T23:14:47.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.698+0000 7fe254039740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe24c2003a0 con 0x561101df1420 2024-09-15T23:14:47.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.698+0000 7fe254039740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe24c157c90 con 0x561101e14a50 2024-09-15T23:14:47.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.698+0000 7fe24a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561101df2bb0 0x561101e1b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.698+0000 7fe24a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561101df2bb0 0x561101e1b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47758/0 (socket says 172.21.15.123:47758) 2024-09-15T23:14:47.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.699+0000 7fe24a59c640 1 -- 172.21.15.123:0/2907662087 learned_addr learned my addr 172.21.15.123:0/2907662087 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:47.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.699+0000 7fe24ad9d640 1 --2- 172.21.15.123:0/2907662087 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561101df1420 0x561101e35f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.699+0000 7fe24b59e640 1 --2- 172.21.15.123:0/2907662087 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561101e14a50 0x561101e49550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.699+0000 7fe24a59c640 1 -- 172.21.15.123:0/2907662087 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561101e14a50 msgr2=0x561101e49550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:47.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.699+0000 7fe24a59c640 1 --2- 172.21.15.123:0/2907662087 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561101e14a50 0x561101e49550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.699+0000 7fe24a59c640 1 -- 172.21.15.123:0/2907662087 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561101df1420 msgr2=0x561101e35f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:47.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.699+0000 7fe24a59c640 1 --2- 172.21.15.123:0/2907662087 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561101df1420 0x561101e35f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.699+0000 7fe24a59c640 1 -- 172.21.15.123:0/2907662087 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561101b31970 con 0x561101df2bb0 2024-09-15T23:14:47.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.699+0000 7fe24a59c640 1 --2- 172.21.15.123:0/2907662087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561101df2bb0 0x561101e1b7b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe234007680 tx=0x7fe234006030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bde6c133f9c168 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:47.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.699+0000 7fe22bfff640 1 -- 172.21.15.123:0/2907662087 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe234015bd0 con 0x561101df2bb0 2024-09-15T23:14:47.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.699+0000 7fe22bfff640 1 -- 172.21.15.123:0/2907662087 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe234015d70 con 0x561101df2bb0 2024-09-15T23:14:47.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.699+0000 7fe22bfff640 1 -- 172.21.15.123:0/2907662087 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe234024640 con 0x561101df2bb0 2024-09-15T23:14:47.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.700+0000 7fe254039740 1 -- 172.21.15.123:0/2907662087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561101df2bb0 msgr2=0x561101e1b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:47.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.700+0000 7fe254039740 1 --2- 172.21.15.123:0/2907662087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561101df2bb0 0x561101e1b7b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe234007680 tx=0x7fe234006030 comp rx=0 tx=0).stop 2024-09-15T23:14:47.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.700+0000 7fe254039740 1 -- 172.21.15.123:0/2907662087 shutdown_connections 2024-09-15T23:14:47.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.700+0000 7fe254039740 1 --2- 172.21.15.123:0/2907662087 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561101e14a50 0x561101e49550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.700+0000 7fe254039740 1 --2- 172.21.15.123:0/2907662087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561101df2bb0 0x561101e1b7b0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.700+0000 7fe254039740 1 --2- 172.21.15.123:0/2907662087 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561101df1420 0x561101e35f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.700+0000 7fe254039740 1 -- 172.21.15.123:0/2907662087 >> 172.21.15.123:0/2907662087 conn(0x561101deebe0 msgr2=0x561101e45880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:47.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.700+0000 7fe254039740 1 -- 172.21.15.123:0/2907662087 shutdown_connections 2024-09-15T23:14:47.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.700+0000 7fe254039740 1 -- 172.21.15.123:0/2907662087 wait complete. 2024-09-15T23:14:47.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.700+0000 7fe254039740 1 -- start start 2024-09-15T23:14:47.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.700+0000 7fe254039740 1 Processor -- start 2024-09-15T23:14:47.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.701+0000 7fe254039740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561101df1420 0x561101e96a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.701+0000 7fe254039740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561101df2bb0 0x561101eb4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.701+0000 7fe254039740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561101e14a50 0x561101eb4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.701+0000 7fe254039740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x561101e15ad0 con 0x561101df2bb0 2024-09-15T23:14:47.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.701+0000 7fe254039740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe24c1582e0 con 0x561101e14a50 2024-09-15T23:14:47.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.701+0000 7fe254039740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x561101d1ffb0 con 0x561101df1420 2024-09-15T23:14:47.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.701+0000 7fe254039740 10 client.0 _ll_register_callbacks cb 0x7fe23c009d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:47.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.701+0000 7fe24a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561101df2bb0 0x561101eb4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.701+0000 7fe24a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561101df2bb0 0x561101eb4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47774/0 (socket says 172.21.15.123:47774) 2024-09-15T23:14:47.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.701+0000 7fe24a59c640 1 -- 172.21.15.123:0/3324918454 learned_addr learned my addr 172.21.15.123:0/3324918454 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:47.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.701+0000 7fe24ad9d640 1 --2- 172.21.15.123:0/3324918454 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561101df1420 0x561101e96a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.701+0000 7fe24b59e640 1 --2- 172.21.15.123:0/3324918454 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561101e14a50 0x561101eb4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.701+0000 7fe24a59c640 1 -- 172.21.15.123:0/3324918454 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561101df1420 msgr2=0x561101e96a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:47.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.701+0000 7fe24a59c640 1 --2- 172.21.15.123:0/3324918454 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561101df1420 0x561101e96a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.701+0000 7fe24a59c640 1 -- 172.21.15.123:0/3324918454 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561101e14a50 msgr2=0x561101eb4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:47.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.701+0000 7fe24a59c640 1 --2- 172.21.15.123:0/3324918454 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561101e14a50 0x561101eb4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.701+0000 7fe24a59c640 1 -- 172.21.15.123:0/3324918454 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561101eb5100 con 0x561101df2bb0 2024-09-15T23:14:47.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.701+0000 7fe24a59c640 1 --2- 172.21.15.123:0/3324918454 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561101df2bb0 0x561101eb4320 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe23400a000 tx=0x7fe24c0cf8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e7cf441214809 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:47.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.701+0000 7fe229ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:47.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.702+0000 7fe229ffb640 1 -- 172.21.15.123:0/3324918454 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe234034030 con 0x561101df2bb0 2024-09-15T23:14:47.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.702+0000 7fe229ffb640 1 -- 172.21.15.123:0/3324918454 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7fe2340327c0 con 0x561101df2bb0 2024-09-15T23:14:47.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.702+0000 7fe254039740 1 -- 172.21.15.123:0/3324918454 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe234015d70 con 0x561101df2bb0 2024-09-15T23:14:47.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.702+0000 7fe229ffb640 1 -- 172.21.15.123:0/3324918454 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe234015bd0 con 0x561101df2bb0 2024-09-15T23:14:47.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.702+0000 7fe254039740 10 client.5445 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:47.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.702+0000 7fe254039740 1 -- 172.21.15.123:0/3324918454 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x561101e97010 con 0x561101df2bb0 2024-09-15T23:14:47.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.702+0000 7fe229ffb640 1 -- 172.21.15.123:0/3324918454 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe234015d70 con 0x561101df2bb0 2024-09-15T23:14:47.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.702+0000 7fe229ffb640 1 -- 172.21.15.123:0/3324918454 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7fe2340329c0 con 0x561101df2bb0 2024-09-15T23:14:47.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.702+0000 7fe254039740 10 client.5445 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:47.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.702+0000 7fe254039740 10 client.5445 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:47.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.702+0000 7fe254039740 20 client.5445 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:47.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.702+0000 7fe254039740 1 --2- 172.21.15.123:0/3324918454 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x561101e35db0 0x561101e445e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.702+0000 7fe254039740 4 client.5445 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}] 2024-09-15T23:14:47.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.702+0000 7fe254039740 1 -- 172.21.15.123:0/3324918454 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}) -- 0x561101d5c310 con 0x561101e35db0 2024-09-15T23:14:47.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.702+0000 7fe24ad9d640 1 --2- 172.21.15.123:0/3324918454 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x561101e35db0 0x561101e445e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.703+0000 7fe229ffb640 10 client.5445 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:47.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.703+0000 7fe24ad9d640 1 --2- 172.21.15.123:0/3324918454 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x561101e35db0 0x561101e445e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d2f310c55be552c server_cookie=32992f34837039e0 in_seq=0 out_seq=0 2024-09-15T23:14:47.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.703+0000 7fe229ffb640 1 -- 172.21.15.123:0/3324918454 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: -2 ) ==== 8+0+45 (crc 0 0 0) 0x561101d5c310 con 0x561101e35db0 2024-09-15T23:14:47.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.703+0000 7fe229ffb640 10 client.5445 handle_command_reply: tid=0 2024-09-15T23:14:47.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.703+0000 7fe254039740 1 client.5445 shutdown 2024-09-15T23:14:47.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.703+0000 7fe254039740 1 -- 172.21.15.123:0/3324918454 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561101df2bb0 msgr2=0x561101eb4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:47.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.703+0000 7fe254039740 1 --2- 172.21.15.123:0/3324918454 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561101df2bb0 0x561101eb4320 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe23400a000 tx=0x7fe24c0cf8e0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.703+0000 7fe254039740 1 -- 172.21.15.123:0/3324918454 shutdown_connections 2024-09-15T23:14:47.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.703+0000 7fe254039740 1 --2- 172.21.15.123:0/3324918454 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x561101e35db0 0x561101e445e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.703+0000 7fe254039740 1 --2- 172.21.15.123:0/3324918454 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561101e14a50 0x561101eb4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.703+0000 7fe229ffb640 0 client.5445 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:47.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.703+0000 7fe254039740 1 --2- 172.21.15.123:0/3324918454 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561101df2bb0 0x561101eb4320 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.703+0000 7fe254039740 1 --2- 172.21.15.123:0/3324918454 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561101df1420 0x561101e96a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.703+0000 7fe254039740 1 -- 172.21.15.123:0/3324918454 >> 172.21.15.123:0/3324918454 conn(0x561101deebe0 msgr2=0x561101e37bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:47.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.703+0000 7fe254039740 1 -- 172.21.15.123:0/3324918454 shutdown_connections 2024-09-15T23:14:47.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.703+0000 7fe254039740 1 -- 172.21.15.123:0/3324918454 wait complete. 2024-09-15T23:14:47.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.703+0000 7fe254039740 20 client.5445 trim_cache size 0 max 16384 2024-09-15T23:14:47.711 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:14:47.711 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "", 2024-09-15T23:14:47.711 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": -2 2024-09-15T23:14:47.711 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:14:47.712 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-15T23:14:47.712 INFO:teuthology.orchestra.run.smithi123.stderr:Error ENOENT: 2024-09-15T23:14:47.712 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/i/dont/exist' returned '{'message': '', 'return_code': -2}' 2024-09-15T23:14:47.713 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/i/dont/exist' 2024-09-15T23:14:47.713 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/i/dont/exist 2024-09-15T23:14:47.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.814+0000 7fb7069c0640 1 Processor -- start 2024-09-15T23:14:47.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.814+0000 7fb7069c0640 1 -- start start 2024-09-15T23:14:47.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.815+0000 7fb7069c0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb7000ccf30 0x7fb7000b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.815+0000 7fb7069c0640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb70015b7c0 0x7fb7000cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.815+0000 7fb7069c0640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb7000cead0 0x7fb70015f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.815+0000 7fb7069c0640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fb7000cd850 con 0x7fb7000cead0 2024-09-15T23:14:47.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.815+0000 7fb7069c0640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fb7000cf2e0 con 0x7fb70015b7c0 2024-09-15T23:14:47.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.815+0000 7fb7069c0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb700070fe0 con 0x7fb7000ccf30 2024-09-15T23:14:47.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.815+0000 7fb704f5d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb7000cead0 0x7fb70015f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.815+0000 7fb704f5d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb7000cead0 0x7fb70015f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47778/0 (socket says 172.21.15.123:47778) 2024-09-15T23:14:47.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.815+0000 7fb704f5d640 1 -- 172.21.15.123:0/1632913841 learned_addr learned my addr 172.21.15.123:0/1632913841 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:47.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.815+0000 7fb6ff7fe640 1 --2- 172.21.15.123:0/1632913841 >> v2:172.21.15.188:3300/0 conn(0x7fb70015b7c0 0x7fb7000cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.815+0000 7fb6fffff640 1 --2- 172.21.15.123:0/1632913841 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb7000ccf30 0x7fb7000b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.815+0000 7fb704f5d640 1 -- 172.21.15.123:0/1632913841 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb7000ccf30 msgr2=0x7fb7000b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:47.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.815+0000 7fb704f5d640 1 --2- 172.21.15.123:0/1632913841 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb7000ccf30 0x7fb7000b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.815+0000 7fb704f5d640 1 -- 172.21.15.123:0/1632913841 >> v2:172.21.15.188:3300/0 conn(0x7fb70015b7c0 msgr2=0x7fb7000cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:47.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.815+0000 7fb704f5d640 1 --2- 172.21.15.123:0/1632913841 >> v2:172.21.15.188:3300/0 conn(0x7fb70015b7c0 0x7fb7000cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.815+0000 7fb704f5d640 1 -- 172.21.15.123:0/1632913841 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7000712c0 con 0x7fb7000cead0 2024-09-15T23:14:47.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.816+0000 7fb704f5d640 1 --2- 172.21.15.123:0/1632913841 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7000cead0 0x7fb70015f150 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb700069c10 tx=0x7fb6f802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ddb68b4a801a612 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:47.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.816+0000 7fb6feffd640 1 -- 172.21.15.123:0/1632913841 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8036070 con 0x7fb7000cead0 2024-09-15T23:14:47.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.816+0000 7fb6feffd640 1 -- 172.21.15.123:0/1632913841 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6f8031600 con 0x7fb7000cead0 2024-09-15T23:14:47.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.816+0000 7fb6feffd640 1 -- 172.21.15.123:0/1632913841 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f80319d0 con 0x7fb7000cead0 2024-09-15T23:14:47.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.817+0000 7fb7069c0640 1 -- 172.21.15.123:0/1632913841 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7000cead0 msgr2=0x7fb70015f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:47.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.817+0000 7fb7069c0640 1 --2- 172.21.15.123:0/1632913841 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7000cead0 0x7fb70015f150 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb700069c10 tx=0x7fb6f802a610 comp rx=0 tx=0).stop 2024-09-15T23:14:47.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.817+0000 7fb7069c0640 1 -- 172.21.15.123:0/1632913841 shutdown_connections 2024-09-15T23:14:47.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.817+0000 7fb7069c0640 1 --2- 172.21.15.123:0/1632913841 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7000cead0 0x7fb70015f150 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.817+0000 7fb7069c0640 1 --2- 172.21.15.123:0/1632913841 >> v2:172.21.15.188:3300/0 conn(0x7fb70015b7c0 0x7fb7000cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.817+0000 7fb7069c0640 1 --2- 172.21.15.123:0/1632913841 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb7000ccf30 0x7fb7000b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.817+0000 7fb7069c0640 1 -- 172.21.15.123:0/1632913841 >> 172.21.15.123:0/1632913841 conn(0x7fb70006d0f0 msgr2=0x7fb70006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:47.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.817+0000 7fb7069c0640 1 -- 172.21.15.123:0/1632913841 shutdown_connections 2024-09-15T23:14:47.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.817+0000 7fb7069c0640 1 -- 172.21.15.123:0/1632913841 wait complete. 2024-09-15T23:14:47.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.818+0000 7fb7069c0640 1 Processor -- start 2024-09-15T23:14:47.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.818+0000 7fb7069c0640 1 -- start start 2024-09-15T23:14:47.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.819+0000 7fb7069c0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb7000ccf30 0x7fb700143ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.819+0000 7fb7069c0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7000cead0 0x7fb70006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.819+0000 7fb7069c0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb70015b7c0 0x7fb70006c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.819+0000 7fb7069c0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb7000cef40 con 0x7fb7000cead0 2024-09-15T23:14:47.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.819+0000 7fb7069c0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb7000cf5c0 con 0x7fb7000ccf30 2024-09-15T23:14:47.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.819+0000 7fb7069c0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb7000cf0c0 con 0x7fb70015b7c0 2024-09-15T23:14:47.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.819+0000 7fb6ff7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7000cead0 0x7fb70006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.819+0000 7fb6ff7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7000cead0 0x7fb70006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47782/0 (socket says 172.21.15.123:47782) 2024-09-15T23:14:47.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.819+0000 7fb6ff7fe640 1 -- 172.21.15.123:0/884553521 learned_addr learned my addr 172.21.15.123:0/884553521 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:47.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.819+0000 7fb6fffff640 1 --2- 172.21.15.123:0/884553521 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb7000ccf30 0x7fb700143ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.819+0000 7fb704f5d640 1 --2- 172.21.15.123:0/884553521 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb70015b7c0 0x7fb70006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.819+0000 7fb6ff7fe640 1 -- 172.21.15.123:0/884553521 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb70015b7c0 msgr2=0x7fb70006c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:47.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.819+0000 7fb6ff7fe640 1 --2- 172.21.15.123:0/884553521 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb70015b7c0 0x7fb70006c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.819+0000 7fb6ff7fe640 1 -- 172.21.15.123:0/884553521 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb7000ccf30 msgr2=0x7fb700143ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:47.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.819+0000 7fb6ff7fe640 1 --2- 172.21.15.123:0/884553521 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb7000ccf30 0x7fb700143ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.819+0000 7fb6ff7fe640 1 -- 172.21.15.123:0/884553521 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb70015bc70 con 0x7fb7000cead0 2024-09-15T23:14:47.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.819+0000 7fb6fffff640 1 --2- 172.21.15.123:0/884553521 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb7000ccf30 0x7fb700143ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:14:47.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.819+0000 7fb6ff7fe640 1 --2- 172.21.15.123:0/884553521 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7000cead0 0x7fb70006bc10 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb6f400e8e0 tx=0x7fb6f400eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:47.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.820+0000 7fb6fcff9640 1 -- 172.21.15.123:0/884553521 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f4017070 con 0x7fb7000cead0 2024-09-15T23:14:47.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.820+0000 7fb6fcff9640 1 -- 172.21.15.123:0/884553521 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6f400c940 con 0x7fb7000cead0 2024-09-15T23:14:47.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.820+0000 7fb6fcff9640 1 -- 172.21.15.123:0/884553521 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f400cd30 con 0x7fb7000cead0 2024-09-15T23:14:47.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.820+0000 7fb7069c0640 1 -- 172.21.15.123:0/884553521 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb70015bf10 con 0x7fb7000cead0 2024-09-15T23:14:47.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.820+0000 7fb7069c0640 1 -- 172.21.15.123:0/884553521 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb70015c4d0 con 0x7fb7000cead0 2024-09-15T23:14:47.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.821+0000 7fb6fcff9640 1 -- 172.21.15.123:0/884553521 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb6f401a070 con 0x7fb7000cead0 2024-09-15T23:14:47.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.821+0000 7fb6fcff9640 1 --2- 172.21.15.123:0/884553521 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb6ec06c2b0 0x7fb6ec06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.822+0000 7fb6fcff9640 1 -- 172.21.15.123:0/884553521 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7fb6f408b3c0 con 0x7fb7000cead0 2024-09-15T23:14:47.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.822+0000 7fb6fffff640 1 --2- 172.21.15.123:0/884553521 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb6ec06c2b0 0x7fb6ec06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.822+0000 7fb6fffff640 1 --2- 172.21.15.123:0/884553521 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb6ec06c2b0 0x7fb6ec06e770 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0009e10 tx=0x7fb6f0009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:47.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.822+0000 7fb70982f740 1 Processor -- start 2024-09-15T23:14:47.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.823+0000 7fb70982f740 1 -- start start 2024-09-15T23:14:47.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.823+0000 7fb70982f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558d5136ae60 0x558d51388780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.823+0000 7fb70982f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558d5136b240 0x558d51387f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.823+0000 7fb70982f740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558d5138a450 0x558d5138a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.823+0000 7fb70982f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x558d512a7aa0 con 0x558d5136b240 2024-09-15T23:14:47.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.823+0000 7fb70982f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x558d5124f8e0 con 0x558d5136ae60 2024-09-15T23:14:47.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.823+0000 7fb70982f740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x558d512a3a60 con 0x558d5138a450 2024-09-15T23:14:47.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.823+0000 7fb6ff7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558d5136b240 0x558d51387f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.823+0000 7fb6ff7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558d5136b240 0x558d51387f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47792/0 (socket says 172.21.15.123:47792) 2024-09-15T23:14:47.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.823+0000 7fb6ff7fe640 1 -- 172.21.15.123:0/3620246029 learned_addr learned my addr 172.21.15.123:0/3620246029 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:47.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.823+0000 7fb6fffff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558d5136ae60 0x558d51388780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.823+0000 7fb704f5d640 1 --2- 172.21.15.123:0/3620246029 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558d5138a450 0x558d5138a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.824+0000 7fb6ff7fe640 1 -- 172.21.15.123:0/3620246029 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558d5138a450 msgr2=0x558d5138a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:47.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.824+0000 7fb6ff7fe640 1 --2- 172.21.15.123:0/3620246029 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558d5138a450 0x558d5138a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.824+0000 7fb6ff7fe640 1 -- 172.21.15.123:0/3620246029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558d5136ae60 msgr2=0x558d51388780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:47.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.824+0000 7fb6ff7fe640 1 --2- 172.21.15.123:0/3620246029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558d5136ae60 0x558d51388780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.824+0000 7fb6ff7fe640 1 -- 172.21.15.123:0/3620246029 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d510869f0 con 0x558d5136b240 2024-09-15T23:14:47.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.824+0000 7fb704f5d640 1 --2- 172.21.15.123:0/3620246029 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558d5138a450 0x558d5138a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:47.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.824+0000 7fb6ff7fe640 1 --2- 172.21.15.123:0/3620246029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558d5136b240 0x558d51387f00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4089860 tx=0x7fb6f40593e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366e8732cb22e8e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:47.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.824+0000 7fb6e5ffb640 1 -- 172.21.15.123:0/3620246029 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f4021040 con 0x558d5136b240 2024-09-15T23:14:47.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.824+0000 7fb6e5ffb640 1 -- 172.21.15.123:0/3620246029 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6f40577e0 con 0x558d5136b240 2024-09-15T23:14:47.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.824+0000 7fb6e5ffb640 1 -- 172.21.15.123:0/3620246029 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f408b070 con 0x558d5136b240 2024-09-15T23:14:47.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.824+0000 7fb70982f740 1 -- 172.21.15.123:0/3620246029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558d5136b240 msgr2=0x558d51387f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:47.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.824+0000 7fb70982f740 1 --2- 172.21.15.123:0/3620246029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558d5136b240 0x558d51387f00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4089860 tx=0x7fb6f40593e0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.824+0000 7fb70982f740 1 -- 172.21.15.123:0/3620246029 shutdown_connections 2024-09-15T23:14:47.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.824+0000 7fb70982f740 1 --2- 172.21.15.123:0/3620246029 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558d5138a450 0x558d5138a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.824+0000 7fb70982f740 1 --2- 172.21.15.123:0/3620246029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558d5136b240 0x558d51387f00 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.824+0000 7fb70982f740 1 --2- 172.21.15.123:0/3620246029 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558d5136ae60 0x558d51388780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.824+0000 7fb70982f740 1 -- 172.21.15.123:0/3620246029 >> 172.21.15.123:0/3620246029 conn(0x558d513408c0 msgr2=0x558d51388cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:47.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.824+0000 7fb70982f740 1 -- 172.21.15.123:0/3620246029 shutdown_connections 2024-09-15T23:14:47.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.825+0000 7fb70982f740 1 -- 172.21.15.123:0/3620246029 wait complete. 2024-09-15T23:14:47.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.825+0000 7fb70982f740 1 -- start start 2024-09-15T23:14:47.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.825+0000 7fb70982f740 1 Processor -- start 2024-09-15T23:14:47.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.826+0000 7fb70982f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558d5136b240 0x558d51342300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.826+0000 7fb70982f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558d5138a450 0x558d513822b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.826+0000 7fb70982f740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558d51344b00 0x558d513a07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.826+0000 7fb70982f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x558d51389e20 con 0x558d5136b240 2024-09-15T23:14:47.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.826+0000 7fb70982f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x558d51262ce0 con 0x558d5138a450 2024-09-15T23:14:47.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.826+0000 7fb70982f740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x558d5138a100 con 0x558d51344b00 2024-09-15T23:14:47.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.826+0000 7fb70982f740 10 client.0 _ll_register_callbacks cb 0x558d50fb9dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:47.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.826+0000 7fb6fffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558d5136b240 0x558d51342300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.826+0000 7fb6fffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558d5136b240 0x558d51342300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47802/0 (socket says 172.21.15.123:47802) 2024-09-15T23:14:47.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.826+0000 7fb6fffff640 1 -- 172.21.15.123:0/4034257097 learned_addr learned my addr 172.21.15.123:0/4034257097 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:47.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.826+0000 7fb6ff7fe640 1 --2- 172.21.15.123:0/4034257097 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558d5138a450 0x558d513822b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.826+0000 7fb704f5d640 1 --2- 172.21.15.123:0/4034257097 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558d51344b00 0x558d513a07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.826+0000 7fb6fffff640 1 -- 172.21.15.123:0/4034257097 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558d51344b00 msgr2=0x558d513a07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:47.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.826+0000 7fb6fffff640 1 --2- 172.21.15.123:0/4034257097 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558d51344b00 0x558d513a07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.826+0000 7fb6fffff640 1 -- 172.21.15.123:0/4034257097 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558d5138a450 msgr2=0x558d513822b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:47.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.826+0000 7fb6fffff640 1 --2- 172.21.15.123:0/4034257097 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558d5138a450 0x558d513822b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.826+0000 7fb6fffff640 1 -- 172.21.15.123:0/4034257097 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d50f7a2e0 con 0x558d5136b240 2024-09-15T23:14:47.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.826+0000 7fb6ff7fe640 1 --2- 172.21.15.123:0/4034257097 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558d5138a450 0x558d513822b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:14:47.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.827+0000 7fb6fffff640 1 --2- 172.21.15.123:0/4034257097 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558d5136b240 0x558d51342300 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0014e10 tx=0x7fb6f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb75ead58743efb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:47.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.827+0000 7fb6deffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:47.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.827+0000 7fb6deffd640 1 -- 172.21.15.123:0/4034257097 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0027030 con 0x558d5136b240 2024-09-15T23:14:47.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.827+0000 7fb6deffd640 1 -- 172.21.15.123:0/4034257097 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7fb6f000f040 con 0x558d5136b240 2024-09-15T23:14:47.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.827+0000 7fb70982f740 1 -- 172.21.15.123:0/4034257097 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6f40577e0 con 0x558d5136b240 2024-09-15T23:14:47.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.827+0000 7fb6deffd640 1 -- 172.21.15.123:0/4034257097 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb6f0033050 con 0x558d5136b240 2024-09-15T23:14:47.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.827+0000 7fb70982f740 10 client.5457 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:47.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.827+0000 7fb70982f740 1 -- 172.21.15.123:0/4034257097 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x558d510e7180 con 0x558d5136b240 2024-09-15T23:14:47.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.827+0000 7fb6deffd640 1 -- 172.21.15.123:0/4034257097 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6f40577e0 con 0x558d5136b240 2024-09-15T23:14:47.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.827+0000 7fb6deffd640 1 -- 172.21.15.123:0/4034257097 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7fb6f0036020 con 0x558d5136b240 2024-09-15T23:14:47.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.827+0000 7fb70982f740 10 client.5457 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:47.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.827+0000 7fb70982f740 10 client.5457 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:47.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.827+0000 7fb70982f740 20 client.5457 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:47.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.827+0000 7fb70982f740 1 --2- 172.21.15.123:0/4034257097 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x558d51367880 0x558d5136c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.827+0000 7fb70982f740 4 client.5457 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:14:47.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.827+0000 7fb70982f740 1 -- 172.21.15.123:0/4034257097 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d512b51d0 con 0x558d51367880 2024-09-15T23:14:47.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.827+0000 7fb6ff7fe640 1 --2- 172.21.15.123:0/4034257097 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x558d51367880 0x558d5136c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.828+0000 7fb6ff7fe640 1 --2- 172.21.15.123:0/4034257097 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x558d51367880 0x558d5136c910 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2e2a267aea0ad19 server_cookie=c50af5109095a2e0 in_seq=0 out_seq=0 2024-09-15T23:14:47.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.828+0000 7fb6deffd640 10 client.5457 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:47.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.828+0000 7fb6deffd640 1 -- 172.21.15.123:0/4034257097 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558d512b51d0 con 0x558d51367880 2024-09-15T23:14:47.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.828+0000 7fb6deffd640 10 client.5457 handle_command_reply: tid=0 2024-09-15T23:14:47.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.828+0000 7fb70982f740 1 client.5457 shutdown 2024-09-15T23:14:47.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.829+0000 7fb70982f740 1 -- 172.21.15.123:0/4034257097 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558d5136b240 msgr2=0x558d51342300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:47.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.829+0000 7fb70982f740 1 --2- 172.21.15.123:0/4034257097 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558d5136b240 0x558d51342300 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0014e10 tx=0x7fb6f00046c0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.829+0000 7fb70982f740 1 -- 172.21.15.123:0/4034257097 shutdown_connections 2024-09-15T23:14:47.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.829+0000 7fb70982f740 1 --2- 172.21.15.123:0/4034257097 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x558d51367880 0x558d5136c910 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.829+0000 7fb70982f740 1 --2- 172.21.15.123:0/4034257097 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558d51344b00 0x558d513a07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.829+0000 7fb70982f740 1 --2- 172.21.15.123:0/4034257097 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558d5138a450 0x558d513822b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.829+0000 7fb70982f740 1 --2- 172.21.15.123:0/4034257097 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558d5136b240 0x558d51342300 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.829+0000 7fb6deffd640 0 client.5457 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:47.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.829+0000 7fb70982f740 1 -- 172.21.15.123:0/4034257097 >> 172.21.15.123:0/4034257097 conn(0x558d5136ae60 msgr2=0x558d513874f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:47.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.829+0000 7fb70982f740 1 -- 172.21.15.123:0/4034257097 shutdown_connections 2024-09-15T23:14:47.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.829+0000 7fb70982f740 1 -- 172.21.15.123:0/4034257097 wait complete. 2024-09-15T23:14:47.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.829+0000 7fb70982f740 20 client.5457 trim_cache size 0 max 16384 2024-09-15T23:14:47.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.846+0000 7fb70982f740 1 Processor -- start 2024-09-15T23:14:47.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.846+0000 7fb70982f740 1 -- start start 2024-09-15T23:14:47.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.846+0000 7fb70982f740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558d51344b00 0x558d513b1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.846+0000 7fb70982f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558d5136b240 0x558d5133f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.846+0000 7fb70982f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558d5138a450 0x558d513433d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.846+0000 7fb70982f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb70015aa60 con 0x558d5138a450 2024-09-15T23:14:47.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.846+0000 7fb70982f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb700159b20 con 0x558d5136b240 2024-09-15T23:14:47.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.846+0000 7fb70982f740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb700158e80 con 0x558d51344b00 2024-09-15T23:14:47.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.847+0000 7fb704f5d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558d5138a450 0x558d513433d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.847+0000 7fb704f5d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558d5138a450 0x558d513433d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47810/0 (socket says 172.21.15.123:47810) 2024-09-15T23:14:47.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.847+0000 7fb704f5d640 1 -- 172.21.15.123:0/2758713052 learned_addr learned my addr 172.21.15.123:0/2758713052 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:47.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.847+0000 7fb6ff7fe640 1 --2- 172.21.15.123:0/2758713052 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558d5136b240 0x558d5133f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.847+0000 7fb6fffff640 1 --2- 172.21.15.123:0/2758713052 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558d51344b00 0x558d513b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.847+0000 7fb704f5d640 1 -- 172.21.15.123:0/2758713052 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558d51344b00 msgr2=0x558d513b1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:47.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.847+0000 7fb704f5d640 1 --2- 172.21.15.123:0/2758713052 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558d51344b00 0x558d513b1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.847+0000 7fb704f5d640 1 -- 172.21.15.123:0/2758713052 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558d5136b240 msgr2=0x558d5133f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:47.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.847+0000 7fb704f5d640 1 --2- 172.21.15.123:0/2758713052 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558d5136b240 0x558d5133f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.847+0000 7fb704f5d640 1 -- 172.21.15.123:0/2758713052 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d50f533a0 con 0x558d5138a450 2024-09-15T23:14:47.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.847+0000 7fb704f5d640 1 --2- 172.21.15.123:0/2758713052 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558d5138a450 0x558d513433d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8009f40 tx=0x7fb6f802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faad9819cb0718c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:47.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.847+0000 7fb6e57fa640 1 -- 172.21.15.123:0/2758713052 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8036040 con 0x558d5138a450 2024-09-15T23:14:47.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.847+0000 7fb6e57fa640 1 -- 172.21.15.123:0/2758713052 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6f8037040 con 0x558d5138a450 2024-09-15T23:14:47.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.847+0000 7fb6e57fa640 1 -- 172.21.15.123:0/2758713052 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f803e940 con 0x558d5138a450 2024-09-15T23:14:47.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.848+0000 7fb70982f740 1 -- 172.21.15.123:0/2758713052 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558d5138a450 msgr2=0x558d513433d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:47.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.848+0000 7fb70982f740 1 --2- 172.21.15.123:0/2758713052 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558d5138a450 0x558d513433d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8009f40 tx=0x7fb6f802e000 comp rx=0 tx=0).stop 2024-09-15T23:14:47.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.848+0000 7fb70982f740 1 -- 172.21.15.123:0/2758713052 shutdown_connections 2024-09-15T23:14:47.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.848+0000 7fb70982f740 1 --2- 172.21.15.123:0/2758713052 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558d5138a450 0x558d513433d0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.848+0000 7fb70982f740 1 --2- 172.21.15.123:0/2758713052 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558d5136b240 0x558d5133f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.848+0000 7fb70982f740 1 --2- 172.21.15.123:0/2758713052 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558d51344b00 0x558d513b1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.848+0000 7fb70982f740 1 -- 172.21.15.123:0/2758713052 >> 172.21.15.123:0/2758713052 conn(0x558d5136ae60 msgr2=0x558d5136a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:47.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.848+0000 7fb70982f740 1 -- 172.21.15.123:0/2758713052 shutdown_connections 2024-09-15T23:14:47.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.848+0000 7fb70982f740 1 -- 172.21.15.123:0/2758713052 wait complete. 2024-09-15T23:14:47.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.848+0000 7fb70982f740 1 -- start start 2024-09-15T23:14:47.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.848+0000 7fb70982f740 1 Processor -- start 2024-09-15T23:14:47.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.849+0000 7fb70982f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558d51344b00 0x558d5139feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.849+0000 7fb70982f740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558d5136b240 0x558d51370d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.849+0000 7fb70982f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558d5138a450 0x558d51371280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.849+0000 7fb70982f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x558d51389c20 con 0x558d5138a450 2024-09-15T23:14:47.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.849+0000 7fb70982f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb7001594d0 con 0x558d51344b00 2024-09-15T23:14:47.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.849+0000 7fb70982f740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x558d5140c880 con 0x558d5136b240 2024-09-15T23:14:47.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.849+0000 7fb70982f740 10 client.0 _ll_register_callbacks cb 0x7fb6f0011dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:47.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.849+0000 7fb704f5d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558d5138a450 0x558d51371280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.849+0000 7fb704f5d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558d5138a450 0x558d51371280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47826/0 (socket says 172.21.15.123:47826) 2024-09-15T23:14:47.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.849+0000 7fb704f5d640 1 -- 172.21.15.123:0/2123631150 learned_addr learned my addr 172.21.15.123:0/2123631150 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:47.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.849+0000 7fb6fffff640 1 --2- 172.21.15.123:0/2123631150 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558d51344b00 0x558d5139feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.849+0000 7fb6ff7fe640 1 --2- 172.21.15.123:0/2123631150 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558d5136b240 0x558d51370d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.850+0000 7fb704f5d640 1 -- 172.21.15.123:0/2123631150 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558d5136b240 msgr2=0x558d51370d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:47.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.850+0000 7fb704f5d640 1 --2- 172.21.15.123:0/2123631150 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558d5136b240 0x558d51370d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.850+0000 7fb704f5d640 1 -- 172.21.15.123:0/2123631150 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558d51344b00 msgr2=0x558d5139feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:47.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.850+0000 7fb704f5d640 1 --2- 172.21.15.123:0/2123631150 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558d51344b00 0x558d5139feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.850+0000 7fb704f5d640 1 -- 172.21.15.123:0/2123631150 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d5138c100 con 0x558d5138a450 2024-09-15T23:14:47.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.850+0000 7fb6ff7fe640 1 --2- 172.21.15.123:0/2123631150 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558d5136b240 0x558d51370d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:47.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.850+0000 7fb704f5d640 1 --2- 172.21.15.123:0/2123631150 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558d5138a450 0x558d51371280 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800c090 tx=0x7fb6f8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ca1178895c6c8e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:47.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.850+0000 7fb6deffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:47.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.850+0000 7fb6deffd640 1 -- 172.21.15.123:0/2123631150 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8054060 con 0x558d5138a450 2024-09-15T23:14:47.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.850+0000 7fb6deffd640 1 -- 172.21.15.123:0/2123631150 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7fb6f8003da0 con 0x558d5138a450 2024-09-15T23:14:47.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.850+0000 7fb70982f740 1 -- 172.21.15.123:0/2123631150 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6f8037040 con 0x558d5138a450 2024-09-15T23:14:47.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.850+0000 7fb6deffd640 1 -- 172.21.15.123:0/2123631150 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb6f805a050 con 0x558d5138a450 2024-09-15T23:14:47.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.850+0000 7fb70982f740 10 client.5463 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:47.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.850+0000 7fb70982f740 1 -- 172.21.15.123:0/2123631150 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x558d5140c5c0 con 0x558d5138a450 2024-09-15T23:14:47.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.850+0000 7fb6deffd640 1 -- 172.21.15.123:0/2123631150 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6f8037040 con 0x558d5138a450 2024-09-15T23:14:47.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.850+0000 7fb6deffd640 1 -- 172.21.15.123:0/2123631150 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7fb6f8008040 con 0x558d5138a450 2024-09-15T23:14:47.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.850+0000 7fb70982f740 10 client.5463 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:47.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.850+0000 7fb70982f740 10 client.5463 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:47.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.850+0000 7fb70982f740 20 client.5463 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:47.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.850+0000 7fb70982f740 1 --2- 172.21.15.123:0/2123631150 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x558d513a7380 0x558d5139b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.850+0000 7fb70982f740 4 client.5463 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}] 2024-09-15T23:14:47.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.850+0000 7fb70982f740 1 -- 172.21.15.123:0/2123631150 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}) -- 0x558d512af520 con 0x558d513a7380 2024-09-15T23:14:47.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.851+0000 7fb6fffff640 1 --2- 172.21.15.123:0/2123631150 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x558d513a7380 0x558d5139b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.851+0000 7fb6deffd640 10 client.5463 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:47.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.851+0000 7fb6fffff640 1 --2- 172.21.15.123:0/2123631150 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x558d513a7380 0x558d5139b380 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=912d2b0414141d5 server_cookie=3a35a8c848e22277 in_seq=0 out_seq=0 2024-09-15T23:14:47.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.851+0000 7fb6deffd640 1 -- 172.21.15.123:0/2123631150 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+26 (crc 0 0 0) 0x558d512af520 con 0x558d513a7380 2024-09-15T23:14:47.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.851+0000 7fb6deffd640 10 client.5463 handle_command_reply: tid=0 2024-09-15T23:14:47.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.851+0000 7fb70982f740 1 client.5463 shutdown 2024-09-15T23:14:47.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.851+0000 7fb70982f740 1 -- 172.21.15.123:0/2123631150 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558d5138a450 msgr2=0x558d51371280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:47.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.851+0000 7fb70982f740 1 --2- 172.21.15.123:0/2123631150 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558d5138a450 0x558d51371280 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800c090 tx=0x7fb6f8004ab0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.851+0000 7fb70982f740 1 -- 172.21.15.123:0/2123631150 shutdown_connections 2024-09-15T23:14:47.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.851+0000 7fb70982f740 1 --2- 172.21.15.123:0/2123631150 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x558d513a7380 0x558d5139b380 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.851+0000 7fb70982f740 1 --2- 172.21.15.123:0/2123631150 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558d5138a450 0x558d51371280 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.851+0000 7fb70982f740 1 --2- 172.21.15.123:0/2123631150 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558d5136b240 0x558d51370d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.851+0000 7fb6deffd640 0 client.5463 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:47.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.851+0000 7fb70982f740 1 --2- 172.21.15.123:0/2123631150 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558d51344b00 0x558d5139feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.851+0000 7fb70982f740 1 -- 172.21.15.123:0/2123631150 >> 172.21.15.123:0/2123631150 conn(0x558d5136ae60 msgr2=0x558d513433d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:47.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.851+0000 7fb70982f740 1 -- 172.21.15.123:0/2123631150 shutdown_connections 2024-09-15T23:14:47.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.851+0000 7fb70982f740 1 -- 172.21.15.123:0/2123631150 wait complete. 2024-09-15T23:14:47.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.851+0000 7fb70982f740 20 client.5463 trim_cache size 0 max 16384 2024-09-15T23:14:47.862 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:14:47.862 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": -2 2024-09-15T23:14:47.862 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:14:47.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.852+0000 7fb7069c0640 1 -- 172.21.15.123:0/884553521 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb6ec06c2b0 msgr2=0x7fb6ec06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:47.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.852+0000 7fb7069c0640 1 --2- 172.21.15.123:0/884553521 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb6ec06c2b0 0x7fb6ec06e770 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0009e10 tx=0x7fb6f0009190 comp rx=0 tx=0).stop 2024-09-15T23:14:47.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.852+0000 7fb7069c0640 1 -- 172.21.15.123:0/884553521 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7000cead0 msgr2=0x7fb70006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:47.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.852+0000 7fb7069c0640 1 --2- 172.21.15.123:0/884553521 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7000cead0 0x7fb70006bc10 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb6f400e8e0 tx=0x7fb6f400eda0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.852+0000 7fb7069c0640 1 -- 172.21.15.123:0/884553521 shutdown_connections 2024-09-15T23:14:47.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.852+0000 7fb7069c0640 1 --2- 172.21.15.123:0/884553521 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb70015b7c0 0x7fb70006c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.852+0000 7fb7069c0640 1 --2- 172.21.15.123:0/884553521 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb6ec06c2b0 0x7fb6ec06e770 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.852+0000 7fb7069c0640 1 --2- 172.21.15.123:0/884553521 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7000cead0 0x7fb70006bc10 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.852+0000 7fb7069c0640 1 --2- 172.21.15.123:0/884553521 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb7000ccf30 0x7fb700143ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.852+0000 7fb7069c0640 1 -- 172.21.15.123:0/884553521 >> 172.21.15.123:0/884553521 conn(0x7fb70006d0f0 msgr2=0x7fb7000b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:47.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.852+0000 7fb7069c0640 1 -- 172.21.15.123:0/884553521 shutdown_connections 2024-09-15T23:14:47.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.852+0000 7fb7069c0640 1 -- 172.21.15.123:0/884553521 wait complete. 2024-09-15T23:14:47.866 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/i/dont/exist' returned '{'return_code': -2}' 2024-09-15T23:14:47.866 INFO:tasks.cephfs.test_scrub_checks:First run: flushing /scrub_test_path/ceph-qa-suite/suites 2024-09-15T23:14:47.866 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/suites' 2024-09-15T23:14:47.866 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/suites 2024-09-15T23:14:47.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.966+0000 7faffaf33640 1 Processor -- start 2024-09-15T23:14:47.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.966+0000 7faffaf33640 1 -- start start 2024-09-15T23:14:47.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.967+0000 7faffaf33640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7faff40b0230 0x7faff4162c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.967+0000 7faffaf33640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faff4073cc0 con 0x7faff4155950 2024-09-15T23:14:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.967+0000 7faffaf33640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faff4071aa0 con 0x7faff4073600 2024-09-15T23:14:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.967+0000 7faffaf33640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7faff41631c0 con 0x7faff40b0230 2024-09-15T23:14:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.967+0000 7faff8ccf640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7faff4155950 0x7faff406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41082/0 (socket says 172.21.15.123:41082) 2024-09-15T23:14:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.967+0000 7faff8ccf640 1 -- 172.21.15.123:0/3034076189 learned_addr learned my addr 172.21.15.123:0/3034076189 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.967+0000 7faff94d0640 1 --2- 172.21.15.123:0/3034076189 >> v2:172.21.15.188:3300/0 conn(0x7faff40b0230 0x7faff4162c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.967+0000 7fafeb7fe640 1 -- 172.21.15.123:0/3034076189 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3273554915 0 0) 0x7faff4073cc0 con 0x7faff4155950 2024-09-15T23:14:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.967+0000 7fafeb7fe640 1 -- 172.21.15.123:0/3034076189 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafdc003520 con 0x7faff4155950 2024-09-15T23:14:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.967+0000 7faff94d0640 1 -- 172.21.15.123:0/3034076189 >> v1:172.21.15.188:6789/0 conn(0x7faff4073600 legacy=0x7faff40afb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.967+0000 7faff94d0640 1 -- 172.21.15.123:0/3034076189 >> v1:172.21.15.123:6789/0 conn(0x7faff4155950 legacy=0x7faff406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.967+0000 7faff94d0640 1 -- 172.21.15.123:0/3034076189 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faff4071d80 con 0x7faff40b0230 2024-09-15T23:14:47.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.969+0000 7faff94d0640 1 --2- 172.21.15.123:0/3034076189 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faff40b0230 0x7faff4162c80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fafec009d90 tx=0x7fafec02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87900c3565e53e90 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:47.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.969+0000 7fafeb7fe640 1 -- 172.21.15.123:0/3034076189 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafec007740 con 0x7faff40b0230 2024-09-15T23:14:47.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.969+0000 7fafeb7fe640 1 -- 172.21.15.123:0/3034076189 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafec0078e0 con 0x7faff40b0230 2024-09-15T23:14:47.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.969+0000 7fafeb7fe640 1 -- 172.21.15.123:0/3034076189 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafec007cb0 con 0x7faff40b0230 2024-09-15T23:14:47.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.970+0000 7faffaf33640 1 -- 172.21.15.123:0/3034076189 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faff40b0230 msgr2=0x7faff4162c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:47.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.970+0000 7faffaf33640 1 --2- 172.21.15.123:0/3034076189 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faff40b0230 0x7faff4162c80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fafec009d90 tx=0x7fafec02a6f0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.970+0000 7faffaf33640 1 -- 172.21.15.123:0/3034076189 shutdown_connections 2024-09-15T23:14:47.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.970+0000 7faffaf33640 1 --2- 172.21.15.123:0/3034076189 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faff40b0230 0x7faff4162c80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.970+0000 7faffaf33640 1 -- 172.21.15.123:0/3034076189 >> 172.21.15.123:0/3034076189 conn(0x7faff406db30 msgr2=0x7faff406df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:47.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.970+0000 7faffaf33640 1 -- 172.21.15.123:0/3034076189 shutdown_connections 2024-09-15T23:14:47.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.970+0000 7faffaf33640 1 -- 172.21.15.123:0/3034076189 wait complete. 2024-09-15T23:14:47.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.971+0000 7faffaf33640 1 Processor -- start 2024-09-15T23:14:47.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.971+0000 7faffaf33640 1 -- start start 2024-09-15T23:14:47.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.972+0000 7faffaf33640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faff4073600 0x7faff41f4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.972+0000 7faffaf33640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faff40b0230 0x7faff4154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.972+0000 7faffaf33640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faff4147260 0x7faff40ce240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.972+0000 7faffaf33640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7faff4073a60 con 0x7faff4147260 2024-09-15T23:14:47.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.972+0000 7faffaf33640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7faff4070370 con 0x7faff40b0230 2024-09-15T23:14:47.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.972+0000 7faffaf33640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7faff4072060 con 0x7faff4073600 2024-09-15T23:14:47.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.972+0000 7faff94d0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faff4147260 0x7faff40ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.972+0000 7faff94d0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faff4147260 0x7faff40ce240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47836/0 (socket says 172.21.15.123:47836) 2024-09-15T23:14:47.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.972+0000 7faff94d0640 1 -- 172.21.15.123:0/138268482 learned_addr learned my addr 172.21.15.123:0/138268482 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:47.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.972+0000 7faff8ccf640 1 --2- 172.21.15.123:0/138268482 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faff4073600 0x7faff41f4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.972+0000 7fafebfff640 1 --2- 172.21.15.123:0/138268482 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faff40b0230 0x7faff4154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.972+0000 7faff94d0640 1 -- 172.21.15.123:0/138268482 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faff4073600 msgr2=0x7faff41f4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:47.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.972+0000 7faff94d0640 1 --2- 172.21.15.123:0/138268482 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faff4073600 0x7faff41f4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.972+0000 7faff94d0640 1 -- 172.21.15.123:0/138268482 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faff40b0230 msgr2=0x7faff4154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:47.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.972+0000 7faff94d0640 1 --2- 172.21.15.123:0/138268482 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faff40b0230 0x7faff4154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.972+0000 7faff94d0640 1 -- 172.21.15.123:0/138268482 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faff40ce9e0 con 0x7faff4147260 2024-09-15T23:14:47.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.972+0000 7faff94d0640 1 --2- 172.21.15.123:0/138268482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faff4147260 0x7faff40ce240 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fafec009eb0 tx=0x7fafec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:47.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.972+0000 7fafe97fa640 1 -- 172.21.15.123:0/138268482 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafec040070 con 0x7faff4147260 2024-09-15T23:14:47.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.972+0000 7fafe97fa640 1 -- 172.21.15.123:0/138268482 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafec031b40 con 0x7faff4147260 2024-09-15T23:14:47.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.972+0000 7faffaf33640 1 -- 172.21.15.123:0/138268482 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faff40cecc0 con 0x7faff4147260 2024-09-15T23:14:47.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.972+0000 7fafe97fa640 1 -- 172.21.15.123:0/138268482 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafec045460 con 0x7faff4147260 2024-09-15T23:14:47.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.972+0000 7faffaf33640 1 -- 172.21.15.123:0/138268482 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faff41e83d0 con 0x7faff4147260 2024-09-15T23:14:47.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.974+0000 7fafe97fa640 1 -- 172.21.15.123:0/138268482 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fafec039040 con 0x7faff4147260 2024-09-15T23:14:47.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.974+0000 7fafe97fa640 1 --2- 172.21.15.123:0/138268482 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fafe006c2e0 0x7fafe006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.974+0000 7fafe97fa640 1 -- 172.21.15.123:0/138268482 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7fafec0acab0 con 0x7faff4147260 2024-09-15T23:14:47.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.975+0000 7faff8ccf640 1 --2- 172.21.15.123:0/138268482 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fafe006c2e0 0x7fafe006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.975+0000 7faff8ccf640 1 --2- 172.21.15.123:0/138268482 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fafe006c2e0 0x7fafe006e7a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7faff0005880 tx=0x7faff0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:47.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.975+0000 7faffdcc9740 1 Processor -- start 2024-09-15T23:14:47.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.975+0000 7faffdcc9740 1 -- start start 2024-09-15T23:14:47.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.976+0000 7faffdcc9740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562189e071e0 0x562189e4c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.976+0000 7faffdcc9740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562189e049a0 0x562189e075c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.976+0000 7faffdcc9740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562189e08970 0x562189e017d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.976+0000 7faffdcc9740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x562189d69780 con 0x562189e071e0 2024-09-15T23:14:47.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.976+0000 7faffdcc9740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x562189d11460 con 0x562189e049a0 2024-09-15T23:14:47.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.976+0000 7faffdcc9740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x562189d65740 con 0x562189e08970 2024-09-15T23:14:47.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.976+0000 7faff8ccf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562189e071e0 0x562189e4c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.976+0000 7faff8ccf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562189e071e0 0x562189e4c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47840/0 (socket says 172.21.15.123:47840) 2024-09-15T23:14:47.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.976+0000 7faff8ccf640 1 -- 172.21.15.123:0/1372346867 learned_addr learned my addr 172.21.15.123:0/1372346867 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:47.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.976+0000 7faff94d0640 1 --2- 172.21.15.123:0/1372346867 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562189e08970 0x562189e017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.976+0000 7fafebfff640 1 --2- 172.21.15.123:0/1372346867 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562189e049a0 0x562189e075c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.976+0000 7faff8ccf640 1 -- 172.21.15.123:0/1372346867 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562189e08970 msgr2=0x562189e017d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:47.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.976+0000 7faff8ccf640 1 --2- 172.21.15.123:0/1372346867 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562189e08970 0x562189e017d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.976+0000 7faff8ccf640 1 -- 172.21.15.123:0/1372346867 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562189e049a0 msgr2=0x562189e075c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:47.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.976+0000 7faff8ccf640 1 --2- 172.21.15.123:0/1372346867 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562189e049a0 0x562189e075c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.976+0000 7faff8ccf640 1 -- 172.21.15.123:0/1372346867 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562189a7c6b0 con 0x562189e071e0 2024-09-15T23:14:47.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.976+0000 7fafebfff640 1 --2- 172.21.15.123:0/1372346867 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562189e049a0 0x562189e075c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:47.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.977+0000 7faff8ccf640 1 --2- 172.21.15.123:0/1372346867 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562189e071e0 0x562189e4c980 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7faff000fb10 tx=0x7faff0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2684168f39ba5d24 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:47.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.977+0000 7fafda7fc640 1 -- 172.21.15.123:0/1372346867 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff0025070 con 0x562189e071e0 2024-09-15T23:14:47.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.977+0000 7fafda7fc640 1 -- 172.21.15.123:0/1372346867 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faff0015bf0 con 0x562189e071e0 2024-09-15T23:14:47.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.977+0000 7fafda7fc640 1 -- 172.21.15.123:0/1372346867 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff0020400 con 0x562189e071e0 2024-09-15T23:14:47.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.977+0000 7faffdcc9740 1 -- 172.21.15.123:0/1372346867 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562189e071e0 msgr2=0x562189e4c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:47.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.977+0000 7faffdcc9740 1 --2- 172.21.15.123:0/1372346867 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562189e071e0 0x562189e4c980 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7faff000fb10 tx=0x7faff0000ed0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.977+0000 7faffdcc9740 1 -- 172.21.15.123:0/1372346867 shutdown_connections 2024-09-15T23:14:47.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.977+0000 7faffdcc9740 1 --2- 172.21.15.123:0/1372346867 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562189e08970 0x562189e017d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.977+0000 7faffdcc9740 1 --2- 172.21.15.123:0/1372346867 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562189e049a0 0x562189e075c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.977+0000 7faffdcc9740 1 --2- 172.21.15.123:0/1372346867 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562189e071e0 0x562189e4c980 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.977+0000 7faffdcc9740 1 -- 172.21.15.123:0/1372346867 >> 172.21.15.123:0/1372346867 conn(0x562189e039a0 msgr2=0x562189e4be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:47.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.977+0000 7faffdcc9740 1 -- 172.21.15.123:0/1372346867 shutdown_connections 2024-09-15T23:14:47.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.977+0000 7faffdcc9740 1 -- 172.21.15.123:0/1372346867 wait complete. 2024-09-15T23:14:47.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.978+0000 7faffdcc9740 1 -- start start 2024-09-15T23:14:47.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.978+0000 7faffdcc9740 1 Processor -- start 2024-09-15T23:14:47.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.979+0000 7faffdcc9740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562189e071e0 0x562189e31940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.979+0000 7faffdcc9740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562189e08970 0x562189e205f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.979+0000 7faffdcc9740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562189e46480 0x562189e47f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.979+0000 7faffdcc9740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x562189e02e40 con 0x562189e071e0 2024-09-15T23:14:47.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.979+0000 7faffdcc9740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x562189cf26e0 con 0x562189e46480 2024-09-15T23:14:47.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.979+0000 7faffdcc9740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x562189e4d1b0 con 0x562189e08970 2024-09-15T23:14:47.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.979+0000 7faffdcc9740 10 client.0 _ll_register_callbacks cb 0x562189d62d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:47.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.979+0000 7faff8ccf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562189e071e0 0x562189e31940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.979+0000 7faff8ccf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562189e071e0 0x562189e31940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47852/0 (socket says 172.21.15.123:47852) 2024-09-15T23:14:47.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.979+0000 7faff8ccf640 1 -- 172.21.15.123:0/52409136 learned_addr learned my addr 172.21.15.123:0/52409136 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:47.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.979+0000 7fafebfff640 1 --2- 172.21.15.123:0/52409136 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562189e08970 0x562189e205f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.979+0000 7faff94d0640 1 --2- 172.21.15.123:0/52409136 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562189e46480 0x562189e47f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.979+0000 7faff8ccf640 1 -- 172.21.15.123:0/52409136 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562189e08970 msgr2=0x562189e205f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:47.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.979+0000 7faff8ccf640 1 --2- 172.21.15.123:0/52409136 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562189e08970 0x562189e205f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.979+0000 7faff8ccf640 1 -- 172.21.15.123:0/52409136 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562189e46480 msgr2=0x562189e47f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:47.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.979+0000 7faff8ccf640 1 --2- 172.21.15.123:0/52409136 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562189e46480 0x562189e47f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.979+0000 7faff8ccf640 1 -- 172.21.15.123:0/52409136 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562189b46a90 con 0x562189e071e0 2024-09-15T23:14:47.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.979+0000 7faff8ccf640 1 --2- 172.21.15.123:0/52409136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562189e071e0 0x562189e31940 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7faff0001eb0 tx=0x7faff00010a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2373570a450b79a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:47.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.979+0000 7fafd37fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:47.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.980+0000 7fafd37fe640 1 -- 172.21.15.123:0/52409136 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff0030060 con 0x562189e071e0 2024-09-15T23:14:47.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.980+0000 7fafd37fe640 1 -- 172.21.15.123:0/52409136 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7faff0020d80 con 0x562189e071e0 2024-09-15T23:14:47.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.980+0000 7faffdcc9740 1 -- 172.21.15.123:0/52409136 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faff0015bf0 con 0x562189e071e0 2024-09-15T23:14:47.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.980+0000 7fafd37fe640 1 -- 172.21.15.123:0/52409136 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7faff0036050 con 0x562189e071e0 2024-09-15T23:14:47.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.980+0000 7faffdcc9740 10 client.5475 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:47.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.980+0000 7faffdcc9740 1 -- 172.21.15.123:0/52409136 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x562189e47700 con 0x562189e071e0 2024-09-15T23:14:47.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.980+0000 7fafd37fe640 1 -- 172.21.15.123:0/52409136 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faff0015bf0 con 0x562189e071e0 2024-09-15T23:14:47.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.980+0000 7fafd37fe640 1 -- 172.21.15.123:0/52409136 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7faff0039020 con 0x562189e071e0 2024-09-15T23:14:47.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.980+0000 7faffdcc9740 10 client.5475 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:47.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.980+0000 7faffdcc9740 10 client.5475 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:47.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.980+0000 7faffdcc9740 20 client.5475 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:47.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.980+0000 7faffdcc9740 1 --2- 172.21.15.123:0/52409136 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x562189e5f520 0x562189e5f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.980+0000 7faffdcc9740 4 client.5475 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:14:47.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.980+0000 7faffdcc9740 1 -- 172.21.15.123:0/52409136 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562189d76eb0 con 0x562189e5f520 2024-09-15T23:14:47.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.980+0000 7fafebfff640 1 --2- 172.21.15.123:0/52409136 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x562189e5f520 0x562189e5f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:47.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.981+0000 7fafd37fe640 10 client.5475 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:47.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.981+0000 7fafebfff640 1 --2- 172.21.15.123:0/52409136 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x562189e5f520 0x562189e5f900 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=281638ee758f2cdc server_cookie=c8e9bab0ae1ba718 in_seq=0 out_seq=0 2024-09-15T23:14:47.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.981+0000 7fafd37fe640 1 -- 172.21.15.123:0/52409136 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562189d76eb0 con 0x562189e5f520 2024-09-15T23:14:47.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.981+0000 7fafd37fe640 10 client.5475 handle_command_reply: tid=0 2024-09-15T23:14:47.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.981+0000 7faffdcc9740 1 client.5475 shutdown 2024-09-15T23:14:47.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.981+0000 7faffdcc9740 1 -- 172.21.15.123:0/52409136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562189e071e0 msgr2=0x562189e31940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:47.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.981+0000 7faffdcc9740 1 --2- 172.21.15.123:0/52409136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562189e071e0 0x562189e31940 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7faff0001eb0 tx=0x7faff00010a0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.981+0000 7faffdcc9740 1 -- 172.21.15.123:0/52409136 shutdown_connections 2024-09-15T23:14:47.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.981+0000 7faffdcc9740 1 --2- 172.21.15.123:0/52409136 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x562189e5f520 0x562189e5f900 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.981+0000 7faffdcc9740 1 --2- 172.21.15.123:0/52409136 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562189e46480 0x562189e47f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.981+0000 7fafd37fe640 0 client.5475 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:47.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.981+0000 7faffdcc9740 1 --2- 172.21.15.123:0/52409136 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562189e08970 0x562189e205f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.981+0000 7faffdcc9740 1 --2- 172.21.15.123:0/52409136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562189e071e0 0x562189e31940 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:47.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.981+0000 7faffdcc9740 1 -- 172.21.15.123:0/52409136 >> 172.21.15.123:0/52409136 conn(0x562189e049a0 msgr2=0x562189e4b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:47.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.981+0000 7faffdcc9740 1 -- 172.21.15.123:0/52409136 shutdown_connections 2024-09-15T23:14:47.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.981+0000 7faffdcc9740 1 -- 172.21.15.123:0/52409136 wait complete. 2024-09-15T23:14:47.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.982+0000 7faffdcc9740 20 client.5475 trim_cache size 0 max 16384 2024-09-15T23:14:47.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.996+0000 7faffdcc9740 1 Processor -- start 2024-09-15T23:14:47.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.996+0000 7faffdcc9740 1 -- start start 2024-09-15T23:14:47.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.996+0000 7faffdcc9740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562189e071e0 0x562189e4b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.996+0000 7faffdcc9740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562189e08970 0x562189e49fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.996+0000 7faffdcc9740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562189e46480 0x562189e4a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:47.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.996+0000 7faffdcc9740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7faff4200d20 con 0x562189e071e0 2024-09-15T23:14:47.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.996+0000 7faffdcc9740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7faff41e9a10 con 0x562189e08970 2024-09-15T23:14:48.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.996+0000 7faffdcc9740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7faff41e8d70 con 0x562189e46480 2024-09-15T23:14:48.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.997+0000 7faff8ccf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562189e071e0 0x562189e4b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.997+0000 7faff8ccf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562189e071e0 0x562189e4b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47858/0 (socket says 172.21.15.123:47858) 2024-09-15T23:14:48.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.997+0000 7faff8ccf640 1 -- 172.21.15.123:0/2776257016 learned_addr learned my addr 172.21.15.123:0/2776257016 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:48.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.997+0000 7faff8ccf640 1 -- 172.21.15.123:0/2776257016 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562189e46480 msgr2=0x562189e4a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.997+0000 7faff8ccf640 1 --2- 172.21.15.123:0/2776257016 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562189e46480 0x562189e4a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.997+0000 7faff8ccf640 1 -- 172.21.15.123:0/2776257016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562189e08970 msgr2=0x562189e49fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.997+0000 7faff8ccf640 1 --2- 172.21.15.123:0/2776257016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562189e08970 0x562189e49fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.997+0000 7faff8ccf640 1 -- 172.21.15.123:0/2776257016 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562189e036e0 con 0x562189e071e0 2024-09-15T23:14:48.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.997+0000 7faff8ccf640 1 --2- 172.21.15.123:0/2776257016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562189e071e0 0x562189e4b3b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7faff0020fd0 tx=0x7faff001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0e6bb8a94acc7c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.997+0000 7fafd9ffb640 1 -- 172.21.15.123:0/2776257016 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff0025040 con 0x562189e071e0 2024-09-15T23:14:48.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.997+0000 7fafd9ffb640 1 -- 172.21.15.123:0/2776257016 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faff002b4c0 con 0x562189e071e0 2024-09-15T23:14:48.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.997+0000 7fafd9ffb640 1 -- 172.21.15.123:0/2776257016 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff0020c40 con 0x562189e071e0 2024-09-15T23:14:48.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.998+0000 7faffdcc9740 1 -- 172.21.15.123:0/2776257016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562189e071e0 msgr2=0x562189e4b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.998+0000 7faffdcc9740 1 --2- 172.21.15.123:0/2776257016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562189e071e0 0x562189e4b3b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7faff0020fd0 tx=0x7faff001d000 comp rx=0 tx=0).stop 2024-09-15T23:14:48.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.998+0000 7faffdcc9740 1 -- 172.21.15.123:0/2776257016 shutdown_connections 2024-09-15T23:14:48.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.998+0000 7faffdcc9740 1 --2- 172.21.15.123:0/2776257016 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562189e46480 0x562189e4a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.998+0000 7faffdcc9740 1 --2- 172.21.15.123:0/2776257016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562189e08970 0x562189e49fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.998+0000 7faffdcc9740 1 --2- 172.21.15.123:0/2776257016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562189e071e0 0x562189e4b3b0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.998+0000 7faffdcc9740 1 -- 172.21.15.123:0/2776257016 >> 172.21.15.123:0/2776257016 conn(0x562189e049a0 msgr2=0x562189e47940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.998+0000 7faffdcc9740 1 -- 172.21.15.123:0/2776257016 shutdown_connections 2024-09-15T23:14:48.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.998+0000 7faffdcc9740 1 -- 172.21.15.123:0/2776257016 wait complete. 2024-09-15T23:14:48.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.998+0000 7faffdcc9740 1 -- start start 2024-09-15T23:14:48.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.998+0000 7faffdcc9740 1 Processor -- start 2024-09-15T23:14:48.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.999+0000 7faffdcc9740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562189e071e0 0x562189e5d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.999+0000 7faffdcc9740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562189e08970 0x562189e49fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.999+0000 7faffdcc9740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562189e46480 0x562189e4a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.999+0000 7faffdcc9740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x562189e2e660 con 0x562189e08970 2024-09-15T23:14:48.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.999+0000 7faffdcc9740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7faff41e93c0 con 0x562189e46480 2024-09-15T23:14:48.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.999+0000 7faffdcc9740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x562189e45980 con 0x562189e071e0 2024-09-15T23:14:48.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.999+0000 7faffdcc9740 10 client.0 _ll_register_callbacks cb 0x7faff0023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:48.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.999+0000 7fafebfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562189e08970 0x562189e49fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.999+0000 7fafebfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562189e08970 0x562189e49fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47864/0 (socket says 172.21.15.123:47864) 2024-09-15T23:14:48.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.999+0000 7fafebfff640 1 -- 172.21.15.123:0/3874244230 learned_addr learned my addr 172.21.15.123:0/3874244230 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:48.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.999+0000 7faff8ccf640 1 --2- 172.21.15.123:0/3874244230 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562189e071e0 0x562189e5d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:47.999+0000 7faff94d0640 1 --2- 172.21.15.123:0/3874244230 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562189e46480 0x562189e4a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.000+0000 7fafebfff640 1 -- 172.21.15.123:0/3874244230 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562189e071e0 msgr2=0x562189e5d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.000+0000 7fafebfff640 1 --2- 172.21.15.123:0/3874244230 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562189e071e0 0x562189e5d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.000+0000 7fafebfff640 1 -- 172.21.15.123:0/3874244230 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562189e46480 msgr2=0x562189e4a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.000+0000 7fafebfff640 1 --2- 172.21.15.123:0/3874244230 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562189e46480 0x562189e4a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.000+0000 7fafebfff640 1 -- 172.21.15.123:0/3874244230 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562189e5e960 con 0x562189e08970 2024-09-15T23:14:48.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.000+0000 7fafebfff640 1 --2- 172.21.15.123:0/3874244230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562189e08970 0x562189e49fb0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x562189e30230 tx=0x7fafe4003e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e3c701d0ad8963b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.000+0000 7fafd37fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:48.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.000+0000 7fafd37fe640 1 -- 172.21.15.123:0/3874244230 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafe4019cb0 con 0x562189e08970 2024-09-15T23:14:48.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.000+0000 7fafd37fe640 1 -- 172.21.15.123:0/3874244230 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7fafe4007050 con 0x562189e08970 2024-09-15T23:14:48.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.000+0000 7faffdcc9740 1 -- 172.21.15.123:0/3874244230 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faff002b4c0 con 0x562189e08970 2024-09-15T23:14:48.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.000+0000 7fafd37fe640 1 -- 172.21.15.123:0/3874244230 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fafe4029050 con 0x562189e08970 2024-09-15T23:14:48.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.000+0000 7faffdcc9740 10 client.5481 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:48.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.000+0000 7faffdcc9740 1 -- 172.21.15.123:0/3874244230 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x562189e5ef20 con 0x562189e08970 2024-09-15T23:14:48.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.000+0000 7fafd37fe640 1 -- 172.21.15.123:0/3874244230 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faff002b4c0 con 0x562189e08970 2024-09-15T23:14:48.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.000+0000 7fafd37fe640 1 -- 172.21.15.123:0/3874244230 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7fafe402c020 con 0x562189e08970 2024-09-15T23:14:48.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.000+0000 7faffdcc9740 10 client.5481 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:48.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.000+0000 7faffdcc9740 10 client.5481 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:48.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.000+0000 7faffdcc9740 20 client.5481 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:48.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.000+0000 7faffdcc9740 1 --2- 172.21.15.123:0/3874244230 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x562189e31560 0x562189e31940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.000+0000 7faffdcc9740 4 client.5481 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-09-15T23:14:48.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.000+0000 7faffdcc9740 1 -- 172.21.15.123:0/3874244230 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites"}) -- 0x562189d71200 con 0x562189e31560 2024-09-15T23:14:48.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.001+0000 7faff8ccf640 1 --2- 172.21.15.123:0/3874244230 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x562189e31560 0x562189e31940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.001+0000 7fafd37fe640 10 client.5481 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:48.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.001+0000 7faff8ccf640 1 --2- 172.21.15.123:0/3874244230 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x562189e31560 0x562189e31940 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14398941c9dec97a server_cookie=b71f4f54f4a83699 in_seq=0 out_seq=0 2024-09-15T23:14:48.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.004+0000 7fafd37fe640 1 -- 172.21.15.123:0/3874244230 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562189d71200 con 0x562189e31560 2024-09-15T23:14:48.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.004+0000 7fafd37fe640 10 client.5481 handle_command_reply: tid=0 2024-09-15T23:14:48.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.004+0000 7faffdcc9740 1 client.5481 shutdown 2024-09-15T23:14:48.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.004+0000 7faffdcc9740 1 -- 172.21.15.123:0/3874244230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562189e08970 msgr2=0x562189e49fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.004+0000 7faffdcc9740 1 --2- 172.21.15.123:0/3874244230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562189e08970 0x562189e49fb0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x562189e30230 tx=0x7fafe4003e70 comp rx=0 tx=0).stop 2024-09-15T23:14:48.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.004+0000 7faffdcc9740 1 -- 172.21.15.123:0/3874244230 shutdown_connections 2024-09-15T23:14:48.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.004+0000 7faffdcc9740 1 --2- 172.21.15.123:0/3874244230 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x562189e31560 0x562189e31940 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.004+0000 7faffdcc9740 1 --2- 172.21.15.123:0/3874244230 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562189e46480 0x562189e4a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.004+0000 7faffdcc9740 1 --2- 172.21.15.123:0/3874244230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562189e08970 0x562189e49fb0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.004+0000 7fafd37fe640 0 client.5481 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:48.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.004+0000 7faffdcc9740 1 --2- 172.21.15.123:0/3874244230 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562189e071e0 0x562189e5d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.004+0000 7faffdcc9740 1 -- 172.21.15.123:0/3874244230 >> 172.21.15.123:0/3874244230 conn(0x562189e049a0 msgr2=0x562189e081d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.004+0000 7faffdcc9740 1 -- 172.21.15.123:0/3874244230 shutdown_connections 2024-09-15T23:14:48.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.004+0000 7faffdcc9740 1 -- 172.21.15.123:0/3874244230 wait complete. 2024-09-15T23:14:48.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.004+0000 7faffdcc9740 20 client.5481 trim_cache size 0 max 16384 2024-09-15T23:14:48.009 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:14:48.009 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "", 2024-09-15T23:14:48.009 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0 2024-09-15T23:14:48.009 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:14:48.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.005+0000 7faffaf33640 1 -- 172.21.15.123:0/138268482 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fafe006c2e0 msgr2=0x7fafe006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.005+0000 7faffaf33640 1 --2- 172.21.15.123:0/138268482 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fafe006c2e0 0x7fafe006e7a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7faff0005880 tx=0x7faff0009040 comp rx=0 tx=0).stop 2024-09-15T23:14:48.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.005+0000 7faffaf33640 1 -- 172.21.15.123:0/138268482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faff4147260 msgr2=0x7faff40ce240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.005+0000 7faffaf33640 1 --2- 172.21.15.123:0/138268482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faff4147260 0x7faff40ce240 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fafec009eb0 tx=0x7fafec004a40 comp rx=0 tx=0).stop 2024-09-15T23:14:48.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.005+0000 7faffaf33640 1 -- 172.21.15.123:0/138268482 shutdown_connections 2024-09-15T23:14:48.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.005+0000 7faffaf33640 1 --2- 172.21.15.123:0/138268482 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fafe006c2e0 0x7fafe006e7a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.005+0000 7faffaf33640 1 --2- 172.21.15.123:0/138268482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faff4147260 0x7faff40ce240 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.005+0000 7faffaf33640 1 --2- 172.21.15.123:0/138268482 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faff40b0230 0x7faff4154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.005+0000 7faffaf33640 1 --2- 172.21.15.123:0/138268482 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faff4073600 0x7faff41f4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.005+0000 7faffaf33640 1 -- 172.21.15.123:0/138268482 >> 172.21.15.123:0/138268482 conn(0x7faff406db30 msgr2=0x7faff406ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.005+0000 7faffaf33640 1 -- 172.21.15.123:0/138268482 shutdown_connections 2024-09-15T23:14:48.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.005+0000 7faffaf33640 1 -- 172.21.15.123:0/138268482 wait complete. 2024-09-15T23:14:48.016 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/suites' returned '{'message': '', 'return_code': 0}' 2024-09-15T23:14:48.016 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites' 2024-09-15T23:14:48.017 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites 2024-09-15T23:14:48.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.118+0000 7fccff942640 1 Processor -- start 2024-09-15T23:14:48.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.118+0000 7fccff942640 1 -- start start 2024-09-15T23:14:48.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.119+0000 7fccff942640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fccf8155950 0x7fccf8073600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.119+0000 7fccff942640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fccf80afb20 0x7fccf80affd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.119+0000 7fccff942640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccf8073cc0 con 0x7fccf8162c80 2024-09-15T23:14:48.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.119+0000 7fccff942640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fccf8070370 con 0x7fccf80afb20 2024-09-15T23:14:48.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.119+0000 7fccff942640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fccf8071aa0 con 0x7fccf8155950 2024-09-15T23:14:48.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.119+0000 7fccfcedd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fccf8162c80 0x7fccf806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41092/0 (socket says 172.21.15.123:41092) 2024-09-15T23:14:48.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.119+0000 7fccfcedd640 1 -- 172.21.15.123:0/1580933889 learned_addr learned my addr 172.21.15.123:0/1580933889 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:48.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.119+0000 7fccfdedf640 1 --2- 172.21.15.123:0/1580933889 >> v2:172.21.15.188:3300/0 conn(0x7fccf80afb20 0x7fccf80affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.119+0000 7fccfd6de640 1 --2- 172.21.15.123:0/1580933889 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fccf8155950 0x7fccf8073600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.119+0000 7fcceffff640 1 -- 172.21.15.123:0/1580933889 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3337281351 0 0) 0x7fccf8073cc0 con 0x7fccf8162c80 2024-09-15T23:14:48.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.119+0000 7fcceffff640 1 -- 172.21.15.123:0/1580933889 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcce4003520 con 0x7fccf8162c80 2024-09-15T23:14:48.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.119+0000 7fccfdedf640 1 -- 172.21.15.123:0/1580933889 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fccf8155950 msgr2=0x7fccf8073600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.119+0000 7fccfdedf640 1 --2- 172.21.15.123:0/1580933889 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fccf8155950 0x7fccf8073600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.119+0000 7fccfdedf640 1 -- 172.21.15.123:0/1580933889 >> v1:172.21.15.123:6789/0 conn(0x7fccf8162c80 legacy=0x7fccf806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.119+0000 7fccfdedf640 1 -- 172.21.15.123:0/1580933889 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf8071d80 con 0x7fccf80afb20 2024-09-15T23:14:48.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.119+0000 7fccfd6de640 1 --2- 172.21.15.123:0/1580933889 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fccf8155950 0x7fccf8073600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:14:48.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.120+0000 7fccfdedf640 1 --2- 172.21.15.123:0/1580933889 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fccf80afb20 0x7fccf80affd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fccf0009d90 tx=0x7fccf002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9af9015cb7af6664 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.120+0000 7fcceffff640 1 -- 172.21.15.123:0/1580933889 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf0007740 con 0x7fccf80afb20 2024-09-15T23:14:48.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.120+0000 7fcceffff640 1 -- 172.21.15.123:0/1580933889 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccf00078e0 con 0x7fccf80afb20 2024-09-15T23:14:48.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.120+0000 7fcceffff640 1 -- 172.21.15.123:0/1580933889 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf0007c90 con 0x7fccf80afb20 2024-09-15T23:14:48.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.121+0000 7fccff942640 1 -- 172.21.15.123:0/1580933889 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fccf80afb20 msgr2=0x7fccf80affd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.121+0000 7fccff942640 1 --2- 172.21.15.123:0/1580933889 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fccf80afb20 0x7fccf80affd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fccf0009d90 tx=0x7fccf002a660 comp rx=0 tx=0).stop 2024-09-15T23:14:48.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.121+0000 7fccff942640 1 -- 172.21.15.123:0/1580933889 shutdown_connections 2024-09-15T23:14:48.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.121+0000 7fccff942640 1 --2- 172.21.15.123:0/1580933889 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fccf80afb20 0x7fccf80affd0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.121+0000 7fccff942640 1 --2- 172.21.15.123:0/1580933889 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fccf8155950 0x7fccf8073600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.121+0000 7fccff942640 1 -- 172.21.15.123:0/1580933889 >> 172.21.15.123:0/1580933889 conn(0x7fccf806db30 msgr2=0x7fccf806df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.121+0000 7fccff942640 1 -- 172.21.15.123:0/1580933889 shutdown_connections 2024-09-15T23:14:48.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.121+0000 7fccff942640 1 -- 172.21.15.123:0/1580933889 wait complete. 2024-09-15T23:14:48.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.122+0000 7fccff942640 1 Processor -- start 2024-09-15T23:14:48.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.122+0000 7fccff942640 1 -- start start 2024-09-15T23:14:48.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.123+0000 7fccff942640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fccf80afb20 0x7fccf80c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.123+0000 7fccff942640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fccf8162c80 0x7fccf80c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.123+0000 7fccff942640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fccf80c8960 0x7fccf81f4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.123+0000 7fccff942640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fccf8072060 con 0x7fccf80afb20 2024-09-15T23:14:48.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.123+0000 7fccff942640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fccf81630e0 con 0x7fccf8162c80 2024-09-15T23:14:48.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.123+0000 7fccff942640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fccf80721e0 con 0x7fccf80c8960 2024-09-15T23:14:48.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.123+0000 7fccfd6de640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fccf80afb20 0x7fccf80c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.123+0000 7fccfd6de640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fccf80afb20 0x7fccf80c5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47874/0 (socket says 172.21.15.123:47874) 2024-09-15T23:14:48.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.123+0000 7fccfd6de640 1 -- 172.21.15.123:0/880157745 learned_addr learned my addr 172.21.15.123:0/880157745 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:48.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.123+0000 7fccfcedd640 1 --2- 172.21.15.123:0/880157745 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fccf8162c80 0x7fccf80c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.123+0000 7fccfdedf640 1 --2- 172.21.15.123:0/880157745 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fccf80c8960 0x7fccf81f4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.123+0000 7fccfd6de640 1 -- 172.21.15.123:0/880157745 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fccf80c8960 msgr2=0x7fccf81f4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.123+0000 7fccfd6de640 1 --2- 172.21.15.123:0/880157745 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fccf80c8960 0x7fccf81f4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.123+0000 7fccfd6de640 1 -- 172.21.15.123:0/880157745 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fccf8162c80 msgr2=0x7fccf80c8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.123+0000 7fccfd6de640 1 --2- 172.21.15.123:0/880157745 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fccf8162c80 0x7fccf80c8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.123+0000 7fccfd6de640 1 -- 172.21.15.123:0/880157745 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf80c75c0 con 0x7fccf80afb20 2024-09-15T23:14:48.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.123+0000 7fccfd6de640 1 --2- 172.21.15.123:0/880157745 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fccf80afb20 0x7fccf80c5df0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fccf400ebe0 tx=0x7fccf400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.124+0000 7fccedffb640 1 -- 172.21.15.123:0/880157745 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf4017070 con 0x7fccf80afb20 2024-09-15T23:14:48.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.124+0000 7fccedffb640 1 -- 172.21.15.123:0/880157745 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccf400cc30 con 0x7fccf80afb20 2024-09-15T23:14:48.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.124+0000 7fccedffb640 1 -- 172.21.15.123:0/880157745 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf4013470 con 0x7fccf80afb20 2024-09-15T23:14:48.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.124+0000 7fccff942640 1 -- 172.21.15.123:0/880157745 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccf80c6520 con 0x7fccf80afb20 2024-09-15T23:14:48.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.124+0000 7fccff942640 1 -- 172.21.15.123:0/880157745 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccf80c6ae0 con 0x7fccf80afb20 2024-09-15T23:14:48.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.125+0000 7fccedffb640 1 -- 172.21.15.123:0/880157745 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fccf401a070 con 0x7fccf80afb20 2024-09-15T23:14:48.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.126+0000 7fccedffb640 1 --2- 172.21.15.123:0/880157745 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fccdc06c2b0 0x7fccdc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.126+0000 7fccedffb640 1 -- 172.21.15.123:0/880157745 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7fccf408b2e0 con 0x7fccf80afb20 2024-09-15T23:14:48.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.126+0000 7fccfcedd640 1 --2- 172.21.15.123:0/880157745 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fccdc06c2b0 0x7fccdc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.126+0000 7fccfcedd640 1 --2- 172.21.15.123:0/880157745 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fccdc06c2b0 0x7fccdc06e770 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fccf80cf6b0 tx=0x7fcce8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.127+0000 7fcd026d9740 1 Processor -- start 2024-09-15T23:14:48.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.127+0000 7fcd026d9740 1 -- start start 2024-09-15T23:14:48.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.127+0000 7fcd026d9740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55784961c6c0 0x55784961caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.127+0000 7fcd026d9740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578495d3cc0 0x5578495d0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.127+0000 7fcd026d9740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578495d7c60 0x557849619a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.127+0000 7fcd026d9740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x557849539af0 con 0x55784961c6c0 2024-09-15T23:14:48.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.127+0000 7fcd026d9740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5578494e1690 con 0x5578495d3cc0 2024-09-15T23:14:48.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.127+0000 7fcd026d9740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x557849535ab0 con 0x5578495d7c60 2024-09-15T23:14:48.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.127+0000 7fccfd6de640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55784961c6c0 0x55784961caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.127+0000 7fccfd6de640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55784961c6c0 0x55784961caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47880/0 (socket says 172.21.15.123:47880) 2024-09-15T23:14:48.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.127+0000 7fccfd6de640 1 -- 172.21.15.123:0/1040310069 learned_addr learned my addr 172.21.15.123:0/1040310069 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:48.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.128+0000 7fccfcedd640 1 --2- 172.21.15.123:0/1040310069 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578495d3cc0 0x5578495d0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.128+0000 7fccfdedf640 1 --2- 172.21.15.123:0/1040310069 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578495d7c60 0x557849619a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.128+0000 7fccfd6de640 1 -- 172.21.15.123:0/1040310069 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578495d7c60 msgr2=0x557849619a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.128+0000 7fccfd6de640 1 --2- 172.21.15.123:0/1040310069 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578495d7c60 0x557849619a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.128+0000 7fccfd6de640 1 -- 172.21.15.123:0/1040310069 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578495d3cc0 msgr2=0x5578495d0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.128+0000 7fccfd6de640 1 --2- 172.21.15.123:0/1040310069 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578495d3cc0 0x5578495d0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.128+0000 7fccfd6de640 1 -- 172.21.15.123:0/1040310069 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557849318b00 con 0x55784961c6c0 2024-09-15T23:14:48.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.128+0000 7fccfcedd640 1 --2- 172.21.15.123:0/1040310069 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578495d3cc0 0x5578495d0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:48.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.128+0000 7fccfdedf640 1 --2- 172.21.15.123:0/1040310069 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578495d7c60 0x557849619a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:48.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.128+0000 7fccfd6de640 1 --2- 172.21.15.123:0/1040310069 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55784961c6c0 0x55784961caa0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fccf4089830 tx=0x7fccf4059400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d6556511a8bee4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.128+0000 7fccdaffd640 1 -- 172.21.15.123:0/1040310069 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf4084070 con 0x55784961c6c0 2024-09-15T23:14:48.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.128+0000 7fccdaffd640 1 -- 172.21.15.123:0/1040310069 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccf4061f30 con 0x55784961c6c0 2024-09-15T23:14:48.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.128+0000 7fccdaffd640 1 -- 172.21.15.123:0/1040310069 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf4021040 con 0x55784961c6c0 2024-09-15T23:14:48.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.128+0000 7fcd026d9740 1 -- 172.21.15.123:0/1040310069 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55784961c6c0 msgr2=0x55784961caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.128+0000 7fcd026d9740 1 --2- 172.21.15.123:0/1040310069 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55784961c6c0 0x55784961caa0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fccf4089830 tx=0x7fccf4059400 comp rx=0 tx=0).stop 2024-09-15T23:14:48.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.129+0000 7fcd026d9740 1 -- 172.21.15.123:0/1040310069 shutdown_connections 2024-09-15T23:14:48.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.129+0000 7fcd026d9740 1 --2- 172.21.15.123:0/1040310069 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578495d7c60 0x557849619a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.129+0000 7fcd026d9740 1 --2- 172.21.15.123:0/1040310069 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578495d3cc0 0x5578495d0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.129+0000 7fcd026d9740 1 --2- 172.21.15.123:0/1040310069 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55784961c6c0 0x55784961caa0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.129+0000 7fcd026d9740 1 -- 172.21.15.123:0/1040310069 >> 172.21.15.123:0/1040310069 conn(0x55784959d890 msgr2=0x55784961b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.129+0000 7fcd026d9740 1 -- 172.21.15.123:0/1040310069 shutdown_connections 2024-09-15T23:14:48.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.129+0000 7fcd026d9740 1 -- 172.21.15.123:0/1040310069 wait complete. 2024-09-15T23:14:48.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.129+0000 7fcd026d9740 1 -- start start 2024-09-15T23:14:48.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.129+0000 7fcd026d9740 1 Processor -- start 2024-09-15T23:14:48.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.130+0000 7fcd026d9740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578495d3cc0 0x5578496153b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.130+0000 7fcd026d9740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578495d7c60 0x5578495fd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.130+0000 7fcd026d9740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55784961c6c0 0x557849619220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.130+0000 7fcd026d9740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5578494c28a0 con 0x5578495d7c60 2024-09-15T23:14:48.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.130+0000 7fcd026d9740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55784961d0a0 con 0x55784961c6c0 2024-09-15T23:14:48.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.130+0000 7fcd026d9740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55784962d230 con 0x5578495d3cc0 2024-09-15T23:14:48.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.130+0000 7fcd026d9740 10 client.0 _ll_register_callbacks cb 0x55784924bee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:48.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.130+0000 7fccfcedd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578495d7c60 0x5578495fd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.130+0000 7fccfcedd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578495d7c60 0x5578495fd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47884/0 (socket says 172.21.15.123:47884) 2024-09-15T23:14:48.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.130+0000 7fccfcedd640 1 -- 172.21.15.123:0/1261043324 learned_addr learned my addr 172.21.15.123:0/1261043324 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:48.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.130+0000 7fccfdedf640 1 --2- 172.21.15.123:0/1261043324 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55784961c6c0 0x557849619220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.130+0000 7fccfd6de640 1 --2- 172.21.15.123:0/1261043324 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578495d3cc0 0x5578496153b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.130+0000 7fccfcedd640 1 -- 172.21.15.123:0/1261043324 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578495d3cc0 msgr2=0x5578496153b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.130+0000 7fccfcedd640 1 --2- 172.21.15.123:0/1261043324 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578495d3cc0 0x5578496153b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.130+0000 7fccfcedd640 1 -- 172.21.15.123:0/1261043324 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55784961c6c0 msgr2=0x557849619220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.130+0000 7fccfcedd640 1 --2- 172.21.15.123:0/1261043324 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55784961c6c0 0x557849619220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.130+0000 7fccfcedd640 1 -- 172.21.15.123:0/1261043324 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55784920c3f0 con 0x5578495d7c60 2024-09-15T23:14:48.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.130+0000 7fccfd6de640 1 --2- 172.21.15.123:0/1261043324 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578495d3cc0 0x5578496153b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:48.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.130+0000 7fccfdedf640 1 --2- 172.21.15.123:0/1261043324 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55784961c6c0 0x557849619220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:48.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.131+0000 7fccfcedd640 1 --2- 172.21.15.123:0/1261043324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578495d7c60 0x5578495fd800 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fcce80156e0 tx=0x7fcce80010a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1811bfc80a452227 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.131+0000 7fccd3fff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:48.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.131+0000 7fccd3fff640 1 -- 172.21.15.123:0/1261043324 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce8013740 con 0x5578495d7c60 2024-09-15T23:14:48.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.131+0000 7fccd3fff640 1 -- 172.21.15.123:0/1261043324 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7fcce80138e0 con 0x5578495d7c60 2024-09-15T23:14:48.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.131+0000 7fcd026d9740 1 -- 172.21.15.123:0/1261043324 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccf4061f30 con 0x5578495d7c60 2024-09-15T23:14:48.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.131+0000 7fccd3fff640 1 -- 172.21.15.123:0/1261043324 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fcce802d050 con 0x5578495d7c60 2024-09-15T23:14:48.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.131+0000 7fcd026d9740 10 client.5493 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:48.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.131+0000 7fcd026d9740 1 -- 172.21.15.123:0/1261043324 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x557849379290 con 0x5578495d7c60 2024-09-15T23:14:48.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.131+0000 7fccd3fff640 1 -- 172.21.15.123:0/1261043324 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccf4061f30 con 0x5578495d7c60 2024-09-15T23:14:48.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.131+0000 7fccd3fff640 1 -- 172.21.15.123:0/1261043324 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7fcce8030020 con 0x5578495d7c60 2024-09-15T23:14:48.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.131+0000 7fcd026d9740 10 client.5493 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:48.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.131+0000 7fcd026d9740 10 client.5493 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:48.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.131+0000 7fcd026d9740 20 client.5493 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:48.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.131+0000 7fcd026d9740 1 --2- 172.21.15.123:0/1261043324 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55784962c2c0 0x55784962c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.131+0000 7fcd026d9740 4 client.5493 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:14:48.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.131+0000 7fcd026d9740 1 -- 172.21.15.123:0/1261043324 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557849547220 con 0x55784962c2c0 2024-09-15T23:14:48.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.131+0000 7fccfd6de640 1 --2- 172.21.15.123:0/1261043324 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55784962c2c0 0x55784962c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.132+0000 7fccd3fff640 10 client.5493 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:48.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.132+0000 7fccfd6de640 1 --2- 172.21.15.123:0/1261043324 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55784962c2c0 0x55784962c700 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a50f63629650d879 server_cookie=9537acda9f8e2b43 in_seq=0 out_seq=0 2024-09-15T23:14:48.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.132+0000 7fccd3fff640 1 -- 172.21.15.123:0/1261043324 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557849547220 con 0x55784962c2c0 2024-09-15T23:14:48.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.132+0000 7fccd3fff640 10 client.5493 handle_command_reply: tid=0 2024-09-15T23:14:48.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.132+0000 7fcd026d9740 1 client.5493 shutdown 2024-09-15T23:14:48.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.132+0000 7fcd026d9740 1 -- 172.21.15.123:0/1261043324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578495d7c60 msgr2=0x5578495fd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.132+0000 7fcd026d9740 1 --2- 172.21.15.123:0/1261043324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578495d7c60 0x5578495fd800 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fcce80156e0 tx=0x7fcce80010a0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.133+0000 7fcd026d9740 1 -- 172.21.15.123:0/1261043324 shutdown_connections 2024-09-15T23:14:48.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.133+0000 7fcd026d9740 1 --2- 172.21.15.123:0/1261043324 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55784962c2c0 0x55784962c700 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.133+0000 7fcd026d9740 1 --2- 172.21.15.123:0/1261043324 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55784961c6c0 0x557849619220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.133+0000 7fcd026d9740 1 --2- 172.21.15.123:0/1261043324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578495d7c60 0x5578495fd800 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.133+0000 7fccd3fff640 0 client.5493 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:48.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.133+0000 7fcd026d9740 1 --2- 172.21.15.123:0/1261043324 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578495d3cc0 0x5578496153b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.133+0000 7fcd026d9740 1 -- 172.21.15.123:0/1261043324 >> 172.21.15.123:0/1261043324 conn(0x55784959d890 msgr2=0x557849611c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.133+0000 7fcd026d9740 1 -- 172.21.15.123:0/1261043324 shutdown_connections 2024-09-15T23:14:48.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.133+0000 7fcd026d9740 1 -- 172.21.15.123:0/1261043324 wait complete. 2024-09-15T23:14:48.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.133+0000 7fcd026d9740 20 client.5493 trim_cache size 0 max 16384 2024-09-15T23:14:48.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.150+0000 7fcd026d9740 1 Processor -- start 2024-09-15T23:14:48.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.150+0000 7fcd026d9740 1 -- start start 2024-09-15T23:14:48.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.150+0000 7fcd026d9740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578495d3cc0 0x557849615040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.150+0000 7fcd026d9740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578495d7c60 0x55784962c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.150+0000 7fcd026d9740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55784961c6c0 0x55784962cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.150+0000 7fcd026d9740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x557849614ce0 con 0x55784961c6c0 2024-09-15T23:14:48.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.150+0000 7fcd026d9740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fccf8200b10 con 0x5578495d7c60 2024-09-15T23:14:48.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.150+0000 7fcd026d9740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fccf81ffb10 con 0x5578495d3cc0 2024-09-15T23:14:48.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.151+0000 7fccfdedf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55784961c6c0 0x55784962cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.151+0000 7fccfdedf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55784961c6c0 0x55784962cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47898/0 (socket says 172.21.15.123:47898) 2024-09-15T23:14:48.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.151+0000 7fccfdedf640 1 -- 172.21.15.123:0/2390859368 learned_addr learned my addr 172.21.15.123:0/2390859368 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:48.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.151+0000 7fccfd6de640 1 --2- 172.21.15.123:0/2390859368 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578495d3cc0 0x557849615040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.151+0000 7fccfcedd640 1 --2- 172.21.15.123:0/2390859368 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578495d7c60 0x55784962c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.151+0000 7fccfdedf640 1 -- 172.21.15.123:0/2390859368 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578495d3cc0 msgr2=0x557849615040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.151+0000 7fccfdedf640 1 --2- 172.21.15.123:0/2390859368 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578495d3cc0 0x557849615040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.151+0000 7fccfdedf640 1 -- 172.21.15.123:0/2390859368 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578495d7c60 msgr2=0x55784962c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.151+0000 7fccfdedf640 1 --2- 172.21.15.123:0/2390859368 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578495d7c60 0x55784962c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.151+0000 7fccfdedf640 1 -- 172.21.15.123:0/2390859368 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578491e54b0 con 0x55784961c6c0 2024-09-15T23:14:48.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.151+0000 7fccfdedf640 1 --2- 172.21.15.123:0/2390859368 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55784961c6c0 0x55784962cbe0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fccf002ac50 tx=0x7fccf002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=694b4e9cf900c4a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.151+0000 7fccda7fc640 1 -- 172.21.15.123:0/2390859368 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf004c070 con 0x55784961c6c0 2024-09-15T23:14:48.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.151+0000 7fccda7fc640 1 -- 172.21.15.123:0/2390859368 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccf0007700 con 0x55784961c6c0 2024-09-15T23:14:48.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.151+0000 7fccda7fc640 1 -- 172.21.15.123:0/2390859368 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf0007ad0 con 0x55784961c6c0 2024-09-15T23:14:48.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.152+0000 7fcd026d9740 1 -- 172.21.15.123:0/2390859368 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55784961c6c0 msgr2=0x55784962cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.152+0000 7fcd026d9740 1 --2- 172.21.15.123:0/2390859368 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55784961c6c0 0x55784962cbe0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fccf002ac50 tx=0x7fccf002e000 comp rx=0 tx=0).stop 2024-09-15T23:14:48.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.152+0000 7fcd026d9740 1 -- 172.21.15.123:0/2390859368 shutdown_connections 2024-09-15T23:14:48.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.152+0000 7fcd026d9740 1 --2- 172.21.15.123:0/2390859368 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55784961c6c0 0x55784962cbe0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.152+0000 7fcd026d9740 1 --2- 172.21.15.123:0/2390859368 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578495d7c60 0x55784962c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.152+0000 7fcd026d9740 1 --2- 172.21.15.123:0/2390859368 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578495d3cc0 0x557849615040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.152+0000 7fcd026d9740 1 -- 172.21.15.123:0/2390859368 >> 172.21.15.123:0/2390859368 conn(0x55784959d890 msgr2=0x5578495d0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.152+0000 7fcd026d9740 1 -- 172.21.15.123:0/2390859368 shutdown_connections 2024-09-15T23:14:48.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.152+0000 7fcd026d9740 1 -- 172.21.15.123:0/2390859368 wait complete. 2024-09-15T23:14:48.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.152+0000 7fcd026d9740 1 -- start start 2024-09-15T23:14:48.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.152+0000 7fcd026d9740 1 Processor -- start 2024-09-15T23:14:48.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.153+0000 7fcd026d9740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578495d3cc0 0x5578496a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.153+0000 7fcd026d9740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578495d7c60 0x55784961f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.153+0000 7fcd026d9740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55784961c6c0 0x5578495ea5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.153+0000 7fcd026d9740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fccf81ff4c0 con 0x5578495d3cc0 2024-09-15T23:14:48.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.153+0000 7fcd026d9740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fccf81feec0 con 0x5578495d7c60 2024-09-15T23:14:48.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.153+0000 7fcd026d9740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x557849600ce0 con 0x55784961c6c0 2024-09-15T23:14:48.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.153+0000 7fcd026d9740 10 client.0 _ll_register_callbacks cb 0x7fcce8001de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:48.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.153+0000 7fccfd6de640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578495d3cc0 0x5578496a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.153+0000 7fccfd6de640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578495d3cc0 0x5578496a1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47912/0 (socket says 172.21.15.123:47912) 2024-09-15T23:14:48.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.153+0000 7fccfd6de640 1 -- 172.21.15.123:0/1174719902 learned_addr learned my addr 172.21.15.123:0/1174719902 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:48.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.153+0000 7fccfdedf640 1 --2- 172.21.15.123:0/1174719902 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55784961c6c0 0x5578495ea5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.153+0000 7fccfcedd640 1 --2- 172.21.15.123:0/1174719902 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578495d7c60 0x55784961f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.154+0000 7fccfd6de640 1 -- 172.21.15.123:0/1174719902 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55784961c6c0 msgr2=0x5578495ea5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.154+0000 7fccfd6de640 1 --2- 172.21.15.123:0/1174719902 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55784961c6c0 0x5578495ea5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.154+0000 7fccfd6de640 1 -- 172.21.15.123:0/1174719902 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578495d7c60 msgr2=0x55784961f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.154+0000 7fccfd6de640 1 --2- 172.21.15.123:0/1174719902 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578495d7c60 0x55784961f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.154+0000 7fccfd6de640 1 -- 172.21.15.123:0/1174719902 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557849634f40 con 0x5578495d3cc0 2024-09-15T23:14:48.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.154+0000 7fccfd6de640 1 --2- 172.21.15.123:0/1174719902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578495d3cc0 0x5578496a1e50 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fccf4059390 tx=0x7fccf4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9816b60995edafd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.154+0000 7fccd3fff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:48.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.154+0000 7fccd3fff640 1 -- 172.21.15.123:0/1174719902 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccf4084070 con 0x5578495d3cc0 2024-09-15T23:14:48.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.154+0000 7fccd3fff640 1 -- 172.21.15.123:0/1174719902 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7fccf4071120 con 0x5578495d3cc0 2024-09-15T23:14:48.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.154+0000 7fcd026d9740 1 -- 172.21.15.123:0/1174719902 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccf0007700 con 0x5578495d3cc0 2024-09-15T23:14:48.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.154+0000 7fccd3fff640 1 -- 172.21.15.123:0/1174719902 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fccf4021040 con 0x5578495d3cc0 2024-09-15T23:14:48.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.154+0000 7fcd026d9740 10 client.5499 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:48.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.154+0000 7fcd026d9740 1 -- 172.21.15.123:0/1174719902 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x5578496a30c0 con 0x5578495d3cc0 2024-09-15T23:14:48.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.154+0000 7fccd3fff640 1 -- 172.21.15.123:0/1174719902 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccf0007700 con 0x5578495d3cc0 2024-09-15T23:14:48.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.154+0000 7fccd3fff640 1 -- 172.21.15.123:0/1174719902 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7fccf4024060 con 0x5578495d3cc0 2024-09-15T23:14:48.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.154+0000 7fcd026d9740 10 client.5499 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:48.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.154+0000 7fcd026d9740 10 client.5499 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:48.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.154+0000 7fcd026d9740 20 client.5499 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:48.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.154+0000 7fcd026d9740 1 --2- 172.21.15.123:0/1174719902 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5578495cfc40 0x55784963da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.154+0000 7fcd026d9740 4 client.5499 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-09-15T23:14:48.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.154+0000 7fcd026d9740 1 -- 172.21.15.123:0/1174719902 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}) -- 0x557849541570 con 0x5578495cfc40 2024-09-15T23:14:48.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.154+0000 7fccfcedd640 1 --2- 172.21.15.123:0/1174719902 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5578495cfc40 0x55784963da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.155+0000 7fccd3fff640 10 client.5499 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:48.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.155+0000 7fccfcedd640 1 --2- 172.21.15.123:0/1174719902 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5578495cfc40 0x55784963da60 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd26bd89c033db3a server_cookie=27c890ed2223d79d in_seq=0 out_seq=0 2024-09-15T23:14:48.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.155+0000 7fccd3fff640 1 -- 172.21.15.123:0/1174719902 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557849541570 con 0x5578495cfc40 2024-09-15T23:14:48.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.155+0000 7fccd3fff640 10 client.5499 handle_command_reply: tid=0 2024-09-15T23:14:48.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.155+0000 7fcd026d9740 1 client.5499 shutdown 2024-09-15T23:14:48.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.155+0000 7fcd026d9740 1 -- 172.21.15.123:0/1174719902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578495d3cc0 msgr2=0x5578496a1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.155+0000 7fcd026d9740 1 --2- 172.21.15.123:0/1174719902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578495d3cc0 0x5578496a1e50 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fccf4059390 tx=0x7fccf4000bc0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.155+0000 7fcd026d9740 1 -- 172.21.15.123:0/1174719902 shutdown_connections 2024-09-15T23:14:48.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.155+0000 7fcd026d9740 1 --2- 172.21.15.123:0/1174719902 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5578495cfc40 0x55784963da60 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.155+0000 7fccd3fff640 0 client.5499 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:48.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.155+0000 7fcd026d9740 1 --2- 172.21.15.123:0/1174719902 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55784961c6c0 0x5578495ea5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.155+0000 7fcd026d9740 1 --2- 172.21.15.123:0/1174719902 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578495d7c60 0x55784961f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.155+0000 7fcd026d9740 1 --2- 172.21.15.123:0/1174719902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578495d3cc0 0x5578496a1e50 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.155+0000 7fcd026d9740 1 -- 172.21.15.123:0/1174719902 >> 172.21.15.123:0/1174719902 conn(0x55784959d890 msgr2=0x5578495f4950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.156+0000 7fcd026d9740 1 -- 172.21.15.123:0/1174719902 shutdown_connections 2024-09-15T23:14:48.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.156+0000 7fcd026d9740 1 -- 172.21.15.123:0/1174719902 wait complete. 2024-09-15T23:14:48.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.156+0000 7fcd026d9740 20 client.5499 trim_cache size 0 max 16384 2024-09-15T23:14:48.163 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:14:48.163 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0, 2024-09-15T23:14:48.163 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_tag": "f58c79e4-e12e-4853-b4c2-724aaf850b3b", 2024-09-15T23:14:48.163 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": "asynchronous" 2024-09-15T23:14:48.163 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:14:48.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.156+0000 7fccff942640 1 -- 172.21.15.123:0/880157745 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fccdc06c2b0 msgr2=0x7fccdc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.156+0000 7fccff942640 1 --2- 172.21.15.123:0/880157745 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fccdc06c2b0 0x7fccdc06e770 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fccf80cf6b0 tx=0x7fcce8009040 comp rx=0 tx=0).stop 2024-09-15T23:14:48.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.156+0000 7fccff942640 1 -- 172.21.15.123:0/880157745 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fccf80afb20 msgr2=0x7fccf80c5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.156+0000 7fccff942640 1 --2- 172.21.15.123:0/880157745 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fccf80afb20 0x7fccf80c5df0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fccf400ebe0 tx=0x7fccf400c520 comp rx=0 tx=0).stop 2024-09-15T23:14:48.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.156+0000 7fccff942640 1 -- 172.21.15.123:0/880157745 shutdown_connections 2024-09-15T23:14:48.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.156+0000 7fccff942640 1 --2- 172.21.15.123:0/880157745 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fccf80c8960 0x7fccf81f4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.156+0000 7fccff942640 1 --2- 172.21.15.123:0/880157745 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fccf8162c80 0x7fccf80c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.156+0000 7fccff942640 1 --2- 172.21.15.123:0/880157745 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fccdc06c2b0 0x7fccdc06e770 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.156+0000 7fccff942640 1 --2- 172.21.15.123:0/880157745 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fccf80afb20 0x7fccf80c5df0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.156+0000 7fccff942640 1 -- 172.21.15.123:0/880157745 >> 172.21.15.123:0/880157745 conn(0x7fccf806db30 msgr2=0x7fccf80b5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.156+0000 7fccff942640 1 -- 172.21.15.123:0/880157745 shutdown_connections 2024-09-15T23:14:48.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.156+0000 7fccff942640 1 -- 172.21.15.123:0/880157745 wait complete. 2024-09-15T23:14:48.168 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites' returned '{'return_code': 0, 'scrub_tag': 'f58c79e4-e12e-4853-b4c2-724aaf850b3b', 'mode': 'asynchronous'}' 2024-09-15T23:14:48.168 INFO:tasks.cephfs.test_scrub_checks:First run: flushing /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-09-15T23:14:48.168 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-09-15T23:14:48.168 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-09-15T23:14:48.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.266+0000 7f6f8400a640 1 Processor -- start 2024-09-15T23:14:48.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.267+0000 7f6f8400a640 1 -- start start 2024-09-15T23:14:48.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.267+0000 7f6f8400a640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f6f7c15b7c0 0x7f6f7c0b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.267+0000 7f6f8400a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f7c0cead0 0x7f6f7c071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.267+0000 7f6f8400a640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f7c0cf2e0 con 0x7f6f7c0ccf30 2024-09-15T23:14:48.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.267+0000 7f6f8400a640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f6f7c070fe0 con 0x7f6f7c15b7c0 2024-09-15T23:14:48.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.267+0000 7f6f8400a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6f7c0712c0 con 0x7f6f7c0cead0 2024-09-15T23:14:48.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.267+0000 7f6f81da6640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6f7c0ccf30 0x7f6f7c0cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41098/0 (socket says 172.21.15.123:41098) 2024-09-15T23:14:48.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.267+0000 7f6f81da6640 1 -- 172.21.15.123:0/4215013530 learned_addr learned my addr 172.21.15.123:0/4215013530 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:48.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.268+0000 7f6f80da4640 1 -- 172.21.15.123:0/4215013530 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3668213722 0 0) 0x7f6f7c0cf2e0 con 0x7f6f7c0ccf30 2024-09-15T23:14:48.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.268+0000 7f6f825a7640 1 --2- 172.21.15.123:0/4215013530 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f7c0cead0 0x7f6f7c071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.268+0000 7f6f815a5640 1 --2- 172.21.15.123:0/4215013530 >> v2:172.21.15.188:3300/0 conn(0x7f6f7c15b7c0 0x7f6f7c0b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.268+0000 7f6f80da4640 1 -- 172.21.15.123:0/4215013530 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f68003520 con 0x7f6f7c0ccf30 2024-09-15T23:14:48.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.268+0000 7f6f80da4640 1 -- 172.21.15.123:0/4215013530 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2282812017 0 0) 0x7f6f68003520 con 0x7f6f7c0ccf30 2024-09-15T23:14:48.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.268+0000 7f6f80da4640 1 -- 172.21.15.123:0/4215013530 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f7c0cead0 msgr2=0x7f6f7c071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.268+0000 7f6f80da4640 1 --2- 172.21.15.123:0/4215013530 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f7c0cead0 0x7f6f7c071ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.268+0000 7f6f80da4640 1 -- 172.21.15.123:0/4215013530 >> v2:172.21.15.188:3300/0 conn(0x7f6f7c15b7c0 msgr2=0x7f6f7c0b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.268+0000 7f6f80da4640 1 --2- 172.21.15.123:0/4215013530 >> v2:172.21.15.188:3300/0 conn(0x7f6f7c15b7c0 0x7f6f7c0b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.268+0000 7f6f80da4640 1 -- 172.21.15.123:0/4215013530 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f7c0715a0 con 0x7f6f7c0ccf30 2024-09-15T23:14:48.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.268+0000 7f6f80da4640 1 -- 172.21.15.123:0/4215013530 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f6f70001670 con 0x7f6f7c0ccf30 2024-09-15T23:14:48.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.268+0000 7f6f80da4640 1 -- 172.21.15.123:0/4215013530 >> v1:172.21.15.123:6789/0 conn(0x7f6f7c0ccf30 legacy=0x7f6f7c0cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.268+0000 7f6f80da4640 1 --2- 172.21.15.123:0/4215013530 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6f680039b0 0x7f6f68003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.268+0000 7f6f80da4640 1 --2- 172.21.15.123:0/4215013530 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f7c0cead0 0x7f6f68004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.268+0000 7f6f80da4640 1 --2- 172.21.15.123:0/4215013530 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f68004d40 0x7f6f680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.268+0000 7f6f80da4640 1 -- 172.21.15.123:0/4215013530 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6f7c070fe0 con 0x7f6f68004d40 2024-09-15T23:14:48.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.268+0000 7f6f80da4640 1 -- 172.21.15.123:0/4215013530 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6f7c0712c0 con 0x7f6f680039b0 2024-09-15T23:14:48.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.268+0000 7f6f80da4640 1 -- 172.21.15.123:0/4215013530 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6f6800b9c0 con 0x7f6f7c0cead0 2024-09-15T23:14:48.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.268+0000 7f6f825a7640 1 --2- 172.21.15.123:0/4215013530 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f68004d40 0x7f6f680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.268+0000 7f6f81da6640 1 --2- 172.21.15.123:0/4215013530 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6f680039b0 0x7f6f68003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.268+0000 7f6f815a5640 1 --2- 172.21.15.123:0/4215013530 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f7c0cead0 0x7f6f68004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.269+0000 7f6f825a7640 1 -- 172.21.15.123:0/4215013530 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f7c0cead0 msgr2=0x7f6f68004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.269+0000 7f6f825a7640 1 --2- 172.21.15.123:0/4215013530 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f7c0cead0 0x7f6f68004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.269+0000 7f6f825a7640 1 -- 172.21.15.123:0/4215013530 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6f680039b0 msgr2=0x7f6f68003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.269+0000 7f6f825a7640 1 --2- 172.21.15.123:0/4215013530 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6f680039b0 0x7f6f68003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.269+0000 7f6f825a7640 1 -- 172.21.15.123:0/4215013530 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f68003520 con 0x7f6f68004d40 2024-09-15T23:14:48.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.269+0000 7f6f825a7640 1 --2- 172.21.15.123:0/4215013530 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f68004d40 0x7f6f680051c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6f74009fc0 tx=0x7f6f68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=180caef2f1314590 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.269+0000 7f6f80da4640 1 -- 172.21.15.123:0/4215013530 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f74009c10 con 0x7f6f68004d40 2024-09-15T23:14:48.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.269+0000 7f6f80da4640 1 -- 172.21.15.123:0/4215013530 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f74036070 con 0x7f6f68004d40 2024-09-15T23:14:48.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.269+0000 7f6f80da4640 1 -- 172.21.15.123:0/4215013530 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f74031880 con 0x7f6f68004d40 2024-09-15T23:14:48.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.270+0000 7f6f8400a640 1 -- 172.21.15.123:0/4215013530 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f68004d40 msgr2=0x7f6f680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.270+0000 7f6f8400a640 1 --2- 172.21.15.123:0/4215013530 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f68004d40 0x7f6f680051c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6f74009fc0 tx=0x7f6f68005830 comp rx=0 tx=0).stop 2024-09-15T23:14:48.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.270+0000 7f6f825a7640 1 -- 172.21.15.123:0/4215013530 reap_dead start 2024-09-15T23:14:48.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.270+0000 7f6f8400a640 1 -- 172.21.15.123:0/4215013530 shutdown_connections 2024-09-15T23:14:48.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.270+0000 7f6f8400a640 1 -- 172.21.15.123:0/4215013530 >> 172.21.15.123:0/4215013530 conn(0x7f6f7c06d0f0 msgr2=0x7f6f7c06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.270+0000 7f6f8400a640 1 -- 172.21.15.123:0/4215013530 shutdown_connections 2024-09-15T23:14:48.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.270+0000 7f6f8400a640 1 -- 172.21.15.123:0/4215013530 wait complete. 2024-09-15T23:14:48.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.271+0000 7f6f8400a640 1 Processor -- start 2024-09-15T23:14:48.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.271+0000 7f6f8400a640 1 -- start start 2024-09-15T23:14:48.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.272+0000 7f6f8400a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f7c1459a0 0x7f6f7c143b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.272+0000 7f6f8400a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f7c072590 0x7f6f7c0729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.272+0000 7f6f8400a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6f7c15a530 0x7f6f7c15a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.272+0000 7f6f8400a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6f7c0cf0c0 con 0x7f6f7c1459a0 2024-09-15T23:14:48.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.272+0000 7f6f8400a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6f7c0cef40 con 0x7f6f7c15a530 2024-09-15T23:14:48.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.272+0000 7f6f8400a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6f7c06bc10 con 0x7f6f7c072590 2024-09-15T23:14:48.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.272+0000 7f6f81da6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f7c1459a0 0x7f6f7c143b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.272+0000 7f6f81da6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f7c1459a0 0x7f6f7c143b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47928/0 (socket says 172.21.15.123:47928) 2024-09-15T23:14:48.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.272+0000 7f6f81da6640 1 -- 172.21.15.123:0/793823916 learned_addr learned my addr 172.21.15.123:0/793823916 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:48.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.272+0000 7f6f815a5640 1 --2- 172.21.15.123:0/793823916 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f7c072590 0x7f6f7c0729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.272+0000 7f6f81da6640 1 -- 172.21.15.123:0/793823916 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f7c072590 msgr2=0x7f6f7c0729f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.272+0000 7f6f81da6640 1 --2- 172.21.15.123:0/793823916 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f7c072590 0x7f6f7c0729f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.272+0000 7f6f81da6640 1 -- 172.21.15.123:0/793823916 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6f7c15a530 msgr2=0x7f6f7c15a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.272+0000 7f6f81da6640 1 --2- 172.21.15.123:0/793823916 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6f7c15a530 0x7f6f7c15a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.272+0000 7f6f81da6640 1 -- 172.21.15.123:0/793823916 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f7c15bc40 con 0x7f6f7c1459a0 2024-09-15T23:14:48.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.273+0000 7f6f81da6640 1 --2- 172.21.15.123:0/793823916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f7c1459a0 0x7f6f7c143b20 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6f70007290 tx=0x7f6f70007690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.273+0000 7f6f6e7fc640 1 -- 172.21.15.123:0/793823916 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7000f8e0 con 0x7f6f7c1459a0 2024-09-15T23:14:48.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.273+0000 7f6f6e7fc640 1 -- 172.21.15.123:0/793823916 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f70018070 con 0x7f6f7c1459a0 2024-09-15T23:14:48.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.273+0000 7f6f8400a640 1 -- 172.21.15.123:0/793823916 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f7c15bf20 con 0x7f6f7c1459a0 2024-09-15T23:14:48.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.273+0000 7f6f6e7fc640 1 -- 172.21.15.123:0/793823916 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7000fd00 con 0x7f6f7c1459a0 2024-09-15T23:14:48.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.273+0000 7f6f8400a640 1 -- 172.21.15.123:0/793823916 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f7c15c4e0 con 0x7f6f7c1459a0 2024-09-15T23:14:48.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.274+0000 7f6f6e7fc640 1 -- 172.21.15.123:0/793823916 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6f7001d460 con 0x7f6f7c1459a0 2024-09-15T23:14:48.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.275+0000 7f6f6e7fc640 1 --2- 172.21.15.123:0/793823916 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6f6006c1f0 0x7f6f6006e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.275+0000 7f6f6e7fc640 1 -- 172.21.15.123:0/793823916 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7f6f7008b5e0 con 0x7f6f7c1459a0 2024-09-15T23:14:48.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.275+0000 7f6f815a5640 1 --2- 172.21.15.123:0/793823916 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6f6006c1f0 0x7f6f6006e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.276+0000 7f6f815a5640 1 --2- 172.21.15.123:0/793823916 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6f6006c1f0 0x7f6f6006e6b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c1593e0 tx=0x7f6f78009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.276+0000 7f6f86e77740 1 Processor -- start 2024-09-15T23:14:48.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.276+0000 7f6f86e77740 1 -- start start 2024-09-15T23:14:48.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.277+0000 7f6f86e77740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c21c702f0 0x557c21c706d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.277+0000 7f6f86e77740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557c21cb5b20 0x557c21c99f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.277+0000 7f6f86e77740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c21c979f0 0x557c21c9a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.277+0000 7f6f86e77740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x557c21bd2870 con 0x557c21c979f0 2024-09-15T23:14:48.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.277+0000 7f6f86e77740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x557c21b7a810 con 0x557c21c702f0 2024-09-15T23:14:48.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.277+0000 7f6f86e77740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x557c21bce830 con 0x557c21cb5b20 2024-09-15T23:14:48.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.277+0000 7f6f825a7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c21c979f0 0x557c21c9a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.277+0000 7f6f815a5640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557c21cb5b20 0x557c21c99f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.277+0000 7f6f815a5640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557c21cb5b20 0x557c21c99f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:44632/0 (socket says 172.21.15.123:44632) 2024-09-15T23:14:48.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.277+0000 7f6f815a5640 1 -- 172.21.15.123:0/2455355218 learned_addr learned my addr 172.21.15.123:0/2455355218 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:48.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.277+0000 7f6f825a7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c21c979f0 0x557c21c9a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47934/0 (socket says 172.21.15.123:47934) 2024-09-15T23:14:48.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.277+0000 7f6f81da6640 1 --2- 172.21.15.123:0/2455355218 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c21c702f0 0x557c21c706d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.277+0000 7f6f815a5640 1 -- 172.21.15.123:0/2455355218 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c21c702f0 msgr2=0x557c21c706d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.277+0000 7f6f815a5640 1 --2- 172.21.15.123:0/2455355218 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c21c702f0 0x557c21c706d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.277+0000 7f6f815a5640 1 -- 172.21.15.123:0/2455355218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c21c979f0 msgr2=0x557c21c9a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.277+0000 7f6f815a5640 1 --2- 172.21.15.123:0/2455355218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c21c979f0 0x557c21c9a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.277+0000 7f6f815a5640 1 -- 172.21.15.123:0/2455355218 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c21b99830 con 0x557c21cb5b20 2024-09-15T23:14:48.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.277+0000 7f6f825a7640 1 --2- 172.21.15.123:0/2455355218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c21c979f0 0x557c21c9a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:14:48.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.277+0000 7f6f815a5640 1 --2- 172.21.15.123:0/2455355218 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557c21cb5b20 0x557c21c99f40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6f78004090 tx=0x7f6f78017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a7f64a759552bc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.279+0000 7f6f5f7fe640 1 -- 172.21.15.123:0/2455355218 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7801b070 con 0x557c21cb5b20 2024-09-15T23:14:48.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.279+0000 7f6f5f7fe640 1 -- 172.21.15.123:0/2455355218 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f78003da0 con 0x557c21cb5b20 2024-09-15T23:14:48.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.279+0000 7f6f5f7fe640 1 -- 172.21.15.123:0/2455355218 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f78022670 con 0x557c21cb5b20 2024-09-15T23:14:48.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.279+0000 7f6f86e77740 1 -- 172.21.15.123:0/2455355218 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557c21cb5b20 msgr2=0x557c21c99f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.279+0000 7f6f86e77740 1 --2- 172.21.15.123:0/2455355218 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557c21cb5b20 0x557c21c99f40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6f78004090 tx=0x7f6f78017000 comp rx=0 tx=0).stop 2024-09-15T23:14:48.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.280+0000 7f6f86e77740 1 -- 172.21.15.123:0/2455355218 shutdown_connections 2024-09-15T23:14:48.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.280+0000 7f6f86e77740 1 --2- 172.21.15.123:0/2455355218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c21c979f0 0x557c21c9a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.280+0000 7f6f86e77740 1 --2- 172.21.15.123:0/2455355218 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557c21cb5b20 0x557c21c99f40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.280+0000 7f6f86e77740 1 --2- 172.21.15.123:0/2455355218 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c21c702f0 0x557c21c706d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.280+0000 7f6f86e77740 1 -- 172.21.15.123:0/2455355218 >> 172.21.15.123:0/2455355218 conn(0x557c21c6c680 msgr2=0x557c21cb4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.280+0000 7f6f86e77740 1 -- 172.21.15.123:0/2455355218 shutdown_connections 2024-09-15T23:14:48.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.280+0000 7f6f86e77740 1 -- 172.21.15.123:0/2455355218 wait complete. 2024-09-15T23:14:48.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.280+0000 7f6f86e77740 1 -- start start 2024-09-15T23:14:48.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.280+0000 7f6f86e77740 1 Processor -- start 2024-09-15T23:14:48.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.281+0000 7f6f86e77740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c21c979f0 0x557c21caeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.281+0000 7f6f86e77740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557c21c9da60 0x557c21cccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.281+0000 7f6f86e77740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c21c9de40 0x557c21ccd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.281+0000 7f6f86e77740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x557c21c71370 con 0x557c21c9de40 2024-09-15T23:14:48.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.281+0000 7f6f86e77740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x557c21b5b9a0 con 0x557c21c979f0 2024-09-15T23:14:48.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.281+0000 7f6f86e77740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x557c21c71610 con 0x557c21c9da60 2024-09-15T23:14:48.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.281+0000 7f6f86e77740 10 client.0 _ll_register_callbacks cb 0x557c218e52b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:48.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.281+0000 7f6f825a7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c21c9de40 0x557c21ccd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.281+0000 7f6f825a7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c21c9de40 0x557c21ccd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47944/0 (socket says 172.21.15.123:47944) 2024-09-15T23:14:48.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.281+0000 7f6f825a7640 1 -- 172.21.15.123:0/142837987 learned_addr learned my addr 172.21.15.123:0/142837987 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:48.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.281+0000 7f6f815a5640 1 --2- 172.21.15.123:0/142837987 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557c21c9da60 0x557c21cccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.281+0000 7f6f81da6640 1 --2- 172.21.15.123:0/142837987 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c21c979f0 0x557c21caeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.281+0000 7f6f825a7640 1 -- 172.21.15.123:0/142837987 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557c21c9da60 msgr2=0x557c21cccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.281+0000 7f6f825a7640 1 --2- 172.21.15.123:0/142837987 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557c21c9da60 0x557c21cccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.281+0000 7f6f825a7640 1 -- 172.21.15.123:0/142837987 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c21c979f0 msgr2=0x557c21caeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.281+0000 7f6f825a7640 1 --2- 172.21.15.123:0/142837987 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c21c979f0 0x557c21caeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.282+0000 7f6f825a7640 1 -- 172.21.15.123:0/142837987 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c218c9ac0 con 0x557c21c9de40 2024-09-15T23:14:48.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.282+0000 7f6f825a7640 1 --2- 172.21.15.123:0/142837987 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c21c9de40 0x557c21ccd150 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400e200 tx=0x7f6f74009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae49bee21e0eea server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.282+0000 7f6f5cff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:48.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.282+0000 7f6f5cff9640 1 -- 172.21.15.123:0/142837987 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f74003990 con 0x557c21c9de40 2024-09-15T23:14:48.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.282+0000 7f6f5cff9640 1 -- 172.21.15.123:0/142837987 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7f6f74003b30 con 0x557c21c9de40 2024-09-15T23:14:48.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.282+0000 7f6f86e77740 1 -- 172.21.15.123:0/142837987 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f78003da0 con 0x557c21c9de40 2024-09-15T23:14:48.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.282+0000 7f6f5cff9640 1 -- 172.21.15.123:0/142837987 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6f7404c050 con 0x557c21c9de40 2024-09-15T23:14:48.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.282+0000 7f6f86e77740 10 client.5511 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:48.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.282+0000 7f6f86e77740 1 -- 172.21.15.123:0/142837987 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x557c218e5ac0 con 0x557c21c9de40 2024-09-15T23:14:48.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.282+0000 7f6f5cff9640 1 -- 172.21.15.123:0/142837987 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f78003da0 con 0x557c21c9de40 2024-09-15T23:14:48.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.282+0000 7f6f5cff9640 1 -- 172.21.15.123:0/142837987 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f6f7404f020 con 0x557c21c9de40 2024-09-15T23:14:48.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.282+0000 7f6f86e77740 10 client.5511 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:48.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.282+0000 7f6f86e77740 10 client.5511 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:48.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.282+0000 7f6f86e77740 20 client.5511 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:48.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.282+0000 7f6f86e77740 1 --2- 172.21.15.123:0/142837987 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x557c21cac960 0x557c21cacd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.282+0000 7f6f86e77740 4 client.5511 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:14:48.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.282+0000 7f6f86e77740 1 -- 172.21.15.123:0/142837987 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c21bdffa0 con 0x557c21cac960 2024-09-15T23:14:48.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.282+0000 7f6f81da6640 1 --2- 172.21.15.123:0/142837987 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x557c21cac960 0x557c21cacd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.283+0000 7f6f5cff9640 10 client.5511 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:48.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.283+0000 7f6f81da6640 1 --2- 172.21.15.123:0/142837987 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x557c21cac960 0x557c21cacd40 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2900affab440bb44 server_cookie=f29444e17e1f18a5 in_seq=0 out_seq=0 2024-09-15T23:14:48.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.283+0000 7f6f5cff9640 1 -- 172.21.15.123:0/142837987 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557c21bdffa0 con 0x557c21cac960 2024-09-15T23:14:48.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.283+0000 7f6f5cff9640 10 client.5511 handle_command_reply: tid=0 2024-09-15T23:14:48.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.283+0000 7f6f86e77740 1 client.5511 shutdown 2024-09-15T23:14:48.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.284+0000 7f6f86e77740 1 -- 172.21.15.123:0/142837987 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c21c9de40 msgr2=0x557c21ccd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.284+0000 7f6f86e77740 1 --2- 172.21.15.123:0/142837987 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c21c9de40 0x557c21ccd150 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400e200 tx=0x7f6f74009750 comp rx=0 tx=0).stop 2024-09-15T23:14:48.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.284+0000 7f6f86e77740 1 -- 172.21.15.123:0/142837987 shutdown_connections 2024-09-15T23:14:48.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.284+0000 7f6f86e77740 1 --2- 172.21.15.123:0/142837987 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x557c21cac960 0x557c21cacd40 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.284+0000 7f6f86e77740 1 --2- 172.21.15.123:0/142837987 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c21c9de40 0x557c21ccd150 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.284+0000 7f6f86e77740 1 --2- 172.21.15.123:0/142837987 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557c21c9da60 0x557c21cccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.284+0000 7f6f86e77740 1 --2- 172.21.15.123:0/142837987 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c21c979f0 0x557c21caeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.284+0000 7f6f86e77740 1 -- 172.21.15.123:0/142837987 >> 172.21.15.123:0/142837987 conn(0x557c21c702f0 msgr2=0x557c21c6b840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.284+0000 7f6f5cff9640 0 client.5511 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:48.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.284+0000 7f6f86e77740 1 -- 172.21.15.123:0/142837987 shutdown_connections 2024-09-15T23:14:48.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.284+0000 7f6f86e77740 1 -- 172.21.15.123:0/142837987 wait complete. 2024-09-15T23:14:48.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.284+0000 7f6f86e77740 20 client.5511 trim_cache size 0 max 16384 2024-09-15T23:14:48.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.298+0000 7f6f86e77740 1 Processor -- start 2024-09-15T23:14:48.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.298+0000 7f6f86e77740 1 -- start start 2024-09-15T23:14:48.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.299+0000 7f6f86e77740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c21c979f0 0x557c21cb84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.299+0000 7f6f86e77740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557c21c9da60 0x557c21c6a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.299+0000 7f6f86e77740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c21c9de40 0x557c21c6a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.299+0000 7f6f86e77740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6f7c1fd290 con 0x557c21c9de40 2024-09-15T23:14:48.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.299+0000 7f6f86e77740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6f7c1fc2e0 con 0x557c21c979f0 2024-09-15T23:14:48.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.299+0000 7f6f86e77740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6f7c15dab0 con 0x557c21c9da60 2024-09-15T23:14:48.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.299+0000 7f6f825a7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c21c9de40 0x557c21c6a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.299+0000 7f6f825a7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c21c9de40 0x557c21c6a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47952/0 (socket says 172.21.15.123:47952) 2024-09-15T23:14:48.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.299+0000 7f6f825a7640 1 -- 172.21.15.123:0/785884058 learned_addr learned my addr 172.21.15.123:0/785884058 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:48.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.299+0000 7f6f815a5640 1 --2- 172.21.15.123:0/785884058 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557c21c9da60 0x557c21c6a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.299+0000 7f6f81da6640 1 --2- 172.21.15.123:0/785884058 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c21c979f0 0x557c21cb84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.299+0000 7f6f825a7640 1 -- 172.21.15.123:0/785884058 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557c21c9da60 msgr2=0x557c21c6a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.299+0000 7f6f825a7640 1 --2- 172.21.15.123:0/785884058 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557c21c9da60 0x557c21c6a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.299+0000 7f6f825a7640 1 -- 172.21.15.123:0/785884058 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c21c979f0 msgr2=0x557c21cb84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.299+0000 7f6f825a7640 1 --2- 172.21.15.123:0/785884058 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c21c979f0 0x557c21cb84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.299+0000 7f6f825a7640 1 -- 172.21.15.123:0/785884058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c21c70a40 con 0x557c21c9de40 2024-09-15T23:14:48.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.300+0000 7f6f825a7640 1 --2- 172.21.15.123:0/785884058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c21c9de40 0x557c21c6a630 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6f74031860 tx=0x7f6f7403d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd633e4707cb5b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.300+0000 7f6f5effd640 1 -- 172.21.15.123:0/785884058 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f74003ad0 con 0x557c21c9de40 2024-09-15T23:14:48.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.300+0000 7f6f5effd640 1 -- 172.21.15.123:0/785884058 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f74036070 con 0x557c21c9de40 2024-09-15T23:14:48.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.300+0000 7f6f5effd640 1 -- 172.21.15.123:0/785884058 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f74031bd0 con 0x557c21c9de40 2024-09-15T23:14:48.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.300+0000 7f6f86e77740 1 -- 172.21.15.123:0/785884058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c21c9de40 msgr2=0x557c21c6a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.300+0000 7f6f86e77740 1 --2- 172.21.15.123:0/785884058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c21c9de40 0x557c21c6a630 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6f74031860 tx=0x7f6f7403d000 comp rx=0 tx=0).stop 2024-09-15T23:14:48.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.300+0000 7f6f86e77740 1 -- 172.21.15.123:0/785884058 shutdown_connections 2024-09-15T23:14:48.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.300+0000 7f6f86e77740 1 --2- 172.21.15.123:0/785884058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c21c9de40 0x557c21c6a630 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.300+0000 7f6f86e77740 1 --2- 172.21.15.123:0/785884058 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557c21c9da60 0x557c21c6a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.300+0000 7f6f86e77740 1 --2- 172.21.15.123:0/785884058 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c21c979f0 0x557c21cb84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.300+0000 7f6f86e77740 1 -- 172.21.15.123:0/785884058 >> 172.21.15.123:0/785884058 conn(0x557c21c702f0 msgr2=0x557c21c980d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.300+0000 7f6f86e77740 1 -- 172.21.15.123:0/785884058 shutdown_connections 2024-09-15T23:14:48.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.300+0000 7f6f86e77740 1 -- 172.21.15.123:0/785884058 wait complete. 2024-09-15T23:14:48.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.301+0000 7f6f86e77740 1 -- start start 2024-09-15T23:14:48.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.301+0000 7f6f86e77740 1 Processor -- start 2024-09-15T23:14:48.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.302+0000 7f6f86e77740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c21c979f0 0x557c21c967e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.302+0000 7f6f86e77740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c21c9da60 0x557c21cc7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.302+0000 7f6f86e77740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557c21c9de40 0x557c21cb6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.302+0000 7f6f86e77740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6f7c14f650 con 0x557c21c9da60 2024-09-15T23:14:48.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.302+0000 7f6f86e77740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x557c21cc7e40 con 0x557c21c979f0 2024-09-15T23:14:48.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.302+0000 7f6f86e77740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x557c21c96d20 con 0x557c21c9de40 2024-09-15T23:14:48.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.302+0000 7f6f86e77740 10 client.0 _ll_register_callbacks cb 0x7f6f78009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:48.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.302+0000 7f6f815a5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c21c9da60 0x557c21cc7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.302+0000 7f6f815a5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c21c9da60 0x557c21cc7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47964/0 (socket says 172.21.15.123:47964) 2024-09-15T23:14:48.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.302+0000 7f6f815a5640 1 -- 172.21.15.123:0/1210736100 learned_addr learned my addr 172.21.15.123:0/1210736100 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:48.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.302+0000 7f6f825a7640 1 --2- 172.21.15.123:0/1210736100 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557c21c9de40 0x557c21cb6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.302+0000 7f6f81da6640 1 --2- 172.21.15.123:0/1210736100 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c21c979f0 0x557c21c967e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.302+0000 7f6f815a5640 1 -- 172.21.15.123:0/1210736100 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557c21c9de40 msgr2=0x557c21cb6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.302+0000 7f6f815a5640 1 --2- 172.21.15.123:0/1210736100 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557c21c9de40 0x557c21cb6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.302+0000 7f6f815a5640 1 -- 172.21.15.123:0/1210736100 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c21c979f0 msgr2=0x557c21c967e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.302+0000 7f6f815a5640 1 --2- 172.21.15.123:0/1210736100 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c21c979f0 0x557c21c967e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.302+0000 7f6f815a5640 1 -- 172.21.15.123:0/1210736100 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c219b1ed0 con 0x557c21c9da60 2024-09-15T23:14:48.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.302+0000 7f6f81da6640 1 --2- 172.21.15.123:0/1210736100 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c21c979f0 0x557c21c967e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:48.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.302+0000 7f6f815a5640 1 --2- 172.21.15.123:0/1210736100 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c21c9da60 0x557c21cc7680 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6f78022a60 tx=0x7f6f780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b800f5beae0a9025 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.302+0000 7f6f5cff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:48.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.302+0000 7f6f5cff9640 1 -- 172.21.15.123:0/1210736100 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7803a060 con 0x557c21c9da60 2024-09-15T23:14:48.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.302+0000 7f6f5cff9640 1 -- 172.21.15.123:0/1210736100 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7f6f78035460 con 0x557c21c9da60 2024-09-15T23:14:48.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.302+0000 7f6f86e77740 1 -- 172.21.15.123:0/1210736100 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f74036070 con 0x557c21c9da60 2024-09-15T23:14:48.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.303+0000 7f6f5cff9640 1 -- 172.21.15.123:0/1210736100 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6f78040050 con 0x557c21c9da60 2024-09-15T23:14:48.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.303+0000 7f6f86e77740 10 client.5517 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:48.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.303+0000 7f6f86e77740 1 -- 172.21.15.123:0/1210736100 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x557c21ccd730 con 0x557c21c9da60 2024-09-15T23:14:48.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.303+0000 7f6f5cff9640 1 -- 172.21.15.123:0/1210736100 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f74036070 con 0x557c21c9da60 2024-09-15T23:14:48.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.303+0000 7f6f5cff9640 1 -- 172.21.15.123:0/1210736100 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f6f78043020 con 0x557c21c9da60 2024-09-15T23:14:48.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.303+0000 7f6f86e77740 10 client.5517 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:48.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.303+0000 7f6f86e77740 10 client.5517 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:48.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.303+0000 7f6f86e77740 20 client.5517 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:48.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.303+0000 7f6f86e77740 1 --2- 172.21.15.123:0/1210736100 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x557c21c9aab0 0x557c21d365e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.303+0000 7f6f86e77740 4 client.5517 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-09-15T23:14:48.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.303+0000 7f6f86e77740 1 -- 172.21.15.123:0/1210736100 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) -- 0x557c21bda2f0 con 0x557c21c9aab0 2024-09-15T23:14:48.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.303+0000 7f6f81da6640 1 --2- 172.21.15.123:0/1210736100 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x557c21c9aab0 0x557c21d365e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.303+0000 7f6f81da6640 1 --2- 172.21.15.123:0/1210736100 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x557c21c9aab0 0x557c21d365e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b39600812ba0edb0 server_cookie=9665e7061eaf3f8c in_seq=0 out_seq=0 2024-09-15T23:14:48.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.303+0000 7f6f5cff9640 10 client.5517 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:48.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.306+0000 7f6f5cff9640 1 -- 172.21.15.123:0/1210736100 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557c21bda2f0 con 0x557c21c9aab0 2024-09-15T23:14:48.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.306+0000 7f6f5cff9640 10 client.5517 handle_command_reply: tid=0 2024-09-15T23:14:48.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.306+0000 7f6f86e77740 1 client.5517 shutdown 2024-09-15T23:14:48.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.307+0000 7f6f86e77740 1 -- 172.21.15.123:0/1210736100 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c21c9da60 msgr2=0x557c21cc7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.307+0000 7f6f86e77740 1 --2- 172.21.15.123:0/1210736100 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c21c9da60 0x557c21cc7680 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6f78022a60 tx=0x7f6f780046c0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.307+0000 7f6f86e77740 1 -- 172.21.15.123:0/1210736100 shutdown_connections 2024-09-15T23:14:48.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.307+0000 7f6f86e77740 1 --2- 172.21.15.123:0/1210736100 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x557c21c9aab0 0x557c21d365e0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.307+0000 7f6f86e77740 1 --2- 172.21.15.123:0/1210736100 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557c21c9de40 0x557c21cb6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.307+0000 7f6f86e77740 1 --2- 172.21.15.123:0/1210736100 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c21c9da60 0x557c21cc7680 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.307+0000 7f6f86e77740 1 --2- 172.21.15.123:0/1210736100 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557c21c979f0 0x557c21c967e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.307+0000 7f6f5cff9640 0 client.5517 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:48.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.307+0000 7f6f86e77740 1 -- 172.21.15.123:0/1210736100 >> 172.21.15.123:0/1210736100 conn(0x557c21c702f0 msgr2=0x557c21c98000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.307+0000 7f6f86e77740 1 -- 172.21.15.123:0/1210736100 shutdown_connections 2024-09-15T23:14:48.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.307+0000 7f6f86e77740 1 -- 172.21.15.123:0/1210736100 wait complete. 2024-09-15T23:14:48.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.307+0000 7f6f86e77740 20 client.5517 trim_cache size 0 max 16384 2024-09-15T23:14:48.312 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:14:48.312 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "", 2024-09-15T23:14:48.312 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0 2024-09-15T23:14:48.312 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:14:48.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.307+0000 7f6f8400a640 1 -- 172.21.15.123:0/793823916 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6f6006c1f0 msgr2=0x7f6f6006e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.307+0000 7f6f8400a640 1 --2- 172.21.15.123:0/793823916 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6f6006c1f0 0x7f6f6006e6b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c1593e0 tx=0x7f6f78009190 comp rx=0 tx=0).stop 2024-09-15T23:14:48.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.307+0000 7f6f8400a640 1 -- 172.21.15.123:0/793823916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f7c1459a0 msgr2=0x7f6f7c143b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.307+0000 7f6f8400a640 1 --2- 172.21.15.123:0/793823916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f7c1459a0 0x7f6f7c143b20 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6f70007290 tx=0x7f6f70007690 comp rx=0 tx=0).stop 2024-09-15T23:14:48.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.307+0000 7f6f8400a640 1 -- 172.21.15.123:0/793823916 shutdown_connections 2024-09-15T23:14:48.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.307+0000 7f6f8400a640 1 --2- 172.21.15.123:0/793823916 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6f7c15a530 0x7f6f7c15a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.307+0000 7f6f8400a640 1 --2- 172.21.15.123:0/793823916 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f7c072590 0x7f6f7c0729f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.307+0000 7f6f8400a640 1 --2- 172.21.15.123:0/793823916 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6f6006c1f0 0x7f6f6006e6b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.307+0000 7f6f8400a640 1 --2- 172.21.15.123:0/793823916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f7c1459a0 0x7f6f7c143b20 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.307+0000 7f6f8400a640 1 -- 172.21.15.123:0/793823916 >> 172.21.15.123:0/793823916 conn(0x7f6f7c06d0f0 msgr2=0x7f6f7c15eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.307+0000 7f6f8400a640 1 -- 172.21.15.123:0/793823916 shutdown_connections 2024-09-15T23:14:48.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.307+0000 7f6f8400a640 1 -- 172.21.15.123:0/793823916 wait complete. 2024-09-15T23:14:48.319 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'message': '', 'return_code': 0}' 2024-09-15T23:14:48.319 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-09-15T23:14:48.319 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-09-15T23:14:48.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.420+0000 7f9d6c865640 1 Processor -- start 2024-09-15T23:14:48.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.420+0000 7f9d6c865640 1 -- start start 2024-09-15T23:14:48.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.421+0000 7f9d6c865640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9d680ccf30 0x7f9d680b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.421+0000 7f9d6c865640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f9d6815b7c0 0x7f9d680cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.421+0000 7f9d6c865640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d680cd850 con 0x7f9d680cead0 2024-09-15T23:14:48.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.421+0000 7f9d6c865640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f9d680cf2e0 con 0x7f9d6815b7c0 2024-09-15T23:14:48.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.421+0000 7f9d6c865640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9d68070fe0 con 0x7f9d680ccf30 2024-09-15T23:14:48.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.422+0000 7f9d6659c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9d680ccf30 0x7f9d680b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.422+0000 7f9d65d9b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f9d6815b7c0 0x7f9d680cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.422+0000 7f9d66d9d640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f9d680cead0 0x7f9d6815f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:59692/0 (socket says 172.21.15.123:59692) 2024-09-15T23:14:48.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.422+0000 7f9d66d9d640 1 -- 172.21.15.123:0/1190174114 learned_addr learned my addr 172.21.15.123:0/1190174114 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:48.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.422+0000 7f9d6659c640 1 -- 172.21.15.123:0/1190174114 >> v2:172.21.15.188:3300/0 conn(0x7f9d6815b7c0 msgr2=0x7f9d680cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.422+0000 7f9d6659c640 1 --2- 172.21.15.123:0/1190174114 >> v2:172.21.15.188:3300/0 conn(0x7f9d6815b7c0 0x7f9d680cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.422+0000 7f9d6659c640 1 -- 172.21.15.123:0/1190174114 >> v1:172.21.15.188:6789/0 conn(0x7f9d680cead0 legacy=0x7f9d6815f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.422+0000 7f9d6659c640 1 -- 172.21.15.123:0/1190174114 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d680712c0 con 0x7f9d680ccf30 2024-09-15T23:14:48.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.422+0000 7f9d65d9b640 1 --2- 172.21.15.123:0/1190174114 >> v2:172.21.15.188:3300/0 conn(0x7f9d6815b7c0 0x7f9d680cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:14:48.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.423+0000 7f9d6659c640 1 --2- 172.21.15.123:0/1190174114 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9d680ccf30 0x7f9d680b2c50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9d58009d90 tx=0x7f9d5802a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b37571da79387dee server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.423+0000 7f9d6559a640 1 -- 172.21.15.123:0/1190174114 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d58031600 con 0x7f9d680ccf30 2024-09-15T23:14:48.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.423+0000 7f9d6559a640 1 -- 172.21.15.123:0/1190174114 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d580317a0 con 0x7f9d680ccf30 2024-09-15T23:14:48.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.423+0000 7f9d6559a640 1 -- 172.21.15.123:0/1190174114 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d58031b70 con 0x7f9d680ccf30 2024-09-15T23:14:48.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.423+0000 7f9d6c865640 1 -- 172.21.15.123:0/1190174114 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9d680ccf30 msgr2=0x7f9d680b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.423+0000 7f9d6c865640 1 --2- 172.21.15.123:0/1190174114 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9d680ccf30 0x7f9d680b2c50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9d58009d90 tx=0x7f9d5802a5d0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.423+0000 7f9d6c865640 1 -- 172.21.15.123:0/1190174114 shutdown_connections 2024-09-15T23:14:48.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.423+0000 7f9d6c865640 1 --2- 172.21.15.123:0/1190174114 >> v2:172.21.15.188:3300/0 conn(0x7f9d6815b7c0 0x7f9d680cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.423+0000 7f9d6c865640 1 --2- 172.21.15.123:0/1190174114 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9d680ccf30 0x7f9d680b2c50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.423+0000 7f9d6c865640 1 -- 172.21.15.123:0/1190174114 >> 172.21.15.123:0/1190174114 conn(0x7f9d6806d0f0 msgr2=0x7f9d6806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.423+0000 7f9d6c865640 1 -- 172.21.15.123:0/1190174114 shutdown_connections 2024-09-15T23:14:48.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.423+0000 7f9d6c865640 1 -- 172.21.15.123:0/1190174114 wait complete. 2024-09-15T23:14:48.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.425+0000 7f9d6c865640 1 Processor -- start 2024-09-15T23:14:48.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.425+0000 7f9d6c865640 1 -- start start 2024-09-15T23:14:48.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.425+0000 7f9d6c865640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d680ccf30 0x7f9d68150550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.426+0000 7f9d6c865640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9d680cead0 0x7f9d680c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.426+0000 7f9d6c865640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9d6815b7c0 0x7f9d681e7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.426+0000 7f9d6c865640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9d680cef40 con 0x7f9d680ccf30 2024-09-15T23:14:48.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.426+0000 7f9d6c865640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9d680cf5c0 con 0x7f9d680cead0 2024-09-15T23:14:48.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.426+0000 7f9d6c865640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9d680cf0c0 con 0x7f9d6815b7c0 2024-09-15T23:14:48.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.426+0000 7f9d6659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d680ccf30 0x7f9d68150550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.426+0000 7f9d6659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d680ccf30 0x7f9d68150550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47978/0 (socket says 172.21.15.123:47978) 2024-09-15T23:14:48.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.426+0000 7f9d6659c640 1 -- 172.21.15.123:0/2788902010 learned_addr learned my addr 172.21.15.123:0/2788902010 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:48.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.426+0000 7f9d65d9b640 1 --2- 172.21.15.123:0/2788902010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9d680cead0 0x7f9d680c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.426+0000 7f9d66d9d640 1 --2- 172.21.15.123:0/2788902010 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9d6815b7c0 0x7f9d681e7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.426+0000 7f9d6659c640 1 -- 172.21.15.123:0/2788902010 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9d6815b7c0 msgr2=0x7f9d681e7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.426+0000 7f9d6659c640 1 --2- 172.21.15.123:0/2788902010 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9d6815b7c0 0x7f9d681e7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.426+0000 7f9d6659c640 1 -- 172.21.15.123:0/2788902010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9d680cead0 msgr2=0x7f9d680c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.426+0000 7f9d6659c640 1 --2- 172.21.15.123:0/2788902010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9d680cead0 0x7f9d680c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.426+0000 7f9d6659c640 1 -- 172.21.15.123:0/2788902010 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d680c7060 con 0x7f9d680ccf30 2024-09-15T23:14:48.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.426+0000 7f9d6659c640 1 --2- 172.21.15.123:0/2788902010 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d680ccf30 0x7f9d68150550 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9d58009d90 tx=0x7f9d58004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.426+0000 7f9d5effd640 1 -- 172.21.15.123:0/2788902010 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d58040070 con 0x7f9d680ccf30 2024-09-15T23:14:48.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.426+0000 7f9d5effd640 1 -- 172.21.15.123:0/2788902010 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d58030be0 con 0x7f9d680ccf30 2024-09-15T23:14:48.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.426+0000 7f9d5effd640 1 -- 172.21.15.123:0/2788902010 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d58009450 con 0x7f9d680ccf30 2024-09-15T23:14:48.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.426+0000 7f9d6c865640 1 -- 172.21.15.123:0/2788902010 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d680c7340 con 0x7f9d680ccf30 2024-09-15T23:14:48.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.426+0000 7f9d6c865640 1 -- 172.21.15.123:0/2788902010 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d680c7be0 con 0x7f9d680ccf30 2024-09-15T23:14:48.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.428+0000 7f9d5effd640 1 -- 172.21.15.123:0/2788902010 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9d58039040 con 0x7f9d680ccf30 2024-09-15T23:14:48.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.428+0000 7f9d5effd640 1 --2- 172.21.15.123:0/2788902010 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9d4806c2b0 0x7f9d4806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.428+0000 7f9d5effd640 1 -- 172.21.15.123:0/2788902010 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7f9d580ac930 con 0x7f9d680ccf30 2024-09-15T23:14:48.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.429+0000 7f9d65d9b640 1 --2- 172.21.15.123:0/2788902010 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9d4806c2b0 0x7f9d4806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.429+0000 7f9d65d9b640 1 --2- 172.21.15.123:0/2788902010 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9d4806c2b0 0x7f9d4806e770 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9d50009560 tx=0x7f9d50009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.429+0000 7f9d6f600740 1 Processor -- start 2024-09-15T23:14:48.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.429+0000 7f9d6f600740 1 -- start start 2024-09-15T23:14:48.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.430+0000 7f9d6f600740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5561a8a258a0 0x5561a8a25c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.430+0000 7f9d6f600740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5561a8a40260 0x5561a8a41a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.430+0000 7f9d6f600740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561a89f9200 0x5561a8a41f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.430+0000 7f9d6f600740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5561a895fc60 con 0x5561a89f9200 2024-09-15T23:14:48.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.430+0000 7f9d6f600740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5561a8907a50 con 0x5561a8a40260 2024-09-15T23:14:48.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.430+0000 7f9d6f600740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5561a895bc20 con 0x5561a8a258a0 2024-09-15T23:14:48.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.430+0000 7f9d66d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561a89f9200 0x5561a8a41f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.430+0000 7f9d66d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561a89f9200 0x5561a8a41f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47982/0 (socket says 172.21.15.123:47982) 2024-09-15T23:14:48.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.430+0000 7f9d66d9d640 1 -- 172.21.15.123:0/868890309 learned_addr learned my addr 172.21.15.123:0/868890309 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:48.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.430+0000 7f9d65d9b640 1 --2- 172.21.15.123:0/868890309 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5561a8a40260 0x5561a8a41a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.430+0000 7f9d6659c640 1 --2- 172.21.15.123:0/868890309 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5561a8a258a0 0x5561a8a25c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.430+0000 7f9d66d9d640 1 -- 172.21.15.123:0/868890309 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5561a8a258a0 msgr2=0x5561a8a25c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.430+0000 7f9d66d9d640 1 --2- 172.21.15.123:0/868890309 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5561a8a258a0 0x5561a8a25c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.430+0000 7f9d66d9d640 1 -- 172.21.15.123:0/868890309 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5561a8a40260 msgr2=0x5561a8a41a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.430+0000 7f9d66d9d640 1 --2- 172.21.15.123:0/868890309 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5561a8a40260 0x5561a8a41a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.430+0000 7f9d66d9d640 1 -- 172.21.15.123:0/868890309 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561a873ef00 con 0x5561a89f9200 2024-09-15T23:14:48.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.430+0000 7f9d6659c640 1 --2- 172.21.15.123:0/868890309 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5561a8a258a0 0x5561a8a25c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:48.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.431+0000 7f9d66d9d640 1 --2- 172.21.15.123:0/868890309 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561a89f9200 0x5561a8a41f50 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9d60004f00 tx=0x7f9d60007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2daef193ba31014b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.431+0000 7f9d47fff640 1 -- 172.21.15.123:0/868890309 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d600017c0 con 0x5561a89f9200 2024-09-15T23:14:48.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.431+0000 7f9d47fff640 1 -- 172.21.15.123:0/868890309 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d60018070 con 0x5561a89f9200 2024-09-15T23:14:48.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.431+0000 7f9d47fff640 1 -- 172.21.15.123:0/868890309 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d60001b60 con 0x5561a89f9200 2024-09-15T23:14:48.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.431+0000 7f9d6f600740 1 -- 172.21.15.123:0/868890309 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561a89f9200 msgr2=0x5561a8a41f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.431+0000 7f9d6f600740 1 --2- 172.21.15.123:0/868890309 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561a89f9200 0x5561a8a41f50 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9d60004f00 tx=0x7f9d60007430 comp rx=0 tx=0).stop 2024-09-15T23:14:48.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.431+0000 7f9d6f600740 1 -- 172.21.15.123:0/868890309 shutdown_connections 2024-09-15T23:14:48.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.431+0000 7f9d6f600740 1 --2- 172.21.15.123:0/868890309 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561a89f9200 0x5561a8a41f50 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.431+0000 7f9d6f600740 1 --2- 172.21.15.123:0/868890309 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5561a8a40260 0x5561a8a41a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.431+0000 7f9d6f600740 1 --2- 172.21.15.123:0/868890309 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5561a8a258a0 0x5561a8a25c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.431+0000 7f9d6f600740 1 -- 172.21.15.123:0/868890309 >> 172.21.15.123:0/868890309 conn(0x5561a89f8200 msgr2=0x5561a8a406b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.432+0000 7f9d6f600740 1 -- 172.21.15.123:0/868890309 shutdown_connections 2024-09-15T23:14:48.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.432+0000 7f9d6f600740 1 -- 172.21.15.123:0/868890309 wait complete. 2024-09-15T23:14:48.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.432+0000 7f9d6f600740 1 -- start start 2024-09-15T23:14:48.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.432+0000 7f9d6f600740 1 Processor -- start 2024-09-15T23:14:48.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.433+0000 7f9d6f600740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561a8a258a0 0x5561a8a3b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.433+0000 7f9d6f600740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5561a8a40260 0x5561a8a3d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.433+0000 7f9d6f600740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5561a89fb6c0 0x5561a8a21fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.433+0000 7f9d6f600740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5561a8a26660 con 0x5561a8a258a0 2024-09-15T23:14:48.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.433+0000 7f9d6f600740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5561a8905cb0 con 0x5561a89fb6c0 2024-09-15T23:14:48.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.433+0000 7f9d6f600740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5561a8a40ef0 con 0x5561a8a40260 2024-09-15T23:14:48.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.433+0000 7f9d6f600740 10 client.0 _ll_register_callbacks cb 0x5561a86722e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:48.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.433+0000 7f9d6659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561a8a258a0 0x5561a8a3b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.433+0000 7f9d6659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561a8a258a0 0x5561a8a3b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47984/0 (socket says 172.21.15.123:47984) 2024-09-15T23:14:48.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.433+0000 7f9d6659c640 1 -- 172.21.15.123:0/704447143 learned_addr learned my addr 172.21.15.123:0/704447143 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:48.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.433+0000 7f9d66d9d640 1 --2- 172.21.15.123:0/704447143 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5561a89fb6c0 0x5561a8a21fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.433+0000 7f9d65d9b640 1 --2- 172.21.15.123:0/704447143 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5561a8a40260 0x5561a8a3d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.433+0000 7f9d6659c640 1 -- 172.21.15.123:0/704447143 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5561a8a40260 msgr2=0x5561a8a3d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.433+0000 7f9d6659c640 1 --2- 172.21.15.123:0/704447143 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5561a8a40260 0x5561a8a3d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.433+0000 7f9d6659c640 1 -- 172.21.15.123:0/704447143 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5561a89fb6c0 msgr2=0x5561a8a21fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.433+0000 7f9d6659c640 1 --2- 172.21.15.123:0/704447143 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5561a89fb6c0 0x5561a8a21fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.433+0000 7f9d6659c640 1 -- 172.21.15.123:0/704447143 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561a86327f0 con 0x5561a8a258a0 2024-09-15T23:14:48.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.434+0000 7f9d6659c640 1 --2- 172.21.15.123:0/704447143 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561a8a258a0 0x5561a8a3b6f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9d580830e0 tx=0x7f9d5807a440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc95bd0c631f4a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.434+0000 7f9d457fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:48.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.434+0000 7f9d457fa640 1 -- 172.21.15.123:0/704447143 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d580a9060 con 0x5561a8a258a0 2024-09-15T23:14:48.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.434+0000 7f9d457fa640 1 -- 172.21.15.123:0/704447143 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7f9d580810b0 con 0x5561a8a258a0 2024-09-15T23:14:48.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.434+0000 7f9d6f600740 1 -- 172.21.15.123:0/704447143 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d60018070 con 0x5561a8a258a0 2024-09-15T23:14:48.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.434+0000 7f9d457fa640 1 -- 172.21.15.123:0/704447143 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9d58097050 con 0x5561a8a258a0 2024-09-15T23:14:48.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.434+0000 7f9d6f600740 10 client.5526 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:48.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.434+0000 7f9d6f600740 1 -- 172.21.15.123:0/704447143 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x5561a879f690 con 0x5561a8a258a0 2024-09-15T23:14:48.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.434+0000 7f9d457fa640 1 -- 172.21.15.123:0/704447143 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d60018070 con 0x5561a8a258a0 2024-09-15T23:14:48.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.434+0000 7f9d457fa640 1 -- 172.21.15.123:0/704447143 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f9d5804d030 con 0x5561a8a258a0 2024-09-15T23:14:48.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.434+0000 7f9d6f600740 10 client.5526 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:48.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.434+0000 7f9d6f600740 10 client.5526 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:48.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.434+0000 7f9d6f600740 20 client.5526 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:48.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.434+0000 7f9d6f600740 1 --2- 172.21.15.123:0/704447143 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5561a8a3f2d0 0x5561a89f96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.434+0000 7f9d6f600740 4 client.5526 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:14:48.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.434+0000 7f9d6f600740 1 -- 172.21.15.123:0/704447143 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5561a896d390 con 0x5561a8a3f2d0 2024-09-15T23:14:48.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.434+0000 7f9d65d9b640 1 --2- 172.21.15.123:0/704447143 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5561a8a3f2d0 0x5561a89f96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.435+0000 7f9d457fa640 10 client.5526 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:48.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.435+0000 7f9d65d9b640 1 --2- 172.21.15.123:0/704447143 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5561a8a3f2d0 0x5561a89f96a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3073bab3b9fe8762 server_cookie=af6503a4e4133dcc in_seq=0 out_seq=0 2024-09-15T23:14:48.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.435+0000 7f9d457fa640 1 -- 172.21.15.123:0/704447143 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5561a896d390 con 0x5561a8a3f2d0 2024-09-15T23:14:48.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.435+0000 7f9d457fa640 10 client.5526 handle_command_reply: tid=0 2024-09-15T23:14:48.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.435+0000 7f9d6f600740 1 client.5526 shutdown 2024-09-15T23:14:48.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.436+0000 7f9d6f600740 1 -- 172.21.15.123:0/704447143 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561a8a258a0 msgr2=0x5561a8a3b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.436+0000 7f9d6f600740 1 --2- 172.21.15.123:0/704447143 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561a8a258a0 0x5561a8a3b6f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9d580830e0 tx=0x7f9d5807a440 comp rx=0 tx=0).stop 2024-09-15T23:14:48.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.436+0000 7f9d6f600740 1 -- 172.21.15.123:0/704447143 shutdown_connections 2024-09-15T23:14:48.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.436+0000 7f9d6f600740 1 --2- 172.21.15.123:0/704447143 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5561a8a3f2d0 0x5561a89f96a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.436+0000 7f9d6f600740 1 --2- 172.21.15.123:0/704447143 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5561a89fb6c0 0x5561a8a21fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.436+0000 7f9d6f600740 1 --2- 172.21.15.123:0/704447143 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5561a8a40260 0x5561a8a3d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.436+0000 7f9d457fa640 0 client.5526 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:48.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.436+0000 7f9d6f600740 1 --2- 172.21.15.123:0/704447143 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561a8a258a0 0x5561a8a3b6f0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.436+0000 7f9d6f600740 1 -- 172.21.15.123:0/704447143 >> 172.21.15.123:0/704447143 conn(0x5561a89f9200 msgr2=0x5561a8a4a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.436+0000 7f9d6f600740 1 -- 172.21.15.123:0/704447143 shutdown_connections 2024-09-15T23:14:48.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.436+0000 7f9d6f600740 1 -- 172.21.15.123:0/704447143 wait complete. 2024-09-15T23:14:48.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.436+0000 7f9d6f600740 20 client.5526 trim_cache size 0 max 16384 2024-09-15T23:14:48.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.453+0000 7f9d6f600740 1 Processor -- start 2024-09-15T23:14:48.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.453+0000 7f9d6f600740 1 -- start start 2024-09-15T23:14:48.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.454+0000 7f9d6f600740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561a89fb6c0 0x5561a8a49fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.454+0000 7f9d6f600740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5561a8a258a0 0x5561a8a3e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.454+0000 7f9d6f600740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5561a8a40260 0x5561a8a574b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.454+0000 7f9d6f600740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9d680c5fa0 con 0x5561a89fb6c0 2024-09-15T23:14:48.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.454+0000 7f9d6f600740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6815e310 con 0x5561a8a40260 2024-09-15T23:14:48.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.454+0000 7f9d6f600740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9d680cc550 con 0x5561a8a258a0 2024-09-15T23:14:48.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.454+0000 7f9d6659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561a89fb6c0 0x5561a8a49fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.454+0000 7f9d6659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561a89fb6c0 0x5561a8a49fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47994/0 (socket says 172.21.15.123:47994) 2024-09-15T23:14:48.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.454+0000 7f9d6659c640 1 -- 172.21.15.123:0/4031709726 learned_addr learned my addr 172.21.15.123:0/4031709726 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:48.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.454+0000 7f9d66d9d640 1 --2- 172.21.15.123:0/4031709726 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5561a8a40260 0x5561a8a574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.454+0000 7f9d65d9b640 1 --2- 172.21.15.123:0/4031709726 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5561a8a258a0 0x5561a8a3e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.454+0000 7f9d6659c640 1 -- 172.21.15.123:0/4031709726 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5561a8a258a0 msgr2=0x5561a8a3e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.454+0000 7f9d6659c640 1 --2- 172.21.15.123:0/4031709726 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5561a8a258a0 0x5561a8a3e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.454+0000 7f9d6659c640 1 -- 172.21.15.123:0/4031709726 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5561a8a40260 msgr2=0x5561a8a574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.454+0000 7f9d6659c640 1 --2- 172.21.15.123:0/4031709726 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5561a8a40260 0x5561a8a574b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.454+0000 7f9d6659c640 1 -- 172.21.15.123:0/4031709726 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561a8a25ff0 con 0x5561a89fb6c0 2024-09-15T23:14:48.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.454+0000 7f9d6659c640 1 --2- 172.21.15.123:0/4031709726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561a89fb6c0 0x5561a8a49fc0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9d58030fd0 tx=0x7f9d5808f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=524a42d9c9ae3c06 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.454+0000 7f9d477fe640 1 -- 172.21.15.123:0/4031709726 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5809d070 con 0x5561a89fb6c0 2024-09-15T23:14:48.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.454+0000 7f9d477fe640 1 -- 172.21.15.123:0/4031709726 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d5809f070 con 0x5561a89fb6c0 2024-09-15T23:14:48.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.454+0000 7f9d477fe640 1 -- 172.21.15.123:0/4031709726 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d58092070 con 0x5561a89fb6c0 2024-09-15T23:14:48.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.455+0000 7f9d6f600740 1 -- 172.21.15.123:0/4031709726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561a89fb6c0 msgr2=0x5561a8a49fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.455+0000 7f9d6f600740 1 --2- 172.21.15.123:0/4031709726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561a89fb6c0 0x5561a8a49fc0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9d58030fd0 tx=0x7f9d5808f000 comp rx=0 tx=0).stop 2024-09-15T23:14:48.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.455+0000 7f9d6f600740 1 -- 172.21.15.123:0/4031709726 shutdown_connections 2024-09-15T23:14:48.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.455+0000 7f9d6f600740 1 --2- 172.21.15.123:0/4031709726 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5561a8a40260 0x5561a8a574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.455+0000 7f9d6f600740 1 --2- 172.21.15.123:0/4031709726 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5561a8a258a0 0x5561a8a3e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.455+0000 7f9d6f600740 1 --2- 172.21.15.123:0/4031709726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561a89fb6c0 0x5561a8a49fc0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.455+0000 7f9d6f600740 1 -- 172.21.15.123:0/4031709726 >> 172.21.15.123:0/4031709726 conn(0x5561a89f9200 msgr2=0x5561a8a40e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.455+0000 7f9d6f600740 1 -- 172.21.15.123:0/4031709726 shutdown_connections 2024-09-15T23:14:48.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.455+0000 7f9d6f600740 1 -- 172.21.15.123:0/4031709726 wait complete. 2024-09-15T23:14:48.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.455+0000 7f9d6f600740 1 -- start start 2024-09-15T23:14:48.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.455+0000 7f9d6f600740 1 Processor -- start 2024-09-15T23:14:48.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.456+0000 7f9d6f600740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5561a89fb6c0 0x5561a8abffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.456+0000 7f9d6f600740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561a8a258a0 0x5561a8a435c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.456+0000 7f9d6f600740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5561a8a40260 0x5561a8a687d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.456+0000 7f9d6f600740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5561a89fc330 con 0x5561a8a258a0 2024-09-15T23:14:48.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.456+0000 7f9d6f600740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6815dcc0 con 0x5561a89fb6c0 2024-09-15T23:14:48.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.456+0000 7f9d6f600740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5561a8a3d860 con 0x5561a8a40260 2024-09-15T23:14:48.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.456+0000 7f9d6f600740 10 client.0 _ll_register_callbacks cb 0x7f9d58031f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:48.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.456+0000 7f9d65d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561a8a258a0 0x5561a8a435c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.456+0000 7f9d65d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561a8a258a0 0x5561a8a435c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48000/0 (socket says 172.21.15.123:48000) 2024-09-15T23:14:48.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.456+0000 7f9d65d9b640 1 -- 172.21.15.123:0/2527586756 learned_addr learned my addr 172.21.15.123:0/2527586756 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:48.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.456+0000 7f9d6659c640 1 --2- 172.21.15.123:0/2527586756 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5561a89fb6c0 0x5561a8abffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.456+0000 7f9d66d9d640 1 --2- 172.21.15.123:0/2527586756 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5561a8a40260 0x5561a8a687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.457+0000 7f9d65d9b640 1 -- 172.21.15.123:0/2527586756 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5561a8a40260 msgr2=0x5561a8a687d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.457+0000 7f9d65d9b640 1 --2- 172.21.15.123:0/2527586756 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5561a8a40260 0x5561a8a687d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.457+0000 7f9d65d9b640 1 -- 172.21.15.123:0/2527586756 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5561a89fb6c0 msgr2=0x5561a8abffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.457+0000 7f9d65d9b640 1 --2- 172.21.15.123:0/2527586756 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5561a89fb6c0 0x5561a8abffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.457+0000 7f9d65d9b640 1 -- 172.21.15.123:0/2527586756 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561a860b8b0 con 0x5561a8a258a0 2024-09-15T23:14:48.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.457+0000 7f9d66d9d640 1 --2- 172.21.15.123:0/2527586756 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5561a8a40260 0x5561a8a687d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:48.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.457+0000 7f9d6659c640 1 --2- 172.21.15.123:0/2527586756 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5561a89fb6c0 0x5561a8abffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:48.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.457+0000 7f9d65d9b640 1 --2- 172.21.15.123:0/2527586756 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561a8a258a0 0x5561a8a435c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9d50016040 tx=0x7f9d50004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d225a7c003bd258c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.457+0000 7f9d457fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:48.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.457+0000 7f9d457fa640 1 -- 172.21.15.123:0/2527586756 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d50030070 con 0x5561a8a258a0 2024-09-15T23:14:48.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.457+0000 7f9d457fa640 1 -- 172.21.15.123:0/2527586756 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7f9d50014b20 con 0x5561a8a258a0 2024-09-15T23:14:48.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.457+0000 7f9d6f600740 1 -- 172.21.15.123:0/2527586756 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d5809f070 con 0x5561a8a258a0 2024-09-15T23:14:48.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.457+0000 7f9d457fa640 1 -- 172.21.15.123:0/2527586756 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9d50014d20 con 0x5561a8a258a0 2024-09-15T23:14:48.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.457+0000 7f9d6f600740 10 client.5532 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:48.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.457+0000 7f9d6f600740 1 -- 172.21.15.123:0/2527586756 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x5561a8ac31f0 con 0x5561a8a258a0 2024-09-15T23:14:48.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.457+0000 7f9d457fa640 1 -- 172.21.15.123:0/2527586756 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d5809f070 con 0x5561a8a258a0 2024-09-15T23:14:48.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.457+0000 7f9d457fa640 1 -- 172.21.15.123:0/2527586756 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f9d50005990 con 0x5561a8a258a0 2024-09-15T23:14:48.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.457+0000 7f9d6f600740 10 client.5532 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:48.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.457+0000 7f9d6f600740 10 client.5532 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:48.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.457+0000 7f9d6f600740 20 client.5532 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:48.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.457+0000 7f9d6f600740 1 --2- 172.21.15.123:0/2527586756 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5561a8a68d10 0x5561a8a21da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.457+0000 7f9d6f600740 4 client.5532 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-09-15T23:14:48.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.457+0000 7f9d6f600740 1 -- 172.21.15.123:0/2527586756 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) -- 0x5561a89676e0 con 0x5561a8a68d10 2024-09-15T23:14:48.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.458+0000 7f9d6659c640 1 --2- 172.21.15.123:0/2527586756 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5561a8a68d10 0x5561a8a21da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.458+0000 7f9d457fa640 10 client.5532 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:48.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.458+0000 7f9d6659c640 1 --2- 172.21.15.123:0/2527586756 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5561a8a68d10 0x5561a8a21da0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2701fd714b79115 server_cookie=15d02e7155f1d956 in_seq=0 out_seq=0 2024-09-15T23:14:48.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.458+0000 7f9d457fa640 1 -- 172.21.15.123:0/2527586756 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5561a89676e0 con 0x5561a8a68d10 2024-09-15T23:14:48.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.458+0000 7f9d457fa640 10 client.5532 handle_command_reply: tid=0 2024-09-15T23:14:48.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.458+0000 7f9d6f600740 1 client.5532 shutdown 2024-09-15T23:14:48.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.458+0000 7f9d6f600740 1 -- 172.21.15.123:0/2527586756 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561a8a258a0 msgr2=0x5561a8a435c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.458+0000 7f9d6f600740 1 --2- 172.21.15.123:0/2527586756 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561a8a258a0 0x5561a8a435c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9d50016040 tx=0x7f9d50004730 comp rx=0 tx=0).stop 2024-09-15T23:14:48.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.459+0000 7f9d6f600740 1 -- 172.21.15.123:0/2527586756 shutdown_connections 2024-09-15T23:14:48.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.459+0000 7f9d6f600740 1 --2- 172.21.15.123:0/2527586756 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5561a8a68d10 0x5561a8a21da0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.459+0000 7f9d6f600740 1 --2- 172.21.15.123:0/2527586756 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5561a8a40260 0x5561a8a687d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.459+0000 7f9d6f600740 1 --2- 172.21.15.123:0/2527586756 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5561a8a258a0 0x5561a8a435c0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.459+0000 7f9d6f600740 1 --2- 172.21.15.123:0/2527586756 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5561a89fb6c0 0x5561a8abffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.459+0000 7f9d457fa640 0 client.5532 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:48.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.459+0000 7f9d6f600740 1 -- 172.21.15.123:0/2527586756 >> 172.21.15.123:0/2527586756 conn(0x5561a89f9200 msgr2=0x5561a8a40e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.459+0000 7f9d6f600740 1 -- 172.21.15.123:0/2527586756 shutdown_connections 2024-09-15T23:14:48.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.459+0000 7f9d6f600740 1 -- 172.21.15.123:0/2527586756 wait complete. 2024-09-15T23:14:48.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.459+0000 7f9d6f600740 20 client.5532 trim_cache size 0 max 16384 2024-09-15T23:14:48.466 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:14:48.466 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0, 2024-09-15T23:14:48.466 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_tag": "75c75053-389d-440b-b30f-9e72e9227740", 2024-09-15T23:14:48.466 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": "asynchronous" 2024-09-15T23:14:48.466 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:14:48.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.459+0000 7f9d6c865640 1 -- 172.21.15.123:0/2788902010 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9d4806c2b0 msgr2=0x7f9d4806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.459+0000 7f9d6c865640 1 --2- 172.21.15.123:0/2788902010 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9d4806c2b0 0x7f9d4806e770 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9d50009560 tx=0x7f9d50009190 comp rx=0 tx=0).stop 2024-09-15T23:14:48.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.459+0000 7f9d6c865640 1 -- 172.21.15.123:0/2788902010 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d680ccf30 msgr2=0x7f9d68150550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.459+0000 7f9d6c865640 1 --2- 172.21.15.123:0/2788902010 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d680ccf30 0x7f9d68150550 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9d58009d90 tx=0x7f9d58004a40 comp rx=0 tx=0).stop 2024-09-15T23:14:48.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.459+0000 7f9d6c865640 1 -- 172.21.15.123:0/2788902010 shutdown_connections 2024-09-15T23:14:48.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.459+0000 7f9d6c865640 1 --2- 172.21.15.123:0/2788902010 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9d6815b7c0 0x7f9d681e7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.459+0000 7f9d6c865640 1 --2- 172.21.15.123:0/2788902010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9d680cead0 0x7f9d680c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.459+0000 7f9d6c865640 1 --2- 172.21.15.123:0/2788902010 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9d4806c2b0 0x7f9d4806e770 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.459+0000 7f9d6c865640 1 --2- 172.21.15.123:0/2788902010 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d680ccf30 0x7f9d68150550 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.459+0000 7f9d6c865640 1 -- 172.21.15.123:0/2788902010 >> 172.21.15.123:0/2788902010 conn(0x7f9d6806d0f0 msgr2=0x7f9d68072970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.459+0000 7f9d6c865640 1 -- 172.21.15.123:0/2788902010 shutdown_connections 2024-09-15T23:14:48.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.459+0000 7f9d6c865640 1 -- 172.21.15.123:0/2788902010 wait complete. 2024-09-15T23:14:48.471 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'return_code': 0, 'scrub_tag': '75c75053-389d-440b-b30f-9e72e9227740', 'mode': 'asynchronous'}' 2024-09-15T23:14:48.471 INFO:tasks.cephfs.test_scrub_checks:First run: flushing base dir / 2024-09-15T23:14:48.471 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-09-15T23:14:48.471 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path / 2024-09-15T23:14:48.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.572+0000 7f668d5d6640 1 Processor -- start 2024-09-15T23:14:48.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.572+0000 7f668d5d6640 1 -- start start 2024-09-15T23:14:48.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.572+0000 7f668d5d6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f668806bfd0 0x7f668806c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.572+0000 7f668d5d6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66880d3930 0x7f6688162ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.572+0000 7f668d5d6640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f668806c8f0 con 0x7f66880b3350 2024-09-15T23:14:48.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.572+0000 7f668d5d6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f66880b78a0 con 0x7f668806bfd0 2024-09-15T23:14:48.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.572+0000 7f668d5d6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f66880cffb0 con 0x7f66880d3930 2024-09-15T23:14:48.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.573+0000 7f66867fc640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f66880b3350 0x7f66881623a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41108/0 (socket says 172.21.15.123:41108) 2024-09-15T23:14:48.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.573+0000 7f66867fc640 1 -- 172.21.15.123:0/871463704 learned_addr learned my addr 172.21.15.123:0/871463704 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:48.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.573+0000 7f66877fe640 1 --2- 172.21.15.123:0/871463704 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66880d3930 0x7f6688162ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.573+0000 7f6686ffd640 1 --2- 172.21.15.123:0/871463704 >> v2:172.21.15.188:3300/0 conn(0x7f668806bfd0 0x7f668806c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.573+0000 7f6685ffb640 1 -- 172.21.15.123:0/871463704 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2880401323 0 0) 0x7f668806c8f0 con 0x7f66880b3350 2024-09-15T23:14:48.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.573+0000 7f6685ffb640 1 -- 172.21.15.123:0/871463704 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6670003520 con 0x7f66880b3350 2024-09-15T23:14:48.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.573+0000 7f6685ffb640 1 -- 172.21.15.123:0/871463704 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 733945753 0 0) 0x7f6670003520 con 0x7f66880b3350 2024-09-15T23:14:48.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.573+0000 7f6685ffb640 1 -- 172.21.15.123:0/871463704 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66880d3930 msgr2=0x7f6688162ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.573+0000 7f6685ffb640 1 --2- 172.21.15.123:0/871463704 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66880d3930 0x7f6688162ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.573+0000 7f6685ffb640 1 -- 172.21.15.123:0/871463704 >> v2:172.21.15.188:3300/0 conn(0x7f668806bfd0 msgr2=0x7f668806c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.573+0000 7f6685ffb640 1 --2- 172.21.15.123:0/871463704 >> v2:172.21.15.188:3300/0 conn(0x7f668806bfd0 0x7f668806c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.573+0000 7f6685ffb640 1 -- 172.21.15.123:0/871463704 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66880cf710 con 0x7f66880b3350 2024-09-15T23:14:48.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.573+0000 7f6685ffb640 1 -- 172.21.15.123:0/871463704 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f667c001670 con 0x7f66880b3350 2024-09-15T23:14:48.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.573+0000 7f6685ffb640 1 -- 172.21.15.123:0/871463704 >> v1:172.21.15.123:6789/0 conn(0x7f66880b3350 legacy=0x7f66881623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.573+0000 7f6685ffb640 1 --2- 172.21.15.123:0/871463704 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66700039e0 0x7f6670003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.573+0000 7f6685ffb640 1 --2- 172.21.15.123:0/871463704 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6670004800 0x7f6670004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.573+0000 7f6685ffb640 1 --2- 172.21.15.123:0/871463704 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66700051c0 0x7f667000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.573+0000 7f6685ffb640 1 -- 172.21.15.123:0/871463704 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f66880cffb0 con 0x7f66700039e0 2024-09-15T23:14:48.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.573+0000 7f6685ffb640 1 -- 172.21.15.123:0/871463704 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f667000bf00 con 0x7f66700051c0 2024-09-15T23:14:48.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.573+0000 7f6685ffb640 1 -- 172.21.15.123:0/871463704 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f667000c080 con 0x7f6670004800 2024-09-15T23:14:48.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.573+0000 7f6686ffd640 1 --2- 172.21.15.123:0/871463704 >> v2:172.21.15.188:3300/0 conn(0x7f668806bfd0 0x7f668806c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:14:48.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.573+0000 7f66877fe640 1 --2- 172.21.15.123:0/871463704 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66880d3930 0x7f6688162ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:14:48.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.573+0000 7f6686ffd640 1 --2- 172.21.15.123:0/871463704 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66700039e0 0x7f6670003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.573+0000 7f66867fc640 1 --2- 172.21.15.123:0/871463704 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6670004800 0x7f6670004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.573+0000 7f66877fe640 1 --2- 172.21.15.123:0/871463704 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66700051c0 0x7f667000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.574+0000 7f6686ffd640 1 -- 172.21.15.123:0/871463704 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6670004800 msgr2=0x7f6670004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.574+0000 7f6686ffd640 1 --2- 172.21.15.123:0/871463704 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6670004800 0x7f6670004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.574+0000 7f6686ffd640 1 -- 172.21.15.123:0/871463704 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66700051c0 msgr2=0x7f667000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.574+0000 7f6686ffd640 1 --2- 172.21.15.123:0/871463704 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66700051c0 0x7f667000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.574+0000 7f6686ffd640 1 -- 172.21.15.123:0/871463704 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6670003520 con 0x7f66700039e0 2024-09-15T23:14:48.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.574+0000 7f6686ffd640 1 --2- 172.21.15.123:0/871463704 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66700039e0 0x7f6670003e00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6678009ca0 tx=0x7f6670005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810bb4104a888c89 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.574+0000 7f6685ffb640 1 -- 172.21.15.123:0/871463704 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6678009840 con 0x7f66700039e0 2024-09-15T23:14:48.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.575+0000 7f6685ffb640 1 -- 172.21.15.123:0/871463704 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6678004020 con 0x7f66700039e0 2024-09-15T23:14:48.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.575+0000 7f6685ffb640 1 -- 172.21.15.123:0/871463704 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66780043d0 con 0x7f66700039e0 2024-09-15T23:14:48.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.575+0000 7f668d5d6640 1 -- 172.21.15.123:0/871463704 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66700039e0 msgr2=0x7f6670003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.575+0000 7f668d5d6640 1 --2- 172.21.15.123:0/871463704 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66700039e0 0x7f6670003e00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6678009ca0 tx=0x7f6670005830 comp rx=0 tx=0).stop 2024-09-15T23:14:48.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.575+0000 7f66877fe640 1 -- 172.21.15.123:0/871463704 reap_dead start 2024-09-15T23:14:48.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.575+0000 7f668d5d6640 1 -- 172.21.15.123:0/871463704 shutdown_connections 2024-09-15T23:14:48.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.575+0000 7f668d5d6640 1 -- 172.21.15.123:0/871463704 >> 172.21.15.123:0/871463704 conn(0x7f66880d11c0 msgr2=0x7f66880d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.575+0000 7f668d5d6640 1 -- 172.21.15.123:0/871463704 shutdown_connections 2024-09-15T23:14:48.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.575+0000 7f668d5d6640 1 -- 172.21.15.123:0/871463704 wait complete. 2024-09-15T23:14:48.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.576+0000 7f668d5d6640 1 Processor -- start 2024-09-15T23:14:48.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.576+0000 7f668d5d6640 1 -- start start 2024-09-15T23:14:48.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.577+0000 7f668d5d6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66700039e0 0x7f6688158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.577+0000 7f668d5d6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66881f89c0 0x7f66881fd030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.577+0000 7f668d5d6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66880b9330 0x7f66880b97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.577+0000 7f668d5d6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f66880d2400 con 0x7f66880b9330 2024-09-15T23:14:48.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.577+0000 7f668d5d6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f66880cfcd0 con 0x7f66881f89c0 2024-09-15T23:14:48.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.577+0000 7f668d5d6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f668806cd50 con 0x7f66700039e0 2024-09-15T23:14:48.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.577+0000 7f66877fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66880b9330 0x7f66880b97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.577+0000 7f66877fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66880b9330 0x7f66880b97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48016/0 (socket says 172.21.15.123:48016) 2024-09-15T23:14:48.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.577+0000 7f66877fe640 1 -- 172.21.15.123:0/1091173461 learned_addr learned my addr 172.21.15.123:0/1091173461 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:48.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.578+0000 7f66867fc640 1 --2- 172.21.15.123:0/1091173461 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66881f89c0 0x7f66881fd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.578+0000 7f6686ffd640 1 --2- 172.21.15.123:0/1091173461 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66700039e0 0x7f6688158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.578+0000 7f66877fe640 1 -- 172.21.15.123:0/1091173461 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66700039e0 msgr2=0x7f6688158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.578+0000 7f66877fe640 1 --2- 172.21.15.123:0/1091173461 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66700039e0 0x7f6688158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.578+0000 7f66877fe640 1 -- 172.21.15.123:0/1091173461 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66881f89c0 msgr2=0x7f66881fd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.578+0000 7f66877fe640 1 --2- 172.21.15.123:0/1091173461 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66881f89c0 0x7f66881fd030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.578+0000 7f66877fe640 1 -- 172.21.15.123:0/1091173461 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66881f8e40 con 0x7f66880b9330 2024-09-15T23:14:48.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.578+0000 7f6686ffd640 1 --2- 172.21.15.123:0/1091173461 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66700039e0 0x7f6688158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:48.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.578+0000 7f66867fc640 1 --2- 172.21.15.123:0/1091173461 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66881f89c0 0x7f66881fd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:48.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.578+0000 7f66877fe640 1 --2- 172.21.15.123:0/1091173461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66880b9330 0x7f66880b97b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6680009da0 tx=0x7f668000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.578+0000 7f666f7fe640 1 -- 172.21.15.123:0/1091173461 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6680015630 con 0x7f66880b9330 2024-09-15T23:14:48.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.578+0000 7f666f7fe640 1 -- 172.21.15.123:0/1091173461 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f668001d070 con 0x7f66880b9330 2024-09-15T23:14:48.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.578+0000 7f666f7fe640 1 -- 172.21.15.123:0/1091173461 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66800159f0 con 0x7f66880b9330 2024-09-15T23:14:48.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.578+0000 7f668d5d6640 1 -- 172.21.15.123:0/1091173461 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66881586d0 con 0x7f66880b9330 2024-09-15T23:14:48.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.578+0000 7f668d5d6640 1 -- 172.21.15.123:0/1091173461 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6688160e30 con 0x7f66880b9330 2024-09-15T23:14:48.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.579+0000 7f666f7fe640 1 -- 172.21.15.123:0/1091173461 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6680015b90 con 0x7f66880b9330 2024-09-15T23:14:48.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.580+0000 7f666f7fe640 1 --2- 172.21.15.123:0/1091173461 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f667406c2b0 0x7f667406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.580+0000 7f666f7fe640 1 -- 172.21.15.123:0/1091173461 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7f668008bf40 con 0x7f66880b9330 2024-09-15T23:14:48.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.580+0000 7f6686ffd640 1 --2- 172.21.15.123:0/1091173461 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f667406c2b0 0x7f667406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.581+0000 7f6686ffd640 1 --2- 172.21.15.123:0/1091173461 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f667406c2b0 0x7f667406e770 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6678032000 tx=0x7f6678008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.581+0000 7f669044f740 1 Processor -- start 2024-09-15T23:14:48.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.581+0000 7f669044f740 1 -- start start 2024-09-15T23:14:48.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.582+0000 7f669044f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562242291450 0x5622422d6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.582+0000 7f669044f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56224228ec10 0x562242291830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.582+0000 7f669044f740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562242292be0 0x56224228ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.582+0000 7f669044f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5622421f3610 con 0x56224228ec10 2024-09-15T23:14:48.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.582+0000 7f669044f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56224219b2e0 con 0x562242291450 2024-09-15T23:14:48.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.582+0000 7f669044f740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5622421ef5d0 con 0x562242292be0 2024-09-15T23:14:48.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.582+0000 7f66867fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56224228ec10 0x562242291830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.582+0000 7f66867fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56224228ec10 0x562242291830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48020/0 (socket says 172.21.15.123:48020) 2024-09-15T23:14:48.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.582+0000 7f66867fc640 1 -- 172.21.15.123:0/2630377645 learned_addr learned my addr 172.21.15.123:0/2630377645 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:48.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.582+0000 7f66877fe640 1 --2- 172.21.15.123:0/2630377645 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562242292be0 0x56224228ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.582+0000 7f6686ffd640 1 --2- 172.21.15.123:0/2630377645 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562242291450 0x5622422d6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.582+0000 7f66867fc640 1 -- 172.21.15.123:0/2630377645 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562242292be0 msgr2=0x56224228ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.582+0000 7f66867fc640 1 --2- 172.21.15.123:0/2630377645 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562242292be0 0x56224228ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.582+0000 7f66867fc640 1 -- 172.21.15.123:0/2630377645 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562242291450 msgr2=0x5622422d6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.582+0000 7f66867fc640 1 --2- 172.21.15.123:0/2630377645 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562242291450 0x5622422d6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.582+0000 7f66867fc640 1 -- 172.21.15.123:0/2630377645 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622421b61f0 con 0x56224228ec10 2024-09-15T23:14:48.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.582+0000 7f66867fc640 1 --2- 172.21.15.123:0/2630377645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56224228ec10 0x562242291830 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f667c001740 tx=0x7f667c004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0f4dc9173a9ffdb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.582+0000 7f666cff9640 1 -- 172.21.15.123:0/2630377645 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f667c007700 con 0x56224228ec10 2024-09-15T23:14:48.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.582+0000 7f666cff9640 1 -- 172.21.15.123:0/2630377645 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f667c019070 con 0x56224228ec10 2024-09-15T23:14:48.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.582+0000 7f666cff9640 1 -- 172.21.15.123:0/2630377645 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f667c007cb0 con 0x56224228ec10 2024-09-15T23:14:48.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.583+0000 7f669044f740 1 -- 172.21.15.123:0/2630377645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56224228ec10 msgr2=0x562242291830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.583+0000 7f669044f740 1 --2- 172.21.15.123:0/2630377645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56224228ec10 0x562242291830 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f667c001740 tx=0x7f667c004bb0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.583+0000 7f669044f740 1 -- 172.21.15.123:0/2630377645 shutdown_connections 2024-09-15T23:14:48.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.583+0000 7f669044f740 1 --2- 172.21.15.123:0/2630377645 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562242292be0 0x56224228ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.583+0000 7f669044f740 1 --2- 172.21.15.123:0/2630377645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56224228ec10 0x562242291830 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.583+0000 7f669044f740 1 --2- 172.21.15.123:0/2630377645 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562242291450 0x5622422d6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.583+0000 7f669044f740 1 -- 172.21.15.123:0/2630377645 >> 172.21.15.123:0/2630377645 conn(0x56224228dc10 msgr2=0x5622422d60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.583+0000 7f669044f740 1 -- 172.21.15.123:0/2630377645 shutdown_connections 2024-09-15T23:14:48.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.583+0000 7f669044f740 1 -- 172.21.15.123:0/2630377645 wait complete. 2024-09-15T23:14:48.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.584+0000 7f669044f740 1 -- start start 2024-09-15T23:14:48.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.584+0000 7f669044f740 1 Processor -- start 2024-09-15T23:14:48.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.584+0000 7f669044f740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562242291450 0x5622422b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.585+0000 7f669044f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562242292be0 0x5622422b2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.585+0000 7f669044f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5622422d0b10 0x5622422d2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.585+0000 7f669044f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56224228d0b0 con 0x562242292be0 2024-09-15T23:14:48.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.585+0000 7f669044f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56224217c350 con 0x5622422d0b10 2024-09-15T23:14:48.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.585+0000 7f669044f740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5622422d7420 con 0x562242291450 2024-09-15T23:14:48.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.585+0000 7f669044f740 10 client.0 _ll_register_callbacks cb 0x562241f05a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:48.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.585+0000 7f66867fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562242292be0 0x5622422b2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.585+0000 7f66867fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562242292be0 0x5622422b2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48034/0 (socket says 172.21.15.123:48034) 2024-09-15T23:14:48.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.585+0000 7f66867fc640 1 -- 172.21.15.123:0/1311592608 learned_addr learned my addr 172.21.15.123:0/1311592608 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:48.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.585+0000 7f66877fe640 1 --2- 172.21.15.123:0/1311592608 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5622422d0b10 0x5622422d2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.585+0000 7f6686ffd640 1 --2- 172.21.15.123:0/1311592608 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562242291450 0x5622422b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.585+0000 7f66867fc640 1 -- 172.21.15.123:0/1311592608 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562242291450 msgr2=0x5622422b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.585+0000 7f66867fc640 1 --2- 172.21.15.123:0/1311592608 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562242291450 0x5622422b2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.585+0000 7f66867fc640 1 -- 172.21.15.123:0/1311592608 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5622422d0b10 msgr2=0x5622422d2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.585+0000 7f66867fc640 1 --2- 172.21.15.123:0/1311592608 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5622422d0b10 0x5622422d2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.585+0000 7f66867fc640 1 -- 172.21.15.123:0/1311592608 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562241f06240 con 0x562242292be0 2024-09-15T23:14:48.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.585+0000 7f66867fc640 1 --2- 172.21.15.123:0/1311592608 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562242292be0 0x5622422b2400 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f667c008ef0 tx=0x7f66880cf8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5ad9e98dc61d75 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.585+0000 7f6665ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:48.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.585+0000 7f6665ffb640 1 -- 172.21.15.123:0/1311592608 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f667c00c070 con 0x562242292be0 2024-09-15T23:14:48.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.585+0000 7f6665ffb640 1 -- 172.21.15.123:0/1311592608 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7f667c01e820 con 0x562242292be0 2024-09-15T23:14:48.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.585+0000 7f669044f740 1 -- 172.21.15.123:0/1311592608 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f667c019070 con 0x562242292be0 2024-09-15T23:14:48.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.585+0000 7f6665ffb640 1 -- 172.21.15.123:0/1311592608 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f667c02f050 con 0x562242292be0 2024-09-15T23:14:48.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.585+0000 7f669044f740 10 client.5544 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:48.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.585+0000 7f669044f740 1 -- 172.21.15.123:0/1311592608 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x562241fd0620 con 0x562242292be0 2024-09-15T23:14:48.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.586+0000 7f6665ffb640 1 -- 172.21.15.123:0/1311592608 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f667c019070 con 0x562242292be0 2024-09-15T23:14:48.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.586+0000 7f6665ffb640 1 -- 172.21.15.123:0/1311592608 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f667c032020 con 0x562242292be0 2024-09-15T23:14:48.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.586+0000 7f669044f740 10 client.5544 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:48.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.586+0000 7f669044f740 10 client.5544 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:48.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.586+0000 7f669044f740 20 client.5544 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:48.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.586+0000 7f669044f740 1 --2- 172.21.15.123:0/1311592608 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5622422d0f90 0x562242290300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.586+0000 7f669044f740 4 client.5544 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:14:48.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.586+0000 7f669044f740 1 -- 172.21.15.123:0/1311592608 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562242200d40 con 0x5622422d0f90 2024-09-15T23:14:48.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.586+0000 7f6686ffd640 1 --2- 172.21.15.123:0/1311592608 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5622422d0f90 0x562242290300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.586+0000 7f6686ffd640 1 --2- 172.21.15.123:0/1311592608 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5622422d0f90 0x562242290300 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b888c25852fe418f server_cookie=e0a56687934ab23c in_seq=0 out_seq=0 2024-09-15T23:14:48.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.586+0000 7f6665ffb640 10 client.5544 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:48.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.587+0000 7f6665ffb640 1 -- 172.21.15.123:0/1311592608 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562242200d40 con 0x5622422d0f90 2024-09-15T23:14:48.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.587+0000 7f6665ffb640 10 client.5544 handle_command_reply: tid=0 2024-09-15T23:14:48.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.587+0000 7f669044f740 1 client.5544 shutdown 2024-09-15T23:14:48.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.587+0000 7f669044f740 1 -- 172.21.15.123:0/1311592608 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562242292be0 msgr2=0x5622422b2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.587+0000 7f669044f740 1 --2- 172.21.15.123:0/1311592608 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562242292be0 0x5622422b2400 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f667c008ef0 tx=0x7f66880cf8e0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.587+0000 7f669044f740 1 -- 172.21.15.123:0/1311592608 shutdown_connections 2024-09-15T23:14:48.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.587+0000 7f669044f740 1 --2- 172.21.15.123:0/1311592608 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5622422d0f90 0x562242290300 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.587+0000 7f669044f740 1 --2- 172.21.15.123:0/1311592608 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5622422d0b10 0x5622422d2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.587+0000 7f6665ffb640 0 client.5544 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:48.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.587+0000 7f669044f740 1 --2- 172.21.15.123:0/1311592608 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562242292be0 0x5622422b2400 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.587+0000 7f669044f740 1 --2- 172.21.15.123:0/1311592608 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562242291450 0x5622422b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.587+0000 7f669044f740 1 -- 172.21.15.123:0/1311592608 >> 172.21.15.123:0/1311592608 conn(0x56224228ec10 msgr2=0x5622422d4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.587+0000 7f669044f740 1 -- 172.21.15.123:0/1311592608 shutdown_connections 2024-09-15T23:14:48.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.587+0000 7f669044f740 1 -- 172.21.15.123:0/1311592608 wait complete. 2024-09-15T23:14:48.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.587+0000 7f669044f740 20 client.5544 trim_cache size 0 max 16384 2024-09-15T23:14:48.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.603+0000 7f669044f740 1 Processor -- start 2024-09-15T23:14:48.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.603+0000 7f669044f740 1 -- start start 2024-09-15T23:14:48.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.603+0000 7f669044f740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562242291450 0x5622422b86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.603+0000 7f669044f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562242292be0 0x5622422b7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.603+0000 7f669044f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5622422d0b10 0x5622422f9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.603+0000 7f669044f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6688205530 con 0x5622422d0b10 2024-09-15T23:14:48.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.603+0000 7f669044f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f66880ccdf0 con 0x562242292be0 2024-09-15T23:14:48.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.603+0000 7f669044f740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f668815f8b0 con 0x562242291450 2024-09-15T23:14:48.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.603+0000 7f66877fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5622422d0b10 0x5622422f9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.603+0000 7f66877fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5622422d0b10 0x5622422f9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48038/0 (socket says 172.21.15.123:48038) 2024-09-15T23:14:48.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.603+0000 7f66877fe640 1 -- 172.21.15.123:0/1289372155 learned_addr learned my addr 172.21.15.123:0/1289372155 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:48.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.603+0000 7f66867fc640 1 --2- 172.21.15.123:0/1289372155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562242292be0 0x5622422b7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.603+0000 7f6686ffd640 1 --2- 172.21.15.123:0/1289372155 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562242291450 0x5622422b86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.604+0000 7f66877fe640 1 -- 172.21.15.123:0/1289372155 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562242291450 msgr2=0x5622422b86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.604+0000 7f66877fe640 1 --2- 172.21.15.123:0/1289372155 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562242291450 0x5622422b86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.604+0000 7f66877fe640 1 -- 172.21.15.123:0/1289372155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562242292be0 msgr2=0x5622422b7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.604+0000 7f66877fe640 1 --2- 172.21.15.123:0/1289372155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562242292be0 0x5622422b7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.604+0000 7f66877fe640 1 -- 172.21.15.123:0/1289372155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562242291f20 con 0x5622422d0b10 2024-09-15T23:14:48.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.604+0000 7f66877fe640 1 --2- 172.21.15.123:0/1289372155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5622422d0b10 0x5622422f9cd0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f66800626f0 tx=0x7f668001f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34094b6d4c498ed4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.604+0000 7f6667fff640 1 -- 172.21.15.123:0/1289372155 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6680088070 con 0x5622422d0b10 2024-09-15T23:14:48.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.604+0000 7f6667fff640 1 -- 172.21.15.123:0/1289372155 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6680019030 con 0x5622422d0b10 2024-09-15T23:14:48.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.604+0000 7f6667fff640 1 -- 172.21.15.123:0/1289372155 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6680083e60 con 0x5622422d0b10 2024-09-15T23:14:48.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.604+0000 7f669044f740 1 -- 172.21.15.123:0/1289372155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5622422d0b10 msgr2=0x5622422f9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.604+0000 7f669044f740 1 --2- 172.21.15.123:0/1289372155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5622422d0b10 0x5622422f9cd0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f66800626f0 tx=0x7f668001f3d0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.605+0000 7f669044f740 1 -- 172.21.15.123:0/1289372155 shutdown_connections 2024-09-15T23:14:48.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.605+0000 7f669044f740 1 --2- 172.21.15.123:0/1289372155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5622422d0b10 0x5622422f9cd0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.605+0000 7f669044f740 1 --2- 172.21.15.123:0/1289372155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562242292be0 0x5622422b7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.605+0000 7f669044f740 1 --2- 172.21.15.123:0/1289372155 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562242291450 0x5622422b86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.605+0000 7f669044f740 1 -- 172.21.15.123:0/1289372155 >> 172.21.15.123:0/1289372155 conn(0x56224228ec10 msgr2=0x5622422b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.605+0000 7f669044f740 1 -- 172.21.15.123:0/1289372155 shutdown_connections 2024-09-15T23:14:48.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.605+0000 7f669044f740 1 -- 172.21.15.123:0/1289372155 wait complete. 2024-09-15T23:14:48.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.605+0000 7f669044f740 1 -- start start 2024-09-15T23:14:48.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.605+0000 7f669044f740 1 Processor -- start 2024-09-15T23:14:48.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.606+0000 7f669044f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562242291450 0x562242357f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.606+0000 7f669044f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562242292be0 0x5622422b9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.606+0000 7f669044f740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5622422d0b10 0x562242354e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.606+0000 7f669044f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5622422b79c0 con 0x562242292be0 2024-09-15T23:14:48.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.606+0000 7f669044f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f66880cc7a0 con 0x562242291450 2024-09-15T23:14:48.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.606+0000 7f669044f740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5622422d54d0 con 0x5622422d0b10 2024-09-15T23:14:48.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.606+0000 7f669044f740 10 client.0 _ll_register_callbacks cb 0x7f66700036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:48.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.606+0000 7f66867fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562242292be0 0x5622422b9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.606+0000 7f66867fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562242292be0 0x5622422b9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48048/0 (socket says 172.21.15.123:48048) 2024-09-15T23:14:48.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.606+0000 7f66867fc640 1 -- 172.21.15.123:0/1544413887 learned_addr learned my addr 172.21.15.123:0/1544413887 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:48.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.606+0000 7f6686ffd640 1 --2- 172.21.15.123:0/1544413887 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562242291450 0x562242357f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.606+0000 7f66877fe640 1 --2- 172.21.15.123:0/1544413887 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5622422d0b10 0x562242354e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.606+0000 7f66867fc640 1 -- 172.21.15.123:0/1544413887 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5622422d0b10 msgr2=0x562242354e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.606+0000 7f66867fc640 1 --2- 172.21.15.123:0/1544413887 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5622422d0b10 0x562242354e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.606+0000 7f66867fc640 1 -- 172.21.15.123:0/1544413887 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562242291450 msgr2=0x562242357f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.606+0000 7f66867fc640 1 --2- 172.21.15.123:0/1544413887 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562242291450 0x562242357f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.606+0000 7f66867fc640 1 -- 172.21.15.123:0/1544413887 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562242358460 con 0x562242292be0 2024-09-15T23:14:48.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.606+0000 7f66867fc640 1 --2- 172.21.15.123:0/1544413887 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562242292be0 0x5622422b9020 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f667c001dc0 tx=0x7f667c006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58ad3253c2d2e9d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.606+0000 7f6665ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:48.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.607+0000 7f6665ffb640 1 -- 172.21.15.123:0/1544413887 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f667c00c040 con 0x562242292be0 2024-09-15T23:14:48.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.607+0000 7f6665ffb640 1 -- 172.21.15.123:0/1544413887 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7f667c028420 con 0x562242292be0 2024-09-15T23:14:48.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.607+0000 7f669044f740 1 -- 172.21.15.123:0/1544413887 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6680019030 con 0x562242292be0 2024-09-15T23:14:48.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.607+0000 7f6665ffb640 1 -- 172.21.15.123:0/1544413887 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f667c03f050 con 0x562242292be0 2024-09-15T23:14:48.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.607+0000 7f669044f740 10 client.5550 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:48.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.607+0000 7f669044f740 1 -- 172.21.15.123:0/1544413887 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x5622422e52b0 con 0x562242292be0 2024-09-15T23:14:48.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.607+0000 7f6665ffb640 1 -- 172.21.15.123:0/1544413887 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6680019030 con 0x562242292be0 2024-09-15T23:14:48.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.607+0000 7f6665ffb640 1 -- 172.21.15.123:0/1544413887 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f667c042020 con 0x562242292be0 2024-09-15T23:14:48.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.607+0000 7f669044f740 10 client.5550 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:48.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.607+0000 7f669044f740 10 client.5550 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:48.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.607+0000 7f669044f740 20 client.5550 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:48.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.607+0000 7f669044f740 1 --2- 172.21.15.123:0/1544413887 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x562242355390 0x562242353cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.607+0000 7f669044f740 4 client.5550 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/"}] 2024-09-15T23:14:48.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.607+0000 7f669044f740 1 -- 172.21.15.123:0/1544413887 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "flush_path", "path": "/"}) -- 0x5622422d3480 con 0x562242355390 2024-09-15T23:14:48.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.607+0000 7f6686ffd640 1 --2- 172.21.15.123:0/1544413887 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x562242355390 0x562242353cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.608+0000 7f6686ffd640 1 --2- 172.21.15.123:0/1544413887 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x562242355390 0x562242353cb0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75a1d40cd04bb3aa server_cookie=a5a4123ed6c5f8a9 in_seq=0 out_seq=0 2024-09-15T23:14:48.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.608+0000 7f6665ffb640 10 client.5550 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:48.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.609+0000 7f6665ffb640 1 -- 172.21.15.123:0/1544413887 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5622422d3480 con 0x562242355390 2024-09-15T23:14:48.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.609+0000 7f6665ffb640 10 client.5550 handle_command_reply: tid=0 2024-09-15T23:14:48.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.609+0000 7f669044f740 1 client.5550 shutdown 2024-09-15T23:14:48.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.609+0000 7f669044f740 1 -- 172.21.15.123:0/1544413887 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562242292be0 msgr2=0x5622422b9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.609+0000 7f669044f740 1 --2- 172.21.15.123:0/1544413887 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562242292be0 0x5622422b9020 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f667c001dc0 tx=0x7f667c006000 comp rx=0 tx=0).stop 2024-09-15T23:14:48.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.609+0000 7f669044f740 1 -- 172.21.15.123:0/1544413887 shutdown_connections 2024-09-15T23:14:48.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.609+0000 7f669044f740 1 --2- 172.21.15.123:0/1544413887 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x562242355390 0x562242353cb0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.609+0000 7f669044f740 1 --2- 172.21.15.123:0/1544413887 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5622422d0b10 0x562242354e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.609+0000 7f669044f740 1 --2- 172.21.15.123:0/1544413887 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562242292be0 0x5622422b9020 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.609+0000 7f6665ffb640 0 client.5550 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:48.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.609+0000 7f669044f740 1 --2- 172.21.15.123:0/1544413887 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562242291450 0x562242357f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.609+0000 7f669044f740 1 -- 172.21.15.123:0/1544413887 >> 172.21.15.123:0/1544413887 conn(0x56224228ec10 msgr2=0x5622422b81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.610+0000 7f669044f740 1 -- 172.21.15.123:0/1544413887 shutdown_connections 2024-09-15T23:14:48.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.610+0000 7f669044f740 1 -- 172.21.15.123:0/1544413887 wait complete. 2024-09-15T23:14:48.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.610+0000 7f669044f740 20 client.5550 trim_cache size 0 max 16384 2024-09-15T23:14:48.616 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:14:48.616 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "", 2024-09-15T23:14:48.616 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0 2024-09-15T23:14:48.616 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:14:48.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.610+0000 7f668d5d6640 1 -- 172.21.15.123:0/1091173461 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f667406c2b0 msgr2=0x7f667406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.610+0000 7f668d5d6640 1 --2- 172.21.15.123:0/1091173461 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f667406c2b0 0x7f667406e770 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6678032000 tx=0x7f6678008030 comp rx=0 tx=0).stop 2024-09-15T23:14:48.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.610+0000 7f668d5d6640 1 -- 172.21.15.123:0/1091173461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66880b9330 msgr2=0x7f66880b97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.610+0000 7f668d5d6640 1 --2- 172.21.15.123:0/1091173461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66880b9330 0x7f66880b97b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6680009da0 tx=0x7f668000f580 comp rx=0 tx=0).stop 2024-09-15T23:14:48.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.610+0000 7f668d5d6640 1 -- 172.21.15.123:0/1091173461 shutdown_connections 2024-09-15T23:14:48.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.610+0000 7f668d5d6640 1 --2- 172.21.15.123:0/1091173461 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f667406c2b0 0x7f667406e770 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.610+0000 7f668d5d6640 1 --2- 172.21.15.123:0/1091173461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66880b9330 0x7f66880b97b0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.610+0000 7f668d5d6640 1 --2- 172.21.15.123:0/1091173461 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66881f89c0 0x7f66881fd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.610+0000 7f668d5d6640 1 --2- 172.21.15.123:0/1091173461 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66700039e0 0x7f6688158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.610+0000 7f668d5d6640 1 -- 172.21.15.123:0/1091173461 >> 172.21.15.123:0/1091173461 conn(0x7f66880d11c0 msgr2=0x7f66880b7790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.610+0000 7f668d5d6640 1 -- 172.21.15.123:0/1091173461 shutdown_connections 2024-09-15T23:14:48.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.610+0000 7f668d5d6640 1 -- 172.21.15.123:0/1091173461 wait complete. 2024-09-15T23:14:48.622 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' returned '{'message': '', 'return_code': 0}' 2024-09-15T23:14:48.622 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /' 2024-09-15T23:14:48.622 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / 2024-09-15T23:14:48.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.722+0000 7f18597df640 1 Processor -- start 2024-09-15T23:14:48.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.722+0000 7f18597df640 1 -- start start 2024-09-15T23:14:48.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.723+0000 7f18597df640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f185415c7e0 0x7f185406ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.723+0000 7f18597df640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f185406bc10 0x7f185406c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.723+0000 7f18597df640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f18540732d0 0x7f1854073740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.723+0000 7f18597df640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f185406c570 con 0x7f18540732d0 2024-09-15T23:14:48.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.723+0000 7f18597df640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f185406f240 con 0x7f185415c7e0 2024-09-15T23:14:48.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.723+0000 7f18597df640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1854074220 con 0x7f185406bc10 2024-09-15T23:14:48.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.723+0000 7f18537fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f18540732d0 0x7f1854073740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.723+0000 7f18537fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f18540732d0 0x7f1854073740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48054/0 (socket says 172.21.15.123:48054) 2024-09-15T23:14:48.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.723+0000 7f18537fe640 1 -- 172.21.15.123:0/1996297131 learned_addr learned my addr 172.21.15.123:0/1996297131 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:48.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.723+0000 7f18527fc640 1 --2- 172.21.15.123:0/1996297131 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f185406bc10 0x7f185406c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.724+0000 7f1852ffd640 1 --2- 172.21.15.123:0/1996297131 >> v2:172.21.15.188:3300/0 conn(0x7f185415c7e0 0x7f185406ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.724+0000 7f18537fe640 1 -- 172.21.15.123:0/1996297131 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f185406bc10 msgr2=0x7f185406c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.724+0000 7f18537fe640 1 --2- 172.21.15.123:0/1996297131 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f185406bc10 0x7f185406c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.724+0000 7f18537fe640 1 -- 172.21.15.123:0/1996297131 >> v2:172.21.15.188:3300/0 conn(0x7f185415c7e0 msgr2=0x7f185406ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.724+0000 7f18537fe640 1 --2- 172.21.15.123:0/1996297131 >> v2:172.21.15.188:3300/0 conn(0x7f185415c7e0 0x7f185406ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.724+0000 7f18537fe640 1 -- 172.21.15.123:0/1996297131 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1854073c80 con 0x7f18540732d0 2024-09-15T23:14:48.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.724+0000 7f1852ffd640 1 --2- 172.21.15.123:0/1996297131 >> v2:172.21.15.188:3300/0 conn(0x7f185415c7e0 0x7f185406ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:48.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.724+0000 7f18537fe640 1 --2- 172.21.15.123:0/1996297131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18540732d0 0x7f1854073740 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f18540689e0 tx=0x7f184c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d88f805e0838627 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.724+0000 7f1851ffb640 1 -- 172.21.15.123:0/1996297131 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c037070 con 0x7f18540732d0 2024-09-15T23:14:48.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.724+0000 7f1851ffb640 1 -- 172.21.15.123:0/1996297131 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f184c032440 con 0x7f18540732d0 2024-09-15T23:14:48.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.724+0000 7f1851ffb640 1 -- 172.21.15.123:0/1996297131 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c032810 con 0x7f18540732d0 2024-09-15T23:14:48.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.725+0000 7f18597df640 1 -- 172.21.15.123:0/1996297131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18540732d0 msgr2=0x7f1854073740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.725+0000 7f18597df640 1 --2- 172.21.15.123:0/1996297131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18540732d0 0x7f1854073740 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f18540689e0 tx=0x7f184c02a1e0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.725+0000 7f18597df640 1 -- 172.21.15.123:0/1996297131 shutdown_connections 2024-09-15T23:14:48.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.725+0000 7f18597df640 1 --2- 172.21.15.123:0/1996297131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18540732d0 0x7f1854073740 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.725+0000 7f18597df640 1 --2- 172.21.15.123:0/1996297131 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f185406bc10 0x7f185406c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.725+0000 7f18597df640 1 --2- 172.21.15.123:0/1996297131 >> v2:172.21.15.188:3300/0 conn(0x7f185415c7e0 0x7f185406ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.725+0000 7f18597df640 1 -- 172.21.15.123:0/1996297131 >> 172.21.15.123:0/1996297131 conn(0x7f18540d1530 msgr2=0x7f18540d1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.725+0000 7f18597df640 1 -- 172.21.15.123:0/1996297131 shutdown_connections 2024-09-15T23:14:48.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.725+0000 7f18597df640 1 -- 172.21.15.123:0/1996297131 wait complete. 2024-09-15T23:14:48.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.726+0000 7f18597df640 1 Processor -- start 2024-09-15T23:14:48.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.726+0000 7f18597df640 1 -- start start 2024-09-15T23:14:48.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.727+0000 7f18597df640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f185406bc10 0x7f185414b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.727+0000 7f18597df640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f18540732d0 0x7f185414a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.727+0000 7f18597df640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f185415c7e0 0x7f18540c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.727+0000 7f18597df640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f185406e500 con 0x7f185415c7e0 2024-09-15T23:14:48.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.727+0000 7f18597df640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f185406e220 con 0x7f18540732d0 2024-09-15T23:14:48.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.727+0000 7f18597df640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f185406e7e0 con 0x7f185406bc10 2024-09-15T23:14:48.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.727+0000 7f18537fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f185415c7e0 0x7f18540c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.727+0000 7f18537fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f185415c7e0 0x7f18540c8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48064/0 (socket says 172.21.15.123:48064) 2024-09-15T23:14:48.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.727+0000 7f18537fe640 1 -- 172.21.15.123:0/1287329457 learned_addr learned my addr 172.21.15.123:0/1287329457 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:48.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.727+0000 7f1852ffd640 1 --2- 172.21.15.123:0/1287329457 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f185406bc10 0x7f185414b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.727+0000 7f18527fc640 1 --2- 172.21.15.123:0/1287329457 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f18540732d0 0x7f185414a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.727+0000 7f18537fe640 1 -- 172.21.15.123:0/1287329457 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f185406bc10 msgr2=0x7f185414b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.727+0000 7f18537fe640 1 --2- 172.21.15.123:0/1287329457 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f185406bc10 0x7f185414b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.727+0000 7f18537fe640 1 -- 172.21.15.123:0/1287329457 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f18540732d0 msgr2=0x7f185414a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.727+0000 7f18537fe640 1 --2- 172.21.15.123:0/1287329457 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f18540732d0 0x7f185414a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.727+0000 7f18537fe640 1 -- 172.21.15.123:0/1287329457 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f185414bb70 con 0x7f185415c7e0 2024-09-15T23:14:48.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.728+0000 7f18537fe640 1 --2- 172.21.15.123:0/1287329457 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f185415c7e0 0x7f18540c8600 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f184c0090b0 tx=0x7f184c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.728+0000 7f183b7fe640 1 -- 172.21.15.123:0/1287329457 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c037040 con 0x7f185415c7e0 2024-09-15T23:14:48.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.728+0000 7f183b7fe640 1 -- 172.21.15.123:0/1287329457 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f184c042070 con 0x7f185415c7e0 2024-09-15T23:14:48.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.728+0000 7f183b7fe640 1 -- 172.21.15.123:0/1287329457 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c030920 con 0x7f185415c7e0 2024-09-15T23:14:48.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.728+0000 7f18597df640 1 -- 172.21.15.123:0/1287329457 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f185414be50 con 0x7f185415c7e0 2024-09-15T23:14:48.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.728+0000 7f18597df640 1 -- 172.21.15.123:0/1287329457 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f185414c410 con 0x7f185415c7e0 2024-09-15T23:14:48.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.730+0000 7f183b7fe640 1 -- 172.21.15.123:0/1287329457 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f184c030ac0 con 0x7f185415c7e0 2024-09-15T23:14:48.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.730+0000 7f183b7fe640 1 --2- 172.21.15.123:0/1287329457 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f184006c2b0 0x7f184006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.730+0000 7f183b7fe640 1 -- 172.21.15.123:0/1287329457 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7f184c0abcb0 con 0x7f185415c7e0 2024-09-15T23:14:48.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.730+0000 7f1852ffd640 1 --2- 172.21.15.123:0/1287329457 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f184006c2b0 0x7f184006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.731+0000 7f1852ffd640 1 --2- 172.21.15.123:0/1287329457 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f184006c2b0 0x7f184006e770 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1844007510 tx=0x7f18440074a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.731+0000 7f185c654740 1 Processor -- start 2024-09-15T23:14:48.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.731+0000 7f185c654740 1 -- start start 2024-09-15T23:14:48.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.732+0000 7f185c654740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56445637e750 0x56445637eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.732+0000 7f185c654740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564456399110 0x56445639a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.732+0000 7f185c654740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644563520b0 0x56445639ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.732+0000 7f185c654740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5644562b7a10 con 0x5644563520b0 2024-09-15T23:14:48.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.732+0000 7f185c654740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56445625f700 con 0x56445637e750 2024-09-15T23:14:48.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.732+0000 7f185c654740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5644562b39d0 con 0x564456399110 2024-09-15T23:14:48.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.732+0000 7f18537fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644563520b0 0x56445639ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.732+0000 7f18537fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644563520b0 0x56445639ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48076/0 (socket says 172.21.15.123:48076) 2024-09-15T23:14:48.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.732+0000 7f18527fc640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564456399110 0x56445639a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.732+0000 7f1852ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56445637e750 0x56445637eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.732+0000 7f18537fe640 1 -- 172.21.15.123:0/3181094226 learned_addr learned my addr 172.21.15.123:0/3181094226 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:48.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.732+0000 7f18537fe640 1 -- 172.21.15.123:0/3181094226 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564456399110 msgr2=0x56445639a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.732+0000 7f18537fe640 1 --2- 172.21.15.123:0/3181094226 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564456399110 0x56445639a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.732+0000 7f18537fe640 1 -- 172.21.15.123:0/3181094226 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56445637e750 msgr2=0x56445637eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.732+0000 7f18537fe640 1 --2- 172.21.15.123:0/3181094226 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56445637e750 0x56445637eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.732+0000 7f18537fe640 1 -- 172.21.15.123:0/3181094226 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564455fae280 con 0x5644563520b0 2024-09-15T23:14:48.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.732+0000 7f18537fe640 1 --2- 172.21.15.123:0/3181094226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644563520b0 0x56445639ae00 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f184c082460 tx=0x7f184c079880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32d42237bed543a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.732+0000 7f1838ff9640 1 -- 172.21.15.123:0/3181094226 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c07e160 con 0x5644563520b0 2024-09-15T23:14:48.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.732+0000 7f1838ff9640 1 -- 172.21.15.123:0/3181094226 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f184c07d030 con 0x5644563520b0 2024-09-15T23:14:48.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.732+0000 7f1838ff9640 1 -- 172.21.15.123:0/3181094226 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c082990 con 0x5644563520b0 2024-09-15T23:14:48.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.733+0000 7f185c654740 1 -- 172.21.15.123:0/3181094226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644563520b0 msgr2=0x56445639ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.733+0000 7f185c654740 1 --2- 172.21.15.123:0/3181094226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644563520b0 0x56445639ae00 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f184c082460 tx=0x7f184c079880 comp rx=0 tx=0).stop 2024-09-15T23:14:48.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.733+0000 7f185c654740 1 -- 172.21.15.123:0/3181094226 shutdown_connections 2024-09-15T23:14:48.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.733+0000 7f185c654740 1 --2- 172.21.15.123:0/3181094226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644563520b0 0x56445639ae00 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.733+0000 7f185c654740 1 --2- 172.21.15.123:0/3181094226 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564456399110 0x56445639a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.733+0000 7f185c654740 1 --2- 172.21.15.123:0/3181094226 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56445637e750 0x56445637eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.733+0000 7f185c654740 1 -- 172.21.15.123:0/3181094226 >> 172.21.15.123:0/3181094226 conn(0x564456351340 msgr2=0x564456399560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.733+0000 7f185c654740 1 -- 172.21.15.123:0/3181094226 shutdown_connections 2024-09-15T23:14:48.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.733+0000 7f185c654740 1 -- 172.21.15.123:0/3181094226 wait complete. 2024-09-15T23:14:48.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.734+0000 7f185c654740 1 -- start start 2024-09-15T23:14:48.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.734+0000 7f185c654740 1 Processor -- start 2024-09-15T23:14:48.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.735+0000 7f185c654740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56445637e750 0x564456378b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.735+0000 7f185c654740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564456399110 0x5644563b1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.735+0000 7f185c654740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5644563b1870 0x5644563b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.735+0000 7f185c654740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56445625f700 con 0x56445637e750 2024-09-15T23:14:48.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.735+0000 7f185c654740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x564456240500 con 0x564456399110 2024-09-15T23:14:48.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.735+0000 7f185c654740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5644562b7a10 con 0x5644563b1870 2024-09-15T23:14:48.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.735+0000 7f185c654740 10 client.0 _ll_register_callbacks cb 0x564455fc9a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:48.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.735+0000 7f1852ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56445637e750 0x564456378b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.735+0000 7f1852ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56445637e750 0x564456378b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48084/0 (socket says 172.21.15.123:48084) 2024-09-15T23:14:48.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.735+0000 7f1852ffd640 1 -- 172.21.15.123:0/2701172151 learned_addr learned my addr 172.21.15.123:0/2701172151 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:48.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.735+0000 7f18527fc640 1 --2- 172.21.15.123:0/2701172151 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564456399110 0x5644563b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.735+0000 7f18537fe640 1 --2- 172.21.15.123:0/2701172151 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5644563b1870 0x5644563b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.735+0000 7f1852ffd640 1 -- 172.21.15.123:0/2701172151 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5644563b1870 msgr2=0x5644563b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.735+0000 7f1852ffd640 1 --2- 172.21.15.123:0/2701172151 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5644563b1870 0x5644563b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.735+0000 7f1852ffd640 1 -- 172.21.15.123:0/2701172151 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564456399110 msgr2=0x5644563b1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.735+0000 7f1852ffd640 1 --2- 172.21.15.123:0/2701172151 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564456399110 0x5644563b1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.735+0000 7f1852ffd640 1 -- 172.21.15.123:0/2701172151 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564456096690 con 0x56445637e750 2024-09-15T23:14:48.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.735+0000 7f18537fe640 1 --2- 172.21.15.123:0/2701172151 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5644563b1870 0x5644563b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:48.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.735+0000 7f18527fc640 1 --2- 172.21.15.123:0/2701172151 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564456399110 0x5644563b1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:48.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.735+0000 7f1852ffd640 1 --2- 172.21.15.123:0/2701172151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56445637e750 0x564456378b80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f184400ff90 tx=0x7f1844004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed1862ab038dcbc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.735+0000 7f1831ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:48.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.735+0000 7f1831ffb640 1 -- 172.21.15.123:0/2701172151 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18440187b0 con 0x56445637e750 2024-09-15T23:14:48.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.735+0000 7f1831ffb640 1 -- 172.21.15.123:0/2701172151 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7f1844027af0 con 0x56445637e750 2024-09-15T23:14:48.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.735+0000 7f185c654740 1 -- 172.21.15.123:0/2701172151 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f184c07d030 con 0x56445637e750 2024-09-15T23:14:48.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.735+0000 7f1831ffb640 1 -- 172.21.15.123:0/2701172151 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1844027cf0 con 0x56445637e750 2024-09-15T23:14:48.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.735+0000 7f185c654740 10 client.5562 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:48.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.735+0000 7f185c654740 1 -- 172.21.15.123:0/2701172151 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x5644560f6e20 con 0x56445637e750 2024-09-15T23:14:48.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.735+0000 7f1831ffb640 1 -- 172.21.15.123:0/2701172151 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f184c07d030 con 0x56445637e750 2024-09-15T23:14:48.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.736+0000 7f1831ffb640 1 -- 172.21.15.123:0/2701172151 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f184402e050 con 0x56445637e750 2024-09-15T23:14:48.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.736+0000 7f185c654740 10 client.5562 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:48.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.736+0000 7f185c654740 10 client.5562 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:48.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.736+0000 7f185c654740 20 client.5562 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:48.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.736+0000 7f185c654740 1 --2- 172.21.15.123:0/2701172151 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x564456381ea0 0x5644563822e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.736+0000 7f185c654740 4 client.5562 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:14:48.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.736+0000 7f185c654740 1 -- 172.21.15.123:0/2701172151 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644562c5140 con 0x564456381ea0 2024-09-15T23:14:48.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.736+0000 7f18527fc640 1 --2- 172.21.15.123:0/2701172151 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x564456381ea0 0x5644563822e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.736+0000 7f1831ffb640 10 client.5562 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:48.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.736+0000 7f18527fc640 1 --2- 172.21.15.123:0/2701172151 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x564456381ea0 0x5644563822e0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d351ac1b60b13bb3 server_cookie=9f0a664bcb5ce4a6 in_seq=0 out_seq=0 2024-09-15T23:14:48.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.737+0000 7f1831ffb640 1 -- 172.21.15.123:0/2701172151 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5644562c5140 con 0x564456381ea0 2024-09-15T23:14:48.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.737+0000 7f1831ffb640 10 client.5562 handle_command_reply: tid=0 2024-09-15T23:14:48.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.737+0000 7f185c654740 1 client.5562 shutdown 2024-09-15T23:14:48.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.737+0000 7f185c654740 1 -- 172.21.15.123:0/2701172151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56445637e750 msgr2=0x564456378b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.737+0000 7f185c654740 1 --2- 172.21.15.123:0/2701172151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56445637e750 0x564456378b80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f184400ff90 tx=0x7f1844004ab0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.737+0000 7f185c654740 1 -- 172.21.15.123:0/2701172151 shutdown_connections 2024-09-15T23:14:48.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.737+0000 7f185c654740 1 --2- 172.21.15.123:0/2701172151 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x564456381ea0 0x5644563822e0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.737+0000 7f185c654740 1 --2- 172.21.15.123:0/2701172151 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5644563b1870 0x5644563b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.737+0000 7f1831ffb640 0 client.5562 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:48.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.737+0000 7f185c654740 1 --2- 172.21.15.123:0/2701172151 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564456399110 0x5644563b1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.737+0000 7f185c654740 1 --2- 172.21.15.123:0/2701172151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56445637e750 0x564456378b80 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.737+0000 7f185c654740 1 -- 172.21.15.123:0/2701172151 >> 172.21.15.123:0/2701172151 conn(0x5644563520b0 msgr2=0x56445634e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.737+0000 7f185c654740 1 -- 172.21.15.123:0/2701172151 shutdown_connections 2024-09-15T23:14:48.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.737+0000 7f185c654740 1 -- 172.21.15.123:0/2701172151 wait complete. 2024-09-15T23:14:48.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.737+0000 7f185c654740 20 client.5562 trim_cache size 0 max 16384 2024-09-15T23:14:48.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.754+0000 7f185c654740 1 Processor -- start 2024-09-15T23:14:48.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.754+0000 7f185c654740 1 -- start start 2024-09-15T23:14:48.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.755+0000 7f185c654740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56445637e750 0x56445634e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.755+0000 7f185c654740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564456399110 0x5644563a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.755+0000 7f185c654740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644563b1870 0x5644563b0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.755+0000 7f185c654740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f18540d10b0 con 0x5644563b1870 2024-09-15T23:14:48.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.755+0000 7f185c654740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f18540cbbc0 con 0x56445637e750 2024-09-15T23:14:48.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.755+0000 7f185c654740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f185414d6a0 con 0x564456399110 2024-09-15T23:14:48.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.755+0000 7f18537fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644563b1870 0x5644563b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.755+0000 7f18537fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644563b1870 0x5644563b0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48088/0 (socket says 172.21.15.123:48088) 2024-09-15T23:14:48.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.755+0000 7f18537fe640 1 -- 172.21.15.123:0/2038810890 learned_addr learned my addr 172.21.15.123:0/2038810890 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:48.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.755+0000 7f18537fe640 1 -- 172.21.15.123:0/2038810890 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564456399110 msgr2=0x5644563a3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.755+0000 7f18537fe640 1 --2- 172.21.15.123:0/2038810890 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564456399110 0x5644563a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.755+0000 7f18537fe640 1 -- 172.21.15.123:0/2038810890 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56445637e750 msgr2=0x56445634e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.755+0000 7f18537fe640 1 --2- 172.21.15.123:0/2038810890 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56445637e750 0x56445634e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.755+0000 7f18537fe640 1 -- 172.21.15.123:0/2038810890 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644563b2060 con 0x5644563b1870 2024-09-15T23:14:48.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.756+0000 7f18537fe640 1 --2- 172.21.15.123:0/2038810890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644563b1870 0x5644563b0360 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f184c082460 tx=0x7f184c008000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f5666d56599ae12 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.756+0000 7f1833fff640 1 -- 172.21.15.123:0/2038810890 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c096070 con 0x5644563b1870 2024-09-15T23:14:48.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.756+0000 7f1833fff640 1 -- 172.21.15.123:0/2038810890 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f184c07d040 con 0x5644563b1870 2024-09-15T23:14:48.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.756+0000 7f1833fff640 1 -- 172.21.15.123:0/2038810890 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c082990 con 0x5644563b1870 2024-09-15T23:14:48.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.756+0000 7f185c654740 1 -- 172.21.15.123:0/2038810890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644563b1870 msgr2=0x5644563b0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.756+0000 7f185c654740 1 --2- 172.21.15.123:0/2038810890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644563b1870 0x5644563b0360 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f184c082460 tx=0x7f184c008000 comp rx=0 tx=0).stop 2024-09-15T23:14:48.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.756+0000 7f185c654740 1 -- 172.21.15.123:0/2038810890 shutdown_connections 2024-09-15T23:14:48.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.756+0000 7f185c654740 1 --2- 172.21.15.123:0/2038810890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5644563b1870 0x5644563b0360 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.756+0000 7f185c654740 1 --2- 172.21.15.123:0/2038810890 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564456399110 0x5644563a3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.756+0000 7f185c654740 1 --2- 172.21.15.123:0/2038810890 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56445637e750 0x56445634e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.756+0000 7f185c654740 1 -- 172.21.15.123:0/2038810890 >> 172.21.15.123:0/2038810890 conn(0x5644563520b0 msgr2=0x564456399d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.756+0000 7f185c654740 1 -- 172.21.15.123:0/2038810890 shutdown_connections 2024-09-15T23:14:48.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.756+0000 7f185c654740 1 -- 172.21.15.123:0/2038810890 wait complete. 2024-09-15T23:14:48.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.757+0000 7f185c654740 1 -- start start 2024-09-15T23:14:48.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.757+0000 7f185c654740 1 Processor -- start 2024-09-15T23:14:48.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.758+0000 7f185c654740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56445637e750 0x564456397c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.758+0000 7f185c654740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564456399110 0x564456398180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.758+0000 7f185c654740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5644563b1870 0x56445639a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.758+0000 7f185c654740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56445639b8b0 con 0x564456399110 2024-09-15T23:14:48.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.758+0000 7f185c654740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f18540cb570 con 0x56445637e750 2024-09-15T23:14:48.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.758+0000 7f185c654740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5644563509d0 con 0x5644563b1870 2024-09-15T23:14:48.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.758+0000 7f185c654740 10 client.0 _ll_register_callbacks cb 0x7f184400f3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:48.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.758+0000 7f18527fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564456399110 0x564456398180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.758+0000 7f18527fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564456399110 0x564456398180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48100/0 (socket says 172.21.15.123:48100) 2024-09-15T23:14:48.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.758+0000 7f18527fc640 1 -- 172.21.15.123:0/4031125806 learned_addr learned my addr 172.21.15.123:0/4031125806 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:48.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.758+0000 7f1852ffd640 1 --2- 172.21.15.123:0/4031125806 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56445637e750 0x564456397c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.758+0000 7f18537fe640 1 --2- 172.21.15.123:0/4031125806 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5644563b1870 0x56445639a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.758+0000 7f18527fc640 1 -- 172.21.15.123:0/4031125806 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5644563b1870 msgr2=0x56445639a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.758+0000 7f18527fc640 1 --2- 172.21.15.123:0/4031125806 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5644563b1870 0x56445639a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.758+0000 7f18527fc640 1 -- 172.21.15.123:0/4031125806 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56445637e750 msgr2=0x564456397c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.758+0000 7f18527fc640 1 --2- 172.21.15.123:0/4031125806 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56445637e750 0x564456397c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.758+0000 7f18527fc640 1 -- 172.21.15.123:0/4031125806 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564455f89f80 con 0x564456399110 2024-09-15T23:14:48.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.758+0000 7f1852ffd640 1 --2- 172.21.15.123:0/4031125806 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56445637e750 0x564456397c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:48.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.758+0000 7f18527fc640 1 --2- 172.21.15.123:0/4031125806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564456399110 0x564456398180 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f1854150eb0 tx=0x7f1848017810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d9d6d015e4a096f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.758+0000 7f1831ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:48.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.758+0000 7f1831ffb640 1 -- 172.21.15.123:0/4031125806 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1848004240 con 0x564456399110 2024-09-15T23:14:48.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.758+0000 7f1831ffb640 1 -- 172.21.15.123:0/4031125806 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7f184800f040 con 0x564456399110 2024-09-15T23:14:48.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.758+0000 7f185c654740 1 -- 172.21.15.123:0/4031125806 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f184c07d040 con 0x564456399110 2024-09-15T23:14:48.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.758+0000 7f1831ffb640 1 -- 172.21.15.123:0/4031125806 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f184802b050 con 0x564456399110 2024-09-15T23:14:48.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.758+0000 7f185c654740 10 client.5568 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:48.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.758+0000 7f185c654740 1 -- 172.21.15.123:0/4031125806 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x56445641c020 con 0x564456399110 2024-09-15T23:14:48.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.758+0000 7f1831ffb640 1 -- 172.21.15.123:0/4031125806 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f184c07d040 con 0x564456399110 2024-09-15T23:14:48.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.759+0000 7f1831ffb640 1 -- 172.21.15.123:0/4031125806 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f184802e020 con 0x564456399110 2024-09-15T23:14:48.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.759+0000 7f185c654740 10 client.5568 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:48.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.759+0000 7f185c654740 10 client.5568 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:48.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.759+0000 7f185c654740 20 client.5568 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:48.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.759+0000 7f185c654740 1 --2- 172.21.15.123:0/4031125806 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5644563c21f0 0x56445639ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.759+0000 7f185c654740 4 client.5568 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/"}] 2024-09-15T23:14:48.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.759+0000 7f185c654740 1 -- 172.21.15.123:0/4031125806 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "scrub start", "path": "/"}) -- 0x5644562bf490 con 0x5644563c21f0 2024-09-15T23:14:48.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.759+0000 7f1852ffd640 1 --2- 172.21.15.123:0/4031125806 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5644563c21f0 0x56445639ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.759+0000 7f1852ffd640 1 --2- 172.21.15.123:0/4031125806 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5644563c21f0 0x56445639ade0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b4c40a5c921bac4 server_cookie=f78ea7ba8f14bb7a in_seq=0 out_seq=0 2024-09-15T23:14:48.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.759+0000 7f1831ffb640 10 client.5568 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:48.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.759+0000 7f1831ffb640 1 -- 172.21.15.123:0/4031125806 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5644562bf490 con 0x5644563c21f0 2024-09-15T23:14:48.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.759+0000 7f1831ffb640 10 client.5568 handle_command_reply: tid=0 2024-09-15T23:14:48.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.759+0000 7f185c654740 1 client.5568 shutdown 2024-09-15T23:14:48.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.760+0000 7f185c654740 1 -- 172.21.15.123:0/4031125806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564456399110 msgr2=0x564456398180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.760+0000 7f185c654740 1 --2- 172.21.15.123:0/4031125806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564456399110 0x564456398180 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f1854150eb0 tx=0x7f1848017810 comp rx=0 tx=0).stop 2024-09-15T23:14:48.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.760+0000 7f185c654740 1 -- 172.21.15.123:0/4031125806 shutdown_connections 2024-09-15T23:14:48.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.760+0000 7f185c654740 1 --2- 172.21.15.123:0/4031125806 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5644563c21f0 0x56445639ade0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.760+0000 7f185c654740 1 --2- 172.21.15.123:0/4031125806 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5644563b1870 0x56445639a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.760+0000 7f1831ffb640 0 client.5568 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:48.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.760+0000 7f185c654740 1 --2- 172.21.15.123:0/4031125806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564456399110 0x564456398180 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.760+0000 7f185c654740 1 --2- 172.21.15.123:0/4031125806 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56445637e750 0x564456397c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.760+0000 7f185c654740 1 -- 172.21.15.123:0/4031125806 >> 172.21.15.123:0/4031125806 conn(0x5644563520b0 msgr2=0x5644563b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.760+0000 7f185c654740 1 -- 172.21.15.123:0/4031125806 shutdown_connections 2024-09-15T23:14:48.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.760+0000 7f185c654740 1 -- 172.21.15.123:0/4031125806 wait complete. 2024-09-15T23:14:48.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.760+0000 7f185c654740 20 client.5568 trim_cache size 0 max 16384 2024-09-15T23:14:48.768 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:14:48.768 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0, 2024-09-15T23:14:48.768 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_tag": "91211599-0132-4e71-9310-0a24f7d72380", 2024-09-15T23:14:48.768 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": "asynchronous" 2024-09-15T23:14:48.768 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:14:48.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.760+0000 7f18597df640 1 -- 172.21.15.123:0/1287329457 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f184006c2b0 msgr2=0x7f184006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.760+0000 7f18597df640 1 --2- 172.21.15.123:0/1287329457 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f184006c2b0 0x7f184006e770 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1844007510 tx=0x7f18440074a0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.760+0000 7f18597df640 1 -- 172.21.15.123:0/1287329457 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f185415c7e0 msgr2=0x7f18540c8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.760+0000 7f18597df640 1 --2- 172.21.15.123:0/1287329457 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f185415c7e0 0x7f18540c8600 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f184c0090b0 tx=0x7f184c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.760+0000 7f18597df640 1 -- 172.21.15.123:0/1287329457 shutdown_connections 2024-09-15T23:14:48.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.760+0000 7f18597df640 1 --2- 172.21.15.123:0/1287329457 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f184006c2b0 0x7f184006e770 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.760+0000 7f18597df640 1 --2- 172.21.15.123:0/1287329457 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f185415c7e0 0x7f18540c8600 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.760+0000 7f18597df640 1 --2- 172.21.15.123:0/1287329457 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f18540732d0 0x7f185414a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.760+0000 7f18597df640 1 --2- 172.21.15.123:0/1287329457 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f185406bc10 0x7f185414b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.760+0000 7f18597df640 1 -- 172.21.15.123:0/1287329457 >> 172.21.15.123:0/1287329457 conn(0x7f18540d1530 msgr2=0x7f18540b54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.760+0000 7f18597df640 1 -- 172.21.15.123:0/1287329457 shutdown_connections 2024-09-15T23:14:48.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.760+0000 7f18597df640 1 -- 172.21.15.123:0/1287329457 wait complete. 2024-09-15T23:14:48.773 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /' returned '{'return_code': 0, 'scrub_tag': '91211599-0132-4e71-9310-0a24f7d72380', 'mode': 'asynchronous'}' 2024-09-15T23:14:48.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:14:48.773 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_dir_0) 2024-09-15T23:14:48.790 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_0' 2024-09-15T23:14:48.790 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_dir_0 2024-09-15T23:14:48.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.929+0000 7fa629396640 1 Processor -- start 2024-09-15T23:14:48.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.930+0000 7fa629396640 1 -- start start 2024-09-15T23:14:48.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.930+0000 7fa629396640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa6240b3350 0x7fa6240d2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.930+0000 7fa629396640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa6240b38a0 0x7fa6240d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.930+0000 7fa629396640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6240cf710 con 0x7fa62406bfd0 2024-09-15T23:14:48.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.930+0000 7fa629396640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fa6240b78a0 con 0x7fa6240b38a0 2024-09-15T23:14:48.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.930+0000 7fa629396640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fa6240cffb0 con 0x7fa6240b3350 2024-09-15T23:14:48.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.931+0000 7fa6237fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa6240b38a0 0x7fa6240d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.931+0000 7fa6237fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa6240b38a0 0x7fa6240d2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48108/0 (socket says 172.21.15.123:48108) 2024-09-15T23:14:48.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.931+0000 7fa6237fe640 1 -- 172.21.15.123:0/19945038 learned_addr learned my addr 172.21.15.123:0/19945038 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:48.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.931+0000 7fa6237fe640 1 -- 172.21.15.123:0/19945038 >> v2:172.21.15.188:3300/0 conn(0x7fa6240b3350 msgr2=0x7fa6240d2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.931+0000 7fa6227fc640 1 --2- 172.21.15.123:0/19945038 >> v2:172.21.15.188:3300/0 conn(0x7fa6240b3350 0x7fa6240d2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.931+0000 7fa6237fe640 1 --2- 172.21.15.123:0/19945038 >> v2:172.21.15.188:3300/0 conn(0x7fa6240b3350 0x7fa6240d2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.931+0000 7fa6237fe640 1 -- 172.21.15.123:0/19945038 >> v1:172.21.15.188:6789/0 conn(0x7fa62406bfd0 legacy=0x7fa62406c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.931+0000 7fa6237fe640 1 -- 172.21.15.123:0/19945038 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6240cf9f0 con 0x7fa6240b38a0 2024-09-15T23:14:48.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.931+0000 7fa6227fc640 1 --2- 172.21.15.123:0/19945038 >> v2:172.21.15.188:3300/0 conn(0x7fa6240b3350 0x7fa6240d2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:48.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.932+0000 7fa6237fe640 1 --2- 172.21.15.123:0/19945038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6240b38a0 0x7fa6240d2e60 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa6240d05e0 tx=0x7fa61c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df885986633d2a28 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.932+0000 7fa621ffb640 1 -- 172.21.15.123:0/19945038 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa61c037070 con 0x7fa6240b38a0 2024-09-15T23:14:48.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.932+0000 7fa621ffb640 1 -- 172.21.15.123:0/19945038 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa61c032640 con 0x7fa6240b38a0 2024-09-15T23:14:48.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.932+0000 7fa621ffb640 1 -- 172.21.15.123:0/19945038 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa61c032a10 con 0x7fa6240b38a0 2024-09-15T23:14:48.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.932+0000 7fa629396640 1 -- 172.21.15.123:0/19945038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6240b38a0 msgr2=0x7fa6240d2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.932+0000 7fa629396640 1 --2- 172.21.15.123:0/19945038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6240b38a0 0x7fa6240d2e60 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa6240d05e0 tx=0x7fa61c02a300 comp rx=0 tx=0).stop 2024-09-15T23:14:48.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.932+0000 7fa629396640 1 -- 172.21.15.123:0/19945038 shutdown_connections 2024-09-15T23:14:48.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.932+0000 7fa629396640 1 --2- 172.21.15.123:0/19945038 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6240b38a0 0x7fa6240d2e60 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.932+0000 7fa629396640 1 --2- 172.21.15.123:0/19945038 >> v2:172.21.15.188:3300/0 conn(0x7fa6240b3350 0x7fa6240d2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.932+0000 7fa629396640 1 -- 172.21.15.123:0/19945038 >> 172.21.15.123:0/19945038 conn(0x7fa6240d11c0 msgr2=0x7fa6240d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.932+0000 7fa629396640 1 -- 172.21.15.123:0/19945038 shutdown_connections 2024-09-15T23:14:48.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.932+0000 7fa629396640 1 -- 172.21.15.123:0/19945038 wait complete. 2024-09-15T23:14:48.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.934+0000 7fa629396640 1 Processor -- start 2024-09-15T23:14:48.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.934+0000 7fa629396640 1 -- start start 2024-09-15T23:14:48.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.934+0000 7fa629396640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa62406bfd0 0x7fa624153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.934+0000 7fa629396640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa6240b3350 0x7fa6240ca830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.934+0000 7fa629396640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa6240b38a0 0x7fa62415fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.934+0000 7fa629396640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa62406cd50 con 0x7fa62406bfd0 2024-09-15T23:14:48.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.934+0000 7fa629396640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa6240d2400 con 0x7fa6240b3350 2024-09-15T23:14:48.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.934+0000 7fa629396640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa62415eae0 con 0x7fa6240b38a0 2024-09-15T23:14:48.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.935+0000 7fa622ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa62406bfd0 0x7fa624153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.935+0000 7fa622ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa62406bfd0 0x7fa624153a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48122/0 (socket says 172.21.15.123:48122) 2024-09-15T23:14:48.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.935+0000 7fa622ffd640 1 -- 172.21.15.123:0/2857334915 learned_addr learned my addr 172.21.15.123:0/2857334915 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:48.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.935+0000 7fa6227fc640 1 --2- 172.21.15.123:0/2857334915 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa6240b3350 0x7fa6240ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.935+0000 7fa6237fe640 1 --2- 172.21.15.123:0/2857334915 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa6240b38a0 0x7fa62415fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.935+0000 7fa622ffd640 1 -- 172.21.15.123:0/2857334915 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa6240b38a0 msgr2=0x7fa62415fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.935+0000 7fa622ffd640 1 --2- 172.21.15.123:0/2857334915 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa6240b38a0 0x7fa62415fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.935+0000 7fa622ffd640 1 -- 172.21.15.123:0/2857334915 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa6240b3350 msgr2=0x7fa6240ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.935+0000 7fa622ffd640 1 --2- 172.21.15.123:0/2857334915 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa6240b3350 0x7fa6240ca830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.935+0000 7fa622ffd640 1 -- 172.21.15.123:0/2857334915 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6240c9790 con 0x7fa62406bfd0 2024-09-15T23:14:48.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.935+0000 7fa622ffd640 1 --2- 172.21.15.123:0/2857334915 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa62406bfd0 0x7fa624153a10 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa61400c7c0 tx=0x7fa61400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.935+0000 7fa60b7fe640 1 -- 172.21.15.123:0/2857334915 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa614016020 con 0x7fa62406bfd0 2024-09-15T23:14:48.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.935+0000 7fa60b7fe640 1 -- 172.21.15.123:0/2857334915 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa61400aa50 con 0x7fa62406bfd0 2024-09-15T23:14:48.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.935+0000 7fa60b7fe640 1 -- 172.21.15.123:0/2857334915 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa614012420 con 0x7fa62406bfd0 2024-09-15T23:14:48.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.935+0000 7fa629396640 1 -- 172.21.15.123:0/2857334915 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6240c9a70 con 0x7fa62406bfd0 2024-09-15T23:14:48.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.935+0000 7fa629396640 1 -- 172.21.15.123:0/2857334915 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6240ca030 con 0x7fa62406bfd0 2024-09-15T23:14:48.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.937+0000 7fa60b7fe640 1 -- 172.21.15.123:0/2857334915 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa614019020 con 0x7fa62406bfd0 2024-09-15T23:14:48.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.937+0000 7fa60b7fe640 1 --2- 172.21.15.123:0/2857334915 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa61006c2b0 0x7fa61006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.937+0000 7fa60b7fe640 1 -- 172.21.15.123:0/2857334915 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7fa61408b010 con 0x7fa62406bfd0 2024-09-15T23:14:48.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.937+0000 7fa6227fc640 1 --2- 172.21.15.123:0/2857334915 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa61006c2b0 0x7fa61006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.938+0000 7fa6227fc640 1 --2- 172.21.15.123:0/2857334915 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa61006c2b0 0x7fa61006e770 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa6240d33e0 tx=0x7fa618008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.938+0000 7fa62c208740 1 Processor -- start 2024-09-15T23:14:48.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.938+0000 7fa62c208740 1 -- start start 2024-09-15T23:14:48.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.939+0000 7fa62c208740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb453907e0 0x55bb45390bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.939+0000 7fa62c208740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb4538bee0 0x55bb4538add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.939+0000 7fa62c208740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb4538dfa0 0x55bb4538b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.939+0000 7fa62c208740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55bb452f3710 con 0x55bb453907e0 2024-09-15T23:14:48.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.939+0000 7fa62c208740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55bb4529b540 con 0x55bb4538dfa0 2024-09-15T23:14:48.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.939+0000 7fa62c208740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55bb452ef6d0 con 0x55bb4538bee0 2024-09-15T23:14:48.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.939+0000 7fa622ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb453907e0 0x55bb45390bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.939+0000 7fa622ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb453907e0 0x55bb45390bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48130/0 (socket says 172.21.15.123:48130) 2024-09-15T23:14:48.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.939+0000 7fa622ffd640 1 -- 172.21.15.123:0/4264258202 learned_addr learned my addr 172.21.15.123:0/4264258202 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:48.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.939+0000 7fa6227fc640 1 --2- 172.21.15.123:0/4264258202 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb4538bee0 0x55bb4538add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.939+0000 7fa6237fe640 1 --2- 172.21.15.123:0/4264258202 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb4538dfa0 0x55bb4538b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.939+0000 7fa622ffd640 1 -- 172.21.15.123:0/4264258202 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb4538bee0 msgr2=0x55bb4538add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.939+0000 7fa622ffd640 1 --2- 172.21.15.123:0/4264258202 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb4538bee0 0x55bb4538add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.939+0000 7fa622ffd640 1 -- 172.21.15.123:0/4264258202 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb4538dfa0 msgr2=0x55bb4538b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.939+0000 7fa622ffd640 1 --2- 172.21.15.123:0/4264258202 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb4538dfa0 0x55bb4538b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.939+0000 7fa622ffd640 1 -- 172.21.15.123:0/4264258202 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb452c1170 con 0x55bb453907e0 2024-09-15T23:14:48.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.939+0000 7fa6227fc640 1 --2- 172.21.15.123:0/4264258202 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb4538bee0 0x55bb4538add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:48.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.939+0000 7fa6237fe640 1 --2- 172.21.15.123:0/4264258202 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb4538dfa0 0x55bb4538b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:48.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.939+0000 7fa622ffd640 1 --2- 172.21.15.123:0/4264258202 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb453907e0 0x55bb45390bc0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fa614055620 tx=0x7fa614059300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c3d083a84fe64a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.940+0000 7fa6097fa640 1 -- 172.21.15.123:0/4264258202 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa614087070 con 0x55bb453907e0 2024-09-15T23:14:48.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.940+0000 7fa6097fa640 1 -- 172.21.15.123:0/4264258202 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6140574c0 con 0x55bb453907e0 2024-09-15T23:14:48.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.940+0000 7fa6097fa640 1 -- 172.21.15.123:0/4264258202 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa614071070 con 0x55bb453907e0 2024-09-15T23:14:48.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.940+0000 7fa62c208740 1 -- 172.21.15.123:0/4264258202 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb453907e0 msgr2=0x55bb45390bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.940+0000 7fa62c208740 1 --2- 172.21.15.123:0/4264258202 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb453907e0 0x55bb45390bc0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fa614055620 tx=0x7fa614059300 comp rx=0 tx=0).stop 2024-09-15T23:14:48.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.940+0000 7fa62c208740 1 -- 172.21.15.123:0/4264258202 shutdown_connections 2024-09-15T23:14:48.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.940+0000 7fa62c208740 1 --2- 172.21.15.123:0/4264258202 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb4538dfa0 0x55bb4538b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.940+0000 7fa62c208740 1 --2- 172.21.15.123:0/4264258202 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb4538bee0 0x55bb4538add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.940+0000 7fa62c208740 1 --2- 172.21.15.123:0/4264258202 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb453907e0 0x55bb45390bc0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.940+0000 7fa62c208740 1 -- 172.21.15.123:0/4264258202 >> 172.21.15.123:0/4264258202 conn(0x55bb4538cfa0 msgr2=0x55bb453d5660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.940+0000 7fa62c208740 1 -- 172.21.15.123:0/4264258202 shutdown_connections 2024-09-15T23:14:48.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.940+0000 7fa62c208740 1 -- 172.21.15.123:0/4264258202 wait complete. 2024-09-15T23:14:48.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.941+0000 7fa62c208740 1 -- start start 2024-09-15T23:14:48.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.941+0000 7fa62c208740 1 Processor -- start 2024-09-15T23:14:48.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.942+0000 7fa62c208740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb4538dfa0 0x55bb453cff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.942+0000 7fa62c208740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb453907e0 0x55bb453d2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.942+0000 7fa62c208740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb453d2fe0 0x55bb453e51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.942+0000 7fa62c208740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55bb453bb070 con 0x55bb4538dfa0 2024-09-15T23:14:48.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.942+0000 7fa62c208740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55bb4527c660 con 0x55bb453d2fe0 2024-09-15T23:14:48.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.942+0000 7fa62c208740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55bb453d5d70 con 0x55bb453907e0 2024-09-15T23:14:48.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.942+0000 7fa62c208740 10 client.0 _ll_register_callbacks cb 0x55bb45005fa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:48.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.942+0000 7fa622ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb4538dfa0 0x55bb453cff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.942+0000 7fa622ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb4538dfa0 0x55bb453cff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48140/0 (socket says 172.21.15.123:48140) 2024-09-15T23:14:48.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.942+0000 7fa622ffd640 1 -- 172.21.15.123:0/2911527908 learned_addr learned my addr 172.21.15.123:0/2911527908 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:48.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.942+0000 7fa622ffd640 1 -- 172.21.15.123:0/2911527908 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb453907e0 msgr2=0x55bb453d2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.942+0000 7fa622ffd640 1 --2- 172.21.15.123:0/2911527908 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb453907e0 0x55bb453d2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.942+0000 7fa622ffd640 1 -- 172.21.15.123:0/2911527908 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb453d2fe0 msgr2=0x55bb453e51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.942+0000 7fa622ffd640 1 --2- 172.21.15.123:0/2911527908 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb453d2fe0 0x55bb453e51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.942+0000 7fa622ffd640 1 -- 172.21.15.123:0/2911527908 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb450067b0 con 0x55bb4538dfa0 2024-09-15T23:14:48.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.942+0000 7fa622ffd640 1 --2- 172.21.15.123:0/2911527908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb4538dfa0 0x55bb453cff40 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa61405d680 tx=0x7fa614003a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56dd59e2e0fc8451 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.942+0000 7fa601ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:48.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.942+0000 7fa601ffb640 1 -- 172.21.15.123:0/2911527908 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa614078060 con 0x55bb4538dfa0 2024-09-15T23:14:48.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.942+0000 7fa601ffb640 1 -- 172.21.15.123:0/2911527908 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7fa614055830 con 0x55bb4538dfa0 2024-09-15T23:14:48.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.942+0000 7fa62c208740 1 -- 172.21.15.123:0/2911527908 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6140574c0 con 0x55bb4538dfa0 2024-09-15T23:14:48.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.942+0000 7fa601ffb640 1 -- 172.21.15.123:0/2911527908 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa614087070 con 0x55bb4538dfa0 2024-09-15T23:14:48.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.942+0000 7fa62c208740 10 client.5580 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:48.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.942+0000 7fa62c208740 1 -- 172.21.15.123:0/2911527908 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55bb450d0b90 con 0x55bb4538dfa0 2024-09-15T23:14:48.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.942+0000 7fa601ffb640 1 -- 172.21.15.123:0/2911527908 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6140574c0 con 0x55bb4538dfa0 2024-09-15T23:14:48.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.943+0000 7fa601ffb640 1 -- 172.21.15.123:0/2911527908 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7fa614006b50 con 0x55bb4538dfa0 2024-09-15T23:14:48.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.943+0000 7fa62c208740 10 client.5580 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:48.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.943+0000 7fa62c208740 10 client.5580 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:48.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.943+0000 7fa62c208740 20 client.5580 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:48.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.943+0000 7fa62c208740 1 --2- 172.21.15.123:0/2911527908 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55bb453e5e30 0x55bb453cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.943+0000 7fa62c208740 4 client.5580 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:14:48.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.943+0000 7fa62c208740 1 -- 172.21.15.123:0/2911527908 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb45300e40 con 0x55bb453e5e30 2024-09-15T23:14:48.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.943+0000 7fa6227fc640 1 --2- 172.21.15.123:0/2911527908 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55bb453e5e30 0x55bb453cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.943+0000 7fa6227fc640 1 --2- 172.21.15.123:0/2911527908 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55bb453e5e30 0x55bb453cd180 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd9b57fd4cf44cf server_cookie=4fff6021ce04887c in_seq=0 out_seq=0 2024-09-15T23:14:48.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.943+0000 7fa601ffb640 10 client.5580 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:48.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.944+0000 7fa601ffb640 1 -- 172.21.15.123:0/2911527908 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bb45300e40 con 0x55bb453e5e30 2024-09-15T23:14:48.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.944+0000 7fa601ffb640 10 client.5580 handle_command_reply: tid=0 2024-09-15T23:14:48.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.944+0000 7fa62c208740 1 client.5580 shutdown 2024-09-15T23:14:48.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.944+0000 7fa62c208740 1 -- 172.21.15.123:0/2911527908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb4538dfa0 msgr2=0x55bb453cff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.944+0000 7fa62c208740 1 --2- 172.21.15.123:0/2911527908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb4538dfa0 0x55bb453cff40 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa61405d680 tx=0x7fa614003a70 comp rx=0 tx=0).stop 2024-09-15T23:14:48.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.944+0000 7fa62c208740 1 -- 172.21.15.123:0/2911527908 shutdown_connections 2024-09-15T23:14:48.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.944+0000 7fa62c208740 1 --2- 172.21.15.123:0/2911527908 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55bb453e5e30 0x55bb453cd180 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.944+0000 7fa62c208740 1 --2- 172.21.15.123:0/2911527908 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb453d2fe0 0x55bb453e51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.944+0000 7fa62c208740 1 --2- 172.21.15.123:0/2911527908 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb453907e0 0x55bb453d2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.944+0000 7fa601ffb640 0 client.5580 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:48.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.944+0000 7fa62c208740 1 --2- 172.21.15.123:0/2911527908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb4538dfa0 0x55bb453cff40 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.944+0000 7fa62c208740 1 -- 172.21.15.123:0/2911527908 >> 172.21.15.123:0/2911527908 conn(0x55bb4538bee0 msgr2=0x55bb453d6290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.944+0000 7fa62c208740 1 -- 172.21.15.123:0/2911527908 shutdown_connections 2024-09-15T23:14:48.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.944+0000 7fa62c208740 1 -- 172.21.15.123:0/2911527908 wait complete. 2024-09-15T23:14:48.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.944+0000 7fa62c208740 20 client.5580 trim_cache size 0 max 16384 2024-09-15T23:14:48.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.958+0000 7fa62c208740 1 Processor -- start 2024-09-15T23:14:48.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.958+0000 7fa62c208740 1 -- start start 2024-09-15T23:14:48.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.959+0000 7fa62c208740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb4538dfa0 0x55bb453cfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.959+0000 7fa62c208740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb453907e0 0x55bb453cd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.959+0000 7fa62c208740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb453d2fe0 0x55bb453cd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.959+0000 7fa62c208740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa624200b30 con 0x55bb453d2fe0 2024-09-15T23:14:48.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.959+0000 7fa62c208740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa6240c8b60 con 0x55bb4538dfa0 2024-09-15T23:14:48.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.959+0000 7fa62c208740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa6240cbf60 con 0x55bb453907e0 2024-09-15T23:14:48.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.959+0000 7fa6237fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb453d2fe0 0x55bb453cd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.959+0000 7fa6237fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb453d2fe0 0x55bb453cd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48142/0 (socket says 172.21.15.123:48142) 2024-09-15T23:14:48.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.959+0000 7fa6237fe640 1 -- 172.21.15.123:0/1439009961 learned_addr learned my addr 172.21.15.123:0/1439009961 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:48.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.959+0000 7fa622ffd640 1 --2- 172.21.15.123:0/1439009961 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb4538dfa0 0x55bb453cfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.959+0000 7fa6237fe640 1 -- 172.21.15.123:0/1439009961 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb453907e0 msgr2=0x55bb453cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.959+0000 7fa6237fe640 1 --2- 172.21.15.123:0/1439009961 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb453907e0 0x55bb453cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.960+0000 7fa6237fe640 1 -- 172.21.15.123:0/1439009961 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb4538dfa0 msgr2=0x55bb453cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.960+0000 7fa6237fe640 1 --2- 172.21.15.123:0/1439009961 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb4538dfa0 0x55bb453cfbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.960+0000 7fa6237fe640 1 -- 172.21.15.123:0/1439009961 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb453d1b50 con 0x55bb453d2fe0 2024-09-15T23:14:48.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.960+0000 7fa622ffd640 1 --2- 172.21.15.123:0/1439009961 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb4538dfa0 0x55bb453cfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:48.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.960+0000 7fa6237fe640 1 --2- 172.21.15.123:0/1439009961 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb453d2fe0 0x55bb453cd560 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0090b0 tx=0x7fa61c02c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd62d78ad2e13ea2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.960+0000 7fa608ff9640 1 -- 172.21.15.123:0/1439009961 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa61c042070 con 0x55bb453d2fe0 2024-09-15T23:14:48.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.960+0000 7fa608ff9640 1 -- 172.21.15.123:0/1439009961 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa61c004300 con 0x55bb453d2fe0 2024-09-15T23:14:48.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.960+0000 7fa608ff9640 1 -- 172.21.15.123:0/1439009961 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa61c037040 con 0x55bb453d2fe0 2024-09-15T23:14:48.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.960+0000 7fa62c208740 1 -- 172.21.15.123:0/1439009961 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb453d2fe0 msgr2=0x55bb453cd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.960+0000 7fa62c208740 1 --2- 172.21.15.123:0/1439009961 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb453d2fe0 0x55bb453cd560 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0090b0 tx=0x7fa61c02c070 comp rx=0 tx=0).stop 2024-09-15T23:14:48.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.960+0000 7fa62c208740 1 -- 172.21.15.123:0/1439009961 shutdown_connections 2024-09-15T23:14:48.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.960+0000 7fa62c208740 1 --2- 172.21.15.123:0/1439009961 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb453d2fe0 0x55bb453cd560 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.960+0000 7fa62c208740 1 --2- 172.21.15.123:0/1439009961 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb453907e0 0x55bb453cd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.960+0000 7fa62c208740 1 --2- 172.21.15.123:0/1439009961 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb4538dfa0 0x55bb453cfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.960+0000 7fa62c208740 1 -- 172.21.15.123:0/1439009961 >> 172.21.15.123:0/1439009961 conn(0x55bb4538bee0 msgr2=0x55bb453d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.960+0000 7fa62c208740 1 -- 172.21.15.123:0/1439009961 shutdown_connections 2024-09-15T23:14:48.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.960+0000 7fa62c208740 1 -- 172.21.15.123:0/1439009961 wait complete. 2024-09-15T23:14:48.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.961+0000 7fa62c208740 1 -- start start 2024-09-15T23:14:48.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.961+0000 7fa62c208740 1 Processor -- start 2024-09-15T23:14:48.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.962+0000 7fa62c208740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb4538dfa0 0x55bb453cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.962+0000 7fa62c208740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb453907e0 0x55bb453ba840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.962+0000 7fa62c208740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb453d2fe0 0x55bb454506d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.962+0000 7fa62c208740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa6240c8510 con 0x55bb453907e0 2024-09-15T23:14:48.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.962+0000 7fa62c208740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55bb453e4aa0 con 0x55bb4538dfa0 2024-09-15T23:14:48.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.962+0000 7fa62c208740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55bb4538f180 con 0x55bb453d2fe0 2024-09-15T23:14:48.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.962+0000 7fa62c208740 10 client.0 _ll_register_callbacks cb 0x7fa614085070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:48.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.962+0000 7fa6227fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb453907e0 0x55bb453ba840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.962+0000 7fa6227fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb453907e0 0x55bb453ba840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48158/0 (socket says 172.21.15.123:48158) 2024-09-15T23:14:48.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.962+0000 7fa6227fc640 1 -- 172.21.15.123:0/3055481188 learned_addr learned my addr 172.21.15.123:0/3055481188 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:48.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.962+0000 7fa622ffd640 1 --2- 172.21.15.123:0/3055481188 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb4538dfa0 0x55bb453cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.962+0000 7fa6237fe640 1 --2- 172.21.15.123:0/3055481188 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb453d2fe0 0x55bb454506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.962+0000 7fa6227fc640 1 -- 172.21.15.123:0/3055481188 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb453d2fe0 msgr2=0x55bb454506d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.962+0000 7fa6227fc640 1 --2- 172.21.15.123:0/3055481188 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb453d2fe0 0x55bb454506d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.962+0000 7fa6227fc640 1 -- 172.21.15.123:0/3055481188 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb4538dfa0 msgr2=0x55bb453cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:48.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.962+0000 7fa6227fc640 1 --2- 172.21.15.123:0/3055481188 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb4538dfa0 0x55bb453cb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.962+0000 7fa6227fc640 1 -- 172.21.15.123:0/3055481188 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb45453bb0 con 0x55bb453907e0 2024-09-15T23:14:48.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.962+0000 7fa6237fe640 1 --2- 172.21.15.123:0/3055481188 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb453d2fe0 0x55bb454506d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:48.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.962+0000 7fa6227fc640 1 --2- 172.21.15.123:0/3055481188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb453907e0 0x55bb453ba840 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x55bb453e5c60 tx=0x7fa61800fdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=786194593b207219 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:48.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.962+0000 7fa601ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:48.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.962+0000 7fa601ffb640 1 -- 172.21.15.123:0/3055481188 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa618030060 con 0x55bb453907e0 2024-09-15T23:14:48.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.962+0000 7fa601ffb640 1 -- 172.21.15.123:0/3055481188 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7fa618013460 con 0x55bb453907e0 2024-09-15T23:14:48.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.962+0000 7fa62c208740 1 -- 172.21.15.123:0/3055481188 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa61c004300 con 0x55bb453907e0 2024-09-15T23:14:48.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.962+0000 7fa601ffb640 1 -- 172.21.15.123:0/3055481188 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa618036050 con 0x55bb453907e0 2024-09-15T23:14:48.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.963+0000 7fa62c208740 10 client.5586 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:48.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.963+0000 7fa62c208740 1 -- 172.21.15.123:0/3055481188 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55bb4538ef20 con 0x55bb453907e0 2024-09-15T23:14:48.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.963+0000 7fa601ffb640 1 -- 172.21.15.123:0/3055481188 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa61c004300 con 0x55bb453907e0 2024-09-15T23:14:48.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.963+0000 7fa601ffb640 1 -- 172.21.15.123:0/3055481188 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7fa618039020 con 0x55bb453907e0 2024-09-15T23:14:48.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.963+0000 7fa62c208740 10 client.5586 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:48.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.963+0000 7fa62c208740 10 client.5586 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:48.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.963+0000 7fa62c208740 20 client.5586 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:48.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.963+0000 7fa62c208740 1 --2- 172.21.15.123:0/3055481188 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55bb4538e3d0 0x55bb4538e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:48.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.963+0000 7fa62c208740 4 client.5586 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_0"}] 2024-09-15T23:14:48.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.963+0000 7fa62c208740 1 -- 172.21.15.123:0/3055481188 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_0"}) -- 0x55bb452fb190 con 0x55bb4538e3d0 2024-09-15T23:14:48.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.963+0000 7fa622ffd640 1 --2- 172.21.15.123:0/3055481188 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55bb4538e3d0 0x55bb4538e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:48.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.963+0000 7fa601ffb640 10 client.5586 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:48.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.963+0000 7fa622ffd640 1 --2- 172.21.15.123:0/3055481188 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55bb4538e3d0 0x55bb4538e7b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55de4f6894e6cc62 server_cookie=5a3f01bed41ca161 in_seq=0 out_seq=0 2024-09-15T23:14:48.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.965+0000 7fa601ffb640 1 -- 172.21.15.123:0/3055481188 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bb452fb190 con 0x55bb4538e3d0 2024-09-15T23:14:48.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.965+0000 7fa601ffb640 10 client.5586 handle_command_reply: tid=0 2024-09-15T23:14:48.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.965+0000 7fa62c208740 1 client.5586 shutdown 2024-09-15T23:14:48.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.965+0000 7fa62c208740 1 -- 172.21.15.123:0/3055481188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb453907e0 msgr2=0x55bb453ba840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.965+0000 7fa62c208740 1 --2- 172.21.15.123:0/3055481188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb453907e0 0x55bb453ba840 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x55bb453e5c60 tx=0x7fa61800fdb0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.966+0000 7fa62c208740 1 -- 172.21.15.123:0/3055481188 shutdown_connections 2024-09-15T23:14:48.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.966+0000 7fa62c208740 1 --2- 172.21.15.123:0/3055481188 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55bb4538e3d0 0x55bb4538e7b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.966+0000 7fa62c208740 1 --2- 172.21.15.123:0/3055481188 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb453d2fe0 0x55bb454506d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.966+0000 7fa601ffb640 0 client.5586 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:48.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.966+0000 7fa62c208740 1 --2- 172.21.15.123:0/3055481188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb453907e0 0x55bb453ba840 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.966+0000 7fa62c208740 1 --2- 172.21.15.123:0/3055481188 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb4538dfa0 0x55bb453cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.966+0000 7fa62c208740 1 -- 172.21.15.123:0/3055481188 >> 172.21.15.123:0/3055481188 conn(0x55bb4538bee0 msgr2=0x55bb453e4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.966+0000 7fa62c208740 1 -- 172.21.15.123:0/3055481188 shutdown_connections 2024-09-15T23:14:48.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.966+0000 7fa62c208740 1 -- 172.21.15.123:0/3055481188 wait complete. 2024-09-15T23:14:48.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.966+0000 7fa62c208740 20 client.5586 trim_cache size 0 max 16384 2024-09-15T23:14:48.972 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:14:48.972 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "", 2024-09-15T23:14:48.972 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0 2024-09-15T23:14:48.972 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:14:48.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.966+0000 7fa629396640 1 -- 172.21.15.123:0/2857334915 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa61006c2b0 msgr2=0x7fa61006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.966+0000 7fa629396640 1 --2- 172.21.15.123:0/2857334915 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa61006c2b0 0x7fa61006e770 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa6240d33e0 tx=0x7fa618008040 comp rx=0 tx=0).stop 2024-09-15T23:14:48.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.966+0000 7fa629396640 1 -- 172.21.15.123:0/2857334915 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa62406bfd0 msgr2=0x7fa624153a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:48.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.966+0000 7fa629396640 1 --2- 172.21.15.123:0/2857334915 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa62406bfd0 0x7fa624153a10 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa61400c7c0 tx=0x7fa61400cc80 comp rx=0 tx=0).stop 2024-09-15T23:14:48.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.966+0000 7fa629396640 1 -- 172.21.15.123:0/2857334915 shutdown_connections 2024-09-15T23:14:48.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.966+0000 7fa629396640 1 --2- 172.21.15.123:0/2857334915 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa6240b38a0 0x7fa62415fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.966+0000 7fa629396640 1 --2- 172.21.15.123:0/2857334915 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa6240b3350 0x7fa6240ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.966+0000 7fa629396640 1 --2- 172.21.15.123:0/2857334915 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa61006c2b0 0x7fa61006e770 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.966+0000 7fa629396640 1 --2- 172.21.15.123:0/2857334915 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa62406bfd0 0x7fa624153a10 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:48.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.966+0000 7fa629396640 1 -- 172.21.15.123:0/2857334915 >> 172.21.15.123:0/2857334915 conn(0x7fa6240d11c0 msgr2=0x7fa6240b7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:48.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.966+0000 7fa629396640 1 -- 172.21.15.123:0/2857334915 shutdown_connections 2024-09-15T23:14:48.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:48.966+0000 7fa629396640 1 -- 172.21.15.123:0/2857334915 wait complete. 2024-09-15T23:14:48.978 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_0' returned '{'message': '', 'return_code': 0}' 2024-09-15T23:14:48.978 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:14:48.978 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:14:48.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:14:48.997 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_0 bs=1M conv=fdatasync count=1 seek=0) 2024-09-15T23:14:49.062 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:14:49.062 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:14:49.062 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759024 s, 138 MB/s 2024-09-15T23:14:49.062 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_0' 2024-09-15T23:14:49.063 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_file_0 2024-09-15T23:14:49.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.202+0000 7f820a28c640 1 Processor -- start 2024-09-15T23:14:49.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.202+0000 7f820a28c640 1 -- start start 2024-09-15T23:14:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.203+0000 7f820a28c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f820415b7c0 0x7f82040b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.203+0000 7f820a28c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f82040cead0 0x7f8204071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.203+0000 7f820a28c640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82040cf2e0 con 0x7f82040ccf30 2024-09-15T23:14:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.203+0000 7f820a28c640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f8204070fe0 con 0x7f820415b7c0 2024-09-15T23:14:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.203+0000 7f820a28c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f82040712c0 con 0x7f82040cead0 2024-09-15T23:14:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.203+0000 7f8203fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f82040ccf30 0x7f82040cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41118/0 (socket says 172.21.15.123:41118) 2024-09-15T23:14:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.203+0000 7f8203fff640 1 -- 172.21.15.123:0/2754571717 learned_addr learned my addr 172.21.15.123:0/2754571717 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.203+0000 7f82037fe640 1 --2- 172.21.15.123:0/2754571717 >> v2:172.21.15.123:3300/0 conn(0x7f820415b7c0 0x7f82040b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.203+0000 7f8208829640 1 --2- 172.21.15.123:0/2754571717 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f82040cead0 0x7f8204071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.203+0000 7f82037fe640 1 -- 172.21.15.123:0/2754571717 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f82040cead0 msgr2=0x7f8204071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.203+0000 7f82037fe640 1 --2- 172.21.15.123:0/2754571717 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f82040cead0 0x7f8204071ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.203+0000 7f82037fe640 1 -- 172.21.15.123:0/2754571717 >> v1:172.21.15.123:6789/0 conn(0x7f82040ccf30 legacy=0x7f82040cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.203+0000 7f8202ffd640 1 -- 172.21.15.123:0/2754571717 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3762125399 0 0) 0x7f82040cf2e0 con 0x7f82040ccf30 2024-09-15T23:14:49.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.203+0000 7f82037fe640 1 -- 172.21.15.123:0/2754571717 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82040715a0 con 0x7f820415b7c0 2024-09-15T23:14:49.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.203+0000 7f8208829640 1 --2- 172.21.15.123:0/2754571717 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f82040cead0 0x7f8204071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:49.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.204+0000 7f82037fe640 1 --2- 172.21.15.123:0/2754571717 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f820415b7c0 0x7f82040b2c50 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f81f80097a0 tx=0x7f81f802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7f68283120e30e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:49.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.204+0000 7f8202ffd640 1 -- 172.21.15.123:0/2754571717 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f8037070 con 0x7f820415b7c0 2024-09-15T23:14:49.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.204+0000 7f8202ffd640 1 -- 172.21.15.123:0/2754571717 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81f802ae50 con 0x7f820415b7c0 2024-09-15T23:14:49.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.204+0000 7f8202ffd640 1 -- 172.21.15.123:0/2754571717 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f8032660 con 0x7f820415b7c0 2024-09-15T23:14:49.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.205+0000 7f820a28c640 1 -- 172.21.15.123:0/2754571717 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f820415b7c0 msgr2=0x7f82040b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.205+0000 7f820a28c640 1 --2- 172.21.15.123:0/2754571717 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f820415b7c0 0x7f82040b2c50 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f81f80097a0 tx=0x7f81f802a100 comp rx=0 tx=0).stop 2024-09-15T23:14:49.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.205+0000 7f820a28c640 1 -- 172.21.15.123:0/2754571717 shutdown_connections 2024-09-15T23:14:49.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.205+0000 7f820a28c640 1 --2- 172.21.15.123:0/2754571717 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f82040cead0 0x7f8204071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.205+0000 7f820a28c640 1 --2- 172.21.15.123:0/2754571717 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f820415b7c0 0x7f82040b2c50 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.205+0000 7f820a28c640 1 -- 172.21.15.123:0/2754571717 >> 172.21.15.123:0/2754571717 conn(0x7f820406d0f0 msgr2=0x7f820406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:49.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.205+0000 7f820a28c640 1 -- 172.21.15.123:0/2754571717 shutdown_connections 2024-09-15T23:14:49.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.205+0000 7f820a28c640 1 -- 172.21.15.123:0/2754571717 wait complete. 2024-09-15T23:14:49.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.206+0000 7f820a28c640 1 Processor -- start 2024-09-15T23:14:49.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.206+0000 7f820a28c640 1 -- start start 2024-09-15T23:14:49.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.207+0000 7f820a28c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f82040ccf30 0x7f8204145d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.207+0000 7f820a28c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82040cead0 0x7f8204157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.207+0000 7f820a28c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f820415b7c0 0x7f82041576b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.207+0000 7f820a28c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f82040cf0c0 con 0x7f820415b7c0 2024-09-15T23:14:49.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.207+0000 7f820a28c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f82040cef40 con 0x7f82040cead0 2024-09-15T23:14:49.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.207+0000 7f820a28c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8204072000 con 0x7f82040ccf30 2024-09-15T23:14:49.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.207+0000 7f8208829640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f820415b7c0 0x7f82041576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.207+0000 7f8208829640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f820415b7c0 0x7f82041576b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48174/0 (socket says 172.21.15.123:48174) 2024-09-15T23:14:49.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.207+0000 7f8208829640 1 -- 172.21.15.123:0/3100695024 learned_addr learned my addr 172.21.15.123:0/3100695024 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:49.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.207+0000 7f8203fff640 1 --2- 172.21.15.123:0/3100695024 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f82040ccf30 0x7f8204145d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.207+0000 7f8208829640 1 -- 172.21.15.123:0/3100695024 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f82040ccf30 msgr2=0x7f8204145d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.207+0000 7f8208829640 1 --2- 172.21.15.123:0/3100695024 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f82040ccf30 0x7f8204145d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.207+0000 7f82037fe640 1 --2- 172.21.15.123:0/3100695024 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82040cead0 0x7f8204157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.207+0000 7f8208829640 1 -- 172.21.15.123:0/3100695024 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82040cead0 msgr2=0x7f8204157170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.207+0000 7f8208829640 1 --2- 172.21.15.123:0/3100695024 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82040cead0 0x7f8204157170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.207+0000 7f8208829640 1 -- 172.21.15.123:0/3100695024 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82041462a0 con 0x7f820415b7c0 2024-09-15T23:14:49.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.207+0000 7f8203fff640 1 --2- 172.21.15.123:0/3100695024 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f82040ccf30 0x7f8204145d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:49.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.207+0000 7f82037fe640 1 --2- 172.21.15.123:0/3100695024 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82040cead0 0x7f8204157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:49.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.207+0000 7f8208829640 1 --2- 172.21.15.123:0/3100695024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f820415b7c0 0x7f82041576b0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f81fc007ef0 tx=0x7f81fc00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:49.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.208+0000 7f8200ff9640 1 -- 172.21.15.123:0/3100695024 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81fc01a070 con 0x7f820415b7c0 2024-09-15T23:14:49.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.208+0000 7f8200ff9640 1 -- 172.21.15.123:0/3100695024 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81fc003b90 con 0x7f820415b7c0 2024-09-15T23:14:49.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.208+0000 7f820a28c640 1 -- 172.21.15.123:0/3100695024 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f820415c090 con 0x7f820415b7c0 2024-09-15T23:14:49.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.208+0000 7f8200ff9640 1 -- 172.21.15.123:0/3100695024 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81fc004030 con 0x7f820415b7c0 2024-09-15T23:14:49.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.208+0000 7f820a28c640 1 -- 172.21.15.123:0/3100695024 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f820415c650 con 0x7f820415b7c0 2024-09-15T23:14:49.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.209+0000 7f8200ff9640 1 -- 172.21.15.123:0/3100695024 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f81fc01d070 con 0x7f820415b7c0 2024-09-15T23:14:49.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.210+0000 7f8200ff9640 1 --2- 172.21.15.123:0/3100695024 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f81f006c2b0 0x7f81f006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.210+0000 7f8200ff9640 1 -- 172.21.15.123:0/3100695024 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7f81fc08b5c0 con 0x7f820415b7c0 2024-09-15T23:14:49.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.210+0000 7f8203fff640 1 --2- 172.21.15.123:0/3100695024 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f81f006c2b0 0x7f81f006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.210+0000 7f8203fff640 1 --2- 172.21.15.123:0/3100695024 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f81f006c2b0 0x7f81f006e770 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f81f4000f60 tx=0x7f81f4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:49.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.211+0000 7f820d025740 1 Processor -- start 2024-09-15T23:14:49.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.211+0000 7f820d025740 1 -- start start 2024-09-15T23:14:49.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.211+0000 7f820d025740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b012ec77e0 0x55b012ec7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.211+0000 7f820d025740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b012ec2ee0 0x55b012ec1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.211+0000 7f820d025740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b012ec4fa0 0x55b012ec2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.211+0000 7f820d025740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55b012e2a710 con 0x55b012ec77e0 2024-09-15T23:14:49.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.211+0000 7f820d025740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b012dd2540 con 0x55b012ec4fa0 2024-09-15T23:14:49.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.211+0000 7f820d025740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55b012e266d0 con 0x55b012ec2ee0 2024-09-15T23:14:49.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.211+0000 7f8203fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b012ec77e0 0x55b012ec7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.212+0000 7f8203fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b012ec77e0 0x55b012ec7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48184/0 (socket says 172.21.15.123:48184) 2024-09-15T23:14:49.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.212+0000 7f8203fff640 1 -- 172.21.15.123:0/3551305446 learned_addr learned my addr 172.21.15.123:0/3551305446 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:49.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.212+0000 7f8208829640 1 --2- 172.21.15.123:0/3551305446 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b012ec4fa0 0x55b012ec2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.212+0000 7f82037fe640 1 --2- 172.21.15.123:0/3551305446 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b012ec2ee0 0x55b012ec1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.212+0000 7f8203fff640 1 -- 172.21.15.123:0/3551305446 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b012ec2ee0 msgr2=0x55b012ec1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.212+0000 7f8203fff640 1 --2- 172.21.15.123:0/3551305446 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b012ec2ee0 0x55b012ec1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.212+0000 7f8203fff640 1 -- 172.21.15.123:0/3551305446 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b012ec4fa0 msgr2=0x55b012ec2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.212+0000 7f8203fff640 1 --2- 172.21.15.123:0/3551305446 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b012ec4fa0 0x55b012ec2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.212+0000 7f8203fff640 1 -- 172.21.15.123:0/3551305446 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b012df8170 con 0x55b012ec77e0 2024-09-15T23:14:49.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.212+0000 7f8203fff640 1 --2- 172.21.15.123:0/3551305446 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b012ec77e0 0x55b012ec7bc0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f81f4007390 tx=0x7f81f4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c12d151de8f2ece server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:49.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.212+0000 7f81e9ffb640 1 -- 172.21.15.123:0/3551305446 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f400dbb0 con 0x55b012ec77e0 2024-09-15T23:14:49.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.212+0000 7f81e9ffb640 1 -- 172.21.15.123:0/3551305446 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81f400dd50 con 0x55b012ec77e0 2024-09-15T23:14:49.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.212+0000 7f81e9ffb640 1 -- 172.21.15.123:0/3551305446 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f4020650 con 0x55b012ec77e0 2024-09-15T23:14:49.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.213+0000 7f820d025740 1 -- 172.21.15.123:0/3551305446 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b012ec77e0 msgr2=0x55b012ec7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.213+0000 7f820d025740 1 --2- 172.21.15.123:0/3551305446 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b012ec77e0 0x55b012ec7bc0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f81f4007390 tx=0x7f81f4010000 comp rx=0 tx=0).stop 2024-09-15T23:14:49.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.213+0000 7f820d025740 1 -- 172.21.15.123:0/3551305446 shutdown_connections 2024-09-15T23:14:49.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.213+0000 7f820d025740 1 --2- 172.21.15.123:0/3551305446 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b012ec4fa0 0x55b012ec2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.213+0000 7f820d025740 1 --2- 172.21.15.123:0/3551305446 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b012ec2ee0 0x55b012ec1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.213+0000 7f820d025740 1 --2- 172.21.15.123:0/3551305446 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b012ec77e0 0x55b012ec7bc0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.213+0000 7f820d025740 1 -- 172.21.15.123:0/3551305446 >> 172.21.15.123:0/3551305446 conn(0x55b012ec3fa0 msgr2=0x55b012f0c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:49.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.213+0000 7f820d025740 1 -- 172.21.15.123:0/3551305446 shutdown_connections 2024-09-15T23:14:49.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.213+0000 7f820d025740 1 -- 172.21.15.123:0/3551305446 wait complete. 2024-09-15T23:14:49.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.213+0000 7f820d025740 1 -- start start 2024-09-15T23:14:49.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.214+0000 7f820d025740 1 Processor -- start 2024-09-15T23:14:49.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.214+0000 7f820d025740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b012ec4fa0 0x55b012f09f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.214+0000 7f820d025740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b012ec77e0 0x55b012f07530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.214+0000 7f820d025740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b012f1a660 0x55b012f1cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.214+0000 7f820d025740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55b012ef2070 con 0x55b012ec4fa0 2024-09-15T23:14:49.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.214+0000 7f820d025740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b012db3660 con 0x55b012f1a660 2024-09-15T23:14:49.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.214+0000 7f820d025740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55b012f0cd70 con 0x55b012ec77e0 2024-09-15T23:14:49.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.214+0000 7f820d025740 10 client.0 _ll_register_callbacks cb 0x55b012b3cfa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:49.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.214+0000 7f8203fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b012ec4fa0 0x55b012f09f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.214+0000 7f8203fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b012ec4fa0 0x55b012f09f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48192/0 (socket says 172.21.15.123:48192) 2024-09-15T23:14:49.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.214+0000 7f8203fff640 1 -- 172.21.15.123:0/342162155 learned_addr learned my addr 172.21.15.123:0/342162155 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:49.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.215+0000 7f8208829640 1 --2- 172.21.15.123:0/342162155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b012f1a660 0x55b012f1cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.215+0000 7f82037fe640 1 --2- 172.21.15.123:0/342162155 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b012ec77e0 0x55b012f07530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.215+0000 7f8203fff640 1 -- 172.21.15.123:0/342162155 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b012ec77e0 msgr2=0x55b012f07530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.215+0000 7f8203fff640 1 --2- 172.21.15.123:0/342162155 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b012ec77e0 0x55b012f07530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.215+0000 7f8203fff640 1 -- 172.21.15.123:0/342162155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b012f1a660 msgr2=0x55b012f1cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.215+0000 7f8203fff640 1 --2- 172.21.15.123:0/342162155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b012f1a660 0x55b012f1cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.215+0000 7f8203fff640 1 -- 172.21.15.123:0/342162155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b012b3d7b0 con 0x55b012ec4fa0 2024-09-15T23:14:49.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.215+0000 7f8208829640 1 --2- 172.21.15.123:0/342162155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b012f1a660 0x55b012f1cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:49.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.215+0000 7f8203fff640 1 --2- 172.21.15.123:0/342162155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b012ec4fa0 0x55b012f09f10 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f81f4007da0 tx=0x7f81f4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=729a666623098948 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:49.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.215+0000 7f81e2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:49.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.215+0000 7f81e2ffd640 1 -- 172.21.15.123:0/342162155 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f40013d0 con 0x55b012ec4fa0 2024-09-15T23:14:49.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.215+0000 7f81e2ffd640 1 -- 172.21.15.123:0/342162155 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7f81f4022820 con 0x55b012ec4fa0 2024-09-15T23:14:49.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.215+0000 7f820d025740 1 -- 172.21.15.123:0/342162155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81f400dd50 con 0x55b012ec4fa0 2024-09-15T23:14:49.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.215+0000 7f81e2ffd640 1 -- 172.21.15.123:0/342162155 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f81f4035050 con 0x55b012ec4fa0 2024-09-15T23:14:49.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.215+0000 7f820d025740 10 client.5601 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:49.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.215+0000 7f820d025740 1 -- 172.21.15.123:0/342162155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55b012c07b90 con 0x55b012ec4fa0 2024-09-15T23:14:49.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.215+0000 7f81e2ffd640 1 -- 172.21.15.123:0/342162155 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81f400dd50 con 0x55b012ec4fa0 2024-09-15T23:14:49.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.215+0000 7f81e2ffd640 1 -- 172.21.15.123:0/342162155 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f81f4038020 con 0x55b012ec4fa0 2024-09-15T23:14:49.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.215+0000 7f820d025740 10 client.5601 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:49.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.215+0000 7f820d025740 10 client.5601 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:49.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.215+0000 7f820d025740 20 client.5601 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:49.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.216+0000 7f820d025740 1 --2- 172.21.15.123:0/342162155 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55b012f276f0 0x55b012f29ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.216+0000 7f820d025740 4 client.5601 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:14:49.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.216+0000 7f820d025740 1 -- 172.21.15.123:0/342162155 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b012e37e40 con 0x55b012f276f0 2024-09-15T23:14:49.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.216+0000 7f82037fe640 1 --2- 172.21.15.123:0/342162155 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55b012f276f0 0x55b012f29ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.216+0000 7f81e2ffd640 10 client.5601 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:49.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.216+0000 7f82037fe640 1 --2- 172.21.15.123:0/342162155 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55b012f276f0 0x55b012f29ae0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c23747776d8fe51a server_cookie=79bde9d8df9168d9 in_seq=0 out_seq=0 2024-09-15T23:14:49.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.217+0000 7f81e2ffd640 1 -- 172.21.15.123:0/342162155 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b012e37e40 con 0x55b012f276f0 2024-09-15T23:14:49.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.217+0000 7f81e2ffd640 10 client.5601 handle_command_reply: tid=0 2024-09-15T23:14:49.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.217+0000 7f820d025740 1 client.5601 shutdown 2024-09-15T23:14:49.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.217+0000 7f820d025740 1 -- 172.21.15.123:0/342162155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b012ec4fa0 msgr2=0x55b012f09f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.217+0000 7f820d025740 1 --2- 172.21.15.123:0/342162155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b012ec4fa0 0x55b012f09f10 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f81f4007da0 tx=0x7f81f4000ed0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.217+0000 7f820d025740 1 -- 172.21.15.123:0/342162155 shutdown_connections 2024-09-15T23:14:49.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.217+0000 7f820d025740 1 --2- 172.21.15.123:0/342162155 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55b012f276f0 0x55b012f29ae0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.217+0000 7f820d025740 1 --2- 172.21.15.123:0/342162155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b012f1a660 0x55b012f1cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.217+0000 7f820d025740 1 --2- 172.21.15.123:0/342162155 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b012ec77e0 0x55b012f07530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.217+0000 7f820d025740 1 --2- 172.21.15.123:0/342162155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b012ec4fa0 0x55b012f09f10 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.217+0000 7f81e2ffd640 0 client.5601 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:49.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.217+0000 7f820d025740 1 -- 172.21.15.123:0/342162155 >> 172.21.15.123:0/342162155 conn(0x55b012ec2ee0 msgr2=0x55b012f0d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:49.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.217+0000 7f820d025740 1 -- 172.21.15.123:0/342162155 shutdown_connections 2024-09-15T23:14:49.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.217+0000 7f820d025740 1 -- 172.21.15.123:0/342162155 wait complete. 2024-09-15T23:14:49.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.217+0000 7f820d025740 20 client.5601 trim_cache size 0 max 16384 2024-09-15T23:14:49.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.232+0000 7f820d025740 1 Processor -- start 2024-09-15T23:14:49.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.232+0000 7f820d025740 1 -- start start 2024-09-15T23:14:49.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.232+0000 7f820d025740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b012ec4fa0 0x55b012f19b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.232+0000 7f820d025740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b012ec77e0 0x55b012f84ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.232+0000 7f820d025740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b012f1a660 0x55b012f07d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.232+0000 7f820d025740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8204200a90 con 0x55b012f1a660 2024-09-15T23:14:49.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.232+0000 7f820d025740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f820414f730 con 0x55b012ec77e0 2024-09-15T23:14:49.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.232+0000 7f820d025740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f820415acd0 con 0x55b012ec4fa0 2024-09-15T23:14:49.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.232+0000 7f8208829640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b012f1a660 0x55b012f07d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.232+0000 7f8208829640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b012f1a660 0x55b012f07d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48196/0 (socket says 172.21.15.123:48196) 2024-09-15T23:14:49.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.232+0000 7f8208829640 1 -- 172.21.15.123:0/3850969457 learned_addr learned my addr 172.21.15.123:0/3850969457 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:49.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.233+0000 7f8208829640 1 -- 172.21.15.123:0/3850969457 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b012ec4fa0 msgr2=0x55b012f19b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.233+0000 7f8208829640 1 --2- 172.21.15.123:0/3850969457 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b012ec4fa0 0x55b012f19b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.233+0000 7f82037fe640 1 --2- 172.21.15.123:0/3850969457 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b012ec77e0 0x55b012f84ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.233+0000 7f8208829640 1 -- 172.21.15.123:0/3850969457 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b012ec77e0 msgr2=0x55b012f84ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.233+0000 7f8208829640 1 --2- 172.21.15.123:0/3850969457 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b012ec77e0 0x55b012f84ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.233+0000 7f8208829640 1 -- 172.21.15.123:0/3850969457 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b012e2cbb0 con 0x55b012f1a660 2024-09-15T23:14:49.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.233+0000 7f8208829640 1 --2- 172.21.15.123:0/3850969457 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b012f1a660 0x55b012f07d40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f81fc059470 tx=0x7f81fc060040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b758c1a76ac5c91 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:49.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.233+0000 7f81e97fa640 1 -- 172.21.15.123:0/3850969457 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81fc0592b0 con 0x55b012f1a660 2024-09-15T23:14:49.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.233+0000 7f81e97fa640 1 -- 172.21.15.123:0/3850969457 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81fc055de0 con 0x55b012f1a660 2024-09-15T23:14:49.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.233+0000 7f81e97fa640 1 -- 172.21.15.123:0/3850969457 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81fc059c10 con 0x55b012f1a660 2024-09-15T23:14:49.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.234+0000 7f820d025740 1 -- 172.21.15.123:0/3850969457 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b012f1a660 msgr2=0x55b012f07d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.234+0000 7f820d025740 1 --2- 172.21.15.123:0/3850969457 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b012f1a660 0x55b012f07d40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f81fc059470 tx=0x7f81fc060040 comp rx=0 tx=0).stop 2024-09-15T23:14:49.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.234+0000 7f820d025740 1 -- 172.21.15.123:0/3850969457 shutdown_connections 2024-09-15T23:14:49.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.234+0000 7f820d025740 1 --2- 172.21.15.123:0/3850969457 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b012f1a660 0x55b012f07d40 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.234+0000 7f820d025740 1 --2- 172.21.15.123:0/3850969457 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b012ec77e0 0x55b012f84ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.234+0000 7f820d025740 1 --2- 172.21.15.123:0/3850969457 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b012ec4fa0 0x55b012f19b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.234+0000 7f820d025740 1 -- 172.21.15.123:0/3850969457 >> 172.21.15.123:0/3850969457 conn(0x55b012ec2ee0 msgr2=0x55b012f0c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:49.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.234+0000 7f820d025740 1 -- 172.21.15.123:0/3850969457 shutdown_connections 2024-09-15T23:14:49.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.234+0000 7f820d025740 1 -- 172.21.15.123:0/3850969457 wait complete. 2024-09-15T23:14:49.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.234+0000 7f820d025740 1 -- start start 2024-09-15T23:14:49.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.234+0000 7f820d025740 1 Processor -- start 2024-09-15T23:14:49.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.235+0000 7f820d025740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b012ec4fa0 0x55b012f19960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.235+0000 7f820d025740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b012ec77e0 0x55b012f0dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.235+0000 7f820d025740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b012f1a660 0x55b012f739d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.235+0000 7f820d025740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55b012f09f60 con 0x55b012ec4fa0 2024-09-15T23:14:49.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.235+0000 7f820d025740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f820414f0e0 con 0x55b012f1a660 2024-09-15T23:14:49.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.235+0000 7f820d025740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55b012e640f0 con 0x55b012ec77e0 2024-09-15T23:14:49.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.235+0000 7f820d025740 10 client.0 _ll_register_callbacks cb 0x7f81fc00df00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:49.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.235+0000 7f8203fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b012ec4fa0 0x55b012f19960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.235+0000 7f8203fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b012ec4fa0 0x55b012f19960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48208/0 (socket says 172.21.15.123:48208) 2024-09-15T23:14:49.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.235+0000 7f8203fff640 1 -- 172.21.15.123:0/2116640046 learned_addr learned my addr 172.21.15.123:0/2116640046 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:49.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.235+0000 7f8208829640 1 --2- 172.21.15.123:0/2116640046 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b012f1a660 0x55b012f739d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.235+0000 7f8203fff640 1 -- 172.21.15.123:0/2116640046 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b012ec77e0 msgr2=0x55b012f0dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.235+0000 7f8203fff640 1 --2- 172.21.15.123:0/2116640046 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b012ec77e0 0x55b012f0dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.235+0000 7f8203fff640 1 -- 172.21.15.123:0/2116640046 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b012f1a660 msgr2=0x55b012f739d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.235+0000 7f8203fff640 1 --2- 172.21.15.123:0/2116640046 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b012f1a660 0x55b012f739d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.235+0000 7f8203fff640 1 -- 172.21.15.123:0/2116640046 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b012f0fad0 con 0x55b012ec4fa0 2024-09-15T23:14:49.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.236+0000 7f8203fff640 1 --2- 172.21.15.123:0/2116640046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b012ec4fa0 0x55b012f19960 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f81f4007c50 tx=0x7f81f4001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f15fe82259868b33 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:49.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.236+0000 7f81e2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:49.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.236+0000 7f81e2ffd640 1 -- 172.21.15.123:0/2116640046 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f40013d0 con 0x55b012ec4fa0 2024-09-15T23:14:49.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.236+0000 7f81e2ffd640 1 -- 172.21.15.123:0/2116640046 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7f81f40070d0 con 0x55b012ec4fa0 2024-09-15T23:14:49.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.236+0000 7f820d025740 1 -- 172.21.15.123:0/2116640046 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81fc055de0 con 0x55b012ec4fa0 2024-09-15T23:14:49.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.236+0000 7f81e2ffd640 1 -- 172.21.15.123:0/2116640046 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f81f4040050 con 0x55b012ec4fa0 2024-09-15T23:14:49.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.236+0000 7f820d025740 10 client.5607 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:49.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.236+0000 7f820d025740 1 -- 172.21.15.123:0/2116640046 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55b012f100f0 con 0x55b012ec4fa0 2024-09-15T23:14:49.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.236+0000 7f81e2ffd640 1 -- 172.21.15.123:0/2116640046 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81fc055de0 con 0x55b012ec4fa0 2024-09-15T23:14:49.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.236+0000 7f81e2ffd640 1 -- 172.21.15.123:0/2116640046 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f81f4043020 con 0x55b012ec4fa0 2024-09-15T23:14:49.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.236+0000 7f820d025740 10 client.5607 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:49.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.236+0000 7f820d025740 10 client.5607 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:49.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.236+0000 7f820d025740 20 client.5607 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:49.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.236+0000 7f820d025740 1 --2- 172.21.15.123:0/2116640046 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55b012f07c60 0x55b012f08080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.236+0000 7f820d025740 4 client.5607 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}] 2024-09-15T23:14:49.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.236+0000 7f820d025740 1 -- 172.21.15.123:0/2116640046 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}) -- 0x55b012ef40e0 con 0x55b012f07c60 2024-09-15T23:14:49.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.236+0000 7f82037fe640 1 --2- 172.21.15.123:0/2116640046 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55b012f07c60 0x55b012f08080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.237+0000 7f82037fe640 1 --2- 172.21.15.123:0/2116640046 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55b012f07c60 0x55b012f08080 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea60be854178e3fe server_cookie=e3005657ca4b76c6 in_seq=0 out_seq=0 2024-09-15T23:14:49.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.237+0000 7f81e2ffd640 10 client.5607 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:49.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.241+0000 7f81e2ffd640 1 -- 172.21.15.123:0/2116640046 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b012ef40e0 con 0x55b012f07c60 2024-09-15T23:14:49.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.241+0000 7f81e2ffd640 10 client.5607 handle_command_reply: tid=0 2024-09-15T23:14:49.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.241+0000 7f820d025740 1 client.5607 shutdown 2024-09-15T23:14:49.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.241+0000 7f820d025740 1 -- 172.21.15.123:0/2116640046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b012ec4fa0 msgr2=0x55b012f19960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.241+0000 7f820d025740 1 --2- 172.21.15.123:0/2116640046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b012ec4fa0 0x55b012f19960 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f81f4007c50 tx=0x7f81f4001080 comp rx=0 tx=0).stop 2024-09-15T23:14:49.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.241+0000 7f820d025740 1 -- 172.21.15.123:0/2116640046 shutdown_connections 2024-09-15T23:14:49.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.241+0000 7f820d025740 1 --2- 172.21.15.123:0/2116640046 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55b012f07c60 0x55b012f08080 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.241+0000 7f820d025740 1 --2- 172.21.15.123:0/2116640046 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b012f1a660 0x55b012f739d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.241+0000 7f81e2ffd640 0 client.5607 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:49.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.241+0000 7f820d025740 1 --2- 172.21.15.123:0/2116640046 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b012ec77e0 0x55b012f0dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.241+0000 7f820d025740 1 --2- 172.21.15.123:0/2116640046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b012ec4fa0 0x55b012f19960 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.241+0000 7f820d025740 1 -- 172.21.15.123:0/2116640046 >> 172.21.15.123:0/2116640046 conn(0x55b012ec2ee0 msgr2=0x55b012f0c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:49.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.241+0000 7f820d025740 1 -- 172.21.15.123:0/2116640046 shutdown_connections 2024-09-15T23:14:49.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.241+0000 7f820d025740 1 -- 172.21.15.123:0/2116640046 wait complete. 2024-09-15T23:14:49.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.241+0000 7f820d025740 20 client.5607 trim_cache size 0 max 16384 2024-09-15T23:14:49.245 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:14:49.245 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "", 2024-09-15T23:14:49.245 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0 2024-09-15T23:14:49.245 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:14:49.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.242+0000 7f820a28c640 1 -- 172.21.15.123:0/3100695024 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f81f006c2b0 msgr2=0x7f81f006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.242+0000 7f820a28c640 1 --2- 172.21.15.123:0/3100695024 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f81f006c2b0 0x7f81f006e770 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f81f4000f60 tx=0x7f81f4009040 comp rx=0 tx=0).stop 2024-09-15T23:14:49.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.242+0000 7f820a28c640 1 -- 172.21.15.123:0/3100695024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f820415b7c0 msgr2=0x7f82041576b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.242+0000 7f820a28c640 1 --2- 172.21.15.123:0/3100695024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f820415b7c0 0x7f82041576b0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f81fc007ef0 tx=0x7f81fc00d4a0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.242+0000 7f820a28c640 1 -- 172.21.15.123:0/3100695024 shutdown_connections 2024-09-15T23:14:49.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.242+0000 7f820a28c640 1 --2- 172.21.15.123:0/3100695024 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f81f006c2b0 0x7f81f006e770 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.242+0000 7f820a28c640 1 --2- 172.21.15.123:0/3100695024 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f820415b7c0 0x7f82041576b0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.242+0000 7f820a28c640 1 --2- 172.21.15.123:0/3100695024 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82040cead0 0x7f8204157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.242+0000 7f820a28c640 1 --2- 172.21.15.123:0/3100695024 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f82040ccf30 0x7f8204145d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.242+0000 7f820a28c640 1 -- 172.21.15.123:0/3100695024 >> 172.21.15.123:0/3100695024 conn(0x7f820406d0f0 msgr2=0x7f82040d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:49.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.242+0000 7f820a28c640 1 -- 172.21.15.123:0/3100695024 shutdown_connections 2024-09-15T23:14:49.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.242+0000 7f820a28c640 1 -- 172.21.15.123:0/3100695024 wait complete. 2024-09-15T23:14:49.253 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_0' returned '{'message': '', 'return_code': 0}' 2024-09-15T23:14:49.254 DEBUG:teuthology.orchestra.run.smithi123:> stdin-killer -- python3 -c ' 2024-09-15T23:14:49.254 DEBUG:teuthology.orchestra.run.smithi123:> import os 2024-09-15T23:14:49.254 DEBUG:teuthology.orchestra.run.smithi123:> import stat 2024-09-15T23:14:49.254 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-15T23:14:49.254 DEBUG:teuthology.orchestra.run.smithi123:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_0").st_ino) 2024-09-15T23:14:49.254 DEBUG:teuthology.orchestra.run.smithi123:> ' 2024-09-15T23:14:49.319 INFO:teuthology.orchestra.run.smithi123.stdout:1099511630412 2024-09-15T23:14:49.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:14:49.328 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-09-15T23:14:49.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.468+0000 7f537acac640 1 Processor -- start 2024-09-15T23:14:49.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.468+0000 7f537acac640 1 -- start start 2024-09-15T23:14:49.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.469+0000 7f537acac640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f53740b3350 0x7f53740d2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.469+0000 7f537acac640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f53740b38a0 0x7f53740d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.469+0000 7f537acac640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53740cf710 con 0x7f537406bfd0 2024-09-15T23:14:49.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.469+0000 7f537acac640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f53740b78a0 con 0x7f53740b3350 2024-09-15T23:14:49.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.469+0000 7f537acac640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f53740cffb0 con 0x7f53740b38a0 2024-09-15T23:14:49.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.469+0000 7f5373fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f53740b3350 0x7f53740d2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.469+0000 7f5379249640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f53740b38a0 0x7f53740d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.469+0000 7f5373fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f53740b3350 0x7f53740d2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:57782/0 (socket says 172.21.15.123:57782) 2024-09-15T23:14:49.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.469+0000 7f5373fff640 1 -- 172.21.15.123:0/1789768883 learned_addr learned my addr 172.21.15.123:0/1789768883 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:49.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.469+0000 7f5378a48640 1 --1- 172.21.15.123:0/1789768883 >> v1:172.21.15.188:6789/0 conn(0x7f537406bfd0 0x7f537406c3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:59708/0 (socket says 172.21.15.123:59708) 2024-09-15T23:14:49.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.469+0000 7f5373fff640 1 -- 172.21.15.123:0/1789768883 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f53740b38a0 msgr2=0x7f53740d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.469+0000 7f5373fff640 1 --2- 172.21.15.123:0/1789768883 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f53740b38a0 0x7f53740d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.469+0000 7f5373fff640 1 -- 172.21.15.123:0/1789768883 >> v1:172.21.15.188:6789/0 conn(0x7f537406bfd0 legacy=0x7f537406c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.469+0000 7f5373fff640 1 -- 172.21.15.123:0/1789768883 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53740cf9f0 con 0x7f53740b3350 2024-09-15T23:14:49.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.469+0000 7f53737fe640 1 -- 172.21.15.123:0/1789768883 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1491632233 0 0) 0x7f53740cf710 con 0x7f537406bfd0 2024-09-15T23:14:49.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.469+0000 7f5379249640 1 --2- 172.21.15.123:0/1789768883 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f53740b38a0 0x7f53740d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:14:49.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.470+0000 7f5373fff640 1 --2- 172.21.15.123:0/1789768883 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53740b3350 0x7f53740d2920 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5360009870 tx=0x7f536002a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a265074923f129de server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:49.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.470+0000 7f53737fe640 1 -- 172.21.15.123:0/1789768883 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5360037070 con 0x7f53740b3350 2024-09-15T23:14:49.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.470+0000 7f53737fe640 1 -- 172.21.15.123:0/1789768883 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f536002ae50 con 0x7f53740b3350 2024-09-15T23:14:49.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.470+0000 7f53737fe640 1 -- 172.21.15.123:0/1789768883 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5360032860 con 0x7f53740b3350 2024-09-15T23:14:49.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.471+0000 7f537acac640 1 -- 172.21.15.123:0/1789768883 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53740b3350 msgr2=0x7f53740d2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.471+0000 7f537acac640 1 --2- 172.21.15.123:0/1789768883 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53740b3350 0x7f53740d2920 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5360009870 tx=0x7f536002a300 comp rx=0 tx=0).stop 2024-09-15T23:14:49.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.471+0000 7f537acac640 1 -- 172.21.15.123:0/1789768883 shutdown_connections 2024-09-15T23:14:49.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.471+0000 7f537acac640 1 --2- 172.21.15.123:0/1789768883 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53740b3350 0x7f53740d2920 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.471+0000 7f537acac640 1 --2- 172.21.15.123:0/1789768883 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f53740b38a0 0x7f53740d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.471+0000 7f537acac640 1 -- 172.21.15.123:0/1789768883 >> 172.21.15.123:0/1789768883 conn(0x7f53740d11c0 msgr2=0x7f53740d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:49.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.471+0000 7f537acac640 1 -- 172.21.15.123:0/1789768883 shutdown_connections 2024-09-15T23:14:49.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.471+0000 7f537acac640 1 -- 172.21.15.123:0/1789768883 wait complete. 2024-09-15T23:14:49.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.472+0000 7f537acac640 1 Processor -- start 2024-09-15T23:14:49.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.472+0000 7f537acac640 1 -- start start 2024-09-15T23:14:49.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.473+0000 7f537acac640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f537406bfd0 0x7f53740b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.473+0000 7f537acac640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53740b3350 0x7f5374157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.473+0000 7f537acac640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f53740b38a0 0x7f5374158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.473+0000 7f537acac640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f537406cd50 con 0x7f537406bfd0 2024-09-15T23:14:49.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.473+0000 7f537acac640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f53740d2400 con 0x7f53740b3350 2024-09-15T23:14:49.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.473+0000 7f537acac640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f537415eae0 con 0x7f53740b38a0 2024-09-15T23:14:49.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.473+0000 7f5378a48640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f537406bfd0 0x7f53740b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.473+0000 7f5378a48640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f537406bfd0 0x7f53740b6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48214/0 (socket says 172.21.15.123:48214) 2024-09-15T23:14:49.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.473+0000 7f5378a48640 1 -- 172.21.15.123:0/2110222850 learned_addr learned my addr 172.21.15.123:0/2110222850 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:49.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.473+0000 7f5373fff640 1 --2- 172.21.15.123:0/2110222850 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53740b3350 0x7f5374157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.473+0000 7f5379249640 1 --2- 172.21.15.123:0/2110222850 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f53740b38a0 0x7f5374158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.473+0000 7f5378a48640 1 -- 172.21.15.123:0/2110222850 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f53740b38a0 msgr2=0x7f5374158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.473+0000 7f5378a48640 1 --2- 172.21.15.123:0/2110222850 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f53740b38a0 0x7f5374158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.473+0000 7f5378a48640 1 -- 172.21.15.123:0/2110222850 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53740b3350 msgr2=0x7f5374157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.473+0000 7f5378a48640 1 --2- 172.21.15.123:0/2110222850 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53740b3350 0x7f5374157f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.473+0000 7f5378a48640 1 -- 172.21.15.123:0/2110222850 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f537415a750 con 0x7f537406bfd0 2024-09-15T23:14:49.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.474+0000 7f5378a48640 1 --2- 172.21.15.123:0/2110222850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f537406bfd0 0x7f53740b6bf0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f536800c4d0 tx=0x7f536800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:49.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.474+0000 7f53717fa640 1 -- 172.21.15.123:0/2110222850 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53680074e0 con 0x7f537406bfd0 2024-09-15T23:14:49.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.474+0000 7f53717fa640 1 -- 172.21.15.123:0/2110222850 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53680047e0 con 0x7f537406bfd0 2024-09-15T23:14:49.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.474+0000 7f53717fa640 1 -- 172.21.15.123:0/2110222850 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5368004bd0 con 0x7f537406bfd0 2024-09-15T23:14:49.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.474+0000 7f537acac640 1 -- 172.21.15.123:0/2110222850 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5374159eb0 con 0x7f537406bfd0 2024-09-15T23:14:49.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.474+0000 7f537acac640 1 -- 172.21.15.123:0/2110222850 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f537415a470 con 0x7f537406bfd0 2024-09-15T23:14:49.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.475+0000 7f53717fa640 1 -- 172.21.15.123:0/2110222850 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5368011070 con 0x7f537406bfd0 2024-09-15T23:14:49.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.476+0000 7f53717fa640 1 --2- 172.21.15.123:0/2110222850 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f535806c2e0 0x7f535806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.476+0000 7f53717fa640 1 -- 172.21.15.123:0/2110222850 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7f536808aec0 con 0x7f537406bfd0 2024-09-15T23:14:49.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.476+0000 7f5373fff640 1 --2- 172.21.15.123:0/2110222850 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f535806c2e0 0x7f535806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.476+0000 7f5373fff640 1 --2- 172.21.15.123:0/2110222850 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f535806c2e0 0x7f535806e7a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5360034000 tx=0x7f536002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:49.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.477+0000 7f537da4c740 1 Processor -- start 2024-09-15T23:14:49.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.477+0000 7f537da4c740 1 -- start start 2024-09-15T23:14:49.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.477+0000 7f537da4c740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55da0f4f65d0 0x55da0f4f69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.477+0000 7f537da4c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da0f4f3d90 0x55da0f4f5920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.477+0000 7f537da4c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da0f4f41f0 0x55da0f4d6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.477+0000 7f537da4c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55da0f4125d0 con 0x55da0f4f3d90 2024-09-15T23:14:49.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.477+0000 7f537da4c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55da0f3ba470 con 0x55da0f4f41f0 2024-09-15T23:14:49.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.477+0000 7f537da4c740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55da0f40e590 con 0x55da0f4f65d0 2024-09-15T23:14:49.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.477+0000 7f5373fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da0f4f3d90 0x55da0f4f5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.478+0000 7f5373fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da0f4f3d90 0x55da0f4f5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48222/0 (socket says 172.21.15.123:48222) 2024-09-15T23:14:49.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.478+0000 7f5373fff640 1 -- 172.21.15.123:0/1720849377 learned_addr learned my addr 172.21.15.123:0/1720849377 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:49.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.478+0000 7f5379249640 1 --2- 172.21.15.123:0/1720849377 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da0f4f41f0 0x55da0f4d6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.478+0000 7f5378a48640 1 --2- 172.21.15.123:0/1720849377 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55da0f4f65d0 0x55da0f4f69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.478+0000 7f5373fff640 1 -- 172.21.15.123:0/1720849377 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55da0f4f65d0 msgr2=0x55da0f4f69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.478+0000 7f5373fff640 1 --2- 172.21.15.123:0/1720849377 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55da0f4f65d0 0x55da0f4f69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.478+0000 7f5373fff640 1 -- 172.21.15.123:0/1720849377 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da0f4f41f0 msgr2=0x55da0f4d6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.478+0000 7f5373fff640 1 --2- 172.21.15.123:0/1720849377 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da0f4f41f0 0x55da0f4d6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.478+0000 7f5373fff640 1 -- 172.21.15.123:0/1720849377 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da0f3a2860 con 0x55da0f4f3d90 2024-09-15T23:14:49.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.478+0000 7f5373fff640 1 --2- 172.21.15.123:0/1720849377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da0f4f3d90 0x55da0f4f5920 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f53600090b0 tx=0x7f536002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f74d15c7f006f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:49.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.478+0000 7f535e7fc640 1 -- 172.21.15.123:0/1720849377 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5360037040 con 0x55da0f4f3d90 2024-09-15T23:14:49.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.478+0000 7f535e7fc640 1 -- 172.21.15.123:0/1720849377 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f536004d070 con 0x55da0f4f3d90 2024-09-15T23:14:49.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.478+0000 7f535e7fc640 1 -- 172.21.15.123:0/1720849377 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5360003da0 con 0x55da0f4f3d90 2024-09-15T23:14:49.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.479+0000 7f537da4c740 1 -- 172.21.15.123:0/1720849377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da0f4f3d90 msgr2=0x55da0f4f5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.479+0000 7f537da4c740 1 --2- 172.21.15.123:0/1720849377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da0f4f3d90 0x55da0f4f5920 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f53600090b0 tx=0x7f536002c000 comp rx=0 tx=0).stop 2024-09-15T23:14:49.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.479+0000 7f537da4c740 1 -- 172.21.15.123:0/1720849377 shutdown_connections 2024-09-15T23:14:49.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.479+0000 7f537da4c740 1 --2- 172.21.15.123:0/1720849377 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da0f4f41f0 0x55da0f4d6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.479+0000 7f537da4c740 1 --2- 172.21.15.123:0/1720849377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da0f4f3d90 0x55da0f4f5920 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.479+0000 7f537da4c740 1 --2- 172.21.15.123:0/1720849377 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55da0f4f65d0 0x55da0f4f69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.479+0000 7f537da4c740 1 -- 172.21.15.123:0/1720849377 >> 172.21.15.123:0/1720849377 conn(0x55da0f4ac230 msgr2=0x55da0f4f4640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:49.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.479+0000 7f537da4c740 1 -- 172.21.15.123:0/1720849377 shutdown_connections 2024-09-15T23:14:49.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.479+0000 7f537da4c740 1 -- 172.21.15.123:0/1720849377 wait complete. 2024-09-15T23:14:49.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.479+0000 7f537da4c740 1 -- start start 2024-09-15T23:14:49.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.480+0000 7f537da4c740 1 Processor -- start 2024-09-15T23:14:49.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.480+0000 7f537da4c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da0f4f41f0 0x55da0f4eccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.480+0000 7f537da4c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da0f4f65d0 0x55da0f4d7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.480+0000 7f537da4c740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55da0f4eb6b0 0x55da0f4f11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.480+0000 7f537da4c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55da0f4f2cf0 con 0x55da0f4f41f0 2024-09-15T23:14:49.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.480+0000 7f537da4c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55da0f39b620 con 0x55da0f4f65d0 2024-09-15T23:14:49.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.480+0000 7f537da4c740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55da0f4f2fd0 con 0x55da0f4eb6b0 2024-09-15T23:14:49.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.480+0000 7f537da4c740 10 client.0 _ll_register_callbacks cb 0x55da0f3bf5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:49.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.480+0000 7f5378a48640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da0f4f41f0 0x55da0f4eccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.480+0000 7f5378a48640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da0f4f41f0 0x55da0f4eccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48232/0 (socket says 172.21.15.123:48232) 2024-09-15T23:14:49.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.480+0000 7f5378a48640 1 -- 172.21.15.123:0/3533788842 learned_addr learned my addr 172.21.15.123:0/3533788842 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:49.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.481+0000 7f5373fff640 1 --2- 172.21.15.123:0/3533788842 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da0f4f65d0 0x55da0f4d7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.481+0000 7f5379249640 1 --2- 172.21.15.123:0/3533788842 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55da0f4eb6b0 0x55da0f4f11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.481+0000 7f5378a48640 1 -- 172.21.15.123:0/3533788842 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55da0f4eb6b0 msgr2=0x55da0f4f11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.481+0000 7f5378a48640 1 --2- 172.21.15.123:0/3533788842 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55da0f4eb6b0 0x55da0f4f11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.481+0000 7f5378a48640 1 -- 172.21.15.123:0/3533788842 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da0f4f65d0 msgr2=0x55da0f4d7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.481+0000 7f5378a48640 1 --2- 172.21.15.123:0/3533788842 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da0f4f65d0 0x55da0f4d7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.481+0000 7f5378a48640 1 -- 172.21.15.123:0/3533788842 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da0f1253f0 con 0x55da0f4f41f0 2024-09-15T23:14:49.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.481+0000 7f5378a48640 1 --2- 172.21.15.123:0/3533788842 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da0f4f41f0 0x55da0f4eccf0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f5368058f50 tx=0x7f5368059800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1be4abaa141bc82 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:49.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.481+0000 7f53537fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:49.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.481+0000 7f53537fe640 1 -- 172.21.15.123:0/3533788842 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5368058410 con 0x55da0f4f41f0 2024-09-15T23:14:49.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.481+0000 7f53537fe640 1 -- 172.21.15.123:0/3533788842 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7f53680585b0 con 0x55da0f4f41f0 2024-09-15T23:14:49.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.481+0000 7f537da4c740 1 -- 172.21.15.123:0/3533788842 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f536004d070 con 0x55da0f4f41f0 2024-09-15T23:14:49.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.481+0000 7f53537fe640 1 -- 172.21.15.123:0/3533788842 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5368089120 con 0x55da0f4f41f0 2024-09-15T23:14:49.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.481+0000 7f537da4c740 10 client.5616 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:49.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.481+0000 7f537da4c740 1 -- 172.21.15.123:0/3533788842 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55da0f1ef7d0 con 0x55da0f4f41f0 2024-09-15T23:14:49.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.481+0000 7f53537fe640 1 -- 172.21.15.123:0/3533788842 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f536004d070 con 0x55da0f4f41f0 2024-09-15T23:14:49.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.481+0000 7f53537fe640 1 -- 172.21.15.123:0/3533788842 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f5368074030 con 0x55da0f4f41f0 2024-09-15T23:14:49.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.481+0000 7f537da4c740 10 client.5616 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:49.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.481+0000 7f537da4c740 10 client.5616 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:49.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.481+0000 7f537da4c740 20 client.5616 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:49.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.481+0000 7f537da4c740 1 --2- 172.21.15.123:0/3533788842 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55da0f5089f0 0x55da0f4d8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.481+0000 7f537da4c740 4 client.5616 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:14:49.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.481+0000 7f537da4c740 1 -- 172.21.15.123:0/3533788842 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da0f471030 con 0x55da0f5089f0 2024-09-15T23:14:49.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.482+0000 7f5373fff640 1 --2- 172.21.15.123:0/3533788842 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55da0f5089f0 0x55da0f4d8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.482+0000 7f53537fe640 10 client.5616 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:49.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.482+0000 7f5373fff640 1 --2- 172.21.15.123:0/3533788842 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55da0f5089f0 0x55da0f4d8d30 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f096eb7ec63e354 server_cookie=ed50ae9962aeca6f in_seq=0 out_seq=0 2024-09-15T23:14:49.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.483+0000 7f53537fe640 1 -- 172.21.15.123:0/3533788842 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55da0f471030 con 0x55da0f5089f0 2024-09-15T23:14:49.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.483+0000 7f53537fe640 10 client.5616 handle_command_reply: tid=0 2024-09-15T23:14:49.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.483+0000 7f537da4c740 1 client.5616 shutdown 2024-09-15T23:14:49.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.483+0000 7f537da4c740 1 -- 172.21.15.123:0/3533788842 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da0f4f41f0 msgr2=0x55da0f4eccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.483+0000 7f537da4c740 1 --2- 172.21.15.123:0/3533788842 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da0f4f41f0 0x55da0f4eccf0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f5368058f50 tx=0x7f5368059800 comp rx=0 tx=0).stop 2024-09-15T23:14:49.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.483+0000 7f537da4c740 1 -- 172.21.15.123:0/3533788842 shutdown_connections 2024-09-15T23:14:49.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.483+0000 7f537da4c740 1 --2- 172.21.15.123:0/3533788842 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55da0f5089f0 0x55da0f4d8d30 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.483+0000 7f537da4c740 1 --2- 172.21.15.123:0/3533788842 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55da0f4eb6b0 0x55da0f4f11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.483+0000 7f53537fe640 0 client.5616 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:49.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.483+0000 7f537da4c740 1 --2- 172.21.15.123:0/3533788842 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da0f4f65d0 0x55da0f4d7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.483+0000 7f537da4c740 1 --2- 172.21.15.123:0/3533788842 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da0f4f41f0 0x55da0f4eccf0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.483+0000 7f537da4c740 1 -- 172.21.15.123:0/3533788842 >> 172.21.15.123:0/3533788842 conn(0x55da0f4f3d90 msgr2=0x55da0f4d6320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:49.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.483+0000 7f537da4c740 1 -- 172.21.15.123:0/3533788842 shutdown_connections 2024-09-15T23:14:49.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.483+0000 7f537da4c740 1 -- 172.21.15.123:0/3533788842 wait complete. 2024-09-15T23:14:49.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.483+0000 7f537da4c740 20 client.5616 trim_cache size 0 max 16384 2024-09-15T23:14:49.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.496+0000 7f537da4c740 1 Processor -- start 2024-09-15T23:14:49.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.496+0000 7f537da4c740 1 -- start start 2024-09-15T23:14:49.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.497+0000 7f537da4c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da0f4eb6b0 0x55da0f4eac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.497+0000 7f537da4c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da0f4f41f0 0x55da0f4f5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.497+0000 7f537da4c740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55da0f4f65d0 0x55da0f4f5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.497+0000 7f537da4c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55da0f4f7300 con 0x55da0f4f41f0 2024-09-15T23:14:49.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.497+0000 7f537da4c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5374200790 con 0x55da0f4eb6b0 2024-09-15T23:14:49.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.497+0000 7f537da4c740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f53741ff770 con 0x55da0f4f65d0 2024-09-15T23:14:49.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.497+0000 7f5373fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da0f4f41f0 0x55da0f4f5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.497+0000 7f5373fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da0f4f41f0 0x55da0f4f5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48242/0 (socket says 172.21.15.123:48242) 2024-09-15T23:14:49.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.497+0000 7f5373fff640 1 -- 172.21.15.123:0/2088578495 learned_addr learned my addr 172.21.15.123:0/2088578495 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:49.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.497+0000 7f5378a48640 1 --2- 172.21.15.123:0/2088578495 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da0f4eb6b0 0x55da0f4eac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.497+0000 7f5379249640 1 --2- 172.21.15.123:0/2088578495 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55da0f4f65d0 0x55da0f4f5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.497+0000 7f5373fff640 1 -- 172.21.15.123:0/2088578495 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55da0f4f65d0 msgr2=0x55da0f4f5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.497+0000 7f5373fff640 1 --2- 172.21.15.123:0/2088578495 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55da0f4f65d0 0x55da0f4f5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.497+0000 7f5373fff640 1 -- 172.21.15.123:0/2088578495 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da0f4eb6b0 msgr2=0x55da0f4eac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.497+0000 7f5373fff640 1 --2- 172.21.15.123:0/2088578495 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da0f4eb6b0 0x55da0f4eac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.497+0000 7f5373fff640 1 -- 172.21.15.123:0/2088578495 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da0f4f6cd0 con 0x55da0f4f41f0 2024-09-15T23:14:49.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.497+0000 7f5379249640 1 --2- 172.21.15.123:0/2088578495 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55da0f4f65d0 0x55da0f4f5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:49.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.497+0000 7f5373fff640 1 --2- 172.21.15.123:0/2088578495 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da0f4f41f0 0x55da0f4f5740 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f5360035040 tx=0x7f5360009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e585524f91bf311 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:49.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.497+0000 7f535dffb640 1 -- 172.21.15.123:0/2088578495 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5360058070 con 0x55da0f4f41f0 2024-09-15T23:14:49.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.497+0000 7f535dffb640 1 -- 172.21.15.123:0/2088578495 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f536004d040 con 0x55da0f4f41f0 2024-09-15T23:14:49.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.497+0000 7f535dffb640 1 -- 172.21.15.123:0/2088578495 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5360037040 con 0x55da0f4f41f0 2024-09-15T23:14:49.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.498+0000 7f537da4c740 1 -- 172.21.15.123:0/2088578495 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da0f4f41f0 msgr2=0x55da0f4f5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.498+0000 7f537da4c740 1 --2- 172.21.15.123:0/2088578495 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da0f4f41f0 0x55da0f4f5740 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f5360035040 tx=0x7f5360009240 comp rx=0 tx=0).stop 2024-09-15T23:14:49.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.498+0000 7f537da4c740 1 -- 172.21.15.123:0/2088578495 shutdown_connections 2024-09-15T23:14:49.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.498+0000 7f537da4c740 1 --2- 172.21.15.123:0/2088578495 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55da0f4f65d0 0x55da0f4f5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.498+0000 7f537da4c740 1 --2- 172.21.15.123:0/2088578495 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da0f4f41f0 0x55da0f4f5740 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.498+0000 7f537da4c740 1 --2- 172.21.15.123:0/2088578495 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da0f4eb6b0 0x55da0f4eac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.498+0000 7f537da4c740 1 -- 172.21.15.123:0/2088578495 >> 172.21.15.123:0/2088578495 conn(0x55da0f4f3d90 msgr2=0x55da0f4d5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:49.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.498+0000 7f537da4c740 1 -- 172.21.15.123:0/2088578495 shutdown_connections 2024-09-15T23:14:49.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.498+0000 7f537da4c740 1 -- 172.21.15.123:0/2088578495 wait complete. 2024-09-15T23:14:49.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.499+0000 7f537da4c740 1 -- start start 2024-09-15T23:14:49.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.499+0000 7f537da4c740 1 Processor -- start 2024-09-15T23:14:49.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.500+0000 7f537da4c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da0f4eb6b0 0x55da0f572290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.500+0000 7f537da4c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da0f4f41f0 0x55da0f504b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.500+0000 7f537da4c740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55da0f4f65d0 0x55da0f4d9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.500+0000 7f537da4c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f53741ff100 con 0x55da0f4eb6b0 2024-09-15T23:14:49.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.500+0000 7f537da4c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f53740b56b0 con 0x55da0f4f41f0 2024-09-15T23:14:49.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.500+0000 7f537da4c740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55da0f4ac020 con 0x55da0f4f65d0 2024-09-15T23:14:49.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.500+0000 7f537da4c740 10 client.0 _ll_register_callbacks cb 0x7f5368058920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:49.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.500+0000 7f5378a48640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da0f4eb6b0 0x55da0f572290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.500+0000 7f5378a48640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da0f4eb6b0 0x55da0f572290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48256/0 (socket says 172.21.15.123:48256) 2024-09-15T23:14:49.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.500+0000 7f5378a48640 1 -- 172.21.15.123:0/4097629721 learned_addr learned my addr 172.21.15.123:0/4097629721 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:49.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.500+0000 7f5373fff640 1 --2- 172.21.15.123:0/4097629721 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da0f4f41f0 0x55da0f504b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.500+0000 7f5379249640 1 --2- 172.21.15.123:0/4097629721 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55da0f4f65d0 0x55da0f4d9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.500+0000 7f5378a48640 1 -- 172.21.15.123:0/4097629721 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55da0f4f65d0 msgr2=0x55da0f4d9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.500+0000 7f5378a48640 1 --2- 172.21.15.123:0/4097629721 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55da0f4f65d0 0x55da0f4d9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.500+0000 7f5378a48640 1 -- 172.21.15.123:0/4097629721 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da0f4f41f0 msgr2=0x55da0f504b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.500+0000 7f5378a48640 1 --2- 172.21.15.123:0/4097629721 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da0f4f41f0 0x55da0f504b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.500+0000 7f5378a48640 1 -- 172.21.15.123:0/4097629721 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da0f4f8040 con 0x55da0f4eb6b0 2024-09-15T23:14:49.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.500+0000 7f5379249640 1 --2- 172.21.15.123:0/4097629721 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55da0f4f65d0 0x55da0f4d9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:49.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.500+0000 7f5378a48640 1 --2- 172.21.15.123:0/4097629721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da0f4eb6b0 0x55da0f572290 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f5368059870 tx=0x7f536806f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e231e7876beabc2d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:49.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.500+0000 7f53537fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:49.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.500+0000 7f53537fe640 1 -- 172.21.15.123:0/4097629721 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5368058080 con 0x55da0f4eb6b0 2024-09-15T23:14:49.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.500+0000 7f53537fe640 1 -- 172.21.15.123:0/4097629721 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7f5368076aa0 con 0x55da0f4eb6b0 2024-09-15T23:14:49.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.500+0000 7f537da4c740 1 -- 172.21.15.123:0/4097629721 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f536004d040 con 0x55da0f4eb6b0 2024-09-15T23:14:49.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.500+0000 7f53537fe640 1 -- 172.21.15.123:0/4097629721 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5368058220 con 0x55da0f4eb6b0 2024-09-15T23:14:49.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.500+0000 7f537da4c740 10 client.5622 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:49.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.500+0000 7f537da4c740 1 -- 172.21.15.123:0/4097629721 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55da0f572860 con 0x55da0f4eb6b0 2024-09-15T23:14:49.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.500+0000 7f53537fe640 1 -- 172.21.15.123:0/4097629721 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f536004d040 con 0x55da0f4eb6b0 2024-09-15T23:14:49.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.501+0000 7f53537fe640 1 -- 172.21.15.123:0/4097629721 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f5368074070 con 0x55da0f4eb6b0 2024-09-15T23:14:49.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.501+0000 7f537da4c740 10 client.5622 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:49.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.501+0000 7f537da4c740 10 client.5622 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:49.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.501+0000 7f537da4c740 20 client.5622 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:49.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.501+0000 7f537da4c740 1 --2- 172.21.15.123:0/4097629721 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55da0f4eccf0 0x55da0f4f5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.501+0000 7f537da4c740 4 client.5622 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:14:49.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.501+0000 7f537da4c740 1 -- 172.21.15.123:0/4097629721 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55da0f41fd00 con 0x55da0f4eccf0 2024-09-15T23:14:49.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.501+0000 7f5373fff640 1 --2- 172.21.15.123:0/4097629721 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55da0f4eccf0 0x55da0f4f5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.501+0000 7f53537fe640 10 client.5622 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:49.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.501+0000 7f5373fff640 1 --2- 172.21.15.123:0/4097629721 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55da0f4eccf0 0x55da0f4f5740 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc920646bb6ffabc server_cookie=96aa5f9bbc2edd2f in_seq=0 out_seq=0 2024-09-15T23:14:49.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.501+0000 7f53537fe640 1 -- 172.21.15.123:0/4097629721 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55da0f41fd00 con 0x55da0f4eccf0 2024-09-15T23:14:49.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.501+0000 7f53537fe640 10 client.5622 handle_command_reply: tid=0 2024-09-15T23:14:49.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.501+0000 7f537da4c740 1 client.5622 shutdown 2024-09-15T23:14:49.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.501+0000 7f537da4c740 1 -- 172.21.15.123:0/4097629721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da0f4eb6b0 msgr2=0x55da0f572290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.501+0000 7f537da4c740 1 --2- 172.21.15.123:0/4097629721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da0f4eb6b0 0x55da0f572290 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f5368059870 tx=0x7f536806f040 comp rx=0 tx=0).stop 2024-09-15T23:14:49.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.501+0000 7f537da4c740 1 -- 172.21.15.123:0/4097629721 shutdown_connections 2024-09-15T23:14:49.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.501+0000 7f537da4c740 1 --2- 172.21.15.123:0/4097629721 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55da0f4eccf0 0x55da0f4f5740 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.501+0000 7f537da4c740 1 --2- 172.21.15.123:0/4097629721 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55da0f4f65d0 0x55da0f4d9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.501+0000 7f537da4c740 1 --2- 172.21.15.123:0/4097629721 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55da0f4f41f0 0x55da0f504b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.501+0000 7f53537fe640 0 client.5622 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:49.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.501+0000 7f537da4c740 1 --2- 172.21.15.123:0/4097629721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55da0f4eb6b0 0x55da0f572290 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.501+0000 7f537da4c740 1 -- 172.21.15.123:0/4097629721 >> 172.21.15.123:0/4097629721 conn(0x55da0f4f3d90 msgr2=0x55da0f4ee4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:49.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.502+0000 7f537da4c740 1 -- 172.21.15.123:0/4097629721 shutdown_connections 2024-09-15T23:14:49.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.502+0000 7f537da4c740 1 -- 172.21.15.123:0/4097629721 wait complete. 2024-09-15T23:14:49.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.502+0000 7f537da4c740 20 client.5622 trim_cache size 0 max 16384 2024-09-15T23:14:49.517 INFO:teuthology.orchestra.run.smithi123.stdout:[] 2024-09-15T23:14:49.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.502+0000 7f537acac640 1 -- 172.21.15.123:0/2110222850 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f535806c2e0 msgr2=0x7f535806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.502+0000 7f537acac640 1 --2- 172.21.15.123:0/2110222850 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f535806c2e0 0x7f535806e7a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5360034000 tx=0x7f536002e000 comp rx=0 tx=0).stop 2024-09-15T23:14:49.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.502+0000 7f537acac640 1 -- 172.21.15.123:0/2110222850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f537406bfd0 msgr2=0x7f53740b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.502+0000 7f537acac640 1 --2- 172.21.15.123:0/2110222850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f537406bfd0 0x7f53740b6bf0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f536800c4d0 tx=0x7f536800c8d0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.502+0000 7f537acac640 1 -- 172.21.15.123:0/2110222850 shutdown_connections 2024-09-15T23:14:49.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.502+0000 7f537acac640 1 --2- 172.21.15.123:0/2110222850 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f53740b38a0 0x7f5374158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.502+0000 7f537acac640 1 --2- 172.21.15.123:0/2110222850 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53740b3350 0x7f5374157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.502+0000 7f537acac640 1 --2- 172.21.15.123:0/2110222850 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f535806c2e0 0x7f535806e7a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.502+0000 7f537acac640 1 --2- 172.21.15.123:0/2110222850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f537406bfd0 0x7f53740b6bf0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.502+0000 7f537acac640 1 -- 172.21.15.123:0/2110222850 >> 172.21.15.123:0/2110222850 conn(0x7f53740d11c0 msgr2=0x7f537415f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:49.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.502+0000 7f537acac640 1 -- 172.21.15.123:0/2110222850 shutdown_connections 2024-09-15T23:14:49.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.502+0000 7f537acac640 1 -- 172.21.15.123:0/2110222850 wait complete. 2024-09-15T23:14:49.519 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data rmxattr 10000000a4c.00000000 parent 2024-09-15T23:14:49.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.562+0000 7f6805709f40 1 Processor -- start 2024-09-15T23:14:49.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.562+0000 7f6805709f40 1 -- start start 2024-09-15T23:14:49.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.563+0000 7f6805709f40 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555bf14d1560 0x555bf1544060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.563+0000 7f6805709f40 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555bf14d87b0 0x555bf14d7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.563+0000 7f6805709f40 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555bf15660a0 0x555bf15615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.563+0000 7f6805709f40 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x555bf13e2510 con 0x555bf14d1560 2024-09-15T23:14:49.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.563+0000 7f6805709f40 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x555bf143bc50 con 0x555bf15660a0 2024-09-15T23:14:49.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.563+0000 7f6805709f40 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x555bf14d1ca0 con 0x555bf14d87b0 2024-09-15T23:14:49.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.563+0000 7f68031ff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555bf14d1560 0x555bf1544060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.563+0000 7f68031ff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555bf14d1560 0x555bf1544060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48258/0 (socket says 172.21.15.123:48258) 2024-09-15T23:14:49.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.563+0000 7f68031ff640 1 -- 172.21.15.123:0/814073408 learned_addr learned my addr 172.21.15.123:0/814073408 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:49.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.563+0000 7f6803a00640 1 --2- 172.21.15.123:0/814073408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555bf15660a0 0x555bf15615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.563+0000 7f67fa9fe640 1 --2- 172.21.15.123:0/814073408 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555bf14d87b0 0x555bf14d7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.563+0000 7f68031ff640 1 -- 172.21.15.123:0/814073408 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555bf14d87b0 msgr2=0x555bf14d7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.563+0000 7f68031ff640 1 --2- 172.21.15.123:0/814073408 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555bf14d87b0 0x555bf14d7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.563+0000 7f68031ff640 1 -- 172.21.15.123:0/814073408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555bf15660a0 msgr2=0x555bf15615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.563+0000 7f68031ff640 1 --2- 172.21.15.123:0/814073408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555bf15660a0 0x555bf15615e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.563+0000 7f68031ff640 1 -- 172.21.15.123:0/814073408 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bf1559c40 con 0x555bf14d1560 2024-09-15T23:14:49.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.564+0000 7f68031ff640 1 --2- 172.21.15.123:0/814073408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555bf14d1560 0x555bf1544060 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f67f400b370 tx=0x7f67f400b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57649e86c0364844 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:49.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.564+0000 7f68021fd640 1 -- 172.21.15.123:0/814073408 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f4012020 con 0x555bf14d1560 2024-09-15T23:14:49.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.564+0000 7f68021fd640 1 -- 172.21.15.123:0/814073408 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67f400d690 con 0x555bf14d1560 2024-09-15T23:14:49.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.564+0000 7f68021fd640 1 -- 172.21.15.123:0/814073408 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f400da80 con 0x555bf14d1560 2024-09-15T23:14:49.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.564+0000 7f6805709f40 1 -- 172.21.15.123:0/814073408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555bf14d1560 msgr2=0x555bf1544060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.564+0000 7f6805709f40 1 --2- 172.21.15.123:0/814073408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555bf14d1560 0x555bf1544060 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f67f400b370 tx=0x7f67f400b830 comp rx=0 tx=0).stop 2024-09-15T23:14:49.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.564+0000 7f6805709f40 1 -- 172.21.15.123:0/814073408 shutdown_connections 2024-09-15T23:14:49.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.564+0000 7f6805709f40 1 --2- 172.21.15.123:0/814073408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555bf15660a0 0x555bf15615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.564+0000 7f6805709f40 1 --2- 172.21.15.123:0/814073408 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555bf14d87b0 0x555bf14d7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.564+0000 7f6805709f40 1 --2- 172.21.15.123:0/814073408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555bf14d1560 0x555bf1544060 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.564+0000 7f6805709f40 1 -- 172.21.15.123:0/814073408 >> 172.21.15.123:0/814073408 conn(0x555bf14dc830 msgr2=0x555bf1564eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:49.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.564+0000 7f6805709f40 1 -- 172.21.15.123:0/814073408 shutdown_connections 2024-09-15T23:14:49.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.564+0000 7f6805709f40 1 -- 172.21.15.123:0/814073408 wait complete. 2024-09-15T23:14:49.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.565+0000 7f6805709f40 1 Processor -- start 2024-09-15T23:14:49.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.565+0000 7f6805709f40 1 -- start start 2024-09-15T23:14:49.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.566+0000 7f6805709f40 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555bf14d1560 0x555bf1544130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.566+0000 7f6805709f40 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555bf14d87b0 0x555bf1491fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.566+0000 7f6805709f40 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555bf15660a0 0x555bf14924f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.566+0000 7f6805709f40 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x555bf1559780 con 0x555bf14d1560 2024-09-15T23:14:49.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.566+0000 7f6805709f40 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x555bf1562c70 con 0x555bf14d87b0 2024-09-15T23:14:49.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.566+0000 7f6805709f40 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x555bf14d6ec0 con 0x555bf15660a0 2024-09-15T23:14:49.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.566+0000 7f68031ff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555bf14d1560 0x555bf1544130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.566+0000 7f68031ff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555bf14d1560 0x555bf1544130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48260/0 (socket says 172.21.15.123:48260) 2024-09-15T23:14:49.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.566+0000 7f68031ff640 1 -- 172.21.15.123:0/1795220227 learned_addr learned my addr 172.21.15.123:0/1795220227 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:49.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.566+0000 7f67fa9fe640 1 --2- 172.21.15.123:0/1795220227 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555bf14d87b0 0x555bf1491fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.566+0000 7f6803a00640 1 --2- 172.21.15.123:0/1795220227 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555bf15660a0 0x555bf14924f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.566+0000 7f68031ff640 1 -- 172.21.15.123:0/1795220227 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555bf15660a0 msgr2=0x555bf14924f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.566+0000 7f68031ff640 1 --2- 172.21.15.123:0/1795220227 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555bf15660a0 0x555bf14924f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.566+0000 7f68031ff640 1 -- 172.21.15.123:0/1795220227 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555bf14d87b0 msgr2=0x555bf1491fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.566+0000 7f68031ff640 1 --2- 172.21.15.123:0/1795220227 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555bf14d87b0 0x555bf1491fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.566+0000 7f68031ff640 1 -- 172.21.15.123:0/1795220227 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bf155cb50 con 0x555bf14d1560 2024-09-15T23:14:49.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.566+0000 7f68031ff640 1 --2- 172.21.15.123:0/1795220227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555bf14d1560 0x555bf1544130 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f67f40017e0 tx=0x7f67f4001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:49.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.566+0000 7f68011fb640 1 -- 172.21.15.123:0/1795220227 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f4027070 con 0x555bf14d1560 2024-09-15T23:14:49.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.566+0000 7f68011fb640 1 -- 172.21.15.123:0/1795220227 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67f4001410 con 0x555bf14d1560 2024-09-15T23:14:49.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.566+0000 7f6805709f40 1 -- 172.21.15.123:0/1795220227 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555bf155ce30 con 0x555bf14d1560 2024-09-15T23:14:49.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.566+0000 7f68011fb640 1 -- 172.21.15.123:0/1795220227 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f400ea30 con 0x555bf14d1560 2024-09-15T23:14:49.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.566+0000 7f6805709f40 1 -- 172.21.15.123:0/1795220227 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bf1545590 con 0x555bf14d1560 2024-09-15T23:14:49.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.568+0000 7f68011fb640 1 -- 172.21.15.123:0/1795220227 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f67f402a070 con 0x555bf14d1560 2024-09-15T23:14:49.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.568+0000 7f68011fb640 1 --2- 172.21.15.123:0/1795220227 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f67e406ac90 0x7f67e406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.568+0000 7f68011fb640 1 -- 172.21.15.123:0/1795220227 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7f67f408b7e0 con 0x555bf14d1560 2024-09-15T23:14:49.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.568+0000 7f67fa9fe640 1 --2- 172.21.15.123:0/1795220227 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f67e406ac90 0x7f67e406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.568+0000 7f6805709f40 1 --2- 172.21.15.123:0/1795220227 >> [v2:172.21.15.188:6816/226100332,v1:172.21.15.188:6817/226100332] conn(0x555bf155c6c0 0x555bf1545fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.568+0000 7f6805709f40 1 -- 172.21.15.123:0/1795220227 --> [v2:172.21.15.188:6816/226100332,v1:172.21.15.188:6817/226100332] -- osd_op(unknown.0.0:1 7.3a 7:5fa3b718:::10000000a4c.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52) -- 0x555bf1561e10 con 0x555bf155c6c0 2024-09-15T23:14:49.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.569+0000 7f6803a00640 1 --2- 172.21.15.123:0/1795220227 >> [v2:172.21.15.188:6816/226100332,v1:172.21.15.188:6817/226100332] conn(0x555bf155c6c0 0x555bf1545fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.569+0000 7f67fa9fe640 1 --2- 172.21.15.123:0/1795220227 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f67e406ac90 0x7f67e406d150 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x555bf1547600 tx=0x7f67ec001810 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:49.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.569+0000 7f6803a00640 1 --2- 172.21.15.123:0/1795220227 >> [v2:172.21.15.188:6816/226100332,v1:172.21.15.188:6817/226100332] conn(0x555bf155c6c0 0x555bf1545fc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:49.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.570+0000 7f6803a00640 1 -- 172.21.15.123:0/1795220227 <== osd.6 v2:172.21.15.188:6816/226100332 1 ==== osd_op_reply(1 10000000a4c.00000000 [rmxattr] v52'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f67fc057030 con 0x555bf155c6c0 2024-09-15T23:14:49.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.570+0000 7f6805709f40 1 -- 172.21.15.123:0/1795220227 >> [v2:172.21.15.188:6816/226100332,v1:172.21.15.188:6817/226100332] conn(0x555bf155c6c0 msgr2=0x555bf1545fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.570+0000 7f6805709f40 1 --2- 172.21.15.123:0/1795220227 >> [v2:172.21.15.188:6816/226100332,v1:172.21.15.188:6817/226100332] conn(0x555bf155c6c0 0x555bf1545fc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.570+0000 7f6805709f40 1 -- 172.21.15.123:0/1795220227 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f67e406ac90 msgr2=0x7f67e406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.570+0000 7f6805709f40 1 --2- 172.21.15.123:0/1795220227 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f67e406ac90 0x7f67e406d150 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x555bf1547600 tx=0x7f67ec001810 comp rx=0 tx=0).stop 2024-09-15T23:14:49.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.570+0000 7f6805709f40 1 -- 172.21.15.123:0/1795220227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555bf14d1560 msgr2=0x555bf1544130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.570+0000 7f6805709f40 1 --2- 172.21.15.123:0/1795220227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555bf14d1560 0x555bf1544130 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f67f40017e0 tx=0x7f67f4001150 comp rx=0 tx=0).stop 2024-09-15T23:14:49.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.570+0000 7f6803a00640 1 -- 172.21.15.123:0/1795220227 reap_dead start 2024-09-15T23:14:49.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.570+0000 7f6805709f40 1 -- 172.21.15.123:0/1795220227 shutdown_connections 2024-09-15T23:14:49.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.570+0000 7f6805709f40 1 -- 172.21.15.123:0/1795220227 >> 172.21.15.123:0/1795220227 conn(0x555bf14dc830 msgr2=0x555bf15615e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:49.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.570+0000 7f6805709f40 1 -- 172.21.15.123:0/1795220227 shutdown_connections 2024-09-15T23:14:49.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.570+0000 7f6805709f40 1 -- 172.21.15.123:0/1795220227 wait complete. 2024-09-15T23:14:49.577 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_0' 2024-09-15T23:14:49.577 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/new_file_0 2024-09-15T23:14:49.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.680+0000 7f4e6e359640 1 Processor -- start 2024-09-15T23:14:49.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.681+0000 7f4e6e359640 1 -- start start 2024-09-15T23:14:49.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.681+0000 7f4e6e359640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4e6806de20 0x7f4e680d3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.681+0000 7f4e6e359640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4e680ba0d0 0x7f4e680b78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.681+0000 7f4e6e359640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e680d2f20 con 0x7f4e6815e950 2024-09-15T23:14:49.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.681+0000 7f4e6e359640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f4e680d3200 con 0x7f4e6806de20 2024-09-15T23:14:49.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.681+0000 7f4e6e359640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4e680d34e0 con 0x7f4e680ba0d0 2024-09-15T23:14:49.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.681+0000 7f4e67fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f4e6815e950 0x7f4e6806d710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41126/0 (socket says 172.21.15.123:41126) 2024-09-15T23:14:49.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.681+0000 7f4e67fff640 1 -- 172.21.15.123:0/2375338685 learned_addr learned my addr 172.21.15.123:0/2375338685 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:49.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.682+0000 7f4e677fe640 1 --2- 172.21.15.123:0/2375338685 >> v2:172.21.15.188:3300/0 conn(0x7f4e6806de20 0x7f4e680d3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.682+0000 7f4e6c8f6640 1 --2- 172.21.15.123:0/2375338685 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4e680ba0d0 0x7f4e680b78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.682+0000 7f4e66ffd640 1 -- 172.21.15.123:0/2375338685 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2382865895 0 0) 0x7f4e680d2f20 con 0x7f4e6815e950 2024-09-15T23:14:49.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.682+0000 7f4e66ffd640 1 -- 172.21.15.123:0/2375338685 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e50003520 con 0x7f4e6815e950 2024-09-15T23:14:49.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.682+0000 7f4e66ffd640 1 -- 172.21.15.123:0/2375338685 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2368477312 0 0) 0x7f4e50003520 con 0x7f4e6815e950 2024-09-15T23:14:49.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.682+0000 7f4e66ffd640 1 -- 172.21.15.123:0/2375338685 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4e680ba0d0 msgr2=0x7f4e680b78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.682+0000 7f4e66ffd640 1 --2- 172.21.15.123:0/2375338685 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4e680ba0d0 0x7f4e680b78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.682+0000 7f4e66ffd640 1 -- 172.21.15.123:0/2375338685 >> v2:172.21.15.188:3300/0 conn(0x7f4e6806de20 msgr2=0x7f4e680d3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.682+0000 7f4e66ffd640 1 --2- 172.21.15.123:0/2375338685 >> v2:172.21.15.188:3300/0 conn(0x7f4e6806de20 0x7f4e680d3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.682+0000 7f4e66ffd640 1 -- 172.21.15.123:0/2375338685 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e680d37c0 con 0x7f4e6815e950 2024-09-15T23:14:49.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.682+0000 7f4e66ffd640 1 -- 172.21.15.123:0/2375338685 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f4e58001670 con 0x7f4e6815e950 2024-09-15T23:14:49.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.682+0000 7f4e677fe640 1 --2- 172.21.15.123:0/2375338685 >> v2:172.21.15.188:3300/0 conn(0x7f4e6806de20 0x7f4e680d3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:14:49.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.682+0000 7f4e66ffd640 1 -- 172.21.15.123:0/2375338685 >> v1:172.21.15.123:6789/0 conn(0x7f4e6815e950 legacy=0x7f4e6806d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.682+0000 7f4e66ffd640 1 --2- 172.21.15.123:0/2375338685 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4e680ba0d0 0x7f4e500039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.682+0000 7f4e66ffd640 1 --2- 172.21.15.123:0/2375338685 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e50003f30 0x7f4e50004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.682+0000 7f4e66ffd640 1 --2- 172.21.15.123:0/2375338685 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4e50004d40 0x7f4e500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.682+0000 7f4e66ffd640 1 -- 172.21.15.123:0/2375338685 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4e680d3200 con 0x7f4e50003f30 2024-09-15T23:14:49.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.682+0000 7f4e66ffd640 1 -- 172.21.15.123:0/2375338685 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4e680d34e0 con 0x7f4e50004d40 2024-09-15T23:14:49.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.682+0000 7f4e66ffd640 1 -- 172.21.15.123:0/2375338685 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4e5000b9c0 con 0x7f4e680ba0d0 2024-09-15T23:14:49.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.682+0000 7f4e677fe640 1 --2- 172.21.15.123:0/2375338685 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e50003f30 0x7f4e50004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.682+0000 7f4e67fff640 1 --2- 172.21.15.123:0/2375338685 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4e680ba0d0 0x7f4e500039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.682+0000 7f4e6c8f6640 1 --2- 172.21.15.123:0/2375338685 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4e50004d40 0x7f4e500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.682+0000 7f4e677fe640 1 -- 172.21.15.123:0/2375338685 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4e680ba0d0 msgr2=0x7f4e500039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.682+0000 7f4e677fe640 1 --2- 172.21.15.123:0/2375338685 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4e680ba0d0 0x7f4e500039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.682+0000 7f4e677fe640 1 -- 172.21.15.123:0/2375338685 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4e50004d40 msgr2=0x7f4e500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.682+0000 7f4e677fe640 1 --2- 172.21.15.123:0/2375338685 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4e50004d40 0x7f4e500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.682+0000 7f4e677fe640 1 -- 172.21.15.123:0/2375338685 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e50003520 con 0x7f4e50003f30 2024-09-15T23:14:49.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.683+0000 7f4e677fe640 1 --2- 172.21.15.123:0/2375338685 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e50003f30 0x7f4e50004800 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c009c90 tx=0x7f4e50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=904e4dafc865e471 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:49.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.683+0000 7f4e66ffd640 1 -- 172.21.15.123:0/2375338685 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c036070 con 0x7f4e50003f30 2024-09-15T23:14:49.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.683+0000 7f4e66ffd640 1 -- 172.21.15.123:0/2375338685 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e5c031400 con 0x7f4e50003f30 2024-09-15T23:14:49.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.683+0000 7f4e66ffd640 1 -- 172.21.15.123:0/2375338685 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c009860 con 0x7f4e50003f30 2024-09-15T23:14:49.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.684+0000 7f4e6e359640 1 -- 172.21.15.123:0/2375338685 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e50003f30 msgr2=0x7f4e50004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.684+0000 7f4e6e359640 1 --2- 172.21.15.123:0/2375338685 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e50003f30 0x7f4e50004800 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c009c90 tx=0x7f4e50005830 comp rx=0 tx=0).stop 2024-09-15T23:14:49.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.684+0000 7f4e6c8f6640 1 -- 172.21.15.123:0/2375338685 reap_dead start 2024-09-15T23:14:49.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.684+0000 7f4e6e359640 1 -- 172.21.15.123:0/2375338685 shutdown_connections 2024-09-15T23:14:49.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.684+0000 7f4e6e359640 1 -- 172.21.15.123:0/2375338685 >> 172.21.15.123:0/2375338685 conn(0x7f4e680d4740 msgr2=0x7f4e680d4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:49.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.684+0000 7f4e6e359640 1 -- 172.21.15.123:0/2375338685 shutdown_connections 2024-09-15T23:14:49.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.684+0000 7f4e6e359640 1 -- 172.21.15.123:0/2375338685 wait complete. 2024-09-15T23:14:49.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.685+0000 7f4e6e359640 1 Processor -- start 2024-09-15T23:14:49.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.685+0000 7f4e6e359640 1 -- start start 2024-09-15T23:14:49.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.686+0000 7f4e6e359640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4e50003f30 0x7f4e68152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.686+0000 7f4e6e359640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4e680caec0 0x7f4e6815ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.686+0000 7f4e6e359640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e681604d0 0x7f4e680cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.686+0000 7f4e6e359640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4e680d2d00 con 0x7f4e681604d0 2024-09-15T23:14:49.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.686+0000 7f4e6e359640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4e680d2b80 con 0x7f4e680caec0 2024-09-15T23:14:49.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.686+0000 7f4e6e359640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4e680d2310 con 0x7f4e50003f30 2024-09-15T23:14:49.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.686+0000 7f4e6c8f6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e681604d0 0x7f4e680cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.686+0000 7f4e6c8f6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e681604d0 0x7f4e680cc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48276/0 (socket says 172.21.15.123:48276) 2024-09-15T23:14:49.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.686+0000 7f4e6c8f6640 1 -- 172.21.15.123:0/1132589594 learned_addr learned my addr 172.21.15.123:0/1132589594 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:49.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.686+0000 7f4e67fff640 1 --2- 172.21.15.123:0/1132589594 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4e50003f30 0x7f4e68152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.686+0000 7f4e677fe640 1 --2- 172.21.15.123:0/1132589594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4e680caec0 0x7f4e6815ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.686+0000 7f4e6c8f6640 1 -- 172.21.15.123:0/1132589594 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4e50003f30 msgr2=0x7f4e68152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.686+0000 7f4e6c8f6640 1 --2- 172.21.15.123:0/1132589594 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4e50003f30 0x7f4e68152100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.686+0000 7f4e6c8f6640 1 -- 172.21.15.123:0/1132589594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4e680caec0 msgr2=0x7f4e6815ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.686+0000 7f4e6c8f6640 1 --2- 172.21.15.123:0/1132589594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4e680caec0 0x7f4e6815ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.686+0000 7f4e6c8f6640 1 -- 172.21.15.123:0/1132589594 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e680ca100 con 0x7f4e681604d0 2024-09-15T23:14:49.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.686+0000 7f4e6c8f6640 1 --2- 172.21.15.123:0/1132589594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e681604d0 0x7f4e680cc2a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4e680b61e0 tx=0x7f4e6000f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:49.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.687+0000 7f4e64ff9640 1 -- 172.21.15.123:0/1132589594 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6000fc80 con 0x7f4e681604d0 2024-09-15T23:14:49.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.687+0000 7f4e64ff9640 1 -- 172.21.15.123:0/1132589594 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e6000fe20 con 0x7f4e681604d0 2024-09-15T23:14:49.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.687+0000 7f4e64ff9640 1 -- 172.21.15.123:0/1132589594 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e60015670 con 0x7f4e681604d0 2024-09-15T23:14:49.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.687+0000 7f4e6e359640 1 -- 172.21.15.123:0/1132589594 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e680ca3e0 con 0x7f4e681604d0 2024-09-15T23:14:49.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.687+0000 7f4e6e359640 1 -- 172.21.15.123:0/1132589594 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e680ccfb0 con 0x7f4e681604d0 2024-09-15T23:14:49.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.688+0000 7f4e64ff9640 1 -- 172.21.15.123:0/1132589594 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4e60015810 con 0x7f4e681604d0 2024-09-15T23:14:49.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.689+0000 7f4e64ff9640 1 --2- 172.21.15.123:0/1132589594 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4e5406c2b0 0x7f4e5406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.689+0000 7f4e64ff9640 1 -- 172.21.15.123:0/1132589594 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7f4e6008bff0 con 0x7f4e681604d0 2024-09-15T23:14:49.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.689+0000 7f4e67fff640 1 --2- 172.21.15.123:0/1132589594 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4e5406c2b0 0x7f4e5406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.690+0000 7f4e711d1740 1 Processor -- start 2024-09-15T23:14:49.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.690+0000 7f4e711d1740 1 -- start start 2024-09-15T23:14:49.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.690+0000 7f4e67fff640 1 --2- 172.21.15.123:0/1132589594 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4e5406c2b0 0x7f4e5406e770 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4e58001050 tx=0x7f4e58007970 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:49.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.690+0000 7f4e711d1740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5637ec456650 0x5637ec456a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.690+0000 7f4e711d1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5637ec453e10 0x5637ec4559a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.691+0000 7f4e711d1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5637ec454270 0x5637ec4365d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.691+0000 7f4e711d1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5637ec372c10 con 0x5637ec453e10 2024-09-15T23:14:49.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.691+0000 7f4e711d1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5637ec31a900 con 0x5637ec454270 2024-09-15T23:14:49.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.691+0000 7f4e711d1740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5637ec36ebd0 con 0x5637ec456650 2024-09-15T23:14:49.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.691+0000 7f4e677fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5637ec453e10 0x5637ec4559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.691+0000 7f4e677fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5637ec453e10 0x5637ec4559a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48288/0 (socket says 172.21.15.123:48288) 2024-09-15T23:14:49.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.691+0000 7f4e67fff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5637ec456650 0x5637ec456a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.691+0000 7f4e677fe640 1 -- 172.21.15.123:0/2346726996 learned_addr learned my addr 172.21.15.123:0/2346726996 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:49.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.691+0000 7f4e6c8f6640 1 --2- 172.21.15.123:0/2346726996 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5637ec454270 0x5637ec4365d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.691+0000 7f4e677fe640 1 -- 172.21.15.123:0/2346726996 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5637ec456650 msgr2=0x5637ec456a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.691+0000 7f4e677fe640 1 --2- 172.21.15.123:0/2346726996 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5637ec456650 0x5637ec456a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.691+0000 7f4e677fe640 1 -- 172.21.15.123:0/2346726996 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5637ec454270 msgr2=0x5637ec4365d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.691+0000 7f4e677fe640 1 --2- 172.21.15.123:0/2346726996 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5637ec454270 0x5637ec4365d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.691+0000 7f4e677fe640 1 -- 172.21.15.123:0/2346726996 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637ec151c00 con 0x5637ec453e10 2024-09-15T23:14:49.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.691+0000 7f4e677fe640 1 --2- 172.21.15.123:0/2346726996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5637ec453e10 0x5637ec4559a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c000c00 tx=0x7f4e5c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=952b909ae999825c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:49.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.691+0000 7f4e4dffb640 1 -- 172.21.15.123:0/2346726996 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c036040 con 0x5637ec453e10 2024-09-15T23:14:49.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.691+0000 7f4e4dffb640 1 -- 172.21.15.123:0/2346726996 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e5c045630 con 0x5637ec453e10 2024-09-15T23:14:49.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.691+0000 7f4e4dffb640 1 -- 172.21.15.123:0/2346726996 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c0459e0 con 0x5637ec453e10 2024-09-15T23:14:49.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.692+0000 7f4e711d1740 1 -- 172.21.15.123:0/2346726996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5637ec453e10 msgr2=0x5637ec4559a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.692+0000 7f4e711d1740 1 --2- 172.21.15.123:0/2346726996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5637ec453e10 0x5637ec4559a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c000c00 tx=0x7f4e5c02e000 comp rx=0 tx=0).stop 2024-09-15T23:14:49.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.692+0000 7f4e711d1740 1 -- 172.21.15.123:0/2346726996 shutdown_connections 2024-09-15T23:14:49.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.692+0000 7f4e711d1740 1 --2- 172.21.15.123:0/2346726996 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5637ec454270 0x5637ec4365d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.692+0000 7f4e711d1740 1 --2- 172.21.15.123:0/2346726996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5637ec453e10 0x5637ec4559a0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.692+0000 7f4e711d1740 1 --2- 172.21.15.123:0/2346726996 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5637ec456650 0x5637ec456a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.692+0000 7f4e711d1740 1 -- 172.21.15.123:0/2346726996 >> 172.21.15.123:0/2346726996 conn(0x5637ec40c2b0 msgr2=0x5637ec4546c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:49.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.692+0000 7f4e711d1740 1 -- 172.21.15.123:0/2346726996 shutdown_connections 2024-09-15T23:14:49.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.692+0000 7f4e711d1740 1 -- 172.21.15.123:0/2346726996 wait complete. 2024-09-15T23:14:49.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.692+0000 7f4e711d1740 1 -- start start 2024-09-15T23:14:49.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.693+0000 7f4e711d1740 1 Processor -- start 2024-09-15T23:14:49.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.693+0000 7f4e711d1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5637ec454270 0x5637ec434f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.693+0000 7f4e711d1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5637ec456650 0x5637ec450fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.693+0000 7f4e711d1740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5637ec44e090 0x5637ec4514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.693+0000 7f4e711d1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5637ec452d70 con 0x5637ec456650 2024-09-15T23:14:49.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.693+0000 7f4e711d1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5637ec2fb900 con 0x5637ec454270 2024-09-15T23:14:49.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.693+0000 7f4e711d1740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5637ec453050 con 0x5637ec44e090 2024-09-15T23:14:49.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.693+0000 7f4e711d1740 10 client.0 _ll_register_callbacks cb 0x5637ec084fe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:49.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.693+0000 7f4e677fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5637ec456650 0x5637ec450fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.694+0000 7f4e677fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5637ec456650 0x5637ec450fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48304/0 (socket says 172.21.15.123:48304) 2024-09-15T23:14:49.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.694+0000 7f4e677fe640 1 -- 172.21.15.123:0/2969391182 learned_addr learned my addr 172.21.15.123:0/2969391182 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:49.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.694+0000 7f4e67fff640 1 --2- 172.21.15.123:0/2969391182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5637ec454270 0x5637ec434f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.694+0000 7f4e6c8f6640 1 --2- 172.21.15.123:0/2969391182 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5637ec44e090 0x5637ec4514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.694+0000 7f4e677fe640 1 -- 172.21.15.123:0/2969391182 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5637ec44e090 msgr2=0x5637ec4514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.694+0000 7f4e677fe640 1 --2- 172.21.15.123:0/2969391182 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5637ec44e090 0x5637ec4514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.694+0000 7f4e677fe640 1 -- 172.21.15.123:0/2969391182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5637ec454270 msgr2=0x5637ec434f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.694+0000 7f4e677fe640 1 --2- 172.21.15.123:0/2969391182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5637ec454270 0x5637ec434f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.694+0000 7f4e677fe640 1 -- 172.21.15.123:0/2969391182 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637ec0454f0 con 0x5637ec456650 2024-09-15T23:14:49.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.694+0000 7f4e677fe640 1 --2- 172.21.15.123:0/2969391182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5637ec456650 0x5637ec450fa0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c009db0 tx=0x7f4e5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b5bc081bc093dd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:49.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.694+0000 7f4e46ffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:49.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.694+0000 7f4e46ffd640 1 -- 172.21.15.123:0/2969391182 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c036070 con 0x5637ec456650 2024-09-15T23:14:49.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.694+0000 7f4e46ffd640 1 -- 172.21.15.123:0/2969391182 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7f4e5c0459f0 con 0x5637ec456650 2024-09-15T23:14:49.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.694+0000 7f4e711d1740 1 -- 172.21.15.123:0/2969391182 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e5c045630 con 0x5637ec456650 2024-09-15T23:14:49.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.694+0000 7f4e46ffd640 1 -- 172.21.15.123:0/2969391182 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f4e5c057050 con 0x5637ec456650 2024-09-15T23:14:49.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.694+0000 7f4e711d1740 10 client.5643 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:49.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.694+0000 7f4e711d1740 1 -- 172.21.15.123:0/2969391182 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x5637ec1b2390 con 0x5637ec456650 2024-09-15T23:14:49.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.694+0000 7f4e46ffd640 1 -- 172.21.15.123:0/2969391182 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e5c045630 con 0x5637ec456650 2024-09-15T23:14:49.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.695+0000 7f4e46ffd640 1 -- 172.21.15.123:0/2969391182 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f4e5c05a020 con 0x5637ec456650 2024-09-15T23:14:49.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.695+0000 7f4e711d1740 10 client.5643 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:49.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.695+0000 7f4e711d1740 10 client.5643 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:49.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.695+0000 7f4e711d1740 20 client.5643 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:49.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.695+0000 7f4e711d1740 1 --2- 172.21.15.123:0/2969391182 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5637ec464520 0x5637ec464900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.695+0000 7f4e711d1740 4 client.5643 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:14:49.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.695+0000 7f4e711d1740 1 -- 172.21.15.123:0/2969391182 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637ec380340 con 0x5637ec464520 2024-09-15T23:14:49.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.695+0000 7f4e67fff640 1 --2- 172.21.15.123:0/2969391182 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5637ec464520 0x5637ec464900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.695+0000 7f4e46ffd640 10 client.5643 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:49.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.695+0000 7f4e67fff640 1 --2- 172.21.15.123:0/2969391182 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5637ec464520 0x5637ec464900 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c64944774f3a0b47 server_cookie=cb86b2eec28325b2 in_seq=0 out_seq=0 2024-09-15T23:14:49.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.696+0000 7f4e46ffd640 1 -- 172.21.15.123:0/2969391182 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5637ec380340 con 0x5637ec464520 2024-09-15T23:14:49.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.696+0000 7f4e46ffd640 10 client.5643 handle_command_reply: tid=0 2024-09-15T23:14:49.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.696+0000 7f4e711d1740 1 client.5643 shutdown 2024-09-15T23:14:49.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.696+0000 7f4e711d1740 1 -- 172.21.15.123:0/2969391182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5637ec456650 msgr2=0x5637ec450fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.696+0000 7f4e711d1740 1 --2- 172.21.15.123:0/2969391182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5637ec456650 0x5637ec450fa0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c009db0 tx=0x7f4e5c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.696+0000 7f4e711d1740 1 -- 172.21.15.123:0/2969391182 shutdown_connections 2024-09-15T23:14:49.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.696+0000 7f4e711d1740 1 --2- 172.21.15.123:0/2969391182 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5637ec464520 0x5637ec464900 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.696+0000 7f4e711d1740 1 --2- 172.21.15.123:0/2969391182 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5637ec44e090 0x5637ec4514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.696+0000 7f4e711d1740 1 --2- 172.21.15.123:0/2969391182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5637ec456650 0x5637ec450fa0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.696+0000 7f4e46ffd640 0 client.5643 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:49.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.696+0000 7f4e711d1740 1 --2- 172.21.15.123:0/2969391182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5637ec454270 0x5637ec434f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.696+0000 7f4e711d1740 1 -- 172.21.15.123:0/2969391182 >> 172.21.15.123:0/2969391182 conn(0x5637ec453e10 msgr2=0x5637ec457100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:49.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.696+0000 7f4e711d1740 1 -- 172.21.15.123:0/2969391182 shutdown_connections 2024-09-15T23:14:49.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.696+0000 7f4e711d1740 1 -- 172.21.15.123:0/2969391182 wait complete. 2024-09-15T23:14:49.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.696+0000 7f4e711d1740 20 client.5643 trim_cache size 0 max 16384 2024-09-15T23:14:49.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.713+0000 7f4e711d1740 1 Processor -- start 2024-09-15T23:14:49.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.713+0000 7f4e711d1740 1 -- start start 2024-09-15T23:14:49.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.714+0000 7f4e711d1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5637ec44e090 0x5637ec454840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.714+0000 7f4e711d1740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5637ec454270 0x5637ec44bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.714+0000 7f4e711d1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5637ec456650 0x5637ec44c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.714+0000 7f4e711d1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4e682013b0 con 0x5637ec456650 2024-09-15T23:14:49.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.714+0000 7f4e711d1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4e68200410 con 0x5637ec44e090 2024-09-15T23:14:49.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.714+0000 7f4e711d1740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4e68159180 con 0x5637ec454270 2024-09-15T23:14:49.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.714+0000 7f4e6c8f6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5637ec456650 0x5637ec44c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.714+0000 7f4e6c8f6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5637ec456650 0x5637ec44c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48306/0 (socket says 172.21.15.123:48306) 2024-09-15T23:14:49.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.714+0000 7f4e6c8f6640 1 -- 172.21.15.123:0/568156789 learned_addr learned my addr 172.21.15.123:0/568156789 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:49.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.714+0000 7f4e6c8f6640 1 -- 172.21.15.123:0/568156789 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5637ec454270 msgr2=0x5637ec44bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.714+0000 7f4e6c8f6640 1 --2- 172.21.15.123:0/568156789 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5637ec454270 0x5637ec44bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.714+0000 7f4e6c8f6640 1 -- 172.21.15.123:0/568156789 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5637ec44e090 msgr2=0x5637ec454840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.714+0000 7f4e6c8f6640 1 --2- 172.21.15.123:0/568156789 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5637ec44e090 0x5637ec454840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.714+0000 7f4e6c8f6640 1 -- 172.21.15.123:0/568156789 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637ec01e5b0 con 0x5637ec456650 2024-09-15T23:14:49.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.714+0000 7f4e6c8f6640 1 --2- 172.21.15.123:0/568156789 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5637ec456650 0x5637ec44c1c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4e6005a080 tx=0x7f4e600564c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ade0113febbc50 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:49.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.715+0000 7f4e4d7fa640 1 -- 172.21.15.123:0/568156789 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e600583f0 con 0x5637ec456650 2024-09-15T23:14:49.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.715+0000 7f4e4d7fa640 1 -- 172.21.15.123:0/568156789 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e60072030 con 0x5637ec456650 2024-09-15T23:14:49.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.715+0000 7f4e4d7fa640 1 -- 172.21.15.123:0/568156789 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6005e0c0 con 0x5637ec456650 2024-09-15T23:14:49.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.715+0000 7f4e711d1740 1 -- 172.21.15.123:0/568156789 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5637ec456650 msgr2=0x5637ec44c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.715+0000 7f4e711d1740 1 --2- 172.21.15.123:0/568156789 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5637ec456650 0x5637ec44c1c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4e6005a080 tx=0x7f4e600564c0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.715+0000 7f4e711d1740 1 -- 172.21.15.123:0/568156789 shutdown_connections 2024-09-15T23:14:49.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.715+0000 7f4e711d1740 1 --2- 172.21.15.123:0/568156789 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5637ec456650 0x5637ec44c1c0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.715+0000 7f4e711d1740 1 --2- 172.21.15.123:0/568156789 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5637ec454270 0x5637ec44bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.715+0000 7f4e711d1740 1 --2- 172.21.15.123:0/568156789 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5637ec44e090 0x5637ec454840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.715+0000 7f4e711d1740 1 -- 172.21.15.123:0/568156789 >> 172.21.15.123:0/568156789 conn(0x5637ec453e10 msgr2=0x5637ec44fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:49.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.715+0000 7f4e711d1740 1 -- 172.21.15.123:0/568156789 shutdown_connections 2024-09-15T23:14:49.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.715+0000 7f4e711d1740 1 -- 172.21.15.123:0/568156789 wait complete. 2024-09-15T23:14:49.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.716+0000 7f4e711d1740 1 -- start start 2024-09-15T23:14:49.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.716+0000 7f4e711d1740 1 Processor -- start 2024-09-15T23:14:49.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.717+0000 7f4e711d1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5637ec44e090 0x5637ec4c2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.717+0000 7f4e711d1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5637ec454270 0x5637ec4be7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.717+0000 7f4e711d1740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5637ec456650 0x5637ec40f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.717+0000 7f4e711d1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5637ec450350 con 0x5637ec454270 2024-09-15T23:14:49.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.717+0000 7f4e711d1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4e681ffdf0 con 0x5637ec44e090 2024-09-15T23:14:49.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.717+0000 7f4e711d1740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5637ec44e470 con 0x5637ec456650 2024-09-15T23:14:49.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.717+0000 7f4e711d1740 10 client.0 _ll_register_callbacks cb 0x7f4e5c03f050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:49.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.717+0000 7f4e677fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5637ec454270 0x5637ec4be7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.717+0000 7f4e677fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5637ec454270 0x5637ec4be7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48318/0 (socket says 172.21.15.123:48318) 2024-09-15T23:14:49.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.717+0000 7f4e677fe640 1 -- 172.21.15.123:0/3837062196 learned_addr learned my addr 172.21.15.123:0/3837062196 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:49.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.717+0000 7f4e67fff640 1 --2- 172.21.15.123:0/3837062196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5637ec44e090 0x5637ec4c2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.717+0000 7f4e6c8f6640 1 --2- 172.21.15.123:0/3837062196 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5637ec456650 0x5637ec40f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.717+0000 7f4e677fe640 1 -- 172.21.15.123:0/3837062196 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5637ec456650 msgr2=0x5637ec40f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.717+0000 7f4e677fe640 1 --2- 172.21.15.123:0/3837062196 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5637ec456650 0x5637ec40f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.717+0000 7f4e677fe640 1 -- 172.21.15.123:0/3837062196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5637ec44e090 msgr2=0x5637ec4c2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.717+0000 7f4e677fe640 1 --2- 172.21.15.123:0/3837062196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5637ec44e090 0x5637ec4c2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.717+0000 7f4e677fe640 1 -- 172.21.15.123:0/3837062196 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637ec463070 con 0x5637ec454270 2024-09-15T23:14:49.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.717+0000 7f4e677fe640 1 --2- 172.21.15.123:0/3837062196 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5637ec454270 0x5637ec4be7e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c02ad90 tx=0x7f4e5c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37337cf24dd2f185 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:49.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.717+0000 7f4e46ffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:49.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.717+0000 7f4e46ffd640 1 -- 172.21.15.123:0/3837062196 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c036030 con 0x5637ec454270 2024-09-15T23:14:49.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.717+0000 7f4e46ffd640 1 -- 172.21.15.123:0/3837062196 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7f4e5c005ba0 con 0x5637ec454270 2024-09-15T23:14:49.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.717+0000 7f4e711d1740 1 -- 172.21.15.123:0/3837062196 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e60072030 con 0x5637ec454270 2024-09-15T23:14:49.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.718+0000 7f4e46ffd640 1 -- 172.21.15.123:0/3837062196 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f4e5c045c40 con 0x5637ec454270 2024-09-15T23:14:49.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.718+0000 7f4e711d1740 10 client.5649 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:49.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.718+0000 7f4e711d1740 1 -- 172.21.15.123:0/3837062196 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x5637ec463070 con 0x5637ec454270 2024-09-15T23:14:49.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.718+0000 7f4e46ffd640 1 -- 172.21.15.123:0/3837062196 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e60072030 con 0x5637ec454270 2024-09-15T23:14:49.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.718+0000 7f4e46ffd640 1 -- 172.21.15.123:0/3837062196 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f4e5c05a040 con 0x5637ec454270 2024-09-15T23:14:49.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.718+0000 7f4e711d1740 10 client.5649 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:49.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.718+0000 7f4e711d1740 10 client.5649 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:49.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.718+0000 7f4e711d1740 20 client.5649 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:49.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.718+0000 7f4e711d1740 1 --2- 172.21.15.123:0/3837062196 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5637ec454e50 0x5637ec40fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.718+0000 7f4e711d1740 4 client.5649 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}] 2024-09-15T23:14:49.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.718+0000 7f4e711d1740 1 -- 172.21.15.123:0/3837062196 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}) -- 0x5637ec37a690 con 0x5637ec454e50 2024-09-15T23:14:49.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.718+0000 7f4e67fff640 1 --2- 172.21.15.123:0/3837062196 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5637ec454e50 0x5637ec40fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.718+0000 7f4e46ffd640 10 client.5649 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:49.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.718+0000 7f4e67fff640 1 --2- 172.21.15.123:0/3837062196 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5637ec454e50 0x5637ec40fe40 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23e1be3463963f22 server_cookie=1b42de0818f2e593 in_seq=0 out_seq=0 2024-09-15T23:14:49.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.719+0000 7f4e46ffd640 1 -- 172.21.15.123:0/3837062196 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5637ec37a690 con 0x5637ec454e50 2024-09-15T23:14:49.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.719+0000 7f4e46ffd640 10 client.5649 handle_command_reply: tid=0 2024-09-15T23:14:49.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.719+0000 7f4e711d1740 1 client.5649 shutdown 2024-09-15T23:14:49.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.719+0000 7f4e711d1740 1 -- 172.21.15.123:0/3837062196 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5637ec454270 msgr2=0x5637ec4be7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.719+0000 7f4e711d1740 1 --2- 172.21.15.123:0/3837062196 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5637ec454270 0x5637ec4be7e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c02ad90 tx=0x7f4e5c004730 comp rx=0 tx=0).stop 2024-09-15T23:14:49.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.719+0000 7f4e711d1740 1 -- 172.21.15.123:0/3837062196 shutdown_connections 2024-09-15T23:14:49.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.719+0000 7f4e711d1740 1 --2- 172.21.15.123:0/3837062196 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5637ec454e50 0x5637ec40fe40 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.719+0000 7f4e711d1740 1 --2- 172.21.15.123:0/3837062196 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5637ec456650 0x5637ec40f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.719+0000 7f4e711d1740 1 --2- 172.21.15.123:0/3837062196 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5637ec454270 0x5637ec4be7e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.719+0000 7f4e46ffd640 0 client.5649 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:49.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.719+0000 7f4e711d1740 1 --2- 172.21.15.123:0/3837062196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5637ec44e090 0x5637ec4c2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.719+0000 7f4e711d1740 1 -- 172.21.15.123:0/3837062196 >> 172.21.15.123:0/3837062196 conn(0x5637ec453e10 msgr2=0x5637ec450cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:49.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.719+0000 7f4e711d1740 1 -- 172.21.15.123:0/3837062196 shutdown_connections 2024-09-15T23:14:49.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.719+0000 7f4e711d1740 1 -- 172.21.15.123:0/3837062196 wait complete. 2024-09-15T23:14:49.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.719+0000 7f4e711d1740 20 client.5649 trim_cache size 0 max 16384 2024-09-15T23:14:49.731 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:14:49.731 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0, 2024-09-15T23:14:49.731 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_tag": "b64337f8-5045-40e8-ae3c-bab0f5479ecb", 2024-09-15T23:14:49.731 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": "asynchronous" 2024-09-15T23:14:49.732 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:14:49.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.720+0000 7f4e6e359640 1 -- 172.21.15.123:0/1132589594 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4e5406c2b0 msgr2=0x7f4e5406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.720+0000 7f4e6e359640 1 --2- 172.21.15.123:0/1132589594 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4e5406c2b0 0x7f4e5406e770 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4e58001050 tx=0x7f4e58007970 comp rx=0 tx=0).stop 2024-09-15T23:14:49.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.720+0000 7f4e6e359640 1 -- 172.21.15.123:0/1132589594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e681604d0 msgr2=0x7f4e680cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.720+0000 7f4e6e359640 1 --2- 172.21.15.123:0/1132589594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e681604d0 0x7f4e680cc2a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4e680b61e0 tx=0x7f4e6000f1b0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.720+0000 7f4e6e359640 1 -- 172.21.15.123:0/1132589594 shutdown_connections 2024-09-15T23:14:49.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.720+0000 7f4e6e359640 1 --2- 172.21.15.123:0/1132589594 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4e5406c2b0 0x7f4e5406e770 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.720+0000 7f4e6e359640 1 --2- 172.21.15.123:0/1132589594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e681604d0 0x7f4e680cc2a0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.720+0000 7f4e6e359640 1 --2- 172.21.15.123:0/1132589594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4e680caec0 0x7f4e6815ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.720+0000 7f4e6e359640 1 --2- 172.21.15.123:0/1132589594 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4e50003f30 0x7f4e68152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.720+0000 7f4e6e359640 1 -- 172.21.15.123:0/1132589594 >> 172.21.15.123:0/1132589594 conn(0x7f4e680d4740 msgr2=0x7f4e680b84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:49.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.720+0000 7f4e6e359640 1 -- 172.21.15.123:0/1132589594 shutdown_connections 2024-09-15T23:14:49.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.720+0000 7f4e6e359640 1 -- 172.21.15.123:0/1132589594 wait complete. 2024-09-15T23:14:49.734 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_0' returned '{'return_code': 0, 'scrub_tag': 'b64337f8-5045-40e8-ae3c-bab0f5479ecb', 'mode': 'asynchronous'}' 2024-09-15T23:14:49.734 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-15T23:14:49.734 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-15T23:14:49.735 INFO:tasks.ceph.mds.d.smithi188.stderr:2024-09-15T23:14:49.719+0000 7fe816845640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a4c [2,head] /scrub_test_path/ceph-qa-suite/new_file_0 auth v440 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={5095=0-4194304@1} caps={5095=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5095 | request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x562325b56580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000a4c:[<0x10000000001/new_file_0 v440>,<0x10000000000/ceph-qa-suite v47>,<0x1/scrub_test_path v17>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61} 2024-09-15T23:14:49.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.834+0000 7f5c53d52640 1 Processor -- start 2024-09-15T23:14:49.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.834+0000 7f5c53d52640 1 -- start start 2024-09-15T23:14:49.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.835+0000 7f5c53d52640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5c4c06c320 0x7f5c4c073ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.835+0000 7f5c53d52640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c4c158d00 con 0x7f5c4c158920 2024-09-15T23:14:49.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.835+0000 7f5c53d52640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c4c0ce0f0 con 0x7f5c4c070f40 2024-09-15T23:14:49.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.835+0000 7f5c53d52640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f5c4c072130 con 0x7f5c4c06c320 2024-09-15T23:14:49.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.835+0000 7f5c512ed640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5c4c06c320 0x7f5c4c073ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.835+0000 7f5c51aee640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f5c4c158920 0x7f5c4c06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41136/0 (socket says 172.21.15.123:41136) 2024-09-15T23:14:49.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.835+0000 7f5c51aee640 1 -- 172.21.15.123:0/969898402 learned_addr learned my addr 172.21.15.123:0/969898402 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:49.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.835+0000 7f5c512ed640 1 -- 172.21.15.123:0/969898402 >> v1:172.21.15.188:6789/0 conn(0x7f5c4c070f40 legacy=0x7f5c4c15b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.835+0000 7f5c512ed640 1 -- 172.21.15.123:0/969898402 >> v1:172.21.15.123:6789/0 conn(0x7f5c4c158920 legacy=0x7f5c4c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.835+0000 7f5c50aec640 1 -- 172.21.15.123:0/969898402 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2401066195 0 0) 0x7f5c48001110 con 0x7f5c4c158920 2024-09-15T23:14:49.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.835+0000 7f5c512ed640 1 -- 172.21.15.123:0/969898402 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c4c071500 con 0x7f5c4c06c320 2024-09-15T23:14:49.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.836+0000 7f5c512ed640 1 --2- 172.21.15.123:0/969898402 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c4c06c320 0x7f5c4c073ac0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0097a0 tx=0x7f5c3c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75f5f09e733a6a8f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:49.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.836+0000 7f5c50aec640 1 -- 172.21.15.123:0/969898402 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c037070 con 0x7f5c4c06c320 2024-09-15T23:14:49.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.836+0000 7f5c50aec640 1 -- 172.21.15.123:0/969898402 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c3c02ae50 con 0x7f5c4c06c320 2024-09-15T23:14:49.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.836+0000 7f5c50aec640 1 -- 172.21.15.123:0/969898402 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c032660 con 0x7f5c4c06c320 2024-09-15T23:14:49.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.837+0000 7f5c53d52640 1 -- 172.21.15.123:0/969898402 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c4c06c320 msgr2=0x7f5c4c073ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.837+0000 7f5c53d52640 1 --2- 172.21.15.123:0/969898402 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c4c06c320 0x7f5c4c073ac0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0097a0 tx=0x7f5c3c02a140 comp rx=0 tx=0).stop 2024-09-15T23:14:49.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.837+0000 7f5c53d52640 1 -- 172.21.15.123:0/969898402 shutdown_connections 2024-09-15T23:14:49.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.837+0000 7f5c53d52640 1 --2- 172.21.15.123:0/969898402 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c4c06c320 0x7f5c4c073ac0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.837+0000 7f5c53d52640 1 -- 172.21.15.123:0/969898402 >> 172.21.15.123:0/969898402 conn(0x7f5c4c06d0f0 msgr2=0x7f5c4c06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:49.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.837+0000 7f5c53d52640 1 -- 172.21.15.123:0/969898402 shutdown_connections 2024-09-15T23:14:49.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.837+0000 7f5c53d52640 1 -- 172.21.15.123:0/969898402 wait complete. 2024-09-15T23:14:49.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.838+0000 7f5c53d52640 1 Processor -- start 2024-09-15T23:14:49.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.838+0000 7f5c53d52640 1 -- start start 2024-09-15T23:14:49.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.839+0000 7f5c53d52640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5c4c06c320 0x7f5c4c0b2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.839+0000 7f5c53d52640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c4c070f40 0x7f5c4c15db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.839+0000 7f5c53d52640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5c4c158920 0x7f5c4c148c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.839+0000 7f5c53d52640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c06cc30 con 0x7f5c4c070f40 2024-09-15T23:14:49.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.839+0000 7f5c53d52640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c071dc0 con 0x7f5c4c158920 2024-09-15T23:14:49.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.839+0000 7f5c53d52640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5c4c0725c0 con 0x7f5c4c06c320 2024-09-15T23:14:49.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.839+0000 7f5c512ed640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c4c070f40 0x7f5c4c15db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.839+0000 7f5c512ed640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c4c070f40 0x7f5c4c15db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48340/0 (socket says 172.21.15.123:48340) 2024-09-15T23:14:49.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.839+0000 7f5c512ed640 1 -- 172.21.15.123:0/2160424231 learned_addr learned my addr 172.21.15.123:0/2160424231 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:49.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.839+0000 7f5c51aee640 1 --2- 172.21.15.123:0/2160424231 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5c4c06c320 0x7f5c4c0b2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.839+0000 7f5c522ef640 1 --2- 172.21.15.123:0/2160424231 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5c4c158920 0x7f5c4c148c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.839+0000 7f5c512ed640 1 -- 172.21.15.123:0/2160424231 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5c4c06c320 msgr2=0x7f5c4c0b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.839+0000 7f5c512ed640 1 --2- 172.21.15.123:0/2160424231 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5c4c06c320 0x7f5c4c0b2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.839+0000 7f5c512ed640 1 -- 172.21.15.123:0/2160424231 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5c4c158920 msgr2=0x7f5c4c148c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.839+0000 7f5c512ed640 1 --2- 172.21.15.123:0/2160424231 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5c4c158920 0x7f5c4c148c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.839+0000 7f5c512ed640 1 -- 172.21.15.123:0/2160424231 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c4c1431d0 con 0x7f5c4c070f40 2024-09-15T23:14:49.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.839+0000 7f5c512ed640 1 --2- 172.21.15.123:0/2160424231 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c4c070f40 0x7f5c4c15db30 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c035040 tx=0x7f5c3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:49.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.839+0000 7f5c427fc640 1 -- 172.21.15.123:0/2160424231 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c037040 con 0x7f5c4c070f40 2024-09-15T23:14:49.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.839+0000 7f5c427fc640 1 -- 172.21.15.123:0/2160424231 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c3c004030 con 0x7f5c4c070f40 2024-09-15T23:14:49.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.839+0000 7f5c427fc640 1 -- 172.21.15.123:0/2160424231 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c006e10 con 0x7f5c4c070f40 2024-09-15T23:14:49.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.839+0000 7f5c53d52640 1 -- 172.21.15.123:0/2160424231 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c4c143470 con 0x7f5c4c070f40 2024-09-15T23:14:49.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.839+0000 7f5c53d52640 1 -- 172.21.15.123:0/2160424231 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c4c143a30 con 0x7f5c4c070f40 2024-09-15T23:14:49.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.841+0000 7f5c427fc640 1 -- 172.21.15.123:0/2160424231 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5c3c03d650 con 0x7f5c4c070f40 2024-09-15T23:14:49.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.841+0000 7f5c427fc640 1 --2- 172.21.15.123:0/2160424231 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5c3006c2b0 0x7f5c3006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.841+0000 7f5c427fc640 1 -- 172.21.15.123:0/2160424231 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7f5c3c0abb10 con 0x7f5c4c070f40 2024-09-15T23:14:49.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.841+0000 7f5c51aee640 1 --2- 172.21.15.123:0/2160424231 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5c3006c2b0 0x7f5c3006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.842+0000 7f5c51aee640 1 --2- 172.21.15.123:0/2160424231 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5c3006c2b0 0x7f5c3006e770 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5c48007fd0 tx=0x7f5c48007de0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:49.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.842+0000 7f5c56bca740 1 Processor -- start 2024-09-15T23:14:49.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.842+0000 7f5c56bca740 1 -- start start 2024-09-15T23:14:49.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.843+0000 7f5c56bca740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564c21f14920 0x564c21f5a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.843+0000 7f5c56bca740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c21f120e0 0x564c21f14d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.843+0000 7f5c56bca740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564c21f160b0 0x564c21f0f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.843+0000 7f5c56bca740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x564c21e776f0 con 0x564c21f120e0 2024-09-15T23:14:49.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.843+0000 7f5c56bca740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x564c21e1f330 con 0x564c21f160b0 2024-09-15T23:14:49.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.843+0000 7f5c56bca740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x564c21e736b0 con 0x564c21f14920 2024-09-15T23:14:49.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.843+0000 7f5c512ed640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c21f120e0 0x564c21f14d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.843+0000 7f5c512ed640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c21f120e0 0x564c21f14d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48354/0 (socket says 172.21.15.123:48354) 2024-09-15T23:14:49.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.843+0000 7f5c512ed640 1 -- 172.21.15.123:0/4185590434 learned_addr learned my addr 172.21.15.123:0/4185590434 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:49.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.843+0000 7f5c51aee640 1 --2- 172.21.15.123:0/4185590434 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564c21f14920 0x564c21f5a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.843+0000 7f5c522ef640 1 --2- 172.21.15.123:0/4185590434 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564c21f160b0 0x564c21f0f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.843+0000 7f5c512ed640 1 -- 172.21.15.123:0/4185590434 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564c21f14920 msgr2=0x564c21f5a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.843+0000 7f5c512ed640 1 --2- 172.21.15.123:0/4185590434 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564c21f14920 0x564c21f5a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.843+0000 7f5c512ed640 1 -- 172.21.15.123:0/4185590434 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564c21f160b0 msgr2=0x564c21f0f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.843+0000 7f5c512ed640 1 --2- 172.21.15.123:0/4185590434 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564c21f160b0 0x564c21f0f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.843+0000 7f5c512ed640 1 -- 172.21.15.123:0/4185590434 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c21e450d0 con 0x564c21f120e0 2024-09-15T23:14:49.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.843+0000 7f5c512ed640 1 --2- 172.21.15.123:0/4185590434 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c21f120e0 0x564c21f14d00 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0aa040 tx=0x7f5c3c079620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=557fe3422843d560 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:49.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.843+0000 7f5c2f7fe640 1 -- 172.21.15.123:0/4185590434 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c04b040 con 0x564c21f120e0 2024-09-15T23:14:49.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.844+0000 7f5c2f7fe640 1 -- 172.21.15.123:0/4185590434 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c3c07dfc0 con 0x564c21f120e0 2024-09-15T23:14:49.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.844+0000 7f5c2f7fe640 1 -- 172.21.15.123:0/4185590434 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c0827f0 con 0x564c21f120e0 2024-09-15T23:14:49.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.844+0000 7f5c56bca740 1 -- 172.21.15.123:0/4185590434 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c21f120e0 msgr2=0x564c21f14d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.844+0000 7f5c56bca740 1 --2- 172.21.15.123:0/4185590434 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c21f120e0 0x564c21f14d00 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0aa040 tx=0x7f5c3c079620 comp rx=0 tx=0).stop 2024-09-15T23:14:49.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.844+0000 7f5c56bca740 1 -- 172.21.15.123:0/4185590434 shutdown_connections 2024-09-15T23:14:49.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.844+0000 7f5c56bca740 1 --2- 172.21.15.123:0/4185590434 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564c21f160b0 0x564c21f0f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.844+0000 7f5c56bca740 1 --2- 172.21.15.123:0/4185590434 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c21f120e0 0x564c21f14d00 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.844+0000 7f5c56bca740 1 --2- 172.21.15.123:0/4185590434 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564c21f14920 0x564c21f5a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.844+0000 7f5c56bca740 1 -- 172.21.15.123:0/4185590434 >> 172.21.15.123:0/4185590434 conn(0x564c21f11370 msgr2=0x564c21f59590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:49.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.844+0000 7f5c56bca740 1 -- 172.21.15.123:0/4185590434 shutdown_connections 2024-09-15T23:14:49.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.844+0000 7f5c56bca740 1 -- 172.21.15.123:0/4185590434 wait complete. 2024-09-15T23:14:49.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.845+0000 7f5c56bca740 1 -- start start 2024-09-15T23:14:49.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.845+0000 7f5c56bca740 1 Processor -- start 2024-09-15T23:14:49.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.846+0000 7f5c56bca740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564c21f14920 0x564c21f33ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.846+0000 7f5c56bca740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c21f160b0 0x564c21f33360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.846+0000 7f5c56bca740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564c21f3d7c0 0x564c21f3ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.846+0000 7f5c56bca740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x564c21e776f0 con 0x564c21f160b0 2024-09-15T23:14:49.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.846+0000 7f5c56bca740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x564c21e004f0 con 0x564c21f14920 2024-09-15T23:14:49.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.846+0000 7f5c56bca740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x564c21f10810 con 0x564c21f3d7c0 2024-09-15T23:14:49.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.846+0000 7f5c56bca740 10 client.0 _ll_register_callbacks cb 0x564c21e21b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:49.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.846+0000 7f5c512ed640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c21f160b0 0x564c21f33360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.846+0000 7f5c512ed640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c21f160b0 0x564c21f33360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48358/0 (socket says 172.21.15.123:48358) 2024-09-15T23:14:49.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.846+0000 7f5c512ed640 1 -- 172.21.15.123:0/2574498978 learned_addr learned my addr 172.21.15.123:0/2574498978 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:49.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.846+0000 7f5c51aee640 1 --2- 172.21.15.123:0/2574498978 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564c21f14920 0x564c21f33ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.846+0000 7f5c522ef640 1 --2- 172.21.15.123:0/2574498978 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564c21f3d7c0 0x564c21f3ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.846+0000 7f5c512ed640 1 -- 172.21.15.123:0/2574498978 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564c21f3d7c0 msgr2=0x564c21f3ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.846+0000 7f5c512ed640 1 --2- 172.21.15.123:0/2574498978 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564c21f3d7c0 0x564c21f3ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.846+0000 7f5c512ed640 1 -- 172.21.15.123:0/2574498978 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564c21f14920 msgr2=0x564c21f33ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.846+0000 7f5c512ed640 1 --2- 172.21.15.123:0/2574498978 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564c21f14920 0x564c21f33ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.846+0000 7f5c512ed640 1 -- 172.21.15.123:0/2574498978 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c21c547d0 con 0x564c21f160b0 2024-09-15T23:14:49.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.846+0000 7f5c512ed640 1 --2- 172.21.15.123:0/2574498978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c21f160b0 0x564c21f33360 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0aa120 tx=0x7f5c3c009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1bfcb9e06a57930 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:49.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.846+0000 7f5c2cff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:49.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.846+0000 7f5c2cff9640 1 -- 172.21.15.123:0/2574498978 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c09d060 con 0x564c21f160b0 2024-09-15T23:14:49.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.846+0000 7f5c2cff9640 1 -- 172.21.15.123:0/2574498978 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7f5c3c082360 con 0x564c21f160b0 2024-09-15T23:14:49.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.847+0000 7f5c56bca740 1 -- 172.21.15.123:0/2574498978 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c3c07dfc0 con 0x564c21f160b0 2024-09-15T23:14:49.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.847+0000 7f5c2cff9640 1 -- 172.21.15.123:0/2574498978 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5c3c098070 con 0x564c21f160b0 2024-09-15T23:14:49.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.847+0000 7f5c56bca740 10 client.5664 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:49.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.847+0000 7f5c56bca740 1 -- 172.21.15.123:0/2574498978 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x564c21b8a3f0 con 0x564c21f160b0 2024-09-15T23:14:49.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.847+0000 7f5c2cff9640 1 -- 172.21.15.123:0/2574498978 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c3c07dfc0 con 0x564c21f160b0 2024-09-15T23:14:49.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.847+0000 7f5c2cff9640 1 -- 172.21.15.123:0/2574498978 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f5c3c079110 con 0x564c21f160b0 2024-09-15T23:14:49.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.847+0000 7f5c56bca740 10 client.5664 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:49.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.847+0000 7f5c56bca740 10 client.5664 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:49.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.847+0000 7f5c56bca740 20 client.5664 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:49.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.847+0000 7f5c56bca740 1 --2- 172.21.15.123:0/2574498978 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x564c21f36400 0x564c21f36810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.847+0000 7f5c56bca740 4 client.5664 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:14:49.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.847+0000 7f5c56bca740 1 -- 172.21.15.123:0/2574498978 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c21e84e20 con 0x564c21f36400 2024-09-15T23:14:49.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.847+0000 7f5c51aee640 1 --2- 172.21.15.123:0/2574498978 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x564c21f36400 0x564c21f36810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.847+0000 7f5c2cff9640 10 client.5664 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:49.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.847+0000 7f5c51aee640 1 --2- 172.21.15.123:0/2574498978 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x564c21f36400 0x564c21f36810 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2b813f3db6e650b server_cookie=d6ec4c2e8b4d3de3 in_seq=0 out_seq=0 2024-09-15T23:14:49.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.848+0000 7f5c2cff9640 1 -- 172.21.15.123:0/2574498978 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564c21e84e20 con 0x564c21f36400 2024-09-15T23:14:49.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.848+0000 7f5c2cff9640 10 client.5664 handle_command_reply: tid=0 2024-09-15T23:14:49.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.848+0000 7f5c56bca740 1 client.5664 shutdown 2024-09-15T23:14:49.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.848+0000 7f5c56bca740 1 -- 172.21.15.123:0/2574498978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c21f160b0 msgr2=0x564c21f33360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.848+0000 7f5c56bca740 1 --2- 172.21.15.123:0/2574498978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c21f160b0 0x564c21f33360 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0aa120 tx=0x7f5c3c009190 comp rx=0 tx=0).stop 2024-09-15T23:14:49.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.848+0000 7f5c56bca740 1 -- 172.21.15.123:0/2574498978 shutdown_connections 2024-09-15T23:14:49.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.848+0000 7f5c56bca740 1 --2- 172.21.15.123:0/2574498978 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x564c21f36400 0x564c21f36810 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.848+0000 7f5c56bca740 1 --2- 172.21.15.123:0/2574498978 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564c21f3d7c0 0x564c21f3ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.848+0000 7f5c56bca740 1 --2- 172.21.15.123:0/2574498978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c21f160b0 0x564c21f33360 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.848+0000 7f5c56bca740 1 --2- 172.21.15.123:0/2574498978 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564c21f14920 0x564c21f33ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.848+0000 7f5c2cff9640 0 client.5664 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:49.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.848+0000 7f5c56bca740 1 -- 172.21.15.123:0/2574498978 >> 172.21.15.123:0/2574498978 conn(0x564c21f120e0 msgr2=0x564c21f57610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:49.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.848+0000 7f5c56bca740 1 -- 172.21.15.123:0/2574498978 shutdown_connections 2024-09-15T23:14:49.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.848+0000 7f5c56bca740 1 -- 172.21.15.123:0/2574498978 wait complete. 2024-09-15T23:14:49.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.848+0000 7f5c56bca740 20 client.5664 trim_cache size 0 max 16384 2024-09-15T23:14:49.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.865+0000 7f5c56bca740 1 Processor -- start 2024-09-15T23:14:49.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.865+0000 7f5c56bca740 1 -- start start 2024-09-15T23:14:49.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.866+0000 7f5c56bca740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564c21f14920 0x564c21f3e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.866+0000 7f5c56bca740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c21f160b0 0x564c21f394d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.866+0000 7f5c56bca740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564c21f3d7c0 0x564c21f594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.866+0000 7f5c56bca740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c1fc860 con 0x564c21f160b0 2024-09-15T23:14:49.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.866+0000 7f5c56bca740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c1fb920 con 0x564c21f3d7c0 2024-09-15T23:14:49.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.866+0000 7f5c56bca740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5c4c169630 con 0x564c21f14920 2024-09-15T23:14:49.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.866+0000 7f5c512ed640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c21f160b0 0x564c21f394d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.866+0000 7f5c512ed640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c21f160b0 0x564c21f394d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48364/0 (socket says 172.21.15.123:48364) 2024-09-15T23:14:49.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.866+0000 7f5c512ed640 1 -- 172.21.15.123:0/3163751305 learned_addr learned my addr 172.21.15.123:0/3163751305 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:49.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.866+0000 7f5c512ed640 1 -- 172.21.15.123:0/3163751305 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564c21f14920 msgr2=0x564c21f3e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.866+0000 7f5c512ed640 1 --2- 172.21.15.123:0/3163751305 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564c21f14920 0x564c21f3e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.866+0000 7f5c512ed640 1 -- 172.21.15.123:0/3163751305 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564c21f3d7c0 msgr2=0x564c21f594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.866+0000 7f5c512ed640 1 --2- 172.21.15.123:0/3163751305 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564c21f3d7c0 0x564c21f594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.866+0000 7f5c512ed640 1 -- 172.21.15.123:0/3163751305 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c21b4a0f0 con 0x564c21f160b0 2024-09-15T23:14:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.867+0000 7f5c512ed640 1 --2- 172.21.15.123:0/3163751305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c21f160b0 0x564c21f394d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c02a730 tx=0x7f5c3c0a9000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e709a8893a0c91b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.867+0000 7f5c2effd640 1 -- 172.21.15.123:0/3163751305 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c04b040 con 0x564c21f160b0 2024-09-15T23:14:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.867+0000 7f5c2effd640 1 -- 172.21.15.123:0/3163751305 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c3c07dfc0 con 0x564c21f160b0 2024-09-15T23:14:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.867+0000 7f5c2effd640 1 -- 172.21.15.123:0/3163751305 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c075f60 con 0x564c21f160b0 2024-09-15T23:14:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.867+0000 7f5c56bca740 1 -- 172.21.15.123:0/3163751305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c21f160b0 msgr2=0x564c21f394d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.867+0000 7f5c56bca740 1 --2- 172.21.15.123:0/3163751305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c21f160b0 0x564c21f394d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c02a730 tx=0x7f5c3c0a9000 comp rx=0 tx=0).stop 2024-09-15T23:14:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.867+0000 7f5c56bca740 1 -- 172.21.15.123:0/3163751305 shutdown_connections 2024-09-15T23:14:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.867+0000 7f5c56bca740 1 --2- 172.21.15.123:0/3163751305 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564c21f3d7c0 0x564c21f594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.867+0000 7f5c56bca740 1 --2- 172.21.15.123:0/3163751305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c21f160b0 0x564c21f394d0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.867+0000 7f5c56bca740 1 --2- 172.21.15.123:0/3163751305 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564c21f14920 0x564c21f3e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.867+0000 7f5c56bca740 1 -- 172.21.15.123:0/3163751305 >> 172.21.15.123:0/3163751305 conn(0x564c21f120e0 msgr2=0x564c21f57610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:49.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.867+0000 7f5c56bca740 1 -- 172.21.15.123:0/3163751305 shutdown_connections 2024-09-15T23:14:49.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.867+0000 7f5c56bca740 1 -- 172.21.15.123:0/3163751305 wait complete. 2024-09-15T23:14:49.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.868+0000 7f5c56bca740 1 -- start start 2024-09-15T23:14:49.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.868+0000 7f5c56bca740 1 Processor -- start 2024-09-15T23:14:49.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.869+0000 7f5c56bca740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564c21f14920 0x564c21f67cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.869+0000 7f5c56bca740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c21f160b0 0x564c21f594a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.869+0000 7f5c56bca740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564c21f3d7c0 0x564c21fd9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.869+0000 7f5c56bca740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c146400 con 0x564c21f160b0 2024-09-15T23:14:49.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.869+0000 7f5c56bca740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x564c21f35180 con 0x564c21f14920 2024-09-15T23:14:49.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.869+0000 7f5c56bca740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x564c21f335c0 con 0x564c21f3d7c0 2024-09-15T23:14:49.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.869+0000 7f5c56bca740 10 client.0 _ll_register_callbacks cb 0x7f5c48007380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:49.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.869+0000 7f5c512ed640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c21f160b0 0x564c21f594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.869+0000 7f5c512ed640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c21f160b0 0x564c21f594a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48370/0 (socket says 172.21.15.123:48370) 2024-09-15T23:14:49.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.869+0000 7f5c512ed640 1 -- 172.21.15.123:0/4064469010 learned_addr learned my addr 172.21.15.123:0/4064469010 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:49.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.869+0000 7f5c51aee640 1 --2- 172.21.15.123:0/4064469010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564c21f14920 0x564c21f67cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.869+0000 7f5c522ef640 1 --2- 172.21.15.123:0/4064469010 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564c21f3d7c0 0x564c21fd9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.869+0000 7f5c512ed640 1 -- 172.21.15.123:0/4064469010 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564c21f3d7c0 msgr2=0x564c21fd9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.869+0000 7f5c512ed640 1 --2- 172.21.15.123:0/4064469010 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564c21f3d7c0 0x564c21fd9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.869+0000 7f5c512ed640 1 -- 172.21.15.123:0/4064469010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564c21f14920 msgr2=0x564c21f67cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:49.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.869+0000 7f5c512ed640 1 --2- 172.21.15.123:0/4064469010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564c21f14920 0x564c21f67cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.869+0000 7f5c512ed640 1 -- 172.21.15.123:0/4064469010 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c21f69140 con 0x564c21f160b0 2024-09-15T23:14:49.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.869+0000 7f5c51aee640 1 --2- 172.21.15.123:0/4064469010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564c21f14920 0x564c21f67cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:49.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.869+0000 7f5c512ed640 1 --2- 172.21.15.123:0/4064469010 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c21f160b0 0x564c21f594a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c077f70 tx=0x7f5c3c009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=750284899c8e6c83 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:49.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.869+0000 7f5c2cff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:49.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.869+0000 7f5c2cff9640 1 -- 172.21.15.123:0/4064469010 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c086030 con 0x564c21f160b0 2024-09-15T23:14:49.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.869+0000 7f5c2cff9640 1 -- 172.21.15.123:0/4064469010 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7f5c3c082570 con 0x564c21f160b0 2024-09-15T23:14:49.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.869+0000 7f5c56bca740 1 -- 172.21.15.123:0/4064469010 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c3c07dfc0 con 0x564c21f160b0 2024-09-15T23:14:49.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.870+0000 7f5c2cff9640 1 -- 172.21.15.123:0/4064469010 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5c3c04b040 con 0x564c21f160b0 2024-09-15T23:14:49.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.870+0000 7f5c56bca740 10 client.5670 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:49.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.870+0000 7f5c56bca740 1 -- 172.21.15.123:0/4064469010 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x564c21f69140 con 0x564c21f160b0 2024-09-15T23:14:49.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.870+0000 7f5c2cff9640 1 -- 172.21.15.123:0/4064469010 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c3c07dfc0 con 0x564c21f160b0 2024-09-15T23:14:49.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.870+0000 7f5c2cff9640 1 -- 172.21.15.123:0/4064469010 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f5c3c0801b0 con 0x564c21f160b0 2024-09-15T23:14:49.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.870+0000 7f5c56bca740 10 client.5670 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:49.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.870+0000 7f5c56bca740 10 client.5670 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:49.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.870+0000 7f5c56bca740 20 client.5670 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:49.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.870+0000 7f5c56bca740 1 --2- 172.21.15.123:0/4064469010 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x564c21f599e0 0x564c21fda3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:49.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.870+0000 7f5c56bca740 4 client.5670 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:14:49.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.870+0000 7f5c56bca740 1 -- 172.21.15.123:0/4064469010 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564c21e7f170 con 0x564c21f599e0 2024-09-15T23:14:49.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.870+0000 7f5c51aee640 1 --2- 172.21.15.123:0/4064469010 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x564c21f599e0 0x564c21fda3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:49.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.871+0000 7f5c2cff9640 10 client.5670 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:49.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.871+0000 7f5c51aee640 1 --2- 172.21.15.123:0/4064469010 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x564c21f599e0 0x564c21fda3b0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=696fa13999c6bb84 server_cookie=9cb552d915d1aba9 in_seq=0 out_seq=0 2024-09-15T23:14:49.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.871+0000 7f5c2cff9640 1 -- 172.21.15.123:0/4064469010 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+284 (crc 0 0 0) 0x564c21e7f170 con 0x564c21f599e0 2024-09-15T23:14:49.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.871+0000 7f5c2cff9640 10 client.5670 handle_command_reply: tid=0 2024-09-15T23:14:49.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.871+0000 7f5c56bca740 1 client.5670 shutdown 2024-09-15T23:14:49.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.871+0000 7f5c56bca740 1 -- 172.21.15.123:0/4064469010 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c21f160b0 msgr2=0x564c21f594a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.871+0000 7f5c56bca740 1 --2- 172.21.15.123:0/4064469010 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c21f160b0 0x564c21f594a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c077f70 tx=0x7f5c3c009500 comp rx=0 tx=0).stop 2024-09-15T23:14:49.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.871+0000 7f5c56bca740 1 -- 172.21.15.123:0/4064469010 shutdown_connections 2024-09-15T23:14:49.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.871+0000 7f5c56bca740 1 --2- 172.21.15.123:0/4064469010 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x564c21f599e0 0x564c21fda3b0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.871+0000 7f5c56bca740 1 --2- 172.21.15.123:0/4064469010 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564c21f3d7c0 0x564c21fd9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.871+0000 7f5c2cff9640 0 client.5670 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:49.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.871+0000 7f5c56bca740 1 --2- 172.21.15.123:0/4064469010 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564c21f160b0 0x564c21f594a0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.871+0000 7f5c56bca740 1 --2- 172.21.15.123:0/4064469010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564c21f14920 0x564c21f67cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.871+0000 7f5c56bca740 1 -- 172.21.15.123:0/4064469010 >> 172.21.15.123:0/4064469010 conn(0x564c21f120e0 msgr2=0x564c21f57610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:49.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.871+0000 7f5c56bca740 1 -- 172.21.15.123:0/4064469010 shutdown_connections 2024-09-15T23:14:49.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.871+0000 7f5c56bca740 1 -- 172.21.15.123:0/4064469010 wait complete. 2024-09-15T23:14:49.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.872+0000 7f5c56bca740 20 client.5670 trim_cache size 0 max 16384 2024-09-15T23:14:49.879 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:14:49.879 INFO:teuthology.orchestra.run.smithi123.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-15T23:14:49.880 INFO:teuthology.orchestra.run.smithi123.stdout: "scrubs": { 2024-09-15T23:14:49.880 INFO:teuthology.orchestra.run.smithi123.stdout: "b64337f8-5045-40e8-ae3c-bab0f5479ecb": { 2024-09-15T23:14:49.880 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0", 2024-09-15T23:14:49.880 INFO:teuthology.orchestra.run.smithi123.stdout: "tag": "b64337f8-5045-40e8-ae3c-bab0f5479ecb", 2024-09-15T23:14:49.880 INFO:teuthology.orchestra.run.smithi123.stdout: "options": "" 2024-09-15T23:14:49.880 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:14:49.880 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:14:49.880 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:14:49.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.872+0000 7f5c53d52640 1 -- 172.21.15.123:0/2160424231 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5c3006c2b0 msgr2=0x7f5c3006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.872+0000 7f5c53d52640 1 --2- 172.21.15.123:0/2160424231 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5c3006c2b0 0x7f5c3006e770 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5c48007fd0 tx=0x7f5c48007de0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.872+0000 7f5c53d52640 1 -- 172.21.15.123:0/2160424231 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c4c070f40 msgr2=0x7f5c4c15db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:49.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.872+0000 7f5c53d52640 1 --2- 172.21.15.123:0/2160424231 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c4c070f40 0x7f5c4c15db30 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c035040 tx=0x7f5c3c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.872+0000 7f5c53d52640 1 -- 172.21.15.123:0/2160424231 shutdown_connections 2024-09-15T23:14:49.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.872+0000 7f5c53d52640 1 --2- 172.21.15.123:0/2160424231 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5c4c158920 0x7f5c4c148c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.872+0000 7f5c53d52640 1 --2- 172.21.15.123:0/2160424231 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5c3006c2b0 0x7f5c3006e770 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.872+0000 7f5c53d52640 1 --2- 172.21.15.123:0/2160424231 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c4c070f40 0x7f5c4c15db30 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.872+0000 7f5c53d52640 1 --2- 172.21.15.123:0/2160424231 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5c4c06c320 0x7f5c4c0b2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:49.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.872+0000 7f5c53d52640 1 -- 172.21.15.123:0/2160424231 >> 172.21.15.123:0/2160424231 conn(0x7f5c4c06d0f0 msgr2=0x7f5c4c15e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:49.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.872+0000 7f5c53d52640 1 -- 172.21.15.123:0/2160424231 shutdown_connections 2024-09-15T23:14:49.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:49.872+0000 7f5c53d52640 1 -- 172.21.15.123:0/2160424231 wait complete. 2024-09-15T23:14:54.884 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-15T23:14:54.884 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-15T23:14:54.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.986+0000 7effe4531640 1 Processor -- start 2024-09-15T23:14:54.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.986+0000 7effe4531640 1 -- start start 2024-09-15T23:14:54.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.987+0000 7effe4531640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effdc0ccf30 0x7effdc0b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:54.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.987+0000 7effe4531640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7effdc0cead0 0x7effdc071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:54.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.987+0000 7effe4531640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effdc0cf2e0 con 0x7effdc15b7c0 2024-09-15T23:14:54.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.987+0000 7effe4531640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7effdc070fe0 con 0x7effdc0cead0 2024-09-15T23:14:54.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.987+0000 7effe4531640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7effdc0712c0 con 0x7effdc0ccf30 2024-09-15T23:14:54.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.987+0000 7effe22cd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effdc0ccf30 0x7effdc0b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:54.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.987+0000 7effe2ace640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7effdc0cead0 0x7effdc071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:54.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.987+0000 7effe1acc640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7effdc15b7c0 0x7effdc0cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:59728/0 (socket says 172.21.15.123:59728) 2024-09-15T23:14:54.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.987+0000 7effe1acc640 1 -- 172.21.15.123:0/329871009 learned_addr learned my addr 172.21.15.123:0/329871009 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:54.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.987+0000 7effe12cb640 1 -- 172.21.15.123:0/329871009 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3354429136 0 0) 0x7effdc0cf2e0 con 0x7effdc15b7c0 2024-09-15T23:14:54.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.987+0000 7effe12cb640 1 -- 172.21.15.123:0/329871009 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effc4003520 con 0x7effdc15b7c0 2024-09-15T23:14:54.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.987+0000 7effe22cd640 1 -- 172.21.15.123:0/329871009 >> v2:172.21.15.188:3300/0 conn(0x7effdc0cead0 msgr2=0x7effdc071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:54.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.987+0000 7effe22cd640 1 --2- 172.21.15.123:0/329871009 >> v2:172.21.15.188:3300/0 conn(0x7effdc0cead0 0x7effdc071ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:54.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.987+0000 7effe22cd640 1 -- 172.21.15.123:0/329871009 >> v1:172.21.15.188:6789/0 conn(0x7effdc15b7c0 legacy=0x7effdc0cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:54.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.987+0000 7effe22cd640 1 -- 172.21.15.123:0/329871009 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effdc0715a0 con 0x7effdc0ccf30 2024-09-15T23:14:54.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.987+0000 7effe2ace640 1 --2- 172.21.15.123:0/329871009 >> v2:172.21.15.188:3300/0 conn(0x7effdc0cead0 0x7effdc071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:14:54.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.988+0000 7effe22cd640 1 --2- 172.21.15.123:0/329871009 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effdc0ccf30 0x7effdc0b2c50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7effd40097a0 tx=0x7effd402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f6ef98edfcabf6b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:54.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.988+0000 7effe12cb640 1 -- 172.21.15.123:0/329871009 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd4037070 con 0x7effdc0ccf30 2024-09-15T23:14:54.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.988+0000 7effe12cb640 1 -- 172.21.15.123:0/329871009 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effd402ae50 con 0x7effdc0ccf30 2024-09-15T23:14:54.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.988+0000 7effe12cb640 1 -- 172.21.15.123:0/329871009 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd4032640 con 0x7effdc0ccf30 2024-09-15T23:14:54.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.989+0000 7effe4531640 1 -- 172.21.15.123:0/329871009 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effdc0ccf30 msgr2=0x7effdc0b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:54.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.989+0000 7effe4531640 1 --2- 172.21.15.123:0/329871009 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effdc0ccf30 0x7effdc0b2c50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7effd40097a0 tx=0x7effd402a100 comp rx=0 tx=0).stop 2024-09-15T23:14:54.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.989+0000 7effe4531640 1 -- 172.21.15.123:0/329871009 shutdown_connections 2024-09-15T23:14:54.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.989+0000 7effe4531640 1 --2- 172.21.15.123:0/329871009 >> v2:172.21.15.188:3300/0 conn(0x7effdc0cead0 0x7effdc071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:54.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.989+0000 7effe4531640 1 --2- 172.21.15.123:0/329871009 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effdc0ccf30 0x7effdc0b2c50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:54.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.989+0000 7effe4531640 1 -- 172.21.15.123:0/329871009 >> 172.21.15.123:0/329871009 conn(0x7effdc06d0f0 msgr2=0x7effdc06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:54.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.989+0000 7effe4531640 1 -- 172.21.15.123:0/329871009 shutdown_connections 2024-09-15T23:14:54.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.989+0000 7effe4531640 1 -- 172.21.15.123:0/329871009 wait complete. 2024-09-15T23:14:54.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.990+0000 7effe4531640 1 Processor -- start 2024-09-15T23:14:54.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.990+0000 7effe4531640 1 -- start start 2024-09-15T23:14:54.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.991+0000 7effe4531640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effdc0ccf30 0x7effdc14a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:54.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.991+0000 7effe4531640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7effdc0cead0 0x7effdc166210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:54.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.991+0000 7effe4531640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effdc15b7c0 0x7effdc14e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:54.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.991+0000 7effe4531640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7effdc072000 con 0x7effdc0ccf30 2024-09-15T23:14:54.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.991+0000 7effe4531640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7effdc0cef60 con 0x7effdc0cead0 2024-09-15T23:14:54.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.991+0000 7effe4531640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7effdc072180 con 0x7effdc15b7c0 2024-09-15T23:14:54.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.991+0000 7effe22cd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effdc0ccf30 0x7effdc14a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:54.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.991+0000 7effe22cd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effdc0ccf30 0x7effdc14a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48382/0 (socket says 172.21.15.123:48382) 2024-09-15T23:14:54.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.991+0000 7effe22cd640 1 -- 172.21.15.123:0/462517549 learned_addr learned my addr 172.21.15.123:0/462517549 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:54.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.991+0000 7effe2ace640 1 --2- 172.21.15.123:0/462517549 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effdc15b7c0 0x7effdc14e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:54.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.991+0000 7effe1acc640 1 --2- 172.21.15.123:0/462517549 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7effdc0cead0 0x7effdc166210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:54.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.991+0000 7effe22cd640 1 -- 172.21.15.123:0/462517549 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effdc15b7c0 msgr2=0x7effdc14e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:54.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.991+0000 7effe22cd640 1 --2- 172.21.15.123:0/462517549 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effdc15b7c0 0x7effdc14e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:54.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.991+0000 7effe22cd640 1 -- 172.21.15.123:0/462517549 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7effdc0cead0 msgr2=0x7effdc166210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:54.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.991+0000 7effe22cd640 1 --2- 172.21.15.123:0/462517549 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7effdc0cead0 0x7effdc166210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:54.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.991+0000 7effe22cd640 1 -- 172.21.15.123:0/462517549 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effdc167a50 con 0x7effdc0ccf30 2024-09-15T23:14:54.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.991+0000 7effe22cd640 1 --2- 172.21.15.123:0/462517549 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effdc0ccf30 0x7effdc14a380 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7effd4035040 tx=0x7effd40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:54.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.992+0000 7effdaffd640 1 -- 172.21.15.123:0/462517549 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd4041020 con 0x7effdc0ccf30 2024-09-15T23:14:54.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.992+0000 7effdaffd640 1 -- 172.21.15.123:0/462517549 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effd403c670 con 0x7effdc0ccf30 2024-09-15T23:14:54.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.992+0000 7effdaffd640 1 -- 172.21.15.123:0/462517549 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd4037040 con 0x7effdc0ccf30 2024-09-15T23:14:54.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.992+0000 7effe4531640 1 -- 172.21.15.123:0/462517549 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effdc1669b0 con 0x7effdc0ccf30 2024-09-15T23:14:54.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.992+0000 7effe4531640 1 -- 172.21.15.123:0/462517549 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effdc166f70 con 0x7effdc0ccf30 2024-09-15T23:14:54.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.993+0000 7effdaffd640 1 -- 172.21.15.123:0/462517549 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7effd4044020 con 0x7effdc0ccf30 2024-09-15T23:14:54.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.993+0000 7effdaffd640 1 --2- 172.21.15.123:0/462517549 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7effc806c2b0 0x7effc806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:54.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.994+0000 7effdaffd640 1 -- 172.21.15.123:0/462517549 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5854+0+0 (secure 0 0 0) 0x7effd40aba50 con 0x7effdc0ccf30 2024-09-15T23:14:54.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.994+0000 7effe1acc640 1 --2- 172.21.15.123:0/462517549 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7effc806c2b0 0x7effc806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.994+0000 7effe1acc640 1 --2- 172.21.15.123:0/462517549 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7effc806c2b0 0x7effc806e770 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7effdc1654a0 tx=0x7effd0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:55.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.995+0000 7effe72d1740 1 Processor -- start 2024-09-15T23:14:55.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.995+0000 7effe72d1740 1 -- start start 2024-09-15T23:14:55.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.995+0000 7effe72d1740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555ff8013920 0x555ff80590c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.995+0000 7effe72d1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555ff80110e0 0x555ff8013d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.995+0000 7effe72d1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555ff80150b0 0x555ff800e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.996+0000 7effe72d1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x555ff7f766f0 con 0x555ff80110e0 2024-09-15T23:14:55.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.996+0000 7effe72d1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x555ff7f1e330 con 0x555ff80150b0 2024-09-15T23:14:55.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.996+0000 7effe72d1740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x555ff7f726b0 con 0x555ff8013920 2024-09-15T23:14:55.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.996+0000 7effe1acc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555ff80110e0 0x555ff8013d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.996+0000 7effe1acc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555ff80110e0 0x555ff8013d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48390/0 (socket says 172.21.15.123:48390) 2024-09-15T23:14:55.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.996+0000 7effe1acc640 1 -- 172.21.15.123:0/2399595682 learned_addr learned my addr 172.21.15.123:0/2399595682 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:55.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.996+0000 7effe2ace640 1 --2- 172.21.15.123:0/2399595682 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555ff80150b0 0x555ff800e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.996+0000 7effe22cd640 1 --2- 172.21.15.123:0/2399595682 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555ff8013920 0x555ff80590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.996+0000 7effe1acc640 1 -- 172.21.15.123:0/2399595682 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555ff8013920 msgr2=0x555ff80590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.996+0000 7effe1acc640 1 --2- 172.21.15.123:0/2399595682 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555ff8013920 0x555ff80590c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.996+0000 7effe1acc640 1 -- 172.21.15.123:0/2399595682 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555ff80150b0 msgr2=0x555ff800e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.996+0000 7effe1acc640 1 --2- 172.21.15.123:0/2399595682 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555ff80150b0 0x555ff800e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.996+0000 7effe1acc640 1 -- 172.21.15.123:0/2399595682 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ff7f440d0 con 0x555ff80110e0 2024-09-15T23:14:55.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.996+0000 7effe1acc640 1 --2- 172.21.15.123:0/2399595682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555ff80110e0 0x555ff8013d00 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7effd0015590 tx=0x7effd0001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=928e361922ce9bb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:55.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.996+0000 7effc3fff640 1 -- 172.21.15.123:0/2399595682 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd0025070 con 0x555ff80110e0 2024-09-15T23:14:55.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.996+0000 7effc3fff640 1 -- 172.21.15.123:0/2399595682 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effd0013680 con 0x555ff80110e0 2024-09-15T23:14:55.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.996+0000 7effc3fff640 1 -- 172.21.15.123:0/2399595682 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd0013a50 con 0x555ff80110e0 2024-09-15T23:14:55.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.997+0000 7effe72d1740 1 -- 172.21.15.123:0/2399595682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555ff80110e0 msgr2=0x555ff8013d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.997+0000 7effe72d1740 1 --2- 172.21.15.123:0/2399595682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555ff80110e0 0x555ff8013d00 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7effd0015590 tx=0x7effd0001250 comp rx=0 tx=0).stop 2024-09-15T23:14:55.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.997+0000 7effe72d1740 1 -- 172.21.15.123:0/2399595682 shutdown_connections 2024-09-15T23:14:55.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.997+0000 7effe72d1740 1 --2- 172.21.15.123:0/2399595682 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555ff80150b0 0x555ff800e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.997+0000 7effe72d1740 1 --2- 172.21.15.123:0/2399595682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555ff80110e0 0x555ff8013d00 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.997+0000 7effe72d1740 1 --2- 172.21.15.123:0/2399595682 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555ff8013920 0x555ff80590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.997+0000 7effe72d1740 1 -- 172.21.15.123:0/2399595682 >> 172.21.15.123:0/2399595682 conn(0x555ff8010370 msgr2=0x555ff8058590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:55.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.997+0000 7effe72d1740 1 -- 172.21.15.123:0/2399595682 shutdown_connections 2024-09-15T23:14:55.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.997+0000 7effe72d1740 1 -- 172.21.15.123:0/2399595682 wait complete. 2024-09-15T23:14:55.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.998+0000 7effe72d1740 1 -- start start 2024-09-15T23:14:55.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.998+0000 7effe72d1740 1 Processor -- start 2024-09-15T23:14:55.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.999+0000 7effe72d1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555ff8013920 0x555ff803df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.999+0000 7effe72d1740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555ff80150b0 0x555ff80332e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.999+0000 7effe72d1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555ff806c9f0 0x555ff800d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.999+0000 7effe72d1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x555ff800f810 con 0x555ff8013920 2024-09-15T23:14:55.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.999+0000 7effe72d1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x555ff7eff4f0 con 0x555ff806c9f0 2024-09-15T23:14:55.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.999+0000 7effe72d1740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x555ff80598f0 con 0x555ff80150b0 2024-09-15T23:14:55.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.999+0000 7effe72d1740 10 client.0 _ll_register_callbacks cb 0x555ff7f20b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:55.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.999+0000 7effe22cd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555ff8013920 0x555ff803df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.999+0000 7effe22cd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555ff8013920 0x555ff803df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48406/0 (socket says 172.21.15.123:48406) 2024-09-15T23:14:55.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.999+0000 7effe22cd640 1 -- 172.21.15.123:0/1733037365 learned_addr learned my addr 172.21.15.123:0/1733037365 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:55.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.999+0000 7effe1acc640 1 --2- 172.21.15.123:0/1733037365 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555ff80150b0 0x555ff80332e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.999+0000 7effe2ace640 1 --2- 172.21.15.123:0/1733037365 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555ff806c9f0 0x555ff800d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.999+0000 7effe22cd640 1 -- 172.21.15.123:0/1733037365 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555ff80150b0 msgr2=0x555ff80332e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.999+0000 7effe22cd640 1 --2- 172.21.15.123:0/1733037365 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555ff80150b0 0x555ff80332e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.999+0000 7effe22cd640 1 -- 172.21.15.123:0/1733037365 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555ff806c9f0 msgr2=0x555ff800d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.999+0000 7effe22cd640 1 --2- 172.21.15.123:0/1733037365 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555ff806c9f0 0x555ff800d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.999+0000 7effe22cd640 1 -- 172.21.15.123:0/1733037365 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ff7d537d0 con 0x555ff8013920 2024-09-15T23:14:55.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.999+0000 7effe22cd640 1 --2- 172.21.15.123:0/1733037365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555ff8013920 0x555ff803df00 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7effd402a140 tx=0x7effd407a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48c9b6234283e060 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:55.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.999+0000 7effc17fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:55.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.999+0000 7effc17fa640 1 -- 172.21.15.123:0/1733037365 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd40802b0 con 0x555ff8013920 2024-09-15T23:14:55.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.999+0000 7effc17fa640 1 -- 172.21.15.123:0/1733037365 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(53..53 src has 1..53) ==== 5854+0+0 (secure 0 0 0) 0x7effd4082180 con 0x555ff8013920 2024-09-15T23:14:55.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.999+0000 7effe72d1740 1 -- 172.21.15.123:0/1733037365 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effd0013680 con 0x555ff8013920 2024-09-15T23:14:55.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.999+0000 7effc17fa640 1 -- 172.21.15.123:0/1733037365 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7effd4082610 con 0x555ff8013920 2024-09-15T23:14:55.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.999+0000 7effe72d1740 10 client.5679 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:55.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.999+0000 7effe72d1740 1 -- 172.21.15.123:0/1733037365 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x555ff7c893f0 con 0x555ff8013920 2024-09-15T23:14:55.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:54.999+0000 7effc17fa640 1 -- 172.21.15.123:0/1733037365 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effd0013680 con 0x555ff8013920 2024-09-15T23:14:55.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.000+0000 7effc17fa640 1 -- 172.21.15.123:0/1733037365 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7effd4078e80 con 0x555ff8013920 2024-09-15T23:14:55.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.000+0000 7effe72d1740 10 client.5679 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:55.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.000+0000 7effe72d1740 10 client.5679 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:55.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.000+0000 7effe72d1740 20 client.5679 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.000+0000 7effe72d1740 1 --2- 172.21.15.123:0/1733037365 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x555ff803c3b0 0x555ff805e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.000+0000 7effe72d1740 4 client.5679 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:14:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.000+0000 7effe72d1740 1 -- 172.21.15.123:0/1733037365 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555ff7f83e20 con 0x555ff803c3b0 2024-09-15T23:14:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.000+0000 7effe1acc640 1 --2- 172.21.15.123:0/1733037365 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x555ff803c3b0 0x555ff805e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.000+0000 7effc17fa640 10 client.5679 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.000+0000 7effe1acc640 1 --2- 172.21.15.123:0/1733037365 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x555ff803c3b0 0x555ff805e7a0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f71e9dae19b1966 server_cookie=3bc39653dc7730e2 in_seq=0 out_seq=0 2024-09-15T23:14:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.001+0000 7effc17fa640 1 -- 172.21.15.123:0/1733037365 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555ff7f83e20 con 0x555ff803c3b0 2024-09-15T23:14:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.001+0000 7effc17fa640 10 client.5679 handle_command_reply: tid=0 2024-09-15T23:14:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.001+0000 7effe72d1740 1 client.5679 shutdown 2024-09-15T23:14:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.001+0000 7effe72d1740 1 -- 172.21.15.123:0/1733037365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555ff8013920 msgr2=0x555ff803df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.001+0000 7effe72d1740 1 --2- 172.21.15.123:0/1733037365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555ff8013920 0x555ff803df00 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7effd402a140 tx=0x7effd407a1f0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.001+0000 7effe72d1740 1 -- 172.21.15.123:0/1733037365 shutdown_connections 2024-09-15T23:14:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.001+0000 7effe72d1740 1 --2- 172.21.15.123:0/1733037365 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x555ff803c3b0 0x555ff805e7a0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.001+0000 7effe72d1740 1 --2- 172.21.15.123:0/1733037365 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555ff806c9f0 0x555ff800d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.001+0000 7effe72d1740 1 --2- 172.21.15.123:0/1733037365 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555ff80150b0 0x555ff80332e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.001+0000 7effe72d1740 1 --2- 172.21.15.123:0/1733037365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555ff8013920 0x555ff803df00 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.001+0000 7effc17fa640 0 client.5679 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:55.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.001+0000 7effe72d1740 1 -- 172.21.15.123:0/1733037365 >> 172.21.15.123:0/1733037365 conn(0x555ff80110e0 msgr2=0x555ff8011680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:55.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.001+0000 7effe72d1740 1 -- 172.21.15.123:0/1733037365 shutdown_connections 2024-09-15T23:14:55.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.001+0000 7effe72d1740 1 -- 172.21.15.123:0/1733037365 wait complete. 2024-09-15T23:14:55.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.001+0000 7effe72d1740 20 client.5679 trim_cache size 0 max 16384 2024-09-15T23:14:55.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.018+0000 7effe72d1740 1 Processor -- start 2024-09-15T23:14:55.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.018+0000 7effe72d1740 1 -- start start 2024-09-15T23:14:55.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.019+0000 7effe72d1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555ff8013920 0x555ff800d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.019+0000 7effe72d1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555ff80150b0 0x555ff800d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.019+0000 7effe72d1740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555ff806c9f0 0x555ff8039410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.019+0000 7effe72d1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7effdc200d10 con 0x555ff8013920 2024-09-15T23:14:55.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.019+0000 7effe72d1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7effdc15d8c0 con 0x555ff80150b0 2024-09-15T23:14:55.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.019+0000 7effe72d1740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7effdc1510f0 con 0x555ff806c9f0 2024-09-15T23:14:55.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.019+0000 7effe22cd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555ff8013920 0x555ff800d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.019+0000 7effe22cd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555ff8013920 0x555ff800d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48422/0 (socket says 172.21.15.123:48422) 2024-09-15T23:14:55.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.019+0000 7effe22cd640 1 -- 172.21.15.123:0/478409048 learned_addr learned my addr 172.21.15.123:0/478409048 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:55.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.019+0000 7effe22cd640 1 -- 172.21.15.123:0/478409048 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555ff806c9f0 msgr2=0x555ff8039410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.019+0000 7effe22cd640 1 --2- 172.21.15.123:0/478409048 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555ff806c9f0 0x555ff8039410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.019+0000 7effe22cd640 1 -- 172.21.15.123:0/478409048 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555ff80150b0 msgr2=0x555ff800d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.019+0000 7effe22cd640 1 --2- 172.21.15.123:0/478409048 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555ff80150b0 0x555ff800d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.019+0000 7effe22cd640 1 -- 172.21.15.123:0/478409048 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ff7c490f0 con 0x555ff8013920 2024-09-15T23:14:55.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.020+0000 7effe22cd640 1 --2- 172.21.15.123:0/478409048 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555ff8013920 0x555ff800d360 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7effd4079730 tx=0x7effd4047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2412955deffb8e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:55.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.020+0000 7effc37fe640 1 -- 172.21.15.123:0/478409048 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd4079800 con 0x555ff8013920 2024-09-15T23:14:55.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.020+0000 7effc37fe640 1 -- 172.21.15.123:0/478409048 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effd402ae50 con 0x555ff8013920 2024-09-15T23:14:55.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.020+0000 7effc37fe640 1 -- 172.21.15.123:0/478409048 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd4082380 con 0x555ff8013920 2024-09-15T23:14:55.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.020+0000 7effe72d1740 1 -- 172.21.15.123:0/478409048 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555ff8013920 msgr2=0x555ff800d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.020+0000 7effe72d1740 1 --2- 172.21.15.123:0/478409048 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555ff8013920 0x555ff800d360 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7effd4079730 tx=0x7effd4047000 comp rx=0 tx=0).stop 2024-09-15T23:14:55.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.020+0000 7effe72d1740 1 -- 172.21.15.123:0/478409048 shutdown_connections 2024-09-15T23:14:55.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.020+0000 7effe72d1740 1 --2- 172.21.15.123:0/478409048 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555ff806c9f0 0x555ff8039410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.020+0000 7effe72d1740 1 --2- 172.21.15.123:0/478409048 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555ff80150b0 0x555ff800d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.020+0000 7effe72d1740 1 --2- 172.21.15.123:0/478409048 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555ff8013920 0x555ff800d360 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.020+0000 7effe72d1740 1 -- 172.21.15.123:0/478409048 >> 172.21.15.123:0/478409048 conn(0x555ff80110e0 msgr2=0x555ff806bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:55.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.020+0000 7effe72d1740 1 -- 172.21.15.123:0/478409048 shutdown_connections 2024-09-15T23:14:55.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.020+0000 7effe72d1740 1 -- 172.21.15.123:0/478409048 wait complete. 2024-09-15T23:14:55.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.021+0000 7effe72d1740 1 -- start start 2024-09-15T23:14:55.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.021+0000 7effe72d1740 1 Processor -- start 2024-09-15T23:14:55.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.022+0000 7effe72d1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555ff8013920 0x555ff805a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.022+0000 7effe72d1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555ff80150b0 0x555ff80d5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.022+0000 7effe72d1740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555ff806c9f0 0x555ff8039410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.022+0000 7effe72d1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x555ff803db80 con 0x555ff8013920 2024-09-15T23:14:55.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.022+0000 7effe72d1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7effdc15d270 con 0x555ff80150b0 2024-09-15T23:14:55.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.022+0000 7effe72d1740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x555ff8039f00 con 0x555ff806c9f0 2024-09-15T23:14:55.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.022+0000 7effe72d1740 10 client.0 _ll_register_callbacks cb 0x7effd40795c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:55.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.022+0000 7effe22cd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555ff8013920 0x555ff805a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.022+0000 7effe22cd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555ff8013920 0x555ff805a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48428/0 (socket says 172.21.15.123:48428) 2024-09-15T23:14:55.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.022+0000 7effe22cd640 1 -- 172.21.15.123:0/69127345 learned_addr learned my addr 172.21.15.123:0/69127345 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:55.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.022+0000 7effe1acc640 1 --2- 172.21.15.123:0/69127345 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555ff80150b0 0x555ff80d5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.022+0000 7effe2ace640 1 --2- 172.21.15.123:0/69127345 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555ff806c9f0 0x555ff8039410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.022+0000 7effe22cd640 1 -- 172.21.15.123:0/69127345 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555ff806c9f0 msgr2=0x555ff8039410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.022+0000 7effe22cd640 1 --2- 172.21.15.123:0/69127345 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555ff806c9f0 0x555ff8039410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.022+0000 7effe22cd640 1 -- 172.21.15.123:0/69127345 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555ff80150b0 msgr2=0x555ff80d5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.022+0000 7effe22cd640 1 --2- 172.21.15.123:0/69127345 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555ff80150b0 0x555ff80d5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.022+0000 7effe22cd640 1 -- 172.21.15.123:0/69127345 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ff8032580 con 0x555ff8013920 2024-09-15T23:14:55.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.022+0000 7effe1acc640 1 --2- 172.21.15.123:0/69127345 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555ff80150b0 0x555ff80d5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:55.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.022+0000 7effe22cd640 1 --2- 172.21.15.123:0/69127345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555ff8013920 0x555ff805a5b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7effd40763b0 tx=0x7effd4009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3742bf1621143a57 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:55.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.022+0000 7effc17fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:55.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.022+0000 7effc17fa640 1 -- 172.21.15.123:0/69127345 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd4079800 con 0x555ff8013920 2024-09-15T23:14:55.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.022+0000 7effc17fa640 1 -- 172.21.15.123:0/69127345 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(53..53 src has 1..53) ==== 5854+0+0 (secure 0 0 0) 0x7effd40802b0 con 0x555ff8013920 2024-09-15T23:14:55.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.022+0000 7effe72d1740 1 -- 172.21.15.123:0/69127345 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effd402ae50 con 0x555ff8013920 2024-09-15T23:14:55.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.023+0000 7effc17fa640 1 -- 172.21.15.123:0/69127345 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7effd4006e10 con 0x555ff8013920 2024-09-15T23:14:55.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.023+0000 7effe72d1740 10 client.5685 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:55.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.023+0000 7effe72d1740 1 -- 172.21.15.123:0/69127345 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x555ff8032580 con 0x555ff8013920 2024-09-15T23:14:55.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.023+0000 7effc17fa640 1 -- 172.21.15.123:0/69127345 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effd402ae50 con 0x555ff8013920 2024-09-15T23:14:55.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.023+0000 7effc17fa640 1 -- 172.21.15.123:0/69127345 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7effd40788f0 con 0x555ff8013920 2024-09-15T23:14:55.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.023+0000 7effe72d1740 10 client.5685 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:55.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.023+0000 7effe72d1740 10 client.5685 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:55.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.023+0000 7effe72d1740 20 client.5685 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:55.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.023+0000 7effe72d1740 1 --2- 172.21.15.123:0/69127345 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x555ff800e050 0x555ff8055290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.023+0000 7effe72d1740 4 client.5685 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:14:55.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.023+0000 7effe72d1740 1 -- 172.21.15.123:0/69127345 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555ff7f7e170 con 0x555ff800e050 2024-09-15T23:14:55.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.023+0000 7effe1acc640 1 --2- 172.21.15.123:0/69127345 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x555ff800e050 0x555ff8055290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.023+0000 7effc17fa640 10 client.5685 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:55.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.023+0000 7effe1acc640 1 --2- 172.21.15.123:0/69127345 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x555ff800e050 0x555ff8055290 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=873877297b4f04be server_cookie=55b6fd1f6a6da820 in_seq=0 out_seq=0 2024-09-15T23:14:55.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.024+0000 7effc17fa640 1 -- 172.21.15.123:0/69127345 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x555ff7f7e170 con 0x555ff800e050 2024-09-15T23:14:55.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.024+0000 7effc17fa640 10 client.5685 handle_command_reply: tid=0 2024-09-15T23:14:55.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.024+0000 7effe72d1740 1 client.5685 shutdown 2024-09-15T23:14:55.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.024+0000 7effe72d1740 1 -- 172.21.15.123:0/69127345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555ff8013920 msgr2=0x555ff805a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.024+0000 7effe72d1740 1 --2- 172.21.15.123:0/69127345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555ff8013920 0x555ff805a5b0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7effd40763b0 tx=0x7effd4009190 comp rx=0 tx=0).stop 2024-09-15T23:14:55.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.024+0000 7effe72d1740 1 -- 172.21.15.123:0/69127345 shutdown_connections 2024-09-15T23:14:55.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.024+0000 7effe72d1740 1 --2- 172.21.15.123:0/69127345 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x555ff800e050 0x555ff8055290 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.024+0000 7effe72d1740 1 --2- 172.21.15.123:0/69127345 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555ff806c9f0 0x555ff8039410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.024+0000 7effe72d1740 1 --2- 172.21.15.123:0/69127345 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555ff80150b0 0x555ff80d5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.024+0000 7effc17fa640 0 client.5685 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:55.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.024+0000 7effe72d1740 1 --2- 172.21.15.123:0/69127345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555ff8013920 0x555ff805a5b0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.024+0000 7effe72d1740 1 -- 172.21.15.123:0/69127345 >> 172.21.15.123:0/69127345 conn(0x555ff80110e0 msgr2=0x555ff800d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:55.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.024+0000 7effe72d1740 1 -- 172.21.15.123:0/69127345 shutdown_connections 2024-09-15T23:14:55.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.024+0000 7effe72d1740 1 -- 172.21.15.123:0/69127345 wait complete. 2024-09-15T23:14:55.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.024+0000 7effe72d1740 20 client.5685 trim_cache size 0 max 16384 2024-09-15T23:14:55.033 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:14:55.033 INFO:teuthology.orchestra.run.smithi123.stdout: "status": "no active scrubs running", 2024-09-15T23:14:55.033 INFO:teuthology.orchestra.run.smithi123.stdout: "scrubs": {} 2024-09-15T23:14:55.033 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:14:55.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.024+0000 7effe4531640 1 -- 172.21.15.123:0/462517549 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7effc806c2b0 msgr2=0x7effc806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.024+0000 7effe4531640 1 --2- 172.21.15.123:0/462517549 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7effc806c2b0 0x7effc806e770 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7effdc1654a0 tx=0x7effd0009040 comp rx=0 tx=0).stop 2024-09-15T23:14:55.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.024+0000 7effe4531640 1 -- 172.21.15.123:0/462517549 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effdc0ccf30 msgr2=0x7effdc14a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.024+0000 7effe4531640 1 --2- 172.21.15.123:0/462517549 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effdc0ccf30 0x7effdc14a380 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7effd4035040 tx=0x7effd40046c0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.024+0000 7effe4531640 1 -- 172.21.15.123:0/462517549 shutdown_connections 2024-09-15T23:14:55.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.024+0000 7effe4531640 1 --2- 172.21.15.123:0/462517549 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7effdc15b7c0 0x7effdc14e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.024+0000 7effe4531640 1 --2- 172.21.15.123:0/462517549 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7effdc0cead0 0x7effdc166210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.024+0000 7effe4531640 1 --2- 172.21.15.123:0/462517549 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7effc806c2b0 0x7effc806e770 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.024+0000 7effe4531640 1 --2- 172.21.15.123:0/462517549 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effdc0ccf30 0x7effdc14a380 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.024+0000 7effe4531640 1 -- 172.21.15.123:0/462517549 >> 172.21.15.123:0/462517549 conn(0x7effdc06d0f0 msgr2=0x7effdc0b4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:55.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.025+0000 7effe4531640 1 -- 172.21.15.123:0/462517549 shutdown_connections 2024-09-15T23:14:55.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.025+0000 7effe4531640 1 -- 172.21.15.123:0/462517549 wait complete. 2024-09-15T23:14:55.037 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T23:14:55.041 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-09-15T23:14:55.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.140+0000 7f4a4e19a640 1 Processor -- start 2024-09-15T23:14:55.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.140+0000 7f4a4e19a640 1 -- start start 2024-09-15T23:14:55.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.140+0000 7f4a4e19a640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4a48155950 0x7f4a48073600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.140+0000 7f4a4e19a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a48162c80 0x7f4a4806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.140+0000 7f4a4e19a640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a48073cc0 con 0x7f4a4806c150 2024-09-15T23:14:55.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.140+0000 7f4a4e19a640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f4a48070370 con 0x7f4a48155950 2024-09-15T23:14:55.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.140+0000 7f4a4e19a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4a48071aa0 con 0x7f4a48162c80 2024-09-15T23:14:55.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.141+0000 7f4a46ffd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a48162c80 0x7f4a4806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.141+0000 7f4a477fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4a48155950 0x7f4a48073600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.141+0000 7f4a47fff640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f4a4806c150 0x7f4a480afb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:59742/0 (socket says 172.21.15.123:59742) 2024-09-15T23:14:55.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.141+0000 7f4a47fff640 1 -- 172.21.15.123:0/3634634601 learned_addr learned my addr 172.21.15.123:0/3634634601 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:55.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.141+0000 7f4a467fc640 1 -- 172.21.15.123:0/3634634601 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2805261085 0 0) 0x7f4a48073cc0 con 0x7f4a4806c150 2024-09-15T23:14:55.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.141+0000 7f4a46ffd640 1 -- 172.21.15.123:0/3634634601 >> v2:172.21.15.188:3300/0 conn(0x7f4a48155950 msgr2=0x7f4a48073600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.141+0000 7f4a46ffd640 1 --2- 172.21.15.123:0/3634634601 >> v2:172.21.15.188:3300/0 conn(0x7f4a48155950 0x7f4a48073600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.141+0000 7f4a46ffd640 1 -- 172.21.15.123:0/3634634601 >> v1:172.21.15.188:6789/0 conn(0x7f4a4806c150 legacy=0x7f4a480afb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.141+0000 7f4a46ffd640 1 -- 172.21.15.123:0/3634634601 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a48071d80 con 0x7f4a48162c80 2024-09-15T23:14:55.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.141+0000 7f4a477fe640 1 --2- 172.21.15.123:0/3634634601 >> v2:172.21.15.188:3300/0 conn(0x7f4a48155950 0x7f4a48073600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:14:55.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.142+0000 7f4a46ffd640 1 --2- 172.21.15.123:0/3634634601 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a48162c80 0x7f4a4806bc10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c0097a0 tx=0x7f4a3c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be1e3df06e72c939 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:55.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.142+0000 7f4a467fc640 1 -- 172.21.15.123:0/3634634601 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c037070 con 0x7f4a48162c80 2024-09-15T23:14:55.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.142+0000 7f4a467fc640 1 -- 172.21.15.123:0/3634634601 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a3c032440 con 0x7f4a48162c80 2024-09-15T23:14:55.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.142+0000 7f4a467fc640 1 -- 172.21.15.123:0/3634634601 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c032810 con 0x7f4a48162c80 2024-09-15T23:14:55.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.143+0000 7f4a4e19a640 1 -- 172.21.15.123:0/3634634601 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a48162c80 msgr2=0x7f4a4806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.143+0000 7f4a4e19a640 1 --2- 172.21.15.123:0/3634634601 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a48162c80 0x7f4a4806bc10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c0097a0 tx=0x7f4a3c02a180 comp rx=0 tx=0).stop 2024-09-15T23:14:55.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.143+0000 7f4a4e19a640 1 -- 172.21.15.123:0/3634634601 shutdown_connections 2024-09-15T23:14:55.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.143+0000 7f4a4e19a640 1 --2- 172.21.15.123:0/3634634601 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a48162c80 0x7f4a4806bc10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.143+0000 7f4a4e19a640 1 --2- 172.21.15.123:0/3634634601 >> v2:172.21.15.188:3300/0 conn(0x7f4a48155950 0x7f4a48073600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.143+0000 7f4a4e19a640 1 -- 172.21.15.123:0/3634634601 >> 172.21.15.123:0/3634634601 conn(0x7f4a4806db30 msgr2=0x7f4a4806df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:55.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.143+0000 7f4a4e19a640 1 -- 172.21.15.123:0/3634634601 shutdown_connections 2024-09-15T23:14:55.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.143+0000 7f4a4e19a640 1 -- 172.21.15.123:0/3634634601 wait complete. 2024-09-15T23:14:55.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.144+0000 7f4a4e19a640 1 Processor -- start 2024-09-15T23:14:55.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.144+0000 7f4a4e19a640 1 -- start start 2024-09-15T23:14:55.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.145+0000 7f4a4e19a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a4806c150 0x7f4a48157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.145+0000 7f4a4e19a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a48162c80 0x7f4a48158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.145+0000 7f4a4e19a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a481488f0 0x7f4a480cff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.145+0000 7f4a4e19a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4a480721e0 con 0x7f4a481488f0 2024-09-15T23:14:55.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.145+0000 7f4a4e19a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4a48072060 con 0x7f4a4806c150 2024-09-15T23:14:55.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.145+0000 7f4a4e19a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4a480b0230 con 0x7f4a48162c80 2024-09-15T23:14:55.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.145+0000 7f4a47fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a481488f0 0x7f4a480cff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.145+0000 7f4a47fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a481488f0 0x7f4a480cff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48442/0 (socket says 172.21.15.123:48442) 2024-09-15T23:14:55.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.145+0000 7f4a47fff640 1 -- 172.21.15.123:0/3040281101 learned_addr learned my addr 172.21.15.123:0/3040281101 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:55.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.145+0000 7f4a46ffd640 1 --2- 172.21.15.123:0/3040281101 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a48162c80 0x7f4a48158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.145+0000 7f4a477fe640 1 --2- 172.21.15.123:0/3040281101 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a4806c150 0x7f4a48157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.145+0000 7f4a47fff640 1 -- 172.21.15.123:0/3040281101 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a48162c80 msgr2=0x7f4a48158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.145+0000 7f4a47fff640 1 --2- 172.21.15.123:0/3040281101 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a48162c80 0x7f4a48158940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.145+0000 7f4a47fff640 1 -- 172.21.15.123:0/3040281101 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a4806c150 msgr2=0x7f4a48157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.145+0000 7f4a47fff640 1 --2- 172.21.15.123:0/3040281101 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a4806c150 0x7f4a48157150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.145+0000 7f4a47fff640 1 -- 172.21.15.123:0/3040281101 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a480cebb0 con 0x7f4a481488f0 2024-09-15T23:14:55.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.145+0000 7f4a47fff640 1 --2- 172.21.15.123:0/3040281101 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a481488f0 0x7f4a480cff30 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4a4000c780 tx=0x7f4a4000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:55.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.146+0000 7f4a2ffff640 1 -- 172.21.15.123:0/3040281101 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a40018070 con 0x7f4a481488f0 2024-09-15T23:14:55.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.146+0000 7f4a2ffff640 1 -- 172.21.15.123:0/3040281101 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a4000ce30 con 0x7f4a481488f0 2024-09-15T23:14:55.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.146+0000 7f4a2ffff640 1 -- 172.21.15.123:0/3040281101 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4000a7e0 con 0x7f4a481488f0 2024-09-15T23:14:55.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.146+0000 7f4a4e19a640 1 -- 172.21.15.123:0/3040281101 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a480cee90 con 0x7f4a481488f0 2024-09-15T23:14:55.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.146+0000 7f4a4e19a640 1 -- 172.21.15.123:0/3040281101 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a480cf450 con 0x7f4a481488f0 2024-09-15T23:14:55.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.147+0000 7f4a2ffff640 1 -- 172.21.15.123:0/3040281101 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4a4000a980 con 0x7f4a481488f0 2024-09-15T23:14:55.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.147+0000 7f4a2ffff640 1 --2- 172.21.15.123:0/3040281101 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4a3406c2b0 0x7f4a3406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.148+0000 7f4a2ffff640 1 -- 172.21.15.123:0/3040281101 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5854+0+0 (secure 0 0 0) 0x7f4a4008a9e0 con 0x7f4a481488f0 2024-09-15T23:14:55.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.148+0000 7f4a477fe640 1 --2- 172.21.15.123:0/3040281101 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4a3406c2b0 0x7f4a3406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.148+0000 7f4a477fe640 1 --2- 172.21.15.123:0/3040281101 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4a3406c2b0 0x7f4a3406e770 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4a38009560 tx=0x7f4a38009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:55.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.148+0000 7f4a5100e740 1 Processor -- start 2024-09-15T23:14:55.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.148+0000 7f4a5100e740 1 -- start start 2024-09-15T23:14:55.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.149+0000 7f4a5100e740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559d388485d0 0x559d388489b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.149+0000 7f4a5100e740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d38845d90 0x559d38847920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.149+0000 7f4a5100e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559d388461f0 0x559d38828550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.149+0000 7f4a5100e740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x559d387645d0 con 0x559d38845d90 2024-09-15T23:14:55.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.149+0000 7f4a5100e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x559d3870c470 con 0x559d388461f0 2024-09-15T23:14:55.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.149+0000 7f4a5100e740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x559d38760590 con 0x559d388485d0 2024-09-15T23:14:55.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.149+0000 7f4a46ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d38845d90 0x559d38847920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.149+0000 7f4a46ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d38845d90 0x559d38847920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48456/0 (socket says 172.21.15.123:48456) 2024-09-15T23:14:55.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.149+0000 7f4a46ffd640 1 -- 172.21.15.123:0/1400694657 learned_addr learned my addr 172.21.15.123:0/1400694657 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:55.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.149+0000 7f4a477fe640 1 --2- 172.21.15.123:0/1400694657 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559d388485d0 0x559d388489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.150+0000 7f4a47fff640 1 --2- 172.21.15.123:0/1400694657 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559d388461f0 0x559d38828550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.150+0000 7f4a46ffd640 1 -- 172.21.15.123:0/1400694657 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559d388485d0 msgr2=0x559d388489b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.150+0000 7f4a46ffd640 1 --2- 172.21.15.123:0/1400694657 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559d388485d0 0x559d388489b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.150+0000 7f4a46ffd640 1 -- 172.21.15.123:0/1400694657 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559d388461f0 msgr2=0x559d38828550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.150+0000 7f4a46ffd640 1 --2- 172.21.15.123:0/1400694657 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559d388461f0 0x559d38828550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.150+0000 7f4a46ffd640 1 -- 172.21.15.123:0/1400694657 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d386f4860 con 0x559d38845d90 2024-09-15T23:14:55.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.150+0000 7f4a46ffd640 1 --2- 172.21.15.123:0/1400694657 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d38845d90 0x559d38847920 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c0097a0 tx=0x7f4a3c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff2a18b4ccd39b31 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:55.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.150+0000 7f4a2d7fa640 1 -- 172.21.15.123:0/1400694657 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c041030 con 0x559d38845d90 2024-09-15T23:14:55.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.150+0000 7f4a2d7fa640 1 -- 172.21.15.123:0/1400694657 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a3c038040 con 0x559d38845d90 2024-09-15T23:14:55.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.150+0000 7f4a2d7fa640 1 -- 172.21.15.123:0/1400694657 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c037070 con 0x559d38845d90 2024-09-15T23:14:55.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.151+0000 7f4a5100e740 1 -- 172.21.15.123:0/1400694657 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d38845d90 msgr2=0x559d38847920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.151+0000 7f4a5100e740 1 --2- 172.21.15.123:0/1400694657 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d38845d90 0x559d38847920 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c0097a0 tx=0x7f4a3c02c000 comp rx=0 tx=0).stop 2024-09-15T23:14:55.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.151+0000 7f4a5100e740 1 -- 172.21.15.123:0/1400694657 shutdown_connections 2024-09-15T23:14:55.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.151+0000 7f4a5100e740 1 --2- 172.21.15.123:0/1400694657 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559d388461f0 0x559d38828550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.151+0000 7f4a5100e740 1 --2- 172.21.15.123:0/1400694657 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d38845d90 0x559d38847920 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.151+0000 7f4a5100e740 1 --2- 172.21.15.123:0/1400694657 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559d388485d0 0x559d388489b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.151+0000 7f4a5100e740 1 -- 172.21.15.123:0/1400694657 >> 172.21.15.123:0/1400694657 conn(0x559d387fe230 msgr2=0x559d38846640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:55.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.151+0000 7f4a5100e740 1 -- 172.21.15.123:0/1400694657 shutdown_connections 2024-09-15T23:14:55.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.151+0000 7f4a5100e740 1 -- 172.21.15.123:0/1400694657 wait complete. 2024-09-15T23:14:55.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.151+0000 7f4a5100e740 1 -- start start 2024-09-15T23:14:55.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.152+0000 7f4a5100e740 1 Processor -- start 2024-09-15T23:14:55.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.152+0000 7f4a5100e740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d388461f0 0x559d388576b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.152+0000 7f4a5100e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559d388485d0 0x559d3882bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.152+0000 7f4a5100e740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559d3883f290 0x559d38857df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.152+0000 7f4a5100e740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x559d38844cf0 con 0x559d388461f0 2024-09-15T23:14:55.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.152+0000 7f4a5100e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x559d386ed620 con 0x559d388485d0 2024-09-15T23:14:55.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.152+0000 7f4a5100e740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x559d38844fd0 con 0x559d3883f290 2024-09-15T23:14:55.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.152+0000 7f4a5100e740 10 client.0 _ll_register_callbacks cb 0x559d387115b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:55.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.152+0000 7f4a477fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d388461f0 0x559d388576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.152+0000 7f4a477fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d388461f0 0x559d388576b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48464/0 (socket says 172.21.15.123:48464) 2024-09-15T23:14:55.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.152+0000 7f4a477fe640 1 -- 172.21.15.123:0/665954655 learned_addr learned my addr 172.21.15.123:0/665954655 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:55.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.152+0000 7f4a47fff640 1 --2- 172.21.15.123:0/665954655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559d3883f290 0x559d38857df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.152+0000 7f4a46ffd640 1 --2- 172.21.15.123:0/665954655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559d388485d0 0x559d3882bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.153+0000 7f4a477fe640 1 -- 172.21.15.123:0/665954655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559d3883f290 msgr2=0x559d38857df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.153+0000 7f4a477fe640 1 --2- 172.21.15.123:0/665954655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559d3883f290 0x559d38857df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.153+0000 7f4a477fe640 1 -- 172.21.15.123:0/665954655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559d388485d0 msgr2=0x559d3882bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.153+0000 7f4a477fe640 1 --2- 172.21.15.123:0/665954655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559d388485d0 0x559d3882bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.153+0000 7f4a477fe640 1 -- 172.21.15.123:0/665954655 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d384773f0 con 0x559d388461f0 2024-09-15T23:14:55.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.153+0000 7f4a477fe640 1 --2- 172.21.15.123:0/665954655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d388461f0 0x559d388576b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4a38003710 tx=0x7f4a380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7157f4b245a5cf9b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:55.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.153+0000 7f4a267fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:55.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.153+0000 7f4a267fc640 1 -- 172.21.15.123:0/665954655 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a38027070 con 0x559d388461f0 2024-09-15T23:14:55.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.153+0000 7f4a267fc640 1 -- 172.21.15.123:0/665954655 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(53..53 src has 1..53) ==== 5854+0+0 (secure 0 0 0) 0x7f4a38014440 con 0x559d388461f0 2024-09-15T23:14:55.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.153+0000 7f4a5100e740 1 -- 172.21.15.123:0/665954655 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a3c038040 con 0x559d388461f0 2024-09-15T23:14:55.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.153+0000 7f4a267fc640 1 -- 172.21.15.123:0/665954655 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f4a38032050 con 0x559d388461f0 2024-09-15T23:14:55.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.153+0000 7f4a5100e740 10 client.5694 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:55.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.153+0000 7f4a5100e740 1 -- 172.21.15.123:0/665954655 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x559d385417d0 con 0x559d388461f0 2024-09-15T23:14:55.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.153+0000 7f4a267fc640 1 -- 172.21.15.123:0/665954655 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a3c038040 con 0x559d388461f0 2024-09-15T23:14:55.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.153+0000 7f4a267fc640 1 -- 172.21.15.123:0/665954655 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f4a38035020 con 0x559d388461f0 2024-09-15T23:14:55.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.153+0000 7f4a5100e740 10 client.5694 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:55.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.153+0000 7f4a5100e740 10 client.5694 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:55.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.153+0000 7f4a5100e740 20 client.5694 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:55.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.153+0000 7f4a5100e740 1 --2- 172.21.15.123:0/665954655 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x559d3884d1f0 0x559d38800820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.153+0000 7f4a5100e740 4 client.5694 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:14:55.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.153+0000 7f4a5100e740 1 -- 172.21.15.123:0/665954655 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d387c3030 con 0x559d3884d1f0 2024-09-15T23:14:55.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.154+0000 7f4a46ffd640 1 --2- 172.21.15.123:0/665954655 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x559d3884d1f0 0x559d38800820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.154+0000 7f4a46ffd640 1 --2- 172.21.15.123:0/665954655 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x559d3884d1f0 0x559d38800820 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19b075643914b88e server_cookie=9de5d0973e2e3fcd in_seq=0 out_seq=0 2024-09-15T23:14:55.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.154+0000 7f4a267fc640 10 client.5694 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:55.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.154+0000 7f4a267fc640 1 -- 172.21.15.123:0/665954655 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559d387c3030 con 0x559d3884d1f0 2024-09-15T23:14:55.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.154+0000 7f4a267fc640 10 client.5694 handle_command_reply: tid=0 2024-09-15T23:14:55.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.155+0000 7f4a5100e740 1 client.5694 shutdown 2024-09-15T23:14:55.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.155+0000 7f4a5100e740 1 -- 172.21.15.123:0/665954655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d388461f0 msgr2=0x559d388576b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.155+0000 7f4a5100e740 1 --2- 172.21.15.123:0/665954655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d388461f0 0x559d388576b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4a38003710 tx=0x7f4a380046c0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.155+0000 7f4a5100e740 1 -- 172.21.15.123:0/665954655 shutdown_connections 2024-09-15T23:14:55.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.155+0000 7f4a5100e740 1 --2- 172.21.15.123:0/665954655 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x559d3884d1f0 0x559d38800820 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.155+0000 7f4a5100e740 1 --2- 172.21.15.123:0/665954655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559d3883f290 0x559d38857df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.155+0000 7f4a5100e740 1 --2- 172.21.15.123:0/665954655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559d388485d0 0x559d3882bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.155+0000 7f4a267fc640 0 client.5694 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:55.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.155+0000 7f4a5100e740 1 --2- 172.21.15.123:0/665954655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d388461f0 0x559d388576b0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.155+0000 7f4a5100e740 1 -- 172.21.15.123:0/665954655 >> 172.21.15.123:0/665954655 conn(0x559d38845d90 msgr2=0x559d38848f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:55.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.155+0000 7f4a5100e740 1 -- 172.21.15.123:0/665954655 shutdown_connections 2024-09-15T23:14:55.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.155+0000 7f4a5100e740 1 -- 172.21.15.123:0/665954655 wait complete. 2024-09-15T23:14:55.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.155+0000 7f4a5100e740 20 client.5694 trim_cache size 0 max 16384 2024-09-15T23:14:55.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.168+0000 7f4a5100e740 1 Processor -- start 2024-09-15T23:14:55.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.168+0000 7f4a5100e740 1 -- start start 2024-09-15T23:14:55.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.169+0000 7f4a5100e740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d3883f290 0x559d3886a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.169+0000 7f4a5100e740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559d388461f0 0x559d387fc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.169+0000 7f4a5100e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559d388485d0 0x559d3882b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.169+0000 7f4a5100e740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4a48200b30 con 0x559d3883f290 2024-09-15T23:14:55.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.169+0000 7f4a5100e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4a481ffc00 con 0x559d388485d0 2024-09-15T23:14:55.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.169+0000 7f4a5100e740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4a480ce5a0 con 0x559d388461f0 2024-09-15T23:14:55.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.169+0000 7f4a477fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d3883f290 0x559d3886a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.169+0000 7f4a477fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d3883f290 0x559d3886a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48470/0 (socket says 172.21.15.123:48470) 2024-09-15T23:14:55.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.169+0000 7f4a477fe640 1 -- 172.21.15.123:0/1842775694 learned_addr learned my addr 172.21.15.123:0/1842775694 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:55.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.169+0000 7f4a477fe640 1 -- 172.21.15.123:0/1842775694 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559d388461f0 msgr2=0x559d387fc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.169+0000 7f4a477fe640 1 --2- 172.21.15.123:0/1842775694 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559d388461f0 0x559d387fc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.169+0000 7f4a477fe640 1 -- 172.21.15.123:0/1842775694 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559d388485d0 msgr2=0x559d3882b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.169+0000 7f4a47fff640 1 --2- 172.21.15.123:0/1842775694 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559d388485d0 0x559d3882b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.169+0000 7f4a477fe640 1 --2- 172.21.15.123:0/1842775694 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559d388485d0 0x559d3882b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.169+0000 7f4a477fe640 1 -- 172.21.15.123:0/1842775694 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d388441d0 con 0x559d3883f290 2024-09-15T23:14:55.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.169+0000 7f4a47fff640 1 --2- 172.21.15.123:0/1842775694 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559d388485d0 0x559d3882b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:55.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.169+0000 7f4a477fe640 1 --2- 172.21.15.123:0/1842775694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d3883f290 0x559d3886a7d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4a38004100 tx=0x7f4a38024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54289ec79cff5917 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:55.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.169+0000 7f4a2cff9640 1 -- 172.21.15.123:0/1842775694 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a3803b070 con 0x559d3883f290 2024-09-15T23:14:55.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.169+0000 7f4a2cff9640 1 -- 172.21.15.123:0/1842775694 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a38014930 con 0x559d3883f290 2024-09-15T23:14:55.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.169+0000 7f4a2cff9640 1 -- 172.21.15.123:0/1842775694 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a38027070 con 0x559d3883f290 2024-09-15T23:14:55.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.170+0000 7f4a5100e740 1 -- 172.21.15.123:0/1842775694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d3883f290 msgr2=0x559d3886a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.170+0000 7f4a5100e740 1 --2- 172.21.15.123:0/1842775694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d3883f290 0x559d3886a7d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4a38004100 tx=0x7f4a38024000 comp rx=0 tx=0).stop 2024-09-15T23:14:55.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.170+0000 7f4a5100e740 1 -- 172.21.15.123:0/1842775694 shutdown_connections 2024-09-15T23:14:55.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.170+0000 7f4a5100e740 1 --2- 172.21.15.123:0/1842775694 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559d388485d0 0x559d3882b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.170+0000 7f4a5100e740 1 --2- 172.21.15.123:0/1842775694 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559d388461f0 0x559d387fc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.170+0000 7f4a5100e740 1 --2- 172.21.15.123:0/1842775694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d3883f290 0x559d3886a7d0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.170+0000 7f4a5100e740 1 -- 172.21.15.123:0/1842775694 >> 172.21.15.123:0/1842775694 conn(0x559d38845d90 msgr2=0x559d3883ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:55.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.170+0000 7f4a5100e740 1 -- 172.21.15.123:0/1842775694 shutdown_connections 2024-09-15T23:14:55.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.170+0000 7f4a5100e740 1 -- 172.21.15.123:0/1842775694 wait complete. 2024-09-15T23:14:55.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.171+0000 7f4a5100e740 1 -- start start 2024-09-15T23:14:55.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.171+0000 7f4a5100e740 1 Processor -- start 2024-09-15T23:14:55.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.171+0000 7f4a5100e740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559d3883f290 0x559d38846fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.171+0000 7f4a5100e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559d388461f0 0x559d388c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.171+0000 7f4a5100e740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d388485d0 0x559d388ad250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.171+0000 7f4a5100e740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4a480b1c70 con 0x559d388485d0 2024-09-15T23:14:55.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.171+0000 7f4a5100e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x559d3883d2b0 con 0x559d388461f0 2024-09-15T23:14:55.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.171+0000 7f4a5100e740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x559d388c5140 con 0x559d3883f290 2024-09-15T23:14:55.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.171+0000 7f4a5100e740 10 client.0 _ll_register_callbacks cb 0x7f4a38011b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:55.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.171+0000 7f4a47fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d388485d0 0x559d388ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.171+0000 7f4a47fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d388485d0 0x559d388ad250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48474/0 (socket says 172.21.15.123:48474) 2024-09-15T23:14:55.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.172+0000 7f4a47fff640 1 -- 172.21.15.123:0/901022834 learned_addr learned my addr 172.21.15.123:0/901022834 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:55.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.172+0000 7f4a477fe640 1 --2- 172.21.15.123:0/901022834 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559d3883f290 0x559d38846fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.172+0000 7f4a46ffd640 1 --2- 172.21.15.123:0/901022834 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559d388461f0 0x559d388c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.172+0000 7f4a47fff640 1 -- 172.21.15.123:0/901022834 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559d3883f290 msgr2=0x559d38846fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.172+0000 7f4a47fff640 1 --2- 172.21.15.123:0/901022834 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559d3883f290 0x559d38846fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.172+0000 7f4a47fff640 1 -- 172.21.15.123:0/901022834 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559d388461f0 msgr2=0x559d388c4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.172+0000 7f4a47fff640 1 --2- 172.21.15.123:0/901022834 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559d388461f0 0x559d388c4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.172+0000 7f4a47fff640 1 -- 172.21.15.123:0/901022834 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d387fd5c0 con 0x559d388485d0 2024-09-15T23:14:55.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.172+0000 7f4a47fff640 1 --2- 172.21.15.123:0/901022834 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d388485d0 0x559d388ad250 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f4a40004fd0 tx=0x7f4a40056c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c44fd3321828fc4f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:55.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.172+0000 7f4a267fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:55.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.172+0000 7f4a267fc640 1 -- 172.21.15.123:0/901022834 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a40070ba0 con 0x559d388485d0 2024-09-15T23:14:55.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.172+0000 7f4a267fc640 1 -- 172.21.15.123:0/901022834 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(53..53 src has 1..53) ==== 5854+0+0 (secure 0 0 0) 0x7f4a40070d40 con 0x559d388485d0 2024-09-15T23:14:55.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.172+0000 7f4a5100e740 1 -- 172.21.15.123:0/901022834 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a38014930 con 0x559d388485d0 2024-09-15T23:14:55.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.172+0000 7f4a267fc640 1 -- 172.21.15.123:0/901022834 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f4a40057db0 con 0x559d388485d0 2024-09-15T23:14:55.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.172+0000 7f4a5100e740 10 client.5700 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:55.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.172+0000 7f4a5100e740 1 -- 172.21.15.123:0/901022834 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x559d388ad7f0 con 0x559d388485d0 2024-09-15T23:14:55.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.172+0000 7f4a267fc640 1 -- 172.21.15.123:0/901022834 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a38014930 con 0x559d388485d0 2024-09-15T23:14:55.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.172+0000 7f4a267fc640 1 -- 172.21.15.123:0/901022834 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f4a40057f50 con 0x559d388485d0 2024-09-15T23:14:55.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.172+0000 7f4a5100e740 10 client.5700 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:55.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.172+0000 7f4a5100e740 10 client.5700 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:55.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.172+0000 7f4a5100e740 20 client.5700 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:55.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.172+0000 7f4a5100e740 1 --2- 172.21.15.123:0/901022834 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x559d3883d690 0x559d3883daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.172+0000 7f4a5100e740 4 client.5700 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:14:55.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.172+0000 7f4a5100e740 1 -- 172.21.15.123:0/901022834 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559d38771d00 con 0x559d3883d690 2024-09-15T23:14:55.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.173+0000 7f4a477fe640 1 --2- 172.21.15.123:0/901022834 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x559d3883d690 0x559d3883daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.173+0000 7f4a267fc640 10 client.5700 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:55.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.173+0000 7f4a477fe640 1 --2- 172.21.15.123:0/901022834 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x559d3883d690 0x559d3883daa0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac1a08e312157857 server_cookie=b611e79b4ab44d66 in_seq=0 out_seq=0 2024-09-15T23:14:55.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.173+0000 7f4a267fc640 1 -- 172.21.15.123:0/901022834 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+168 (crc 0 0 0) 0x559d38771d00 con 0x559d3883d690 2024-09-15T23:14:55.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.173+0000 7f4a267fc640 10 client.5700 handle_command_reply: tid=0 2024-09-15T23:14:55.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.173+0000 7f4a5100e740 1 client.5700 shutdown 2024-09-15T23:14:55.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.173+0000 7f4a5100e740 1 -- 172.21.15.123:0/901022834 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d388485d0 msgr2=0x559d388ad250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.173+0000 7f4a5100e740 1 --2- 172.21.15.123:0/901022834 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d388485d0 0x559d388ad250 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f4a40004fd0 tx=0x7f4a40056c60 comp rx=0 tx=0).stop 2024-09-15T23:14:55.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.173+0000 7f4a5100e740 1 -- 172.21.15.123:0/901022834 shutdown_connections 2024-09-15T23:14:55.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.173+0000 7f4a5100e740 1 --2- 172.21.15.123:0/901022834 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x559d3883d690 0x559d3883daa0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.173+0000 7f4a5100e740 1 --2- 172.21.15.123:0/901022834 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d388485d0 0x559d388ad250 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.173+0000 7f4a267fc640 0 client.5700 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:55.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.173+0000 7f4a5100e740 1 --2- 172.21.15.123:0/901022834 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559d388461f0 0x559d388c4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.173+0000 7f4a5100e740 1 --2- 172.21.15.123:0/901022834 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559d3883f290 0x559d38846fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.173+0000 7f4a5100e740 1 -- 172.21.15.123:0/901022834 >> 172.21.15.123:0/901022834 conn(0x559d38845d90 msgr2=0x559d3883fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:55.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.173+0000 7f4a5100e740 1 -- 172.21.15.123:0/901022834 shutdown_connections 2024-09-15T23:14:55.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.173+0000 7f4a5100e740 1 -- 172.21.15.123:0/901022834 wait complete. 2024-09-15T23:14:55.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.173+0000 7f4a5100e740 20 client.5700 trim_cache size 0 max 16384 2024-09-15T23:14:55.182 INFO:teuthology.orchestra.run.smithi123.stdout:[ 2024-09-15T23:14:55.182 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:14:55.182 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-09-15T23:14:55.183 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 3670963752, 2024-09-15T23:14:55.183 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511630412, 2024-09-15T23:14:55.183 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0" 2024-09-15T23:14:55.183 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:14:55.183 INFO:teuthology.orchestra.run.smithi123.stdout:] 2024-09-15T23:14:55.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.174+0000 7f4a4e19a640 1 -- 172.21.15.123:0/3040281101 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4a3406c2b0 msgr2=0x7f4a3406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.174+0000 7f4a4e19a640 1 --2- 172.21.15.123:0/3040281101 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4a3406c2b0 0x7f4a3406e770 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4a38009560 tx=0x7f4a38009190 comp rx=0 tx=0).stop 2024-09-15T23:14:55.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.174+0000 7f4a4e19a640 1 -- 172.21.15.123:0/3040281101 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a481488f0 msgr2=0x7f4a480cff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.174+0000 7f4a4e19a640 1 --2- 172.21.15.123:0/3040281101 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a481488f0 0x7f4a480cff30 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4a4000c780 tx=0x7f4a4000cc40 comp rx=0 tx=0).stop 2024-09-15T23:14:55.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.174+0000 7f4a4e19a640 1 -- 172.21.15.123:0/3040281101 shutdown_connections 2024-09-15T23:14:55.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.174+0000 7f4a4e19a640 1 --2- 172.21.15.123:0/3040281101 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4a3406c2b0 0x7f4a3406e770 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.174+0000 7f4a4e19a640 1 --2- 172.21.15.123:0/3040281101 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a481488f0 0x7f4a480cff30 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.174+0000 7f4a4e19a640 1 --2- 172.21.15.123:0/3040281101 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a48162c80 0x7f4a48158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.174+0000 7f4a4e19a640 1 --2- 172.21.15.123:0/3040281101 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a4806c150 0x7f4a48157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.174+0000 7f4a4e19a640 1 -- 172.21.15.123:0/3040281101 >> 172.21.15.123:0/3040281101 conn(0x7f4a4806db30 msgr2=0x7f4a4806ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:55.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.174+0000 7f4a4e19a640 1 -- 172.21.15.123:0/3040281101 shutdown_connections 2024-09-15T23:14:55.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.174+0000 7f4a4e19a640 1 -- 172.21.15.123:0/3040281101 wait complete. 2024-09-15T23:14:55.186 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:14:55.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.283+0000 7f33b6647640 1 Processor -- start 2024-09-15T23:14:55.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.283+0000 7f33b6647640 1 -- start start 2024-09-15T23:14:55.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.283+0000 7f33b6647640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f33b015e990 0x7f33b00d3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.283+0000 7f33b6647640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f33b00cfba0 0x7f33b00d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.283+0000 7f33b6647640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33b00d3d90 con 0x7f33b00d1460 2024-09-15T23:14:55.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.283+0000 7f33b6647640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f33b00d4070 con 0x7f33b015e990 2024-09-15T23:14:55.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.283+0000 7f33b6647640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f33b00d4350 con 0x7f33b00cfba0 2024-09-15T23:14:55.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.283+0000 7f33affff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f33b015e990 0x7f33b00d3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.283+0000 7f33b4be4640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f33b00d1460 0x7f33b00b6200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41140/0 (socket says 172.21.15.123:41140) 2024-09-15T23:14:55.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.284+0000 7f33b4be4640 1 -- 172.21.15.123:0/410479191 learned_addr learned my addr 172.21.15.123:0/410479191 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:55.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.284+0000 7f33af7fe640 1 --2- 172.21.15.123:0/410479191 >> v2:172.21.15.188:3300/0 conn(0x7f33b00cfba0 0x7f33b00d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.284+0000 7f33affff640 1 -- 172.21.15.123:0/410479191 >> v2:172.21.15.188:3300/0 conn(0x7f33b00cfba0 msgr2=0x7f33b00d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.284+0000 7f33affff640 1 --2- 172.21.15.123:0/410479191 >> v2:172.21.15.188:3300/0 conn(0x7f33b00cfba0 0x7f33b00d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.284+0000 7f33affff640 1 -- 172.21.15.123:0/410479191 >> v1:172.21.15.123:6789/0 conn(0x7f33b00d1460 legacy=0x7f33b00b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.284+0000 7f33aeffd640 1 -- 172.21.15.123:0/410479191 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3466524160 0 0) 0x7f33b00d3d90 con 0x7f33b00d1460 2024-09-15T23:14:55.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.284+0000 7f33affff640 1 -- 172.21.15.123:0/410479191 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b00b7c90 con 0x7f33b015e990 2024-09-15T23:14:55.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.284+0000 7f33af7fe640 1 --2- 172.21.15.123:0/410479191 >> v2:172.21.15.188:3300/0 conn(0x7f33b00cfba0 0x7f33b00d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:55.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.285+0000 7f33affff640 1 --2- 172.21.15.123:0/410479191 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33b015e990 0x7f33b00d3560 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f33b006dee0 tx=0x7f33a002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e7676ce8d3026e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:55.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.285+0000 7f33aeffd640 1 -- 172.21.15.123:0/410479191 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a0037070 con 0x7f33b015e990 2024-09-15T23:14:55.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.285+0000 7f33aeffd640 1 -- 172.21.15.123:0/410479191 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33a0032440 con 0x7f33b015e990 2024-09-15T23:14:55.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.285+0000 7f33aeffd640 1 -- 172.21.15.123:0/410479191 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a0032810 con 0x7f33b015e990 2024-09-15T23:14:55.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.285+0000 7f33b6647640 1 -- 172.21.15.123:0/410479191 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33b015e990 msgr2=0x7f33b00d3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.285+0000 7f33b6647640 1 --2- 172.21.15.123:0/410479191 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33b015e990 0x7f33b00d3560 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f33b006dee0 tx=0x7f33a002a1a0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.285+0000 7f33b6647640 1 -- 172.21.15.123:0/410479191 shutdown_connections 2024-09-15T23:14:55.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.285+0000 7f33b6647640 1 --2- 172.21.15.123:0/410479191 >> v2:172.21.15.188:3300/0 conn(0x7f33b00cfba0 0x7f33b00d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.285+0000 7f33b6647640 1 --2- 172.21.15.123:0/410479191 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33b015e990 0x7f33b00d3560 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.285+0000 7f33b6647640 1 -- 172.21.15.123:0/410479191 >> 172.21.15.123:0/410479191 conn(0x7f33b006c020 msgr2=0x7f33b006c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:55.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.285+0000 7f33b6647640 1 -- 172.21.15.123:0/410479191 shutdown_connections 2024-09-15T23:14:55.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.285+0000 7f33b6647640 1 -- 172.21.15.123:0/410479191 wait complete. 2024-09-15T23:14:55.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.286+0000 7f33b6647640 1 Processor -- start 2024-09-15T23:14:55.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.287+0000 7f33b6647640 1 -- start start 2024-09-15T23:14:55.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.287+0000 7f33b6647640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33b00cfba0 0x7f33b015aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.287+0000 7f33b6647640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33b00d1460 0x7f33b01e8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.287+0000 7f33b6647640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33b015e990 0x7f33b015b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.287+0000 7f33b6647640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f33b00b78b0 con 0x7f33b00d1460 2024-09-15T23:14:55.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.287+0000 7f33b6647640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f33b00d1890 con 0x7f33b015e990 2024-09-15T23:14:55.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.287+0000 7f33b6647640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f33b00b7a30 con 0x7f33b00cfba0 2024-09-15T23:14:55.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.287+0000 7f33af7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33b00d1460 0x7f33b01e8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.287+0000 7f33af7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33b00d1460 0x7f33b01e8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48480/0 (socket says 172.21.15.123:48480) 2024-09-15T23:14:55.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.287+0000 7f33af7fe640 1 -- 172.21.15.123:0/3463340506 learned_addr learned my addr 172.21.15.123:0/3463340506 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:55.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.288+0000 7f33affff640 1 --2- 172.21.15.123:0/3463340506 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33b00cfba0 0x7f33b015aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.288+0000 7f33b4be4640 1 --2- 172.21.15.123:0/3463340506 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33b015e990 0x7f33b015b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.288+0000 7f33af7fe640 1 -- 172.21.15.123:0/3463340506 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33b00cfba0 msgr2=0x7f33b015aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.288+0000 7f33af7fe640 1 --2- 172.21.15.123:0/3463340506 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33b00cfba0 0x7f33b015aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.288+0000 7f33af7fe640 1 -- 172.21.15.123:0/3463340506 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33b015e990 msgr2=0x7f33b015b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.288+0000 7f33af7fe640 1 --2- 172.21.15.123:0/3463340506 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33b015e990 0x7f33b015b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.288+0000 7f33af7fe640 1 -- 172.21.15.123:0/3463340506 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b01e9ef0 con 0x7f33b00d1460 2024-09-15T23:14:55.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.288+0000 7f33b4be4640 1 --2- 172.21.15.123:0/3463340506 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33b015e990 0x7f33b015b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:55.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.288+0000 7f33af7fe640 1 --2- 172.21.15.123:0/3463340506 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33b00d1460 0x7f33b01e8bc0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f33a400c820 tx=0x7f33a400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:55.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.288+0000 7f33acff9640 1 -- 172.21.15.123:0/3463340506 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a4015070 con 0x7f33b00d1460 2024-09-15T23:14:55.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.288+0000 7f33acff9640 1 -- 172.21.15.123:0/3463340506 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33a4007a30 con 0x7f33b00d1460 2024-09-15T23:14:55.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.288+0000 7f33acff9640 1 -- 172.21.15.123:0/3463340506 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a4007de0 con 0x7f33b00d1460 2024-09-15T23:14:55.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.288+0000 7f33b6647640 1 -- 172.21.15.123:0/3463340506 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33b01e9970 con 0x7f33b00d1460 2024-09-15T23:14:55.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.288+0000 7f33b6647640 1 -- 172.21.15.123:0/3463340506 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33b015bcb0 con 0x7f33b00d1460 2024-09-15T23:14:55.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.289+0000 7f33b6647640 1 -- 172.21.15.123:0/3463340506 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33b00d0f20 con 0x7f33b00d1460 2024-09-15T23:14:55.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.290+0000 7f33acff9640 1 -- 172.21.15.123:0/3463340506 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f33a4018070 con 0x7f33b00d1460 2024-09-15T23:14:55.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.290+0000 7f33acff9640 1 --2- 172.21.15.123:0/3463340506 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f339c06c2b0 0x7f339c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.290+0000 7f33acff9640 1 -- 172.21.15.123:0/3463340506 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5854+0+0 (secure 0 0 0) 0x7f33a408b2a0 con 0x7f33b00d1460 2024-09-15T23:14:55.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.290+0000 7f33affff640 1 --2- 172.21.15.123:0/3463340506 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f339c06c2b0 0x7f339c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.291+0000 7f33affff640 1 --2- 172.21.15.123:0/3463340506 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f339c06c2b0 0x7f339c06e770 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f33a0034000 tx=0x7f33a002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:55.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.294+0000 7f33acff9640 1 -- 172.21.15.123:0/3463340506 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f33a40593c0 con 0x7f33b00d1460 2024-09-15T23:14:55.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.497+0000 7f33b6647640 1 -- 172.21.15.123:0/3463340506 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33b00cb0f0 con 0x7f33b00d1460 2024-09-15T23:14:55.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.498+0000 7f33acff9640 1 -- 172.21.15.123:0/3463340506 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5229 (secure 0 0 0) 0x7f33a408b0c0 con 0x7f33b00d1460 2024-09-15T23:14:55.499 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:14:55.499 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":21,"btime":"2024-09-15T23:14:36:243751+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5014,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/354247514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":354247514},{"type":"v1","addr":"172.21.15.188:6837","nonce":354247514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2925346627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2925346627},{"type":"v1","addr":"172.21.15.123:6834","nonce":2925346627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/280703051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":280703051},{"type":"v1","addr":"172.21.15.123:6835","nonce":280703051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:14:32.926325+0000","modified":"2024-09-15T23:14:35.577957+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6836/1307575248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":1307575248},{"type":"v1","addr":"172.21.15.188:6836","nonce":1307575248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":3}]} 2024-09-15T23:14:55.499 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 21 2024-09-15T23:14:55.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.500+0000 7f33b6647640 1 -- 172.21.15.123:0/3463340506 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f339c06c2b0 msgr2=0x7f339c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.500+0000 7f33b6647640 1 --2- 172.21.15.123:0/3463340506 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f339c06c2b0 0x7f339c06e770 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f33a0034000 tx=0x7f33a002e000 comp rx=0 tx=0).stop 2024-09-15T23:14:55.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.500+0000 7f33b6647640 1 -- 172.21.15.123:0/3463340506 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33b00d1460 msgr2=0x7f33b01e8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.500+0000 7f33b6647640 1 --2- 172.21.15.123:0/3463340506 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33b00d1460 0x7f33b01e8bc0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f33a400c820 tx=0x7f33a400cce0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.500+0000 7f33b6647640 1 -- 172.21.15.123:0/3463340506 shutdown_connections 2024-09-15T23:14:55.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.500+0000 7f33b6647640 1 --2- 172.21.15.123:0/3463340506 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33b015e990 0x7f33b015b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.500+0000 7f33b6647640 1 --2- 172.21.15.123:0/3463340506 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f339c06c2b0 0x7f339c06e770 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.500+0000 7f33b6647640 1 --2- 172.21.15.123:0/3463340506 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33b00d1460 0x7f33b01e8bc0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.500+0000 7f33b6647640 1 --2- 172.21.15.123:0/3463340506 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33b00cfba0 0x7f33b015aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.500+0000 7f33b6647640 1 -- 172.21.15.123:0/3463340506 >> 172.21.15.123:0/3463340506 conn(0x7f33b006c020 msgr2=0x7f33b00b5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:55.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.500+0000 7f33b6647640 1 -- 172.21.15.123:0/3463340506 shutdown_connections 2024-09-15T23:14:55.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.500+0000 7f33b6647640 1 -- 172.21.15.123:0/3463340506 wait complete. 2024-09-15T23:14:55.512 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d damage rm 3670963752 2024-09-15T23:14:55.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.612+0000 7fa06492c640 1 Processor -- start 2024-09-15T23:14:55.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.612+0000 7fa06492c640 1 -- start start 2024-09-15T23:14:55.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.613+0000 7fa06492c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa0600ccf30 0x7fa0600b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.613+0000 7fa06492c640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0600cf2e0 con 0x7fa0600cead0 2024-09-15T23:14:55.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.613+0000 7fa06492c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa060070fe0 con 0x7fa06015b7c0 2024-09-15T23:14:55.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.613+0000 7fa06492c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa0600712c0 con 0x7fa0600ccf30 2024-09-15T23:14:55.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.613+0000 7fa05ed9d640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa0600cead0 0x7fa060071ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41146/0 (socket says 172.21.15.123:41146) 2024-09-15T23:14:55.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.613+0000 7fa05ed9d640 1 -- 172.21.15.123:0/2693653908 learned_addr learned my addr 172.21.15.123:0/2693653908 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:55.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.614+0000 7fa05e59c640 1 --2- 172.21.15.123:0/2693653908 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa0600ccf30 0x7fa0600b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.614+0000 7fa05d59a640 1 -- 172.21.15.123:0/2693653908 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2144101069 0 0) 0x7fa0600cf2e0 con 0x7fa0600cead0 2024-09-15T23:14:55.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.614+0000 7fa05d59a640 1 -- 172.21.15.123:0/2693653908 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa04c003520 con 0x7fa0600cead0 2024-09-15T23:14:55.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.614+0000 7fa05d59a640 1 -- 172.21.15.123:0/2693653908 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3010549187 0 0) 0x7fa04c003520 con 0x7fa0600cead0 2024-09-15T23:14:55.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.614+0000 7fa05d59a640 1 -- 172.21.15.123:0/2693653908 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa0600ccf30 msgr2=0x7fa0600b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.614+0000 7fa05d59a640 1 --2- 172.21.15.123:0/2693653908 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa0600ccf30 0x7fa0600b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.614+0000 7fa05d59a640 1 -- 172.21.15.123:0/2693653908 >> v1:172.21.15.188:6789/0 conn(0x7fa06015b7c0 legacy=0x7fa0600cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.614+0000 7fa05d59a640 1 -- 172.21.15.123:0/2693653908 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0600715a0 con 0x7fa0600cead0 2024-09-15T23:14:55.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.614+0000 7fa05d59a640 1 -- 172.21.15.123:0/2693653908 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fa050001670 con 0x7fa0600cead0 2024-09-15T23:14:55.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.614+0000 7fa05d59a640 1 -- 172.21.15.123:0/2693653908 >> v1:172.21.15.123:6789/0 conn(0x7fa0600cead0 legacy=0x7fa060071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.614+0000 7fa05d59a640 1 --2- 172.21.15.123:0/2693653908 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa0600ccf30 0x7fa04c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.614+0000 7fa05d59a640 1 --2- 172.21.15.123:0/2693653908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa04c003f20 0x7fa04c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.614+0000 7fa05d59a640 1 --2- 172.21.15.123:0/2693653908 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa04c004d40 0x7fa04c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.614+0000 7fa05d59a640 1 -- 172.21.15.123:0/2693653908 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa0600712c0 con 0x7fa04c003f20 2024-09-15T23:14:55.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.614+0000 7fa05d59a640 1 -- 172.21.15.123:0/2693653908 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa04c00bad0 con 0x7fa04c004d40 2024-09-15T23:14:55.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.614+0000 7fa05d59a640 1 -- 172.21.15.123:0/2693653908 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa04c00bcd0 con 0x7fa0600ccf30 2024-09-15T23:14:55.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.614+0000 7fa05dd9b640 1 --2- 172.21.15.123:0/2693653908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa04c003f20 0x7fa04c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.614+0000 7fa05e59c640 1 --2- 172.21.15.123:0/2693653908 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa0600ccf30 0x7fa04c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.614+0000 7fa05ed9d640 1 --2- 172.21.15.123:0/2693653908 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa04c004d40 0x7fa04c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.614+0000 7fa05dd9b640 1 -- 172.21.15.123:0/2693653908 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa0600ccf30 msgr2=0x7fa04c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.614+0000 7fa05dd9b640 1 --2- 172.21.15.123:0/2693653908 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa0600ccf30 0x7fa04c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.614+0000 7fa05dd9b640 1 -- 172.21.15.123:0/2693653908 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa04c004d40 msgr2=0x7fa04c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.614+0000 7fa05dd9b640 1 --2- 172.21.15.123:0/2693653908 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa04c004d40 0x7fa04c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.614+0000 7fa05dd9b640 1 -- 172.21.15.123:0/2693653908 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa04c003520 con 0x7fa04c003f20 2024-09-15T23:14:55.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.615+0000 7fa05dd9b640 1 --2- 172.21.15.123:0/2693653908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa04c003f20 0x7fa04c004800 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fa060073a50 tx=0x7fa04c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9cab20bcdb6152d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:55.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.615+0000 7fa05d59a640 1 -- 172.21.15.123:0/2693653908 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa048037070 con 0x7fa04c003f20 2024-09-15T23:14:55.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.615+0000 7fa05d59a640 1 -- 172.21.15.123:0/2693653908 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa04802ab90 con 0x7fa04c003f20 2024-09-15T23:14:55.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.615+0000 7fa05d59a640 1 -- 172.21.15.123:0/2693653908 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa048001430 con 0x7fa04c003f20 2024-09-15T23:14:55.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.616+0000 7fa06492c640 1 -- 172.21.15.123:0/2693653908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa04c003f20 msgr2=0x7fa04c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.616+0000 7fa06492c640 1 --2- 172.21.15.123:0/2693653908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa04c003f20 0x7fa04c004800 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fa060073a50 tx=0x7fa04c005830 comp rx=0 tx=0).stop 2024-09-15T23:14:55.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.616+0000 7fa05ed9d640 1 -- 172.21.15.123:0/2693653908 reap_dead start 2024-09-15T23:14:55.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.616+0000 7fa06492c640 1 -- 172.21.15.123:0/2693653908 shutdown_connections 2024-09-15T23:14:55.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.616+0000 7fa06492c640 1 -- 172.21.15.123:0/2693653908 >> 172.21.15.123:0/2693653908 conn(0x7fa06006d0f0 msgr2=0x7fa06006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:55.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.616+0000 7fa06492c640 1 -- 172.21.15.123:0/2693653908 shutdown_connections 2024-09-15T23:14:55.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.616+0000 7fa06492c640 1 -- 172.21.15.123:0/2693653908 wait complete. 2024-09-15T23:14:55.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.617+0000 7fa06492c640 1 Processor -- start 2024-09-15T23:14:55.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.617+0000 7fa06492c640 1 -- start start 2024-09-15T23:14:55.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.618+0000 7fa06492c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa04c003f20 0x7fa0600cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.618+0000 7fa06492c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa060140e70 0x7fa060143910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.618+0000 7fa06492c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa060144360 0x7fa060144810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.618+0000 7fa06492c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa0600b2c50 con 0x7fa04c003f20 2024-09-15T23:14:55.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.618+0000 7fa06492c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa0600cef60 con 0x7fa060140e70 2024-09-15T23:14:55.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.618+0000 7fa06492c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa0600b2dd0 con 0x7fa060144360 2024-09-15T23:14:55.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.618+0000 7fa05e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa04c003f20 0x7fa0600cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.618+0000 7fa05e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa04c003f20 0x7fa0600cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48486/0 (socket says 172.21.15.123:48486) 2024-09-15T23:14:55.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.618+0000 7fa05e59c640 1 -- 172.21.15.123:0/4228366378 learned_addr learned my addr 172.21.15.123:0/4228366378 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:55.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.618+0000 7fa05ed9d640 1 --2- 172.21.15.123:0/4228366378 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa060144360 0x7fa060144810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.618+0000 7fa05dd9b640 1 --2- 172.21.15.123:0/4228366378 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa060140e70 0x7fa060143910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.618+0000 7fa05e59c640 1 -- 172.21.15.123:0/4228366378 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa060144360 msgr2=0x7fa060144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.618+0000 7fa05e59c640 1 --2- 172.21.15.123:0/4228366378 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa060144360 0x7fa060144810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.618+0000 7fa05e59c640 1 -- 172.21.15.123:0/4228366378 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa060140e70 msgr2=0x7fa060143910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.618+0000 7fa05e59c640 1 --2- 172.21.15.123:0/4228366378 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa060140e70 0x7fa060143910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.618+0000 7fa05e59c640 1 -- 172.21.15.123:0/4228366378 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa060143e50 con 0x7fa04c003f20 2024-09-15T23:14:55.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.619+0000 7fa05e59c640 1 --2- 172.21.15.123:0/4228366378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa04c003f20 0x7fa0600cbf40 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa058011e30 tx=0x7fa05800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:55.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.619+0000 7fa056ffd640 1 -- 172.21.15.123:0/4228366378 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa058015430 con 0x7fa04c003f20 2024-09-15T23:14:55.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.619+0000 7fa056ffd640 1 -- 172.21.15.123:0/4228366378 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0580155d0 con 0x7fa04c003f20 2024-09-15T23:14:55.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.619+0000 7fa056ffd640 1 -- 172.21.15.123:0/4228366378 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0580159a0 con 0x7fa04c003f20 2024-09-15T23:14:55.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.619+0000 7fa06492c640 1 -- 172.21.15.123:0/4228366378 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa060141370 con 0x7fa04c003f20 2024-09-15T23:14:55.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.619+0000 7fa06492c640 1 -- 172.21.15.123:0/4228366378 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa060141930 con 0x7fa04c003f20 2024-09-15T23:14:55.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.620+0000 7fa056ffd640 1 -- 172.21.15.123:0/4228366378 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa058015b40 con 0x7fa04c003f20 2024-09-15T23:14:55.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.621+0000 7fa056ffd640 1 --2- 172.21.15.123:0/4228366378 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa04006c2e0 0x7fa04006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.621+0000 7fa056ffd640 1 -- 172.21.15.123:0/4228366378 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7fa05808c540 con 0x7fa04c003f20 2024-09-15T23:14:55.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.621+0000 7fa05dd9b640 1 --2- 172.21.15.123:0/4228366378 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa04006c2e0 0x7fa04006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.622+0000 7fa05dd9b640 1 --2- 172.21.15.123:0/4228366378 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa04006c2e0 0x7fa04006e7a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa048034000 tx=0x7fa048009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:55.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.622+0000 7fa0676c1740 1 Processor -- start 2024-09-15T23:14:55.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.622+0000 7fa0676c1740 1 -- start start 2024-09-15T23:14:55.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.622+0000 7fa0676c1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562650e04ea0 0x562650e05280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.622+0000 7fa0676c1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562650e02660 0x562650e041f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.622+0000 7fa0676c1740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562650e02ac0 0x562650de4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.622+0000 7fa0676c1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x562650d218d0 con 0x562650e04ea0 2024-09-15T23:14:55.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.622+0000 7fa0676c1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x562650cc9510 con 0x562650e02660 2024-09-15T23:14:55.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.622+0000 7fa0676c1740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x562650d1d890 con 0x562650e02ac0 2024-09-15T23:14:55.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.623+0000 7fa05e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562650e04ea0 0x562650e05280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.623+0000 7fa05e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562650e04ea0 0x562650e05280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48492/0 (socket says 172.21.15.123:48492) 2024-09-15T23:14:55.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.623+0000 7fa05e59c640 1 -- 172.21.15.123:0/2675062903 learned_addr learned my addr 172.21.15.123:0/2675062903 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:55.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.623+0000 7fa05dd9b640 1 --2- 172.21.15.123:0/2675062903 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562650e02660 0x562650e041f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.623+0000 7fa05ed9d640 1 --2- 172.21.15.123:0/2675062903 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562650e02ac0 0x562650de4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.623+0000 7fa05e59c640 1 -- 172.21.15.123:0/2675062903 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562650e02ac0 msgr2=0x562650de4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.623+0000 7fa05e59c640 1 --2- 172.21.15.123:0/2675062903 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562650e02ac0 0x562650de4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.623+0000 7fa05e59c640 1 -- 172.21.15.123:0/2675062903 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562650e02660 msgr2=0x562650e041f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.623+0000 7fa05e59c640 1 --2- 172.21.15.123:0/2675062903 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562650e02660 0x562650e041f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.623+0000 7fa05e59c640 1 -- 172.21.15.123:0/2675062903 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562650cde1a0 con 0x562650e04ea0 2024-09-15T23:14:55.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.623+0000 7fa05dd9b640 1 --2- 172.21.15.123:0/2675062903 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562650e02660 0x562650e041f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:55.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.623+0000 7fa05e59c640 1 --2- 172.21.15.123:0/2675062903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562650e04ea0 0x562650e05280 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa05805a190 tx=0x7fa05805a550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e5083593686815 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:55.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.623+0000 7fa03ffff640 1 -- 172.21.15.123:0/2675062903 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa058022040 con 0x562650e04ea0 2024-09-15T23:14:55.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.623+0000 7fa03ffff640 1 -- 172.21.15.123:0/2675062903 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa058058530 con 0x562650e04ea0 2024-09-15T23:14:55.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.623+0000 7fa03ffff640 1 -- 172.21.15.123:0/2675062903 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa058056b00 con 0x562650e04ea0 2024-09-15T23:14:55.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.624+0000 7fa0676c1740 1 -- 172.21.15.123:0/2675062903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562650e04ea0 msgr2=0x562650e05280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.624+0000 7fa0676c1740 1 --2- 172.21.15.123:0/2675062903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562650e04ea0 0x562650e05280 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa05805a190 tx=0x7fa05805a550 comp rx=0 tx=0).stop 2024-09-15T23:14:55.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.624+0000 7fa0676c1740 1 -- 172.21.15.123:0/2675062903 shutdown_connections 2024-09-15T23:14:55.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.624+0000 7fa0676c1740 1 --2- 172.21.15.123:0/2675062903 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562650e02ac0 0x562650de4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.624+0000 7fa0676c1740 1 --2- 172.21.15.123:0/2675062903 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562650e02660 0x562650e041f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.624+0000 7fa0676c1740 1 --2- 172.21.15.123:0/2675062903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562650e04ea0 0x562650e05280 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.624+0000 7fa0676c1740 1 -- 172.21.15.123:0/2675062903 >> 172.21.15.123:0/2675062903 conn(0x562650dbad90 msgr2=0x562650e02f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:55.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.624+0000 7fa0676c1740 1 -- 172.21.15.123:0/2675062903 shutdown_connections 2024-09-15T23:14:55.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.624+0000 7fa0676c1740 1 -- 172.21.15.123:0/2675062903 wait complete. 2024-09-15T23:14:55.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.624+0000 7fa0676c1740 1 -- start start 2024-09-15T23:14:55.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.625+0000 7fa0676c1740 1 Processor -- start 2024-09-15T23:14:55.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.625+0000 7fa0676c1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562650e02ac0 0x562650dfff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.625+0000 7fa0676c1740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562650e04ea0 0x562650de2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.625+0000 7fa0676c1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562650de2bd0 0x562650dbe390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.625+0000 7fa0676c1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x562650e015c0 con 0x562650de2bd0 2024-09-15T23:14:55.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.625+0000 7fa0676c1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x562650caa640 con 0x562650e02ac0 2024-09-15T23:14:55.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.625+0000 7fa0676c1740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x562650e018a0 con 0x562650e04ea0 2024-09-15T23:14:55.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.625+0000 7fa0676c1740 10 client.0 _ll_register_callbacks cb 0x562650ce22a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:55.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.626+0000 7fa05ed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562650de2bd0 0x562650dbe390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.626+0000 7fa05ed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562650de2bd0 0x562650dbe390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48500/0 (socket says 172.21.15.123:48500) 2024-09-15T23:14:55.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.626+0000 7fa05ed9d640 1 -- 172.21.15.123:0/433974827 learned_addr learned my addr 172.21.15.123:0/433974827 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:55.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.626+0000 7fa05dd9b640 1 --2- 172.21.15.123:0/433974827 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562650e04ea0 0x562650de2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.626+0000 7fa05e59c640 1 --2- 172.21.15.123:0/433974827 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562650e02ac0 0x562650dfff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.626+0000 7fa05ed9d640 1 -- 172.21.15.123:0/433974827 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562650e04ea0 msgr2=0x562650de2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.626+0000 7fa05ed9d640 1 --2- 172.21.15.123:0/433974827 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562650e04ea0 0x562650de2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.626+0000 7fa05ed9d640 1 -- 172.21.15.123:0/433974827 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562650e02ac0 msgr2=0x562650dfff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.626+0000 7fa05ed9d640 1 --2- 172.21.15.123:0/433974827 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562650e02ac0 0x562650dfff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.626+0000 7fa05ed9d640 1 -- 172.21.15.123:0/433974827 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562650b00710 con 0x562650de2bd0 2024-09-15T23:14:55.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.626+0000 7fa05ed9d640 1 --2- 172.21.15.123:0/433974827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562650de2bd0 0x562650dbe390 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fa06006f170 tx=0x7fa050007410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e92a0867eaf29b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:55.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.626+0000 7fa03d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:55.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.626+0000 7fa03d7fa640 1 -- 172.21.15.123:0/433974827 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05001b030 con 0x562650de2bd0 2024-09-15T23:14:55.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.626+0000 7fa03d7fa640 1 -- 172.21.15.123:0/433974827 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7fa050010040 con 0x562650de2bd0 2024-09-15T23:14:55.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.626+0000 7fa0676c1740 1 -- 172.21.15.123:0/433974827 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa058058530 con 0x562650de2bd0 2024-09-15T23:14:55.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.626+0000 7fa03d7fa640 1 -- 172.21.15.123:0/433974827 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa050007750 con 0x562650de2bd0 2024-09-15T23:14:55.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.626+0000 7fa0676c1740 10 client.5721 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:55.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.626+0000 7fa0676c1740 1 -- 172.21.15.123:0/433974827 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x562650b60ea0 con 0x562650de2bd0 2024-09-15T23:14:55.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.627+0000 7fa03d7fa640 1 -- 172.21.15.123:0/433974827 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa058058530 con 0x562650de2bd0 2024-09-15T23:14:55.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.627+0000 7fa03d7fa640 1 -- 172.21.15.123:0/433974827 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7fa050014820 con 0x562650de2bd0 2024-09-15T23:14:55.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.627+0000 7fa0676c1740 10 client.5721 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:55.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.627+0000 7fa0676c1740 10 client.5721 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-15T23:14:55.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.627+0000 7fa0676c1740 20 client.5721 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:55.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.627+0000 7fa0676c1740 1 --2- 172.21.15.123:0/433974827 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x562650df9f30 0x562650de60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.627+0000 7fa0676c1740 4 client.5721 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:14:55.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.627+0000 7fa0676c1740 1 -- 172.21.15.123:0/433974827 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562650d2f000 con 0x562650df9f30 2024-09-15T23:14:55.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.627+0000 7fa05e59c640 1 --2- 172.21.15.123:0/433974827 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x562650df9f30 0x562650de60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.627+0000 7fa05e59c640 1 --2- 172.21.15.123:0/433974827 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x562650df9f30 0x562650de60f0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2aa6aca49e86c419 server_cookie=8963b15dba9675ff in_seq=0 out_seq=0 2024-09-15T23:14:55.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.627+0000 7fa03d7fa640 10 client.5721 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:55.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.628+0000 7fa03d7fa640 1 -- 172.21.15.123:0/433974827 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562650d2f000 con 0x562650df9f30 2024-09-15T23:14:55.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.628+0000 7fa03d7fa640 10 client.5721 handle_command_reply: tid=0 2024-09-15T23:14:55.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.628+0000 7fa0676c1740 1 client.5721 shutdown 2024-09-15T23:14:55.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.628+0000 7fa0676c1740 1 -- 172.21.15.123:0/433974827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562650de2bd0 msgr2=0x562650dbe390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.628+0000 7fa0676c1740 1 --2- 172.21.15.123:0/433974827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562650de2bd0 0x562650dbe390 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fa06006f170 tx=0x7fa050007410 comp rx=0 tx=0).stop 2024-09-15T23:14:55.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.629+0000 7fa0676c1740 1 -- 172.21.15.123:0/433974827 shutdown_connections 2024-09-15T23:14:55.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.629+0000 7fa0676c1740 1 --2- 172.21.15.123:0/433974827 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x562650df9f30 0x562650de60f0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.629+0000 7fa0676c1740 1 --2- 172.21.15.123:0/433974827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562650de2bd0 0x562650dbe390 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.629+0000 7fa0676c1740 1 --2- 172.21.15.123:0/433974827 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562650e04ea0 0x562650de2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.629+0000 7fa0676c1740 1 --2- 172.21.15.123:0/433974827 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562650e02ac0 0x562650dfff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.629+0000 7fa03d7fa640 0 client.5721 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:55.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.629+0000 7fa0676c1740 1 -- 172.21.15.123:0/433974827 >> 172.21.15.123:0/433974827 conn(0x562650e02660 msgr2=0x562650e02f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:55.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.629+0000 7fa0676c1740 1 -- 172.21.15.123:0/433974827 shutdown_connections 2024-09-15T23:14:55.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.629+0000 7fa0676c1740 1 -- 172.21.15.123:0/433974827 wait complete. 2024-09-15T23:14:55.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.629+0000 7fa0676c1740 20 client.5721 trim_cache size 0 max 16384 2024-09-15T23:14:55.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.642+0000 7fa0676c1740 1 Processor -- start 2024-09-15T23:14:55.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.642+0000 7fa0676c1740 1 -- start start 2024-09-15T23:14:55.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.642+0000 7fa0676c1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562650de2bd0 0x562650df9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.642+0000 7fa0676c1740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562650e02ac0 0x562650e25a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.642+0000 7fa0676c1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562650e04ea0 0x562650e25fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.642+0000 7fa0676c1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa0601fe2d0 con 0x562650e04ea0 2024-09-15T23:14:55.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.642+0000 7fa0676c1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa06015a860 con 0x562650de2bd0 2024-09-15T23:14:55.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.642+0000 7fa0676c1740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa0601fdd00 con 0x562650e02ac0 2024-09-15T23:14:55.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.643+0000 7fa05ed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562650e04ea0 0x562650e25fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.643+0000 7fa05ed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562650e04ea0 0x562650e25fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48508/0 (socket says 172.21.15.123:48508) 2024-09-15T23:14:55.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.643+0000 7fa05ed9d640 1 -- 172.21.15.123:0/2532787110 learned_addr learned my addr 172.21.15.123:0/2532787110 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:55.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.643+0000 7fa05ed9d640 1 -- 172.21.15.123:0/2532787110 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562650e02ac0 msgr2=0x562650e25a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.643+0000 7fa05ed9d640 1 --2- 172.21.15.123:0/2532787110 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562650e02ac0 0x562650e25a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.643+0000 7fa05ed9d640 1 -- 172.21.15.123:0/2532787110 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562650de2bd0 msgr2=0x562650df9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.643+0000 7fa05ed9d640 1 --2- 172.21.15.123:0/2532787110 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562650de2bd0 0x562650df9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.643+0000 7fa05ed9d640 1 -- 172.21.15.123:0/2532787110 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626509f4000 con 0x562650e04ea0 2024-09-15T23:14:55.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.643+0000 7fa05ed9d640 1 --2- 172.21.15.123:0/2532787110 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562650e04ea0 0x562650e25fc0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fa050000c00 tx=0x7fa05000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9264dfe7eff885b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:55.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.643+0000 7fa03f7fe640 1 -- 172.21.15.123:0/2532787110 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05001b070 con 0x562650e04ea0 2024-09-15T23:14:55.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.643+0000 7fa03f7fe640 1 -- 172.21.15.123:0/2532787110 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa05002b430 con 0x562650e04ea0 2024-09-15T23:14:55.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.643+0000 7fa03f7fe640 1 -- 172.21.15.123:0/2532787110 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05002b820 con 0x562650e04ea0 2024-09-15T23:14:55.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.644+0000 7fa0676c1740 1 -- 172.21.15.123:0/2532787110 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562650e04ea0 msgr2=0x562650e25fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.644+0000 7fa0676c1740 1 --2- 172.21.15.123:0/2532787110 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562650e04ea0 0x562650e25fc0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fa050000c00 tx=0x7fa05000f000 comp rx=0 tx=0).stop 2024-09-15T23:14:55.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.644+0000 7fa0676c1740 1 -- 172.21.15.123:0/2532787110 shutdown_connections 2024-09-15T23:14:55.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.644+0000 7fa0676c1740 1 --2- 172.21.15.123:0/2532787110 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562650e04ea0 0x562650e25fc0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.644+0000 7fa0676c1740 1 --2- 172.21.15.123:0/2532787110 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562650e02ac0 0x562650e25a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.644+0000 7fa0676c1740 1 --2- 172.21.15.123:0/2532787110 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562650de2bd0 0x562650df9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.644+0000 7fa0676c1740 1 -- 172.21.15.123:0/2532787110 >> 172.21.15.123:0/2532787110 conn(0x562650e02660 msgr2=0x562650dba1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:55.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.644+0000 7fa0676c1740 1 -- 172.21.15.123:0/2532787110 shutdown_connections 2024-09-15T23:14:55.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.644+0000 7fa0676c1740 1 -- 172.21.15.123:0/2532787110 wait complete. 2024-09-15T23:14:55.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.644+0000 7fa0676c1740 1 -- start start 2024-09-15T23:14:55.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.644+0000 7fa0676c1740 1 Processor -- start 2024-09-15T23:14:55.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.645+0000 7fa0676c1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562650de2bd0 0x562650e83ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.645+0000 7fa0676c1740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562650e02ac0 0x562650e1cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.645+0000 7fa0676c1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562650e04ea0 0x562650e1d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.645+0000 7fa0676c1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x562650df9db0 con 0x562650e04ea0 2024-09-15T23:14:55.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.645+0000 7fa0676c1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x562650dfc7b0 con 0x562650de2bd0 2024-09-15T23:14:55.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.645+0000 7fa0676c1740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x562650dfa3d0 con 0x562650e02ac0 2024-09-15T23:14:55.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.645+0000 7fa0676c1740 10 client.0 _ll_register_callbacks cb 0x7fa050004a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:55.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.645+0000 7fa05ed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562650e04ea0 0x562650e1d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.645+0000 7fa05ed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562650e04ea0 0x562650e1d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48514/0 (socket says 172.21.15.123:48514) 2024-09-15T23:14:55.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.645+0000 7fa05ed9d640 1 -- 172.21.15.123:0/2225139022 learned_addr learned my addr 172.21.15.123:0/2225139022 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:55.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.645+0000 7fa05dd9b640 1 --2- 172.21.15.123:0/2225139022 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562650e02ac0 0x562650e1cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.646+0000 7fa05e59c640 1 --2- 172.21.15.123:0/2225139022 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562650de2bd0 0x562650e83ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.646+0000 7fa05ed9d640 1 -- 172.21.15.123:0/2225139022 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562650e02ac0 msgr2=0x562650e1cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.646+0000 7fa05ed9d640 1 --2- 172.21.15.123:0/2225139022 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562650e02ac0 0x562650e1cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.646+0000 7fa05ed9d640 1 -- 172.21.15.123:0/2225139022 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562650de2bd0 msgr2=0x562650e83ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.646+0000 7fa05ed9d640 1 --2- 172.21.15.123:0/2225139022 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562650de2bd0 0x562650e83ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.646+0000 7fa05ed9d640 1 -- 172.21.15.123:0/2225139022 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562650e1a9e0 con 0x562650e04ea0 2024-09-15T23:14:55.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.646+0000 7fa05e59c640 1 --2- 172.21.15.123:0/2225139022 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562650de2bd0 0x562650e83ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:55.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.646+0000 7fa05ed9d640 1 --2- 172.21.15.123:0/2225139022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562650e04ea0 0x562650e1d020 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fa050014790 tx=0x7fa0500078f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b81387cd3430b78 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:55.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.646+0000 7fa03d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:55.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.646+0000 7fa03d7fa640 1 -- 172.21.15.123:0/2225139022 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05002b5e0 con 0x562650e04ea0 2024-09-15T23:14:55.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.646+0000 7fa03d7fa640 1 -- 172.21.15.123:0/2225139022 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7fa050037ba0 con 0x562650e04ea0 2024-09-15T23:14:55.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.646+0000 7fa0676c1740 1 -- 172.21.15.123:0/2225139022 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa05002b430 con 0x562650e04ea0 2024-09-15T23:14:55.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.646+0000 7fa03d7fa640 1 -- 172.21.15.123:0/2225139022 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa050037da0 con 0x562650e04ea0 2024-09-15T23:14:55.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.646+0000 7fa0676c1740 10 client.5727 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:55.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.646+0000 7fa0676c1740 1 -- 172.21.15.123:0/2225139022 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x562650e18f90 con 0x562650e04ea0 2024-09-15T23:14:55.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.646+0000 7fa03d7fa640 1 -- 172.21.15.123:0/2225139022 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa05002b430 con 0x562650e04ea0 2024-09-15T23:14:55.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.646+0000 7fa03d7fa640 1 -- 172.21.15.123:0/2225139022 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7fa05002b780 con 0x562650e04ea0 2024-09-15T23:14:55.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.646+0000 7fa0676c1740 10 client.5727 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:55.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.646+0000 7fa0676c1740 10 client.5727 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-15T23:14:55.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.646+0000 7fa0676c1740 20 client.5727 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:55.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.646+0000 7fa0676c1740 1 --2- 172.21.15.123:0/2225139022 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x562650e84e20 0x562650e17f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.646+0000 7fa0676c1740 4 client.5727 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "damage rm", "damage_id": 3670963752}] 2024-09-15T23:14:55.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.646+0000 7fa0676c1740 1 -- 172.21.15.123:0/2225139022 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "damage rm", "damage_id": 3670963752}) -- 0x562650d29350 con 0x562650e84e20 2024-09-15T23:14:55.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.647+0000 7fa05e59c640 1 --2- 172.21.15.123:0/2225139022 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x562650e84e20 0x562650e17f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.647+0000 7fa03d7fa640 10 client.5727 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:55.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.647+0000 7fa05e59c640 1 --2- 172.21.15.123:0/2225139022 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x562650e84e20 0x562650e17f10 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdd03fa36ec5dfa7 server_cookie=44d5724e9f328365 in_seq=0 out_seq=0 2024-09-15T23:14:55.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.647+0000 7fa03d7fa640 1 -- 172.21.15.123:0/2225139022 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+0 (crc 0 0 0) 0x562650d29350 con 0x562650e84e20 2024-09-15T23:14:55.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.647+0000 7fa03d7fa640 10 client.5727 handle_command_reply: tid=0 2024-09-15T23:14:55.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.647+0000 7fa0676c1740 1 client.5727 shutdown 2024-09-15T23:14:55.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.647+0000 7fa0676c1740 1 -- 172.21.15.123:0/2225139022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562650e04ea0 msgr2=0x562650e1d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.647+0000 7fa0676c1740 1 --2- 172.21.15.123:0/2225139022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562650e04ea0 0x562650e1d020 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fa050014790 tx=0x7fa0500078f0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.647+0000 7fa0676c1740 1 -- 172.21.15.123:0/2225139022 shutdown_connections 2024-09-15T23:14:55.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.647+0000 7fa0676c1740 1 --2- 172.21.15.123:0/2225139022 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x562650e84e20 0x562650e17f10 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.647+0000 7fa0676c1740 1 --2- 172.21.15.123:0/2225139022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562650e04ea0 0x562650e1d020 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.647+0000 7fa03d7fa640 0 client.5727 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:55.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.647+0000 7fa0676c1740 1 --2- 172.21.15.123:0/2225139022 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562650e02ac0 0x562650e1cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.647+0000 7fa0676c1740 1 --2- 172.21.15.123:0/2225139022 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562650de2bd0 0x562650e83ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.647+0000 7fa0676c1740 1 -- 172.21.15.123:0/2225139022 >> 172.21.15.123:0/2225139022 conn(0x562650e02660 msgr2=0x562650e27050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:55.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.647+0000 7fa0676c1740 1 -- 172.21.15.123:0/2225139022 shutdown_connections 2024-09-15T23:14:55.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.647+0000 7fa0676c1740 1 -- 172.21.15.123:0/2225139022 wait complete. 2024-09-15T23:14:55.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.648+0000 7fa0676c1740 20 client.5727 trim_cache size 0 max 16384 2024-09-15T23:14:55.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.648+0000 7fa06492c640 1 -- 172.21.15.123:0/4228366378 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa04006c2e0 msgr2=0x7fa04006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.648+0000 7fa06492c640 1 --2- 172.21.15.123:0/4228366378 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa04006c2e0 0x7fa04006e7a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa048034000 tx=0x7fa048009030 comp rx=0 tx=0).stop 2024-09-15T23:14:55.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.648+0000 7fa06492c640 1 -- 172.21.15.123:0/4228366378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa04c003f20 msgr2=0x7fa0600cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.648+0000 7fa06492c640 1 --2- 172.21.15.123:0/4228366378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa04c003f20 0x7fa0600cbf40 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa058011e30 tx=0x7fa05800f580 comp rx=0 tx=0).stop 2024-09-15T23:14:55.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.648+0000 7fa06492c640 1 -- 172.21.15.123:0/4228366378 shutdown_connections 2024-09-15T23:14:55.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.648+0000 7fa06492c640 1 --2- 172.21.15.123:0/4228366378 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa060144360 0x7fa060144810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.648+0000 7fa06492c640 1 --2- 172.21.15.123:0/4228366378 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa060140e70 0x7fa060143910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.648+0000 7fa06492c640 1 --2- 172.21.15.123:0/4228366378 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa04006c2e0 0x7fa04006e7a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.648+0000 7fa06492c640 1 --2- 172.21.15.123:0/4228366378 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa04c003f20 0x7fa0600cbf40 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.648+0000 7fa06492c640 1 -- 172.21.15.123:0/4228366378 >> 172.21.15.123:0/4228366378 conn(0x7fa06006d0f0 msgr2=0x7fa060072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:55.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.648+0000 7fa06492c640 1 -- 172.21.15.123:0/4228366378 shutdown_connections 2024-09-15T23:14:55.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.648+0000 7fa06492c640 1 -- 172.21.15.123:0/4228366378 wait complete. 2024-09-15T23:14:55.660 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-09-15T23:14:55.660 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path / 2024-09-15T23:14:55.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.759+0000 7ffa2018d640 1 Processor -- start 2024-09-15T23:14:55.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.760+0000 7ffa2018d640 1 -- start start 2024-09-15T23:14:55.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.760+0000 7ffa2018d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ffa180ccf30 0x7ffa180b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.760+0000 7ffa2018d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa1815b7c0 0x7ffa180cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.760+0000 7ffa2018d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffa180cead0 0x7ffa1815f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.760+0000 7ffa2018d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7ffa180cd850 con 0x7ffa180cead0 2024-09-15T23:14:55.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.760+0000 7ffa2018d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7ffa180cf2e0 con 0x7ffa180ccf30 2024-09-15T23:14:55.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.760+0000 7ffa2018d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ffa18070fe0 con 0x7ffa1815b7c0 2024-09-15T23:14:55.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.761+0000 7ffa1e72a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffa180cead0 0x7ffa1815f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.761+0000 7ffa1e72a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffa180cead0 0x7ffa1815f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48520/0 (socket says 172.21.15.123:48520) 2024-09-15T23:14:55.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.761+0000 7ffa1e72a640 1 -- 172.21.15.123:0/3702191403 learned_addr learned my addr 172.21.15.123:0/3702191403 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:55.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.761+0000 7ffa1d728640 1 --2- 172.21.15.123:0/3702191403 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa1815b7c0 0x7ffa180cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.761+0000 7ffa1df29640 1 --2- 172.21.15.123:0/3702191403 >> v2:172.21.15.188:3300/0 conn(0x7ffa180ccf30 0x7ffa180b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.761+0000 7ffa1e72a640 1 -- 172.21.15.123:0/3702191403 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa1815b7c0 msgr2=0x7ffa180cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.761+0000 7ffa1e72a640 1 --2- 172.21.15.123:0/3702191403 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa1815b7c0 0x7ffa180cd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.761+0000 7ffa1e72a640 1 -- 172.21.15.123:0/3702191403 >> v2:172.21.15.188:3300/0 conn(0x7ffa180ccf30 msgr2=0x7ffa180b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.761+0000 7ffa1e72a640 1 --2- 172.21.15.123:0/3702191403 >> v2:172.21.15.188:3300/0 conn(0x7ffa180ccf30 0x7ffa180b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.761+0000 7ffa1e72a640 1 -- 172.21.15.123:0/3702191403 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa180712c0 con 0x7ffa180cead0 2024-09-15T23:14:55.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.762+0000 7ffa1e72a640 1 --2- 172.21.15.123:0/3702191403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa180cead0 0x7ffa1815f150 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ffa1806f1c0 tx=0x7ffa1002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e9125047be85e95 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:55.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.762+0000 7ffa1cf27640 1 -- 172.21.15.123:0/3702191403 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa10036070 con 0x7ffa180cead0 2024-09-15T23:14:55.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.762+0000 7ffa1cf27640 1 -- 172.21.15.123:0/3702191403 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa10031600 con 0x7ffa180cead0 2024-09-15T23:14:55.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.762+0000 7ffa1cf27640 1 -- 172.21.15.123:0/3702191403 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa100319d0 con 0x7ffa180cead0 2024-09-15T23:14:55.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.762+0000 7ffa2018d640 1 -- 172.21.15.123:0/3702191403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa180cead0 msgr2=0x7ffa1815f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.762+0000 7ffa2018d640 1 --2- 172.21.15.123:0/3702191403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa180cead0 0x7ffa1815f150 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ffa1806f1c0 tx=0x7ffa1002a610 comp rx=0 tx=0).stop 2024-09-15T23:14:55.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.762+0000 7ffa2018d640 1 -- 172.21.15.123:0/3702191403 shutdown_connections 2024-09-15T23:14:55.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.762+0000 7ffa2018d640 1 --2- 172.21.15.123:0/3702191403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa180cead0 0x7ffa1815f150 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.762+0000 7ffa2018d640 1 --2- 172.21.15.123:0/3702191403 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa1815b7c0 0x7ffa180cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.762+0000 7ffa2018d640 1 --2- 172.21.15.123:0/3702191403 >> v2:172.21.15.188:3300/0 conn(0x7ffa180ccf30 0x7ffa180b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.762+0000 7ffa2018d640 1 -- 172.21.15.123:0/3702191403 >> 172.21.15.123:0/3702191403 conn(0x7ffa1806d0f0 msgr2=0x7ffa1806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:55.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.762+0000 7ffa2018d640 1 -- 172.21.15.123:0/3702191403 shutdown_connections 2024-09-15T23:14:55.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.762+0000 7ffa2018d640 1 -- 172.21.15.123:0/3702191403 wait complete. 2024-09-15T23:14:55.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.763+0000 7ffa2018d640 1 Processor -- start 2024-09-15T23:14:55.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.764+0000 7ffa2018d640 1 -- start start 2024-09-15T23:14:55.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.764+0000 7ffa2018d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa180ccf30 0x7ffa1814e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.764+0000 7ffa2018d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa180cead0 0x7ffa18150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.764+0000 7ffa2018d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa1815b7c0 0x7ffa1814be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.764+0000 7ffa2018d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ffa180cef20 con 0x7ffa180ccf30 2024-09-15T23:14:55.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.764+0000 7ffa2018d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ffa180cf5c0 con 0x7ffa180cead0 2024-09-15T23:14:55.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.764+0000 7ffa2018d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ffa180cf0a0 con 0x7ffa1815b7c0 2024-09-15T23:14:55.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.764+0000 7ffa1df29640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa180ccf30 0x7ffa1814e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.764+0000 7ffa1df29640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa180ccf30 0x7ffa1814e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48522/0 (socket says 172.21.15.123:48522) 2024-09-15T23:14:55.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.764+0000 7ffa1df29640 1 -- 172.21.15.123:0/1197044487 learned_addr learned my addr 172.21.15.123:0/1197044487 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:55.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.765+0000 7ffa1df29640 1 -- 172.21.15.123:0/1197044487 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa1815b7c0 msgr2=0x7ffa1814be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.765+0000 7ffa1df29640 1 --2- 172.21.15.123:0/1197044487 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa1815b7c0 0x7ffa1814be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.765+0000 7ffa1df29640 1 -- 172.21.15.123:0/1197044487 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa180cead0 msgr2=0x7ffa18150810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.765+0000 7ffa1df29640 1 --2- 172.21.15.123:0/1197044487 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa180cead0 0x7ffa18150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.765+0000 7ffa1df29640 1 -- 172.21.15.123:0/1197044487 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa18150d50 con 0x7ffa180ccf30 2024-09-15T23:14:55.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.765+0000 7ffa1df29640 1 --2- 172.21.15.123:0/1197044487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa180ccf30 0x7ffa1814e990 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ffa1400c5a0 tx=0x7ffa1400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:55.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.765+0000 7ffa0e7fc640 1 -- 172.21.15.123:0/1197044487 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa14015070 con 0x7ffa180ccf30 2024-09-15T23:14:55.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.765+0000 7ffa0e7fc640 1 -- 172.21.15.123:0/1197044487 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa14004220 con 0x7ffa180ccf30 2024-09-15T23:14:55.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.765+0000 7ffa2018d640 1 -- 172.21.15.123:0/1197044487 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa1815bce0 con 0x7ffa180ccf30 2024-09-15T23:14:55.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.765+0000 7ffa0e7fc640 1 -- 172.21.15.123:0/1197044487 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa14003610 con 0x7ffa180ccf30 2024-09-15T23:14:55.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.765+0000 7ffa2018d640 1 -- 172.21.15.123:0/1197044487 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa1815c2a0 con 0x7ffa180ccf30 2024-09-15T23:14:55.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.766+0000 7ffa0e7fc640 1 -- 172.21.15.123:0/1197044487 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ffa140037b0 con 0x7ffa180ccf30 2024-09-15T23:14:55.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.767+0000 7ffa0e7fc640 1 --2- 172.21.15.123:0/1197044487 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff9fc06c2b0 0x7ff9fc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.767+0000 7ffa0e7fc640 1 -- 172.21.15.123:0/1197044487 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7ffa1408b330 con 0x7ffa180ccf30 2024-09-15T23:14:55.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.767+0000 7ffa1d728640 1 --2- 172.21.15.123:0/1197044487 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff9fc06c2b0 0x7ff9fc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.768+0000 7ffa1d728640 1 --2- 172.21.15.123:0/1197044487 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff9fc06c2b0 0x7ff9fc06e770 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ffa08006fd0 tx=0x7ffa08008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:55.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.768+0000 7ffa23006740 1 Processor -- start 2024-09-15T23:14:55.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.768+0000 7ffa23006740 1 -- start start 2024-09-15T23:14:55.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.769+0000 7ffa23006740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56456f529450 0x56456f56ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.769+0000 7ffa23006740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56456f526c10 0x56456f529830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.769+0000 7ffa23006740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56456f52abe0 0x56456f523a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.769+0000 7ffa23006740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56456f48b610 con 0x56456f529450 2024-09-15T23:14:55.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.769+0000 7ffa23006740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56456f4332e0 con 0x56456f526c10 2024-09-15T23:14:55.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.769+0000 7ffa23006740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x56456f4875d0 con 0x56456f52abe0 2024-09-15T23:14:55.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.769+0000 7ffa1df29640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56456f529450 0x56456f56ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.769+0000 7ffa1df29640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56456f529450 0x56456f56ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48524/0 (socket says 172.21.15.123:48524) 2024-09-15T23:14:55.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.769+0000 7ffa1df29640 1 -- 172.21.15.123:0/2826812142 learned_addr learned my addr 172.21.15.123:0/2826812142 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:55.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.769+0000 7ffa1e72a640 1 --2- 172.21.15.123:0/2826812142 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56456f52abe0 0x56456f523a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.769+0000 7ffa1d728640 1 --2- 172.21.15.123:0/2826812142 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56456f526c10 0x56456f529830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.769+0000 7ffa1df29640 1 -- 172.21.15.123:0/2826812142 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56456f52abe0 msgr2=0x56456f523a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.769+0000 7ffa1df29640 1 --2- 172.21.15.123:0/2826812142 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56456f52abe0 0x56456f523a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.769+0000 7ffa1df29640 1 -- 172.21.15.123:0/2826812142 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56456f526c10 msgr2=0x56456f529830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.769+0000 7ffa1df29640 1 --2- 172.21.15.123:0/2826812142 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56456f526c10 0x56456f529830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.769+0000 7ffa1df29640 1 -- 172.21.15.123:0/2826812142 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56456f44e1f0 con 0x56456f529450 2024-09-15T23:14:55.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.769+0000 7ffa1d728640 1 --2- 172.21.15.123:0/2826812142 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56456f526c10 0x56456f529830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:55.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.769+0000 7ffa1df29640 1 --2- 172.21.15.123:0/2826812142 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56456f529450 0x56456f56ebf0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ffa14089710 tx=0x7ffa14059340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb7315c29375ee5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:55.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.769+0000 7ff9fb7fe640 1 -- 172.21.15.123:0/2826812142 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa1401e070 con 0x56456f529450 2024-09-15T23:14:55.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.769+0000 7ff9fb7fe640 1 -- 172.21.15.123:0/2826812142 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa14057320 con 0x56456f529450 2024-09-15T23:14:55.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.769+0000 7ff9fb7fe640 1 -- 172.21.15.123:0/2826812142 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa14057580 con 0x56456f529450 2024-09-15T23:14:55.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.770+0000 7ffa23006740 1 -- 172.21.15.123:0/2826812142 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56456f529450 msgr2=0x56456f56ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.770+0000 7ffa23006740 1 --2- 172.21.15.123:0/2826812142 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56456f529450 0x56456f56ebf0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ffa14089710 tx=0x7ffa14059340 comp rx=0 tx=0).stop 2024-09-15T23:14:55.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.770+0000 7ffa23006740 1 -- 172.21.15.123:0/2826812142 shutdown_connections 2024-09-15T23:14:55.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.770+0000 7ffa23006740 1 --2- 172.21.15.123:0/2826812142 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56456f52abe0 0x56456f523a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.770+0000 7ffa23006740 1 --2- 172.21.15.123:0/2826812142 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56456f526c10 0x56456f529830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.770+0000 7ffa23006740 1 --2- 172.21.15.123:0/2826812142 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56456f529450 0x56456f56ebf0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.770+0000 7ffa23006740 1 -- 172.21.15.123:0/2826812142 >> 172.21.15.123:0/2826812142 conn(0x56456f525c10 msgr2=0x56456f56e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:55.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.770+0000 7ffa23006740 1 -- 172.21.15.123:0/2826812142 shutdown_connections 2024-09-15T23:14:55.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.770+0000 7ffa23006740 1 -- 172.21.15.123:0/2826812142 wait complete. 2024-09-15T23:14:55.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.771+0000 7ffa23006740 1 -- start start 2024-09-15T23:14:55.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.771+0000 7ffa23006740 1 Processor -- start 2024-09-15T23:14:55.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.772+0000 7ffa23006740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56456f529450 0x56456f54a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.772+0000 7ffa23006740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56456f52abe0 0x56456f5466f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.772+0000 7ffa23006740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56456f568db0 0x56456f56a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.772+0000 7ffa23006740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56456f5250b0 con 0x56456f529450 2024-09-15T23:14:55.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.772+0000 7ffa23006740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56456f414350 con 0x56456f568db0 2024-09-15T23:14:55.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.772+0000 7ffa23006740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x56456f56f420 con 0x56456f52abe0 2024-09-15T23:14:55.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.772+0000 7ffa23006740 10 client.0 _ll_register_callbacks cb 0x56456f19da30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:55.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.772+0000 7ffa1df29640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56456f529450 0x56456f54a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.772+0000 7ffa1df29640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56456f529450 0x56456f54a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48532/0 (socket says 172.21.15.123:48532) 2024-09-15T23:14:55.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.772+0000 7ffa1df29640 1 -- 172.21.15.123:0/407389702 learned_addr learned my addr 172.21.15.123:0/407389702 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:55.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.772+0000 7ffa1d728640 1 --2- 172.21.15.123:0/407389702 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56456f52abe0 0x56456f5466f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.772+0000 7ffa1e72a640 1 --2- 172.21.15.123:0/407389702 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56456f568db0 0x56456f56a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.772+0000 7ffa1df29640 1 -- 172.21.15.123:0/407389702 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56456f52abe0 msgr2=0x56456f5466f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.772+0000 7ffa1df29640 1 --2- 172.21.15.123:0/407389702 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56456f52abe0 0x56456f5466f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.772+0000 7ffa1df29640 1 -- 172.21.15.123:0/407389702 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56456f568db0 msgr2=0x56456f56a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.772+0000 7ffa1df29640 1 --2- 172.21.15.123:0/407389702 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56456f568db0 0x56456f56a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.772+0000 7ffa1df29640 1 -- 172.21.15.123:0/407389702 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56456f19e240 con 0x56456f529450 2024-09-15T23:14:55.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.772+0000 7ffa1d728640 1 --2- 172.21.15.123:0/407389702 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56456f52abe0 0x56456f5466f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:55.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.772+0000 7ffa1e72a640 1 --2- 172.21.15.123:0/407389702 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56456f568db0 0x56456f56a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:55.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.772+0000 7ffa1df29640 1 --2- 172.21.15.123:0/407389702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56456f529450 0x56456f54a850 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ffa14089820 tx=0x7ffa1401b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2563dc26e8860047 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:55.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.772+0000 7ff9f8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:55.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.772+0000 7ff9f8ff9640 1 -- 172.21.15.123:0/407389702 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa14075030 con 0x56456f529450 2024-09-15T23:14:55.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.772+0000 7ff9f8ff9640 1 -- 172.21.15.123:0/407389702 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7ffa14085070 con 0x56456f529450 2024-09-15T23:14:55.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.772+0000 7ffa23006740 1 -- 172.21.15.123:0/407389702 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa14057320 con 0x56456f529450 2024-09-15T23:14:55.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.772+0000 7ff9f8ff9640 1 -- 172.21.15.123:0/407389702 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ffa14078320 con 0x56456f529450 2024-09-15T23:14:55.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.772+0000 7ffa23006740 10 client.5739 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:55.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.772+0000 7ffa23006740 1 -- 172.21.15.123:0/407389702 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x56456f268620 con 0x56456f529450 2024-09-15T23:14:55.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.773+0000 7ff9f8ff9640 1 -- 172.21.15.123:0/407389702 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa14057320 con 0x56456f529450 2024-09-15T23:14:55.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.773+0000 7ff9f8ff9640 1 -- 172.21.15.123:0/407389702 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7ffa14071180 con 0x56456f529450 2024-09-15T23:14:55.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.773+0000 7ffa23006740 10 client.5739 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:55.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.773+0000 7ffa23006740 10 client.5739 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:55.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.773+0000 7ffa23006740 20 client.5739 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:55.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.773+0000 7ffa23006740 1 --2- 172.21.15.123:0/407389702 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x56456f5532f0 0x56456f5536d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.773+0000 7ffa23006740 4 client.5739 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:14:55.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.773+0000 7ffa23006740 1 -- 172.21.15.123:0/407389702 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56456f498d40 con 0x56456f5532f0 2024-09-15T23:14:55.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.773+0000 7ffa1d728640 1 --2- 172.21.15.123:0/407389702 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x56456f5532f0 0x56456f5536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.773+0000 7ff9f8ff9640 10 client.5739 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:55.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.773+0000 7ffa1d728640 1 --2- 172.21.15.123:0/407389702 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x56456f5532f0 0x56456f5536d0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76a3cd591d6fa8aa server_cookie=1d4a58158290d669 in_seq=0 out_seq=0 2024-09-15T23:14:55.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.774+0000 7ff9f8ff9640 1 -- 172.21.15.123:0/407389702 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56456f498d40 con 0x56456f5532f0 2024-09-15T23:14:55.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.774+0000 7ff9f8ff9640 10 client.5739 handle_command_reply: tid=0 2024-09-15T23:14:55.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.774+0000 7ffa23006740 1 client.5739 shutdown 2024-09-15T23:14:55.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.774+0000 7ffa23006740 1 -- 172.21.15.123:0/407389702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56456f529450 msgr2=0x56456f54a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.774+0000 7ffa23006740 1 --2- 172.21.15.123:0/407389702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56456f529450 0x56456f54a850 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ffa14089820 tx=0x7ffa1401b040 comp rx=0 tx=0).stop 2024-09-15T23:14:55.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.774+0000 7ffa23006740 1 -- 172.21.15.123:0/407389702 shutdown_connections 2024-09-15T23:14:55.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.774+0000 7ffa23006740 1 --2- 172.21.15.123:0/407389702 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x56456f5532f0 0x56456f5536d0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.774+0000 7ffa23006740 1 --2- 172.21.15.123:0/407389702 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56456f568db0 0x56456f56a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.774+0000 7ffa23006740 1 --2- 172.21.15.123:0/407389702 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56456f52abe0 0x56456f5466f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.774+0000 7ff9f8ff9640 0 client.5739 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:55.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.774+0000 7ffa23006740 1 --2- 172.21.15.123:0/407389702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56456f529450 0x56456f54a850 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.774+0000 7ffa23006740 1 -- 172.21.15.123:0/407389702 >> 172.21.15.123:0/407389702 conn(0x56456f526c10 msgr2=0x56456f5271b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:55.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.774+0000 7ffa23006740 1 -- 172.21.15.123:0/407389702 shutdown_connections 2024-09-15T23:14:55.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.774+0000 7ffa23006740 1 -- 172.21.15.123:0/407389702 wait complete. 2024-09-15T23:14:55.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.774+0000 7ffa23006740 20 client.5739 trim_cache size 0 max 16384 2024-09-15T23:14:55.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.789+0000 7ffa23006740 1 Processor -- start 2024-09-15T23:14:55.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.789+0000 7ffa23006740 1 -- start start 2024-09-15T23:14:55.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.789+0000 7ffa23006740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56456f529450 0x56456f56d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.789+0000 7ffa23006740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56456f52abe0 0x56456f54a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.789+0000 7ffa23006740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56456f568db0 0x56456f54a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.789+0000 7ffa23006740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ffa181fee50 con 0x56456f568db0 2024-09-15T23:14:55.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.789+0000 7ffa23006740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ffa181fdeb0 con 0x56456f52abe0 2024-09-15T23:14:55.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.789+0000 7ffa23006740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ffa181fd210 con 0x56456f529450 2024-09-15T23:14:55.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.790+0000 7ffa1e72a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56456f568db0 0x56456f54a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.790+0000 7ffa1e72a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56456f568db0 0x56456f54a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48536/0 (socket says 172.21.15.123:48536) 2024-09-15T23:14:55.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.790+0000 7ffa1e72a640 1 -- 172.21.15.123:0/3183849280 learned_addr learned my addr 172.21.15.123:0/3183849280 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:55.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.790+0000 7ffa1df29640 1 --2- 172.21.15.123:0/3183849280 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56456f529450 0x56456f56d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.790+0000 7ffa1d728640 1 --2- 172.21.15.123:0/3183849280 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56456f52abe0 0x56456f54a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.790+0000 7ffa1e72a640 1 -- 172.21.15.123:0/3183849280 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56456f529450 msgr2=0x56456f56d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.790+0000 7ffa1e72a640 1 --2- 172.21.15.123:0/3183849280 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56456f529450 0x56456f56d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.790+0000 7ffa1e72a640 1 -- 172.21.15.123:0/3183849280 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56456f52abe0 msgr2=0x56456f54a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.790+0000 7ffa1e72a640 1 --2- 172.21.15.123:0/3183849280 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56456f52abe0 0x56456f54a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.790+0000 7ffa1e72a640 1 -- 172.21.15.123:0/3183849280 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56456f5684d0 con 0x56456f568db0 2024-09-15T23:14:55.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.790+0000 7ffa1e72a640 1 --2- 172.21.15.123:0/3183849280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56456f568db0 0x56456f54a820 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ffa1002ac00 tx=0x7ffa1002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=818777d1437ae5d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:55.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.790+0000 7ff9faffd640 1 -- 172.21.15.123:0/3183849280 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa10036040 con 0x56456f568db0 2024-09-15T23:14:55.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.790+0000 7ff9faffd640 1 -- 172.21.15.123:0/3183849280 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa10037040 con 0x56456f568db0 2024-09-15T23:14:55.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.790+0000 7ff9faffd640 1 -- 172.21.15.123:0/3183849280 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa10031960 con 0x56456f568db0 2024-09-15T23:14:55.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.791+0000 7ffa23006740 1 -- 172.21.15.123:0/3183849280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56456f568db0 msgr2=0x56456f54a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.791+0000 7ffa23006740 1 --2- 172.21.15.123:0/3183849280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56456f568db0 0x56456f54a820 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ffa1002ac00 tx=0x7ffa1002c000 comp rx=0 tx=0).stop 2024-09-15T23:14:55.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.791+0000 7ffa23006740 1 -- 172.21.15.123:0/3183849280 shutdown_connections 2024-09-15T23:14:55.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.791+0000 7ffa23006740 1 --2- 172.21.15.123:0/3183849280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56456f568db0 0x56456f54a820 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.791+0000 7ffa23006740 1 --2- 172.21.15.123:0/3183849280 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56456f52abe0 0x56456f54a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.791+0000 7ffa23006740 1 --2- 172.21.15.123:0/3183849280 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56456f529450 0x56456f56d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.791+0000 7ffa23006740 1 -- 172.21.15.123:0/3183849280 >> 172.21.15.123:0/3183849280 conn(0x56456f526c10 msgr2=0x56456f56fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:55.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.791+0000 7ffa23006740 1 -- 172.21.15.123:0/3183849280 shutdown_connections 2024-09-15T23:14:55.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.791+0000 7ffa23006740 1 -- 172.21.15.123:0/3183849280 wait complete. 2024-09-15T23:14:55.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.791+0000 7ffa23006740 1 -- start start 2024-09-15T23:14:55.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.791+0000 7ffa23006740 1 Processor -- start 2024-09-15T23:14:55.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.792+0000 7ffa23006740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56456f529450 0x56456f546750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.792+0000 7ffa23006740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56456f52abe0 0x56456f5ebb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.792+0000 7ffa23006740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56456f568db0 0x56456f54e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.792+0000 7ffa23006740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56456f4c5980 con 0x56456f529450 2024-09-15T23:14:55.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.792+0000 7ffa23006740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ffa181fd860 con 0x56456f52abe0 2024-09-15T23:14:55.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.792+0000 7ffa23006740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x56456f54f080 con 0x56456f568db0 2024-09-15T23:14:55.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.792+0000 7ffa23006740 10 client.0 _ll_register_callbacks cb 0x7ffa10034070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:55.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.792+0000 7ffa1df29640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56456f529450 0x56456f546750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.792+0000 7ffa1df29640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56456f529450 0x56456f546750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48546/0 (socket says 172.21.15.123:48546) 2024-09-15T23:14:55.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.792+0000 7ffa1df29640 1 -- 172.21.15.123:0/3175637273 learned_addr learned my addr 172.21.15.123:0/3175637273 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:55.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.792+0000 7ffa1d728640 1 --2- 172.21.15.123:0/3175637273 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56456f52abe0 0x56456f5ebb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.792+0000 7ffa1e72a640 1 --2- 172.21.15.123:0/3175637273 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56456f568db0 0x56456f54e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.793+0000 7ffa1df29640 1 -- 172.21.15.123:0/3175637273 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56456f568db0 msgr2=0x56456f54e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.793+0000 7ffa1df29640 1 --2- 172.21.15.123:0/3175637273 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56456f568db0 0x56456f54e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.793+0000 7ffa1df29640 1 -- 172.21.15.123:0/3175637273 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56456f52abe0 msgr2=0x56456f5ebb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:55.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.793+0000 7ffa1df29640 1 --2- 172.21.15.123:0/3175637273 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56456f52abe0 0x56456f5ebb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.793+0000 7ffa1df29640 1 -- 172.21.15.123:0/3175637273 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56456f550260 con 0x56456f529450 2024-09-15T23:14:55.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.793+0000 7ffa1d728640 1 --2- 172.21.15.123:0/3175637273 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56456f52abe0 0x56456f5ebb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:55.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.793+0000 7ffa1e72a640 1 --2- 172.21.15.123:0/3175637273 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56456f568db0 0x56456f54e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:55.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.793+0000 7ffa1df29640 1 --2- 172.21.15.123:0/3175637273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56456f529450 0x56456f546750 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ffa14000c00 tx=0x7ffa1401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=429a7a994d650624 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:55.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.793+0000 7ff9f8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:55.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.793+0000 7ff9f8ff9640 1 -- 172.21.15.123:0/3175637273 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa14075020 con 0x56456f529450 2024-09-15T23:14:55.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.793+0000 7ff9f8ff9640 1 -- 172.21.15.123:0/3175637273 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7ffa14058970 con 0x56456f529450 2024-09-15T23:14:55.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.793+0000 7ffa23006740 1 -- 172.21.15.123:0/3175637273 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa10037040 con 0x56456f529450 2024-09-15T23:14:55.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.793+0000 7ff9f8ff9640 1 -- 172.21.15.123:0/3175637273 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ffa1405d0d0 con 0x56456f529450 2024-09-15T23:14:55.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.793+0000 7ffa23006740 10 client.5745 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:55.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.793+0000 7ffa23006740 1 -- 172.21.15.123:0/3175637273 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x56456f552a80 con 0x56456f529450 2024-09-15T23:14:55.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.793+0000 7ff9f8ff9640 1 -- 172.21.15.123:0/3175637273 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa10037040 con 0x56456f529450 2024-09-15T23:14:55.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.793+0000 7ff9f8ff9640 1 -- 172.21.15.123:0/3175637273 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7ffa1405d270 con 0x56456f529450 2024-09-15T23:14:55.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.793+0000 7ffa23006740 10 client.5745 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:55.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.793+0000 7ffa23006740 10 client.5745 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:55.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.793+0000 7ffa23006740 20 client.5745 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:55.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.793+0000 7ffa23006740 1 --2- 172.21.15.123:0/3175637273 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x56456f527a10 0x56456f54e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:55.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.793+0000 7ffa23006740 4 client.5745 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/"}] 2024-09-15T23:14:55.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.793+0000 7ffa23006740 1 -- 172.21.15.123:0/3175637273 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "flush_path", "path": "/"}) -- 0x56456f493090 con 0x56456f527a10 2024-09-15T23:14:55.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.794+0000 7ffa1d728640 1 --2- 172.21.15.123:0/3175637273 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x56456f527a10 0x56456f54e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:55.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.794+0000 7ff9f8ff9640 10 client.5745 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:55.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.794+0000 7ffa1d728640 1 --2- 172.21.15.123:0/3175637273 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x56456f527a10 0x56456f54e830 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32b34ad9e721e852 server_cookie=d50f3c87626440b4 in_seq=0 out_seq=0 2024-09-15T23:14:55.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.796+0000 7ff9f8ff9640 1 -- 172.21.15.123:0/3175637273 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56456f493090 con 0x56456f527a10 2024-09-15T23:14:55.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.796+0000 7ff9f8ff9640 10 client.5745 handle_command_reply: tid=0 2024-09-15T23:14:55.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.796+0000 7ffa23006740 1 client.5745 shutdown 2024-09-15T23:14:55.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.796+0000 7ffa23006740 1 -- 172.21.15.123:0/3175637273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56456f529450 msgr2=0x56456f546750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.796+0000 7ffa23006740 1 --2- 172.21.15.123:0/3175637273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56456f529450 0x56456f546750 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ffa14000c00 tx=0x7ffa1401e000 comp rx=0 tx=0).stop 2024-09-15T23:14:55.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.796+0000 7ffa23006740 1 -- 172.21.15.123:0/3175637273 shutdown_connections 2024-09-15T23:14:55.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.796+0000 7ffa23006740 1 --2- 172.21.15.123:0/3175637273 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x56456f527a10 0x56456f54e830 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.796+0000 7ffa23006740 1 --2- 172.21.15.123:0/3175637273 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56456f568db0 0x56456f54e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.796+0000 7ff9f8ff9640 0 client.5745 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:55.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.796+0000 7ffa23006740 1 --2- 172.21.15.123:0/3175637273 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56456f52abe0 0x56456f5ebb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.796+0000 7ffa23006740 1 --2- 172.21.15.123:0/3175637273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56456f529450 0x56456f546750 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.796+0000 7ffa23006740 1 -- 172.21.15.123:0/3175637273 >> 172.21.15.123:0/3175637273 conn(0x56456f526c10 msgr2=0x56456f56c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:55.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.796+0000 7ffa23006740 1 -- 172.21.15.123:0/3175637273 shutdown_connections 2024-09-15T23:14:55.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.796+0000 7ffa23006740 1 -- 172.21.15.123:0/3175637273 wait complete. 2024-09-15T23:14:55.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.796+0000 7ffa23006740 20 client.5745 trim_cache size 0 max 16384 2024-09-15T23:14:55.804 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:14:55.805 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "", 2024-09-15T23:14:55.805 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0 2024-09-15T23:14:55.805 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:14:55.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.797+0000 7ffa2018d640 1 -- 172.21.15.123:0/1197044487 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff9fc06c2b0 msgr2=0x7ff9fc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.797+0000 7ffa2018d640 1 --2- 172.21.15.123:0/1197044487 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff9fc06c2b0 0x7ff9fc06e770 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ffa08006fd0 tx=0x7ffa08008040 comp rx=0 tx=0).stop 2024-09-15T23:14:55.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.797+0000 7ffa2018d640 1 -- 172.21.15.123:0/1197044487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa180ccf30 msgr2=0x7ffa1814e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:55.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.797+0000 7ffa2018d640 1 --2- 172.21.15.123:0/1197044487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa180ccf30 0x7ffa1814e990 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ffa1400c5a0 tx=0x7ffa1400ca60 comp rx=0 tx=0).stop 2024-09-15T23:14:55.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.797+0000 7ffa2018d640 1 -- 172.21.15.123:0/1197044487 shutdown_connections 2024-09-15T23:14:55.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.797+0000 7ffa2018d640 1 --2- 172.21.15.123:0/1197044487 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa1815b7c0 0x7ffa1814be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.797+0000 7ffa2018d640 1 --2- 172.21.15.123:0/1197044487 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa180cead0 0x7ffa18150810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.797+0000 7ffa2018d640 1 --2- 172.21.15.123:0/1197044487 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff9fc06c2b0 0x7ff9fc06e770 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.797+0000 7ffa2018d640 1 --2- 172.21.15.123:0/1197044487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa180ccf30 0x7ffa1814e990 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:55.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.797+0000 7ffa2018d640 1 -- 172.21.15.123:0/1197044487 >> 172.21.15.123:0/1197044487 conn(0x7ffa1806d0f0 msgr2=0x7ffa1814d770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:55.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.797+0000 7ffa2018d640 1 -- 172.21.15.123:0/1197044487 shutdown_connections 2024-09-15T23:14:55.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55.797+0000 7ffa2018d640 1 -- 172.21.15.123:0/1197044487 wait complete. 2024-09-15T23:14:55.809 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' returned '{'message': '', 'return_code': 0}' 2024-09-15T23:14:55.809 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-09-15T23:14:55.809 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_test_path 2024-09-15T23:14:55.809 INFO:tasks.cephfs.test_scrub_checks:Cloning repo into place 2024-09-15T23:14:55.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:14:55.809 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p /home/ubuntu/cephtest/mnt.0/scrub_test_path) 2024-09-15T23:14:55.825 DEBUG:teuthology.orchestra.run.smithi123:> stdin-killer -- python3 -c ' 2024-09-15T23:14:55.825 DEBUG:teuthology.orchestra.run.smithi123:> import os 2024-09-15T23:14:55.825 DEBUG:teuthology.orchestra.run.smithi123:> import stat 2024-09-15T23:14:55.825 DEBUG:teuthology.orchestra.run.smithi123:> import json 2024-09-15T23:14:55.825 DEBUG:teuthology.orchestra.run.smithi123:> import sys 2024-09-15T23:14:55.825 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-15T23:14:55.825 DEBUG:teuthology.orchestra.run.smithi123:> try: 2024-09-15T23:14:55.825 DEBUG:teuthology.orchestra.run.smithi123:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'"'"') 2024-09-15T23:14:55.825 DEBUG:teuthology.orchestra.run.smithi123:> except OSError as e: 2024-09-15T23:14:55.825 DEBUG:teuthology.orchestra.run.smithi123:> sys.exit(e.errno) 2024-09-15T23:14:55.826 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-15T23:14:55.826 DEBUG:teuthology.orchestra.run.smithi123:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-15T23:14:55.826 DEBUG:teuthology.orchestra.run.smithi123:> print(json.dumps( 2024-09-15T23:14:55.826 DEBUG:teuthology.orchestra.run.smithi123:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-15T23:14:55.826 DEBUG:teuthology.orchestra.run.smithi123:> indent=2)) 2024-09-15T23:14:55.826 DEBUG:teuthology.orchestra.run.smithi123:> ' 2024-09-15T23:14:55.930 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:14:55.930 INFO:teuthology.orchestra.run.smithi123.stdout: "st_mode": 16877, 2024-09-15T23:14:55.930 INFO:teuthology.orchestra.run.smithi123.stdout: "st_ino": 1099511627777, 2024-09-15T23:14:55.930 INFO:teuthology.orchestra.run.smithi123.stdout: "st_dev": 41, 2024-09-15T23:14:55.930 INFO:teuthology.orchestra.run.smithi123.stdout: "st_nlink": 16, 2024-09-15T23:14:55.930 INFO:teuthology.orchestra.run.smithi123.stdout: "st_uid": 1000, 2024-09-15T23:14:55.931 INFO:teuthology.orchestra.run.smithi123.stdout: "st_gid": 1333, 2024-09-15T23:14:55.931 INFO:teuthology.orchestra.run.smithi123.stdout: "st_size": 18, 2024-09-15T23:14:55.931 INFO:teuthology.orchestra.run.smithi123.stdout: "st_atime": 1726442084.380754, 2024-09-15T23:14:55.931 INFO:teuthology.orchestra.run.smithi123.stdout: "st_mtime": 1726442089.0526433, 2024-09-15T23:14:55.931 INFO:teuthology.orchestra.run.smithi123.stdout: "st_ctime": 1726442089.0526433 2024-09-15T23:14:55.931 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:14:55.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:14:55.939 INFO:tasks.cephfs.test_scrub_checks:Initiating mds_scrub_checks on mds.0 test_path /scrub_test_path, run_seq 1 2024-09-15T23:14:55.939 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/i/dont/exist' 2024-09-15T23:14:55.939 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/i/dont/exist 2024-09-15T23:14:56.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.077+0000 7f106e3f1640 1 Processor -- start 2024-09-15T23:14:56.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.077+0000 7f106e3f1640 1 -- start start 2024-09-15T23:14:56.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.078+0000 7f106e3f1640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1068155950 0x7f1068073600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.078+0000 7f106e3f1640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f10680afb20 0x7f10680aff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.078+0000 7f106e3f1640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1068073cc0 con 0x7f1068162c80 2024-09-15T23:14:56.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.078+0000 7f106e3f1640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f10680b04d0 con 0x7f1068155950 2024-09-15T23:14:56.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.078+0000 7f106e3f1640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f1068070370 con 0x7f10680afb20 2024-09-15T23:14:56.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.078+0000 7f1067fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1068155950 0x7f1068073600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.078+0000 7f105ffff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1068162c80 0x7f106806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41148/0 (socket says 172.21.15.123:41148) 2024-09-15T23:14:56.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.078+0000 7f105ffff640 1 -- 172.21.15.123:0/2046680683 learned_addr learned my addr 172.21.15.123:0/2046680683 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:56.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.079+0000 7f106c98e640 1 --2- 172.21.15.123:0/2046680683 >> v2:172.21.15.188:3300/0 conn(0x7f10680afb20 0x7f10680aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.079+0000 7f1067fff640 1 -- 172.21.15.123:0/2046680683 >> v2:172.21.15.188:3300/0 conn(0x7f10680afb20 msgr2=0x7f10680aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.079+0000 7f1067fff640 1 --2- 172.21.15.123:0/2046680683 >> v2:172.21.15.188:3300/0 conn(0x7f10680afb20 0x7f10680aff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.079+0000 7f1067fff640 1 -- 172.21.15.123:0/2046680683 >> v1:172.21.15.123:6789/0 conn(0x7f1068162c80 legacy=0x7f106806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.079+0000 7f1067fff640 1 -- 172.21.15.123:0/2046680683 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1068071aa0 con 0x7f1068155950 2024-09-15T23:14:56.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.079+0000 7f10677fe640 1 -- 172.21.15.123:0/2046680683 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3343654057 0 0) 0x7f1068073cc0 con 0x7f1068162c80 2024-09-15T23:14:56.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.079+0000 7f106c98e640 1 --2- 172.21.15.123:0/2046680683 >> v2:172.21.15.188:3300/0 conn(0x7f10680afb20 0x7f10680aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:56.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.079+0000 7f1067fff640 1 --2- 172.21.15.123:0/2046680683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1068155950 0x7f1068073600 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f106806ebb0 tx=0x7f105802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9592c97dd98c1d64 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.079+0000 7f10677fe640 1 -- 172.21.15.123:0/2046680683 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1058037070 con 0x7f1068155950 2024-09-15T23:14:56.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.079+0000 7f10677fe640 1 -- 172.21.15.123:0/2046680683 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1058032440 con 0x7f1068155950 2024-09-15T23:14:56.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.079+0000 7f10677fe640 1 -- 172.21.15.123:0/2046680683 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1058032810 con 0x7f1068155950 2024-09-15T23:14:56.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.080+0000 7f106e3f1640 1 -- 172.21.15.123:0/2046680683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1068155950 msgr2=0x7f1068073600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.080+0000 7f106e3f1640 1 --2- 172.21.15.123:0/2046680683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1068155950 0x7f1068073600 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f106806ebb0 tx=0x7f105802a1a0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.080+0000 7f106e3f1640 1 -- 172.21.15.123:0/2046680683 shutdown_connections 2024-09-15T23:14:56.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.080+0000 7f106e3f1640 1 --2- 172.21.15.123:0/2046680683 >> v2:172.21.15.188:3300/0 conn(0x7f10680afb20 0x7f10680aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.080+0000 7f106e3f1640 1 --2- 172.21.15.123:0/2046680683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1068155950 0x7f1068073600 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.080+0000 7f106e3f1640 1 -- 172.21.15.123:0/2046680683 >> 172.21.15.123:0/2046680683 conn(0x7f106806db30 msgr2=0x7f106806df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:56.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.080+0000 7f106e3f1640 1 -- 172.21.15.123:0/2046680683 shutdown_connections 2024-09-15T23:14:56.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.080+0000 7f106e3f1640 1 -- 172.21.15.123:0/2046680683 wait complete. 2024-09-15T23:14:56.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.081+0000 7f106e3f1640 1 Processor -- start 2024-09-15T23:14:56.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.081+0000 7f106e3f1640 1 -- start start 2024-09-15T23:14:56.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.082+0000 7f106e3f1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10680afb20 0x7f10680b0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.082+0000 7f106e3f1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1068162c80 0x7f106814ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.082+0000 7f106e3f1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f10680b18a0 0x7f10680b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.082+0000 7f106e3f1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f10681630e0 con 0x7f10680afb20 2024-09-15T23:14:56.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.082+0000 7f106e3f1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f106806c320 con 0x7f10680b18a0 2024-09-15T23:14:56.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.082+0000 7f106e3f1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1068072060 con 0x7f1068162c80 2024-09-15T23:14:56.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.082+0000 7f1067fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10680afb20 0x7f10680b0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.082+0000 7f1067fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10680afb20 0x7f10680b0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48568/0 (socket says 172.21.15.123:48568) 2024-09-15T23:14:56.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.082+0000 7f1067fff640 1 -- 172.21.15.123:0/2856349012 learned_addr learned my addr 172.21.15.123:0/2856349012 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:56.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.082+0000 7f1067fff640 1 -- 172.21.15.123:0/2856349012 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1068162c80 msgr2=0x7f106814ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.082+0000 7f1067fff640 1 --2- 172.21.15.123:0/2856349012 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1068162c80 0x7f106814ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.082+0000 7f1067fff640 1 -- 172.21.15.123:0/2856349012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f10680b18a0 msgr2=0x7f10680b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.082+0000 7f1067fff640 1 --2- 172.21.15.123:0/2856349012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f10680b18a0 0x7f10680b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.082+0000 7f1067fff640 1 -- 172.21.15.123:0/2856349012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10681f4890 con 0x7f10680afb20 2024-09-15T23:14:56.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.082+0000 7f1067fff640 1 --2- 172.21.15.123:0/2856349012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10680afb20 0x7f10680b0650 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1058000c00 tx=0x7f10580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.083+0000 7f10657fa640 1 -- 172.21.15.123:0/2856349012 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1058037050 con 0x7f10680afb20 2024-09-15T23:14:56.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.083+0000 7f10657fa640 1 -- 172.21.15.123:0/2856349012 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1058038040 con 0x7f10680afb20 2024-09-15T23:14:56.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.083+0000 7f10657fa640 1 -- 172.21.15.123:0/2856349012 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1058004450 con 0x7f10680afb20 2024-09-15T23:14:56.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.083+0000 7f106e3f1640 1 -- 172.21.15.123:0/2856349012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10681f4b70 con 0x7f10680afb20 2024-09-15T23:14:56.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.083+0000 7f106e3f1640 1 -- 172.21.15.123:0/2856349012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10681f5130 con 0x7f10680afb20 2024-09-15T23:14:56.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.084+0000 7f10657fa640 1 -- 172.21.15.123:0/2856349012 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1058030980 con 0x7f10680afb20 2024-09-15T23:14:56.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.085+0000 7f10657fa640 1 --2- 172.21.15.123:0/2856349012 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f104806c2b0 0x7f104806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.085+0000 7f10657fa640 1 -- 172.21.15.123:0/2856349012 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7f10580ac280 con 0x7f10680afb20 2024-09-15T23:14:56.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.085+0000 7f105ffff640 1 --2- 172.21.15.123:0/2856349012 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f104806c2b0 0x7f104806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.086+0000 7f105ffff640 1 --2- 172.21.15.123:0/2856349012 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f104806c2b0 0x7f104806e770 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1050000c00 tx=0x7f10500079c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.086+0000 7f1071263740 1 Processor -- start 2024-09-15T23:14:56.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.086+0000 7f1071263740 1 -- start start 2024-09-15T23:14:56.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.087+0000 7f1071263740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c774100420 0x55c774145bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.087+0000 7f1071263740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c7740fdbe0 0x55c774100800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.087+0000 7f1071263740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c774101bb0 0x55c7740faa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.087+0000 7f1071263740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55c774063890 con 0x55c774101bb0 2024-09-15T23:14:56.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.087+0000 7f1071263740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55c77400b6a0 con 0x55c7740fdbe0 2024-09-15T23:14:56.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.087+0000 7f1071263740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55c77405f850 con 0x55c774100420 2024-09-15T23:14:56.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.087+0000 7f106c98e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c774101bb0 0x55c7740faa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.087+0000 7f106c98e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c774101bb0 0x55c7740faa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48576/0 (socket says 172.21.15.123:48576) 2024-09-15T23:14:56.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.087+0000 7f106c98e640 1 -- 172.21.15.123:0/1954136548 learned_addr learned my addr 172.21.15.123:0/1954136548 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:56.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.087+0000 7f1067fff640 1 --2- 172.21.15.123:0/1954136548 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c774100420 0x55c774145bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.087+0000 7f105ffff640 1 --2- 172.21.15.123:0/1954136548 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c7740fdbe0 0x55c774100800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.087+0000 7f106c98e640 1 -- 172.21.15.123:0/1954136548 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c774100420 msgr2=0x55c774145bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.087+0000 7f106c98e640 1 --2- 172.21.15.123:0/1954136548 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c774100420 0x55c774145bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.087+0000 7f106c98e640 1 -- 172.21.15.123:0/1954136548 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c7740fdbe0 msgr2=0x55c774100800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.087+0000 7f106c98e640 1 --2- 172.21.15.123:0/1954136548 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c7740fdbe0 0x55c774100800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.087+0000 7f106c98e640 1 -- 172.21.15.123:0/1954136548 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c774031300 con 0x55c774101bb0 2024-09-15T23:14:56.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.087+0000 7f105ffff640 1 --2- 172.21.15.123:0/1954136548 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c7740fdbe0 0x55c774100800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:56.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.087+0000 7f1067fff640 1 --2- 172.21.15.123:0/1954136548 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c774100420 0x55c774145bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:56.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.087+0000 7f106c98e640 1 --2- 172.21.15.123:0/1954136548 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c774101bb0 0x55c7740faa10 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1060008f60 tx=0x7f1060008f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3bfcdd6fbc93a4e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.087+0000 7f105dffb640 1 -- 172.21.15.123:0/1954136548 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106000e910 con 0x55c774101bb0 2024-09-15T23:14:56.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.087+0000 7f105dffb640 1 -- 172.21.15.123:0/1954136548 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f106000eab0 con 0x55c774101bb0 2024-09-15T23:14:56.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.087+0000 7f105dffb640 1 -- 172.21.15.123:0/1954136548 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106000b430 con 0x55c774101bb0 2024-09-15T23:14:56.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.088+0000 7f1071263740 1 -- 172.21.15.123:0/1954136548 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c774101bb0 msgr2=0x55c7740faa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.088+0000 7f1071263740 1 --2- 172.21.15.123:0/1954136548 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c774101bb0 0x55c7740faa10 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1060008f60 tx=0x7f1060008f90 comp rx=0 tx=0).stop 2024-09-15T23:14:56.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.088+0000 7f1071263740 1 -- 172.21.15.123:0/1954136548 shutdown_connections 2024-09-15T23:14:56.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.088+0000 7f1071263740 1 --2- 172.21.15.123:0/1954136548 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c774101bb0 0x55c7740faa10 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.088+0000 7f1071263740 1 --2- 172.21.15.123:0/1954136548 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c7740fdbe0 0x55c774100800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.088+0000 7f1071263740 1 --2- 172.21.15.123:0/1954136548 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c774100420 0x55c774145bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.088+0000 7f1071263740 1 -- 172.21.15.123:0/1954136548 >> 172.21.15.123:0/1954136548 conn(0x55c7740fcbe0 msgr2=0x55c774145090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:56.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.088+0000 7f1071263740 1 -- 172.21.15.123:0/1954136548 shutdown_connections 2024-09-15T23:14:56.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.088+0000 7f1071263740 1 -- 172.21.15.123:0/1954136548 wait complete. 2024-09-15T23:14:56.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.088+0000 7f1071263740 1 -- start start 2024-09-15T23:14:56.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.089+0000 7f1071263740 1 Processor -- start 2024-09-15T23:14:56.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.089+0000 7f1071263740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c774100420 0x55c77412aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.089+0000 7f1071263740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c774101bb0 0x55c774122f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.089+0000 7f1071263740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c774123470 0x55c774142300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.089+0000 7f1071263740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55c7740fc080 con 0x55c774123470 2024-09-15T23:14:56.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.089+0000 7f1071263740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55c773fec520 con 0x55c774101bb0 2024-09-15T23:14:56.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.089+0000 7f1071263740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55c7741463f0 con 0x55c774100420 2024-09-15T23:14:56.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.089+0000 7f1071263740 10 client.0 _ll_register_callbacks cb 0x55c773d75d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:56.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.089+0000 7f106c98e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c774123470 0x55c774142300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.090+0000 7f106c98e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c774123470 0x55c774142300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48584/0 (socket says 172.21.15.123:48584) 2024-09-15T23:14:56.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.090+0000 7f106c98e640 1 -- 172.21.15.123:0/2276793705 learned_addr learned my addr 172.21.15.123:0/2276793705 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:56.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.090+0000 7f105ffff640 1 --2- 172.21.15.123:0/2276793705 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c774101bb0 0x55c774122f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.090+0000 7f1067fff640 1 --2- 172.21.15.123:0/2276793705 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c774100420 0x55c77412aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.090+0000 7f106c98e640 1 -- 172.21.15.123:0/2276793705 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c774100420 msgr2=0x55c77412aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.090+0000 7f106c98e640 1 --2- 172.21.15.123:0/2276793705 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c774100420 0x55c77412aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.090+0000 7f106c98e640 1 -- 172.21.15.123:0/2276793705 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c774101bb0 msgr2=0x55c774122f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.090+0000 7f106c98e640 1 --2- 172.21.15.123:0/2276793705 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c774101bb0 0x55c774122f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.090+0000 7f106c98e640 1 -- 172.21.15.123:0/2276793705 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c773d5a590 con 0x55c774123470 2024-09-15T23:14:56.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.090+0000 7f105ffff640 1 --2- 172.21.15.123:0/2276793705 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c774101bb0 0x55c774122f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:56.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.090+0000 7f106c98e640 1 --2- 172.21.15.123:0/2276793705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c774123470 0x55c774142300 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1060018040 tx=0x7f1060005d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e7b55e48c9b7487 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.090+0000 7f1046ffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:56.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.090+0000 7f1046ffd640 1 -- 172.21.15.123:0/2276793705 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1060026020 con 0x55c774123470 2024-09-15T23:14:56.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.090+0000 7f1046ffd640 1 -- 172.21.15.123:0/2276793705 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7f1060003da0 con 0x55c774123470 2024-09-15T23:14:56.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.090+0000 7f1071263740 1 -- 172.21.15.123:0/2276793705 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f106000eab0 con 0x55c774123470 2024-09-15T23:14:56.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.090+0000 7f1046ffd640 1 -- 172.21.15.123:0/2276793705 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1060030050 con 0x55c774123470 2024-09-15T23:14:56.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.090+0000 7f1071263740 10 client.5760 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:56.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.090+0000 7f1071263740 1 -- 172.21.15.123:0/2276793705 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55c773d76590 con 0x55c774123470 2024-09-15T23:14:56.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.090+0000 7f1046ffd640 1 -- 172.21.15.123:0/2276793705 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f106000eab0 con 0x55c774123470 2024-09-15T23:14:56.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.091+0000 7f1046ffd640 1 -- 172.21.15.123:0/2276793705 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f1060033020 con 0x55c774123470 2024-09-15T23:14:56.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.091+0000 7f1071263740 10 client.5760 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:56.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.091+0000 7f1071263740 10 client.5760 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:56.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.091+0000 7f1071263740 20 client.5760 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:56.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.091+0000 7f1071263740 1 --2- 172.21.15.123:0/2276793705 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55c774120630 0x55c774120a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.091+0000 7f1071263740 4 client.5760 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:14:56.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.091+0000 7f1071263740 1 -- 172.21.15.123:0/2276793705 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c774070fc0 con 0x55c774120630 2024-09-15T23:14:56.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.091+0000 7f1067fff640 1 --2- 172.21.15.123:0/2276793705 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55c774120630 0x55c774120a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.091+0000 7f1046ffd640 10 client.5760 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:56.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.091+0000 7f1067fff640 1 --2- 172.21.15.123:0/2276793705 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55c774120630 0x55c774120a40 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8aca218e0d9bb6f4 server_cookie=3005620022b5088e in_seq=0 out_seq=0 2024-09-15T23:14:56.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.092+0000 7f1046ffd640 1 -- 172.21.15.123:0/2276793705 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c774070fc0 con 0x55c774120630 2024-09-15T23:14:56.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.092+0000 7f1046ffd640 10 client.5760 handle_command_reply: tid=0 2024-09-15T23:14:56.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.092+0000 7f1071263740 1 client.5760 shutdown 2024-09-15T23:14:56.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.092+0000 7f1071263740 1 -- 172.21.15.123:0/2276793705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c774123470 msgr2=0x55c774142300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.092+0000 7f1071263740 1 --2- 172.21.15.123:0/2276793705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c774123470 0x55c774142300 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1060018040 tx=0x7f1060005d10 comp rx=0 tx=0).stop 2024-09-15T23:14:56.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.092+0000 7f1071263740 1 -- 172.21.15.123:0/2276793705 shutdown_connections 2024-09-15T23:14:56.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.092+0000 7f1071263740 1 --2- 172.21.15.123:0/2276793705 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55c774120630 0x55c774120a40 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.092+0000 7f1071263740 1 --2- 172.21.15.123:0/2276793705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c774123470 0x55c774142300 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.092+0000 7f1046ffd640 0 client.5760 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:56.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.092+0000 7f1071263740 1 --2- 172.21.15.123:0/2276793705 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c774101bb0 0x55c774122f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.092+0000 7f1071263740 1 --2- 172.21.15.123:0/2276793705 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c774100420 0x55c77412aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.092+0000 7f1071263740 1 -- 172.21.15.123:0/2276793705 >> 172.21.15.123:0/2276793705 conn(0x55c7740fdbe0 msgr2=0x55c774143110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:56.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.092+0000 7f1071263740 1 -- 172.21.15.123:0/2276793705 shutdown_connections 2024-09-15T23:14:56.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.092+0000 7f1071263740 1 -- 172.21.15.123:0/2276793705 wait complete. 2024-09-15T23:14:56.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.092+0000 7f1071263740 20 client.5760 trim_cache size 0 max 16384 2024-09-15T23:14:56.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.106+0000 7f1071263740 1 Processor -- start 2024-09-15T23:14:56.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.107+0000 7f1071263740 1 -- start start 2024-09-15T23:14:56.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.107+0000 7f1071263740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c774100420 0x55c7740ffa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.107+0000 7f1071263740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c774101bb0 0x55c77411f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.107+0000 7f1071263740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c774123470 0x55c77411fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.107+0000 7f1071263740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1068200de0 con 0x55c774123470 2024-09-15T23:14:56.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.107+0000 7f1071263740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f10681ffea0 con 0x55c774101bb0 2024-09-15T23:14:56.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.107+0000 7f1071263740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f10680cdb90 con 0x55c774100420 2024-09-15T23:14:56.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.107+0000 7f106c98e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c774123470 0x55c77411fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.107+0000 7f106c98e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c774123470 0x55c77411fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48596/0 (socket says 172.21.15.123:48596) 2024-09-15T23:14:56.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.107+0000 7f106c98e640 1 -- 172.21.15.123:0/33773789 learned_addr learned my addr 172.21.15.123:0/33773789 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:56.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.108+0000 7f105ffff640 1 --2- 172.21.15.123:0/33773789 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c774101bb0 0x55c77411f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.108+0000 7f1067fff640 1 --2- 172.21.15.123:0/33773789 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c774100420 0x55c7740ffa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.108+0000 7f106c98e640 1 -- 172.21.15.123:0/33773789 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c774100420 msgr2=0x55c7740ffa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.108+0000 7f106c98e640 1 --2- 172.21.15.123:0/33773789 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c774100420 0x55c7740ffa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.108+0000 7f106c98e640 1 -- 172.21.15.123:0/33773789 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c774101bb0 msgr2=0x55c77411f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.108+0000 7f106c98e640 1 --2- 172.21.15.123:0/33773789 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c774101bb0 0x55c77411f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.108+0000 7f106c98e640 1 -- 172.21.15.123:0/33773789 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c773e40970 con 0x55c774123470 2024-09-15T23:14:56.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.108+0000 7f1067fff640 1 --2- 172.21.15.123:0/33773789 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c774100420 0x55c7740ffa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:56.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.108+0000 7f106c98e640 1 --2- 172.21.15.123:0/33773789 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c774123470 0x55c77411fba0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f10600087c0 tx=0x7f106001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f0f024f68861d76 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.108+0000 7f105d7fa640 1 -- 172.21.15.123:0/33773789 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1060039070 con 0x55c774123470 2024-09-15T23:14:56.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.108+0000 7f105d7fa640 1 -- 172.21.15.123:0/33773789 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1060003da0 con 0x55c774123470 2024-09-15T23:14:56.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.108+0000 7f105d7fa640 1 -- 172.21.15.123:0/33773789 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1060026070 con 0x55c774123470 2024-09-15T23:14:56.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.108+0000 7f1071263740 1 -- 172.21.15.123:0/33773789 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c774123470 msgr2=0x55c77411fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.108+0000 7f1071263740 1 --2- 172.21.15.123:0/33773789 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c774123470 0x55c77411fba0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f10600087c0 tx=0x7f106001f000 comp rx=0 tx=0).stop 2024-09-15T23:14:56.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.108+0000 7f1071263740 1 -- 172.21.15.123:0/33773789 shutdown_connections 2024-09-15T23:14:56.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.108+0000 7f1071263740 1 --2- 172.21.15.123:0/33773789 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c774123470 0x55c77411fba0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.108+0000 7f1071263740 1 --2- 172.21.15.123:0/33773789 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c774101bb0 0x55c77411f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.108+0000 7f1071263740 1 --2- 172.21.15.123:0/33773789 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c774100420 0x55c7740ffa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.108+0000 7f1071263740 1 -- 172.21.15.123:0/33773789 >> 172.21.15.123:0/33773789 conn(0x55c7740fdbe0 msgr2=0x55c7740f5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:56.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.109+0000 7f1071263740 1 -- 172.21.15.123:0/33773789 shutdown_connections 2024-09-15T23:14:56.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.109+0000 7f1071263740 1 -- 172.21.15.123:0/33773789 wait complete. 2024-09-15T23:14:56.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.109+0000 7f1071263740 1 -- start start 2024-09-15T23:14:56.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.109+0000 7f1071263740 1 Processor -- start 2024-09-15T23:14:56.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.110+0000 7f1071263740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c774100420 0x55c77415f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.110+0000 7f1071263740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c774101bb0 0x55c7741bfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.110+0000 7f1071263740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c774123470 0x55c774143110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.110+0000 7f1071263740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f10680ce1e0 con 0x55c774100420 2024-09-15T23:14:56.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.110+0000 7f1071263740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55c774100800 con 0x55c774123470 2024-09-15T23:14:56.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.110+0000 7f1071263740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55c7741217f0 con 0x55c774101bb0 2024-09-15T23:14:56.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.110+0000 7f1071263740 10 client.0 _ll_register_callbacks cb 0x7f1060008d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:56.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.110+0000 7f1067fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c774100420 0x55c77415f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.110+0000 7f1067fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c774100420 0x55c77415f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48598/0 (socket says 172.21.15.123:48598) 2024-09-15T23:14:56.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.110+0000 7f1067fff640 1 -- 172.21.15.123:0/2593905622 learned_addr learned my addr 172.21.15.123:0/2593905622 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:56.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.110+0000 7f106c98e640 1 --2- 172.21.15.123:0/2593905622 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c774123470 0x55c774143110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.110+0000 7f105ffff640 1 --2- 172.21.15.123:0/2593905622 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c774101bb0 0x55c7741bfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.110+0000 7f1067fff640 1 -- 172.21.15.123:0/2593905622 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c774101bb0 msgr2=0x55c7741bfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.110+0000 7f1067fff640 1 --2- 172.21.15.123:0/2593905622 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c774101bb0 0x55c7741bfff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.110+0000 7f1067fff640 1 -- 172.21.15.123:0/2593905622 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c774123470 msgr2=0x55c774143110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.110+0000 7f1067fff640 1 --2- 172.21.15.123:0/2593905622 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c774123470 0x55c774143110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.110+0000 7f1067fff640 1 -- 172.21.15.123:0/2593905622 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c774142160 con 0x55c774100420 2024-09-15T23:14:56.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.110+0000 7f106c98e640 1 --2- 172.21.15.123:0/2593905622 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c774123470 0x55c774143110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:56.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.111+0000 7f1067fff640 1 --2- 172.21.15.123:0/2593905622 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c774100420 0x55c77415f0f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f1058035040 tx=0x7f1058008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=604cc6b39fe0f569 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.111+0000 7f1046ffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:56.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.111+0000 7f1046ffd640 1 -- 172.21.15.123:0/2593905622 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105807aa80 con 0x55c774100420 2024-09-15T23:14:56.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.111+0000 7f1046ffd640 1 -- 172.21.15.123:0/2593905622 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7f1058046e00 con 0x55c774100420 2024-09-15T23:14:56.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.111+0000 7f1071263740 1 -- 172.21.15.123:0/2593905622 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1060003da0 con 0x55c774100420 2024-09-15T23:14:56.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.111+0000 7f1046ffd640 1 -- 172.21.15.123:0/2593905622 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f105807a380 con 0x55c774100420 2024-09-15T23:14:56.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.111+0000 7f1071263740 10 client.5766 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:56.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.111+0000 7f1071263740 1 -- 172.21.15.123:0/2593905622 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55c774121a40 con 0x55c774100420 2024-09-15T23:14:56.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.111+0000 7f1046ffd640 1 -- 172.21.15.123:0/2593905622 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1060003da0 con 0x55c774100420 2024-09-15T23:14:56.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.111+0000 7f1046ffd640 1 -- 172.21.15.123:0/2593905622 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f10580769f0 con 0x55c774100420 2024-09-15T23:14:56.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.111+0000 7f1071263740 10 client.5766 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:56.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.111+0000 7f1071263740 10 client.5766 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:56.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.111+0000 7f1071263740 20 client.5766 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:56.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.111+0000 7f1071263740 1 --2- 172.21.15.123:0/2593905622 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55c774143650 0x55c7741c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.111+0000 7f1071263740 4 client.5766 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}] 2024-09-15T23:14:56.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.111+0000 7f1071263740 1 -- 172.21.15.123:0/2593905622 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/i/dont/exist"}) -- 0x55c77406b310 con 0x55c774143650 2024-09-15T23:14:56.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.111+0000 7f105ffff640 1 --2- 172.21.15.123:0/2593905622 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55c774143650 0x55c7741c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.112+0000 7f105ffff640 1 --2- 172.21.15.123:0/2593905622 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55c774143650 0x55c7741c62a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a27e10b77b016f69 server_cookie=e568b0dde2c835fa in_seq=0 out_seq=0 2024-09-15T23:14:56.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.112+0000 7f1046ffd640 10 client.5766 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:56.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.112+0000 7f1046ffd640 1 -- 172.21.15.123:0/2593905622 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: -2 ) ==== 8+0+45 (crc 0 0 0) 0x55c77406b310 con 0x55c774143650 2024-09-15T23:14:56.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.112+0000 7f1046ffd640 10 client.5766 handle_command_reply: tid=0 2024-09-15T23:14:56.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.112+0000 7f1071263740 1 client.5766 shutdown 2024-09-15T23:14:56.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.112+0000 7f1071263740 1 -- 172.21.15.123:0/2593905622 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c774100420 msgr2=0x55c77415f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.112+0000 7f1071263740 1 --2- 172.21.15.123:0/2593905622 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c774100420 0x55c77415f0f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f1058035040 tx=0x7f1058008040 comp rx=0 tx=0).stop 2024-09-15T23:14:56.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.112+0000 7f1071263740 1 -- 172.21.15.123:0/2593905622 shutdown_connections 2024-09-15T23:14:56.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.112+0000 7f1071263740 1 --2- 172.21.15.123:0/2593905622 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55c774143650 0x55c7741c62a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.112+0000 7f1071263740 1 --2- 172.21.15.123:0/2593905622 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c774123470 0x55c774143110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.112+0000 7f1046ffd640 0 client.5766 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:56.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.112+0000 7f1071263740 1 --2- 172.21.15.123:0/2593905622 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c774101bb0 0x55c7741bfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.112+0000 7f1071263740 1 --2- 172.21.15.123:0/2593905622 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c774100420 0x55c77415f0f0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.112+0000 7f1071263740 1 -- 172.21.15.123:0/2593905622 >> 172.21.15.123:0/2593905622 conn(0x55c7740fdbe0 msgr2=0x55c77411fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:56.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.112+0000 7f1071263740 1 -- 172.21.15.123:0/2593905622 shutdown_connections 2024-09-15T23:14:56.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.112+0000 7f1071263740 1 -- 172.21.15.123:0/2593905622 wait complete. 2024-09-15T23:14:56.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.113+0000 7f1071263740 20 client.5766 trim_cache size 0 max 16384 2024-09-15T23:14:56.122 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:14:56.122 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "", 2024-09-15T23:14:56.122 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": -2 2024-09-15T23:14:56.122 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:14:56.123 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-15T23:14:56.123 INFO:teuthology.orchestra.run.smithi123.stderr:Error ENOENT: 2024-09-15T23:14:56.123 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/i/dont/exist' returned '{'message': '', 'return_code': -2}' 2024-09-15T23:14:56.123 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/i/dont/exist' 2024-09-15T23:14:56.124 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/i/dont/exist 2024-09-15T23:14:56.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.223+0000 7f0a500b7640 1 Processor -- start 2024-09-15T23:14:56.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.223+0000 7f0a500b7640 1 -- start start 2024-09-15T23:14:56.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.224+0000 7f0a500b7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0a4806c320 0x7f0a48073ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.224+0000 7f0a500b7640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a48158d00 con 0x7f0a48158920 2024-09-15T23:14:56.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.224+0000 7f0a500b7640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a480ce0f0 con 0x7f0a48070f40 2024-09-15T23:14:56.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.224+0000 7f0a500b7640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f0a48072130 con 0x7f0a4806c320 2024-09-15T23:14:56.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.224+0000 7f0a4d652640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0a4806c320 0x7f0a48073ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.224+0000 7f0a4de53640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f0a48158920 0x7f0a4806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54442/0 (socket says 172.21.15.123:54442) 2024-09-15T23:14:56.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.224+0000 7f0a4de53640 1 -- 172.21.15.123:0/3925479789 learned_addr learned my addr 172.21.15.123:0/3925479789 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:56.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.225+0000 7f0a4d652640 1 -- 172.21.15.123:0/3925479789 >> v1:172.21.15.188:6789/0 conn(0x7f0a48070f40 legacy=0x7f0a4815b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.225+0000 7f0a4d652640 1 -- 172.21.15.123:0/3925479789 >> v1:172.21.15.123:6789/0 conn(0x7f0a48158920 legacy=0x7f0a4806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.225+0000 7f0a4d652640 1 -- 172.21.15.123:0/3925479789 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a48071500 con 0x7f0a4806c320 2024-09-15T23:14:56.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.225+0000 7f0a4ce51640 1 -- 172.21.15.123:0/3925479789 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1168773299 0 0) 0x7f0a44001110 con 0x7f0a48158920 2024-09-15T23:14:56.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.225+0000 7f0a4d652640 1 --2- 172.21.15.123:0/3925479789 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a4806c320 0x7f0a48073ac0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f0a380097a0 tx=0x7f0a3802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83454168e27fb3e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.225+0000 7f0a4ce51640 1 -- 172.21.15.123:0/3925479789 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a38037070 con 0x7f0a4806c320 2024-09-15T23:14:56.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.225+0000 7f0a4ce51640 1 -- 172.21.15.123:0/3925479789 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a3802ae50 con 0x7f0a4806c320 2024-09-15T23:14:56.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.225+0000 7f0a4ce51640 1 -- 172.21.15.123:0/3925479789 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a38032660 con 0x7f0a4806c320 2024-09-15T23:14:56.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.226+0000 7f0a500b7640 1 -- 172.21.15.123:0/3925479789 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a4806c320 msgr2=0x7f0a48073ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.226+0000 7f0a500b7640 1 --2- 172.21.15.123:0/3925479789 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a4806c320 0x7f0a48073ac0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f0a380097a0 tx=0x7f0a3802a140 comp rx=0 tx=0).stop 2024-09-15T23:14:56.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.226+0000 7f0a500b7640 1 -- 172.21.15.123:0/3925479789 shutdown_connections 2024-09-15T23:14:56.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.226+0000 7f0a500b7640 1 --2- 172.21.15.123:0/3925479789 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a4806c320 0x7f0a48073ac0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.226+0000 7f0a500b7640 1 -- 172.21.15.123:0/3925479789 >> 172.21.15.123:0/3925479789 conn(0x7f0a4806d0f0 msgr2=0x7f0a4806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:56.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.226+0000 7f0a500b7640 1 -- 172.21.15.123:0/3925479789 shutdown_connections 2024-09-15T23:14:56.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.226+0000 7f0a500b7640 1 -- 172.21.15.123:0/3925479789 wait complete. 2024-09-15T23:14:56.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.227+0000 7f0a500b7640 1 Processor -- start 2024-09-15T23:14:56.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.227+0000 7f0a500b7640 1 -- start start 2024-09-15T23:14:56.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.228+0000 7f0a500b7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a4806c320 0x7f0a4813b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.228+0000 7f0a500b7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0a48070f40 0x7f0a4813fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.228+0000 7f0a500b7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a48158920 0x7f0a4813ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.228+0000 7f0a500b7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0a4806cc30 con 0x7f0a48158920 2024-09-15T23:14:56.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.228+0000 7f0a500b7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0a48071dc0 con 0x7f0a4806c320 2024-09-15T23:14:56.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.228+0000 7f0a500b7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0a480725c0 con 0x7f0a48070f40 2024-09-15T23:14:56.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.228+0000 7f0a4e654640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a48158920 0x7f0a4813ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.228+0000 7f0a4e654640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a48158920 0x7f0a4813ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45162/0 (socket says 172.21.15.123:45162) 2024-09-15T23:14:56.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.228+0000 7f0a4e654640 1 -- 172.21.15.123:0/3538518115 learned_addr learned my addr 172.21.15.123:0/3538518115 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:56.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.228+0000 7f0a4d652640 1 --2- 172.21.15.123:0/3538518115 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0a48070f40 0x7f0a4813fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.228+0000 7f0a4de53640 1 --2- 172.21.15.123:0/3538518115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a4806c320 0x7f0a4813b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.228+0000 7f0a4e654640 1 -- 172.21.15.123:0/3538518115 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0a48070f40 msgr2=0x7f0a4813fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.228+0000 7f0a4e654640 1 --2- 172.21.15.123:0/3538518115 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0a48070f40 0x7f0a4813fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.228+0000 7f0a4e654640 1 -- 172.21.15.123:0/3538518115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a4806c320 msgr2=0x7f0a4813b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.228+0000 7f0a4e654640 1 --2- 172.21.15.123:0/3538518115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a4806c320 0x7f0a4813b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.228+0000 7f0a4e654640 1 -- 172.21.15.123:0/3538518115 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a48144f40 con 0x7f0a48158920 2024-09-15T23:14:56.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.229+0000 7f0a4e654640 1 --2- 172.21.15.123:0/3538518115 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a48158920 0x7f0a4813ffc0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0a4000c7b0 tx=0x7f0a4000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.229+0000 7f0a3e7fc640 1 -- 172.21.15.123:0/3538518115 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a40017070 con 0x7f0a48158920 2024-09-15T23:14:56.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.229+0000 7f0a3e7fc640 1 -- 172.21.15.123:0/3538518115 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a40003da0 con 0x7f0a48158920 2024-09-15T23:14:56.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.229+0000 7f0a500b7640 1 -- 172.21.15.123:0/3538518115 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a481451c0 con 0x7f0a48158920 2024-09-15T23:14:56.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.229+0000 7f0a3e7fc640 1 -- 172.21.15.123:0/3538518115 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a400052b0 con 0x7f0a48158920 2024-09-15T23:14:56.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.229+0000 7f0a500b7640 1 -- 172.21.15.123:0/3538518115 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a48145780 con 0x7f0a48158920 2024-09-15T23:14:56.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.230+0000 7f0a3e7fc640 1 -- 172.21.15.123:0/3538518115 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0a4001a070 con 0x7f0a48158920 2024-09-15T23:14:56.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.231+0000 7f0a3e7fc640 1 --2- 172.21.15.123:0/3538518115 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0a2c06c2b0 0x7f0a2c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.231+0000 7f0a3e7fc640 1 -- 172.21.15.123:0/3538518115 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7f0a4008aa80 con 0x7f0a48158920 2024-09-15T23:14:56.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.231+0000 7f0a4de53640 1 --2- 172.21.15.123:0/3538518115 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0a2c06c2b0 0x7f0a2c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.231+0000 7f0a4de53640 1 --2- 172.21.15.123:0/3538518115 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0a2c06c2b0 0x7f0a2c06e770 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0a44000f60 tx=0x7f0a44009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.232+0000 7f0a52e4e740 1 Processor -- start 2024-09-15T23:14:56.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.232+0000 7f0a52e4e740 1 -- start start 2024-09-15T23:14:56.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.232+0000 7f0a52e4e740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55edc6d69c60 0x55edc6d6a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.232+0000 7f0a52e4e740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55edc6d67420 0x55edc6d68fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.232+0000 7f0a52e4e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55edc6d67880 0x55edc6d49be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.232+0000 7f0a52e4e740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55edc6c86aa0 con 0x55edc6d69c60 2024-09-15T23:14:56.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.232+0000 7f0a52e4e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55edc6c2e8e0 con 0x55edc6d67880 2024-09-15T23:14:56.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.233+0000 7f0a52e4e740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55edc6c82a60 con 0x55edc6d67420 2024-09-15T23:14:56.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.233+0000 7f0a4de53640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55edc6d69c60 0x55edc6d6a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.233+0000 7f0a4de53640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55edc6d69c60 0x55edc6d6a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45174/0 (socket says 172.21.15.123:45174) 2024-09-15T23:14:56.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.233+0000 7f0a4de53640 1 -- 172.21.15.123:0/1076086572 learned_addr learned my addr 172.21.15.123:0/1076086572 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:56.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.233+0000 7f0a4e654640 1 --2- 172.21.15.123:0/1076086572 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55edc6d67880 0x55edc6d49be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.233+0000 7f0a4d652640 1 --2- 172.21.15.123:0/1076086572 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55edc6d67420 0x55edc6d68fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.233+0000 7f0a4de53640 1 -- 172.21.15.123:0/1076086572 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55edc6d67420 msgr2=0x55edc6d68fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.233+0000 7f0a4de53640 1 --2- 172.21.15.123:0/1076086572 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55edc6d67420 0x55edc6d68fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.233+0000 7f0a4de53640 1 -- 172.21.15.123:0/1076086572 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55edc6d67880 msgr2=0x55edc6d49be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.233+0000 7f0a4de53640 1 --2- 172.21.15.123:0/1076086572 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55edc6d67880 0x55edc6d49be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.233+0000 7f0a4de53640 1 -- 172.21.15.123:0/1076086572 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edc6a659f0 con 0x55edc6d69c60 2024-09-15T23:14:56.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.233+0000 7f0a4d652640 1 --2- 172.21.15.123:0/1076086572 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55edc6d67420 0x55edc6d68fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:56.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.233+0000 7f0a4de53640 1 --2- 172.21.15.123:0/1076086572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55edc6d69c60 0x55edc6d6a040 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f0a44007490 tx=0x7f0a44010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f18806feecea4c99 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.233+0000 7f0a2b7fe640 1 -- 172.21.15.123:0/1076086572 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4400da70 con 0x55edc6d69c60 2024-09-15T23:14:56.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.233+0000 7f0a2b7fe640 1 -- 172.21.15.123:0/1076086572 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a4400dc10 con 0x55edc6d69c60 2024-09-15T23:14:56.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.233+0000 7f0a2b7fe640 1 -- 172.21.15.123:0/1076086572 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a44020450 con 0x55edc6d69c60 2024-09-15T23:14:56.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.234+0000 7f0a52e4e740 1 -- 172.21.15.123:0/1076086572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55edc6d69c60 msgr2=0x55edc6d6a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.234+0000 7f0a52e4e740 1 --2- 172.21.15.123:0/1076086572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55edc6d69c60 0x55edc6d6a040 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f0a44007490 tx=0x7f0a44010000 comp rx=0 tx=0).stop 2024-09-15T23:14:56.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.234+0000 7f0a52e4e740 1 -- 172.21.15.123:0/1076086572 shutdown_connections 2024-09-15T23:14:56.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.234+0000 7f0a52e4e740 1 --2- 172.21.15.123:0/1076086572 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55edc6d67880 0x55edc6d49be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.234+0000 7f0a52e4e740 1 --2- 172.21.15.123:0/1076086572 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55edc6d67420 0x55edc6d68fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.234+0000 7f0a52e4e740 1 --2- 172.21.15.123:0/1076086572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55edc6d69c60 0x55edc6d6a040 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.234+0000 7f0a52e4e740 1 -- 172.21.15.123:0/1076086572 >> 172.21.15.123:0/1076086572 conn(0x55edc6d1f8c0 msgr2=0x55edc6d67cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:56.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.234+0000 7f0a52e4e740 1 -- 172.21.15.123:0/1076086572 shutdown_connections 2024-09-15T23:14:56.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.234+0000 7f0a52e4e740 1 -- 172.21.15.123:0/1076086572 wait complete. 2024-09-15T23:14:56.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.234+0000 7f0a52e4e740 1 -- start start 2024-09-15T23:14:56.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.235+0000 7f0a52e4e740 1 Processor -- start 2024-09-15T23:14:56.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.235+0000 7f0a52e4e740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55edc6d67880 0x55edc6d477d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.235+0000 7f0a52e4e740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55edc6d69c60 0x55edc6d5ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.235+0000 7f0a52e4e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55edc6d613f0 0x55edc6d5f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.235+0000 7f0a52e4e740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55edc6d66380 con 0x55edc6d69c60 2024-09-15T23:14:56.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.235+0000 7f0a52e4e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55edc6c41ce0 con 0x55edc6d613f0 2024-09-15T23:14:56.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.235+0000 7f0a52e4e740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55edc6d66660 con 0x55edc6d67880 2024-09-15T23:14:56.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.236+0000 7f0a52e4e740 10 client.0 _ll_register_callbacks cb 0x55edc6998dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:56.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.236+0000 7f0a4d652640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55edc6d69c60 0x55edc6d5ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.236+0000 7f0a4d652640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55edc6d69c60 0x55edc6d5ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45176/0 (socket says 172.21.15.123:45176) 2024-09-15T23:14:56.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.236+0000 7f0a4d652640 1 -- 172.21.15.123:0/2411494511 learned_addr learned my addr 172.21.15.123:0/2411494511 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:56.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.236+0000 7f0a4de53640 1 --2- 172.21.15.123:0/2411494511 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55edc6d67880 0x55edc6d477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.236+0000 7f0a4e654640 1 --2- 172.21.15.123:0/2411494511 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55edc6d613f0 0x55edc6d5f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.236+0000 7f0a4d652640 1 -- 172.21.15.123:0/2411494511 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55edc6d67880 msgr2=0x55edc6d477d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.236+0000 7f0a4d652640 1 --2- 172.21.15.123:0/2411494511 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55edc6d67880 0x55edc6d477d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.236+0000 7f0a4d652640 1 -- 172.21.15.123:0/2411494511 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55edc6d613f0 msgr2=0x55edc6d5f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.236+0000 7f0a4d652640 1 --2- 172.21.15.123:0/2411494511 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55edc6d613f0 0x55edc6d5f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.236+0000 7f0a4d652640 1 -- 172.21.15.123:0/2411494511 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edc69592e0 con 0x55edc6d69c60 2024-09-15T23:14:56.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.236+0000 7f0a4e654640 1 --2- 172.21.15.123:0/2411494511 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55edc6d613f0 0x55edc6d5f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:56.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.236+0000 7f0a4d652640 1 --2- 172.21.15.123:0/2411494511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55edc6d69c60 0x55edc6d5ee00 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f0a380098c0 tx=0x7f0a38004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1742460fa711a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.236+0000 7f0a28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:56.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.236+0000 7f0a28ff9640 1 -- 172.21.15.123:0/2411494511 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a38042030 con 0x55edc6d69c60 2024-09-15T23:14:56.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.236+0000 7f0a28ff9640 1 -- 172.21.15.123:0/2411494511 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7f0a38003610 con 0x55edc6d69c60 2024-09-15T23:14:56.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.236+0000 7f0a52e4e740 1 -- 172.21.15.123:0/2411494511 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a4400dc10 con 0x55edc6d69c60 2024-09-15T23:14:56.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.236+0000 7f0a28ff9640 1 -- 172.21.15.123:0/2411494511 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f0a3804e050 con 0x55edc6d69c60 2024-09-15T23:14:56.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.236+0000 7f0a52e4e740 10 client.5781 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:56.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.236+0000 7f0a52e4e740 1 -- 172.21.15.123:0/2411494511 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55edc6ac6180 con 0x55edc6d69c60 2024-09-15T23:14:56.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.237+0000 7f0a28ff9640 1 -- 172.21.15.123:0/2411494511 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a4400dc10 con 0x55edc6d69c60 2024-09-15T23:14:56.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.237+0000 7f0a28ff9640 1 -- 172.21.15.123:0/2411494511 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f0a38051020 con 0x55edc6d69c60 2024-09-15T23:14:56.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.237+0000 7f0a52e4e740 10 client.5781 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:56.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.237+0000 7f0a52e4e740 10 client.5781 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:56.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.237+0000 7f0a52e4e740 20 client.5781 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:56.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.237+0000 7f0a52e4e740 1 --2- 172.21.15.123:0/2411494511 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55edc6d78380 0x55edc6d4acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.237+0000 7f0a52e4e740 4 client.5781 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:14:56.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.237+0000 7f0a52e4e740 1 -- 172.21.15.123:0/2411494511 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55edc6c941d0 con 0x55edc6d78380 2024-09-15T23:14:56.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.237+0000 7f0a4de53640 1 --2- 172.21.15.123:0/2411494511 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55edc6d78380 0x55edc6d4acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.237+0000 7f0a4de53640 1 --2- 172.21.15.123:0/2411494511 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55edc6d78380 0x55edc6d4acb0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eea25bd58ff09321 server_cookie=8c332a88b590804f in_seq=0 out_seq=0 2024-09-15T23:14:56.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.237+0000 7f0a28ff9640 10 client.5781 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:56.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.238+0000 7f0a28ff9640 1 -- 172.21.15.123:0/2411494511 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55edc6c941d0 con 0x55edc6d78380 2024-09-15T23:14:56.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.238+0000 7f0a28ff9640 10 client.5781 handle_command_reply: tid=0 2024-09-15T23:14:56.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.238+0000 7f0a52e4e740 1 client.5781 shutdown 2024-09-15T23:14:56.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.238+0000 7f0a52e4e740 1 -- 172.21.15.123:0/2411494511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55edc6d69c60 msgr2=0x55edc6d5ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.238+0000 7f0a52e4e740 1 --2- 172.21.15.123:0/2411494511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55edc6d69c60 0x55edc6d5ee00 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f0a380098c0 tx=0x7f0a38004730 comp rx=0 tx=0).stop 2024-09-15T23:14:56.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.238+0000 7f0a52e4e740 1 -- 172.21.15.123:0/2411494511 shutdown_connections 2024-09-15T23:14:56.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.238+0000 7f0a52e4e740 1 --2- 172.21.15.123:0/2411494511 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55edc6d78380 0x55edc6d4acb0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.238+0000 7f0a52e4e740 1 --2- 172.21.15.123:0/2411494511 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55edc6d613f0 0x55edc6d5f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.238+0000 7f0a52e4e740 1 --2- 172.21.15.123:0/2411494511 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55edc6d69c60 0x55edc6d5ee00 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.238+0000 7f0a28ff9640 0 client.5781 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:56.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.238+0000 7f0a52e4e740 1 --2- 172.21.15.123:0/2411494511 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55edc6d67880 0x55edc6d477d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.238+0000 7f0a52e4e740 1 -- 172.21.15.123:0/2411494511 >> 172.21.15.123:0/2411494511 conn(0x55edc6d67420 msgr2=0x55edc6d67cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:56.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.238+0000 7f0a52e4e740 1 -- 172.21.15.123:0/2411494511 shutdown_connections 2024-09-15T23:14:56.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.238+0000 7f0a52e4e740 1 -- 172.21.15.123:0/2411494511 wait complete. 2024-09-15T23:14:56.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.238+0000 7f0a52e4e740 20 client.5781 trim_cache size 0 max 16384 2024-09-15T23:14:56.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.256+0000 7f0a52e4e740 1 Processor -- start 2024-09-15T23:14:56.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.256+0000 7f0a52e4e740 1 -- start start 2024-09-15T23:14:56.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.256+0000 7f0a52e4e740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55edc6d613f0 0x55edc6d47420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.256+0000 7f0a52e4e740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55edc6d67880 0x55edc6d1f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.256+0000 7f0a52e4e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55edc6d69c60 0x55edc6d8bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.256+0000 7f0a52e4e740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0a481feca0 con 0x55edc6d613f0 2024-09-15T23:14:56.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.256+0000 7f0a52e4e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0a4813d1b0 con 0x55edc6d69c60 2024-09-15T23:14:56.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.256+0000 7f0a52e4e740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0a48141c50 con 0x55edc6d67880 2024-09-15T23:14:56.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.256+0000 7f0a4de53640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55edc6d613f0 0x55edc6d47420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.256+0000 7f0a4de53640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55edc6d613f0 0x55edc6d47420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45178/0 (socket says 172.21.15.123:45178) 2024-09-15T23:14:56.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.256+0000 7f0a4de53640 1 -- 172.21.15.123:0/2957588759 learned_addr learned my addr 172.21.15.123:0/2957588759 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:56.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.257+0000 7f0a4d652640 1 --2- 172.21.15.123:0/2957588759 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55edc6d67880 0x55edc6d1f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.257+0000 7f0a4e654640 1 --2- 172.21.15.123:0/2957588759 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55edc6d69c60 0x55edc6d8bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.257+0000 7f0a4de53640 1 -- 172.21.15.123:0/2957588759 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55edc6d67880 msgr2=0x55edc6d1f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.257+0000 7f0a4de53640 1 --2- 172.21.15.123:0/2957588759 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55edc6d67880 0x55edc6d1f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.257+0000 7f0a4de53640 1 -- 172.21.15.123:0/2957588759 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55edc6d69c60 msgr2=0x55edc6d8bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.257+0000 7f0a4de53640 1 --2- 172.21.15.123:0/2957588759 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55edc6d69c60 0x55edc6d8bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.257+0000 7f0a4de53640 1 -- 172.21.15.123:0/2957588759 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edc69323a0 con 0x55edc6d613f0 2024-09-15T23:14:56.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.257+0000 7f0a4de53640 1 --2- 172.21.15.123:0/2957588759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55edc6d613f0 0x55edc6d47420 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f0a44013000 tx=0x7f0a44016070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9938ed16ebc9b65c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.257+0000 7f0a2affd640 1 -- 172.21.15.123:0/2957588759 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4400dc10 con 0x55edc6d613f0 2024-09-15T23:14:56.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.257+0000 7f0a2affd640 1 -- 172.21.15.123:0/2957588759 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a44034070 con 0x55edc6d613f0 2024-09-15T23:14:56.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.257+0000 7f0a2affd640 1 -- 172.21.15.123:0/2957588759 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4402e480 con 0x55edc6d613f0 2024-09-15T23:14:56.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.257+0000 7f0a52e4e740 1 -- 172.21.15.123:0/2957588759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55edc6d613f0 msgr2=0x55edc6d47420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.257+0000 7f0a52e4e740 1 --2- 172.21.15.123:0/2957588759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55edc6d613f0 0x55edc6d47420 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f0a44013000 tx=0x7f0a44016070 comp rx=0 tx=0).stop 2024-09-15T23:14:56.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.258+0000 7f0a52e4e740 1 -- 172.21.15.123:0/2957588759 shutdown_connections 2024-09-15T23:14:56.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.258+0000 7f0a52e4e740 1 --2- 172.21.15.123:0/2957588759 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55edc6d69c60 0x55edc6d8bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.258+0000 7f0a52e4e740 1 --2- 172.21.15.123:0/2957588759 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55edc6d67880 0x55edc6d1f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.258+0000 7f0a52e4e740 1 --2- 172.21.15.123:0/2957588759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55edc6d613f0 0x55edc6d47420 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.258+0000 7f0a52e4e740 1 -- 172.21.15.123:0/2957588759 >> 172.21.15.123:0/2957588759 conn(0x55edc6d67420 msgr2=0x55edc6d5f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:56.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.258+0000 7f0a52e4e740 1 -- 172.21.15.123:0/2957588759 shutdown_connections 2024-09-15T23:14:56.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.258+0000 7f0a52e4e740 1 -- 172.21.15.123:0/2957588759 wait complete. 2024-09-15T23:14:56.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.258+0000 7f0a52e4e740 1 -- start start 2024-09-15T23:14:56.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.258+0000 7f0a52e4e740 1 Processor -- start 2024-09-15T23:14:56.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.259+0000 7f0a52e4e740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55edc6d613f0 0x55edc6d77000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.259+0000 7f0a52e4e740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55edc6d67880 0x55edc6d4c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.259+0000 7f0a52e4e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55edc6d69c60 0x55edc6deaf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.259+0000 7f0a52e4e740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55edc6d18f80 con 0x55edc6d613f0 2024-09-15T23:14:56.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.259+0000 7f0a52e4e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0a4813cb60 con 0x55edc6d69c60 2024-09-15T23:14:56.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.259+0000 7f0a52e4e740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55edc6d77c80 con 0x55edc6d67880 2024-09-15T23:14:56.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.259+0000 7f0a52e4e740 10 client.0 _ll_register_callbacks cb 0x7f0a38035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:56.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.259+0000 7f0a4de53640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55edc6d613f0 0x55edc6d77000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.259+0000 7f0a4de53640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55edc6d613f0 0x55edc6d77000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45180/0 (socket says 172.21.15.123:45180) 2024-09-15T23:14:56.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.259+0000 7f0a4de53640 1 -- 172.21.15.123:0/1927984010 learned_addr learned my addr 172.21.15.123:0/1927984010 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:56.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.259+0000 7f0a4e654640 1 --2- 172.21.15.123:0/1927984010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55edc6d69c60 0x55edc6deaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.259+0000 7f0a4d652640 1 --2- 172.21.15.123:0/1927984010 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55edc6d67880 0x55edc6d4c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.259+0000 7f0a4de53640 1 -- 172.21.15.123:0/1927984010 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55edc6d67880 msgr2=0x55edc6d4c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.259+0000 7f0a4de53640 1 --2- 172.21.15.123:0/1927984010 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55edc6d67880 0x55edc6d4c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.259+0000 7f0a4de53640 1 -- 172.21.15.123:0/1927984010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55edc6d69c60 msgr2=0x55edc6deaf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.259+0000 7f0a4de53640 1 --2- 172.21.15.123:0/1927984010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55edc6d69c60 0x55edc6deaf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.259+0000 7f0a4de53640 1 -- 172.21.15.123:0/1927984010 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edc6d5eb70 con 0x55edc6d613f0 2024-09-15T23:14:56.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.260+0000 7f0a4de53640 1 --2- 172.21.15.123:0/1927984010 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55edc6d613f0 0x55edc6d77000 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0a440014c0 tx=0x7f0a44012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae8a19e29f2d2332 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.260+0000 7f0a28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:56.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.260+0000 7f0a28ff9640 1 -- 172.21.15.123:0/1927984010 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4400de10 con 0x55edc6d613f0 2024-09-15T23:14:56.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.260+0000 7f0a28ff9640 1 -- 172.21.15.123:0/1927984010 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7f0a4402e480 con 0x55edc6d613f0 2024-09-15T23:14:56.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.260+0000 7f0a52e4e740 1 -- 172.21.15.123:0/1927984010 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a44034070 con 0x55edc6d613f0 2024-09-15T23:14:56.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.260+0000 7f0a28ff9640 1 -- 172.21.15.123:0/1927984010 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f0a44047050 con 0x55edc6d613f0 2024-09-15T23:14:56.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.260+0000 7f0a52e4e740 10 client.5787 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:56.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.260+0000 7f0a52e4e740 1 -- 172.21.15.123:0/1927984010 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55edc6d1e8b0 con 0x55edc6d613f0 2024-09-15T23:14:56.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.260+0000 7f0a28ff9640 1 -- 172.21.15.123:0/1927984010 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a44034070 con 0x55edc6d613f0 2024-09-15T23:14:56.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.260+0000 7f0a28ff9640 1 -- 172.21.15.123:0/1927984010 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f0a4404a020 con 0x55edc6d613f0 2024-09-15T23:14:56.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.260+0000 7f0a52e4e740 10 client.5787 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:56.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.260+0000 7f0a52e4e740 10 client.5787 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:56.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.260+0000 7f0a52e4e740 20 client.5787 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:56.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.260+0000 7f0a52e4e740 1 --2- 172.21.15.123:0/1927984010 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55edc6d67d80 0x55edc6de7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.260+0000 7f0a52e4e740 4 client.5787 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}] 2024-09-15T23:14:56.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.260+0000 7f0a52e4e740 1 -- 172.21.15.123:0/1927984010 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}) -- 0x55edc6c8e520 con 0x55edc6d67d80 2024-09-15T23:14:56.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.260+0000 7f0a4d652640 1 --2- 172.21.15.123:0/1927984010 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55edc6d67d80 0x55edc6de7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.261+0000 7f0a28ff9640 10 client.5787 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:56.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.261+0000 7f0a4d652640 1 --2- 172.21.15.123:0/1927984010 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55edc6d67d80 0x55edc6de7880 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cd2e1291e2e6640 server_cookie=101a0a92faf099a9 in_seq=0 out_seq=0 2024-09-15T23:14:56.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.261+0000 7f0a28ff9640 1 -- 172.21.15.123:0/1927984010 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+26 (crc 0 0 0) 0x55edc6c8e520 con 0x55edc6d67d80 2024-09-15T23:14:56.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.261+0000 7f0a28ff9640 10 client.5787 handle_command_reply: tid=0 2024-09-15T23:14:56.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.261+0000 7f0a52e4e740 1 client.5787 shutdown 2024-09-15T23:14:56.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.261+0000 7f0a52e4e740 1 -- 172.21.15.123:0/1927984010 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55edc6d613f0 msgr2=0x55edc6d77000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.261+0000 7f0a52e4e740 1 --2- 172.21.15.123:0/1927984010 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55edc6d613f0 0x55edc6d77000 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0a440014c0 tx=0x7f0a44012000 comp rx=0 tx=0).stop 2024-09-15T23:14:56.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.261+0000 7f0a52e4e740 1 -- 172.21.15.123:0/1927984010 shutdown_connections 2024-09-15T23:14:56.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.261+0000 7f0a52e4e740 1 --2- 172.21.15.123:0/1927984010 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55edc6d67d80 0x55edc6de7880 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.261+0000 7f0a28ff9640 0 client.5787 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:56.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.261+0000 7f0a52e4e740 1 --2- 172.21.15.123:0/1927984010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55edc6d69c60 0x55edc6deaf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.261+0000 7f0a52e4e740 1 --2- 172.21.15.123:0/1927984010 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55edc6d67880 0x55edc6d4c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.261+0000 7f0a52e4e740 1 --2- 172.21.15.123:0/1927984010 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55edc6d613f0 0x55edc6d77000 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.261+0000 7f0a52e4e740 1 -- 172.21.15.123:0/1927984010 >> 172.21.15.123:0/1927984010 conn(0x55edc6d67420 msgr2=0x55edc6d8bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:56.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.261+0000 7f0a52e4e740 1 -- 172.21.15.123:0/1927984010 shutdown_connections 2024-09-15T23:14:56.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.261+0000 7f0a52e4e740 1 -- 172.21.15.123:0/1927984010 wait complete. 2024-09-15T23:14:56.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.261+0000 7f0a52e4e740 20 client.5787 trim_cache size 0 max 16384 2024-09-15T23:14:56.269 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:14:56.269 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": -2 2024-09-15T23:14:56.269 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:14:56.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.262+0000 7f0a500b7640 1 -- 172.21.15.123:0/3538518115 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0a2c06c2b0 msgr2=0x7f0a2c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.262+0000 7f0a500b7640 1 --2- 172.21.15.123:0/3538518115 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0a2c06c2b0 0x7f0a2c06e770 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0a44000f60 tx=0x7f0a44009040 comp rx=0 tx=0).stop 2024-09-15T23:14:56.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.262+0000 7f0a500b7640 1 -- 172.21.15.123:0/3538518115 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a48158920 msgr2=0x7f0a4813ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.262+0000 7f0a500b7640 1 --2- 172.21.15.123:0/3538518115 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a48158920 0x7f0a4813ffc0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0a4000c7b0 tx=0x7f0a4000cc70 comp rx=0 tx=0).stop 2024-09-15T23:14:56.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.262+0000 7f0a500b7640 1 -- 172.21.15.123:0/3538518115 shutdown_connections 2024-09-15T23:14:56.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.262+0000 7f0a500b7640 1 --2- 172.21.15.123:0/3538518115 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0a2c06c2b0 0x7f0a2c06e770 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.262+0000 7f0a500b7640 1 --2- 172.21.15.123:0/3538518115 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a48158920 0x7f0a4813ffc0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.262+0000 7f0a500b7640 1 --2- 172.21.15.123:0/3538518115 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0a48070f40 0x7f0a4813fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.262+0000 7f0a500b7640 1 --2- 172.21.15.123:0/3538518115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0a4806c320 0x7f0a4813b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.262+0000 7f0a500b7640 1 -- 172.21.15.123:0/3538518115 >> 172.21.15.123:0/3538518115 conn(0x7f0a4806d0f0 msgr2=0x7f0a480b53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:56.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.262+0000 7f0a500b7640 1 -- 172.21.15.123:0/3538518115 shutdown_connections 2024-09-15T23:14:56.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.262+0000 7f0a500b7640 1 -- 172.21.15.123:0/3538518115 wait complete. 2024-09-15T23:14:56.273 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/i/dont/exist' returned '{'return_code': -2}' 2024-09-15T23:14:56.273 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites' 2024-09-15T23:14:56.274 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites 2024-09-15T23:14:56.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.375+0000 7faca244c640 1 Processor -- start 2024-09-15T23:14:56.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.375+0000 7faca244c640 1 -- start start 2024-09-15T23:14:56.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.376+0000 7faca244c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac9c0cd2a0 0x7fac9c15c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.376+0000 7faca244c640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac9c0714b0 con 0x7fac9c0cce30 2024-09-15T23:14:56.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.376+0000 7faca244c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac9c0cd880 con 0x7fac9c0732e0 2024-09-15T23:14:56.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.376+0000 7faca244c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fac9c0cdb60 con 0x7fac9c0cd2a0 2024-09-15T23:14:56.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.376+0000 7fac9b7fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fac9c0cce30 0x7fac9c071c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54450/0 (socket says 172.21.15.123:54450) 2024-09-15T23:14:56.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.376+0000 7fac9b7fe640 1 -- 172.21.15.123:0/2465199 learned_addr learned my addr 172.21.15.123:0/2465199 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:56.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.376+0000 7fac9affd640 1 -- 172.21.15.123:0/2465199 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 120407 0 0) 0x7fac9c0714b0 con 0x7fac9c0cce30 2024-09-15T23:14:56.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.376+0000 7fac9affd640 1 -- 172.21.15.123:0/2465199 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac84003520 con 0x7fac9c0cce30 2024-09-15T23:14:56.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.376+0000 7faca09e9640 1 --2- 172.21.15.123:0/2465199 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac9c0cd2a0 0x7fac9c15c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.377+0000 7fac9affd640 1 -- 172.21.15.123:0/2465199 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2040003763 0 0) 0x7fac84003520 con 0x7fac9c0cce30 2024-09-15T23:14:56.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.377+0000 7fac9affd640 1 -- 172.21.15.123:0/2465199 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac9c0cd2a0 msgr2=0x7fac9c15c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.377+0000 7fac9affd640 1 --2- 172.21.15.123:0/2465199 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac9c0cd2a0 0x7fac9c15c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.377+0000 7fac9affd640 1 -- 172.21.15.123:0/2465199 >> v1:172.21.15.188:6789/0 conn(0x7fac9c0732e0 legacy=0x7fac9c0736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.377+0000 7fac9affd640 1 -- 172.21.15.123:0/2465199 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac9c0cde40 con 0x7fac9c0cce30 2024-09-15T23:14:56.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.377+0000 7fac9affd640 1 -- 172.21.15.123:0/2465199 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fac90001670 con 0x7fac9c0cce30 2024-09-15T23:14:56.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.377+0000 7fac9affd640 1 -- 172.21.15.123:0/2465199 >> v1:172.21.15.123:6789/0 conn(0x7fac9c0cce30 legacy=0x7fac9c071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.377+0000 7fac9affd640 1 --2- 172.21.15.123:0/2465199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac840039e0 0x7fac84003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.377+0000 7fac9affd640 1 --2- 172.21.15.123:0/2465199 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac84004800 0x7fac84004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.377+0000 7fac9affd640 1 --2- 172.21.15.123:0/2465199 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac9c0cd2a0 0x7fac8400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.377+0000 7fac9affd640 1 -- 172.21.15.123:0/2465199 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fac9c0cdb60 con 0x7fac840039e0 2024-09-15T23:14:56.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.377+0000 7fac9affd640 1 -- 172.21.15.123:0/2465199 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fac84005520 con 0x7fac84004800 2024-09-15T23:14:56.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.377+0000 7fac9affd640 1 -- 172.21.15.123:0/2465199 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fac8400bf00 con 0x7fac9c0cd2a0 2024-09-15T23:14:56.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.377+0000 7fac9bfff640 1 --2- 172.21.15.123:0/2465199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac840039e0 0x7fac84003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.377+0000 7faca09e9640 1 --2- 172.21.15.123:0/2465199 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac9c0cd2a0 0x7fac8400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.377+0000 7fac9b7fe640 1 --2- 172.21.15.123:0/2465199 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac84004800 0x7fac84004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.377+0000 7fac9bfff640 1 -- 172.21.15.123:0/2465199 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac9c0cd2a0 msgr2=0x7fac8400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.377+0000 7fac9bfff640 1 --2- 172.21.15.123:0/2465199 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac9c0cd2a0 0x7fac8400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.377+0000 7fac9bfff640 1 -- 172.21.15.123:0/2465199 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac84004800 msgr2=0x7fac84004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.377+0000 7fac9bfff640 1 --2- 172.21.15.123:0/2465199 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac84004800 0x7fac84004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.377+0000 7fac9bfff640 1 -- 172.21.15.123:0/2465199 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac84003520 con 0x7fac840039e0 2024-09-15T23:14:56.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.377+0000 7fac9b7fe640 1 --2- 172.21.15.123:0/2465199 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac84004800 0x7fac84004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:56.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.378+0000 7fac9bfff640 1 --2- 172.21.15.123:0/2465199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac840039e0 0x7fac84003e00 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fac8c001750 tx=0x7fac84005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e52d0a664b74d73 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.378+0000 7fac9affd640 1 -- 172.21.15.123:0/2465199 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac8c001370 con 0x7fac840039e0 2024-09-15T23:14:56.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.378+0000 7fac9affd640 1 -- 172.21.15.123:0/2465199 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac8c0052d0 con 0x7fac840039e0 2024-09-15T23:14:56.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.378+0000 7fac9affd640 1 -- 172.21.15.123:0/2465199 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac8c02abe0 con 0x7fac840039e0 2024-09-15T23:14:56.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.379+0000 7faca244c640 1 -- 172.21.15.123:0/2465199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac840039e0 msgr2=0x7fac84003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.379+0000 7faca244c640 1 --2- 172.21.15.123:0/2465199 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac840039e0 0x7fac84003e00 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fac8c001750 tx=0x7fac84005830 comp rx=0 tx=0).stop 2024-09-15T23:14:56.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.379+0000 7faca09e9640 1 -- 172.21.15.123:0/2465199 reap_dead start 2024-09-15T23:14:56.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.379+0000 7faca244c640 1 -- 172.21.15.123:0/2465199 shutdown_connections 2024-09-15T23:14:56.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.379+0000 7faca244c640 1 -- 172.21.15.123:0/2465199 >> 172.21.15.123:0/2465199 conn(0x7fac9c06d0f0 msgr2=0x7fac9c06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:56.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.379+0000 7faca244c640 1 -- 172.21.15.123:0/2465199 shutdown_connections 2024-09-15T23:14:56.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.379+0000 7faca244c640 1 -- 172.21.15.123:0/2465199 wait complete. 2024-09-15T23:14:56.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.380+0000 7faca244c640 1 Processor -- start 2024-09-15T23:14:56.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.380+0000 7faca244c640 1 -- start start 2024-09-15T23:14:56.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.381+0000 7faca244c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac840039e0 0x7fac9c1f31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.381+0000 7faca244c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac9c0cb780 0x7fac9c159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.381+0000 7faca244c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac9c0cbbe0 0x7fac9c15a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.381+0000 7faca244c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fac9c072500 con 0x7fac9c0cbbe0 2024-09-15T23:14:56.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.381+0000 7faca244c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fac9c072380 con 0x7fac9c0cb780 2024-09-15T23:14:56.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.381+0000 7faca244c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fac9c15c8d0 con 0x7fac840039e0 2024-09-15T23:14:56.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.381+0000 7faca09e9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac9c0cbbe0 0x7fac9c15a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.381+0000 7faca09e9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac9c0cbbe0 0x7fac9c15a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45198/0 (socket says 172.21.15.123:45198) 2024-09-15T23:14:56.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.381+0000 7faca09e9640 1 -- 172.21.15.123:0/3664988513 learned_addr learned my addr 172.21.15.123:0/3664988513 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:56.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.381+0000 7fac9bfff640 1 --2- 172.21.15.123:0/3664988513 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac840039e0 0x7fac9c1f31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.381+0000 7fac9b7fe640 1 --2- 172.21.15.123:0/3664988513 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac9c0cb780 0x7fac9c159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.381+0000 7faca09e9640 1 -- 172.21.15.123:0/3664988513 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac840039e0 msgr2=0x7fac9c1f31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.381+0000 7faca09e9640 1 --2- 172.21.15.123:0/3664988513 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac840039e0 0x7fac9c1f31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.381+0000 7faca09e9640 1 -- 172.21.15.123:0/3664988513 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac9c0cb780 msgr2=0x7fac9c159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.381+0000 7faca09e9640 1 --2- 172.21.15.123:0/3664988513 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac9c0cb780 0x7fac9c159030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.381+0000 7faca09e9640 1 -- 172.21.15.123:0/3664988513 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac9c1f3720 con 0x7fac9c0cbbe0 2024-09-15T23:14:56.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.381+0000 7fac9b7fe640 1 --2- 172.21.15.123:0/3664988513 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac9c0cb780 0x7fac9c159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:56.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.381+0000 7faca09e9640 1 --2- 172.21.15.123:0/3664988513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac9c0cbbe0 0x7fac9c15a930 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fac9c06cdf0 tx=0x7fac94007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.381+0000 7fac98ff9640 1 -- 172.21.15.123:0/3664988513 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac940046a0 con 0x7fac9c0cbbe0 2024-09-15T23:14:56.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.381+0000 7fac98ff9640 1 -- 172.21.15.123:0/3664988513 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac9401a070 con 0x7fac9c0cbbe0 2024-09-15T23:14:56.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.381+0000 7faca244c640 1 -- 172.21.15.123:0/3664988513 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac9c156d70 con 0x7fac9c0cbbe0 2024-09-15T23:14:56.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.381+0000 7fac98ff9640 1 -- 172.21.15.123:0/3664988513 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac94015640 con 0x7fac9c0cbbe0 2024-09-15T23:14:56.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.381+0000 7faca244c640 1 -- 172.21.15.123:0/3664988513 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac9c0b2fd0 con 0x7fac9c0cbbe0 2024-09-15T23:14:56.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.383+0000 7fac98ff9640 1 -- 172.21.15.123:0/3664988513 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fac940157e0 con 0x7fac9c0cbbe0 2024-09-15T23:14:56.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.383+0000 7fac98ff9640 1 --2- 172.21.15.123:0/3664988513 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fac8806c2b0 0x7fac8806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.383+0000 7fac98ff9640 1 -- 172.21.15.123:0/3664988513 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7fac9408b8f0 con 0x7fac9c0cbbe0 2024-09-15T23:14:56.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.384+0000 7fac9bfff640 1 --2- 172.21.15.123:0/3664988513 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fac8806c2b0 0x7fac8806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.384+0000 7faca51e3740 1 Processor -- start 2024-09-15T23:14:56.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.384+0000 7fac9bfff640 1 --2- 172.21.15.123:0/3664988513 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fac8806c2b0 0x7fac8806e770 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fac8c032000 tx=0x7fac8c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.384+0000 7faca51e3740 1 -- start start 2024-09-15T23:14:56.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.385+0000 7faca51e3740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563be91dad0 0x5563be91deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.385+0000 7faca51e3740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563be8d50d0 0x5563be8d2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.385+0000 7faca51e3740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563be8d9070 0x5563be91ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.385+0000 7faca51e3740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5563be836af0 con 0x5563be91dad0 2024-09-15T23:14:56.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.385+0000 7faca51e3740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5563be7de690 con 0x5563be8d50d0 2024-09-15T23:14:56.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.385+0000 7faca51e3740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5563be832ab0 con 0x5563be8d9070 2024-09-15T23:14:56.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.385+0000 7fac9bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563be91dad0 0x5563be91deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.385+0000 7fac9bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563be91dad0 0x5563be91deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45202/0 (socket says 172.21.15.123:45202) 2024-09-15T23:14:56.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.385+0000 7fac9bfff640 1 -- 172.21.15.123:0/1588876458 learned_addr learned my addr 172.21.15.123:0/1588876458 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:56.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.385+0000 7fac9b7fe640 1 --2- 172.21.15.123:0/1588876458 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563be8d50d0 0x5563be8d2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.385+0000 7faca09e9640 1 --2- 172.21.15.123:0/1588876458 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563be8d9070 0x5563be91ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.385+0000 7fac9bfff640 1 -- 172.21.15.123:0/1588876458 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563be8d9070 msgr2=0x5563be91ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.385+0000 7fac9bfff640 1 --2- 172.21.15.123:0/1588876458 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563be8d9070 0x5563be91ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.385+0000 7fac9bfff640 1 -- 172.21.15.123:0/1588876458 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563be8d50d0 msgr2=0x5563be8d2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.385+0000 7fac9bfff640 1 --2- 172.21.15.123:0/1588876458 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563be8d50d0 0x5563be8d2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.385+0000 7fac9bfff640 1 -- 172.21.15.123:0/1588876458 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563be615b00 con 0x5563be91dad0 2024-09-15T23:14:56.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.385+0000 7fac9b7fe640 1 --2- 172.21.15.123:0/1588876458 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563be8d50d0 0x5563be8d2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:56.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.385+0000 7fac9bfff640 1 --2- 172.21.15.123:0/1588876458 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563be91dad0 0x5563be91deb0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fac8c001840 tx=0x7fac8c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6363bcf4448728b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.385+0000 7fac81ffb640 1 -- 172.21.15.123:0/1588876458 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac8c037040 con 0x5563be91dad0 2024-09-15T23:14:56.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.385+0000 7fac81ffb640 1 -- 172.21.15.123:0/1588876458 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac8c005400 con 0x5563be91dad0 2024-09-15T23:14:56.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.385+0000 7fac81ffb640 1 -- 172.21.15.123:0/1588876458 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac8c0067d0 con 0x5563be91dad0 2024-09-15T23:14:56.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.386+0000 7faca51e3740 1 -- 172.21.15.123:0/1588876458 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563be91dad0 msgr2=0x5563be91deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.386+0000 7faca51e3740 1 --2- 172.21.15.123:0/1588876458 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563be91dad0 0x5563be91deb0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fac8c001840 tx=0x7fac8c02c000 comp rx=0 tx=0).stop 2024-09-15T23:14:56.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.386+0000 7faca51e3740 1 -- 172.21.15.123:0/1588876458 shutdown_connections 2024-09-15T23:14:56.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.386+0000 7faca51e3740 1 --2- 172.21.15.123:0/1588876458 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563be8d9070 0x5563be91ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.386+0000 7faca51e3740 1 --2- 172.21.15.123:0/1588876458 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563be8d50d0 0x5563be8d2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.386+0000 7faca51e3740 1 --2- 172.21.15.123:0/1588876458 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563be91dad0 0x5563be91deb0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.386+0000 7faca51e3740 1 -- 172.21.15.123:0/1588876458 >> 172.21.15.123:0/1588876458 conn(0x5563be89a890 msgr2=0x5563be91c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:56.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.386+0000 7faca51e3740 1 -- 172.21.15.123:0/1588876458 shutdown_connections 2024-09-15T23:14:56.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.386+0000 7faca51e3740 1 -- 172.21.15.123:0/1588876458 wait complete. 2024-09-15T23:14:56.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.387+0000 7faca51e3740 1 -- start start 2024-09-15T23:14:56.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.387+0000 7faca51e3740 1 Processor -- start 2024-09-15T23:14:56.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.388+0000 7faca51e3740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563be8d50d0 0x5563be909ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.388+0000 7faca51e3740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563be8d9070 0x5563be8ed350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.388+0000 7faca51e3740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563be91dad0 0x5563be900af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.388+0000 7faca51e3740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5563be7bf8a0 con 0x5563be8d9070 2024-09-15T23:14:56.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.388+0000 7faca51e3740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5563be91e4b0 con 0x5563be91dad0 2024-09-15T23:14:56.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.388+0000 7faca51e3740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5563be90a8f0 con 0x5563be8d50d0 2024-09-15T23:14:56.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.388+0000 7faca51e3740 10 client.0 _ll_register_callbacks cb 0x5563be548ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:56.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.388+0000 7fac9b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563be8d9070 0x5563be8ed350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.388+0000 7fac9b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563be8d9070 0x5563be8ed350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45218/0 (socket says 172.21.15.123:45218) 2024-09-15T23:14:56.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.388+0000 7fac9b7fe640 1 -- 172.21.15.123:0/3263296406 learned_addr learned my addr 172.21.15.123:0/3263296406 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:56.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.388+0000 7fac9bfff640 1 --2- 172.21.15.123:0/3263296406 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563be8d50d0 0x5563be909ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.388+0000 7faca09e9640 1 --2- 172.21.15.123:0/3263296406 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563be91dad0 0x5563be900af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.388+0000 7fac9b7fe640 1 -- 172.21.15.123:0/3263296406 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563be8d50d0 msgr2=0x5563be909ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.388+0000 7fac9b7fe640 1 --2- 172.21.15.123:0/3263296406 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563be8d50d0 0x5563be909ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.388+0000 7fac9b7fe640 1 -- 172.21.15.123:0/3263296406 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563be91dad0 msgr2=0x5563be900af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.388+0000 7fac9b7fe640 1 --2- 172.21.15.123:0/3263296406 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563be91dad0 0x5563be900af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.388+0000 7fac9b7fe640 1 -- 172.21.15.123:0/3263296406 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563be5093f0 con 0x5563be8d9070 2024-09-15T23:14:56.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.388+0000 7faca09e9640 1 --2- 172.21.15.123:0/3263296406 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563be91dad0 0x5563be900af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:56.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.388+0000 7fac9b7fe640 1 --2- 172.21.15.123:0/3263296406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563be8d9070 0x5563be8ed350 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fac90012510 tx=0x7fac900129d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11fb2de7bb195129 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.388+0000 7fac7affd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:56.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.388+0000 7fac7affd640 1 -- 172.21.15.123:0/3263296406 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac900155f0 con 0x5563be8d9070 2024-09-15T23:14:56.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.388+0000 7fac7affd640 1 -- 172.21.15.123:0/3263296406 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7fac90015790 con 0x5563be8d9070 2024-09-15T23:14:56.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.388+0000 7faca51e3740 1 -- 172.21.15.123:0/3263296406 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac8c005400 con 0x5563be8d9070 2024-09-15T23:14:56.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.388+0000 7fac7affd640 1 -- 172.21.15.123:0/3263296406 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fac90023050 con 0x5563be8d9070 2024-09-15T23:14:56.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.388+0000 7faca51e3740 10 client.5799 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:56.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.388+0000 7faca51e3740 1 -- 172.21.15.123:0/3263296406 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x5563be676290 con 0x5563be8d9070 2024-09-15T23:14:56.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.389+0000 7fac7affd640 1 -- 172.21.15.123:0/3263296406 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac8c005400 con 0x5563be8d9070 2024-09-15T23:14:56.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.389+0000 7fac7affd640 1 -- 172.21.15.123:0/3263296406 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7fac90026020 con 0x5563be8d9070 2024-09-15T23:14:56.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.389+0000 7faca51e3740 10 client.5799 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:56.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.389+0000 7faca51e3740 10 client.5799 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:56.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.389+0000 7faca51e3740 20 client.5799 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:56.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.389+0000 7faca51e3740 1 --2- 172.21.15.123:0/3263296406 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5563be901030 0x5563be901df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.389+0000 7faca51e3740 4 client.5799 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:14:56.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.389+0000 7faca51e3740 1 -- 172.21.15.123:0/3263296406 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563be844220 con 0x5563be901030 2024-09-15T23:14:56.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.389+0000 7fac9bfff640 1 --2- 172.21.15.123:0/3263296406 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5563be901030 0x5563be901df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.389+0000 7fac7affd640 10 client.5799 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:56.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.389+0000 7fac9bfff640 1 --2- 172.21.15.123:0/3263296406 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5563be901030 0x5563be901df0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e5fad739d6c9b78 server_cookie=90c933eacfbca2fd in_seq=0 out_seq=0 2024-09-15T23:14:56.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.390+0000 7fac7affd640 1 -- 172.21.15.123:0/3263296406 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5563be844220 con 0x5563be901030 2024-09-15T23:14:56.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.390+0000 7fac7affd640 10 client.5799 handle_command_reply: tid=0 2024-09-15T23:14:56.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.390+0000 7faca51e3740 1 client.5799 shutdown 2024-09-15T23:14:56.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.390+0000 7faca51e3740 1 -- 172.21.15.123:0/3263296406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563be8d9070 msgr2=0x5563be8ed350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.390+0000 7faca51e3740 1 --2- 172.21.15.123:0/3263296406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563be8d9070 0x5563be8ed350 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fac90012510 tx=0x7fac900129d0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.390+0000 7faca51e3740 1 -- 172.21.15.123:0/3263296406 shutdown_connections 2024-09-15T23:14:56.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.390+0000 7faca51e3740 1 --2- 172.21.15.123:0/3263296406 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5563be901030 0x5563be901df0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.390+0000 7faca51e3740 1 --2- 172.21.15.123:0/3263296406 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563be91dad0 0x5563be900af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.390+0000 7faca51e3740 1 --2- 172.21.15.123:0/3263296406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563be8d9070 0x5563be8ed350 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.390+0000 7fac7affd640 0 client.5799 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:56.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.390+0000 7faca51e3740 1 --2- 172.21.15.123:0/3263296406 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563be8d50d0 0x5563be909ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.391+0000 7faca51e3740 1 -- 172.21.15.123:0/3263296406 >> 172.21.15.123:0/3263296406 conn(0x5563be89a890 msgr2=0x5563be919760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:56.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.391+0000 7faca51e3740 1 -- 172.21.15.123:0/3263296406 shutdown_connections 2024-09-15T23:14:56.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.391+0000 7faca51e3740 1 -- 172.21.15.123:0/3263296406 wait complete. 2024-09-15T23:14:56.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.391+0000 7faca51e3740 20 client.5799 trim_cache size 0 max 16384 2024-09-15T23:14:56.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.408+0000 7faca51e3740 1 Processor -- start 2024-09-15T23:14:56.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.408+0000 7faca51e3740 1 -- start start 2024-09-15T23:14:56.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.408+0000 7faca51e3740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563be8d50d0 0x5563be940850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.408+0000 7faca51e3740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563be8d9070 0x5563be92ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.408+0000 7faca51e3740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563be91dad0 0x5563be91deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.408+0000 7faca51e3740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fac9c1fd280 con 0x5563be8d50d0 2024-09-15T23:14:56.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.408+0000 7faca51e3740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fac9c0cfdf0 con 0x5563be91dad0 2024-09-15T23:14:56.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.408+0000 7faca51e3740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fac9c1f6440 con 0x5563be8d9070 2024-09-15T23:14:56.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.409+0000 7fac9bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563be8d50d0 0x5563be940850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.409+0000 7fac9bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563be8d50d0 0x5563be940850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45232/0 (socket says 172.21.15.123:45232) 2024-09-15T23:14:56.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.409+0000 7fac9bfff640 1 -- 172.21.15.123:0/3784539032 learned_addr learned my addr 172.21.15.123:0/3784539032 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:56.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.409+0000 7faca09e9640 1 --2- 172.21.15.123:0/3784539032 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563be91dad0 0x5563be91deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.409+0000 7fac9bfff640 1 -- 172.21.15.123:0/3784539032 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563be8d9070 msgr2=0x5563be92ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.409+0000 7fac9bfff640 1 --2- 172.21.15.123:0/3784539032 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563be8d9070 0x5563be92ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.409+0000 7fac9bfff640 1 -- 172.21.15.123:0/3784539032 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563be91dad0 msgr2=0x5563be91deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.409+0000 7fac9bfff640 1 --2- 172.21.15.123:0/3784539032 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563be91dad0 0x5563be91deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.409+0000 7fac9bfff640 1 -- 172.21.15.123:0/3784539032 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563be4e24b0 con 0x5563be8d50d0 2024-09-15T23:14:56.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.409+0000 7faca09e9640 1 --2- 172.21.15.123:0/3784539032 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563be91dad0 0x5563be91deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:56.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.409+0000 7fac9bfff640 1 --2- 172.21.15.123:0/3784539032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563be8d50d0 0x5563be940850 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fac8c0015c0 tx=0x7fac8c03b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47cc6b6d5c1124c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.409+0000 7fac817fa640 1 -- 172.21.15.123:0/3784539032 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac8c037040 con 0x5563be8d50d0 2024-09-15T23:14:56.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.409+0000 7fac817fa640 1 -- 172.21.15.123:0/3784539032 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac8c0067d0 con 0x5563be8d50d0 2024-09-15T23:14:56.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.409+0000 7fac817fa640 1 -- 172.21.15.123:0/3784539032 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac8c006b80 con 0x5563be8d50d0 2024-09-15T23:14:56.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.410+0000 7faca51e3740 1 -- 172.21.15.123:0/3784539032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563be8d50d0 msgr2=0x5563be940850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.410+0000 7faca51e3740 1 --2- 172.21.15.123:0/3784539032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563be8d50d0 0x5563be940850 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fac8c0015c0 tx=0x7fac8c03b000 comp rx=0 tx=0).stop 2024-09-15T23:14:56.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.410+0000 7faca51e3740 1 -- 172.21.15.123:0/3784539032 shutdown_connections 2024-09-15T23:14:56.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.410+0000 7faca51e3740 1 --2- 172.21.15.123:0/3784539032 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563be91dad0 0x5563be91deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.410+0000 7faca51e3740 1 --2- 172.21.15.123:0/3784539032 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563be8d9070 0x5563be92ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.410+0000 7faca51e3740 1 --2- 172.21.15.123:0/3784539032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563be8d50d0 0x5563be940850 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.410+0000 7faca51e3740 1 -- 172.21.15.123:0/3784539032 >> 172.21.15.123:0/3784539032 conn(0x5563be89a890 msgr2=0x5563be909d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:56.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.410+0000 7faca51e3740 1 -- 172.21.15.123:0/3784539032 shutdown_connections 2024-09-15T23:14:56.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.410+0000 7faca51e3740 1 -- 172.21.15.123:0/3784539032 wait complete. 2024-09-15T23:14:56.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.410+0000 7faca51e3740 1 -- start start 2024-09-15T23:14:56.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.410+0000 7faca51e3740 1 Processor -- start 2024-09-15T23:14:56.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.411+0000 7faca51e3740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563be8d50d0 0x5563be931650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.411+0000 7faca51e3740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563be8d9070 0x5563be8d26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.411+0000 7faca51e3740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563be91dad0 0x5563be9182a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.411+0000 7faca51e3740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5563be92f380 con 0x5563be91dad0 2024-09-15T23:14:56.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.411+0000 7faca51e3740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fac9c0cf780 con 0x5563be8d9070 2024-09-15T23:14:56.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.411+0000 7faca51e3740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5563be8ef800 con 0x5563be8d50d0 2024-09-15T23:14:56.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.411+0000 7faca51e3740 10 client.0 _ll_register_callbacks cb 0x7fac90001c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:56.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.411+0000 7faca09e9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563be91dad0 0x5563be9182a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.411+0000 7faca09e9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563be91dad0 0x5563be9182a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45246/0 (socket says 172.21.15.123:45246) 2024-09-15T23:14:56.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.411+0000 7faca09e9640 1 -- 172.21.15.123:0/788605815 learned_addr learned my addr 172.21.15.123:0/788605815 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:56.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.412+0000 7faca09e9640 1 -- 172.21.15.123:0/788605815 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563be8d50d0 msgr2=0x5563be931650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.412+0000 7faca09e9640 1 --2- 172.21.15.123:0/788605815 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563be8d50d0 0x5563be931650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.412+0000 7faca09e9640 1 -- 172.21.15.123:0/788605815 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563be8d9070 msgr2=0x5563be8d26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.412+0000 7faca09e9640 1 --2- 172.21.15.123:0/788605815 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563be8d9070 0x5563be8d26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.412+0000 7faca09e9640 1 -- 172.21.15.123:0/788605815 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563be8d37e0 con 0x5563be91dad0 2024-09-15T23:14:56.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.412+0000 7faca09e9640 1 --2- 172.21.15.123:0/788605815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563be91dad0 0x5563be9182a0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fac94059860 tx=0x7fac94004900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c00bf0afa23c3a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.412+0000 7fac7affd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:56.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.412+0000 7fac7affd640 1 -- 172.21.15.123:0/788605815 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac9405dc80 con 0x5563be91dad0 2024-09-15T23:14:56.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.412+0000 7fac7affd640 1 -- 172.21.15.123:0/788605815 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7fac94055f40 con 0x5563be91dad0 2024-09-15T23:14:56.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.412+0000 7faca51e3740 1 -- 172.21.15.123:0/788605815 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac8c0067d0 con 0x5563be91dad0 2024-09-15T23:14:56.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.412+0000 7fac7affd640 1 -- 172.21.15.123:0/788605815 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fac940624b0 con 0x5563be91dad0 2024-09-15T23:14:56.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.412+0000 7faca51e3740 10 client.5805 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:56.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.412+0000 7faca51e3740 1 -- 172.21.15.123:0/788605815 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x5563be931e70 con 0x5563be91dad0 2024-09-15T23:14:56.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.412+0000 7fac7affd640 1 -- 172.21.15.123:0/788605815 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac8c0067d0 con 0x5563be91dad0 2024-09-15T23:14:56.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.412+0000 7fac7affd640 1 -- 172.21.15.123:0/788605815 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7fac94062020 con 0x5563be91dad0 2024-09-15T23:14:56.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.412+0000 7faca51e3740 10 client.5805 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:56.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.412+0000 7faca51e3740 10 client.5805 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:56.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.412+0000 7faca51e3740 20 client.5805 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:56.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.412+0000 7faca51e3740 1 --2- 172.21.15.123:0/788605815 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5563be8d2be0 0x5563be99dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.412+0000 7faca51e3740 4 client.5805 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2024-09-15T23:14:56.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.412+0000 7faca51e3740 1 -- 172.21.15.123:0/788605815 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}) -- 0x5563be83e570 con 0x5563be8d2be0 2024-09-15T23:14:56.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.412+0000 7fac9bfff640 1 --2- 172.21.15.123:0/788605815 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5563be8d2be0 0x5563be99dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.413+0000 7fac7affd640 10 client.5805 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:56.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.413+0000 7fac9bfff640 1 --2- 172.21.15.123:0/788605815 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5563be8d2be0 0x5563be99dbd0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d70efcd9d5bc121a server_cookie=26556d494b9e9cb8 in_seq=0 out_seq=0 2024-09-15T23:14:56.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.413+0000 7fac7affd640 1 -- 172.21.15.123:0/788605815 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5563be83e570 con 0x5563be8d2be0 2024-09-15T23:14:56.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.413+0000 7fac7affd640 10 client.5805 handle_command_reply: tid=0 2024-09-15T23:14:56.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.413+0000 7faca51e3740 1 client.5805 shutdown 2024-09-15T23:14:56.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.414+0000 7faca51e3740 1 -- 172.21.15.123:0/788605815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563be91dad0 msgr2=0x5563be9182a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.414+0000 7faca51e3740 1 --2- 172.21.15.123:0/788605815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563be91dad0 0x5563be9182a0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fac94059860 tx=0x7fac94004900 comp rx=0 tx=0).stop 2024-09-15T23:14:56.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.414+0000 7faca51e3740 1 -- 172.21.15.123:0/788605815 shutdown_connections 2024-09-15T23:14:56.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.414+0000 7faca51e3740 1 --2- 172.21.15.123:0/788605815 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5563be8d2be0 0x5563be99dbd0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.414+0000 7faca51e3740 1 --2- 172.21.15.123:0/788605815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563be91dad0 0x5563be9182a0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.414+0000 7faca51e3740 1 --2- 172.21.15.123:0/788605815 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563be8d9070 0x5563be8d26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.414+0000 7fac7affd640 0 client.5805 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:56.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.414+0000 7faca51e3740 1 --2- 172.21.15.123:0/788605815 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563be8d50d0 0x5563be931650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.414+0000 7faca51e3740 1 -- 172.21.15.123:0/788605815 >> 172.21.15.123:0/788605815 conn(0x5563be89a890 msgr2=0x5563be909d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:56.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.414+0000 7faca51e3740 1 -- 172.21.15.123:0/788605815 shutdown_connections 2024-09-15T23:14:56.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.414+0000 7faca51e3740 1 -- 172.21.15.123:0/788605815 wait complete. 2024-09-15T23:14:56.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.414+0000 7faca51e3740 20 client.5805 trim_cache size 0 max 16384 2024-09-15T23:14:56.421 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:14:56.421 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0, 2024-09-15T23:14:56.421 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_tag": "cfd0d925-de8b-4377-aa2a-0082734cf983", 2024-09-15T23:14:56.421 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": "asynchronous" 2024-09-15T23:14:56.421 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:14:56.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.414+0000 7faca244c640 1 -- 172.21.15.123:0/3664988513 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fac8806c2b0 msgr2=0x7fac8806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.414+0000 7faca244c640 1 --2- 172.21.15.123:0/3664988513 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fac8806c2b0 0x7fac8806e770 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fac8c032000 tx=0x7fac8c02e000 comp rx=0 tx=0).stop 2024-09-15T23:14:56.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.414+0000 7faca244c640 1 -- 172.21.15.123:0/3664988513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac9c0cbbe0 msgr2=0x7fac9c15a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.414+0000 7faca244c640 1 --2- 172.21.15.123:0/3664988513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac9c0cbbe0 0x7fac9c15a930 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fac9c06cdf0 tx=0x7fac94007700 comp rx=0 tx=0).stop 2024-09-15T23:14:56.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.414+0000 7faca244c640 1 -- 172.21.15.123:0/3664988513 shutdown_connections 2024-09-15T23:14:56.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.414+0000 7faca244c640 1 --2- 172.21.15.123:0/3664988513 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fac8806c2b0 0x7fac8806e770 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.414+0000 7faca244c640 1 --2- 172.21.15.123:0/3664988513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac9c0cbbe0 0x7fac9c15a930 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.414+0000 7faca244c640 1 --2- 172.21.15.123:0/3664988513 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac9c0cb780 0x7fac9c159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.414+0000 7faca244c640 1 --2- 172.21.15.123:0/3664988513 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac840039e0 0x7fac9c1f31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.414+0000 7faca244c640 1 -- 172.21.15.123:0/3664988513 >> 172.21.15.123:0/3664988513 conn(0x7fac9c06d0f0 msgr2=0x7fac9c06c040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:56.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.415+0000 7faca244c640 1 -- 172.21.15.123:0/3664988513 shutdown_connections 2024-09-15T23:14:56.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.415+0000 7faca244c640 1 -- 172.21.15.123:0/3664988513 wait complete. 2024-09-15T23:14:56.426 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites' returned '{'return_code': 0, 'scrub_tag': 'cfd0d925-de8b-4377-aa2a-0082734cf983', 'mode': 'asynchronous'}' 2024-09-15T23:14:56.426 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2024-09-15T23:14:56.427 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-09-15T23:14:56.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.528+0000 7f7c5ef4b640 1 Processor -- start 2024-09-15T23:14:56.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.528+0000 7f7c5ef4b640 1 -- start start 2024-09-15T23:14:56.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.529+0000 7f7c5ef4b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7c5815e990 0x7f7c5815ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.529+0000 7f7c5ef4b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7c58162a00 0x7f7c58162e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.529+0000 7f7c5ef4b640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c5815f2b0 con 0x7f7c580b5520 2024-09-15T23:14:56.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.529+0000 7f7c5ef4b640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f7c5815f550 con 0x7f7c5815e990 2024-09-15T23:14:56.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.529+0000 7f7c5ef4b640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f7c5815f830 con 0x7f7c58162a00 2024-09-15T23:14:56.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.529+0000 7f7c5cce7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7c5815e990 0x7f7c5815ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.529+0000 7f7c57fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7c580b5520 0x7f7c5806cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54452/0 (socket says 172.21.15.123:54452) 2024-09-15T23:14:56.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.529+0000 7f7c57fff640 1 -- 172.21.15.123:0/2218127991 learned_addr learned my addr 172.21.15.123:0/2218127991 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:56.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.529+0000 7f7c5d4e8640 1 --2- 172.21.15.123:0/2218127991 >> v2:172.21.15.188:3300/0 conn(0x7f7c58162a00 0x7f7c58162e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.529+0000 7f7c5cce7640 1 -- 172.21.15.123:0/2218127991 >> v2:172.21.15.188:3300/0 conn(0x7f7c58162a00 msgr2=0x7f7c58162e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.529+0000 7f7c5cce7640 1 --2- 172.21.15.123:0/2218127991 >> v2:172.21.15.188:3300/0 conn(0x7f7c58162a00 0x7f7c58162e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.529+0000 7f7c5cce7640 1 -- 172.21.15.123:0/2218127991 >> v1:172.21.15.123:6789/0 conn(0x7f7c580b5520 legacy=0x7f7c5806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.529+0000 7f7c5cce7640 1 -- 172.21.15.123:0/2218127991 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c5815fb10 con 0x7f7c5815e990 2024-09-15T23:14:56.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.529+0000 7f7c577fe640 1 -- 172.21.15.123:0/2218127991 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2861215253 0 0) 0x7f7c5815f2b0 con 0x7f7c580b5520 2024-09-15T23:14:56.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.529+0000 7f7c5d4e8640 1 --2- 172.21.15.123:0/2218127991 >> v2:172.21.15.188:3300/0 conn(0x7f7c58162a00 0x7f7c58162e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:56.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.530+0000 7f7c5cce7640 1 --2- 172.21.15.123:0/2218127991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c5815e990 0x7f7c5815ed70 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f7c58072cd0 tx=0x7f7c4802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b274fbdd72b5eac5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.530+0000 7f7c577fe640 1 -- 172.21.15.123:0/2218127991 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c48037070 con 0x7f7c5815e990 2024-09-15T23:14:56.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.530+0000 7f7c577fe640 1 -- 172.21.15.123:0/2218127991 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c48032440 con 0x7f7c5815e990 2024-09-15T23:14:56.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.530+0000 7f7c577fe640 1 -- 172.21.15.123:0/2218127991 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c48032810 con 0x7f7c5815e990 2024-09-15T23:14:56.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.531+0000 7f7c5ef4b640 1 -- 172.21.15.123:0/2218127991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c5815e990 msgr2=0x7f7c5815ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.531+0000 7f7c5ef4b640 1 --2- 172.21.15.123:0/2218127991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c5815e990 0x7f7c5815ed70 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f7c58072cd0 tx=0x7f7c4802a1a0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.531+0000 7f7c5ef4b640 1 -- 172.21.15.123:0/2218127991 shutdown_connections 2024-09-15T23:14:56.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.531+0000 7f7c5ef4b640 1 --2- 172.21.15.123:0/2218127991 >> v2:172.21.15.188:3300/0 conn(0x7f7c58162a00 0x7f7c58162e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.531+0000 7f7c5ef4b640 1 --2- 172.21.15.123:0/2218127991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c5815e990 0x7f7c5815ed70 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.531+0000 7f7c5ef4b640 1 -- 172.21.15.123:0/2218127991 >> 172.21.15.123:0/2218127991 conn(0x7f7c580d25d0 msgr2=0x7f7c580d29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:56.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.531+0000 7f7c5ef4b640 1 -- 172.21.15.123:0/2218127991 shutdown_connections 2024-09-15T23:14:56.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.531+0000 7f7c5ef4b640 1 -- 172.21.15.123:0/2218127991 wait complete. 2024-09-15T23:14:56.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.532+0000 7f7c5ef4b640 1 Processor -- start 2024-09-15T23:14:56.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.532+0000 7f7c5ef4b640 1 -- start start 2024-09-15T23:14:56.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.533+0000 7f7c5ef4b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7c580b5520 0x7f7c580cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.533+0000 7f7c5ef4b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7c5815e990 0x7f7c5814ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.533+0000 7f7c5ef4b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c58162a00 0x7f7c58158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.533+0000 7f7c5ef4b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7c5806d430 con 0x7f7c58162a00 2024-09-15T23:14:56.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.533+0000 7f7c5ef4b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7c580b6ff0 con 0x7f7c5815e990 2024-09-15T23:14:56.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.533+0000 7f7c5ef4b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7c580d03f0 con 0x7f7c580b5520 2024-09-15T23:14:56.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.533+0000 7f7c5d4e8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c58162a00 0x7f7c58158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.533+0000 7f7c5d4e8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c58162a00 0x7f7c58158b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45270/0 (socket says 172.21.15.123:45270) 2024-09-15T23:14:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.533+0000 7f7c5d4e8640 1 -- 172.21.15.123:0/43249264 learned_addr learned my addr 172.21.15.123:0/43249264 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.533+0000 7f7c5cce7640 1 --2- 172.21.15.123:0/43249264 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7c580b5520 0x7f7c580cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.533+0000 7f7c57fff640 1 --2- 172.21.15.123:0/43249264 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7c5815e990 0x7f7c5814ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.533+0000 7f7c5d4e8640 1 -- 172.21.15.123:0/43249264 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7c580b5520 msgr2=0x7f7c580cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.533+0000 7f7c5d4e8640 1 --2- 172.21.15.123:0/43249264 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7c580b5520 0x7f7c580cfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.533+0000 7f7c5d4e8640 1 -- 172.21.15.123:0/43249264 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7c5815e990 msgr2=0x7f7c5814ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.533+0000 7f7c5d4e8640 1 --2- 172.21.15.123:0/43249264 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7c5815e990 0x7f7c5814ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.533+0000 7f7c5d4e8640 1 -- 172.21.15.123:0/43249264 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c580cf0f0 con 0x7f7c58162a00 2024-09-15T23:14:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.533+0000 7f7c57fff640 1 --2- 172.21.15.123:0/43249264 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7c5815e990 0x7f7c5814ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.533+0000 7f7c5d4e8640 1 --2- 172.21.15.123:0/43249264 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c58162a00 0x7f7c58158b00 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f7c5000cd50 tx=0x7f7c5000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.534+0000 7f7c557fa640 1 -- 172.21.15.123:0/43249264 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5000f680 con 0x7f7c58162a00 2024-09-15T23:14:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.534+0000 7f7c557fa640 1 -- 172.21.15.123:0/43249264 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c5000f840 con 0x7f7c58162a00 2024-09-15T23:14:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.534+0000 7f7c5ef4b640 1 -- 172.21.15.123:0/43249264 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c580cf3d0 con 0x7f7c58162a00 2024-09-15T23:14:56.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.534+0000 7f7c557fa640 1 -- 172.21.15.123:0/43249264 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5000fc30 con 0x7f7c58162a00 2024-09-15T23:14:56.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.534+0000 7f7c5ef4b640 1 -- 172.21.15.123:0/43249264 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c580cf990 con 0x7f7c58162a00 2024-09-15T23:14:56.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.535+0000 7f7c557fa640 1 -- 172.21.15.123:0/43249264 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7c500213f0 con 0x7f7c58162a00 2024-09-15T23:14:56.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.536+0000 7f7c557fa640 1 --2- 172.21.15.123:0/43249264 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7c4406c2e0 0x7f7c4406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.536+0000 7f7c557fa640 1 -- 172.21.15.123:0/43249264 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7f7c5008c210 con 0x7f7c58162a00 2024-09-15T23:14:56.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.536+0000 7f7c5cce7640 1 --2- 172.21.15.123:0/43249264 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7c4406c2e0 0x7f7c4406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.536+0000 7f7c5cce7640 1 --2- 172.21.15.123:0/43249264 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7c4406c2e0 0x7f7c4406e7a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7c48034000 tx=0x7f7c4802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.537+0000 7f7c61dc0740 1 Processor -- start 2024-09-15T23:14:56.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.537+0000 7f7c61dc0740 1 -- start start 2024-09-15T23:14:56.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.537+0000 7f7c61dc0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56218e802a40 0x56218e8481e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.537+0000 7f7c61dc0740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56218e800200 0x56218e802e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.537+0000 7f7c61dc0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56218e8041d0 0x56218e7fd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.537+0000 7f7c61dc0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56218e766c60 con 0x56218e8041d0 2024-09-15T23:14:56.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.537+0000 7f7c61dc0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56218e70ea50 con 0x56218e802a40 2024-09-15T23:14:56.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.537+0000 7f7c61dc0740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x56218e762c20 con 0x56218e800200 2024-09-15T23:14:56.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.537+0000 7f7c5d4e8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56218e8041d0 0x56218e7fd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.537+0000 7f7c5d4e8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56218e8041d0 0x56218e7fd030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45286/0 (socket says 172.21.15.123:45286) 2024-09-15T23:14:56.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.537+0000 7f7c5d4e8640 1 -- 172.21.15.123:0/2254811547 learned_addr learned my addr 172.21.15.123:0/2254811547 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:56.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.538+0000 7f7c5cce7640 1 --2- 172.21.15.123:0/2254811547 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56218e802a40 0x56218e8481e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.538+0000 7f7c57fff640 1 --2- 172.21.15.123:0/2254811547 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56218e800200 0x56218e802e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.538+0000 7f7c5d4e8640 1 -- 172.21.15.123:0/2254811547 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56218e800200 msgr2=0x56218e802e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.538+0000 7f7c5d4e8640 1 --2- 172.21.15.123:0/2254811547 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56218e800200 0x56218e802e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.538+0000 7f7c5d4e8640 1 -- 172.21.15.123:0/2254811547 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56218e802a40 msgr2=0x56218e8481e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.538+0000 7f7c5d4e8640 1 --2- 172.21.15.123:0/2254811547 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56218e802a40 0x56218e8481e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.538+0000 7f7c5d4e8640 1 -- 172.21.15.123:0/2254811547 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56218e545f00 con 0x56218e8041d0 2024-09-15T23:14:56.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.538+0000 7f7c57fff640 1 --2- 172.21.15.123:0/2254811547 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56218e800200 0x56218e802e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:56.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.538+0000 7f7c5d4e8640 1 --2- 172.21.15.123:0/2254811547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56218e8041d0 0x56218e7fd030 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f7c5008a5f0 tx=0x7f7c50059e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be1b6e107d431276 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.538+0000 7f7c3e7fc640 1 -- 172.21.15.123:0/2254811547 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c50072020 con 0x56218e8041d0 2024-09-15T23:14:56.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.538+0000 7f7c3e7fc640 1 -- 172.21.15.123:0/2254811547 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c50062dd0 con 0x56218e8041d0 2024-09-15T23:14:56.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.538+0000 7f7c3e7fc640 1 -- 172.21.15.123:0/2254811547 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c50058290 con 0x56218e8041d0 2024-09-15T23:14:56.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.539+0000 7f7c61dc0740 1 -- 172.21.15.123:0/2254811547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56218e8041d0 msgr2=0x56218e7fd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.539+0000 7f7c61dc0740 1 --2- 172.21.15.123:0/2254811547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56218e8041d0 0x56218e7fd030 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f7c5008a5f0 tx=0x7f7c50059e60 comp rx=0 tx=0).stop 2024-09-15T23:14:56.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.539+0000 7f7c61dc0740 1 -- 172.21.15.123:0/2254811547 shutdown_connections 2024-09-15T23:14:56.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.539+0000 7f7c61dc0740 1 --2- 172.21.15.123:0/2254811547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56218e8041d0 0x56218e7fd030 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.539+0000 7f7c61dc0740 1 --2- 172.21.15.123:0/2254811547 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56218e800200 0x56218e802e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.539+0000 7f7c61dc0740 1 --2- 172.21.15.123:0/2254811547 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56218e802a40 0x56218e8481e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.539+0000 7f7c61dc0740 1 -- 172.21.15.123:0/2254811547 >> 172.21.15.123:0/2254811547 conn(0x56218e7ff200 msgr2=0x56218e8476b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:56.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.539+0000 7f7c61dc0740 1 -- 172.21.15.123:0/2254811547 shutdown_connections 2024-09-15T23:14:56.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.539+0000 7f7c61dc0740 1 -- 172.21.15.123:0/2254811547 wait complete. 2024-09-15T23:14:56.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.539+0000 7f7c61dc0740 1 -- start start 2024-09-15T23:14:56.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.539+0000 7f7c61dc0740 1 Processor -- start 2024-09-15T23:14:56.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.540+0000 7f7c61dc0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56218e802a40 0x56218e821680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.540+0000 7f7c61dc0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56218e8041d0 0x56218e823670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.540+0000 7f7c61dc0740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56218e823bb0 0x56218e8012b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.540+0000 7f7c61dc0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56218e7fe6a0 con 0x56218e8041d0 2024-09-15T23:14:56.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.540+0000 7f7c61dc0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56218e70ccb0 con 0x56218e802a40 2024-09-15T23:14:56.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.540+0000 7f7c61dc0740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x56218e848a10 con 0x56218e823bb0 2024-09-15T23:14:56.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.540+0000 7f7c61dc0740 10 client.0 _ll_register_callbacks cb 0x56218e4792e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:56.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.540+0000 7f7c57fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56218e8041d0 0x56218e823670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.540+0000 7f7c57fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56218e8041d0 0x56218e823670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45302/0 (socket says 172.21.15.123:45302) 2024-09-15T23:14:56.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.540+0000 7f7c57fff640 1 -- 172.21.15.123:0/1893096602 learned_addr learned my addr 172.21.15.123:0/1893096602 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:56.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.540+0000 7f7c5cce7640 1 --2- 172.21.15.123:0/1893096602 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56218e802a40 0x56218e821680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.540+0000 7f7c5d4e8640 1 --2- 172.21.15.123:0/1893096602 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56218e823bb0 0x56218e8012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.541+0000 7f7c57fff640 1 -- 172.21.15.123:0/1893096602 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56218e823bb0 msgr2=0x56218e8012b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.541+0000 7f7c57fff640 1 --2- 172.21.15.123:0/1893096602 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56218e823bb0 0x56218e8012b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.541+0000 7f7c57fff640 1 -- 172.21.15.123:0/1893096602 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56218e802a40 msgr2=0x56218e821680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.541+0000 7f7c57fff640 1 --2- 172.21.15.123:0/1893096602 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56218e802a40 0x56218e821680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.541+0000 7f7c57fff640 1 -- 172.21.15.123:0/1893096602 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56218e4397f0 con 0x56218e8041d0 2024-09-15T23:14:56.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.541+0000 7f7c57fff640 1 --2- 172.21.15.123:0/1893096602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56218e8041d0 0x56218e823670 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c0073b0 tx=0x7f7c4c007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3e18a5769009017 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.541+0000 7f7c377fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:56.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.541+0000 7f7c377fe640 1 -- 172.21.15.123:0/1893096602 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c001c50 con 0x56218e8041d0 2024-09-15T23:14:56.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.541+0000 7f7c377fe640 1 -- 172.21.15.123:0/1893096602 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7f7c4c014400 con 0x56218e8041d0 2024-09-15T23:14:56.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.541+0000 7f7c61dc0740 1 -- 172.21.15.123:0/1893096602 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c50062dd0 con 0x56218e8041d0 2024-09-15T23:14:56.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.541+0000 7f7c377fe640 1 -- 172.21.15.123:0/1893096602 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7c4c021050 con 0x56218e8041d0 2024-09-15T23:14:56.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.541+0000 7f7c61dc0740 10 client.5820 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:56.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.541+0000 7f7c61dc0740 1 -- 172.21.15.123:0/1893096602 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x56218e5a6690 con 0x56218e8041d0 2024-09-15T23:14:56.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.541+0000 7f7c377fe640 1 -- 172.21.15.123:0/1893096602 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c50062dd0 con 0x56218e8041d0 2024-09-15T23:14:56.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.541+0000 7f7c377fe640 1 -- 172.21.15.123:0/1893096602 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f7c4c024020 con 0x56218e8041d0 2024-09-15T23:14:56.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.541+0000 7f7c61dc0740 10 client.5820 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:56.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.541+0000 7f7c61dc0740 10 client.5820 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:56.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.541+0000 7f7c61dc0740 20 client.5820 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:56.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.541+0000 7f7c61dc0740 1 --2- 172.21.15.123:0/1893096602 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x56218e7fc400 0x56218e7fc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.541+0000 7f7c61dc0740 4 client.5820 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:14:56.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.541+0000 7f7c61dc0740 1 -- 172.21.15.123:0/1893096602 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56218e774390 con 0x56218e7fc400 2024-09-15T23:14:56.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.542+0000 7f7c5cce7640 1 --2- 172.21.15.123:0/1893096602 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x56218e7fc400 0x56218e7fc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.542+0000 7f7c5cce7640 1 --2- 172.21.15.123:0/1893096602 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x56218e7fc400 0x56218e7fc800 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=372a264e83c9fa13 server_cookie=e0b46f90c942e9e5 in_seq=0 out_seq=0 2024-09-15T23:14:56.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.542+0000 7f7c377fe640 10 client.5820 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:56.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.543+0000 7f7c377fe640 1 -- 172.21.15.123:0/1893096602 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56218e774390 con 0x56218e7fc400 2024-09-15T23:14:56.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.543+0000 7f7c377fe640 10 client.5820 handle_command_reply: tid=0 2024-09-15T23:14:56.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.543+0000 7f7c61dc0740 1 client.5820 shutdown 2024-09-15T23:14:56.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.543+0000 7f7c61dc0740 1 -- 172.21.15.123:0/1893096602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56218e8041d0 msgr2=0x56218e823670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.543+0000 7f7c61dc0740 1 --2- 172.21.15.123:0/1893096602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56218e8041d0 0x56218e823670 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c0073b0 tx=0x7f7c4c007870 comp rx=0 tx=0).stop 2024-09-15T23:14:56.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.543+0000 7f7c61dc0740 1 -- 172.21.15.123:0/1893096602 shutdown_connections 2024-09-15T23:14:56.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.543+0000 7f7c61dc0740 1 --2- 172.21.15.123:0/1893096602 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x56218e7fc400 0x56218e7fc800 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.543+0000 7f7c61dc0740 1 --2- 172.21.15.123:0/1893096602 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56218e823bb0 0x56218e8012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.543+0000 7f7c377fe640 0 client.5820 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:56.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.543+0000 7f7c61dc0740 1 --2- 172.21.15.123:0/1893096602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56218e8041d0 0x56218e823670 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.543+0000 7f7c61dc0740 1 --2- 172.21.15.123:0/1893096602 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56218e802a40 0x56218e821680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.543+0000 7f7c61dc0740 1 -- 172.21.15.123:0/1893096602 >> 172.21.15.123:0/1893096602 conn(0x56218e800200 msgr2=0x56218e846540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:56.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.543+0000 7f7c61dc0740 1 -- 172.21.15.123:0/1893096602 shutdown_connections 2024-09-15T23:14:56.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.543+0000 7f7c61dc0740 1 -- 172.21.15.123:0/1893096602 wait complete. 2024-09-15T23:14:56.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.543+0000 7f7c61dc0740 20 client.5820 trim_cache size 0 max 16384 2024-09-15T23:14:56.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.560+0000 7f7c61dc0740 1 Processor -- start 2024-09-15T23:14:56.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.560+0000 7f7c61dc0740 1 -- start start 2024-09-15T23:14:56.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.561+0000 7f7c61dc0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56218e7fc400 0x56218e856f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.561+0000 7f7c61dc0740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56218e802a40 0x56218e84abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.561+0000 7f7c61dc0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56218e8041d0 0x56218e84b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.561+0000 7f7c61dc0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7c58200ba0 con 0x56218e7fc400 2024-09-15T23:14:56.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.561+0000 7f7c61dc0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7c580cd700 con 0x56218e8041d0 2024-09-15T23:14:56.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.561+0000 7f7c61dc0740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7c580cca60 con 0x56218e802a40 2024-09-15T23:14:56.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.561+0000 7f7c5cce7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56218e7fc400 0x56218e856f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.561+0000 7f7c5cce7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56218e7fc400 0x56218e856f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45314/0 (socket says 172.21.15.123:45314) 2024-09-15T23:14:56.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.561+0000 7f7c5cce7640 1 -- 172.21.15.123:0/3412081020 learned_addr learned my addr 172.21.15.123:0/3412081020 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:56.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.561+0000 7f7c5d4e8640 1 --2- 172.21.15.123:0/3412081020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56218e8041d0 0x56218e84b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.561+0000 7f7c5cce7640 1 -- 172.21.15.123:0/3412081020 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56218e802a40 msgr2=0x56218e84abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.561+0000 7f7c5cce7640 1 --2- 172.21.15.123:0/3412081020 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56218e802a40 0x56218e84abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.561+0000 7f7c5cce7640 1 -- 172.21.15.123:0/3412081020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56218e8041d0 msgr2=0x56218e84b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.561+0000 7f7c5cce7640 1 --2- 172.21.15.123:0/3412081020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56218e8041d0 0x56218e84b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.561+0000 7f7c5cce7640 1 -- 172.21.15.123:0/3412081020 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56218e4128b0 con 0x56218e7fc400 2024-09-15T23:14:56.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.561+0000 7f7c5d4e8640 1 --2- 172.21.15.123:0/3412081020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56218e8041d0 0x56218e84b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:56.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.561+0000 7f7c5cce7640 1 --2- 172.21.15.123:0/3412081020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56218e7fc400 0x56218e856f50 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f7c4802a1e0 tx=0x7f7c48008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16bb55d4ef13278a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.561+0000 7f7c3dffb640 1 -- 172.21.15.123:0/3412081020 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c48055030 con 0x56218e7fc400 2024-09-15T23:14:56.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.561+0000 7f7c3dffb640 1 -- 172.21.15.123:0/3412081020 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c480512c0 con 0x56218e7fc400 2024-09-15T23:14:56.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.561+0000 7f7c3dffb640 1 -- 172.21.15.123:0/3412081020 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c48037040 con 0x56218e7fc400 2024-09-15T23:14:56.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.562+0000 7f7c61dc0740 1 -- 172.21.15.123:0/3412081020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56218e7fc400 msgr2=0x56218e856f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.562+0000 7f7c61dc0740 1 --2- 172.21.15.123:0/3412081020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56218e7fc400 0x56218e856f50 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f7c4802a1e0 tx=0x7f7c48008030 comp rx=0 tx=0).stop 2024-09-15T23:14:56.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.562+0000 7f7c61dc0740 1 -- 172.21.15.123:0/3412081020 shutdown_connections 2024-09-15T23:14:56.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.562+0000 7f7c61dc0740 1 --2- 172.21.15.123:0/3412081020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56218e8041d0 0x56218e84b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.562+0000 7f7c61dc0740 1 --2- 172.21.15.123:0/3412081020 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56218e802a40 0x56218e84abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.562+0000 7f7c61dc0740 1 --2- 172.21.15.123:0/3412081020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56218e7fc400 0x56218e856f50 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.562+0000 7f7c61dc0740 1 -- 172.21.15.123:0/3412081020 >> 172.21.15.123:0/3412081020 conn(0x56218e800200 msgr2=0x56218e849210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:56.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.562+0000 7f7c61dc0740 1 -- 172.21.15.123:0/3412081020 shutdown_connections 2024-09-15T23:14:56.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.562+0000 7f7c61dc0740 1 -- 172.21.15.123:0/3412081020 wait complete. 2024-09-15T23:14:56.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.562+0000 7f7c61dc0740 1 -- start start 2024-09-15T23:14:56.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.563+0000 7f7c61dc0740 1 Processor -- start 2024-09-15T23:14:56.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.563+0000 7f7c61dc0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56218e7fc400 0x56218e829600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.563+0000 7f7c61dc0740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56218e802a40 0x56218e86a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.563+0000 7f7c61dc0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56218e8041d0 0x56218e855d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.563+0000 7f7c61dc0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56218e858760 con 0x56218e8041d0 2024-09-15T23:14:56.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.563+0000 7f7c61dc0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7c580cd0b0 con 0x56218e7fc400 2024-09-15T23:14:56.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.563+0000 7f7c61dc0740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x56218e82b200 con 0x56218e802a40 2024-09-15T23:14:56.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.564+0000 7f7c61dc0740 10 client.0 _ll_register_callbacks cb 0x7f7c4c007e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:56.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.564+0000 7f7c5d4e8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56218e8041d0 0x56218e855d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.564+0000 7f7c5d4e8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56218e8041d0 0x56218e855d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45330/0 (socket says 172.21.15.123:45330) 2024-09-15T23:14:56.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.564+0000 7f7c5d4e8640 1 -- 172.21.15.123:0/2589525230 learned_addr learned my addr 172.21.15.123:0/2589525230 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:56.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.564+0000 7f7c5cce7640 1 --2- 172.21.15.123:0/2589525230 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56218e7fc400 0x56218e829600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.564+0000 7f7c57fff640 1 --2- 172.21.15.123:0/2589525230 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56218e802a40 0x56218e86a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.564+0000 7f7c5d4e8640 1 -- 172.21.15.123:0/2589525230 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56218e802a40 msgr2=0x56218e86a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.564+0000 7f7c5d4e8640 1 --2- 172.21.15.123:0/2589525230 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56218e802a40 0x56218e86a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.564+0000 7f7c5d4e8640 1 -- 172.21.15.123:0/2589525230 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56218e7fc400 msgr2=0x56218e829600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.564+0000 7f7c5d4e8640 1 --2- 172.21.15.123:0/2589525230 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56218e7fc400 0x56218e829600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.564+0000 7f7c5d4e8640 1 -- 172.21.15.123:0/2589525230 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56218e8c9ca0 con 0x56218e8041d0 2024-09-15T23:14:56.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.564+0000 7f7c5d4e8640 1 --2- 172.21.15.123:0/2589525230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56218e8041d0 0x56218e855d10 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f7c5008a5f0 tx=0x7f7c5001a070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebfcaf1184a453c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.564+0000 7f7c377fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:56.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.564+0000 7f7c377fe640 1 -- 172.21.15.123:0/2589525230 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c50072040 con 0x56218e8041d0 2024-09-15T23:14:56.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.564+0000 7f7c377fe640 1 -- 172.21.15.123:0/2589525230 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7f7c5008a220 con 0x56218e8041d0 2024-09-15T23:14:56.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.564+0000 7f7c61dc0740 1 -- 172.21.15.123:0/2589525230 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c480512c0 con 0x56218e8041d0 2024-09-15T23:14:56.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.564+0000 7f7c377fe640 1 -- 172.21.15.123:0/2589525230 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7c50062dd0 con 0x56218e8041d0 2024-09-15T23:14:56.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.564+0000 7f7c61dc0740 10 client.5826 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:56.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.564+0000 7f7c61dc0740 1 -- 172.21.15.123:0/2589525230 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x56218e82cac0 con 0x56218e8041d0 2024-09-15T23:14:56.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.564+0000 7f7c377fe640 1 -- 172.21.15.123:0/2589525230 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c480512c0 con 0x56218e8041d0 2024-09-15T23:14:56.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.565+0000 7f7c377fe640 1 -- 172.21.15.123:0/2589525230 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f7c5005e170 con 0x56218e8041d0 2024-09-15T23:14:56.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.565+0000 7f7c61dc0740 10 client.5826 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:56.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.565+0000 7f7c61dc0740 10 client.5826 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:56.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.565+0000 7f7c61dc0740 20 client.5826 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:56.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.565+0000 7f7c61dc0740 1 --2- 172.21.15.123:0/2589525230 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x56218e823bb0 0x56218e856250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.565+0000 7f7c61dc0740 4 client.5826 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2024-09-15T23:14:56.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.565+0000 7f7c61dc0740 1 -- 172.21.15.123:0/2589525230 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) -- 0x56218e7f88f0 con 0x56218e823bb0 2024-09-15T23:14:56.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.565+0000 7f7c5cce7640 1 --2- 172.21.15.123:0/2589525230 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x56218e823bb0 0x56218e856250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.565+0000 7f7c5cce7640 1 --2- 172.21.15.123:0/2589525230 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x56218e823bb0 0x56218e856250 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=344db5ece28f9675 server_cookie=e1ef2337ae294e6e in_seq=0 out_seq=0 2024-09-15T23:14:56.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.565+0000 7f7c377fe640 10 client.5826 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:56.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.566+0000 7f7c377fe640 1 -- 172.21.15.123:0/2589525230 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56218e7f88f0 con 0x56218e823bb0 2024-09-15T23:14:56.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.566+0000 7f7c377fe640 10 client.5826 handle_command_reply: tid=0 2024-09-15T23:14:56.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.566+0000 7f7c61dc0740 1 client.5826 shutdown 2024-09-15T23:14:56.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.566+0000 7f7c61dc0740 1 -- 172.21.15.123:0/2589525230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56218e8041d0 msgr2=0x56218e855d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.566+0000 7f7c61dc0740 1 --2- 172.21.15.123:0/2589525230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56218e8041d0 0x56218e855d10 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f7c5008a5f0 tx=0x7f7c5001a070 comp rx=0 tx=0).stop 2024-09-15T23:14:56.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.566+0000 7f7c61dc0740 1 -- 172.21.15.123:0/2589525230 shutdown_connections 2024-09-15T23:14:56.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.566+0000 7f7c61dc0740 1 --2- 172.21.15.123:0/2589525230 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x56218e823bb0 0x56218e856250 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.566+0000 7f7c61dc0740 1 --2- 172.21.15.123:0/2589525230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56218e8041d0 0x56218e855d10 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.566+0000 7f7c61dc0740 1 --2- 172.21.15.123:0/2589525230 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56218e802a40 0x56218e86a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.566+0000 7f7c61dc0740 1 --2- 172.21.15.123:0/2589525230 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56218e7fc400 0x56218e829600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.566+0000 7f7c377fe640 0 client.5826 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:56.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.566+0000 7f7c61dc0740 1 -- 172.21.15.123:0/2589525230 >> 172.21.15.123:0/2589525230 conn(0x56218e800200 msgr2=0x56218e84abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:56.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.566+0000 7f7c61dc0740 1 -- 172.21.15.123:0/2589525230 shutdown_connections 2024-09-15T23:14:56.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.566+0000 7f7c61dc0740 1 -- 172.21.15.123:0/2589525230 wait complete. 2024-09-15T23:14:56.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.566+0000 7f7c61dc0740 20 client.5826 trim_cache size 0 max 16384 2024-09-15T23:14:56.573 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:14:56.573 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0, 2024-09-15T23:14:56.573 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_tag": "0268e802-891e-4976-ac75-404bdd2a455c", 2024-09-15T23:14:56.573 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": "asynchronous" 2024-09-15T23:14:56.573 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:14:56.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.567+0000 7f7c5ef4b640 1 -- 172.21.15.123:0/43249264 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7c4406c2e0 msgr2=0x7f7c4406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.567+0000 7f7c5ef4b640 1 --2- 172.21.15.123:0/43249264 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7c4406c2e0 0x7f7c4406e7a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7c48034000 tx=0x7f7c4802e000 comp rx=0 tx=0).stop 2024-09-15T23:14:56.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.567+0000 7f7c5ef4b640 1 -- 172.21.15.123:0/43249264 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c58162a00 msgr2=0x7f7c58158b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.567+0000 7f7c5ef4b640 1 --2- 172.21.15.123:0/43249264 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c58162a00 0x7f7c58158b00 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f7c5000cd50 tx=0x7f7c5000a650 comp rx=0 tx=0).stop 2024-09-15T23:14:56.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.567+0000 7f7c5ef4b640 1 -- 172.21.15.123:0/43249264 shutdown_connections 2024-09-15T23:14:56.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.567+0000 7f7c5ef4b640 1 --2- 172.21.15.123:0/43249264 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7c4406c2e0 0x7f7c4406e7a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.567+0000 7f7c5ef4b640 1 --2- 172.21.15.123:0/43249264 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7c58162a00 0x7f7c58158b00 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.567+0000 7f7c5ef4b640 1 --2- 172.21.15.123:0/43249264 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7c5815e990 0x7f7c5814ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.567+0000 7f7c5ef4b640 1 --2- 172.21.15.123:0/43249264 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7c580b5520 0x7f7c580cfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.567+0000 7f7c5ef4b640 1 -- 172.21.15.123:0/43249264 >> 172.21.15.123:0/43249264 conn(0x7f7c580d25d0 msgr2=0x7f7c5806e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:56.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.567+0000 7f7c5ef4b640 1 -- 172.21.15.123:0/43249264 shutdown_connections 2024-09-15T23:14:56.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.567+0000 7f7c5ef4b640 1 -- 172.21.15.123:0/43249264 wait complete. 2024-09-15T23:14:56.579 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'return_code': 0, 'scrub_tag': '0268e802-891e-4976-ac75-404bdd2a455c', 'mode': 'asynchronous'}' 2024-09-15T23:14:56.579 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /' 2024-09-15T23:14:56.579 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / 2024-09-15T23:14:56.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.679+0000 7f784a731640 1 Processor -- start 2024-09-15T23:14:56.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.679+0000 7f784a731640 1 -- start start 2024-09-15T23:14:56.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.680+0000 7f784a731640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f78440cce30 0x7f78440cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.680+0000 7f784a731640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78440714b0 con 0x7f7844071c70 2024-09-15T23:14:56.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.680+0000 7f784a731640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78440cd880 con 0x7f78440732e0 2024-09-15T23:14:56.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.680+0000 7f784a731640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f78440cdb60 con 0x7f78440cce30 2024-09-15T23:14:56.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.680+0000 7f7848cce640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7844071c70 0x7f784415c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54454/0 (socket says 172.21.15.123:54454) 2024-09-15T23:14:56.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.680+0000 7f7848cce640 1 -- 172.21.15.123:0/2422949113 learned_addr learned my addr 172.21.15.123:0/2422949113 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:56.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.680+0000 7f7842ffd640 1 -- 172.21.15.123:0/2422949113 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2438401629 0 0) 0x7f78440714b0 con 0x7f7844071c70 2024-09-15T23:14:56.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.680+0000 7f78437fe640 1 --2- 172.21.15.123:0/2422949113 >> v2:172.21.15.188:3300/0 conn(0x7f78440cce30 0x7f78440cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.680+0000 7f7842ffd640 1 -- 172.21.15.123:0/2422949113 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f782c003520 con 0x7f7844071c70 2024-09-15T23:14:56.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.680+0000 7f7842ffd640 1 -- 172.21.15.123:0/2422949113 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2377531497 0 0) 0x7f782c003520 con 0x7f7844071c70 2024-09-15T23:14:56.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.680+0000 7f7842ffd640 1 -- 172.21.15.123:0/2422949113 >> v2:172.21.15.188:3300/0 conn(0x7f78440cce30 msgr2=0x7f78440cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.680+0000 7f7842ffd640 1 --2- 172.21.15.123:0/2422949113 >> v2:172.21.15.188:3300/0 conn(0x7f78440cce30 0x7f78440cd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.680+0000 7f7842ffd640 1 -- 172.21.15.123:0/2422949113 >> v1:172.21.15.188:6789/0 conn(0x7f78440732e0 legacy=0x7f78440736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.680+0000 7f7842ffd640 1 -- 172.21.15.123:0/2422949113 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78440cde40 con 0x7f7844071c70 2024-09-15T23:14:56.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.680+0000 7f7842ffd640 1 -- 172.21.15.123:0/2422949113 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f783c0019f0 con 0x7f7844071c70 2024-09-15T23:14:56.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.680+0000 7f7842ffd640 1 -- 172.21.15.123:0/2422949113 >> v1:172.21.15.123:6789/0 conn(0x7f7844071c70 legacy=0x7f784415c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.680+0000 7f7842ffd640 1 --2- 172.21.15.123:0/2422949113 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f782c0039b0 0x7f782c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.680+0000 7f7842ffd640 1 --2- 172.21.15.123:0/2422949113 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f782c004800 0x7f782c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.680+0000 7f7842ffd640 1 --2- 172.21.15.123:0/2422949113 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f782c0051c0 0x7f782c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.680+0000 7f7842ffd640 1 -- 172.21.15.123:0/2422949113 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f78440cdb60 con 0x7f782c004800 2024-09-15T23:14:56.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.680+0000 7f7842ffd640 1 -- 172.21.15.123:0/2422949113 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f782c00c160 con 0x7f782c0051c0 2024-09-15T23:14:56.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.680+0000 7f7842ffd640 1 -- 172.21.15.123:0/2422949113 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f782c00c360 con 0x7f782c0039b0 2024-09-15T23:14:56.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.680+0000 7f78437fe640 1 --2- 172.21.15.123:0/2422949113 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f782c004800 0x7f782c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.680+0000 7f7843fff640 1 --2- 172.21.15.123:0/2422949113 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f782c0039b0 0x7f782c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.681+0000 7f7848cce640 1 --2- 172.21.15.123:0/2422949113 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f782c0051c0 0x7f782c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.681+0000 7f78437fe640 1 -- 172.21.15.123:0/2422949113 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f782c0039b0 msgr2=0x7f782c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.681+0000 7f78437fe640 1 --2- 172.21.15.123:0/2422949113 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f782c0039b0 0x7f782c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.681+0000 7f78437fe640 1 -- 172.21.15.123:0/2422949113 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f782c0051c0 msgr2=0x7f782c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.681+0000 7f78437fe640 1 --2- 172.21.15.123:0/2422949113 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f782c0051c0 0x7f782c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.681+0000 7f78437fe640 1 -- 172.21.15.123:0/2422949113 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f782c003520 con 0x7f782c004800 2024-09-15T23:14:56.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.681+0000 7f7848cce640 1 -- 172.21.15.123:0/2422949113 reap_dead start 2024-09-15T23:14:56.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.681+0000 7f78437fe640 1 --2- 172.21.15.123:0/2422949113 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f782c004800 0x7f782c004c80 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f7838009aa0 tx=0x7f782c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bda3e44baf5ba5b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.681+0000 7f7842ffd640 1 -- 172.21.15.123:0/2422949113 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7838036070 con 0x7f782c004800 2024-09-15T23:14:56.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.681+0000 7f7842ffd640 1 -- 172.21.15.123:0/2422949113 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7838031400 con 0x7f782c004800 2024-09-15T23:14:56.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.681+0000 7f7842ffd640 1 -- 172.21.15.123:0/2422949113 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7838009670 con 0x7f782c004800 2024-09-15T23:14:56.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.682+0000 7f784a731640 1 -- 172.21.15.123:0/2422949113 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f782c004800 msgr2=0x7f782c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.682+0000 7f784a731640 1 --2- 172.21.15.123:0/2422949113 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f782c004800 0x7f782c004c80 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f7838009aa0 tx=0x7f782c005830 comp rx=0 tx=0).stop 2024-09-15T23:14:56.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.682+0000 7f784a731640 1 -- 172.21.15.123:0/2422949113 shutdown_connections 2024-09-15T23:14:56.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.682+0000 7f784a731640 1 --2- 172.21.15.123:0/2422949113 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f782c004800 0x7f782c004c80 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.682+0000 7f784a731640 1 -- 172.21.15.123:0/2422949113 >> 172.21.15.123:0/2422949113 conn(0x7f784406d0f0 msgr2=0x7f784406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:56.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.682+0000 7f784a731640 1 -- 172.21.15.123:0/2422949113 shutdown_connections 2024-09-15T23:14:56.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.682+0000 7f784a731640 1 -- 172.21.15.123:0/2422949113 wait complete. 2024-09-15T23:14:56.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.683+0000 7f784a731640 1 Processor -- start 2024-09-15T23:14:56.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.683+0000 7f784a731640 1 -- start start 2024-09-15T23:14:56.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.684+0000 7f784a731640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f782c004800 0x7f78440ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.684+0000 7f784a731640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f78440cc0b0 0x7f7844158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.684+0000 7f784a731640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f784414b4b0 0x7f78440b5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.684+0000 7f784a731640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f78440cd420 con 0x7f784414b4b0 2024-09-15T23:14:56.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.684+0000 7f784a731640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f78440cd2a0 con 0x7f782c004800 2024-09-15T23:14:56.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.684+0000 7f784a731640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f78440cd5a0 con 0x7f78440cc0b0 2024-09-15T23:14:56.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.684+0000 7f7848cce640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f784414b4b0 0x7f78440b5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.684+0000 7f7848cce640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f784414b4b0 0x7f78440b5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45344/0 (socket says 172.21.15.123:45344) 2024-09-15T23:14:56.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.684+0000 7f7848cce640 1 -- 172.21.15.123:0/1983671470 learned_addr learned my addr 172.21.15.123:0/1983671470 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:56.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.684+0000 7f7843fff640 1 --2- 172.21.15.123:0/1983671470 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f782c004800 0x7f78440ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.684+0000 7f78437fe640 1 --2- 172.21.15.123:0/1983671470 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f78440cc0b0 0x7f7844158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.685+0000 7f7848cce640 1 -- 172.21.15.123:0/1983671470 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f78440cc0b0 msgr2=0x7f7844158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.685+0000 7f7848cce640 1 --2- 172.21.15.123:0/1983671470 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f78440cc0b0 0x7f7844158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.685+0000 7f7848cce640 1 -- 172.21.15.123:0/1983671470 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f782c004800 msgr2=0x7f78440ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.685+0000 7f7848cce640 1 --2- 172.21.15.123:0/1983671470 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f782c004800 0x7f78440ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.685+0000 7f7848cce640 1 -- 172.21.15.123:0/1983671470 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78440caf10 con 0x7f784414b4b0 2024-09-15T23:14:56.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.685+0000 7f7848cce640 1 --2- 172.21.15.123:0/1983671470 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f784414b4b0 0x7f78440b5860 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f7844071060 tx=0x7f783c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.685+0000 7f7840ff9640 1 -- 172.21.15.123:0/1983671470 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783c00eb60 con 0x7f784414b4b0 2024-09-15T23:14:56.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.685+0000 7f7840ff9640 1 -- 172.21.15.123:0/1983671470 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f783c00ed00 con 0x7f784414b4b0 2024-09-15T23:14:56.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.685+0000 7f784a731640 1 -- 172.21.15.123:0/1983671470 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78440cb1b0 con 0x7f784414b4b0 2024-09-15T23:14:56.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.685+0000 7f7840ff9640 1 -- 172.21.15.123:0/1983671470 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783c014650 con 0x7f784414b4b0 2024-09-15T23:14:56.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.685+0000 7f784a731640 1 -- 172.21.15.123:0/1983671470 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78440cb770 con 0x7f784414b4b0 2024-09-15T23:14:56.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.686+0000 7f7840ff9640 1 -- 172.21.15.123:0/1983671470 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f783c0147f0 con 0x7f784414b4b0 2024-09-15T23:14:56.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.687+0000 7f7840ff9640 1 --2- 172.21.15.123:0/1983671470 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f783006c2b0 0x7f783006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.687+0000 7f7840ff9640 1 -- 172.21.15.123:0/1983671470 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7f783c08b1f0 con 0x7f784414b4b0 2024-09-15T23:14:56.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.687+0000 7f7843fff640 1 --2- 172.21.15.123:0/1983671470 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f783006c2b0 0x7f783006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.688+0000 7f7843fff640 1 --2- 172.21.15.123:0/1983671470 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f783006c2b0 0x7f783006e770 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7834000c00 tx=0x7f7834009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.688+0000 7f784d4cf740 1 Processor -- start 2024-09-15T23:14:56.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.688+0000 7f784d4cf740 1 -- start start 2024-09-15T23:14:56.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.688+0000 7f784d4cf740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564733f18f0 0x556473437090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.689+0000 7f784d4cf740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564733ef0b0 0x5564733f1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.689+0000 7f784d4cf740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5564733f3080 0x5564733ec170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.689+0000 7f784d4cf740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x556473354a10 con 0x5564733f18f0 2024-09-15T23:14:56.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.689+0000 7f784d4cf740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5564732fc700 con 0x5564733ef0b0 2024-09-15T23:14:56.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.689+0000 7f784d4cf740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5564733509d0 con 0x5564733f3080 2024-09-15T23:14:56.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.689+0000 7f7843fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564733f18f0 0x556473437090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.689+0000 7f7843fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564733f18f0 0x556473437090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45348/0 (socket says 172.21.15.123:45348) 2024-09-15T23:14:56.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.689+0000 7f7843fff640 1 -- 172.21.15.123:0/451574028 learned_addr learned my addr 172.21.15.123:0/451574028 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:56.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.689+0000 7f78437fe640 1 --2- 172.21.15.123:0/451574028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564733ef0b0 0x5564733f1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.689+0000 7f7848cce640 1 --2- 172.21.15.123:0/451574028 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5564733f3080 0x5564733ec170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.689+0000 7f7843fff640 1 -- 172.21.15.123:0/451574028 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5564733f3080 msgr2=0x5564733ec170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.689+0000 7f7843fff640 1 --2- 172.21.15.123:0/451574028 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5564733f3080 0x5564733ec170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.689+0000 7f7843fff640 1 -- 172.21.15.123:0/451574028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564733ef0b0 msgr2=0x5564733f1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.689+0000 7f7843fff640 1 --2- 172.21.15.123:0/451574028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564733ef0b0 0x5564733f1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.689+0000 7f7843fff640 1 -- 172.21.15.123:0/451574028 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55647304b280 con 0x5564733f18f0 2024-09-15T23:14:56.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.689+0000 7f7843fff640 1 --2- 172.21.15.123:0/451574028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564733f18f0 0x556473437090 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f78340018b0 tx=0x7f7834014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbfa488c697bac1f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.689+0000 7f7829ffb640 1 -- 172.21.15.123:0/451574028 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7834028070 con 0x5564733f18f0 2024-09-15T23:14:56.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.689+0000 7f7829ffb640 1 -- 172.21.15.123:0/451574028 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7834015c00 con 0x5564733f18f0 2024-09-15T23:14:56.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.689+0000 7f7829ffb640 1 -- 172.21.15.123:0/451574028 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78340143d0 con 0x5564733f18f0 2024-09-15T23:14:56.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.690+0000 7f784d4cf740 1 -- 172.21.15.123:0/451574028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564733f18f0 msgr2=0x556473437090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.690+0000 7f784d4cf740 1 --2- 172.21.15.123:0/451574028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564733f18f0 0x556473437090 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f78340018b0 tx=0x7f7834014000 comp rx=0 tx=0).stop 2024-09-15T23:14:56.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.690+0000 7f784d4cf740 1 -- 172.21.15.123:0/451574028 shutdown_connections 2024-09-15T23:14:56.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.690+0000 7f784d4cf740 1 --2- 172.21.15.123:0/451574028 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5564733f3080 0x5564733ec170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.690+0000 7f784d4cf740 1 --2- 172.21.15.123:0/451574028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564733ef0b0 0x5564733f1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.690+0000 7f784d4cf740 1 --2- 172.21.15.123:0/451574028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564733f18f0 0x556473437090 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.690+0000 7f784d4cf740 1 -- 172.21.15.123:0/451574028 >> 172.21.15.123:0/451574028 conn(0x5564733ee340 msgr2=0x556473436560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:56.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.690+0000 7f784d4cf740 1 -- 172.21.15.123:0/451574028 shutdown_connections 2024-09-15T23:14:56.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.690+0000 7f784d4cf740 1 -- 172.21.15.123:0/451574028 wait complete. 2024-09-15T23:14:56.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.690+0000 7f784d4cf740 1 -- start start 2024-09-15T23:14:56.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.691+0000 7f784d4cf740 1 Processor -- start 2024-09-15T23:14:56.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.691+0000 7f784d4cf740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564733f18f0 0x556473412e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.691+0000 7f784d4cf740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5564733f3080 0x556473414670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.691+0000 7f784d4cf740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55647341c050 0x556473430240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.691+0000 7f784d4cf740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5564733ed7e0 con 0x5564733f18f0 2024-09-15T23:14:56.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.691+0000 7f784d4cf740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5564732dd500 con 0x55647341c050 2024-09-15T23:14:56.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.691+0000 7f784d4cf740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5564734378c0 con 0x5564733f3080 2024-09-15T23:14:56.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.691+0000 7f784d4cf740 10 client.0 _ll_register_callbacks cb 0x556473066a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:56.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.691+0000 7f7843fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564733f18f0 0x556473412e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.691+0000 7f7843fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564733f18f0 0x556473412e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45358/0 (socket says 172.21.15.123:45358) 2024-09-15T23:14:56.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.692+0000 7f7843fff640 1 -- 172.21.15.123:0/2884874660 learned_addr learned my addr 172.21.15.123:0/2884874660 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:56.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.692+0000 7f7848cce640 1 --2- 172.21.15.123:0/2884874660 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55647341c050 0x556473430240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.692+0000 7f78437fe640 1 --2- 172.21.15.123:0/2884874660 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5564733f3080 0x556473414670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.692+0000 7f7843fff640 1 -- 172.21.15.123:0/2884874660 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5564733f3080 msgr2=0x556473414670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.692+0000 7f7843fff640 1 --2- 172.21.15.123:0/2884874660 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5564733f3080 0x556473414670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.692+0000 7f7843fff640 1 -- 172.21.15.123:0/2884874660 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55647341c050 msgr2=0x556473430240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.692+0000 7f7843fff640 1 --2- 172.21.15.123:0/2884874660 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55647341c050 0x556473430240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.692+0000 7f7843fff640 1 -- 172.21.15.123:0/2884874660 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556473133690 con 0x5564733f18f0 2024-09-15T23:14:56.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.692+0000 7f78437fe640 1 --2- 172.21.15.123:0/2884874660 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5564733f3080 0x556473414670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:56.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.692+0000 7f7843fff640 1 --2- 172.21.15.123:0/2884874660 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564733f18f0 0x556473412e10 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7834015840 tx=0x7f7834001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2fa3e99ca731b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.692+0000 7f7822ffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:56.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.692+0000 7f7822ffd640 1 -- 172.21.15.123:0/2884874660 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7834028070 con 0x5564733f18f0 2024-09-15T23:14:56.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.692+0000 7f7822ffd640 1 -- 172.21.15.123:0/2884874660 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7f7834022bc0 con 0x5564733f18f0 2024-09-15T23:14:56.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.692+0000 7f784d4cf740 1 -- 172.21.15.123:0/2884874660 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7834015c00 con 0x5564733f18f0 2024-09-15T23:14:56.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.692+0000 7f7822ffd640 1 -- 172.21.15.123:0/2884874660 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f783403b050 con 0x5564733f18f0 2024-09-15T23:14:56.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.692+0000 7f784d4cf740 10 client.5838 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:56.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.692+0000 7f784d4cf740 1 -- 172.21.15.123:0/2884874660 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x556473193e20 con 0x5564733f18f0 2024-09-15T23:14:56.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.692+0000 7f7822ffd640 1 -- 172.21.15.123:0/2884874660 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7834015c00 con 0x5564733f18f0 2024-09-15T23:14:56.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.692+0000 7f7822ffd640 1 -- 172.21.15.123:0/2884874660 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f783403e020 con 0x5564733f18f0 2024-09-15T23:14:56.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.692+0000 7f784d4cf740 10 client.5838 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:56.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.692+0000 7f784d4cf740 10 client.5838 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:56.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.693+0000 7f784d4cf740 20 client.5838 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.693+0000 7f784d4cf740 1 --2- 172.21.15.123:0/2884874660 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x556473431ec0 0x556473415350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.693+0000 7f784d4cf740 4 client.5838 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:14:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.693+0000 7f784d4cf740 1 -- 172.21.15.123:0/2884874660 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556473362140 con 0x556473431ec0 2024-09-15T23:14:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.693+0000 7f78437fe640 1 --2- 172.21.15.123:0/2884874660 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x556473431ec0 0x556473415350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.693+0000 7f7822ffd640 10 client.5838 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.693+0000 7f78437fe640 1 --2- 172.21.15.123:0/2884874660 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x556473431ec0 0x556473415350 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e15d7bdafb6a979c server_cookie=2ab46a1faa757ab5 in_seq=0 out_seq=0 2024-09-15T23:14:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.694+0000 7f7822ffd640 1 -- 172.21.15.123:0/2884874660 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556473362140 con 0x556473431ec0 2024-09-15T23:14:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.694+0000 7f7822ffd640 10 client.5838 handle_command_reply: tid=0 2024-09-15T23:14:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.694+0000 7f784d4cf740 1 client.5838 shutdown 2024-09-15T23:14:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.694+0000 7f784d4cf740 1 -- 172.21.15.123:0/2884874660 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564733f18f0 msgr2=0x556473412e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.694+0000 7f784d4cf740 1 --2- 172.21.15.123:0/2884874660 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564733f18f0 0x556473412e10 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7834015840 tx=0x7f7834001120 comp rx=0 tx=0).stop 2024-09-15T23:14:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.694+0000 7f784d4cf740 1 -- 172.21.15.123:0/2884874660 shutdown_connections 2024-09-15T23:14:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.694+0000 7f784d4cf740 1 --2- 172.21.15.123:0/2884874660 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x556473431ec0 0x556473415350 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.694+0000 7f784d4cf740 1 --2- 172.21.15.123:0/2884874660 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55647341c050 0x556473430240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.694+0000 7f784d4cf740 1 --2- 172.21.15.123:0/2884874660 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5564733f3080 0x556473414670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.694+0000 7f7822ffd640 0 client.5838 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:56.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.694+0000 7f784d4cf740 1 --2- 172.21.15.123:0/2884874660 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564733f18f0 0x556473412e10 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.694+0000 7f784d4cf740 1 -- 172.21.15.123:0/2884874660 >> 172.21.15.123:0/2884874660 conn(0x5564733ef0b0 msgr2=0x5564734353b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:56.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.694+0000 7f784d4cf740 1 -- 172.21.15.123:0/2884874660 shutdown_connections 2024-09-15T23:14:56.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.694+0000 7f784d4cf740 1 -- 172.21.15.123:0/2884874660 wait complete. 2024-09-15T23:14:56.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.694+0000 7f784d4cf740 20 client.5838 trim_cache size 0 max 16384 2024-09-15T23:14:56.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.711+0000 7f784d4cf740 1 Processor -- start 2024-09-15T23:14:56.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.711+0000 7f784d4cf740 1 -- start start 2024-09-15T23:14:56.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.712+0000 7f784d4cf740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564733f18f0 0x556473414650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.712+0000 7f784d4cf740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5564733f3080 0x556473439f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.712+0000 7f784d4cf740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55647341c050 0x55647343a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.712+0000 7f784d4cf740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7844201610 con 0x5564733f18f0 2024-09-15T23:14:56.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.712+0000 7f784d4cf740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7844200660 con 0x55647341c050 2024-09-15T23:14:56.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.712+0000 7f784d4cf740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f78441f8740 con 0x5564733f3080 2024-09-15T23:14:56.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.712+0000 7f7843fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564733f18f0 0x556473414650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.712+0000 7f7843fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564733f18f0 0x556473414650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45366/0 (socket says 172.21.15.123:45366) 2024-09-15T23:14:56.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.712+0000 7f7843fff640 1 -- 172.21.15.123:0/3591343601 learned_addr learned my addr 172.21.15.123:0/3591343601 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:56.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.712+0000 7f7848cce640 1 --2- 172.21.15.123:0/3591343601 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55647341c050 0x55647343a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.712+0000 7f78437fe640 1 --2- 172.21.15.123:0/3591343601 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5564733f3080 0x556473439f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.712+0000 7f7843fff640 1 -- 172.21.15.123:0/3591343601 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5564733f3080 msgr2=0x556473439f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.712+0000 7f7843fff640 1 --2- 172.21.15.123:0/3591343601 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5564733f3080 0x556473439f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.712+0000 7f7843fff640 1 -- 172.21.15.123:0/3591343601 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55647341c050 msgr2=0x55647343a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.712+0000 7f7843fff640 1 --2- 172.21.15.123:0/3591343601 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55647341c050 0x55647343a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.712+0000 7f7843fff640 1 -- 172.21.15.123:0/3591343601 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556473026f80 con 0x5564733f18f0 2024-09-15T23:14:56.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.712+0000 7f78437fe640 1 --2- 172.21.15.123:0/3591343601 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5564733f3080 0x556473439f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:56.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.712+0000 7f7843fff640 1 --2- 172.21.15.123:0/3591343601 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564733f18f0 0x556473414650 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7834005290 tx=0x7f7834028000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ca0d924f5ba7fe server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.712+0000 7f78297fa640 1 -- 172.21.15.123:0/3591343601 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7834022a10 con 0x5564733f18f0 2024-09-15T23:14:56.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.712+0000 7f78297fa640 1 -- 172.21.15.123:0/3591343601 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7834033070 con 0x5564733f18f0 2024-09-15T23:14:56.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.712+0000 7f78297fa640 1 -- 172.21.15.123:0/3591343601 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78340067d0 con 0x5564733f18f0 2024-09-15T23:14:56.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.713+0000 7f784d4cf740 1 -- 172.21.15.123:0/3591343601 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564733f18f0 msgr2=0x556473414650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.713+0000 7f784d4cf740 1 --2- 172.21.15.123:0/3591343601 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564733f18f0 0x556473414650 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7834005290 tx=0x7f7834028000 comp rx=0 tx=0).stop 2024-09-15T23:14:56.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.713+0000 7f784d4cf740 1 -- 172.21.15.123:0/3591343601 shutdown_connections 2024-09-15T23:14:56.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.713+0000 7f784d4cf740 1 --2- 172.21.15.123:0/3591343601 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55647341c050 0x55647343a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.713+0000 7f784d4cf740 1 --2- 172.21.15.123:0/3591343601 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5564733f3080 0x556473439f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.713+0000 7f784d4cf740 1 --2- 172.21.15.123:0/3591343601 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564733f18f0 0x556473414650 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.713+0000 7f784d4cf740 1 -- 172.21.15.123:0/3591343601 >> 172.21.15.123:0/3591343601 conn(0x5564733ef0b0 msgr2=0x5564734359e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:56.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.713+0000 7f784d4cf740 1 -- 172.21.15.123:0/3591343601 shutdown_connections 2024-09-15T23:14:56.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.713+0000 7f784d4cf740 1 -- 172.21.15.123:0/3591343601 wait complete. 2024-09-15T23:14:56.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.713+0000 7f784d4cf740 1 -- start start 2024-09-15T23:14:56.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.714+0000 7f784d4cf740 1 Processor -- start 2024-09-15T23:14:56.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.714+0000 7f784d4cf740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564733f18f0 0x556473434830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.714+0000 7f784d4cf740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564733f3080 0x55647343a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.714+0000 7f784d4cf740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55647341c050 0x5564734b7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.714+0000 7f784d4cf740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f78442001c0 con 0x5564733f18f0 2024-09-15T23:14:56.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.714+0000 7f784d4cf740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5564734340b0 con 0x5564733f3080 2024-09-15T23:14:56.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.714+0000 7f784d4cf740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55647341aa00 con 0x55647341c050 2024-09-15T23:14:56.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.714+0000 7f784d4cf740 10 client.0 _ll_register_callbacks cb 0x7f7834026070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:56.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.715+0000 7f7843fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564733f18f0 0x556473434830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.715+0000 7f7843fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564733f18f0 0x556473434830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45378/0 (socket says 172.21.15.123:45378) 2024-09-15T23:14:56.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.715+0000 7f7843fff640 1 -- 172.21.15.123:0/1459026148 learned_addr learned my addr 172.21.15.123:0/1459026148 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:56.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.715+0000 7f78437fe640 1 --2- 172.21.15.123:0/1459026148 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564733f3080 0x55647343a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.715+0000 7f7848cce640 1 --2- 172.21.15.123:0/1459026148 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55647341c050 0x5564734b7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.715+0000 7f7843fff640 1 -- 172.21.15.123:0/1459026148 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55647341c050 msgr2=0x5564734b7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.715+0000 7f7843fff640 1 --2- 172.21.15.123:0/1459026148 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55647341c050 0x5564734b7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.715+0000 7f7843fff640 1 -- 172.21.15.123:0/1459026148 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564733f3080 msgr2=0x55647343a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.715+0000 7f7843fff640 1 --2- 172.21.15.123:0/1459026148 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564733f3080 0x55647343a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.715+0000 7f7843fff640 1 -- 172.21.15.123:0/1459026148 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55647343a8e0 con 0x5564733f18f0 2024-09-15T23:14:56.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.715+0000 7f7843fff640 1 --2- 172.21.15.123:0/1459026148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564733f18f0 0x556473434830 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f7834003e50 tx=0x7f783400c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=393c9adf8ec5e11d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.715+0000 7f7822ffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:56.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.715+0000 7f7822ffd640 1 -- 172.21.15.123:0/1459026148 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7834028040 con 0x5564733f18f0 2024-09-15T23:14:56.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.715+0000 7f7822ffd640 1 -- 172.21.15.123:0/1459026148 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7f78340069d0 con 0x5564733f18f0 2024-09-15T23:14:56.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.715+0000 7f784d4cf740 1 -- 172.21.15.123:0/1459026148 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7834033070 con 0x5564733f18f0 2024-09-15T23:14:56.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.715+0000 7f7822ffd640 1 -- 172.21.15.123:0/1459026148 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7834055050 con 0x5564733f18f0 2024-09-15T23:14:56.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.715+0000 7f784d4cf740 10 client.5844 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:56.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.715+0000 7f784d4cf740 1 -- 172.21.15.123:0/1459026148 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55647343a8e0 con 0x5564733f18f0 2024-09-15T23:14:56.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.715+0000 7f7822ffd640 1 -- 172.21.15.123:0/1459026148 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7834033070 con 0x5564733f18f0 2024-09-15T23:14:56.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.715+0000 7f7822ffd640 1 -- 172.21.15.123:0/1459026148 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f7834058020 con 0x5564733f18f0 2024-09-15T23:14:56.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.715+0000 7f784d4cf740 10 client.5844 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:56.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.716+0000 7f784d4cf740 10 client.5844 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:56.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.716+0000 7f784d4cf740 20 client.5844 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:56.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.716+0000 7f784d4cf740 1 --2- 172.21.15.123:0/1459026148 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55647345ab50 0x55647345af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.716+0000 7f784d4cf740 4 client.5844 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/"}] 2024-09-15T23:14:56.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.716+0000 7f784d4cf740 1 -- 172.21.15.123:0/1459026148 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "scrub start", "path": "/"}) -- 0x55647335c490 con 0x55647345ab50 2024-09-15T23:14:56.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.716+0000 7f78437fe640 1 --2- 172.21.15.123:0/1459026148 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55647345ab50 0x55647345af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.716+0000 7f7822ffd640 10 client.5844 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:56.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.716+0000 7f78437fe640 1 --2- 172.21.15.123:0/1459026148 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55647345ab50 0x55647345af30 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5321791028a18a7e server_cookie=57bbe2bd0157a239 in_seq=0 out_seq=0 2024-09-15T23:14:56.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.717+0000 7f7822ffd640 1 -- 172.21.15.123:0/1459026148 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55647335c490 con 0x55647345ab50 2024-09-15T23:14:56.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.717+0000 7f7822ffd640 10 client.5844 handle_command_reply: tid=0 2024-09-15T23:14:56.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.717+0000 7f784d4cf740 1 client.5844 shutdown 2024-09-15T23:14:56.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.717+0000 7f784d4cf740 1 -- 172.21.15.123:0/1459026148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564733f18f0 msgr2=0x556473434830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.717+0000 7f784d4cf740 1 --2- 172.21.15.123:0/1459026148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564733f18f0 0x556473434830 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f7834003e50 tx=0x7f783400c000 comp rx=0 tx=0).stop 2024-09-15T23:14:56.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.717+0000 7f784d4cf740 1 -- 172.21.15.123:0/1459026148 shutdown_connections 2024-09-15T23:14:56.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.717+0000 7f784d4cf740 1 --2- 172.21.15.123:0/1459026148 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55647345ab50 0x55647345af30 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.717+0000 7f784d4cf740 1 --2- 172.21.15.123:0/1459026148 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55647341c050 0x5564734b7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.717+0000 7f784d4cf740 1 --2- 172.21.15.123:0/1459026148 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5564733f3080 0x55647343a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.717+0000 7f7822ffd640 0 client.5844 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:56.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.717+0000 7f784d4cf740 1 --2- 172.21.15.123:0/1459026148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5564733f18f0 0x556473434830 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.717+0000 7f784d4cf740 1 -- 172.21.15.123:0/1459026148 >> 172.21.15.123:0/1459026148 conn(0x5564733ef0b0 msgr2=0x55647341af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:56.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.717+0000 7f784d4cf740 1 -- 172.21.15.123:0/1459026148 shutdown_connections 2024-09-15T23:14:56.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.717+0000 7f784d4cf740 1 -- 172.21.15.123:0/1459026148 wait complete. 2024-09-15T23:14:56.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.717+0000 7f784d4cf740 20 client.5844 trim_cache size 0 max 16384 2024-09-15T23:14:56.724 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:14:56.725 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0, 2024-09-15T23:14:56.725 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_tag": "ca73209e-4aaf-46db-830f-43d5b291e77c", 2024-09-15T23:14:56.725 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": "asynchronous" 2024-09-15T23:14:56.725 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:14:56.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.717+0000 7f784a731640 1 -- 172.21.15.123:0/1983671470 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f783006c2b0 msgr2=0x7f783006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.717+0000 7f784a731640 1 --2- 172.21.15.123:0/1983671470 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f783006c2b0 0x7f783006e770 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7834000c00 tx=0x7f7834009040 comp rx=0 tx=0).stop 2024-09-15T23:14:56.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.717+0000 7f784a731640 1 -- 172.21.15.123:0/1983671470 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f784414b4b0 msgr2=0x7f78440b5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.717+0000 7f784a731640 1 --2- 172.21.15.123:0/1983671470 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f784414b4b0 0x7f78440b5860 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f7844071060 tx=0x7f783c00e530 comp rx=0 tx=0).stop 2024-09-15T23:14:56.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.717+0000 7f784a731640 1 -- 172.21.15.123:0/1983671470 shutdown_connections 2024-09-15T23:14:56.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.717+0000 7f784a731640 1 --2- 172.21.15.123:0/1983671470 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f783006c2b0 0x7f783006e770 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.717+0000 7f784a731640 1 --2- 172.21.15.123:0/1983671470 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f784414b4b0 0x7f78440b5860 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.717+0000 7f784a731640 1 --2- 172.21.15.123:0/1983671470 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f78440cc0b0 0x7f7844158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.717+0000 7f784a731640 1 --2- 172.21.15.123:0/1983671470 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f782c004800 0x7f78440ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.717+0000 7f784a731640 1 -- 172.21.15.123:0/1983671470 >> 172.21.15.123:0/1983671470 conn(0x7f784406d0f0 msgr2=0x7f78440736c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:56.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.718+0000 7f784a731640 1 -- 172.21.15.123:0/1983671470 shutdown_connections 2024-09-15T23:14:56.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.718+0000 7f784a731640 1 -- 172.21.15.123:0/1983671470 wait complete. 2024-09-15T23:14:56.729 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /' returned '{'return_code': 0, 'scrub_tag': 'ca73209e-4aaf-46db-830f-43d5b291e77c', 'mode': 'asynchronous'}' 2024-09-15T23:14:56.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:14:56.729 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_dir_1) 2024-09-15T23:14:56.746 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_1' 2024-09-15T23:14:56.746 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_dir_1 2024-09-15T23:14:56.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.887+0000 7fc345865640 1 Processor -- start 2024-09-15T23:14:56.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.887+0000 7fc345865640 1 -- start start 2024-09-15T23:14:56.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.888+0000 7fc345865640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc3400b5520 0x7fc34006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.888+0000 7fc345865640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc34015f550 con 0x7fc34015e990 2024-09-15T23:14:56.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.888+0000 7fc345865640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc34015f830 con 0x7fc34006d260 2024-09-15T23:14:56.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.888+0000 7fc345865640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc34015fb10 con 0x7fc3400b5520 2024-09-15T23:14:56.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.888+0000 7fc33e7fc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc3400b5520 0x7fc34006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.888+0000 7fc33effd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc34015e990 0x7fc34015ed70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54460/0 (socket says 172.21.15.123:54460) 2024-09-15T23:14:56.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.888+0000 7fc33effd640 1 -- 172.21.15.123:0/1341691042 learned_addr learned my addr 172.21.15.123:0/1341691042 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:56.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.888+0000 7fc33e7fc640 1 -- 172.21.15.123:0/1341691042 >> v1:172.21.15.188:6789/0 conn(0x7fc34006d260 legacy=0x7fc340162a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.888+0000 7fc33e7fc640 1 -- 172.21.15.123:0/1341691042 >> v1:172.21.15.123:6789/0 conn(0x7fc34015e990 legacy=0x7fc34015ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.888+0000 7fc33dffb640 1 -- 172.21.15.123:0/1341691042 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2690202417 0 0) 0x7fc34015f550 con 0x7fc34015e990 2024-09-15T23:14:56.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.889+0000 7fc33e7fc640 1 -- 172.21.15.123:0/1341691042 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3401624e0 con 0x7fc3400b5520 2024-09-15T23:14:56.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.889+0000 7fc33e7fc640 1 --2- 172.21.15.123:0/1341691042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3400b5520 0x7fc34006cd20 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fc3340097a0 tx=0x7fc33402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54056f38917d6c9d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.889+0000 7fc33dffb640 1 -- 172.21.15.123:0/1341691042 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc334037070 con 0x7fc3400b5520 2024-09-15T23:14:56.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.889+0000 7fc33dffb640 1 -- 172.21.15.123:0/1341691042 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc334032440 con 0x7fc3400b5520 2024-09-15T23:14:56.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.889+0000 7fc33dffb640 1 -- 172.21.15.123:0/1341691042 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc334032810 con 0x7fc3400b5520 2024-09-15T23:14:56.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.890+0000 7fc345865640 1 -- 172.21.15.123:0/1341691042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3400b5520 msgr2=0x7fc34006cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.890+0000 7fc345865640 1 --2- 172.21.15.123:0/1341691042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3400b5520 0x7fc34006cd20 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fc3340097a0 tx=0x7fc33402a230 comp rx=0 tx=0).stop 2024-09-15T23:14:56.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.890+0000 7fc345865640 1 -- 172.21.15.123:0/1341691042 shutdown_connections 2024-09-15T23:14:56.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.890+0000 7fc345865640 1 --2- 172.21.15.123:0/1341691042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3400b5520 0x7fc34006cd20 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.890+0000 7fc345865640 1 -- 172.21.15.123:0/1341691042 >> 172.21.15.123:0/1341691042 conn(0x7fc3400d25d0 msgr2=0x7fc3400d29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:56.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.890+0000 7fc345865640 1 -- 172.21.15.123:0/1341691042 shutdown_connections 2024-09-15T23:14:56.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.890+0000 7fc345865640 1 -- 172.21.15.123:0/1341691042 wait complete. 2024-09-15T23:14:56.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.891+0000 7fc345865640 1 Processor -- start 2024-09-15T23:14:56.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.891+0000 7fc345865640 1 -- start start 2024-09-15T23:14:56.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.892+0000 7fc345865640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc34006d260 0x7fc3401e8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.892+0000 7fc345865640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3400b5520 0x7fc340070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.892+0000 7fc345865640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc34015e990 0x7fc3400d11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.892+0000 7fc345865640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc3400b7170 con 0x7fc3400b5520 2024-09-15T23:14:56.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.892+0000 7fc345865640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc3400b6ff0 con 0x7fc34006d260 2024-09-15T23:14:56.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.892+0000 7fc345865640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc3400b72f0 con 0x7fc34015e990 2024-09-15T23:14:56.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.892+0000 7fc33e7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3400b5520 0x7fc340070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.892+0000 7fc33e7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3400b5520 0x7fc340070b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45404/0 (socket says 172.21.15.123:45404) 2024-09-15T23:14:56.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.892+0000 7fc33e7fc640 1 -- 172.21.15.123:0/3706347273 learned_addr learned my addr 172.21.15.123:0/3706347273 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:56.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.892+0000 7fc33e7fc640 1 -- 172.21.15.123:0/3706347273 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc34015e990 msgr2=0x7fc3400d11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.892+0000 7fc33e7fc640 1 --2- 172.21.15.123:0/3706347273 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc34015e990 0x7fc3400d11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.892+0000 7fc33e7fc640 1 -- 172.21.15.123:0/3706347273 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc34006d260 msgr2=0x7fc3401e8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.892+0000 7fc33e7fc640 1 --2- 172.21.15.123:0/3706347273 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc34006d260 0x7fc3401e8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.892+0000 7fc33e7fc640 1 -- 172.21.15.123:0/3706347273 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc34015a100 con 0x7fc3400b5520 2024-09-15T23:14:56.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.893+0000 7fc33e7fc640 1 --2- 172.21.15.123:0/3706347273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3400b5520 0x7fc340070b10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc334035040 tx=0x7fc3340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.893+0000 7fc327fff640 1 -- 172.21.15.123:0/3706347273 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc334037050 con 0x7fc3400b5520 2024-09-15T23:14:56.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.893+0000 7fc327fff640 1 -- 172.21.15.123:0/3706347273 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc334038040 con 0x7fc3400b5520 2024-09-15T23:14:56.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.893+0000 7fc345865640 1 -- 172.21.15.123:0/3706347273 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3401e9470 con 0x7fc3400b5520 2024-09-15T23:14:56.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.893+0000 7fc327fff640 1 -- 172.21.15.123:0/3706347273 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc334004490 con 0x7fc3400b5520 2024-09-15T23:14:56.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.893+0000 7fc345865640 1 -- 172.21.15.123:0/3706347273 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc34015a3c0 con 0x7fc3400b5520 2024-09-15T23:14:56.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.894+0000 7fc327fff640 1 -- 172.21.15.123:0/3706347273 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc334030900 con 0x7fc3400b5520 2024-09-15T23:14:56.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.895+0000 7fc327fff640 1 --2- 172.21.15.123:0/3706347273 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc32c06c2b0 0x7fc32c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.895+0000 7fc327fff640 1 -- 172.21.15.123:0/3706347273 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7fc3340ac020 con 0x7fc3400b5520 2024-09-15T23:14:56.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.895+0000 7fc33effd640 1 --2- 172.21.15.123:0/3706347273 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc32c06c2b0 0x7fc32c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.896+0000 7fc348606740 1 Processor -- start 2024-09-15T23:14:56.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.896+0000 7fc33effd640 1 --2- 172.21.15.123:0/3706347273 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc32c06c2b0 0x7fc32c06e770 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc330007fd0 tx=0x7fc330007d40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.896+0000 7fc348606740 1 -- start start 2024-09-15T23:14:56.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.896+0000 7fc348606740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c02f89c7e0 0x55c02f89cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.896+0000 7fc348606740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c02f897ee0 0x55c02f896dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.896+0000 7fc348606740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c02f899fa0 0x55c02f897310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.896+0000 7fc348606740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55c02f7ff710 con 0x55c02f899fa0 2024-09-15T23:14:56.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.896+0000 7fc348606740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55c02f7a7540 con 0x55c02f897ee0 2024-09-15T23:14:56.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.896+0000 7fc348606740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55c02f7fb6d0 con 0x55c02f89c7e0 2024-09-15T23:14:56.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.897+0000 7fc33f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c02f899fa0 0x55c02f897310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.897+0000 7fc33f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c02f899fa0 0x55c02f897310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45418/0 (socket says 172.21.15.123:45418) 2024-09-15T23:14:56.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.897+0000 7fc33f7fe640 1 -- 172.21.15.123:0/1242425409 learned_addr learned my addr 172.21.15.123:0/1242425409 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:56.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.897+0000 7fc33effd640 1 --2- 172.21.15.123:0/1242425409 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c02f89c7e0 0x55c02f89cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.897+0000 7fc33e7fc640 1 --2- 172.21.15.123:0/1242425409 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c02f897ee0 0x55c02f896dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.897+0000 7fc33f7fe640 1 -- 172.21.15.123:0/1242425409 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c02f89c7e0 msgr2=0x55c02f89cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.897+0000 7fc33f7fe640 1 --2- 172.21.15.123:0/1242425409 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c02f89c7e0 0x55c02f89cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.897+0000 7fc33f7fe640 1 -- 172.21.15.123:0/1242425409 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c02f897ee0 msgr2=0x55c02f896dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.897+0000 7fc33f7fe640 1 --2- 172.21.15.123:0/1242425409 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c02f897ee0 0x55c02f896dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.897+0000 7fc33f7fe640 1 -- 172.21.15.123:0/1242425409 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c02f7cd170 con 0x55c02f899fa0 2024-09-15T23:14:56.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.897+0000 7fc33f7fe640 1 --2- 172.21.15.123:0/1242425409 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c02f899fa0 0x55c02f897310 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fc338001620 tx=0x7fc338001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddcc0021810ca22e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.897+0000 7fc3257fa640 1 -- 172.21.15.123:0/1242425409 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc338005220 con 0x55c02f899fa0 2024-09-15T23:14:56.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.897+0000 7fc3257fa640 1 -- 172.21.15.123:0/1242425409 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc338001d30 con 0x55c02f899fa0 2024-09-15T23:14:56.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.897+0000 7fc3257fa640 1 -- 172.21.15.123:0/1242425409 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33800c8d0 con 0x55c02f899fa0 2024-09-15T23:14:56.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.898+0000 7fc348606740 1 -- 172.21.15.123:0/1242425409 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c02f899fa0 msgr2=0x55c02f897310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.898+0000 7fc348606740 1 --2- 172.21.15.123:0/1242425409 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c02f899fa0 0x55c02f897310 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fc338001620 tx=0x7fc338001ae0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.898+0000 7fc348606740 1 -- 172.21.15.123:0/1242425409 shutdown_connections 2024-09-15T23:14:56.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.898+0000 7fc348606740 1 --2- 172.21.15.123:0/1242425409 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c02f899fa0 0x55c02f897310 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.898+0000 7fc348606740 1 --2- 172.21.15.123:0/1242425409 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c02f897ee0 0x55c02f896dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.898+0000 7fc348606740 1 --2- 172.21.15.123:0/1242425409 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c02f89c7e0 0x55c02f89cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.898+0000 7fc348606740 1 -- 172.21.15.123:0/1242425409 >> 172.21.15.123:0/1242425409 conn(0x55c02f898fa0 msgr2=0x55c02f8e1660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:56.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.898+0000 7fc348606740 1 -- 172.21.15.123:0/1242425409 shutdown_connections 2024-09-15T23:14:56.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.898+0000 7fc348606740 1 -- 172.21.15.123:0/1242425409 wait complete. 2024-09-15T23:14:56.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.899+0000 7fc348606740 1 -- start start 2024-09-15T23:14:56.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.899+0000 7fc348606740 1 Processor -- start 2024-09-15T23:14:56.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.899+0000 7fc348606740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c02f899fa0 0x55c02f8b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.899+0000 7fc348606740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c02f89c7e0 0x55c02f8d71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.899+0000 7fc348606740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c02f8d76e0 0x55c02f8daab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.899+0000 7fc348606740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55c02f8c7070 con 0x55c02f8d76e0 2024-09-15T23:14:56.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.899+0000 7fc348606740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55c02f788660 con 0x55c02f89c7e0 2024-09-15T23:14:56.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.899+0000 7fc348606740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55c02f8e1d70 con 0x55c02f899fa0 2024-09-15T23:14:56.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.899+0000 7fc348606740 10 client.0 _ll_register_callbacks cb 0x55c02f511fa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:56.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.900+0000 7fc33f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c02f8d76e0 0x55c02f8daab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.900+0000 7fc33f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c02f8d76e0 0x55c02f8daab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45424/0 (socket says 172.21.15.123:45424) 2024-09-15T23:14:56.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.900+0000 7fc33f7fe640 1 -- 172.21.15.123:0/389776198 learned_addr learned my addr 172.21.15.123:0/389776198 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:56.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.900+0000 7fc33effd640 1 --2- 172.21.15.123:0/389776198 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c02f899fa0 0x55c02f8b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.900+0000 7fc33e7fc640 1 --2- 172.21.15.123:0/389776198 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c02f89c7e0 0x55c02f8d71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.900+0000 7fc33f7fe640 1 -- 172.21.15.123:0/389776198 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c02f899fa0 msgr2=0x55c02f8b22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.900+0000 7fc33f7fe640 1 --2- 172.21.15.123:0/389776198 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c02f899fa0 0x55c02f8b22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.900+0000 7fc33f7fe640 1 -- 172.21.15.123:0/389776198 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c02f89c7e0 msgr2=0x55c02f8d71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.900+0000 7fc33f7fe640 1 --2- 172.21.15.123:0/389776198 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c02f89c7e0 0x55c02f8d71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.900+0000 7fc33f7fe640 1 -- 172.21.15.123:0/389776198 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c02f5127b0 con 0x55c02f8d76e0 2024-09-15T23:14:56.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.900+0000 7fc33f7fe640 1 --2- 172.21.15.123:0/389776198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c02f8d76e0 0x55c02f8daab0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fc33800c4b0 tx=0x7fc338001190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6f867bfe0e8bae8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.900+0000 7fc31e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:56.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.900+0000 7fc31e7fc640 1 -- 172.21.15.123:0/389776198 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc338022020 con 0x55c02f8d76e0 2024-09-15T23:14:56.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.900+0000 7fc31e7fc640 1 -- 172.21.15.123:0/389776198 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7fc33800c8d0 con 0x55c02f8d76e0 2024-09-15T23:14:56.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.900+0000 7fc348606740 1 -- 172.21.15.123:0/389776198 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc338001d30 con 0x55c02f8d76e0 2024-09-15T23:14:56.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.900+0000 7fc31e7fc640 1 -- 172.21.15.123:0/389776198 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc33802c050 con 0x55c02f8d76e0 2024-09-15T23:14:56.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.900+0000 7fc348606740 10 client.5859 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:56.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.900+0000 7fc348606740 1 -- 172.21.15.123:0/389776198 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55c02f5dcb90 con 0x55c02f8d76e0 2024-09-15T23:14:56.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.900+0000 7fc31e7fc640 1 -- 172.21.15.123:0/389776198 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc338001d30 con 0x55c02f8d76e0 2024-09-15T23:14:56.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.900+0000 7fc31e7fc640 1 -- 172.21.15.123:0/389776198 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7fc33802f020 con 0x55c02f8d76e0 2024-09-15T23:14:56.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.901+0000 7fc348606740 10 client.5859 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:56.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.901+0000 7fc348606740 10 client.5859 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:56.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.901+0000 7fc348606740 20 client.5859 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:56.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.901+0000 7fc348606740 1 --2- 172.21.15.123:0/389776198 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55c02f8daff0 0x55c02f8d97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.901+0000 7fc348606740 4 client.5859 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:14:56.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.901+0000 7fc348606740 1 -- 172.21.15.123:0/389776198 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c02f80ce40 con 0x55c02f8daff0 2024-09-15T23:14:56.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.901+0000 7fc33effd640 1 --2- 172.21.15.123:0/389776198 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55c02f8daff0 0x55c02f8d97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.901+0000 7fc33effd640 1 --2- 172.21.15.123:0/389776198 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55c02f8daff0 0x55c02f8d97a0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=716fdea18944bbc9 server_cookie=d36f570797bb6809 in_seq=0 out_seq=0 2024-09-15T23:14:56.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.901+0000 7fc31e7fc640 10 client.5859 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:56.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.902+0000 7fc31e7fc640 1 -- 172.21.15.123:0/389776198 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c02f80ce40 con 0x55c02f8daff0 2024-09-15T23:14:56.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.902+0000 7fc31e7fc640 10 client.5859 handle_command_reply: tid=0 2024-09-15T23:14:56.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.902+0000 7fc348606740 1 client.5859 shutdown 2024-09-15T23:14:56.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.902+0000 7fc348606740 1 -- 172.21.15.123:0/389776198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c02f8d76e0 msgr2=0x55c02f8daab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.902+0000 7fc348606740 1 --2- 172.21.15.123:0/389776198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c02f8d76e0 0x55c02f8daab0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fc33800c4b0 tx=0x7fc338001190 comp rx=0 tx=0).stop 2024-09-15T23:14:56.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.902+0000 7fc348606740 1 -- 172.21.15.123:0/389776198 shutdown_connections 2024-09-15T23:14:56.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.902+0000 7fc348606740 1 --2- 172.21.15.123:0/389776198 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55c02f8daff0 0x55c02f8d97a0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.902+0000 7fc348606740 1 --2- 172.21.15.123:0/389776198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c02f8d76e0 0x55c02f8daab0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.902+0000 7fc348606740 1 --2- 172.21.15.123:0/389776198 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c02f89c7e0 0x55c02f8d71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.902+0000 7fc348606740 1 --2- 172.21.15.123:0/389776198 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c02f899fa0 0x55c02f8b22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.902+0000 7fc31e7fc640 0 client.5859 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:56.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.902+0000 7fc348606740 1 -- 172.21.15.123:0/389776198 >> 172.21.15.123:0/389776198 conn(0x55c02f897ee0 msgr2=0x55c02f8df750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:56.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.902+0000 7fc348606740 1 -- 172.21.15.123:0/389776198 shutdown_connections 2024-09-15T23:14:56.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.902+0000 7fc348606740 1 -- 172.21.15.123:0/389776198 wait complete. 2024-09-15T23:14:56.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.902+0000 7fc348606740 20 client.5859 trim_cache size 0 max 16384 2024-09-15T23:14:56.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.916+0000 7fc348606740 1 Processor -- start 2024-09-15T23:14:56.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.917+0000 7fc348606740 1 -- start start 2024-09-15T23:14:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.917+0000 7fc348606740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c02f899fa0 0x55c02f8e1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.917+0000 7fc348606740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c02f89c7e0 0x55c02f8db450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.917+0000 7fc348606740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c02f8d76e0 0x55c02f8db990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.917+0000 7fc348606740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc340200e00 con 0x55c02f8d76e0 2024-09-15T23:14:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.917+0000 7fc348606740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc3401ffe10 con 0x55c02f899fa0 2024-09-15T23:14:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.917+0000 7fc348606740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc340158200 con 0x55c02f89c7e0 2024-09-15T23:14:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.918+0000 7fc33f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c02f8d76e0 0x55c02f8db990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.918+0000 7fc33f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c02f8d76e0 0x55c02f8db990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45430/0 (socket says 172.21.15.123:45430) 2024-09-15T23:14:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.918+0000 7fc33f7fe640 1 -- 172.21.15.123:0/204591960 learned_addr learned my addr 172.21.15.123:0/204591960 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.918+0000 7fc33effd640 1 --2- 172.21.15.123:0/204591960 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c02f899fa0 0x55c02f8e1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.918+0000 7fc33e7fc640 1 --2- 172.21.15.123:0/204591960 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c02f89c7e0 0x55c02f8db450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.918+0000 7fc33f7fe640 1 -- 172.21.15.123:0/204591960 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c02f89c7e0 msgr2=0x55c02f8db450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.918+0000 7fc33f7fe640 1 --2- 172.21.15.123:0/204591960 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c02f89c7e0 0x55c02f8db450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.918+0000 7fc33f7fe640 1 -- 172.21.15.123:0/204591960 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c02f899fa0 msgr2=0x55c02f8e1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.918+0000 7fc33f7fe640 1 --2- 172.21.15.123:0/204591960 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c02f899fa0 0x55c02f8e1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.918+0000 7fc33f7fe640 1 -- 172.21.15.123:0/204591960 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c02f905f30 con 0x55c02f8d76e0 2024-09-15T23:14:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.918+0000 7fc33effd640 1 --2- 172.21.15.123:0/204591960 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c02f899fa0 0x55c02f8e1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.918+0000 7fc33f7fe640 1 --2- 172.21.15.123:0/204591960 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c02f8d76e0 0x55c02f8db990 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc33800cba0 tx=0x7fc33801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=279f8907173cdcf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.918+0000 7fc324ff9640 1 -- 172.21.15.123:0/204591960 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc338022020 con 0x55c02f8d76e0 2024-09-15T23:14:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.918+0000 7fc324ff9640 1 -- 172.21.15.123:0/204591960 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc338001230 con 0x55c02f8d76e0 2024-09-15T23:14:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.918+0000 7fc324ff9640 1 -- 172.21.15.123:0/204591960 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33800cce0 con 0x55c02f8d76e0 2024-09-15T23:14:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.919+0000 7fc348606740 1 -- 172.21.15.123:0/204591960 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c02f8d76e0 msgr2=0x55c02f8db990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.919+0000 7fc348606740 1 --2- 172.21.15.123:0/204591960 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c02f8d76e0 0x55c02f8db990 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc33800cba0 tx=0x7fc33801d000 comp rx=0 tx=0).stop 2024-09-15T23:14:56.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.919+0000 7fc348606740 1 -- 172.21.15.123:0/204591960 shutdown_connections 2024-09-15T23:14:56.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.919+0000 7fc348606740 1 --2- 172.21.15.123:0/204591960 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c02f8d76e0 0x55c02f8db990 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.919+0000 7fc348606740 1 --2- 172.21.15.123:0/204591960 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c02f89c7e0 0x55c02f8db450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.919+0000 7fc348606740 1 --2- 172.21.15.123:0/204591960 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c02f899fa0 0x55c02f8e1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.919+0000 7fc348606740 1 -- 172.21.15.123:0/204591960 >> 172.21.15.123:0/204591960 conn(0x55c02f897ee0 msgr2=0x55c02f8df6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:56.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.919+0000 7fc348606740 1 -- 172.21.15.123:0/204591960 shutdown_connections 2024-09-15T23:14:56.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.919+0000 7fc348606740 1 -- 172.21.15.123:0/204591960 wait complete. 2024-09-15T23:14:56.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.919+0000 7fc348606740 1 -- start start 2024-09-15T23:14:56.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.919+0000 7fc348606740 1 Processor -- start 2024-09-15T23:14:56.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.920+0000 7fc348606740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c02f899fa0 0x55c02f95f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.920+0000 7fc348606740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c02f89c7e0 0x55c02f9633b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.920+0000 7fc348606740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c02f8d76e0 0x55c02f9638f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.920+0000 7fc348606740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55c02f8d9310 con 0x55c02f8d76e0 2024-09-15T23:14:56.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.920+0000 7fc348606740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc34015b9a0 con 0x55c02f899fa0 2024-09-15T23:14:56.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.920+0000 7fc348606740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55c02f8b28d0 con 0x55c02f89c7e0 2024-09-15T23:14:56.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.920+0000 7fc348606740 10 client.0 _ll_register_callbacks cb 0x7fc3340764d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:56.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.920+0000 7fc33f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c02f8d76e0 0x55c02f9638f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.920+0000 7fc33f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c02f8d76e0 0x55c02f9638f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45438/0 (socket says 172.21.15.123:45438) 2024-09-15T23:14:56.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.920+0000 7fc33f7fe640 1 -- 172.21.15.123:0/211973877 learned_addr learned my addr 172.21.15.123:0/211973877 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:56.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.920+0000 7fc33effd640 1 --2- 172.21.15.123:0/211973877 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c02f899fa0 0x55c02f95f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.920+0000 7fc33e7fc640 1 --2- 172.21.15.123:0/211973877 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c02f89c7e0 0x55c02f9633b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.920+0000 7fc33f7fe640 1 -- 172.21.15.123:0/211973877 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c02f89c7e0 msgr2=0x55c02f9633b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.920+0000 7fc33f7fe640 1 --2- 172.21.15.123:0/211973877 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c02f89c7e0 0x55c02f9633b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.920+0000 7fc33f7fe640 1 -- 172.21.15.123:0/211973877 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c02f899fa0 msgr2=0x55c02f95f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:56.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.920+0000 7fc33f7fe640 1 --2- 172.21.15.123:0/211973877 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c02f899fa0 0x55c02f95f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.920+0000 7fc33f7fe640 1 -- 172.21.15.123:0/211973877 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c02f8e0640 con 0x55c02f8d76e0 2024-09-15T23:14:56.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.920+0000 7fc33e7fc640 1 --2- 172.21.15.123:0/211973877 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c02f89c7e0 0x55c02f9633b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:56.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.921+0000 7fc33f7fe640 1 --2- 172.21.15.123:0/211973877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c02f8d76e0 0x55c02f9638f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc338000f90 tx=0x7fc338007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae30e3685e82f593 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:56.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.921+0000 7fc31e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:56.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.921+0000 7fc31e7fc640 1 -- 172.21.15.123:0/211973877 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3380035f0 con 0x55c02f8d76e0 2024-09-15T23:14:56.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.921+0000 7fc31e7fc640 1 -- 172.21.15.123:0/211973877 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7fc338003790 con 0x55c02f8d76e0 2024-09-15T23:14:56.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.921+0000 7fc348606740 1 -- 172.21.15.123:0/211973877 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc338001230 con 0x55c02f8d76e0 2024-09-15T23:14:56.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.921+0000 7fc31e7fc640 1 -- 172.21.15.123:0/211973877 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc338044050 con 0x55c02f8d76e0 2024-09-15T23:14:56.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.921+0000 7fc348606740 10 client.5865 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:56.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.921+0000 7fc348606740 1 -- 172.21.15.123:0/211973877 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55c02f8d4b20 con 0x55c02f8d76e0 2024-09-15T23:14:56.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.921+0000 7fc31e7fc640 1 -- 172.21.15.123:0/211973877 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc338001230 con 0x55c02f8d76e0 2024-09-15T23:14:56.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.921+0000 7fc31e7fc640 1 -- 172.21.15.123:0/211973877 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7fc338047020 con 0x55c02f8d76e0 2024-09-15T23:14:56.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.921+0000 7fc348606740 10 client.5865 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:56.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.921+0000 7fc348606740 10 client.5865 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:56.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.921+0000 7fc348606740 20 client.5865 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:56.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.921+0000 7fc348606740 1 --2- 172.21.15.123:0/211973877 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55c02f8e2a50 0x55c02f8967a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:56.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.921+0000 7fc348606740 4 client.5865 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_1"}] 2024-09-15T23:14:56.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.921+0000 7fc348606740 1 -- 172.21.15.123:0/211973877 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_dir_1"}) -- 0x55c02f807190 con 0x55c02f8e2a50 2024-09-15T23:14:56.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.921+0000 7fc33effd640 1 --2- 172.21.15.123:0/211973877 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55c02f8e2a50 0x55c02f8967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:56.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.922+0000 7fc33effd640 1 --2- 172.21.15.123:0/211973877 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55c02f8e2a50 0x55c02f8967a0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5954d0fbb976bf13 server_cookie=d18f978f0e1363c8 in_seq=0 out_seq=0 2024-09-15T23:14:56.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.922+0000 7fc31e7fc640 10 client.5865 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:56.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.926+0000 7fc31e7fc640 1 -- 172.21.15.123:0/211973877 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c02f807190 con 0x55c02f8e2a50 2024-09-15T23:14:56.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.926+0000 7fc31e7fc640 10 client.5865 handle_command_reply: tid=0 2024-09-15T23:14:56.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.926+0000 7fc348606740 1 client.5865 shutdown 2024-09-15T23:14:56.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.927+0000 7fc348606740 1 -- 172.21.15.123:0/211973877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c02f8d76e0 msgr2=0x55c02f9638f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.927+0000 7fc348606740 1 --2- 172.21.15.123:0/211973877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c02f8d76e0 0x55c02f9638f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc338000f90 tx=0x7fc338007d90 comp rx=0 tx=0).stop 2024-09-15T23:14:56.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.927+0000 7fc348606740 1 -- 172.21.15.123:0/211973877 shutdown_connections 2024-09-15T23:14:56.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.927+0000 7fc348606740 1 --2- 172.21.15.123:0/211973877 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55c02f8e2a50 0x55c02f8967a0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.927+0000 7fc348606740 1 --2- 172.21.15.123:0/211973877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c02f8d76e0 0x55c02f9638f0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.927+0000 7fc348606740 1 --2- 172.21.15.123:0/211973877 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c02f89c7e0 0x55c02f9633b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.927+0000 7fc31e7fc640 0 client.5865 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:56.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.927+0000 7fc348606740 1 --2- 172.21.15.123:0/211973877 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c02f899fa0 0x55c02f95f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.927+0000 7fc348606740 1 -- 172.21.15.123:0/211973877 >> 172.21.15.123:0/211973877 conn(0x55c02f897ee0 msgr2=0x55c02f8dfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:56.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.927+0000 7fc348606740 1 -- 172.21.15.123:0/211973877 shutdown_connections 2024-09-15T23:14:56.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.927+0000 7fc348606740 1 -- 172.21.15.123:0/211973877 wait complete. 2024-09-15T23:14:56.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.927+0000 7fc348606740 20 client.5865 trim_cache size 0 max 16384 2024-09-15T23:14:56.930 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:14:56.930 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "", 2024-09-15T23:14:56.930 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0 2024-09-15T23:14:56.930 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:14:56.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.927+0000 7fc345865640 1 -- 172.21.15.123:0/3706347273 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc32c06c2b0 msgr2=0x7fc32c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.927+0000 7fc345865640 1 --2- 172.21.15.123:0/3706347273 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc32c06c2b0 0x7fc32c06e770 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc330007fd0 tx=0x7fc330007d40 comp rx=0 tx=0).stop 2024-09-15T23:14:56.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.927+0000 7fc345865640 1 -- 172.21.15.123:0/3706347273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3400b5520 msgr2=0x7fc340070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:56.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.927+0000 7fc345865640 1 --2- 172.21.15.123:0/3706347273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3400b5520 0x7fc340070b10 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc334035040 tx=0x7fc3340046c0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.927+0000 7fc345865640 1 -- 172.21.15.123:0/3706347273 shutdown_connections 2024-09-15T23:14:56.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.927+0000 7fc345865640 1 --2- 172.21.15.123:0/3706347273 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc34015e990 0x7fc3400d11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.927+0000 7fc345865640 1 --2- 172.21.15.123:0/3706347273 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc32c06c2b0 0x7fc32c06e770 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.927+0000 7fc345865640 1 --2- 172.21.15.123:0/3706347273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3400b5520 0x7fc340070b10 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.927+0000 7fc345865640 1 --2- 172.21.15.123:0/3706347273 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc34006d260 0x7fc3401e8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:56.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.927+0000 7fc345865640 1 -- 172.21.15.123:0/3706347273 >> 172.21.15.123:0/3706347273 conn(0x7fc3400d25d0 msgr2=0x7fc3400b5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:56.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.927+0000 7fc345865640 1 -- 172.21.15.123:0/3706347273 shutdown_connections 2024-09-15T23:14:56.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:56.927+0000 7fc345865640 1 -- 172.21.15.123:0/3706347273 wait complete. 2024-09-15T23:14:56.939 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_1' returned '{'message': '', 'return_code': 0}' 2024-09-15T23:14:56.939 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:14:56.939 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:14:56.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:14:56.955 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_1 bs=1M conv=fdatasync count=1 seek=0) 2024-09-15T23:14:57.022 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:14:57.022 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:14:57.022 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00827442 s, 127 MB/s 2024-09-15T23:14:57.022 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_1' 2024-09-15T23:14:57.022 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path /scrub_test_path/ceph-qa-suite/new_file_1 2024-09-15T23:14:57.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.165+0000 7f6d25f86640 1 Processor -- start 2024-09-15T23:14:57.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.165+0000 7f6d25f86640 1 -- start start 2024-09-15T23:14:57.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.166+0000 7f6d25f86640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6d2015e990 0x7f6d2015ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.166+0000 7f6d25f86640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f6d200b5520 0x7f6d2006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.166+0000 7f6d25f86640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d2015f2b0 con 0x7f6d2006d260 2024-09-15T23:14:57.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.166+0000 7f6d25f86640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f6d2015f550 con 0x7f6d2015e990 2024-09-15T23:14:57.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.166+0000 7f6d25f86640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f6d2015f830 con 0x7f6d200b5520 2024-09-15T23:14:57.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.166+0000 7f6d1f7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6d2015e990 0x7f6d2015ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.166+0000 7f6d1f7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6d2015e990 0x7f6d2015ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45446/0 (socket says 172.21.15.123:45446) 2024-09-15T23:14:57.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.166+0000 7f6d1f7fe640 1 -- 172.21.15.123:0/2974760971 learned_addr learned my addr 172.21.15.123:0/2974760971 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:57.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.166+0000 7f6d1f7fe640 1 -- 172.21.15.123:0/2974760971 >> v2:172.21.15.188:3300/0 conn(0x7f6d200b5520 msgr2=0x7f6d2006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.166+0000 7f6d1f7fe640 1 --2- 172.21.15.123:0/2974760971 >> v2:172.21.15.188:3300/0 conn(0x7f6d200b5520 0x7f6d2006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.166+0000 7f6d1f7fe640 1 -- 172.21.15.123:0/2974760971 >> v1:172.21.15.188:6789/0 conn(0x7f6d2006d260 legacy=0x7f6d20162a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.166+0000 7f6d1f7fe640 1 -- 172.21.15.123:0/2974760971 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d2015fb10 con 0x7f6d2015e990 2024-09-15T23:14:57.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.167+0000 7f6d1f7fe640 1 --2- 172.21.15.123:0/2974760971 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d2015e990 0x7f6d2015ed70 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f6d200d24e0 tx=0x7f6d1002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf7ced8467aadb1f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:57.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.167+0000 7f6d1e7fc640 1 -- 172.21.15.123:0/2974760971 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d10037070 con 0x7f6d2015e990 2024-09-15T23:14:57.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.167+0000 7f6d1e7fc640 1 -- 172.21.15.123:0/2974760971 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d10032440 con 0x7f6d2015e990 2024-09-15T23:14:57.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.167+0000 7f6d1e7fc640 1 -- 172.21.15.123:0/2974760971 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d10032810 con 0x7f6d2015e990 2024-09-15T23:14:57.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.168+0000 7f6d25f86640 1 -- 172.21.15.123:0/2974760971 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d2015e990 msgr2=0x7f6d2015ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.168+0000 7f6d25f86640 1 --2- 172.21.15.123:0/2974760971 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d2015e990 0x7f6d2015ed70 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f6d200d24e0 tx=0x7f6d1002a230 comp rx=0 tx=0).stop 2024-09-15T23:14:57.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.168+0000 7f6d25f86640 1 -- 172.21.15.123:0/2974760971 shutdown_connections 2024-09-15T23:14:57.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.168+0000 7f6d25f86640 1 --2- 172.21.15.123:0/2974760971 >> v2:172.21.15.188:3300/0 conn(0x7f6d200b5520 0x7f6d2006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.168+0000 7f6d25f86640 1 --2- 172.21.15.123:0/2974760971 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d2015e990 0x7f6d2015ed70 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.168+0000 7f6d25f86640 1 -- 172.21.15.123:0/2974760971 >> 172.21.15.123:0/2974760971 conn(0x7f6d200d25d0 msgr2=0x7f6d200d29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:57.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.168+0000 7f6d25f86640 1 -- 172.21.15.123:0/2974760971 shutdown_connections 2024-09-15T23:14:57.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.168+0000 7f6d25f86640 1 -- 172.21.15.123:0/2974760971 wait complete. 2024-09-15T23:14:57.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.169+0000 7f6d25f86640 1 Processor -- start 2024-09-15T23:14:57.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.169+0000 7f6d25f86640 1 -- start start 2024-09-15T23:14:57.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.170+0000 7f6d25f86640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d2006d260 0x7f6d2014f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.170+0000 7f6d25f86640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6d200b5520 0x7f6d201f4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.170+0000 7f6d25f86640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6d2015e990 0x7f6d2015d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.170+0000 7f6d25f86640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6d20163290 con 0x7f6d2006d260 2024-09-15T23:14:57.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.170+0000 7f6d25f86640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6d20163110 con 0x7f6d2015e990 2024-09-15T23:14:57.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.170+0000 7f6d25f86640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6d200b6ff0 con 0x7f6d200b5520 2024-09-15T23:14:57.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.170+0000 7f6d1f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d2006d260 0x7f6d2014f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.170+0000 7f6d1f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d2006d260 0x7f6d2014f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45448/0 (socket says 172.21.15.123:45448) 2024-09-15T23:14:57.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.170+0000 7f6d1f7fe640 1 -- 172.21.15.123:0/2984168344 learned_addr learned my addr 172.21.15.123:0/2984168344 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:57.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.170+0000 7f6d1effd640 1 --2- 172.21.15.123:0/2984168344 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6d200b5520 0x7f6d201f4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.170+0000 7f6d1ffff640 1 --2- 172.21.15.123:0/2984168344 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6d2015e990 0x7f6d2015d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.170+0000 7f6d1f7fe640 1 -- 172.21.15.123:0/2984168344 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6d200b5520 msgr2=0x7f6d201f4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.170+0000 7f6d1f7fe640 1 --2- 172.21.15.123:0/2984168344 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6d200b5520 0x7f6d201f4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.170+0000 7f6d1f7fe640 1 -- 172.21.15.123:0/2984168344 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6d2015e990 msgr2=0x7f6d2015d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.170+0000 7f6d1f7fe640 1 --2- 172.21.15.123:0/2984168344 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6d2015e990 0x7f6d2015d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.170+0000 7f6d1f7fe640 1 -- 172.21.15.123:0/2984168344 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d200d07f0 con 0x7f6d2006d260 2024-09-15T23:14:57.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.170+0000 7f6d1ffff640 1 --2- 172.21.15.123:0/2984168344 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6d2015e990 0x7f6d2015d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:57.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.170+0000 7f6d1effd640 1 --2- 172.21.15.123:0/2984168344 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6d200b5520 0x7f6d201f4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:57.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.170+0000 7f6d1f7fe640 1 --2- 172.21.15.123:0/2984168344 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d2006d260 0x7f6d2014f150 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f6d1002a270 tx=0x7f6d100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:57.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.171+0000 7f6d07fff640 1 -- 172.21.15.123:0/2984168344 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d10037040 con 0x7f6d2006d260 2024-09-15T23:14:57.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.171+0000 7f6d07fff640 1 -- 172.21.15.123:0/2984168344 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d10042070 con 0x7f6d2006d260 2024-09-15T23:14:57.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.171+0000 7f6d25f86640 1 -- 172.21.15.123:0/2984168344 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d200d0ad0 con 0x7f6d2006d260 2024-09-15T23:14:57.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.171+0000 7f6d07fff640 1 -- 172.21.15.123:0/2984168344 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d10030bb0 con 0x7f6d2006d260 2024-09-15T23:14:57.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.171+0000 7f6d25f86640 1 -- 172.21.15.123:0/2984168344 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d200d1090 con 0x7f6d2006d260 2024-09-15T23:14:57.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.172+0000 7f6d07fff640 1 -- 172.21.15.123:0/2984168344 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6d10047460 con 0x7f6d2006d260 2024-09-15T23:14:57.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.173+0000 7f6d07fff640 1 --2- 172.21.15.123:0/2984168344 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6d0c06c2b0 0x7f6d0c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.173+0000 7f6d07fff640 1 -- 172.21.15.123:0/2984168344 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7f6d100ac130 con 0x7f6d2006d260 2024-09-15T23:14:57.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.173+0000 7f6d1effd640 1 --2- 172.21.15.123:0/2984168344 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6d0c06c2b0 0x7f6d0c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.173+0000 7f6d1effd640 1 --2- 172.21.15.123:0/2984168344 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6d0c06c2b0 0x7f6d0c06e770 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6d201f7bc0 tx=0x7f6d14008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:57.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.174+0000 7f6d28df7740 1 Processor -- start 2024-09-15T23:14:57.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.174+0000 7f6d28df7740 1 -- start start 2024-09-15T23:14:57.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.174+0000 7f6d28df7740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55811e5e07e0 0x55811e5e0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.174+0000 7f6d28df7740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55811e5dbee0 0x55811e5dadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.174+0000 7f6d28df7740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55811e5ddfa0 0x55811e5db310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.174+0000 7f6d28df7740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55811e543710 con 0x55811e5e07e0 2024-09-15T23:14:57.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.174+0000 7f6d28df7740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55811e4eb540 con 0x55811e5dbee0 2024-09-15T23:14:57.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.174+0000 7f6d28df7740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55811e53f6d0 con 0x55811e5ddfa0 2024-09-15T23:14:57.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.175+0000 7f6d1f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55811e5e07e0 0x55811e5e0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.175+0000 7f6d1f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55811e5e07e0 0x55811e5e0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45456/0 (socket says 172.21.15.123:45456) 2024-09-15T23:14:57.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.175+0000 7f6d1f7fe640 1 -- 172.21.15.123:0/3785315749 learned_addr learned my addr 172.21.15.123:0/3785315749 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:57.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.175+0000 7f6d1effd640 1 --2- 172.21.15.123:0/3785315749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55811e5dbee0 0x55811e5dadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.175+0000 7f6d1ffff640 1 --2- 172.21.15.123:0/3785315749 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55811e5ddfa0 0x55811e5db310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.175+0000 7f6d1f7fe640 1 -- 172.21.15.123:0/3785315749 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55811e5ddfa0 msgr2=0x55811e5db310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.175+0000 7f6d1f7fe640 1 --2- 172.21.15.123:0/3785315749 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55811e5ddfa0 0x55811e5db310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.175+0000 7f6d1f7fe640 1 -- 172.21.15.123:0/3785315749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55811e5dbee0 msgr2=0x55811e5dadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.175+0000 7f6d1f7fe640 1 --2- 172.21.15.123:0/3785315749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55811e5dbee0 0x55811e5dadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.175+0000 7f6d1f7fe640 1 -- 172.21.15.123:0/3785315749 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55811e511170 con 0x55811e5e07e0 2024-09-15T23:14:57.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.175+0000 7f6d1f7fe640 1 --2- 172.21.15.123:0/3785315749 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55811e5e07e0 0x55811e5e0bc0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6d100765e0 tx=0x7f6d10079ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=676365bb3fcbcb59 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:57.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.175+0000 7f6d057fa640 1 -- 172.21.15.123:0/3785315749 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d100921c0 con 0x55811e5e07e0 2024-09-15T23:14:57.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.175+0000 7f6d057fa640 1 -- 172.21.15.123:0/3785315749 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d1007e530 con 0x55811e5e07e0 2024-09-15T23:14:57.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.175+0000 7f6d057fa640 1 -- 172.21.15.123:0/3785315749 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d10082d60 con 0x55811e5e07e0 2024-09-15T23:14:57.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.176+0000 7f6d28df7740 1 -- 172.21.15.123:0/3785315749 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55811e5e07e0 msgr2=0x55811e5e0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.176+0000 7f6d28df7740 1 --2- 172.21.15.123:0/3785315749 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55811e5e07e0 0x55811e5e0bc0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6d100765e0 tx=0x7f6d10079ba0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.176+0000 7f6d28df7740 1 -- 172.21.15.123:0/3785315749 shutdown_connections 2024-09-15T23:14:57.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.176+0000 7f6d28df7740 1 --2- 172.21.15.123:0/3785315749 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55811e5ddfa0 0x55811e5db310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.176+0000 7f6d28df7740 1 --2- 172.21.15.123:0/3785315749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55811e5dbee0 0x55811e5dadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.176+0000 7f6d28df7740 1 --2- 172.21.15.123:0/3785315749 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55811e5e07e0 0x55811e5e0bc0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.176+0000 7f6d28df7740 1 -- 172.21.15.123:0/3785315749 >> 172.21.15.123:0/3785315749 conn(0x55811e5dcfa0 msgr2=0x55811e625660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:57.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.176+0000 7f6d28df7740 1 -- 172.21.15.123:0/3785315749 shutdown_connections 2024-09-15T23:14:57.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.176+0000 7f6d28df7740 1 -- 172.21.15.123:0/3785315749 wait complete. 2024-09-15T23:14:57.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.176+0000 7f6d28df7740 1 -- start start 2024-09-15T23:14:57.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.176+0000 7f6d28df7740 1 Processor -- start 2024-09-15T23:14:57.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.177+0000 7f6d28df7740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55811e5ddfa0 0x55811e61c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.177+0000 7f6d28df7740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55811e5e07e0 0x55811e635590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.177+0000 7f6d28df7740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55811e639e20 0x55811e6391d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.177+0000 7f6d28df7740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55811e543710 con 0x55811e5e07e0 2024-09-15T23:14:57.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.177+0000 7f6d28df7740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55811e4cc660 con 0x55811e639e20 2024-09-15T23:14:57.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.177+0000 7f6d28df7740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55811e60b070 con 0x55811e5ddfa0 2024-09-15T23:14:57.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.177+0000 7f6d28df7740 10 client.0 _ll_register_callbacks cb 0x55811e255fa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:57.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.177+0000 7f6d1effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55811e5e07e0 0x55811e635590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.177+0000 7f6d1effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55811e5e07e0 0x55811e635590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45464/0 (socket says 172.21.15.123:45464) 2024-09-15T23:14:57.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.177+0000 7f6d1effd640 1 -- 172.21.15.123:0/3959618981 learned_addr learned my addr 172.21.15.123:0/3959618981 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:57.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.177+0000 7f6d1f7fe640 1 --2- 172.21.15.123:0/3959618981 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55811e5ddfa0 0x55811e61c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.177+0000 7f6d1ffff640 1 --2- 172.21.15.123:0/3959618981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55811e639e20 0x55811e6391d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.178+0000 7f6d1effd640 1 -- 172.21.15.123:0/3959618981 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55811e5ddfa0 msgr2=0x55811e61c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.178+0000 7f6d1effd640 1 --2- 172.21.15.123:0/3959618981 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55811e5ddfa0 0x55811e61c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.178+0000 7f6d1effd640 1 -- 172.21.15.123:0/3959618981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55811e639e20 msgr2=0x55811e6391d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.178+0000 7f6d1effd640 1 --2- 172.21.15.123:0/3959618981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55811e639e20 0x55811e6391d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.178+0000 7f6d1effd640 1 -- 172.21.15.123:0/3959618981 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55811e2567b0 con 0x55811e5e07e0 2024-09-15T23:14:57.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.178+0000 7f6d1ffff640 1 --2- 172.21.15.123:0/3959618981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55811e639e20 0x55811e6391d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:57.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.178+0000 7f6d1effd640 1 --2- 172.21.15.123:0/3959618981 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55811e5e07e0 0x55811e635590 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f6d1400ded0 tx=0x7f6d140047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0b3956a99620670 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:57.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.178+0000 7f6cfe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:57.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.178+0000 7f6cfe7fc640 1 -- 172.21.15.123:0/3959618981 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d14024020 con 0x55811e5e07e0 2024-09-15T23:14:57.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.178+0000 7f6cfe7fc640 1 -- 172.21.15.123:0/3959618981 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7f6d1400f040 con 0x55811e5e07e0 2024-09-15T23:14:57.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.178+0000 7f6d28df7740 1 -- 172.21.15.123:0/3959618981 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d1007e530 con 0x55811e5e07e0 2024-09-15T23:14:57.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.178+0000 7f6cfe7fc640 1 -- 172.21.15.123:0/3959618981 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6d1402e050 con 0x55811e5e07e0 2024-09-15T23:14:57.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.178+0000 7f6d28df7740 10 client.5877 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:57.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.178+0000 7f6d28df7740 1 -- 172.21.15.123:0/3959618981 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55811e320b90 con 0x55811e5e07e0 2024-09-15T23:14:57.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.178+0000 7f6cfe7fc640 1 -- 172.21.15.123:0/3959618981 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d1007e530 con 0x55811e5e07e0 2024-09-15T23:14:57.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.178+0000 7f6cfe7fc640 1 -- 172.21.15.123:0/3959618981 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f6d14031020 con 0x55811e5e07e0 2024-09-15T23:14:57.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.178+0000 7f6d28df7740 10 client.5877 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:57.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.178+0000 7f6d28df7740 10 client.5877 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:57.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.178+0000 7f6d28df7740 20 client.5877 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:57.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.178+0000 7f6d28df7740 1 --2- 172.21.15.123:0/3959618981 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55811e5f2f00 0x55811e5f3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.178+0000 7f6d28df7740 4 client.5877 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:14:57.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.178+0000 7f6d28df7740 1 -- 172.21.15.123:0/3959618981 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55811e550e40 con 0x55811e5f2f00 2024-09-15T23:14:57.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.179+0000 7f6d1f7fe640 1 --2- 172.21.15.123:0/3959618981 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55811e5f2f00 0x55811e5f3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.179+0000 7f6cfe7fc640 10 client.5877 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:57.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.179+0000 7f6d1f7fe640 1 --2- 172.21.15.123:0/3959618981 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55811e5f2f00 0x55811e5f3330 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d5f22aa2c3eab29 server_cookie=95b354668a093e3a in_seq=0 out_seq=0 2024-09-15T23:14:57.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.180+0000 7f6cfe7fc640 1 -- 172.21.15.123:0/3959618981 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55811e550e40 con 0x55811e5f2f00 2024-09-15T23:14:57.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.180+0000 7f6cfe7fc640 10 client.5877 handle_command_reply: tid=0 2024-09-15T23:14:57.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.180+0000 7f6d28df7740 1 client.5877 shutdown 2024-09-15T23:14:57.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.180+0000 7f6d28df7740 1 -- 172.21.15.123:0/3959618981 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55811e5e07e0 msgr2=0x55811e635590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.180+0000 7f6d28df7740 1 --2- 172.21.15.123:0/3959618981 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55811e5e07e0 0x55811e635590 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f6d1400ded0 tx=0x7f6d140047d0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.180+0000 7f6d28df7740 1 -- 172.21.15.123:0/3959618981 shutdown_connections 2024-09-15T23:14:57.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.180+0000 7f6d28df7740 1 --2- 172.21.15.123:0/3959618981 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55811e5f2f00 0x55811e5f3330 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.180+0000 7f6d28df7740 1 --2- 172.21.15.123:0/3959618981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55811e639e20 0x55811e6391d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.180+0000 7f6d28df7740 1 --2- 172.21.15.123:0/3959618981 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55811e5e07e0 0x55811e635590 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.180+0000 7f6d28df7740 1 --2- 172.21.15.123:0/3959618981 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55811e5ddfa0 0x55811e61c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.180+0000 7f6cfe7fc640 0 client.5877 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:57.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.180+0000 7f6d28df7740 1 -- 172.21.15.123:0/3959618981 >> 172.21.15.123:0/3959618981 conn(0x55811e5dbee0 msgr2=0x55811e627440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:57.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.180+0000 7f6d28df7740 1 -- 172.21.15.123:0/3959618981 shutdown_connections 2024-09-15T23:14:57.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.180+0000 7f6d28df7740 1 -- 172.21.15.123:0/3959618981 wait complete. 2024-09-15T23:14:57.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.180+0000 7f6d28df7740 20 client.5877 trim_cache size 0 max 16384 2024-09-15T23:14:57.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.194+0000 7f6d28df7740 1 Processor -- start 2024-09-15T23:14:57.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.194+0000 7f6d28df7740 1 -- start start 2024-09-15T23:14:57.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.195+0000 7f6d28df7740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55811e5ddfa0 0x55811e5f1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.195+0000 7f6d28df7740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55811e5e07e0 0x55811e625000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.195+0000 7f6d28df7740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55811e5de540 0x55811e625540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.195+0000 7f6d28df7740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6d20201010 con 0x55811e5ddfa0 2024-09-15T23:14:57.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.195+0000 7f6d28df7740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6d20200070 con 0x55811e5e07e0 2024-09-15T23:14:57.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.195+0000 7f6d28df7740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6d200cfcd0 con 0x55811e5de540 2024-09-15T23:14:57.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.195+0000 7f6d1f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55811e5ddfa0 0x55811e5f1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.195+0000 7f6d1f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55811e5ddfa0 0x55811e5f1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45476/0 (socket says 172.21.15.123:45476) 2024-09-15T23:14:57.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.195+0000 7f6d1f7fe640 1 -- 172.21.15.123:0/1853775697 learned_addr learned my addr 172.21.15.123:0/1853775697 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:57.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.195+0000 7f6d1f7fe640 1 -- 172.21.15.123:0/1853775697 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55811e5de540 msgr2=0x55811e625540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.195+0000 7f6d1f7fe640 1 --2- 172.21.15.123:0/1853775697 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55811e5de540 0x55811e625540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.195+0000 7f6d1effd640 1 --2- 172.21.15.123:0/1853775697 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55811e5e07e0 0x55811e625000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.195+0000 7f6d1f7fe640 1 -- 172.21.15.123:0/1853775697 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55811e5e07e0 msgr2=0x55811e625000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.195+0000 7f6d1f7fe640 1 --2- 172.21.15.123:0/1853775697 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55811e5e07e0 0x55811e625000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.195+0000 7f6d1f7fe640 1 -- 172.21.15.123:0/1853775697 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55811e5f23f0 con 0x55811e5ddfa0 2024-09-15T23:14:57.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.195+0000 7f6d1effd640 1 --2- 172.21.15.123:0/1853775697 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55811e5e07e0 0x55811e625000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:57.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.195+0000 7f6d1f7fe640 1 --2- 172.21.15.123:0/1853775697 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55811e5ddfa0 0x55811e5f1eb0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f6d1007a110 tx=0x7f6d10079c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7856cb63b32cba97 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:57.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.196+0000 7f6d04ff9640 1 -- 172.21.15.123:0/1853775697 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d100a7070 con 0x55811e5ddfa0 2024-09-15T23:14:57.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.196+0000 7f6d04ff9640 1 -- 172.21.15.123:0/1853775697 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d100921c0 con 0x55811e5ddfa0 2024-09-15T23:14:57.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.196+0000 7f6d04ff9640 1 -- 172.21.15.123:0/1853775697 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d10082d60 con 0x55811e5ddfa0 2024-09-15T23:14:57.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.196+0000 7f6d28df7740 1 -- 172.21.15.123:0/1853775697 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55811e5ddfa0 msgr2=0x55811e5f1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.196+0000 7f6d28df7740 1 --2- 172.21.15.123:0/1853775697 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55811e5ddfa0 0x55811e5f1eb0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f6d1007a110 tx=0x7f6d10079c10 comp rx=0 tx=0).stop 2024-09-15T23:14:57.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.196+0000 7f6d28df7740 1 -- 172.21.15.123:0/1853775697 shutdown_connections 2024-09-15T23:14:57.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.196+0000 7f6d28df7740 1 --2- 172.21.15.123:0/1853775697 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55811e5de540 0x55811e625540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.196+0000 7f6d28df7740 1 --2- 172.21.15.123:0/1853775697 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55811e5e07e0 0x55811e625000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.196+0000 7f6d28df7740 1 --2- 172.21.15.123:0/1853775697 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55811e5ddfa0 0x55811e5f1eb0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.196+0000 7f6d28df7740 1 -- 172.21.15.123:0/1853775697 >> 172.21.15.123:0/1853775697 conn(0x55811e5dbee0 msgr2=0x55811e61c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:57.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.196+0000 7f6d28df7740 1 -- 172.21.15.123:0/1853775697 shutdown_connections 2024-09-15T23:14:57.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.196+0000 7f6d28df7740 1 -- 172.21.15.123:0/1853775697 wait complete. 2024-09-15T23:14:57.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.197+0000 7f6d28df7740 1 -- start start 2024-09-15T23:14:57.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.197+0000 7f6d28df7740 1 Processor -- start 2024-09-15T23:14:57.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.198+0000 7f6d28df7740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55811e5ddfa0 0x55811e6a4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.198+0000 7f6d28df7740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55811e5de540 0x55811e633b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.198+0000 7f6d28df7740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55811e5e07e0 0x55811e622940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.198+0000 7f6d28df7740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55811e5dc3f0 con 0x55811e5ddfa0 2024-09-15T23:14:57.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.198+0000 7f6d28df7740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6d200b2790 con 0x55811e5de540 2024-09-15T23:14:57.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.198+0000 7f6d28df7740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55811e4fb300 con 0x55811e5e07e0 2024-09-15T23:14:57.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.198+0000 7f6d28df7740 10 client.0 _ll_register_callbacks cb 0x7f6d140091c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:57.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.198+0000 7f6d1f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55811e5ddfa0 0x55811e6a4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.198+0000 7f6d1f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55811e5ddfa0 0x55811e6a4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45486/0 (socket says 172.21.15.123:45486) 2024-09-15T23:14:57.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.198+0000 7f6d1f7fe640 1 -- 172.21.15.123:0/25917684 learned_addr learned my addr 172.21.15.123:0/25917684 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:57.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.198+0000 7f6d1effd640 1 --2- 172.21.15.123:0/25917684 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55811e5de540 0x55811e633b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.198+0000 7f6d1ffff640 1 --2- 172.21.15.123:0/25917684 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55811e5e07e0 0x55811e622940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.198+0000 7f6d1f7fe640 1 -- 172.21.15.123:0/25917684 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55811e5e07e0 msgr2=0x55811e622940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.198+0000 7f6d1f7fe640 1 --2- 172.21.15.123:0/25917684 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55811e5e07e0 0x55811e622940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.198+0000 7f6d1f7fe640 1 -- 172.21.15.123:0/25917684 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55811e5de540 msgr2=0x55811e633b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.198+0000 7f6d1f7fe640 1 --2- 172.21.15.123:0/25917684 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55811e5de540 0x55811e633b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.198+0000 7f6d1f7fe640 1 -- 172.21.15.123:0/25917684 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55811e5f1aa0 con 0x55811e5ddfa0 2024-09-15T23:14:57.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.198+0000 7f6d1effd640 1 --2- 172.21.15.123:0/25917684 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55811e5de540 0x55811e633b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:57.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.198+0000 7f6d1f7fe640 1 --2- 172.21.15.123:0/25917684 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55811e5ddfa0 0x55811e6a4930 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f6d10009280 tx=0x7f6d10008070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a68f85e798c046 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:57.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.198+0000 7f6cfe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:57.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.198+0000 7f6cfe7fc640 1 -- 172.21.15.123:0/25917684 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d10098060 con 0x55811e5ddfa0 2024-09-15T23:14:57.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.198+0000 7f6cfe7fc640 1 -- 172.21.15.123:0/25917684 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7f6d10030d50 con 0x55811e5ddfa0 2024-09-15T23:14:57.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.198+0000 7f6d28df7740 1 -- 172.21.15.123:0/25917684 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55811e61d8d0 con 0x55811e5ddfa0 2024-09-15T23:14:57.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.198+0000 7f6cfe7fc640 1 -- 172.21.15.123:0/25917684 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6d100a7050 con 0x55811e5ddfa0 2024-09-15T23:14:57.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.198+0000 7f6d28df7740 10 client.5883 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:57.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.198+0000 7f6d28df7740 1 -- 172.21.15.123:0/25917684 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55811e5f1aa0 con 0x55811e5ddfa0 2024-09-15T23:14:57.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.199+0000 7f6cfe7fc640 1 -- 172.21.15.123:0/25917684 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55811e61d8d0 con 0x55811e5ddfa0 2024-09-15T23:14:57.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.199+0000 7f6cfe7fc640 1 -- 172.21.15.123:0/25917684 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f6d1003a030 con 0x55811e5ddfa0 2024-09-15T23:14:57.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.199+0000 7f6d28df7740 10 client.5883 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:57.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.199+0000 7f6d28df7740 10 client.5883 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:57.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.199+0000 7f6d28df7740 20 client.5883 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:57.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.199+0000 7f6d28df7740 1 --2- 172.21.15.123:0/25917684 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55811e5ee6c0 0x55811e637cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.199+0000 7f6d28df7740 4 client.5883 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}] 2024-09-15T23:14:57.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.199+0000 7f6d28df7740 1 -- 172.21.15.123:0/25917684 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "flush_path", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}) -- 0x55811e54b190 con 0x55811e5ee6c0 2024-09-15T23:14:57.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.199+0000 7f6d1effd640 1 --2- 172.21.15.123:0/25917684 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55811e5ee6c0 0x55811e637cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.199+0000 7f6cfe7fc640 10 client.5883 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:57.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.199+0000 7f6d1effd640 1 --2- 172.21.15.123:0/25917684 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55811e5ee6c0 0x55811e637cd0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74f04a8c439d324f server_cookie=6a9d15b0b3834c1f in_seq=0 out_seq=0 2024-09-15T23:14:57.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.204+0000 7f6cfe7fc640 1 -- 172.21.15.123:0/25917684 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55811e54b190 con 0x55811e5ee6c0 2024-09-15T23:14:57.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.204+0000 7f6cfe7fc640 10 client.5883 handle_command_reply: tid=0 2024-09-15T23:14:57.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.204+0000 7f6d28df7740 1 client.5883 shutdown 2024-09-15T23:14:57.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.204+0000 7f6d28df7740 1 -- 172.21.15.123:0/25917684 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55811e5ddfa0 msgr2=0x55811e6a4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.204+0000 7f6d28df7740 1 --2- 172.21.15.123:0/25917684 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55811e5ddfa0 0x55811e6a4930 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f6d10009280 tx=0x7f6d10008070 comp rx=0 tx=0).stop 2024-09-15T23:14:57.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.204+0000 7f6d28df7740 1 -- 172.21.15.123:0/25917684 shutdown_connections 2024-09-15T23:14:57.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.204+0000 7f6d28df7740 1 --2- 172.21.15.123:0/25917684 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55811e5ee6c0 0x55811e637cd0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.204+0000 7f6d28df7740 1 --2- 172.21.15.123:0/25917684 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55811e5e07e0 0x55811e622940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.204+0000 7f6d28df7740 1 --2- 172.21.15.123:0/25917684 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55811e5de540 0x55811e633b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.204+0000 7f6cfe7fc640 0 client.5883 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:57.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.204+0000 7f6d28df7740 1 --2- 172.21.15.123:0/25917684 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55811e5ddfa0 0x55811e6a4930 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.204+0000 7f6d28df7740 1 -- 172.21.15.123:0/25917684 >> 172.21.15.123:0/25917684 conn(0x55811e5dbee0 msgr2=0x55811e628ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:57.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.204+0000 7f6d28df7740 1 -- 172.21.15.123:0/25917684 shutdown_connections 2024-09-15T23:14:57.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.204+0000 7f6d28df7740 1 -- 172.21.15.123:0/25917684 wait complete. 2024-09-15T23:14:57.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.204+0000 7f6d28df7740 20 client.5883 trim_cache size 0 max 16384 2024-09-15T23:14:57.212 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:14:57.212 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "", 2024-09-15T23:14:57.213 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0 2024-09-15T23:14:57.213 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:14:57.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.204+0000 7f6d25f86640 1 -- 172.21.15.123:0/2984168344 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6d0c06c2b0 msgr2=0x7f6d0c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.204+0000 7f6d25f86640 1 --2- 172.21.15.123:0/2984168344 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6d0c06c2b0 0x7f6d0c06e770 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6d201f7bc0 tx=0x7f6d14008040 comp rx=0 tx=0).stop 2024-09-15T23:14:57.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.204+0000 7f6d25f86640 1 -- 172.21.15.123:0/2984168344 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d2006d260 msgr2=0x7f6d2014f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.204+0000 7f6d25f86640 1 --2- 172.21.15.123:0/2984168344 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d2006d260 0x7f6d2014f150 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f6d1002a270 tx=0x7f6d100046c0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.205+0000 7f6d25f86640 1 -- 172.21.15.123:0/2984168344 shutdown_connections 2024-09-15T23:14:57.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.205+0000 7f6d25f86640 1 --2- 172.21.15.123:0/2984168344 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6d2015e990 0x7f6d2015d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.205+0000 7f6d25f86640 1 --2- 172.21.15.123:0/2984168344 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6d200b5520 0x7f6d201f4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.205+0000 7f6d25f86640 1 --2- 172.21.15.123:0/2984168344 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6d0c06c2b0 0x7f6d0c06e770 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.205+0000 7f6d25f86640 1 --2- 172.21.15.123:0/2984168344 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d2006d260 0x7f6d2014f150 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.205+0000 7f6d25f86640 1 -- 172.21.15.123:0/2984168344 >> 172.21.15.123:0/2984168344 conn(0x7f6d200d25d0 msgr2=0x7f6d2015fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:57.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.205+0000 7f6d25f86640 1 -- 172.21.15.123:0/2984168344 shutdown_connections 2024-09-15T23:14:57.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.205+0000 7f6d25f86640 1 -- 172.21.15.123:0/2984168344 wait complete. 2024-09-15T23:14:57.217 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_1' returned '{'message': '', 'return_code': 0}' 2024-09-15T23:14:57.217 DEBUG:teuthology.orchestra.run.smithi123:> stdin-killer -- python3 -c ' 2024-09-15T23:14:57.217 DEBUG:teuthology.orchestra.run.smithi123:> import os 2024-09-15T23:14:57.217 DEBUG:teuthology.orchestra.run.smithi123:> import stat 2024-09-15T23:14:57.217 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-15T23:14:57.217 DEBUG:teuthology.orchestra.run.smithi123:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_1").st_ino) 2024-09-15T23:14:57.217 DEBUG:teuthology.orchestra.run.smithi123:> ' 2024-09-15T23:14:57.283 INFO:teuthology.orchestra.run.smithi123.stdout:1099511630414 2024-09-15T23:14:57.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:14:57.294 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-09-15T23:14:57.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.433+0000 7fe97f6f1640 1 Processor -- start 2024-09-15T23:14:57.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.433+0000 7fe97f6f1640 1 -- start start 2024-09-15T23:14:57.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.434+0000 7fe97f6f1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe97815b7c0 0x7fe9780b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.434+0000 7fe97f6f1640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe9780cead0 0x7fe978071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.434+0000 7fe97f6f1640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9780cf2e0 con 0x7fe9780ccf30 2024-09-15T23:14:57.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.434+0000 7fe97f6f1640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fe978070fe0 con 0x7fe9780cead0 2024-09-15T23:14:57.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.434+0000 7fe97f6f1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe9780712c0 con 0x7fe97815b7c0 2024-09-15T23:14:57.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.434+0000 7fe97d48d640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe9780ccf30 0x7fe9780cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54474/0 (socket says 172.21.15.123:54474) 2024-09-15T23:14:57.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.434+0000 7fe97d48d640 1 -- 172.21.15.123:0/779032538 learned_addr learned my addr 172.21.15.123:0/779032538 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:57.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.434+0000 7fe96ffff640 1 -- 172.21.15.123:0/779032538 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2338589278 0 0) 0x7fe9780cf2e0 con 0x7fe9780ccf30 2024-09-15T23:14:57.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.434+0000 7fe97dc8e640 1 --2- 172.21.15.123:0/779032538 >> v2:172.21.15.188:3300/0 conn(0x7fe9780cead0 0x7fe978071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.434+0000 7fe97cc8c640 1 --2- 172.21.15.123:0/779032538 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe97815b7c0 0x7fe9780b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.435+0000 7fe96ffff640 1 -- 172.21.15.123:0/779032538 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe964003520 con 0x7fe9780ccf30 2024-09-15T23:14:57.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.435+0000 7fe96ffff640 1 -- 172.21.15.123:0/779032538 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3220177979 0 0) 0x7fe964003520 con 0x7fe9780ccf30 2024-09-15T23:14:57.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.435+0000 7fe96ffff640 1 -- 172.21.15.123:0/779032538 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe97815b7c0 msgr2=0x7fe9780b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.435+0000 7fe96ffff640 1 --2- 172.21.15.123:0/779032538 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe97815b7c0 0x7fe9780b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.435+0000 7fe96ffff640 1 -- 172.21.15.123:0/779032538 >> v2:172.21.15.188:3300/0 conn(0x7fe9780cead0 msgr2=0x7fe978071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.435+0000 7fe96ffff640 1 --2- 172.21.15.123:0/779032538 >> v2:172.21.15.188:3300/0 conn(0x7fe9780cead0 0x7fe978071ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.435+0000 7fe96ffff640 1 -- 172.21.15.123:0/779032538 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9780715a0 con 0x7fe9780ccf30 2024-09-15T23:14:57.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.435+0000 7fe96ffff640 1 -- 172.21.15.123:0/779032538 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fe974001670 con 0x7fe9780ccf30 2024-09-15T23:14:57.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.435+0000 7fe96ffff640 1 -- 172.21.15.123:0/779032538 >> v1:172.21.15.123:6789/0 conn(0x7fe9780ccf30 legacy=0x7fe9780cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.435+0000 7fe96ffff640 1 --2- 172.21.15.123:0/779032538 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe9640039b0 0x7fe964003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.435+0000 7fe96ffff640 1 --2- 172.21.15.123:0/779032538 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe97815b7c0 0x7fe964004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.435+0000 7fe96ffff640 1 --2- 172.21.15.123:0/779032538 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe964004d40 0x7fe9640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.435+0000 7fe96ffff640 1 -- 172.21.15.123:0/779032538 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe978070fe0 con 0x7fe964004d40 2024-09-15T23:14:57.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.435+0000 7fe96ffff640 1 -- 172.21.15.123:0/779032538 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe9780712c0 con 0x7fe9640039b0 2024-09-15T23:14:57.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.435+0000 7fe96ffff640 1 -- 172.21.15.123:0/779032538 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe96400b9f0 con 0x7fe97815b7c0 2024-09-15T23:14:57.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.435+0000 7fe97dc8e640 1 --2- 172.21.15.123:0/779032538 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe964004d40 0x7fe9640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.435+0000 7fe97cc8c640 1 --2- 172.21.15.123:0/779032538 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe97815b7c0 0x7fe964004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.435+0000 7fe97d48d640 1 --2- 172.21.15.123:0/779032538 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe9640039b0 0x7fe964003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.435+0000 7fe97dc8e640 1 -- 172.21.15.123:0/779032538 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe97815b7c0 msgr2=0x7fe964004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.435+0000 7fe97dc8e640 1 --2- 172.21.15.123:0/779032538 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe97815b7c0 0x7fe964004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.435+0000 7fe97dc8e640 1 -- 172.21.15.123:0/779032538 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe9640039b0 msgr2=0x7fe964003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.435+0000 7fe97dc8e640 1 --2- 172.21.15.123:0/779032538 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe9640039b0 0x7fe964003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.435+0000 7fe97dc8e640 1 -- 172.21.15.123:0/779032538 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe964003520 con 0x7fe964004d40 2024-09-15T23:14:57.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.435+0000 7fe97d48d640 1 --2- 172.21.15.123:0/779032538 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe9640039b0 0x7fe964003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:57.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.436+0000 7fe97dc8e640 1 --2- 172.21.15.123:0/779032538 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe964004d40 0x7fe9640051c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fe970009fc0 tx=0x7fe964005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cee5c87b6416b2d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:57.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.436+0000 7fe96ffff640 1 -- 172.21.15.123:0/779032538 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe970009c10 con 0x7fe964004d40 2024-09-15T23:14:57.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.436+0000 7fe96ffff640 1 -- 172.21.15.123:0/779032538 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe970036070 con 0x7fe964004d40 2024-09-15T23:14:57.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.436+0000 7fe96ffff640 1 -- 172.21.15.123:0/779032538 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97002d070 con 0x7fe964004d40 2024-09-15T23:14:57.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.437+0000 7fe97f6f1640 1 -- 172.21.15.123:0/779032538 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe964004d40 msgr2=0x7fe9640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.437+0000 7fe97f6f1640 1 --2- 172.21.15.123:0/779032538 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe964004d40 0x7fe9640051c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fe970009fc0 tx=0x7fe964005830 comp rx=0 tx=0).stop 2024-09-15T23:14:57.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.437+0000 7fe97dc8e640 1 -- 172.21.15.123:0/779032538 reap_dead start 2024-09-15T23:14:57.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.437+0000 7fe97f6f1640 1 -- 172.21.15.123:0/779032538 shutdown_connections 2024-09-15T23:14:57.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.437+0000 7fe97f6f1640 1 -- 172.21.15.123:0/779032538 >> 172.21.15.123:0/779032538 conn(0x7fe97806d0f0 msgr2=0x7fe97806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:57.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.437+0000 7fe97f6f1640 1 -- 172.21.15.123:0/779032538 shutdown_connections 2024-09-15T23:14:57.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.437+0000 7fe97f6f1640 1 -- 172.21.15.123:0/779032538 wait complete. 2024-09-15T23:14:57.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.438+0000 7fe97f6f1640 1 Processor -- start 2024-09-15T23:14:57.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.438+0000 7fe97f6f1640 1 -- start start 2024-09-15T23:14:57.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.439+0000 7fe97f6f1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe964004d40 0x7fe978145bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.439+0000 7fe97f6f1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe9781461f0 0x7fe978148d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.439+0000 7fe97f6f1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe97814f380 0x7fe97814f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.439+0000 7fe97f6f1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe9780cf0c0 con 0x7fe964004d40 2024-09-15T23:14:57.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.439+0000 7fe97f6f1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe9780cef40 con 0x7fe97814f380 2024-09-15T23:14:57.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.439+0000 7fe97f6f1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe9780b2c50 con 0x7fe9781461f0 2024-09-15T23:14:57.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.439+0000 7fe97d48d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe964004d40 0x7fe978145bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.439+0000 7fe97d48d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe964004d40 0x7fe978145bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45506/0 (socket says 172.21.15.123:45506) 2024-09-15T23:14:57.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.439+0000 7fe97d48d640 1 -- 172.21.15.123:0/258340450 learned_addr learned my addr 172.21.15.123:0/258340450 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:57.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.439+0000 7fe97dc8e640 1 --2- 172.21.15.123:0/258340450 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe97814f380 0x7fe97814f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.439+0000 7fe97cc8c640 1 --2- 172.21.15.123:0/258340450 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe9781461f0 0x7fe978148d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.439+0000 7fe97d48d640 1 -- 172.21.15.123:0/258340450 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe9781461f0 msgr2=0x7fe978148d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.439+0000 7fe97d48d640 1 --2- 172.21.15.123:0/258340450 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe9781461f0 0x7fe978148d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.439+0000 7fe97d48d640 1 -- 172.21.15.123:0/258340450 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe97814f380 msgr2=0x7fe97814f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.439+0000 7fe97d48d640 1 --2- 172.21.15.123:0/258340450 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe97814f380 0x7fe97814f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.439+0000 7fe97d48d640 1 -- 172.21.15.123:0/258340450 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe978146dc0 con 0x7fe964004d40 2024-09-15T23:14:57.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.439+0000 7fe97d48d640 1 --2- 172.21.15.123:0/258340450 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe964004d40 0x7fe978145bd0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe97400e7f0 tx=0x7fe97400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:57.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.439+0000 7fe96dffb640 1 -- 172.21.15.123:0/258340450 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97400eea0 con 0x7fe964004d40 2024-09-15T23:14:57.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.439+0000 7fe96dffb640 1 -- 172.21.15.123:0/258340450 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe974018070 con 0x7fe964004d40 2024-09-15T23:14:57.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.439+0000 7fe97f6f1640 1 -- 172.21.15.123:0/258340450 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe978149260 con 0x7fe964004d40 2024-09-15T23:14:57.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.439+0000 7fe96dffb640 1 -- 172.21.15.123:0/258340450 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97400ca90 con 0x7fe964004d40 2024-09-15T23:14:57.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.439+0000 7fe97f6f1640 1 -- 172.21.15.123:0/258340450 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe978149810 con 0x7fe964004d40 2024-09-15T23:14:57.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.441+0000 7fe96dffb640 1 -- 172.21.15.123:0/258340450 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe97400cc30 con 0x7fe964004d40 2024-09-15T23:14:57.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.441+0000 7fe96dffb640 1 --2- 172.21.15.123:0/258340450 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe95c06c2b0 0x7fe95c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.441+0000 7fe96dffb640 1 -- 172.21.15.123:0/258340450 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7fe97408b3e0 con 0x7fe964004d40 2024-09-15T23:14:57.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.442+0000 7fe97cc8c640 1 --2- 172.21.15.123:0/258340450 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe95c06c2b0 0x7fe95c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.442+0000 7fe97cc8c640 1 --2- 172.21.15.123:0/258340450 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe95c06c2b0 0x7fe95c06e770 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe97815e1f0 tx=0x7fe96800d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:57.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.442+0000 7fe98248b740 1 Processor -- start 2024-09-15T23:14:57.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.442+0000 7fe98248b740 1 -- start start 2024-09-15T23:14:57.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.443+0000 7fe98248b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5570d6f805d0 0x5570d6f809b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.443+0000 7fe98248b740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5570d6f7dd90 0x5570d6f7f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.443+0000 7fe98248b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570d6f7e1f0 0x5570d6f60550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.443+0000 7fe98248b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5570d6e9c5d0 con 0x5570d6f805d0 2024-09-15T23:14:57.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.443+0000 7fe98248b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5570d6e44470 con 0x5570d6f7e1f0 2024-09-15T23:14:57.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.443+0000 7fe98248b740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5570d6e98590 con 0x5570d6f7dd90 2024-09-15T23:14:57.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.443+0000 7fe97d48d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5570d6f805d0 0x5570d6f809b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.443+0000 7fe97d48d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5570d6f805d0 0x5570d6f809b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45518/0 (socket says 172.21.15.123:45518) 2024-09-15T23:14:57.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.443+0000 7fe97d48d640 1 -- 172.21.15.123:0/2774573436 learned_addr learned my addr 172.21.15.123:0/2774573436 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:57.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.443+0000 7fe97cc8c640 1 --2- 172.21.15.123:0/2774573436 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5570d6f7dd90 0x5570d6f7f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.443+0000 7fe97dc8e640 1 --2- 172.21.15.123:0/2774573436 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570d6f7e1f0 0x5570d6f60550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.443+0000 7fe97d48d640 1 -- 172.21.15.123:0/2774573436 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5570d6f7dd90 msgr2=0x5570d6f7f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.443+0000 7fe97d48d640 1 --2- 172.21.15.123:0/2774573436 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5570d6f7dd90 0x5570d6f7f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.444+0000 7fe97d48d640 1 -- 172.21.15.123:0/2774573436 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570d6f7e1f0 msgr2=0x5570d6f60550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.444+0000 7fe97d48d640 1 --2- 172.21.15.123:0/2774573436 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570d6f7e1f0 0x5570d6f60550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.444+0000 7fe97d48d640 1 -- 172.21.15.123:0/2774573436 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570d6e2c860 con 0x5570d6f805d0 2024-09-15T23:14:57.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.444+0000 7fe97dc8e640 1 --2- 172.21.15.123:0/2774573436 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570d6f7e1f0 0x5570d6f60550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:57.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.444+0000 7fe97d48d640 1 --2- 172.21.15.123:0/2774573436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5570d6f805d0 0x5570d6f809b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fe97400c4b0 tx=0x7fe97401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aac46a955f540c12 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:57.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.444+0000 7fe962ffd640 1 -- 172.21.15.123:0/2774573436 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe974071020 con 0x5570d6f805d0 2024-09-15T23:14:57.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.444+0000 7fe962ffd640 1 -- 172.21.15.123:0/2774573436 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe974062030 con 0x5570d6f805d0 2024-09-15T23:14:57.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.444+0000 7fe962ffd640 1 -- 172.21.15.123:0/2774573436 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe97408b0d0 con 0x5570d6f805d0 2024-09-15T23:14:57.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.444+0000 7fe98248b740 1 -- 172.21.15.123:0/2774573436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5570d6f805d0 msgr2=0x5570d6f809b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.444+0000 7fe98248b740 1 --2- 172.21.15.123:0/2774573436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5570d6f805d0 0x5570d6f809b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fe97400c4b0 tx=0x7fe97401d000 comp rx=0 tx=0).stop 2024-09-15T23:14:57.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.444+0000 7fe98248b740 1 -- 172.21.15.123:0/2774573436 shutdown_connections 2024-09-15T23:14:57.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.444+0000 7fe98248b740 1 --2- 172.21.15.123:0/2774573436 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570d6f7e1f0 0x5570d6f60550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.444+0000 7fe98248b740 1 --2- 172.21.15.123:0/2774573436 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5570d6f7dd90 0x5570d6f7f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.444+0000 7fe98248b740 1 --2- 172.21.15.123:0/2774573436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5570d6f805d0 0x5570d6f809b0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.444+0000 7fe98248b740 1 -- 172.21.15.123:0/2774573436 >> 172.21.15.123:0/2774573436 conn(0x5570d6f36230 msgr2=0x5570d6f7e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:57.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.445+0000 7fe98248b740 1 -- 172.21.15.123:0/2774573436 shutdown_connections 2024-09-15T23:14:57.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.445+0000 7fe98248b740 1 -- 172.21.15.123:0/2774573436 wait complete. 2024-09-15T23:14:57.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.445+0000 7fe98248b740 1 -- start start 2024-09-15T23:14:57.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.445+0000 7fe98248b740 1 Processor -- start 2024-09-15T23:14:57.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.446+0000 7fe98248b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5570d6f7e1f0 0x5570d6f77c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.446+0000 7fe98248b740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5570d6f805d0 0x5570d6f92480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.446+0000 7fe98248b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570d6f929c0 0x5570d6f61620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.446+0000 7fe98248b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5570d6f7ccf0 con 0x5570d6f7e1f0 2024-09-15T23:14:57.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.446+0000 7fe98248b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5570d6e25620 con 0x5570d6f929c0 2024-09-15T23:14:57.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.446+0000 7fe98248b740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5570d6f7cfd0 con 0x5570d6f805d0 2024-09-15T23:14:57.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.446+0000 7fe98248b740 10 client.0 _ll_register_callbacks cb 0x5570d6e495b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:57.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.446+0000 7fe97d48d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5570d6f7e1f0 0x5570d6f77c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.446+0000 7fe97d48d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5570d6f7e1f0 0x5570d6f77c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45520/0 (socket says 172.21.15.123:45520) 2024-09-15T23:14:57.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.446+0000 7fe97d48d640 1 -- 172.21.15.123:0/1135865249 learned_addr learned my addr 172.21.15.123:0/1135865249 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:57.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.446+0000 7fe97cc8c640 1 --2- 172.21.15.123:0/1135865249 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5570d6f805d0 0x5570d6f92480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.446+0000 7fe97d48d640 1 -- 172.21.15.123:0/1135865249 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5570d6f805d0 msgr2=0x5570d6f92480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.446+0000 7fe97d48d640 1 --2- 172.21.15.123:0/1135865249 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5570d6f805d0 0x5570d6f92480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.446+0000 7fe97dc8e640 1 --2- 172.21.15.123:0/1135865249 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570d6f929c0 0x5570d6f61620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.446+0000 7fe97d48d640 1 -- 172.21.15.123:0/1135865249 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570d6f929c0 msgr2=0x5570d6f61620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.446+0000 7fe97d48d640 1 --2- 172.21.15.123:0/1135865249 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570d6f929c0 0x5570d6f61620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.446+0000 7fe97d48d640 1 -- 172.21.15.123:0/1135865249 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570d6baf3f0 con 0x5570d6f7e1f0 2024-09-15T23:14:57.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.446+0000 7fe97dc8e640 1 --2- 172.21.15.123:0/1135865249 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570d6f929c0 0x5570d6f61620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:57.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.447+0000 7fe97d48d640 1 --2- 172.21.15.123:0/1135865249 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5570d6f7e1f0 0x5570d6f77c90 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fe9740898e0 tx=0x7fe974001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db371b4d90e9fe40 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:57.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.447+0000 7fe957fff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:57.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.447+0000 7fe957fff640 1 -- 172.21.15.123:0/1135865249 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe974076060 con 0x5570d6f7e1f0 2024-09-15T23:14:57.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.447+0000 7fe957fff640 1 -- 172.21.15.123:0/1135865249 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7fe974055ac0 con 0x5570d6f7e1f0 2024-09-15T23:14:57.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.447+0000 7fe98248b740 1 -- 172.21.15.123:0/1135865249 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe974062030 con 0x5570d6f7e1f0 2024-09-15T23:14:57.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.447+0000 7fe957fff640 1 -- 172.21.15.123:0/1135865249 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe97407d050 con 0x5570d6f7e1f0 2024-09-15T23:14:57.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.447+0000 7fe98248b740 10 client.5895 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:57.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.447+0000 7fe98248b740 1 -- 172.21.15.123:0/1135865249 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x5570d6c797d0 con 0x5570d6f7e1f0 2024-09-15T23:14:57.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.447+0000 7fe957fff640 1 -- 172.21.15.123:0/1135865249 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe974062030 con 0x5570d6f7e1f0 2024-09-15T23:14:57.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.447+0000 7fe957fff640 1 -- 172.21.15.123:0/1135865249 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7fe9740782b0 con 0x5570d6f7e1f0 2024-09-15T23:14:57.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.447+0000 7fe98248b740 10 client.5895 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:57.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.447+0000 7fe98248b740 10 client.5895 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:57.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.447+0000 7fe98248b740 20 client.5895 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:57.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.447+0000 7fe98248b740 1 --2- 172.21.15.123:0/1135865249 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5570d6f61b60 0x5570d6f8f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.447+0000 7fe98248b740 4 client.5895 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:14:57.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.447+0000 7fe98248b740 1 -- 172.21.15.123:0/1135865249 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5570d6efb030 con 0x5570d6f61b60 2024-09-15T23:14:57.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.447+0000 7fe97cc8c640 1 --2- 172.21.15.123:0/1135865249 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5570d6f61b60 0x5570d6f8f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.448+0000 7fe957fff640 10 client.5895 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:57.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.448+0000 7fe97cc8c640 1 --2- 172.21.15.123:0/1135865249 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5570d6f61b60 0x5570d6f8f290 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8262440df93d2755 server_cookie=5d3f758bed8004b7 in_seq=0 out_seq=0 2024-09-15T23:14:57.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.448+0000 7fe957fff640 1 -- 172.21.15.123:0/1135865249 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5570d6efb030 con 0x5570d6f61b60 2024-09-15T23:14:57.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.449+0000 7fe957fff640 10 client.5895 handle_command_reply: tid=0 2024-09-15T23:14:57.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.449+0000 7fe98248b740 1 client.5895 shutdown 2024-09-15T23:14:57.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.449+0000 7fe98248b740 1 -- 172.21.15.123:0/1135865249 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5570d6f7e1f0 msgr2=0x5570d6f77c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.449+0000 7fe98248b740 1 --2- 172.21.15.123:0/1135865249 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5570d6f7e1f0 0x5570d6f77c90 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fe9740898e0 tx=0x7fe974001a40 comp rx=0 tx=0).stop 2024-09-15T23:14:57.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.449+0000 7fe98248b740 1 -- 172.21.15.123:0/1135865249 shutdown_connections 2024-09-15T23:14:57.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.449+0000 7fe98248b740 1 --2- 172.21.15.123:0/1135865249 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5570d6f61b60 0x5570d6f8f290 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.449+0000 7fe98248b740 1 --2- 172.21.15.123:0/1135865249 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570d6f929c0 0x5570d6f61620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.449+0000 7fe957fff640 0 client.5895 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:57.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.449+0000 7fe98248b740 1 --2- 172.21.15.123:0/1135865249 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5570d6f805d0 0x5570d6f92480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.449+0000 7fe98248b740 1 --2- 172.21.15.123:0/1135865249 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5570d6f7e1f0 0x5570d6f77c90 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.449+0000 7fe98248b740 1 -- 172.21.15.123:0/1135865249 >> 172.21.15.123:0/1135865249 conn(0x5570d6f7dd90 msgr2=0x5570d6f81ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:57.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.449+0000 7fe98248b740 1 -- 172.21.15.123:0/1135865249 shutdown_connections 2024-09-15T23:14:57.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.449+0000 7fe98248b740 1 -- 172.21.15.123:0/1135865249 wait complete. 2024-09-15T23:14:57.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.449+0000 7fe98248b740 20 client.5895 trim_cache size 0 max 16384 2024-09-15T23:14:57.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.462+0000 7fe98248b740 1 Processor -- start 2024-09-15T23:14:57.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.462+0000 7fe98248b740 1 -- start start 2024-09-15T23:14:57.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.462+0000 7fe98248b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5570d6f61b60 0x5570d6f91950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.462+0000 7fe98248b740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5570d6f7e1f0 0x5570d6fa1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.462+0000 7fe98248b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570d6f805d0 0x5570d6fa1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.462+0000 7fe98248b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe9781fcf50 con 0x5570d6f61b60 2024-09-15T23:14:57.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.462+0000 7fe98248b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe9781fbf60 con 0x5570d6f805d0 2024-09-15T23:14:57.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.462+0000 7fe98248b740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe97815cf70 con 0x5570d6f7e1f0 2024-09-15T23:14:57.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.463+0000 7fe97d48d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5570d6f61b60 0x5570d6f91950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.463+0000 7fe97d48d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5570d6f61b60 0x5570d6f91950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45522/0 (socket says 172.21.15.123:45522) 2024-09-15T23:14:57.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.463+0000 7fe97d48d640 1 -- 172.21.15.123:0/1375116987 learned_addr learned my addr 172.21.15.123:0/1375116987 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:57.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.463+0000 7fe97d48d640 1 -- 172.21.15.123:0/1375116987 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5570d6f7e1f0 msgr2=0x5570d6fa1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.463+0000 7fe97d48d640 1 --2- 172.21.15.123:0/1375116987 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5570d6f7e1f0 0x5570d6fa1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.463+0000 7fe97d48d640 1 -- 172.21.15.123:0/1375116987 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570d6f805d0 msgr2=0x5570d6fa1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.463+0000 7fe97d48d640 1 --2- 172.21.15.123:0/1375116987 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570d6f805d0 0x5570d6fa1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.463+0000 7fe97d48d640 1 -- 172.21.15.123:0/1375116987 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570d6d12940 con 0x5570d6f61b60 2024-09-15T23:14:57.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.463+0000 7fe97d48d640 1 --2- 172.21.15.123:0/1375116987 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5570d6f61b60 0x5570d6f91950 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe9740593e0 tx=0x7fe974089000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d40ca6a3c4f725b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:57.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.463+0000 7fe9627fc640 1 -- 172.21.15.123:0/1375116987 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe974071040 con 0x5570d6f61b60 2024-09-15T23:14:57.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.463+0000 7fe9627fc640 1 -- 172.21.15.123:0/1375116987 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe974062030 con 0x5570d6f61b60 2024-09-15T23:14:57.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.463+0000 7fe9627fc640 1 -- 172.21.15.123:0/1375116987 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe974071440 con 0x5570d6f61b60 2024-09-15T23:14:57.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.463+0000 7fe98248b740 1 -- 172.21.15.123:0/1375116987 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5570d6f61b60 msgr2=0x5570d6f91950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.463+0000 7fe98248b740 1 --2- 172.21.15.123:0/1375116987 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5570d6f61b60 0x5570d6f91950 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe9740593e0 tx=0x7fe974089000 comp rx=0 tx=0).stop 2024-09-15T23:14:57.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.464+0000 7fe98248b740 1 -- 172.21.15.123:0/1375116987 shutdown_connections 2024-09-15T23:14:57.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.464+0000 7fe98248b740 1 --2- 172.21.15.123:0/1375116987 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570d6f805d0 0x5570d6fa1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.464+0000 7fe98248b740 1 --2- 172.21.15.123:0/1375116987 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5570d6f7e1f0 0x5570d6fa1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.464+0000 7fe98248b740 1 --2- 172.21.15.123:0/1375116987 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5570d6f61b60 0x5570d6f91950 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.464+0000 7fe98248b740 1 -- 172.21.15.123:0/1375116987 >> 172.21.15.123:0/1375116987 conn(0x5570d6f7dd90 msgr2=0x5570d6f34860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:57.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.464+0000 7fe98248b740 1 -- 172.21.15.123:0/1375116987 shutdown_connections 2024-09-15T23:14:57.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.464+0000 7fe98248b740 1 -- 172.21.15.123:0/1375116987 wait complete. 2024-09-15T23:14:57.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.464+0000 7fe98248b740 1 -- start start 2024-09-15T23:14:57.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.464+0000 7fe98248b740 1 Processor -- start 2024-09-15T23:14:57.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.465+0000 7fe98248b740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5570d6f61b60 0x5570d6fa0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.465+0000 7fe98248b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570d6f7e1f0 0x5570d6fa17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.465+0000 7fe98248b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5570d6f805d0 0x5570d6fa1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.465+0000 7fe98248b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5570d6f5ea20 con 0x5570d6f805d0 2024-09-15T23:14:57.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.465+0000 7fe98248b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe9781fba10 con 0x5570d6f7e1f0 2024-09-15T23:14:57.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.465+0000 7fe98248b740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5570d6f75300 con 0x5570d6f61b60 2024-09-15T23:14:57.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.465+0000 7fe98248b740 10 client.0 _ll_register_callbacks cb 0x7fe97405d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:57.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.465+0000 7fe97dc8e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5570d6f805d0 0x5570d6fa1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.465+0000 7fe97dc8e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5570d6f805d0 0x5570d6fa1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45536/0 (socket says 172.21.15.123:45536) 2024-09-15T23:14:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.465+0000 7fe97dc8e640 1 -- 172.21.15.123:0/1565002466 learned_addr learned my addr 172.21.15.123:0/1565002466 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.465+0000 7fe97dc8e640 1 -- 172.21.15.123:0/1565002466 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5570d6f61b60 msgr2=0x5570d6fa0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.465+0000 7fe97dc8e640 1 --2- 172.21.15.123:0/1565002466 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5570d6f61b60 0x5570d6fa0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.465+0000 7fe97dc8e640 1 -- 172.21.15.123:0/1565002466 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570d6f7e1f0 msgr2=0x5570d6fa17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.465+0000 7fe97dc8e640 1 --2- 172.21.15.123:0/1565002466 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570d6f7e1f0 0x5570d6fa17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.465+0000 7fe97dc8e640 1 -- 172.21.15.123:0/1565002466 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570d6fe2500 con 0x5570d6f805d0 2024-09-15T23:14:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.466+0000 7fe97dc8e640 1 --2- 172.21.15.123:0/1565002466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5570d6f805d0 0x5570d6fa1d00 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fe97002af10 tx=0x7fe970009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b16a54feb2623c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.466+0000 7fe957fff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.466+0000 7fe957fff640 1 -- 172.21.15.123:0/1565002466 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9700043d0 con 0x5570d6f805d0 2024-09-15T23:14:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.466+0000 7fe957fff640 1 -- 172.21.15.123:0/1565002466 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7fe970004570 con 0x5570d6f805d0 2024-09-15T23:14:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.466+0000 7fe98248b740 1 -- 172.21.15.123:0/1565002466 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe974062030 con 0x5570d6f805d0 2024-09-15T23:14:57.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.466+0000 7fe957fff640 1 -- 172.21.15.123:0/1565002466 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe97004f050 con 0x5570d6f805d0 2024-09-15T23:14:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.466+0000 7fe98248b740 10 client.5901 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.466+0000 7fe98248b740 1 -- 172.21.15.123:0/1565002466 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x5570d6f74f90 con 0x5570d6f805d0 2024-09-15T23:14:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.466+0000 7fe957fff640 1 -- 172.21.15.123:0/1565002466 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe974062030 con 0x5570d6f805d0 2024-09-15T23:14:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.466+0000 7fe957fff640 1 -- 172.21.15.123:0/1565002466 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7fe970052020 con 0x5570d6f805d0 2024-09-15T23:14:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.466+0000 7fe98248b740 10 client.5901 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.466+0000 7fe98248b740 10 client.5901 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.466+0000 7fe98248b740 20 client.5901 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.466+0000 7fe98248b740 1 --2- 172.21.15.123:0/1565002466 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5570d6f929c0 0x5570d6f32f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.466+0000 7fe98248b740 4 client.5901 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:14:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.466+0000 7fe98248b740 1 -- 172.21.15.123:0/1565002466 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5570d6ea9d00 con 0x5570d6f929c0 2024-09-15T23:14:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.466+0000 7fe97d48d640 1 --2- 172.21.15.123:0/1565002466 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5570d6f929c0 0x5570d6f32f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.467+0000 7fe957fff640 10 client.5901 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.467+0000 7fe97d48d640 1 --2- 172.21.15.123:0/1565002466 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5570d6f929c0 0x5570d6f32f60 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce3046864e0e9a5e server_cookie=bcbd742901375da4 in_seq=0 out_seq=0 2024-09-15T23:14:57.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.467+0000 7fe957fff640 1 -- 172.21.15.123:0/1565002466 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5570d6ea9d00 con 0x5570d6f929c0 2024-09-15T23:14:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.467+0000 7fe957fff640 10 client.5901 handle_command_reply: tid=0 2024-09-15T23:14:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.467+0000 7fe98248b740 1 client.5901 shutdown 2024-09-15T23:14:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.467+0000 7fe98248b740 1 -- 172.21.15.123:0/1565002466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5570d6f805d0 msgr2=0x5570d6fa1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.467+0000 7fe98248b740 1 --2- 172.21.15.123:0/1565002466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5570d6f805d0 0x5570d6fa1d00 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fe97002af10 tx=0x7fe970009750 comp rx=0 tx=0).stop 2024-09-15T23:14:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.467+0000 7fe98248b740 1 -- 172.21.15.123:0/1565002466 shutdown_connections 2024-09-15T23:14:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.467+0000 7fe98248b740 1 --2- 172.21.15.123:0/1565002466 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x5570d6f929c0 0x5570d6f32f60 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.467+0000 7fe98248b740 1 --2- 172.21.15.123:0/1565002466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5570d6f805d0 0x5570d6fa1d00 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.467+0000 7fe957fff640 0 client.5901 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.467+0000 7fe98248b740 1 --2- 172.21.15.123:0/1565002466 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5570d6f7e1f0 0x5570d6fa17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.467+0000 7fe98248b740 1 --2- 172.21.15.123:0/1565002466 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5570d6f61b60 0x5570d6fa0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.467+0000 7fe98248b740 1 -- 172.21.15.123:0/1565002466 >> 172.21.15.123:0/1565002466 conn(0x5570d6f7dd90 msgr2=0x5570d6f35040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.467+0000 7fe98248b740 1 -- 172.21.15.123:0/1565002466 shutdown_connections 2024-09-15T23:14:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.467+0000 7fe98248b740 1 -- 172.21.15.123:0/1565002466 wait complete. 2024-09-15T23:14:57.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.467+0000 7fe98248b740 20 client.5901 trim_cache size 0 max 16384 2024-09-15T23:14:57.475 INFO:teuthology.orchestra.run.smithi123.stdout:[] 2024-09-15T23:14:57.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.468+0000 7fe97f6f1640 1 -- 172.21.15.123:0/258340450 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe95c06c2b0 msgr2=0x7fe95c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.468+0000 7fe97f6f1640 1 --2- 172.21.15.123:0/258340450 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe95c06c2b0 0x7fe95c06e770 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe97815e1f0 tx=0x7fe96800d040 comp rx=0 tx=0).stop 2024-09-15T23:14:57.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.468+0000 7fe97f6f1640 1 -- 172.21.15.123:0/258340450 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe964004d40 msgr2=0x7fe978145bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.468+0000 7fe97f6f1640 1 --2- 172.21.15.123:0/258340450 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe964004d40 0x7fe978145bd0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe97400e7f0 tx=0x7fe97400ecb0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.468+0000 7fe97f6f1640 1 -- 172.21.15.123:0/258340450 shutdown_connections 2024-09-15T23:14:57.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.468+0000 7fe97f6f1640 1 --2- 172.21.15.123:0/258340450 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe97814f380 0x7fe97814f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.468+0000 7fe97f6f1640 1 --2- 172.21.15.123:0/258340450 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe9781461f0 0x7fe978148d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.468+0000 7fe97f6f1640 1 --2- 172.21.15.123:0/258340450 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe95c06c2b0 0x7fe95c06e770 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.468+0000 7fe97f6f1640 1 --2- 172.21.15.123:0/258340450 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe964004d40 0x7fe978145bd0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.468+0000 7fe97f6f1640 1 -- 172.21.15.123:0/258340450 >> 172.21.15.123:0/258340450 conn(0x7fe97806d0f0 msgr2=0x7fe97815eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:57.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.468+0000 7fe97f6f1640 1 -- 172.21.15.123:0/258340450 shutdown_connections 2024-09-15T23:14:57.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.468+0000 7fe97f6f1640 1 -- 172.21.15.123:0/258340450 wait complete. 2024-09-15T23:14:57.480 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data rmxattr 10000000a4e.00000000 parent 2024-09-15T23:14:57.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.522+0000 7f890e693f40 1 Processor -- start 2024-09-15T23:14:57.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.522+0000 7f890e693f40 1 -- start start 2024-09-15T23:14:57.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.523+0000 7f890e693f40 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ea102a95a0 0x55ea1037d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.523+0000 7f890e693f40 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ea10377650 0x55ea10380c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.523+0000 7f890e693f40 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ea10381180 0x55ea1037a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.523+0000 7f890e693f40 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55ea101fc510 con 0x55ea102a95a0 2024-09-15T23:14:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.523+0000 7f890e693f40 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55ea10255c50 con 0x55ea10377650 2024-09-15T23:14:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.523+0000 7f890e693f40 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55ea102eab40 con 0x55ea10381180 2024-09-15T23:14:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.523+0000 7f890c18b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ea102a95a0 0x55ea1037d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.523+0000 7f890c18b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ea102a95a0 0x55ea1037d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45542/0 (socket says 172.21.15.123:45542) 2024-09-15T23:14:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.523+0000 7f890c18b640 1 -- 172.21.15.123:0/345401767 learned_addr learned my addr 172.21.15.123:0/345401767 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.523+0000 7f890398a640 1 --2- 172.21.15.123:0/345401767 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ea10377650 0x55ea10380c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.523+0000 7f890c98c640 1 --2- 172.21.15.123:0/345401767 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ea10381180 0x55ea1037a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.523+0000 7f890c18b640 1 -- 172.21.15.123:0/345401767 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ea10381180 msgr2=0x55ea1037a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.523+0000 7f890c18b640 1 --2- 172.21.15.123:0/345401767 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ea10381180 0x55ea1037a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.523+0000 7f890c18b640 1 -- 172.21.15.123:0/345401767 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ea10377650 msgr2=0x55ea10380c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.523+0000 7f890c18b640 1 --2- 172.21.15.123:0/345401767 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ea10377650 0x55ea10380c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.523+0000 7f890c18b640 1 -- 172.21.15.123:0/345401767 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea103795c0 con 0x55ea102a95a0 2024-09-15T23:14:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.523+0000 7f890c98c640 1 --2- 172.21.15.123:0/345401767 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ea10381180 0x55ea1037a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.523+0000 7f890c18b640 1 --2- 172.21.15.123:0/345401767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ea102a95a0 0x55ea1037d470 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f88fc009790 tx=0x7f88fc009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5f68b88a2ade662 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.523+0000 7f890b189640 1 -- 172.21.15.123:0/345401767 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88fc0088d0 con 0x55ea102a95a0 2024-09-15T23:14:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.523+0000 7f890b189640 1 -- 172.21.15.123:0/345401767 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88fc01a070 con 0x55ea102a95a0 2024-09-15T23:14:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.524+0000 7f890b189640 1 -- 172.21.15.123:0/345401767 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88fc008cb0 con 0x55ea102a95a0 2024-09-15T23:14:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.524+0000 7f890e693f40 1 -- 172.21.15.123:0/345401767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ea102a95a0 msgr2=0x55ea1037d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.524+0000 7f890e693f40 1 --2- 172.21.15.123:0/345401767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ea102a95a0 0x55ea1037d470 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f88fc009790 tx=0x7f88fc009880 comp rx=0 tx=0).stop 2024-09-15T23:14:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.524+0000 7f890e693f40 1 -- 172.21.15.123:0/345401767 shutdown_connections 2024-09-15T23:14:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.524+0000 7f890e693f40 1 --2- 172.21.15.123:0/345401767 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ea10381180 0x55ea1037a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.524+0000 7f890e693f40 1 --2- 172.21.15.123:0/345401767 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ea10377650 0x55ea10380c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.524+0000 7f890e693f40 1 --2- 172.21.15.123:0/345401767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ea102a95a0 0x55ea1037d470 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.524+0000 7f890e693f40 1 -- 172.21.15.123:0/345401767 >> 172.21.15.123:0/345401767 conn(0x55ea102d7710 msgr2=0x55ea10381ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.524+0000 7f890e693f40 1 -- 172.21.15.123:0/345401767 shutdown_connections 2024-09-15T23:14:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.524+0000 7f890e693f40 1 -- 172.21.15.123:0/345401767 wait complete. 2024-09-15T23:14:57.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.525+0000 7f890e693f40 1 Processor -- start 2024-09-15T23:14:57.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.525+0000 7f890e693f40 1 -- start start 2024-09-15T23:14:57.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.525+0000 7f890e693f40 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ea102a95a0 0x55ea10360910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.525+0000 7f890e693f40 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ea10377650 0x55ea1037f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.525+0000 7f890e693f40 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ea10381180 0x55ea103610c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.525+0000 7f890e693f40 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55ea10379c10 con 0x55ea102a95a0 2024-09-15T23:14:57.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.525+0000 7f890e693f40 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55ea103798a0 con 0x55ea10377650 2024-09-15T23:14:57.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.525+0000 7f890e693f40 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55ea103818c0 con 0x55ea10381180 2024-09-15T23:14:57.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.525+0000 7f890c18b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ea102a95a0 0x55ea10360910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.525+0000 7f890c18b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ea102a95a0 0x55ea10360910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45554/0 (socket says 172.21.15.123:45554) 2024-09-15T23:14:57.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.525+0000 7f890c18b640 1 -- 172.21.15.123:0/2376596460 learned_addr learned my addr 172.21.15.123:0/2376596460 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:57.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.526+0000 7f890c18b640 1 -- 172.21.15.123:0/2376596460 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ea10381180 msgr2=0x55ea103610c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.526+0000 7f890c18b640 1 --2- 172.21.15.123:0/2376596460 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ea10381180 0x55ea103610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.526+0000 7f890c18b640 1 -- 172.21.15.123:0/2376596460 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ea10377650 msgr2=0x55ea1037f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.526+0000 7f890398a640 1 --2- 172.21.15.123:0/2376596460 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ea10377650 0x55ea1037f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.526+0000 7f890c18b640 1 --2- 172.21.15.123:0/2376596460 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ea10377650 0x55ea1037f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.526+0000 7f890c18b640 1 -- 172.21.15.123:0/2376596460 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea104194f0 con 0x55ea102a95a0 2024-09-15T23:14:57.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.526+0000 7f890c18b640 1 --2- 172.21.15.123:0/2376596460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ea102a95a0 0x55ea10360910 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f88fc017040 tx=0x7f88fc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:57.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.526+0000 7f890a187640 1 -- 172.21.15.123:0/2376596460 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88fc015660 con 0x55ea102a95a0 2024-09-15T23:14:57.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.526+0000 7f890a187640 1 -- 172.21.15.123:0/2376596460 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88fc015800 con 0x55ea102a95a0 2024-09-15T23:14:57.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.526+0000 7f890e693f40 1 -- 172.21.15.123:0/2376596460 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ea1037e480 con 0x55ea102a95a0 2024-09-15T23:14:57.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.526+0000 7f890a187640 1 -- 172.21.15.123:0/2376596460 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88fc015bf0 con 0x55ea102a95a0 2024-09-15T23:14:57.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.526+0000 7f890e693f40 1 -- 172.21.15.123:0/2376596460 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea1037ea00 con 0x55ea102a95a0 2024-09-15T23:14:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.527+0000 7f890a187640 1 -- 172.21.15.123:0/2376596460 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f88fc013030 con 0x55ea102a95a0 2024-09-15T23:14:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.528+0000 7f890a187640 1 --2- 172.21.15.123:0/2376596460 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f88ec06ac90 0x7f88ec06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.528+0000 7f890a187640 1 -- 172.21.15.123:0/2376596460 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7f88fc08b8d0 con 0x55ea102a95a0 2024-09-15T23:14:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.528+0000 7f890e693f40 1 --2- 172.21.15.123:0/2376596460 >> [v2:172.21.15.188:6800/3901678408,v1:172.21.15.188:6801/3901678408] conn(0x55ea10373d80 0x55ea103741c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.528+0000 7f890e693f40 1 -- 172.21.15.123:0/2376596460 --> [v2:172.21.15.188:6800/3901678408,v1:172.21.15.188:6801/3901678408] -- osd_op(unknown.0.0:1 7.2 7:43adcc81:::10000000a4e.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54) -- 0x55ea10376930 con 0x55ea10373d80 2024-09-15T23:14:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.528+0000 7f890398a640 1 --2- 172.21.15.123:0/2376596460 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f88ec06ac90 0x7f88ec06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.528+0000 7f890c98c640 1 --2- 172.21.15.123:0/2376596460 >> [v2:172.21.15.188:6800/3901678408,v1:172.21.15.188:6801/3901678408] conn(0x55ea10373d80 0x55ea103741c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.529+0000 7f890398a640 1 --2- 172.21.15.123:0/2376596460 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f88ec06ac90 0x7f88ec06d150 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55ea102dbcb0 tx=0x7f88f40013d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.529+0000 7f890c98c640 1 --2- 172.21.15.123:0/2376596460 >> [v2:172.21.15.188:6800/3901678408,v1:172.21.15.188:6801/3901678408] conn(0x55ea10373d80 0x55ea103741c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.530+0000 7f890c98c640 1 -- 172.21.15.123:0/2376596460 <== osd.4 v2:172.21.15.188:6800/3901678408 1 ==== osd_op_reply(1 10000000a4e.00000000 [rmxattr] v54'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f8904006040 con 0x55ea10373d80 2024-09-15T23:14:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.530+0000 7f890e693f40 1 -- 172.21.15.123:0/2376596460 >> [v2:172.21.15.188:6800/3901678408,v1:172.21.15.188:6801/3901678408] conn(0x55ea10373d80 msgr2=0x55ea103741c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.530+0000 7f890e693f40 1 --2- 172.21.15.123:0/2376596460 >> [v2:172.21.15.188:6800/3901678408,v1:172.21.15.188:6801/3901678408] conn(0x55ea10373d80 0x55ea103741c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.530+0000 7f890e693f40 1 -- 172.21.15.123:0/2376596460 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f88ec06ac90 msgr2=0x7f88ec06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.530+0000 7f890e693f40 1 --2- 172.21.15.123:0/2376596460 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f88ec06ac90 0x7f88ec06d150 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55ea102dbcb0 tx=0x7f88f40013d0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.530+0000 7f890e693f40 1 -- 172.21.15.123:0/2376596460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ea102a95a0 msgr2=0x55ea10360910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.530+0000 7f890e693f40 1 --2- 172.21.15.123:0/2376596460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ea102a95a0 0x55ea10360910 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f88fc017040 tx=0x7f88fc002fb0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.530+0000 7f890c98c640 1 -- 172.21.15.123:0/2376596460 reap_dead start 2024-09-15T23:14:57.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.530+0000 7f890e693f40 1 -- 172.21.15.123:0/2376596460 shutdown_connections 2024-09-15T23:14:57.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.530+0000 7f890e693f40 1 -- 172.21.15.123:0/2376596460 >> 172.21.15.123:0/2376596460 conn(0x55ea102d7710 msgr2=0x55ea1037bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:57.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.530+0000 7f890e693f40 1 -- 172.21.15.123:0/2376596460 shutdown_connections 2024-09-15T23:14:57.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.530+0000 7f890e693f40 1 -- 172.21.15.123:0/2376596460 wait complete. 2024-09-15T23:14:57.536 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_1' 2024-09-15T23:14:57.536 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/new_file_1 2024-09-15T23:14:57.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.677+0000 7f86dbc53640 1 Processor -- start 2024-09-15T23:14:57.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.678+0000 7f86dbc53640 1 -- start start 2024-09-15T23:14:57.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.678+0000 7f86dbc53640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f86d406bfd0 0x7f86d406c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.678+0000 7f86dbc53640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f86d40b3350 0x7f86d41623a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.678+0000 7f86dbc53640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86d406c8f0 con 0x7f86d40b38a0 2024-09-15T23:14:57.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.678+0000 7f86dbc53640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f86d40b78a0 con 0x7f86d406bfd0 2024-09-15T23:14:57.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.678+0000 7f86dbc53640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f86d40cffb0 con 0x7f86d40b3350 2024-09-15T23:14:57.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.679+0000 7f86d91ee640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f86d40b3350 0x7f86d41623a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.679+0000 7f86d99ef640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f86d406bfd0 0x7f86d406c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.679+0000 7f86d91ee640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f86d40b3350 0x7f86d41623a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:55658/0 (socket says 172.21.15.123:55658) 2024-09-15T23:14:57.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.679+0000 7f86d91ee640 1 -- 172.21.15.123:0/2239887754 learned_addr learned my addr 172.21.15.123:0/2239887754 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:57.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.679+0000 7f86d91ee640 1 -- 172.21.15.123:0/2239887754 >> v2:172.21.15.188:3300/0 conn(0x7f86d406bfd0 msgr2=0x7f86d406c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.679+0000 7f86d91ee640 1 --2- 172.21.15.123:0/2239887754 >> v2:172.21.15.188:3300/0 conn(0x7f86d406bfd0 0x7f86d406c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.679+0000 7f86d91ee640 1 -- 172.21.15.123:0/2239887754 >> v1:172.21.15.188:6789/0 conn(0x7f86d40b38a0 legacy=0x7f86d41628e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.679+0000 7f86d91ee640 1 -- 172.21.15.123:0/2239887754 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86d40cf710 con 0x7f86d40b3350 2024-09-15T23:14:57.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.679+0000 7f86d99ef640 1 --2- 172.21.15.123:0/2239887754 >> v2:172.21.15.188:3300/0 conn(0x7f86d406bfd0 0x7f86d406c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:14:57.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.679+0000 7f86d89ed640 1 -- 172.21.15.123:0/2239887754 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3240814968 0 0) 0x7f86d406c8f0 con 0x7f86d40b38a0 2024-09-15T23:14:57.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.680+0000 7f86d91ee640 1 --2- 172.21.15.123:0/2239887754 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f86d40b3350 0x7f86d41623a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f86c4009870 tx=0x7f86c402a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85b52cf05c602211 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:57.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.680+0000 7f86d89ed640 1 -- 172.21.15.123:0/2239887754 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c4037070 con 0x7f86d40b3350 2024-09-15T23:14:57.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.680+0000 7f86d89ed640 1 -- 172.21.15.123:0/2239887754 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86c402ae50 con 0x7f86d40b3350 2024-09-15T23:14:57.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.680+0000 7f86d89ed640 1 -- 172.21.15.123:0/2239887754 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c4032860 con 0x7f86d40b3350 2024-09-15T23:14:57.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.681+0000 7f86dbc53640 1 -- 172.21.15.123:0/2239887754 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f86d40b3350 msgr2=0x7f86d41623a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.681+0000 7f86dbc53640 1 --2- 172.21.15.123:0/2239887754 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f86d40b3350 0x7f86d41623a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f86c4009870 tx=0x7f86c402a300 comp rx=0 tx=0).stop 2024-09-15T23:14:57.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.681+0000 7f86dbc53640 1 -- 172.21.15.123:0/2239887754 shutdown_connections 2024-09-15T23:14:57.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.681+0000 7f86dbc53640 1 --2- 172.21.15.123:0/2239887754 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f86d40b3350 0x7f86d41623a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.681+0000 7f86dbc53640 1 --2- 172.21.15.123:0/2239887754 >> v2:172.21.15.188:3300/0 conn(0x7f86d406bfd0 0x7f86d406c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.681+0000 7f86dbc53640 1 -- 172.21.15.123:0/2239887754 >> 172.21.15.123:0/2239887754 conn(0x7f86d40d11c0 msgr2=0x7f86d40d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:57.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.681+0000 7f86dbc53640 1 -- 172.21.15.123:0/2239887754 shutdown_connections 2024-09-15T23:14:57.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.681+0000 7f86dbc53640 1 -- 172.21.15.123:0/2239887754 wait complete. 2024-09-15T23:14:57.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.682+0000 7f86dbc53640 1 Processor -- start 2024-09-15T23:14:57.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.682+0000 7f86dbc53640 1 -- start start 2024-09-15T23:14:57.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.683+0000 7f86dbc53640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86d406bfd0 0x7f86d40ab120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.683+0000 7f86dbc53640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f86d40b3350 0x7f86d40cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.683+0000 7f86dbc53640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86d40b38a0 0x7f86d414be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.683+0000 7f86dbc53640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f86d40d2400 con 0x7f86d40b38a0 2024-09-15T23:14:57.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.683+0000 7f86dbc53640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f86d40cfcd0 con 0x7f86d406bfd0 2024-09-15T23:14:57.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.683+0000 7f86dbc53640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f86d406cd50 con 0x7f86d40b3350 2024-09-15T23:14:57.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.683+0000 7f86da1f0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86d40b38a0 0x7f86d414be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.683+0000 7f86da1f0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86d40b38a0 0x7f86d414be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45568/0 (socket says 172.21.15.123:45568) 2024-09-15T23:14:57.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.683+0000 7f86da1f0640 1 -- 172.21.15.123:0/1139602319 learned_addr learned my addr 172.21.15.123:0/1139602319 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:57.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.683+0000 7f86d91ee640 1 --2- 172.21.15.123:0/1139602319 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f86d40b3350 0x7f86d40cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.683+0000 7f86d99ef640 1 --2- 172.21.15.123:0/1139602319 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86d406bfd0 0x7f86d40ab120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.683+0000 7f86da1f0640 1 -- 172.21.15.123:0/1139602319 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f86d40b3350 msgr2=0x7f86d40cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.683+0000 7f86da1f0640 1 --2- 172.21.15.123:0/1139602319 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f86d40b3350 0x7f86d40cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.683+0000 7f86da1f0640 1 -- 172.21.15.123:0/1139602319 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86d406bfd0 msgr2=0x7f86d40ab120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.683+0000 7f86da1f0640 1 --2- 172.21.15.123:0/1139602319 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86d406bfd0 0x7f86d40ab120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.683+0000 7f86da1f0640 1 -- 172.21.15.123:0/1139602319 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86d40ab660 con 0x7f86d40b38a0 2024-09-15T23:14:57.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.683+0000 7f86da1f0640 1 --2- 172.21.15.123:0/1139602319 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86d40b38a0 0x7f86d414be40 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f86cc00c780 tx=0x7f86cc00cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:57.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.683+0000 7f86ca7fc640 1 -- 172.21.15.123:0/1139602319 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86cc003b70 con 0x7f86d40b38a0 2024-09-15T23:14:57.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.683+0000 7f86ca7fc640 1 -- 172.21.15.123:0/1139602319 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86cc003d10 con 0x7f86d40b38a0 2024-09-15T23:14:57.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.683+0000 7f86dbc53640 1 -- 172.21.15.123:0/1139602319 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86d414ada0 con 0x7f86d40b38a0 2024-09-15T23:14:57.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.683+0000 7f86ca7fc640 1 -- 172.21.15.123:0/1139602319 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86cc005270 con 0x7f86d40b38a0 2024-09-15T23:14:57.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.684+0000 7f86dbc53640 1 -- 172.21.15.123:0/1139602319 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86d414b360 con 0x7f86d40b38a0 2024-09-15T23:14:57.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.685+0000 7f86ca7fc640 1 -- 172.21.15.123:0/1139602319 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f86cc005410 con 0x7f86d40b38a0 2024-09-15T23:14:57.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.685+0000 7f86ca7fc640 1 --2- 172.21.15.123:0/1139602319 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f86b806c2e0 0x7f86b806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.685+0000 7f86ca7fc640 1 -- 172.21.15.123:0/1139602319 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7f86cc08b1c0 con 0x7f86d40b38a0 2024-09-15T23:14:57.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.686+0000 7f86d99ef640 1 --2- 172.21.15.123:0/1139602319 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f86b806c2e0 0x7f86b806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.686+0000 7f86d99ef640 1 --2- 172.21.15.123:0/1139602319 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f86b806c2e0 0x7f86b806e7a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f86d40d3210 tx=0x7f86d0009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:57.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.686+0000 7f86de9ec740 1 Processor -- start 2024-09-15T23:14:57.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.687+0000 7f86de9ec740 1 -- start start 2024-09-15T23:14:57.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.687+0000 7f86de9ec740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557af7bb5650 0x557af7bb5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.687+0000 7f86de9ec740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557af7bb2e10 0x557af7bb49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.687+0000 7f86de9ec740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557af7bb3270 0x557af7b955d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.687+0000 7f86de9ec740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x557af7ad1c10 con 0x557af7bb3270 2024-09-15T23:14:57.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.687+0000 7f86de9ec740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x557af7a79900 con 0x557af7bb5650 2024-09-15T23:14:57.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.687+0000 7f86de9ec740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x557af7acdbd0 con 0x557af7bb2e10 2024-09-15T23:14:57.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.687+0000 7f86da1f0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557af7bb3270 0x557af7b955d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.687+0000 7f86da1f0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557af7bb3270 0x557af7b955d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45582/0 (socket says 172.21.15.123:45582) 2024-09-15T23:14:57.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.687+0000 7f86da1f0640 1 -- 172.21.15.123:0/288671534 learned_addr learned my addr 172.21.15.123:0/288671534 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:57.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.687+0000 7f86d91ee640 1 --2- 172.21.15.123:0/288671534 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557af7bb2e10 0x557af7bb49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.687+0000 7f86d99ef640 1 --2- 172.21.15.123:0/288671534 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557af7bb5650 0x557af7bb5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.688+0000 7f86da1f0640 1 -- 172.21.15.123:0/288671534 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557af7bb2e10 msgr2=0x557af7bb49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.688+0000 7f86da1f0640 1 --2- 172.21.15.123:0/288671534 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557af7bb2e10 0x557af7bb49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.688+0000 7f86da1f0640 1 -- 172.21.15.123:0/288671534 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557af7bb5650 msgr2=0x557af7bb5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.688+0000 7f86da1f0640 1 --2- 172.21.15.123:0/288671534 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557af7bb5650 0x557af7bb5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.688+0000 7f86da1f0640 1 -- 172.21.15.123:0/288671534 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557af78b0c00 con 0x557af7bb3270 2024-09-15T23:14:57.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.688+0000 7f86da1f0640 1 --2- 172.21.15.123:0/288671534 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557af7bb3270 0x557af7b955d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f86cc089660 tx=0x7f86cc058c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e34782c74a9b5dca server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:57.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.688+0000 7f86b77fe640 1 -- 172.21.15.123:0/288671534 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86cc087070 con 0x557af7bb3270 2024-09-15T23:14:57.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.688+0000 7f86b77fe640 1 -- 172.21.15.123:0/288671534 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86cc0572f0 con 0x557af7bb3270 2024-09-15T23:14:57.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.688+0000 7f86b77fe640 1 -- 172.21.15.123:0/288671534 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86cc005700 con 0x557af7bb3270 2024-09-15T23:14:57.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.689+0000 7f86de9ec740 1 -- 172.21.15.123:0/288671534 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557af7bb3270 msgr2=0x557af7b955d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.689+0000 7f86de9ec740 1 --2- 172.21.15.123:0/288671534 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557af7bb3270 0x557af7b955d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f86cc089660 tx=0x7f86cc058c70 comp rx=0 tx=0).stop 2024-09-15T23:14:57.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.689+0000 7f86de9ec740 1 -- 172.21.15.123:0/288671534 shutdown_connections 2024-09-15T23:14:57.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.689+0000 7f86de9ec740 1 --2- 172.21.15.123:0/288671534 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557af7bb3270 0x557af7b955d0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.689+0000 7f86de9ec740 1 --2- 172.21.15.123:0/288671534 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557af7bb2e10 0x557af7bb49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.689+0000 7f86de9ec740 1 --2- 172.21.15.123:0/288671534 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557af7bb5650 0x557af7bb5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.689+0000 7f86de9ec740 1 -- 172.21.15.123:0/288671534 >> 172.21.15.123:0/288671534 conn(0x557af7b6b2b0 msgr2=0x557af7bb36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:57.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.689+0000 7f86de9ec740 1 -- 172.21.15.123:0/288671534 shutdown_connections 2024-09-15T23:14:57.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.689+0000 7f86de9ec740 1 -- 172.21.15.123:0/288671534 wait complete. 2024-09-15T23:14:57.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.689+0000 7f86de9ec740 1 -- start start 2024-09-15T23:14:57.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.689+0000 7f86de9ec740 1 Processor -- start 2024-09-15T23:14:57.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.690+0000 7f86de9ec740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557af7bb3270 0x557af7b966a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.690+0000 7f86de9ec740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557af7bb5650 0x557af7b934d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.690+0000 7f86de9ec740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557af7bac5d0 0x557af7baca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.690+0000 7f86de9ec740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x557af7bb1d70 con 0x557af7bb3270 2024-09-15T23:14:57.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.690+0000 7f86de9ec740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x557af7a5a900 con 0x557af7bac5d0 2024-09-15T23:14:57.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.690+0000 7f86de9ec740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x557af7bb2050 con 0x557af7bb5650 2024-09-15T23:14:57.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.690+0000 7f86de9ec740 10 client.0 _ll_register_callbacks cb 0x557af77e3fe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:57.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.690+0000 7f86d99ef640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557af7bb3270 0x557af7b966a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.690+0000 7f86d99ef640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557af7bb3270 0x557af7b966a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45584/0 (socket says 172.21.15.123:45584) 2024-09-15T23:14:57.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.690+0000 7f86d99ef640 1 -- 172.21.15.123:0/1457234906 learned_addr learned my addr 172.21.15.123:0/1457234906 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:57.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.690+0000 7f86d91ee640 1 --2- 172.21.15.123:0/1457234906 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557af7bb5650 0x557af7b934d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.690+0000 7f86da1f0640 1 --2- 172.21.15.123:0/1457234906 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557af7bac5d0 0x557af7baca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.691+0000 7f86d99ef640 1 -- 172.21.15.123:0/1457234906 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557af7bb5650 msgr2=0x557af7b934d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.691+0000 7f86d99ef640 1 --2- 172.21.15.123:0/1457234906 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557af7bb5650 0x557af7b934d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.691+0000 7f86d99ef640 1 -- 172.21.15.123:0/1457234906 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557af7bac5d0 msgr2=0x557af7baca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.691+0000 7f86d99ef640 1 --2- 172.21.15.123:0/1457234906 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557af7bac5d0 0x557af7baca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.691+0000 7f86d99ef640 1 -- 172.21.15.123:0/1457234906 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557af77a44f0 con 0x557af7bb3270 2024-09-15T23:14:57.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.691+0000 7f86d99ef640 1 --2- 172.21.15.123:0/1457234906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557af7bb3270 0x557af7b966a0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f86d0003920 tx=0x7f86d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1282ff4a62813fad server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:57.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.691+0000 7f86b4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:57.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.691+0000 7f86b4ff9640 1 -- 172.21.15.123:0/1457234906 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d0027070 con 0x557af7bb3270 2024-09-15T23:14:57.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.691+0000 7f86b4ff9640 1 -- 172.21.15.123:0/1457234906 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7f86d0023690 con 0x557af7bb3270 2024-09-15T23:14:57.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.691+0000 7f86de9ec740 1 -- 172.21.15.123:0/1457234906 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86cc0572f0 con 0x557af7bb3270 2024-09-15T23:14:57.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.691+0000 7f86b4ff9640 1 -- 172.21.15.123:0/1457234906 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f86d0023890 con 0x557af7bb3270 2024-09-15T23:14:57.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.691+0000 7f86de9ec740 10 client.5919 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:57.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.691+0000 7f86de9ec740 1 -- 172.21.15.123:0/1457234906 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x557af7911390 con 0x557af7bb3270 2024-09-15T23:14:57.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.691+0000 7f86b4ff9640 1 -- 172.21.15.123:0/1457234906 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86cc0572f0 con 0x557af7bb3270 2024-09-15T23:14:57.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.691+0000 7f86b4ff9640 1 -- 172.21.15.123:0/1457234906 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f86d0035080 con 0x557af7bb3270 2024-09-15T23:14:57.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.691+0000 7f86de9ec740 10 client.5919 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:57.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.691+0000 7f86de9ec740 10 client.5919 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:57.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.691+0000 7f86de9ec740 20 client.5919 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:57.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.691+0000 7f86de9ec740 1 --2- 172.21.15.123:0/1457234906 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x557af7baaaa0 0x557af7b98bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.691+0000 7f86de9ec740 4 client.5919 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:14:57.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.691+0000 7f86de9ec740 1 -- 172.21.15.123:0/1457234906 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557af7adf340 con 0x557af7baaaa0 2024-09-15T23:14:57.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.692+0000 7f86d91ee640 1 --2- 172.21.15.123:0/1457234906 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x557af7baaaa0 0x557af7b98bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.692+0000 7f86b4ff9640 10 client.5919 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:57.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.692+0000 7f86d91ee640 1 --2- 172.21.15.123:0/1457234906 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x557af7baaaa0 0x557af7b98bd0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0bf5d65c41f9819 server_cookie=816da2fe041b67ba in_seq=0 out_seq=0 2024-09-15T23:14:57.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.693+0000 7f86b4ff9640 1 -- 172.21.15.123:0/1457234906 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557af7adf340 con 0x557af7baaaa0 2024-09-15T23:14:57.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.693+0000 7f86b4ff9640 10 client.5919 handle_command_reply: tid=0 2024-09-15T23:14:57.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.693+0000 7f86de9ec740 1 client.5919 shutdown 2024-09-15T23:14:57.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.693+0000 7f86de9ec740 1 -- 172.21.15.123:0/1457234906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557af7bb3270 msgr2=0x557af7b966a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.693+0000 7f86de9ec740 1 --2- 172.21.15.123:0/1457234906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557af7bb3270 0x557af7b966a0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f86d0003920 tx=0x7f86d00046c0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.693+0000 7f86de9ec740 1 -- 172.21.15.123:0/1457234906 shutdown_connections 2024-09-15T23:14:57.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.693+0000 7f86de9ec740 1 --2- 172.21.15.123:0/1457234906 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x557af7baaaa0 0x557af7b98bd0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.693+0000 7f86de9ec740 1 --2- 172.21.15.123:0/1457234906 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557af7bac5d0 0x557af7baca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.693+0000 7f86de9ec740 1 --2- 172.21.15.123:0/1457234906 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557af7bb5650 0x557af7b934d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.693+0000 7f86b4ff9640 0 client.5919 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:57.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.693+0000 7f86de9ec740 1 --2- 172.21.15.123:0/1457234906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557af7bb3270 0x557af7b966a0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.693+0000 7f86de9ec740 1 -- 172.21.15.123:0/1457234906 >> 172.21.15.123:0/1457234906 conn(0x557af7bb2e10 msgr2=0x557af7b95bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:57.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.693+0000 7f86de9ec740 1 -- 172.21.15.123:0/1457234906 shutdown_connections 2024-09-15T23:14:57.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.693+0000 7f86de9ec740 1 -- 172.21.15.123:0/1457234906 wait complete. 2024-09-15T23:14:57.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.693+0000 7f86de9ec740 20 client.5919 trim_cache size 0 max 16384 2024-09-15T23:14:57.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.710+0000 7f86de9ec740 1 Processor -- start 2024-09-15T23:14:57.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.710+0000 7f86de9ec740 1 -- start start 2024-09-15T23:14:57.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.711+0000 7f86de9ec740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557af7bac5d0 0x557af7b68f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.711+0000 7f86de9ec740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557af7bb3270 0x557af7b98b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.711+0000 7f86de9ec740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557af7bb5650 0x557af7b990d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.711+0000 7f86de9ec740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f86d4200da0 con 0x557af7bac5d0 2024-09-15T23:14:57.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.711+0000 7f86de9ec740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f86d4160a00 con 0x557af7bb3270 2024-09-15T23:14:57.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.711+0000 7f86de9ec740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f86d415fd90 con 0x557af7bb5650 2024-09-15T23:14:57.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.711+0000 7f86d99ef640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557af7bac5d0 0x557af7b68f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.711+0000 7f86d99ef640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557af7bac5d0 0x557af7b68f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45598/0 (socket says 172.21.15.123:45598) 2024-09-15T23:14:57.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.711+0000 7f86d99ef640 1 -- 172.21.15.123:0/227473788 learned_addr learned my addr 172.21.15.123:0/227473788 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:57.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.711+0000 7f86d99ef640 1 -- 172.21.15.123:0/227473788 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557af7bb5650 msgr2=0x557af7b990d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.711+0000 7f86d99ef640 1 --2- 172.21.15.123:0/227473788 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557af7bb5650 0x557af7b990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.711+0000 7f86d99ef640 1 -- 172.21.15.123:0/227473788 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557af7bb3270 msgr2=0x557af7b98b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.711+0000 7f86d99ef640 1 --2- 172.21.15.123:0/227473788 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557af7bb3270 0x557af7b98b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.711+0000 7f86d99ef640 1 -- 172.21.15.123:0/227473788 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557af777d5b0 con 0x557af7bac5d0 2024-09-15T23:14:57.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.711+0000 7f86d99ef640 1 --2- 172.21.15.123:0/227473788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557af7bac5d0 0x557af7b68f70 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f86d0009430 tx=0x7f86d001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6145db27dd583bf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:57.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.712+0000 7f86b6ffd640 1 -- 172.21.15.123:0/227473788 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d0027050 con 0x557af7bac5d0 2024-09-15T23:14:57.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.712+0000 7f86b6ffd640 1 -- 172.21.15.123:0/227473788 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86d001b030 con 0x557af7bac5d0 2024-09-15T23:14:57.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.712+0000 7f86b6ffd640 1 -- 172.21.15.123:0/227473788 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86d0023a30 con 0x557af7bac5d0 2024-09-15T23:14:57.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.712+0000 7f86de9ec740 1 -- 172.21.15.123:0/227473788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557af7bac5d0 msgr2=0x557af7b68f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.712+0000 7f86de9ec740 1 --2- 172.21.15.123:0/227473788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557af7bac5d0 0x557af7b68f70 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f86d0009430 tx=0x7f86d001d000 comp rx=0 tx=0).stop 2024-09-15T23:14:57.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.712+0000 7f86de9ec740 1 -- 172.21.15.123:0/227473788 shutdown_connections 2024-09-15T23:14:57.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.712+0000 7f86de9ec740 1 --2- 172.21.15.123:0/227473788 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557af7bb5650 0x557af7b990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.712+0000 7f86de9ec740 1 --2- 172.21.15.123:0/227473788 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557af7bb3270 0x557af7b98b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.712+0000 7f86de9ec740 1 --2- 172.21.15.123:0/227473788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557af7bac5d0 0x557af7b68f70 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.712+0000 7f86de9ec740 1 -- 172.21.15.123:0/227473788 >> 172.21.15.123:0/227473788 conn(0x557af7bb2e10 msgr2=0x557af7b6a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:57.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.712+0000 7f86de9ec740 1 -- 172.21.15.123:0/227473788 shutdown_connections 2024-09-15T23:14:57.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.712+0000 7f86de9ec740 1 -- 172.21.15.123:0/227473788 wait complete. 2024-09-15T23:14:57.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.713+0000 7f86de9ec740 1 -- start start 2024-09-15T23:14:57.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.713+0000 7f86de9ec740 1 Processor -- start 2024-09-15T23:14:57.718 INFO:tasks.ceph.mds.d.smithi188.stderr:2024-09-15T23:14:57.716+0000 7fe816845640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a4e [2,head] /scrub_test_path/ceph-qa-suite/new_file_1 auth v471 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={5095=0-4194304@1} caps={5095=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5095 | request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x562327349600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000a4e:[<0x10000000001/new_file_1 v471>,<0x10000000000/ceph-qa-suite v63>,<0x1/scrub_test_path v21>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61} 2024-09-15T23:14:57.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.714+0000 7f86de9ec740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557af7bac5d0 0x557af7bc01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.714+0000 7f86de9ec740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557af7bb3270 0x557af7b6e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.714+0000 7f86de9ec740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557af7bb5650 0x557af7c30e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.714+0000 7f86de9ec740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f86d41603b0 con 0x557af7bb3270 2024-09-15T23:14:57.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.714+0000 7f86de9ec740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x557af7b96640 con 0x557af7bb5650 2024-09-15T23:14:57.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.714+0000 7f86de9ec740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x557af7bc0a40 con 0x557af7bac5d0 2024-09-15T23:14:57.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.714+0000 7f86de9ec740 10 client.0 _ll_register_callbacks cb 0x7f86d0004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:57.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.714+0000 7f86d91ee640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557af7bb3270 0x557af7b6e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.714+0000 7f86d91ee640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557af7bb3270 0x557af7b6e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45602/0 (socket says 172.21.15.123:45602) 2024-09-15T23:14:57.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.714+0000 7f86d91ee640 1 -- 172.21.15.123:0/2398866716 learned_addr learned my addr 172.21.15.123:0/2398866716 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:57.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.714+0000 7f86d91ee640 1 -- 172.21.15.123:0/2398866716 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557af7bac5d0 msgr2=0x557af7bc01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.714+0000 7f86d91ee640 1 --2- 172.21.15.123:0/2398866716 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557af7bac5d0 0x557af7bc01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.714+0000 7f86d91ee640 1 -- 172.21.15.123:0/2398866716 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557af7bb5650 msgr2=0x557af7c30e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.714+0000 7f86d91ee640 1 --2- 172.21.15.123:0/2398866716 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557af7bb5650 0x557af7c30e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.714+0000 7f86d91ee640 1 -- 172.21.15.123:0/2398866716 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557af7bb10a0 con 0x557af7bb3270 2024-09-15T23:14:57.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.714+0000 7f86d91ee640 1 --2- 172.21.15.123:0/2398866716 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557af7bb3270 0x557af7b6e720 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f86c4009870 tx=0x7f86c4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d4523cb574ddb00 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:57.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.714+0000 7f86b4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:57.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.714+0000 7f86b4ff9640 1 -- 172.21.15.123:0/2398866716 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c4037040 con 0x557af7bb3270 2024-09-15T23:14:57.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.714+0000 7f86b4ff9640 1 -- 172.21.15.123:0/2398866716 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7f86c4046480 con 0x557af7bb3270 2024-09-15T23:14:57.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.714+0000 7f86de9ec740 1 -- 172.21.15.123:0/2398866716 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86d001b030 con 0x557af7bb3270 2024-09-15T23:14:57.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.714+0000 7f86b4ff9640 1 -- 172.21.15.123:0/2398866716 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f86c4057050 con 0x557af7bb3270 2024-09-15T23:14:57.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.714+0000 7f86de9ec740 10 client.5925 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:57.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.715+0000 7f86de9ec740 1 -- 172.21.15.123:0/2398866716 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x557af7bc07d0 con 0x557af7bb3270 2024-09-15T23:14:57.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.715+0000 7f86b4ff9640 1 -- 172.21.15.123:0/2398866716 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86d001b030 con 0x557af7bb3270 2024-09-15T23:14:57.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.715+0000 7f86b4ff9640 1 -- 172.21.15.123:0/2398866716 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f86c405a020 con 0x557af7bb3270 2024-09-15T23:14:57.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.715+0000 7f86de9ec740 10 client.5925 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:57.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.715+0000 7f86de9ec740 10 client.5925 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:57.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.715+0000 7f86de9ec740 20 client.5925 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:57.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.715+0000 7f86de9ec740 1 --2- 172.21.15.123:0/2398866716 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x557af7b694f0 0x557af7b98b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.715+0000 7f86de9ec740 4 client.5925 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}] 2024-09-15T23:14:57.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.715+0000 7f86de9ec740 1 -- 172.21.15.123:0/2398866716 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}) -- 0x557af7ad9690 con 0x557af7b694f0 2024-09-15T23:14:57.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.715+0000 7f86d99ef640 1 --2- 172.21.15.123:0/2398866716 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x557af7b694f0 0x557af7b98b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.715+0000 7f86d99ef640 1 --2- 172.21.15.123:0/2398866716 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x557af7b694f0 0x557af7b98b60 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17fcf833622273a5 server_cookie=9752a20886cf96b8 in_seq=0 out_seq=0 2024-09-15T23:14:57.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.715+0000 7f86b4ff9640 10 client.5925 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:57.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.716+0000 7f86b4ff9640 1 -- 172.21.15.123:0/2398866716 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557af7ad9690 con 0x557af7b694f0 2024-09-15T23:14:57.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.716+0000 7f86b4ff9640 10 client.5925 handle_command_reply: tid=0 2024-09-15T23:14:57.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.716+0000 7f86de9ec740 1 client.5925 shutdown 2024-09-15T23:14:57.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.716+0000 7f86de9ec740 1 -- 172.21.15.123:0/2398866716 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557af7bb3270 msgr2=0x557af7b6e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.716+0000 7f86de9ec740 1 --2- 172.21.15.123:0/2398866716 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557af7bb3270 0x557af7b6e720 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f86c4009870 tx=0x7f86c4004730 comp rx=0 tx=0).stop 2024-09-15T23:14:57.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.716+0000 7f86de9ec740 1 -- 172.21.15.123:0/2398866716 shutdown_connections 2024-09-15T23:14:57.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.716+0000 7f86de9ec740 1 --2- 172.21.15.123:0/2398866716 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x557af7b694f0 0x557af7b98b60 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.716+0000 7f86de9ec740 1 --2- 172.21.15.123:0/2398866716 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557af7bb5650 0x557af7c30e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.716+0000 7f86de9ec740 1 --2- 172.21.15.123:0/2398866716 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557af7bb3270 0x557af7b6e720 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.716+0000 7f86b4ff9640 0 client.5925 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:57.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.716+0000 7f86de9ec740 1 --2- 172.21.15.123:0/2398866716 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557af7bac5d0 0x557af7bc01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.716+0000 7f86de9ec740 1 -- 172.21.15.123:0/2398866716 >> 172.21.15.123:0/2398866716 conn(0x557af7bb2e10 msgr2=0x557af7bb6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:57.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.716+0000 7f86de9ec740 1 -- 172.21.15.123:0/2398866716 shutdown_connections 2024-09-15T23:14:57.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.716+0000 7f86de9ec740 1 -- 172.21.15.123:0/2398866716 wait complete. 2024-09-15T23:14:57.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.716+0000 7f86de9ec740 20 client.5925 trim_cache size 0 max 16384 2024-09-15T23:14:57.727 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:14:57.727 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0, 2024-09-15T23:14:57.728 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_tag": "f12b799a-41e6-4196-b5eb-4e700227db93", 2024-09-15T23:14:57.728 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": "asynchronous" 2024-09-15T23:14:57.728 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:14:57.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.717+0000 7f86dbc53640 1 -- 172.21.15.123:0/1139602319 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f86b806c2e0 msgr2=0x7f86b806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.717+0000 7f86dbc53640 1 --2- 172.21.15.123:0/1139602319 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f86b806c2e0 0x7f86b806e7a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f86d40d3210 tx=0x7f86d0009190 comp rx=0 tx=0).stop 2024-09-15T23:14:57.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.717+0000 7f86dbc53640 1 -- 172.21.15.123:0/1139602319 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86d40b38a0 msgr2=0x7f86d414be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.717+0000 7f86dbc53640 1 --2- 172.21.15.123:0/1139602319 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86d40b38a0 0x7f86d414be40 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f86cc00c780 tx=0x7f86cc00cb80 comp rx=0 tx=0).stop 2024-09-15T23:14:57.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.717+0000 7f86dbc53640 1 -- 172.21.15.123:0/1139602319 shutdown_connections 2024-09-15T23:14:57.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.717+0000 7f86dbc53640 1 --2- 172.21.15.123:0/1139602319 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f86b806c2e0 0x7f86b806e7a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.717+0000 7f86dbc53640 1 --2- 172.21.15.123:0/1139602319 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f86d40b38a0 0x7f86d414be40 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.717+0000 7f86dbc53640 1 --2- 172.21.15.123:0/1139602319 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f86d40b3350 0x7f86d40cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.717+0000 7f86dbc53640 1 --2- 172.21.15.123:0/1139602319 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86d406bfd0 0x7f86d40ab120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.717+0000 7f86dbc53640 1 -- 172.21.15.123:0/1139602319 >> 172.21.15.123:0/1139602319 conn(0x7f86d40d11c0 msgr2=0x7f86d40cd790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:57.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.717+0000 7f86dbc53640 1 -- 172.21.15.123:0/1139602319 shutdown_connections 2024-09-15T23:14:57.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.717+0000 7f86dbc53640 1 -- 172.21.15.123:0/1139602319 wait complete. 2024-09-15T23:14:57.731 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_1' returned '{'return_code': 0, 'scrub_tag': 'f12b799a-41e6-4196-b5eb-4e700227db93', 'mode': 'asynchronous'}' 2024-09-15T23:14:57.731 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-15T23:14:57.731 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-15T23:14:57.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.831+0000 7f18726d7640 1 Processor -- start 2024-09-15T23:14:57.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.831+0000 7f18726d7640 1 -- start start 2024-09-15T23:14:57.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.832+0000 7f18726d7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f186c0730f0 0x7f186c073530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.832+0000 7f18726d7640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f186c06f460 0x7f186c06f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.832+0000 7f18726d7640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f186c15cbd0 con 0x7f186c15c7f0 2024-09-15T23:14:57.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.832+0000 7f18726d7640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f186c0cecf0 con 0x7f186c0730f0 2024-09-15T23:14:57.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.832+0000 7f18726d7640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f186c073a70 con 0x7f186c06f460 2024-09-15T23:14:57.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.832+0000 7f186b7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f186c0730f0 0x7f186c073530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.832+0000 7f186bfff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f186c15c7f0 0x7f186c0b16f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54486/0 (socket says 172.21.15.123:54486) 2024-09-15T23:14:57.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.832+0000 7f186bfff640 1 -- 172.21.15.123:0/2163609156 learned_addr learned my addr 172.21.15.123:0/2163609156 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:14:57.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.832+0000 7f186b7fe640 1 -- 172.21.15.123:0/2163609156 >> v2:172.21.15.188:3300/0 conn(0x7f186c06f460 msgr2=0x7f186c06f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.832+0000 7f186b7fe640 1 --2- 172.21.15.123:0/2163609156 >> v2:172.21.15.188:3300/0 conn(0x7f186c06f460 0x7f186c06f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.832+0000 7f186b7fe640 1 -- 172.21.15.123:0/2163609156 >> v1:172.21.15.123:6789/0 conn(0x7f186c15c7f0 legacy=0x7f186c0b16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.832+0000 7f186b7fe640 1 -- 172.21.15.123:0/2163609156 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f186c0ce0e0 con 0x7f186c0730f0 2024-09-15T23:14:57.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.833+0000 7f186b7fe640 1 --2- 172.21.15.123:0/2163609156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f186c0730f0 0x7f186c073530 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f186c068860 tx=0x7f186002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ecb5616d3e0c45 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:57.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.833+0000 7f186affd640 1 -- 172.21.15.123:0/2163609156 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1860037070 con 0x7f186c0730f0 2024-09-15T23:14:57.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.833+0000 7f186affd640 1 -- 172.21.15.123:0/2163609156 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1860032440 con 0x7f186c0730f0 2024-09-15T23:14:57.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.833+0000 7f186affd640 1 -- 172.21.15.123:0/2163609156 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1860032810 con 0x7f186c0730f0 2024-09-15T23:14:57.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.834+0000 7f18726d7640 1 -- 172.21.15.123:0/2163609156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f186c0730f0 msgr2=0x7f186c073530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.834+0000 7f18726d7640 1 --2- 172.21.15.123:0/2163609156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f186c0730f0 0x7f186c073530 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f186c068860 tx=0x7f186002a1a0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.834+0000 7f18726d7640 1 -- 172.21.15.123:0/2163609156 shutdown_connections 2024-09-15T23:14:57.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.834+0000 7f18726d7640 1 --2- 172.21.15.123:0/2163609156 >> v2:172.21.15.188:3300/0 conn(0x7f186c06f460 0x7f186c06f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.834+0000 7f18726d7640 1 --2- 172.21.15.123:0/2163609156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f186c0730f0 0x7f186c073530 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.834+0000 7f18726d7640 1 -- 172.21.15.123:0/2163609156 >> 172.21.15.123:0/2163609156 conn(0x7f186c0d2570 msgr2=0x7f186c0d2980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:57.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.834+0000 7f18726d7640 1 -- 172.21.15.123:0/2163609156 shutdown_connections 2024-09-15T23:14:57.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.834+0000 7f18726d7640 1 -- 172.21.15.123:0/2163609156 wait complete. 2024-09-15T23:14:57.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.835+0000 7f18726d7640 1 Processor -- start 2024-09-15T23:14:57.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.835+0000 7f18726d7640 1 -- start start 2024-09-15T23:14:57.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.836+0000 7f18726d7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f186c06f460 0x7f186c0c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.836+0000 7f18726d7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f186c0730f0 0x7f186c14ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.836+0000 7f18726d7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f186c15c7f0 0x7f186c0b64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.836+0000 7f18726d7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f186c0ce980 con 0x7f186c06f460 2024-09-15T23:14:57.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.836+0000 7f18726d7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f186c0ce6a0 con 0x7f186c15c7f0 2024-09-15T23:14:57.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.836+0000 7f18726d7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f186c0b1e00 con 0x7f186c0730f0 2024-09-15T23:14:57.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.836+0000 7f186bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f186c06f460 0x7f186c0c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.836+0000 7f186bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f186c06f460 0x7f186c0c8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45614/0 (socket says 172.21.15.123:45614) 2024-09-15T23:14:57.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.836+0000 7f186bfff640 1 -- 172.21.15.123:0/2387669748 learned_addr learned my addr 172.21.15.123:0/2387669748 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:57.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.836+0000 7f186b7fe640 1 --2- 172.21.15.123:0/2387669748 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f186c0730f0 0x7f186c14ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.836+0000 7f1870c74640 1 --2- 172.21.15.123:0/2387669748 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f186c15c7f0 0x7f186c0b64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.836+0000 7f186bfff640 1 -- 172.21.15.123:0/2387669748 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f186c0730f0 msgr2=0x7f186c14ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.836+0000 7f186bfff640 1 --2- 172.21.15.123:0/2387669748 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f186c0730f0 0x7f186c14ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.836+0000 7f186bfff640 1 -- 172.21.15.123:0/2387669748 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f186c15c7f0 msgr2=0x7f186c0b64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.836+0000 7f186bfff640 1 --2- 172.21.15.123:0/2387669748 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f186c15c7f0 0x7f186c0b64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.836+0000 7f186bfff640 1 -- 172.21.15.123:0/2387669748 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f186c1494e0 con 0x7f186c06f460 2024-09-15T23:14:57.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.836+0000 7f186bfff640 1 --2- 172.21.15.123:0/2387669748 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f186c06f460 0x7f186c0c8bb0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f185c00c3c0 tx=0x7f185c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:57.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.836+0000 7f1868ff9640 1 -- 172.21.15.123:0/2387669748 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f185c017070 con 0x7f186c06f460 2024-09-15T23:14:57.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.836+0000 7f1868ff9640 1 -- 172.21.15.123:0/2387669748 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f185c005ce0 con 0x7f186c06f460 2024-09-15T23:14:57.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.837+0000 7f1868ff9640 1 -- 172.21.15.123:0/2387669748 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f185c0072f0 con 0x7f186c06f460 2024-09-15T23:14:57.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.837+0000 7f18726d7640 1 -- 172.21.15.123:0/2387669748 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f186c0c90f0 con 0x7f186c06f460 2024-09-15T23:14:57.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.837+0000 7f18726d7640 1 -- 172.21.15.123:0/2387669748 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f186c14b8f0 con 0x7f186c06f460 2024-09-15T23:14:57.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.838+0000 7f1868ff9640 1 -- 172.21.15.123:0/2387669748 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f185c01a070 con 0x7f186c06f460 2024-09-15T23:14:57.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.838+0000 7f1868ff9640 1 --2- 172.21.15.123:0/2387669748 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f185806c2b0 0x7f185806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.839+0000 7f1868ff9640 1 -- 172.21.15.123:0/2387669748 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7f185c08a820 con 0x7f186c06f460 2024-09-15T23:14:57.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.839+0000 7f186b7fe640 1 --2- 172.21.15.123:0/2387669748 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f185806c2b0 0x7f185806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.839+0000 7f186b7fe640 1 --2- 172.21.15.123:0/2387669748 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f185806c2b0 0x7f185806e770 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1860034000 tx=0x7f186002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:57.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.839+0000 7f1875471740 1 Processor -- start 2024-09-15T23:14:57.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.840+0000 7f1875471740 1 -- start start 2024-09-15T23:14:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.840+0000 7f1875471740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f3ef1a9920 0x55f3ef1ef0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.840+0000 7f1875471740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f3ef1a70e0 0x55f3ef1a9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.840+0000 7f1875471740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f3ef1ab0b0 0x55f3ef1a41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.840+0000 7f1875471740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55f3ef10c6f0 con 0x55f3ef1ab0b0 2024-09-15T23:14:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.840+0000 7f1875471740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55f3ef0b4330 con 0x55f3ef1a9920 2024-09-15T23:14:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.840+0000 7f1875471740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55f3ef1086b0 con 0x55f3ef1a70e0 2024-09-15T23:14:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.840+0000 7f1870c74640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f3ef1ab0b0 0x55f3ef1a41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.840+0000 7f1870c74640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f3ef1ab0b0 0x55f3ef1a41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45620/0 (socket says 172.21.15.123:45620) 2024-09-15T23:14:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.840+0000 7f1870c74640 1 -- 172.21.15.123:0/2297554086 learned_addr learned my addr 172.21.15.123:0/2297554086 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.840+0000 7f186bfff640 1 --2- 172.21.15.123:0/2297554086 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f3ef1a9920 0x55f3ef1ef0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.840+0000 7f186b7fe640 1 --2- 172.21.15.123:0/2297554086 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f3ef1a70e0 0x55f3ef1a9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.841+0000 7f1870c74640 1 -- 172.21.15.123:0/2297554086 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f3ef1a70e0 msgr2=0x55f3ef1a9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.841+0000 7f1870c74640 1 --2- 172.21.15.123:0/2297554086 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f3ef1a70e0 0x55f3ef1a9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.841+0000 7f1870c74640 1 -- 172.21.15.123:0/2297554086 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f3ef1a9920 msgr2=0x55f3ef1ef0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.841+0000 7f1870c74640 1 --2- 172.21.15.123:0/2297554086 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f3ef1a9920 0x55f3ef1ef0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.841+0000 7f1870c74640 1 -- 172.21.15.123:0/2297554086 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3ef0da0d0 con 0x55f3ef1ab0b0 2024-09-15T23:14:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.841+0000 7f186b7fe640 1 --2- 172.21.15.123:0/2297554086 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f3ef1a70e0 0x55f3ef1a9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.841+0000 7f186bfff640 1 --2- 172.21.15.123:0/2297554086 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f3ef1a9920 0x55f3ef1ef0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:14:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.841+0000 7f1870c74640 1 --2- 172.21.15.123:0/2297554086 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f3ef1ab0b0 0x55f3ef1a41a0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f1864009f80 tx=0x7f186400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2445a2e21e7df46 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.841+0000 7f1851ffb640 1 -- 172.21.15.123:0/2297554086 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1864016420 con 0x55f3ef1ab0b0 2024-09-15T23:14:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.841+0000 7f1851ffb640 1 -- 172.21.15.123:0/2297554086 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18640165c0 con 0x55f3ef1ab0b0 2024-09-15T23:14:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.841+0000 7f1851ffb640 1 -- 172.21.15.123:0/2297554086 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18640169b0 con 0x55f3ef1ab0b0 2024-09-15T23:14:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.841+0000 7f1875471740 1 -- 172.21.15.123:0/2297554086 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f3ef1ab0b0 msgr2=0x55f3ef1a41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.841+0000 7f1875471740 1 --2- 172.21.15.123:0/2297554086 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f3ef1ab0b0 0x55f3ef1a41a0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f1864009f80 tx=0x7f186400c8b0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.841+0000 7f1875471740 1 -- 172.21.15.123:0/2297554086 shutdown_connections 2024-09-15T23:14:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.842+0000 7f1875471740 1 --2- 172.21.15.123:0/2297554086 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f3ef1ab0b0 0x55f3ef1a41a0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.842+0000 7f1875471740 1 --2- 172.21.15.123:0/2297554086 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f3ef1a70e0 0x55f3ef1a9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.842+0000 7f1875471740 1 --2- 172.21.15.123:0/2297554086 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f3ef1a9920 0x55f3ef1ef0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.842+0000 7f1875471740 1 -- 172.21.15.123:0/2297554086 >> 172.21.15.123:0/2297554086 conn(0x55f3ef1a6370 msgr2=0x55f3ef1ee590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.842+0000 7f1875471740 1 -- 172.21.15.123:0/2297554086 shutdown_connections 2024-09-15T23:14:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.842+0000 7f1875471740 1 -- 172.21.15.123:0/2297554086 wait complete. 2024-09-15T23:14:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.842+0000 7f1875471740 1 -- start start 2024-09-15T23:14:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.842+0000 7f1875471740 1 Processor -- start 2024-09-15T23:14:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.843+0000 7f1875471740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f3ef1a9920 0x55f3ef1c8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.843+0000 7f1875471740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f3ef1ab0b0 0x55f3ef1c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.843+0000 7f1875471740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f3ef1a30c0 0x55f3ef1d3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.843+0000 7f1875471740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55f3ef1a5810 con 0x55f3ef1ab0b0 2024-09-15T23:14:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.843+0000 7f1875471740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55f3ef0954f0 con 0x55f3ef1a30c0 2024-09-15T23:14:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.843+0000 7f1875471740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55f3ef1ef8f0 con 0x55f3ef1a9920 2024-09-15T23:14:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.843+0000 7f1875471740 10 client.0 _ll_register_callbacks cb 0x55f3ef0b6b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.843+0000 7f186b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f3ef1ab0b0 0x55f3ef1c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.843+0000 7f186b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f3ef1ab0b0 0x55f3ef1c96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45628/0 (socket says 172.21.15.123:45628) 2024-09-15T23:14:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.843+0000 7f186b7fe640 1 -- 172.21.15.123:0/4083084619 learned_addr learned my addr 172.21.15.123:0/4083084619 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.843+0000 7f186b7fe640 1 -- 172.21.15.123:0/4083084619 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f3ef1a9920 msgr2=0x55f3ef1c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.843+0000 7f186bfff640 1 --2- 172.21.15.123:0/4083084619 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f3ef1a9920 0x55f3ef1c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.843+0000 7f1870c74640 1 --2- 172.21.15.123:0/4083084619 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f3ef1a30c0 0x55f3ef1d3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.843+0000 7f186b7fe640 1 --2- 172.21.15.123:0/4083084619 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f3ef1a9920 0x55f3ef1c8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.843+0000 7f186b7fe640 1 -- 172.21.15.123:0/4083084619 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f3ef1a30c0 msgr2=0x55f3ef1d3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.843+0000 7f186b7fe640 1 --2- 172.21.15.123:0/4083084619 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f3ef1a30c0 0x55f3ef1d3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.843+0000 7f186b7fe640 1 -- 172.21.15.123:0/4083084619 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3eeee97d0 con 0x55f3ef1ab0b0 2024-09-15T23:14:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.844+0000 7f186b7fe640 1 --2- 172.21.15.123:0/4083084619 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f3ef1ab0b0 0x55f3ef1c96a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f1860009890 tx=0x7f1860004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d49332c2c5a591f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.844+0000 7f184affd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.844+0000 7f184affd640 1 -- 172.21.15.123:0/4083084619 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f186004e060 con 0x55f3ef1ab0b0 2024-09-15T23:14:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.844+0000 7f184affd640 1 -- 172.21.15.123:0/4083084619 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7f186003e9f0 con 0x55f3ef1ab0b0 2024-09-15T23:14:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.844+0000 7f1875471740 1 -- 172.21.15.123:0/4083084619 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18640165c0 con 0x55f3ef1ab0b0 2024-09-15T23:14:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.844+0000 7f184affd640 1 -- 172.21.15.123:0/4083084619 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1860054050 con 0x55f3ef1ab0b0 2024-09-15T23:14:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.844+0000 7f1875471740 10 client.5940 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.844+0000 7f1875471740 1 -- 172.21.15.123:0/4083084619 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55f3eee1f3f0 con 0x55f3ef1ab0b0 2024-09-15T23:14:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.844+0000 7f184affd640 1 -- 172.21.15.123:0/4083084619 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18640165c0 con 0x55f3ef1ab0b0 2024-09-15T23:14:57.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.844+0000 7f184affd640 1 -- 172.21.15.123:0/4083084619 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f1860057020 con 0x55f3ef1ab0b0 2024-09-15T23:14:57.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.844+0000 7f1875471740 10 client.5940 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:57.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.844+0000 7f1875471740 10 client.5940 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:57.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.844+0000 7f1875471740 20 client.5940 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:57.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.844+0000 7f1875471740 1 --2- 172.21.15.123:0/4083084619 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55f3ef1a84c0 0x55f3ef1a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.844+0000 7f1875471740 4 client.5940 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:14:57.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.844+0000 7f1875471740 1 -- 172.21.15.123:0/4083084619 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3ef119e20 con 0x55f3ef1a84c0 2024-09-15T23:14:57.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.844+0000 7f186bfff640 1 --2- 172.21.15.123:0/4083084619 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55f3ef1a84c0 0x55f3ef1a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.845+0000 7f184affd640 10 client.5940 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:57.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.845+0000 7f186bfff640 1 --2- 172.21.15.123:0/4083084619 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55f3ef1a84c0 0x55f3ef1a88d0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c5e185dd9ad911c server_cookie=2eb78ac16d0fd3a7 in_seq=0 out_seq=0 2024-09-15T23:14:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.845+0000 7f184affd640 1 -- 172.21.15.123:0/4083084619 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f3ef119e20 con 0x55f3ef1a84c0 2024-09-15T23:14:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.845+0000 7f184affd640 10 client.5940 handle_command_reply: tid=0 2024-09-15T23:14:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.846+0000 7f1875471740 1 client.5940 shutdown 2024-09-15T23:14:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.846+0000 7f1875471740 1 -- 172.21.15.123:0/4083084619 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f3ef1ab0b0 msgr2=0x55f3ef1c96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.846+0000 7f1875471740 1 --2- 172.21.15.123:0/4083084619 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f3ef1ab0b0 0x55f3ef1c96a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f1860009890 tx=0x7f1860004730 comp rx=0 tx=0).stop 2024-09-15T23:14:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.846+0000 7f1875471740 1 -- 172.21.15.123:0/4083084619 shutdown_connections 2024-09-15T23:14:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.846+0000 7f1875471740 1 --2- 172.21.15.123:0/4083084619 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55f3ef1a84c0 0x55f3ef1a88d0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.846+0000 7f1875471740 1 --2- 172.21.15.123:0/4083084619 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f3ef1a30c0 0x55f3ef1d3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.846+0000 7f1875471740 1 --2- 172.21.15.123:0/4083084619 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f3ef1ab0b0 0x55f3ef1c96a0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.846+0000 7f184affd640 0 client.5940 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.846+0000 7f1875471740 1 --2- 172.21.15.123:0/4083084619 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f3ef1a9920 0x55f3ef1c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.846+0000 7f1875471740 1 -- 172.21.15.123:0/4083084619 >> 172.21.15.123:0/4083084619 conn(0x55f3ef1a70e0 msgr2=0x55f3ef1ec540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.846+0000 7f1875471740 1 -- 172.21.15.123:0/4083084619 shutdown_connections 2024-09-15T23:14:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.846+0000 7f1875471740 1 -- 172.21.15.123:0/4083084619 wait complete. 2024-09-15T23:14:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.846+0000 7f1875471740 20 client.5940 trim_cache size 0 max 16384 2024-09-15T23:14:57.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.863+0000 7f1875471740 1 Processor -- start 2024-09-15T23:14:57.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.863+0000 7f1875471740 1 -- start start 2024-09-15T23:14:57.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.863+0000 7f1875471740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f3ef1a30c0 0x55f3ef1c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.863+0000 7f1875471740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f3ef1a9920 0x55f3ef1a7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.863+0000 7f1875471740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f3ef1ab0b0 0x55f3ef1a89a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.863+0000 7f1875471740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f186c200f60 con 0x55f3ef1ab0b0 2024-09-15T23:14:57.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.863+0000 7f1875471740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f186c1fff80 con 0x55f3ef1a9920 2024-09-15T23:14:57.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.863+0000 7f1875471740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f186c0cc0c0 con 0x55f3ef1a30c0 2024-09-15T23:14:57.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.864+0000 7f1870c74640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f3ef1ab0b0 0x55f3ef1a89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.864+0000 7f1870c74640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f3ef1ab0b0 0x55f3ef1a89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45632/0 (socket says 172.21.15.123:45632) 2024-09-15T23:14:57.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.864+0000 7f1870c74640 1 -- 172.21.15.123:0/3816982419 learned_addr learned my addr 172.21.15.123:0/3816982419 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:57.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.864+0000 7f1870c74640 1 -- 172.21.15.123:0/3816982419 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f3ef1a30c0 msgr2=0x55f3ef1c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.864+0000 7f1870c74640 1 --2- 172.21.15.123:0/3816982419 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f3ef1a30c0 0x55f3ef1c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.864+0000 7f1870c74640 1 -- 172.21.15.123:0/3816982419 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f3ef1a9920 msgr2=0x55f3ef1a7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.864+0000 7f1870c74640 1 --2- 172.21.15.123:0/3816982419 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f3ef1a9920 0x55f3ef1a7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.864+0000 7f1870c74640 1 -- 172.21.15.123:0/3816982419 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3eeddf0f0 con 0x55f3ef1ab0b0 2024-09-15T23:14:57.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.864+0000 7f1870c74640 1 --2- 172.21.15.123:0/3816982419 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f3ef1ab0b0 0x55f3ef1a89a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f1864000f80 tx=0x7f186400e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adc8201d244aded4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:57.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.864+0000 7f18517fa640 1 -- 172.21.15.123:0/3816982419 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1864023070 con 0x55f3ef1ab0b0 2024-09-15T23:14:57.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.864+0000 7f18517fa640 1 -- 172.21.15.123:0/3816982419 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1864009a50 con 0x55f3ef1ab0b0 2024-09-15T23:14:57.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.864+0000 7f18517fa640 1 -- 172.21.15.123:0/3816982419 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f186401e660 con 0x55f3ef1ab0b0 2024-09-15T23:14:57.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.865+0000 7f1875471740 1 -- 172.21.15.123:0/3816982419 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f3ef1ab0b0 msgr2=0x55f3ef1a89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.865+0000 7f1875471740 1 --2- 172.21.15.123:0/3816982419 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f3ef1ab0b0 0x55f3ef1a89a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f1864000f80 tx=0x7f186400e000 comp rx=0 tx=0).stop 2024-09-15T23:14:57.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.865+0000 7f1875471740 1 -- 172.21.15.123:0/3816982419 shutdown_connections 2024-09-15T23:14:57.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.865+0000 7f1875471740 1 --2- 172.21.15.123:0/3816982419 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f3ef1ab0b0 0x55f3ef1a89a0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.865+0000 7f1875471740 1 --2- 172.21.15.123:0/3816982419 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f3ef1a9920 0x55f3ef1a7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.865+0000 7f1875471740 1 --2- 172.21.15.123:0/3816982419 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f3ef1a30c0 0x55f3ef1c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.865+0000 7f1875471740 1 -- 172.21.15.123:0/3816982419 >> 172.21.15.123:0/3816982419 conn(0x55f3ef1a70e0 msgr2=0x55f3ef1a4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:57.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.865+0000 7f1875471740 1 -- 172.21.15.123:0/3816982419 shutdown_connections 2024-09-15T23:14:57.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.865+0000 7f1875471740 1 -- 172.21.15.123:0/3816982419 wait complete. 2024-09-15T23:14:57.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.865+0000 7f1875471740 1 -- start start 2024-09-15T23:14:57.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.865+0000 7f1875471740 1 Processor -- start 2024-09-15T23:14:57.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.866+0000 7f1875471740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f3ef1a30c0 0x55f3ef2700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.866+0000 7f1875471740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f3ef1a9920 0x55f3ef1eb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.866+0000 7f1875471740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f3ef1ab0b0 0x55f3ef211770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.866+0000 7f1875471740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55f3ef1d3d40 con 0x55f3ef1a30c0 2024-09-15T23:14:57.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.866+0000 7f1875471740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f186c0cc710 con 0x55f3ef1a9920 2024-09-15T23:14:57.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.866+0000 7f1875471740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55f3ef1ec060 con 0x55f3ef1ab0b0 2024-09-15T23:14:57.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.866+0000 7f1875471740 10 client.0 _ll_register_callbacks cb 0x7f1860035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:14:57.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.866+0000 7f186bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f3ef1a30c0 0x55f3ef2700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.866+0000 7f186bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f3ef1a30c0 0x55f3ef2700b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45634/0 (socket says 172.21.15.123:45634) 2024-09-15T23:14:57.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.866+0000 7f186bfff640 1 -- 172.21.15.123:0/3170608729 learned_addr learned my addr 172.21.15.123:0/3170608729 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:14:57.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.866+0000 7f1870c74640 1 --2- 172.21.15.123:0/3170608729 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f3ef1ab0b0 0x55f3ef211770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.866+0000 7f186b7fe640 1 --2- 172.21.15.123:0/3170608729 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f3ef1a9920 0x55f3ef1eb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.866+0000 7f186bfff640 1 -- 172.21.15.123:0/3170608729 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f3ef1ab0b0 msgr2=0x55f3ef211770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.866+0000 7f186bfff640 1 --2- 172.21.15.123:0/3170608729 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f3ef1ab0b0 0x55f3ef211770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.866+0000 7f186bfff640 1 -- 172.21.15.123:0/3170608729 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f3ef1a9920 msgr2=0x55f3ef1eb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:14:57.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.866+0000 7f186bfff640 1 --2- 172.21.15.123:0/3170608729 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f3ef1a9920 0x55f3ef1eb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.866+0000 7f186bfff640 1 -- 172.21.15.123:0/3170608729 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3ef1a9200 con 0x55f3ef1a30c0 2024-09-15T23:14:57.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.866+0000 7f186b7fe640 1 --2- 172.21.15.123:0/3170608729 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f3ef1a9920 0x55f3ef1eb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:57.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.866+0000 7f1870c74640 1 --2- 172.21.15.123:0/3170608729 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f3ef1ab0b0 0x55f3ef211770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:14:57.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.867+0000 7f186bfff640 1 --2- 172.21.15.123:0/3170608729 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f3ef1a30c0 0x55f3ef2700b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f185c0582d0 tx=0x7f185c001110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68cc082c332a9475 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:14:57.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.867+0000 7f184affd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:14:57.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.867+0000 7f184affd640 1 -- 172.21.15.123:0/3170608729 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f185c0613e0 con 0x55f3ef1a30c0 2024-09-15T23:14:57.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.867+0000 7f184affd640 1 -- 172.21.15.123:0/3170608729 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7f185c056b00 con 0x55f3ef1a30c0 2024-09-15T23:14:57.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.867+0000 7f1875471740 1 -- 172.21.15.123:0/3170608729 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1864009a50 con 0x55f3ef1a30c0 2024-09-15T23:14:57.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.867+0000 7f184affd640 1 -- 172.21.15.123:0/3170608729 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f185c054e70 con 0x55f3ef1a30c0 2024-09-15T23:14:57.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.867+0000 7f1875471740 10 client.5946 fetch_fsmap learned FSMap version 21 2024-09-15T23:14:57.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.867+0000 7f1875471740 1 -- 172.21.15.123:0/3170608729 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55f3ef1f2340 con 0x55f3ef1a30c0 2024-09-15T23:14:57.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.867+0000 7f184affd640 1 -- 172.21.15.123:0/3170608729 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1864009a50 con 0x55f3ef1a30c0 2024-09-15T23:14:57.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.867+0000 7f184affd640 1 -- 172.21.15.123:0/3170608729 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f185c007490 con 0x55f3ef1a30c0 2024-09-15T23:14:57.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.867+0000 7f1875471740 10 client.5946 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:14:57.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.867+0000 7f1875471740 10 client.5946 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:14:57.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.867+0000 7f1875471740 20 client.5946 populate_metadata read hostname 'smithi123' 2024-09-15T23:14:57.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.867+0000 7f1875471740 1 --2- 172.21.15.123:0/3170608729 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55f3ef200e10 0x55f3ef211cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:14:57.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.867+0000 7f1875471740 4 client.5946 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:14:57.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.867+0000 7f1875471740 1 -- 172.21.15.123:0/3170608729 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f3ef114170 con 0x55f3ef200e10 2024-09-15T23:14:57.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.867+0000 7f186b7fe640 1 --2- 172.21.15.123:0/3170608729 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55f3ef200e10 0x55f3ef211cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:14:57.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.868+0000 7f184affd640 10 client.5946 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:57.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.868+0000 7f186b7fe640 1 --2- 172.21.15.123:0/3170608729 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55f3ef200e10 0x55f3ef211cb0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76b3a50d3d656068 server_cookie=3f83a737baa0c2a3 in_seq=0 out_seq=0 2024-09-15T23:14:57.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.868+0000 7f184affd640 1 -- 172.21.15.123:0/3170608729 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+903 (crc 0 0 0) 0x55f3ef114170 con 0x55f3ef200e10 2024-09-15T23:14:57.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.868+0000 7f184affd640 10 client.5946 handle_command_reply: tid=0 2024-09-15T23:14:57.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.868+0000 7f1875471740 1 client.5946 shutdown 2024-09-15T23:14:57.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.868+0000 7f1875471740 1 -- 172.21.15.123:0/3170608729 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f3ef1a30c0 msgr2=0x55f3ef2700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.868+0000 7f1875471740 1 --2- 172.21.15.123:0/3170608729 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f3ef1a30c0 0x55f3ef2700b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f185c0582d0 tx=0x7f185c001110 comp rx=0 tx=0).stop 2024-09-15T23:14:57.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.868+0000 7f1875471740 1 -- 172.21.15.123:0/3170608729 shutdown_connections 2024-09-15T23:14:57.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.868+0000 7f1875471740 1 --2- 172.21.15.123:0/3170608729 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55f3ef200e10 0x55f3ef211cb0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.868+0000 7f1875471740 1 --2- 172.21.15.123:0/3170608729 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f3ef1ab0b0 0x55f3ef211770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.868+0000 7f1875471740 1 --2- 172.21.15.123:0/3170608729 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f3ef1a9920 0x55f3ef1eb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.868+0000 7f184affd640 0 client.5946 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:14:57.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.868+0000 7f1875471740 1 --2- 172.21.15.123:0/3170608729 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f3ef1a30c0 0x55f3ef2700b0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.868+0000 7f1875471740 1 -- 172.21.15.123:0/3170608729 >> 172.21.15.123:0/3170608729 conn(0x55f3ef1a70e0 msgr2=0x55f3ef1a7680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:57.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.868+0000 7f1875471740 1 -- 172.21.15.123:0/3170608729 shutdown_connections 2024-09-15T23:14:57.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.868+0000 7f1875471740 1 -- 172.21.15.123:0/3170608729 wait complete. 2024-09-15T23:14:57.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.868+0000 7f1875471740 20 client.5946 trim_cache size 0 max 16384 2024-09-15T23:14:57.876 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:14:57.876 INFO:teuthology.orchestra.run.smithi123.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-15T23:14:57.876 INFO:teuthology.orchestra.run.smithi123.stdout: "scrubs": { 2024-09-15T23:14:57.876 INFO:teuthology.orchestra.run.smithi123.stdout: "0268e802-891e-4976-ac75-404bdd2a455c": { 2024-09-15T23:14:57.876 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2024-09-15T23:14:57.876 INFO:teuthology.orchestra.run.smithi123.stdout: "tag": "0268e802-891e-4976-ac75-404bdd2a455c", 2024-09-15T23:14:57.876 INFO:teuthology.orchestra.run.smithi123.stdout: "options": "" 2024-09-15T23:14:57.876 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:57.876 INFO:teuthology.orchestra.run.smithi123.stdout: "ca73209e-4aaf-46db-830f-43d5b291e77c": { 2024-09-15T23:14:57.876 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/", 2024-09-15T23:14:57.876 INFO:teuthology.orchestra.run.smithi123.stdout: "tag": "ca73209e-4aaf-46db-830f-43d5b291e77c", 2024-09-15T23:14:57.876 INFO:teuthology.orchestra.run.smithi123.stdout: "options": "" 2024-09-15T23:14:57.876 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:57.877 INFO:teuthology.orchestra.run.smithi123.stdout: "cfd0d925-de8b-4377-aa2a-0082734cf983": { 2024-09-15T23:14:57.877 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites", 2024-09-15T23:14:57.877 INFO:teuthology.orchestra.run.smithi123.stdout: "tag": "cfd0d925-de8b-4377-aa2a-0082734cf983", 2024-09-15T23:14:57.877 INFO:teuthology.orchestra.run.smithi123.stdout: "options": "" 2024-09-15T23:14:57.877 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:14:57.877 INFO:teuthology.orchestra.run.smithi123.stdout: "f12b799a-41e6-4196-b5eb-4e700227db93": { 2024-09-15T23:14:57.877 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1", 2024-09-15T23:14:57.877 INFO:teuthology.orchestra.run.smithi123.stdout: "tag": "f12b799a-41e6-4196-b5eb-4e700227db93", 2024-09-15T23:14:57.877 INFO:teuthology.orchestra.run.smithi123.stdout: "options": "" 2024-09-15T23:14:57.877 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:14:57.877 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:14:57.877 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:14:57.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.869+0000 7f18726d7640 1 -- 172.21.15.123:0/2387669748 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f185806c2b0 msgr2=0x7f185806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.869+0000 7f18726d7640 1 --2- 172.21.15.123:0/2387669748 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f185806c2b0 0x7f185806e770 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1860034000 tx=0x7f186002e000 comp rx=0 tx=0).stop 2024-09-15T23:14:57.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.869+0000 7f18726d7640 1 -- 172.21.15.123:0/2387669748 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f186c06f460 msgr2=0x7f186c0c8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:14:57.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.869+0000 7f18726d7640 1 --2- 172.21.15.123:0/2387669748 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f186c06f460 0x7f186c0c8bb0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f185c00c3c0 tx=0x7f185c00c880 comp rx=0 tx=0).stop 2024-09-15T23:14:57.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.869+0000 7f18726d7640 1 -- 172.21.15.123:0/2387669748 shutdown_connections 2024-09-15T23:14:57.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.869+0000 7f18726d7640 1 --2- 172.21.15.123:0/2387669748 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f186c15c7f0 0x7f186c0b64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.869+0000 7f18726d7640 1 --2- 172.21.15.123:0/2387669748 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f186c0730f0 0x7f186c14ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.869+0000 7f18726d7640 1 --2- 172.21.15.123:0/2387669748 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f185806c2b0 0x7f185806e770 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.869+0000 7f18726d7640 1 --2- 172.21.15.123:0/2387669748 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f186c06f460 0x7f186c0c8bb0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:14:57.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.869+0000 7f18726d7640 1 -- 172.21.15.123:0/2387669748 >> 172.21.15.123:0/2387669748 conn(0x7f186c0d2570 msgr2=0x7f186c0b2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:14:57.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.869+0000 7f18726d7640 1 -- 172.21.15.123:0/2387669748 shutdown_connections 2024-09-15T23:14:57.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:14:57.869+0000 7f18726d7640 1 -- 172.21.15.123:0/2387669748 wait complete. 2024-09-15T23:14:58.309 INFO:tasks.ceph.mon.a.smithi123.stderr:2024-09-15T23:14:58.308+0000 7f8a6f4f5640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-15T23:15:02.881 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-15T23:15:02.881 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-15T23:15:02.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:02.998+0000 7ff6eb796640 1 Processor -- start 2024-09-15T23:15:02.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:02.998+0000 7ff6eb796640 1 -- start start 2024-09-15T23:15:03.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:02.999+0000 7ff6eb796640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff6e40ccf30 0x7ff6e40b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:02.999+0000 7ff6eb796640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff6e415b7c0 0x7ff6e40cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:02.999+0000 7ff6eb796640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff6e40cead0 0x7ff6e415f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:02.999+0000 7ff6eb796640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7ff6e40cd850 con 0x7ff6e40cead0 2024-09-15T23:15:03.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:02.999+0000 7ff6eb796640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7ff6e40cf2e0 con 0x7ff6e40ccf30 2024-09-15T23:15:03.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:02.999+0000 7ff6eb796640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ff6e4070fe0 con 0x7ff6e415b7c0 2024-09-15T23:15:03.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:02.999+0000 7ff6e9d33640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff6e40cead0 0x7ff6e415f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:02.999+0000 7ff6e9d33640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff6e40cead0 0x7ff6e415f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45640/0 (socket says 172.21.15.123:45640) 2024-09-15T23:15:03.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:02.999+0000 7ff6e9d33640 1 -- 172.21.15.123:0/104887916 learned_addr learned my addr 172.21.15.123:0/104887916 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:03.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.000+0000 7ff6e8d31640 1 --2- 172.21.15.123:0/104887916 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff6e415b7c0 0x7ff6e40cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.000+0000 7ff6e9532640 1 --2- 172.21.15.123:0/104887916 >> v2:172.21.15.188:3300/0 conn(0x7ff6e40ccf30 0x7ff6e40b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.000+0000 7ff6e9d33640 1 -- 172.21.15.123:0/104887916 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff6e415b7c0 msgr2=0x7ff6e40cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.000+0000 7ff6e9d33640 1 --2- 172.21.15.123:0/104887916 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff6e415b7c0 0x7ff6e40cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.000+0000 7ff6e9d33640 1 -- 172.21.15.123:0/104887916 >> v2:172.21.15.188:3300/0 conn(0x7ff6e40ccf30 msgr2=0x7ff6e40b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.000+0000 7ff6e9d33640 1 --2- 172.21.15.123:0/104887916 >> v2:172.21.15.188:3300/0 conn(0x7ff6e40ccf30 0x7ff6e40b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.000+0000 7ff6e9d33640 1 -- 172.21.15.123:0/104887916 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e40712c0 con 0x7ff6e40cead0 2024-09-15T23:15:03.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.000+0000 7ff6e8d31640 1 --2- 172.21.15.123:0/104887916 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff6e415b7c0 0x7ff6e40cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:03.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.000+0000 7ff6e9532640 1 --2- 172.21.15.123:0/104887916 >> v2:172.21.15.188:3300/0 conn(0x7ff6e40ccf30 0x7ff6e40b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:03.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.001+0000 7ff6e9d33640 1 --2- 172.21.15.123:0/104887916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6e40cead0 0x7ff6e415f150 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7ff6e406f1c0 tx=0x7ff6dc02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24007da728716f80 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:03.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.001+0000 7ff6dbfff640 1 -- 172.21.15.123:0/104887916 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc036070 con 0x7ff6e40cead0 2024-09-15T23:15:03.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.001+0000 7ff6dbfff640 1 -- 172.21.15.123:0/104887916 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6dc031600 con 0x7ff6e40cead0 2024-09-15T23:15:03.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.001+0000 7ff6dbfff640 1 -- 172.21.15.123:0/104887916 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc0319d0 con 0x7ff6e40cead0 2024-09-15T23:15:03.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.001+0000 7ff6eb796640 1 -- 172.21.15.123:0/104887916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6e40cead0 msgr2=0x7ff6e415f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.001+0000 7ff6eb796640 1 --2- 172.21.15.123:0/104887916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6e40cead0 0x7ff6e415f150 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7ff6e406f1c0 tx=0x7ff6dc02a610 comp rx=0 tx=0).stop 2024-09-15T23:15:03.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.001+0000 7ff6eb796640 1 -- 172.21.15.123:0/104887916 shutdown_connections 2024-09-15T23:15:03.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.001+0000 7ff6eb796640 1 --2- 172.21.15.123:0/104887916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6e40cead0 0x7ff6e415f150 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.001+0000 7ff6eb796640 1 --2- 172.21.15.123:0/104887916 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff6e415b7c0 0x7ff6e40cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.001+0000 7ff6eb796640 1 --2- 172.21.15.123:0/104887916 >> v2:172.21.15.188:3300/0 conn(0x7ff6e40ccf30 0x7ff6e40b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.001+0000 7ff6eb796640 1 -- 172.21.15.123:0/104887916 >> 172.21.15.123:0/104887916 conn(0x7ff6e406d0f0 msgr2=0x7ff6e406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:03.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.001+0000 7ff6eb796640 1 -- 172.21.15.123:0/104887916 shutdown_connections 2024-09-15T23:15:03.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.001+0000 7ff6eb796640 1 -- 172.21.15.123:0/104887916 wait complete. 2024-09-15T23:15:03.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.003+0000 7ff6eb796640 1 Processor -- start 2024-09-15T23:15:03.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.003+0000 7ff6eb796640 1 -- start start 2024-09-15T23:15:03.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.003+0000 7ff6eb796640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6e40ccf30 0x7ff6e415e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.003+0000 7ff6eb796640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff6e40cead0 0x7ff6e4152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.003+0000 7ff6eb796640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff6e415b7c0 0x7ff6e4153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.003+0000 7ff6eb796640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e40cef20 con 0x7ff6e40ccf30 2024-09-15T23:15:03.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.003+0000 7ff6eb796640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e40cf5c0 con 0x7ff6e40cead0 2024-09-15T23:15:03.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.003+0000 7ff6eb796640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ff6e40cf0a0 con 0x7ff6e415b7c0 2024-09-15T23:15:03.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.004+0000 7ff6e9532640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6e40ccf30 0x7ff6e415e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.004+0000 7ff6e9532640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6e40ccf30 0x7ff6e415e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45648/0 (socket says 172.21.15.123:45648) 2024-09-15T23:15:03.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.004+0000 7ff6e9532640 1 -- 172.21.15.123:0/2115424028 learned_addr learned my addr 172.21.15.123:0/2115424028 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:03.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.004+0000 7ff6e8d31640 1 --2- 172.21.15.123:0/2115424028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff6e40cead0 0x7ff6e4152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.004+0000 7ff6e9d33640 1 --2- 172.21.15.123:0/2115424028 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff6e415b7c0 0x7ff6e4153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.004+0000 7ff6e9532640 1 -- 172.21.15.123:0/2115424028 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff6e415b7c0 msgr2=0x7ff6e4153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.004+0000 7ff6e9532640 1 --2- 172.21.15.123:0/2115424028 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff6e415b7c0 0x7ff6e4153e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.004+0000 7ff6e9532640 1 -- 172.21.15.123:0/2115424028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff6e40cead0 msgr2=0x7ff6e4152320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.004+0000 7ff6e9532640 1 --2- 172.21.15.123:0/2115424028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff6e40cead0 0x7ff6e4152320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.004+0000 7ff6e9532640 1 -- 172.21.15.123:0/2115424028 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e4156db0 con 0x7ff6e40ccf30 2024-09-15T23:15:03.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.004+0000 7ff6e9532640 1 --2- 172.21.15.123:0/2115424028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6e40ccf30 0x7ff6e415e020 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7ff6e000d830 tx=0x7ff6e000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:03.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.004+0000 7ff6d9ffb640 1 -- 172.21.15.123:0/2115424028 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0018070 con 0x7ff6e40ccf30 2024-09-15T23:15:03.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.004+0000 7ff6d9ffb640 1 -- 172.21.15.123:0/2115424028 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6e000be10 con 0x7ff6e40ccf30 2024-09-15T23:15:03.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.004+0000 7ff6eb796640 1 -- 172.21.15.123:0/2115424028 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6e4157090 con 0x7ff6e40ccf30 2024-09-15T23:15:03.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.004+0000 7ff6d9ffb640 1 -- 172.21.15.123:0/2115424028 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0004250 con 0x7ff6e40ccf30 2024-09-15T23:15:03.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.005+0000 7ff6eb796640 1 -- 172.21.15.123:0/2115424028 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6e415be20 con 0x7ff6e40ccf30 2024-09-15T23:15:03.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.006+0000 7ff6d9ffb640 1 -- 172.21.15.123:0/2115424028 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff6e00098b0 con 0x7ff6e40ccf30 2024-09-15T23:15:03.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.007+0000 7ff6d9ffb640 1 --2- 172.21.15.123:0/2115424028 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff6c806c2e0 0x7ff6c806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.007+0000 7ff6d9ffb640 1 -- 172.21.15.123:0/2115424028 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7ff6e008b7a0 con 0x7ff6e40ccf30 2024-09-15T23:15:03.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.007+0000 7ff6e8d31640 1 --2- 172.21.15.123:0/2115424028 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff6c806c2e0 0x7ff6c806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.007+0000 7ff6e8d31640 1 --2- 172.21.15.123:0/2115424028 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff6c806c2e0 0x7ff6c806e7a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff6e40b4fd0 tx=0x7ff6d4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:03.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.008+0000 7ff6ee608740 1 Processor -- start 2024-09-15T23:15:03.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.008+0000 7ff6ee608740 1 -- start start 2024-09-15T23:15:03.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.008+0000 7ff6ee608740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ed6f8c4d30 0x55ed6f90a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.008+0000 7ff6ee608740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ed6f8c24f0 0x55ed6f8c5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.008+0000 7ff6ee608740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ed6f8c64c0 0x55ed6f8bf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.008+0000 7ff6ee608740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55ed6f8236f0 con 0x55ed6f8c24f0 2024-09-15T23:15:03.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.008+0000 7ff6ee608740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55ed6f7cb330 con 0x55ed6f8c64c0 2024-09-15T23:15:03.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.009+0000 7ff6ee608740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55ed6f81f6b0 con 0x55ed6f8c4d30 2024-09-15T23:15:03.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.009+0000 7ff6e8d31640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ed6f8c24f0 0x55ed6f8c5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.009+0000 7ff6e8d31640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ed6f8c24f0 0x55ed6f8c5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45660/0 (socket says 172.21.15.123:45660) 2024-09-15T23:15:03.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.009+0000 7ff6e8d31640 1 -- 172.21.15.123:0/3235831621 learned_addr learned my addr 172.21.15.123:0/3235831621 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:03.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.009+0000 7ff6e9532640 1 --2- 172.21.15.123:0/3235831621 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ed6f8c4d30 0x55ed6f90a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.009+0000 7ff6e8d31640 1 -- 172.21.15.123:0/3235831621 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ed6f8c4d30 msgr2=0x55ed6f90a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.009+0000 7ff6e8d31640 1 --2- 172.21.15.123:0/3235831621 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ed6f8c4d30 0x55ed6f90a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.009+0000 7ff6e8d31640 1 -- 172.21.15.123:0/3235831621 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ed6f8c64c0 msgr2=0x55ed6f8bf5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:15:03.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.009+0000 7ff6e8d31640 1 --2- 172.21.15.123:0/3235831621 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ed6f8c64c0 0x55ed6f8bf5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.009+0000 7ff6e8d31640 1 -- 172.21.15.123:0/3235831621 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed6f7f10d0 con 0x55ed6f8c24f0 2024-09-15T23:15:03.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.009+0000 7ff6e8d31640 1 --2- 172.21.15.123:0/3235831621 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ed6f8c24f0 0x55ed6f8c5110 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4010890 tx=0x7ff6d4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e64bf718716ab4f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:03.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.009+0000 7ff6ceffd640 1 -- 172.21.15.123:0/3235831621 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d401c050 con 0x55ed6f8c24f0 2024-09-15T23:15:03.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.009+0000 7ff6ceffd640 1 -- 172.21.15.123:0/3235831621 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6d4026070 con 0x55ed6f8c24f0 2024-09-15T23:15:03.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.009+0000 7ff6ceffd640 1 -- 172.21.15.123:0/3235831621 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d400f040 con 0x55ed6f8c24f0 2024-09-15T23:15:03.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.010+0000 7ff6ee608740 1 -- 172.21.15.123:0/3235831621 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ed6f8c24f0 msgr2=0x55ed6f8c5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.010+0000 7ff6ee608740 1 --2- 172.21.15.123:0/3235831621 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ed6f8c24f0 0x55ed6f8c5110 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4010890 tx=0x7ff6d4013000 comp rx=0 tx=0).stop 2024-09-15T23:15:03.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.010+0000 7ff6ee608740 1 -- 172.21.15.123:0/3235831621 shutdown_connections 2024-09-15T23:15:03.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.010+0000 7ff6ee608740 1 --2- 172.21.15.123:0/3235831621 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ed6f8c64c0 0x55ed6f8bf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.010+0000 7ff6ee608740 1 --2- 172.21.15.123:0/3235831621 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ed6f8c24f0 0x55ed6f8c5110 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.010+0000 7ff6ee608740 1 --2- 172.21.15.123:0/3235831621 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ed6f8c4d30 0x55ed6f90a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.010+0000 7ff6ee608740 1 -- 172.21.15.123:0/3235831621 >> 172.21.15.123:0/3235831621 conn(0x55ed6f8c1780 msgr2=0x55ed6f9099a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:03.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.010+0000 7ff6ee608740 1 -- 172.21.15.123:0/3235831621 shutdown_connections 2024-09-15T23:15:03.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.010+0000 7ff6ee608740 1 -- 172.21.15.123:0/3235831621 wait complete. 2024-09-15T23:15:03.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.010+0000 7ff6ee608740 1 -- start start 2024-09-15T23:15:03.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.011+0000 7ff6ee608740 1 Processor -- start 2024-09-15T23:15:03.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.012+0000 7ff6ee608740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ed6f8c4d30 0x55ed6f91d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.012+0000 7ff6ee608740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ed6f8c64c0 0x55ed6f8e5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.012+0000 7ff6ee608740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ed6f8eec00 0x55ed6f8e7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.012+0000 7ff6ee608740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55ed6f8c0c20 con 0x55ed6f8c4d30 2024-09-15T23:15:03.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.012+0000 7ff6ee608740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55ed6f7ac4f0 con 0x55ed6f8eec00 2024-09-15T23:15:03.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.012+0000 7ff6ee608740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55ed6f90ad00 con 0x55ed6f8c64c0 2024-09-15T23:15:03.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.012+0000 7ff6ee608740 10 client.0 _ll_register_callbacks cb 0x55ed6f7cdb50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:15:03.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.012+0000 7ff6e9532640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ed6f8c4d30 0x55ed6f91d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.012+0000 7ff6e9532640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ed6f8c4d30 0x55ed6f91d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45668/0 (socket says 172.21.15.123:45668) 2024-09-15T23:15:03.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.012+0000 7ff6e9532640 1 -- 172.21.15.123:0/3193990615 learned_addr learned my addr 172.21.15.123:0/3193990615 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:03.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.012+0000 7ff6e8d31640 1 --2- 172.21.15.123:0/3193990615 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ed6f8c64c0 0x55ed6f8e5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.012+0000 7ff6e9d33640 1 --2- 172.21.15.123:0/3193990615 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ed6f8eec00 0x55ed6f8e7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.012+0000 7ff6e9532640 1 -- 172.21.15.123:0/3193990615 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ed6f8c64c0 msgr2=0x55ed6f8e5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.012+0000 7ff6e9532640 1 --2- 172.21.15.123:0/3193990615 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ed6f8c64c0 0x55ed6f8e5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.012+0000 7ff6e9532640 1 -- 172.21.15.123:0/3193990615 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ed6f8eec00 msgr2=0x55ed6f8e7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.012+0000 7ff6e9532640 1 --2- 172.21.15.123:0/3193990615 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ed6f8eec00 0x55ed6f8e7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.012+0000 7ff6e9532640 1 -- 172.21.15.123:0/3193990615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed6f6007d0 con 0x55ed6f8c4d30 2024-09-15T23:15:03.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.012+0000 7ff6e8d31640 1 --2- 172.21.15.123:0/3193990615 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ed6f8c64c0 0x55ed6f8e5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:03.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.012+0000 7ff6e9d33640 1 --2- 172.21.15.123:0/3193990615 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ed6f8eec00 0x55ed6f8e7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:03.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.012+0000 7ff6e9532640 1 --2- 172.21.15.123:0/3193990615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ed6f8c4d30 0x55ed6f91d1e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff6e00596f0 tx=0x7ff6e0059760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de87be41499bf82f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:03.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.012+0000 7ff6c3fff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:15:03.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.012+0000 7ff6c3fff640 1 -- 172.21.15.123:0/3193990615 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0088060 con 0x55ed6f8c4d30 2024-09-15T23:15:03.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.012+0000 7ff6c3fff640 1 -- 172.21.15.123:0/3193990615 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7ff6e0055dd0 con 0x55ed6f8c4d30 2024-09-15T23:15:03.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.012+0000 7ff6ee608740 1 -- 172.21.15.123:0/3193990615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6d4026070 con 0x55ed6f8c4d30 2024-09-15T23:15:03.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.012+0000 7ff6c3fff640 1 -- 172.21.15.123:0/3193990615 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7ff6e0076050 con 0x55ed6f8c4d30 2024-09-15T23:15:03.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.012+0000 7ff6ee608740 10 client.5958 fetch_fsmap learned FSMap version 22 2024-09-15T23:15:03.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.012+0000 7ff6ee608740 1 -- 172.21.15.123:0/3193990615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x55ed6f5363f0 con 0x55ed6f8c4d30 2024-09-15T23:15:03.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.013+0000 7ff6c3fff640 1 -- 172.21.15.123:0/3193990615 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6d4026070 con 0x55ed6f8c4d30 2024-09-15T23:15:03.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.013+0000 7ff6c3fff640 1 -- 172.21.15.123:0/3193990615 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 22) ==== 3502+0+0 (secure 0 0 0) 0x7ff6e0013050 con 0x55ed6f8c4d30 2024-09-15T23:15:03.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.013+0000 7ff6ee608740 10 client.5958 fetch_fsmap finished waiting for FSMap version 22 2024-09-15T23:15:03.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.013+0000 7ff6ee608740 10 client.5958 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:15:03.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.013+0000 7ff6ee608740 20 client.5958 populate_metadata read hostname 'smithi123' 2024-09-15T23:15:03.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.013+0000 7ff6ee608740 1 --2- 172.21.15.123:0/3193990615 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55ed6f8e68b0 0x55ed6f8e6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.013+0000 7ff6ee608740 4 client.5958 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:15:03.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.013+0000 7ff6ee608740 1 -- 172.21.15.123:0/3193990615 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed6f830e20 con 0x55ed6f8e68b0 2024-09-15T23:15:03.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.013+0000 7ff6e8d31640 1 --2- 172.21.15.123:0/3193990615 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55ed6f8e68b0 0x55ed6f8e6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.013+0000 7ff6c3fff640 10 client.5958 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:15:03.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.013+0000 7ff6e8d31640 1 --2- 172.21.15.123:0/3193990615 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55ed6f8e68b0 0x55ed6f8e6c90 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54e2115ab83bf2f9 server_cookie=24afecb8a0fd7fc3 in_seq=0 out_seq=0 2024-09-15T23:15:03.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.014+0000 7ff6c3fff640 1 -- 172.21.15.123:0/3193990615 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ed6f830e20 con 0x55ed6f8e68b0 2024-09-15T23:15:03.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.014+0000 7ff6c3fff640 10 client.5958 handle_command_reply: tid=0 2024-09-15T23:15:03.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.014+0000 7ff6ee608740 1 client.5958 shutdown 2024-09-15T23:15:03.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.014+0000 7ff6ee608740 1 -- 172.21.15.123:0/3193990615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ed6f8c4d30 msgr2=0x55ed6f91d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.014+0000 7ff6ee608740 1 --2- 172.21.15.123:0/3193990615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ed6f8c4d30 0x55ed6f91d1e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7ff6e00596f0 tx=0x7ff6e0059760 comp rx=0 tx=0).stop 2024-09-15T23:15:03.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.014+0000 7ff6ee608740 1 -- 172.21.15.123:0/3193990615 shutdown_connections 2024-09-15T23:15:03.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.014+0000 7ff6ee608740 1 --2- 172.21.15.123:0/3193990615 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55ed6f8e68b0 0x55ed6f8e6c90 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.014+0000 7ff6ee608740 1 --2- 172.21.15.123:0/3193990615 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ed6f8eec00 0x55ed6f8e7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.014+0000 7ff6ee608740 1 --2- 172.21.15.123:0/3193990615 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ed6f8c64c0 0x55ed6f8e5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.014+0000 7ff6c3fff640 0 client.5958 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:15:03.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.014+0000 7ff6ee608740 1 --2- 172.21.15.123:0/3193990615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ed6f8c4d30 0x55ed6f91d1e0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.014+0000 7ff6ee608740 1 -- 172.21.15.123:0/3193990615 >> 172.21.15.123:0/3193990615 conn(0x55ed6f8c24f0 msgr2=0x55ed6f90cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:03.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.014+0000 7ff6ee608740 1 -- 172.21.15.123:0/3193990615 shutdown_connections 2024-09-15T23:15:03.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.014+0000 7ff6ee608740 1 -- 172.21.15.123:0/3193990615 wait complete. 2024-09-15T23:15:03.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.015+0000 7ff6ee608740 20 client.5958 trim_cache size 0 max 16384 2024-09-15T23:15:03.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.032+0000 7ff6ee608740 1 Processor -- start 2024-09-15T23:15:03.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.032+0000 7ff6ee608740 1 -- start start 2024-09-15T23:15:03.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.032+0000 7ff6ee608740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ed6f8c4d30 0x55ed6f8ba0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.033+0000 7ff6ee608740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ed6f8c64c0 0x55ed6f8ba600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.033+0000 7ff6ee608740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ed6f8eec00 0x55ed6f8ef070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.033+0000 7ff6ee608740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e41fccf0 con 0x55ed6f8c4d30 2024-09-15T23:15:03.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.033+0000 7ff6ee608740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e4159fc0 con 0x55ed6f8c64c0 2024-09-15T23:15:03.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.033+0000 7ff6ee608740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ff6e415d880 con 0x55ed6f8eec00 2024-09-15T23:15:03.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.033+0000 7ff6e9532640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ed6f8c4d30 0x55ed6f8ba0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.033+0000 7ff6e9532640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ed6f8c4d30 0x55ed6f8ba0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45672/0 (socket says 172.21.15.123:45672) 2024-09-15T23:15:03.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.033+0000 7ff6e9532640 1 -- 172.21.15.123:0/432407417 learned_addr learned my addr 172.21.15.123:0/432407417 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:03.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.033+0000 7ff6e9532640 1 -- 172.21.15.123:0/432407417 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ed6f8eec00 msgr2=0x55ed6f8ef070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.033+0000 7ff6e9532640 1 --2- 172.21.15.123:0/432407417 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ed6f8eec00 0x55ed6f8ef070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.033+0000 7ff6e9532640 1 -- 172.21.15.123:0/432407417 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ed6f8c64c0 msgr2=0x55ed6f8ba600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.033+0000 7ff6e9532640 1 --2- 172.21.15.123:0/432407417 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ed6f8c64c0 0x55ed6f8ba600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.033+0000 7ff6e9532640 1 -- 172.21.15.123:0/432407417 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed6f4f60f0 con 0x55ed6f8c4d30 2024-09-15T23:15:03.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.033+0000 7ff6e9532640 1 --2- 172.21.15.123:0/432407417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ed6f8c4d30 0x55ed6f8ba0c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff6e005dcd0 tx=0x7ff6e005d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e754c6734032871 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:03.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.033+0000 7ff6ce7fc640 1 -- 172.21.15.123:0/432407417 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0071070 con 0x55ed6f8c4d30 2024-09-15T23:15:03.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.033+0000 7ff6ce7fc640 1 -- 172.21.15.123:0/432407417 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6e0057a60 con 0x55ed6f8c4d30 2024-09-15T23:15:03.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.033+0000 7ff6ce7fc640 1 -- 172.21.15.123:0/432407417 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0009ba0 con 0x55ed6f8c4d30 2024-09-15T23:15:03.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.034+0000 7ff6ee608740 1 -- 172.21.15.123:0/432407417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ed6f8c4d30 msgr2=0x55ed6f8ba0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.034+0000 7ff6ee608740 1 --2- 172.21.15.123:0/432407417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ed6f8c4d30 0x55ed6f8ba0c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff6e005dcd0 tx=0x7ff6e005d000 comp rx=0 tx=0).stop 2024-09-15T23:15:03.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.034+0000 7ff6ee608740 1 -- 172.21.15.123:0/432407417 shutdown_connections 2024-09-15T23:15:03.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.034+0000 7ff6ee608740 1 --2- 172.21.15.123:0/432407417 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ed6f8eec00 0x55ed6f8ef070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.034+0000 7ff6ee608740 1 --2- 172.21.15.123:0/432407417 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ed6f8c64c0 0x55ed6f8ba600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.034+0000 7ff6ee608740 1 --2- 172.21.15.123:0/432407417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ed6f8c4d30 0x55ed6f8ba0c0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.034+0000 7ff6ee608740 1 -- 172.21.15.123:0/432407417 >> 172.21.15.123:0/432407417 conn(0x55ed6f8c24f0 msgr2=0x55ed6f8e7290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:03.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.034+0000 7ff6ee608740 1 -- 172.21.15.123:0/432407417 shutdown_connections 2024-09-15T23:15:03.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.034+0000 7ff6ee608740 1 -- 172.21.15.123:0/432407417 wait complete. 2024-09-15T23:15:03.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.034+0000 7ff6ee608740 1 -- start start 2024-09-15T23:15:03.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.035+0000 7ff6ee608740 1 Processor -- start 2024-09-15T23:15:03.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.035+0000 7ff6ee608740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ed6f8c4d30 0x55ed6f8ba740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.035+0000 7ff6ee608740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ed6f8c64c0 0x55ed6f987460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.036+0000 7ff6ee608740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ed6f8eec00 0x55ed6f92d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.036+0000 7ff6ee608740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55ed6f825c20 con 0x55ed6f8c64c0 2024-09-15T23:15:03.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.036+0000 7ff6ee608740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e41564f0 con 0x55ed6f8c4d30 2024-09-15T23:15:03.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.036+0000 7ff6ee608740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55ed6f8ee500 con 0x55ed6f8eec00 2024-09-15T23:15:03.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.036+0000 7ff6ee608740 10 client.0 _ll_register_callbacks cb 0x7ff6e0060140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:15:03.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.036+0000 7ff6e8d31640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ed6f8c64c0 0x55ed6f987460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.036+0000 7ff6e8d31640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ed6f8c64c0 0x55ed6f987460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45684/0 (socket says 172.21.15.123:45684) 2024-09-15T23:15:03.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.036+0000 7ff6e8d31640 1 -- 172.21.15.123:0/1903103807 learned_addr learned my addr 172.21.15.123:0/1903103807 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:03.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.036+0000 7ff6e9532640 1 --2- 172.21.15.123:0/1903103807 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ed6f8c4d30 0x55ed6f8ba740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.036+0000 7ff6e9d33640 1 --2- 172.21.15.123:0/1903103807 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ed6f8eec00 0x55ed6f92d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.036+0000 7ff6e8d31640 1 -- 172.21.15.123:0/1903103807 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ed6f8eec00 msgr2=0x55ed6f92d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.036+0000 7ff6e8d31640 1 --2- 172.21.15.123:0/1903103807 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ed6f8eec00 0x55ed6f92d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.036+0000 7ff6e8d31640 1 -- 172.21.15.123:0/1903103807 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ed6f8c4d30 msgr2=0x55ed6f8ba740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.036+0000 7ff6e8d31640 1 --2- 172.21.15.123:0/1903103807 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ed6f8c4d30 0x55ed6f8ba740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.036+0000 7ff6e8d31640 1 -- 172.21.15.123:0/1903103807 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed6f8efb50 con 0x55ed6f8c64c0 2024-09-15T23:15:03.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.036+0000 7ff6e9d33640 1 --2- 172.21.15.123:0/1903103807 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ed6f8eec00 0x55ed6f92d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:03.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.036+0000 7ff6e9532640 1 --2- 172.21.15.123:0/1903103807 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ed6f8c4d30 0x55ed6f8ba740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:03.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.036+0000 7ff6e8d31640 1 --2- 172.21.15.123:0/1903103807 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ed6f8c64c0 0x55ed6f987460 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff6e415bba0 tx=0x7ff6d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aba46012bac7502 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:03.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.036+0000 7ff6c3fff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:15:03.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.036+0000 7ff6c3fff640 1 -- 172.21.15.123:0/1903103807 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d401c040 con 0x55ed6f8c64c0 2024-09-15T23:15:03.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.036+0000 7ff6c3fff640 1 -- 172.21.15.123:0/1903103807 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7ff6d4004450 con 0x55ed6f8c64c0 2024-09-15T23:15:03.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.036+0000 7ff6ee608740 1 -- 172.21.15.123:0/1903103807 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6e0057a60 con 0x55ed6f8c64c0 2024-09-15T23:15:03.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.036+0000 7ff6c3fff640 1 -- 172.21.15.123:0/1903103807 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7ff6d4042050 con 0x55ed6f8c64c0 2024-09-15T23:15:03.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.036+0000 7ff6ee608740 10 client.5964 fetch_fsmap learned FSMap version 22 2024-09-15T23:15:03.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.036+0000 7ff6ee608740 1 -- 172.21.15.123:0/1903103807 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x55ed6f90bc10 con 0x55ed6f8c64c0 2024-09-15T23:15:03.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.037+0000 7ff6c3fff640 1 -- 172.21.15.123:0/1903103807 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6e0057a60 con 0x55ed6f8c64c0 2024-09-15T23:15:03.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.037+0000 7ff6c3fff640 1 -- 172.21.15.123:0/1903103807 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 22) ==== 3502+0+0 (secure 0 0 0) 0x7ff6d4045020 con 0x55ed6f8c64c0 2024-09-15T23:15:03.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.037+0000 7ff6ee608740 10 client.5964 fetch_fsmap finished waiting for FSMap version 22 2024-09-15T23:15:03.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.037+0000 7ff6ee608740 10 client.5964 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:15:03.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.037+0000 7ff6ee608740 20 client.5964 populate_metadata read hostname 'smithi123' 2024-09-15T23:15:03.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.037+0000 7ff6ee608740 1 --2- 172.21.15.123:0/1903103807 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55ed6f92dc70 0x55ed6f8ed720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.037+0000 7ff6ee608740 4 client.5964 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:15:03.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.037+0000 7ff6ee608740 1 -- 172.21.15.123:0/1903103807 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ed6f82b170 con 0x55ed6f92dc70 2024-09-15T23:15:03.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.037+0000 7ff6e9532640 1 --2- 172.21.15.123:0/1903103807 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55ed6f92dc70 0x55ed6f8ed720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.037+0000 7ff6c3fff640 10 client.5964 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:15:03.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.037+0000 7ff6e9532640 1 --2- 172.21.15.123:0/1903103807 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55ed6f92dc70 0x55ed6f8ed720 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8b39a8dec0745f server_cookie=b07f61d2b3e3c094 in_seq=0 out_seq=0 2024-09-15T23:15:03.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.037+0000 7ff6c3fff640 1 -- 172.21.15.123:0/1903103807 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ed6f82b170 con 0x55ed6f92dc70 2024-09-15T23:15:03.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.037+0000 7ff6c3fff640 10 client.5964 handle_command_reply: tid=0 2024-09-15T23:15:03.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.037+0000 7ff6ee608740 1 client.5964 shutdown 2024-09-15T23:15:03.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.038+0000 7ff6ee608740 1 -- 172.21.15.123:0/1903103807 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ed6f8c64c0 msgr2=0x55ed6f987460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.038+0000 7ff6ee608740 1 --2- 172.21.15.123:0/1903103807 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ed6f8c64c0 0x55ed6f987460 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff6e415bba0 tx=0x7ff6d40046c0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.038+0000 7ff6ee608740 1 -- 172.21.15.123:0/1903103807 shutdown_connections 2024-09-15T23:15:03.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.038+0000 7ff6ee608740 1 --2- 172.21.15.123:0/1903103807 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55ed6f92dc70 0x55ed6f8ed720 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.038+0000 7ff6ee608740 1 --2- 172.21.15.123:0/1903103807 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ed6f8eec00 0x55ed6f92d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.038+0000 7ff6c3fff640 0 client.5964 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:15:03.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.038+0000 7ff6ee608740 1 --2- 172.21.15.123:0/1903103807 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ed6f8c64c0 0x55ed6f987460 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.038+0000 7ff6ee608740 1 --2- 172.21.15.123:0/1903103807 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ed6f8c4d30 0x55ed6f8ba740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.038+0000 7ff6ee608740 1 -- 172.21.15.123:0/1903103807 >> 172.21.15.123:0/1903103807 conn(0x55ed6f8c24f0 msgr2=0x55ed6f90b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:03.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.038+0000 7ff6ee608740 1 -- 172.21.15.123:0/1903103807 shutdown_connections 2024-09-15T23:15:03.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.038+0000 7ff6ee608740 1 -- 172.21.15.123:0/1903103807 wait complete. 2024-09-15T23:15:03.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.038+0000 7ff6ee608740 20 client.5964 trim_cache size 0 max 16384 2024-09-15T23:15:03.045 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:15:03.045 INFO:teuthology.orchestra.run.smithi123.stdout: "status": "no active scrubs running", 2024-09-15T23:15:03.045 INFO:teuthology.orchestra.run.smithi123.stdout: "scrubs": {} 2024-09-15T23:15:03.045 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:15:03.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.038+0000 7ff6eb796640 1 -- 172.21.15.123:0/2115424028 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff6c806c2e0 msgr2=0x7ff6c806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.038+0000 7ff6eb796640 1 --2- 172.21.15.123:0/2115424028 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff6c806c2e0 0x7ff6c806e7a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff6e40b4fd0 tx=0x7ff6d4008040 comp rx=0 tx=0).stop 2024-09-15T23:15:03.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.038+0000 7ff6eb796640 1 -- 172.21.15.123:0/2115424028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6e40ccf30 msgr2=0x7ff6e415e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.038+0000 7ff6eb796640 1 --2- 172.21.15.123:0/2115424028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6e40ccf30 0x7ff6e415e020 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7ff6e000d830 tx=0x7ff6e000dcf0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.038+0000 7ff6eb796640 1 -- 172.21.15.123:0/2115424028 shutdown_connections 2024-09-15T23:15:03.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.038+0000 7ff6eb796640 1 --2- 172.21.15.123:0/2115424028 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff6e415b7c0 0x7ff6e4153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.038+0000 7ff6eb796640 1 --2- 172.21.15.123:0/2115424028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff6e40cead0 0x7ff6e4152320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.038+0000 7ff6eb796640 1 --2- 172.21.15.123:0/2115424028 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff6c806c2e0 0x7ff6c806e7a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.038+0000 7ff6eb796640 1 --2- 172.21.15.123:0/2115424028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6e40ccf30 0x7ff6e415e020 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.038+0000 7ff6eb796640 1 -- 172.21.15.123:0/2115424028 >> 172.21.15.123:0/2115424028 conn(0x7ff6e406d0f0 msgr2=0x7ff6e40728e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:03.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.039+0000 7ff6eb796640 1 -- 172.21.15.123:0/2115424028 shutdown_connections 2024-09-15T23:15:03.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.039+0000 7ff6eb796640 1 -- 172.21.15.123:0/2115424028 wait complete. 2024-09-15T23:15:03.050 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T23:15:03.051 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2024-09-15T23:15:03.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.150+0000 7f2ba10e6640 1 Processor -- start 2024-09-15T23:15:03.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.151+0000 7f2ba10e6640 1 -- start start 2024-09-15T23:15:03.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.151+0000 7f2ba10e6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2b9c15b7c0 0x7f2b9c0b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.151+0000 7f2ba10e6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2b9c0cead0 0x7f2b9c071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.151+0000 7f2ba10e6640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b9c0cf2e0 con 0x7f2b9c0ccf30 2024-09-15T23:15:03.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.151+0000 7f2ba10e6640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f2b9c070fe0 con 0x7f2b9c0cead0 2024-09-15T23:15:03.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.151+0000 7f2ba10e6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f2b9c0712c0 con 0x7f2b9c15b7c0 2024-09-15T23:15:03.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.152+0000 7f2b9b59e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2b9c0cead0 0x7f2b9c071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.152+0000 7f2b9b59e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2b9c0cead0 0x7f2b9c071ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45698/0 (socket says 172.21.15.123:45698) 2024-09-15T23:15:03.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.152+0000 7f2b9b59e640 1 -- 172.21.15.123:0/1282667963 learned_addr learned my addr 172.21.15.123:0/1282667963 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:03.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.152+0000 7f2b9b59e640 1 -- 172.21.15.123:0/1282667963 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2b9c15b7c0 msgr2=0x7f2b9c0b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.152+0000 7f2b9a59c640 1 --2- 172.21.15.123:0/1282667963 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2b9c15b7c0 0x7f2b9c0b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.152+0000 7f2b9b59e640 1 --2- 172.21.15.123:0/1282667963 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2b9c15b7c0 0x7f2b9c0b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.152+0000 7f2b9b59e640 1 -- 172.21.15.123:0/1282667963 >> v1:172.21.15.188:6789/0 conn(0x7f2b9c0ccf30 legacy=0x7f2b9c0cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.152+0000 7f2b9b59e640 1 -- 172.21.15.123:0/1282667963 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b9c0715a0 con 0x7f2b9c0cead0 2024-09-15T23:15:03.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.153+0000 7f2b9b59e640 1 --2- 172.21.15.123:0/1282667963 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b9c0cead0 0x7f2b9c071ac0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c009870 tx=0x7f2b8c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2e7a4203ff6a33 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:03.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.153+0000 7f2b99d9b640 1 -- 172.21.15.123:0/1282667963 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c037070 con 0x7f2b9c0cead0 2024-09-15T23:15:03.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.153+0000 7f2b99d9b640 1 -- 172.21.15.123:0/1282667963 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b8c032440 con 0x7f2b9c0cead0 2024-09-15T23:15:03.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.153+0000 7f2b99d9b640 1 -- 172.21.15.123:0/1282667963 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c032810 con 0x7f2b9c0cead0 2024-09-15T23:15:03.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.153+0000 7f2ba10e6640 1 -- 172.21.15.123:0/1282667963 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b9c0cead0 msgr2=0x7f2b9c071ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.153+0000 7f2ba10e6640 1 --2- 172.21.15.123:0/1282667963 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b9c0cead0 0x7f2b9c071ac0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c009870 tx=0x7f2b8c02a180 comp rx=0 tx=0).stop 2024-09-15T23:15:03.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.153+0000 7f2ba10e6640 1 -- 172.21.15.123:0/1282667963 shutdown_connections 2024-09-15T23:15:03.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.153+0000 7f2ba10e6640 1 --2- 172.21.15.123:0/1282667963 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b9c0cead0 0x7f2b9c071ac0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.153+0000 7f2ba10e6640 1 --2- 172.21.15.123:0/1282667963 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2b9c15b7c0 0x7f2b9c0b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.153+0000 7f2ba10e6640 1 -- 172.21.15.123:0/1282667963 >> 172.21.15.123:0/1282667963 conn(0x7f2b9c06d0f0 msgr2=0x7f2b9c06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:03.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.153+0000 7f2ba10e6640 1 -- 172.21.15.123:0/1282667963 shutdown_connections 2024-09-15T23:15:03.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.153+0000 7f2ba10e6640 1 -- 172.21.15.123:0/1282667963 wait complete. 2024-09-15T23:15:03.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.155+0000 7f2ba10e6640 1 Processor -- start 2024-09-15T23:15:03.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.155+0000 7f2ba10e6640 1 -- start start 2024-09-15T23:15:03.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.155+0000 7f2ba10e6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2b9c0ccf30 0x7f2b9c13dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.155+0000 7f2ba10e6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2b9c0cead0 0x7f2b9c140d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.155+0000 7f2ba10e6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b9c15b7c0 0x7f2b9c15dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.155+0000 7f2ba10e6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2b9c0cf0c0 con 0x7f2b9c15b7c0 2024-09-15T23:15:03.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.155+0000 7f2ba10e6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2b9c0cef40 con 0x7f2b9c0ccf30 2024-09-15T23:15:03.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.155+0000 7f2ba10e6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f2b9c072000 con 0x7f2b9c0cead0 2024-09-15T23:15:03.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.156+0000 7f2b9b59e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b9c15b7c0 0x7f2b9c15dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.156+0000 7f2b9b59e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b9c15b7c0 0x7f2b9c15dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45700/0 (socket says 172.21.15.123:45700) 2024-09-15T23:15:03.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.156+0000 7f2b9b59e640 1 -- 172.21.15.123:0/3642683394 learned_addr learned my addr 172.21.15.123:0/3642683394 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:03.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.156+0000 7f2b9ad9d640 1 --2- 172.21.15.123:0/3642683394 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2b9c0ccf30 0x7f2b9c13dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.156+0000 7f2b9a59c640 1 --2- 172.21.15.123:0/3642683394 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2b9c0cead0 0x7f2b9c140d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.156+0000 7f2b9b59e640 1 -- 172.21.15.123:0/3642683394 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2b9c0cead0 msgr2=0x7f2b9c140d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.156+0000 7f2b9b59e640 1 --2- 172.21.15.123:0/3642683394 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2b9c0cead0 0x7f2b9c140d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.156+0000 7f2b9b59e640 1 -- 172.21.15.123:0/3642683394 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2b9c0ccf30 msgr2=0x7f2b9c13dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.156+0000 7f2b9b59e640 1 --2- 172.21.15.123:0/3642683394 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2b9c0ccf30 0x7f2b9c13dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.156+0000 7f2b9b59e640 1 -- 172.21.15.123:0/3642683394 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b9c141250 con 0x7f2b9c15b7c0 2024-09-15T23:15:03.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.156+0000 7f2b9a59c640 1 --2- 172.21.15.123:0/3642683394 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2b9c0cead0 0x7f2b9c140d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:03.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.156+0000 7f2b9ad9d640 1 --2- 172.21.15.123:0/3642683394 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2b9c0ccf30 0x7f2b9c13dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:03.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.156+0000 7f2b9b59e640 1 --2- 172.21.15.123:0/3642683394 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b9c15b7c0 0x7f2b9c15dde0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c02a1c0 tx=0x7f2b8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:03.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.156+0000 7f2b937fe640 1 -- 172.21.15.123:0/3642683394 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c041020 con 0x7f2b9c15b7c0 2024-09-15T23:15:03.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.156+0000 7f2b937fe640 1 -- 172.21.15.123:0/3642683394 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b8c030990 con 0x7f2b9c15b7c0 2024-09-15T23:15:03.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.156+0000 7f2ba10e6640 1 -- 172.21.15.123:0/3642683394 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b9c151010 con 0x7f2b9c15b7c0 2024-09-15T23:15:03.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.156+0000 7f2b937fe640 1 -- 172.21.15.123:0/3642683394 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c037040 con 0x7f2b9c15b7c0 2024-09-15T23:15:03.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.156+0000 7f2ba10e6640 1 -- 172.21.15.123:0/3642683394 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b9c1515d0 con 0x7f2b9c15b7c0 2024-09-15T23:15:03.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.158+0000 7f2b937fe640 1 -- 172.21.15.123:0/3642683394 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2b8c044020 con 0x7f2b9c15b7c0 2024-09-15T23:15:03.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.158+0000 7f2b937fe640 1 --2- 172.21.15.123:0/3642683394 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2b7c06c2b0 0x7f2b7c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.158+0000 7f2b937fe640 1 -- 172.21.15.123:0/3642683394 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7f2b8c0abe50 con 0x7f2b9c15b7c0 2024-09-15T23:15:03.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.159+0000 7f2b9ad9d640 1 --2- 172.21.15.123:0/3642683394 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2b7c06c2b0 0x7f2b7c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.159+0000 7f2ba3e80740 1 Processor -- start 2024-09-15T23:15:03.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.159+0000 7f2b9ad9d640 1 --2- 172.21.15.123:0/3642683394 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2b7c06c2b0 0x7f2b7c06e770 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c072df0 tx=0x7f2b94009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:03.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.159+0000 7f2ba3e80740 1 -- start start 2024-09-15T23:15:03.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.160+0000 7f2ba3e80740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfc5ea05d0 0x55dfc5ea09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.160+0000 7f2ba3e80740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dfc5e9dd90 0x55dfc5e9f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.160+0000 7f2ba3e80740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dfc5e9e1f0 0x55dfc5e80550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.160+0000 7f2ba3e80740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55dfc5dbc5d0 con 0x55dfc5e9dd90 2024-09-15T23:15:03.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.160+0000 7f2ba3e80740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55dfc5d64470 con 0x55dfc5ea05d0 2024-09-15T23:15:03.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.160+0000 7f2ba3e80740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55dfc5db8590 con 0x55dfc5e9e1f0 2024-09-15T23:15:03.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.160+0000 7f2b9a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dfc5e9dd90 0x55dfc5e9f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.160+0000 7f2b9a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dfc5e9dd90 0x55dfc5e9f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45704/0 (socket says 172.21.15.123:45704) 2024-09-15T23:15:03.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.160+0000 7f2b9a59c640 1 -- 172.21.15.123:0/282328343 learned_addr learned my addr 172.21.15.123:0/282328343 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:03.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.160+0000 7f2b9ad9d640 1 --2- 172.21.15.123:0/282328343 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfc5ea05d0 0x55dfc5ea09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.160+0000 7f2b9b59e640 1 --2- 172.21.15.123:0/282328343 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dfc5e9e1f0 0x55dfc5e80550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.160+0000 7f2b9a59c640 1 -- 172.21.15.123:0/282328343 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dfc5e9e1f0 msgr2=0x55dfc5e80550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.160+0000 7f2b9a59c640 1 --2- 172.21.15.123:0/282328343 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dfc5e9e1f0 0x55dfc5e80550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.160+0000 7f2b9a59c640 1 -- 172.21.15.123:0/282328343 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfc5ea05d0 msgr2=0x55dfc5ea09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.160+0000 7f2b9a59c640 1 --2- 172.21.15.123:0/282328343 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfc5ea05d0 0x55dfc5ea09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.160+0000 7f2b9a59c640 1 -- 172.21.15.123:0/282328343 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfc5d4c860 con 0x55dfc5e9dd90 2024-09-15T23:15:03.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.160+0000 7f2b9b59e640 1 --2- 172.21.15.123:0/282328343 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dfc5e9e1f0 0x55dfc5e80550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:03.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.160+0000 7f2b9a59c640 1 --2- 172.21.15.123:0/282328343 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dfc5e9dd90 0x55dfc5e9f920 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f2b8400ca10 tx=0x7f2b8400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcaa1ba41558143 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:03.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.161+0000 7f2b90ff9640 1 -- 172.21.15.123:0/282328343 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b84018030 con 0x55dfc5e9dd90 2024-09-15T23:15:03.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.161+0000 7f2b90ff9640 1 -- 172.21.15.123:0/282328343 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b8400eae0 con 0x55dfc5e9dd90 2024-09-15T23:15:03.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.161+0000 7f2b90ff9640 1 -- 172.21.15.123:0/282328343 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8400ecb0 con 0x55dfc5e9dd90 2024-09-15T23:15:03.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.161+0000 7f2ba3e80740 1 -- 172.21.15.123:0/282328343 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dfc5e9dd90 msgr2=0x55dfc5e9f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.161+0000 7f2ba3e80740 1 --2- 172.21.15.123:0/282328343 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dfc5e9dd90 0x55dfc5e9f920 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f2b8400ca10 tx=0x7f2b8400ced0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.161+0000 7f2ba3e80740 1 -- 172.21.15.123:0/282328343 shutdown_connections 2024-09-15T23:15:03.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.161+0000 7f2ba3e80740 1 --2- 172.21.15.123:0/282328343 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dfc5e9e1f0 0x55dfc5e80550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.161+0000 7f2ba3e80740 1 --2- 172.21.15.123:0/282328343 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dfc5e9dd90 0x55dfc5e9f920 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.161+0000 7f2ba3e80740 1 --2- 172.21.15.123:0/282328343 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfc5ea05d0 0x55dfc5ea09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.161+0000 7f2ba3e80740 1 -- 172.21.15.123:0/282328343 >> 172.21.15.123:0/282328343 conn(0x55dfc5e56230 msgr2=0x55dfc5e9e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:03.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.161+0000 7f2ba3e80740 1 -- 172.21.15.123:0/282328343 shutdown_connections 2024-09-15T23:15:03.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.161+0000 7f2ba3e80740 1 -- 172.21.15.123:0/282328343 wait complete. 2024-09-15T23:15:03.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.162+0000 7f2ba3e80740 1 -- start start 2024-09-15T23:15:03.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.162+0000 7f2ba3e80740 1 Processor -- start 2024-09-15T23:15:03.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.163+0000 7f2ba3e80740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfc5e9e1f0 0x55dfc5e97610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.163+0000 7f2ba3e80740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dfc5ea05d0 0x55dfc5e97b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.163+0000 7f2ba3e80740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dfc5eb1f80 0x55dfc5eb23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.163+0000 7f2ba3e80740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55dfc5e9ccf0 con 0x55dfc5ea05d0 2024-09-15T23:15:03.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.163+0000 7f2ba3e80740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55dfc5d45620 con 0x55dfc5e9e1f0 2024-09-15T23:15:03.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.163+0000 7f2ba3e80740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55dfc5e9cfd0 con 0x55dfc5eb1f80 2024-09-15T23:15:03.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.163+0000 7f2ba3e80740 10 client.0 _ll_register_callbacks cb 0x55dfc5d695b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:15:03.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.163+0000 7f2b9a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dfc5ea05d0 0x55dfc5e97b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.163+0000 7f2b9a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dfc5ea05d0 0x55dfc5e97b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45718/0 (socket says 172.21.15.123:45718) 2024-09-15T23:15:03.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.163+0000 7f2b9a59c640 1 -- 172.21.15.123:0/3815771266 learned_addr learned my addr 172.21.15.123:0/3815771266 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:03.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.163+0000 7f2b9b59e640 1 --2- 172.21.15.123:0/3815771266 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dfc5eb1f80 0x55dfc5eb23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.163+0000 7f2b9ad9d640 1 --2- 172.21.15.123:0/3815771266 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfc5e9e1f0 0x55dfc5e97610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.163+0000 7f2b9a59c640 1 -- 172.21.15.123:0/3815771266 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dfc5eb1f80 msgr2=0x55dfc5eb23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.163+0000 7f2b9a59c640 1 --2- 172.21.15.123:0/3815771266 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dfc5eb1f80 0x55dfc5eb23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.163+0000 7f2b9a59c640 1 -- 172.21.15.123:0/3815771266 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfc5e9e1f0 msgr2=0x55dfc5e97610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.163+0000 7f2b9a59c640 1 --2- 172.21.15.123:0/3815771266 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfc5e9e1f0 0x55dfc5e97610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.163+0000 7f2b9a59c640 1 -- 172.21.15.123:0/3815771266 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfc5acf3f0 con 0x55dfc5ea05d0 2024-09-15T23:15:03.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.163+0000 7f2b9ad9d640 1 --2- 172.21.15.123:0/3815771266 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfc5e9e1f0 0x55dfc5e97610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:03.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.163+0000 7f2b9a59c640 1 --2- 172.21.15.123:0/3815771266 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dfc5ea05d0 0x55dfc5e97b50 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f2b84017040 tx=0x7f2b84004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25dec3f4f0abadf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:03.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.163+0000 7f2b79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:15:03.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.163+0000 7f2b79ffb640 1 -- 172.21.15.123:0/3815771266 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b84004030 con 0x55dfc5ea05d0 2024-09-15T23:15:03.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.163+0000 7f2b79ffb640 1 -- 172.21.15.123:0/3815771266 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7f2b840041d0 con 0x55dfc5ea05d0 2024-09-15T23:15:03.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.163+0000 7f2ba3e80740 1 -- 172.21.15.123:0/3815771266 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b8400eae0 con 0x55dfc5ea05d0 2024-09-15T23:15:03.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.164+0000 7f2b79ffb640 1 -- 172.21.15.123:0/3815771266 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f2b8402d050 con 0x55dfc5ea05d0 2024-09-15T23:15:03.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.164+0000 7f2ba3e80740 10 client.5976 fetch_fsmap learned FSMap version 22 2024-09-15T23:15:03.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.164+0000 7f2ba3e80740 1 -- 172.21.15.123:0/3815771266 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x55dfc5b997d0 con 0x55dfc5ea05d0 2024-09-15T23:15:03.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.164+0000 7f2b79ffb640 1 -- 172.21.15.123:0/3815771266 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b8400eae0 con 0x55dfc5ea05d0 2024-09-15T23:15:03.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.164+0000 7f2b79ffb640 1 -- 172.21.15.123:0/3815771266 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 22) ==== 3502+0+0 (secure 0 0 0) 0x7f2b84030020 con 0x55dfc5ea05d0 2024-09-15T23:15:03.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.164+0000 7f2ba3e80740 10 client.5976 fetch_fsmap finished waiting for FSMap version 22 2024-09-15T23:15:03.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.164+0000 7f2ba3e80740 10 client.5976 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:15:03.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.164+0000 7f2ba3e80740 20 client.5976 populate_metadata read hostname 'smithi123' 2024-09-15T23:15:03.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.164+0000 7f2ba3e80740 1 --2- 172.21.15.123:0/3815771266 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55dfc5e841a0 0x55dfc5e71400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.164+0000 7f2ba3e80740 4 client.5976 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:15:03.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.164+0000 7f2ba3e80740 1 -- 172.21.15.123:0/3815771266 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dfc5e1b030 con 0x55dfc5e841a0 2024-09-15T23:15:03.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.164+0000 7f2b9ad9d640 1 --2- 172.21.15.123:0/3815771266 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55dfc5e841a0 0x55dfc5e71400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.164+0000 7f2b79ffb640 10 client.5976 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:15:03.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.164+0000 7f2b9ad9d640 1 --2- 172.21.15.123:0/3815771266 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55dfc5e841a0 0x55dfc5e71400 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=150c0c6e3fd87aaf server_cookie=17685aa7aa8e863a in_seq=0 out_seq=0 2024-09-15T23:15:03.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.165+0000 7f2b79ffb640 1 -- 172.21.15.123:0/3815771266 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dfc5e1b030 con 0x55dfc5e841a0 2024-09-15T23:15:03.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.165+0000 7f2b79ffb640 10 client.5976 handle_command_reply: tid=0 2024-09-15T23:15:03.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.165+0000 7f2ba3e80740 1 client.5976 shutdown 2024-09-15T23:15:03.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.165+0000 7f2ba3e80740 1 -- 172.21.15.123:0/3815771266 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dfc5ea05d0 msgr2=0x55dfc5e97b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.165+0000 7f2ba3e80740 1 --2- 172.21.15.123:0/3815771266 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dfc5ea05d0 0x55dfc5e97b50 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f2b84017040 tx=0x7f2b84004730 comp rx=0 tx=0).stop 2024-09-15T23:15:03.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.165+0000 7f2ba3e80740 1 -- 172.21.15.123:0/3815771266 shutdown_connections 2024-09-15T23:15:03.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.165+0000 7f2ba3e80740 1 --2- 172.21.15.123:0/3815771266 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55dfc5e841a0 0x55dfc5e71400 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.165+0000 7f2ba3e80740 1 --2- 172.21.15.123:0/3815771266 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dfc5eb1f80 0x55dfc5eb23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.165+0000 7f2ba3e80740 1 --2- 172.21.15.123:0/3815771266 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dfc5ea05d0 0x55dfc5e97b50 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.165+0000 7f2b79ffb640 0 client.5976 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:15:03.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.165+0000 7f2ba3e80740 1 --2- 172.21.15.123:0/3815771266 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfc5e9e1f0 0x55dfc5e97610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.165+0000 7f2ba3e80740 1 -- 172.21.15.123:0/3815771266 >> 172.21.15.123:0/3815771266 conn(0x55dfc5e9dd90 msgr2=0x55dfc5e9e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:03.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.165+0000 7f2ba3e80740 1 -- 172.21.15.123:0/3815771266 shutdown_connections 2024-09-15T23:15:03.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.165+0000 7f2ba3e80740 1 -- 172.21.15.123:0/3815771266 wait complete. 2024-09-15T23:15:03.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.166+0000 7f2ba3e80740 20 client.5976 trim_cache size 0 max 16384 2024-09-15T23:15:03.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.179+0000 7f2ba3e80740 1 Processor -- start 2024-09-15T23:15:03.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.179+0000 7f2ba3e80740 1 -- start start 2024-09-15T23:15:03.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.179+0000 7f2ba3e80740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfc5e9e1f0 0x55dfc5eb9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.179+0000 7f2ba3e80740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dfc5ea05d0 0x55dfc5e94d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.179+0000 7f2ba3e80740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dfc5eb1f80 0x55dfc5e95ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.179+0000 7f2ba3e80740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55dfc5e9bbe0 con 0x55dfc5ea05d0 2024-09-15T23:15:03.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.179+0000 7f2ba3e80740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2b9c1fedc0 con 0x55dfc5e9e1f0 2024-09-15T23:15:03.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.179+0000 7f2ba3e80740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f2b9c1fded0 con 0x55dfc5eb1f80 2024-09-15T23:15:03.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.179+0000 7f2b9a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dfc5ea05d0 0x55dfc5e94d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.179+0000 7f2b9a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dfc5ea05d0 0x55dfc5e94d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45734/0 (socket says 172.21.15.123:45734) 2024-09-15T23:15:03.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.179+0000 7f2b9a59c640 1 -- 172.21.15.123:0/2770265352 learned_addr learned my addr 172.21.15.123:0/2770265352 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:03.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.180+0000 7f2b9a59c640 1 -- 172.21.15.123:0/2770265352 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dfc5eb1f80 msgr2=0x55dfc5e95ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.180+0000 7f2b9a59c640 1 --2- 172.21.15.123:0/2770265352 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dfc5eb1f80 0x55dfc5e95ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.180+0000 7f2b9a59c640 1 -- 172.21.15.123:0/2770265352 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfc5e9e1f0 msgr2=0x55dfc5eb9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.180+0000 7f2b9a59c640 1 --2- 172.21.15.123:0/2770265352 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfc5e9e1f0 0x55dfc5eb9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.180+0000 7f2b9a59c640 1 -- 172.21.15.123:0/2770265352 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfc5eb2750 con 0x55dfc5ea05d0 2024-09-15T23:15:03.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.180+0000 7f2b9a59c640 1 --2- 172.21.15.123:0/2770265352 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dfc5ea05d0 0x55dfc5e94d50 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f2b8400e5a0 tx=0x7f2b8401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f75632f89e6a94 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:03.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.180+0000 7f2b7bfff640 1 -- 172.21.15.123:0/2770265352 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b84035070 con 0x55dfc5ea05d0 2024-09-15T23:15:03.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.180+0000 7f2b7bfff640 1 -- 172.21.15.123:0/2770265352 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b8400c860 con 0x55dfc5ea05d0 2024-09-15T23:15:03.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.180+0000 7f2b7bfff640 1 -- 172.21.15.123:0/2770265352 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b84018040 con 0x55dfc5ea05d0 2024-09-15T23:15:03.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.180+0000 7f2ba3e80740 1 -- 172.21.15.123:0/2770265352 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dfc5ea05d0 msgr2=0x55dfc5e94d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.180+0000 7f2ba3e80740 1 --2- 172.21.15.123:0/2770265352 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dfc5ea05d0 0x55dfc5e94d50 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f2b8400e5a0 tx=0x7f2b8401e000 comp rx=0 tx=0).stop 2024-09-15T23:15:03.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.180+0000 7f2ba3e80740 1 -- 172.21.15.123:0/2770265352 shutdown_connections 2024-09-15T23:15:03.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.180+0000 7f2ba3e80740 1 --2- 172.21.15.123:0/2770265352 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dfc5eb1f80 0x55dfc5e95ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.181+0000 7f2ba3e80740 1 --2- 172.21.15.123:0/2770265352 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dfc5ea05d0 0x55dfc5e94d50 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.181+0000 7f2ba3e80740 1 --2- 172.21.15.123:0/2770265352 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfc5e9e1f0 0x55dfc5eb9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.181+0000 7f2ba3e80740 1 -- 172.21.15.123:0/2770265352 >> 172.21.15.123:0/2770265352 conn(0x55dfc5e9dd90 msgr2=0x55dfc5ea0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:03.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.181+0000 7f2ba3e80740 1 -- 172.21.15.123:0/2770265352 shutdown_connections 2024-09-15T23:15:03.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.181+0000 7f2ba3e80740 1 -- 172.21.15.123:0/2770265352 wait complete. 2024-09-15T23:15:03.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.181+0000 7f2ba3e80740 1 -- start start 2024-09-15T23:15:03.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.181+0000 7f2ba3e80740 1 Processor -- start 2024-09-15T23:15:03.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.182+0000 7f2ba3e80740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dfc5e9e1f0 0x55dfc5e6fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.182+0000 7f2ba3e80740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dfc5ea05d0 0x55dfc5eace40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.182+0000 7f2ba3e80740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfc5eb1f80 0x55dfc5ec27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.182+0000 7f2ba3e80740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2b9c13f000 con 0x55dfc5e9e1f0 2024-09-15T23:15:03.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.182+0000 7f2ba3e80740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2b9c06ca90 con 0x55dfc5eb1f80 2024-09-15T23:15:03.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.182+0000 7f2ba3e80740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55dfc5e80ed0 con 0x55dfc5ea05d0 2024-09-15T23:15:03.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.182+0000 7f2b9ad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dfc5e9e1f0 0x55dfc5e6fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.182+0000 7f2ba3e80740 10 client.0 _ll_register_callbacks cb 0x7f2b840137a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:15:03.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.182+0000 7f2b9ad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dfc5e9e1f0 0x55dfc5e6fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45736/0 (socket says 172.21.15.123:45736) 2024-09-15T23:15:03.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.182+0000 7f2b9ad9d640 1 -- 172.21.15.123:0/3332977506 learned_addr learned my addr 172.21.15.123:0/3332977506 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:03.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.182+0000 7f2b9ad9d640 1 -- 172.21.15.123:0/3332977506 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dfc5ea05d0 msgr2=0x55dfc5eace40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.182+0000 7f2b9ad9d640 1 --2- 172.21.15.123:0/3332977506 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dfc5ea05d0 0x55dfc5eace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.182+0000 7f2b9ad9d640 1 -- 172.21.15.123:0/3332977506 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfc5eb1f80 msgr2=0x55dfc5ec27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.182+0000 7f2b9b59e640 1 --2- 172.21.15.123:0/3332977506 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfc5eb1f80 0x55dfc5ec27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.182+0000 7f2b9ad9d640 1 --2- 172.21.15.123:0/3332977506 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfc5eb1f80 0x55dfc5ec27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.182+0000 7f2b9ad9d640 1 -- 172.21.15.123:0/3332977506 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfc5ea0d20 con 0x55dfc5e9e1f0 2024-09-15T23:15:03.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.182+0000 7f2b9b59e640 1 --2- 172.21.15.123:0/3332977506 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfc5eb1f80 0x55dfc5ec27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:03.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.182+0000 7f2b9ad9d640 1 --2- 172.21.15.123:0/3332977506 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dfc5e9e1f0 0x55dfc5e6fd10 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x55dfc5e84760 tx=0x7f2b94003ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f8feaf244d735d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:03.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.182+0000 7f2b79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:15:03.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.183+0000 7f2b79ffb640 1 -- 172.21.15.123:0/3332977506 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b94015c10 con 0x55dfc5e9e1f0 2024-09-15T23:15:03.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.183+0000 7f2b79ffb640 1 -- 172.21.15.123:0/3332977506 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7f2b9401e040 con 0x55dfc5e9e1f0 2024-09-15T23:15:03.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.183+0000 7f2ba3e80740 1 -- 172.21.15.123:0/3332977506 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b8400c860 con 0x55dfc5e9e1f0 2024-09-15T23:15:03.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.183+0000 7f2b79ffb640 1 -- 172.21.15.123:0/3332977506 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f2b94015db0 con 0x55dfc5e9e1f0 2024-09-15T23:15:03.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.183+0000 7f2ba3e80740 10 client.5982 fetch_fsmap learned FSMap version 22 2024-09-15T23:15:03.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.183+0000 7f2ba3e80740 1 -- 172.21.15.123:0/3332977506 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x55dfc5e974b0 con 0x55dfc5e9e1f0 2024-09-15T23:15:03.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.183+0000 7f2b79ffb640 1 -- 172.21.15.123:0/3332977506 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b8400c860 con 0x55dfc5e9e1f0 2024-09-15T23:15:03.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.183+0000 7f2b79ffb640 1 -- 172.21.15.123:0/3332977506 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 22) ==== 3502+0+0 (secure 0 0 0) 0x7f2b94036050 con 0x55dfc5e9e1f0 2024-09-15T23:15:03.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.183+0000 7f2ba3e80740 10 client.5982 fetch_fsmap finished waiting for FSMap version 22 2024-09-15T23:15:03.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.183+0000 7f2ba3e80740 10 client.5982 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:15:03.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.183+0000 7f2ba3e80740 20 client.5982 populate_metadata read hostname 'smithi123' 2024-09-15T23:15:03.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.183+0000 7f2ba3e80740 1 --2- 172.21.15.123:0/3332977506 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55dfc5eadac0 0x55dfc5e52f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.183+0000 7f2ba3e80740 4 client.5982 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:15:03.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.183+0000 7f2ba3e80740 1 -- 172.21.15.123:0/3332977506 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dfc5dc9d00 con 0x55dfc5eadac0 2024-09-15T23:15:03.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.183+0000 7f2b9a59c640 1 --2- 172.21.15.123:0/3332977506 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55dfc5eadac0 0x55dfc5e52f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.184+0000 7f2b79ffb640 10 client.5982 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:15:03.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.184+0000 7f2b9a59c640 1 --2- 172.21.15.123:0/3332977506 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55dfc5eadac0 0x55dfc5e52f60 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf8311e88e108c0d server_cookie=48169a00675ae86 in_seq=0 out_seq=0 2024-09-15T23:15:03.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.184+0000 7f2b79ffb640 1 -- 172.21.15.123:0/3332977506 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+168 (crc 0 0 0) 0x55dfc5dc9d00 con 0x55dfc5eadac0 2024-09-15T23:15:03.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.184+0000 7f2b79ffb640 10 client.5982 handle_command_reply: tid=0 2024-09-15T23:15:03.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.184+0000 7f2ba3e80740 1 client.5982 shutdown 2024-09-15T23:15:03.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.184+0000 7f2ba3e80740 1 -- 172.21.15.123:0/3332977506 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dfc5e9e1f0 msgr2=0x55dfc5e6fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.184+0000 7f2ba3e80740 1 --2- 172.21.15.123:0/3332977506 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dfc5e9e1f0 0x55dfc5e6fd10 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x55dfc5e84760 tx=0x7f2b94003ae0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.184+0000 7f2ba3e80740 1 -- 172.21.15.123:0/3332977506 shutdown_connections 2024-09-15T23:15:03.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.184+0000 7f2ba3e80740 1 --2- 172.21.15.123:0/3332977506 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x55dfc5eadac0 0x55dfc5e52f60 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.184+0000 7f2ba3e80740 1 --2- 172.21.15.123:0/3332977506 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dfc5eb1f80 0x55dfc5ec27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.184+0000 7f2ba3e80740 1 --2- 172.21.15.123:0/3332977506 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dfc5ea05d0 0x55dfc5eace40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.184+0000 7f2ba3e80740 1 --2- 172.21.15.123:0/3332977506 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dfc5e9e1f0 0x55dfc5e6fd10 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.184+0000 7f2b79ffb640 0 client.5982 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:15:03.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.184+0000 7f2ba3e80740 1 -- 172.21.15.123:0/3332977506 >> 172.21.15.123:0/3332977506 conn(0x55dfc5e9dd90 msgr2=0x55dfc5e94d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:03.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.184+0000 7f2ba3e80740 1 -- 172.21.15.123:0/3332977506 shutdown_connections 2024-09-15T23:15:03.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.184+0000 7f2ba3e80740 1 -- 172.21.15.123:0/3332977506 wait complete. 2024-09-15T23:15:03.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.184+0000 7f2ba3e80740 20 client.5982 trim_cache size 0 max 16384 2024-09-15T23:15:03.192 INFO:teuthology.orchestra.run.smithi123.stdout:[ 2024-09-15T23:15:03.192 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:03.192 INFO:teuthology.orchestra.run.smithi123.stdout: "damage_type": "backtrace", 2024-09-15T23:15:03.192 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 1191626301, 2024-09-15T23:15:03.192 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511630414, 2024-09-15T23:15:03.192 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1" 2024-09-15T23:15:03.192 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:03.192 INFO:teuthology.orchestra.run.smithi123.stdout:] 2024-09-15T23:15:03.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.184+0000 7f2ba10e6640 1 -- 172.21.15.123:0/3642683394 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2b7c06c2b0 msgr2=0x7f2b7c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.184+0000 7f2ba10e6640 1 --2- 172.21.15.123:0/3642683394 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2b7c06c2b0 0x7f2b7c06e770 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c072df0 tx=0x7f2b94009040 comp rx=0 tx=0).stop 2024-09-15T23:15:03.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.184+0000 7f2ba10e6640 1 -- 172.21.15.123:0/3642683394 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b9c15b7c0 msgr2=0x7f2b9c15dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.184+0000 7f2ba10e6640 1 --2- 172.21.15.123:0/3642683394 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b9c15b7c0 0x7f2b9c15dde0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c02a1c0 tx=0x7f2b8c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.185+0000 7f2ba10e6640 1 -- 172.21.15.123:0/3642683394 shutdown_connections 2024-09-15T23:15:03.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.185+0000 7f2ba10e6640 1 --2- 172.21.15.123:0/3642683394 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2b7c06c2b0 0x7f2b7c06e770 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.185+0000 7f2ba10e6640 1 --2- 172.21.15.123:0/3642683394 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2b9c15b7c0 0x7f2b9c15dde0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.185+0000 7f2ba10e6640 1 --2- 172.21.15.123:0/3642683394 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2b9c0cead0 0x7f2b9c140d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.185+0000 7f2ba10e6640 1 --2- 172.21.15.123:0/3642683394 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2b9c0ccf30 0x7f2b9c13dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.185+0000 7f2ba10e6640 1 -- 172.21.15.123:0/3642683394 >> 172.21.15.123:0/3642683394 conn(0x7f2b9c06d0f0 msgr2=0x7f2b9c0b5be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:03.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.185+0000 7f2ba10e6640 1 -- 172.21.15.123:0/3642683394 shutdown_connections 2024-09-15T23:15:03.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.185+0000 7f2ba10e6640 1 -- 172.21.15.123:0/3642683394 wait complete. 2024-09-15T23:15:03.197 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:15:03.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.294+0000 7f9aada42640 1 Processor -- start 2024-09-15T23:15:03.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.294+0000 7f9aada42640 1 -- start start 2024-09-15T23:15:03.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.294+0000 7f9aada42640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f9aa80b6dc0 0x7f9aa815ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.294+0000 7f9aada42640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9aa815f570 con 0x7f9aa8162490 2024-09-15T23:15:03.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.294+0000 7f9aada42640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9aa815f850 con 0x7f9aa815eab0 2024-09-15T23:15:03.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.294+0000 7f9aada42640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f9aa815fb30 con 0x7f9aa80b6dc0 2024-09-15T23:15:03.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.295+0000 7f9aa67fc640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f9aa8162490 0x7f9aa80b66b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54502/0 (socket says 172.21.15.123:54502) 2024-09-15T23:15:03.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.295+0000 7f9aa67fc640 1 -- 172.21.15.123:0/26871725 learned_addr learned my addr 172.21.15.123:0/26871725 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:03.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.295+0000 7f9aa77fe640 1 --2- 172.21.15.123:0/26871725 >> v2:172.21.15.188:3300/0 conn(0x7f9aa80b6dc0 0x7f9aa815ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.295+0000 7f9aa5ffb640 1 -- 172.21.15.123:0/26871725 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1150609817 0 0) 0x7f9aa815f570 con 0x7f9aa8162490 2024-09-15T23:15:03.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.295+0000 7f9aa5ffb640 1 -- 172.21.15.123:0/26871725 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a90003520 con 0x7f9aa8162490 2024-09-15T23:15:03.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.295+0000 7f9aa77fe640 1 -- 172.21.15.123:0/26871725 >> v1:172.21.15.188:6789/0 conn(0x7f9aa815eab0 legacy=0x7f9aa80d2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.295+0000 7f9aa77fe640 1 -- 172.21.15.123:0/26871725 >> v1:172.21.15.123:6789/0 conn(0x7f9aa8162490 legacy=0x7f9aa80b66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.295+0000 7f9aa77fe640 1 -- 172.21.15.123:0/26871725 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aa815fe10 con 0x7f9aa80b6dc0 2024-09-15T23:15:03.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.296+0000 7f9aa77fe640 1 --2- 172.21.15.123:0/26871725 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9aa80b6dc0 0x7f9aa815ee90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009d90 tx=0x7f9aa002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5f85190ab878ec3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:03.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.296+0000 7f9aa5ffb640 1 -- 172.21.15.123:0/26871725 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0007740 con 0x7f9aa80b6dc0 2024-09-15T23:15:03.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.296+0000 7f9aa5ffb640 1 -- 172.21.15.123:0/26871725 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aa00078e0 con 0x7f9aa80b6dc0 2024-09-15T23:15:03.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.296+0000 7f9aa5ffb640 1 -- 172.21.15.123:0/26871725 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0007c90 con 0x7f9aa80b6dc0 2024-09-15T23:15:03.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.297+0000 7f9aada42640 1 -- 172.21.15.123:0/26871725 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9aa80b6dc0 msgr2=0x7f9aa815ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.297+0000 7f9aada42640 1 --2- 172.21.15.123:0/26871725 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9aa80b6dc0 0x7f9aa815ee90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009d90 tx=0x7f9aa002a6f0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.297+0000 7f9aada42640 1 -- 172.21.15.123:0/26871725 shutdown_connections 2024-09-15T23:15:03.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.297+0000 7f9aada42640 1 --2- 172.21.15.123:0/26871725 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9aa80b6dc0 0x7f9aa815ee90 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.297+0000 7f9aada42640 1 -- 172.21.15.123:0/26871725 >> 172.21.15.123:0/26871725 conn(0x7f9aa80d16d0 msgr2=0x7f9aa80d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:03.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.297+0000 7f9aada42640 1 -- 172.21.15.123:0/26871725 shutdown_connections 2024-09-15T23:15:03.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.297+0000 7f9aada42640 1 -- 172.21.15.123:0/26871725 wait complete. 2024-09-15T23:15:03.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.298+0000 7f9aada42640 1 Processor -- start 2024-09-15T23:15:03.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.298+0000 7f9aada42640 1 -- start start 2024-09-15T23:15:03.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.299+0000 7f9aada42640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9aa80b6dc0 0x7f9aa81f45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.299+0000 7f9aada42640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9aa815eab0 0x7f9aa80ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.299+0000 7f9aada42640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9aa8162490 0x7f9aa8150c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.299+0000 7f9aada42640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa80d45e0 con 0x7f9aa8162490 2024-09-15T23:15:03.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.299+0000 7f9aada42640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa80d4460 con 0x7f9aa80b6dc0 2024-09-15T23:15:03.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.299+0000 7f9aada42640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9aa80d35e0 con 0x7f9aa815eab0 2024-09-15T23:15:03.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.299+0000 7f9aa77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9aa8162490 0x7f9aa8150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.299+0000 7f9aa77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9aa8162490 0x7f9aa8150c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45746/0 (socket says 172.21.15.123:45746) 2024-09-15T23:15:03.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.299+0000 7f9aa77fe640 1 -- 172.21.15.123:0/4016885575 learned_addr learned my addr 172.21.15.123:0/4016885575 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:03.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.299+0000 7f9aa67fc640 1 --2- 172.21.15.123:0/4016885575 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9aa815eab0 0x7f9aa80ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.299+0000 7f9aa6ffd640 1 --2- 172.21.15.123:0/4016885575 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9aa80b6dc0 0x7f9aa81f45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.299+0000 7f9aa77fe640 1 -- 172.21.15.123:0/4016885575 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9aa815eab0 msgr2=0x7f9aa80ce7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.299+0000 7f9aa77fe640 1 --2- 172.21.15.123:0/4016885575 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9aa815eab0 0x7f9aa80ce7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.299+0000 7f9aa77fe640 1 -- 172.21.15.123:0/4016885575 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9aa80b6dc0 msgr2=0x7f9aa81f45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.299+0000 7f9aa77fe640 1 --2- 172.21.15.123:0/4016885575 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9aa80b6dc0 0x7f9aa81f45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.299+0000 7f9aa77fe640 1 -- 172.21.15.123:0/4016885575 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aa81511d0 con 0x7f9aa8162490 2024-09-15T23:15:03.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.299+0000 7f9aa6ffd640 1 --2- 172.21.15.123:0/4016885575 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9aa80b6dc0 0x7f9aa81f45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:03.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.299+0000 7f9aa77fe640 1 --2- 172.21.15.123:0/4016885575 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9aa8162490 0x7f9aa8150c90 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009eb0 tx=0x7f9aa0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:03.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.299+0000 7f9a8ffff640 1 -- 172.21.15.123:0/4016885575 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0040070 con 0x7f9aa8162490 2024-09-15T23:15:03.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.299+0000 7f9a8ffff640 1 -- 172.21.15.123:0/4016885575 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aa0031c40 con 0x7f9aa8162490 2024-09-15T23:15:03.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.299+0000 7f9aada42640 1 -- 172.21.15.123:0/4016885575 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9aa80c94f0 con 0x7f9aa8162490 2024-09-15T23:15:03.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.299+0000 7f9a8ffff640 1 -- 172.21.15.123:0/4016885575 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0009450 con 0x7f9aa8162490 2024-09-15T23:15:03.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.299+0000 7f9aada42640 1 -- 172.21.15.123:0/4016885575 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aa80c9ab0 con 0x7f9aa8162490 2024-09-15T23:15:03.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.301+0000 7f9aada42640 1 -- 172.21.15.123:0/4016885575 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9aa815f570 con 0x7f9aa8162490 2024-09-15T23:15:03.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.301+0000 7f9a8ffff640 1 -- 172.21.15.123:0/4016885575 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9aa0039040 con 0x7f9aa8162490 2024-09-15T23:15:03.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.302+0000 7f9a8ffff640 1 --2- 172.21.15.123:0/4016885575 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9a9406c2b0 0x7f9a9406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.302+0000 7f9a8ffff640 1 -- 172.21.15.123:0/4016885575 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7f9aa00ac6f0 con 0x7f9aa8162490 2024-09-15T23:15:03.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.302+0000 7f9aa6ffd640 1 --2- 172.21.15.123:0/4016885575 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9a9406c2b0 0x7f9a9406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.302+0000 7f9aa6ffd640 1 --2- 172.21.15.123:0/4016885575 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9a9406c2b0 0x7f9a9406e770 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9a98001700 tx=0x7f9a98009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:03.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.306+0000 7f9a8ffff640 1 -- 172.21.15.123:0/4016885575 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9aa81511d0 con 0x7f9aa8162490 2024-09-15T23:15:03.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.506+0000 7f9aada42640 1 -- 172.21.15.123:0/4016885575 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9aa80d2500 con 0x7f9aa8162490 2024-09-15T23:15:03.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.506+0000 7f9a8ffff640 1 -- 172.21.15.123:0/4016885575 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5229 (secure 0 0 0) 0x7f9aa007a660 con 0x7f9aa8162490 2024-09-15T23:15:03.507 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:03.508 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":22,"btime":"2024-09-15T23:14:58:309501+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5014,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/354247514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":354247514},{"type":"v1","addr":"172.21.15.188:6837","nonce":354247514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2925346627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2925346627},{"type":"v1","addr":"172.21.15.123:6834","nonce":2925346627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/280703051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":280703051},{"type":"v1","addr":"172.21.15.123:6835","nonce":280703051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:14:32.926325+0000","modified":"2024-09-15T23:14:57.626319+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.188:6836/1307575248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":1307575248},{"type":"v1","addr":"172.21.15.188:6836","nonce":1307575248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":3}]} 2024-09-15T23:15:03.508 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 22 2024-09-15T23:15:03.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.508+0000 7f9aada42640 1 -- 172.21.15.123:0/4016885575 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9a9406c2b0 msgr2=0x7f9a9406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.508+0000 7f9aada42640 1 --2- 172.21.15.123:0/4016885575 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9a9406c2b0 0x7f9a9406e770 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9a98001700 tx=0x7f9a98009040 comp rx=0 tx=0).stop 2024-09-15T23:15:03.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.508+0000 7f9aada42640 1 -- 172.21.15.123:0/4016885575 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9aa8162490 msgr2=0x7f9aa8150c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.508+0000 7f9aada42640 1 --2- 172.21.15.123:0/4016885575 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9aa8162490 0x7f9aa8150c90 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009eb0 tx=0x7f9aa0004a40 comp rx=0 tx=0).stop 2024-09-15T23:15:03.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.508+0000 7f9aada42640 1 -- 172.21.15.123:0/4016885575 shutdown_connections 2024-09-15T23:15:03.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.508+0000 7f9aada42640 1 --2- 172.21.15.123:0/4016885575 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9a9406c2b0 0x7f9a9406e770 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.508+0000 7f9aada42640 1 --2- 172.21.15.123:0/4016885575 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9aa8162490 0x7f9aa8150c90 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.508+0000 7f9aada42640 1 --2- 172.21.15.123:0/4016885575 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9aa815eab0 0x7f9aa80ce7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.508+0000 7f9aada42640 1 --2- 172.21.15.123:0/4016885575 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9aa80b6dc0 0x7f9aa81f45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.508+0000 7f9aada42640 1 -- 172.21.15.123:0/4016885575 >> 172.21.15.123:0/4016885575 conn(0x7f9aa80d16d0 msgr2=0x7f9aa806e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:03.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.509+0000 7f9aada42640 1 -- 172.21.15.123:0/4016885575 shutdown_connections 2024-09-15T23:15:03.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.509+0000 7f9aada42640 1 -- 172.21.15.123:0/4016885575 wait complete. 2024-09-15T23:15:03.520 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d damage rm 1191626301 2024-09-15T23:15:03.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.621+0000 7f17b0e74640 1 Processor -- start 2024-09-15T23:15:03.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.621+0000 7f17b0e74640 1 -- start start 2024-09-15T23:15:03.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.622+0000 7f17b0e74640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f17ac0cce30 0x7f17ac0cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.622+0000 7f17b0e74640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f17ac071c70 0x7f17ac072120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.622+0000 7f17b0e74640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17ac0714b0 con 0x7f17ac0732e0 2024-09-15T23:15:03.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.622+0000 7f17b0e74640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f17ac0cd880 con 0x7f17ac071c70 2024-09-15T23:15:03.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.622+0000 7f17b0e74640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f17ac0cdb60 con 0x7f17ac0cce30 2024-09-15T23:15:03.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.622+0000 7f17aad9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f17ac071c70 0x7f17ac072120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.622+0000 7f17aad9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f17ac071c70 0x7f17ac072120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45756/0 (socket says 172.21.15.123:45756) 2024-09-15T23:15:03.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.622+0000 7f17aad9d640 1 -- 172.21.15.123:0/799476114 learned_addr learned my addr 172.21.15.123:0/799476114 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:03.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.622+0000 7f17a9d9b640 1 --2- 172.21.15.123:0/799476114 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f17ac0cce30 0x7f17ac0cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.622+0000 7f17aad9d640 1 -- 172.21.15.123:0/799476114 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f17ac0cce30 msgr2=0x7f17ac0cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.622+0000 7f17aad9d640 1 --2- 172.21.15.123:0/799476114 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f17ac0cce30 0x7f17ac0cd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.622+0000 7f17aad9d640 1 -- 172.21.15.123:0/799476114 >> v1:172.21.15.188:6789/0 conn(0x7f17ac0732e0 legacy=0x7f17ac0736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.622+0000 7f17aad9d640 1 -- 172.21.15.123:0/799476114 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17ac0cde40 con 0x7f17ac071c70 2024-09-15T23:15:03.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.623+0000 7f17aad9d640 1 --2- 172.21.15.123:0/799476114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17ac071c70 0x7f17ac072120 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f17a4009870 tx=0x7f17a402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4cbba8d635cc9fc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:03.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.623+0000 7f17a959a640 1 -- 172.21.15.123:0/799476114 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a4037070 con 0x7f17ac071c70 2024-09-15T23:15:03.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.623+0000 7f17a959a640 1 -- 172.21.15.123:0/799476114 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17a4032440 con 0x7f17ac071c70 2024-09-15T23:15:03.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.623+0000 7f17a959a640 1 -- 172.21.15.123:0/799476114 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a4032810 con 0x7f17ac071c70 2024-09-15T23:15:03.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.624+0000 7f17b0e74640 1 -- 172.21.15.123:0/799476114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17ac071c70 msgr2=0x7f17ac072120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.624+0000 7f17b0e74640 1 --2- 172.21.15.123:0/799476114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17ac071c70 0x7f17ac072120 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f17a4009870 tx=0x7f17a402a1c0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.624+0000 7f17b0e74640 1 -- 172.21.15.123:0/799476114 shutdown_connections 2024-09-15T23:15:03.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.624+0000 7f17b0e74640 1 --2- 172.21.15.123:0/799476114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17ac071c70 0x7f17ac072120 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.624+0000 7f17b0e74640 1 --2- 172.21.15.123:0/799476114 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f17ac0cce30 0x7f17ac0cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.624+0000 7f17b0e74640 1 -- 172.21.15.123:0/799476114 >> 172.21.15.123:0/799476114 conn(0x7f17ac06d0f0 msgr2=0x7f17ac06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:03.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.624+0000 7f17b0e74640 1 -- 172.21.15.123:0/799476114 shutdown_connections 2024-09-15T23:15:03.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.624+0000 7f17b0e74640 1 -- 172.21.15.123:0/799476114 wait complete. 2024-09-15T23:15:03.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.625+0000 7f17b0e74640 1 Processor -- start 2024-09-15T23:15:03.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.625+0000 7f17b0e74640 1 -- start start 2024-09-15T23:15:03.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.626+0000 7f17b0e74640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17ac071c70 0x7f17ac1f3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.626+0000 7f17b0e74640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f17ac0732e0 0x7f17ac158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.626+0000 7f17b0e74640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f17ac0cce30 0x7f17ac1f5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.626+0000 7f17b0e74640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f17ac15ca50 con 0x7f17ac071c70 2024-09-15T23:15:03.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.626+0000 7f17b0e74640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f17ac15c8d0 con 0x7f17ac0732e0 2024-09-15T23:15:03.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.626+0000 7f17b0e74640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f17ac15cbd0 con 0x7f17ac0cce30 2024-09-15T23:15:03.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.626+0000 7f17aa59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17ac071c70 0x7f17ac1f3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.626+0000 7f17aa59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17ac071c70 0x7f17ac1f3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45758/0 (socket says 172.21.15.123:45758) 2024-09-15T23:15:03.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.626+0000 7f17aa59c640 1 -- 172.21.15.123:0/3694865189 learned_addr learned my addr 172.21.15.123:0/3694865189 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:03.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.626+0000 7f17aad9d640 1 --2- 172.21.15.123:0/3694865189 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f17ac0cce30 0x7f17ac1f5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.626+0000 7f17a9d9b640 1 --2- 172.21.15.123:0/3694865189 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f17ac0732e0 0x7f17ac158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.626+0000 7f17aa59c640 1 -- 172.21.15.123:0/3694865189 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f17ac0cce30 msgr2=0x7f17ac1f5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.626+0000 7f17aa59c640 1 --2- 172.21.15.123:0/3694865189 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f17ac0cce30 0x7f17ac1f5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.626+0000 7f17aa59c640 1 -- 172.21.15.123:0/3694865189 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f17ac0732e0 msgr2=0x7f17ac158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.626+0000 7f17aa59c640 1 --2- 172.21.15.123:0/3694865189 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f17ac0732e0 0x7f17ac158e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.626+0000 7f17aa59c640 1 -- 172.21.15.123:0/3694865189 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17ac1f6540 con 0x7f17ac071c70 2024-09-15T23:15:03.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.626+0000 7f17aad9d640 1 --2- 172.21.15.123:0/3694865189 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f17ac0cce30 0x7f17ac1f5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:03.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.626+0000 7f17a9d9b640 1 --2- 172.21.15.123:0/3694865189 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f17ac0732e0 0x7f17ac158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:03.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.627+0000 7f17aa59c640 1 --2- 172.21.15.123:0/3694865189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17ac071c70 0x7f17ac1f3020 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f179c00c790 tx=0x7f179c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:03.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.627+0000 7f17a2ffd640 1 -- 172.21.15.123:0/3694865189 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179c016020 con 0x7f17ac071c70 2024-09-15T23:15:03.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.627+0000 7f17a2ffd640 1 -- 172.21.15.123:0/3694865189 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f179c006d50 con 0x7f17ac071c70 2024-09-15T23:15:03.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.627+0000 7f17b0e74640 1 -- 172.21.15.123:0/3694865189 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17ac1f6820 con 0x7f17ac071c70 2024-09-15T23:15:03.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.627+0000 7f17a2ffd640 1 -- 172.21.15.123:0/3694865189 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179c003bb0 con 0x7f17ac071c70 2024-09-15T23:15:03.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.627+0000 7f17b0e74640 1 -- 172.21.15.123:0/3694865189 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17ac1f2b00 con 0x7f17ac071c70 2024-09-15T23:15:03.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.628+0000 7f17a2ffd640 1 -- 172.21.15.123:0/3694865189 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f179c00a850 con 0x7f17ac071c70 2024-09-15T23:15:03.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.629+0000 7f17a2ffd640 1 --2- 172.21.15.123:0/3694865189 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f178c06c2e0 0x7f178c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.629+0000 7f17a2ffd640 1 -- 172.21.15.123:0/3694865189 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7f179c08b1a0 con 0x7f17ac071c70 2024-09-15T23:15:03.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.629+0000 7f17a9d9b640 1 --2- 172.21.15.123:0/3694865189 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f178c06c2e0 0x7f178c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.629+0000 7f17a9d9b640 1 --2- 172.21.15.123:0/3694865189 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f178c06c2e0 0x7f178c06e7a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1794006fd0 tx=0x7f1794008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:03.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.630+0000 7f17b3c17740 1 Processor -- start 2024-09-15T23:15:03.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.630+0000 7f17b3c17740 1 -- start start 2024-09-15T23:15:03.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.631+0000 7f17b3c17740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d0fd4eea0 0x557d0fd4f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.631+0000 7f17b3c17740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557d0fd4c660 0x557d0fd4e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.631+0000 7f17b3c17740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557d0fd4cac0 0x557d0fd2ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.631+0000 7f17b3c17740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x557d0fc6b8d0 con 0x557d0fd4cac0 2024-09-15T23:15:03.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.631+0000 7f17b3c17740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x557d0fc13510 con 0x557d0fd4eea0 2024-09-15T23:15:03.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.631+0000 7f17b3c17740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x557d0fc67890 con 0x557d0fd4c660 2024-09-15T23:15:03.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.631+0000 7f17aad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557d0fd4cac0 0x557d0fd2ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.631+0000 7f17aad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557d0fd4cac0 0x557d0fd2ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45760/0 (socket says 172.21.15.123:45760) 2024-09-15T23:15:03.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.631+0000 7f17a9d9b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557d0fd4c660 0x557d0fd4e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.631+0000 7f17aad9d640 1 -- 172.21.15.123:0/3718810177 learned_addr learned my addr 172.21.15.123:0/3718810177 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:03.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.631+0000 7f17aa59c640 1 --2- 172.21.15.123:0/3718810177 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d0fd4eea0 0x557d0fd4f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.631+0000 7f17aad9d640 1 -- 172.21.15.123:0/3718810177 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557d0fd4c660 msgr2=0x557d0fd4e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.631+0000 7f17aad9d640 1 --2- 172.21.15.123:0/3718810177 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557d0fd4c660 0x557d0fd4e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.631+0000 7f17aad9d640 1 -- 172.21.15.123:0/3718810177 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d0fd4eea0 msgr2=0x557d0fd4f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.631+0000 7f17aad9d640 1 --2- 172.21.15.123:0/3718810177 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d0fd4eea0 0x557d0fd4f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.631+0000 7f17aad9d640 1 -- 172.21.15.123:0/3718810177 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d0fc281a0 con 0x557d0fd4cac0 2024-09-15T23:15:03.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.631+0000 7f17aad9d640 1 --2- 172.21.15.123:0/3718810177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557d0fd4cac0 0x557d0fd2ee20 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f17a40090b0 tx=0x7f17a402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b849f4c51dc9cae server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:03.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.631+0000 7f178bfff640 1 -- 172.21.15.123:0/3718810177 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a4037040 con 0x557d0fd4cac0 2024-09-15T23:15:03.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.631+0000 7f178bfff640 1 -- 172.21.15.123:0/3718810177 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17a4032740 con 0x557d0fd4cac0 2024-09-15T23:15:03.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.631+0000 7f178bfff640 1 -- 172.21.15.123:0/3718810177 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a4032af0 con 0x557d0fd4cac0 2024-09-15T23:15:03.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.632+0000 7f17b3c17740 1 -- 172.21.15.123:0/3718810177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557d0fd4cac0 msgr2=0x557d0fd2ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.632+0000 7f17b3c17740 1 --2- 172.21.15.123:0/3718810177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557d0fd4cac0 0x557d0fd2ee20 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f17a40090b0 tx=0x7f17a402c000 comp rx=0 tx=0).stop 2024-09-15T23:15:03.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.632+0000 7f17b3c17740 1 -- 172.21.15.123:0/3718810177 shutdown_connections 2024-09-15T23:15:03.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.632+0000 7f17b3c17740 1 --2- 172.21.15.123:0/3718810177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557d0fd4cac0 0x557d0fd2ee20 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.632+0000 7f17b3c17740 1 --2- 172.21.15.123:0/3718810177 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557d0fd4c660 0x557d0fd4e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.632+0000 7f17b3c17740 1 --2- 172.21.15.123:0/3718810177 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d0fd4eea0 0x557d0fd4f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.632+0000 7f17b3c17740 1 -- 172.21.15.123:0/3718810177 >> 172.21.15.123:0/3718810177 conn(0x557d0fd04d90 msgr2=0x557d0fd4cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:03.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.632+0000 7f17b3c17740 1 -- 172.21.15.123:0/3718810177 shutdown_connections 2024-09-15T23:15:03.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.632+0000 7f17b3c17740 1 -- 172.21.15.123:0/3718810177 wait complete. 2024-09-15T23:15:03.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.633+0000 7f17b3c17740 1 -- start start 2024-09-15T23:15:03.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.633+0000 7f17b3c17740 1 Processor -- start 2024-09-15T23:15:03.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.634+0000 7f17b3c17740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557d0fd4cac0 0x557d0fd4a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.634+0000 7f17b3c17740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d0fd4eea0 0x557d0fd313a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.634+0000 7f17b3c17740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557d0fd45900 0x557d0fd48110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.634+0000 7f17b3c17740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x557d0fd4b5c0 con 0x557d0fd45900 2024-09-15T23:15:03.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.634+0000 7f17b3c17740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x557d0fbf4640 con 0x557d0fd4eea0 2024-09-15T23:15:03.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.634+0000 7f17b3c17740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x557d0fd4b8a0 con 0x557d0fd4cac0 2024-09-15T23:15:03.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.634+0000 7f17b3c17740 10 client.0 _ll_register_callbacks cb 0x557d0fc2c2a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:15:03.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.634+0000 7f17aad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557d0fd45900 0x557d0fd48110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.634+0000 7f17aad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557d0fd45900 0x557d0fd48110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45764/0 (socket says 172.21.15.123:45764) 2024-09-15T23:15:03.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.634+0000 7f17aad9d640 1 -- 172.21.15.123:0/1422911933 learned_addr learned my addr 172.21.15.123:0/1422911933 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:03.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.634+0000 7f17a9d9b640 1 --2- 172.21.15.123:0/1422911933 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d0fd4eea0 0x557d0fd313a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.634+0000 7f17aa59c640 1 --2- 172.21.15.123:0/1422911933 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557d0fd4cac0 0x557d0fd4a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.634+0000 7f17aad9d640 1 -- 172.21.15.123:0/1422911933 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557d0fd4cac0 msgr2=0x557d0fd4a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.634+0000 7f17aad9d640 1 --2- 172.21.15.123:0/1422911933 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557d0fd4cac0 0x557d0fd4a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.634+0000 7f17aad9d640 1 -- 172.21.15.123:0/1422911933 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d0fd4eea0 msgr2=0x557d0fd313a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.634+0000 7f17aad9d640 1 --2- 172.21.15.123:0/1422911933 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d0fd4eea0 0x557d0fd313a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.634+0000 7f17aad9d640 1 -- 172.21.15.123:0/1422911933 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d0fa4a710 con 0x557d0fd45900 2024-09-15T23:15:03.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.634+0000 7f17aa59c640 1 --2- 172.21.15.123:0/1422911933 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557d0fd4cac0 0x557d0fd4a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:03.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.634+0000 7f17aad9d640 1 --2- 172.21.15.123:0/1422911933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557d0fd45900 0x557d0fd48110 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f17a4009990 tx=0x7f17a4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35343d311c6d90e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:03.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.634+0000 7f17897fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:15:03.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.635+0000 7f17897fa640 1 -- 172.21.15.123:0/1422911933 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17a4037040 con 0x557d0fd45900 2024-09-15T23:15:03.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.635+0000 7f17897fa640 1 -- 172.21.15.123:0/1422911933 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7f17a4032b00 con 0x557d0fd45900 2024-09-15T23:15:03.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.635+0000 7f17b3c17740 1 -- 172.21.15.123:0/1422911933 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17a4032740 con 0x557d0fd45900 2024-09-15T23:15:03.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.635+0000 7f17897fa640 1 -- 172.21.15.123:0/1422911933 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f17a4054050 con 0x557d0fd45900 2024-09-15T23:15:03.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.635+0000 7f17b3c17740 10 client.6000 fetch_fsmap learned FSMap version 22 2024-09-15T23:15:03.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.635+0000 7f17b3c17740 1 -- 172.21.15.123:0/1422911933 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x557d0faaaea0 con 0x557d0fd45900 2024-09-15T23:15:03.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.635+0000 7f17897fa640 1 -- 172.21.15.123:0/1422911933 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17a4032740 con 0x557d0fd45900 2024-09-15T23:15:03.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.635+0000 7f17897fa640 1 -- 172.21.15.123:0/1422911933 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 22) ==== 3502+0+0 (secure 0 0 0) 0x7f17a4057020 con 0x557d0fd45900 2024-09-15T23:15:03.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.635+0000 7f17b3c17740 10 client.6000 fetch_fsmap finished waiting for FSMap version 22 2024-09-15T23:15:03.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.635+0000 7f17b3c17740 10 client.6000 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-15T23:15:03.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.635+0000 7f17b3c17740 20 client.6000 populate_metadata read hostname 'smithi123' 2024-09-15T23:15:03.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.635+0000 7f17b3c17740 1 --2- 172.21.15.123:0/1422911933 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x557d0fd2fef0 0x557d0fd302d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.635+0000 7f17b3c17740 4 client.6000 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:15:03.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.635+0000 7f17b3c17740 1 -- 172.21.15.123:0/1422911933 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d0fc79000 con 0x557d0fd2fef0 2024-09-15T23:15:03.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.635+0000 7f17aa59c640 1 --2- 172.21.15.123:0/1422911933 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x557d0fd2fef0 0x557d0fd302d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.636+0000 7f17aa59c640 1 --2- 172.21.15.123:0/1422911933 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x557d0fd2fef0 0x557d0fd302d0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74abc53c1f967743 server_cookie=b9cd6559d03f25cb in_seq=0 out_seq=0 2024-09-15T23:15:03.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.636+0000 7f17897fa640 10 client.6000 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:15:03.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.636+0000 7f17897fa640 1 -- 172.21.15.123:0/1422911933 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557d0fc79000 con 0x557d0fd2fef0 2024-09-15T23:15:03.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.636+0000 7f17897fa640 10 client.6000 handle_command_reply: tid=0 2024-09-15T23:15:03.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.636+0000 7f17b3c17740 1 client.6000 shutdown 2024-09-15T23:15:03.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.636+0000 7f17b3c17740 1 -- 172.21.15.123:0/1422911933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557d0fd45900 msgr2=0x557d0fd48110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.636+0000 7f17b3c17740 1 --2- 172.21.15.123:0/1422911933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557d0fd45900 0x557d0fd48110 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f17a4009990 tx=0x7f17a4004730 comp rx=0 tx=0).stop 2024-09-15T23:15:03.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.636+0000 7f17b3c17740 1 -- 172.21.15.123:0/1422911933 shutdown_connections 2024-09-15T23:15:03.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.636+0000 7f17b3c17740 1 --2- 172.21.15.123:0/1422911933 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x557d0fd2fef0 0x557d0fd302d0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.636+0000 7f17b3c17740 1 --2- 172.21.15.123:0/1422911933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557d0fd45900 0x557d0fd48110 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.636+0000 7f17b3c17740 1 --2- 172.21.15.123:0/1422911933 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d0fd4eea0 0x557d0fd313a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.636+0000 7f17b3c17740 1 --2- 172.21.15.123:0/1422911933 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557d0fd4cac0 0x557d0fd4a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.636+0000 7f17897fa640 0 client.6000 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:15:03.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.636+0000 7f17b3c17740 1 -- 172.21.15.123:0/1422911933 >> 172.21.15.123:0/1422911933 conn(0x557d0fd4c660 msgr2=0x557d0fd2f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:03.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.637+0000 7f17b3c17740 1 -- 172.21.15.123:0/1422911933 shutdown_connections 2024-09-15T23:15:03.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.637+0000 7f17b3c17740 1 -- 172.21.15.123:0/1422911933 wait complete. 2024-09-15T23:15:03.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.637+0000 7f17b3c17740 20 client.6000 trim_cache size 0 max 16384 2024-09-15T23:15:03.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.650+0000 7f17b3c17740 1 Processor -- start 2024-09-15T23:15:03.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.650+0000 7f17b3c17740 1 -- start start 2024-09-15T23:15:03.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.650+0000 7f17b3c17740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557d0fd45900 0x557d0fdc5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.650+0000 7f17b3c17740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557d0fd4cac0 0x557d0fd2b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.650+0000 7f17b3c17740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d0fd4eea0 0x557d0fd2bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.650+0000 7f17b3c17740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f17ac1fde50 con 0x557d0fd4cac0 2024-09-15T23:15:03.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.650+0000 7f17b3c17740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f17ac1541c0 con 0x557d0fd4eea0 2024-09-15T23:15:03.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.650+0000 7f17b3c17740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f17ac154810 con 0x557d0fd45900 2024-09-15T23:15:03.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.650+0000 7f17a9d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557d0fd4cac0 0x557d0fd2b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.650+0000 7f17a9d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557d0fd4cac0 0x557d0fd2b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45774/0 (socket says 172.21.15.123:45774) 2024-09-15T23:15:03.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.650+0000 7f17a9d9b640 1 -- 172.21.15.123:0/2267722558 learned_addr learned my addr 172.21.15.123:0/2267722558 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:03.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.651+0000 7f17aad9d640 1 --2- 172.21.15.123:0/2267722558 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d0fd4eea0 0x557d0fd2bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.651+0000 7f17aa59c640 1 --2- 172.21.15.123:0/2267722558 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557d0fd45900 0x557d0fdc5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.651+0000 7f17a9d9b640 1 -- 172.21.15.123:0/2267722558 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557d0fd45900 msgr2=0x557d0fdc5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.651+0000 7f17a9d9b640 1 --2- 172.21.15.123:0/2267722558 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557d0fd45900 0x557d0fdc5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.651+0000 7f17a9d9b640 1 -- 172.21.15.123:0/2267722558 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d0fd4eea0 msgr2=0x557d0fd2bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.651+0000 7f17a9d9b640 1 --2- 172.21.15.123:0/2267722558 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d0fd4eea0 0x557d0fd2bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.651+0000 7f17a9d9b640 1 -- 172.21.15.123:0/2267722558 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d0f93e000 con 0x557d0fd4cac0 2024-09-15T23:15:03.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.651+0000 7f17a9d9b640 1 --2- 172.21.15.123:0/2267722558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557d0fd4cac0 0x557d0fd2b830 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f179400fbb0 tx=0x7f1794012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d086b8ddb78e2ee9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:03.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.651+0000 7f178b7fe640 1 -- 172.21.15.123:0/2267722558 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179401b040 con 0x557d0fd4cac0 2024-09-15T23:15:03.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.651+0000 7f178b7fe640 1 -- 172.21.15.123:0/2267722558 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f179401c040 con 0x557d0fd4cac0 2024-09-15T23:15:03.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.651+0000 7f178b7fe640 1 -- 172.21.15.123:0/2267722558 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1794023660 con 0x557d0fd4cac0 2024-09-15T23:15:03.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.651+0000 7f17b3c17740 1 -- 172.21.15.123:0/2267722558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557d0fd4cac0 msgr2=0x557d0fd2b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.651+0000 7f17b3c17740 1 --2- 172.21.15.123:0/2267722558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557d0fd4cac0 0x557d0fd2b830 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f179400fbb0 tx=0x7f1794012000 comp rx=0 tx=0).stop 2024-09-15T23:15:03.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.651+0000 7f17b3c17740 1 -- 172.21.15.123:0/2267722558 shutdown_connections 2024-09-15T23:15:03.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.651+0000 7f17b3c17740 1 --2- 172.21.15.123:0/2267722558 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d0fd4eea0 0x557d0fd2bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.651+0000 7f17b3c17740 1 --2- 172.21.15.123:0/2267722558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557d0fd4cac0 0x557d0fd2b830 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.651+0000 7f17b3c17740 1 --2- 172.21.15.123:0/2267722558 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557d0fd45900 0x557d0fdc5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.652+0000 7f17b3c17740 1 -- 172.21.15.123:0/2267722558 >> 172.21.15.123:0/2267722558 conn(0x557d0fd4c660 msgr2=0x557d0fd50470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:03.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.652+0000 7f17b3c17740 1 -- 172.21.15.123:0/2267722558 shutdown_connections 2024-09-15T23:15:03.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.652+0000 7f17b3c17740 1 -- 172.21.15.123:0/2267722558 wait complete. 2024-09-15T23:15:03.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.652+0000 7f17b3c17740 1 -- start start 2024-09-15T23:15:03.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.652+0000 7f17b3c17740 1 Processor -- start 2024-09-15T23:15:03.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.653+0000 7f17b3c17740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d0fd45900 0x557d0fd2bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.653+0000 7f17b3c17740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557d0fd4cac0 0x557d0fdb1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.653+0000 7f17b3c17740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557d0fd4eea0 0x557d0fdb2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.653+0000 7f17b3c17740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x557d0fd46d70 con 0x557d0fd4cac0 2024-09-15T23:15:03.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.653+0000 7f17b3c17740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x557d0fd45100 con 0x557d0fd45900 2024-09-15T23:15:03.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.653+0000 7f17b3c17740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x557d0fd45d80 con 0x557d0fd4eea0 2024-09-15T23:15:03.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.653+0000 7f17b3c17740 10 client.0 _ll_register_callbacks cb 0x7f179c00cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:15:03.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.653+0000 7f17a9d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557d0fd4cac0 0x557d0fdb1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.653+0000 7f17a9d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557d0fd4cac0 0x557d0fdb1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45786/0 (socket says 172.21.15.123:45786) 2024-09-15T23:15:03.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.653+0000 7f17a9d9b640 1 -- 172.21.15.123:0/3763368666 learned_addr learned my addr 172.21.15.123:0/3763368666 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:03.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.653+0000 7f17aad9d640 1 --2- 172.21.15.123:0/3763368666 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557d0fd4eea0 0x557d0fdb2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.653+0000 7f17aa59c640 1 --2- 172.21.15.123:0/3763368666 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d0fd45900 0x557d0fd2bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.653+0000 7f17a9d9b640 1 -- 172.21.15.123:0/3763368666 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557d0fd4eea0 msgr2=0x557d0fdb2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.653+0000 7f17a9d9b640 1 --2- 172.21.15.123:0/3763368666 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557d0fd4eea0 0x557d0fdb2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.653+0000 7f17a9d9b640 1 -- 172.21.15.123:0/3763368666 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d0fd45900 msgr2=0x557d0fd2bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.653+0000 7f17a9d9b640 1 --2- 172.21.15.123:0/3763368666 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d0fd45900 0x557d0fd2bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.653+0000 7f17a9d9b640 1 -- 172.21.15.123:0/3763368666 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d0fd44b60 con 0x557d0fd4cac0 2024-09-15T23:15:03.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.653+0000 7f17aad9d640 1 --2- 172.21.15.123:0/3763368666 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557d0fd4eea0 0x557d0fdb2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:03.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.654+0000 7f17a9d9b640 1 --2- 172.21.15.123:0/3763368666 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557d0fd4cac0 0x557d0fdb1cf0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f1794027000 tx=0x7f1794004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba8f51a94472d06 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:03.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.654+0000 7f17897fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:15:03.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.654+0000 7f17897fa640 1 -- 172.21.15.123:0/3763368666 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f179401b040 con 0x557d0fd4cac0 2024-09-15T23:15:03.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.654+0000 7f17897fa640 1 -- 172.21.15.123:0/3763368666 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7f1794036b60 con 0x557d0fd4cac0 2024-09-15T23:15:03.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.654+0000 7f17b3c17740 1 -- 172.21.15.123:0/3763368666 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f179401c040 con 0x557d0fd4cac0 2024-09-15T23:15:03.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.654+0000 7f17897fa640 1 -- 172.21.15.123:0/3763368666 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f179403d050 con 0x557d0fd4cac0 2024-09-15T23:15:03.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.654+0000 7f17b3c17740 10 client.6006 fetch_fsmap learned FSMap version 22 2024-09-15T23:15:03.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.654+0000 7f17b3c17740 1 -- 172.21.15.123:0/3763368666 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x557d0fd30740 con 0x557d0fd4cac0 2024-09-15T23:15:03.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.654+0000 7f17897fa640 1 -- 172.21.15.123:0/3763368666 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f179401c040 con 0x557d0fd4cac0 2024-09-15T23:15:03.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.654+0000 7f17897fa640 1 -- 172.21.15.123:0/3763368666 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 22) ==== 3502+0+0 (secure 0 0 0) 0x7f1794040020 con 0x557d0fd4cac0 2024-09-15T23:15:03.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.654+0000 7f17b3c17740 10 client.6006 fetch_fsmap finished waiting for FSMap version 22 2024-09-15T23:15:03.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.654+0000 7f17b3c17740 10 client.6006 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-15T23:15:03.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.654+0000 7f17b3c17740 20 client.6006 populate_metadata read hostname 'smithi123' 2024-09-15T23:15:03.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.654+0000 7f17b3c17740 1 --2- 172.21.15.123:0/3763368666 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x557d0fd5f940 0x557d0fd5fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.654+0000 7f17b3c17740 4 client.6006 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "damage rm", "damage_id": 1191626301}] 2024-09-15T23:15:03.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.654+0000 7f17b3c17740 1 -- 172.21.15.123:0/3763368666 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "damage rm", "damage_id": 1191626301}) -- 0x557d0fc73350 con 0x557d0fd5f940 2024-09-15T23:15:03.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.654+0000 7f17aa59c640 1 --2- 172.21.15.123:0/3763368666 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x557d0fd5f940 0x557d0fd5fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.655+0000 7f17897fa640 10 client.6006 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:15:03.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.655+0000 7f17aa59c640 1 --2- 172.21.15.123:0/3763368666 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x557d0fd5f940 0x557d0fd5fd20 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95f5ef05b2698f1a server_cookie=c1ccbf3d4b0ed5e9 in_seq=0 out_seq=0 2024-09-15T23:15:03.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.655+0000 7f17897fa640 1 -- 172.21.15.123:0/3763368666 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+0 (crc 0 0 0) 0x557d0fc73350 con 0x557d0fd5f940 2024-09-15T23:15:03.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.655+0000 7f17897fa640 10 client.6006 handle_command_reply: tid=0 2024-09-15T23:15:03.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.655+0000 7f17b3c17740 1 client.6006 shutdown 2024-09-15T23:15:03.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.655+0000 7f17b3c17740 1 -- 172.21.15.123:0/3763368666 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557d0fd4cac0 msgr2=0x557d0fdb1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.655+0000 7f17b3c17740 1 --2- 172.21.15.123:0/3763368666 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557d0fd4cac0 0x557d0fdb1cf0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f1794027000 tx=0x7f1794004730 comp rx=0 tx=0).stop 2024-09-15T23:15:03.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.655+0000 7f17b3c17740 1 -- 172.21.15.123:0/3763368666 shutdown_connections 2024-09-15T23:15:03.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.655+0000 7f17b3c17740 1 --2- 172.21.15.123:0/3763368666 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x557d0fd5f940 0x557d0fd5fd20 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.655+0000 7f17b3c17740 1 --2- 172.21.15.123:0/3763368666 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557d0fd4eea0 0x557d0fdb2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.655+0000 7f17b3c17740 1 --2- 172.21.15.123:0/3763368666 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557d0fd4cac0 0x557d0fdb1cf0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.655+0000 7f17b3c17740 1 --2- 172.21.15.123:0/3763368666 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557d0fd45900 0x557d0fd2bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.655+0000 7f17897fa640 0 client.6006 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:15:03.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.655+0000 7f17b3c17740 1 -- 172.21.15.123:0/3763368666 >> 172.21.15.123:0/3763368666 conn(0x557d0fd4c660 msgr2=0x557d0fd43200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:03.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.655+0000 7f17b3c17740 1 -- 172.21.15.123:0/3763368666 shutdown_connections 2024-09-15T23:15:03.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.655+0000 7f17b3c17740 1 -- 172.21.15.123:0/3763368666 wait complete. 2024-09-15T23:15:03.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.655+0000 7f17b3c17740 20 client.6006 trim_cache size 0 max 16384 2024-09-15T23:15:03.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.656+0000 7f17b0e74640 1 -- 172.21.15.123:0/3694865189 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f178c06c2e0 msgr2=0x7f178c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.656+0000 7f17b0e74640 1 --2- 172.21.15.123:0/3694865189 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f178c06c2e0 0x7f178c06e7a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1794006fd0 tx=0x7f1794008040 comp rx=0 tx=0).stop 2024-09-15T23:15:03.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.656+0000 7f17b0e74640 1 -- 172.21.15.123:0/3694865189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17ac071c70 msgr2=0x7f17ac1f3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.656+0000 7f17b0e74640 1 --2- 172.21.15.123:0/3694865189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17ac071c70 0x7f17ac1f3020 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f179c00c790 tx=0x7f179c00cc50 comp rx=0 tx=0).stop 2024-09-15T23:15:03.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.656+0000 7f17b0e74640 1 -- 172.21.15.123:0/3694865189 shutdown_connections 2024-09-15T23:15:03.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.656+0000 7f17b0e74640 1 --2- 172.21.15.123:0/3694865189 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f17ac0cce30 0x7f17ac1f5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.656+0000 7f17b0e74640 1 --2- 172.21.15.123:0/3694865189 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f17ac0732e0 0x7f17ac158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.656+0000 7f17b0e74640 1 --2- 172.21.15.123:0/3694865189 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f178c06c2e0 0x7f178c06e7a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.656+0000 7f17b0e74640 1 --2- 172.21.15.123:0/3694865189 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17ac071c70 0x7f17ac1f3020 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.656+0000 7f17b0e74640 1 -- 172.21.15.123:0/3694865189 >> 172.21.15.123:0/3694865189 conn(0x7f17ac06d0f0 msgr2=0x7f17ac15d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:03.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.656+0000 7f17b0e74640 1 -- 172.21.15.123:0/3694865189 shutdown_connections 2024-09-15T23:15:03.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.656+0000 7f17b0e74640 1 -- 172.21.15.123:0/3694865189 wait complete. 2024-09-15T23:15:03.667 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2024-09-15T23:15:03.668 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush_path / 2024-09-15T23:15:03.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.767+0000 7f2f815df640 1 Processor -- start 2024-09-15T23:15:03.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.767+0000 7f2f815df640 1 -- start start 2024-09-15T23:15:03.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.768+0000 7f2f815df640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2f7c15c650 0x7f2f7c0d3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.768+0000 7f2f815df640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2f7c15d580 0x7f2f7c160930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.768+0000 7f2f815df640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f7c160170 con 0x7f2f7c06f400 2024-09-15T23:15:03.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.768+0000 7f2f815df640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f2f7c0b7380 con 0x7f2f7c15c650 2024-09-15T23:15:03.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.768+0000 7f2f815df640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f2f7c0b7660 con 0x7f2f7c15d580 2024-09-15T23:15:03.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.768+0000 7f2f7affd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2f7c15c650 0x7f2f7c0d3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.768+0000 7f2f7b7fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f2f7c06f400 0x7f2f7c0b5520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54514/0 (socket says 172.21.15.123:54514) 2024-09-15T23:15:03.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.768+0000 7f2f7affd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2f7c15c650 0x7f2f7c0d3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45802/0 (socket says 172.21.15.123:45802) 2024-09-15T23:15:03.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.768+0000 7f2f7b7fe640 1 -- 172.21.15.123:0/2222886970 learned_addr learned my addr 172.21.15.123:0/2222886970 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:03.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.768+0000 7f2f727fc640 1 --2- 172.21.15.123:0/2222886970 >> v2:172.21.15.188:3300/0 conn(0x7f2f7c15d580 0x7f2f7c160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.768+0000 7f2f7affd640 1 -- 172.21.15.123:0/2222886970 >> v2:172.21.15.188:3300/0 conn(0x7f2f7c15d580 msgr2=0x7f2f7c160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.768+0000 7f2f7affd640 1 --2- 172.21.15.123:0/2222886970 >> v2:172.21.15.188:3300/0 conn(0x7f2f7c15d580 0x7f2f7c160930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.768+0000 7f2f7affd640 1 -- 172.21.15.123:0/2222886970 >> v1:172.21.15.123:6789/0 conn(0x7f2f7c06f400 legacy=0x7f2f7c0b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.768+0000 7f2f7a7fc640 1 -- 172.21.15.123:0/2222886970 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2849277460 0 0) 0x7f2f7c160170 con 0x7f2f7c06f400 2024-09-15T23:15:03.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.768+0000 7f2f7affd640 1 -- 172.21.15.123:0/2222886970 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f7c160410 con 0x7f2f7c15c650 2024-09-15T23:15:03.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.769+0000 7f2f7affd640 1 --2- 172.21.15.123:0/2222886970 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f7c15c650 0x7f2f7c0d3160 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c073110 tx=0x7f2f6c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=429677083e68cb36 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:03.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.769+0000 7f2f7a7fc640 1 -- 172.21.15.123:0/2222886970 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c037070 con 0x7f2f7c15c650 2024-09-15T23:15:03.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.769+0000 7f2f7a7fc640 1 -- 172.21.15.123:0/2222886970 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f6c032440 con 0x7f2f7c15c650 2024-09-15T23:15:03.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.769+0000 7f2f7a7fc640 1 -- 172.21.15.123:0/2222886970 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c02ae60 con 0x7f2f7c15c650 2024-09-15T23:15:03.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.770+0000 7f2f815df640 1 -- 172.21.15.123:0/2222886970 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f7c15c650 msgr2=0x7f2f7c0d3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.770+0000 7f2f815df640 1 --2- 172.21.15.123:0/2222886970 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f7c15c650 0x7f2f7c0d3160 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c073110 tx=0x7f2f6c02a110 comp rx=0 tx=0).stop 2024-09-15T23:15:03.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.770+0000 7f2f815df640 1 -- 172.21.15.123:0/2222886970 shutdown_connections 2024-09-15T23:15:03.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.770+0000 7f2f815df640 1 --2- 172.21.15.123:0/2222886970 >> v2:172.21.15.188:3300/0 conn(0x7f2f7c15d580 0x7f2f7c160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.770+0000 7f2f815df640 1 --2- 172.21.15.123:0/2222886970 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f7c15c650 0x7f2f7c0d3160 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.770+0000 7f2f815df640 1 -- 172.21.15.123:0/2222886970 >> 172.21.15.123:0/2222886970 conn(0x7f2f7c0d25d0 msgr2=0x7f2f7c0d29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:03.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.770+0000 7f2f815df640 1 -- 172.21.15.123:0/2222886970 shutdown_connections 2024-09-15T23:15:03.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.770+0000 7f2f815df640 1 -- 172.21.15.123:0/2222886970 wait complete. 2024-09-15T23:15:03.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.771+0000 7f2f815df640 1 Processor -- start 2024-09-15T23:15:03.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.771+0000 7f2f815df640 1 -- start start 2024-09-15T23:15:03.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.772+0000 7f2f815df640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f7c06f400 0x7f2f7c0b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.772+0000 7f2f815df640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f7c15c650 0x7f2f7c1f17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.772+0000 7f2f815df640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f7c15d580 0x7f2f7c0b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.772+0000 7f2f815df640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7c160e70 con 0x7f2f7c15d580 2024-09-15T23:15:03.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.772+0000 7f2f815df640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7c15d9c0 con 0x7f2f7c15c650 2024-09-15T23:15:03.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.772+0000 7f2f815df640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f2f7c160ff0 con 0x7f2f7c06f400 2024-09-15T23:15:03.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.772+0000 7f2f7b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f7c15d580 0x7f2f7c0b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.772+0000 7f2f7b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f7c15d580 0x7f2f7c0b2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45804/0 (socket says 172.21.15.123:45804) 2024-09-15T23:15:03.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.772+0000 7f2f7b7fe640 1 -- 172.21.15.123:0/766730729 learned_addr learned my addr 172.21.15.123:0/766730729 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:03.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.772+0000 7f2f727fc640 1 --2- 172.21.15.123:0/766730729 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f7c15c650 0x7f2f7c1f17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.772+0000 7f2f7affd640 1 --2- 172.21.15.123:0/766730729 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f7c06f400 0x7f2f7c0b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.772+0000 7f2f7b7fe640 1 -- 172.21.15.123:0/766730729 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f7c06f400 msgr2=0x7f2f7c0b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.772+0000 7f2f7b7fe640 1 --2- 172.21.15.123:0/766730729 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f7c06f400 0x7f2f7c0b0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.772+0000 7f2f7b7fe640 1 -- 172.21.15.123:0/766730729 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f7c15c650 msgr2=0x7f2f7c1f17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.772+0000 7f2f7b7fe640 1 --2- 172.21.15.123:0/766730729 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f7c15c650 0x7f2f7c1f17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.772+0000 7f2f7b7fe640 1 -- 172.21.15.123:0/766730729 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f7c0b0db0 con 0x7f2f7c15d580 2024-09-15T23:15:03.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.772+0000 7f2f727fc640 1 --2- 172.21.15.123:0/766730729 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f7c15c650 0x7f2f7c1f17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:03.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.772+0000 7f2f7b7fe640 1 --2- 172.21.15.123:0/766730729 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f7c15d580 0x7f2f7c0b2ca0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f2f7400c810 tx=0x7f2f7400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:03.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.773+0000 7f2f73fff640 1 -- 172.21.15.123:0/766730729 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f74018070 con 0x7f2f7c15d580 2024-09-15T23:15:03.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.773+0000 7f2f73fff640 1 -- 172.21.15.123:0/766730729 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f7400a640 con 0x7f2f7c15d580 2024-09-15T23:15:03.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.773+0000 7f2f815df640 1 -- 172.21.15.123:0/766730729 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f7c15aa30 con 0x7f2f7c15d580 2024-09-15T23:15:03.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.773+0000 7f2f73fff640 1 -- 172.21.15.123:0/766730729 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7400aa30 con 0x7f2f7c15d580 2024-09-15T23:15:03.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.773+0000 7f2f815df640 1 -- 172.21.15.123:0/766730729 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f7c15af90 con 0x7f2f7c15d580 2024-09-15T23:15:03.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.775+0000 7f2f73fff640 1 -- 172.21.15.123:0/766730729 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2f7401b070 con 0x7f2f7c15d580 2024-09-15T23:15:03.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.775+0000 7f2f73fff640 1 --2- 172.21.15.123:0/766730729 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2f5c06c2b0 0x7f2f5c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.775+0000 7f2f73fff640 1 -- 172.21.15.123:0/766730729 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7f2f7408aac0 con 0x7f2f7c15d580 2024-09-15T23:15:03.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.775+0000 7f2f7affd640 1 --2- 172.21.15.123:0/766730729 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2f5c06c2b0 0x7f2f5c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.776+0000 7f2f84454740 1 Processor -- start 2024-09-15T23:15:03.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.776+0000 7f2f7affd640 1 --2- 172.21.15.123:0/766730729 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2f5c06c2b0 0x7f2f5c06e770 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c034000 tx=0x7f2f6c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:03.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.776+0000 7f2f84454740 1 -- start start 2024-09-15T23:15:03.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.776+0000 7f2f84454740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563176751450 0x563176796bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.776+0000 7f2f84454740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56317674ec10 0x563176751830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.777+0000 7f2f84454740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563176752be0 0x56317674ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.777+0000 7f2f84454740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5631766b3610 con 0x56317674ec10 2024-09-15T23:15:03.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.777+0000 7f2f84454740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56317665b2e0 con 0x563176752be0 2024-09-15T23:15:03.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.777+0000 7f2f84454740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5631766af5d0 con 0x563176751450 2024-09-15T23:15:03.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.777+0000 7f2f727fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56317674ec10 0x563176751830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.777+0000 7f2f727fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56317674ec10 0x563176751830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45814/0 (socket says 172.21.15.123:45814) 2024-09-15T23:15:03.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.777+0000 7f2f727fc640 1 -- 172.21.15.123:0/320718713 learned_addr learned my addr 172.21.15.123:0/320718713 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:03.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.777+0000 7f2f7affd640 1 --2- 172.21.15.123:0/320718713 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563176751450 0x563176796bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.777+0000 7f2f7b7fe640 1 --2- 172.21.15.123:0/320718713 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563176752be0 0x56317674ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.777+0000 7f2f727fc640 1 -- 172.21.15.123:0/320718713 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563176751450 msgr2=0x563176796bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.777+0000 7f2f727fc640 1 --2- 172.21.15.123:0/320718713 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563176751450 0x563176796bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.777+0000 7f2f727fc640 1 -- 172.21.15.123:0/320718713 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563176752be0 msgr2=0x56317674ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.777+0000 7f2f727fc640 1 --2- 172.21.15.123:0/320718713 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563176752be0 0x56317674ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.777+0000 7f2f727fc640 1 -- 172.21.15.123:0/320718713 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631766761f0 con 0x56317674ec10 2024-09-15T23:15:03.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.777+0000 7f2f727fc640 1 --2- 172.21.15.123:0/320718713 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56317674ec10 0x563176751830 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f2f6400b980 tx=0x7f2f6400be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8226171e1cd959b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:03.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.777+0000 7f2f70ff9640 1 -- 172.21.15.123:0/320718713 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f64018020 con 0x56317674ec10 2024-09-15T23:15:03.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.777+0000 7f2f70ff9640 1 -- 172.21.15.123:0/320718713 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f6400fa80 con 0x56317674ec10 2024-09-15T23:15:03.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.777+0000 7f2f70ff9640 1 -- 172.21.15.123:0/320718713 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6400fe50 con 0x56317674ec10 2024-09-15T23:15:03.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.778+0000 7f2f84454740 1 -- 172.21.15.123:0/320718713 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56317674ec10 msgr2=0x563176751830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.778+0000 7f2f84454740 1 --2- 172.21.15.123:0/320718713 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56317674ec10 0x563176751830 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f2f6400b980 tx=0x7f2f6400be40 comp rx=0 tx=0).stop 2024-09-15T23:15:03.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.778+0000 7f2f84454740 1 -- 172.21.15.123:0/320718713 shutdown_connections 2024-09-15T23:15:03.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.778+0000 7f2f84454740 1 --2- 172.21.15.123:0/320718713 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563176752be0 0x56317674ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.778+0000 7f2f84454740 1 --2- 172.21.15.123:0/320718713 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56317674ec10 0x563176751830 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.778+0000 7f2f84454740 1 --2- 172.21.15.123:0/320718713 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563176751450 0x563176796bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.778+0000 7f2f84454740 1 -- 172.21.15.123:0/320718713 >> 172.21.15.123:0/320718713 conn(0x56317674dc10 msgr2=0x5631767960c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:03.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.778+0000 7f2f84454740 1 -- 172.21.15.123:0/320718713 shutdown_connections 2024-09-15T23:15:03.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.778+0000 7f2f84454740 1 -- 172.21.15.123:0/320718713 wait complete. 2024-09-15T23:15:03.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.779+0000 7f2f84454740 1 -- start start 2024-09-15T23:15:03.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.779+0000 7f2f84454740 1 Processor -- start 2024-09-15T23:15:03.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.779+0000 7f2f84454740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563176751450 0x5631767739c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.779+0000 7f2f84454740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563176752be0 0x563176774520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.779+0000 7f2f84454740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563176793220 0x563176778e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.779+0000 7f2f84454740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56317674d0b0 con 0x563176793220 2024-09-15T23:15:03.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.779+0000 7f2f84454740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56317663c350 con 0x563176752be0 2024-09-15T23:15:03.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.779+0000 7f2f84454740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x563176797420 con 0x563176751450 2024-09-15T23:15:03.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.779+0000 7f2f84454740 10 client.0 _ll_register_callbacks cb 0x5631763c5a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:15:03.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.780+0000 7f2f7b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563176793220 0x563176778e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.780+0000 7f2f7b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563176793220 0x563176778e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45818/0 (socket says 172.21.15.123:45818) 2024-09-15T23:15:03.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.780+0000 7f2f7b7fe640 1 -- 172.21.15.123:0/3590162510 learned_addr learned my addr 172.21.15.123:0/3590162510 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:03.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.780+0000 7f2f7affd640 1 --2- 172.21.15.123:0/3590162510 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563176751450 0x5631767739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.780+0000 7f2f727fc640 1 --2- 172.21.15.123:0/3590162510 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563176752be0 0x563176774520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.780+0000 7f2f7b7fe640 1 -- 172.21.15.123:0/3590162510 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563176751450 msgr2=0x5631767739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.780+0000 7f2f7b7fe640 1 --2- 172.21.15.123:0/3590162510 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563176751450 0x5631767739c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.780+0000 7f2f7b7fe640 1 -- 172.21.15.123:0/3590162510 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563176752be0 msgr2=0x563176774520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.780+0000 7f2f7b7fe640 1 --2- 172.21.15.123:0/3590162510 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563176752be0 0x563176774520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.780+0000 7f2f7b7fe640 1 -- 172.21.15.123:0/3590162510 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631763c6240 con 0x563176793220 2024-09-15T23:15:03.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.780+0000 7f2f7b7fe640 1 --2- 172.21.15.123:0/3590162510 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563176793220 0x563176778e30 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f2f7400a430 tx=0x7f2f74058bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c210c90e2fbf9f99 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:03.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.780+0000 7f2f59ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:15:03.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.780+0000 7f2f59ffb640 1 -- 172.21.15.123:0/3590162510 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f740613f0 con 0x563176793220 2024-09-15T23:15:03.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.780+0000 7f2f59ffb640 1 -- 172.21.15.123:0/3590162510 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7f2f74057ef0 con 0x563176793220 2024-09-15T23:15:03.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.780+0000 7f2f84454740 1 -- 172.21.15.123:0/3590162510 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f6400fa80 con 0x563176793220 2024-09-15T23:15:03.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.780+0000 7f2f59ffb640 1 -- 172.21.15.123:0/3590162510 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f2f740580f0 con 0x563176793220 2024-09-15T23:15:03.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.780+0000 7f2f84454740 10 client.6021 fetch_fsmap learned FSMap version 22 2024-09-15T23:15:03.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.780+0000 7f2f84454740 1 -- 172.21.15.123:0/3590162510 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x563176490620 con 0x563176793220 2024-09-15T23:15:03.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.780+0000 7f2f59ffb640 1 -- 172.21.15.123:0/3590162510 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f6400fa80 con 0x563176793220 2024-09-15T23:15:03.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.780+0000 7f2f59ffb640 1 -- 172.21.15.123:0/3590162510 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 22) ==== 3502+0+0 (secure 0 0 0) 0x7f2f7405f070 con 0x563176793220 2024-09-15T23:15:03.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.780+0000 7f2f84454740 10 client.6021 fetch_fsmap finished waiting for FSMap version 22 2024-09-15T23:15:03.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.780+0000 7f2f84454740 10 client.6021 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:15:03.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.780+0000 7f2f84454740 20 client.6021 populate_metadata read hostname 'smithi123' 2024-09-15T23:15:03.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.781+0000 7f2f84454740 1 --2- 172.21.15.123:0/3590162510 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x563176779370 0x56317677b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.781+0000 7f2f84454740 4 client.6021 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:15:03.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.781+0000 7f2f84454740 1 -- 172.21.15.123:0/3590162510 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631766c0d40 con 0x563176779370 2024-09-15T23:15:03.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.781+0000 7f2f7affd640 1 --2- 172.21.15.123:0/3590162510 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x563176779370 0x56317677b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.781+0000 7f2f59ffb640 10 client.6021 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:15:03.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.781+0000 7f2f7affd640 1 --2- 172.21.15.123:0/3590162510 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x563176779370 0x56317677b7c0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47c32bb09dc742ba server_cookie=e1ac1ecacf863fa7 in_seq=0 out_seq=0 2024-09-15T23:15:03.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.782+0000 7f2f59ffb640 1 -- 172.21.15.123:0/3590162510 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5631766c0d40 con 0x563176779370 2024-09-15T23:15:03.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.782+0000 7f2f59ffb640 10 client.6021 handle_command_reply: tid=0 2024-09-15T23:15:03.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.782+0000 7f2f84454740 1 client.6021 shutdown 2024-09-15T23:15:03.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.782+0000 7f2f84454740 1 -- 172.21.15.123:0/3590162510 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563176793220 msgr2=0x563176778e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.782+0000 7f2f84454740 1 --2- 172.21.15.123:0/3590162510 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563176793220 0x563176778e30 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f2f7400a430 tx=0x7f2f74058bb0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.782+0000 7f2f84454740 1 -- 172.21.15.123:0/3590162510 shutdown_connections 2024-09-15T23:15:03.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.782+0000 7f2f84454740 1 --2- 172.21.15.123:0/3590162510 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x563176779370 0x56317677b7c0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.782+0000 7f2f84454740 1 --2- 172.21.15.123:0/3590162510 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563176793220 0x563176778e30 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.782+0000 7f2f84454740 1 --2- 172.21.15.123:0/3590162510 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563176752be0 0x563176774520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.782+0000 7f2f84454740 1 --2- 172.21.15.123:0/3590162510 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563176751450 0x5631767739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.782+0000 7f2f59ffb640 0 client.6021 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:15:03.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.782+0000 7f2f84454740 1 -- 172.21.15.123:0/3590162510 >> 172.21.15.123:0/3590162510 conn(0x56317674ec10 msgr2=0x5631767995d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:03.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.782+0000 7f2f84454740 1 -- 172.21.15.123:0/3590162510 shutdown_connections 2024-09-15T23:15:03.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.782+0000 7f2f84454740 1 -- 172.21.15.123:0/3590162510 wait complete. 2024-09-15T23:15:03.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.782+0000 7f2f84454740 20 client.6021 trim_cache size 0 max 16384 2024-09-15T23:15:03.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.796+0000 7f2f84454740 1 Processor -- start 2024-09-15T23:15:03.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.796+0000 7f2f84454740 1 -- start start 2024-09-15T23:15:03.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.797+0000 7f2f84454740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563176751450 0x5631767a6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.797+0000 7f2f84454740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563176752be0 0x563176796090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.797+0000 7f2f84454740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563176793220 0x5631767b9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.797+0000 7f2f84454740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7c1fec10 con 0x563176793220 2024-09-15T23:15:03.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.797+0000 7f2f84454740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7c1fdc70 con 0x563176751450 2024-09-15T23:15:03.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.797+0000 7f2f84454740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f2f7c158fd0 con 0x563176752be0 2024-09-15T23:15:03.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.797+0000 7f2f7b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563176793220 0x5631767b9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.797+0000 7f2f7b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563176793220 0x5631767b9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45824/0 (socket says 172.21.15.123:45824) 2024-09-15T23:15:03.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.797+0000 7f2f7b7fe640 1 -- 172.21.15.123:0/1647118610 learned_addr learned my addr 172.21.15.123:0/1647118610 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:03.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.797+0000 7f2f7b7fe640 1 -- 172.21.15.123:0/1647118610 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563176752be0 msgr2=0x563176796090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.797+0000 7f2f7b7fe640 1 --2- 172.21.15.123:0/1647118610 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563176752be0 0x563176796090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.797+0000 7f2f7affd640 1 --2- 172.21.15.123:0/1647118610 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563176751450 0x5631767a6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.797+0000 7f2f7b7fe640 1 -- 172.21.15.123:0/1647118610 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563176751450 msgr2=0x5631767a6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.797+0000 7f2f7b7fe640 1 --2- 172.21.15.123:0/1647118610 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563176751450 0x5631767a6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.797+0000 7f2f7b7fe640 1 -- 172.21.15.123:0/1647118610 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631767791a0 con 0x563176793220 2024-09-15T23:15:03.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.797+0000 7f2f7b7fe640 1 --2- 172.21.15.123:0/1647118610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563176793220 0x5631767b9f90 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2f74001330 tx=0x7f2f74014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc10da959ce7e4d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:03.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.797+0000 7f2f5bfff640 1 -- 172.21.15.123:0/1647118610 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f74077020 con 0x563176793220 2024-09-15T23:15:03.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.797+0000 7f2f5bfff640 1 -- 172.21.15.123:0/1647118610 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f740611f0 con 0x563176793220 2024-09-15T23:15:03.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.797+0000 7f2f5bfff640 1 -- 172.21.15.123:0/1647118610 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f740547f0 con 0x563176793220 2024-09-15T23:15:03.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.798+0000 7f2f84454740 1 -- 172.21.15.123:0/1647118610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563176793220 msgr2=0x5631767b9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.798+0000 7f2f84454740 1 --2- 172.21.15.123:0/1647118610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563176793220 0x5631767b9f90 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2f74001330 tx=0x7f2f74014000 comp rx=0 tx=0).stop 2024-09-15T23:15:03.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.798+0000 7f2f84454740 1 -- 172.21.15.123:0/1647118610 shutdown_connections 2024-09-15T23:15:03.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.798+0000 7f2f84454740 1 --2- 172.21.15.123:0/1647118610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563176793220 0x5631767b9f90 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.798+0000 7f2f84454740 1 --2- 172.21.15.123:0/1647118610 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563176752be0 0x563176796090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.798+0000 7f2f84454740 1 --2- 172.21.15.123:0/1647118610 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563176751450 0x5631767a6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.798+0000 7f2f84454740 1 -- 172.21.15.123:0/1647118610 >> 172.21.15.123:0/1647118610 conn(0x56317674ec10 msgr2=0x5631767a5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:03.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.798+0000 7f2f84454740 1 -- 172.21.15.123:0/1647118610 shutdown_connections 2024-09-15T23:15:03.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.798+0000 7f2f84454740 1 -- 172.21.15.123:0/1647118610 wait complete. 2024-09-15T23:15:03.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.798+0000 7f2f84454740 1 -- start start 2024-09-15T23:15:03.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.799+0000 7f2f84454740 1 Processor -- start 2024-09-15T23:15:03.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.799+0000 7f2f84454740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563176751450 0x5631767965a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.799+0000 7f2f84454740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563176752be0 0x563176776320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.799+0000 7f2f84454740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563176793220 0x563176776860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.799+0000 7f2f84454740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7c1fd790 con 0x563176793220 2024-09-15T23:15:03.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.799+0000 7f2f84454740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5631766bec90 con 0x563176751450 2024-09-15T23:15:03.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.799+0000 7f2f84454740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x56317674ff10 con 0x563176752be0 2024-09-15T23:15:03.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.799+0000 7f2f84454740 10 client.0 _ll_register_callbacks cb 0x7f2f74059290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:15:03.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.799+0000 7f2f7b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563176793220 0x563176776860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.799+0000 7f2f7b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563176793220 0x563176776860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45838/0 (socket says 172.21.15.123:45838) 2024-09-15T23:15:03.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.799+0000 7f2f7b7fe640 1 -- 172.21.15.123:0/1483539129 learned_addr learned my addr 172.21.15.123:0/1483539129 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:03.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.800+0000 7f2f727fc640 1 --2- 172.21.15.123:0/1483539129 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563176752be0 0x563176776320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.800+0000 7f2f7affd640 1 --2- 172.21.15.123:0/1483539129 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563176751450 0x5631767965a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.800+0000 7f2f7b7fe640 1 -- 172.21.15.123:0/1483539129 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563176752be0 msgr2=0x563176776320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.800+0000 7f2f7b7fe640 1 --2- 172.21.15.123:0/1483539129 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563176752be0 0x563176776320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.800+0000 7f2f7b7fe640 1 -- 172.21.15.123:0/1483539129 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563176751450 msgr2=0x5631767965a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:03.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.800+0000 7f2f7b7fe640 1 --2- 172.21.15.123:0/1483539129 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563176751450 0x5631767965a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.800+0000 7f2f7b7fe640 1 -- 172.21.15.123:0/1483539129 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563176819170 con 0x563176793220 2024-09-15T23:15:03.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.800+0000 7f2f7b7fe640 1 --2- 172.21.15.123:0/1483539129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563176793220 0x563176776860 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f2f7400a430 tx=0x7f2f74014070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a45b2b9429aa0a8f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:03.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.800+0000 7f2f59ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:15:03.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.800+0000 7f2f59ffb640 1 -- 172.21.15.123:0/1483539129 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f74077030 con 0x563176793220 2024-09-15T23:15:03.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.800+0000 7f2f59ffb640 1 -- 172.21.15.123:0/1483539129 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7f2f74057960 con 0x563176793220 2024-09-15T23:15:03.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.800+0000 7f2f84454740 1 -- 172.21.15.123:0/1483539129 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f740611f0 con 0x563176793220 2024-09-15T23:15:03.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.800+0000 7f2f59ffb640 1 -- 172.21.15.123:0/1483539129 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f2f74057ef0 con 0x563176793220 2024-09-15T23:15:03.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.800+0000 7f2f84454740 10 client.6027 fetch_fsmap learned FSMap version 22 2024-09-15T23:15:03.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.800+0000 7f2f84454740 1 -- 172.21.15.123:0/1483539129 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x563176776da0 con 0x563176793220 2024-09-15T23:15:03.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.800+0000 7f2f59ffb640 1 -- 172.21.15.123:0/1483539129 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f740611f0 con 0x563176793220 2024-09-15T23:15:03.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.800+0000 7f2f59ffb640 1 -- 172.21.15.123:0/1483539129 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 22) ==== 3502+0+0 (secure 0 0 0) 0x7f2f74057b60 con 0x563176793220 2024-09-15T23:15:03.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.800+0000 7f2f84454740 10 client.6027 fetch_fsmap finished waiting for FSMap version 22 2024-09-15T23:15:03.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.800+0000 7f2f84454740 10 client.6027 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-09-15T23:15:03.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.800+0000 7f2f84454740 20 client.6027 populate_metadata read hostname 'smithi123' 2024-09-15T23:15:03.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.800+0000 7f2f84454740 1 --2- 172.21.15.123:0/1483539129 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x563176779c60 0x56317677a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:03.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.800+0000 7f2f84454740 4 client.6027 mds_command: new command op to 5256 tid=0 multi_id=0 [{"prefix": "flush_path", "path": "/"}] 2024-09-15T23:15:03.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.800+0000 7f2f84454740 1 -- 172.21.15.123:0/1483539129 --> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] -- command(tid 0: {"prefix": "flush_path", "path": "/"}) -- 0x5631766bb090 con 0x563176779c60 2024-09-15T23:15:03.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.801+0000 7f2f7affd640 1 --2- 172.21.15.123:0/1483539129 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x563176779c60 0x56317677a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:03.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.801+0000 7f2f59ffb640 10 client.6027 ms_handle_connect on v2:172.21.15.188:6834/1307575248 2024-09-15T23:15:03.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.801+0000 7f2f7affd640 1 --2- 172.21.15.123:0/1483539129 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x563176779c60 0x56317677a070 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2bed8efb42ff7db server_cookie=60ceca3c4d44d4e3 in_seq=0 out_seq=0 2024-09-15T23:15:03.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.803+0000 7f2f59ffb640 1 -- 172.21.15.123:0/1483539129 <== mds.0 v2:172.21.15.188:6834/1307575248 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5631766bb090 con 0x563176779c60 2024-09-15T23:15:03.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.803+0000 7f2f59ffb640 10 client.6027 handle_command_reply: tid=0 2024-09-15T23:15:03.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.803+0000 7f2f84454740 1 client.6027 shutdown 2024-09-15T23:15:03.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.803+0000 7f2f84454740 1 -- 172.21.15.123:0/1483539129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563176793220 msgr2=0x563176776860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.803+0000 7f2f84454740 1 --2- 172.21.15.123:0/1483539129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563176793220 0x563176776860 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f2f7400a430 tx=0x7f2f74014070 comp rx=0 tx=0).stop 2024-09-15T23:15:03.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.803+0000 7f2f84454740 1 -- 172.21.15.123:0/1483539129 shutdown_connections 2024-09-15T23:15:03.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.803+0000 7f2f84454740 1 --2- 172.21.15.123:0/1483539129 >> [v2:172.21.15.188:6834/1307575248,v1:172.21.15.188:6836/1307575248] conn(0x563176779c60 0x56317677a070 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.803+0000 7f2f84454740 1 --2- 172.21.15.123:0/1483539129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563176793220 0x563176776860 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.803+0000 7f2f84454740 1 --2- 172.21.15.123:0/1483539129 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563176752be0 0x563176776320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.803+0000 7f2f59ffb640 0 client.6027 ms_handle_reset on v2:172.21.15.188:6834/1307575248 2024-09-15T23:15:03.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.803+0000 7f2f84454740 1 --2- 172.21.15.123:0/1483539129 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563176751450 0x5631767965a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.803+0000 7f2f84454740 1 -- 172.21.15.123:0/1483539129 >> 172.21.15.123:0/1483539129 conn(0x56317674ec10 msgr2=0x5631767a6b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:03.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.803+0000 7f2f84454740 1 -- 172.21.15.123:0/1483539129 shutdown_connections 2024-09-15T23:15:03.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.803+0000 7f2f84454740 1 -- 172.21.15.123:0/1483539129 wait complete. 2024-09-15T23:15:03.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.803+0000 7f2f84454740 20 client.6027 trim_cache size 0 max 16384 2024-09-15T23:15:03.811 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:15:03.812 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "", 2024-09-15T23:15:03.812 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0 2024-09-15T23:15:03.812 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:15:03.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.804+0000 7f2f815df640 1 -- 172.21.15.123:0/766730729 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2f5c06c2b0 msgr2=0x7f2f5c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.804+0000 7f2f815df640 1 --2- 172.21.15.123:0/766730729 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2f5c06c2b0 0x7f2f5c06e770 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c034000 tx=0x7f2f6c02e000 comp rx=0 tx=0).stop 2024-09-15T23:15:03.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.804+0000 7f2f815df640 1 -- 172.21.15.123:0/766730729 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f7c15d580 msgr2=0x7f2f7c0b2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:03.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.804+0000 7f2f815df640 1 --2- 172.21.15.123:0/766730729 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f7c15d580 0x7f2f7c0b2ca0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f2f7400c810 tx=0x7f2f7400ccd0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.804+0000 7f2f815df640 1 -- 172.21.15.123:0/766730729 shutdown_connections 2024-09-15T23:15:03.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.804+0000 7f2f815df640 1 --2- 172.21.15.123:0/766730729 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2f5c06c2b0 0x7f2f5c06e770 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.804+0000 7f2f815df640 1 --2- 172.21.15.123:0/766730729 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f7c15d580 0x7f2f7c0b2ca0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.804+0000 7f2f815df640 1 --2- 172.21.15.123:0/766730729 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f7c15c650 0x7f2f7c1f17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.804+0000 7f2f815df640 1 --2- 172.21.15.123:0/766730729 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f7c06f400 0x7f2f7c0b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:03.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.804+0000 7f2f815df640 1 -- 172.21.15.123:0/766730729 >> 172.21.15.123:0/766730729 conn(0x7f2f7c0d25d0 msgr2=0x7f2f7c0b6380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:03.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.804+0000 7f2f815df640 1 -- 172.21.15.123:0/766730729 shutdown_connections 2024-09-15T23:15:03.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:03.804+0000 7f2f815df640 1 -- 172.21.15.123:0/766730729 wait complete. 2024-09-15T23:15:03.815 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' returned '{'message': '', 'return_code': 0}' 2024-09-15T23:15:03.815 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:15:03.815 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:15:03.863 DEBUG:teuthology.orchestra.run.smithi188:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:15:03.910 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:15:03.910 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:15:03.910 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:15:03.910 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:15:03.926 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:15:03.926 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:15:03.982 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:15:04.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.120+0000 7fde96db9640 1 Processor -- start 2024-09-15T23:15:04.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.120+0000 7fde96db9640 1 -- start start 2024-09-15T23:15:04.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.121+0000 7fde96db9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde9015ab40 0x7fde9006c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:04.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.121+0000 7fde96db9640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fde9015af20 0x7fde9015b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:04.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.121+0000 7fde96db9640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde900724f0 con 0x7fde900720b0 2024-09-15T23:15:04.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.121+0000 7fde96db9640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fde90071010 con 0x7fde9015af20 2024-09-15T23:15:04.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.121+0000 7fde96db9640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fde900712f0 con 0x7fde9015ab40 2024-09-15T23:15:04.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.121+0000 7fde94b55640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde9015ab40 0x7fde9006c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:04.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.121+0000 7fde95356640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fde9015af20 0x7fde9015b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:04.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.121+0000 7fde95356640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fde9015af20 0x7fde9015b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:59376/0 (socket says 172.21.15.123:59376) 2024-09-15T23:15:04.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.121+0000 7fde95356640 1 -- 172.21.15.123:0/2244851413 learned_addr learned my addr 172.21.15.123:0/2244851413 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:04.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.121+0000 7fde94b55640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde9015ab40 0x7fde9006c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:55934/0 (socket says 172.21.15.123:55934) 2024-09-15T23:15:04.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.121+0000 7fde95356640 1 -- 172.21.15.123:0/2244851413 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde9015ab40 msgr2=0x7fde9006c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:04.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.121+0000 7fde95356640 1 --2- 172.21.15.123:0/2244851413 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde9015ab40 0x7fde9006c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:04.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.121+0000 7fde95356640 1 -- 172.21.15.123:0/2244851413 >> v1:172.21.15.188:6789/0 conn(0x7fde900720b0 legacy=0x7fde90073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:04.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.121+0000 7fde95356640 1 -- 172.21.15.123:0/2244851413 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde900715d0 con 0x7fde9015af20 2024-09-15T23:15:04.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.121+0000 7fde94b55640 1 --2- 172.21.15.123:0/2244851413 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde9015ab40 0x7fde9006c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:15:04.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.122+0000 7fde95356640 1 --2- 172.21.15.123:0/2244851413 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde9015af20 0x7fde9015b370 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fde8800af60 tx=0x7fde8802b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ac69109399edae6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:04.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.122+0000 7fde8f7fe640 1 -- 172.21.15.123:0/2244851413 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde88037070 con 0x7fde9015af20 2024-09-15T23:15:04.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.122+0000 7fde8f7fe640 1 -- 172.21.15.123:0/2244851413 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde88008500 con 0x7fde9015af20 2024-09-15T23:15:04.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.122+0000 7fde8f7fe640 1 -- 172.21.15.123:0/2244851413 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde880088d0 con 0x7fde9015af20 2024-09-15T23:15:04.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.123+0000 7fde96db9640 1 -- 172.21.15.123:0/2244851413 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde9015af20 msgr2=0x7fde9015b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:04.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.123+0000 7fde96db9640 1 --2- 172.21.15.123:0/2244851413 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde9015af20 0x7fde9015b370 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fde8800af60 tx=0x7fde8802b7a0 comp rx=0 tx=0).stop 2024-09-15T23:15:04.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.123+0000 7fde96db9640 1 -- 172.21.15.123:0/2244851413 shutdown_connections 2024-09-15T23:15:04.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.123+0000 7fde96db9640 1 --2- 172.21.15.123:0/2244851413 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde9015af20 0x7fde9015b370 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:04.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.123+0000 7fde96db9640 1 --2- 172.21.15.123:0/2244851413 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde9015ab40 0x7fde9006c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:04.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.123+0000 7fde96db9640 1 -- 172.21.15.123:0/2244851413 >> 172.21.15.123:0/2244851413 conn(0x7fde900ccec0 msgr2=0x7fde900cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:04.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.123+0000 7fde96db9640 1 -- 172.21.15.123:0/2244851413 shutdown_connections 2024-09-15T23:15:04.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.123+0000 7fde96db9640 1 -- 172.21.15.123:0/2244851413 wait complete. 2024-09-15T23:15:04.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.124+0000 7fde96db9640 1 Processor -- start 2024-09-15T23:15:04.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.124+0000 7fde96db9640 1 -- start start 2024-09-15T23:15:04.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.125+0000 7fde96db9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde900720b0 0x7fde901efe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:04.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.125+0000 7fde96db9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde9015ab40 0x7fde9014b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:04.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.125+0000 7fde96db9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde9015af20 0x7fde9014bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:04.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.125+0000 7fde96db9640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fde9015ba30 con 0x7fde9015af20 2024-09-15T23:15:04.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.125+0000 7fde96db9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fde9015b8b0 con 0x7fde900720b0 2024-09-15T23:15:04.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.125+0000 7fde96db9640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fde9006bc10 con 0x7fde9015ab40 2024-09-15T23:15:04.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.125+0000 7fde95356640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde9015af20 0x7fde9014bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:04.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.125+0000 7fde95356640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde9015af20 0x7fde9014bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45840/0 (socket says 172.21.15.123:45840) 2024-09-15T23:15:04.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.125+0000 7fde95356640 1 -- 172.21.15.123:0/1478821574 learned_addr learned my addr 172.21.15.123:0/1478821574 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:04.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.125+0000 7fde94b55640 1 --2- 172.21.15.123:0/1478821574 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde900720b0 0x7fde901efe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:04.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.125+0000 7fde8ffff640 1 --2- 172.21.15.123:0/1478821574 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde9015ab40 0x7fde9014b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:04.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.126+0000 7fde95356640 1 -- 172.21.15.123:0/1478821574 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde9015ab40 msgr2=0x7fde9014b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:04.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.126+0000 7fde95356640 1 --2- 172.21.15.123:0/1478821574 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde9015ab40 0x7fde9014b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:04.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.126+0000 7fde95356640 1 -- 172.21.15.123:0/1478821574 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde900720b0 msgr2=0x7fde901efe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:04.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.126+0000 7fde95356640 1 --2- 172.21.15.123:0/1478821574 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde900720b0 0x7fde901efe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:04.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.126+0000 7fde95356640 1 -- 172.21.15.123:0/1478821574 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde900c7cd0 con 0x7fde9015af20 2024-09-15T23:15:04.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.126+0000 7fde8ffff640 1 --2- 172.21.15.123:0/1478821574 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde9015ab40 0x7fde9014b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:04.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.126+0000 7fde95356640 1 --2- 172.21.15.123:0/1478821574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde9015af20 0x7fde9014bdf0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fde88035040 tx=0x7fde88004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:04.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.126+0000 7fde8d7fa640 1 -- 172.21.15.123:0/1478821574 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde88037040 con 0x7fde9015af20 2024-09-15T23:15:04.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.126+0000 7fde8d7fa640 1 -- 172.21.15.123:0/1478821574 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde88043070 con 0x7fde9015af20 2024-09-15T23:15:04.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.126+0000 7fde96db9640 1 -- 172.21.15.123:0/1478821574 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde900c7fb0 con 0x7fde9015af20 2024-09-15T23:15:04.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.126+0000 7fde8d7fa640 1 -- 172.21.15.123:0/1478821574 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8803e890 con 0x7fde9015af20 2024-09-15T23:15:04.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.126+0000 7fde96db9640 1 -- 172.21.15.123:0/1478821574 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde900c8570 con 0x7fde9015af20 2024-09-15T23:15:04.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.127+0000 7fde96db9640 1 -- 172.21.15.123:0/1478821574 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde9006c070 con 0x7fde9015af20 2024-09-15T23:15:04.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.127+0000 7fde8d7fa640 1 -- 172.21.15.123:0/1478821574 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fde88008380 con 0x7fde9015af20 2024-09-15T23:15:04.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.128+0000 7fde8d7fa640 1 --2- 172.21.15.123:0/1478821574 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fde7406c2b0 0x7fde7406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:04.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.128+0000 7fde8d7fa640 1 -- 172.21.15.123:0/1478821574 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7fde880ac3a0 con 0x7fde9015af20 2024-09-15T23:15:04.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.128+0000 7fde94b55640 1 --2- 172.21.15.123:0/1478821574 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fde7406c2b0 0x7fde7406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:04.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.129+0000 7fde94b55640 1 --2- 172.21.15.123:0/1478821574 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fde7406c2b0 0x7fde7406e770 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fde84009560 tx=0x7fde84008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:04.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.132+0000 7fde8d7fa640 1 -- 172.21.15.123:0/1478821574 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fde8807ac30 con 0x7fde9015af20 2024-09-15T23:15:04.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.311+0000 7fde96db9640 1 -- 172.21.15.123:0/1478821574 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fde900b52c0 con 0x7fde9015af20 2024-09-15T23:15:04.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.311+0000 7fde8d7fa640 1 -- 172.21.15.123:0/1478821574 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) ==== 80+0+0 (secure 0 0 0) 0x7fde8807a530 con 0x7fde9015af20 2024-09-15T23:15:04.312 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-15T23:15:04.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.313+0000 7fde96db9640 1 -- 172.21.15.123:0/1478821574 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fde7406c2b0 msgr2=0x7fde7406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:04.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.313+0000 7fde96db9640 1 --2- 172.21.15.123:0/1478821574 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fde7406c2b0 0x7fde7406e770 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fde84009560 tx=0x7fde84008040 comp rx=0 tx=0).stop 2024-09-15T23:15:04.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.313+0000 7fde96db9640 1 -- 172.21.15.123:0/1478821574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde9015af20 msgr2=0x7fde9014bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:04.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.313+0000 7fde96db9640 1 --2- 172.21.15.123:0/1478821574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde9015af20 0x7fde9014bdf0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fde88035040 tx=0x7fde88004a40 comp rx=0 tx=0).stop 2024-09-15T23:15:04.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.313+0000 7fde96db9640 1 -- 172.21.15.123:0/1478821574 shutdown_connections 2024-09-15T23:15:04.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.313+0000 7fde96db9640 1 --2- 172.21.15.123:0/1478821574 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fde7406c2b0 0x7fde7406e770 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:04.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.313+0000 7fde96db9640 1 --2- 172.21.15.123:0/1478821574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde9015af20 0x7fde9014bdf0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:04.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.313+0000 7fde96db9640 1 --2- 172.21.15.123:0/1478821574 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde9015ab40 0x7fde9014b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:04.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.313+0000 7fde96db9640 1 --2- 172.21.15.123:0/1478821574 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde900720b0 0x7fde901efe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:04.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.313+0000 7fde96db9640 1 -- 172.21.15.123:0/1478821574 >> 172.21.15.123:0/1478821574 conn(0x7fde900ccec0 msgr2=0x7fde90158130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:04.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.313+0000 7fde96db9640 1 -- 172.21.15.123:0/1478821574 shutdown_connections 2024-09-15T23:15:04.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:04.313+0000 7fde96db9640 1 -- 172.21.15.123:0/1478821574 wait complete. 2024-09-15T23:15:04.325 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-15T23:15:04.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:15:04.325 DEBUG:teuthology.orchestra.run.smithi123:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-15T23:15:05.743 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-09-15T23:15:05.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:15:05.743 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T23:15:05.761 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:15:05.761 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:15:05.761 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:15:05.777 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:15:05.777 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:15:05.777 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:15:05.777 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:15:05.819 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:15:05.819 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:15:05.819 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:15:05.819 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:15:05.834 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:15:05.835 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:15:05.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.960+0000 7f5a7c050640 1 Processor -- start 2024-09-15T23:15:05.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.960+0000 7f5a7c050640 1 -- start start 2024-09-15T23:15:05.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.961+0000 7f5a7c050640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a74145ed0 0x7f5a740b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:05.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.961+0000 7f5a7c050640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f5a74073180 0x7f5a740735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:05.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.961+0000 7f5a7c050640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5a740b5880 0x7f5a740b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:05.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.961+0000 7f5a7c050640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f5a74073b00 con 0x7f5a740b5880 2024-09-15T23:15:05.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.961+0000 7f5a7c050640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f5a740b4020 con 0x7f5a74073180 2024-09-15T23:15:05.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.961+0000 7f5a7c050640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5a740b42c0 con 0x7f5a74145ed0 2024-09-15T23:15:05.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.961+0000 7f5a7a5ed640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5a740b5880 0x7f5a740b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:05.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.961+0000 7f5a7a5ed640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5a740b5880 0x7f5a740b5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45848/0 (socket says 172.21.15.123:45848) 2024-09-15T23:15:05.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.961+0000 7f5a7a5ed640 1 -- 172.21.15.123:0/3693371842 learned_addr learned my addr 172.21.15.123:0/3693371842 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:05.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.962+0000 7f5a79dec640 1 --2- 172.21.15.123:0/3693371842 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a74145ed0 0x7f5a740b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:05.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.962+0000 7f5a795eb640 1 --2- 172.21.15.123:0/3693371842 >> v2:172.21.15.188:3300/0 conn(0x7f5a74073180 0x7f5a740735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:05.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.962+0000 7f5a7a5ed640 1 -- 172.21.15.123:0/3693371842 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a74145ed0 msgr2=0x7f5a740b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:05.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.962+0000 7f5a7a5ed640 1 --2- 172.21.15.123:0/3693371842 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a74145ed0 0x7f5a740b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:05.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.962+0000 7f5a7a5ed640 1 -- 172.21.15.123:0/3693371842 >> v2:172.21.15.188:3300/0 conn(0x7f5a74073180 msgr2=0x7f5a740735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:05.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.962+0000 7f5a7a5ed640 1 --2- 172.21.15.123:0/3693371842 >> v2:172.21.15.188:3300/0 conn(0x7f5a74073180 0x7f5a740735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:05.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.962+0000 7f5a7a5ed640 1 -- 172.21.15.123:0/3693371842 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a740b45a0 con 0x7f5a740b5880 2024-09-15T23:15:05.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.962+0000 7f5a7a5ed640 1 --2- 172.21.15.123:0/3693371842 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a740b5880 0x7f5a740b5d30 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f5a740700e0 tx=0x7f5a6c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee6ebfaf98405ae server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:05.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.962+0000 7f5a78dea640 1 -- 172.21.15.123:0/3693371842 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c037070 con 0x7f5a740b5880 2024-09-15T23:15:05.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.963+0000 7f5a78dea640 1 -- 172.21.15.123:0/3693371842 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a6c032440 con 0x7f5a740b5880 2024-09-15T23:15:05.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.963+0000 7f5a78dea640 1 -- 172.21.15.123:0/3693371842 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c032810 con 0x7f5a740b5880 2024-09-15T23:15:05.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.963+0000 7f5a7c050640 1 -- 172.21.15.123:0/3693371842 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a740b5880 msgr2=0x7f5a740b5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:05.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.963+0000 7f5a7c050640 1 --2- 172.21.15.123:0/3693371842 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a740b5880 0x7f5a740b5d30 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f5a740700e0 tx=0x7f5a6c02a1e0 comp rx=0 tx=0).stop 2024-09-15T23:15:05.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.963+0000 7f5a7c050640 1 -- 172.21.15.123:0/3693371842 shutdown_connections 2024-09-15T23:15:05.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.963+0000 7f5a7c050640 1 --2- 172.21.15.123:0/3693371842 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a740b5880 0x7f5a740b5d30 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:05.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.963+0000 7f5a7c050640 1 --2- 172.21.15.123:0/3693371842 >> v2:172.21.15.188:3300/0 conn(0x7f5a74073180 0x7f5a740735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:05.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.963+0000 7f5a7c050640 1 --2- 172.21.15.123:0/3693371842 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a74145ed0 0x7f5a740b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:05.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.963+0000 7f5a7c050640 1 -- 172.21.15.123:0/3693371842 >> 172.21.15.123:0/3693371842 conn(0x7f5a740ccec0 msgr2=0x7f5a740cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:05.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.963+0000 7f5a7c050640 1 -- 172.21.15.123:0/3693371842 shutdown_connections 2024-09-15T23:15:05.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.963+0000 7f5a7c050640 1 -- 172.21.15.123:0/3693371842 wait complete. 2024-09-15T23:15:05.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.964+0000 7f5a7c050640 1 Processor -- start 2024-09-15T23:15:05.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.965+0000 7f5a7c050640 1 -- start start 2024-09-15T23:15:05.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.965+0000 7f5a7c050640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5a74073180 0x7f5a7413a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:05.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.965+0000 7f5a7c050640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a740b5880 0x7f5a74072200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:05.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.965+0000 7f5a7c050640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a74145ed0 0x7f5a74157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:05.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.965+0000 7f5a7c050640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5a740b6270 con 0x7f5a740b5880 2024-09-15T23:15:05.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.965+0000 7f5a7c050640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5a740b4b60 con 0x7f5a74073180 2024-09-15T23:15:05.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.965+0000 7f5a7c050640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5a741f3fb0 con 0x7f5a74145ed0 2024-09-15T23:15:05.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.965+0000 7f5a795eb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a740b5880 0x7f5a74072200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:05.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.965+0000 7f5a795eb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a740b5880 0x7f5a74072200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45856/0 (socket says 172.21.15.123:45856) 2024-09-15T23:15:05.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.965+0000 7f5a795eb640 1 -- 172.21.15.123:0/1273907683 learned_addr learned my addr 172.21.15.123:0/1273907683 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:05.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.965+0000 7f5a79dec640 1 --2- 172.21.15.123:0/1273907683 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5a74073180 0x7f5a7413a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:05.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.966+0000 7f5a7a5ed640 1 --2- 172.21.15.123:0/1273907683 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a74145ed0 0x7f5a74157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:05.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.966+0000 7f5a795eb640 1 -- 172.21.15.123:0/1273907683 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a74145ed0 msgr2=0x7f5a74157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:05.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.966+0000 7f5a795eb640 1 --2- 172.21.15.123:0/1273907683 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a74145ed0 0x7f5a74157e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:05.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.966+0000 7f5a795eb640 1 -- 172.21.15.123:0/1273907683 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5a74073180 msgr2=0x7f5a7413a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:05.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.966+0000 7f5a795eb640 1 --2- 172.21.15.123:0/1273907683 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5a74073180 0x7f5a7413a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:05.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.966+0000 7f5a795eb640 1 -- 172.21.15.123:0/1273907683 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a741583d0 con 0x7f5a740b5880 2024-09-15T23:15:05.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.966+0000 7f5a795eb640 1 --2- 172.21.15.123:0/1273907683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a740b5880 0x7f5a74072200 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f5a6800d7d0 tx=0x7f5a6800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:05.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.966+0000 7f5a727fc640 1 -- 172.21.15.123:0/1273907683 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a68018030 con 0x7f5a740b5880 2024-09-15T23:15:05.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.966+0000 7f5a727fc640 1 -- 172.21.15.123:0/1273907683 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a68004020 con 0x7f5a740b5880 2024-09-15T23:15:05.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.966+0000 7f5a727fc640 1 -- 172.21.15.123:0/1273907683 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a68004230 con 0x7f5a740b5880 2024-09-15T23:15:05.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.966+0000 7f5a7c050640 1 -- 172.21.15.123:0/1273907683 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a7413a870 con 0x7f5a740b5880 2024-09-15T23:15:05.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.966+0000 7f5a7c050640 1 -- 172.21.15.123:0/1273907683 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a7413ae30 con 0x7f5a740b5880 2024-09-15T23:15:05.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.967+0000 7f5a7c050640 1 -- 172.21.15.123:0/1273907683 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a741462b0 con 0x7f5a740b5880 2024-09-15T23:15:05.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.968+0000 7f5a727fc640 1 -- 172.21.15.123:0/1273907683 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5a6801b070 con 0x7f5a740b5880 2024-09-15T23:15:05.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.968+0000 7f5a727fc640 1 --2- 172.21.15.123:0/1273907683 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5a6006c2b0 0x7f5a6006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:05.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.968+0000 7f5a727fc640 1 -- 172.21.15.123:0/1273907683 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7f5a6808b510 con 0x7f5a740b5880 2024-09-15T23:15:05.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.968+0000 7f5a79dec640 1 --2- 172.21.15.123:0/1273907683 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5a6006c2b0 0x7f5a6006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:05.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.969+0000 7f5a79dec640 1 --2- 172.21.15.123:0/1273907683 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5a6006c2b0 0x7f5a6006e770 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5a64003aa0 tx=0x7f5a64009830 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:05.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:05.972+0000 7f5a727fc640 1 -- 172.21.15.123:0/1273907683 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5a68059510 con 0x7f5a740b5880 2024-09-15T23:15:06.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.173+0000 7f5a7c050640 1 -- 172.21.15.123:0/1273907683 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a7415c8e0 con 0x7f5a740b5880 2024-09-15T23:15:06.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.173+0000 7f5a727fc640 1 -- 172.21.15.123:0/1273907683 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5229 (secure 0 0 0) 0x7f5a6805d810 con 0x7f5a740b5880 2024-09-15T23:15:06.175 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:06.175 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":22,"btime":"2024-09-15T23:14:58:309501+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5014,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/354247514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":354247514},{"type":"v1","addr":"172.21.15.188:6837","nonce":354247514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2925346627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2925346627},{"type":"v1","addr":"172.21.15.123:6834","nonce":2925346627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/280703051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":280703051},{"type":"v1","addr":"172.21.15.123:6835","nonce":280703051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:14:32.926325+0000","modified":"2024-09-15T23:14:57.626319+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.188:6836/1307575248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":1307575248},{"type":"v1","addr":"172.21.15.188:6836","nonce":1307575248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":3}]} 2024-09-15T23:15:06.175 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 22 2024-09-15T23:15:06.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.175+0000 7f5a7c050640 1 -- 172.21.15.123:0/1273907683 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5a6006c2b0 msgr2=0x7f5a6006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:06.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.175+0000 7f5a7c050640 1 --2- 172.21.15.123:0/1273907683 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5a6006c2b0 0x7f5a6006e770 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5a64003aa0 tx=0x7f5a64009830 comp rx=0 tx=0).stop 2024-09-15T23:15:06.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.175+0000 7f5a7c050640 1 -- 172.21.15.123:0/1273907683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a740b5880 msgr2=0x7f5a74072200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:06.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.175+0000 7f5a7c050640 1 --2- 172.21.15.123:0/1273907683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a740b5880 0x7f5a74072200 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f5a6800d7d0 tx=0x7f5a6800dc90 comp rx=0 tx=0).stop 2024-09-15T23:15:06.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.175+0000 7f5a7c050640 1 -- 172.21.15.123:0/1273907683 shutdown_connections 2024-09-15T23:15:06.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.175+0000 7f5a7c050640 1 --2- 172.21.15.123:0/1273907683 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a74145ed0 0x7f5a74157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:06.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.175+0000 7f5a7c050640 1 --2- 172.21.15.123:0/1273907683 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5a6006c2b0 0x7f5a6006e770 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:06.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.175+0000 7f5a7c050640 1 --2- 172.21.15.123:0/1273907683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a740b5880 0x7f5a74072200 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:06.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.175+0000 7f5a7c050640 1 --2- 172.21.15.123:0/1273907683 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5a74073180 0x7f5a7413a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:06.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.175+0000 7f5a7c050640 1 -- 172.21.15.123:0/1273907683 >> 172.21.15.123:0/1273907683 conn(0x7f5a740ccec0 msgr2=0x7f5a74144f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:06.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.175+0000 7f5a7c050640 1 -- 172.21.15.123:0/1273907683 shutdown_connections 2024-09-15T23:15:06.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.175+0000 7f5a7c050640 1 -- 172.21.15.123:0/1273907683 wait complete. 2024-09-15T23:15:06.187 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:15:06.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.284+0000 7f088eaa4640 1 Processor -- start 2024-09-15T23:15:06.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.284+0000 7f088eaa4640 1 -- start start 2024-09-15T23:15:06.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.284+0000 7f088eaa4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f088815ed20 0x7f08880b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:06.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.284+0000 7f088eaa4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08880d0e70 con 0x7f08880d23b0 2024-09-15T23:15:06.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.284+0000 7f088eaa4640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08880d00f0 con 0x7f08880b90e0 2024-09-15T23:15:06.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.284+0000 7f088eaa4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f08880d41c0 con 0x7f088815ed20 2024-09-15T23:15:06.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.285+0000 7f0887fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f08880d23b0 0x7f08880cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60296/0 (socket says 172.21.15.123:60296) 2024-09-15T23:15:06.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.285+0000 7f0887fff640 1 -- 172.21.15.123:0/2451751835 learned_addr learned my addr 172.21.15.123:0/2451751835 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:06.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.285+0000 7f088c840640 1 --2- 172.21.15.123:0/2451751835 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f088815ed20 0x7f08880b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:06.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.285+0000 7f08877fe640 1 -- 172.21.15.123:0/2451751835 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2647612231 0 0) 0x7f087c001110 con 0x7f08880d23b0 2024-09-15T23:15:06.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.285+0000 7f08877fe640 1 -- 172.21.15.123:0/2451751835 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0870003520 con 0x7f08880d23b0 2024-09-15T23:15:06.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.285+0000 7f08877fe640 1 -- 172.21.15.123:0/2451751835 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 692263297 0 0) 0x7f08880d00f0 con 0x7f08880b90e0 2024-09-15T23:15:06.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.285+0000 7f08877fe640 1 -- 172.21.15.123:0/2451751835 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f087c001110 con 0x7f08880b90e0 2024-09-15T23:15:06.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.285+0000 7f088c840640 1 -- 172.21.15.123:0/2451751835 >> v1:172.21.15.188:6789/0 conn(0x7f08880b90e0 legacy=0x7f08880cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:06.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.285+0000 7f088c840640 1 -- 172.21.15.123:0/2451751835 >> v1:172.21.15.123:6789/0 conn(0x7f08880d23b0 legacy=0x7f08880cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:06.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.285+0000 7f08877fe640 1 -- 172.21.15.123:0/2451751835 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3153134370 0 0) 0x7f0870003520 con 0x7f08880d23b0 2024-09-15T23:15:06.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.285+0000 7f088c840640 1 -- 172.21.15.123:0/2451751835 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08880d35b0 con 0x7f088815ed20 2024-09-15T23:15:06.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.286+0000 7f088c840640 1 --2- 172.21.15.123:0/2451751835 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f088815ed20 0x7f08880b6260 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f08780097d0 tx=0x7f087802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5f7da894e7bfe08 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:06.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.286+0000 7f08877fe640 1 -- 172.21.15.123:0/2451751835 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0878037070 con 0x7f088815ed20 2024-09-15T23:15:06.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.286+0000 7f08877fe640 1 -- 172.21.15.123:0/2451751835 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f087802ac30 con 0x7f088815ed20 2024-09-15T23:15:06.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.286+0000 7f08877fe640 1 -- 172.21.15.123:0/2451751835 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087c001840 con 0x7f088815ed20 2024-09-15T23:15:06.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.286+0000 7f088eaa4640 1 -- 172.21.15.123:0/2451751835 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f088815ed20 msgr2=0x7f08880b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:06.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.286+0000 7f088eaa4640 1 --2- 172.21.15.123:0/2451751835 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f088815ed20 0x7f08880b6260 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f08780097d0 tx=0x7f087802a1a0 comp rx=0 tx=0).stop 2024-09-15T23:15:06.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.286+0000 7f088eaa4640 1 -- 172.21.15.123:0/2451751835 shutdown_connections 2024-09-15T23:15:06.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.287+0000 7f088eaa4640 1 --2- 172.21.15.123:0/2451751835 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f088815ed20 0x7f08880b6260 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:06.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.287+0000 7f088eaa4640 1 -- 172.21.15.123:0/2451751835 >> 172.21.15.123:0/2451751835 conn(0x7f08880d1260 msgr2=0x7f08880d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:06.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.287+0000 7f088eaa4640 1 -- 172.21.15.123:0/2451751835 shutdown_connections 2024-09-15T23:15:06.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.287+0000 7f088eaa4640 1 -- 172.21.15.123:0/2451751835 wait complete. 2024-09-15T23:15:06.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.288+0000 7f088eaa4640 1 Processor -- start 2024-09-15T23:15:06.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.288+0000 7f088eaa4640 1 -- start start 2024-09-15T23:15:06.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.289+0000 7f088eaa4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08880b90e0 0x7f0888160ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:06.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.289+0000 7f088eaa4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08880d23b0 0x7f088815f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:06.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.289+0000 7f088eaa4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f088815ed20 0x7f08880cda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:06.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.289+0000 7f088eaa4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f08880d3e50 con 0x7f08880b90e0 2024-09-15T23:15:06.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.289+0000 7f088eaa4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f08880d3b70 con 0x7f088815ed20 2024-09-15T23:15:06.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.289+0000 7f088eaa4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f08880d32a0 con 0x7f08880d23b0 2024-09-15T23:15:06.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.289+0000 7f088c840640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08880b90e0 0x7f0888160ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:06.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.289+0000 7f088c840640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08880b90e0 0x7f0888160ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46566/0 (socket says 172.21.15.123:46566) 2024-09-15T23:15:06.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.289+0000 7f088c840640 1 -- 172.21.15.123:0/2062922146 learned_addr learned my addr 172.21.15.123:0/2062922146 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:06.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.289+0000 7f0887fff640 1 --2- 172.21.15.123:0/2062922146 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08880d23b0 0x7f088815f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:06.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.289+0000 7f088d041640 1 --2- 172.21.15.123:0/2062922146 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f088815ed20 0x7f08880cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:06.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.289+0000 7f088c840640 1 -- 172.21.15.123:0/2062922146 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08880d23b0 msgr2=0x7f088815f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:06.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.289+0000 7f088c840640 1 --2- 172.21.15.123:0/2062922146 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08880d23b0 0x7f088815f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:06.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.289+0000 7f088c840640 1 -- 172.21.15.123:0/2062922146 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f088815ed20 msgr2=0x7f08880cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:06.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.289+0000 7f088c840640 1 --2- 172.21.15.123:0/2062922146 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f088815ed20 0x7f08880cda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:06.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.289+0000 7f088c840640 1 -- 172.21.15.123:0/2062922146 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08880cdf70 con 0x7f08880b90e0 2024-09-15T23:15:06.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.289+0000 7f088d041640 1 --2- 172.21.15.123:0/2062922146 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f088815ed20 0x7f08880cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:06.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.289+0000 7f088c840640 1 --2- 172.21.15.123:0/2062922146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08880b90e0 0x7f0888160ab0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f0878035040 tx=0x7f08780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:06.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.289+0000 7f08857fa640 1 -- 172.21.15.123:0/2062922146 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0878042020 con 0x7f08880b90e0 2024-09-15T23:15:06.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.289+0000 7f08857fa640 1 -- 172.21.15.123:0/2062922146 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f087803d670 con 0x7f08880b90e0 2024-09-15T23:15:06.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.289+0000 7f08857fa640 1 -- 172.21.15.123:0/2062922146 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0878037040 con 0x7f08880b90e0 2024-09-15T23:15:06.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.289+0000 7f088eaa4640 1 -- 172.21.15.123:0/2062922146 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f088815fa10 con 0x7f08880b90e0 2024-09-15T23:15:06.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.289+0000 7f088eaa4640 1 -- 172.21.15.123:0/2062922146 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f088815ffd0 con 0x7f08880b90e0 2024-09-15T23:15:06.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.290+0000 7f088eaa4640 1 -- 172.21.15.123:0/2062922146 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f088815f100 con 0x7f08880b90e0 2024-09-15T23:15:06.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.291+0000 7f08857fa640 1 -- 172.21.15.123:0/2062922146 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0878045020 con 0x7f08880b90e0 2024-09-15T23:15:06.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.291+0000 7f08857fa640 1 --2- 172.21.15.123:0/2062922146 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f087406c2b0 0x7f087406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:06.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.291+0000 7f08857fa640 1 -- 172.21.15.123:0/2062922146 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7f08780abcd0 con 0x7f08880b90e0 2024-09-15T23:15:06.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.291+0000 7f0887fff640 1 --2- 172.21.15.123:0/2062922146 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f087406c2b0 0x7f087406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:06.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.292+0000 7f0887fff640 1 --2- 172.21.15.123:0/2062922146 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f087406c2b0 0x7f087406e770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f08880b34c0 tx=0x7f087c001e30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:06.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.295+0000 7f08857fa640 1 -- 172.21.15.123:0/2062922146 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f087804c030 con 0x7f08880b90e0 2024-09-15T23:15:06.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.497+0000 7f088eaa4640 1 -- 172.21.15.123:0/2062922146 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f08880b3f20 con 0x7f08880b90e0 2024-09-15T23:15:06.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.498+0000 7f08857fa640 1 -- 172.21.15.123:0/2062922146 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5230 (secure 0 0 0) 0x7f087807a3c0 con 0x7f08880b90e0 2024-09-15T23:15:06.501 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:06.501 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":23,"btime":"2024-09-15T23:15:06:332223+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5014,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/354247514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":354247514},{"type":"v1","addr":"172.21.15.188:6837","nonce":354247514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2925346627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2925346627},{"type":"v1","addr":"172.21.15.123:6834","nonce":2925346627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/280703051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":280703051},{"type":"v1","addr":"172.21.15.123:6835","nonce":280703051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:14:32.926325+0000","modified":"2024-09-15T23:15:05.628308+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.188:6836/1307575248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":1307575248},{"type":"v1","addr":"172.21.15.188:6836","nonce":1307575248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":3}]} 2024-09-15T23:15:06.502 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 23 2024-09-15T23:15:06.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.500+0000 7f088eaa4640 1 -- 172.21.15.123:0/2062922146 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f087406c2b0 msgr2=0x7f087406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:06.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.500+0000 7f088eaa4640 1 --2- 172.21.15.123:0/2062922146 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f087406c2b0 0x7f087406e770 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f08880b34c0 tx=0x7f087c001e30 comp rx=0 tx=0).stop 2024-09-15T23:15:06.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.500+0000 7f088eaa4640 1 -- 172.21.15.123:0/2062922146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08880b90e0 msgr2=0x7f0888160ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:06.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.500+0000 7f088eaa4640 1 --2- 172.21.15.123:0/2062922146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08880b90e0 0x7f0888160ab0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f0878035040 tx=0x7f08780046c0 comp rx=0 tx=0).stop 2024-09-15T23:15:06.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.500+0000 7f088eaa4640 1 -- 172.21.15.123:0/2062922146 shutdown_connections 2024-09-15T23:15:06.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.500+0000 7f088eaa4640 1 --2- 172.21.15.123:0/2062922146 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f088815ed20 0x7f08880cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:06.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.500+0000 7f088eaa4640 1 --2- 172.21.15.123:0/2062922146 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f08880d23b0 0x7f088815f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:06.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.500+0000 7f088eaa4640 1 --2- 172.21.15.123:0/2062922146 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f087406c2b0 0x7f087406e770 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:06.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.500+0000 7f088eaa4640 1 --2- 172.21.15.123:0/2062922146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08880b90e0 0x7f0888160ab0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:06.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.500+0000 7f088eaa4640 1 -- 172.21.15.123:0/2062922146 >> 172.21.15.123:0/2062922146 conn(0x7f08880d1260 msgr2=0x7f08880b4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:06.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.500+0000 7f088eaa4640 1 -- 172.21.15.123:0/2062922146 shutdown_connections 2024-09-15T23:15:06.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.500+0000 7f088eaa4640 1 -- 172.21.15.123:0/2062922146 wait complete. 2024-09-15T23:15:06.512 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:15:06.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.610+0000 7f1f9207b640 1 Processor -- start 2024-09-15T23:15:06.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.610+0000 7f1f9207b640 1 -- start start 2024-09-15T23:15:06.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.611+0000 7f1f9207b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1f8c15eab0 0x7f1f8c15ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:06.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.611+0000 7f1f9207b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f8c0b66b0 0x7f1f8c0b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:06.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.611+0000 7f1f9207b640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f8c15f570 con 0x7f1f8c162490 2024-09-15T23:15:06.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.611+0000 7f1f9207b640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f1f8c0b7040 con 0x7f1f8c15eab0 2024-09-15T23:15:06.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.611+0000 7f1f9207b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1f8c15f850 con 0x7f1f8c0b66b0 2024-09-15T23:15:06.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.611+0000 7f1f82ffd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1f8c162490 0x7f1f8c0d2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60312/0 (socket says 172.21.15.123:60312) 2024-09-15T23:15:06.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.611+0000 7f1f82ffd640 1 -- 172.21.15.123:0/133594149 learned_addr learned my addr 172.21.15.123:0/133594149 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:06.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.611+0000 7f1f8b7fe640 1 --2- 172.21.15.123:0/133594149 >> v2:172.21.15.188:3300/0 conn(0x7f1f8c15eab0 0x7f1f8c15ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:06.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.611+0000 7f1f8affd640 1 -- 172.21.15.123:0/133594149 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3564025287 0 0) 0x7f1f8c15f570 con 0x7f1f8c162490 2024-09-15T23:15:06.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.611+0000 7f1f8bfff640 1 --2- 172.21.15.123:0/133594149 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f8c0b66b0 0x7f1f8c0b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:06.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.611+0000 7f1f8affd640 1 -- 172.21.15.123:0/133594149 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f78003520 con 0x7f1f8c162490 2024-09-15T23:15:06.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.612+0000 7f1f8affd640 1 -- 172.21.15.123:0/133594149 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3826747342 0 0) 0x7f1f78003520 con 0x7f1f8c162490 2024-09-15T23:15:06.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.612+0000 7f1f8affd640 1 -- 172.21.15.123:0/133594149 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f8c0b66b0 msgr2=0x7f1f8c0b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:06.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.612+0000 7f1f8affd640 1 --2- 172.21.15.123:0/133594149 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f8c0b66b0 0x7f1f8c0b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:06.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.612+0000 7f1f8affd640 1 -- 172.21.15.123:0/133594149 >> v2:172.21.15.188:3300/0 conn(0x7f1f8c15eab0 msgr2=0x7f1f8c15ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:06.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.612+0000 7f1f8affd640 1 --2- 172.21.15.123:0/133594149 >> v2:172.21.15.188:3300/0 conn(0x7f1f8c15eab0 0x7f1f8c15ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:06.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.612+0000 7f1f8affd640 1 -- 172.21.15.123:0/133594149 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f8c15fb30 con 0x7f1f8c162490 2024-09-15T23:15:06.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.612+0000 7f1f8affd640 1 -- 172.21.15.123:0/133594149 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f1f74001670 con 0x7f1f8c162490 2024-09-15T23:15:06.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.612+0000 7f1f8affd640 1 -- 172.21.15.123:0/133594149 >> v1:172.21.15.123:6789/0 conn(0x7f1f8c162490 legacy=0x7f1f8c0d2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:06.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.612+0000 7f1f8affd640 1 --2- 172.21.15.123:0/133594149 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f780039b0 0x7f1f78003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:06.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.612+0000 7f1f8affd640 1 --2- 172.21.15.123:0/133594149 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f78004800 0x7f1f78004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:06.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.612+0000 7f1f8affd640 1 --2- 172.21.15.123:0/133594149 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f8c0b66b0 0x7f1f780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:06.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.612+0000 7f1f8affd640 1 -- 172.21.15.123:0/133594149 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8c0b7040 con 0x7f1f780039b0 2024-09-15T23:15:06.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.612+0000 7f1f8affd640 1 -- 172.21.15.123:0/133594149 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8c15f850 con 0x7f1f78004800 2024-09-15T23:15:06.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.612+0000 7f1f8affd640 1 -- 172.21.15.123:0/133594149 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1f7800b9c0 con 0x7f1f8c0b66b0 2024-09-15T23:15:06.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.612+0000 7f1f8b7fe640 1 --2- 172.21.15.123:0/133594149 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f780039b0 0x7f1f78003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:06.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.612+0000 7f1f82ffd640 1 --2- 172.21.15.123:0/133594149 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f78004800 0x7f1f78004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:06.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.612+0000 7f1f8bfff640 1 --2- 172.21.15.123:0/133594149 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f8c0b66b0 0x7f1f780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:06.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.612+0000 7f1f8b7fe640 1 -- 172.21.15.123:0/133594149 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f8c0b66b0 msgr2=0x7f1f780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:06.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.612+0000 7f1f8b7fe640 1 --2- 172.21.15.123:0/133594149 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f8c0b66b0 0x7f1f780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:06.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.612+0000 7f1f8b7fe640 1 -- 172.21.15.123:0/133594149 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f78004800 msgr2=0x7f1f78004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:06.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.612+0000 7f1f8b7fe640 1 --2- 172.21.15.123:0/133594149 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f78004800 0x7f1f78004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:06.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.612+0000 7f1f8b7fe640 1 -- 172.21.15.123:0/133594149 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f78003520 con 0x7f1f780039b0 2024-09-15T23:15:06.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.612+0000 7f1f8bfff640 1 --2- 172.21.15.123:0/133594149 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f8c0b66b0 0x7f1f780051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:06.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.613+0000 7f1f8b7fe640 1 --2- 172.21.15.123:0/133594149 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f780039b0 0x7f1f78003dd0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c009ac0 tx=0x7f1f78005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ae609027d44474 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:06.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.613+0000 7f1f8affd640 1 -- 172.21.15.123:0/133594149 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c036070 con 0x7f1f780039b0 2024-09-15T23:15:06.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.613+0000 7f1f8affd640 1 -- 172.21.15.123:0/133594149 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f7c031400 con 0x7f1f780039b0 2024-09-15T23:15:06.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.613+0000 7f1f8affd640 1 -- 172.21.15.123:0/133594149 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c009690 con 0x7f1f780039b0 2024-09-15T23:15:06.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.613+0000 7f1f9207b640 1 -- 172.21.15.123:0/133594149 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f780039b0 msgr2=0x7f1f78003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:06.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.613+0000 7f1f9207b640 1 --2- 172.21.15.123:0/133594149 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f780039b0 0x7f1f78003dd0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c009ac0 tx=0x7f1f78005830 comp rx=0 tx=0).stop 2024-09-15T23:15:06.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.613+0000 7f1f8bfff640 1 -- 172.21.15.123:0/133594149 reap_dead start 2024-09-15T23:15:06.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.614+0000 7f1f9207b640 1 -- 172.21.15.123:0/133594149 shutdown_connections 2024-09-15T23:15:06.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.614+0000 7f1f9207b640 1 -- 172.21.15.123:0/133594149 >> 172.21.15.123:0/133594149 conn(0x7f1f8c0d16d0 msgr2=0x7f1f8c0d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:06.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.614+0000 7f1f9207b640 1 -- 172.21.15.123:0/133594149 shutdown_connections 2024-09-15T23:15:06.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.614+0000 7f1f9207b640 1 -- 172.21.15.123:0/133594149 wait complete. 2024-09-15T23:15:06.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.615+0000 7f1f9207b640 1 Processor -- start 2024-09-15T23:15:06.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.615+0000 7f1f9207b640 1 -- start start 2024-09-15T23:15:06.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.616+0000 7f1f9207b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f780039b0 0x7f1f8c1596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:06.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.616+0000 7f1f9207b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f8c0b8c40 0x7f1f8c0b90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:06.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.616+0000 7f1f9207b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f8c1610a0 0x7f1f8c161550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:06.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.616+0000 7f1f9207b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8c0d4460 con 0x7f1f8c0b8c40 2024-09-15T23:15:06.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.616+0000 7f1f9207b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1f8c0cef20 con 0x7f1f780039b0 2024-09-15T23:15:06.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.616+0000 7f1f9207b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1f8c0d45e0 con 0x7f1f8c1610a0 2024-09-15T23:15:06.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.616+0000 7f1f82ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f8c0b8c40 0x7f1f8c0b90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:06.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.616+0000 7f1f82ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f8c0b8c40 0x7f1f8c0b90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46584/0 (socket says 172.21.15.123:46584) 2024-09-15T23:15:06.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.616+0000 7f1f82ffd640 1 -- 172.21.15.123:0/2620981612 learned_addr learned my addr 172.21.15.123:0/2620981612 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:06.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.616+0000 7f1f8b7fe640 1 --2- 172.21.15.123:0/2620981612 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f780039b0 0x7f1f8c1596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:06.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.616+0000 7f1f8bfff640 1 --2- 172.21.15.123:0/2620981612 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f8c1610a0 0x7f1f8c161550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:06.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.616+0000 7f1f82ffd640 1 -- 172.21.15.123:0/2620981612 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f8c1610a0 msgr2=0x7f1f8c161550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:06.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.616+0000 7f1f82ffd640 1 --2- 172.21.15.123:0/2620981612 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f8c1610a0 0x7f1f8c161550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:06.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.616+0000 7f1f82ffd640 1 -- 172.21.15.123:0/2620981612 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f780039b0 msgr2=0x7f1f8c1596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:06.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.616+0000 7f1f82ffd640 1 --2- 172.21.15.123:0/2620981612 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f780039b0 0x7f1f8c1596b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:06.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.616+0000 7f1f82ffd640 1 -- 172.21.15.123:0/2620981612 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f8c0cca40 con 0x7f1f8c0b8c40 2024-09-15T23:15:06.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.616+0000 7f1f82ffd640 1 --2- 172.21.15.123:0/2620981612 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f8c0b8c40 0x7f1f8c0b90c0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f1f74007340 tx=0x7f1f74007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:06.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.617+0000 7f1f88ff9640 1 -- 172.21.15.123:0/2620981612 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7401a070 con 0x7f1f8c0b8c40 2024-09-15T23:15:06.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.617+0000 7f1f88ff9640 1 -- 172.21.15.123:0/2620981612 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f7400f8e0 con 0x7f1f8c0b8c40 2024-09-15T23:15:06.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.617+0000 7f1f9207b640 1 -- 172.21.15.123:0/2620981612 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f8c159bf0 con 0x7f1f8c0b8c40 2024-09-15T23:15:06.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.617+0000 7f1f88ff9640 1 -- 172.21.15.123:0/2620981612 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7400fcb0 con 0x7f1f8c0b8c40 2024-09-15T23:15:06.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.617+0000 7f1f9207b640 1 -- 172.21.15.123:0/2620981612 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f8c0cbc80 con 0x7f1f8c0b8c40 2024-09-15T23:15:06.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.618+0000 7f1f9207b640 1 -- 172.21.15.123:0/2620981612 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f8c15f570 con 0x7f1f8c0b8c40 2024-09-15T23:15:06.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.619+0000 7f1f88ff9640 1 -- 172.21.15.123:0/2620981612 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1f7401d070 con 0x7f1f8c0b8c40 2024-09-15T23:15:06.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.619+0000 7f1f88ff9640 1 --2- 172.21.15.123:0/2620981612 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1f6c06c2e0 0x7f1f6c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:06.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.619+0000 7f1f88ff9640 1 -- 172.21.15.123:0/2620981612 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7f1f7408afb0 con 0x7f1f8c0b8c40 2024-09-15T23:15:06.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.620+0000 7f1f8b7fe640 1 --2- 172.21.15.123:0/2620981612 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1f6c06c2e0 0x7f1f6c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:06.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.620+0000 7f1f8b7fe640 1 --2- 172.21.15.123:0/2620981612 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1f6c06c2e0 0x7f1f6c06e7a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c033000 tx=0x7f1f7c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:06.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.624+0000 7f1f88ff9640 1 -- 172.21.15.123:0/2620981612 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1f74059040 con 0x7f1f8c0b8c40 2024-09-15T23:15:06.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.789+0000 7f1f9207b640 1 -- 172.21.15.123:0/2620981612 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f8c0d2500 con 0x7f1f8c0b8c40 2024-09-15T23:15:06.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.790+0000 7f1f88ff9640 1 -- 172.21.15.123:0/2620981612 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+16924 (secure 0 0 0) 0x7f1f7405d340 con 0x7f1f8c0b8c40 2024-09-15T23:15:06.791 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:06.792 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":54,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:14:55.295760+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:14:31.528995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-15T23:14:31.891097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.0","mappings":[{"from":5,"to":7}]},{"pgid":"7.6","mappings":[{"from":5,"to":7}]},{"pgid":"7.12","mappings":[{"from":5,"to":7}]},{"pgid":"7.1b","mappings":[{"from":5,"to":7}]},{"pgid":"7.32","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:15:06.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.792+0000 7f1f9207b640 1 -- 172.21.15.123:0/2620981612 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1f6c06c2e0 msgr2=0x7f1f6c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:06.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.792+0000 7f1f9207b640 1 --2- 172.21.15.123:0/2620981612 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1f6c06c2e0 0x7f1f6c06e7a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c033000 tx=0x7f1f7c008030 comp rx=0 tx=0).stop 2024-09-15T23:15:06.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.792+0000 7f1f9207b640 1 -- 172.21.15.123:0/2620981612 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f8c0b8c40 msgr2=0x7f1f8c0b90c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:06.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.792+0000 7f1f9207b640 1 --2- 172.21.15.123:0/2620981612 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f8c0b8c40 0x7f1f8c0b90c0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f1f74007340 tx=0x7f1f74007800 comp rx=0 tx=0).stop 2024-09-15T23:15:06.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.792+0000 7f1f9207b640 1 -- 172.21.15.123:0/2620981612 shutdown_connections 2024-09-15T23:15:06.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.792+0000 7f1f9207b640 1 --2- 172.21.15.123:0/2620981612 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f8c1610a0 0x7f1f8c161550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:06.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.792+0000 7f1f9207b640 1 --2- 172.21.15.123:0/2620981612 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1f6c06c2e0 0x7f1f6c06e7a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:06.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.792+0000 7f1f9207b640 1 --2- 172.21.15.123:0/2620981612 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f8c0b8c40 0x7f1f8c0b90c0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:06.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.792+0000 7f1f9207b640 1 --2- 172.21.15.123:0/2620981612 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f780039b0 0x7f1f8c1596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:06.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.792+0000 7f1f9207b640 1 -- 172.21.15.123:0/2620981612 >> 172.21.15.123:0/2620981612 conn(0x7f1f8c0d16d0 msgr2=0x7f1f8c0d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:06.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.792+0000 7f1f9207b640 1 -- 172.21.15.123:0/2620981612 shutdown_connections 2024-09-15T23:15:06.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.792+0000 7f1f9207b640 1 -- 172.21.15.123:0/2620981612 wait complete. 2024-09-15T23:15:06.804 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T23:15:06.805 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:15:06.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.901+0000 7fd13a065640 1 Processor -- start 2024-09-15T23:15:06.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.901+0000 7fd13a065640 1 -- start start 2024-09-15T23:15:06.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.902+0000 7fd13a065640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd13406cd20 0x7fd1340b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:06.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.902+0000 7fd13a065640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd134070b80 0x7fd1340b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:06.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.902+0000 7fd13a065640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd13415eab0 con 0x7fd13415e6d0 2024-09-15T23:15:06.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.902+0000 7fd13a065640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fd1340b77e0 con 0x7fd13406cd20 2024-09-15T23:15:06.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.902+0000 7fd13a065640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fd13415ed70 con 0x7fd134070b80 2024-09-15T23:15:06.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.902+0000 7fd132ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd13406cd20 0x7fd1340b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:06.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.902+0000 7fd1337fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd13415e6d0 0x7fd134071390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60316/0 (socket says 172.21.15.123:60316) 2024-09-15T23:15:06.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.902+0000 7fd1337fe640 1 -- 172.21.15.123:0/705911653 learned_addr learned my addr 172.21.15.123:0/705911653 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:06.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.902+0000 7fd133fff640 1 --2- 172.21.15.123:0/705911653 >> v2:172.21.15.188:3300/0 conn(0x7fd134070b80 0x7fd1340b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:06.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.902+0000 7fd132ffd640 1 -- 172.21.15.123:0/705911653 >> v2:172.21.15.188:3300/0 conn(0x7fd134070b80 msgr2=0x7fd1340b72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:06.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.902+0000 7fd132ffd640 1 --2- 172.21.15.123:0/705911653 >> v2:172.21.15.188:3300/0 conn(0x7fd134070b80 0x7fd1340b72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:06.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.902+0000 7fd132ffd640 1 -- 172.21.15.123:0/705911653 >> v1:172.21.15.123:6789/0 conn(0x7fd13415e6d0 legacy=0x7fd134071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:06.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.902+0000 7fd132ffd640 1 -- 172.21.15.123:0/705911653 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd13415f050 con 0x7fd13406cd20 2024-09-15T23:15:06.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.902+0000 7fd1327fc640 1 -- 172.21.15.123:0/705911653 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2178963333 0 0) 0x7fd13415eab0 con 0x7fd13415e6d0 2024-09-15T23:15:06.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.903+0000 7fd132ffd640 1 --2- 172.21.15.123:0/705911653 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd13406cd20 0x7fd1340b6d60 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fd1340710d0 tx=0x7fd12802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9bc15d68f8e72ec server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:06.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.903+0000 7fd1327fc640 1 -- 172.21.15.123:0/705911653 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd128037070 con 0x7fd13406cd20 2024-09-15T23:15:06.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.903+0000 7fd1327fc640 1 -- 172.21.15.123:0/705911653 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd128032440 con 0x7fd13406cd20 2024-09-15T23:15:06.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.903+0000 7fd1327fc640 1 -- 172.21.15.123:0/705911653 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd128032810 con 0x7fd13406cd20 2024-09-15T23:15:06.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.904+0000 7fd13a065640 1 -- 172.21.15.123:0/705911653 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd13406cd20 msgr2=0x7fd1340b6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:06.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.904+0000 7fd13a065640 1 --2- 172.21.15.123:0/705911653 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd13406cd20 0x7fd1340b6d60 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fd1340710d0 tx=0x7fd12802a1a0 comp rx=0 tx=0).stop 2024-09-15T23:15:06.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.904+0000 7fd13a065640 1 -- 172.21.15.123:0/705911653 shutdown_connections 2024-09-15T23:15:06.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.904+0000 7fd13a065640 1 --2- 172.21.15.123:0/705911653 >> v2:172.21.15.188:3300/0 conn(0x7fd134070b80 0x7fd1340b72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:06.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.904+0000 7fd13a065640 1 --2- 172.21.15.123:0/705911653 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd13406cd20 0x7fd1340b6d60 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:06.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.904+0000 7fd13a065640 1 -- 172.21.15.123:0/705911653 >> 172.21.15.123:0/705911653 conn(0x7fd134067fb0 msgr2=0x7fd13406f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:06.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.904+0000 7fd13a065640 1 -- 172.21.15.123:0/705911653 shutdown_connections 2024-09-15T23:15:06.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.904+0000 7fd13a065640 1 -- 172.21.15.123:0/705911653 wait complete. 2024-09-15T23:15:06.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.905+0000 7fd13a065640 1 Processor -- start 2024-09-15T23:15:06.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.905+0000 7fd13a065640 1 -- start start 2024-09-15T23:15:06.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.906+0000 7fd13a065640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd13406cd20 0x7fd1341548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:06.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.906+0000 7fd13a065640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd134070b80 0x7fd1341e9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:06.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.906+0000 7fd13a065640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd13415e6d0 0x7fd1341551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:06.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.906+0000 7fd13a065640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd13415f8f0 con 0x7fd134070b80 2024-09-15T23:15:06.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.906+0000 7fd13a065640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd13415f610 con 0x7fd13415e6d0 2024-09-15T23:15:06.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.906+0000 7fd13a065640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd1341622a0 con 0x7fd13406cd20 2024-09-15T23:15:06.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.906+0000 7fd132ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd134070b80 0x7fd1341e9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:06.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.906+0000 7fd132ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd134070b80 0x7fd1341e9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46606/0 (socket says 172.21.15.123:46606) 2024-09-15T23:15:06.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.906+0000 7fd132ffd640 1 -- 172.21.15.123:0/3210665981 learned_addr learned my addr 172.21.15.123:0/3210665981 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:06.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.906+0000 7fd133fff640 1 --2- 172.21.15.123:0/3210665981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd13415e6d0 0x7fd1341551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:06.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.906+0000 7fd1337fe640 1 --2- 172.21.15.123:0/3210665981 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd13406cd20 0x7fd1341548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:06.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.906+0000 7fd132ffd640 1 -- 172.21.15.123:0/3210665981 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd13406cd20 msgr2=0x7fd1341548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:06.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.906+0000 7fd132ffd640 1 --2- 172.21.15.123:0/3210665981 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd13406cd20 0x7fd1341548b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:06.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.906+0000 7fd132ffd640 1 -- 172.21.15.123:0/3210665981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd13415e6d0 msgr2=0x7fd1341551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:06.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.906+0000 7fd132ffd640 1 --2- 172.21.15.123:0/3210665981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd13415e6d0 0x7fd1341551c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:06.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.906+0000 7fd132ffd640 1 -- 172.21.15.123:0/3210665981 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1341ea390 con 0x7fd134070b80 2024-09-15T23:15:06.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.907+0000 7fd132ffd640 1 --2- 172.21.15.123:0/3210665981 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd134070b80 0x7fd1341e9a60 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fd128000c00 tx=0x7fd1280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:06.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.907+0000 7fd11bfff640 1 -- 172.21.15.123:0/3210665981 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd128037040 con 0x7fd134070b80 2024-09-15T23:15:06.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.907+0000 7fd11bfff640 1 -- 172.21.15.123:0/3210665981 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd128042070 con 0x7fd134070b80 2024-09-15T23:15:06.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.907+0000 7fd13a065640 1 -- 172.21.15.123:0/3210665981 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1341ea670 con 0x7fd134070b80 2024-09-15T23:15:06.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.907+0000 7fd11bfff640 1 -- 172.21.15.123:0/3210665981 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd128030bd0 con 0x7fd134070b80 2024-09-15T23:15:06.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.907+0000 7fd13a065640 1 -- 172.21.15.123:0/3210665981 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1340b1ea0 con 0x7fd134070b80 2024-09-15T23:15:06.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.908+0000 7fd13a065640 1 -- 172.21.15.123:0/3210665981 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd134071390 con 0x7fd134070b80 2024-09-15T23:15:06.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.908+0000 7fd11bfff640 1 -- 172.21.15.123:0/3210665981 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd128047460 con 0x7fd134070b80 2024-09-15T23:15:06.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.909+0000 7fd11bfff640 1 --2- 172.21.15.123:0/3210665981 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd12006c2b0 0x7fd12006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:06.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.909+0000 7fd11bfff640 1 -- 172.21.15.123:0/3210665981 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7fd1280abf20 con 0x7fd134070b80 2024-09-15T23:15:06.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.909+0000 7fd1337fe640 1 --2- 172.21.15.123:0/3210665981 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd12006c2b0 0x7fd12006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:06.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.910+0000 7fd1337fe640 1 --2- 172.21.15.123:0/3210665981 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd12006c2b0 0x7fd12006e770 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd124007fd0 tx=0x7fd124007de0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:06.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:06.913+0000 7fd11bfff640 1 -- 172.21.15.123:0/3210665981 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd128032e20 con 0x7fd134070b80 2024-09-15T23:15:07.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.111+0000 7fd13a065640 1 -- 172.21.15.123:0/3210665981 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd13406f650 con 0x7fd134070b80 2024-09-15T23:15:07.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.111+0000 7fd11bfff640 1 -- 172.21.15.123:0/3210665981 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5230 (secure 0 0 0) 0x7fd128079fb0 con 0x7fd134070b80 2024-09-15T23:15:07.113 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:07.113 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":23,"btime":"2024-09-15T23:15:06:332223+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5014,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/354247514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":354247514},{"type":"v1","addr":"172.21.15.188:6837","nonce":354247514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2925346627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2925346627},{"type":"v1","addr":"172.21.15.123:6834","nonce":2925346627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/280703051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":280703051},{"type":"v1","addr":"172.21.15.123:6835","nonce":280703051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:14:32.926325+0000","modified":"2024-09-15T23:15:05.628308+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.188:6836/1307575248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":1307575248},{"type":"v1","addr":"172.21.15.188:6836","nonce":1307575248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":3}]} 2024-09-15T23:15:07.113 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 23 2024-09-15T23:15:07.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.113+0000 7fd13a065640 1 -- 172.21.15.123:0/3210665981 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd12006c2b0 msgr2=0x7fd12006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:07.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.113+0000 7fd13a065640 1 --2- 172.21.15.123:0/3210665981 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd12006c2b0 0x7fd12006e770 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd124007fd0 tx=0x7fd124007de0 comp rx=0 tx=0).stop 2024-09-15T23:15:07.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.113+0000 7fd13a065640 1 -- 172.21.15.123:0/3210665981 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd134070b80 msgr2=0x7fd1341e9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:07.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.113+0000 7fd13a065640 1 --2- 172.21.15.123:0/3210665981 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd134070b80 0x7fd1341e9a60 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fd128000c00 tx=0x7fd1280046c0 comp rx=0 tx=0).stop 2024-09-15T23:15:07.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.113+0000 7fd13a065640 1 -- 172.21.15.123:0/3210665981 shutdown_connections 2024-09-15T23:15:07.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.113+0000 7fd13a065640 1 --2- 172.21.15.123:0/3210665981 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd13415e6d0 0x7fd1341551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:07.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.113+0000 7fd13a065640 1 --2- 172.21.15.123:0/3210665981 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd12006c2b0 0x7fd12006e770 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:07.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.113+0000 7fd13a065640 1 --2- 172.21.15.123:0/3210665981 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd134070b80 0x7fd1341e9a60 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:07.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.113+0000 7fd13a065640 1 --2- 172.21.15.123:0/3210665981 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd13406cd20 0x7fd1341548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:07.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.113+0000 7fd13a065640 1 -- 172.21.15.123:0/3210665981 >> 172.21.15.123:0/3210665981 conn(0x7fd134067fb0 msgr2=0x7fd134162660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:07.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.113+0000 7fd13a065640 1 -- 172.21.15.123:0/3210665981 shutdown_connections 2024-09-15T23:15:07.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.114+0000 7fd13a065640 1 -- 172.21.15.123:0/3210665981 wait complete. 2024-09-15T23:15:07.125 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:15:07.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.222+0000 7fe6f2eba640 1 Processor -- start 2024-09-15T23:15:07.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.222+0000 7fe6f2eba640 1 -- start start 2024-09-15T23:15:07.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.222+0000 7fe6f2eba640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe6ec0b6970 0x7fe6ec0b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:07.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.222+0000 7fe6f2eba640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6ec0d23b0 0x7fe6ec0b8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:07.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.222+0000 7fe6f2eba640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6ec0d0e70 con 0x7fe6ec15ed20 2024-09-15T23:15:07.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.222+0000 7fe6f2eba640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fe6ec0d41c0 con 0x7fe6ec0b6970 2024-09-15T23:15:07.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.222+0000 7fe6f2eba640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe6ec0d35b0 con 0x7fe6ec0d23b0 2024-09-15T23:15:07.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.223+0000 7fe6f1457640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6ec0d23b0 0x7fe6ec0b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:07.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.223+0000 7fe6ebfff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe6ec0b6970 0x7fe6ec0b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:07.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.223+0000 7fe6f0c56640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fe6ec15ed20 0x7fe6ec0b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:51882/0 (socket says 172.21.15.123:51882) 2024-09-15T23:15:07.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.223+0000 7fe6f1457640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6ec0d23b0 0x7fe6ec0b8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:56924/0 (socket says 172.21.15.123:56924) 2024-09-15T23:15:07.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.223+0000 7fe6ebfff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe6ec0b6970 0x7fe6ec0b80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:59640/0 (socket says 172.21.15.123:59640) 2024-09-15T23:15:07.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.223+0000 7fe6f0c56640 1 -- 172.21.15.123:0/1171477840 learned_addr learned my addr 172.21.15.123:0/1171477840 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:07.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.223+0000 7fe6f1457640 1 -- 172.21.15.123:0/1171477840 >> v2:172.21.15.188:3300/0 conn(0x7fe6ec0b6970 msgr2=0x7fe6ec0b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:07.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.223+0000 7fe6f1457640 1 --2- 172.21.15.123:0/1171477840 >> v2:172.21.15.188:3300/0 conn(0x7fe6ec0b6970 0x7fe6ec0b80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:07.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.223+0000 7fe6f1457640 1 -- 172.21.15.123:0/1171477840 >> v1:172.21.15.188:6789/0 conn(0x7fe6ec15ed20 legacy=0x7fe6ec0b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:07.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.223+0000 7fe6f1457640 1 -- 172.21.15.123:0/1171477840 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ec0d3890 con 0x7fe6ec0d23b0 2024-09-15T23:15:07.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.223+0000 7fe6ebfff640 1 --2- 172.21.15.123:0/1171477840 >> v2:172.21.15.188:3300/0 conn(0x7fe6ec0b6970 0x7fe6ec0b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:15:07.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.224+0000 7fe6f1457640 1 --2- 172.21.15.123:0/1171477840 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6ec0d23b0 0x7fe6ec0b8610 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4009d90 tx=0x7fe6e402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=752f34d207ae7b26 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:07.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.224+0000 7fe6eb7fe640 1 -- 172.21.15.123:0/1171477840 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4031600 con 0x7fe6ec0d23b0 2024-09-15T23:15:07.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.224+0000 7fe6eb7fe640 1 -- 172.21.15.123:0/1171477840 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6e40317a0 con 0x7fe6ec0d23b0 2024-09-15T23:15:07.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.224+0000 7fe6eb7fe640 1 -- 172.21.15.123:0/1171477840 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4031b70 con 0x7fe6ec0d23b0 2024-09-15T23:15:07.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.225+0000 7fe6f2eba640 1 -- 172.21.15.123:0/1171477840 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6ec0d23b0 msgr2=0x7fe6ec0b8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:07.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.225+0000 7fe6f2eba640 1 --2- 172.21.15.123:0/1171477840 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6ec0d23b0 0x7fe6ec0b8610 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4009d90 tx=0x7fe6e402a5d0 comp rx=0 tx=0).stop 2024-09-15T23:15:07.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.225+0000 7fe6f2eba640 1 -- 172.21.15.123:0/1171477840 shutdown_connections 2024-09-15T23:15:07.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.225+0000 7fe6f2eba640 1 --2- 172.21.15.123:0/1171477840 >> v2:172.21.15.188:3300/0 conn(0x7fe6ec0b6970 0x7fe6ec0b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:07.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.225+0000 7fe6f2eba640 1 --2- 172.21.15.123:0/1171477840 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6ec0d23b0 0x7fe6ec0b8610 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:07.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.225+0000 7fe6f2eba640 1 -- 172.21.15.123:0/1171477840 >> 172.21.15.123:0/1171477840 conn(0x7fe6ec0d1260 msgr2=0x7fe6ec0d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:07.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.225+0000 7fe6f2eba640 1 -- 172.21.15.123:0/1171477840 shutdown_connections 2024-09-15T23:15:07.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.225+0000 7fe6f2eba640 1 -- 172.21.15.123:0/1171477840 wait complete. 2024-09-15T23:15:07.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.226+0000 7fe6f2eba640 1 Processor -- start 2024-09-15T23:15:07.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.226+0000 7fe6f2eba640 1 -- start start 2024-09-15T23:15:07.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.227+0000 7fe6f2eba640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6ec0b6970 0x7fe6ec1f90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:07.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.227+0000 7fe6f2eba640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6ec0d23b0 0x7fe6ec1539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:07.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.227+0000 7fe6f2eba640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6ec15ed20 0x7fe6ec154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:07.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.227+0000 7fe6f2eba640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ec0d32a0 con 0x7fe6ec15ed20 2024-09-15T23:15:07.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.227+0000 7fe6f2eba640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe6ec0d3e50 con 0x7fe6ec0b6970 2024-09-15T23:15:07.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.227+0000 7fe6f2eba640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe6ec15f100 con 0x7fe6ec0d23b0 2024-09-15T23:15:07.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.227+0000 7fe6f1457640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6ec15ed20 0x7fe6ec154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:07.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.227+0000 7fe6f1457640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6ec15ed20 0x7fe6ec154590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46618/0 (socket says 172.21.15.123:46618) 2024-09-15T23:15:07.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.227+0000 7fe6f1457640 1 -- 172.21.15.123:0/2585376301 learned_addr learned my addr 172.21.15.123:0/2585376301 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:07.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.227+0000 7fe6ebfff640 1 --2- 172.21.15.123:0/2585376301 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6ec0d23b0 0x7fe6ec1539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:07.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.227+0000 7fe6f0c56640 1 --2- 172.21.15.123:0/2585376301 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6ec0b6970 0x7fe6ec1f90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:07.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.227+0000 7fe6f1457640 1 -- 172.21.15.123:0/2585376301 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6ec0d23b0 msgr2=0x7fe6ec1539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:07.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.227+0000 7fe6f1457640 1 --2- 172.21.15.123:0/2585376301 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6ec0d23b0 0x7fe6ec1539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:07.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.227+0000 7fe6f1457640 1 -- 172.21.15.123:0/2585376301 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6ec0b6970 msgr2=0x7fe6ec1f90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:07.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.227+0000 7fe6f1457640 1 --2- 172.21.15.123:0/2585376301 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6ec0b6970 0x7fe6ec1f90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:07.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.227+0000 7fe6f1457640 1 -- 172.21.15.123:0/2585376301 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ec0ce240 con 0x7fe6ec15ed20 2024-09-15T23:15:07.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.227+0000 7fe6f1457640 1 --2- 172.21.15.123:0/2585376301 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6ec15ed20 0x7fe6ec154590 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4009eb0 tx=0x7fe6e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:07.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.228+0000 7fe6e97fa640 1 -- 172.21.15.123:0/2585376301 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4040070 con 0x7fe6ec15ed20 2024-09-15T23:15:07.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.228+0000 7fe6e97fa640 1 -- 172.21.15.123:0/2585376301 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6e4030b60 con 0x7fe6ec15ed20 2024-09-15T23:15:07.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.228+0000 7fe6e97fa640 1 -- 172.21.15.123:0/2585376301 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4009450 con 0x7fe6ec15ed20 2024-09-15T23:15:07.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.228+0000 7fe6f2eba640 1 -- 172.21.15.123:0/2585376301 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6ec0ce520 con 0x7fe6ec15ed20 2024-09-15T23:15:07.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.228+0000 7fe6f2eba640 1 -- 172.21.15.123:0/2585376301 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6ec153f30 con 0x7fe6ec15ed20 2024-09-15T23:15:07.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.229+0000 7fe6f2eba640 1 -- 172.21.15.123:0/2585376301 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6ec0b7010 con 0x7fe6ec15ed20 2024-09-15T23:15:07.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.229+0000 7fe6e97fa640 1 -- 172.21.15.123:0/2585376301 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe6e4039040 con 0x7fe6ec15ed20 2024-09-15T23:15:07.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.230+0000 7fe6e97fa640 1 --2- 172.21.15.123:0/2585376301 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe6d006c2b0 0x7fe6d006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:07.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.230+0000 7fe6e97fa640 1 -- 172.21.15.123:0/2585376301 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7fe6e40ac9a0 con 0x7fe6ec15ed20 2024-09-15T23:15:07.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.230+0000 7fe6f0c56640 1 --2- 172.21.15.123:0/2585376301 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe6d006c2b0 0x7fe6d006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:07.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.230+0000 7fe6f0c56640 1 --2- 172.21.15.123:0/2585376301 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe6d006c2b0 0x7fe6d006e770 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0007fd0 tx=0x7fe6e0007e80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:07.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.234+0000 7fe6e97fa640 1 -- 172.21.15.123:0/2585376301 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe6e407aac0 con 0x7fe6ec15ed20 2024-09-15T23:15:07.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.431+0000 7fe6f2eba640 1 -- 172.21.15.123:0/2585376301 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe6ec0b7840 con 0x7fe6ec15ed20 2024-09-15T23:15:07.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.432+0000 7fe6e97fa640 1 -- 172.21.15.123:0/2585376301 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5230 (secure 0 0 0) 0x7fe6e407edc0 con 0x7fe6ec15ed20 2024-09-15T23:15:07.433 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:07.433 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":23,"btime":"2024-09-15T23:15:06:332223+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5014,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/354247514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":354247514},{"type":"v1","addr":"172.21.15.188:6837","nonce":354247514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2925346627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2925346627},{"type":"v1","addr":"172.21.15.123:6834","nonce":2925346627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/280703051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":280703051},{"type":"v1","addr":"172.21.15.123:6835","nonce":280703051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:14:32.926325+0000","modified":"2024-09-15T23:15:05.628308+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5256},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5256":{"gid":5256,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":11,"addr":"172.21.15.188:6836/1307575248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":1307575248},{"type":"v1","addr":"172.21.15.188:6836","nonce":1307575248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5256,"qdb_cluster":[5256]},"id":3}]} 2024-09-15T23:15:07.434 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 23 2024-09-15T23:15:07.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.434+0000 7fe6f2eba640 1 -- 172.21.15.123:0/2585376301 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe6d006c2b0 msgr2=0x7fe6d006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:07.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.434+0000 7fe6f2eba640 1 --2- 172.21.15.123:0/2585376301 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe6d006c2b0 0x7fe6d006e770 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0007fd0 tx=0x7fe6e0007e80 comp rx=0 tx=0).stop 2024-09-15T23:15:07.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.434+0000 7fe6f2eba640 1 -- 172.21.15.123:0/2585376301 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6ec15ed20 msgr2=0x7fe6ec154590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:07.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.434+0000 7fe6f2eba640 1 --2- 172.21.15.123:0/2585376301 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6ec15ed20 0x7fe6ec154590 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4009eb0 tx=0x7fe6e4004a40 comp rx=0 tx=0).stop 2024-09-15T23:15:07.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.434+0000 7fe6f2eba640 1 -- 172.21.15.123:0/2585376301 shutdown_connections 2024-09-15T23:15:07.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.434+0000 7fe6f2eba640 1 --2- 172.21.15.123:0/2585376301 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe6d006c2b0 0x7fe6d006e770 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:07.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.434+0000 7fe6f2eba640 1 --2- 172.21.15.123:0/2585376301 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6ec15ed20 0x7fe6ec154590 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:07.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.434+0000 7fe6f2eba640 1 --2- 172.21.15.123:0/2585376301 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6ec0d23b0 0x7fe6ec1539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:07.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.434+0000 7fe6f2eba640 1 --2- 172.21.15.123:0/2585376301 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6ec0b6970 0x7fe6ec1f90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:07.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.434+0000 7fe6f2eba640 1 -- 172.21.15.123:0/2585376301 >> 172.21.15.123:0/2585376301 conn(0x7fe6ec0d1260 msgr2=0x7fe6ec15c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:07.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.434+0000 7fe6f2eba640 1 -- 172.21.15.123:0/2585376301 shutdown_connections 2024-09-15T23:15:07.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.434+0000 7fe6f2eba640 1 -- 172.21.15.123:0/2585376301 wait complete. 2024-09-15T23:15:07.445 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:15:07.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.543+0000 7f74a7342640 1 Processor -- start 2024-09-15T23:15:07.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.543+0000 7f74a7342640 1 -- start start 2024-09-15T23:15:07.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.544+0000 7f74a7342640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f74a00b6970 0x7f74a00b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:07.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.544+0000 7f74a7342640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f74a00d23b0 0x7f74a00b8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:07.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.544+0000 7f74a7342640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74a00d0e70 con 0x7f74a015ed20 2024-09-15T23:15:07.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.544+0000 7f74a7342640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f74a00d41c0 con 0x7f74a00d23b0 2024-09-15T23:15:07.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.544+0000 7f74a7342640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f74a00d35b0 con 0x7f74a00b6970 2024-09-15T23:15:07.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.544+0000 7f74a58df640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f74a00d23b0 0x7f74a00b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:07.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.544+0000 7f74a48dd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f74a00b6970 0x7f74a00b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:07.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.544+0000 7f74a50de640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f74a015ed20 0x7f74a00b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:51886/0 (socket says 172.21.15.123:51886) 2024-09-15T23:15:07.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.544+0000 7f74a50de640 1 -- 172.21.15.123:0/3271211856 learned_addr learned my addr 172.21.15.123:0/3271211856 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:07.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.544+0000 7f74a58df640 1 -- 172.21.15.123:0/3271211856 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f74a00b6970 msgr2=0x7f74a00b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:07.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.544+0000 7f74a58df640 1 --2- 172.21.15.123:0/3271211856 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f74a00b6970 0x7f74a00b80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:07.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.544+0000 7f74a58df640 1 -- 172.21.15.123:0/3271211856 >> v1:172.21.15.188:6789/0 conn(0x7f74a015ed20 legacy=0x7f74a00b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:07.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.544+0000 7f74a58df640 1 -- 172.21.15.123:0/3271211856 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74a00d3890 con 0x7f74a00d23b0 2024-09-15T23:15:07.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.544+0000 7f7497fff640 1 -- 172.21.15.123:0/3271211856 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2074288829 0 0) 0x7f749c001110 con 0x7f74a015ed20 2024-09-15T23:15:07.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.544+0000 7f74a48dd640 1 --2- 172.21.15.123:0/3271211856 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f74a00b6970 0x7f74a00b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:15:07.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.545+0000 7f74a58df640 1 --2- 172.21.15.123:0/3271211856 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f74a00d23b0 0x7f74a00b8610 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7498009d90 tx=0x7f749802a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b329107b4d50bb2a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:07.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.545+0000 7f7497fff640 1 -- 172.21.15.123:0/3271211856 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7498031600 con 0x7f74a00d23b0 2024-09-15T23:15:07.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.545+0000 7f7497fff640 1 -- 172.21.15.123:0/3271211856 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74980317a0 con 0x7f74a00d23b0 2024-09-15T23:15:07.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.545+0000 7f7497fff640 1 -- 172.21.15.123:0/3271211856 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7498031b70 con 0x7f74a00d23b0 2024-09-15T23:15:07.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.546+0000 7f74a7342640 1 -- 172.21.15.123:0/3271211856 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f74a00d23b0 msgr2=0x7f74a00b8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:07.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.546+0000 7f74a7342640 1 --2- 172.21.15.123:0/3271211856 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f74a00d23b0 0x7f74a00b8610 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7498009d90 tx=0x7f749802a5d0 comp rx=0 tx=0).stop 2024-09-15T23:15:07.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.546+0000 7f74a7342640 1 -- 172.21.15.123:0/3271211856 shutdown_connections 2024-09-15T23:15:07.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.546+0000 7f74a7342640 1 --2- 172.21.15.123:0/3271211856 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f74a00d23b0 0x7f74a00b8610 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:07.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.546+0000 7f74a7342640 1 --2- 172.21.15.123:0/3271211856 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f74a00b6970 0x7f74a00b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:07.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.546+0000 7f74a7342640 1 -- 172.21.15.123:0/3271211856 >> 172.21.15.123:0/3271211856 conn(0x7f74a00d1260 msgr2=0x7f74a00d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:07.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.546+0000 7f74a7342640 1 -- 172.21.15.123:0/3271211856 shutdown_connections 2024-09-15T23:15:07.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.546+0000 7f74a7342640 1 -- 172.21.15.123:0/3271211856 wait complete. 2024-09-15T23:15:07.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.547+0000 7f74a7342640 1 Processor -- start 2024-09-15T23:15:07.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.547+0000 7f74a7342640 1 -- start start 2024-09-15T23:15:07.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.548+0000 7f74a7342640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74a00b6970 0x7f74a00cde70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:07.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.548+0000 7f74a7342640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f74a00d23b0 0x7f74a00c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:07.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.548+0000 7f74a7342640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f74a015ed20 0x7f74a01601f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:07.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.548+0000 7f74a7342640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f74a00d32a0 con 0x7f74a00b6970 2024-09-15T23:15:07.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.548+0000 7f74a7342640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f74a00d3e50 con 0x7f74a00d23b0 2024-09-15T23:15:07.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.548+0000 7f74a7342640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f74a015f100 con 0x7f74a015ed20 2024-09-15T23:15:07.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.548+0000 7f74a50de640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74a00b6970 0x7f74a00cde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:07.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.548+0000 7f74a50de640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74a00b6970 0x7f74a00cde70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46620/0 (socket says 172.21.15.123:46620) 2024-09-15T23:15:07.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.548+0000 7f74a50de640 1 -- 172.21.15.123:0/1323123983 learned_addr learned my addr 172.21.15.123:0/1323123983 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:07.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.548+0000 7f74a48dd640 1 --2- 172.21.15.123:0/1323123983 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f74a00d23b0 0x7f74a00c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:07.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.548+0000 7f74a58df640 1 --2- 172.21.15.123:0/1323123983 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f74a015ed20 0x7f74a01601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:07.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.548+0000 7f74a50de640 1 -- 172.21.15.123:0/1323123983 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f74a015ed20 msgr2=0x7f74a01601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:07.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.548+0000 7f74a50de640 1 --2- 172.21.15.123:0/1323123983 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f74a015ed20 0x7f74a01601f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:07.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.548+0000 7f74a50de640 1 -- 172.21.15.123:0/1323123983 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f74a00d23b0 msgr2=0x7f74a00c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:07.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.548+0000 7f74a50de640 1 --2- 172.21.15.123:0/1323123983 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f74a00d23b0 0x7f74a00c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:07.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.548+0000 7f74a50de640 1 -- 172.21.15.123:0/1323123983 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74a00ccdd0 con 0x7f74a00b6970 2024-09-15T23:15:07.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.548+0000 7f74a50de640 1 --2- 172.21.15.123:0/1323123983 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74a00b6970 0x7f74a00cde70 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f749c00c430 tx=0x7f749c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:07.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.548+0000 7f7495ffb640 1 -- 172.21.15.123:0/1323123983 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f749c0074e0 con 0x7f74a00b6970 2024-09-15T23:15:07.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.548+0000 7f7495ffb640 1 -- 172.21.15.123:0/1323123983 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f749c0047e0 con 0x7f74a00b6970 2024-09-15T23:15:07.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.548+0000 7f74a7342640 1 -- 172.21.15.123:0/1323123983 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74a00cd0b0 con 0x7f74a00b6970 2024-09-15T23:15:07.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.548+0000 7f7495ffb640 1 -- 172.21.15.123:0/1323123983 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f749c004bd0 con 0x7f74a00b6970 2024-09-15T23:15:07.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.549+0000 7f74a7342640 1 -- 172.21.15.123:0/1323123983 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74a00cd670 con 0x7f74a00b6970 2024-09-15T23:15:07.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.550+0000 7f74a7342640 1 -- 172.21.15.123:0/1323123983 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74a00d21a0 con 0x7f74a00b6970 2024-09-15T23:15:07.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.550+0000 7f7495ffb640 1 -- 172.21.15.123:0/1323123983 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f749c011070 con 0x7f74a00b6970 2024-09-15T23:15:07.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.551+0000 7f7495ffb640 1 --2- 172.21.15.123:0/1323123983 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f748406c2b0 0x7f748406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:07.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.551+0000 7f7495ffb640 1 -- 172.21.15.123:0/1323123983 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7f749c08b160 con 0x7f74a00b6970 2024-09-15T23:15:07.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.551+0000 7f74a48dd640 1 --2- 172.21.15.123:0/1323123983 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f748406c2b0 0x7f748406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:07.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.551+0000 7f74a48dd640 1 --2- 172.21.15.123:0/1323123983 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f748406c2b0 0x7f748406e770 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7490009560 tx=0x7f7490008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:07.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.555+0000 7f7495ffb640 1 -- 172.21.15.123:0/1323123983 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f74a00d0e70 con 0x7f74a00b6970 2024-09-15T23:15:07.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.721+0000 7f74a7342640 1 -- 172.21.15.123:0/1323123983 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f74a00b7010 con 0x7f74a00b6970 2024-09-15T23:15:07.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.723+0000 7f7495ffb640 1 -- 172.21.15.123:0/1323123983 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+16924 (secure 0 0 0) 0x7f749c00e280 con 0x7f74a00b6970 2024-09-15T23:15:07.724 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:07.724 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":54,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:14:55.295760+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:14:31.528995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-15T23:14:31.891097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.0","mappings":[{"from":5,"to":7}]},{"pgid":"7.6","mappings":[{"from":5,"to":7}]},{"pgid":"7.12","mappings":[{"from":5,"to":7}]},{"pgid":"7.1b","mappings":[{"from":5,"to":7}]},{"pgid":"7.32","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:15:07.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.725+0000 7f74a7342640 1 -- 172.21.15.123:0/1323123983 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f748406c2b0 msgr2=0x7f748406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:07.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.725+0000 7f74a7342640 1 --2- 172.21.15.123:0/1323123983 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f748406c2b0 0x7f748406e770 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7490009560 tx=0x7f7490008040 comp rx=0 tx=0).stop 2024-09-15T23:15:07.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.725+0000 7f74a7342640 1 -- 172.21.15.123:0/1323123983 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74a00b6970 msgr2=0x7f74a00cde70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:07.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.725+0000 7f74a7342640 1 --2- 172.21.15.123:0/1323123983 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74a00b6970 0x7f74a00cde70 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f749c00c430 tx=0x7f749c00c8f0 comp rx=0 tx=0).stop 2024-09-15T23:15:07.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.725+0000 7f74a7342640 1 -- 172.21.15.123:0/1323123983 shutdown_connections 2024-09-15T23:15:07.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.725+0000 7f74a7342640 1 --2- 172.21.15.123:0/1323123983 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f74a015ed20 0x7f74a01601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:07.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.725+0000 7f74a7342640 1 --2- 172.21.15.123:0/1323123983 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f74a00d23b0 0x7f74a00c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:07.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.725+0000 7f74a7342640 1 --2- 172.21.15.123:0/1323123983 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f748406c2b0 0x7f748406e770 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:07.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.725+0000 7f74a7342640 1 --2- 172.21.15.123:0/1323123983 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74a00b6970 0x7f74a00cde70 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:07.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.725+0000 7f74a7342640 1 -- 172.21.15.123:0/1323123983 >> 172.21.15.123:0/1323123983 conn(0x7f74a00d1260 msgr2=0x7f74a0154da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:07.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.725+0000 7f74a7342640 1 -- 172.21.15.123:0/1323123983 shutdown_connections 2024-09-15T23:15:07.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.725+0000 7f74a7342640 1 -- 172.21.15.123:0/1323123983 wait complete. 2024-09-15T23:15:07.737 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T23:15:07.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.836+0000 7fc5e359e640 1 Processor -- start 2024-09-15T23:15:07.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.836+0000 7fc5e359e640 1 -- start start 2024-09-15T23:15:07.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.837+0000 7fc5e359e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5e415c440 0x7fc5e40b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:07.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.837+0000 7fc5e359e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc5e40cf110 0x7fc5e40cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:07.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.837+0000 7fc5e359e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc5e406f2f0 0x7fc5e406f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:07.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.837+0000 7fc5e359e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc5e406fc60 con 0x7fc5e406f2f0 2024-09-15T23:15:07.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.837+0000 7fc5e359e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fc5e40b5db0 con 0x7fc5e40cf110 2024-09-15T23:15:07.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.837+0000 7fc5e359e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc5e40b6090 con 0x7fc5e415c440 2024-09-15T23:15:07.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.837+0000 7fc5e2d9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc5e406f2f0 0x7fc5e406f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:07.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.837+0000 7fc5e2d9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc5e406f2f0 0x7fc5e406f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46636/0 (socket says 172.21.15.123:46636) 2024-09-15T23:15:07.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.837+0000 7fc5e2d9d640 1 -- 172.21.15.123:0/2833519610 learned_addr learned my addr 172.21.15.123:0/2833519610 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:07.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.837+0000 7fc5e259c640 1 --2- 172.21.15.123:0/2833519610 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5e415c440 0x7fc5e40b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:07.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.837+0000 7fc5d9d9b640 1 --2- 172.21.15.123:0/2833519610 >> v2:172.21.15.188:3300/0 conn(0x7fc5e40cf110 0x7fc5e40cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:07.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.837+0000 7fc5e2d9d640 1 -- 172.21.15.123:0/2833519610 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5e415c440 msgr2=0x7fc5e40b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:07.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.837+0000 7fc5e2d9d640 1 --2- 172.21.15.123:0/2833519610 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5e415c440 0x7fc5e40b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:07.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.838+0000 7fc5e2d9d640 1 -- 172.21.15.123:0/2833519610 >> v2:172.21.15.188:3300/0 conn(0x7fc5e40cf110 msgr2=0x7fc5e40cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:07.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.838+0000 7fc5e2d9d640 1 --2- 172.21.15.123:0/2833519610 >> v2:172.21.15.188:3300/0 conn(0x7fc5e40cf110 0x7fc5e40cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:07.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.838+0000 7fc5e2d9d640 1 -- 172.21.15.123:0/2833519610 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5e40b6370 con 0x7fc5e406f2f0 2024-09-15T23:15:07.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.838+0000 7fc5d9d9b640 1 --2- 172.21.15.123:0/2833519610 >> v2:172.21.15.188:3300/0 conn(0x7fc5e40cf110 0x7fc5e40cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:07.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.838+0000 7fc5e2d9d640 1 --2- 172.21.15.123:0/2833519610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5e406f2f0 0x7fc5e406f720 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fc5e40b5fc0 tx=0x7fc5dc02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54a8872535e09ec7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:07.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.838+0000 7fc5e1d9b640 1 -- 172.21.15.123:0/2833519610 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc036070 con 0x7fc5e406f2f0 2024-09-15T23:15:07.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.838+0000 7fc5e1d9b640 1 -- 172.21.15.123:0/2833519610 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5dc031600 con 0x7fc5e406f2f0 2024-09-15T23:15:07.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.838+0000 7fc5e1d9b640 1 -- 172.21.15.123:0/2833519610 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc0319d0 con 0x7fc5e406f2f0 2024-09-15T23:15:07.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.839+0000 7fc5e359e640 1 -- 172.21.15.123:0/2833519610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5e406f2f0 msgr2=0x7fc5e406f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:07.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.839+0000 7fc5e359e640 1 --2- 172.21.15.123:0/2833519610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5e406f2f0 0x7fc5e406f720 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fc5e40b5fc0 tx=0x7fc5dc02a5f0 comp rx=0 tx=0).stop 2024-09-15T23:15:07.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.839+0000 7fc5e359e640 1 -- 172.21.15.123:0/2833519610 shutdown_connections 2024-09-15T23:15:07.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.839+0000 7fc5e359e640 1 --2- 172.21.15.123:0/2833519610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5e406f2f0 0x7fc5e406f720 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:07.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.839+0000 7fc5e359e640 1 --2- 172.21.15.123:0/2833519610 >> v2:172.21.15.188:3300/0 conn(0x7fc5e40cf110 0x7fc5e40cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:07.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.839+0000 7fc5e359e640 1 --2- 172.21.15.123:0/2833519610 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5e415c440 0x7fc5e40b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:07.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.839+0000 7fc5e359e640 1 -- 172.21.15.123:0/2833519610 >> 172.21.15.123:0/2833519610 conn(0x7fc5e40b41b0 msgr2=0x7fc5e40b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:07.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.839+0000 7fc5e359e640 1 -- 172.21.15.123:0/2833519610 shutdown_connections 2024-09-15T23:15:07.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.839+0000 7fc5e359e640 1 -- 172.21.15.123:0/2833519610 wait complete. 2024-09-15T23:15:07.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.840+0000 7fc5e359e640 1 Processor -- start 2024-09-15T23:15:07.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.840+0000 7fc5e359e640 1 -- start start 2024-09-15T23:15:07.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.841+0000 7fc5e359e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5e406f2f0 0x7fc5e4150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:07.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.841+0000 7fc5e359e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5e40cf110 0x7fc5e40c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:07.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.841+0000 7fc5e359e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc5e415c440 0x7fc5e41f5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:07.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.841+0000 7fc5e359e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e40cfc80 con 0x7fc5e406f2f0 2024-09-15T23:15:07.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.841+0000 7fc5e359e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e40d21b0 con 0x7fc5e415c440 2024-09-15T23:15:07.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.841+0000 7fc5e359e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc5e40cfe00 con 0x7fc5e40cf110 2024-09-15T23:15:07.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.841+0000 7fc5e259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5e406f2f0 0x7fc5e4150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:07.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.841+0000 7fc5e259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5e406f2f0 0x7fc5e4150aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46644/0 (socket says 172.21.15.123:46644) 2024-09-15T23:15:07.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.841+0000 7fc5e259c640 1 -- 172.21.15.123:0/1273842061 learned_addr learned my addr 172.21.15.123:0/1273842061 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:07.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.842+0000 7fc5e2d9d640 1 --2- 172.21.15.123:0/1273842061 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc5e415c440 0x7fc5e41f5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:07.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.842+0000 7fc5e259c640 1 -- 172.21.15.123:0/1273842061 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5e40cf110 msgr2=0x7fc5e40c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:07.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.842+0000 7fc5e259c640 1 --2- 172.21.15.123:0/1273842061 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5e40cf110 0x7fc5e40c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:07.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.842+0000 7fc5e259c640 1 -- 172.21.15.123:0/1273842061 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc5e415c440 msgr2=0x7fc5e41f5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:07.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.842+0000 7fc5e259c640 1 --2- 172.21.15.123:0/1273842061 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc5e415c440 0x7fc5e41f5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:07.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.842+0000 7fc5e259c640 1 -- 172.21.15.123:0/1273842061 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5e41f3660 con 0x7fc5e406f2f0 2024-09-15T23:15:07.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.842+0000 7fc5e2d9d640 1 --2- 172.21.15.123:0/1273842061 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc5e415c440 0x7fc5e41f5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:07.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.842+0000 7fc5e259c640 1 --2- 172.21.15.123:0/1273842061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5e406f2f0 0x7fc5e4150aa0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fc5d400e870 tx=0x7fc5d400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:07.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.842+0000 7fc5db7fe640 1 -- 172.21.15.123:0/1273842061 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d4017070 con 0x7fc5e406f2f0 2024-09-15T23:15:07.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.842+0000 7fc5db7fe640 1 -- 172.21.15.123:0/1273842061 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5d400c8e0 con 0x7fc5e406f2f0 2024-09-15T23:15:07.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.842+0000 7fc5e359e640 1 -- 172.21.15.123:0/1273842061 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5e40c8c90 con 0x7fc5e406f2f0 2024-09-15T23:15:07.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.842+0000 7fc5db7fe640 1 -- 172.21.15.123:0/1273842061 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d400ccd0 con 0x7fc5e406f2f0 2024-09-15T23:15:07.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.842+0000 7fc5e359e640 1 -- 172.21.15.123:0/1273842061 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5e41f3bb0 con 0x7fc5e406f2f0 2024-09-15T23:15:07.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.843+0000 7fc5e359e640 1 -- 172.21.15.123:0/1273842061 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5e406f720 con 0x7fc5e406f2f0 2024-09-15T23:15:07.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.843+0000 7fc5db7fe640 1 -- 172.21.15.123:0/1273842061 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc5d401a070 con 0x7fc5e406f2f0 2024-09-15T23:15:07.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.844+0000 7fc5db7fe640 1 --2- 172.21.15.123:0/1273842061 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc5c406c2b0 0x7fc5c406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:07.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.844+0000 7fc5db7fe640 1 -- 172.21.15.123:0/1273842061 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5854+0+0 (secure 0 0 0) 0x7fc5d408b380 con 0x7fc5e406f2f0 2024-09-15T23:15:07.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.844+0000 7fc5d9d9b640 1 --2- 172.21.15.123:0/1273842061 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc5c406c2b0 0x7fc5c406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:07.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.845+0000 7fc5d9d9b640 1 --2- 172.21.15.123:0/1273842061 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc5c406c2b0 0x7fc5c406e770 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc5e415b130 tx=0x7fc5cc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:07.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:07.848+0000 7fc5db7fe640 1 -- 172.21.15.123:0/1273842061 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc5d40599e0 con 0x7fc5e406f2f0 2024-09-15T23:15:07.889 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:15:07.892 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:15:08.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.051+0000 7fc5e359e640 1 -- 172.21.15.123:0/1273842061 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fc5e4157a00 con 0x7fc5e406f2f0 2024-09-15T23:15:08.053 INFO:tasks.ceph.mon.a.smithi123.stderr:2024-09-15T23:15:08.052+0000 7f8a6ccf0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:15:08.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.054+0000 7fc5db7fe640 1 -- 172.21.15.123:0/1273842061 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) ==== 161+0+0 (secure 0 0 0) 0x7fc5d40592e0 con 0x7fc5e406f2f0 2024-09-15T23:15:08.055 INFO:teuthology.orchestra.run.smithi123.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T23:15:08.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.056+0000 7fc5e359e640 1 -- 172.21.15.123:0/1273842061 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc5c406c2b0 msgr2=0x7fc5c406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:08.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.056+0000 7fc5e359e640 1 --2- 172.21.15.123:0/1273842061 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc5c406c2b0 0x7fc5c406e770 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc5e415b130 tx=0x7fc5cc008040 comp rx=0 tx=0).stop 2024-09-15T23:15:08.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.056+0000 7fc5e359e640 1 -- 172.21.15.123:0/1273842061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5e406f2f0 msgr2=0x7fc5e4150aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:08.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.056+0000 7fc5e359e640 1 --2- 172.21.15.123:0/1273842061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5e406f2f0 0x7fc5e4150aa0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fc5d400e870 tx=0x7fc5d400ed30 comp rx=0 tx=0).stop 2024-09-15T23:15:08.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.056+0000 7fc5e359e640 1 -- 172.21.15.123:0/1273842061 shutdown_connections 2024-09-15T23:15:08.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.056+0000 7fc5e359e640 1 --2- 172.21.15.123:0/1273842061 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc5e415c440 0x7fc5e41f5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:08.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.056+0000 7fc5e359e640 1 --2- 172.21.15.123:0/1273842061 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5e40cf110 0x7fc5e40c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:08.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.056+0000 7fc5e359e640 1 --2- 172.21.15.123:0/1273842061 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc5c406c2b0 0x7fc5c406e770 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:08.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.056+0000 7fc5e359e640 1 --2- 172.21.15.123:0/1273842061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5e406f2f0 0x7fc5e4150aa0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:08.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.056+0000 7fc5e359e640 1 -- 172.21.15.123:0/1273842061 >> 172.21.15.123:0/1273842061 conn(0x7fc5e40b41b0 msgr2=0x7fc5e4152d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:08.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.056+0000 7fc5e359e640 1 -- 172.21.15.123:0/1273842061 shutdown_connections 2024-09-15T23:15:08.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.056+0000 7fc5e359e640 1 -- 172.21.15.123:0/1273842061 wait complete. 2024-09-15T23:15:08.069 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T23:15:08.099 INFO:tasks.ceph.mds.d.smithi188.stdout:starting mds.d at 2024-09-15T23:15:08.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.169+0000 7f44fdf13640 1 Processor -- start 2024-09-15T23:15:08.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.169+0000 7f44fdf13640 1 -- start start 2024-09-15T23:15:08.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.170+0000 7f44fdf13640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f44f80ccf30 0x7f44f80b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:08.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.170+0000 7f44fdf13640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44f80cead0 0x7f44f8071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:08.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.170+0000 7f44fdf13640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44f80cf2e0 con 0x7f44f815b7c0 2024-09-15T23:15:08.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.170+0000 7f44fdf13640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f44f8070fe0 con 0x7f44f80ccf30 2024-09-15T23:15:08.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.170+0000 7f44fdf13640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f44f80712c0 con 0x7f44f80cead0 2024-09-15T23:15:08.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.170+0000 7f44f6ffd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f44f815b7c0 0x7f44f80cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60332/0 (socket says 172.21.15.123:60332) 2024-09-15T23:15:08.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.170+0000 7f44f6ffd640 1 -- 172.21.15.123:0/428287514 learned_addr learned my addr 172.21.15.123:0/428287514 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:08.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.170+0000 7f44f77fe640 1 --2- 172.21.15.123:0/428287514 >> v2:172.21.15.188:3300/0 conn(0x7f44f80ccf30 0x7f44f80b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:08.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.170+0000 7f44f7fff640 1 --2- 172.21.15.123:0/428287514 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44f80cead0 0x7f44f8071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:08.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.170+0000 7f44f67fc640 1 -- 172.21.15.123:0/428287514 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3898517297 0 0) 0x7f44f80cf2e0 con 0x7f44f815b7c0 2024-09-15T23:15:08.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.170+0000 7f44f67fc640 1 -- 172.21.15.123:0/428287514 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44e0003520 con 0x7f44f815b7c0 2024-09-15T23:15:08.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.170+0000 7f44f77fe640 1 -- 172.21.15.123:0/428287514 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44f80cead0 msgr2=0x7f44f8071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:08.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.170+0000 7f44f77fe640 1 --2- 172.21.15.123:0/428287514 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44f80cead0 0x7f44f8071ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:08.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.170+0000 7f44f77fe640 1 -- 172.21.15.123:0/428287514 >> v1:172.21.15.123:6789/0 conn(0x7f44f815b7c0 legacy=0x7f44f80cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:08.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.170+0000 7f44f77fe640 1 -- 172.21.15.123:0/428287514 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f80715a0 con 0x7f44f80ccf30 2024-09-15T23:15:08.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.170+0000 7f44f7fff640 1 --2- 172.21.15.123:0/428287514 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44f80cead0 0x7f44f8071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:15:08.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.171+0000 7f44f77fe640 1 --2- 172.21.15.123:0/428287514 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44f80ccf30 0x7f44f80b2c50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f44e80097a0 tx=0x7f44e802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a93207930259243c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:08.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.171+0000 7f44f67fc640 1 -- 172.21.15.123:0/428287514 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e8037070 con 0x7f44f80ccf30 2024-09-15T23:15:08.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.171+0000 7f44f67fc640 1 -- 172.21.15.123:0/428287514 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44e802ae50 con 0x7f44f80ccf30 2024-09-15T23:15:08.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.171+0000 7f44f67fc640 1 -- 172.21.15.123:0/428287514 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e8032640 con 0x7f44f80ccf30 2024-09-15T23:15:08.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.172+0000 7f44fdf13640 1 -- 172.21.15.123:0/428287514 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44f80ccf30 msgr2=0x7f44f80b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:08.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.172+0000 7f44fdf13640 1 --2- 172.21.15.123:0/428287514 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44f80ccf30 0x7f44f80b2c50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f44e80097a0 tx=0x7f44e802a100 comp rx=0 tx=0).stop 2024-09-15T23:15:08.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.172+0000 7f44fdf13640 1 -- 172.21.15.123:0/428287514 shutdown_connections 2024-09-15T23:15:08.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.172+0000 7f44fdf13640 1 --2- 172.21.15.123:0/428287514 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44f80cead0 0x7f44f8071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:08.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.172+0000 7f44fdf13640 1 --2- 172.21.15.123:0/428287514 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44f80ccf30 0x7f44f80b2c50 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:08.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.172+0000 7f44fdf13640 1 -- 172.21.15.123:0/428287514 >> 172.21.15.123:0/428287514 conn(0x7f44f806d0f0 msgr2=0x7f44f806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:08.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.172+0000 7f44fdf13640 1 -- 172.21.15.123:0/428287514 shutdown_connections 2024-09-15T23:15:08.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.172+0000 7f44fdf13640 1 -- 172.21.15.123:0/428287514 wait complete. 2024-09-15T23:15:08.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.173+0000 7f44fdf13640 1 Processor -- start 2024-09-15T23:15:08.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.173+0000 7f44fdf13640 1 -- start start 2024-09-15T23:15:08.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.174+0000 7f44fdf13640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44f80ccf30 0x7f44f8152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:08.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.174+0000 7f44fdf13640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44f80cead0 0x7f44f81582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:08.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.174+0000 7f44fdf13640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44f815b7c0 0x7f44f814fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:08.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.174+0000 7f44fdf13640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f44f80cf0c0 con 0x7f44f80cead0 2024-09-15T23:15:08.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.174+0000 7f44fdf13640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f44f80cef40 con 0x7f44f815b7c0 2024-09-15T23:15:08.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.174+0000 7f44fdf13640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f44f8072000 con 0x7f44f80ccf30 2024-09-15T23:15:08.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.174+0000 7f44f6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44f80cead0 0x7f44f81582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:08.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.174+0000 7f44f6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44f80cead0 0x7f44f81582d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46646/0 (socket says 172.21.15.123:46646) 2024-09-15T23:15:08.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.174+0000 7f44f6ffd640 1 -- 172.21.15.123:0/2291282871 learned_addr learned my addr 172.21.15.123:0/2291282871 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:08.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.174+0000 7f44f77fe640 1 --2- 172.21.15.123:0/2291282871 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44f80ccf30 0x7f44f8152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:08.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.174+0000 7f44f7fff640 1 --2- 172.21.15.123:0/2291282871 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44f815b7c0 0x7f44f814fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:08.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.174+0000 7f44f6ffd640 1 -- 172.21.15.123:0/2291282871 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44f80ccf30 msgr2=0x7f44f8152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:08.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.174+0000 7f44f6ffd640 1 --2- 172.21.15.123:0/2291282871 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44f80ccf30 0x7f44f8152e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:08.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.174+0000 7f44f6ffd640 1 -- 172.21.15.123:0/2291282871 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44f815b7c0 msgr2=0x7f44f814fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:08.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.174+0000 7f44f6ffd640 1 --2- 172.21.15.123:0/2291282871 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44f815b7c0 0x7f44f814fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:08.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.174+0000 7f44f6ffd640 1 -- 172.21.15.123:0/2291282871 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f8153680 con 0x7f44f80cead0 2024-09-15T23:15:08.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.174+0000 7f44f6ffd640 1 --2- 172.21.15.123:0/2291282871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44f80cead0 0x7f44f81582d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f44ec00c3c0 tx=0x7f44ec00c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:08.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.175+0000 7f44dffff640 1 -- 172.21.15.123:0/2291282871 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ec017070 con 0x7f44f80cead0 2024-09-15T23:15:08.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.175+0000 7f44dffff640 1 -- 172.21.15.123:0/2291282871 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44ec005ce0 con 0x7f44f80cead0 2024-09-15T23:15:08.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.175+0000 7f44dffff640 1 -- 172.21.15.123:0/2291282871 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ec0072d0 con 0x7f44f80cead0 2024-09-15T23:15:08.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.175+0000 7f44fdf13640 1 -- 172.21.15.123:0/2291282871 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44f8153960 con 0x7f44f80cead0 2024-09-15T23:15:08.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.175+0000 7f44fdf13640 1 -- 172.21.15.123:0/2291282871 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44f8153390 con 0x7f44f80cead0 2024-09-15T23:15:08.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.176+0000 7f44fdf13640 1 -- 172.21.15.123:0/2291282871 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44f8071ac0 con 0x7f44f80cead0 2024-09-15T23:15:08.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.176+0000 7f44dffff640 1 -- 172.21.15.123:0/2291282871 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f44ec01a070 con 0x7f44f80cead0 2024-09-15T23:15:08.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.176+0000 7f44dffff640 1 --2- 172.21.15.123:0/2291282871 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f44e406c2b0 0x7f44e406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:08.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.177+0000 7f44dffff640 1 -- 172.21.15.123:0/2291282871 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5940+0+0 (secure 0 0 0) 0x7f44ec08a820 con 0x7f44f80cead0 2024-09-15T23:15:08.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.177+0000 7f44f77fe640 1 --2- 172.21.15.123:0/2291282871 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f44e406c2b0 0x7f44e406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:08.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.177+0000 7f44f77fe640 1 --2- 172.21.15.123:0/2291282871 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f44e406c2b0 0x7f44e406e770 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f44e8034000 tx=0x7f44e802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:08.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.181+0000 7f44dffff640 1 -- 172.21.15.123:0/2291282871 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f44ec058850 con 0x7f44f80cead0 2024-09-15T23:15:08.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:08.380+0000 7f44fdf13640 1 -- 172.21.15.123:0/2291282871 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f44f80cc960 con 0x7f44f80cead0 2024-09-15T23:15:09.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.055+0000 7f44dffff640 1 -- 172.21.15.123:0/2291282871 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v25) ==== 104+0+0 (secure 0 0 0) 0x7f44ec05cb50 con 0x7f44f80cead0 2024-09-15T23:15:09.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.058+0000 7f44fdf13640 1 -- 172.21.15.123:0/2291282871 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f44e406c2b0 msgr2=0x7f44e406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:09.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.058+0000 7f44fdf13640 1 --2- 172.21.15.123:0/2291282871 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f44e406c2b0 0x7f44e406e770 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f44e8034000 tx=0x7f44e802e000 comp rx=0 tx=0).stop 2024-09-15T23:15:09.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.058+0000 7f44fdf13640 1 -- 172.21.15.123:0/2291282871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44f80cead0 msgr2=0x7f44f81582d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:09.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.058+0000 7f44fdf13640 1 --2- 172.21.15.123:0/2291282871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44f80cead0 0x7f44f81582d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f44ec00c3c0 tx=0x7f44ec00c7c0 comp rx=0 tx=0).stop 2024-09-15T23:15:09.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.058+0000 7f44fdf13640 1 -- 172.21.15.123:0/2291282871 shutdown_connections 2024-09-15T23:15:09.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.058+0000 7f44fdf13640 1 --2- 172.21.15.123:0/2291282871 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44f815b7c0 0x7f44f814fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:09.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.058+0000 7f44fdf13640 1 --2- 172.21.15.123:0/2291282871 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f44e406c2b0 0x7f44e406e770 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:09.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.058+0000 7f44fdf13640 1 --2- 172.21.15.123:0/2291282871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44f80cead0 0x7f44f81582d0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:09.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.058+0000 7f44fdf13640 1 --2- 172.21.15.123:0/2291282871 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44f80ccf30 0x7f44f8152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:09.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.058+0000 7f44fdf13640 1 -- 172.21.15.123:0/2291282871 >> 172.21.15.123:0/2291282871 conn(0x7f44f806d0f0 msgr2=0x7f44f80b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:09.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.058+0000 7f44fdf13640 1 -- 172.21.15.123:0/2291282871 shutdown_connections 2024-09-15T23:15:09.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.058+0000 7f44fdf13640 1 -- 172.21.15.123:0/2291282871 wait complete. 2024-09-15T23:15:09.072 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T23:15:09.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.176+0000 7f885fb81640 1 Processor -- start 2024-09-15T23:15:09.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.176+0000 7f885fb81640 1 -- start start 2024-09-15T23:15:09.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.176+0000 7f885fb81640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f88580d16e0 0x7f88580d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:09.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.176+0000 7f885fb81640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f88580d40b0 0x7f88580b7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:09.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.176+0000 7f885fb81640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88580cf060 con 0x7f885815ea90 2024-09-15T23:15:09.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.177+0000 7f885fb81640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f88580d34c0 con 0x7f88580d40b0 2024-09-15T23:15:09.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.177+0000 7f885fb81640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f88580cf340 con 0x7f88580d16e0 2024-09-15T23:15:09.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.177+0000 7f885e11e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f88580d40b0 0x7f88580b7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:09.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.177+0000 7f885e11e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f88580d40b0 0x7f88580b7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46656/0 (socket says 172.21.15.123:46656) 2024-09-15T23:15:09.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.177+0000 7f885e11e640 1 -- 172.21.15.123:0/2911706779 learned_addr learned my addr 172.21.15.123:0/2911706779 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:09.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.177+0000 7f885d11c640 1 --2- 172.21.15.123:0/2911706779 >> v2:172.21.15.188:3300/0 conn(0x7f88580d16e0 0x7f88580d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:09.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.177+0000 7f885e11e640 1 -- 172.21.15.123:0/2911706779 >> v2:172.21.15.188:3300/0 conn(0x7f88580d16e0 msgr2=0x7f88580d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:09.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.177+0000 7f885e11e640 1 --2- 172.21.15.123:0/2911706779 >> v2:172.21.15.188:3300/0 conn(0x7f88580d16e0 0x7f88580d2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:09.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.177+0000 7f885e11e640 1 -- 172.21.15.123:0/2911706779 >> v1:172.21.15.188:6789/0 conn(0x7f885815ea90 legacy=0x7f88580d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:09.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.177+0000 7f885e11e640 1 -- 172.21.15.123:0/2911706779 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88580cf620 con 0x7f88580d40b0 2024-09-15T23:15:09.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.178+0000 7f885e11e640 1 --2- 172.21.15.123:0/2911706779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88580d40b0 0x7f88580b7ac0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f88580c8290 tx=0x7f885002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990699a79c8bcb13 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:09.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.178+0000 7f885c91b640 1 -- 172.21.15.123:0/2911706779 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8850036070 con 0x7f88580d40b0 2024-09-15T23:15:09.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.178+0000 7f885c91b640 1 -- 172.21.15.123:0/2911706779 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8850031600 con 0x7f88580d40b0 2024-09-15T23:15:09.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.178+0000 7f885c91b640 1 -- 172.21.15.123:0/2911706779 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88500319d0 con 0x7f88580d40b0 2024-09-15T23:15:09.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.178+0000 7f885fb81640 1 -- 172.21.15.123:0/2911706779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88580d40b0 msgr2=0x7f88580b7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:09.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.178+0000 7f885fb81640 1 --2- 172.21.15.123:0/2911706779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88580d40b0 0x7f88580b7ac0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f88580c8290 tx=0x7f885002a660 comp rx=0 tx=0).stop 2024-09-15T23:15:09.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.179+0000 7f885fb81640 1 -- 172.21.15.123:0/2911706779 shutdown_connections 2024-09-15T23:15:09.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.179+0000 7f885fb81640 1 --2- 172.21.15.123:0/2911706779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88580d40b0 0x7f88580b7ac0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:09.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.179+0000 7f885fb81640 1 --2- 172.21.15.123:0/2911706779 >> v2:172.21.15.188:3300/0 conn(0x7f88580d16e0 0x7f88580d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:09.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.179+0000 7f885fb81640 1 -- 172.21.15.123:0/2911706779 >> 172.21.15.123:0/2911706779 conn(0x7f885806c0e0 msgr2=0x7f885806c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:09.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.179+0000 7f885fb81640 1 -- 172.21.15.123:0/2911706779 shutdown_connections 2024-09-15T23:15:09.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.179+0000 7f885fb81640 1 -- 172.21.15.123:0/2911706779 wait complete. 2024-09-15T23:15:09.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.180+0000 7f885fb81640 1 Processor -- start 2024-09-15T23:15:09.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.180+0000 7f885fb81640 1 -- start start 2024-09-15T23:15:09.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.180+0000 7f885fb81640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88580d16e0 0x7f88580b6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:09.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.180+0000 7f885fb81640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88580d40b0 0x7f8858154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:09.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.180+0000 7f885fb81640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f885815ea90 0x7f8858154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:09.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.180+0000 7f885fb81640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f885815ee70 con 0x7f88580d40b0 2024-09-15T23:15:09.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.180+0000 7f885fb81640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f88580cfbe0 con 0x7f88580d16e0 2024-09-15T23:15:09.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.180+0000 7f885fb81640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f88580b8000 con 0x7f885815ea90 2024-09-15T23:15:09.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.181+0000 7f885d11c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88580d40b0 0x7f8858154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:09.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.181+0000 7f885d11c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88580d40b0 0x7f8858154a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46660/0 (socket says 172.21.15.123:46660) 2024-09-15T23:15:09.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.181+0000 7f885d11c640 1 -- 172.21.15.123:0/1180423613 learned_addr learned my addr 172.21.15.123:0/1180423613 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:09.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.181+0000 7f885d91d640 1 --2- 172.21.15.123:0/1180423613 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88580d16e0 0x7f88580b6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:09.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.181+0000 7f885e11e640 1 --2- 172.21.15.123:0/1180423613 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f885815ea90 0x7f8858154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:09.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.181+0000 7f885d11c640 1 -- 172.21.15.123:0/1180423613 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f885815ea90 msgr2=0x7f8858154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:09.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.181+0000 7f885d11c640 1 --2- 172.21.15.123:0/1180423613 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f885815ea90 0x7f8858154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:09.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.181+0000 7f885d11c640 1 -- 172.21.15.123:0/1180423613 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88580d16e0 msgr2=0x7f88580b6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:09.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.181+0000 7f885d11c640 1 --2- 172.21.15.123:0/1180423613 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88580d16e0 0x7f88580b6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:09.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.181+0000 7f885d11c640 1 -- 172.21.15.123:0/1180423613 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88581f6090 con 0x7f88580d40b0 2024-09-15T23:15:09.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.181+0000 7f885e11e640 1 --2- 172.21.15.123:0/1180423613 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f885815ea90 0x7f8858154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:09.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.181+0000 7f885d91d640 1 --2- 172.21.15.123:0/1180423613 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88580d16e0 0x7f88580b6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:09.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.181+0000 7f885d11c640 1 --2- 172.21.15.123:0/1180423613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88580d40b0 0x7f8858154a30 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f884800c7f0 tx=0x7f884800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:09.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.181+0000 7f884e7fc640 1 -- 172.21.15.123:0/1180423613 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8848015070 con 0x7f88580d40b0 2024-09-15T23:15:09.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.181+0000 7f884e7fc640 1 -- 172.21.15.123:0/1180423613 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8848004220 con 0x7f88580d40b0 2024-09-15T23:15:09.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.181+0000 7f885fb81640 1 -- 172.21.15.123:0/1180423613 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88580cb860 con 0x7f88580d40b0 2024-09-15T23:15:09.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.181+0000 7f884e7fc640 1 -- 172.21.15.123:0/1180423613 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8848007620 con 0x7f88580d40b0 2024-09-15T23:15:09.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.181+0000 7f885fb81640 1 -- 172.21.15.123:0/1180423613 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88580cc100 con 0x7f88580d40b0 2024-09-15T23:15:09.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.182+0000 7f885fb81640 1 -- 172.21.15.123:0/1180423613 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88580d2f80 con 0x7f88580d40b0 2024-09-15T23:15:09.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.183+0000 7f884e7fc640 1 -- 172.21.15.123:0/1180423613 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f88480079d0 con 0x7f88580d40b0 2024-09-15T23:15:09.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.183+0000 7f884e7fc640 1 --2- 172.21.15.123:0/1180423613 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f883c06c2b0 0x7f883c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:09.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.183+0000 7f884e7fc640 1 -- 172.21.15.123:0/1180423613 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5940+0+0 (secure 0 0 0) 0x7f884808b8c0 con 0x7f88580d40b0 2024-09-15T23:15:09.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.183+0000 7f885d91d640 1 --2- 172.21.15.123:0/1180423613 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f883c06c2b0 0x7f883c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:09.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.184+0000 7f885d91d640 1 --2- 172.21.15.123:0/1180423613 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f883c06c2b0 0x7f883c06e770 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f885400a830 tx=0x7f8854008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:09.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.187+0000 7f884e7fc640 1 -- 172.21.15.123:0/1180423613 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8848059fd0 con 0x7f88580d40b0 2024-09-15T23:15:09.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:09.354+0000 7f885fb81640 1 -- 172.21.15.123:0/1180423613 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f88580c9980 con 0x7f88580d40b0 2024-09-15T23:15:10.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.357+0000 7f884e7fc640 1 -- 172.21.15.123:0/1180423613 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v56) ==== 181+0+0 (secure 0 0 0) 0x7f88480598d0 con 0x7f88580d40b0 2024-09-15T23:15:10.358 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' removed 2024-09-15T23:15:10.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.360+0000 7f885fb81640 1 -- 172.21.15.123:0/1180423613 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f883c06c2b0 msgr2=0x7f883c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:10.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.360+0000 7f885fb81640 1 --2- 172.21.15.123:0/1180423613 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f883c06c2b0 0x7f883c06e770 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f885400a830 tx=0x7f8854008040 comp rx=0 tx=0).stop 2024-09-15T23:15:10.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.360+0000 7f885fb81640 1 -- 172.21.15.123:0/1180423613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88580d40b0 msgr2=0x7f8858154a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:10.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.360+0000 7f885fb81640 1 --2- 172.21.15.123:0/1180423613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88580d40b0 0x7f8858154a30 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f884800c7f0 tx=0x7f884800ccb0 comp rx=0 tx=0).stop 2024-09-15T23:15:10.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.361+0000 7f885fb81640 1 -- 172.21.15.123:0/1180423613 shutdown_connections 2024-09-15T23:15:10.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.361+0000 7f885fb81640 1 --2- 172.21.15.123:0/1180423613 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f885815ea90 0x7f8858154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:10.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.361+0000 7f885fb81640 1 --2- 172.21.15.123:0/1180423613 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f883c06c2b0 0x7f883c06e770 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:10.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.361+0000 7f885fb81640 1 --2- 172.21.15.123:0/1180423613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88580d40b0 0x7f8858154a30 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:10.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.361+0000 7f885fb81640 1 --2- 172.21.15.123:0/1180423613 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88580d16e0 0x7f88580b6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:10.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.361+0000 7f885fb81640 1 -- 172.21.15.123:0/1180423613 >> 172.21.15.123:0/1180423613 conn(0x7f885806c0e0 msgr2=0x7f88580c9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:10.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.361+0000 7f885fb81640 1 -- 172.21.15.123:0/1180423613 shutdown_connections 2024-09-15T23:15:10.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.361+0000 7f885fb81640 1 -- 172.21.15.123:0/1180423613 wait complete. 2024-09-15T23:15:10.378 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T23:15:10.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.486+0000 7fc093103640 1 Processor -- start 2024-09-15T23:15:10.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.486+0000 7fc093103640 1 -- start start 2024-09-15T23:15:10.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.486+0000 7fc093103640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc08c0d16e0 0x7fc08c0d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:10.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.486+0000 7fc093103640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc08c0d40b0 0x7fc08c0b7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:10.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.486+0000 7fc093103640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc08c0cf060 con 0x7fc08c15ea90 2024-09-15T23:15:10.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.486+0000 7fc093103640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc08c0d34c0 con 0x7fc08c0d16e0 2024-09-15T23:15:10.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.486+0000 7fc093103640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fc08c0cf340 con 0x7fc08c0d40b0 2024-09-15T23:15:10.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.487+0000 7fc083fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc08c0d16e0 0x7fc08c0d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:10.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.487+0000 7fc090e9f640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc08c15ea90 0x7fc08c0d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60338/0 (socket says 172.21.15.123:60338) 2024-09-15T23:15:10.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.487+0000 7fc090e9f640 1 -- 172.21.15.123:0/3890091029 learned_addr learned my addr 172.21.15.123:0/3890091029 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:10.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.487+0000 7fc083fff640 1 -- 172.21.15.123:0/3890091029 >> v2:172.21.15.188:3300/0 conn(0x7fc08c0d40b0 msgr2=0x7fc08c0b7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:10.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.487+0000 7fc0837fe640 1 -- 172.21.15.123:0/3890091029 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2339289092 0 0) 0x7fc08c0cf060 con 0x7fc08c15ea90 2024-09-15T23:15:10.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.487+0000 7fc0916a0640 1 --2- 172.21.15.123:0/3890091029 >> v2:172.21.15.188:3300/0 conn(0x7fc08c0d40b0 0x7fc08c0b7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:10.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.487+0000 7fc083fff640 1 --2- 172.21.15.123:0/3890091029 >> v2:172.21.15.188:3300/0 conn(0x7fc08c0d40b0 0x7fc08c0b7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:10.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.487+0000 7fc083fff640 1 -- 172.21.15.123:0/3890091029 >> v1:172.21.15.123:6789/0 conn(0x7fc08c15ea90 legacy=0x7fc08c0d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:10.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.487+0000 7fc083fff640 1 -- 172.21.15.123:0/3890091029 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc08c0cf620 con 0x7fc08c0d16e0 2024-09-15T23:15:10.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.487+0000 7fc0916a0640 1 --2- 172.21.15.123:0/3890091029 >> v2:172.21.15.188:3300/0 conn(0x7fc08c0d40b0 0x7fc08c0b7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:10.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.488+0000 7fc083fff640 1 --2- 172.21.15.123:0/3890091029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc08c0d16e0 0x7fc08c0d2f80 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fc08c0d0c10 tx=0x7fc07c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ede62b358d2025 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:10.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.488+0000 7fc0837fe640 1 -- 172.21.15.123:0/3890091029 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07c037070 con 0x7fc08c0d16e0 2024-09-15T23:15:10.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.488+0000 7fc0837fe640 1 -- 172.21.15.123:0/3890091029 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc07c032440 con 0x7fc08c0d16e0 2024-09-15T23:15:10.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.488+0000 7fc0837fe640 1 -- 172.21.15.123:0/3890091029 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07c02ae60 con 0x7fc08c0d16e0 2024-09-15T23:15:10.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.488+0000 7fc093103640 1 -- 172.21.15.123:0/3890091029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc08c0d16e0 msgr2=0x7fc08c0d2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:10.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.488+0000 7fc093103640 1 --2- 172.21.15.123:0/3890091029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc08c0d16e0 0x7fc08c0d2f80 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fc08c0d0c10 tx=0x7fc07c02a110 comp rx=0 tx=0).stop 2024-09-15T23:15:10.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.488+0000 7fc093103640 1 -- 172.21.15.123:0/3890091029 shutdown_connections 2024-09-15T23:15:10.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.488+0000 7fc093103640 1 --2- 172.21.15.123:0/3890091029 >> v2:172.21.15.188:3300/0 conn(0x7fc08c0d40b0 0x7fc08c0b7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:10.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.488+0000 7fc093103640 1 --2- 172.21.15.123:0/3890091029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc08c0d16e0 0x7fc08c0d2f80 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:10.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.488+0000 7fc093103640 1 -- 172.21.15.123:0/3890091029 >> 172.21.15.123:0/3890091029 conn(0x7fc08c06c0e0 msgr2=0x7fc08c06c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:10.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.488+0000 7fc093103640 1 -- 172.21.15.123:0/3890091029 shutdown_connections 2024-09-15T23:15:10.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.488+0000 7fc093103640 1 -- 172.21.15.123:0/3890091029 wait complete. 2024-09-15T23:15:10.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.490+0000 7fc093103640 1 Processor -- start 2024-09-15T23:15:10.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.490+0000 7fc093103640 1 -- start start 2024-09-15T23:15:10.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.490+0000 7fc093103640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc08c0d16e0 0x7fc08c159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:10.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.490+0000 7fc093103640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc08c0d40b0 0x7fc08c15b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:10.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.491+0000 7fc093103640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc08c15ea90 0x7fc08c15b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:10.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.491+0000 7fc093103640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc08c15ee70 con 0x7fc08c0d40b0 2024-09-15T23:15:10.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.491+0000 7fc093103640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc08c0cfbe0 con 0x7fc08c15ea90 2024-09-15T23:15:10.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.491+0000 7fc093103640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc08c0b8000 con 0x7fc08c0d16e0 2024-09-15T23:15:10.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.491+0000 7fc083fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc08c0d40b0 0x7fc08c15b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:10.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.491+0000 7fc083fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc08c0d40b0 0x7fc08c15b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46672/0 (socket says 172.21.15.123:46672) 2024-09-15T23:15:10.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.491+0000 7fc083fff640 1 -- 172.21.15.123:0/2246946707 learned_addr learned my addr 172.21.15.123:0/2246946707 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:10.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.491+0000 7fc090e9f640 1 --2- 172.21.15.123:0/2246946707 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc08c0d16e0 0x7fc08c159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:10.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.491+0000 7fc0916a0640 1 --2- 172.21.15.123:0/2246946707 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc08c15ea90 0x7fc08c15b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:10.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.491+0000 7fc083fff640 1 -- 172.21.15.123:0/2246946707 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc08c0d16e0 msgr2=0x7fc08c159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:10.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.491+0000 7fc083fff640 1 --2- 172.21.15.123:0/2246946707 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc08c0d16e0 0x7fc08c159230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:10.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.491+0000 7fc083fff640 1 -- 172.21.15.123:0/2246946707 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc08c15ea90 msgr2=0x7fc08c15b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:10.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.491+0000 7fc083fff640 1 --2- 172.21.15.123:0/2246946707 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc08c15ea90 0x7fc08c15b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:10.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.491+0000 7fc083fff640 1 -- 172.21.15.123:0/2246946707 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc08c0b4320 con 0x7fc08c0d40b0 2024-09-15T23:15:10.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.491+0000 7fc083fff640 1 --2- 172.21.15.123:0/2246946707 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc08c0d40b0 0x7fc08c15b0f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fc07c000c00 tx=0x7fc07c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:10.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.491+0000 7fc0817fa640 1 -- 172.21.15.123:0/2246946707 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07c037050 con 0x7fc08c0d40b0 2024-09-15T23:15:10.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.491+0000 7fc0817fa640 1 -- 172.21.15.123:0/2246946707 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc07c038040 con 0x7fc08c0d40b0 2024-09-15T23:15:10.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.491+0000 7fc0817fa640 1 -- 172.21.15.123:0/2246946707 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07c004450 con 0x7fc08c0d40b0 2024-09-15T23:15:10.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.491+0000 7fc093103640 1 -- 172.21.15.123:0/2246946707 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc08c0b4600 con 0x7fc08c0d40b0 2024-09-15T23:15:10.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.491+0000 7fc093103640 1 -- 172.21.15.123:0/2246946707 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc08c0b4bc0 con 0x7fc08c0d40b0 2024-09-15T23:15:10.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.492+0000 7fc093103640 1 -- 172.21.15.123:0/2246946707 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc08c0d2f80 con 0x7fc08c0d40b0 2024-09-15T23:15:10.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.493+0000 7fc0817fa640 1 -- 172.21.15.123:0/2246946707 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc07c030980 con 0x7fc08c0d40b0 2024-09-15T23:15:10.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.493+0000 7fc0817fa640 1 --2- 172.21.15.123:0/2246946707 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc07806c2b0 0x7fc07806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:10.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.494+0000 7fc0817fa640 1 -- 172.21.15.123:0/2246946707 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5502+0+0 (secure 0 0 0) 0x7fc07c0abfa0 con 0x7fc08c0d40b0 2024-09-15T23:15:10.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.494+0000 7fc090e9f640 1 --2- 172.21.15.123:0/2246946707 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc07806c2b0 0x7fc07806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:10.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.494+0000 7fc090e9f640 1 --2- 172.21.15.123:0/2246946707 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc07806c2b0 0x7fc07806e770 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc088000f60 tx=0x7fc088007c00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:10.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.498+0000 7fc0817fa640 1 -- 172.21.15.123:0/2246946707 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc07c07a990 con 0x7fc08c0d40b0 2024-09-15T23:15:10.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:10.664+0000 7fc093103640 1 -- 172.21.15.123:0/2246946707 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc08c0cac90 con 0x7fc08c0d40b0 2024-09-15T23:15:11.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.364+0000 7fc0817fa640 1 -- 172.21.15.123:0/2246946707 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v57) ==== 169+0+0 (secure 0 0 0) 0x7fc07c07a290 con 0x7fc08c0d40b0 2024-09-15T23:15:11.366 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' removed 2024-09-15T23:15:11.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.368+0000 7fc093103640 1 -- 172.21.15.123:0/2246946707 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc07806c2b0 msgr2=0x7fc07806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:11.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.368+0000 7fc093103640 1 --2- 172.21.15.123:0/2246946707 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc07806c2b0 0x7fc07806e770 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc088000f60 tx=0x7fc088007c00 comp rx=0 tx=0).stop 2024-09-15T23:15:11.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.368+0000 7fc093103640 1 -- 172.21.15.123:0/2246946707 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc08c0d40b0 msgr2=0x7fc08c15b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:11.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.368+0000 7fc093103640 1 --2- 172.21.15.123:0/2246946707 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc08c0d40b0 0x7fc08c15b0f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fc07c000c00 tx=0x7fc07c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:15:11.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.368+0000 7fc093103640 1 -- 172.21.15.123:0/2246946707 shutdown_connections 2024-09-15T23:15:11.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.368+0000 7fc093103640 1 --2- 172.21.15.123:0/2246946707 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc08c15ea90 0x7fc08c15b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:11.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.368+0000 7fc093103640 1 --2- 172.21.15.123:0/2246946707 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc07806c2b0 0x7fc07806e770 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:11.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.368+0000 7fc093103640 1 --2- 172.21.15.123:0/2246946707 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc08c0d40b0 0x7fc08c15b0f0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:11.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.368+0000 7fc093103640 1 --2- 172.21.15.123:0/2246946707 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc08c0d16e0 0x7fc08c159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:11.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.368+0000 7fc093103640 1 -- 172.21.15.123:0/2246946707 >> 172.21.15.123:0/2246946707 conn(0x7fc08c06c0e0 msgr2=0x7fc08c0d37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:11.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.369+0000 7fc093103640 1 -- 172.21.15.123:0/2246946707 shutdown_connections 2024-09-15T23:15:11.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.369+0000 7fc093103640 1 -- 172.21.15.123:0/2246946707 wait complete. 2024-09-15T23:15:11.393 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T23:15:11.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.498+0000 7fce63ee4640 1 Processor -- start 2024-09-15T23:15:11.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.498+0000 7fce63ee4640 1 -- start start 2024-09-15T23:15:11.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.499+0000 7fce63ee4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fce5c072ad0 0x7fce5c0b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:11.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.499+0000 7fce63ee4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce5c0cf2e0 con 0x7fce5c0ccf30 2024-09-15T23:15:11.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.499+0000 7fce63ee4640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce5c070fe0 con 0x7fce5c15b7c0 2024-09-15T23:15:11.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.499+0000 7fce63ee4640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fce5c0712c0 con 0x7fce5c072ad0 2024-09-15T23:15:11.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.499+0000 7fce62481640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fce5c072ad0 0x7fce5c0b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:11.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.499+0000 7fce62481640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fce5c072ad0 0x7fce5c0b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46680/0 (socket says 172.21.15.123:46680) 2024-09-15T23:15:11.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.499+0000 7fce62481640 1 -- 172.21.15.123:0/4072102680 learned_addr learned my addr 172.21.15.123:0/4072102680 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:11.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.499+0000 7fce61c80640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fce5c0ccf30 0x7fce5c0cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60346/0 (socket says 172.21.15.123:60346) 2024-09-15T23:15:11.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.499+0000 7fce62481640 1 -- 172.21.15.123:0/4072102680 >> v1:172.21.15.188:6789/0 conn(0x7fce5c15b7c0 legacy=0x7fce5c0cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:11.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.499+0000 7fce62481640 1 -- 172.21.15.123:0/4072102680 >> v1:172.21.15.123:6789/0 conn(0x7fce5c0ccf30 legacy=0x7fce5c0cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:11.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.499+0000 7fce62481640 1 -- 172.21.15.123:0/4072102680 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce5c0715a0 con 0x7fce5c072ad0 2024-09-15T23:15:11.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.499+0000 7fce60c7e640 1 -- 172.21.15.123:0/4072102680 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4173814259 0 0) 0x7fce5c0cf2e0 con 0x7fce5c0ccf30 2024-09-15T23:15:11.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.500+0000 7fce62481640 1 --2- 172.21.15.123:0/4072102680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce5c072ad0 0x7fce5c0b2c50 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fce54009e50 tx=0x7fce5402a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e97b248381565f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:11.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.500+0000 7fce60c7e640 1 -- 172.21.15.123:0/4072102680 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce54036070 con 0x7fce5c072ad0 2024-09-15T23:15:11.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.500+0000 7fce60c7e640 1 -- 172.21.15.123:0/4072102680 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce54031600 con 0x7fce5c072ad0 2024-09-15T23:15:11.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.500+0000 7fce60c7e640 1 -- 172.21.15.123:0/4072102680 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce540319d0 con 0x7fce5c072ad0 2024-09-15T23:15:11.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.501+0000 7fce63ee4640 1 -- 172.21.15.123:0/4072102680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce5c072ad0 msgr2=0x7fce5c0b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:11.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.501+0000 7fce63ee4640 1 --2- 172.21.15.123:0/4072102680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce5c072ad0 0x7fce5c0b2c50 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fce54009e50 tx=0x7fce5402a6d0 comp rx=0 tx=0).stop 2024-09-15T23:15:11.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.501+0000 7fce63ee4640 1 -- 172.21.15.123:0/4072102680 shutdown_connections 2024-09-15T23:15:11.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.501+0000 7fce63ee4640 1 --2- 172.21.15.123:0/4072102680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce5c072ad0 0x7fce5c0b2c50 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:11.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.501+0000 7fce63ee4640 1 -- 172.21.15.123:0/4072102680 >> 172.21.15.123:0/4072102680 conn(0x7fce5c06d0f0 msgr2=0x7fce5c06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:11.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.501+0000 7fce63ee4640 1 -- 172.21.15.123:0/4072102680 shutdown_connections 2024-09-15T23:15:11.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.501+0000 7fce63ee4640 1 -- 172.21.15.123:0/4072102680 wait complete. 2024-09-15T23:15:11.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.502+0000 7fce63ee4640 1 Processor -- start 2024-09-15T23:15:11.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.502+0000 7fce63ee4640 1 -- start start 2024-09-15T23:15:11.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.503+0000 7fce63ee4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce5c072ad0 0x7fce5c1515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:11.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.503+0000 7fce63ee4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fce5c0ccf30 0x7fce5c14e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:11.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.503+0000 7fce63ee4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fce5c15b7c0 0x7fce5c14e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:11.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.503+0000 7fce63ee4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fce5c166430 con 0x7fce5c072ad0 2024-09-15T23:15:11.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.503+0000 7fce63ee4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fce5c1662b0 con 0x7fce5c0ccf30 2024-09-15T23:15:11.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.503+0000 7fce63ee4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fce5c1665b0 con 0x7fce5c15b7c0 2024-09-15T23:15:11.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.503+0000 7fce61c80640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce5c072ad0 0x7fce5c1515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:11.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.503+0000 7fce61c80640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce5c072ad0 0x7fce5c1515a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46694/0 (socket says 172.21.15.123:46694) 2024-09-15T23:15:11.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.503+0000 7fce61c80640 1 -- 172.21.15.123:0/1095725617 learned_addr learned my addr 172.21.15.123:0/1095725617 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:11.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.503+0000 7fce61c80640 1 -- 172.21.15.123:0/1095725617 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fce5c15b7c0 msgr2=0x7fce5c14e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:11.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.503+0000 7fce61c80640 1 --2- 172.21.15.123:0/1095725617 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fce5c15b7c0 0x7fce5c14e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:11.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.503+0000 7fce61c80640 1 -- 172.21.15.123:0/1095725617 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fce5c0ccf30 msgr2=0x7fce5c14e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:11.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.503+0000 7fce61c80640 1 --2- 172.21.15.123:0/1095725617 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fce5c0ccf30 0x7fce5c14e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:11.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.503+0000 7fce61c80640 1 -- 172.21.15.123:0/1095725617 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce5c15de20 con 0x7fce5c072ad0 2024-09-15T23:15:11.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.503+0000 7fce61c80640 1 --2- 172.21.15.123:0/1095725617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce5c072ad0 0x7fce5c1515a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fce5800c4d0 tx=0x7fce5800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:11.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.503+0000 7fce527fc640 1 -- 172.21.15.123:0/1095725617 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce58018070 con 0x7fce5c072ad0 2024-09-15T23:15:11.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.503+0000 7fce527fc640 1 -- 172.21.15.123:0/1095725617 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce58007500 con 0x7fce5c072ad0 2024-09-15T23:15:11.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.503+0000 7fce527fc640 1 -- 172.21.15.123:0/1095725617 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce58004a20 con 0x7fce5c072ad0 2024-09-15T23:15:11.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.503+0000 7fce63ee4640 1 -- 172.21.15.123:0/1095725617 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce5c15e100 con 0x7fce5c072ad0 2024-09-15T23:15:11.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.503+0000 7fce63ee4640 1 -- 172.21.15.123:0/1095725617 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce5c151ae0 con 0x7fce5c072ad0 2024-09-15T23:15:11.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.504+0000 7fce63ee4640 1 -- 172.21.15.123:0/1095725617 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce5c0b2c50 con 0x7fce5c072ad0 2024-09-15T23:15:11.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.505+0000 7fce527fc640 1 -- 172.21.15.123:0/1095725617 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fce58004bc0 con 0x7fce5c072ad0 2024-09-15T23:15:11.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.505+0000 7fce527fc640 1 --2- 172.21.15.123:0/1095725617 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fce4006c2b0 0x7fce4006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:11.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.505+0000 7fce527fc640 1 -- 172.21.15.123:0/1095725617 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 4943+0+0 (secure 0 0 0) 0x7fce5808a450 con 0x7fce5c072ad0 2024-09-15T23:15:11.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.505+0000 7fce6147f640 1 --2- 172.21.15.123:0/1095725617 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fce4006c2b0 0x7fce4006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:11.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.506+0000 7fce6147f640 1 --2- 172.21.15.123:0/1095725617 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fce4006c2b0 0x7fce4006e770 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fce4c006fd0 tx=0x7fce4c006bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:11.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.510+0000 7fce527fc640 1 -- 172.21.15.123:0/1095725617 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fce58058e40 con 0x7fce5c072ad0 2024-09-15T23:15:11.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.678+0000 7fce63ee4640 1 -- 172.21.15.123:0/1095725617 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fce5c0cc960 con 0x7fce5c072ad0 2024-09-15T23:15:11.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.682+0000 7fce527fc640 1 -- 172.21.15.123:0/1095725617 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7fce58058740 con 0x7fce5c072ad0 2024-09-15T23:15:11.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.684+0000 7fce63ee4640 1 -- 172.21.15.123:0/1095725617 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fce4006c2b0 msgr2=0x7fce4006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:11.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.684+0000 7fce63ee4640 1 --2- 172.21.15.123:0/1095725617 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fce4006c2b0 0x7fce4006e770 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fce4c006fd0 tx=0x7fce4c006bc0 comp rx=0 tx=0).stop 2024-09-15T23:15:11.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.684+0000 7fce63ee4640 1 -- 172.21.15.123:0/1095725617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce5c072ad0 msgr2=0x7fce5c1515a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:11.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.684+0000 7fce63ee4640 1 --2- 172.21.15.123:0/1095725617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce5c072ad0 0x7fce5c1515a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fce5800c4d0 tx=0x7fce5800c990 comp rx=0 tx=0).stop 2024-09-15T23:15:11.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.684+0000 7fce63ee4640 1 -- 172.21.15.123:0/1095725617 shutdown_connections 2024-09-15T23:15:11.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.684+0000 7fce63ee4640 1 --2- 172.21.15.123:0/1095725617 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fce5c15b7c0 0x7fce5c14e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:11.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.684+0000 7fce63ee4640 1 --2- 172.21.15.123:0/1095725617 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fce5c0ccf30 0x7fce5c14e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:11.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.684+0000 7fce63ee4640 1 --2- 172.21.15.123:0/1095725617 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fce4006c2b0 0x7fce4006e770 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:11.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.684+0000 7fce63ee4640 1 --2- 172.21.15.123:0/1095725617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce5c072ad0 0x7fce5c1515a0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:11.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.684+0000 7fce63ee4640 1 -- 172.21.15.123:0/1095725617 >> 172.21.15.123:0/1095725617 conn(0x7fce5c06d0f0 msgr2=0x7fce5c15f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:11.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.684+0000 7fce63ee4640 1 -- 172.21.15.123:0/1095725617 shutdown_connections 2024-09-15T23:15:11.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.684+0000 7fce63ee4640 1 -- 172.21.15.123:0/1095725617 wait complete. 2024-09-15T23:15:11.696 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks' 2024-09-15T23:15:11.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.794+0000 7f85a3598640 1 Processor -- start 2024-09-15T23:15:11.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.794+0000 7f85a3598640 1 -- start start 2024-09-15T23:15:11.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.795+0000 7f85a3598640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f859c15ed20 0x7f859c0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:11.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.795+0000 7f85a3598640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f859c0b90e0 0x7f859c0b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:11.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.795+0000 7f85a3598640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f859c0d0e70 con 0x7f859c0d23b0 2024-09-15T23:15:11.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.795+0000 7f85a3598640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f859c0d41c0 con 0x7f859c0b90e0 2024-09-15T23:15:11.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.795+0000 7f85a3598640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f859c0d35b0 con 0x7f859c15ed20 2024-09-15T23:15:11.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.795+0000 7f85a1b35640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f859c0b90e0 0x7f859c0b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:11.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.795+0000 7f85a0b33640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f859c0d23b0 0x7f859c0cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60348/0 (socket says 172.21.15.123:60348) 2024-09-15T23:15:11.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.795+0000 7f85a1b35640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f859c0b90e0 0x7f859c0b67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46708/0 (socket says 172.21.15.123:46708) 2024-09-15T23:15:11.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.795+0000 7f85a0b33640 1 -- 172.21.15.123:0/546597459 learned_addr learned my addr 172.21.15.123:0/546597459 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:11.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.796+0000 7f85a1b35640 1 -- 172.21.15.123:0/546597459 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f859c15ed20 msgr2=0x7f859c0b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:11.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.796+0000 7f85a1b35640 1 --2- 172.21.15.123:0/546597459 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f859c15ed20 0x7f859c0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:11.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.796+0000 7f85a1b35640 1 -- 172.21.15.123:0/546597459 >> v1:172.21.15.123:6789/0 conn(0x7f859c0d23b0 legacy=0x7f859c0cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:11.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.796+0000 7f8593fff640 1 -- 172.21.15.123:0/546597459 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 529838963 0 0) 0x7f858c001110 con 0x7f859c0d23b0 2024-09-15T23:15:11.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.796+0000 7f85a1b35640 1 -- 172.21.15.123:0/546597459 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f859c0d3890 con 0x7f859c0b90e0 2024-09-15T23:15:11.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.796+0000 7f85a1b35640 1 --2- 172.21.15.123:0/546597459 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f859c0b90e0 0x7f859c0b67a0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f8594009d90 tx=0x7f859402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a3bb5fc8385fce server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:11.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.796+0000 7f8593fff640 1 -- 172.21.15.123:0/546597459 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8594007740 con 0x7f859c0b90e0 2024-09-15T23:15:11.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.796+0000 7f8593fff640 1 -- 172.21.15.123:0/546597459 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85940078e0 con 0x7f859c0b90e0 2024-09-15T23:15:11.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.796+0000 7f8593fff640 1 -- 172.21.15.123:0/546597459 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8594007cb0 con 0x7f859c0b90e0 2024-09-15T23:15:11.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.797+0000 7f85a3598640 1 -- 172.21.15.123:0/546597459 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f859c0b90e0 msgr2=0x7f859c0b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:11.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.797+0000 7f85a3598640 1 --2- 172.21.15.123:0/546597459 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f859c0b90e0 0x7f859c0b67a0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f8594009d90 tx=0x7f859402a660 comp rx=0 tx=0).stop 2024-09-15T23:15:11.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.797+0000 7f85a3598640 1 -- 172.21.15.123:0/546597459 shutdown_connections 2024-09-15T23:15:11.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.797+0000 7f85a3598640 1 --2- 172.21.15.123:0/546597459 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f859c0b90e0 0x7f859c0b67a0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:11.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.797+0000 7f85a3598640 1 --2- 172.21.15.123:0/546597459 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f859c15ed20 0x7f859c0b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:11.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.797+0000 7f85a3598640 1 -- 172.21.15.123:0/546597459 >> 172.21.15.123:0/546597459 conn(0x7f859c0d1260 msgr2=0x7f859c0d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:11.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.797+0000 7f85a3598640 1 -- 172.21.15.123:0/546597459 shutdown_connections 2024-09-15T23:15:11.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.797+0000 7f85a3598640 1 -- 172.21.15.123:0/546597459 wait complete. 2024-09-15T23:15:11.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.798+0000 7f85a3598640 1 Processor -- start 2024-09-15T23:15:11.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.798+0000 7f85a3598640 1 -- start start 2024-09-15T23:15:11.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.799+0000 7f85a3598640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f859c0b90e0 0x7f859c1615d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:11.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.799+0000 7f85a3598640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f859c0d23b0 0x7f859c153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:11.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.799+0000 7f85a3598640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f859c15ed20 0x7f859c1e96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:11.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.799+0000 7f85a3598640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f859c0d32a0 con 0x7f859c0d23b0 2024-09-15T23:15:11.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.799+0000 7f85a3598640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f859c0d3e50 con 0x7f859c15ed20 2024-09-15T23:15:11.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.799+0000 7f85a3598640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f859c15f100 con 0x7f859c0b90e0 2024-09-15T23:15:11.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.799+0000 7f85a0b33640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f859c0d23b0 0x7f859c153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:11.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.799+0000 7f85a0b33640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f859c0d23b0 0x7f859c153380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46716/0 (socket says 172.21.15.123:46716) 2024-09-15T23:15:11.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.799+0000 7f85a0b33640 1 -- 172.21.15.123:0/1160085605 learned_addr learned my addr 172.21.15.123:0/1160085605 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:11.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.799+0000 7f85a1334640 1 --2- 172.21.15.123:0/1160085605 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f859c0b90e0 0x7f859c1615d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:11.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.799+0000 7f85a1b35640 1 --2- 172.21.15.123:0/1160085605 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f859c15ed20 0x7f859c1e96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:11.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.799+0000 7f85a0b33640 1 -- 172.21.15.123:0/1160085605 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f859c0b90e0 msgr2=0x7f859c1615d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:11.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.799+0000 7f85a0b33640 1 --2- 172.21.15.123:0/1160085605 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f859c0b90e0 0x7f859c1615d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:11.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.799+0000 7f85a0b33640 1 -- 172.21.15.123:0/1160085605 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f859c15ed20 msgr2=0x7f859c1e96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:11.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.799+0000 7f85a0b33640 1 --2- 172.21.15.123:0/1160085605 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f859c15ed20 0x7f859c1e96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:11.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.799+0000 7f85a0b33640 1 -- 172.21.15.123:0/1160085605 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f859c160570 con 0x7f859c0d23b0 2024-09-15T23:15:11.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.799+0000 7f85a1b35640 1 --2- 172.21.15.123:0/1160085605 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f859c15ed20 0x7f859c1e96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:11.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.800+0000 7f85a0b33640 1 --2- 172.21.15.123:0/1160085605 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f859c0d23b0 0x7f859c153380 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f858c00c750 tx=0x7f858c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:11.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.800+0000 7f8591ffb640 1 -- 172.21.15.123:0/1160085605 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858c018070 con 0x7f859c0d23b0 2024-09-15T23:15:11.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.800+0000 7f8591ffb640 1 -- 172.21.15.123:0/1160085605 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f858c0070d0 con 0x7f859c0d23b0 2024-09-15T23:15:11.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.800+0000 7f85a3598640 1 -- 172.21.15.123:0/1160085605 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f859c1538c0 con 0x7f859c0d23b0 2024-09-15T23:15:11.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.800+0000 7f8591ffb640 1 -- 172.21.15.123:0/1160085605 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858c0074c0 con 0x7f859c0d23b0 2024-09-15T23:15:11.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.800+0000 7f85a3598640 1 -- 172.21.15.123:0/1160085605 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f859c160af0 con 0x7f859c0d23b0 2024-09-15T23:15:11.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.801+0000 7f85a3598640 1 -- 172.21.15.123:0/1160085605 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f859c0b7010 con 0x7f859c0d23b0 2024-09-15T23:15:11.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.801+0000 7f8591ffb640 1 -- 172.21.15.123:0/1160085605 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f858c01b070 con 0x7f859c0d23b0 2024-09-15T23:15:11.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.801+0000 7f8591ffb640 1 --2- 172.21.15.123:0/1160085605 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f858006c2b0 0x7f858006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:11.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.802+0000 7f8591ffb640 1 -- 172.21.15.123:0/1160085605 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 4943+0+0 (secure 0 0 0) 0x7f858c08a3e0 con 0x7f859c0d23b0 2024-09-15T23:15:11.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.802+0000 7f85a1334640 1 --2- 172.21.15.123:0/1160085605 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f858006c2b0 0x7f858006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:11.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.802+0000 7f85a1334640 1 --2- 172.21.15.123:0/1160085605 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f858006c2b0 0x7f858006e770 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f859800b810 tx=0x7f8598008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:11.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:11.806+0000 7f8591ffb640 1 -- 172.21.15.123:0/1160085605 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f859c0d0e70 con 0x7f859c0d23b0 2024-09-15T23:15:12.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.031+0000 7f85a3598640 1 -- 172.21.15.123:0/1160085605 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]} v 0) -- 0x7f859c0d0a90 con 0x7f859c0d23b0 2024-09-15T23:15:12.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.369+0000 7f8591ffb640 1 -- 172.21.15.123:0/1160085605 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]}]=0 v160) ==== 143+0+0 (secure 0 0 0) 0x7f858c058ee0 con 0x7f859c0d23b0 2024-09-15T23:15:12.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.371+0000 7f85a3598640 1 -- 172.21.15.123:0/1160085605 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f858006c2b0 msgr2=0x7f858006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:12.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.371+0000 7f85a3598640 1 --2- 172.21.15.123:0/1160085605 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f858006c2b0 0x7f858006e770 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f859800b810 tx=0x7f8598008040 comp rx=0 tx=0).stop 2024-09-15T23:15:12.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.371+0000 7f85a3598640 1 -- 172.21.15.123:0/1160085605 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f859c0d23b0 msgr2=0x7f859c153380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:12.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.371+0000 7f85a3598640 1 --2- 172.21.15.123:0/1160085605 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f859c0d23b0 0x7f859c153380 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f858c00c750 tx=0x7f858c00cc10 comp rx=0 tx=0).stop 2024-09-15T23:15:12.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.371+0000 7f85a3598640 1 -- 172.21.15.123:0/1160085605 shutdown_connections 2024-09-15T23:15:12.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.371+0000 7f85a3598640 1 --2- 172.21.15.123:0/1160085605 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f859c15ed20 0x7f859c1e96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:12.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.371+0000 7f85a3598640 1 --2- 172.21.15.123:0/1160085605 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f858006c2b0 0x7f858006e770 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:12.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.371+0000 7f85a3598640 1 --2- 172.21.15.123:0/1160085605 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f859c0d23b0 0x7f859c153380 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:12.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.371+0000 7f85a3598640 1 --2- 172.21.15.123:0/1160085605 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f859c0b90e0 0x7f859c1615d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:12.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.371+0000 7f85a3598640 1 -- 172.21.15.123:0/1160085605 >> 172.21.15.123:0/1160085605 conn(0x7f859c0d1260 msgr2=0x7f859c0b4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:12.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.371+0000 7f85a3598640 1 -- 172.21.15.123:0/1160085605 shutdown_connections 2024-09-15T23:15:12.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.371+0000 7f85a3598640 1 -- 172.21.15.123:0/1160085605 wait complete. 2024-09-15T23:15:12.383 INFO:tasks.cephfs_test_runner:test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) ... ok 2024-09-15T23:15:12.383 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_merge_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) That a directory is merged during scrub. 2024-09-15T23:15:12.383 INFO:tasks.cephfs_test_runner:test_scrub_merge_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-15T23:15:12.384 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:15:12.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.482+0000 7f4f9edf6640 1 Processor -- start 2024-09-15T23:15:12.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.482+0000 7f4f9edf6640 1 -- start start 2024-09-15T23:15:12.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.483+0000 7f4f9edf6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4f9815ab40 0x7f4f9806c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:12.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.483+0000 7f4f9edf6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f9815af20 0x7f4f9815b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:12.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.483+0000 7f4f9edf6640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f98072520 con 0x7f4f980720b0 2024-09-15T23:15:12.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.483+0000 7f4f9edf6640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f4f98071010 con 0x7f4f9815ab40 2024-09-15T23:15:12.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.483+0000 7f4f9edf6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4f980712f0 con 0x7f4f9815af20 2024-09-15T23:15:12.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.483+0000 7f4f9cb92640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4f9815ab40 0x7f4f9806c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:12.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.483+0000 7f4f9cb92640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4f9815ab40 0x7f4f9806c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46720/0 (socket says 172.21.15.123:46720) 2024-09-15T23:15:12.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.483+0000 7f4f9cb92640 1 -- 172.21.15.123:0/3553401651 learned_addr learned my addr 172.21.15.123:0/3553401651 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:12.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.483+0000 7f4f9d393640 1 --2- 172.21.15.123:0/3553401651 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f9815af20 0x7f4f9815b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:12.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.483+0000 7f4f9cb92640 1 -- 172.21.15.123:0/3553401651 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f9815af20 msgr2=0x7f4f9815b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:12.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.483+0000 7f4f9cb92640 1 --2- 172.21.15.123:0/3553401651 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f9815af20 0x7f4f9815b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:12.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.483+0000 7f4f9cb92640 1 -- 172.21.15.123:0/3553401651 >> v1:172.21.15.188:6789/0 conn(0x7f4f980720b0 legacy=0x7f4f98073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:12.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.483+0000 7f4f9cb92640 1 -- 172.21.15.123:0/3553401651 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f980715d0 con 0x7f4f9815ab40 2024-09-15T23:15:12.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.483+0000 7f4f9d393640 1 --2- 172.21.15.123:0/3553401651 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f9815af20 0x7f4f9815b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:12.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.484+0000 7f4f9cb92640 1 --2- 172.21.15.123:0/3553401651 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f9815ab40 0x7f4f9806c6a0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c00bb10 tx=0x7f4f8c02c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a1a492a1f0d24d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:12.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.484+0000 7f4f977fe640 1 -- 172.21.15.123:0/3553401651 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c032790 con 0x7f4f9815ab40 2024-09-15T23:15:12.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.484+0000 7f4f977fe640 1 -- 172.21.15.123:0/3553401651 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f8c038070 con 0x7f4f9815ab40 2024-09-15T23:15:12.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.484+0000 7f4f977fe640 1 -- 172.21.15.123:0/3553401651 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c032b50 con 0x7f4f9815ab40 2024-09-15T23:15:12.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.484+0000 7f4f9edf6640 1 -- 172.21.15.123:0/3553401651 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f9815ab40 msgr2=0x7f4f9806c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:12.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.484+0000 7f4f9edf6640 1 --2- 172.21.15.123:0/3553401651 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f9815ab40 0x7f4f9806c6a0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c00bb10 tx=0x7f4f8c02c890 comp rx=0 tx=0).stop 2024-09-15T23:15:12.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.484+0000 7f4f9edf6640 1 -- 172.21.15.123:0/3553401651 shutdown_connections 2024-09-15T23:15:12.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.484+0000 7f4f9edf6640 1 --2- 172.21.15.123:0/3553401651 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f9815af20 0x7f4f9815b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:12.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.484+0000 7f4f9edf6640 1 --2- 172.21.15.123:0/3553401651 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f9815ab40 0x7f4f9806c6a0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:12.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.484+0000 7f4f9edf6640 1 -- 172.21.15.123:0/3553401651 >> 172.21.15.123:0/3553401651 conn(0x7f4f980ccec0 msgr2=0x7f4f980cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:12.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.485+0000 7f4f9edf6640 1 -- 172.21.15.123:0/3553401651 shutdown_connections 2024-09-15T23:15:12.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.485+0000 7f4f9edf6640 1 -- 172.21.15.123:0/3553401651 wait complete. 2024-09-15T23:15:12.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.486+0000 7f4f9edf6640 1 Processor -- start 2024-09-15T23:15:12.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.486+0000 7f4f9edf6640 1 -- start start 2024-09-15T23:15:12.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.486+0000 7f4f9edf6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f980720b0 0x7f4f98146c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:12.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.487+0000 7f4f9edf6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f9815ab40 0x7f4f98149410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:12.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.487+0000 7f4f9edf6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f9815af20 0x7f4f98149950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:12.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.487+0000 7f4f9edf6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9815ba30 con 0x7f4f9815ab40 2024-09-15T23:15:12.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.487+0000 7f4f9edf6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9815b8b0 con 0x7f4f980720b0 2024-09-15T23:15:12.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.487+0000 7f4f9edf6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4f9806bc10 con 0x7f4f9815af20 2024-09-15T23:15:12.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.487+0000 7f4f97fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f9815ab40 0x7f4f98149410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:12.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.487+0000 7f4f97fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f9815ab40 0x7f4f98149410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46722/0 (socket says 172.21.15.123:46722) 2024-09-15T23:15:12.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.487+0000 7f4f97fff640 1 -- 172.21.15.123:0/340744376 learned_addr learned my addr 172.21.15.123:0/340744376 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:12.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.487+0000 7f4f9cb92640 1 --2- 172.21.15.123:0/340744376 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f980720b0 0x7f4f98146c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:12.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.487+0000 7f4f9d393640 1 --2- 172.21.15.123:0/340744376 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f9815af20 0x7f4f98149950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:12.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.487+0000 7f4f97fff640 1 -- 172.21.15.123:0/340744376 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f9815af20 msgr2=0x7f4f98149950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:12.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.487+0000 7f4f97fff640 1 --2- 172.21.15.123:0/340744376 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f9815af20 0x7f4f98149950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:12.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.487+0000 7f4f97fff640 1 -- 172.21.15.123:0/340744376 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f980720b0 msgr2=0x7f4f98146c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:12.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.487+0000 7f4f97fff640 1 --2- 172.21.15.123:0/340744376 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f980720b0 0x7f4f98146c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:12.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.487+0000 7f4f97fff640 1 -- 172.21.15.123:0/340744376 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f980c6bb0 con 0x7f4f9815ab40 2024-09-15T23:15:12.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.487+0000 7f4f97fff640 1 --2- 172.21.15.123:0/340744376 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f9815ab40 0x7f4f98149410 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f4f8400c480 tx=0x7f4f8400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:12.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.487+0000 7f4f957fa640 1 -- 172.21.15.123:0/340744376 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f840052d0 con 0x7f4f9815ab40 2024-09-15T23:15:12.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.487+0000 7f4f957fa640 1 -- 172.21.15.123:0/340744376 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f84005470 con 0x7f4f9815ab40 2024-09-15T23:15:12.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.487+0000 7f4f9edf6640 1 -- 172.21.15.123:0/340744376 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f98147460 con 0x7f4f9815ab40 2024-09-15T23:15:12.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.487+0000 7f4f957fa640 1 -- 172.21.15.123:0/340744376 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f84012870 con 0x7f4f9815ab40 2024-09-15T23:15:12.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.487+0000 7f4f9edf6640 1 -- 172.21.15.123:0/340744376 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f98147a20 con 0x7f4f9815ab40 2024-09-15T23:15:12.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.488+0000 7f4f9edf6640 1 -- 172.21.15.123:0/340744376 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f9806bf90 con 0x7f4f9815ab40 2024-09-15T23:15:12.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.489+0000 7f4f957fa640 1 -- 172.21.15.123:0/340744376 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4f84012a10 con 0x7f4f9815ab40 2024-09-15T23:15:12.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.489+0000 7f4f957fa640 1 --2- 172.21.15.123:0/340744376 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4f7c06c2b0 0x7f4f7c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:12.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.489+0000 7f4f957fa640 1 -- 172.21.15.123:0/340744376 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 4943+0+0 (secure 0 0 0) 0x7f4f8408ab80 con 0x7f4f9815ab40 2024-09-15T23:15:12.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.490+0000 7f4f9cb92640 1 --2- 172.21.15.123:0/340744376 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4f7c06c2b0 0x7f4f7c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:12.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.490+0000 7f4f9cb92640 1 --2- 172.21.15.123:0/340744376 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4f7c06c2b0 0x7f4f7c06e770 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c037000 tx=0x7f4f8c032000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:12.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.494+0000 7f4f957fa640 1 -- 172.21.15.123:0/340744376 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4f84059030 con 0x7f4f9815ab40 2024-09-15T23:15:12.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.665+0000 7f4f9edf6640 1 -- 172.21.15.123:0/340744376 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4f980cf0f0 con 0x7f4f9815ab40 2024-09-15T23:15:12.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.666+0000 7f4f957fa640 1 -- 172.21.15.123:0/340744376 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+13058 (secure 0 0 0) 0x7f4f8405d330 con 0x7f4f9815ab40 2024-09-15T23:15:12.667 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:12.667 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":57,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:15:11.358363+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.188:6836/1307575248":"2024-09-16T23:15:08.053039+0000","172.21.15.188:6834/1307575248":"2024-09-16T23:15:08.053039+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:15:12.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.668+0000 7f4f9edf6640 1 -- 172.21.15.123:0/340744376 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4f7c06c2b0 msgr2=0x7f4f7c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:12.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.668+0000 7f4f9edf6640 1 --2- 172.21.15.123:0/340744376 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4f7c06c2b0 0x7f4f7c06e770 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c037000 tx=0x7f4f8c032000 comp rx=0 tx=0).stop 2024-09-15T23:15:12.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.668+0000 7f4f9edf6640 1 -- 172.21.15.123:0/340744376 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f9815ab40 msgr2=0x7f4f98149410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:12.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.668+0000 7f4f9edf6640 1 --2- 172.21.15.123:0/340744376 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f9815ab40 0x7f4f98149410 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f4f8400c480 tx=0x7f4f8400c940 comp rx=0 tx=0).stop 2024-09-15T23:15:12.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.668+0000 7f4f9edf6640 1 -- 172.21.15.123:0/340744376 shutdown_connections 2024-09-15T23:15:12.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.668+0000 7f4f9edf6640 1 --2- 172.21.15.123:0/340744376 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f9815af20 0x7f4f98149950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:12.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.668+0000 7f4f9edf6640 1 --2- 172.21.15.123:0/340744376 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4f7c06c2b0 0x7f4f7c06e770 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:12.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.668+0000 7f4f9edf6640 1 --2- 172.21.15.123:0/340744376 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f9815ab40 0x7f4f98149410 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:12.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.668+0000 7f4f9edf6640 1 --2- 172.21.15.123:0/340744376 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f980720b0 0x7f4f98146c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:12.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.668+0000 7f4f9edf6640 1 -- 172.21.15.123:0/340744376 >> 172.21.15.123:0/340744376 conn(0x7f4f980ccec0 msgr2=0x7f4f980cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:12.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.668+0000 7f4f9edf6640 1 -- 172.21.15.123:0/340744376 shutdown_connections 2024-09-15T23:15:12.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.668+0000 7f4f9edf6640 1 -- 172.21.15.123:0/340744376 wait complete. 2024-09-15T23:15:12.680 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T23:12:01.531886+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T23:15:12.680 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T23:15:12.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.780+0000 7f6190f18640 1 Processor -- start 2024-09-15T23:15:12.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.780+0000 7f6190f18640 1 -- start start 2024-09-15T23:15:12.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.781+0000 7f6190f18640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f618c06bfd0 0x7f618c06c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:12.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.781+0000 7f6190f18640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f618c0b3350 0x7f618c1623a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:12.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.781+0000 7f6190f18640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f618c06c8f0 con 0x7f618c0b38a0 2024-09-15T23:15:12.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.781+0000 7f6190f18640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f618c0b78a0 con 0x7f618c06bfd0 2024-09-15T23:15:12.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.781+0000 7f6190f18640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f618c0cffb0 con 0x7f618c0b3350 2024-09-15T23:15:12.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.781+0000 7f618a59c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f618c06bfd0 0x7f618c06c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:12.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.781+0000 7f618ad9d640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f618c0b38a0 0x7f618c1628e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60354/0 (socket says 172.21.15.123:60354) 2024-09-15T23:15:12.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.781+0000 7f618a59c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f618c06bfd0 0x7f618c06c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46738/0 (socket says 172.21.15.123:46738) 2024-09-15T23:15:12.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.781+0000 7f618ad9d640 1 -- 172.21.15.123:0/1377095520 learned_addr learned my addr 172.21.15.123:0/1377095520 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:12.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.782+0000 7f6189d9b640 1 --2- 172.21.15.123:0/1377095520 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f618c0b3350 0x7f618c1623a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:12.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.782+0000 7f618a59c640 1 -- 172.21.15.123:0/1377095520 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f618c0b3350 msgr2=0x7f618c1623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:12.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.782+0000 7f618a59c640 1 --2- 172.21.15.123:0/1377095520 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f618c0b3350 0x7f618c1623a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:12.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.782+0000 7f618a59c640 1 -- 172.21.15.123:0/1377095520 >> v1:172.21.15.123:6789/0 conn(0x7f618c0b38a0 legacy=0x7f618c1628e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:12.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.782+0000 7f618a59c640 1 -- 172.21.15.123:0/1377095520 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f618c0cf710 con 0x7f618c06bfd0 2024-09-15T23:15:12.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.782+0000 7f618959a640 1 -- 172.21.15.123:0/1377095520 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2730691883 0 0) 0x7f618c06c8f0 con 0x7f618c0b38a0 2024-09-15T23:15:12.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.782+0000 7f618a59c640 1 --2- 172.21.15.123:0/1377095520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f618c06bfd0 0x7f618c06c3b0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f617c009dc0 tx=0x7f617c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e39654d7b7468c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:12.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.782+0000 7f618959a640 1 -- 172.21.15.123:0/1377095520 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617c007740 con 0x7f618c06bfd0 2024-09-15T23:15:12.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.783+0000 7f618959a640 1 -- 172.21.15.123:0/1377095520 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f617c0078e0 con 0x7f618c06bfd0 2024-09-15T23:15:12.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.783+0000 7f618959a640 1 -- 172.21.15.123:0/1377095520 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617c007cb0 con 0x7f618c06bfd0 2024-09-15T23:15:12.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.783+0000 7f6190f18640 1 -- 172.21.15.123:0/1377095520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f618c06bfd0 msgr2=0x7f618c06c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:12.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.783+0000 7f6190f18640 1 --2- 172.21.15.123:0/1377095520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f618c06bfd0 0x7f618c06c3b0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f617c009dc0 tx=0x7f617c02a710 comp rx=0 tx=0).stop 2024-09-15T23:15:12.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.783+0000 7f6190f18640 1 -- 172.21.15.123:0/1377095520 shutdown_connections 2024-09-15T23:15:12.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.783+0000 7f6190f18640 1 --2- 172.21.15.123:0/1377095520 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f618c0b3350 0x7f618c1623a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:12.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.783+0000 7f6190f18640 1 --2- 172.21.15.123:0/1377095520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f618c06bfd0 0x7f618c06c3b0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:12.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.783+0000 7f6190f18640 1 -- 172.21.15.123:0/1377095520 >> 172.21.15.123:0/1377095520 conn(0x7f618c0d11c0 msgr2=0x7f618c0d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:12.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.783+0000 7f6190f18640 1 -- 172.21.15.123:0/1377095520 shutdown_connections 2024-09-15T23:15:12.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.783+0000 7f6190f18640 1 -- 172.21.15.123:0/1377095520 wait complete. 2024-09-15T23:15:12.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.784+0000 7f6190f18640 1 Processor -- start 2024-09-15T23:15:12.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.785+0000 7f6190f18640 1 -- start start 2024-09-15T23:15:12.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.785+0000 7f6190f18640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f618c06bfd0 0x7f618c0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:12.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.785+0000 7f6190f18640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f618c0b3350 0x7f618c157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:12.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.785+0000 7f6190f18640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f618c0b38a0 0x7f618c0cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:12.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.785+0000 7f6190f18640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f618c0d2400 con 0x7f618c0b3350 2024-09-15T23:15:12.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.785+0000 7f6190f18640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f618c0cfcd0 con 0x7f618c0b38a0 2024-09-15T23:15:12.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.785+0000 7f6190f18640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f618c06cd50 con 0x7f618c06bfd0 2024-09-15T23:15:12.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.785+0000 7f6189d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f618c0b3350 0x7f618c157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:12.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.785+0000 7f6189d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f618c0b3350 0x7f618c157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46742/0 (socket says 172.21.15.123:46742) 2024-09-15T23:15:12.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.785+0000 7f6189d9b640 1 -- 172.21.15.123:0/3900089857 learned_addr learned my addr 172.21.15.123:0/3900089857 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:12.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.786+0000 7f618ad9d640 1 --2- 172.21.15.123:0/3900089857 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f618c0b38a0 0x7f618c0cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:12.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.786+0000 7f618a59c640 1 --2- 172.21.15.123:0/3900089857 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f618c06bfd0 0x7f618c0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:12.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.786+0000 7f6189d9b640 1 -- 172.21.15.123:0/3900089857 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f618c06bfd0 msgr2=0x7f618c0ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:12.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.786+0000 7f6189d9b640 1 --2- 172.21.15.123:0/3900089857 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f618c06bfd0 0x7f618c0ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:12.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.786+0000 7f6189d9b640 1 -- 172.21.15.123:0/3900089857 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f618c0b38a0 msgr2=0x7f618c0cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:12.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.786+0000 7f6189d9b640 1 --2- 172.21.15.123:0/3900089857 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f618c0b38a0 0x7f618c0cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:12.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.786+0000 7f6189d9b640 1 -- 172.21.15.123:0/3900089857 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f618c0b8030 con 0x7f618c0b3350 2024-09-15T23:15:12.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.786+0000 7f6189d9b640 1 --2- 172.21.15.123:0/3900089857 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f618c0b3350 0x7f618c157770 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f618000d800 tx=0x7f618000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:12.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.786+0000 7f617affd640 1 -- 172.21.15.123:0/3900089857 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618000b6c0 con 0x7f618c0b3350 2024-09-15T23:15:12.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.786+0000 7f617affd640 1 -- 172.21.15.123:0/3900089857 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6180019070 con 0x7f618c0b3350 2024-09-15T23:15:12.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.786+0000 7f617affd640 1 -- 172.21.15.123:0/3900089857 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618000ba80 con 0x7f618c0b3350 2024-09-15T23:15:12.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.786+0000 7f6190f18640 1 -- 172.21.15.123:0/3900089857 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f618c157cb0 con 0x7f618c0b3350 2024-09-15T23:15:12.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.786+0000 7f6190f18640 1 -- 172.21.15.123:0/3900089857 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f618c0b8580 con 0x7f618c0b3350 2024-09-15T23:15:12.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.787+0000 7f6190f18640 1 -- 172.21.15.123:0/3900089857 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f618c15eae0 con 0x7f618c0b3350 2024-09-15T23:15:12.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.787+0000 7f617affd640 1 -- 172.21.15.123:0/3900089857 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f618000bc20 con 0x7f618c0b3350 2024-09-15T23:15:12.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.788+0000 7f617affd640 1 --2- 172.21.15.123:0/3900089857 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f616c06c2b0 0x7f616c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:12.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.788+0000 7f617affd640 1 -- 172.21.15.123:0/3900089857 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 4943+0+0 (secure 0 0 0) 0x7f618008b600 con 0x7f618c0b3350 2024-09-15T23:15:12.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.788+0000 7f618a59c640 1 --2- 172.21.15.123:0/3900089857 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f616c06c2b0 0x7f616c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:12.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.789+0000 7f618a59c640 1 --2- 172.21.15.123:0/3900089857 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f616c06c2b0 0x7f616c06e770 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f617c034000 tx=0x7f617c02f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:12.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.792+0000 7f617affd640 1 -- 172.21.15.123:0/3900089857 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f618005a070 con 0x7f618c0b3350 2024-09-15T23:15:12.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.955+0000 7f6190f18640 1 -- 172.21.15.123:0/3900089857 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f618c0ba3d0 con 0x7f618c0b3350 2024-09-15T23:15:12.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.955+0000 7f617affd640 1 -- 172.21.15.123:0/3900089857 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) ==== 93+0+10 (secure 0 0 0) 0x7f6180059970 con 0x7f618c0b3350 2024-09-15T23:15:12.957 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-15T23:15:12.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.957+0000 7f6190f18640 1 -- 172.21.15.123:0/3900089857 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f616c06c2b0 msgr2=0x7f616c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:12.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.957+0000 7f6190f18640 1 --2- 172.21.15.123:0/3900089857 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f616c06c2b0 0x7f616c06e770 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f617c034000 tx=0x7f617c02f000 comp rx=0 tx=0).stop 2024-09-15T23:15:12.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.957+0000 7f6190f18640 1 -- 172.21.15.123:0/3900089857 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f618c0b3350 msgr2=0x7f618c157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:12.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.957+0000 7f6190f18640 1 --2- 172.21.15.123:0/3900089857 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f618c0b3350 0x7f618c157770 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f618000d800 tx=0x7f618000dcc0 comp rx=0 tx=0).stop 2024-09-15T23:15:12.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.957+0000 7f6190f18640 1 -- 172.21.15.123:0/3900089857 shutdown_connections 2024-09-15T23:15:12.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.957+0000 7f6190f18640 1 --2- 172.21.15.123:0/3900089857 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f618c0b38a0 0x7f618c0cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:12.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.957+0000 7f6190f18640 1 --2- 172.21.15.123:0/3900089857 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f616c06c2b0 0x7f616c06e770 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:12.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.957+0000 7f6190f18640 1 --2- 172.21.15.123:0/3900089857 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f618c0b3350 0x7f618c157770 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:12.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.957+0000 7f6190f18640 1 --2- 172.21.15.123:0/3900089857 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f618c06bfd0 0x7f618c0ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:12.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.957+0000 7f6190f18640 1 -- 172.21.15.123:0/3900089857 >> 172.21.15.123:0/3900089857 conn(0x7f618c0d11c0 msgr2=0x7f618c0b59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:12.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.957+0000 7f6190f18640 1 -- 172.21.15.123:0/3900089857 shutdown_connections 2024-09-15T23:15:12.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:12.957+0000 7f6190f18640 1 -- 172.21.15.123:0/3900089857 wait complete. 2024-09-15T23:15:12.970 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags' 2024-09-15T23:15:13.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.069+0000 7ff70dc9b640 1 Processor -- start 2024-09-15T23:15:13.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.069+0000 7ff70dc9b640 1 -- start start 2024-09-15T23:15:13.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.070+0000 7ff70dc9b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff7080b2d40 0x7ff70806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:13.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.070+0000 7ff70dc9b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff70813eb20 0x7ff70806c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:13.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.070+0000 7ff70dc9b640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff708071180 con 0x7ff70815bcf0 2024-09-15T23:15:13.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.070+0000 7ff70dc9b640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7ff70815c890 con 0x7ff70813eb20 2024-09-15T23:15:13.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.070+0000 7ff70dc9b640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7ff708071ab0 con 0x7ff7080b2d40 2024-09-15T23:15:13.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.070+0000 7ff706ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff70813eb20 0x7ff70806c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:13.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.070+0000 7ff707fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff70815bcf0 0x7ff70815c180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60360/0 (socket says 172.21.15.123:60360) 2024-09-15T23:15:13.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.070+0000 7ff706ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff70813eb20 0x7ff70806c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46758/0 (socket says 172.21.15.123:46758) 2024-09-15T23:15:13.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.070+0000 7ff707fff640 1 -- 172.21.15.123:0/2726053687 learned_addr learned my addr 172.21.15.123:0/2726053687 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:13.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.070+0000 7ff7077fe640 1 --2- 172.21.15.123:0/2726053687 >> v2:172.21.15.188:3300/0 conn(0x7ff7080b2d40 0x7ff70806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:13.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.070+0000 7ff706ffd640 1 -- 172.21.15.123:0/2726053687 >> v2:172.21.15.188:3300/0 conn(0x7ff7080b2d40 msgr2=0x7ff70806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:13.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.070+0000 7ff706ffd640 1 --2- 172.21.15.123:0/2726053687 >> v2:172.21.15.188:3300/0 conn(0x7ff7080b2d40 0x7ff70806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:13.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.070+0000 7ff706ffd640 1 -- 172.21.15.123:0/2726053687 >> v1:172.21.15.123:6789/0 conn(0x7ff70815bcf0 legacy=0x7ff70815c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:13.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.070+0000 7ff7067fc640 1 -- 172.21.15.123:0/2726053687 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3012921352 0 0) 0x7ff708071180 con 0x7ff70815bcf0 2024-09-15T23:15:13.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.070+0000 7ff706ffd640 1 -- 172.21.15.123:0/2726053687 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff708071460 con 0x7ff70813eb20 2024-09-15T23:15:13.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.071+0000 7ff706ffd640 1 --2- 172.21.15.123:0/2726053687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff70813eb20 0x7ff70806c150 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7ff708069be0 tx=0x7ff6fc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3707ea2ef5207a55 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:13.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.071+0000 7ff7067fc640 1 -- 172.21.15.123:0/2726053687 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc037070 con 0x7ff70813eb20 2024-09-15T23:15:13.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.071+0000 7ff7067fc640 1 -- 172.21.15.123:0/2726053687 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6fc032440 con 0x7ff70813eb20 2024-09-15T23:15:13.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.071+0000 7ff7067fc640 1 -- 172.21.15.123:0/2726053687 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc032810 con 0x7ff70813eb20 2024-09-15T23:15:13.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.072+0000 7ff70dc9b640 1 -- 172.21.15.123:0/2726053687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff70813eb20 msgr2=0x7ff70806c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:13.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.072+0000 7ff70dc9b640 1 --2- 172.21.15.123:0/2726053687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff70813eb20 0x7ff70806c150 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7ff708069be0 tx=0x7ff6fc02a1a0 comp rx=0 tx=0).stop 2024-09-15T23:15:13.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.072+0000 7ff70dc9b640 1 -- 172.21.15.123:0/2726053687 shutdown_connections 2024-09-15T23:15:13.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.072+0000 7ff70dc9b640 1 --2- 172.21.15.123:0/2726053687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff70813eb20 0x7ff70806c150 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:13.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.072+0000 7ff70dc9b640 1 --2- 172.21.15.123:0/2726053687 >> v2:172.21.15.188:3300/0 conn(0x7ff7080b2d40 0x7ff70806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:13.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.072+0000 7ff70dc9b640 1 -- 172.21.15.123:0/2726053687 >> 172.21.15.123:0/2726053687 conn(0x7ff7080ccec0 msgr2=0x7ff7080cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:13.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.072+0000 7ff70dc9b640 1 -- 172.21.15.123:0/2726053687 shutdown_connections 2024-09-15T23:15:13.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.072+0000 7ff70dc9b640 1 -- 172.21.15.123:0/2726053687 wait complete. 2024-09-15T23:15:13.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.073+0000 7ff70dc9b640 1 Processor -- start 2024-09-15T23:15:13.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.073+0000 7ff70dc9b640 1 -- start start 2024-09-15T23:15:13.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.074+0000 7ff70dc9b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7080b2d40 0x7ff70813e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:13.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.074+0000 7ff70dc9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff70813eb20 0x7ff70815f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:13.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.074+0000 7ff70dc9b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff70815bcf0 0x7ff70813d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:13.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.074+0000 7ff70dc9b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff7080720c0 con 0x7ff70813eb20 2024-09-15T23:15:13.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.074+0000 7ff70dc9b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff708071f40 con 0x7ff7080b2d40 2024-09-15T23:15:13.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.074+0000 7ff70dc9b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ff708072240 con 0x7ff70815bcf0 2024-09-15T23:15:13.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.074+0000 7ff706ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff70813eb20 0x7ff70815f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:13.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.074+0000 7ff706ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff70813eb20 0x7ff70815f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46770/0 (socket says 172.21.15.123:46770) 2024-09-15T23:15:13.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.074+0000 7ff706ffd640 1 -- 172.21.15.123:0/4242101871 learned_addr learned my addr 172.21.15.123:0/4242101871 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:13.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.074+0000 7ff7077fe640 1 --2- 172.21.15.123:0/4242101871 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7080b2d40 0x7ff70813e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:13.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.074+0000 7ff707fff640 1 --2- 172.21.15.123:0/4242101871 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff70815bcf0 0x7ff70813d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:13.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.074+0000 7ff706ffd640 1 -- 172.21.15.123:0/4242101871 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff70815bcf0 msgr2=0x7ff70813d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:13.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.074+0000 7ff706ffd640 1 --2- 172.21.15.123:0/4242101871 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff70815bcf0 0x7ff70813d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:13.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.074+0000 7ff706ffd640 1 -- 172.21.15.123:0/4242101871 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7080b2d40 msgr2=0x7ff70813e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:13.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.074+0000 7ff706ffd640 1 --2- 172.21.15.123:0/4242101871 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7080b2d40 0x7ff70813e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:13.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.074+0000 7ff706ffd640 1 -- 172.21.15.123:0/4242101871 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff70815e960 con 0x7ff70813eb20 2024-09-15T23:15:13.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.074+0000 7ff707fff640 1 --2- 172.21.15.123:0/4242101871 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff70815bcf0 0x7ff70813d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:13.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.074+0000 7ff7077fe640 1 --2- 172.21.15.123:0/4242101871 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7080b2d40 0x7ff70813e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:13.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.075+0000 7ff706ffd640 1 --2- 172.21.15.123:0/4242101871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff70813eb20 0x7ff70815f9c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc000c00 tx=0x7ff6fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:13.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.075+0000 7ff6effff640 1 -- 172.21.15.123:0/4242101871 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc037040 con 0x7ff70813eb20 2024-09-15T23:15:13.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.075+0000 7ff6effff640 1 -- 172.21.15.123:0/4242101871 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6fc042070 con 0x7ff70813eb20 2024-09-15T23:15:13.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.075+0000 7ff70dc9b640 1 -- 172.21.15.123:0/4242101871 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff70815ec00 con 0x7ff70813eb20 2024-09-15T23:15:13.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.075+0000 7ff6effff640 1 -- 172.21.15.123:0/4242101871 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc030bd0 con 0x7ff70813eb20 2024-09-15T23:15:13.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.075+0000 7ff70dc9b640 1 -- 172.21.15.123:0/4242101871 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff70815f1c0 con 0x7ff70813eb20 2024-09-15T23:15:13.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.076+0000 7ff70dc9b640 1 -- 172.21.15.123:0/4242101871 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff70815c180 con 0x7ff70813eb20 2024-09-15T23:15:13.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.076+0000 7ff6effff640 1 -- 172.21.15.123:0/4242101871 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff6fc047460 con 0x7ff70813eb20 2024-09-15T23:15:13.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.076+0000 7ff6effff640 1 --2- 172.21.15.123:0/4242101871 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff6f406c2b0 0x7ff6f406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:13.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.077+0000 7ff6effff640 1 -- 172.21.15.123:0/4242101871 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 4943+0+0 (secure 0 0 0) 0x7ff6fc0abc90 con 0x7ff70813eb20 2024-09-15T23:15:13.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.077+0000 7ff7077fe640 1 --2- 172.21.15.123:0/4242101871 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff6f406c2b0 0x7ff6f406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:13.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.077+0000 7ff7077fe640 1 --2- 172.21.15.123:0/4242101871 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff6f406c2b0 0x7ff6f406e770 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8006fd0 tx=0x7ff6f8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:13.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.081+0000 7ff6effff640 1 -- 172.21.15.123:0/4242101871 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff6fc032e20 con 0x7ff70813eb20 2024-09-15T23:15:13.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.309+0000 7ff70dc9b640 1 -- 172.21.15.123:0/4242101871 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]} v 0) -- 0x7ff70806c9c0 con 0x7ff70813eb20 2024-09-15T23:15:13.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.370+0000 7ff6effff640 1 -- 172.21.15.123:0/4242101871 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]}]=0 v161) ==== 154+0+0 (secure 0 0 0) 0x7ff6fc07a790 con 0x7ff70813eb20 2024-09-15T23:15:13.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.372+0000 7ff70dc9b640 1 -- 172.21.15.123:0/4242101871 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff6f406c2b0 msgr2=0x7ff6f406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:13.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.372+0000 7ff70dc9b640 1 --2- 172.21.15.123:0/4242101871 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff6f406c2b0 0x7ff6f406e770 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8006fd0 tx=0x7ff6f8008040 comp rx=0 tx=0).stop 2024-09-15T23:15:13.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.372+0000 7ff70dc9b640 1 -- 172.21.15.123:0/4242101871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff70813eb20 msgr2=0x7ff70815f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:13.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.372+0000 7ff70dc9b640 1 --2- 172.21.15.123:0/4242101871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff70813eb20 0x7ff70815f9c0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc000c00 tx=0x7ff6fc0046c0 comp rx=0 tx=0).stop 2024-09-15T23:15:13.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.372+0000 7ff70dc9b640 1 -- 172.21.15.123:0/4242101871 shutdown_connections 2024-09-15T23:15:13.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.372+0000 7ff70dc9b640 1 --2- 172.21.15.123:0/4242101871 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff70815bcf0 0x7ff70813d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:13.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.372+0000 7ff70dc9b640 1 --2- 172.21.15.123:0/4242101871 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff6f406c2b0 0x7ff6f406e770 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:13.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.372+0000 7ff70dc9b640 1 --2- 172.21.15.123:0/4242101871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff70813eb20 0x7ff70815f9c0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:13.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.372+0000 7ff70dc9b640 1 --2- 172.21.15.123:0/4242101871 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff7080b2d40 0x7ff70813e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:13.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.372+0000 7ff70dc9b640 1 -- 172.21.15.123:0/4242101871 >> 172.21.15.123:0/4242101871 conn(0x7ff7080ccec0 msgr2=0x7ff7080d0400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:13.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.372+0000 7ff70dc9b640 1 -- 172.21.15.123:0/4242101871 shutdown_connections 2024-09-15T23:15:13.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.372+0000 7ff70dc9b640 1 -- 172.21.15.123:0/4242101871 wait complete. 2024-09-15T23:15:13.385 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T23:15:13.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.485+0000 7f1c0a6ac640 1 Processor -- start 2024-09-15T23:15:13.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.485+0000 7f1c0a6ac640 1 -- start start 2024-09-15T23:15:13.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.486+0000 7f1c0a6ac640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1c04155950 0x7f1c04073600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:13.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.486+0000 7f1c0a6ac640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1c040afb20 0x7f1c040aff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:13.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.486+0000 7f1c0a6ac640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c04073cc0 con 0x7f1c04162c80 2024-09-15T23:15:13.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.486+0000 7f1c0a6ac640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f1c040b04d0 con 0x7f1c04155950 2024-09-15T23:15:13.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.486+0000 7f1c0a6ac640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1c04070370 con 0x7f1c040afb20 2024-09-15T23:15:13.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.486+0000 7f1c03fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1c04155950 0x7f1c04073600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:13.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.486+0000 7f1c08c49640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1c040afb20 0x7f1c040aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:13.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.486+0000 7f1c03fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1c04155950 0x7f1c04073600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:59800/0 (socket says 172.21.15.123:59800) 2024-09-15T23:15:13.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.486+0000 7f1c037fe640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f1c04162c80 0x7f1c0406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:51932/0 (socket says 172.21.15.123:51932) 2024-09-15T23:15:13.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.486+0000 7f1c03fff640 1 -- 172.21.15.123:0/3153802809 learned_addr learned my addr 172.21.15.123:0/3153802809 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:13.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.486+0000 7f1c08c49640 1 --2- 172.21.15.123:0/3153802809 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1c040afb20 0x7f1c040aff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:57080/0 (socket says 172.21.15.123:57080) 2024-09-15T23:15:13.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.487+0000 7f1c08c49640 1 -- 172.21.15.123:0/3153802809 >> v2:172.21.15.188:3300/0 conn(0x7f1c04155950 msgr2=0x7f1c04073600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:13.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.487+0000 7f1c08c49640 1 --2- 172.21.15.123:0/3153802809 >> v2:172.21.15.188:3300/0 conn(0x7f1c04155950 0x7f1c04073600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:13.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.487+0000 7f1c08c49640 1 -- 172.21.15.123:0/3153802809 >> v1:172.21.15.188:6789/0 conn(0x7f1c04162c80 legacy=0x7f1c0406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:13.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.487+0000 7f1c08c49640 1 -- 172.21.15.123:0/3153802809 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c04071aa0 con 0x7f1c040afb20 2024-09-15T23:15:13.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.487+0000 7f1c03fff640 1 --2- 172.21.15.123:0/3153802809 >> v2:172.21.15.188:3300/0 conn(0x7f1c04155950 0x7f1c04073600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:15:13.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.487+0000 7f1c08c49640 1 --2- 172.21.15.123:0/3153802809 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1c040afb20 0x7f1c040aff90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc009d90 tx=0x7f1bfc02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8af9591644ac5c74 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:13.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.488+0000 7f1c02ffd640 1 -- 172.21.15.123:0/3153802809 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc007740 con 0x7f1c040afb20 2024-09-15T23:15:13.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.488+0000 7f1c02ffd640 1 -- 172.21.15.123:0/3153802809 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bfc0078e0 con 0x7f1c040afb20 2024-09-15T23:15:13.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.488+0000 7f1c02ffd640 1 -- 172.21.15.123:0/3153802809 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc007cb0 con 0x7f1c040afb20 2024-09-15T23:15:13.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.488+0000 7f1c0a6ac640 1 -- 172.21.15.123:0/3153802809 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1c040afb20 msgr2=0x7f1c040aff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:13.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.488+0000 7f1c0a6ac640 1 --2- 172.21.15.123:0/3153802809 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1c040afb20 0x7f1c040aff90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc009d90 tx=0x7f1bfc02a660 comp rx=0 tx=0).stop 2024-09-15T23:15:13.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.488+0000 7f1c0a6ac640 1 -- 172.21.15.123:0/3153802809 shutdown_connections 2024-09-15T23:15:13.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.488+0000 7f1c0a6ac640 1 --2- 172.21.15.123:0/3153802809 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1c040afb20 0x7f1c040aff90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:13.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.488+0000 7f1c0a6ac640 1 --2- 172.21.15.123:0/3153802809 >> v2:172.21.15.188:3300/0 conn(0x7f1c04155950 0x7f1c04073600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:13.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.488+0000 7f1c0a6ac640 1 -- 172.21.15.123:0/3153802809 >> 172.21.15.123:0/3153802809 conn(0x7f1c0406db30 msgr2=0x7f1c0406df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:13.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.488+0000 7f1c0a6ac640 1 -- 172.21.15.123:0/3153802809 shutdown_connections 2024-09-15T23:15:13.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.488+0000 7f1c0a6ac640 1 -- 172.21.15.123:0/3153802809 wait complete. 2024-09-15T23:15:13.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.489+0000 7f1c0a6ac640 1 Processor -- start 2024-09-15T23:15:13.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.489+0000 7f1c0a6ac640 1 -- start start 2024-09-15T23:15:13.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.490+0000 7f1c0a6ac640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1c040afb20 0x7f1c040cd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:13.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.490+0000 7f1c0a6ac640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c04162c80 0x7f1c040cf150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:13.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.490+0000 7f1c0a6ac640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1c040d0300 0x7f1c041f44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:13.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.490+0000 7f1c0a6ac640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1c041630e0 con 0x7f1c04162c80 2024-09-15T23:15:13.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.490+0000 7f1c0a6ac640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0406c320 con 0x7f1c040d0300 2024-09-15T23:15:13.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.490+0000 7f1c0a6ac640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1c04072060 con 0x7f1c040afb20 2024-09-15T23:15:13.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.490+0000 7f1c037fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c04162c80 0x7f1c040cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:13.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.490+0000 7f1c037fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c04162c80 0x7f1c040cf150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46772/0 (socket says 172.21.15.123:46772) 2024-09-15T23:15:13.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.490+0000 7f1c037fe640 1 -- 172.21.15.123:0/2500312032 learned_addr learned my addr 172.21.15.123:0/2500312032 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:13.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.490+0000 7f1c08c49640 1 --2- 172.21.15.123:0/2500312032 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1c040d0300 0x7f1c041f44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:13.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.490+0000 7f1c03fff640 1 --2- 172.21.15.123:0/2500312032 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1c040afb20 0x7f1c040cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:13.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.491+0000 7f1c037fe640 1 -- 172.21.15.123:0/2500312032 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1c040afb20 msgr2=0x7f1c040cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:13.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.491+0000 7f1c037fe640 1 --2- 172.21.15.123:0/2500312032 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1c040afb20 0x7f1c040cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:13.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.491+0000 7f1c037fe640 1 -- 172.21.15.123:0/2500312032 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1c040d0300 msgr2=0x7f1c041f44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:13.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.491+0000 7f1c037fe640 1 --2- 172.21.15.123:0/2500312032 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1c040d0300 0x7f1c041f44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:13.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.491+0000 7f1c037fe640 1 -- 172.21.15.123:0/2500312032 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c040ce0b0 con 0x7f1c04162c80 2024-09-15T23:15:13.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.491+0000 7f1c037fe640 1 --2- 172.21.15.123:0/2500312032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c04162c80 0x7f1c040cf150 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f1bf800c3e0 tx=0x7f1bf800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:13.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.491+0000 7f1c00ff9640 1 -- 172.21.15.123:0/2500312032 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf80074e0 con 0x7f1c04162c80 2024-09-15T23:15:13.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.491+0000 7f1c00ff9640 1 -- 172.21.15.123:0/2500312032 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bf8007680 con 0x7f1c04162c80 2024-09-15T23:15:13.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.491+0000 7f1c00ff9640 1 -- 172.21.15.123:0/2500312032 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bf80049e0 con 0x7f1c04162c80 2024-09-15T23:15:13.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.491+0000 7f1c0a6ac640 1 -- 172.21.15.123:0/2500312032 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c040ce390 con 0x7f1c04162c80 2024-09-15T23:15:13.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.491+0000 7f1c0a6ac640 1 -- 172.21.15.123:0/2500312032 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c040ce950 con 0x7f1c04162c80 2024-09-15T23:15:13.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.492+0000 7f1c0a6ac640 1 -- 172.21.15.123:0/2500312032 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c040aff90 con 0x7f1c04162c80 2024-09-15T23:15:13.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.492+0000 7f1c00ff9640 1 -- 172.21.15.123:0/2500312032 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1bf801a020 con 0x7f1c04162c80 2024-09-15T23:15:13.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.493+0000 7f1c00ff9640 1 --2- 172.21.15.123:0/2500312032 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1bf006c2b0 0x7f1bf006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:13.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.493+0000 7f1c00ff9640 1 -- 172.21.15.123:0/2500312032 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 4943+0+0 (secure 0 0 0) 0x7f1bf808a7c0 con 0x7f1c04162c80 2024-09-15T23:15:13.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.493+0000 7f1c03fff640 1 --2- 172.21.15.123:0/2500312032 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1bf006c2b0 0x7f1bf006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:13.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.494+0000 7f1c03fff640 1 --2- 172.21.15.123:0/2500312032 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1bf006c2b0 0x7f1bf006e770 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4006ca0 tx=0x7f1bf4009240 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:13.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.497+0000 7f1c00ff9640 1 -- 172.21.15.123:0/2500312032 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1bf8058b60 con 0x7f1c04162c80 2024-09-15T23:15:13.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.666+0000 7f1c0a6ac640 1 -- 172.21.15.123:0/2500312032 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f1c040b6360 con 0x7f1c04162c80 2024-09-15T23:15:13.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.669+0000 7f1c00ff9640 1 -- 172.21.15.123:0/2500312032 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7f1bf805ce60 con 0x7f1c04162c80 2024-09-15T23:15:13.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.672+0000 7f1c0a6ac640 1 -- 172.21.15.123:0/2500312032 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1bf006c2b0 msgr2=0x7f1bf006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:13.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.672+0000 7f1c0a6ac640 1 --2- 172.21.15.123:0/2500312032 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1bf006c2b0 0x7f1bf006e770 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1bf4006ca0 tx=0x7f1bf4009240 comp rx=0 tx=0).stop 2024-09-15T23:15:13.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.672+0000 7f1c0a6ac640 1 -- 172.21.15.123:0/2500312032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c04162c80 msgr2=0x7f1c040cf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:13.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.672+0000 7f1c0a6ac640 1 --2- 172.21.15.123:0/2500312032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c04162c80 0x7f1c040cf150 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f1bf800c3e0 tx=0x7f1bf800c8a0 comp rx=0 tx=0).stop 2024-09-15T23:15:13.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.672+0000 7f1c0a6ac640 1 -- 172.21.15.123:0/2500312032 shutdown_connections 2024-09-15T23:15:13.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.672+0000 7f1c0a6ac640 1 --2- 172.21.15.123:0/2500312032 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1c040d0300 0x7f1c041f44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:13.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.672+0000 7f1c0a6ac640 1 --2- 172.21.15.123:0/2500312032 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1bf006c2b0 0x7f1bf006e770 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:13.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.672+0000 7f1c0a6ac640 1 --2- 172.21.15.123:0/2500312032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c04162c80 0x7f1c040cf150 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:13.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.672+0000 7f1c0a6ac640 1 --2- 172.21.15.123:0/2500312032 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1c040afb20 0x7f1c040cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:13.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.672+0000 7f1c0a6ac640 1 -- 172.21.15.123:0/2500312032 >> 172.21.15.123:0/2500312032 conn(0x7f1c0406db30 msgr2=0x7f1c041545a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:13.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.672+0000 7f1c0a6ac640 1 -- 172.21.15.123:0/2500312032 shutdown_connections 2024-09-15T23:15:13.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.672+0000 7f1c0a6ac640 1 -- 172.21.15.123:0/2500312032 wait complete. 2024-09-15T23:15:13.684 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:15:13.684 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:15:13.735 DEBUG:teuthology.orchestra.run.smithi188:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:15:13.774 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:15:13.775 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:15:13.775 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:15:13.791 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:15:13.791 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:15:13.791 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:15:13.835 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:15:13.835 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:15:13.835 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:15:13.854 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:15:13.854 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:15:13.854 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:15:13.893 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:15:13.893 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-15T23:15:13.893 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:15:13.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.990+0000 7f7eb1c47640 1 Processor -- start 2024-09-15T23:15:13.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.990+0000 7f7eb1c47640 1 -- start start 2024-09-15T23:15:13.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.991+0000 7f7eb1c47640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7eac06efb0 0x7f7eac169360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:13.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.991+0000 7f7eb1c47640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7eac072fb0 con 0x7f7eac1482b0 2024-09-15T23:15:13.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.991+0000 7f7eb1c47640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7eac073290 con 0x7f7eac0b49a0 2024-09-15T23:15:13.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.991+0000 7f7eb1c47640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f7eac073570 con 0x7f7eac06efb0 2024-09-15T23:15:13.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.991+0000 7f7eabfff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7eac06efb0 0x7f7eac169360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:13.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.991+0000 7f7eab7fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7eac1482b0 0x7f7eac0b4290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60362/0 (socket says 172.21.15.123:60362) 2024-09-15T23:15:13.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.991+0000 7f7eab7fe640 1 -- 172.21.15.123:0/3275790310 learned_addr learned my addr 172.21.15.123:0/3275790310 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:13.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.992+0000 7f7eabfff640 1 -- 172.21.15.123:0/3275790310 >> v1:172.21.15.188:6789/0 conn(0x7f7eac0b49a0 legacy=0x7f7eac071430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:13.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.992+0000 7f7eabfff640 1 -- 172.21.15.123:0/3275790310 >> v1:172.21.15.123:6789/0 conn(0x7f7eac1482b0 legacy=0x7f7eac0b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:13.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.992+0000 7f7eabfff640 1 -- 172.21.15.123:0/3275790310 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eac06da80 con 0x7f7eac06efb0 2024-09-15T23:15:13.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.992+0000 7f7eabfff640 1 --2- 172.21.15.123:0/3275790310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7eac06efb0 0x7f7eac169360 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f7ea40097a0 tx=0x7f7ea402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c6cdc97ec59eabf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:13.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.992+0000 7f7eaa7fc640 1 -- 172.21.15.123:0/3275790310 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4037070 con 0x7f7eac06efb0 2024-09-15T23:15:13.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.992+0000 7f7eaa7fc640 1 -- 172.21.15.123:0/3275790310 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ea4032440 con 0x7f7eac06efb0 2024-09-15T23:15:13.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.992+0000 7f7eaa7fc640 1 -- 172.21.15.123:0/3275790310 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4032810 con 0x7f7eac06efb0 2024-09-15T23:15:13.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.993+0000 7f7eb1c47640 1 -- 172.21.15.123:0/3275790310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7eac06efb0 msgr2=0x7f7eac169360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:13.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.993+0000 7f7eb1c47640 1 --2- 172.21.15.123:0/3275790310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7eac06efb0 0x7f7eac169360 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f7ea40097a0 tx=0x7f7ea402a1a0 comp rx=0 tx=0).stop 2024-09-15T23:15:13.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.993+0000 7f7eb1c47640 1 -- 172.21.15.123:0/3275790310 shutdown_connections 2024-09-15T23:15:13.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.993+0000 7f7eb1c47640 1 --2- 172.21.15.123:0/3275790310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7eac06efb0 0x7f7eac169360 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:13.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.993+0000 7f7eb1c47640 1 -- 172.21.15.123:0/3275790310 >> 172.21.15.123:0/3275790310 conn(0x7f7eac06c240 msgr2=0x7f7eac0b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:13.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.993+0000 7f7eb1c47640 1 -- 172.21.15.123:0/3275790310 shutdown_connections 2024-09-15T23:15:13.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.993+0000 7f7eb1c47640 1 -- 172.21.15.123:0/3275790310 wait complete. 2024-09-15T23:15:13.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.994+0000 7f7eb1c47640 1 Processor -- start 2024-09-15T23:15:13.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.994+0000 7f7eb1c47640 1 -- start start 2024-09-15T23:15:13.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.995+0000 7f7eb1c47640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7eac06efb0 0x7f7eac1584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:13.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.995+0000 7f7eb1c47640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7eac0b49a0 0x7f7eac13fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:13.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.995+0000 7f7eb1c47640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7eac1482b0 0x7f7eac143e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:13.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.995+0000 7f7eb1c47640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7eac06d6a0 con 0x7f7eac0b49a0 2024-09-15T23:15:13.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.995+0000 7f7eb1c47640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7eac148690 con 0x7f7eac1482b0 2024-09-15T23:15:13.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.995+0000 7f7eb1c47640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7eac06d820 con 0x7f7eac06efb0 2024-09-15T23:15:13.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.995+0000 7f7eaaffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7eac0b49a0 0x7f7eac13fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:13.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.995+0000 7f7eaaffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7eac0b49a0 0x7f7eac13fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46786/0 (socket says 172.21.15.123:46786) 2024-09-15T23:15:13.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.995+0000 7f7eaaffd640 1 -- 172.21.15.123:0/3021609493 learned_addr learned my addr 172.21.15.123:0/3021609493 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:13.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.995+0000 7f7eabfff640 1 --2- 172.21.15.123:0/3021609493 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7eac1482b0 0x7f7eac143e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:13.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.995+0000 7f7eab7fe640 1 --2- 172.21.15.123:0/3021609493 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7eac06efb0 0x7f7eac1584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:13.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.995+0000 7f7eaaffd640 1 -- 172.21.15.123:0/3021609493 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7eac06efb0 msgr2=0x7f7eac1584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:13.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.995+0000 7f7eaaffd640 1 --2- 172.21.15.123:0/3021609493 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7eac06efb0 0x7f7eac1584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:13.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.995+0000 7f7eaaffd640 1 -- 172.21.15.123:0/3021609493 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7eac1482b0 msgr2=0x7f7eac143e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:13.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.995+0000 7f7eaaffd640 1 --2- 172.21.15.123:0/3021609493 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7eac1482b0 0x7f7eac143e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:13.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.995+0000 7f7eaaffd640 1 -- 172.21.15.123:0/3021609493 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eac140830 con 0x7f7eac0b49a0 2024-09-15T23:15:13.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.995+0000 7f7eabfff640 1 --2- 172.21.15.123:0/3021609493 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7eac1482b0 0x7f7eac143e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:13.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.996+0000 7f7eaaffd640 1 --2- 172.21.15.123:0/3021609493 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7eac0b49a0 0x7f7eac13fea0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f7ea000c430 tx=0x7f7ea000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:13.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.996+0000 7f7e93fff640 1 -- 172.21.15.123:0/3021609493 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0017070 con 0x7f7eac0b49a0 2024-09-15T23:15:13.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.996+0000 7f7e93fff640 1 -- 172.21.15.123:0/3021609493 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ea00052d0 con 0x7f7eac0b49a0 2024-09-15T23:15:13.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.996+0000 7f7eb1c47640 1 -- 172.21.15.123:0/3021609493 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7eac140b10 con 0x7f7eac0b49a0 2024-09-15T23:15:13.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.996+0000 7f7e93fff640 1 -- 172.21.15.123:0/3021609493 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0003830 con 0x7f7eac0b49a0 2024-09-15T23:15:13.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.996+0000 7f7eb1c47640 1 -- 172.21.15.123:0/3021609493 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7eac1410d0 con 0x7f7eac0b49a0 2024-09-15T23:15:14.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.997+0000 7f7eb1c47640 1 -- 172.21.15.123:0/3021609493 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7eac0b4290 con 0x7f7eac0b49a0 2024-09-15T23:15:14.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.997+0000 7f7e93fff640 1 -- 172.21.15.123:0/3021609493 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7ea001a070 con 0x7f7eac0b49a0 2024-09-15T23:15:14.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.998+0000 7f7e93fff640 1 --2- 172.21.15.123:0/3021609493 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7e9806c2b0 0x7f7e9806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:14.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.998+0000 7f7e93fff640 1 -- 172.21.15.123:0/3021609493 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 4943+0+0 (secure 0 0 0) 0x7f7ea008a3c0 con 0x7f7eac0b49a0 2024-09-15T23:15:14.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.998+0000 7f7eab7fe640 1 --2- 172.21.15.123:0/3021609493 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7e9806c2b0 0x7f7e9806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:14.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:13.998+0000 7f7eab7fe640 1 --2- 172.21.15.123:0/3021609493 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7e9806c2b0 0x7f7e9806e770 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c005c00 tx=0x7f7e9c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:14.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.002+0000 7f7e93fff640 1 -- 172.21.15.123:0/3021609493 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7ea0058ec0 con 0x7f7eac0b49a0 2024-09-15T23:15:14.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.199+0000 7f7eb1c47640 1 -- 172.21.15.123:0/3021609493 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7eac072370 con 0x7f7eac0b49a0 2024-09-15T23:15:14.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.199+0000 7f7e93fff640 1 -- 172.21.15.123:0/3021609493 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+3914 (secure 0 0 0) 0x7f7ea00587c0 con 0x7f7eac0b49a0 2024-09-15T23:15:14.200 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:14.201 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":25,"btime":"2024-09-15T23:15:09:054854+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5014,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/354247514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":354247514},{"type":"v1","addr":"172.21.15.188:6837","nonce":354247514}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2925346627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2925346627},{"type":"v1","addr":"172.21.15.123:6834","nonce":2925346627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5247,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/280703051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":280703051},{"type":"v1","addr":"172.21.15.123:6835","nonce":280703051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5608,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/967705641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":967705641},{"type":"v1","addr":"172.21.15.188:6836","nonce":967705641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[]} 2024-09-15T23:15:14.201 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 25 2024-09-15T23:15:14.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.201+0000 7f7eb1c47640 1 -- 172.21.15.123:0/3021609493 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7e9806c2b0 msgr2=0x7f7e9806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:14.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.201+0000 7f7eb1c47640 1 --2- 172.21.15.123:0/3021609493 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7e9806c2b0 0x7f7e9806e770 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c005c00 tx=0x7f7e9c009040 comp rx=0 tx=0).stop 2024-09-15T23:15:14.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.201+0000 7f7eb1c47640 1 -- 172.21.15.123:0/3021609493 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7eac0b49a0 msgr2=0x7f7eac13fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:14.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.201+0000 7f7eb1c47640 1 --2- 172.21.15.123:0/3021609493 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7eac0b49a0 0x7f7eac13fea0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f7ea000c430 tx=0x7f7ea000c8f0 comp rx=0 tx=0).stop 2024-09-15T23:15:14.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.201+0000 7f7eb1c47640 1 -- 172.21.15.123:0/3021609493 shutdown_connections 2024-09-15T23:15:14.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.201+0000 7f7eb1c47640 1 --2- 172.21.15.123:0/3021609493 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7eac1482b0 0x7f7eac143e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:14.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.201+0000 7f7eb1c47640 1 --2- 172.21.15.123:0/3021609493 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7e9806c2b0 0x7f7e9806e770 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:14.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.201+0000 7f7eb1c47640 1 --2- 172.21.15.123:0/3021609493 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7eac0b49a0 0x7f7eac13fea0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:14.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.201+0000 7f7eb1c47640 1 --2- 172.21.15.123:0/3021609493 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7eac06efb0 0x7f7eac1584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:14.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.201+0000 7f7eb1c47640 1 -- 172.21.15.123:0/3021609493 >> 172.21.15.123:0/3021609493 conn(0x7f7eac06c240 msgr2=0x7f7eac0af5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:14.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.201+0000 7f7eb1c47640 1 -- 172.21.15.123:0/3021609493 shutdown_connections 2024-09-15T23:15:14.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.201+0000 7f7eb1c47640 1 -- 172.21.15.123:0/3021609493 wait complete. 2024-09-15T23:15:14.214 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T23:15:14.214 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T23:15:14.214 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T23:15:14.214 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:15:14.214 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T23:15:14.214 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T23:15:14.215 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T23:15:14.215 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:15:14.215 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T23:15:14.215 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T23:15:14.215 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T23:15:14.215 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:15:14.215 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T23:15:14.215 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T23:15:14.216 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T23:15:14.216 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:15:14.224 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T23:15:14.224 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T23:15:14.225 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T23:15:14.225 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T23:15:14.230 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T23:15:14.231 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T23:15:14.231 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T23:15:14.231 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T23:15:14.266 INFO:tasks.ceph.mds.a:Started 2024-09-15T23:15:14.267 DEBUG:teuthology.parallel:result is None 2024-09-15T23:15:14.267 INFO:tasks.ceph.mds.c:Started 2024-09-15T23:15:14.267 DEBUG:teuthology.parallel:result is None 2024-09-15T23:15:14.273 INFO:tasks.ceph.mds.b:Started 2024-09-15T23:15:14.273 DEBUG:teuthology.parallel:result is None 2024-09-15T23:15:14.274 INFO:tasks.ceph.mds.d:Started 2024-09-15T23:15:14.274 DEBUG:teuthology.parallel:result is None 2024-09-15T23:15:14.274 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T23:15:14.341 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-15T23:15:14.341 INFO:tasks.ceph.mds.a.smithi123.stdout:starting mds.a at 2024-09-15T23:15:14.356 INFO:tasks.ceph.mds.d.smithi188.stdout:starting mds.d at 2024-09-15T23:15:14.357 INFO:tasks.ceph.mds.b.smithi188.stdout:starting mds.b at 2024-09-15T23:15:14.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.378+0000 7f5c819b0640 1 Processor -- start 2024-09-15T23:15:14.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.378+0000 7f5c819b0640 1 -- start start 2024-09-15T23:15:14.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.379+0000 7f5c819b0640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5c7c15c3f0 0x7f5c7c15d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:14.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.379+0000 7f5c819b0640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f5c7c0d0fc0 0x7f5c7c0720c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:14.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.379+0000 7f5c819b0640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c7c0d1470 con 0x7f5c7c15c7d0 2024-09-15T23:15:14.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.379+0000 7f5c819b0640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f5c7c0cff20 con 0x7f5c7c15c3f0 2024-09-15T23:15:14.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.379+0000 7f5c819b0640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f5c7c0d0200 con 0x7f5c7c0d0fc0 2024-09-15T23:15:14.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.379+0000 7f5c7affd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5c7c15c3f0 0x7f5c7c15d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:14.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.379+0000 7f5c7affd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5c7c15c3f0 0x7f5c7c15d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46824/0 (socket says 172.21.15.123:46824) 2024-09-15T23:15:14.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.379+0000 7f5c7affd640 1 -- 172.21.15.123:0/1073367926 learned_addr learned my addr 172.21.15.123:0/1073367926 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:14.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.379+0000 7f5c7b7fe640 1 --2- 172.21.15.123:0/1073367926 >> v2:172.21.15.188:3300/0 conn(0x7f5c7c0d0fc0 0x7f5c7c0720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:14.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.380+0000 7f5c7affd640 1 -- 172.21.15.123:0/1073367926 >> v2:172.21.15.188:3300/0 conn(0x7f5c7c0d0fc0 msgr2=0x7f5c7c0720c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:14.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.380+0000 7f5c7affd640 1 --2- 172.21.15.123:0/1073367926 >> v2:172.21.15.188:3300/0 conn(0x7f5c7c0d0fc0 0x7f5c7c0720c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:14.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.380+0000 7f5c7affd640 1 -- 172.21.15.123:0/1073367926 >> v1:172.21.15.188:6789/0 conn(0x7f5c7c15c7d0 legacy=0x7f5c7c0cf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:14.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.380+0000 7f5c7affd640 1 -- 172.21.15.123:0/1073367926 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c7c0d04e0 con 0x7f5c7c15c3f0 2024-09-15T23:15:14.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.380+0000 7f5c7affd640 1 --2- 172.21.15.123:0/1073367926 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c7c15c3f0 0x7f5c7c15d710 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c0cef10 tx=0x7f5c6c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e74aff6a3c64d206 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:14.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.380+0000 7f5c79ffb640 1 -- 172.21.15.123:0/1073367926 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c037070 con 0x7f5c7c15c3f0 2024-09-15T23:15:14.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.381+0000 7f5c79ffb640 1 -- 172.21.15.123:0/1073367926 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c6c032440 con 0x7f5c7c15c3f0 2024-09-15T23:15:14.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.381+0000 7f5c79ffb640 1 -- 172.21.15.123:0/1073367926 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c032810 con 0x7f5c7c15c3f0 2024-09-15T23:15:14.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.381+0000 7f5c819b0640 1 -- 172.21.15.123:0/1073367926 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c7c15c3f0 msgr2=0x7f5c7c15d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:14.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.381+0000 7f5c819b0640 1 --2- 172.21.15.123:0/1073367926 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c7c15c3f0 0x7f5c7c15d710 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5c7c0cef10 tx=0x7f5c6c02a1e0 comp rx=0 tx=0).stop 2024-09-15T23:15:14.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.381+0000 7f5c819b0640 1 -- 172.21.15.123:0/1073367926 shutdown_connections 2024-09-15T23:15:14.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.381+0000 7f5c819b0640 1 --2- 172.21.15.123:0/1073367926 >> v2:172.21.15.188:3300/0 conn(0x7f5c7c0d0fc0 0x7f5c7c0720c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:14.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.381+0000 7f5c819b0640 1 --2- 172.21.15.123:0/1073367926 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c7c15c3f0 0x7f5c7c15d710 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:14.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.381+0000 7f5c819b0640 1 -- 172.21.15.123:0/1073367926 >> 172.21.15.123:0/1073367926 conn(0x7f5c7c06cd20 msgr2=0x7f5c7c06d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:14.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.381+0000 7f5c819b0640 1 -- 172.21.15.123:0/1073367926 shutdown_connections 2024-09-15T23:15:14.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.381+0000 7f5c819b0640 1 -- 172.21.15.123:0/1073367926 wait complete. 2024-09-15T23:15:14.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.382+0000 7f5c819b0640 1 Processor -- start 2024-09-15T23:15:14.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.383+0000 7f5c819b0640 1 -- start start 2024-09-15T23:15:14.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.383+0000 7f5c819b0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5c7c0d0fc0 0x7f5c7c143e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:14.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.383+0000 7f5c819b0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5c7c15c3f0 0x7f5c7c147070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:14.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.383+0000 7f5c819b0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c7c15c7d0 0x7f5c7c15e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:14.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.383+0000 7f5c819b0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5c7c072600 con 0x7f5c7c15c7d0 2024-09-15T23:15:14.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.383+0000 7f5c819b0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5c7c0d0aa0 con 0x7f5c7c0d0fc0 2024-09-15T23:15:14.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.383+0000 7f5c819b0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5c7c072780 con 0x7f5c7c15c3f0 2024-09-15T23:15:14.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.383+0000 7f5c7b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c7c15c7d0 0x7f5c7c15e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:14.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.384+0000 7f5c7b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c7c15c7d0 0x7f5c7c15e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46830/0 (socket says 172.21.15.123:46830) 2024-09-15T23:15:14.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.384+0000 7f5c7b7fe640 1 -- 172.21.15.123:0/2865123956 learned_addr learned my addr 172.21.15.123:0/2865123956 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:14.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.384+0000 7f5c7affd640 1 --2- 172.21.15.123:0/2865123956 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5c7c0d0fc0 0x7f5c7c143e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:14.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.384+0000 7f5c7a7fc640 1 --2- 172.21.15.123:0/2865123956 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5c7c15c3f0 0x7f5c7c147070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:14.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.384+0000 7f5c7b7fe640 1 -- 172.21.15.123:0/2865123956 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5c7c15c3f0 msgr2=0x7f5c7c147070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:14.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.384+0000 7f5c7b7fe640 1 --2- 172.21.15.123:0/2865123956 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5c7c15c3f0 0x7f5c7c147070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:14.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.384+0000 7f5c7b7fe640 1 -- 172.21.15.123:0/2865123956 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5c7c0d0fc0 msgr2=0x7f5c7c143e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:14.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.384+0000 7f5c7b7fe640 1 --2- 172.21.15.123:0/2865123956 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5c7c0d0fc0 0x7f5c7c143e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:14.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.384+0000 7f5c7b7fe640 1 -- 172.21.15.123:0/2865123956 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c7c158d70 con 0x7f5c7c15c7d0 2024-09-15T23:15:14.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.384+0000 7f5c7b7fe640 1 --2- 172.21.15.123:0/2865123956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c7c15c7d0 0x7f5c7c15e7d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5c74009dd0 tx=0x7f5c7400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:14.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.385+0000 7f5c63fff640 1 -- 172.21.15.123:0/2865123956 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c74018020 con 0x7f5c7c15c7d0 2024-09-15T23:15:14.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.385+0000 7f5c819b0640 1 -- 172.21.15.123:0/2865123956 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c7c144770 con 0x7f5c7c15c7d0 2024-09-15T23:15:14.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.386+0000 7f5c819b0640 1 -- 172.21.15.123:0/2865123956 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c7c144d30 con 0x7f5c7c15c7d0 2024-09-15T23:15:14.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.386+0000 7f5c63fff640 1 -- 172.21.15.123:0/2865123956 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c74014480 con 0x7f5c7c15c7d0 2024-09-15T23:15:14.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.386+0000 7f5c63fff640 1 -- 172.21.15.123:0/2865123956 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c74014830 con 0x7f5c7c15c7d0 2024-09-15T23:15:14.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.387+0000 7f5c819b0640 1 -- 172.21.15.123:0/2865123956 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c7c0720c0 con 0x7f5c7c15c7d0 2024-09-15T23:15:14.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.387+0000 7f5c63fff640 1 -- 172.21.15.123:0/2865123956 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5c74005d10 con 0x7f5c7c15c7d0 2024-09-15T23:15:14.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.387+0000 7f5c63fff640 1 --2- 172.21.15.123:0/2865123956 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5c6806c2b0 0x7f5c6806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:14.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.387+0000 7f5c63fff640 1 -- 172.21.15.123:0/2865123956 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f5c7408bb30 con 0x7f5c7c15c7d0 2024-09-15T23:15:14.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.388+0000 7f5c7affd640 1 --2- 172.21.15.123:0/2865123956 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5c6806c2b0 0x7f5c6806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:14.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.388+0000 7f5c7affd640 1 --2- 172.21.15.123:0/2865123956 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5c6806c2b0 0x7f5c6806e770 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c034000 tx=0x7f5c6c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:14.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.392+0000 7f5c63fff640 1 -- 172.21.15.123:0/2865123956 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5c74022070 con 0x7f5c7c15c7d0 2024-09-15T23:15:14.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:14.569+0000 7f5c819b0640 1 -- 172.21.15.123:0/2865123956 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f5c7c0d1fa0 con 0x7f5c7c15c7d0 2024-09-15T23:15:15.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.394+0000 7f5c63fff640 1 -- 172.21.15.123:0/2865123956 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v62) ==== 97+0+0 (secure 0 0 0) 0x7f5c74010040 con 0x7f5c7c15c7d0 2024-09-15T23:15:15.396 INFO:teuthology.orchestra.run.smithi123.stderr: removed all blocklist entries 2024-09-15T23:15:15.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.398+0000 7f5c819b0640 1 -- 172.21.15.123:0/2865123956 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5c6806c2b0 msgr2=0x7f5c6806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:15.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.398+0000 7f5c819b0640 1 --2- 172.21.15.123:0/2865123956 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5c6806c2b0 0x7f5c6806e770 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c034000 tx=0x7f5c6c02e000 comp rx=0 tx=0).stop 2024-09-15T23:15:15.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.398+0000 7f5c819b0640 1 -- 172.21.15.123:0/2865123956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c7c15c7d0 msgr2=0x7f5c7c15e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:15.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.398+0000 7f5c819b0640 1 --2- 172.21.15.123:0/2865123956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c7c15c7d0 0x7f5c7c15e7d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5c74009dd0 tx=0x7f5c7400c490 comp rx=0 tx=0).stop 2024-09-15T23:15:15.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.398+0000 7f5c819b0640 1 -- 172.21.15.123:0/2865123956 shutdown_connections 2024-09-15T23:15:15.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.398+0000 7f5c819b0640 1 --2- 172.21.15.123:0/2865123956 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5c6806c2b0 0x7f5c6806e770 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:15.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.398+0000 7f5c819b0640 1 --2- 172.21.15.123:0/2865123956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c7c15c7d0 0x7f5c7c15e7d0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:15.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.398+0000 7f5c819b0640 1 --2- 172.21.15.123:0/2865123956 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5c7c15c3f0 0x7f5c7c147070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:15.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.398+0000 7f5c819b0640 1 --2- 172.21.15.123:0/2865123956 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5c7c0d0fc0 0x7f5c7c143e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:15.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.398+0000 7f5c819b0640 1 -- 172.21.15.123:0/2865123956 >> 172.21.15.123:0/2865123956 conn(0x7f5c7c06cd20 msgr2=0x7f5c7c06de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:15.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.398+0000 7f5c819b0640 1 -- 172.21.15.123:0/2865123956 shutdown_connections 2024-09-15T23:15:15.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.398+0000 7f5c819b0640 1 -- 172.21.15.123:0/2865123956 wait complete. 2024-09-15T23:15:15.412 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T23:15:15.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.516+0000 7f59a0913640 1 Processor -- start 2024-09-15T23:15:15.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.516+0000 7f59a0913640 1 -- start start 2024-09-15T23:15:15.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.516+0000 7f59a0913640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f599c0d23b0 0x7f599c0b87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:15.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.517+0000 7f59a0913640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f599c0d0e70 con 0x7f599c0b6970 2024-09-15T23:15:15.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.517+0000 7f59a0913640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f599c0d41c0 con 0x7f599c15ed20 2024-09-15T23:15:15.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.517+0000 7f59a0913640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f599c0d35b0 con 0x7f599c0d23b0 2024-09-15T23:15:15.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.517+0000 7f599ad9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f599c0d23b0 0x7f599c0b87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:15.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.517+0000 7f599ad9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f599c0d23b0 0x7f599c0b87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46838/0 (socket says 172.21.15.123:46838) 2024-09-15T23:15:15.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.517+0000 7f599ad9d640 1 -- 172.21.15.123:0/1017532079 learned_addr learned my addr 172.21.15.123:0/1017532079 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:15.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.517+0000 7f599ad9d640 1 -- 172.21.15.123:0/1017532079 >> v1:172.21.15.188:6789/0 conn(0x7f599c15ed20 legacy=0x7f599c0b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:15.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.517+0000 7f599ad9d640 1 -- 172.21.15.123:0/1017532079 >> v1:172.21.15.123:6789/0 conn(0x7f599c0b6970 legacy=0x7f599c0b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:15.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.517+0000 7f599ad9d640 1 -- 172.21.15.123:0/1017532079 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f599c0d3890 con 0x7f599c0d23b0 2024-09-15T23:15:15.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.517+0000 7f5999d9b640 1 -- 172.21.15.123:0/1017532079 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2448812343 0 0) 0x7f5984001110 con 0x7f599c0b6970 2024-09-15T23:15:15.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.518+0000 7f599ad9d640 1 --2- 172.21.15.123:0/1017532079 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f599c0d23b0 0x7f599c0b87e0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f5994009e50 tx=0x7f599402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda63c3122de2ea8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:15.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.518+0000 7f5999d9b640 1 -- 172.21.15.123:0/1017532079 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5994036070 con 0x7f599c0d23b0 2024-09-15T23:15:15.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.518+0000 7f5999d9b640 1 -- 172.21.15.123:0/1017532079 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5994031600 con 0x7f599c0d23b0 2024-09-15T23:15:15.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.518+0000 7f5999d9b640 1 -- 172.21.15.123:0/1017532079 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59940319d0 con 0x7f599c0d23b0 2024-09-15T23:15:15.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.518+0000 7f59a0913640 1 -- 172.21.15.123:0/1017532079 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f599c0d23b0 msgr2=0x7f599c0b87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:15.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.518+0000 7f59a0913640 1 --2- 172.21.15.123:0/1017532079 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f599c0d23b0 0x7f599c0b87e0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f5994009e50 tx=0x7f599402a730 comp rx=0 tx=0).stop 2024-09-15T23:15:15.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.518+0000 7f59a0913640 1 -- 172.21.15.123:0/1017532079 shutdown_connections 2024-09-15T23:15:15.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.518+0000 7f59a0913640 1 --2- 172.21.15.123:0/1017532079 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f599c0d23b0 0x7f599c0b87e0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:15.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.518+0000 7f59a0913640 1 -- 172.21.15.123:0/1017532079 >> 172.21.15.123:0/1017532079 conn(0x7f599c0d1260 msgr2=0x7f599c0d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:15.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.518+0000 7f59a0913640 1 -- 172.21.15.123:0/1017532079 shutdown_connections 2024-09-15T23:15:15.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.519+0000 7f59a0913640 1 -- 172.21.15.123:0/1017532079 wait complete. 2024-09-15T23:15:15.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.520+0000 7f59a0913640 1 Processor -- start 2024-09-15T23:15:15.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.520+0000 7f59a0913640 1 -- start start 2024-09-15T23:15:15.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.521+0000 7f59a0913640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f599c0b6970 0x7f599c154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:15.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.521+0000 7f59a0913640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f599c0d23b0 0x7f599c159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:15.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.521+0000 7f59a0913640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f599c15ed20 0x7f599c1558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:15.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.521+0000 7f59a0913640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f599c0d32a0 con 0x7f599c0b6970 2024-09-15T23:15:15.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.521+0000 7f59a0913640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f599c0d3e50 con 0x7f599c15ed20 2024-09-15T23:15:15.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.521+0000 7f59a0913640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f599c15f100 con 0x7f599c0d23b0 2024-09-15T23:15:15.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.521+0000 7f599a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f599c0b6970 0x7f599c154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:15.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.521+0000 7f599a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f599c0b6970 0x7f599c154c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46850/0 (socket says 172.21.15.123:46850) 2024-09-15T23:15:15.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.521+0000 7f599a59c640 1 -- 172.21.15.123:0/3994782328 learned_addr learned my addr 172.21.15.123:0/3994782328 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:15.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.521+0000 7f599ad9d640 1 --2- 172.21.15.123:0/3994782328 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f599c15ed20 0x7f599c1558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:15.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.521+0000 7f5993fff640 1 --2- 172.21.15.123:0/3994782328 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f599c0d23b0 0x7f599c159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:15.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.521+0000 7f599a59c640 1 -- 172.21.15.123:0/3994782328 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f599c0d23b0 msgr2=0x7f599c159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:15.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.521+0000 7f599a59c640 1 --2- 172.21.15.123:0/3994782328 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f599c0d23b0 0x7f599c159ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:15.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.521+0000 7f599a59c640 1 -- 172.21.15.123:0/3994782328 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f599c15ed20 msgr2=0x7f599c1558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:15.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.521+0000 7f599a59c640 1 --2- 172.21.15.123:0/3994782328 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f599c15ed20 0x7f599c1558f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:15.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.521+0000 7f599a59c640 1 -- 172.21.15.123:0/3994782328 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f599c15a840 con 0x7f599c0b6970 2024-09-15T23:15:15.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.521+0000 7f5993fff640 1 --2- 172.21.15.123:0/3994782328 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f599c0d23b0 0x7f599c159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:15.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.521+0000 7f599a59c640 1 --2- 172.21.15.123:0/3994782328 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f599c0b6970 0x7f599c154c80 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f598c00c450 tx=0x7f598c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:15.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.521+0000 7f5992ffd640 1 -- 172.21.15.123:0/3994782328 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f598c0052d0 con 0x7f599c0b6970 2024-09-15T23:15:15.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.521+0000 7f5992ffd640 1 -- 172.21.15.123:0/3994782328 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f598c005470 con 0x7f599c0b6970 2024-09-15T23:15:15.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.521+0000 7f59a0913640 1 -- 172.21.15.123:0/3994782328 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f599c15ab20 con 0x7f599c0b6970 2024-09-15T23:15:15.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.521+0000 7f5992ffd640 1 -- 172.21.15.123:0/3994782328 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f598c012870 con 0x7f599c0b6970 2024-09-15T23:15:15.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.521+0000 7f59a0913640 1 -- 172.21.15.123:0/3994782328 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f599c15b0e0 con 0x7f599c0b6970 2024-09-15T23:15:15.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.522+0000 7f59a0913640 1 -- 172.21.15.123:0/3994782328 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f599c0b7010 con 0x7f599c0b6970 2024-09-15T23:15:15.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.523+0000 7f5992ffd640 1 -- 172.21.15.123:0/3994782328 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f598c012a10 con 0x7f599c0b6970 2024-09-15T23:15:15.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.523+0000 7f5992ffd640 1 --2- 172.21.15.123:0/3994782328 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f597c06c2e0 0x7f597c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:15.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.523+0000 7f5992ffd640 1 -- 172.21.15.123:0/3994782328 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 4857+0+0 (secure 0 0 0) 0x7f598c08ac10 con 0x7f599c0b6970 2024-09-15T23:15:15.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.523+0000 7f5993fff640 1 --2- 172.21.15.123:0/3994782328 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f597c06c2e0 0x7f597c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:15.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.524+0000 7f5993fff640 1 --2- 172.21.15.123:0/3994782328 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f597c06c2e0 0x7f597c06e7a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f599c1f8130 tx=0x7f5984009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:15.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.527+0000 7f5992ffd640 1 -- 172.21.15.123:0/3994782328 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f598c059760 con 0x7f599c0b6970 2024-09-15T23:15:15.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.755+0000 7f59a0913640 1 -- 172.21.15.123:0/3994782328 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f599c0b3f20 con 0x7f599c0b6970 2024-09-15T23:15:15.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.755+0000 7f5992ffd640 1 -- 172.21.15.123:0/3994782328 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) ==== 80+0+5304 (secure 0 0 0) 0x7f598c059060 con 0x7f599c0b6970 2024-09-15T23:15:15.757 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:15.757 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:15:15.757 INFO:teuthology.orchestra.run.smithi123.stdout: "auth_dump": [ 2024-09-15T23:15:15.757 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:15.757 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.a", 2024-09-15T23:15:15.757 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm9ATVDhAAnukyZogTuG4YCbzRXSCkiQ==", 2024-09-15T23:15:15.757 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:15.757 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:15:15.757 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:15:15.757 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:15:15.757 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:15:15.758 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:15.758 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:15:15.758 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:15.758 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.b", 2024-09-15T23:15:15.758 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm4KmaGhAAbf6vcffqiJTOYXK5DCXcZA==", 2024-09-15T23:15:15.758 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:15.758 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:15:15.758 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:15:15.758 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:15:15.758 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:15:15.758 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:15.758 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:15:15.759 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:15.759 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.c", 2024-09-15T23:15:15.759 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmua/VFRAAwbPm2TslrfQkrvHiO8oeLg==", 2024-09-15T23:15:15.759 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:15.759 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:15:15.759 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:15:15.759 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:15:15.759 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:15:15.759 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:15.760 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:15:15.760 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:15.760 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.d", 2024-09-15T23:15:15.760 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmzw3eIRAAaE+5y9USwp+xM3MTAndn7Q==", 2024-09-15T23:15:15.760 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:15.760 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:15:15.760 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:15:15.760 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:15:15.760 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:15:15.760 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:15.760 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:15:15.760 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:15.760 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.0", 2024-09-15T23:15:15.760 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCRaedmFrHGAxAAy/jTkothESNn2DC9xcHDAQ==", 2024-09-15T23:15:15.761 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:15.761 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:15:15.761 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:15:15.761 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:15:15.761 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:15.761 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:15:15.761 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:15.761 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.1", 2024-09-15T23:15:15.761 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCUaedm6vZlIxAAdsnLqFSng6SRpCT6UZKGsw==", 2024-09-15T23:15:15.761 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:15.761 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:15:15.761 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:15:15.761 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:15:15.761 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:15.762 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:15:15.762 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:15.762 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.2", 2024-09-15T23:15:15.762 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCYaedmXgVwFRAA1mOzzRafhKMsU7kTAT6TqA==", 2024-09-15T23:15:15.762 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:15.762 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:15:15.762 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:15:15.762 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:15:15.762 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:15.762 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:15:15.762 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:15.762 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.3", 2024-09-15T23:15:15.762 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCcaedm+APAFhAAb8blNFzswwHriSmCrMuA0A==", 2024-09-15T23:15:15.763 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:15.763 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:15:15.763 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:15:15.763 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:15:15.763 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:15.763 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:15:15.763 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:15.763 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.4", 2024-09-15T23:15:15.763 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCjaedmReUmABAAXpxsK7osxn/ZelVXKiCLOw==", 2024-09-15T23:15:15.763 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:15.763 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:15:15.763 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:15:15.763 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:15:15.763 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:15.764 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:15:15.764 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:15.764 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.5", 2024-09-15T23:15:15.764 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCnaedmtbdmARAAdxguBdtwBmtiaIx/y992GA==", 2024-09-15T23:15:15.764 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:15.764 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:15:15.764 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:15:15.764 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:15:15.764 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:15.764 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:15:15.765 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:15.765 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.6", 2024-09-15T23:15:15.765 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCraedmkR+NAxAAd2GAAH0BgOMonU8iTSn+Fw==", 2024-09-15T23:15:15.765 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:15.765 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:15:15.765 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:15:15.765 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:15:15.765 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:15.765 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:15:15.765 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:15.765 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.7", 2024-09-15T23:15:15.765 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCvaedmAaCwBBAAdpDtCbXchArmy019wiOdSQ==", 2024-09-15T23:15:15.765 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:15.765 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:15:15.766 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:15:15.766 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:15:15.766 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:15.766 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:15:15.766 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:15.766 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.0", 2024-09-15T23:15:15.766 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmzQPqJRAAhUf1dnVYohN4obCfeu8+7g==", 2024-09-15T23:15:15.766 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:15.766 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:15:15.766 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow r", 2024-09-15T23:15:15.766 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-15T23:15:15.766 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:15.767 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:15:15.767 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:15.767 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.1", 2024-09-15T23:15:15.767 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmdKK0LhAAXXmUkxVwMEjRTRXUh9CL/g==", 2024-09-15T23:15:15.767 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:15.767 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:15:15.767 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:15:15.767 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:15:15.767 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:15:15.767 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:15.767 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:15:15.767 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:15.768 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.2", 2024-09-15T23:15:15.768 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmRz55KxAARi7B4WYOY1QqH1CK81z9pA==", 2024-09-15T23:15:15.768 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:15.768 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:15:15.768 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:15:15.768 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:15:15.768 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:15:15.768 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:15.768 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:15:15.768 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:15.768 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.3", 2024-09-15T23:15:15.768 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmbWo8NBAAR1qGX1bs35ojx6lMxftcfg==", 2024-09-15T23:15:15.768 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:15.769 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:15:15.769 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:15:15.769 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:15:15.769 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:15:15.769 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:15.769 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:15:15.769 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:15.769 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.admin", 2024-09-15T23:15:15.769 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCMaedmVUW0LhAAqgPFk1HtxsZXcIStNN43pA==", 2024-09-15T23:15:15.769 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:15.769 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:15:15.769 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:15:15.769 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:15:15.770 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:15:15.770 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:15.770 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:15:15.770 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:15.770 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.x", 2024-09-15T23:15:15.770 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmGPSBCxAAHAhXQERogdAOm0ZPNtlxpw==", 2024-09-15T23:15:15.770 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:15.770 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:15:15.770 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-15T23:15:15.770 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:15:15.770 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:15.770 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:15:15.770 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:15.770 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.y", 2024-09-15T23:15:15.770 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm5Om4BxAA/7ZtMMlbUA3bvMCfaNMQyg==", 2024-09-15T23:15:15.771 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:15.771 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:15:15.771 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-15T23:15:15.771 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:15:15.771 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:15.771 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:15.771 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-15T23:15:15.771 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:15:15.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.757+0000 7f59a0913640 1 -- 172.21.15.123:0/3994782328 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f597c06c2e0 msgr2=0x7f597c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:15.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.757+0000 7f59a0913640 1 --2- 172.21.15.123:0/3994782328 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f597c06c2e0 0x7f597c06e7a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f599c1f8130 tx=0x7f5984009040 comp rx=0 tx=0).stop 2024-09-15T23:15:15.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.757+0000 7f59a0913640 1 -- 172.21.15.123:0/3994782328 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f599c0b6970 msgr2=0x7f599c154c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:15.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.757+0000 7f59a0913640 1 --2- 172.21.15.123:0/3994782328 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f599c0b6970 0x7f599c154c80 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f598c00c450 tx=0x7f598c00c910 comp rx=0 tx=0).stop 2024-09-15T23:15:15.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.757+0000 7f59a0913640 1 -- 172.21.15.123:0/3994782328 shutdown_connections 2024-09-15T23:15:15.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.757+0000 7f59a0913640 1 --2- 172.21.15.123:0/3994782328 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f599c15ed20 0x7f599c1558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:15.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.757+0000 7f59a0913640 1 --2- 172.21.15.123:0/3994782328 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f599c0d23b0 0x7f599c159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:15.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.757+0000 7f59a0913640 1 --2- 172.21.15.123:0/3994782328 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f597c06c2e0 0x7f597c06e7a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:15.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.757+0000 7f59a0913640 1 --2- 172.21.15.123:0/3994782328 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f599c0b6970 0x7f599c154c80 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:15.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.757+0000 7f59a0913640 1 -- 172.21.15.123:0/3994782328 >> 172.21.15.123:0/3994782328 conn(0x7f599c0d1260 msgr2=0x7f599c0b9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:15.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.758+0000 7f59a0913640 1 -- 172.21.15.123:0/3994782328 shutdown_connections 2024-09-15T23:15:15.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.758+0000 7f59a0913640 1 -- 172.21.15.123:0/3994782328 wait complete. 2024-09-15T23:15:15.774 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T23:15:15.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.871+0000 7f0d8d05e640 1 Processor -- start 2024-09-15T23:15:15.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.871+0000 7f0d8d05e640 1 -- start start 2024-09-15T23:15:15.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.872+0000 7f0d8d05e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f0d8806c320 0x7f0d8815bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:15.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.872+0000 7f0d8d05e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d8813eb20 0x7f0d8815c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:15.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.872+0000 7f0d8d05e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d88071180 con 0x7f0d880b2d40 2024-09-15T23:15:15.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.872+0000 7f0d8d05e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f0d88071ab0 con 0x7f0d8806c320 2024-09-15T23:15:15.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.872+0000 7f0d8d05e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0d88071460 con 0x7f0d8813eb20 2024-09-15T23:15:15.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.872+0000 7f0d86d9d640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f0d880b2d40 0x7f0d8806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60408/0 (socket says 172.21.15.123:60408) 2024-09-15T23:15:15.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.872+0000 7f0d86d9d640 1 -- 172.21.15.123:0/3737700138 learned_addr learned my addr 172.21.15.123:0/3737700138 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:15.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.873+0000 7f0d85d9b640 1 -- 172.21.15.123:0/3737700138 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3183621789 0 0) 0x7f0d88071180 con 0x7f0d880b2d40 2024-09-15T23:15:15.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.873+0000 7f0d85d9b640 1 -- 172.21.15.123:0/3737700138 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d74003520 con 0x7f0d880b2d40 2024-09-15T23:15:15.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.873+0000 7f0d8659c640 1 --2- 172.21.15.123:0/3737700138 >> v2:172.21.15.188:3300/0 conn(0x7f0d8806c320 0x7f0d8815bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:15.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.873+0000 7f0d8759e640 1 --2- 172.21.15.123:0/3737700138 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d8813eb20 0x7f0d8815c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:15.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.873+0000 7f0d85d9b640 1 -- 172.21.15.123:0/3737700138 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3749162503 0 0) 0x7f0d74003520 con 0x7f0d880b2d40 2024-09-15T23:15:15.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.873+0000 7f0d85d9b640 1 -- 172.21.15.123:0/3737700138 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d8813eb20 msgr2=0x7f0d8815c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:15.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.873+0000 7f0d85d9b640 1 --2- 172.21.15.123:0/3737700138 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d8813eb20 0x7f0d8815c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:15.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.873+0000 7f0d85d9b640 1 -- 172.21.15.123:0/3737700138 >> v2:172.21.15.188:3300/0 conn(0x7f0d8806c320 msgr2=0x7f0d8815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:15.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.873+0000 7f0d85d9b640 1 --2- 172.21.15.123:0/3737700138 >> v2:172.21.15.188:3300/0 conn(0x7f0d8806c320 0x7f0d8815bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:15.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.873+0000 7f0d85d9b640 1 -- 172.21.15.123:0/3737700138 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d88071740 con 0x7f0d880b2d40 2024-09-15T23:15:15.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.873+0000 7f0d85d9b640 1 -- 172.21.15.123:0/3737700138 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f0d80001670 con 0x7f0d880b2d40 2024-09-15T23:15:15.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.873+0000 7f0d8759e640 1 --2- 172.21.15.123:0/3737700138 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d8813eb20 0x7f0d8815c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:15.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.873+0000 7f0d85d9b640 1 -- 172.21.15.123:0/3737700138 >> v1:172.21.15.123:6789/0 conn(0x7f0d880b2d40 legacy=0x7f0d8806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:15.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.873+0000 7f0d85d9b640 1 --2- 172.21.15.123:0/3737700138 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d8813eb20 0x7f0d740039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:15.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.873+0000 7f0d85d9b640 1 --2- 172.21.15.123:0/3737700138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0d74003ef0 0x7f0d74004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:15.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.873+0000 7f0d85d9b640 1 --2- 172.21.15.123:0/3737700138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d74004d40 0x7f0d740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:15.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.873+0000 7f0d85d9b640 1 -- 172.21.15.123:0/3737700138 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0d88071ab0 con 0x7f0d74004d40 2024-09-15T23:15:15.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.873+0000 7f0d85d9b640 1 -- 172.21.15.123:0/3737700138 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0d88071460 con 0x7f0d74003ef0 2024-09-15T23:15:15.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.873+0000 7f0d85d9b640 1 -- 172.21.15.123:0/3737700138 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0d7400b9f0 con 0x7f0d8813eb20 2024-09-15T23:15:15.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.873+0000 7f0d8759e640 1 --2- 172.21.15.123:0/3737700138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d74004d40 0x7f0d740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:15.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.873+0000 7f0d8659c640 1 --2- 172.21.15.123:0/3737700138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0d74003ef0 0x7f0d74004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:15.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.873+0000 7f0d86d9d640 1 --2- 172.21.15.123:0/3737700138 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d8813eb20 0x7f0d740039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:15.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.873+0000 7f0d8759e640 1 -- 172.21.15.123:0/3737700138 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d8813eb20 msgr2=0x7f0d740039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:15.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.873+0000 7f0d8759e640 1 --2- 172.21.15.123:0/3737700138 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d8813eb20 0x7f0d740039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:15.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.873+0000 7f0d8759e640 1 -- 172.21.15.123:0/3737700138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0d74003ef0 msgr2=0x7f0d74004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:15.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.873+0000 7f0d8759e640 1 --2- 172.21.15.123:0/3737700138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0d74003ef0 0x7f0d74004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:15.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.873+0000 7f0d8759e640 1 -- 172.21.15.123:0/3737700138 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d74003520 con 0x7f0d74004d40 2024-09-15T23:15:15.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.873+0000 7f0d86d9d640 1 --2- 172.21.15.123:0/3737700138 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d8813eb20 0x7f0d740039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:15.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.874+0000 7f0d8759e640 1 --2- 172.21.15.123:0/3737700138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d74004d40 0x7f0d740051c0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f0d780073e0 tx=0x7f0d74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f596903489545ab9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:15.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.874+0000 7f0d85d9b640 1 -- 172.21.15.123:0/3737700138 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d78009c80 con 0x7f0d74004d40 2024-09-15T23:15:15.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.874+0000 7f0d85d9b640 1 -- 172.21.15.123:0/3737700138 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d7802e660 con 0x7f0d74004d40 2024-09-15T23:15:15.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.874+0000 7f0d85d9b640 1 -- 172.21.15.123:0/3737700138 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d7802ea10 con 0x7f0d74004d40 2024-09-15T23:15:15.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.875+0000 7f0d8d05e640 1 -- 172.21.15.123:0/3737700138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d74004d40 msgr2=0x7f0d740051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:15.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.875+0000 7f0d8d05e640 1 --2- 172.21.15.123:0/3737700138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d74004d40 0x7f0d740051c0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f0d780073e0 tx=0x7f0d74005830 comp rx=0 tx=0).stop 2024-09-15T23:15:15.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.875+0000 7f0d8759e640 1 -- 172.21.15.123:0/3737700138 reap_dead start 2024-09-15T23:15:15.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.875+0000 7f0d8d05e640 1 -- 172.21.15.123:0/3737700138 shutdown_connections 2024-09-15T23:15:15.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.875+0000 7f0d8d05e640 1 -- 172.21.15.123:0/3737700138 >> 172.21.15.123:0/3737700138 conn(0x7f0d880ccec0 msgr2=0x7f0d880cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:15.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.875+0000 7f0d8d05e640 1 -- 172.21.15.123:0/3737700138 shutdown_connections 2024-09-15T23:15:15.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.875+0000 7f0d8d05e640 1 -- 172.21.15.123:0/3737700138 wait complete. 2024-09-15T23:15:15.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.876+0000 7f0d8d05e640 1 Processor -- start 2024-09-15T23:15:15.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.876+0000 7f0d8d05e640 1 -- start start 2024-09-15T23:15:15.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.877+0000 7f0d8d05e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0d74004d40 0x7f0d8813dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:15.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.877+0000 7f0d8d05e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d8813e140 0x7f0d881570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:15.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.877+0000 7f0d8d05e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d88157620 0x7f0d88157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:15.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.877+0000 7f0d8d05e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8815c5c0 con 0x7f0d88157620 2024-09-15T23:15:15.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.877+0000 7f0d8d05e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8815c440 con 0x7f0d74004d40 2024-09-15T23:15:15.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.877+0000 7f0d8d05e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0d8815c740 con 0x7f0d8813e140 2024-09-15T23:15:15.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.877+0000 7f0d8759e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d88157620 0x7f0d88157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:15.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.877+0000 7f0d8759e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d88157620 0x7f0d88157aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46874/0 (socket says 172.21.15.123:46874) 2024-09-15T23:15:15.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.877+0000 7f0d8759e640 1 -- 172.21.15.123:0/3715687053 learned_addr learned my addr 172.21.15.123:0/3715687053 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:15.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.877+0000 7f0d86d9d640 1 --2- 172.21.15.123:0/3715687053 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0d74004d40 0x7f0d8813dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:15.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.877+0000 7f0d8659c640 1 --2- 172.21.15.123:0/3715687053 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d8813e140 0x7f0d881570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:15.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.877+0000 7f0d8759e640 1 -- 172.21.15.123:0/3715687053 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d8813e140 msgr2=0x7f0d881570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:15.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.877+0000 7f0d8759e640 1 --2- 172.21.15.123:0/3715687053 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d8813e140 0x7f0d881570e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:15.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.877+0000 7f0d8759e640 1 -- 172.21.15.123:0/3715687053 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0d74004d40 msgr2=0x7f0d8813dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:15.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.877+0000 7f0d8759e640 1 --2- 172.21.15.123:0/3715687053 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0d74004d40 0x7f0d8813dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:15.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.877+0000 7f0d8759e640 1 -- 172.21.15.123:0/3715687053 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d8813e5c0 con 0x7f0d88157620 2024-09-15T23:15:15.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.878+0000 7f0d8759e640 1 --2- 172.21.15.123:0/3715687053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d88157620 0x7f0d88157aa0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f0d780073e0 tx=0x7f0d78004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:15.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.878+0000 7f0d7f7fe640 1 -- 172.21.15.123:0/3715687053 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d78009c80 con 0x7f0d88157620 2024-09-15T23:15:15.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.878+0000 7f0d7f7fe640 1 -- 172.21.15.123:0/3715687053 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d7802e460 con 0x7f0d88157620 2024-09-15T23:15:15.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.878+0000 7f0d7f7fe640 1 -- 172.21.15.123:0/3715687053 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d78038280 con 0x7f0d88157620 2024-09-15T23:15:15.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.878+0000 7f0d8d05e640 1 -- 172.21.15.123:0/3715687053 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d88141a70 con 0x7f0d88157620 2024-09-15T23:15:15.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.878+0000 7f0d8d05e640 1 -- 172.21.15.123:0/3715687053 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d88142030 con 0x7f0d88157620 2024-09-15T23:15:15.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.879+0000 7f0d8d05e640 1 -- 172.21.15.123:0/3715687053 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d8815bcf0 con 0x7f0d88157620 2024-09-15T23:15:15.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.879+0000 7f0d7f7fe640 1 -- 172.21.15.123:0/3715687053 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0d78038650 con 0x7f0d88157620 2024-09-15T23:15:15.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.880+0000 7f0d7f7fe640 1 --2- 172.21.15.123:0/3715687053 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0d6806c2b0 0x7f0d6806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:15.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.880+0000 7f0d7f7fe640 1 -- 172.21.15.123:0/3715687053 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 4857+0+0 (secure 0 0 0) 0x7f0d780ab480 con 0x7f0d88157620 2024-09-15T23:15:15.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.880+0000 7f0d86d9d640 1 --2- 172.21.15.123:0/3715687053 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0d6806c2b0 0x7f0d6806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:15.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.880+0000 7f0d86d9d640 1 --2- 172.21.15.123:0/3715687053 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0d6806c2b0 0x7f0d6806e770 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0d800017e0 tx=0x7f0d80007040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:15.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:15.884+0000 7f0d7f7fe640 1 -- 172.21.15.123:0/3715687053 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0d8813e5c0 con 0x7f0d88157620 2024-09-15T23:15:16.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.050+0000 7f0d8d05e640 1 -- 172.21.15.123:0/3715687053 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f0d8806c9c0 con 0x7f0d88157620 2024-09-15T23:15:16.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.050+0000 7f0d7f7fe640 1 -- 172.21.15.123:0/3715687053 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v62) ==== 84+0+65 (secure 0 0 0) 0x7f0d78032030 con 0x7f0d88157620 2024-09-15T23:15:16.051 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:16.051 INFO:teuthology.orchestra.run.smithi123.stdout:[ 2024-09-15T23:15:16.051 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:16.051 INFO:teuthology.orchestra.run.smithi123.stdout: "poolnum": 1, 2024-09-15T23:15:16.052 INFO:teuthology.orchestra.run.smithi123.stdout: "poolname": ".mgr" 2024-09-15T23:15:16.052 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:16.052 INFO:teuthology.orchestra.run.smithi123.stdout:] 2024-09-15T23:15:16.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.052+0000 7f0d8d05e640 1 -- 172.21.15.123:0/3715687053 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0d6806c2b0 msgr2=0x7f0d6806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:16.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.052+0000 7f0d8d05e640 1 --2- 172.21.15.123:0/3715687053 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0d6806c2b0 0x7f0d6806e770 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0d800017e0 tx=0x7f0d80007040 comp rx=0 tx=0).stop 2024-09-15T23:15:16.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.052+0000 7f0d8d05e640 1 -- 172.21.15.123:0/3715687053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d88157620 msgr2=0x7f0d88157aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:16.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.052+0000 7f0d8d05e640 1 --2- 172.21.15.123:0/3715687053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d88157620 0x7f0d88157aa0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f0d780073e0 tx=0x7f0d78004ab0 comp rx=0 tx=0).stop 2024-09-15T23:15:16.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.052+0000 7f0d8d05e640 1 -- 172.21.15.123:0/3715687053 shutdown_connections 2024-09-15T23:15:16.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.052+0000 7f0d8d05e640 1 --2- 172.21.15.123:0/3715687053 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0d6806c2b0 0x7f0d6806e770 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:16.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.052+0000 7f0d8d05e640 1 --2- 172.21.15.123:0/3715687053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d88157620 0x7f0d88157aa0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:16.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.052+0000 7f0d8d05e640 1 --2- 172.21.15.123:0/3715687053 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d8813e140 0x7f0d881570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:16.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.052+0000 7f0d8d05e640 1 --2- 172.21.15.123:0/3715687053 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0d74004d40 0x7f0d8813dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:16.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.052+0000 7f0d8d05e640 1 -- 172.21.15.123:0/3715687053 >> 172.21.15.123:0/3715687053 conn(0x7f0d880ccec0 msgr2=0x7f0d88071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:16.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.052+0000 7f0d8d05e640 1 -- 172.21.15.123:0/3715687053 shutdown_connections 2024-09-15T23:15:16.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.052+0000 7f0d8d05e640 1 -- 172.21.15.123:0/3715687053 wait complete. 2024-09-15T23:15:16.064 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T23:15:16.065 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T23:15:16.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.166+0000 7f672eae4640 1 Processor -- start 2024-09-15T23:15:16.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.166+0000 7f672eae4640 1 -- start start 2024-09-15T23:15:16.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.167+0000 7f672eae4640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f672815b6d0 0x7f67280b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:16.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.167+0000 7f672eae4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f672815bab0 0x7f67280b5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:16.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.167+0000 7f672eae4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f672815bef0 0x7f67280b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:16.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.167+0000 7f672eae4640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f67280b5160 con 0x7f672815bef0 2024-09-15T23:15:16.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.167+0000 7f672eae4640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f67280b35e0 con 0x7f672815b6d0 2024-09-15T23:15:16.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.167+0000 7f672eae4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f67280b38a0 con 0x7f672815bab0 2024-09-15T23:15:16.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.167+0000 7f672d081640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f672815bef0 0x7f67280b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:16.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.167+0000 7f672d081640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f672815bef0 0x7f67280b59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46882/0 (socket says 172.21.15.123:46882) 2024-09-15T23:15:16.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.167+0000 7f672d081640 1 -- 172.21.15.123:0/4181381932 learned_addr learned my addr 172.21.15.123:0/4181381932 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:16.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.167+0000 7f672c880640 1 --2- 172.21.15.123:0/4181381932 >> v2:172.21.15.188:3300/0 conn(0x7f672815b6d0 0x7f67280b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:16.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.167+0000 7f6727fff640 1 --2- 172.21.15.123:0/4181381932 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f672815bab0 0x7f67280b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:16.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.167+0000 7f672d081640 1 -- 172.21.15.123:0/4181381932 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f672815bab0 msgr2=0x7f67280b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:16.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.167+0000 7f672d081640 1 --2- 172.21.15.123:0/4181381932 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f672815bab0 0x7f67280b5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:16.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.167+0000 7f672d081640 1 -- 172.21.15.123:0/4181381932 >> v2:172.21.15.188:3300/0 conn(0x7f672815b6d0 msgr2=0x7f67280b4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:16.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.167+0000 7f672d081640 1 --2- 172.21.15.123:0/4181381932 >> v2:172.21.15.188:3300/0 conn(0x7f672815b6d0 0x7f67280b4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:16.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.167+0000 7f672d081640 1 -- 172.21.15.123:0/4181381932 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67280b3b80 con 0x7f672815bef0 2024-09-15T23:15:16.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.168+0000 7f672d081640 1 --2- 172.21.15.123:0/4181381932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f672815bef0 0x7f67280b59c0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f67280b2740 tx=0x7f671002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd1cf94d1df5da24 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:16.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.168+0000 7f67277fe640 1 -- 172.21.15.123:0/4181381932 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6710037070 con 0x7f672815bef0 2024-09-15T23:15:16.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.168+0000 7f67277fe640 1 -- 172.21.15.123:0/4181381932 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6710032440 con 0x7f672815bef0 2024-09-15T23:15:16.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.168+0000 7f67277fe640 1 -- 172.21.15.123:0/4181381932 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6710032810 con 0x7f672815bef0 2024-09-15T23:15:16.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.168+0000 7f672eae4640 1 -- 172.21.15.123:0/4181381932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f672815bef0 msgr2=0x7f67280b59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:16.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.168+0000 7f672eae4640 1 --2- 172.21.15.123:0/4181381932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f672815bef0 0x7f67280b59c0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f67280b2740 tx=0x7f671002a1c0 comp rx=0 tx=0).stop 2024-09-15T23:15:16.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.168+0000 7f672eae4640 1 -- 172.21.15.123:0/4181381932 shutdown_connections 2024-09-15T23:15:16.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.168+0000 7f672eae4640 1 --2- 172.21.15.123:0/4181381932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f672815bef0 0x7f67280b59c0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:16.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.168+0000 7f672eae4640 1 --2- 172.21.15.123:0/4181381932 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f672815bab0 0x7f67280b5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:16.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.168+0000 7f672eae4640 1 --2- 172.21.15.123:0/4181381932 >> v2:172.21.15.188:3300/0 conn(0x7f672815b6d0 0x7f67280b4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:16.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.168+0000 7f672eae4640 1 -- 172.21.15.123:0/4181381932 >> 172.21.15.123:0/4181381932 conn(0x7f672806c240 msgr2=0x7f672806d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:16.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.169+0000 7f672eae4640 1 -- 172.21.15.123:0/4181381932 shutdown_connections 2024-09-15T23:15:16.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.169+0000 7f672eae4640 1 -- 172.21.15.123:0/4181381932 wait complete. 2024-09-15T23:15:16.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.170+0000 7f672eae4640 1 Processor -- start 2024-09-15T23:15:16.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.170+0000 7f672eae4640 1 -- start start 2024-09-15T23:15:16.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.170+0000 7f672eae4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f672815b6d0 0x7f67280cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:16.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.170+0000 7f672eae4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f672815bab0 0x7f67280cf810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:16.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.170+0000 7f672eae4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f672815bef0 0x7f67281459b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:16.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.170+0000 7f672eae4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f672815e7b0 con 0x7f672815bab0 2024-09-15T23:15:16.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.170+0000 7f672eae4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f67280b4140 con 0x7f672815bef0 2024-09-15T23:15:16.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.171+0000 7f672eae4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f672815e930 con 0x7f672815b6d0 2024-09-15T23:15:16.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.171+0000 7f6727fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f672815bab0 0x7f67280cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:16.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.171+0000 7f6727fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f672815bab0 0x7f67280cf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46888/0 (socket says 172.21.15.123:46888) 2024-09-15T23:15:16.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.171+0000 7f6727fff640 1 -- 172.21.15.123:0/4138049016 learned_addr learned my addr 172.21.15.123:0/4138049016 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:16.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.171+0000 7f672c880640 1 --2- 172.21.15.123:0/4138049016 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f672815b6d0 0x7f67280cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:16.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.171+0000 7f672d081640 1 --2- 172.21.15.123:0/4138049016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f672815bef0 0x7f67281459b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:16.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.171+0000 7f6727fff640 1 -- 172.21.15.123:0/4138049016 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f672815b6d0 msgr2=0x7f67280cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:16.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.171+0000 7f6727fff640 1 --2- 172.21.15.123:0/4138049016 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f672815b6d0 0x7f67280cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:16.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.171+0000 7f6727fff640 1 -- 172.21.15.123:0/4138049016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f672815bef0 msgr2=0x7f67281459b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:16.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.171+0000 7f6727fff640 1 --2- 172.21.15.123:0/4138049016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f672815bef0 0x7f67281459b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:16.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.171+0000 7f6727fff640 1 -- 172.21.15.123:0/4138049016 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67280ce5a0 con 0x7f672815bab0 2024-09-15T23:15:16.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.171+0000 7f6727fff640 1 --2- 172.21.15.123:0/4138049016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f672815bab0 0x7f67280cf810 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f6718007ef0 tx=0x7f671800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:16.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.171+0000 7f67257fa640 1 -- 172.21.15.123:0/4138049016 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6718014620 con 0x7f672815bab0 2024-09-15T23:15:16.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.171+0000 7f67257fa640 1 -- 172.21.15.123:0/4138049016 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6718019070 con 0x7f672815bab0 2024-09-15T23:15:16.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.171+0000 7f67257fa640 1 -- 172.21.15.123:0/4138049016 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6718014a00 con 0x7f672815bab0 2024-09-15T23:15:16.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.171+0000 7f672eae4640 1 -- 172.21.15.123:0/4138049016 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67280ce880 con 0x7f672815bab0 2024-09-15T23:15:16.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.171+0000 7f672eae4640 1 -- 172.21.15.123:0/4138049016 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f672814c3d0 con 0x7f672815bab0 2024-09-15T23:15:16.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.172+0000 7f672eae4640 1 -- 172.21.15.123:0/4138049016 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67280b4c20 con 0x7f672815bab0 2024-09-15T23:15:16.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.173+0000 7f67257fa640 1 -- 172.21.15.123:0/4138049016 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6718014ba0 con 0x7f672815bab0 2024-09-15T23:15:16.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.173+0000 7f67257fa640 1 --2- 172.21.15.123:0/4138049016 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f670806c2b0 0x7f670806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:16.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.173+0000 7f67257fa640 1 -- 172.21.15.123:0/4138049016 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 4857+0+0 (secure 0 0 0) 0x7f671808b7f0 con 0x7f672815bab0 2024-09-15T23:15:16.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.173+0000 7f672c880640 1 --2- 172.21.15.123:0/4138049016 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f670806c2b0 0x7f670806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:16.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.174+0000 7f672c880640 1 --2- 172.21.15.123:0/4138049016 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f670806c2b0 0x7f670806e770 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6720006fd0 tx=0x7f6720008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:16.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.177+0000 7f67257fa640 1 -- 172.21.15.123:0/4138049016 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6718059cf0 con 0x7f672815bab0 2024-09-15T23:15:16.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.342+0000 7f672eae4640 1 -- 172.21.15.123:0/4138049016 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f67280d02c0 con 0x7f672815bab0 2024-09-15T23:15:16.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.398+0000 7f67257fa640 1 -- 172.21.15.123:0/4138049016 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v63) ==== 138+0+0 (secure 0 0 0) 0x7f671805dff0 con 0x7f672815bab0 2024-09-15T23:15:16.400 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' created 2024-09-15T23:15:16.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.401+0000 7f672eae4640 1 -- 172.21.15.123:0/4138049016 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f670806c2b0 msgr2=0x7f670806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:16.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.401+0000 7f672eae4640 1 --2- 172.21.15.123:0/4138049016 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f670806c2b0 0x7f670806e770 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6720006fd0 tx=0x7f6720008040 comp rx=0 tx=0).stop 2024-09-15T23:15:16.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.401+0000 7f672eae4640 1 -- 172.21.15.123:0/4138049016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f672815bab0 msgr2=0x7f67280cf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:16.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.401+0000 7f672eae4640 1 --2- 172.21.15.123:0/4138049016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f672815bab0 0x7f67280cf810 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f6718007ef0 tx=0x7f671800e4b0 comp rx=0 tx=0).stop 2024-09-15T23:15:16.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.401+0000 7f672eae4640 1 -- 172.21.15.123:0/4138049016 shutdown_connections 2024-09-15T23:15:16.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.401+0000 7f672eae4640 1 --2- 172.21.15.123:0/4138049016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f672815bef0 0x7f67281459b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:16.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.401+0000 7f672eae4640 1 --2- 172.21.15.123:0/4138049016 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f670806c2b0 0x7f670806e770 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:16.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.401+0000 7f672eae4640 1 --2- 172.21.15.123:0/4138049016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f672815bab0 0x7f67280cf810 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:16.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.401+0000 7f672eae4640 1 --2- 172.21.15.123:0/4138049016 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f672815b6d0 0x7f67280cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:16.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.401+0000 7f672eae4640 1 -- 172.21.15.123:0/4138049016 >> 172.21.15.123:0/4138049016 conn(0x7f672806c240 msgr2=0x7f6728071f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:16.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.401+0000 7f672eae4640 1 -- 172.21.15.123:0/4138049016 shutdown_connections 2024-09-15T23:15:16.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.401+0000 7f672eae4640 1 -- 172.21.15.123:0/4138049016 wait complete. 2024-09-15T23:15:16.417 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T23:15:16.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.520+0000 7f16fc427640 1 Processor -- start 2024-09-15T23:15:16.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.520+0000 7f16fc427640 1 -- start start 2024-09-15T23:15:16.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.521+0000 7f16fc427640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16f415e9d0 0x7f16f41697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:16.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.521+0000 7f16fc427640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16f406f020 con 0x7f16f415e5f0 2024-09-15T23:15:16.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.521+0000 7f16fc427640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16f406e2a0 con 0x7f16f406c320 2024-09-15T23:15:16.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.521+0000 7f16fc427640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f16f406eb90 con 0x7f16f415e9d0 2024-09-15T23:15:16.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.521+0000 7f16fa1c3640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f16f415e5f0 0x7f16f406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58124/0 (socket says 172.21.15.123:58124) 2024-09-15T23:15:16.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.521+0000 7f16fa1c3640 1 -- 172.21.15.123:0/2422568330 learned_addr learned my addr 172.21.15.123:0/2422568330 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:16.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.522+0000 7f16fa9c4640 1 --2- 172.21.15.123:0/2422568330 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16f415e9d0 0x7f16f41697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:16.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.522+0000 7f16f91c1640 1 -- 172.21.15.123:0/2422568330 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 382308391 0 0) 0x7f16f406f020 con 0x7f16f415e5f0 2024-09-15T23:15:16.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.522+0000 7f16f91c1640 1 -- 172.21.15.123:0/2422568330 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16dc003520 con 0x7f16f415e5f0 2024-09-15T23:15:16.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.522+0000 7f16f91c1640 1 -- 172.21.15.123:0/2422568330 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2261501911 0 0) 0x7f16f406e2a0 con 0x7f16f406c320 2024-09-15T23:15:16.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.522+0000 7f16f91c1640 1 -- 172.21.15.123:0/2422568330 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16f406f020 con 0x7f16f406c320 2024-09-15T23:15:16.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.522+0000 7f16f91c1640 1 -- 172.21.15.123:0/2422568330 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 246131598 0 0) 0x7f16dc003520 con 0x7f16f415e5f0 2024-09-15T23:15:16.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.522+0000 7f16f91c1640 1 -- 172.21.15.123:0/2422568330 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16f415e9d0 msgr2=0x7f16f41697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:16.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.522+0000 7f16f91c1640 1 --2- 172.21.15.123:0/2422568330 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16f415e9d0 0x7f16f41697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:16.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.522+0000 7f16f91c1640 1 -- 172.21.15.123:0/2422568330 >> v1:172.21.15.188:6789/0 conn(0x7f16f406c320 legacy=0x7f16f40cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:16.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.522+0000 7f16f91c1640 1 -- 172.21.15.123:0/2422568330 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f406e540 con 0x7f16f415e5f0 2024-09-15T23:15:16.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.522+0000 7f16f91c1640 1 -- 172.21.15.123:0/2422568330 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f16ec001670 con 0x7f16f415e5f0 2024-09-15T23:15:16.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.522+0000 7f16f91c1640 1 -- 172.21.15.123:0/2422568330 >> v1:172.21.15.123:6789/0 conn(0x7f16f415e5f0 legacy=0x7f16f406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:16.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.522+0000 7f16f91c1640 1 --2- 172.21.15.123:0/2422568330 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16dc003b70 0x7f16dc003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:16.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.522+0000 7f16f91c1640 1 --2- 172.21.15.123:0/2422568330 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16dc004800 0x7f16dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:16.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.522+0000 7f16f91c1640 1 --2- 172.21.15.123:0/2422568330 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16f415e9d0 0x7f16dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:16.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.522+0000 7f16f91c1640 1 -- 172.21.15.123:0/2422568330 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f16f406eb90 con 0x7f16dc003b70 2024-09-15T23:15:16.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.522+0000 7f16f91c1640 1 -- 172.21.15.123:0/2422568330 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f16dc00baa0 con 0x7f16dc004800 2024-09-15T23:15:16.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.522+0000 7f16f91c1640 1 -- 172.21.15.123:0/2422568330 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f16dc00bca0 con 0x7f16f415e9d0 2024-09-15T23:15:16.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.522+0000 7f16fa1c3640 1 --2- 172.21.15.123:0/2422568330 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16dc003b70 0x7f16dc003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:16.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.522+0000 7f16f99c2640 1 --2- 172.21.15.123:0/2422568330 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16dc004800 0x7f16dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:16.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.522+0000 7f16fa9c4640 1 --2- 172.21.15.123:0/2422568330 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16f415e9d0 0x7f16dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:16.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.522+0000 7f16fa1c3640 1 -- 172.21.15.123:0/2422568330 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16f415e9d0 msgr2=0x7f16dc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:16.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.522+0000 7f16fa1c3640 1 --2- 172.21.15.123:0/2422568330 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16f415e9d0 0x7f16dc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:16.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.522+0000 7f16fa1c3640 1 -- 172.21.15.123:0/2422568330 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16dc004800 msgr2=0x7f16dc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:16.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.522+0000 7f16fa1c3640 1 --2- 172.21.15.123:0/2422568330 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16dc004800 0x7f16dc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:16.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.522+0000 7f16fa1c3640 1 -- 172.21.15.123:0/2422568330 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16dc003520 con 0x7f16dc003b70 2024-09-15T23:15:16.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.522+0000 7f16fa9c4640 1 --2- 172.21.15.123:0/2422568330 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16f415e9d0 0x7f16dc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:16.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.523+0000 7f16fa1c3640 1 --2- 172.21.15.123:0/2422568330 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16dc003b70 0x7f16dc003f70 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f16ec00c0e0 tx=0x7f16dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c03c5942f3222a65 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:16.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.523+0000 7f16f91c1640 1 -- 172.21.15.123:0/2422568330 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec007c40 con 0x7f16dc003b70 2024-09-15T23:15:16.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.523+0000 7f16f91c1640 1 -- 172.21.15.123:0/2422568330 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16ec005ad0 con 0x7f16dc003b70 2024-09-15T23:15:16.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.523+0000 7f16f91c1640 1 -- 172.21.15.123:0/2422568330 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec007070 con 0x7f16dc003b70 2024-09-15T23:15:16.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.524+0000 7f16fc427640 1 -- 172.21.15.123:0/2422568330 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16dc003b70 msgr2=0x7f16dc003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:16.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.524+0000 7f16fc427640 1 --2- 172.21.15.123:0/2422568330 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16dc003b70 0x7f16dc003f70 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f16ec00c0e0 tx=0x7f16dc005830 comp rx=0 tx=0).stop 2024-09-15T23:15:16.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.524+0000 7f16fa9c4640 1 -- 172.21.15.123:0/2422568330 reap_dead start 2024-09-15T23:15:16.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.524+0000 7f16fc427640 1 -- 172.21.15.123:0/2422568330 shutdown_connections 2024-09-15T23:15:16.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.524+0000 7f16fc427640 1 -- 172.21.15.123:0/2422568330 >> 172.21.15.123:0/2422568330 conn(0x7f16f40d14d0 msgr2=0x7f16f40d18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:16.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.524+0000 7f16fc427640 1 -- 172.21.15.123:0/2422568330 shutdown_connections 2024-09-15T23:15:16.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.524+0000 7f16fc427640 1 -- 172.21.15.123:0/2422568330 wait complete. 2024-09-15T23:15:16.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.525+0000 7f16fc427640 1 Processor -- start 2024-09-15T23:15:16.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.525+0000 7f16fc427640 1 -- start start 2024-09-15T23:15:16.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.526+0000 7f16fc427640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16dc003b70 0x7f16f41f5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:16.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.526+0000 7f16fc427640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16f4156ce0 0x7f16f40b64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:16.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.526+0000 7f16fc427640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16f40b6a30 0x7f16f4072550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:16.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.526+0000 7f16fc427640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f16f40cd770 con 0x7f16f4156ce0 2024-09-15T23:15:16.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.526+0000 7f16fc427640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f16f406c860 con 0x7f16dc003b70 2024-09-15T23:15:16.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.526+0000 7f16fc427640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f16f40cd8f0 con 0x7f16f40b6a30 2024-09-15T23:15:16.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.526+0000 7f16f99c2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16f4156ce0 0x7f16f40b64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:16.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.526+0000 7f16f99c2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16f4156ce0 0x7f16f40b64f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49292/0 (socket says 172.21.15.123:49292) 2024-09-15T23:15:16.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.526+0000 7f16f99c2640 1 -- 172.21.15.123:0/3048801622 learned_addr learned my addr 172.21.15.123:0/3048801622 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:16.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.526+0000 7f16fa1c3640 1 --2- 172.21.15.123:0/3048801622 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16dc003b70 0x7f16f41f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:16.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.526+0000 7f16fa9c4640 1 --2- 172.21.15.123:0/3048801622 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16f40b6a30 0x7f16f4072550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:16.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.526+0000 7f16f99c2640 1 -- 172.21.15.123:0/3048801622 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16f40b6a30 msgr2=0x7f16f4072550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:16.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.526+0000 7f16f99c2640 1 --2- 172.21.15.123:0/3048801622 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16f40b6a30 0x7f16f4072550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:16.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.526+0000 7f16f99c2640 1 -- 172.21.15.123:0/3048801622 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16dc003b70 msgr2=0x7f16f41f5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:16.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.526+0000 7f16f99c2640 1 --2- 172.21.15.123:0/3048801622 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16dc003b70 0x7f16f41f5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:16.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.526+0000 7f16f99c2640 1 -- 172.21.15.123:0/3048801622 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f41f45e0 con 0x7f16f4156ce0 2024-09-15T23:15:16.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.526+0000 7f16fa9c4640 1 --2- 172.21.15.123:0/3048801622 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16f40b6a30 0x7f16f4072550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:16.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.526+0000 7f16f99c2640 1 --2- 172.21.15.123:0/3048801622 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16f4156ce0 0x7f16f40b64f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f16e800fb90 tx=0x7f16e800d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:16.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.527+0000 7f16f2ffd640 1 -- 172.21.15.123:0/3048801622 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e801a070 con 0x7f16f4156ce0 2024-09-15T23:15:16.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.527+0000 7f16f2ffd640 1 -- 172.21.15.123:0/3048801622 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16e800dbd0 con 0x7f16f4156ce0 2024-09-15T23:15:16.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.527+0000 7f16f2ffd640 1 -- 172.21.15.123:0/3048801622 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e8006b50 con 0x7f16f4156ce0 2024-09-15T23:15:16.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.527+0000 7f16fc427640 1 -- 172.21.15.123:0/3048801622 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16f40b6eb0 con 0x7f16f4156ce0 2024-09-15T23:15:16.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.527+0000 7f16fc427640 1 -- 172.21.15.123:0/3048801622 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16f41f4b60 con 0x7f16f4156ce0 2024-09-15T23:15:16.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.528+0000 7f16fc427640 1 -- 172.21.15.123:0/3048801622 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16f40cd060 con 0x7f16f4156ce0 2024-09-15T23:15:16.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.528+0000 7f16f2ffd640 1 -- 172.21.15.123:0/3048801622 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f16e801d070 con 0x7f16f4156ce0 2024-09-15T23:15:16.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.528+0000 7f16f2ffd640 1 --2- 172.21.15.123:0/3048801622 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f16e006c2e0 0x7f16e006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:16.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.529+0000 7f16f2ffd640 1 -- 172.21.15.123:0/3048801622 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5227+0+0 (secure 0 0 0) 0x7f16e808ad50 con 0x7f16f4156ce0 2024-09-15T23:15:16.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.529+0000 7f16fa1c3640 1 --2- 172.21.15.123:0/3048801622 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f16e006c2e0 0x7f16e006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:16.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.529+0000 7f16fa1c3640 1 --2- 172.21.15.123:0/3048801622 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f16e006c2e0 0x7f16e006e7a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f16ec032000 tx=0x7f16ec034040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:16.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.533+0000 7f16f2ffd640 1 -- 172.21.15.123:0/3048801622 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f16e808e030 con 0x7f16f4156ce0 2024-09-15T23:15:16.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:16.698+0000 7f16fc427640 1 -- 172.21.15.123:0/3048801622 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f16f40b7450 con 0x7f16f4156ce0 2024-09-15T23:15:17.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.403+0000 7f16f2ffd640 1 -- 172.21.15.123:0/3048801622 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v64) ==== 170+0+0 (secure 0 0 0) 0x7f16e8059050 con 0x7f16f4156ce0 2024-09-15T23:15:17.406 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' created 2024-09-15T23:15:17.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.406+0000 7f16fc427640 1 -- 172.21.15.123:0/3048801622 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f16e006c2e0 msgr2=0x7f16e006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:17.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.406+0000 7f16fc427640 1 --2- 172.21.15.123:0/3048801622 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f16e006c2e0 0x7f16e006e7a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f16ec032000 tx=0x7f16ec034040 comp rx=0 tx=0).stop 2024-09-15T23:15:17.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.406+0000 7f16fc427640 1 -- 172.21.15.123:0/3048801622 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16f4156ce0 msgr2=0x7f16f40b64f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:17.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.406+0000 7f16fc427640 1 --2- 172.21.15.123:0/3048801622 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16f4156ce0 0x7f16f40b64f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f16e800fb90 tx=0x7f16e800d520 comp rx=0 tx=0).stop 2024-09-15T23:15:17.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.407+0000 7f16fc427640 1 -- 172.21.15.123:0/3048801622 shutdown_connections 2024-09-15T23:15:17.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.407+0000 7f16fc427640 1 --2- 172.21.15.123:0/3048801622 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16f40b6a30 0x7f16f4072550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:17.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.407+0000 7f16fc427640 1 --2- 172.21.15.123:0/3048801622 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f16e006c2e0 0x7f16e006e7a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:17.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.407+0000 7f16fc427640 1 --2- 172.21.15.123:0/3048801622 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16f4156ce0 0x7f16f40b64f0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:17.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.407+0000 7f16fc427640 1 --2- 172.21.15.123:0/3048801622 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16dc003b70 0x7f16f41f5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:17.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.407+0000 7f16fc427640 1 -- 172.21.15.123:0/3048801622 >> 172.21.15.123:0/3048801622 conn(0x7f16f40d14d0 msgr2=0x7f16f40b2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:17.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.407+0000 7f16fc427640 1 -- 172.21.15.123:0/3048801622 shutdown_connections 2024-09-15T23:15:17.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.410+0000 7f16fc427640 1 -- 172.21.15.123:0/3048801622 wait complete. 2024-09-15T23:15:17.434 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T23:15:17.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.535+0000 7f52f56d7640 1 Processor -- start 2024-09-15T23:15:17.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.535+0000 7f52f56d7640 1 -- start start 2024-09-15T23:15:17.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.536+0000 7f52f56d7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f52f0072ad0 0x7f52f00b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:17.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.536+0000 7f52f56d7640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52f00cf2e0 con 0x7f52f015b7c0 2024-09-15T23:15:17.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.536+0000 7f52f56d7640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52f0070fe0 con 0x7f52f00ccf30 2024-09-15T23:15:17.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.536+0000 7f52f56d7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f52f00712c0 con 0x7f52f0072ad0 2024-09-15T23:15:17.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.536+0000 7f52e67fc640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f52f015b7c0 0x7f52f00cead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58136/0 (socket says 172.21.15.123:58136) 2024-09-15T23:15:17.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.536+0000 7f52e67fc640 1 -- 172.21.15.123:0/1814010478 learned_addr learned my addr 172.21.15.123:0/1814010478 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:17.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.536+0000 7f52ee7fc640 1 -- 172.21.15.123:0/1814010478 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1672773574 0 0) 0x7f52f00cf2e0 con 0x7f52f015b7c0 2024-09-15T23:15:17.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.536+0000 7f52ee7fc640 1 -- 172.21.15.123:0/1814010478 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52dc003520 con 0x7f52f015b7c0 2024-09-15T23:15:17.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.536+0000 7f52ef7fe640 1 --2- 172.21.15.123:0/1814010478 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f52f0072ad0 0x7f52f00b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:17.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.537+0000 7f52ee7fc640 1 -- 172.21.15.123:0/1814010478 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2583165177 0 0) 0x7f52dc003520 con 0x7f52f015b7c0 2024-09-15T23:15:17.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.537+0000 7f52ee7fc640 1 -- 172.21.15.123:0/1814010478 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f52f0072ad0 msgr2=0x7f52f00b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:17.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.537+0000 7f52ee7fc640 1 --2- 172.21.15.123:0/1814010478 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f52f0072ad0 0x7f52f00b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:17.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.537+0000 7f52ee7fc640 1 -- 172.21.15.123:0/1814010478 >> v1:172.21.15.188:6789/0 conn(0x7f52f00ccf30 legacy=0x7f52f00cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:17.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.537+0000 7f52ee7fc640 1 -- 172.21.15.123:0/1814010478 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52f00715a0 con 0x7f52f015b7c0 2024-09-15T23:15:17.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.537+0000 7f52ee7fc640 1 -- 172.21.15.123:0/1814010478 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f52d8001670 con 0x7f52f015b7c0 2024-09-15T23:15:17.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.537+0000 7f52ee7fc640 1 -- 172.21.15.123:0/1814010478 >> v1:172.21.15.123:6789/0 conn(0x7f52f015b7c0 legacy=0x7f52f00cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:17.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.537+0000 7f52ee7fc640 1 --2- 172.21.15.123:0/1814010478 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f52f0072ad0 0x7f52dc0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:17.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.537+0000 7f52ee7fc640 1 --2- 172.21.15.123:0/1814010478 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52dc003fb0 0x7f52dc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:17.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.537+0000 7f52ee7fc640 1 --2- 172.21.15.123:0/1814010478 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f52dc004d40 0x7f52dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:17.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.537+0000 7f52ee7fc640 1 -- 172.21.15.123:0/1814010478 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f52f00712c0 con 0x7f52dc003fb0 2024-09-15T23:15:17.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.537+0000 7f52ee7fc640 1 -- 172.21.15.123:0/1814010478 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f52dc00bbb0 con 0x7f52dc004d40 2024-09-15T23:15:17.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.537+0000 7f52ee7fc640 1 -- 172.21.15.123:0/1814010478 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f52dc00bdb0 con 0x7f52f0072ad0 2024-09-15T23:15:17.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.537+0000 7f52e67fc640 1 --2- 172.21.15.123:0/1814010478 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52dc003fb0 0x7f52dc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:17.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.537+0000 7f52eeffd640 1 --2- 172.21.15.123:0/1814010478 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f52f0072ad0 0x7f52dc0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:17.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.537+0000 7f52ef7fe640 1 --2- 172.21.15.123:0/1814010478 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f52dc004d40 0x7f52dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:17.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.537+0000 7f52e67fc640 1 -- 172.21.15.123:0/1814010478 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f52f0072ad0 msgr2=0x7f52dc0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:17.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.537+0000 7f52e67fc640 1 --2- 172.21.15.123:0/1814010478 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f52f0072ad0 0x7f52dc0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:17.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.537+0000 7f52e67fc640 1 -- 172.21.15.123:0/1814010478 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f52dc004d40 msgr2=0x7f52dc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:17.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.537+0000 7f52e67fc640 1 --2- 172.21.15.123:0/1814010478 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f52dc004d40 0x7f52dc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:17.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.537+0000 7f52e67fc640 1 -- 172.21.15.123:0/1814010478 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52dc003520 con 0x7f52dc003fb0 2024-09-15T23:15:17.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.538+0000 7f52e67fc640 1 --2- 172.21.15.123:0/1814010478 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52dc003fb0 0x7f52dc004800 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f52d800c190 tx=0x7f52dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=258a282a8c7e0597 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:17.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.538+0000 7f52ee7fc640 1 -- 172.21.15.123:0/1814010478 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d8007c60 con 0x7f52dc003fb0 2024-09-15T23:15:17.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.538+0000 7f52ee7fc640 1 -- 172.21.15.123:0/1814010478 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d8005af0 con 0x7f52dc003fb0 2024-09-15T23:15:17.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.538+0000 7f52ee7fc640 1 -- 172.21.15.123:0/1814010478 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d8007070 con 0x7f52dc003fb0 2024-09-15T23:15:17.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.538+0000 7f52f56d7640 1 -- 172.21.15.123:0/1814010478 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52dc003fb0 msgr2=0x7f52dc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:17.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.538+0000 7f52f56d7640 1 --2- 172.21.15.123:0/1814010478 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52dc003fb0 0x7f52dc004800 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f52d800c190 tx=0x7f52dc005830 comp rx=0 tx=0).stop 2024-09-15T23:15:17.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.539+0000 7f52ef7fe640 1 -- 172.21.15.123:0/1814010478 reap_dead start 2024-09-15T23:15:17.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.539+0000 7f52f56d7640 1 -- 172.21.15.123:0/1814010478 shutdown_connections 2024-09-15T23:15:17.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.539+0000 7f52f56d7640 1 -- 172.21.15.123:0/1814010478 >> 172.21.15.123:0/1814010478 conn(0x7f52f006d0f0 msgr2=0x7f52f006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:17.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.539+0000 7f52f56d7640 1 -- 172.21.15.123:0/1814010478 shutdown_connections 2024-09-15T23:15:17.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.539+0000 7f52f56d7640 1 -- 172.21.15.123:0/1814010478 wait complete. 2024-09-15T23:15:17.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.540+0000 7f52f56d7640 1 Processor -- start 2024-09-15T23:15:17.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.540+0000 7f52f56d7640 1 -- start start 2024-09-15T23:15:17.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.541+0000 7f52f56d7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52dc003fb0 0x7f52f0144290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:17.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.541+0000 7f52f56d7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f52f014ffd0 0x7f52f0150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:17.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.541+0000 7f52f56d7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f52f015a4f0 0x7f52f015a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:17.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.541+0000 7f52f56d7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f52f00b2dd0 con 0x7f52dc003fb0 2024-09-15T23:15:17.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.541+0000 7f52f56d7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f52f00b2c50 con 0x7f52f014ffd0 2024-09-15T23:15:17.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.541+0000 7f52f56d7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f52f00b2f50 con 0x7f52f015a4f0 2024-09-15T23:15:17.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.541+0000 7f52eeffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52dc003fb0 0x7f52f0144290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:17.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.541+0000 7f52eeffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52dc003fb0 0x7f52f0144290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49310/0 (socket says 172.21.15.123:49310) 2024-09-15T23:15:17.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.541+0000 7f52eeffd640 1 -- 172.21.15.123:0/3065619390 learned_addr learned my addr 172.21.15.123:0/3065619390 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:17.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.541+0000 7f52ef7fe640 1 --2- 172.21.15.123:0/3065619390 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f52f015a4f0 0x7f52f015a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:17.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.541+0000 7f52e67fc640 1 --2- 172.21.15.123:0/3065619390 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f52f014ffd0 0x7f52f0150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:17.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.541+0000 7f52eeffd640 1 -- 172.21.15.123:0/3065619390 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f52f015a4f0 msgr2=0x7f52f015a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:17.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.541+0000 7f52eeffd640 1 --2- 172.21.15.123:0/3065619390 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f52f015a4f0 0x7f52f015a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:17.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.541+0000 7f52eeffd640 1 -- 172.21.15.123:0/3065619390 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f52f014ffd0 msgr2=0x7f52f0150430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:17.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.541+0000 7f52eeffd640 1 --2- 172.21.15.123:0/3065619390 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f52f014ffd0 0x7f52f0150430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:17.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.541+0000 7f52eeffd640 1 -- 172.21.15.123:0/3065619390 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52f0152350 con 0x7f52dc003fb0 2024-09-15T23:15:17.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.541+0000 7f52eeffd640 1 --2- 172.21.15.123:0/3065619390 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52dc003fb0 0x7f52f0144290 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f52e000f850 tx=0x7f52e000fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:17.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.541+0000 7f52e7fff640 1 -- 172.21.15.123:0/3065619390 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e000fe40 con 0x7f52dc003fb0 2024-09-15T23:15:17.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.541+0000 7f52e7fff640 1 -- 172.21.15.123:0/3065619390 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52e0018070 con 0x7f52dc003fb0 2024-09-15T23:15:17.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.541+0000 7f52f56d7640 1 -- 172.21.15.123:0/3065619390 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52f0152630 con 0x7f52dc003fb0 2024-09-15T23:15:17.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.541+0000 7f52e7fff640 1 -- 172.21.15.123:0/3065619390 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e000d730 con 0x7f52dc003fb0 2024-09-15T23:15:17.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.541+0000 7f52f56d7640 1 -- 172.21.15.123:0/3065619390 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52f0152bf0 con 0x7f52dc003fb0 2024-09-15T23:15:17.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.543+0000 7f52f56d7640 1 -- 172.21.15.123:0/3065619390 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52f00cd310 con 0x7f52dc003fb0 2024-09-15T23:15:17.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.543+0000 7f52e7fff640 1 -- 172.21.15.123:0/3065619390 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f52e000d8d0 con 0x7f52dc003fb0 2024-09-15T23:15:17.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.543+0000 7f52e7fff640 1 --2- 172.21.15.123:0/3065619390 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f52d006c2b0 0x7f52d006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:17.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.544+0000 7f52e7fff640 1 -- 172.21.15.123:0/3065619390 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5609+0+0 (secure 0 0 0) 0x7f52e008b130 con 0x7f52dc003fb0 2024-09-15T23:15:17.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.544+0000 7f52e67fc640 1 --2- 172.21.15.123:0/3065619390 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f52d006c2b0 0x7f52d006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:17.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.544+0000 7f52e67fc640 1 --2- 172.21.15.123:0/3065619390 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f52d006c2b0 0x7f52d006e770 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f52d800c160 tx=0x7f52d8009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:17.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.548+0000 7f52e7fff640 1 -- 172.21.15.123:0/3065619390 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f52e00592b0 con 0x7f52dc003fb0 2024-09-15T23:15:17.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:17.749+0000 7f52f56d7640 1 -- 172.21.15.123:0/3065619390 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f52f00cc960 con 0x7f52dc003fb0 2024-09-15T23:15:18.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.413+0000 7f52e7fff640 1 -- 172.21.15.123:0/3065619390 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v27) ==== 172+0+0 (secure 0 0 0) 0x7f52e005d5b0 con 0x7f52dc003fb0 2024-09-15T23:15:18.416 INFO:teuthology.orchestra.run.smithi123.stderr:new fs with metadata pool 8 and data pool 9 2024-09-15T23:15:18.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.426+0000 7f52f56d7640 1 -- 172.21.15.123:0/3065619390 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f52d006c2b0 msgr2=0x7f52d006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:18.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.426+0000 7f52f56d7640 1 --2- 172.21.15.123:0/3065619390 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f52d006c2b0 0x7f52d006e770 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f52d800c160 tx=0x7f52d8009030 comp rx=0 tx=0).stop 2024-09-15T23:15:18.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.426+0000 7f52f56d7640 1 -- 172.21.15.123:0/3065619390 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52dc003fb0 msgr2=0x7f52f0144290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:18.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.426+0000 7f52f56d7640 1 --2- 172.21.15.123:0/3065619390 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52dc003fb0 0x7f52f0144290 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f52e000f850 tx=0x7f52e000fd10 comp rx=0 tx=0).stop 2024-09-15T23:15:18.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.426+0000 7f52f56d7640 1 -- 172.21.15.123:0/3065619390 shutdown_connections 2024-09-15T23:15:18.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.426+0000 7f52f56d7640 1 --2- 172.21.15.123:0/3065619390 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f52f015a4f0 0x7f52f015a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:18.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.426+0000 7f52f56d7640 1 --2- 172.21.15.123:0/3065619390 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f52f014ffd0 0x7f52f0150430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:18.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.426+0000 7f52f56d7640 1 --2- 172.21.15.123:0/3065619390 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f52d006c2b0 0x7f52d006e770 secure :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f52d800c160 tx=0x7f52d8009030 comp rx=0 tx=0).stop 2024-09-15T23:15:18.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.426+0000 7f52f56d7640 1 --2- 172.21.15.123:0/3065619390 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52dc003fb0 0x7f52f0144290 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:18.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.426+0000 7f52f56d7640 1 -- 172.21.15.123:0/3065619390 >> 172.21.15.123:0/3065619390 conn(0x7f52f006d0f0 msgr2=0x7f52f015eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:18.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.427+0000 7f52f56d7640 1 -- 172.21.15.123:0/3065619390 shutdown_connections 2024-09-15T23:15:18.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.428+0000 7f52f56d7640 1 -- 172.21.15.123:0/3065619390 wait complete. 2024-09-15T23:15:18.448 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:15:18.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.546+0000 7f435baa5640 1 Processor -- start 2024-09-15T23:15:18.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.547+0000 7f435baa5640 1 -- start start 2024-09-15T23:15:18.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.547+0000 7f435baa5640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f435415ed20 0x7f43540b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:18.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.547+0000 7f435baa5640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43540d23b0 0x7f43540b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:18.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.547+0000 7f435baa5640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f43540cf2d0 0x7f43540cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:18.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.547+0000 7f435baa5640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f43540d0e70 con 0x7f43540cf2d0 2024-09-15T23:15:18.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.547+0000 7f435baa5640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f43540d41c0 con 0x7f435415ed20 2024-09-15T23:15:18.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.547+0000 7f435baa5640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f43540d35b0 con 0x7f43540d23b0 2024-09-15T23:15:18.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.548+0000 7f435a042640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f43540cf2d0 0x7f43540cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:18.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.548+0000 7f435a042640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f43540cf2d0 0x7f43540cf760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49316/0 (socket says 172.21.15.123:49316) 2024-09-15T23:15:18.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.548+0000 7f435a042640 1 -- 172.21.15.123:0/1887976623 learned_addr learned my addr 172.21.15.123:0/1887976623 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:18.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.548+0000 7f4359841640 1 --2- 172.21.15.123:0/1887976623 >> v2:172.21.15.188:3300/0 conn(0x7f435415ed20 0x7f43540b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:18.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.548+0000 7f4359040640 1 --2- 172.21.15.123:0/1887976623 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43540d23b0 0x7f43540b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:18.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.548+0000 7f435a042640 1 -- 172.21.15.123:0/1887976623 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43540d23b0 msgr2=0x7f43540b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:18.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.548+0000 7f435a042640 1 --2- 172.21.15.123:0/1887976623 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43540d23b0 0x7f43540b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:18.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.548+0000 7f435a042640 1 -- 172.21.15.123:0/1887976623 >> v2:172.21.15.188:3300/0 conn(0x7f435415ed20 msgr2=0x7f43540b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:18.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.548+0000 7f435a042640 1 --2- 172.21.15.123:0/1887976623 >> v2:172.21.15.188:3300/0 conn(0x7f435415ed20 0x7f43540b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:18.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.548+0000 7f435a042640 1 -- 172.21.15.123:0/1887976623 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43540d3890 con 0x7f43540cf2d0 2024-09-15T23:15:18.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.548+0000 7f4359841640 1 --2- 172.21.15.123:0/1887976623 >> v2:172.21.15.188:3300/0 conn(0x7f435415ed20 0x7f43540b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:18.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.549+0000 7f435a042640 1 --2- 172.21.15.123:0/1887976623 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43540cf2d0 0x7f43540cf760 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f43540d47b0 tx=0x7f434c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f248c7ffc7659aa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:18.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.549+0000 7f435883f640 1 -- 172.21.15.123:0/1887976623 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434c036070 con 0x7f43540cf2d0 2024-09-15T23:15:18.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.549+0000 7f435883f640 1 -- 172.21.15.123:0/1887976623 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f434c031600 con 0x7f43540cf2d0 2024-09-15T23:15:18.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.549+0000 7f435883f640 1 -- 172.21.15.123:0/1887976623 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f434c0319d0 con 0x7f43540cf2d0 2024-09-15T23:15:18.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.549+0000 7f435baa5640 1 -- 172.21.15.123:0/1887976623 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43540cf2d0 msgr2=0x7f43540cf760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:18.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.549+0000 7f435baa5640 1 --2- 172.21.15.123:0/1887976623 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43540cf2d0 0x7f43540cf760 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f43540d47b0 tx=0x7f434c02a6a0 comp rx=0 tx=0).stop 2024-09-15T23:15:18.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.549+0000 7f435baa5640 1 -- 172.21.15.123:0/1887976623 shutdown_connections 2024-09-15T23:15:18.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.549+0000 7f435baa5640 1 --2- 172.21.15.123:0/1887976623 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43540cf2d0 0x7f43540cf760 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:18.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.549+0000 7f435baa5640 1 --2- 172.21.15.123:0/1887976623 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43540d23b0 0x7f43540b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:18.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.549+0000 7f435baa5640 1 --2- 172.21.15.123:0/1887976623 >> v2:172.21.15.188:3300/0 conn(0x7f435415ed20 0x7f43540b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:18.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.549+0000 7f435baa5640 1 -- 172.21.15.123:0/1887976623 >> 172.21.15.123:0/1887976623 conn(0x7f43540d1260 msgr2=0x7f43540d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:18.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.549+0000 7f435baa5640 1 -- 172.21.15.123:0/1887976623 shutdown_connections 2024-09-15T23:15:18.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.549+0000 7f435baa5640 1 -- 172.21.15.123:0/1887976623 wait complete. 2024-09-15T23:15:18.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.550+0000 7f435baa5640 1 Processor -- start 2024-09-15T23:15:18.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.550+0000 7f435baa5640 1 -- start start 2024-09-15T23:15:18.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.551+0000 7f435baa5640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43540cf2d0 0x7f435414fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:18.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.551+0000 7f435baa5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43540d23b0 0x7f43540cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:18.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.551+0000 7f435baa5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f435415ed20 0x7f43540cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:18.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.551+0000 7f435baa5640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f43540d32a0 con 0x7f43540d23b0 2024-09-15T23:15:18.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.551+0000 7f435baa5640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f43540d3e50 con 0x7f435415ed20 2024-09-15T23:15:18.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.551+0000 7f435baa5640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f435415f100 con 0x7f43540cf2d0 2024-09-15T23:15:18.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.551+0000 7f4359040640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43540d23b0 0x7f43540cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:18.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.551+0000 7f4359040640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43540d23b0 0x7f43540cb8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49332/0 (socket says 172.21.15.123:49332) 2024-09-15T23:15:18.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.551+0000 7f4359040640 1 -- 172.21.15.123:0/2543750110 learned_addr learned my addr 172.21.15.123:0/2543750110 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:18.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.551+0000 7f435a042640 1 --2- 172.21.15.123:0/2543750110 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f435415ed20 0x7f43540cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:18.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.551+0000 7f4359841640 1 --2- 172.21.15.123:0/2543750110 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43540cf2d0 0x7f435414fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:18.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.552+0000 7f4359040640 1 -- 172.21.15.123:0/2543750110 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43540cf2d0 msgr2=0x7f435414fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:18.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.552+0000 7f4359040640 1 --2- 172.21.15.123:0/2543750110 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43540cf2d0 0x7f435414fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:18.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.552+0000 7f4359040640 1 -- 172.21.15.123:0/2543750110 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f435415ed20 msgr2=0x7f43540cbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:18.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.552+0000 7f4359040640 1 --2- 172.21.15.123:0/2543750110 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f435415ed20 0x7f43540cbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:18.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.552+0000 7f4359040640 1 -- 172.21.15.123:0/2543750110 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43540cd560 con 0x7f43540d23b0 2024-09-15T23:15:18.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.552+0000 7f4359040640 1 --2- 172.21.15.123:0/2543750110 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43540d23b0 0x7f43540cb8b0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f434400d7d0 tx=0x7f434400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:18.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.552+0000 7f434a7fc640 1 -- 172.21.15.123:0/2543750110 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4344018030 con 0x7f43540d23b0 2024-09-15T23:15:18.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.552+0000 7f434a7fc640 1 -- 172.21.15.123:0/2543750110 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4344004020 con 0x7f43540d23b0 2024-09-15T23:15:18.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.552+0000 7f435baa5640 1 -- 172.21.15.123:0/2543750110 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43540cc420 con 0x7f43540d23b0 2024-09-15T23:15:18.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.552+0000 7f434a7fc640 1 -- 172.21.15.123:0/2543750110 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4344004230 con 0x7f43540d23b0 2024-09-15T23:15:18.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.552+0000 7f435baa5640 1 -- 172.21.15.123:0/2543750110 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f435415f3e0 con 0x7f43540d23b0 2024-09-15T23:15:18.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.553+0000 7f435baa5640 1 -- 172.21.15.123:0/2543750110 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43540b7010 con 0x7f43540d23b0 2024-09-15T23:15:18.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.553+0000 7f434a7fc640 1 -- 172.21.15.123:0/2543750110 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f434401b070 con 0x7f43540d23b0 2024-09-15T23:15:18.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.554+0000 7f434a7fc640 1 --2- 172.21.15.123:0/2543750110 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f433806c2e0 0x7f433806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:18.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.554+0000 7f434a7fc640 1 -- 172.21.15.123:0/2543750110 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5709+0+0 (secure 0 0 0) 0x7f434408b4b0 con 0x7f43540d23b0 2024-09-15T23:15:18.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.554+0000 7f4359841640 1 --2- 172.21.15.123:0/2543750110 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f433806c2e0 0x7f433806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:18.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.554+0000 7f4359841640 1 --2- 172.21.15.123:0/2543750110 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f433806c2e0 0x7f433806e7a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4350006fd0 tx=0x7f4350008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:18.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.558+0000 7f434a7fc640 1 -- 172.21.15.123:0/2543750110 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4344059cb0 con 0x7f43540d23b0 2024-09-15T23:15:18.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.722+0000 7f435baa5640 1 -- 172.21.15.123:0/2543750110 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f43540d0a90 con 0x7f43540d23b0 2024-09-15T23:15:18.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.724+0000 7f434a7fc640 1 -- 172.21.15.123:0/2543750110 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) ==== 74+0+16762 (secure 0 0 0) 0x7f43440595b0 con 0x7f43540d23b0 2024-09-15T23:15:18.726 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:18.726 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":65,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:15:17.751985+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:15:16.362912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-15T23:15:16.718663+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:15:18.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.726+0000 7f435baa5640 1 -- 172.21.15.123:0/2543750110 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f433806c2e0 msgr2=0x7f433806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:18.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.726+0000 7f435baa5640 1 --2- 172.21.15.123:0/2543750110 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f433806c2e0 0x7f433806e7a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4350006fd0 tx=0x7f4350008040 comp rx=0 tx=0).stop 2024-09-15T23:15:18.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.726+0000 7f435baa5640 1 -- 172.21.15.123:0/2543750110 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43540d23b0 msgr2=0x7f43540cb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:18.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.726+0000 7f435baa5640 1 --2- 172.21.15.123:0/2543750110 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43540d23b0 0x7f43540cb8b0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f434400d7d0 tx=0x7f434400dc90 comp rx=0 tx=0).stop 2024-09-15T23:15:18.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.726+0000 7f435baa5640 1 -- 172.21.15.123:0/2543750110 shutdown_connections 2024-09-15T23:15:18.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.726+0000 7f435baa5640 1 --2- 172.21.15.123:0/2543750110 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f435415ed20 0x7f43540cbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:18.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.726+0000 7f435baa5640 1 --2- 172.21.15.123:0/2543750110 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f433806c2e0 0x7f433806e7a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:18.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.726+0000 7f435baa5640 1 --2- 172.21.15.123:0/2543750110 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43540d23b0 0x7f43540cb8b0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:18.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.726+0000 7f435baa5640 1 --2- 172.21.15.123:0/2543750110 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43540cf2d0 0x7f435414fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:18.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.726+0000 7f435baa5640 1 -- 172.21.15.123:0/2543750110 >> 172.21.15.123:0/2543750110 conn(0x7f43540d1260 msgr2=0x7f43540b4910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:18.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.726+0000 7f435baa5640 1 -- 172.21.15.123:0/2543750110 shutdown_connections 2024-09-15T23:15:18.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.726+0000 7f435baa5640 1 -- 172.21.15.123:0/2543750110 wait complete. 2024-09-15T23:15:18.739 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:15:18.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.835+0000 7f998748d640 1 Processor -- start 2024-09-15T23:15:18.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.835+0000 7f998748d640 1 -- start start 2024-09-15T23:15:18.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.836+0000 7f998748d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f998015e790 0x7f9980073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:18.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.836+0000 7f998748d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9980162c60 0x7f99800b5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:18.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.836+0000 7f998748d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99801631c0 con 0x7f99800b5970 2024-09-15T23:15:18.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.836+0000 7f998748d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f998015eb70 con 0x7f9980162c60 2024-09-15T23:15:18.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.836+0000 7f998748d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f99800ae9a0 con 0x7f998015e790 2024-09-15T23:15:18.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.836+0000 7f9984a28640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9980162c60 0x7f99800b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:18.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.836+0000 7f9984a28640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9980162c60 0x7f99800b5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49342/0 (socket says 172.21.15.123:49342) 2024-09-15T23:15:18.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.836+0000 7f9985a2a640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f99800b5970 0x7f998006f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58152/0 (socket says 172.21.15.123:58152) 2024-09-15T23:15:18.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.836+0000 7f9984a28640 1 -- 172.21.15.123:0/2525395203 learned_addr learned my addr 172.21.15.123:0/2525395203 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:18.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.836+0000 7f9985229640 1 --2- 172.21.15.123:0/2525395203 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f998015e790 0x7f9980073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:18.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.836+0000 7f9984a28640 1 -- 172.21.15.123:0/2525395203 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f998015e790 msgr2=0x7f9980073a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:18.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.836+0000 7f9984a28640 1 --2- 172.21.15.123:0/2525395203 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f998015e790 0x7f9980073a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:18.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.836+0000 7f9984a28640 1 -- 172.21.15.123:0/2525395203 >> v1:172.21.15.123:6789/0 conn(0x7f99800b5970 legacy=0x7f998006f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:18.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.837+0000 7f9984a28640 1 -- 172.21.15.123:0/2525395203 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99800aec40 con 0x7f9980162c60 2024-09-15T23:15:18.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.837+0000 7f9977fff640 1 -- 172.21.15.123:0/2525395203 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1352630706 0 0) 0x7f99801631c0 con 0x7f99800b5970 2024-09-15T23:15:18.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.837+0000 7f9984a28640 1 --2- 172.21.15.123:0/2525395203 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9980162c60 0x7f99800b5430 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f9970009870 tx=0x7f997002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca9cb6cfc2dc66cc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:18.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.837+0000 7f9977fff640 1 -- 172.21.15.123:0/2525395203 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9970037070 con 0x7f9980162c60 2024-09-15T23:15:18.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.837+0000 7f9977fff640 1 -- 172.21.15.123:0/2525395203 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9970032440 con 0x7f9980162c60 2024-09-15T23:15:18.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.837+0000 7f9977fff640 1 -- 172.21.15.123:0/2525395203 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9970032810 con 0x7f9980162c60 2024-09-15T23:15:18.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.838+0000 7f998748d640 1 -- 172.21.15.123:0/2525395203 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9980162c60 msgr2=0x7f99800b5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:18.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.838+0000 7f998748d640 1 --2- 172.21.15.123:0/2525395203 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9980162c60 0x7f99800b5430 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f9970009870 tx=0x7f997002a1c0 comp rx=0 tx=0).stop 2024-09-15T23:15:18.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.838+0000 7f998748d640 1 -- 172.21.15.123:0/2525395203 shutdown_connections 2024-09-15T23:15:18.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.838+0000 7f998748d640 1 --2- 172.21.15.123:0/2525395203 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9980162c60 0x7f99800b5430 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:18.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.838+0000 7f998748d640 1 --2- 172.21.15.123:0/2525395203 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f998015e790 0x7f9980073a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:18.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.838+0000 7f998748d640 1 -- 172.21.15.123:0/2525395203 >> 172.21.15.123:0/2525395203 conn(0x7f99800b0a80 msgr2=0x7f99800b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:18.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.838+0000 7f998748d640 1 -- 172.21.15.123:0/2525395203 shutdown_connections 2024-09-15T23:15:18.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.838+0000 7f998748d640 1 -- 172.21.15.123:0/2525395203 wait complete. 2024-09-15T23:15:18.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.839+0000 7f998748d640 1 Processor -- start 2024-09-15T23:15:18.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.839+0000 7f998748d640 1 -- start start 2024-09-15T23:15:18.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.840+0000 7f998748d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f99800b5970 0x7f99801f5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:18.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.840+0000 7f998748d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f998015e790 0x7f99801622f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:18.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.840+0000 7f998748d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9980162c60 0x7f9980156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:18.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.840+0000 7f998748d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f998006f430 con 0x7f998015e790 2024-09-15T23:15:18.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.840+0000 7f998748d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f99800af200 con 0x7f9980162c60 2024-09-15T23:15:18.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.840+0000 7f998748d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f998006fe40 con 0x7f99800b5970 2024-09-15T23:15:18.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.840+0000 7f9984a28640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f998015e790 0x7f99801622f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:18.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.840+0000 7f9984a28640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f998015e790 0x7f99801622f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49356/0 (socket says 172.21.15.123:49356) 2024-09-15T23:15:18.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.840+0000 7f9984a28640 1 -- 172.21.15.123:0/3219023034 learned_addr learned my addr 172.21.15.123:0/3219023034 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:18.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.840+0000 7f9985229640 1 --2- 172.21.15.123:0/3219023034 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f99800b5970 0x7f99801f5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:18.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.840+0000 7f9985a2a640 1 --2- 172.21.15.123:0/3219023034 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9980162c60 0x7f9980156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:18.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.840+0000 7f9984a28640 1 -- 172.21.15.123:0/3219023034 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f99800b5970 msgr2=0x7f99801f5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:18.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.840+0000 7f9984a28640 1 --2- 172.21.15.123:0/3219023034 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f99800b5970 0x7f99801f5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:18.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.840+0000 7f9984a28640 1 -- 172.21.15.123:0/3219023034 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9980162c60 msgr2=0x7f9980156410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:18.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.840+0000 7f9984a28640 1 --2- 172.21.15.123:0/3219023034 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9980162c60 0x7f9980156410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:18.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.840+0000 7f9984a28640 1 -- 172.21.15.123:0/3219023034 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99800d0830 con 0x7f998015e790 2024-09-15T23:15:18.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.840+0000 7f9985a2a640 1 --2- 172.21.15.123:0/3219023034 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9980162c60 0x7f9980156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:18.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.840+0000 7f9984a28640 1 --2- 172.21.15.123:0/3219023034 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f998015e790 0x7f99801622f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f99700090b0 tx=0x7f99700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:18.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.841+0000 7f9975ffb640 1 -- 172.21.15.123:0/3219023034 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9970037040 con 0x7f998015e790 2024-09-15T23:15:18.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.841+0000 7f9975ffb640 1 -- 172.21.15.123:0/3219023034 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9970004230 con 0x7f998015e790 2024-09-15T23:15:18.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.841+0000 7f9975ffb640 1 -- 172.21.15.123:0/3219023034 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9970003610 con 0x7f998015e790 2024-09-15T23:15:18.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.841+0000 7f998748d640 1 -- 172.21.15.123:0/3219023034 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99801590b0 con 0x7f998015e790 2024-09-15T23:15:18.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.841+0000 7f998748d640 1 -- 172.21.15.123:0/3219023034 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9980159670 con 0x7f998015e790 2024-09-15T23:15:18.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.842+0000 7f998748d640 1 -- 172.21.15.123:0/3219023034 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9980073a40 con 0x7f998015e790 2024-09-15T23:15:18.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.842+0000 7f9975ffb640 1 -- 172.21.15.123:0/3219023034 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f997002ad10 con 0x7f998015e790 2024-09-15T23:15:18.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.843+0000 7f9975ffb640 1 --2- 172.21.15.123:0/3219023034 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f996406c2b0 0x7f996406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:18.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.843+0000 7f9975ffb640 1 -- 172.21.15.123:0/3219023034 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5709+0+0 (secure 0 0 0) 0x7f99700abdc0 con 0x7f998015e790 2024-09-15T23:15:18.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.843+0000 7f9985229640 1 --2- 172.21.15.123:0/3219023034 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f996406c2b0 0x7f996406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:18.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.843+0000 7f9985229640 1 --2- 172.21.15.123:0/3219023034 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f996406c2b0 0x7f996406e770 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f997c003b80 tx=0x7f997c0098d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:18.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:18.847+0000 7f9975ffb640 1 -- 172.21.15.123:0/3219023034 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f99800d0830 con 0x7f998015e790 2024-09-15T23:15:19.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.013+0000 7f998748d640 1 -- 172.21.15.123:0/3219023034 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f99800b22d0 con 0x7f998015e790 2024-09-15T23:15:19.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.014+0000 7f9975ffb640 1 -- 172.21.15.123:0/3219023034 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) ==== 74+0+16762 (secure 0 0 0) 0x7f997007a5c0 con 0x7f998015e790 2024-09-15T23:15:19.016 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:19.016 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":65,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:15:17.751985+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:15:16.362912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-15T23:15:16.718663+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:15:19.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.016+0000 7f998748d640 1 -- 172.21.15.123:0/3219023034 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f996406c2b0 msgr2=0x7f996406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:19.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.016+0000 7f998748d640 1 --2- 172.21.15.123:0/3219023034 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f996406c2b0 0x7f996406e770 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f997c003b80 tx=0x7f997c0098d0 comp rx=0 tx=0).stop 2024-09-15T23:15:19.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.016+0000 7f998748d640 1 -- 172.21.15.123:0/3219023034 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f998015e790 msgr2=0x7f99801622f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:19.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.016+0000 7f998748d640 1 --2- 172.21.15.123:0/3219023034 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f998015e790 0x7f99801622f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f99700090b0 tx=0x7f99700046c0 comp rx=0 tx=0).stop 2024-09-15T23:15:19.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.016+0000 7f998748d640 1 -- 172.21.15.123:0/3219023034 shutdown_connections 2024-09-15T23:15:19.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.016+0000 7f998748d640 1 --2- 172.21.15.123:0/3219023034 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9980162c60 0x7f9980156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:19.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.016+0000 7f998748d640 1 --2- 172.21.15.123:0/3219023034 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f996406c2b0 0x7f996406e770 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:19.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.016+0000 7f998748d640 1 --2- 172.21.15.123:0/3219023034 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f998015e790 0x7f99801622f0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:19.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.016+0000 7f998748d640 1 --2- 172.21.15.123:0/3219023034 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f99800b5970 0x7f99801f5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:19.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.016+0000 7f998748d640 1 -- 172.21.15.123:0/3219023034 >> 172.21.15.123:0/3219023034 conn(0x7f99800b0a80 msgr2=0x7f99800717a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:19.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.016+0000 7f998748d640 1 -- 172.21.15.123:0/3219023034 shutdown_connections 2024-09-15T23:15:19.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.016+0000 7f998748d640 1 -- 172.21.15.123:0/3219023034 wait complete. 2024-09-15T23:15:19.029 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T23:15:19.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.128+0000 7f9a6128b640 1 Processor -- start 2024-09-15T23:15:19.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.128+0000 7f9a6128b640 1 -- start start 2024-09-15T23:15:19.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.129+0000 7f9a6128b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f9a5c15e900 0x7f9a5c0d3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:19.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.129+0000 7f9a6128b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9a5c0cfca0 0x7f9a5c06d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:19.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.129+0000 7f9a6128b640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a5c0b7940 con 0x7f9a5c06dce0 2024-09-15T23:15:19.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.129+0000 7f9a6128b640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f9a5c06e150 con 0x7f9a5c0cfca0 2024-09-15T23:15:19.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.129+0000 7f9a6128b640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f9a5c15ece0 con 0x7f9a5c15e900 2024-09-15T23:15:19.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.129+0000 7f9a527fc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9a5c0cfca0 0x7f9a5c06d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:19.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.129+0000 7f9a527fc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9a5c0cfca0 0x7f9a5c06d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49370/0 (socket says 172.21.15.123:49370) 2024-09-15T23:15:19.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.129+0000 7f9a527fc640 1 -- 172.21.15.123:0/2232498240 learned_addr learned my addr 172.21.15.123:0/2232498240 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:19.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.129+0000 7f9a5b7fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f9a5c06dce0 0x7f9a5c06bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58160/0 (socket says 172.21.15.123:58160) 2024-09-15T23:15:19.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.129+0000 7f9a5affd640 1 --2- 172.21.15.123:0/2232498240 >> v2:172.21.15.188:3300/0 conn(0x7f9a5c15e900 0x7f9a5c0d3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:19.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.129+0000 7f9a527fc640 1 -- 172.21.15.123:0/2232498240 >> v2:172.21.15.188:3300/0 conn(0x7f9a5c15e900 msgr2=0x7f9a5c0d3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:19.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.129+0000 7f9a527fc640 1 --2- 172.21.15.123:0/2232498240 >> v2:172.21.15.188:3300/0 conn(0x7f9a5c15e900 0x7f9a5c0d3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:19.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.129+0000 7f9a527fc640 1 -- 172.21.15.123:0/2232498240 >> v1:172.21.15.123:6789/0 conn(0x7f9a5c06dce0 legacy=0x7f9a5c06bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:19.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.129+0000 7f9a527fc640 1 -- 172.21.15.123:0/2232498240 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a5c0d3f90 con 0x7f9a5c0cfca0 2024-09-15T23:15:19.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.129+0000 7f9a5a7fc640 1 -- 172.21.15.123:0/2232498240 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2743819603 0 0) 0x7f9a54001490 con 0x7f9a5c06dce0 2024-09-15T23:15:19.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.130+0000 7f9a527fc640 1 --2- 172.21.15.123:0/2232498240 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a5c0cfca0 0x7f9a5c06d7a0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0b72a0 tx=0x7f9a4402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=470dee25aae556d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:19.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.130+0000 7f9a5a7fc640 1 -- 172.21.15.123:0/2232498240 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a44037070 con 0x7f9a5c0cfca0 2024-09-15T23:15:19.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.130+0000 7f9a5a7fc640 1 -- 172.21.15.123:0/2232498240 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a44032440 con 0x7f9a5c0cfca0 2024-09-15T23:15:19.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.130+0000 7f9a5a7fc640 1 -- 172.21.15.123:0/2232498240 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a44032810 con 0x7f9a5c0cfca0 2024-09-15T23:15:19.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.131+0000 7f9a6128b640 1 -- 172.21.15.123:0/2232498240 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a5c0cfca0 msgr2=0x7f9a5c06d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:19.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.131+0000 7f9a6128b640 1 --2- 172.21.15.123:0/2232498240 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a5c0cfca0 0x7f9a5c06d7a0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0b72a0 tx=0x7f9a4402a270 comp rx=0 tx=0).stop 2024-09-15T23:15:19.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.131+0000 7f9a6128b640 1 -- 172.21.15.123:0/2232498240 shutdown_connections 2024-09-15T23:15:19.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.131+0000 7f9a6128b640 1 --2- 172.21.15.123:0/2232498240 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a5c0cfca0 0x7f9a5c06d7a0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:19.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.131+0000 7f9a6128b640 1 --2- 172.21.15.123:0/2232498240 >> v2:172.21.15.188:3300/0 conn(0x7f9a5c15e900 0x7f9a5c0d3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:19.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.131+0000 7f9a6128b640 1 -- 172.21.15.123:0/2232498240 >> 172.21.15.123:0/2232498240 conn(0x7f9a5c0d47a0 msgr2=0x7f9a5c0d4b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:19.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.131+0000 7f9a6128b640 1 -- 172.21.15.123:0/2232498240 shutdown_connections 2024-09-15T23:15:19.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.131+0000 7f9a6128b640 1 -- 172.21.15.123:0/2232498240 wait complete. 2024-09-15T23:15:19.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.132+0000 7f9a6128b640 1 Processor -- start 2024-09-15T23:15:19.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.132+0000 7f9a6128b640 1 -- start start 2024-09-15T23:15:19.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.133+0000 7f9a6128b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a5c06dce0 0x7f9a5c15ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:19.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.133+0000 7f9a6128b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9a5c0cfca0 0x7f9a5c1e8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:19.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.133+0000 7f9a6128b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9a5c15e900 0x7f9a5c152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:19.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.133+0000 7f9a6128b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9a5c0b7bc0 con 0x7f9a5c06dce0 2024-09-15T23:15:19.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.133+0000 7f9a6128b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9a5c0b7f30 con 0x7f9a5c0cfca0 2024-09-15T23:15:19.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.133+0000 7f9a6128b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9a5c0d3ba0 con 0x7f9a5c15e900 2024-09-15T23:15:19.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.133+0000 7f9a5affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a5c06dce0 0x7f9a5c15ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:19.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.133+0000 7f9a5affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a5c06dce0 0x7f9a5c15ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49374/0 (socket says 172.21.15.123:49374) 2024-09-15T23:15:19.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.133+0000 7f9a5affd640 1 -- 172.21.15.123:0/2961361472 learned_addr learned my addr 172.21.15.123:0/2961361472 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:19.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.133+0000 7f9a5affd640 1 -- 172.21.15.123:0/2961361472 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9a5c15e900 msgr2=0x7f9a5c152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:19.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.133+0000 7f9a5affd640 1 --2- 172.21.15.123:0/2961361472 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9a5c15e900 0x7f9a5c152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:19.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.133+0000 7f9a527fc640 1 --2- 172.21.15.123:0/2961361472 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9a5c0cfca0 0x7f9a5c1e8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:19.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.133+0000 7f9a5affd640 1 -- 172.21.15.123:0/2961361472 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9a5c0cfca0 msgr2=0x7f9a5c1e8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:19.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.133+0000 7f9a5affd640 1 --2- 172.21.15.123:0/2961361472 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9a5c0cfca0 0x7f9a5c1e8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:19.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.133+0000 7f9a5affd640 1 -- 172.21.15.123:0/2961361472 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a5c152fc0 con 0x7f9a5c06dce0 2024-09-15T23:15:19.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.133+0000 7f9a5affd640 1 --2- 172.21.15.123:0/2961361472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a5c06dce0 0x7f9a5c15ee70 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c00d5f0 tx=0x7f9a4c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:19.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.133+0000 7f9a53fff640 1 -- 172.21.15.123:0/2961361472 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c0125f0 con 0x7f9a5c06dce0 2024-09-15T23:15:19.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.133+0000 7f9a53fff640 1 -- 172.21.15.123:0/2961361472 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a4c019070 con 0x7f9a5c06dce0 2024-09-15T23:15:19.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.133+0000 7f9a6128b640 1 -- 172.21.15.123:0/2961361472 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a5c1e93c0 con 0x7f9a5c06dce0 2024-09-15T23:15:19.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.133+0000 7f9a53fff640 1 -- 172.21.15.123:0/2961361472 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c0129d0 con 0x7f9a5c06dce0 2024-09-15T23:15:19.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.133+0000 7f9a6128b640 1 -- 172.21.15.123:0/2961361472 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a5c15fa10 con 0x7f9a5c06dce0 2024-09-15T23:15:19.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.134+0000 7f9a6128b640 1 -- 172.21.15.123:0/2961361472 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a5c06d7a0 con 0x7f9a5c06dce0 2024-09-15T23:15:19.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.135+0000 7f9a53fff640 1 -- 172.21.15.123:0/2961361472 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9a4c012b70 con 0x7f9a5c06dce0 2024-09-15T23:15:19.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.135+0000 7f9a53fff640 1 --2- 172.21.15.123:0/2961361472 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9a3c06c2b0 0x7f9a3c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:19.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.135+0000 7f9a53fff640 1 -- 172.21.15.123:0/2961361472 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5709+0+0 (secure 0 0 0) 0x7f9a4c08b840 con 0x7f9a5c06dce0 2024-09-15T23:15:19.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.136+0000 7f9a527fc640 1 --2- 172.21.15.123:0/2961361472 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9a3c06c2b0 0x7f9a3c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:19.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.136+0000 7f9a527fc640 1 --2- 172.21.15.123:0/2961361472 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9a3c06c2b0 0x7f9a3c06e770 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9a44034000 tx=0x7f9a4402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:19.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.139+0000 7f9a53fff640 1 -- 172.21.15.123:0/2961361472 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9a4c059fb0 con 0x7f9a5c06dce0 2024-09-15T23:15:19.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:19.341+0000 7f9a6128b640 1 -- 172.21.15.123:0/2961361472 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9a5c15cbb0 con 0x7f9a5c06dce0 2024-09-15T23:15:19.676 INFO:tasks.ceph.mds.a.smithi123.stderr:2024-09-15T23:15:19.674+0000 7f2586cfd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:15:20.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.248+0000 7f9a53fff640 1 -- 172.21.15.123:0/2961361472 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v29) ==== 118+0+0 (secure 0 0 0) 0x7f9a4c0598b0 con 0x7f9a5c06dce0 2024-09-15T23:15:20.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.250+0000 7f9a6128b640 1 -- 172.21.15.123:0/2961361472 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9a3c06c2b0 msgr2=0x7f9a3c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:20.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.250+0000 7f9a6128b640 1 --2- 172.21.15.123:0/2961361472 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9a3c06c2b0 0x7f9a3c06e770 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9a44034000 tx=0x7f9a4402e000 comp rx=0 tx=0).stop 2024-09-15T23:15:20.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.250+0000 7f9a6128b640 1 -- 172.21.15.123:0/2961361472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a5c06dce0 msgr2=0x7f9a5c15ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:20.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.250+0000 7f9a6128b640 1 --2- 172.21.15.123:0/2961361472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a5c06dce0 0x7f9a5c15ee70 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c00d5f0 tx=0x7f9a4c00dab0 comp rx=0 tx=0).stop 2024-09-15T23:15:20.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.250+0000 7f9a6128b640 1 -- 172.21.15.123:0/2961361472 shutdown_connections 2024-09-15T23:15:20.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.250+0000 7f9a6128b640 1 --2- 172.21.15.123:0/2961361472 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9a5c15e900 0x7f9a5c152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:20.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.250+0000 7f9a6128b640 1 --2- 172.21.15.123:0/2961361472 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9a5c0cfca0 0x7f9a5c1e8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:20.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.250+0000 7f9a6128b640 1 --2- 172.21.15.123:0/2961361472 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9a3c06c2b0 0x7f9a3c06e770 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:20.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.250+0000 7f9a6128b640 1 --2- 172.21.15.123:0/2961361472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a5c06dce0 0x7f9a5c15ee70 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:20.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.250+0000 7f9a6128b640 1 -- 172.21.15.123:0/2961361472 >> 172.21.15.123:0/2961361472 conn(0x7f9a5c0d47a0 msgr2=0x7f9a5c15bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:20.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.251+0000 7f9a6128b640 1 -- 172.21.15.123:0/2961361472 shutdown_connections 2024-09-15T23:15:20.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.251+0000 7f9a6128b640 1 -- 172.21.15.123:0/2961361472 wait complete. 2024-09-15T23:15:20.265 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T23:15:20.265 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T23:15:20.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.366+0000 7fbecd0a6640 1 Processor -- start 2024-09-15T23:15:20.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.366+0000 7fbecd0a6640 1 -- start start 2024-09-15T23:15:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.367+0000 7fbecd0a6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbec80ccf30 0x7fbec80b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.367+0000 7fbecd0a6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fbec815b7c0 0x7fbec80cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.367+0000 7fbecd0a6640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbec80cd850 con 0x7fbec80cead0 2024-09-15T23:15:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.367+0000 7fbecd0a6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fbec80cf2e0 con 0x7fbec815b7c0 2024-09-15T23:15:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.367+0000 7fbecd0a6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbec8070fe0 con 0x7fbec80ccf30 2024-09-15T23:15:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.367+0000 7fbec759e640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fbec80cead0 0x7fbec815f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58176/0 (socket says 172.21.15.123:58176) 2024-09-15T23:15:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.367+0000 7fbec759e640 1 -- 172.21.15.123:0/3162973280 learned_addr learned my addr 172.21.15.123:0/3162973280 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.367+0000 7fbec5d9b640 1 -- 172.21.15.123:0/3162973280 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3434809625 0 0) 0x7fbec80cd850 con 0x7fbec80cead0 2024-09-15T23:15:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.367+0000 7fbec6d9d640 1 --2- 172.21.15.123:0/3162973280 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbec80ccf30 0x7fbec80b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.367+0000 7fbec659c640 1 --2- 172.21.15.123:0/3162973280 >> v2:172.21.15.188:3300/0 conn(0x7fbec815b7c0 0x7fbec80cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.367+0000 7fbec5d9b640 1 -- 172.21.15.123:0/3162973280 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbeb0003520 con 0x7fbec80cead0 2024-09-15T23:15:20.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.367+0000 7fbec5d9b640 1 -- 172.21.15.123:0/3162973280 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4214169946 0 0) 0x7fbeb0003520 con 0x7fbec80cead0 2024-09-15T23:15:20.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.367+0000 7fbec5d9b640 1 -- 172.21.15.123:0/3162973280 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbec80ccf30 msgr2=0x7fbec80b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:20.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.367+0000 7fbec5d9b640 1 --2- 172.21.15.123:0/3162973280 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbec80ccf30 0x7fbec80b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:20.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.367+0000 7fbec5d9b640 1 -- 172.21.15.123:0/3162973280 >> v2:172.21.15.188:3300/0 conn(0x7fbec815b7c0 msgr2=0x7fbec80cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:20.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.367+0000 7fbec5d9b640 1 --2- 172.21.15.123:0/3162973280 >> v2:172.21.15.188:3300/0 conn(0x7fbec815b7c0 0x7fbec80cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:20.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.367+0000 7fbec5d9b640 1 -- 172.21.15.123:0/3162973280 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec80712c0 con 0x7fbec80cead0 2024-09-15T23:15:20.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.367+0000 7fbec5d9b640 1 -- 172.21.15.123:0/3162973280 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fbec00019f0 con 0x7fbec80cead0 2024-09-15T23:15:20.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.367+0000 7fbec5d9b640 1 -- 172.21.15.123:0/3162973280 >> v1:172.21.15.123:6789/0 conn(0x7fbec80cead0 legacy=0x7fbec815f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:20.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.368+0000 7fbec5d9b640 1 --2- 172.21.15.123:0/3162973280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbeb00039b0 0x7fbeb0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:20.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.368+0000 7fbec5d9b640 1 --2- 172.21.15.123:0/3162973280 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbec80ccf30 0x7fbeb0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:20.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.368+0000 7fbec5d9b640 1 --2- 172.21.15.123:0/3162973280 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbeb0004d40 0x7fbeb00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:20.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.368+0000 7fbec5d9b640 1 -- 172.21.15.123:0/3162973280 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbec80cf2e0 con 0x7fbeb00039b0 2024-09-15T23:15:20.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.368+0000 7fbec5d9b640 1 -- 172.21.15.123:0/3162973280 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbec8070fe0 con 0x7fbeb0004d40 2024-09-15T23:15:20.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.368+0000 7fbec5d9b640 1 -- 172.21.15.123:0/3162973280 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbeb000b9c0 con 0x7fbec80ccf30 2024-09-15T23:15:20.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.368+0000 7fbec6d9d640 1 --2- 172.21.15.123:0/3162973280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbeb00039b0 0x7fbeb0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:20.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.368+0000 7fbec659c640 1 --2- 172.21.15.123:0/3162973280 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbec80ccf30 0x7fbeb0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:20.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.368+0000 7fbec759e640 1 --2- 172.21.15.123:0/3162973280 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbeb0004d40 0x7fbeb00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:20.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.368+0000 7fbec6d9d640 1 -- 172.21.15.123:0/3162973280 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbec80ccf30 msgr2=0x7fbeb0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:20.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.368+0000 7fbec6d9d640 1 --2- 172.21.15.123:0/3162973280 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbec80ccf30 0x7fbeb0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:20.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.368+0000 7fbec6d9d640 1 -- 172.21.15.123:0/3162973280 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbeb0004d40 msgr2=0x7fbeb00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:20.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.368+0000 7fbec6d9d640 1 --2- 172.21.15.123:0/3162973280 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbeb0004d40 0x7fbeb00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:20.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.368+0000 7fbec6d9d640 1 -- 172.21.15.123:0/3162973280 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeb0003520 con 0x7fbeb00039b0 2024-09-15T23:15:20.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.369+0000 7fbec6d9d640 1 --2- 172.21.15.123:0/3162973280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbeb00039b0 0x7fbeb0003dd0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8009ac0 tx=0x7fbeb0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d95c354d0573f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:20.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.369+0000 7fbec5d9b640 1 -- 172.21.15.123:0/3162973280 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb8036070 con 0x7fbeb00039b0 2024-09-15T23:15:20.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.369+0000 7fbec5d9b640 1 -- 172.21.15.123:0/3162973280 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbeb8031400 con 0x7fbeb00039b0 2024-09-15T23:15:20.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.369+0000 7fbec5d9b640 1 -- 172.21.15.123:0/3162973280 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb8009690 con 0x7fbeb00039b0 2024-09-15T23:15:20.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.369+0000 7fbecd0a6640 1 -- 172.21.15.123:0/3162973280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbeb00039b0 msgr2=0x7fbeb0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:20.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.369+0000 7fbecd0a6640 1 --2- 172.21.15.123:0/3162973280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbeb00039b0 0x7fbeb0003dd0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8009ac0 tx=0x7fbeb0005830 comp rx=0 tx=0).stop 2024-09-15T23:15:20.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.369+0000 7fbec759e640 1 -- 172.21.15.123:0/3162973280 reap_dead start 2024-09-15T23:15:20.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.369+0000 7fbecd0a6640 1 -- 172.21.15.123:0/3162973280 shutdown_connections 2024-09-15T23:15:20.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.369+0000 7fbecd0a6640 1 -- 172.21.15.123:0/3162973280 >> 172.21.15.123:0/3162973280 conn(0x7fbec806d0f0 msgr2=0x7fbec806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:20.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.369+0000 7fbecd0a6640 1 -- 172.21.15.123:0/3162973280 shutdown_connections 2024-09-15T23:15:20.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.369+0000 7fbecd0a6640 1 -- 172.21.15.123:0/3162973280 wait complete. 2024-09-15T23:15:20.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.371+0000 7fbecd0a6640 1 Processor -- start 2024-09-15T23:15:20.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.371+0000 7fbecd0a6640 1 -- start start 2024-09-15T23:15:20.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.371+0000 7fbecd0a6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbeb00039b0 0x7fbec81472a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:20.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.371+0000 7fbecd0a6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbec81496f0 0x7fbec8148450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:20.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.371+0000 7fbecd0a6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbec8148990 0x7fbec80719c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:20.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.371+0000 7fbecd0a6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbec80cef40 con 0x7fbec81496f0 2024-09-15T23:15:20.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.371+0000 7fbecd0a6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbec80cf5c0 con 0x7fbec8148990 2024-09-15T23:15:20.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.371+0000 7fbecd0a6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbec80cf0c0 con 0x7fbeb00039b0 2024-09-15T23:15:20.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.372+0000 7fbec659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbec81496f0 0x7fbec8148450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:20.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.372+0000 7fbec659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbec81496f0 0x7fbec8148450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49390/0 (socket says 172.21.15.123:49390) 2024-09-15T23:15:20.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.372+0000 7fbec659c640 1 -- 172.21.15.123:0/2757022132 learned_addr learned my addr 172.21.15.123:0/2757022132 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:20.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.372+0000 7fbec759e640 1 --2- 172.21.15.123:0/2757022132 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbec8148990 0x7fbec80719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:20.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.372+0000 7fbec6d9d640 1 --2- 172.21.15.123:0/2757022132 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbeb00039b0 0x7fbec81472a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:20.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.372+0000 7fbec659c640 1 -- 172.21.15.123:0/2757022132 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbeb00039b0 msgr2=0x7fbec81472a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:20.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.372+0000 7fbec659c640 1 --2- 172.21.15.123:0/2757022132 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbeb00039b0 0x7fbec81472a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:20.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.372+0000 7fbec659c640 1 -- 172.21.15.123:0/2757022132 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbec8148990 msgr2=0x7fbec80719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:20.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.372+0000 7fbec659c640 1 --2- 172.21.15.123:0/2757022132 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbec8148990 0x7fbec80719c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:20.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.372+0000 7fbec659c640 1 -- 172.21.15.123:0/2757022132 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec814afd0 con 0x7fbec81496f0 2024-09-15T23:15:20.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.372+0000 7fbec659c640 1 --2- 172.21.15.123:0/2757022132 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbec81496f0 0x7fbec8148450 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0115b0 tx=0x7fbebc0119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:20.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.372+0000 7fbeaf7fe640 1 -- 172.21.15.123:0/2757022132 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbebc015870 con 0x7fbec81496f0 2024-09-15T23:15:20.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.372+0000 7fbeaf7fe640 1 -- 172.21.15.123:0/2757022132 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbebc015a10 con 0x7fbec81496f0 2024-09-15T23:15:20.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.372+0000 7fbecd0a6640 1 -- 172.21.15.123:0/2757022132 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbec814b240 con 0x7fbec81496f0 2024-09-15T23:15:20.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.372+0000 7fbeaf7fe640 1 -- 172.21.15.123:0/2757022132 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbebc015dc0 con 0x7fbec81496f0 2024-09-15T23:15:20.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.372+0000 7fbecd0a6640 1 -- 172.21.15.123:0/2757022132 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbec814b800 con 0x7fbec81496f0 2024-09-15T23:15:20.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.373+0000 7fbecd0a6640 1 -- 172.21.15.123:0/2757022132 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbec80b2c50 con 0x7fbec81496f0 2024-09-15T23:15:20.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.374+0000 7fbeaf7fe640 1 -- 172.21.15.123:0/2757022132 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbebc013400 con 0x7fbec81496f0 2024-09-15T23:15:20.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.374+0000 7fbeaf7fe640 1 --2- 172.21.15.123:0/2757022132 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbeb406c2b0 0x7fbeb406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:20.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.374+0000 7fbeaf7fe640 1 -- 172.21.15.123:0/2757022132 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7fbebc08bb90 con 0x7fbec81496f0 2024-09-15T23:15:20.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.374+0000 7fbec6d9d640 1 --2- 172.21.15.123:0/2757022132 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbeb406c2b0 0x7fbeb406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:20.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.375+0000 7fbec6d9d640 1 --2- 172.21.15.123:0/2757022132 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbeb406c2b0 0x7fbeb406e770 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8033000 tx=0x7fbeb8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:20.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.378+0000 7fbeaf7fe640 1 -- 172.21.15.123:0/2757022132 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbebc019030 con 0x7fbec81496f0 2024-09-15T23:15:20.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:20.580+0000 7fbecd0a6640 1 -- 172.21.15.123:0/2757022132 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fbec80cc960 con 0x7fbec81496f0 2024-09-15T23:15:21.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.434+0000 7fbeaf7fe640 1 -- 172.21.15.123:0/2757022132 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v30) ==== 122+0+0 (secure 0 0 0) 0x7fbebc05a300 con 0x7fbec81496f0 2024-09-15T23:15:21.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.437+0000 7fbecd0a6640 1 -- 172.21.15.123:0/2757022132 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbeb406c2b0 msgr2=0x7fbeb406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:21.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.437+0000 7fbecd0a6640 1 --2- 172.21.15.123:0/2757022132 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbeb406c2b0 0x7fbeb406e770 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8033000 tx=0x7fbeb8008030 comp rx=0 tx=0).stop 2024-09-15T23:15:21.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.437+0000 7fbecd0a6640 1 -- 172.21.15.123:0/2757022132 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbec81496f0 msgr2=0x7fbec8148450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:21.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.437+0000 7fbecd0a6640 1 --2- 172.21.15.123:0/2757022132 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbec81496f0 0x7fbec8148450 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0115b0 tx=0x7fbebc0119b0 comp rx=0 tx=0).stop 2024-09-15T23:15:21.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.437+0000 7fbecd0a6640 1 -- 172.21.15.123:0/2757022132 shutdown_connections 2024-09-15T23:15:21.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.437+0000 7fbecd0a6640 1 --2- 172.21.15.123:0/2757022132 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbec8148990 0x7fbec80719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:21.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.437+0000 7fbecd0a6640 1 --2- 172.21.15.123:0/2757022132 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbeb406c2b0 0x7fbeb406e770 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:21.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.437+0000 7fbecd0a6640 1 --2- 172.21.15.123:0/2757022132 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbec81496f0 0x7fbec8148450 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:21.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.437+0000 7fbecd0a6640 1 --2- 172.21.15.123:0/2757022132 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbeb00039b0 0x7fbec81472a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:21.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.437+0000 7fbecd0a6640 1 -- 172.21.15.123:0/2757022132 >> 172.21.15.123:0/2757022132 conn(0x7fbec806d0f0 msgr2=0x7fbec815eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:21.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.437+0000 7fbecd0a6640 1 -- 172.21.15.123:0/2757022132 shutdown_connections 2024-09-15T23:15:21.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.437+0000 7fbecd0a6640 1 -- 172.21.15.123:0/2757022132 wait complete. 2024-09-15T23:15:21.453 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T23:15:21.453 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:15:21.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.556+0000 7f876d778640 1 Processor -- start 2024-09-15T23:15:21.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.556+0000 7f876d778640 1 -- start start 2024-09-15T23:15:21.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.557+0000 7f876d778640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f876815ed20 0x7f87680b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:21.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.557+0000 7f876d778640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87680d23b0 0x7f87680b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:21.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.557+0000 7f876d778640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87680d0e70 con 0x7f87680cf2d0 2024-09-15T23:15:21.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.557+0000 7f876d778640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f87680d41c0 con 0x7f876815ed20 2024-09-15T23:15:21.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.557+0000 7f876d778640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f87680d35b0 con 0x7f87680d23b0 2024-09-15T23:15:21.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.557+0000 7f8766ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f876815ed20 0x7f87680b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:21.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.557+0000 7f8766ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f876815ed20 0x7f87680b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49398/0 (socket says 172.21.15.123:49398) 2024-09-15T23:15:21.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.557+0000 7f8766ffd640 1 -- 172.21.15.123:0/3265397433 learned_addr learned my addr 172.21.15.123:0/3265397433 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:21.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.557+0000 7f875ffff640 1 --2- 172.21.15.123:0/3265397433 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87680d23b0 0x7f87680b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:21.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.557+0000 7f8766ffd640 1 -- 172.21.15.123:0/3265397433 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87680d23b0 msgr2=0x7f87680b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:21.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.557+0000 7f8766ffd640 1 --2- 172.21.15.123:0/3265397433 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87680d23b0 0x7f87680b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:21.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.557+0000 7f8766ffd640 1 -- 172.21.15.123:0/3265397433 >> v1:172.21.15.188:6789/0 conn(0x7f87680cf2d0 legacy=0x7f87680cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:21.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.557+0000 7f8766ffd640 1 -- 172.21.15.123:0/3265397433 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87680d3890 con 0x7f876815ed20 2024-09-15T23:15:21.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.558+0000 7f8766ffd640 1 --2- 172.21.15.123:0/3265397433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f876815ed20 0x7f87680b6260 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f8758009870 tx=0x7f875802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ca436368f3798ff server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:21.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.558+0000 7f87667fc640 1 -- 172.21.15.123:0/3265397433 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8758037070 con 0x7f876815ed20 2024-09-15T23:15:21.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.558+0000 7f87667fc640 1 -- 172.21.15.123:0/3265397433 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8758032440 con 0x7f876815ed20 2024-09-15T23:15:21.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.558+0000 7f87667fc640 1 -- 172.21.15.123:0/3265397433 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8758032810 con 0x7f876815ed20 2024-09-15T23:15:21.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.559+0000 7f876d778640 1 -- 172.21.15.123:0/3265397433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f876815ed20 msgr2=0x7f87680b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:21.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.559+0000 7f876d778640 1 --2- 172.21.15.123:0/3265397433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f876815ed20 0x7f87680b6260 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f8758009870 tx=0x7f875802a210 comp rx=0 tx=0).stop 2024-09-15T23:15:21.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.559+0000 7f876d778640 1 -- 172.21.15.123:0/3265397433 shutdown_connections 2024-09-15T23:15:21.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.559+0000 7f876d778640 1 --2- 172.21.15.123:0/3265397433 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87680d23b0 0x7f87680b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:21.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.559+0000 7f876d778640 1 --2- 172.21.15.123:0/3265397433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f876815ed20 0x7f87680b6260 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:21.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.559+0000 7f876d778640 1 -- 172.21.15.123:0/3265397433 >> 172.21.15.123:0/3265397433 conn(0x7f87680d1260 msgr2=0x7f87680d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:21.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.559+0000 7f876d778640 1 -- 172.21.15.123:0/3265397433 shutdown_connections 2024-09-15T23:15:21.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.559+0000 7f876d778640 1 -- 172.21.15.123:0/3265397433 wait complete. 2024-09-15T23:15:21.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.560+0000 7f876d778640 1 Processor -- start 2024-09-15T23:15:21.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.560+0000 7f876d778640 1 -- start start 2024-09-15T23:15:21.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.561+0000 7f876d778640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87680cf2d0 0x7f876814eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:21.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.561+0000 7f876d778640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87680d23b0 0x7f87680ce530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:21.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.561+0000 7f876d778640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f876815ed20 0x7f87680ab130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:21.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.561+0000 7f876d778640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f87680d32a0 con 0x7f87680cf2d0 2024-09-15T23:15:21.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.561+0000 7f876d778640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f87680d3e50 con 0x7f876815ed20 2024-09-15T23:15:21.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.561+0000 7f876d778640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f876815f100 con 0x7f87680d23b0 2024-09-15T23:15:21.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.561+0000 7f8766ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87680cf2d0 0x7f876814eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:21.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.561+0000 7f8766ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87680cf2d0 0x7f876814eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49404/0 (socket says 172.21.15.123:49404) 2024-09-15T23:15:21.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.561+0000 7f8766ffd640 1 -- 172.21.15.123:0/263538328 learned_addr learned my addr 172.21.15.123:0/263538328 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:21.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.561+0000 7f87677fe640 1 --2- 172.21.15.123:0/263538328 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f876815ed20 0x7f87680ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:21.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.561+0000 7f875ffff640 1 --2- 172.21.15.123:0/263538328 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87680d23b0 0x7f87680ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:21.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.561+0000 7f8766ffd640 1 -- 172.21.15.123:0/263538328 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87680d23b0 msgr2=0x7f87680ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:21.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.561+0000 7f8766ffd640 1 --2- 172.21.15.123:0/263538328 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87680d23b0 0x7f87680ce530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:21.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.561+0000 7f8766ffd640 1 -- 172.21.15.123:0/263538328 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f876815ed20 msgr2=0x7f87680ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:21.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.561+0000 7f8766ffd640 1 --2- 172.21.15.123:0/263538328 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f876815ed20 0x7f87680ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:21.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.561+0000 7f8766ffd640 1 -- 172.21.15.123:0/263538328 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87681e8a40 con 0x7f87680cf2d0 2024-09-15T23:15:21.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.561+0000 7f87677fe640 1 --2- 172.21.15.123:0/263538328 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f876815ed20 0x7f87680ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:21.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.561+0000 7f875ffff640 1 --2- 172.21.15.123:0/263538328 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87680d23b0 0x7f87680ce530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:21.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.561+0000 7f8766ffd640 1 --2- 172.21.15.123:0/263538328 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87680cf2d0 0x7f876814eb90 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f8758009870 tx=0x7f87580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:21.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.561+0000 7f875f7fe640 1 -- 172.21.15.123:0/263538328 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8758041020 con 0x7f87680cf2d0 2024-09-15T23:15:21.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.561+0000 7f875f7fe640 1 -- 172.21.15.123:0/263538328 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87580306c0 con 0x7f87680cf2d0 2024-09-15T23:15:21.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.561+0000 7f876d778640 1 -- 172.21.15.123:0/263538328 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87681e8d20 con 0x7f87680cf2d0 2024-09-15T23:15:21.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.561+0000 7f875f7fe640 1 -- 172.21.15.123:0/263538328 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8758037040 con 0x7f87680cf2d0 2024-09-15T23:15:21.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.561+0000 7f876d778640 1 -- 172.21.15.123:0/263538328 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87681e92e0 con 0x7f87680cf2d0 2024-09-15T23:15:21.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.562+0000 7f876d778640 1 -- 172.21.15.123:0/263538328 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87680b7010 con 0x7f87680cf2d0 2024-09-15T23:15:21.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.563+0000 7f875f7fe640 1 -- 172.21.15.123:0/263538328 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8758044020 con 0x7f87680cf2d0 2024-09-15T23:15:21.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.563+0000 7f875f7fe640 1 --2- 172.21.15.123:0/263538328 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f874806c2e0 0x7f874806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:21.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.563+0000 7f875f7fe640 1 -- 172.21.15.123:0/263538328 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7f87580abbf0 con 0x7f87680cf2d0 2024-09-15T23:15:21.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.563+0000 7f875ffff640 1 --2- 172.21.15.123:0/263538328 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f874806c2e0 0x7f874806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:21.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.564+0000 7f875ffff640 1 --2- 172.21.15.123:0/263538328 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f874806c2e0 0x7f874806e7a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f87680b4f00 tx=0x7f8750008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:21.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.567+0000 7f875f7fe640 1 -- 172.21.15.123:0/263538328 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f875804b030 con 0x7f87680cf2d0 2024-09-15T23:15:21.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.766+0000 7f876d778640 1 -- 172.21.15.123:0/263538328 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f87680d0a90 con 0x7f87680cf2d0 2024-09-15T23:15:21.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.766+0000 7f875f7fe640 1 -- 172.21.15.123:0/263538328 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5232 (secure 0 0 0) 0x7f87680d0e70 con 0x7f87680cf2d0 2024-09-15T23:15:21.768 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:21.769 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":30,"btime":"2024-09-15T23:15:21:435254+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5339,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/3452580408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":3452580408},{"type":"v1","addr":"172.21.15.188:6837","nonce":3452580408}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5665,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/301618526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":301618526},{"type":"v1","addr":"172.21.15.188:6836","nonce":301618526}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":6162,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2171163786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2171163786},{"type":"v1","addr":"172.21.15.123:6834","nonce":2171163786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:15:17.752297+0000","modified":"2024-09-15T23:15:20.582574+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6165},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6165":{"gid":6165,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/2772280632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":2772280632},{"type":"v1","addr":"172.21.15.123:6835","nonce":2772280632}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6165,"qdb_cluster":[6165]},"id":4}]} 2024-09-15T23:15:21.769 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 30 2024-09-15T23:15:21.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.768+0000 7f876d778640 1 -- 172.21.15.123:0/263538328 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f874806c2e0 msgr2=0x7f874806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:21.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.768+0000 7f876d778640 1 --2- 172.21.15.123:0/263538328 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f874806c2e0 0x7f874806e7a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f87680b4f00 tx=0x7f8750008040 comp rx=0 tx=0).stop 2024-09-15T23:15:21.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.768+0000 7f876d778640 1 -- 172.21.15.123:0/263538328 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87680cf2d0 msgr2=0x7f876814eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:21.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.768+0000 7f876d778640 1 --2- 172.21.15.123:0/263538328 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87680cf2d0 0x7f876814eb90 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f8758009870 tx=0x7f87580046c0 comp rx=0 tx=0).stop 2024-09-15T23:15:21.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.768+0000 7f876d778640 1 -- 172.21.15.123:0/263538328 shutdown_connections 2024-09-15T23:15:21.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.768+0000 7f876d778640 1 --2- 172.21.15.123:0/263538328 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f876815ed20 0x7f87680ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:21.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.768+0000 7f876d778640 1 --2- 172.21.15.123:0/263538328 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87680d23b0 0x7f87680ce530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:21.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.768+0000 7f876d778640 1 --2- 172.21.15.123:0/263538328 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f874806c2e0 0x7f874806e7a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:21.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.768+0000 7f876d778640 1 --2- 172.21.15.123:0/263538328 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87680cf2d0 0x7f876814eb90 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:21.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.768+0000 7f876d778640 1 -- 172.21.15.123:0/263538328 >> 172.21.15.123:0/263538328 conn(0x7f87680d1260 msgr2=0x7f8768161390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:21.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.768+0000 7f876d778640 1 -- 172.21.15.123:0/263538328 shutdown_connections 2024-09-15T23:15:21.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.768+0000 7f876d778640 1 -- 172.21.15.123:0/263538328 wait complete. 2024-09-15T23:15:21.782 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:15:21.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.878+0000 7f75d1e30640 1 Processor -- start 2024-09-15T23:15:21.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.879+0000 7f75d1e30640 1 -- start start 2024-09-15T23:15:21.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.879+0000 7f75d1e30640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f75cc0b2d40 0x7f75cc06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:21.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.879+0000 7f75d1e30640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75cc071180 con 0x7f75cc06c150 2024-09-15T23:15:21.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.879+0000 7f75d1e30640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75cc071460 con 0x7f75cc13eb20 2024-09-15T23:15:21.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.879+0000 7f75d1e30640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f75cc071ab0 con 0x7f75cc0b2d40 2024-09-15T23:15:21.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.880+0000 7f75cbfff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f75cc06c150 0x7f75cc071f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58192/0 (socket says 172.21.15.123:58192) 2024-09-15T23:15:21.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.880+0000 7f75cbfff640 1 -- 172.21.15.123:0/3434268470 learned_addr learned my addr 172.21.15.123:0/3434268470 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:21.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.880+0000 7f75cb7fe640 1 --2- 172.21.15.123:0/3434268470 >> v2:172.21.15.188:3300/0 conn(0x7f75cc0b2d40 0x7f75cc06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:21.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.880+0000 7f75ca7fc640 1 -- 172.21.15.123:0/3434268470 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2239304048 0 0) 0x7f75cc071180 con 0x7f75cc06c150 2024-09-15T23:15:21.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.880+0000 7f75ca7fc640 1 -- 172.21.15.123:0/3434268470 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75b4003520 con 0x7f75cc06c150 2024-09-15T23:15:21.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.880+0000 7f75ca7fc640 1 -- 172.21.15.123:0/3434268470 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3150518349 0 0) 0x7f75b4003520 con 0x7f75cc06c150 2024-09-15T23:15:21.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.880+0000 7f75ca7fc640 1 -- 172.21.15.123:0/3434268470 >> v2:172.21.15.188:3300/0 conn(0x7f75cc0b2d40 msgr2=0x7f75cc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:21.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.880+0000 7f75ca7fc640 1 --2- 172.21.15.123:0/3434268470 >> v2:172.21.15.188:3300/0 conn(0x7f75cc0b2d40 0x7f75cc06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:21.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.880+0000 7f75ca7fc640 1 -- 172.21.15.123:0/3434268470 >> v1:172.21.15.188:6789/0 conn(0x7f75cc13eb20 legacy=0x7f75cc15bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:21.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.880+0000 7f75ca7fc640 1 -- 172.21.15.123:0/3434268470 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75cc071740 con 0x7f75cc06c150 2024-09-15T23:15:21.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.880+0000 7f75ca7fc640 1 -- 172.21.15.123:0/3434268470 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f75c40019f0 con 0x7f75cc06c150 2024-09-15T23:15:21.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.880+0000 7f75ca7fc640 1 -- 172.21.15.123:0/3434268470 >> v1:172.21.15.123:6789/0 conn(0x7f75cc06c150 legacy=0x7f75cc071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:21.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.880+0000 7f75ca7fc640 1 --2- 172.21.15.123:0/3434268470 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75b40039b0 0x7f75b4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:21.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.880+0000 7f75ca7fc640 1 --2- 172.21.15.123:0/3434268470 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75b4004800 0x7f75b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:21.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.880+0000 7f75ca7fc640 1 --2- 172.21.15.123:0/3434268470 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75b40051c0 0x7f75b400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:21.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.880+0000 7f75ca7fc640 1 -- 172.21.15.123:0/3434268470 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f75cc071ab0 con 0x7f75b4004800 2024-09-15T23:15:21.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.880+0000 7f75ca7fc640 1 -- 172.21.15.123:0/3434268470 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f75b400c060 con 0x7f75b40051c0 2024-09-15T23:15:21.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.880+0000 7f75ca7fc640 1 -- 172.21.15.123:0/3434268470 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f75b400c260 con 0x7f75b40039b0 2024-09-15T23:15:21.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.880+0000 7f75caffd640 1 --2- 172.21.15.123:0/3434268470 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75b4004800 0x7f75b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:21.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.880+0000 7f75cbfff640 1 --2- 172.21.15.123:0/3434268470 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75b40051c0 0x7f75b400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:21.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.880+0000 7f75cb7fe640 1 --2- 172.21.15.123:0/3434268470 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75b40039b0 0x7f75b4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:21.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.880+0000 7f75caffd640 1 -- 172.21.15.123:0/3434268470 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75b40039b0 msgr2=0x7f75b4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:21.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.880+0000 7f75caffd640 1 --2- 172.21.15.123:0/3434268470 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75b40039b0 0x7f75b4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:21.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.880+0000 7f75caffd640 1 -- 172.21.15.123:0/3434268470 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75b40051c0 msgr2=0x7f75b400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:21.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.880+0000 7f75caffd640 1 --2- 172.21.15.123:0/3434268470 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75b40051c0 0x7f75b400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.880+0000 7f75caffd640 1 -- 172.21.15.123:0/3434268470 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75b4003520 con 0x7f75b4004800 2024-09-15T23:15:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.880+0000 7f75cbfff640 1 --2- 172.21.15.123:0/3434268470 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75b40051c0 0x7f75b400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.880+0000 7f75cb7fe640 1 --2- 172.21.15.123:0/3434268470 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75b40039b0 0x7f75b4003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.880+0000 7f75cbfff640 1 -- 172.21.15.123:0/3434268470 reap_dead start 2024-09-15T23:15:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.881+0000 7f75caffd640 1 --2- 172.21.15.123:0/3434268470 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75b4004800 0x7f75b4004c80 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f75c0001720 tx=0x7f75b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=183a0939b37fb345 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.881+0000 7f75ca7fc640 1 -- 172.21.15.123:0/3434268470 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c0001370 con 0x7f75b4004800 2024-09-15T23:15:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.881+0000 7f75ca7fc640 1 -- 172.21.15.123:0/3434268470 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75c00052d0 con 0x7f75b4004800 2024-09-15T23:15:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.881+0000 7f75ca7fc640 1 -- 172.21.15.123:0/3434268470 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c002ab90 con 0x7f75b4004800 2024-09-15T23:15:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.882+0000 7f75d1e30640 1 -- 172.21.15.123:0/3434268470 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75b4004800 msgr2=0x7f75b4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.882+0000 7f75d1e30640 1 --2- 172.21.15.123:0/3434268470 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75b4004800 0x7f75b4004c80 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f75c0001720 tx=0x7f75b4005830 comp rx=0 tx=0).stop 2024-09-15T23:15:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.882+0000 7f75d1e30640 1 -- 172.21.15.123:0/3434268470 shutdown_connections 2024-09-15T23:15:21.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.882+0000 7f75d1e30640 1 --2- 172.21.15.123:0/3434268470 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75b4004800 0x7f75b4004c80 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:21.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.882+0000 7f75d1e30640 1 -- 172.21.15.123:0/3434268470 >> 172.21.15.123:0/3434268470 conn(0x7f75cc0ccec0 msgr2=0x7f75cc0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:21.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.882+0000 7f75d1e30640 1 -- 172.21.15.123:0/3434268470 shutdown_connections 2024-09-15T23:15:21.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.882+0000 7f75d1e30640 1 -- 172.21.15.123:0/3434268470 wait complete. 2024-09-15T23:15:21.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.883+0000 7f75d1e30640 1 Processor -- start 2024-09-15T23:15:21.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.883+0000 7f75d1e30640 1 -- start start 2024-09-15T23:15:21.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.884+0000 7f75d1e30640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75b4004800 0x7f75cc1370a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:21.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.884+0000 7f75d1e30640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75cc1e75d0 0x7f75cc1e7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:21.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.884+0000 7f75d1e30640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75cc13c5f0 0x7f75cc13caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:21.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.884+0000 7f75d1e30640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f75cc06bfa0 con 0x7f75cc13c5f0 2024-09-15T23:15:21.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.884+0000 7f75d1e30640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f75cc06be20 con 0x7f75cc1e75d0 2024-09-15T23:15:21.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.884+0000 7f75d1e30640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f75cc15bcf0 con 0x7f75b4004800 2024-09-15T23:15:21.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.884+0000 7f75cbfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75cc13c5f0 0x7f75cc13caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:21.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.884+0000 7f75cbfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75cc13c5f0 0x7f75cc13caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49418/0 (socket says 172.21.15.123:49418) 2024-09-15T23:15:21.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.884+0000 7f75cbfff640 1 -- 172.21.15.123:0/3799631631 learned_addr learned my addr 172.21.15.123:0/3799631631 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:21.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.884+0000 7f75cbfff640 1 -- 172.21.15.123:0/3799631631 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75b4004800 msgr2=0x7f75cc1370a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:21.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.884+0000 7f75cbfff640 1 --2- 172.21.15.123:0/3799631631 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75b4004800 0x7f75cc1370a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:21.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.884+0000 7f75cbfff640 1 -- 172.21.15.123:0/3799631631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75cc1e75d0 msgr2=0x7f75cc1e7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:21.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.884+0000 7f75cbfff640 1 --2- 172.21.15.123:0/3799631631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75cc1e75d0 0x7f75cc1e7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:21.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.884+0000 7f75cbfff640 1 -- 172.21.15.123:0/3799631631 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75cc156070 con 0x7f75cc13c5f0 2024-09-15T23:15:21.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.884+0000 7f75cbfff640 1 --2- 172.21.15.123:0/3799631631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75cc13c5f0 0x7f75cc13caa0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f75cc13ef00 tx=0x7f75c4007af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:21.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.885+0000 7f75b3fff640 1 -- 172.21.15.123:0/3799631631 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c400ea40 con 0x7f75cc13c5f0 2024-09-15T23:15:21.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.885+0000 7f75b3fff640 1 -- 172.21.15.123:0/3799631631 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75c400ec00 con 0x7f75cc13c5f0 2024-09-15T23:15:21.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.885+0000 7f75b3fff640 1 -- 172.21.15.123:0/3799631631 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c4014480 con 0x7f75cc13c5f0 2024-09-15T23:15:21.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.885+0000 7f75d1e30640 1 -- 172.21.15.123:0/3799631631 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75cc156350 con 0x7f75cc13c5f0 2024-09-15T23:15:21.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.885+0000 7f75d1e30640 1 -- 172.21.15.123:0/3799631631 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75cc156910 con 0x7f75cc13c5f0 2024-09-15T23:15:21.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.886+0000 7f75d1e30640 1 -- 172.21.15.123:0/3799631631 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75cc15c080 con 0x7f75cc13c5f0 2024-09-15T23:15:21.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.886+0000 7f75b3fff640 1 -- 172.21.15.123:0/3799631631 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f75c4014620 con 0x7f75cc13c5f0 2024-09-15T23:15:21.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.887+0000 7f75b3fff640 1 --2- 172.21.15.123:0/3799631631 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f75b806c2e0 0x7f75b806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:21.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.887+0000 7f75b3fff640 1 -- 172.21.15.123:0/3799631631 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7f75c408b2f0 con 0x7f75cc13c5f0 2024-09-15T23:15:21.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.887+0000 7f75cb7fe640 1 --2- 172.21.15.123:0/3799631631 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f75b806c2e0 0x7f75b806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:21.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.887+0000 7f75cb7fe640 1 --2- 172.21.15.123:0/3799631631 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f75b806c2e0 0x7f75b806e7a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f75cc06ab10 tx=0x7f75bc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:21.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:21.891+0000 7f75b3fff640 1 -- 172.21.15.123:0/3799631631 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f75c4059a60 con 0x7f75cc13c5f0 2024-09-15T23:15:22.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.059+0000 7f75d1e30640 1 -- 172.21.15.123:0/3799631631 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f75cc06c9c0 con 0x7f75cc13c5f0 2024-09-15T23:15:22.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.060+0000 7f75b3fff640 1 -- 172.21.15.123:0/3799631631 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) ==== 74+0+16749 (secure 0 0 0) 0x7f75c4059360 con 0x7f75cc13c5f0 2024-09-15T23:15:22.062 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:22.062 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":66,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:15:19.414884+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:15:16.362912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-15T23:15:16.718663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:15:22.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.062+0000 7f75d1e30640 1 -- 172.21.15.123:0/3799631631 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f75b806c2e0 msgr2=0x7f75b806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:22.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.062+0000 7f75d1e30640 1 --2- 172.21.15.123:0/3799631631 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f75b806c2e0 0x7f75b806e7a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f75cc06ab10 tx=0x7f75bc008040 comp rx=0 tx=0).stop 2024-09-15T23:15:22.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.062+0000 7f75d1e30640 1 -- 172.21.15.123:0/3799631631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75cc13c5f0 msgr2=0x7f75cc13caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:22.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.062+0000 7f75d1e30640 1 --2- 172.21.15.123:0/3799631631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75cc13c5f0 0x7f75cc13caa0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f75cc13ef00 tx=0x7f75c4007af0 comp rx=0 tx=0).stop 2024-09-15T23:15:22.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.062+0000 7f75d1e30640 1 -- 172.21.15.123:0/3799631631 shutdown_connections 2024-09-15T23:15:22.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.062+0000 7f75d1e30640 1 --2- 172.21.15.123:0/3799631631 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f75b806c2e0 0x7f75b806e7a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:22.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.062+0000 7f75d1e30640 1 --2- 172.21.15.123:0/3799631631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75cc13c5f0 0x7f75cc13caa0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:22.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.062+0000 7f75d1e30640 1 --2- 172.21.15.123:0/3799631631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75cc1e75d0 0x7f75cc1e7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:22.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.062+0000 7f75d1e30640 1 --2- 172.21.15.123:0/3799631631 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75b4004800 0x7f75cc1370a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:22.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.062+0000 7f75d1e30640 1 -- 172.21.15.123:0/3799631631 >> 172.21.15.123:0/3799631631 conn(0x7f75cc0ccec0 msgr2=0x7f75cc15aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:22.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.062+0000 7f75d1e30640 1 -- 172.21.15.123:0/3799631631 shutdown_connections 2024-09-15T23:15:22.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.062+0000 7f75d1e30640 1 -- 172.21.15.123:0/3799631631 wait complete. 2024-09-15T23:15:22.075 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T23:15:22.076 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:15:22.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.171+0000 7f7761526640 1 Processor -- start 2024-09-15T23:15:22.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.171+0000 7f7761526640 1 -- start start 2024-09-15T23:15:22.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.172+0000 7f7761526640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f775c0b2d40 0x7f775c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:22.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.172+0000 7f7761526640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f775c13eb20 0x7f775c06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:22.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.172+0000 7f7761526640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f775c071180 con 0x7f775c15bcf0 2024-09-15T23:15:22.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.172+0000 7f7761526640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f775c071ab0 con 0x7f775c13eb20 2024-09-15T23:15:22.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.172+0000 7f7761526640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f775c071460 con 0x7f775c0b2d40 2024-09-15T23:15:22.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.172+0000 7f77527fc640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f775c13eb20 0x7f775c06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:22.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.172+0000 7f77527fc640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f775c13eb20 0x7f775c06c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:58174/0 (socket says 172.21.15.123:58174) 2024-09-15T23:15:22.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.172+0000 7f775affd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f775c0b2d40 0x7f775c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:22.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.172+0000 7f77527fc640 1 -- 172.21.15.123:0/1036537481 learned_addr learned my addr 172.21.15.123:0/1036537481 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:22.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.172+0000 7f775b7fe640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f775c15bcf0 0x7f775c15c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:52428/0 (socket says 172.21.15.123:52428) 2024-09-15T23:15:22.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.173+0000 7f775affd640 1 -- 172.21.15.123:0/1036537481 >> v2:172.21.15.188:3300/0 conn(0x7f775c13eb20 msgr2=0x7f775c06c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:22.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.173+0000 7f775affd640 1 --2- 172.21.15.123:0/1036537481 >> v2:172.21.15.188:3300/0 conn(0x7f775c13eb20 0x7f775c06c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:22.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.173+0000 7f775affd640 1 -- 172.21.15.123:0/1036537481 >> v1:172.21.15.188:6789/0 conn(0x7f775c15bcf0 legacy=0x7f775c15c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:22.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.173+0000 7f775affd640 1 -- 172.21.15.123:0/1036537481 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f775c071740 con 0x7f775c0b2d40 2024-09-15T23:15:22.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.173+0000 7f77527fc640 1 --2- 172.21.15.123:0/1036537481 >> v2:172.21.15.188:3300/0 conn(0x7f775c13eb20 0x7f775c06c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:15:22.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.173+0000 7f775affd640 1 --2- 172.21.15.123:0/1036537481 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f775c0b2d40 0x7f775c06bc10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f775c071c30 tx=0x7f774c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca79d50adf3f965c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:22.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.174+0000 7f775a7fc640 1 -- 172.21.15.123:0/1036537481 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c037070 con 0x7f775c0b2d40 2024-09-15T23:15:22.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.174+0000 7f775a7fc640 1 -- 172.21.15.123:0/1036537481 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f774c032440 con 0x7f775c0b2d40 2024-09-15T23:15:22.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.174+0000 7f775a7fc640 1 -- 172.21.15.123:0/1036537481 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774c032810 con 0x7f775c0b2d40 2024-09-15T23:15:22.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.174+0000 7f7761526640 1 -- 172.21.15.123:0/1036537481 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f775c0b2d40 msgr2=0x7f775c06bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:22.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.174+0000 7f7761526640 1 --2- 172.21.15.123:0/1036537481 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f775c0b2d40 0x7f775c06bc10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f775c071c30 tx=0x7f774c02a180 comp rx=0 tx=0).stop 2024-09-15T23:15:22.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.174+0000 7f7761526640 1 -- 172.21.15.123:0/1036537481 shutdown_connections 2024-09-15T23:15:22.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.174+0000 7f7761526640 1 --2- 172.21.15.123:0/1036537481 >> v2:172.21.15.188:3300/0 conn(0x7f775c13eb20 0x7f775c06c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:22.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.174+0000 7f7761526640 1 --2- 172.21.15.123:0/1036537481 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f775c0b2d40 0x7f775c06bc10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:22.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.174+0000 7f7761526640 1 -- 172.21.15.123:0/1036537481 >> 172.21.15.123:0/1036537481 conn(0x7f775c0ccec0 msgr2=0x7f775c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:22.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.174+0000 7f7761526640 1 -- 172.21.15.123:0/1036537481 shutdown_connections 2024-09-15T23:15:22.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.174+0000 7f7761526640 1 -- 172.21.15.123:0/1036537481 wait complete. 2024-09-15T23:15:22.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.175+0000 7f7761526640 1 Processor -- start 2024-09-15T23:15:22.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.176+0000 7f7761526640 1 -- start start 2024-09-15T23:15:22.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.176+0000 7f7761526640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f775c0b2d40 0x7f775c1f8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:22.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.176+0000 7f7761526640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f775c13eb20 0x7f775c1348a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:22.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.176+0000 7f7761526640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f775c15bcf0 0x7f775c157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:22.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.176+0000 7f7761526640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f775c0722d0 con 0x7f775c13eb20 2024-09-15T23:15:22.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.176+0000 7f7761526640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f775c072150 con 0x7f775c0b2d40 2024-09-15T23:15:22.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.176+0000 7f7761526640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f775c072450 con 0x7f775c15bcf0 2024-09-15T23:15:22.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.176+0000 7f77527fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f775c13eb20 0x7f775c1348a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:22.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.176+0000 7f77527fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f775c13eb20 0x7f775c1348a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49428/0 (socket says 172.21.15.123:49428) 2024-09-15T23:15:22.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.176+0000 7f77527fc640 1 -- 172.21.15.123:0/702121021 learned_addr learned my addr 172.21.15.123:0/702121021 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:22.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.177+0000 7f775affd640 1 --2- 172.21.15.123:0/702121021 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f775c0b2d40 0x7f775c1f8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:22.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.177+0000 7f775b7fe640 1 --2- 172.21.15.123:0/702121021 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f775c15bcf0 0x7f775c157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:22.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.177+0000 7f77527fc640 1 -- 172.21.15.123:0/702121021 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f775c15bcf0 msgr2=0x7f775c157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:22.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.177+0000 7f77527fc640 1 --2- 172.21.15.123:0/702121021 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f775c15bcf0 0x7f775c157fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:22.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.177+0000 7f77527fc640 1 -- 172.21.15.123:0/702121021 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f775c0b2d40 msgr2=0x7f775c1f8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:22.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.177+0000 7f77527fc640 1 --2- 172.21.15.123:0/702121021 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f775c0b2d40 0x7f775c1f8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:22.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.177+0000 7f77527fc640 1 -- 172.21.15.123:0/702121021 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f775c134de0 con 0x7f775c13eb20 2024-09-15T23:15:22.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.177+0000 7f77527fc640 1 --2- 172.21.15.123:0/702121021 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f775c13eb20 0x7f775c1348a0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f774400ed20 tx=0x7f774400d720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:22.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.177+0000 7f7753fff640 1 -- 172.21.15.123:0/702121021 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7744010640 con 0x7f775c13eb20 2024-09-15T23:15:22.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.177+0000 7f7753fff640 1 -- 172.21.15.123:0/702121021 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77440107e0 con 0x7f775c13eb20 2024-09-15T23:15:22.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.177+0000 7f7761526640 1 -- 172.21.15.123:0/702121021 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f775c0cac10 con 0x7f775c13eb20 2024-09-15T23:15:22.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.177+0000 7f7753fff640 1 -- 172.21.15.123:0/702121021 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7744010bb0 con 0x7f775c13eb20 2024-09-15T23:15:22.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.177+0000 7f7761526640 1 -- 172.21.15.123:0/702121021 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f775c0cb1d0 con 0x7f775c13eb20 2024-09-15T23:15:22.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.178+0000 7f7761526640 1 -- 172.21.15.123:0/702121021 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f775c0728e0 con 0x7f775c13eb20 2024-09-15T23:15:22.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.178+0000 7f7753fff640 1 -- 172.21.15.123:0/702121021 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7744018400 con 0x7f775c13eb20 2024-09-15T23:15:22.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.179+0000 7f7753fff640 1 --2- 172.21.15.123:0/702121021 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f773c06c2b0 0x7f773c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:22.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.179+0000 7f7753fff640 1 -- 172.21.15.123:0/702121021 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7f774408bcb0 con 0x7f775c13eb20 2024-09-15T23:15:22.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.179+0000 7f775affd640 1 --2- 172.21.15.123:0/702121021 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f773c06c2b0 0x7f773c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:22.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.180+0000 7f775affd640 1 --2- 172.21.15.123:0/702121021 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f773c06c2b0 0x7f773c06e770 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f774c034000 tx=0x7f774c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:22.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.183+0000 7f7753fff640 1 -- 172.21.15.123:0/702121021 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7744014030 con 0x7f775c13eb20 2024-09-15T23:15:22.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.345+0000 7f7761526640 1 -- 172.21.15.123:0/702121021 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f775c0ce130 con 0x7f773c06c2b0 2024-09-15T23:15:22.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.353+0000 7f7753fff640 1 -- 172.21.15.123:0/702121021 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251948 (secure 0 0 0) 0x7f775c0ce130 con 0x7f773c06c2b0 2024-09-15T23:15:22.357 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:22.359 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:15:22.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.355+0000 7f7761526640 1 -- 172.21.15.123:0/702121021 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f773c06c2b0 msgr2=0x7f773c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:22.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.355+0000 7f7761526640 1 --2- 172.21.15.123:0/702121021 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f773c06c2b0 0x7f773c06e770 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f774c034000 tx=0x7f774c02e000 comp rx=0 tx=0).stop 2024-09-15T23:15:22.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.355+0000 7f7761526640 1 -- 172.21.15.123:0/702121021 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f775c13eb20 msgr2=0x7f775c1348a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:22.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.355+0000 7f7761526640 1 --2- 172.21.15.123:0/702121021 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f775c13eb20 0x7f775c1348a0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f774400ed20 tx=0x7f774400d720 comp rx=0 tx=0).stop 2024-09-15T23:15:22.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.355+0000 7f7761526640 1 -- 172.21.15.123:0/702121021 shutdown_connections 2024-09-15T23:15:22.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.355+0000 7f7761526640 1 --2- 172.21.15.123:0/702121021 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f775c15bcf0 0x7f775c157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:22.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.355+0000 7f7761526640 1 --2- 172.21.15.123:0/702121021 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f773c06c2b0 0x7f773c06e770 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:22.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.355+0000 7f7761526640 1 --2- 172.21.15.123:0/702121021 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f775c13eb20 0x7f775c1348a0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:22.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.355+0000 7f7761526640 1 --2- 172.21.15.123:0/702121021 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f775c0b2d40 0x7f775c1f8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:22.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.355+0000 7f7761526640 1 -- 172.21.15.123:0/702121021 >> 172.21.15.123:0/702121021 conn(0x7f775c0ccec0 msgr2=0x7f775c154520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:22.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.355+0000 7f7761526640 1 -- 172.21.15.123:0/702121021 shutdown_connections 2024-09-15T23:15:22.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.355+0000 7f7761526640 1 -- 172.21.15.123:0/702121021 wait complete. 2024-09-15T23:15:22.368 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-09-15T23:15:21.546036+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":164,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":290024,"kb_used_data":7200,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754684696,"statfs":{"total":773094113280,"available":772797128704,"internally_reserved":0,"allocated":7372800,"data_stored":3793040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":289394224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,5,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.145363"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.970337+0000","last_change":"2024-09-15T23:15:18.439334+0000","last_active":"2024-09-15T23:15:19.970337+0000","last_peered":"2024-09-15T23:15:19.970337+0000","last_clean":"2024-09-15T23:15:19.970337+0000","last_became_active":"2024-09-15T23:15:18.439000+0000","last_became_peered":"2024-09-15T23:15:18.439000+0000","last_unstale":"2024-09-15T23:15:19.970337+0000","last_undegraded":"2024-09-15T23:15:19.970337+0000","last_fullsized":"2024-09-15T23:15:19.970337+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:30:12.756464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.424335+0000","last_change":"2024-09-15T23:15:18.434154+0000","last_active":"2024-09-15T23:15:19.424335+0000","last_peered":"2024-09-15T23:15:19.424335+0000","last_clean":"2024-09-15T23:15:19.424335+0000","last_became_active":"2024-09-15T23:15:18.433736+0000","last_became_peered":"2024-09-15T23:15:18.433736+0000","last_unstale":"2024-09-15T23:15:19.424335+0000","last_undegraded":"2024-09-15T23:15:19.424335+0000","last_fullsized":"2024-09-15T23:15:19.424335+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:43.283307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.431899+0000","last_change":"2024-09-15T23:15:18.423868+0000","last_active":"2024-09-15T23:15:18.431899+0000","last_peered":"2024-09-15T23:15:18.431899+0000","last_clean":"2024-09-15T23:15:18.431899+0000","last_became_active":"2024-09-15T23:15:18.423385+0000","last_became_peered":"2024-09-15T23:15:18.423385+0000","last_unstale":"2024-09-15T23:15:18.431899+0000","last_undegraded":"2024-09-15T23:15:18.431899+0000","last_fullsized":"2024-09-15T23:15:18.431899+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:58:52.164625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.435961+0000","last_change":"2024-09-15T23:15:18.431364+0000","last_active":"2024-09-15T23:15:18.435961+0000","last_peered":"2024-09-15T23:15:18.435961+0000","last_clean":"2024-09-15T23:15:18.435961+0000","last_became_active":"2024-09-15T23:15:18.431048+0000","last_became_peered":"2024-09-15T23:15:18.431048+0000","last_unstale":"2024-09-15T23:15:18.435961+0000","last_undegraded":"2024-09-15T23:15:18.435961+0000","last_fullsized":"2024-09-15T23:15:18.435961+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:47:00.933662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.970330+0000","last_change":"2024-09-15T23:15:18.436447+0000","last_active":"2024-09-15T23:15:19.970330+0000","last_peered":"2024-09-15T23:15:19.970330+0000","last_clean":"2024-09-15T23:15:19.970330+0000","last_became_active":"2024-09-15T23:15:18.436198+0000","last_became_peered":"2024-09-15T23:15:18.436198+0000","last_unstale":"2024-09-15T23:15:19.970330+0000","last_undegraded":"2024-09-15T23:15:19.970330+0000","last_fullsized":"2024-09-15T23:15:19.970330+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:13:14.970303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.969913+0000","last_change":"2024-09-15T23:15:18.437223+0000","last_active":"2024-09-15T23:15:19.969913+0000","last_peered":"2024-09-15T23:15:19.969913+0000","last_clean":"2024-09-15T23:15:19.969913+0000","last_became_active":"2024-09-15T23:15:18.436744+0000","last_became_peered":"2024-09-15T23:15:18.436744+0000","last_unstale":"2024-09-15T23:15:19.969913+0000","last_undegraded":"2024-09-15T23:15:19.969913+0000","last_fullsized":"2024-09-15T23:15:19.969913+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:27.937790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.430989+0000","last_change":"2024-09-15T23:15:18.426778+0000","last_active":"2024-09-15T23:15:18.430989+0000","last_peered":"2024-09-15T23:15:18.430989+0000","last_clean":"2024-09-15T23:15:18.430989+0000","last_became_active":"2024-09-15T23:15:18.423971+0000","last_became_peered":"2024-09-15T23:15:18.423971+0000","last_unstale":"2024-09-15T23:15:18.430989+0000","last_undegraded":"2024-09-15T23:15:18.430989+0000","last_fullsized":"2024-09-15T23:15:18.430989+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:16.294601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.433035+0000","last_change":"2024-09-15T23:15:18.431876+0000","last_active":"2024-09-15T23:15:19.433035+0000","last_peered":"2024-09-15T23:15:19.433035+0000","last_clean":"2024-09-15T23:15:19.433035+0000","last_became_active":"2024-09-15T23:15:18.431590+0000","last_became_peered":"2024-09-15T23:15:18.431590+0000","last_unstale":"2024-09-15T23:15:19.433035+0000","last_undegraded":"2024-09-15T23:15:19.433035+0000","last_fullsized":"2024-09-15T23:15:19.433035+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:39.949512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.437112+0000","last_change":"2024-09-15T23:15:18.431941+0000","last_active":"2024-09-15T23:15:18.437112+0000","last_peered":"2024-09-15T23:15:18.437112+0000","last_clean":"2024-09-15T23:15:18.437112+0000","last_became_active":"2024-09-15T23:15:18.431643+0000","last_became_peered":"2024-09-15T23:15:18.431643+0000","last_unstale":"2024-09-15T23:15:18.437112+0000","last_undegraded":"2024-09-15T23:15:18.437112+0000","last_fullsized":"2024-09-15T23:15:18.437112+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:21:30.386792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.970216+0000","last_change":"2024-09-15T23:15:18.430549+0000","last_active":"2024-09-15T23:15:19.970216+0000","last_peered":"2024-09-15T23:15:19.970216+0000","last_clean":"2024-09-15T23:15:19.970216+0000","last_became_active":"2024-09-15T23:15:18.430236+0000","last_became_peered":"2024-09-15T23:15:18.430236+0000","last_unstale":"2024-09-15T23:15:19.970216+0000","last_undegraded":"2024-09-15T23:15:19.970216+0000","last_fullsized":"2024-09-15T23:15:19.970216+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:30:46.873336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:20.131953+0000","last_change":"2024-09-15T23:15:18.433755+0000","last_active":"2024-09-15T23:15:20.131953+0000","last_peered":"2024-09-15T23:15:20.131953+0000","last_clean":"2024-09-15T23:15:20.131953+0000","last_became_active":"2024-09-15T23:15:18.433495+0000","last_became_peered":"2024-09-15T23:15:18.433495+0000","last_unstale":"2024-09-15T23:15:20.131953+0000","last_undegraded":"2024-09-15T23:15:20.131953+0000","last_fullsized":"2024-09-15T23:15:20.131953+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:19.950525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.435073+0000","last_change":"2024-09-15T23:15:18.428196+0000","last_active":"2024-09-15T23:15:18.435073+0000","last_peered":"2024-09-15T23:15:18.435073+0000","last_clean":"2024-09-15T23:15:18.435073+0000","last_became_active":"2024-09-15T23:15:18.427896+0000","last_became_peered":"2024-09-15T23:15:18.427896+0000","last_unstale":"2024-09-15T23:15:18.435073+0000","last_undegraded":"2024-09-15T23:15:18.435073+0000","last_fullsized":"2024-09-15T23:15:18.435073+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:46:03.806298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.429497+0000","last_change":"2024-09-15T23:15:18.425632+0000","last_active":"2024-09-15T23:15:18.429497+0000","last_peered":"2024-09-15T23:15:18.429497+0000","last_clean":"2024-09-15T23:15:18.429497+0000","last_became_active":"2024-09-15T23:15:18.425360+0000","last_became_peered":"2024-09-15T23:15:18.425360+0000","last_unstale":"2024-09-15T23:15:18.429497+0000","last_undegraded":"2024-09-15T23:15:18.429497+0000","last_fullsized":"2024-09-15T23:15:18.429497+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:05:05.151198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.432069+0000","last_change":"2024-09-15T23:15:18.423704+0000","last_active":"2024-09-15T23:15:18.432069+0000","last_peered":"2024-09-15T23:15:18.432069+0000","last_clean":"2024-09-15T23:15:18.432069+0000","last_became_active":"2024-09-15T23:15:18.423454+0000","last_became_peered":"2024-09-15T23:15:18.423454+0000","last_unstale":"2024-09-15T23:15:18.432069+0000","last_undegraded":"2024-09-15T23:15:18.432069+0000","last_fullsized":"2024-09-15T23:15:18.432069+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:39.319833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.437900+0000","last_change":"2024-09-15T23:15:18.433520+0000","last_active":"2024-09-15T23:15:18.437900+0000","last_peered":"2024-09-15T23:15:18.437900+0000","last_clean":"2024-09-15T23:15:18.437900+0000","last_became_active":"2024-09-15T23:15:18.433230+0000","last_became_peered":"2024-09-15T23:15:18.433230+0000","last_unstale":"2024-09-15T23:15:18.437900+0000","last_undegraded":"2024-09-15T23:15:18.437900+0000","last_fullsized":"2024-09-15T23:15:18.437900+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:31.573725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.969796+0000","last_change":"2024-09-15T23:15:18.437502+0000","last_active":"2024-09-15T23:15:19.969796+0000","last_peered":"2024-09-15T23:15:19.969796+0000","last_clean":"2024-09-15T23:15:19.969796+0000","last_became_active":"2024-09-15T23:15:18.437232+0000","last_became_peered":"2024-09-15T23:15:18.437232+0000","last_unstale":"2024-09-15T23:15:19.969796+0000","last_undegraded":"2024-09-15T23:15:19.969796+0000","last_fullsized":"2024-09-15T23:15:19.969796+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:15.830577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.970378+0000","last_change":"2024-09-15T23:15:18.434765+0000","last_active":"2024-09-15T23:15:19.970378+0000","last_peered":"2024-09-15T23:15:19.970378+0000","last_clean":"2024-09-15T23:15:19.970378+0000","last_became_active":"2024-09-15T23:15:18.434466+0000","last_became_peered":"2024-09-15T23:15:18.434466+0000","last_unstale":"2024-09-15T23:15:19.970378+0000","last_undegraded":"2024-09-15T23:15:19.970378+0000","last_fullsized":"2024-09-15T23:15:19.970378+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:19.804479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.432225+0000","last_change":"2024-09-15T23:15:18.426352+0000","last_active":"2024-09-15T23:15:18.432225+0000","last_peered":"2024-09-15T23:15:18.432225+0000","last_clean":"2024-09-15T23:15:18.432225+0000","last_became_active":"2024-09-15T23:15:18.426044+0000","last_became_peered":"2024-09-15T23:15:18.426044+0000","last_unstale":"2024-09-15T23:15:18.432225+0000","last_undegraded":"2024-09-15T23:15:18.432225+0000","last_fullsized":"2024-09-15T23:15:18.432225+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:15.830577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.423990+0000","last_change":"2024-09-15T23:15:18.424373+0000","last_active":"2024-09-15T23:15:19.423990+0000","last_peered":"2024-09-15T23:15:19.423990+0000","last_clean":"2024-09-15T23:15:19.423990+0000","last_became_active":"2024-09-15T23:15:18.423933+0000","last_became_peered":"2024-09-15T23:15:18.423933+0000","last_unstale":"2024-09-15T23:15:19.423990+0000","last_undegraded":"2024-09-15T23:15:19.423990+0000","last_fullsized":"2024-09-15T23:15:19.423990+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:11:36.335746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:20.131940+0000","last_change":"2024-09-15T23:15:18.434523+0000","last_active":"2024-09-15T23:15:20.131940+0000","last_peered":"2024-09-15T23:15:20.131940+0000","last_clean":"2024-09-15T23:15:20.131940+0000","last_became_active":"2024-09-15T23:15:18.434282+0000","last_became_peered":"2024-09-15T23:15:18.434282+0000","last_unstale":"2024-09-15T23:15:20.131940+0000","last_undegraded":"2024-09-15T23:15:20.131940+0000","last_fullsized":"2024-09-15T23:15:20.131940+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:58:42.806614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.426914+0000","last_change":"2024-09-15T23:15:18.424416+0000","last_active":"2024-09-15T23:15:18.426914+0000","last_peered":"2024-09-15T23:15:18.426914+0000","last_clean":"2024-09-15T23:15:18.426914+0000","last_became_active":"2024-09-15T23:15:18.424144+0000","last_became_peered":"2024-09-15T23:15:18.424144+0000","last_unstale":"2024-09-15T23:15:18.426914+0000","last_undegraded":"2024-09-15T23:15:18.426914+0000","last_fullsized":"2024-09-15T23:15:18.426914+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:58:52.164625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:20.132190+0000","last_change":"2024-09-15T23:15:18.422363+0000","last_active":"2024-09-15T23:15:20.132190+0000","last_peered":"2024-09-15T23:15:20.132190+0000","last_clean":"2024-09-15T23:15:20.132190+0000","last_became_active":"2024-09-15T23:15:18.422103+0000","last_became_peered":"2024-09-15T23:15:18.422103+0000","last_unstale":"2024-09-15T23:15:20.132190+0000","last_undegraded":"2024-09-15T23:15:20.132190+0000","last_fullsized":"2024-09-15T23:15:20.132190+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:17:03.556020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.418261+0000","last_change":"2024-09-15T23:15:18.415403+0000","last_active":"2024-09-15T23:15:18.418261+0000","last_peered":"2024-09-15T23:15:18.418261+0000","last_clean":"2024-09-15T23:15:18.418261+0000","last_became_active":"2024-09-15T23:15:18.415094+0000","last_became_peered":"2024-09-15T23:15:18.415094+0000","last_unstale":"2024-09-15T23:15:18.418261+0000","last_undegraded":"2024-09-15T23:15:18.418261+0000","last_fullsized":"2024-09-15T23:15:18.418261+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:52:18.724497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.435135+0000","last_change":"2024-09-15T23:15:18.428409+0000","last_active":"2024-09-15T23:15:18.435135+0000","last_peered":"2024-09-15T23:15:18.435135+0000","last_clean":"2024-09-15T23:15:18.435135+0000","last_became_active":"2024-09-15T23:15:18.427910+0000","last_became_peered":"2024-09-15T23:15:18.427910+0000","last_unstale":"2024-09-15T23:15:18.435135+0000","last_undegraded":"2024-09-15T23:15:18.435135+0000","last_fullsized":"2024-09-15T23:15:18.435135+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:21:02.531500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.423967+0000","last_change":"2024-09-15T23:15:18.433080+0000","last_active":"2024-09-15T23:15:19.423967+0000","last_peered":"2024-09-15T23:15:19.423967+0000","last_clean":"2024-09-15T23:15:19.423967+0000","last_became_active":"2024-09-15T23:15:18.432779+0000","last_became_peered":"2024-09-15T23:15:18.432779+0000","last_unstale":"2024-09-15T23:15:19.423967+0000","last_undegraded":"2024-09-15T23:15:19.423967+0000","last_fullsized":"2024-09-15T23:15:19.423967+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:48.110108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.424920+0000","last_change":"2024-09-15T23:15:18.423716+0000","last_active":"2024-09-15T23:15:18.424920+0000","last_peered":"2024-09-15T23:15:18.424920+0000","last_clean":"2024-09-15T23:15:18.424920+0000","last_became_active":"2024-09-15T23:15:18.423450+0000","last_became_peered":"2024-09-15T23:15:18.423450+0000","last_unstale":"2024-09-15T23:15:18.424920+0000","last_undegraded":"2024-09-15T23:15:18.424920+0000","last_fullsized":"2024-09-15T23:15:18.424920+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:39.319833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.424176+0000","last_change":"2024-09-15T23:15:18.423811+0000","last_active":"2024-09-15T23:15:19.424176+0000","last_peered":"2024-09-15T23:15:19.424176+0000","last_clean":"2024-09-15T23:15:19.424176+0000","last_became_active":"2024-09-15T23:15:18.423388+0000","last_became_peered":"2024-09-15T23:15:18.423388+0000","last_unstale":"2024-09-15T23:15:19.424176+0000","last_undegraded":"2024-09-15T23:15:19.424176+0000","last_fullsized":"2024-09-15T23:15:19.424176+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:14.699526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.433277+0000","last_change":"2024-09-15T23:15:18.425885+0000","last_active":"2024-09-15T23:15:19.433277+0000","last_peered":"2024-09-15T23:15:19.433277+0000","last_clean":"2024-09-15T23:15:19.433277+0000","last_became_active":"2024-09-15T23:15:18.425181+0000","last_became_peered":"2024-09-15T23:15:18.425181+0000","last_unstale":"2024-09-15T23:15:19.433277+0000","last_undegraded":"2024-09-15T23:15:19.433277+0000","last_fullsized":"2024-09-15T23:15:19.433277+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:05:05.937073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.433160+0000","last_change":"2024-09-15T23:15:18.431677+0000","last_active":"2024-09-15T23:15:19.433160+0000","last_peered":"2024-09-15T23:15:19.433160+0000","last_clean":"2024-09-15T23:15:19.433160+0000","last_became_active":"2024-09-15T23:15:18.431394+0000","last_became_peered":"2024-09-15T23:15:18.431394+0000","last_unstale":"2024-09-15T23:15:19.433160+0000","last_undegraded":"2024-09-15T23:15:19.433160+0000","last_fullsized":"2024-09-15T23:15:19.433160+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:03:04.172651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.429466+0000","last_change":"2024-09-15T23:15:18.422709+0000","last_active":"2024-09-15T23:15:18.429466+0000","last_peered":"2024-09-15T23:15:18.429466+0000","last_clean":"2024-09-15T23:15:18.429466+0000","last_became_active":"2024-09-15T23:15:18.421685+0000","last_became_peered":"2024-09-15T23:15:18.421685+0000","last_unstale":"2024-09-15T23:15:18.429466+0000","last_undegraded":"2024-09-15T23:15:18.429466+0000","last_fullsized":"2024-09-15T23:15:18.429466+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:05.577417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.423700+0000","last_change":"2024-09-15T23:15:18.416660+0000","last_active":"2024-09-15T23:15:19.423700+0000","last_peered":"2024-09-15T23:15:19.423700+0000","last_clean":"2024-09-15T23:15:19.423700+0000","last_became_active":"2024-09-15T23:15:18.416371+0000","last_became_peered":"2024-09-15T23:15:18.416371+0000","last_unstale":"2024-09-15T23:15:19.423700+0000","last_undegraded":"2024-09-15T23:15:19.423700+0000","last_fullsized":"2024-09-15T23:15:19.423700+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:39:59.210108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:20.131872+0000","last_change":"2024-09-15T23:15:18.420063+0000","last_active":"2024-09-15T23:15:20.131872+0000","last_peered":"2024-09-15T23:15:20.131872+0000","last_clean":"2024-09-15T23:15:20.131872+0000","last_became_active":"2024-09-15T23:15:18.419793+0000","last_became_peered":"2024-09-15T23:15:18.419793+0000","last_unstale":"2024-09-15T23:15:20.131872+0000","last_undegraded":"2024-09-15T23:15:20.131872+0000","last_fullsized":"2024-09-15T23:15:20.131872+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:05.501711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.970313+0000","last_change":"2024-09-15T23:15:18.436009+0000","last_active":"2024-09-15T23:15:19.970313+0000","last_peered":"2024-09-15T23:15:19.970313+0000","last_clean":"2024-09-15T23:15:19.970313+0000","last_became_active":"2024-09-15T23:15:18.435533+0000","last_became_peered":"2024-09-15T23:15:18.435533+0000","last_unstale":"2024-09-15T23:15:19.970313+0000","last_undegraded":"2024-09-15T23:15:19.970313+0000","last_fullsized":"2024-09-15T23:15:19.970313+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:26:15.486840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"65'4","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:20.131989+0000","last_change":"2024-09-15T23:15:17.417037+0000","last_active":"2024-09-15T23:15:20.131989+0000","last_peered":"2024-09-15T23:15:20.131989+0000","last_clean":"2024-09-15T23:15:20.131989+0000","last_became_active":"2024-09-15T23:15:17.416771+0000","last_became_peered":"2024-09-15T23:15:17.416771+0000","last_unstale":"2024-09-15T23:15:20.131989+0000","last_undegraded":"2024-09-15T23:15:20.131989+0000","last_fullsized":"2024-09-15T23:15:20.131989+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:48:36.393544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.970503+0000","last_change":"2024-09-15T23:15:18.438025+0000","last_active":"2024-09-15T23:15:19.970503+0000","last_peered":"2024-09-15T23:15:19.970503+0000","last_clean":"2024-09-15T23:15:19.970503+0000","last_became_active":"2024-09-15T23:15:18.437698+0000","last_became_peered":"2024-09-15T23:15:18.437698+0000","last_unstale":"2024-09-15T23:15:19.970503+0000","last_undegraded":"2024-09-15T23:15:19.970503+0000","last_fullsized":"2024-09-15T23:15:19.970503+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:17.024938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"65'1","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.424267+0000","last_change":"2024-09-15T23:15:17.420108+0000","last_active":"2024-09-15T23:15:19.424267+0000","last_peered":"2024-09-15T23:15:19.424267+0000","last_clean":"2024-09-15T23:15:19.424267+0000","last_became_active":"2024-09-15T23:15:17.419839+0000","last_became_peered":"2024-09-15T23:15:17.419839+0000","last_unstale":"2024-09-15T23:15:19.424267+0000","last_undegraded":"2024-09-15T23:15:19.424267+0000","last_fullsized":"2024-09-15T23:15:19.424267+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:46.547138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.433150+0000","last_change":"2024-09-15T23:15:18.434810+0000","last_active":"2024-09-15T23:15:19.433150+0000","last_peered":"2024-09-15T23:15:19.433150+0000","last_clean":"2024-09-15T23:15:19.433150+0000","last_became_active":"2024-09-15T23:15:18.434468+0000","last_became_peered":"2024-09-15T23:15:18.434468+0000","last_unstale":"2024-09-15T23:15:19.433150+0000","last_undegraded":"2024-09-15T23:15:19.433150+0000","last_fullsized":"2024-09-15T23:15:19.433150+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:06.859089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.970223+0000","last_change":"2024-09-15T23:15:17.420266+0000","last_active":"2024-09-15T23:15:19.970223+0000","last_peered":"2024-09-15T23:15:19.970223+0000","last_clean":"2024-09-15T23:15:19.970223+0000","last_became_active":"2024-09-15T23:15:17.419999+0000","last_became_peered":"2024-09-15T23:15:17.419999+0000","last_unstale":"2024-09-15T23:15:19.970223+0000","last_undegraded":"2024-09-15T23:15:19.970223+0000","last_fullsized":"2024-09-15T23:15:19.970223+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:46.444334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.970139+0000","last_change":"2024-09-15T23:15:18.430709+0000","last_active":"2024-09-15T23:15:19.970139+0000","last_peered":"2024-09-15T23:15:19.970139+0000","last_clean":"2024-09-15T23:15:19.970139+0000","last_became_active":"2024-09-15T23:15:18.430396+0000","last_became_peered":"2024-09-15T23:15:18.430396+0000","last_unstale":"2024-09-15T23:15:19.970139+0000","last_undegraded":"2024-09-15T23:15:19.970139+0000","last_fullsized":"2024-09-15T23:15:19.970139+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:17.670996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"65'2","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.440380+0000","last_change":"2024-09-15T23:15:17.425060+0000","last_active":"2024-09-15T23:15:18.440380+0000","last_peered":"2024-09-15T23:15:18.440380+0000","last_clean":"2024-09-15T23:15:18.440380+0000","last_became_active":"2024-09-15T23:15:17.424786+0000","last_became_peered":"2024-09-15T23:15:17.424786+0000","last_unstale":"2024-09-15T23:15:18.440380+0000","last_undegraded":"2024-09-15T23:15:18.440380+0000","last_fullsized":"2024-09-15T23:15:18.440380+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:28:27.013881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.433054+0000","last_change":"2024-09-15T23:15:18.421643+0000","last_active":"2024-09-15T23:15:19.433054+0000","last_peered":"2024-09-15T23:15:19.433054+0000","last_clean":"2024-09-15T23:15:19.433054+0000","last_became_active":"2024-09-15T23:15:18.421176+0000","last_became_peered":"2024-09-15T23:15:18.421176+0000","last_unstale":"2024-09-15T23:15:19.433054+0000","last_undegraded":"2024-09-15T23:15:19.433054+0000","last_fullsized":"2024-09-15T23:15:19.433054+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:05:23.192016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"65'1","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.435487+0000","last_change":"2024-09-15T23:15:17.421346+0000","last_active":"2024-09-15T23:15:18.435487+0000","last_peered":"2024-09-15T23:15:18.435487+0000","last_clean":"2024-09-15T23:15:18.435487+0000","last_became_active":"2024-09-15T23:15:17.421068+0000","last_became_peered":"2024-09-15T23:15:17.421068+0000","last_unstale":"2024-09-15T23:15:18.435487+0000","last_undegraded":"2024-09-15T23:15:18.435487+0000","last_fullsized":"2024-09-15T23:15:18.435487+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:33.328627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:20.132013+0000","last_change":"2024-09-15T23:15:18.420107+0000","last_active":"2024-09-15T23:15:20.132013+0000","last_peered":"2024-09-15T23:15:20.132013+0000","last_clean":"2024-09-15T23:15:20.132013+0000","last_became_active":"2024-09-15T23:15:18.419767+0000","last_became_peered":"2024-09-15T23:15:18.419767+0000","last_unstale":"2024-09-15T23:15:20.132013+0000","last_undegraded":"2024-09-15T23:15:20.132013+0000","last_fullsized":"2024-09-15T23:15:20.132013+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:52:29.671637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"65'1","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.969991+0000","last_change":"2024-09-15T23:15:17.424272+0000","last_active":"2024-09-15T23:15:19.969991+0000","last_peered":"2024-09-15T23:15:19.969991+0000","last_clean":"2024-09-15T23:15:19.969991+0000","last_became_active":"2024-09-15T23:15:17.423836+0000","last_became_peered":"2024-09-15T23:15:17.423836+0000","last_unstale":"2024-09-15T23:15:19.969991+0000","last_undegraded":"2024-09-15T23:15:19.969991+0000","last_fullsized":"2024-09-15T23:15:19.969991+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:03.177439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.437172+0000","last_change":"2024-09-15T23:15:18.434790+0000","last_active":"2024-09-15T23:15:18.437172+0000","last_peered":"2024-09-15T23:15:18.437172+0000","last_clean":"2024-09-15T23:15:18.437172+0000","last_became_active":"2024-09-15T23:15:18.434189+0000","last_became_peered":"2024-09-15T23:15:18.434189+0000","last_unstale":"2024-09-15T23:15:18.437172+0000","last_undegraded":"2024-09-15T23:15:18.437172+0000","last_fullsized":"2024-09-15T23:15:18.437172+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:46.961107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.411300+0000","last_change":"2024-09-15T23:15:17.414929+0000","last_active":"2024-09-15T23:15:18.411300+0000","last_peered":"2024-09-15T23:15:18.411300+0000","last_clean":"2024-09-15T23:15:18.411300+0000","last_became_active":"2024-09-15T23:15:17.414654+0000","last_became_peered":"2024-09-15T23:15:17.414654+0000","last_unstale":"2024-09-15T23:15:18.411300+0000","last_undegraded":"2024-09-15T23:15:18.411300+0000","last_fullsized":"2024-09-15T23:15:18.411300+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:18.709002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.969799+0000","last_change":"2024-09-15T23:15:18.431587+0000","last_active":"2024-09-15T23:15:19.969799+0000","last_peered":"2024-09-15T23:15:19.969799+0000","last_clean":"2024-09-15T23:15:19.969799+0000","last_became_active":"2024-09-15T23:15:18.431349+0000","last_became_peered":"2024-09-15T23:15:18.431349+0000","last_unstale":"2024-09-15T23:15:19.969799+0000","last_undegraded":"2024-09-15T23:15:19.969799+0000","last_fullsized":"2024-09-15T23:15:19.969799+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:46.961107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.416513+0000","last_change":"2024-09-15T23:15:17.419929+0000","last_active":"2024-09-15T23:15:18.416513+0000","last_peered":"2024-09-15T23:15:18.416513+0000","last_clean":"2024-09-15T23:15:18.416513+0000","last_became_active":"2024-09-15T23:15:17.419466+0000","last_became_peered":"2024-09-15T23:15:17.419466+0000","last_unstale":"2024-09-15T23:15:18.416513+0000","last_undegraded":"2024-09-15T23:15:18.416513+0000","last_fullsized":"2024-09-15T23:15:18.416513+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:46.261414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.429073+0000","last_change":"2024-09-15T23:15:18.425524+0000","last_active":"2024-09-15T23:15:18.429073+0000","last_peered":"2024-09-15T23:15:18.429073+0000","last_clean":"2024-09-15T23:15:18.429073+0000","last_became_active":"2024-09-15T23:15:18.425219+0000","last_became_peered":"2024-09-15T23:15:18.425219+0000","last_unstale":"2024-09-15T23:15:18.429073+0000","last_undegraded":"2024-09-15T23:15:18.429073+0000","last_fullsized":"2024-09-15T23:15:18.429073+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:08:27.349431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.411879+0000","last_change":"2024-09-15T23:15:17.414889+0000","last_active":"2024-09-15T23:15:18.411879+0000","last_peered":"2024-09-15T23:15:18.411879+0000","last_clean":"2024-09-15T23:15:18.411879+0000","last_became_active":"2024-09-15T23:15:17.414596+0000","last_became_peered":"2024-09-15T23:15:17.414596+0000","last_unstale":"2024-09-15T23:15:18.411879+0000","last_undegraded":"2024-09-15T23:15:18.411879+0000","last_fullsized":"2024-09-15T23:15:18.411879+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:34:47.821581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.432884+0000","last_change":"2024-09-15T23:15:18.425840+0000","last_active":"2024-09-15T23:15:18.432884+0000","last_peered":"2024-09-15T23:15:18.432884+0000","last_clean":"2024-09-15T23:15:18.432884+0000","last_became_active":"2024-09-15T23:15:18.425561+0000","last_became_peered":"2024-09-15T23:15:18.425561+0000","last_unstale":"2024-09-15T23:15:18.432884+0000","last_undegraded":"2024-09-15T23:15:18.432884+0000","last_fullsized":"2024-09-15T23:15:18.432884+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:31.573725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.433357+0000","last_change":"2024-09-15T23:15:17.421844+0000","last_active":"2024-09-15T23:15:19.433357+0000","last_peered":"2024-09-15T23:15:19.433357+0000","last_clean":"2024-09-15T23:15:19.433357+0000","last_became_active":"2024-09-15T23:15:17.421309+0000","last_became_peered":"2024-09-15T23:15:17.421309+0000","last_unstale":"2024-09-15T23:15:19.433357+0000","last_undegraded":"2024-09-15T23:15:19.433357+0000","last_fullsized":"2024-09-15T23:15:19.433357+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:48:36.393544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.433365+0000","last_change":"2024-09-15T23:15:18.436382+0000","last_active":"2024-09-15T23:15:19.433365+0000","last_peered":"2024-09-15T23:15:19.433365+0000","last_clean":"2024-09-15T23:15:19.433365+0000","last_became_active":"2024-09-15T23:15:18.436102+0000","last_became_peered":"2024-09-15T23:15:18.436102+0000","last_unstale":"2024-09-15T23:15:19.433365+0000","last_undegraded":"2024-09-15T23:15:19.433365+0000","last_fullsized":"2024-09-15T23:15:19.433365+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:06.214882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"65'3","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.440190+0000","last_change":"2024-09-15T23:15:17.420819+0000","last_active":"2024-09-15T23:15:18.440190+0000","last_peered":"2024-09-15T23:15:18.440190+0000","last_clean":"2024-09-15T23:15:18.440190+0000","last_became_active":"2024-09-15T23:15:17.420556+0000","last_became_peered":"2024-09-15T23:15:17.420556+0000","last_unstale":"2024-09-15T23:15:18.440190+0000","last_undegraded":"2024-09-15T23:15:18.440190+0000","last_fullsized":"2024-09-15T23:15:18.440190+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:16:35.100011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.428959+0000","last_change":"2024-09-15T23:15:18.426496+0000","last_active":"2024-09-15T23:15:18.428959+0000","last_peered":"2024-09-15T23:15:18.428959+0000","last_clean":"2024-09-15T23:15:18.428959+0000","last_became_active":"2024-09-15T23:15:18.424000+0000","last_became_peered":"2024-09-15T23:15:18.424000+0000","last_unstale":"2024-09-15T23:15:18.428959+0000","last_undegraded":"2024-09-15T23:15:18.428959+0000","last_fullsized":"2024-09-15T23:15:18.428959+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:47:22.021855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"65'6","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.445115+0000","last_change":"2024-09-15T23:15:17.423001+0000","last_active":"2024-09-15T23:15:18.445115+0000","last_peered":"2024-09-15T23:15:18.445115+0000","last_clean":"2024-09-15T23:15:18.445115+0000","last_became_active":"2024-09-15T23:15:17.422673+0000","last_became_peered":"2024-09-15T23:15:17.422673+0000","last_unstale":"2024-09-15T23:15:18.445115+0000","last_undegraded":"2024-09-15T23:15:18.445115+0000","last_fullsized":"2024-09-15T23:15:18.445115+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:04.754257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.422439+0000","last_change":"2024-09-15T23:15:18.415452+0000","last_active":"2024-09-15T23:15:18.422439+0000","last_peered":"2024-09-15T23:15:18.422439+0000","last_clean":"2024-09-15T23:15:18.422439+0000","last_became_active":"2024-09-15T23:15:18.415151+0000","last_became_peered":"2024-09-15T23:15:18.415151+0000","last_unstale":"2024-09-15T23:15:18.422439+0000","last_undegraded":"2024-09-15T23:15:18.422439+0000","last_fullsized":"2024-09-15T23:15:18.422439+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:26:54.990691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.433277+0000","last_change":"2024-09-15T23:15:17.419449+0000","last_active":"2024-09-15T23:15:19.433277+0000","last_peered":"2024-09-15T23:15:19.433277+0000","last_clean":"2024-09-15T23:15:19.433277+0000","last_became_active":"2024-09-15T23:15:17.419170+0000","last_became_peered":"2024-09-15T23:15:17.419170+0000","last_unstale":"2024-09-15T23:15:19.433277+0000","last_undegraded":"2024-09-15T23:15:19.433277+0000","last_fullsized":"2024-09-15T23:15:19.433277+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:40:04.518437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.433019+0000","last_change":"2024-09-15T23:15:18.424172+0000","last_active":"2024-09-15T23:15:18.433019+0000","last_peered":"2024-09-15T23:15:18.433019+0000","last_clean":"2024-09-15T23:15:18.433019+0000","last_became_active":"2024-09-15T23:15:18.423379+0000","last_became_peered":"2024-09-15T23:15:18.423379+0000","last_unstale":"2024-09-15T23:15:18.433019+0000","last_undegraded":"2024-09-15T23:15:18.433019+0000","last_fullsized":"2024-09-15T23:15:18.433019+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:17.965471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.410255+0000","last_change":"2024-09-15T23:15:17.421978+0000","last_active":"2024-09-15T23:15:18.410255+0000","last_peered":"2024-09-15T23:15:18.410255+0000","last_clean":"2024-09-15T23:15:18.410255+0000","last_became_active":"2024-09-15T23:15:17.421678+0000","last_became_peered":"2024-09-15T23:15:17.421678+0000","last_unstale":"2024-09-15T23:15:18.410255+0000","last_undegraded":"2024-09-15T23:15:18.410255+0000","last_fullsized":"2024-09-15T23:15:18.410255+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:24.562420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.435116+0000","last_change":"2024-09-15T23:15:18.427890+0000","last_active":"2024-09-15T23:15:18.435116+0000","last_peered":"2024-09-15T23:15:18.435116+0000","last_clean":"2024-09-15T23:15:18.435116+0000","last_became_active":"2024-09-15T23:15:18.427590+0000","last_became_peered":"2024-09-15T23:15:18.427590+0000","last_unstale":"2024-09-15T23:15:18.435116+0000","last_undegraded":"2024-09-15T23:15:18.435116+0000","last_fullsized":"2024-09-15T23:15:18.435116+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:09.454369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.410781+0000","last_change":"2024-09-15T23:15:17.420485+0000","last_active":"2024-09-15T23:15:18.410781+0000","last_peered":"2024-09-15T23:15:18.410781+0000","last_clean":"2024-09-15T23:15:18.410781+0000","last_became_active":"2024-09-15T23:15:17.420162+0000","last_became_peered":"2024-09-15T23:15:17.420162+0000","last_unstale":"2024-09-15T23:15:18.410781+0000","last_undegraded":"2024-09-15T23:15:18.410781+0000","last_fullsized":"2024-09-15T23:15:18.410781+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:17.449432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.417911+0000","last_change":"2024-09-15T23:15:18.413330+0000","last_active":"2024-09-15T23:15:18.417911+0000","last_peered":"2024-09-15T23:15:18.417911+0000","last_clean":"2024-09-15T23:15:18.417911+0000","last_became_active":"2024-09-15T23:15:18.413081+0000","last_became_peered":"2024-09-15T23:15:18.413081+0000","last_unstale":"2024-09-15T23:15:18.417911+0000","last_undegraded":"2024-09-15T23:15:18.417911+0000","last_fullsized":"2024-09-15T23:15:18.417911+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:36:23.935215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"65'8","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.442790+0000","last_change":"2024-09-15T23:15:17.423689+0000","last_active":"2024-09-15T23:15:18.442790+0000","last_peered":"2024-09-15T23:15:18.442790+0000","last_clean":"2024-09-15T23:15:18.442790+0000","last_became_active":"2024-09-15T23:15:17.423435+0000","last_became_peered":"2024-09-15T23:15:17.423435+0000","last_unstale":"2024-09-15T23:15:18.442790+0000","last_undegraded":"2024-09-15T23:15:18.442790+0000","last_fullsized":"2024-09-15T23:15:18.442790+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:59:47.888544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.431945+0000","last_change":"2024-09-15T23:15:18.424381+0000","last_active":"2024-09-15T23:15:18.431945+0000","last_peered":"2024-09-15T23:15:18.431945+0000","last_clean":"2024-09-15T23:15:18.431945+0000","last_became_active":"2024-09-15T23:15:18.424031+0000","last_became_peered":"2024-09-15T23:15:18.424031+0000","last_unstale":"2024-09-15T23:15:18.431945+0000","last_undegraded":"2024-09-15T23:15:18.431945+0000","last_fullsized":"2024-09-15T23:15:18.431945+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:08:27.349431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"65'1","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.424227+0000","last_change":"2024-09-15T23:15:17.421154+0000","last_active":"2024-09-15T23:15:19.424227+0000","last_peered":"2024-09-15T23:15:19.424227+0000","last_clean":"2024-09-15T23:15:19.424227+0000","last_became_active":"2024-09-15T23:15:17.420848+0000","last_became_peered":"2024-09-15T23:15:17.420848+0000","last_unstale":"2024-09-15T23:15:19.424227+0000","last_undegraded":"2024-09-15T23:15:19.424227+0000","last_fullsized":"2024-09-15T23:15:19.424227+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:18.709002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.432841+0000","last_change":"2024-09-15T23:15:18.425127+0000","last_active":"2024-09-15T23:15:18.432841+0000","last_peered":"2024-09-15T23:15:18.432841+0000","last_clean":"2024-09-15T23:15:18.432841+0000","last_became_active":"2024-09-15T23:15:18.424836+0000","last_became_peered":"2024-09-15T23:15:18.424836+0000","last_unstale":"2024-09-15T23:15:18.432841+0000","last_undegraded":"2024-09-15T23:15:18.432841+0000","last_fullsized":"2024-09-15T23:15:18.432841+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:05:05.151198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.433365+0000","last_change":"2024-09-15T23:15:17.422055+0000","last_active":"2024-09-15T23:15:19.433365+0000","last_peered":"2024-09-15T23:15:19.433365+0000","last_clean":"2024-09-15T23:15:19.433365+0000","last_became_active":"2024-09-15T23:15:17.421606+0000","last_became_peered":"2024-09-15T23:15:17.421606+0000","last_unstale":"2024-09-15T23:15:19.433365+0000","last_undegraded":"2024-09-15T23:15:19.433365+0000","last_fullsized":"2024-09-15T23:15:19.433365+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:37.326654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.424071+0000","last_change":"2024-09-15T23:15:18.425786+0000","last_active":"2024-09-15T23:15:19.424071+0000","last_peered":"2024-09-15T23:15:19.424071+0000","last_clean":"2024-09-15T23:15:19.424071+0000","last_became_active":"2024-09-15T23:15:18.425509+0000","last_became_peered":"2024-09-15T23:15:18.425509+0000","last_unstale":"2024-09-15T23:15:19.424071+0000","last_undegraded":"2024-09-15T23:15:19.424071+0000","last_fullsized":"2024-09-15T23:15:19.424071+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:18:19.569755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"65'1","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.435430+0000","last_change":"2024-09-15T23:15:17.418532+0000","last_active":"2024-09-15T23:15:18.435430+0000","last_peered":"2024-09-15T23:15:18.435430+0000","last_clean":"2024-09-15T23:15:18.435430+0000","last_became_active":"2024-09-15T23:15:17.417558+0000","last_became_peered":"2024-09-15T23:15:17.417558+0000","last_unstale":"2024-09-15T23:15:18.435430+0000","last_undegraded":"2024-09-15T23:15:18.435430+0000","last_fullsized":"2024-09-15T23:15:18.435430+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:54.239430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.438608+0000","last_change":"2024-09-15T23:15:18.432660+0000","last_active":"2024-09-15T23:15:18.438608+0000","last_peered":"2024-09-15T23:15:18.438608+0000","last_clean":"2024-09-15T23:15:18.438608+0000","last_became_active":"2024-09-15T23:15:18.432409+0000","last_became_peered":"2024-09-15T23:15:18.432409+0000","last_unstale":"2024-09-15T23:15:18.438608+0000","last_undegraded":"2024-09-15T23:15:18.438608+0000","last_fullsized":"2024-09-15T23:15:18.438608+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:24.426135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.433421+0000","last_change":"2024-09-15T23:15:17.424665+0000","last_active":"2024-09-15T23:15:19.433421+0000","last_peered":"2024-09-15T23:15:19.433421+0000","last_clean":"2024-09-15T23:15:19.433421+0000","last_became_active":"2024-09-15T23:15:17.424403+0000","last_became_peered":"2024-09-15T23:15:17.424403+0000","last_unstale":"2024-09-15T23:15:19.433421+0000","last_undegraded":"2024-09-15T23:15:19.433421+0000","last_fullsized":"2024-09-15T23:15:19.433421+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:48:52.648306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.438058+0000","last_change":"2024-09-15T23:15:18.432228+0000","last_active":"2024-09-15T23:15:18.438058+0000","last_peered":"2024-09-15T23:15:18.438058+0000","last_clean":"2024-09-15T23:15:18.438058+0000","last_became_active":"2024-09-15T23:15:18.431968+0000","last_became_peered":"2024-09-15T23:15:18.431968+0000","last_unstale":"2024-09-15T23:15:18.438058+0000","last_undegraded":"2024-09-15T23:15:18.438058+0000","last_fullsized":"2024-09-15T23:15:18.438058+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:31.008454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:20.131986+0000","last_change":"2024-09-15T23:15:17.422615+0000","last_active":"2024-09-15T23:15:20.131986+0000","last_peered":"2024-09-15T23:15:20.131986+0000","last_clean":"2024-09-15T23:15:20.131986+0000","last_became_active":"2024-09-15T23:15:17.421865+0000","last_became_peered":"2024-09-15T23:15:17.421865+0000","last_unstale":"2024-09-15T23:15:20.131986+0000","last_undegraded":"2024-09-15T23:15:20.131986+0000","last_fullsized":"2024-09-15T23:15:20.131986+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:35.001251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.433177+0000","last_change":"2024-09-15T23:15:18.424562+0000","last_active":"2024-09-15T23:15:19.433177+0000","last_peered":"2024-09-15T23:15:19.433177+0000","last_clean":"2024-09-15T23:15:19.433177+0000","last_became_active":"2024-09-15T23:15:18.424252+0000","last_became_peered":"2024-09-15T23:15:18.424252+0000","last_unstale":"2024-09-15T23:15:19.433177+0000","last_undegraded":"2024-09-15T23:15:19.433177+0000","last_fullsized":"2024-09-15T23:15:19.433177+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:17.873620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.432977+0000","last_change":"2024-09-15T23:15:17.423259+0000","last_active":"2024-09-15T23:15:19.432977+0000","last_peered":"2024-09-15T23:15:19.432977+0000","last_clean":"2024-09-15T23:15:19.432977+0000","last_became_active":"2024-09-15T23:15:17.423018+0000","last_became_peered":"2024-09-15T23:15:17.423018+0000","last_unstale":"2024-09-15T23:15:19.432977+0000","last_undegraded":"2024-09-15T23:15:19.432977+0000","last_fullsized":"2024-09-15T23:15:19.432977+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:47:43.185090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.432989+0000","last_change":"2024-09-15T23:15:18.427422+0000","last_active":"2024-09-15T23:15:19.432989+0000","last_peered":"2024-09-15T23:15:19.432989+0000","last_clean":"2024-09-15T23:15:19.432989+0000","last_became_active":"2024-09-15T23:15:18.424429+0000","last_became_peered":"2024-09-15T23:15:18.424429+0000","last_unstale":"2024-09-15T23:15:19.432989+0000","last_undegraded":"2024-09-15T23:15:19.432989+0000","last_fullsized":"2024-09-15T23:15:19.432989+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:19:31.569558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.411003+0000","last_change":"2024-09-15T23:15:17.419419+0000","last_active":"2024-09-15T23:15:18.411003+0000","last_peered":"2024-09-15T23:15:18.411003+0000","last_clean":"2024-09-15T23:15:18.411003+0000","last_became_active":"2024-09-15T23:15:17.419136+0000","last_became_peered":"2024-09-15T23:15:17.419136+0000","last_unstale":"2024-09-15T23:15:18.411003+0000","last_undegraded":"2024-09-15T23:15:18.411003+0000","last_fullsized":"2024-09-15T23:15:18.411003+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:46.547138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.427099+0000","last_change":"2024-09-15T23:15:18.422950+0000","last_active":"2024-09-15T23:15:18.427099+0000","last_peered":"2024-09-15T23:15:18.427099+0000","last_clean":"2024-09-15T23:15:18.427099+0000","last_became_active":"2024-09-15T23:15:18.422642+0000","last_became_peered":"2024-09-15T23:15:18.422642+0000","last_unstale":"2024-09-15T23:15:18.427099+0000","last_undegraded":"2024-09-15T23:15:18.427099+0000","last_fullsized":"2024-09-15T23:15:18.427099+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:56:32.834170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.424166+0000","last_change":"2024-09-15T23:15:17.423581+0000","last_active":"2024-09-15T23:15:19.424166+0000","last_peered":"2024-09-15T23:15:19.424166+0000","last_clean":"2024-09-15T23:15:19.424166+0000","last_became_active":"2024-09-15T23:15:17.423230+0000","last_became_peered":"2024-09-15T23:15:17.423230+0000","last_unstale":"2024-09-15T23:15:19.424166+0000","last_undegraded":"2024-09-15T23:15:19.424166+0000","last_fullsized":"2024-09-15T23:15:19.424166+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:34:47.821581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.427675+0000","last_change":"2024-09-15T23:15:18.422308+0000","last_active":"2024-09-15T23:15:18.427675+0000","last_peered":"2024-09-15T23:15:18.427675+0000","last_clean":"2024-09-15T23:15:18.427675+0000","last_became_active":"2024-09-15T23:15:18.422052+0000","last_became_peered":"2024-09-15T23:15:18.422052+0000","last_unstale":"2024-09-15T23:15:18.427675+0000","last_undegraded":"2024-09-15T23:15:18.427675+0000","last_fullsized":"2024-09-15T23:15:18.427675+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:05.758506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"65'1","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.970307+0000","last_change":"2024-09-15T23:15:17.423958+0000","last_active":"2024-09-15T23:15:19.970307+0000","last_peered":"2024-09-15T23:15:19.970307+0000","last_clean":"2024-09-15T23:15:19.970307+0000","last_became_active":"2024-09-15T23:15:17.423564+0000","last_became_peered":"2024-09-15T23:15:17.423564+0000","last_unstale":"2024-09-15T23:15:19.970307+0000","last_undegraded":"2024-09-15T23:15:19.970307+0000","last_fullsized":"2024-09-15T23:15:19.970307+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:04:38.769835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.423950+0000","last_change":"2024-09-15T23:15:18.419932+0000","last_active":"2024-09-15T23:15:19.423950+0000","last_peered":"2024-09-15T23:15:19.423950+0000","last_clean":"2024-09-15T23:15:19.423950+0000","last_became_active":"2024-09-15T23:15:18.419632+0000","last_became_peered":"2024-09-15T23:15:18.419632+0000","last_unstale":"2024-09-15T23:15:19.423950+0000","last_undegraded":"2024-09-15T23:15:19.423950+0000","last_fullsized":"2024-09-15T23:15:19.423950+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:14.886926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.411271+0000","last_change":"2024-09-15T23:15:17.419469+0000","last_active":"2024-09-15T23:15:18.411271+0000","last_peered":"2024-09-15T23:15:18.411271+0000","last_clean":"2024-09-15T23:15:18.411271+0000","last_became_active":"2024-09-15T23:15:17.419181+0000","last_became_peered":"2024-09-15T23:15:17.419181+0000","last_unstale":"2024-09-15T23:15:18.411271+0000","last_undegraded":"2024-09-15T23:15:18.411271+0000","last_fullsized":"2024-09-15T23:15:18.411271+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:55:50.068951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.433552+0000","last_change":"2024-09-15T23:15:18.425146+0000","last_active":"2024-09-15T23:15:19.433552+0000","last_peered":"2024-09-15T23:15:19.433552+0000","last_clean":"2024-09-15T23:15:19.433552+0000","last_became_active":"2024-09-15T23:15:18.424653+0000","last_became_peered":"2024-09-15T23:15:18.424653+0000","last_unstale":"2024-09-15T23:15:19.433552+0000","last_undegraded":"2024-09-15T23:15:19.433552+0000","last_fullsized":"2024-09-15T23:15:19.433552+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:43:13.880554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.419573+0000","last_change":"2024-09-15T23:15:17.419719+0000","last_active":"2024-09-15T23:15:18.419573+0000","last_peered":"2024-09-15T23:15:18.419573+0000","last_clean":"2024-09-15T23:15:18.419573+0000","last_became_active":"2024-09-15T23:15:17.418627+0000","last_became_peered":"2024-09-15T23:15:17.418627+0000","last_unstale":"2024-09-15T23:15:18.419573+0000","last_undegraded":"2024-09-15T23:15:18.419573+0000","last_fullsized":"2024-09-15T23:15:18.419573+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:46.261414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.969972+0000","last_change":"2024-09-15T23:15:18.437022+0000","last_active":"2024-09-15T23:15:19.969972+0000","last_peered":"2024-09-15T23:15:19.969972+0000","last_clean":"2024-09-15T23:15:19.969972+0000","last_became_active":"2024-09-15T23:15:18.436379+0000","last_became_peered":"2024-09-15T23:15:18.436379+0000","last_unstale":"2024-09-15T23:15:19.969972+0000","last_undegraded":"2024-09-15T23:15:19.969972+0000","last_fullsized":"2024-09-15T23:15:19.969972+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:23:13.317304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.424041+0000","last_change":"2024-09-15T23:15:17.421602+0000","last_active":"2024-09-15T23:15:19.424041+0000","last_peered":"2024-09-15T23:15:19.424041+0000","last_clean":"2024-09-15T23:15:19.424041+0000","last_became_active":"2024-09-15T23:15:17.421331+0000","last_became_peered":"2024-09-15T23:15:17.421331+0000","last_unstale":"2024-09-15T23:15:19.424041+0000","last_undegraded":"2024-09-15T23:15:19.424041+0000","last_fullsized":"2024-09-15T23:15:19.424041+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:55:50.068951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.429476+0000","last_change":"2024-09-15T23:15:18.425047+0000","last_active":"2024-09-15T23:15:18.429476+0000","last_peered":"2024-09-15T23:15:18.429476+0000","last_clean":"2024-09-15T23:15:18.429476+0000","last_became_active":"2024-09-15T23:15:18.424709+0000","last_became_peered":"2024-09-15T23:15:18.424709+0000","last_unstale":"2024-09-15T23:15:18.429476+0000","last_undegraded":"2024-09-15T23:15:18.429476+0000","last_fullsized":"2024-09-15T23:15:18.429476+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:17.965471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.417042+0000","last_change":"2024-09-15T23:15:17.418864+0000","last_active":"2024-09-15T23:15:18.417042+0000","last_peered":"2024-09-15T23:15:18.417042+0000","last_clean":"2024-09-15T23:15:18.417042+0000","last_became_active":"2024-09-15T23:15:17.418469+0000","last_became_peered":"2024-09-15T23:15:17.418469+0000","last_unstale":"2024-09-15T23:15:18.417042+0000","last_undegraded":"2024-09-15T23:15:18.417042+0000","last_fullsized":"2024-09-15T23:15:18.417042+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:43.948383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.433446+0000","last_change":"2024-09-15T23:15:18.429353+0000","last_active":"2024-09-15T23:15:19.433446+0000","last_peered":"2024-09-15T23:15:19.433446+0000","last_clean":"2024-09-15T23:15:19.433446+0000","last_became_active":"2024-09-15T23:15:18.428860+0000","last_became_peered":"2024-09-15T23:15:18.428860+0000","last_unstale":"2024-09-15T23:15:19.433446+0000","last_undegraded":"2024-09-15T23:15:19.433446+0000","last_fullsized":"2024-09-15T23:15:19.433446+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:49:38.817033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.969785+0000","last_change":"2024-09-15T23:15:17.422477+0000","last_active":"2024-09-15T23:15:19.969785+0000","last_peered":"2024-09-15T23:15:19.969785+0000","last_clean":"2024-09-15T23:15:19.969785+0000","last_became_active":"2024-09-15T23:15:17.422210+0000","last_became_peered":"2024-09-15T23:15:17.422210+0000","last_unstale":"2024-09-15T23:15:19.969785+0000","last_undegraded":"2024-09-15T23:15:19.969785+0000","last_fullsized":"2024-09-15T23:15:19.969785+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:04:20.566409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.423868+0000","last_change":"2024-09-15T23:15:18.421044+0000","last_active":"2024-09-15T23:15:19.423868+0000","last_peered":"2024-09-15T23:15:19.423868+0000","last_clean":"2024-09-15T23:15:19.423868+0000","last_became_active":"2024-09-15T23:15:18.420464+0000","last_became_peered":"2024-09-15T23:15:18.420464+0000","last_unstale":"2024-09-15T23:15:19.423868+0000","last_undegraded":"2024-09-15T23:15:19.423868+0000","last_fullsized":"2024-09-15T23:15:19.423868+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:23:13.764284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.433123+0000","last_change":"2024-09-15T23:15:17.421433+0000","last_active":"2024-09-15T23:15:19.433123+0000","last_peered":"2024-09-15T23:15:19.433123+0000","last_clean":"2024-09-15T23:15:19.433123+0000","last_became_active":"2024-09-15T23:15:17.420922+0000","last_became_peered":"2024-09-15T23:15:17.420922+0000","last_unstale":"2024-09-15T23:15:19.433123+0000","last_undegraded":"2024-09-15T23:15:19.433123+0000","last_fullsized":"2024-09-15T23:15:19.433123+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:29.467855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.433348+0000","last_change":"2024-09-15T23:15:18.424109+0000","last_active":"2024-09-15T23:15:19.433348+0000","last_peered":"2024-09-15T23:15:19.433348+0000","last_clean":"2024-09-15T23:15:19.433348+0000","last_became_active":"2024-09-15T23:15:18.423760+0000","last_became_peered":"2024-09-15T23:15:18.423760+0000","last_unstale":"2024-09-15T23:15:19.433348+0000","last_undegraded":"2024-09-15T23:15:19.433348+0000","last_fullsized":"2024-09-15T23:15:19.433348+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:28.224101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.419336+0000","last_change":"2024-09-15T23:15:17.420005+0000","last_active":"2024-09-15T23:15:18.419336+0000","last_peered":"2024-09-15T23:15:18.419336+0000","last_clean":"2024-09-15T23:15:18.419336+0000","last_became_active":"2024-09-15T23:15:17.419730+0000","last_became_peered":"2024-09-15T23:15:17.419730+0000","last_unstale":"2024-09-15T23:15:18.419336+0000","last_undegraded":"2024-09-15T23:15:18.419336+0000","last_fullsized":"2024-09-15T23:15:18.419336+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:56:31.829921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":250,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.411062+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:15:18.411062+0000","last_peered":"2024-09-15T23:15:18.411062+0000","last_clean":"2024-09-15T23:15:18.411062+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:15:18.411062+0000","last_undegraded":"2024-09-15T23:15:18.411062+0000","last_fullsized":"2024-09-15T23:15:18.411062+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476781,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40252,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331588,"statfs":{"total":96636764160,"available":96595546112,"internally_reserved":0,"allocated":757760,"data_stored":319905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476778,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36088,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335752,"statfs":{"total":96636764160,"available":96599810048,"internally_reserved":0,"allocated":757760,"data_stored":319905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476780,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36672,"kb_used_data":1320,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335168,"statfs":{"total":96636764160,"available":96599212032,"internally_reserved":0,"allocated":1351680,"data_stored":910273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476780,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31932,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":757760,"data_stored":319905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542187,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36128,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335712,"statfs":{"total":96636764160,"available":96599769088,"internally_reserved":0,"allocated":790528,"data_stored":333072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542187,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36124,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335716,"statfs":{"total":96636764160,"available":96599773184,"internally_reserved":0,"allocated":786432,"data_stored":333002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542186,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36704,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335136,"statfs":{"total":96636764160,"available":96599179264,"internally_reserved":0,"allocated":1380352,"data_stored":923382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542188,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36124,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335716,"statfs":{"total":96636764160,"available":96599773184,"internally_reserved":0,"allocated":790528,"data_stored":333596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:15:22.372 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:15:22.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.505+0000 7f0f52b66640 1 Processor -- start 2024-09-15T23:15:22.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.505+0000 7f0f52b66640 1 -- start start 2024-09-15T23:15:22.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.506+0000 7f0f52b66640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0f4c0b2d40 0x7f0f4c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:22.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.506+0000 7f0f52b66640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0f4c13eb20 0x7f0f4c06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:22.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.506+0000 7f0f52b66640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f4c071180 con 0x7f0f4c15bcf0 2024-09-15T23:15:22.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.506+0000 7f0f52b66640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f0f4c071ab0 con 0x7f0f4c0b2d40 2024-09-15T23:15:22.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.506+0000 7f0f52b66640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0f4c071460 con 0x7f0f4c13eb20 2024-09-15T23:15:22.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.506+0000 7f0f50902640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0f4c0b2d40 0x7f0f4c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:22.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.506+0000 7f0f50902640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0f4c0b2d40 0x7f0f4c06bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49436/0 (socket says 172.21.15.123:49436) 2024-09-15T23:15:22.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.506+0000 7f0f51103640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f0f4c15bcf0 0x7f0f4c15c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58204/0 (socket says 172.21.15.123:58204) 2024-09-15T23:15:22.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.506+0000 7f0f50902640 1 -- 172.21.15.123:0/223020872 learned_addr learned my addr 172.21.15.123:0/223020872 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:22.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.507+0000 7f0f4bfff640 1 --2- 172.21.15.123:0/223020872 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0f4c13eb20 0x7f0f4c06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:22.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.507+0000 7f0f50902640 1 -- 172.21.15.123:0/223020872 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0f4c13eb20 msgr2=0x7f0f4c06c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:22.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.507+0000 7f0f50902640 1 --2- 172.21.15.123:0/223020872 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0f4c13eb20 0x7f0f4c06c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:22.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.507+0000 7f0f50902640 1 -- 172.21.15.123:0/223020872 >> v1:172.21.15.123:6789/0 conn(0x7f0f4c15bcf0 legacy=0x7f0f4c15c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:22.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.507+0000 7f0f4b7fe640 1 -- 172.21.15.123:0/223020872 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2927706813 0 0) 0x7f0f4c071180 con 0x7f0f4c15bcf0 2024-09-15T23:15:22.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.507+0000 7f0f50902640 1 -- 172.21.15.123:0/223020872 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f4c071740 con 0x7f0f4c0b2d40 2024-09-15T23:15:22.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.507+0000 7f0f50902640 1 --2- 172.21.15.123:0/223020872 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f4c0b2d40 0x7f0f4c06bc10 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c071c30 tx=0x7f0f4002c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c845d0a99e9728 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:22.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.507+0000 7f0f4b7fe640 1 -- 172.21.15.123:0/223020872 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f40036020 con 0x7f0f4c0b2d40 2024-09-15T23:15:22.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.508+0000 7f0f4b7fe640 1 -- 172.21.15.123:0/223020872 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f40032800 con 0x7f0f4c0b2d40 2024-09-15T23:15:22.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.508+0000 7f0f4b7fe640 1 -- 172.21.15.123:0/223020872 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f40032bd0 con 0x7f0f4c0b2d40 2024-09-15T23:15:22.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.508+0000 7f0f52b66640 1 -- 172.21.15.123:0/223020872 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f4c0b2d40 msgr2=0x7f0f4c06bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:22.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.508+0000 7f0f52b66640 1 --2- 172.21.15.123:0/223020872 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f4c0b2d40 0x7f0f4c06bc10 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c071c30 tx=0x7f0f4002c900 comp rx=0 tx=0).stop 2024-09-15T23:15:22.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.508+0000 7f0f52b66640 1 -- 172.21.15.123:0/223020872 shutdown_connections 2024-09-15T23:15:22.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.508+0000 7f0f52b66640 1 --2- 172.21.15.123:0/223020872 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0f4c13eb20 0x7f0f4c06c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:22.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.508+0000 7f0f52b66640 1 --2- 172.21.15.123:0/223020872 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f4c0b2d40 0x7f0f4c06bc10 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:22.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.508+0000 7f0f52b66640 1 -- 172.21.15.123:0/223020872 >> 172.21.15.123:0/223020872 conn(0x7f0f4c0ccec0 msgr2=0x7f0f4c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:22.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.508+0000 7f0f52b66640 1 -- 172.21.15.123:0/223020872 shutdown_connections 2024-09-15T23:15:22.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.508+0000 7f0f52b66640 1 -- 172.21.15.123:0/223020872 wait complete. 2024-09-15T23:15:22.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.509+0000 7f0f52b66640 1 Processor -- start 2024-09-15T23:15:22.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.509+0000 7f0f52b66640 1 -- start start 2024-09-15T23:15:22.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.510+0000 7f0f52b66640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0f4c0b2d40 0x7f0f4c0b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:22.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.510+0000 7f0f52b66640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0f4c13eb20 0x7f0f4c15ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:22.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.510+0000 7f0f52b66640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f4c15bcf0 0x7f0f4c15f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:22.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.510+0000 7f0f52b66640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4c0722d0 con 0x7f0f4c15bcf0 2024-09-15T23:15:22.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.510+0000 7f0f52b66640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4c072150 con 0x7f0f4c13eb20 2024-09-15T23:15:22.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.510+0000 7f0f52b66640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0f4c072450 con 0x7f0f4c0b2d40 2024-09-15T23:15:22.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.510+0000 7f0f51103640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f4c15bcf0 0x7f0f4c15f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:22.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.510+0000 7f0f51103640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f4c15bcf0 0x7f0f4c15f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49438/0 (socket says 172.21.15.123:49438) 2024-09-15T23:15:22.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.510+0000 7f0f51103640 1 -- 172.21.15.123:0/141198455 learned_addr learned my addr 172.21.15.123:0/141198455 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:22.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.510+0000 7f0f50902640 1 --2- 172.21.15.123:0/141198455 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0f4c0b2d40 0x7f0f4c0b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:22.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.510+0000 7f0f4bfff640 1 --2- 172.21.15.123:0/141198455 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0f4c13eb20 0x7f0f4c15ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:22.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.511+0000 7f0f51103640 1 -- 172.21.15.123:0/141198455 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0f4c0b2d40 msgr2=0x7f0f4c0b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:22.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.511+0000 7f0f51103640 1 --2- 172.21.15.123:0/141198455 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0f4c0b2d40 0x7f0f4c0b5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:22.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.511+0000 7f0f51103640 1 -- 172.21.15.123:0/141198455 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0f4c13eb20 msgr2=0x7f0f4c15ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:22.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.511+0000 7f0f51103640 1 --2- 172.21.15.123:0/141198455 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0f4c13eb20 0x7f0f4c15ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:22.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.511+0000 7f0f51103640 1 -- 172.21.15.123:0/141198455 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f4c0b4ac0 con 0x7f0f4c15bcf0 2024-09-15T23:15:22.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.511+0000 7f0f51103640 1 --2- 172.21.15.123:0/141198455 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f4c15bcf0 0x7f0f4c15f8a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f0f4400c700 tx=0x7f0f4400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:22.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.511+0000 7f0f497fa640 1 -- 172.21.15.123:0/141198455 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f44018070 con 0x7f0f4c15bcf0 2024-09-15T23:15:22.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.511+0000 7f0f497fa640 1 -- 172.21.15.123:0/141198455 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f4400ce10 con 0x7f0f4c15bcf0 2024-09-15T23:15:22.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.511+0000 7f0f52b66640 1 -- 172.21.15.123:0/141198455 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f4c0b4da0 con 0x7f0f4c15bcf0 2024-09-15T23:15:22.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.511+0000 7f0f497fa640 1 -- 172.21.15.123:0/141198455 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4400a860 con 0x7f0f4c15bcf0 2024-09-15T23:15:22.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.511+0000 7f0f52b66640 1 -- 172.21.15.123:0/141198455 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f4c0b5360 con 0x7f0f4c15bcf0 2024-09-15T23:15:22.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.512+0000 7f0f52b66640 1 -- 172.21.15.123:0/141198455 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f4c072890 con 0x7f0f4c15bcf0 2024-09-15T23:15:22.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.512+0000 7f0f497fa640 1 -- 172.21.15.123:0/141198455 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0f4401b070 con 0x7f0f4c15bcf0 2024-09-15T23:15:22.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.513+0000 7f0f497fa640 1 --2- 172.21.15.123:0/141198455 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0f3006c2b0 0x7f0f3006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:22.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.513+0000 7f0f497fa640 1 -- 172.21.15.123:0/141198455 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7f0f4408aa40 con 0x7f0f4c15bcf0 2024-09-15T23:15:22.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.513+0000 7f0f50902640 1 --2- 172.21.15.123:0/141198455 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0f3006c2b0 0x7f0f3006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:22.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.514+0000 7f0f50902640 1 --2- 172.21.15.123:0/141198455 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0f3006c2b0 0x7f0f3006e770 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0f40037000 tx=0x7f0f4003d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:22.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.517+0000 7f0f497fa640 1 -- 172.21.15.123:0/141198455 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0f440591b0 con 0x7f0f4c15bcf0 2024-09-15T23:15:22.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.679+0000 7f0f52b66640 1 -- 172.21.15.123:0/141198455 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0f4c0cc430 con 0x7f0f3006c2b0 2024-09-15T23:15:22.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.686+0000 7f0f497fa640 1 -- 172.21.15.123:0/141198455 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251948 (secure 0 0 0) 0x7f0f4c0cc430 con 0x7f0f3006c2b0 2024-09-15T23:15:22.689 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:22.691 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:15:22.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.688+0000 7f0f52b66640 1 -- 172.21.15.123:0/141198455 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0f3006c2b0 msgr2=0x7f0f3006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:22.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.688+0000 7f0f52b66640 1 --2- 172.21.15.123:0/141198455 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0f3006c2b0 0x7f0f3006e770 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0f40037000 tx=0x7f0f4003d040 comp rx=0 tx=0).stop 2024-09-15T23:15:22.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.688+0000 7f0f52b66640 1 -- 172.21.15.123:0/141198455 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f4c15bcf0 msgr2=0x7f0f4c15f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:22.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.688+0000 7f0f52b66640 1 --2- 172.21.15.123:0/141198455 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f4c15bcf0 0x7f0f4c15f8a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f0f4400c700 tx=0x7f0f4400cbc0 comp rx=0 tx=0).stop 2024-09-15T23:15:22.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.688+0000 7f0f52b66640 1 -- 172.21.15.123:0/141198455 shutdown_connections 2024-09-15T23:15:22.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.688+0000 7f0f52b66640 1 --2- 172.21.15.123:0/141198455 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0f3006c2b0 0x7f0f3006e770 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:22.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.688+0000 7f0f52b66640 1 --2- 172.21.15.123:0/141198455 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0f4c15bcf0 0x7f0f4c15f8a0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:22.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.688+0000 7f0f52b66640 1 --2- 172.21.15.123:0/141198455 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0f4c13eb20 0x7f0f4c15ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:22.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.688+0000 7f0f52b66640 1 --2- 172.21.15.123:0/141198455 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0f4c0b2d40 0x7f0f4c0b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:22.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.688+0000 7f0f52b66640 1 -- 172.21.15.123:0/141198455 >> 172.21.15.123:0/141198455 conn(0x7f0f4c0ccec0 msgr2=0x7f0f4c072c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:22.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.688+0000 7f0f52b66640 1 -- 172.21.15.123:0/141198455 shutdown_connections 2024-09-15T23:15:22.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.688+0000 7f0f52b66640 1 -- 172.21.15.123:0/141198455 wait complete. 2024-09-15T23:15:22.701 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-09-15T23:15:21.546036+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":164,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":290024,"kb_used_data":7200,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754684696,"statfs":{"total":773094113280,"available":772797128704,"internally_reserved":0,"allocated":7372800,"data_stored":3793040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":289394224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,5,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.145363"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.970337+0000","last_change":"2024-09-15T23:15:18.439334+0000","last_active":"2024-09-15T23:15:19.970337+0000","last_peered":"2024-09-15T23:15:19.970337+0000","last_clean":"2024-09-15T23:15:19.970337+0000","last_became_active":"2024-09-15T23:15:18.439000+0000","last_became_peered":"2024-09-15T23:15:18.439000+0000","last_unstale":"2024-09-15T23:15:19.970337+0000","last_undegraded":"2024-09-15T23:15:19.970337+0000","last_fullsized":"2024-09-15T23:15:19.970337+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:30:12.756464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.424335+0000","last_change":"2024-09-15T23:15:18.434154+0000","last_active":"2024-09-15T23:15:19.424335+0000","last_peered":"2024-09-15T23:15:19.424335+0000","last_clean":"2024-09-15T23:15:19.424335+0000","last_became_active":"2024-09-15T23:15:18.433736+0000","last_became_peered":"2024-09-15T23:15:18.433736+0000","last_unstale":"2024-09-15T23:15:19.424335+0000","last_undegraded":"2024-09-15T23:15:19.424335+0000","last_fullsized":"2024-09-15T23:15:19.424335+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:14:43.283307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.431899+0000","last_change":"2024-09-15T23:15:18.423868+0000","last_active":"2024-09-15T23:15:18.431899+0000","last_peered":"2024-09-15T23:15:18.431899+0000","last_clean":"2024-09-15T23:15:18.431899+0000","last_became_active":"2024-09-15T23:15:18.423385+0000","last_became_peered":"2024-09-15T23:15:18.423385+0000","last_unstale":"2024-09-15T23:15:18.431899+0000","last_undegraded":"2024-09-15T23:15:18.431899+0000","last_fullsized":"2024-09-15T23:15:18.431899+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:58:52.164625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.435961+0000","last_change":"2024-09-15T23:15:18.431364+0000","last_active":"2024-09-15T23:15:18.435961+0000","last_peered":"2024-09-15T23:15:18.435961+0000","last_clean":"2024-09-15T23:15:18.435961+0000","last_became_active":"2024-09-15T23:15:18.431048+0000","last_became_peered":"2024-09-15T23:15:18.431048+0000","last_unstale":"2024-09-15T23:15:18.435961+0000","last_undegraded":"2024-09-15T23:15:18.435961+0000","last_fullsized":"2024-09-15T23:15:18.435961+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:47:00.933662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.970330+0000","last_change":"2024-09-15T23:15:18.436447+0000","last_active":"2024-09-15T23:15:19.970330+0000","last_peered":"2024-09-15T23:15:19.970330+0000","last_clean":"2024-09-15T23:15:19.970330+0000","last_became_active":"2024-09-15T23:15:18.436198+0000","last_became_peered":"2024-09-15T23:15:18.436198+0000","last_unstale":"2024-09-15T23:15:19.970330+0000","last_undegraded":"2024-09-15T23:15:19.970330+0000","last_fullsized":"2024-09-15T23:15:19.970330+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:13:14.970303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.969913+0000","last_change":"2024-09-15T23:15:18.437223+0000","last_active":"2024-09-15T23:15:19.969913+0000","last_peered":"2024-09-15T23:15:19.969913+0000","last_clean":"2024-09-15T23:15:19.969913+0000","last_became_active":"2024-09-15T23:15:18.436744+0000","last_became_peered":"2024-09-15T23:15:18.436744+0000","last_unstale":"2024-09-15T23:15:19.969913+0000","last_undegraded":"2024-09-15T23:15:19.969913+0000","last_fullsized":"2024-09-15T23:15:19.969913+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:27.937790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.430989+0000","last_change":"2024-09-15T23:15:18.426778+0000","last_active":"2024-09-15T23:15:18.430989+0000","last_peered":"2024-09-15T23:15:18.430989+0000","last_clean":"2024-09-15T23:15:18.430989+0000","last_became_active":"2024-09-15T23:15:18.423971+0000","last_became_peered":"2024-09-15T23:15:18.423971+0000","last_unstale":"2024-09-15T23:15:18.430989+0000","last_undegraded":"2024-09-15T23:15:18.430989+0000","last_fullsized":"2024-09-15T23:15:18.430989+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:16.294601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.433035+0000","last_change":"2024-09-15T23:15:18.431876+0000","last_active":"2024-09-15T23:15:19.433035+0000","last_peered":"2024-09-15T23:15:19.433035+0000","last_clean":"2024-09-15T23:15:19.433035+0000","last_became_active":"2024-09-15T23:15:18.431590+0000","last_became_peered":"2024-09-15T23:15:18.431590+0000","last_unstale":"2024-09-15T23:15:19.433035+0000","last_undegraded":"2024-09-15T23:15:19.433035+0000","last_fullsized":"2024-09-15T23:15:19.433035+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:39.949512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.437112+0000","last_change":"2024-09-15T23:15:18.431941+0000","last_active":"2024-09-15T23:15:18.437112+0000","last_peered":"2024-09-15T23:15:18.437112+0000","last_clean":"2024-09-15T23:15:18.437112+0000","last_became_active":"2024-09-15T23:15:18.431643+0000","last_became_peered":"2024-09-15T23:15:18.431643+0000","last_unstale":"2024-09-15T23:15:18.437112+0000","last_undegraded":"2024-09-15T23:15:18.437112+0000","last_fullsized":"2024-09-15T23:15:18.437112+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:21:30.386792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.970216+0000","last_change":"2024-09-15T23:15:18.430549+0000","last_active":"2024-09-15T23:15:19.970216+0000","last_peered":"2024-09-15T23:15:19.970216+0000","last_clean":"2024-09-15T23:15:19.970216+0000","last_became_active":"2024-09-15T23:15:18.430236+0000","last_became_peered":"2024-09-15T23:15:18.430236+0000","last_unstale":"2024-09-15T23:15:19.970216+0000","last_undegraded":"2024-09-15T23:15:19.970216+0000","last_fullsized":"2024-09-15T23:15:19.970216+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:30:46.873336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:20.131953+0000","last_change":"2024-09-15T23:15:18.433755+0000","last_active":"2024-09-15T23:15:20.131953+0000","last_peered":"2024-09-15T23:15:20.131953+0000","last_clean":"2024-09-15T23:15:20.131953+0000","last_became_active":"2024-09-15T23:15:18.433495+0000","last_became_peered":"2024-09-15T23:15:18.433495+0000","last_unstale":"2024-09-15T23:15:20.131953+0000","last_undegraded":"2024-09-15T23:15:20.131953+0000","last_fullsized":"2024-09-15T23:15:20.131953+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:19.950525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.435073+0000","last_change":"2024-09-15T23:15:18.428196+0000","last_active":"2024-09-15T23:15:18.435073+0000","last_peered":"2024-09-15T23:15:18.435073+0000","last_clean":"2024-09-15T23:15:18.435073+0000","last_became_active":"2024-09-15T23:15:18.427896+0000","last_became_peered":"2024-09-15T23:15:18.427896+0000","last_unstale":"2024-09-15T23:15:18.435073+0000","last_undegraded":"2024-09-15T23:15:18.435073+0000","last_fullsized":"2024-09-15T23:15:18.435073+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:46:03.806298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.429497+0000","last_change":"2024-09-15T23:15:18.425632+0000","last_active":"2024-09-15T23:15:18.429497+0000","last_peered":"2024-09-15T23:15:18.429497+0000","last_clean":"2024-09-15T23:15:18.429497+0000","last_became_active":"2024-09-15T23:15:18.425360+0000","last_became_peered":"2024-09-15T23:15:18.425360+0000","last_unstale":"2024-09-15T23:15:18.429497+0000","last_undegraded":"2024-09-15T23:15:18.429497+0000","last_fullsized":"2024-09-15T23:15:18.429497+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:05:05.151198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.432069+0000","last_change":"2024-09-15T23:15:18.423704+0000","last_active":"2024-09-15T23:15:18.432069+0000","last_peered":"2024-09-15T23:15:18.432069+0000","last_clean":"2024-09-15T23:15:18.432069+0000","last_became_active":"2024-09-15T23:15:18.423454+0000","last_became_peered":"2024-09-15T23:15:18.423454+0000","last_unstale":"2024-09-15T23:15:18.432069+0000","last_undegraded":"2024-09-15T23:15:18.432069+0000","last_fullsized":"2024-09-15T23:15:18.432069+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:39.319833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.437900+0000","last_change":"2024-09-15T23:15:18.433520+0000","last_active":"2024-09-15T23:15:18.437900+0000","last_peered":"2024-09-15T23:15:18.437900+0000","last_clean":"2024-09-15T23:15:18.437900+0000","last_became_active":"2024-09-15T23:15:18.433230+0000","last_became_peered":"2024-09-15T23:15:18.433230+0000","last_unstale":"2024-09-15T23:15:18.437900+0000","last_undegraded":"2024-09-15T23:15:18.437900+0000","last_fullsized":"2024-09-15T23:15:18.437900+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:31.573725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.969796+0000","last_change":"2024-09-15T23:15:18.437502+0000","last_active":"2024-09-15T23:15:19.969796+0000","last_peered":"2024-09-15T23:15:19.969796+0000","last_clean":"2024-09-15T23:15:19.969796+0000","last_became_active":"2024-09-15T23:15:18.437232+0000","last_became_peered":"2024-09-15T23:15:18.437232+0000","last_unstale":"2024-09-15T23:15:19.969796+0000","last_undegraded":"2024-09-15T23:15:19.969796+0000","last_fullsized":"2024-09-15T23:15:19.969796+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:15.830577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.970378+0000","last_change":"2024-09-15T23:15:18.434765+0000","last_active":"2024-09-15T23:15:19.970378+0000","last_peered":"2024-09-15T23:15:19.970378+0000","last_clean":"2024-09-15T23:15:19.970378+0000","last_became_active":"2024-09-15T23:15:18.434466+0000","last_became_peered":"2024-09-15T23:15:18.434466+0000","last_unstale":"2024-09-15T23:15:19.970378+0000","last_undegraded":"2024-09-15T23:15:19.970378+0000","last_fullsized":"2024-09-15T23:15:19.970378+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:19.804479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.432225+0000","last_change":"2024-09-15T23:15:18.426352+0000","last_active":"2024-09-15T23:15:18.432225+0000","last_peered":"2024-09-15T23:15:18.432225+0000","last_clean":"2024-09-15T23:15:18.432225+0000","last_became_active":"2024-09-15T23:15:18.426044+0000","last_became_peered":"2024-09-15T23:15:18.426044+0000","last_unstale":"2024-09-15T23:15:18.432225+0000","last_undegraded":"2024-09-15T23:15:18.432225+0000","last_fullsized":"2024-09-15T23:15:18.432225+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:15.830577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.423990+0000","last_change":"2024-09-15T23:15:18.424373+0000","last_active":"2024-09-15T23:15:19.423990+0000","last_peered":"2024-09-15T23:15:19.423990+0000","last_clean":"2024-09-15T23:15:19.423990+0000","last_became_active":"2024-09-15T23:15:18.423933+0000","last_became_peered":"2024-09-15T23:15:18.423933+0000","last_unstale":"2024-09-15T23:15:19.423990+0000","last_undegraded":"2024-09-15T23:15:19.423990+0000","last_fullsized":"2024-09-15T23:15:19.423990+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:11:36.335746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:20.131940+0000","last_change":"2024-09-15T23:15:18.434523+0000","last_active":"2024-09-15T23:15:20.131940+0000","last_peered":"2024-09-15T23:15:20.131940+0000","last_clean":"2024-09-15T23:15:20.131940+0000","last_became_active":"2024-09-15T23:15:18.434282+0000","last_became_peered":"2024-09-15T23:15:18.434282+0000","last_unstale":"2024-09-15T23:15:20.131940+0000","last_undegraded":"2024-09-15T23:15:20.131940+0000","last_fullsized":"2024-09-15T23:15:20.131940+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:58:42.806614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.426914+0000","last_change":"2024-09-15T23:15:18.424416+0000","last_active":"2024-09-15T23:15:18.426914+0000","last_peered":"2024-09-15T23:15:18.426914+0000","last_clean":"2024-09-15T23:15:18.426914+0000","last_became_active":"2024-09-15T23:15:18.424144+0000","last_became_peered":"2024-09-15T23:15:18.424144+0000","last_unstale":"2024-09-15T23:15:18.426914+0000","last_undegraded":"2024-09-15T23:15:18.426914+0000","last_fullsized":"2024-09-15T23:15:18.426914+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:58:52.164625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:20.132190+0000","last_change":"2024-09-15T23:15:18.422363+0000","last_active":"2024-09-15T23:15:20.132190+0000","last_peered":"2024-09-15T23:15:20.132190+0000","last_clean":"2024-09-15T23:15:20.132190+0000","last_became_active":"2024-09-15T23:15:18.422103+0000","last_became_peered":"2024-09-15T23:15:18.422103+0000","last_unstale":"2024-09-15T23:15:20.132190+0000","last_undegraded":"2024-09-15T23:15:20.132190+0000","last_fullsized":"2024-09-15T23:15:20.132190+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:17:03.556020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.418261+0000","last_change":"2024-09-15T23:15:18.415403+0000","last_active":"2024-09-15T23:15:18.418261+0000","last_peered":"2024-09-15T23:15:18.418261+0000","last_clean":"2024-09-15T23:15:18.418261+0000","last_became_active":"2024-09-15T23:15:18.415094+0000","last_became_peered":"2024-09-15T23:15:18.415094+0000","last_unstale":"2024-09-15T23:15:18.418261+0000","last_undegraded":"2024-09-15T23:15:18.418261+0000","last_fullsized":"2024-09-15T23:15:18.418261+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:52:18.724497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.435135+0000","last_change":"2024-09-15T23:15:18.428409+0000","last_active":"2024-09-15T23:15:18.435135+0000","last_peered":"2024-09-15T23:15:18.435135+0000","last_clean":"2024-09-15T23:15:18.435135+0000","last_became_active":"2024-09-15T23:15:18.427910+0000","last_became_peered":"2024-09-15T23:15:18.427910+0000","last_unstale":"2024-09-15T23:15:18.435135+0000","last_undegraded":"2024-09-15T23:15:18.435135+0000","last_fullsized":"2024-09-15T23:15:18.435135+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:21:02.531500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.423967+0000","last_change":"2024-09-15T23:15:18.433080+0000","last_active":"2024-09-15T23:15:19.423967+0000","last_peered":"2024-09-15T23:15:19.423967+0000","last_clean":"2024-09-15T23:15:19.423967+0000","last_became_active":"2024-09-15T23:15:18.432779+0000","last_became_peered":"2024-09-15T23:15:18.432779+0000","last_unstale":"2024-09-15T23:15:19.423967+0000","last_undegraded":"2024-09-15T23:15:19.423967+0000","last_fullsized":"2024-09-15T23:15:19.423967+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:48.110108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.424920+0000","last_change":"2024-09-15T23:15:18.423716+0000","last_active":"2024-09-15T23:15:18.424920+0000","last_peered":"2024-09-15T23:15:18.424920+0000","last_clean":"2024-09-15T23:15:18.424920+0000","last_became_active":"2024-09-15T23:15:18.423450+0000","last_became_peered":"2024-09-15T23:15:18.423450+0000","last_unstale":"2024-09-15T23:15:18.424920+0000","last_undegraded":"2024-09-15T23:15:18.424920+0000","last_fullsized":"2024-09-15T23:15:18.424920+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:39.319833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.424176+0000","last_change":"2024-09-15T23:15:18.423811+0000","last_active":"2024-09-15T23:15:19.424176+0000","last_peered":"2024-09-15T23:15:19.424176+0000","last_clean":"2024-09-15T23:15:19.424176+0000","last_became_active":"2024-09-15T23:15:18.423388+0000","last_became_peered":"2024-09-15T23:15:18.423388+0000","last_unstale":"2024-09-15T23:15:19.424176+0000","last_undegraded":"2024-09-15T23:15:19.424176+0000","last_fullsized":"2024-09-15T23:15:19.424176+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:14.699526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.433277+0000","last_change":"2024-09-15T23:15:18.425885+0000","last_active":"2024-09-15T23:15:19.433277+0000","last_peered":"2024-09-15T23:15:19.433277+0000","last_clean":"2024-09-15T23:15:19.433277+0000","last_became_active":"2024-09-15T23:15:18.425181+0000","last_became_peered":"2024-09-15T23:15:18.425181+0000","last_unstale":"2024-09-15T23:15:19.433277+0000","last_undegraded":"2024-09-15T23:15:19.433277+0000","last_fullsized":"2024-09-15T23:15:19.433277+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:05:05.937073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.433160+0000","last_change":"2024-09-15T23:15:18.431677+0000","last_active":"2024-09-15T23:15:19.433160+0000","last_peered":"2024-09-15T23:15:19.433160+0000","last_clean":"2024-09-15T23:15:19.433160+0000","last_became_active":"2024-09-15T23:15:18.431394+0000","last_became_peered":"2024-09-15T23:15:18.431394+0000","last_unstale":"2024-09-15T23:15:19.433160+0000","last_undegraded":"2024-09-15T23:15:19.433160+0000","last_fullsized":"2024-09-15T23:15:19.433160+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:03:04.172651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.429466+0000","last_change":"2024-09-15T23:15:18.422709+0000","last_active":"2024-09-15T23:15:18.429466+0000","last_peered":"2024-09-15T23:15:18.429466+0000","last_clean":"2024-09-15T23:15:18.429466+0000","last_became_active":"2024-09-15T23:15:18.421685+0000","last_became_peered":"2024-09-15T23:15:18.421685+0000","last_unstale":"2024-09-15T23:15:18.429466+0000","last_undegraded":"2024-09-15T23:15:18.429466+0000","last_fullsized":"2024-09-15T23:15:18.429466+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:05.577417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.423700+0000","last_change":"2024-09-15T23:15:18.416660+0000","last_active":"2024-09-15T23:15:19.423700+0000","last_peered":"2024-09-15T23:15:19.423700+0000","last_clean":"2024-09-15T23:15:19.423700+0000","last_became_active":"2024-09-15T23:15:18.416371+0000","last_became_peered":"2024-09-15T23:15:18.416371+0000","last_unstale":"2024-09-15T23:15:19.423700+0000","last_undegraded":"2024-09-15T23:15:19.423700+0000","last_fullsized":"2024-09-15T23:15:19.423700+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:39:59.210108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:20.131872+0000","last_change":"2024-09-15T23:15:18.420063+0000","last_active":"2024-09-15T23:15:20.131872+0000","last_peered":"2024-09-15T23:15:20.131872+0000","last_clean":"2024-09-15T23:15:20.131872+0000","last_became_active":"2024-09-15T23:15:18.419793+0000","last_became_peered":"2024-09-15T23:15:18.419793+0000","last_unstale":"2024-09-15T23:15:20.131872+0000","last_undegraded":"2024-09-15T23:15:20.131872+0000","last_fullsized":"2024-09-15T23:15:20.131872+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:05.501711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.970313+0000","last_change":"2024-09-15T23:15:18.436009+0000","last_active":"2024-09-15T23:15:19.970313+0000","last_peered":"2024-09-15T23:15:19.970313+0000","last_clean":"2024-09-15T23:15:19.970313+0000","last_became_active":"2024-09-15T23:15:18.435533+0000","last_became_peered":"2024-09-15T23:15:18.435533+0000","last_unstale":"2024-09-15T23:15:19.970313+0000","last_undegraded":"2024-09-15T23:15:19.970313+0000","last_fullsized":"2024-09-15T23:15:19.970313+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:26:15.486840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"65'4","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:20.131989+0000","last_change":"2024-09-15T23:15:17.417037+0000","last_active":"2024-09-15T23:15:20.131989+0000","last_peered":"2024-09-15T23:15:20.131989+0000","last_clean":"2024-09-15T23:15:20.131989+0000","last_became_active":"2024-09-15T23:15:17.416771+0000","last_became_peered":"2024-09-15T23:15:17.416771+0000","last_unstale":"2024-09-15T23:15:20.131989+0000","last_undegraded":"2024-09-15T23:15:20.131989+0000","last_fullsized":"2024-09-15T23:15:20.131989+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:48:36.393544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.970503+0000","last_change":"2024-09-15T23:15:18.438025+0000","last_active":"2024-09-15T23:15:19.970503+0000","last_peered":"2024-09-15T23:15:19.970503+0000","last_clean":"2024-09-15T23:15:19.970503+0000","last_became_active":"2024-09-15T23:15:18.437698+0000","last_became_peered":"2024-09-15T23:15:18.437698+0000","last_unstale":"2024-09-15T23:15:19.970503+0000","last_undegraded":"2024-09-15T23:15:19.970503+0000","last_fullsized":"2024-09-15T23:15:19.970503+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:17.024938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"65'1","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.424267+0000","last_change":"2024-09-15T23:15:17.420108+0000","last_active":"2024-09-15T23:15:19.424267+0000","last_peered":"2024-09-15T23:15:19.424267+0000","last_clean":"2024-09-15T23:15:19.424267+0000","last_became_active":"2024-09-15T23:15:17.419839+0000","last_became_peered":"2024-09-15T23:15:17.419839+0000","last_unstale":"2024-09-15T23:15:19.424267+0000","last_undegraded":"2024-09-15T23:15:19.424267+0000","last_fullsized":"2024-09-15T23:15:19.424267+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:46.547138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.433150+0000","last_change":"2024-09-15T23:15:18.434810+0000","last_active":"2024-09-15T23:15:19.433150+0000","last_peered":"2024-09-15T23:15:19.433150+0000","last_clean":"2024-09-15T23:15:19.433150+0000","last_became_active":"2024-09-15T23:15:18.434468+0000","last_became_peered":"2024-09-15T23:15:18.434468+0000","last_unstale":"2024-09-15T23:15:19.433150+0000","last_undegraded":"2024-09-15T23:15:19.433150+0000","last_fullsized":"2024-09-15T23:15:19.433150+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:06.859089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.970223+0000","last_change":"2024-09-15T23:15:17.420266+0000","last_active":"2024-09-15T23:15:19.970223+0000","last_peered":"2024-09-15T23:15:19.970223+0000","last_clean":"2024-09-15T23:15:19.970223+0000","last_became_active":"2024-09-15T23:15:17.419999+0000","last_became_peered":"2024-09-15T23:15:17.419999+0000","last_unstale":"2024-09-15T23:15:19.970223+0000","last_undegraded":"2024-09-15T23:15:19.970223+0000","last_fullsized":"2024-09-15T23:15:19.970223+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:46.444334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.970139+0000","last_change":"2024-09-15T23:15:18.430709+0000","last_active":"2024-09-15T23:15:19.970139+0000","last_peered":"2024-09-15T23:15:19.970139+0000","last_clean":"2024-09-15T23:15:19.970139+0000","last_became_active":"2024-09-15T23:15:18.430396+0000","last_became_peered":"2024-09-15T23:15:18.430396+0000","last_unstale":"2024-09-15T23:15:19.970139+0000","last_undegraded":"2024-09-15T23:15:19.970139+0000","last_fullsized":"2024-09-15T23:15:19.970139+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:17.670996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"65'2","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.440380+0000","last_change":"2024-09-15T23:15:17.425060+0000","last_active":"2024-09-15T23:15:18.440380+0000","last_peered":"2024-09-15T23:15:18.440380+0000","last_clean":"2024-09-15T23:15:18.440380+0000","last_became_active":"2024-09-15T23:15:17.424786+0000","last_became_peered":"2024-09-15T23:15:17.424786+0000","last_unstale":"2024-09-15T23:15:18.440380+0000","last_undegraded":"2024-09-15T23:15:18.440380+0000","last_fullsized":"2024-09-15T23:15:18.440380+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:28:27.013881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.433054+0000","last_change":"2024-09-15T23:15:18.421643+0000","last_active":"2024-09-15T23:15:19.433054+0000","last_peered":"2024-09-15T23:15:19.433054+0000","last_clean":"2024-09-15T23:15:19.433054+0000","last_became_active":"2024-09-15T23:15:18.421176+0000","last_became_peered":"2024-09-15T23:15:18.421176+0000","last_unstale":"2024-09-15T23:15:19.433054+0000","last_undegraded":"2024-09-15T23:15:19.433054+0000","last_fullsized":"2024-09-15T23:15:19.433054+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:05:23.192016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"65'1","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.435487+0000","last_change":"2024-09-15T23:15:17.421346+0000","last_active":"2024-09-15T23:15:18.435487+0000","last_peered":"2024-09-15T23:15:18.435487+0000","last_clean":"2024-09-15T23:15:18.435487+0000","last_became_active":"2024-09-15T23:15:17.421068+0000","last_became_peered":"2024-09-15T23:15:17.421068+0000","last_unstale":"2024-09-15T23:15:18.435487+0000","last_undegraded":"2024-09-15T23:15:18.435487+0000","last_fullsized":"2024-09-15T23:15:18.435487+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:33.328627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:20.132013+0000","last_change":"2024-09-15T23:15:18.420107+0000","last_active":"2024-09-15T23:15:20.132013+0000","last_peered":"2024-09-15T23:15:20.132013+0000","last_clean":"2024-09-15T23:15:20.132013+0000","last_became_active":"2024-09-15T23:15:18.419767+0000","last_became_peered":"2024-09-15T23:15:18.419767+0000","last_unstale":"2024-09-15T23:15:20.132013+0000","last_undegraded":"2024-09-15T23:15:20.132013+0000","last_fullsized":"2024-09-15T23:15:20.132013+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:52:29.671637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"65'1","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.969991+0000","last_change":"2024-09-15T23:15:17.424272+0000","last_active":"2024-09-15T23:15:19.969991+0000","last_peered":"2024-09-15T23:15:19.969991+0000","last_clean":"2024-09-15T23:15:19.969991+0000","last_became_active":"2024-09-15T23:15:17.423836+0000","last_became_peered":"2024-09-15T23:15:17.423836+0000","last_unstale":"2024-09-15T23:15:19.969991+0000","last_undegraded":"2024-09-15T23:15:19.969991+0000","last_fullsized":"2024-09-15T23:15:19.969991+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:03.177439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.437172+0000","last_change":"2024-09-15T23:15:18.434790+0000","last_active":"2024-09-15T23:15:18.437172+0000","last_peered":"2024-09-15T23:15:18.437172+0000","last_clean":"2024-09-15T23:15:18.437172+0000","last_became_active":"2024-09-15T23:15:18.434189+0000","last_became_peered":"2024-09-15T23:15:18.434189+0000","last_unstale":"2024-09-15T23:15:18.437172+0000","last_undegraded":"2024-09-15T23:15:18.437172+0000","last_fullsized":"2024-09-15T23:15:18.437172+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:46.961107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.411300+0000","last_change":"2024-09-15T23:15:17.414929+0000","last_active":"2024-09-15T23:15:18.411300+0000","last_peered":"2024-09-15T23:15:18.411300+0000","last_clean":"2024-09-15T23:15:18.411300+0000","last_became_active":"2024-09-15T23:15:17.414654+0000","last_became_peered":"2024-09-15T23:15:17.414654+0000","last_unstale":"2024-09-15T23:15:18.411300+0000","last_undegraded":"2024-09-15T23:15:18.411300+0000","last_fullsized":"2024-09-15T23:15:18.411300+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:18.709002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.969799+0000","last_change":"2024-09-15T23:15:18.431587+0000","last_active":"2024-09-15T23:15:19.969799+0000","last_peered":"2024-09-15T23:15:19.969799+0000","last_clean":"2024-09-15T23:15:19.969799+0000","last_became_active":"2024-09-15T23:15:18.431349+0000","last_became_peered":"2024-09-15T23:15:18.431349+0000","last_unstale":"2024-09-15T23:15:19.969799+0000","last_undegraded":"2024-09-15T23:15:19.969799+0000","last_fullsized":"2024-09-15T23:15:19.969799+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:46.961107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.416513+0000","last_change":"2024-09-15T23:15:17.419929+0000","last_active":"2024-09-15T23:15:18.416513+0000","last_peered":"2024-09-15T23:15:18.416513+0000","last_clean":"2024-09-15T23:15:18.416513+0000","last_became_active":"2024-09-15T23:15:17.419466+0000","last_became_peered":"2024-09-15T23:15:17.419466+0000","last_unstale":"2024-09-15T23:15:18.416513+0000","last_undegraded":"2024-09-15T23:15:18.416513+0000","last_fullsized":"2024-09-15T23:15:18.416513+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:46.261414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.429073+0000","last_change":"2024-09-15T23:15:18.425524+0000","last_active":"2024-09-15T23:15:18.429073+0000","last_peered":"2024-09-15T23:15:18.429073+0000","last_clean":"2024-09-15T23:15:18.429073+0000","last_became_active":"2024-09-15T23:15:18.425219+0000","last_became_peered":"2024-09-15T23:15:18.425219+0000","last_unstale":"2024-09-15T23:15:18.429073+0000","last_undegraded":"2024-09-15T23:15:18.429073+0000","last_fullsized":"2024-09-15T23:15:18.429073+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:08:27.349431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.411879+0000","last_change":"2024-09-15T23:15:17.414889+0000","last_active":"2024-09-15T23:15:18.411879+0000","last_peered":"2024-09-15T23:15:18.411879+0000","last_clean":"2024-09-15T23:15:18.411879+0000","last_became_active":"2024-09-15T23:15:17.414596+0000","last_became_peered":"2024-09-15T23:15:17.414596+0000","last_unstale":"2024-09-15T23:15:18.411879+0000","last_undegraded":"2024-09-15T23:15:18.411879+0000","last_fullsized":"2024-09-15T23:15:18.411879+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:34:47.821581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.432884+0000","last_change":"2024-09-15T23:15:18.425840+0000","last_active":"2024-09-15T23:15:18.432884+0000","last_peered":"2024-09-15T23:15:18.432884+0000","last_clean":"2024-09-15T23:15:18.432884+0000","last_became_active":"2024-09-15T23:15:18.425561+0000","last_became_peered":"2024-09-15T23:15:18.425561+0000","last_unstale":"2024-09-15T23:15:18.432884+0000","last_undegraded":"2024-09-15T23:15:18.432884+0000","last_fullsized":"2024-09-15T23:15:18.432884+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:31.573725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.433357+0000","last_change":"2024-09-15T23:15:17.421844+0000","last_active":"2024-09-15T23:15:19.433357+0000","last_peered":"2024-09-15T23:15:19.433357+0000","last_clean":"2024-09-15T23:15:19.433357+0000","last_became_active":"2024-09-15T23:15:17.421309+0000","last_became_peered":"2024-09-15T23:15:17.421309+0000","last_unstale":"2024-09-15T23:15:19.433357+0000","last_undegraded":"2024-09-15T23:15:19.433357+0000","last_fullsized":"2024-09-15T23:15:19.433357+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:48:36.393544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.433365+0000","last_change":"2024-09-15T23:15:18.436382+0000","last_active":"2024-09-15T23:15:19.433365+0000","last_peered":"2024-09-15T23:15:19.433365+0000","last_clean":"2024-09-15T23:15:19.433365+0000","last_became_active":"2024-09-15T23:15:18.436102+0000","last_became_peered":"2024-09-15T23:15:18.436102+0000","last_unstale":"2024-09-15T23:15:19.433365+0000","last_undegraded":"2024-09-15T23:15:19.433365+0000","last_fullsized":"2024-09-15T23:15:19.433365+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:06.214882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"65'3","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.440190+0000","last_change":"2024-09-15T23:15:17.420819+0000","last_active":"2024-09-15T23:15:18.440190+0000","last_peered":"2024-09-15T23:15:18.440190+0000","last_clean":"2024-09-15T23:15:18.440190+0000","last_became_active":"2024-09-15T23:15:17.420556+0000","last_became_peered":"2024-09-15T23:15:17.420556+0000","last_unstale":"2024-09-15T23:15:18.440190+0000","last_undegraded":"2024-09-15T23:15:18.440190+0000","last_fullsized":"2024-09-15T23:15:18.440190+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:16:35.100011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.428959+0000","last_change":"2024-09-15T23:15:18.426496+0000","last_active":"2024-09-15T23:15:18.428959+0000","last_peered":"2024-09-15T23:15:18.428959+0000","last_clean":"2024-09-15T23:15:18.428959+0000","last_became_active":"2024-09-15T23:15:18.424000+0000","last_became_peered":"2024-09-15T23:15:18.424000+0000","last_unstale":"2024-09-15T23:15:18.428959+0000","last_undegraded":"2024-09-15T23:15:18.428959+0000","last_fullsized":"2024-09-15T23:15:18.428959+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:47:22.021855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"65'6","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.445115+0000","last_change":"2024-09-15T23:15:17.423001+0000","last_active":"2024-09-15T23:15:18.445115+0000","last_peered":"2024-09-15T23:15:18.445115+0000","last_clean":"2024-09-15T23:15:18.445115+0000","last_became_active":"2024-09-15T23:15:17.422673+0000","last_became_peered":"2024-09-15T23:15:17.422673+0000","last_unstale":"2024-09-15T23:15:18.445115+0000","last_undegraded":"2024-09-15T23:15:18.445115+0000","last_fullsized":"2024-09-15T23:15:18.445115+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:04.754257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.422439+0000","last_change":"2024-09-15T23:15:18.415452+0000","last_active":"2024-09-15T23:15:18.422439+0000","last_peered":"2024-09-15T23:15:18.422439+0000","last_clean":"2024-09-15T23:15:18.422439+0000","last_became_active":"2024-09-15T23:15:18.415151+0000","last_became_peered":"2024-09-15T23:15:18.415151+0000","last_unstale":"2024-09-15T23:15:18.422439+0000","last_undegraded":"2024-09-15T23:15:18.422439+0000","last_fullsized":"2024-09-15T23:15:18.422439+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:26:54.990691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.433277+0000","last_change":"2024-09-15T23:15:17.419449+0000","last_active":"2024-09-15T23:15:19.433277+0000","last_peered":"2024-09-15T23:15:19.433277+0000","last_clean":"2024-09-15T23:15:19.433277+0000","last_became_active":"2024-09-15T23:15:17.419170+0000","last_became_peered":"2024-09-15T23:15:17.419170+0000","last_unstale":"2024-09-15T23:15:19.433277+0000","last_undegraded":"2024-09-15T23:15:19.433277+0000","last_fullsized":"2024-09-15T23:15:19.433277+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:40:04.518437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.433019+0000","last_change":"2024-09-15T23:15:18.424172+0000","last_active":"2024-09-15T23:15:18.433019+0000","last_peered":"2024-09-15T23:15:18.433019+0000","last_clean":"2024-09-15T23:15:18.433019+0000","last_became_active":"2024-09-15T23:15:18.423379+0000","last_became_peered":"2024-09-15T23:15:18.423379+0000","last_unstale":"2024-09-15T23:15:18.433019+0000","last_undegraded":"2024-09-15T23:15:18.433019+0000","last_fullsized":"2024-09-15T23:15:18.433019+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:17.965471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.410255+0000","last_change":"2024-09-15T23:15:17.421978+0000","last_active":"2024-09-15T23:15:18.410255+0000","last_peered":"2024-09-15T23:15:18.410255+0000","last_clean":"2024-09-15T23:15:18.410255+0000","last_became_active":"2024-09-15T23:15:17.421678+0000","last_became_peered":"2024-09-15T23:15:17.421678+0000","last_unstale":"2024-09-15T23:15:18.410255+0000","last_undegraded":"2024-09-15T23:15:18.410255+0000","last_fullsized":"2024-09-15T23:15:18.410255+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:24.562420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.435116+0000","last_change":"2024-09-15T23:15:18.427890+0000","last_active":"2024-09-15T23:15:18.435116+0000","last_peered":"2024-09-15T23:15:18.435116+0000","last_clean":"2024-09-15T23:15:18.435116+0000","last_became_active":"2024-09-15T23:15:18.427590+0000","last_became_peered":"2024-09-15T23:15:18.427590+0000","last_unstale":"2024-09-15T23:15:18.435116+0000","last_undegraded":"2024-09-15T23:15:18.435116+0000","last_fullsized":"2024-09-15T23:15:18.435116+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:09.454369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.410781+0000","last_change":"2024-09-15T23:15:17.420485+0000","last_active":"2024-09-15T23:15:18.410781+0000","last_peered":"2024-09-15T23:15:18.410781+0000","last_clean":"2024-09-15T23:15:18.410781+0000","last_became_active":"2024-09-15T23:15:17.420162+0000","last_became_peered":"2024-09-15T23:15:17.420162+0000","last_unstale":"2024-09-15T23:15:18.410781+0000","last_undegraded":"2024-09-15T23:15:18.410781+0000","last_fullsized":"2024-09-15T23:15:18.410781+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:17.449432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.417911+0000","last_change":"2024-09-15T23:15:18.413330+0000","last_active":"2024-09-15T23:15:18.417911+0000","last_peered":"2024-09-15T23:15:18.417911+0000","last_clean":"2024-09-15T23:15:18.417911+0000","last_became_active":"2024-09-15T23:15:18.413081+0000","last_became_peered":"2024-09-15T23:15:18.413081+0000","last_unstale":"2024-09-15T23:15:18.417911+0000","last_undegraded":"2024-09-15T23:15:18.417911+0000","last_fullsized":"2024-09-15T23:15:18.417911+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:36:23.935215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"65'8","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.442790+0000","last_change":"2024-09-15T23:15:17.423689+0000","last_active":"2024-09-15T23:15:18.442790+0000","last_peered":"2024-09-15T23:15:18.442790+0000","last_clean":"2024-09-15T23:15:18.442790+0000","last_became_active":"2024-09-15T23:15:17.423435+0000","last_became_peered":"2024-09-15T23:15:17.423435+0000","last_unstale":"2024-09-15T23:15:18.442790+0000","last_undegraded":"2024-09-15T23:15:18.442790+0000","last_fullsized":"2024-09-15T23:15:18.442790+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:59:47.888544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.431945+0000","last_change":"2024-09-15T23:15:18.424381+0000","last_active":"2024-09-15T23:15:18.431945+0000","last_peered":"2024-09-15T23:15:18.431945+0000","last_clean":"2024-09-15T23:15:18.431945+0000","last_became_active":"2024-09-15T23:15:18.424031+0000","last_became_peered":"2024-09-15T23:15:18.424031+0000","last_unstale":"2024-09-15T23:15:18.431945+0000","last_undegraded":"2024-09-15T23:15:18.431945+0000","last_fullsized":"2024-09-15T23:15:18.431945+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:08:27.349431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"65'1","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.424227+0000","last_change":"2024-09-15T23:15:17.421154+0000","last_active":"2024-09-15T23:15:19.424227+0000","last_peered":"2024-09-15T23:15:19.424227+0000","last_clean":"2024-09-15T23:15:19.424227+0000","last_became_active":"2024-09-15T23:15:17.420848+0000","last_became_peered":"2024-09-15T23:15:17.420848+0000","last_unstale":"2024-09-15T23:15:19.424227+0000","last_undegraded":"2024-09-15T23:15:19.424227+0000","last_fullsized":"2024-09-15T23:15:19.424227+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:18.709002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.432841+0000","last_change":"2024-09-15T23:15:18.425127+0000","last_active":"2024-09-15T23:15:18.432841+0000","last_peered":"2024-09-15T23:15:18.432841+0000","last_clean":"2024-09-15T23:15:18.432841+0000","last_became_active":"2024-09-15T23:15:18.424836+0000","last_became_peered":"2024-09-15T23:15:18.424836+0000","last_unstale":"2024-09-15T23:15:18.432841+0000","last_undegraded":"2024-09-15T23:15:18.432841+0000","last_fullsized":"2024-09-15T23:15:18.432841+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:05:05.151198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.433365+0000","last_change":"2024-09-15T23:15:17.422055+0000","last_active":"2024-09-15T23:15:19.433365+0000","last_peered":"2024-09-15T23:15:19.433365+0000","last_clean":"2024-09-15T23:15:19.433365+0000","last_became_active":"2024-09-15T23:15:17.421606+0000","last_became_peered":"2024-09-15T23:15:17.421606+0000","last_unstale":"2024-09-15T23:15:19.433365+0000","last_undegraded":"2024-09-15T23:15:19.433365+0000","last_fullsized":"2024-09-15T23:15:19.433365+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:31:37.326654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.424071+0000","last_change":"2024-09-15T23:15:18.425786+0000","last_active":"2024-09-15T23:15:19.424071+0000","last_peered":"2024-09-15T23:15:19.424071+0000","last_clean":"2024-09-15T23:15:19.424071+0000","last_became_active":"2024-09-15T23:15:18.425509+0000","last_became_peered":"2024-09-15T23:15:18.425509+0000","last_unstale":"2024-09-15T23:15:19.424071+0000","last_undegraded":"2024-09-15T23:15:19.424071+0000","last_fullsized":"2024-09-15T23:15:19.424071+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:18:19.569755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"65'1","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.435430+0000","last_change":"2024-09-15T23:15:17.418532+0000","last_active":"2024-09-15T23:15:18.435430+0000","last_peered":"2024-09-15T23:15:18.435430+0000","last_clean":"2024-09-15T23:15:18.435430+0000","last_became_active":"2024-09-15T23:15:17.417558+0000","last_became_peered":"2024-09-15T23:15:17.417558+0000","last_unstale":"2024-09-15T23:15:18.435430+0000","last_undegraded":"2024-09-15T23:15:18.435430+0000","last_fullsized":"2024-09-15T23:15:18.435430+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:54.239430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.438608+0000","last_change":"2024-09-15T23:15:18.432660+0000","last_active":"2024-09-15T23:15:18.438608+0000","last_peered":"2024-09-15T23:15:18.438608+0000","last_clean":"2024-09-15T23:15:18.438608+0000","last_became_active":"2024-09-15T23:15:18.432409+0000","last_became_peered":"2024-09-15T23:15:18.432409+0000","last_unstale":"2024-09-15T23:15:18.438608+0000","last_undegraded":"2024-09-15T23:15:18.438608+0000","last_fullsized":"2024-09-15T23:15:18.438608+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:24.426135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.433421+0000","last_change":"2024-09-15T23:15:17.424665+0000","last_active":"2024-09-15T23:15:19.433421+0000","last_peered":"2024-09-15T23:15:19.433421+0000","last_clean":"2024-09-15T23:15:19.433421+0000","last_became_active":"2024-09-15T23:15:17.424403+0000","last_became_peered":"2024-09-15T23:15:17.424403+0000","last_unstale":"2024-09-15T23:15:19.433421+0000","last_undegraded":"2024-09-15T23:15:19.433421+0000","last_fullsized":"2024-09-15T23:15:19.433421+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:48:52.648306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.438058+0000","last_change":"2024-09-15T23:15:18.432228+0000","last_active":"2024-09-15T23:15:18.438058+0000","last_peered":"2024-09-15T23:15:18.438058+0000","last_clean":"2024-09-15T23:15:18.438058+0000","last_became_active":"2024-09-15T23:15:18.431968+0000","last_became_peered":"2024-09-15T23:15:18.431968+0000","last_unstale":"2024-09-15T23:15:18.438058+0000","last_undegraded":"2024-09-15T23:15:18.438058+0000","last_fullsized":"2024-09-15T23:15:18.438058+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:39:31.008454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:20.131986+0000","last_change":"2024-09-15T23:15:17.422615+0000","last_active":"2024-09-15T23:15:20.131986+0000","last_peered":"2024-09-15T23:15:20.131986+0000","last_clean":"2024-09-15T23:15:20.131986+0000","last_became_active":"2024-09-15T23:15:17.421865+0000","last_became_peered":"2024-09-15T23:15:17.421865+0000","last_unstale":"2024-09-15T23:15:20.131986+0000","last_undegraded":"2024-09-15T23:15:20.131986+0000","last_fullsized":"2024-09-15T23:15:20.131986+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:13:35.001251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.433177+0000","last_change":"2024-09-15T23:15:18.424562+0000","last_active":"2024-09-15T23:15:19.433177+0000","last_peered":"2024-09-15T23:15:19.433177+0000","last_clean":"2024-09-15T23:15:19.433177+0000","last_became_active":"2024-09-15T23:15:18.424252+0000","last_became_peered":"2024-09-15T23:15:18.424252+0000","last_unstale":"2024-09-15T23:15:19.433177+0000","last_undegraded":"2024-09-15T23:15:19.433177+0000","last_fullsized":"2024-09-15T23:15:19.433177+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:17.873620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.432977+0000","last_change":"2024-09-15T23:15:17.423259+0000","last_active":"2024-09-15T23:15:19.432977+0000","last_peered":"2024-09-15T23:15:19.432977+0000","last_clean":"2024-09-15T23:15:19.432977+0000","last_became_active":"2024-09-15T23:15:17.423018+0000","last_became_peered":"2024-09-15T23:15:17.423018+0000","last_unstale":"2024-09-15T23:15:19.432977+0000","last_undegraded":"2024-09-15T23:15:19.432977+0000","last_fullsized":"2024-09-15T23:15:19.432977+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:47:43.185090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.432989+0000","last_change":"2024-09-15T23:15:18.427422+0000","last_active":"2024-09-15T23:15:19.432989+0000","last_peered":"2024-09-15T23:15:19.432989+0000","last_clean":"2024-09-15T23:15:19.432989+0000","last_became_active":"2024-09-15T23:15:18.424429+0000","last_became_peered":"2024-09-15T23:15:18.424429+0000","last_unstale":"2024-09-15T23:15:19.432989+0000","last_undegraded":"2024-09-15T23:15:19.432989+0000","last_fullsized":"2024-09-15T23:15:19.432989+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:19:31.569558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.411003+0000","last_change":"2024-09-15T23:15:17.419419+0000","last_active":"2024-09-15T23:15:18.411003+0000","last_peered":"2024-09-15T23:15:18.411003+0000","last_clean":"2024-09-15T23:15:18.411003+0000","last_became_active":"2024-09-15T23:15:17.419136+0000","last_became_peered":"2024-09-15T23:15:17.419136+0000","last_unstale":"2024-09-15T23:15:18.411003+0000","last_undegraded":"2024-09-15T23:15:18.411003+0000","last_fullsized":"2024-09-15T23:15:18.411003+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:46.547138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.427099+0000","last_change":"2024-09-15T23:15:18.422950+0000","last_active":"2024-09-15T23:15:18.427099+0000","last_peered":"2024-09-15T23:15:18.427099+0000","last_clean":"2024-09-15T23:15:18.427099+0000","last_became_active":"2024-09-15T23:15:18.422642+0000","last_became_peered":"2024-09-15T23:15:18.422642+0000","last_unstale":"2024-09-15T23:15:18.427099+0000","last_undegraded":"2024-09-15T23:15:18.427099+0000","last_fullsized":"2024-09-15T23:15:18.427099+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:56:32.834170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.424166+0000","last_change":"2024-09-15T23:15:17.423581+0000","last_active":"2024-09-15T23:15:19.424166+0000","last_peered":"2024-09-15T23:15:19.424166+0000","last_clean":"2024-09-15T23:15:19.424166+0000","last_became_active":"2024-09-15T23:15:17.423230+0000","last_became_peered":"2024-09-15T23:15:17.423230+0000","last_unstale":"2024-09-15T23:15:19.424166+0000","last_undegraded":"2024-09-15T23:15:19.424166+0000","last_fullsized":"2024-09-15T23:15:19.424166+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:34:47.821581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.427675+0000","last_change":"2024-09-15T23:15:18.422308+0000","last_active":"2024-09-15T23:15:18.427675+0000","last_peered":"2024-09-15T23:15:18.427675+0000","last_clean":"2024-09-15T23:15:18.427675+0000","last_became_active":"2024-09-15T23:15:18.422052+0000","last_became_peered":"2024-09-15T23:15:18.422052+0000","last_unstale":"2024-09-15T23:15:18.427675+0000","last_undegraded":"2024-09-15T23:15:18.427675+0000","last_fullsized":"2024-09-15T23:15:18.427675+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:05.758506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"65'1","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.970307+0000","last_change":"2024-09-15T23:15:17.423958+0000","last_active":"2024-09-15T23:15:19.970307+0000","last_peered":"2024-09-15T23:15:19.970307+0000","last_clean":"2024-09-15T23:15:19.970307+0000","last_became_active":"2024-09-15T23:15:17.423564+0000","last_became_peered":"2024-09-15T23:15:17.423564+0000","last_unstale":"2024-09-15T23:15:19.970307+0000","last_undegraded":"2024-09-15T23:15:19.970307+0000","last_fullsized":"2024-09-15T23:15:19.970307+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:04:38.769835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.423950+0000","last_change":"2024-09-15T23:15:18.419932+0000","last_active":"2024-09-15T23:15:19.423950+0000","last_peered":"2024-09-15T23:15:19.423950+0000","last_clean":"2024-09-15T23:15:19.423950+0000","last_became_active":"2024-09-15T23:15:18.419632+0000","last_became_peered":"2024-09-15T23:15:18.419632+0000","last_unstale":"2024-09-15T23:15:19.423950+0000","last_undegraded":"2024-09-15T23:15:19.423950+0000","last_fullsized":"2024-09-15T23:15:19.423950+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:14.886926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.411271+0000","last_change":"2024-09-15T23:15:17.419469+0000","last_active":"2024-09-15T23:15:18.411271+0000","last_peered":"2024-09-15T23:15:18.411271+0000","last_clean":"2024-09-15T23:15:18.411271+0000","last_became_active":"2024-09-15T23:15:17.419181+0000","last_became_peered":"2024-09-15T23:15:17.419181+0000","last_unstale":"2024-09-15T23:15:18.411271+0000","last_undegraded":"2024-09-15T23:15:18.411271+0000","last_fullsized":"2024-09-15T23:15:18.411271+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:55:50.068951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.433552+0000","last_change":"2024-09-15T23:15:18.425146+0000","last_active":"2024-09-15T23:15:19.433552+0000","last_peered":"2024-09-15T23:15:19.433552+0000","last_clean":"2024-09-15T23:15:19.433552+0000","last_became_active":"2024-09-15T23:15:18.424653+0000","last_became_peered":"2024-09-15T23:15:18.424653+0000","last_unstale":"2024-09-15T23:15:19.433552+0000","last_undegraded":"2024-09-15T23:15:19.433552+0000","last_fullsized":"2024-09-15T23:15:19.433552+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:43:13.880554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.419573+0000","last_change":"2024-09-15T23:15:17.419719+0000","last_active":"2024-09-15T23:15:18.419573+0000","last_peered":"2024-09-15T23:15:18.419573+0000","last_clean":"2024-09-15T23:15:18.419573+0000","last_became_active":"2024-09-15T23:15:17.418627+0000","last_became_peered":"2024-09-15T23:15:17.418627+0000","last_unstale":"2024-09-15T23:15:18.419573+0000","last_undegraded":"2024-09-15T23:15:18.419573+0000","last_fullsized":"2024-09-15T23:15:18.419573+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:46.261414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.969972+0000","last_change":"2024-09-15T23:15:18.437022+0000","last_active":"2024-09-15T23:15:19.969972+0000","last_peered":"2024-09-15T23:15:19.969972+0000","last_clean":"2024-09-15T23:15:19.969972+0000","last_became_active":"2024-09-15T23:15:18.436379+0000","last_became_peered":"2024-09-15T23:15:18.436379+0000","last_unstale":"2024-09-15T23:15:19.969972+0000","last_undegraded":"2024-09-15T23:15:19.969972+0000","last_fullsized":"2024-09-15T23:15:19.969972+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:23:13.317304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.424041+0000","last_change":"2024-09-15T23:15:17.421602+0000","last_active":"2024-09-15T23:15:19.424041+0000","last_peered":"2024-09-15T23:15:19.424041+0000","last_clean":"2024-09-15T23:15:19.424041+0000","last_became_active":"2024-09-15T23:15:17.421331+0000","last_became_peered":"2024-09-15T23:15:17.421331+0000","last_unstale":"2024-09-15T23:15:19.424041+0000","last_undegraded":"2024-09-15T23:15:19.424041+0000","last_fullsized":"2024-09-15T23:15:19.424041+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:55:50.068951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.429476+0000","last_change":"2024-09-15T23:15:18.425047+0000","last_active":"2024-09-15T23:15:18.429476+0000","last_peered":"2024-09-15T23:15:18.429476+0000","last_clean":"2024-09-15T23:15:18.429476+0000","last_became_active":"2024-09-15T23:15:18.424709+0000","last_became_peered":"2024-09-15T23:15:18.424709+0000","last_unstale":"2024-09-15T23:15:18.429476+0000","last_undegraded":"2024-09-15T23:15:18.429476+0000","last_fullsized":"2024-09-15T23:15:18.429476+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:17.965471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.417042+0000","last_change":"2024-09-15T23:15:17.418864+0000","last_active":"2024-09-15T23:15:18.417042+0000","last_peered":"2024-09-15T23:15:18.417042+0000","last_clean":"2024-09-15T23:15:18.417042+0000","last_became_active":"2024-09-15T23:15:17.418469+0000","last_became_peered":"2024-09-15T23:15:17.418469+0000","last_unstale":"2024-09-15T23:15:18.417042+0000","last_undegraded":"2024-09-15T23:15:18.417042+0000","last_fullsized":"2024-09-15T23:15:18.417042+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:43.948383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.433446+0000","last_change":"2024-09-15T23:15:18.429353+0000","last_active":"2024-09-15T23:15:19.433446+0000","last_peered":"2024-09-15T23:15:19.433446+0000","last_clean":"2024-09-15T23:15:19.433446+0000","last_became_active":"2024-09-15T23:15:18.428860+0000","last_became_peered":"2024-09-15T23:15:18.428860+0000","last_unstale":"2024-09-15T23:15:19.433446+0000","last_undegraded":"2024-09-15T23:15:19.433446+0000","last_fullsized":"2024-09-15T23:15:19.433446+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:49:38.817033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.969785+0000","last_change":"2024-09-15T23:15:17.422477+0000","last_active":"2024-09-15T23:15:19.969785+0000","last_peered":"2024-09-15T23:15:19.969785+0000","last_clean":"2024-09-15T23:15:19.969785+0000","last_became_active":"2024-09-15T23:15:17.422210+0000","last_became_peered":"2024-09-15T23:15:17.422210+0000","last_unstale":"2024-09-15T23:15:19.969785+0000","last_undegraded":"2024-09-15T23:15:19.969785+0000","last_fullsized":"2024-09-15T23:15:19.969785+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:04:20.566409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.423868+0000","last_change":"2024-09-15T23:15:18.421044+0000","last_active":"2024-09-15T23:15:19.423868+0000","last_peered":"2024-09-15T23:15:19.423868+0000","last_clean":"2024-09-15T23:15:19.423868+0000","last_became_active":"2024-09-15T23:15:18.420464+0000","last_became_peered":"2024-09-15T23:15:18.420464+0000","last_unstale":"2024-09-15T23:15:19.423868+0000","last_undegraded":"2024-09-15T23:15:19.423868+0000","last_fullsized":"2024-09-15T23:15:19.423868+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:23:13.764284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.433123+0000","last_change":"2024-09-15T23:15:17.421433+0000","last_active":"2024-09-15T23:15:19.433123+0000","last_peered":"2024-09-15T23:15:19.433123+0000","last_clean":"2024-09-15T23:15:19.433123+0000","last_became_active":"2024-09-15T23:15:17.420922+0000","last_became_peered":"2024-09-15T23:15:17.420922+0000","last_unstale":"2024-09-15T23:15:19.433123+0000","last_undegraded":"2024-09-15T23:15:19.433123+0000","last_fullsized":"2024-09-15T23:15:19.433123+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:29.467855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-15T23:15:19.433348+0000","last_change":"2024-09-15T23:15:18.424109+0000","last_active":"2024-09-15T23:15:19.433348+0000","last_peered":"2024-09-15T23:15:19.433348+0000","last_clean":"2024-09-15T23:15:19.433348+0000","last_became_active":"2024-09-15T23:15:18.423760+0000","last_became_peered":"2024-09-15T23:15:18.423760+0000","last_unstale":"2024-09-15T23:15:19.433348+0000","last_undegraded":"2024-09-15T23:15:19.433348+0000","last_fullsized":"2024-09-15T23:15:19.433348+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:17.400199+0000","last_clean_scrub_stamp":"2024-09-15T23:15:17.400199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:28.224101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.419336+0000","last_change":"2024-09-15T23:15:17.420005+0000","last_active":"2024-09-15T23:15:18.419336+0000","last_peered":"2024-09-15T23:15:18.419336+0000","last_clean":"2024-09-15T23:15:18.419336+0000","last_became_active":"2024-09-15T23:15:17.419730+0000","last_became_peered":"2024-09-15T23:15:17.419730+0000","last_unstale":"2024-09-15T23:15:18.419336+0000","last_undegraded":"2024-09-15T23:15:18.419336+0000","last_fullsized":"2024-09-15T23:15:18.419336+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:16.395950+0000","last_clean_scrub_stamp":"2024-09-15T23:15:16.395950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:56:31.829921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":250,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T23:15:18.411062+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:15:18.411062+0000","last_peered":"2024-09-15T23:15:18.411062+0000","last_clean":"2024-09-15T23:15:18.411062+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:15:18.411062+0000","last_undegraded":"2024-09-15T23:15:18.411062+0000","last_fullsized":"2024-09-15T23:15:18.411062+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476781,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40252,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331588,"statfs":{"total":96636764160,"available":96595546112,"internally_reserved":0,"allocated":757760,"data_stored":319905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476778,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36088,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335752,"statfs":{"total":96636764160,"available":96599810048,"internally_reserved":0,"allocated":757760,"data_stored":319905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,3,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476780,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36672,"kb_used_data":1320,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335168,"statfs":{"total":96636764160,"available":96599212032,"internally_reserved":0,"allocated":1351680,"data_stored":910273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476780,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31932,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":757760,"data_stored":319905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542187,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36128,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335712,"statfs":{"total":96636764160,"available":96599769088,"internally_reserved":0,"allocated":790528,"data_stored":333072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542187,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36124,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335716,"statfs":{"total":96636764160,"available":96599773184,"internally_reserved":0,"allocated":786432,"data_stored":333002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542186,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36704,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335136,"statfs":{"total":96636764160,"available":96599179264,"internally_reserved":0,"allocated":1380352,"data_stored":923382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542188,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36124,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335716,"statfs":{"total":96636764160,"available":96599773184,"internally_reserved":0,"allocated":790528,"data_stored":333596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:15:22.705 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T23:15:22.705 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T23:15:22.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.846+0000 7fdfce04c640 1 Processor -- start 2024-09-15T23:15:22.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.846+0000 7fdfce04c640 1 -- start start 2024-09-15T23:15:22.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.847+0000 7fdfce04c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdfc8155950 0x7fdfc8073600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:22.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.847+0000 7fdfce04c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdfc8162c80 0x7fdfc806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:22.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.847+0000 7fdfce04c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfc8073cc0 con 0x7fdfc806c150 2024-09-15T23:15:22.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.847+0000 7fdfce04c640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fdfc8070370 con 0x7fdfc8155950 2024-09-15T23:15:22.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.847+0000 7fdfce04c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fdfc8071aa0 con 0x7fdfc8162c80 2024-09-15T23:15:22.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.847+0000 7fdfc77fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdfc8155950 0x7fdfc8073600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:22.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.847+0000 7fdfc77fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdfc8155950 0x7fdfc8073600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49440/0 (socket says 172.21.15.123:49440) 2024-09-15T23:15:22.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.847+0000 7fdfc77fe640 1 -- 172.21.15.123:0/2383020994 learned_addr learned my addr 172.21.15.123:0/2383020994 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:22.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.847+0000 7fdfc6ffd640 1 --2- 172.21.15.123:0/2383020994 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdfc8162c80 0x7fdfc806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:22.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.847+0000 7fdfc77fe640 1 -- 172.21.15.123:0/2383020994 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdfc8162c80 msgr2=0x7fdfc806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:22.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.847+0000 7fdfc77fe640 1 --2- 172.21.15.123:0/2383020994 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdfc8162c80 0x7fdfc806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:22.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.847+0000 7fdfc77fe640 1 -- 172.21.15.123:0/2383020994 >> v1:172.21.15.188:6789/0 conn(0x7fdfc806c150 legacy=0x7fdfc80afb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:22.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.847+0000 7fdfc77fe640 1 -- 172.21.15.123:0/2383020994 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc8071d80 con 0x7fdfc8155950 2024-09-15T23:15:22.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.848+0000 7fdfc77fe640 1 --2- 172.21.15.123:0/2383020994 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfc8155950 0x7fdfc8073600 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8009870 tx=0x7fdfb802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf8dfd7c67fbdf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:22.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.848+0000 7fdfc67fc640 1 -- 172.21.15.123:0/2383020994 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb8037070 con 0x7fdfc8155950 2024-09-15T23:15:22.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.848+0000 7fdfc67fc640 1 -- 172.21.15.123:0/2383020994 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfb8032440 con 0x7fdfc8155950 2024-09-15T23:15:22.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.848+0000 7fdfc67fc640 1 -- 172.21.15.123:0/2383020994 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb8032810 con 0x7fdfc8155950 2024-09-15T23:15:22.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.848+0000 7fdfce04c640 1 -- 172.21.15.123:0/2383020994 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfc8155950 msgr2=0x7fdfc8073600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:22.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.848+0000 7fdfce04c640 1 --2- 172.21.15.123:0/2383020994 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfc8155950 0x7fdfc8073600 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8009870 tx=0x7fdfb802a270 comp rx=0 tx=0).stop 2024-09-15T23:15:22.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.849+0000 7fdfce04c640 1 -- 172.21.15.123:0/2383020994 shutdown_connections 2024-09-15T23:15:22.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.849+0000 7fdfce04c640 1 --2- 172.21.15.123:0/2383020994 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdfc8162c80 0x7fdfc806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:22.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.849+0000 7fdfce04c640 1 --2- 172.21.15.123:0/2383020994 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfc8155950 0x7fdfc8073600 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:22.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.849+0000 7fdfce04c640 1 -- 172.21.15.123:0/2383020994 >> 172.21.15.123:0/2383020994 conn(0x7fdfc806db30 msgr2=0x7fdfc806df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:22.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.849+0000 7fdfce04c640 1 -- 172.21.15.123:0/2383020994 shutdown_connections 2024-09-15T23:15:22.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.849+0000 7fdfce04c640 1 -- 172.21.15.123:0/2383020994 wait complete. 2024-09-15T23:15:22.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.850+0000 7fdfce04c640 1 Processor -- start 2024-09-15T23:15:22.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.850+0000 7fdfce04c640 1 -- start start 2024-09-15T23:15:22.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.850+0000 7fdfce04c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdfc806c150 0x7fdfc8157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:22.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.851+0000 7fdfce04c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfc8162c80 0x7fdfc8155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:22.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.851+0000 7fdfce04c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdfc8156280 0x7fdfc8143bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:22.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.851+0000 7fdfce04c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc80721e0 con 0x7fdfc8162c80 2024-09-15T23:15:22.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.851+0000 7fdfce04c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc8072060 con 0x7fdfc806c150 2024-09-15T23:15:22.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.851+0000 7fdfce04c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fdfc80b0230 con 0x7fdfc8156280 2024-09-15T23:15:22.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.851+0000 7fdfc6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfc8162c80 0x7fdfc8155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:22.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.851+0000 7fdfc6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfc8162c80 0x7fdfc8155d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49448/0 (socket says 172.21.15.123:49448) 2024-09-15T23:15:22.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.851+0000 7fdfc6ffd640 1 -- 172.21.15.123:0/2985912449 learned_addr learned my addr 172.21.15.123:0/2985912449 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:22.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.851+0000 7fdfc77fe640 1 --2- 172.21.15.123:0/2985912449 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdfc806c150 0x7fdfc8157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:22.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.851+0000 7fdfc7fff640 1 --2- 172.21.15.123:0/2985912449 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdfc8156280 0x7fdfc8143bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:22.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.851+0000 7fdfc6ffd640 1 -- 172.21.15.123:0/2985912449 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdfc8156280 msgr2=0x7fdfc8143bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:22.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.851+0000 7fdfc6ffd640 1 --2- 172.21.15.123:0/2985912449 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdfc8156280 0x7fdfc8143bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:22.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.851+0000 7fdfc6ffd640 1 -- 172.21.15.123:0/2985912449 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdfc806c150 msgr2=0x7fdfc8157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:22.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.851+0000 7fdfc6ffd640 1 --2- 172.21.15.123:0/2985912449 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdfc806c150 0x7fdfc8157e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:22.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.851+0000 7fdfc6ffd640 1 -- 172.21.15.123:0/2985912449 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc8158710 con 0x7fdfc8162c80 2024-09-15T23:15:22.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.851+0000 7fdfc6ffd640 1 --2- 172.21.15.123:0/2985912449 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfc8162c80 0x7fdfc8155d40 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000d7d0 tx=0x7fdfb000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:22.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.851+0000 7fdfbffff640 1 -- 172.21.15.123:0/2985912449 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb0004020 con 0x7fdfc8162c80 2024-09-15T23:15:22.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.851+0000 7fdfbffff640 1 -- 172.21.15.123:0/2985912449 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfb00041e0 con 0x7fdfc8162c80 2024-09-15T23:15:22.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.851+0000 7fdfce04c640 1 -- 172.21.15.123:0/2985912449 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfc81589f0 con 0x7fdfc8162c80 2024-09-15T23:15:22.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.851+0000 7fdfbffff640 1 -- 172.21.15.123:0/2985912449 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb00043d0 con 0x7fdfc8162c80 2024-09-15T23:15:22.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.851+0000 7fdfce04c640 1 -- 172.21.15.123:0/2985912449 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfc8158390 con 0x7fdfc8162c80 2024-09-15T23:15:22.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.852+0000 7fdfce04c640 1 -- 172.21.15.123:0/2985912449 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfc8156690 con 0x7fdfc8162c80 2024-09-15T23:15:22.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.853+0000 7fdfbffff640 1 -- 172.21.15.123:0/2985912449 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdfb001b020 con 0x7fdfc8162c80 2024-09-15T23:15:22.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.853+0000 7fdfbffff640 1 --2- 172.21.15.123:0/2985912449 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdfa806c2b0 0x7fdfa806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:22.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.853+0000 7fdfbffff640 1 -- 172.21.15.123:0/2985912449 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7fdfb008b0d0 con 0x7fdfc8162c80 2024-09-15T23:15:22.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.853+0000 7fdfc77fe640 1 --2- 172.21.15.123:0/2985912449 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdfa806c2b0 0x7fdfa806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:22.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.854+0000 7fdfc77fe640 1 --2- 172.21.15.123:0/2985912449 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdfa806c2b0 0x7fdfa806e770 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8034000 tx=0x7fdfb802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:22.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:22.858+0000 7fdfbffff640 1 -- 172.21.15.123:0/2985912449 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdfc8156690 con 0x7fdfc8162c80 2024-09-15T23:15:23.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.085+0000 7fdfce04c640 1 -- 172.21.15.123:0/2985912449 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fdfc8073600 con 0x7fdfc8162c80 2024-09-15T23:15:23.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.088+0000 7fdfbffff640 1 -- 172.21.15.123:0/2985912449 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7fdfb0059280 con 0x7fdfc8162c80 2024-09-15T23:15:23.090 INFO:teuthology.orchestra.run.smithi123.stdout:[client.0] 2024-09-15T23:15:23.090 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCNaedmzQPqJRAAhUf1dnVYohN4obCfeu8+7g== 2024-09-15T23:15:23.090 INFO:teuthology.orchestra.run.smithi123.stdout: caps mds = "allow" 2024-09-15T23:15:23.090 INFO:teuthology.orchestra.run.smithi123.stdout: caps mon = "allow r" 2024-09-15T23:15:23.090 INFO:teuthology.orchestra.run.smithi123.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T23:15:23.091 INFO:teuthology.orchestra.run.smithi123.stderr:updated caps for client.0 2024-09-15T23:15:23.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.090+0000 7fdfce04c640 1 -- 172.21.15.123:0/2985912449 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdfa806c2b0 msgr2=0x7fdfa806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:23.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.090+0000 7fdfce04c640 1 --2- 172.21.15.123:0/2985912449 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdfa806c2b0 0x7fdfa806e770 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8034000 tx=0x7fdfb802e000 comp rx=0 tx=0).stop 2024-09-15T23:15:23.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.090+0000 7fdfce04c640 1 -- 172.21.15.123:0/2985912449 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfc8162c80 msgr2=0x7fdfc8155d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:23.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.090+0000 7fdfce04c640 1 --2- 172.21.15.123:0/2985912449 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfc8162c80 0x7fdfc8155d40 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000d7d0 tx=0x7fdfb000dc90 comp rx=0 tx=0).stop 2024-09-15T23:15:23.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.090+0000 7fdfce04c640 1 -- 172.21.15.123:0/2985912449 shutdown_connections 2024-09-15T23:15:23.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.090+0000 7fdfce04c640 1 --2- 172.21.15.123:0/2985912449 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdfc8156280 0x7fdfc8143bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.090+0000 7fdfce04c640 1 --2- 172.21.15.123:0/2985912449 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdfa806c2b0 0x7fdfa806e770 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.090+0000 7fdfce04c640 1 --2- 172.21.15.123:0/2985912449 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfc8162c80 0x7fdfc8155d40 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.090+0000 7fdfce04c640 1 --2- 172.21.15.123:0/2985912449 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdfc806c150 0x7fdfc8157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.090+0000 7fdfce04c640 1 -- 172.21.15.123:0/2985912449 >> 172.21.15.123:0/2985912449 conn(0x7fdfc806db30 msgr2=0x7fdfc80b4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:23.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.090+0000 7fdfce04c640 1 -- 172.21.15.123:0/2985912449 shutdown_connections 2024-09-15T23:15:23.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.090+0000 7fdfce04c640 1 -- 172.21.15.123:0/2985912449 wait complete. 2024-09-15T23:15:23.103 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:15:23.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.199+0000 7fc491fc4640 1 Processor -- start 2024-09-15T23:15:23.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.199+0000 7fc491fc4640 1 -- start start 2024-09-15T23:15:23.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.200+0000 7fc491fc4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc48c06c320 0x7fc48c15bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:23.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.200+0000 7fc491fc4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc48c13eb20 0x7fc48c15c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:23.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.200+0000 7fc491fc4640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc48c071180 con 0x7fc48c0b2d40 2024-09-15T23:15:23.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.200+0000 7fc491fc4640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc48c071ab0 con 0x7fc48c13eb20 2024-09-15T23:15:23.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.200+0000 7fc491fc4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc48c071460 con 0x7fc48c06c320 2024-09-15T23:15:23.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.200+0000 7fc48bfff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc48c13eb20 0x7fc48c15c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:23.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.200+0000 7fc48bfff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc48c13eb20 0x7fc48c15c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49462/0 (socket says 172.21.15.123:49462) 2024-09-15T23:15:23.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.200+0000 7fc48bfff640 1 -- 172.21.15.123:0/2769099898 learned_addr learned my addr 172.21.15.123:0/2769099898 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:23.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.200+0000 7fc48affd640 1 --2- 172.21.15.123:0/2769099898 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc48c06c320 0x7fc48c15bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:23.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.200+0000 7fc48bfff640 1 -- 172.21.15.123:0/2769099898 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc48c06c320 msgr2=0x7fc48c15bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:23.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.200+0000 7fc48bfff640 1 --2- 172.21.15.123:0/2769099898 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc48c06c320 0x7fc48c15bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.200+0000 7fc48bfff640 1 -- 172.21.15.123:0/2769099898 >> v1:172.21.15.188:6789/0 conn(0x7fc48c0b2d40 legacy=0x7fc48c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:23.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.200+0000 7fc48bfff640 1 -- 172.21.15.123:0/2769099898 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc48c071740 con 0x7fc48c13eb20 2024-09-15T23:15:23.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.200+0000 7fc48affd640 1 --2- 172.21.15.123:0/2769099898 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc48c06c320 0x7fc48c15bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:23.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.201+0000 7fc48bfff640 1 --2- 172.21.15.123:0/2769099898 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc48c13eb20 0x7fc48c15c230 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc484009870 tx=0x7fc48402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b82335f93ee5e37 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:23.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.201+0000 7fc48a7fc640 1 -- 172.21.15.123:0/2769099898 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc484037070 con 0x7fc48c13eb20 2024-09-15T23:15:23.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.201+0000 7fc48a7fc640 1 -- 172.21.15.123:0/2769099898 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc484032440 con 0x7fc48c13eb20 2024-09-15T23:15:23.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.201+0000 7fc48a7fc640 1 -- 172.21.15.123:0/2769099898 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc484032810 con 0x7fc48c13eb20 2024-09-15T23:15:23.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.202+0000 7fc491fc4640 1 -- 172.21.15.123:0/2769099898 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc48c13eb20 msgr2=0x7fc48c15c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:23.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.202+0000 7fc491fc4640 1 --2- 172.21.15.123:0/2769099898 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc48c13eb20 0x7fc48c15c230 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc484009870 tx=0x7fc48402a270 comp rx=0 tx=0).stop 2024-09-15T23:15:23.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.202+0000 7fc491fc4640 1 -- 172.21.15.123:0/2769099898 shutdown_connections 2024-09-15T23:15:23.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.202+0000 7fc491fc4640 1 --2- 172.21.15.123:0/2769099898 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc48c13eb20 0x7fc48c15c230 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.202+0000 7fc491fc4640 1 --2- 172.21.15.123:0/2769099898 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc48c06c320 0x7fc48c15bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.202+0000 7fc491fc4640 1 -- 172.21.15.123:0/2769099898 >> 172.21.15.123:0/2769099898 conn(0x7fc48c0ccec0 msgr2=0x7fc48c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:23.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.202+0000 7fc491fc4640 1 -- 172.21.15.123:0/2769099898 shutdown_connections 2024-09-15T23:15:23.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.202+0000 7fc491fc4640 1 -- 172.21.15.123:0/2769099898 wait complete. 2024-09-15T23:15:23.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.203+0000 7fc491fc4640 1 Processor -- start 2024-09-15T23:15:23.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.203+0000 7fc491fc4640 1 -- start start 2024-09-15T23:15:23.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.204+0000 7fc491fc4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc48c06c320 0x7fc48c137970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:23.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.204+0000 7fc491fc4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc48c0b2d40 0x7fc48c154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:23.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.204+0000 7fc491fc4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc48c13eb20 0x7fc48c157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:23.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.204+0000 7fc491fc4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc48c0720c0 con 0x7fc48c13eb20 2024-09-15T23:15:23.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.204+0000 7fc491fc4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc48c071f40 con 0x7fc48c0b2d40 2024-09-15T23:15:23.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.204+0000 7fc491fc4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc48c072240 con 0x7fc48c06c320 2024-09-15T23:15:23.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.204+0000 7fc48bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc48c13eb20 0x7fc48c157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:23.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.204+0000 7fc48bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc48c13eb20 0x7fc48c157e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49472/0 (socket says 172.21.15.123:49472) 2024-09-15T23:15:23.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.204+0000 7fc48bfff640 1 -- 172.21.15.123:0/2758322094 learned_addr learned my addr 172.21.15.123:0/2758322094 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:23.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.204+0000 7fc48b7fe640 1 --2- 172.21.15.123:0/2758322094 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc48c06c320 0x7fc48c137970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:23.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.204+0000 7fc48affd640 1 --2- 172.21.15.123:0/2758322094 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc48c0b2d40 0x7fc48c154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:23.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.204+0000 7fc48bfff640 1 -- 172.21.15.123:0/2758322094 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc48c06c320 msgr2=0x7fc48c137970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:23.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.204+0000 7fc48bfff640 1 --2- 172.21.15.123:0/2758322094 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc48c06c320 0x7fc48c137970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.204+0000 7fc48bfff640 1 -- 172.21.15.123:0/2758322094 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc48c0b2d40 msgr2=0x7fc48c154d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:23.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.204+0000 7fc48bfff640 1 --2- 172.21.15.123:0/2758322094 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc48c0b2d40 0x7fc48c154d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.204+0000 7fc48bfff640 1 -- 172.21.15.123:0/2758322094 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc48c15cd70 con 0x7fc48c13eb20 2024-09-15T23:15:23.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.204+0000 7fc48bfff640 1 --2- 172.21.15.123:0/2758322094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc48c13eb20 0x7fc48c157e50 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fc48402a2b0 tx=0x7fc4840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:23.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.205+0000 7fc473fff640 1 -- 172.21.15.123:0/2758322094 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc484037040 con 0x7fc48c13eb20 2024-09-15T23:15:23.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.205+0000 7fc473fff640 1 -- 172.21.15.123:0/2758322094 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc484042070 con 0x7fc48c13eb20 2024-09-15T23:15:23.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.205+0000 7fc491fc4640 1 -- 172.21.15.123:0/2758322094 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc48c15d050 con 0x7fc48c13eb20 2024-09-15T23:15:23.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.205+0000 7fc473fff640 1 -- 172.21.15.123:0/2758322094 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc484030920 con 0x7fc48c13eb20 2024-09-15T23:15:23.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.205+0000 7fc491fc4640 1 -- 172.21.15.123:0/2758322094 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc48c157180 con 0x7fc48c13eb20 2024-09-15T23:15:23.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.206+0000 7fc491fc4640 1 -- 172.21.15.123:0/2758322094 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc48c06bc10 con 0x7fc48c13eb20 2024-09-15T23:15:23.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.206+0000 7fc473fff640 1 -- 172.21.15.123:0/2758322094 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc484030ac0 con 0x7fc48c13eb20 2024-09-15T23:15:23.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.206+0000 7fc473fff640 1 --2- 172.21.15.123:0/2758322094 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc47806c2b0 0x7fc47806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:23.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.206+0000 7fc473fff640 1 -- 172.21.15.123:0/2758322094 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7fc4840abc20 con 0x7fc48c13eb20 2024-09-15T23:15:23.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.207+0000 7fc48b7fe640 1 --2- 172.21.15.123:0/2758322094 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc47806c2b0 0x7fc47806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:23.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.207+0000 7fc48b7fe640 1 --2- 172.21.15.123:0/2758322094 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc47806c2b0 0x7fc47806e770 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc47c001f10 tx=0x7fc47c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:23.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.211+0000 7fc473fff640 1 -- 172.21.15.123:0/2758322094 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc484079d40 con 0x7fc48c13eb20 2024-09-15T23:15:23.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.411+0000 7fc491fc4640 1 -- 172.21.15.123:0/2758322094 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc48c06c9c0 con 0x7fc48c13eb20 2024-09-15T23:15:23.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.412+0000 7fc473fff640 1 -- 172.21.15.123:0/2758322094 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5232 (secure 0 0 0) 0x7fc48407e040 con 0x7fc48c13eb20 2024-09-15T23:15:23.414 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:23.414 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":30,"btime":"2024-09-15T23:15:21:435254+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5339,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/3452580408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":3452580408},{"type":"v1","addr":"172.21.15.188:6837","nonce":3452580408}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5665,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/301618526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":301618526},{"type":"v1","addr":"172.21.15.188:6836","nonce":301618526}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":6162,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2171163786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2171163786},{"type":"v1","addr":"172.21.15.123:6834","nonce":2171163786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:15:17.752297+0000","modified":"2024-09-15T23:15:20.582574+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6165},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6165":{"gid":6165,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/2772280632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":2772280632},{"type":"v1","addr":"172.21.15.123:6835","nonce":2772280632}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6165,"qdb_cluster":[6165]},"id":4}]} 2024-09-15T23:15:23.414 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 30 2024-09-15T23:15:23.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.414+0000 7fc491fc4640 1 -- 172.21.15.123:0/2758322094 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc47806c2b0 msgr2=0x7fc47806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:23.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.414+0000 7fc491fc4640 1 --2- 172.21.15.123:0/2758322094 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc47806c2b0 0x7fc47806e770 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc47c001f10 tx=0x7fc47c009040 comp rx=0 tx=0).stop 2024-09-15T23:15:23.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.414+0000 7fc491fc4640 1 -- 172.21.15.123:0/2758322094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc48c13eb20 msgr2=0x7fc48c157e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:23.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.414+0000 7fc491fc4640 1 --2- 172.21.15.123:0/2758322094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc48c13eb20 0x7fc48c157e50 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fc48402a2b0 tx=0x7fc4840046c0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.414+0000 7fc491fc4640 1 -- 172.21.15.123:0/2758322094 shutdown_connections 2024-09-15T23:15:23.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.414+0000 7fc491fc4640 1 --2- 172.21.15.123:0/2758322094 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc47806c2b0 0x7fc47806e770 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.414+0000 7fc491fc4640 1 --2- 172.21.15.123:0/2758322094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc48c13eb20 0x7fc48c157e50 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.414+0000 7fc491fc4640 1 --2- 172.21.15.123:0/2758322094 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc48c0b2d40 0x7fc48c154d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.414+0000 7fc491fc4640 1 --2- 172.21.15.123:0/2758322094 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc48c06c320 0x7fc48c137970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.414+0000 7fc491fc4640 1 -- 172.21.15.123:0/2758322094 >> 172.21.15.123:0/2758322094 conn(0x7fc48c0ccec0 msgr2=0x7fc48c13d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:23.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.414+0000 7fc491fc4640 1 -- 172.21.15.123:0/2758322094 shutdown_connections 2024-09-15T23:15:23.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.414+0000 7fc491fc4640 1 -- 172.21.15.123:0/2758322094 wait complete. 2024-09-15T23:15:23.830 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 30, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:15:17.752297+0000', 'modified': '2024-09-15T23:15:20.582574+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6165}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6165': {'gid': 6165, 'name': 'a', 'rank': 0, 'incarnation': 27, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.123:6835/2772280632', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6833', 'nonce': 2772280632}, {'type': 'v1', 'addr': '172.21.15.123:6835', 'nonce': 2772280632}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6165, 'qdb_cluster': [6165]} 2024-09-15T23:15:23.830 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:15:23.830 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-15T23:15:23.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.931+0000 7f30b1d31640 1 Processor -- start 2024-09-15T23:15:23.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.931+0000 7f30b1d31640 1 -- start start 2024-09-15T23:15:23.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.932+0000 7f30b1d31640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f30ac162490 0x7f30ac15ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:23.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.932+0000 7f30b1d31640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30ac0b66b0 0x7f30ac0b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:23.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.932+0000 7f30b1d31640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30ac15f570 con 0x7f30ac15eab0 2024-09-15T23:15:23.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.932+0000 7f30b1d31640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f30ac0b7040 con 0x7f30ac162490 2024-09-15T23:15:23.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.932+0000 7f30b1d31640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f30ac15f850 con 0x7f30ac0b66b0 2024-09-15T23:15:23.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.932+0000 7f30ab7fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f30ac15eab0 0x7f30ac0d2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58212/0 (socket says 172.21.15.123:58212) 2024-09-15T23:15:23.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.932+0000 7f30ab7fe640 1 -- 172.21.15.123:0/154799082 learned_addr learned my addr 172.21.15.123:0/154799082 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:23.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.933+0000 7f30aaffd640 1 --2- 172.21.15.123:0/154799082 >> v2:172.21.15.188:3300/0 conn(0x7f30ac162490 0x7f30ac15ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:23.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.933+0000 7f30abfff640 1 --2- 172.21.15.123:0/154799082 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30ac0b66b0 0x7f30ac0b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:23.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.933+0000 7f30aa7fc640 1 -- 172.21.15.123:0/154799082 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1455897361 0 0) 0x7f30ac15f570 con 0x7f30ac15eab0 2024-09-15T23:15:23.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.933+0000 7f30aa7fc640 1 -- 172.21.15.123:0/154799082 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3094003520 con 0x7f30ac15eab0 2024-09-15T23:15:23.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.933+0000 7f30aa7fc640 1 -- 172.21.15.123:0/154799082 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2016473272 0 0) 0x7f3094003520 con 0x7f30ac15eab0 2024-09-15T23:15:23.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.933+0000 7f30aa7fc640 1 -- 172.21.15.123:0/154799082 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30ac0b66b0 msgr2=0x7f30ac0b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:23.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.933+0000 7f30aa7fc640 1 --2- 172.21.15.123:0/154799082 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30ac0b66b0 0x7f30ac0b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.933+0000 7f30aa7fc640 1 -- 172.21.15.123:0/154799082 >> v2:172.21.15.188:3300/0 conn(0x7f30ac162490 msgr2=0x7f30ac15ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:23.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.933+0000 7f30aa7fc640 1 --2- 172.21.15.123:0/154799082 >> v2:172.21.15.188:3300/0 conn(0x7f30ac162490 0x7f30ac15ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.933+0000 7f30aa7fc640 1 -- 172.21.15.123:0/154799082 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30ac15fb30 con 0x7f30ac15eab0 2024-09-15T23:15:23.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.933+0000 7f30aa7fc640 1 -- 172.21.15.123:0/154799082 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f309c001670 con 0x7f30ac15eab0 2024-09-15T23:15:23.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.933+0000 7f30abfff640 1 --2- 172.21.15.123:0/154799082 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30ac0b66b0 0x7f30ac0b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:15:23.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.933+0000 7f30aaffd640 1 --2- 172.21.15.123:0/154799082 >> v2:172.21.15.188:3300/0 conn(0x7f30ac162490 0x7f30ac15ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:15:23.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.933+0000 7f30aa7fc640 1 -- 172.21.15.123:0/154799082 >> v1:172.21.15.123:6789/0 conn(0x7f30ac15eab0 legacy=0x7f30ac0d2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:23.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.933+0000 7f30aa7fc640 1 --2- 172.21.15.123:0/154799082 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30940039b0 0x7f3094003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:23.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.933+0000 7f30aa7fc640 1 --2- 172.21.15.123:0/154799082 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3094004800 0x7f3094004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:23.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.933+0000 7f30aa7fc640 1 --2- 172.21.15.123:0/154799082 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30ac0b66b0 0x7f30940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:23.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.933+0000 7f30aa7fc640 1 -- 172.21.15.123:0/154799082 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac0b7040 con 0x7f30940039b0 2024-09-15T23:15:23.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.933+0000 7f30aa7fc640 1 -- 172.21.15.123:0/154799082 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac15f850 con 0x7f3094004800 2024-09-15T23:15:23.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.933+0000 7f30aa7fc640 1 -- 172.21.15.123:0/154799082 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f309400b9c0 con 0x7f30ac0b66b0 2024-09-15T23:15:23.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.933+0000 7f30ab7fe640 1 --2- 172.21.15.123:0/154799082 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30940039b0 0x7f3094003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:23.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.933+0000 7f30aaffd640 1 --2- 172.21.15.123:0/154799082 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3094004800 0x7f3094004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:23.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.933+0000 7f30abfff640 1 --2- 172.21.15.123:0/154799082 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30ac0b66b0 0x7f30940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:23.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.933+0000 7f30ab7fe640 1 -- 172.21.15.123:0/154799082 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30ac0b66b0 msgr2=0x7f30940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:23.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.933+0000 7f30ab7fe640 1 --2- 172.21.15.123:0/154799082 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30ac0b66b0 0x7f30940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.933+0000 7f30ab7fe640 1 -- 172.21.15.123:0/154799082 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3094004800 msgr2=0x7f3094004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:23.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.933+0000 7f30ab7fe640 1 --2- 172.21.15.123:0/154799082 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3094004800 0x7f3094004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.933+0000 7f30ab7fe640 1 -- 172.21.15.123:0/154799082 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3094003520 con 0x7f30940039b0 2024-09-15T23:15:23.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.933+0000 7f30abfff640 1 --2- 172.21.15.123:0/154799082 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30ac0b66b0 0x7f30940051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:23.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.934+0000 7f30ab7fe640 1 --2- 172.21.15.123:0/154799082 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30940039b0 0x7f3094003dd0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f309c00c210 tx=0x7f3094005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d9b8ca6a7f183e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:23.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.934+0000 7f30aa7fc640 1 -- 172.21.15.123:0/154799082 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c007d50 con 0x7f30940039b0 2024-09-15T23:15:23.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.934+0000 7f30aa7fc640 1 -- 172.21.15.123:0/154799082 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f309c005af0 con 0x7f30940039b0 2024-09-15T23:15:23.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.934+0000 7f30aa7fc640 1 -- 172.21.15.123:0/154799082 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c007070 con 0x7f30940039b0 2024-09-15T23:15:23.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.935+0000 7f30b1d31640 1 -- 172.21.15.123:0/154799082 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30940039b0 msgr2=0x7f3094003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:23.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.935+0000 7f30b1d31640 1 --2- 172.21.15.123:0/154799082 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30940039b0 0x7f3094003dd0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f309c00c210 tx=0x7f3094005830 comp rx=0 tx=0).stop 2024-09-15T23:15:23.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.935+0000 7f30abfff640 1 -- 172.21.15.123:0/154799082 reap_dead start 2024-09-15T23:15:23.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.935+0000 7f30b1d31640 1 -- 172.21.15.123:0/154799082 shutdown_connections 2024-09-15T23:15:23.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.935+0000 7f30b1d31640 1 -- 172.21.15.123:0/154799082 >> 172.21.15.123:0/154799082 conn(0x7f30ac0d16d0 msgr2=0x7f30ac0d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:23.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.935+0000 7f30b1d31640 1 -- 172.21.15.123:0/154799082 shutdown_connections 2024-09-15T23:15:23.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.935+0000 7f30b1d31640 1 -- 172.21.15.123:0/154799082 wait complete. 2024-09-15T23:15:23.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.936+0000 7f30b1d31640 1 Processor -- start 2024-09-15T23:15:23.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.936+0000 7f30b1d31640 1 -- start start 2024-09-15T23:15:23.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.937+0000 7f30b1d31640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30940039b0 0x7f30ac159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:23.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.937+0000 7f30b1d31640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30ac1ea0b0 0x7f30ac1ea530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:23.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.937+0000 7f30b1d31640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30ac1610a0 0x7f30ac161520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:23.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.937+0000 7f30b1d31640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac0d4460 con 0x7f30ac1ea0b0 2024-09-15T23:15:23.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.937+0000 7f30b1d31640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac0cef20 con 0x7f30ac1610a0 2024-09-15T23:15:23.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.937+0000 7f30b1d31640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f30ac0d45e0 con 0x7f30940039b0 2024-09-15T23:15:23.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.937+0000 7f30aaffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30ac1ea0b0 0x7f30ac1ea530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:23.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.937+0000 7f30aaffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30ac1ea0b0 0x7f30ac1ea530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49486/0 (socket says 172.21.15.123:49486) 2024-09-15T23:15:23.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.937+0000 7f30aaffd640 1 -- 172.21.15.123:0/3643148968 learned_addr learned my addr 172.21.15.123:0/3643148968 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:23.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.937+0000 7f30aaffd640 1 -- 172.21.15.123:0/3643148968 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30940039b0 msgr2=0x7f30ac159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:23.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.937+0000 7f30aaffd640 1 --2- 172.21.15.123:0/3643148968 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30940039b0 0x7f30ac159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.937+0000 7f30abfff640 1 --2- 172.21.15.123:0/3643148968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30ac1610a0 0x7f30ac161520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:23.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.937+0000 7f30aaffd640 1 -- 172.21.15.123:0/3643148968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30ac1610a0 msgr2=0x7f30ac161520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:23.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.937+0000 7f30aaffd640 1 --2- 172.21.15.123:0/3643148968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30ac1610a0 0x7f30ac161520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.937+0000 7f30aaffd640 1 -- 172.21.15.123:0/3643148968 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30ac159df0 con 0x7f30ac1ea0b0 2024-09-15T23:15:23.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.937+0000 7f30abfff640 1 --2- 172.21.15.123:0/3643148968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30ac1610a0 0x7f30ac161520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:23.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.938+0000 7f30aaffd640 1 --2- 172.21.15.123:0/3643148968 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30ac1ea0b0 0x7f30ac1ea530 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f30a0011d30 tx=0x7f30a000f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:23.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.938+0000 7f3093fff640 1 -- 172.21.15.123:0/3643148968 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a000fd20 con 0x7f30ac1ea0b0 2024-09-15T23:15:23.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.938+0000 7f3093fff640 1 -- 172.21.15.123:0/3643148968 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a0004030 con 0x7f30ac1ea0b0 2024-09-15T23:15:23.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.938+0000 7f30b1d31640 1 -- 172.21.15.123:0/3643148968 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30ac1f4b40 con 0x7f30ac1ea0b0 2024-09-15T23:15:23.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.938+0000 7f3093fff640 1 -- 172.21.15.123:0/3643148968 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a0004420 con 0x7f30ac1ea0b0 2024-09-15T23:15:23.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.938+0000 7f30b1d31640 1 -- 172.21.15.123:0/3643148968 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30ac1f50c0 con 0x7f30ac1ea0b0 2024-09-15T23:15:23.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.940+0000 7f3093fff640 1 -- 172.21.15.123:0/3643148968 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f30a0012040 con 0x7f30ac1ea0b0 2024-09-15T23:15:23.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.940+0000 7f3093fff640 1 --2- 172.21.15.123:0/3643148968 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f309806c2b0 0x7f309806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:23.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.940+0000 7f3093fff640 1 -- 172.21.15.123:0/3643148968 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7f30a008b8f0 con 0x7f30ac1ea0b0 2024-09-15T23:15:23.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.940+0000 7f30ab7fe640 1 --2- 172.21.15.123:0/3643148968 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f309806c2b0 0x7f309806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:23.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.941+0000 7f30b4ad1740 1 Processor -- start 2024-09-15T23:15:23.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.941+0000 7f30ab7fe640 1 --2- 172.21.15.123:0/3643148968 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f309806c2b0 0x7f309806e770 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f309c033000 tx=0x7f309c007000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:23.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.941+0000 7f30b4ad1740 1 -- start start 2024-09-15T23:15:23.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.942+0000 7f30b4ad1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c30def02c0 0x55c30df35a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:23.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.942+0000 7f30b4ad1740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c30deeda80 0x55c30def06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:23.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.942+0000 7f30b4ad1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c30def1a50 0x55c30deea8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:23.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.942+0000 7f30b4ad1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55c30de52520 con 0x55c30def1a50 2024-09-15T23:15:23.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.942+0000 7f30b4ad1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55c30ddfa3e0 con 0x55c30def02c0 2024-09-15T23:15:23.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.942+0000 7f30b4ad1740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55c30de4e4e0 con 0x55c30deeda80 2024-09-15T23:15:23.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.942+0000 7f30abfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c30def1a50 0x55c30deea8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:23.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.942+0000 7f30abfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c30def1a50 0x55c30deea8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49496/0 (socket says 172.21.15.123:49496) 2024-09-15T23:15:23.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.942+0000 7f30abfff640 1 -- 172.21.15.123:0/2836484874 learned_addr learned my addr 172.21.15.123:0/2836484874 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:23.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.942+0000 7f30ab7fe640 1 --2- 172.21.15.123:0/2836484874 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c30def02c0 0x55c30df35a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:23.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.942+0000 7f30aaffd640 1 --2- 172.21.15.123:0/2836484874 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c30deeda80 0x55c30def06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:23.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.942+0000 7f30abfff640 1 -- 172.21.15.123:0/2836484874 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c30deeda80 msgr2=0x55c30def06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:23.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.942+0000 7f30abfff640 1 --2- 172.21.15.123:0/2836484874 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c30deeda80 0x55c30def06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.942+0000 7f30abfff640 1 -- 172.21.15.123:0/2836484874 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c30def02c0 msgr2=0x55c30df35a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:23.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.942+0000 7f30abfff640 1 --2- 172.21.15.123:0/2836484874 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c30def02c0 0x55c30df35a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.942+0000 7f30abfff640 1 -- 172.21.15.123:0/2836484874 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c30de152f0 con 0x55c30def1a50 2024-09-15T23:15:23.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.942+0000 7f30abfff640 1 --2- 172.21.15.123:0/2836484874 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c30def1a50 0x55c30deea8b0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f30ac0d1010 tx=0x7f30a4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b910465cd485cd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:23.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.942+0000 7f30917fa640 1 -- 172.21.15.123:0/2836484874 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4016660 con 0x55c30def1a50 2024-09-15T23:15:23.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.942+0000 7f30917fa640 1 -- 172.21.15.123:0/2836484874 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a401c070 con 0x55c30def1a50 2024-09-15T23:15:23.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.942+0000 7f30917fa640 1 -- 172.21.15.123:0/2836484874 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4016a00 con 0x55c30def1a50 2024-09-15T23:15:23.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.943+0000 7f30b4ad1740 1 -- 172.21.15.123:0/2836484874 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c30def1a50 msgr2=0x55c30deea8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:23.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.943+0000 7f30b4ad1740 1 --2- 172.21.15.123:0/2836484874 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c30def1a50 0x55c30deea8b0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f30ac0d1010 tx=0x7f30a4009750 comp rx=0 tx=0).stop 2024-09-15T23:15:23.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.943+0000 7f30b4ad1740 1 -- 172.21.15.123:0/2836484874 shutdown_connections 2024-09-15T23:15:23.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.943+0000 7f30b4ad1740 1 --2- 172.21.15.123:0/2836484874 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c30def1a50 0x55c30deea8b0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.943+0000 7f30b4ad1740 1 --2- 172.21.15.123:0/2836484874 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c30deeda80 0x55c30def06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.943+0000 7f30b4ad1740 1 --2- 172.21.15.123:0/2836484874 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c30def02c0 0x55c30df35a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.943+0000 7f30b4ad1740 1 -- 172.21.15.123:0/2836484874 >> 172.21.15.123:0/2836484874 conn(0x55c30deeca80 msgr2=0x55c30df34f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:23.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.943+0000 7f30b4ad1740 1 -- 172.21.15.123:0/2836484874 shutdown_connections 2024-09-15T23:15:23.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.943+0000 7f30b4ad1740 1 -- 172.21.15.123:0/2836484874 wait complete. 2024-09-15T23:15:23.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.944+0000 7f30b4ad1740 1 -- start start 2024-09-15T23:15:23.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.944+0000 7f30b4ad1740 1 Processor -- start 2024-09-15T23:15:23.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.945+0000 7f30b4ad1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c30def02c0 0x55c30df0bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:23.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.945+0000 7f30b4ad1740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c30def1a50 0x55c30df17dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:23.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.945+0000 7f30b4ad1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c30deeab10 0x55c30df10f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:23.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.945+0000 7f30b4ad1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55c30deebf20 con 0x55c30deeab10 2024-09-15T23:15:23.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.945+0000 7f30b4ad1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55c30dddb450 con 0x55c30def02c0 2024-09-15T23:15:23.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.945+0000 7f30b4ad1740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55c30df36290 con 0x55c30def1a50 2024-09-15T23:15:23.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.945+0000 7f30b4ad1740 10 client.0 _ll_register_callbacks cb 0x55c30db64ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:15:23.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.945+0000 7f30abfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c30deeab10 0x55c30df10f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:23.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.945+0000 7f30abfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c30deeab10 0x55c30df10f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49512/0 (socket says 172.21.15.123:49512) 2024-09-15T23:15:23.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.945+0000 7f30abfff640 1 -- 172.21.15.123:0/3931765479 learned_addr learned my addr 172.21.15.123:0/3931765479 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:23.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.945+0000 7f30aaffd640 1 --2- 172.21.15.123:0/3931765479 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c30def1a50 0x55c30df17dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:23.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.945+0000 7f30ab7fe640 1 --2- 172.21.15.123:0/3931765479 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c30def02c0 0x55c30df0bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:23.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.945+0000 7f30abfff640 1 -- 172.21.15.123:0/3931765479 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c30def1a50 msgr2=0x55c30df17dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:23.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.945+0000 7f30abfff640 1 --2- 172.21.15.123:0/3931765479 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c30def1a50 0x55c30df17dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.945+0000 7f30abfff640 1 -- 172.21.15.123:0/3931765479 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c30def02c0 msgr2=0x55c30df0bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:23.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.945+0000 7f30abfff640 1 --2- 172.21.15.123:0/3931765479 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c30def02c0 0x55c30df0bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.945+0000 7f30abfff640 1 -- 172.21.15.123:0/3931765479 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c30db652d0 con 0x55c30deeab10 2024-09-15T23:15:23.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.945+0000 7f30ab7fe640 1 --2- 172.21.15.123:0/3931765479 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c30def02c0 0x55c30df0bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:23.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.945+0000 7f30aaffd640 1 --2- 172.21.15.123:0/3931765479 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c30def1a50 0x55c30df17dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:23.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.945+0000 7f30abfff640 1 --2- 172.21.15.123:0/3931765479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c30deeab10 0x55c30df10f40 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f30a4009790 tx=0x7f30a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f478359c2e3b9d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:23.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.945+0000 7f308a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:15:23.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.945+0000 7f308a7fc640 1 -- 172.21.15.123:0/3931765479 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4003990 con 0x55c30deeab10 2024-09-15T23:15:23.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.945+0000 7f30b4ad1740 1 -- 172.21.15.123:0/3931765479 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30a401c070 con 0x55c30deeab10 2024-09-15T23:15:23.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.945+0000 7f308a7fc640 1 -- 172.21.15.123:0/3931765479 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7f30a4003b30 con 0x55c30deeab10 2024-09-15T23:15:23.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.946+0000 7f308a7fc640 1 -- 172.21.15.123:0/3931765479 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f30a4032050 con 0x55c30deeab10 2024-09-15T23:15:23.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.946+0000 7f30b4ad1740 10 client.6294 fetch_fsmap learned FSMap version 30 2024-09-15T23:15:23.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.946+0000 7f30b4ad1740 1 -- 172.21.15.123:0/3931765479 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x55c30dc2f6b0 con 0x55c30deeab10 2024-09-15T23:15:23.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.946+0000 7f308a7fc640 1 -- 172.21.15.123:0/3931765479 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a401c070 con 0x55c30deeab10 2024-09-15T23:15:23.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.946+0000 7f308a7fc640 1 -- 172.21.15.123:0/3931765479 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7f30a4035020 con 0x55c30deeab10 2024-09-15T23:15:23.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.946+0000 7f30b4ad1740 10 client.6294 fetch_fsmap finished waiting for FSMap version 30 2024-09-15T23:15:23.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.946+0000 7f30b4ad1740 10 client.6294 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T23:15:23.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.946+0000 7f30b4ad1740 20 client.6294 populate_metadata read hostname 'smithi123' 2024-09-15T23:15:23.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.946+0000 7f30b4ad1740 1 --2- 172.21.15.123:0/3931765479 >> [v2:172.21.15.123:6833/2772280632,v1:172.21.15.123:6835/2772280632] conn(0x55c30df196f0 0x55c30dee9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:23.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.946+0000 7f30b4ad1740 4 client.6294 mds_command: new command op to 6165 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:15:23.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.946+0000 7f30b4ad1740 1 -- 172.21.15.123:0/3931765479 --> [v2:172.21.15.123:6833/2772280632,v1:172.21.15.123:6835/2772280632] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c30de5fc50 con 0x55c30df196f0 2024-09-15T23:15:23.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.946+0000 7f30ab7fe640 1 --2- 172.21.15.123:0/3931765479 >> [v2:172.21.15.123:6833/2772280632,v1:172.21.15.123:6835/2772280632] conn(0x55c30df196f0 0x55c30dee9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:23.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.946+0000 7f308a7fc640 10 client.6294 ms_handle_connect on v2:172.21.15.123:6833/2772280632 2024-09-15T23:15:23.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.946+0000 7f30ab7fe640 1 --2- 172.21.15.123:0/3931765479 >> [v2:172.21.15.123:6833/2772280632,v1:172.21.15.123:6835/2772280632] conn(0x55c30df196f0 0x55c30dee9ad0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58be8209239dd4e0 server_cookie=ddc0d0e344a44037 in_seq=0 out_seq=0 2024-09-15T23:15:23.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.947+0000 7f308a7fc640 1 -- 172.21.15.123:0/3931765479 <== mds.0 v2:172.21.15.123:6833/2772280632 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c30de5fc50 con 0x55c30df196f0 2024-09-15T23:15:23.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.947+0000 7f308a7fc640 10 client.6294 handle_command_reply: tid=0 2024-09-15T23:15:23.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.947+0000 7f30b4ad1740 1 client.6294 shutdown 2024-09-15T23:15:23.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.947+0000 7f30b4ad1740 1 -- 172.21.15.123:0/3931765479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c30deeab10 msgr2=0x55c30df10f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:23.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.947+0000 7f30b4ad1740 1 --2- 172.21.15.123:0/3931765479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c30deeab10 0x55c30df10f40 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f30a4009790 tx=0x7f30a4004a40 comp rx=0 tx=0).stop 2024-09-15T23:15:23.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.947+0000 7f30b4ad1740 1 -- 172.21.15.123:0/3931765479 shutdown_connections 2024-09-15T23:15:23.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.947+0000 7f30b4ad1740 1 --2- 172.21.15.123:0/3931765479 >> [v2:172.21.15.123:6833/2772280632,v1:172.21.15.123:6835/2772280632] conn(0x55c30df196f0 0x55c30dee9ad0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.947+0000 7f30b4ad1740 1 --2- 172.21.15.123:0/3931765479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c30deeab10 0x55c30df10f40 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.947+0000 7f30b4ad1740 1 --2- 172.21.15.123:0/3931765479 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c30def1a50 0x55c30df17dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.947+0000 7f30b4ad1740 1 --2- 172.21.15.123:0/3931765479 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c30def02c0 0x55c30df0bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.947+0000 7f30b4ad1740 1 -- 172.21.15.123:0/3931765479 >> 172.21.15.123:0/3931765479 conn(0x55c30deeda80 msgr2=0x55c30df37070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:23.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.947+0000 7f308a7fc640 0 client.6294 ms_handle_reset on v2:172.21.15.123:6833/2772280632 2024-09-15T23:15:23.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.947+0000 7f30b4ad1740 1 -- 172.21.15.123:0/3931765479 shutdown_connections 2024-09-15T23:15:23.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.947+0000 7f30b4ad1740 1 -- 172.21.15.123:0/3931765479 wait complete. 2024-09-15T23:15:23.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.947+0000 7f30b4ad1740 20 client.6294 trim_cache size 0 max 16384 2024-09-15T23:15:23.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.965+0000 7f30b4ad1740 1 Processor -- start 2024-09-15T23:15:23.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.965+0000 7f30b4ad1740 1 -- start start 2024-09-15T23:15:23.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.966+0000 7f30b4ad1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c30deeab10 0x55c30df350f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:23.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.966+0000 7f30b4ad1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c30def02c0 0x55c30df36a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:23.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.966+0000 7f30b4ad1740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c30def1a50 0x55c30df36fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:23.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.966+0000 7f30b4ad1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac2005d0 con 0x55c30deeab10 2024-09-15T23:15:23.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.966+0000 7f30b4ad1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac1f8df0 con 0x55c30def02c0 2024-09-15T23:15:23.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.966+0000 7f30b4ad1740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f30ac15b210 con 0x55c30def1a50 2024-09-15T23:15:23.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.966+0000 7f30ab7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c30deeab10 0x55c30df350f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:23.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.966+0000 7f30ab7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c30deeab10 0x55c30df350f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49516/0 (socket says 172.21.15.123:49516) 2024-09-15T23:15:23.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.966+0000 7f30ab7fe640 1 -- 172.21.15.123:0/1095778380 learned_addr learned my addr 172.21.15.123:0/1095778380 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:23.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.966+0000 7f30aaffd640 1 --2- 172.21.15.123:0/1095778380 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c30def02c0 0x55c30df36a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:23.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.966+0000 7f30ab7fe640 1 -- 172.21.15.123:0/1095778380 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c30def1a50 msgr2=0x55c30df36fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:23.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.966+0000 7f30ab7fe640 1 --2- 172.21.15.123:0/1095778380 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c30def1a50 0x55c30df36fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.966+0000 7f30ab7fe640 1 -- 172.21.15.123:0/1095778380 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c30def02c0 msgr2=0x55c30df36a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:23.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.966+0000 7f30ab7fe640 1 --2- 172.21.15.123:0/1095778380 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c30def02c0 0x55c30df36a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.966+0000 7f30ab7fe640 1 -- 172.21.15.123:0/1095778380 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c30def1320 con 0x55c30deeab10 2024-09-15T23:15:23.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.966+0000 7f30aaffd640 1 --2- 172.21.15.123:0/1095778380 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c30def02c0 0x55c30df36a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:23.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.966+0000 7f30ab7fe640 1 --2- 172.21.15.123:0/1095778380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c30deeab10 0x55c30df350f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f309c00c330 tx=0x7f309c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b146d1067b718269 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:23.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.966+0000 7f3090ff9640 1 -- 172.21.15.123:0/1095778380 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c042040 con 0x55c30deeab10 2024-09-15T23:15:23.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.967+0000 7f3090ff9640 1 -- 172.21.15.123:0/1095778380 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f309c043040 con 0x55c30deeab10 2024-09-15T23:15:23.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.967+0000 7f3090ff9640 1 -- 172.21.15.123:0/1095778380 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c04b670 con 0x55c30deeab10 2024-09-15T23:15:23.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.967+0000 7f30b4ad1740 1 -- 172.21.15.123:0/1095778380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c30deeab10 msgr2=0x55c30df350f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:23.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.967+0000 7f30b4ad1740 1 --2- 172.21.15.123:0/1095778380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c30deeab10 0x55c30df350f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f309c00c330 tx=0x7f309c02e000 comp rx=0 tx=0).stop 2024-09-15T23:15:23.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.967+0000 7f30b4ad1740 1 -- 172.21.15.123:0/1095778380 shutdown_connections 2024-09-15T23:15:23.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.967+0000 7f30b4ad1740 1 --2- 172.21.15.123:0/1095778380 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c30def1a50 0x55c30df36fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.967+0000 7f30b4ad1740 1 --2- 172.21.15.123:0/1095778380 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c30def02c0 0x55c30df36a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.967+0000 7f30b4ad1740 1 --2- 172.21.15.123:0/1095778380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c30deeab10 0x55c30df350f0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.967+0000 7f30b4ad1740 1 -- 172.21.15.123:0/1095778380 >> 172.21.15.123:0/1095778380 conn(0x55c30deeda80 msgr2=0x55c30df32fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:23.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.967+0000 7f30b4ad1740 1 -- 172.21.15.123:0/1095778380 shutdown_connections 2024-09-15T23:15:23.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.967+0000 7f30b4ad1740 1 -- 172.21.15.123:0/1095778380 wait complete. 2024-09-15T23:15:23.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.968+0000 7f30b4ad1740 1 -- start start 2024-09-15T23:15:23.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.968+0000 7f30b4ad1740 1 Processor -- start 2024-09-15T23:15:23.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.969+0000 7f30b4ad1740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c30deeab10 0x55c30df99370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:23.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.969+0000 7f30b4ad1740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c30def02c0 0x55c30df54550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:23.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.969+0000 7f30b4ad1740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c30def1a50 0x55c30df54a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:23.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.969+0000 7f30b4ad1740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55c30df1a570 con 0x55c30def02c0 2024-09-15T23:15:23.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.969+0000 7f30b4ad1740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55c30df10050 con 0x55c30def1a50 2024-09-15T23:15:23.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.969+0000 7f30b4ad1740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55c30df19b10 con 0x55c30deeab10 2024-09-15T23:15:23.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.969+0000 7f30b4ad1740 10 client.0 _ll_register_callbacks cb 0x7f309c02c040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:15:23.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.969+0000 7f30aaffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c30def02c0 0x55c30df54550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:23.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.969+0000 7f30aaffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c30def02c0 0x55c30df54550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49522/0 (socket says 172.21.15.123:49522) 2024-09-15T23:15:23.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.969+0000 7f30aaffd640 1 -- 172.21.15.123:0/2712374300 learned_addr learned my addr 172.21.15.123:0/2712374300 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:23.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.969+0000 7f30abfff640 1 --2- 172.21.15.123:0/2712374300 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c30def1a50 0x55c30df54a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:23.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.969+0000 7f30ab7fe640 1 --2- 172.21.15.123:0/2712374300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c30deeab10 0x55c30df99370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:23.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.969+0000 7f30aaffd640 1 -- 172.21.15.123:0/2712374300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c30deeab10 msgr2=0x55c30df99370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:23.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.969+0000 7f30aaffd640 1 --2- 172.21.15.123:0/2712374300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c30deeab10 0x55c30df99370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.969+0000 7f30aaffd640 1 -- 172.21.15.123:0/2712374300 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c30def1a50 msgr2=0x55c30df54a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:23.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.969+0000 7f30aaffd640 1 --2- 172.21.15.123:0/2712374300 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c30def1a50 0x55c30df54a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.969+0000 7f30aaffd640 1 -- 172.21.15.123:0/2712374300 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c30dfb34f0 con 0x55c30def02c0 2024-09-15T23:15:23.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.969+0000 7f30aaffd640 1 --2- 172.21.15.123:0/2712374300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c30def02c0 0x55c30df54550 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f30a0089d60 tx=0x7f30a0059380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c5f6a7d27136ff2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:23.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.969+0000 7f308a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:15:23.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.969+0000 7f308a7fc640 1 -- 172.21.15.123:0/2712374300 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a0088060 con 0x55c30def02c0 2024-09-15T23:15:23.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.969+0000 7f308a7fc640 1 -- 172.21.15.123:0/2712374300 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7f30a0059bc0 con 0x55c30def02c0 2024-09-15T23:15:23.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.969+0000 7f30b4ad1740 1 -- 172.21.15.123:0/2712374300 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f309c043040 con 0x55c30def02c0 2024-09-15T23:15:23.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.969+0000 7f308a7fc640 1 -- 172.21.15.123:0/2712374300 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f30a0076050 con 0x55c30def02c0 2024-09-15T23:15:23.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.969+0000 7f30b4ad1740 10 client.6300 fetch_fsmap learned FSMap version 30 2024-09-15T23:15:23.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.969+0000 7f30b4ad1740 1 -- 172.21.15.123:0/2712374300 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x55c30deefa40 con 0x55c30def02c0 2024-09-15T23:15:23.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.970+0000 7f308a7fc640 1 -- 172.21.15.123:0/2712374300 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f309c043040 con 0x55c30def02c0 2024-09-15T23:15:23.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.970+0000 7f308a7fc640 1 -- 172.21.15.123:0/2712374300 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7f30a00620b0 con 0x55c30def02c0 2024-09-15T23:15:23.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.970+0000 7f30b4ad1740 10 client.6300 fetch_fsmap finished waiting for FSMap version 30 2024-09-15T23:15:23.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.970+0000 7f30b4ad1740 10 client.6300 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T23:15:23.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.970+0000 7f30b4ad1740 20 client.6300 populate_metadata read hostname 'smithi123' 2024-09-15T23:15:23.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.970+0000 7f30b4ad1740 1 --2- 172.21.15.123:0/2712374300 >> [v2:172.21.15.123:6833/2772280632,v1:172.21.15.123:6835/2772280632] conn(0x55c30df37580 0x55c30deee9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:23.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.970+0000 7f30b4ad1740 4 client.6300 mds_command: new command op to 6165 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:15:23.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.970+0000 7f30b4ad1740 1 -- 172.21.15.123:0/2712374300 --> [v2:172.21.15.123:6833/2772280632,v1:172.21.15.123:6835/2772280632] -- command(tid 0: {"prefix": "status"}) -- 0x55c30de59fa0 con 0x55c30df37580 2024-09-15T23:15:23.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.970+0000 7f30ab7fe640 1 --2- 172.21.15.123:0/2712374300 >> [v2:172.21.15.123:6833/2772280632,v1:172.21.15.123:6835/2772280632] conn(0x55c30df37580 0x55c30deee9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:23.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.970+0000 7f308a7fc640 10 client.6300 ms_handle_connect on v2:172.21.15.123:6833/2772280632 2024-09-15T23:15:23.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.970+0000 7f30ab7fe640 1 --2- 172.21.15.123:0/2712374300 >> [v2:172.21.15.123:6833/2772280632,v1:172.21.15.123:6835/2772280632] conn(0x55c30df37580 0x55c30deee9c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40663d3feee67b82 server_cookie=e5e55a41517f17bd in_seq=0 out_seq=0 2024-09-15T23:15:23.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.970+0000 7f308a7fc640 1 -- 172.21.15.123:0/2712374300 <== mds.0 v2:172.21.15.123:6833/2772280632 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55c30de59fa0 con 0x55c30df37580 2024-09-15T23:15:23.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.970+0000 7f308a7fc640 10 client.6300 handle_command_reply: tid=0 2024-09-15T23:15:23.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.970+0000 7f30b4ad1740 1 client.6300 shutdown 2024-09-15T23:15:23.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.970+0000 7f30b4ad1740 1 -- 172.21.15.123:0/2712374300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c30def02c0 msgr2=0x55c30df54550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:23.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.970+0000 7f30b4ad1740 1 --2- 172.21.15.123:0/2712374300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c30def02c0 0x55c30df54550 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f30a0089d60 tx=0x7f30a0059380 comp rx=0 tx=0).stop 2024-09-15T23:15:23.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.970+0000 7f30b4ad1740 1 -- 172.21.15.123:0/2712374300 shutdown_connections 2024-09-15T23:15:23.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.970+0000 7f30b4ad1740 1 --2- 172.21.15.123:0/2712374300 >> [v2:172.21.15.123:6833/2772280632,v1:172.21.15.123:6835/2772280632] conn(0x55c30df37580 0x55c30deee9c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.970+0000 7f30b4ad1740 1 --2- 172.21.15.123:0/2712374300 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c30def1a50 0x55c30df54a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.970+0000 7f308a7fc640 0 client.6300 ms_handle_reset on v2:172.21.15.123:6833/2772280632 2024-09-15T23:15:23.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.970+0000 7f30b4ad1740 1 --2- 172.21.15.123:0/2712374300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c30def02c0 0x55c30df54550 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.970+0000 7f30b4ad1740 1 --2- 172.21.15.123:0/2712374300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c30deeab10 0x55c30df99370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.970+0000 7f30b4ad1740 1 -- 172.21.15.123:0/2712374300 >> 172.21.15.123:0/2712374300 conn(0x55c30deeda80 msgr2=0x55c30df17a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:23.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.971+0000 7f30b4ad1740 1 -- 172.21.15.123:0/2712374300 shutdown_connections 2024-09-15T23:15:23.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.971+0000 7f30b4ad1740 1 -- 172.21.15.123:0/2712374300 wait complete. 2024-09-15T23:15:23.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.971+0000 7f30b4ad1740 20 client.6300 trim_cache size 0 max 16384 2024-09-15T23:15:23.982 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:15:23.982 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "cb968ac4-8d3a-4b17-a673-6177aeaea589", 2024-09-15T23:15:23.982 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2024-09-15T23:15:23.982 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 6165, 2024-09-15T23:15:23.982 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-09-15T23:15:23.982 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-09-15T23:15:23.982 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-09-15T23:15:23.982 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 5.5554532099999996, 2024-09-15T23:15:23.982 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 30, 2024-09-15T23:15:23.983 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 66, 2024-09-15T23:15:23.983 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 66, 2024-09-15T23:15:23.983 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 9.6280012599999996 2024-09-15T23:15:23.983 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:15:23.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.971+0000 7f30b1d31640 1 -- 172.21.15.123:0/3643148968 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f309806c2b0 msgr2=0x7f309806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:23.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.971+0000 7f30b1d31640 1 --2- 172.21.15.123:0/3643148968 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f309806c2b0 0x7f309806e770 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f309c033000 tx=0x7f309c007000 comp rx=0 tx=0).stop 2024-09-15T23:15:23.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.971+0000 7f30b1d31640 1 -- 172.21.15.123:0/3643148968 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30ac1ea0b0 msgr2=0x7f30ac1ea530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:23.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.971+0000 7f30b1d31640 1 --2- 172.21.15.123:0/3643148968 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30ac1ea0b0 0x7f30ac1ea530 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f30a0011d30 tx=0x7f30a000f610 comp rx=0 tx=0).stop 2024-09-15T23:15:23.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.971+0000 7f30b1d31640 1 -- 172.21.15.123:0/3643148968 shutdown_connections 2024-09-15T23:15:23.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.971+0000 7f30b1d31640 1 --2- 172.21.15.123:0/3643148968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30ac1610a0 0x7f30ac161520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.971+0000 7f30b1d31640 1 --2- 172.21.15.123:0/3643148968 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f309806c2b0 0x7f309806e770 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.971+0000 7f30b1d31640 1 --2- 172.21.15.123:0/3643148968 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30ac1ea0b0 0x7f30ac1ea530 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.971+0000 7f30b1d31640 1 --2- 172.21.15.123:0/3643148968 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30940039b0 0x7f30ac159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:23.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.971+0000 7f30b1d31640 1 -- 172.21.15.123:0/3643148968 >> 172.21.15.123:0/3643148968 conn(0x7f30ac0d16d0 msgr2=0x7f30ac0d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:23.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.971+0000 7f30b1d31640 1 -- 172.21.15.123:0/3643148968 shutdown_connections 2024-09-15T23:15:23.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:23.971+0000 7f30b1d31640 1 -- 172.21.15.123:0/3643148968 wait complete. 2024-09-15T23:15:23.986 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:15:24.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.082+0000 7fd4b0742640 1 Processor -- start 2024-09-15T23:15:24.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.082+0000 7fd4b0742640 1 -- start start 2024-09-15T23:15:24.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.083+0000 7fd4b0742640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4a80b02b0 0x7fd4a806e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:24.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.083+0000 7fd4b0742640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4a8067b50 con 0x7fd4a815c4b0 2024-09-15T23:15:24.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.083+0000 7fd4b0742640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4a80ce860 con 0x7fd4a80b6830 2024-09-15T23:15:24.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.083+0000 7fd4b0742640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd4a8070130 con 0x7fd4a80b02b0 2024-09-15T23:15:24.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.083+0000 7fd4ae4de640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd4a815c4b0 0x7fd4a80b6120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58224/0 (socket says 172.21.15.123:58224) 2024-09-15T23:15:24.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.083+0000 7fd4ae4de640 1 -- 172.21.15.123:0/1845527956 learned_addr learned my addr 172.21.15.123:0/1845527956 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:24.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.084+0000 7fd4aecdf640 1 --2- 172.21.15.123:0/1845527956 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4a80b02b0 0x7fd4a806e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:24.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.084+0000 7fd4ad4dc640 1 -- 172.21.15.123:0/1845527956 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2207206535 0 0) 0x7fd4a4001110 con 0x7fd4a815c4b0 2024-09-15T23:15:24.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.084+0000 7fd4ad4dc640 1 -- 172.21.15.123:0/1845527956 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd494003520 con 0x7fd4a815c4b0 2024-09-15T23:15:24.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.084+0000 7fd4ad4dc640 1 -- 172.21.15.123:0/1845527956 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3699485988 0 0) 0x7fd494003520 con 0x7fd4a815c4b0 2024-09-15T23:15:24.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.084+0000 7fd4ad4dc640 1 -- 172.21.15.123:0/1845527956 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4a80b02b0 msgr2=0x7fd4a806e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:24.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.084+0000 7fd4ad4dc640 1 --2- 172.21.15.123:0/1845527956 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4a80b02b0 0x7fd4a806e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:24.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.084+0000 7fd4ad4dc640 1 -- 172.21.15.123:0/1845527956 >> v1:172.21.15.188:6789/0 conn(0x7fd4a80b6830 legacy=0x7fd4a806e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:24.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.084+0000 7fd4ad4dc640 1 -- 172.21.15.123:0/1845527956 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4a806fe50 con 0x7fd4a815c4b0 2024-09-15T23:15:24.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.084+0000 7fd4ad4dc640 1 -- 172.21.15.123:0/1845527956 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fd4a4001840 con 0x7fd4a815c4b0 2024-09-15T23:15:24.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.084+0000 7fd4ad4dc640 1 -- 172.21.15.123:0/1845527956 >> v1:172.21.15.123:6789/0 conn(0x7fd4a815c4b0 legacy=0x7fd4a80b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:24.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.084+0000 7fd4ad4dc640 1 --2- 172.21.15.123:0/1845527956 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4a80b02b0 0x7fd4940039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:24.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.084+0000 7fd4ad4dc640 1 --2- 172.21.15.123:0/1845527956 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd494003f20 0x7fd494004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:24.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.084+0000 7fd4ad4dc640 1 --2- 172.21.15.123:0/1845527956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd494004d40 0x7fd4940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:24.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.084+0000 7fd4ad4dc640 1 -- 172.21.15.123:0/1845527956 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a8070130 con 0x7fd494004d40 2024-09-15T23:15:24.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.084+0000 7fd4ad4dc640 1 -- 172.21.15.123:0/1845527956 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd49400ba20 con 0x7fd494003f20 2024-09-15T23:15:24.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.084+0000 7fd4ad4dc640 1 -- 172.21.15.123:0/1845527956 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd49400bc20 con 0x7fd4a80b02b0 2024-09-15T23:15:24.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.084+0000 7fd4aecdf640 1 --2- 172.21.15.123:0/1845527956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd494004d40 0x7fd4940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:24.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.084+0000 7fd4ae4de640 1 --2- 172.21.15.123:0/1845527956 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4a80b02b0 0x7fd4940039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:24.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.084+0000 7fd4adcdd640 1 --2- 172.21.15.123:0/1845527956 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd494003f20 0x7fd494004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:24.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.084+0000 7fd4aecdf640 1 -- 172.21.15.123:0/1845527956 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4a80b02b0 msgr2=0x7fd4940039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:24.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.084+0000 7fd4aecdf640 1 --2- 172.21.15.123:0/1845527956 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4a80b02b0 0x7fd4940039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:24.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.084+0000 7fd4aecdf640 1 -- 172.21.15.123:0/1845527956 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd494003f20 msgr2=0x7fd494004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:24.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.084+0000 7fd4aecdf640 1 --2- 172.21.15.123:0/1845527956 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd494003f20 0x7fd494004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:24.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.084+0000 7fd4aecdf640 1 -- 172.21.15.123:0/1845527956 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd494003520 con 0x7fd494004d40 2024-09-15T23:15:24.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.085+0000 7fd4aecdf640 1 --2- 172.21.15.123:0/1845527956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd494004d40 0x7fd4940051c0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0009f90 tx=0x7fd494005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=360071cb565cc204 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:24.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.085+0000 7fd4ad4dc640 1 -- 172.21.15.123:0/1845527956 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a0009c10 con 0x7fd494004d40 2024-09-15T23:15:24.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.085+0000 7fd4ad4dc640 1 -- 172.21.15.123:0/1845527956 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4a0036070 con 0x7fd494004d40 2024-09-15T23:15:24.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.085+0000 7fd4ad4dc640 1 -- 172.21.15.123:0/1845527956 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a0031850 con 0x7fd494004d40 2024-09-15T23:15:24.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.086+0000 7fd4b0742640 1 -- 172.21.15.123:0/1845527956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd494004d40 msgr2=0x7fd4940051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:24.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.086+0000 7fd4b0742640 1 --2- 172.21.15.123:0/1845527956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd494004d40 0x7fd4940051c0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0009f90 tx=0x7fd494005830 comp rx=0 tx=0).stop 2024-09-15T23:15:24.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.086+0000 7fd4aecdf640 1 -- 172.21.15.123:0/1845527956 reap_dead start 2024-09-15T23:15:24.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.086+0000 7fd4b0742640 1 -- 172.21.15.123:0/1845527956 shutdown_connections 2024-09-15T23:15:24.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.086+0000 7fd4b0742640 1 -- 172.21.15.123:0/1845527956 >> 172.21.15.123:0/1845527956 conn(0x7fd4a80b0a80 msgr2=0x7fd4a80b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:24.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.086+0000 7fd4b0742640 1 -- 172.21.15.123:0/1845527956 shutdown_connections 2024-09-15T23:15:24.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.086+0000 7fd4b0742640 1 -- 172.21.15.123:0/1845527956 wait complete. 2024-09-15T23:15:24.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.087+0000 7fd4b0742640 1 Processor -- start 2024-09-15T23:15:24.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.087+0000 7fd4b0742640 1 -- start start 2024-09-15T23:15:24.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.088+0000 7fd4b0742640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd494004d40 0x7fd4a8148490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:24.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.088+0000 7fd4b0742640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4a815d510 0x7fd4a81573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:24.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.088+0000 7fd4b0742640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4a815d970 0x7fd4a81578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:24.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.088+0000 7fd4b0742640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a806dcc0 con 0x7fd494004d40 2024-09-15T23:15:24.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.088+0000 7fd4b0742640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd4a80ce580 con 0x7fd4a815d510 2024-09-15T23:15:24.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.088+0000 7fd4b0742640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd4a815c890 con 0x7fd4a815d970 2024-09-15T23:15:24.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.088+0000 7fd4ae4de640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd494004d40 0x7fd4a8148490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:24.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.088+0000 7fd4ae4de640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd494004d40 0x7fd4a8148490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49552/0 (socket says 172.21.15.123:49552) 2024-09-15T23:15:24.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.088+0000 7fd4ae4de640 1 -- 172.21.15.123:0/3176646450 learned_addr learned my addr 172.21.15.123:0/3176646450 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:24.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.088+0000 7fd4ae4de640 1 -- 172.21.15.123:0/3176646450 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4a815d970 msgr2=0x7fd4a81578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:24.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.088+0000 7fd4ae4de640 1 --2- 172.21.15.123:0/3176646450 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4a815d970 0x7fd4a81578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:24.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.088+0000 7fd4ae4de640 1 -- 172.21.15.123:0/3176646450 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4a815d510 msgr2=0x7fd4a81573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:24.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.088+0000 7fd4ae4de640 1 --2- 172.21.15.123:0/3176646450 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4a815d510 0x7fd4a81573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:24.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.088+0000 7fd4ae4de640 1 -- 172.21.15.123:0/3176646450 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4a815eae0 con 0x7fd494004d40 2024-09-15T23:15:24.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.088+0000 7fd4ae4de640 1 --2- 172.21.15.123:0/3176646450 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd494004d40 0x7fd4a8148490 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4007290 tx=0x7fd4a4007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:24.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.088+0000 7fd49effd640 1 -- 172.21.15.123:0/3176646450 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a400f8e0 con 0x7fd494004d40 2024-09-15T23:15:24.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.088+0000 7fd49effd640 1 -- 172.21.15.123:0/3176646450 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4a4018070 con 0x7fd494004d40 2024-09-15T23:15:24.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.088+0000 7fd4b0742640 1 -- 172.21.15.123:0/3176646450 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4a815ded0 con 0x7fd494004d40 2024-09-15T23:15:24.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.088+0000 7fd49effd640 1 -- 172.21.15.123:0/3176646450 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a400fd00 con 0x7fd494004d40 2024-09-15T23:15:24.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.089+0000 7fd4b0742640 1 -- 172.21.15.123:0/3176646450 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4a815e490 con 0x7fd494004d40 2024-09-15T23:15:24.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.090+0000 7fd4b0742640 1 -- 172.21.15.123:0/3176646450 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4a8069400 con 0x7fd494004d40 2024-09-15T23:15:24.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.090+0000 7fd49effd640 1 -- 172.21.15.123:0/3176646450 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd4a401d460 con 0x7fd494004d40 2024-09-15T23:15:24.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.090+0000 7fd49effd640 1 --2- 172.21.15.123:0/3176646450 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd48c06c2e0 0x7fd48c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:24.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.090+0000 7fd49effd640 1 -- 172.21.15.123:0/3176646450 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7fd4a408b440 con 0x7fd494004d40 2024-09-15T23:15:24.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.091+0000 7fd4adcdd640 1 --2- 172.21.15.123:0/3176646450 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd48c06c2e0 0x7fd48c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:24.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.091+0000 7fd4adcdd640 1 --2- 172.21.15.123:0/3176646450 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd48c06c2e0 0x7fd48c06e7a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8151a20 tx=0x7fd498009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:24.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.094+0000 7fd49effd640 1 -- 172.21.15.123:0/3176646450 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd4a8067b50 con 0x7fd494004d40 2024-09-15T23:15:24.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.292+0000 7fd4b0742640 1 -- 172.21.15.123:0/3176646450 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd4a80ce860 con 0x7fd494004d40 2024-09-15T23:15:24.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.293+0000 7fd49effd640 1 -- 172.21.15.123:0/3176646450 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) ==== 53+0+73 (secure 0 0 0) 0x7fd4a4059bb0 con 0x7fd494004d40 2024-09-15T23:15:24.294 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:15:24.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.294+0000 7fd4b0742640 1 -- 172.21.15.123:0/3176646450 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd48c06c2e0 msgr2=0x7fd48c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:24.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.294+0000 7fd4b0742640 1 --2- 172.21.15.123:0/3176646450 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd48c06c2e0 0x7fd48c06e7a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8151a20 tx=0x7fd498009040 comp rx=0 tx=0).stop 2024-09-15T23:15:24.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.294+0000 7fd4b0742640 1 -- 172.21.15.123:0/3176646450 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd494004d40 msgr2=0x7fd4a8148490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:24.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.294+0000 7fd4b0742640 1 --2- 172.21.15.123:0/3176646450 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd494004d40 0x7fd4a8148490 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4007290 tx=0x7fd4a4007750 comp rx=0 tx=0).stop 2024-09-15T23:15:24.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.294+0000 7fd4b0742640 1 -- 172.21.15.123:0/3176646450 shutdown_connections 2024-09-15T23:15:24.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.294+0000 7fd4b0742640 1 --2- 172.21.15.123:0/3176646450 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4a815d970 0x7fd4a81578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:24.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.294+0000 7fd4b0742640 1 --2- 172.21.15.123:0/3176646450 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4a815d510 0x7fd4a81573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:24.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.294+0000 7fd4b0742640 1 --2- 172.21.15.123:0/3176646450 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd48c06c2e0 0x7fd48c06e7a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:24.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.294+0000 7fd4b0742640 1 --2- 172.21.15.123:0/3176646450 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd494004d40 0x7fd4a8148490 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:24.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.294+0000 7fd4b0742640 1 -- 172.21.15.123:0/3176646450 >> 172.21.15.123:0/3176646450 conn(0x7fd4a80b0a80 msgr2=0x7fd4a806f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:24.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.295+0000 7fd4b0742640 1 -- 172.21.15.123:0/3176646450 shutdown_connections 2024-09-15T23:15:24.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24.295+0000 7fd4b0742640 1 -- 172.21.15.123:0/3176646450 wait complete. 2024-09-15T23:15:24.307 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T23:15:24.307 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:15:24.307 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-09-15T23:15:24.307 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T23:15:24.307 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T23:15:24.307 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T23:15:24.307 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T23:15:24.307 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:15:24.307 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:15:24.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:15:24.308 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-09-15T23:15:24.323 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:15:24.323 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:15:24.323 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:15:24.324 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:15:24.324 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-09-15T23:15:24.324 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:15:24.324 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:15:24.324 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-09-15T23:15:24.324 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f0 2024-09-15T23:15:24.324 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:15:24.324 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:15:24.324 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f1 2024-09-15T23:15:24.324 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:15:24.324 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:15:24.324 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:15:24.324 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:15:24.325 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T23:15:24.325 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42616sec preferred_lft 42616sec 2024-09-15T23:15:24.325 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link noprefixroute 2024-09-15T23:15:24.325 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:15:24.325 INFO:teuthology.orchestra.run.smithi123.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:15:24.325 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 46:55:5a:e0:32:4d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:15:24.325 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:15:24.325 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:15:24.325 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::1c6f:d5ff:fe19:ff05/64 scope link 2024-09-15T23:15:24.325 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:15:24.325 INFO:teuthology.orchestra.run.smithi123.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:15:24.325 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 46:55:5a:e0:32:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:15:24.326 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::4455:5aff:fee0:324d/64 scope link 2024-09-15T23:15:24.326 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:15:24.326 INFO:teuthology.orchestra.run.smithi123.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:15:24.326 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether be:c1:f3:63:cb:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:15:24.326 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::bcc1:f3ff:fe63:cb24/64 scope link 2024-09-15T23:15:24.326 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:15:24.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:15:24.326 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:15:24.387 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-09-15T23:15:24.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:15:24.388 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-09-15T23:15:24.445 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-09-15T23:15:24.445 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:15:24.445 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:15:24.445 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:15:24.446 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:15:24.446 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:15:24.446 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:15:24.446 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:15:24.446 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:15:24.446 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:15:24.446 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:15:24.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:15:24.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:15:24.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:15:24.573 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-09-15T23:15:24.588 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T23:15:24.588 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:15:24.588 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:15:24.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:15:24.589 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2024-09-15T23:15:24.658 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:15:24.658 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T23:15:24.714 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:15:24.714 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:15:24.715 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:15:24.770 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T23:15:24.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:15:24.771 DEBUG:teuthology.orchestra.run.smithi123:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:15:24.854 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:15:24.854 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:15:24.855 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:15:24.863 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:15:24.863 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:15:24.863 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:15:24.863 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.188:3300,172.21.15.188:3301" 2024-09-15T23:15:24.863 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T23:15:24.867 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:15:24.868 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:15:24.868 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:15:24.868 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.188:3300,172.21.15.188:3301" 2024-09-15T23:15:24.868 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T23:15:24.868 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:6789,172.21.15.188:6789,172.21.15.188:6790" 2024-09-15T23:15:24.868 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.123:6789,172.21.15.188:6789,172.21.15.188:6790:/ 2024-09-15T23:15:24.868 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=cb968ac4-8d3a-4b17-a673-6177aeaea589" will pass to kernel 2024-09-15T23:15:24.869 INFO:teuthology.orchestra.run.smithi123.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-15T23:15:24.872 INFO:teuthology.orchestra.run.smithi123.stdout: You just mounted a file system that supports labels which does not 2024-09-15T23:15:24.872 INFO:teuthology.orchestra.run.smithi123.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T23:15:24.872 INFO:teuthology.orchestra.run.smithi123.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T23:15:24.872 INFO:teuthology.orchestra.run.smithi123.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T23:15:24.873 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T23:15:24.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:15:24.873 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:15:24.897 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T23:15:24.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:15:24.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:15:24.997 INFO:teuthology.orchestra.run.smithi123.stdout:client6309 2024-09-15T23:15:24.998 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:15:24.998 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:15:25.014 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_size 20 2024-09-15T23:15:25.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.154+0000 7f7bf5559640 1 Processor -- start 2024-09-15T23:15:25.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.155+0000 7f7bf5559640 1 -- start start 2024-09-15T23:15:25.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.155+0000 7f7bf5559640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7bf006bc10 0x7f7bf006bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:25.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.155+0000 7f7bf5559640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7bf00d0320 0x7f7bf006e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:25.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.155+0000 7f7bf5559640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bf006c530 con 0x7f7bf0073f40 2024-09-15T23:15:25.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.155+0000 7f7bf5559640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f7bf00cd140 con 0x7f7bf00d0320 2024-09-15T23:15:25.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.155+0000 7f7bf5559640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f7bf006e0f0 con 0x7f7bf006bc10 2024-09-15T23:15:25.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.155+0000 7f7bef7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7bf00d0320 0x7f7bf006e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:25.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.156+0000 7f7bef7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7bf00d0320 0x7f7bf006e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49566/0 (socket says 172.21.15.123:49566) 2024-09-15T23:15:25.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.156+0000 7f7bef7fe640 1 -- 172.21.15.123:0/3899971852 learned_addr learned my addr 172.21.15.123:0/3899971852 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:25.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.156+0000 7f7bee7fc640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7bf0073f40 0x7f7bf01624b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58236/0 (socket says 172.21.15.123:58236) 2024-09-15T23:15:25.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.156+0000 7f7beeffd640 1 --2- 172.21.15.123:0/3899971852 >> v2:172.21.15.188:3300/0 conn(0x7f7bf006bc10 0x7f7bf006bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:25.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.156+0000 7f7bef7fe640 1 -- 172.21.15.123:0/3899971852 >> v2:172.21.15.188:3300/0 conn(0x7f7bf006bc10 msgr2=0x7f7bf006bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:25.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.156+0000 7f7bef7fe640 1 --2- 172.21.15.123:0/3899971852 >> v2:172.21.15.188:3300/0 conn(0x7f7bf006bc10 0x7f7bf006bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:25.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.156+0000 7f7bef7fe640 1 -- 172.21.15.123:0/3899971852 >> v1:172.21.15.123:6789/0 conn(0x7f7bf0073f40 legacy=0x7f7bf01624b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:25.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.156+0000 7f7bef7fe640 1 -- 172.21.15.123:0/3899971852 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf00cd370 con 0x7f7bf00d0320 2024-09-15T23:15:25.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.156+0000 7f7bedffb640 1 -- 172.21.15.123:0/3899971852 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1095815481 0 0) 0x7f7bf006c530 con 0x7f7bf0073f40 2024-09-15T23:15:25.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.156+0000 7f7beeffd640 1 --2- 172.21.15.123:0/3899971852 >> v2:172.21.15.188:3300/0 conn(0x7f7bf006bc10 0x7f7bf006bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:25.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.157+0000 7f7bef7fe640 1 --2- 172.21.15.123:0/3899971852 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7bf00d0320 0x7f7bf006e580 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f7bf006b0d0 tx=0x7f7be802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a20e5fdeb339453c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:25.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.157+0000 7f7bedffb640 1 -- 172.21.15.123:0/3899971852 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be8037070 con 0x7f7bf00d0320 2024-09-15T23:15:25.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.157+0000 7f7bedffb640 1 -- 172.21.15.123:0/3899971852 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7be8032440 con 0x7f7bf00d0320 2024-09-15T23:15:25.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.157+0000 7f7bedffb640 1 -- 172.21.15.123:0/3899971852 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be8032810 con 0x7f7bf00d0320 2024-09-15T23:15:25.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.157+0000 7f7bf5559640 1 -- 172.21.15.123:0/3899971852 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7bf00d0320 msgr2=0x7f7bf006e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:25.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.157+0000 7f7bf5559640 1 --2- 172.21.15.123:0/3899971852 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7bf00d0320 0x7f7bf006e580 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f7bf006b0d0 tx=0x7f7be802a270 comp rx=0 tx=0).stop 2024-09-15T23:15:25.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.157+0000 7f7bf5559640 1 -- 172.21.15.123:0/3899971852 shutdown_connections 2024-09-15T23:15:25.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.157+0000 7f7bf5559640 1 --2- 172.21.15.123:0/3899971852 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7bf00d0320 0x7f7bf006e580 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:25.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.157+0000 7f7bf5559640 1 --2- 172.21.15.123:0/3899971852 >> v2:172.21.15.188:3300/0 conn(0x7f7bf006bc10 0x7f7bf006bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:25.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.157+0000 7f7bf5559640 1 -- 172.21.15.123:0/3899971852 >> 172.21.15.123:0/3899971852 conn(0x7f7bf00d1530 msgr2=0x7f7bf00d1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:25.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.157+0000 7f7bf5559640 1 -- 172.21.15.123:0/3899971852 shutdown_connections 2024-09-15T23:15:25.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.157+0000 7f7bf5559640 1 -- 172.21.15.123:0/3899971852 wait complete. 2024-09-15T23:15:25.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.159+0000 7f7bf5559640 1 Processor -- start 2024-09-15T23:15:25.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.159+0000 7f7bf5559640 1 -- start start 2024-09-15T23:15:25.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.159+0000 7f7bf5559640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7bf006bc10 0x7f7bf0154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:25.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.159+0000 7f7bf5559640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7bf0073f40 0x7f7bf0160b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:25.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.159+0000 7f7bf5559640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7bf00d0320 0x7f7bf00afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:25.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.159+0000 7f7bf5559640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf00cdc10 con 0x7f7bf006bc10 2024-09-15T23:15:25.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.159+0000 7f7bf5559640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf00cd930 con 0x7f7bf00d0320 2024-09-15T23:15:25.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.159+0000 7f7bf5559640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7bf00c4d50 con 0x7f7bf0073f40 2024-09-15T23:15:25.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.159+0000 7f7beeffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7bf006bc10 0x7f7bf0154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:25.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.159+0000 7f7beeffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7bf006bc10 0x7f7bf0154b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49568/0 (socket says 172.21.15.123:49568) 2024-09-15T23:15:25.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.159+0000 7f7beeffd640 1 -- 172.21.15.123:0/3730561067 learned_addr learned my addr 172.21.15.123:0/3730561067 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:25.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.160+0000 7f7bef7fe640 1 --2- 172.21.15.123:0/3730561067 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7bf00d0320 0x7f7bf00afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:25.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.160+0000 7f7bee7fc640 1 --2- 172.21.15.123:0/3730561067 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7bf0073f40 0x7f7bf0160b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:25.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.160+0000 7f7beeffd640 1 -- 172.21.15.123:0/3730561067 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7bf0073f40 msgr2=0x7f7bf0160b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:25.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.160+0000 7f7beeffd640 1 --2- 172.21.15.123:0/3730561067 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7bf0073f40 0x7f7bf0160b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:25.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.160+0000 7f7beeffd640 1 -- 172.21.15.123:0/3730561067 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7bf00d0320 msgr2=0x7f7bf00afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:25.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.160+0000 7f7beeffd640 1 --2- 172.21.15.123:0/3730561067 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7bf00d0320 0x7f7bf00afdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:25.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.160+0000 7f7beeffd640 1 -- 172.21.15.123:0/3730561067 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf00c9bc0 con 0x7f7bf006bc10 2024-09-15T23:15:25.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.160+0000 7f7bee7fc640 1 --2- 172.21.15.123:0/3730561067 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7bf0073f40 0x7f7bf0160b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:25.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.160+0000 7f7beeffd640 1 --2- 172.21.15.123:0/3730561067 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7bf006bc10 0x7f7bf0154b00 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f7be000cf60 tx=0x7f7be000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:25.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.160+0000 7f7be77fe640 1 -- 172.21.15.123:0/3730561067 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be001a070 con 0x7f7bf006bc10 2024-09-15T23:15:25.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.160+0000 7f7be77fe640 1 -- 172.21.15.123:0/3730561067 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7be000d840 con 0x7f7bf006bc10 2024-09-15T23:15:25.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.160+0000 7f7bf5559640 1 -- 172.21.15.123:0/3730561067 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bf00c9ea0 con 0x7f7bf006bc10 2024-09-15T23:15:25.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.160+0000 7f7be77fe640 1 -- 172.21.15.123:0/3730561067 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be000dc10 con 0x7f7bf006bc10 2024-09-15T23:15:25.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.160+0000 7f7bf5559640 1 -- 172.21.15.123:0/3730561067 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bf00ca460 con 0x7f7bf006bc10 2024-09-15T23:15:25.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.161+0000 7f7bf5559640 1 -- 172.21.15.123:0/3730561067 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bf00d0870 con 0x7f7bf006bc10 2024-09-15T23:15:25.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.161+0000 7f7be77fe640 1 -- 172.21.15.123:0/3730561067 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7be001d070 con 0x7f7bf006bc10 2024-09-15T23:15:25.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.162+0000 7f7be77fe640 1 --2- 172.21.15.123:0/3730561067 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7bd006c2b0 0x7f7bd006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:25.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.162+0000 7f7be77fe640 1 -- 172.21.15.123:0/3730561067 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7f7be008bbf0 con 0x7f7bf006bc10 2024-09-15T23:15:25.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.162+0000 7f7bee7fc640 1 --2- 172.21.15.123:0/3730561067 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7bd006c2b0 0x7f7bd006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:25.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.163+0000 7f7bee7fc640 1 --2- 172.21.15.123:0/3730561067 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7bd006c2b0 0x7f7bd006e770 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7bf00c8360 tx=0x7f7bd8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:25.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.166+0000 7f7be77fe640 1 -- 172.21.15.123:0/3730561067 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7be0059da0 con 0x7f7bf006bc10 2024-09-15T23:15:25.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.334+0000 7f7bf5559640 1 -- 172.21.15.123:0/3730561067 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f7bf00b74b0 con 0x7f7bf006bc10 2024-09-15T23:15:25.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.337+0000 7f7be77fe640 1 -- 172.21.15.123:0/3730561067 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v15)=0 v15) ==== 117+0+0 (secure 0 0 0) 0x7f7be005e0a0 con 0x7f7bf006bc10 2024-09-15T23:15:25.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.340+0000 7f7bf5559640 1 -- 172.21.15.123:0/3730561067 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7bd006c2b0 msgr2=0x7f7bd006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:25.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.340+0000 7f7bf5559640 1 --2- 172.21.15.123:0/3730561067 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7bd006c2b0 0x7f7bd006e770 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7bf00c8360 tx=0x7f7bd8009040 comp rx=0 tx=0).stop 2024-09-15T23:15:25.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.340+0000 7f7bf5559640 1 -- 172.21.15.123:0/3730561067 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7bf006bc10 msgr2=0x7f7bf0154b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:25.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.340+0000 7f7bf5559640 1 --2- 172.21.15.123:0/3730561067 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7bf006bc10 0x7f7bf0154b00 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f7be000cf60 tx=0x7f7be000cf90 comp rx=0 tx=0).stop 2024-09-15T23:15:25.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.340+0000 7f7bf5559640 1 -- 172.21.15.123:0/3730561067 shutdown_connections 2024-09-15T23:15:25.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.340+0000 7f7bf5559640 1 --2- 172.21.15.123:0/3730561067 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7bf00d0320 0x7f7bf00afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:25.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.340+0000 7f7bf5559640 1 --2- 172.21.15.123:0/3730561067 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7bf0073f40 0x7f7bf0160b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:25.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.340+0000 7f7bf5559640 1 --2- 172.21.15.123:0/3730561067 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7bd006c2b0 0x7f7bd006e770 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:25.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.340+0000 7f7bf5559640 1 --2- 172.21.15.123:0/3730561067 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7bf006bc10 0x7f7bf0154b00 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:25.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.340+0000 7f7bf5559640 1 -- 172.21.15.123:0/3730561067 >> 172.21.15.123:0/3730561067 conn(0x7f7bf00d1530 msgr2=0x7f7bf00728e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:25.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.340+0000 7f7bf5559640 1 -- 172.21.15.123:0/3730561067 shutdown_connections 2024-09-15T23:15:25.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.340+0000 7f7bf5559640 1 -- 172.21.15.123:0/3730561067 wait complete. 2024-09-15T23:15:25.352 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_merge_size 5 2024-09-15T23:15:25.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.453+0000 7f073b92c640 1 Processor -- start 2024-09-15T23:15:25.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.453+0000 7f073b92c640 1 -- start start 2024-09-15T23:15:25.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.454+0000 7f073b92c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f07340b6e00 0x7f07340d3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:25.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.454+0000 7f073b92c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f0734162d90 0x7f07340b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:25.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.454+0000 7f073b92c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f073415ec10 con 0x7f0734071160 2024-09-15T23:15:25.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.454+0000 7f073b92c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f073406e7f0 con 0x7f0734162d90 2024-09-15T23:15:25.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.454+0000 7f073b92c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f07341631d0 con 0x7f07340b6e00 2024-09-15T23:15:25.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.454+0000 7f07396c8640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f07340b6e00 0x7f07340d3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:25.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.454+0000 7f0738ec7640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f0734162d90 0x7f07340b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:25.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.454+0000 7f0739ec9640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f0734071160 0x7f073406cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:52450/0 (socket says 172.21.15.123:52450) 2024-09-15T23:15:25.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.454+0000 7f0739ec9640 1 -- 172.21.15.123:0/2543950518 learned_addr learned my addr 172.21.15.123:0/2543950518 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:25.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.454+0000 7f07396c8640 1 -- 172.21.15.123:0/2543950518 >> v2:172.21.15.188:3300/0 conn(0x7f0734162d90 msgr2=0x7f07340b71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:25.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.454+0000 7f07396c8640 1 --2- 172.21.15.123:0/2543950518 >> v2:172.21.15.188:3300/0 conn(0x7f0734162d90 0x7f07340b71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:25.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.454+0000 7f07396c8640 1 -- 172.21.15.123:0/2543950518 >> v1:172.21.15.188:6789/0 conn(0x7f0734071160 legacy=0x7f073406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:25.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.454+0000 7f07396c8640 1 -- 172.21.15.123:0/2543950518 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f073406ed20 con 0x7f07340b6e00 2024-09-15T23:15:25.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.454+0000 7f0738ec7640 1 --2- 172.21.15.123:0/2543950518 >> v2:172.21.15.188:3300/0 conn(0x7f0734162d90 0x7f07340b71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:15:25.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.455+0000 7f07396c8640 1 --2- 172.21.15.123:0/2543950518 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f07340b6e00 0x7f07340d3040 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f07300097a0 tx=0x7f073002a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9210528712f55164 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:25.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.455+0000 7f072bfff640 1 -- 172.21.15.123:0/2543950518 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0730037070 con 0x7f07340b6e00 2024-09-15T23:15:25.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.455+0000 7f072bfff640 1 -- 172.21.15.123:0/2543950518 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f073002adb0 con 0x7f07340b6e00 2024-09-15T23:15:25.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.455+0000 7f072bfff640 1 -- 172.21.15.123:0/2543950518 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0730032660 con 0x7f07340b6e00 2024-09-15T23:15:25.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.456+0000 7f073b92c640 1 -- 172.21.15.123:0/2543950518 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f07340b6e00 msgr2=0x7f07340d3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:25.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.456+0000 7f073b92c640 1 --2- 172.21.15.123:0/2543950518 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f07340b6e00 0x7f07340d3040 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f07300097a0 tx=0x7f073002a060 comp rx=0 tx=0).stop 2024-09-15T23:15:25.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.456+0000 7f073b92c640 1 -- 172.21.15.123:0/2543950518 shutdown_connections 2024-09-15T23:15:25.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.456+0000 7f073b92c640 1 --2- 172.21.15.123:0/2543950518 >> v2:172.21.15.188:3300/0 conn(0x7f0734162d90 0x7f07340b71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:25.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.456+0000 7f073b92c640 1 --2- 172.21.15.123:0/2543950518 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f07340b6e00 0x7f07340d3040 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:25.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.456+0000 7f073b92c640 1 -- 172.21.15.123:0/2543950518 >> 172.21.15.123:0/2543950518 conn(0x7f07340d2550 msgr2=0x7f07340d2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:25.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.456+0000 7f073b92c640 1 -- 172.21.15.123:0/2543950518 shutdown_connections 2024-09-15T23:15:25.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.456+0000 7f073b92c640 1 -- 172.21.15.123:0/2543950518 wait complete. 2024-09-15T23:15:25.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.457+0000 7f073b92c640 1 Processor -- start 2024-09-15T23:15:25.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.457+0000 7f073b92c640 1 -- start start 2024-09-15T23:15:25.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.458+0000 7f073b92c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0734071160 0x7f0734161720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:25.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.458+0000 7f073b92c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f07340b6e00 0x7f07341f4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:25.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.458+0000 7f073b92c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0734162d90 0x7f073415ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:25.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.458+0000 7f073b92c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0734070960 con 0x7f0734162d90 2024-09-15T23:15:25.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.458+0000 7f073b92c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f073406ea40 con 0x7f07340b6e00 2024-09-15T23:15:25.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.458+0000 7f073b92c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0734070c40 con 0x7f0734071160 2024-09-15T23:15:25.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.458+0000 7f0739ec9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0734162d90 0x7f073415ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:25.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.458+0000 7f0739ec9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0734162d90 0x7f073415ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49578/0 (socket says 172.21.15.123:49578) 2024-09-15T23:15:25.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.458+0000 7f0739ec9640 1 -- 172.21.15.123:0/1844143438 learned_addr learned my addr 172.21.15.123:0/1844143438 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:25.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.458+0000 7f0738ec7640 1 --2- 172.21.15.123:0/1844143438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f07340b6e00 0x7f07341f4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:25.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.458+0000 7f07396c8640 1 --2- 172.21.15.123:0/1844143438 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0734071160 0x7f0734161720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:25.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.458+0000 7f0739ec9640 1 -- 172.21.15.123:0/1844143438 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0734071160 msgr2=0x7f0734161720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:25.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.458+0000 7f0739ec9640 1 --2- 172.21.15.123:0/1844143438 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0734071160 0x7f0734161720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:25.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.458+0000 7f0739ec9640 1 -- 172.21.15.123:0/1844143438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f07340b6e00 msgr2=0x7f07341f4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:25.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.458+0000 7f0739ec9640 1 --2- 172.21.15.123:0/1844143438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f07340b6e00 0x7f07341f4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.458+0000 7f0739ec9640 1 -- 172.21.15.123:0/1844143438 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f073415fcf0 con 0x7f0734162d90 2024-09-15T23:15:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.459+0000 7f0739ec9640 1 --2- 172.21.15.123:0/1844143438 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0734162d90 0x7f073415ba40 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f072c00cbc0 tx=0x7f072c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.459+0000 7f0729ffb640 1 -- 172.21.15.123:0/1844143438 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072c017070 con 0x7f0734162d90 2024-09-15T23:15:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.459+0000 7f0729ffb640 1 -- 172.21.15.123:0/1844143438 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f072c00ace0 con 0x7f0734162d90 2024-09-15T23:15:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.459+0000 7f073b92c640 1 -- 172.21.15.123:0/1844143438 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0734160c40 con 0x7f0734162d90 2024-09-15T23:15:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.459+0000 7f0729ffb640 1 -- 172.21.15.123:0/1844143438 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f072c012600 con 0x7f0734162d90 2024-09-15T23:15:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.459+0000 7f073b92c640 1 -- 172.21.15.123:0/1844143438 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0734161200 con 0x7f0734162d90 2024-09-15T23:15:25.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.460+0000 7f073b92c640 1 -- 172.21.15.123:0/1844143438 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07340d1a70 con 0x7f0734162d90 2024-09-15T23:15:25.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.460+0000 7f0729ffb640 1 -- 172.21.15.123:0/1844143438 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f072c01a070 con 0x7f0734162d90 2024-09-15T23:15:25.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.461+0000 7f0729ffb640 1 --2- 172.21.15.123:0/1844143438 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f071806c2b0 0x7f071806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:25.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.461+0000 7f0729ffb640 1 -- 172.21.15.123:0/1844143438 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7f072c08b040 con 0x7f0734162d90 2024-09-15T23:15:25.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.461+0000 7f07396c8640 1 --2- 172.21.15.123:0/1844143438 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f071806c2b0 0x7f071806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:25.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.462+0000 7f07396c8640 1 --2- 172.21.15.123:0/1844143438 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f071806c2b0 0x7f071806e770 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0730034000 tx=0x7f073002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:25.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.465+0000 7f0729ffb640 1 -- 172.21.15.123:0/1844143438 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f072c0591f0 con 0x7f0734162d90 2024-09-15T23:15:25.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.633+0000 7f073b92c640 1 -- 172.21.15.123:0/1844143438 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f073406de40 con 0x7f0734162d90 2024-09-15T23:15:25.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.637+0000 7f0729ffb640 1 -- 172.21.15.123:0/1844143438 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v16)=0 v16) ==== 116+0+0 (secure 0 0 0) 0x7f072c05d4f0 con 0x7f0734162d90 2024-09-15T23:15:25.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.639+0000 7f073b92c640 1 -- 172.21.15.123:0/1844143438 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f071806c2b0 msgr2=0x7f071806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:25.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.639+0000 7f073b92c640 1 --2- 172.21.15.123:0/1844143438 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f071806c2b0 0x7f071806e770 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0730034000 tx=0x7f073002e000 comp rx=0 tx=0).stop 2024-09-15T23:15:25.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.639+0000 7f073b92c640 1 -- 172.21.15.123:0/1844143438 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0734162d90 msgr2=0x7f073415ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:25.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.639+0000 7f073b92c640 1 --2- 172.21.15.123:0/1844143438 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0734162d90 0x7f073415ba40 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f072c00cbc0 tx=0x7f072c00a430 comp rx=0 tx=0).stop 2024-09-15T23:15:25.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.639+0000 7f073b92c640 1 -- 172.21.15.123:0/1844143438 shutdown_connections 2024-09-15T23:15:25.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.639+0000 7f073b92c640 1 --2- 172.21.15.123:0/1844143438 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f071806c2b0 0x7f071806e770 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:25.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.639+0000 7f073b92c640 1 --2- 172.21.15.123:0/1844143438 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0734162d90 0x7f073415ba40 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:25.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.639+0000 7f073b92c640 1 --2- 172.21.15.123:0/1844143438 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f07340b6e00 0x7f07341f4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:25.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.639+0000 7f073b92c640 1 --2- 172.21.15.123:0/1844143438 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0734071160 0x7f0734161720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:25.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.639+0000 7f073b92c640 1 -- 172.21.15.123:0/1844143438 >> 172.21.15.123:0/1844143438 conn(0x7f07340d2550 msgr2=0x7f07340b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:25.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.639+0000 7f073b92c640 1 -- 172.21.15.123:0/1844143438 shutdown_connections 2024-09-15T23:15:25.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.639+0000 7f073b92c640 1 -- 172.21.15.123:0/1844143438 wait complete. 2024-09-15T23:15:25.651 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_bits 1 2024-09-15T23:15:25.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.751+0000 7eff5596d640 1 Processor -- start 2024-09-15T23:15:25.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.751+0000 7eff5596d640 1 -- start start 2024-09-15T23:15:25.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.752+0000 7eff5596d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7eff5015c690 0x7eff500ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:25.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.752+0000 7eff5596d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7eff500b7320 0x7eff5006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:25.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.752+0000 7eff5596d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff500b5a80 con 0x7eff5006c150 2024-09-15T23:15:25.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.752+0000 7eff5596d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7eff500b6620 con 0x7eff500b7320 2024-09-15T23:15:25.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.752+0000 7eff5596d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7eff500b6ab0 con 0x7eff5015c690 2024-09-15T23:15:25.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.752+0000 7eff467fc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7eff500b7320 0x7eff5006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:25.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.752+0000 7eff467fc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7eff500b7320 0x7eff5006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49594/0 (socket says 172.21.15.123:49594) 2024-09-15T23:15:25.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.752+0000 7eff467fc640 1 -- 172.21.15.123:0/3988857324 learned_addr learned my addr 172.21.15.123:0/3988857324 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:25.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.752+0000 7eff4f7fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7eff5006c150 0x7eff500b4660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58248/0 (socket says 172.21.15.123:58248) 2024-09-15T23:15:25.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.752+0000 7eff467fc640 1 -- 172.21.15.123:0/3988857324 >> v2:172.21.15.188:3300/0 conn(0x7eff5015c690 msgr2=0x7eff500ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:25.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.752+0000 7eff4effd640 1 --2- 172.21.15.123:0/3988857324 >> v2:172.21.15.188:3300/0 conn(0x7eff5015c690 0x7eff500ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:25.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.752+0000 7eff467fc640 1 --2- 172.21.15.123:0/3988857324 >> v2:172.21.15.188:3300/0 conn(0x7eff5015c690 0x7eff500ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:25.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.752+0000 7eff467fc640 1 -- 172.21.15.123:0/3988857324 >> v1:172.21.15.123:6789/0 conn(0x7eff5006c150 legacy=0x7eff500b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:25.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.752+0000 7eff467fc640 1 -- 172.21.15.123:0/3988857324 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff500b5cf0 con 0x7eff500b7320 2024-09-15T23:15:25.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.752+0000 7eff4e7fc640 1 -- 172.21.15.123:0/3988857324 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 588152970 0 0) 0x7eff500b5a80 con 0x7eff5006c150 2024-09-15T23:15:25.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.752+0000 7eff4effd640 1 --2- 172.21.15.123:0/3988857324 >> v2:172.21.15.188:3300/0 conn(0x7eff5015c690 0x7eff500ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:25.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.753+0000 7eff467fc640 1 --2- 172.21.15.123:0/3988857324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff500b7320 0x7eff5006bc10 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7eff5006c8d0 tx=0x7eff3802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f50fa7b7d970291 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:25.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.753+0000 7eff4e7fc640 1 -- 172.21.15.123:0/3988857324 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff38037070 con 0x7eff500b7320 2024-09-15T23:15:25.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.753+0000 7eff4e7fc640 1 -- 172.21.15.123:0/3988857324 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff38032440 con 0x7eff500b7320 2024-09-15T23:15:25.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.753+0000 7eff4e7fc640 1 -- 172.21.15.123:0/3988857324 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff38032810 con 0x7eff500b7320 2024-09-15T23:15:25.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.754+0000 7eff5596d640 1 -- 172.21.15.123:0/3988857324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff500b7320 msgr2=0x7eff5006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:25.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.754+0000 7eff5596d640 1 --2- 172.21.15.123:0/3988857324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff500b7320 0x7eff5006bc10 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7eff5006c8d0 tx=0x7eff3802a270 comp rx=0 tx=0).stop 2024-09-15T23:15:25.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.754+0000 7eff5596d640 1 -- 172.21.15.123:0/3988857324 shutdown_connections 2024-09-15T23:15:25.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.754+0000 7eff5596d640 1 --2- 172.21.15.123:0/3988857324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff500b7320 0x7eff5006bc10 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:25.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.754+0000 7eff5596d640 1 --2- 172.21.15.123:0/3988857324 >> v2:172.21.15.188:3300/0 conn(0x7eff5015c690 0x7eff500ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:25.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.754+0000 7eff5596d640 1 -- 172.21.15.123:0/3988857324 >> 172.21.15.123:0/3988857324 conn(0x7eff5006cd20 msgr2=0x7eff5006d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:25.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.754+0000 7eff5596d640 1 -- 172.21.15.123:0/3988857324 shutdown_connections 2024-09-15T23:15:25.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.754+0000 7eff5596d640 1 -- 172.21.15.123:0/3988857324 wait complete. 2024-09-15T23:15:25.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.755+0000 7eff5596d640 1 Processor -- start 2024-09-15T23:15:25.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.755+0000 7eff5596d640 1 -- start start 2024-09-15T23:15:25.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.756+0000 7eff5596d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7eff5006c150 0x7eff50149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:25.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.756+0000 7eff5596d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7eff500b7320 0x7eff50157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:25.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.756+0000 7eff5596d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff5015c690 0x7eff501581c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:25.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.756+0000 7eff5596d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7eff5015da80 con 0x7eff5015c690 2024-09-15T23:15:25.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.756+0000 7eff5596d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7eff500b62b0 con 0x7eff500b7320 2024-09-15T23:15:25.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.756+0000 7eff5596d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7eff5015dc00 con 0x7eff5006c150 2024-09-15T23:15:25.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.756+0000 7eff4f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff5015c690 0x7eff501581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:25.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.756+0000 7eff4f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff5015c690 0x7eff501581c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49610/0 (socket says 172.21.15.123:49610) 2024-09-15T23:15:25.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.756+0000 7eff4f7fe640 1 -- 172.21.15.123:0/2597182490 learned_addr learned my addr 172.21.15.123:0/2597182490 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:25.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.756+0000 7eff467fc640 1 --2- 172.21.15.123:0/2597182490 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7eff500b7320 0x7eff50157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:25.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.756+0000 7eff4effd640 1 --2- 172.21.15.123:0/2597182490 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7eff5006c150 0x7eff50149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:25.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.756+0000 7eff4f7fe640 1 -- 172.21.15.123:0/2597182490 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7eff5006c150 msgr2=0x7eff50149df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:25.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.756+0000 7eff4f7fe640 1 --2- 172.21.15.123:0/2597182490 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7eff5006c150 0x7eff50149df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:25.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.756+0000 7eff4f7fe640 1 -- 172.21.15.123:0/2597182490 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7eff500b7320 msgr2=0x7eff50157c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:25.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.756+0000 7eff4f7fe640 1 --2- 172.21.15.123:0/2597182490 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7eff500b7320 0x7eff50157c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:25.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.756+0000 7eff4f7fe640 1 -- 172.21.15.123:0/2597182490 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff5014a330 con 0x7eff5015c690 2024-09-15T23:15:25.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.756+0000 7eff4f7fe640 1 --2- 172.21.15.123:0/2597182490 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff5015c690 0x7eff501581c0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7eff4800c7a0 tx=0x7eff4800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:25.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.757+0000 7eff4cff9640 1 -- 172.21.15.123:0/2597182490 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff48018070 con 0x7eff5015c690 2024-09-15T23:15:25.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.757+0000 7eff4cff9640 1 -- 172.21.15.123:0/2597182490 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff4800a640 con 0x7eff5015c690 2024-09-15T23:15:25.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.757+0000 7eff4cff9640 1 -- 172.21.15.123:0/2597182490 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4800aab0 con 0x7eff5015c690 2024-09-15T23:15:25.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.757+0000 7eff5596d640 1 -- 172.21.15.123:0/2597182490 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff500c7380 con 0x7eff5015c690 2024-09-15T23:15:25.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.757+0000 7eff5596d640 1 -- 172.21.15.123:0/2597182490 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff500c7940 con 0x7eff5015c690 2024-09-15T23:15:25.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.758+0000 7eff5596d640 1 -- 172.21.15.123:0/2597182490 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff5006f780 con 0x7eff5015c690 2024-09-15T23:15:25.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.758+0000 7eff4cff9640 1 -- 172.21.15.123:0/2597182490 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7eff4801b070 con 0x7eff5015c690 2024-09-15T23:15:25.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.759+0000 7eff4cff9640 1 --2- 172.21.15.123:0/2597182490 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7eff3006c2b0 0x7eff3006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:25.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.759+0000 7eff4cff9640 1 -- 172.21.15.123:0/2597182490 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7eff4808a9f0 con 0x7eff5015c690 2024-09-15T23:15:25.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.759+0000 7eff4effd640 1 --2- 172.21.15.123:0/2597182490 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7eff3006c2b0 0x7eff3006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:25.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.759+0000 7eff4effd640 1 --2- 172.21.15.123:0/2597182490 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7eff3006c2b0 0x7eff3006e770 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7eff4000a950 tx=0x7eff40008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:25.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.763+0000 7eff4cff9640 1 -- 172.21.15.123:0/2597182490 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7eff480591f0 con 0x7eff5015c690 2024-09-15T23:15:25.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.927+0000 7eff5596d640 1 -- 172.21.15.123:0/2597182490 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7eff500cecc0 con 0x7eff5015c690 2024-09-15T23:15:25.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.931+0000 7eff4cff9640 1 -- 172.21.15.123:0/2597182490 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v17)=0 v17) ==== 116+0+0 (secure 0 0 0) 0x7eff48058af0 con 0x7eff5015c690 2024-09-15T23:15:25.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.933+0000 7eff5596d640 1 -- 172.21.15.123:0/2597182490 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7eff3006c2b0 msgr2=0x7eff3006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:25.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.933+0000 7eff5596d640 1 --2- 172.21.15.123:0/2597182490 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7eff3006c2b0 0x7eff3006e770 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7eff4000a950 tx=0x7eff40008040 comp rx=0 tx=0).stop 2024-09-15T23:15:25.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.933+0000 7eff5596d640 1 -- 172.21.15.123:0/2597182490 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff5015c690 msgr2=0x7eff501581c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:25.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.933+0000 7eff5596d640 1 --2- 172.21.15.123:0/2597182490 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff5015c690 0x7eff501581c0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7eff4800c7a0 tx=0x7eff4800cc60 comp rx=0 tx=0).stop 2024-09-15T23:15:25.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.933+0000 7eff5596d640 1 -- 172.21.15.123:0/2597182490 shutdown_connections 2024-09-15T23:15:25.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.933+0000 7eff5596d640 1 --2- 172.21.15.123:0/2597182490 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7eff3006c2b0 0x7eff3006e770 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:25.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.933+0000 7eff5596d640 1 --2- 172.21.15.123:0/2597182490 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff5015c690 0x7eff501581c0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:25.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.933+0000 7eff5596d640 1 --2- 172.21.15.123:0/2597182490 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7eff500b7320 0x7eff50157c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:25.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.933+0000 7eff5596d640 1 --2- 172.21.15.123:0/2597182490 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7eff5006c150 0x7eff50149df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:25.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.933+0000 7eff5596d640 1 -- 172.21.15.123:0/2597182490 >> 172.21.15.123:0/2597182490 conn(0x7eff5006cd20 msgr2=0x7eff5006ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:25.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.933+0000 7eff5596d640 1 -- 172.21.15.123:0/2597182490 shutdown_connections 2024-09-15T23:15:25.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:25.933+0000 7eff5596d640 1 -- 172.21.15.123:0/2597182490 wait complete. 2024-09-15T23:15:25.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:15:25.945 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2024-09-15T23:15:25.964 DEBUG:teuthology.orchestra.run.smithi123:> stdin-killer -- python3 -c ' 2024-09-15T23:15:25.965 DEBUG:teuthology.orchestra.run.smithi123:> import os 2024-09-15T23:15:25.965 DEBUG:teuthology.orchestra.run.smithi123:> import stat 2024-09-15T23:15:25.965 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-15T23:15:25.965 DEBUG:teuthology.orchestra.run.smithi123:> print(os.stat("/home/ubuntu/cephtest/mnt.0/testdir").st_ino) 2024-09-15T23:15:25.965 DEBUG:teuthology.orchestra.run.smithi123:> ' 2024-09-15T23:15:26.070 INFO:teuthology.orchestra.run.smithi123.stdout:1099511627776 2024-09-15T23:15:26.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:15:26.079 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:15:26.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.216+0000 7f68f6d78640 1 Processor -- start 2024-09-15T23:15:26.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.216+0000 7f68f6d78640 1 -- start start 2024-09-15T23:15:26.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.217+0000 7f68f6d78640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f68f0158f80 0x7f68f0071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:26.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.217+0000 7f68f6d78640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f68f00b7270 0x7f68f00cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:26.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.217+0000 7f68f6d78640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68f0072930 con 0x7f68f015b9a0 2024-09-15T23:15:26.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.217+0000 7f68f6d78640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f68f0072c10 con 0x7f68f00b7270 2024-09-15T23:15:26.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.217+0000 7f68f6d78640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f68f0072ef0 con 0x7f68f0158f80 2024-09-15T23:15:26.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.217+0000 7f68f5315640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f68f00b7270 0x7f68f00cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:26.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.217+0000 7f68f5315640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f68f00b7270 0x7f68f00cf4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58668/0 (socket says 172.21.15.123:58668) 2024-09-15T23:15:26.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.217+0000 7f68f5315640 1 -- 172.21.15.123:0/3076215617 learned_addr learned my addr 172.21.15.123:0/3076215617 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:26.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.218+0000 7f68f4b14640 1 --2- 172.21.15.123:0/3076215617 >> v2:172.21.15.188:3300/0 conn(0x7f68f0158f80 0x7f68f0071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:26.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.218+0000 7f68f5315640 1 -- 172.21.15.123:0/3076215617 >> v2:172.21.15.188:3300/0 conn(0x7f68f0158f80 msgr2=0x7f68f0071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:26.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.218+0000 7f68f5315640 1 --2- 172.21.15.123:0/3076215617 >> v2:172.21.15.188:3300/0 conn(0x7f68f0158f80 0x7f68f0071fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:26.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.218+0000 7f68f5315640 1 -- 172.21.15.123:0/3076215617 >> v1:172.21.15.188:6789/0 conn(0x7f68f015b9a0 legacy=0x7f68f00b6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:26.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.218+0000 7f68f5315640 1 -- 172.21.15.123:0/3076215617 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f00731d0 con 0x7f68f00b7270 2024-09-15T23:15:26.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.218+0000 7f68f5315640 1 --2- 172.21.15.123:0/3076215617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68f00b7270 0x7f68f00cf4d0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f68f00757c0 tx=0x7f68e802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3fbf8ad371a1496 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:26.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.219+0000 7f68ef7fe640 1 -- 172.21.15.123:0/3076215617 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e8037070 con 0x7f68f00b7270 2024-09-15T23:15:26.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.219+0000 7f68ef7fe640 1 -- 172.21.15.123:0/3076215617 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68e8032440 con 0x7f68f00b7270 2024-09-15T23:15:26.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.219+0000 7f68ef7fe640 1 -- 172.21.15.123:0/3076215617 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e8032810 con 0x7f68f00b7270 2024-09-15T23:15:26.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.219+0000 7f68f6d78640 1 -- 172.21.15.123:0/3076215617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68f00b7270 msgr2=0x7f68f00cf4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:26.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.219+0000 7f68f6d78640 1 --2- 172.21.15.123:0/3076215617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68f00b7270 0x7f68f00cf4d0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f68f00757c0 tx=0x7f68e802a230 comp rx=0 tx=0).stop 2024-09-15T23:15:26.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.219+0000 7f68f6d78640 1 -- 172.21.15.123:0/3076215617 shutdown_connections 2024-09-15T23:15:26.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.219+0000 7f68f6d78640 1 --2- 172.21.15.123:0/3076215617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68f00b7270 0x7f68f00cf4d0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:26.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.219+0000 7f68f6d78640 1 --2- 172.21.15.123:0/3076215617 >> v2:172.21.15.188:3300/0 conn(0x7f68f0158f80 0x7f68f0071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:26.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.219+0000 7f68f6d78640 1 -- 172.21.15.123:0/3076215617 >> 172.21.15.123:0/3076215617 conn(0x7f68f006cd20 msgr2=0x7f68f006d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:26.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.219+0000 7f68f6d78640 1 -- 172.21.15.123:0/3076215617 shutdown_connections 2024-09-15T23:15:26.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.219+0000 7f68f6d78640 1 -- 172.21.15.123:0/3076215617 wait complete. 2024-09-15T23:15:26.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.220+0000 7f68f6d78640 1 Processor -- start 2024-09-15T23:15:26.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.220+0000 7f68f6d78640 1 -- start start 2024-09-15T23:15:26.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.221+0000 7f68f6d78640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68f00b7270 0x7f68f0153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:26.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.221+0000 7f68f6d78640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68f0158f80 0x7f68f0151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:26.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.221+0000 7f68f6d78640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68f015b9a0 0x7f68f015f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:26.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.221+0000 7f68f6d78640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f68f0072680 con 0x7f68f015b9a0 2024-09-15T23:15:26.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.221+0000 7f68f6d78640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f68f0072500 con 0x7f68f0158f80 2024-09-15T23:15:26.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.221+0000 7f68f6d78640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f68f00739d0 con 0x7f68f00b7270 2024-09-15T23:15:26.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.221+0000 7f68f5315640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68f015b9a0 0x7f68f015f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:26.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.221+0000 7f68f5315640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68f015b9a0 0x7f68f015f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58680/0 (socket says 172.21.15.123:58680) 2024-09-15T23:15:26.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.221+0000 7f68f5315640 1 -- 172.21.15.123:0/2390190952 learned_addr learned my addr 172.21.15.123:0/2390190952 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:26.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.221+0000 7f68effff640 1 --2- 172.21.15.123:0/2390190952 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68f0158f80 0x7f68f0151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:26.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.221+0000 7f68f4b14640 1 --2- 172.21.15.123:0/2390190952 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68f00b7270 0x7f68f0153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:26.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.222+0000 7f68f5315640 1 -- 172.21.15.123:0/2390190952 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68f00b7270 msgr2=0x7f68f0153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:26.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.222+0000 7f68f5315640 1 --2- 172.21.15.123:0/2390190952 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68f00b7270 0x7f68f0153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:26.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.222+0000 7f68f5315640 1 -- 172.21.15.123:0/2390190952 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68f0158f80 msgr2=0x7f68f0151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:26.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.222+0000 7f68f5315640 1 --2- 172.21.15.123:0/2390190952 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68f0158f80 0x7f68f0151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:26.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.222+0000 7f68f5315640 1 -- 172.21.15.123:0/2390190952 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f0152690 con 0x7f68f015b9a0 2024-09-15T23:15:26.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.222+0000 7f68f4b14640 1 --2- 172.21.15.123:0/2390190952 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68f00b7270 0x7f68f0153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:26.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.222+0000 7f68f5315640 1 --2- 172.21.15.123:0/2390190952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68f015b9a0 0x7f68f015f1c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f68e80090b0 tx=0x7f68e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:26.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.222+0000 7f68ed7fa640 1 -- 172.21.15.123:0/2390190952 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e8041020 con 0x7f68f015b9a0 2024-09-15T23:15:26.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.222+0000 7f68ed7fa640 1 -- 172.21.15.123:0/2390190952 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68e80306c0 con 0x7f68f015b9a0 2024-09-15T23:15:26.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.222+0000 7f68f6d78640 1 -- 172.21.15.123:0/2390190952 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68f0152970 con 0x7f68f015b9a0 2024-09-15T23:15:26.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.222+0000 7f68ed7fa640 1 -- 172.21.15.123:0/2390190952 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e8037040 con 0x7f68f015b9a0 2024-09-15T23:15:26.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.222+0000 7f68f6d78640 1 -- 172.21.15.123:0/2390190952 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68f0152f30 con 0x7f68f015b9a0 2024-09-15T23:15:26.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.223+0000 7f68f6d78640 1 -- 172.21.15.123:0/2390190952 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68f0071fc0 con 0x7f68f015b9a0 2024-09-15T23:15:26.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.223+0000 7f68ed7fa640 1 -- 172.21.15.123:0/2390190952 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f68e8044020 con 0x7f68f015b9a0 2024-09-15T23:15:26.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.224+0000 7f68ed7fa640 1 --2- 172.21.15.123:0/2390190952 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f68d006c2e0 0x7f68d006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:26.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.224+0000 7f68ed7fa640 1 -- 172.21.15.123:0/2390190952 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7f68e80abb30 con 0x7f68f015b9a0 2024-09-15T23:15:26.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.224+0000 7f68f4b14640 1 --2- 172.21.15.123:0/2390190952 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f68d006c2e0 0x7f68d006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:26.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.225+0000 7f68f4b14640 1 --2- 172.21.15.123:0/2390190952 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f68d006c2e0 0x7f68d006e7a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f68e0009b20 tx=0x7f68e00039d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:26.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.228+0000 7f68ed7fa640 1 -- 172.21.15.123:0/2390190952 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f68e804b030 con 0x7f68f015b9a0 2024-09-15T23:15:26.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.431+0000 7f68f6d78640 1 -- 172.21.15.123:0/2390190952 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f68f00b6e20 con 0x7f68f015b9a0 2024-09-15T23:15:26.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.431+0000 7f68ed7fa640 1 -- 172.21.15.123:0/2390190952 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5232 (secure 0 0 0) 0x7f68e807a2a0 con 0x7f68f015b9a0 2024-09-15T23:15:26.433 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:26.433 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":30,"btime":"2024-09-15T23:15:21:435254+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5339,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/3452580408","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":3452580408},{"type":"v1","addr":"172.21.15.188:6837","nonce":3452580408}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":5665,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/301618526","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":301618526},{"type":"v1","addr":"172.21.15.188:6836","nonce":301618526}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":6162,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2171163786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2171163786},{"type":"v1","addr":"172.21.15.123:6834","nonce":2171163786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:15:17.752297+0000","modified":"2024-09-15T23:15:20.582574+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6165},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6165":{"gid":6165,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/2772280632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":2772280632},{"type":"v1","addr":"172.21.15.123:6835","nonce":2772280632}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6165,"qdb_cluster":[6165]},"id":4}]} 2024-09-15T23:15:26.433 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 30 2024-09-15T23:15:26.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.434+0000 7f68f6d78640 1 -- 172.21.15.123:0/2390190952 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f68d006c2e0 msgr2=0x7f68d006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:26.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.434+0000 7f68f6d78640 1 --2- 172.21.15.123:0/2390190952 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f68d006c2e0 0x7f68d006e7a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f68e0009b20 tx=0x7f68e00039d0 comp rx=0 tx=0).stop 2024-09-15T23:15:26.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.434+0000 7f68f6d78640 1 -- 172.21.15.123:0/2390190952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68f015b9a0 msgr2=0x7f68f015f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:26.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.434+0000 7f68f6d78640 1 --2- 172.21.15.123:0/2390190952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68f015b9a0 0x7f68f015f1c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f68e80090b0 tx=0x7f68e80046c0 comp rx=0 tx=0).stop 2024-09-15T23:15:26.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.434+0000 7f68f6d78640 1 -- 172.21.15.123:0/2390190952 shutdown_connections 2024-09-15T23:15:26.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.434+0000 7f68f6d78640 1 --2- 172.21.15.123:0/2390190952 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f68d006c2e0 0x7f68d006e7a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:26.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.434+0000 7f68f6d78640 1 --2- 172.21.15.123:0/2390190952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68f015b9a0 0x7f68f015f1c0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:26.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.434+0000 7f68f6d78640 1 --2- 172.21.15.123:0/2390190952 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68f0158f80 0x7f68f0151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:26.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.434+0000 7f68f6d78640 1 --2- 172.21.15.123:0/2390190952 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68f00b7270 0x7f68f0153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:26.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.434+0000 7f68f6d78640 1 -- 172.21.15.123:0/2390190952 >> 172.21.15.123:0/2390190952 conn(0x7f68f006cd20 msgr2=0x7f68f015a920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:26.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.434+0000 7f68f6d78640 1 -- 172.21.15.123:0/2390190952 shutdown_connections 2024-09-15T23:15:26.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.434+0000 7f68f6d78640 1 -- 172.21.15.123:0/2390190952 wait complete. 2024-09-15T23:15:26.446 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-15T23:15:26.558 INFO:teuthology.orchestra.run.smithi123.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-15T23:15:25.961769+0000","btime":"2024-09-15T23:15:25.961769+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-15T23:15:25.961769+0000","atime":"2024-09-15T23:15:25.961769+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"version":2,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"excl","type":"iauth","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","type":"ifile","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{"gather_set":[],"state":"excl","type":"ixattr","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":6309,"pending":"pAsxLsXsxFsx","issued":"pAsxLsXsxFsx","wanted":"-","last_sent":1}],"loner":6309,"want_loner":6309,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-15T23:15:26.559 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-15T23:15:25.961769+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "iauth", "xlock_by": {} }, "backtrace_version": 2, "btime": "2024-09-15T23:15:25.961769+0000", "change_attr": 0, "client_caps": [ { "client_id": 6309, "issued": "pAsxLsXsxFsx", "last_sent": 1, "pending": "pAsxLsXsxFsx", "wanted": "-" } ], "client_ranges": [], "ctime": "2024-09-15T23:15:25.961769+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ifile", "xlock_by": {} }, "flocklock": {}, "gid": 1333, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 6309, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-15T23:15:25.961769+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": 6309, "xattr_version": 1, "xattrlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ixattr", "xlock_by": {} }, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-15T23:15:26.559 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:15:26.559 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:15:26.575 DEBUG:teuthology.orchestra.run.smithi123:> stdin-killer -- python3 -c ' 2024-09-15T23:15:26.575 DEBUG:teuthology.orchestra.run.smithi123:> import os 2024-09-15T23:15:26.575 DEBUG:teuthology.orchestra.run.smithi123:> import uuid 2024-09-15T23:15:26.575 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-15T23:15:26.575 DEBUG:teuthology.orchestra.run.smithi123:> n = 40 2024-09-15T23:15:26.575 DEBUG:teuthology.orchestra.run.smithi123:> create_hard_links = False 2024-09-15T23:15:26.576 DEBUG:teuthology.orchestra.run.smithi123:> if 0 > 0: 2024-09-15T23:15:26.576 DEBUG:teuthology.orchestra.run.smithi123:> create_hard_links = True 2024-09-15T23:15:26.576 DEBUG:teuthology.orchestra.run.smithi123:> path = "/home/ubuntu/cephtest/mnt.0/testdir/file" 2024-09-15T23:15:26.576 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-15T23:15:26.576 DEBUG:teuthology.orchestra.run.smithi123:> dpath = os.path.dirname(path) 2024-09-15T23:15:26.576 DEBUG:teuthology.orchestra.run.smithi123:> fnameprefix = os.path.basename(path) 2024-09-15T23:15:26.576 DEBUG:teuthology.orchestra.run.smithi123:> os.makedirs(dpath, exist_ok=True) 2024-09-15T23:15:26.576 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-15T23:15:26.576 DEBUG:teuthology.orchestra.run.smithi123:> try: 2024-09-15T23:15:26.576 DEBUG:teuthology.orchestra.run.smithi123:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-15T23:15:26.576 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-15T23:15:26.576 DEBUG:teuthology.orchestra.run.smithi123:> for i in range(n): 2024-09-15T23:15:26.577 DEBUG:teuthology.orchestra.run.smithi123:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-15T23:15:26.577 DEBUG:teuthology.orchestra.run.smithi123:> with open(fpath, '"'"'w'"'"') as f: 2024-09-15T23:15:26.577 DEBUG:teuthology.orchestra.run.smithi123:> f.write(f"{i}") 2024-09-15T23:15:26.577 DEBUG:teuthology.orchestra.run.smithi123:> if False: 2024-09-15T23:15:26.577 DEBUG:teuthology.orchestra.run.smithi123:> f.flush() 2024-09-15T23:15:26.577 DEBUG:teuthology.orchestra.run.smithi123:> os.fsync(f.fileno()) 2024-09-15T23:15:26.577 DEBUG:teuthology.orchestra.run.smithi123:> if False: 2024-09-15T23:15:26.577 DEBUG:teuthology.orchestra.run.smithi123:> os.unlink(fpath) 2024-09-15T23:15:26.577 DEBUG:teuthology.orchestra.run.smithi123:> if False: 2024-09-15T23:15:26.577 DEBUG:teuthology.orchestra.run.smithi123:> os.fsync(dirfd) 2024-09-15T23:15:26.577 DEBUG:teuthology.orchestra.run.smithi123:> if create_hard_links: 2024-09-15T23:15:26.577 DEBUG:teuthology.orchestra.run.smithi123:> for j in range(0): 2024-09-15T23:15:26.577 DEBUG:teuthology.orchestra.run.smithi123:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-15T23:15:26.577 DEBUG:teuthology.orchestra.run.smithi123:> if False: 2024-09-15T23:15:26.578 DEBUG:teuthology.orchestra.run.smithi123:> os.fsync(dirfd) 2024-09-15T23:15:26.578 DEBUG:teuthology.orchestra.run.smithi123:> finally: 2024-09-15T23:15:26.578 DEBUG:teuthology.orchestra.run.smithi123:> os.close(dirfd) 2024-09-15T23:15:26.578 DEBUG:teuthology.orchestra.run.smithi123:> ' 2024-09-15T23:15:26.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:15:26.745 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:15:26.745 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:15:26.801 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:15:26.801 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:15:26.857 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:15:26.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.995+0000 7f36c1e30640 1 Processor -- start 2024-09-15T23:15:26.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.995+0000 7f36c1e30640 1 -- start start 2024-09-15T23:15:26.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.995+0000 7f36c1e30640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f36bc15ed20 0x7f36bc0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:26.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.995+0000 7f36c1e30640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f36bc0d23b0 0x7f36bc0b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:26.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.995+0000 7f36c1e30640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36bc0d0e70 con 0x7f36bc0cf2d0 2024-09-15T23:15:26.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.995+0000 7f36c1e30640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f36bc0d41c0 con 0x7f36bc0d23b0 2024-09-15T23:15:26.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.995+0000 7f36c1e30640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f36bc0d35b0 con 0x7f36bc15ed20 2024-09-15T23:15:26.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.996+0000 7f36b3fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f36bc0d23b0 0x7f36bc0b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:26.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.996+0000 7f36b3fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f36bc0d23b0 0x7f36bc0b67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58688/0 (socket says 172.21.15.123:58688) 2024-09-15T23:15:26.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.996+0000 7f36b3fff640 1 -- 172.21.15.123:0/2696744876 learned_addr learned my addr 172.21.15.123:0/2696744876 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:26.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.996+0000 7f36bbfff640 1 --1- 172.21.15.123:0/2696744876 >> v1:172.21.15.123:6789/0 conn(0x7f36bc0cf2d0 0x7f36bc0cf760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39428/0 (socket says 172.21.15.123:39428) 2024-09-15T23:15:26.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.996+0000 7f36bb7fe640 1 --2- 172.21.15.123:0/2696744876 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f36bc15ed20 0x7f36bc0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:26.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.996+0000 7f36b3fff640 1 -- 172.21.15.123:0/2696744876 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f36bc15ed20 msgr2=0x7f36bc0b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:26.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.996+0000 7f36b3fff640 1 --2- 172.21.15.123:0/2696744876 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f36bc15ed20 0x7f36bc0b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:26.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.996+0000 7f36b3fff640 1 -- 172.21.15.123:0/2696744876 >> v1:172.21.15.123:6789/0 conn(0x7f36bc0cf2d0 legacy=0x7f36bc0cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:26.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.996+0000 7f36baffd640 1 -- 172.21.15.123:0/2696744876 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3429273551 0 0) 0x7f36b4001490 con 0x7f36bc0cf2d0 2024-09-15T23:15:26.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.996+0000 7f36b3fff640 1 -- 172.21.15.123:0/2696744876 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36bc0d3890 con 0x7f36bc0d23b0 2024-09-15T23:15:26.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.997+0000 7f36b3fff640 1 --2- 172.21.15.123:0/2696744876 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36bc0d23b0 0x7f36bc0b67a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f36a4009870 tx=0x7f36a402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=482ca1513374650b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:26.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.997+0000 7f36baffd640 1 -- 172.21.15.123:0/2696744876 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a4037070 con 0x7f36bc0d23b0 2024-09-15T23:15:26.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.997+0000 7f36baffd640 1 -- 172.21.15.123:0/2696744876 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36a4032440 con 0x7f36bc0d23b0 2024-09-15T23:15:26.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.997+0000 7f36baffd640 1 -- 172.21.15.123:0/2696744876 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a4032810 con 0x7f36bc0d23b0 2024-09-15T23:15:27.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.997+0000 7f36c1e30640 1 -- 172.21.15.123:0/2696744876 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36bc0d23b0 msgr2=0x7f36bc0b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:27.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.997+0000 7f36c1e30640 1 --2- 172.21.15.123:0/2696744876 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36bc0d23b0 0x7f36bc0b67a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f36a4009870 tx=0x7f36a402a270 comp rx=0 tx=0).stop 2024-09-15T23:15:27.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.997+0000 7f36c1e30640 1 -- 172.21.15.123:0/2696744876 shutdown_connections 2024-09-15T23:15:27.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.997+0000 7f36c1e30640 1 --2- 172.21.15.123:0/2696744876 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36bc0d23b0 0x7f36bc0b67a0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.997+0000 7f36c1e30640 1 --2- 172.21.15.123:0/2696744876 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f36bc15ed20 0x7f36bc0b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.997+0000 7f36c1e30640 1 -- 172.21.15.123:0/2696744876 >> 172.21.15.123:0/2696744876 conn(0x7f36bc0d1260 msgr2=0x7f36bc0d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:27.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.997+0000 7f36c1e30640 1 -- 172.21.15.123:0/2696744876 shutdown_connections 2024-09-15T23:15:27.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.997+0000 7f36c1e30640 1 -- 172.21.15.123:0/2696744876 wait complete. 2024-09-15T23:15:27.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.999+0000 7f36c1e30640 1 Processor -- start 2024-09-15T23:15:27.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.999+0000 7f36c1e30640 1 -- start start 2024-09-15T23:15:27.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.999+0000 7f36c1e30640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f36bc0cf2d0 0x7f36bc154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.999+0000 7f36c1e30640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36bc0d23b0 0x7f36bc0cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.999+0000 7f36c1e30640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36bc15ed20 0x7f36bc0ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.999+0000 7f36c1e30640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc0d32a0 con 0x7f36bc15ed20 2024-09-15T23:15:27.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.999+0000 7f36c1e30640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc0d3e50 con 0x7f36bc0d23b0 2024-09-15T23:15:27.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.999+0000 7f36c1e30640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f36bc15f100 con 0x7f36bc0cf2d0 2024-09-15T23:15:27.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.999+0000 7f36bbfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36bc15ed20 0x7f36bc0ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.999+0000 7f36bbfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36bc15ed20 0x7f36bc0ccd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58700/0 (socket says 172.21.15.123:58700) 2024-09-15T23:15:27.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:26.999+0000 7f36bbfff640 1 -- 172.21.15.123:0/737542632 learned_addr learned my addr 172.21.15.123:0/737542632 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:27.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.000+0000 7f36bb7fe640 1 --2- 172.21.15.123:0/737542632 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f36bc0cf2d0 0x7f36bc154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.000+0000 7f36b3fff640 1 --2- 172.21.15.123:0/737542632 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36bc0d23b0 0x7f36bc0cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.000+0000 7f36bbfff640 1 -- 172.21.15.123:0/737542632 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f36bc0cf2d0 msgr2=0x7f36bc154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:27.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.000+0000 7f36bbfff640 1 --2- 172.21.15.123:0/737542632 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f36bc0cf2d0 0x7f36bc154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.000+0000 7f36bbfff640 1 -- 172.21.15.123:0/737542632 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36bc0d23b0 msgr2=0x7f36bc0cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:27.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.000+0000 7f36bbfff640 1 --2- 172.21.15.123:0/737542632 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36bc0d23b0 0x7f36bc0cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.000+0000 7f36bbfff640 1 -- 172.21.15.123:0/737542632 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36bc0cd450 con 0x7f36bc15ed20 2024-09-15T23:15:27.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.000+0000 7f36bbfff640 1 --2- 172.21.15.123:0/737542632 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36bc15ed20 0x7f36bc0ccd10 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f36b400c7f0 tx=0x7f36b400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:27.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.000+0000 7f36b8ff9640 1 -- 172.21.15.123:0/737542632 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b4018070 con 0x7f36bc15ed20 2024-09-15T23:15:27.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.000+0000 7f36b8ff9640 1 -- 172.21.15.123:0/737542632 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36b400a5e0 con 0x7f36bc15ed20 2024-09-15T23:15:27.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.000+0000 7f36c1e30640 1 -- 172.21.15.123:0/737542632 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36bc0cd730 con 0x7f36bc15ed20 2024-09-15T23:15:27.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.000+0000 7f36b8ff9640 1 -- 172.21.15.123:0/737542632 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b400aa10 con 0x7f36bc15ed20 2024-09-15T23:15:27.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.000+0000 7f36c1e30640 1 -- 172.21.15.123:0/737542632 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36bc155fc0 con 0x7f36bc15ed20 2024-09-15T23:15:27.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.001+0000 7f36c1e30640 1 -- 172.21.15.123:0/737542632 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36bc0b7010 con 0x7f36bc15ed20 2024-09-15T23:15:27.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.001+0000 7f36b8ff9640 1 -- 172.21.15.123:0/737542632 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f36b401b070 con 0x7f36bc15ed20 2024-09-15T23:15:27.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.002+0000 7f36b8ff9640 1 --2- 172.21.15.123:0/737542632 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f369c06c2b0 0x7f369c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.002+0000 7f36b8ff9640 1 -- 172.21.15.123:0/737542632 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7f36b408aa80 con 0x7f36bc15ed20 2024-09-15T23:15:27.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.002+0000 7f36bb7fe640 1 --2- 172.21.15.123:0/737542632 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f369c06c2b0 0x7f369c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.003+0000 7f36bb7fe640 1 --2- 172.21.15.123:0/737542632 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f369c06c2b0 0x7f369c06e770 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f36ac006fd0 tx=0x7f36ac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:27.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.006+0000 7f36b8ff9640 1 -- 172.21.15.123:0/737542632 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f36bc0d0e70 con 0x7f36bc15ed20 2024-09-15T23:15:27.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.181+0000 7f36c1e30640 1 -- 172.21.15.123:0/737542632 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f36bc0b3f20 con 0x7f36bc15ed20 2024-09-15T23:15:27.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.182+0000 7f36b8ff9640 1 -- 172.21.15.123:0/737542632 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v66) ==== 80+0+0 (secure 0 0 0) 0x7f36b40591f0 con 0x7f36bc15ed20 2024-09-15T23:15:27.183 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-15T23:15:27.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.184+0000 7f36c1e30640 1 -- 172.21.15.123:0/737542632 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f369c06c2b0 msgr2=0x7f369c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:27.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.184+0000 7f36c1e30640 1 --2- 172.21.15.123:0/737542632 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f369c06c2b0 0x7f369c06e770 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f36ac006fd0 tx=0x7f36ac008040 comp rx=0 tx=0).stop 2024-09-15T23:15:27.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.184+0000 7f36c1e30640 1 -- 172.21.15.123:0/737542632 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36bc15ed20 msgr2=0x7f36bc0ccd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:27.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.184+0000 7f36c1e30640 1 --2- 172.21.15.123:0/737542632 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36bc15ed20 0x7f36bc0ccd10 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f36b400c7f0 tx=0x7f36b400ccb0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.184+0000 7f36c1e30640 1 -- 172.21.15.123:0/737542632 shutdown_connections 2024-09-15T23:15:27.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.184+0000 7f36c1e30640 1 --2- 172.21.15.123:0/737542632 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f369c06c2b0 0x7f369c06e770 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.184+0000 7f36c1e30640 1 --2- 172.21.15.123:0/737542632 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f36bc15ed20 0x7f36bc0ccd10 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.184+0000 7f36c1e30640 1 --2- 172.21.15.123:0/737542632 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f36bc0d23b0 0x7f36bc0cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.184+0000 7f36c1e30640 1 --2- 172.21.15.123:0/737542632 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f36bc0cf2d0 0x7f36bc154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.184+0000 7f36c1e30640 1 -- 172.21.15.123:0/737542632 >> 172.21.15.123:0/737542632 conn(0x7f36bc0d1260 msgr2=0x7f36bc0b5ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:27.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.184+0000 7f36c1e30640 1 -- 172.21.15.123:0/737542632 shutdown_connections 2024-09-15T23:15:27.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.184+0000 7f36c1e30640 1 -- 172.21.15.123:0/737542632 wait complete. 2024-09-15T23:15:27.196 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-15T23:15:27.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:15:27.196 DEBUG:teuthology.orchestra.run.smithi123:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-15T23:15:27.285 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-09-15T23:15:27.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:15:27.285 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T23:15:27.303 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 flush journal 2024-09-15T23:15:27.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.443+0000 7f045df6d640 1 Processor -- start 2024-09-15T23:15:27.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.443+0000 7f045df6d640 1 -- start start 2024-09-15T23:15:27.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.443+0000 7f045df6d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f045806bfd0 0x7f045806c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.443+0000 7f045df6d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04580b3350 0x7f04581623a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.443+0000 7f045df6d640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f045806c8f0 con 0x7f04580b38a0 2024-09-15T23:15:27.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.443+0000 7f045df6d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f04580b78a0 con 0x7f045806bfd0 2024-09-15T23:15:27.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.443+0000 7f045df6d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f04580cffb0 con 0x7f04580b3350 2024-09-15T23:15:27.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.444+0000 7f044ffff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04580b3350 0x7f04581623a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.444+0000 7f04577fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f045806bfd0 0x7f045806c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.444+0000 7f0457fff640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f04580b38a0 0x7f04581628e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:60606/0 (socket says 172.21.15.123:60606) 2024-09-15T23:15:27.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.444+0000 7f0457fff640 1 -- 172.21.15.123:0/1994626668 learned_addr learned my addr 172.21.15.123:0/1994626668 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:27.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.444+0000 7f044ffff640 1 -- 172.21.15.123:0/1994626668 >> v2:172.21.15.188:3300/0 conn(0x7f045806bfd0 msgr2=0x7f045806c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:27.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.444+0000 7f044ffff640 1 --2- 172.21.15.123:0/1994626668 >> v2:172.21.15.188:3300/0 conn(0x7f045806bfd0 0x7f045806c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.444+0000 7f044ffff640 1 -- 172.21.15.123:0/1994626668 >> v1:172.21.15.188:6789/0 conn(0x7f04580b38a0 legacy=0x7f04581628e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:27.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.444+0000 7f044ffff640 1 -- 172.21.15.123:0/1994626668 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04580cf710 con 0x7f04580b3350 2024-09-15T23:15:27.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.444+0000 7f04577fe640 1 --2- 172.21.15.123:0/1994626668 >> v2:172.21.15.188:3300/0 conn(0x7f045806bfd0 0x7f045806c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:15:27.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.445+0000 7f044ffff640 1 --2- 172.21.15.123:0/1994626668 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04580b3350 0x7f04581623a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f04400097a0 tx=0x7f044002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7429c47c73a040e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:27.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.445+0000 7f0456ffd640 1 -- 172.21.15.123:0/1994626668 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0440037070 con 0x7f04580b3350 2024-09-15T23:15:27.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.445+0000 7f0456ffd640 1 -- 172.21.15.123:0/1994626668 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0440032440 con 0x7f04580b3350 2024-09-15T23:15:27.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.445+0000 7f0456ffd640 1 -- 172.21.15.123:0/1994626668 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0440032810 con 0x7f04580b3350 2024-09-15T23:15:27.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.446+0000 7f045df6d640 1 -- 172.21.15.123:0/1994626668 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04580b3350 msgr2=0x7f04581623a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:27.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.446+0000 7f045df6d640 1 --2- 172.21.15.123:0/1994626668 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04580b3350 0x7f04581623a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f04400097a0 tx=0x7f044002a210 comp rx=0 tx=0).stop 2024-09-15T23:15:27.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.446+0000 7f045df6d640 1 -- 172.21.15.123:0/1994626668 shutdown_connections 2024-09-15T23:15:27.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.446+0000 7f045df6d640 1 --2- 172.21.15.123:0/1994626668 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04580b3350 0x7f04581623a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.446+0000 7f045df6d640 1 --2- 172.21.15.123:0/1994626668 >> v2:172.21.15.188:3300/0 conn(0x7f045806bfd0 0x7f045806c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.446+0000 7f045df6d640 1 -- 172.21.15.123:0/1994626668 >> 172.21.15.123:0/1994626668 conn(0x7f04580d11c0 msgr2=0x7f04580d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:27.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.446+0000 7f045df6d640 1 -- 172.21.15.123:0/1994626668 shutdown_connections 2024-09-15T23:15:27.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.446+0000 7f045df6d640 1 -- 172.21.15.123:0/1994626668 wait complete. 2024-09-15T23:15:27.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.447+0000 7f045df6d640 1 Processor -- start 2024-09-15T23:15:27.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.447+0000 7f045df6d640 1 -- start start 2024-09-15T23:15:27.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.448+0000 7f045df6d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f045806bfd0 0x7f045815cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.448+0000 7f045df6d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04580b3350 0x7f045814d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.448+0000 7f045df6d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04580b38a0 0x7f045815f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.448+0000 7f045df6d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f04580d2400 con 0x7f045806bfd0 2024-09-15T23:15:27.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.448+0000 7f045df6d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f04580cfcd0 con 0x7f04580b38a0 2024-09-15T23:15:27.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.448+0000 7f045df6d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f045806cd50 con 0x7f04580b3350 2024-09-15T23:15:27.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.448+0000 7f04577fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f045806bfd0 0x7f045815cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.448+0000 7f04577fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f045806bfd0 0x7f045815cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58702/0 (socket says 172.21.15.123:58702) 2024-09-15T23:15:27.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.448+0000 7f04577fe640 1 -- 172.21.15.123:0/1763700465 learned_addr learned my addr 172.21.15.123:0/1763700465 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:27.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.448+0000 7f0457fff640 1 --2- 172.21.15.123:0/1763700465 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04580b38a0 0x7f045815f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.448+0000 7f044ffff640 1 --2- 172.21.15.123:0/1763700465 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04580b3350 0x7f045814d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.448+0000 7f04577fe640 1 -- 172.21.15.123:0/1763700465 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04580b3350 msgr2=0x7f045814d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:27.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.448+0000 7f04577fe640 1 --2- 172.21.15.123:0/1763700465 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04580b3350 0x7f045814d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.448+0000 7f04577fe640 1 -- 172.21.15.123:0/1763700465 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04580b38a0 msgr2=0x7f045815f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:27.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.448+0000 7f04577fe640 1 --2- 172.21.15.123:0/1763700465 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04580b38a0 0x7f045815f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.448+0000 7f04577fe640 1 -- 172.21.15.123:0/1763700465 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f045814ac80 con 0x7f045806bfd0 2024-09-15T23:15:27.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.448+0000 7f044ffff640 1 --2- 172.21.15.123:0/1763700465 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04580b3350 0x7f045814d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:27.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.448+0000 7f04577fe640 1 --2- 172.21.15.123:0/1763700465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f045806bfd0 0x7f045815cc20 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f044800ebe0 tx=0x7f044800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:27.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.448+0000 7f0454ff9640 1 -- 172.21.15.123:0/1763700465 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0448017070 con 0x7f045806bfd0 2024-09-15T23:15:27.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.448+0000 7f0454ff9640 1 -- 172.21.15.123:0/1763700465 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f044800cc30 con 0x7f045806bfd0 2024-09-15T23:15:27.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.448+0000 7f0454ff9640 1 -- 172.21.15.123:0/1763700465 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0448013470 con 0x7f045806bfd0 2024-09-15T23:15:27.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.448+0000 7f045df6d640 1 -- 172.21.15.123:0/1763700465 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f045814dc10 con 0x7f045806bfd0 2024-09-15T23:15:27.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.449+0000 7f045df6d640 1 -- 172.21.15.123:0/1763700465 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f045814b200 con 0x7f045806bfd0 2024-09-15T23:15:27.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.450+0000 7f0454ff9640 1 -- 172.21.15.123:0/1763700465 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f044801a070 con 0x7f045806bfd0 2024-09-15T23:15:27.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.450+0000 7f0454ff9640 1 --2- 172.21.15.123:0/1763700465 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f043806c2b0 0x7f043806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.450+0000 7f0454ff9640 1 -- 172.21.15.123:0/1763700465 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7f044808b2e0 con 0x7f045806bfd0 2024-09-15T23:15:27.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.451+0000 7f044ffff640 1 --2- 172.21.15.123:0/1763700465 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f043806c2b0 0x7f043806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.451+0000 7f044ffff640 1 --2- 172.21.15.123:0/1763700465 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f043806c2b0 0x7f043806e770 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f04400097a0 tx=0x7f044002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:27.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.451+0000 7f0460dec740 1 Processor -- start 2024-09-15T23:15:27.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.451+0000 7f0460dec740 1 -- start start 2024-09-15T23:15:27.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.452+0000 7f0460dec740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb6b25a920 0x55bb6b2a00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.452+0000 7f0460dec740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb6b2580e0 0x55bb6b25ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.452+0000 7f0460dec740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb6b25c0b0 0x55bb6b2551a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.452+0000 7f0460dec740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55bb6b1bd6f0 con 0x55bb6b25a920 2024-09-15T23:15:27.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.452+0000 7f0460dec740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55bb6b165330 con 0x55bb6b25c0b0 2024-09-15T23:15:27.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.452+0000 7f0460dec740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55bb6b1b96b0 con 0x55bb6b2580e0 2024-09-15T23:15:27.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.452+0000 7f04577fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb6b25a920 0x55bb6b2a00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.452+0000 7f04577fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb6b25a920 0x55bb6b2a00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58712/0 (socket says 172.21.15.123:58712) 2024-09-15T23:15:27.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.452+0000 7f04577fe640 1 -- 172.21.15.123:0/4150048210 learned_addr learned my addr 172.21.15.123:0/4150048210 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:27.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.452+0000 7f044ffff640 1 --2- 172.21.15.123:0/4150048210 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb6b2580e0 0x55bb6b25ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.452+0000 7f0457fff640 1 --2- 172.21.15.123:0/4150048210 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb6b25c0b0 0x55bb6b2551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.452+0000 7f04577fe640 1 -- 172.21.15.123:0/4150048210 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb6b2580e0 msgr2=0x55bb6b25ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:27.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.453+0000 7f04577fe640 1 --2- 172.21.15.123:0/4150048210 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb6b2580e0 0x55bb6b25ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.453+0000 7f04577fe640 1 -- 172.21.15.123:0/4150048210 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb6b25c0b0 msgr2=0x55bb6b2551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:27.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.453+0000 7f04577fe640 1 --2- 172.21.15.123:0/4150048210 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb6b25c0b0 0x55bb6b2551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.453+0000 7f04577fe640 1 -- 172.21.15.123:0/4150048210 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb6b18b0d0 con 0x55bb6b25a920 2024-09-15T23:15:27.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.453+0000 7f044ffff640 1 --2- 172.21.15.123:0/4150048210 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb6b2580e0 0x55bb6b25ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:27.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.453+0000 7f04577fe640 1 --2- 172.21.15.123:0/4150048210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb6b25a920 0x55bb6b2a00c0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f0448089830 tx=0x7f0448059400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6067168f1e595d77 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:27.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.453+0000 7f044d7fa640 1 -- 172.21.15.123:0/4150048210 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0448084020 con 0x55bb6b25a920 2024-09-15T23:15:27.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.453+0000 7f044d7fa640 1 -- 172.21.15.123:0/4150048210 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f044808b070 con 0x55bb6b25a920 2024-09-15T23:15:27.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.453+0000 7f044d7fa640 1 -- 172.21.15.123:0/4150048210 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0448021040 con 0x55bb6b25a920 2024-09-15T23:15:27.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.453+0000 7f0460dec740 1 -- 172.21.15.123:0/4150048210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb6b25a920 msgr2=0x55bb6b2a00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:27.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.453+0000 7f0460dec740 1 --2- 172.21.15.123:0/4150048210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb6b25a920 0x55bb6b2a00c0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f0448089830 tx=0x7f0448059400 comp rx=0 tx=0).stop 2024-09-15T23:15:27.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.454+0000 7f0460dec740 1 -- 172.21.15.123:0/4150048210 shutdown_connections 2024-09-15T23:15:27.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.454+0000 7f0460dec740 1 --2- 172.21.15.123:0/4150048210 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb6b25c0b0 0x55bb6b2551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.454+0000 7f0460dec740 1 --2- 172.21.15.123:0/4150048210 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb6b2580e0 0x55bb6b25ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.454+0000 7f0460dec740 1 --2- 172.21.15.123:0/4150048210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb6b25a920 0x55bb6b2a00c0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.454+0000 7f0460dec740 1 -- 172.21.15.123:0/4150048210 >> 172.21.15.123:0/4150048210 conn(0x55bb6b257370 msgr2=0x55bb6b29f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:27.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.454+0000 7f0460dec740 1 -- 172.21.15.123:0/4150048210 shutdown_connections 2024-09-15T23:15:27.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.454+0000 7f0460dec740 1 -- 172.21.15.123:0/4150048210 wait complete. 2024-09-15T23:15:27.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.454+0000 7f0460dec740 1 -- start start 2024-09-15T23:15:27.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.454+0000 7f0460dec740 1 Processor -- start 2024-09-15T23:15:27.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.455+0000 7f0460dec740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb6b25a920 0x55bb6b29cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.455+0000 7f0460dec740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb6b25c0b0 0x55bb6b26cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.455+0000 7f0460dec740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb6b26b600 0x55bb6b26eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.455+0000 7f0460dec740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55bb6b256810 con 0x55bb6b25c0b0 2024-09-15T23:15:27.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.455+0000 7f0460dec740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55bb6b1464f0 con 0x55bb6b26b600 2024-09-15T23:15:27.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.455+0000 7f0460dec740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55bb6b2a08f0 con 0x55bb6b25a920 2024-09-15T23:15:27.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.455+0000 7f0460dec740 10 client.0 _ll_register_callbacks cb 0x55bb6b167b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:15:27.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.455+0000 7f044ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb6b25c0b0 0x55bb6b26cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.455+0000 7f044ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb6b25c0b0 0x55bb6b26cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58714/0 (socket says 172.21.15.123:58714) 2024-09-15T23:15:27.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.455+0000 7f044ffff640 1 -- 172.21.15.123:0/2857785935 learned_addr learned my addr 172.21.15.123:0/2857785935 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:27.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.455+0000 7f0457fff640 1 --2- 172.21.15.123:0/2857785935 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb6b26b600 0x55bb6b26eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.455+0000 7f04577fe640 1 --2- 172.21.15.123:0/2857785935 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb6b25a920 0x55bb6b29cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.455+0000 7f044ffff640 1 -- 172.21.15.123:0/2857785935 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb6b25a920 msgr2=0x55bb6b29cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:27.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.455+0000 7f044ffff640 1 --2- 172.21.15.123:0/2857785935 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb6b25a920 0x55bb6b29cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.455+0000 7f044ffff640 1 -- 172.21.15.123:0/2857785935 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb6b26b600 msgr2=0x55bb6b26eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:27.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.455+0000 7f044ffff640 1 --2- 172.21.15.123:0/2857785935 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb6b26b600 0x55bb6b26eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.455+0000 7f044ffff640 1 -- 172.21.15.123:0/2857785935 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb6af9a7d0 con 0x55bb6b25c0b0 2024-09-15T23:15:27.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.455+0000 7f044ffff640 1 --2- 172.21.15.123:0/2857785935 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb6b25c0b0 0x55bb6b26cdb0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f0440035040 tx=0x7f0440004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea5f04ae5ee0687c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:27.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.455+0000 7f04367fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:15:27.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.456+0000 7f04367fc640 1 -- 172.21.15.123:0/2857785935 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0440037040 con 0x55bb6b25c0b0 2024-09-15T23:15:27.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.456+0000 7f04367fc640 1 -- 172.21.15.123:0/2857785935 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7f044003eb70 con 0x55bb6b25c0b0 2024-09-15T23:15:27.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.456+0000 7f0460dec740 1 -- 172.21.15.123:0/2857785935 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f044808b070 con 0x55bb6b25c0b0 2024-09-15T23:15:27.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.456+0000 7f04367fc640 1 -- 172.21.15.123:0/2857785935 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0440056050 con 0x55bb6b25c0b0 2024-09-15T23:15:27.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.456+0000 7f0460dec740 10 client.6354 fetch_fsmap learned FSMap version 30 2024-09-15T23:15:27.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.456+0000 7f0460dec740 1 -- 172.21.15.123:0/2857785935 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x55bb6aed03f0 con 0x55bb6b25c0b0 2024-09-15T23:15:27.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.456+0000 7f04367fc640 1 -- 172.21.15.123:0/2857785935 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f044808b070 con 0x55bb6b25c0b0 2024-09-15T23:15:27.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.456+0000 7f04367fc640 1 -- 172.21.15.123:0/2857785935 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7f0440059020 con 0x55bb6b25c0b0 2024-09-15T23:15:27.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.456+0000 7f0460dec740 10 client.6354 fetch_fsmap finished waiting for FSMap version 30 2024-09-15T23:15:27.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.456+0000 7f0460dec740 10 client.6354 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-09-15T23:15:27.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.456+0000 7f0460dec740 20 client.6354 populate_metadata read hostname 'smithi123' 2024-09-15T23:15:27.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.456+0000 7f0460dec740 1 --2- 172.21.15.123:0/2857785935 >> [v2:172.21.15.123:6833/2772280632,v1:172.21.15.123:6835/2772280632] conn(0x55bb6b282420 0x55bb6b282830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.456+0000 7f0460dec740 4 client.6354 mds_command: new command op to 6165 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:15:27.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.456+0000 7f0460dec740 1 -- 172.21.15.123:0/2857785935 --> [v2:172.21.15.123:6833/2772280632,v1:172.21.15.123:6835/2772280632] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb6b1cae20 con 0x55bb6b282420 2024-09-15T23:15:27.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.456+0000 7f04577fe640 1 --2- 172.21.15.123:0/2857785935 >> [v2:172.21.15.123:6833/2772280632,v1:172.21.15.123:6835/2772280632] conn(0x55bb6b282420 0x55bb6b282830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.456+0000 7f04367fc640 10 client.6354 ms_handle_connect on v2:172.21.15.123:6833/2772280632 2024-09-15T23:15:27.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.456+0000 7f04577fe640 1 --2- 172.21.15.123:0/2857785935 >> [v2:172.21.15.123:6833/2772280632,v1:172.21.15.123:6835/2772280632] conn(0x55bb6b282420 0x55bb6b282830 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60463f3446a78c07 server_cookie=9e2c4bcce39a3e0c in_seq=0 out_seq=0 2024-09-15T23:15:27.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.457+0000 7f04367fc640 1 -- 172.21.15.123:0/2857785935 <== mds.0 v2:172.21.15.123:6833/2772280632 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bb6b1cae20 con 0x55bb6b282420 2024-09-15T23:15:27.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.457+0000 7f04367fc640 10 client.6354 handle_command_reply: tid=0 2024-09-15T23:15:27.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.457+0000 7f0460dec740 1 client.6354 shutdown 2024-09-15T23:15:27.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.457+0000 7f0460dec740 1 -- 172.21.15.123:0/2857785935 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb6b25c0b0 msgr2=0x55bb6b26cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:27.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.457+0000 7f0460dec740 1 --2- 172.21.15.123:0/2857785935 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb6b25c0b0 0x55bb6b26cdb0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f0440035040 tx=0x7f0440004730 comp rx=0 tx=0).stop 2024-09-15T23:15:27.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.457+0000 7f0460dec740 1 -- 172.21.15.123:0/2857785935 shutdown_connections 2024-09-15T23:15:27.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.457+0000 7f0460dec740 1 --2- 172.21.15.123:0/2857785935 >> [v2:172.21.15.123:6833/2772280632,v1:172.21.15.123:6835/2772280632] conn(0x55bb6b282420 0x55bb6b282830 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.457+0000 7f0460dec740 1 --2- 172.21.15.123:0/2857785935 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb6b26b600 0x55bb6b26eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.457+0000 7f04367fc640 0 client.6354 ms_handle_reset on v2:172.21.15.123:6833/2772280632 2024-09-15T23:15:27.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.457+0000 7f0460dec740 1 --2- 172.21.15.123:0/2857785935 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb6b25c0b0 0x55bb6b26cdb0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.457+0000 7f0460dec740 1 --2- 172.21.15.123:0/2857785935 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb6b25a920 0x55bb6b29cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.457+0000 7f0460dec740 1 -- 172.21.15.123:0/2857785935 >> 172.21.15.123:0/2857785935 conn(0x55bb6b2580e0 msgr2=0x55bb6b29eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:27.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.457+0000 7f0460dec740 1 -- 172.21.15.123:0/2857785935 shutdown_connections 2024-09-15T23:15:27.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.457+0000 7f0460dec740 1 -- 172.21.15.123:0/2857785935 wait complete. 2024-09-15T23:15:27.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.457+0000 7f0460dec740 20 client.6354 trim_cache size 0 max 16384 2024-09-15T23:15:27.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.471+0000 7f0460dec740 1 Processor -- start 2024-09-15T23:15:27.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.472+0000 7f0460dec740 1 -- start start 2024-09-15T23:15:27.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.472+0000 7f0460dec740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb6b25a920 0x55bb6b26cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.472+0000 7f0460dec740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb6b25c0b0 0x55bb6b2828a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.472+0000 7f0460dec740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb6b26b600 0x55bb6b29f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.472+0000 7f0460dec740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0458200c70 con 0x55bb6b25c0b0 2024-09-15T23:15:27.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.472+0000 7f0460dec740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f04580ce320 con 0x55bb6b26b600 2024-09-15T23:15:27.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.472+0000 7f0460dec740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0458162be0 con 0x55bb6b25a920 2024-09-15T23:15:27.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.473+0000 7f044ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb6b25c0b0 0x55bb6b2828a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.473+0000 7f044ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb6b25c0b0 0x55bb6b2828a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58720/0 (socket says 172.21.15.123:58720) 2024-09-15T23:15:27.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.473+0000 7f044ffff640 1 -- 172.21.15.123:0/1816834421 learned_addr learned my addr 172.21.15.123:0/1816834421 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:27.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.473+0000 7f0457fff640 1 --2- 172.21.15.123:0/1816834421 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb6b26b600 0x55bb6b29f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.473+0000 7f04577fe640 1 --2- 172.21.15.123:0/1816834421 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb6b25a920 0x55bb6b26cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.473+0000 7f044ffff640 1 -- 172.21.15.123:0/1816834421 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb6b25a920 msgr2=0x55bb6b26cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:27.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.473+0000 7f044ffff640 1 --2- 172.21.15.123:0/1816834421 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb6b25a920 0x55bb6b26cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.473+0000 7f044ffff640 1 -- 172.21.15.123:0/1816834421 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb6b26b600 msgr2=0x55bb6b29f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:27.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.473+0000 7f044ffff640 1 --2- 172.21.15.123:0/1816834421 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb6b26b600 0x55bb6b29f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.473+0000 7f044ffff640 1 -- 172.21.15.123:0/1816834421 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb6ae900f0 con 0x55bb6b25c0b0 2024-09-15T23:15:27.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.473+0000 7f044ffff640 1 --2- 172.21.15.123:0/1816834421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb6b25c0b0 0x55bb6b2828a0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f0440032590 tx=0x7f0440041070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d903608f757f23b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:27.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.473+0000 7f044cff9640 1 -- 172.21.15.123:0/1816834421 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0440037070 con 0x55bb6b25c0b0 2024-09-15T23:15:27.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.473+0000 7f044cff9640 1 -- 172.21.15.123:0/1816834421 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f044004e070 con 0x55bb6b25c0b0 2024-09-15T23:15:27.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.473+0000 7f044cff9640 1 -- 172.21.15.123:0/1816834421 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044003c550 con 0x55bb6b25c0b0 2024-09-15T23:15:27.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.474+0000 7f0460dec740 1 -- 172.21.15.123:0/1816834421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb6b25c0b0 msgr2=0x55bb6b2828a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:27.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.474+0000 7f0460dec740 1 --2- 172.21.15.123:0/1816834421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb6b25c0b0 0x55bb6b2828a0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f0440032590 tx=0x7f0440041070 comp rx=0 tx=0).stop 2024-09-15T23:15:27.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.474+0000 7f0460dec740 1 -- 172.21.15.123:0/1816834421 shutdown_connections 2024-09-15T23:15:27.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.474+0000 7f0460dec740 1 --2- 172.21.15.123:0/1816834421 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb6b26b600 0x55bb6b29f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.474+0000 7f0460dec740 1 --2- 172.21.15.123:0/1816834421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb6b25c0b0 0x55bb6b2828a0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.474+0000 7f0460dec740 1 --2- 172.21.15.123:0/1816834421 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb6b25a920 0x55bb6b26cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.474+0000 7f0460dec740 1 -- 172.21.15.123:0/1816834421 >> 172.21.15.123:0/1816834421 conn(0x55bb6b2580e0 msgr2=0x55bb6b27fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:27.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.474+0000 7f0460dec740 1 -- 172.21.15.123:0/1816834421 shutdown_connections 2024-09-15T23:15:27.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.474+0000 7f0460dec740 1 -- 172.21.15.123:0/1816834421 wait complete. 2024-09-15T23:15:27.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.474+0000 7f0460dec740 1 -- start start 2024-09-15T23:15:27.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.474+0000 7f0460dec740 1 Processor -- start 2024-09-15T23:15:27.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.475+0000 7f0460dec740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb6b25a920 0x55bb6b280a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.475+0000 7f0460dec740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb6b25c0b0 0x55bb6b2c3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.475+0000 7f0460dec740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb6b26b600 0x55bb6b2c4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.475+0000 7f0460dec740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55bb6b26b350 con 0x55bb6b25c0b0 2024-09-15T23:15:27.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.475+0000 7f0460dec740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f04580cdcd0 con 0x55bb6b25a920 2024-09-15T23:15:27.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.475+0000 7f0460dec740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55bb6b284f80 con 0x55bb6b26b600 2024-09-15T23:15:27.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.475+0000 7f0460dec740 10 client.0 _ll_register_callbacks cb 0x7f0440035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:15:27.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.475+0000 7f044ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb6b25c0b0 0x55bb6b2c3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.475+0000 7f044ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb6b25c0b0 0x55bb6b2c3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58734/0 (socket says 172.21.15.123:58734) 2024-09-15T23:15:27.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.475+0000 7f044ffff640 1 -- 172.21.15.123:0/3743220976 learned_addr learned my addr 172.21.15.123:0/3743220976 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:27.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.475+0000 7f04577fe640 1 --2- 172.21.15.123:0/3743220976 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb6b25a920 0x55bb6b280a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.475+0000 7f0457fff640 1 --2- 172.21.15.123:0/3743220976 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb6b26b600 0x55bb6b2c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.476+0000 7f044ffff640 1 -- 172.21.15.123:0/3743220976 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb6b26b600 msgr2=0x55bb6b2c4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:27.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.476+0000 7f044ffff640 1 --2- 172.21.15.123:0/3743220976 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb6b26b600 0x55bb6b2c4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.476+0000 7f044ffff640 1 -- 172.21.15.123:0/3743220976 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb6b25a920 msgr2=0x55bb6b280a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:27.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.476+0000 7f044ffff640 1 --2- 172.21.15.123:0/3743220976 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb6b25a920 0x55bb6b280a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.476+0000 7f044ffff640 1 -- 172.21.15.123:0/3743220976 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb6b2b2f80 con 0x55bb6b25c0b0 2024-09-15T23:15:27.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.476+0000 7f04367fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:15:27.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.476+0000 7f044ffff640 1 --2- 172.21.15.123:0/3743220976 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb6b25c0b0 0x55bb6b2c3c10 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f0440006f80 tx=0x7f0440009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f26dd17c4846f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:27.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.476+0000 7f04367fc640 1 -- 172.21.15.123:0/3743220976 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0440037040 con 0x55bb6b25c0b0 2024-09-15T23:15:27.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.476+0000 7f04367fc640 1 -- 172.21.15.123:0/3743220976 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7f044003cae0 con 0x55bb6b25c0b0 2024-09-15T23:15:27.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.476+0000 7f0460dec740 1 -- 172.21.15.123:0/3743220976 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f044004e070 con 0x55bb6b25c0b0 2024-09-15T23:15:27.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.476+0000 7f04367fc640 1 -- 172.21.15.123:0/3743220976 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f0440068050 con 0x55bb6b25c0b0 2024-09-15T23:15:27.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.476+0000 7f0460dec740 10 client.6360 fetch_fsmap learned FSMap version 30 2024-09-15T23:15:27.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.476+0000 7f0460dec740 1 -- 172.21.15.123:0/3743220976 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x55bb6b31dec0 con 0x55bb6b25c0b0 2024-09-15T23:15:27.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.476+0000 7f04367fc640 1 -- 172.21.15.123:0/3743220976 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f044004e070 con 0x55bb6b25c0b0 2024-09-15T23:15:27.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.476+0000 7f04367fc640 1 -- 172.21.15.123:0/3743220976 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7f044006b020 con 0x55bb6b25c0b0 2024-09-15T23:15:27.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.476+0000 7f0460dec740 10 client.6360 fetch_fsmap finished waiting for FSMap version 30 2024-09-15T23:15:27.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.476+0000 7f0460dec740 10 client.6360 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-09-15T23:15:27.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.476+0000 7f0460dec740 20 client.6360 populate_metadata read hostname 'smithi123' 2024-09-15T23:15:27.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.476+0000 7f0460dec740 1 --2- 172.21.15.123:0/3743220976 >> [v2:172.21.15.123:6833/2772280632,v1:172.21.15.123:6835/2772280632] conn(0x55bb6b280fa0 0x55bb6b31d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.476+0000 7f0460dec740 4 client.6360 mds_command: new command op to 6165 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T23:15:27.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.476+0000 7f0460dec740 1 -- 172.21.15.123:0/3743220976 --> [v2:172.21.15.123:6833/2772280632,v1:172.21.15.123:6835/2772280632] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bb6b2854e0 con 0x55bb6b280fa0 2024-09-15T23:15:27.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.476+0000 7f04577fe640 1 --2- 172.21.15.123:0/3743220976 >> [v2:172.21.15.123:6833/2772280632,v1:172.21.15.123:6835/2772280632] conn(0x55bb6b280fa0 0x55bb6b31d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.477+0000 7f04367fc640 10 client.6360 ms_handle_connect on v2:172.21.15.123:6833/2772280632 2024-09-15T23:15:27.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.477+0000 7f04577fe640 1 --2- 172.21.15.123:0/3743220976 >> [v2:172.21.15.123:6833/2772280632,v1:172.21.15.123:6835/2772280632] conn(0x55bb6b280fa0 0x55bb6b31d2b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f11513cb795cf48 server_cookie=f00c0b7e8d60d66e in_seq=0 out_seq=0 2024-09-15T23:15:27.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.494+0000 7f04367fc640 1 -- 172.21.15.123:0/3743220976 <== mds.0 v2:172.21.15.123:6833/2772280632 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bb6b2854e0 con 0x55bb6b280fa0 2024-09-15T23:15:27.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.494+0000 7f04367fc640 10 client.6360 handle_command_reply: tid=0 2024-09-15T23:15:27.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.494+0000 7f0460dec740 1 client.6360 shutdown 2024-09-15T23:15:27.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.494+0000 7f0460dec740 1 -- 172.21.15.123:0/3743220976 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb6b25c0b0 msgr2=0x55bb6b2c3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:27.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.494+0000 7f0460dec740 1 --2- 172.21.15.123:0/3743220976 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb6b25c0b0 0x55bb6b2c3c10 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f0440006f80 tx=0x7f0440009190 comp rx=0 tx=0).stop 2024-09-15T23:15:27.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.495+0000 7f0460dec740 1 -- 172.21.15.123:0/3743220976 shutdown_connections 2024-09-15T23:15:27.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.495+0000 7f0460dec740 1 --2- 172.21.15.123:0/3743220976 >> [v2:172.21.15.123:6833/2772280632,v1:172.21.15.123:6835/2772280632] conn(0x55bb6b280fa0 0x55bb6b31d2b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.495+0000 7f0460dec740 1 --2- 172.21.15.123:0/3743220976 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bb6b26b600 0x55bb6b2c4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.495+0000 7f0460dec740 1 --2- 172.21.15.123:0/3743220976 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bb6b25c0b0 0x55bb6b2c3c10 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.495+0000 7f04367fc640 0 client.6360 ms_handle_reset on v2:172.21.15.123:6833/2772280632 2024-09-15T23:15:27.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.495+0000 7f0460dec740 1 --2- 172.21.15.123:0/3743220976 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bb6b25a920 0x55bb6b280a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.495+0000 7f0460dec740 1 -- 172.21.15.123:0/3743220976 >> 172.21.15.123:0/3743220976 conn(0x55bb6b2580e0 msgr2=0x55bb6b29f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:27.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.495+0000 7f0460dec740 1 -- 172.21.15.123:0/3743220976 shutdown_connections 2024-09-15T23:15:27.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.495+0000 7f0460dec740 1 -- 172.21.15.123:0/3743220976 wait complete. 2024-09-15T23:15:27.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.495+0000 7f0460dec740 20 client.6360 trim_cache size 0 max 16384 2024-09-15T23:15:27.498 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:15:27.498 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "", 2024-09-15T23:15:27.498 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0 2024-09-15T23:15:27.498 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:15:27.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.495+0000 7f045df6d640 1 -- 172.21.15.123:0/1763700465 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f043806c2b0 msgr2=0x7f043806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:27.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.495+0000 7f045df6d640 1 --2- 172.21.15.123:0/1763700465 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f043806c2b0 0x7f043806e770 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f04400097a0 tx=0x7f044002e000 comp rx=0 tx=0).stop 2024-09-15T23:15:27.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.495+0000 7f045df6d640 1 -- 172.21.15.123:0/1763700465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f045806bfd0 msgr2=0x7f045815cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:27.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.495+0000 7f045df6d640 1 --2- 172.21.15.123:0/1763700465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f045806bfd0 0x7f045815cc20 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f044800ebe0 tx=0x7f044800c520 comp rx=0 tx=0).stop 2024-09-15T23:15:27.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.495+0000 7f045df6d640 1 -- 172.21.15.123:0/1763700465 shutdown_connections 2024-09-15T23:15:27.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.495+0000 7f045df6d640 1 --2- 172.21.15.123:0/1763700465 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04580b38a0 0x7f045815f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.495+0000 7f045df6d640 1 --2- 172.21.15.123:0/1763700465 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04580b3350 0x7f045814d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.495+0000 7f045df6d640 1 --2- 172.21.15.123:0/1763700465 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f043806c2b0 0x7f043806e770 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.495+0000 7f045df6d640 1 --2- 172.21.15.123:0/1763700465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f045806bfd0 0x7f045815cc20 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.495+0000 7f045df6d640 1 -- 172.21.15.123:0/1763700465 >> 172.21.15.123:0/1763700465 conn(0x7f04580d11c0 msgr2=0x7f04580b7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:27.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.495+0000 7f045df6d640 1 -- 172.21.15.123:0/1763700465 shutdown_connections 2024-09-15T23:15:27.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.495+0000 7f045df6d640 1 -- 172.21.15.123:0/1763700465 wait complete. 2024-09-15T23:15:27.507 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T23:15:27.508 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:15:27.508 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T23:15:27.508 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:15:27.508 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T23:15:27.509 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:15:27.509 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T23:15:27.509 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:15:27.518 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T23:15:27.518 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-09-15T23:15:27.519 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T23:15:27.519 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-09-15T23:15:27.520 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T23:15:27.521 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-09-15T23:15:27.529 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T23:15:27.529 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-09-15T23:15:27.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.663+0000 7fe3bc650640 1 Processor -- start 2024-09-15T23:15:27.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.664+0000 7fe3bc650640 1 -- start start 2024-09-15T23:15:27.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.664+0000 7ffb37423640 1 Processor -- start 2024-09-15T23:15:27.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.664+0000 7ffb37423640 1 -- start start 2024-09-15T23:15:27.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.665+0000 7f468cfbd640 1 Processor -- start 2024-09-15T23:15:27.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.665+0000 7fe3bc650640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe3b40b6970 0x7fe3b40b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.665+0000 7fe3bc650640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3b40d0e70 con 0x7fe3b415ed20 2024-09-15T23:15:27.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.665+0000 7fe3bc650640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3b40d41c0 con 0x7fe3b40d23b0 2024-09-15T23:15:27.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.665+0000 7fe3bc650640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fe3b40d35b0 con 0x7fe3b40b6970 2024-09-15T23:15:27.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.665+0000 7f468cfbd640 1 -- start start 2024-09-15T23:15:27.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.665+0000 7ffb37423640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ffb300b42c0 0x7ffb30160040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.665+0000 7f216ab4b640 1 Processor -- start 2024-09-15T23:15:27.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.665+0000 7ffb37423640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffb3015d150 0x7ffb3015d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.665+0000 7ffb37423640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb300cdbc0 con 0x7ffb300d0230 2024-09-15T23:15:27.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.665+0000 7ffb37423640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7ffb301606d0 con 0x7ffb3015d150 2024-09-15T23:15:27.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.665+0000 7fe3ba3ec640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe3b415ed20 0x7fe3b40b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39434/0 (socket says 172.21.15.123:39434) 2024-09-15T23:15:27.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.665+0000 7fe3ba3ec640 1 -- 172.21.15.123:0/2886346152 learned_addr learned my addr 172.21.15.123:0/2886346152 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:27.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.665+0000 7ffb37423640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7ffb301609b0 con 0x7ffb300b42c0 2024-09-15T23:15:27.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.665+0000 7ffb359c0640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffb3015d150 0x7ffb3015d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.665+0000 7ffb359c0640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffb3015d150 0x7ffb3015d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58738/0 (socket says 172.21.15.123:58738) 2024-09-15T23:15:27.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.665+0000 7ffb359c0640 1 -- 172.21.15.123:0/1362659178 learned_addr learned my addr 172.21.15.123:0/1362659178 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:27.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.665+0000 7f216ab4b640 1 -- start start 2024-09-15T23:15:27.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.665+0000 7fe3b9beb640 1 --2- 172.21.15.123:0/2886346152 >> v2:172.21.15.188:3300/0 conn(0x7fe3b40b6970 0x7fe3b40b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.665+0000 7fe3b93ea640 1 -- 172.21.15.123:0/2886346152 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1962778079 0 0) 0x7fe3b0001110 con 0x7fe3b415ed20 2024-09-15T23:15:27.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.665+0000 7ffb351bf640 1 --2- 172.21.15.123:0/1362659178 >> v2:172.21.15.188:3300/0 conn(0x7ffb300b42c0 0x7ffb30160040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.665+0000 7ffb359c0640 1 -- 172.21.15.123:0/1362659178 >> v2:172.21.15.188:3300/0 conn(0x7ffb300b42c0 msgr2=0x7ffb30160040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:27.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.666+0000 7ffb359c0640 1 --2- 172.21.15.123:0/1362659178 >> v2:172.21.15.188:3300/0 conn(0x7ffb300b42c0 0x7ffb30160040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.666+0000 7ffb359c0640 1 -- 172.21.15.123:0/1362659178 >> v1:172.21.15.123:6789/0 conn(0x7ffb300d0230 legacy=0x7ffb300b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:27.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.666+0000 7ffb27fff640 1 -- 172.21.15.123:0/1362659178 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3588302014 0 0) 0x7ffb20001110 con 0x7ffb300d0230 2024-09-15T23:15:27.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.666+0000 7ffb359c0640 1 -- 172.21.15.123:0/1362659178 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb30160c90 con 0x7ffb3015d150 2024-09-15T23:15:27.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.665+0000 7fe3b93ea640 1 -- 172.21.15.123:0/2886346152 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3a0003520 con 0x7fe3b415ed20 2024-09-15T23:15:27.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.666+0000 7fe3b93ea640 1 -- 172.21.15.123:0/2886346152 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3818477463 0 0) 0x7fe3b40d41c0 con 0x7fe3b40d23b0 2024-09-15T23:15:27.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.666+0000 7fe3b93ea640 1 -- 172.21.15.123:0/2886346152 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3b0001110 con 0x7fe3b40d23b0 2024-09-15T23:15:27.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.666+0000 7fe3b9beb640 1 -- 172.21.15.123:0/2886346152 >> v1:172.21.15.188:6789/0 conn(0x7fe3b40d23b0 legacy=0x7fe3b40b8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:27.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.666+0000 7fe3b9beb640 1 -- 172.21.15.123:0/2886346152 >> v1:172.21.15.123:6789/0 conn(0x7fe3b415ed20 legacy=0x7fe3b40b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:27.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.666+0000 7fe3b9beb640 1 -- 172.21.15.123:0/2886346152 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3b40d3890 con 0x7fe3b40b6970 2024-09-15T23:15:27.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.666+0000 7f468cfbd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f468815b320 0x7f46880ce570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.666+0000 7f4685d9b640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f468815b700 0x7f46880b10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39452/0 (socket says 172.21.15.123:39452) 2024-09-15T23:15:27.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.666+0000 7f4685d9b640 1 -- 172.21.15.123:0/1645096348 learned_addr learned my addr 172.21.15.123:0/1645096348 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:27.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.666+0000 7f468cfbd640 1 --2- 172.21.15.123:0/1645096348 >> v2:172.21.15.123:3300/0 conn(0x7f46880720c0 0x7f4688072530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.666+0000 7f468659c640 1 --2- 172.21.15.123:0/1645096348 >> v2:172.21.15.188:3300/0 conn(0x7f468815b320 0x7f46880ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.666+0000 7f468cfbd640 1 -- 172.21.15.123:0/1645096348 --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46880b1c60 con 0x7f468815b700 2024-09-15T23:15:27.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.666+0000 7f4686d9d640 1 --2- 172.21.15.123:0/1645096348 >> v2:172.21.15.123:3300/0 conn(0x7f46880720c0 0x7f4688072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.666+0000 7f468cfbd640 1 -- 172.21.15.123:0/1645096348 --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f4688072a70 con 0x7f46880720c0 2024-09-15T23:15:27.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.666+0000 7f468cfbd640 1 -- 172.21.15.123:0/1645096348 --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f46880b4790 con 0x7f468815b320 2024-09-15T23:15:27.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.667+0000 7f468559a640 1 -- 172.21.15.123:0/1645096348 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1236065354 0 0) 0x7f46880b1c60 con 0x7f468815b700 2024-09-15T23:15:27.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.667+0000 7f468559a640 1 -- 172.21.15.123:0/1645096348 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4670003520 con 0x7f468815b700 2024-09-15T23:15:27.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.667+0000 7ffb359c0640 1 --2- 172.21.15.123:0/1362659178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb3015d150 0x7ffb3015d5e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7ffb300d3730 tx=0x7ffb2802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de6256aa9aca0308 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:27.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.667+0000 7fe3b9beb640 1 --2- 172.21.15.123:0/2886346152 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe3b40b6970 0x7fe3b40b80d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40097a0 tx=0x7fe3a402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f91c5e11865a7a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:27.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.667+0000 7f468559a640 1 -- 172.21.15.123:0/1645096348 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 633183769 0 0) 0x7f4670003520 con 0x7f468815b700 2024-09-15T23:15:27.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.667+0000 7f4686d9d640 1 -- 172.21.15.123:0/1645096348 >> v2:172.21.15.188:3300/0 conn(0x7f468815b320 msgr2=0x7f46880ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:27.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.667+0000 7f4686d9d640 1 --2- 172.21.15.123:0/1645096348 >> v2:172.21.15.188:3300/0 conn(0x7f468815b320 0x7f46880ce570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.667+0000 7f4686d9d640 1 -- 172.21.15.123:0/1645096348 >> v1:172.21.15.123:6789/0 conn(0x7f468815b700 legacy=0x7f46880b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:27.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.667+0000 7f4686d9d640 1 -- 172.21.15.123:0/1645096348 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46880b1f40 con 0x7f46880720c0 2024-09-15T23:15:27.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.667+0000 7f216ab4b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f216415b7e0 0x7f21640b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.667+0000 7ffb27fff640 1 -- 172.21.15.123:0/1362659178 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb28036070 con 0x7ffb3015d150 2024-09-15T23:15:27.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.667+0000 7f216ab4b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f216406f240 0x7f21640b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.667+0000 7ffb27fff640 1 -- 172.21.15.123:0/1362659178 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb28031600 con 0x7ffb3015d150 2024-09-15T23:15:27.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.667+0000 7ffb27fff640 1 -- 172.21.15.123:0/1362659178 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb280319d0 con 0x7ffb3015d150 2024-09-15T23:15:27.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.667+0000 7f216ab4b640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f216415bbc0 con 0x7f21640b73c0 2024-09-15T23:15:27.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.667+0000 7f216ab4b640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f21640cfec0 con 0x7f216406f240 2024-09-15T23:15:27.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.667+0000 7f216ab4b640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f216406e1a0 con 0x7f216415b7e0 2024-09-15T23:15:27.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.667+0000 7fe3b93ea640 1 -- 172.21.15.123:0/2886346152 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a4037070 con 0x7fe3b40b6970 2024-09-15T23:15:27.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.667+0000 7fe3b93ea640 1 -- 172.21.15.123:0/2886346152 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3a4032440 con 0x7fe3b40b6970 2024-09-15T23:15:27.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.667+0000 7fe3b93ea640 1 -- 172.21.15.123:0/2886346152 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3a4032810 con 0x7fe3b40b6970 2024-09-15T23:15:27.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.667+0000 7f21688e7640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f216415b7e0 0x7f21640b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.667+0000 7f21688e7640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f216415b7e0 0x7f21640b3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:56610/0 (socket says 172.21.15.123:56610) 2024-09-15T23:15:27.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.667+0000 7f21690e8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f216406f240 0x7f21640b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.667+0000 7f2163fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f21640b73c0 0x7f216406eb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39464/0 (socket says 172.21.15.123:39464) 2024-09-15T23:15:27.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.667+0000 7f21688e7640 1 -- 172.21.15.123:0/180571299 learned_addr learned my addr 172.21.15.123:0/180571299 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:27.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.667+0000 7f21690e8640 1 -- 172.21.15.123:0/180571299 >> v2:172.21.15.188:3300/0 conn(0x7f216415b7e0 msgr2=0x7f21640b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:27.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.667+0000 7f21690e8640 1 --2- 172.21.15.123:0/180571299 >> v2:172.21.15.188:3300/0 conn(0x7f216415b7e0 0x7f21640b3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.667+0000 7f21690e8640 1 -- 172.21.15.123:0/180571299 >> v1:172.21.15.123:6789/0 conn(0x7f21640b73c0 legacy=0x7f216406eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:27.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.667+0000 7f21690e8640 1 -- 172.21.15.123:0/180571299 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f216406e480 con 0x7f216406f240 2024-09-15T23:15:27.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.668+0000 7ffb37423640 1 -- 172.21.15.123:0/1362659178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb3015d150 msgr2=0x7ffb3015d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:27.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.668+0000 7f4686d9d640 1 --2- 172.21.15.123:0/1645096348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46880720c0 0x7f4688072530 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f4688073a70 tx=0x7f468002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b664ca8ecccc829e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:27.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.668+0000 7ffb37423640 1 --2- 172.21.15.123:0/1362659178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb3015d150 0x7ffb3015d5e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7ffb300d3730 tx=0x7ffb2802a730 comp rx=0 tx=0).stop 2024-09-15T23:15:27.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.668+0000 7fe3bc650640 1 -- 172.21.15.123:0/2886346152 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe3b40b6970 msgr2=0x7fe3b40b80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:27.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.668+0000 7fe3bc650640 1 --2- 172.21.15.123:0/2886346152 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe3b40b6970 0x7fe3b40b80d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40097a0 tx=0x7fe3a402a1a0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.668+0000 7ffb37423640 1 -- 172.21.15.123:0/1362659178 shutdown_connections 2024-09-15T23:15:27.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.668+0000 7f468559a640 1 -- 172.21.15.123:0/1645096348 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f467c001670 con 0x7f46880720c0 2024-09-15T23:15:27.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.668+0000 7ffb37423640 1 --2- 172.21.15.123:0/1362659178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb3015d150 0x7ffb3015d5e0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.668+0000 7ffb37423640 1 --2- 172.21.15.123:0/1362659178 >> v2:172.21.15.188:3300/0 conn(0x7ffb300b42c0 0x7ffb30160040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.668+0000 7ffb37423640 1 -- 172.21.15.123:0/1362659178 >> 172.21.15.123:0/1362659178 conn(0x7ffb30067950 msgr2=0x7ffb30067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:27.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.668+0000 7fe3bc650640 1 -- 172.21.15.123:0/2886346152 shutdown_connections 2024-09-15T23:15:27.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.668+0000 7fe3bc650640 1 --2- 172.21.15.123:0/2886346152 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe3b40b6970 0x7fe3b40b80d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.668+0000 7fe3bc650640 1 -- 172.21.15.123:0/2886346152 >> 172.21.15.123:0/2886346152 conn(0x7fe3b40d1260 msgr2=0x7fe3b40d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:27.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.668+0000 7f468559a640 1 -- 172.21.15.123:0/1645096348 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4680007540 con 0x7f46880720c0 2024-09-15T23:15:27.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.668+0000 7f468559a640 1 -- 172.21.15.123:0/1645096348 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46800078f0 con 0x7f46880720c0 2024-09-15T23:15:27.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.668+0000 7ffb37423640 1 -- 172.21.15.123:0/1362659178 shutdown_connections 2024-09-15T23:15:27.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.668+0000 7fe3bc650640 1 -- 172.21.15.123:0/2886346152 shutdown_connections 2024-09-15T23:15:27.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.668+0000 7ffb37423640 1 -- 172.21.15.123:0/1362659178 wait complete. 2024-09-15T23:15:27.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.668+0000 7fe3bc650640 1 -- 172.21.15.123:0/2886346152 wait complete. 2024-09-15T23:15:27.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.668+0000 7f21690e8640 1 --2- 172.21.15.123:0/180571299 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f216406f240 0x7f21640b48f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f21640d1490 tx=0x7f215c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6d0df651ab3774 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:27.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.669+0000 7f21637fe640 1 -- 172.21.15.123:0/180571299 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215c007740 con 0x7f216406f240 2024-09-15T23:15:27.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.669+0000 7f21637fe640 1 -- 172.21.15.123:0/180571299 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f215c0078e0 con 0x7f216406f240 2024-09-15T23:15:27.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.669+0000 7f21637fe640 1 -- 172.21.15.123:0/180571299 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215c007cb0 con 0x7f216406f240 2024-09-15T23:15:27.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.669+0000 7f468cfbd640 1 -- 172.21.15.123:0/1645096348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46880720c0 msgr2=0x7f4688072530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:27.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.669+0000 7f468cfbd640 1 --2- 172.21.15.123:0/1645096348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46880720c0 0x7f4688072530 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f4688073a70 tx=0x7f468002a610 comp rx=0 tx=0).stop 2024-09-15T23:15:27.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.669+0000 7f468cfbd640 1 -- 172.21.15.123:0/1645096348 shutdown_connections 2024-09-15T23:15:27.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.669+0000 7f468cfbd640 1 --2- 172.21.15.123:0/1645096348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46880720c0 0x7f4688072530 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.669+0000 7f468cfbd640 1 --2- 172.21.15.123:0/1645096348 >> v2:172.21.15.188:3300/0 conn(0x7f468815b320 0x7f46880ce570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.669+0000 7f468cfbd640 1 -- 172.21.15.123:0/1645096348 >> 172.21.15.123:0/1645096348 conn(0x7f468806cd20 msgr2=0x7f468806d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:27.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.669+0000 7f468cfbd640 1 -- 172.21.15.123:0/1645096348 shutdown_connections 2024-09-15T23:15:27.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.669+0000 7f468cfbd640 1 -- 172.21.15.123:0/1645096348 wait complete. 2024-09-15T23:15:27.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.670+0000 7f216ab4b640 1 -- 172.21.15.123:0/180571299 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f216406f240 msgr2=0x7f21640b48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:27.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.670+0000 7f216ab4b640 1 --2- 172.21.15.123:0/180571299 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f216406f240 0x7f21640b48f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f21640d1490 tx=0x7f215c02a710 comp rx=0 tx=0).stop 2024-09-15T23:15:27.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.670+0000 7f216ab4b640 1 -- 172.21.15.123:0/180571299 shutdown_connections 2024-09-15T23:15:27.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.670+0000 7f216ab4b640 1 --2- 172.21.15.123:0/180571299 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f216406f240 0x7f21640b48f0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.670+0000 7f216ab4b640 1 --2- 172.21.15.123:0/180571299 >> v2:172.21.15.188:3300/0 conn(0x7f216415b7e0 0x7f21640b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.670+0000 7f216ab4b640 1 -- 172.21.15.123:0/180571299 >> 172.21.15.123:0/180571299 conn(0x7f21640b3360 msgr2=0x7f21640b3740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:27.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.670+0000 7f216ab4b640 1 -- 172.21.15.123:0/180571299 shutdown_connections 2024-09-15T23:15:27.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.670+0000 7f216ab4b640 1 -- 172.21.15.123:0/180571299 wait complete. 2024-09-15T23:15:27.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.670+0000 7fe3bc650640 1 Processor -- start 2024-09-15T23:15:27.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.670+0000 7ffb37423640 1 Processor -- start 2024-09-15T23:15:27.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.670+0000 7fe3bc650640 1 -- start start 2024-09-15T23:15:27.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.670+0000 7ffb37423640 1 -- start start 2024-09-15T23:15:27.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.672+0000 7f468cfbd640 1 Processor -- start 2024-09-15T23:15:27.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.672+0000 7f468cfbd640 1 -- start start 2024-09-15T23:15:27.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.672+0000 7fe3bc650640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe3b40b6970 0x7fe3b4161fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.672+0000 7ffb37423640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb300b42c0 0x7ffb3014b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.672+0000 7fe3bc650640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe3b40d23b0 0x7fe3b4154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.672+0000 7f216ab4b640 1 Processor -- start 2024-09-15T23:15:27.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.672+0000 7fe3bc650640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3b415ed20 0x7fe3b4159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.672+0000 7f216ab4b640 1 -- start start 2024-09-15T23:15:27.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.672+0000 7fe3bc650640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b40d32a0 con 0x7fe3b415ed20 2024-09-15T23:15:27.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.672+0000 7ffb351bf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb300b42c0 0x7ffb3014b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.672+0000 7fe3bc650640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe3b40d3e50 con 0x7fe3b40d23b0 2024-09-15T23:15:27.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.672+0000 7ffb351bf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb300b42c0 0x7ffb3014b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58772/0 (socket says 172.21.15.123:58772) 2024-09-15T23:15:27.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.672+0000 7ffb37423640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffb300d0230 0x7ffb30156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.672+0000 7fe3babed640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3b415ed20 0x7fe3b4159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.672+0000 7fe3bc650640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe3b415f100 con 0x7fe3b40b6970 2024-09-15T23:15:27.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.672+0000 7fe3babed640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3b415ed20 0x7fe3b4159310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58782/0 (socket says 172.21.15.123:58782) 2024-09-15T23:15:27.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.672+0000 7fe3babed640 1 -- 172.21.15.123:0/4040572910 learned_addr learned my addr 172.21.15.123:0/4040572910 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:27.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.672+0000 7fe3ba3ec640 1 --2- 172.21.15.123:0/4040572910 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe3b40b6970 0x7fe3b4161fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.672+0000 7fe3b9beb640 1 --2- 172.21.15.123:0/4040572910 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe3b40d23b0 0x7fe3b4154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.672+0000 7ffb37423640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffb3015d150 0x7ffb30156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.672+0000 7ffb37423640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ffb300ce4e0 con 0x7ffb300b42c0 2024-09-15T23:15:27.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.672+0000 7ffb37423640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ffb300ce360 con 0x7ffb3015d150 2024-09-15T23:15:27.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.672+0000 7ffb37423640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ffb300ce660 con 0x7ffb300d0230 2024-09-15T23:15:27.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.672+0000 7ffb351bf640 1 -- 172.21.15.123:0/3701184832 learned_addr learned my addr 172.21.15.123:0/3701184832 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:27.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.672+0000 7ffb359c0640 1 --2- 172.21.15.123:0/3701184832 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffb3015d150 0x7ffb30156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.672+0000 7ffb349be640 1 --2- 172.21.15.123:0/3701184832 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffb300d0230 0x7ffb30156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.673+0000 7fe3babed640 1 -- 172.21.15.123:0/4040572910 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe3b40b6970 msgr2=0x7fe3b4161fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:27.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.673+0000 7fe3babed640 1 --2- 172.21.15.123:0/4040572910 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe3b40b6970 0x7fe3b4161fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.673+0000 7fe3babed640 1 -- 172.21.15.123:0/4040572910 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe3b40d23b0 msgr2=0x7fe3b4154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:27.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.673+0000 7fe3babed640 1 --2- 172.21.15.123:0/4040572910 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe3b40d23b0 0x7fe3b4154600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.673+0000 7fe3babed640 1 -- 172.21.15.123:0/4040572910 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3b415c200 con 0x7fe3b415ed20 2024-09-15T23:15:27.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.673+0000 7ffb351bf640 1 -- 172.21.15.123:0/3701184832 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffb300d0230 msgr2=0x7ffb30156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:27.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.673+0000 7ffb351bf640 1 --2- 172.21.15.123:0/3701184832 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffb300d0230 0x7ffb30156030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.673+0000 7ffb351bf640 1 -- 172.21.15.123:0/3701184832 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffb3015d150 msgr2=0x7ffb30156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:27.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.673+0000 7ffb351bf640 1 --2- 172.21.15.123:0/3701184832 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffb3015d150 0x7ffb30156570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.673+0000 7ffb351bf640 1 -- 172.21.15.123:0/3701184832 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb30157160 con 0x7ffb300b42c0 2024-09-15T23:15:27.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.673+0000 7fe3babed640 1 --2- 172.21.15.123:0/4040572910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3b415ed20 0x7fe3b4159310 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac00c7a0 tx=0x7fe3ac00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:27.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.673+0000 7ffb351bf640 1 --2- 172.21.15.123:0/3701184832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb300b42c0 0x7ffb3014b270 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c00d800 tx=0x7ffb2c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:27.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.673+0000 7ffb25ffb640 1 -- 172.21.15.123:0/3701184832 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c00b660 con 0x7ffb300b42c0 2024-09-15T23:15:27.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.673+0000 7fe3aaffd640 1 -- 172.21.15.123:0/4040572910 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac003b70 con 0x7fe3b415ed20 2024-09-15T23:15:27.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.673+0000 7ffb37423640 1 -- 172.21.15.123:0/3701184832 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb30157400 con 0x7ffb300b42c0 2024-09-15T23:15:27.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.673+0000 7ffb25ffb640 1 -- 172.21.15.123:0/3701184832 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb2c019070 con 0x7ffb300b42c0 2024-09-15T23:15:27.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.673+0000 7ffb25ffb640 1 -- 172.21.15.123:0/3701184832 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c00ba20 con 0x7ffb300b42c0 2024-09-15T23:15:27.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.673+0000 7fe3bc650640 1 -- 172.21.15.123:0/4040572910 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3b415f3f0 con 0x7fe3b415ed20 2024-09-15T23:15:27.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.673+0000 7fe3bc650640 1 -- 172.21.15.123:0/4040572910 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3b415fc90 con 0x7fe3b415ed20 2024-09-15T23:15:27.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.674+0000 7f216ab4b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f216406f240 0x7f216414d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.674+0000 7f468cfbd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46880720c0 0x7f46881ef5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.674+0000 7f216ab4b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21640b73c0 0x7f216414dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.674+0000 7f216ab4b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f216415b7e0 0x7f216414e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.674+0000 7f468cfbd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f468815b320 0x7f46880b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.674+0000 7f468cfbd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f468815b700 0x7f46880b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.674+0000 7f216ab4b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f21640d1160 con 0x7f216406f240 2024-09-15T23:15:27.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.674+0000 7f21688e7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f216406f240 0x7f216414d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.674+0000 7f2163fff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21640b73c0 0x7f216414dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.674+0000 7f216ab4b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f21640d0440 con 0x7f216415b7e0 2024-09-15T23:15:27.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.674+0000 7f2163fff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21640b73c0 0x7f216414dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:45848/0 (socket says 172.21.15.123:45848) 2024-09-15T23:15:27.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.674+0000 7f2163fff640 1 -- 172.21.15.123:0/2204260442 learned_addr learned my addr 172.21.15.123:0/2204260442 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:27.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.674+0000 7f21688e7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f216406f240 0x7f216414d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58792/0 (socket says 172.21.15.123:58792) 2024-09-15T23:15:27.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.674+0000 7f216ab4b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f21640b4e30 con 0x7f21640b73c0 2024-09-15T23:15:27.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.674+0000 7f21690e8640 1 --2- 172.21.15.123:0/2204260442 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f216415b7e0 0x7f216414e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.674+0000 7f468659c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46880720c0 0x7f46881ef5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.673+0000 7ffb37423640 1 -- 172.21.15.123:0/3701184832 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb301579c0 con 0x7ffb300b42c0 2024-09-15T23:15:27.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.674+0000 7f468659c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46880720c0 0x7f46881ef5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:56636/0 (socket says 172.21.15.123:56636) 2024-09-15T23:15:27.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.674+0000 7f468659c640 1 -- 172.21.15.123:0/3781190343 learned_addr learned my addr 172.21.15.123:0/3781190343 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:27.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.674+0000 7f468cfbd640 1 -- 172.21.15.123:0/3781190343 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f46880b6bb0 con 0x7f468815b700 2024-09-15T23:15:27.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.674+0000 7f468cfbd640 1 -- 172.21.15.123:0/3781190343 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f46880b4a70 con 0x7f46880720c0 2024-09-15T23:15:27.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.674+0000 7f468cfbd640 1 -- 172.21.15.123:0/3781190343 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f46880ceab0 con 0x7f468815b320 2024-09-15T23:15:27.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.675+0000 7f4686d9d640 1 --2- 172.21.15.123:0/3781190343 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f468815b700 0x7f46880b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.675+0000 7f4685d9b640 1 --2- 172.21.15.123:0/3781190343 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f468815b320 0x7f46880b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.674+0000 7f21690e8640 1 -- 172.21.15.123:0/2204260442 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21640b73c0 msgr2=0x7f216414dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:27.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.674+0000 7f21690e8640 1 --2- 172.21.15.123:0/2204260442 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21640b73c0 0x7f216414dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.674+0000 7f21690e8640 1 -- 172.21.15.123:0/2204260442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f216406f240 msgr2=0x7f216414d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:27.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.674+0000 7f21690e8640 1 --2- 172.21.15.123:0/2204260442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f216406f240 0x7f216414d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.674+0000 7f21690e8640 1 -- 172.21.15.123:0/2204260442 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f216414f860 con 0x7f216415b7e0 2024-09-15T23:15:27.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.674+0000 7f21688e7640 1 --2- 172.21.15.123:0/2204260442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f216406f240 0x7f216414d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:15:27.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.674+0000 7f2163fff640 1 --2- 172.21.15.123:0/2204260442 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21640b73c0 0x7f216414dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:15:27.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.675+0000 7f21690e8640 1 --2- 172.21.15.123:0/2204260442 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f216415b7e0 0x7f216414e280 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f215c031000 tx=0x7f215c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:27.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.675+0000 7ffb37423640 1 -- 172.21.15.123:0/3701184832 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb3015d5e0 con 0x7ffb300b42c0 2024-09-15T23:15:27.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.675+0000 7f468659c640 1 -- 172.21.15.123:0/3781190343 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f468815b320 msgr2=0x7f46880b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:27.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.675+0000 7f468659c640 1 --2- 172.21.15.123:0/3781190343 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f468815b320 0x7f46880b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.675+0000 7f468659c640 1 -- 172.21.15.123:0/3781190343 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f468815b700 msgr2=0x7f46880b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:27.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.675+0000 7f468659c640 1 --2- 172.21.15.123:0/3781190343 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f468815b700 0x7f46880b0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:27.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.675+0000 7f468659c640 1 -- 172.21.15.123:0/3781190343 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46880ace60 con 0x7f46880720c0 2024-09-15T23:15:27.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.675+0000 7f4686d9d640 1 --2- 172.21.15.123:0/3781190343 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f468815b700 0x7f46880b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:27.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.675+0000 7f21617fa640 1 -- 172.21.15.123:0/2204260442 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215c04b020 con 0x7f216415b7e0 2024-09-15T23:15:27.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.675+0000 7f21617fa640 1 -- 172.21.15.123:0/2204260442 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f215c03e4e0 con 0x7f216415b7e0 2024-09-15T23:15:27.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.675+0000 7f468659c640 1 --2- 172.21.15.123:0/3781190343 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46880720c0 0x7f46881ef5a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4678010dc0 tx=0x7f467800e730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:27.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.675+0000 7fe3aaffd640 1 -- 172.21.15.123:0/4040572910 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3ac003d10 con 0x7fe3b415ed20 2024-09-15T23:15:27.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.675+0000 7f4676ffd640 1 -- 172.21.15.123:0/3781190343 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f467801a070 con 0x7f46880720c0 2024-09-15T23:15:27.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.675+0000 7fe3aaffd640 1 -- 172.21.15.123:0/4040572910 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3ac00aa50 con 0x7fe3b415ed20 2024-09-15T23:15:27.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.675+0000 7f4676ffd640 1 -- 172.21.15.123:0/3781190343 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4678015c70 con 0x7f46880720c0 2024-09-15T23:15:27.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.676+0000 7f21617fa640 1 -- 172.21.15.123:0/2204260442 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215c009450 con 0x7f216415b7e0 2024-09-15T23:15:27.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.676+0000 7f4676ffd640 1 -- 172.21.15.123:0/3781190343 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f467801e5d0 con 0x7f46880720c0 2024-09-15T23:15:27.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.676+0000 7f468cfbd640 1 -- 172.21.15.123:0/3781190343 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46881efae0 con 0x7f46880720c0 2024-09-15T23:15:27.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.676+0000 7f216ab4b640 1 -- 172.21.15.123:0/2204260442 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f216414fb00 con 0x7f216415b7e0 2024-09-15T23:15:27.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.676+0000 7f216ab4b640 1 -- 172.21.15.123:0/2204260442 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21641500c0 con 0x7f216415b7e0 2024-09-15T23:15:27.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.676+0000 7f468cfbd640 1 -- 172.21.15.123:0/3781190343 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46880ac530 con 0x7f46880720c0 2024-09-15T23:15:27.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.676+0000 7fe3bc650640 1 -- 172.21.15.123:0/4040572910 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3b415f5c0 con 0x7fe3b415ed20 2024-09-15T23:15:27.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.676+0000 7ffb25ffb640 1 -- 172.21.15.123:0/3701184832 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ffb2c00bbc0 con 0x7ffb300b42c0 2024-09-15T23:15:27.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.677+0000 7fe3aaffd640 1 -- 172.21.15.123:0/4040572910 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe3ac00abf0 con 0x7fe3b415ed20 2024-09-15T23:15:27.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.677+0000 7ffb25ffb640 1 --2- 172.21.15.123:0/3701184832 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ffb1406c2b0 0x7ffb1406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.677+0000 7ffb25ffb640 1 -- 172.21.15.123:0/3701184832 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7ffb2c08c2b0 con 0x7ffb300b42c0 2024-09-15T23:15:27.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.677+0000 7f468cfbd640 1 -- 172.21.15.123:0/3781190343 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4688072530 con 0x7f46880720c0 2024-09-15T23:15:27.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.677+0000 7ffb349be640 1 --2- 172.21.15.123:0/3701184832 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ffb1406c2b0 0x7ffb1406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.677+0000 7fe3aaffd640 1 --2- 172.21.15.123:0/4040572910 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe39806c2b0 0x7fe39806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.678+0000 7fe3aaffd640 1 -- 172.21.15.123:0/4040572910 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7fe3ac08b250 con 0x7fe3b415ed20 2024-09-15T23:15:27.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.678+0000 7fe3ba3ec640 1 --2- 172.21.15.123:0/4040572910 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe39806c2b0 0x7fe39806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.678+0000 7f216ab4b640 1 -- 172.21.15.123:0/2204260442 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21640b48f0 con 0x7f216415b7e0 2024-09-15T23:15:27.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.678+0000 7ffb349be640 1 --2- 172.21.15.123:0/3701184832 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ffb1406c2b0 0x7ffb1406e770 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ffb300d1300 tx=0x7ffb20009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:27.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.678+0000 7f4676ffd640 1 -- 172.21.15.123:0/3781190343 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f467801d070 con 0x7f46880720c0 2024-09-15T23:15:27.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.678+0000 7f21617fa640 1 -- 172.21.15.123:0/2204260442 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f215c04e020 con 0x7f216415b7e0 2024-09-15T23:15:27.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.678+0000 7fe3ba3ec640 1 --2- 172.21.15.123:0/4040572910 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe39806c2b0 0x7fe39806e770 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0005880 tx=0x7fe3b0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:27.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.679+0000 7f4676ffd640 1 --2- 172.21.15.123:0/3781190343 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f466806c330 0x7f466806e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.679+0000 7f21617fa640 1 --2- 172.21.15.123:0/2204260442 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f214806c2b0 0x7f214806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:27.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.679+0000 7f4676ffd640 1 -- 172.21.15.123:0/3781190343 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7f467808ff20 con 0x7f46880720c0 2024-09-15T23:15:27.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.679+0000 7f4685d9b640 1 --2- 172.21.15.123:0/3781190343 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f466806c330 0x7f466806e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.679+0000 7f21688e7640 1 --2- 172.21.15.123:0/2204260442 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f214806c2b0 0x7f214806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:27.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.679+0000 7f21617fa640 1 -- 172.21.15.123:0/2204260442 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5709+0+0 (secure 0 0 0) 0x7f215c0b4df0 con 0x7f216415b7e0 2024-09-15T23:15:27.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.679+0000 7f4685d9b640 1 --2- 172.21.15.123:0/3781190343 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f466806c330 0x7f466806e7f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f467c0017e0 tx=0x7f467c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:27.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.679+0000 7f21688e7640 1 --2- 172.21.15.123:0/2204260442 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f214806c2b0 0x7f214806e770 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2158009f20 tx=0x7f2158008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:27.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.681+0000 7ffb25ffb640 1 -- 172.21.15.123:0/3701184832 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffb2c05aa90 con 0x7ffb300b42c0 2024-09-15T23:15:27.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.683+0000 7f4676ffd640 1 -- 172.21.15.123:0/3781190343 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f46880ace60 con 0x7f46880720c0 2024-09-15T23:15:27.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.685+0000 7fe3aaffd640 1 -- 172.21.15.123:0/4040572910 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe3ac0592d0 con 0x7fe3b415ed20 2024-09-15T23:15:27.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.688+0000 7f21617fa640 1 -- 172.21.15.123:0/2204260442 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f215c055030 con 0x7f216415b7e0 2024-09-15T23:15:27.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.924+0000 7f468cfbd640 1 -- 172.21.15.123:0/3781190343 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) -- 0x7f4688068680 con 0x7f46880720c0 2024-09-15T23:15:27.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.925+0000 7ffb37423640 1 -- 172.21.15.123:0/3701184832 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) -- 0x7ffb30073fb0 con 0x7ffb300b42c0 2024-09-15T23:15:27.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.927+0000 7fe3bc650640 1 -- 172.21.15.123:0/4040572910 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) -- 0x7fe3b40d21a0 con 0x7fe3b415ed20 2024-09-15T23:15:27.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:27.927+0000 7f216ab4b640 1 -- 172.21.15.123:0/2204260442 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) -- 0x7f2164072d90 con 0x7f216415b7e0 2024-09-15T23:15:28.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.655+0000 7ffb25ffb640 1 -- 172.21.15.123:0/3701184832 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 6162 v31) ==== 95+0+0 (secure 0 0 0) 0x7ffb2c05a390 con 0x7ffb300b42c0 2024-09-15T23:15:28.657 INFO:teuthology.orchestra.run.smithi123.stderr:failed mds gid 6162 2024-09-15T23:15:28.658 INFO:tasks.ceph.mon.a.smithi123.stderr:2024-09-15T23:15:28.657+0000 7f8a6a4eb640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:15:28.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.658+0000 7ffb37423640 1 -- 172.21.15.123:0/3701184832 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ffb1406c2b0 msgr2=0x7ffb1406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:28.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.658+0000 7ffb37423640 1 --2- 172.21.15.123:0/3701184832 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ffb1406c2b0 0x7ffb1406e770 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ffb300d1300 tx=0x7ffb20009040 comp rx=0 tx=0).stop 2024-09-15T23:15:28.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.658+0000 7ffb37423640 1 -- 172.21.15.123:0/3701184832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb300b42c0 msgr2=0x7ffb3014b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:28.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.658+0000 7ffb37423640 1 --2- 172.21.15.123:0/3701184832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb300b42c0 0x7ffb3014b270 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c00d800 tx=0x7ffb2c00dcc0 comp rx=0 tx=0).stop 2024-09-15T23:15:28.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.658+0000 7ffb37423640 1 -- 172.21.15.123:0/3701184832 shutdown_connections 2024-09-15T23:15:28.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.658+0000 7ffb37423640 1 --2- 172.21.15.123:0/3701184832 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffb3015d150 0x7ffb30156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:28.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.658+0000 7ffb37423640 1 --2- 172.21.15.123:0/3701184832 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffb300d0230 0x7ffb30156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:28.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.658+0000 7ffb37423640 1 --2- 172.21.15.123:0/3701184832 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ffb1406c2b0 0x7ffb1406e770 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:28.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.658+0000 7ffb37423640 1 --2- 172.21.15.123:0/3701184832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb300b42c0 0x7ffb3014b270 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:28.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.658+0000 7ffb37423640 1 -- 172.21.15.123:0/3701184832 >> 172.21.15.123:0/3701184832 conn(0x7ffb30067950 msgr2=0x7ffb300b46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:28.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.658+0000 7ffb37423640 1 -- 172.21.15.123:0/3701184832 shutdown_connections 2024-09-15T23:15:28.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.658+0000 7ffb37423640 1 -- 172.21.15.123:0/3701184832 wait complete. 2024-09-15T23:15:28.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.663+0000 7f4676ffd640 1 -- 172.21.15.123:0/3781190343 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 6165 v32) ==== 95+0+0 (secure 0 0 0) 0x7f467800b070 con 0x7f46880720c0 2024-09-15T23:15:28.665 INFO:teuthology.orchestra.run.smithi123.stderr:failed mds gid 6165 2024-09-15T23:15:28.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.667+0000 7f468cfbd640 1 -- 172.21.15.123:0/3781190343 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f466806c330 msgr2=0x7f466806e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:28.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.667+0000 7f468cfbd640 1 --2- 172.21.15.123:0/3781190343 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f466806c330 0x7f466806e7f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f467c0017e0 tx=0x7f467c009040 comp rx=0 tx=0).stop 2024-09-15T23:15:28.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.667+0000 7f468cfbd640 1 -- 172.21.15.123:0/3781190343 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46880720c0 msgr2=0x7f46881ef5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:28.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.667+0000 7f468cfbd640 1 --2- 172.21.15.123:0/3781190343 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46880720c0 0x7f46881ef5a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4678010dc0 tx=0x7f467800e730 comp rx=0 tx=0).stop 2024-09-15T23:15:28.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.667+0000 7f468cfbd640 1 -- 172.21.15.123:0/3781190343 shutdown_connections 2024-09-15T23:15:28.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.667+0000 7f468cfbd640 1 --2- 172.21.15.123:0/3781190343 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f466806c330 0x7f466806e7f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:28.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.667+0000 7f468cfbd640 1 --2- 172.21.15.123:0/3781190343 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f468815b700 0x7f46880b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:28.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.667+0000 7f468cfbd640 1 --2- 172.21.15.123:0/3781190343 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f468815b320 0x7f46880b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:28.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.667+0000 7f468cfbd640 1 --2- 172.21.15.123:0/3781190343 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46880720c0 0x7f46881ef5a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:28.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.667+0000 7f468cfbd640 1 -- 172.21.15.123:0/3781190343 >> 172.21.15.123:0/3781190343 conn(0x7f468806cd20 msgr2=0x7f468806de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:28.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.667+0000 7f468cfbd640 1 -- 172.21.15.123:0/3781190343 shutdown_connections 2024-09-15T23:15:28.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.667+0000 7f468cfbd640 1 -- 172.21.15.123:0/3781190343 wait complete. 2024-09-15T23:15:28.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.669+0000 7fe3aaffd640 1 -- 172.21.15.123:0/4040572910 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 5665 v33) ==== 95+0+0 (secure 0 0 0) 0x7fe3ac05d5d0 con 0x7fe3b415ed20 2024-09-15T23:15:28.670 INFO:teuthology.orchestra.run.smithi123.stderr:failed mds gid 5665 2024-09-15T23:15:28.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.672+0000 7fe3bc650640 1 -- 172.21.15.123:0/4040572910 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe39806c2b0 msgr2=0x7fe39806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:28.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.672+0000 7fe3bc650640 1 --2- 172.21.15.123:0/4040572910 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe39806c2b0 0x7fe39806e770 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe3b0005880 tx=0x7fe3b0009040 comp rx=0 tx=0).stop 2024-09-15T23:15:28.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.672+0000 7fe3bc650640 1 -- 172.21.15.123:0/4040572910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3b415ed20 msgr2=0x7fe3b4159310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:28.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.672+0000 7fe3bc650640 1 --2- 172.21.15.123:0/4040572910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3b415ed20 0x7fe3b4159310 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fe3ac00c7a0 tx=0x7fe3ac00cc60 comp rx=0 tx=0).stop 2024-09-15T23:15:28.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.672+0000 7fe3bc650640 1 -- 172.21.15.123:0/4040572910 shutdown_connections 2024-09-15T23:15:28.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.672+0000 7fe3bc650640 1 --2- 172.21.15.123:0/4040572910 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe39806c2b0 0x7fe39806e770 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:28.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.672+0000 7fe3bc650640 1 --2- 172.21.15.123:0/4040572910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3b415ed20 0x7fe3b4159310 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:28.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.672+0000 7fe3bc650640 1 --2- 172.21.15.123:0/4040572910 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe3b40d23b0 0x7fe3b4154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:28.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.672+0000 7fe3bc650640 1 --2- 172.21.15.123:0/4040572910 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe3b40b6970 0x7fe3b4161fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:28.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.672+0000 7fe3bc650640 1 -- 172.21.15.123:0/4040572910 >> 172.21.15.123:0/4040572910 conn(0x7fe3b40d1260 msgr2=0x7fe3b415c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:28.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.673+0000 7fe3bc650640 1 -- 172.21.15.123:0/4040572910 shutdown_connections 2024-09-15T23:15:28.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:28.673+0000 7fe3bc650640 1 -- 172.21.15.123:0/4040572910 wait complete. 2024-09-15T23:15:28.676 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T23:15:28.676 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T23:15:28.678 INFO:tasks.ceph.mds.c:Started 2024-09-15T23:15:28.678 DEBUG:teuthology.parallel:result is None 2024-09-15T23:15:28.686 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T23:15:28.686 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T23:15:28.690 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T23:15:28.690 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T23:15:28.692 INFO:tasks.ceph.mds.b:Started 2024-09-15T23:15:28.693 DEBUG:teuthology.parallel:result is None 2024-09-15T23:15:28.731 INFO:tasks.ceph.mds.a:Started 2024-09-15T23:15:28.731 DEBUG:teuthology.parallel:result is None 2024-09-15T23:15:28.753 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-15T23:15:28.773 INFO:tasks.ceph.mds.b.smithi188.stdout:starting mds.b at 2024-09-15T23:15:28.806 INFO:tasks.ceph.mds.a.smithi123.stdout:starting mds.a at 2024-09-15T23:15:29.652 INFO:tasks.ceph.mon.a.smithi123.stderr:2024-09-15T23:15:29.651+0000 7f8a6a4eb640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:15:29.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.656+0000 7f21617fa640 1 -- 172.21.15.123:0/2204260442 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 5339 v34) ==== 95+0+0 (secure 0 0 0) 0x7f215c082fa0 con 0x7f216415b7e0 2024-09-15T23:15:29.657 INFO:teuthology.orchestra.run.smithi123.stderr:failed mds gid 5339 2024-09-15T23:15:29.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.659+0000 7f216ab4b640 1 -- 172.21.15.123:0/2204260442 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f214806c2b0 msgr2=0x7f214806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:29.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.659+0000 7f216ab4b640 1 --2- 172.21.15.123:0/2204260442 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f214806c2b0 0x7f214806e770 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2158009f20 tx=0x7f2158008040 comp rx=0 tx=0).stop 2024-09-15T23:15:29.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.659+0000 7f216ab4b640 1 -- 172.21.15.123:0/2204260442 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f216415b7e0 msgr2=0x7f216414e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:29.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.659+0000 7f216ab4b640 1 --2- 172.21.15.123:0/2204260442 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f216415b7e0 0x7f216414e280 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f215c031000 tx=0x7f215c004a40 comp rx=0 tx=0).stop 2024-09-15T23:15:29.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.659+0000 7f216ab4b640 1 -- 172.21.15.123:0/2204260442 shutdown_connections 2024-09-15T23:15:29.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.659+0000 7f216ab4b640 1 --2- 172.21.15.123:0/2204260442 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f216415b7e0 0x7f216414e280 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:29.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.659+0000 7f216ab4b640 1 --2- 172.21.15.123:0/2204260442 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21640b73c0 0x7f216414dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:29.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.659+0000 7f216ab4b640 1 --2- 172.21.15.123:0/2204260442 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f214806c2b0 0x7f214806e770 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:29.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.659+0000 7f216ab4b640 1 --2- 172.21.15.123:0/2204260442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f216406f240 0x7f216414d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:29.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.659+0000 7f216ab4b640 1 -- 172.21.15.123:0/2204260442 >> 172.21.15.123:0/2204260442 conn(0x7f21640b3360 msgr2=0x7f216406f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:29.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.659+0000 7f216ab4b640 1 -- 172.21.15.123:0/2204260442 shutdown_connections 2024-09-15T23:15:29.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.659+0000 7f216ab4b640 1 -- 172.21.15.123:0/2204260442 wait complete. 2024-09-15T23:15:29.677 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T23:15:29.677 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T23:15:29.679 INFO:tasks.ceph.mds.d:Started 2024-09-15T23:15:29.680 DEBUG:teuthology.parallel:result is None 2024-09-15T23:15:29.680 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:15:29.757 INFO:tasks.ceph.mds.d.smithi188.stdout:starting mds.d at 2024-09-15T23:15:29.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.821+0000 7f56d0aaf640 1 Processor -- start 2024-09-15T23:15:29.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.821+0000 7f56d0aaf640 1 -- start start 2024-09-15T23:15:29.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.822+0000 7f56d0aaf640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f56cc15e6d0 0x7f56cc071390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:29.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.822+0000 7f56d0aaf640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f56cc070b80 0x7f56cc1622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:29.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.822+0000 7f56d0aaf640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56cc15eab0 con 0x7f56cc06cd20 2024-09-15T23:15:29.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.822+0000 7f56d0aaf640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f56cc15ed70 con 0x7f56cc15e6d0 2024-09-15T23:15:29.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.822+0000 7f56d0aaf640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f56cc15f050 con 0x7f56cc070b80 2024-09-15T23:15:29.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.822+0000 7f56ca59c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f56cc15e6d0 0x7f56cc071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:29.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.822+0000 7f56c9d9b640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f56cc06cd20 0x7f56cc0b6d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39486/0 (socket says 172.21.15.123:39486) 2024-09-15T23:15:29.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.822+0000 7f56ca59c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f56cc15e6d0 0x7f56cc071390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58832/0 (socket says 172.21.15.123:58832) 2024-09-15T23:15:29.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.822+0000 7f56c9d9b640 1 -- 172.21.15.123:0/2148312848 learned_addr learned my addr 172.21.15.123:0/2148312848 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:29.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.822+0000 7f56cad9d640 1 --2- 172.21.15.123:0/2148312848 >> v2:172.21.15.188:3300/0 conn(0x7f56cc070b80 0x7f56cc1622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:29.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.822+0000 7f56ca59c640 1 -- 172.21.15.123:0/2148312848 >> v2:172.21.15.188:3300/0 conn(0x7f56cc070b80 msgr2=0x7f56cc1622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:29.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.822+0000 7f56ca59c640 1 --2- 172.21.15.123:0/2148312848 >> v2:172.21.15.188:3300/0 conn(0x7f56cc070b80 0x7f56cc1622a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:29.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.822+0000 7f56ca59c640 1 -- 172.21.15.123:0/2148312848 >> v1:172.21.15.123:6789/0 conn(0x7f56cc06cd20 legacy=0x7f56cc0b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:29.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.822+0000 7f56ca59c640 1 -- 172.21.15.123:0/2148312848 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56cc15f330 con 0x7f56cc15e6d0 2024-09-15T23:15:29.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.822+0000 7f56c959a640 1 -- 172.21.15.123:0/2148312848 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2024636312 0 0) 0x7f56cc15eab0 con 0x7f56cc06cd20 2024-09-15T23:15:29.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.822+0000 7f56cad9d640 1 --2- 172.21.15.123:0/2148312848 >> v2:172.21.15.188:3300/0 conn(0x7f56cc070b80 0x7f56cc1622a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:29.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.823+0000 7f56ca59c640 1 --2- 172.21.15.123:0/2148312848 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56cc15e6d0 0x7f56cc071390 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f56cc0710d0 tx=0x7f56bc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66e3f49de412ffcf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:29.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.823+0000 7f56c959a640 1 -- 172.21.15.123:0/2148312848 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56bc037070 con 0x7f56cc15e6d0 2024-09-15T23:15:29.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.823+0000 7f56c959a640 1 -- 172.21.15.123:0/2148312848 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56bc032440 con 0x7f56cc15e6d0 2024-09-15T23:15:29.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.823+0000 7f56c959a640 1 -- 172.21.15.123:0/2148312848 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56bc032810 con 0x7f56cc15e6d0 2024-09-15T23:15:29.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.824+0000 7f56d0aaf640 1 -- 172.21.15.123:0/2148312848 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56cc15e6d0 msgr2=0x7f56cc071390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:29.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.824+0000 7f56d0aaf640 1 --2- 172.21.15.123:0/2148312848 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56cc15e6d0 0x7f56cc071390 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f56cc0710d0 tx=0x7f56bc02a1a0 comp rx=0 tx=0).stop 2024-09-15T23:15:29.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.824+0000 7f56d0aaf640 1 -- 172.21.15.123:0/2148312848 shutdown_connections 2024-09-15T23:15:29.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.824+0000 7f56d0aaf640 1 --2- 172.21.15.123:0/2148312848 >> v2:172.21.15.188:3300/0 conn(0x7f56cc070b80 0x7f56cc1622a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:29.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.824+0000 7f56d0aaf640 1 --2- 172.21.15.123:0/2148312848 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56cc15e6d0 0x7f56cc071390 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:29.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.824+0000 7f56d0aaf640 1 -- 172.21.15.123:0/2148312848 >> 172.21.15.123:0/2148312848 conn(0x7f56cc067fb0 msgr2=0x7f56cc06f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:29.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.824+0000 7f56d0aaf640 1 -- 172.21.15.123:0/2148312848 shutdown_connections 2024-09-15T23:15:29.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.824+0000 7f56d0aaf640 1 -- 172.21.15.123:0/2148312848 wait complete. 2024-09-15T23:15:29.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.825+0000 7f56d0aaf640 1 Processor -- start 2024-09-15T23:15:29.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.825+0000 7f56d0aaf640 1 -- start start 2024-09-15T23:15:29.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.826+0000 7f56d0aaf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56cc06cd20 0x7f56cc14fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:29.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.826+0000 7f56d0aaf640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56cc070b80 0x7f56cc1f85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.826+0000 7f56d0aaf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f56cc15e6d0 0x7f56cc0b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.826+0000 7f56d0aaf640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f56cc0718d0 con 0x7f56cc06cd20 2024-09-15T23:15:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.826+0000 7f56d0aaf640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f56cc15f8f0 con 0x7f56cc15e6d0 2024-09-15T23:15:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.826+0000 7f56d0aaf640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f56cc071a50 con 0x7f56cc070b80 2024-09-15T23:15:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.826+0000 7f56ca59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56cc06cd20 0x7f56cc14fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.826+0000 7f56ca59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56cc06cd20 0x7f56cc14fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58842/0 (socket says 172.21.15.123:58842) 2024-09-15T23:15:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.826+0000 7f56ca59c640 1 -- 172.21.15.123:0/857988850 learned_addr learned my addr 172.21.15.123:0/857988850 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.826+0000 7f56c9d9b640 1 --2- 172.21.15.123:0/857988850 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56cc070b80 0x7f56cc1f85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.826+0000 7f56cad9d640 1 --2- 172.21.15.123:0/857988850 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f56cc15e6d0 0x7f56cc0b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.826+0000 7f56ca59c640 1 -- 172.21.15.123:0/857988850 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56cc070b80 msgr2=0x7f56cc1f85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.826+0000 7f56ca59c640 1 --2- 172.21.15.123:0/857988850 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56cc070b80 0x7f56cc1f85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.826+0000 7f56ca59c640 1 -- 172.21.15.123:0/857988850 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f56cc15e6d0 msgr2=0x7f56cc0b42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.826+0000 7f56ca59c640 1 --2- 172.21.15.123:0/857988850 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f56cc15e6d0 0x7f56cc0b42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:29.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.827+0000 7f56ca59c640 1 -- 172.21.15.123:0/857988850 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56cc1f8ae0 con 0x7f56cc06cd20 2024-09-15T23:15:29.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.827+0000 7f56cad9d640 1 --2- 172.21.15.123:0/857988850 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f56cc15e6d0 0x7f56cc0b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:29.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.827+0000 7f56c9d9b640 1 --2- 172.21.15.123:0/857988850 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56cc070b80 0x7f56cc1f85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:29.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.827+0000 7f56ca59c640 1 --2- 172.21.15.123:0/857988850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56cc06cd20 0x7f56cc14fe30 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f56bc035040 tx=0x7f56bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:29.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.827+0000 7f56baffd640 1 -- 172.21.15.123:0/857988850 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56bc037050 con 0x7f56cc06cd20 2024-09-15T23:15:29.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.827+0000 7f56baffd640 1 -- 172.21.15.123:0/857988850 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56bc038040 con 0x7f56cc06cd20 2024-09-15T23:15:29.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.827+0000 7f56baffd640 1 -- 172.21.15.123:0/857988850 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56bc006e10 con 0x7f56cc06cd20 2024-09-15T23:15:29.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.827+0000 7f56d0aaf640 1 -- 172.21.15.123:0/857988850 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56cc1507f0 con 0x7f56cc06cd20 2024-09-15T23:15:29.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.827+0000 7f56d0aaf640 1 -- 172.21.15.123:0/857988850 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56cc155a20 con 0x7f56cc06cd20 2024-09-15T23:15:29.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.828+0000 7f56d0aaf640 1 -- 172.21.15.123:0/857988850 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56cc071390 con 0x7f56cc06cd20 2024-09-15T23:15:29.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.828+0000 7f56baffd640 1 -- 172.21.15.123:0/857988850 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f56bc030980 con 0x7f56cc06cd20 2024-09-15T23:15:29.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.829+0000 7f56baffd640 1 --2- 172.21.15.123:0/857988850 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f56ac06c2b0 0x7f56ac06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:29.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.829+0000 7f56baffd640 1 -- 172.21.15.123:0/857988850 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5881+0+0 (secure 0 0 0) 0x7f56bc0abf50 con 0x7f56cc06cd20 2024-09-15T23:15:29.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.829+0000 7f56c9d9b640 1 --2- 172.21.15.123:0/857988850 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f56ac06c2b0 0x7f56ac06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:29.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.830+0000 7f56c9d9b640 1 --2- 172.21.15.123:0/857988850 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f56ac06c2b0 0x7f56ac06e770 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f56cc150d30 tx=0x7f56c0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:29.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:29.833+0000 7f56baffd640 1 -- 172.21.15.123:0/857988850 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f56cc1507f0 con 0x7f56cc06cd20 2024-09-15T23:15:30.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:30.032+0000 7f56d0aaf640 1 -- 172.21.15.123:0/857988850 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56cc160950 con 0x7f56cc06cd20 2024-09-15T23:15:30.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:30.033+0000 7f56baffd640 1 -- 172.21.15.123:0/857988850 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+4395 (secure 0 0 0) 0x7f56bc07a7c0 con 0x7f56cc06cd20 2024-09-15T23:15:30.034 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:30.034 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":35,"btime":"2024-09-15T23:15:29:656720+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5483,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/522636413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":522636413},{"type":"v1","addr":"172.21.15.188:6835","nonce":522636413}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":6399,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/811728648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":811728648},{"type":"v1","addr":"172.21.15.123:6833","nonce":811728648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:15:17.752297+0000","modified":"2024-09-15T23:15:29.656703+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6411":{"gid":6411,"name":"a","rank":0,"incarnation":35,"state":"up:replay","state_seq":1,"addr":"172.21.15.123:6835/3634063333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3634063333},{"type":"v1","addr":"172.21.15.123:6835","nonce":3634063333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":4}]} 2024-09-15T23:15:30.034 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 35 2024-09-15T23:15:30.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:30.035+0000 7f56d0aaf640 1 -- 172.21.15.123:0/857988850 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f56ac06c2b0 msgr2=0x7f56ac06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:30.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:30.035+0000 7f56d0aaf640 1 --2- 172.21.15.123:0/857988850 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f56ac06c2b0 0x7f56ac06e770 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f56cc150d30 tx=0x7f56c0009040 comp rx=0 tx=0).stop 2024-09-15T23:15:30.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:30.035+0000 7f56d0aaf640 1 -- 172.21.15.123:0/857988850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56cc06cd20 msgr2=0x7f56cc14fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:30.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:30.035+0000 7f56d0aaf640 1 --2- 172.21.15.123:0/857988850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56cc06cd20 0x7f56cc14fe30 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f56bc035040 tx=0x7f56bc0046c0 comp rx=0 tx=0).stop 2024-09-15T23:15:30.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:30.035+0000 7f56d0aaf640 1 -- 172.21.15.123:0/857988850 shutdown_connections 2024-09-15T23:15:30.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:30.035+0000 7f56d0aaf640 1 --2- 172.21.15.123:0/857988850 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f56cc15e6d0 0x7f56cc0b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:30.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:30.035+0000 7f56d0aaf640 1 --2- 172.21.15.123:0/857988850 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56cc070b80 0x7f56cc1f85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:30.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:30.035+0000 7f56d0aaf640 1 --2- 172.21.15.123:0/857988850 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f56ac06c2b0 0x7f56ac06e770 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:30.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:30.035+0000 7f56d0aaf640 1 --2- 172.21.15.123:0/857988850 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56cc06cd20 0x7f56cc14fe30 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:30.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:30.035+0000 7f56d0aaf640 1 -- 172.21.15.123:0/857988850 >> 172.21.15.123:0/857988850 conn(0x7f56cc067fb0 msgr2=0x7f56cc161fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:30.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:30.035+0000 7f56d0aaf640 1 -- 172.21.15.123:0/857988850 shutdown_connections 2024-09-15T23:15:30.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:30.035+0000 7f56d0aaf640 1 -- 172.21.15.123:0/857988850 wait complete. 2024-09-15T23:15:30.450 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 35, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:15:17.752297+0000', 'modified': '2024-09-15T23:15:29.656703+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 70, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6411}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6411': {'gid': 6411, 'name': 'a', 'rank': 0, 'incarnation': 35, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.123:6835/3634063333', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6834', 'nonce': 3634063333}, {'type': 'v1', 'addr': '172.21.15.123:6835', 'nonce': 3634063333}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-15T23:15:30.450 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6411:up:replay 2024-09-15T23:15:31.451 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:15:31.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.561+0000 7f9f9ba53640 1 Processor -- start 2024-09-15T23:15:31.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.562+0000 7f9f9ba53640 1 -- start start 2024-09-15T23:15:31.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.563+0000 7f9f9ba53640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9f940b2d40 0x7f9f9406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:31.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.563+0000 7f9f9ba53640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9f9413eb20 0x7f9f9406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:31.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.563+0000 7f9f9ba53640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f9f9415bcf0 0x7f9f9415c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:31.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.563+0000 7f9f9ba53640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f9f94071ab0 con 0x7f9f940b2d40 2024-09-15T23:15:31.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.563+0000 7f9f9ba53640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f9f94071180 con 0x7f9f9415bcf0 2024-09-15T23:15:31.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.563+0000 7f9f9ba53640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9f94071460 con 0x7f9f9413eb20 2024-09-15T23:15:31.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.563+0000 7f9f997ef640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9f940b2d40 0x7f9f9406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:31.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.563+0000 7f9f997ef640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9f940b2d40 0x7f9f9406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58848/0 (socket says 172.21.15.123:58848) 2024-09-15T23:15:31.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.563+0000 7f9f997ef640 1 -- 172.21.15.123:0/1330932426 learned_addr learned my addr 172.21.15.123:0/1330932426 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:31.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.563+0000 7f9f99ff0640 1 --2- 172.21.15.123:0/1330932426 >> v2:172.21.15.188:3300/0 conn(0x7f9f9415bcf0 0x7f9f9415c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:31.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.563+0000 7f9f98fee640 1 --2- 172.21.15.123:0/1330932426 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9f9413eb20 0x7f9f9406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:31.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.563+0000 7f9f997ef640 1 -- 172.21.15.123:0/1330932426 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9f9413eb20 msgr2=0x7f9f9406c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:31.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.563+0000 7f9f997ef640 1 --2- 172.21.15.123:0/1330932426 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9f9413eb20 0x7f9f9406c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:31.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.563+0000 7f9f997ef640 1 -- 172.21.15.123:0/1330932426 >> v2:172.21.15.188:3300/0 conn(0x7f9f9415bcf0 msgr2=0x7f9f9415c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:31.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.563+0000 7f9f997ef640 1 --2- 172.21.15.123:0/1330932426 >> v2:172.21.15.188:3300/0 conn(0x7f9f9415bcf0 0x7f9f9415c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:31.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.563+0000 7f9f997ef640 1 -- 172.21.15.123:0/1330932426 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f94071740 con 0x7f9f940b2d40 2024-09-15T23:15:31.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.563+0000 7f9f99ff0640 1 --2- 172.21.15.123:0/1330932426 >> v2:172.21.15.188:3300/0 conn(0x7f9f9415bcf0 0x7f9f9415c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:31.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.563+0000 7f9f98fee640 1 --2- 172.21.15.123:0/1330932426 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9f9413eb20 0x7f9f9406c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:31.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.564+0000 7f9f997ef640 1 --2- 172.21.15.123:0/1330932426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f940b2d40 0x7f9f9406bc10 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f9f941595c0 tx=0x7f9f9002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3671223c2139547c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:31.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.564+0000 7f9f8bfff640 1 -- 172.21.15.123:0/1330932426 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f90037070 con 0x7f9f940b2d40 2024-09-15T23:15:31.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.564+0000 7f9f8bfff640 1 -- 172.21.15.123:0/1330932426 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f90032440 con 0x7f9f940b2d40 2024-09-15T23:15:31.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.564+0000 7f9f8bfff640 1 -- 172.21.15.123:0/1330932426 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f90032810 con 0x7f9f940b2d40 2024-09-15T23:15:31.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.564+0000 7f9f9ba53640 1 -- 172.21.15.123:0/1330932426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f940b2d40 msgr2=0x7f9f9406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:31.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.564+0000 7f9f9ba53640 1 --2- 172.21.15.123:0/1330932426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f940b2d40 0x7f9f9406bc10 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f9f941595c0 tx=0x7f9f9002a1e0 comp rx=0 tx=0).stop 2024-09-15T23:15:31.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.565+0000 7f9f9ba53640 1 -- 172.21.15.123:0/1330932426 shutdown_connections 2024-09-15T23:15:31.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.565+0000 7f9f9ba53640 1 --2- 172.21.15.123:0/1330932426 >> v2:172.21.15.188:3300/0 conn(0x7f9f9415bcf0 0x7f9f9415c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:31.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.565+0000 7f9f9ba53640 1 --2- 172.21.15.123:0/1330932426 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9f9413eb20 0x7f9f9406c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:31.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.565+0000 7f9f9ba53640 1 --2- 172.21.15.123:0/1330932426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f940b2d40 0x7f9f9406bc10 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:31.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.565+0000 7f9f9ba53640 1 -- 172.21.15.123:0/1330932426 >> 172.21.15.123:0/1330932426 conn(0x7f9f940ccec0 msgr2=0x7f9f940cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:31.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.565+0000 7f9f9ba53640 1 -- 172.21.15.123:0/1330932426 shutdown_connections 2024-09-15T23:15:31.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.565+0000 7f9f9ba53640 1 -- 172.21.15.123:0/1330932426 wait complete. 2024-09-15T23:15:31.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.566+0000 7f9f9ba53640 1 Processor -- start 2024-09-15T23:15:31.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.566+0000 7f9f9ba53640 1 -- start start 2024-09-15T23:15:31.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.567+0000 7f9f9ba53640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9f940b2d40 0x7f9f94154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:31.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.567+0000 7f9f9ba53640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f9413eb20 0x7f9f94158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:31.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.567+0000 7f9f9ba53640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9f9415bcf0 0x7f9f94155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:31.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.567+0000 7f9f9ba53640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9415f140 con 0x7f9f9413eb20 2024-09-15T23:15:31.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.567+0000 7f9f9ba53640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9415efc0 con 0x7f9f9415bcf0 2024-09-15T23:15:31.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.567+0000 7f9f9ba53640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9f9415f2c0 con 0x7f9f940b2d40 2024-09-15T23:15:31.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.567+0000 7f9f98fee640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f9413eb20 0x7f9f94158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:31.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.567+0000 7f9f98fee640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f9413eb20 0x7f9f94158890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58862/0 (socket says 172.21.15.123:58862) 2024-09-15T23:15:31.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.567+0000 7f9f98fee640 1 -- 172.21.15.123:0/24683178 learned_addr learned my addr 172.21.15.123:0/24683178 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:31.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.567+0000 7f9f997ef640 1 --2- 172.21.15.123:0/24683178 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9f940b2d40 0x7f9f94154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:31.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.567+0000 7f9f99ff0640 1 --2- 172.21.15.123:0/24683178 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9f9415bcf0 0x7f9f94155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:31.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.567+0000 7f9f98fee640 1 -- 172.21.15.123:0/24683178 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9f940b2d40 msgr2=0x7f9f94154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:31.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.567+0000 7f9f98fee640 1 --2- 172.21.15.123:0/24683178 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9f940b2d40 0x7f9f94154fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:31.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.567+0000 7f9f98fee640 1 -- 172.21.15.123:0/24683178 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9f9415bcf0 msgr2=0x7f9f94155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:31.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.567+0000 7f9f98fee640 1 --2- 172.21.15.123:0/24683178 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9f9415bcf0 0x7f9f94155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:31.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.567+0000 7f9f98fee640 1 -- 172.21.15.123:0/24683178 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f940c9dc0 con 0x7f9f9413eb20 2024-09-15T23:15:31.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.567+0000 7f9f98fee640 1 --2- 172.21.15.123:0/24683178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f9413eb20 0x7f9f94158890 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f9f8400c820 tx=0x7f9f8400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:31.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.567+0000 7f9f89ffb640 1 -- 172.21.15.123:0/24683178 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f84004230 con 0x7f9f9413eb20 2024-09-15T23:15:31.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.567+0000 7f9f89ffb640 1 -- 172.21.15.123:0/24683178 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f840043f0 con 0x7f9f9413eb20 2024-09-15T23:15:31.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.567+0000 7f9f9ba53640 1 -- 172.21.15.123:0/24683178 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f940ca0a0 con 0x7f9f9413eb20 2024-09-15T23:15:31.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.567+0000 7f9f89ffb640 1 -- 172.21.15.123:0/24683178 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f84007a10 con 0x7f9f9413eb20 2024-09-15T23:15:31.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.568+0000 7f9f9ba53640 1 -- 172.21.15.123:0/24683178 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f940ca660 con 0x7f9f9413eb20 2024-09-15T23:15:31.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.569+0000 7f9f9ba53640 1 -- 172.21.15.123:0/24683178 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f9415c1a0 con 0x7f9f9413eb20 2024-09-15T23:15:31.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.569+0000 7f9f89ffb640 1 -- 172.21.15.123:0/24683178 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9f84007bb0 con 0x7f9f9413eb20 2024-09-15T23:15:31.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.569+0000 7f9f89ffb640 1 --2- 172.21.15.123:0/24683178 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9f7806c2b0 0x7f9f7806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:31.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.570+0000 7f9f89ffb640 1 -- 172.21.15.123:0/24683178 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5881+0+0 (secure 0 0 0) 0x7f9f8408b4d0 con 0x7f9f9413eb20 2024-09-15T23:15:31.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.570+0000 7f9f997ef640 1 --2- 172.21.15.123:0/24683178 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9f7806c2b0 0x7f9f7806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:31.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.570+0000 7f9f997ef640 1 --2- 172.21.15.123:0/24683178 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9f7806c2b0 0x7f9f7806e770 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9f90034000 tx=0x7f9f9002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:31.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.574+0000 7f9f89ffb640 1 -- 172.21.15.123:0/24683178 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9f84015020 con 0x7f9f9413eb20 2024-09-15T23:15:31.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.775+0000 7f9f9ba53640 1 -- 172.21.15.123:0/24683178 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f9415ba30 con 0x7f9f9413eb20 2024-09-15T23:15:31.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.776+0000 7f9f89ffb640 1 -- 172.21.15.123:0/24683178 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5223 (secure 0 0 0) 0x7f9f840594b0 con 0x7f9f9413eb20 2024-09-15T23:15:31.777 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:31.777 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":37,"btime":"2024-09-15T23:15:31:673002+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5483,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/522636413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":522636413},{"type":"v1","addr":"172.21.15.188:6835","nonce":522636413}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5860,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/3057173907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":3057173907},{"type":"v1","addr":"172.21.15.188:6837","nonce":3057173907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6399,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/811728648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":811728648},{"type":"v1","addr":"172.21.15.123:6833","nonce":811728648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:15:17.752297+0000","modified":"2024-09-15T23:15:30.674552+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6411":{"gid":6411,"name":"a","rank":0,"incarnation":35,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.123:6835/3634063333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3634063333},{"type":"v1","addr":"172.21.15.123:6835","nonce":3634063333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":4}]} 2024-09-15T23:15:31.777 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 37 2024-09-15T23:15:31.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.778+0000 7f9f9ba53640 1 -- 172.21.15.123:0/24683178 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9f7806c2b0 msgr2=0x7f9f7806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:31.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.778+0000 7f9f9ba53640 1 --2- 172.21.15.123:0/24683178 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9f7806c2b0 0x7f9f7806e770 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9f90034000 tx=0x7f9f9002e000 comp rx=0 tx=0).stop 2024-09-15T23:15:31.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.778+0000 7f9f9ba53640 1 -- 172.21.15.123:0/24683178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f9413eb20 msgr2=0x7f9f94158890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:31.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.778+0000 7f9f9ba53640 1 --2- 172.21.15.123:0/24683178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f9413eb20 0x7f9f94158890 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f9f8400c820 tx=0x7f9f8400cce0 comp rx=0 tx=0).stop 2024-09-15T23:15:31.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.778+0000 7f9f9ba53640 1 -- 172.21.15.123:0/24683178 shutdown_connections 2024-09-15T23:15:31.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.778+0000 7f9f9ba53640 1 --2- 172.21.15.123:0/24683178 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9f9415bcf0 0x7f9f94155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:31.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.778+0000 7f9f9ba53640 1 --2- 172.21.15.123:0/24683178 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9f7806c2b0 0x7f9f7806e770 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:31.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.778+0000 7f9f9ba53640 1 --2- 172.21.15.123:0/24683178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f9413eb20 0x7f9f94158890 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:31.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.778+0000 7f9f9ba53640 1 --2- 172.21.15.123:0/24683178 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9f940b2d40 0x7f9f94154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:31.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.778+0000 7f9f9ba53640 1 -- 172.21.15.123:0/24683178 >> 172.21.15.123:0/24683178 conn(0x7f9f940ccec0 msgr2=0x7f9f94071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:31.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.778+0000 7f9f9ba53640 1 -- 172.21.15.123:0/24683178 shutdown_connections 2024-09-15T23:15:31.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:31.778+0000 7f9f9ba53640 1 -- 172.21.15.123:0/24683178 wait complete. 2024-09-15T23:15:32.193 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 37, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:15:17.752297+0000', 'modified': '2024-09-15T23:15:30.674552+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 70, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6411}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6411': {'gid': 6411, 'name': 'a', 'rank': 0, 'incarnation': 35, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.123:6835/3634063333', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6834', 'nonce': 3634063333}, {'type': 'v1', 'addr': '172.21.15.123:6835', 'nonce': 3634063333}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-15T23:15:32.193 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6411:up:rejoin 2024-09-15T23:15:33.193 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:15:33.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.306+0000 7fdc5dec0640 1 Processor -- start 2024-09-15T23:15:33.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.306+0000 7fdc5dec0640 1 -- start start 2024-09-15T23:15:33.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.307+0000 7fdc5dec0640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdc5815ab40 0x7fdc5806c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:33.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.307+0000 7fdc5dec0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc580720b0 0x7fdc58073990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:33.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.307+0000 7fdc5dec0640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fdc5815af20 0x7fdc5815b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:33.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.307+0000 7fdc5dec0640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fdc58072520 con 0x7fdc5815ab40 2024-09-15T23:15:33.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.307+0000 7fdc5dec0640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fdc58071010 con 0x7fdc5815af20 2024-09-15T23:15:33.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.307+0000 7fdc5dec0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fdc580712f0 con 0x7fdc580720b0 2024-09-15T23:15:33.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.307+0000 7fdc577fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdc5815ab40 0x7fdc5806c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:33.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.307+0000 7fdc577fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdc5815ab40 0x7fdc5806c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58876/0 (socket says 172.21.15.123:58876) 2024-09-15T23:15:33.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.307+0000 7fdc577fe640 1 -- 172.21.15.123:0/788342256 learned_addr learned my addr 172.21.15.123:0/788342256 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:33.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.308+0000 7fdc56ffd640 1 --2- 172.21.15.123:0/788342256 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc580720b0 0x7fdc58073990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:33.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.308+0000 7fdc57fff640 1 --2- 172.21.15.123:0/788342256 >> v2:172.21.15.188:3300/0 conn(0x7fdc5815af20 0x7fdc5815b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:33.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.308+0000 7fdc577fe640 1 -- 172.21.15.123:0/788342256 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc580720b0 msgr2=0x7fdc58073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:33.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.308+0000 7fdc577fe640 1 --2- 172.21.15.123:0/788342256 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc580720b0 0x7fdc58073990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:33.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.308+0000 7fdc577fe640 1 -- 172.21.15.123:0/788342256 >> v2:172.21.15.188:3300/0 conn(0x7fdc5815af20 msgr2=0x7fdc5815b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:33.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.308+0000 7fdc577fe640 1 --2- 172.21.15.123:0/788342256 >> v2:172.21.15.188:3300/0 conn(0x7fdc5815af20 0x7fdc5815b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:33.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.308+0000 7fdc577fe640 1 -- 172.21.15.123:0/788342256 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc580715d0 con 0x7fdc5815ab40 2024-09-15T23:15:33.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.308+0000 7fdc56ffd640 1 --2- 172.21.15.123:0/788342256 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc580720b0 0x7fdc58073990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:33.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.308+0000 7fdc57fff640 1 --2- 172.21.15.123:0/788342256 >> v2:172.21.15.188:3300/0 conn(0x7fdc5815af20 0x7fdc5815b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:33.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.308+0000 7fdc577fe640 1 --2- 172.21.15.123:0/788342256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc5815ab40 0x7fdc5806c6a0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fdc580b6090 tx=0x7fdc4802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=455f659dde9445c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:33.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.309+0000 7fdc567fc640 1 -- 172.21.15.123:0/788342256 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc48037070 con 0x7fdc5815ab40 2024-09-15T23:15:33.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.309+0000 7fdc567fc640 1 -- 172.21.15.123:0/788342256 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc48032440 con 0x7fdc5815ab40 2024-09-15T23:15:33.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.309+0000 7fdc567fc640 1 -- 172.21.15.123:0/788342256 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc48032810 con 0x7fdc5815ab40 2024-09-15T23:15:33.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.309+0000 7fdc5dec0640 1 -- 172.21.15.123:0/788342256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc5815ab40 msgr2=0x7fdc5806c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:33.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.309+0000 7fdc5dec0640 1 --2- 172.21.15.123:0/788342256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc5815ab40 0x7fdc5806c6a0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fdc580b6090 tx=0x7fdc4802a130 comp rx=0 tx=0).stop 2024-09-15T23:15:33.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.309+0000 7fdc5dec0640 1 -- 172.21.15.123:0/788342256 shutdown_connections 2024-09-15T23:15:33.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.309+0000 7fdc5dec0640 1 --2- 172.21.15.123:0/788342256 >> v2:172.21.15.188:3300/0 conn(0x7fdc5815af20 0x7fdc5815b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:33.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.309+0000 7fdc5dec0640 1 --2- 172.21.15.123:0/788342256 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc580720b0 0x7fdc58073990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:33.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.309+0000 7fdc5dec0640 1 --2- 172.21.15.123:0/788342256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc5815ab40 0x7fdc5806c6a0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:33.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.309+0000 7fdc5dec0640 1 -- 172.21.15.123:0/788342256 >> 172.21.15.123:0/788342256 conn(0x7fdc580ccec0 msgr2=0x7fdc580cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:33.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.309+0000 7fdc5dec0640 1 -- 172.21.15.123:0/788342256 shutdown_connections 2024-09-15T23:15:33.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.309+0000 7fdc5dec0640 1 -- 172.21.15.123:0/788342256 wait complete. 2024-09-15T23:15:33.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.310+0000 7fdc5dec0640 1 Processor -- start 2024-09-15T23:15:33.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.311+0000 7fdc5dec0640 1 -- start start 2024-09-15T23:15:33.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.311+0000 7fdc5dec0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc580720b0 0x7fdc581560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:33.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.311+0000 7fdc5dec0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc5815ab40 0x7fdc5814b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:33.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.311+0000 7fdc5dec0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc5815af20 0x7fdc58151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:33.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.311+0000 7fdc5dec0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdc5815b8d0 con 0x7fdc580720b0 2024-09-15T23:15:33.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.311+0000 7fdc5dec0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fdc58073ed0 con 0x7fdc5815ab40 2024-09-15T23:15:33.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.311+0000 7fdc5dec0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fdc5815ba50 con 0x7fdc5815af20 2024-09-15T23:15:33.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.311+0000 7fdc577fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc580720b0 0x7fdc581560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:33.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.312+0000 7fdc577fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc580720b0 0x7fdc581560e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58890/0 (socket says 172.21.15.123:58890) 2024-09-15T23:15:33.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.312+0000 7fdc577fe640 1 -- 172.21.15.123:0/2722154928 learned_addr learned my addr 172.21.15.123:0/2722154928 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:33.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.312+0000 7fdc57fff640 1 --2- 172.21.15.123:0/2722154928 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc5815af20 0x7fdc58151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:33.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.312+0000 7fdc56ffd640 1 --2- 172.21.15.123:0/2722154928 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc5815ab40 0x7fdc5814b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:33.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.312+0000 7fdc577fe640 1 -- 172.21.15.123:0/2722154928 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc5815af20 msgr2=0x7fdc58151be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:33.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.312+0000 7fdc577fe640 1 --2- 172.21.15.123:0/2722154928 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc5815af20 0x7fdc58151be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:33.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.312+0000 7fdc577fe640 1 -- 172.21.15.123:0/2722154928 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc5815ab40 msgr2=0x7fdc5814b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:33.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.312+0000 7fdc577fe640 1 --2- 172.21.15.123:0/2722154928 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc5815ab40 0x7fdc5814b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:33.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.312+0000 7fdc577fe640 1 -- 172.21.15.123:0/2722154928 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc58156620 con 0x7fdc580720b0 2024-09-15T23:15:33.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.312+0000 7fdc577fe640 1 --2- 172.21.15.123:0/2722154928 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc580720b0 0x7fdc581560e0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fdc4802a170 tx=0x7fdc480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:33.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.312+0000 7fdc3ffff640 1 -- 172.21.15.123:0/2722154928 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc48037040 con 0x7fdc580720b0 2024-09-15T23:15:33.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.312+0000 7fdc3ffff640 1 -- 172.21.15.123:0/2722154928 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc48042070 con 0x7fdc580720b0 2024-09-15T23:15:33.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.312+0000 7fdc3ffff640 1 -- 172.21.15.123:0/2722154928 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc48030bb0 con 0x7fdc580720b0 2024-09-15T23:15:33.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.312+0000 7fdc5dec0640 1 -- 172.21.15.123:0/2722154928 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc5814b600 con 0x7fdc580720b0 2024-09-15T23:15:33.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.312+0000 7fdc5dec0640 1 -- 172.21.15.123:0/2722154928 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc58150700 con 0x7fdc580720b0 2024-09-15T23:15:33.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.314+0000 7fdc5dec0640 1 -- 172.21.15.123:0/2722154928 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc580cedd0 con 0x7fdc580720b0 2024-09-15T23:15:33.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.314+0000 7fdc3ffff640 1 -- 172.21.15.123:0/2722154928 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdc48047460 con 0x7fdc580720b0 2024-09-15T23:15:33.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.314+0000 7fdc3ffff640 1 --2- 172.21.15.123:0/2722154928 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdc4406c2b0 0x7fdc4406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:33.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.314+0000 7fdc3ffff640 1 -- 172.21.15.123:0/2722154928 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5881+0+0 (secure 0 0 0) 0x7fdc480abf40 con 0x7fdc580720b0 2024-09-15T23:15:33.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.315+0000 7fdc56ffd640 1 --2- 172.21.15.123:0/2722154928 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdc4406c2b0 0x7fdc4406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:33.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.315+0000 7fdc56ffd640 1 --2- 172.21.15.123:0/2722154928 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdc4406c2b0 0x7fdc4406e770 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdc580c5d30 tx=0x7fdc4c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:33.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.319+0000 7fdc3ffff640 1 -- 172.21.15.123:0/2722154928 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdc4807a040 con 0x7fdc580720b0 2024-09-15T23:15:33.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.522+0000 7fdc5dec0640 1 -- 172.21.15.123:0/2722154928 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc580686b0 con 0x7fdc580720b0 2024-09-15T23:15:33.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.523+0000 7fdc3ffff640 1 -- 172.21.15.123:0/2722154928 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5230 (secure 0 0 0) 0x7fdc4807e340 con 0x7fdc580720b0 2024-09-15T23:15:33.524 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:33.524 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":38,"btime":"2024-09-15T23:15:32:678232+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5483,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/522636413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":522636413},{"type":"v1","addr":"172.21.15.188:6835","nonce":522636413}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5860,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/3057173907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":3057173907},{"type":"v1","addr":"172.21.15.188:6837","nonce":3057173907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6399,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/811728648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":811728648},{"type":"v1","addr":"172.21.15.123:6833","nonce":811728648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:15:17.752297+0000","modified":"2024-09-15T23:15:32.678225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6411":{"gid":6411,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6835/3634063333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3634063333},{"type":"v1","addr":"172.21.15.123:6835","nonce":3634063333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6411,"qdb_cluster":[6411]},"id":4}]} 2024-09-15T23:15:33.525 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 38 2024-09-15T23:15:33.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.525+0000 7fdc5dec0640 1 -- 172.21.15.123:0/2722154928 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdc4406c2b0 msgr2=0x7fdc4406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:33.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.525+0000 7fdc5dec0640 1 --2- 172.21.15.123:0/2722154928 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdc4406c2b0 0x7fdc4406e770 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdc580c5d30 tx=0x7fdc4c008040 comp rx=0 tx=0).stop 2024-09-15T23:15:33.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.525+0000 7fdc5dec0640 1 -- 172.21.15.123:0/2722154928 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc580720b0 msgr2=0x7fdc581560e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:33.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.525+0000 7fdc5dec0640 1 --2- 172.21.15.123:0/2722154928 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc580720b0 0x7fdc581560e0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fdc4802a170 tx=0x7fdc480046c0 comp rx=0 tx=0).stop 2024-09-15T23:15:33.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.525+0000 7fdc5dec0640 1 -- 172.21.15.123:0/2722154928 shutdown_connections 2024-09-15T23:15:33.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.525+0000 7fdc5dec0640 1 --2- 172.21.15.123:0/2722154928 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc5815af20 0x7fdc58151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:33.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.525+0000 7fdc5dec0640 1 --2- 172.21.15.123:0/2722154928 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc5815ab40 0x7fdc5814b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:33.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.525+0000 7fdc5dec0640 1 --2- 172.21.15.123:0/2722154928 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdc4406c2b0 0x7fdc4406e770 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:33.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.525+0000 7fdc5dec0640 1 --2- 172.21.15.123:0/2722154928 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc580720b0 0x7fdc581560e0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:33.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.525+0000 7fdc5dec0640 1 -- 172.21.15.123:0/2722154928 >> 172.21.15.123:0/2722154928 conn(0x7fdc580ccec0 msgr2=0x7fdc580c6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:33.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.525+0000 7fdc5dec0640 1 -- 172.21.15.123:0/2722154928 shutdown_connections 2024-09-15T23:15:33.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:33.525+0000 7fdc5dec0640 1 -- 172.21.15.123:0/2722154928 wait complete. 2024-09-15T23:15:33.940 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:15:17.752297+0000', 'modified': '2024-09-15T23:15:32.678225+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 70, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6411}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6411': {'gid': 6411, 'name': 'a', 'rank': 0, 'incarnation': 35, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.123:6835/3634063333', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6834', 'nonce': 3634063333}, {'type': 'v1', 'addr': '172.21.15.123:6835', 'nonce': 3634063333}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6411, 'qdb_cluster': [6411]} 2024-09-15T23:15:33.940 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:15:33.940 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-15T23:15:34.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.039+0000 7fbe9c6af640 1 Processor -- start 2024-09-15T23:15:34.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.040+0000 7fbe9c6af640 1 -- start start 2024-09-15T23:15:34.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.040+0000 7fbe9c6af640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbe940b2d40 0x7fbe9406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.040+0000 7fbe9c6af640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fbe9413eb20 0x7fbe9406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.040+0000 7fbe9c6af640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbe9415bcf0 0x7fbe9415c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.040+0000 7fbe9c6af640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fbe94071ab0 con 0x7fbe9415bcf0 2024-09-15T23:15:34.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.040+0000 7fbe9c6af640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fbe94071180 con 0x7fbe9413eb20 2024-09-15T23:15:34.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.040+0000 7fbe9c6af640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbe94071460 con 0x7fbe940b2d40 2024-09-15T23:15:34.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.041+0000 7fbe9ac4c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbe9415bcf0 0x7fbe9415c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.041+0000 7fbe9ac4c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbe9415bcf0 0x7fbe9415c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58904/0 (socket says 172.21.15.123:58904) 2024-09-15T23:15:34.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.041+0000 7fbe9ac4c640 1 -- 172.21.15.123:0/1705045247 learned_addr learned my addr 172.21.15.123:0/1705045247 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:34.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.041+0000 7fbe99c4a640 1 --2- 172.21.15.123:0/1705045247 >> v2:172.21.15.188:3300/0 conn(0x7fbe9413eb20 0x7fbe9406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.041+0000 7fbe9a44b640 1 --2- 172.21.15.123:0/1705045247 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbe940b2d40 0x7fbe9406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.041+0000 7fbe9ac4c640 1 -- 172.21.15.123:0/1705045247 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbe940b2d40 msgr2=0x7fbe9406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:34.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.041+0000 7fbe9ac4c640 1 --2- 172.21.15.123:0/1705045247 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbe940b2d40 0x7fbe9406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.041+0000 7fbe9ac4c640 1 -- 172.21.15.123:0/1705045247 >> v2:172.21.15.188:3300/0 conn(0x7fbe9413eb20 msgr2=0x7fbe9406c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:34.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.041+0000 7fbe9ac4c640 1 --2- 172.21.15.123:0/1705045247 >> v2:172.21.15.188:3300/0 conn(0x7fbe9413eb20 0x7fbe9406c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.041+0000 7fbe9ac4c640 1 -- 172.21.15.123:0/1705045247 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe94071740 con 0x7fbe9415bcf0 2024-09-15T23:15:34.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.042+0000 7fbe9ac4c640 1 --2- 172.21.15.123:0/1705045247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe9415bcf0 0x7fbe9415c1a0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fbe94073460 tx=0x7fbe8402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f53b208a25652e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:34.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.042+0000 7fbe99449640 1 -- 172.21.15.123:0/1705045247 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe84036070 con 0x7fbe9415bcf0 2024-09-15T23:15:34.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.042+0000 7fbe99449640 1 -- 172.21.15.123:0/1705045247 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe84031600 con 0x7fbe9415bcf0 2024-09-15T23:15:34.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.042+0000 7fbe99449640 1 -- 172.21.15.123:0/1705045247 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe840319d0 con 0x7fbe9415bcf0 2024-09-15T23:15:34.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.042+0000 7fbe9c6af640 1 -- 172.21.15.123:0/1705045247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe9415bcf0 msgr2=0x7fbe9415c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:34.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.042+0000 7fbe9c6af640 1 --2- 172.21.15.123:0/1705045247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe9415bcf0 0x7fbe9415c1a0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fbe94073460 tx=0x7fbe8402a6a0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.042+0000 7fbe9c6af640 1 -- 172.21.15.123:0/1705045247 shutdown_connections 2024-09-15T23:15:34.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.042+0000 7fbe9c6af640 1 --2- 172.21.15.123:0/1705045247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe9415bcf0 0x7fbe9415c1a0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.042+0000 7fbe9c6af640 1 --2- 172.21.15.123:0/1705045247 >> v2:172.21.15.188:3300/0 conn(0x7fbe9413eb20 0x7fbe9406c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.042+0000 7fbe9c6af640 1 --2- 172.21.15.123:0/1705045247 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbe940b2d40 0x7fbe9406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.042+0000 7fbe9c6af640 1 -- 172.21.15.123:0/1705045247 >> 172.21.15.123:0/1705045247 conn(0x7fbe940ccec0 msgr2=0x7fbe940cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:34.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.042+0000 7fbe9c6af640 1 -- 172.21.15.123:0/1705045247 shutdown_connections 2024-09-15T23:15:34.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.042+0000 7fbe9c6af640 1 -- 172.21.15.123:0/1705045247 wait complete. 2024-09-15T23:15:34.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.044+0000 7fbe9c6af640 1 Processor -- start 2024-09-15T23:15:34.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.044+0000 7fbe9c6af640 1 -- start start 2024-09-15T23:15:34.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.044+0000 7fbe9c6af640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbe940b2d40 0x7fbe9413d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.044+0000 7fbe9c6af640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe9413eb20 0x7fbe94072490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.044+0000 7fbe9c6af640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbe9415bcf0 0x7fbe940729d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.044+0000 7fbe9c6af640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9415f140 con 0x7fbe9413eb20 2024-09-15T23:15:34.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.044+0000 7fbe9c6af640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9415efc0 con 0x7fbe9415bcf0 2024-09-15T23:15:34.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.044+0000 7fbe9c6af640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbe9415f2c0 con 0x7fbe940b2d40 2024-09-15T23:15:34.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.044+0000 7fbe99c4a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe9413eb20 0x7fbe94072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.044+0000 7fbe99c4a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe9413eb20 0x7fbe94072490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58910/0 (socket says 172.21.15.123:58910) 2024-09-15T23:15:34.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.044+0000 7fbe99c4a640 1 -- 172.21.15.123:0/99858205 learned_addr learned my addr 172.21.15.123:0/99858205 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:34.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.045+0000 7fbe9a44b640 1 --2- 172.21.15.123:0/99858205 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbe940b2d40 0x7fbe9413d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.045+0000 7fbe9ac4c640 1 --2- 172.21.15.123:0/99858205 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbe9415bcf0 0x7fbe940729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.045+0000 7fbe99c4a640 1 -- 172.21.15.123:0/99858205 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbe940b2d40 msgr2=0x7fbe9413d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:34.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.045+0000 7fbe99c4a640 1 --2- 172.21.15.123:0/99858205 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbe940b2d40 0x7fbe9413d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.045+0000 7fbe99c4a640 1 -- 172.21.15.123:0/99858205 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbe9415bcf0 msgr2=0x7fbe940729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:34.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.045+0000 7fbe99c4a640 1 --2- 172.21.15.123:0/99858205 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbe9415bcf0 0x7fbe940729d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.045+0000 7fbe99c4a640 1 -- 172.21.15.123:0/99858205 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe941f5ef0 con 0x7fbe9413eb20 2024-09-15T23:15:34.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.045+0000 7fbe99c4a640 1 --2- 172.21.15.123:0/99858205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe9413eb20 0x7fbe94072490 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fbe8800c7f0 tx=0x7fbe8800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:34.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.045+0000 7fbe92ffd640 1 -- 172.21.15.123:0/99858205 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe88015070 con 0x7fbe9413eb20 2024-09-15T23:15:34.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.045+0000 7fbe92ffd640 1 -- 172.21.15.123:0/99858205 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe88004220 con 0x7fbe9413eb20 2024-09-15T23:15:34.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.045+0000 7fbe92ffd640 1 -- 172.21.15.123:0/99858205 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe88007620 con 0x7fbe9413eb20 2024-09-15T23:15:34.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.045+0000 7fbe9c6af640 1 -- 172.21.15.123:0/99858205 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe941f61d0 con 0x7fbe9413eb20 2024-09-15T23:15:34.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.045+0000 7fbe9c6af640 1 -- 172.21.15.123:0/99858205 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe941f6790 con 0x7fbe9413eb20 2024-09-15T23:15:34.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.046+0000 7fbe92ffd640 1 -- 172.21.15.123:0/99858205 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbe880079d0 con 0x7fbe9413eb20 2024-09-15T23:15:34.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.047+0000 7fbe92ffd640 1 --2- 172.21.15.123:0/99858205 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbe8006c2b0 0x7fbe8006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.047+0000 7fbe92ffd640 1 -- 172.21.15.123:0/99858205 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5881+0+0 (secure 0 0 0) 0x7fbe8808b7c0 con 0x7fbe9413eb20 2024-09-15T23:15:34.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.048+0000 7fbe9a44b640 1 --2- 172.21.15.123:0/99858205 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbe8006c2b0 0x7fbe8006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.048+0000 7fbe9f43d740 1 Processor -- start 2024-09-15T23:15:34.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.048+0000 7fbe9a44b640 1 --2- 172.21.15.123:0/99858205 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbe8006c2b0 0x7fbe8006e770 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c00aaf0 tx=0x7fbe8c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:34.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.048+0000 7fbe9f43d740 1 -- start start 2024-09-15T23:15:34.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.049+0000 7fbe9f43d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b65c5c42c0 0x55b65c609a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.049+0000 7fbe9f43d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b65c5c1a80 0x55b65c5c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.049+0000 7fbe9f43d740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b65c5c5a50 0x55b65c5be8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.049+0000 7fbe9f43d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55b65c526520 con 0x55b65c5c1a80 2024-09-15T23:15:34.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.049+0000 7fbe9f43d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b65c4ce3e0 con 0x55b65c5c42c0 2024-09-15T23:15:34.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.049+0000 7fbe9f43d740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55b65c5224e0 con 0x55b65c5c5a50 2024-09-15T23:15:34.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.049+0000 7fbe99c4a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b65c5c1a80 0x55b65c5c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.049+0000 7fbe99c4a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b65c5c1a80 0x55b65c5c46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58920/0 (socket says 172.21.15.123:58920) 2024-09-15T23:15:34.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.049+0000 7fbe99c4a640 1 -- 172.21.15.123:0/392640820 learned_addr learned my addr 172.21.15.123:0/392640820 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:34.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.049+0000 7fbe9a44b640 1 --2- 172.21.15.123:0/392640820 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b65c5c42c0 0x55b65c609a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.049+0000 7fbe9ac4c640 1 --2- 172.21.15.123:0/392640820 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b65c5c5a50 0x55b65c5be8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.049+0000 7fbe99c4a640 1 -- 172.21.15.123:0/392640820 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b65c5c5a50 msgr2=0x55b65c5be8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:34.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.049+0000 7fbe99c4a640 1 --2- 172.21.15.123:0/392640820 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b65c5c5a50 0x55b65c5be8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.049+0000 7fbe99c4a640 1 -- 172.21.15.123:0/392640820 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b65c5c42c0 msgr2=0x55b65c609a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:34.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.049+0000 7fbe99c4a640 1 --2- 172.21.15.123:0/392640820 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b65c5c42c0 0x55b65c609a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.049+0000 7fbe99c4a640 1 -- 172.21.15.123:0/392640820 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b65c4e92f0 con 0x55b65c5c1a80 2024-09-15T23:15:34.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.050+0000 7fbe99c4a640 1 --2- 172.21.15.123:0/392640820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b65c5c1a80 0x55b65c5c46a0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fbe88089c40 tx=0x7fbe880597c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf85fb358c4d358 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:34.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.050+0000 7fbe7bfff640 1 -- 172.21.15.123:0/392640820 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8801e040 con 0x55b65c5c1a80 2024-09-15T23:15:34.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.050+0000 7fbe7bfff640 1 -- 172.21.15.123:0/392640820 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe880623f0 con 0x55b65c5c1a80 2024-09-15T23:15:34.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.050+0000 7fbe7bfff640 1 -- 172.21.15.123:0/392640820 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe88057bc0 con 0x55b65c5c1a80 2024-09-15T23:15:34.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.050+0000 7fbe9f43d740 1 -- 172.21.15.123:0/392640820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b65c5c1a80 msgr2=0x55b65c5c46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:34.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.050+0000 7fbe9f43d740 1 --2- 172.21.15.123:0/392640820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b65c5c1a80 0x55b65c5c46a0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fbe88089c40 tx=0x7fbe880597c0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.050+0000 7fbe9f43d740 1 -- 172.21.15.123:0/392640820 shutdown_connections 2024-09-15T23:15:34.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.050+0000 7fbe9f43d740 1 --2- 172.21.15.123:0/392640820 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b65c5c5a50 0x55b65c5be8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.050+0000 7fbe9f43d740 1 --2- 172.21.15.123:0/392640820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b65c5c1a80 0x55b65c5c46a0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.050+0000 7fbe9f43d740 1 --2- 172.21.15.123:0/392640820 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b65c5c42c0 0x55b65c609a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.050+0000 7fbe9f43d740 1 -- 172.21.15.123:0/392640820 >> 172.21.15.123:0/392640820 conn(0x55b65c5c0a80 msgr2=0x55b65c608f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:34.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.050+0000 7fbe9f43d740 1 -- 172.21.15.123:0/392640820 shutdown_connections 2024-09-15T23:15:34.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.050+0000 7fbe9f43d740 1 -- 172.21.15.123:0/392640820 wait complete. 2024-09-15T23:15:34.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.051+0000 7fbe9f43d740 1 -- start start 2024-09-15T23:15:34.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.051+0000 7fbe9f43d740 1 Processor -- start 2024-09-15T23:15:34.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.052+0000 7fbe9f43d740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b65c5c42c0 0x55b65c604610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.052+0000 7fbe9f43d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b65c5c5a50 0x55b65c5ed280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.052+0000 7fbe9f43d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b65c60d600 0x55b65c60da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.052+0000 7fbe9f43d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55b65c5bff20 con 0x55b65c5c5a50 2024-09-15T23:15:34.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.052+0000 7fbe9f43d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b65c4af450 con 0x55b65c60d600 2024-09-15T23:15:34.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.052+0000 7fbe9f43d740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55b65c60a290 con 0x55b65c5c42c0 2024-09-15T23:15:34.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.052+0000 7fbe9f43d740 10 client.0 _ll_register_callbacks cb 0x55b65c238ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:15:34.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.052+0000 7fbe99c4a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b65c5c5a50 0x55b65c5ed280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.052+0000 7fbe99c4a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b65c5c5a50 0x55b65c5ed280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58928/0 (socket says 172.21.15.123:58928) 2024-09-15T23:15:34.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.052+0000 7fbe99c4a640 1 -- 172.21.15.123:0/1031120412 learned_addr learned my addr 172.21.15.123:0/1031120412 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:34.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.052+0000 7fbe9ac4c640 1 --2- 172.21.15.123:0/1031120412 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b65c60d600 0x55b65c60da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.052+0000 7fbe9a44b640 1 --2- 172.21.15.123:0/1031120412 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b65c5c42c0 0x55b65c604610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.052+0000 7fbe99c4a640 1 -- 172.21.15.123:0/1031120412 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b65c5c42c0 msgr2=0x55b65c604610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:34.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.052+0000 7fbe99c4a640 1 --2- 172.21.15.123:0/1031120412 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b65c5c42c0 0x55b65c604610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.052+0000 7fbe99c4a640 1 -- 172.21.15.123:0/1031120412 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b65c60d600 msgr2=0x55b65c60da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:34.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.052+0000 7fbe99c4a640 1 --2- 172.21.15.123:0/1031120412 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b65c60d600 0x55b65c60da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.052+0000 7fbe99c4a640 1 -- 172.21.15.123:0/1031120412 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b65c2392d0 con 0x55b65c5c5a50 2024-09-15T23:15:34.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.052+0000 7fbe9a44b640 1 --2- 172.21.15.123:0/1031120412 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b65c5c42c0 0x55b65c604610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:34.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.053+0000 7fbe99c4a640 1 --2- 172.21.15.123:0/1031120412 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b65c5c5a50 0x55b65c5ed280 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fbe8800c7c0 tx=0x7fbe88000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fa320c4feeda03b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:34.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.053+0000 7fbe797fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:15:34.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.053+0000 7fbe797fa640 1 -- 172.21.15.123:0/1031120412 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8801e030 con 0x55b65c5c5a50 2024-09-15T23:15:34.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.053+0000 7fbe797fa640 1 -- 172.21.15.123:0/1031120412 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 5881+0+0 (secure 0 0 0) 0x7fbe88007cc0 con 0x55b65c5c5a50 2024-09-15T23:15:34.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.053+0000 7fbe9f43d740 1 -- 172.21.15.123:0/1031120412 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe880623f0 con 0x55b65c5c5a50 2024-09-15T23:15:34.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.053+0000 7fbe797fa640 1 -- 172.21.15.123:0/1031120412 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fbe88089070 con 0x55b65c5c5a50 2024-09-15T23:15:34.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.053+0000 7fbe9f43d740 10 client.6453 fetch_fsmap learned FSMap version 38 2024-09-15T23:15:34.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.053+0000 7fbe9f43d740 1 -- 172.21.15.123:0/1031120412 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x55b65c3036b0 con 0x55b65c5c5a50 2024-09-15T23:15:34.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.053+0000 7fbe797fa640 1 -- 172.21.15.123:0/1031120412 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe880623f0 con 0x55b65c5c5a50 2024-09-15T23:15:34.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.053+0000 7fbe797fa640 1 -- 172.21.15.123:0/1031120412 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 38) ==== 3502+0+0 (secure 0 0 0) 0x7fbe88061f60 con 0x55b65c5c5a50 2024-09-15T23:15:34.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.053+0000 7fbe9f43d740 10 client.6453 fetch_fsmap finished waiting for FSMap version 38 2024-09-15T23:15:34.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.053+0000 7fbe9f43d740 10 client.6453 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T23:15:34.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.053+0000 7fbe9f43d740 20 client.6453 populate_metadata read hostname 'smithi123' 2024-09-15T23:15:34.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.053+0000 7fbe9f43d740 1 --2- 172.21.15.123:0/1031120412 >> [v2:172.21.15.123:6834/3634063333,v1:172.21.15.123:6835/3634063333] conn(0x55b65c606150 0x55b65c6267c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.053+0000 7fbe9f43d740 4 client.6453 mds_command: new command op to 6411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:15:34.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.053+0000 7fbe9f43d740 1 -- 172.21.15.123:0/1031120412 --> [v2:172.21.15.123:6834/3634063333,v1:172.21.15.123:6835/3634063333] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b65c533c50 con 0x55b65c606150 2024-09-15T23:15:34.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.053+0000 7fbe9a44b640 1 --2- 172.21.15.123:0/1031120412 >> [v2:172.21.15.123:6834/3634063333,v1:172.21.15.123:6835/3634063333] conn(0x55b65c606150 0x55b65c6267c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.054+0000 7fbe9a44b640 1 --2- 172.21.15.123:0/1031120412 >> [v2:172.21.15.123:6834/3634063333,v1:172.21.15.123:6835/3634063333] conn(0x55b65c606150 0x55b65c6267c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28c39918dfe2b957 server_cookie=9b116b8ebd18812 in_seq=0 out_seq=0 2024-09-15T23:15:34.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.054+0000 7fbe797fa640 10 client.6453 ms_handle_connect on v2:172.21.15.123:6834/3634063333 2024-09-15T23:15:34.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.054+0000 7fbe797fa640 1 -- 172.21.15.123:0/1031120412 <== mds.0 v2:172.21.15.123:6834/3634063333 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b65c533c50 con 0x55b65c606150 2024-09-15T23:15:34.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.054+0000 7fbe797fa640 10 client.6453 handle_command_reply: tid=0 2024-09-15T23:15:34.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.054+0000 7fbe9f43d740 1 client.6453 shutdown 2024-09-15T23:15:34.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.054+0000 7fbe9f43d740 1 -- 172.21.15.123:0/1031120412 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b65c5c5a50 msgr2=0x55b65c5ed280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:34.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.054+0000 7fbe9f43d740 1 --2- 172.21.15.123:0/1031120412 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b65c5c5a50 0x55b65c5ed280 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fbe8800c7c0 tx=0x7fbe88000bc0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.054+0000 7fbe9f43d740 1 -- 172.21.15.123:0/1031120412 shutdown_connections 2024-09-15T23:15:34.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.054+0000 7fbe9f43d740 1 --2- 172.21.15.123:0/1031120412 >> [v2:172.21.15.123:6834/3634063333,v1:172.21.15.123:6835/3634063333] conn(0x55b65c606150 0x55b65c6267c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.054+0000 7fbe9f43d740 1 --2- 172.21.15.123:0/1031120412 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b65c60d600 0x55b65c60da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.054+0000 7fbe9f43d740 1 --2- 172.21.15.123:0/1031120412 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b65c5c5a50 0x55b65c5ed280 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.054+0000 7fbe9f43d740 1 --2- 172.21.15.123:0/1031120412 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b65c5c42c0 0x55b65c604610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.054+0000 7fbe797fa640 0 client.6453 ms_handle_reset on v2:172.21.15.123:6834/3634063333 2024-09-15T23:15:34.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.054+0000 7fbe9f43d740 1 -- 172.21.15.123:0/1031120412 >> 172.21.15.123:0/1031120412 conn(0x55b65c5c1a80 msgr2=0x55b65c60aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:34.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.055+0000 7fbe9f43d740 1 -- 172.21.15.123:0/1031120412 shutdown_connections 2024-09-15T23:15:34.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.055+0000 7fbe9f43d740 1 -- 172.21.15.123:0/1031120412 wait complete. 2024-09-15T23:15:34.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.055+0000 7fbe9f43d740 20 client.6453 trim_cache size 0 max 16384 2024-09-15T23:15:34.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.072+0000 7fbe9f43d740 1 Processor -- start 2024-09-15T23:15:34.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.072+0000 7fbe9f43d740 1 -- start start 2024-09-15T23:15:34.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.073+0000 7fbe9f43d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b65c5c42c0 0x55b65c5ee670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.073+0000 7fbe9f43d740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b65c5c5a50 0x55b65c5e6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.073+0000 7fbe9f43d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b65c60d600 0x55b65c5e6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.073+0000 7fbe9f43d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbe941fdd70 con 0x55b65c5c42c0 2024-09-15T23:15:34.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.073+0000 7fbe9f43d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbe94158350 con 0x55b65c60d600 2024-09-15T23:15:34.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.073+0000 7fbe9f43d740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbe941589a0 con 0x55b65c5c5a50 2024-09-15T23:15:34.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.073+0000 7fbe9a44b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b65c5c42c0 0x55b65c5ee670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.073+0000 7fbe9a44b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b65c5c42c0 0x55b65c5ee670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58944/0 (socket says 172.21.15.123:58944) 2024-09-15T23:15:34.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.073+0000 7fbe9a44b640 1 -- 172.21.15.123:0/3478761949 learned_addr learned my addr 172.21.15.123:0/3478761949 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:34.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.073+0000 7fbe9a44b640 1 -- 172.21.15.123:0/3478761949 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b65c5c5a50 msgr2=0x55b65c5e6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:34.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.073+0000 7fbe9a44b640 1 --2- 172.21.15.123:0/3478761949 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b65c5c5a50 0x55b65c5e6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.073+0000 7fbe9a44b640 1 -- 172.21.15.123:0/3478761949 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b65c60d600 msgr2=0x55b65c5e6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:34.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.073+0000 7fbe9a44b640 1 --2- 172.21.15.123:0/3478761949 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b65c60d600 0x55b65c5e6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.073+0000 7fbe9a44b640 1 -- 172.21.15.123:0/3478761949 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b65c5c4a10 con 0x55b65c5c42c0 2024-09-15T23:15:34.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.074+0000 7fbe9a44b640 1 --2- 172.21.15.123:0/3478761949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b65c5c42c0 0x55b65c5ee670 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c00a930 tx=0x7fbe8c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b8b8a2fbe231ed server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:34.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.074+0000 7fbe7b7fe640 1 -- 172.21.15.123:0/3478761949 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c02f070 con 0x55b65c5c42c0 2024-09-15T23:15:34.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.074+0000 7fbe7b7fe640 1 -- 172.21.15.123:0/3478761949 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe8c003a10 con 0x55b65c5c42c0 2024-09-15T23:15:34.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.074+0000 7fbe7b7fe640 1 -- 172.21.15.123:0/3478761949 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8c003dc0 con 0x55b65c5c42c0 2024-09-15T23:15:34.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.074+0000 7fbe9f43d740 1 -- 172.21.15.123:0/3478761949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b65c5c42c0 msgr2=0x55b65c5ee670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:34.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.074+0000 7fbe9f43d740 1 --2- 172.21.15.123:0/3478761949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b65c5c42c0 0x55b65c5ee670 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c00a930 tx=0x7fbe8c016000 comp rx=0 tx=0).stop 2024-09-15T23:15:34.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.074+0000 7fbe9f43d740 1 -- 172.21.15.123:0/3478761949 shutdown_connections 2024-09-15T23:15:34.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.074+0000 7fbe9f43d740 1 --2- 172.21.15.123:0/3478761949 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b65c60d600 0x55b65c5e6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.074+0000 7fbe9f43d740 1 --2- 172.21.15.123:0/3478761949 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b65c5c5a50 0x55b65c5e6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.074+0000 7fbe9f43d740 1 --2- 172.21.15.123:0/3478761949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b65c5c42c0 0x55b65c5ee670 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.074+0000 7fbe9f43d740 1 -- 172.21.15.123:0/3478761949 >> 172.21.15.123:0/3478761949 conn(0x55b65c5c1a80 msgr2=0x55b65c606530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:34.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.074+0000 7fbe9f43d740 1 -- 172.21.15.123:0/3478761949 shutdown_connections 2024-09-15T23:15:34.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.074+0000 7fbe9f43d740 1 -- 172.21.15.123:0/3478761949 wait complete. 2024-09-15T23:15:34.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.075+0000 7fbe9f43d740 1 -- start start 2024-09-15T23:15:34.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.075+0000 7fbe9f43d740 1 Processor -- start 2024-09-15T23:15:34.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.076+0000 7fbe9f43d740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b65c5c42c0 0x55b65c68a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.076+0000 7fbe9f43d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b65c5c5a50 0x55b65c5e6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.076+0000 7fbe9f43d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b65c60d600 0x55b65c5e6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.076+0000 7fbe9f43d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55b65c5bff20 con 0x55b65c5c5a50 2024-09-15T23:15:34.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.076+0000 7fbe9f43d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b65c4af450 con 0x55b65c60d600 2024-09-15T23:15:34.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.076+0000 7fbe9f43d740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55b65c5e9930 con 0x55b65c5c42c0 2024-09-15T23:15:34.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.076+0000 7fbe9f43d740 10 client.0 _ll_register_callbacks cb 0x7fbe8c00a740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:15:34.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.076+0000 7fbe99c4a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b65c5c5a50 0x55b65c5e6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.076+0000 7fbe99c4a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b65c5c5a50 0x55b65c5e6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58954/0 (socket says 172.21.15.123:58954) 2024-09-15T23:15:34.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.076+0000 7fbe99c4a640 1 -- 172.21.15.123:0/411876531 learned_addr learned my addr 172.21.15.123:0/411876531 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:34.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.076+0000 7fbe9a44b640 1 --2- 172.21.15.123:0/411876531 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b65c5c42c0 0x55b65c68a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.076+0000 7fbe9ac4c640 1 --2- 172.21.15.123:0/411876531 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b65c60d600 0x55b65c5e6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.076+0000 7fbe99c4a640 1 -- 172.21.15.123:0/411876531 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b65c5c42c0 msgr2=0x55b65c68a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:34.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.076+0000 7fbe99c4a640 1 --2- 172.21.15.123:0/411876531 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b65c5c42c0 0x55b65c68a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.076+0000 7fbe99c4a640 1 -- 172.21.15.123:0/411876531 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b65c60d600 msgr2=0x55b65c5e6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:34.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.076+0000 7fbe99c4a640 1 --2- 172.21.15.123:0/411876531 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b65c60d600 0x55b65c5e6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.076+0000 7fbe99c4a640 1 -- 172.21.15.123:0/411876531 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b65c605050 con 0x55b65c5c5a50 2024-09-15T23:15:34.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.076+0000 7fbe9ac4c640 1 --2- 172.21.15.123:0/411876531 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b65c60d600 0x55b65c5e6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:34.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.076+0000 7fbe99c4a640 1 --2- 172.21.15.123:0/411876531 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b65c5c5a50 0x55b65c5e6240 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fbe88059850 tx=0x7fbe88089ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb750462111437cd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:34.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.076+0000 7fbe797fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:15:34.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.076+0000 7fbe797fa640 1 -- 172.21.15.123:0/411876531 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8801e040 con 0x55b65c5c5a50 2024-09-15T23:15:34.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.077+0000 7fbe797fa640 1 -- 172.21.15.123:0/411876531 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 5881+0+0 (secure 0 0 0) 0x7fbe88007cc0 con 0x55b65c5c5a50 2024-09-15T23:15:34.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.077+0000 7fbe9f43d740 1 -- 172.21.15.123:0/411876531 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe8c003a10 con 0x55b65c5c5a50 2024-09-15T23:15:34.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.077+0000 7fbe797fa640 1 -- 172.21.15.123:0/411876531 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fbe88059220 con 0x55b65c5c5a50 2024-09-15T23:15:34.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.077+0000 7fbe9f43d740 10 client.6459 fetch_fsmap learned FSMap version 38 2024-09-15T23:15:34.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.077+0000 7fbe9f43d740 1 -- 172.21.15.123:0/411876531 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x55b65c607590 con 0x55b65c5c5a50 2024-09-15T23:15:34.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.077+0000 7fbe797fa640 1 -- 172.21.15.123:0/411876531 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe8c003a10 con 0x55b65c5c5a50 2024-09-15T23:15:34.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.077+0000 7fbe797fa640 1 -- 172.21.15.123:0/411876531 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 38) ==== 3502+0+0 (secure 0 0 0) 0x7fbe880830d0 con 0x55b65c5c5a50 2024-09-15T23:15:34.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.077+0000 7fbe9f43d740 10 client.6459 fetch_fsmap finished waiting for FSMap version 38 2024-09-15T23:15:34.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.077+0000 7fbe9f43d740 10 client.6459 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T23:15:34.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.077+0000 7fbe9f43d740 20 client.6459 populate_metadata read hostname 'smithi123' 2024-09-15T23:15:34.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.077+0000 7fbe9f43d740 1 --2- 172.21.15.123:0/411876531 >> [v2:172.21.15.123:6834/3634063333,v1:172.21.15.123:6835/3634063333] conn(0x55b65c5c32f0 0x55b65c628d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.077+0000 7fbe9f43d740 4 client.6459 mds_command: new command op to 6411 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:15:34.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.077+0000 7fbe9f43d740 1 -- 172.21.15.123:0/411876531 --> [v2:172.21.15.123:6834/3634063333,v1:172.21.15.123:6835/3634063333] -- command(tid 0: {"prefix": "status"}) -- 0x55b65c52dfa0 con 0x55b65c5c32f0 2024-09-15T23:15:34.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.077+0000 7fbe9a44b640 1 --2- 172.21.15.123:0/411876531 >> [v2:172.21.15.123:6834/3634063333,v1:172.21.15.123:6835/3634063333] conn(0x55b65c5c32f0 0x55b65c628d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.077+0000 7fbe797fa640 10 client.6459 ms_handle_connect on v2:172.21.15.123:6834/3634063333 2024-09-15T23:15:34.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.077+0000 7fbe9a44b640 1 --2- 172.21.15.123:0/411876531 >> [v2:172.21.15.123:6834/3634063333,v1:172.21.15.123:6835/3634063333] conn(0x55b65c5c32f0 0x55b65c628d90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12985945d5b8f4f6 server_cookie=484e1e8ae03745f2 in_seq=0 out_seq=0 2024-09-15T23:15:34.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.077+0000 7fbe797fa640 1 -- 172.21.15.123:0/411876531 <== mds.0 v2:172.21.15.123:6834/3634063333 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55b65c52dfa0 con 0x55b65c5c32f0 2024-09-15T23:15:34.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.078+0000 7fbe797fa640 10 client.6459 handle_command_reply: tid=0 2024-09-15T23:15:34.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.078+0000 7fbe9f43d740 1 client.6459 shutdown 2024-09-15T23:15:34.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.078+0000 7fbe9f43d740 1 -- 172.21.15.123:0/411876531 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b65c5c5a50 msgr2=0x55b65c5e6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:34.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.078+0000 7fbe9f43d740 1 --2- 172.21.15.123:0/411876531 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b65c5c5a50 0x55b65c5e6240 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fbe88059850 tx=0x7fbe88089ba0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.078+0000 7fbe9f43d740 1 -- 172.21.15.123:0/411876531 shutdown_connections 2024-09-15T23:15:34.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.078+0000 7fbe9f43d740 1 --2- 172.21.15.123:0/411876531 >> [v2:172.21.15.123:6834/3634063333,v1:172.21.15.123:6835/3634063333] conn(0x55b65c5c32f0 0x55b65c628d90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.078+0000 7fbe9f43d740 1 --2- 172.21.15.123:0/411876531 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b65c60d600 0x55b65c5e6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.078+0000 7fbe797fa640 0 client.6459 ms_handle_reset on v2:172.21.15.123:6834/3634063333 2024-09-15T23:15:34.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.078+0000 7fbe9f43d740 1 --2- 172.21.15.123:0/411876531 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b65c5c5a50 0x55b65c5e6240 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.078+0000 7fbe9f43d740 1 --2- 172.21.15.123:0/411876531 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b65c5c42c0 0x55b65c68a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.078+0000 7fbe9f43d740 1 -- 172.21.15.123:0/411876531 >> 172.21.15.123:0/411876531 conn(0x55b65c5c1a80 msgr2=0x55b65c5ee670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:34.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.078+0000 7fbe9f43d740 1 -- 172.21.15.123:0/411876531 shutdown_connections 2024-09-15T23:15:34.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.078+0000 7fbe9f43d740 1 -- 172.21.15.123:0/411876531 wait complete. 2024-09-15T23:15:34.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.078+0000 7fbe9f43d740 20 client.6459 trim_cache size 0 max 16384 2024-09-15T23:15:34.086 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:15:34.086 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "cb968ac4-8d3a-4b17-a673-6177aeaea589", 2024-09-15T23:15:34.086 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2024-09-15T23:15:34.086 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 6411, 2024-09-15T23:15:34.086 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-09-15T23:15:34.086 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-09-15T23:15:34.086 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-09-15T23:15:34.086 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 4.4160008059999996, 2024-09-15T23:15:34.086 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 38, 2024-09-15T23:15:34.086 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 70, 2024-09-15T23:15:34.086 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 70, 2024-09-15T23:15:34.086 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 5.2711625050000004 2024-09-15T23:15:34.087 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:15:34.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.078+0000 7fbe9c6af640 1 -- 172.21.15.123:0/99858205 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbe8006c2b0 msgr2=0x7fbe8006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:34.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.078+0000 7fbe9c6af640 1 --2- 172.21.15.123:0/99858205 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbe8006c2b0 0x7fbe8006e770 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbe8c00aaf0 tx=0x7fbe8c008040 comp rx=0 tx=0).stop 2024-09-15T23:15:34.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.078+0000 7fbe9c6af640 1 -- 172.21.15.123:0/99858205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe9413eb20 msgr2=0x7fbe94072490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:34.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.078+0000 7fbe9c6af640 1 --2- 172.21.15.123:0/99858205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe9413eb20 0x7fbe94072490 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fbe8800c7f0 tx=0x7fbe8800ccb0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.078+0000 7fbe9c6af640 1 -- 172.21.15.123:0/99858205 shutdown_connections 2024-09-15T23:15:34.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.078+0000 7fbe9c6af640 1 --2- 172.21.15.123:0/99858205 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbe9415bcf0 0x7fbe940729d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.078+0000 7fbe9c6af640 1 --2- 172.21.15.123:0/99858205 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbe8006c2b0 0x7fbe8006e770 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.078+0000 7fbe9c6af640 1 --2- 172.21.15.123:0/99858205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe9413eb20 0x7fbe94072490 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.078+0000 7fbe9c6af640 1 --2- 172.21.15.123:0/99858205 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbe940b2d40 0x7fbe9413d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.078+0000 7fbe9c6af640 1 -- 172.21.15.123:0/99858205 >> 172.21.15.123:0/99858205 conn(0x7fbe940ccec0 msgr2=0x7fbe94159be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:34.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.079+0000 7fbe9c6af640 1 -- 172.21.15.123:0/99858205 shutdown_connections 2024-09-15T23:15:34.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.079+0000 7fbe9c6af640 1 -- 172.21.15.123:0/99858205 wait complete. 2024-09-15T23:15:34.090 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_size 100 2024-09-15T23:15:34.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.190+0000 7f4ac2277640 1 Processor -- start 2024-09-15T23:15:34.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.190+0000 7f4ac2277640 1 -- start start 2024-09-15T23:15:34.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.190+0000 7f4ac2277640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4abc0b3350 0x7f4abc0d2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.190+0000 7f4ac2277640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4abc0cf710 con 0x7f4abc0b38a0 2024-09-15T23:15:34.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.190+0000 7f4ac2277640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4abc0cf9f0 con 0x7f4abc06bfd0 2024-09-15T23:15:34.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.190+0000 7f4ac2277640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f4abc0b78a0 con 0x7f4abc0b3350 2024-09-15T23:15:34.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.191+0000 7f4ac0814640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f4abc0b38a0 0x7f4abc0d2e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39500/0 (socket says 172.21.15.123:39500) 2024-09-15T23:15:34.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.191+0000 7f4ac0814640 1 -- 172.21.15.123:0/3728737880 learned_addr learned my addr 172.21.15.123:0/3728737880 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:34.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.191+0000 7f4abb7fe640 1 --2- 172.21.15.123:0/3728737880 >> v2:172.21.15.188:3300/0 conn(0x7f4abc0b3350 0x7f4abc0d2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.191+0000 7f4abaffd640 1 -- 172.21.15.123:0/3728737880 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2799604219 0 0) 0x7f4abc0cf710 con 0x7f4abc0b38a0 2024-09-15T23:15:34.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.191+0000 7f4abaffd640 1 -- 172.21.15.123:0/3728737880 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4aa4003520 con 0x7f4abc0b38a0 2024-09-15T23:15:34.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.191+0000 7f4abaffd640 1 -- 172.21.15.123:0/3728737880 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1509673201 0 0) 0x7f4aa4003520 con 0x7f4abc0b38a0 2024-09-15T23:15:34.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.191+0000 7f4abaffd640 1 -- 172.21.15.123:0/3728737880 >> v2:172.21.15.188:3300/0 conn(0x7f4abc0b3350 msgr2=0x7f4abc0d2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:34.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.191+0000 7f4abaffd640 1 --2- 172.21.15.123:0/3728737880 >> v2:172.21.15.188:3300/0 conn(0x7f4abc0b3350 0x7f4abc0d2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.191+0000 7f4abaffd640 1 -- 172.21.15.123:0/3728737880 >> v1:172.21.15.188:6789/0 conn(0x7f4abc06bfd0 legacy=0x7f4abc06c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:34.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.191+0000 7f4abaffd640 1 -- 172.21.15.123:0/3728737880 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4abc0cfcd0 con 0x7f4abc0b38a0 2024-09-15T23:15:34.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.191+0000 7f4abaffd640 1 -- 172.21.15.123:0/3728737880 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f4ab40019f0 con 0x7f4abc0b38a0 2024-09-15T23:15:34.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.191+0000 7f4abaffd640 1 -- 172.21.15.123:0/3728737880 >> v1:172.21.15.123:6789/0 conn(0x7f4abc0b38a0 legacy=0x7f4abc0d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:34.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.191+0000 7f4abaffd640 1 --2- 172.21.15.123:0/3728737880 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4aa40039b0 0x7f4aa4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.191+0000 7f4abaffd640 1 --2- 172.21.15.123:0/3728737880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4aa4004800 0x7f4aa4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.191+0000 7f4abaffd640 1 --2- 172.21.15.123:0/3728737880 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4aa40051c0 0x7f4aa400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.191+0000 7f4abaffd640 1 -- 172.21.15.123:0/3728737880 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa400c040 con 0x7f4aa4004800 2024-09-15T23:15:34.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.191+0000 7f4abaffd640 1 -- 172.21.15.123:0/3728737880 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa400c1f0 con 0x7f4aa40051c0 2024-09-15T23:15:34.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.191+0000 7f4abaffd640 1 -- 172.21.15.123:0/3728737880 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4aa400c3f0 con 0x7f4aa40039b0 2024-09-15T23:15:34.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.191+0000 7f4abb7fe640 1 --2- 172.21.15.123:0/3728737880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4aa4004800 0x7f4aa4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.191+0000 7f4abbfff640 1 --2- 172.21.15.123:0/3728737880 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4aa40039b0 0x7f4aa4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.191+0000 7f4ac0814640 1 --2- 172.21.15.123:0/3728737880 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4aa40051c0 0x7f4aa400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.192+0000 7f4abb7fe640 1 -- 172.21.15.123:0/3728737880 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4aa40039b0 msgr2=0x7f4aa4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:34.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.192+0000 7f4abb7fe640 1 --2- 172.21.15.123:0/3728737880 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4aa40039b0 0x7f4aa4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.192+0000 7f4abb7fe640 1 -- 172.21.15.123:0/3728737880 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4aa40051c0 msgr2=0x7f4aa400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:34.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.192+0000 7f4abb7fe640 1 --2- 172.21.15.123:0/3728737880 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4aa40051c0 0x7f4aa400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.192+0000 7f4abb7fe640 1 -- 172.21.15.123:0/3728737880 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aa4003520 con 0x7f4aa4004800 2024-09-15T23:15:34.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.192+0000 7f4ac0814640 1 -- 172.21.15.123:0/3728737880 reap_dead start 2024-09-15T23:15:34.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.192+0000 7f4abbfff640 1 --2- 172.21.15.123:0/3728737880 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4aa40039b0 0x7f4aa4003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:34.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.192+0000 7f4abb7fe640 1 --2- 172.21.15.123:0/3728737880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4aa4004800 0x7f4aa4004c80 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0009ac0 tx=0x7f4aa4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e64f49112569e65 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:34.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.192+0000 7f4abaffd640 1 -- 172.21.15.123:0/3728737880 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0036070 con 0x7f4aa4004800 2024-09-15T23:15:34.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.192+0000 7f4abaffd640 1 -- 172.21.15.123:0/3728737880 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab0031400 con 0x7f4aa4004800 2024-09-15T23:15:34.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.192+0000 7f4abaffd640 1 -- 172.21.15.123:0/3728737880 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0009690 con 0x7f4aa4004800 2024-09-15T23:15:34.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.193+0000 7f4ac2277640 1 -- 172.21.15.123:0/3728737880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4aa4004800 msgr2=0x7f4aa4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:34.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.193+0000 7f4ac2277640 1 --2- 172.21.15.123:0/3728737880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4aa4004800 0x7f4aa4004c80 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0009ac0 tx=0x7f4aa4005830 comp rx=0 tx=0).stop 2024-09-15T23:15:34.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.193+0000 7f4ac2277640 1 -- 172.21.15.123:0/3728737880 shutdown_connections 2024-09-15T23:15:34.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.193+0000 7f4ac2277640 1 --2- 172.21.15.123:0/3728737880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4aa4004800 0x7f4aa4004c80 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.193+0000 7f4ac2277640 1 -- 172.21.15.123:0/3728737880 >> 172.21.15.123:0/3728737880 conn(0x7f4abc0d11c0 msgr2=0x7f4abc0d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:34.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.193+0000 7f4ac2277640 1 -- 172.21.15.123:0/3728737880 shutdown_connections 2024-09-15T23:15:34.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.193+0000 7f4ac2277640 1 -- 172.21.15.123:0/3728737880 wait complete. 2024-09-15T23:15:34.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.194+0000 7f4ac2277640 1 Processor -- start 2024-09-15T23:15:34.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.194+0000 7f4ac2277640 1 -- start start 2024-09-15T23:15:34.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.195+0000 7f4ac2277640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4aa4004800 0x7f4abc161b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.195+0000 7f4ac2277640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4abc154670 0x7f4abc15f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.195+0000 7f4ac2277640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4abc0b50f0 0x7f4abc0b5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.195+0000 7f4ac2277640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4abc06cd50 con 0x7f4abc0b50f0 2024-09-15T23:15:34.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.195+0000 7f4ac2277640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4abc0cffb0 con 0x7f4aa4004800 2024-09-15T23:15:34.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.195+0000 7f4ac2277640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4abc15eae0 con 0x7f4abc154670 2024-09-15T23:15:34.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.195+0000 7f4ac0814640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4abc0b50f0 0x7f4abc0b5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.195+0000 7f4ac0814640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4abc0b50f0 0x7f4abc0b5570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58968/0 (socket says 172.21.15.123:58968) 2024-09-15T23:15:34.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.195+0000 7f4ac0814640 1 -- 172.21.15.123:0/1379053703 learned_addr learned my addr 172.21.15.123:0/1379053703 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:34.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.195+0000 7f4abbfff640 1 --2- 172.21.15.123:0/1379053703 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4aa4004800 0x7f4abc161b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.196+0000 7f4ac0814640 1 -- 172.21.15.123:0/1379053703 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4abc154670 msgr2=0x7f4abc15f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:34.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.196+0000 7f4abb7fe640 1 --2- 172.21.15.123:0/1379053703 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4abc154670 0x7f4abc15f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.196+0000 7f4ac0814640 1 --2- 172.21.15.123:0/1379053703 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4abc154670 0x7f4abc15f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.196+0000 7f4ac0814640 1 -- 172.21.15.123:0/1379053703 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4aa4004800 msgr2=0x7f4abc161b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:34.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.196+0000 7f4ac0814640 1 --2- 172.21.15.123:0/1379053703 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4aa4004800 0x7f4abc161b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.196+0000 7f4ac0814640 1 -- 172.21.15.123:0/1379053703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4abc154af0 con 0x7f4abc0b50f0 2024-09-15T23:15:34.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.196+0000 7f4abbfff640 1 --2- 172.21.15.123:0/1379053703 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4aa4004800 0x7f4abc161b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:34.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.196+0000 7f4ac0814640 1 --2- 172.21.15.123:0/1379053703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4abc0b50f0 0x7f4abc0b5570 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f4ab40077b0 tx=0x7f4ab400e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:34.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.196+0000 7f4ab8ff9640 1 -- 172.21.15.123:0/1379053703 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab400eae0 con 0x7f4abc0b50f0 2024-09-15T23:15:34.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.196+0000 7f4ab8ff9640 1 -- 172.21.15.123:0/1379053703 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab400ec80 con 0x7f4abc0b50f0 2024-09-15T23:15:34.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.196+0000 7f4ac2277640 1 -- 172.21.15.123:0/1379053703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4abc1600d0 con 0x7f4abc0b50f0 2024-09-15T23:15:34.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.196+0000 7f4ab8ff9640 1 -- 172.21.15.123:0/1379053703 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4014480 con 0x7f4abc0b50f0 2024-09-15T23:15:34.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.196+0000 7f4ac2277640 1 -- 172.21.15.123:0/1379053703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4abc160690 con 0x7f4abc0b50f0 2024-09-15T23:15:34.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.197+0000 7f4ac2277640 1 -- 172.21.15.123:0/1379053703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4abc0b5ab0 con 0x7f4abc0b50f0 2024-09-15T23:15:34.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.197+0000 7f4ab8ff9640 1 -- 172.21.15.123:0/1379053703 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4ab4014620 con 0x7f4abc0b50f0 2024-09-15T23:15:34.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.198+0000 7f4ab8ff9640 1 --2- 172.21.15.123:0/1379053703 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4aa806c2b0 0x7f4aa806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.198+0000 7f4ab8ff9640 1 -- 172.21.15.123:0/1379053703 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5881+0+0 (secure 0 0 0) 0x7f4ab408b3a0 con 0x7f4abc0b50f0 2024-09-15T23:15:34.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.198+0000 7f4abbfff640 1 --2- 172.21.15.123:0/1379053703 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4aa806c2b0 0x7f4aa806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.199+0000 7f4abbfff640 1 --2- 172.21.15.123:0/1379053703 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4aa806c2b0 0x7f4aa806e770 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4aac000c00 tx=0x7f4aac009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:34.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.202+0000 7f4ab8ff9640 1 -- 172.21.15.123:0/1379053703 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4ab4059a60 con 0x7f4abc0b50f0 2024-09-15T23:15:34.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.368+0000 7f4ac2277640 1 -- 172.21.15.123:0/1379053703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f4abc06c3b0 con 0x7f4abc0b50f0 2024-09-15T23:15:34.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.370+0000 7f4ab8ff9640 1 -- 172.21.15.123:0/1379053703 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v18)=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f4ab4059360 con 0x7f4abc0b50f0 2024-09-15T23:15:34.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.373+0000 7f4ac2277640 1 -- 172.21.15.123:0/1379053703 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4aa806c2b0 msgr2=0x7f4aa806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:34.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.373+0000 7f4ac2277640 1 --2- 172.21.15.123:0/1379053703 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4aa806c2b0 0x7f4aa806e770 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4aac000c00 tx=0x7f4aac009040 comp rx=0 tx=0).stop 2024-09-15T23:15:34.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.373+0000 7f4ac2277640 1 -- 172.21.15.123:0/1379053703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4abc0b50f0 msgr2=0x7f4abc0b5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:34.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.373+0000 7f4ac2277640 1 --2- 172.21.15.123:0/1379053703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4abc0b50f0 0x7f4abc0b5570 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f4ab40077b0 tx=0x7f4ab400e160 comp rx=0 tx=0).stop 2024-09-15T23:15:34.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.373+0000 7f4ac2277640 1 -- 172.21.15.123:0/1379053703 shutdown_connections 2024-09-15T23:15:34.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.373+0000 7f4ac2277640 1 --2- 172.21.15.123:0/1379053703 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4aa806c2b0 0x7f4aa806e770 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.373+0000 7f4ac2277640 1 --2- 172.21.15.123:0/1379053703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4abc0b50f0 0x7f4abc0b5570 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.373+0000 7f4ac2277640 1 --2- 172.21.15.123:0/1379053703 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4abc154670 0x7f4abc15f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.373+0000 7f4ac2277640 1 --2- 172.21.15.123:0/1379053703 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4aa4004800 0x7f4abc161b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.373+0000 7f4ac2277640 1 -- 172.21.15.123:0/1379053703 >> 172.21.15.123:0/1379053703 conn(0x7f4abc0d11c0 msgr2=0x7f4abc0b8100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:34.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.373+0000 7f4ac2277640 1 -- 172.21.15.123:0/1379053703 shutdown_connections 2024-09-15T23:15:34.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.373+0000 7f4ac2277640 1 -- 172.21.15.123:0/1379053703 wait complete. 2024-09-15T23:15:34.385 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_merge_size 30 2024-09-15T23:15:34.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.488+0000 7fca63f5f640 1 Processor -- start 2024-09-15T23:15:34.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.488+0000 7fca63f5f640 1 -- start start 2024-09-15T23:15:34.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.489+0000 7fca63f5f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fca5c0b5520 0x7fca5c06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.489+0000 7fca63f5f640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca5c15f550 con 0x7fca5c15e990 2024-09-15T23:15:34.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.489+0000 7fca63f5f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca5c15f830 con 0x7fca5c06d260 2024-09-15T23:15:34.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.489+0000 7fca63f5f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fca5c15fb10 con 0x7fca5c0b5520 2024-09-15T23:15:34.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.489+0000 7fca614fa640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fca5c0b5520 0x7fca5c06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.489+0000 7fca61cfb640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fca5c15e990 0x7fca5c15ed70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39516/0 (socket says 172.21.15.123:39516) 2024-09-15T23:15:34.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.489+0000 7fca61cfb640 1 -- 172.21.15.123:0/2248698366 learned_addr learned my addr 172.21.15.123:0/2248698366 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:34.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.489+0000 7fca614fa640 1 --2- 172.21.15.123:0/2248698366 >> v2:172.21.15.123:3300/0 conn(0x7fca5c0b5520 0x7fca5c06cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58978/0 (socket says 172.21.15.123:58978) 2024-09-15T23:15:34.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.489+0000 7fca614fa640 1 -- 172.21.15.123:0/2248698366 >> v1:172.21.15.188:6789/0 conn(0x7fca5c06d260 legacy=0x7fca5c162a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:34.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.489+0000 7fca614fa640 1 -- 172.21.15.123:0/2248698366 >> v1:172.21.15.123:6789/0 conn(0x7fca5c15e990 legacy=0x7fca5c15ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:34.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.489+0000 7fca614fa640 1 -- 172.21.15.123:0/2248698366 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca5c1624e0 con 0x7fca5c0b5520 2024-09-15T23:15:34.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.489+0000 7fca60cf9640 1 -- 172.21.15.123:0/2248698366 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1130629247 0 0) 0x7fca5c15f550 con 0x7fca5c15e990 2024-09-15T23:15:34.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.490+0000 7fca614fa640 1 --2- 172.21.15.123:0/2248698366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca5c0b5520 0x7fca5c06cd20 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fca4c0097a0 tx=0x7fca4c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5663110facb26f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:34.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.490+0000 7fca60cf9640 1 -- 172.21.15.123:0/2248698366 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4c037070 con 0x7fca5c0b5520 2024-09-15T23:15:34.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.490+0000 7fca60cf9640 1 -- 172.21.15.123:0/2248698366 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca4c032440 con 0x7fca5c0b5520 2024-09-15T23:15:34.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.490+0000 7fca60cf9640 1 -- 172.21.15.123:0/2248698366 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4c032810 con 0x7fca5c0b5520 2024-09-15T23:15:34.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.491+0000 7fca63f5f640 1 -- 172.21.15.123:0/2248698366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca5c0b5520 msgr2=0x7fca5c06cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:34.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.491+0000 7fca63f5f640 1 --2- 172.21.15.123:0/2248698366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca5c0b5520 0x7fca5c06cd20 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fca4c0097a0 tx=0x7fca4c02a1e0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.491+0000 7fca63f5f640 1 -- 172.21.15.123:0/2248698366 shutdown_connections 2024-09-15T23:15:34.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.491+0000 7fca63f5f640 1 --2- 172.21.15.123:0/2248698366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca5c0b5520 0x7fca5c06cd20 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.491+0000 7fca63f5f640 1 -- 172.21.15.123:0/2248698366 >> 172.21.15.123:0/2248698366 conn(0x7fca5c0d25d0 msgr2=0x7fca5c0d29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:34.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.491+0000 7fca63f5f640 1 -- 172.21.15.123:0/2248698366 shutdown_connections 2024-09-15T23:15:34.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.491+0000 7fca63f5f640 1 -- 172.21.15.123:0/2248698366 wait complete. 2024-09-15T23:15:34.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.492+0000 7fca63f5f640 1 Processor -- start 2024-09-15T23:15:34.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.492+0000 7fca63f5f640 1 -- start start 2024-09-15T23:15:34.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.492+0000 7fca63f5f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca5c06d260 0x7fca5c0cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.492+0000 7fca63f5f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca5c0b5520 0x7fca5c0d1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.493+0000 7fca63f5f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fca5c15e990 0x7fca5c14ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.493+0000 7fca63f5f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fca5c0b7170 con 0x7fca5c0b5520 2024-09-15T23:15:34.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.493+0000 7fca63f5f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fca5c0b6ff0 con 0x7fca5c06d260 2024-09-15T23:15:34.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.493+0000 7fca63f5f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fca5c0b72f0 con 0x7fca5c15e990 2024-09-15T23:15:34.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.493+0000 7fca614fa640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca5c0b5520 0x7fca5c0d1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.493+0000 7fca614fa640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca5c0b5520 0x7fca5c0d1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58986/0 (socket says 172.21.15.123:58986) 2024-09-15T23:15:34.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.493+0000 7fca614fa640 1 -- 172.21.15.123:0/153840361 learned_addr learned my addr 172.21.15.123:0/153840361 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:34.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.493+0000 7fca61cfb640 1 --2- 172.21.15.123:0/153840361 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca5c06d260 0x7fca5c0cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.493+0000 7fca624fc640 1 --2- 172.21.15.123:0/153840361 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fca5c15e990 0x7fca5c14ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.493+0000 7fca614fa640 1 -- 172.21.15.123:0/153840361 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fca5c15e990 msgr2=0x7fca5c14ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:34.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.493+0000 7fca614fa640 1 --2- 172.21.15.123:0/153840361 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fca5c15e990 0x7fca5c14ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.493+0000 7fca614fa640 1 -- 172.21.15.123:0/153840361 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca5c06d260 msgr2=0x7fca5c0cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:34.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.493+0000 7fca614fa640 1 --2- 172.21.15.123:0/153840361 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca5c06d260 0x7fca5c0cfc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.493+0000 7fca614fa640 1 -- 172.21.15.123:0/153840361 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca5c0d0300 con 0x7fca5c0b5520 2024-09-15T23:15:34.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.493+0000 7fca61cfb640 1 --2- 172.21.15.123:0/153840361 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca5c06d260 0x7fca5c0cfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:34.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.493+0000 7fca614fa640 1 --2- 172.21.15.123:0/153840361 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca5c0b5520 0x7fca5c0d1b60 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fca4c0097a0 tx=0x7fca4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:34.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.493+0000 7fca527fc640 1 -- 172.21.15.123:0/153840361 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4c037040 con 0x7fca5c0b5520 2024-09-15T23:15:34.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.493+0000 7fca527fc640 1 -- 172.21.15.123:0/153840361 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca4c004250 con 0x7fca5c0b5520 2024-09-15T23:15:34.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.493+0000 7fca527fc640 1 -- 172.21.15.123:0/153840361 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4c032e20 con 0x7fca5c0b5520 2024-09-15T23:15:34.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.493+0000 7fca63f5f640 1 -- 172.21.15.123:0/153840361 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca5c0d05e0 con 0x7fca5c0b5520 2024-09-15T23:15:34.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.493+0000 7fca63f5f640 1 -- 172.21.15.123:0/153840361 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca5c0d0ba0 con 0x7fca5c0b5520 2024-09-15T23:15:34.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.494+0000 7fca63f5f640 1 -- 172.21.15.123:0/153840361 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca5c06cd20 con 0x7fca5c0b5520 2024-09-15T23:15:34.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.495+0000 7fca527fc640 1 -- 172.21.15.123:0/153840361 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fca4c030770 con 0x7fca5c0b5520 2024-09-15T23:15:34.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.495+0000 7fca527fc640 1 --2- 172.21.15.123:0/153840361 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fca4006c2b0 0x7fca4006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.495+0000 7fca527fc640 1 -- 172.21.15.123:0/153840361 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5881+0+0 (secure 0 0 0) 0x7fca4c0ac890 con 0x7fca5c0b5520 2024-09-15T23:15:34.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.495+0000 7fca61cfb640 1 --2- 172.21.15.123:0/153840361 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fca4006c2b0 0x7fca4006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.496+0000 7fca61cfb640 1 --2- 172.21.15.123:0/153840361 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fca4006c2b0 0x7fca4006e770 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fca58000f60 tx=0x7fca58007ca0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:34.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.499+0000 7fca527fc640 1 -- 172.21.15.123:0/153840361 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fca4c07afe0 con 0x7fca5c0b5520 2024-09-15T23:15:34.664 INFO:tasks.ceph.mds.a.smithi123.stderr:2024-09-15T23:15:34.663+0000 7ff83eec6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:15:34.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.665+0000 7fca63f5f640 1 -- 172.21.15.123:0/153840361 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7fca5c06cd20 con 0x7fca5c0b5520 2024-09-15T23:15:34.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.668+0000 7fca527fc640 1 -- 172.21.15.123:0/153840361 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v19)=0 v19) ==== 117+0+0 (secure 0 0 0) 0x7fca4c07a8e0 con 0x7fca5c0b5520 2024-09-15T23:15:34.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.670+0000 7fca63f5f640 1 -- 172.21.15.123:0/153840361 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fca4006c2b0 msgr2=0x7fca4006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:34.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.670+0000 7fca63f5f640 1 --2- 172.21.15.123:0/153840361 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fca4006c2b0 0x7fca4006e770 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fca58000f60 tx=0x7fca58007ca0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.670+0000 7fca63f5f640 1 -- 172.21.15.123:0/153840361 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca5c0b5520 msgr2=0x7fca5c0d1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:34.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.670+0000 7fca63f5f640 1 --2- 172.21.15.123:0/153840361 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca5c0b5520 0x7fca5c0d1b60 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fca4c0097a0 tx=0x7fca4c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.671+0000 7fca63f5f640 1 -- 172.21.15.123:0/153840361 shutdown_connections 2024-09-15T23:15:34.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.671+0000 7fca63f5f640 1 --2- 172.21.15.123:0/153840361 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fca5c15e990 0x7fca5c14ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.671+0000 7fca63f5f640 1 --2- 172.21.15.123:0/153840361 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fca4006c2b0 0x7fca4006e770 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.671+0000 7fca63f5f640 1 --2- 172.21.15.123:0/153840361 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca5c0b5520 0x7fca5c0d1b60 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.671+0000 7fca63f5f640 1 --2- 172.21.15.123:0/153840361 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fca5c06d260 0x7fca5c0cfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.671+0000 7fca63f5f640 1 -- 172.21.15.123:0/153840361 >> 172.21.15.123:0/153840361 conn(0x7fca5c0d25d0 msgr2=0x7fca5c15fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:34.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.671+0000 7fca63f5f640 1 -- 172.21.15.123:0/153840361 shutdown_connections 2024-09-15T23:15:34.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.671+0000 7fca63f5f640 1 -- 172.21.15.123:0/153840361 wait complete. 2024-09-15T23:15:34.683 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:15:34.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.779+0000 7f187ef42640 1 Processor -- start 2024-09-15T23:15:34.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.779+0000 7f187ef42640 1 -- start start 2024-09-15T23:15:34.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.780+0000 7f187ef42640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1878145ed0 0x7f18780b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.780+0000 7f187ef42640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f18780b5f90 0x7f18780735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.780+0000 7f187ef42640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18780b4020 con 0x7f1878073180 2024-09-15T23:15:34.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.780+0000 7f187ef42640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f1878073b00 con 0x7f18780b5f90 2024-09-15T23:15:34.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.780+0000 7f187ef42640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f18780b42c0 con 0x7f1878145ed0 2024-09-15T23:15:34.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.780+0000 7f187d4df640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f18780b5f90 0x7f18780735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.780+0000 7f187d4df640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f18780b5f90 0x7f18780735c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58998/0 (socket says 172.21.15.123:58998) 2024-09-15T23:15:34.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.780+0000 7f187d4df640 1 -- 172.21.15.123:0/1562665936 learned_addr learned my addr 172.21.15.123:0/1562665936 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:34.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.780+0000 7f187ccde640 1 --2- 172.21.15.123:0/1562665936 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1878145ed0 0x7f18780b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.780+0000 7f187d4df640 1 -- 172.21.15.123:0/1562665936 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1878145ed0 msgr2=0x7f18780b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:34.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.780+0000 7f187d4df640 1 --2- 172.21.15.123:0/1562665936 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1878145ed0 0x7f18780b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.780+0000 7f187d4df640 1 -- 172.21.15.123:0/1562665936 >> v1:172.21.15.188:6789/0 conn(0x7f1878073180 legacy=0x7f18780b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:34.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.780+0000 7f187d4df640 1 -- 172.21.15.123:0/1562665936 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18780b45a0 con 0x7f18780b5f90 2024-09-15T23:15:34.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.781+0000 7f187d4df640 1 --2- 172.21.15.123:0/1562665936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18780b5f90 0x7f18780735c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f1870009e50 tx=0x7f187002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b92fbbe0f4f33d2f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:34.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.781+0000 7f18777fe640 1 -- 172.21.15.123:0/1562665936 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1870036070 con 0x7f18780b5f90 2024-09-15T23:15:34.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.781+0000 7f18777fe640 1 -- 172.21.15.123:0/1562665936 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1870031600 con 0x7f18780b5f90 2024-09-15T23:15:34.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.781+0000 7f18777fe640 1 -- 172.21.15.123:0/1562665936 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18700319d0 con 0x7f18780b5f90 2024-09-15T23:15:34.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.781+0000 7f187ef42640 1 -- 172.21.15.123:0/1562665936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18780b5f90 msgr2=0x7f18780735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:34.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.781+0000 7f187ef42640 1 --2- 172.21.15.123:0/1562665936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18780b5f90 0x7f18780735c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f1870009e50 tx=0x7f187002a710 comp rx=0 tx=0).stop 2024-09-15T23:15:34.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.782+0000 7f187ef42640 1 -- 172.21.15.123:0/1562665936 shutdown_connections 2024-09-15T23:15:34.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.782+0000 7f187ef42640 1 --2- 172.21.15.123:0/1562665936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18780b5f90 0x7f18780735c0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.782+0000 7f187ef42640 1 --2- 172.21.15.123:0/1562665936 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1878145ed0 0x7f18780b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.782+0000 7f187ef42640 1 -- 172.21.15.123:0/1562665936 >> 172.21.15.123:0/1562665936 conn(0x7f18780ccec0 msgr2=0x7f18780cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:34.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.782+0000 7f187ef42640 1 -- 172.21.15.123:0/1562665936 shutdown_connections 2024-09-15T23:15:34.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.782+0000 7f187ef42640 1 -- 172.21.15.123:0/1562665936 wait complete. 2024-09-15T23:15:34.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.783+0000 7f187ef42640 1 Processor -- start 2024-09-15T23:15:34.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.783+0000 7f187ef42640 1 -- start start 2024-09-15T23:15:34.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.784+0000 7f187ef42640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1878073180 0x7f1878152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.784+0000 7f187ef42640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f18780b5f90 0x7f18780c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.784+0000 7f187ef42640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1878145ed0 0x7f187813b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.784+0000 7f187ef42640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f18781462b0 con 0x7f1878145ed0 2024-09-15T23:15:34.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.784+0000 7f187ef42640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f18780b4b60 con 0x7f18780b5f90 2024-09-15T23:15:34.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.784+0000 7f187ef42640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1878146430 con 0x7f1878073180 2024-09-15T23:15:34.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.784+0000 7f187d4df640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1878145ed0 0x7f187813b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.784+0000 7f187d4df640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1878145ed0 0x7f187813b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59004/0 (socket says 172.21.15.123:59004) 2024-09-15T23:15:34.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.784+0000 7f187d4df640 1 -- 172.21.15.123:0/1022220818 learned_addr learned my addr 172.21.15.123:0/1022220818 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:34.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.784+0000 7f187ccde640 1 --2- 172.21.15.123:0/1022220818 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1878073180 0x7f1878152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.784+0000 7f1877fff640 1 --2- 172.21.15.123:0/1022220818 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f18780b5f90 0x7f18780c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.784+0000 7f187d4df640 1 -- 172.21.15.123:0/1022220818 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1878073180 msgr2=0x7f1878152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:34.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.784+0000 7f187d4df640 1 --2- 172.21.15.123:0/1022220818 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1878073180 0x7f1878152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.784+0000 7f187d4df640 1 -- 172.21.15.123:0/1022220818 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f18780b5f90 msgr2=0x7f18780c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:34.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.784+0000 7f187d4df640 1 --2- 172.21.15.123:0/1022220818 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f18780b5f90 0x7f18780c6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.784+0000 7f187d4df640 1 -- 172.21.15.123:0/1022220818 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18780c6a80 con 0x7f1878145ed0 2024-09-15T23:15:34.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.784+0000 7f187d4df640 1 --2- 172.21.15.123:0/1022220818 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1878145ed0 0x7f187813b580 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f1870034040 tx=0x7f1870004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:34.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.784+0000 7f18757fa640 1 -- 172.21.15.123:0/1022220818 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1870036050 con 0x7f1878145ed0 2024-09-15T23:15:34.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.784+0000 7f18757fa640 1 -- 172.21.15.123:0/1022220818 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1870042070 con 0x7f1878145ed0 2024-09-15T23:15:34.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.784+0000 7f187ef42640 1 -- 172.21.15.123:0/1022220818 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f187813d8a0 con 0x7f1878145ed0 2024-09-15T23:15:34.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.784+0000 7f18757fa640 1 -- 172.21.15.123:0/1022220818 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1870009510 con 0x7f1878145ed0 2024-09-15T23:15:34.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.785+0000 7f187ef42640 1 -- 172.21.15.123:0/1022220818 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f187813cdc0 con 0x7f1878145ed0 2024-09-15T23:15:34.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.785+0000 7f187ef42640 1 -- 172.21.15.123:0/1022220818 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18780735c0 con 0x7f1878145ed0 2024-09-15T23:15:34.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.786+0000 7f18757fa640 1 -- 172.21.15.123:0/1022220818 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1870007bd0 con 0x7f1878145ed0 2024-09-15T23:15:34.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.786+0000 7f18757fa640 1 --2- 172.21.15.123:0/1022220818 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f185c06c2e0 0x7f185c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:34.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.786+0000 7f18757fa640 1 -- 172.21.15.123:0/1022220818 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5881+0+0 (secure 0 0 0) 0x7f18700ac1c0 con 0x7f1878145ed0 2024-09-15T23:15:34.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.787+0000 7f187ccde640 1 --2- 172.21.15.123:0/1022220818 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f185c06c2e0 0x7f185c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:34.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.787+0000 7f187ccde640 1 --2- 172.21.15.123:0/1022220818 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f185c06c2e0 0x7f185c06e7a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1878139280 tx=0x7f186c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:34.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.791+0000 7f18757fa640 1 -- 172.21.15.123:0/1022220818 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f187007a2c0 con 0x7f1878145ed0 2024-09-15T23:15:34.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.989+0000 7f187ef42640 1 -- 172.21.15.123:0/1022220818 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1878143fb0 con 0x7f1878145ed0 2024-09-15T23:15:34.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.989+0000 7f18757fa640 1 -- 172.21.15.123:0/1022220818 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5230 (secure 0 0 0) 0x7f187007e5c0 con 0x7f1878145ed0 2024-09-15T23:15:34.990 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:34.990 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":38,"btime":"2024-09-15T23:15:32:678232+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5483,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/522636413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":522636413},{"type":"v1","addr":"172.21.15.188:6835","nonce":522636413}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5860,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/3057173907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":3057173907},{"type":"v1","addr":"172.21.15.188:6837","nonce":3057173907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6399,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/811728648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":811728648},{"type":"v1","addr":"172.21.15.123:6833","nonce":811728648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:15:17.752297+0000","modified":"2024-09-15T23:15:32.678225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6411":{"gid":6411,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6835/3634063333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3634063333},{"type":"v1","addr":"172.21.15.123:6835","nonce":3634063333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6411,"qdb_cluster":[6411]},"id":4}]} 2024-09-15T23:15:34.991 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 38 2024-09-15T23:15:34.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.991+0000 7f187ef42640 1 -- 172.21.15.123:0/1022220818 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f185c06c2e0 msgr2=0x7f185c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:34.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.991+0000 7f187ef42640 1 --2- 172.21.15.123:0/1022220818 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f185c06c2e0 0x7f185c06e7a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1878139280 tx=0x7f186c008040 comp rx=0 tx=0).stop 2024-09-15T23:15:34.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.991+0000 7f187ef42640 1 -- 172.21.15.123:0/1022220818 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1878145ed0 msgr2=0x7f187813b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:34.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.991+0000 7f187ef42640 1 --2- 172.21.15.123:0/1022220818 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1878145ed0 0x7f187813b580 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f1870034040 tx=0x7f1870004a40 comp rx=0 tx=0).stop 2024-09-15T23:15:34.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.991+0000 7f187ef42640 1 -- 172.21.15.123:0/1022220818 shutdown_connections 2024-09-15T23:15:34.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.991+0000 7f187ef42640 1 --2- 172.21.15.123:0/1022220818 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f185c06c2e0 0x7f185c06e7a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.991+0000 7f187ef42640 1 --2- 172.21.15.123:0/1022220818 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1878145ed0 0x7f187813b580 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.991+0000 7f187ef42640 1 --2- 172.21.15.123:0/1022220818 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f18780b5f90 0x7f18780c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.991+0000 7f187ef42640 1 --2- 172.21.15.123:0/1022220818 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1878073180 0x7f1878152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:34.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.991+0000 7f187ef42640 1 -- 172.21.15.123:0/1022220818 >> 172.21.15.123:0/1022220818 conn(0x7f18780ccec0 msgr2=0x7f1878144e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:34.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.991+0000 7f187ef42640 1 -- 172.21.15.123:0/1022220818 shutdown_connections 2024-09-15T23:15:34.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:34.991+0000 7f187ef42640 1 -- 172.21.15.123:0/1022220818 wait complete. 2024-09-15T23:15:35.003 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-15T23:15:35.114 INFO:teuthology.orchestra.run.smithi123.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-15T23:15:26.733751+0000","btime":"2024-09-15T23:15:25.961769+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-15T23:15:26.733751+0000","atime":"2024-09-15T23:15:25.961769+0000","time_warp_seq":0,"change_attr":31,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-15T23:15:26.733751+0000","num_files":40,"num_subdirs":0,"change_attr":31},"rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-15T23:15:26.733751+0000"},"accounted_rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-15T23:15:26.733751+0000"},"version":244,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[{"frag":"*","children":1}]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{},"nref":0,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-15T23:15:35.115 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 70, "rctime": "2024-09-15T23:15:26.733751+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-15T23:15:25.961769+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-15T23:15:25.961769+0000", "change_attr": 31, "client_caps": [], "client_ranges": [], "ctime": "2024-09-15T23:15:26.733751+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [ { "children": 1, "frag": "*" } ] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 31, "mtime": "2024-09-15T23:15:26.733751+0000", "num_files": 40, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1333, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-15T23:15:26.733751+0000", "nestlock": {}, "nlink": 1, "nref": 0, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": {}, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 70, "rctime": "2024-09-15T23:15:26.733751+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 244, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-15T23:15:35.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:15:35.115 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start /testdir recursive 2024-09-15T23:15:35.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.216+0000 7f690d4a5640 1 Processor -- start 2024-09-15T23:15:35.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.216+0000 7f690d4a5640 1 -- start start 2024-09-15T23:15:35.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.217+0000 7f690d4a5640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69080d16e0 0x7f69080d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:35.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.217+0000 7f690d4a5640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69080cf060 con 0x7f69080d40b0 2024-09-15T23:15:35.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.217+0000 7f690d4a5640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69080cf340 con 0x7f690815ea90 2024-09-15T23:15:35.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.217+0000 7f690d4a5640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f69080d34c0 con 0x7f69080d16e0 2024-09-15T23:15:35.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.217+0000 7f69077fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f69080d40b0 0x7f69080b7ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39528/0 (socket says 172.21.15.123:39528) 2024-09-15T23:15:35.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.217+0000 7f69077fe640 1 -- 172.21.15.123:0/2548198627 learned_addr learned my addr 172.21.15.123:0/2548198627 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:35.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.217+0000 7f69067fc640 1 -- 172.21.15.123:0/2548198627 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1886779082 0 0) 0x7f69080cf060 con 0x7f69080d40b0 2024-09-15T23:15:35.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.217+0000 7f68fe7fc640 1 --2- 172.21.15.123:0/2548198627 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69080d16e0 0x7f69080d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:35.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.217+0000 7f69067fc640 1 -- 172.21.15.123:0/2548198627 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68f4003520 con 0x7f69080d40b0 2024-09-15T23:15:35.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.218+0000 7f69067fc640 1 -- 172.21.15.123:0/2548198627 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1209992193 0 0) 0x7f68f4003520 con 0x7f69080d40b0 2024-09-15T23:15:35.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.218+0000 7f69067fc640 1 -- 172.21.15.123:0/2548198627 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69080d16e0 msgr2=0x7f69080d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:35.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.218+0000 7f69067fc640 1 --2- 172.21.15.123:0/2548198627 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69080d16e0 0x7f69080d2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.218+0000 7f69067fc640 1 -- 172.21.15.123:0/2548198627 >> v1:172.21.15.188:6789/0 conn(0x7f690815ea90 legacy=0x7f69080d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:35.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.218+0000 7f69067fc640 1 -- 172.21.15.123:0/2548198627 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69080cf620 con 0x7f69080d40b0 2024-09-15T23:15:35.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.218+0000 7f69067fc640 1 -- 172.21.15.123:0/2548198627 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f69000019f0 con 0x7f69080d40b0 2024-09-15T23:15:35.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.218+0000 7f69067fc640 1 -- 172.21.15.123:0/2548198627 >> v1:172.21.15.123:6789/0 conn(0x7f69080d40b0 legacy=0x7f69080b7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:35.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.218+0000 7f69067fc640 1 --2- 172.21.15.123:0/2548198627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68f40039e0 0x7f68f4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:35.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.218+0000 7f69067fc640 1 --2- 172.21.15.123:0/2548198627 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68f4004800 0x7f68f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:35.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.218+0000 7f69067fc640 1 --2- 172.21.15.123:0/2548198627 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69080d16e0 0x7f68f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:35.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.218+0000 7f69067fc640 1 -- 172.21.15.123:0/2548198627 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f69080d34c0 con 0x7f68f40039e0 2024-09-15T23:15:35.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.218+0000 7f69067fc640 1 -- 172.21.15.123:0/2548198627 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f68f400baa0 con 0x7f68f4004800 2024-09-15T23:15:35.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.218+0000 7f69067fc640 1 -- 172.21.15.123:0/2548198627 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f68f400bca0 con 0x7f69080d16e0 2024-09-15T23:15:35.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.218+0000 7f6906ffd640 1 --2- 172.21.15.123:0/2548198627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68f40039e0 0x7f68f4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:35.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.218+0000 7f68fe7fc640 1 --2- 172.21.15.123:0/2548198627 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68f4004800 0x7f68f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:35.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.218+0000 7f69077fe640 1 --2- 172.21.15.123:0/2548198627 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69080d16e0 0x7f68f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:35.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.218+0000 7f6906ffd640 1 -- 172.21.15.123:0/2548198627 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69080d16e0 msgr2=0x7f68f40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:35.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.218+0000 7f6906ffd640 1 --2- 172.21.15.123:0/2548198627 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69080d16e0 0x7f68f40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.218+0000 7f6906ffd640 1 -- 172.21.15.123:0/2548198627 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68f4004800 msgr2=0x7f68f4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:35.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.218+0000 7f6906ffd640 1 --2- 172.21.15.123:0/2548198627 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68f4004800 0x7f68f4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.218+0000 7f6906ffd640 1 -- 172.21.15.123:0/2548198627 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f4003520 con 0x7f68f40039e0 2024-09-15T23:15:35.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.218+0000 7f68fe7fc640 1 --2- 172.21.15.123:0/2548198627 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68f4004800 0x7f68f4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:35.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.219+0000 7f6906ffd640 1 --2- 172.21.15.123:0/2548198627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68f40039e0 0x7f68f4003e20 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f68f8001720 tx=0x7f68f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9dbf431a78ca63b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:35.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.219+0000 7f69067fc640 1 -- 172.21.15.123:0/2548198627 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f8001370 con 0x7f68f40039e0 2024-09-15T23:15:35.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.219+0000 7f69067fc640 1 -- 172.21.15.123:0/2548198627 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68f80052d0 con 0x7f68f40039e0 2024-09-15T23:15:35.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.219+0000 7f69067fc640 1 -- 172.21.15.123:0/2548198627 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f802ab90 con 0x7f68f40039e0 2024-09-15T23:15:35.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.219+0000 7f690d4a5640 1 -- 172.21.15.123:0/2548198627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68f40039e0 msgr2=0x7f68f4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:35.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.219+0000 7f690d4a5640 1 --2- 172.21.15.123:0/2548198627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68f40039e0 0x7f68f4003e20 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f68f8001720 tx=0x7f68f4005830 comp rx=0 tx=0).stop 2024-09-15T23:15:35.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.219+0000 7f69077fe640 1 -- 172.21.15.123:0/2548198627 reap_dead start 2024-09-15T23:15:35.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.219+0000 7f690d4a5640 1 -- 172.21.15.123:0/2548198627 shutdown_connections 2024-09-15T23:15:35.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.219+0000 7f690d4a5640 1 -- 172.21.15.123:0/2548198627 >> 172.21.15.123:0/2548198627 conn(0x7f690806c0e0 msgr2=0x7f690806c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:35.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.219+0000 7f690d4a5640 1 -- 172.21.15.123:0/2548198627 shutdown_connections 2024-09-15T23:15:35.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.219+0000 7f690d4a5640 1 -- 172.21.15.123:0/2548198627 wait complete. 2024-09-15T23:15:35.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.221+0000 7f690d4a5640 1 Processor -- start 2024-09-15T23:15:35.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.221+0000 7f690d4a5640 1 -- start start 2024-09-15T23:15:35.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.221+0000 7f690d4a5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68f40039e0 0x7f69081e9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:35.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.221+0000 7f690d4a5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69080ce590 0x7f69081f57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:35.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.221+0000 7f690d4a5640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69080b5f80 0x7f690815bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:35.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.221+0000 7f690d4a5640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f690815ee70 con 0x7f69080ce590 2024-09-15T23:15:35.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.221+0000 7f690d4a5640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f69080cfbe0 con 0x7f68f40039e0 2024-09-15T23:15:35.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.221+0000 7f690d4a5640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f69080d2f80 con 0x7f69080b5f80 2024-09-15T23:15:35.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.222+0000 7f68fe7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69080ce590 0x7f69081f57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:35.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.222+0000 7f68fe7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69080ce590 0x7f69081f57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59032/0 (socket says 172.21.15.123:59032) 2024-09-15T23:15:35.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.222+0000 7f68fe7fc640 1 -- 172.21.15.123:0/2228324307 learned_addr learned my addr 172.21.15.123:0/2228324307 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:35.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.222+0000 7f69077fe640 1 --2- 172.21.15.123:0/2228324307 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69080b5f80 0x7f690815bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:35.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.222+0000 7f6906ffd640 1 --2- 172.21.15.123:0/2228324307 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68f40039e0 0x7f69081e9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:35.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.222+0000 7f68fe7fc640 1 -- 172.21.15.123:0/2228324307 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69080b5f80 msgr2=0x7f690815bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:35.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.222+0000 7f68fe7fc640 1 --2- 172.21.15.123:0/2228324307 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69080b5f80 0x7f690815bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.222+0000 7f68fe7fc640 1 -- 172.21.15.123:0/2228324307 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68f40039e0 msgr2=0x7f69081e9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:35.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.222+0000 7f68fe7fc640 1 --2- 172.21.15.123:0/2228324307 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68f40039e0 0x7f69081e9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.222+0000 7f68fe7fc640 1 -- 172.21.15.123:0/2228324307 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69081f5d10 con 0x7f69080ce590 2024-09-15T23:15:35.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.222+0000 7f6906ffd640 1 --2- 172.21.15.123:0/2228324307 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68f40039e0 0x7f69081e9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:35.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.222+0000 7f68fe7fc640 1 --2- 172.21.15.123:0/2228324307 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69080ce590 0x7f69081f57d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f68f00116d0 tx=0x7f68f0011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:35.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.222+0000 7f68fffff640 1 -- 172.21.15.123:0/2228324307 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f000f960 con 0x7f69080ce590 2024-09-15T23:15:35.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.222+0000 7f68fffff640 1 -- 172.21.15.123:0/2228324307 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68f000fb00 con 0x7f69080ce590 2024-09-15T23:15:35.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.222+0000 7f68fffff640 1 -- 172.21.15.123:0/2228324307 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f0015460 con 0x7f69080ce590 2024-09-15T23:15:35.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.222+0000 7f690d4a5640 1 -- 172.21.15.123:0/2228324307 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69081e9d20 con 0x7f69080ce590 2024-09-15T23:15:35.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.222+0000 7f690d4a5640 1 -- 172.21.15.123:0/2228324307 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69080b5780 con 0x7f69080ce590 2024-09-15T23:15:35.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.224+0000 7f68fffff640 1 -- 172.21.15.123:0/2228324307 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f68f0015600 con 0x7f69080ce590 2024-09-15T23:15:35.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.224+0000 7f68fffff640 1 --2- 172.21.15.123:0/2228324307 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f68e806c2b0 0x7f68e806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:35.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.225+0000 7f68fffff640 1 -- 172.21.15.123:0/2228324307 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5881+0+0 (secure 0 0 0) 0x7f68f008bce0 con 0x7f69080ce590 2024-09-15T23:15:35.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.225+0000 7f6906ffd640 1 --2- 172.21.15.123:0/2228324307 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f68e806c2b0 0x7f68e806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:35.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.225+0000 7f6906ffd640 1 --2- 172.21.15.123:0/2228324307 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f68e806c2b0 0x7f68e806e770 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f68f8032000 tx=0x7f68f802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:35.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.225+0000 7f6910246740 1 Processor -- start 2024-09-15T23:15:35.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.225+0000 7f6910246740 1 -- start start 2024-09-15T23:15:35.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.226+0000 7f6910246740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e9f7028500 0x55e9f70288e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:35.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.226+0000 7f6910246740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e9f7025cc0 0x55e9f7027850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:35.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.226+0000 7f6910246740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e9f7026120 0x55e9f7008480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:35.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.226+0000 7f6910246740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55e9f6f44ac0 con 0x55e9f7028500 2024-09-15T23:15:35.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.226+0000 7f6910246740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55e9f6eec7b0 con 0x55e9f7026120 2024-09-15T23:15:35.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.226+0000 7f6910246740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55e9f6f40a80 con 0x55e9f7025cc0 2024-09-15T23:15:35.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.226+0000 7f6906ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e9f7028500 0x55e9f70288e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:35.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.226+0000 7f6906ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e9f7028500 0x55e9f70288e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59036/0 (socket says 172.21.15.123:59036) 2024-09-15T23:15:35.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.226+0000 7f6906ffd640 1 -- 172.21.15.123:0/3236518443 learned_addr learned my addr 172.21.15.123:0/3236518443 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:35.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.226+0000 7f69077fe640 1 --2- 172.21.15.123:0/3236518443 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e9f7026120 0x55e9f7008480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:35.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.226+0000 7f68fe7fc640 1 --2- 172.21.15.123:0/3236518443 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e9f7025cc0 0x55e9f7027850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:35.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.227+0000 7f6906ffd640 1 -- 172.21.15.123:0/3236518443 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e9f7025cc0 msgr2=0x55e9f7027850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:35.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.227+0000 7f6906ffd640 1 --2- 172.21.15.123:0/3236518443 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e9f7025cc0 0x55e9f7027850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.227+0000 7f6906ffd640 1 -- 172.21.15.123:0/3236518443 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e9f7026120 msgr2=0x55e9f7008480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:35.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.227+0000 7f6906ffd640 1 --2- 172.21.15.123:0/3236518443 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e9f7026120 0x55e9f7008480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.227+0000 7f6906ffd640 1 -- 172.21.15.123:0/3236518443 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9f6d23a20 con 0x55e9f7028500 2024-09-15T23:15:35.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.227+0000 7f6906ffd640 1 --2- 172.21.15.123:0/3236518443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e9f7028500 0x55e9f70288e0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f68f802a540 tx=0x7f68f802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a3e8ed9d92f980f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:35.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.227+0000 7f68fcff9640 1 -- 172.21.15.123:0/3236518443 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f804d070 con 0x55e9f7028500 2024-09-15T23:15:35.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.227+0000 7f68fcff9640 1 -- 172.21.15.123:0/3236518443 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68f8005340 con 0x55e9f7028500 2024-09-15T23:15:35.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.227+0000 7f68fcff9640 1 -- 172.21.15.123:0/3236518443 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f80069d0 con 0x55e9f7028500 2024-09-15T23:15:35.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.227+0000 7f6910246740 1 -- 172.21.15.123:0/3236518443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e9f7028500 msgr2=0x55e9f70288e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:35.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.227+0000 7f6910246740 1 --2- 172.21.15.123:0/3236518443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e9f7028500 0x55e9f70288e0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f68f802a540 tx=0x7f68f802c000 comp rx=0 tx=0).stop 2024-09-15T23:15:35.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.227+0000 7f6910246740 1 -- 172.21.15.123:0/3236518443 shutdown_connections 2024-09-15T23:15:35.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.227+0000 7f6910246740 1 --2- 172.21.15.123:0/3236518443 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e9f7026120 0x55e9f7008480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.228+0000 7f6910246740 1 --2- 172.21.15.123:0/3236518443 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e9f7025cc0 0x55e9f7027850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.228+0000 7f6910246740 1 --2- 172.21.15.123:0/3236518443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e9f7028500 0x55e9f70288e0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.228+0000 7f6910246740 1 -- 172.21.15.123:0/3236518443 >> 172.21.15.123:0/3236518443 conn(0x55e9f6fde160 msgr2=0x55e9f7026570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:35.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.228+0000 7f6910246740 1 -- 172.21.15.123:0/3236518443 shutdown_connections 2024-09-15T23:15:35.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.228+0000 7f6910246740 1 -- 172.21.15.123:0/3236518443 wait complete. 2024-09-15T23:15:35.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.228+0000 7f6910246740 1 -- start start 2024-09-15T23:15:35.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.228+0000 7f6910246740 1 Processor -- start 2024-09-15T23:15:35.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.229+0000 7f6910246740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e9f7026120 0x55e9f700a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:35.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.229+0000 7f6910246740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e9f7028500 0x55e9f7007540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:35.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.229+0000 7f6910246740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e9f7020240 0x55e9f70206c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:35.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.229+0000 7f6910246740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55e9f7024c20 con 0x55e9f7028500 2024-09-15T23:15:35.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.229+0000 7f6910246740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55e9f6ecd7b0 con 0x55e9f7026120 2024-09-15T23:15:35.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.229+0000 7f6910246740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55e9f7024f00 con 0x55e9f7020240 2024-09-15T23:15:35.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.229+0000 7f6910246740 10 client.0 _ll_register_callbacks cb 0x55e9f6c56e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:15:35.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.229+0000 7f68fe7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e9f7028500 0x55e9f7007540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:35.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.229+0000 7f68fe7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e9f7028500 0x55e9f7007540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59038/0 (socket says 172.21.15.123:59038) 2024-09-15T23:15:35.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.229+0000 7f68fe7fc640 1 -- 172.21.15.123:0/1243613051 learned_addr learned my addr 172.21.15.123:0/1243613051 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:35.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.229+0000 7f69077fe640 1 --2- 172.21.15.123:0/1243613051 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e9f7020240 0x55e9f70206c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:35.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.229+0000 7f6906ffd640 1 --2- 172.21.15.123:0/1243613051 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e9f7026120 0x55e9f700a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:35.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.229+0000 7f68fe7fc640 1 -- 172.21.15.123:0/1243613051 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e9f7020240 msgr2=0x55e9f70206c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:35.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.229+0000 7f68fe7fc640 1 --2- 172.21.15.123:0/1243613051 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e9f7020240 0x55e9f70206c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.229+0000 7f68fe7fc640 1 -- 172.21.15.123:0/1243613051 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e9f7026120 msgr2=0x55e9f700a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:35.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.229+0000 7f68fe7fc640 1 --2- 172.21.15.123:0/1243613051 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e9f7026120 0x55e9f700a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.229+0000 7f68fe7fc640 1 -- 172.21.15.123:0/1243613051 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9f6c17310 con 0x55e9f7028500 2024-09-15T23:15:35.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.229+0000 7f6906ffd640 1 --2- 172.21.15.123:0/1243613051 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e9f7026120 0x55e9f700a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:35.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.229+0000 7f68fe7fc640 1 --2- 172.21.15.123:0/1243613051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e9f7028500 0x55e9f7007540 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f68f0056190 tx=0x7f68f005a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3023642106788937 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:35.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.229+0000 7f68e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:15:35.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.230+0000 7f68e5ffb640 1 -- 172.21.15.123:0/1243613051 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f0087070 con 0x55e9f7028500 2024-09-15T23:15:35.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.230+0000 7f68e5ffb640 1 -- 172.21.15.123:0/1243613051 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 5881+0+0 (secure 0 0 0) 0x7f68f0062680 con 0x55e9f7028500 2024-09-15T23:15:35.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.230+0000 7f6910246740 1 -- 172.21.15.123:0/1243613051 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68f8005340 con 0x55e9f7028500 2024-09-15T23:15:35.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.230+0000 7f68e5ffb640 1 -- 172.21.15.123:0/1243613051 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f68f001bbb0 con 0x55e9f7028500 2024-09-15T23:15:35.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.230+0000 7f6910246740 10 client.6492 fetch_fsmap learned FSMap version 38 2024-09-15T23:15:35.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.230+0000 7f6910246740 1 -- 172.21.15.123:0/1243613051 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x55e9f6d841b0 con 0x55e9f7028500 2024-09-15T23:15:35.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.230+0000 7f68e5ffb640 1 -- 172.21.15.123:0/1243613051 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68f8005340 con 0x55e9f7028500 2024-09-15T23:15:35.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.230+0000 7f68e5ffb640 1 -- 172.21.15.123:0/1243613051 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 38) ==== 3502+0+0 (secure 0 0 0) 0x7f68f0083b50 con 0x55e9f7028500 2024-09-15T23:15:35.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.230+0000 7f6910246740 10 client.6492 fetch_fsmap finished waiting for FSMap version 38 2024-09-15T23:15:35.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.230+0000 7f6910246740 10 client.6492 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-09-15T23:15:35.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.230+0000 7f6910246740 20 client.6492 populate_metadata read hostname 'smithi123' 2024-09-15T23:15:35.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.230+0000 7f6910246740 1 --2- 172.21.15.123:0/1243613051 >> [v2:172.21.15.123:6834/3634063333,v1:172.21.15.123:6835/3634063333] conn(0x55e9f70228c0 0x55e9f7022d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:35.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.230+0000 7f6910246740 4 client.6492 mds_command: new command op to 6411 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:15:35.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.230+0000 7f6910246740 1 -- 172.21.15.123:0/1243613051 --> [v2:172.21.15.123:6834/3634063333,v1:172.21.15.123:6835/3634063333] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9f6f521f0 con 0x55e9f70228c0 2024-09-15T23:15:35.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.230+0000 7f6906ffd640 1 --2- 172.21.15.123:0/1243613051 >> [v2:172.21.15.123:6834/3634063333,v1:172.21.15.123:6835/3634063333] conn(0x55e9f70228c0 0x55e9f7022d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:35.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.230+0000 7f68e5ffb640 10 client.6492 ms_handle_connect on v2:172.21.15.123:6834/3634063333 2024-09-15T23:15:35.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.230+0000 7f6906ffd640 1 --2- 172.21.15.123:0/1243613051 >> [v2:172.21.15.123:6834/3634063333,v1:172.21.15.123:6835/3634063333] conn(0x55e9f70228c0 0x55e9f7022d40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9191bada26bff1e0 server_cookie=f42bf9bb1584ada6 in_seq=0 out_seq=0 2024-09-15T23:15:35.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.231+0000 7f68e5ffb640 1 -- 172.21.15.123:0/1243613051 <== mds.0 v2:172.21.15.123:6834/3634063333 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e9f6f521f0 con 0x55e9f70228c0 2024-09-15T23:15:35.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.231+0000 7f68e5ffb640 10 client.6492 handle_command_reply: tid=0 2024-09-15T23:15:35.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.231+0000 7f6910246740 1 client.6492 shutdown 2024-09-15T23:15:35.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.231+0000 7f6910246740 1 -- 172.21.15.123:0/1243613051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e9f7028500 msgr2=0x55e9f7007540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:35.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.231+0000 7f6910246740 1 --2- 172.21.15.123:0/1243613051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e9f7028500 0x55e9f7007540 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f68f0056190 tx=0x7f68f005a560 comp rx=0 tx=0).stop 2024-09-15T23:15:35.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.231+0000 7f6910246740 1 -- 172.21.15.123:0/1243613051 shutdown_connections 2024-09-15T23:15:35.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.231+0000 7f6910246740 1 --2- 172.21.15.123:0/1243613051 >> [v2:172.21.15.123:6834/3634063333,v1:172.21.15.123:6835/3634063333] conn(0x55e9f70228c0 0x55e9f7022d40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.231+0000 7f6910246740 1 --2- 172.21.15.123:0/1243613051 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e9f7020240 0x55e9f70206c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.231+0000 7f6910246740 1 --2- 172.21.15.123:0/1243613051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e9f7028500 0x55e9f7007540 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.231+0000 7f68e5ffb640 0 client.6492 ms_handle_reset on v2:172.21.15.123:6834/3634063333 2024-09-15T23:15:35.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.231+0000 7f6910246740 1 --2- 172.21.15.123:0/1243613051 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e9f7026120 0x55e9f700a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.231+0000 7f6910246740 1 -- 172.21.15.123:0/1243613051 >> 172.21.15.123:0/1243613051 conn(0x55e9f7025cc0 msgr2=0x55e9f7029ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:35.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.232+0000 7f6910246740 1 -- 172.21.15.123:0/1243613051 shutdown_connections 2024-09-15T23:15:35.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.232+0000 7f6910246740 1 -- 172.21.15.123:0/1243613051 wait complete. 2024-09-15T23:15:35.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.232+0000 7f6910246740 20 client.6492 trim_cache size 0 max 16384 2024-09-15T23:15:35.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.249+0000 7f6910246740 1 Processor -- start 2024-09-15T23:15:35.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.249+0000 7f6910246740 1 -- start start 2024-09-15T23:15:35.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.249+0000 7f6910246740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e9f7020240 0x55e9f7009ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:35.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.249+0000 7f6910246740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e9f7026120 0x55e9f7027670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:35.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.249+0000 7f6910246740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e9f7028500 0x55e9f7027bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:35.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.249+0000 7f6910246740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6908201690 con 0x55e9f7026120 2024-09-15T23:15:35.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.249+0000 7f6910246740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6908200700 con 0x55e9f7020240 2024-09-15T23:15:35.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.249+0000 7f6910246740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f69080cdac0 con 0x55e9f7028500 2024-09-15T23:15:35.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.250+0000 7f68fe7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e9f7026120 0x55e9f7027670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:35.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.250+0000 7f68fe7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e9f7026120 0x55e9f7027670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59048/0 (socket says 172.21.15.123:59048) 2024-09-15T23:15:35.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.250+0000 7f68fe7fc640 1 -- 172.21.15.123:0/565468396 learned_addr learned my addr 172.21.15.123:0/565468396 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:35.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.250+0000 7f68fe7fc640 1 -- 172.21.15.123:0/565468396 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e9f7028500 msgr2=0x55e9f7027bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:35.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.250+0000 7f68fe7fc640 1 --2- 172.21.15.123:0/565468396 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e9f7028500 0x55e9f7027bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.250+0000 7f68fe7fc640 1 -- 172.21.15.123:0/565468396 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e9f7020240 msgr2=0x55e9f7009ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:35.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.250+0000 7f68fe7fc640 1 --2- 172.21.15.123:0/565468396 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e9f7020240 0x55e9f7009ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.250+0000 7f68fe7fc640 1 -- 172.21.15.123:0/565468396 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9f6bf03d0 con 0x55e9f7026120 2024-09-15T23:15:35.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.250+0000 7f68fe7fc640 1 --2- 172.21.15.123:0/565468396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e9f7026120 0x55e9f7027670 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f68f000f5b0 tx=0x7f68f0084000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a4180669ba42f5c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:35.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.250+0000 7f68e7fff640 1 -- 172.21.15.123:0/565468396 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f007e030 con 0x55e9f7026120 2024-09-15T23:15:35.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.250+0000 7f68e7fff640 1 -- 172.21.15.123:0/565468396 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68f001bd50 con 0x55e9f7026120 2024-09-15T23:15:35.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.250+0000 7f68e7fff640 1 -- 172.21.15.123:0/565468396 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f0087040 con 0x55e9f7026120 2024-09-15T23:15:35.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.251+0000 7f6910246740 1 -- 172.21.15.123:0/565468396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e9f7026120 msgr2=0x55e9f7027670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:35.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.251+0000 7f6910246740 1 --2- 172.21.15.123:0/565468396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e9f7026120 0x55e9f7027670 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f68f000f5b0 tx=0x7f68f0084000 comp rx=0 tx=0).stop 2024-09-15T23:15:35.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.251+0000 7f6910246740 1 -- 172.21.15.123:0/565468396 shutdown_connections 2024-09-15T23:15:35.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.251+0000 7f6910246740 1 --2- 172.21.15.123:0/565468396 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e9f7028500 0x55e9f7027bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.251+0000 7f6910246740 1 --2- 172.21.15.123:0/565468396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e9f7026120 0x55e9f7027670 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.251+0000 7f6910246740 1 --2- 172.21.15.123:0/565468396 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e9f7020240 0x55e9f7009ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.251+0000 7f6910246740 1 -- 172.21.15.123:0/565468396 >> 172.21.15.123:0/565468396 conn(0x55e9f7025cc0 msgr2=0x55e9f704aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:35.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.251+0000 7f6910246740 1 -- 172.21.15.123:0/565468396 shutdown_connections 2024-09-15T23:15:35.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.251+0000 7f6910246740 1 -- 172.21.15.123:0/565468396 wait complete. 2024-09-15T23:15:35.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.251+0000 7f6910246740 1 -- start start 2024-09-15T23:15:35.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.251+0000 7f6910246740 1 Processor -- start 2024-09-15T23:15:35.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.252+0000 7f6910246740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e9f7020240 0x55e9f709e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:35.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.252+0000 7f6910246740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e9f7026120 0x55e9f7023950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:35.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.252+0000 7f6910246740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e9f7028500 0x55e9f7027670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:35.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.252+0000 7f6910246740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55e9f700b2f0 con 0x55e9f7026120 2024-09-15T23:15:35.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.252+0000 7f6910246740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f69081f8d10 con 0x55e9f7028500 2024-09-15T23:15:35.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.252+0000 7f6910246740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55e9f7022ca0 con 0x55e9f7020240 2024-09-15T23:15:35.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.252+0000 7f6910246740 10 client.0 _ll_register_callbacks cb 0x7f68f0011f90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:15:35.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.252+0000 7f68fe7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e9f7026120 0x55e9f7023950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:35.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.252+0000 7f68fe7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e9f7026120 0x55e9f7023950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59052/0 (socket says 172.21.15.123:59052) 2024-09-15T23:15:35.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.252+0000 7f68fe7fc640 1 -- 172.21.15.123:0/4235297591 learned_addr learned my addr 172.21.15.123:0/4235297591 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:35.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.252+0000 7f69077fe640 1 --2- 172.21.15.123:0/4235297591 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e9f7028500 0x55e9f7027670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:35.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.252+0000 7f6906ffd640 1 --2- 172.21.15.123:0/4235297591 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e9f7020240 0x55e9f709e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:35.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.252+0000 7f68fe7fc640 1 -- 172.21.15.123:0/4235297591 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e9f7020240 msgr2=0x55e9f709e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:35.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.252+0000 7f68fe7fc640 1 --2- 172.21.15.123:0/4235297591 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e9f7020240 0x55e9f709e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.252+0000 7f68fe7fc640 1 -- 172.21.15.123:0/4235297591 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e9f7028500 msgr2=0x55e9f7027670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:35.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.252+0000 7f68fe7fc640 1 --2- 172.21.15.123:0/4235297591 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e9f7028500 0x55e9f7027670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.252+0000 7f68fe7fc640 1 -- 172.21.15.123:0/4235297591 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9f709e6a0 con 0x55e9f7026120 2024-09-15T23:15:35.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.252+0000 7f6906ffd640 1 --2- 172.21.15.123:0/4235297591 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e9f7020240 0x55e9f709e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:35.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.252+0000 7f68fe7fc640 1 --2- 172.21.15.123:0/4235297591 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e9f7026120 0x55e9f7023950 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f68f008bfe0 tx=0x7f68f006f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b12fe446ba2cd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:35.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.252+0000 7f68e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:15:35.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.253+0000 7f68e5ffb640 1 -- 172.21.15.123:0/4235297591 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f007e070 con 0x55e9f7026120 2024-09-15T23:15:35.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.253+0000 7f68e5ffb640 1 -- 172.21.15.123:0/4235297591 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 5881+0+0 (secure 0 0 0) 0x7f68f0062b60 con 0x55e9f7026120 2024-09-15T23:15:35.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.253+0000 7f6910246740 1 -- 172.21.15.123:0/4235297591 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68f001bd50 con 0x55e9f7026120 2024-09-15T23:15:35.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.253+0000 7f68e5ffb640 1 -- 172.21.15.123:0/4235297591 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f68f0059690 con 0x55e9f7026120 2024-09-15T23:15:35.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.253+0000 7f6910246740 10 client.6498 fetch_fsmap learned FSMap version 38 2024-09-15T23:15:35.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.253+0000 7f6910246740 1 -- 172.21.15.123:0/4235297591 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x55e9f6fdcbb0 con 0x55e9f7026120 2024-09-15T23:15:35.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.253+0000 7f68e5ffb640 1 -- 172.21.15.123:0/4235297591 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68f001bd50 con 0x55e9f7026120 2024-09-15T23:15:35.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.253+0000 7f68e5ffb640 1 -- 172.21.15.123:0/4235297591 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 38) ==== 3502+0+0 (secure 0 0 0) 0x7f68f00602e0 con 0x55e9f7026120 2024-09-15T23:15:35.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.253+0000 7f6910246740 10 client.6498 fetch_fsmap finished waiting for FSMap version 38 2024-09-15T23:15:35.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.253+0000 7f6910246740 10 client.6498 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-09-15T23:15:35.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.253+0000 7f6910246740 20 client.6498 populate_metadata read hostname 'smithi123' 2024-09-15T23:15:35.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.253+0000 7f6910246740 1 --2- 172.21.15.123:0/4235297591 >> [v2:172.21.15.123:6834/3634063333,v1:172.21.15.123:6835/3634063333] conn(0x55e9f7023e90 0x55e9f7027bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:35.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.253+0000 7f6910246740 4 client.6498 mds_command: new command op to 6411 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}] 2024-09-15T23:15:35.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.253+0000 7f6910246740 1 -- 172.21.15.123:0/4235297591 --> [v2:172.21.15.123:6834/3634063333,v1:172.21.15.123:6835/3634063333] -- command(tid 0: {"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}) -- 0x55e9f6f4c540 con 0x55e9f7023e90 2024-09-15T23:15:35.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.253+0000 7f6906ffd640 1 --2- 172.21.15.123:0/4235297591 >> [v2:172.21.15.123:6834/3634063333,v1:172.21.15.123:6835/3634063333] conn(0x55e9f7023e90 0x55e9f7027bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:35.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.253+0000 7f6906ffd640 1 --2- 172.21.15.123:0/4235297591 >> [v2:172.21.15.123:6834/3634063333,v1:172.21.15.123:6835/3634063333] conn(0x55e9f7023e90 0x55e9f7027bb0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e068e6cd0c715695 server_cookie=362ee614a94bfbf3 in_seq=0 out_seq=0 2024-09-15T23:15:35.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.253+0000 7f68e5ffb640 10 client.6498 ms_handle_connect on v2:172.21.15.123:6834/3634063333 2024-09-15T23:15:35.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.254+0000 7f68e5ffb640 1 -- 172.21.15.123:0/4235297591 <== mds.0 v2:172.21.15.123:6834/3634063333 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e9f6f4c540 con 0x55e9f7023e90 2024-09-15T23:15:35.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.254+0000 7f68e5ffb640 10 client.6498 handle_command_reply: tid=0 2024-09-15T23:15:35.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.254+0000 7f6910246740 1 client.6498 shutdown 2024-09-15T23:15:35.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.254+0000 7f6910246740 1 -- 172.21.15.123:0/4235297591 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e9f7026120 msgr2=0x55e9f7023950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:35.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.254+0000 7f6910246740 1 --2- 172.21.15.123:0/4235297591 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e9f7026120 0x55e9f7023950 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f68f008bfe0 tx=0x7f68f006f000 comp rx=0 tx=0).stop 2024-09-15T23:15:35.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.254+0000 7f6910246740 1 -- 172.21.15.123:0/4235297591 shutdown_connections 2024-09-15T23:15:35.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.254+0000 7f6910246740 1 --2- 172.21.15.123:0/4235297591 >> [v2:172.21.15.123:6834/3634063333,v1:172.21.15.123:6835/3634063333] conn(0x55e9f7023e90 0x55e9f7027bb0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.254+0000 7f6910246740 1 --2- 172.21.15.123:0/4235297591 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e9f7028500 0x55e9f7027670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.254+0000 7f6910246740 1 --2- 172.21.15.123:0/4235297591 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e9f7026120 0x55e9f7023950 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.254+0000 7f68e5ffb640 0 client.6498 ms_handle_reset on v2:172.21.15.123:6834/3634063333 2024-09-15T23:15:35.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.254+0000 7f6910246740 1 --2- 172.21.15.123:0/4235297591 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e9f7020240 0x55e9f709e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.254+0000 7f6910246740 1 -- 172.21.15.123:0/4235297591 >> 172.21.15.123:0/4235297591 conn(0x55e9f7025cc0 msgr2=0x55e9f6fe2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:35.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.254+0000 7f6910246740 1 -- 172.21.15.123:0/4235297591 shutdown_connections 2024-09-15T23:15:35.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.254+0000 7f6910246740 1 -- 172.21.15.123:0/4235297591 wait complete. 2024-09-15T23:15:35.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.254+0000 7f6910246740 20 client.6498 trim_cache size 0 max 16384 2024-09-15T23:15:35.262 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:15:35.262 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0, 2024-09-15T23:15:35.262 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_tag": "86dd78af-017a-46bd-9586-5a3d970fabec", 2024-09-15T23:15:35.262 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": "asynchronous" 2024-09-15T23:15:35.262 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:15:35.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.255+0000 7f690d4a5640 1 -- 172.21.15.123:0/2228324307 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f68e806c2b0 msgr2=0x7f68e806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:35.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.255+0000 7f690d4a5640 1 --2- 172.21.15.123:0/2228324307 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f68e806c2b0 0x7f68e806e770 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f68f8032000 tx=0x7f68f802e000 comp rx=0 tx=0).stop 2024-09-15T23:15:35.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.255+0000 7f690d4a5640 1 -- 172.21.15.123:0/2228324307 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69080ce590 msgr2=0x7f69081f57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:35.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.255+0000 7f690d4a5640 1 --2- 172.21.15.123:0/2228324307 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69080ce590 0x7f69081f57d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f68f00116d0 tx=0x7f68f0011b90 comp rx=0 tx=0).stop 2024-09-15T23:15:35.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.255+0000 7f690d4a5640 1 -- 172.21.15.123:0/2228324307 shutdown_connections 2024-09-15T23:15:35.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.255+0000 7f690d4a5640 1 --2- 172.21.15.123:0/2228324307 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69080b5f80 0x7f690815bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.255+0000 7f690d4a5640 1 --2- 172.21.15.123:0/2228324307 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f68e806c2b0 0x7f68e806e770 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.255+0000 7f690d4a5640 1 --2- 172.21.15.123:0/2228324307 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69080ce590 0x7f69081f57d0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.255+0000 7f690d4a5640 1 --2- 172.21.15.123:0/2228324307 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68f40039e0 0x7f69081e9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.255+0000 7f690d4a5640 1 -- 172.21.15.123:0/2228324307 >> 172.21.15.123:0/2228324307 conn(0x7f690806c0e0 msgr2=0x7f69080c9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:35.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.255+0000 7f690d4a5640 1 -- 172.21.15.123:0/2228324307 shutdown_connections 2024-09-15T23:15:35.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.255+0000 7f690d4a5640 1 -- 172.21.15.123:0/2228324307 wait complete. 2024-09-15T23:15:35.268 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:15:35.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.365+0000 7f4cfbf18640 1 Processor -- start 2024-09-15T23:15:35.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.366+0000 7f4cfbf18640 1 -- start start 2024-09-15T23:15:35.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.366+0000 7f4cfbf18640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4cf415ed20 0x7f4cf40b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:35.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.366+0000 7f4cfbf18640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cf40d0e70 con 0x7f4cf40d23b0 2024-09-15T23:15:35.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.366+0000 7f4cfbf18640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cf40d00f0 con 0x7f4cf40b90e0 2024-09-15T23:15:35.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.366+0000 7f4cfbf18640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f4cf40d41c0 con 0x7f4cf415ed20 2024-09-15T23:15:35.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.367+0000 7f4cf9cb4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4cf415ed20 0x7f4cf40b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:35.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.367+0000 7f4cf94b3640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f4cf40d23b0 0x7f4cf40cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39538/0 (socket says 172.21.15.123:39538) 2024-09-15T23:15:35.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.367+0000 7f4cf94b3640 1 -- 172.21.15.123:0/837099370 learned_addr learned my addr 172.21.15.123:0/837099370 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:35.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.367+0000 7f4cf9cb4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4cf415ed20 0x7f4cf40b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59064/0 (socket says 172.21.15.123:59064) 2024-09-15T23:15:35.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.367+0000 7f4cf9cb4640 1 -- 172.21.15.123:0/837099370 >> v1:172.21.15.188:6789/0 conn(0x7f4cf40b90e0 legacy=0x7f4cf40cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:35.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.367+0000 7f4cf9cb4640 1 -- 172.21.15.123:0/837099370 >> v1:172.21.15.123:6789/0 conn(0x7f4cf40d23b0 legacy=0x7f4cf40cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:35.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.367+0000 7f4cf8cb2640 1 -- 172.21.15.123:0/837099370 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3553025325 0 0) 0x7f4cf0001110 con 0x7f4cf40d23b0 2024-09-15T23:15:35.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.367+0000 7f4cf9cb4640 1 -- 172.21.15.123:0/837099370 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf40d35b0 con 0x7f4cf415ed20 2024-09-15T23:15:35.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.368+0000 7f4cf9cb4640 1 --2- 172.21.15.123:0/837099370 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cf415ed20 0x7f4cf40b6260 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80097a0 tx=0x7f4ce802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d90c1bb16faf44ef server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:35.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.368+0000 7f4cf8cb2640 1 -- 172.21.15.123:0/837099370 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8037070 con 0x7f4cf415ed20 2024-09-15T23:15:35.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.368+0000 7f4cf8cb2640 1 -- 172.21.15.123:0/837099370 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ce8032440 con 0x7f4cf415ed20 2024-09-15T23:15:35.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.368+0000 7f4cf8cb2640 1 -- 172.21.15.123:0/837099370 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8032810 con 0x7f4cf415ed20 2024-09-15T23:15:35.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.368+0000 7f4cfbf18640 1 -- 172.21.15.123:0/837099370 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cf415ed20 msgr2=0x7f4cf40b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:35.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.368+0000 7f4cfbf18640 1 --2- 172.21.15.123:0/837099370 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cf415ed20 0x7f4cf40b6260 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80097a0 tx=0x7f4ce802a1a0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.368+0000 7f4cfbf18640 1 -- 172.21.15.123:0/837099370 shutdown_connections 2024-09-15T23:15:35.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.368+0000 7f4cfbf18640 1 --2- 172.21.15.123:0/837099370 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cf415ed20 0x7f4cf40b6260 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.368+0000 7f4cfbf18640 1 -- 172.21.15.123:0/837099370 >> 172.21.15.123:0/837099370 conn(0x7f4cf40d1260 msgr2=0x7f4cf40d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:35.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.368+0000 7f4cfbf18640 1 -- 172.21.15.123:0/837099370 shutdown_connections 2024-09-15T23:15:35.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.368+0000 7f4cfbf18640 1 -- 172.21.15.123:0/837099370 wait complete. 2024-09-15T23:15:35.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.370+0000 7f4cfbf18640 1 Processor -- start 2024-09-15T23:15:35.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.370+0000 7f4cfbf18640 1 -- start start 2024-09-15T23:15:35.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.370+0000 7f4cfbf18640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cf40b90e0 0x7f4cf40c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:35.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.370+0000 7f4cfbf18640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4cf40d23b0 0x7f4cf4157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:35.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.370+0000 7f4cfbf18640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4cf415ed20 0x7f4cf40ce600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:35.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.370+0000 7f4cfbf18640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf40d3e50 con 0x7f4cf40b90e0 2024-09-15T23:15:35.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.370+0000 7f4cfbf18640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf40d3b70 con 0x7f4cf415ed20 2024-09-15T23:15:35.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.370+0000 7f4cfbf18640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4cf40d32a0 con 0x7f4cf40d23b0 2024-09-15T23:15:35.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.370+0000 7f4cf9cb4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cf40b90e0 0x7f4cf40c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:35.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.371+0000 7f4cf9cb4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cf40b90e0 0x7f4cf40c9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59074/0 (socket says 172.21.15.123:59074) 2024-09-15T23:15:35.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.371+0000 7f4cf9cb4640 1 -- 172.21.15.123:0/1335855338 learned_addr learned my addr 172.21.15.123:0/1335855338 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:35.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.371+0000 7f4cfa4b5640 1 --2- 172.21.15.123:0/1335855338 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4cf415ed20 0x7f4cf40ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:35.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.371+0000 7f4cf94b3640 1 --2- 172.21.15.123:0/1335855338 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4cf40d23b0 0x7f4cf4157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:35.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.371+0000 7f4cf9cb4640 1 -- 172.21.15.123:0/1335855338 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4cf40d23b0 msgr2=0x7f4cf4157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:35.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.371+0000 7f4cf9cb4640 1 --2- 172.21.15.123:0/1335855338 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4cf40d23b0 0x7f4cf4157db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.371+0000 7f4cf9cb4640 1 -- 172.21.15.123:0/1335855338 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4cf415ed20 msgr2=0x7f4cf40ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:35.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.371+0000 7f4cf9cb4640 1 --2- 172.21.15.123:0/1335855338 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4cf415ed20 0x7f4cf40ce600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.371+0000 7f4cf9cb4640 1 -- 172.21.15.123:0/1335855338 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf415bda0 con 0x7f4cf40b90e0 2024-09-15T23:15:35.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.371+0000 7f4cf94b3640 1 --2- 172.21.15.123:0/1335855338 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4cf40d23b0 0x7f4cf4157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:35.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.371+0000 7f4cf9cb4640 1 --2- 172.21.15.123:0/1335855338 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cf40b90e0 0x7f4cf40c9660 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8000c00 tx=0x7f4ce80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:35.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.372+0000 7f4ce67fc640 1 -- 172.21.15.123:0/1335855338 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8037040 con 0x7f4cf40b90e0 2024-09-15T23:15:35.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.372+0000 7f4ce67fc640 1 -- 172.21.15.123:0/1335855338 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ce8042070 con 0x7f4cf40b90e0 2024-09-15T23:15:35.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.372+0000 7f4cfbf18640 1 -- 172.21.15.123:0/1335855338 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cf40b3480 con 0x7f4cf40b90e0 2024-09-15T23:15:35.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.372+0000 7f4ce67fc640 1 -- 172.21.15.123:0/1335855338 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8030a70 con 0x7f4cf40b90e0 2024-09-15T23:15:35.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.372+0000 7f4cfbf18640 1 -- 172.21.15.123:0/1335855338 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cf41582f0 con 0x7f4cf40b90e0 2024-09-15T23:15:35.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.373+0000 7f4cfbf18640 1 -- 172.21.15.123:0/1335855338 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cf40d21a0 con 0x7f4cf40b90e0 2024-09-15T23:15:35.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.374+0000 7f4ce67fc640 1 -- 172.21.15.123:0/1335855338 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4ce8030c10 con 0x7f4cf40b90e0 2024-09-15T23:15:35.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.374+0000 7f4ce67fc640 1 --2- 172.21.15.123:0/1335855338 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4cd806c2e0 0x7f4cd806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:35.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.374+0000 7f4ce67fc640 1 -- 172.21.15.123:0/1335855338 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5881+0+0 (secure 0 0 0) 0x7f4ce80abf60 con 0x7f4cf40b90e0 2024-09-15T23:15:35.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.374+0000 7f4cf94b3640 1 --2- 172.21.15.123:0/1335855338 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4cd806c2e0 0x7f4cd806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:35.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.375+0000 7f4cf94b3640 1 --2- 172.21.15.123:0/1335855338 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4cd806c2e0 0x7f4cd806e7a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4cf41e9960 tx=0x7f4cf0007a10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:35.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.379+0000 7f4ce67fc640 1 -- 172.21.15.123:0/1335855338 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4ce807a5a0 con 0x7f4cf40b90e0 2024-09-15T23:15:35.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.578+0000 7f4cfbf18640 1 -- 172.21.15.123:0/1335855338 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4cf415f100 con 0x7f4cf40b90e0 2024-09-15T23:15:35.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.579+0000 7f4ce67fc640 1 -- 172.21.15.123:0/1335855338 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5230 (secure 0 0 0) 0x7f4ce8079ea0 con 0x7f4cf40b90e0 2024-09-15T23:15:35.580 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:35.580 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":38,"btime":"2024-09-15T23:15:32:678232+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5483,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/522636413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":522636413},{"type":"v1","addr":"172.21.15.188:6835","nonce":522636413}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5860,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/3057173907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":3057173907},{"type":"v1","addr":"172.21.15.188:6837","nonce":3057173907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6399,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/811728648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":811728648},{"type":"v1","addr":"172.21.15.123:6833","nonce":811728648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:15:17.752297+0000","modified":"2024-09-15T23:15:32.678225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6411":{"gid":6411,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6835/3634063333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3634063333},{"type":"v1","addr":"172.21.15.123:6835","nonce":3634063333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6411,"qdb_cluster":[6411]},"id":4}]} 2024-09-15T23:15:35.580 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 38 2024-09-15T23:15:35.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.581+0000 7f4cfbf18640 1 -- 172.21.15.123:0/1335855338 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4cd806c2e0 msgr2=0x7f4cd806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:35.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.581+0000 7f4cfbf18640 1 --2- 172.21.15.123:0/1335855338 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4cd806c2e0 0x7f4cd806e7a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4cf41e9960 tx=0x7f4cf0007a10 comp rx=0 tx=0).stop 2024-09-15T23:15:35.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.581+0000 7f4cfbf18640 1 -- 172.21.15.123:0/1335855338 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cf40b90e0 msgr2=0x7f4cf40c9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:35.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.581+0000 7f4cfbf18640 1 --2- 172.21.15.123:0/1335855338 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cf40b90e0 0x7f4cf40c9660 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8000c00 tx=0x7f4ce80046c0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.581+0000 7f4cfbf18640 1 -- 172.21.15.123:0/1335855338 shutdown_connections 2024-09-15T23:15:35.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.581+0000 7f4cfbf18640 1 --2- 172.21.15.123:0/1335855338 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4cf415ed20 0x7f4cf40ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.581+0000 7f4cfbf18640 1 --2- 172.21.15.123:0/1335855338 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4cf40d23b0 0x7f4cf4157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.581+0000 7f4cfbf18640 1 --2- 172.21.15.123:0/1335855338 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4cd806c2e0 0x7f4cd806e7a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.581+0000 7f4cfbf18640 1 --2- 172.21.15.123:0/1335855338 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cf40b90e0 0x7f4cf40c9660 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:35.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.581+0000 7f4cfbf18640 1 -- 172.21.15.123:0/1335855338 >> 172.21.15.123:0/1335855338 conn(0x7f4cf40d1260 msgr2=0x7f4cf40b4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:35.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.581+0000 7f4cfbf18640 1 -- 172.21.15.123:0/1335855338 shutdown_connections 2024-09-15T23:15:35.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:35.581+0000 7f4cfbf18640 1 -- 172.21.15.123:0/1335855338 wait complete. 2024-09-15T23:15:35.593 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-15T23:15:35.707 INFO:teuthology.orchestra.run.smithi123.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-15T23:15:26.733751+0000","btime":"2024-09-15T23:15:25.961769+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-15T23:15:26.733751+0000","atime":"2024-09-15T23:15:25.961769+0000","time_warp_seq":0,"change_attr":31,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-15T23:15:26.733751+0000","num_files":40,"num_subdirs":0,"change_attr":31},"rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-15T23:15:26.733751+0000"},"accounted_rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-15T23:15:26.733751+0000"},"version":244,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[{"frag":"*","children":1}]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dirfrag":2,"authpin":0,"scrubqueue":0},"nref":2,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-15T23:15:35.707 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 70, "rctime": "2024-09-15T23:15:26.733751+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-15T23:15:25.961769+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-15T23:15:25.961769+0000", "change_attr": 31, "client_caps": [], "client_ranges": [], "ctime": "2024-09-15T23:15:26.733751+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [ { "children": 1, "frag": "*" } ] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 31, "mtime": "2024-09-15T23:15:26.733751+0000", "num_files": 40, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1333, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-15T23:15:26.733751+0000", "nestlock": {}, "nlink": 1, "nref": 2, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 2, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 70, "rctime": "2024-09-15T23:15:26.733751+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 244, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-15T23:15:35.708 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2024-09-15T23:15:38.226 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:15:38.230 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:15:40.709 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:15:40.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.817+0000 7f1a3774b640 1 Processor -- start 2024-09-15T23:15:40.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.817+0000 7f1a3774b640 1 -- start start 2024-09-15T23:15:40.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.818+0000 7f1a3774b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a300b2d40 0x7f1a3006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:40.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.818+0000 7f1a3774b640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a30071180 con 0x7f1a3013eb20 2024-09-15T23:15:40.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.818+0000 7f1a3774b640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a30071460 con 0x7f1a3006c150 2024-09-15T23:15:40.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.818+0000 7f1a3774b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1a30071ab0 con 0x7f1a300b2d40 2024-09-15T23:15:40.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.818+0000 7f1a34ce6640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1a3013eb20 0x7f1a3015bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:46256/0 (socket says 172.21.15.123:46256) 2024-09-15T23:15:40.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.818+0000 7f1a34ce6640 1 -- 172.21.15.123:0/2534982043 learned_addr learned my addr 172.21.15.123:0/2534982043 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:40.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.818+0000 7f1a354e7640 1 --2- 172.21.15.123:0/2534982043 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a300b2d40 0x7f1a3006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:40.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.818+0000 7f1a27fff640 1 -- 172.21.15.123:0/2534982043 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3628280534 0 0) 0x7f1a30071180 con 0x7f1a3013eb20 2024-09-15T23:15:40.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.818+0000 7f1a27fff640 1 -- 172.21.15.123:0/2534982043 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a1c003520 con 0x7f1a3013eb20 2024-09-15T23:15:40.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.818+0000 7f1a27fff640 1 -- 172.21.15.123:0/2534982043 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2529859933 0 0) 0x7f1a1c003520 con 0x7f1a3013eb20 2024-09-15T23:15:40.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.818+0000 7f1a27fff640 1 -- 172.21.15.123:0/2534982043 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a300b2d40 msgr2=0x7f1a3006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:40.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.818+0000 7f1a27fff640 1 --2- 172.21.15.123:0/2534982043 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a300b2d40 0x7f1a3006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:40.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.818+0000 7f1a27fff640 1 -- 172.21.15.123:0/2534982043 >> v1:172.21.15.188:6789/0 conn(0x7f1a3006c150 legacy=0x7f1a30071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:40.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.818+0000 7f1a27fff640 1 -- 172.21.15.123:0/2534982043 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a30071740 con 0x7f1a3013eb20 2024-09-15T23:15:40.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.818+0000 7f1a27fff640 1 -- 172.21.15.123:0/2534982043 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f1a20001670 con 0x7f1a3013eb20 2024-09-15T23:15:40.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.818+0000 7f1a27fff640 1 -- 172.21.15.123:0/2534982043 >> v1:172.21.15.123:6789/0 conn(0x7f1a3013eb20 legacy=0x7f1a3015bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:40.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.818+0000 7f1a27fff640 1 --2- 172.21.15.123:0/2534982043 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a300b2d40 0x7f1a1c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:40.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.819+0000 7f1a27fff640 1 --2- 172.21.15.123:0/2534982043 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a1c003f60 0x7f1a1c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:40.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.819+0000 7f1a27fff640 1 --2- 172.21.15.123:0/2534982043 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a1c004d40 0x7f1a1c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:40.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.819+0000 7f1a27fff640 1 -- 172.21.15.123:0/2534982043 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1a30071ab0 con 0x7f1a1c003f60 2024-09-15T23:15:40.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.819+0000 7f1a27fff640 1 -- 172.21.15.123:0/2534982043 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1a1c00baa0 con 0x7f1a1c004d40 2024-09-15T23:15:40.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.819+0000 7f1a27fff640 1 -- 172.21.15.123:0/2534982043 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1a1c00bca0 con 0x7f1a300b2d40 2024-09-15T23:15:40.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.819+0000 7f1a34ce6640 1 --2- 172.21.15.123:0/2534982043 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a1c003f60 0x7f1a1c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:40.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.819+0000 7f1a354e7640 1 --2- 172.21.15.123:0/2534982043 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a300b2d40 0x7f1a1c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:40.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.819+0000 7f1a35ce8640 1 --2- 172.21.15.123:0/2534982043 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a1c004d40 0x7f1a1c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:40.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.819+0000 7f1a34ce6640 1 -- 172.21.15.123:0/2534982043 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a300b2d40 msgr2=0x7f1a1c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:40.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.819+0000 7f1a34ce6640 1 --2- 172.21.15.123:0/2534982043 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a300b2d40 0x7f1a1c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:40.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.819+0000 7f1a34ce6640 1 -- 172.21.15.123:0/2534982043 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a1c004d40 msgr2=0x7f1a1c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:40.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.819+0000 7f1a34ce6640 1 --2- 172.21.15.123:0/2534982043 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a1c004d40 0x7f1a1c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:40.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.819+0000 7f1a34ce6640 1 -- 172.21.15.123:0/2534982043 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a1c003520 con 0x7f1a1c003f60 2024-09-15T23:15:40.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.820+0000 7f1a34ce6640 1 --2- 172.21.15.123:0/2534982043 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a1c003f60 0x7f1a1c004800 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f1a2000c210 tx=0x7f1a1c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e4557ce9bff7e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:40.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.820+0000 7f1a27fff640 1 -- 172.21.15.123:0/2534982043 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a20007cf0 con 0x7f1a1c003f60 2024-09-15T23:15:40.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.820+0000 7f1a27fff640 1 -- 172.21.15.123:0/2534982043 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a20005af0 con 0x7f1a1c003f60 2024-09-15T23:15:40.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.820+0000 7f1a27fff640 1 -- 172.21.15.123:0/2534982043 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a20007070 con 0x7f1a1c003f60 2024-09-15T23:15:40.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.820+0000 7f1a3774b640 1 -- 172.21.15.123:0/2534982043 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a1c003f60 msgr2=0x7f1a1c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:40.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.820+0000 7f1a3774b640 1 --2- 172.21.15.123:0/2534982043 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a1c003f60 0x7f1a1c004800 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f1a2000c210 tx=0x7f1a1c005830 comp rx=0 tx=0).stop 2024-09-15T23:15:40.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.820+0000 7f1a35ce8640 1 -- 172.21.15.123:0/2534982043 reap_dead start 2024-09-15T23:15:40.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.820+0000 7f1a3774b640 1 -- 172.21.15.123:0/2534982043 shutdown_connections 2024-09-15T23:15:40.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.820+0000 7f1a3774b640 1 -- 172.21.15.123:0/2534982043 >> 172.21.15.123:0/2534982043 conn(0x7f1a300ccec0 msgr2=0x7f1a300cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:40.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.820+0000 7f1a3774b640 1 -- 172.21.15.123:0/2534982043 shutdown_connections 2024-09-15T23:15:40.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.820+0000 7f1a3774b640 1 -- 172.21.15.123:0/2534982043 wait complete. 2024-09-15T23:15:40.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.822+0000 7f1a3774b640 1 Processor -- start 2024-09-15T23:15:40.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.822+0000 7f1a3774b640 1 -- start start 2024-09-15T23:15:40.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.822+0000 7f1a3774b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a1c003f60 0x7f1a30136c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:40.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.822+0000 7f1a3774b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a3015f770 0x7f1a30157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:40.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.822+0000 7f1a3774b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a30158080 0x7f1a3015cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:40.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.822+0000 7f1a3774b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3006bfa0 con 0x7f1a1c003f60 2024-09-15T23:15:40.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.822+0000 7f1a3774b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3006be20 con 0x7f1a30158080 2024-09-15T23:15:40.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.822+0000 7f1a3774b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1a3015c400 con 0x7f1a3015f770 2024-09-15T23:15:40.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.822+0000 7f1a354e7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a1c003f60 0x7f1a30136c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:40.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.822+0000 7f1a354e7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a1c003f60 0x7f1a30136c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40328/0 (socket says 172.21.15.123:40328) 2024-09-15T23:15:40.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.822+0000 7f1a354e7640 1 -- 172.21.15.123:0/2250519984 learned_addr learned my addr 172.21.15.123:0/2250519984 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:40.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.823+0000 7f1a34ce6640 1 --2- 172.21.15.123:0/2250519984 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a3015f770 0x7f1a30157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:40.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.823+0000 7f1a35ce8640 1 --2- 172.21.15.123:0/2250519984 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a30158080 0x7f1a3015cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:40.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.823+0000 7f1a354e7640 1 -- 172.21.15.123:0/2250519984 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a3015f770 msgr2=0x7f1a30157b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:40.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.823+0000 7f1a354e7640 1 --2- 172.21.15.123:0/2250519984 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a3015f770 0x7f1a30157b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:40.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.823+0000 7f1a354e7640 1 -- 172.21.15.123:0/2250519984 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a30158080 msgr2=0x7f1a3015cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:40.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.823+0000 7f1a354e7640 1 --2- 172.21.15.123:0/2250519984 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a30158080 0x7f1a3015cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:40.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.823+0000 7f1a354e7640 1 -- 172.21.15.123:0/2250519984 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a301375d0 con 0x7f1a1c003f60 2024-09-15T23:15:40.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.823+0000 7f1a35ce8640 1 --2- 172.21.15.123:0/2250519984 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a30158080 0x7f1a3015cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:40.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.823+0000 7f1a354e7640 1 --2- 172.21.15.123:0/2250519984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a1c003f60 0x7f1a30136c50 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c0119a0 tx=0x7f1a2c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:40.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.823+0000 7f1a25ffb640 1 -- 172.21.15.123:0/2250519984 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c00faf0 con 0x7f1a1c003f60 2024-09-15T23:15:40.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.823+0000 7f1a25ffb640 1 -- 172.21.15.123:0/2250519984 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a2c00fc90 con 0x7f1a1c003f60 2024-09-15T23:15:40.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.823+0000 7f1a3774b640 1 -- 172.21.15.123:0/2250519984 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a30156aa0 con 0x7f1a1c003f60 2024-09-15T23:15:40.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.823+0000 7f1a25ffb640 1 -- 172.21.15.123:0/2250519984 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c014440 con 0x7f1a1c003f60 2024-09-15T23:15:40.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.823+0000 7f1a3774b640 1 -- 172.21.15.123:0/2250519984 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a30157060 con 0x7f1a1c003f60 2024-09-15T23:15:40.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.824+0000 7f1a3774b640 1 -- 172.21.15.123:0/2250519984 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a3015c7e0 con 0x7f1a1c003f60 2024-09-15T23:15:40.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.825+0000 7f1a25ffb640 1 -- 172.21.15.123:0/2250519984 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1a2c012040 con 0x7f1a1c003f60 2024-09-15T23:15:40.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.825+0000 7f1a25ffb640 1 --2- 172.21.15.123:0/2250519984 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1a1406c2b0 0x7f1a1406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:40.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.825+0000 7f1a25ffb640 1 -- 172.21.15.123:0/2250519984 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5881+0+0 (secure 0 0 0) 0x7f1a2c08bb30 con 0x7f1a1c003f60 2024-09-15T23:15:40.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.826+0000 7f1a34ce6640 1 --2- 172.21.15.123:0/2250519984 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1a1406c2b0 0x7f1a1406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:40.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.826+0000 7f1a34ce6640 1 --2- 172.21.15.123:0/2250519984 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1a1406c2b0 0x7f1a1406e770 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1a20032000 tx=0x7f1a20009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:40.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:40.830+0000 7f1a25ffb640 1 -- 172.21.15.123:0/2250519984 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1a2c019030 con 0x7f1a1c003f60 2024-09-15T23:15:41.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.030+0000 7f1a3774b640 1 -- 172.21.15.123:0/2250519984 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1a3006c9c0 con 0x7f1a1c003f60 2024-09-15T23:15:41.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.030+0000 7f1a25ffb640 1 -- 172.21.15.123:0/2250519984 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5230 (secure 0 0 0) 0x7f1a2c05a280 con 0x7f1a1c003f60 2024-09-15T23:15:41.031 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:41.032 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":38,"btime":"2024-09-15T23:15:32:678232+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5483,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/522636413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":522636413},{"type":"v1","addr":"172.21.15.188:6835","nonce":522636413}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5860,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/3057173907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":3057173907},{"type":"v1","addr":"172.21.15.188:6837","nonce":3057173907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6399,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/811728648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":811728648},{"type":"v1","addr":"172.21.15.123:6833","nonce":811728648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:15:17.752297+0000","modified":"2024-09-15T23:15:32.678225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6411":{"gid":6411,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6835/3634063333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3634063333},{"type":"v1","addr":"172.21.15.123:6835","nonce":3634063333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6411,"qdb_cluster":[6411]},"id":4}]} 2024-09-15T23:15:41.032 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 38 2024-09-15T23:15:41.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.032+0000 7f1a3774b640 1 -- 172.21.15.123:0/2250519984 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1a1406c2b0 msgr2=0x7f1a1406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:41.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.032+0000 7f1a3774b640 1 --2- 172.21.15.123:0/2250519984 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1a1406c2b0 0x7f1a1406e770 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1a20032000 tx=0x7f1a20009030 comp rx=0 tx=0).stop 2024-09-15T23:15:41.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.032+0000 7f1a3774b640 1 -- 172.21.15.123:0/2250519984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a1c003f60 msgr2=0x7f1a30136c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:41.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.032+0000 7f1a3774b640 1 --2- 172.21.15.123:0/2250519984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a1c003f60 0x7f1a30136c50 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c0119a0 tx=0x7f1a2c011e60 comp rx=0 tx=0).stop 2024-09-15T23:15:41.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.032+0000 7f1a3774b640 1 -- 172.21.15.123:0/2250519984 shutdown_connections 2024-09-15T23:15:41.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.032+0000 7f1a3774b640 1 --2- 172.21.15.123:0/2250519984 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a30158080 0x7f1a3015cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:41.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.032+0000 7f1a3774b640 1 --2- 172.21.15.123:0/2250519984 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a3015f770 0x7f1a30157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:41.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.032+0000 7f1a3774b640 1 --2- 172.21.15.123:0/2250519984 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1a1406c2b0 0x7f1a1406e770 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:41.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.032+0000 7f1a3774b640 1 --2- 172.21.15.123:0/2250519984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a1c003f60 0x7f1a30136c50 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:41.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.032+0000 7f1a3774b640 1 -- 172.21.15.123:0/2250519984 >> 172.21.15.123:0/2250519984 conn(0x7f1a300ccec0 msgr2=0x7f1a301595e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:41.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.032+0000 7f1a3774b640 1 -- 172.21.15.123:0/2250519984 shutdown_connections 2024-09-15T23:15:41.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.032+0000 7f1a3774b640 1 -- 172.21.15.123:0/2250519984 wait complete. 2024-09-15T23:15:41.044 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 1099511627776 2024-09-15T23:15:41.156 INFO:teuthology.orchestra.run.smithi123.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-15T23:15:26.733751+0000","btime":"2024-09-15T23:15:25.961769+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-15T23:15:26.733751+0000","atime":"2024-09-15T23:15:25.961769+0000","time_warp_seq":0,"change_attr":31,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-15T23:15:26.733751+0000","num_files":40,"num_subdirs":0,"change_attr":31},"rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-15T23:15:26.733751+0000"},"accounted_rstat":{"version":0,"rbytes":70,"rfiles":40,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-15T23:15:26.733751+0000"},"version":247,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"2024-09-15T23:15:35.256315+0000","last_scrub_version":244,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"lock":0,"dirfrag":1,"dirtyrstat":1,"dirty":1,"authpin":0,"scrubqueue":0},"nref":3,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyrstat"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-15T23:15:41.156 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 70, "rctime": "2024-09-15T23:15:26.733751+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-15T23:15:25.961769+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-15T23:15:25.961769+0000", "change_attr": 31, "client_caps": [], "client_ranges": [], "ctime": "2024-09-15T23:15:26.733751+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 31, "mtime": "2024-09-15T23:15:26.733751+0000", "num_files": 40, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1333, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "2024-09-15T23:15:35.256315+0000", "last_scrub_version": 244, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-15T23:15:26.733751+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 3, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 1, "dirty": 1, "dirtyrstat": 1, "lock": 0, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 70, "rctime": "2024-09-15T23:15:26.733751+0000", "rfiles": 40, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyrstat" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 247, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-15T23:15:41.156 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-15T23:15:41.157 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:15:41.157 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:15:41.198 DEBUG:teuthology.orchestra.run.smithi188:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:15:41.248 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:15:41.248 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:15:41.248 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:15:41.248 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:15:41.265 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:15:41.265 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:15:41.265 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:15:41.265 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:15:41.284 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:15:41.284 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:15:41.284 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:15:41.284 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:15:41.320 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:15:41.320 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:15:41.320 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:15:41.321 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:15:41.342 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:15:41.342 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:15:41.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.458+0000 7f6055111640 1 Processor -- start 2024-09-15T23:15:41.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.458+0000 7f6055111640 1 -- start start 2024-09-15T23:15:41.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.459+0000 7f6055111640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f6050162c60 0x7f6050073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:41.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.459+0000 7f6055111640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60501631c0 con 0x7f605015e790 2024-09-15T23:15:41.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.459+0000 7f6055111640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60500ae9a0 con 0x7f605006f730 2024-09-15T23:15:41.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.459+0000 7f6055111640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f605015eb70 con 0x7f6050162c60 2024-09-15T23:15:41.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.459+0000 7f604ed9d640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f605015e790 0x7f60500b5430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:46264/0 (socket says 172.21.15.123:46264) 2024-09-15T23:15:41.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.459+0000 7f604ed9d640 1 -- 172.21.15.123:0/981422984 learned_addr learned my addr 172.21.15.123:0/981422984 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:41.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.459+0000 7f604e59c640 1 --2- 172.21.15.123:0/981422984 >> v2:172.21.15.188:3300/0 conn(0x7f6050162c60 0x7f6050073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:41.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.459+0000 7f604dd9b640 1 -- 172.21.15.123:0/981422984 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 735764128 0 0) 0x7f60501631c0 con 0x7f605015e790 2024-09-15T23:15:41.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.459+0000 7f604dd9b640 1 -- 172.21.15.123:0/981422984 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6038003520 con 0x7f605015e790 2024-09-15T23:15:41.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.460+0000 7f604dd9b640 1 -- 172.21.15.123:0/981422984 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2516716154 0 0) 0x7f60500ae9a0 con 0x7f605006f730 2024-09-15T23:15:41.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.460+0000 7f604dd9b640 1 -- 172.21.15.123:0/981422984 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60501631c0 con 0x7f605006f730 2024-09-15T23:15:41.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.460+0000 7f604dd9b640 1 -- 172.21.15.123:0/981422984 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2267907040 0 0) 0x7f6038003520 con 0x7f605015e790 2024-09-15T23:15:41.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.460+0000 7f604dd9b640 1 -- 172.21.15.123:0/981422984 >> v2:172.21.15.188:3300/0 conn(0x7f6050162c60 msgr2=0x7f6050073a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:41.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.460+0000 7f604dd9b640 1 --2- 172.21.15.123:0/981422984 >> v2:172.21.15.188:3300/0 conn(0x7f6050162c60 0x7f6050073a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:41.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.460+0000 7f604dd9b640 1 -- 172.21.15.123:0/981422984 >> v1:172.21.15.188:6789/0 conn(0x7f605006f730 legacy=0x7f60500af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:41.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.460+0000 7f604dd9b640 1 -- 172.21.15.123:0/981422984 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60500aec40 con 0x7f605015e790 2024-09-15T23:15:41.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.460+0000 7f604dd9b640 1 -- 172.21.15.123:0/981422984 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f6040001670 con 0x7f605015e790 2024-09-15T23:15:41.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.460+0000 7f604dd9b640 1 -- 172.21.15.123:0/981422984 >> v1:172.21.15.123:6789/0 conn(0x7f605015e790 legacy=0x7f60500b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:41.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.460+0000 7f604dd9b640 1 --2- 172.21.15.123:0/981422984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6038003b90 0x7f6038003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:41.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.460+0000 7f604dd9b640 1 --2- 172.21.15.123:0/981422984 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6038004800 0x7f6038004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:41.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.460+0000 7f604dd9b640 1 --2- 172.21.15.123:0/981422984 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6038005210 0x7f603800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:41.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.460+0000 7f604dd9b640 1 -- 172.21.15.123:0/981422984 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f603800c110 con 0x7f6038003b90 2024-09-15T23:15:41.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.460+0000 7f604dd9b640 1 -- 172.21.15.123:0/981422984 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f603800c2c0 con 0x7f6038004800 2024-09-15T23:15:41.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.460+0000 7f604dd9b640 1 -- 172.21.15.123:0/981422984 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f603800c4c0 con 0x7f6038005210 2024-09-15T23:15:41.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.460+0000 7f604e59c640 1 --2- 172.21.15.123:0/981422984 >> v2:172.21.15.188:3300/0 conn(0x7f6050162c60 0x7f6050073a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:15:41.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.460+0000 7f604ed9d640 1 --2- 172.21.15.123:0/981422984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6038003b90 0x7f6038003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:41.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.460+0000 7f604e59c640 1 --2- 172.21.15.123:0/981422984 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6038004800 0x7f6038004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:41.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.460+0000 7f604f59e640 1 --2- 172.21.15.123:0/981422984 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6038005210 0x7f603800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:41.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.460+0000 7f604ed9d640 1 -- 172.21.15.123:0/981422984 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6038005210 msgr2=0x7f603800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:41.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.460+0000 7f604ed9d640 1 --2- 172.21.15.123:0/981422984 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6038005210 0x7f603800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:41.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.460+0000 7f604ed9d640 1 -- 172.21.15.123:0/981422984 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6038004800 msgr2=0x7f6038004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:41.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.460+0000 7f604ed9d640 1 --2- 172.21.15.123:0/981422984 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6038004800 0x7f6038004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:41.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.460+0000 7f604ed9d640 1 -- 172.21.15.123:0/981422984 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6038003520 con 0x7f6038003b90 2024-09-15T23:15:41.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.460+0000 7f604f59e640 1 --2- 172.21.15.123:0/981422984 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6038005210 0x7f603800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:41.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.460+0000 7f604f59e640 1 -- 172.21.15.123:0/981422984 reap_dead start 2024-09-15T23:15:41.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.461+0000 7f604ed9d640 1 --2- 172.21.15.123:0/981422984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6038003b90 0x7f6038003f90 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f604000c0e0 tx=0x7f6038005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b507f776e7f23448 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:41.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.461+0000 7f604dd9b640 1 -- 172.21.15.123:0/981422984 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6040007c00 con 0x7f6038003b90 2024-09-15T23:15:41.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.461+0000 7f604dd9b640 1 -- 172.21.15.123:0/981422984 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6040005ad0 con 0x7f6038003b90 2024-09-15T23:15:41.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.461+0000 7f604dd9b640 1 -- 172.21.15.123:0/981422984 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6040007070 con 0x7f6038003b90 2024-09-15T23:15:41.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.461+0000 7f6055111640 1 -- 172.21.15.123:0/981422984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6038003b90 msgr2=0x7f6038003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:41.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.461+0000 7f6055111640 1 --2- 172.21.15.123:0/981422984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6038003b90 0x7f6038003f90 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f604000c0e0 tx=0x7f6038005830 comp rx=0 tx=0).stop 2024-09-15T23:15:41.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.461+0000 7f6055111640 1 -- 172.21.15.123:0/981422984 shutdown_connections 2024-09-15T23:15:41.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.461+0000 7f6055111640 1 --2- 172.21.15.123:0/981422984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6038003b90 0x7f6038003f90 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:41.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.461+0000 7f6055111640 1 -- 172.21.15.123:0/981422984 >> 172.21.15.123:0/981422984 conn(0x7f60500b0a80 msgr2=0x7f60500b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:41.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.462+0000 7f6055111640 1 -- 172.21.15.123:0/981422984 shutdown_connections 2024-09-15T23:15:41.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.462+0000 7f6055111640 1 -- 172.21.15.123:0/981422984 wait complete. 2024-09-15T23:15:41.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.463+0000 7f6055111640 1 Processor -- start 2024-09-15T23:15:41.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.463+0000 7f6055111640 1 -- start start 2024-09-15T23:15:41.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.464+0000 7f6055111640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6038003b90 0x7f60501f4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:41.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.464+0000 7f6055111640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f605014d2c0 0x7f605015b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:41.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.464+0000 7f6055111640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f605015cd60 0x7f605015d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:41.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.464+0000 7f6055111640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f605006f430 con 0x7f605015cd60 2024-09-15T23:15:41.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.464+0000 7f6055111640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f60500af200 con 0x7f6038003b90 2024-09-15T23:15:41.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.464+0000 7f6055111640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6050073a40 con 0x7f605014d2c0 2024-09-15T23:15:41.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.464+0000 7f604f59e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f605015cd60 0x7f605015d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:41.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.464+0000 7f604f59e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f605015cd60 0x7f605015d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40336/0 (socket says 172.21.15.123:40336) 2024-09-15T23:15:41.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.464+0000 7f604e59c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f605014d2c0 0x7f605015b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:41.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.464+0000 7f604f59e640 1 -- 172.21.15.123:0/1831702805 learned_addr learned my addr 172.21.15.123:0/1831702805 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:41.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.464+0000 7f604ed9d640 1 --2- 172.21.15.123:0/1831702805 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6038003b90 0x7f60501f4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:41.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.464+0000 7f604f59e640 1 -- 172.21.15.123:0/1831702805 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f605014d2c0 msgr2=0x7f605015b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:41.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.464+0000 7f604f59e640 1 --2- 172.21.15.123:0/1831702805 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f605014d2c0 0x7f605015b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:41.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.464+0000 7f604f59e640 1 -- 172.21.15.123:0/1831702805 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6038003b90 msgr2=0x7f60501f4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:41.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.464+0000 7f604f59e640 1 --2- 172.21.15.123:0/1831702805 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6038003b90 0x7f60501f4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:41.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.464+0000 7f604f59e640 1 -- 172.21.15.123:0/1831702805 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60501f4bd0 con 0x7f605015cd60 2024-09-15T23:15:41.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.464+0000 7f604f59e640 1 --2- 172.21.15.123:0/1831702805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f605015cd60 0x7f605015d1e0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f605006f400 tx=0x7f604800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:41.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.464+0000 7f60377fe640 1 -- 172.21.15.123:0/1831702805 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6048018070 con 0x7f605015cd60 2024-09-15T23:15:41.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.464+0000 7f60377fe640 1 -- 172.21.15.123:0/1831702805 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6048003b90 con 0x7f605015cd60 2024-09-15T23:15:41.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.464+0000 7f6055111640 1 -- 172.21.15.123:0/1831702805 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f605015af00 con 0x7f605015cd60 2024-09-15T23:15:41.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.464+0000 7f60377fe640 1 -- 172.21.15.123:0/1831702805 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6048005070 con 0x7f605015cd60 2024-09-15T23:15:41.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.465+0000 7f6055111640 1 -- 172.21.15.123:0/1831702805 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f605015ac20 con 0x7f605015cd60 2024-09-15T23:15:41.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.465+0000 7f6055111640 1 -- 172.21.15.123:0/1831702805 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f605006fb80 con 0x7f605015cd60 2024-09-15T23:15:41.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.466+0000 7f60377fe640 1 -- 172.21.15.123:0/1831702805 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6048005210 con 0x7f605015cd60 2024-09-15T23:15:41.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.466+0000 7f60377fe640 1 --2- 172.21.15.123:0/1831702805 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f603c06c2e0 0x7f603c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:41.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.466+0000 7f60377fe640 1 -- 172.21.15.123:0/1831702805 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5881+0+0 (secure 0 0 0) 0x7f604808a7d0 con 0x7f605015cd60 2024-09-15T23:15:41.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.467+0000 7f604ed9d640 1 --2- 172.21.15.123:0/1831702805 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f603c06c2e0 0x7f603c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:41.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.467+0000 7f604ed9d640 1 --2- 172.21.15.123:0/1831702805 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f603c06c2e0 0x7f603c06e7a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6040032000 tx=0x7f604002d000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:41.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.471+0000 7f60377fe640 1 -- 172.21.15.123:0/1831702805 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f60501f4bd0 con 0x7f605015cd60 2024-09-15T23:15:41.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.669+0000 7f6055111640 1 -- 172.21.15.123:0/1831702805 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6050071b20 con 0x7f605015cd60 2024-09-15T23:15:41.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.670+0000 7f60377fe640 1 -- 172.21.15.123:0/1831702805 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5230 (secure 0 0 0) 0x7f6048058840 con 0x7f605015cd60 2024-09-15T23:15:41.672 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:41.672 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":38,"btime":"2024-09-15T23:15:32:678232+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5483,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/522636413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":522636413},{"type":"v1","addr":"172.21.15.188:6835","nonce":522636413}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5860,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/3057173907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":3057173907},{"type":"v1","addr":"172.21.15.188:6837","nonce":3057173907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6399,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/811728648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":811728648},{"type":"v1","addr":"172.21.15.123:6833","nonce":811728648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:15:17.752297+0000","modified":"2024-09-15T23:15:32.678225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6411":{"gid":6411,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6835/3634063333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3634063333},{"type":"v1","addr":"172.21.15.123:6835","nonce":3634063333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6411,"qdb_cluster":[6411]},"id":4}]} 2024-09-15T23:15:41.674 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 38 2024-09-15T23:15:41.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.671+0000 7f6055111640 1 -- 172.21.15.123:0/1831702805 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f603c06c2e0 msgr2=0x7f603c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:41.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.671+0000 7f6055111640 1 --2- 172.21.15.123:0/1831702805 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f603c06c2e0 0x7f603c06e7a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6040032000 tx=0x7f604002d000 comp rx=0 tx=0).stop 2024-09-15T23:15:41.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.671+0000 7f6055111640 1 -- 172.21.15.123:0/1831702805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f605015cd60 msgr2=0x7f605015d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:41.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.671+0000 7f6055111640 1 --2- 172.21.15.123:0/1831702805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f605015cd60 0x7f605015d1e0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f605006f400 tx=0x7f604800dc00 comp rx=0 tx=0).stop 2024-09-15T23:15:41.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.672+0000 7f6055111640 1 -- 172.21.15.123:0/1831702805 shutdown_connections 2024-09-15T23:15:41.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.672+0000 7f6055111640 1 --2- 172.21.15.123:0/1831702805 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f603c06c2e0 0x7f603c06e7a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:41.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.672+0000 7f6055111640 1 --2- 172.21.15.123:0/1831702805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f605015cd60 0x7f605015d1e0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:41.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.672+0000 7f6055111640 1 --2- 172.21.15.123:0/1831702805 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f605014d2c0 0x7f605015b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:41.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.672+0000 7f6055111640 1 --2- 172.21.15.123:0/1831702805 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6038003b90 0x7f60501f4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:41.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.672+0000 7f6055111640 1 -- 172.21.15.123:0/1831702805 >> 172.21.15.123:0/1831702805 conn(0x7f60500b0a80 msgr2=0x7f60500d0350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:41.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.672+0000 7f6055111640 1 -- 172.21.15.123:0/1831702805 shutdown_connections 2024-09-15T23:15:41.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.672+0000 7f6055111640 1 -- 172.21.15.123:0/1831702805 wait complete. 2024-09-15T23:15:41.684 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:15:41.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.781+0000 7fa48e0c9640 1 Processor -- start 2024-09-15T23:15:41.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.781+0000 7fa48e0c9640 1 -- start start 2024-09-15T23:15:41.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.782+0000 7fa48e0c9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa488073890 0x7fa4880b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:41.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.782+0000 7fa48e0c9640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa4880b5880 0x7fa4880b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:41.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.782+0000 7fa48e0c9640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4880b4020 con 0x7fa488145ed0 2024-09-15T23:15:41.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.782+0000 7fa48e0c9640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fa4880b42c0 con 0x7fa4880b5880 2024-09-15T23:15:41.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.782+0000 7fa48e0c9640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa4880b45a0 con 0x7fa488073890 2024-09-15T23:15:41.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.782+0000 7fa4877fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa488145ed0 0x7fa488073180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:46272/0 (socket says 172.21.15.123:46272) 2024-09-15T23:15:41.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.782+0000 7fa4877fe640 1 -- 172.21.15.123:0/1190614409 learned_addr learned my addr 172.21.15.123:0/1190614409 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:41.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.782+0000 7fa487fff640 1 --2- 172.21.15.123:0/1190614409 >> v2:172.21.15.188:3300/0 conn(0x7fa4880b5880 0x7fa4880b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:41.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.782+0000 7fa486ffd640 1 --2- 172.21.15.123:0/1190614409 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa488073890 0x7fa4880b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:41.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.782+0000 7fa4867fc640 1 -- 172.21.15.123:0/1190614409 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1166249668 0 0) 0x7fa4880b4020 con 0x7fa488145ed0 2024-09-15T23:15:41.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.782+0000 7fa4867fc640 1 -- 172.21.15.123:0/1190614409 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa470003520 con 0x7fa488145ed0 2024-09-15T23:15:41.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.782+0000 7fa4867fc640 1 -- 172.21.15.123:0/1190614409 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2840903327 0 0) 0x7fa470003520 con 0x7fa488145ed0 2024-09-15T23:15:41.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.782+0000 7fa4867fc640 1 -- 172.21.15.123:0/1190614409 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa488073890 msgr2=0x7fa4880b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:41.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.782+0000 7fa4867fc640 1 --2- 172.21.15.123:0/1190614409 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa488073890 0x7fa4880b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:41.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.782+0000 7fa4867fc640 1 -- 172.21.15.123:0/1190614409 >> v2:172.21.15.188:3300/0 conn(0x7fa4880b5880 msgr2=0x7fa4880b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:41.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.782+0000 7fa4867fc640 1 --2- 172.21.15.123:0/1190614409 >> v2:172.21.15.188:3300/0 conn(0x7fa4880b5880 0x7fa4880b5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:41.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.782+0000 7fa4867fc640 1 -- 172.21.15.123:0/1190614409 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4880b4880 con 0x7fa488145ed0 2024-09-15T23:15:41.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.782+0000 7fa4867fc640 1 -- 172.21.15.123:0/1190614409 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fa478001670 con 0x7fa488145ed0 2024-09-15T23:15:41.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.782+0000 7fa4867fc640 1 -- 172.21.15.123:0/1190614409 >> v1:172.21.15.123:6789/0 conn(0x7fa488145ed0 legacy=0x7fa488073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:41.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.782+0000 7fa4867fc640 1 --2- 172.21.15.123:0/1190614409 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4700039b0 0x7fa470003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:41.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.782+0000 7fa4867fc640 1 --2- 172.21.15.123:0/1190614409 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa470004800 0x7fa470004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:41.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.782+0000 7fa4867fc640 1 --2- 172.21.15.123:0/1190614409 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa488073890 0x7fa4700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:41.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.782+0000 7fa4867fc640 1 -- 172.21.15.123:0/1190614409 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa4880b42c0 con 0x7fa4700039b0 2024-09-15T23:15:41.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.782+0000 7fa4867fc640 1 -- 172.21.15.123:0/1190614409 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa4880b45a0 con 0x7fa470004800 2024-09-15T23:15:41.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.782+0000 7fa4867fc640 1 -- 172.21.15.123:0/1190614409 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa47000b9c0 con 0x7fa488073890 2024-09-15T23:15:41.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.783+0000 7fa4877fe640 1 --2- 172.21.15.123:0/1190614409 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4700039b0 0x7fa470003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:41.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.783+0000 7fa487fff640 1 --2- 172.21.15.123:0/1190614409 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa488073890 0x7fa4700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:41.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.783+0000 7fa486ffd640 1 --2- 172.21.15.123:0/1190614409 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa470004800 0x7fa470004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:41.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.783+0000 7fa4877fe640 1 -- 172.21.15.123:0/1190614409 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa488073890 msgr2=0x7fa4700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:41.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.783+0000 7fa4877fe640 1 --2- 172.21.15.123:0/1190614409 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa488073890 0x7fa4700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:41.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.783+0000 7fa4877fe640 1 -- 172.21.15.123:0/1190614409 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa470004800 msgr2=0x7fa470004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:41.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.783+0000 7fa4877fe640 1 --2- 172.21.15.123:0/1190614409 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa470004800 0x7fa470004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:41.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.783+0000 7fa4877fe640 1 -- 172.21.15.123:0/1190614409 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa470003520 con 0x7fa4700039b0 2024-09-15T23:15:41.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.783+0000 7fa4877fe640 1 --2- 172.21.15.123:0/1190614409 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4700039b0 0x7fa470003dd0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fa47800c240 tx=0x7fa470005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1206d564352c2f0c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:41.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.784+0000 7fa4867fc640 1 -- 172.21.15.123:0/1190614409 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47802e070 con 0x7fa4700039b0 2024-09-15T23:15:41.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.784+0000 7fa4867fc640 1 -- 172.21.15.123:0/1190614409 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa478005af0 con 0x7fa4700039b0 2024-09-15T23:15:41.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.784+0000 7fa4867fc640 1 -- 172.21.15.123:0/1190614409 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa478007d30 con 0x7fa4700039b0 2024-09-15T23:15:41.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.784+0000 7fa48e0c9640 1 -- 172.21.15.123:0/1190614409 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4700039b0 msgr2=0x7fa470003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:41.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.784+0000 7fa48e0c9640 1 --2- 172.21.15.123:0/1190614409 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4700039b0 0x7fa470003dd0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fa47800c240 tx=0x7fa470005830 comp rx=0 tx=0).stop 2024-09-15T23:15:41.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.784+0000 7fa487fff640 1 -- 172.21.15.123:0/1190614409 reap_dead start 2024-09-15T23:15:41.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.784+0000 7fa48e0c9640 1 -- 172.21.15.123:0/1190614409 shutdown_connections 2024-09-15T23:15:41.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.784+0000 7fa48e0c9640 1 -- 172.21.15.123:0/1190614409 >> 172.21.15.123:0/1190614409 conn(0x7fa4880ccec0 msgr2=0x7fa4880cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:41.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.784+0000 7fa48e0c9640 1 -- 172.21.15.123:0/1190614409 shutdown_connections 2024-09-15T23:15:41.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.784+0000 7fa48e0c9640 1 -- 172.21.15.123:0/1190614409 wait complete. 2024-09-15T23:15:41.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.785+0000 7fa48e0c9640 1 Processor -- start 2024-09-15T23:15:41.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.785+0000 7fa48e0c9640 1 -- start start 2024-09-15T23:15:41.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.786+0000 7fa48e0c9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4700039b0 0x7fa4881f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:41.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.786+0000 7fa48e0c9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa488071800 0x7fa48815c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:41.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.786+0000 7fa48e0c9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa48813baa0 0x7fa48813bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:41.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.786+0000 7fa48e0c9640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa4880b6270 con 0x7fa488071800 2024-09-15T23:15:41.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.786+0000 7fa48e0c9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa4881462b0 con 0x7fa48813baa0 2024-09-15T23:15:41.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.786+0000 7fa48e0c9640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa48813c440 con 0x7fa4700039b0 2024-09-15T23:15:41.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.786+0000 7fa486ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa488071800 0x7fa48815c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:41.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.786+0000 7fa486ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa488071800 0x7fa48815c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40350/0 (socket says 172.21.15.123:40350) 2024-09-15T23:15:41.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.786+0000 7fa486ffd640 1 -- 172.21.15.123:0/1264571815 learned_addr learned my addr 172.21.15.123:0/1264571815 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:41.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.786+0000 7fa487fff640 1 --2- 172.21.15.123:0/1264571815 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa48813baa0 0x7fa48813bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:41.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.786+0000 7fa4877fe640 1 --2- 172.21.15.123:0/1264571815 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4700039b0 0x7fa4881f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:41.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.787+0000 7fa486ffd640 1 -- 172.21.15.123:0/1264571815 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4700039b0 msgr2=0x7fa4881f83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:41.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.787+0000 7fa486ffd640 1 --2- 172.21.15.123:0/1264571815 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4700039b0 0x7fa4881f83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:41.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.787+0000 7fa486ffd640 1 -- 172.21.15.123:0/1264571815 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa48813baa0 msgr2=0x7fa48813bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:41.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.787+0000 7fa486ffd640 1 --2- 172.21.15.123:0/1264571815 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa48813baa0 0x7fa48813bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:41.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.787+0000 7fa486ffd640 1 -- 172.21.15.123:0/1264571815 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4881f8900 con 0x7fa488071800 2024-09-15T23:15:41.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.787+0000 7fa487fff640 1 --2- 172.21.15.123:0/1264571815 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa48813baa0 0x7fa48813bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:41.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.787+0000 7fa486ffd640 1 --2- 172.21.15.123:0/1264571815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa488071800 0x7fa48815c2e0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fa47c011570 tx=0x7fa47c011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:41.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.787+0000 7fa46ffff640 1 -- 172.21.15.123:0/1264571815 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47c015930 con 0x7fa488071800 2024-09-15T23:15:41.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.787+0000 7fa46ffff640 1 -- 172.21.15.123:0/1264571815 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa47c015ad0 con 0x7fa488071800 2024-09-15T23:15:41.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.787+0000 7fa48e0c9640 1 -- 172.21.15.123:0/1264571815 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4881f4430 con 0x7fa488071800 2024-09-15T23:15:41.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.787+0000 7fa46ffff640 1 -- 172.21.15.123:0/1264571815 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47c00f460 con 0x7fa488071800 2024-09-15T23:15:41.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.787+0000 7fa48e0c9640 1 -- 172.21.15.123:0/1264571815 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa488072c40 con 0x7fa488071800 2024-09-15T23:15:41.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.788+0000 7fa48e0c9640 1 -- 172.21.15.123:0/1264571815 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4880b5d30 con 0x7fa488071800 2024-09-15T23:15:41.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.788+0000 7fa46ffff640 1 -- 172.21.15.123:0/1264571815 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa47c00f600 con 0x7fa488071800 2024-09-15T23:15:41.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.789+0000 7fa46ffff640 1 --2- 172.21.15.123:0/1264571815 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa47406c2b0 0x7fa47406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:41.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.789+0000 7fa46ffff640 1 -- 172.21.15.123:0/1264571815 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5881+0+0 (secure 0 0 0) 0x7fa47c08bdc0 con 0x7fa488071800 2024-09-15T23:15:41.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.789+0000 7fa4877fe640 1 --2- 172.21.15.123:0/1264571815 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa47406c2b0 0x7fa47406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:41.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.789+0000 7fa4877fe640 1 --2- 172.21.15.123:0/1264571815 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa47406c2b0 0x7fa47406e770 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa478033000 tx=0x7fa478009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:41.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.793+0000 7fa46ffff640 1 -- 172.21.15.123:0/1264571815 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa4881f8900 con 0x7fa488071800 2024-09-15T23:15:41.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.992+0000 7fa48e0c9640 1 -- 172.21.15.123:0/1264571815 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa488071f70 con 0x7fa488071800 2024-09-15T23:15:41.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.992+0000 7fa46ffff640 1 -- 172.21.15.123:0/1264571815 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5230 (secure 0 0 0) 0x7fa47c019030 con 0x7fa488071800 2024-09-15T23:15:41.994 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:41.994 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":38,"btime":"2024-09-15T23:15:32:678232+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5483,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/522636413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":522636413},{"type":"v1","addr":"172.21.15.188:6835","nonce":522636413}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5860,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/3057173907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":3057173907},{"type":"v1","addr":"172.21.15.188:6837","nonce":3057173907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6399,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/811728648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":811728648},{"type":"v1","addr":"172.21.15.123:6833","nonce":811728648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:15:17.752297+0000","modified":"2024-09-15T23:15:32.678225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6411":{"gid":6411,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6835/3634063333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3634063333},{"type":"v1","addr":"172.21.15.123:6835","nonce":3634063333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6411,"qdb_cluster":[6411]},"id":4}]} 2024-09-15T23:15:41.994 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 38 2024-09-15T23:15:41.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.994+0000 7fa48e0c9640 1 -- 172.21.15.123:0/1264571815 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa47406c2b0 msgr2=0x7fa47406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:41.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.994+0000 7fa48e0c9640 1 --2- 172.21.15.123:0/1264571815 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa47406c2b0 0x7fa47406e770 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa478033000 tx=0x7fa478009030 comp rx=0 tx=0).stop 2024-09-15T23:15:41.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.994+0000 7fa48e0c9640 1 -- 172.21.15.123:0/1264571815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa488071800 msgr2=0x7fa48815c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:41.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.994+0000 7fa48e0c9640 1 --2- 172.21.15.123:0/1264571815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa488071800 0x7fa48815c2e0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fa47c011570 tx=0x7fa47c011a30 comp rx=0 tx=0).stop 2024-09-15T23:15:41.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.994+0000 7fa48e0c9640 1 -- 172.21.15.123:0/1264571815 shutdown_connections 2024-09-15T23:15:41.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.994+0000 7fa48e0c9640 1 --2- 172.21.15.123:0/1264571815 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa48813baa0 0x7fa48813bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:41.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.994+0000 7fa48e0c9640 1 --2- 172.21.15.123:0/1264571815 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa47406c2b0 0x7fa47406e770 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:41.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.994+0000 7fa48e0c9640 1 --2- 172.21.15.123:0/1264571815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa488071800 0x7fa48815c2e0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:41.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.994+0000 7fa48e0c9640 1 --2- 172.21.15.123:0/1264571815 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4700039b0 0x7fa4881f83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:41.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.994+0000 7fa48e0c9640 1 -- 172.21.15.123:0/1264571815 >> 172.21.15.123:0/1264571815 conn(0x7fa4880ccec0 msgr2=0x7fa488143d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:41.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.995+0000 7fa48e0c9640 1 -- 172.21.15.123:0/1264571815 shutdown_connections 2024-09-15T23:15:41.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:41.995+0000 7fa48e0c9640 1 -- 172.21.15.123:0/1264571815 wait complete. 2024-09-15T23:15:42.006 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:15:42.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.103+0000 7fd694a9b640 1 Processor -- start 2024-09-15T23:15:42.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.103+0000 7fd694a9b640 1 -- start start 2024-09-15T23:15:42.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.104+0000 7fd694a9b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd69015c4b0 0x7fd6900b6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:42.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.104+0000 7fd694a9b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd6900d08e0 0x7fd6900b6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:42.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.104+0000 7fd694a9b640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd690067b50 con 0x7fd6900b02b0 2024-09-15T23:15:42.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.104+0000 7fd694a9b640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fd6900ce860 con 0x7fd6900d08e0 2024-09-15T23:15:42.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.104+0000 7fd694a9b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd690070130 con 0x7fd69015c4b0 2024-09-15T23:15:42.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.104+0000 7fd68ed9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd6900d08e0 0x7fd6900b6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:42.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.104+0000 7fd687fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd6900b02b0 0x7fd690160120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:46276/0 (socket says 172.21.15.123:46276) 2024-09-15T23:15:42.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.104+0000 7fd687fff640 1 -- 172.21.15.123:0/2806241672 learned_addr learned my addr 172.21.15.123:0/2806241672 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:42.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.104+0000 7fd68ed9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd6900d08e0 0x7fd6900b6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40358/0 (socket says 172.21.15.123:40358) 2024-09-15T23:15:42.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.104+0000 7fd68e59c640 1 --2- 172.21.15.123:0/2806241672 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd69015c4b0 0x7fd6900b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:42.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.104+0000 7fd68ed9d640 1 -- 172.21.15.123:0/2806241672 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd69015c4b0 msgr2=0x7fd6900b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:42.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.104+0000 7fd68ed9d640 1 --2- 172.21.15.123:0/2806241672 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd69015c4b0 0x7fd6900b6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:42.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.104+0000 7fd68ed9d640 1 -- 172.21.15.123:0/2806241672 >> v1:172.21.15.123:6789/0 conn(0x7fd6900b02b0 legacy=0x7fd690160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:42.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.104+0000 7fd68dd9b640 1 -- 172.21.15.123:0/2806241672 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 953447535 0 0) 0x7fd678001110 con 0x7fd6900b02b0 2024-09-15T23:15:42.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.104+0000 7fd68ed9d640 1 -- 172.21.15.123:0/2806241672 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd69006fe50 con 0x7fd6900d08e0 2024-09-15T23:15:42.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.105+0000 7fd68ed9d640 1 --2- 172.21.15.123:0/2806241672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6900d08e0 0x7fd6900b6660 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fd688009d90 tx=0x7fd68802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=340c0c15b5ab790c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:42.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.105+0000 7fd68dd9b640 1 -- 172.21.15.123:0/2806241672 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd688007740 con 0x7fd6900d08e0 2024-09-15T23:15:42.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.105+0000 7fd68dd9b640 1 -- 172.21.15.123:0/2806241672 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6880078e0 con 0x7fd6900d08e0 2024-09-15T23:15:42.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.105+0000 7fd68dd9b640 1 -- 172.21.15.123:0/2806241672 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd688007cb0 con 0x7fd6900d08e0 2024-09-15T23:15:42.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.106+0000 7fd694a9b640 1 -- 172.21.15.123:0/2806241672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6900d08e0 msgr2=0x7fd6900b6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:42.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.106+0000 7fd694a9b640 1 --2- 172.21.15.123:0/2806241672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6900d08e0 0x7fd6900b6660 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fd688009d90 tx=0x7fd68802a660 comp rx=0 tx=0).stop 2024-09-15T23:15:42.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.106+0000 7fd694a9b640 1 -- 172.21.15.123:0/2806241672 shutdown_connections 2024-09-15T23:15:42.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.106+0000 7fd694a9b640 1 --2- 172.21.15.123:0/2806241672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6900d08e0 0x7fd6900b6660 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:42.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.106+0000 7fd694a9b640 1 --2- 172.21.15.123:0/2806241672 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd69015c4b0 0x7fd6900b6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:42.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.106+0000 7fd694a9b640 1 -- 172.21.15.123:0/2806241672 >> 172.21.15.123:0/2806241672 conn(0x7fd6900b0a80 msgr2=0x7fd6900b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:42.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.106+0000 7fd694a9b640 1 -- 172.21.15.123:0/2806241672 shutdown_connections 2024-09-15T23:15:42.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.106+0000 7fd694a9b640 1 -- 172.21.15.123:0/2806241672 wait complete. 2024-09-15T23:15:42.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.107+0000 7fd694a9b640 1 Processor -- start 2024-09-15T23:15:42.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.107+0000 7fd694a9b640 1 -- start start 2024-09-15T23:15:42.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.108+0000 7fd694a9b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6900b02b0 0x7fd69014a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:42.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.108+0000 7fd694a9b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6900d08e0 0x7fd69015ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:42.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.108+0000 7fd694a9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd69015c4b0 0x7fd6900aba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:42.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.108+0000 7fd694a9b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd69006dcc0 con 0x7fd69015c4b0 2024-09-15T23:15:42.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.108+0000 7fd694a9b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd6900ce580 con 0x7fd6900d08e0 2024-09-15T23:15:42.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.108+0000 7fd694a9b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd69015c890 con 0x7fd6900b02b0 2024-09-15T23:15:42.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.108+0000 7fd68ed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd69015c4b0 0x7fd6900aba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:42.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.108+0000 7fd68ed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd69015c4b0 0x7fd6900aba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40374/0 (socket says 172.21.15.123:40374) 2024-09-15T23:15:42.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.108+0000 7fd68ed9d640 1 -- 172.21.15.123:0/847416214 learned_addr learned my addr 172.21.15.123:0/847416214 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:42.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.108+0000 7fd687fff640 1 --2- 172.21.15.123:0/847416214 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6900d08e0 0x7fd69015ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:42.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.108+0000 7fd68e59c640 1 --2- 172.21.15.123:0/847416214 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6900b02b0 0x7fd69014a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:42.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.108+0000 7fd68ed9d640 1 -- 172.21.15.123:0/847416214 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6900b02b0 msgr2=0x7fd69014a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:42.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.108+0000 7fd68ed9d640 1 --2- 172.21.15.123:0/847416214 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6900b02b0 0x7fd69014a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:42.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.108+0000 7fd68ed9d640 1 -- 172.21.15.123:0/847416214 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6900d08e0 msgr2=0x7fd69015ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:42.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.108+0000 7fd68ed9d640 1 --2- 172.21.15.123:0/847416214 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6900d08e0 0x7fd69015ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:42.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.108+0000 7fd68ed9d640 1 -- 172.21.15.123:0/847416214 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6900ae990 con 0x7fd69015c4b0 2024-09-15T23:15:42.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.108+0000 7fd68ed9d640 1 --2- 172.21.15.123:0/847416214 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd69015c4b0 0x7fd6900aba50 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fd688009d90 tx=0x7fd688004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:42.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.108+0000 7fd686ffd640 1 -- 172.21.15.123:0/847416214 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd688040070 con 0x7fd69015c4b0 2024-09-15T23:15:42.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.108+0000 7fd686ffd640 1 -- 172.21.15.123:0/847416214 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd688031bc0 con 0x7fd69015c4b0 2024-09-15T23:15:42.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.109+0000 7fd694a9b640 1 -- 172.21.15.123:0/847416214 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6900aec70 con 0x7fd69015c4b0 2024-09-15T23:15:42.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.109+0000 7fd686ffd640 1 -- 172.21.15.123:0/847416214 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd68803c420 con 0x7fd69015c4b0 2024-09-15T23:15:42.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.109+0000 7fd694a9b640 1 -- 172.21.15.123:0/847416214 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6900af230 con 0x7fd69015c4b0 2024-09-15T23:15:42.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.110+0000 7fd694a9b640 1 -- 172.21.15.123:0/847416214 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6900b6120 con 0x7fd69015c4b0 2024-09-15T23:15:42.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.110+0000 7fd686ffd640 1 -- 172.21.15.123:0/847416214 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd688039040 con 0x7fd69015c4b0 2024-09-15T23:15:42.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.111+0000 7fd686ffd640 1 --2- 172.21.15.123:0/847416214 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd67006c2b0 0x7fd67006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:42.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.111+0000 7fd686ffd640 1 -- 172.21.15.123:0/847416214 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5881+0+0 (secure 0 0 0) 0x7fd6880ac910 con 0x7fd69015c4b0 2024-09-15T23:15:42.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.111+0000 7fd68e59c640 1 --2- 172.21.15.123:0/847416214 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd67006c2b0 0x7fd67006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:42.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.111+0000 7fd68e59c640 1 --2- 172.21.15.123:0/847416214 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd67006c2b0 0x7fd67006e770 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd6800079a0 tx=0x7fd680008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:42.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.115+0000 7fd686ffd640 1 -- 172.21.15.123:0/847416214 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd68807a980 con 0x7fd69015c4b0 2024-09-15T23:15:42.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.280+0000 7fd694a9b640 1 -- 172.21.15.123:0/847416214 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd6900af470 con 0x7fd69015c4b0 2024-09-15T23:15:42.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.281+0000 7fd686ffd640 1 -- 172.21.15.123:0/847416214 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+17012 (secure 0 0 0) 0x7fd6880ac090 con 0x7fd69015c4b0 2024-09-15T23:15:42.283 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:42.283 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":70,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:15:29.652228+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:15:16.362912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-15T23:15:16.718663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.188:6837/3452580408":"2024-09-16T23:15:29.652204+0000","172.21.15.188:6835/3452580408":"2024-09-16T23:15:29.652204+0000","172.21.15.123:6835/2772280632":"2024-09-16T23:15:28.658500+0000","172.21.15.123:6833/2772280632":"2024-09-16T23:15:28.658500+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:15:42.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.283+0000 7fd694a9b640 1 -- 172.21.15.123:0/847416214 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd67006c2b0 msgr2=0x7fd67006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:42.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.283+0000 7fd694a9b640 1 --2- 172.21.15.123:0/847416214 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd67006c2b0 0x7fd67006e770 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd6800079a0 tx=0x7fd680008040 comp rx=0 tx=0).stop 2024-09-15T23:15:42.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.283+0000 7fd694a9b640 1 -- 172.21.15.123:0/847416214 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd69015c4b0 msgr2=0x7fd6900aba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:42.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.283+0000 7fd694a9b640 1 --2- 172.21.15.123:0/847416214 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd69015c4b0 0x7fd6900aba50 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fd688009d90 tx=0x7fd688004a40 comp rx=0 tx=0).stop 2024-09-15T23:15:42.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.283+0000 7fd694a9b640 1 -- 172.21.15.123:0/847416214 shutdown_connections 2024-09-15T23:15:42.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.283+0000 7fd694a9b640 1 --2- 172.21.15.123:0/847416214 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd67006c2b0 0x7fd67006e770 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:42.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.283+0000 7fd694a9b640 1 --2- 172.21.15.123:0/847416214 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd69015c4b0 0x7fd6900aba50 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:42.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.283+0000 7fd694a9b640 1 --2- 172.21.15.123:0/847416214 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6900d08e0 0x7fd69015ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:42.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.283+0000 7fd694a9b640 1 --2- 172.21.15.123:0/847416214 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6900b02b0 0x7fd69014a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:42.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.283+0000 7fd694a9b640 1 -- 172.21.15.123:0/847416214 >> 172.21.15.123:0/847416214 conn(0x7fd6900b0a80 msgr2=0x7fd6900b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:42.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.283+0000 7fd694a9b640 1 -- 172.21.15.123:0/847416214 shutdown_connections 2024-09-15T23:15:42.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.283+0000 7fd694a9b640 1 -- 172.21.15.123:0/847416214 wait complete. 2024-09-15T23:15:42.297 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T23:15:42.297 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:15:42.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.395+0000 7f0971b98640 1 Processor -- start 2024-09-15T23:15:42.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.395+0000 7f0971b98640 1 -- start start 2024-09-15T23:15:42.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.396+0000 7f0971b98640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f096c148090 0x7f096c0ae870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:42.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.396+0000 7f0971b98640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f096c0731e0 0x7f096c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:42.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.396+0000 7f0971b98640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f096c0b07c0 con 0x7f096c06c150 2024-09-15T23:15:42.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.396+0000 7f0971b98640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f096c0b52c0 con 0x7f096c148090 2024-09-15T23:15:42.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.396+0000 7f0971b98640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f096c148470 con 0x7f096c0731e0 2024-09-15T23:15:42.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.396+0000 7f096b7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f096c148090 0x7f096c0ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:42.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.396+0000 7f096b7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f096c148090 0x7f096c0ae870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40384/0 (socket says 172.21.15.123:40384) 2024-09-15T23:15:42.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.396+0000 7f096b7fe640 1 -- 172.21.15.123:0/1307586629 learned_addr learned my addr 172.21.15.123:0/1307586629 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:42.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.396+0000 7f096affd640 1 --2- 172.21.15.123:0/1307586629 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f096c0731e0 0x7f096c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:42.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.396+0000 7f096b7fe640 1 -- 172.21.15.123:0/1307586629 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f096c0731e0 msgr2=0x7f096c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:42.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.396+0000 7f096b7fe640 1 --2- 172.21.15.123:0/1307586629 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f096c0731e0 0x7f096c06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:42.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.397+0000 7f096b7fe640 1 -- 172.21.15.123:0/1307586629 >> v1:172.21.15.188:6789/0 conn(0x7f096c06c150 legacy=0x7f096c071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:42.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.397+0000 7f096b7fe640 1 -- 172.21.15.123:0/1307586629 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f096c0af7a0 con 0x7f096c148090 2024-09-15T23:15:42.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.397+0000 7f096affd640 1 --2- 172.21.15.123:0/1307586629 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f096c0731e0 0x7f096c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:42.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.397+0000 7f096b7fe640 1 --2- 172.21.15.123:0/1307586629 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f096c148090 0x7f096c0ae870 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f095c009870 tx=0x7f095c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b05b758fc7b5129 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:42.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.397+0000 7f096a7fc640 1 -- 172.21.15.123:0/1307586629 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f095c037070 con 0x7f096c148090 2024-09-15T23:15:42.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.397+0000 7f096a7fc640 1 -- 172.21.15.123:0/1307586629 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f095c032440 con 0x7f096c148090 2024-09-15T23:15:42.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.397+0000 7f096a7fc640 1 -- 172.21.15.123:0/1307586629 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f095c032810 con 0x7f096c148090 2024-09-15T23:15:42.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.398+0000 7f0971b98640 1 -- 172.21.15.123:0/1307586629 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f096c148090 msgr2=0x7f096c0ae870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:42.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.398+0000 7f0971b98640 1 --2- 172.21.15.123:0/1307586629 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f096c148090 0x7f096c0ae870 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f095c009870 tx=0x7f095c02a270 comp rx=0 tx=0).stop 2024-09-15T23:15:42.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.398+0000 7f0971b98640 1 -- 172.21.15.123:0/1307586629 shutdown_connections 2024-09-15T23:15:42.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.398+0000 7f0971b98640 1 --2- 172.21.15.123:0/1307586629 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f096c0731e0 0x7f096c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:42.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.398+0000 7f0971b98640 1 --2- 172.21.15.123:0/1307586629 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f096c148090 0x7f096c0ae870 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:42.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.398+0000 7f0971b98640 1 -- 172.21.15.123:0/1307586629 >> 172.21.15.123:0/1307586629 conn(0x7f096c06cd20 msgr2=0x7f096c06d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:42.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.398+0000 7f0971b98640 1 -- 172.21.15.123:0/1307586629 shutdown_connections 2024-09-15T23:15:42.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.398+0000 7f0971b98640 1 -- 172.21.15.123:0/1307586629 wait complete. 2024-09-15T23:15:42.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.399+0000 7f0971b98640 1 Processor -- start 2024-09-15T23:15:42.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.399+0000 7f0971b98640 1 -- start start 2024-09-15T23:15:42.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.400+0000 7f0971b98640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f096c06c150 0x7f096c13f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:42.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.400+0000 7f0971b98640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f096c0731e0 0x7f096c144df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:42.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.400+0000 7f0971b98640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f096c148090 0x7f096c1415a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:42.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.400+0000 7f0971b98640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f096c0af1e0 con 0x7f096c148090 2024-09-15T23:15:42.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.400+0000 7f0971b98640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f096c0b5580 con 0x7f096c06c150 2024-09-15T23:15:42.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.400+0000 7f0971b98640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f096c0af4c0 con 0x7f096c0731e0 2024-09-15T23:15:42.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.400+0000 7f096bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f096c148090 0x7f096c1415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:42.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.400+0000 7f096bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f096c148090 0x7f096c1415a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40400/0 (socket says 172.21.15.123:40400) 2024-09-15T23:15:42.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.400+0000 7f096bfff640 1 -- 172.21.15.123:0/650718647 learned_addr learned my addr 172.21.15.123:0/650718647 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:42.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.400+0000 7f096b7fe640 1 --2- 172.21.15.123:0/650718647 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f096c06c150 0x7f096c13f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:42.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.400+0000 7f096affd640 1 --2- 172.21.15.123:0/650718647 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f096c0731e0 0x7f096c144df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:42.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.400+0000 7f096bfff640 1 -- 172.21.15.123:0/650718647 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f096c0731e0 msgr2=0x7f096c144df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:42.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.400+0000 7f096bfff640 1 --2- 172.21.15.123:0/650718647 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f096c0731e0 0x7f096c144df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:42.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.401+0000 7f096bfff640 1 -- 172.21.15.123:0/650718647 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f096c06c150 msgr2=0x7f096c13f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:42.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.401+0000 7f096bfff640 1 --2- 172.21.15.123:0/650718647 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f096c06c150 0x7f096c13f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:42.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.401+0000 7f096bfff640 1 -- 172.21.15.123:0/650718647 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f096c141ae0 con 0x7f096c148090 2024-09-15T23:15:42.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.401+0000 7f096affd640 1 --2- 172.21.15.123:0/650718647 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f096c0731e0 0x7f096c144df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:42.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.401+0000 7f096bfff640 1 --2- 172.21.15.123:0/650718647 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f096c148090 0x7f096c1415a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f096400c760 tx=0x7f096400cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:42.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.401+0000 7f0953fff640 1 -- 172.21.15.123:0/650718647 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0964016020 con 0x7f096c148090 2024-09-15T23:15:42.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.401+0000 7f0953fff640 1 -- 172.21.15.123:0/650718647 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0964006d50 con 0x7f096c148090 2024-09-15T23:15:42.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.401+0000 7f0971b98640 1 -- 172.21.15.123:0/650718647 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f096c142db0 con 0x7f096c148090 2024-09-15T23:15:42.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.401+0000 7f0953fff640 1 -- 172.21.15.123:0/650718647 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0964003bb0 con 0x7f096c148090 2024-09-15T23:15:42.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.401+0000 7f0971b98640 1 -- 172.21.15.123:0/650718647 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f096c143370 con 0x7f096c148090 2024-09-15T23:15:42.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.402+0000 7f0971b98640 1 -- 172.21.15.123:0/650718647 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f096c06bc10 con 0x7f096c148090 2024-09-15T23:15:42.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.402+0000 7f0953fff640 1 -- 172.21.15.123:0/650718647 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f09640050d0 con 0x7f096c148090 2024-09-15T23:15:42.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.403+0000 7f0953fff640 1 --2- 172.21.15.123:0/650718647 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f095806c2e0 0x7f095806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:42.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.403+0000 7f0953fff640 1 -- 172.21.15.123:0/650718647 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5881+0+0 (secure 0 0 0) 0x7f096408af70 con 0x7f096c148090 2024-09-15T23:15:42.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.403+0000 7f096b7fe640 1 --2- 172.21.15.123:0/650718647 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f095806c2e0 0x7f095806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:42.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.403+0000 7f096b7fe640 1 --2- 172.21.15.123:0/650718647 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f095806c2e0 0x7f095806e7a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f095c034000 tx=0x7f095c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:42.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.407+0000 7f0953fff640 1 -- 172.21.15.123:0/650718647 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0964020020 con 0x7f096c148090 2024-09-15T23:15:42.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.611+0000 7f0971b98640 1 -- 172.21.15.123:0/650718647 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f096c0b6ac0 con 0x7f096c148090 2024-09-15T23:15:42.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.612+0000 7f0953fff640 1 -- 172.21.15.123:0/650718647 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5230 (secure 0 0 0) 0x7f09640596c0 con 0x7f096c148090 2024-09-15T23:15:42.613 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:42.613 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":38,"btime":"2024-09-15T23:15:32:678232+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5483,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/522636413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":522636413},{"type":"v1","addr":"172.21.15.188:6835","nonce":522636413}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5860,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/3057173907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":3057173907},{"type":"v1","addr":"172.21.15.188:6837","nonce":3057173907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6399,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/811728648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":811728648},{"type":"v1","addr":"172.21.15.123:6833","nonce":811728648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:15:17.752297+0000","modified":"2024-09-15T23:15:32.678225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6411":{"gid":6411,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6835/3634063333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3634063333},{"type":"v1","addr":"172.21.15.123:6835","nonce":3634063333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6411,"qdb_cluster":[6411]},"id":4}]} 2024-09-15T23:15:42.613 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 38 2024-09-15T23:15:42.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.614+0000 7f0971b98640 1 -- 172.21.15.123:0/650718647 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f095806c2e0 msgr2=0x7f095806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:42.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.614+0000 7f0971b98640 1 --2- 172.21.15.123:0/650718647 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f095806c2e0 0x7f095806e7a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f095c034000 tx=0x7f095c02e000 comp rx=0 tx=0).stop 2024-09-15T23:15:42.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.614+0000 7f0971b98640 1 -- 172.21.15.123:0/650718647 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f096c148090 msgr2=0x7f096c1415a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:42.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.614+0000 7f0971b98640 1 --2- 172.21.15.123:0/650718647 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f096c148090 0x7f096c1415a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f096400c760 tx=0x7f096400cb60 comp rx=0 tx=0).stop 2024-09-15T23:15:42.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.614+0000 7f0971b98640 1 -- 172.21.15.123:0/650718647 shutdown_connections 2024-09-15T23:15:42.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.614+0000 7f0971b98640 1 --2- 172.21.15.123:0/650718647 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f095806c2e0 0x7f095806e7a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:42.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.614+0000 7f0971b98640 1 --2- 172.21.15.123:0/650718647 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f096c148090 0x7f096c1415a0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:42.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.614+0000 7f0971b98640 1 --2- 172.21.15.123:0/650718647 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f096c0731e0 0x7f096c144df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:42.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.614+0000 7f0971b98640 1 --2- 172.21.15.123:0/650718647 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f096c06c150 0x7f096c13f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:42.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.614+0000 7f0971b98640 1 -- 172.21.15.123:0/650718647 >> 172.21.15.123:0/650718647 conn(0x7f096c06cd20 msgr2=0x7f096c0b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:42.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.614+0000 7f0971b98640 1 -- 172.21.15.123:0/650718647 shutdown_connections 2024-09-15T23:15:42.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.614+0000 7f0971b98640 1 -- 172.21.15.123:0/650718647 wait complete. 2024-09-15T23:15:42.626 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:15:42.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.723+0000 7f95e76a5640 1 Processor -- start 2024-09-15T23:15:42.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.723+0000 7f95e76a5640 1 -- start start 2024-09-15T23:15:42.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.724+0000 7f95e76a5640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f95e01447b0 0x7f95e00b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:42.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.724+0000 7f95e76a5640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f95e00b5bd0 0x7f95e00b6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:42.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.724+0000 7f95e76a5640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95e0144b90 con 0x7f95e006f7a0 2024-09-15T23:15:42.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.724+0000 7f95e76a5640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f95e00b6580 con 0x7f95e00b5bd0 2024-09-15T23:15:42.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.724+0000 7f95e76a5640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f95e00b3eb0 con 0x7f95e01447b0 2024-09-15T23:15:42.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.724+0000 7f95e5c42640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f95e00b5bd0 0x7f95e00b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:42.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.724+0000 7f95e4c40640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f95e006f7a0 0x7f95e015bbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:46280/0 (socket says 172.21.15.123:46280) 2024-09-15T23:15:42.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.724+0000 7f95e4c40640 1 -- 172.21.15.123:0/4164042014 learned_addr learned my addr 172.21.15.123:0/4164042014 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:42.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.724+0000 7f95e5c42640 1 -- 172.21.15.123:0/4164042014 >> v2:172.21.15.188:3300/0 conn(0x7f95e01447b0 msgr2=0x7f95e00b4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:42.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.724+0000 7f95e5441640 1 --2- 172.21.15.123:0/4164042014 >> v2:172.21.15.188:3300/0 conn(0x7f95e01447b0 0x7f95e00b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:42.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.724+0000 7f95dffff640 1 -- 172.21.15.123:0/4164042014 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 724645388 0 0) 0x7f95e0144b90 con 0x7f95e006f7a0 2024-09-15T23:15:42.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.724+0000 7f95e5c42640 1 --2- 172.21.15.123:0/4164042014 >> v2:172.21.15.188:3300/0 conn(0x7f95e01447b0 0x7f95e00b4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:42.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.724+0000 7f95e5c42640 1 -- 172.21.15.123:0/4164042014 >> v1:172.21.15.123:6789/0 conn(0x7f95e006f7a0 legacy=0x7f95e015bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:42.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.724+0000 7f95e5c42640 1 -- 172.21.15.123:0/4164042014 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e00b4190 con 0x7f95e00b5bd0 2024-09-15T23:15:42.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.724+0000 7f95e5441640 1 --2- 172.21.15.123:0/4164042014 >> v2:172.21.15.188:3300/0 conn(0x7f95e01447b0 0x7f95e00b4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:42.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.725+0000 7f95e5c42640 1 --2- 172.21.15.123:0/4164042014 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95e00b5bd0 0x7f95e00b6040 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f95e0074240 tx=0x7f95d802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e7da5b59c2076ba server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:42.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.725+0000 7f95dffff640 1 -- 172.21.15.123:0/4164042014 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d8037070 con 0x7f95e00b5bd0 2024-09-15T23:15:42.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.725+0000 7f95dffff640 1 -- 172.21.15.123:0/4164042014 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95d8032440 con 0x7f95e00b5bd0 2024-09-15T23:15:42.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.725+0000 7f95dffff640 1 -- 172.21.15.123:0/4164042014 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d802ae60 con 0x7f95e00b5bd0 2024-09-15T23:15:42.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.725+0000 7f95e76a5640 1 -- 172.21.15.123:0/4164042014 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95e00b5bd0 msgr2=0x7f95e00b6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:42.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.725+0000 7f95e76a5640 1 --2- 172.21.15.123:0/4164042014 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95e00b5bd0 0x7f95e00b6040 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f95e0074240 tx=0x7f95d802a110 comp rx=0 tx=0).stop 2024-09-15T23:15:42.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.726+0000 7f95e76a5640 1 -- 172.21.15.123:0/4164042014 shutdown_connections 2024-09-15T23:15:42.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.726+0000 7f95e76a5640 1 --2- 172.21.15.123:0/4164042014 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95e00b5bd0 0x7f95e00b6040 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:42.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.726+0000 7f95e76a5640 1 --2- 172.21.15.123:0/4164042014 >> v2:172.21.15.188:3300/0 conn(0x7f95e01447b0 0x7f95e00b4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:42.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.726+0000 7f95e76a5640 1 -- 172.21.15.123:0/4164042014 >> 172.21.15.123:0/4164042014 conn(0x7f95e00b0a80 msgr2=0x7f95e00b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:42.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.726+0000 7f95e76a5640 1 -- 172.21.15.123:0/4164042014 shutdown_connections 2024-09-15T23:15:42.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.726+0000 7f95e76a5640 1 -- 172.21.15.123:0/4164042014 wait complete. 2024-09-15T23:15:42.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.727+0000 7f95e76a5640 1 Processor -- start 2024-09-15T23:15:42.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.727+0000 7f95e76a5640 1 -- start start 2024-09-15T23:15:42.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.728+0000 7f95e76a5640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f95e006f7a0 0x7f95e01f0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:42.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.728+0000 7f95e76a5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95e00b5bd0 0x7f95e00ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:42.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.728+0000 7f95e76a5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95e01447b0 0x7f95e01f34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:42.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.728+0000 7f95e76a5640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f95e006fd40 con 0x7f95e00b5bd0 2024-09-15T23:15:42.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.728+0000 7f95e76a5640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f95e00b4750 con 0x7f95e01447b0 2024-09-15T23:15:42.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.728+0000 7f95e76a5640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f95e0067950 con 0x7f95e006f7a0 2024-09-15T23:15:42.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.728+0000 7f95e4c40640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95e00b5bd0 0x7f95e00ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:42.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.728+0000 7f95e4c40640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95e00b5bd0 0x7f95e00ad110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40412/0 (socket says 172.21.15.123:40412) 2024-09-15T23:15:42.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.728+0000 7f95e4c40640 1 -- 172.21.15.123:0/2337521196 learned_addr learned my addr 172.21.15.123:0/2337521196 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:42.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.728+0000 7f95e5441640 1 --2- 172.21.15.123:0/2337521196 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f95e006f7a0 0x7f95e01f0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:42.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.728+0000 7f95e4c40640 1 -- 172.21.15.123:0/2337521196 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f95e006f7a0 msgr2=0x7f95e01f0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:42.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.728+0000 7f95e4c40640 1 --2- 172.21.15.123:0/2337521196 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f95e006f7a0 0x7f95e01f0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:42.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.728+0000 7f95e4c40640 1 -- 172.21.15.123:0/2337521196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95e01447b0 msgr2=0x7f95e01f34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:42.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.728+0000 7f95e4c40640 1 --2- 172.21.15.123:0/2337521196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95e01447b0 0x7f95e01f34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:42.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.728+0000 7f95e4c40640 1 -- 172.21.15.123:0/2337521196 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e01f0e60 con 0x7f95e00b5bd0 2024-09-15T23:15:42.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.728+0000 7f95e5441640 1 --2- 172.21.15.123:0/2337521196 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f95e006f7a0 0x7f95e01f0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:42.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.728+0000 7f95e4c40640 1 --2- 172.21.15.123:0/2337521196 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95e00b5bd0 0x7f95e00ad110 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f95d400c500 tx=0x7f95d400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:42.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.728+0000 7f95ddffb640 1 -- 172.21.15.123:0/2337521196 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d4018070 con 0x7f95e00b5bd0 2024-09-15T23:15:42.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.728+0000 7f95ddffb640 1 -- 172.21.15.123:0/2337521196 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95d4007580 con 0x7f95e00b5bd0 2024-09-15T23:15:42.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.728+0000 7f95e76a5640 1 -- 172.21.15.123:0/2337521196 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95e01f0240 con 0x7f95e00b5bd0 2024-09-15T23:15:42.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.728+0000 7f95ddffb640 1 -- 172.21.15.123:0/2337521196 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d4004a20 con 0x7f95e00b5bd0 2024-09-15T23:15:42.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.728+0000 7f95e76a5640 1 -- 172.21.15.123:0/2337521196 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95e01f4330 con 0x7f95e00b5bd0 2024-09-15T23:15:42.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.730+0000 7f95e76a5640 1 -- 172.21.15.123:0/2337521196 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95e0067d10 con 0x7f95e00b5bd0 2024-09-15T23:15:42.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.730+0000 7f95ddffb640 1 -- 172.21.15.123:0/2337521196 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f95d401b070 con 0x7f95e00b5bd0 2024-09-15T23:15:42.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.730+0000 7f95ddffb640 1 --2- 172.21.15.123:0/2337521196 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f95cc06c2b0 0x7f95cc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:42.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.730+0000 7f95ddffb640 1 -- 172.21.15.123:0/2337521196 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5881+0+0 (secure 0 0 0) 0x7f95d408a750 con 0x7f95e00b5bd0 2024-09-15T23:15:42.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.730+0000 7f95e5441640 1 --2- 172.21.15.123:0/2337521196 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f95cc06c2b0 0x7f95cc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:42.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.731+0000 7f95e5441640 1 --2- 172.21.15.123:0/2337521196 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f95cc06c2b0 0x7f95cc06e770 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f95d000e3d0 tx=0x7f95d0007a10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:42.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.734+0000 7f95ddffb640 1 -- 172.21.15.123:0/2337521196 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f95d4058ea0 con 0x7f95e00b5bd0 2024-09-15T23:15:42.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.933+0000 7f95e76a5640 1 -- 172.21.15.123:0/2337521196 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f95e00b4db0 con 0x7f95e00b5bd0 2024-09-15T23:15:42.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.933+0000 7f95ddffb640 1 -- 172.21.15.123:0/2337521196 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5230 (secure 0 0 0) 0x7f95d40587a0 con 0x7f95e00b5bd0 2024-09-15T23:15:42.934 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:42.934 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":38,"btime":"2024-09-15T23:15:32:678232+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5483,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/522636413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":522636413},{"type":"v1","addr":"172.21.15.188:6835","nonce":522636413}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5860,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/3057173907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":3057173907},{"type":"v1","addr":"172.21.15.188:6837","nonce":3057173907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6399,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/811728648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":811728648},{"type":"v1","addr":"172.21.15.123:6833","nonce":811728648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:15:17.752297+0000","modified":"2024-09-15T23:15:32.678225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":70,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6411},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6411":{"gid":6411,"name":"a","rank":0,"incarnation":35,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6835/3634063333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3634063333},{"type":"v1","addr":"172.21.15.123:6835","nonce":3634063333}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6411,"qdb_cluster":[6411]},"id":4}]} 2024-09-15T23:15:42.935 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 38 2024-09-15T23:15:42.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.935+0000 7f95e76a5640 1 -- 172.21.15.123:0/2337521196 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f95cc06c2b0 msgr2=0x7f95cc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:42.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.935+0000 7f95e76a5640 1 --2- 172.21.15.123:0/2337521196 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f95cc06c2b0 0x7f95cc06e770 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f95d000e3d0 tx=0x7f95d0007a10 comp rx=0 tx=0).stop 2024-09-15T23:15:42.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.935+0000 7f95e76a5640 1 -- 172.21.15.123:0/2337521196 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95e00b5bd0 msgr2=0x7f95e00ad110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:42.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.935+0000 7f95e76a5640 1 --2- 172.21.15.123:0/2337521196 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95e00b5bd0 0x7f95e00ad110 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f95d400c500 tx=0x7f95d400c9c0 comp rx=0 tx=0).stop 2024-09-15T23:15:42.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.935+0000 7f95e76a5640 1 -- 172.21.15.123:0/2337521196 shutdown_connections 2024-09-15T23:15:42.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.935+0000 7f95e76a5640 1 --2- 172.21.15.123:0/2337521196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95e01447b0 0x7f95e01f34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:42.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.935+0000 7f95e76a5640 1 --2- 172.21.15.123:0/2337521196 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f95cc06c2b0 0x7f95cc06e770 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:42.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.935+0000 7f95e76a5640 1 --2- 172.21.15.123:0/2337521196 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95e00b5bd0 0x7f95e00ad110 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:42.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.935+0000 7f95e76a5640 1 --2- 172.21.15.123:0/2337521196 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f95e006f7a0 0x7f95e01f0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:42.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.935+0000 7f95e76a5640 1 -- 172.21.15.123:0/2337521196 >> 172.21.15.123:0/2337521196 conn(0x7f95e00b0a80 msgr2=0x7f95e0143940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:42.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.935+0000 7f95e76a5640 1 -- 172.21.15.123:0/2337521196 shutdown_connections 2024-09-15T23:15:42.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:42.935+0000 7f95e76a5640 1 -- 172.21.15.123:0/2337521196 wait complete. 2024-09-15T23:15:42.947 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:15:43.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.044+0000 7f1ee5b78640 1 Processor -- start 2024-09-15T23:15:43.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.044+0000 7f1ee5b78640 1 -- start start 2024-09-15T23:15:43.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.045+0000 7f1ee5b78640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1ee015ab40 0x7f1ee006c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:43.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.045+0000 7f1ee5b78640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1ee00720b0 0x7f1ee0073990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:43.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.045+0000 7f1ee5b78640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ee0072520 con 0x7f1ee015af20 2024-09-15T23:15:43.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.045+0000 7f1ee5b78640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f1ee0071010 con 0x7f1ee00720b0 2024-09-15T23:15:43.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.045+0000 7f1ee5b78640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f1ee00712f0 con 0x7f1ee015ab40 2024-09-15T23:15:43.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.045+0000 7f1edeffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1ee00720b0 0x7f1ee0073990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:43.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.045+0000 7f1edeffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1ee00720b0 0x7f1ee0073990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40428/0 (socket says 172.21.15.123:40428) 2024-09-15T23:15:43.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.045+0000 7f1edeffd640 1 -- 172.21.15.123:0/4101824157 learned_addr learned my addr 172.21.15.123:0/4101824157 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:43.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.045+0000 7f1edf7fe640 1 --2- 172.21.15.123:0/4101824157 >> v2:172.21.15.188:3300/0 conn(0x7f1ee015ab40 0x7f1ee006c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:43.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.045+0000 7f1edeffd640 1 -- 172.21.15.123:0/4101824157 >> v2:172.21.15.188:3300/0 conn(0x7f1ee015ab40 msgr2=0x7f1ee006c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:43.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.045+0000 7f1edeffd640 1 --2- 172.21.15.123:0/4101824157 >> v2:172.21.15.188:3300/0 conn(0x7f1ee015ab40 0x7f1ee006c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:43.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.045+0000 7f1edeffd640 1 -- 172.21.15.123:0/4101824157 >> v1:172.21.15.188:6789/0 conn(0x7f1ee015af20 legacy=0x7f1ee015b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:43.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.045+0000 7f1edeffd640 1 -- 172.21.15.123:0/4101824157 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee00715d0 con 0x7f1ee00720b0 2024-09-15T23:15:43.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.045+0000 7f1edf7fe640 1 --2- 172.21.15.123:0/4101824157 >> v2:172.21.15.188:3300/0 conn(0x7f1ee015ab40 0x7f1ee006c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:43.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.046+0000 7f1edeffd640 1 --2- 172.21.15.123:0/4101824157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ee00720b0 0x7f1ee0073990 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f1ee00d1500 tx=0x7f1ed402c620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc90174eddc19a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:43.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.046+0000 7f1ede7fc640 1 -- 172.21.15.123:0/4101824157 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed403a070 con 0x7f1ee00720b0 2024-09-15T23:15:43.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.046+0000 7f1ede7fc640 1 -- 172.21.15.123:0/4101824157 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ed4032480 con 0x7f1ee00720b0 2024-09-15T23:15:43.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.046+0000 7f1ede7fc640 1 -- 172.21.15.123:0/4101824157 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed4032650 con 0x7f1ee00720b0 2024-09-15T23:15:43.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.047+0000 7f1ee5b78640 1 -- 172.21.15.123:0/4101824157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ee00720b0 msgr2=0x7f1ee0073990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:43.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.047+0000 7f1ee5b78640 1 --2- 172.21.15.123:0/4101824157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ee00720b0 0x7f1ee0073990 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f1ee00d1500 tx=0x7f1ed402c620 comp rx=0 tx=0).stop 2024-09-15T23:15:43.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.047+0000 7f1ee5b78640 1 -- 172.21.15.123:0/4101824157 shutdown_connections 2024-09-15T23:15:43.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.047+0000 7f1ee5b78640 1 --2- 172.21.15.123:0/4101824157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ee00720b0 0x7f1ee0073990 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:43.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.047+0000 7f1ee5b78640 1 --2- 172.21.15.123:0/4101824157 >> v2:172.21.15.188:3300/0 conn(0x7f1ee015ab40 0x7f1ee006c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:43.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.047+0000 7f1ee5b78640 1 -- 172.21.15.123:0/4101824157 >> 172.21.15.123:0/4101824157 conn(0x7f1ee00ccec0 msgr2=0x7f1ee00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:43.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.047+0000 7f1ee5b78640 1 -- 172.21.15.123:0/4101824157 shutdown_connections 2024-09-15T23:15:43.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.047+0000 7f1ee5b78640 1 -- 172.21.15.123:0/4101824157 wait complete. 2024-09-15T23:15:43.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.048+0000 7f1ee5b78640 1 Processor -- start 2024-09-15T23:15:43.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.048+0000 7f1ee5b78640 1 -- start start 2024-09-15T23:15:43.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.049+0000 7f1ee5b78640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1ee00720b0 0x7f1ee01f0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:43.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.049+0000 7f1ee5b78640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1ee015ab40 0x7f1ee00c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:43.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.049+0000 7f1ee5b78640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ee015af20 0x7f1ee0148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:43.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.049+0000 7f1ee5b78640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee0073ed0 con 0x7f1ee015af20 2024-09-15T23:15:43.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.049+0000 7f1ee5b78640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee015ba80 con 0x7f1ee00720b0 2024-09-15T23:15:43.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.049+0000 7f1ee5b78640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1ee006bc10 con 0x7f1ee015ab40 2024-09-15T23:15:43.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.049+0000 7f1edffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ee015af20 0x7f1ee0148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:43.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.049+0000 7f1edffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ee015af20 0x7f1ee0148ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40442/0 (socket says 172.21.15.123:40442) 2024-09-15T23:15:43.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.049+0000 7f1edffff640 1 -- 172.21.15.123:0/1439010952 learned_addr learned my addr 172.21.15.123:0/1439010952 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:43.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.049+0000 7f1edf7fe640 1 --2- 172.21.15.123:0/1439010952 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1ee00720b0 0x7f1ee01f0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:43.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.049+0000 7f1edeffd640 1 --2- 172.21.15.123:0/1439010952 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1ee015ab40 0x7f1ee00c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:43.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.049+0000 7f1edffff640 1 -- 172.21.15.123:0/1439010952 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1ee015ab40 msgr2=0x7f1ee00c6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:43.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.049+0000 7f1edffff640 1 --2- 172.21.15.123:0/1439010952 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1ee015ab40 0x7f1ee00c6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:43.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.049+0000 7f1edffff640 1 -- 172.21.15.123:0/1439010952 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1ee00720b0 msgr2=0x7f1ee01f0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:43.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.049+0000 7f1edffff640 1 --2- 172.21.15.123:0/1439010952 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1ee00720b0 0x7f1ee01f0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:43.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.049+0000 7f1edffff640 1 -- 172.21.15.123:0/1439010952 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee00c75b0 con 0x7f1ee015af20 2024-09-15T23:15:43.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.049+0000 7f1edffff640 1 --2- 172.21.15.123:0/1439010952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ee015af20 0x7f1ee0148ee0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f1ed800b990 tx=0x7f1ed800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:43.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.049+0000 7f1ec7fff640 1 -- 172.21.15.123:0/1439010952 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed8019070 con 0x7f1ee015af20 2024-09-15T23:15:43.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.049+0000 7f1ec7fff640 1 -- 172.21.15.123:0/1439010952 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ed800cba0 con 0x7f1ee015af20 2024-09-15T23:15:43.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.049+0000 7f1ec7fff640 1 -- 172.21.15.123:0/1439010952 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed8014440 con 0x7f1ee015af20 2024-09-15T23:15:43.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.049+0000 7f1ee5b78640 1 -- 172.21.15.123:0/1439010952 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ee00c7890 con 0x7f1ee015af20 2024-09-15T23:15:43.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.050+0000 7f1ee5b78640 1 -- 172.21.15.123:0/1439010952 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ee00c7e50 con 0x7f1ee015af20 2024-09-15T23:15:43.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.050+0000 7f1ee5b78640 1 -- 172.21.15.123:0/1439010952 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ee006c790 con 0x7f1ee015af20 2024-09-15T23:15:43.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.051+0000 7f1ec7fff640 1 -- 172.21.15.123:0/1439010952 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1ed801c070 con 0x7f1ee015af20 2024-09-15T23:15:43.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.051+0000 7f1ec7fff640 1 --2- 172.21.15.123:0/1439010952 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1ecc06c2b0 0x7f1ecc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:43.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.052+0000 7f1ec7fff640 1 -- 172.21.15.123:0/1439010952 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5881+0+0 (secure 0 0 0) 0x7f1ed808b1d0 con 0x7f1ee015af20 2024-09-15T23:15:43.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.052+0000 7f1edf7fe640 1 --2- 172.21.15.123:0/1439010952 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1ecc06c2b0 0x7f1ecc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:43.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.052+0000 7f1edf7fe640 1 --2- 172.21.15.123:0/1439010952 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1ecc06c2b0 0x7f1ecc06e770 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1ed000ab60 tx=0x7f1ed0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:43.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.056+0000 7f1ec7fff640 1 -- 172.21.15.123:0/1439010952 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1ed8059240 con 0x7f1ee015af20 2024-09-15T23:15:43.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.223+0000 7f1ee5b78640 1 -- 172.21.15.123:0/1439010952 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ee00b3d10 con 0x7f1ee015af20 2024-09-15T23:15:43.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.224+0000 7f1ec7fff640 1 -- 172.21.15.123:0/1439010952 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+17012 (secure 0 0 0) 0x7f1ed805d540 con 0x7f1ee015af20 2024-09-15T23:15:43.225 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:43.225 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":70,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:15:29.652228+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:15:16.362912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-15T23:15:16.718663+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.188:6837/3452580408":"2024-09-16T23:15:29.652204+0000","172.21.15.188:6835/3452580408":"2024-09-16T23:15:29.652204+0000","172.21.15.123:6835/2772280632":"2024-09-16T23:15:28.658500+0000","172.21.15.123:6833/2772280632":"2024-09-16T23:15:28.658500+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:15:43.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.226+0000 7f1ee5b78640 1 -- 172.21.15.123:0/1439010952 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1ecc06c2b0 msgr2=0x7f1ecc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:43.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.226+0000 7f1ee5b78640 1 --2- 172.21.15.123:0/1439010952 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1ecc06c2b0 0x7f1ecc06e770 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1ed000ab60 tx=0x7f1ed0008040 comp rx=0 tx=0).stop 2024-09-15T23:15:43.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.226+0000 7f1ee5b78640 1 -- 172.21.15.123:0/1439010952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ee015af20 msgr2=0x7f1ee0148ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:43.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.226+0000 7f1ee5b78640 1 --2- 172.21.15.123:0/1439010952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ee015af20 0x7f1ee0148ee0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f1ed800b990 tx=0x7f1ed800be50 comp rx=0 tx=0).stop 2024-09-15T23:15:43.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.226+0000 7f1ee5b78640 1 -- 172.21.15.123:0/1439010952 shutdown_connections 2024-09-15T23:15:43.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.226+0000 7f1ee5b78640 1 --2- 172.21.15.123:0/1439010952 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1ecc06c2b0 0x7f1ecc06e770 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:43.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.226+0000 7f1ee5b78640 1 --2- 172.21.15.123:0/1439010952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ee015af20 0x7f1ee0148ee0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:43.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.226+0000 7f1ee5b78640 1 --2- 172.21.15.123:0/1439010952 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1ee015ab40 0x7f1ee00c6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:43.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.226+0000 7f1ee5b78640 1 --2- 172.21.15.123:0/1439010952 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1ee00720b0 0x7f1ee01f0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:43.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.226+0000 7f1ee5b78640 1 -- 172.21.15.123:0/1439010952 >> 172.21.15.123:0/1439010952 conn(0x7f1ee00ccec0 msgr2=0x7f1ee0159a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:43.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.226+0000 7f1ee5b78640 1 -- 172.21.15.123:0/1439010952 shutdown_connections 2024-09-15T23:15:43.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.226+0000 7f1ee5b78640 1 -- 172.21.15.123:0/1439010952 wait complete. 2024-09-15T23:15:43.238 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T23:15:43.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.335+0000 7f59c90d2640 1 Processor -- start 2024-09-15T23:15:43.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.335+0000 7f59c90d2640 1 -- start start 2024-09-15T23:15:43.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.336+0000 7f59c90d2640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f59c413eb20 0x7f59c415c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:43.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.336+0000 7f59c90d2640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59c4071180 con 0x7f59c40b2d40 2024-09-15T23:15:43.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.336+0000 7f59c90d2640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59c4071460 con 0x7f59c406c320 2024-09-15T23:15:43.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.336+0000 7f59c90d2640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f59c4071ab0 con 0x7f59c413eb20 2024-09-15T23:15:43.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.336+0000 7f59c359e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f59c413eb20 0x7f59c415c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:43.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.336+0000 7f59c359e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f59c413eb20 0x7f59c415c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40448/0 (socket says 172.21.15.123:40448) 2024-09-15T23:15:43.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.336+0000 7f59c359e640 1 -- 172.21.15.123:0/1766304258 learned_addr learned my addr 172.21.15.123:0/1766304258 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:43.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.336+0000 7f59c359e640 1 -- 172.21.15.123:0/1766304258 >> v1:172.21.15.188:6789/0 conn(0x7f59c406c320 legacy=0x7f59c415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:43.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.336+0000 7f59c359e640 1 -- 172.21.15.123:0/1766304258 >> v1:172.21.15.123:6789/0 conn(0x7f59c40b2d40 legacy=0x7f59c406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:43.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.336+0000 7f59c359e640 1 -- 172.21.15.123:0/1766304258 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c4071740 con 0x7f59c413eb20 2024-09-15T23:15:43.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.337+0000 7f59c359e640 1 --2- 172.21.15.123:0/1766304258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59c413eb20 0x7f59c415c400 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00d150 tx=0x7f59bc02c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7c1fbce61f14577 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:43.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.337+0000 7f59c259c640 1 -- 172.21.15.123:0/1766304258 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc009600 con 0x7f59c413eb20 2024-09-15T23:15:43.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.337+0000 7f59c259c640 1 -- 172.21.15.123:0/1766304258 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59bc037070 con 0x7f59c413eb20 2024-09-15T23:15:43.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.337+0000 7f59c259c640 1 -- 172.21.15.123:0/1766304258 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc0099c0 con 0x7f59c413eb20 2024-09-15T23:15:43.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.337+0000 7f59c90d2640 1 -- 172.21.15.123:0/1766304258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59c413eb20 msgr2=0x7f59c415c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:43.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.337+0000 7f59c90d2640 1 --2- 172.21.15.123:0/1766304258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59c413eb20 0x7f59c415c400 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00d150 tx=0x7f59bc02c970 comp rx=0 tx=0).stop 2024-09-15T23:15:43.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.338+0000 7f59c90d2640 1 -- 172.21.15.123:0/1766304258 shutdown_connections 2024-09-15T23:15:43.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.338+0000 7f59c90d2640 1 --2- 172.21.15.123:0/1766304258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59c413eb20 0x7f59c415c400 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:43.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.338+0000 7f59c90d2640 1 -- 172.21.15.123:0/1766304258 >> 172.21.15.123:0/1766304258 conn(0x7f59c40ccec0 msgr2=0x7f59c40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:43.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.338+0000 7f59c90d2640 1 -- 172.21.15.123:0/1766304258 shutdown_connections 2024-09-15T23:15:43.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.338+0000 7f59c90d2640 1 -- 172.21.15.123:0/1766304258 wait complete. 2024-09-15T23:15:43.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.339+0000 7f59c90d2640 1 Processor -- start 2024-09-15T23:15:43.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.339+0000 7f59c90d2640 1 -- start start 2024-09-15T23:15:43.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.340+0000 7f59c90d2640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f59c406c320 0x7f59c41439a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:43.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.340+0000 7f59c90d2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f59c40b2d40 0x7f59c4154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:43.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.340+0000 7f59c90d2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59c413eb20 0x7f59c4144210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:43.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.340+0000 7f59c90d2640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f59c40b3980 con 0x7f59c413eb20 2024-09-15T23:15:43.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.340+0000 7f59c90d2640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f59c40b3800 con 0x7f59c40b2d40 2024-09-15T23:15:43.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.340+0000 7f59c90d2640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f59c40b3b00 con 0x7f59c406c320 2024-09-15T23:15:43.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.340+0000 7f59c359e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59c413eb20 0x7f59c4144210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:43.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.340+0000 7f59c359e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59c413eb20 0x7f59c4144210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40462/0 (socket says 172.21.15.123:40462) 2024-09-15T23:15:43.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.340+0000 7f59c359e640 1 -- 172.21.15.123:0/3637264205 learned_addr learned my addr 172.21.15.123:0/3637264205 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:43.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.340+0000 7f59bbfff640 1 --2- 172.21.15.123:0/3637264205 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f59c40b2d40 0x7f59c4154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:43.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.340+0000 7f59c2d9d640 1 --2- 172.21.15.123:0/3637264205 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f59c406c320 0x7f59c41439a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:43.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.340+0000 7f59c359e640 1 -- 172.21.15.123:0/3637264205 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f59c406c320 msgr2=0x7f59c41439a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:43.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.340+0000 7f59c359e640 1 --2- 172.21.15.123:0/3637264205 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f59c406c320 0x7f59c41439a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:43.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.340+0000 7f59c359e640 1 -- 172.21.15.123:0/3637264205 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f59c40b2d40 msgr2=0x7f59c4154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:43.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.340+0000 7f59c359e640 1 --2- 172.21.15.123:0/3637264205 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f59c40b2d40 0x7f59c4154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:43.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.340+0000 7f59c359e640 1 -- 172.21.15.123:0/3637264205 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c4142900 con 0x7f59c413eb20 2024-09-15T23:15:43.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.340+0000 7f59bbfff640 1 --2- 172.21.15.123:0/3637264205 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f59c40b2d40 0x7f59c4154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:43.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.340+0000 7f59c359e640 1 --2- 172.21.15.123:0/3637264205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59c413eb20 0x7f59c4144210 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00d270 tx=0x7f59bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:43.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.340+0000 7f59bb7fe640 1 -- 172.21.15.123:0/3637264205 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc009dc0 con 0x7f59c413eb20 2024-09-15T23:15:43.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.340+0000 7f59bb7fe640 1 -- 172.21.15.123:0/3637264205 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59bc032420 con 0x7f59c413eb20 2024-09-15T23:15:43.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.340+0000 7f59c90d2640 1 -- 172.21.15.123:0/3637264205 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59c4142be0 con 0x7f59c413eb20 2024-09-15T23:15:43.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.340+0000 7f59bb7fe640 1 -- 172.21.15.123:0/3637264205 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc032810 con 0x7f59c413eb20 2024-09-15T23:15:43.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.341+0000 7f59c90d2640 1 -- 172.21.15.123:0/3637264205 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59c41431a0 con 0x7f59c413eb20 2024-09-15T23:15:43.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.341+0000 7f59c90d2640 1 -- 172.21.15.123:0/3637264205 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59c406bc10 con 0x7f59c413eb20 2024-09-15T23:15:43.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.342+0000 7f59bb7fe640 1 -- 172.21.15.123:0/3637264205 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f59bc0329b0 con 0x7f59c413eb20 2024-09-15T23:15:43.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.342+0000 7f59bb7fe640 1 --2- 172.21.15.123:0/3637264205 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f59a406c2b0 0x7f59a406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:43.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.342+0000 7f59bb7fe640 1 -- 172.21.15.123:0/3637264205 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5881+0+0 (secure 0 0 0) 0x7f59bc0ac630 con 0x7f59c413eb20 2024-09-15T23:15:43.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.343+0000 7f59c2d9d640 1 --2- 172.21.15.123:0/3637264205 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f59a406c2b0 0x7f59a406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:43.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.343+0000 7f59c2d9d640 1 --2- 172.21.15.123:0/3637264205 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f59a406c2b0 0x7f59a406e770 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f59b4001640 tx=0x7f59b4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:43.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.347+0000 7f59bb7fe640 1 -- 172.21.15.123:0/3637264205 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f59bc07ac60 con 0x7f59c413eb20 2024-09-15T23:15:43.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.548+0000 7f59c90d2640 1 -- 172.21.15.123:0/3637264205 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f59c40b56f0 con 0x7f59c413eb20 2024-09-15T23:15:43.550 INFO:tasks.ceph.mon.a.smithi123.stderr:2024-09-15T23:15:43.549+0000 7f8a6ccf0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:15:43.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.551+0000 7f59bb7fe640 1 -- 172.21.15.123:0/3637264205 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v39) ==== 161+0+0 (secure 0 0 0) 0x7f59bc07a560 con 0x7f59c413eb20 2024-09-15T23:15:43.552 INFO:teuthology.orchestra.run.smithi123.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T23:15:43.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.554+0000 7f59c90d2640 1 -- 172.21.15.123:0/3637264205 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f59a406c2b0 msgr2=0x7f59a406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:43.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.554+0000 7f59c90d2640 1 --2- 172.21.15.123:0/3637264205 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f59a406c2b0 0x7f59a406e770 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f59b4001640 tx=0x7f59b4009040 comp rx=0 tx=0).stop 2024-09-15T23:15:43.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.554+0000 7f59c90d2640 1 -- 172.21.15.123:0/3637264205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59c413eb20 msgr2=0x7f59c4144210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:43.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.554+0000 7f59c90d2640 1 --2- 172.21.15.123:0/3637264205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59c413eb20 0x7f59c4144210 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00d270 tx=0x7f59bc004a40 comp rx=0 tx=0).stop 2024-09-15T23:15:43.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.554+0000 7f59c90d2640 1 -- 172.21.15.123:0/3637264205 shutdown_connections 2024-09-15T23:15:43.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.554+0000 7f59c90d2640 1 --2- 172.21.15.123:0/3637264205 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f59a406c2b0 0x7f59a406e770 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:43.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.554+0000 7f59c90d2640 1 --2- 172.21.15.123:0/3637264205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59c413eb20 0x7f59c4144210 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:43.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.554+0000 7f59c90d2640 1 --2- 172.21.15.123:0/3637264205 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f59c40b2d40 0x7f59c4154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:43.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.554+0000 7f59c90d2640 1 --2- 172.21.15.123:0/3637264205 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f59c406c320 0x7f59c41439a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:43.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.554+0000 7f59c90d2640 1 -- 172.21.15.123:0/3637264205 >> 172.21.15.123:0/3637264205 conn(0x7f59c40ccec0 msgr2=0x7f59c41409d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:43.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.554+0000 7f59c90d2640 1 -- 172.21.15.123:0/3637264205 shutdown_connections 2024-09-15T23:15:43.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.554+0000 7f59c90d2640 1 -- 172.21.15.123:0/3637264205 wait complete. 2024-09-15T23:15:43.557 INFO:tasks.ceph.mds.a.smithi123.stderr: -2072> 2024-09-15T23:15:34.663+0000 7ff83eec6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:15:43.567 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T23:15:43.584 INFO:tasks.ceph.mds.a.smithi123.stdout:starting mds.a at 2024-09-15T23:15:43.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.667+0000 7f64c1576640 1 Processor -- start 2024-09-15T23:15:43.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.667+0000 7f64c1576640 1 -- start start 2024-09-15T23:15:43.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.668+0000 7f64c1576640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f64bc06bfd0 0x7f64bc06c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:43.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.668+0000 7f64c1576640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64bc1631c0 con 0x7f64bc0b3350 2024-09-15T23:15:43.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.668+0000 7f64c1576640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64bc06c8f0 con 0x7f64bc0d3930 2024-09-15T23:15:43.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.668+0000 7f64c1576640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f64bc0b78a0 con 0x7f64bc06bfd0 2024-09-15T23:15:43.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.668+0000 7f64b27fc640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f64bc0b3350 0x7f64bc1623a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:46298/0 (socket says 172.21.15.123:46298) 2024-09-15T23:15:43.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.668+0000 7f64b27fc640 1 -- 172.21.15.123:0/4078378909 learned_addr learned my addr 172.21.15.123:0/4078378909 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:43.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.668+0000 7f64baffd640 1 --2- 172.21.15.123:0/4078378909 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f64bc06bfd0 0x7f64bc06c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:43.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.668+0000 7f64ba7fc640 1 -- 172.21.15.123:0/4078378909 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2812412260 0 0) 0x7f64bc1631c0 con 0x7f64bc0b3350 2024-09-15T23:15:43.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.668+0000 7f64ba7fc640 1 -- 172.21.15.123:0/4078378909 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64a8003520 con 0x7f64bc0b3350 2024-09-15T23:15:43.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.668+0000 7f64ba7fc640 1 -- 172.21.15.123:0/4078378909 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1211774501 0 0) 0x7f64a8003520 con 0x7f64bc0b3350 2024-09-15T23:15:43.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.668+0000 7f64ba7fc640 1 -- 172.21.15.123:0/4078378909 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f64bc06bfd0 msgr2=0x7f64bc06c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:43.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.668+0000 7f64ba7fc640 1 --2- 172.21.15.123:0/4078378909 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f64bc06bfd0 0x7f64bc06c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:43.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.668+0000 7f64ba7fc640 1 -- 172.21.15.123:0/4078378909 >> v1:172.21.15.188:6789/0 conn(0x7f64bc0d3930 legacy=0x7f64bc162ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:43.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.668+0000 7f64ba7fc640 1 -- 172.21.15.123:0/4078378909 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64bc0cf710 con 0x7f64bc0b3350 2024-09-15T23:15:43.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.668+0000 7f64ba7fc640 1 -- 172.21.15.123:0/4078378909 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f64a4001670 con 0x7f64bc0b3350 2024-09-15T23:15:43.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.668+0000 7f64ba7fc640 1 -- 172.21.15.123:0/4078378909 >> v1:172.21.15.123:6789/0 conn(0x7f64bc0b3350 legacy=0x7f64bc1623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:43.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.668+0000 7f64ba7fc640 1 --2- 172.21.15.123:0/4078378909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64a80039e0 0x7f64a8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:43.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.669+0000 7f64ba7fc640 1 --2- 172.21.15.123:0/4078378909 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f64bc06bfd0 0x7f64a8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:43.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.669+0000 7f64ba7fc640 1 --2- 172.21.15.123:0/4078378909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f64a8004d40 0x7f64a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:43.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.669+0000 7f64ba7fc640 1 -- 172.21.15.123:0/4078378909 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f64a800b9c0 con 0x7f64a80039e0 2024-09-15T23:15:43.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.669+0000 7f64ba7fc640 1 -- 172.21.15.123:0/4078378909 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f64a800bb40 con 0x7f64a8004d40 2024-09-15T23:15:43.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.669+0000 7f64ba7fc640 1 -- 172.21.15.123:0/4078378909 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f64a800bd40 con 0x7f64bc06bfd0 2024-09-15T23:15:43.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.669+0000 7f64baffd640 1 --2- 172.21.15.123:0/4078378909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64a80039e0 0x7f64a8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:43.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.669+0000 7f64b27fc640 1 --2- 172.21.15.123:0/4078378909 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f64bc06bfd0 0x7f64a8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:43.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.669+0000 7f64bb7fe640 1 --2- 172.21.15.123:0/4078378909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f64a8004d40 0x7f64a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:43.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.669+0000 7f64baffd640 1 -- 172.21.15.123:0/4078378909 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f64bc06bfd0 msgr2=0x7f64a8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:43.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.669+0000 7f64baffd640 1 --2- 172.21.15.123:0/4078378909 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f64bc06bfd0 0x7f64a8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:43.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.669+0000 7f64baffd640 1 -- 172.21.15.123:0/4078378909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f64a8004d40 msgr2=0x7f64a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:43.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.669+0000 7f64baffd640 1 --2- 172.21.15.123:0/4078378909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f64a8004d40 0x7f64a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:43.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.669+0000 7f64baffd640 1 -- 172.21.15.123:0/4078378909 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a8003520 con 0x7f64a80039e0 2024-09-15T23:15:43.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.669+0000 7f64b27fc640 1 --2- 172.21.15.123:0/4078378909 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f64bc06bfd0 0x7f64a8004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:43.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.669+0000 7f64baffd640 1 --2- 172.21.15.123:0/4078378909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64a80039e0 0x7f64a8003dc0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f64ac009ac0 tx=0x7f64a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c1dea43af884b37 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:43.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.670+0000 7f64ba7fc640 1 -- 172.21.15.123:0/4078378909 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ac036070 con 0x7f64a80039e0 2024-09-15T23:15:43.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.670+0000 7f64ba7fc640 1 -- 172.21.15.123:0/4078378909 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64ac031400 con 0x7f64a80039e0 2024-09-15T23:15:43.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.670+0000 7f64ba7fc640 1 -- 172.21.15.123:0/4078378909 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ac009690 con 0x7f64a80039e0 2024-09-15T23:15:43.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.670+0000 7f64c1576640 1 -- 172.21.15.123:0/4078378909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64a80039e0 msgr2=0x7f64a8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:43.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.670+0000 7f64c1576640 1 --2- 172.21.15.123:0/4078378909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64a80039e0 0x7f64a8003dc0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f64ac009ac0 tx=0x7f64a8005830 comp rx=0 tx=0).stop 2024-09-15T23:15:43.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.670+0000 7f64bb7fe640 1 -- 172.21.15.123:0/4078378909 reap_dead start 2024-09-15T23:15:43.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.670+0000 7f64c1576640 1 -- 172.21.15.123:0/4078378909 shutdown_connections 2024-09-15T23:15:43.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.670+0000 7f64c1576640 1 -- 172.21.15.123:0/4078378909 >> 172.21.15.123:0/4078378909 conn(0x7f64bc0d11c0 msgr2=0x7f64bc0d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:43.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.670+0000 7f64c1576640 1 -- 172.21.15.123:0/4078378909 shutdown_connections 2024-09-15T23:15:43.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.670+0000 7f64c1576640 1 -- 172.21.15.123:0/4078378909 wait complete. 2024-09-15T23:15:43.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.671+0000 7f64c1576640 1 Processor -- start 2024-09-15T23:15:43.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.672+0000 7f64c1576640 1 -- start start 2024-09-15T23:15:43.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.672+0000 7f64c1576640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64a80039e0 0x7f64bc0b2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:43.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.672+0000 7f64c1576640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f64bc15cd10 0x7f64bc0b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:43.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.672+0000 7f64c1576640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f64bc15c070 0x7f64bc15c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:43.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.672+0000 7f64c1576640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f64bc0cfcd0 con 0x7f64a80039e0 2024-09-15T23:15:43.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.672+0000 7f64c1576640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f64bc0cffb0 con 0x7f64bc15c070 2024-09-15T23:15:43.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.672+0000 7f64c1576640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f64bc0d2400 con 0x7f64bc15cd10 2024-09-15T23:15:43.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.672+0000 7f64baffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64a80039e0 0x7f64bc0b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:43.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.672+0000 7f64baffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64a80039e0 0x7f64bc0b2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40492/0 (socket says 172.21.15.123:40492) 2024-09-15T23:15:43.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.672+0000 7f64baffd640 1 -- 172.21.15.123:0/1124273243 learned_addr learned my addr 172.21.15.123:0/1124273243 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:43.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.672+0000 7f64bb7fe640 1 --2- 172.21.15.123:0/1124273243 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f64bc15c070 0x7f64bc15c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:43.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.673+0000 7f64b27fc640 1 --2- 172.21.15.123:0/1124273243 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f64bc15cd10 0x7f64bc0b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:43.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.673+0000 7f64baffd640 1 -- 172.21.15.123:0/1124273243 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f64bc15cd10 msgr2=0x7f64bc0b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:43.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.673+0000 7f64baffd640 1 --2- 172.21.15.123:0/1124273243 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f64bc15cd10 0x7f64bc0b2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:43.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.673+0000 7f64baffd640 1 -- 172.21.15.123:0/1124273243 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f64bc15c070 msgr2=0x7f64bc15c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:43.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.673+0000 7f64baffd640 1 --2- 172.21.15.123:0/1124273243 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f64bc15c070 0x7f64bc15c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:43.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.673+0000 7f64baffd640 1 -- 172.21.15.123:0/1124273243 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64bc0ce0e0 con 0x7f64a80039e0 2024-09-15T23:15:43.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.673+0000 7f64baffd640 1 --2- 172.21.15.123:0/1124273243 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64a80039e0 0x7f64bc0b2680 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f64ac009ac0 tx=0x7f64ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:43.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.673+0000 7f64b3fff640 1 -- 172.21.15.123:0/1124273243 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ac040020 con 0x7f64a80039e0 2024-09-15T23:15:43.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.673+0000 7f64b3fff640 1 -- 172.21.15.123:0/1124273243 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64ac003b40 con 0x7f64a80039e0 2024-09-15T23:15:43.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.673+0000 7f64b3fff640 1 -- 172.21.15.123:0/1124273243 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ac036040 con 0x7f64a80039e0 2024-09-15T23:15:43.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.673+0000 7f64c1576640 1 -- 172.21.15.123:0/1124273243 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64bc0ce3c0 con 0x7f64a80039e0 2024-09-15T23:15:43.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.673+0000 7f64c1576640 1 -- 172.21.15.123:0/1124273243 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64bc0ce980 con 0x7f64a80039e0 2024-09-15T23:15:43.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.674+0000 7f64c1576640 1 -- 172.21.15.123:0/1124273243 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64bc0cb920 con 0x7f64a80039e0 2024-09-15T23:15:43.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.674+0000 7f64b3fff640 1 -- 172.21.15.123:0/1124273243 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f64ac043020 con 0x7f64a80039e0 2024-09-15T23:15:43.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.675+0000 7f64b3fff640 1 --2- 172.21.15.123:0/1124273243 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f649c06c2b0 0x7f649c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:43.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.675+0000 7f64b3fff640 1 -- 172.21.15.123:0/1124273243 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5967+0+0 (secure 0 0 0) 0x7f64ac0ab580 con 0x7f64a80039e0 2024-09-15T23:15:43.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.675+0000 7f64b27fc640 1 --2- 172.21.15.123:0/1124273243 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f649c06c2b0 0x7f649c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:43.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.676+0000 7f64b27fc640 1 --2- 172.21.15.123:0/1124273243 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f649c06c2b0 0x7f649c06e770 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f64bc0b4dc0 tx=0x7f64a4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:43.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.679+0000 7f64b3fff640 1 -- 172.21.15.123:0/1124273243 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f64ac04a070 con 0x7f64a80039e0 2024-09-15T23:15:43.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:43.880+0000 7f64c1576640 1 -- 172.21.15.123:0/1124273243 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f64bc0d0cf0 con 0x7f64a80039e0 2024-09-15T23:15:44.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.555+0000 7f64b3fff640 1 -- 172.21.15.123:0/1124273243 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v40) ==== 104+0+0 (secure 0 0 0) 0x7f64ac0044e0 con 0x7f64a80039e0 2024-09-15T23:15:44.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.557+0000 7f64c1576640 1 -- 172.21.15.123:0/1124273243 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f649c06c2b0 msgr2=0x7f649c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:44.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.557+0000 7f64c1576640 1 --2- 172.21.15.123:0/1124273243 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f649c06c2b0 0x7f649c06e770 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f64bc0b4dc0 tx=0x7f64a4009040 comp rx=0 tx=0).stop 2024-09-15T23:15:44.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.557+0000 7f64c1576640 1 -- 172.21.15.123:0/1124273243 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64a80039e0 msgr2=0x7f64bc0b2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:44.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.557+0000 7f64c1576640 1 --2- 172.21.15.123:0/1124273243 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64a80039e0 0x7f64bc0b2680 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f64ac009ac0 tx=0x7f64ac004730 comp rx=0 tx=0).stop 2024-09-15T23:15:44.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.557+0000 7f64c1576640 1 -- 172.21.15.123:0/1124273243 shutdown_connections 2024-09-15T23:15:44.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.557+0000 7f64c1576640 1 --2- 172.21.15.123:0/1124273243 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f64bc15c070 0x7f64bc15c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:44.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.557+0000 7f64c1576640 1 --2- 172.21.15.123:0/1124273243 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f64bc15cd10 0x7f64bc0b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:44.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.557+0000 7f64c1576640 1 --2- 172.21.15.123:0/1124273243 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f649c06c2b0 0x7f649c06e770 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:44.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.557+0000 7f64c1576640 1 --2- 172.21.15.123:0/1124273243 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64a80039e0 0x7f64bc0b2680 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:44.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.557+0000 7f64c1576640 1 -- 172.21.15.123:0/1124273243 >> 172.21.15.123:0/1124273243 conn(0x7f64bc0d11c0 msgr2=0x7f64bc0cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:44.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.558+0000 7f64c1576640 1 -- 172.21.15.123:0/1124273243 shutdown_connections 2024-09-15T23:15:44.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.558+0000 7f64c1576640 1 -- 172.21.15.123:0/1124273243 wait complete. 2024-09-15T23:15:44.572 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T23:15:44.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.718+0000 7f44cc6e6640 1 Processor -- start 2024-09-15T23:15:44.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.718+0000 7f44cc6e6640 1 -- start start 2024-09-15T23:15:44.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.719+0000 7f44cc6e6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f44c40d0ef0 0x7f44c4160330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:44.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.719+0000 7f44cc6e6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44c4160870 0x7f44c4160cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:44.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.719+0000 7f44cc6e6640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c40b74f0 con 0x7f44c40d0b10 2024-09-15T23:15:44.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.719+0000 7f44cc6e6640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f44c4073b30 con 0x7f44c40d0ef0 2024-09-15T23:15:44.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.719+0000 7f44cc6e6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f44c40b48a0 con 0x7f44c4160870 2024-09-15T23:15:44.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.720+0000 7f44c9c81640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f44c40d0ef0 0x7f44c4160330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:44.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.720+0000 7f44c9c81640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f44c40d0ef0 0x7f44c4160330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40500/0 (socket says 172.21.15.123:40500) 2024-09-15T23:15:44.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.720+0000 7f44c9c81640 1 -- 172.21.15.123:0/4041444888 learned_addr learned my addr 172.21.15.123:0/4041444888 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:44.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.720+0000 7f44cac83640 1 --2- 172.21.15.123:0/4041444888 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44c4160870 0x7f44c4160cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:44.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.720+0000 7f44c9c81640 1 -- 172.21.15.123:0/4041444888 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44c4160870 msgr2=0x7f44c4160cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:44.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.720+0000 7f44c9c81640 1 --2- 172.21.15.123:0/4041444888 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44c4160870 0x7f44c4160cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:44.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.720+0000 7f44c9c81640 1 -- 172.21.15.123:0/4041444888 >> v1:172.21.15.188:6789/0 conn(0x7f44c40d0b10 legacy=0x7f44c40d22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:44.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.720+0000 7f44c9c81640 1 -- 172.21.15.123:0/4041444888 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c40b77d0 con 0x7f44c40d0ef0 2024-09-15T23:15:44.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.721+0000 7f44c9c81640 1 --2- 172.21.15.123:0/4041444888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44c40d0ef0 0x7f44c4160330 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f44b8009870 tx=0x7f44b802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e001d0c1b242b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:44.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.721+0000 7f44c9480640 1 -- 172.21.15.123:0/4041444888 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b8037070 con 0x7f44c40d0ef0 2024-09-15T23:15:44.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.721+0000 7f44c9480640 1 -- 172.21.15.123:0/4041444888 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44b8032440 con 0x7f44c40d0ef0 2024-09-15T23:15:44.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.721+0000 7f44c9480640 1 -- 172.21.15.123:0/4041444888 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b8032810 con 0x7f44c40d0ef0 2024-09-15T23:15:44.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.721+0000 7f44cc6e6640 1 -- 172.21.15.123:0/4041444888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44c40d0ef0 msgr2=0x7f44c4160330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:44.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.721+0000 7f44cc6e6640 1 --2- 172.21.15.123:0/4041444888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44c40d0ef0 0x7f44c4160330 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f44b8009870 tx=0x7f44b802a270 comp rx=0 tx=0).stop 2024-09-15T23:15:44.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.721+0000 7f44cc6e6640 1 -- 172.21.15.123:0/4041444888 shutdown_connections 2024-09-15T23:15:44.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.721+0000 7f44cc6e6640 1 --2- 172.21.15.123:0/4041444888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44c40d0ef0 0x7f44c4160330 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:44.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.721+0000 7f44cc6e6640 1 --2- 172.21.15.123:0/4041444888 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44c4160870 0x7f44c4160cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:44.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.721+0000 7f44cc6e6640 1 -- 172.21.15.123:0/4041444888 >> 172.21.15.123:0/4041444888 conn(0x7f44c4067950 msgr2=0x7f44c4067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:44.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.721+0000 7f44cc6e6640 1 -- 172.21.15.123:0/4041444888 shutdown_connections 2024-09-15T23:15:44.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.721+0000 7f44cc6e6640 1 -- 172.21.15.123:0/4041444888 wait complete. 2024-09-15T23:15:44.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.722+0000 7f44cc6e6640 1 Processor -- start 2024-09-15T23:15:44.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.723+0000 7f44cc6e6640 1 -- start start 2024-09-15T23:15:44.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.723+0000 7f44cc6e6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44c40d0b10 0x7f44c414d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:44.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.723+0000 7f44cc6e6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44c40d0ef0 0x7f44c41f7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:44.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.723+0000 7f44cc6e6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44c4160870 0x7f44c41f8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:44.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.723+0000 7f44cc6e6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f44c40b7110 con 0x7f44c40d0ef0 2024-09-15T23:15:44.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.723+0000 7f44cc6e6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f44c40b4530 con 0x7f44c4160870 2024-09-15T23:15:44.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.723+0000 7f44cc6e6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f44c40b7290 con 0x7f44c40d0b10 2024-09-15T23:15:44.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.723+0000 7f44c9c81640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44c40d0ef0 0x7f44c41f7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:44.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.723+0000 7f44c9c81640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44c40d0ef0 0x7f44c41f7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40504/0 (socket says 172.21.15.123:40504) 2024-09-15T23:15:44.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.723+0000 7f44c9c81640 1 -- 172.21.15.123:0/3047389749 learned_addr learned my addr 172.21.15.123:0/3047389749 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:44.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.723+0000 7f44cac83640 1 --2- 172.21.15.123:0/3047389749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44c4160870 0x7f44c41f8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:44.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.723+0000 7f44ca482640 1 --2- 172.21.15.123:0/3047389749 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44c40d0b10 0x7f44c414d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:44.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.724+0000 7f44c9c81640 1 -- 172.21.15.123:0/3047389749 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44c40d0b10 msgr2=0x7f44c414d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:44.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.724+0000 7f44c9c81640 1 --2- 172.21.15.123:0/3047389749 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44c40d0b10 0x7f44c414d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:44.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.724+0000 7f44c9c81640 1 -- 172.21.15.123:0/3047389749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44c4160870 msgr2=0x7f44c41f8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:44.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.724+0000 7f44c9c81640 1 --2- 172.21.15.123:0/3047389749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44c4160870 0x7f44c41f8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:44.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.724+0000 7f44c9c81640 1 -- 172.21.15.123:0/3047389749 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c414e880 con 0x7f44c40d0ef0 2024-09-15T23:15:44.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.724+0000 7f44c9c81640 1 --2- 172.21.15.123:0/3047389749 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44c40d0ef0 0x7f44c41f7df0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f44b802a2b0 tx=0x7f44b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:44.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.724+0000 7f44c2ffd640 1 -- 172.21.15.123:0/3047389749 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b8037040 con 0x7f44c40d0ef0 2024-09-15T23:15:44.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.724+0000 7f44c2ffd640 1 -- 172.21.15.123:0/3047389749 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44b8042070 con 0x7f44c40d0ef0 2024-09-15T23:15:44.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.724+0000 7f44cc6e6640 1 -- 172.21.15.123:0/3047389749 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44c414eb60 con 0x7f44c40d0ef0 2024-09-15T23:15:44.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.724+0000 7f44c2ffd640 1 -- 172.21.15.123:0/3047389749 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b8030880 con 0x7f44c40d0ef0 2024-09-15T23:15:44.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.724+0000 7f44cc6e6640 1 -- 172.21.15.123:0/3047389749 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44c414f120 con 0x7f44c40d0ef0 2024-09-15T23:15:44.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.725+0000 7f44cc6e6640 1 -- 172.21.15.123:0/3047389749 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44c40b4e50 con 0x7f44c40d0ef0 2024-09-15T23:15:44.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.725+0000 7f44c2ffd640 1 -- 172.21.15.123:0/3047389749 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f44b8030a20 con 0x7f44c40d0ef0 2024-09-15T23:15:44.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.726+0000 7f44c2ffd640 1 --2- 172.21.15.123:0/3047389749 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f44b006c2b0 0x7f44b006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:44.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.726+0000 7f44c2ffd640 1 -- 172.21.15.123:0/3047389749 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5967+0+0 (secure 0 0 0) 0x7f44b80abe70 con 0x7f44c40d0ef0 2024-09-15T23:15:44.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.726+0000 7f44ca482640 1 --2- 172.21.15.123:0/3047389749 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f44b006c2b0 0x7f44b006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:44.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.727+0000 7f44ca482640 1 --2- 172.21.15.123:0/3047389749 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f44b006c2b0 0x7f44b006e770 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f44b4007fd0 tx=0x7f44b4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:44.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.730+0000 7f44c2ffd640 1 -- 172.21.15.123:0/3047389749 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f44b8045360 con 0x7f44c40d0ef0 2024-09-15T23:15:44.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:44.895+0000 7f44cc6e6640 1 -- 172.21.15.123:0/3047389749 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f44c415f880 con 0x7f44c40d0ef0 2024-09-15T23:15:45.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.556+0000 7f44c2ffd640 1 -- 172.21.15.123:0/3047389749 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v72) ==== 181+0+0 (secure 0 0 0) 0x7f44b807a460 con 0x7f44c40d0ef0 2024-09-15T23:15:45.558 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' removed 2024-09-15T23:15:45.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.561+0000 7f44cc6e6640 1 -- 172.21.15.123:0/3047389749 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f44b006c2b0 msgr2=0x7f44b006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:45.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.561+0000 7f44cc6e6640 1 --2- 172.21.15.123:0/3047389749 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f44b006c2b0 0x7f44b006e770 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f44b4007fd0 tx=0x7f44b4009040 comp rx=0 tx=0).stop 2024-09-15T23:15:45.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.561+0000 7f44cc6e6640 1 -- 172.21.15.123:0/3047389749 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44c40d0ef0 msgr2=0x7f44c41f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:45.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.561+0000 7f44cc6e6640 1 --2- 172.21.15.123:0/3047389749 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44c40d0ef0 0x7f44c41f7df0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f44b802a2b0 tx=0x7f44b80046c0 comp rx=0 tx=0).stop 2024-09-15T23:15:45.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.564+0000 7f44cc6e6640 1 -- 172.21.15.123:0/3047389749 shutdown_connections 2024-09-15T23:15:45.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.564+0000 7f44cc6e6640 1 --2- 172.21.15.123:0/3047389749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44c4160870 0x7f44c41f8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:45.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.564+0000 7f44cc6e6640 1 --2- 172.21.15.123:0/3047389749 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f44b006c2b0 0x7f44b006e770 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:45.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.564+0000 7f44cc6e6640 1 --2- 172.21.15.123:0/3047389749 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44c40d0ef0 0x7f44c41f7df0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:45.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.564+0000 7f44cc6e6640 1 --2- 172.21.15.123:0/3047389749 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44c40d0b10 0x7f44c414d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:45.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.564+0000 7f44cc6e6640 1 -- 172.21.15.123:0/3047389749 >> 172.21.15.123:0/3047389749 conn(0x7f44c4067950 msgr2=0x7f44c40b6110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:45.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.564+0000 7f44cc6e6640 1 -- 172.21.15.123:0/3047389749 shutdown_connections 2024-09-15T23:15:45.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.564+0000 7f44cc6e6640 1 -- 172.21.15.123:0/3047389749 wait complete. 2024-09-15T23:15:45.578 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T23:15:45.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.682+0000 7fd6116e6640 1 Processor -- start 2024-09-15T23:15:45.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.682+0000 7fd6116e6640 1 -- start start 2024-09-15T23:15:45.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.683+0000 7fd6116e6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd60c0d16e0 0x7fd60c0d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:45.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.683+0000 7fd6116e6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd60c0d40b0 0x7fd60c0b7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:45.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.683+0000 7fd6116e6640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd60c0cf060 con 0x7fd60c15ea90 2024-09-15T23:15:45.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.683+0000 7fd6116e6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fd60c0d34c0 con 0x7fd60c0d40b0 2024-09-15T23:15:45.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.683+0000 7fd6116e6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd60c0cf340 con 0x7fd60c0d16e0 2024-09-15T23:15:45.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.683+0000 7fd60affd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd60c15ea90 0x7fd60c0d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:46310/0 (socket says 172.21.15.123:46310) 2024-09-15T23:15:45.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.683+0000 7fd60affd640 1 -- 172.21.15.123:0/1081019115 learned_addr learned my addr 172.21.15.123:0/1081019115 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:45.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.684+0000 7fd60a7fc640 1 -- 172.21.15.123:0/1081019115 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3374855420 0 0) 0x7fd60c0cf060 con 0x7fd60c15ea90 2024-09-15T23:15:45.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.684+0000 7fd60a7fc640 1 -- 172.21.15.123:0/1081019115 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5f8003520 con 0x7fd60c15ea90 2024-09-15T23:15:45.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.684+0000 7fd6027fc640 1 --2- 172.21.15.123:0/1081019115 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd60c0d16e0 0x7fd60c0d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:45.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.684+0000 7fd60b7fe640 1 --2- 172.21.15.123:0/1081019115 >> v2:172.21.15.188:3300/0 conn(0x7fd60c0d40b0 0x7fd60c0b7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:45.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.684+0000 7fd60a7fc640 1 -- 172.21.15.123:0/1081019115 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2856552830 0 0) 0x7fd5f8003520 con 0x7fd60c15ea90 2024-09-15T23:15:45.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.684+0000 7fd60a7fc640 1 -- 172.21.15.123:0/1081019115 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd60c0d16e0 msgr2=0x7fd60c0d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:45.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.684+0000 7fd60a7fc640 1 --2- 172.21.15.123:0/1081019115 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd60c0d16e0 0x7fd60c0d2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:45.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.684+0000 7fd60a7fc640 1 -- 172.21.15.123:0/1081019115 >> v2:172.21.15.188:3300/0 conn(0x7fd60c0d40b0 msgr2=0x7fd60c0b7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:45.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.684+0000 7fd60a7fc640 1 --2- 172.21.15.123:0/1081019115 >> v2:172.21.15.188:3300/0 conn(0x7fd60c0d40b0 0x7fd60c0b7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:45.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.684+0000 7fd60a7fc640 1 -- 172.21.15.123:0/1081019115 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd60c0cf620 con 0x7fd60c15ea90 2024-09-15T23:15:45.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.684+0000 7fd60a7fc640 1 -- 172.21.15.123:0/1081019115 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fd5fc001670 con 0x7fd60c15ea90 2024-09-15T23:15:45.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.684+0000 7fd60a7fc640 1 -- 172.21.15.123:0/1081019115 >> v1:172.21.15.123:6789/0 conn(0x7fd60c15ea90 legacy=0x7fd60c0d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:45.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.684+0000 7fd60a7fc640 1 --2- 172.21.15.123:0/1081019115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd5f80039b0 0x7fd5f8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:45.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.684+0000 7fd60a7fc640 1 --2- 172.21.15.123:0/1081019115 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5f8004800 0x7fd5f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:45.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.684+0000 7fd60a7fc640 1 --2- 172.21.15.123:0/1081019115 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd60c0d16e0 0x7fd5f80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:45.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.684+0000 7fd60a7fc640 1 -- 172.21.15.123:0/1081019115 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c0d34c0 con 0x7fd5f8004800 2024-09-15T23:15:45.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.684+0000 7fd60a7fc640 1 -- 172.21.15.123:0/1081019115 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c0cf340 con 0x7fd5f80039b0 2024-09-15T23:15:45.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.684+0000 7fd60a7fc640 1 -- 172.21.15.123:0/1081019115 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd5f800b9c0 con 0x7fd60c0d16e0 2024-09-15T23:15:45.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.684+0000 7fd6027fc640 1 --2- 172.21.15.123:0/1081019115 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5f8004800 0x7fd5f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:45.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.684+0000 7fd60affd640 1 --2- 172.21.15.123:0/1081019115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd5f80039b0 0x7fd5f8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:45.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.684+0000 7fd6027fc640 1 -- 172.21.15.123:0/1081019115 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd60c0d16e0 msgr2=0x7fd5f80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:45.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.684+0000 7fd6027fc640 1 --2- 172.21.15.123:0/1081019115 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd60c0d16e0 0x7fd5f80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:45.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.684+0000 7fd6027fc640 1 -- 172.21.15.123:0/1081019115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd5f80039b0 msgr2=0x7fd5f8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:45.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.684+0000 7fd6027fc640 1 --2- 172.21.15.123:0/1081019115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd5f80039b0 0x7fd5f8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:45.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.684+0000 7fd6027fc640 1 -- 172.21.15.123:0/1081019115 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f8003520 con 0x7fd5f8004800 2024-09-15T23:15:45.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.685+0000 7fd6027fc640 1 --2- 172.21.15.123:0/1081019115 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5f8004800 0x7fd5f8004c80 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4009ac0 tx=0x7fd5f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=210bec05a739af49 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:45.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.685+0000 7fd60a7fc640 1 -- 172.21.15.123:0/1081019115 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f4036070 con 0x7fd5f8004800 2024-09-15T23:15:45.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.685+0000 7fd60a7fc640 1 -- 172.21.15.123:0/1081019115 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5f4031400 con 0x7fd5f8004800 2024-09-15T23:15:45.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.685+0000 7fd60a7fc640 1 -- 172.21.15.123:0/1081019115 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f4009690 con 0x7fd5f8004800 2024-09-15T23:15:45.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.686+0000 7fd6116e6640 1 -- 172.21.15.123:0/1081019115 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5f8004800 msgr2=0x7fd5f8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:45.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.686+0000 7fd6116e6640 1 --2- 172.21.15.123:0/1081019115 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5f8004800 0x7fd5f8004c80 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4009ac0 tx=0x7fd5f8005830 comp rx=0 tx=0).stop 2024-09-15T23:15:45.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.686+0000 7fd60b7fe640 1 -- 172.21.15.123:0/1081019115 reap_dead start 2024-09-15T23:15:45.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.686+0000 7fd6116e6640 1 -- 172.21.15.123:0/1081019115 shutdown_connections 2024-09-15T23:15:45.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.686+0000 7fd6116e6640 1 -- 172.21.15.123:0/1081019115 >> 172.21.15.123:0/1081019115 conn(0x7fd60c06c0e0 msgr2=0x7fd60c06c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:45.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.686+0000 7fd6116e6640 1 -- 172.21.15.123:0/1081019115 shutdown_connections 2024-09-15T23:15:45.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.686+0000 7fd6116e6640 1 -- 172.21.15.123:0/1081019115 wait complete. 2024-09-15T23:15:45.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.687+0000 7fd6116e6640 1 Processor -- start 2024-09-15T23:15:45.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.687+0000 7fd6116e6640 1 -- start start 2024-09-15T23:15:45.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.688+0000 7fd6116e6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5f8004800 0x7fd60c150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:45.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.688+0000 7fd6116e6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd60c14d750 0x7fd60c0cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:45.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.688+0000 7fd6116e6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd60c0adc40 0x7fd60c0ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:45.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.688+0000 7fd6116e6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c15ee70 con 0x7fd5f8004800 2024-09-15T23:15:45.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.688+0000 7fd6116e6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd60c0cfbe0 con 0x7fd60c14d750 2024-09-15T23:15:45.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.688+0000 7fd6116e6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd60c0d2f80 con 0x7fd60c0adc40 2024-09-15T23:15:45.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.688+0000 7fd60affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5f8004800 0x7fd60c150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:45.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.688+0000 7fd60affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5f8004800 0x7fd60c150a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40524/0 (socket says 172.21.15.123:40524) 2024-09-15T23:15:45.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.688+0000 7fd60affd640 1 -- 172.21.15.123:0/3054336174 learned_addr learned my addr 172.21.15.123:0/3054336174 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:45.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.688+0000 7fd6027fc640 1 --2- 172.21.15.123:0/3054336174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd60c14d750 0x7fd60c0cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:45.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.688+0000 7fd60b7fe640 1 --2- 172.21.15.123:0/3054336174 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd60c0adc40 0x7fd60c0ae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:45.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.688+0000 7fd60affd640 1 -- 172.21.15.123:0/3054336174 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd60c0adc40 msgr2=0x7fd60c0ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:45.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.688+0000 7fd60affd640 1 --2- 172.21.15.123:0/3054336174 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd60c0adc40 0x7fd60c0ae0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:45.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.688+0000 7fd60affd640 1 -- 172.21.15.123:0/3054336174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd60c14d750 msgr2=0x7fd60c0cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:45.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.688+0000 7fd60affd640 1 --2- 172.21.15.123:0/3054336174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd60c14d750 0x7fd60c0cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:45.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.688+0000 7fd60affd640 1 -- 172.21.15.123:0/3054336174 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd60c0ae600 con 0x7fd5f8004800 2024-09-15T23:15:45.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.688+0000 7fd60b7fe640 1 --2- 172.21.15.123:0/3054336174 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd60c0adc40 0x7fd60c0ae0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:45.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.688+0000 7fd6027fc640 1 --2- 172.21.15.123:0/3054336174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd60c14d750 0x7fd60c0cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:45.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.688+0000 7fd60affd640 1 --2- 172.21.15.123:0/3054336174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5f8004800 0x7fd60c150a60 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc007340 tx=0x7fd5fc007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:45.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.688+0000 7fd603fff640 1 -- 172.21.15.123:0/3054336174 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc00f960 con 0x7fd5f8004800 2024-09-15T23:15:45.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.688+0000 7fd603fff640 1 -- 172.21.15.123:0/3054336174 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5fc018070 con 0x7fd5f8004800 2024-09-15T23:15:45.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.688+0000 7fd6116e6640 1 -- 172.21.15.123:0/3054336174 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd60c0ce250 con 0x7fd5f8004800 2024-09-15T23:15:45.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.688+0000 7fd603fff640 1 -- 172.21.15.123:0/3054336174 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc00fd40 con 0x7fd5f8004800 2024-09-15T23:15:45.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.688+0000 7fd6116e6640 1 -- 172.21.15.123:0/3054336174 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd60c0cd490 con 0x7fd5f8004800 2024-09-15T23:15:45.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.690+0000 7fd6116e6640 1 -- 172.21.15.123:0/3054336174 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd60c0d0fd0 con 0x7fd5f8004800 2024-09-15T23:15:45.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.690+0000 7fd603fff640 1 -- 172.21.15.123:0/3054336174 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd5fc01d460 con 0x7fd5f8004800 2024-09-15T23:15:45.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.690+0000 7fd603fff640 1 --2- 172.21.15.123:0/3054336174 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd5ec06c2e0 0x7fd5ec06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:45.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.690+0000 7fd603fff640 1 -- 172.21.15.123:0/3054336174 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 5529+0+0 (secure 0 0 0) 0x7fd5fc08b430 con 0x7fd5f8004800 2024-09-15T23:15:45.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.691+0000 7fd6027fc640 1 --2- 172.21.15.123:0/3054336174 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd5ec06c2e0 0x7fd5ec06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:45.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.691+0000 7fd6027fc640 1 --2- 172.21.15.123:0/3054336174 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd5ec06c2e0 0x7fd5ec06e7a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4033000 tx=0x7fd5f4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:45.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.695+0000 7fd603fff640 1 -- 172.21.15.123:0/3054336174 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd5fc059ce0 con 0x7fd5f8004800 2024-09-15T23:15:45.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:45.859+0000 7fd6116e6640 1 -- 172.21.15.123:0/3054336174 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd60c162020 con 0x7fd5f8004800 2024-09-15T23:15:46.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.566+0000 7fd603fff640 1 -- 172.21.15.123:0/3054336174 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v73) ==== 169+0+0 (secure 0 0 0) 0x7fd5fc0595e0 con 0x7fd5f8004800 2024-09-15T23:15:46.568 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' removed 2024-09-15T23:15:46.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.569+0000 7fd6116e6640 1 -- 172.21.15.123:0/3054336174 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd5ec06c2e0 msgr2=0x7fd5ec06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:46.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.569+0000 7fd6116e6640 1 --2- 172.21.15.123:0/3054336174 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd5ec06c2e0 0x7fd5ec06e7a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4033000 tx=0x7fd5f4008030 comp rx=0 tx=0).stop 2024-09-15T23:15:46.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.569+0000 7fd6116e6640 1 -- 172.21.15.123:0/3054336174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5f8004800 msgr2=0x7fd60c150a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:46.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.569+0000 7fd6116e6640 1 --2- 172.21.15.123:0/3054336174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5f8004800 0x7fd60c150a60 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc007340 tx=0x7fd5fc007800 comp rx=0 tx=0).stop 2024-09-15T23:15:46.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.569+0000 7fd6116e6640 1 -- 172.21.15.123:0/3054336174 shutdown_connections 2024-09-15T23:15:46.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.569+0000 7fd6116e6640 1 --2- 172.21.15.123:0/3054336174 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd60c0adc40 0x7fd60c0ae0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:46.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.569+0000 7fd6116e6640 1 --2- 172.21.15.123:0/3054336174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd60c14d750 0x7fd60c0cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:46.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.569+0000 7fd6116e6640 1 --2- 172.21.15.123:0/3054336174 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd5ec06c2e0 0x7fd5ec06e7a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:46.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.569+0000 7fd6116e6640 1 --2- 172.21.15.123:0/3054336174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5f8004800 0x7fd60c150a60 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:46.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.569+0000 7fd6116e6640 1 -- 172.21.15.123:0/3054336174 >> 172.21.15.123:0/3054336174 conn(0x7fd60c06c0e0 msgr2=0x7fd60c1602d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:46.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.569+0000 7fd6116e6640 1 -- 172.21.15.123:0/3054336174 shutdown_connections 2024-09-15T23:15:46.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.569+0000 7fd6116e6640 1 -- 172.21.15.123:0/3054336174 wait complete. 2024-09-15T23:15:46.589 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T23:15:46.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.689+0000 7fbb2dcd0640 1 Processor -- start 2024-09-15T23:15:46.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.690+0000 7fbb2dcd0640 1 -- start start 2024-09-15T23:15:46.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.690+0000 7fbb2dcd0640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbb280b3350 0x7fbb280d2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:46.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.690+0000 7fbb2dcd0640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb280cf710 con 0x7fbb2806bfd0 2024-09-15T23:15:46.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.690+0000 7fbb2dcd0640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb280cf9f0 con 0x7fbb280b38a0 2024-09-15T23:15:46.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.690+0000 7fbb2dcd0640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fbb280b78a0 con 0x7fbb280b3350 2024-09-15T23:15:46.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.690+0000 7fbb26ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbb280b3350 0x7fbb280d2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:46.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.691+0000 7fbb277fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fbb2806bfd0 0x7fbb2806c3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60294/0 (socket says 172.21.15.123:60294) 2024-09-15T23:15:46.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.691+0000 7fbb277fe640 1 -- 172.21.15.123:0/223302096 learned_addr learned my addr 172.21.15.123:0/223302096 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:46.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.691+0000 7fbb26ffd640 1 -- 172.21.15.123:0/223302096 >> v1:172.21.15.188:6789/0 conn(0x7fbb280b38a0 legacy=0x7fbb280d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:46.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.691+0000 7fbb26ffd640 1 -- 172.21.15.123:0/223302096 >> v1:172.21.15.123:6789/0 conn(0x7fbb2806bfd0 legacy=0x7fbb2806c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:46.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.691+0000 7fbb26ffd640 1 -- 172.21.15.123:0/223302096 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb280cfcd0 con 0x7fbb280b3350 2024-09-15T23:15:46.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.691+0000 7fbb267fc640 1 -- 172.21.15.123:0/223302096 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 840559483 0 0) 0x7fbb280cf710 con 0x7fbb2806bfd0 2024-09-15T23:15:46.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.692+0000 7fbb26ffd640 1 --2- 172.21.15.123:0/223302096 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb280b3350 0x7fbb280d2920 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c0097a0 tx=0x7fbb1c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8462e328defebe5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:46.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.692+0000 7fbb267fc640 1 -- 172.21.15.123:0/223302096 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c037070 con 0x7fbb280b3350 2024-09-15T23:15:46.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.692+0000 7fbb267fc640 1 -- 172.21.15.123:0/223302096 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb1c032440 con 0x7fbb280b3350 2024-09-15T23:15:46.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.692+0000 7fbb267fc640 1 -- 172.21.15.123:0/223302096 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c032810 con 0x7fbb280b3350 2024-09-15T23:15:46.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.692+0000 7fbb2dcd0640 1 -- 172.21.15.123:0/223302096 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb280b3350 msgr2=0x7fbb280d2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:46.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.692+0000 7fbb2dcd0640 1 --2- 172.21.15.123:0/223302096 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb280b3350 0x7fbb280d2920 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c0097a0 tx=0x7fbb1c02a270 comp rx=0 tx=0).stop 2024-09-15T23:15:46.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.692+0000 7fbb2dcd0640 1 -- 172.21.15.123:0/223302096 shutdown_connections 2024-09-15T23:15:46.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.692+0000 7fbb2dcd0640 1 --2- 172.21.15.123:0/223302096 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb280b3350 0x7fbb280d2920 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:46.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.692+0000 7fbb2dcd0640 1 -- 172.21.15.123:0/223302096 >> 172.21.15.123:0/223302096 conn(0x7fbb280d11c0 msgr2=0x7fbb280d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:46.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.692+0000 7fbb2dcd0640 1 -- 172.21.15.123:0/223302096 shutdown_connections 2024-09-15T23:15:46.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.692+0000 7fbb2dcd0640 1 -- 172.21.15.123:0/223302096 wait complete. 2024-09-15T23:15:46.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.693+0000 7fbb2dcd0640 1 Processor -- start 2024-09-15T23:15:46.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.694+0000 7fbb2dcd0640 1 -- start start 2024-09-15T23:15:46.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.694+0000 7fbb2dcd0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbb2806bfd0 0x7fbb28161300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:46.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.694+0000 7fbb2dcd0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbb280b3350 0x7fbb281f79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:46.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.694+0000 7fbb2dcd0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb280b38a0 0x7fbb280cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:46.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.694+0000 7fbb2dcd0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbb2806cd50 con 0x7fbb280b38a0 2024-09-15T23:15:46.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.694+0000 7fbb2dcd0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbb280cffb0 con 0x7fbb280b3350 2024-09-15T23:15:46.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.694+0000 7fbb2dcd0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbb2815eae0 con 0x7fbb2806bfd0 2024-09-15T23:15:46.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.694+0000 7fbb27fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb280b38a0 0x7fbb280cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:46.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.694+0000 7fbb27fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb280b38a0 0x7fbb280cac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58486/0 (socket says 172.21.15.123:58486) 2024-09-15T23:15:46.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.694+0000 7fbb27fff640 1 -- 172.21.15.123:0/2946427142 learned_addr learned my addr 172.21.15.123:0/2946427142 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:46.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.695+0000 7fbb277fe640 1 --2- 172.21.15.123:0/2946427142 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbb2806bfd0 0x7fbb28161300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:46.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.695+0000 7fbb26ffd640 1 --2- 172.21.15.123:0/2946427142 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbb280b3350 0x7fbb281f79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:46.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.695+0000 7fbb27fff640 1 -- 172.21.15.123:0/2946427142 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbb2806bfd0 msgr2=0x7fbb28161300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:46.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.695+0000 7fbb27fff640 1 --2- 172.21.15.123:0/2946427142 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbb2806bfd0 0x7fbb28161300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:46.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.695+0000 7fbb27fff640 1 -- 172.21.15.123:0/2946427142 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbb280b3350 msgr2=0x7fbb281f79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:46.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.695+0000 7fbb27fff640 1 --2- 172.21.15.123:0/2946427142 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbb280b3350 0x7fbb281f79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:46.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.695+0000 7fbb27fff640 1 -- 172.21.15.123:0/2946427142 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb281f90a0 con 0x7fbb280b38a0 2024-09-15T23:15:46.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.695+0000 7fbb27fff640 1 --2- 172.21.15.123:0/2946427142 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb280b38a0 0x7fbb280cac00 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fbb2000b970 tx=0x7fbb2000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:46.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.695+0000 7fbb0ffff640 1 -- 172.21.15.123:0/2946427142 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb20019070 con 0x7fbb280b38a0 2024-09-15T23:15:46.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.695+0000 7fbb0ffff640 1 -- 172.21.15.123:0/2946427142 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb2000cb40 con 0x7fbb280b38a0 2024-09-15T23:15:46.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.695+0000 7fbb0ffff640 1 -- 172.21.15.123:0/2946427142 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb20014440 con 0x7fbb280b38a0 2024-09-15T23:15:46.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.695+0000 7fbb2dcd0640 1 -- 172.21.15.123:0/2946427142 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb28160260 con 0x7fbb280b38a0 2024-09-15T23:15:46.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.695+0000 7fbb2dcd0640 1 -- 172.21.15.123:0/2946427142 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb28160820 con 0x7fbb280b38a0 2024-09-15T23:15:46.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.696+0000 7fbb2dcd0640 1 -- 172.21.15.123:0/2946427142 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb2806c3b0 con 0x7fbb280b38a0 2024-09-15T23:15:46.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.697+0000 7fbb0ffff640 1 -- 172.21.15.123:0/2946427142 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbb2001c070 con 0x7fbb280b38a0 2024-09-15T23:15:46.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.697+0000 7fbb0ffff640 1 --2- 172.21.15.123:0/2946427142 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbb1406c2e0 0x7fbb1406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:46.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.697+0000 7fbb0ffff640 1 -- 172.21.15.123:0/2946427142 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5115+0+0 (secure 0 0 0) 0x7fbb2008adb0 con 0x7fbb280b38a0 2024-09-15T23:15:46.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.697+0000 7fbb277fe640 1 --2- 172.21.15.123:0/2946427142 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbb1406c2e0 0x7fbb1406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:46.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.698+0000 7fbb277fe640 1 --2- 172.21.15.123:0/2946427142 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbb1406c2e0 0x7fbb1406e7a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbb18000f60 tx=0x7fbb18007b50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:46.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.701+0000 7fbb0ffff640 1 -- 172.21.15.123:0/2946427142 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbb20059770 con 0x7fbb280b38a0 2024-09-15T23:15:46.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.869+0000 7fbb2dcd0640 1 -- 172.21.15.123:0/2946427142 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fbb280ba3d0 con 0x7fbb280b38a0 2024-09-15T23:15:46.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.873+0000 7fbb0ffff640 1 -- 172.21.15.123:0/2946427142 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v20) ==== 104+0+0 (secure 0 0 0) 0x7fbb20059070 con 0x7fbb280b38a0 2024-09-15T23:15:46.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.875+0000 7fbb2dcd0640 1 -- 172.21.15.123:0/2946427142 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbb1406c2e0 msgr2=0x7fbb1406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:46.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.875+0000 7fbb2dcd0640 1 --2- 172.21.15.123:0/2946427142 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbb1406c2e0 0x7fbb1406e7a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbb18000f60 tx=0x7fbb18007b50 comp rx=0 tx=0).stop 2024-09-15T23:15:46.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.875+0000 7fbb2dcd0640 1 -- 172.21.15.123:0/2946427142 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb280b38a0 msgr2=0x7fbb280cac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:46.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.875+0000 7fbb2dcd0640 1 --2- 172.21.15.123:0/2946427142 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb280b38a0 0x7fbb280cac00 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fbb2000b970 tx=0x7fbb2000be30 comp rx=0 tx=0).stop 2024-09-15T23:15:46.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.875+0000 7fbb2dcd0640 1 -- 172.21.15.123:0/2946427142 shutdown_connections 2024-09-15T23:15:46.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.875+0000 7fbb2dcd0640 1 --2- 172.21.15.123:0/2946427142 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbb1406c2e0 0x7fbb1406e7a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:46.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.875+0000 7fbb2dcd0640 1 --2- 172.21.15.123:0/2946427142 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb280b38a0 0x7fbb280cac00 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:46.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.875+0000 7fbb2dcd0640 1 --2- 172.21.15.123:0/2946427142 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbb280b3350 0x7fbb281f79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:46.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.875+0000 7fbb2dcd0640 1 --2- 172.21.15.123:0/2946427142 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbb2806bfd0 0x7fbb28161300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:46.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.875+0000 7fbb2dcd0640 1 -- 172.21.15.123:0/2946427142 >> 172.21.15.123:0/2946427142 conn(0x7fbb280d11c0 msgr2=0x7fbb28162b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:46.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.875+0000 7fbb2dcd0640 1 -- 172.21.15.123:0/2946427142 shutdown_connections 2024-09-15T23:15:46.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.875+0000 7fbb2dcd0640 1 -- 172.21.15.123:0/2946427142 wait complete. 2024-09-15T23:15:46.887 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_split_bits 2024-09-15T23:15:46.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.986+0000 7f4304cf1640 1 Processor -- start 2024-09-15T23:15:46.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.986+0000 7f4304cf1640 1 -- start start 2024-09-15T23:15:46.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.987+0000 7f4304cf1640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f43000b7320 0x7f430006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:46.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.987+0000 7f4304cf1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f430006c150 0x7f430015ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:46.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.987+0000 7f4304cf1640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43000b5a80 con 0x7f430015c690 2024-09-15T23:15:46.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.987+0000 7f4304cf1640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f43000b6620 con 0x7f43000b7320 2024-09-15T23:15:46.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.987+0000 7f4304cf1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f43000cf1b0 con 0x7f430006c150 2024-09-15T23:15:46.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.987+0000 7f42f5d9b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f43000b7320 0x7f430006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:46.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.987+0000 7f42fe59c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f430015c690 0x7f43000ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60298/0 (socket says 172.21.15.123:60298) 2024-09-15T23:15:46.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.987+0000 7f42fe59c640 1 -- 172.21.15.123:0/106661323 learned_addr learned my addr 172.21.15.123:0/106661323 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:46.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.987+0000 7f42f5d9b640 1 -- 172.21.15.123:0/106661323 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f430006c150 msgr2=0x7f430015ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:46.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.987+0000 7f42f5d9b640 1 --2- 172.21.15.123:0/106661323 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f430006c150 0x7f430015ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:46.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.987+0000 7f42f5d9b640 1 -- 172.21.15.123:0/106661323 >> v1:172.21.15.123:6789/0 conn(0x7f430015c690 legacy=0x7f43000ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:46.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.987+0000 7f42f5d9b640 1 -- 172.21.15.123:0/106661323 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43000b6ab0 con 0x7f43000b7320 2024-09-15T23:15:46.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.987+0000 7f42fdd9b640 1 -- 172.21.15.123:0/106661323 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2004457500 0 0) 0x7f43000b5a80 con 0x7f430015c690 2024-09-15T23:15:46.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.988+0000 7f42f5d9b640 1 --2- 172.21.15.123:0/106661323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43000b7320 0x7f430006bc10 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f42e80097a0 tx=0x7f42e802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b77f564f3404e15 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:46.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.988+0000 7f42fdd9b640 1 -- 172.21.15.123:0/106661323 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e8037070 con 0x7f43000b7320 2024-09-15T23:15:46.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.988+0000 7f42fdd9b640 1 -- 172.21.15.123:0/106661323 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42e8032440 con 0x7f43000b7320 2024-09-15T23:15:46.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.988+0000 7f42fdd9b640 1 -- 172.21.15.123:0/106661323 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e8032810 con 0x7f43000b7320 2024-09-15T23:15:46.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.988+0000 7f4304cf1640 1 -- 172.21.15.123:0/106661323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43000b7320 msgr2=0x7f430006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:46.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.988+0000 7f4304cf1640 1 --2- 172.21.15.123:0/106661323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43000b7320 0x7f430006bc10 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f42e80097a0 tx=0x7f42e802a180 comp rx=0 tx=0).stop 2024-09-15T23:15:46.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.988+0000 7f4304cf1640 1 -- 172.21.15.123:0/106661323 shutdown_connections 2024-09-15T23:15:46.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.988+0000 7f4304cf1640 1 --2- 172.21.15.123:0/106661323 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f430006c150 0x7f430015ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:46.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.988+0000 7f4304cf1640 1 --2- 172.21.15.123:0/106661323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43000b7320 0x7f430006bc10 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:46.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.988+0000 7f4304cf1640 1 -- 172.21.15.123:0/106661323 >> 172.21.15.123:0/106661323 conn(0x7f430006cd20 msgr2=0x7f430006d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:46.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.988+0000 7f4304cf1640 1 -- 172.21.15.123:0/106661323 shutdown_connections 2024-09-15T23:15:46.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.989+0000 7f4304cf1640 1 -- 172.21.15.123:0/106661323 wait complete. 2024-09-15T23:15:46.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.990+0000 7f4304cf1640 1 Processor -- start 2024-09-15T23:15:46.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.990+0000 7f4304cf1640 1 -- start start 2024-09-15T23:15:46.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.991+0000 7f4304cf1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f430006c150 0x7f43000733c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:46.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.991+0000 7f4304cf1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43000b7320 0x7f43001e7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:46.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.991+0000 7f4304cf1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f430015c690 0x7f43001e56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:46.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.991+0000 7f4304cf1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f43000b62b0 con 0x7f430006c150 2024-09-15T23:15:46.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.991+0000 7f4304cf1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f43000b5fd0 con 0x7f43000b7320 2024-09-15T23:15:46.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.991+0000 7f4304cf1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f430015cfb0 con 0x7f430015c690 2024-09-15T23:15:46.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.991+0000 7f42fe59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f430006c150 0x7f43000733c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:46.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.991+0000 7f42fe59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f430006c150 0x7f43000733c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58498/0 (socket says 172.21.15.123:58498) 2024-09-15T23:15:46.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.991+0000 7f42fe59c640 1 -- 172.21.15.123:0/3335336103 learned_addr learned my addr 172.21.15.123:0/3335336103 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:46.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.991+0000 7f42fe59c640 1 -- 172.21.15.123:0/3335336103 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f430015c690 msgr2=0x7f43001e56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:46.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.991+0000 7f42fe59c640 1 --2- 172.21.15.123:0/3335336103 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f430015c690 0x7f43001e56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:46.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.991+0000 7f42fe59c640 1 -- 172.21.15.123:0/3335336103 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43000b7320 msgr2=0x7f43001e7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:46.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.991+0000 7f42fe59c640 1 --2- 172.21.15.123:0/3335336103 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43000b7320 0x7f43001e7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:46.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.991+0000 7f42fe59c640 1 -- 172.21.15.123:0/3335336103 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43001e61c0 con 0x7f430006c150 2024-09-15T23:15:46.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.991+0000 7f42fe59c640 1 --2- 172.21.15.123:0/3335336103 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f430006c150 0x7f43000733c0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f42f000c430 tx=0x7f42f000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:46.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.991+0000 7f42f77fe640 1 -- 172.21.15.123:0/3335336103 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f00074e0 con 0x7f430006c150 2024-09-15T23:15:46.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.991+0000 7f42f77fe640 1 -- 172.21.15.123:0/3335336103 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f00047e0 con 0x7f430006c150 2024-09-15T23:15:46.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.991+0000 7f42f77fe640 1 -- 172.21.15.123:0/3335336103 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f0004bd0 con 0x7f430006c150 2024-09-15T23:15:46.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.991+0000 7f4304cf1640 1 -- 172.21.15.123:0/3335336103 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43001e6780 con 0x7f430006c150 2024-09-15T23:15:46.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.991+0000 7f4304cf1640 1 -- 172.21.15.123:0/3335336103 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43001e6d40 con 0x7f430006c150 2024-09-15T23:15:46.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.992+0000 7f4304cf1640 1 -- 172.21.15.123:0/3335336103 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f430015ca70 con 0x7f430006c150 2024-09-15T23:15:46.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.993+0000 7f42f77fe640 1 -- 172.21.15.123:0/3335336103 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f42f0011070 con 0x7f430006c150 2024-09-15T23:15:46.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.993+0000 7f42f77fe640 1 --2- 172.21.15.123:0/3335336103 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f42e006c2b0 0x7f42e006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:46.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.994+0000 7f42f77fe640 1 -- 172.21.15.123:0/3335336103 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5115+0+0 (secure 0 0 0) 0x7f42f008ae70 con 0x7f430006c150 2024-09-15T23:15:46.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.994+0000 7f42f5d9b640 1 --2- 172.21.15.123:0/3335336103 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f42e006c2b0 0x7f42e006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:46.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.994+0000 7f42f5d9b640 1 --2- 172.21.15.123:0/3335336103 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f42e006c2b0 0x7f42e006e770 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f42e8034000 tx=0x7f42e802c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:46.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:46.998+0000 7f42f77fe640 1 -- 172.21.15.123:0/3335336103 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f42f0059840 con 0x7f430006c150 2024-09-15T23:15:47.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.163+0000 7f4304cf1640 1 -- 172.21.15.123:0/3335336103 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_split_bits"} v 0) -- 0x7f43000b1b20 con 0x7f430006c150 2024-09-15T23:15:47.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.166+0000 7f42f77fe640 1 -- 172.21.15.123:0/3335336103 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_split_bits"}]=0 v21) ==== 101+0+0 (secure 0 0 0) 0x7f42f0059140 con 0x7f430006c150 2024-09-15T23:15:47.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.168+0000 7f4304cf1640 1 -- 172.21.15.123:0/3335336103 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f42e006c2b0 msgr2=0x7f42e006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:47.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.168+0000 7f4304cf1640 1 --2- 172.21.15.123:0/3335336103 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f42e006c2b0 0x7f42e006e770 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f42e8034000 tx=0x7f42e802c000 comp rx=0 tx=0).stop 2024-09-15T23:15:47.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.168+0000 7f4304cf1640 1 -- 172.21.15.123:0/3335336103 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f430006c150 msgr2=0x7f43000733c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:47.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.168+0000 7f4304cf1640 1 --2- 172.21.15.123:0/3335336103 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f430006c150 0x7f43000733c0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f42f000c430 tx=0x7f42f000c8f0 comp rx=0 tx=0).stop 2024-09-15T23:15:47.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.168+0000 7f4304cf1640 1 -- 172.21.15.123:0/3335336103 shutdown_connections 2024-09-15T23:15:47.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.168+0000 7f4304cf1640 1 --2- 172.21.15.123:0/3335336103 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f430015c690 0x7f43001e56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:47.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.168+0000 7f4304cf1640 1 --2- 172.21.15.123:0/3335336103 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43000b7320 0x7f43001e7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:47.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.168+0000 7f4304cf1640 1 --2- 172.21.15.123:0/3335336103 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f42e006c2b0 0x7f42e006e770 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:47.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.168+0000 7f4304cf1640 1 --2- 172.21.15.123:0/3335336103 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f430006c150 0x7f43000733c0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:47.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.168+0000 7f4304cf1640 1 -- 172.21.15.123:0/3335336103 >> 172.21.15.123:0/3335336103 conn(0x7f430006cd20 msgr2=0x7f43000d05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:47.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.168+0000 7f4304cf1640 1 -- 172.21.15.123:0/3335336103 shutdown_connections 2024-09-15T23:15:47.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.168+0000 7f4304cf1640 1 -- 172.21.15.123:0/3335336103 wait complete. 2024-09-15T23:15:47.180 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_merge_size 2024-09-15T23:15:47.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.280+0000 7f5f663be640 1 Processor -- start 2024-09-15T23:15:47.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.280+0000 7f5f663be640 1 -- start start 2024-09-15T23:15:47.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.281+0000 7f5f663be640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f5f600b7320 0x7f5f6006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:47.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.281+0000 7f5f663be640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5f6006c150 0x7f5f6015ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:47.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.281+0000 7f5f663be640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f600b5a80 con 0x7f5f6015c690 2024-09-15T23:15:47.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.281+0000 7f5f663be640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f5f600b6620 con 0x7f5f6006c150 2024-09-15T23:15:47.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.281+0000 7f5f663be640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f5f600cf1b0 con 0x7f5f600b7320 2024-09-15T23:15:47.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.281+0000 7f5f5ffff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f5f6015c690 0x7f5f600ceaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60304/0 (socket says 172.21.15.123:60304) 2024-09-15T23:15:47.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.281+0000 7f5f5ffff640 1 -- 172.21.15.123:0/3016144906 learned_addr learned my addr 172.21.15.123:0/3016144906 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:47.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.281+0000 7f5f6495b640 1 --2- 172.21.15.123:0/3016144906 >> v2:172.21.15.123:3300/0 conn(0x7f5f6006c150 0x7f5f6015ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:47.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.281+0000 7f5f5f7fe640 1 --2- 172.21.15.123:0/3016144906 >> v2:172.21.15.188:3300/0 conn(0x7f5f600b7320 0x7f5f6006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:47.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.281+0000 7f5f6495b640 1 -- 172.21.15.123:0/3016144906 >> v2:172.21.15.188:3300/0 conn(0x7f5f600b7320 msgr2=0x7f5f6006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:47.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.281+0000 7f5f6495b640 1 --2- 172.21.15.123:0/3016144906 >> v2:172.21.15.188:3300/0 conn(0x7f5f600b7320 0x7f5f6006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:47.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.281+0000 7f5f6495b640 1 -- 172.21.15.123:0/3016144906 >> v1:172.21.15.123:6789/0 conn(0x7f5f6015c690 legacy=0x7f5f600ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:47.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.282+0000 7f5f5effd640 1 -- 172.21.15.123:0/3016144906 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 961215243 0 0) 0x7f5f600b5a80 con 0x7f5f6015c690 2024-09-15T23:15:47.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.282+0000 7f5f6495b640 1 -- 172.21.15.123:0/3016144906 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f600b6ab0 con 0x7f5f6006c150 2024-09-15T23:15:47.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.282+0000 7f5f6495b640 1 --2- 172.21.15.123:0/3016144906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f6006c150 0x7f5f6015ca70 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f5f600b7920 tx=0x7f5f5802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b505405e043f82 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:47.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.282+0000 7f5f5effd640 1 -- 172.21.15.123:0/3016144906 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f58007740 con 0x7f5f6006c150 2024-09-15T23:15:47.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.282+0000 7f5f5effd640 1 -- 172.21.15.123:0/3016144906 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f580078e0 con 0x7f5f6006c150 2024-09-15T23:15:47.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.282+0000 7f5f5effd640 1 -- 172.21.15.123:0/3016144906 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f58007cb0 con 0x7f5f6006c150 2024-09-15T23:15:47.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.283+0000 7f5f663be640 1 -- 172.21.15.123:0/3016144906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f6006c150 msgr2=0x7f5f6015ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:47.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.283+0000 7f5f663be640 1 --2- 172.21.15.123:0/3016144906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f6006c150 0x7f5f6015ca70 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f5f600b7920 tx=0x7f5f5802a680 comp rx=0 tx=0).stop 2024-09-15T23:15:47.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.283+0000 7f5f663be640 1 -- 172.21.15.123:0/3016144906 shutdown_connections 2024-09-15T23:15:47.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.283+0000 7f5f663be640 1 --2- 172.21.15.123:0/3016144906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f6006c150 0x7f5f6015ca70 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:47.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.283+0000 7f5f663be640 1 --2- 172.21.15.123:0/3016144906 >> v2:172.21.15.188:3300/0 conn(0x7f5f600b7320 0x7f5f6006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:47.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.283+0000 7f5f663be640 1 -- 172.21.15.123:0/3016144906 >> 172.21.15.123:0/3016144906 conn(0x7f5f6006cd20 msgr2=0x7f5f6006d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:47.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.283+0000 7f5f663be640 1 -- 172.21.15.123:0/3016144906 shutdown_connections 2024-09-15T23:15:47.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.283+0000 7f5f663be640 1 -- 172.21.15.123:0/3016144906 wait complete. 2024-09-15T23:15:47.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.284+0000 7f5f663be640 1 Processor -- start 2024-09-15T23:15:47.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.284+0000 7f5f663be640 1 -- start start 2024-09-15T23:15:47.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.285+0000 7f5f663be640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5f6006c150 0x7f5f60144a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:47.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.285+0000 7f5f663be640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f600b7320 0x7f5f601e68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:47.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.285+0000 7f5f663be640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5f6015c690 0x7f5f600ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:47.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.285+0000 7f5f663be640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5f600b62b0 con 0x7f5f600b7320 2024-09-15T23:15:47.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.285+0000 7f5f663be640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5f600b5fd0 con 0x7f5f6015c690 2024-09-15T23:15:47.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.285+0000 7f5f663be640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5f6015cfb0 con 0x7f5f6006c150 2024-09-15T23:15:47.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.285+0000 7f5f5f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f600b7320 0x7f5f601e68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:47.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.285+0000 7f5f5f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f600b7320 0x7f5f601e68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58520/0 (socket says 172.21.15.123:58520) 2024-09-15T23:15:47.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.285+0000 7f5f5f7fe640 1 -- 172.21.15.123:0/420479351 learned_addr learned my addr 172.21.15.123:0/420479351 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:47.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.285+0000 7f5f6495b640 1 --2- 172.21.15.123:0/420479351 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5f6015c690 0x7f5f600ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:47.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.285+0000 7f5f5ffff640 1 --2- 172.21.15.123:0/420479351 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5f6006c150 0x7f5f60144a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:47.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.285+0000 7f5f5f7fe640 1 -- 172.21.15.123:0/420479351 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5f6006c150 msgr2=0x7f5f60144a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:47.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.285+0000 7f5f5f7fe640 1 --2- 172.21.15.123:0/420479351 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5f6006c150 0x7f5f60144a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:47.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.285+0000 7f5f5f7fe640 1 -- 172.21.15.123:0/420479351 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5f6015c690 msgr2=0x7f5f600ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:47.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.285+0000 7f5f5f7fe640 1 --2- 172.21.15.123:0/420479351 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5f6015c690 0x7f5f600ccb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:47.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.285+0000 7f5f5f7fe640 1 -- 172.21.15.123:0/420479351 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f601e5820 con 0x7f5f600b7320 2024-09-15T23:15:47.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.285+0000 7f5f6495b640 1 --2- 172.21.15.123:0/420479351 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5f6015c690 0x7f5f600ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:47.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.286+0000 7f5f5f7fe640 1 --2- 172.21.15.123:0/420479351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f600b7320 0x7f5f601e68c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f5f4800d800 tx=0x7f5f4800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:47.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.286+0000 7f5f5cff9640 1 -- 172.21.15.123:0/420479351 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4800b6c0 con 0x7f5f600b7320 2024-09-15T23:15:47.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.286+0000 7f5f5cff9640 1 -- 172.21.15.123:0/420479351 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f48019070 con 0x7f5f600b7320 2024-09-15T23:15:47.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.286+0000 7f5f663be640 1 -- 172.21.15.123:0/420479351 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f601e5b00 con 0x7f5f600b7320 2024-09-15T23:15:47.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.286+0000 7f5f5cff9640 1 -- 172.21.15.123:0/420479351 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4800ba80 con 0x7f5f600b7320 2024-09-15T23:15:47.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.286+0000 7f5f663be640 1 -- 172.21.15.123:0/420479351 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f601e60c0 con 0x7f5f600b7320 2024-09-15T23:15:47.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.287+0000 7f5f663be640 1 -- 172.21.15.123:0/420479351 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f601e6e00 con 0x7f5f600b7320 2024-09-15T23:15:47.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.287+0000 7f5f5cff9640 1 -- 172.21.15.123:0/420479351 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5f4800bc20 con 0x7f5f600b7320 2024-09-15T23:15:47.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.288+0000 7f5f5cff9640 1 --2- 172.21.15.123:0/420479351 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5f4006c2b0 0x7f5f4006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:47.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.288+0000 7f5f5cff9640 1 -- 172.21.15.123:0/420479351 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5115+0+0 (secure 0 0 0) 0x7f5f4808b6b0 con 0x7f5f600b7320 2024-09-15T23:15:47.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.288+0000 7f5f5ffff640 1 --2- 172.21.15.123:0/420479351 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5f4006c2b0 0x7f5f4006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:47.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.288+0000 7f5f5ffff640 1 --2- 172.21.15.123:0/420479351 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5f4006c2b0 0x7f5f4006e770 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5f50000f60 tx=0x7f5f50007c00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:47.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.292+0000 7f5f5cff9640 1 -- 172.21.15.123:0/420479351 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5f4801c360 con 0x7f5f600b7320 2024-09-15T23:15:47.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.455+0000 7f5f663be640 1 -- 172.21.15.123:0/420479351 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_merge_size"} v 0) -- 0x7f5f600cdc30 con 0x7f5f600b7320 2024-09-15T23:15:47.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.458+0000 7f5f5cff9640 1 -- 172.21.15.123:0/420479351 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_merge_size"}]=0 v22) ==== 101+0+0 (secure 0 0 0) 0x7f5f4805a070 con 0x7f5f600b7320 2024-09-15T23:15:47.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.461+0000 7f5f663be640 1 -- 172.21.15.123:0/420479351 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5f4006c2b0 msgr2=0x7f5f4006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:47.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.461+0000 7f5f663be640 1 --2- 172.21.15.123:0/420479351 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5f4006c2b0 0x7f5f4006e770 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5f50000f60 tx=0x7f5f50007c00 comp rx=0 tx=0).stop 2024-09-15T23:15:47.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.461+0000 7f5f663be640 1 -- 172.21.15.123:0/420479351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f600b7320 msgr2=0x7f5f601e68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:47.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.461+0000 7f5f663be640 1 --2- 172.21.15.123:0/420479351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f600b7320 0x7f5f601e68c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f5f4800d800 tx=0x7f5f4800dcc0 comp rx=0 tx=0).stop 2024-09-15T23:15:47.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.461+0000 7f5f663be640 1 -- 172.21.15.123:0/420479351 shutdown_connections 2024-09-15T23:15:47.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.461+0000 7f5f663be640 1 --2- 172.21.15.123:0/420479351 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5f6015c690 0x7f5f600ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:47.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.461+0000 7f5f663be640 1 --2- 172.21.15.123:0/420479351 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5f4006c2b0 0x7f5f4006e770 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:47.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.461+0000 7f5f663be640 1 --2- 172.21.15.123:0/420479351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f600b7320 0x7f5f601e68c0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:47.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.461+0000 7f5f663be640 1 --2- 172.21.15.123:0/420479351 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5f6006c150 0x7f5f60144a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:47.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.461+0000 7f5f663be640 1 -- 172.21.15.123:0/420479351 >> 172.21.15.123:0/420479351 conn(0x7f5f6006cd20 msgr2=0x7f5f601e2050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:47.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.461+0000 7f5f663be640 1 -- 172.21.15.123:0/420479351 shutdown_connections 2024-09-15T23:15:47.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.461+0000 7f5f663be640 1 -- 172.21.15.123:0/420479351 wait complete. 2024-09-15T23:15:47.473 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_split_size 2024-09-15T23:15:47.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.572+0000 7f8404378640 1 Processor -- start 2024-09-15T23:15:47.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.572+0000 7f8404378640 1 -- start start 2024-09-15T23:15:47.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.573+0000 7f8404378640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f83fc15b7c0 0x7f83fc072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:47.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.573+0000 7f8404378640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f83fc06e200 0x7f83fc06e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:47.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.573+0000 7f8404378640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83fc06eb50 con 0x7f83fc073800 2024-09-15T23:15:47.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.573+0000 7f8404378640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f83fc0cccb0 con 0x7f83fc15b7c0 2024-09-15T23:15:47.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.573+0000 7f8404378640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f83fc072760 con 0x7f83fc06e200 2024-09-15T23:15:47.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.573+0000 7f8402114640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f83fc15b7c0 0x7f83fc072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:47.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.573+0000 7f8401913640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f83fc073800 0x7f83fc0cc5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60320/0 (socket says 172.21.15.123:60320) 2024-09-15T23:15:47.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.573+0000 7f8402114640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f83fc15b7c0 0x7f83fc072160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58524/0 (socket says 172.21.15.123:58524) 2024-09-15T23:15:47.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.573+0000 7f8401913640 1 -- 172.21.15.123:0/1725520343 learned_addr learned my addr 172.21.15.123:0/1725520343 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:47.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.573+0000 7f8402915640 1 --2- 172.21.15.123:0/1725520343 >> v2:172.21.15.188:3300/0 conn(0x7f83fc06e200 0x7f83fc06e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:47.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.573+0000 7f8402114640 1 -- 172.21.15.123:0/1725520343 >> v2:172.21.15.188:3300/0 conn(0x7f83fc06e200 msgr2=0x7f83fc06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:47.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.573+0000 7f8402114640 1 --2- 172.21.15.123:0/1725520343 >> v2:172.21.15.188:3300/0 conn(0x7f83fc06e200 0x7f83fc06e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:47.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.573+0000 7f8402114640 1 -- 172.21.15.123:0/1725520343 >> v1:172.21.15.123:6789/0 conn(0x7f83fc073800 legacy=0x7f83fc0cc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:47.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.573+0000 7f8402114640 1 -- 172.21.15.123:0/1725520343 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83fc072a40 con 0x7f83fc15b7c0 2024-09-15T23:15:47.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.573+0000 7f8401112640 1 -- 172.21.15.123:0/1725520343 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2059172986 0 0) 0x7f83f8001110 con 0x7f83fc073800 2024-09-15T23:15:47.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.574+0000 7f8402114640 1 --2- 172.21.15.123:0/1725520343 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83fc15b7c0 0x7f83fc072160 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f83fc070a60 tx=0x7f83f002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53c6e7c3005211e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:47.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.574+0000 7f8401112640 1 -- 172.21.15.123:0/1725520343 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f0037070 con 0x7f83fc15b7c0 2024-09-15T23:15:47.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.574+0000 7f8401112640 1 -- 172.21.15.123:0/1725520343 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83f0032440 con 0x7f83fc15b7c0 2024-09-15T23:15:47.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.574+0000 7f8401112640 1 -- 172.21.15.123:0/1725520343 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f0032810 con 0x7f83fc15b7c0 2024-09-15T23:15:47.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.574+0000 7f8404378640 1 -- 172.21.15.123:0/1725520343 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83fc15b7c0 msgr2=0x7f83fc072160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:47.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.574+0000 7f8404378640 1 --2- 172.21.15.123:0/1725520343 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83fc15b7c0 0x7f83fc072160 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f83fc070a60 tx=0x7f83f002a1a0 comp rx=0 tx=0).stop 2024-09-15T23:15:47.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.574+0000 7f8404378640 1 -- 172.21.15.123:0/1725520343 shutdown_connections 2024-09-15T23:15:47.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.574+0000 7f8404378640 1 --2- 172.21.15.123:0/1725520343 >> v2:172.21.15.188:3300/0 conn(0x7f83fc06e200 0x7f83fc06e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:47.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.574+0000 7f8404378640 1 --2- 172.21.15.123:0/1725520343 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83fc15b7c0 0x7f83fc072160 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:47.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.574+0000 7f8404378640 1 -- 172.21.15.123:0/1725520343 >> 172.21.15.123:0/1725520343 conn(0x7f83fc0d14d0 msgr2=0x7f83fc0d18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:47.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.575+0000 7f8404378640 1 -- 172.21.15.123:0/1725520343 shutdown_connections 2024-09-15T23:15:47.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.575+0000 7f8404378640 1 -- 172.21.15.123:0/1725520343 wait complete. 2024-09-15T23:15:47.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.576+0000 7f8404378640 1 Processor -- start 2024-09-15T23:15:47.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.576+0000 7f8404378640 1 -- start start 2024-09-15T23:15:47.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.576+0000 7f8404378640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f83fc06e200 0x7f83fc1508f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:47.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.576+0000 7f8404378640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83fc073800 0x7f83fc1f5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:47.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.576+0000 7f8404378640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f83fc15b7c0 0x7f83fc15dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:47.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.576+0000 7f8404378640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f83fc0732e0 con 0x7f83fc073800 2024-09-15T23:15:47.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.576+0000 7f8404378640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f83fc073000 con 0x7f83fc15b7c0 2024-09-15T23:15:47.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.576+0000 7f8404378640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f83fc0cf8a0 con 0x7f83fc06e200 2024-09-15T23:15:47.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.577+0000 7f8401913640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83fc073800 0x7f83fc1f5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:47.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.577+0000 7f8401913640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83fc073800 0x7f83fc1f5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58532/0 (socket says 172.21.15.123:58532) 2024-09-15T23:15:47.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.577+0000 7f8401913640 1 -- 172.21.15.123:0/939227727 learned_addr learned my addr 172.21.15.123:0/939227727 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:47.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.577+0000 7f8402915640 1 --2- 172.21.15.123:0/939227727 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f83fc15b7c0 0x7f83fc15dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:47.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.577+0000 7f8402114640 1 --2- 172.21.15.123:0/939227727 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f83fc06e200 0x7f83fc1508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:47.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.577+0000 7f8401913640 1 -- 172.21.15.123:0/939227727 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f83fc06e200 msgr2=0x7f83fc1508f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:47.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.577+0000 7f8401913640 1 --2- 172.21.15.123:0/939227727 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f83fc06e200 0x7f83fc1508f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:47.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.577+0000 7f8401913640 1 -- 172.21.15.123:0/939227727 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f83fc15b7c0 msgr2=0x7f83fc15dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:47.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.577+0000 7f8401913640 1 --2- 172.21.15.123:0/939227727 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f83fc15b7c0 0x7f83fc15dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:47.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.577+0000 7f8401913640 1 -- 172.21.15.123:0/939227727 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83fc0c9f30 con 0x7f83fc073800 2024-09-15T23:15:47.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.577+0000 7f8402114640 1 --2- 172.21.15.123:0/939227727 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f83fc06e200 0x7f83fc1508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:47.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.577+0000 7f8401913640 1 --2- 172.21.15.123:0/939227727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83fc073800 0x7f83fc1f5100 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f83f800c750 tx=0x7f83f800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:47.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.577+0000 7f83eeffd640 1 -- 172.21.15.123:0/939227727 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f8018070 con 0x7f83fc073800 2024-09-15T23:15:47.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.577+0000 7f83eeffd640 1 -- 172.21.15.123:0/939227727 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83f80072d0 con 0x7f83fc073800 2024-09-15T23:15:47.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.577+0000 7f83eeffd640 1 -- 172.21.15.123:0/939227727 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f80047e0 con 0x7f83fc073800 2024-09-15T23:15:47.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.577+0000 7f8404378640 1 -- 172.21.15.123:0/939227727 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83fc0ca210 con 0x7f83fc073800 2024-09-15T23:15:47.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.577+0000 7f8404378640 1 -- 172.21.15.123:0/939227727 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83fc1f48c0 con 0x7f83fc073800 2024-09-15T23:15:47.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.578+0000 7f8404378640 1 -- 172.21.15.123:0/939227727 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83fc06e610 con 0x7f83fc073800 2024-09-15T23:15:47.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.579+0000 7f83eeffd640 1 -- 172.21.15.123:0/939227727 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f83f801b070 con 0x7f83fc073800 2024-09-15T23:15:47.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.579+0000 7f83eeffd640 1 --2- 172.21.15.123:0/939227727 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f83e006c2b0 0x7f83e006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:47.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.579+0000 7f83eeffd640 1 -- 172.21.15.123:0/939227727 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5115+0+0 (secure 0 0 0) 0x7f83f808a400 con 0x7f83fc073800 2024-09-15T23:15:47.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.579+0000 7f8402114640 1 --2- 172.21.15.123:0/939227727 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f83e006c2b0 0x7f83e006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:47.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.580+0000 7f8402114640 1 --2- 172.21.15.123:0/939227727 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f83e006c2b0 0x7f83e006e770 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f83f0034000 tx=0x7f83f002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:47.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.583+0000 7f83eeffd640 1 -- 172.21.15.123:0/939227727 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f83fc06eb50 con 0x7f83fc073800 2024-09-15T23:15:47.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.752+0000 7f8404378640 1 -- 172.21.15.123:0/939227727 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_split_size"} v 0) -- 0x7f83fc0741d0 con 0x7f83fc073800 2024-09-15T23:15:47.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.755+0000 7f83eeffd640 1 -- 172.21.15.123:0/939227727 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_split_size"}]=0 v23) ==== 101+0+0 (secure 0 0 0) 0x7f83f8058800 con 0x7f83fc073800 2024-09-15T23:15:47.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.758+0000 7f8404378640 1 -- 172.21.15.123:0/939227727 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f83e006c2b0 msgr2=0x7f83e006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:47.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.758+0000 7f8404378640 1 --2- 172.21.15.123:0/939227727 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f83e006c2b0 0x7f83e006e770 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f83f0034000 tx=0x7f83f002e000 comp rx=0 tx=0).stop 2024-09-15T23:15:47.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.758+0000 7f8404378640 1 -- 172.21.15.123:0/939227727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83fc073800 msgr2=0x7f83fc1f5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:47.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.758+0000 7f8404378640 1 --2- 172.21.15.123:0/939227727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83fc073800 0x7f83fc1f5100 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f83f800c750 tx=0x7f83f800cc10 comp rx=0 tx=0).stop 2024-09-15T23:15:47.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.758+0000 7f8404378640 1 -- 172.21.15.123:0/939227727 shutdown_connections 2024-09-15T23:15:47.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.758+0000 7f8404378640 1 --2- 172.21.15.123:0/939227727 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f83fc15b7c0 0x7f83fc15dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:47.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.758+0000 7f8404378640 1 --2- 172.21.15.123:0/939227727 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f83e006c2b0 0x7f83e006e770 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:47.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.758+0000 7f8404378640 1 --2- 172.21.15.123:0/939227727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83fc073800 0x7f83fc1f5100 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:47.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.758+0000 7f8404378640 1 --2- 172.21.15.123:0/939227727 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f83fc06e200 0x7f83fc1508f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:47.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.758+0000 7f8404378640 1 -- 172.21.15.123:0/939227727 >> 172.21.15.123:0/939227727 conn(0x7f83fc0d14d0 msgr2=0x7f83fc0b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:47.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.758+0000 7f8404378640 1 -- 172.21.15.123:0/939227727 shutdown_connections 2024-09-15T23:15:47.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.758+0000 7f8404378640 1 -- 172.21.15.123:0/939227727 wait complete. 2024-09-15T23:15:47.769 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags' 2024-09-15T23:15:47.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.867+0000 7f96a5ad0640 1 Processor -- start 2024-09-15T23:15:47.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.867+0000 7f96a5ad0640 1 -- start start 2024-09-15T23:15:47.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.868+0000 7f96a5ad0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96a00b2d40 0x7f96a006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:47.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.868+0000 7f96a5ad0640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f96a006c150 0x7f96a015c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:47.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.868+0000 7f96a5ad0640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96a0071180 con 0x7f96a013eb20 2024-09-15T23:15:47.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.868+0000 7f96a5ad0640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f96a0071ab0 con 0x7f96a006c150 2024-09-15T23:15:47.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.868+0000 7f96a5ad0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f96a0071460 con 0x7f96a00b2d40 2024-09-15T23:15:47.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.868+0000 7f969effd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f96a013eb20 0x7f96a015bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60322/0 (socket says 172.21.15.123:60322) 2024-09-15T23:15:47.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.868+0000 7f969effd640 1 -- 172.21.15.123:0/4162845485 learned_addr learned my addr 172.21.15.123:0/4162845485 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:47.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.868+0000 7f969ffff640 1 --2- 172.21.15.123:0/4162845485 >> v2:172.21.15.188:3300/0 conn(0x7f96a006c150 0x7f96a015c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:47.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.868+0000 7f969f7fe640 1 --2- 172.21.15.123:0/4162845485 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96a00b2d40 0x7f96a006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:47.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.868+0000 7f969e7fc640 1 -- 172.21.15.123:0/4162845485 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1208280610 0 0) 0x7f96a0071180 con 0x7f96a013eb20 2024-09-15T23:15:47.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.869+0000 7f969e7fc640 1 -- 172.21.15.123:0/4162845485 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9688003520 con 0x7f96a013eb20 2024-09-15T23:15:47.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.869+0000 7f969e7fc640 1 -- 172.21.15.123:0/4162845485 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2437821420 0 0) 0x7f9688003520 con 0x7f96a013eb20 2024-09-15T23:15:47.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.869+0000 7f969e7fc640 1 -- 172.21.15.123:0/4162845485 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96a00b2d40 msgr2=0x7f96a006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:47.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.869+0000 7f969e7fc640 1 --2- 172.21.15.123:0/4162845485 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96a00b2d40 0x7f96a006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:47.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.869+0000 7f969e7fc640 1 -- 172.21.15.123:0/4162845485 >> v2:172.21.15.188:3300/0 conn(0x7f96a006c150 msgr2=0x7f96a015c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:47.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.869+0000 7f969e7fc640 1 --2- 172.21.15.123:0/4162845485 >> v2:172.21.15.188:3300/0 conn(0x7f96a006c150 0x7f96a015c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:47.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.869+0000 7f969e7fc640 1 -- 172.21.15.123:0/4162845485 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a0071740 con 0x7f96a013eb20 2024-09-15T23:15:47.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.869+0000 7f969e7fc640 1 -- 172.21.15.123:0/4162845485 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f9694001670 con 0x7f96a013eb20 2024-09-15T23:15:47.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.869+0000 7f969e7fc640 1 -- 172.21.15.123:0/4162845485 >> v1:172.21.15.123:6789/0 conn(0x7f96a013eb20 legacy=0x7f96a015bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:47.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.869+0000 7f969e7fc640 1 --2- 172.21.15.123:0/4162845485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96880039b0 0x7f9688003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:47.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.869+0000 7f969e7fc640 1 --2- 172.21.15.123:0/4162845485 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96a00b2d40 0x7f9688004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:47.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.869+0000 7f969e7fc640 1 --2- 172.21.15.123:0/4162845485 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9688004d40 0x7f96880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:47.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.869+0000 7f969e7fc640 1 -- 172.21.15.123:0/4162845485 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f96a0071ab0 con 0x7f96880039b0 2024-09-15T23:15:47.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.869+0000 7f969e7fc640 1 -- 172.21.15.123:0/4162845485 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f96a0071460 con 0x7f9688004d40 2024-09-15T23:15:47.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.869+0000 7f969e7fc640 1 -- 172.21.15.123:0/4162845485 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f968800b9c0 con 0x7f96a00b2d40 2024-09-15T23:15:47.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.869+0000 7f969f7fe640 1 --2- 172.21.15.123:0/4162845485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96880039b0 0x7f9688003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:47.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.869+0000 7f969ffff640 1 --2- 172.21.15.123:0/4162845485 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9688004d40 0x7f96880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:47.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.869+0000 7f969effd640 1 --2- 172.21.15.123:0/4162845485 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96a00b2d40 0x7f9688004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:47.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.869+0000 7f969f7fe640 1 -- 172.21.15.123:0/4162845485 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96a00b2d40 msgr2=0x7f9688004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:47.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.869+0000 7f969f7fe640 1 --2- 172.21.15.123:0/4162845485 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96a00b2d40 0x7f9688004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:47.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.869+0000 7f969f7fe640 1 -- 172.21.15.123:0/4162845485 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9688004d40 msgr2=0x7f96880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:47.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.869+0000 7f969f7fe640 1 --2- 172.21.15.123:0/4162845485 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9688004d40 0x7f96880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:47.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.869+0000 7f969f7fe640 1 -- 172.21.15.123:0/4162845485 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9688003520 con 0x7f96880039b0 2024-09-15T23:15:47.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.869+0000 7f969effd640 1 --2- 172.21.15.123:0/4162845485 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96a00b2d40 0x7f9688004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:47.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.870+0000 7f969f7fe640 1 --2- 172.21.15.123:0/4162845485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96880039b0 0x7f9688003df0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f9690009ac0 tx=0x7f9688005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51a9e4a18b1e647 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:47.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.870+0000 7f969e7fc640 1 -- 172.21.15.123:0/4162845485 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9690036070 con 0x7f96880039b0 2024-09-15T23:15:47.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.870+0000 7f969e7fc640 1 -- 172.21.15.123:0/4162845485 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9690031400 con 0x7f96880039b0 2024-09-15T23:15:47.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.870+0000 7f969e7fc640 1 -- 172.21.15.123:0/4162845485 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9690009690 con 0x7f96880039b0 2024-09-15T23:15:47.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.871+0000 7f96a5ad0640 1 -- 172.21.15.123:0/4162845485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96880039b0 msgr2=0x7f9688003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:47.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.871+0000 7f96a5ad0640 1 --2- 172.21.15.123:0/4162845485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96880039b0 0x7f9688003df0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f9690009ac0 tx=0x7f9688005830 comp rx=0 tx=0).stop 2024-09-15T23:15:47.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.871+0000 7f969ffff640 1 -- 172.21.15.123:0/4162845485 reap_dead start 2024-09-15T23:15:47.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.871+0000 7f96a5ad0640 1 -- 172.21.15.123:0/4162845485 shutdown_connections 2024-09-15T23:15:47.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.871+0000 7f96a5ad0640 1 -- 172.21.15.123:0/4162845485 >> 172.21.15.123:0/4162845485 conn(0x7f96a00ccec0 msgr2=0x7f96a00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:47.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.871+0000 7f96a5ad0640 1 -- 172.21.15.123:0/4162845485 shutdown_connections 2024-09-15T23:15:47.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.871+0000 7f96a5ad0640 1 -- 172.21.15.123:0/4162845485 wait complete. 2024-09-15T23:15:47.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.872+0000 7f96a5ad0640 1 Processor -- start 2024-09-15T23:15:47.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.872+0000 7f96a5ad0640 1 -- start start 2024-09-15T23:15:47.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.873+0000 7f96a5ad0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f96880039b0 0x7f96a0154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:47.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.873+0000 7f96a5ad0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96a0154c30 0x7f96a00b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:47.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.873+0000 7f96a5ad0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96a00b4330 0x7f96a00b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:47.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.873+0000 7f96a5ad0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f96a006bfa0 con 0x7f96a00b4330 2024-09-15T23:15:47.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.873+0000 7f96a5ad0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f96a006be20 con 0x7f96880039b0 2024-09-15T23:15:47.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.873+0000 7f96a5ad0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f96a0071f40 con 0x7f96a0154c30 2024-09-15T23:15:47.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.873+0000 7f969ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96a00b4330 0x7f96a00b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:47.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.873+0000 7f969ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96a00b4330 0x7f96a00b47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58552/0 (socket says 172.21.15.123:58552) 2024-09-15T23:15:47.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.873+0000 7f969ffff640 1 -- 172.21.15.123:0/3920581799 learned_addr learned my addr 172.21.15.123:0/3920581799 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:47.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.873+0000 7f969effd640 1 --2- 172.21.15.123:0/3920581799 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96a0154c30 0x7f96a00b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:47.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.873+0000 7f969f7fe640 1 --2- 172.21.15.123:0/3920581799 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f96880039b0 0x7f96a0154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:47.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.873+0000 7f969ffff640 1 -- 172.21.15.123:0/3920581799 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96a0154c30 msgr2=0x7f96a00b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:47.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.873+0000 7f969ffff640 1 --2- 172.21.15.123:0/3920581799 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96a0154c30 0x7f96a00b3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:47.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.873+0000 7f969ffff640 1 -- 172.21.15.123:0/3920581799 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f96880039b0 msgr2=0x7f96a0154500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:47.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.873+0000 7f969ffff640 1 --2- 172.21.15.123:0/3920581799 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f96880039b0 0x7f96a0154500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:47.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.873+0000 7f969ffff640 1 -- 172.21.15.123:0/3920581799 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a00b3930 con 0x7f96a00b4330 2024-09-15T23:15:47.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.873+0000 7f969ffff640 1 --2- 172.21.15.123:0/3920581799 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96a00b4330 0x7f96a00b47e0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f96a00cdf80 tx=0x7f969800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:47.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.873+0000 7f9687fff640 1 -- 172.21.15.123:0/3920581799 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969800fde0 con 0x7f96a00b4330 2024-09-15T23:15:47.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.873+0000 7f9687fff640 1 -- 172.21.15.123:0/3920581799 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f969801d070 con 0x7f96a00b4330 2024-09-15T23:15:47.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.873+0000 7f96a5ad0640 1 -- 172.21.15.123:0/3920581799 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96a00b5bb0 con 0x7f96a00b4330 2024-09-15T23:15:47.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.873+0000 7f9687fff640 1 -- 172.21.15.123:0/3920581799 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9698015670 con 0x7f96a00b4330 2024-09-15T23:15:47.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.873+0000 7f96a5ad0640 1 -- 172.21.15.123:0/3920581799 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96a00b3570 con 0x7f96a00b4330 2024-09-15T23:15:47.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.874+0000 7f96a5ad0640 1 -- 172.21.15.123:0/3920581799 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96a0072320 con 0x7f96a00b4330 2024-09-15T23:15:47.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.875+0000 7f9687fff640 1 -- 172.21.15.123:0/3920581799 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9698015810 con 0x7f96a00b4330 2024-09-15T23:15:47.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.875+0000 7f9687fff640 1 --2- 172.21.15.123:0/3920581799 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f968c06c2b0 0x7f968c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:47.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.875+0000 7f9687fff640 1 -- 172.21.15.123:0/3920581799 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5115+0+0 (secure 0 0 0) 0x7f969808baa0 con 0x7f96a00b4330 2024-09-15T23:15:47.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.876+0000 7f969f7fe640 1 --2- 172.21.15.123:0/3920581799 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f968c06c2b0 0x7f968c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:47.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.876+0000 7f969f7fe640 1 --2- 172.21.15.123:0/3920581799 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f968c06c2b0 0x7f968c06e770 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9690033000 tx=0x7f9690008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:47.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:47.880+0000 7f9687fff640 1 -- 172.21.15.123:0/3920581799 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9698010040 con 0x7f96a00b4330 2024-09-15T23:15:48.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.108+0000 7f96a5ad0640 1 -- 172.21.15.123:0/3920581799 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]} v 0) -- 0x7f96a006c9c0 con 0x7f96a00b4330 2024-09-15T23:15:48.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.569+0000 7f9687fff640 1 -- 172.21.15.123:0/3920581799 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_merge_dirfrags"]}]=0 v194) ==== 151+0+0 (secure 0 0 0) 0x7f969805a460 con 0x7f96a00b4330 2024-09-15T23:15:48.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.571+0000 7f96a5ad0640 1 -- 172.21.15.123:0/3920581799 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f968c06c2b0 msgr2=0x7f968c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:48.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.571+0000 7f96a5ad0640 1 --2- 172.21.15.123:0/3920581799 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f968c06c2b0 0x7f968c06e770 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9690033000 tx=0x7f9690008030 comp rx=0 tx=0).stop 2024-09-15T23:15:48.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.571+0000 7f96a5ad0640 1 -- 172.21.15.123:0/3920581799 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96a00b4330 msgr2=0x7f96a00b47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:48.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.571+0000 7f96a5ad0640 1 --2- 172.21.15.123:0/3920581799 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96a00b4330 0x7f96a00b47e0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f96a00cdf80 tx=0x7f969800f580 comp rx=0 tx=0).stop 2024-09-15T23:15:48.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.571+0000 7f96a5ad0640 1 -- 172.21.15.123:0/3920581799 shutdown_connections 2024-09-15T23:15:48.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.571+0000 7f96a5ad0640 1 --2- 172.21.15.123:0/3920581799 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f968c06c2b0 0x7f968c06e770 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:48.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.571+0000 7f96a5ad0640 1 --2- 172.21.15.123:0/3920581799 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96a00b4330 0x7f96a00b47e0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:48.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.571+0000 7f96a5ad0640 1 --2- 172.21.15.123:0/3920581799 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96a0154c30 0x7f96a00b3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:48.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.571+0000 7f96a5ad0640 1 --2- 172.21.15.123:0/3920581799 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f96880039b0 0x7f96a0154500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:48.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.571+0000 7f96a5ad0640 1 -- 172.21.15.123:0/3920581799 >> 172.21.15.123:0/3920581799 conn(0x7f96a00ccec0 msgr2=0x7f96a013f160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:48.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.571+0000 7f96a5ad0640 1 -- 172.21.15.123:0/3920581799 shutdown_connections 2024-09-15T23:15:48.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.571+0000 7f96a5ad0640 1 -- 172.21.15.123:0/3920581799 wait complete. 2024-09-15T23:15:48.583 INFO:tasks.cephfs_test_runner:That a directory is merged during scrub. ... ok 2024-09-15T23:15:48.584 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_repair (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-15T23:15:48.584 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:15:48.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.681+0000 7f94c04b7640 1 Processor -- start 2024-09-15T23:15:48.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.682+0000 7f94c04b7640 1 -- start start 2024-09-15T23:15:48.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.682+0000 7f94c04b7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f94b815ed20 0x7f94b80b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:48.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.682+0000 7f94c04b7640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f94b80b90e0 0x7f94b80b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:48.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.682+0000 7f94c04b7640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94b80d0e70 con 0x7f94b80d23b0 2024-09-15T23:15:48.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.682+0000 7f94c04b7640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f94b80d41c0 con 0x7f94b80b90e0 2024-09-15T23:15:48.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.682+0000 7f94c04b7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f94b80d35b0 con 0x7f94b815ed20 2024-09-15T23:15:48.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.683+0000 7f94bda52640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f94b80d23b0 0x7f94b80cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60336/0 (socket says 172.21.15.123:60336) 2024-09-15T23:15:48.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.683+0000 7f94bda52640 1 -- 172.21.15.123:0/2287321871 learned_addr learned my addr 172.21.15.123:0/2287321871 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:48.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.683+0000 7f94bea54640 1 --2- 172.21.15.123:0/2287321871 >> v2:172.21.15.188:3300/0 conn(0x7f94b80b90e0 0x7f94b80b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:48.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.683+0000 7f94be253640 1 --2- 172.21.15.123:0/2287321871 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f94b815ed20 0x7f94b80b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:48.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.683+0000 7f94bd251640 1 -- 172.21.15.123:0/2287321871 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1102339235 0 0) 0x7f94a8001110 con 0x7f94b80d23b0 2024-09-15T23:15:48.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.683+0000 7f94bd251640 1 -- 172.21.15.123:0/2287321871 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94a4003520 con 0x7f94b80d23b0 2024-09-15T23:15:48.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.683+0000 7f94bd251640 1 -- 172.21.15.123:0/2287321871 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 370054207 0 0) 0x7f94a4003520 con 0x7f94b80d23b0 2024-09-15T23:15:48.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.683+0000 7f94bd251640 1 -- 172.21.15.123:0/2287321871 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f94b815ed20 msgr2=0x7f94b80b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:48.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.683+0000 7f94bd251640 1 --2- 172.21.15.123:0/2287321871 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f94b815ed20 0x7f94b80b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:48.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.683+0000 7f94bd251640 1 -- 172.21.15.123:0/2287321871 >> v2:172.21.15.188:3300/0 conn(0x7f94b80b90e0 msgr2=0x7f94b80b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:48.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.683+0000 7f94bd251640 1 --2- 172.21.15.123:0/2287321871 >> v2:172.21.15.188:3300/0 conn(0x7f94b80b90e0 0x7f94b80b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:48.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.683+0000 7f94bd251640 1 -- 172.21.15.123:0/2287321871 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94b80d3890 con 0x7f94b80d23b0 2024-09-15T23:15:48.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.683+0000 7f94bd251640 1 -- 172.21.15.123:0/2287321871 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f94a8001840 con 0x7f94b80d23b0 2024-09-15T23:15:48.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.683+0000 7f94bd251640 1 -- 172.21.15.123:0/2287321871 >> v1:172.21.15.123:6789/0 conn(0x7f94b80d23b0 legacy=0x7f94b80cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:48.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.683+0000 7f94bd251640 1 --2- 172.21.15.123:0/2287321871 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94a40039b0 0x7f94a4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:48.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.683+0000 7f94bd251640 1 --2- 172.21.15.123:0/2287321871 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f94b815ed20 0x7f94a4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:48.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.683+0000 7f94bd251640 1 --2- 172.21.15.123:0/2287321871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94a4004d40 0x7f94a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:48.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.683+0000 7f94bd251640 1 -- 172.21.15.123:0/2287321871 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f94b80d41c0 con 0x7f94a4004d40 2024-09-15T23:15:48.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.683+0000 7f94bd251640 1 -- 172.21.15.123:0/2287321871 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f94b80d35b0 con 0x7f94a40039b0 2024-09-15T23:15:48.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.683+0000 7f94bd251640 1 -- 172.21.15.123:0/2287321871 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f94a400b9c0 con 0x7f94b815ed20 2024-09-15T23:15:48.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.683+0000 7f94bea54640 1 --2- 172.21.15.123:0/2287321871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94a4004d40 0x7f94a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:48.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.683+0000 7f94bda52640 1 --2- 172.21.15.123:0/2287321871 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f94b815ed20 0x7f94a4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:48.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.683+0000 7f94be253640 1 --2- 172.21.15.123:0/2287321871 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94a40039b0 0x7f94a4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:48.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.684+0000 7f94bea54640 1 -- 172.21.15.123:0/2287321871 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f94b815ed20 msgr2=0x7f94a4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:48.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.684+0000 7f94bea54640 1 --2- 172.21.15.123:0/2287321871 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f94b815ed20 0x7f94a4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:48.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.684+0000 7f94bea54640 1 -- 172.21.15.123:0/2287321871 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94a40039b0 msgr2=0x7f94a4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:48.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.684+0000 7f94bea54640 1 --2- 172.21.15.123:0/2287321871 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94a40039b0 0x7f94a4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:48.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.684+0000 7f94bea54640 1 -- 172.21.15.123:0/2287321871 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94a4003520 con 0x7f94a4004d40 2024-09-15T23:15:48.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.684+0000 7f94bea54640 1 --2- 172.21.15.123:0/2287321871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94a4004d40 0x7f94a40051c0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f94b0009f90 tx=0x7f94a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5c320bc242b1619 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:48.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.684+0000 7f94bd251640 1 -- 172.21.15.123:0/2287321871 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b0009c10 con 0x7f94a4004d40 2024-09-15T23:15:48.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.684+0000 7f94bd251640 1 -- 172.21.15.123:0/2287321871 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94b0036070 con 0x7f94a4004d40 2024-09-15T23:15:48.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.684+0000 7f94bd251640 1 -- 172.21.15.123:0/2287321871 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b0031840 con 0x7f94a4004d40 2024-09-15T23:15:48.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.685+0000 7f94c04b7640 1 -- 172.21.15.123:0/2287321871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94a4004d40 msgr2=0x7f94a40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:48.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.685+0000 7f94c04b7640 1 --2- 172.21.15.123:0/2287321871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94a4004d40 0x7f94a40051c0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f94b0009f90 tx=0x7f94a4005830 comp rx=0 tx=0).stop 2024-09-15T23:15:48.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.685+0000 7f94bea54640 1 -- 172.21.15.123:0/2287321871 reap_dead start 2024-09-15T23:15:48.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.685+0000 7f94c04b7640 1 -- 172.21.15.123:0/2287321871 shutdown_connections 2024-09-15T23:15:48.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.685+0000 7f94c04b7640 1 -- 172.21.15.123:0/2287321871 >> 172.21.15.123:0/2287321871 conn(0x7f94b80d1260 msgr2=0x7f94b80d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:48.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.685+0000 7f94c04b7640 1 -- 172.21.15.123:0/2287321871 shutdown_connections 2024-09-15T23:15:48.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.685+0000 7f94c04b7640 1 -- 172.21.15.123:0/2287321871 wait complete. 2024-09-15T23:15:48.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.686+0000 7f94c04b7640 1 Processor -- start 2024-09-15T23:15:48.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.686+0000 7f94c04b7640 1 -- start start 2024-09-15T23:15:48.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.687+0000 7f94c04b7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94a4004d40 0x7f94b81e7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:48.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.687+0000 7f94c04b7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94b80c8dd0 0x7f94b80c9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:48.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.687+0000 7f94c04b7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f94b80cdfe0 0x7f94b80ce460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:48.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.687+0000 7f94c04b7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f94b80d32a0 con 0x7f94a4004d40 2024-09-15T23:15:48.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.687+0000 7f94c04b7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f94b80d3e50 con 0x7f94b80c8dd0 2024-09-15T23:15:48.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.687+0000 7f94c04b7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f94b815f100 con 0x7f94b80cdfe0 2024-09-15T23:15:48.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.687+0000 7f94be253640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94a4004d40 0x7f94b81e7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:48.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.687+0000 7f94be253640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94a4004d40 0x7f94b81e7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58570/0 (socket says 172.21.15.123:58570) 2024-09-15T23:15:48.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.687+0000 7f94be253640 1 -- 172.21.15.123:0/2220251695 learned_addr learned my addr 172.21.15.123:0/2220251695 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:48.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.687+0000 7f94be253640 1 -- 172.21.15.123:0/2220251695 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f94b80cdfe0 msgr2=0x7f94b80ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:48.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.687+0000 7f94be253640 1 --2- 172.21.15.123:0/2220251695 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f94b80cdfe0 0x7f94b80ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:48.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.687+0000 7f94be253640 1 -- 172.21.15.123:0/2220251695 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94b80c8dd0 msgr2=0x7f94b80c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:48.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.687+0000 7f94be253640 1 --2- 172.21.15.123:0/2220251695 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94b80c8dd0 0x7f94b80c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:48.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.687+0000 7f94be253640 1 -- 172.21.15.123:0/2220251695 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94b80cd2a0 con 0x7f94a4004d40 2024-09-15T23:15:48.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.687+0000 7f94be253640 1 --2- 172.21.15.123:0/2220251695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94a4004d40 0x7f94b81e7840 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f94b40114c0 tx=0x7f94b4011980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:48.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.688+0000 7f94aeffd640 1 -- 172.21.15.123:0/2220251695 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b4015930 con 0x7f94a4004d40 2024-09-15T23:15:48.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.688+0000 7f94aeffd640 1 -- 172.21.15.123:0/2220251695 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94b4015ad0 con 0x7f94a4004d40 2024-09-15T23:15:48.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.688+0000 7f94c04b7640 1 -- 172.21.15.123:0/2220251695 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94b80cd540 con 0x7f94a4004d40 2024-09-15T23:15:48.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.688+0000 7f94aeffd640 1 -- 172.21.15.123:0/2220251695 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b401d400 con 0x7f94a4004d40 2024-09-15T23:15:48.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.688+0000 7f94c04b7640 1 -- 172.21.15.123:0/2220251695 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94b80c9940 con 0x7f94a4004d40 2024-09-15T23:15:48.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.689+0000 7f94c04b7640 1 -- 172.21.15.123:0/2220251695 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94b80b7010 con 0x7f94a4004d40 2024-09-15T23:15:48.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.689+0000 7f94aeffd640 1 -- 172.21.15.123:0/2220251695 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f94b401d5a0 con 0x7f94a4004d40 2024-09-15T23:15:48.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.690+0000 7f94aeffd640 1 --2- 172.21.15.123:0/2220251695 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f949c06c2b0 0x7f949c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:48.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.690+0000 7f94aeffd640 1 -- 172.21.15.123:0/2220251695 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5115+0+0 (secure 0 0 0) 0x7f94b408ba50 con 0x7f94a4004d40 2024-09-15T23:15:48.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.690+0000 7f94bda52640 1 --2- 172.21.15.123:0/2220251695 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f949c06c2b0 0x7f949c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:48.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.690+0000 7f94bda52640 1 --2- 172.21.15.123:0/2220251695 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f949c06c2b0 0x7f949c06e770 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f94b80c8350 tx=0x7f94a8000ed0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:48.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.694+0000 7f94aeffd640 1 -- 172.21.15.123:0/2220251695 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f94b4019030 con 0x7f94a4004d40 2024-09-15T23:15:48.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.861+0000 7f94c04b7640 1 -- 172.21.15.123:0/2220251695 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f94b80b3f20 con 0x7f94a4004d40 2024-09-15T23:15:48.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.862+0000 7f94aeffd640 1 -- 172.21.15.123:0/2220251695 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+13322 (secure 0 0 0) 0x7f94b405a410 con 0x7f94a4004d40 2024-09-15T23:15:48.863 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:48.863 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":73,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:15:46.557693+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6835/3634063333":"2024-09-16T23:15:43.550033+0000","172.21.15.123:6834/3634063333":"2024-09-16T23:15:43.550033+0000","172.21.15.188:6837/3452580408":"2024-09-16T23:15:29.652204+0000","172.21.15.188:6835/3452580408":"2024-09-16T23:15:29.652204+0000","172.21.15.123:6835/2772280632":"2024-09-16T23:15:28.658500+0000","172.21.15.123:6833/2772280632":"2024-09-16T23:15:28.658500+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:15:48.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.864+0000 7f94c04b7640 1 -- 172.21.15.123:0/2220251695 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f949c06c2b0 msgr2=0x7f949c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:48.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.864+0000 7f94c04b7640 1 --2- 172.21.15.123:0/2220251695 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f949c06c2b0 0x7f949c06e770 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f94b80c8350 tx=0x7f94a8000ed0 comp rx=0 tx=0).stop 2024-09-15T23:15:48.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.864+0000 7f94c04b7640 1 -- 172.21.15.123:0/2220251695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94a4004d40 msgr2=0x7f94b81e7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:48.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.864+0000 7f94c04b7640 1 --2- 172.21.15.123:0/2220251695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94a4004d40 0x7f94b81e7840 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f94b40114c0 tx=0x7f94b4011980 comp rx=0 tx=0).stop 2024-09-15T23:15:48.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.864+0000 7f94c04b7640 1 -- 172.21.15.123:0/2220251695 shutdown_connections 2024-09-15T23:15:48.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.864+0000 7f94c04b7640 1 --2- 172.21.15.123:0/2220251695 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f94b80cdfe0 0x7f94b80ce460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:48.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.864+0000 7f94c04b7640 1 --2- 172.21.15.123:0/2220251695 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f94b80c8dd0 0x7f94b80c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:48.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.864+0000 7f94c04b7640 1 --2- 172.21.15.123:0/2220251695 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f949c06c2b0 0x7f949c06e770 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:48.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.864+0000 7f94c04b7640 1 --2- 172.21.15.123:0/2220251695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f94a4004d40 0x7f94b81e7840 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:48.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.864+0000 7f94c04b7640 1 -- 172.21.15.123:0/2220251695 >> 172.21.15.123:0/2220251695 conn(0x7f94b80d1260 msgr2=0x7f94b80d0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:48.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.864+0000 7f94c04b7640 1 -- 172.21.15.123:0/2220251695 shutdown_connections 2024-09-15T23:15:48.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.864+0000 7f94c04b7640 1 -- 172.21.15.123:0/2220251695 wait complete. 2024-09-15T23:15:48.876 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T23:12:01.531886+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T23:15:48.877 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T23:15:48.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.977+0000 7fdd8201e640 1 Processor -- start 2024-09-15T23:15:48.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.977+0000 7fdd8201e640 1 -- start start 2024-09-15T23:15:48.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.978+0000 7fdd8201e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fdd7c0cd2a0 0x7fdd7c15c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:48.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.978+0000 7fdd8201e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd7c0714b0 con 0x7fdd7c0732e0 2024-09-15T23:15:48.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.978+0000 7fdd8201e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd7c0cd880 con 0x7fdd7c0cce30 2024-09-15T23:15:48.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.978+0000 7fdd8201e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fdd7c0cdb60 con 0x7fdd7c0cd2a0 2024-09-15T23:15:48.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.978+0000 7fdd7b7fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fdd7c0732e0 0x7fdd7c0736c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60342/0 (socket says 172.21.15.123:60342) 2024-09-15T23:15:48.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.978+0000 7fdd7b7fe640 1 -- 172.21.15.123:0/81659622 learned_addr learned my addr 172.21.15.123:0/81659622 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:48.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.978+0000 7fdd7bfff640 1 --2- 172.21.15.123:0/81659622 >> v2:172.21.15.188:3300/0 conn(0x7fdd7c0cd2a0 0x7fdd7c15c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:48.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.978+0000 7fdd7a7fc640 1 -- 172.21.15.123:0/81659622 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 928794545 0 0) 0x7fdd7c0714b0 con 0x7fdd7c0732e0 2024-09-15T23:15:48.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.978+0000 7fdd7a7fc640 1 -- 172.21.15.123:0/81659622 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd68003520 con 0x7fdd7c0732e0 2024-09-15T23:15:48.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.978+0000 7fdd7a7fc640 1 -- 172.21.15.123:0/81659622 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4196023874 0 0) 0x7fdd7c0cd880 con 0x7fdd7c0cce30 2024-09-15T23:15:48.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.978+0000 7fdd7a7fc640 1 -- 172.21.15.123:0/81659622 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd7c0714b0 con 0x7fdd7c0cce30 2024-09-15T23:15:48.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.978+0000 7fdd7bfff640 1 -- 172.21.15.123:0/81659622 >> v1:172.21.15.188:6789/0 conn(0x7fdd7c0cce30 legacy=0x7fdd7c071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:48.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.978+0000 7fdd7bfff640 1 -- 172.21.15.123:0/81659622 >> v1:172.21.15.123:6789/0 conn(0x7fdd7c0732e0 legacy=0x7fdd7c0736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:48.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.978+0000 7fdd7bfff640 1 -- 172.21.15.123:0/81659622 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd7c0cde40 con 0x7fdd7c0cd2a0 2024-09-15T23:15:48.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.979+0000 7fdd7bfff640 1 --2- 172.21.15.123:0/81659622 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdd7c0cd2a0 0x7fdd7c15c8d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdd74009d90 tx=0x7fdd7402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f664753ca11f253 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:48.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.979+0000 7fdd7a7fc640 1 -- 172.21.15.123:0/81659622 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd74007740 con 0x7fdd7c0cd2a0 2024-09-15T23:15:48.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.979+0000 7fdd7a7fc640 1 -- 172.21.15.123:0/81659622 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd740078e0 con 0x7fdd7c0cd2a0 2024-09-15T23:15:48.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.979+0000 7fdd7a7fc640 1 -- 172.21.15.123:0/81659622 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd74007cb0 con 0x7fdd7c0cd2a0 2024-09-15T23:15:48.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.980+0000 7fdd8201e640 1 -- 172.21.15.123:0/81659622 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdd7c0cd2a0 msgr2=0x7fdd7c15c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:48.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.980+0000 7fdd8201e640 1 --2- 172.21.15.123:0/81659622 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdd7c0cd2a0 0x7fdd7c15c8d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdd74009d90 tx=0x7fdd7402a660 comp rx=0 tx=0).stop 2024-09-15T23:15:48.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.980+0000 7fdd8201e640 1 -- 172.21.15.123:0/81659622 shutdown_connections 2024-09-15T23:15:48.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.980+0000 7fdd8201e640 1 --2- 172.21.15.123:0/81659622 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdd7c0cd2a0 0x7fdd7c15c8d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:48.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.980+0000 7fdd8201e640 1 -- 172.21.15.123:0/81659622 >> 172.21.15.123:0/81659622 conn(0x7fdd7c06d0f0 msgr2=0x7fdd7c06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:48.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.980+0000 7fdd8201e640 1 -- 172.21.15.123:0/81659622 shutdown_connections 2024-09-15T23:15:48.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.980+0000 7fdd8201e640 1 -- 172.21.15.123:0/81659622 wait complete. 2024-09-15T23:15:48.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.981+0000 7fdd8201e640 1 Processor -- start 2024-09-15T23:15:48.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.981+0000 7fdd8201e640 1 -- start start 2024-09-15T23:15:48.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.982+0000 7fdd8201e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdd7c0732e0 0x7fdd7c149250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:48.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.982+0000 7fdd8201e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd7c0cce30 0x7fdd7c159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:48.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.982+0000 7fdd8201e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdd7c0cd2a0 0x7fdd7c155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:48.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.982+0000 7fdd8201e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdd7c072500 con 0x7fdd7c0cce30 2024-09-15T23:15:48.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.982+0000 7fdd8201e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fdd7c072380 con 0x7fdd7c0cd2a0 2024-09-15T23:15:48.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.982+0000 7fdd8201e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fdd7c15ce10 con 0x7fdd7c0732e0 2024-09-15T23:15:48.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.982+0000 7fdd7affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd7c0cce30 0x7fdd7c159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:48.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.982+0000 7fdd7affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd7c0cce30 0x7fdd7c159230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58586/0 (socket says 172.21.15.123:58586) 2024-09-15T23:15:48.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.982+0000 7fdd7affd640 1 -- 172.21.15.123:0/3131036938 learned_addr learned my addr 172.21.15.123:0/3131036938 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:48.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.982+0000 7fdd7bfff640 1 --2- 172.21.15.123:0/3131036938 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdd7c0cd2a0 0x7fdd7c155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:48.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.982+0000 7fdd7b7fe640 1 --2- 172.21.15.123:0/3131036938 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdd7c0732e0 0x7fdd7c149250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:48.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.982+0000 7fdd7affd640 1 -- 172.21.15.123:0/3131036938 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdd7c0732e0 msgr2=0x7fdd7c149250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:48.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.982+0000 7fdd7affd640 1 --2- 172.21.15.123:0/3131036938 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdd7c0732e0 0x7fdd7c149250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:48.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.982+0000 7fdd7affd640 1 -- 172.21.15.123:0/3131036938 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdd7c0cd2a0 msgr2=0x7fdd7c155bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:48.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.982+0000 7fdd7affd640 1 --2- 172.21.15.123:0/3131036938 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdd7c0cd2a0 0x7fdd7c155bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:48.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.982+0000 7fdd7affd640 1 -- 172.21.15.123:0/3131036938 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd7c1599a0 con 0x7fdd7c0cce30 2024-09-15T23:15:48.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.982+0000 7fdd7affd640 1 --2- 172.21.15.123:0/3131036938 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd7c0cce30 0x7fdd7c159230 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fdd6400c530 tx=0x7fdd6400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:48.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.983+0000 7fdd73fff640 1 -- 172.21.15.123:0/3131036938 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd640052d0 con 0x7fdd7c0cce30 2024-09-15T23:15:48.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.983+0000 7fdd73fff640 1 -- 172.21.15.123:0/3131036938 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd64005490 con 0x7fdd7c0cce30 2024-09-15T23:15:48.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.983+0000 7fdd8201e640 1 -- 172.21.15.123:0/3131036938 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd7c159c80 con 0x7fdd7c0cce30 2024-09-15T23:15:48.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.983+0000 7fdd73fff640 1 -- 172.21.15.123:0/3131036938 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd64012870 con 0x7fdd7c0cce30 2024-09-15T23:15:48.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.983+0000 7fdd8201e640 1 -- 172.21.15.123:0/3131036938 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd7c0c6a40 con 0x7fdd7c0cce30 2024-09-15T23:15:48.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.984+0000 7fdd8201e640 1 -- 172.21.15.123:0/3131036938 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd7c15d200 con 0x7fdd7c0cce30 2024-09-15T23:15:48.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.984+0000 7fdd73fff640 1 -- 172.21.15.123:0/3131036938 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdd64012a10 con 0x7fdd7c0cce30 2024-09-15T23:15:48.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.985+0000 7fdd73fff640 1 --2- 172.21.15.123:0/3131036938 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdd5c06c2b0 0x7fdd5c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:48.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.985+0000 7fdd73fff640 1 -- 172.21.15.123:0/3131036938 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5115+0+0 (secure 0 0 0) 0x7fdd6408acc0 con 0x7fdd7c0cce30 2024-09-15T23:15:48.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.985+0000 7fdd7b7fe640 1 --2- 172.21.15.123:0/3131036938 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdd5c06c2b0 0x7fdd5c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:48.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.985+0000 7fdd7b7fe640 1 --2- 172.21.15.123:0/3131036938 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdd5c06c2b0 0x7fdd5c06e770 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c0011e0 tx=0x7fdd6c007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:48.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:48.989+0000 7fdd73fff640 1 -- 172.21.15.123:0/3131036938 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdd64059040 con 0x7fdd7c0cce30 2024-09-15T23:15:49.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.154+0000 7fdd8201e640 1 -- 172.21.15.123:0/3131036938 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdd7c0c6c10 con 0x7fdd7c0cce30 2024-09-15T23:15:49.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.155+0000 7fdd73fff640 1 -- 172.21.15.123:0/3131036938 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) ==== 93+0+10 (secure 0 0 0) 0x7fdd6405d340 con 0x7fdd7c0cce30 2024-09-15T23:15:49.156 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-15T23:15:49.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.157+0000 7fdd8201e640 1 -- 172.21.15.123:0/3131036938 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdd5c06c2b0 msgr2=0x7fdd5c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:49.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.157+0000 7fdd8201e640 1 --2- 172.21.15.123:0/3131036938 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdd5c06c2b0 0x7fdd5c06e770 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c0011e0 tx=0x7fdd6c007d30 comp rx=0 tx=0).stop 2024-09-15T23:15:49.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.157+0000 7fdd8201e640 1 -- 172.21.15.123:0/3131036938 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd7c0cce30 msgr2=0x7fdd7c159230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:49.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.157+0000 7fdd8201e640 1 --2- 172.21.15.123:0/3131036938 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd7c0cce30 0x7fdd7c159230 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fdd6400c530 tx=0x7fdd6400c9f0 comp rx=0 tx=0).stop 2024-09-15T23:15:49.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.157+0000 7fdd8201e640 1 -- 172.21.15.123:0/3131036938 shutdown_connections 2024-09-15T23:15:49.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.157+0000 7fdd8201e640 1 --2- 172.21.15.123:0/3131036938 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdd7c0cd2a0 0x7fdd7c155bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:49.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.157+0000 7fdd8201e640 1 --2- 172.21.15.123:0/3131036938 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdd5c06c2b0 0x7fdd5c06e770 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:49.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.157+0000 7fdd8201e640 1 --2- 172.21.15.123:0/3131036938 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd7c0cce30 0x7fdd7c159230 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:49.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.157+0000 7fdd8201e640 1 --2- 172.21.15.123:0/3131036938 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdd7c0732e0 0x7fdd7c149250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:49.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.157+0000 7fdd8201e640 1 -- 172.21.15.123:0/3131036938 >> 172.21.15.123:0/3131036938 conn(0x7fdd7c06d0f0 msgr2=0x7fdd7c15e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:49.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.157+0000 7fdd8201e640 1 -- 172.21.15.123:0/3131036938 shutdown_connections 2024-09-15T23:15:49.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.157+0000 7fdd8201e640 1 -- 172.21.15.123:0/3131036938 wait complete. 2024-09-15T23:15:49.169 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair' 2024-09-15T23:15:49.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.267+0000 7fb852a4c640 1 Processor -- start 2024-09-15T23:15:49.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.267+0000 7fb852a4c640 1 -- start start 2024-09-15T23:15:49.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.268+0000 7fb852a4c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb84c06c320 0x7fb84c15bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:49.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.268+0000 7fb852a4c640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb84c071180 con 0x7fb84c13eb20 2024-09-15T23:15:49.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.268+0000 7fb852a4c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb84c071460 con 0x7fb84c0b2d40 2024-09-15T23:15:49.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.268+0000 7fb852a4c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fb84c071ab0 con 0x7fb84c06c320 2024-09-15T23:15:49.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.268+0000 7fb850fe9640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb84c13eb20 0x7fb84c15c230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60350/0 (socket says 172.21.15.123:60350) 2024-09-15T23:15:49.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.268+0000 7fb850fe9640 1 -- 172.21.15.123:0/1797961028 learned_addr learned my addr 172.21.15.123:0/1797961028 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:49.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.268+0000 7fb84affd640 1 -- 172.21.15.123:0/1797961028 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2828554926 0 0) 0x7fb84c071180 con 0x7fb84c13eb20 2024-09-15T23:15:49.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.268+0000 7fb84b7fe640 1 --2- 172.21.15.123:0/1797961028 >> v2:172.21.15.188:3300/0 conn(0x7fb84c06c320 0x7fb84c15bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:49.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.269+0000 7fb84affd640 1 -- 172.21.15.123:0/1797961028 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb834003520 con 0x7fb84c13eb20 2024-09-15T23:15:49.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.269+0000 7fb84affd640 1 -- 172.21.15.123:0/1797961028 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4059261847 0 0) 0x7fb834003520 con 0x7fb84c13eb20 2024-09-15T23:15:49.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.269+0000 7fb84affd640 1 -- 172.21.15.123:0/1797961028 >> v2:172.21.15.188:3300/0 conn(0x7fb84c06c320 msgr2=0x7fb84c15bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:49.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.269+0000 7fb84affd640 1 --2- 172.21.15.123:0/1797961028 >> v2:172.21.15.188:3300/0 conn(0x7fb84c06c320 0x7fb84c15bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:49.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.269+0000 7fb84affd640 1 -- 172.21.15.123:0/1797961028 >> v1:172.21.15.188:6789/0 conn(0x7fb84c0b2d40 legacy=0x7fb84c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:49.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.269+0000 7fb84affd640 1 -- 172.21.15.123:0/1797961028 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb84c071740 con 0x7fb84c13eb20 2024-09-15T23:15:49.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.269+0000 7fb84affd640 1 -- 172.21.15.123:0/1797961028 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fb8440019f0 con 0x7fb84c13eb20 2024-09-15T23:15:49.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.269+0000 7fb84affd640 1 -- 172.21.15.123:0/1797961028 >> v1:172.21.15.123:6789/0 conn(0x7fb84c13eb20 legacy=0x7fb84c15c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:49.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.269+0000 7fb84affd640 1 --2- 172.21.15.123:0/1797961028 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb8340039b0 0x7fb834003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:49.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.269+0000 7fb84affd640 1 --2- 172.21.15.123:0/1797961028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb834004800 0x7fb834004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:49.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.269+0000 7fb84affd640 1 --2- 172.21.15.123:0/1797961028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb8340051c0 0x7fb83400dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:49.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.269+0000 7fb84affd640 1 -- 172.21.15.123:0/1797961028 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb84c071ab0 con 0x7fb834004800 2024-09-15T23:15:49.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.269+0000 7fb84affd640 1 -- 172.21.15.123:0/1797961028 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb83400e320 con 0x7fb8340051c0 2024-09-15T23:15:49.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.269+0000 7fb84affd640 1 -- 172.21.15.123:0/1797961028 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb83400e520 con 0x7fb8340039b0 2024-09-15T23:15:49.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.269+0000 7fb84b7fe640 1 --2- 172.21.15.123:0/1797961028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb834004800 0x7fb834004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:49.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.269+0000 7fb84bfff640 1 --2- 172.21.15.123:0/1797961028 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb8340039b0 0x7fb834003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:49.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.269+0000 7fb850fe9640 1 --2- 172.21.15.123:0/1797961028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb8340051c0 0x7fb83400dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:49.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.269+0000 7fb84b7fe640 1 -- 172.21.15.123:0/1797961028 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb8340039b0 msgr2=0x7fb834003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:49.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.269+0000 7fb84b7fe640 1 --2- 172.21.15.123:0/1797961028 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb8340039b0 0x7fb834003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:49.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.269+0000 7fb84b7fe640 1 -- 172.21.15.123:0/1797961028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb8340051c0 msgr2=0x7fb83400dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:49.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.269+0000 7fb84b7fe640 1 --2- 172.21.15.123:0/1797961028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb8340051c0 0x7fb83400dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:49.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.269+0000 7fb850fe9640 1 -- 172.21.15.123:0/1797961028 reap_dead start 2024-09-15T23:15:49.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.269+0000 7fb84b7fe640 1 -- 172.21.15.123:0/1797961028 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb834003520 con 0x7fb834004800 2024-09-15T23:15:49.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.270+0000 7fb84b7fe640 1 --2- 172.21.15.123:0/1797961028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb834004800 0x7fb834004c80 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fb84000ba30 tx=0x7fb834005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=147226b2d2cd1f5e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:49.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.270+0000 7fb84affd640 1 -- 172.21.15.123:0/1797961028 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb840030070 con 0x7fb834004800 2024-09-15T23:15:49.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.270+0000 7fb84affd640 1 -- 172.21.15.123:0/1797961028 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb84002ade0 con 0x7fb834004800 2024-09-15T23:15:49.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.270+0000 7fb84affd640 1 -- 172.21.15.123:0/1797961028 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84000b600 con 0x7fb834004800 2024-09-15T23:15:49.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.271+0000 7fb852a4c640 1 -- 172.21.15.123:0/1797961028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb834004800 msgr2=0x7fb834004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:49.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.271+0000 7fb852a4c640 1 --2- 172.21.15.123:0/1797961028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb834004800 0x7fb834004c80 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fb84000ba30 tx=0x7fb834005830 comp rx=0 tx=0).stop 2024-09-15T23:15:49.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.271+0000 7fb852a4c640 1 -- 172.21.15.123:0/1797961028 shutdown_connections 2024-09-15T23:15:49.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.271+0000 7fb852a4c640 1 --2- 172.21.15.123:0/1797961028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb834004800 0x7fb834004c80 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:49.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.271+0000 7fb852a4c640 1 -- 172.21.15.123:0/1797961028 >> 172.21.15.123:0/1797961028 conn(0x7fb84c0ccec0 msgr2=0x7fb84c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:49.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.271+0000 7fb852a4c640 1 -- 172.21.15.123:0/1797961028 shutdown_connections 2024-09-15T23:15:49.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.271+0000 7fb852a4c640 1 -- 172.21.15.123:0/1797961028 wait complete. 2024-09-15T23:15:49.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.272+0000 7fb852a4c640 1 Processor -- start 2024-09-15T23:15:49.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.272+0000 7fb852a4c640 1 -- start start 2024-09-15T23:15:49.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.273+0000 7fb852a4c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb834004800 0x7fb84c13ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:49.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.273+0000 7fb852a4c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb84c13d380 0x7fb84c15a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:49.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.273+0000 7fb852a4c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb84c15ec20 0x7fb84c15ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:49.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.273+0000 7fb852a4c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb84c06bfa0 con 0x7fb84c13d380 2024-09-15T23:15:49.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.273+0000 7fb852a4c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb84c06be20 con 0x7fb834004800 2024-09-15T23:15:49.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.273+0000 7fb852a4c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb84c06c120 con 0x7fb84c15ec20 2024-09-15T23:15:49.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.273+0000 7fb84b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb84c13d380 0x7fb84c15a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:49.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.273+0000 7fb84b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb84c13d380 0x7fb84c15a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58604/0 (socket says 172.21.15.123:58604) 2024-09-15T23:15:49.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.273+0000 7fb84b7fe640 1 -- 172.21.15.123:0/2743579266 learned_addr learned my addr 172.21.15.123:0/2743579266 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:49.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.273+0000 7fb850fe9640 1 --2- 172.21.15.123:0/2743579266 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb84c15ec20 0x7fb84c15ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:49.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.273+0000 7fb84b7fe640 1 -- 172.21.15.123:0/2743579266 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb84c15ec20 msgr2=0x7fb84c15ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:49.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.273+0000 7fb84bfff640 1 --2- 172.21.15.123:0/2743579266 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb834004800 0x7fb84c13ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:49.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.273+0000 7fb84b7fe640 1 --2- 172.21.15.123:0/2743579266 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb84c15ec20 0x7fb84c15ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:49.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.273+0000 7fb84b7fe640 1 -- 172.21.15.123:0/2743579266 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb834004800 msgr2=0x7fb84c13ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:49.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.273+0000 7fb84b7fe640 1 --2- 172.21.15.123:0/2743579266 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb834004800 0x7fb84c13ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:49.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.273+0000 7fb84b7fe640 1 -- 172.21.15.123:0/2743579266 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb84c15f9a0 con 0x7fb84c13d380 2024-09-15T23:15:49.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.273+0000 7fb84bfff640 1 --2- 172.21.15.123:0/2743579266 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb834004800 0x7fb84c13ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:49.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.273+0000 7fb84b7fe640 1 --2- 172.21.15.123:0/2743579266 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb84c13d380 0x7fb84c15a610 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fb84002a8d0 tx=0x7fb8400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:49.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.273+0000 7fb848ff9640 1 -- 172.21.15.123:0/2743579266 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb840043030 con 0x7fb84c13d380 2024-09-15T23:15:49.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.273+0000 7fb848ff9640 1 -- 172.21.15.123:0/2743579266 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb84002abe0 con 0x7fb84c13d380 2024-09-15T23:15:49.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.273+0000 7fb852a4c640 1 -- 172.21.15.123:0/2743579266 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb84c0b3570 con 0x7fb84c13d380 2024-09-15T23:15:49.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.273+0000 7fb848ff9640 1 -- 172.21.15.123:0/2743579266 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84000b600 con 0x7fb84c13d380 2024-09-15T23:15:49.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.273+0000 7fb852a4c640 1 -- 172.21.15.123:0/2743579266 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb84c0b3b30 con 0x7fb84c13d380 2024-09-15T23:15:49.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.274+0000 7fb852a4c640 1 -- 172.21.15.123:0/2743579266 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb84c15bcf0 con 0x7fb84c13d380 2024-09-15T23:15:49.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.275+0000 7fb848ff9640 1 -- 172.21.15.123:0/2743579266 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb840046070 con 0x7fb84c13d380 2024-09-15T23:15:49.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.275+0000 7fb848ff9640 1 --2- 172.21.15.123:0/2743579266 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb83806c2b0 0x7fb83806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:49.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.275+0000 7fb848ff9640 1 -- 172.21.15.123:0/2743579266 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5115+0+0 (secure 0 0 0) 0x7fb8400abd80 con 0x7fb84c13d380 2024-09-15T23:15:49.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.276+0000 7fb84bfff640 1 --2- 172.21.15.123:0/2743579266 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb83806c2b0 0x7fb83806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:49.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.276+0000 7fb84bfff640 1 --2- 172.21.15.123:0/2743579266 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb83806c2b0 0x7fb83806e770 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb84c0cfbc0 tx=0x7fb83c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:49.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.279+0000 7fb848ff9640 1 -- 172.21.15.123:0/2743579266 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb84007a6c0 con 0x7fb84c13d380 2024-09-15T23:15:49.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.515+0000 7fb852a4c640 1 -- 172.21.15.123:0/2743579266 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]} v 0) -- 0x7fb84c06c9c0 con 0x7fb84c13d380 2024-09-15T23:15:49.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.573+0000 7fb848ff9640 1 -- 172.21.15.123:0/2743579266 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]}]=0 v195) ==== 146+0+0 (secure 0 0 0) 0x7fb840079fc0 con 0x7fb84c13d380 2024-09-15T23:15:49.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.575+0000 7fb852a4c640 1 -- 172.21.15.123:0/2743579266 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb83806c2b0 msgr2=0x7fb83806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:49.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.575+0000 7fb852a4c640 1 --2- 172.21.15.123:0/2743579266 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb83806c2b0 0x7fb83806e770 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb84c0cfbc0 tx=0x7fb83c009040 comp rx=0 tx=0).stop 2024-09-15T23:15:49.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.575+0000 7fb852a4c640 1 -- 172.21.15.123:0/2743579266 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb84c13d380 msgr2=0x7fb84c15a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:49.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.575+0000 7fb852a4c640 1 --2- 172.21.15.123:0/2743579266 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb84c13d380 0x7fb84c15a610 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fb84002a8d0 tx=0x7fb8400046c0 comp rx=0 tx=0).stop 2024-09-15T23:15:49.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.575+0000 7fb852a4c640 1 -- 172.21.15.123:0/2743579266 shutdown_connections 2024-09-15T23:15:49.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.575+0000 7fb852a4c640 1 --2- 172.21.15.123:0/2743579266 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb84c15ec20 0x7fb84c15ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:49.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.575+0000 7fb852a4c640 1 --2- 172.21.15.123:0/2743579266 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb83806c2b0 0x7fb83806e770 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:49.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.575+0000 7fb852a4c640 1 --2- 172.21.15.123:0/2743579266 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb84c13d380 0x7fb84c15a610 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:49.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.575+0000 7fb852a4c640 1 --2- 172.21.15.123:0/2743579266 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb834004800 0x7fb84c13ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:49.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.575+0000 7fb852a4c640 1 -- 172.21.15.123:0/2743579266 >> 172.21.15.123:0/2743579266 conn(0x7fb84c0ccec0 msgr2=0x7fb84c140370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:49.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.576+0000 7fb852a4c640 1 -- 172.21.15.123:0/2743579266 shutdown_connections 2024-09-15T23:15:49.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.576+0000 7fb852a4c640 1 -- 172.21.15.123:0/2743579266 wait complete. 2024-09-15T23:15:49.587 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T23:15:49.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.688+0000 7f72c828d640 1 Processor -- start 2024-09-15T23:15:49.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.688+0000 7f72c828d640 1 -- start start 2024-09-15T23:15:49.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.689+0000 7f72c828d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f72c00732e0 0x7f72c00736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:49.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.689+0000 7f72c828d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72c00cce30 0x7f72c00cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:49.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.689+0000 7f72c828d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72c00714b0 con 0x7f72c0071c70 2024-09-15T23:15:49.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.689+0000 7f72c828d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f72c0073c00 con 0x7f72c00732e0 2024-09-15T23:15:49.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.689+0000 7f72c828d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f72c00cd880 con 0x7f72c00cce30 2024-09-15T23:15:49.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.689+0000 7f72c6029640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f72c00732e0 0x7f72c00736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:49.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.689+0000 7f72c682a640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f72c0071c70 0x7f72c015c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60362/0 (socket says 172.21.15.123:60362) 2024-09-15T23:15:49.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.689+0000 7f72c682a640 1 -- 172.21.15.123:0/3743844210 learned_addr learned my addr 172.21.15.123:0/3743844210 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:49.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.689+0000 7f72c5828640 1 --2- 172.21.15.123:0/3743844210 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72c00cce30 0x7f72c00cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:49.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.689+0000 7f72c6029640 1 -- 172.21.15.123:0/3743844210 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72c00cce30 msgr2=0x7f72c00cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:49.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.689+0000 7f72c6029640 1 --2- 172.21.15.123:0/3743844210 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72c00cce30 0x7f72c00cd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:49.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.689+0000 7f72c6029640 1 -- 172.21.15.123:0/3743844210 >> v1:172.21.15.123:6789/0 conn(0x7f72c0071c70 legacy=0x7f72c015c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:49.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.689+0000 7f72c5027640 1 -- 172.21.15.123:0/3743844210 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1163922012 0 0) 0x7f72c00714b0 con 0x7f72c0071c70 2024-09-15T23:15:49.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.689+0000 7f72c6029640 1 -- 172.21.15.123:0/3743844210 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c00cdb60 con 0x7f72c00732e0 2024-09-15T23:15:49.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.689+0000 7f72c5828640 1 --2- 172.21.15.123:0/3743844210 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72c00cce30 0x7f72c00cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:49.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.690+0000 7f72c6029640 1 --2- 172.21.15.123:0/3743844210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72c00732e0 0x7f72c00736c0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009d90 tx=0x7f72b002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb33840719771ff2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:49.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.690+0000 7f72c5027640 1 -- 172.21.15.123:0/3743844210 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0031600 con 0x7f72c00732e0 2024-09-15T23:15:49.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.690+0000 7f72c5027640 1 -- 172.21.15.123:0/3743844210 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72b00317a0 con 0x7f72c00732e0 2024-09-15T23:15:49.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.690+0000 7f72c5027640 1 -- 172.21.15.123:0/3743844210 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0031b70 con 0x7f72c00732e0 2024-09-15T23:15:49.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.691+0000 7f72c828d640 1 -- 172.21.15.123:0/3743844210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72c00732e0 msgr2=0x7f72c00736c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:49.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.691+0000 7f72c828d640 1 --2- 172.21.15.123:0/3743844210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72c00732e0 0x7f72c00736c0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009d90 tx=0x7f72b002a5d0 comp rx=0 tx=0).stop 2024-09-15T23:15:49.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.691+0000 7f72c828d640 1 -- 172.21.15.123:0/3743844210 shutdown_connections 2024-09-15T23:15:49.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.691+0000 7f72c828d640 1 --2- 172.21.15.123:0/3743844210 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72c00cce30 0x7f72c00cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:49.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.691+0000 7f72c828d640 1 --2- 172.21.15.123:0/3743844210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72c00732e0 0x7f72c00736c0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:49.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.691+0000 7f72c828d640 1 -- 172.21.15.123:0/3743844210 >> 172.21.15.123:0/3743844210 conn(0x7f72c006d0f0 msgr2=0x7f72c006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:49.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.691+0000 7f72c828d640 1 -- 172.21.15.123:0/3743844210 shutdown_connections 2024-09-15T23:15:49.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.691+0000 7f72c828d640 1 -- 172.21.15.123:0/3743844210 wait complete. 2024-09-15T23:15:49.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.692+0000 7f72c828d640 1 Processor -- start 2024-09-15T23:15:49.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.692+0000 7f72c828d640 1 -- start start 2024-09-15T23:15:49.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.693+0000 7f72c828d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f72c0071c70 0x7f72c0157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:49.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.693+0000 7f72c828d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72c00732e0 0x7f72c0148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:49.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.693+0000 7f72c828d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72c00cce30 0x7f72c01f2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:49.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.693+0000 7f72c828d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f72c006bf70 con 0x7f72c00732e0 2024-09-15T23:15:49.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.693+0000 7f72c828d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f72c006bdf0 con 0x7f72c0071c70 2024-09-15T23:15:49.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.693+0000 7f72c828d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f72c0072120 con 0x7f72c00cce30 2024-09-15T23:15:49.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.693+0000 7f72c5828640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72c00732e0 0x7f72c0148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:49.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.693+0000 7f72c5828640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72c00732e0 0x7f72c0148fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58626/0 (socket says 172.21.15.123:58626) 2024-09-15T23:15:49.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.693+0000 7f72c5828640 1 -- 172.21.15.123:0/3269840958 learned_addr learned my addr 172.21.15.123:0/3269840958 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:49.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.693+0000 7f72c6029640 1 --2- 172.21.15.123:0/3269840958 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f72c0071c70 0x7f72c0157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:49.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.693+0000 7f72c682a640 1 --2- 172.21.15.123:0/3269840958 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72c00cce30 0x7f72c01f2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:49.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.693+0000 7f72c5828640 1 -- 172.21.15.123:0/3269840958 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72c00cce30 msgr2=0x7f72c01f2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:49.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.693+0000 7f72c5828640 1 --2- 172.21.15.123:0/3269840958 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72c00cce30 0x7f72c01f2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:49.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.693+0000 7f72c5828640 1 -- 172.21.15.123:0/3269840958 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f72c0071c70 msgr2=0x7f72c0157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:49.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.693+0000 7f72c5828640 1 --2- 172.21.15.123:0/3269840958 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f72c0071c70 0x7f72c0157a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:49.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.693+0000 7f72c5828640 1 -- 172.21.15.123:0/3269840958 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c01593d0 con 0x7f72c00732e0 2024-09-15T23:15:49.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.693+0000 7f72c682a640 1 --2- 172.21.15.123:0/3269840958 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72c00cce30 0x7f72c01f2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:49.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.693+0000 7f72c5828640 1 --2- 172.21.15.123:0/3269840958 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72c00732e0 0x7f72c0148fb0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f72b400c7f0 tx=0x7f72b400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:49.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.694+0000 7f72beffd640 1 -- 172.21.15.123:0/3269840958 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b4015070 con 0x7f72c00732e0 2024-09-15T23:15:49.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.694+0000 7f72beffd640 1 -- 172.21.15.123:0/3269840958 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72b4007820 con 0x7f72c00732e0 2024-09-15T23:15:49.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.694+0000 7f72c828d640 1 -- 172.21.15.123:0/3269840958 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72c0158330 con 0x7f72c00732e0 2024-09-15T23:15:49.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.694+0000 7f72beffd640 1 -- 172.21.15.123:0/3269840958 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b4007c10 con 0x7f72c00732e0 2024-09-15T23:15:49.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.694+0000 7f72c828d640 1 -- 172.21.15.123:0/3269840958 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72c0158bd0 con 0x7f72c00732e0 2024-09-15T23:15:49.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.695+0000 7f72c828d640 1 -- 172.21.15.123:0/3269840958 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72c00724b0 con 0x7f72c00732e0 2024-09-15T23:15:49.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.695+0000 7f72beffd640 1 -- 172.21.15.123:0/3269840958 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f72b4018070 con 0x7f72c00732e0 2024-09-15T23:15:49.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.695+0000 7f72beffd640 1 --2- 172.21.15.123:0/3269840958 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f72ac06c2b0 0x7f72ac06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:49.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.696+0000 7f72beffd640 1 -- 172.21.15.123:0/3269840958 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5115+0+0 (secure 0 0 0) 0x7f72b408b0a0 con 0x7f72c00732e0 2024-09-15T23:15:49.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.696+0000 7f72c6029640 1 --2- 172.21.15.123:0/3269840958 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f72ac06c2b0 0x7f72ac06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:49.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.696+0000 7f72c6029640 1 --2- 172.21.15.123:0/3269840958 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f72ac06c2b0 0x7f72ac06e770 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f72b0034000 tx=0x7f72b002f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:49.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.700+0000 7f72beffd640 1 -- 172.21.15.123:0/3269840958 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f72b4059a60 con 0x7f72c00732e0 2024-09-15T23:15:49.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.865+0000 7f72c828d640 1 -- 172.21.15.123:0/3269840958 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f72c00711f0 con 0x7f72c00732e0 2024-09-15T23:15:49.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.868+0000 7f72beffd640 1 -- 172.21.15.123:0/3269840958 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) ==== 122+0+0 (secure 0 0 0) 0x7f72b4059360 con 0x7f72c00732e0 2024-09-15T23:15:49.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.870+0000 7f72c828d640 1 -- 172.21.15.123:0/3269840958 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f72ac06c2b0 msgr2=0x7f72ac06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:49.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.870+0000 7f72c828d640 1 --2- 172.21.15.123:0/3269840958 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f72ac06c2b0 0x7f72ac06e770 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f72b0034000 tx=0x7f72b002f000 comp rx=0 tx=0).stop 2024-09-15T23:15:49.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.870+0000 7f72c828d640 1 -- 172.21.15.123:0/3269840958 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72c00732e0 msgr2=0x7f72c0148fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:49.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.870+0000 7f72c828d640 1 --2- 172.21.15.123:0/3269840958 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72c00732e0 0x7f72c0148fb0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f72b400c7f0 tx=0x7f72b400ccb0 comp rx=0 tx=0).stop 2024-09-15T23:15:49.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.870+0000 7f72c828d640 1 -- 172.21.15.123:0/3269840958 shutdown_connections 2024-09-15T23:15:49.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.870+0000 7f72c828d640 1 --2- 172.21.15.123:0/3269840958 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72c00cce30 0x7f72c01f2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:49.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.870+0000 7f72c828d640 1 --2- 172.21.15.123:0/3269840958 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f72ac06c2b0 0x7f72ac06e770 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:49.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.870+0000 7f72c828d640 1 --2- 172.21.15.123:0/3269840958 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72c00732e0 0x7f72c0148fb0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:49.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.870+0000 7f72c828d640 1 --2- 172.21.15.123:0/3269840958 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f72c0071c70 0x7f72c0157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:49.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.870+0000 7f72c828d640 1 -- 172.21.15.123:0/3269840958 >> 172.21.15.123:0/3269840958 conn(0x7f72c006d0f0 msgr2=0x7f72c00b29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:49.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.870+0000 7f72c828d640 1 -- 172.21.15.123:0/3269840958 shutdown_connections 2024-09-15T23:15:49.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:49.870+0000 7f72c828d640 1 -- 172.21.15.123:0/3269840958 wait complete. 2024-09-15T23:15:49.882 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:15:49.882 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:15:49.934 DEBUG:teuthology.orchestra.run.smithi188:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:15:49.985 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:15:49.986 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:15:49.986 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:15:50.002 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:15:50.002 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:15:50.002 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:15:50.021 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:15:50.021 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:15:50.021 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:15:50.057 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:15:50.057 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:15:50.057 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:15:50.080 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:15:50.080 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-15T23:15:50.081 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:15:50.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.194+0000 7f22a975f640 1 Processor -- start 2024-09-15T23:15:50.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.194+0000 7f22a975f640 1 -- start start 2024-09-15T23:15:50.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.195+0000 7f22a975f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f22a415e6d0 0x7f22a4071390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:50.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.195+0000 7f22a975f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f22a4070b80 0x7f22a41622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:50.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.195+0000 7f22a975f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22a415eab0 con 0x7f22a406cd20 2024-09-15T23:15:50.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.195+0000 7f22a975f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f22a415ed70 con 0x7f22a415e6d0 2024-09-15T23:15:50.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.195+0000 7f22a975f640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f22a415f050 con 0x7f22a4070b80 2024-09-15T23:15:50.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.195+0000 7f22a2ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f22a415e6d0 0x7f22a4071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:50.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.195+0000 7f22a2ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f22a415e6d0 0x7f22a4071390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58642/0 (socket says 172.21.15.123:58642) 2024-09-15T23:15:50.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.195+0000 7f22a2ffd640 1 -- 172.21.15.123:0/957996690 learned_addr learned my addr 172.21.15.123:0/957996690 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:50.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.195+0000 7f22a2ffd640 1 -- 172.21.15.123:0/957996690 >> v2:172.21.15.188:3300/0 conn(0x7f22a4070b80 msgr2=0x7f22a41622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:50.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.195+0000 7f22a2ffd640 1 --2- 172.21.15.123:0/957996690 >> v2:172.21.15.188:3300/0 conn(0x7f22a4070b80 0x7f22a41622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:50.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.195+0000 7f22a2ffd640 1 -- 172.21.15.123:0/957996690 >> v1:172.21.15.188:6789/0 conn(0x7f22a406cd20 legacy=0x7f22a40b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:50.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.195+0000 7f22a2ffd640 1 -- 172.21.15.123:0/957996690 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a415f330 con 0x7f22a415e6d0 2024-09-15T23:15:50.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.196+0000 7f22a2ffd640 1 --2- 172.21.15.123:0/957996690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22a415e6d0 0x7f22a4071390 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f22a40710d0 tx=0x7f229402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee6e2cf34d14406 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:50.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.196+0000 7f22a27fc640 1 -- 172.21.15.123:0/957996690 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2294037070 con 0x7f22a415e6d0 2024-09-15T23:15:50.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.196+0000 7f22a27fc640 1 -- 172.21.15.123:0/957996690 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2294032440 con 0x7f22a415e6d0 2024-09-15T23:15:50.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.196+0000 7f22a27fc640 1 -- 172.21.15.123:0/957996690 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2294032810 con 0x7f22a415e6d0 2024-09-15T23:15:50.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.197+0000 7f22a975f640 1 -- 172.21.15.123:0/957996690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22a415e6d0 msgr2=0x7f22a4071390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:50.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.197+0000 7f22a975f640 1 --2- 172.21.15.123:0/957996690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22a415e6d0 0x7f22a4071390 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f22a40710d0 tx=0x7f229402a230 comp rx=0 tx=0).stop 2024-09-15T23:15:50.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.197+0000 7f22a975f640 1 -- 172.21.15.123:0/957996690 shutdown_connections 2024-09-15T23:15:50.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.197+0000 7f22a975f640 1 --2- 172.21.15.123:0/957996690 >> v2:172.21.15.188:3300/0 conn(0x7f22a4070b80 0x7f22a41622a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:50.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.197+0000 7f22a975f640 1 --2- 172.21.15.123:0/957996690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22a415e6d0 0x7f22a4071390 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:50.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.197+0000 7f22a975f640 1 -- 172.21.15.123:0/957996690 >> 172.21.15.123:0/957996690 conn(0x7f22a4067fb0 msgr2=0x7f22a406f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:50.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.197+0000 7f22a975f640 1 -- 172.21.15.123:0/957996690 shutdown_connections 2024-09-15T23:15:50.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.197+0000 7f22a975f640 1 -- 172.21.15.123:0/957996690 wait complete. 2024-09-15T23:15:50.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.198+0000 7f22a975f640 1 Processor -- start 2024-09-15T23:15:50.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.198+0000 7f22a975f640 1 -- start start 2024-09-15T23:15:50.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.199+0000 7f22a975f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f22a406cd20 0x7f22a414ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:50.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.199+0000 7f22a975f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22a4070b80 0x7f22a41496f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:50.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.199+0000 7f22a975f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22a415e6d0 0x7f22a415d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:50.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.199+0000 7f22a975f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f22a40718d0 con 0x7f22a4070b80 2024-09-15T23:15:50.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.199+0000 7f22a975f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f22a415f8f0 con 0x7f22a415e6d0 2024-09-15T23:15:50.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.199+0000 7f22a975f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f22a4071a50 con 0x7f22a406cd20 2024-09-15T23:15:50.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.199+0000 7f229a7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22a4070b80 0x7f22a41496f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:50.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.199+0000 7f229a7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22a4070b80 0x7f22a41496f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58650/0 (socket says 172.21.15.123:58650) 2024-09-15T23:15:50.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.199+0000 7f229a7fc640 1 -- 172.21.15.123:0/3884320046 learned_addr learned my addr 172.21.15.123:0/3884320046 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:50.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.199+0000 7f22a37fe640 1 --2- 172.21.15.123:0/3884320046 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22a415e6d0 0x7f22a415d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:50.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.199+0000 7f22a2ffd640 1 --2- 172.21.15.123:0/3884320046 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f22a406cd20 0x7f22a414ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:50.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.199+0000 7f229a7fc640 1 -- 172.21.15.123:0/3884320046 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f22a406cd20 msgr2=0x7f22a414ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:50.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.199+0000 7f229a7fc640 1 --2- 172.21.15.123:0/3884320046 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f22a406cd20 0x7f22a414ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:50.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.199+0000 7f229a7fc640 1 -- 172.21.15.123:0/3884320046 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22a415e6d0 msgr2=0x7f22a415d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:50.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.199+0000 7f229a7fc640 1 --2- 172.21.15.123:0/3884320046 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22a415e6d0 0x7f22a415d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:50.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.199+0000 7f229a7fc640 1 -- 172.21.15.123:0/3884320046 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a414b2d0 con 0x7f22a4070b80 2024-09-15T23:15:50.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.199+0000 7f22a37fe640 1 --2- 172.21.15.123:0/3884320046 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22a415e6d0 0x7f22a415d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:50.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.199+0000 7f22a2ffd640 1 --2- 172.21.15.123:0/3884320046 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f22a406cd20 0x7f22a414ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:50.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.200+0000 7f229a7fc640 1 --2- 172.21.15.123:0/3884320046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22a4070b80 0x7f22a41496f0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f228c00c400 tx=0x7f228c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:50.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.200+0000 7f229bfff640 1 -- 172.21.15.123:0/3884320046 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c017070 con 0x7f22a4070b80 2024-09-15T23:15:50.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.200+0000 7f229bfff640 1 -- 172.21.15.123:0/3884320046 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f228c0035f0 con 0x7f22a4070b80 2024-09-15T23:15:50.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.200+0000 7f229bfff640 1 -- 172.21.15.123:0/3884320046 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c0039e0 con 0x7f22a4070b80 2024-09-15T23:15:50.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.200+0000 7f22a975f640 1 -- 172.21.15.123:0/3884320046 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22a4149c30 con 0x7f22a4070b80 2024-09-15T23:15:50.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.200+0000 7f22a975f640 1 -- 172.21.15.123:0/3884320046 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22a41506f0 con 0x7f22a4070b80 2024-09-15T23:15:50.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.201+0000 7f22a975f640 1 -- 172.21.15.123:0/3884320046 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22a4071390 con 0x7f22a4070b80 2024-09-15T23:15:50.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.201+0000 7f229bfff640 1 -- 172.21.15.123:0/3884320046 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f228c01a070 con 0x7f22a4070b80 2024-09-15T23:15:50.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.202+0000 7f229bfff640 1 --2- 172.21.15.123:0/3884320046 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f228406c2b0 0x7f228406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:50.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.202+0000 7f229bfff640 1 -- 172.21.15.123:0/3884320046 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5115+0+0 (secure 0 0 0) 0x7f228c08a530 con 0x7f22a4070b80 2024-09-15T23:15:50.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.202+0000 7f22a2ffd640 1 --2- 172.21.15.123:0/3884320046 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f228406c2b0 0x7f228406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:50.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.202+0000 7f22a2ffd640 1 --2- 172.21.15.123:0/3884320046 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f228406c2b0 0x7f228406e770 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2294034000 tx=0x7f229402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:50.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.206+0000 7f229bfff640 1 -- 172.21.15.123:0/3884320046 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f228c0588a0 con 0x7f22a4070b80 2024-09-15T23:15:50.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.403+0000 7f22a975f640 1 -- 172.21.15.123:0/3884320046 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22a41629f0 con 0x7f22a4070b80 2024-09-15T23:15:50.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.404+0000 7f229bfff640 1 -- 172.21.15.123:0/3884320046 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+3917 (secure 0 0 0) 0x7f228c05cba0 con 0x7f22a4070b80 2024-09-15T23:15:50.405 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:50.405 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":40,"btime":"2024-09-15T23:15:44:552070+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5483,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/522636413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":522636413},{"type":"v1","addr":"172.21.15.188:6835","nonce":522636413}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5860,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/3057173907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":3057173907},{"type":"v1","addr":"172.21.15.188:6837","nonce":3057173907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6399,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/811728648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":811728648},{"type":"v1","addr":"172.21.15.123:6833","nonce":811728648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":6570,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3046282494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3046282494},{"type":"v1","addr":"172.21.15.123:6835","nonce":3046282494}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[]} 2024-09-15T23:15:50.406 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 40 2024-09-15T23:15:50.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.406+0000 7f22a975f640 1 -- 172.21.15.123:0/3884320046 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f228406c2b0 msgr2=0x7f228406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:50.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.406+0000 7f22a975f640 1 --2- 172.21.15.123:0/3884320046 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f228406c2b0 0x7f228406e770 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2294034000 tx=0x7f229402e000 comp rx=0 tx=0).stop 2024-09-15T23:15:50.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.406+0000 7f22a975f640 1 -- 172.21.15.123:0/3884320046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22a4070b80 msgr2=0x7f22a41496f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:50.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.406+0000 7f22a975f640 1 --2- 172.21.15.123:0/3884320046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22a4070b80 0x7f22a41496f0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f228c00c400 tx=0x7f228c00c8c0 comp rx=0 tx=0).stop 2024-09-15T23:15:50.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.406+0000 7f22a975f640 1 -- 172.21.15.123:0/3884320046 shutdown_connections 2024-09-15T23:15:50.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.406+0000 7f22a975f640 1 --2- 172.21.15.123:0/3884320046 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22a415e6d0 0x7f22a415d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:50.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.406+0000 7f22a975f640 1 --2- 172.21.15.123:0/3884320046 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f228406c2b0 0x7f228406e770 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:50.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.406+0000 7f22a975f640 1 --2- 172.21.15.123:0/3884320046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22a4070b80 0x7f22a41496f0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:50.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.406+0000 7f22a975f640 1 --2- 172.21.15.123:0/3884320046 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f22a406cd20 0x7f22a414ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:50.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.406+0000 7f22a975f640 1 -- 172.21.15.123:0/3884320046 >> 172.21.15.123:0/3884320046 conn(0x7f22a4067fb0 msgr2=0x7f22a4160760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:50.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.406+0000 7f22a975f640 1 -- 172.21.15.123:0/3884320046 shutdown_connections 2024-09-15T23:15:50.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.406+0000 7f22a975f640 1 -- 172.21.15.123:0/3884320046 wait complete. 2024-09-15T23:15:50.419 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T23:15:50.419 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T23:15:50.419 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T23:15:50.419 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:15:50.419 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T23:15:50.419 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T23:15:50.420 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T23:15:50.420 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:15:50.420 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T23:15:50.420 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T23:15:50.420 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T23:15:50.420 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:15:50.420 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T23:15:50.421 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T23:15:50.421 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T23:15:50.421 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:15:50.429 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T23:15:50.429 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T23:15:50.430 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T23:15:50.430 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T23:15:50.432 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T23:15:50.433 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T23:15:50.433 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T23:15:50.433 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T23:15:50.472 INFO:tasks.ceph.mds.a:Started 2024-09-15T23:15:50.472 DEBUG:teuthology.parallel:result is None 2024-09-15T23:15:50.473 INFO:tasks.ceph.mds.c:Started 2024-09-15T23:15:50.473 DEBUG:teuthology.parallel:result is None 2024-09-15T23:15:50.475 INFO:tasks.ceph.mds.b:Started 2024-09-15T23:15:50.476 DEBUG:teuthology.parallel:result is None 2024-09-15T23:15:50.476 INFO:tasks.ceph.mds.d:Started 2024-09-15T23:15:50.476 DEBUG:teuthology.parallel:result is None 2024-09-15T23:15:50.477 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T23:15:50.547 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-15T23:15:50.547 INFO:tasks.ceph.mds.a.smithi123.stdout:starting mds.a at 2024-09-15T23:15:50.557 INFO:tasks.ceph.mds.b.smithi188.stdout:starting mds.b at 2024-09-15T23:15:50.557 INFO:tasks.ceph.mds.d.smithi188.stdout:starting mds.d at 2024-09-15T23:15:50.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.581+0000 7f3af56e6640 1 Processor -- start 2024-09-15T23:15:50.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.581+0000 7f3af56e6640 1 -- start start 2024-09-15T23:15:50.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.582+0000 7f3af56e6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3af015e910 0x7f3af00731a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:50.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.582+0000 7f3af56e6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f3af00b49d0 0x7f3af00d0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:50.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.582+0000 7f3af56e6640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3af00d22a0 con 0x7f3af00cfd00 2024-09-15T23:15:50.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.582+0000 7f3af56e6640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f3af015ecf0 con 0x7f3af015e910 2024-09-15T23:15:50.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.582+0000 7f3af56e6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f3af00d2e70 con 0x7f3af00b49d0 2024-09-15T23:15:50.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.582+0000 7f3aeeffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3af015e910 0x7f3af00731a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:50.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.582+0000 7f3aeeffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3af015e910 0x7f3af00731a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58696/0 (socket says 172.21.15.123:58696) 2024-09-15T23:15:50.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.582+0000 7f3aeeffd640 1 -- 172.21.15.123:0/1732936937 learned_addr learned my addr 172.21.15.123:0/1732936937 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:50.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.582+0000 7f3ae7fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f3af00cfd00 0x7f3af00b42c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60382/0 (socket says 172.21.15.123:60382) 2024-09-15T23:15:50.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.582+0000 7f3aef7fe640 1 --2- 172.21.15.123:0/1732936937 >> v2:172.21.15.188:3300/0 conn(0x7f3af00b49d0 0x7f3af00d0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:50.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.582+0000 7f3aeeffd640 1 -- 172.21.15.123:0/1732936937 >> v2:172.21.15.188:3300/0 conn(0x7f3af00b49d0 msgr2=0x7f3af00d0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:50.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.582+0000 7f3aeeffd640 1 --2- 172.21.15.123:0/1732936937 >> v2:172.21.15.188:3300/0 conn(0x7f3af00b49d0 0x7f3af00d0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:50.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.582+0000 7f3aeeffd640 1 -- 172.21.15.123:0/1732936937 >> v1:172.21.15.123:6789/0 conn(0x7f3af00cfd00 legacy=0x7f3af00b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:50.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.582+0000 7f3aeeffd640 1 -- 172.21.15.123:0/1732936937 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3af00736e0 con 0x7f3af015e910 2024-09-15T23:15:50.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.582+0000 7f3aee7fc640 1 -- 172.21.15.123:0/1732936937 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3966005674 0 0) 0x7f3af00d22a0 con 0x7f3af00cfd00 2024-09-15T23:15:50.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.583+0000 7f3aeeffd640 1 --2- 172.21.15.123:0/1732936937 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3af015e910 0x7f3af00731a0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f3af015ee70 tx=0x7f3ae002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814121d2b124ce79 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:50.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.586+0000 7f3aee7fc640 1 -- 172.21.15.123:0/1732936937 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae0037070 con 0x7f3af015e910 2024-09-15T23:15:50.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.586+0000 7f3aee7fc640 1 -- 172.21.15.123:0/1732936937 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ae0032440 con 0x7f3af015e910 2024-09-15T23:15:50.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.586+0000 7f3aee7fc640 1 -- 172.21.15.123:0/1732936937 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae0032810 con 0x7f3af015e910 2024-09-15T23:15:50.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.586+0000 7f3af56e6640 1 -- 172.21.15.123:0/1732936937 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3af015e910 msgr2=0x7f3af00731a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:50.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.586+0000 7f3af56e6640 1 --2- 172.21.15.123:0/1732936937 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3af015e910 0x7f3af00731a0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f3af015ee70 tx=0x7f3ae002a180 comp rx=0 tx=0).stop 2024-09-15T23:15:50.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.587+0000 7f3af56e6640 1 -- 172.21.15.123:0/1732936937 shutdown_connections 2024-09-15T23:15:50.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.587+0000 7f3af56e6640 1 --2- 172.21.15.123:0/1732936937 >> v2:172.21.15.188:3300/0 conn(0x7f3af00b49d0 0x7f3af00d0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:50.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.587+0000 7f3af56e6640 1 --2- 172.21.15.123:0/1732936937 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3af015e910 0x7f3af00731a0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:50.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.587+0000 7f3af56e6640 1 -- 172.21.15.123:0/1732936937 >> 172.21.15.123:0/1732936937 conn(0x7f3af0067950 msgr2=0x7f3af0067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:50.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.587+0000 7f3af56e6640 1 -- 172.21.15.123:0/1732936937 shutdown_connections 2024-09-15T23:15:50.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.587+0000 7f3af56e6640 1 -- 172.21.15.123:0/1732936937 wait complete. 2024-09-15T23:15:50.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.588+0000 7f3af56e6640 1 Processor -- start 2024-09-15T23:15:50.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.588+0000 7f3af56e6640 1 -- start start 2024-09-15T23:15:50.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.589+0000 7f3af56e6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3af00b49d0 0x7f3af014f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:50.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.589+0000 7f3af56e6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3af00cfd00 0x7f3af00b5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:50.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.589+0000 7f3af56e6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3af015e910 0x7f3af00ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:50.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.589+0000 7f3af56e6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3af00d2b00 con 0x7f3af00b49d0 2024-09-15T23:15:50.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.589+0000 7f3af56e6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3af00d2820 con 0x7f3af015e910 2024-09-15T23:15:50.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.589+0000 7f3af56e6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f3af00d3300 con 0x7f3af00cfd00 2024-09-15T23:15:50.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.589+0000 7f3aeeffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3af00b49d0 0x7f3af014f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:50.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.589+0000 7f3aeeffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3af00b49d0 0x7f3af014f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58704/0 (socket says 172.21.15.123:58704) 2024-09-15T23:15:50.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.589+0000 7f3aeeffd640 1 -- 172.21.15.123:0/3596083196 learned_addr learned my addr 172.21.15.123:0/3596083196 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:50.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.589+0000 7f3ae7fff640 1 --2- 172.21.15.123:0/3596083196 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3af00cfd00 0x7f3af00b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:50.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.589+0000 7f3aef7fe640 1 --2- 172.21.15.123:0/3596083196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3af015e910 0x7f3af00ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:50.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.589+0000 7f3aeeffd640 1 -- 172.21.15.123:0/3596083196 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3af00cfd00 msgr2=0x7f3af00b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:50.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.589+0000 7f3aeeffd640 1 --2- 172.21.15.123:0/3596083196 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3af00cfd00 0x7f3af00b5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:50.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.589+0000 7f3aeeffd640 1 -- 172.21.15.123:0/3596083196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3af015e910 msgr2=0x7f3af00ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:50.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.589+0000 7f3aeeffd640 1 --2- 172.21.15.123:0/3596083196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3af015e910 0x7f3af00ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:50.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.589+0000 7f3aeeffd640 1 -- 172.21.15.123:0/3596083196 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3af01f4180 con 0x7f3af00b49d0 2024-09-15T23:15:50.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.590+0000 7f3aeeffd640 1 --2- 172.21.15.123:0/3596083196 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3af00b49d0 0x7f3af014f2d0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f3ae00090b0 tx=0x7f3ae00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:50.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.590+0000 7f3ae77fe640 1 -- 172.21.15.123:0/3596083196 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae0037040 con 0x7f3af00b49d0 2024-09-15T23:15:50.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.590+0000 7f3ae77fe640 1 -- 172.21.15.123:0/3596083196 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ae0004230 con 0x7f3af00b49d0 2024-09-15T23:15:50.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.590+0000 7f3ae77fe640 1 -- 172.21.15.123:0/3596083196 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae0003610 con 0x7f3af00b49d0 2024-09-15T23:15:50.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.590+0000 7f3af56e6640 1 -- 172.21.15.123:0/3596083196 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3af00b60f0 con 0x7f3af00b49d0 2024-09-15T23:15:50.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.590+0000 7f3af56e6640 1 -- 172.21.15.123:0/3596083196 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3af00b6d30 con 0x7f3af00b49d0 2024-09-15T23:15:50.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.591+0000 7f3af56e6640 1 -- 172.21.15.123:0/3596083196 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3af00731a0 con 0x7f3af00b49d0 2024-09-15T23:15:50.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.592+0000 7f3ae77fe640 1 -- 172.21.15.123:0/3596083196 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3ae00037b0 con 0x7f3af00b49d0 2024-09-15T23:15:50.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.592+0000 7f3ae77fe640 1 --2- 172.21.15.123:0/3596083196 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3ad006c2b0 0x7f3ad006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:50.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.592+0000 7f3ae77fe640 1 -- 172.21.15.123:0/3596083196 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5115+0+0 (secure 0 0 0) 0x7f3ae00abd40 con 0x7f3af00b49d0 2024-09-15T23:15:50.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.592+0000 7f3ae7fff640 1 --2- 172.21.15.123:0/3596083196 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3ad006c2b0 0x7f3ad006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:50.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.593+0000 7f3ae7fff640 1 --2- 172.21.15.123:0/3596083196 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3ad006c2b0 0x7f3ad006e770 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3af01622d0 tx=0x7f3ad8007d50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:50.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.596+0000 7f3ae77fe640 1 -- 172.21.15.123:0/3596083196 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3ae007a140 con 0x7f3af00b49d0 2024-09-15T23:15:50.635 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-09-15T23:15:50.635 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-09-15T23:15:50.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:50.774+0000 7f3af56e6640 1 -- 172.21.15.123:0/3596083196 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f3af006d580 con 0x7f3af00b49d0 2024-09-15T23:15:51.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.588+0000 7f3ae77fe640 1 -- 172.21.15.123:0/3596083196 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v78) ==== 97+0+0 (secure 0 0 0) 0x7f3ae007e440 con 0x7f3af00b49d0 2024-09-15T23:15:51.589 INFO:teuthology.orchestra.run.smithi123.stderr: removed all blocklist entries 2024-09-15T23:15:51.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.590+0000 7f3af56e6640 1 -- 172.21.15.123:0/3596083196 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3ad006c2b0 msgr2=0x7f3ad006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:51.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.590+0000 7f3af56e6640 1 --2- 172.21.15.123:0/3596083196 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3ad006c2b0 0x7f3ad006e770 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3af01622d0 tx=0x7f3ad8007d50 comp rx=0 tx=0).stop 2024-09-15T23:15:51.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.590+0000 7f3af56e6640 1 -- 172.21.15.123:0/3596083196 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3af00b49d0 msgr2=0x7f3af014f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:51.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.590+0000 7f3af56e6640 1 --2- 172.21.15.123:0/3596083196 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3af00b49d0 0x7f3af014f2d0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f3ae00090b0 tx=0x7f3ae00046c0 comp rx=0 tx=0).stop 2024-09-15T23:15:51.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.591+0000 7f3af56e6640 1 -- 172.21.15.123:0/3596083196 shutdown_connections 2024-09-15T23:15:51.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.591+0000 7f3af56e6640 1 --2- 172.21.15.123:0/3596083196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3af015e910 0x7f3af00ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:51.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.591+0000 7f3af56e6640 1 --2- 172.21.15.123:0/3596083196 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3af00cfd00 0x7f3af00b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:51.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.591+0000 7f3af56e6640 1 --2- 172.21.15.123:0/3596083196 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3ad006c2b0 0x7f3ad006e770 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:51.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.591+0000 7f3af56e6640 1 --2- 172.21.15.123:0/3596083196 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3af00b49d0 0x7f3af014f2d0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:51.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.591+0000 7f3af56e6640 1 -- 172.21.15.123:0/3596083196 >> 172.21.15.123:0/3596083196 conn(0x7f3af0067950 msgr2=0x7f3af00b2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:51.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.591+0000 7f3af56e6640 1 -- 172.21.15.123:0/3596083196 shutdown_connections 2024-09-15T23:15:51.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.591+0000 7f3af56e6640 1 -- 172.21.15.123:0/3596083196 wait complete. 2024-09-15T23:15:51.603 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T23:15:51.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.701+0000 7efd36bc6640 1 Processor -- start 2024-09-15T23:15:51.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.701+0000 7efd36bc6640 1 -- start start 2024-09-15T23:15:51.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.702+0000 7efd36bc6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd3015e790 0x7efd30073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:51.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.702+0000 7efd36bc6640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd301631c0 con 0x7efd30162c60 2024-09-15T23:15:51.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.702+0000 7efd36bc6640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd300ae9a0 con 0x7efd3006f730 2024-09-15T23:15:51.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.702+0000 7efd36bc6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7efd3015eb70 con 0x7efd3015e790 2024-09-15T23:15:51.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.702+0000 7efd2ffff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7efd30162c60 0x7efd300b5430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60390/0 (socket says 172.21.15.123:60390) 2024-09-15T23:15:51.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.702+0000 7efd2ffff640 1 -- 172.21.15.123:0/1705114254 learned_addr learned my addr 172.21.15.123:0/1705114254 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:51.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.702+0000 7efd2f7fe640 1 -- 172.21.15.123:0/1705114254 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3385090090 0 0) 0x7efd301631c0 con 0x7efd30162c60 2024-09-15T23:15:51.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.702+0000 7efd2f7fe640 1 -- 172.21.15.123:0/1705114254 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd1c003520 con 0x7efd30162c60 2024-09-15T23:15:51.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.702+0000 7efd34962640 1 --2- 172.21.15.123:0/1705114254 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd3015e790 0x7efd30073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:51.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.702+0000 7efd2f7fe640 1 -- 172.21.15.123:0/1705114254 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4085167728 0 0) 0x7efd1c003520 con 0x7efd30162c60 2024-09-15T23:15:51.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.702+0000 7efd2f7fe640 1 -- 172.21.15.123:0/1705114254 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd3015e790 msgr2=0x7efd30073a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:51.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.702+0000 7efd2f7fe640 1 --2- 172.21.15.123:0/1705114254 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd3015e790 0x7efd30073a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:51.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.702+0000 7efd2f7fe640 1 -- 172.21.15.123:0/1705114254 >> v1:172.21.15.188:6789/0 conn(0x7efd3006f730 legacy=0x7efd300af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:51.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.702+0000 7efd2f7fe640 1 -- 172.21.15.123:0/1705114254 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd300aec40 con 0x7efd30162c60 2024-09-15T23:15:51.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.702+0000 7efd2f7fe640 1 -- 172.21.15.123:0/1705114254 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7efd200019f0 con 0x7efd30162c60 2024-09-15T23:15:51.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.702+0000 7efd34962640 1 --2- 172.21.15.123:0/1705114254 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd3015e790 0x7efd30073a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:51.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.702+0000 7efd2f7fe640 1 -- 172.21.15.123:0/1705114254 >> v1:172.21.15.123:6789/0 conn(0x7efd30162c60 legacy=0x7efd300b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:51.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.702+0000 7efd2f7fe640 1 --2- 172.21.15.123:0/1705114254 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efd1c0039e0 0x7efd1c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:51.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.702+0000 7efd2f7fe640 1 --2- 172.21.15.123:0/1705114254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd1c004800 0x7efd1c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:51.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.702+0000 7efd2f7fe640 1 --2- 172.21.15.123:0/1705114254 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd3015e790 0x7efd1c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:51.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.702+0000 7efd2f7fe640 1 -- 172.21.15.123:0/1705114254 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efd1c0054b0 con 0x7efd1c004800 2024-09-15T23:15:51.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.702+0000 7efd2f7fe640 1 -- 172.21.15.123:0/1705114254 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7efd1c005660 con 0x7efd1c0039e0 2024-09-15T23:15:51.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.702+0000 7efd2f7fe640 1 -- 172.21.15.123:0/1705114254 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7efd1c00bf00 con 0x7efd3015e790 2024-09-15T23:15:51.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.702+0000 7efd2ffff640 1 --2- 172.21.15.123:0/1705114254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd1c004800 0x7efd1c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:51.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.703+0000 7efd34962640 1 --2- 172.21.15.123:0/1705114254 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efd1c0039e0 0x7efd1c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:51.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.703+0000 7efd35163640 1 --2- 172.21.15.123:0/1705114254 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd3015e790 0x7efd1c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:51.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.703+0000 7efd2ffff640 1 -- 172.21.15.123:0/1705114254 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd3015e790 msgr2=0x7efd1c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:51.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.703+0000 7efd2ffff640 1 --2- 172.21.15.123:0/1705114254 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd3015e790 0x7efd1c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:51.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.703+0000 7efd2ffff640 1 -- 172.21.15.123:0/1705114254 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efd1c0039e0 msgr2=0x7efd1c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:51.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.703+0000 7efd2ffff640 1 --2- 172.21.15.123:0/1705114254 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efd1c0039e0 0x7efd1c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:51.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.703+0000 7efd2ffff640 1 -- 172.21.15.123:0/1705114254 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd1c003520 con 0x7efd1c004800 2024-09-15T23:15:51.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.703+0000 7efd2ffff640 1 --2- 172.21.15.123:0/1705114254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd1c004800 0x7efd1c004c80 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7efd2000a830 tx=0x7efd1c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=508c9ca63ccf9334 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:51.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.704+0000 7efd2f7fe640 1 -- 172.21.15.123:0/1705114254 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2000a480 con 0x7efd1c004800 2024-09-15T23:15:51.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.704+0000 7efd2f7fe640 1 -- 172.21.15.123:0/1705114254 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd2002f070 con 0x7efd1c004800 2024-09-15T23:15:51.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.704+0000 7efd2f7fe640 1 -- 172.21.15.123:0/1705114254 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2002bcd0 con 0x7efd1c004800 2024-09-15T23:15:51.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.704+0000 7efd36bc6640 1 -- 172.21.15.123:0/1705114254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd1c004800 msgr2=0x7efd1c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:51.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.704+0000 7efd36bc6640 1 --2- 172.21.15.123:0/1705114254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd1c004800 0x7efd1c004c80 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7efd2000a830 tx=0x7efd1c005830 comp rx=0 tx=0).stop 2024-09-15T23:15:51.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.704+0000 7efd35163640 1 -- 172.21.15.123:0/1705114254 reap_dead start 2024-09-15T23:15:51.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.704+0000 7efd36bc6640 1 -- 172.21.15.123:0/1705114254 shutdown_connections 2024-09-15T23:15:51.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.704+0000 7efd36bc6640 1 -- 172.21.15.123:0/1705114254 >> 172.21.15.123:0/1705114254 conn(0x7efd300b0a80 msgr2=0x7efd300b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:51.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.704+0000 7efd36bc6640 1 -- 172.21.15.123:0/1705114254 shutdown_connections 2024-09-15T23:15:51.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.704+0000 7efd36bc6640 1 -- 172.21.15.123:0/1705114254 wait complete. 2024-09-15T23:15:51.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.705+0000 7efd36bc6640 1 Processor -- start 2024-09-15T23:15:51.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.705+0000 7efd36bc6640 1 -- start start 2024-09-15T23:15:51.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.706+0000 7efd36bc6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd1c004800 0x7efd300cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:51.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.706+0000 7efd36bc6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd3014f850 0x7efd301588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:51.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.706+0000 7efd36bc6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efd30158de0 0x7efd30150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:51.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.706+0000 7efd36bc6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efd300b5b40 con 0x7efd3014f850 2024-09-15T23:15:51.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.706+0000 7efd36bc6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7efd300af200 con 0x7efd30158de0 2024-09-15T23:15:51.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.706+0000 7efd36bc6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7efd3006f430 con 0x7efd1c004800 2024-09-15T23:15:51.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.706+0000 7efd2ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd3014f850 0x7efd301588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:51.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.706+0000 7efd2ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd3014f850 0x7efd301588a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58716/0 (socket says 172.21.15.123:58716) 2024-09-15T23:15:51.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.706+0000 7efd2ffff640 1 -- 172.21.15.123:0/4163828827 learned_addr learned my addr 172.21.15.123:0/4163828827 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:51.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.707+0000 7efd34962640 1 --2- 172.21.15.123:0/4163828827 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd1c004800 0x7efd300cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:51.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.707+0000 7efd35163640 1 --2- 172.21.15.123:0/4163828827 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efd30158de0 0x7efd30150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:51.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.707+0000 7efd2ffff640 1 -- 172.21.15.123:0/4163828827 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd1c004800 msgr2=0x7efd300cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:51.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.707+0000 7efd2ffff640 1 --2- 172.21.15.123:0/4163828827 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd1c004800 0x7efd300cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:51.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.707+0000 7efd2ffff640 1 -- 172.21.15.123:0/4163828827 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efd30158de0 msgr2=0x7efd30150e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:51.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.707+0000 7efd2ffff640 1 --2- 172.21.15.123:0/4163828827 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efd30158de0 0x7efd30150e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:51.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.707+0000 7efd2ffff640 1 -- 172.21.15.123:0/4163828827 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd300cee50 con 0x7efd3014f850 2024-09-15T23:15:51.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.707+0000 7efd34962640 1 --2- 172.21.15.123:0/4163828827 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd1c004800 0x7efd300cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:51.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.707+0000 7efd35163640 1 --2- 172.21.15.123:0/4163828827 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efd30158de0 0x7efd30150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:51.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.707+0000 7efd2ffff640 1 --2- 172.21.15.123:0/4163828827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd3014f850 0x7efd301588a0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7efd20001cf0 tx=0x7efd300aee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:51.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.707+0000 7efd2d7fa640 1 -- 172.21.15.123:0/4163828827 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd20044070 con 0x7efd3014f850 2024-09-15T23:15:51.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.707+0000 7efd2d7fa640 1 -- 172.21.15.123:0/4163828827 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd200019e0 con 0x7efd3014f850 2024-09-15T23:15:51.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.707+0000 7efd2d7fa640 1 -- 172.21.15.123:0/4163828827 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd2000a480 con 0x7efd3014f850 2024-09-15T23:15:51.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.707+0000 7efd36bc6640 1 -- 172.21.15.123:0/4163828827 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd300cf130 con 0x7efd3014f850 2024-09-15T23:15:51.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.707+0000 7efd36bc6640 1 -- 172.21.15.123:0/4163828827 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd300d0150 con 0x7efd3014f850 2024-09-15T23:15:51.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.708+0000 7efd36bc6640 1 -- 172.21.15.123:0/4163828827 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd30073a40 con 0x7efd3014f850 2024-09-15T23:15:51.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.708+0000 7efd2d7fa640 1 -- 172.21.15.123:0/4163828827 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7efd20047070 con 0x7efd3014f850 2024-09-15T23:15:51.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.709+0000 7efd2d7fa640 1 --2- 172.21.15.123:0/4163828827 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efd1006c2e0 0x7efd1006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:51.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.709+0000 7efd2d7fa640 1 -- 172.21.15.123:0/4163828827 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 4857+0+0 (secure 0 0 0) 0x7efd200ab230 con 0x7efd3014f850 2024-09-15T23:15:51.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.709+0000 7efd34962640 1 --2- 172.21.15.123:0/4163828827 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efd1006c2e0 0x7efd1006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:51.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.710+0000 7efd34962640 1 --2- 172.21.15.123:0/4163828827 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efd1006c2e0 0x7efd1006e7a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7efd28006fd0 tx=0x7efd28008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:51.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.713+0000 7efd2d7fa640 1 -- 172.21.15.123:0/4163828827 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efd20079cf0 con 0x7efd3014f850 2024-09-15T23:15:51.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.941+0000 7efd36bc6640 1 -- 172.21.15.123:0/4163828827 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7efd3014fcc0 con 0x7efd3014f850 2024-09-15T23:15:51.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.941+0000 7efd2d7fa640 1 -- 172.21.15.123:0/4163828827 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7efd200795f0 con 0x7efd3014f850 2024-09-15T23:15:51.942 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:51.943 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:15:51.943 INFO:teuthology.orchestra.run.smithi123.stdout: "auth_dump": [ 2024-09-15T23:15:51.943 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:51.943 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.a", 2024-09-15T23:15:51.943 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm9ATVDhAAnukyZogTuG4YCbzRXSCkiQ==", 2024-09-15T23:15:51.943 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:51.943 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:15:51.943 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:15:51.943 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:15:51.943 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:15:51.943 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:51.943 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:15:51.944 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:51.944 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.b", 2024-09-15T23:15:51.944 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm4KmaGhAAbf6vcffqiJTOYXK5DCXcZA==", 2024-09-15T23:15:51.944 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:51.944 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:15:51.944 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:15:51.944 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:15:51.944 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:15:51.944 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:51.944 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:15:51.944 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:51.944 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.c", 2024-09-15T23:15:51.944 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmua/VFRAAwbPm2TslrfQkrvHiO8oeLg==", 2024-09-15T23:15:51.945 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:51.945 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:15:51.945 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:15:51.945 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:15:51.945 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:15:51.945 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:51.945 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:15:51.945 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:51.945 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.d", 2024-09-15T23:15:51.945 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmzw3eIRAAaE+5y9USwp+xM3MTAndn7Q==", 2024-09-15T23:15:51.945 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:51.945 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:15:51.945 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:15:51.945 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:15:51.946 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:15:51.946 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:51.946 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:15:51.946 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:51.946 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.0", 2024-09-15T23:15:51.946 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCRaedmFrHGAxAAy/jTkothESNn2DC9xcHDAQ==", 2024-09-15T23:15:51.946 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:51.946 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:15:51.946 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:15:51.946 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:15:51.946 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:51.946 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:15:51.946 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:51.946 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.1", 2024-09-15T23:15:51.947 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCUaedm6vZlIxAAdsnLqFSng6SRpCT6UZKGsw==", 2024-09-15T23:15:51.947 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:51.947 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:15:51.947 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:15:51.947 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:15:51.947 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:51.947 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:15:51.947 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:51.947 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.2", 2024-09-15T23:15:51.947 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCYaedmXgVwFRAA1mOzzRafhKMsU7kTAT6TqA==", 2024-09-15T23:15:51.947 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:51.947 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:15:51.947 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:15:51.947 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:15:51.948 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:51.948 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:15:51.948 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:51.948 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.3", 2024-09-15T23:15:51.948 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCcaedm+APAFhAAb8blNFzswwHriSmCrMuA0A==", 2024-09-15T23:15:51.948 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:51.948 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:15:51.948 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:15:51.948 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:15:51.948 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:51.948 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:15:51.948 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:51.948 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.4", 2024-09-15T23:15:51.948 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCjaedmReUmABAAXpxsK7osxn/ZelVXKiCLOw==", 2024-09-15T23:15:51.949 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:51.949 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:15:51.949 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:15:51.949 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:15:51.949 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:51.949 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:15:51.949 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:51.949 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.5", 2024-09-15T23:15:51.949 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCnaedmtbdmARAAdxguBdtwBmtiaIx/y992GA==", 2024-09-15T23:15:51.949 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:51.949 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:15:51.949 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:15:51.949 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:15:51.949 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:51.950 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:15:51.950 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:51.950 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.6", 2024-09-15T23:15:51.950 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCraedmkR+NAxAAd2GAAH0BgOMonU8iTSn+Fw==", 2024-09-15T23:15:51.950 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:51.950 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:15:51.950 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:15:51.950 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:15:51.950 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:51.950 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:15:51.950 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:51.950 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.7", 2024-09-15T23:15:51.950 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCvaedmAaCwBBAAdpDtCbXchArmy019wiOdSQ==", 2024-09-15T23:15:51.951 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:51.951 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:15:51.951 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:15:51.951 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:15:51.951 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:51.951 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:15:51.951 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:51.951 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.0", 2024-09-15T23:15:51.951 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmzQPqJRAAhUf1dnVYohN4obCfeu8+7g==", 2024-09-15T23:15:51.951 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:51.951 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:15:51.951 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow r", 2024-09-15T23:15:51.951 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-15T23:15:51.951 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:51.952 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:15:51.952 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:51.952 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.1", 2024-09-15T23:15:51.952 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmdKK0LhAAXXmUkxVwMEjRTRXUh9CL/g==", 2024-09-15T23:15:51.952 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:51.952 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:15:51.952 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:15:51.952 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:15:51.952 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:15:51.952 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:51.952 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:15:51.952 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:51.953 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.2", 2024-09-15T23:15:51.953 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmRz55KxAARi7B4WYOY1QqH1CK81z9pA==", 2024-09-15T23:15:51.953 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:51.953 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:15:51.953 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:15:51.953 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:15:51.953 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:15:51.953 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:51.953 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:15:51.953 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:51.953 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.3", 2024-09-15T23:15:51.953 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmbWo8NBAAR1qGX1bs35ojx6lMxftcfg==", 2024-09-15T23:15:51.953 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:51.954 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:15:51.954 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:15:51.954 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:15:51.954 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:15:51.954 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:51.954 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:15:51.954 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:51.954 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.admin", 2024-09-15T23:15:51.954 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCMaedmVUW0LhAAqgPFk1HtxsZXcIStNN43pA==", 2024-09-15T23:15:51.954 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:51.954 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:15:51.954 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:15:51.954 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:15:51.955 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:15:51.955 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:51.955 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:15:51.955 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:51.955 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.x", 2024-09-15T23:15:51.955 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmGPSBCxAAHAhXQERogdAOm0ZPNtlxpw==", 2024-09-15T23:15:51.955 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:51.955 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:15:51.955 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-15T23:15:51.955 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:15:51.955 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:51.955 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:15:51.955 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:51.955 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.y", 2024-09-15T23:15:51.955 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm5Om4BxAA/7ZtMMlbUA3bvMCfaNMQyg==", 2024-09-15T23:15:51.956 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:15:51.956 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:15:51.956 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-15T23:15:51.956 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:15:51.956 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:51.956 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:51.956 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-15T23:15:51.956 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:15:51.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.944+0000 7efd36bc6640 1 -- 172.21.15.123:0/4163828827 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efd1006c2e0 msgr2=0x7efd1006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:51.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.944+0000 7efd36bc6640 1 --2- 172.21.15.123:0/4163828827 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efd1006c2e0 0x7efd1006e7a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7efd28006fd0 tx=0x7efd28008040 comp rx=0 tx=0).stop 2024-09-15T23:15:51.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.944+0000 7efd36bc6640 1 -- 172.21.15.123:0/4163828827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd3014f850 msgr2=0x7efd301588a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:51.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.944+0000 7efd36bc6640 1 --2- 172.21.15.123:0/4163828827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd3014f850 0x7efd301588a0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7efd20001cf0 tx=0x7efd300aee10 comp rx=0 tx=0).stop 2024-09-15T23:15:51.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.944+0000 7efd36bc6640 1 -- 172.21.15.123:0/4163828827 shutdown_connections 2024-09-15T23:15:51.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.944+0000 7efd36bc6640 1 --2- 172.21.15.123:0/4163828827 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efd30158de0 0x7efd30150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:51.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.944+0000 7efd36bc6640 1 --2- 172.21.15.123:0/4163828827 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efd1006c2e0 0x7efd1006e7a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:51.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.944+0000 7efd36bc6640 1 --2- 172.21.15.123:0/4163828827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd3014f850 0x7efd301588a0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:51.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.944+0000 7efd36bc6640 1 --2- 172.21.15.123:0/4163828827 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd1c004800 0x7efd300cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:51.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.944+0000 7efd36bc6640 1 -- 172.21.15.123:0/4163828827 >> 172.21.15.123:0/4163828827 conn(0x7efd300b0a80 msgr2=0x7efd30071dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:51.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.944+0000 7efd36bc6640 1 -- 172.21.15.123:0/4163828827 shutdown_connections 2024-09-15T23:15:51.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:51.944+0000 7efd36bc6640 1 -- 172.21.15.123:0/4163828827 wait complete. 2024-09-15T23:15:51.959 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T23:15:52.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.055+0000 7f9dfeeb7640 1 Processor -- start 2024-09-15T23:15:52.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.055+0000 7f9dfeeb7640 1 -- start start 2024-09-15T23:15:52.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.056+0000 7f9dfeeb7640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f9df806c320 0x7f9df815bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:52.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.056+0000 7f9dfeeb7640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9df8071180 con 0x7f9df813eb20 2024-09-15T23:15:52.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.056+0000 7f9dfeeb7640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9df8071460 con 0x7f9df80b2d40 2024-09-15T23:15:52.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.056+0000 7f9dfeeb7640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f9df8071ab0 con 0x7f9df806c320 2024-09-15T23:15:52.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.056+0000 7f9dfd454640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f9df813eb20 0x7f9df815c230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60404/0 (socket says 172.21.15.123:60404) 2024-09-15T23:15:52.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.056+0000 7f9dfd454640 1 -- 172.21.15.123:0/2824937588 learned_addr learned my addr 172.21.15.123:0/2824937588 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:52.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.056+0000 7f9deffff640 1 --2- 172.21.15.123:0/2824937588 >> v2:172.21.15.188:3300/0 conn(0x7f9df806c320 0x7f9df815bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:52.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.057+0000 7f9def7fe640 1 -- 172.21.15.123:0/2824937588 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1661541269 0 0) 0x7f9df8071180 con 0x7f9df813eb20 2024-09-15T23:15:52.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.057+0000 7f9def7fe640 1 -- 172.21.15.123:0/2824937588 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9de0003520 con 0x7f9df813eb20 2024-09-15T23:15:52.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.057+0000 7f9def7fe640 1 -- 172.21.15.123:0/2824937588 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 282633710 0 0) 0x7f9de0003520 con 0x7f9df813eb20 2024-09-15T23:15:52.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.057+0000 7f9def7fe640 1 -- 172.21.15.123:0/2824937588 >> v2:172.21.15.188:3300/0 conn(0x7f9df806c320 msgr2=0x7f9df815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:52.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.057+0000 7f9def7fe640 1 --2- 172.21.15.123:0/2824937588 >> v2:172.21.15.188:3300/0 conn(0x7f9df806c320 0x7f9df815bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:52.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.057+0000 7f9def7fe640 1 -- 172.21.15.123:0/2824937588 >> v1:172.21.15.188:6789/0 conn(0x7f9df80b2d40 legacy=0x7f9df806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:52.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.057+0000 7f9def7fe640 1 -- 172.21.15.123:0/2824937588 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df8071740 con 0x7f9df813eb20 2024-09-15T23:15:52.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.057+0000 7f9def7fe640 1 -- 172.21.15.123:0/2824937588 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f9df0001670 con 0x7f9df813eb20 2024-09-15T23:15:52.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.057+0000 7f9def7fe640 1 -- 172.21.15.123:0/2824937588 >> v1:172.21.15.123:6789/0 conn(0x7f9df813eb20 legacy=0x7f9df815c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:52.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.057+0000 7f9def7fe640 1 --2- 172.21.15.123:0/2824937588 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9de00039b0 0x7f9de0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:52.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.057+0000 7f9def7fe640 1 --2- 172.21.15.123:0/2824937588 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9de0004800 0x7f9de0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:52.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.057+0000 7f9def7fe640 1 --2- 172.21.15.123:0/2824937588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9de00051c0 0x7f9de000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:52.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.057+0000 7f9def7fe640 1 -- 172.21.15.123:0/2824937588 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9df8071ab0 con 0x7f9de00051c0 2024-09-15T23:15:52.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.057+0000 7f9def7fe640 1 -- 172.21.15.123:0/2824937588 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9de000c060 con 0x7f9de00039b0 2024-09-15T23:15:52.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.057+0000 7f9def7fe640 1 -- 172.21.15.123:0/2824937588 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9de000c260 con 0x7f9de0004800 2024-09-15T23:15:52.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.057+0000 7f9dfd454640 1 --2- 172.21.15.123:0/2824937588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9de00051c0 0x7f9de000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:52.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.057+0000 7f9dfcc53640 1 --2- 172.21.15.123:0/2824937588 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9de00039b0 0x7f9de0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:52.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.057+0000 7f9deffff640 1 --2- 172.21.15.123:0/2824937588 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9de0004800 0x7f9de0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:52.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.057+0000 7f9dfd454640 1 -- 172.21.15.123:0/2824937588 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9de0004800 msgr2=0x7f9de0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:52.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.057+0000 7f9dfd454640 1 --2- 172.21.15.123:0/2824937588 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9de0004800 0x7f9de0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:52.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.057+0000 7f9dfd454640 1 -- 172.21.15.123:0/2824937588 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9de00039b0 msgr2=0x7f9de0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:52.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.057+0000 7f9dfd454640 1 --2- 172.21.15.123:0/2824937588 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9de00039b0 0x7f9de0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:52.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.057+0000 7f9dfd454640 1 -- 172.21.15.123:0/2824937588 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9de0003520 con 0x7f9de00051c0 2024-09-15T23:15:52.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.058+0000 7f9dfd454640 1 -- 172.21.15.123:0/2824937588 reap_dead start 2024-09-15T23:15:52.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.058+0000 7f9dfd454640 1 --2- 172.21.15.123:0/2824937588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9de00051c0 0x7f9de000b9c0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f9df000c240 tx=0x7f9de0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3cd6efb593030f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:52.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.058+0000 7f9def7fe640 1 -- 172.21.15.123:0/2824937588 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df0007cf0 con 0x7f9de00051c0 2024-09-15T23:15:52.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.058+0000 7f9def7fe640 1 -- 172.21.15.123:0/2824937588 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9df00058d0 con 0x7f9de00051c0 2024-09-15T23:15:52.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.058+0000 7f9def7fe640 1 -- 172.21.15.123:0/2824937588 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df0005cc0 con 0x7f9de00051c0 2024-09-15T23:15:52.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.059+0000 7f9dfeeb7640 1 -- 172.21.15.123:0/2824937588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9de00051c0 msgr2=0x7f9de000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:52.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.059+0000 7f9dfeeb7640 1 --2- 172.21.15.123:0/2824937588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9de00051c0 0x7f9de000b9c0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f9df000c240 tx=0x7f9de0005830 comp rx=0 tx=0).stop 2024-09-15T23:15:52.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.059+0000 7f9dfeeb7640 1 -- 172.21.15.123:0/2824937588 shutdown_connections 2024-09-15T23:15:52.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.059+0000 7f9dfeeb7640 1 --2- 172.21.15.123:0/2824937588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9de00051c0 0x7f9de000b9c0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:52.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.059+0000 7f9dfeeb7640 1 -- 172.21.15.123:0/2824937588 >> 172.21.15.123:0/2824937588 conn(0x7f9df80ccec0 msgr2=0x7f9df80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:52.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.059+0000 7f9dfeeb7640 1 -- 172.21.15.123:0/2824937588 shutdown_connections 2024-09-15T23:15:52.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.059+0000 7f9dfeeb7640 1 -- 172.21.15.123:0/2824937588 wait complete. 2024-09-15T23:15:52.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.060+0000 7f9dfeeb7640 1 Processor -- start 2024-09-15T23:15:52.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.060+0000 7f9dfeeb7640 1 -- start start 2024-09-15T23:15:52.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.061+0000 7f9dfeeb7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9de00051c0 0x7f9df80cc520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:52.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.061+0000 7f9dfeeb7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9df80b5180 0x7f9df80b3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:52.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.061+0000 7f9dfeeb7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9df813dfa0 0x7f9df80c9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:52.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.061+0000 7f9dfeeb7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9df806bfa0 con 0x7f9df80b5180 2024-09-15T23:15:52.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.061+0000 7f9dfeeb7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9df806be20 con 0x7f9df813dfa0 2024-09-15T23:15:52.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.061+0000 7f9dfeeb7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9df806c120 con 0x7f9de00051c0 2024-09-15T23:15:52.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.061+0000 7f9deffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9df80b5180 0x7f9df80b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:52.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.061+0000 7f9deffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9df80b5180 0x7f9df80b3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58722/0 (socket says 172.21.15.123:58722) 2024-09-15T23:15:52.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.061+0000 7f9deffff640 1 -- 172.21.15.123:0/1729898603 learned_addr learned my addr 172.21.15.123:0/1729898603 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:52.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.061+0000 7f9dfcc53640 1 --2- 172.21.15.123:0/1729898603 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9de00051c0 0x7f9df80cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:52.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.061+0000 7f9dfd454640 1 --2- 172.21.15.123:0/1729898603 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9df813dfa0 0x7f9df80c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:52.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.061+0000 7f9deffff640 1 -- 172.21.15.123:0/1729898603 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9de00051c0 msgr2=0x7f9df80cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:52.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.061+0000 7f9deffff640 1 --2- 172.21.15.123:0/1729898603 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9de00051c0 0x7f9df80cc520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:52.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.061+0000 7f9deffff640 1 -- 172.21.15.123:0/1729898603 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9df813dfa0 msgr2=0x7f9df80c9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:52.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.061+0000 7f9deffff640 1 --2- 172.21.15.123:0/1729898603 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9df813dfa0 0x7f9df80c9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:52.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.061+0000 7f9deffff640 1 -- 172.21.15.123:0/1729898603 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df80b40e0 con 0x7f9df80b5180 2024-09-15T23:15:52.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.061+0000 7f9dfd454640 1 --2- 172.21.15.123:0/1729898603 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9df813dfa0 0x7f9df80c9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:52.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.061+0000 7f9deffff640 1 --2- 172.21.15.123:0/1729898603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9df80b5180 0x7f9df80b3970 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f9de80118e0 tx=0x7f9de8011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:52.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.061+0000 7f9ded7fa640 1 -- 172.21.15.123:0/1729898603 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de800faf0 con 0x7f9df80b5180 2024-09-15T23:15:52.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.062+0000 7f9ded7fa640 1 -- 172.21.15.123:0/1729898603 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9de800fc90 con 0x7f9df80b5180 2024-09-15T23:15:52.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.062+0000 7f9ded7fa640 1 -- 172.21.15.123:0/1729898603 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de8014440 con 0x7f9df80b5180 2024-09-15T23:15:52.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.062+0000 7f9dfeeb7640 1 -- 172.21.15.123:0/1729898603 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9df80b43c0 con 0x7f9df80b5180 2024-09-15T23:15:52.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.062+0000 7f9dfeeb7640 1 -- 172.21.15.123:0/1729898603 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9df80b4980 con 0x7f9df80b5180 2024-09-15T23:15:52.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.063+0000 7f9dfeeb7640 1 -- 172.21.15.123:0/1729898603 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9df815bcf0 con 0x7f9df80b5180 2024-09-15T23:15:52.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.063+0000 7f9ded7fa640 1 -- 172.21.15.123:0/1729898603 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9de8012040 con 0x7f9df80b5180 2024-09-15T23:15:52.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.064+0000 7f9ded7fa640 1 --2- 172.21.15.123:0/1729898603 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9de406c2e0 0x7f9de406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:52.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.064+0000 7f9ded7fa640 1 -- 172.21.15.123:0/1729898603 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 4857+0+0 (secure 0 0 0) 0x7f9de808b750 con 0x7f9df80b5180 2024-09-15T23:15:52.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.064+0000 7f9dfcc53640 1 --2- 172.21.15.123:0/1729898603 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9de406c2e0 0x7f9de406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:52.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.064+0000 7f9dfcc53640 1 --2- 172.21.15.123:0/1729898603 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9de406c2e0 0x7f9de406e7a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9df4000f80 tx=0x7f9df4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:52.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.068+0000 7f9ded7fa640 1 -- 172.21.15.123:0/1729898603 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9de8019030 con 0x7f9df80b5180 2024-09-15T23:15:52.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.234+0000 7f9dfeeb7640 1 -- 172.21.15.123:0/1729898603 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f9df806c9c0 con 0x7f9df80b5180 2024-09-15T23:15:52.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.234+0000 7f9ded7fa640 1 -- 172.21.15.123:0/1729898603 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v78) ==== 84+0+65 (secure 0 0 0) 0x7f9de805a210 con 0x7f9df80b5180 2024-09-15T23:15:52.236 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:52.236 INFO:teuthology.orchestra.run.smithi123.stdout:[ 2024-09-15T23:15:52.236 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:15:52.236 INFO:teuthology.orchestra.run.smithi123.stdout: "poolnum": 1, 2024-09-15T23:15:52.236 INFO:teuthology.orchestra.run.smithi123.stdout: "poolname": ".mgr" 2024-09-15T23:15:52.236 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:15:52.236 INFO:teuthology.orchestra.run.smithi123.stdout:] 2024-09-15T23:15:52.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.236+0000 7f9dfeeb7640 1 -- 172.21.15.123:0/1729898603 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9de406c2e0 msgr2=0x7f9de406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:52.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.236+0000 7f9dfeeb7640 1 --2- 172.21.15.123:0/1729898603 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9de406c2e0 0x7f9de406e7a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9df4000f80 tx=0x7f9df4009040 comp rx=0 tx=0).stop 2024-09-15T23:15:52.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.236+0000 7f9dfeeb7640 1 -- 172.21.15.123:0/1729898603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9df80b5180 msgr2=0x7f9df80b3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:52.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.236+0000 7f9dfeeb7640 1 --2- 172.21.15.123:0/1729898603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9df80b5180 0x7f9df80b3970 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f9de80118e0 tx=0x7f9de8011da0 comp rx=0 tx=0).stop 2024-09-15T23:15:52.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.236+0000 7f9dfeeb7640 1 -- 172.21.15.123:0/1729898603 shutdown_connections 2024-09-15T23:15:52.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.236+0000 7f9dfeeb7640 1 --2- 172.21.15.123:0/1729898603 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9df813dfa0 0x7f9df80c9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:52.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.236+0000 7f9dfeeb7640 1 --2- 172.21.15.123:0/1729898603 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9de406c2e0 0x7f9de406e7a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:52.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.236+0000 7f9dfeeb7640 1 --2- 172.21.15.123:0/1729898603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9df80b5180 0x7f9df80b3970 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:52.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.236+0000 7f9dfeeb7640 1 --2- 172.21.15.123:0/1729898603 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9de00051c0 0x7f9df80cc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:52.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.236+0000 7f9dfeeb7640 1 -- 172.21.15.123:0/1729898603 >> 172.21.15.123:0/1729898603 conn(0x7f9df80ccec0 msgr2=0x7f9df80cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:52.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.236+0000 7f9dfeeb7640 1 -- 172.21.15.123:0/1729898603 shutdown_connections 2024-09-15T23:15:52.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.236+0000 7f9dfeeb7640 1 -- 172.21.15.123:0/1729898603 wait complete. 2024-09-15T23:15:52.249 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T23:15:52.249 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T23:15:52.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.351+0000 7f5a65f8d640 1 Processor -- start 2024-09-15T23:15:52.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.351+0000 7f5a65f8d640 1 -- start start 2024-09-15T23:15:52.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.352+0000 7f5a65f8d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a600cfb30 0x7f5a601660b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:52.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.352+0000 7f5a65f8d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a600b0680 con 0x7f5a600b2370 2024-09-15T23:15:52.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.352+0000 7f5a65f8d640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a600ccf70 con 0x7f5a60155b20 2024-09-15T23:15:52.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.352+0000 7f5a65f8d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5a600b01e0 con 0x7f5a600cfb30 2024-09-15T23:15:52.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.352+0000 7f5a5effd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f5a600b2370 0x7f5a600cf420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60414/0 (socket says 172.21.15.123:60414) 2024-09-15T23:15:52.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.352+0000 7f5a5effd640 1 -- 172.21.15.123:0/1501810469 learned_addr learned my addr 172.21.15.123:0/1501810469 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:52.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.352+0000 7f5a5ffff640 1 --2- 172.21.15.123:0/1501810469 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a600cfb30 0x7f5a601660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:52.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.352+0000 7f5a5e7fc640 1 -- 172.21.15.123:0/1501810469 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2637672688 0 0) 0x7f5a600b0680 con 0x7f5a600b2370 2024-09-15T23:15:52.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.352+0000 7f5a5e7fc640 1 -- 172.21.15.123:0/1501810469 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a4c003520 con 0x7f5a600b2370 2024-09-15T23:15:52.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.352+0000 7f5a5e7fc640 1 -- 172.21.15.123:0/1501810469 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2682243292 0 0) 0x7f5a4c003520 con 0x7f5a600b2370 2024-09-15T23:15:52.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.352+0000 7f5a5e7fc640 1 -- 172.21.15.123:0/1501810469 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a600cfb30 msgr2=0x7f5a601660b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:52.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.352+0000 7f5a5e7fc640 1 --2- 172.21.15.123:0/1501810469 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a600cfb30 0x7f5a601660b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:52.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.352+0000 7f5a5e7fc640 1 -- 172.21.15.123:0/1501810469 >> v1:172.21.15.188:6789/0 conn(0x7f5a60155b20 legacy=0x7f5a600b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:52.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.352+0000 7f5a5e7fc640 1 -- 172.21.15.123:0/1501810469 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a600ce940 con 0x7f5a600b2370 2024-09-15T23:15:52.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.352+0000 7f5a5e7fc640 1 -- 172.21.15.123:0/1501810469 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f5a48001670 con 0x7f5a600b2370 2024-09-15T23:15:52.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.352+0000 7f5a5e7fc640 1 -- 172.21.15.123:0/1501810469 >> v1:172.21.15.123:6789/0 conn(0x7f5a600b2370 legacy=0x7f5a600cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:52.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.352+0000 7f5a5e7fc640 1 --2- 172.21.15.123:0/1501810469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a4c0039e0 0x7f5a4c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:52.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.352+0000 7f5a5e7fc640 1 --2- 172.21.15.123:0/1501810469 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5a4c004800 0x7f5a4c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:52.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.352+0000 7f5a5e7fc640 1 --2- 172.21.15.123:0/1501810469 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a600cfb30 0x7f5a4c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:52.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.352+0000 7f5a5e7fc640 1 -- 172.21.15.123:0/1501810469 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5a600b01e0 con 0x7f5a4c0039e0 2024-09-15T23:15:52.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.352+0000 7f5a5e7fc640 1 -- 172.21.15.123:0/1501810469 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4c00baa0 con 0x7f5a4c004800 2024-09-15T23:15:52.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.352+0000 7f5a5e7fc640 1 -- 172.21.15.123:0/1501810469 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5a4c00deb0 con 0x7f5a600cfb30 2024-09-15T23:15:52.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.352+0000 7f5a5f7fe640 1 --2- 172.21.15.123:0/1501810469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a4c0039e0 0x7f5a4c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:52.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.353+0000 7f5a5effd640 1 --2- 172.21.15.123:0/1501810469 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5a4c004800 0x7f5a4c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:52.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.353+0000 7f5a5ffff640 1 --2- 172.21.15.123:0/1501810469 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a600cfb30 0x7f5a4c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:52.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.353+0000 7f5a5f7fe640 1 -- 172.21.15.123:0/1501810469 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a600cfb30 msgr2=0x7f5a4c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:52.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.353+0000 7f5a5f7fe640 1 --2- 172.21.15.123:0/1501810469 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a600cfb30 0x7f5a4c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:52.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.353+0000 7f5a5f7fe640 1 -- 172.21.15.123:0/1501810469 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5a4c004800 msgr2=0x7f5a4c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:52.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.353+0000 7f5a5f7fe640 1 --2- 172.21.15.123:0/1501810469 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5a4c004800 0x7f5a4c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:52.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.353+0000 7f5a5f7fe640 1 -- 172.21.15.123:0/1501810469 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a4c003520 con 0x7f5a4c0039e0 2024-09-15T23:15:52.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.353+0000 7f5a5f7fe640 1 --2- 172.21.15.123:0/1501810469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a4c0039e0 0x7f5a4c003e00 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f5a50001720 tx=0x7f5a4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3490a002b3b08316 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:52.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.354+0000 7f5a5e7fc640 1 -- 172.21.15.123:0/1501810469 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50001370 con 0x7f5a4c0039e0 2024-09-15T23:15:52.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.354+0000 7f5a5e7fc640 1 -- 172.21.15.123:0/1501810469 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a500052d0 con 0x7f5a4c0039e0 2024-09-15T23:15:52.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.354+0000 7f5a5e7fc640 1 -- 172.21.15.123:0/1501810469 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5002ab90 con 0x7f5a4c0039e0 2024-09-15T23:15:52.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.354+0000 7f5a65f8d640 1 -- 172.21.15.123:0/1501810469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a4c0039e0 msgr2=0x7f5a4c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:52.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.354+0000 7f5a65f8d640 1 --2- 172.21.15.123:0/1501810469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a4c0039e0 0x7f5a4c003e00 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f5a50001720 tx=0x7f5a4c005830 comp rx=0 tx=0).stop 2024-09-15T23:15:52.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.354+0000 7f5a5ffff640 1 -- 172.21.15.123:0/1501810469 reap_dead start 2024-09-15T23:15:52.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.354+0000 7f5a65f8d640 1 -- 172.21.15.123:0/1501810469 shutdown_connections 2024-09-15T23:15:52.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.354+0000 7f5a65f8d640 1 -- 172.21.15.123:0/1501810469 >> 172.21.15.123:0/1501810469 conn(0x7f5a6006c240 msgr2=0x7f5a6006d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:52.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.354+0000 7f5a65f8d640 1 -- 172.21.15.123:0/1501810469 shutdown_connections 2024-09-15T23:15:52.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.354+0000 7f5a65f8d640 1 -- 172.21.15.123:0/1501810469 wait complete. 2024-09-15T23:15:52.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.355+0000 7f5a65f8d640 1 Processor -- start 2024-09-15T23:15:52.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.355+0000 7f5a65f8d640 1 -- start start 2024-09-15T23:15:52.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.356+0000 7f5a65f8d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a4c0039e0 0x7f5a60158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:52.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.356+0000 7f5a65f8d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a6014d790 0x7f5a6014f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:52.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.356+0000 7f5a65f8d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5a6014f6a0 0x7f5a6014fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:52.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.356+0000 7f5a65f8d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5a600ce610 con 0x7f5a4c0039e0 2024-09-15T23:15:52.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.356+0000 7f5a65f8d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5a600cef00 con 0x7f5a6014f6a0 2024-09-15T23:15:52.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.356+0000 7f5a65f8d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5a600ccb20 con 0x7f5a6014d790 2024-09-15T23:15:52.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.356+0000 7f5a5f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a4c0039e0 0x7f5a60158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:52.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.356+0000 7f5a5f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a4c0039e0 0x7f5a60158c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58740/0 (socket says 172.21.15.123:58740) 2024-09-15T23:15:52.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.356+0000 7f5a5f7fe640 1 -- 172.21.15.123:0/3755016336 learned_addr learned my addr 172.21.15.123:0/3755016336 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:52.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.356+0000 7f5a5ffff640 1 --2- 172.21.15.123:0/3755016336 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5a6014f6a0 0x7f5a6014fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:52.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.356+0000 7f5a5effd640 1 --2- 172.21.15.123:0/3755016336 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a6014d790 0x7f5a6014f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:52.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.356+0000 7f5a5f7fe640 1 -- 172.21.15.123:0/3755016336 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a6014d790 msgr2=0x7f5a6014f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:52.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.356+0000 7f5a5f7fe640 1 --2- 172.21.15.123:0/3755016336 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a6014d790 0x7f5a6014f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:52.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.356+0000 7f5a5f7fe640 1 -- 172.21.15.123:0/3755016336 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5a6014f6a0 msgr2=0x7f5a6014fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:52.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.356+0000 7f5a5f7fe640 1 --2- 172.21.15.123:0/3755016336 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5a6014f6a0 0x7f5a6014fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:52.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.356+0000 7f5a5f7fe640 1 -- 172.21.15.123:0/3755016336 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a60159190 con 0x7f5a4c0039e0 2024-09-15T23:15:52.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.357+0000 7f5a5ffff640 1 --2- 172.21.15.123:0/3755016336 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5a6014f6a0 0x7f5a6014fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:52.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.357+0000 7f5a5f7fe640 1 --2- 172.21.15.123:0/3755016336 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a4c0039e0 0x7f5a60158c50 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f5a50008fd0 tx=0x7f5a50001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:52.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.357+0000 7f5a57fff640 1 -- 172.21.15.123:0/3755016336 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50040020 con 0x7f5a4c0039e0 2024-09-15T23:15:52.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.357+0000 7f5a57fff640 1 -- 172.21.15.123:0/3755016336 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a5002be40 con 0x7f5a4c0039e0 2024-09-15T23:15:52.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.357+0000 7f5a65f8d640 1 -- 172.21.15.123:0/3755016336 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a6013f620 con 0x7f5a4c0039e0 2024-09-15T23:15:52.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.357+0000 7f5a57fff640 1 -- 172.21.15.123:0/3755016336 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50001370 con 0x7f5a4c0039e0 2024-09-15T23:15:52.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.357+0000 7f5a65f8d640 1 -- 172.21.15.123:0/3755016336 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a60150430 con 0x7f5a4c0039e0 2024-09-15T23:15:52.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.358+0000 7f5a65f8d640 1 -- 172.21.15.123:0/3755016336 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a600cf420 con 0x7f5a4c0039e0 2024-09-15T23:15:52.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.359+0000 7f5a57fff640 1 -- 172.21.15.123:0/3755016336 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5a50043020 con 0x7f5a4c0039e0 2024-09-15T23:15:52.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.359+0000 7f5a57fff640 1 --2- 172.21.15.123:0/3755016336 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5a4006c2e0 0x7f5a4006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:52.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.359+0000 7f5a57fff640 1 -- 172.21.15.123:0/3755016336 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 4857+0+0 (secure 0 0 0) 0x7f5a500ab030 con 0x7f5a4c0039e0 2024-09-15T23:15:52.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.359+0000 7f5a5effd640 1 --2- 172.21.15.123:0/3755016336 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5a4006c2e0 0x7f5a4006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:52.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.360+0000 7f5a5effd640 1 --2- 172.21.15.123:0/3755016336 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5a4006c2e0 0x7f5a4006e7a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5a48001050 tx=0x7f5a48009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:52.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.363+0000 7f5a57fff640 1 -- 172.21.15.123:0/3755016336 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5a5004a030 con 0x7f5a4c0039e0 2024-09-15T23:15:52.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.530+0000 7f5a65f8d640 1 -- 172.21.15.123:0/3755016336 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f5a600b1ab0 con 0x7f5a4c0039e0 2024-09-15T23:15:52.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.870+0000 7f5a57fff640 1 -- 172.21.15.123:0/3755016336 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v79) ==== 138+0+0 (secure 0 0 0) 0x7f5a60159190 con 0x7f5a4c0039e0 2024-09-15T23:15:52.872 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' created 2024-09-15T23:15:52.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.874+0000 7f5a65f8d640 1 -- 172.21.15.123:0/3755016336 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5a4006c2e0 msgr2=0x7f5a4006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:52.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.874+0000 7f5a65f8d640 1 --2- 172.21.15.123:0/3755016336 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5a4006c2e0 0x7f5a4006e7a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5a48001050 tx=0x7f5a48009040 comp rx=0 tx=0).stop 2024-09-15T23:15:52.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.874+0000 7f5a65f8d640 1 -- 172.21.15.123:0/3755016336 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a4c0039e0 msgr2=0x7f5a60158c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:52.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.874+0000 7f5a65f8d640 1 --2- 172.21.15.123:0/3755016336 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a4c0039e0 0x7f5a60158c50 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f5a50008fd0 tx=0x7f5a50001120 comp rx=0 tx=0).stop 2024-09-15T23:15:52.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.874+0000 7f5a65f8d640 1 -- 172.21.15.123:0/3755016336 shutdown_connections 2024-09-15T23:15:52.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.874+0000 7f5a65f8d640 1 --2- 172.21.15.123:0/3755016336 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5a6014f6a0 0x7f5a6014fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:52.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.874+0000 7f5a65f8d640 1 --2- 172.21.15.123:0/3755016336 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a6014d790 0x7f5a6014f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:52.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.874+0000 7f5a65f8d640 1 --2- 172.21.15.123:0/3755016336 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5a4006c2e0 0x7f5a4006e7a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:52.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.874+0000 7f5a65f8d640 1 --2- 172.21.15.123:0/3755016336 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a4c0039e0 0x7f5a60158c50 secure :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f5a50008fd0 tx=0x7f5a50001120 comp rx=0 tx=0).stop 2024-09-15T23:15:52.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.874+0000 7f5a65f8d640 1 -- 172.21.15.123:0/3755016336 >> 172.21.15.123:0/3755016336 conn(0x7f5a6006c240 msgr2=0x7f5a60072010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:52.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.874+0000 7f5a65f8d640 1 -- 172.21.15.123:0/3755016336 shutdown_connections 2024-09-15T23:15:52.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.874+0000 7f5a65f8d640 1 -- 172.21.15.123:0/3755016336 wait complete. 2024-09-15T23:15:52.890 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T23:15:52.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.997+0000 7f2059dfd640 1 Processor -- start 2024-09-15T23:15:52.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.997+0000 7f2059dfd640 1 -- start start 2024-09-15T23:15:53.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.998+0000 7f2059dfd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f20540ccf30 0x7f20540b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:53.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.998+0000 7f2059dfd640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20540cf2e0 con 0x7f20540cead0 2024-09-15T23:15:53.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.998+0000 7f2059dfd640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2054070fe0 con 0x7f205415b7c0 2024-09-15T23:15:53.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.998+0000 7f2059dfd640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f20540712c0 con 0x7f20540ccf30 2024-09-15T23:15:53.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.998+0000 7f2053fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f20540cead0 0x7f2054071ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60416/0 (socket says 172.21.15.123:60416) 2024-09-15T23:15:53.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.998+0000 7f2053fff640 1 -- 172.21.15.123:0/651893217 learned_addr learned my addr 172.21.15.123:0/651893217 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:53.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.998+0000 7f20527fc640 1 -- 172.21.15.123:0/651893217 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1137773785 0 0) 0x7f20540cf2e0 con 0x7f20540cead0 2024-09-15T23:15:53.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.998+0000 7f20527fc640 1 -- 172.21.15.123:0/651893217 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2040003520 con 0x7f20540cead0 2024-09-15T23:15:53.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.998+0000 7f20537fe640 1 --2- 172.21.15.123:0/651893217 >> v2:172.21.15.188:3300/0 conn(0x7f20540ccf30 0x7f20540b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:53.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.998+0000 7f20527fc640 1 -- 172.21.15.123:0/651893217 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2776915936 0 0) 0x7f2040003520 con 0x7f20540cead0 2024-09-15T23:15:53.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.998+0000 7f20527fc640 1 -- 172.21.15.123:0/651893217 >> v2:172.21.15.188:3300/0 conn(0x7f20540ccf30 msgr2=0x7f20540b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:53.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.998+0000 7f20527fc640 1 --2- 172.21.15.123:0/651893217 >> v2:172.21.15.188:3300/0 conn(0x7f20540ccf30 0x7f20540b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:53.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.998+0000 7f20527fc640 1 -- 172.21.15.123:0/651893217 >> v1:172.21.15.188:6789/0 conn(0x7f205415b7c0 legacy=0x7f20540cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:53.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.998+0000 7f20527fc640 1 -- 172.21.15.123:0/651893217 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20540715a0 con 0x7f20540cead0 2024-09-15T23:15:53.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.998+0000 7f20527fc640 1 -- 172.21.15.123:0/651893217 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f204c0019f0 con 0x7f20540cead0 2024-09-15T23:15:53.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.998+0000 7f20527fc640 1 -- 172.21.15.123:0/651893217 >> v1:172.21.15.123:6789/0 conn(0x7f20540cead0 legacy=0x7f2054071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:53.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.998+0000 7f20527fc640 1 --2- 172.21.15.123:0/651893217 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20400039b0 0x7f2040003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:53.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.998+0000 7f20527fc640 1 --2- 172.21.15.123:0/651893217 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2040004800 0x7f2040004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:53.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.998+0000 7f20527fc640 1 --2- 172.21.15.123:0/651893217 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20400052e0 0x7f204000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:53.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.998+0000 7f20527fc640 1 -- 172.21.15.123:0/651893217 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f20540712c0 con 0x7f20400052e0 2024-09-15T23:15:53.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.998+0000 7f20527fc640 1 -- 172.21.15.123:0/651893217 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f204000c1b0 con 0x7f20400039b0 2024-09-15T23:15:53.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.998+0000 7f20527fc640 1 -- 172.21.15.123:0/651893217 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f204000c3b0 con 0x7f2040004800 2024-09-15T23:15:53.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.998+0000 7f2053fff640 1 --2- 172.21.15.123:0/651893217 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20400052e0 0x7f204000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:53.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.999+0000 7f20537fe640 1 --2- 172.21.15.123:0/651893217 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20400039b0 0x7f2040003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:53.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.999+0000 7f2052ffd640 1 --2- 172.21.15.123:0/651893217 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2040004800 0x7f2040004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:53.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.999+0000 7f2053fff640 1 -- 172.21.15.123:0/651893217 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2040004800 msgr2=0x7f2040004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:53.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.999+0000 7f2053fff640 1 --2- 172.21.15.123:0/651893217 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2040004800 0x7f2040004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:53.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.999+0000 7f2053fff640 1 -- 172.21.15.123:0/651893217 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20400039b0 msgr2=0x7f2040003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:53.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.999+0000 7f2053fff640 1 --2- 172.21.15.123:0/651893217 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20400039b0 0x7f2040003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:53.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.999+0000 7f2053fff640 1 -- 172.21.15.123:0/651893217 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2040003520 con 0x7f20400052e0 2024-09-15T23:15:53.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.999+0000 7f2053fff640 1 -- 172.21.15.123:0/651893217 reap_dead start 2024-09-15T23:15:53.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:52.999+0000 7f2053fff640 1 --2- 172.21.15.123:0/651893217 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20400052e0 0x7f204000b9c0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f204c00a830 tx=0x7f2040005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab4bc902cbc71f1e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:53.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.000+0000 7f20527fc640 1 -- 172.21.15.123:0/651893217 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c00a480 con 0x7f20400052e0 2024-09-15T23:15:53.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.000+0000 7f20527fc640 1 -- 172.21.15.123:0/651893217 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f204c02f070 con 0x7f20400052e0 2024-09-15T23:15:53.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.000+0000 7f20527fc640 1 -- 172.21.15.123:0/651893217 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c02bc90 con 0x7f20400052e0 2024-09-15T23:15:53.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.000+0000 7f2059dfd640 1 -- 172.21.15.123:0/651893217 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20400052e0 msgr2=0x7f204000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:53.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.000+0000 7f2059dfd640 1 --2- 172.21.15.123:0/651893217 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20400052e0 0x7f204000b9c0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f204c00a830 tx=0x7f2040005830 comp rx=0 tx=0).stop 2024-09-15T23:15:53.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.000+0000 7f2059dfd640 1 -- 172.21.15.123:0/651893217 shutdown_connections 2024-09-15T23:15:53.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.000+0000 7f2059dfd640 1 --2- 172.21.15.123:0/651893217 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20400052e0 0x7f204000b9c0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:53.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.000+0000 7f2059dfd640 1 -- 172.21.15.123:0/651893217 >> 172.21.15.123:0/651893217 conn(0x7f205406d0f0 msgr2=0x7f205406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:53.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.000+0000 7f2059dfd640 1 -- 172.21.15.123:0/651893217 shutdown_connections 2024-09-15T23:15:53.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.000+0000 7f2059dfd640 1 -- 172.21.15.123:0/651893217 wait complete. 2024-09-15T23:15:53.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.001+0000 7f2059dfd640 1 Processor -- start 2024-09-15T23:15:53.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.002+0000 7f2059dfd640 1 -- start start 2024-09-15T23:15:53.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.002+0000 7f2059dfd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20400052e0 0x7f20541400e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:53.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.002+0000 7f2059dfd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2054151020 0x7f2054151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:53.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.002+0000 7f2059dfd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20540b5af0 0x7f20540b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:53.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.002+0000 7f2059dfd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f20540cf080 con 0x7f20540b5af0 2024-09-15T23:15:53.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.002+0000 7f2059dfd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f20540cef00 con 0x7f20400052e0 2024-09-15T23:15:53.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.002+0000 7f2059dfd640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f20540b2c50 con 0x7f2054151020 2024-09-15T23:15:53.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.002+0000 7f2053fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20540b5af0 0x7f20540b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:53.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.002+0000 7f2053fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20540b5af0 0x7f20540b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58762/0 (socket says 172.21.15.123:58762) 2024-09-15T23:15:53.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.002+0000 7f2053fff640 1 -- 172.21.15.123:0/3247932426 learned_addr learned my addr 172.21.15.123:0/3247932426 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:53.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.002+0000 7f20537fe640 1 --2- 172.21.15.123:0/3247932426 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20400052e0 0x7f20541400e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:53.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.003+0000 7f2052ffd640 1 --2- 172.21.15.123:0/3247932426 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2054151020 0x7f2054151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:53.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.003+0000 7f2053fff640 1 -- 172.21.15.123:0/3247932426 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2054151020 msgr2=0x7f2054151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:53.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.003+0000 7f2053fff640 1 --2- 172.21.15.123:0/3247932426 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2054151020 0x7f2054151480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:53.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.003+0000 7f2053fff640 1 -- 172.21.15.123:0/3247932426 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20400052e0 msgr2=0x7f20541400e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:53.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.003+0000 7f2053fff640 1 --2- 172.21.15.123:0/3247932426 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20400052e0 0x7f20541400e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:53.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.003+0000 7f2053fff640 1 -- 172.21.15.123:0/3247932426 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2054153c50 con 0x7f20540b5af0 2024-09-15T23:15:53.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.003+0000 7f2053fff640 1 --2- 172.21.15.123:0/3247932426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20540b5af0 0x7f20540b5f70 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f204c00a950 tx=0x7f20540711b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:53.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.003+0000 7f204bfff640 1 -- 172.21.15.123:0/3247932426 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c00a480 con 0x7f20540b5af0 2024-09-15T23:15:53.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.003+0000 7f204bfff640 1 -- 172.21.15.123:0/3247932426 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f204c02bd90 con 0x7f20540b5af0 2024-09-15T23:15:53.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.003+0000 7f2059dfd640 1 -- 172.21.15.123:0/3247932426 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2054153f30 con 0x7f20540b5af0 2024-09-15T23:15:53.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.003+0000 7f204bfff640 1 -- 172.21.15.123:0/3247932426 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c034690 con 0x7f20540b5af0 2024-09-15T23:15:53.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.003+0000 7f2059dfd640 1 -- 172.21.15.123:0/3247932426 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20541544f0 con 0x7f20540b5af0 2024-09-15T23:15:53.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.004+0000 7f2059dfd640 1 -- 172.21.15.123:0/3247932426 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20540b2fe0 con 0x7f20540b5af0 2024-09-15T23:15:53.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.005+0000 7f204bfff640 1 -- 172.21.15.123:0/3247932426 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f204c034830 con 0x7f20540b5af0 2024-09-15T23:15:53.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.005+0000 7f204bfff640 1 --2- 172.21.15.123:0/3247932426 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f203406c2b0 0x7f203406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:53.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.005+0000 7f204bfff640 1 -- 172.21.15.123:0/3247932426 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5227+0+0 (secure 0 0 0) 0x7f204c0ab2a0 con 0x7f20540b5af0 2024-09-15T23:15:53.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.006+0000 7f20537fe640 1 --2- 172.21.15.123:0/3247932426 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f203406c2b0 0x7f203406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:53.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.006+0000 7f20537fe640 1 --2- 172.21.15.123:0/3247932426 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f203406c2b0 0x7f203406e770 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2044006fd0 tx=0x7f2044008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:53.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.009+0000 7f204bfff640 1 -- 172.21.15.123:0/3247932426 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f204c079680 con 0x7f20540b5af0 2024-09-15T23:15:53.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.174+0000 7f2059dfd640 1 -- 172.21.15.123:0/3247932426 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f20540cc960 con 0x7f20540b5af0 2024-09-15T23:15:53.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.878+0000 7f204bfff640 1 -- 172.21.15.123:0/3247932426 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v80) ==== 170+0+0 (secure 0 0 0) 0x7f204c07d980 con 0x7f20540b5af0 2024-09-15T23:15:53.880 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' created 2024-09-15T23:15:53.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.882+0000 7f2059dfd640 1 -- 172.21.15.123:0/3247932426 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f203406c2b0 msgr2=0x7f203406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:53.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.882+0000 7f2059dfd640 1 --2- 172.21.15.123:0/3247932426 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f203406c2b0 0x7f203406e770 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2044006fd0 tx=0x7f2044008040 comp rx=0 tx=0).stop 2024-09-15T23:15:53.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.882+0000 7f2059dfd640 1 -- 172.21.15.123:0/3247932426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20540b5af0 msgr2=0x7f20540b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:53.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.882+0000 7f2059dfd640 1 --2- 172.21.15.123:0/3247932426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20540b5af0 0x7f20540b5f70 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f204c00a950 tx=0x7f20540711b0 comp rx=0 tx=0).stop 2024-09-15T23:15:53.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.882+0000 7f2059dfd640 1 -- 172.21.15.123:0/3247932426 shutdown_connections 2024-09-15T23:15:53.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.882+0000 7f2059dfd640 1 --2- 172.21.15.123:0/3247932426 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f203406c2b0 0x7f203406e770 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:53.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.882+0000 7f2059dfd640 1 --2- 172.21.15.123:0/3247932426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20540b5af0 0x7f20540b5f70 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:53.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.882+0000 7f2059dfd640 1 --2- 172.21.15.123:0/3247932426 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2054151020 0x7f2054151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:53.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.882+0000 7f2059dfd640 1 --2- 172.21.15.123:0/3247932426 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20400052e0 0x7f20541400e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:53.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.882+0000 7f2059dfd640 1 -- 172.21.15.123:0/3247932426 >> 172.21.15.123:0/3247932426 conn(0x7f205406d0f0 msgr2=0x7f20540719c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:53.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.882+0000 7f2059dfd640 1 -- 172.21.15.123:0/3247932426 shutdown_connections 2024-09-15T23:15:53.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:53.883+0000 7f2059dfd640 1 -- 172.21.15.123:0/3247932426 wait complete. 2024-09-15T23:15:53.910 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T23:15:54.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.013+0000 7fbc6496d640 1 Processor -- start 2024-09-15T23:15:54.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.013+0000 7fbc6496d640 1 -- start start 2024-09-15T23:15:54.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.014+0000 7fbc6496d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc600b5520 0x7fbc6006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:54.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.014+0000 7fbc6496d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbc6006d260 0x7fbc60162a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:54.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.014+0000 7fbc6496d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc6015f550 con 0x7fbc6015e990 2024-09-15T23:15:54.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.014+0000 7fbc6496d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fbc6015f830 con 0x7fbc6006d260 2024-09-15T23:15:54.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.014+0000 7fbc6496d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbc6015fb10 con 0x7fbc600b5520 2024-09-15T23:15:54.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.014+0000 7fbc5ed9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbc6006d260 0x7fbc60162a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:54.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.014+0000 7fbc5ed9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbc6006d260 0x7fbc60162a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58764/0 (socket says 172.21.15.123:58764) 2024-09-15T23:15:54.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.014+0000 7fbc5ed9d640 1 -- 172.21.15.123:0/1072641584 learned_addr learned my addr 172.21.15.123:0/1072641584 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:54.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.014+0000 7fbc5e59c640 1 --1- 172.21.15.123:0/1072641584 >> v1:172.21.15.123:6789/0 conn(0x7fbc6015e990 0x7fbc6015ed70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60418/0 (socket says 172.21.15.123:60418) 2024-09-15T23:15:54.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.015+0000 7fbc5dd9b640 1 --2- 172.21.15.123:0/1072641584 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc600b5520 0x7fbc6006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:54.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.015+0000 7fbc5ed9d640 1 -- 172.21.15.123:0/1072641584 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc600b5520 msgr2=0x7fbc6006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:54.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.015+0000 7fbc5ed9d640 1 --2- 172.21.15.123:0/1072641584 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc600b5520 0x7fbc6006cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:54.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.015+0000 7fbc5ed9d640 1 -- 172.21.15.123:0/1072641584 >> v1:172.21.15.123:6789/0 conn(0x7fbc6015e990 legacy=0x7fbc6015ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:54.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.015+0000 7fbc5d59a640 1 -- 172.21.15.123:0/1072641584 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2986484441 0 0) 0x7fbc6015f550 con 0x7fbc6015e990 2024-09-15T23:15:54.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.015+0000 7fbc5ed9d640 1 -- 172.21.15.123:0/1072641584 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc601624e0 con 0x7fbc6006d260 2024-09-15T23:15:54.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.015+0000 7fbc5ed9d640 1 --2- 172.21.15.123:0/1072641584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc6006d260 0x7fbc60162a00 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fbc58009e50 tx=0x7fbc5802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7caf5be2c6b780c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:54.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.015+0000 7fbc5d59a640 1 -- 172.21.15.123:0/1072641584 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc58036070 con 0x7fbc6006d260 2024-09-15T23:15:54.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.016+0000 7fbc5d59a640 1 -- 172.21.15.123:0/1072641584 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc58031600 con 0x7fbc6006d260 2024-09-15T23:15:54.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.016+0000 7fbc5d59a640 1 -- 172.21.15.123:0/1072641584 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc580319d0 con 0x7fbc6006d260 2024-09-15T23:15:54.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.016+0000 7fbc6496d640 1 -- 172.21.15.123:0/1072641584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc6006d260 msgr2=0x7fbc60162a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:54.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.016+0000 7fbc6496d640 1 --2- 172.21.15.123:0/1072641584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc6006d260 0x7fbc60162a00 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fbc58009e50 tx=0x7fbc5802a710 comp rx=0 tx=0).stop 2024-09-15T23:15:54.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.016+0000 7fbc6496d640 1 -- 172.21.15.123:0/1072641584 shutdown_connections 2024-09-15T23:15:54.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.016+0000 7fbc6496d640 1 --2- 172.21.15.123:0/1072641584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc6006d260 0x7fbc60162a00 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:54.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.016+0000 7fbc6496d640 1 --2- 172.21.15.123:0/1072641584 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc600b5520 0x7fbc6006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:54.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.016+0000 7fbc6496d640 1 -- 172.21.15.123:0/1072641584 >> 172.21.15.123:0/1072641584 conn(0x7fbc600d25d0 msgr2=0x7fbc600d29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:54.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.016+0000 7fbc6496d640 1 -- 172.21.15.123:0/1072641584 shutdown_connections 2024-09-15T23:15:54.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.016+0000 7fbc6496d640 1 -- 172.21.15.123:0/1072641584 wait complete. 2024-09-15T23:15:54.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.017+0000 7fbc6496d640 1 Processor -- start 2024-09-15T23:15:54.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.018+0000 7fbc6496d640 1 -- start start 2024-09-15T23:15:54.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.018+0000 7fbc6496d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc6006d260 0x7fbc600cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:54.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.018+0000 7fbc6496d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc600b5520 0x7fbc600ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:54.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.018+0000 7fbc6496d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc6015e990 0x7fbc600cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:54.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.018+0000 7fbc6496d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbc601632d0 con 0x7fbc6006d260 2024-09-15T23:15:54.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.018+0000 7fbc6496d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbc60163150 con 0x7fbc6015e990 2024-09-15T23:15:54.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.018+0000 7fbc6496d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbc600b6ff0 con 0x7fbc600b5520 2024-09-15T23:15:54.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.018+0000 7fbc5e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc6006d260 0x7fbc600cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:54.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.018+0000 7fbc5e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc6006d260 0x7fbc600cb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58776/0 (socket says 172.21.15.123:58776) 2024-09-15T23:15:54.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.018+0000 7fbc5e59c640 1 -- 172.21.15.123:0/262116657 learned_addr learned my addr 172.21.15.123:0/262116657 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:54.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.019+0000 7fbc5dd9b640 1 --2- 172.21.15.123:0/262116657 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc600b5520 0x7fbc600ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:54.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.019+0000 7fbc5ed9d640 1 --2- 172.21.15.123:0/262116657 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc6015e990 0x7fbc600cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:54.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.019+0000 7fbc5e59c640 1 -- 172.21.15.123:0/262116657 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc600b5520 msgr2=0x7fbc600ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:54.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.019+0000 7fbc5e59c640 1 --2- 172.21.15.123:0/262116657 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc600b5520 0x7fbc600ccf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:54.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.019+0000 7fbc5e59c640 1 -- 172.21.15.123:0/262116657 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc6015e990 msgr2=0x7fbc600cfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:54.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.019+0000 7fbc5e59c640 1 --2- 172.21.15.123:0/262116657 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc6015e990 0x7fbc600cfa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:54.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.019+0000 7fbc5e59c640 1 -- 172.21.15.123:0/262116657 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc600cbe80 con 0x7fbc6006d260 2024-09-15T23:15:54.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.019+0000 7fbc5dd9b640 1 --2- 172.21.15.123:0/262116657 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc600b5520 0x7fbc600ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:54.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.019+0000 7fbc5ed9d640 1 --2- 172.21.15.123:0/262116657 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc6015e990 0x7fbc600cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:54.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.019+0000 7fbc5e59c640 1 --2- 172.21.15.123:0/262116657 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc6006d260 0x7fbc600cb8a0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fbc5000c430 tx=0x7fbc5000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:54.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.019+0000 7fbc4effd640 1 -- 172.21.15.123:0/262116657 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc500074e0 con 0x7fbc6006d260 2024-09-15T23:15:54.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.019+0000 7fbc4effd640 1 -- 172.21.15.123:0/262116657 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc500047e0 con 0x7fbc6006d260 2024-09-15T23:15:54.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.019+0000 7fbc6496d640 1 -- 172.21.15.123:0/262116657 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc600cc160 con 0x7fbc6006d260 2024-09-15T23:15:54.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.019+0000 7fbc4effd640 1 -- 172.21.15.123:0/262116657 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc50004bd0 con 0x7fbc6006d260 2024-09-15T23:15:54.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.019+0000 7fbc6496d640 1 -- 172.21.15.123:0/262116657 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc600cc720 con 0x7fbc6006d260 2024-09-15T23:15:54.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.020+0000 7fbc6496d640 1 -- 172.21.15.123:0/262116657 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc60162a00 con 0x7fbc6006d260 2024-09-15T23:15:54.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.021+0000 7fbc4effd640 1 -- 172.21.15.123:0/262116657 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbc50011070 con 0x7fbc6006d260 2024-09-15T23:15:54.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.021+0000 7fbc4effd640 1 --2- 172.21.15.123:0/262116657 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbc4006c2b0 0x7fbc4006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:54.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.021+0000 7fbc4effd640 1 -- 172.21.15.123:0/262116657 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5609+0+0 (secure 0 0 0) 0x7fbc5008b070 con 0x7fbc6006d260 2024-09-15T23:15:54.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.021+0000 7fbc5dd9b640 1 --2- 172.21.15.123:0/262116657 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbc4006c2b0 0x7fbc4006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:54.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.022+0000 7fbc5dd9b640 1 --2- 172.21.15.123:0/262116657 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbc4006c2b0 0x7fbc4006e770 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbc600b4080 tx=0x7fbc54008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:54.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.026+0000 7fbc4effd640 1 -- 172.21.15.123:0/262116657 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbc50059840 con 0x7fbc6006d260 2024-09-15T23:15:54.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.224+0000 7fbc6496d640 1 -- 172.21.15.123:0/262116657 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fbc600b1e70 con 0x7fbc6006d260 2024-09-15T23:15:54.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.880+0000 7fbc4effd640 1 -- 172.21.15.123:0/262116657 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v42) ==== 174+0+0 (secure 0 0 0) 0x7fbc50059140 con 0x7fbc6006d260 2024-09-15T23:15:54.881 INFO:teuthology.orchestra.run.smithi123.stderr:new fs with metadata pool 10 and data pool 11 2024-09-15T23:15:54.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.889+0000 7fbc6496d640 1 -- 172.21.15.123:0/262116657 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbc4006c2b0 msgr2=0x7fbc4006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:54.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.889+0000 7fbc6496d640 1 --2- 172.21.15.123:0/262116657 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbc4006c2b0 0x7fbc4006e770 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbc600b4080 tx=0x7fbc54008040 comp rx=0 tx=0).stop 2024-09-15T23:15:54.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.890+0000 7fbc6496d640 1 -- 172.21.15.123:0/262116657 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc6006d260 msgr2=0x7fbc600cb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:54.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.890+0000 7fbc6496d640 1 --2- 172.21.15.123:0/262116657 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc6006d260 0x7fbc600cb8a0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fbc5000c430 tx=0x7fbc5000c8f0 comp rx=0 tx=0).stop 2024-09-15T23:15:54.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.891+0000 7fbc6496d640 1 -- 172.21.15.123:0/262116657 shutdown_connections 2024-09-15T23:15:54.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.891+0000 7fbc6496d640 1 --2- 172.21.15.123:0/262116657 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc6015e990 0x7fbc600cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:54.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.891+0000 7fbc6496d640 1 --2- 172.21.15.123:0/262116657 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc600b5520 0x7fbc600ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:54.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.891+0000 7fbc6496d640 1 --2- 172.21.15.123:0/262116657 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbc4006c2b0 0x7fbc4006e770 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:54.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.891+0000 7fbc6496d640 1 --2- 172.21.15.123:0/262116657 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc6006d260 0x7fbc600cb8a0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:54.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.891+0000 7fbc6496d640 1 -- 172.21.15.123:0/262116657 >> 172.21.15.123:0/262116657 conn(0x7fbc600d25d0 msgr2=0x7fbc6015ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:54.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.892+0000 7fbc6496d640 1 -- 172.21.15.123:0/262116657 shutdown_connections 2024-09-15T23:15:54.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:54.899+0000 7fbc6496d640 1 -- 172.21.15.123:0/262116657 wait complete. 2024-09-15T23:15:54.921 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:15:55.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.021+0000 7f6aa2627640 1 Processor -- start 2024-09-15T23:15:55.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.021+0000 7f6aa2627640 1 -- start start 2024-09-15T23:15:55.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.022+0000 7f6aa2627640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f6a9c145ed0 0x7f6a9c0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:55.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.022+0000 7f6aa2627640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a9c0b4020 con 0x7f6a9c073180 2024-09-15T23:15:55.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.022+0000 7f6aa2627640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a9c0b42c0 con 0x7f6a9c0b5f90 2024-09-15T23:15:55.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.022+0000 7f6aa2627640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f6a9c0b63d0 con 0x7f6a9c145ed0 2024-09-15T23:15:55.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.022+0000 7f6a9b7fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6a9c073180 0x7f6a9c0b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60428/0 (socket says 172.21.15.123:60428) 2024-09-15T23:15:55.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.022+0000 7f6a9b7fe640 1 -- 172.21.15.123:0/225433755 learned_addr learned my addr 172.21.15.123:0/225433755 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:55.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.022+0000 7f6a9affd640 1 -- 172.21.15.123:0/225433755 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4094644252 0 0) 0x7f6a9c0b4020 con 0x7f6a9c073180 2024-09-15T23:15:55.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.022+0000 7f6a9affd640 1 -- 172.21.15.123:0/225433755 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a84003520 con 0x7f6a9c073180 2024-09-15T23:15:55.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.022+0000 7f6a9bfff640 1 --2- 172.21.15.123:0/225433755 >> v2:172.21.15.188:3300/0 conn(0x7f6a9c145ed0 0x7f6a9c0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:55.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.023+0000 7f6a9affd640 1 -- 172.21.15.123:0/225433755 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3103550299 0 0) 0x7f6a84003520 con 0x7f6a9c073180 2024-09-15T23:15:55.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.023+0000 7f6a9affd640 1 -- 172.21.15.123:0/225433755 >> v2:172.21.15.188:3300/0 conn(0x7f6a9c145ed0 msgr2=0x7f6a9c0b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:55.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.023+0000 7f6a9affd640 1 --2- 172.21.15.123:0/225433755 >> v2:172.21.15.188:3300/0 conn(0x7f6a9c145ed0 0x7f6a9c0b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:55.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.023+0000 7f6a9affd640 1 -- 172.21.15.123:0/225433755 >> v1:172.21.15.188:6789/0 conn(0x7f6a9c0b5f90 legacy=0x7f6a9c15cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:55.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.023+0000 7f6a9affd640 1 -- 172.21.15.123:0/225433755 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a9c0b45a0 con 0x7f6a9c073180 2024-09-15T23:15:55.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.023+0000 7f6a9affd640 1 -- 172.21.15.123:0/225433755 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f6a90001690 con 0x7f6a9c073180 2024-09-15T23:15:55.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.023+0000 7f6a9affd640 1 -- 172.21.15.123:0/225433755 >> v1:172.21.15.123:6789/0 conn(0x7f6a9c073180 legacy=0x7f6a9c0b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:55.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.023+0000 7f6a9affd640 1 --2- 172.21.15.123:0/225433755 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a84003a00 0x7f6a84003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:55.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.023+0000 7f6a9affd640 1 --2- 172.21.15.123:0/225433755 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a84004800 0x7f6a84004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:55.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.023+0000 7f6a9affd640 1 --2- 172.21.15.123:0/225433755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a840051c0 0x7f6a8400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:55.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.023+0000 7f6a9affd640 1 -- 172.21.15.123:0/225433755 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9c0b63d0 con 0x7f6a840051c0 2024-09-15T23:15:55.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.023+0000 7f6a9affd640 1 -- 172.21.15.123:0/225433755 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6a8400c0c0 con 0x7f6a84004800 2024-09-15T23:15:55.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.023+0000 7f6a9affd640 1 -- 172.21.15.123:0/225433755 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6a8400c2c0 con 0x7f6a84003a00 2024-09-15T23:15:55.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.023+0000 7f6aa0bc4640 1 --2- 172.21.15.123:0/225433755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a840051c0 0x7f6a8400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:55.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.023+0000 7f6a9bfff640 1 --2- 172.21.15.123:0/225433755 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a84003a00 0x7f6a84003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:55.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.023+0000 7f6a9b7fe640 1 --2- 172.21.15.123:0/225433755 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a84004800 0x7f6a84004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:55.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.023+0000 7f6aa0bc4640 1 -- 172.21.15.123:0/225433755 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a84003a00 msgr2=0x7f6a84003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:55.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.023+0000 7f6aa0bc4640 1 --2- 172.21.15.123:0/225433755 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a84003a00 0x7f6a84003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:55.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.023+0000 7f6aa0bc4640 1 -- 172.21.15.123:0/225433755 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a84004800 msgr2=0x7f6a84004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:55.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.023+0000 7f6aa0bc4640 1 --2- 172.21.15.123:0/225433755 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a84004800 0x7f6a84004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:55.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.023+0000 7f6aa0bc4640 1 -- 172.21.15.123:0/225433755 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a84003520 con 0x7f6a840051c0 2024-09-15T23:15:55.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.023+0000 7f6a9bfff640 1 --2- 172.21.15.123:0/225433755 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a84003a00 0x7f6a84003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:55.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.024+0000 7f6aa0bc4640 1 -- 172.21.15.123:0/225433755 reap_dead start 2024-09-15T23:15:55.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.024+0000 7f6aa0bc4640 1 --2- 172.21.15.123:0/225433755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a840051c0 0x7f6a8400b9c0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f6a94001e50 tx=0x7f6a84005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f434c1fe96891bb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:55.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.024+0000 7f6a9affd640 1 -- 172.21.15.123:0/225433755 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a94001a70 con 0x7f6a840051c0 2024-09-15T23:15:55.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.024+0000 7f6a9affd640 1 -- 172.21.15.123:0/225433755 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a94003970 con 0x7f6a840051c0 2024-09-15T23:15:55.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.024+0000 7f6a9affd640 1 -- 172.21.15.123:0/225433755 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a94003d60 con 0x7f6a840051c0 2024-09-15T23:15:55.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.024+0000 7f6aa2627640 1 -- 172.21.15.123:0/225433755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a840051c0 msgr2=0x7f6a8400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:55.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.024+0000 7f6aa2627640 1 --2- 172.21.15.123:0/225433755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a840051c0 0x7f6a8400b9c0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f6a94001e50 tx=0x7f6a84005830 comp rx=0 tx=0).stop 2024-09-15T23:15:55.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.025+0000 7f6aa2627640 1 -- 172.21.15.123:0/225433755 shutdown_connections 2024-09-15T23:15:55.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.025+0000 7f6aa2627640 1 --2- 172.21.15.123:0/225433755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a840051c0 0x7f6a8400b9c0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:55.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.025+0000 7f6aa2627640 1 -- 172.21.15.123:0/225433755 >> 172.21.15.123:0/225433755 conn(0x7f6a9c0ccec0 msgr2=0x7f6a9c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:55.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.025+0000 7f6aa2627640 1 -- 172.21.15.123:0/225433755 shutdown_connections 2024-09-15T23:15:55.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.025+0000 7f6aa2627640 1 -- 172.21.15.123:0/225433755 wait complete. 2024-09-15T23:15:55.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.026+0000 7f6aa2627640 1 Processor -- start 2024-09-15T23:15:55.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.026+0000 7f6aa2627640 1 -- start start 2024-09-15T23:15:55.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.027+0000 7f6aa2627640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a840051c0 0x7f6a9c15c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:55.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.027+0000 7f6aa2627640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a9c13ac20 0x7f6a9c1f6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:55.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.027+0000 7f6aa2627640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a9c0c8520 0x7f6a9c0c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:55.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.027+0000 7f6aa2627640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9c1462b0 con 0x7f6a840051c0 2024-09-15T23:15:55.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.027+0000 7f6aa2627640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6a9c0b4b60 con 0x7f6a9c13ac20 2024-09-15T23:15:55.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.027+0000 7f6aa2627640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6a9c146430 con 0x7f6a9c0c8520 2024-09-15T23:15:55.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.027+0000 7f6a9bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a840051c0 0x7f6a9c15c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:55.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.027+0000 7f6a9bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a840051c0 0x7f6a9c15c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58792/0 (socket says 172.21.15.123:58792) 2024-09-15T23:15:55.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.027+0000 7f6a9bfff640 1 -- 172.21.15.123:0/884893114 learned_addr learned my addr 172.21.15.123:0/884893114 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:55.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.027+0000 7f6a9b7fe640 1 --2- 172.21.15.123:0/884893114 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a9c13ac20 0x7f6a9c1f6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:55.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.027+0000 7f6aa0bc4640 1 --2- 172.21.15.123:0/884893114 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a9c0c8520 0x7f6a9c0c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:55.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.027+0000 7f6a9bfff640 1 -- 172.21.15.123:0/884893114 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a9c0c8520 msgr2=0x7f6a9c0c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:55.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.027+0000 7f6a9bfff640 1 --2- 172.21.15.123:0/884893114 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a9c0c8520 0x7f6a9c0c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:55.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.027+0000 7f6a9bfff640 1 -- 172.21.15.123:0/884893114 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a9c13ac20 msgr2=0x7f6a9c1f6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:55.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.027+0000 7f6a9bfff640 1 --2- 172.21.15.123:0/884893114 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a9c13ac20 0x7f6a9c1f6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:55.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.027+0000 7f6a9bfff640 1 -- 172.21.15.123:0/884893114 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a9c13b0a0 con 0x7f6a840051c0 2024-09-15T23:15:55.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.027+0000 7f6a9b7fe640 1 --2- 172.21.15.123:0/884893114 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a9c13ac20 0x7f6a9c1f6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:55.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.027+0000 7f6aa0bc4640 1 --2- 172.21.15.123:0/884893114 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a9c0c8520 0x7f6a9c0c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:55.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.027+0000 7f6a9bfff640 1 --2- 172.21.15.123:0/884893114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a840051c0 0x7f6a9c15c510 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c011540 tx=0x7f6a8c011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:55.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.027+0000 7f6a98ff9640 1 -- 172.21.15.123:0/884893114 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c015870 con 0x7f6a840051c0 2024-09-15T23:15:55.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.027+0000 7f6a98ff9640 1 -- 172.21.15.123:0/884893114 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a8c015a10 con 0x7f6a840051c0 2024-09-15T23:15:55.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.027+0000 7f6aa2627640 1 -- 172.21.15.123:0/884893114 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a9c1f6840 con 0x7f6a840051c0 2024-09-15T23:15:55.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.027+0000 7f6a98ff9640 1 -- 172.21.15.123:0/884893114 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c015dc0 con 0x7f6a840051c0 2024-09-15T23:15:55.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.027+0000 7f6aa2627640 1 -- 172.21.15.123:0/884893114 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a9c13da90 con 0x7f6a840051c0 2024-09-15T23:15:55.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.028+0000 7f6aa2627640 1 -- 172.21.15.123:0/884893114 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a9c0b5080 con 0x7f6a840051c0 2024-09-15T23:15:55.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.029+0000 7f6a98ff9640 1 -- 172.21.15.123:0/884893114 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6a8c00f460 con 0x7f6a840051c0 2024-09-15T23:15:55.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.029+0000 7f6a98ff9640 1 --2- 172.21.15.123:0/884893114 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6a8806c2b0 0x7f6a8806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:55.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.029+0000 7f6a98ff9640 1 -- 172.21.15.123:0/884893114 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f6a8c08bc50 con 0x7f6a840051c0 2024-09-15T23:15:55.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.030+0000 7f6a9b7fe640 1 --2- 172.21.15.123:0/884893114 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6a8806c2b0 0x7f6a8806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:55.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.030+0000 7f6a9b7fe640 1 --2- 172.21.15.123:0/884893114 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6a8806c2b0 0x7f6a8806e770 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6a90000c00 tx=0x7f6a90009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:55.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.034+0000 7f6a98ff9640 1 -- 172.21.15.123:0/884893114 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6a8c091020 con 0x7f6a840051c0 2024-09-15T23:15:55.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.202+0000 7f6aa2627640 1 -- 172.21.15.123:0/884893114 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6a9c0d04c0 con 0x7f6a840051c0 2024-09-15T23:15:55.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.203+0000 7f6a98ff9640 1 -- 172.21.15.123:0/884893114 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+16705 (secure 0 0 0) 0x7f6a9c1f6840 con 0x7f6a840051c0 2024-09-15T23:15:55.205 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:55.205 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":81,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:15:54.225666+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:15:52.548725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-15T23:15:53.192974+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:15:55.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.206+0000 7f6aa2627640 1 -- 172.21.15.123:0/884893114 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6a8806c2b0 msgr2=0x7f6a8806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:55.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.206+0000 7f6aa2627640 1 --2- 172.21.15.123:0/884893114 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6a8806c2b0 0x7f6a8806e770 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6a90000c00 tx=0x7f6a90009040 comp rx=0 tx=0).stop 2024-09-15T23:15:55.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.206+0000 7f6aa2627640 1 -- 172.21.15.123:0/884893114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a840051c0 msgr2=0x7f6a9c15c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:55.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.206+0000 7f6aa2627640 1 --2- 172.21.15.123:0/884893114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a840051c0 0x7f6a9c15c510 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c011540 tx=0x7f6a8c011a00 comp rx=0 tx=0).stop 2024-09-15T23:15:55.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.206+0000 7f6aa2627640 1 -- 172.21.15.123:0/884893114 shutdown_connections 2024-09-15T23:15:55.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.206+0000 7f6aa2627640 1 --2- 172.21.15.123:0/884893114 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a9c0c8520 0x7f6a9c0c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:55.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.206+0000 7f6aa2627640 1 --2- 172.21.15.123:0/884893114 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a9c13ac20 0x7f6a9c1f6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:55.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.206+0000 7f6aa2627640 1 --2- 172.21.15.123:0/884893114 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6a8806c2b0 0x7f6a8806e770 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:55.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.206+0000 7f6aa2627640 1 --2- 172.21.15.123:0/884893114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a840051c0 0x7f6a9c15c510 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:55.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.206+0000 7f6aa2627640 1 -- 172.21.15.123:0/884893114 >> 172.21.15.123:0/884893114 conn(0x7f6a9c0ccec0 msgr2=0x7f6a9c143f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:55.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.206+0000 7f6aa2627640 1 -- 172.21.15.123:0/884893114 shutdown_connections 2024-09-15T23:15:55.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.206+0000 7f6aa2627640 1 -- 172.21.15.123:0/884893114 wait complete. 2024-09-15T23:15:55.218 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:15:55.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.315+0000 7f5e4c4e6640 1 Processor -- start 2024-09-15T23:15:55.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.315+0000 7f5e4c4e6640 1 -- start start 2024-09-15T23:15:55.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.316+0000 7f5e4c4e6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f5e4415ab40 0x7f5e4406c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:55.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.316+0000 7f5e4c4e6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5e440720b0 0x7f5e44073990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:55.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.316+0000 7f5e4c4e6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5e4415af20 0x7f5e4415b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:55.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.316+0000 7f5e4c4e6640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f5e44072520 con 0x7f5e4415af20 2024-09-15T23:15:55.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.316+0000 7f5e4c4e6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f5e44071010 con 0x7f5e4415ab40 2024-09-15T23:15:55.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.316+0000 7f5e4c4e6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5e440712f0 con 0x7f5e440720b0 2024-09-15T23:15:55.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.316+0000 7f5e4aa83640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5e4415af20 0x7f5e4415b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:55.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.316+0000 7f5e4aa83640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5e4415af20 0x7f5e4415b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58808/0 (socket says 172.21.15.123:58808) 2024-09-15T23:15:55.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.316+0000 7f5e4aa83640 1 -- 172.21.15.123:0/1440773510 learned_addr learned my addr 172.21.15.123:0/1440773510 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:55.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.317+0000 7f5e49a81640 1 --2- 172.21.15.123:0/1440773510 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5e440720b0 0x7f5e44073990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:55.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.317+0000 7f5e4a282640 1 --2- 172.21.15.123:0/1440773510 >> v2:172.21.15.188:3300/0 conn(0x7f5e4415ab40 0x7f5e4406c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:55.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.317+0000 7f5e4aa83640 1 -- 172.21.15.123:0/1440773510 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5e440720b0 msgr2=0x7f5e44073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:55.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.317+0000 7f5e4aa83640 1 --2- 172.21.15.123:0/1440773510 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5e440720b0 0x7f5e44073990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:55.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.317+0000 7f5e4aa83640 1 -- 172.21.15.123:0/1440773510 >> v2:172.21.15.188:3300/0 conn(0x7f5e4415ab40 msgr2=0x7f5e4406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:55.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.317+0000 7f5e4aa83640 1 --2- 172.21.15.123:0/1440773510 >> v2:172.21.15.188:3300/0 conn(0x7f5e4415ab40 0x7f5e4406c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:55.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.317+0000 7f5e4aa83640 1 -- 172.21.15.123:0/1440773510 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e440715d0 con 0x7f5e4415af20 2024-09-15T23:15:55.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.317+0000 7f5e49a81640 1 --2- 172.21.15.123:0/1440773510 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5e440720b0 0x7f5e44073990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:55.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.317+0000 7f5e4aa83640 1 --2- 172.21.15.123:0/1440773510 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e4415af20 0x7f5e4415b390 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f5e440d1500 tx=0x7f5e3c02b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d632136f8a6f18ee server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:55.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.318+0000 7f5e49280640 1 -- 172.21.15.123:0/1440773510 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c037070 con 0x7f5e4415af20 2024-09-15T23:15:55.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.318+0000 7f5e49280640 1 -- 172.21.15.123:0/1440773510 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e3c008500 con 0x7f5e4415af20 2024-09-15T23:15:55.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.318+0000 7f5e49280640 1 -- 172.21.15.123:0/1440773510 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c0088d0 con 0x7f5e4415af20 2024-09-15T23:15:55.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.318+0000 7f5e4c4e6640 1 -- 172.21.15.123:0/1440773510 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e4415af20 msgr2=0x7f5e4415b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:55.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.318+0000 7f5e4c4e6640 1 --2- 172.21.15.123:0/1440773510 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e4415af20 0x7f5e4415b390 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f5e440d1500 tx=0x7f5e3c02b710 comp rx=0 tx=0).stop 2024-09-15T23:15:55.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.318+0000 7f5e4c4e6640 1 -- 172.21.15.123:0/1440773510 shutdown_connections 2024-09-15T23:15:55.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.318+0000 7f5e4c4e6640 1 --2- 172.21.15.123:0/1440773510 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e4415af20 0x7f5e4415b390 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:55.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.318+0000 7f5e4c4e6640 1 --2- 172.21.15.123:0/1440773510 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5e440720b0 0x7f5e44073990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:55.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.318+0000 7f5e4c4e6640 1 --2- 172.21.15.123:0/1440773510 >> v2:172.21.15.188:3300/0 conn(0x7f5e4415ab40 0x7f5e4406c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:55.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.318+0000 7f5e4c4e6640 1 -- 172.21.15.123:0/1440773510 >> 172.21.15.123:0/1440773510 conn(0x7f5e440ccec0 msgr2=0x7f5e440cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:55.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.318+0000 7f5e4c4e6640 1 -- 172.21.15.123:0/1440773510 shutdown_connections 2024-09-15T23:15:55.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.318+0000 7f5e4c4e6640 1 -- 172.21.15.123:0/1440773510 wait complete. 2024-09-15T23:15:55.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.319+0000 7f5e4c4e6640 1 Processor -- start 2024-09-15T23:15:55.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.319+0000 7f5e4c4e6640 1 -- start start 2024-09-15T23:15:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.320+0000 7f5e4c4e6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5e440720b0 0x7f5e4414cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.320+0000 7f5e4c4e6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e4415ab40 0x7f5e441578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.320+0000 7f5e4c4e6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5e4415af20 0x7f5e44158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.320+0000 7f5e4c4e6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4415b8d0 con 0x7f5e4415ab40 2024-09-15T23:15:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.320+0000 7f5e4c4e6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5e44073ed0 con 0x7f5e4415af20 2024-09-15T23:15:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.320+0000 7f5e4c4e6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5e4415ba50 con 0x7f5e440720b0 2024-09-15T23:15:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.320+0000 7f5e49a81640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e4415ab40 0x7f5e441578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.320+0000 7f5e49a81640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e4415ab40 0x7f5e441578d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58812/0 (socket says 172.21.15.123:58812) 2024-09-15T23:15:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.320+0000 7f5e49a81640 1 -- 172.21.15.123:0/1551359976 learned_addr learned my addr 172.21.15.123:0/1551359976 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.320+0000 7f5e4aa83640 1 --2- 172.21.15.123:0/1551359976 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5e4415af20 0x7f5e44158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.320+0000 7f5e4a282640 1 --2- 172.21.15.123:0/1551359976 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5e440720b0 0x7f5e4414cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:55.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.321+0000 7f5e49a81640 1 -- 172.21.15.123:0/1551359976 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5e440720b0 msgr2=0x7f5e4414cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:55.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.321+0000 7f5e49a81640 1 --2- 172.21.15.123:0/1551359976 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5e440720b0 0x7f5e4414cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:55.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.321+0000 7f5e49a81640 1 -- 172.21.15.123:0/1551359976 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5e4415af20 msgr2=0x7f5e44158d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:55.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.321+0000 7f5e49a81640 1 --2- 172.21.15.123:0/1551359976 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5e4415af20 0x7f5e44158d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:55.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.321+0000 7f5e49a81640 1 -- 172.21.15.123:0/1551359976 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e44158390 con 0x7f5e4415ab40 2024-09-15T23:15:55.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.321+0000 7f5e4aa83640 1 --2- 172.21.15.123:0/1551359976 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5e4415af20 0x7f5e44158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:15:55.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.321+0000 7f5e49a81640 1 --2- 172.21.15.123:0/1551359976 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e4415ab40 0x7f5e441578d0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f5e3400c7f0 tx=0x7f5e3400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:55.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.321+0000 7f5e3affd640 1 -- 172.21.15.123:0/1551359976 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e34015070 con 0x7f5e4415ab40 2024-09-15T23:15:55.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.321+0000 7f5e3affd640 1 -- 172.21.15.123:0/1551359976 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e34007820 con 0x7f5e4415ab40 2024-09-15T23:15:55.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.321+0000 7f5e3affd640 1 -- 172.21.15.123:0/1551359976 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e34007c10 con 0x7f5e4415ab40 2024-09-15T23:15:55.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.321+0000 7f5e4c4e6640 1 -- 172.21.15.123:0/1551359976 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e440c9990 con 0x7f5e4415ab40 2024-09-15T23:15:55.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.321+0000 7f5e4c4e6640 1 -- 172.21.15.123:0/1551359976 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e440c9f50 con 0x7f5e4415ab40 2024-09-15T23:15:55.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.322+0000 7f5e4c4e6640 1 -- 172.21.15.123:0/1551359976 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e4406c6a0 con 0x7f5e4415ab40 2024-09-15T23:15:55.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.322+0000 7f5e3affd640 1 -- 172.21.15.123:0/1551359976 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5e34018070 con 0x7f5e4415ab40 2024-09-15T23:15:55.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.323+0000 7f5e3affd640 1 --2- 172.21.15.123:0/1551359976 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5e2806c2b0 0x7f5e2806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:55.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.323+0000 7f5e3affd640 1 -- 172.21.15.123:0/1551359976 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f5e3408b520 con 0x7f5e4415ab40 2024-09-15T23:15:55.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.323+0000 7f5e4a282640 1 --2- 172.21.15.123:0/1551359976 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5e2806c2b0 0x7f5e2806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:55.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.324+0000 7f5e4a282640 1 --2- 172.21.15.123:0/1551359976 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5e2806c2b0 0x7f5e2806e770 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5e440cbac0 tx=0x7f5e40008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:55.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.327+0000 7f5e3affd640 1 -- 172.21.15.123:0/1551359976 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5e340595c0 con 0x7f5e4415ab40 2024-09-15T23:15:55.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.492+0000 7f5e4c4e6640 1 -- 172.21.15.123:0/1551359976 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5e440b3e30 con 0x7f5e4415ab40 2024-09-15T23:15:55.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.493+0000 7f5e3affd640 1 -- 172.21.15.123:0/1551359976 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+16705 (secure 0 0 0) 0x7f5e34078020 con 0x7f5e4415ab40 2024-09-15T23:15:55.495 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:55.495 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":81,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:15:54.225666+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:15:52.548725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-15T23:15:53.192974+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:15:55.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.495+0000 7f5e4c4e6640 1 -- 172.21.15.123:0/1551359976 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5e2806c2b0 msgr2=0x7f5e2806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:55.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.495+0000 7f5e4c4e6640 1 --2- 172.21.15.123:0/1551359976 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5e2806c2b0 0x7f5e2806e770 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5e440cbac0 tx=0x7f5e40008040 comp rx=0 tx=0).stop 2024-09-15T23:15:55.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.495+0000 7f5e4c4e6640 1 -- 172.21.15.123:0/1551359976 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e4415ab40 msgr2=0x7f5e441578d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:55.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.495+0000 7f5e4c4e6640 1 --2- 172.21.15.123:0/1551359976 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e4415ab40 0x7f5e441578d0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f5e3400c7f0 tx=0x7f5e3400ccb0 comp rx=0 tx=0).stop 2024-09-15T23:15:55.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.495+0000 7f5e4c4e6640 1 -- 172.21.15.123:0/1551359976 shutdown_connections 2024-09-15T23:15:55.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.495+0000 7f5e4c4e6640 1 --2- 172.21.15.123:0/1551359976 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5e4415af20 0x7f5e44158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:55.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.495+0000 7f5e4c4e6640 1 --2- 172.21.15.123:0/1551359976 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5e2806c2b0 0x7f5e2806e770 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:55.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.495+0000 7f5e4c4e6640 1 --2- 172.21.15.123:0/1551359976 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e4415ab40 0x7f5e441578d0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:55.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.495+0000 7f5e4c4e6640 1 --2- 172.21.15.123:0/1551359976 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5e440720b0 0x7f5e4414cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:55.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.495+0000 7f5e4c4e6640 1 -- 172.21.15.123:0/1551359976 >> 172.21.15.123:0/1551359976 conn(0x7f5e440ccec0 msgr2=0x7f5e44150f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:55.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.495+0000 7f5e4c4e6640 1 -- 172.21.15.123:0/1551359976 shutdown_connections 2024-09-15T23:15:55.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.496+0000 7f5e4c4e6640 1 -- 172.21.15.123:0/1551359976 wait complete. 2024-09-15T23:15:55.508 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T23:15:55.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.608+0000 7fb69812a640 1 Processor -- start 2024-09-15T23:15:55.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.609+0000 7fb69812a640 1 -- start start 2024-09-15T23:15:55.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.609+0000 7fb69812a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb690165300 0x7fb6901676f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:55.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.609+0000 7fb69812a640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6900741c0 con 0x7fb69015c7e0 2024-09-15T23:15:55.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.609+0000 7fb69812a640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb69015cbc0 con 0x7fb6900b4060 2024-09-15T23:15:55.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.609+0000 7fb69812a640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fb6900cee40 con 0x7fb690165300 2024-09-15T23:15:55.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.610+0000 7fb6966c7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb690165300 0x7fb6901676f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:55.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.610+0000 7fb695ec6640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb69015c7e0 0x7fb690073ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60432/0 (socket says 172.21.15.123:60432) 2024-09-15T23:15:55.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.610+0000 7fb695ec6640 1 -- 172.21.15.123:0/1469679664 learned_addr learned my addr 172.21.15.123:0/1469679664 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:55.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.610+0000 7fb6966c7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb690165300 0x7fb6901676f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58816/0 (socket says 172.21.15.123:58816) 2024-09-15T23:15:55.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.610+0000 7fb6966c7640 1 -- 172.21.15.123:0/1469679664 >> v1:172.21.15.188:6789/0 conn(0x7fb6900b4060 legacy=0x7fb6900b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:55.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.610+0000 7fb6966c7640 1 -- 172.21.15.123:0/1469679664 >> v1:172.21.15.123:6789/0 conn(0x7fb69015c7e0 legacy=0x7fb690073ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:55.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.610+0000 7fb6966c7640 1 -- 172.21.15.123:0/1469679664 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6900d0240 con 0x7fb690165300 2024-09-15T23:15:55.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.610+0000 7fb694ec4640 1 -- 172.21.15.123:0/1469679664 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1072598745 0 0) 0x7fb68c001290 con 0x7fb69015c7e0 2024-09-15T23:15:55.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.611+0000 7fb6966c7640 1 --2- 172.21.15.123:0/1469679664 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb690165300 0x7fb6901676f0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fb688009d90 tx=0x7fb68802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32b68f9a1444986 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:55.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.611+0000 7fb694ec4640 1 -- 172.21.15.123:0/1469679664 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb688007740 con 0x7fb690165300 2024-09-15T23:15:55.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.611+0000 7fb694ec4640 1 -- 172.21.15.123:0/1469679664 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6880078e0 con 0x7fb690165300 2024-09-15T23:15:55.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.611+0000 7fb694ec4640 1 -- 172.21.15.123:0/1469679664 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb688007cb0 con 0x7fb690165300 2024-09-15T23:15:55.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.611+0000 7fb69812a640 1 -- 172.21.15.123:0/1469679664 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb690165300 msgr2=0x7fb6901676f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:55.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.611+0000 7fb69812a640 1 --2- 172.21.15.123:0/1469679664 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb690165300 0x7fb6901676f0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fb688009d90 tx=0x7fb68802a6a0 comp rx=0 tx=0).stop 2024-09-15T23:15:55.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.611+0000 7fb69812a640 1 -- 172.21.15.123:0/1469679664 shutdown_connections 2024-09-15T23:15:55.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.611+0000 7fb69812a640 1 --2- 172.21.15.123:0/1469679664 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb690165300 0x7fb6901676f0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:55.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.611+0000 7fb69812a640 1 -- 172.21.15.123:0/1469679664 >> 172.21.15.123:0/1469679664 conn(0x7fb6900cefe0 msgr2=0x7fb6900cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:55.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.611+0000 7fb69812a640 1 -- 172.21.15.123:0/1469679664 shutdown_connections 2024-09-15T23:15:55.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.611+0000 7fb69812a640 1 -- 172.21.15.123:0/1469679664 wait complete. 2024-09-15T23:15:55.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.612+0000 7fb69812a640 1 Processor -- start 2024-09-15T23:15:55.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.613+0000 7fb69812a640 1 -- start start 2024-09-15T23:15:55.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.613+0000 7fb69812a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb6900b4060 0x7fb6901646b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:55.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.613+0000 7fb69812a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb69015c7e0 0x7fb6900c5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:55.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.613+0000 7fb69812a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb690165300 0x7fb69006e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:55.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.613+0000 7fb69812a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb6900d0ae0 con 0x7fb69015c7e0 2024-09-15T23:15:55.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.613+0000 7fb69812a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb6900d0800 con 0x7fb690165300 2024-09-15T23:15:55.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.613+0000 7fb69812a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb690073110 con 0x7fb6900b4060 2024-09-15T23:15:55.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.613+0000 7fb6956c5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb69015c7e0 0x7fb6900c5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:55.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.613+0000 7fb6956c5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb69015c7e0 0x7fb6900c5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58826/0 (socket says 172.21.15.123:58826) 2024-09-15T23:15:55.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.613+0000 7fb6956c5640 1 -- 172.21.15.123:0/1136013554 learned_addr learned my addr 172.21.15.123:0/1136013554 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:55.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.614+0000 7fb695ec6640 1 --2- 172.21.15.123:0/1136013554 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb6900b4060 0x7fb6901646b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:55.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.614+0000 7fb6966c7640 1 --2- 172.21.15.123:0/1136013554 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb690165300 0x7fb69006e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:55.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.614+0000 7fb6956c5640 1 -- 172.21.15.123:0/1136013554 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb6900b4060 msgr2=0x7fb6901646b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:55.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.614+0000 7fb6956c5640 1 --2- 172.21.15.123:0/1136013554 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb6900b4060 0x7fb6901646b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:55.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.614+0000 7fb6956c5640 1 -- 172.21.15.123:0/1136013554 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb690165300 msgr2=0x7fb69006e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:55.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.614+0000 7fb6956c5640 1 --2- 172.21.15.123:0/1136013554 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb690165300 0x7fb69006e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:55.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.614+0000 7fb6956c5640 1 -- 172.21.15.123:0/1136013554 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb69006d810 con 0x7fb69015c7e0 2024-09-15T23:15:55.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.614+0000 7fb6956c5640 1 --2- 172.21.15.123:0/1136013554 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb69015c7e0 0x7fb6900c5b00 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fb68000c460 tx=0x7fb68000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:55.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.614+0000 7fb6867fc640 1 -- 172.21.15.123:0/1136013554 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb680016020 con 0x7fb69015c7e0 2024-09-15T23:15:55.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.614+0000 7fb6867fc640 1 -- 172.21.15.123:0/1136013554 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb680012870 con 0x7fb69015c7e0 2024-09-15T23:15:55.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.614+0000 7fb69812a640 1 -- 172.21.15.123:0/1136013554 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb69015ce30 con 0x7fb69015c7e0 2024-09-15T23:15:55.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.614+0000 7fb6867fc640 1 -- 172.21.15.123:0/1136013554 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb680012c60 con 0x7fb69015c7e0 2024-09-15T23:15:55.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.614+0000 7fb69812a640 1 -- 172.21.15.123:0/1136013554 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb69015d3f0 con 0x7fb69015c7e0 2024-09-15T23:15:55.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.615+0000 7fb69812a640 1 -- 172.21.15.123:0/1136013554 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6900b53d0 con 0x7fb69015c7e0 2024-09-15T23:15:55.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.616+0000 7fb6867fc640 1 -- 172.21.15.123:0/1136013554 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb680019020 con 0x7fb69015c7e0 2024-09-15T23:15:55.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.616+0000 7fb6867fc640 1 --2- 172.21.15.123:0/1136013554 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb67406c2b0 0x7fb67406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:55.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.616+0000 7fb6867fc640 1 -- 172.21.15.123:0/1136013554 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7fb68008ad40 con 0x7fb69015c7e0 2024-09-15T23:15:55.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.616+0000 7fb695ec6640 1 --2- 172.21.15.123:0/1136013554 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb67406c2b0 0x7fb67406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:55.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.617+0000 7fb695ec6640 1 --2- 172.21.15.123:0/1136013554 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb67406c2b0 0x7fb67406e770 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb68c0010e0 tx=0x7fb68c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:55.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.620+0000 7fb6867fc640 1 -- 172.21.15.123:0/1136013554 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb680020070 con 0x7fb69015c7e0 2024-09-15T23:15:55.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.819+0000 7fb69812a640 1 -- 172.21.15.123:0/1136013554 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb69015d790 con 0x7fb69015c7e0 2024-09-15T23:15:55.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.900+0000 7fb6867fc640 1 -- 172.21.15.123:0/1136013554 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v43) ==== 118+0+0 (secure 0 0 0) 0x7fb680058e60 con 0x7fb69015c7e0 2024-09-15T23:15:55.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.903+0000 7fb69812a640 1 -- 172.21.15.123:0/1136013554 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb67406c2b0 msgr2=0x7fb67406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:55.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.903+0000 7fb69812a640 1 --2- 172.21.15.123:0/1136013554 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb67406c2b0 0x7fb67406e770 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb68c0010e0 tx=0x7fb68c009040 comp rx=0 tx=0).stop 2024-09-15T23:15:55.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.903+0000 7fb69812a640 1 -- 172.21.15.123:0/1136013554 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb69015c7e0 msgr2=0x7fb6900c5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:55.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.903+0000 7fb69812a640 1 --2- 172.21.15.123:0/1136013554 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb69015c7e0 0x7fb6900c5b00 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fb68000c460 tx=0x7fb68000c920 comp rx=0 tx=0).stop 2024-09-15T23:15:55.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.903+0000 7fb69812a640 1 -- 172.21.15.123:0/1136013554 shutdown_connections 2024-09-15T23:15:55.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.903+0000 7fb69812a640 1 --2- 172.21.15.123:0/1136013554 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb690165300 0x7fb69006e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:55.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.903+0000 7fb69812a640 1 --2- 172.21.15.123:0/1136013554 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb67406c2b0 0x7fb67406e770 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:55.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.903+0000 7fb69812a640 1 --2- 172.21.15.123:0/1136013554 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb69015c7e0 0x7fb6900c5b00 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:55.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.903+0000 7fb69812a640 1 --2- 172.21.15.123:0/1136013554 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb6900b4060 0x7fb6901646b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:55.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.903+0000 7fb69812a640 1 -- 172.21.15.123:0/1136013554 >> 172.21.15.123:0/1136013554 conn(0x7fb6900cefe0 msgr2=0x7fb6900b3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:55.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.903+0000 7fb69812a640 1 -- 172.21.15.123:0/1136013554 shutdown_connections 2024-09-15T23:15:55.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:55.903+0000 7fb69812a640 1 -- 172.21.15.123:0/1136013554 wait complete. 2024-09-15T23:15:55.915 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T23:15:55.915 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T23:15:56.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.016+0000 7efdda118640 1 Processor -- start 2024-09-15T23:15:56.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.016+0000 7efdda118640 1 -- start start 2024-09-15T23:15:56.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.016+0000 7efdda118640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efdd415c7f0 0x7efdd40b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:56.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.016+0000 7efdda118640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdd415cbd0 con 0x7efdd40b1c30 2024-09-15T23:15:56.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.016+0000 7efdda118640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdd40ce0e0 con 0x7efdd4073800 2024-09-15T23:15:56.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.016+0000 7efdda118640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7efdd40cecf0 con 0x7efdd415c7f0 2024-09-15T23:15:56.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.016+0000 7efdd37fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efdd415c7f0 0x7efdd40b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:56.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.017+0000 7efdd37fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efdd415c7f0 0x7efdd40b16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58838/0 (socket says 172.21.15.123:58838) 2024-09-15T23:15:56.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.017+0000 7efdd2ffd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7efdd40b1c30 0x7efdd40730f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60442/0 (socket says 172.21.15.123:60442) 2024-09-15T23:15:56.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.017+0000 7efdd37fe640 1 -- 172.21.15.123:0/2061743364 learned_addr learned my addr 172.21.15.123:0/2061743364 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:56.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.017+0000 7efdd37fe640 1 -- 172.21.15.123:0/2061743364 >> v1:172.21.15.188:6789/0 conn(0x7efdd4073800 legacy=0x7efdd406f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:56.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.017+0000 7efdd37fe640 1 -- 172.21.15.123:0/2061743364 >> v1:172.21.15.123:6789/0 conn(0x7efdd40b1c30 legacy=0x7efdd40730f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:56.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.017+0000 7efdd37fe640 1 -- 172.21.15.123:0/2061743364 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd40ce3c0 con 0x7efdd415c7f0 2024-09-15T23:15:56.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.017+0000 7efdd37fe640 1 --2- 172.21.15.123:0/2061743364 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efdd415c7f0 0x7efdd40b16f0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7efdc4009870 tx=0x7efdc402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3948f7fbe5fe60e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:56.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.018+0000 7efdd27fc640 1 -- 172.21.15.123:0/2061743364 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc4037070 con 0x7efdd415c7f0 2024-09-15T23:15:56.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.018+0000 7efdd27fc640 1 -- 172.21.15.123:0/2061743364 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc4032440 con 0x7efdd415c7f0 2024-09-15T23:15:56.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.018+0000 7efdd27fc640 1 -- 172.21.15.123:0/2061743364 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc4032810 con 0x7efdd415c7f0 2024-09-15T23:15:56.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.018+0000 7efdda118640 1 -- 172.21.15.123:0/2061743364 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efdd415c7f0 msgr2=0x7efdd40b16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:56.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.018+0000 7efdda118640 1 --2- 172.21.15.123:0/2061743364 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efdd415c7f0 0x7efdd40b16f0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7efdc4009870 tx=0x7efdc402a2a0 comp rx=0 tx=0).stop 2024-09-15T23:15:56.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.018+0000 7efdda118640 1 -- 172.21.15.123:0/2061743364 shutdown_connections 2024-09-15T23:15:56.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.018+0000 7efdda118640 1 --2- 172.21.15.123:0/2061743364 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efdd415c7f0 0x7efdd40b16f0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:56.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.018+0000 7efdda118640 1 -- 172.21.15.123:0/2061743364 >> 172.21.15.123:0/2061743364 conn(0x7efdd40d2570 msgr2=0x7efdd40d2980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:56.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.018+0000 7efdda118640 1 -- 172.21.15.123:0/2061743364 shutdown_connections 2024-09-15T23:15:56.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.018+0000 7efdda118640 1 -- 172.21.15.123:0/2061743364 wait complete. 2024-09-15T23:15:56.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.019+0000 7efdda118640 1 Processor -- start 2024-09-15T23:15:56.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.020+0000 7efdda118640 1 -- start start 2024-09-15T23:15:56.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.020+0000 7efdda118640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efdd4073800 0x7efdd4152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:56.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.020+0000 7efdda118640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efdd40b1c30 0x7efdd406dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:56.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.020+0000 7efdda118640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efdd415c7f0 0x7efdd40b0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:56.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.020+0000 7efdda118640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efdd40b5440 con 0x7efdd40b1c30 2024-09-15T23:15:56.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.020+0000 7efdda118640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7efdd40ce980 con 0x7efdd4073800 2024-09-15T23:15:56.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.020+0000 7efdda118640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7efdd415ed00 con 0x7efdd415c7f0 2024-09-15T23:15:56.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.020+0000 7efdd2ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efdd40b1c30 0x7efdd406dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:56.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.020+0000 7efdd2ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efdd40b1c30 0x7efdd406dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58850/0 (socket says 172.21.15.123:58850) 2024-09-15T23:15:56.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.020+0000 7efdd2ffd640 1 -- 172.21.15.123:0/606961454 learned_addr learned my addr 172.21.15.123:0/606961454 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:56.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.021+0000 7efdd37fe640 1 --2- 172.21.15.123:0/606961454 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efdd4073800 0x7efdd4152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:56.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.021+0000 7efdd2ffd640 1 -- 172.21.15.123:0/606961454 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efdd415c7f0 msgr2=0x7efdd40b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:56.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.021+0000 7efdd3fff640 1 --2- 172.21.15.123:0/606961454 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efdd415c7f0 0x7efdd40b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:56.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.021+0000 7efdd2ffd640 1 --2- 172.21.15.123:0/606961454 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efdd415c7f0 0x7efdd40b0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:56.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.021+0000 7efdd2ffd640 1 -- 172.21.15.123:0/606961454 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efdd4073800 msgr2=0x7efdd4152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:56.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.021+0000 7efdd2ffd640 1 --2- 172.21.15.123:0/606961454 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efdd4073800 0x7efdd4152b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:56.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.021+0000 7efdd2ffd640 1 -- 172.21.15.123:0/606961454 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd415efa0 con 0x7efdd40b1c30 2024-09-15T23:15:56.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.021+0000 7efdd2ffd640 1 --2- 172.21.15.123:0/606961454 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efdd40b1c30 0x7efdd406dd80 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7efdc800c430 tx=0x7efdc800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:56.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.021+0000 7efdbbfff640 1 -- 172.21.15.123:0/606961454 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc80074e0 con 0x7efdd40b1c30 2024-09-15T23:15:56.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.021+0000 7efdbbfff640 1 -- 172.21.15.123:0/606961454 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc8007680 con 0x7efdd40b1c30 2024-09-15T23:15:56.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.021+0000 7efdbbfff640 1 -- 172.21.15.123:0/606961454 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc8004a00 con 0x7efdd40b1c30 2024-09-15T23:15:56.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.021+0000 7efdda118640 1 -- 172.21.15.123:0/606961454 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdd415f280 con 0x7efdd40b1c30 2024-09-15T23:15:56.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.021+0000 7efdda118640 1 -- 172.21.15.123:0/606961454 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdd415f840 con 0x7efdd40b1c30 2024-09-15T23:15:56.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.022+0000 7efdda118640 1 -- 172.21.15.123:0/606961454 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdd40cdd00 con 0x7efdd40b1c30 2024-09-15T23:15:56.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.022+0000 7efdbbfff640 1 -- 172.21.15.123:0/606961454 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7efdc801a020 con 0x7efdd40b1c30 2024-09-15T23:15:56.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.023+0000 7efdbbfff640 1 --2- 172.21.15.123:0/606961454 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efdc006c2e0 0x7efdc006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:56.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.023+0000 7efdbbfff640 1 -- 172.21.15.123:0/606961454 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7efdc808ac40 con 0x7efdd40b1c30 2024-09-15T23:15:56.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.023+0000 7efdd37fe640 1 --2- 172.21.15.123:0/606961454 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efdc006c2e0 0x7efdc006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:56.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.023+0000 7efdd37fe640 1 --2- 172.21.15.123:0/606961454 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efdc006c2e0 0x7efdc006e7a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efdc4034000 tx=0x7efdc402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:56.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.027+0000 7efdbbfff640 1 -- 172.21.15.123:0/606961454 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efdc80593b0 con 0x7efdd40b1c30 2024-09-15T23:15:56.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.224+0000 7efdda118640 1 -- 172.21.15.123:0/606961454 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7efdd40b58f0 con 0x7efdd40b1c30 2024-09-15T23:15:56.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.905+0000 7efdbbfff640 1 -- 172.21.15.123:0/606961454 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v44) ==== 122+0+0 (secure 0 0 0) 0x7efdc8058cb0 con 0x7efdd40b1c30 2024-09-15T23:15:56.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.908+0000 7efdda118640 1 -- 172.21.15.123:0/606961454 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efdc006c2e0 msgr2=0x7efdc006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:56.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.908+0000 7efdda118640 1 --2- 172.21.15.123:0/606961454 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efdc006c2e0 0x7efdc006e7a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efdc4034000 tx=0x7efdc402e000 comp rx=0 tx=0).stop 2024-09-15T23:15:56.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.908+0000 7efdda118640 1 -- 172.21.15.123:0/606961454 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efdd40b1c30 msgr2=0x7efdd406dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:56.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.908+0000 7efdda118640 1 --2- 172.21.15.123:0/606961454 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efdd40b1c30 0x7efdd406dd80 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7efdc800c430 tx=0x7efdc800c8f0 comp rx=0 tx=0).stop 2024-09-15T23:15:56.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.908+0000 7efdda118640 1 -- 172.21.15.123:0/606961454 shutdown_connections 2024-09-15T23:15:56.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.908+0000 7efdda118640 1 --2- 172.21.15.123:0/606961454 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efdd415c7f0 0x7efdd40b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:56.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.908+0000 7efdda118640 1 --2- 172.21.15.123:0/606961454 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efdc006c2e0 0x7efdc006e7a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:56.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.908+0000 7efdda118640 1 --2- 172.21.15.123:0/606961454 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efdd40b1c30 0x7efdd406dd80 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:56.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.908+0000 7efdda118640 1 --2- 172.21.15.123:0/606961454 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efdd4073800 0x7efdd4152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:56.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.908+0000 7efdda118640 1 -- 172.21.15.123:0/606961454 >> 172.21.15.123:0/606961454 conn(0x7efdd40d2570 msgr2=0x7efdd40b3180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:56.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.909+0000 7efdda118640 1 -- 172.21.15.123:0/606961454 shutdown_connections 2024-09-15T23:15:56.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:56.909+0000 7efdda118640 1 -- 172.21.15.123:0/606961454 wait complete. 2024-09-15T23:15:56.922 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T23:15:56.922 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:15:57.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.022+0000 7f3e9d9d6640 1 Processor -- start 2024-09-15T23:15:57.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.022+0000 7f3e9d9d6640 1 -- start start 2024-09-15T23:15:57.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.023+0000 7f3e9d9d6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3e980d23b0 0x7f3e980b87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:57.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.023+0000 7f3e9d9d6640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e980d0e70 con 0x7f3e980b6970 2024-09-15T23:15:57.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.023+0000 7f3e9d9d6640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e980d41c0 con 0x7f3e9815ed20 2024-09-15T23:15:57.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.023+0000 7f3e9d9d6640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f3e980d35b0 con 0x7f3e980d23b0 2024-09-15T23:15:57.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.023+0000 7f3e977fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3e980d23b0 0x7f3e980b87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:57.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.023+0000 7f3e8e7fc640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f3e980b6970 0x7f3e980b80d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:44010/0 (socket says 172.21.15.123:44010) 2024-09-15T23:15:57.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.023+0000 7f3e8e7fc640 1 -- 172.21.15.123:0/148836357 learned_addr learned my addr 172.21.15.123:0/148836357 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:57.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.023+0000 7f3e977fe640 1 -- 172.21.15.123:0/148836357 >> v1:172.21.15.188:6789/0 conn(0x7f3e9815ed20 legacy=0x7f3e980b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:57.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.023+0000 7f3e977fe640 1 -- 172.21.15.123:0/148836357 >> v1:172.21.15.123:6789/0 conn(0x7f3e980b6970 legacy=0x7f3e980b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:57.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.023+0000 7f3e977fe640 1 -- 172.21.15.123:0/148836357 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e980d3890 con 0x7f3e980d23b0 2024-09-15T23:15:57.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.023+0000 7f3e967fc640 1 -- 172.21.15.123:0/148836357 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3878789147 0 0) 0x7f3e80001110 con 0x7f3e980b6970 2024-09-15T23:15:57.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.024+0000 7f3e977fe640 1 --2- 172.21.15.123:0/148836357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e980d23b0 0x7f3e980b87e0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f3e90009d90 tx=0x7f3e9002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ca83e4ce0a6254 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:57.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.024+0000 7f3e967fc640 1 -- 172.21.15.123:0/148836357 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e90007740 con 0x7f3e980d23b0 2024-09-15T23:15:57.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.024+0000 7f3e967fc640 1 -- 172.21.15.123:0/148836357 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e900078e0 con 0x7f3e980d23b0 2024-09-15T23:15:57.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.024+0000 7f3e967fc640 1 -- 172.21.15.123:0/148836357 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e90007cb0 con 0x7f3e980d23b0 2024-09-15T23:15:57.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.025+0000 7f3e9d9d6640 1 -- 172.21.15.123:0/148836357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e980d23b0 msgr2=0x7f3e980b87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:57.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.025+0000 7f3e9d9d6640 1 --2- 172.21.15.123:0/148836357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e980d23b0 0x7f3e980b87e0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f3e90009d90 tx=0x7f3e9002a660 comp rx=0 tx=0).stop 2024-09-15T23:15:57.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.025+0000 7f3e9d9d6640 1 -- 172.21.15.123:0/148836357 shutdown_connections 2024-09-15T23:15:57.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.025+0000 7f3e9d9d6640 1 --2- 172.21.15.123:0/148836357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e980d23b0 0x7f3e980b87e0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:57.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.025+0000 7f3e9d9d6640 1 -- 172.21.15.123:0/148836357 >> 172.21.15.123:0/148836357 conn(0x7f3e980d1260 msgr2=0x7f3e980d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:57.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.025+0000 7f3e9d9d6640 1 -- 172.21.15.123:0/148836357 shutdown_connections 2024-09-15T23:15:57.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.025+0000 7f3e9d9d6640 1 -- 172.21.15.123:0/148836357 wait complete. 2024-09-15T23:15:57.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.026+0000 7f3e9d9d6640 1 Processor -- start 2024-09-15T23:15:57.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.026+0000 7f3e9d9d6640 1 -- start start 2024-09-15T23:15:57.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.027+0000 7f3e9d9d6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3e980b6970 0x7f3e98161e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:57.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.027+0000 7f3e9d9d6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3e980d23b0 0x7f3e98157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:57.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.027+0000 7f3e9d9d6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e9815ed20 0x7f3e98157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:57.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.027+0000 7f3e9d9d6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3e980d32a0 con 0x7f3e9815ed20 2024-09-15T23:15:57.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.027+0000 7f3e9d9d6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3e980d3e50 con 0x7f3e980b6970 2024-09-15T23:15:57.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.027+0000 7f3e9d9d6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f3e9815f100 con 0x7f3e980d23b0 2024-09-15T23:15:57.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.027+0000 7f3e977fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e9815ed20 0x7f3e98157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:57.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.027+0000 7f3e977fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e9815ed20 0x7f3e98157ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53906/0 (socket says 172.21.15.123:53906) 2024-09-15T23:15:57.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.027+0000 7f3e977fe640 1 -- 172.21.15.123:0/4239367547 learned_addr learned my addr 172.21.15.123:0/4239367547 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:57.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.027+0000 7f3e96ffd640 1 --2- 172.21.15.123:0/4239367547 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3e980b6970 0x7f3e98161e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:57.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.027+0000 7f3e8e7fc640 1 --2- 172.21.15.123:0/4239367547 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3e980d23b0 0x7f3e98157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:57.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.027+0000 7f3e977fe640 1 -- 172.21.15.123:0/4239367547 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3e980d23b0 msgr2=0x7f3e98157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:57.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.027+0000 7f3e977fe640 1 --2- 172.21.15.123:0/4239367547 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3e980d23b0 0x7f3e98157570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:57.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.027+0000 7f3e977fe640 1 -- 172.21.15.123:0/4239367547 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3e980b6970 msgr2=0x7f3e98161e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:57.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.027+0000 7f3e977fe640 1 --2- 172.21.15.123:0/4239367547 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3e980b6970 0x7f3e98161e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:57.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.027+0000 7f3e977fe640 1 -- 172.21.15.123:0/4239367547 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e98154d80 con 0x7f3e9815ed20 2024-09-15T23:15:57.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.027+0000 7f3e8e7fc640 1 --2- 172.21.15.123:0/4239367547 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3e980d23b0 0x7f3e98157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:57.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.027+0000 7f3e977fe640 1 --2- 172.21.15.123:0/4239367547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e9815ed20 0x7f3e98157ab0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f3e9002ac50 tx=0x7f3e90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:57.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.028+0000 7f3e94ff9640 1 -- 172.21.15.123:0/4239367547 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e90040070 con 0x7f3e9815ed20 2024-09-15T23:15:57.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.028+0000 7f3e94ff9640 1 -- 172.21.15.123:0/4239367547 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e90031c90 con 0x7f3e9815ed20 2024-09-15T23:15:57.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.028+0000 7f3e9d9d6640 1 -- 172.21.15.123:0/4239367547 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e98162390 con 0x7f3e9815ed20 2024-09-15T23:15:57.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.028+0000 7f3e94ff9640 1 -- 172.21.15.123:0/4239367547 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e90045680 con 0x7f3e9815ed20 2024-09-15T23:15:57.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.028+0000 7f3e9d9d6640 1 -- 172.21.15.123:0/4239367547 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e981569c0 con 0x7f3e9815ed20 2024-09-15T23:15:57.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.029+0000 7f3e9d9d6640 1 -- 172.21.15.123:0/4239367547 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e980d1f60 con 0x7f3e9815ed20 2024-09-15T23:15:57.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.029+0000 7f3e94ff9640 1 -- 172.21.15.123:0/4239367547 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3e90039040 con 0x7f3e9815ed20 2024-09-15T23:15:57.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.030+0000 7f3e94ff9640 1 --2- 172.21.15.123:0/4239367547 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3e7806c2b0 0x7f3e7806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:57.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.030+0000 7f3e94ff9640 1 -- 172.21.15.123:0/4239367547 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f3e900acd00 con 0x7f3e9815ed20 2024-09-15T23:15:57.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.030+0000 7f3e96ffd640 1 --2- 172.21.15.123:0/4239367547 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3e7806c2b0 0x7f3e7806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:57.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.030+0000 7f3e96ffd640 1 --2- 172.21.15.123:0/4239367547 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3e7806c2b0 0x7f3e7806e770 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3e88000f60 tx=0x7f3e88009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:57.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.034+0000 7f3e94ff9640 1 -- 172.21.15.123:0/4239367547 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3e980d1f60 con 0x7f3e9815ed20 2024-09-15T23:15:57.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.231+0000 7f3e9d9d6640 1 -- 172.21.15.123:0/4239367547 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e980b7010 con 0x7f3e9815ed20 2024-09-15T23:15:57.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.231+0000 7f3e94ff9640 1 -- 172.21.15.123:0/4239367547 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5234 (secure 0 0 0) 0x7f3e9007b5c0 con 0x7f3e9815ed20 2024-09-15T23:15:57.232 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:57.233 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":44,"btime":"2024-09-15T23:15:56:901221+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5621,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/3995408325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3995408325},{"type":"v1","addr":"172.21.15.188:6836","nonce":3995408325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5624,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2597191885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2597191885},{"type":"v1","addr":"172.21.15.188:6837","nonce":2597191885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6675,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/3814257760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3814257760},{"type":"v1","addr":"172.21.15.123:6834","nonce":3814257760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:15:54.225983+0000","modified":"2024-09-15T23:15:56.226130+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6678},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6678":{"gid":6678,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/839817134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":839817134},{"type":"v1","addr":"172.21.15.123:6835","nonce":839817134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6678,"qdb_cluster":[6678]},"id":5}]} 2024-09-15T23:15:57.233 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 44 2024-09-15T23:15:57.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.233+0000 7f3e9d9d6640 1 -- 172.21.15.123:0/4239367547 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3e7806c2b0 msgr2=0x7f3e7806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:57.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.233+0000 7f3e9d9d6640 1 --2- 172.21.15.123:0/4239367547 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3e7806c2b0 0x7f3e7806e770 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3e88000f60 tx=0x7f3e88009040 comp rx=0 tx=0).stop 2024-09-15T23:15:57.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.233+0000 7f3e9d9d6640 1 -- 172.21.15.123:0/4239367547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e9815ed20 msgr2=0x7f3e98157ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:57.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.233+0000 7f3e9d9d6640 1 --2- 172.21.15.123:0/4239367547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e9815ed20 0x7f3e98157ab0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f3e9002ac50 tx=0x7f3e90004a40 comp rx=0 tx=0).stop 2024-09-15T23:15:57.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.233+0000 7f3e9d9d6640 1 -- 172.21.15.123:0/4239367547 shutdown_connections 2024-09-15T23:15:57.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.233+0000 7f3e9d9d6640 1 --2- 172.21.15.123:0/4239367547 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3e7806c2b0 0x7f3e7806e770 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:57.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.233+0000 7f3e9d9d6640 1 --2- 172.21.15.123:0/4239367547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e9815ed20 0x7f3e98157ab0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:57.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.233+0000 7f3e9d9d6640 1 --2- 172.21.15.123:0/4239367547 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3e980d23b0 0x7f3e98157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:57.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.233+0000 7f3e9d9d6640 1 --2- 172.21.15.123:0/4239367547 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3e980b6970 0x7f3e98161e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:57.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.233+0000 7f3e9d9d6640 1 -- 172.21.15.123:0/4239367547 >> 172.21.15.123:0/4239367547 conn(0x7f3e980d1260 msgr2=0x7f3e980b5620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:57.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.234+0000 7f3e9d9d6640 1 -- 172.21.15.123:0/4239367547 shutdown_connections 2024-09-15T23:15:57.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.234+0000 7f3e9d9d6640 1 -- 172.21.15.123:0/4239367547 wait complete. 2024-09-15T23:15:57.246 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:15:57.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.343+0000 7f07356a6640 1 Processor -- start 2024-09-15T23:15:57.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.343+0000 7f07356a6640 1 -- start start 2024-09-15T23:15:57.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.344+0000 7f07356a6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f073015ed20 0x7f07300b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:57.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.344+0000 7f07356a6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f07300b90e0 0x7f07300b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:57.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.344+0000 7f07356a6640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07300d0e70 con 0x7f07300d23b0 2024-09-15T23:15:57.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.344+0000 7f07356a6640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f07300d41c0 con 0x7f073015ed20 2024-09-15T23:15:57.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.344+0000 7f07356a6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f07300d35b0 con 0x7f07300b90e0 2024-09-15T23:15:57.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.344+0000 7f072effd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f073015ed20 0x7f07300b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:57.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.344+0000 7f072effd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f073015ed20 0x7f07300b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53908/0 (socket says 172.21.15.123:53908) 2024-09-15T23:15:57.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.344+0000 7f07267fc640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f07300d23b0 0x7f07300cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:44016/0 (socket says 172.21.15.123:44016) 2024-09-15T23:15:57.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.344+0000 7f072effd640 1 -- 172.21.15.123:0/1027515462 learned_addr learned my addr 172.21.15.123:0/1027515462 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:57.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.344+0000 7f072f7fe640 1 --2- 172.21.15.123:0/1027515462 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f07300b90e0 0x7f07300b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:57.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.344+0000 7f072effd640 1 -- 172.21.15.123:0/1027515462 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f07300b90e0 msgr2=0x7f07300b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:57.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.344+0000 7f072effd640 1 --2- 172.21.15.123:0/1027515462 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f07300b90e0 0x7f07300b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:57.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.344+0000 7f072effd640 1 -- 172.21.15.123:0/1027515462 >> v1:172.21.15.123:6789/0 conn(0x7f07300d23b0 legacy=0x7f07300cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:57.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.344+0000 7f072effd640 1 -- 172.21.15.123:0/1027515462 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07300d3890 con 0x7f073015ed20 2024-09-15T23:15:57.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.345+0000 7f072effd640 1 --2- 172.21.15.123:0/1027515462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f073015ed20 0x7f07300b6260 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f0720009870 tx=0x7f072002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4355bb1456cfee server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:57.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.345+0000 7f072e7fc640 1 -- 172.21.15.123:0/1027515462 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0720037070 con 0x7f073015ed20 2024-09-15T23:15:57.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.345+0000 7f072e7fc640 1 -- 172.21.15.123:0/1027515462 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0720032440 con 0x7f073015ed20 2024-09-15T23:15:57.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.345+0000 7f072e7fc640 1 -- 172.21.15.123:0/1027515462 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0720032810 con 0x7f073015ed20 2024-09-15T23:15:57.348 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-09-15T23:15:57.348 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-09-15T23:15:57.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.346+0000 7f07356a6640 1 -- 172.21.15.123:0/1027515462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f073015ed20 msgr2=0x7f07300b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:57.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.346+0000 7f07356a6640 1 --2- 172.21.15.123:0/1027515462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f073015ed20 0x7f07300b6260 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f0720009870 tx=0x7f072002a1c0 comp rx=0 tx=0).stop 2024-09-15T23:15:57.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.346+0000 7f07356a6640 1 -- 172.21.15.123:0/1027515462 shutdown_connections 2024-09-15T23:15:57.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.346+0000 7f07356a6640 1 --2- 172.21.15.123:0/1027515462 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f07300b90e0 0x7f07300b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:57.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.346+0000 7f07356a6640 1 --2- 172.21.15.123:0/1027515462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f073015ed20 0x7f07300b6260 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:57.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.346+0000 7f07356a6640 1 -- 172.21.15.123:0/1027515462 >> 172.21.15.123:0/1027515462 conn(0x7f07300d1260 msgr2=0x7f07300d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:57.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.346+0000 7f07356a6640 1 -- 172.21.15.123:0/1027515462 shutdown_connections 2024-09-15T23:15:57.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.346+0000 7f07356a6640 1 -- 172.21.15.123:0/1027515462 wait complete. 2024-09-15T23:15:57.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.347+0000 7f07356a6640 1 Processor -- start 2024-09-15T23:15:57.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.347+0000 7f07356a6640 1 -- start start 2024-09-15T23:15:57.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.348+0000 7f07356a6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f07300b90e0 0x7f073015cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:57.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.348+0000 7f07356a6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07300d23b0 0x7f07300d4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:57.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.348+0000 7f07356a6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f073015ed20 0x7f07300d4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:57.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.348+0000 7f07356a6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f07300d32a0 con 0x7f07300d23b0 2024-09-15T23:15:57.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.348+0000 7f07356a6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f07300d3e50 con 0x7f07300b90e0 2024-09-15T23:15:57.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.348+0000 7f07356a6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f073015f100 con 0x7f073015ed20 2024-09-15T23:15:57.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.348+0000 7f07267fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07300d23b0 0x7f07300d4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:57.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.348+0000 7f07267fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07300d23b0 0x7f07300d4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53924/0 (socket says 172.21.15.123:53924) 2024-09-15T23:15:57.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.348+0000 7f07267fc640 1 -- 172.21.15.123:0/2986738713 learned_addr learned my addr 172.21.15.123:0/2986738713 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:57.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.348+0000 7f072effd640 1 --2- 172.21.15.123:0/2986738713 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f07300b90e0 0x7f073015cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:57.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.348+0000 7f072f7fe640 1 --2- 172.21.15.123:0/2986738713 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f073015ed20 0x7f07300d4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:57.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.348+0000 7f07267fc640 1 -- 172.21.15.123:0/2986738713 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f073015ed20 msgr2=0x7f07300d4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:57.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.348+0000 7f07267fc640 1 --2- 172.21.15.123:0/2986738713 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f073015ed20 0x7f07300d4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:57.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.348+0000 7f07267fc640 1 -- 172.21.15.123:0/2986738713 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f07300b90e0 msgr2=0x7f073015cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:57.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.348+0000 7f07267fc640 1 --2- 172.21.15.123:0/2986738713 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f07300b90e0 0x7f073015cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:57.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.348+0000 7f07267fc640 1 -- 172.21.15.123:0/2986738713 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07300c8e10 con 0x7f07300d23b0 2024-09-15T23:15:57.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.348+0000 7f07267fc640 1 --2- 172.21.15.123:0/2986738713 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07300d23b0 0x7f07300d4740 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f071800c400 tx=0x7f071800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:57.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.348+0000 7f0727fff640 1 -- 172.21.15.123:0/2986738713 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07180074e0 con 0x7f07300d23b0 2024-09-15T23:15:57.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.349+0000 7f0727fff640 1 -- 172.21.15.123:0/2986738713 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0718007680 con 0x7f07300d23b0 2024-09-15T23:15:57.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.349+0000 7f0727fff640 1 -- 172.21.15.123:0/2986738713 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0718004a00 con 0x7f07300d23b0 2024-09-15T23:15:57.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.349+0000 7f07356a6640 1 -- 172.21.15.123:0/2986738713 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07300c90f0 con 0x7f07300d23b0 2024-09-15T23:15:57.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.349+0000 7f07356a6640 1 -- 172.21.15.123:0/2986738713 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07300c96b0 con 0x7f07300d23b0 2024-09-15T23:15:57.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.350+0000 7f07356a6640 1 -- 172.21.15.123:0/2986738713 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07300ab130 con 0x7f07300d23b0 2024-09-15T23:15:57.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.350+0000 7f0727fff640 1 -- 172.21.15.123:0/2986738713 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f071801a020 con 0x7f07300d23b0 2024-09-15T23:15:57.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.350+0000 7f0727fff640 1 --2- 172.21.15.123:0/2986738713 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f071006c2b0 0x7f071006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:57.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.351+0000 7f0727fff640 1 -- 172.21.15.123:0/2986738713 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f071808ab00 con 0x7f07300d23b0 2024-09-15T23:15:57.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.351+0000 7f072effd640 1 --2- 172.21.15.123:0/2986738713 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f071006c2b0 0x7f071006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:57.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.351+0000 7f072effd640 1 --2- 172.21.15.123:0/2986738713 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f071006c2b0 0x7f071006e770 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0720034000 tx=0x7f072002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:57.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.355+0000 7f0727fff640 1 -- 172.21.15.123:0/2986738713 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f07300ab130 con 0x7f07300d23b0 2024-09-15T23:15:57.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.524+0000 7f07356a6640 1 -- 172.21.15.123:0/2986738713 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f07300b7010 con 0x7f07300d23b0 2024-09-15T23:15:57.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.525+0000 7f0727fff640 1 -- 172.21.15.123:0/2986738713 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+16692 (secure 0 0 0) 0x7f07300d0e70 con 0x7f07300d23b0 2024-09-15T23:15:57.526 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:57.527 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":82,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:15:55.881296+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:15:52.548725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-15T23:15:53.192974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:15:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.527+0000 7f07356a6640 1 -- 172.21.15.123:0/2986738713 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f071006c2b0 msgr2=0x7f071006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.527+0000 7f07356a6640 1 --2- 172.21.15.123:0/2986738713 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f071006c2b0 0x7f071006e770 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0720034000 tx=0x7f072002e000 comp rx=0 tx=0).stop 2024-09-15T23:15:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.527+0000 7f07356a6640 1 -- 172.21.15.123:0/2986738713 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07300d23b0 msgr2=0x7f07300d4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.527+0000 7f07356a6640 1 --2- 172.21.15.123:0/2986738713 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07300d23b0 0x7f07300d4740 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f071800c400 tx=0x7f071800c8c0 comp rx=0 tx=0).stop 2024-09-15T23:15:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.527+0000 7f07356a6640 1 -- 172.21.15.123:0/2986738713 shutdown_connections 2024-09-15T23:15:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.527+0000 7f07356a6640 1 --2- 172.21.15.123:0/2986738713 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f073015ed20 0x7f07300d4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.527+0000 7f07356a6640 1 --2- 172.21.15.123:0/2986738713 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f071006c2b0 0x7f071006e770 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.527+0000 7f07356a6640 1 --2- 172.21.15.123:0/2986738713 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07300d23b0 0x7f07300d4740 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.527+0000 7f07356a6640 1 --2- 172.21.15.123:0/2986738713 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f07300b90e0 0x7f073015cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.527+0000 7f07356a6640 1 -- 172.21.15.123:0/2986738713 >> 172.21.15.123:0/2986738713 conn(0x7f07300d1260 msgr2=0x7f07300cee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.527+0000 7f07356a6640 1 -- 172.21.15.123:0/2986738713 shutdown_connections 2024-09-15T23:15:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.527+0000 7f07356a6640 1 -- 172.21.15.123:0/2986738713 wait complete. 2024-09-15T23:15:57.539 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T23:15:57.539 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:15:57.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.636+0000 7f26a6082640 1 Processor -- start 2024-09-15T23:15:57.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.636+0000 7f26a6082640 1 -- start start 2024-09-15T23:15:57.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.637+0000 7f26a6082640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f26a006c320 0x7f26a015bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:57.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.637+0000 7f26a6082640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26a013eb20 0x7f26a015c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:57.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.637+0000 7f26a6082640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26a0071180 con 0x7f26a00b2d40 2024-09-15T23:15:57.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.637+0000 7f26a6082640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f26a0071ab0 con 0x7f26a006c320 2024-09-15T23:15:57.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.637+0000 7f26a6082640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f26a0071460 con 0x7f26a013eb20 2024-09-15T23:15:57.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.637+0000 7f269effd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f26a006c320 0x7f26a015bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:57.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.637+0000 7f269effd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f26a006c320 0x7f26a015bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53938/0 (socket says 172.21.15.123:53938) 2024-09-15T23:15:57.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.637+0000 7f269effd640 1 -- 172.21.15.123:0/3591007030 learned_addr learned my addr 172.21.15.123:0/3591007030 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:57.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.637+0000 7f269f7fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f26a00b2d40 0x7f26a006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:44018/0 (socket says 172.21.15.123:44018) 2024-09-15T23:15:57.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.637+0000 7f269ffff640 1 --2- 172.21.15.123:0/3591007030 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26a013eb20 0x7f26a015c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:57.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.637+0000 7f269effd640 1 -- 172.21.15.123:0/3591007030 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26a013eb20 msgr2=0x7f26a015c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:57.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.637+0000 7f269effd640 1 --2- 172.21.15.123:0/3591007030 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26a013eb20 0x7f26a015c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:57.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.637+0000 7f269effd640 1 -- 172.21.15.123:0/3591007030 >> v1:172.21.15.123:6789/0 conn(0x7f26a00b2d40 legacy=0x7f26a006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:57.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.637+0000 7f269e7fc640 1 -- 172.21.15.123:0/3591007030 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1955584102 0 0) 0x7f26a0071180 con 0x7f26a00b2d40 2024-09-15T23:15:57.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.637+0000 7f269effd640 1 -- 172.21.15.123:0/3591007030 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26a0071740 con 0x7f26a006c320 2024-09-15T23:15:57.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.638+0000 7f269effd640 1 --2- 172.21.15.123:0/3591007030 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26a006c320 0x7f26a015bcf0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f269400bb10 tx=0x7f269402c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd9113a94903a44 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:57.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.638+0000 7f269e7fc640 1 -- 172.21.15.123:0/3591007030 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2694036020 con 0x7f26a006c320 2024-09-15T23:15:57.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.638+0000 7f269e7fc640 1 -- 172.21.15.123:0/3591007030 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2694032820 con 0x7f26a006c320 2024-09-15T23:15:57.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.638+0000 7f269e7fc640 1 -- 172.21.15.123:0/3591007030 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2694032bf0 con 0x7f26a006c320 2024-09-15T23:15:57.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.639+0000 7f26a6082640 1 -- 172.21.15.123:0/3591007030 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26a006c320 msgr2=0x7f26a015bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:57.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.639+0000 7f26a6082640 1 --2- 172.21.15.123:0/3591007030 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26a006c320 0x7f26a015bcf0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f269400bb10 tx=0x7f269402c920 comp rx=0 tx=0).stop 2024-09-15T23:15:57.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.639+0000 7f26a6082640 1 -- 172.21.15.123:0/3591007030 shutdown_connections 2024-09-15T23:15:57.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.639+0000 7f26a6082640 1 --2- 172.21.15.123:0/3591007030 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26a013eb20 0x7f26a015c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:57.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.639+0000 7f26a6082640 1 --2- 172.21.15.123:0/3591007030 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26a006c320 0x7f26a015bcf0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:57.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.639+0000 7f26a6082640 1 -- 172.21.15.123:0/3591007030 >> 172.21.15.123:0/3591007030 conn(0x7f26a00ccec0 msgr2=0x7f26a00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:57.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.639+0000 7f26a6082640 1 -- 172.21.15.123:0/3591007030 shutdown_connections 2024-09-15T23:15:57.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.639+0000 7f26a6082640 1 -- 172.21.15.123:0/3591007030 wait complete. 2024-09-15T23:15:57.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.640+0000 7f26a6082640 1 Processor -- start 2024-09-15T23:15:57.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.640+0000 7f26a6082640 1 -- start start 2024-09-15T23:15:57.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.641+0000 7f26a6082640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26a006c320 0x7f26a00c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:57.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.641+0000 7f26a6082640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26a00b2d40 0x7f26a013dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:57.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.641+0000 7f26a6082640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26a013eb20 0x7f26a0159340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:57.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.641+0000 7f26a6082640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f26a00720c0 con 0x7f26a006c320 2024-09-15T23:15:57.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.641+0000 7f26a6082640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f26a0071f40 con 0x7f26a013eb20 2024-09-15T23:15:57.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.641+0000 7f26a6082640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f26a0072240 con 0x7f26a00b2d40 2024-09-15T23:15:57.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.641+0000 7f269f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26a006c320 0x7f26a00c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:57.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.641+0000 7f269f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26a006c320 0x7f26a00c5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53948/0 (socket says 172.21.15.123:53948) 2024-09-15T23:15:57.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.641+0000 7f269f7fe640 1 -- 172.21.15.123:0/3475792688 learned_addr learned my addr 172.21.15.123:0/3475792688 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:57.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.641+0000 7f269effd640 1 --2- 172.21.15.123:0/3475792688 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26a00b2d40 0x7f26a013dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:57.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.641+0000 7f269ffff640 1 --2- 172.21.15.123:0/3475792688 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26a013eb20 0x7f26a0159340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:57.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.641+0000 7f269f7fe640 1 -- 172.21.15.123:0/3475792688 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26a00b2d40 msgr2=0x7f26a013dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:57.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.641+0000 7f269f7fe640 1 --2- 172.21.15.123:0/3475792688 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26a00b2d40 0x7f26a013dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:57.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.641+0000 7f269f7fe640 1 -- 172.21.15.123:0/3475792688 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26a013eb20 msgr2=0x7f26a0159340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:57.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.641+0000 7f269f7fe640 1 --2- 172.21.15.123:0/3475792688 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26a013eb20 0x7f26a0159340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:57.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.641+0000 7f269f7fe640 1 -- 172.21.15.123:0/3475792688 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26a013e580 con 0x7f26a006c320 2024-09-15T23:15:57.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.641+0000 7f269effd640 1 --2- 172.21.15.123:0/3475792688 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26a00b2d40 0x7f26a013dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:57.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.641+0000 7f269f7fe640 1 --2- 172.21.15.123:0/3475792688 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26a006c320 0x7f26a00c5df0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f269000c4d0 tx=0x7f269000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:57.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.641+0000 7f2687fff640 1 -- 172.21.15.123:0/3475792688 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2690018070 con 0x7f26a006c320 2024-09-15T23:15:57.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.642+0000 7f2687fff640 1 -- 172.21.15.123:0/3475792688 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2690007500 con 0x7f26a006c320 2024-09-15T23:15:57.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.642+0000 7f26a6082640 1 -- 172.21.15.123:0/3475792688 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26a00c6460 con 0x7f26a006c320 2024-09-15T23:15:57.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.642+0000 7f2687fff640 1 -- 172.21.15.123:0/3475792688 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2690004a20 con 0x7f26a006c320 2024-09-15T23:15:57.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.642+0000 7f26a6082640 1 -- 172.21.15.123:0/3475792688 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26a00c6f10 con 0x7f26a006c320 2024-09-15T23:15:57.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.642+0000 7f26a6082640 1 -- 172.21.15.123:0/3475792688 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26a006bc10 con 0x7f26a006c320 2024-09-15T23:15:57.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.643+0000 7f2687fff640 1 -- 172.21.15.123:0/3475792688 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2690004bc0 con 0x7f26a006c320 2024-09-15T23:15:57.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.643+0000 7f2687fff640 1 --2- 172.21.15.123:0/3475792688 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f268c06c2b0 0x7f268c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:57.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.644+0000 7f269effd640 1 --2- 172.21.15.123:0/3475792688 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f268c06c2b0 0x7f268c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:57.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.644+0000 7f2687fff640 1 -- 172.21.15.123:0/3475792688 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f269008a6c0 con 0x7f26a006c320 2024-09-15T23:15:57.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.644+0000 7f269effd640 1 --2- 172.21.15.123:0/3475792688 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f268c06c2b0 0x7f268c06e770 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2694037000 tx=0x7f2694032000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:57.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.648+0000 7f2687fff640 1 -- 172.21.15.123:0/3475792688 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f26a013e580 con 0x7f26a006c320 2024-09-15T23:15:57.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.810+0000 7f26a6082640 1 -- 172.21.15.123:0/3475792688 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f26a006c9c0 con 0x7f268c06c2b0 2024-09-15T23:15:57.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.817+0000 7f2687fff640 1 -- 172.21.15.123:0/3475792688 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245300 (secure 0 0 0) 0x7f26a006c9c0 con 0x7f268c06c2b0 2024-09-15T23:15:57.820 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:57.822 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:15:57.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.819+0000 7f26a6082640 1 -- 172.21.15.123:0/3475792688 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f268c06c2b0 msgr2=0x7f268c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:57.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.819+0000 7f26a6082640 1 --2- 172.21.15.123:0/3475792688 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f268c06c2b0 0x7f268c06e770 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2694037000 tx=0x7f2694032000 comp rx=0 tx=0).stop 2024-09-15T23:15:57.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.819+0000 7f26a6082640 1 -- 172.21.15.123:0/3475792688 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26a006c320 msgr2=0x7f26a00c5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:57.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.819+0000 7f26a6082640 1 --2- 172.21.15.123:0/3475792688 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26a006c320 0x7f26a00c5df0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f269000c4d0 tx=0x7f269000c990 comp rx=0 tx=0).stop 2024-09-15T23:15:57.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.819+0000 7f26a6082640 1 -- 172.21.15.123:0/3475792688 shutdown_connections 2024-09-15T23:15:57.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.819+0000 7f26a6082640 1 --2- 172.21.15.123:0/3475792688 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26a013eb20 0x7f26a0159340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:57.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.819+0000 7f26a6082640 1 --2- 172.21.15.123:0/3475792688 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26a00b2d40 0x7f26a013dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:57.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.819+0000 7f26a6082640 1 --2- 172.21.15.123:0/3475792688 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f268c06c2b0 0x7f268c06e770 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:57.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.819+0000 7f26a6082640 1 --2- 172.21.15.123:0/3475792688 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26a006c320 0x7f26a00c5df0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:57.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.819+0000 7f26a6082640 1 -- 172.21.15.123:0/3475792688 >> 172.21.15.123:0/3475792688 conn(0x7f26a00ccec0 msgr2=0x7f26a0157870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:57.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.820+0000 7f26a6082640 1 -- 172.21.15.123:0/3475792688 shutdown_connections 2024-09-15T23:15:57.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.820+0000 7f26a6082640 1 -- 172.21.15.123:0/3475792688 wait complete. 2024-09-15T23:15:57.831 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":193,"stamp":"2024-09-15T23:15:57.555049+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592104,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":172,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":122,"acting":122,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":85,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":295680,"kb_used_data":8712,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754679040,"statfs":{"total":773094113280,"available":772791336960,"internally_reserved":0,"allocated":8921088,"data_stored":4492257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":293654064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1736,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.682399"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382986+0000","last_change":"2024-09-15T23:15:54.895953+0000","last_active":"2024-09-15T23:15:56.382986+0000","last_peered":"2024-09-15T23:15:56.382986+0000","last_clean":"2024-09-15T23:15:56.382986+0000","last_became_active":"2024-09-15T23:15:54.895632+0000","last_became_peered":"2024-09-15T23:15:54.895632+0000","last_unstale":"2024-09-15T23:15:56.382986+0000","last_undegraded":"2024-09-15T23:15:56.382986+0000","last_fullsized":"2024-09-15T23:15:56.382986+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:30:23.433151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382408+0000","last_change":"2024-09-15T23:15:54.895888+0000","last_active":"2024-09-15T23:15:56.382408+0000","last_peered":"2024-09-15T23:15:56.382408+0000","last_clean":"2024-09-15T23:15:56.382408+0000","last_became_active":"2024-09-15T23:15:54.895558+0000","last_became_peered":"2024-09-15T23:15:54.895558+0000","last_unstale":"2024-09-15T23:15:56.382408+0000","last_undegraded":"2024-09-15T23:15:56.382408+0000","last_fullsized":"2024-09-15T23:15:56.382408+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:09:03.821475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382636+0000","last_change":"2024-09-15T23:15:54.904818+0000","last_active":"2024-09-15T23:15:56.382636+0000","last_peered":"2024-09-15T23:15:56.382636+0000","last_clean":"2024-09-15T23:15:56.382636+0000","last_became_active":"2024-09-15T23:15:54.903868+0000","last_became_peered":"2024-09-15T23:15:54.903868+0000","last_unstale":"2024-09-15T23:15:56.382636+0000","last_undegraded":"2024-09-15T23:15:56.382636+0000","last_fullsized":"2024-09-15T23:15:56.382636+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:37.663336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383920+0000","last_change":"2024-09-15T23:15:54.901116+0000","last_active":"2024-09-15T23:15:56.383920+0000","last_peered":"2024-09-15T23:15:56.383920+0000","last_clean":"2024-09-15T23:15:56.383920+0000","last_became_active":"2024-09-15T23:15:54.900244+0000","last_became_peered":"2024-09-15T23:15:54.900244+0000","last_unstale":"2024-09-15T23:15:56.383920+0000","last_undegraded":"2024-09-15T23:15:56.383920+0000","last_fullsized":"2024-09-15T23:15:56.383920+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:54.143040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383622+0000","last_change":"2024-09-15T23:15:54.899743+0000","last_active":"2024-09-15T23:15:56.383622+0000","last_peered":"2024-09-15T23:15:56.383622+0000","last_clean":"2024-09-15T23:15:56.383622+0000","last_became_active":"2024-09-15T23:15:54.899474+0000","last_became_peered":"2024-09-15T23:15:54.899474+0000","last_unstale":"2024-09-15T23:15:56.383622+0000","last_undegraded":"2024-09-15T23:15:56.383622+0000","last_fullsized":"2024-09-15T23:15:56.383622+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:47:21.466200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382646+0000","last_change":"2024-09-15T23:15:54.895898+0000","last_active":"2024-09-15T23:15:56.382646+0000","last_peered":"2024-09-15T23:15:56.382646+0000","last_clean":"2024-09-15T23:15:56.382646+0000","last_became_active":"2024-09-15T23:15:54.895600+0000","last_became_peered":"2024-09-15T23:15:54.895600+0000","last_unstale":"2024-09-15T23:15:56.382646+0000","last_undegraded":"2024-09-15T23:15:56.382646+0000","last_fullsized":"2024-09-15T23:15:56.382646+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:05:41.623242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382898+0000","last_change":"2024-09-15T23:15:54.907811+0000","last_active":"2024-09-15T23:15:56.382898+0000","last_peered":"2024-09-15T23:15:56.382898+0000","last_clean":"2024-09-15T23:15:56.382898+0000","last_became_active":"2024-09-15T23:15:54.906473+0000","last_became_peered":"2024-09-15T23:15:54.906473+0000","last_unstale":"2024-09-15T23:15:56.382898+0000","last_undegraded":"2024-09-15T23:15:56.382898+0000","last_fullsized":"2024-09-15T23:15:56.382898+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:41.289668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382377+0000","last_change":"2024-09-15T23:15:54.901163+0000","last_active":"2024-09-15T23:15:56.382377+0000","last_peered":"2024-09-15T23:15:56.382377+0000","last_clean":"2024-09-15T23:15:56.382377+0000","last_became_active":"2024-09-15T23:15:54.900857+0000","last_became_peered":"2024-09-15T23:15:54.900857+0000","last_unstale":"2024-09-15T23:15:56.382377+0000","last_undegraded":"2024-09-15T23:15:56.382377+0000","last_fullsized":"2024-09-15T23:15:56.382377+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:21.515224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382867+0000","last_change":"2024-09-15T23:15:54.903632+0000","last_active":"2024-09-15T23:15:56.382867+0000","last_peered":"2024-09-15T23:15:56.382867+0000","last_clean":"2024-09-15T23:15:56.382867+0000","last_became_active":"2024-09-15T23:15:54.903372+0000","last_became_peered":"2024-09-15T23:15:54.903372+0000","last_unstale":"2024-09-15T23:15:56.382867+0000","last_undegraded":"2024-09-15T23:15:56.382867+0000","last_fullsized":"2024-09-15T23:15:56.382867+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:24:41.298145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383611+0000","last_change":"2024-09-15T23:15:54.913958+0000","last_active":"2024-09-15T23:15:56.383611+0000","last_peered":"2024-09-15T23:15:56.383611+0000","last_clean":"2024-09-15T23:15:56.383611+0000","last_became_active":"2024-09-15T23:15:54.913620+0000","last_became_peered":"2024-09-15T23:15:54.913620+0000","last_unstale":"2024-09-15T23:15:56.383611+0000","last_undegraded":"2024-09-15T23:15:56.383611+0000","last_fullsized":"2024-09-15T23:15:56.383611+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:54:51.854826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382795+0000","last_change":"2024-09-15T23:15:54.908104+0000","last_active":"2024-09-15T23:15:56.382795+0000","last_peered":"2024-09-15T23:15:56.382795+0000","last_clean":"2024-09-15T23:15:56.382795+0000","last_became_active":"2024-09-15T23:15:54.907745+0000","last_became_peered":"2024-09-15T23:15:54.907745+0000","last_unstale":"2024-09-15T23:15:56.382795+0000","last_undegraded":"2024-09-15T23:15:56.382795+0000","last_fullsized":"2024-09-15T23:15:56.382795+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:25.144212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383665+0000","last_change":"2024-09-15T23:15:54.905358+0000","last_active":"2024-09-15T23:15:56.383665+0000","last_peered":"2024-09-15T23:15:56.383665+0000","last_clean":"2024-09-15T23:15:56.383665+0000","last_became_active":"2024-09-15T23:15:54.905065+0000","last_became_peered":"2024-09-15T23:15:54.905065+0000","last_unstale":"2024-09-15T23:15:56.383665+0000","last_undegraded":"2024-09-15T23:15:56.383665+0000","last_fullsized":"2024-09-15T23:15:56.383665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:44.715419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382812+0000","last_change":"2024-09-15T23:15:54.901618+0000","last_active":"2024-09-15T23:15:56.382812+0000","last_peered":"2024-09-15T23:15:56.382812+0000","last_clean":"2024-09-15T23:15:56.382812+0000","last_became_active":"2024-09-15T23:15:54.901320+0000","last_became_peered":"2024-09-15T23:15:54.901320+0000","last_unstale":"2024-09-15T23:15:56.382812+0000","last_undegraded":"2024-09-15T23:15:56.382812+0000","last_fullsized":"2024-09-15T23:15:56.382812+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:27:08.045770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.876492+0000","last_change":"2024-09-15T23:15:52.876492+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.876492+0000","last_undegraded":"2024-09-15T23:15:52.876492+0000","last_fullsized":"2024-09-15T23:15:52.876492+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383939+0000","last_change":"2024-09-15T23:15:54.906698+0000","last_active":"2024-09-15T23:15:56.383939+0000","last_peered":"2024-09-15T23:15:56.383939+0000","last_clean":"2024-09-15T23:15:56.383939+0000","last_became_active":"2024-09-15T23:15:54.906420+0000","last_became_peered":"2024-09-15T23:15:54.906420+0000","last_unstale":"2024-09-15T23:15:56.383939+0000","last_undegraded":"2024-09-15T23:15:56.383939+0000","last_fullsized":"2024-09-15T23:15:56.383939+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:23.345381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1e","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383715+0000","last_change":"2024-09-15T23:15:53.899891+0000","last_active":"2024-09-15T23:15:56.383715+0000","last_peered":"2024-09-15T23:15:56.383715+0000","last_clean":"2024-09-15T23:15:56.383715+0000","last_became_active":"2024-09-15T23:15:53.899625+0000","last_became_peered":"2024-09-15T23:15:53.899625+0000","last_unstale":"2024-09-15T23:15:56.383715+0000","last_undegraded":"2024-09-15T23:15:56.383715+0000","last_fullsized":"2024-09-15T23:15:56.383715+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:25:50.828449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.880276+0000","last_change":"2024-09-15T23:15:52.880276+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.880276+0000","last_undegraded":"2024-09-15T23:15:52.880276+0000","last_fullsized":"2024-09-15T23:15:52.880276+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.876682+0000","last_change":"2024-09-15T23:15:52.876682+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.876682+0000","last_undegraded":"2024-09-15T23:15:52.876682+0000","last_fullsized":"2024-09-15T23:15:52.876682+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382496+0000","last_change":"2024-09-15T23:15:53.898588+0000","last_active":"2024-09-15T23:15:56.382496+0000","last_peered":"2024-09-15T23:15:56.382496+0000","last_clean":"2024-09-15T23:15:56.382496+0000","last_became_active":"2024-09-15T23:15:53.898307+0000","last_became_peered":"2024-09-15T23:15:53.898307+0000","last_unstale":"2024-09-15T23:15:56.382496+0000","last_undegraded":"2024-09-15T23:15:56.382496+0000","last_fullsized":"2024-09-15T23:15:56.382496+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:38:25.728830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.879239+0000","last_change":"2024-09-15T23:15:52.879239+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.879239+0000","last_undegraded":"2024-09-15T23:15:52.879239+0000","last_fullsized":"2024-09-15T23:15:52.879239+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.275987+0000","last_change":"2024-09-15T23:15:54.911292+0000","last_active":"2024-09-15T23:15:56.275987+0000","last_peered":"2024-09-15T23:15:56.275987+0000","last_clean":"2024-09-15T23:15:56.275987+0000","last_became_active":"2024-09-15T23:15:54.910952+0000","last_became_peered":"2024-09-15T23:15:54.910952+0000","last_unstale":"2024-09-15T23:15:56.275987+0000","last_undegraded":"2024-09-15T23:15:56.275987+0000","last_fullsized":"2024-09-15T23:15:56.275987+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:42.049462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.276093+0000","last_change":"2024-09-15T23:15:53.900588+0000","last_active":"2024-09-15T23:15:56.276093+0000","last_peered":"2024-09-15T23:15:56.276093+0000","last_clean":"2024-09-15T23:15:56.276093+0000","last_became_active":"2024-09-15T23:15:53.900366+0000","last_became_peered":"2024-09-15T23:15:53.900366+0000","last_unstale":"2024-09-15T23:15:56.276093+0000","last_undegraded":"2024-09-15T23:15:56.276093+0000","last_fullsized":"2024-09-15T23:15:56.276093+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:24.362527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382521+0000","last_change":"2024-09-15T23:15:54.906993+0000","last_active":"2024-09-15T23:15:56.382521+0000","last_peered":"2024-09-15T23:15:56.382521+0000","last_clean":"2024-09-15T23:15:56.382521+0000","last_became_active":"2024-09-15T23:15:54.906662+0000","last_became_peered":"2024-09-15T23:15:54.906662+0000","last_unstale":"2024-09-15T23:15:56.382521+0000","last_undegraded":"2024-09-15T23:15:56.382521+0000","last_fullsized":"2024-09-15T23:15:56.382521+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:20.992800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382206+0000","last_change":"2024-09-15T23:15:53.897383+0000","last_active":"2024-09-15T23:15:56.382206+0000","last_peered":"2024-09-15T23:15:56.382206+0000","last_clean":"2024-09-15T23:15:56.382206+0000","last_became_active":"2024-09-15T23:15:53.897092+0000","last_became_peered":"2024-09-15T23:15:53.897092+0000","last_unstale":"2024-09-15T23:15:56.382206+0000","last_undegraded":"2024-09-15T23:15:56.382206+0000","last_fullsized":"2024-09-15T23:15:56.382206+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:10.169770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.880676+0000","last_change":"2024-09-15T23:15:52.880676+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.880676+0000","last_undegraded":"2024-09-15T23:15:52.880676+0000","last_fullsized":"2024-09-15T23:15:52.880676+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.876565+0000","last_change":"2024-09-15T23:15:52.876565+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.876565+0000","last_undegraded":"2024-09-15T23:15:52.876565+0000","last_fullsized":"2024-09-15T23:15:52.876565+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"81'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383356+0000","last_change":"2024-09-15T23:15:53.895758+0000","last_active":"2024-09-15T23:15:56.383356+0000","last_peered":"2024-09-15T23:15:56.383356+0000","last_clean":"2024-09-15T23:15:56.383356+0000","last_became_active":"2024-09-15T23:15:53.895493+0000","last_became_peered":"2024-09-15T23:15:53.895493+0000","last_unstale":"2024-09-15T23:15:56.383356+0000","last_undegraded":"2024-09-15T23:15:56.383356+0000","last_fullsized":"2024-09-15T23:15:56.383356+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:54:45.779651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383425+0000","last_change":"2024-09-15T23:15:54.904531+0000","last_active":"2024-09-15T23:15:56.383425+0000","last_peered":"2024-09-15T23:15:56.383425+0000","last_clean":"2024-09-15T23:15:56.383425+0000","last_became_active":"2024-09-15T23:15:54.904250+0000","last_became_peered":"2024-09-15T23:15:54.904250+0000","last_unstale":"2024-09-15T23:15:56.383425+0000","last_undegraded":"2024-09-15T23:15:56.383425+0000","last_fullsized":"2024-09-15T23:15:56.383425+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:43:33.055440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"81'6","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.276398+0000","last_change":"2024-09-15T23:15:53.895740+0000","last_active":"2024-09-15T23:15:56.276398+0000","last_peered":"2024-09-15T23:15:56.276398+0000","last_clean":"2024-09-15T23:15:56.276398+0000","last_became_active":"2024-09-15T23:15:53.895480+0000","last_became_peered":"2024-09-15T23:15:53.895480+0000","last_unstale":"2024-09-15T23:15:56.276398+0000","last_undegraded":"2024-09-15T23:15:56.276398+0000","last_fullsized":"2024-09-15T23:15:56.276398+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:05.057467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.276131+0000","last_change":"2024-09-15T23:15:53.893711+0000","last_active":"2024-09-15T23:15:56.276131+0000","last_peered":"2024-09-15T23:15:56.276131+0000","last_clean":"2024-09-15T23:15:56.276131+0000","last_became_active":"2024-09-15T23:15:53.893432+0000","last_became_peered":"2024-09-15T23:15:53.893432+0000","last_unstale":"2024-09-15T23:15:56.276131+0000","last_undegraded":"2024-09-15T23:15:56.276131+0000","last_fullsized":"2024-09-15T23:15:56.276131+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:58:01.036404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.878742+0000","last_change":"2024-09-15T23:15:52.878742+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.878742+0000","last_undegraded":"2024-09-15T23:15:52.878742+0000","last_fullsized":"2024-09-15T23:15:52.878742+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382734+0000","last_change":"2024-09-15T23:15:54.911495+0000","last_active":"2024-09-15T23:15:56.382734+0000","last_peered":"2024-09-15T23:15:56.382734+0000","last_clean":"2024-09-15T23:15:56.382734+0000","last_became_active":"2024-09-15T23:15:54.911165+0000","last_became_peered":"2024-09-15T23:15:54.911165+0000","last_unstale":"2024-09-15T23:15:56.382734+0000","last_undegraded":"2024-09-15T23:15:56.382734+0000","last_fullsized":"2024-09-15T23:15:56.382734+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:00:46.921868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.878729+0000","last_change":"2024-09-15T23:15:52.878729+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.878729+0000","last_undegraded":"2024-09-15T23:15:52.878729+0000","last_fullsized":"2024-09-15T23:15:52.878729+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383393+0000","last_change":"2024-09-15T23:15:54.899159+0000","last_active":"2024-09-15T23:15:56.383393+0000","last_peered":"2024-09-15T23:15:56.383393+0000","last_clean":"2024-09-15T23:15:56.383393+0000","last_became_active":"2024-09-15T23:15:54.898842+0000","last_became_peered":"2024-09-15T23:15:54.898842+0000","last_unstale":"2024-09-15T23:15:56.383393+0000","last_undegraded":"2024-09-15T23:15:56.383393+0000","last_fullsized":"2024-09-15T23:15:56.383393+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:23:49.789348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.878721+0000","last_change":"2024-09-15T23:15:52.878721+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.878721+0000","last_undegraded":"2024-09-15T23:15:52.878721+0000","last_fullsized":"2024-09-15T23:15:52.878721+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.880235+0000","last_change":"2024-09-15T23:15:52.880235+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.880235+0000","last_undegraded":"2024-09-15T23:15:52.880235+0000","last_fullsized":"2024-09-15T23:15:52.880235+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.875743+0000","last_change":"2024-09-15T23:15:52.875743+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.875743+0000","last_undegraded":"2024-09-15T23:15:52.875743+0000","last_fullsized":"2024-09-15T23:15:52.875743+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382925+0000","last_change":"2024-09-15T23:15:54.894455+0000","last_active":"2024-09-15T23:15:56.382925+0000","last_peered":"2024-09-15T23:15:56.382925+0000","last_clean":"2024-09-15T23:15:56.382925+0000","last_became_active":"2024-09-15T23:15:54.894157+0000","last_became_peered":"2024-09-15T23:15:54.894157+0000","last_unstale":"2024-09-15T23:15:56.382925+0000","last_undegraded":"2024-09-15T23:15:56.382925+0000","last_fullsized":"2024-09-15T23:15:56.382925+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:52.302621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.875754+0000","last_change":"2024-09-15T23:15:52.875754+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.875754+0000","last_undegraded":"2024-09-15T23:15:52.875754+0000","last_fullsized":"2024-09-15T23:15:52.875754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383121+0000","last_change":"2024-09-15T23:15:54.900984+0000","last_active":"2024-09-15T23:15:56.383121+0000","last_peered":"2024-09-15T23:15:56.383121+0000","last_clean":"2024-09-15T23:15:56.383121+0000","last_became_active":"2024-09-15T23:15:54.900709+0000","last_became_peered":"2024-09-15T23:15:54.900709+0000","last_unstale":"2024-09-15T23:15:56.383121+0000","last_undegraded":"2024-09-15T23:15:56.383121+0000","last_fullsized":"2024-09-15T23:15:56.383121+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:35:04.409834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.876188+0000","last_change":"2024-09-15T23:15:52.876188+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.876188+0000","last_undegraded":"2024-09-15T23:15:52.876188+0000","last_fullsized":"2024-09-15T23:15:52.876188+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.276226+0000","last_change":"2024-09-15T23:15:54.899731+0000","last_active":"2024-09-15T23:15:56.276226+0000","last_peered":"2024-09-15T23:15:56.276226+0000","last_clean":"2024-09-15T23:15:56.276226+0000","last_became_active":"2024-09-15T23:15:54.899453+0000","last_became_peered":"2024-09-15T23:15:54.899453+0000","last_unstale":"2024-09-15T23:15:56.276226+0000","last_undegraded":"2024-09-15T23:15:56.276226+0000","last_fullsized":"2024-09-15T23:15:56.276226+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:52.766645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.876047+0000","last_change":"2024-09-15T23:15:52.876047+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.876047+0000","last_undegraded":"2024-09-15T23:15:52.876047+0000","last_fullsized":"2024-09-15T23:15:52.876047+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.276158+0000","last_change":"2024-09-15T23:15:54.896709+0000","last_active":"2024-09-15T23:15:56.276158+0000","last_peered":"2024-09-15T23:15:56.276158+0000","last_clean":"2024-09-15T23:15:56.276158+0000","last_became_active":"2024-09-15T23:15:54.896326+0000","last_became_peered":"2024-09-15T23:15:54.896326+0000","last_unstale":"2024-09-15T23:15:56.276158+0000","last_undegraded":"2024-09-15T23:15:56.276158+0000","last_fullsized":"2024-09-15T23:15:56.276158+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:47:58.493900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.875687+0000","last_change":"2024-09-15T23:15:52.875687+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.875687+0000","last_undegraded":"2024-09-15T23:15:52.875687+0000","last_fullsized":"2024-09-15T23:15:52.875687+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383554+0000","last_change":"2024-09-15T23:15:54.897799+0000","last_active":"2024-09-15T23:15:56.383554+0000","last_peered":"2024-09-15T23:15:56.383554+0000","last_clean":"2024-09-15T23:15:56.383554+0000","last_became_active":"2024-09-15T23:15:54.897468+0000","last_became_peered":"2024-09-15T23:15:54.897468+0000","last_unstale":"2024-09-15T23:15:56.383554+0000","last_undegraded":"2024-09-15T23:15:56.383554+0000","last_fullsized":"2024-09-15T23:15:56.383554+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:04:08.287676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382587+0000","last_change":"2024-09-15T23:15:53.894527+0000","last_active":"2024-09-15T23:15:56.382587+0000","last_peered":"2024-09-15T23:15:56.382587+0000","last_clean":"2024-09-15T23:15:56.382587+0000","last_became_active":"2024-09-15T23:15:53.894233+0000","last_became_peered":"2024-09-15T23:15:53.894233+0000","last_unstale":"2024-09-15T23:15:56.382587+0000","last_undegraded":"2024-09-15T23:15:56.382587+0000","last_fullsized":"2024-09-15T23:15:56.382587+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:51:14.198694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383690+0000","last_change":"2024-09-15T23:15:54.904641+0000","last_active":"2024-09-15T23:15:56.383690+0000","last_peered":"2024-09-15T23:15:56.383690+0000","last_clean":"2024-09-15T23:15:56.383690+0000","last_became_active":"2024-09-15T23:15:54.904370+0000","last_became_peered":"2024-09-15T23:15:54.904370+0000","last_unstale":"2024-09-15T23:15:56.383690+0000","last_undegraded":"2024-09-15T23:15:56.383690+0000","last_fullsized":"2024-09-15T23:15:56.383690+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:33:50.355276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.878138+0000","last_change":"2024-09-15T23:15:52.878138+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.878138+0000","last_undegraded":"2024-09-15T23:15:52.878138+0000","last_fullsized":"2024-09-15T23:15:52.878138+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.878152+0000","last_change":"2024-09-15T23:15:52.878152+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.878152+0000","last_undegraded":"2024-09-15T23:15:52.878152+0000","last_fullsized":"2024-09-15T23:15:52.878152+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383459+0000","last_change":"2024-09-15T23:15:53.890515+0000","last_active":"2024-09-15T23:15:56.383459+0000","last_peered":"2024-09-15T23:15:56.383459+0000","last_clean":"2024-09-15T23:15:56.383459+0000","last_became_active":"2024-09-15T23:15:53.890230+0000","last_became_peered":"2024-09-15T23:15:53.890230+0000","last_unstale":"2024-09-15T23:15:56.383459+0000","last_undegraded":"2024-09-15T23:15:56.383459+0000","last_fullsized":"2024-09-15T23:15:56.383459+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:02.636477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383555+0000","last_change":"2024-09-15T23:15:53.895098+0000","last_active":"2024-09-15T23:15:56.383555+0000","last_peered":"2024-09-15T23:15:56.383555+0000","last_clean":"2024-09-15T23:15:56.383555+0000","last_became_active":"2024-09-15T23:15:53.893423+0000","last_became_peered":"2024-09-15T23:15:53.893423+0000","last_unstale":"2024-09-15T23:15:56.383555+0000","last_undegraded":"2024-09-15T23:15:56.383555+0000","last_fullsized":"2024-09-15T23:15:56.383555+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:05.970626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383220+0000","last_change":"2024-09-15T23:15:54.903195+0000","last_active":"2024-09-15T23:15:56.383220+0000","last_peered":"2024-09-15T23:15:56.383220+0000","last_clean":"2024-09-15T23:15:56.383220+0000","last_became_active":"2024-09-15T23:15:54.902860+0000","last_became_peered":"2024-09-15T23:15:54.902860+0000","last_unstale":"2024-09-15T23:15:56.383220+0000","last_undegraded":"2024-09-15T23:15:56.383220+0000","last_fullsized":"2024-09-15T23:15:56.383220+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:18:55.627155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382407+0000","last_change":"2024-09-15T23:15:53.897951+0000","last_active":"2024-09-15T23:15:56.382407+0000","last_peered":"2024-09-15T23:15:56.382407+0000","last_clean":"2024-09-15T23:15:56.382407+0000","last_became_active":"2024-09-15T23:15:53.897654+0000","last_became_peered":"2024-09-15T23:15:53.897654+0000","last_unstale":"2024-09-15T23:15:56.382407+0000","last_undegraded":"2024-09-15T23:15:56.382407+0000","last_fullsized":"2024-09-15T23:15:56.382407+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:52:21.447053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383263+0000","last_change":"2024-09-15T23:15:53.901460+0000","last_active":"2024-09-15T23:15:56.383263+0000","last_peered":"2024-09-15T23:15:56.383263+0000","last_clean":"2024-09-15T23:15:56.383263+0000","last_became_active":"2024-09-15T23:15:53.901261+0000","last_became_peered":"2024-09-15T23:15:53.901261+0000","last_unstale":"2024-09-15T23:15:56.383263+0000","last_undegraded":"2024-09-15T23:15:56.383263+0000","last_fullsized":"2024-09-15T23:15:56.383263+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:06.343575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.276260+0000","last_change":"2024-09-15T23:15:54.897440+0000","last_active":"2024-09-15T23:15:56.276260+0000","last_peered":"2024-09-15T23:15:56.276260+0000","last_clean":"2024-09-15T23:15:56.276260+0000","last_became_active":"2024-09-15T23:15:54.897175+0000","last_became_peered":"2024-09-15T23:15:54.897175+0000","last_unstale":"2024-09-15T23:15:56.276260+0000","last_undegraded":"2024-09-15T23:15:56.276260+0000","last_fullsized":"2024-09-15T23:15:56.276260+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:47:37.405707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.875198+0000","last_change":"2024-09-15T23:15:52.875198+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.875198+0000","last_undegraded":"2024-09-15T23:15:52.875198+0000","last_fullsized":"2024-09-15T23:15:52.875198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.876072+0000","last_change":"2024-09-15T23:15:52.876072+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.876072+0000","last_undegraded":"2024-09-15T23:15:52.876072+0000","last_fullsized":"2024-09-15T23:15:52.876072+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383109+0000","last_change":"2024-09-15T23:15:54.906530+0000","last_active":"2024-09-15T23:15:56.383109+0000","last_peered":"2024-09-15T23:15:56.383109+0000","last_clean":"2024-09-15T23:15:56.383109+0000","last_became_active":"2024-09-15T23:15:54.906238+0000","last_became_peered":"2024-09-15T23:15:54.906238+0000","last_unstale":"2024-09-15T23:15:56.383109+0000","last_undegraded":"2024-09-15T23:15:56.383109+0000","last_fullsized":"2024-09-15T23:15:56.383109+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:41:09.389540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.878091+0000","last_change":"2024-09-15T23:15:52.878091+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.878091+0000","last_undegraded":"2024-09-15T23:15:52.878091+0000","last_fullsized":"2024-09-15T23:15:52.878091+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":276,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T23:15:52.879325+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:15:52.879325+0000","last_peered":"2024-09-15T23:15:52.879325+0000","last_clean":"2024-09-15T23:15:52.879325+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:15:52.879325+0000","last_undegraded":"2024-09-15T23:15:52.879325+0000","last_fullsized":"2024-09-15T23:15:52.879325+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":56,"acting":56,"num_store_stats":4},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":1736,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":4042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476788,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40436,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331404,"statfs":{"total":96636764160,"available":96595357696,"internally_reserved":0,"allocated":950272,"data_stored":407641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476785,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40428,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331412,"statfs":{"total":96636764160,"available":96595365888,"internally_reserved":0,"allocated":937984,"data_stored":401824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476787,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36856,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334984,"statfs":{"total":96636764160,"available":96599023616,"internally_reserved":0,"allocated":1544192,"data_stored":998009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476787,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":950272,"data_stored":407641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542194,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":987136,"data_stored":422295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542194,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":991232,"data_stored":422329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542193,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36892,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334948,"statfs":{"total":96636764160,"available":96598986752,"internally_reserved":0,"allocated":1572864,"data_stored":1011141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542195,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":987136,"data_stored":421377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:15:57.836 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:15:57.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.970+0000 7fb18d186640 1 Processor -- start 2024-09-15T23:15:57.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.970+0000 7fb18d186640 1 -- start start 2024-09-15T23:15:57.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.971+0000 7fb18d186640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb18806bc10 0x7fb18806bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:57.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.971+0000 7fb18d186640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb1880cef60 0x7fb18815eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:57.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.971+0000 7fb18d186640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb18806c530 con 0x7fb1880b3790 2024-09-15T23:15:57.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.971+0000 7fb18d186640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fb1880cd690 con 0x7fb18806bc10 2024-09-15T23:15:57.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.971+0000 7fb18d186640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fb1880d06f0 con 0x7fb1880cef60 2024-09-15T23:15:57.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.971+0000 7fb186d9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb18806bc10 0x7fb18806bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:57.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.971+0000 7fb18759e640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb1880b3790 0x7fb1880b67a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:44034/0 (socket says 172.21.15.123:44034) 2024-09-15T23:15:57.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.971+0000 7fb18759e640 1 -- 172.21.15.123:0/1687777073 learned_addr learned my addr 172.21.15.123:0/1687777073 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:57.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.971+0000 7fb17ffff640 1 --2- 172.21.15.123:0/1687777073 >> v2:172.21.15.188:3300/0 conn(0x7fb1880cef60 0x7fb18815eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:57.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.971+0000 7fb186d9d640 1 -- 172.21.15.123:0/1687777073 >> v2:172.21.15.188:3300/0 conn(0x7fb1880cef60 msgr2=0x7fb18815eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:57.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.971+0000 7fb186d9d640 1 --2- 172.21.15.123:0/1687777073 >> v2:172.21.15.188:3300/0 conn(0x7fb1880cef60 0x7fb18815eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:57.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.971+0000 7fb186d9d640 1 -- 172.21.15.123:0/1687777073 >> v1:172.21.15.123:6789/0 conn(0x7fb1880b3790 legacy=0x7fb1880b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:57.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.971+0000 7fb186d9d640 1 -- 172.21.15.123:0/1687777073 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb18815f060 con 0x7fb18806bc10 2024-09-15T23:15:57.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.971+0000 7fb18659c640 1 -- 172.21.15.123:0/1687777073 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 371020902 0 0) 0x7fb18806c530 con 0x7fb1880b3790 2024-09-15T23:15:57.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.971+0000 7fb17ffff640 1 --2- 172.21.15.123:0/1687777073 >> v2:172.21.15.188:3300/0 conn(0x7fb1880cef60 0x7fb18815eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:15:57.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.972+0000 7fb186d9d640 1 --2- 172.21.15.123:0/1687777073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb18806bc10 0x7fb18806bff0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fb1881635a0 tx=0x7fb17802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=681e4a8318e445e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:57.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.972+0000 7fb18659c640 1 -- 172.21.15.123:0/1687777073 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb178037070 con 0x7fb18806bc10 2024-09-15T23:15:57.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.972+0000 7fb18659c640 1 -- 172.21.15.123:0/1687777073 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb178032440 con 0x7fb18806bc10 2024-09-15T23:15:57.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.972+0000 7fb18659c640 1 -- 172.21.15.123:0/1687777073 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb178032810 con 0x7fb18806bc10 2024-09-15T23:15:57.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.973+0000 7fb18d186640 1 -- 172.21.15.123:0/1687777073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb18806bc10 msgr2=0x7fb18806bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:57.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.973+0000 7fb18d186640 1 --2- 172.21.15.123:0/1687777073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb18806bc10 0x7fb18806bff0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fb1881635a0 tx=0x7fb17802a1e0 comp rx=0 tx=0).stop 2024-09-15T23:15:57.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.973+0000 7fb18d186640 1 -- 172.21.15.123:0/1687777073 shutdown_connections 2024-09-15T23:15:57.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.973+0000 7fb18d186640 1 --2- 172.21.15.123:0/1687777073 >> v2:172.21.15.188:3300/0 conn(0x7fb1880cef60 0x7fb18815eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:57.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.973+0000 7fb18d186640 1 --2- 172.21.15.123:0/1687777073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb18806bc10 0x7fb18806bff0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:57.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.973+0000 7fb18d186640 1 -- 172.21.15.123:0/1687777073 >> 172.21.15.123:0/1687777073 conn(0x7fb18806cd20 msgr2=0x7fb18806d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:57.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.973+0000 7fb18d186640 1 -- 172.21.15.123:0/1687777073 shutdown_connections 2024-09-15T23:15:57.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.973+0000 7fb18d186640 1 -- 172.21.15.123:0/1687777073 wait complete. 2024-09-15T23:15:57.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.974+0000 7fb18d186640 1 Processor -- start 2024-09-15T23:15:57.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.974+0000 7fb18d186640 1 -- start start 2024-09-15T23:15:57.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.975+0000 7fb18d186640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb18806bc10 0x7fb1881f7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:57.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.975+0000 7fb18d186640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1880b3790 0x7fb188159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:57.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.975+0000 7fb18d186640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb1880cef60 0x7fb1881597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:57.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.975+0000 7fb18d186640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb1880d0c30 con 0x7fb1880b3790 2024-09-15T23:15:57.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.975+0000 7fb18d186640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb1880d0950 con 0x7fb18806bc10 2024-09-15T23:15:57.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.975+0000 7fb18d186640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb1880d0f10 con 0x7fb1880cef60 2024-09-15T23:15:57.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.975+0000 7fb17ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1880b3790 0x7fb188159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:57.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.975+0000 7fb17ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1880b3790 0x7fb188159280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53974/0 (socket says 172.21.15.123:53974) 2024-09-15T23:15:57.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.975+0000 7fb17ffff640 1 -- 172.21.15.123:0/3627888988 learned_addr learned my addr 172.21.15.123:0/3627888988 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:57.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.975+0000 7fb186d9d640 1 --2- 172.21.15.123:0/3627888988 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb18806bc10 0x7fb1881f7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:57.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.975+0000 7fb18759e640 1 --2- 172.21.15.123:0/3627888988 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb1880cef60 0x7fb1881597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:57.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.975+0000 7fb17ffff640 1 -- 172.21.15.123:0/3627888988 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb1880cef60 msgr2=0x7fb1881597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:57.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.975+0000 7fb17ffff640 1 --2- 172.21.15.123:0/3627888988 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb1880cef60 0x7fb1881597c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:57.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.975+0000 7fb17ffff640 1 -- 172.21.15.123:0/3627888988 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb18806bc10 msgr2=0x7fb1881f7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:57.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.975+0000 7fb17ffff640 1 --2- 172.21.15.123:0/3627888988 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb18806bc10 0x7fb1881f7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:57.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.975+0000 7fb17ffff640 1 -- 172.21.15.123:0/3627888988 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1880b5310 con 0x7fb1880b3790 2024-09-15T23:15:57.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.975+0000 7fb186d9d640 1 --2- 172.21.15.123:0/3627888988 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb18806bc10 0x7fb1881f7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:57.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.975+0000 7fb18759e640 1 --2- 172.21.15.123:0/3627888988 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb1880cef60 0x7fb1881597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:15:57.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.975+0000 7fb17ffff640 1 --2- 172.21.15.123:0/3627888988 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1880b3790 0x7fb188159280 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fb17000d7d0 tx=0x7fb17000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:57.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.975+0000 7fb17f7fe640 1 -- 172.21.15.123:0/3627888988 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb170004030 con 0x7fb1880b3790 2024-09-15T23:15:57.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.976+0000 7fb17f7fe640 1 -- 172.21.15.123:0/3627888988 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1700041d0 con 0x7fb1880b3790 2024-09-15T23:15:57.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.976+0000 7fb18d186640 1 -- 172.21.15.123:0/3627888988 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1880b55f0 con 0x7fb1880b3790 2024-09-15T23:15:57.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.976+0000 7fb17f7fe640 1 -- 172.21.15.123:0/3627888988 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1700096a0 con 0x7fb1880b3790 2024-09-15T23:15:57.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.976+0000 7fb18d186640 1 -- 172.21.15.123:0/3627888988 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1880b5bb0 con 0x7fb1880b3790 2024-09-15T23:15:57.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.977+0000 7fb18d186640 1 -- 172.21.15.123:0/3627888988 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1880b3bc0 con 0x7fb1880b3790 2024-09-15T23:15:57.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.977+0000 7fb17f7fe640 1 -- 172.21.15.123:0/3627888988 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb170009840 con 0x7fb1880b3790 2024-09-15T23:15:57.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.977+0000 7fb17f7fe640 1 --2- 172.21.15.123:0/3627888988 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb16806c2b0 0x7fb16806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:57.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.978+0000 7fb17f7fe640 1 -- 172.21.15.123:0/3627888988 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7fb17008b660 con 0x7fb1880b3790 2024-09-15T23:15:57.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.978+0000 7fb186d9d640 1 --2- 172.21.15.123:0/3627888988 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb16806c2b0 0x7fb16806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:57.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.978+0000 7fb186d9d640 1 --2- 172.21.15.123:0/3627888988 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb16806c2b0 0x7fb16806e770 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb178034000 tx=0x7fb17802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:57.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:57.982+0000 7fb17f7fe640 1 -- 172.21.15.123:0/3627888988 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb170059e60 con 0x7fb1880b3790 2024-09-15T23:15:58.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.143+0000 7fb18d186640 1 -- 172.21.15.123:0/3627888988 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb1880cdbe0 con 0x7fb16806c2b0 2024-09-15T23:15:58.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.149+0000 7fb17f7fe640 1 -- 172.21.15.123:0/3627888988 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245300 (secure 0 0 0) 0x7fb1880cdbe0 con 0x7fb16806c2b0 2024-09-15T23:15:58.152 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:58.153 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:15:58.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.152+0000 7fb18d186640 1 -- 172.21.15.123:0/3627888988 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb16806c2b0 msgr2=0x7fb16806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:58.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.152+0000 7fb18d186640 1 --2- 172.21.15.123:0/3627888988 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb16806c2b0 0x7fb16806e770 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb178034000 tx=0x7fb17802e000 comp rx=0 tx=0).stop 2024-09-15T23:15:58.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.152+0000 7fb18d186640 1 -- 172.21.15.123:0/3627888988 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1880b3790 msgr2=0x7fb188159280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:58.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.152+0000 7fb18d186640 1 --2- 172.21.15.123:0/3627888988 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1880b3790 0x7fb188159280 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fb17000d7d0 tx=0x7fb17000dc90 comp rx=0 tx=0).stop 2024-09-15T23:15:58.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.152+0000 7fb18d186640 1 -- 172.21.15.123:0/3627888988 shutdown_connections 2024-09-15T23:15:58.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.152+0000 7fb18d186640 1 --2- 172.21.15.123:0/3627888988 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb1880cef60 0x7fb1881597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:58.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.152+0000 7fb18d186640 1 --2- 172.21.15.123:0/3627888988 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb16806c2b0 0x7fb16806e770 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:58.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.152+0000 7fb18d186640 1 --2- 172.21.15.123:0/3627888988 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1880b3790 0x7fb188159280 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:58.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.152+0000 7fb18d186640 1 --2- 172.21.15.123:0/3627888988 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb18806bc10 0x7fb1881f7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:58.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.152+0000 7fb18d186640 1 -- 172.21.15.123:0/3627888988 >> 172.21.15.123:0/3627888988 conn(0x7fb18806cd20 msgr2=0x7fb1880d1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:58.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.152+0000 7fb18d186640 1 -- 172.21.15.123:0/3627888988 shutdown_connections 2024-09-15T23:15:58.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.152+0000 7fb18d186640 1 -- 172.21.15.123:0/3627888988 wait complete. 2024-09-15T23:15:58.164 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":193,"stamp":"2024-09-15T23:15:57.555049+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592104,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":172,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":122,"acting":122,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":85,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":295680,"kb_used_data":8712,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754679040,"statfs":{"total":773094113280,"available":772791336960,"internally_reserved":0,"allocated":8921088,"data_stored":4492257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":293654064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1736,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.682399"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382986+0000","last_change":"2024-09-15T23:15:54.895953+0000","last_active":"2024-09-15T23:15:56.382986+0000","last_peered":"2024-09-15T23:15:56.382986+0000","last_clean":"2024-09-15T23:15:56.382986+0000","last_became_active":"2024-09-15T23:15:54.895632+0000","last_became_peered":"2024-09-15T23:15:54.895632+0000","last_unstale":"2024-09-15T23:15:56.382986+0000","last_undegraded":"2024-09-15T23:15:56.382986+0000","last_fullsized":"2024-09-15T23:15:56.382986+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:30:23.433151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382408+0000","last_change":"2024-09-15T23:15:54.895888+0000","last_active":"2024-09-15T23:15:56.382408+0000","last_peered":"2024-09-15T23:15:56.382408+0000","last_clean":"2024-09-15T23:15:56.382408+0000","last_became_active":"2024-09-15T23:15:54.895558+0000","last_became_peered":"2024-09-15T23:15:54.895558+0000","last_unstale":"2024-09-15T23:15:56.382408+0000","last_undegraded":"2024-09-15T23:15:56.382408+0000","last_fullsized":"2024-09-15T23:15:56.382408+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:09:03.821475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382636+0000","last_change":"2024-09-15T23:15:54.904818+0000","last_active":"2024-09-15T23:15:56.382636+0000","last_peered":"2024-09-15T23:15:56.382636+0000","last_clean":"2024-09-15T23:15:56.382636+0000","last_became_active":"2024-09-15T23:15:54.903868+0000","last_became_peered":"2024-09-15T23:15:54.903868+0000","last_unstale":"2024-09-15T23:15:56.382636+0000","last_undegraded":"2024-09-15T23:15:56.382636+0000","last_fullsized":"2024-09-15T23:15:56.382636+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:37.663336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383920+0000","last_change":"2024-09-15T23:15:54.901116+0000","last_active":"2024-09-15T23:15:56.383920+0000","last_peered":"2024-09-15T23:15:56.383920+0000","last_clean":"2024-09-15T23:15:56.383920+0000","last_became_active":"2024-09-15T23:15:54.900244+0000","last_became_peered":"2024-09-15T23:15:54.900244+0000","last_unstale":"2024-09-15T23:15:56.383920+0000","last_undegraded":"2024-09-15T23:15:56.383920+0000","last_fullsized":"2024-09-15T23:15:56.383920+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:54.143040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383622+0000","last_change":"2024-09-15T23:15:54.899743+0000","last_active":"2024-09-15T23:15:56.383622+0000","last_peered":"2024-09-15T23:15:56.383622+0000","last_clean":"2024-09-15T23:15:56.383622+0000","last_became_active":"2024-09-15T23:15:54.899474+0000","last_became_peered":"2024-09-15T23:15:54.899474+0000","last_unstale":"2024-09-15T23:15:56.383622+0000","last_undegraded":"2024-09-15T23:15:56.383622+0000","last_fullsized":"2024-09-15T23:15:56.383622+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:47:21.466200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382646+0000","last_change":"2024-09-15T23:15:54.895898+0000","last_active":"2024-09-15T23:15:56.382646+0000","last_peered":"2024-09-15T23:15:56.382646+0000","last_clean":"2024-09-15T23:15:56.382646+0000","last_became_active":"2024-09-15T23:15:54.895600+0000","last_became_peered":"2024-09-15T23:15:54.895600+0000","last_unstale":"2024-09-15T23:15:56.382646+0000","last_undegraded":"2024-09-15T23:15:56.382646+0000","last_fullsized":"2024-09-15T23:15:56.382646+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:05:41.623242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382898+0000","last_change":"2024-09-15T23:15:54.907811+0000","last_active":"2024-09-15T23:15:56.382898+0000","last_peered":"2024-09-15T23:15:56.382898+0000","last_clean":"2024-09-15T23:15:56.382898+0000","last_became_active":"2024-09-15T23:15:54.906473+0000","last_became_peered":"2024-09-15T23:15:54.906473+0000","last_unstale":"2024-09-15T23:15:56.382898+0000","last_undegraded":"2024-09-15T23:15:56.382898+0000","last_fullsized":"2024-09-15T23:15:56.382898+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:41.289668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382377+0000","last_change":"2024-09-15T23:15:54.901163+0000","last_active":"2024-09-15T23:15:56.382377+0000","last_peered":"2024-09-15T23:15:56.382377+0000","last_clean":"2024-09-15T23:15:56.382377+0000","last_became_active":"2024-09-15T23:15:54.900857+0000","last_became_peered":"2024-09-15T23:15:54.900857+0000","last_unstale":"2024-09-15T23:15:56.382377+0000","last_undegraded":"2024-09-15T23:15:56.382377+0000","last_fullsized":"2024-09-15T23:15:56.382377+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:21.515224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382867+0000","last_change":"2024-09-15T23:15:54.903632+0000","last_active":"2024-09-15T23:15:56.382867+0000","last_peered":"2024-09-15T23:15:56.382867+0000","last_clean":"2024-09-15T23:15:56.382867+0000","last_became_active":"2024-09-15T23:15:54.903372+0000","last_became_peered":"2024-09-15T23:15:54.903372+0000","last_unstale":"2024-09-15T23:15:56.382867+0000","last_undegraded":"2024-09-15T23:15:56.382867+0000","last_fullsized":"2024-09-15T23:15:56.382867+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:24:41.298145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383611+0000","last_change":"2024-09-15T23:15:54.913958+0000","last_active":"2024-09-15T23:15:56.383611+0000","last_peered":"2024-09-15T23:15:56.383611+0000","last_clean":"2024-09-15T23:15:56.383611+0000","last_became_active":"2024-09-15T23:15:54.913620+0000","last_became_peered":"2024-09-15T23:15:54.913620+0000","last_unstale":"2024-09-15T23:15:56.383611+0000","last_undegraded":"2024-09-15T23:15:56.383611+0000","last_fullsized":"2024-09-15T23:15:56.383611+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:54:51.854826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382795+0000","last_change":"2024-09-15T23:15:54.908104+0000","last_active":"2024-09-15T23:15:56.382795+0000","last_peered":"2024-09-15T23:15:56.382795+0000","last_clean":"2024-09-15T23:15:56.382795+0000","last_became_active":"2024-09-15T23:15:54.907745+0000","last_became_peered":"2024-09-15T23:15:54.907745+0000","last_unstale":"2024-09-15T23:15:56.382795+0000","last_undegraded":"2024-09-15T23:15:56.382795+0000","last_fullsized":"2024-09-15T23:15:56.382795+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:25.144212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383665+0000","last_change":"2024-09-15T23:15:54.905358+0000","last_active":"2024-09-15T23:15:56.383665+0000","last_peered":"2024-09-15T23:15:56.383665+0000","last_clean":"2024-09-15T23:15:56.383665+0000","last_became_active":"2024-09-15T23:15:54.905065+0000","last_became_peered":"2024-09-15T23:15:54.905065+0000","last_unstale":"2024-09-15T23:15:56.383665+0000","last_undegraded":"2024-09-15T23:15:56.383665+0000","last_fullsized":"2024-09-15T23:15:56.383665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:44.715419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382812+0000","last_change":"2024-09-15T23:15:54.901618+0000","last_active":"2024-09-15T23:15:56.382812+0000","last_peered":"2024-09-15T23:15:56.382812+0000","last_clean":"2024-09-15T23:15:56.382812+0000","last_became_active":"2024-09-15T23:15:54.901320+0000","last_became_peered":"2024-09-15T23:15:54.901320+0000","last_unstale":"2024-09-15T23:15:56.382812+0000","last_undegraded":"2024-09-15T23:15:56.382812+0000","last_fullsized":"2024-09-15T23:15:56.382812+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:27:08.045770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.876492+0000","last_change":"2024-09-15T23:15:52.876492+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.876492+0000","last_undegraded":"2024-09-15T23:15:52.876492+0000","last_fullsized":"2024-09-15T23:15:52.876492+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383939+0000","last_change":"2024-09-15T23:15:54.906698+0000","last_active":"2024-09-15T23:15:56.383939+0000","last_peered":"2024-09-15T23:15:56.383939+0000","last_clean":"2024-09-15T23:15:56.383939+0000","last_became_active":"2024-09-15T23:15:54.906420+0000","last_became_peered":"2024-09-15T23:15:54.906420+0000","last_unstale":"2024-09-15T23:15:56.383939+0000","last_undegraded":"2024-09-15T23:15:56.383939+0000","last_fullsized":"2024-09-15T23:15:56.383939+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:23.345381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1e","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383715+0000","last_change":"2024-09-15T23:15:53.899891+0000","last_active":"2024-09-15T23:15:56.383715+0000","last_peered":"2024-09-15T23:15:56.383715+0000","last_clean":"2024-09-15T23:15:56.383715+0000","last_became_active":"2024-09-15T23:15:53.899625+0000","last_became_peered":"2024-09-15T23:15:53.899625+0000","last_unstale":"2024-09-15T23:15:56.383715+0000","last_undegraded":"2024-09-15T23:15:56.383715+0000","last_fullsized":"2024-09-15T23:15:56.383715+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:25:50.828449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.880276+0000","last_change":"2024-09-15T23:15:52.880276+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.880276+0000","last_undegraded":"2024-09-15T23:15:52.880276+0000","last_fullsized":"2024-09-15T23:15:52.880276+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.876682+0000","last_change":"2024-09-15T23:15:52.876682+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.876682+0000","last_undegraded":"2024-09-15T23:15:52.876682+0000","last_fullsized":"2024-09-15T23:15:52.876682+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382496+0000","last_change":"2024-09-15T23:15:53.898588+0000","last_active":"2024-09-15T23:15:56.382496+0000","last_peered":"2024-09-15T23:15:56.382496+0000","last_clean":"2024-09-15T23:15:56.382496+0000","last_became_active":"2024-09-15T23:15:53.898307+0000","last_became_peered":"2024-09-15T23:15:53.898307+0000","last_unstale":"2024-09-15T23:15:56.382496+0000","last_undegraded":"2024-09-15T23:15:56.382496+0000","last_fullsized":"2024-09-15T23:15:56.382496+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:38:25.728830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.879239+0000","last_change":"2024-09-15T23:15:52.879239+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.879239+0000","last_undegraded":"2024-09-15T23:15:52.879239+0000","last_fullsized":"2024-09-15T23:15:52.879239+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.275987+0000","last_change":"2024-09-15T23:15:54.911292+0000","last_active":"2024-09-15T23:15:56.275987+0000","last_peered":"2024-09-15T23:15:56.275987+0000","last_clean":"2024-09-15T23:15:56.275987+0000","last_became_active":"2024-09-15T23:15:54.910952+0000","last_became_peered":"2024-09-15T23:15:54.910952+0000","last_unstale":"2024-09-15T23:15:56.275987+0000","last_undegraded":"2024-09-15T23:15:56.275987+0000","last_fullsized":"2024-09-15T23:15:56.275987+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:42.049462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.276093+0000","last_change":"2024-09-15T23:15:53.900588+0000","last_active":"2024-09-15T23:15:56.276093+0000","last_peered":"2024-09-15T23:15:56.276093+0000","last_clean":"2024-09-15T23:15:56.276093+0000","last_became_active":"2024-09-15T23:15:53.900366+0000","last_became_peered":"2024-09-15T23:15:53.900366+0000","last_unstale":"2024-09-15T23:15:56.276093+0000","last_undegraded":"2024-09-15T23:15:56.276093+0000","last_fullsized":"2024-09-15T23:15:56.276093+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:24.362527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382521+0000","last_change":"2024-09-15T23:15:54.906993+0000","last_active":"2024-09-15T23:15:56.382521+0000","last_peered":"2024-09-15T23:15:56.382521+0000","last_clean":"2024-09-15T23:15:56.382521+0000","last_became_active":"2024-09-15T23:15:54.906662+0000","last_became_peered":"2024-09-15T23:15:54.906662+0000","last_unstale":"2024-09-15T23:15:56.382521+0000","last_undegraded":"2024-09-15T23:15:56.382521+0000","last_fullsized":"2024-09-15T23:15:56.382521+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:20.992800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382206+0000","last_change":"2024-09-15T23:15:53.897383+0000","last_active":"2024-09-15T23:15:56.382206+0000","last_peered":"2024-09-15T23:15:56.382206+0000","last_clean":"2024-09-15T23:15:56.382206+0000","last_became_active":"2024-09-15T23:15:53.897092+0000","last_became_peered":"2024-09-15T23:15:53.897092+0000","last_unstale":"2024-09-15T23:15:56.382206+0000","last_undegraded":"2024-09-15T23:15:56.382206+0000","last_fullsized":"2024-09-15T23:15:56.382206+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:10.169770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.880676+0000","last_change":"2024-09-15T23:15:52.880676+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.880676+0000","last_undegraded":"2024-09-15T23:15:52.880676+0000","last_fullsized":"2024-09-15T23:15:52.880676+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.876565+0000","last_change":"2024-09-15T23:15:52.876565+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.876565+0000","last_undegraded":"2024-09-15T23:15:52.876565+0000","last_fullsized":"2024-09-15T23:15:52.876565+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"81'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383356+0000","last_change":"2024-09-15T23:15:53.895758+0000","last_active":"2024-09-15T23:15:56.383356+0000","last_peered":"2024-09-15T23:15:56.383356+0000","last_clean":"2024-09-15T23:15:56.383356+0000","last_became_active":"2024-09-15T23:15:53.895493+0000","last_became_peered":"2024-09-15T23:15:53.895493+0000","last_unstale":"2024-09-15T23:15:56.383356+0000","last_undegraded":"2024-09-15T23:15:56.383356+0000","last_fullsized":"2024-09-15T23:15:56.383356+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:54:45.779651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383425+0000","last_change":"2024-09-15T23:15:54.904531+0000","last_active":"2024-09-15T23:15:56.383425+0000","last_peered":"2024-09-15T23:15:56.383425+0000","last_clean":"2024-09-15T23:15:56.383425+0000","last_became_active":"2024-09-15T23:15:54.904250+0000","last_became_peered":"2024-09-15T23:15:54.904250+0000","last_unstale":"2024-09-15T23:15:56.383425+0000","last_undegraded":"2024-09-15T23:15:56.383425+0000","last_fullsized":"2024-09-15T23:15:56.383425+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:43:33.055440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"81'6","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.276398+0000","last_change":"2024-09-15T23:15:53.895740+0000","last_active":"2024-09-15T23:15:56.276398+0000","last_peered":"2024-09-15T23:15:56.276398+0000","last_clean":"2024-09-15T23:15:56.276398+0000","last_became_active":"2024-09-15T23:15:53.895480+0000","last_became_peered":"2024-09-15T23:15:53.895480+0000","last_unstale":"2024-09-15T23:15:56.276398+0000","last_undegraded":"2024-09-15T23:15:56.276398+0000","last_fullsized":"2024-09-15T23:15:56.276398+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:05.057467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.276131+0000","last_change":"2024-09-15T23:15:53.893711+0000","last_active":"2024-09-15T23:15:56.276131+0000","last_peered":"2024-09-15T23:15:56.276131+0000","last_clean":"2024-09-15T23:15:56.276131+0000","last_became_active":"2024-09-15T23:15:53.893432+0000","last_became_peered":"2024-09-15T23:15:53.893432+0000","last_unstale":"2024-09-15T23:15:56.276131+0000","last_undegraded":"2024-09-15T23:15:56.276131+0000","last_fullsized":"2024-09-15T23:15:56.276131+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:58:01.036404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.878742+0000","last_change":"2024-09-15T23:15:52.878742+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.878742+0000","last_undegraded":"2024-09-15T23:15:52.878742+0000","last_fullsized":"2024-09-15T23:15:52.878742+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382734+0000","last_change":"2024-09-15T23:15:54.911495+0000","last_active":"2024-09-15T23:15:56.382734+0000","last_peered":"2024-09-15T23:15:56.382734+0000","last_clean":"2024-09-15T23:15:56.382734+0000","last_became_active":"2024-09-15T23:15:54.911165+0000","last_became_peered":"2024-09-15T23:15:54.911165+0000","last_unstale":"2024-09-15T23:15:56.382734+0000","last_undegraded":"2024-09-15T23:15:56.382734+0000","last_fullsized":"2024-09-15T23:15:56.382734+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:00:46.921868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.878729+0000","last_change":"2024-09-15T23:15:52.878729+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.878729+0000","last_undegraded":"2024-09-15T23:15:52.878729+0000","last_fullsized":"2024-09-15T23:15:52.878729+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383393+0000","last_change":"2024-09-15T23:15:54.899159+0000","last_active":"2024-09-15T23:15:56.383393+0000","last_peered":"2024-09-15T23:15:56.383393+0000","last_clean":"2024-09-15T23:15:56.383393+0000","last_became_active":"2024-09-15T23:15:54.898842+0000","last_became_peered":"2024-09-15T23:15:54.898842+0000","last_unstale":"2024-09-15T23:15:56.383393+0000","last_undegraded":"2024-09-15T23:15:56.383393+0000","last_fullsized":"2024-09-15T23:15:56.383393+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:23:49.789348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.878721+0000","last_change":"2024-09-15T23:15:52.878721+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.878721+0000","last_undegraded":"2024-09-15T23:15:52.878721+0000","last_fullsized":"2024-09-15T23:15:52.878721+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.880235+0000","last_change":"2024-09-15T23:15:52.880235+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.880235+0000","last_undegraded":"2024-09-15T23:15:52.880235+0000","last_fullsized":"2024-09-15T23:15:52.880235+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.875743+0000","last_change":"2024-09-15T23:15:52.875743+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.875743+0000","last_undegraded":"2024-09-15T23:15:52.875743+0000","last_fullsized":"2024-09-15T23:15:52.875743+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382925+0000","last_change":"2024-09-15T23:15:54.894455+0000","last_active":"2024-09-15T23:15:56.382925+0000","last_peered":"2024-09-15T23:15:56.382925+0000","last_clean":"2024-09-15T23:15:56.382925+0000","last_became_active":"2024-09-15T23:15:54.894157+0000","last_became_peered":"2024-09-15T23:15:54.894157+0000","last_unstale":"2024-09-15T23:15:56.382925+0000","last_undegraded":"2024-09-15T23:15:56.382925+0000","last_fullsized":"2024-09-15T23:15:56.382925+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:52.302621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.875754+0000","last_change":"2024-09-15T23:15:52.875754+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.875754+0000","last_undegraded":"2024-09-15T23:15:52.875754+0000","last_fullsized":"2024-09-15T23:15:52.875754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383121+0000","last_change":"2024-09-15T23:15:54.900984+0000","last_active":"2024-09-15T23:15:56.383121+0000","last_peered":"2024-09-15T23:15:56.383121+0000","last_clean":"2024-09-15T23:15:56.383121+0000","last_became_active":"2024-09-15T23:15:54.900709+0000","last_became_peered":"2024-09-15T23:15:54.900709+0000","last_unstale":"2024-09-15T23:15:56.383121+0000","last_undegraded":"2024-09-15T23:15:56.383121+0000","last_fullsized":"2024-09-15T23:15:56.383121+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:35:04.409834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.876188+0000","last_change":"2024-09-15T23:15:52.876188+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.876188+0000","last_undegraded":"2024-09-15T23:15:52.876188+0000","last_fullsized":"2024-09-15T23:15:52.876188+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.276226+0000","last_change":"2024-09-15T23:15:54.899731+0000","last_active":"2024-09-15T23:15:56.276226+0000","last_peered":"2024-09-15T23:15:56.276226+0000","last_clean":"2024-09-15T23:15:56.276226+0000","last_became_active":"2024-09-15T23:15:54.899453+0000","last_became_peered":"2024-09-15T23:15:54.899453+0000","last_unstale":"2024-09-15T23:15:56.276226+0000","last_undegraded":"2024-09-15T23:15:56.276226+0000","last_fullsized":"2024-09-15T23:15:56.276226+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:52.766645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.876047+0000","last_change":"2024-09-15T23:15:52.876047+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.876047+0000","last_undegraded":"2024-09-15T23:15:52.876047+0000","last_fullsized":"2024-09-15T23:15:52.876047+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.276158+0000","last_change":"2024-09-15T23:15:54.896709+0000","last_active":"2024-09-15T23:15:56.276158+0000","last_peered":"2024-09-15T23:15:56.276158+0000","last_clean":"2024-09-15T23:15:56.276158+0000","last_became_active":"2024-09-15T23:15:54.896326+0000","last_became_peered":"2024-09-15T23:15:54.896326+0000","last_unstale":"2024-09-15T23:15:56.276158+0000","last_undegraded":"2024-09-15T23:15:56.276158+0000","last_fullsized":"2024-09-15T23:15:56.276158+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:47:58.493900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.875687+0000","last_change":"2024-09-15T23:15:52.875687+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.875687+0000","last_undegraded":"2024-09-15T23:15:52.875687+0000","last_fullsized":"2024-09-15T23:15:52.875687+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383554+0000","last_change":"2024-09-15T23:15:54.897799+0000","last_active":"2024-09-15T23:15:56.383554+0000","last_peered":"2024-09-15T23:15:56.383554+0000","last_clean":"2024-09-15T23:15:56.383554+0000","last_became_active":"2024-09-15T23:15:54.897468+0000","last_became_peered":"2024-09-15T23:15:54.897468+0000","last_unstale":"2024-09-15T23:15:56.383554+0000","last_undegraded":"2024-09-15T23:15:56.383554+0000","last_fullsized":"2024-09-15T23:15:56.383554+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:04:08.287676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382587+0000","last_change":"2024-09-15T23:15:53.894527+0000","last_active":"2024-09-15T23:15:56.382587+0000","last_peered":"2024-09-15T23:15:56.382587+0000","last_clean":"2024-09-15T23:15:56.382587+0000","last_became_active":"2024-09-15T23:15:53.894233+0000","last_became_peered":"2024-09-15T23:15:53.894233+0000","last_unstale":"2024-09-15T23:15:56.382587+0000","last_undegraded":"2024-09-15T23:15:56.382587+0000","last_fullsized":"2024-09-15T23:15:56.382587+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:51:14.198694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383690+0000","last_change":"2024-09-15T23:15:54.904641+0000","last_active":"2024-09-15T23:15:56.383690+0000","last_peered":"2024-09-15T23:15:56.383690+0000","last_clean":"2024-09-15T23:15:56.383690+0000","last_became_active":"2024-09-15T23:15:54.904370+0000","last_became_peered":"2024-09-15T23:15:54.904370+0000","last_unstale":"2024-09-15T23:15:56.383690+0000","last_undegraded":"2024-09-15T23:15:56.383690+0000","last_fullsized":"2024-09-15T23:15:56.383690+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:33:50.355276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.878138+0000","last_change":"2024-09-15T23:15:52.878138+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.878138+0000","last_undegraded":"2024-09-15T23:15:52.878138+0000","last_fullsized":"2024-09-15T23:15:52.878138+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.878152+0000","last_change":"2024-09-15T23:15:52.878152+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.878152+0000","last_undegraded":"2024-09-15T23:15:52.878152+0000","last_fullsized":"2024-09-15T23:15:52.878152+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383459+0000","last_change":"2024-09-15T23:15:53.890515+0000","last_active":"2024-09-15T23:15:56.383459+0000","last_peered":"2024-09-15T23:15:56.383459+0000","last_clean":"2024-09-15T23:15:56.383459+0000","last_became_active":"2024-09-15T23:15:53.890230+0000","last_became_peered":"2024-09-15T23:15:53.890230+0000","last_unstale":"2024-09-15T23:15:56.383459+0000","last_undegraded":"2024-09-15T23:15:56.383459+0000","last_fullsized":"2024-09-15T23:15:56.383459+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:02.636477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383555+0000","last_change":"2024-09-15T23:15:53.895098+0000","last_active":"2024-09-15T23:15:56.383555+0000","last_peered":"2024-09-15T23:15:56.383555+0000","last_clean":"2024-09-15T23:15:56.383555+0000","last_became_active":"2024-09-15T23:15:53.893423+0000","last_became_peered":"2024-09-15T23:15:53.893423+0000","last_unstale":"2024-09-15T23:15:56.383555+0000","last_undegraded":"2024-09-15T23:15:56.383555+0000","last_fullsized":"2024-09-15T23:15:56.383555+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:05.970626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383220+0000","last_change":"2024-09-15T23:15:54.903195+0000","last_active":"2024-09-15T23:15:56.383220+0000","last_peered":"2024-09-15T23:15:56.383220+0000","last_clean":"2024-09-15T23:15:56.383220+0000","last_became_active":"2024-09-15T23:15:54.902860+0000","last_became_peered":"2024-09-15T23:15:54.902860+0000","last_unstale":"2024-09-15T23:15:56.383220+0000","last_undegraded":"2024-09-15T23:15:56.383220+0000","last_fullsized":"2024-09-15T23:15:56.383220+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:18:55.627155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382407+0000","last_change":"2024-09-15T23:15:53.897951+0000","last_active":"2024-09-15T23:15:56.382407+0000","last_peered":"2024-09-15T23:15:56.382407+0000","last_clean":"2024-09-15T23:15:56.382407+0000","last_became_active":"2024-09-15T23:15:53.897654+0000","last_became_peered":"2024-09-15T23:15:53.897654+0000","last_unstale":"2024-09-15T23:15:56.382407+0000","last_undegraded":"2024-09-15T23:15:56.382407+0000","last_fullsized":"2024-09-15T23:15:56.382407+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:52:21.447053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383263+0000","last_change":"2024-09-15T23:15:53.901460+0000","last_active":"2024-09-15T23:15:56.383263+0000","last_peered":"2024-09-15T23:15:56.383263+0000","last_clean":"2024-09-15T23:15:56.383263+0000","last_became_active":"2024-09-15T23:15:53.901261+0000","last_became_peered":"2024-09-15T23:15:53.901261+0000","last_unstale":"2024-09-15T23:15:56.383263+0000","last_undegraded":"2024-09-15T23:15:56.383263+0000","last_fullsized":"2024-09-15T23:15:56.383263+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:06.343575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.276260+0000","last_change":"2024-09-15T23:15:54.897440+0000","last_active":"2024-09-15T23:15:56.276260+0000","last_peered":"2024-09-15T23:15:56.276260+0000","last_clean":"2024-09-15T23:15:56.276260+0000","last_became_active":"2024-09-15T23:15:54.897175+0000","last_became_peered":"2024-09-15T23:15:54.897175+0000","last_unstale":"2024-09-15T23:15:56.276260+0000","last_undegraded":"2024-09-15T23:15:56.276260+0000","last_fullsized":"2024-09-15T23:15:56.276260+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:47:37.405707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.875198+0000","last_change":"2024-09-15T23:15:52.875198+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.875198+0000","last_undegraded":"2024-09-15T23:15:52.875198+0000","last_fullsized":"2024-09-15T23:15:52.875198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.876072+0000","last_change":"2024-09-15T23:15:52.876072+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.876072+0000","last_undegraded":"2024-09-15T23:15:52.876072+0000","last_fullsized":"2024-09-15T23:15:52.876072+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383109+0000","last_change":"2024-09-15T23:15:54.906530+0000","last_active":"2024-09-15T23:15:56.383109+0000","last_peered":"2024-09-15T23:15:56.383109+0000","last_clean":"2024-09-15T23:15:56.383109+0000","last_became_active":"2024-09-15T23:15:54.906238+0000","last_became_peered":"2024-09-15T23:15:54.906238+0000","last_unstale":"2024-09-15T23:15:56.383109+0000","last_undegraded":"2024-09-15T23:15:56.383109+0000","last_fullsized":"2024-09-15T23:15:56.383109+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:41:09.389540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.878091+0000","last_change":"2024-09-15T23:15:52.878091+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.878091+0000","last_undegraded":"2024-09-15T23:15:52.878091+0000","last_fullsized":"2024-09-15T23:15:52.878091+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":276,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T23:15:52.879325+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:15:52.879325+0000","last_peered":"2024-09-15T23:15:52.879325+0000","last_clean":"2024-09-15T23:15:52.879325+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:15:52.879325+0000","last_undegraded":"2024-09-15T23:15:52.879325+0000","last_fullsized":"2024-09-15T23:15:52.879325+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":56,"acting":56,"num_store_stats":4},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":1736,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":4042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476788,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40436,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331404,"statfs":{"total":96636764160,"available":96595357696,"internally_reserved":0,"allocated":950272,"data_stored":407641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476785,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40428,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331412,"statfs":{"total":96636764160,"available":96595365888,"internally_reserved":0,"allocated":937984,"data_stored":401824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476787,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36856,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334984,"statfs":{"total":96636764160,"available":96599023616,"internally_reserved":0,"allocated":1544192,"data_stored":998009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476787,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":950272,"data_stored":407641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542194,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":987136,"data_stored":422295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542194,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":991232,"data_stored":422329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542193,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36892,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334948,"statfs":{"total":96636764160,"available":96598986752,"internally_reserved":0,"allocated":1572864,"data_stored":1011141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542195,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":987136,"data_stored":421377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:15:58.168 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:15:58.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.303+0000 7f54c55d6640 1 Processor -- start 2024-09-15T23:15:58.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.303+0000 7f54c55d6640 1 -- start start 2024-09-15T23:15:58.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.303+0000 7f54c55d6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f54c00d23b0 0x7f54c00b87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:58.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.303+0000 7f54c55d6640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54c00d0e70 con 0x7f54c015ed20 2024-09-15T23:15:58.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.303+0000 7f54c55d6640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54c00d41c0 con 0x7f54c00b6970 2024-09-15T23:15:58.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.303+0000 7f54c55d6640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f54c00d35b0 con 0x7f54c00d23b0 2024-09-15T23:15:58.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.304+0000 7f54bf7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f54c00d23b0 0x7f54c00b87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:58.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.304+0000 7f54bf7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f54c00d23b0 0x7f54c00b87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53982/0 (socket says 172.21.15.123:53982) 2024-09-15T23:15:58.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.304+0000 7f54bf7fe640 1 -- 172.21.15.123:0/2299336144 learned_addr learned my addr 172.21.15.123:0/2299336144 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:58.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.304+0000 7f54beffd640 1 --1- 172.21.15.123:0/2299336144 >> v1:172.21.15.123:6789/0 conn(0x7f54c015ed20 0x7f54c00b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:44042/0 (socket says 172.21.15.123:44042) 2024-09-15T23:15:58.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.304+0000 7f54bf7fe640 1 -- 172.21.15.123:0/2299336144 >> v1:172.21.15.188:6789/0 conn(0x7f54c00b6970 legacy=0x7f54c00b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:58.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.304+0000 7f54bf7fe640 1 -- 172.21.15.123:0/2299336144 >> v1:172.21.15.123:6789/0 conn(0x7f54c015ed20 legacy=0x7f54c00b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:58.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.304+0000 7f54bf7fe640 1 -- 172.21.15.123:0/2299336144 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54c00d3890 con 0x7f54c00d23b0 2024-09-15T23:15:58.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.305+0000 7f54bf7fe640 1 --2- 172.21.15.123:0/2299336144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54c00d23b0 0x7f54c00b87e0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f54b8009e50 tx=0x7f54b802a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6219416747c99f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:58.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.305+0000 7f54be7fc640 1 -- 172.21.15.123:0/2299336144 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b8036070 con 0x7f54c00d23b0 2024-09-15T23:15:58.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.305+0000 7f54be7fc640 1 -- 172.21.15.123:0/2299336144 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54b8031600 con 0x7f54c00d23b0 2024-09-15T23:15:58.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.305+0000 7f54be7fc640 1 -- 172.21.15.123:0/2299336144 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b80319d0 con 0x7f54c00d23b0 2024-09-15T23:15:58.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.305+0000 7f54c55d6640 1 -- 172.21.15.123:0/2299336144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54c00d23b0 msgr2=0x7f54c00b87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:58.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.305+0000 7f54c55d6640 1 --2- 172.21.15.123:0/2299336144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54c00d23b0 0x7f54c00b87e0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f54b8009e50 tx=0x7f54b802a630 comp rx=0 tx=0).stop 2024-09-15T23:15:58.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.305+0000 7f54c55d6640 1 -- 172.21.15.123:0/2299336144 shutdown_connections 2024-09-15T23:15:58.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.305+0000 7f54c55d6640 1 --2- 172.21.15.123:0/2299336144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54c00d23b0 0x7f54c00b87e0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:58.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.305+0000 7f54c55d6640 1 -- 172.21.15.123:0/2299336144 >> 172.21.15.123:0/2299336144 conn(0x7f54c00d1260 msgr2=0x7f54c00d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:58.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.305+0000 7f54c55d6640 1 -- 172.21.15.123:0/2299336144 shutdown_connections 2024-09-15T23:15:58.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.305+0000 7f54c55d6640 1 -- 172.21.15.123:0/2299336144 wait complete. 2024-09-15T23:15:58.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.306+0000 7f54c55d6640 1 Processor -- start 2024-09-15T23:15:58.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.307+0000 7f54c55d6640 1 -- start start 2024-09-15T23:15:58.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.307+0000 7f54c55d6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f54c00b6970 0x7f54c0154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:58.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.307+0000 7f54c55d6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54c00d23b0 0x7f54c00ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:58.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.307+0000 7f54c55d6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54c015ed20 0x7f54c00ce620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:58.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.307+0000 7f54c55d6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f54c00d32a0 con 0x7f54c00d23b0 2024-09-15T23:15:58.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.307+0000 7f54c55d6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f54c00d3e50 con 0x7f54c00b6970 2024-09-15T23:15:58.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.307+0000 7f54c55d6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f54c015f100 con 0x7f54c015ed20 2024-09-15T23:15:58.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.308+0000 7f54b67fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54c00d23b0 0x7f54c00ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:58.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.308+0000 7f54b67fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54c00d23b0 0x7f54c00ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53992/0 (socket says 172.21.15.123:53992) 2024-09-15T23:15:58.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.308+0000 7f54b67fc640 1 -- 172.21.15.123:0/3998804384 learned_addr learned my addr 172.21.15.123:0/3998804384 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:58.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.308+0000 7f54beffd640 1 --2- 172.21.15.123:0/3998804384 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f54c00b6970 0x7f54c0154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:58.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.308+0000 7f54bf7fe640 1 --2- 172.21.15.123:0/3998804384 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54c015ed20 0x7f54c00ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:58.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.308+0000 7f54b67fc640 1 -- 172.21.15.123:0/3998804384 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54c015ed20 msgr2=0x7f54c00ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:58.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.308+0000 7f54b67fc640 1 --2- 172.21.15.123:0/3998804384 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54c015ed20 0x7f54c00ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:58.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.308+0000 7f54b67fc640 1 -- 172.21.15.123:0/3998804384 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f54c00b6970 msgr2=0x7f54c0154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:58.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.308+0000 7f54b67fc640 1 --2- 172.21.15.123:0/3998804384 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f54c00b6970 0x7f54c0154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:58.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.308+0000 7f54b67fc640 1 -- 172.21.15.123:0/3998804384 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54c01f4e00 con 0x7f54c00d23b0 2024-09-15T23:15:58.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.308+0000 7f54b67fc640 1 --2- 172.21.15.123:0/3998804384 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54c00d23b0 0x7f54c00ce0e0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f54a800c3c0 tx=0x7f54a800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:58.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.308+0000 7f54b7fff640 1 -- 172.21.15.123:0/3998804384 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a80052d0 con 0x7f54c00d23b0 2024-09-15T23:15:58.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.308+0000 7f54b7fff640 1 -- 172.21.15.123:0/3998804384 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54a8005490 con 0x7f54c00d23b0 2024-09-15T23:15:58.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.308+0000 7f54c55d6640 1 -- 172.21.15.123:0/3998804384 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54c01f50e0 con 0x7f54c00d23b0 2024-09-15T23:15:58.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.308+0000 7f54b7fff640 1 -- 172.21.15.123:0/3998804384 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a8007260 con 0x7f54c00d23b0 2024-09-15T23:15:58.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.308+0000 7f54c55d6640 1 -- 172.21.15.123:0/3998804384 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54c01f56a0 con 0x7f54c00d23b0 2024-09-15T23:15:58.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.309+0000 7f54c55d6640 1 -- 172.21.15.123:0/3998804384 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54c00b7010 con 0x7f54c00d23b0 2024-09-15T23:15:58.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.310+0000 7f54b7fff640 1 -- 172.21.15.123:0/3998804384 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f54a8007400 con 0x7f54c00d23b0 2024-09-15T23:15:58.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.310+0000 7f54b7fff640 1 --2- 172.21.15.123:0/3998804384 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f54a006c2b0 0x7f54a006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:58.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.310+0000 7f54b7fff640 1 -- 172.21.15.123:0/3998804384 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f54a808a7d0 con 0x7f54c00d23b0 2024-09-15T23:15:58.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.310+0000 7f54beffd640 1 --2- 172.21.15.123:0/3998804384 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f54a006c2b0 0x7f54a006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:58.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.311+0000 7f54beffd640 1 --2- 172.21.15.123:0/3998804384 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f54a006c2b0 0x7f54a006e770 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f54b0000f60 tx=0x7f54b0007e20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:58.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.314+0000 7f54b7fff640 1 -- 172.21.15.123:0/3998804384 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f54a8058980 con 0x7f54c00d23b0 2024-09-15T23:15:58.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.479+0000 7f54c55d6640 1 -- 172.21.15.123:0/3998804384 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f54c01f4bb0 con 0x7f54a006c2b0 2024-09-15T23:15:58.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.486+0000 7f54b7fff640 1 -- 172.21.15.123:0/3998804384 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245300 (secure 0 0 0) 0x7f54c01f4bb0 con 0x7f54a006c2b0 2024-09-15T23:15:58.489 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:58.490 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:15:58.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.488+0000 7f54c55d6640 1 -- 172.21.15.123:0/3998804384 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f54a006c2b0 msgr2=0x7f54a006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:58.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.488+0000 7f54c55d6640 1 --2- 172.21.15.123:0/3998804384 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f54a006c2b0 0x7f54a006e770 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f54b0000f60 tx=0x7f54b0007e20 comp rx=0 tx=0).stop 2024-09-15T23:15:58.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.488+0000 7f54c55d6640 1 -- 172.21.15.123:0/3998804384 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54c00d23b0 msgr2=0x7f54c00ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:58.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.488+0000 7f54c55d6640 1 --2- 172.21.15.123:0/3998804384 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54c00d23b0 0x7f54c00ce0e0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f54a800c3c0 tx=0x7f54a800c880 comp rx=0 tx=0).stop 2024-09-15T23:15:58.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.488+0000 7f54c55d6640 1 -- 172.21.15.123:0/3998804384 shutdown_connections 2024-09-15T23:15:58.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.488+0000 7f54c55d6640 1 --2- 172.21.15.123:0/3998804384 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54c015ed20 0x7f54c00ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:58.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.488+0000 7f54c55d6640 1 --2- 172.21.15.123:0/3998804384 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f54a006c2b0 0x7f54a006e770 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:58.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.488+0000 7f54c55d6640 1 --2- 172.21.15.123:0/3998804384 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54c00d23b0 0x7f54c00ce0e0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:58.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.488+0000 7f54c55d6640 1 --2- 172.21.15.123:0/3998804384 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f54c00b6970 0x7f54c0154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:58.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.488+0000 7f54c55d6640 1 -- 172.21.15.123:0/3998804384 >> 172.21.15.123:0/3998804384 conn(0x7f54c00d1260 msgr2=0x7f54c00b9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:58.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.488+0000 7f54c55d6640 1 -- 172.21.15.123:0/3998804384 shutdown_connections 2024-09-15T23:15:58.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.488+0000 7f54c55d6640 1 -- 172.21.15.123:0/3998804384 wait complete. 2024-09-15T23:15:58.500 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":193,"stamp":"2024-09-15T23:15:57.555049+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592104,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":172,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":122,"acting":122,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":85,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":295680,"kb_used_data":8712,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754679040,"statfs":{"total":773094113280,"available":772791336960,"internally_reserved":0,"allocated":8921088,"data_stored":4492257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":293654064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1736,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.682399"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382986+0000","last_change":"2024-09-15T23:15:54.895953+0000","last_active":"2024-09-15T23:15:56.382986+0000","last_peered":"2024-09-15T23:15:56.382986+0000","last_clean":"2024-09-15T23:15:56.382986+0000","last_became_active":"2024-09-15T23:15:54.895632+0000","last_became_peered":"2024-09-15T23:15:54.895632+0000","last_unstale":"2024-09-15T23:15:56.382986+0000","last_undegraded":"2024-09-15T23:15:56.382986+0000","last_fullsized":"2024-09-15T23:15:56.382986+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:30:23.433151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382408+0000","last_change":"2024-09-15T23:15:54.895888+0000","last_active":"2024-09-15T23:15:56.382408+0000","last_peered":"2024-09-15T23:15:56.382408+0000","last_clean":"2024-09-15T23:15:56.382408+0000","last_became_active":"2024-09-15T23:15:54.895558+0000","last_became_peered":"2024-09-15T23:15:54.895558+0000","last_unstale":"2024-09-15T23:15:56.382408+0000","last_undegraded":"2024-09-15T23:15:56.382408+0000","last_fullsized":"2024-09-15T23:15:56.382408+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:09:03.821475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382636+0000","last_change":"2024-09-15T23:15:54.904818+0000","last_active":"2024-09-15T23:15:56.382636+0000","last_peered":"2024-09-15T23:15:56.382636+0000","last_clean":"2024-09-15T23:15:56.382636+0000","last_became_active":"2024-09-15T23:15:54.903868+0000","last_became_peered":"2024-09-15T23:15:54.903868+0000","last_unstale":"2024-09-15T23:15:56.382636+0000","last_undegraded":"2024-09-15T23:15:56.382636+0000","last_fullsized":"2024-09-15T23:15:56.382636+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:37.663336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383920+0000","last_change":"2024-09-15T23:15:54.901116+0000","last_active":"2024-09-15T23:15:56.383920+0000","last_peered":"2024-09-15T23:15:56.383920+0000","last_clean":"2024-09-15T23:15:56.383920+0000","last_became_active":"2024-09-15T23:15:54.900244+0000","last_became_peered":"2024-09-15T23:15:54.900244+0000","last_unstale":"2024-09-15T23:15:56.383920+0000","last_undegraded":"2024-09-15T23:15:56.383920+0000","last_fullsized":"2024-09-15T23:15:56.383920+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:54.143040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383622+0000","last_change":"2024-09-15T23:15:54.899743+0000","last_active":"2024-09-15T23:15:56.383622+0000","last_peered":"2024-09-15T23:15:56.383622+0000","last_clean":"2024-09-15T23:15:56.383622+0000","last_became_active":"2024-09-15T23:15:54.899474+0000","last_became_peered":"2024-09-15T23:15:54.899474+0000","last_unstale":"2024-09-15T23:15:56.383622+0000","last_undegraded":"2024-09-15T23:15:56.383622+0000","last_fullsized":"2024-09-15T23:15:56.383622+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:47:21.466200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382646+0000","last_change":"2024-09-15T23:15:54.895898+0000","last_active":"2024-09-15T23:15:56.382646+0000","last_peered":"2024-09-15T23:15:56.382646+0000","last_clean":"2024-09-15T23:15:56.382646+0000","last_became_active":"2024-09-15T23:15:54.895600+0000","last_became_peered":"2024-09-15T23:15:54.895600+0000","last_unstale":"2024-09-15T23:15:56.382646+0000","last_undegraded":"2024-09-15T23:15:56.382646+0000","last_fullsized":"2024-09-15T23:15:56.382646+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:05:41.623242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382898+0000","last_change":"2024-09-15T23:15:54.907811+0000","last_active":"2024-09-15T23:15:56.382898+0000","last_peered":"2024-09-15T23:15:56.382898+0000","last_clean":"2024-09-15T23:15:56.382898+0000","last_became_active":"2024-09-15T23:15:54.906473+0000","last_became_peered":"2024-09-15T23:15:54.906473+0000","last_unstale":"2024-09-15T23:15:56.382898+0000","last_undegraded":"2024-09-15T23:15:56.382898+0000","last_fullsized":"2024-09-15T23:15:56.382898+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:41.289668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382377+0000","last_change":"2024-09-15T23:15:54.901163+0000","last_active":"2024-09-15T23:15:56.382377+0000","last_peered":"2024-09-15T23:15:56.382377+0000","last_clean":"2024-09-15T23:15:56.382377+0000","last_became_active":"2024-09-15T23:15:54.900857+0000","last_became_peered":"2024-09-15T23:15:54.900857+0000","last_unstale":"2024-09-15T23:15:56.382377+0000","last_undegraded":"2024-09-15T23:15:56.382377+0000","last_fullsized":"2024-09-15T23:15:56.382377+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:21.515224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382867+0000","last_change":"2024-09-15T23:15:54.903632+0000","last_active":"2024-09-15T23:15:56.382867+0000","last_peered":"2024-09-15T23:15:56.382867+0000","last_clean":"2024-09-15T23:15:56.382867+0000","last_became_active":"2024-09-15T23:15:54.903372+0000","last_became_peered":"2024-09-15T23:15:54.903372+0000","last_unstale":"2024-09-15T23:15:56.382867+0000","last_undegraded":"2024-09-15T23:15:56.382867+0000","last_fullsized":"2024-09-15T23:15:56.382867+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:24:41.298145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383611+0000","last_change":"2024-09-15T23:15:54.913958+0000","last_active":"2024-09-15T23:15:56.383611+0000","last_peered":"2024-09-15T23:15:56.383611+0000","last_clean":"2024-09-15T23:15:56.383611+0000","last_became_active":"2024-09-15T23:15:54.913620+0000","last_became_peered":"2024-09-15T23:15:54.913620+0000","last_unstale":"2024-09-15T23:15:56.383611+0000","last_undegraded":"2024-09-15T23:15:56.383611+0000","last_fullsized":"2024-09-15T23:15:56.383611+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:54:51.854826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382795+0000","last_change":"2024-09-15T23:15:54.908104+0000","last_active":"2024-09-15T23:15:56.382795+0000","last_peered":"2024-09-15T23:15:56.382795+0000","last_clean":"2024-09-15T23:15:56.382795+0000","last_became_active":"2024-09-15T23:15:54.907745+0000","last_became_peered":"2024-09-15T23:15:54.907745+0000","last_unstale":"2024-09-15T23:15:56.382795+0000","last_undegraded":"2024-09-15T23:15:56.382795+0000","last_fullsized":"2024-09-15T23:15:56.382795+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:25.144212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383665+0000","last_change":"2024-09-15T23:15:54.905358+0000","last_active":"2024-09-15T23:15:56.383665+0000","last_peered":"2024-09-15T23:15:56.383665+0000","last_clean":"2024-09-15T23:15:56.383665+0000","last_became_active":"2024-09-15T23:15:54.905065+0000","last_became_peered":"2024-09-15T23:15:54.905065+0000","last_unstale":"2024-09-15T23:15:56.383665+0000","last_undegraded":"2024-09-15T23:15:56.383665+0000","last_fullsized":"2024-09-15T23:15:56.383665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:44.715419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382812+0000","last_change":"2024-09-15T23:15:54.901618+0000","last_active":"2024-09-15T23:15:56.382812+0000","last_peered":"2024-09-15T23:15:56.382812+0000","last_clean":"2024-09-15T23:15:56.382812+0000","last_became_active":"2024-09-15T23:15:54.901320+0000","last_became_peered":"2024-09-15T23:15:54.901320+0000","last_unstale":"2024-09-15T23:15:56.382812+0000","last_undegraded":"2024-09-15T23:15:56.382812+0000","last_fullsized":"2024-09-15T23:15:56.382812+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:27:08.045770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.876492+0000","last_change":"2024-09-15T23:15:52.876492+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.876492+0000","last_undegraded":"2024-09-15T23:15:52.876492+0000","last_fullsized":"2024-09-15T23:15:52.876492+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383939+0000","last_change":"2024-09-15T23:15:54.906698+0000","last_active":"2024-09-15T23:15:56.383939+0000","last_peered":"2024-09-15T23:15:56.383939+0000","last_clean":"2024-09-15T23:15:56.383939+0000","last_became_active":"2024-09-15T23:15:54.906420+0000","last_became_peered":"2024-09-15T23:15:54.906420+0000","last_unstale":"2024-09-15T23:15:56.383939+0000","last_undegraded":"2024-09-15T23:15:56.383939+0000","last_fullsized":"2024-09-15T23:15:56.383939+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:23.345381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1e","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383715+0000","last_change":"2024-09-15T23:15:53.899891+0000","last_active":"2024-09-15T23:15:56.383715+0000","last_peered":"2024-09-15T23:15:56.383715+0000","last_clean":"2024-09-15T23:15:56.383715+0000","last_became_active":"2024-09-15T23:15:53.899625+0000","last_became_peered":"2024-09-15T23:15:53.899625+0000","last_unstale":"2024-09-15T23:15:56.383715+0000","last_undegraded":"2024-09-15T23:15:56.383715+0000","last_fullsized":"2024-09-15T23:15:56.383715+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:25:50.828449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.880276+0000","last_change":"2024-09-15T23:15:52.880276+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.880276+0000","last_undegraded":"2024-09-15T23:15:52.880276+0000","last_fullsized":"2024-09-15T23:15:52.880276+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.876682+0000","last_change":"2024-09-15T23:15:52.876682+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.876682+0000","last_undegraded":"2024-09-15T23:15:52.876682+0000","last_fullsized":"2024-09-15T23:15:52.876682+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382496+0000","last_change":"2024-09-15T23:15:53.898588+0000","last_active":"2024-09-15T23:15:56.382496+0000","last_peered":"2024-09-15T23:15:56.382496+0000","last_clean":"2024-09-15T23:15:56.382496+0000","last_became_active":"2024-09-15T23:15:53.898307+0000","last_became_peered":"2024-09-15T23:15:53.898307+0000","last_unstale":"2024-09-15T23:15:56.382496+0000","last_undegraded":"2024-09-15T23:15:56.382496+0000","last_fullsized":"2024-09-15T23:15:56.382496+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:38:25.728830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.879239+0000","last_change":"2024-09-15T23:15:52.879239+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.879239+0000","last_undegraded":"2024-09-15T23:15:52.879239+0000","last_fullsized":"2024-09-15T23:15:52.879239+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.275987+0000","last_change":"2024-09-15T23:15:54.911292+0000","last_active":"2024-09-15T23:15:56.275987+0000","last_peered":"2024-09-15T23:15:56.275987+0000","last_clean":"2024-09-15T23:15:56.275987+0000","last_became_active":"2024-09-15T23:15:54.910952+0000","last_became_peered":"2024-09-15T23:15:54.910952+0000","last_unstale":"2024-09-15T23:15:56.275987+0000","last_undegraded":"2024-09-15T23:15:56.275987+0000","last_fullsized":"2024-09-15T23:15:56.275987+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:42.049462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.276093+0000","last_change":"2024-09-15T23:15:53.900588+0000","last_active":"2024-09-15T23:15:56.276093+0000","last_peered":"2024-09-15T23:15:56.276093+0000","last_clean":"2024-09-15T23:15:56.276093+0000","last_became_active":"2024-09-15T23:15:53.900366+0000","last_became_peered":"2024-09-15T23:15:53.900366+0000","last_unstale":"2024-09-15T23:15:56.276093+0000","last_undegraded":"2024-09-15T23:15:56.276093+0000","last_fullsized":"2024-09-15T23:15:56.276093+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:24.362527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382521+0000","last_change":"2024-09-15T23:15:54.906993+0000","last_active":"2024-09-15T23:15:56.382521+0000","last_peered":"2024-09-15T23:15:56.382521+0000","last_clean":"2024-09-15T23:15:56.382521+0000","last_became_active":"2024-09-15T23:15:54.906662+0000","last_became_peered":"2024-09-15T23:15:54.906662+0000","last_unstale":"2024-09-15T23:15:56.382521+0000","last_undegraded":"2024-09-15T23:15:56.382521+0000","last_fullsized":"2024-09-15T23:15:56.382521+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:20.992800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382206+0000","last_change":"2024-09-15T23:15:53.897383+0000","last_active":"2024-09-15T23:15:56.382206+0000","last_peered":"2024-09-15T23:15:56.382206+0000","last_clean":"2024-09-15T23:15:56.382206+0000","last_became_active":"2024-09-15T23:15:53.897092+0000","last_became_peered":"2024-09-15T23:15:53.897092+0000","last_unstale":"2024-09-15T23:15:56.382206+0000","last_undegraded":"2024-09-15T23:15:56.382206+0000","last_fullsized":"2024-09-15T23:15:56.382206+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:10.169770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.880676+0000","last_change":"2024-09-15T23:15:52.880676+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.880676+0000","last_undegraded":"2024-09-15T23:15:52.880676+0000","last_fullsized":"2024-09-15T23:15:52.880676+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.876565+0000","last_change":"2024-09-15T23:15:52.876565+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.876565+0000","last_undegraded":"2024-09-15T23:15:52.876565+0000","last_fullsized":"2024-09-15T23:15:52.876565+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"81'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383356+0000","last_change":"2024-09-15T23:15:53.895758+0000","last_active":"2024-09-15T23:15:56.383356+0000","last_peered":"2024-09-15T23:15:56.383356+0000","last_clean":"2024-09-15T23:15:56.383356+0000","last_became_active":"2024-09-15T23:15:53.895493+0000","last_became_peered":"2024-09-15T23:15:53.895493+0000","last_unstale":"2024-09-15T23:15:56.383356+0000","last_undegraded":"2024-09-15T23:15:56.383356+0000","last_fullsized":"2024-09-15T23:15:56.383356+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:54:45.779651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383425+0000","last_change":"2024-09-15T23:15:54.904531+0000","last_active":"2024-09-15T23:15:56.383425+0000","last_peered":"2024-09-15T23:15:56.383425+0000","last_clean":"2024-09-15T23:15:56.383425+0000","last_became_active":"2024-09-15T23:15:54.904250+0000","last_became_peered":"2024-09-15T23:15:54.904250+0000","last_unstale":"2024-09-15T23:15:56.383425+0000","last_undegraded":"2024-09-15T23:15:56.383425+0000","last_fullsized":"2024-09-15T23:15:56.383425+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:43:33.055440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"81'6","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.276398+0000","last_change":"2024-09-15T23:15:53.895740+0000","last_active":"2024-09-15T23:15:56.276398+0000","last_peered":"2024-09-15T23:15:56.276398+0000","last_clean":"2024-09-15T23:15:56.276398+0000","last_became_active":"2024-09-15T23:15:53.895480+0000","last_became_peered":"2024-09-15T23:15:53.895480+0000","last_unstale":"2024-09-15T23:15:56.276398+0000","last_undegraded":"2024-09-15T23:15:56.276398+0000","last_fullsized":"2024-09-15T23:15:56.276398+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:05.057467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.276131+0000","last_change":"2024-09-15T23:15:53.893711+0000","last_active":"2024-09-15T23:15:56.276131+0000","last_peered":"2024-09-15T23:15:56.276131+0000","last_clean":"2024-09-15T23:15:56.276131+0000","last_became_active":"2024-09-15T23:15:53.893432+0000","last_became_peered":"2024-09-15T23:15:53.893432+0000","last_unstale":"2024-09-15T23:15:56.276131+0000","last_undegraded":"2024-09-15T23:15:56.276131+0000","last_fullsized":"2024-09-15T23:15:56.276131+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:58:01.036404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.878742+0000","last_change":"2024-09-15T23:15:52.878742+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.878742+0000","last_undegraded":"2024-09-15T23:15:52.878742+0000","last_fullsized":"2024-09-15T23:15:52.878742+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382734+0000","last_change":"2024-09-15T23:15:54.911495+0000","last_active":"2024-09-15T23:15:56.382734+0000","last_peered":"2024-09-15T23:15:56.382734+0000","last_clean":"2024-09-15T23:15:56.382734+0000","last_became_active":"2024-09-15T23:15:54.911165+0000","last_became_peered":"2024-09-15T23:15:54.911165+0000","last_unstale":"2024-09-15T23:15:56.382734+0000","last_undegraded":"2024-09-15T23:15:56.382734+0000","last_fullsized":"2024-09-15T23:15:56.382734+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:00:46.921868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.878729+0000","last_change":"2024-09-15T23:15:52.878729+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.878729+0000","last_undegraded":"2024-09-15T23:15:52.878729+0000","last_fullsized":"2024-09-15T23:15:52.878729+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383393+0000","last_change":"2024-09-15T23:15:54.899159+0000","last_active":"2024-09-15T23:15:56.383393+0000","last_peered":"2024-09-15T23:15:56.383393+0000","last_clean":"2024-09-15T23:15:56.383393+0000","last_became_active":"2024-09-15T23:15:54.898842+0000","last_became_peered":"2024-09-15T23:15:54.898842+0000","last_unstale":"2024-09-15T23:15:56.383393+0000","last_undegraded":"2024-09-15T23:15:56.383393+0000","last_fullsized":"2024-09-15T23:15:56.383393+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:23:49.789348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.878721+0000","last_change":"2024-09-15T23:15:52.878721+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.878721+0000","last_undegraded":"2024-09-15T23:15:52.878721+0000","last_fullsized":"2024-09-15T23:15:52.878721+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.880235+0000","last_change":"2024-09-15T23:15:52.880235+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.880235+0000","last_undegraded":"2024-09-15T23:15:52.880235+0000","last_fullsized":"2024-09-15T23:15:52.880235+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.875743+0000","last_change":"2024-09-15T23:15:52.875743+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.875743+0000","last_undegraded":"2024-09-15T23:15:52.875743+0000","last_fullsized":"2024-09-15T23:15:52.875743+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382925+0000","last_change":"2024-09-15T23:15:54.894455+0000","last_active":"2024-09-15T23:15:56.382925+0000","last_peered":"2024-09-15T23:15:56.382925+0000","last_clean":"2024-09-15T23:15:56.382925+0000","last_became_active":"2024-09-15T23:15:54.894157+0000","last_became_peered":"2024-09-15T23:15:54.894157+0000","last_unstale":"2024-09-15T23:15:56.382925+0000","last_undegraded":"2024-09-15T23:15:56.382925+0000","last_fullsized":"2024-09-15T23:15:56.382925+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:52.302621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.875754+0000","last_change":"2024-09-15T23:15:52.875754+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.875754+0000","last_undegraded":"2024-09-15T23:15:52.875754+0000","last_fullsized":"2024-09-15T23:15:52.875754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383121+0000","last_change":"2024-09-15T23:15:54.900984+0000","last_active":"2024-09-15T23:15:56.383121+0000","last_peered":"2024-09-15T23:15:56.383121+0000","last_clean":"2024-09-15T23:15:56.383121+0000","last_became_active":"2024-09-15T23:15:54.900709+0000","last_became_peered":"2024-09-15T23:15:54.900709+0000","last_unstale":"2024-09-15T23:15:56.383121+0000","last_undegraded":"2024-09-15T23:15:56.383121+0000","last_fullsized":"2024-09-15T23:15:56.383121+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:35:04.409834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.876188+0000","last_change":"2024-09-15T23:15:52.876188+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.876188+0000","last_undegraded":"2024-09-15T23:15:52.876188+0000","last_fullsized":"2024-09-15T23:15:52.876188+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.276226+0000","last_change":"2024-09-15T23:15:54.899731+0000","last_active":"2024-09-15T23:15:56.276226+0000","last_peered":"2024-09-15T23:15:56.276226+0000","last_clean":"2024-09-15T23:15:56.276226+0000","last_became_active":"2024-09-15T23:15:54.899453+0000","last_became_peered":"2024-09-15T23:15:54.899453+0000","last_unstale":"2024-09-15T23:15:56.276226+0000","last_undegraded":"2024-09-15T23:15:56.276226+0000","last_fullsized":"2024-09-15T23:15:56.276226+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:52.766645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.876047+0000","last_change":"2024-09-15T23:15:52.876047+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.876047+0000","last_undegraded":"2024-09-15T23:15:52.876047+0000","last_fullsized":"2024-09-15T23:15:52.876047+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.276158+0000","last_change":"2024-09-15T23:15:54.896709+0000","last_active":"2024-09-15T23:15:56.276158+0000","last_peered":"2024-09-15T23:15:56.276158+0000","last_clean":"2024-09-15T23:15:56.276158+0000","last_became_active":"2024-09-15T23:15:54.896326+0000","last_became_peered":"2024-09-15T23:15:54.896326+0000","last_unstale":"2024-09-15T23:15:56.276158+0000","last_undegraded":"2024-09-15T23:15:56.276158+0000","last_fullsized":"2024-09-15T23:15:56.276158+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:47:58.493900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.875687+0000","last_change":"2024-09-15T23:15:52.875687+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.875687+0000","last_undegraded":"2024-09-15T23:15:52.875687+0000","last_fullsized":"2024-09-15T23:15:52.875687+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383554+0000","last_change":"2024-09-15T23:15:54.897799+0000","last_active":"2024-09-15T23:15:56.383554+0000","last_peered":"2024-09-15T23:15:56.383554+0000","last_clean":"2024-09-15T23:15:56.383554+0000","last_became_active":"2024-09-15T23:15:54.897468+0000","last_became_peered":"2024-09-15T23:15:54.897468+0000","last_unstale":"2024-09-15T23:15:56.383554+0000","last_undegraded":"2024-09-15T23:15:56.383554+0000","last_fullsized":"2024-09-15T23:15:56.383554+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:04:08.287676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382587+0000","last_change":"2024-09-15T23:15:53.894527+0000","last_active":"2024-09-15T23:15:56.382587+0000","last_peered":"2024-09-15T23:15:56.382587+0000","last_clean":"2024-09-15T23:15:56.382587+0000","last_became_active":"2024-09-15T23:15:53.894233+0000","last_became_peered":"2024-09-15T23:15:53.894233+0000","last_unstale":"2024-09-15T23:15:56.382587+0000","last_undegraded":"2024-09-15T23:15:56.382587+0000","last_fullsized":"2024-09-15T23:15:56.382587+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:51:14.198694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383690+0000","last_change":"2024-09-15T23:15:54.904641+0000","last_active":"2024-09-15T23:15:56.383690+0000","last_peered":"2024-09-15T23:15:56.383690+0000","last_clean":"2024-09-15T23:15:56.383690+0000","last_became_active":"2024-09-15T23:15:54.904370+0000","last_became_peered":"2024-09-15T23:15:54.904370+0000","last_unstale":"2024-09-15T23:15:56.383690+0000","last_undegraded":"2024-09-15T23:15:56.383690+0000","last_fullsized":"2024-09-15T23:15:56.383690+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:33:50.355276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.878138+0000","last_change":"2024-09-15T23:15:52.878138+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.878138+0000","last_undegraded":"2024-09-15T23:15:52.878138+0000","last_fullsized":"2024-09-15T23:15:52.878138+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.878152+0000","last_change":"2024-09-15T23:15:52.878152+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.878152+0000","last_undegraded":"2024-09-15T23:15:52.878152+0000","last_fullsized":"2024-09-15T23:15:52.878152+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383459+0000","last_change":"2024-09-15T23:15:53.890515+0000","last_active":"2024-09-15T23:15:56.383459+0000","last_peered":"2024-09-15T23:15:56.383459+0000","last_clean":"2024-09-15T23:15:56.383459+0000","last_became_active":"2024-09-15T23:15:53.890230+0000","last_became_peered":"2024-09-15T23:15:53.890230+0000","last_unstale":"2024-09-15T23:15:56.383459+0000","last_undegraded":"2024-09-15T23:15:56.383459+0000","last_fullsized":"2024-09-15T23:15:56.383459+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:02.636477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383555+0000","last_change":"2024-09-15T23:15:53.895098+0000","last_active":"2024-09-15T23:15:56.383555+0000","last_peered":"2024-09-15T23:15:56.383555+0000","last_clean":"2024-09-15T23:15:56.383555+0000","last_became_active":"2024-09-15T23:15:53.893423+0000","last_became_peered":"2024-09-15T23:15:53.893423+0000","last_unstale":"2024-09-15T23:15:56.383555+0000","last_undegraded":"2024-09-15T23:15:56.383555+0000","last_fullsized":"2024-09-15T23:15:56.383555+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:05.970626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383220+0000","last_change":"2024-09-15T23:15:54.903195+0000","last_active":"2024-09-15T23:15:56.383220+0000","last_peered":"2024-09-15T23:15:56.383220+0000","last_clean":"2024-09-15T23:15:56.383220+0000","last_became_active":"2024-09-15T23:15:54.902860+0000","last_became_peered":"2024-09-15T23:15:54.902860+0000","last_unstale":"2024-09-15T23:15:56.383220+0000","last_undegraded":"2024-09-15T23:15:56.383220+0000","last_fullsized":"2024-09-15T23:15:56.383220+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:18:55.627155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382407+0000","last_change":"2024-09-15T23:15:53.897951+0000","last_active":"2024-09-15T23:15:56.382407+0000","last_peered":"2024-09-15T23:15:56.382407+0000","last_clean":"2024-09-15T23:15:56.382407+0000","last_became_active":"2024-09-15T23:15:53.897654+0000","last_became_peered":"2024-09-15T23:15:53.897654+0000","last_unstale":"2024-09-15T23:15:56.382407+0000","last_undegraded":"2024-09-15T23:15:56.382407+0000","last_fullsized":"2024-09-15T23:15:56.382407+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:52:21.447053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383263+0000","last_change":"2024-09-15T23:15:53.901460+0000","last_active":"2024-09-15T23:15:56.383263+0000","last_peered":"2024-09-15T23:15:56.383263+0000","last_clean":"2024-09-15T23:15:56.383263+0000","last_became_active":"2024-09-15T23:15:53.901261+0000","last_became_peered":"2024-09-15T23:15:53.901261+0000","last_unstale":"2024-09-15T23:15:56.383263+0000","last_undegraded":"2024-09-15T23:15:56.383263+0000","last_fullsized":"2024-09-15T23:15:56.383263+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:06.343575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.276260+0000","last_change":"2024-09-15T23:15:54.897440+0000","last_active":"2024-09-15T23:15:56.276260+0000","last_peered":"2024-09-15T23:15:56.276260+0000","last_clean":"2024-09-15T23:15:56.276260+0000","last_became_active":"2024-09-15T23:15:54.897175+0000","last_became_peered":"2024-09-15T23:15:54.897175+0000","last_unstale":"2024-09-15T23:15:56.276260+0000","last_undegraded":"2024-09-15T23:15:56.276260+0000","last_fullsized":"2024-09-15T23:15:56.276260+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:47:37.405707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.875198+0000","last_change":"2024-09-15T23:15:52.875198+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.875198+0000","last_undegraded":"2024-09-15T23:15:52.875198+0000","last_fullsized":"2024-09-15T23:15:52.875198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.876072+0000","last_change":"2024-09-15T23:15:52.876072+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.876072+0000","last_undegraded":"2024-09-15T23:15:52.876072+0000","last_fullsized":"2024-09-15T23:15:52.876072+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383109+0000","last_change":"2024-09-15T23:15:54.906530+0000","last_active":"2024-09-15T23:15:56.383109+0000","last_peered":"2024-09-15T23:15:56.383109+0000","last_clean":"2024-09-15T23:15:56.383109+0000","last_became_active":"2024-09-15T23:15:54.906238+0000","last_became_peered":"2024-09-15T23:15:54.906238+0000","last_unstale":"2024-09-15T23:15:56.383109+0000","last_undegraded":"2024-09-15T23:15:56.383109+0000","last_fullsized":"2024-09-15T23:15:56.383109+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:41:09.389540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.878091+0000","last_change":"2024-09-15T23:15:52.878091+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.878091+0000","last_undegraded":"2024-09-15T23:15:52.878091+0000","last_fullsized":"2024-09-15T23:15:52.878091+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":276,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T23:15:52.879325+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:15:52.879325+0000","last_peered":"2024-09-15T23:15:52.879325+0000","last_clean":"2024-09-15T23:15:52.879325+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:15:52.879325+0000","last_undegraded":"2024-09-15T23:15:52.879325+0000","last_fullsized":"2024-09-15T23:15:52.879325+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":56,"acting":56,"num_store_stats":4},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":1736,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":4042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476788,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40436,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331404,"statfs":{"total":96636764160,"available":96595357696,"internally_reserved":0,"allocated":950272,"data_stored":407641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476785,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40428,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331412,"statfs":{"total":96636764160,"available":96595365888,"internally_reserved":0,"allocated":937984,"data_stored":401824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476787,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36856,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334984,"statfs":{"total":96636764160,"available":96599023616,"internally_reserved":0,"allocated":1544192,"data_stored":998009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476787,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":950272,"data_stored":407641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542194,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":987136,"data_stored":422295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542194,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":991232,"data_stored":422329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542193,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36892,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334948,"statfs":{"total":96636764160,"available":96598986752,"internally_reserved":0,"allocated":1572864,"data_stored":1011141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542195,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":987136,"data_stored":421377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:15:58.550 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3f is not active+clean 2024-09-15T23:15:58.551 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:15:53.872244+0000', 'last_change': '2024-09-15T23:15:53.872244+0000', 'last_active': '2024-09-15T23:15:53.872244+0000', 'last_peered': '2024-09-15T23:15:53.872244+0000', 'last_clean': '2024-09-15T23:15:53.872244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:53.872244+0000', 'last_undegraded': '2024-09-15T23:15:53.872244+0000', 'last_fullsized': '2024-09-15T23:15:53.872244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:15:58.551 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3e is not active+clean 2024-09-15T23:15:58.551 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:15:53.872244+0000', 'last_change': '2024-09-15T23:15:53.872244+0000', 'last_active': '2024-09-15T23:15:53.872244+0000', 'last_peered': '2024-09-15T23:15:53.872244+0000', 'last_clean': '2024-09-15T23:15:53.872244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:53.872244+0000', 'last_undegraded': '2024-09-15T23:15:53.872244+0000', 'last_fullsized': '2024-09-15T23:15:53.872244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:15:58.551 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3a is not active+clean 2024-09-15T23:15:58.551 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:15:53.872244+0000', 'last_change': '2024-09-15T23:15:53.872244+0000', 'last_active': '2024-09-15T23:15:53.872244+0000', 'last_peered': '2024-09-15T23:15:53.872244+0000', 'last_clean': '2024-09-15T23:15:53.872244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:53.872244+0000', 'last_undegraded': '2024-09-15T23:15:53.872244+0000', 'last_fullsized': '2024-09-15T23:15:53.872244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:15:58.551 INFO:tasks.ceph.ceph_manager.ceph:PG 11.39 is not active+clean 2024-09-15T23:15:58.551 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:15:53.872244+0000', 'last_change': '2024-09-15T23:15:53.872244+0000', 'last_active': '2024-09-15T23:15:53.872244+0000', 'last_peered': '2024-09-15T23:15:53.872244+0000', 'last_clean': '2024-09-15T23:15:53.872244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:53.872244+0000', 'last_undegraded': '2024-09-15T23:15:53.872244+0000', 'last_fullsized': '2024-09-15T23:15:53.872244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:15:58.551 INFO:tasks.ceph.ceph_manager.ceph:PG 11.38 is not active+clean 2024-09-15T23:15:58.552 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:15:53.872244+0000', 'last_change': '2024-09-15T23:15:53.872244+0000', 'last_active': '2024-09-15T23:15:53.872244+0000', 'last_peered': '2024-09-15T23:15:53.872244+0000', 'last_clean': '2024-09-15T23:15:53.872244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:53.872244+0000', 'last_undegraded': '2024-09-15T23:15:53.872244+0000', 'last_fullsized': '2024-09-15T23:15:53.872244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:15:58.552 INFO:tasks.ceph.ceph_manager.ceph:PG 11.36 is not active+clean 2024-09-15T23:15:58.552 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:15:53.872244+0000', 'last_change': '2024-09-15T23:15:53.872244+0000', 'last_active': '2024-09-15T23:15:53.872244+0000', 'last_peered': '2024-09-15T23:15:53.872244+0000', 'last_clean': '2024-09-15T23:15:53.872244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:53.872244+0000', 'last_undegraded': '2024-09-15T23:15:53.872244+0000', 'last_fullsized': '2024-09-15T23:15:53.872244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:15:58.552 INFO:tasks.ceph.ceph_manager.ceph:PG 11.35 is not active+clean 2024-09-15T23:15:58.552 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:15:53.872244+0000', 'last_change': '2024-09-15T23:15:53.872244+0000', 'last_active': '2024-09-15T23:15:53.872244+0000', 'last_peered': '2024-09-15T23:15:53.872244+0000', 'last_clean': '2024-09-15T23:15:53.872244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:53.872244+0000', 'last_undegraded': '2024-09-15T23:15:53.872244+0000', 'last_fullsized': '2024-09-15T23:15:53.872244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:15:58.552 INFO:tasks.ceph.ceph_manager.ceph:PG 11.30 is not active+clean 2024-09-15T23:15:58.552 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:15:53.872244+0000', 'last_change': '2024-09-15T23:15:53.872244+0000', 'last_active': '2024-09-15T23:15:53.872244+0000', 'last_peered': '2024-09-15T23:15:53.872244+0000', 'last_clean': '2024-09-15T23:15:53.872244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:53.872244+0000', 'last_undegraded': '2024-09-15T23:15:53.872244+0000', 'last_fullsized': '2024-09-15T23:15:53.872244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:15:58.552 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2d is not active+clean 2024-09-15T23:15:58.552 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:15:53.872244+0000', 'last_change': '2024-09-15T23:15:53.872244+0000', 'last_active': '2024-09-15T23:15:53.872244+0000', 'last_peered': '2024-09-15T23:15:53.872244+0000', 'last_clean': '2024-09-15T23:15:53.872244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:53.872244+0000', 'last_undegraded': '2024-09-15T23:15:53.872244+0000', 'last_fullsized': '2024-09-15T23:15:53.872244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:15:58.552 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2b is not active+clean 2024-09-15T23:15:58.552 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:15:53.872244+0000', 'last_change': '2024-09-15T23:15:53.872244+0000', 'last_active': '2024-09-15T23:15:53.872244+0000', 'last_peered': '2024-09-15T23:15:53.872244+0000', 'last_clean': '2024-09-15T23:15:53.872244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:53.872244+0000', 'last_undegraded': '2024-09-15T23:15:53.872244+0000', 'last_fullsized': '2024-09-15T23:15:53.872244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:15:58.553 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2a is not active+clean 2024-09-15T23:15:58.553 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:15:53.872244+0000', 'last_change': '2024-09-15T23:15:53.872244+0000', 'last_active': '2024-09-15T23:15:53.872244+0000', 'last_peered': '2024-09-15T23:15:53.872244+0000', 'last_clean': '2024-09-15T23:15:53.872244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:53.872244+0000', 'last_undegraded': '2024-09-15T23:15:53.872244+0000', 'last_fullsized': '2024-09-15T23:15:53.872244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:15:58.553 INFO:tasks.ceph.ceph_manager.ceph:PG 11.29 is not active+clean 2024-09-15T23:15:58.553 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:15:53.872244+0000', 'last_change': '2024-09-15T23:15:53.872244+0000', 'last_active': '2024-09-15T23:15:53.872244+0000', 'last_peered': '2024-09-15T23:15:53.872244+0000', 'last_clean': '2024-09-15T23:15:53.872244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:53.872244+0000', 'last_undegraded': '2024-09-15T23:15:53.872244+0000', 'last_fullsized': '2024-09-15T23:15:53.872244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:15:58.553 INFO:tasks.ceph.ceph_manager.ceph:PG 11.28 is not active+clean 2024-09-15T23:15:58.553 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:15:53.872244+0000', 'last_change': '2024-09-15T23:15:53.872244+0000', 'last_active': '2024-09-15T23:15:53.872244+0000', 'last_peered': '2024-09-15T23:15:53.872244+0000', 'last_clean': '2024-09-15T23:15:53.872244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:53.872244+0000', 'last_undegraded': '2024-09-15T23:15:53.872244+0000', 'last_fullsized': '2024-09-15T23:15:53.872244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:15:58.553 INFO:tasks.ceph.ceph_manager.ceph:PG 11.27 is not active+clean 2024-09-15T23:15:58.553 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:15:53.872244+0000', 'last_change': '2024-09-15T23:15:53.872244+0000', 'last_active': '2024-09-15T23:15:53.872244+0000', 'last_peered': '2024-09-15T23:15:53.872244+0000', 'last_clean': '2024-09-15T23:15:53.872244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:53.872244+0000', 'last_undegraded': '2024-09-15T23:15:53.872244+0000', 'last_fullsized': '2024-09-15T23:15:53.872244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:15:58.553 INFO:tasks.ceph.ceph_manager.ceph:PG 11.26 is not active+clean 2024-09-15T23:15:58.554 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:15:53.872244+0000', 'last_change': '2024-09-15T23:15:53.872244+0000', 'last_active': '2024-09-15T23:15:53.872244+0000', 'last_peered': '2024-09-15T23:15:53.872244+0000', 'last_clean': '2024-09-15T23:15:53.872244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:53.872244+0000', 'last_undegraded': '2024-09-15T23:15:53.872244+0000', 'last_fullsized': '2024-09-15T23:15:53.872244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:15:58.554 INFO:tasks.ceph.ceph_manager.ceph:PG 11.24 is not active+clean 2024-09-15T23:15:58.554 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:15:53.872244+0000', 'last_change': '2024-09-15T23:15:53.872244+0000', 'last_active': '2024-09-15T23:15:53.872244+0000', 'last_peered': '2024-09-15T23:15:53.872244+0000', 'last_clean': '2024-09-15T23:15:53.872244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:53.872244+0000', 'last_undegraded': '2024-09-15T23:15:53.872244+0000', 'last_fullsized': '2024-09-15T23:15:53.872244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:15:58.554 INFO:tasks.ceph.ceph_manager.ceph:PG 11.22 is not active+clean 2024-09-15T23:15:58.554 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:15:53.872244+0000', 'last_change': '2024-09-15T23:15:53.872244+0000', 'last_active': '2024-09-15T23:15:53.872244+0000', 'last_peered': '2024-09-15T23:15:53.872244+0000', 'last_clean': '2024-09-15T23:15:53.872244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:53.872244+0000', 'last_undegraded': '2024-09-15T23:15:53.872244+0000', 'last_fullsized': '2024-09-15T23:15:53.872244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:15:58.554 INFO:tasks.ceph.ceph_manager.ceph:PG 11.21 is not active+clean 2024-09-15T23:15:58.554 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:15:53.872244+0000', 'last_change': '2024-09-15T23:15:53.872244+0000', 'last_active': '2024-09-15T23:15:53.872244+0000', 'last_peered': '2024-09-15T23:15:53.872244+0000', 'last_clean': '2024-09-15T23:15:53.872244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:53.872244+0000', 'last_undegraded': '2024-09-15T23:15:53.872244+0000', 'last_fullsized': '2024-09-15T23:15:53.872244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:15:58.554 INFO:tasks.ceph.ceph_manager.ceph:PG 11.20 is not active+clean 2024-09-15T23:15:58.554 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:15:53.872244+0000', 'last_change': '2024-09-15T23:15:53.872244+0000', 'last_active': '2024-09-15T23:15:53.872244+0000', 'last_peered': '2024-09-15T23:15:53.872244+0000', 'last_clean': '2024-09-15T23:15:53.872244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:53.872244+0000', 'last_undegraded': '2024-09-15T23:15:53.872244+0000', 'last_fullsized': '2024-09-15T23:15:53.872244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:15:58.554 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1e is not active+clean 2024-09-15T23:15:58.554 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:15:53.872244+0000', 'last_change': '2024-09-15T23:15:53.872244+0000', 'last_active': '2024-09-15T23:15:53.872244+0000', 'last_peered': '2024-09-15T23:15:53.872244+0000', 'last_clean': '2024-09-15T23:15:53.872244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:53.872244+0000', 'last_undegraded': '2024-09-15T23:15:53.872244+0000', 'last_fullsized': '2024-09-15T23:15:53.872244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:15:58.555 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1f is not active+clean 2024-09-15T23:15:58.555 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:15:52.876492+0000', 'last_change': '2024-09-15T23:15:52.876492+0000', 'last_active': '2024-09-15T23:15:52.869934+0000', 'last_peered': '2024-09-15T23:15:52.869934+0000', 'last_clean': '2024-09-15T23:15:52.869934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:52.876492+0000', 'last_undegraded': '2024-09-15T23:15:52.876492+0000', 'last_fullsized': '2024-09-15T23:15:52.876492+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:15:58.555 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1c is not active+clean 2024-09-15T23:15:58.555 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:15:53.872244+0000', 'last_change': '2024-09-15T23:15:53.872244+0000', 'last_active': '2024-09-15T23:15:53.872244+0000', 'last_peered': '2024-09-15T23:15:53.872244+0000', 'last_clean': '2024-09-15T23:15:53.872244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:53.872244+0000', 'last_undegraded': '2024-09-15T23:15:53.872244+0000', 'last_fullsized': '2024-09-15T23:15:53.872244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:15:58.555 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1d is not active+clean 2024-09-15T23:15:58.555 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:15:52.880276+0000', 'last_change': '2024-09-15T23:15:52.880276+0000', 'last_active': '2024-09-15T23:15:52.869934+0000', 'last_peered': '2024-09-15T23:15:52.869934+0000', 'last_clean': '2024-09-15T23:15:52.869934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:52.880276+0000', 'last_undegraded': '2024-09-15T23:15:52.880276+0000', 'last_fullsized': '2024-09-15T23:15:52.880276+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:15:58.555 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1d is not active+clean 2024-09-15T23:15:58.555 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:15:53.872244+0000', 'last_change': '2024-09-15T23:15:53.872244+0000', 'last_active': '2024-09-15T23:15:53.872244+0000', 'last_peered': '2024-09-15T23:15:53.872244+0000', 'last_clean': '2024-09-15T23:15:53.872244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:53.872244+0000', 'last_undegraded': '2024-09-15T23:15:53.872244+0000', 'last_fullsized': '2024-09-15T23:15:53.872244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:15:58.555 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1c is not active+clean 2024-09-15T23:15:58.555 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:15:52.876682+0000', 'last_change': '2024-09-15T23:15:52.876682+0000', 'last_active': '2024-09-15T23:15:52.869934+0000', 'last_peered': '2024-09-15T23:15:52.869934+0000', 'last_clean': '2024-09-15T23:15:52.869934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:52.876682+0000', 'last_undegraded': '2024-09-15T23:15:52.876682+0000', 'last_fullsized': '2024-09-15T23:15:52.876682+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:15:58.555 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1a is not active+clean 2024-09-15T23:15:58.556 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:15:53.872244+0000', 'last_change': '2024-09-15T23:15:53.872244+0000', 'last_active': '2024-09-15T23:15:53.872244+0000', 'last_peered': '2024-09-15T23:15:53.872244+0000', 'last_clean': '2024-09-15T23:15:53.872244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:53.872244+0000', 'last_undegraded': '2024-09-15T23:15:53.872244+0000', 'last_fullsized': '2024-09-15T23:15:53.872244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:15:58.556 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1b is not active+clean 2024-09-15T23:15:58.556 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:15:53.872244+0000', 'last_change': '2024-09-15T23:15:53.872244+0000', 'last_active': '2024-09-15T23:15:53.872244+0000', 'last_peered': '2024-09-15T23:15:53.872244+0000', 'last_clean': '2024-09-15T23:15:53.872244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:53.872244+0000', 'last_undegraded': '2024-09-15T23:15:53.872244+0000', 'last_fullsized': '2024-09-15T23:15:53.872244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:15:58.556 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1a is not active+clean 2024-09-15T23:15:58.556 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:15:52.879239+0000', 'last_change': '2024-09-15T23:15:52.879239+0000', 'last_active': '2024-09-15T23:15:52.869934+0000', 'last_peered': '2024-09-15T23:15:52.869934+0000', 'last_clean': '2024-09-15T23:15:52.869934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:52.879239+0000', 'last_undegraded': '2024-09-15T23:15:52.879239+0000', 'last_fullsized': '2024-09-15T23:15:52.879239+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:15:58.556 INFO:tasks.ceph.ceph_manager.ceph:PG 11.16 is not active+clean 2024-09-15T23:15:58.556 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:15:53.872244+0000', 'last_change': '2024-09-15T23:15:53.872244+0000', 'last_active': '2024-09-15T23:15:53.872244+0000', 'last_peered': '2024-09-15T23:15:53.872244+0000', 'last_clean': '2024-09-15T23:15:53.872244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:53.872244+0000', 'last_undegraded': '2024-09-15T23:15:53.872244+0000', 'last_fullsized': '2024-09-15T23:15:53.872244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:15:58.556 INFO:tasks.ceph.ceph_manager.ceph:PG 10.17 is not active+clean 2024-09-15T23:15:58.556 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:15:52.880676+0000', 'last_change': '2024-09-15T23:15:52.880676+0000', 'last_active': '2024-09-15T23:15:52.869934+0000', 'last_peered': '2024-09-15T23:15:52.869934+0000', 'last_clean': '2024-09-15T23:15:52.869934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:52.880676+0000', 'last_undegraded': '2024-09-15T23:15:52.880676+0000', 'last_fullsized': '2024-09-15T23:15:52.880676+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:15:58.556 INFO:tasks.ceph.ceph_manager.ceph:PG 11.17 is not active+clean 2024-09-15T23:15:58.556 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:15:53.872244+0000', 'last_change': '2024-09-15T23:15:53.872244+0000', 'last_active': '2024-09-15T23:15:53.872244+0000', 'last_peered': '2024-09-15T23:15:53.872244+0000', 'last_clean': '2024-09-15T23:15:53.872244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:53.872244+0000', 'last_undegraded': '2024-09-15T23:15:53.872244+0000', 'last_fullsized': '2024-09-15T23:15:53.872244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:15:58.557 INFO:tasks.ceph.ceph_manager.ceph:PG 10.16 is not active+clean 2024-09-15T23:15:58.557 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:15:52.876565+0000', 'last_change': '2024-09-15T23:15:52.876565+0000', 'last_active': '2024-09-15T23:15:52.869934+0000', 'last_peered': '2024-09-15T23:15:52.869934+0000', 'last_clean': '2024-09-15T23:15:52.869934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:52.876565+0000', 'last_undegraded': '2024-09-15T23:15:52.876565+0000', 'last_fullsized': '2024-09-15T23:15:52.876565+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:15:58.557 INFO:tasks.ceph.ceph_manager.ceph:PG 11.14 is not active+clean 2024-09-15T23:15:58.557 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:15:53.872244+0000', 'last_change': '2024-09-15T23:15:53.872244+0000', 'last_active': '2024-09-15T23:15:53.872244+0000', 'last_peered': '2024-09-15T23:15:53.872244+0000', 'last_clean': '2024-09-15T23:15:53.872244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:53.872244+0000', 'last_undegraded': '2024-09-15T23:15:53.872244+0000', 'last_fullsized': '2024-09-15T23:15:53.872244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:15:58.557 INFO:tasks.ceph.ceph_manager.ceph:PG 11.12 is not active+clean 2024-09-15T23:15:58.557 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:15:53.872244+0000', 'last_change': '2024-09-15T23:15:53.872244+0000', 'last_active': '2024-09-15T23:15:53.872244+0000', 'last_peered': '2024-09-15T23:15:53.872244+0000', 'last_clean': '2024-09-15T23:15:53.872244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:53.872244+0000', 'last_undegraded': '2024-09-15T23:15:53.872244+0000', 'last_fullsized': '2024-09-15T23:15:53.872244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:15:58.557 INFO:tasks.ceph.ceph_manager.ceph:PG 11.13 is not active+clean 2024-09-15T23:15:58.557 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:15:53.872244+0000', 'last_change': '2024-09-15T23:15:53.872244+0000', 'last_active': '2024-09-15T23:15:53.872244+0000', 'last_peered': '2024-09-15T23:15:53.872244+0000', 'last_clean': '2024-09-15T23:15:53.872244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:53.872244+0000', 'last_undegraded': '2024-09-15T23:15:53.872244+0000', 'last_fullsized': '2024-09-15T23:15:53.872244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:15:58.557 INFO:tasks.ceph.ceph_manager.ceph:PG 10.12 is not active+clean 2024-09-15T23:15:58.557 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:15:52.878742+0000', 'last_change': '2024-09-15T23:15:52.878742+0000', 'last_active': '2024-09-15T23:15:52.869934+0000', 'last_peered': '2024-09-15T23:15:52.869934+0000', 'last_clean': '2024-09-15T23:15:52.869934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:52.878742+0000', 'last_undegraded': '2024-09-15T23:15:52.878742+0000', 'last_fullsized': '2024-09-15T23:15:52.878742+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:15:58.558 INFO:tasks.ceph.ceph_manager.ceph:PG 10.11 is not active+clean 2024-09-15T23:15:58.558 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:15:52.878729+0000', 'last_change': '2024-09-15T23:15:52.878729+0000', 'last_active': '2024-09-15T23:15:52.869934+0000', 'last_peered': '2024-09-15T23:15:52.869934+0000', 'last_clean': '2024-09-15T23:15:52.869934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:52.878729+0000', 'last_undegraded': '2024-09-15T23:15:52.878729+0000', 'last_fullsized': '2024-09-15T23:15:52.878729+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:15:58.558 INFO:tasks.ceph.ceph_manager.ceph:PG 10.10 is not active+clean 2024-09-15T23:15:58.558 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:15:52.878721+0000', 'last_change': '2024-09-15T23:15:52.878721+0000', 'last_active': '2024-09-15T23:15:52.869934+0000', 'last_peered': '2024-09-15T23:15:52.869934+0000', 'last_clean': '2024-09-15T23:15:52.869934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:52.878721+0000', 'last_undegraded': '2024-09-15T23:15:52.878721+0000', 'last_fullsized': '2024-09-15T23:15:52.878721+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:15:58.558 INFO:tasks.ceph.ceph_manager.ceph:PG 11.e is not active+clean 2024-09-15T23:15:58.558 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:15:53.872244+0000', 'last_change': '2024-09-15T23:15:53.872244+0000', 'last_active': '2024-09-15T23:15:53.872244+0000', 'last_peered': '2024-09-15T23:15:53.872244+0000', 'last_clean': '2024-09-15T23:15:53.872244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:53.872244+0000', 'last_undegraded': '2024-09-15T23:15:53.872244+0000', 'last_fullsized': '2024-09-15T23:15:53.872244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:15:58.558 INFO:tasks.ceph.ceph_manager.ceph:PG 10.f is not active+clean 2024-09-15T23:15:58.558 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:15:52.880235+0000', 'last_change': '2024-09-15T23:15:52.880235+0000', 'last_active': '2024-09-15T23:15:52.869934+0000', 'last_peered': '2024-09-15T23:15:52.869934+0000', 'last_clean': '2024-09-15T23:15:52.869934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:52.880235+0000', 'last_undegraded': '2024-09-15T23:15:52.880235+0000', 'last_fullsized': '2024-09-15T23:15:52.880235+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:15:58.558 INFO:tasks.ceph.ceph_manager.ceph:PG 11.f is not active+clean 2024-09-15T23:15:58.558 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:15:53.872244+0000', 'last_change': '2024-09-15T23:15:53.872244+0000', 'last_active': '2024-09-15T23:15:53.872244+0000', 'last_peered': '2024-09-15T23:15:53.872244+0000', 'last_clean': '2024-09-15T23:15:53.872244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:53.872244+0000', 'last_undegraded': '2024-09-15T23:15:53.872244+0000', 'last_fullsized': '2024-09-15T23:15:53.872244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:15:58.558 INFO:tasks.ceph.ceph_manager.ceph:PG 10.e is not active+clean 2024-09-15T23:15:58.559 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:15:52.875743+0000', 'last_change': '2024-09-15T23:15:52.875743+0000', 'last_active': '2024-09-15T23:15:52.869934+0000', 'last_peered': '2024-09-15T23:15:52.869934+0000', 'last_clean': '2024-09-15T23:15:52.869934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:52.875743+0000', 'last_undegraded': '2024-09-15T23:15:52.875743+0000', 'last_fullsized': '2024-09-15T23:15:52.875743+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:15:58.559 INFO:tasks.ceph.ceph_manager.ceph:PG 10.d is not active+clean 2024-09-15T23:15:58.559 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:15:52.875754+0000', 'last_change': '2024-09-15T23:15:52.875754+0000', 'last_active': '2024-09-15T23:15:52.869934+0000', 'last_peered': '2024-09-15T23:15:52.869934+0000', 'last_clean': '2024-09-15T23:15:52.869934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:52.875754+0000', 'last_undegraded': '2024-09-15T23:15:52.875754+0000', 'last_fullsized': '2024-09-15T23:15:52.875754+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:15:58.559 INFO:tasks.ceph.ceph_manager.ceph:PG 10.c is not active+clean 2024-09-15T23:15:58.559 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:15:52.876188+0000', 'last_change': '2024-09-15T23:15:52.876188+0000', 'last_active': '2024-09-15T23:15:52.869934+0000', 'last_peered': '2024-09-15T23:15:52.869934+0000', 'last_clean': '2024-09-15T23:15:52.869934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:52.876188+0000', 'last_undegraded': '2024-09-15T23:15:52.876188+0000', 'last_fullsized': '2024-09-15T23:15:52.876188+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:15:58.559 INFO:tasks.ceph.ceph_manager.ceph:PG 10.a is not active+clean 2024-09-15T23:15:58.559 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:15:52.876047+0000', 'last_change': '2024-09-15T23:15:52.876047+0000', 'last_active': '2024-09-15T23:15:52.869934+0000', 'last_peered': '2024-09-15T23:15:52.869934+0000', 'last_clean': '2024-09-15T23:15:52.869934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:52.876047+0000', 'last_undegraded': '2024-09-15T23:15:52.876047+0000', 'last_fullsized': '2024-09-15T23:15:52.876047+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:15:58.559 INFO:tasks.ceph.ceph_manager.ceph:PG 10.9 is not active+clean 2024-09-15T23:15:58.559 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:15:52.875687+0000', 'last_change': '2024-09-15T23:15:52.875687+0000', 'last_active': '2024-09-15T23:15:52.869934+0000', 'last_peered': '2024-09-15T23:15:52.869934+0000', 'last_clean': '2024-09-15T23:15:52.869934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:52.875687+0000', 'last_undegraded': '2024-09-15T23:15:52.875687+0000', 'last_fullsized': '2024-09-15T23:15:52.875687+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:15:58.559 INFO:tasks.ceph.ceph_manager.ceph:PG 10.7 is not active+clean 2024-09-15T23:15:58.559 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:15:52.878138+0000', 'last_change': '2024-09-15T23:15:52.878138+0000', 'last_active': '2024-09-15T23:15:52.869934+0000', 'last_peered': '2024-09-15T23:15:52.869934+0000', 'last_clean': '2024-09-15T23:15:52.869934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:52.878138+0000', 'last_undegraded': '2024-09-15T23:15:52.878138+0000', 'last_fullsized': '2024-09-15T23:15:52.878138+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:15:58.560 INFO:tasks.ceph.ceph_manager.ceph:PG 11.7 is not active+clean 2024-09-15T23:15:58.560 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:15:53.872244+0000', 'last_change': '2024-09-15T23:15:53.872244+0000', 'last_active': '2024-09-15T23:15:53.872244+0000', 'last_peered': '2024-09-15T23:15:53.872244+0000', 'last_clean': '2024-09-15T23:15:53.872244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:53.872244+0000', 'last_undegraded': '2024-09-15T23:15:53.872244+0000', 'last_fullsized': '2024-09-15T23:15:53.872244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:15:58.560 INFO:tasks.ceph.ceph_manager.ceph:PG 10.6 is not active+clean 2024-09-15T23:15:58.560 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:15:52.878152+0000', 'last_change': '2024-09-15T23:15:52.878152+0000', 'last_active': '2024-09-15T23:15:52.869934+0000', 'last_peered': '2024-09-15T23:15:52.869934+0000', 'last_clean': '2024-09-15T23:15:52.869934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:52.878152+0000', 'last_undegraded': '2024-09-15T23:15:52.878152+0000', 'last_fullsized': '2024-09-15T23:15:52.878152+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:15:58.560 INFO:tasks.ceph.ceph_manager.ceph:PG 11.4 is not active+clean 2024-09-15T23:15:58.560 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:15:53.872244+0000', 'last_change': '2024-09-15T23:15:53.872244+0000', 'last_active': '2024-09-15T23:15:53.872244+0000', 'last_peered': '2024-09-15T23:15:53.872244+0000', 'last_clean': '2024-09-15T23:15:53.872244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:53.872244+0000', 'last_undegraded': '2024-09-15T23:15:53.872244+0000', 'last_fullsized': '2024-09-15T23:15:53.872244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:15:58.560 INFO:tasks.ceph.ceph_manager.ceph:PG 11.5 is not active+clean 2024-09-15T23:15:58.560 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:15:53.872244+0000', 'last_change': '2024-09-15T23:15:53.872244+0000', 'last_active': '2024-09-15T23:15:53.872244+0000', 'last_peered': '2024-09-15T23:15:53.872244+0000', 'last_clean': '2024-09-15T23:15:53.872244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:53.872244+0000', 'last_undegraded': '2024-09-15T23:15:53.872244+0000', 'last_fullsized': '2024-09-15T23:15:53.872244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:15:58.560 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3 is not active+clean 2024-09-15T23:15:58.560 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:15:53.872244+0000', 'last_change': '2024-09-15T23:15:53.872244+0000', 'last_active': '2024-09-15T23:15:53.872244+0000', 'last_peered': '2024-09-15T23:15:53.872244+0000', 'last_clean': '2024-09-15T23:15:53.872244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:53.872244+0000', 'last_undegraded': '2024-09-15T23:15:53.872244+0000', 'last_fullsized': '2024-09-15T23:15:53.872244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:15:58.561 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1 is not active+clean 2024-09-15T23:15:58.561 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:15:52.875198+0000', 'last_change': '2024-09-15T23:15:52.875198+0000', 'last_active': '2024-09-15T23:15:52.869934+0000', 'last_peered': '2024-09-15T23:15:52.869934+0000', 'last_clean': '2024-09-15T23:15:52.869934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:52.875198+0000', 'last_undegraded': '2024-09-15T23:15:52.875198+0000', 'last_fullsized': '2024-09-15T23:15:52.875198+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:15:58.561 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1 is not active+clean 2024-09-15T23:15:58.561 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:15:53.872244+0000', 'last_change': '2024-09-15T23:15:53.872244+0000', 'last_active': '2024-09-15T23:15:53.872244+0000', 'last_peered': '2024-09-15T23:15:53.872244+0000', 'last_clean': '2024-09-15T23:15:53.872244+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:53.872244+0000', 'last_undegraded': '2024-09-15T23:15:53.872244+0000', 'last_fullsized': '2024-09-15T23:15:53.872244+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:53.872244+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:15:58.561 INFO:tasks.ceph.ceph_manager.ceph:PG 10.0 is not active+clean 2024-09-15T23:15:58.561 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:15:52.876072+0000', 'last_change': '2024-09-15T23:15:52.876072+0000', 'last_active': '2024-09-15T23:15:52.869934+0000', 'last_peered': '2024-09-15T23:15:52.869934+0000', 'last_clean': '2024-09-15T23:15:52.869934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:52.876072+0000', 'last_undegraded': '2024-09-15T23:15:52.876072+0000', 'last_fullsized': '2024-09-15T23:15:52.876072+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:15:58.561 INFO:tasks.ceph.ceph_manager.ceph:PG 10.b is not active+clean 2024-09-15T23:15:58.561 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:15:52.878091+0000', 'last_change': '2024-09-15T23:15:52.878091+0000', 'last_active': '2024-09-15T23:15:52.869934+0000', 'last_peered': '2024-09-15T23:15:52.869934+0000', 'last_clean': '2024-09-15T23:15:52.869934+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:15:52.878091+0000', 'last_undegraded': '2024-09-15T23:15:52.878091+0000', 'last_fullsized': '2024-09-15T23:15:52.878091+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'last_clean_scrub_stamp': '2024-09-15T23:15:52.869934+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:15:58.562 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:15:58.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.657+0000 7f969d8af640 1 Processor -- start 2024-09-15T23:15:58.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.657+0000 7f969d8af640 1 -- start start 2024-09-15T23:15:58.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.658+0000 7f969d8af640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f96980d23b0 0x7f96980b87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:58.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.658+0000 7f969d8af640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96980d0e70 con 0x7f96980b6970 2024-09-15T23:15:58.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.658+0000 7f969d8af640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96980d41c0 con 0x7f969815ed20 2024-09-15T23:15:58.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.658+0000 7f969d8af640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f96980d35b0 con 0x7f96980d23b0 2024-09-15T23:15:58.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.658+0000 7f968e7fc640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f96980b6970 0x7f96980b80d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:44052/0 (socket says 172.21.15.123:44052) 2024-09-15T23:15:58.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.658+0000 7f968e7fc640 1 -- 172.21.15.123:0/4064168957 learned_addr learned my addr 172.21.15.123:0/4064168957 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:58.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.659+0000 7f96967fc640 1 -- 172.21.15.123:0/4064168957 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 930163144 0 0) 0x7f9680001110 con 0x7f96980b6970 2024-09-15T23:15:58.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.659+0000 7f96967fc640 1 -- 172.21.15.123:0/4064168957 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9684003520 con 0x7f96980b6970 2024-09-15T23:15:58.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.659+0000 7f96977fe640 1 --2- 172.21.15.123:0/4064168957 >> v2:172.21.15.188:3300/0 conn(0x7f96980d23b0 0x7f96980b87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:58.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.659+0000 7f96967fc640 1 -- 172.21.15.123:0/4064168957 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 398680783 0 0) 0x7f9684003520 con 0x7f96980b6970 2024-09-15T23:15:58.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.659+0000 7f96967fc640 1 -- 172.21.15.123:0/4064168957 >> v2:172.21.15.188:3300/0 conn(0x7f96980d23b0 msgr2=0x7f96980b87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:58.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.659+0000 7f96967fc640 1 --2- 172.21.15.123:0/4064168957 >> v2:172.21.15.188:3300/0 conn(0x7f96980d23b0 0x7f96980b87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:58.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.659+0000 7f96967fc640 1 -- 172.21.15.123:0/4064168957 >> v1:172.21.15.188:6789/0 conn(0x7f969815ed20 legacy=0x7f96980b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:58.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.659+0000 7f96967fc640 1 -- 172.21.15.123:0/4064168957 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96980d3890 con 0x7f96980b6970 2024-09-15T23:15:58.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.659+0000 7f96967fc640 1 -- 172.21.15.123:0/4064168957 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f9680001840 con 0x7f96980b6970 2024-09-15T23:15:58.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.659+0000 7f96967fc640 1 -- 172.21.15.123:0/4064168957 >> v1:172.21.15.123:6789/0 conn(0x7f96980b6970 legacy=0x7f96980b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:58.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.659+0000 7f96967fc640 1 --2- 172.21.15.123:0/4064168957 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96840039b0 0x7f9684003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:58.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.659+0000 7f96967fc640 1 --2- 172.21.15.123:0/4064168957 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9684004800 0x7f9684004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:58.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.659+0000 7f96967fc640 1 --2- 172.21.15.123:0/4064168957 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96840051c0 0x7f968400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:58.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.659+0000 7f96967fc640 1 -- 172.21.15.123:0/4064168957 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f96980d35b0 con 0x7f96840039b0 2024-09-15T23:15:58.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.659+0000 7f96967fc640 1 -- 172.21.15.123:0/4064168957 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f968400c160 con 0x7f9684004800 2024-09-15T23:15:58.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.659+0000 7f96967fc640 1 -- 172.21.15.123:0/4064168957 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f968400c360 con 0x7f96840051c0 2024-09-15T23:15:58.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.659+0000 7f9696ffd640 1 --2- 172.21.15.123:0/4064168957 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96840039b0 0x7f9684003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:58.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.659+0000 7f968e7fc640 1 --2- 172.21.15.123:0/4064168957 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9684004800 0x7f9684004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:58.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.659+0000 7f96977fe640 1 --2- 172.21.15.123:0/4064168957 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96840051c0 0x7f968400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:58.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.659+0000 7f9696ffd640 1 -- 172.21.15.123:0/4064168957 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96840051c0 msgr2=0x7f968400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:58.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.659+0000 7f9696ffd640 1 --2- 172.21.15.123:0/4064168957 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96840051c0 0x7f968400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:58.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.659+0000 7f9696ffd640 1 -- 172.21.15.123:0/4064168957 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9684004800 msgr2=0x7f9684004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:58.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.659+0000 7f9696ffd640 1 --2- 172.21.15.123:0/4064168957 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9684004800 0x7f9684004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:58.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.659+0000 7f9696ffd640 1 -- 172.21.15.123:0/4064168957 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9684003520 con 0x7f96840039b0 2024-09-15T23:15:58.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.659+0000 7f96977fe640 1 -- 172.21.15.123:0/4064168957 reap_dead start 2024-09-15T23:15:58.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.660+0000 7f9696ffd640 1 --2- 172.21.15.123:0/4064168957 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96840039b0 0x7f9684003dd0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f9688001750 tx=0x7f9684005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f83cdecee7b676 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:58.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.660+0000 7f96967fc640 1 -- 172.21.15.123:0/4064168957 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9688001370 con 0x7f96840039b0 2024-09-15T23:15:58.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.660+0000 7f96967fc640 1 -- 172.21.15.123:0/4064168957 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96880052d0 con 0x7f96840039b0 2024-09-15T23:15:58.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.660+0000 7f96967fc640 1 -- 172.21.15.123:0/4064168957 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968802abe0 con 0x7f96840039b0 2024-09-15T23:15:58.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.661+0000 7f969d8af640 1 -- 172.21.15.123:0/4064168957 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96840039b0 msgr2=0x7f9684003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:58.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.661+0000 7f969d8af640 1 --2- 172.21.15.123:0/4064168957 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96840039b0 0x7f9684003dd0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f9688001750 tx=0x7f9684005830 comp rx=0 tx=0).stop 2024-09-15T23:15:58.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.661+0000 7f969d8af640 1 -- 172.21.15.123:0/4064168957 shutdown_connections 2024-09-15T23:15:58.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.661+0000 7f969d8af640 1 --2- 172.21.15.123:0/4064168957 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96840039b0 0x7f9684003dd0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:58.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.661+0000 7f969d8af640 1 -- 172.21.15.123:0/4064168957 >> 172.21.15.123:0/4064168957 conn(0x7f96980d1260 msgr2=0x7f96980d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:58.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.661+0000 7f969d8af640 1 -- 172.21.15.123:0/4064168957 shutdown_connections 2024-09-15T23:15:58.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.661+0000 7f969d8af640 1 -- 172.21.15.123:0/4064168957 wait complete. 2024-09-15T23:15:58.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.662+0000 7f969d8af640 1 Processor -- start 2024-09-15T23:15:58.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.662+0000 7f969d8af640 1 -- start start 2024-09-15T23:15:58.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.663+0000 7f969d8af640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96840039b0 0x7f969815d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:58.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.663+0000 7f969d8af640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f969815f310 0x7f96980c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:58.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.663+0000 7f969d8af640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96980b2bb0 0x7f96981e94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:58.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.663+0000 7f969d8af640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f96980d32a0 con 0x7f96980b2bb0 2024-09-15T23:15:58.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.663+0000 7f969d8af640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f96980d3e50 con 0x7f969815f310 2024-09-15T23:15:58.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.663+0000 7f969d8af640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f969815f100 con 0x7f96840039b0 2024-09-15T23:15:58.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.663+0000 7f96977fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96980b2bb0 0x7f96981e94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:58.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.663+0000 7f96977fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96980b2bb0 0x7f96981e94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54002/0 (socket says 172.21.15.123:54002) 2024-09-15T23:15:58.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.663+0000 7f96977fe640 1 -- 172.21.15.123:0/1878956526 learned_addr learned my addr 172.21.15.123:0/1878956526 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:58.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.663+0000 7f9696ffd640 1 --2- 172.21.15.123:0/1878956526 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96840039b0 0x7f969815d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:58.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.663+0000 7f968e7fc640 1 --2- 172.21.15.123:0/1878956526 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f969815f310 0x7f96980c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:58.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.663+0000 7f96977fe640 1 -- 172.21.15.123:0/1878956526 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96840039b0 msgr2=0x7f969815d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:58.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.663+0000 7f96977fe640 1 --2- 172.21.15.123:0/1878956526 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96840039b0 0x7f969815d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:58.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.663+0000 7f96977fe640 1 -- 172.21.15.123:0/1878956526 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f969815f310 msgr2=0x7f96980c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:58.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.663+0000 7f96977fe640 1 --2- 172.21.15.123:0/1878956526 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f969815f310 0x7f96980c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:58.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.663+0000 7f96977fe640 1 -- 172.21.15.123:0/1878956526 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96980c86d0 con 0x7f96980b2bb0 2024-09-15T23:15:58.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.664+0000 7f96977fe640 1 --2- 172.21.15.123:0/1878956526 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96980b2bb0 0x7f96981e94a0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f96980d2860 tx=0x7f969000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:58.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.664+0000 7f9694ff9640 1 -- 172.21.15.123:0/1878956526 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969000fd80 con 0x7f96980b2bb0 2024-09-15T23:15:58.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.664+0000 7f9694ff9640 1 -- 172.21.15.123:0/1878956526 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f969001d070 con 0x7f96980b2bb0 2024-09-15T23:15:58.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.664+0000 7f969d8af640 1 -- 172.21.15.123:0/1878956526 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f969815f810 con 0x7f96980b2bb0 2024-09-15T23:15:58.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.664+0000 7f9694ff9640 1 -- 172.21.15.123:0/1878956526 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9690015670 con 0x7f96980b2bb0 2024-09-15T23:15:58.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.664+0000 7f969d8af640 1 -- 172.21.15.123:0/1878956526 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f969815fdd0 con 0x7f96980b2bb0 2024-09-15T23:15:58.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.665+0000 7f969d8af640 1 -- 172.21.15.123:0/1878956526 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96980b7010 con 0x7f96980b2bb0 2024-09-15T23:15:58.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.665+0000 7f9694ff9640 1 -- 172.21.15.123:0/1878956526 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9690015810 con 0x7f96980b2bb0 2024-09-15T23:15:58.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.666+0000 7f9694ff9640 1 --2- 172.21.15.123:0/1878956526 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f967806c2e0 0x7f967806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:58.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.666+0000 7f9694ff9640 1 -- 172.21.15.123:0/1878956526 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f969008bb70 con 0x7f96980b2bb0 2024-09-15T23:15:58.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.666+0000 7f9696ffd640 1 --2- 172.21.15.123:0/1878956526 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f967806c2e0 0x7f967806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:58.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.666+0000 7f9696ffd640 1 --2- 172.21.15.123:0/1878956526 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f967806c2e0 0x7f967806e7a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9688032000 tx=0x7f968802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:58.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.670+0000 7f9694ff9640 1 -- 172.21.15.123:0/1878956526 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9690010040 con 0x7f96980b2bb0 2024-09-15T23:15:58.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.900+0000 7f969d8af640 1 -- 172.21.15.123:0/1878956526 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f96980b3f20 con 0x7f96980b2bb0 2024-09-15T23:15:58.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.901+0000 7f9694ff9640 1 -- 172.21.15.123:0/1878956526 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1379 (secure 0 0 0) 0x7f9690059c90 con 0x7f96980b2bb0 2024-09-15T23:15:58.903 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:58.903 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":249,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":82,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":41},{"state_name":"unknown","count":36},{"state_name":"creating+peering","count":20}],"num_pgs":97,"num_pools":3,"num_objects":10,"data_bytes":592104,"bytes_used":302776320,"bytes_avail":772791336960,"bytes_total":773094113280,"unknown_pgs_ratio":0.37113401293754578,"inactive_pgs_ratio":0.20618556439876556,"write_bytes_sec":2405,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":44,"btime":"2024-09-15T23:15:56:901221+0000","id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"a","status":"up:active","gid":6678}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2024-09-15T23:15:29.548221+0000","services":{"mds":{"daemons":{"summary":"","d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T23:15:58.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.903+0000 7f969d8af640 1 -- 172.21.15.123:0/1878956526 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f967806c2e0 msgr2=0x7f967806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:58.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.903+0000 7f969d8af640 1 --2- 172.21.15.123:0/1878956526 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f967806c2e0 0x7f967806e7a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9688032000 tx=0x7f968802e000 comp rx=0 tx=0).stop 2024-09-15T23:15:58.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.903+0000 7f969d8af640 1 -- 172.21.15.123:0/1878956526 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96980b2bb0 msgr2=0x7f96981e94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:58.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.903+0000 7f969d8af640 1 --2- 172.21.15.123:0/1878956526 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96980b2bb0 0x7f96981e94a0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f96980d2860 tx=0x7f969000f580 comp rx=0 tx=0).stop 2024-09-15T23:15:58.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.903+0000 7f969d8af640 1 -- 172.21.15.123:0/1878956526 shutdown_connections 2024-09-15T23:15:58.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.903+0000 7f969d8af640 1 --2- 172.21.15.123:0/1878956526 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f967806c2e0 0x7f967806e7a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:58.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.903+0000 7f969d8af640 1 --2- 172.21.15.123:0/1878956526 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96980b2bb0 0x7f96981e94a0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:58.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.903+0000 7f969d8af640 1 --2- 172.21.15.123:0/1878956526 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f969815f310 0x7f96980c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:58.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.903+0000 7f969d8af640 1 --2- 172.21.15.123:0/1878956526 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96840039b0 0x7f969815d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:58.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.903+0000 7f969d8af640 1 -- 172.21.15.123:0/1878956526 >> 172.21.15.123:0/1878956526 conn(0x7f96980d1260 msgr2=0x7f96980b57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:58.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.903+0000 7f969d8af640 1 -- 172.21.15.123:0/1878956526 shutdown_connections 2024-09-15T23:15:58.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:58.903+0000 7f969d8af640 1 -- 172.21.15.123:0/1878956526 wait complete. 2024-09-15T23:15:58.916 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-15T23:15:58.916 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:15:59.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.012+0000 7fd4857cf640 1 Processor -- start 2024-09-15T23:15:59.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.012+0000 7fd4857cf640 1 -- start start 2024-09-15T23:15:59.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.013+0000 7fd4857cf640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4800b6970 0x7fd4800b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:59.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.013+0000 7fd4857cf640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd4800d23b0 0x7fd4800b8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:59.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.013+0000 7fd4857cf640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4800d0e70 con 0x7fd48015ed20 2024-09-15T23:15:59.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.013+0000 7fd4857cf640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fd4800d41c0 con 0x7fd4800d23b0 2024-09-15T23:15:59.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.013+0000 7fd4857cf640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd4800d35b0 con 0x7fd4800b6970 2024-09-15T23:15:59.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.013+0000 7fd47f7fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd4800d23b0 0x7fd4800b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:59.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.013+0000 7fd47e7fc640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4800b6970 0x7fd4800b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:59.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.013+0000 7fd47effd640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fd48015ed20 0x7fd4800b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:50224/0 (socket says 172.21.15.123:50224) 2024-09-15T23:15:59.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.013+0000 7fd47effd640 1 -- 172.21.15.123:0/4241478895 learned_addr learned my addr 172.21.15.123:0/4241478895 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:15:59.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.014+0000 7fd47dffb640 1 -- 172.21.15.123:0/4241478895 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3594212902 0 0) 0x7fd470001490 con 0x7fd48015ed20 2024-09-15T23:15:59.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.014+0000 7fd47dffb640 1 -- 172.21.15.123:0/4241478895 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd468003520 con 0x7fd48015ed20 2024-09-15T23:15:59.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.014+0000 7fd47e7fc640 1 -- 172.21.15.123:0/4241478895 >> v2:172.21.15.188:3300/0 conn(0x7fd4800d23b0 msgr2=0x7fd4800b8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:15:59.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.014+0000 7fd47e7fc640 1 --2- 172.21.15.123:0/4241478895 >> v2:172.21.15.188:3300/0 conn(0x7fd4800d23b0 0x7fd4800b8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:59.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.014+0000 7fd47e7fc640 1 -- 172.21.15.123:0/4241478895 >> v1:172.21.15.188:6789/0 conn(0x7fd48015ed20 legacy=0x7fd4800b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:59.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.014+0000 7fd47e7fc640 1 -- 172.21.15.123:0/4241478895 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4800d3890 con 0x7fd4800b6970 2024-09-15T23:15:59.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.014+0000 7fd47f7fe640 1 --2- 172.21.15.123:0/4241478895 >> v2:172.21.15.188:3300/0 conn(0x7fd4800d23b0 0x7fd4800b8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:15:59.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.015+0000 7fd47e7fc640 1 --2- 172.21.15.123:0/4241478895 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4800b6970 0x7fd4800b80d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd4740097a0 tx=0x7fd47402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50260808a11c04c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:59.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.015+0000 7fd47dffb640 1 -- 172.21.15.123:0/4241478895 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd474037070 con 0x7fd4800b6970 2024-09-15T23:15:59.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.015+0000 7fd47dffb640 1 -- 172.21.15.123:0/4241478895 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd47402ae50 con 0x7fd4800b6970 2024-09-15T23:15:59.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.015+0000 7fd47dffb640 1 -- 172.21.15.123:0/4241478895 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd474032660 con 0x7fd4800b6970 2024-09-15T23:15:59.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.015+0000 7fd4857cf640 1 -- 172.21.15.123:0/4241478895 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4800b6970 msgr2=0x7fd4800b80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:59.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.015+0000 7fd4857cf640 1 --2- 172.21.15.123:0/4241478895 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4800b6970 0x7fd4800b80d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd4740097a0 tx=0x7fd47402a100 comp rx=0 tx=0).stop 2024-09-15T23:15:59.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.015+0000 7fd4857cf640 1 -- 172.21.15.123:0/4241478895 shutdown_connections 2024-09-15T23:15:59.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.015+0000 7fd4857cf640 1 --2- 172.21.15.123:0/4241478895 >> v2:172.21.15.188:3300/0 conn(0x7fd4800d23b0 0x7fd4800b8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:59.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.015+0000 7fd4857cf640 1 --2- 172.21.15.123:0/4241478895 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4800b6970 0x7fd4800b80d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:59.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.015+0000 7fd4857cf640 1 -- 172.21.15.123:0/4241478895 >> 172.21.15.123:0/4241478895 conn(0x7fd4800d1260 msgr2=0x7fd4800d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:59.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.015+0000 7fd4857cf640 1 -- 172.21.15.123:0/4241478895 shutdown_connections 2024-09-15T23:15:59.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.015+0000 7fd4857cf640 1 -- 172.21.15.123:0/4241478895 wait complete. 2024-09-15T23:15:59.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.017+0000 7fd4857cf640 1 Processor -- start 2024-09-15T23:15:59.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.017+0000 7fd4857cf640 1 -- start start 2024-09-15T23:15:59.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.017+0000 7fd4857cf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4800b6970 0x7fd480154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:59.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.017+0000 7fd4857cf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4800d23b0 0x7fd4801572a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:59.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.017+0000 7fd4857cf640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd48015ed20 0x7fd4801577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:59.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.017+0000 7fd4857cf640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd4800d32a0 con 0x7fd4800b6970 2024-09-15T23:15:59.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.017+0000 7fd4857cf640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd4800d3e50 con 0x7fd4800d23b0 2024-09-15T23:15:59.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.017+0000 7fd4857cf640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd48015f100 con 0x7fd48015ed20 2024-09-15T23:15:59.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.018+0000 7fd47effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4800b6970 0x7fd480154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:59.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.018+0000 7fd47effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4800b6970 0x7fd480154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54008/0 (socket says 172.21.15.123:54008) 2024-09-15T23:15:59.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.018+0000 7fd47effd640 1 -- 172.21.15.123:0/196384060 learned_addr learned my addr 172.21.15.123:0/196384060 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:15:59.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.018+0000 7fd47f7fe640 1 --2- 172.21.15.123:0/196384060 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd48015ed20 0x7fd4801577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:59.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.018+0000 7fd47e7fc640 1 --2- 172.21.15.123:0/196384060 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4800d23b0 0x7fd4801572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:59.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.018+0000 7fd47effd640 1 -- 172.21.15.123:0/196384060 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd48015ed20 msgr2=0x7fd4801577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:59.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.018+0000 7fd47effd640 1 --2- 172.21.15.123:0/196384060 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd48015ed20 0x7fd4801577e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:59.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.018+0000 7fd47effd640 1 -- 172.21.15.123:0/196384060 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4800d23b0 msgr2=0x7fd4801572a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:59.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.018+0000 7fd47effd640 1 --2- 172.21.15.123:0/196384060 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4800d23b0 0x7fd4801572a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:59.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.018+0000 7fd47effd640 1 -- 172.21.15.123:0/196384060 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4800cc3f0 con 0x7fd4800b6970 2024-09-15T23:15:59.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.018+0000 7fd47effd640 1 --2- 172.21.15.123:0/196384060 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4800b6970 0x7fd480154830 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fd47000cb10 tx=0x7fd47000cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:59.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.018+0000 7fd4677fe640 1 -- 172.21.15.123:0/196384060 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd470017070 con 0x7fd4800b6970 2024-09-15T23:15:59.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.018+0000 7fd4677fe640 1 -- 172.21.15.123:0/196384060 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd47000ab50 con 0x7fd4800b6970 2024-09-15T23:15:59.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.018+0000 7fd4677fe640 1 -- 172.21.15.123:0/196384060 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd470012400 con 0x7fd4800b6970 2024-09-15T23:15:59.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.018+0000 7fd4857cf640 1 -- 172.21.15.123:0/196384060 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4800cc6d0 con 0x7fd4800b6970 2024-09-15T23:15:59.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.018+0000 7fd4857cf640 1 -- 172.21.15.123:0/196384060 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4800cd1b0 con 0x7fd4800b6970 2024-09-15T23:15:59.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.019+0000 7fd4857cf640 1 -- 172.21.15.123:0/196384060 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4800b7010 con 0x7fd4800b6970 2024-09-15T23:15:59.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.020+0000 7fd4677fe640 1 -- 172.21.15.123:0/196384060 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd47001a070 con 0x7fd4800b6970 2024-09-15T23:15:59.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.020+0000 7fd4677fe640 1 --2- 172.21.15.123:0/196384060 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd46c06c2b0 0x7fd46c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:15:59.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.020+0000 7fd4677fe640 1 -- 172.21.15.123:0/196384060 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7fd47008b030 con 0x7fd4800b6970 2024-09-15T23:15:59.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.021+0000 7fd47e7fc640 1 --2- 172.21.15.123:0/196384060 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd46c06c2b0 0x7fd46c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:15:59.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.021+0000 7fd47e7fc640 1 --2- 172.21.15.123:0/196384060 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd46c06c2b0 0x7fd46c06e770 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd474034000 tx=0x7fd47402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:15:59.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.025+0000 7fd4677fe640 1 -- 172.21.15.123:0/196384060 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd4800d0e70 con 0x7fd4800b6970 2024-09-15T23:15:59.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.186+0000 7fd4857cf640 1 -- 172.21.15.123:0/196384060 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd480157070 con 0x7fd46c06c2b0 2024-09-15T23:15:59.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.192+0000 7fd4677fe640 1 -- 172.21.15.123:0/196384060 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245300 (secure 0 0 0) 0x7fd474030340 con 0x7fd46c06c2b0 2024-09-15T23:15:59.281 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:15:59.282 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:15:59.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.195+0000 7fd4857cf640 1 -- 172.21.15.123:0/196384060 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd46c06c2b0 msgr2=0x7fd46c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:59.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.195+0000 7fd4857cf640 1 --2- 172.21.15.123:0/196384060 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd46c06c2b0 0x7fd46c06e770 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd474034000 tx=0x7fd47402e000 comp rx=0 tx=0).stop 2024-09-15T23:15:59.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.195+0000 7fd4857cf640 1 -- 172.21.15.123:0/196384060 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4800b6970 msgr2=0x7fd480154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:15:59.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.195+0000 7fd4857cf640 1 --2- 172.21.15.123:0/196384060 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4800b6970 0x7fd480154830 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fd47000cb10 tx=0x7fd47000cf10 comp rx=0 tx=0).stop 2024-09-15T23:15:59.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.195+0000 7fd4857cf640 1 -- 172.21.15.123:0/196384060 shutdown_connections 2024-09-15T23:15:59.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.195+0000 7fd4857cf640 1 --2- 172.21.15.123:0/196384060 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd48015ed20 0x7fd4801577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:59.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.195+0000 7fd4857cf640 1 --2- 172.21.15.123:0/196384060 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4800d23b0 0x7fd4801572a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:59.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.195+0000 7fd4857cf640 1 --2- 172.21.15.123:0/196384060 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd46c06c2b0 0x7fd46c06e770 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:59.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.195+0000 7fd4857cf640 1 --2- 172.21.15.123:0/196384060 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4800b6970 0x7fd480154830 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:15:59.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.195+0000 7fd4857cf640 1 -- 172.21.15.123:0/196384060 >> 172.21.15.123:0/196384060 conn(0x7fd4800d1260 msgr2=0x7fd4800b5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:15:59.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.195+0000 7fd4857cf640 1 -- 172.21.15.123:0/196384060 shutdown_connections 2024-09-15T23:15:59.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:15:59.195+0000 7fd4857cf640 1 -- 172.21.15.123:0/196384060 wait complete. 2024-09-15T23:15:59.285 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":193,"stamp":"2024-09-15T23:15:57.555049+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592104,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":172,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":122,"acting":122,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":85,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":295680,"kb_used_data":8712,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754679040,"statfs":{"total":773094113280,"available":772791336960,"internally_reserved":0,"allocated":8921088,"data_stored":4492257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":293654064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1736,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.682399"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382986+0000","last_change":"2024-09-15T23:15:54.895953+0000","last_active":"2024-09-15T23:15:56.382986+0000","last_peered":"2024-09-15T23:15:56.382986+0000","last_clean":"2024-09-15T23:15:56.382986+0000","last_became_active":"2024-09-15T23:15:54.895632+0000","last_became_peered":"2024-09-15T23:15:54.895632+0000","last_unstale":"2024-09-15T23:15:56.382986+0000","last_undegraded":"2024-09-15T23:15:56.382986+0000","last_fullsized":"2024-09-15T23:15:56.382986+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:30:23.433151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382408+0000","last_change":"2024-09-15T23:15:54.895888+0000","last_active":"2024-09-15T23:15:56.382408+0000","last_peered":"2024-09-15T23:15:56.382408+0000","last_clean":"2024-09-15T23:15:56.382408+0000","last_became_active":"2024-09-15T23:15:54.895558+0000","last_became_peered":"2024-09-15T23:15:54.895558+0000","last_unstale":"2024-09-15T23:15:56.382408+0000","last_undegraded":"2024-09-15T23:15:56.382408+0000","last_fullsized":"2024-09-15T23:15:56.382408+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:09:03.821475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382636+0000","last_change":"2024-09-15T23:15:54.904818+0000","last_active":"2024-09-15T23:15:56.382636+0000","last_peered":"2024-09-15T23:15:56.382636+0000","last_clean":"2024-09-15T23:15:56.382636+0000","last_became_active":"2024-09-15T23:15:54.903868+0000","last_became_peered":"2024-09-15T23:15:54.903868+0000","last_unstale":"2024-09-15T23:15:56.382636+0000","last_undegraded":"2024-09-15T23:15:56.382636+0000","last_fullsized":"2024-09-15T23:15:56.382636+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:37.663336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383920+0000","last_change":"2024-09-15T23:15:54.901116+0000","last_active":"2024-09-15T23:15:56.383920+0000","last_peered":"2024-09-15T23:15:56.383920+0000","last_clean":"2024-09-15T23:15:56.383920+0000","last_became_active":"2024-09-15T23:15:54.900244+0000","last_became_peered":"2024-09-15T23:15:54.900244+0000","last_unstale":"2024-09-15T23:15:56.383920+0000","last_undegraded":"2024-09-15T23:15:56.383920+0000","last_fullsized":"2024-09-15T23:15:56.383920+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:54.143040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383622+0000","last_change":"2024-09-15T23:15:54.899743+0000","last_active":"2024-09-15T23:15:56.383622+0000","last_peered":"2024-09-15T23:15:56.383622+0000","last_clean":"2024-09-15T23:15:56.383622+0000","last_became_active":"2024-09-15T23:15:54.899474+0000","last_became_peered":"2024-09-15T23:15:54.899474+0000","last_unstale":"2024-09-15T23:15:56.383622+0000","last_undegraded":"2024-09-15T23:15:56.383622+0000","last_fullsized":"2024-09-15T23:15:56.383622+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:47:21.466200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382646+0000","last_change":"2024-09-15T23:15:54.895898+0000","last_active":"2024-09-15T23:15:56.382646+0000","last_peered":"2024-09-15T23:15:56.382646+0000","last_clean":"2024-09-15T23:15:56.382646+0000","last_became_active":"2024-09-15T23:15:54.895600+0000","last_became_peered":"2024-09-15T23:15:54.895600+0000","last_unstale":"2024-09-15T23:15:56.382646+0000","last_undegraded":"2024-09-15T23:15:56.382646+0000","last_fullsized":"2024-09-15T23:15:56.382646+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:05:41.623242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382898+0000","last_change":"2024-09-15T23:15:54.907811+0000","last_active":"2024-09-15T23:15:56.382898+0000","last_peered":"2024-09-15T23:15:56.382898+0000","last_clean":"2024-09-15T23:15:56.382898+0000","last_became_active":"2024-09-15T23:15:54.906473+0000","last_became_peered":"2024-09-15T23:15:54.906473+0000","last_unstale":"2024-09-15T23:15:56.382898+0000","last_undegraded":"2024-09-15T23:15:56.382898+0000","last_fullsized":"2024-09-15T23:15:56.382898+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:41.289668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382377+0000","last_change":"2024-09-15T23:15:54.901163+0000","last_active":"2024-09-15T23:15:56.382377+0000","last_peered":"2024-09-15T23:15:56.382377+0000","last_clean":"2024-09-15T23:15:56.382377+0000","last_became_active":"2024-09-15T23:15:54.900857+0000","last_became_peered":"2024-09-15T23:15:54.900857+0000","last_unstale":"2024-09-15T23:15:56.382377+0000","last_undegraded":"2024-09-15T23:15:56.382377+0000","last_fullsized":"2024-09-15T23:15:56.382377+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:21.515224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382867+0000","last_change":"2024-09-15T23:15:54.903632+0000","last_active":"2024-09-15T23:15:56.382867+0000","last_peered":"2024-09-15T23:15:56.382867+0000","last_clean":"2024-09-15T23:15:56.382867+0000","last_became_active":"2024-09-15T23:15:54.903372+0000","last_became_peered":"2024-09-15T23:15:54.903372+0000","last_unstale":"2024-09-15T23:15:56.382867+0000","last_undegraded":"2024-09-15T23:15:56.382867+0000","last_fullsized":"2024-09-15T23:15:56.382867+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:24:41.298145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383611+0000","last_change":"2024-09-15T23:15:54.913958+0000","last_active":"2024-09-15T23:15:56.383611+0000","last_peered":"2024-09-15T23:15:56.383611+0000","last_clean":"2024-09-15T23:15:56.383611+0000","last_became_active":"2024-09-15T23:15:54.913620+0000","last_became_peered":"2024-09-15T23:15:54.913620+0000","last_unstale":"2024-09-15T23:15:56.383611+0000","last_undegraded":"2024-09-15T23:15:56.383611+0000","last_fullsized":"2024-09-15T23:15:56.383611+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:54:51.854826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382795+0000","last_change":"2024-09-15T23:15:54.908104+0000","last_active":"2024-09-15T23:15:56.382795+0000","last_peered":"2024-09-15T23:15:56.382795+0000","last_clean":"2024-09-15T23:15:56.382795+0000","last_became_active":"2024-09-15T23:15:54.907745+0000","last_became_peered":"2024-09-15T23:15:54.907745+0000","last_unstale":"2024-09-15T23:15:56.382795+0000","last_undegraded":"2024-09-15T23:15:56.382795+0000","last_fullsized":"2024-09-15T23:15:56.382795+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:25.144212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383665+0000","last_change":"2024-09-15T23:15:54.905358+0000","last_active":"2024-09-15T23:15:56.383665+0000","last_peered":"2024-09-15T23:15:56.383665+0000","last_clean":"2024-09-15T23:15:56.383665+0000","last_became_active":"2024-09-15T23:15:54.905065+0000","last_became_peered":"2024-09-15T23:15:54.905065+0000","last_unstale":"2024-09-15T23:15:56.383665+0000","last_undegraded":"2024-09-15T23:15:56.383665+0000","last_fullsized":"2024-09-15T23:15:56.383665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:44.715419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382812+0000","last_change":"2024-09-15T23:15:54.901618+0000","last_active":"2024-09-15T23:15:56.382812+0000","last_peered":"2024-09-15T23:15:56.382812+0000","last_clean":"2024-09-15T23:15:56.382812+0000","last_became_active":"2024-09-15T23:15:54.901320+0000","last_became_peered":"2024-09-15T23:15:54.901320+0000","last_unstale":"2024-09-15T23:15:56.382812+0000","last_undegraded":"2024-09-15T23:15:56.382812+0000","last_fullsized":"2024-09-15T23:15:56.382812+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:27:08.045770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.876492+0000","last_change":"2024-09-15T23:15:52.876492+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.876492+0000","last_undegraded":"2024-09-15T23:15:52.876492+0000","last_fullsized":"2024-09-15T23:15:52.876492+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383939+0000","last_change":"2024-09-15T23:15:54.906698+0000","last_active":"2024-09-15T23:15:56.383939+0000","last_peered":"2024-09-15T23:15:56.383939+0000","last_clean":"2024-09-15T23:15:56.383939+0000","last_became_active":"2024-09-15T23:15:54.906420+0000","last_became_peered":"2024-09-15T23:15:54.906420+0000","last_unstale":"2024-09-15T23:15:56.383939+0000","last_undegraded":"2024-09-15T23:15:56.383939+0000","last_fullsized":"2024-09-15T23:15:56.383939+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:23.345381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1e","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383715+0000","last_change":"2024-09-15T23:15:53.899891+0000","last_active":"2024-09-15T23:15:56.383715+0000","last_peered":"2024-09-15T23:15:56.383715+0000","last_clean":"2024-09-15T23:15:56.383715+0000","last_became_active":"2024-09-15T23:15:53.899625+0000","last_became_peered":"2024-09-15T23:15:53.899625+0000","last_unstale":"2024-09-15T23:15:56.383715+0000","last_undegraded":"2024-09-15T23:15:56.383715+0000","last_fullsized":"2024-09-15T23:15:56.383715+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:25:50.828449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.880276+0000","last_change":"2024-09-15T23:15:52.880276+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.880276+0000","last_undegraded":"2024-09-15T23:15:52.880276+0000","last_fullsized":"2024-09-15T23:15:52.880276+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.876682+0000","last_change":"2024-09-15T23:15:52.876682+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.876682+0000","last_undegraded":"2024-09-15T23:15:52.876682+0000","last_fullsized":"2024-09-15T23:15:52.876682+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382496+0000","last_change":"2024-09-15T23:15:53.898588+0000","last_active":"2024-09-15T23:15:56.382496+0000","last_peered":"2024-09-15T23:15:56.382496+0000","last_clean":"2024-09-15T23:15:56.382496+0000","last_became_active":"2024-09-15T23:15:53.898307+0000","last_became_peered":"2024-09-15T23:15:53.898307+0000","last_unstale":"2024-09-15T23:15:56.382496+0000","last_undegraded":"2024-09-15T23:15:56.382496+0000","last_fullsized":"2024-09-15T23:15:56.382496+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:38:25.728830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.879239+0000","last_change":"2024-09-15T23:15:52.879239+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.879239+0000","last_undegraded":"2024-09-15T23:15:52.879239+0000","last_fullsized":"2024-09-15T23:15:52.879239+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.275987+0000","last_change":"2024-09-15T23:15:54.911292+0000","last_active":"2024-09-15T23:15:56.275987+0000","last_peered":"2024-09-15T23:15:56.275987+0000","last_clean":"2024-09-15T23:15:56.275987+0000","last_became_active":"2024-09-15T23:15:54.910952+0000","last_became_peered":"2024-09-15T23:15:54.910952+0000","last_unstale":"2024-09-15T23:15:56.275987+0000","last_undegraded":"2024-09-15T23:15:56.275987+0000","last_fullsized":"2024-09-15T23:15:56.275987+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:42.049462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.276093+0000","last_change":"2024-09-15T23:15:53.900588+0000","last_active":"2024-09-15T23:15:56.276093+0000","last_peered":"2024-09-15T23:15:56.276093+0000","last_clean":"2024-09-15T23:15:56.276093+0000","last_became_active":"2024-09-15T23:15:53.900366+0000","last_became_peered":"2024-09-15T23:15:53.900366+0000","last_unstale":"2024-09-15T23:15:56.276093+0000","last_undegraded":"2024-09-15T23:15:56.276093+0000","last_fullsized":"2024-09-15T23:15:56.276093+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:24.362527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382521+0000","last_change":"2024-09-15T23:15:54.906993+0000","last_active":"2024-09-15T23:15:56.382521+0000","last_peered":"2024-09-15T23:15:56.382521+0000","last_clean":"2024-09-15T23:15:56.382521+0000","last_became_active":"2024-09-15T23:15:54.906662+0000","last_became_peered":"2024-09-15T23:15:54.906662+0000","last_unstale":"2024-09-15T23:15:56.382521+0000","last_undegraded":"2024-09-15T23:15:56.382521+0000","last_fullsized":"2024-09-15T23:15:56.382521+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:20.992800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382206+0000","last_change":"2024-09-15T23:15:53.897383+0000","last_active":"2024-09-15T23:15:56.382206+0000","last_peered":"2024-09-15T23:15:56.382206+0000","last_clean":"2024-09-15T23:15:56.382206+0000","last_became_active":"2024-09-15T23:15:53.897092+0000","last_became_peered":"2024-09-15T23:15:53.897092+0000","last_unstale":"2024-09-15T23:15:56.382206+0000","last_undegraded":"2024-09-15T23:15:56.382206+0000","last_fullsized":"2024-09-15T23:15:56.382206+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:10.169770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.880676+0000","last_change":"2024-09-15T23:15:52.880676+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.880676+0000","last_undegraded":"2024-09-15T23:15:52.880676+0000","last_fullsized":"2024-09-15T23:15:52.880676+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.876565+0000","last_change":"2024-09-15T23:15:52.876565+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.876565+0000","last_undegraded":"2024-09-15T23:15:52.876565+0000","last_fullsized":"2024-09-15T23:15:52.876565+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"81'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383356+0000","last_change":"2024-09-15T23:15:53.895758+0000","last_active":"2024-09-15T23:15:56.383356+0000","last_peered":"2024-09-15T23:15:56.383356+0000","last_clean":"2024-09-15T23:15:56.383356+0000","last_became_active":"2024-09-15T23:15:53.895493+0000","last_became_peered":"2024-09-15T23:15:53.895493+0000","last_unstale":"2024-09-15T23:15:56.383356+0000","last_undegraded":"2024-09-15T23:15:56.383356+0000","last_fullsized":"2024-09-15T23:15:56.383356+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:54:45.779651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383425+0000","last_change":"2024-09-15T23:15:54.904531+0000","last_active":"2024-09-15T23:15:56.383425+0000","last_peered":"2024-09-15T23:15:56.383425+0000","last_clean":"2024-09-15T23:15:56.383425+0000","last_became_active":"2024-09-15T23:15:54.904250+0000","last_became_peered":"2024-09-15T23:15:54.904250+0000","last_unstale":"2024-09-15T23:15:56.383425+0000","last_undegraded":"2024-09-15T23:15:56.383425+0000","last_fullsized":"2024-09-15T23:15:56.383425+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:43:33.055440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"81'6","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.276398+0000","last_change":"2024-09-15T23:15:53.895740+0000","last_active":"2024-09-15T23:15:56.276398+0000","last_peered":"2024-09-15T23:15:56.276398+0000","last_clean":"2024-09-15T23:15:56.276398+0000","last_became_active":"2024-09-15T23:15:53.895480+0000","last_became_peered":"2024-09-15T23:15:53.895480+0000","last_unstale":"2024-09-15T23:15:56.276398+0000","last_undegraded":"2024-09-15T23:15:56.276398+0000","last_fullsized":"2024-09-15T23:15:56.276398+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:05.057467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.276131+0000","last_change":"2024-09-15T23:15:53.893711+0000","last_active":"2024-09-15T23:15:56.276131+0000","last_peered":"2024-09-15T23:15:56.276131+0000","last_clean":"2024-09-15T23:15:56.276131+0000","last_became_active":"2024-09-15T23:15:53.893432+0000","last_became_peered":"2024-09-15T23:15:53.893432+0000","last_unstale":"2024-09-15T23:15:56.276131+0000","last_undegraded":"2024-09-15T23:15:56.276131+0000","last_fullsized":"2024-09-15T23:15:56.276131+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:58:01.036404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.878742+0000","last_change":"2024-09-15T23:15:52.878742+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.878742+0000","last_undegraded":"2024-09-15T23:15:52.878742+0000","last_fullsized":"2024-09-15T23:15:52.878742+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382734+0000","last_change":"2024-09-15T23:15:54.911495+0000","last_active":"2024-09-15T23:15:56.382734+0000","last_peered":"2024-09-15T23:15:56.382734+0000","last_clean":"2024-09-15T23:15:56.382734+0000","last_became_active":"2024-09-15T23:15:54.911165+0000","last_became_peered":"2024-09-15T23:15:54.911165+0000","last_unstale":"2024-09-15T23:15:56.382734+0000","last_undegraded":"2024-09-15T23:15:56.382734+0000","last_fullsized":"2024-09-15T23:15:56.382734+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:00:46.921868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.878729+0000","last_change":"2024-09-15T23:15:52.878729+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.878729+0000","last_undegraded":"2024-09-15T23:15:52.878729+0000","last_fullsized":"2024-09-15T23:15:52.878729+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383393+0000","last_change":"2024-09-15T23:15:54.899159+0000","last_active":"2024-09-15T23:15:56.383393+0000","last_peered":"2024-09-15T23:15:56.383393+0000","last_clean":"2024-09-15T23:15:56.383393+0000","last_became_active":"2024-09-15T23:15:54.898842+0000","last_became_peered":"2024-09-15T23:15:54.898842+0000","last_unstale":"2024-09-15T23:15:56.383393+0000","last_undegraded":"2024-09-15T23:15:56.383393+0000","last_fullsized":"2024-09-15T23:15:56.383393+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:23:49.789348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.878721+0000","last_change":"2024-09-15T23:15:52.878721+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.878721+0000","last_undegraded":"2024-09-15T23:15:52.878721+0000","last_fullsized":"2024-09-15T23:15:52.878721+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.880235+0000","last_change":"2024-09-15T23:15:52.880235+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.880235+0000","last_undegraded":"2024-09-15T23:15:52.880235+0000","last_fullsized":"2024-09-15T23:15:52.880235+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.875743+0000","last_change":"2024-09-15T23:15:52.875743+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.875743+0000","last_undegraded":"2024-09-15T23:15:52.875743+0000","last_fullsized":"2024-09-15T23:15:52.875743+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382925+0000","last_change":"2024-09-15T23:15:54.894455+0000","last_active":"2024-09-15T23:15:56.382925+0000","last_peered":"2024-09-15T23:15:56.382925+0000","last_clean":"2024-09-15T23:15:56.382925+0000","last_became_active":"2024-09-15T23:15:54.894157+0000","last_became_peered":"2024-09-15T23:15:54.894157+0000","last_unstale":"2024-09-15T23:15:56.382925+0000","last_undegraded":"2024-09-15T23:15:56.382925+0000","last_fullsized":"2024-09-15T23:15:56.382925+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:52.302621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.875754+0000","last_change":"2024-09-15T23:15:52.875754+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.875754+0000","last_undegraded":"2024-09-15T23:15:52.875754+0000","last_fullsized":"2024-09-15T23:15:52.875754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383121+0000","last_change":"2024-09-15T23:15:54.900984+0000","last_active":"2024-09-15T23:15:56.383121+0000","last_peered":"2024-09-15T23:15:56.383121+0000","last_clean":"2024-09-15T23:15:56.383121+0000","last_became_active":"2024-09-15T23:15:54.900709+0000","last_became_peered":"2024-09-15T23:15:54.900709+0000","last_unstale":"2024-09-15T23:15:56.383121+0000","last_undegraded":"2024-09-15T23:15:56.383121+0000","last_fullsized":"2024-09-15T23:15:56.383121+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:35:04.409834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.876188+0000","last_change":"2024-09-15T23:15:52.876188+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.876188+0000","last_undegraded":"2024-09-15T23:15:52.876188+0000","last_fullsized":"2024-09-15T23:15:52.876188+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.276226+0000","last_change":"2024-09-15T23:15:54.899731+0000","last_active":"2024-09-15T23:15:56.276226+0000","last_peered":"2024-09-15T23:15:56.276226+0000","last_clean":"2024-09-15T23:15:56.276226+0000","last_became_active":"2024-09-15T23:15:54.899453+0000","last_became_peered":"2024-09-15T23:15:54.899453+0000","last_unstale":"2024-09-15T23:15:56.276226+0000","last_undegraded":"2024-09-15T23:15:56.276226+0000","last_fullsized":"2024-09-15T23:15:56.276226+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:52.766645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.876047+0000","last_change":"2024-09-15T23:15:52.876047+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.876047+0000","last_undegraded":"2024-09-15T23:15:52.876047+0000","last_fullsized":"2024-09-15T23:15:52.876047+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.276158+0000","last_change":"2024-09-15T23:15:54.896709+0000","last_active":"2024-09-15T23:15:56.276158+0000","last_peered":"2024-09-15T23:15:56.276158+0000","last_clean":"2024-09-15T23:15:56.276158+0000","last_became_active":"2024-09-15T23:15:54.896326+0000","last_became_peered":"2024-09-15T23:15:54.896326+0000","last_unstale":"2024-09-15T23:15:56.276158+0000","last_undegraded":"2024-09-15T23:15:56.276158+0000","last_fullsized":"2024-09-15T23:15:56.276158+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:47:58.493900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.875687+0000","last_change":"2024-09-15T23:15:52.875687+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.875687+0000","last_undegraded":"2024-09-15T23:15:52.875687+0000","last_fullsized":"2024-09-15T23:15:52.875687+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383554+0000","last_change":"2024-09-15T23:15:54.897799+0000","last_active":"2024-09-15T23:15:56.383554+0000","last_peered":"2024-09-15T23:15:56.383554+0000","last_clean":"2024-09-15T23:15:56.383554+0000","last_became_active":"2024-09-15T23:15:54.897468+0000","last_became_peered":"2024-09-15T23:15:54.897468+0000","last_unstale":"2024-09-15T23:15:56.383554+0000","last_undegraded":"2024-09-15T23:15:56.383554+0000","last_fullsized":"2024-09-15T23:15:56.383554+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:04:08.287676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382587+0000","last_change":"2024-09-15T23:15:53.894527+0000","last_active":"2024-09-15T23:15:56.382587+0000","last_peered":"2024-09-15T23:15:56.382587+0000","last_clean":"2024-09-15T23:15:56.382587+0000","last_became_active":"2024-09-15T23:15:53.894233+0000","last_became_peered":"2024-09-15T23:15:53.894233+0000","last_unstale":"2024-09-15T23:15:56.382587+0000","last_undegraded":"2024-09-15T23:15:56.382587+0000","last_fullsized":"2024-09-15T23:15:56.382587+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:51:14.198694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383690+0000","last_change":"2024-09-15T23:15:54.904641+0000","last_active":"2024-09-15T23:15:56.383690+0000","last_peered":"2024-09-15T23:15:56.383690+0000","last_clean":"2024-09-15T23:15:56.383690+0000","last_became_active":"2024-09-15T23:15:54.904370+0000","last_became_peered":"2024-09-15T23:15:54.904370+0000","last_unstale":"2024-09-15T23:15:56.383690+0000","last_undegraded":"2024-09-15T23:15:56.383690+0000","last_fullsized":"2024-09-15T23:15:56.383690+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:33:50.355276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.878138+0000","last_change":"2024-09-15T23:15:52.878138+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.878138+0000","last_undegraded":"2024-09-15T23:15:52.878138+0000","last_fullsized":"2024-09-15T23:15:52.878138+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.878152+0000","last_change":"2024-09-15T23:15:52.878152+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.878152+0000","last_undegraded":"2024-09-15T23:15:52.878152+0000","last_fullsized":"2024-09-15T23:15:52.878152+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383459+0000","last_change":"2024-09-15T23:15:53.890515+0000","last_active":"2024-09-15T23:15:56.383459+0000","last_peered":"2024-09-15T23:15:56.383459+0000","last_clean":"2024-09-15T23:15:56.383459+0000","last_became_active":"2024-09-15T23:15:53.890230+0000","last_became_peered":"2024-09-15T23:15:53.890230+0000","last_unstale":"2024-09-15T23:15:56.383459+0000","last_undegraded":"2024-09-15T23:15:56.383459+0000","last_fullsized":"2024-09-15T23:15:56.383459+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:02.636477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383555+0000","last_change":"2024-09-15T23:15:53.895098+0000","last_active":"2024-09-15T23:15:56.383555+0000","last_peered":"2024-09-15T23:15:56.383555+0000","last_clean":"2024-09-15T23:15:56.383555+0000","last_became_active":"2024-09-15T23:15:53.893423+0000","last_became_peered":"2024-09-15T23:15:53.893423+0000","last_unstale":"2024-09-15T23:15:56.383555+0000","last_undegraded":"2024-09-15T23:15:56.383555+0000","last_fullsized":"2024-09-15T23:15:56.383555+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:05.970626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383220+0000","last_change":"2024-09-15T23:15:54.903195+0000","last_active":"2024-09-15T23:15:56.383220+0000","last_peered":"2024-09-15T23:15:56.383220+0000","last_clean":"2024-09-15T23:15:56.383220+0000","last_became_active":"2024-09-15T23:15:54.902860+0000","last_became_peered":"2024-09-15T23:15:54.902860+0000","last_unstale":"2024-09-15T23:15:56.383220+0000","last_undegraded":"2024-09-15T23:15:56.383220+0000","last_fullsized":"2024-09-15T23:15:56.383220+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:18:55.627155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382407+0000","last_change":"2024-09-15T23:15:53.897951+0000","last_active":"2024-09-15T23:15:56.382407+0000","last_peered":"2024-09-15T23:15:56.382407+0000","last_clean":"2024-09-15T23:15:56.382407+0000","last_became_active":"2024-09-15T23:15:53.897654+0000","last_became_peered":"2024-09-15T23:15:53.897654+0000","last_unstale":"2024-09-15T23:15:56.382407+0000","last_undegraded":"2024-09-15T23:15:56.382407+0000","last_fullsized":"2024-09-15T23:15:56.382407+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:52:21.447053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383263+0000","last_change":"2024-09-15T23:15:53.901460+0000","last_active":"2024-09-15T23:15:56.383263+0000","last_peered":"2024-09-15T23:15:56.383263+0000","last_clean":"2024-09-15T23:15:56.383263+0000","last_became_active":"2024-09-15T23:15:53.901261+0000","last_became_peered":"2024-09-15T23:15:53.901261+0000","last_unstale":"2024-09-15T23:15:56.383263+0000","last_undegraded":"2024-09-15T23:15:56.383263+0000","last_fullsized":"2024-09-15T23:15:56.383263+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:06.343575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.276260+0000","last_change":"2024-09-15T23:15:54.897440+0000","last_active":"2024-09-15T23:15:56.276260+0000","last_peered":"2024-09-15T23:15:56.276260+0000","last_clean":"2024-09-15T23:15:56.276260+0000","last_became_active":"2024-09-15T23:15:54.897175+0000","last_became_peered":"2024-09-15T23:15:54.897175+0000","last_unstale":"2024-09-15T23:15:56.276260+0000","last_undegraded":"2024-09-15T23:15:56.276260+0000","last_fullsized":"2024-09-15T23:15:56.276260+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:47:37.405707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.875198+0000","last_change":"2024-09-15T23:15:52.875198+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.875198+0000","last_undegraded":"2024-09-15T23:15:52.875198+0000","last_fullsized":"2024-09-15T23:15:52.875198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:15:53.872244+0000","last_change":"2024-09-15T23:15:53.872244+0000","last_active":"2024-09-15T23:15:53.872244+0000","last_peered":"2024-09-15T23:15:53.872244+0000","last_clean":"2024-09-15T23:15:53.872244+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:53.872244+0000","last_undegraded":"2024-09-15T23:15:53.872244+0000","last_fullsized":"2024-09-15T23:15:53.872244+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.876072+0000","last_change":"2024-09-15T23:15:52.876072+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.876072+0000","last_undegraded":"2024-09-15T23:15:52.876072+0000","last_fullsized":"2024-09-15T23:15:52.876072+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383109+0000","last_change":"2024-09-15T23:15:54.906530+0000","last_active":"2024-09-15T23:15:56.383109+0000","last_peered":"2024-09-15T23:15:56.383109+0000","last_clean":"2024-09-15T23:15:56.383109+0000","last_became_active":"2024-09-15T23:15:54.906238+0000","last_became_peered":"2024-09-15T23:15:54.906238+0000","last_unstale":"2024-09-15T23:15:56.383109+0000","last_undegraded":"2024-09-15T23:15:56.383109+0000","last_fullsized":"2024-09-15T23:15:56.383109+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:41:09.389540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-09-15T23:15:52.878091+0000","last_change":"2024-09-15T23:15:52.878091+0000","last_active":"2024-09-15T23:15:52.869934+0000","last_peered":"2024-09-15T23:15:52.869934+0000","last_clean":"2024-09-15T23:15:52.869934+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:15:52.878091+0000","last_undegraded":"2024-09-15T23:15:52.878091+0000","last_fullsized":"2024-09-15T23:15:52.878091+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":276,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-09-15T23:15:52.879325+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:15:52.879325+0000","last_peered":"2024-09-15T23:15:52.879325+0000","last_clean":"2024-09-15T23:15:52.879325+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:15:52.879325+0000","last_undegraded":"2024-09-15T23:15:52.879325+0000","last_fullsized":"2024-09-15T23:15:52.879325+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":56,"acting":56,"num_store_stats":4},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":1736,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":4042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476788,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40436,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331404,"statfs":{"total":96636764160,"available":96595357696,"internally_reserved":0,"allocated":950272,"data_stored":407641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476785,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40428,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331412,"statfs":{"total":96636764160,"available":96595365888,"internally_reserved":0,"allocated":937984,"data_stored":401824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476787,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36856,"kb_used_data":1508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334984,"statfs":{"total":96636764160,"available":96599023616,"internally_reserved":0,"allocated":1544192,"data_stored":998009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476787,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":950272,"data_stored":407641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542194,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":987136,"data_stored":422295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542194,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36320,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335520,"statfs":{"total":96636764160,"available":96599572480,"internally_reserved":0,"allocated":991232,"data_stored":422329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542193,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36892,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334948,"statfs":{"total":96636764160,"available":96598986752,"internally_reserved":0,"allocated":1572864,"data_stored":1011141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542195,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":987136,"data_stored":421377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:16:00.875 INFO:tasks.ceph.mds.a.smithi123.stderr:2024-09-15T23:16:00.873+0000 7fcf72783640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:16:02.290 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:16:02.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.397+0000 7f792d8e6640 1 Processor -- start 2024-09-15T23:16:02.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.397+0000 7f792d8e6640 1 -- start start 2024-09-15T23:16:02.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.398+0000 7f792d8e6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f792815e6d0 0x7f792815f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:02.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.398+0000 7f792d8e6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f792806cf30 0x7f792806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:02.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.398+0000 7f792d8e6640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79280cc990 con 0x7f79280cb980 2024-09-15T23:16:02.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.398+0000 7f792d8e6640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f792815fcd0 con 0x7f792815e6d0 2024-09-15T23:16:02.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.398+0000 7f792d8e6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7928162440 con 0x7f792806cf30 2024-09-15T23:16:02.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.398+0000 7f7926ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f792815e6d0 0x7f792815f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:02.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.398+0000 7f7926ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f792815e6d0 0x7f792815f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54024/0 (socket says 172.21.15.123:54024) 2024-09-15T23:16:02.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.398+0000 7f79267fc640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f79280cb980 0x7f7928162c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:44062/0 (socket says 172.21.15.123:44062) 2024-09-15T23:16:02.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.398+0000 7f7926ffd640 1 -- 172.21.15.123:0/3482500794 learned_addr learned my addr 172.21.15.123:0/3482500794 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:02.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.398+0000 7f79277fe640 1 --2- 172.21.15.123:0/3482500794 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f792806cf30 0x7f792806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:02.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.398+0000 7f7926ffd640 1 -- 172.21.15.123:0/3482500794 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f792806cf30 msgr2=0x7f792806d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:02.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.399+0000 7f7926ffd640 1 --2- 172.21.15.123:0/3482500794 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f792806cf30 0x7f792806d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:02.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.399+0000 7f7926ffd640 1 -- 172.21.15.123:0/3482500794 >> v1:172.21.15.123:6789/0 conn(0x7f79280cb980 legacy=0x7f7928162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:02.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.398+0000 7f7925ffb640 1 -- 172.21.15.123:0/3482500794 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 521034919 0 0) 0x7f79280cc990 con 0x7f79280cb980 2024-09-15T23:16:02.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.399+0000 7f7926ffd640 1 -- 172.21.15.123:0/3482500794 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79280cc3d0 con 0x7f792815e6d0 2024-09-15T23:16:02.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.399+0000 7f79277fe640 1 --2- 172.21.15.123:0/3482500794 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f792806cf30 0x7f792806d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:16:02.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.399+0000 7f7926ffd640 1 --2- 172.21.15.123:0/3482500794 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f792815e6d0 0x7f792815f790 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f7918009870 tx=0x7f791802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a7ea3a2d65a0fb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:02.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.399+0000 7f7925ffb640 1 -- 172.21.15.123:0/3482500794 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7918037070 con 0x7f792815e6d0 2024-09-15T23:16:02.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.399+0000 7f7925ffb640 1 -- 172.21.15.123:0/3482500794 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7918032440 con 0x7f792815e6d0 2024-09-15T23:16:02.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.399+0000 7f7925ffb640 1 -- 172.21.15.123:0/3482500794 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7918032810 con 0x7f792815e6d0 2024-09-15T23:16:02.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.400+0000 7f792d8e6640 1 -- 172.21.15.123:0/3482500794 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f792815e6d0 msgr2=0x7f792815f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:02.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.400+0000 7f792d8e6640 1 --2- 172.21.15.123:0/3482500794 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f792815e6d0 0x7f792815f790 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f7918009870 tx=0x7f791802a130 comp rx=0 tx=0).stop 2024-09-15T23:16:02.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.400+0000 7f792d8e6640 1 -- 172.21.15.123:0/3482500794 shutdown_connections 2024-09-15T23:16:02.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.400+0000 7f792d8e6640 1 --2- 172.21.15.123:0/3482500794 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f792806cf30 0x7f792806d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:02.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.400+0000 7f792d8e6640 1 --2- 172.21.15.123:0/3482500794 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f792815e6d0 0x7f792815f790 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:02.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.400+0000 7f792d8e6640 1 -- 172.21.15.123:0/3482500794 >> 172.21.15.123:0/3482500794 conn(0x7f79280b4300 msgr2=0x7f79280b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:02.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.400+0000 7f792d8e6640 1 -- 172.21.15.123:0/3482500794 shutdown_connections 2024-09-15T23:16:02.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.400+0000 7f792d8e6640 1 -- 172.21.15.123:0/3482500794 wait complete. 2024-09-15T23:16:02.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.401+0000 7f792d8e6640 1 Processor -- start 2024-09-15T23:16:02.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.401+0000 7f792d8e6640 1 -- start start 2024-09-15T23:16:02.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.402+0000 7f792d8e6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f792806cf30 0x7f7928153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:02.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.402+0000 7f792d8e6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79280cb980 0x7f79281502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:02.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.402+0000 7f792d8e6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f792815e6d0 0x7f792815d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:02.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.402+0000 7f792d8e6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f792815eab0 con 0x7f79280cb980 2024-09-15T23:16:02.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.402+0000 7f792d8e6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f79281626e0 con 0x7f792806cf30 2024-09-15T23:16:02.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.402+0000 7f792d8e6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f792815ec30 con 0x7f792815e6d0 2024-09-15T23:16:02.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.402+0000 7f79267fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79280cb980 0x7f79281502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:02.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.402+0000 7f79267fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79280cb980 0x7f79281502a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54036/0 (socket says 172.21.15.123:54036) 2024-09-15T23:16:02.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.402+0000 7f79267fc640 1 -- 172.21.15.123:0/3383779582 learned_addr learned my addr 172.21.15.123:0/3383779582 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:02.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.402+0000 7f79277fe640 1 --2- 172.21.15.123:0/3383779582 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f792815e6d0 0x7f792815d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:02.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.403+0000 7f7926ffd640 1 --2- 172.21.15.123:0/3383779582 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f792806cf30 0x7f7928153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:02.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.403+0000 7f79267fc640 1 -- 172.21.15.123:0/3383779582 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f792815e6d0 msgr2=0x7f792815d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:02.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.403+0000 7f79267fc640 1 --2- 172.21.15.123:0/3383779582 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f792815e6d0 0x7f792815d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:02.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.403+0000 7f79267fc640 1 -- 172.21.15.123:0/3383779582 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f792806cf30 msgr2=0x7f7928153ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:02.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.403+0000 7f79267fc640 1 --2- 172.21.15.123:0/3383779582 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f792806cf30 0x7f7928153ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:02.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.403+0000 7f79267fc640 1 -- 172.21.15.123:0/3383779582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79280cfaa0 con 0x7f79280cb980 2024-09-15T23:16:02.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.403+0000 7f79277fe640 1 --2- 172.21.15.123:0/3383779582 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f792815e6d0 0x7f792815d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:16:02.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.403+0000 7f79267fc640 1 --2- 172.21.15.123:0/3383779582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79280cb980 0x7f79281502a0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f791c00c430 tx=0x7f791c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:02.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.403+0000 7f790ffff640 1 -- 172.21.15.123:0/3383779582 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791c0074e0 con 0x7f79280cb980 2024-09-15T23:16:02.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.403+0000 7f790ffff640 1 -- 172.21.15.123:0/3383779582 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f791c0047e0 con 0x7f79280cb980 2024-09-15T23:16:02.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.403+0000 7f790ffff640 1 -- 172.21.15.123:0/3383779582 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791c004bd0 con 0x7f79280cb980 2024-09-15T23:16:02.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.403+0000 7f792d8e6640 1 -- 172.21.15.123:0/3383779582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7928153510 con 0x7f79280cb980 2024-09-15T23:16:02.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.403+0000 7f792d8e6640 1 -- 172.21.15.123:0/3383779582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7928153ad0 con 0x7f79280cb980 2024-09-15T23:16:02.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.404+0000 7f792d8e6640 1 -- 172.21.15.123:0/3383779582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7928153cd0 con 0x7f79280cb980 2024-09-15T23:16:02.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.404+0000 7f790ffff640 1 -- 172.21.15.123:0/3383779582 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f791c011070 con 0x7f79280cb980 2024-09-15T23:16:02.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.405+0000 7f790ffff640 1 --2- 172.21.15.123:0/3383779582 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f791406c2b0 0x7f791406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:02.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.405+0000 7f790ffff640 1 -- 172.21.15.123:0/3383779582 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f791c08b0f0 con 0x7f79280cb980 2024-09-15T23:16:02.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.405+0000 7f7926ffd640 1 --2- 172.21.15.123:0/3383779582 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f791406c2b0 0x7f791406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:02.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.406+0000 7f7926ffd640 1 --2- 172.21.15.123:0/3383779582 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f791406c2b0 0x7f791406e770 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7918034000 tx=0x7f791802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:02.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.409+0000 7f790ffff640 1 -- 172.21.15.123:0/3383779582 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7928153cd0 con 0x7f79280cb980 2024-09-15T23:16:02.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.572+0000 7f792d8e6640 1 -- 172.21.15.123:0/3383779582 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f792815f790 con 0x7f791406c2b0 2024-09-15T23:16:02.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.578+0000 7f790ffff640 1 -- 172.21.15.123:0/3383779582 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252027 (secure 0 0 0) 0x7f792815f790 con 0x7f791406c2b0 2024-09-15T23:16:02.582 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:16:02.584 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:16:02.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.581+0000 7f792d8e6640 1 -- 172.21.15.123:0/3383779582 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f791406c2b0 msgr2=0x7f791406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:02.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.581+0000 7f792d8e6640 1 --2- 172.21.15.123:0/3383779582 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f791406c2b0 0x7f791406e770 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7918034000 tx=0x7f791802e000 comp rx=0 tx=0).stop 2024-09-15T23:16:02.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.581+0000 7f792d8e6640 1 -- 172.21.15.123:0/3383779582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79280cb980 msgr2=0x7f79281502a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:02.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.581+0000 7f792d8e6640 1 --2- 172.21.15.123:0/3383779582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79280cb980 0x7f79281502a0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f791c00c430 tx=0x7f791c00c8f0 comp rx=0 tx=0).stop 2024-09-15T23:16:02.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.581+0000 7f792d8e6640 1 -- 172.21.15.123:0/3383779582 shutdown_connections 2024-09-15T23:16:02.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.581+0000 7f792d8e6640 1 --2- 172.21.15.123:0/3383779582 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f792815e6d0 0x7f792815d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:02.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.581+0000 7f792d8e6640 1 --2- 172.21.15.123:0/3383779582 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f791406c2b0 0x7f791406e770 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:02.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.581+0000 7f792d8e6640 1 --2- 172.21.15.123:0/3383779582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79280cb980 0x7f79281502a0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:02.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.581+0000 7f792d8e6640 1 --2- 172.21.15.123:0/3383779582 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f792806cf30 0x7f7928153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:02.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.581+0000 7f792d8e6640 1 -- 172.21.15.123:0/3383779582 >> 172.21.15.123:0/3383779582 conn(0x7f79280b4300 msgr2=0x7f79280b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:02.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.581+0000 7f792d8e6640 1 -- 172.21.15.123:0/3383779582 shutdown_connections 2024-09-15T23:16:02.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.581+0000 7f792d8e6640 1 -- 172.21.15.123:0/3383779582 wait complete. 2024-09-15T23:16:02.594 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":195,"stamp":"2024-09-15T23:16:01.556128+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":295912,"kb_used_data":8936,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754678808,"statfs":{"total":773094113280,"available":772791099392,"internally_reserved":0,"allocated":9150464,"data_stored":4601420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":293654064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.672661"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.885737+0000","last_change":"2024-09-15T23:15:54.902805+0000","last_active":"2024-09-15T23:15:55.885737+0000","last_peered":"2024-09-15T23:15:55.885737+0000","last_clean":"2024-09-15T23:15:55.885737+0000","last_became_active":"2024-09-15T23:15:54.901328+0000","last_became_peered":"2024-09-15T23:15:54.901328+0000","last_unstale":"2024-09-15T23:15:55.885737+0000","last_undegraded":"2024-09-15T23:15:55.885737+0000","last_fullsized":"2024-09-15T23:15:55.885737+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:25.453496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.381990+0000","last_change":"2024-09-15T23:15:54.908860+0000","last_active":"2024-09-15T23:15:56.381990+0000","last_peered":"2024-09-15T23:15:56.381990+0000","last_clean":"2024-09-15T23:15:56.381990+0000","last_became_active":"2024-09-15T23:15:54.908608+0000","last_became_peered":"2024-09-15T23:15:54.908608+0000","last_unstale":"2024-09-15T23:15:56.381990+0000","last_undegraded":"2024-09-15T23:15:56.381990+0000","last_fullsized":"2024-09-15T23:15:56.381990+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:33:22.809324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382986+0000","last_change":"2024-09-15T23:15:54.895953+0000","last_active":"2024-09-15T23:15:56.382986+0000","last_peered":"2024-09-15T23:15:56.382986+0000","last_clean":"2024-09-15T23:15:56.382986+0000","last_became_active":"2024-09-15T23:15:54.895632+0000","last_became_peered":"2024-09-15T23:15:54.895632+0000","last_unstale":"2024-09-15T23:15:56.382986+0000","last_undegraded":"2024-09-15T23:15:56.382986+0000","last_fullsized":"2024-09-15T23:15:56.382986+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:30:23.433151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382408+0000","last_change":"2024-09-15T23:15:54.895888+0000","last_active":"2024-09-15T23:15:56.382408+0000","last_peered":"2024-09-15T23:15:56.382408+0000","last_clean":"2024-09-15T23:15:56.382408+0000","last_became_active":"2024-09-15T23:15:54.895558+0000","last_became_peered":"2024-09-15T23:15:54.895558+0000","last_unstale":"2024-09-15T23:15:56.382408+0000","last_undegraded":"2024-09-15T23:15:56.382408+0000","last_fullsized":"2024-09-15T23:15:56.382408+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:09:03.821475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382636+0000","last_change":"2024-09-15T23:15:54.904818+0000","last_active":"2024-09-15T23:15:56.382636+0000","last_peered":"2024-09-15T23:15:56.382636+0000","last_clean":"2024-09-15T23:15:56.382636+0000","last_became_active":"2024-09-15T23:15:54.903868+0000","last_became_peered":"2024-09-15T23:15:54.903868+0000","last_unstale":"2024-09-15T23:15:56.382636+0000","last_undegraded":"2024-09-15T23:15:56.382636+0000","last_fullsized":"2024-09-15T23:15:56.382636+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:37.663336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.886051+0000","last_change":"2024-09-15T23:15:54.893963+0000","last_active":"2024-09-15T23:15:55.886051+0000","last_peered":"2024-09-15T23:15:55.886051+0000","last_clean":"2024-09-15T23:15:55.886051+0000","last_became_active":"2024-09-15T23:15:54.893665+0000","last_became_peered":"2024-09-15T23:15:54.893665+0000","last_unstale":"2024-09-15T23:15:55.886051+0000","last_undegraded":"2024-09-15T23:15:55.886051+0000","last_fullsized":"2024-09-15T23:15:55.886051+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:15:52.391364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.884845+0000","last_change":"2024-09-15T23:15:54.904908+0000","last_active":"2024-09-15T23:15:55.884845+0000","last_peered":"2024-09-15T23:15:55.884845+0000","last_clean":"2024-09-15T23:15:55.884845+0000","last_became_active":"2024-09-15T23:15:54.904632+0000","last_became_peered":"2024-09-15T23:15:54.904632+0000","last_unstale":"2024-09-15T23:15:55.884845+0000","last_undegraded":"2024-09-15T23:15:55.884845+0000","last_fullsized":"2024-09-15T23:15:55.884845+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:13:51.442347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.885401+0000","last_change":"2024-09-15T23:15:54.896129+0000","last_active":"2024-09-15T23:15:55.885401+0000","last_peered":"2024-09-15T23:15:55.885401+0000","last_clean":"2024-09-15T23:15:55.885401+0000","last_became_active":"2024-09-15T23:15:54.895813+0000","last_became_peered":"2024-09-15T23:15:54.895813+0000","last_unstale":"2024-09-15T23:15:55.885401+0000","last_undegraded":"2024-09-15T23:15:55.885401+0000","last_fullsized":"2024-09-15T23:15:55.885401+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:37:32.375886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383920+0000","last_change":"2024-09-15T23:15:54.901116+0000","last_active":"2024-09-15T23:15:56.383920+0000","last_peered":"2024-09-15T23:15:56.383920+0000","last_clean":"2024-09-15T23:15:56.383920+0000","last_became_active":"2024-09-15T23:15:54.900244+0000","last_became_peered":"2024-09-15T23:15:54.900244+0000","last_unstale":"2024-09-15T23:15:56.383920+0000","last_undegraded":"2024-09-15T23:15:56.383920+0000","last_fullsized":"2024-09-15T23:15:56.383920+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:54.143040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.884872+0000","last_change":"2024-09-15T23:15:54.906652+0000","last_active":"2024-09-15T23:15:55.884872+0000","last_peered":"2024-09-15T23:15:55.884872+0000","last_clean":"2024-09-15T23:15:55.884872+0000","last_became_active":"2024-09-15T23:15:54.906348+0000","last_became_peered":"2024-09-15T23:15:54.906348+0000","last_unstale":"2024-09-15T23:15:55.884872+0000","last_undegraded":"2024-09-15T23:15:55.884872+0000","last_fullsized":"2024-09-15T23:15:55.884872+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:56.276523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.886010+0000","last_change":"2024-09-15T23:15:54.900931+0000","last_active":"2024-09-15T23:15:55.886010+0000","last_peered":"2024-09-15T23:15:55.886010+0000","last_clean":"2024-09-15T23:15:55.886010+0000","last_became_active":"2024-09-15T23:15:54.900661+0000","last_became_peered":"2024-09-15T23:15:54.900661+0000","last_unstale":"2024-09-15T23:15:55.886010+0000","last_undegraded":"2024-09-15T23:15:55.886010+0000","last_fullsized":"2024-09-15T23:15:55.886010+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:03:39.107644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383622+0000","last_change":"2024-09-15T23:15:54.899743+0000","last_active":"2024-09-15T23:15:56.383622+0000","last_peered":"2024-09-15T23:15:56.383622+0000","last_clean":"2024-09-15T23:15:56.383622+0000","last_became_active":"2024-09-15T23:15:54.899474+0000","last_became_peered":"2024-09-15T23:15:54.899474+0000","last_unstale":"2024-09-15T23:15:56.383622+0000","last_undegraded":"2024-09-15T23:15:56.383622+0000","last_fullsized":"2024-09-15T23:15:56.383622+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:47:21.466200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382646+0000","last_change":"2024-09-15T23:15:54.895898+0000","last_active":"2024-09-15T23:15:56.382646+0000","last_peered":"2024-09-15T23:15:56.382646+0000","last_clean":"2024-09-15T23:15:56.382646+0000","last_became_active":"2024-09-15T23:15:54.895600+0000","last_became_peered":"2024-09-15T23:15:54.895600+0000","last_unstale":"2024-09-15T23:15:56.382646+0000","last_undegraded":"2024-09-15T23:15:56.382646+0000","last_fullsized":"2024-09-15T23:15:56.382646+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:05:41.623242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382898+0000","last_change":"2024-09-15T23:15:54.907811+0000","last_active":"2024-09-15T23:15:56.382898+0000","last_peered":"2024-09-15T23:15:56.382898+0000","last_clean":"2024-09-15T23:15:56.382898+0000","last_became_active":"2024-09-15T23:15:54.906473+0000","last_became_peered":"2024-09-15T23:15:54.906473+0000","last_unstale":"2024-09-15T23:15:56.382898+0000","last_undegraded":"2024-09-15T23:15:56.382898+0000","last_fullsized":"2024-09-15T23:15:56.382898+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:41.289668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382377+0000","last_change":"2024-09-15T23:15:54.901163+0000","last_active":"2024-09-15T23:15:56.382377+0000","last_peered":"2024-09-15T23:15:56.382377+0000","last_clean":"2024-09-15T23:15:56.382377+0000","last_became_active":"2024-09-15T23:15:54.900857+0000","last_became_peered":"2024-09-15T23:15:54.900857+0000","last_unstale":"2024-09-15T23:15:56.382377+0000","last_undegraded":"2024-09-15T23:15:56.382377+0000","last_fullsized":"2024-09-15T23:15:56.382377+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:16:21.515224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.885395+0000","last_change":"2024-09-15T23:15:54.897817+0000","last_active":"2024-09-15T23:15:55.885395+0000","last_peered":"2024-09-15T23:15:55.885395+0000","last_clean":"2024-09-15T23:15:55.885395+0000","last_became_active":"2024-09-15T23:15:54.897575+0000","last_became_peered":"2024-09-15T23:15:54.897575+0000","last_unstale":"2024-09-15T23:15:55.885395+0000","last_undegraded":"2024-09-15T23:15:55.885395+0000","last_fullsized":"2024-09-15T23:15:55.885395+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:07.880031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382867+0000","last_change":"2024-09-15T23:15:54.903632+0000","last_active":"2024-09-15T23:15:56.382867+0000","last_peered":"2024-09-15T23:15:56.382867+0000","last_clean":"2024-09-15T23:15:56.382867+0000","last_became_active":"2024-09-15T23:15:54.903372+0000","last_became_peered":"2024-09-15T23:15:54.903372+0000","last_unstale":"2024-09-15T23:15:56.382867+0000","last_undegraded":"2024-09-15T23:15:56.382867+0000","last_fullsized":"2024-09-15T23:15:56.382867+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:24:41.298145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383611+0000","last_change":"2024-09-15T23:15:54.913958+0000","last_active":"2024-09-15T23:15:56.383611+0000","last_peered":"2024-09-15T23:15:56.383611+0000","last_clean":"2024-09-15T23:15:56.383611+0000","last_became_active":"2024-09-15T23:15:54.913620+0000","last_became_peered":"2024-09-15T23:15:54.913620+0000","last_unstale":"2024-09-15T23:15:56.383611+0000","last_undegraded":"2024-09-15T23:15:56.383611+0000","last_fullsized":"2024-09-15T23:15:56.383611+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:54:51.854826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.885650+0000","last_change":"2024-09-15T23:15:54.899474+0000","last_active":"2024-09-15T23:15:55.885650+0000","last_peered":"2024-09-15T23:15:55.885650+0000","last_clean":"2024-09-15T23:15:55.885650+0000","last_became_active":"2024-09-15T23:15:54.899220+0000","last_became_peered":"2024-09-15T23:15:54.899220+0000","last_unstale":"2024-09-15T23:15:55.885650+0000","last_undegraded":"2024-09-15T23:15:55.885650+0000","last_fullsized":"2024-09-15T23:15:55.885650+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:12.852829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382795+0000","last_change":"2024-09-15T23:15:54.908104+0000","last_active":"2024-09-15T23:15:56.382795+0000","last_peered":"2024-09-15T23:15:56.382795+0000","last_clean":"2024-09-15T23:15:56.382795+0000","last_became_active":"2024-09-15T23:15:54.907745+0000","last_became_peered":"2024-09-15T23:15:54.907745+0000","last_unstale":"2024-09-15T23:15:56.382795+0000","last_undegraded":"2024-09-15T23:15:56.382795+0000","last_fullsized":"2024-09-15T23:15:56.382795+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:25.144212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.381965+0000","last_change":"2024-09-15T23:15:54.897193+0000","last_active":"2024-09-15T23:15:56.381965+0000","last_peered":"2024-09-15T23:15:56.381965+0000","last_clean":"2024-09-15T23:15:56.381965+0000","last_became_active":"2024-09-15T23:15:54.896899+0000","last_became_peered":"2024-09-15T23:15:54.896899+0000","last_unstale":"2024-09-15T23:15:56.381965+0000","last_undegraded":"2024-09-15T23:15:56.381965+0000","last_fullsized":"2024-09-15T23:15:56.381965+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:05:12.918290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.886080+0000","last_change":"2024-09-15T23:15:54.906845+0000","last_active":"2024-09-15T23:15:55.886080+0000","last_peered":"2024-09-15T23:15:55.886080+0000","last_clean":"2024-09-15T23:15:55.886080+0000","last_became_active":"2024-09-15T23:15:54.906575+0000","last_became_peered":"2024-09-15T23:15:54.906575+0000","last_unstale":"2024-09-15T23:15:55.886080+0000","last_undegraded":"2024-09-15T23:15:55.886080+0000","last_fullsized":"2024-09-15T23:15:55.886080+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:49:01.051647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.884860+0000","last_change":"2024-09-15T23:15:54.904784+0000","last_active":"2024-09-15T23:15:55.884860+0000","last_peered":"2024-09-15T23:15:55.884860+0000","last_clean":"2024-09-15T23:15:55.884860+0000","last_became_active":"2024-09-15T23:15:54.904527+0000","last_became_peered":"2024-09-15T23:15:54.904527+0000","last_unstale":"2024-09-15T23:15:55.884860+0000","last_undegraded":"2024-09-15T23:15:55.884860+0000","last_fullsized":"2024-09-15T23:15:55.884860+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:30:49.228509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.885614+0000","last_change":"2024-09-15T23:15:54.892945+0000","last_active":"2024-09-15T23:15:55.885614+0000","last_peered":"2024-09-15T23:15:55.885614+0000","last_clean":"2024-09-15T23:15:55.885614+0000","last_became_active":"2024-09-15T23:15:54.892656+0000","last_became_peered":"2024-09-15T23:15:54.892656+0000","last_unstale":"2024-09-15T23:15:55.885614+0000","last_undegraded":"2024-09-15T23:15:55.885614+0000","last_fullsized":"2024-09-15T23:15:55.885614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:08.388708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.884998+0000","last_change":"2024-09-15T23:15:54.897292+0000","last_active":"2024-09-15T23:15:55.884998+0000","last_peered":"2024-09-15T23:15:55.884998+0000","last_clean":"2024-09-15T23:15:55.884998+0000","last_became_active":"2024-09-15T23:15:54.896999+0000","last_became_peered":"2024-09-15T23:15:54.896999+0000","last_unstale":"2024-09-15T23:15:55.884998+0000","last_undegraded":"2024-09-15T23:15:55.884998+0000","last_fullsized":"2024-09-15T23:15:55.884998+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:53.496982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.885676+0000","last_change":"2024-09-15T23:15:54.892926+0000","last_active":"2024-09-15T23:15:55.885676+0000","last_peered":"2024-09-15T23:15:55.885676+0000","last_clean":"2024-09-15T23:15:55.885676+0000","last_became_active":"2024-09-15T23:15:54.892511+0000","last_became_peered":"2024-09-15T23:15:54.892511+0000","last_unstale":"2024-09-15T23:15:55.885676+0000","last_undegraded":"2024-09-15T23:15:55.885676+0000","last_fullsized":"2024-09-15T23:15:55.885676+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:02.890308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383665+0000","last_change":"2024-09-15T23:15:54.905358+0000","last_active":"2024-09-15T23:15:56.383665+0000","last_peered":"2024-09-15T23:15:56.383665+0000","last_clean":"2024-09-15T23:15:56.383665+0000","last_became_active":"2024-09-15T23:15:54.905065+0000","last_became_peered":"2024-09-15T23:15:54.905065+0000","last_unstale":"2024-09-15T23:15:56.383665+0000","last_undegraded":"2024-09-15T23:15:56.383665+0000","last_fullsized":"2024-09-15T23:15:56.383665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:44.715419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.381969+0000","last_change":"2024-09-15T23:15:54.902551+0000","last_active":"2024-09-15T23:15:56.381969+0000","last_peered":"2024-09-15T23:15:56.381969+0000","last_clean":"2024-09-15T23:15:56.381969+0000","last_became_active":"2024-09-15T23:15:54.902299+0000","last_became_peered":"2024-09-15T23:15:54.902299+0000","last_unstale":"2024-09-15T23:15:56.381969+0000","last_undegraded":"2024-09-15T23:15:56.381969+0000","last_fullsized":"2024-09-15T23:15:56.381969+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:17.956405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382812+0000","last_change":"2024-09-15T23:15:54.901618+0000","last_active":"2024-09-15T23:15:56.382812+0000","last_peered":"2024-09-15T23:15:56.382812+0000","last_clean":"2024-09-15T23:15:56.382812+0000","last_became_active":"2024-09-15T23:15:54.901320+0000","last_became_peered":"2024-09-15T23:15:54.901320+0000","last_unstale":"2024-09-15T23:15:56.382812+0000","last_undegraded":"2024-09-15T23:15:56.382812+0000","last_fullsized":"2024-09-15T23:15:56.382812+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:27:08.045770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.885513+0000","last_change":"2024-09-15T23:15:54.899856+0000","last_active":"2024-09-15T23:15:55.885513+0000","last_peered":"2024-09-15T23:15:55.885513+0000","last_clean":"2024-09-15T23:15:55.885513+0000","last_became_active":"2024-09-15T23:15:54.899606+0000","last_became_peered":"2024-09-15T23:15:54.899606+0000","last_unstale":"2024-09-15T23:15:55.885513+0000","last_undegraded":"2024-09-15T23:15:55.885513+0000","last_fullsized":"2024-09-15T23:15:55.885513+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:09:31.744756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.381949+0000","last_change":"2024-09-15T23:15:54.896329+0000","last_active":"2024-09-15T23:15:56.381949+0000","last_peered":"2024-09-15T23:15:56.381949+0000","last_clean":"2024-09-15T23:15:56.381949+0000","last_became_active":"2024-09-15T23:15:54.895984+0000","last_became_peered":"2024-09-15T23:15:54.895984+0000","last_unstale":"2024-09-15T23:15:56.381949+0000","last_undegraded":"2024-09-15T23:15:56.381949+0000","last_fullsized":"2024-09-15T23:15:56.381949+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:49:26.829560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.381829+0000","last_change":"2024-09-15T23:15:54.897680+0000","last_active":"2024-09-15T23:15:56.381829+0000","last_peered":"2024-09-15T23:15:56.381829+0000","last_clean":"2024-09-15T23:15:56.381829+0000","last_became_active":"2024-09-15T23:15:54.897416+0000","last_became_peered":"2024-09-15T23:15:54.897416+0000","last_unstale":"2024-09-15T23:15:56.381829+0000","last_undegraded":"2024-09-15T23:15:56.381829+0000","last_fullsized":"2024-09-15T23:15:56.381829+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:49:01.051647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.885724+0000","last_change":"2024-09-15T23:15:54.897285+0000","last_active":"2024-09-15T23:15:55.885724+0000","last_peered":"2024-09-15T23:15:55.885724+0000","last_clean":"2024-09-15T23:15:55.885724+0000","last_became_active":"2024-09-15T23:15:54.897022+0000","last_became_peered":"2024-09-15T23:15:54.897022+0000","last_unstale":"2024-09-15T23:15:55.885724+0000","last_undegraded":"2024-09-15T23:15:55.885724+0000","last_fullsized":"2024-09-15T23:15:55.885724+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:23:34.477520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1f","version":"81'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.885909+0000","last_change":"2024-09-15T23:15:53.897581+0000","last_active":"2024-09-15T23:15:55.885909+0000","last_peered":"2024-09-15T23:15:55.885909+0000","last_clean":"2024-09-15T23:15:55.885909+0000","last_became_active":"2024-09-15T23:15:53.897338+0000","last_became_peered":"2024-09-15T23:15:53.897338+0000","last_unstale":"2024-09-15T23:15:55.885909+0000","last_undegraded":"2024-09-15T23:15:55.885909+0000","last_fullsized":"2024-09-15T23:15:55.885909+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:14:53.923415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383939+0000","last_change":"2024-09-15T23:15:54.906698+0000","last_active":"2024-09-15T23:15:56.383939+0000","last_peered":"2024-09-15T23:15:56.383939+0000","last_clean":"2024-09-15T23:15:56.383939+0000","last_became_active":"2024-09-15T23:15:54.906420+0000","last_became_peered":"2024-09-15T23:15:54.906420+0000","last_unstale":"2024-09-15T23:15:56.383939+0000","last_undegraded":"2024-09-15T23:15:56.383939+0000","last_fullsized":"2024-09-15T23:15:56.383939+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:23.345381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1e","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383715+0000","last_change":"2024-09-15T23:15:53.899891+0000","last_active":"2024-09-15T23:15:56.383715+0000","last_peered":"2024-09-15T23:15:56.383715+0000","last_clean":"2024-09-15T23:15:56.383715+0000","last_became_active":"2024-09-15T23:15:53.899625+0000","last_became_peered":"2024-09-15T23:15:53.899625+0000","last_unstale":"2024-09-15T23:15:56.383715+0000","last_undegraded":"2024-09-15T23:15:56.383715+0000","last_fullsized":"2024-09-15T23:15:56.383715+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:25:50.828449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.886321+0000","last_change":"2024-09-15T23:15:54.893643+0000","last_active":"2024-09-15T23:15:55.886321+0000","last_peered":"2024-09-15T23:15:55.886321+0000","last_clean":"2024-09-15T23:15:55.886321+0000","last_became_active":"2024-09-15T23:15:54.893241+0000","last_became_peered":"2024-09-15T23:15:54.893241+0000","last_unstale":"2024-09-15T23:15:55.886321+0000","last_undegraded":"2024-09-15T23:15:55.886321+0000","last_fullsized":"2024-09-15T23:15:55.886321+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:17.956405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.885965+0000","last_change":"2024-09-15T23:15:53.900979+0000","last_active":"2024-09-15T23:15:55.885965+0000","last_peered":"2024-09-15T23:15:55.885965+0000","last_clean":"2024-09-15T23:15:55.885965+0000","last_became_active":"2024-09-15T23:15:53.900578+0000","last_became_peered":"2024-09-15T23:15:53.900578+0000","last_unstale":"2024-09-15T23:15:55.885965+0000","last_undegraded":"2024-09-15T23:15:55.885965+0000","last_fullsized":"2024-09-15T23:15:55.885965+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:38:21.789099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.884669+0000","last_change":"2024-09-15T23:15:54.903888+0000","last_active":"2024-09-15T23:15:55.884669+0000","last_peered":"2024-09-15T23:15:55.884669+0000","last_clean":"2024-09-15T23:15:55.884669+0000","last_became_active":"2024-09-15T23:15:54.903624+0000","last_became_peered":"2024-09-15T23:15:54.903624+0000","last_unstale":"2024-09-15T23:15:55.884669+0000","last_undegraded":"2024-09-15T23:15:55.884669+0000","last_fullsized":"2024-09-15T23:15:55.884669+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:31:23.345381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.886311+0000","last_change":"2024-09-15T23:15:53.894008+0000","last_active":"2024-09-15T23:15:55.886311+0000","last_peered":"2024-09-15T23:15:55.886311+0000","last_clean":"2024-09-15T23:15:55.886311+0000","last_became_active":"2024-09-15T23:15:53.893703+0000","last_became_peered":"2024-09-15T23:15:53.893703+0000","last_unstale":"2024-09-15T23:15:55.886311+0000","last_undegraded":"2024-09-15T23:15:55.886311+0000","last_fullsized":"2024-09-15T23:15:55.886311+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:36:59.404949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.885645+0000","last_change":"2024-09-15T23:15:54.903291+0000","last_active":"2024-09-15T23:15:55.885645+0000","last_peered":"2024-09-15T23:15:55.885645+0000","last_clean":"2024-09-15T23:15:55.885645+0000","last_became_active":"2024-09-15T23:15:54.903023+0000","last_became_peered":"2024-09-15T23:15:54.903023+0000","last_unstale":"2024-09-15T23:15:55.885645+0000","last_undegraded":"2024-09-15T23:15:55.885645+0000","last_fullsized":"2024-09-15T23:15:55.885645+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:07:27.332937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382496+0000","last_change":"2024-09-15T23:15:53.898588+0000","last_active":"2024-09-15T23:15:56.382496+0000","last_peered":"2024-09-15T23:15:56.382496+0000","last_clean":"2024-09-15T23:15:56.382496+0000","last_became_active":"2024-09-15T23:15:53.898307+0000","last_became_peered":"2024-09-15T23:15:53.898307+0000","last_unstale":"2024-09-15T23:15:56.382496+0000","last_undegraded":"2024-09-15T23:15:56.382496+0000","last_fullsized":"2024-09-15T23:15:56.382496+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:38:25.728830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.886262+0000","last_change":"2024-09-15T23:15:54.893603+0000","last_active":"2024-09-15T23:15:55.886262+0000","last_peered":"2024-09-15T23:15:55.886262+0000","last_clean":"2024-09-15T23:15:55.886262+0000","last_became_active":"2024-09-15T23:15:54.893203+0000","last_became_peered":"2024-09-15T23:15:54.893203+0000","last_unstale":"2024-09-15T23:15:55.886262+0000","last_undegraded":"2024-09-15T23:15:55.886262+0000","last_fullsized":"2024-09-15T23:15:55.886262+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:05:12.918290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.884323+0000","last_change":"2024-09-15T23:15:53.893999+0000","last_active":"2024-09-15T23:15:55.884323+0000","last_peered":"2024-09-15T23:15:55.884323+0000","last_clean":"2024-09-15T23:15:55.884323+0000","last_became_active":"2024-09-15T23:15:53.893728+0000","last_became_peered":"2024-09-15T23:15:53.893728+0000","last_unstale":"2024-09-15T23:15:55.884323+0000","last_undegraded":"2024-09-15T23:15:55.884323+0000","last_fullsized":"2024-09-15T23:15:55.884323+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:14:22.735398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.275987+0000","last_change":"2024-09-15T23:15:54.911292+0000","last_active":"2024-09-15T23:15:56.275987+0000","last_peered":"2024-09-15T23:15:56.275987+0000","last_clean":"2024-09-15T23:15:56.275987+0000","last_became_active":"2024-09-15T23:15:54.910952+0000","last_became_peered":"2024-09-15T23:15:54.910952+0000","last_unstale":"2024-09-15T23:15:56.275987+0000","last_undegraded":"2024-09-15T23:15:56.275987+0000","last_fullsized":"2024-09-15T23:15:56.275987+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:42.049462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.276093+0000","last_change":"2024-09-15T23:15:53.900588+0000","last_active":"2024-09-15T23:15:56.276093+0000","last_peered":"2024-09-15T23:15:56.276093+0000","last_clean":"2024-09-15T23:15:56.276093+0000","last_became_active":"2024-09-15T23:15:53.900366+0000","last_became_peered":"2024-09-15T23:15:53.900366+0000","last_unstale":"2024-09-15T23:15:56.276093+0000","last_undegraded":"2024-09-15T23:15:56.276093+0000","last_fullsized":"2024-09-15T23:15:56.276093+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:24.362527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382521+0000","last_change":"2024-09-15T23:15:54.906993+0000","last_active":"2024-09-15T23:15:56.382521+0000","last_peered":"2024-09-15T23:15:56.382521+0000","last_clean":"2024-09-15T23:15:56.382521+0000","last_became_active":"2024-09-15T23:15:54.906662+0000","last_became_peered":"2024-09-15T23:15:54.906662+0000","last_unstale":"2024-09-15T23:15:56.382521+0000","last_undegraded":"2024-09-15T23:15:56.382521+0000","last_fullsized":"2024-09-15T23:15:56.382521+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:20.992800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382206+0000","last_change":"2024-09-15T23:15:53.897383+0000","last_active":"2024-09-15T23:15:56.382206+0000","last_peered":"2024-09-15T23:15:56.382206+0000","last_clean":"2024-09-15T23:15:56.382206+0000","last_became_active":"2024-09-15T23:15:53.897092+0000","last_became_peered":"2024-09-15T23:15:53.897092+0000","last_unstale":"2024-09-15T23:15:56.382206+0000","last_undegraded":"2024-09-15T23:15:56.382206+0000","last_fullsized":"2024-09-15T23:15:56.382206+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:10.169770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.885003+0000","last_change":"2024-09-15T23:15:54.906479+0000","last_active":"2024-09-15T23:15:55.885003+0000","last_peered":"2024-09-15T23:15:55.885003+0000","last_clean":"2024-09-15T23:15:55.885003+0000","last_became_active":"2024-09-15T23:15:54.905148+0000","last_became_peered":"2024-09-15T23:15:54.905148+0000","last_unstale":"2024-09-15T23:15:55.885003+0000","last_undegraded":"2024-09-15T23:15:55.885003+0000","last_fullsized":"2024-09-15T23:15:55.885003+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:24:19.803644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.885510+0000","last_change":"2024-09-15T23:15:53.897397+0000","last_active":"2024-09-15T23:15:55.885510+0000","last_peered":"2024-09-15T23:15:55.885510+0000","last_clean":"2024-09-15T23:15:55.885510+0000","last_became_active":"2024-09-15T23:15:53.897148+0000","last_became_peered":"2024-09-15T23:15:53.897148+0000","last_unstale":"2024-09-15T23:15:55.885510+0000","last_undegraded":"2024-09-15T23:15:55.885510+0000","last_fullsized":"2024-09-15T23:15:55.885510+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:55:45.952747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382095+0000","last_change":"2024-09-15T23:15:54.908477+0000","last_active":"2024-09-15T23:15:56.382095+0000","last_peered":"2024-09-15T23:15:56.382095+0000","last_clean":"2024-09-15T23:15:56.382095+0000","last_became_active":"2024-09-15T23:15:54.908215+0000","last_became_peered":"2024-09-15T23:15:54.908215+0000","last_unstale":"2024-09-15T23:15:56.382095+0000","last_undegraded":"2024-09-15T23:15:56.382095+0000","last_fullsized":"2024-09-15T23:15:56.382095+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:21.642631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382055+0000","last_change":"2024-09-15T23:15:53.895882+0000","last_active":"2024-09-15T23:15:56.382055+0000","last_peered":"2024-09-15T23:15:56.382055+0000","last_clean":"2024-09-15T23:15:56.382055+0000","last_became_active":"2024-09-15T23:15:53.895592+0000","last_became_peered":"2024-09-15T23:15:53.895592+0000","last_unstale":"2024-09-15T23:15:56.382055+0000","last_undegraded":"2024-09-15T23:15:56.382055+0000","last_fullsized":"2024-09-15T23:15:56.382055+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:05.057467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.885809+0000","last_change":"2024-09-15T23:15:54.891905+0000","last_active":"2024-09-15T23:15:55.885809+0000","last_peered":"2024-09-15T23:15:55.885809+0000","last_clean":"2024-09-15T23:15:55.885809+0000","last_became_active":"2024-09-15T23:15:54.891622+0000","last_became_peered":"2024-09-15T23:15:54.891622+0000","last_unstale":"2024-09-15T23:15:55.885809+0000","last_undegraded":"2024-09-15T23:15:55.885809+0000","last_fullsized":"2024-09-15T23:15:55.885809+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:13:05.558399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"81'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383356+0000","last_change":"2024-09-15T23:15:53.895758+0000","last_active":"2024-09-15T23:15:56.383356+0000","last_peered":"2024-09-15T23:15:56.383356+0000","last_clean":"2024-09-15T23:15:56.383356+0000","last_became_active":"2024-09-15T23:15:53.895493+0000","last_became_peered":"2024-09-15T23:15:53.895493+0000","last_unstale":"2024-09-15T23:15:56.383356+0000","last_undegraded":"2024-09-15T23:15:56.383356+0000","last_fullsized":"2024-09-15T23:15:56.383356+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:54:45.779651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383425+0000","last_change":"2024-09-15T23:15:54.904531+0000","last_active":"2024-09-15T23:15:56.383425+0000","last_peered":"2024-09-15T23:15:56.383425+0000","last_clean":"2024-09-15T23:15:56.383425+0000","last_became_active":"2024-09-15T23:15:54.904250+0000","last_became_peered":"2024-09-15T23:15:54.904250+0000","last_unstale":"2024-09-15T23:15:56.383425+0000","last_undegraded":"2024-09-15T23:15:56.383425+0000","last_fullsized":"2024-09-15T23:15:56.383425+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:43:33.055440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"81'6","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.276398+0000","last_change":"2024-09-15T23:15:53.895740+0000","last_active":"2024-09-15T23:15:56.276398+0000","last_peered":"2024-09-15T23:15:56.276398+0000","last_clean":"2024-09-15T23:15:56.276398+0000","last_became_active":"2024-09-15T23:15:53.895480+0000","last_became_peered":"2024-09-15T23:15:53.895480+0000","last_unstale":"2024-09-15T23:15:56.276398+0000","last_undegraded":"2024-09-15T23:15:56.276398+0000","last_fullsized":"2024-09-15T23:15:56.276398+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:05.057467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.886224+0000","last_change":"2024-09-15T23:15:54.899726+0000","last_active":"2024-09-15T23:15:55.886224+0000","last_peered":"2024-09-15T23:15:55.886224+0000","last_clean":"2024-09-15T23:15:55.886224+0000","last_became_active":"2024-09-15T23:15:54.899442+0000","last_became_peered":"2024-09-15T23:15:54.899442+0000","last_unstale":"2024-09-15T23:15:55.886224+0000","last_undegraded":"2024-09-15T23:15:55.886224+0000","last_fullsized":"2024-09-15T23:15:55.886224+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:49:26.829560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.276131+0000","last_change":"2024-09-15T23:15:53.893711+0000","last_active":"2024-09-15T23:15:56.276131+0000","last_peered":"2024-09-15T23:15:56.276131+0000","last_clean":"2024-09-15T23:15:56.276131+0000","last_became_active":"2024-09-15T23:15:53.893432+0000","last_became_peered":"2024-09-15T23:15:53.893432+0000","last_unstale":"2024-09-15T23:15:56.276131+0000","last_undegraded":"2024-09-15T23:15:56.276131+0000","last_fullsized":"2024-09-15T23:15:56.276131+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:58:01.036404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.884511+0000","last_change":"2024-09-15T23:15:54.895527+0000","last_active":"2024-09-15T23:15:55.884511+0000","last_peered":"2024-09-15T23:15:55.884511+0000","last_clean":"2024-09-15T23:15:55.884511+0000","last_became_active":"2024-09-15T23:15:54.895259+0000","last_became_peered":"2024-09-15T23:15:54.895259+0000","last_unstale":"2024-09-15T23:15:55.884511+0000","last_undegraded":"2024-09-15T23:15:55.884511+0000","last_fullsized":"2024-09-15T23:15:55.884511+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:54.143040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.884353+0000","last_change":"2024-09-15T23:15:53.897785+0000","last_active":"2024-09-15T23:15:55.884353+0000","last_peered":"2024-09-15T23:15:55.884353+0000","last_clean":"2024-09-15T23:15:55.884353+0000","last_became_active":"2024-09-15T23:15:53.897213+0000","last_became_peered":"2024-09-15T23:15:53.897213+0000","last_unstale":"2024-09-15T23:15:55.884353+0000","last_undegraded":"2024-09-15T23:15:55.884353+0000","last_fullsized":"2024-09-15T23:15:55.884353+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:28:41.228240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382734+0000","last_change":"2024-09-15T23:15:54.911495+0000","last_active":"2024-09-15T23:15:56.382734+0000","last_peered":"2024-09-15T23:15:56.382734+0000","last_clean":"2024-09-15T23:15:56.382734+0000","last_became_active":"2024-09-15T23:15:54.911165+0000","last_became_peered":"2024-09-15T23:15:54.911165+0000","last_unstale":"2024-09-15T23:15:56.382734+0000","last_undegraded":"2024-09-15T23:15:56.382734+0000","last_fullsized":"2024-09-15T23:15:56.382734+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:00:46.921868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.885039+0000","last_change":"2024-09-15T23:15:53.890284+0000","last_active":"2024-09-15T23:15:55.885039+0000","last_peered":"2024-09-15T23:15:55.885039+0000","last_clean":"2024-09-15T23:15:55.885039+0000","last_became_active":"2024-09-15T23:15:53.889739+0000","last_became_peered":"2024-09-15T23:15:53.889739+0000","last_unstale":"2024-09-15T23:15:55.885039+0000","last_undegraded":"2024-09-15T23:15:55.885039+0000","last_fullsized":"2024-09-15T23:15:55.885039+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:45:30.713413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383393+0000","last_change":"2024-09-15T23:15:54.899159+0000","last_active":"2024-09-15T23:15:56.383393+0000","last_peered":"2024-09-15T23:15:56.383393+0000","last_clean":"2024-09-15T23:15:56.383393+0000","last_became_active":"2024-09-15T23:15:54.898842+0000","last_became_peered":"2024-09-15T23:15:54.898842+0000","last_unstale":"2024-09-15T23:15:56.383393+0000","last_undegraded":"2024-09-15T23:15:56.383393+0000","last_fullsized":"2024-09-15T23:15:56.383393+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:23:49.789348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.10","version":"81'8","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.884192+0000","last_change":"2024-09-15T23:15:53.894498+0000","last_active":"2024-09-15T23:15:55.884192+0000","last_peered":"2024-09-15T23:15:55.884192+0000","last_clean":"2024-09-15T23:15:55.884192+0000","last_became_active":"2024-09-15T23:15:53.894252+0000","last_became_peered":"2024-09-15T23:15:53.894252+0000","last_unstale":"2024-09-15T23:15:55.884192+0000","last_undegraded":"2024-09-15T23:15:55.884192+0000","last_fullsized":"2024-09-15T23:15:55.884192+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:09:09.802610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382151+0000","last_change":"2024-09-15T23:15:54.898916+0000","last_active":"2024-09-15T23:15:56.382151+0000","last_peered":"2024-09-15T23:15:56.382151+0000","last_clean":"2024-09-15T23:15:56.382151+0000","last_became_active":"2024-09-15T23:15:54.898671+0000","last_became_peered":"2024-09-15T23:15:54.898671+0000","last_unstale":"2024-09-15T23:15:56.382151+0000","last_undegraded":"2024-09-15T23:15:56.382151+0000","last_fullsized":"2024-09-15T23:15:56.382151+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:19:06.272305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.885553+0000","last_change":"2024-09-15T23:15:53.898295+0000","last_active":"2024-09-15T23:15:55.885553+0000","last_peered":"2024-09-15T23:15:55.885553+0000","last_clean":"2024-09-15T23:15:55.885553+0000","last_became_active":"2024-09-15T23:15:53.897965+0000","last_became_peered":"2024-09-15T23:15:53.897965+0000","last_unstale":"2024-09-15T23:15:55.885553+0000","last_undegraded":"2024-09-15T23:15:55.885553+0000","last_fullsized":"2024-09-15T23:15:55.885553+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:07.848380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382117+0000","last_change":"2024-09-15T23:15:54.901166+0000","last_active":"2024-09-15T23:15:56.382117+0000","last_peered":"2024-09-15T23:15:56.382117+0000","last_clean":"2024-09-15T23:15:56.382117+0000","last_became_active":"2024-09-15T23:15:54.900095+0000","last_became_peered":"2024-09-15T23:15:54.900095+0000","last_unstale":"2024-09-15T23:15:56.382117+0000","last_undegraded":"2024-09-15T23:15:56.382117+0000","last_fullsized":"2024-09-15T23:15:56.382117+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:06:22.959547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382110+0000","last_change":"2024-09-15T23:15:53.892505+0000","last_active":"2024-09-15T23:15:56.382110+0000","last_peered":"2024-09-15T23:15:56.382110+0000","last_clean":"2024-09-15T23:15:56.382110+0000","last_became_active":"2024-09-15T23:15:53.892232+0000","last_became_peered":"2024-09-15T23:15:53.892232+0000","last_unstale":"2024-09-15T23:15:56.382110+0000","last_undegraded":"2024-09-15T23:15:56.382110+0000","last_fullsized":"2024-09-15T23:15:56.382110+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:58:01.036404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382925+0000","last_change":"2024-09-15T23:15:54.894455+0000","last_active":"2024-09-15T23:15:56.382925+0000","last_peered":"2024-09-15T23:15:56.382925+0000","last_clean":"2024-09-15T23:15:56.382925+0000","last_became_active":"2024-09-15T23:15:54.894157+0000","last_became_peered":"2024-09-15T23:15:54.894157+0000","last_unstale":"2024-09-15T23:15:56.382925+0000","last_undegraded":"2024-09-15T23:15:56.382925+0000","last_fullsized":"2024-09-15T23:15:56.382925+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:52.302621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.381815+0000","last_change":"2024-09-15T23:15:53.896495+0000","last_active":"2024-09-15T23:15:56.381815+0000","last_peered":"2024-09-15T23:15:56.381815+0000","last_clean":"2024-09-15T23:15:56.381815+0000","last_became_active":"2024-09-15T23:15:53.896254+0000","last_became_peered":"2024-09-15T23:15:53.896254+0000","last_unstale":"2024-09-15T23:15:56.381815+0000","last_undegraded":"2024-09-15T23:15:56.381815+0000","last_fullsized":"2024-09-15T23:15:56.381815+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:24.362527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383121+0000","last_change":"2024-09-15T23:15:54.900984+0000","last_active":"2024-09-15T23:15:56.383121+0000","last_peered":"2024-09-15T23:15:56.383121+0000","last_clean":"2024-09-15T23:15:56.383121+0000","last_became_active":"2024-09-15T23:15:54.900709+0000","last_became_peered":"2024-09-15T23:15:54.900709+0000","last_unstale":"2024-09-15T23:15:56.383121+0000","last_undegraded":"2024-09-15T23:15:56.383121+0000","last_fullsized":"2024-09-15T23:15:56.383121+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:35:04.409834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.886351+0000","last_change":"2024-09-15T23:15:53.894758+0000","last_active":"2024-09-15T23:15:55.886351+0000","last_peered":"2024-09-15T23:15:55.886351+0000","last_clean":"2024-09-15T23:15:55.886351+0000","last_became_active":"2024-09-15T23:15:53.894398+0000","last_became_peered":"2024-09-15T23:15:53.894398+0000","last_unstale":"2024-09-15T23:15:55.886351+0000","last_undegraded":"2024-09-15T23:15:55.886351+0000","last_fullsized":"2024-09-15T23:15:55.886351+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:52:54.194232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.276226+0000","last_change":"2024-09-15T23:15:54.899731+0000","last_active":"2024-09-15T23:15:56.276226+0000","last_peered":"2024-09-15T23:15:56.276226+0000","last_clean":"2024-09-15T23:15:56.276226+0000","last_became_active":"2024-09-15T23:15:54.899453+0000","last_became_peered":"2024-09-15T23:15:54.899453+0000","last_unstale":"2024-09-15T23:15:56.276226+0000","last_undegraded":"2024-09-15T23:15:56.276226+0000","last_fullsized":"2024-09-15T23:15:56.276226+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:52.766645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.886216+0000","last_change":"2024-09-15T23:15:53.898212+0000","last_active":"2024-09-15T23:15:55.886216+0000","last_peered":"2024-09-15T23:15:55.886216+0000","last_clean":"2024-09-15T23:15:55.886216+0000","last_became_active":"2024-09-15T23:15:53.897946+0000","last_became_peered":"2024-09-15T23:15:53.897946+0000","last_unstale":"2024-09-15T23:15:55.886216+0000","last_undegraded":"2024-09-15T23:15:55.886216+0000","last_fullsized":"2024-09-15T23:15:55.886216+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:03.487864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.276158+0000","last_change":"2024-09-15T23:15:54.896709+0000","last_active":"2024-09-15T23:15:56.276158+0000","last_peered":"2024-09-15T23:15:56.276158+0000","last_clean":"2024-09-15T23:15:56.276158+0000","last_became_active":"2024-09-15T23:15:54.896326+0000","last_became_peered":"2024-09-15T23:15:54.896326+0000","last_unstale":"2024-09-15T23:15:56.276158+0000","last_undegraded":"2024-09-15T23:15:56.276158+0000","last_fullsized":"2024-09-15T23:15:56.276158+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:47:58.493900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.381881+0000","last_change":"2024-09-15T23:15:53.894628+0000","last_active":"2024-09-15T23:15:56.381881+0000","last_peered":"2024-09-15T23:15:56.381881+0000","last_clean":"2024-09-15T23:15:56.381881+0000","last_became_active":"2024-09-15T23:15:53.894345+0000","last_became_peered":"2024-09-15T23:15:53.894345+0000","last_unstale":"2024-09-15T23:15:56.381881+0000","last_undegraded":"2024-09-15T23:15:56.381881+0000","last_fullsized":"2024-09-15T23:15:56.381881+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:10:36.611528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383554+0000","last_change":"2024-09-15T23:15:54.897799+0000","last_active":"2024-09-15T23:15:56.383554+0000","last_peered":"2024-09-15T23:15:56.383554+0000","last_clean":"2024-09-15T23:15:56.383554+0000","last_became_active":"2024-09-15T23:15:54.897468+0000","last_became_peered":"2024-09-15T23:15:54.897468+0000","last_unstale":"2024-09-15T23:15:56.383554+0000","last_undegraded":"2024-09-15T23:15:56.383554+0000","last_fullsized":"2024-09-15T23:15:56.383554+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:04:08.287676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382587+0000","last_change":"2024-09-15T23:15:53.894527+0000","last_active":"2024-09-15T23:15:56.382587+0000","last_peered":"2024-09-15T23:15:56.382587+0000","last_clean":"2024-09-15T23:15:56.382587+0000","last_became_active":"2024-09-15T23:15:53.894233+0000","last_became_peered":"2024-09-15T23:15:53.894233+0000","last_unstale":"2024-09-15T23:15:56.382587+0000","last_undegraded":"2024-09-15T23:15:56.382587+0000","last_fullsized":"2024-09-15T23:15:56.382587+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:51:14.198694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383690+0000","last_change":"2024-09-15T23:15:54.904641+0000","last_active":"2024-09-15T23:15:56.383690+0000","last_peered":"2024-09-15T23:15:56.383690+0000","last_clean":"2024-09-15T23:15:56.383690+0000","last_became_active":"2024-09-15T23:15:54.904370+0000","last_became_peered":"2024-09-15T23:15:54.904370+0000","last_unstale":"2024-09-15T23:15:56.383690+0000","last_undegraded":"2024-09-15T23:15:56.383690+0000","last_fullsized":"2024-09-15T23:15:56.383690+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:33:50.355276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.885780+0000","last_change":"2024-09-15T23:15:53.895769+0000","last_active":"2024-09-15T23:15:55.885780+0000","last_peered":"2024-09-15T23:15:55.885780+0000","last_clean":"2024-09-15T23:15:55.885780+0000","last_became_active":"2024-09-15T23:15:53.895523+0000","last_became_peered":"2024-09-15T23:15:53.895523+0000","last_unstale":"2024-09-15T23:15:55.885780+0000","last_undegraded":"2024-09-15T23:15:55.885780+0000","last_fullsized":"2024-09-15T23:15:55.885780+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:02.419304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.885002+0000","last_change":"2024-09-15T23:15:54.904026+0000","last_active":"2024-09-15T23:15:55.885002+0000","last_peered":"2024-09-15T23:15:55.885002+0000","last_clean":"2024-09-15T23:15:55.885002+0000","last_became_active":"2024-09-15T23:15:54.903728+0000","last_became_peered":"2024-09-15T23:15:54.903728+0000","last_unstale":"2024-09-15T23:15:55.885002+0000","last_undegraded":"2024-09-15T23:15:55.885002+0000","last_fullsized":"2024-09-15T23:15:55.885002+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:17:17.518184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"82'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.885782+0000","last_change":"2024-09-15T23:15:53.897204+0000","last_active":"2024-09-15T23:15:55.885782+0000","last_peered":"2024-09-15T23:15:55.885782+0000","last_clean":"2024-09-15T23:15:55.885782+0000","last_became_active":"2024-09-15T23:15:53.896943+0000","last_became_peered":"2024-09-15T23:15:53.896943+0000","last_unstale":"2024-09-15T23:15:55.885782+0000","last_undegraded":"2024-09-15T23:15:55.885782+0000","last_fullsized":"2024-09-15T23:15:55.885782+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:40:06.742761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382035+0000","last_change":"2024-09-15T23:15:54.897812+0000","last_active":"2024-09-15T23:15:56.382035+0000","last_peered":"2024-09-15T23:15:56.382035+0000","last_clean":"2024-09-15T23:15:56.382035+0000","last_became_active":"2024-09-15T23:15:54.897556+0000","last_became_peered":"2024-09-15T23:15:54.897556+0000","last_unstale":"2024-09-15T23:15:56.382035+0000","last_undegraded":"2024-09-15T23:15:56.382035+0000","last_fullsized":"2024-09-15T23:15:56.382035+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:43:55.819101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383459+0000","last_change":"2024-09-15T23:15:53.890515+0000","last_active":"2024-09-15T23:15:56.383459+0000","last_peered":"2024-09-15T23:15:56.383459+0000","last_clean":"2024-09-15T23:15:56.383459+0000","last_became_active":"2024-09-15T23:15:53.890230+0000","last_became_peered":"2024-09-15T23:15:53.890230+0000","last_unstale":"2024-09-15T23:15:56.383459+0000","last_undegraded":"2024-09-15T23:15:56.383459+0000","last_fullsized":"2024-09-15T23:15:56.383459+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:02.636477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.884678+0000","last_change":"2024-09-15T23:15:54.894242+0000","last_active":"2024-09-15T23:15:55.884678+0000","last_peered":"2024-09-15T23:15:55.884678+0000","last_clean":"2024-09-15T23:15:55.884678+0000","last_became_active":"2024-09-15T23:15:54.893895+0000","last_became_peered":"2024-09-15T23:15:54.893895+0000","last_unstale":"2024-09-15T23:15:55.884678+0000","last_undegraded":"2024-09-15T23:15:55.884678+0000","last_fullsized":"2024-09-15T23:15:55.884678+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:26:51.958884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383555+0000","last_change":"2024-09-15T23:15:53.895098+0000","last_active":"2024-09-15T23:15:56.383555+0000","last_peered":"2024-09-15T23:15:56.383555+0000","last_clean":"2024-09-15T23:15:56.383555+0000","last_became_active":"2024-09-15T23:15:53.893423+0000","last_became_peered":"2024-09-15T23:15:53.893423+0000","last_unstale":"2024-09-15T23:15:56.383555+0000","last_undegraded":"2024-09-15T23:15:56.383555+0000","last_fullsized":"2024-09-15T23:15:56.383555+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:05.970626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383220+0000","last_change":"2024-09-15T23:15:54.903195+0000","last_active":"2024-09-15T23:15:56.383220+0000","last_peered":"2024-09-15T23:15:56.383220+0000","last_clean":"2024-09-15T23:15:56.383220+0000","last_became_active":"2024-09-15T23:15:54.902860+0000","last_became_peered":"2024-09-15T23:15:54.902860+0000","last_unstale":"2024-09-15T23:15:56.383220+0000","last_undegraded":"2024-09-15T23:15:56.383220+0000","last_fullsized":"2024-09-15T23:15:56.383220+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:18:55.627155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.382407+0000","last_change":"2024-09-15T23:15:53.897951+0000","last_active":"2024-09-15T23:15:56.382407+0000","last_peered":"2024-09-15T23:15:56.382407+0000","last_clean":"2024-09-15T23:15:56.382407+0000","last_became_active":"2024-09-15T23:15:53.897654+0000","last_became_peered":"2024-09-15T23:15:53.897654+0000","last_unstale":"2024-09-15T23:15:56.382407+0000","last_undegraded":"2024-09-15T23:15:56.382407+0000","last_fullsized":"2024-09-15T23:15:56.382407+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:52:21.447053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.885917+0000","last_change":"2024-09-15T23:15:54.897869+0000","last_active":"2024-09-15T23:15:55.885917+0000","last_peered":"2024-09-15T23:15:55.885917+0000","last_clean":"2024-09-15T23:15:55.885917+0000","last_became_active":"2024-09-15T23:15:54.897630+0000","last_became_peered":"2024-09-15T23:15:54.897630+0000","last_unstale":"2024-09-15T23:15:55.885917+0000","last_undegraded":"2024-09-15T23:15:55.885917+0000","last_fullsized":"2024-09-15T23:15:55.885917+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:52:52.240015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383263+0000","last_change":"2024-09-15T23:15:53.901460+0000","last_active":"2024-09-15T23:15:56.383263+0000","last_peered":"2024-09-15T23:15:56.383263+0000","last_clean":"2024-09-15T23:15:56.383263+0000","last_became_active":"2024-09-15T23:15:53.901261+0000","last_became_peered":"2024-09-15T23:15:53.901261+0000","last_unstale":"2024-09-15T23:15:56.383263+0000","last_undegraded":"2024-09-15T23:15:56.383263+0000","last_fullsized":"2024-09-15T23:15:56.383263+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:06.343575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.276260+0000","last_change":"2024-09-15T23:15:54.897440+0000","last_active":"2024-09-15T23:15:56.276260+0000","last_peered":"2024-09-15T23:15:56.276260+0000","last_clean":"2024-09-15T23:15:56.276260+0000","last_became_active":"2024-09-15T23:15:54.897175+0000","last_became_peered":"2024-09-15T23:15:54.897175+0000","last_unstale":"2024-09-15T23:15:56.276260+0000","last_undegraded":"2024-09-15T23:15:56.276260+0000","last_fullsized":"2024-09-15T23:15:56.276260+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:47:37.405707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.381987+0000","last_change":"2024-09-15T23:15:53.894636+0000","last_active":"2024-09-15T23:15:56.381987+0000","last_peered":"2024-09-15T23:15:56.381987+0000","last_clean":"2024-09-15T23:15:56.381987+0000","last_became_active":"2024-09-15T23:15:53.894333+0000","last_became_peered":"2024-09-15T23:15:53.894333+0000","last_unstale":"2024-09-15T23:15:56.381987+0000","last_undegraded":"2024-09-15T23:15:56.381987+0000","last_fullsized":"2024-09-15T23:15:56.381987+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:46.862877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.381826+0000","last_change":"2024-09-15T23:15:54.905798+0000","last_active":"2024-09-15T23:15:56.381826+0000","last_peered":"2024-09-15T23:15:56.381826+0000","last_clean":"2024-09-15T23:15:56.381826+0000","last_became_active":"2024-09-15T23:15:54.905529+0000","last_became_peered":"2024-09-15T23:15:54.905529+0000","last_unstale":"2024-09-15T23:15:56.381826+0000","last_undegraded":"2024-09-15T23:15:56.381826+0000","last_fullsized":"2024-09-15T23:15:56.381826+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:15:52.391364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.886050+0000","last_change":"2024-09-15T23:15:53.896504+0000","last_active":"2024-09-15T23:15:55.886050+0000","last_peered":"2024-09-15T23:15:55.886050+0000","last_clean":"2024-09-15T23:15:55.886050+0000","last_became_active":"2024-09-15T23:15:53.896236+0000","last_became_peered":"2024-09-15T23:15:53.896236+0000","last_unstale":"2024-09-15T23:15:55.886050+0000","last_undegraded":"2024-09-15T23:15:55.886050+0000","last_fullsized":"2024-09-15T23:15:55.886050+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:17:11.573994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:56.383109+0000","last_change":"2024-09-15T23:15:54.906530+0000","last_active":"2024-09-15T23:15:56.383109+0000","last_peered":"2024-09-15T23:15:56.383109+0000","last_clean":"2024-09-15T23:15:56.383109+0000","last_became_active":"2024-09-15T23:15:54.906238+0000","last_became_peered":"2024-09-15T23:15:54.906238+0000","last_unstale":"2024-09-15T23:15:56.383109+0000","last_undegraded":"2024-09-15T23:15:56.383109+0000","last_fullsized":"2024-09-15T23:15:56.383109+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:53.872244+0000","last_clean_scrub_stamp":"2024-09-15T23:15:53.872244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:41:09.389540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.884469+0000","last_change":"2024-09-15T23:15:53.889767+0000","last_active":"2024-09-15T23:15:55.884469+0000","last_peered":"2024-09-15T23:15:55.884469+0000","last_clean":"2024-09-15T23:15:55.884469+0000","last_became_active":"2024-09-15T23:15:53.889495+0000","last_became_peered":"2024-09-15T23:15:53.889495+0000","last_unstale":"2024-09-15T23:15:55.884469+0000","last_undegraded":"2024-09-15T23:15:55.884469+0000","last_fullsized":"2024-09-15T23:15:55.884469+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:15:52.869934+0000","last_clean_scrub_stamp":"2024-09-15T23:15:52.869934+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:08.303904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":282,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-15T23:15:55.884252+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:15:55.884252+0000","last_peered":"2024-09-15T23:15:55.884252+0000","last_clean":"2024-09-15T23:15:55.884252+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:15:55.884252+0000","last_undegraded":"2024-09-15T23:15:55.884252+0000","last_fullsized":"2024-09-15T23:15:55.884252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476789,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40484,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331356,"statfs":{"total":96636764160,"available":96595308544,"internally_reserved":0,"allocated":999424,"data_stored":427109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476786,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40484,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331356,"statfs":{"total":96636764160,"available":96595308544,"internally_reserved":0,"allocated":991232,"data_stored":427565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476788,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36892,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334948,"statfs":{"total":96636764160,"available":96598986752,"internally_reserved":0,"allocated":1581056,"data_stored":1017351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476788,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":991232,"data_stored":427053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542195,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36332,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335508,"statfs":{"total":96636764160,"available":96599560192,"internally_reserved":0,"allocated":999424,"data_stored":428595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542195,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36336,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1003520,"data_stored":428629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542194,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36896,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334944,"statfs":{"total":96636764160,"available":96598982656,"internally_reserved":0,"allocated":1585152,"data_stored":1017441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542196,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36332,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335508,"statfs":{"total":96636764160,"available":96599560192,"internally_reserved":0,"allocated":999424,"data_stored":427677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:16:02.598 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T23:16:02.598 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T23:16:02.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.738+0000 7f798f19f640 1 Processor -- start 2024-09-15T23:16:02.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.738+0000 7f798f19f640 1 -- start start 2024-09-15T23:16:02.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.739+0000 7f798f19f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f79880d0880 0x7f7988071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:02.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.739+0000 7f798f19f640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79880afa10 con 0x7f79880725c0 2024-09-15T23:16:02.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.739+0000 7f798f19f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7988071220 con 0x7f798815c310 2024-09-15T23:16:02.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.739+0000 7f798f19f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f7988071500 con 0x7f79880d0880 2024-09-15T23:16:02.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.739+0000 7f798d99c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f79880d0880 0x7f7988071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:02.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.739+0000 7f798e99e640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f79880725c0 0x7f79880cdf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:44076/0 (socket says 172.21.15.123:44076) 2024-09-15T23:16:02.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.739+0000 7f798e99e640 1 -- 172.21.15.123:0/3760759417 learned_addr learned my addr 172.21.15.123:0/3760759417 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:02.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.740+0000 7f798d99c640 1 -- 172.21.15.123:0/3760759417 >> v1:172.21.15.188:6789/0 conn(0x7f798815c310 legacy=0x7f79880d0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:02.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.740+0000 7f798d99c640 1 -- 172.21.15.123:0/3760759417 >> v1:172.21.15.123:6789/0 conn(0x7f79880725c0 legacy=0x7f79880cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:02.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.740+0000 7f798d19b640 1 -- 172.21.15.123:0/3760759417 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1016804150 0 0) 0x7f79880afa10 con 0x7f79880725c0 2024-09-15T23:16:02.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.740+0000 7f798d99c640 1 -- 172.21.15.123:0/3760759417 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79880717e0 con 0x7f79880d0880 2024-09-15T23:16:02.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.740+0000 7f798d99c640 1 --2- 172.21.15.123:0/3760759417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79880d0880 0x7f7988071d00 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f797c009d90 tx=0x7f797c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c9c368335151d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:02.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.740+0000 7f798d19b640 1 -- 172.21.15.123:0/3760759417 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f797c007740 con 0x7f79880d0880 2024-09-15T23:16:02.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.741+0000 7f798d19b640 1 -- 172.21.15.123:0/3760759417 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f797c0078e0 con 0x7f79880d0880 2024-09-15T23:16:02.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.741+0000 7f798d19b640 1 -- 172.21.15.123:0/3760759417 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f797c007cb0 con 0x7f79880d0880 2024-09-15T23:16:02.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.741+0000 7f798f19f640 1 -- 172.21.15.123:0/3760759417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79880d0880 msgr2=0x7f7988071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:02.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.741+0000 7f798f19f640 1 --2- 172.21.15.123:0/3760759417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79880d0880 0x7f7988071d00 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f797c009d90 tx=0x7f797c02a6f0 comp rx=0 tx=0).stop 2024-09-15T23:16:02.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.741+0000 7f798f19f640 1 -- 172.21.15.123:0/3760759417 shutdown_connections 2024-09-15T23:16:02.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.741+0000 7f798f19f640 1 --2- 172.21.15.123:0/3760759417 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79880d0880 0x7f7988071d00 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:02.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.741+0000 7f798f19f640 1 -- 172.21.15.123:0/3760759417 >> 172.21.15.123:0/3760759417 conn(0x7f798806bc10 msgr2=0x7f798806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:02.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.741+0000 7f798f19f640 1 -- 172.21.15.123:0/3760759417 shutdown_connections 2024-09-15T23:16:02.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.741+0000 7f798f19f640 1 -- 172.21.15.123:0/3760759417 wait complete. 2024-09-15T23:16:02.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.742+0000 7f798f19f640 1 Processor -- start 2024-09-15T23:16:02.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.742+0000 7f798f19f640 1 -- start start 2024-09-15T23:16:02.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.743+0000 7f798f19f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f79880725c0 0x7f79880b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:02.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.743+0000 7f798f19f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79880d0880 0x7f7988148c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:02.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.743+0000 7f798f19f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f798815c310 0x7f7988155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:02.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.743+0000 7f798f19f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7988073e30 con 0x7f79880d0880 2024-09-15T23:16:02.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.743+0000 7f798f19f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f79880af6c0 con 0x7f79880725c0 2024-09-15T23:16:02.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.743+0000 7f798f19f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7988073fb0 con 0x7f798815c310 2024-09-15T23:16:02.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.743+0000 7f798d99c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79880d0880 0x7f7988148c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:02.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.743+0000 7f798d99c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79880d0880 0x7f7988148c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54054/0 (socket says 172.21.15.123:54054) 2024-09-15T23:16:02.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.743+0000 7f798d99c640 1 -- 172.21.15.123:0/3631508809 learned_addr learned my addr 172.21.15.123:0/3631508809 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:02.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.743+0000 7f798d99c640 1 -- 172.21.15.123:0/3631508809 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f798815c310 msgr2=0x7f7988155b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:02.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.743+0000 7f798d99c640 1 --2- 172.21.15.123:0/3631508809 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f798815c310 0x7f7988155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:02.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.743+0000 7f798d99c640 1 -- 172.21.15.123:0/3631508809 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f79880725c0 msgr2=0x7f79880b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:02.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.743+0000 7f798d99c640 1 --2- 172.21.15.123:0/3631508809 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f79880725c0 0x7f79880b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:02.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.743+0000 7f798d99c640 1 -- 172.21.15.123:0/3631508809 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79881560d0 con 0x7f79880d0880 2024-09-15T23:16:02.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.744+0000 7f798d99c640 1 --2- 172.21.15.123:0/3631508809 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79880d0880 0x7f7988148c20 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f797c000f80 tx=0x7f797c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:02.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.744+0000 7f7986ffd640 1 -- 172.21.15.123:0/3631508809 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f797c040070 con 0x7f79880d0880 2024-09-15T23:16:02.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.744+0000 7f7986ffd640 1 -- 172.21.15.123:0/3631508809 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f797c031d00 con 0x7f79880d0880 2024-09-15T23:16:02.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.744+0000 7f7986ffd640 1 -- 172.21.15.123:0/3631508809 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f797c003b90 con 0x7f79880d0880 2024-09-15T23:16:02.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.744+0000 7f798f19f640 1 -- 172.21.15.123:0/3631508809 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7988156390 con 0x7f79880d0880 2024-09-15T23:16:02.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.744+0000 7f798f19f640 1 -- 172.21.15.123:0/3631508809 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7988156950 con 0x7f79880d0880 2024-09-15T23:16:02.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.745+0000 7f798f19f640 1 -- 172.21.15.123:0/3631508809 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f798815c6f0 con 0x7f79880d0880 2024-09-15T23:16:02.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.745+0000 7f7986ffd640 1 -- 172.21.15.123:0/3631508809 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f797c039040 con 0x7f79880d0880 2024-09-15T23:16:02.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.746+0000 7f7986ffd640 1 --2- 172.21.15.123:0/3631508809 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f797406c2b0 0x7f797406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:02.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.746+0000 7f7986ffd640 1 -- 172.21.15.123:0/3631508809 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f797c0ac750 con 0x7f79880d0880 2024-09-15T23:16:02.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.746+0000 7f798e19d640 1 --2- 172.21.15.123:0/3631508809 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f797406c2b0 0x7f797406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:02.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.747+0000 7f798e19d640 1 --2- 172.21.15.123:0/3631508809 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f797406c2b0 0x7f797406e770 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7980000f60 tx=0x7f79800079b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:02.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.750+0000 7f7986ffd640 1 -- 172.21.15.123:0/3631508809 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f797c07aec0 con 0x7f79880d0880 2024-09-15T23:16:02.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.983+0000 7f798f19f640 1 -- 172.21.15.123:0/3631508809 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f798815b4c0 con 0x7f79880d0880 2024-09-15T23:16:02.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.985+0000 7f7986ffd640 1 -- 172.21.15.123:0/3631508809 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7f797c07a7c0 con 0x7f79880d0880 2024-09-15T23:16:02.987 INFO:teuthology.orchestra.run.smithi123.stdout:[client.0] 2024-09-15T23:16:02.987 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCNaedmzQPqJRAAhUf1dnVYohN4obCfeu8+7g== 2024-09-15T23:16:02.987 INFO:teuthology.orchestra.run.smithi123.stdout: caps mds = "allow" 2024-09-15T23:16:02.987 INFO:teuthology.orchestra.run.smithi123.stdout: caps mon = "allow r" 2024-09-15T23:16:02.987 INFO:teuthology.orchestra.run.smithi123.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T23:16:02.987 INFO:teuthology.orchestra.run.smithi123.stderr:updated caps for client.0 2024-09-15T23:16:02.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.987+0000 7f798f19f640 1 -- 172.21.15.123:0/3631508809 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f797406c2b0 msgr2=0x7f797406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:02.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.987+0000 7f798f19f640 1 --2- 172.21.15.123:0/3631508809 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f797406c2b0 0x7f797406e770 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7980000f60 tx=0x7f79800079b0 comp rx=0 tx=0).stop 2024-09-15T23:16:02.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.987+0000 7f798f19f640 1 -- 172.21.15.123:0/3631508809 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79880d0880 msgr2=0x7f7988148c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:02.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.987+0000 7f798f19f640 1 --2- 172.21.15.123:0/3631508809 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79880d0880 0x7f7988148c20 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f797c000f80 tx=0x7f797c004a40 comp rx=0 tx=0).stop 2024-09-15T23:16:02.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.987+0000 7f798f19f640 1 -- 172.21.15.123:0/3631508809 shutdown_connections 2024-09-15T23:16:02.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.987+0000 7f798f19f640 1 --2- 172.21.15.123:0/3631508809 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f798815c310 0x7f7988155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:02.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.987+0000 7f798f19f640 1 --2- 172.21.15.123:0/3631508809 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f797406c2b0 0x7f797406e770 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:02.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.987+0000 7f798f19f640 1 --2- 172.21.15.123:0/3631508809 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79880d0880 0x7f7988148c20 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:02.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.987+0000 7f798f19f640 1 --2- 172.21.15.123:0/3631508809 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f79880725c0 0x7f79880b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:02.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.987+0000 7f798f19f640 1 -- 172.21.15.123:0/3631508809 >> 172.21.15.123:0/3631508809 conn(0x7f798806bc10 msgr2=0x7f798815f240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:02.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.987+0000 7f798f19f640 1 -- 172.21.15.123:0/3631508809 shutdown_connections 2024-09-15T23:16:02.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:02.987+0000 7f798f19f640 1 -- 172.21.15.123:0/3631508809 wait complete. 2024-09-15T23:16:03.000 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:16:03.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.096+0000 7f1037d81640 1 Processor -- start 2024-09-15T23:16:03.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.096+0000 7f1037d81640 1 -- start start 2024-09-15T23:16:03.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.097+0000 7f1037d81640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f10300b2d40 0x7f103006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:03.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.097+0000 7f1037d81640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f103013eb20 0x7f103006c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:03.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.097+0000 7f1037d81640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1030071180 con 0x7f103015bcf0 2024-09-15T23:16:03.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.097+0000 7f1037d81640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f1030071ab0 con 0x7f10300b2d40 2024-09-15T23:16:03.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.097+0000 7f1037d81640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1030071460 con 0x7f103013eb20 2024-09-15T23:16:03.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.097+0000 7f103631e640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f103015bcf0 0x7f103015c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:44082/0 (socket says 172.21.15.123:44082) 2024-09-15T23:16:03.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.097+0000 7f103631e640 1 -- 172.21.15.123:0/1402775518 learned_addr learned my addr 172.21.15.123:0/1402775518 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:03.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.097+0000 7f103531c640 1 --2- 172.21.15.123:0/1402775518 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f103013eb20 0x7f103006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:03.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.097+0000 7f1035b1d640 1 --2- 172.21.15.123:0/1402775518 >> v2:172.21.15.188:3300/0 conn(0x7f10300b2d40 0x7f103006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:03.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.097+0000 7f1034b1b640 1 -- 172.21.15.123:0/1402775518 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2613142003 0 0) 0x7f1030071180 con 0x7f103015bcf0 2024-09-15T23:16:03.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.097+0000 7f1034b1b640 1 -- 172.21.15.123:0/1402775518 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f101c003520 con 0x7f103015bcf0 2024-09-15T23:16:03.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.097+0000 7f1034b1b640 1 -- 172.21.15.123:0/1402775518 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2755315922 0 0) 0x7f101c003520 con 0x7f103015bcf0 2024-09-15T23:16:03.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.097+0000 7f1034b1b640 1 -- 172.21.15.123:0/1402775518 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f103013eb20 msgr2=0x7f103006c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:03.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.097+0000 7f1034b1b640 1 --2- 172.21.15.123:0/1402775518 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f103013eb20 0x7f103006c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.097+0000 7f1034b1b640 1 -- 172.21.15.123:0/1402775518 >> v2:172.21.15.188:3300/0 conn(0x7f10300b2d40 msgr2=0x7f103006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:03.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.097+0000 7f1034b1b640 1 --2- 172.21.15.123:0/1402775518 >> v2:172.21.15.188:3300/0 conn(0x7f10300b2d40 0x7f103006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.097+0000 7f1034b1b640 1 -- 172.21.15.123:0/1402775518 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1030071740 con 0x7f103015bcf0 2024-09-15T23:16:03.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.097+0000 7f1034b1b640 1 -- 172.21.15.123:0/1402775518 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f10280019f0 con 0x7f103015bcf0 2024-09-15T23:16:03.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.097+0000 7f1034b1b640 1 -- 172.21.15.123:0/1402775518 >> v1:172.21.15.123:6789/0 conn(0x7f103015bcf0 legacy=0x7f103015c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:03.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.097+0000 7f1034b1b640 1 --2- 172.21.15.123:0/1402775518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f101c0039b0 0x7f101c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:03.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.097+0000 7f1034b1b640 1 --2- 172.21.15.123:0/1402775518 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f101c004800 0x7f101c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:03.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.097+0000 7f1034b1b640 1 --2- 172.21.15.123:0/1402775518 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f103013eb20 0x7f101c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:03.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.098+0000 7f1034b1b640 1 -- 172.21.15.123:0/1402775518 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1030071ab0 con 0x7f101c0039b0 2024-09-15T23:16:03.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.098+0000 7f1034b1b640 1 -- 172.21.15.123:0/1402775518 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1030071460 con 0x7f101c004800 2024-09-15T23:16:03.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.098+0000 7f1034b1b640 1 -- 172.21.15.123:0/1402775518 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f101c00b9c0 con 0x7f103013eb20 2024-09-15T23:16:03.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.098+0000 7f1035b1d640 1 --2- 172.21.15.123:0/1402775518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f101c0039b0 0x7f101c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:03.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.098+0000 7f103631e640 1 --2- 172.21.15.123:0/1402775518 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f103013eb20 0x7f101c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:03.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.098+0000 7f103531c640 1 --2- 172.21.15.123:0/1402775518 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f101c004800 0x7f101c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:03.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.098+0000 7f1035b1d640 1 -- 172.21.15.123:0/1402775518 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f103013eb20 msgr2=0x7f101c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:03.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.098+0000 7f1035b1d640 1 --2- 172.21.15.123:0/1402775518 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f103013eb20 0x7f101c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.098+0000 7f1035b1d640 1 -- 172.21.15.123:0/1402775518 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f101c004800 msgr2=0x7f101c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:03.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.098+0000 7f1035b1d640 1 --2- 172.21.15.123:0/1402775518 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f101c004800 0x7f101c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.098+0000 7f1035b1d640 1 -- 172.21.15.123:0/1402775518 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f101c003520 con 0x7f101c0039b0 2024-09-15T23:16:03.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.099+0000 7f1035b1d640 1 --2- 172.21.15.123:0/1402775518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f101c0039b0 0x7f101c003df0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f102c009ac0 tx=0x7f101c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a17759f53f8b12a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:03.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.099+0000 7f1034b1b640 1 -- 172.21.15.123:0/1402775518 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102c036070 con 0x7f101c0039b0 2024-09-15T23:16:03.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.099+0000 7f1034b1b640 1 -- 172.21.15.123:0/1402775518 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f102c031400 con 0x7f101c0039b0 2024-09-15T23:16:03.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.099+0000 7f1034b1b640 1 -- 172.21.15.123:0/1402775518 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102c009690 con 0x7f101c0039b0 2024-09-15T23:16:03.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.099+0000 7f1037d81640 1 -- 172.21.15.123:0/1402775518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f101c0039b0 msgr2=0x7f101c003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:03.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.099+0000 7f1037d81640 1 --2- 172.21.15.123:0/1402775518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f101c0039b0 0x7f101c003df0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f102c009ac0 tx=0x7f101c005830 comp rx=0 tx=0).stop 2024-09-15T23:16:03.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.099+0000 7f103631e640 1 -- 172.21.15.123:0/1402775518 reap_dead start 2024-09-15T23:16:03.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.099+0000 7f1037d81640 1 -- 172.21.15.123:0/1402775518 shutdown_connections 2024-09-15T23:16:03.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.099+0000 7f1037d81640 1 -- 172.21.15.123:0/1402775518 >> 172.21.15.123:0/1402775518 conn(0x7f10300ccec0 msgr2=0x7f10300cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:03.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.099+0000 7f1037d81640 1 -- 172.21.15.123:0/1402775518 shutdown_connections 2024-09-15T23:16:03.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.099+0000 7f1037d81640 1 -- 172.21.15.123:0/1402775518 wait complete. 2024-09-15T23:16:03.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.100+0000 7f1037d81640 1 Processor -- start 2024-09-15T23:16:03.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.101+0000 7f1037d81640 1 -- start start 2024-09-15T23:16:03.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.101+0000 7f1037d81640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f101c0039b0 0x7f1030143f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:03.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.101+0000 7f1037d81640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1030154c10 0x7f103013d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:03.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.101+0000 7f1037d81640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f103013d760 0x7f10300b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:03.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.101+0000 7f1037d81640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f103006c4e0 con 0x7f101c0039b0 2024-09-15T23:16:03.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.101+0000 7f1037d81640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f103006c360 con 0x7f103013d760 2024-09-15T23:16:03.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.101+0000 7f1037d81640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1030071f40 con 0x7f1030154c10 2024-09-15T23:16:03.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.101+0000 7f1035b1d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f101c0039b0 0x7f1030143f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:03.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.101+0000 7f1035b1d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f101c0039b0 0x7f1030143f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54070/0 (socket says 172.21.15.123:54070) 2024-09-15T23:16:03.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.101+0000 7f1035b1d640 1 -- 172.21.15.123:0/3628477310 learned_addr learned my addr 172.21.15.123:0/3628477310 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:03.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.101+0000 7f103531c640 1 --2- 172.21.15.123:0/3628477310 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1030154c10 0x7f103013d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:03.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.101+0000 7f103631e640 1 --2- 172.21.15.123:0/3628477310 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f103013d760 0x7f10300b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:03.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.102+0000 7f1035b1d640 1 -- 172.21.15.123:0/3628477310 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1030154c10 msgr2=0x7f103013d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:03.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.102+0000 7f1035b1d640 1 --2- 172.21.15.123:0/3628477310 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1030154c10 0x7f103013d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.102+0000 7f1035b1d640 1 -- 172.21.15.123:0/3628477310 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f103013d760 msgr2=0x7f10300b3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:03.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.102+0000 7f1035b1d640 1 --2- 172.21.15.123:0/3628477310 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f103013d760 0x7f10300b3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.102+0000 7f1035b1d640 1 -- 172.21.15.123:0/3628477310 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10300cfbf0 con 0x7f101c0039b0 2024-09-15T23:16:03.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.102+0000 7f103631e640 1 --2- 172.21.15.123:0/3628477310 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f103013d760 0x7f10300b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:16:03.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.102+0000 7f1035b1d640 1 --2- 172.21.15.123:0/3628477310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f101c0039b0 0x7f1030143f30 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f102c009ac0 tx=0x7f102c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:03.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.102+0000 7f10267fc640 1 -- 172.21.15.123:0/3628477310 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102c041020 con 0x7f101c0039b0 2024-09-15T23:16:03.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.102+0000 7f10267fc640 1 -- 172.21.15.123:0/3628477310 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f102c03c470 con 0x7f101c0039b0 2024-09-15T23:16:03.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.102+0000 7f1037d81640 1 -- 172.21.15.123:0/3628477310 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1030158a50 con 0x7f101c0039b0 2024-09-15T23:16:03.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.102+0000 7f10267fc640 1 -- 172.21.15.123:0/3628477310 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102c036040 con 0x7f101c0039b0 2024-09-15T23:16:03.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.102+0000 7f1037d81640 1 -- 172.21.15.123:0/3628477310 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1030155090 con 0x7f101c0039b0 2024-09-15T23:16:03.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.103+0000 7f1037d81640 1 -- 172.21.15.123:0/3628477310 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1030158870 con 0x7f101c0039b0 2024-09-15T23:16:03.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.103+0000 7f10267fc640 1 -- 172.21.15.123:0/3628477310 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f102c044020 con 0x7f101c0039b0 2024-09-15T23:16:03.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.104+0000 7f10267fc640 1 --2- 172.21.15.123:0/3628477310 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f101406c2e0 0x7f101406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:03.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.104+0000 7f10267fc640 1 -- 172.21.15.123:0/3628477310 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f102c0aba50 con 0x7f101c0039b0 2024-09-15T23:16:03.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.104+0000 7f103531c640 1 --2- 172.21.15.123:0/3628477310 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f101406c2e0 0x7f101406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:03.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.105+0000 7f103531c640 1 --2- 172.21.15.123:0/3628477310 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f101406c2e0 0x7f101406e7a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f103013de90 tx=0x7f1020009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:03.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.108+0000 7f10267fc640 1 -- 172.21.15.123:0/3628477310 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1030158870 con 0x7f101c0039b0 2024-09-15T23:16:03.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.307+0000 7f1037d81640 1 -- 172.21.15.123:0/3628477310 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f103006bc10 con 0x7f101c0039b0 2024-09-15T23:16:03.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.307+0000 7f10267fc640 1 -- 172.21.15.123:0/3628477310 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5234 (secure 0 0 0) 0x7f102c04b030 con 0x7f101c0039b0 2024-09-15T23:16:03.310 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:16:03.310 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":44,"btime":"2024-09-15T23:15:56:901221+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5621,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/3995408325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3995408325},{"type":"v1","addr":"172.21.15.188:6836","nonce":3995408325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5624,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2597191885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2597191885},{"type":"v1","addr":"172.21.15.188:6837","nonce":2597191885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6675,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/3814257760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3814257760},{"type":"v1","addr":"172.21.15.123:6834","nonce":3814257760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:15:54.225983+0000","modified":"2024-09-15T23:15:56.226130+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6678},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6678":{"gid":6678,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/839817134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":839817134},{"type":"v1","addr":"172.21.15.123:6835","nonce":839817134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6678,"qdb_cluster":[6678]},"id":5}]} 2024-09-15T23:16:03.310 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 44 2024-09-15T23:16:03.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.309+0000 7f1037d81640 1 -- 172.21.15.123:0/3628477310 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f101406c2e0 msgr2=0x7f101406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:03.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.309+0000 7f1037d81640 1 --2- 172.21.15.123:0/3628477310 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f101406c2e0 0x7f101406e7a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f103013de90 tx=0x7f1020009190 comp rx=0 tx=0).stop 2024-09-15T23:16:03.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.309+0000 7f1037d81640 1 -- 172.21.15.123:0/3628477310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f101c0039b0 msgr2=0x7f1030143f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:03.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.309+0000 7f1037d81640 1 --2- 172.21.15.123:0/3628477310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f101c0039b0 0x7f1030143f30 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f102c009ac0 tx=0x7f102c004730 comp rx=0 tx=0).stop 2024-09-15T23:16:03.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.309+0000 7f1037d81640 1 -- 172.21.15.123:0/3628477310 shutdown_connections 2024-09-15T23:16:03.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.309+0000 7f1037d81640 1 --2- 172.21.15.123:0/3628477310 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f103013d760 0x7f10300b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.309+0000 7f1037d81640 1 --2- 172.21.15.123:0/3628477310 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1030154c10 0x7f103013d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.309+0000 7f1037d81640 1 --2- 172.21.15.123:0/3628477310 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f101406c2e0 0x7f101406e7a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.309+0000 7f1037d81640 1 --2- 172.21.15.123:0/3628477310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f101c0039b0 0x7f1030143f30 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.309+0000 7f1037d81640 1 -- 172.21.15.123:0/3628477310 >> 172.21.15.123:0/3628477310 conn(0x7f10300ccec0 msgr2=0x7f103015b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:03.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.309+0000 7f1037d81640 1 -- 172.21.15.123:0/3628477310 shutdown_connections 2024-09-15T23:16:03.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.309+0000 7f1037d81640 1 -- 172.21.15.123:0/3628477310 wait complete. 2024-09-15T23:16:03.726 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 44, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:15:54.225983+0000', 'modified': '2024-09-15T23:15:56.226130+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6678}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6678': {'gid': 6678, 'name': 'a', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.123:6835/839817134', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6833', 'nonce': 839817134}, {'type': 'v1', 'addr': '172.21.15.123:6835', 'nonce': 839817134}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6678, 'qdb_cluster': [6678]} 2024-09-15T23:16:03.726 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:16:03.726 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-15T23:16:03.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.825+0000 7f7812c1e640 1 Processor -- start 2024-09-15T23:16:03.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.825+0000 7f7812c1e640 1 -- start start 2024-09-15T23:16:03.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.826+0000 7f7812c1e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f780c162c60 0x7f780c073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:03.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.826+0000 7f7812c1e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f780c06f730 0x7f780c06fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:03.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.826+0000 7f7812c1e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f780c1631c0 con 0x7f780c15e790 2024-09-15T23:16:03.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.826+0000 7f7812c1e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f780c15eb70 con 0x7f780c06f730 2024-09-15T23:16:03.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.826+0000 7f7812c1e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f780c0ae9a0 con 0x7f780c162c60 2024-09-15T23:16:03.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.826+0000 7f780bfff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f780c162c60 0x7f780c073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:03.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.826+0000 7f78111bb640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f780c06f730 0x7f780c06fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:03.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.826+0000 7f780bfff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f780c162c60 0x7f780c073a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:41800/0 (socket says 172.21.15.123:41800) 2024-09-15T23:16:03.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.826+0000 7f780bfff640 1 -- 172.21.15.123:0/3542196033 learned_addr learned my addr 172.21.15.123:0/3542196033 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:03.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.826+0000 7f78109ba640 1 --1- 172.21.15.123:0/3542196033 >> v1:172.21.15.188:6789/0 conn(0x7f780c15e790 0x7f780c0b5430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:50240/0 (socket says 172.21.15.123:50240) 2024-09-15T23:16:03.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.826+0000 7f780bfff640 1 -- 172.21.15.123:0/3542196033 >> v2:172.21.15.188:3300/0 conn(0x7f780c06f730 msgr2=0x7f780c06fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:03.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.826+0000 7f780bfff640 1 --2- 172.21.15.123:0/3542196033 >> v2:172.21.15.188:3300/0 conn(0x7f780c06f730 0x7f780c06fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.826+0000 7f780bfff640 1 -- 172.21.15.123:0/3542196033 >> v1:172.21.15.188:6789/0 conn(0x7f780c15e790 legacy=0x7f780c0b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:03.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.826+0000 7f780bfff640 1 -- 172.21.15.123:0/3542196033 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f780c0aec40 con 0x7f780c162c60 2024-09-15T23:16:03.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.827+0000 7f780bfff640 1 --2- 172.21.15.123:0/3542196033 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f780c162c60 0x7f780c073a40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f77f8009870 tx=0x7f77f802a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c06200d3c2d9165 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:03.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.827+0000 7f780b7fe640 1 -- 172.21.15.123:0/3542196033 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f8037070 con 0x7f780c162c60 2024-09-15T23:16:03.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.827+0000 7f780b7fe640 1 -- 172.21.15.123:0/3542196033 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77f8032440 con 0x7f780c162c60 2024-09-15T23:16:03.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.827+0000 7f780b7fe640 1 -- 172.21.15.123:0/3542196033 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f8032810 con 0x7f780c162c60 2024-09-15T23:16:03.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.828+0000 7f7812c1e640 1 -- 172.21.15.123:0/3542196033 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f780c162c60 msgr2=0x7f780c073a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:03.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.828+0000 7f7812c1e640 1 --2- 172.21.15.123:0/3542196033 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f780c162c60 0x7f780c073a40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f77f8009870 tx=0x7f77f802a1c0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.828+0000 7f7812c1e640 1 -- 172.21.15.123:0/3542196033 shutdown_connections 2024-09-15T23:16:03.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.828+0000 7f7812c1e640 1 --2- 172.21.15.123:0/3542196033 >> v2:172.21.15.188:3300/0 conn(0x7f780c06f730 0x7f780c06fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.828+0000 7f7812c1e640 1 --2- 172.21.15.123:0/3542196033 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f780c162c60 0x7f780c073a40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.828+0000 7f7812c1e640 1 -- 172.21.15.123:0/3542196033 >> 172.21.15.123:0/3542196033 conn(0x7f780c0b0a80 msgr2=0x7f780c0b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:03.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.828+0000 7f7812c1e640 1 -- 172.21.15.123:0/3542196033 shutdown_connections 2024-09-15T23:16:03.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.828+0000 7f7812c1e640 1 -- 172.21.15.123:0/3542196033 wait complete. 2024-09-15T23:16:03.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.829+0000 7f7812c1e640 1 Processor -- start 2024-09-15T23:16:03.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.829+0000 7f7812c1e640 1 -- start start 2024-09-15T23:16:03.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.830+0000 7f7812c1e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f780c06f730 0x7f780c0c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:03.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.830+0000 7f7812c1e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f780c15e790 0x7f780c0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:03.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.830+0000 7f7812c1e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f780c162c60 0x7f780c145280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:03.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.830+0000 7f7812c1e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f780c0b5b40 con 0x7f780c162c60 2024-09-15T23:16:03.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.830+0000 7f7812c1e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f780c0af200 con 0x7f780c15e790 2024-09-15T23:16:03.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.830+0000 7f7812c1e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f780c06f430 con 0x7f780c06f730 2024-09-15T23:16:03.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.830+0000 7f78111bb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f780c162c60 0x7f780c145280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:03.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.830+0000 7f78111bb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f780c162c60 0x7f780c145280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54084/0 (socket says 172.21.15.123:54084) 2024-09-15T23:16:03.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.830+0000 7f78111bb640 1 -- 172.21.15.123:0/1129828907 learned_addr learned my addr 172.21.15.123:0/1129828907 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:03.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.830+0000 7f78109ba640 1 --2- 172.21.15.123:0/1129828907 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f780c06f730 0x7f780c0c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:03.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.830+0000 7f780bfff640 1 --2- 172.21.15.123:0/1129828907 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f780c15e790 0x7f780c0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:03.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.830+0000 7f78111bb640 1 -- 172.21.15.123:0/1129828907 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f780c06f730 msgr2=0x7f780c0c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:03.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.830+0000 7f78111bb640 1 --2- 172.21.15.123:0/1129828907 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f780c06f730 0x7f780c0c5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.830+0000 7f78111bb640 1 -- 172.21.15.123:0/1129828907 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f780c15e790 msgr2=0x7f780c0c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:03.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.830+0000 7f78111bb640 1 --2- 172.21.15.123:0/1129828907 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f780c15e790 0x7f780c0c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.830+0000 7f78111bb640 1 -- 172.21.15.123:0/1129828907 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f780c0cd4e0 con 0x7f780c162c60 2024-09-15T23:16:03.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.831+0000 7f78111bb640 1 --2- 172.21.15.123:0/1129828907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f780c162c60 0x7f780c145280 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f7804009dd0 tx=0x7f780400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:03.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.831+0000 7f78097fa640 1 -- 172.21.15.123:0/1129828907 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7804018020 con 0x7f780c162c60 2024-09-15T23:16:03.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.831+0000 7f78097fa640 1 -- 172.21.15.123:0/1129828907 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7804014480 con 0x7f780c162c60 2024-09-15T23:16:03.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.831+0000 7f7812c1e640 1 -- 172.21.15.123:0/1129828907 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f780c0c6e30 con 0x7f780c162c60 2024-09-15T23:16:03.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.831+0000 7f78097fa640 1 -- 172.21.15.123:0/1129828907 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7804014870 con 0x7f780c162c60 2024-09-15T23:16:03.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.831+0000 7f7812c1e640 1 -- 172.21.15.123:0/1129828907 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f780c0c6590 con 0x7f780c162c60 2024-09-15T23:16:03.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.832+0000 7f78097fa640 1 -- 172.21.15.123:0/1129828907 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7804005d10 con 0x7f780c162c60 2024-09-15T23:16:03.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.833+0000 7f78097fa640 1 --2- 172.21.15.123:0/1129828907 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f77f006c2b0 0x7f77f006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:03.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.833+0000 7f78097fa640 1 -- 172.21.15.123:0/1129828907 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f780408be70 con 0x7f780c162c60 2024-09-15T23:16:03.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.833+0000 7f78109ba640 1 --2- 172.21.15.123:0/1129828907 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f77f006c2b0 0x7f77f006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:03.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.833+0000 7f78109ba640 1 --2- 172.21.15.123:0/1129828907 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f77f006c2b0 0x7f77f006e770 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7800007fd0 tx=0x7f7800007e80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:03.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.834+0000 7f7815a8e740 1 Processor -- start 2024-09-15T23:16:03.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.834+0000 7f7815a8e740 1 -- start start 2024-09-15T23:16:03.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.834+0000 7f7815a8e740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56007454f2c0 0x560074594a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:03.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.834+0000 7f7815a8e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56007454ca80 0x56007454f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:03.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.834+0000 7f7815a8e740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x560074550a50 0x5600745498b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:03.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.834+0000 7f7815a8e740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5600744b1520 con 0x56007454f2c0 2024-09-15T23:16:03.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.834+0000 7f7815a8e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5600744593e0 con 0x56007454ca80 2024-09-15T23:16:03.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.834+0000 7f7815a8e740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5600744ad4e0 con 0x560074550a50 2024-09-15T23:16:03.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.835+0000 7f78109ba640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56007454f2c0 0x560074594a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:03.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.835+0000 7f78109ba640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56007454f2c0 0x560074594a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54100/0 (socket says 172.21.15.123:54100) 2024-09-15T23:16:03.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.835+0000 7f78109ba640 1 -- 172.21.15.123:0/2906898191 learned_addr learned my addr 172.21.15.123:0/2906898191 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:03.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.835+0000 7f780bfff640 1 --2- 172.21.15.123:0/2906898191 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56007454ca80 0x56007454f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:03.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.835+0000 7f78111bb640 1 --2- 172.21.15.123:0/2906898191 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x560074550a50 0x5600745498b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:03.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.835+0000 7f78109ba640 1 -- 172.21.15.123:0/2906898191 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x560074550a50 msgr2=0x5600745498b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:03.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.835+0000 7f78109ba640 1 --2- 172.21.15.123:0/2906898191 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x560074550a50 0x5600745498b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.835+0000 7f78109ba640 1 -- 172.21.15.123:0/2906898191 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56007454ca80 msgr2=0x56007454f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:03.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.835+0000 7f78109ba640 1 --2- 172.21.15.123:0/2906898191 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56007454ca80 0x56007454f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.835+0000 7f78109ba640 1 -- 172.21.15.123:0/2906898191 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600744742f0 con 0x56007454f2c0 2024-09-15T23:16:03.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.835+0000 7f78109ba640 1 --2- 172.21.15.123:0/2906898191 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56007454f2c0 0x560074594a60 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f7800004c20 tx=0x7f7800013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d17e566634c8518 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:03.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.835+0000 7f77f67fc640 1 -- 172.21.15.123:0/2906898191 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7800026070 con 0x56007454f2c0 2024-09-15T23:16:03.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.835+0000 7f77f67fc640 1 -- 172.21.15.123:0/2906898191 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7800013b80 con 0x56007454f2c0 2024-09-15T23:16:03.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.835+0000 7f77f67fc640 1 -- 172.21.15.123:0/2906898191 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7800001d40 con 0x56007454f2c0 2024-09-15T23:16:03.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.836+0000 7f7815a8e740 1 -- 172.21.15.123:0/2906898191 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56007454f2c0 msgr2=0x560074594a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:03.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.836+0000 7f7815a8e740 1 --2- 172.21.15.123:0/2906898191 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56007454f2c0 0x560074594a60 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f7800004c20 tx=0x7f7800013000 comp rx=0 tx=0).stop 2024-09-15T23:16:03.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.836+0000 7f7815a8e740 1 -- 172.21.15.123:0/2906898191 shutdown_connections 2024-09-15T23:16:03.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.836+0000 7f7815a8e740 1 --2- 172.21.15.123:0/2906898191 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x560074550a50 0x5600745498b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.836+0000 7f7815a8e740 1 --2- 172.21.15.123:0/2906898191 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56007454ca80 0x56007454f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.836+0000 7f7815a8e740 1 --2- 172.21.15.123:0/2906898191 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56007454f2c0 0x560074594a60 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.836+0000 7f7815a8e740 1 -- 172.21.15.123:0/2906898191 >> 172.21.15.123:0/2906898191 conn(0x56007454ba80 msgr2=0x560074593f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:03.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.836+0000 7f7815a8e740 1 -- 172.21.15.123:0/2906898191 shutdown_connections 2024-09-15T23:16:03.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.836+0000 7f7815a8e740 1 -- 172.21.15.123:0/2906898191 wait complete. 2024-09-15T23:16:03.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.836+0000 7f7815a8e740 1 -- start start 2024-09-15T23:16:03.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.837+0000 7f7815a8e740 1 Processor -- start 2024-09-15T23:16:03.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.837+0000 7f7815a8e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56007454f2c0 0x560074563bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:03.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.837+0000 7f7815a8e740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x560074550a50 0x5600745703c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:03.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.837+0000 7f7815a8e740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56007456dd00 0x56007454e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:03.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.837+0000 7f7815a8e740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56007454af20 con 0x56007456dd00 2024-09-15T23:16:03.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.837+0000 7f7815a8e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56007443a450 con 0x56007454f2c0 2024-09-15T23:16:03.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.837+0000 7f7815a8e740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x560074595290 con 0x560074550a50 2024-09-15T23:16:03.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.837+0000 7f7815a8e740 10 client.0 _ll_register_callbacks cb 0x5600741c3ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:16:03.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.838+0000 7f78111bb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56007456dd00 0x56007454e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:03.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.838+0000 7f78111bb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56007456dd00 0x56007454e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54116/0 (socket says 172.21.15.123:54116) 2024-09-15T23:16:03.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.838+0000 7f78111bb640 1 -- 172.21.15.123:0/3623886373 learned_addr learned my addr 172.21.15.123:0/3623886373 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:03.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.838+0000 7f780bfff640 1 --2- 172.21.15.123:0/3623886373 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x560074550a50 0x5600745703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:03.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.838+0000 7f78109ba640 1 --2- 172.21.15.123:0/3623886373 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56007454f2c0 0x560074563bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:03.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.838+0000 7f78111bb640 1 -- 172.21.15.123:0/3623886373 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x560074550a50 msgr2=0x5600745703c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:03.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.838+0000 7f78111bb640 1 --2- 172.21.15.123:0/3623886373 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x560074550a50 0x5600745703c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.838+0000 7f78111bb640 1 -- 172.21.15.123:0/3623886373 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56007454f2c0 msgr2=0x560074563bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:03.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.838+0000 7f78111bb640 1 --2- 172.21.15.123:0/3623886373 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56007454f2c0 0x560074563bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.838+0000 7f78111bb640 1 -- 172.21.15.123:0/3623886373 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600741c42d0 con 0x56007456dd00 2024-09-15T23:16:03.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.838+0000 7f78111bb640 1 --2- 172.21.15.123:0/3623886373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56007456dd00 0x56007454e110 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f7804009a40 tx=0x7f780405e350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6166bd96bab87d28 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:03.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.838+0000 7f77eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:16:03.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.838+0000 7f77eb7fe640 1 -- 172.21.15.123:0/3623886373 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78040593e0 con 0x56007456dd00 2024-09-15T23:16:03.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.838+0000 7f77eb7fe640 1 -- 172.21.15.123:0/3623886373 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f7804059580 con 0x56007456dd00 2024-09-15T23:16:03.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.838+0000 7f7815a8e740 1 -- 172.21.15.123:0/3623886373 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7800013b80 con 0x56007456dd00 2024-09-15T23:16:03.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.838+0000 7f77eb7fe640 1 -- 172.21.15.123:0/3623886373 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f7804055ce0 con 0x56007456dd00 2024-09-15T23:16:03.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.838+0000 7f7815a8e740 10 client.6849 fetch_fsmap learned FSMap version 44 2024-09-15T23:16:03.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.838+0000 7f7815a8e740 1 -- 172.21.15.123:0/3623886373 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) -- 0x56007428e6b0 con 0x56007456dd00 2024-09-15T23:16:03.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.838+0000 7f77eb7fe640 1 -- 172.21.15.123:0/3623886373 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7800013b80 con 0x56007456dd00 2024-09-15T23:16:03.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.838+0000 7f77eb7fe640 1 -- 172.21.15.123:0/3623886373 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 44) ==== 3502+0+0 (secure 0 0 0) 0x7f7804055e80 con 0x56007456dd00 2024-09-15T23:16:03.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.838+0000 7f7815a8e740 10 client.6849 fetch_fsmap finished waiting for FSMap version 44 2024-09-15T23:16:03.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.838+0000 7f7815a8e740 10 client.6849 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T23:16:03.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.838+0000 7f7815a8e740 20 client.6849 populate_metadata read hostname 'smithi123' 2024-09-15T23:16:03.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.838+0000 7f7815a8e740 1 --2- 172.21.15.123:0/3623886373 >> [v2:172.21.15.123:6833/839817134,v1:172.21.15.123:6835/839817134] conn(0x56007456e740 0x560074548ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:03.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.839+0000 7f7815a8e740 4 client.6849 mds_command: new command op to 6678 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:16:03.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.839+0000 7f7815a8e740 1 -- 172.21.15.123:0/3623886373 --> [v2:172.21.15.123:6833/839817134,v1:172.21.15.123:6835/839817134] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600744bec50 con 0x56007456e740 2024-09-15T23:16:03.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.839+0000 7f78109ba640 1 --2- 172.21.15.123:0/3623886373 >> [v2:172.21.15.123:6833/839817134,v1:172.21.15.123:6835/839817134] conn(0x56007456e740 0x560074548ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:03.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.839+0000 7f77eb7fe640 10 client.6849 ms_handle_connect on v2:172.21.15.123:6833/839817134 2024-09-15T23:16:03.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.839+0000 7f78109ba640 1 --2- 172.21.15.123:0/3623886373 >> [v2:172.21.15.123:6833/839817134,v1:172.21.15.123:6835/839817134] conn(0x56007456e740 0x560074548ba0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93d2db9121510e16 server_cookie=efd0bbaaa26246e9 in_seq=0 out_seq=0 2024-09-15T23:16:03.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.840+0000 7f77eb7fe640 1 -- 172.21.15.123:0/3623886373 <== mds.0 v2:172.21.15.123:6833/839817134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5600744bec50 con 0x56007456e740 2024-09-15T23:16:03.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.840+0000 7f77eb7fe640 10 client.6849 handle_command_reply: tid=0 2024-09-15T23:16:03.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.840+0000 7f7815a8e740 1 client.6849 shutdown 2024-09-15T23:16:03.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.840+0000 7f7815a8e740 1 -- 172.21.15.123:0/3623886373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56007456dd00 msgr2=0x56007454e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:03.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.840+0000 7f7815a8e740 1 --2- 172.21.15.123:0/3623886373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56007456dd00 0x56007454e110 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f7804009a40 tx=0x7f780405e350 comp rx=0 tx=0).stop 2024-09-15T23:16:03.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.840+0000 7f7815a8e740 1 -- 172.21.15.123:0/3623886373 shutdown_connections 2024-09-15T23:16:03.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.840+0000 7f7815a8e740 1 --2- 172.21.15.123:0/3623886373 >> [v2:172.21.15.123:6833/839817134,v1:172.21.15.123:6835/839817134] conn(0x56007456e740 0x560074548ba0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.840+0000 7f7815a8e740 1 --2- 172.21.15.123:0/3623886373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56007456dd00 0x56007454e110 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.840+0000 7f7815a8e740 1 --2- 172.21.15.123:0/3623886373 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x560074550a50 0x5600745703c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.840+0000 7f77eb7fe640 0 client.6849 ms_handle_reset on v2:172.21.15.123:6833/839817134 2024-09-15T23:16:03.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.840+0000 7f7815a8e740 1 --2- 172.21.15.123:0/3623886373 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56007454f2c0 0x560074563bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.840+0000 7f7815a8e740 1 -- 172.21.15.123:0/3623886373 >> 172.21.15.123:0/3623886373 conn(0x56007454ca80 msgr2=0x560074591ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:03.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.840+0000 7f7815a8e740 1 -- 172.21.15.123:0/3623886373 shutdown_connections 2024-09-15T23:16:03.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.840+0000 7f7815a8e740 1 -- 172.21.15.123:0/3623886373 wait complete. 2024-09-15T23:16:03.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.840+0000 7f7815a8e740 20 client.6849 trim_cache size 0 max 16384 2024-09-15T23:16:03.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.858+0000 7f7815a8e740 1 Processor -- start 2024-09-15T23:16:03.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.858+0000 7f7815a8e740 1 -- start start 2024-09-15T23:16:03.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.858+0000 7f7815a8e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56007454f2c0 0x560074577ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:03.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.858+0000 7f7815a8e740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560074550a50 0x5600745b7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:03.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.858+0000 7f7815a8e740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56007456dd00 0x5600745b7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:03.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.858+0000 7f7815a8e740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f780c0cea40 con 0x560074550a50 2024-09-15T23:16:03.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.858+0000 7f7815a8e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f780c1f8870 con 0x56007454f2c0 2024-09-15T23:16:03.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.858+0000 7f7815a8e740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f780c0ce3f0 con 0x56007456dd00 2024-09-15T23:16:03.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.858+0000 7f780bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560074550a50 0x5600745b7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:03.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.858+0000 7f780bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560074550a50 0x5600745b7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54122/0 (socket says 172.21.15.123:54122) 2024-09-15T23:16:03.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.858+0000 7f780bfff640 1 -- 172.21.15.123:0/433876308 learned_addr learned my addr 172.21.15.123:0/433876308 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:03.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.859+0000 7f780bfff640 1 -- 172.21.15.123:0/433876308 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56007456dd00 msgr2=0x5600745b7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:03.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.859+0000 7f780bfff640 1 --2- 172.21.15.123:0/433876308 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56007456dd00 0x5600745b7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.859+0000 7f780bfff640 1 -- 172.21.15.123:0/433876308 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56007454f2c0 msgr2=0x560074577ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:03.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.859+0000 7f780bfff640 1 --2- 172.21.15.123:0/433876308 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56007454f2c0 0x560074577ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.859+0000 7f780bfff640 1 -- 172.21.15.123:0/433876308 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56007456db30 con 0x560074550a50 2024-09-15T23:16:03.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.859+0000 7f780bfff640 1 --2- 172.21.15.123:0/433876308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560074550a50 0x5600745b7400 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f77f8009990 tx=0x7f77f802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39c5358a1d681818 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:03.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.859+0000 7f77f5ffb640 1 -- 172.21.15.123:0/433876308 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f8037040 con 0x560074550a50 2024-09-15T23:16:03.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.859+0000 7f77f5ffb640 1 -- 172.21.15.123:0/433876308 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77f804c070 con 0x560074550a50 2024-09-15T23:16:03.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.859+0000 7f77f5ffb640 1 -- 172.21.15.123:0/433876308 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77f8032af0 con 0x560074550a50 2024-09-15T23:16:03.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.859+0000 7f7815a8e740 1 -- 172.21.15.123:0/433876308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560074550a50 msgr2=0x5600745b7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:03.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.859+0000 7f7815a8e740 1 --2- 172.21.15.123:0/433876308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560074550a50 0x5600745b7400 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f77f8009990 tx=0x7f77f802c000 comp rx=0 tx=0).stop 2024-09-15T23:16:03.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.859+0000 7f7815a8e740 1 -- 172.21.15.123:0/433876308 shutdown_connections 2024-09-15T23:16:03.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.860+0000 7f7815a8e740 1 --2- 172.21.15.123:0/433876308 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56007456dd00 0x5600745b7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.860+0000 7f7815a8e740 1 --2- 172.21.15.123:0/433876308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x560074550a50 0x5600745b7400 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.860+0000 7f7815a8e740 1 --2- 172.21.15.123:0/433876308 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56007454f2c0 0x560074577ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.860+0000 7f7815a8e740 1 -- 172.21.15.123:0/433876308 >> 172.21.15.123:0/433876308 conn(0x56007454ca80 msgr2=0x560074595b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:03.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.860+0000 7f7815a8e740 1 -- 172.21.15.123:0/433876308 shutdown_connections 2024-09-15T23:16:03.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.860+0000 7f7815a8e740 1 -- 172.21.15.123:0/433876308 wait complete. 2024-09-15T23:16:03.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.860+0000 7f7815a8e740 1 -- start start 2024-09-15T23:16:03.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.860+0000 7f7815a8e740 1 Processor -- start 2024-09-15T23:16:03.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.861+0000 7f7815a8e740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56007454f2c0 0x560074593ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:03.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.861+0000 7f7815a8e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560074550a50 0x5600745f7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:03.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.861+0000 7f7815a8e740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56007456dd00 0x5600745f7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:03.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.861+0000 7f7815a8e740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56007456e5c0 con 0x56007454f2c0 2024-09-15T23:16:03.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.861+0000 7f7815a8e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x560074579cf0 con 0x560074550a50 2024-09-15T23:16:03.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.861+0000 7f7815a8e740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x56007456ec10 con 0x56007456dd00 2024-09-15T23:16:03.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.861+0000 7f7815a8e740 10 client.0 _ll_register_callbacks cb 0x7f7804009d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:16:03.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.861+0000 7f78109ba640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56007454f2c0 0x560074593ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:03.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.861+0000 7f78109ba640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56007454f2c0 0x560074593ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54134/0 (socket says 172.21.15.123:54134) 2024-09-15T23:16:03.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.861+0000 7f78109ba640 1 -- 172.21.15.123:0/4124579428 learned_addr learned my addr 172.21.15.123:0/4124579428 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:03.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.861+0000 7f78109ba640 1 -- 172.21.15.123:0/4124579428 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56007456dd00 msgr2=0x5600745f7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:03.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.861+0000 7f78109ba640 1 --2- 172.21.15.123:0/4124579428 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56007456dd00 0x5600745f7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.861+0000 7f780bfff640 1 --2- 172.21.15.123:0/4124579428 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560074550a50 0x5600745f7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:03.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.861+0000 7f78109ba640 1 -- 172.21.15.123:0/4124579428 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560074550a50 msgr2=0x5600745f7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:03.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.861+0000 7f78109ba640 1 --2- 172.21.15.123:0/4124579428 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560074550a50 0x5600745f7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.861+0000 7f78109ba640 1 -- 172.21.15.123:0/4124579428 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600745b75a0 con 0x56007454f2c0 2024-09-15T23:16:03.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.861+0000 7f780bfff640 1 --2- 172.21.15.123:0/4124579428 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560074550a50 0x5600745f7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:16:03.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.862+0000 7f78109ba640 1 --2- 172.21.15.123:0/4124579428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56007454f2c0 0x560074593ca0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f780001f000 tx=0x7f7800000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f910b96b8dcb537 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:03.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.862+0000 7f77eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:16:03.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.862+0000 7f77eb7fe640 1 -- 172.21.15.123:0/4124579428 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7800026040 con 0x56007454f2c0 2024-09-15T23:16:03.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.862+0000 7f77eb7fe640 1 -- 172.21.15.123:0/4124579428 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f7800013b80 con 0x56007454f2c0 2024-09-15T23:16:03.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.862+0000 7f7815a8e740 1 -- 172.21.15.123:0/4124579428 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77f804c070 con 0x56007454f2c0 2024-09-15T23:16:03.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.862+0000 7f77eb7fe640 1 -- 172.21.15.123:0/4124579428 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f7800013d80 con 0x56007454f2c0 2024-09-15T23:16:03.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.862+0000 7f7815a8e740 10 client.6855 fetch_fsmap learned FSMap version 44 2024-09-15T23:16:03.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.862+0000 7f7815a8e740 1 -- 172.21.15.123:0/4124579428 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) -- 0x560074591f50 con 0x56007454f2c0 2024-09-15T23:16:03.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.862+0000 7f77eb7fe640 1 -- 172.21.15.123:0/4124579428 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77f804c070 con 0x56007454f2c0 2024-09-15T23:16:03.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.862+0000 7f77eb7fe640 1 -- 172.21.15.123:0/4124579428 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 44) ==== 3502+0+0 (secure 0 0 0) 0x7f7800044080 con 0x56007454f2c0 2024-09-15T23:16:03.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.862+0000 7f7815a8e740 10 client.6855 fetch_fsmap finished waiting for FSMap version 44 2024-09-15T23:16:03.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.862+0000 7f7815a8e740 10 client.6855 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T23:16:03.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.862+0000 7f7815a8e740 20 client.6855 populate_metadata read hostname 'smithi123' 2024-09-15T23:16:03.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.862+0000 7f7815a8e740 1 --2- 172.21.15.123:0/4124579428 >> [v2:172.21.15.123:6833/839817134,v1:172.21.15.123:6835/839817134] conn(0x5600745f8b80 0x560074590570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:03.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.862+0000 7f7815a8e740 4 client.6855 mds_command: new command op to 6678 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:16:03.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.862+0000 7f7815a8e740 1 -- 172.21.15.123:0/4124579428 --> [v2:172.21.15.123:6833/839817134,v1:172.21.15.123:6835/839817134] -- command(tid 0: {"prefix": "status"}) -- 0x56007458e360 con 0x5600745f8b80 2024-09-15T23:16:03.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.862+0000 7f780bfff640 1 --2- 172.21.15.123:0/4124579428 >> [v2:172.21.15.123:6833/839817134,v1:172.21.15.123:6835/839817134] conn(0x5600745f8b80 0x560074590570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:03.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.863+0000 7f77eb7fe640 10 client.6855 ms_handle_connect on v2:172.21.15.123:6833/839817134 2024-09-15T23:16:03.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.863+0000 7f780bfff640 1 --2- 172.21.15.123:0/4124579428 >> [v2:172.21.15.123:6833/839817134,v1:172.21.15.123:6835/839817134] conn(0x5600745f8b80 0x560074590570 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a836b5a29ee1d93 server_cookie=660e0535acb992e4 in_seq=0 out_seq=0 2024-09-15T23:16:03.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.863+0000 7f77eb7fe640 1 -- 172.21.15.123:0/4124579428 <== mds.0 v2:172.21.15.123:6833/839817134 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x56007458e360 con 0x5600745f8b80 2024-09-15T23:16:03.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.863+0000 7f77eb7fe640 10 client.6855 handle_command_reply: tid=0 2024-09-15T23:16:03.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.863+0000 7f7815a8e740 1 client.6855 shutdown 2024-09-15T23:16:03.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.863+0000 7f7815a8e740 1 -- 172.21.15.123:0/4124579428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56007454f2c0 msgr2=0x560074593ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:03.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.863+0000 7f7815a8e740 1 --2- 172.21.15.123:0/4124579428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56007454f2c0 0x560074593ca0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f780001f000 tx=0x7f7800000ed0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.863+0000 7f7815a8e740 1 -- 172.21.15.123:0/4124579428 shutdown_connections 2024-09-15T23:16:03.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.863+0000 7f7815a8e740 1 --2- 172.21.15.123:0/4124579428 >> [v2:172.21.15.123:6833/839817134,v1:172.21.15.123:6835/839817134] conn(0x5600745f8b80 0x560074590570 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.863+0000 7f7815a8e740 1 --2- 172.21.15.123:0/4124579428 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56007456dd00 0x5600745f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.863+0000 7f7815a8e740 1 --2- 172.21.15.123:0/4124579428 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x560074550a50 0x5600745f7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.863+0000 7f77eb7fe640 0 client.6855 ms_handle_reset on v2:172.21.15.123:6833/839817134 2024-09-15T23:16:03.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.863+0000 7f7815a8e740 1 --2- 172.21.15.123:0/4124579428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56007454f2c0 0x560074593ca0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.863+0000 7f7815a8e740 1 -- 172.21.15.123:0/4124579428 >> 172.21.15.123:0/4124579428 conn(0x56007454ca80 msgr2=0x5600745923a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:03.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.863+0000 7f7815a8e740 1 -- 172.21.15.123:0/4124579428 shutdown_connections 2024-09-15T23:16:03.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.863+0000 7f7815a8e740 1 -- 172.21.15.123:0/4124579428 wait complete. 2024-09-15T23:16:03.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.863+0000 7f7815a8e740 20 client.6855 trim_cache size 0 max 16384 2024-09-15T23:16:03.872 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:16:03.872 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "cb968ac4-8d3a-4b17-a673-6177aeaea589", 2024-09-15T23:16:03.872 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2024-09-15T23:16:03.872 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 6678, 2024-09-15T23:16:03.872 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-09-15T23:16:03.873 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-09-15T23:16:03.873 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-09-15T23:16:03.873 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 8.9831538700000007, 2024-09-15T23:16:03.873 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 44, 2024-09-15T23:16:03.873 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 82, 2024-09-15T23:16:03.873 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 82, 2024-09-15T23:16:03.873 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 13.316239603 2024-09-15T23:16:03.873 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:16:03.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.864+0000 7f7812c1e640 1 -- 172.21.15.123:0/1129828907 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f77f006c2b0 msgr2=0x7f77f006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:03.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.864+0000 7f7812c1e640 1 --2- 172.21.15.123:0/1129828907 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f77f006c2b0 0x7f77f006e770 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7800007fd0 tx=0x7f7800007e80 comp rx=0 tx=0).stop 2024-09-15T23:16:03.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.864+0000 7f7812c1e640 1 -- 172.21.15.123:0/1129828907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f780c162c60 msgr2=0x7f780c145280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:03.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.864+0000 7f7812c1e640 1 --2- 172.21.15.123:0/1129828907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f780c162c60 0x7f780c145280 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f7804009dd0 tx=0x7f780400c490 comp rx=0 tx=0).stop 2024-09-15T23:16:03.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.864+0000 7f7812c1e640 1 -- 172.21.15.123:0/1129828907 shutdown_connections 2024-09-15T23:16:03.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.864+0000 7f7812c1e640 1 --2- 172.21.15.123:0/1129828907 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f77f006c2b0 0x7f77f006e770 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.864+0000 7f7812c1e640 1 --2- 172.21.15.123:0/1129828907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f780c162c60 0x7f780c145280 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.864+0000 7f7812c1e640 1 --2- 172.21.15.123:0/1129828907 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f780c15e790 0x7f780c0c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.864+0000 7f7812c1e640 1 --2- 172.21.15.123:0/1129828907 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f780c06f730 0x7f780c0c5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.864+0000 7f7812c1e640 1 -- 172.21.15.123:0/1129828907 >> 172.21.15.123:0/1129828907 conn(0x7f780c0b0a80 msgr2=0x7f780c0726f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:03.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.864+0000 7f7812c1e640 1 -- 172.21.15.123:0/1129828907 shutdown_connections 2024-09-15T23:16:03.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.864+0000 7f7812c1e640 1 -- 172.21.15.123:0/1129828907 wait complete. 2024-09-15T23:16:03.877 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:16:03.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.973+0000 7f59202e4640 1 Processor -- start 2024-09-15T23:16:03.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.973+0000 7f59202e4640 1 -- start start 2024-09-15T23:16:03.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.974+0000 7f59202e4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f59180b2d40 0x7f591806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:03.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.974+0000 7f59202e4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f591806c150 0x7f591815c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:03.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.974+0000 7f59202e4640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5918071180 con 0x7f591813eb20 2024-09-15T23:16:03.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.974+0000 7f59202e4640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f5918071ab0 con 0x7f591806c150 2024-09-15T23:16:03.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.974+0000 7f59202e4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5918071460 con 0x7f59180b2d40 2024-09-15T23:16:03.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.974+0000 7f591e881640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f591806c150 0x7f591815c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:03.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.974+0000 7f591e881640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f591806c150 0x7f591815c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54148/0 (socket says 172.21.15.123:54148) 2024-09-15T23:16:03.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.974+0000 7f591e881640 1 -- 172.21.15.123:0/3305463682 learned_addr learned my addr 172.21.15.123:0/3305463682 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:03.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.974+0000 7f591e080640 1 --2- 172.21.15.123:0/3305463682 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f59180b2d40 0x7f591806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:03.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.974+0000 7f591e881640 1 -- 172.21.15.123:0/3305463682 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f59180b2d40 msgr2=0x7f591806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:03.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.974+0000 7f591e881640 1 --2- 172.21.15.123:0/3305463682 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f59180b2d40 0x7f591806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.974+0000 7f591e881640 1 -- 172.21.15.123:0/3305463682 >> v1:172.21.15.188:6789/0 conn(0x7f591813eb20 legacy=0x7f591815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:03.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.974+0000 7f591e881640 1 -- 172.21.15.123:0/3305463682 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5918071740 con 0x7f591806c150 2024-09-15T23:16:03.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.975+0000 7f591e881640 1 --2- 172.21.15.123:0/3305463682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f591806c150 0x7f591815c400 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f5918071c30 tx=0x7f591002c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b5276f998f327d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:03.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.975+0000 7f591d07e640 1 -- 172.21.15.123:0/3305463682 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5910009600 con 0x7f591806c150 2024-09-15T23:16:03.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.975+0000 7f591d07e640 1 -- 172.21.15.123:0/3305463682 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5910037070 con 0x7f591806c150 2024-09-15T23:16:03.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.975+0000 7f591d07e640 1 -- 172.21.15.123:0/3305463682 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59100099c0 con 0x7f591806c150 2024-09-15T23:16:03.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.976+0000 7f59202e4640 1 -- 172.21.15.123:0/3305463682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f591806c150 msgr2=0x7f591815c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:03.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.976+0000 7f59202e4640 1 --2- 172.21.15.123:0/3305463682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f591806c150 0x7f591815c400 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f5918071c30 tx=0x7f591002c910 comp rx=0 tx=0).stop 2024-09-15T23:16:03.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.976+0000 7f59202e4640 1 -- 172.21.15.123:0/3305463682 shutdown_connections 2024-09-15T23:16:03.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.976+0000 7f59202e4640 1 --2- 172.21.15.123:0/3305463682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f591806c150 0x7f591815c400 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.976+0000 7f59202e4640 1 --2- 172.21.15.123:0/3305463682 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f59180b2d40 0x7f591806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.976+0000 7f59202e4640 1 -- 172.21.15.123:0/3305463682 >> 172.21.15.123:0/3305463682 conn(0x7f59180ccec0 msgr2=0x7f59180cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:03.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.976+0000 7f59202e4640 1 -- 172.21.15.123:0/3305463682 shutdown_connections 2024-09-15T23:16:03.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.976+0000 7f59202e4640 1 -- 172.21.15.123:0/3305463682 wait complete. 2024-09-15T23:16:03.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.977+0000 7f59202e4640 1 Processor -- start 2024-09-15T23:16:03.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.977+0000 7f59202e4640 1 -- start start 2024-09-15T23:16:03.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.978+0000 7f59202e4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f591806c150 0x7f591813de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:03.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.978+0000 7f59202e4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59180b2d40 0x7f5918155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:03.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.978+0000 7f59202e4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f591813eb20 0x7f5918155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:03.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.978+0000 7f59202e4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f59180722d0 con 0x7f59180b2d40 2024-09-15T23:16:03.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.978+0000 7f59202e4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5918072150 con 0x7f591813eb20 2024-09-15T23:16:03.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.978+0000 7f59202e4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5918072450 con 0x7f591806c150 2024-09-15T23:16:03.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.978+0000 7f591d87f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59180b2d40 0x7f5918155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:03.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.978+0000 7f591d87f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59180b2d40 0x7f5918155000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54160/0 (socket says 172.21.15.123:54160) 2024-09-15T23:16:03.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.978+0000 7f591d87f640 1 -- 172.21.15.123:0/900159799 learned_addr learned my addr 172.21.15.123:0/900159799 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:03.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.978+0000 7f591e080640 1 --2- 172.21.15.123:0/900159799 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f591806c150 0x7f591813de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:03.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.978+0000 7f591e881640 1 --2- 172.21.15.123:0/900159799 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f591813eb20 0x7f5918155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:03.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.978+0000 7f591d87f640 1 -- 172.21.15.123:0/900159799 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f591806c150 msgr2=0x7f591813de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:03.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.978+0000 7f591d87f640 1 --2- 172.21.15.123:0/900159799 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f591806c150 0x7f591813de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.978+0000 7f591d87f640 1 -- 172.21.15.123:0/900159799 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f591813eb20 msgr2=0x7f5918155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:03.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.978+0000 7f591d87f640 1 --2- 172.21.15.123:0/900159799 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f591813eb20 0x7f5918155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:03.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.978+0000 7f591d87f640 1 -- 172.21.15.123:0/900159799 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f591813e390 con 0x7f59180b2d40 2024-09-15T23:16:03.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.978+0000 7f591d87f640 1 --2- 172.21.15.123:0/900159799 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59180b2d40 0x7f5918155000 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f590800c440 tx=0x7f590800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:03.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.978+0000 7f590effd640 1 -- 172.21.15.123:0/900159799 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59080052d0 con 0x7f59180b2d40 2024-09-15T23:16:03.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.978+0000 7f590effd640 1 -- 172.21.15.123:0/900159799 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5908005470 con 0x7f59180b2d40 2024-09-15T23:16:03.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.978+0000 7f59202e4640 1 -- 172.21.15.123:0/900159799 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f591815cb90 con 0x7f59180b2d40 2024-09-15T23:16:03.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.978+0000 7f590effd640 1 -- 172.21.15.123:0/900159799 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5908007260 con 0x7f59180b2d40 2024-09-15T23:16:03.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.978+0000 7f59202e4640 1 -- 172.21.15.123:0/900159799 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f591815d150 con 0x7f59180b2d40 2024-09-15T23:16:03.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.979+0000 7f59202e4640 1 -- 172.21.15.123:0/900159799 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f591806bc10 con 0x7f59180b2d40 2024-09-15T23:16:03.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.980+0000 7f590effd640 1 -- 172.21.15.123:0/900159799 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f59080074c0 con 0x7f59180b2d40 2024-09-15T23:16:03.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.980+0000 7f590effd640 1 --2- 172.21.15.123:0/900159799 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f58fc06c2b0 0x7f58fc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:03.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.980+0000 7f590effd640 1 -- 172.21.15.123:0/900159799 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f590808a820 con 0x7f59180b2d40 2024-09-15T23:16:03.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.981+0000 7f591e080640 1 --2- 172.21.15.123:0/900159799 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f58fc06c2b0 0x7f58fc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:03.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.981+0000 7f591e080640 1 --2- 172.21.15.123:0/900159799 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f58fc06c2b0 0x7f58fc06e770 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5914006fd0 tx=0x7f5914008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:03.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:03.985+0000 7f590effd640 1 -- 172.21.15.123:0/900159799 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5908058940 con 0x7f59180b2d40 2024-09-15T23:16:04.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:04.184+0000 7f59202e4640 1 -- 172.21.15.123:0/900159799 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f591813fdd0 con 0x7f59180b2d40 2024-09-15T23:16:04.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:04.185+0000 7f590effd640 1 -- 172.21.15.123:0/900159799 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v44) ==== 53+0+73 (secure 0 0 0) 0x7f590805cc40 con 0x7f59180b2d40 2024-09-15T23:16:04.187 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:16:04.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:04.187+0000 7f59202e4640 1 -- 172.21.15.123:0/900159799 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f58fc06c2b0 msgr2=0x7f58fc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:04.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:04.187+0000 7f59202e4640 1 --2- 172.21.15.123:0/900159799 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f58fc06c2b0 0x7f58fc06e770 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5914006fd0 tx=0x7f5914008040 comp rx=0 tx=0).stop 2024-09-15T23:16:04.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:04.187+0000 7f59202e4640 1 -- 172.21.15.123:0/900159799 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59180b2d40 msgr2=0x7f5918155000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:04.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:04.187+0000 7f59202e4640 1 --2- 172.21.15.123:0/900159799 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59180b2d40 0x7f5918155000 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f590800c440 tx=0x7f590800c900 comp rx=0 tx=0).stop 2024-09-15T23:16:04.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:04.187+0000 7f59202e4640 1 -- 172.21.15.123:0/900159799 shutdown_connections 2024-09-15T23:16:04.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:04.187+0000 7f59202e4640 1 --2- 172.21.15.123:0/900159799 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f591813eb20 0x7f5918155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:04.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:04.187+0000 7f59202e4640 1 --2- 172.21.15.123:0/900159799 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f58fc06c2b0 0x7f58fc06e770 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:04.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:04.187+0000 7f59202e4640 1 --2- 172.21.15.123:0/900159799 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59180b2d40 0x7f5918155000 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:04.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:04.187+0000 7f59202e4640 1 --2- 172.21.15.123:0/900159799 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f591806c150 0x7f591813de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:04.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:04.187+0000 7f59202e4640 1 -- 172.21.15.123:0/900159799 >> 172.21.15.123:0/900159799 conn(0x7f59180ccec0 msgr2=0x7f591813efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:04.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:04.187+0000 7f59202e4640 1 -- 172.21.15.123:0/900159799 shutdown_connections 2024-09-15T23:16:04.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:04.187+0000 7f59202e4640 1 -- 172.21.15.123:0/900159799 wait complete. 2024-09-15T23:16:04.200 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T23:16:04.200 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:16:04.200 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-09-15T23:16:04.200 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T23:16:04.200 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T23:16:04.200 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T23:16:04.200 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T23:16:04.200 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:16:04.200 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:16:04.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:16:04.201 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-09-15T23:16:04.216 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:16:04.216 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:16:04.216 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:16:04.216 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:16:04.217 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-09-15T23:16:04.217 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:16:04.217 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:16:04.217 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-09-15T23:16:04.217 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f0 2024-09-15T23:16:04.217 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:16:04.217 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:16:04.217 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f1 2024-09-15T23:16:04.217 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:16:04.217 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:16:04.217 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:16:04.217 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:16:04.217 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T23:16:04.217 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42576sec preferred_lft 42576sec 2024-09-15T23:16:04.218 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link noprefixroute 2024-09-15T23:16:04.218 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:16:04.218 INFO:teuthology.orchestra.run.smithi123.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:16:04.218 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 46:55:5a:e0:32:4d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:16:04.218 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:16:04.218 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:16:04.218 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::1c6f:d5ff:fe19:ff05/64 scope link 2024-09-15T23:16:04.218 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:16:04.218 INFO:teuthology.orchestra.run.smithi123.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:16:04.218 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 46:55:5a:e0:32:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:16:04.218 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::4455:5aff:fee0:324d/64 scope link 2024-09-15T23:16:04.218 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:16:04.218 INFO:teuthology.orchestra.run.smithi123.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:16:04.218 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether be:c1:f3:63:cb:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:16:04.218 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::bcc1:f3ff:fe63:cb24/64 scope link 2024-09-15T23:16:04.219 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:16:04.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:16:04.219 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:16:04.280 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-09-15T23:16:04.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:16:04.281 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-09-15T23:16:04.338 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-09-15T23:16:04.338 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:16:04.338 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:16:04.338 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:16:04.338 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:16:04.338 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:16:04.338 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:16:04.338 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:16:04.338 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:16:04.339 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:16:04.339 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:16:04.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:16:04.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:16:04.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:16:04.463 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-09-15T23:16:04.478 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T23:16:04.478 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:16:04.478 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:16:04.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:16:04.478 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2024-09-15T23:16:04.542 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:16:04.542 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T23:16:04.597 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:16:04.597 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:16:04.597 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:16:04.652 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T23:16:04.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:16:04.653 DEBUG:teuthology.orchestra.run.smithi123:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:16:04.736 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:16:04.736 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:16:04.736 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:16:04.745 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:16:04.745 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:16:04.745 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:16:04.745 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.188:3300,172.21.15.188:3301" 2024-09-15T23:16:04.745 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T23:16:04.750 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:16:04.750 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:16:04.750 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:16:04.750 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.188:3300,172.21.15.188:3301" 2024-09-15T23:16:04.750 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T23:16:04.750 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:6789,172.21.15.188:6789,172.21.15.188:6790" 2024-09-15T23:16:04.750 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.123:6789,172.21.15.188:6789,172.21.15.188:6790:/ 2024-09-15T23:16:04.750 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=cb968ac4-8d3a-4b17-a673-6177aeaea589" will pass to kernel 2024-09-15T23:16:04.751 INFO:teuthology.orchestra.run.smithi123.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-15T23:16:04.751 INFO:teuthology.orchestra.run.smithi123.stdout: You just mounted a file system that supports labels which does not 2024-09-15T23:16:04.751 INFO:teuthology.orchestra.run.smithi123.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T23:16:04.751 INFO:teuthology.orchestra.run.smithi123.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T23:16:04.751 INFO:teuthology.orchestra.run.smithi123.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T23:16:04.752 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T23:16:04.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:16:04.753 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:16:04.818 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T23:16:04.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:16:04.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:16:04.917 INFO:teuthology.orchestra.run.smithi123.stdout:client6145 2024-09-15T23:16:04.917 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:16:04.917 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:16:04.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:16:04.934 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scrub_repair_path) 2024-09-15T23:16:04.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:16:04.994 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch scrub_repair_path/file) 2024-09-15T23:16:05.050 DEBUG:teuthology.orchestra.run.smithi123:> stdin-killer -- python3 -c ' 2024-09-15T23:16:05.050 DEBUG:teuthology.orchestra.run.smithi123:> import os 2024-09-15T23:16:05.050 DEBUG:teuthology.orchestra.run.smithi123:> import stat 2024-09-15T23:16:05.050 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-15T23:16:05.050 DEBUG:teuthology.orchestra.run.smithi123:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_repair_path").st_ino) 2024-09-15T23:16:05.050 DEBUG:teuthology.orchestra.run.smithi123:> ' 2024-09-15T23:16:05.154 INFO:teuthology.orchestra.run.smithi123.stdout:1099511627776 2024-09-15T23:16:05.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:16:05.162 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:16:05.163 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:16:05.220 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:16:05.220 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:16:05.276 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:16:05.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.412+0000 7f15f0533640 1 Processor -- start 2024-09-15T23:16:05.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.412+0000 7f15f0533640 1 -- start start 2024-09-15T23:16:05.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.413+0000 7f15f0533640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f15e8073990 0x7f15e8169560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:05.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.413+0000 7f15f0533640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15e81632f0 con 0x7f15e8073330 2024-09-15T23:16:05.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.413+0000 7f15f0533640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15e806cb00 con 0x7f15e815e740 2024-09-15T23:16:05.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.413+0000 7f15f0533640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f15e806d430 con 0x7f15e8073990 2024-09-15T23:16:05.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.413+0000 7f15eead0640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f15e8073990 0x7f15e8169560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:05.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.413+0000 7f15eead0640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f15e8073990 0x7f15e8169560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54164/0 (socket says 172.21.15.123:54164) 2024-09-15T23:16:05.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.413+0000 7f15eead0640 1 -- 172.21.15.123:0/3343185840 learned_addr learned my addr 172.21.15.123:0/3343185840 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:05.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.414+0000 7f15eead0640 1 -- 172.21.15.123:0/3343185840 >> v1:172.21.15.188:6789/0 conn(0x7f15e815e740 legacy=0x7f15e8162400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:05.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.414+0000 7f15eead0640 1 -- 172.21.15.123:0/3343185840 >> v1:172.21.15.123:6789/0 conn(0x7f15e8073330 legacy=0x7f15e8162b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:05.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.414+0000 7f15eead0640 1 -- 172.21.15.123:0/3343185840 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15e806cde0 con 0x7f15e8073990 2024-09-15T23:16:05.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.414+0000 7f15ed2cd640 1 -- 172.21.15.123:0/3343185840 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2825530874 0 0) 0x7f15e81632f0 con 0x7f15e8073330 2024-09-15T23:16:05.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.414+0000 7f15eead0640 1 --2- 172.21.15.123:0/3343185840 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15e8073990 0x7f15e8169560 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f15e0009870 tx=0x7f15e002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7651f19ea255b4ed server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:05.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.415+0000 7f15ed2cd640 1 -- 172.21.15.123:0/3343185840 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e0037070 con 0x7f15e8073990 2024-09-15T23:16:05.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.415+0000 7f15ed2cd640 1 -- 172.21.15.123:0/3343185840 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15e0032440 con 0x7f15e8073990 2024-09-15T23:16:05.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.415+0000 7f15ed2cd640 1 -- 172.21.15.123:0/3343185840 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e0032810 con 0x7f15e8073990 2024-09-15T23:16:05.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.415+0000 7f15f0533640 1 -- 172.21.15.123:0/3343185840 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15e8073990 msgr2=0x7f15e8169560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:05.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.415+0000 7f15f0533640 1 --2- 172.21.15.123:0/3343185840 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15e8073990 0x7f15e8169560 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f15e0009870 tx=0x7f15e002a2a0 comp rx=0 tx=0).stop 2024-09-15T23:16:05.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.415+0000 7f15f0533640 1 -- 172.21.15.123:0/3343185840 shutdown_connections 2024-09-15T23:16:05.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.415+0000 7f15f0533640 1 --2- 172.21.15.123:0/3343185840 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15e8073990 0x7f15e8169560 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:05.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.415+0000 7f15f0533640 1 -- 172.21.15.123:0/3343185840 >> 172.21.15.123:0/3343185840 conn(0x7f15e806f400 msgr2=0x7f15e806f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:05.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.415+0000 7f15f0533640 1 -- 172.21.15.123:0/3343185840 shutdown_connections 2024-09-15T23:16:05.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.415+0000 7f15f0533640 1 -- 172.21.15.123:0/3343185840 wait complete. 2024-09-15T23:16:05.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.416+0000 7f15f0533640 1 Processor -- start 2024-09-15T23:16:05.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.416+0000 7f15f0533640 1 -- start start 2024-09-15T23:16:05.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.417+0000 7f15f0533640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15e8073330 0x7f15e815bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:05.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.417+0000 7f15f0533640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f15e8073990 0x7f15e80b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:05.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.417+0000 7f15f0533640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f15e815e740 0x7f15e81602e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:05.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.417+0000 7f15f0533640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f15e80aea00 con 0x7f15e8073330 2024-09-15T23:16:05.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.417+0000 7f15f0533640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f15e80ae880 con 0x7f15e8073990 2024-09-15T23:16:05.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.417+0000 7f15f0533640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f15e815eb20 con 0x7f15e815e740 2024-09-15T23:16:05.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.417+0000 7f15ee2cf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15e8073330 0x7f15e815bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:05.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.417+0000 7f15ee2cf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15e8073330 0x7f15e815bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54178/0 (socket says 172.21.15.123:54178) 2024-09-15T23:16:05.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.417+0000 7f15ee2cf640 1 -- 172.21.15.123:0/3225167294 learned_addr learned my addr 172.21.15.123:0/3225167294 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:05.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.417+0000 7f15edace640 1 --2- 172.21.15.123:0/3225167294 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f15e8073990 0x7f15e80b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:05.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.418+0000 7f15ee2cf640 1 -- 172.21.15.123:0/3225167294 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f15e815e740 msgr2=0x7f15e81602e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:05.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.418+0000 7f15ee2cf640 1 --2- 172.21.15.123:0/3225167294 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f15e815e740 0x7f15e81602e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:05.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.418+0000 7f15ee2cf640 1 -- 172.21.15.123:0/3225167294 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f15e8073990 msgr2=0x7f15e80b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:05.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.418+0000 7f15ee2cf640 1 --2- 172.21.15.123:0/3225167294 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f15e8073990 0x7f15e80b2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:05.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.418+0000 7f15ee2cf640 1 -- 172.21.15.123:0/3225167294 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15e815c110 con 0x7f15e8073330 2024-09-15T23:16:05.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.418+0000 7f15edace640 1 --2- 172.21.15.123:0/3225167294 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f15e8073990 0x7f15e80b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:16:05.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.418+0000 7f15ee2cf640 1 --2- 172.21.15.123:0/3225167294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15e8073330 0x7f15e815bbd0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f15d800c7f0 tx=0x7f15d800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:05.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.418+0000 7f15e6ffd640 1 -- 172.21.15.123:0/3225167294 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d8016020 con 0x7f15e8073330 2024-09-15T23:16:05.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.418+0000 7f15e6ffd640 1 -- 172.21.15.123:0/3225167294 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15d800aa50 con 0x7f15e8073330 2024-09-15T23:16:05.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.418+0000 7f15e6ffd640 1 -- 172.21.15.123:0/3225167294 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d800ae40 con 0x7f15e8073330 2024-09-15T23:16:05.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.418+0000 7f15f0533640 1 -- 172.21.15.123:0/3225167294 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15e80d1230 con 0x7f15e8073330 2024-09-15T23:16:05.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.418+0000 7f15f0533640 1 -- 172.21.15.123:0/3225167294 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15e80d17f0 con 0x7f15e8073330 2024-09-15T23:16:05.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.419+0000 7f15f0533640 1 -- 172.21.15.123:0/3225167294 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15e8162400 con 0x7f15e8073330 2024-09-15T23:16:05.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.419+0000 7f15e6ffd640 1 -- 172.21.15.123:0/3225167294 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f15d8019020 con 0x7f15e8073330 2024-09-15T23:16:05.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.420+0000 7f15e6ffd640 1 --2- 172.21.15.123:0/3225167294 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f15d406c2b0 0x7f15d406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:05.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.420+0000 7f15e6ffd640 1 -- 172.21.15.123:0/3225167294 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f15d808b090 con 0x7f15e8073330 2024-09-15T23:16:05.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.420+0000 7f15edace640 1 --2- 172.21.15.123:0/3225167294 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f15d406c2b0 0x7f15d406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:05.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.421+0000 7f15edace640 1 --2- 172.21.15.123:0/3225167294 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f15d406c2b0 0x7f15d406e770 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f15e80c8cf0 tx=0x7f15dc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:05.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.425+0000 7f15e6ffd640 1 -- 172.21.15.123:0/3225167294 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f15d8020070 con 0x7f15e8073330 2024-09-15T23:16:05.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.601+0000 7f15f0533640 1 -- 172.21.15.123:0/3225167294 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f15e815d280 con 0x7f15e8073330 2024-09-15T23:16:05.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.601+0000 7f15e6ffd640 1 -- 172.21.15.123:0/3225167294 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v82) ==== 80+0+0 (secure 0 0 0) 0x7f15e815c110 con 0x7f15e8073330 2024-09-15T23:16:05.604 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-15T23:16:05.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.604+0000 7f15f0533640 1 -- 172.21.15.123:0/3225167294 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f15d406c2b0 msgr2=0x7f15d406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:05.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.604+0000 7f15f0533640 1 --2- 172.21.15.123:0/3225167294 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f15d406c2b0 0x7f15d406e770 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f15e80c8cf0 tx=0x7f15dc009040 comp rx=0 tx=0).stop 2024-09-15T23:16:05.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.604+0000 7f15f0533640 1 -- 172.21.15.123:0/3225167294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15e8073330 msgr2=0x7f15e815bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:05.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.604+0000 7f15f0533640 1 --2- 172.21.15.123:0/3225167294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15e8073330 0x7f15e815bbd0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f15d800c7f0 tx=0x7f15d800ccb0 comp rx=0 tx=0).stop 2024-09-15T23:16:05.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.604+0000 7f15f0533640 1 -- 172.21.15.123:0/3225167294 shutdown_connections 2024-09-15T23:16:05.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.604+0000 7f15f0533640 1 --2- 172.21.15.123:0/3225167294 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f15e815e740 0x7f15e81602e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:05.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.604+0000 7f15f0533640 1 --2- 172.21.15.123:0/3225167294 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f15e8073990 0x7f15e80b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:05.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.604+0000 7f15f0533640 1 --2- 172.21.15.123:0/3225167294 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f15d406c2b0 0x7f15d406e770 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:05.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.604+0000 7f15f0533640 1 --2- 172.21.15.123:0/3225167294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15e8073330 0x7f15e815bbd0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:05.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.604+0000 7f15f0533640 1 -- 172.21.15.123:0/3225167294 >> 172.21.15.123:0/3225167294 conn(0x7f15e806f400 msgr2=0x7f15e815d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:05.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.604+0000 7f15f0533640 1 -- 172.21.15.123:0/3225167294 shutdown_connections 2024-09-15T23:16:05.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.604+0000 7f15f0533640 1 -- 172.21.15.123:0/3225167294 wait complete. 2024-09-15T23:16:05.616 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-15T23:16:05.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:16:05.617 DEBUG:teuthology.orchestra.run.smithi123:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-15T23:16:05.661 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-09-15T23:16:05.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:16:05.661 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T23:16:05.691 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:16:05.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.828+0000 7fcdea2d0640 1 Processor -- start 2024-09-15T23:16:05.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.828+0000 7fcdea2d0640 1 -- start start 2024-09-15T23:16:05.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.829+0000 7fcdea2d0640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcde40b2d40 0x7fcde406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:05.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.829+0000 7fcdea2d0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcde406c150 0x7fcde415c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:05.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.829+0000 7fcdea2d0640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcde4071180 con 0x7fcde413eb20 2024-09-15T23:16:05.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.829+0000 7fcdea2d0640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fcde4071ab0 con 0x7fcde40b2d40 2024-09-15T23:16:05.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.829+0000 7fcdea2d0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fcde4071460 con 0x7fcde406c150 2024-09-15T23:16:05.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.829+0000 7fcde3fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcde40b2d40 0x7fcde406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:05.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.829+0000 7fcde37fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fcde413eb20 0x7fcde415bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:44102/0 (socket says 172.21.15.123:44102) 2024-09-15T23:16:05.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.829+0000 7fcde3fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcde40b2d40 0x7fcde406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54188/0 (socket says 172.21.15.123:54188) 2024-09-15T23:16:05.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.829+0000 7fcde37fe640 1 -- 172.21.15.123:0/915488094 learned_addr learned my addr 172.21.15.123:0/915488094 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:05.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.829+0000 7fcde886d640 1 --2- 172.21.15.123:0/915488094 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcde406c150 0x7fcde415c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:05.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.830+0000 7fcde3fff640 1 -- 172.21.15.123:0/915488094 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcde406c150 msgr2=0x7fcde415c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:05.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.830+0000 7fcde3fff640 1 --2- 172.21.15.123:0/915488094 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcde406c150 0x7fcde415c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:05.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.830+0000 7fcde3fff640 1 -- 172.21.15.123:0/915488094 >> v1:172.21.15.123:6789/0 conn(0x7fcde413eb20 legacy=0x7fcde415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:05.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.830+0000 7fcde3fff640 1 -- 172.21.15.123:0/915488094 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde4071740 con 0x7fcde40b2d40 2024-09-15T23:16:05.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.830+0000 7fcde2ffd640 1 -- 172.21.15.123:0/915488094 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 755098940 0 0) 0x7fcde4071180 con 0x7fcde413eb20 2024-09-15T23:16:05.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.830+0000 7fcde3fff640 1 --2- 172.21.15.123:0/915488094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcde40b2d40 0x7fcde406bc10 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fcdd40097a0 tx=0x7fcdd402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf209726ecc77783 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:05.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.830+0000 7fcde2ffd640 1 -- 172.21.15.123:0/915488094 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4037070 con 0x7fcde40b2d40 2024-09-15T23:16:05.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.830+0000 7fcde2ffd640 1 -- 172.21.15.123:0/915488094 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdd4032440 con 0x7fcde40b2d40 2024-09-15T23:16:05.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.830+0000 7fcde2ffd640 1 -- 172.21.15.123:0/915488094 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4032810 con 0x7fcde40b2d40 2024-09-15T23:16:05.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.831+0000 7fcdea2d0640 1 -- 172.21.15.123:0/915488094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcde40b2d40 msgr2=0x7fcde406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:05.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.831+0000 7fcdea2d0640 1 --2- 172.21.15.123:0/915488094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcde40b2d40 0x7fcde406bc10 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fcdd40097a0 tx=0x7fcdd402a180 comp rx=0 tx=0).stop 2024-09-15T23:16:05.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.831+0000 7fcdea2d0640 1 -- 172.21.15.123:0/915488094 shutdown_connections 2024-09-15T23:16:05.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.831+0000 7fcdea2d0640 1 --2- 172.21.15.123:0/915488094 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcde406c150 0x7fcde415c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:05.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.831+0000 7fcdea2d0640 1 --2- 172.21.15.123:0/915488094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcde40b2d40 0x7fcde406bc10 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:05.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.831+0000 7fcdea2d0640 1 -- 172.21.15.123:0/915488094 >> 172.21.15.123:0/915488094 conn(0x7fcde40ccec0 msgr2=0x7fcde40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:05.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.831+0000 7fcdea2d0640 1 -- 172.21.15.123:0/915488094 shutdown_connections 2024-09-15T23:16:05.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.831+0000 7fcdea2d0640 1 -- 172.21.15.123:0/915488094 wait complete. 2024-09-15T23:16:05.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.832+0000 7fcdea2d0640 1 Processor -- start 2024-09-15T23:16:05.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.832+0000 7fcdea2d0640 1 -- start start 2024-09-15T23:16:05.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.833+0000 7fcdea2d0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcde406c150 0x7fcde415dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:05.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.833+0000 7fcdea2d0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcde40b2d40 0x7fcde415ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:05.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.833+0000 7fcdea2d0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcde413eb20 0x7fcde41f3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:05.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.833+0000 7fcdea2d0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcde40722d0 con 0x7fcde406c150 2024-09-15T23:16:05.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.833+0000 7fcdea2d0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fcde4072150 con 0x7fcde413eb20 2024-09-15T23:16:05.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.833+0000 7fcdea2d0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fcde4072450 con 0x7fcde40b2d40 2024-09-15T23:16:05.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.833+0000 7fcde3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcde406c150 0x7fcde415dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:05.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.833+0000 7fcde3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcde406c150 0x7fcde415dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54192/0 (socket says 172.21.15.123:54192) 2024-09-15T23:16:05.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.833+0000 7fcde3fff640 1 -- 172.21.15.123:0/3648477949 learned_addr learned my addr 172.21.15.123:0/3648477949 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:05.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.833+0000 7fcde3fff640 1 -- 172.21.15.123:0/3648477949 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcde40b2d40 msgr2=0x7fcde415ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:05.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.833+0000 7fcde3fff640 1 --2- 172.21.15.123:0/3648477949 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcde40b2d40 0x7fcde415ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:05.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.833+0000 7fcde3fff640 1 -- 172.21.15.123:0/3648477949 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcde413eb20 msgr2=0x7fcde41f3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:05.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.833+0000 7fcde3fff640 1 --2- 172.21.15.123:0/3648477949 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcde413eb20 0x7fcde41f3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:05.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.833+0000 7fcde3fff640 1 -- 172.21.15.123:0/3648477949 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde41f4230 con 0x7fcde406c150 2024-09-15T23:16:05.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.834+0000 7fcde3fff640 1 --2- 172.21.15.123:0/3648477949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcde406c150 0x7fcde415dbe0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4035040 tx=0x7fcdd40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:05.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.834+0000 7fcde0ff9640 1 -- 172.21.15.123:0/3648477949 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4037040 con 0x7fcde406c150 2024-09-15T23:16:05.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.834+0000 7fcde0ff9640 1 -- 172.21.15.123:0/3648477949 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdd4030770 con 0x7fcde406c150 2024-09-15T23:16:05.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.834+0000 7fcdea2d0640 1 -- 172.21.15.123:0/3648477949 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcde4157e40 con 0x7fcde406c150 2024-09-15T23:16:05.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.834+0000 7fcde0ff9640 1 -- 172.21.15.123:0/3648477949 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4030b80 con 0x7fcde406c150 2024-09-15T23:16:05.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.834+0000 7fcdea2d0640 1 -- 172.21.15.123:0/3648477949 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcde4158400 con 0x7fcde406c150 2024-09-15T23:16:05.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.835+0000 7fcdea2d0640 1 -- 172.21.15.123:0/3648477949 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcde406bc10 con 0x7fcde406c150 2024-09-15T23:16:05.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.835+0000 7fcde0ff9640 1 -- 172.21.15.123:0/3648477949 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcdd4044020 con 0x7fcde406c150 2024-09-15T23:16:05.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.836+0000 7fcde0ff9640 1 --2- 172.21.15.123:0/3648477949 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcdd006c2b0 0x7fcdd006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:05.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.836+0000 7fcde0ff9640 1 -- 172.21.15.123:0/3648477949 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7fcdd40ab970 con 0x7fcde406c150 2024-09-15T23:16:05.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.836+0000 7fcde37fe640 1 --2- 172.21.15.123:0/3648477949 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcdd006c2b0 0x7fcdd006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:05.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.836+0000 7fcde37fe640 1 --2- 172.21.15.123:0/3648477949 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcdd006c2b0 0x7fcdd006e770 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8007fd0 tx=0x7fcdd8007960 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:05.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:05.841+0000 7fcde0ff9640 1 -- 172.21.15.123:0/3648477949 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcde41f4230 con 0x7fcde406c150 2024-09-15T23:16:06.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.046+0000 7fcdea2d0640 1 -- 172.21.15.123:0/3648477949 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcde406c9c0 con 0x7fcde406c150 2024-09-15T23:16:06.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.047+0000 7fcde0ff9640 1 -- 172.21.15.123:0/3648477949 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5234 (secure 0 0 0) 0x7fcdd4032e20 con 0x7fcde406c150 2024-09-15T23:16:06.048 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:16:06.048 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":44,"btime":"2024-09-15T23:15:56:901221+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5621,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/3995408325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3995408325},{"type":"v1","addr":"172.21.15.188:6836","nonce":3995408325}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":5624,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2597191885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2597191885},{"type":"v1","addr":"172.21.15.188:6837","nonce":2597191885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6675,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/3814257760","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3814257760},{"type":"v1","addr":"172.21.15.123:6834","nonce":3814257760}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:15:54.225983+0000","modified":"2024-09-15T23:15:56.226130+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6678},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6678":{"gid":6678,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/839817134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":839817134},{"type":"v1","addr":"172.21.15.123:6835","nonce":839817134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6678,"qdb_cluster":[6678]},"id":5}]} 2024-09-15T23:16:06.048 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 44 2024-09-15T23:16:06.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.049+0000 7fcdea2d0640 1 -- 172.21.15.123:0/3648477949 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcdd006c2b0 msgr2=0x7fcdd006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:06.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.049+0000 7fcdea2d0640 1 --2- 172.21.15.123:0/3648477949 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcdd006c2b0 0x7fcdd006e770 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8007fd0 tx=0x7fcdd8007960 comp rx=0 tx=0).stop 2024-09-15T23:16:06.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.049+0000 7fcdea2d0640 1 -- 172.21.15.123:0/3648477949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcde406c150 msgr2=0x7fcde415dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:06.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.049+0000 7fcdea2d0640 1 --2- 172.21.15.123:0/3648477949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcde406c150 0x7fcde415dbe0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4035040 tx=0x7fcdd40046c0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.049+0000 7fcdea2d0640 1 -- 172.21.15.123:0/3648477949 shutdown_connections 2024-09-15T23:16:06.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.049+0000 7fcdea2d0640 1 --2- 172.21.15.123:0/3648477949 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcde413eb20 0x7fcde41f3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.049+0000 7fcdea2d0640 1 --2- 172.21.15.123:0/3648477949 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcde40b2d40 0x7fcde415ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.049+0000 7fcdea2d0640 1 --2- 172.21.15.123:0/3648477949 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcdd006c2b0 0x7fcdd006e770 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.049+0000 7fcdea2d0640 1 --2- 172.21.15.123:0/3648477949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcde406c150 0x7fcde415dbe0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.049+0000 7fcdea2d0640 1 -- 172.21.15.123:0/3648477949 >> 172.21.15.123:0/3648477949 conn(0x7fcde40ccec0 msgr2=0x7fcde413f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:06.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.049+0000 7fcdea2d0640 1 -- 172.21.15.123:0/3648477949 shutdown_connections 2024-09-15T23:16:06.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.049+0000 7fcdea2d0640 1 -- 172.21.15.123:0/3648477949 wait complete. 2024-09-15T23:16:06.061 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-09-15T23:16:06.186 INFO:teuthology.orchestra.run.smithi123.stdout:{"message":"","return_code":0} 2024-09-15T23:16:06.187 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-15T23:16:06.187 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T23:16:06.187 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:16:06.188 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T23:16:06.188 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:16:06.188 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T23:16:06.188 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:16:06.189 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T23:16:06.189 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:16:06.198 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T23:16:06.199 DEBUG:teuthology.parallel:result is None 2024-09-15T23:16:06.199 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T23:16:06.199 DEBUG:teuthology.parallel:result is None 2024-09-15T23:16:06.200 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T23:16:06.200 DEBUG:teuthology.parallel:result is None 2024-09-15T23:16:06.209 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T23:16:06.209 DEBUG:teuthology.parallel:result is None 2024-09-15T23:16:06.210 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmomapkey 10000000000.00000000 file_head 2024-09-15T23:16:06.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.281+0000 7f4e3a861f40 1 Processor -- start 2024-09-15T23:16:06.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.281+0000 7f4e3a861f40 1 -- start start 2024-09-15T23:16:06.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.281+0000 7f4e3a861f40 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e016047bd0 0x55e016066090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:06.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.281+0000 7f4e3a861f40 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e016049c80 0x55e0160e5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:06.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.282+0000 7f4e3a861f40 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e01605c6a0 0x55e016060680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:06.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.282+0000 7f4e3a861f40 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55e01604b010 con 0x55e016049c80 2024-09-15T23:16:06.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.282+0000 7f4e3a861f40 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55e015f6d510 con 0x55e01605c6a0 2024-09-15T23:16:06.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.282+0000 7f4e3a861f40 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55e01604b2b0 con 0x55e016047bd0 2024-09-15T23:16:06.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.282+0000 7f4e37b56640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e016049c80 0x55e0160e5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:06.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.282+0000 7f4e37b56640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e016049c80 0x55e0160e5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46426/0 (socket says 172.21.15.123:46426) 2024-09-15T23:16:06.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.282+0000 7f4e37b56640 1 -- 172.21.15.123:0/807387603 learned_addr learned my addr 172.21.15.123:0/807387603 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:06.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.282+0000 7f4e37b56640 1 -- 172.21.15.123:0/807387603 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e016047bd0 msgr2=0x55e016066090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:06.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.282+0000 7f4e37b56640 1 --2- 172.21.15.123:0/807387603 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e016047bd0 0x55e016066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.282+0000 7f4e37b56640 1 -- 172.21.15.123:0/807387603 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e01605c6a0 msgr2=0x55e016060680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:06.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.282+0000 7f4e37b56640 1 --2- 172.21.15.123:0/807387603 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e01605c6a0 0x55e016060680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.282+0000 7f4e37b56640 1 -- 172.21.15.123:0/807387603 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0160452f0 con 0x55e016049c80 2024-09-15T23:16:06.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.282+0000 7f4e37b56640 1 --2- 172.21.15.123:0/807387603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e016049c80 0x55e0160e5620 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c00b2f0 tx=0x7f4e2c00b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e206e6b2de202aa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:06.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.282+0000 7f4e36b54640 1 -- 172.21.15.123:0/807387603 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c008070 con 0x55e016049c80 2024-09-15T23:16:06.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.282+0000 7f4e36b54640 1 -- 172.21.15.123:0/807387603 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e2c00d500 con 0x55e016049c80 2024-09-15T23:16:06.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.282+0000 7f4e36b54640 1 -- 172.21.15.123:0/807387603 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c00d8d0 con 0x55e016049c80 2024-09-15T23:16:06.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.283+0000 7f4e3a861f40 1 -- 172.21.15.123:0/807387603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e016049c80 msgr2=0x55e0160e5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:06.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.283+0000 7f4e3a861f40 1 --2- 172.21.15.123:0/807387603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e016049c80 0x55e0160e5620 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c00b2f0 tx=0x7f4e2c00b7b0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.283+0000 7f4e3a861f40 1 -- 172.21.15.123:0/807387603 shutdown_connections 2024-09-15T23:16:06.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.283+0000 7f4e3a861f40 1 --2- 172.21.15.123:0/807387603 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e01605c6a0 0x55e016060680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.283+0000 7f4e3a861f40 1 --2- 172.21.15.123:0/807387603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e016049c80 0x55e0160e5620 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.283+0000 7f4e3a861f40 1 --2- 172.21.15.123:0/807387603 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e016047bd0 0x55e016066090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.283+0000 7f4e3a861f40 1 -- 172.21.15.123:0/807387603 >> 172.21.15.123:0/807387603 conn(0x55e0160485d0 msgr2=0x55e01604a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:06.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.283+0000 7f4e3a861f40 1 -- 172.21.15.123:0/807387603 shutdown_connections 2024-09-15T23:16:06.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.283+0000 7f4e3a861f40 1 -- 172.21.15.123:0/807387603 wait complete. 2024-09-15T23:16:06.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.283+0000 7f4e3a861f40 1 Processor -- start 2024-09-15T23:16:06.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.283+0000 7f4e3a861f40 1 -- start start 2024-09-15T23:16:06.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.284+0000 7f4e3a861f40 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e016047bd0 0x55e0160650f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:06.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.284+0000 7f4e3a861f40 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e016049c80 0x55e0160e1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:06.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.284+0000 7f4e3a861f40 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e01605c6a0 0x55e0160e5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:06.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.284+0000 7f4e3a861f40 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55e016045590 con 0x55e016047bd0 2024-09-15T23:16:06.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.284+0000 7f4e3a861f40 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55e0160601f0 con 0x55e01605c6a0 2024-09-15T23:16:06.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.284+0000 7f4e3a861f40 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55e0160458a0 con 0x55e016049c80 2024-09-15T23:16:06.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.284+0000 7f4e38357640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e016047bd0 0x55e0160650f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:06.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.284+0000 7f4e38357640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e016047bd0 0x55e0160650f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46442/0 (socket says 172.21.15.123:46442) 2024-09-15T23:16:06.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.284+0000 7f4e38357640 1 -- 172.21.15.123:0/1217646308 learned_addr learned my addr 172.21.15.123:0/1217646308 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:06.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.284+0000 7f4e38b58640 1 --2- 172.21.15.123:0/1217646308 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e01605c6a0 0x55e0160e5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:06.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.284+0000 7f4e37b56640 1 --2- 172.21.15.123:0/1217646308 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e016049c80 0x55e0160e1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:06.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.284+0000 7f4e38357640 1 -- 172.21.15.123:0/1217646308 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e016049c80 msgr2=0x55e0160e1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:06.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.284+0000 7f4e38357640 1 --2- 172.21.15.123:0/1217646308 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e016049c80 0x55e0160e1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.284+0000 7f4e38357640 1 -- 172.21.15.123:0/1217646308 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e01605c6a0 msgr2=0x55e0160e5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:06.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.284+0000 7f4e38357640 1 --2- 172.21.15.123:0/1217646308 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e01605c6a0 0x55e0160e5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.284+0000 7f4e38357640 1 -- 172.21.15.123:0/1217646308 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e016061580 con 0x55e016047bd0 2024-09-15T23:16:06.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.284+0000 7f4e38357640 1 --2- 172.21.15.123:0/1217646308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e016047bd0 0x55e0160650f0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f4e2800af50 tx=0x7f4e280087a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:06.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.285+0000 7f4e35b52640 1 -- 172.21.15.123:0/1217646308 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2800b810 con 0x55e016047bd0 2024-09-15T23:16:06.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.285+0000 7f4e35b52640 1 -- 172.21.15.123:0/1217646308 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e2800f070 con 0x55e016047bd0 2024-09-15T23:16:06.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.285+0000 7f4e3a861f40 1 -- 172.21.15.123:0/1217646308 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e016061860 con 0x55e016047bd0 2024-09-15T23:16:06.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.285+0000 7f4e35b52640 1 -- 172.21.15.123:0/1217646308 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2800bbf0 con 0x55e016047bd0 2024-09-15T23:16:06.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.285+0000 7f4e3a861f40 1 -- 172.21.15.123:0/1217646308 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e01601cc90 con 0x55e016047bd0 2024-09-15T23:16:06.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.286+0000 7f4e35b52640 1 -- 172.21.15.123:0/1217646308 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4e28014470 con 0x55e016047bd0 2024-09-15T23:16:06.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.286+0000 7f4e35b52640 1 --2- 172.21.15.123:0/1217646308 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4e2406ac90 0x7f4e2406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:06.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.287+0000 7f4e35b52640 1 -- 172.21.15.123:0/1217646308 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f4e2808a030 con 0x55e016047bd0 2024-09-15T23:16:06.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.287+0000 7f4e37b56640 1 --2- 172.21.15.123:0/1217646308 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4e2406ac90 0x7f4e2406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:06.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.287+0000 7f4e3a861f40 1 --2- 172.21.15.123:0/1217646308 >> [v2:172.21.15.123:6808/290001388,v1:172.21.15.123:6809/290001388] conn(0x55e0160610e0 0x55e01604a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:06.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.287+0000 7f4e3a861f40 1 -- 172.21.15.123:0/1217646308 --> [v2:172.21.15.123:6808/290001388,v1:172.21.15.123:6809/290001388] -- osd_op(unknown.0.0:1 10.10 10:0cf6ad0f:::10000000000.00000000:head [omap-rm-keys in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82) -- 0x55e01601d490 con 0x55e0160610e0 2024-09-15T23:16:06.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.287+0000 7f4e38b58640 1 --2- 172.21.15.123:0/1217646308 >> [v2:172.21.15.123:6808/290001388,v1:172.21.15.123:6809/290001388] conn(0x55e0160610e0 0x55e01604a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:06.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.287+0000 7f4e38b58640 1 --2- 172.21.15.123:0/1217646308 >> [v2:172.21.15.123:6808/290001388,v1:172.21.15.123:6809/290001388] conn(0x55e0160610e0 0x55e01604a570 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:06.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.287+0000 7f4e37b56640 1 --2- 172.21.15.123:0/1217646308 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4e2406ac90 0x7f4e2406d150 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c00b2f0 tx=0x7f4e2c009000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:06.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.288+0000 7f4e38b58640 1 -- 172.21.15.123:0/1217646308 <== osd.1 v2:172.21.15.123:6808/290001388 1 ==== osd_op_reply(1 10000000000.00000000 [omap-rm-keys] v82'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f4e300564a0 con 0x55e0160610e0 2024-09-15T23:16:06.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.288+0000 7f4e3a861f40 1 -- 172.21.15.123:0/1217646308 >> [v2:172.21.15.123:6808/290001388,v1:172.21.15.123:6809/290001388] conn(0x55e0160610e0 msgr2=0x55e01604a570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:06.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.288+0000 7f4e3a861f40 1 --2- 172.21.15.123:0/1217646308 >> [v2:172.21.15.123:6808/290001388,v1:172.21.15.123:6809/290001388] conn(0x55e0160610e0 0x55e01604a570 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.288+0000 7f4e3a861f40 1 -- 172.21.15.123:0/1217646308 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4e2406ac90 msgr2=0x7f4e2406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:06.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.288+0000 7f4e3a861f40 1 --2- 172.21.15.123:0/1217646308 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4e2406ac90 0x7f4e2406d150 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c00b2f0 tx=0x7f4e2c009000 comp rx=0 tx=0).stop 2024-09-15T23:16:06.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.288+0000 7f4e3a861f40 1 -- 172.21.15.123:0/1217646308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e016047bd0 msgr2=0x55e0160650f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:06.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.288+0000 7f4e3a861f40 1 --2- 172.21.15.123:0/1217646308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e016047bd0 0x55e0160650f0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f4e2800af50 tx=0x7f4e280087a0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.288+0000 7f4e38b58640 1 -- 172.21.15.123:0/1217646308 reap_dead start 2024-09-15T23:16:06.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.288+0000 7f4e3a861f40 1 -- 172.21.15.123:0/1217646308 shutdown_connections 2024-09-15T23:16:06.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.288+0000 7f4e3a861f40 1 -- 172.21.15.123:0/1217646308 >> 172.21.15.123:0/1217646308 conn(0x55e0160485d0 msgr2=0x55e016065e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:06.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.288+0000 7f4e3a861f40 1 -- 172.21.15.123:0/1217646308 shutdown_connections 2024-09-15T23:16:06.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.288+0000 7f4e3a861f40 1 -- 172.21.15.123:0/1217646308 wait complete. 2024-09-15T23:16:06.295 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2024-09-15T23:16:06.295 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-09-15T23:16:06.295 ERROR:tasks.ceph.mds.c:tried to stop a non-running daemon 2024-09-15T23:16:06.295 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-09-15T23:16:06.296 ERROR:tasks.ceph.mds.b:tried to stop a non-running daemon 2024-09-15T23:16:06.296 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-09-15T23:16:06.296 ERROR:tasks.ceph.mds.d:tried to stop a non-running daemon 2024-09-15T23:16:06.296 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-09-15T23:16:06.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.439+0000 7fa2e8326640 1 Processor -- start 2024-09-15T23:16:06.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.439+0000 7fc8336ed640 1 Processor -- start 2024-09-15T23:16:06.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.439+0000 7fa2e8326640 1 -- start start 2024-09-15T23:16:06.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.439+0000 7f4b660e6640 1 Processor -- start 2024-09-15T23:16:06.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.439+0000 7f4b660e6640 1 -- start start 2024-09-15T23:16:06.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.439+0000 7fc8336ed640 1 -- start start 2024-09-15T23:16:06.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.439+0000 7ff9c6ff8640 1 Processor -- start 2024-09-15T23:16:06.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.439+0000 7ff9c6ff8640 1 -- start start 2024-09-15T23:16:06.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.440+0000 7fa2e8326640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2e006c320 0x7fa2e015bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:06.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.440+0000 7fa2e8326640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa2e013eb20 0x7fa2e015c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:06.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.440+0000 7fa2e8326640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2e0071180 con 0x7fa2e00b2d40 2024-09-15T23:16:06.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.440+0000 7fa2e8326640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fa2e0071ab0 con 0x7fa2e013eb20 2024-09-15T23:16:06.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.440+0000 7fa2e8326640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa2e0071460 con 0x7fa2e006c320 2024-09-15T23:16:06.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.440+0000 7ff9c6ff8640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff9c0162980 0x7ff9c0154d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:06.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.440+0000 7ff9c6ff8640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9c00b0700 con 0x7ff9c00af0c0 2024-09-15T23:16:06.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.440+0000 7ff9c6ff8640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9c00af660 con 0x7ff9c006f150 2024-09-15T23:16:06.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.440+0000 7ff9c6ff8640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ff9c006f530 con 0x7ff9c0162980 2024-09-15T23:16:06.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.440+0000 7ff9bffff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff9c00af0c0 0x7ff9c0162270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40894/0 (socket says 172.21.15.123:40894) 2024-09-15T23:16:06.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.440+0000 7ff9bffff640 1 -- 172.21.15.123:0/3883584373 learned_addr learned my addr 172.21.15.123:0/3883584373 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:06.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.440+0000 7fa2e68c3640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa2e013eb20 0x7fa2e015c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:06.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.440+0000 7ff9c5595640 1 --2- 172.21.15.123:0/3883584373 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff9c0162980 0x7ff9c0154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:06.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.440+0000 7f4b660e6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4b6015ed20 0x7f4b600b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:06.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.440+0000 7fa2e68c3640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa2e013eb20 0x7fa2e015c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:58140/0 (socket says 172.21.15.123:58140) 2024-09-15T23:16:06.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.440+0000 7fa2e58c1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2e006c320 0x7fa2e015bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:06.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.440+0000 7fa2e68c3640 1 -- 172.21.15.123:0/3747307560 learned_addr learned my addr 172.21.15.123:0/3747307560 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:06.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.440+0000 7fc8336ed640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc82c0b2d40 0x7fc82c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:06.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.441+0000 7ff9bf7fe640 1 -- 172.21.15.123:0/3883584373 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3931225913 0 0) 0x7ff9c00b0700 con 0x7ff9c00af0c0 2024-09-15T23:16:06.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.441+0000 7fc8336ed640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc82c06c150 0x7fc82c15c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:06.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.441+0000 7ff9bf7fe640 1 -- 172.21.15.123:0/3883584373 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9b0003520 con 0x7ff9c00af0c0 2024-09-15T23:16:06.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.441+0000 7f4b660e6640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b600d0e70 con 0x7f4b600b90e0 2024-09-15T23:16:06.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.441+0000 7fc8336ed640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc82c071180 con 0x7fc82c13eb20 2024-09-15T23:16:06.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.441+0000 7f4b660e6640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b600d00f0 con 0x7f4b600d23b0 2024-09-15T23:16:06.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.441+0000 7fc8336ed640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc82c071ab0 con 0x7fc82c06c150 2024-09-15T23:16:06.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.441+0000 7fc831489640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc82c0b2d40 0x7fc82c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:06.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.441+0000 7fc830c88640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc82c13eb20 0x7fc82c15bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40902/0 (socket says 172.21.15.123:40902) 2024-09-15T23:16:06.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.441+0000 7fc830c88640 1 -- 172.21.15.123:0/1212938402 learned_addr learned my addr 172.21.15.123:0/1212938402 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:06.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.441+0000 7f4b660e6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f4b600d41c0 con 0x7f4b6015ed20 2024-09-15T23:16:06.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.441+0000 7fc8336ed640 1 -- 172.21.15.123:0/1212938402 --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fc82c071460 con 0x7fc82c0b2d40 2024-09-15T23:16:06.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.441+0000 7ff9c5595640 1 -- 172.21.15.123:0/3883584373 >> v1:172.21.15.188:6789/0 conn(0x7ff9c006f150 legacy=0x7ff9c0072bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:06.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.441+0000 7ff9c5595640 1 -- 172.21.15.123:0/3883584373 >> v1:172.21.15.123:6789/0 conn(0x7ff9c00af0c0 legacy=0x7ff9c0162270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:06.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.441+0000 7ff9c5595640 1 -- 172.21.15.123:0/3883584373 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c00af940 con 0x7ff9c0162980 2024-09-15T23:16:06.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.441+0000 7f4b5f7fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4b6015ed20 0x7f4b600b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:06.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.441+0000 7f4b5f7fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4b6015ed20 0x7f4b600b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:58156/0 (socket says 172.21.15.123:58156) 2024-09-15T23:16:06.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.441+0000 7f4b5f7fe640 1 -- 172.21.15.123:0/4278914245 learned_addr learned my addr 172.21.15.123:0/4278914245 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:06.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.441+0000 7f4b5ffff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f4b600b90e0 0x7f4b600cf9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40908/0 (socket says 172.21.15.123:40908) 2024-09-15T23:16:06.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.441+0000 7fc831c8a640 1 --2- 172.21.15.123:0/1212938402 >> v2:172.21.15.123:3300/0 conn(0x7fc82c06c150 0x7fc82c15c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:06.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.441+0000 7fa2e50c0640 1 -- 172.21.15.123:0/3747307560 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2538267814 0 0) 0x7fa2e0071180 con 0x7fa2e00b2d40 2024-09-15T23:16:06.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.441+0000 7fa2e50c0640 1 -- 172.21.15.123:0/3747307560 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2cc003520 con 0x7fa2e00b2d40 2024-09-15T23:16:06.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.441+0000 7fa2e68c3640 1 -- 172.21.15.123:0/3747307560 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2e006c320 msgr2=0x7fa2e015bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:06.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.441+0000 7fa2e68c3640 1 --2- 172.21.15.123:0/3747307560 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2e006c320 0x7fa2e015bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.441+0000 7fa2e68c3640 1 -- 172.21.15.123:0/3747307560 >> v1:172.21.15.188:6789/0 conn(0x7fa2e00b2d40 legacy=0x7fa2e006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:06.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.441+0000 7fc831489640 1 -- 172.21.15.123:0/1212938402 >> v2:172.21.15.123:3300/0 conn(0x7fc82c06c150 msgr2=0x7fc82c15c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:06.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.441+0000 7fc831489640 1 --2- 172.21.15.123:0/1212938402 >> v2:172.21.15.123:3300/0 conn(0x7fc82c06c150 0x7fc82c15c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.441+0000 7fc831489640 1 -- 172.21.15.123:0/1212938402 >> v1:172.21.15.123:6789/0 conn(0x7fc82c13eb20 legacy=0x7fc82c15bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:06.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.441+0000 7fc831489640 1 -- 172.21.15.123:0/1212938402 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc82c071740 con 0x7fc82c0b2d40 2024-09-15T23:16:06.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.441+0000 7f4b5f7fe640 1 -- 172.21.15.123:0/4278914245 >> v1:172.21.15.188:6789/0 conn(0x7f4b600d23b0 legacy=0x7f4b600cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:06.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.441+0000 7f4b5f7fe640 1 -- 172.21.15.123:0/4278914245 >> v1:172.21.15.123:6789/0 conn(0x7f4b600b90e0 legacy=0x7f4b600cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:06.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.441+0000 7f4b5e7fc640 1 -- 172.21.15.123:0/4278914245 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1893767488 0 0) 0x7f4b600d00f0 con 0x7f4b600d23b0 2024-09-15T23:16:06.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.441+0000 7f4b5f7fe640 1 -- 172.21.15.123:0/4278914245 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b600d35b0 con 0x7f4b6015ed20 2024-09-15T23:16:06.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.441+0000 7fa2e68c3640 1 -- 172.21.15.123:0/3747307560 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2e0071740 con 0x7fa2e013eb20 2024-09-15T23:16:06.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.442+0000 7ff9c5595640 1 --2- 172.21.15.123:0/3883584373 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff9c0162980 0x7ff9c0154d30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8009dc0 tx=0x7ff9b802a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cb99a9627c3cd40 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:06.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.442+0000 7fc831489640 1 --2- 172.21.15.123:0/1212938402 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc82c0b2d40 0x7fc82c06bc10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc82c069be0 tx=0x7fc82802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42b340a301e56322 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:06.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.442+0000 7ff9bf7fe640 1 -- 172.21.15.123:0/3883584373 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b8007740 con 0x7ff9c0162980 2024-09-15T23:16:06.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.442+0000 7ff9bf7fe640 1 -- 172.21.15.123:0/3883584373 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9b80078e0 con 0x7ff9c0162980 2024-09-15T23:16:06.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.442+0000 7ff9bf7fe640 1 -- 172.21.15.123:0/3883584373 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b8007cb0 con 0x7ff9c0162980 2024-09-15T23:16:06.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.442+0000 7fc823fff640 1 -- 172.21.15.123:0/1212938402 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc828037070 con 0x7fc82c0b2d40 2024-09-15T23:16:06.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.442+0000 7fc823fff640 1 -- 172.21.15.123:0/1212938402 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc828032440 con 0x7fc82c0b2d40 2024-09-15T23:16:06.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.442+0000 7fc823fff640 1 -- 172.21.15.123:0/1212938402 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc828032810 con 0x7fc82c0b2d40 2024-09-15T23:16:06.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.442+0000 7f4b5f7fe640 1 --2- 172.21.15.123:0/4278914245 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b6015ed20 0x7f4b600b6260 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4b50009870 tx=0x7f4b5002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bf5a5b5c8ce66f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:06.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.442+0000 7fa2e68c3640 1 --2- 172.21.15.123:0/3747307560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2e013eb20 0x7fa2e015c230 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa2d800bef0 tx=0x7fa2d80093b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27d274fe34b47791 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:06.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.442+0000 7f4b5e7fc640 1 -- 172.21.15.123:0/4278914245 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b50037070 con 0x7f4b6015ed20 2024-09-15T23:16:06.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.443+0000 7f4b5e7fc640 1 -- 172.21.15.123:0/4278914245 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b50032440 con 0x7f4b6015ed20 2024-09-15T23:16:06.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.443+0000 7f4b5e7fc640 1 -- 172.21.15.123:0/4278914245 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b50032810 con 0x7f4b6015ed20 2024-09-15T23:16:06.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.443+0000 7fa2e50c0640 1 -- 172.21.15.123:0/3747307560 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8036070 con 0x7fa2e013eb20 2024-09-15T23:16:06.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.443+0000 7fa2e50c0640 1 -- 172.21.15.123:0/3747307560 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2d8009600 con 0x7fa2e013eb20 2024-09-15T23:16:06.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.443+0000 7fa2e50c0640 1 -- 172.21.15.123:0/3747307560 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d80099f0 con 0x7fa2e013eb20 2024-09-15T23:16:06.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.443+0000 7ff9c6ff8640 1 -- 172.21.15.123:0/3883584373 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff9c0162980 msgr2=0x7ff9c0154d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:06.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.443+0000 7ff9c6ff8640 1 --2- 172.21.15.123:0/3883584373 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff9c0162980 0x7ff9c0154d30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8009dc0 tx=0x7ff9b802a6d0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.443+0000 7ff9c6ff8640 1 -- 172.21.15.123:0/3883584373 shutdown_connections 2024-09-15T23:16:06.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.443+0000 7ff9c6ff8640 1 --2- 172.21.15.123:0/3883584373 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff9c0162980 0x7ff9c0154d30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.443+0000 7ff9c6ff8640 1 -- 172.21.15.123:0/3883584373 >> 172.21.15.123:0/3883584373 conn(0x7ff9c00b30c0 msgr2=0x7ff9c006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:06.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.443+0000 7ff9c6ff8640 1 -- 172.21.15.123:0/3883584373 shutdown_connections 2024-09-15T23:16:06.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.443+0000 7ff9c6ff8640 1 -- 172.21.15.123:0/3883584373 wait complete. 2024-09-15T23:16:06.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.443+0000 7fc8336ed640 1 -- 172.21.15.123:0/1212938402 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc82c0b2d40 msgr2=0x7fc82c06bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:06.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.443+0000 7fc8336ed640 1 --2- 172.21.15.123:0/1212938402 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc82c0b2d40 0x7fc82c06bc10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc82c069be0 tx=0x7fc82802a1a0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.443+0000 7fc8336ed640 1 -- 172.21.15.123:0/1212938402 shutdown_connections 2024-09-15T23:16:06.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.443+0000 7fc8336ed640 1 --2- 172.21.15.123:0/1212938402 >> v2:172.21.15.123:3300/0 conn(0x7fc82c06c150 0x7fc82c15c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.443+0000 7fc8336ed640 1 --2- 172.21.15.123:0/1212938402 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc82c0b2d40 0x7fc82c06bc10 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.443+0000 7fc8336ed640 1 -- 172.21.15.123:0/1212938402 >> 172.21.15.123:0/1212938402 conn(0x7fc82c0ccec0 msgr2=0x7fc82c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:06.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.443+0000 7fa2e8326640 1 -- 172.21.15.123:0/3747307560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2e013eb20 msgr2=0x7fa2e015c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:06.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.443+0000 7fa2e8326640 1 --2- 172.21.15.123:0/3747307560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2e013eb20 0x7fa2e015c230 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa2d800bef0 tx=0x7fa2d80093b0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.443+0000 7f4b660e6640 1 -- 172.21.15.123:0/4278914245 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b6015ed20 msgr2=0x7f4b600b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:06.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.443+0000 7f4b660e6640 1 --2- 172.21.15.123:0/4278914245 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b6015ed20 0x7f4b600b6260 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4b50009870 tx=0x7f4b5002a270 comp rx=0 tx=0).stop 2024-09-15T23:16:06.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.443+0000 7fc8336ed640 1 -- 172.21.15.123:0/1212938402 shutdown_connections 2024-09-15T23:16:06.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.443+0000 7f4b660e6640 1 -- 172.21.15.123:0/4278914245 shutdown_connections 2024-09-15T23:16:06.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.443+0000 7f4b660e6640 1 --2- 172.21.15.123:0/4278914245 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b6015ed20 0x7f4b600b6260 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.443+0000 7f4b660e6640 1 -- 172.21.15.123:0/4278914245 >> 172.21.15.123:0/4278914245 conn(0x7f4b600d1260 msgr2=0x7f4b600d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:06.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.443+0000 7fc8336ed640 1 -- 172.21.15.123:0/1212938402 wait complete. 2024-09-15T23:16:06.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.443+0000 7fa2e8326640 1 -- 172.21.15.123:0/3747307560 shutdown_connections 2024-09-15T23:16:06.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.443+0000 7fa2e8326640 1 --2- 172.21.15.123:0/3747307560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2e013eb20 0x7fa2e015c230 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.443+0000 7fa2e8326640 1 --2- 172.21.15.123:0/3747307560 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2e006c320 0x7fa2e015bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.443+0000 7fa2e8326640 1 -- 172.21.15.123:0/3747307560 >> 172.21.15.123:0/3747307560 conn(0x7fa2e00ccec0 msgr2=0x7fa2e00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:06.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.444+0000 7f4b660e6640 1 -- 172.21.15.123:0/4278914245 shutdown_connections 2024-09-15T23:16:06.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.444+0000 7f4b660e6640 1 -- 172.21.15.123:0/4278914245 wait complete. 2024-09-15T23:16:06.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.444+0000 7fa2e8326640 1 -- 172.21.15.123:0/3747307560 shutdown_connections 2024-09-15T23:16:06.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.444+0000 7fa2e8326640 1 -- 172.21.15.123:0/3747307560 wait complete. 2024-09-15T23:16:06.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.445+0000 7ff9c6ff8640 1 Processor -- start 2024-09-15T23:16:06.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.445+0000 7ff9c6ff8640 1 -- start start 2024-09-15T23:16:06.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.445+0000 7f4b660e6640 1 Processor -- start 2024-09-15T23:16:06.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.445+0000 7fa2e8326640 1 Processor -- start 2024-09-15T23:16:06.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.445+0000 7fa2e8326640 1 -- start start 2024-09-15T23:16:06.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.445+0000 7fc8336ed640 1 Processor -- start 2024-09-15T23:16:06.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.445+0000 7f4b660e6640 1 -- start start 2024-09-15T23:16:06.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.445+0000 7fc8336ed640 1 -- start start 2024-09-15T23:16:06.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7fa2e8326640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2e006c320 0x7fa2e0153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:06.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7fa2e8326640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2e00b2d40 0x7fa2e00b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:06.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7fa2e8326640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2e013eb20 0x7fa2e00b5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:06.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7fc8336ed640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc82c06c150 0x7fc82c15dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:06.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7fc8336ed640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc82c0b2d40 0x7fc82c15e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:06.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7fc8336ed640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc82c13eb20 0x7fc82c154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:06.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7fa2e58c1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2e00b2d40 0x7fa2e00b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:06.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7fc8336ed640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc82c0722d0 con 0x7fc82c06c150 2024-09-15T23:16:06.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7fc8336ed640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc82c072150 con 0x7fc82c13eb20 2024-09-15T23:16:06.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7fc8336ed640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc82c072450 con 0x7fc82c0b2d40 2024-09-15T23:16:06.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7fc831489640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc82c06c150 0x7fc82c15dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:06.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7fc831489640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc82c06c150 0x7fc82c15dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46456/0 (socket says 172.21.15.123:46456) 2024-09-15T23:16:06.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7fc830c88640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc82c0b2d40 0x7fc82c15e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:06.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7fc831489640 1 -- 172.21.15.123:0/3676189010 learned_addr learned my addr 172.21.15.123:0/3676189010 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:06.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7fa2e8326640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e00720c0 con 0x7fa2e00b2d40 2024-09-15T23:16:06.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7fa2e8326640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e0071f40 con 0x7fa2e013eb20 2024-09-15T23:16:06.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7fc831c8a640 1 --2- 172.21.15.123:0/3676189010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc82c13eb20 0x7fc82c154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:06.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7fa2e8326640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa2e0072240 con 0x7fa2e006c320 2024-09-15T23:16:06.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7f4b660e6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b600b90e0 0x7f4b600cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:06.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7f4b660e6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b600d23b0 0x7f4b60154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:06.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7f4b660e6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4b6015ed20 0x7f4b600ca480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:06.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7fa2e60c2640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2e006c320 0x7fa2e0153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:06.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7f4b660e6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4b600d3e50 con 0x7f4b600b90e0 2024-09-15T23:16:06.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7f4b660e6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4b600d3b70 con 0x7f4b600d23b0 2024-09-15T23:16:06.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7f4b660e6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4b600d32a0 con 0x7f4b6015ed20 2024-09-15T23:16:06.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7fa2e58c1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2e00b2d40 0x7fa2e00b51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46448/0 (socket says 172.21.15.123:46448) 2024-09-15T23:16:06.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7fa2e58c1640 1 -- 172.21.15.123:0/2322996867 learned_addr learned my addr 172.21.15.123:0/2322996867 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:06.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7fa2e60c2640 1 -- 172.21.15.123:0/2322996867 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2e013eb20 msgr2=0x7fa2e00b5720 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T23:16:06.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7fa2e60c2640 1 --2- 172.21.15.123:0/2322996867 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2e013eb20 0x7fa2e00b5720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7fa2e60c2640 1 -- 172.21.15.123:0/2322996867 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2e00b2d40 msgr2=0x7fa2e00b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:06.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7fa2e60c2640 1 --2- 172.21.15.123:0/2322996867 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2e00b2d40 0x7fa2e00b51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7fa2e60c2640 1 -- 172.21.15.123:0/2322996867 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2e00b6400 con 0x7fa2e006c320 2024-09-15T23:16:06.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7fa2e58c1640 1 --2- 172.21.15.123:0/2322996867 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2e00b2d40 0x7fa2e00b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:16:06.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7ff9c6ff8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff9c006f150 0x7ff9c014d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:06.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7ff9c6ff8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9c00af0c0 0x7ff9c01f4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:06.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7f4b5f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b600b90e0 0x7f4b600cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:06.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7f4b5f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b600b90e0 0x7f4b600cc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46466/0 (socket says 172.21.15.123:46466) 2024-09-15T23:16:06.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7f4b5f7fe640 1 -- 172.21.15.123:0/867717645 learned_addr learned my addr 172.21.15.123:0/867717645 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:06.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7f4b5effd640 1 --2- 172.21.15.123:0/867717645 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b600d23b0 0x7f4b60154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:06.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7f4b5ffff640 1 --2- 172.21.15.123:0/867717645 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4b6015ed20 0x7f4b600ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:06.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7fc830c88640 1 -- 172.21.15.123:0/3676189010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc82c13eb20 msgr2=0x7fc82c154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:06.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7fc830c88640 1 --2- 172.21.15.123:0/3676189010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc82c13eb20 0x7fc82c154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7fc830c88640 1 -- 172.21.15.123:0/3676189010 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc82c06c150 msgr2=0x7fc82c15dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:06.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7fc830c88640 1 --2- 172.21.15.123:0/3676189010 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc82c06c150 0x7fc82c15dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.446+0000 7fc830c88640 1 -- 172.21.15.123:0/3676189010 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc82c15e220 con 0x7fc82c0b2d40 2024-09-15T23:16:06.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7fc831489640 1 --2- 172.21.15.123:0/3676189010 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc82c06c150 0x7fc82c15dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:16:06.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7fa2e60c2640 1 --2- 172.21.15.123:0/2322996867 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2e006c320 0x7fa2e0153390 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc00c430 tx=0x7fa2dc00c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:06.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7ff9c6ff8640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff9c0162980 0x7ff9c0157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:06.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7ff9c6ff8640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c00732d0 con 0x7ff9c00af0c0 2024-09-15T23:16:06.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7ff9c6ff8640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c00b0270 con 0x7ff9c006f150 2024-09-15T23:16:06.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7ff9c6ff8640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ff9c00aff00 con 0x7ff9c0162980 2024-09-15T23:16:06.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7fc830c88640 1 --2- 172.21.15.123:0/3676189010 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc82c0b2d40 0x7fc82c15e6e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc81c000f60 tx=0x7fc81c00c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:06.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7ff9bffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9c00af0c0 0x7ff9c01f4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:06.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7ff9c4d94640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff9c006f150 0x7ff9c014d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:06.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7ff9c4d94640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff9c006f150 0x7ff9c014d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:58226/0 (socket says 172.21.15.123:58226) 2024-09-15T23:16:06.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7ff9c4d94640 1 -- 172.21.15.123:0/2883159895 learned_addr learned my addr 172.21.15.123:0/2883159895 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:06.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7ff9bffff640 1 --2- 172.21.15.123:0/2883159895 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9c00af0c0 0x7ff9c01f4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46474/0 (socket says 172.21.15.123:46474) 2024-09-15T23:16:06.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7ff9c5595640 1 --2- 172.21.15.123:0/2883159895 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff9c0162980 0x7ff9c0157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:06.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7fc821ffb640 1 -- 172.21.15.123:0/3676189010 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81c017070 con 0x7fc82c0b2d40 2024-09-15T23:16:06.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7fc821ffb640 1 -- 172.21.15.123:0/3676189010 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc81c005ce0 con 0x7fc82c0b2d40 2024-09-15T23:16:06.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7fc821ffb640 1 -- 172.21.15.123:0/3676189010 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81c007310 con 0x7fc82c0b2d40 2024-09-15T23:16:06.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7fa2d6ffd640 1 -- 172.21.15.123:0/2322996867 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc017070 con 0x7fa2e006c320 2024-09-15T23:16:06.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7fa2d6ffd640 1 -- 172.21.15.123:0/2322996867 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2dc0052d0 con 0x7fa2e006c320 2024-09-15T23:16:06.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7fa2d6ffd640 1 -- 172.21.15.123:0/2322996867 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc003830 con 0x7fa2e006c320 2024-09-15T23:16:06.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7fa2e8326640 1 -- 172.21.15.123:0/2322996867 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2e00b5e40 con 0x7fa2e006c320 2024-09-15T23:16:06.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7fa2e8326640 1 -- 172.21.15.123:0/2322996867 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2e015b770 con 0x7fa2e006c320 2024-09-15T23:16:06.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7ff9c4d94640 1 -- 172.21.15.123:0/2883159895 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff9c0162980 msgr2=0x7ff9c0157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:06.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7ff9c4d94640 1 --2- 172.21.15.123:0/2883159895 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff9c0162980 0x7ff9c0157840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7ff9c4d94640 1 -- 172.21.15.123:0/2883159895 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9c00af0c0 msgr2=0x7ff9c01f4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:06.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7ff9c4d94640 1 --2- 172.21.15.123:0/2883159895 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9c00af0c0 0x7ff9c01f4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7ff9c4d94640 1 -- 172.21.15.123:0/2883159895 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c0153ae0 con 0x7ff9c006f150 2024-09-15T23:16:06.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7ff9bffff640 1 --2- 172.21.15.123:0/2883159895 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9c00af0c0 0x7ff9c01f4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:16:06.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7f4b5f7fe640 1 -- 172.21.15.123:0/867717645 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4b6015ed20 msgr2=0x7f4b600ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:06.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7f4b5f7fe640 1 --2- 172.21.15.123:0/867717645 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4b6015ed20 0x7f4b600ca480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7f4b5f7fe640 1 -- 172.21.15.123:0/867717645 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b600d23b0 msgr2=0x7f4b60154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:06.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7f4b5f7fe640 1 --2- 172.21.15.123:0/867717645 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b600d23b0 0x7f4b60154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7f4b5f7fe640 1 -- 172.21.15.123:0/867717645 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b600ca9c0 con 0x7f4b600b90e0 2024-09-15T23:16:06.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7f4b5f7fe640 1 --2- 172.21.15.123:0/867717645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b600b90e0 0x7f4b600cc2c0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f4b50009870 tx=0x7f4b500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:06.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7fc8336ed640 1 -- 172.21.15.123:0/3676189010 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc82c1f0740 con 0x7fc82c0b2d40 2024-09-15T23:16:06.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.447+0000 7fc8336ed640 1 -- 172.21.15.123:0/3676189010 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc82c1f0d00 con 0x7fc82c0b2d40 2024-09-15T23:16:06.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.448+0000 7ff9c4d94640 1 --2- 172.21.15.123:0/2883159895 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff9c006f150 0x7ff9c014d470 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff9b400c450 tx=0x7ff9b400c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:06.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.448+0000 7f4b47fff640 1 -- 172.21.15.123:0/867717645 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b50041020 con 0x7f4b600b90e0 2024-09-15T23:16:06.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.448+0000 7f4b47fff640 1 -- 172.21.15.123:0/867717645 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b50030970 con 0x7f4b600b90e0 2024-09-15T23:16:06.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.448+0000 7f4b660e6640 1 -- 172.21.15.123:0/867717645 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b600cc8a0 con 0x7f4b600b90e0 2024-09-15T23:16:06.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.448+0000 7f4b47fff640 1 -- 172.21.15.123:0/867717645 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b50037040 con 0x7f4b600b90e0 2024-09-15T23:16:06.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.448+0000 7ff9bd7fa640 1 -- 172.21.15.123:0/2883159895 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b40052d0 con 0x7ff9c006f150 2024-09-15T23:16:06.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.448+0000 7ff9bd7fa640 1 -- 172.21.15.123:0/2883159895 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9b4005470 con 0x7ff9c006f150 2024-09-15T23:16:06.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.448+0000 7f4b660e6640 1 -- 172.21.15.123:0/867717645 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b600cce60 con 0x7f4b600b90e0 2024-09-15T23:16:06.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.448+0000 7ff9bd7fa640 1 -- 172.21.15.123:0/2883159895 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4012870 con 0x7ff9c006f150 2024-09-15T23:16:06.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.448+0000 7ff9c6ff8640 1 -- 172.21.15.123:0/2883159895 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9c0153dc0 con 0x7ff9c006f150 2024-09-15T23:16:06.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.448+0000 7ff9c6ff8640 1 -- 172.21.15.123:0/2883159895 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9c0154380 con 0x7ff9c006f150 2024-09-15T23:16:06.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.449+0000 7fa2e8326640 1 -- 172.21.15.123:0/2322996867 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2e006bc10 con 0x7fa2e006c320 2024-09-15T23:16:06.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.449+0000 7fc8336ed640 1 -- 172.21.15.123:0/3676189010 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc82c0cefc0 con 0x7fc82c0b2d40 2024-09-15T23:16:06.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.449+0000 7ff9c6ff8640 1 -- 172.21.15.123:0/2883159895 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9c00aeea0 con 0x7ff9c006f150 2024-09-15T23:16:06.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.449+0000 7f4b660e6640 1 -- 172.21.15.123:0/867717645 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b60160280 con 0x7f4b600b90e0 2024-09-15T23:16:06.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.450+0000 7fc821ffb640 1 -- 172.21.15.123:0/3676189010 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc81c01a070 con 0x7fc82c0b2d40 2024-09-15T23:16:06.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.450+0000 7fa2d6ffd640 1 -- 172.21.15.123:0/2322996867 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa2dc01a070 con 0x7fa2e006c320 2024-09-15T23:16:06.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.450+0000 7f4b47fff640 1 -- 172.21.15.123:0/867717645 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4b50044020 con 0x7f4b600b90e0 2024-09-15T23:16:06.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.450+0000 7fc821ffb640 1 --2- 172.21.15.123:0/3676189010 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc81006c2b0 0x7fc81006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:06.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.450+0000 7fc821ffb640 1 -- 172.21.15.123:0/3676189010 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7fc81c08a670 con 0x7fc82c0b2d40 2024-09-15T23:16:06.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.450+0000 7fa2d6ffd640 1 --2- 172.21.15.123:0/2322996867 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa2c406c380 0x7fa2c406e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:06.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.450+0000 7f4b47fff640 1 --2- 172.21.15.123:0/867717645 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4b4c06c300 0x7f4b4c06e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:06.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.450+0000 7f4b47fff640 1 -- 172.21.15.123:0/867717645 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f4b500abc20 con 0x7f4b600b90e0 2024-09-15T23:16:06.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.450+0000 7fc831489640 1 --2- 172.21.15.123:0/3676189010 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc81006c2b0 0x7fc81006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:06.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.451+0000 7fa2d6ffd640 1 -- 172.21.15.123:0/2322996867 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7fa2dc08a780 con 0x7fa2e006c320 2024-09-15T23:16:06.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.451+0000 7f4b5effd640 1 --2- 172.21.15.123:0/867717645 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4b4c06c300 0x7f4b4c06e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:06.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.451+0000 7fa2e58c1640 1 --2- 172.21.15.123:0/2322996867 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa2c406c380 0x7fa2c406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:06.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.451+0000 7ff9bd7fa640 1 -- 172.21.15.123:0/2883159895 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff9b4012a10 con 0x7ff9c006f150 2024-09-15T23:16:06.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.451+0000 7fa2e58c1640 1 --2- 172.21.15.123:0/2322996867 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa2c406c380 0x7fa2c406e840 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa2e013b9b0 tx=0x7fa2d000f040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:06.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.451+0000 7fc831489640 1 --2- 172.21.15.123:0/3676189010 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc81006c2b0 0x7fc81006e770 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc828009560 tx=0x7fc82803d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:06.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.451+0000 7f4b5effd640 1 --2- 172.21.15.123:0/867717645 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4b4c06c300 0x7f4b4c06e7c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4b600d53b0 tx=0x7f4b54009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:06.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.451+0000 7ff9bd7fa640 1 --2- 172.21.15.123:0/2883159895 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff9a406c2b0 0x7ff9a406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:06.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.452+0000 7ff9bffff640 1 --2- 172.21.15.123:0/2883159895 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff9a406c2b0 0x7ff9a406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:06.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.452+0000 7ff9bd7fa640 1 -- 172.21.15.123:0/2883159895 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7ff9b408b150 con 0x7ff9c006f150 2024-09-15T23:16:06.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.452+0000 7ff9bffff640 1 --2- 172.21.15.123:0/2883159895 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff9a406c2b0 0x7ff9a406e770 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0158610 tx=0x7ff9ac009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:06.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.455+0000 7fa2d6ffd640 1 -- 172.21.15.123:0/2322996867 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa2dc058910 con 0x7fa2e006c320 2024-09-15T23:16:06.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.455+0000 7ff9bd7fa640 1 -- 172.21.15.123:0/2883159895 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff9b40592e0 con 0x7ff9c006f150 2024-09-15T23:16:06.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.455+0000 7f4b47fff640 1 -- 172.21.15.123:0/867717645 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4b5004b030 con 0x7f4b600b90e0 2024-09-15T23:16:06.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.459+0000 7fc821ffb640 1 -- 172.21.15.123:0/3676189010 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc82c0cefc0 con 0x7fc82c0b2d40 2024-09-15T23:16:06.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.694+0000 7ff9c6ff8640 1 -- 172.21.15.123:0/2883159895 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) -- 0x7ff9c006c270 con 0x7ff9c006f150 2024-09-15T23:16:06.696 INFO:tasks.ceph.mon.a.smithi123.stderr:2024-09-15T23:16:06.696+0000 7f8a6ccf0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:16:06.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.698+0000 7f4b660e6640 1 -- 172.21.15.123:0/867717645 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) -- 0x7f4b600b3f20 con 0x7f4b600b90e0 2024-09-15T23:16:06.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.701+0000 7fc8336ed640 1 -- 172.21.15.123:0/3676189010 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) -- 0x7fc82c06bc10 con 0x7fc82c0b2d40 2024-09-15T23:16:06.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.701+0000 7ff9bd7fa640 1 -- 172.21.15.123:0/2883159895 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 6678 v45) ==== 95+0+0 (secure 0 0 0) 0x7ff9b405d5e0 con 0x7ff9c006f150 2024-09-15T23:16:06.702 INFO:teuthology.orchestra.run.smithi123.stderr:failed mds gid 6678 2024-09-15T23:16:06.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.703+0000 7ff9c6ff8640 1 -- 172.21.15.123:0/2883159895 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff9a406c2b0 msgr2=0x7ff9a406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:06.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.703+0000 7ff9c6ff8640 1 --2- 172.21.15.123:0/2883159895 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff9a406c2b0 0x7ff9a406e770 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0158610 tx=0x7ff9ac009040 comp rx=0 tx=0).stop 2024-09-15T23:16:06.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.703+0000 7ff9c6ff8640 1 -- 172.21.15.123:0/2883159895 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff9c006f150 msgr2=0x7ff9c014d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:06.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.703+0000 7ff9c6ff8640 1 --2- 172.21.15.123:0/2883159895 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff9c006f150 0x7ff9c014d470 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff9b400c450 tx=0x7ff9b400c910 comp rx=0 tx=0).stop 2024-09-15T23:16:06.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.703+0000 7ff9c6ff8640 1 -- 172.21.15.123:0/2883159895 shutdown_connections 2024-09-15T23:16:06.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.703+0000 7ff9c6ff8640 1 --2- 172.21.15.123:0/2883159895 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff9c0162980 0x7ff9c0157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.703+0000 7ff9c6ff8640 1 --2- 172.21.15.123:0/2883159895 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff9a406c2b0 0x7ff9a406e770 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.703+0000 7ff9c6ff8640 1 --2- 172.21.15.123:0/2883159895 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9c00af0c0 0x7ff9c01f4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.703+0000 7ff9c6ff8640 1 --2- 172.21.15.123:0/2883159895 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff9c006f150 0x7ff9c014d470 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.703+0000 7ff9c6ff8640 1 -- 172.21.15.123:0/2883159895 >> 172.21.15.123:0/2883159895 conn(0x7ff9c00b30c0 msgr2=0x7ff9c006ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:06.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.703+0000 7ff9c6ff8640 1 -- 172.21.15.123:0/2883159895 shutdown_connections 2024-09-15T23:16:06.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.703+0000 7ff9c6ff8640 1 -- 172.21.15.123:0/2883159895 wait complete. 2024-09-15T23:16:06.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.704+0000 7fa2e8326640 1 -- 172.21.15.123:0/2322996867 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) -- 0x7fa2e006c9c0 con 0x7fa2e006c320 2024-09-15T23:16:06.706 INFO:tasks.ceph.mon.a.smithi123.stderr:2024-09-15T23:16:06.704+0000 7f8a6a4eb640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:16:06.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.708+0000 7f4b47fff640 1 -- 172.21.15.123:0/867717645 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 6675 v47) ==== 95+0+0 (secure 0 0 0) 0x7f4b50079e20 con 0x7f4b600b90e0 2024-09-15T23:16:06.709 INFO:teuthology.orchestra.run.smithi123.stderr:failed mds gid 6675 2024-09-15T23:16:06.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.712+0000 7f4b660e6640 1 -- 172.21.15.123:0/867717645 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4b4c06c300 msgr2=0x7f4b4c06e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:06.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.712+0000 7f4b660e6640 1 --2- 172.21.15.123:0/867717645 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4b4c06c300 0x7f4b4c06e7c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4b600d53b0 tx=0x7f4b54009040 comp rx=0 tx=0).stop 2024-09-15T23:16:06.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.712+0000 7f4b660e6640 1 -- 172.21.15.123:0/867717645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b600b90e0 msgr2=0x7f4b600cc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:06.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.712+0000 7f4b660e6640 1 --2- 172.21.15.123:0/867717645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b600b90e0 0x7f4b600cc2c0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f4b50009870 tx=0x7f4b500046c0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.712+0000 7f4b660e6640 1 -- 172.21.15.123:0/867717645 shutdown_connections 2024-09-15T23:16:06.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.712+0000 7f4b660e6640 1 --2- 172.21.15.123:0/867717645 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4b6015ed20 0x7f4b600ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.712+0000 7f4b660e6640 1 --2- 172.21.15.123:0/867717645 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b600d23b0 0x7f4b60154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.712+0000 7f4b660e6640 1 --2- 172.21.15.123:0/867717645 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4b4c06c300 0x7f4b4c06e7c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.712+0000 7f4b660e6640 1 --2- 172.21.15.123:0/867717645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b600b90e0 0x7f4b600cc2c0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.712+0000 7f4b660e6640 1 -- 172.21.15.123:0/867717645 >> 172.21.15.123:0/867717645 conn(0x7f4b600d1260 msgr2=0x7f4b600b5170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:06.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.712+0000 7f4b660e6640 1 -- 172.21.15.123:0/867717645 shutdown_connections 2024-09-15T23:16:06.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.712+0000 7f4b660e6640 1 -- 172.21.15.123:0/867717645 wait complete. 2024-09-15T23:16:06.717 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T23:16:06.718 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T23:16:06.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.718+0000 7fc821ffb640 1 -- 172.21.15.123:0/3676189010 <== mon.2 v2:172.21.15.188:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 5621 v48) ==== 95+0+0 (secure 0 0 0) 0x7fc81c058790 con 0x7fc82c0b2d40 2024-09-15T23:16:06.719 INFO:teuthology.orchestra.run.smithi123.stderr:failed mds gid 5621 2024-09-15T23:16:06.720 INFO:tasks.ceph.mds.a:Started 2024-09-15T23:16:06.721 DEBUG:teuthology.parallel:result is None 2024-09-15T23:16:06.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.721+0000 7fc8336ed640 1 -- 172.21.15.123:0/3676189010 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc81006c2b0 msgr2=0x7fc81006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:06.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.721+0000 7fc8336ed640 1 --2- 172.21.15.123:0/3676189010 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc81006c2b0 0x7fc81006e770 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc828009560 tx=0x7fc82803d040 comp rx=0 tx=0).stop 2024-09-15T23:16:06.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.721+0000 7fc8336ed640 1 -- 172.21.15.123:0/3676189010 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc82c0b2d40 msgr2=0x7fc82c15e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:06.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.721+0000 7fc8336ed640 1 --2- 172.21.15.123:0/3676189010 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc82c0b2d40 0x7fc82c15e6e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc81c000f60 tx=0x7fc81c00c760 comp rx=0 tx=0).stop 2024-09-15T23:16:06.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.721+0000 7fc8336ed640 1 -- 172.21.15.123:0/3676189010 shutdown_connections 2024-09-15T23:16:06.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.721+0000 7fc8336ed640 1 --2- 172.21.15.123:0/3676189010 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc82c13eb20 0x7fc82c154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.721+0000 7fc8336ed640 1 --2- 172.21.15.123:0/3676189010 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc82c0b2d40 0x7fc82c15e6e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.721+0000 7fc8336ed640 1 --2- 172.21.15.123:0/3676189010 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc81006c2b0 0x7fc81006e770 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.721+0000 7fc8336ed640 1 --2- 172.21.15.123:0/3676189010 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc82c06c150 0x7fc82c15dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:06.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.721+0000 7fc8336ed640 1 -- 172.21.15.123:0/3676189010 >> 172.21.15.123:0/3676189010 conn(0x7fc82c0ccec0 msgr2=0x7fc82c13db00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:06.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.721+0000 7fc8336ed640 1 -- 172.21.15.123:0/3676189010 shutdown_connections 2024-09-15T23:16:06.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:06.721+0000 7fc8336ed640 1 -- 172.21.15.123:0/3676189010 wait complete. 2024-09-15T23:16:06.727 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T23:16:06.727 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T23:16:06.734 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T23:16:06.734 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T23:16:06.737 INFO:tasks.ceph.mds.b:Started 2024-09-15T23:16:06.737 DEBUG:teuthology.parallel:result is None 2024-09-15T23:16:06.775 INFO:tasks.ceph.mds.c:Started 2024-09-15T23:16:06.776 DEBUG:teuthology.parallel:result is None 2024-09-15T23:16:06.794 INFO:tasks.ceph.mds.a.smithi123.stdout:starting mds.a at 2024-09-15T23:16:06.815 INFO:tasks.ceph.mds.b.smithi188.stdout:starting mds.b at 2024-09-15T23:16:06.848 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-15T23:16:07.004 INFO:tasks.ceph.mon.a.smithi123.stderr:2024-09-15T23:16:07.003+0000 7f8a6a4eb640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:16:07.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.007+0000 7fa2d6ffd640 1 -- 172.21.15.123:0/2322996867 <== mon.2 v2:172.21.15.188:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 5624 v49) ==== 95+0+0 (secure 0 0 0) 0x7fa2dc05cc10 con 0x7fa2e006c320 2024-09-15T23:16:07.008 INFO:teuthology.orchestra.run.smithi123.stderr:failed mds gid 5624 2024-09-15T23:16:07.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.011+0000 7fa2e8326640 1 -- 172.21.15.123:0/2322996867 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa2c406c380 msgr2=0x7fa2c406e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:07.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.011+0000 7fa2e8326640 1 --2- 172.21.15.123:0/2322996867 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa2c406c380 0x7fa2c406e840 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa2e013b9b0 tx=0x7fa2d000f040 comp rx=0 tx=0).stop 2024-09-15T23:16:07.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.012+0000 7fa2e8326640 1 -- 172.21.15.123:0/2322996867 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2e006c320 msgr2=0x7fa2e0153390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:07.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.012+0000 7fa2e8326640 1 --2- 172.21.15.123:0/2322996867 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2e006c320 0x7fa2e0153390 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc00c430 tx=0x7fa2dc00c8f0 comp rx=0 tx=0).stop 2024-09-15T23:16:07.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.012+0000 7fa2e8326640 1 -- 172.21.15.123:0/2322996867 shutdown_connections 2024-09-15T23:16:07.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.012+0000 7fa2e8326640 1 --2- 172.21.15.123:0/2322996867 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa2e013eb20 0x7fa2e00b5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:07.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.012+0000 7fa2e8326640 1 --2- 172.21.15.123:0/2322996867 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa2c406c380 0x7fa2c406e840 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:07.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.012+0000 7fa2e8326640 1 --2- 172.21.15.123:0/2322996867 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa2e00b2d40 0x7fa2e00b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:07.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.012+0000 7fa2e8326640 1 --2- 172.21.15.123:0/2322996867 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa2e006c320 0x7fa2e0153390 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:07.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.012+0000 7fa2e8326640 1 -- 172.21.15.123:0/2322996867 >> 172.21.15.123:0/2322996867 conn(0x7fa2e00ccec0 msgr2=0x7fa2e0072620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:07.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.012+0000 7fa2e8326640 1 -- 172.21.15.123:0/2322996867 shutdown_connections 2024-09-15T23:16:07.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.012+0000 7fa2e8326640 1 -- 172.21.15.123:0/2322996867 wait complete. 2024-09-15T23:16:07.027 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T23:16:07.027 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T23:16:07.029 INFO:tasks.ceph.mds.d:Started 2024-09-15T23:16:07.030 DEBUG:teuthology.parallel:result is None 2024-09-15T23:16:07.030 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:16:07.101 INFO:tasks.ceph.mds.d.smithi188.stdout:starting mds.d at 2024-09-15T23:16:07.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.165+0000 7f33d366e640 1 Processor -- start 2024-09-15T23:16:07.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.166+0000 7f33d366e640 1 -- start start 2024-09-15T23:16:07.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.166+0000 7f33d366e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33cc15ed20 0x7f33cc0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:07.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.166+0000 7f33d366e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33cc0d0e70 con 0x7f33cc0b90e0 2024-09-15T23:16:07.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.166+0000 7f33d366e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33cc0d00f0 con 0x7f33cc0d23b0 2024-09-15T23:16:07.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.166+0000 7f33d366e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f33cc0d41c0 con 0x7f33cc15ed20 2024-09-15T23:16:07.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.166+0000 7f33d1c0b640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f33cc0b90e0 0x7f33cc0cf9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40930/0 (socket says 172.21.15.123:40930) 2024-09-15T23:16:07.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.166+0000 7f33d1c0b640 1 -- 172.21.15.123:0/2908970553 learned_addr learned my addr 172.21.15.123:0/2908970553 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:07.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.167+0000 7f33cbfff640 1 -- 172.21.15.123:0/2908970553 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 78933681 0 0) 0x7f33c4001110 con 0x7f33cc0b90e0 2024-09-15T23:16:07.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.167+0000 7f33d140a640 1 --2- 172.21.15.123:0/2908970553 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33cc15ed20 0x7f33cc0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:07.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.167+0000 7f33cbfff640 1 -- 172.21.15.123:0/2908970553 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33b4003520 con 0x7f33cc0b90e0 2024-09-15T23:16:07.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.167+0000 7f33cbfff640 1 -- 172.21.15.123:0/2908970553 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2622849788 0 0) 0x7f33b4003520 con 0x7f33cc0b90e0 2024-09-15T23:16:07.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.167+0000 7f33cbfff640 1 -- 172.21.15.123:0/2908970553 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33cc15ed20 msgr2=0x7f33cc0b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:07.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.167+0000 7f33cbfff640 1 --2- 172.21.15.123:0/2908970553 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33cc15ed20 0x7f33cc0b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:07.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.167+0000 7f33cbfff640 1 -- 172.21.15.123:0/2908970553 >> v1:172.21.15.188:6789/0 conn(0x7f33cc0d23b0 legacy=0x7f33cc0cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:07.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.167+0000 7f33cbfff640 1 -- 172.21.15.123:0/2908970553 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33cc0d35b0 con 0x7f33cc0b90e0 2024-09-15T23:16:07.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.167+0000 7f33cbfff640 1 -- 172.21.15.123:0/2908970553 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f33c4001840 con 0x7f33cc0b90e0 2024-09-15T23:16:07.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.167+0000 7f33cbfff640 1 -- 172.21.15.123:0/2908970553 >> v1:172.21.15.123:6789/0 conn(0x7f33cc0b90e0 legacy=0x7f33cc0cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:07.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.167+0000 7f33cbfff640 1 --2- 172.21.15.123:0/2908970553 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33cc15ed20 0x7f33b40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:07.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.167+0000 7f33cbfff640 1 --2- 172.21.15.123:0/2908970553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33b4003f60 0x7f33b4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:07.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.167+0000 7f33cbfff640 1 --2- 172.21.15.123:0/2908970553 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33b4004d40 0x7f33b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:07.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.167+0000 7f33cbfff640 1 -- 172.21.15.123:0/2908970553 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f33cc0d41c0 con 0x7f33b4003f60 2024-09-15T23:16:07.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.167+0000 7f33cbfff640 1 -- 172.21.15.123:0/2908970553 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f33b400baa0 con 0x7f33b4004d40 2024-09-15T23:16:07.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.167+0000 7f33cbfff640 1 -- 172.21.15.123:0/2908970553 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f33b400bca0 con 0x7f33cc15ed20 2024-09-15T23:16:07.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.167+0000 7f33d0c09640 1 --2- 172.21.15.123:0/2908970553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33b4003f60 0x7f33b4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:07.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.167+0000 7f33d140a640 1 --2- 172.21.15.123:0/2908970553 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33cc15ed20 0x7f33b40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:07.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.167+0000 7f33d1c0b640 1 --2- 172.21.15.123:0/2908970553 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33b4004d40 0x7f33b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:07.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.167+0000 7f33d0c09640 1 -- 172.21.15.123:0/2908970553 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33cc15ed20 msgr2=0x7f33b40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:07.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.167+0000 7f33d0c09640 1 --2- 172.21.15.123:0/2908970553 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33cc15ed20 0x7f33b40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:07.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.167+0000 7f33d0c09640 1 -- 172.21.15.123:0/2908970553 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33b4004d40 msgr2=0x7f33b40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:07.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.167+0000 7f33d0c09640 1 --2- 172.21.15.123:0/2908970553 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33b4004d40 0x7f33b40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:07.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.167+0000 7f33d0c09640 1 -- 172.21.15.123:0/2908970553 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b4003520 con 0x7f33b4003f60 2024-09-15T23:16:07.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.168+0000 7f33d0c09640 1 --2- 172.21.15.123:0/2908970553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33b4003f60 0x7f33b4004800 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f33c0001720 tx=0x7f33b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fa238ca27f46c23 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:07.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.168+0000 7f33cbfff640 1 -- 172.21.15.123:0/2908970553 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c0001370 con 0x7f33b4003f60 2024-09-15T23:16:07.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.168+0000 7f33cbfff640 1 -- 172.21.15.123:0/2908970553 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33c00052d0 con 0x7f33b4003f60 2024-09-15T23:16:07.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.168+0000 7f33cbfff640 1 -- 172.21.15.123:0/2908970553 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c002abc0 con 0x7f33b4003f60 2024-09-15T23:16:07.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.169+0000 7f33d366e640 1 -- 172.21.15.123:0/2908970553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33b4003f60 msgr2=0x7f33b4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:07.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.169+0000 7f33d366e640 1 --2- 172.21.15.123:0/2908970553 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33b4003f60 0x7f33b4004800 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f33c0001720 tx=0x7f33b4005830 comp rx=0 tx=0).stop 2024-09-15T23:16:07.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.169+0000 7f33d1c0b640 1 -- 172.21.15.123:0/2908970553 reap_dead start 2024-09-15T23:16:07.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.169+0000 7f33d366e640 1 -- 172.21.15.123:0/2908970553 shutdown_connections 2024-09-15T23:16:07.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.169+0000 7f33d366e640 1 -- 172.21.15.123:0/2908970553 >> 172.21.15.123:0/2908970553 conn(0x7f33cc0d1260 msgr2=0x7f33cc0d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:07.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.169+0000 7f33d366e640 1 -- 172.21.15.123:0/2908970553 shutdown_connections 2024-09-15T23:16:07.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.169+0000 7f33d366e640 1 -- 172.21.15.123:0/2908970553 wait complete. 2024-09-15T23:16:07.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.170+0000 7f33d366e640 1 Processor -- start 2024-09-15T23:16:07.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.170+0000 7f33d366e640 1 -- start start 2024-09-15T23:16:07.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.171+0000 7f33d366e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33b4003f60 0x7f33cc1526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:07.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.171+0000 7f33d366e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33cc157750 0x7f33cc1f8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:07.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.171+0000 7f33d366e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33cc1f89a0 0x7f33cc1f8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:07.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.171+0000 7f33d366e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f33cc0d3e50 con 0x7f33cc157750 2024-09-15T23:16:07.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.171+0000 7f33d366e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f33cc0d3b70 con 0x7f33b4003f60 2024-09-15T23:16:07.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.171+0000 7f33d366e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f33cc0d32a0 con 0x7f33cc1f89a0 2024-09-15T23:16:07.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.171+0000 7f33d0c09640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33cc157750 0x7f33cc1f8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:07.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.171+0000 7f33d0c09640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33cc157750 0x7f33cc1f8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46526/0 (socket says 172.21.15.123:46526) 2024-09-15T23:16:07.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.171+0000 7f33d0c09640 1 -- 172.21.15.123:0/1334337136 learned_addr learned my addr 172.21.15.123:0/1334337136 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:07.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.171+0000 7f33d140a640 1 --2- 172.21.15.123:0/1334337136 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33b4003f60 0x7f33cc1526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:07.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.171+0000 7f33d1c0b640 1 --2- 172.21.15.123:0/1334337136 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33cc1f89a0 0x7f33cc1f8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:07.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.171+0000 7f33d0c09640 1 -- 172.21.15.123:0/1334337136 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33cc1f89a0 msgr2=0x7f33cc1f8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:07.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.171+0000 7f33d0c09640 1 --2- 172.21.15.123:0/1334337136 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33cc1f89a0 0x7f33cc1f8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:07.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.171+0000 7f33d0c09640 1 -- 172.21.15.123:0/1334337136 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33b4003f60 msgr2=0x7f33cc1526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:07.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.171+0000 7f33d0c09640 1 --2- 172.21.15.123:0/1334337136 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33b4003f60 0x7f33cc1526f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:07.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.171+0000 7f33d0c09640 1 -- 172.21.15.123:0/1334337136 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33cc158560 con 0x7f33cc157750 2024-09-15T23:16:07.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.171+0000 7f33d0c09640 1 --2- 172.21.15.123:0/1334337136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33cc157750 0x7f33cc1f8460 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f33c0008fd0 tx=0x7f33c0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:07.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.172+0000 7f33c9ffb640 1 -- 172.21.15.123:0/1334337136 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c0037040 con 0x7f33cc157750 2024-09-15T23:16:07.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.172+0000 7f33c9ffb640 1 -- 172.21.15.123:0/1334337136 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33c0005480 con 0x7f33cc157750 2024-09-15T23:16:07.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.172+0000 7f33c9ffb640 1 -- 172.21.15.123:0/1334337136 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c0007a30 con 0x7f33cc157750 2024-09-15T23:16:07.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.172+0000 7f33d366e640 1 -- 172.21.15.123:0/1334337136 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33cc157cc0 con 0x7f33cc157750 2024-09-15T23:16:07.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.172+0000 7f33d366e640 1 -- 172.21.15.123:0/1334337136 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33cc158280 con 0x7f33cc157750 2024-09-15T23:16:07.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.173+0000 7f33d366e640 1 -- 172.21.15.123:0/1334337136 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33cc15f100 con 0x7f33cc157750 2024-09-15T23:16:07.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.173+0000 7f33c9ffb640 1 -- 172.21.15.123:0/1334337136 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f33c0044020 con 0x7f33cc157750 2024-09-15T23:16:07.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.174+0000 7f33c9ffb640 1 --2- 172.21.15.123:0/1334337136 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f33b806c2e0 0x7f33b806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:07.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.174+0000 7f33c9ffb640 1 -- 172.21.15.123:0/1334337136 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5967+0+0 (secure 0 0 0) 0x7f33c00ab020 con 0x7f33cc157750 2024-09-15T23:16:07.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.174+0000 7f33d140a640 1 --2- 172.21.15.123:0/1334337136 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f33b806c2e0 0x7f33b806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:07.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.174+0000 7f33d140a640 1 --2- 172.21.15.123:0/1334337136 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f33b806c2e0 0x7f33b806e7a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f33bc014510 tx=0x7f33bc00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:07.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.178+0000 7f33c9ffb640 1 -- 172.21.15.123:0/1334337136 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f33c0079690 con 0x7f33cc157750 2024-09-15T23:16:07.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.375+0000 7f33d366e640 1 -- 172.21.15.123:0/1334337136 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33cc153260 con 0x7f33cc157750 2024-09-15T23:16:07.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.376+0000 7f33c9ffb640 1 -- 172.21.15.123:0/1334337136 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+4403 (secure 0 0 0) 0x7f33c0078f90 con 0x7f33cc157750 2024-09-15T23:16:07.377 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:16:07.377 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":50,"btime":"2024-09-15T23:16:07:010706+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/2007918144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2007918144},{"type":"v1","addr":"172.21.15.188:6835","nonce":2007918144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":6918,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/1092174152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":1092174152},{"type":"v1","addr":"172.21.15.123:6833","nonce":1092174152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:15:54.225983+0000","modified":"2024-09-15T23:16:07.010693+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6930":{"gid":6930,"name":"c","rank":0,"incarnation":50,"state":"up:replay","state_seq":1,"addr":"172.21.15.123:6835/3648891779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3648891779},{"type":"v1","addr":"172.21.15.123:6835","nonce":3648891779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-09-15T23:16:07.377 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 50 2024-09-15T23:16:07.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.378+0000 7f33d366e640 1 -- 172.21.15.123:0/1334337136 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f33b806c2e0 msgr2=0x7f33b806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:07.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.378+0000 7f33d366e640 1 --2- 172.21.15.123:0/1334337136 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f33b806c2e0 0x7f33b806e7a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f33bc014510 tx=0x7f33bc00b040 comp rx=0 tx=0).stop 2024-09-15T23:16:07.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.378+0000 7f33d366e640 1 -- 172.21.15.123:0/1334337136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33cc157750 msgr2=0x7f33cc1f8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:07.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.378+0000 7f33d366e640 1 --2- 172.21.15.123:0/1334337136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33cc157750 0x7f33cc1f8460 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f33c0008fd0 tx=0x7f33c0001120 comp rx=0 tx=0).stop 2024-09-15T23:16:07.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.378+0000 7f33d366e640 1 -- 172.21.15.123:0/1334337136 shutdown_connections 2024-09-15T23:16:07.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.378+0000 7f33d366e640 1 --2- 172.21.15.123:0/1334337136 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33cc1f89a0 0x7f33cc1f8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:07.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.378+0000 7f33d366e640 1 --2- 172.21.15.123:0/1334337136 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f33b806c2e0 0x7f33b806e7a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:07.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.378+0000 7f33d366e640 1 --2- 172.21.15.123:0/1334337136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33cc157750 0x7f33cc1f8460 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:07.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.378+0000 7f33d366e640 1 --2- 172.21.15.123:0/1334337136 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33b4003f60 0x7f33cc1526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:07.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.378+0000 7f33d366e640 1 -- 172.21.15.123:0/1334337136 >> 172.21.15.123:0/1334337136 conn(0x7f33cc0d1260 msgr2=0x7f33cc15da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:07.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.378+0000 7f33d366e640 1 -- 172.21.15.123:0/1334337136 shutdown_connections 2024-09-15T23:16:07.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:07.378+0000 7f33d366e640 1 -- 172.21.15.123:0/1334337136 wait complete. 2024-09-15T23:16:07.792 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 50, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:15:54.225983+0000', 'modified': '2024-09-15T23:16:07.010693+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 86, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6930}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6930': {'gid': 6930, 'name': 'c', 'rank': 0, 'incarnation': 50, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.123:6835/3648891779', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6834', 'nonce': 3648891779}, {'type': 'v1', 'addr': '172.21.15.123:6835', 'nonce': 3648891779}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-15T23:16:07.792 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6930:up:replay 2024-09-15T23:16:08.397 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:16:08.400 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:16:08.793 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:16:08.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.902+0000 7f1b2de8d640 1 Processor -- start 2024-09-15T23:16:08.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.902+0000 7f1b2de8d640 1 -- start start 2024-09-15T23:16:08.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.903+0000 7f1b2de8d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b28145ed0 0x7f1b280b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:08.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.903+0000 7f1b2de8d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b280b4020 con 0x7f1b28073180 2024-09-15T23:16:08.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.903+0000 7f1b2de8d640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b280b42c0 con 0x7f1b280b5f90 2024-09-15T23:16:08.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.903+0000 7f1b2de8d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1b280b45a0 con 0x7f1b28145ed0 2024-09-15T23:16:08.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.903+0000 7f1b26ffd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1b28073180 0x7f1b280b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40934/0 (socket says 172.21.15.123:40934) 2024-09-15T23:16:08.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.903+0000 7f1b26ffd640 1 -- 172.21.15.123:0/3959760726 learned_addr learned my addr 172.21.15.123:0/3959760726 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:08.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.903+0000 7f1b277fe640 1 --2- 172.21.15.123:0/3959760726 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b28145ed0 0x7f1b280b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:08.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.903+0000 7f1b267fc640 1 -- 172.21.15.123:0/3959760726 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2608581628 0 0) 0x7f1b280b4020 con 0x7f1b28073180 2024-09-15T23:16:08.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.903+0000 7f1b267fc640 1 -- 172.21.15.123:0/3959760726 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b10003520 con 0x7f1b28073180 2024-09-15T23:16:08.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.903+0000 7f1b267fc640 1 -- 172.21.15.123:0/3959760726 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2707880896 0 0) 0x7f1b280b42c0 con 0x7f1b280b5f90 2024-09-15T23:16:08.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.903+0000 7f1b267fc640 1 -- 172.21.15.123:0/3959760726 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b280b4020 con 0x7f1b280b5f90 2024-09-15T23:16:08.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.903+0000 7f1b267fc640 1 -- 172.21.15.123:0/3959760726 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1946851085 0 0) 0x7f1b10003520 con 0x7f1b28073180 2024-09-15T23:16:08.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.903+0000 7f1b267fc640 1 -- 172.21.15.123:0/3959760726 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b28145ed0 msgr2=0x7f1b280b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:08.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.903+0000 7f1b267fc640 1 --2- 172.21.15.123:0/3959760726 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b28145ed0 0x7f1b280b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:08.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.903+0000 7f1b267fc640 1 -- 172.21.15.123:0/3959760726 >> v1:172.21.15.188:6789/0 conn(0x7f1b280b5f90 legacy=0x7f1b2815cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:08.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.903+0000 7f1b267fc640 1 -- 172.21.15.123:0/3959760726 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b280b4880 con 0x7f1b28073180 2024-09-15T23:16:08.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.903+0000 7f1b267fc640 1 -- 172.21.15.123:0/3959760726 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f1b1c001670 con 0x7f1b28073180 2024-09-15T23:16:08.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.903+0000 7f1b267fc640 1 -- 172.21.15.123:0/3959760726 >> v1:172.21.15.123:6789/0 conn(0x7f1b28073180 legacy=0x7f1b280b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:08.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.903+0000 7f1b267fc640 1 --2- 172.21.15.123:0/3959760726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b10003b70 0x7f1b10003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:08.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.903+0000 7f1b267fc640 1 --2- 172.21.15.123:0/3959760726 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b28145ed0 0x7f1b10004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:08.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.903+0000 7f1b267fc640 1 --2- 172.21.15.123:0/3959760726 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b10004d40 0x7f1b100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:08.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.903+0000 7f1b267fc640 1 -- 172.21.15.123:0/3959760726 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1b280b45a0 con 0x7f1b10003b70 2024-09-15T23:16:08.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.903+0000 7f1b267fc640 1 -- 172.21.15.123:0/3959760726 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1000ba70 con 0x7f1b10004d40 2024-09-15T23:16:08.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.903+0000 7f1b267fc640 1 -- 172.21.15.123:0/3959760726 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1b1000bc70 con 0x7f1b28145ed0 2024-09-15T23:16:08.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.904+0000 7f1b277fe640 1 --2- 172.21.15.123:0/3959760726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b10003b70 0x7f1b10003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:08.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.904+0000 7f1b27fff640 1 --2- 172.21.15.123:0/3959760726 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b10004d40 0x7f1b100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:08.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.904+0000 7f1b26ffd640 1 --2- 172.21.15.123:0/3959760726 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b28145ed0 0x7f1b10004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:08.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.904+0000 7f1b277fe640 1 -- 172.21.15.123:0/3959760726 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b28145ed0 msgr2=0x7f1b10004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:08.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.904+0000 7f1b277fe640 1 --2- 172.21.15.123:0/3959760726 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b28145ed0 0x7f1b10004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:08.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.904+0000 7f1b277fe640 1 -- 172.21.15.123:0/3959760726 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b10004d40 msgr2=0x7f1b100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:08.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.904+0000 7f1b277fe640 1 --2- 172.21.15.123:0/3959760726 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b10004d40 0x7f1b100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:08.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.904+0000 7f1b277fe640 1 -- 172.21.15.123:0/3959760726 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b10003520 con 0x7f1b10003b70 2024-09-15T23:16:08.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.905+0000 7f1b277fe640 1 --2- 172.21.15.123:0/3959760726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b10003b70 0x7f1b10003f70 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f1b18009ac0 tx=0x7f1b10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3304c02cadb709fe server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:08.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.905+0000 7f1b267fc640 1 -- 172.21.15.123:0/3959760726 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b18036070 con 0x7f1b10003b70 2024-09-15T23:16:08.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.905+0000 7f1b267fc640 1 -- 172.21.15.123:0/3959760726 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b18031400 con 0x7f1b10003b70 2024-09-15T23:16:08.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.905+0000 7f1b267fc640 1 -- 172.21.15.123:0/3959760726 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b18009690 con 0x7f1b10003b70 2024-09-15T23:16:08.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.905+0000 7f1b2de8d640 1 -- 172.21.15.123:0/3959760726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b10003b70 msgr2=0x7f1b10003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:08.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.905+0000 7f1b2de8d640 1 --2- 172.21.15.123:0/3959760726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b10003b70 0x7f1b10003f70 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f1b18009ac0 tx=0x7f1b10005830 comp rx=0 tx=0).stop 2024-09-15T23:16:08.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.905+0000 7f1b27fff640 1 -- 172.21.15.123:0/3959760726 reap_dead start 2024-09-15T23:16:08.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.905+0000 7f1b2de8d640 1 -- 172.21.15.123:0/3959760726 shutdown_connections 2024-09-15T23:16:08.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.905+0000 7f1b2de8d640 1 -- 172.21.15.123:0/3959760726 >> 172.21.15.123:0/3959760726 conn(0x7f1b280ccec0 msgr2=0x7f1b280cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:08.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.905+0000 7f1b2de8d640 1 -- 172.21.15.123:0/3959760726 shutdown_connections 2024-09-15T23:16:08.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.905+0000 7f1b2de8d640 1 -- 172.21.15.123:0/3959760726 wait complete. 2024-09-15T23:16:08.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.906+0000 7f1b2de8d640 1 Processor -- start 2024-09-15T23:16:08.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.907+0000 7f1b2de8d640 1 -- start start 2024-09-15T23:16:08.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.907+0000 7f1b2de8d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b10003b70 0x7f1b280cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:08.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.907+0000 7f1b2de8d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b2815c160 0x7f1b2813f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:08.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.907+0000 7f1b2de8d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b2813f8c0 0x7f1b280c66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:08.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.907+0000 7f1b2de8d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1b28146430 con 0x7f1b2813f8c0 2024-09-15T23:16:08.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.907+0000 7f1b2de8d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1b281462b0 con 0x7f1b2815c160 2024-09-15T23:16:08.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.907+0000 7f1b2de8d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1b280b5080 con 0x7f1b10003b70 2024-09-15T23:16:08.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.908+0000 7f1b27fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b2813f8c0 0x7f1b280c66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:08.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.908+0000 7f1b27fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b2813f8c0 0x7f1b280c66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46540/0 (socket says 172.21.15.123:46540) 2024-09-15T23:16:08.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.908+0000 7f1b27fff640 1 -- 172.21.15.123:0/1922494862 learned_addr learned my addr 172.21.15.123:0/1922494862 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:08.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.908+0000 7f1b277fe640 1 --2- 172.21.15.123:0/1922494862 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b10003b70 0x7f1b280cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:08.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.908+0000 7f1b27fff640 1 -- 172.21.15.123:0/1922494862 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b10003b70 msgr2=0x7f1b280cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:08.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.908+0000 7f1b26ffd640 1 --2- 172.21.15.123:0/1922494862 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b2815c160 0x7f1b2813f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:08.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.908+0000 7f1b27fff640 1 --2- 172.21.15.123:0/1922494862 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b10003b70 0x7f1b280cb1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:08.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.908+0000 7f1b27fff640 1 -- 172.21.15.123:0/1922494862 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b2815c160 msgr2=0x7f1b2813f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:08.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.908+0000 7f1b27fff640 1 --2- 172.21.15.123:0/1922494862 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b2815c160 0x7f1b2813f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:08.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.908+0000 7f1b27fff640 1 -- 172.21.15.123:0/1922494862 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b2815c5e0 con 0x7f1b2813f8c0 2024-09-15T23:16:08.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.908+0000 7f1b27fff640 1 --2- 172.21.15.123:0/1922494862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b2813f8c0 0x7f1b280c66a0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f1b280b6730 tx=0x7f1b2000ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:08.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.908+0000 7f1b0ffff640 1 -- 172.21.15.123:0/1922494862 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b20019070 con 0x7f1b2813f8c0 2024-09-15T23:16:08.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.908+0000 7f1b0ffff640 1 -- 172.21.15.123:0/1922494862 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b20006e20 con 0x7f1b2813f8c0 2024-09-15T23:16:08.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.908+0000 7f1b2de8d640 1 -- 172.21.15.123:0/1922494862 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b280c7410 con 0x7f1b2813f8c0 2024-09-15T23:16:08.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.908+0000 7f1b0ffff640 1 -- 172.21.15.123:0/1922494862 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b20003b70 con 0x7f1b2813f8c0 2024-09-15T23:16:08.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.908+0000 7f1b2de8d640 1 -- 172.21.15.123:0/1922494862 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b280ca6c0 con 0x7f1b2813f8c0 2024-09-15T23:16:08.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.909+0000 7f1b2de8d640 1 -- 172.21.15.123:0/1922494862 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b280735c0 con 0x7f1b2813f8c0 2024-09-15T23:16:08.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.910+0000 7f1b0ffff640 1 -- 172.21.15.123:0/1922494862 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1b2001c070 con 0x7f1b2813f8c0 2024-09-15T23:16:08.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.910+0000 7f1b0ffff640 1 --2- 172.21.15.123:0/1922494862 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1b1406c2b0 0x7f1b1406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:08.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.910+0000 7f1b0ffff640 1 -- 172.21.15.123:0/1922494862 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5967+0+0 (secure 0 0 0) 0x7f1b2008aa80 con 0x7f1b2813f8c0 2024-09-15T23:16:08.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.911+0000 7f1b277fe640 1 --2- 172.21.15.123:0/1922494862 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1b1406c2b0 0x7f1b1406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:08.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.911+0000 7f1b277fe640 1 --2- 172.21.15.123:0/1922494862 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1b1406c2b0 0x7f1b1406e770 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1b18033000 tx=0x7f1b18008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:08.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:08.915+0000 7f1b0ffff640 1 -- 172.21.15.123:0/1922494862 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1b200590f0 con 0x7f1b2813f8c0 2024-09-15T23:16:09.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:09.119+0000 7f1b2de8d640 1 -- 172.21.15.123:0/1922494862 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1b28076150 con 0x7f1b2813f8c0 2024-09-15T23:16:09.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:09.119+0000 7f1b0ffff640 1 -- 172.21.15.123:0/1922494862 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5231 (secure 0 0 0) 0x7f1b200589f0 con 0x7f1b2813f8c0 2024-09-15T23:16:09.121 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:16:09.121 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":52,"btime":"2024-09-15T23:16:09:017274+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/2007918144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2007918144},{"type":"v1","addr":"172.21.15.188:6835","nonce":2007918144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":6199,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2540326254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":2540326254},{"type":"v1","addr":"172.21.15.188:6837","nonce":2540326254}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6918,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/1092174152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":1092174152},{"type":"v1","addr":"172.21.15.123:6833","nonce":1092174152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:15:54.225983+0000","modified":"2024-09-15T23:16:08.018923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6930":{"gid":6930,"name":"c","rank":0,"incarnation":50,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.123:6835/3648891779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3648891779},{"type":"v1","addr":"172.21.15.123:6835","nonce":3648891779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":5}]} 2024-09-15T23:16:09.121 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 52 2024-09-15T23:16:09.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:09.121+0000 7f1b2de8d640 1 -- 172.21.15.123:0/1922494862 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1b1406c2b0 msgr2=0x7f1b1406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:09.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:09.121+0000 7f1b2de8d640 1 --2- 172.21.15.123:0/1922494862 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1b1406c2b0 0x7f1b1406e770 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1b18033000 tx=0x7f1b18008030 comp rx=0 tx=0).stop 2024-09-15T23:16:09.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:09.121+0000 7f1b2de8d640 1 -- 172.21.15.123:0/1922494862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b2813f8c0 msgr2=0x7f1b280c66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:09.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:09.121+0000 7f1b2de8d640 1 --2- 172.21.15.123:0/1922494862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b2813f8c0 0x7f1b280c66a0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f1b280b6730 tx=0x7f1b2000ff70 comp rx=0 tx=0).stop 2024-09-15T23:16:09.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:09.121+0000 7f1b2de8d640 1 -- 172.21.15.123:0/1922494862 shutdown_connections 2024-09-15T23:16:09.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:09.121+0000 7f1b2de8d640 1 --2- 172.21.15.123:0/1922494862 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1b1406c2b0 0x7f1b1406e770 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:09.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:09.121+0000 7f1b2de8d640 1 --2- 172.21.15.123:0/1922494862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b2813f8c0 0x7f1b280c66a0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:09.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:09.121+0000 7f1b2de8d640 1 --2- 172.21.15.123:0/1922494862 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b2815c160 0x7f1b2813f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:09.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:09.121+0000 7f1b2de8d640 1 --2- 172.21.15.123:0/1922494862 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b10003b70 0x7f1b280cb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:09.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:09.121+0000 7f1b2de8d640 1 -- 172.21.15.123:0/1922494862 >> 172.21.15.123:0/1922494862 conn(0x7f1b280ccec0 msgr2=0x7f1b280cdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:09.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:09.121+0000 7f1b2de8d640 1 -- 172.21.15.123:0/1922494862 shutdown_connections 2024-09-15T23:16:09.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:09.121+0000 7f1b2de8d640 1 -- 172.21.15.123:0/1922494862 wait complete. 2024-09-15T23:16:09.536 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 52, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:15:54.225983+0000', 'modified': '2024-09-15T23:16:08.018923+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 86, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6930}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6930': {'gid': 6930, 'name': 'c', 'rank': 0, 'incarnation': 50, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.123:6835/3648891779', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6834', 'nonce': 3648891779}, {'type': 'v1', 'addr': '172.21.15.123:6835', 'nonce': 3648891779}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-15T23:16:09.537 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6930:up:rejoin 2024-09-15T23:16:10.537 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:16:10.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.644+0000 7fa4b647b640 1 Processor -- start 2024-09-15T23:16:10.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.644+0000 7fa4b647b640 1 -- start start 2024-09-15T23:16:10.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.645+0000 7fa4b647b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa4b00b2d40 0x7fa4b006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:10.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.645+0000 7fa4b647b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4b013eb20 0x7fa4b006c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:10.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.645+0000 7fa4b647b640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4b0071180 con 0x7fa4b015bcf0 2024-09-15T23:16:10.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.645+0000 7fa4b647b640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fa4b0071ab0 con 0x7fa4b00b2d40 2024-09-15T23:16:10.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.645+0000 7fa4b647b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa4b0071460 con 0x7fa4b013eb20 2024-09-15T23:16:10.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.645+0000 7fa4affff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa4b00b2d40 0x7fa4b006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:10.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.645+0000 7fa4affff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa4b00b2d40 0x7fa4b006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46554/0 (socket says 172.21.15.123:46554) 2024-09-15T23:16:10.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.645+0000 7fa4affff640 1 -- 172.21.15.123:0/899372508 learned_addr learned my addr 172.21.15.123:0/899372508 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:10.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.645+0000 7fa4af7fe640 1 --2- 172.21.15.123:0/899372508 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4b013eb20 0x7fa4b006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:10.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.645+0000 7fa4affff640 1 -- 172.21.15.123:0/899372508 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4b013eb20 msgr2=0x7fa4b006c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:10.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.645+0000 7fa4affff640 1 --2- 172.21.15.123:0/899372508 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4b013eb20 0x7fa4b006c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:10.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.645+0000 7fa4affff640 1 -- 172.21.15.123:0/899372508 >> v1:172.21.15.188:6789/0 conn(0x7fa4b015bcf0 legacy=0x7fa4b015c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:10.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.645+0000 7fa4affff640 1 -- 172.21.15.123:0/899372508 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b0071740 con 0x7fa4b00b2d40 2024-09-15T23:16:10.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.645+0000 7fa4af7fe640 1 --2- 172.21.15.123:0/899372508 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4b013eb20 0x7fa4b006c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:16:10.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.646+0000 7fa4affff640 1 --2- 172.21.15.123:0/899372508 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b00b2d40 0x7fa4b006bc10 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0071c30 tx=0x7fa4a002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d7a214bc45f32e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:10.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.646+0000 7fa4aeffd640 1 -- 172.21.15.123:0/899372508 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a0037070 con 0x7fa4b00b2d40 2024-09-15T23:16:10.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.646+0000 7fa4aeffd640 1 -- 172.21.15.123:0/899372508 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4a0032440 con 0x7fa4b00b2d40 2024-09-15T23:16:10.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.646+0000 7fa4aeffd640 1 -- 172.21.15.123:0/899372508 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a0032810 con 0x7fa4b00b2d40 2024-09-15T23:16:10.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.647+0000 7fa4b647b640 1 -- 172.21.15.123:0/899372508 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b00b2d40 msgr2=0x7fa4b006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:10.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.647+0000 7fa4b647b640 1 --2- 172.21.15.123:0/899372508 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b00b2d40 0x7fa4b006bc10 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fa4b0071c30 tx=0x7fa4a002a250 comp rx=0 tx=0).stop 2024-09-15T23:16:10.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.647+0000 7fa4b647b640 1 -- 172.21.15.123:0/899372508 shutdown_connections 2024-09-15T23:16:10.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.647+0000 7fa4b647b640 1 --2- 172.21.15.123:0/899372508 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4b013eb20 0x7fa4b006c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:10.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.647+0000 7fa4b647b640 1 --2- 172.21.15.123:0/899372508 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b00b2d40 0x7fa4b006bc10 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:10.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.647+0000 7fa4b647b640 1 -- 172.21.15.123:0/899372508 >> 172.21.15.123:0/899372508 conn(0x7fa4b00ccec0 msgr2=0x7fa4b00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:10.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.647+0000 7fa4b647b640 1 -- 172.21.15.123:0/899372508 shutdown_connections 2024-09-15T23:16:10.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.647+0000 7fa4b647b640 1 -- 172.21.15.123:0/899372508 wait complete. 2024-09-15T23:16:10.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.648+0000 7fa4b647b640 1 Processor -- start 2024-09-15T23:16:10.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.648+0000 7fa4b647b640 1 -- start start 2024-09-15T23:16:10.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.649+0000 7fa4b647b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4b00b2d40 0x7fa4b015faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:10.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.649+0000 7fa4b647b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4b013eb20 0x7fa4b01f13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:10.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.649+0000 7fa4b647b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b015bcf0 0x7fa4b00c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:10.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.649+0000 7fa4b647b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b00722d0 con 0x7fa4b015bcf0 2024-09-15T23:16:10.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.649+0000 7fa4b647b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b0072150 con 0x7fa4b00b2d40 2024-09-15T23:16:10.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.649+0000 7fa4b647b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa4b0072450 con 0x7fa4b013eb20 2024-09-15T23:16:10.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.649+0000 7fa4b4a18640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b015bcf0 0x7fa4b00c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:10.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.649+0000 7fa4b4a18640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b015bcf0 0x7fa4b00c53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46570/0 (socket says 172.21.15.123:46570) 2024-09-15T23:16:10.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.649+0000 7fa4b4a18640 1 -- 172.21.15.123:0/219517046 learned_addr learned my addr 172.21.15.123:0/219517046 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:10.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.649+0000 7fa4affff640 1 --2- 172.21.15.123:0/219517046 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4b00b2d40 0x7fa4b015faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:10.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.649+0000 7fa4af7fe640 1 --2- 172.21.15.123:0/219517046 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4b013eb20 0x7fa4b01f13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:10.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.650+0000 7fa4b4a18640 1 -- 172.21.15.123:0/219517046 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4b013eb20 msgr2=0x7fa4b01f13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:10.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.650+0000 7fa4b4a18640 1 --2- 172.21.15.123:0/219517046 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4b013eb20 0x7fa4b01f13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:10.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.650+0000 7fa4b4a18640 1 -- 172.21.15.123:0/219517046 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4b00b2d40 msgr2=0x7fa4b015faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:10.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.650+0000 7fa4b4a18640 1 --2- 172.21.15.123:0/219517046 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4b00b2d40 0x7fa4b015faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:10.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.650+0000 7fa4b4a18640 1 -- 172.21.15.123:0/219517046 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b01f1920 con 0x7fa4b015bcf0 2024-09-15T23:16:10.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.650+0000 7fa4b4a18640 1 --2- 172.21.15.123:0/219517046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b015bcf0 0x7fa4b00c53e0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fa4a800c760 tx=0x7fa4a800cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:10.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.650+0000 7fa4acff9640 1 -- 172.21.15.123:0/219517046 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a8016020 con 0x7fa4b015bcf0 2024-09-15T23:16:10.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.650+0000 7fa4acff9640 1 -- 172.21.15.123:0/219517046 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4a8006d50 con 0x7fa4b015bcf0 2024-09-15T23:16:10.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.650+0000 7fa4acff9640 1 -- 172.21.15.123:0/219517046 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a8003bb0 con 0x7fa4b015bcf0 2024-09-15T23:16:10.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.650+0000 7fa4b647b640 1 -- 172.21.15.123:0/219517046 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4b015db60 con 0x7fa4b015bcf0 2024-09-15T23:16:10.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.650+0000 7fa4b647b640 1 -- 172.21.15.123:0/219517046 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4b015e120 con 0x7fa4b015bcf0 2024-09-15T23:16:10.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.651+0000 7fa4b647b640 1 -- 172.21.15.123:0/219517046 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4b00728e0 con 0x7fa4b015bcf0 2024-09-15T23:16:10.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.651+0000 7fa4acff9640 1 -- 172.21.15.123:0/219517046 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa4a80050d0 con 0x7fa4b015bcf0 2024-09-15T23:16:10.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.652+0000 7fa4acff9640 1 --2- 172.21.15.123:0/219517046 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa49c06c2b0 0x7fa49c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:10.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.652+0000 7fa4acff9640 1 -- 172.21.15.123:0/219517046 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5967+0+0 (secure 0 0 0) 0x7fa4a808aee0 con 0x7fa4b015bcf0 2024-09-15T23:16:10.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.652+0000 7fa4affff640 1 --2- 172.21.15.123:0/219517046 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa49c06c2b0 0x7fa49c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:10.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.653+0000 7fa4affff640 1 --2- 172.21.15.123:0/219517046 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa49c06c2b0 0x7fa49c06e770 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0034000 tx=0x7fa4a002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:10.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.656+0000 7fa4acff9640 1 -- 172.21.15.123:0/219517046 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa4a8020020 con 0x7fa4b015bcf0 2024-09-15T23:16:10.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.857+0000 7fa4b647b640 1 -- 172.21.15.123:0/219517046 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4b00cc800 con 0x7fa4b015bcf0 2024-09-15T23:16:10.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.857+0000 7fa4acff9640 1 -- 172.21.15.123:0/219517046 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5238 (secure 0 0 0) 0x7fa4a8058f90 con 0x7fa4b015bcf0 2024-09-15T23:16:10.858 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:16:10.859 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":53,"btime":"2024-09-15T23:16:10:023819+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/2007918144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2007918144},{"type":"v1","addr":"172.21.15.188:6835","nonce":2007918144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":6199,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2540326254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":2540326254},{"type":"v1","addr":"172.21.15.188:6837","nonce":2540326254}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6918,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/1092174152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":1092174152},{"type":"v1","addr":"172.21.15.123:6833","nonce":1092174152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:15:54.225983+0000","modified":"2024-09-15T23:16:10.023816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6930":{"gid":6930,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6835/3648891779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3648891779},{"type":"v1","addr":"172.21.15.123:6835","nonce":3648891779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6930,"qdb_cluster":[6930]},"id":5}]} 2024-09-15T23:16:10.859 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 53 2024-09-15T23:16:10.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.859+0000 7fa4b647b640 1 -- 172.21.15.123:0/219517046 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa49c06c2b0 msgr2=0x7fa49c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:10.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.859+0000 7fa4b647b640 1 --2- 172.21.15.123:0/219517046 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa49c06c2b0 0x7fa49c06e770 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0034000 tx=0x7fa4a002e000 comp rx=0 tx=0).stop 2024-09-15T23:16:10.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.859+0000 7fa4b647b640 1 -- 172.21.15.123:0/219517046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b015bcf0 msgr2=0x7fa4b00c53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:10.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.859+0000 7fa4b647b640 1 --2- 172.21.15.123:0/219517046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b015bcf0 0x7fa4b00c53e0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fa4a800c760 tx=0x7fa4a800cb60 comp rx=0 tx=0).stop 2024-09-15T23:16:10.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.859+0000 7fa4b647b640 1 -- 172.21.15.123:0/219517046 shutdown_connections 2024-09-15T23:16:10.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.859+0000 7fa4b647b640 1 --2- 172.21.15.123:0/219517046 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa49c06c2b0 0x7fa49c06e770 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:10.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.859+0000 7fa4b647b640 1 --2- 172.21.15.123:0/219517046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4b015bcf0 0x7fa4b00c53e0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:10.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.859+0000 7fa4b647b640 1 --2- 172.21.15.123:0/219517046 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4b013eb20 0x7fa4b01f13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:10.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.859+0000 7fa4b647b640 1 --2- 172.21.15.123:0/219517046 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4b00b2d40 0x7fa4b015faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:10.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.859+0000 7fa4b647b640 1 -- 172.21.15.123:0/219517046 >> 172.21.15.123:0/219517046 conn(0x7fa4b00ccec0 msgr2=0x7fa4b0159d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:10.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.859+0000 7fa4b647b640 1 -- 172.21.15.123:0/219517046 shutdown_connections 2024-09-15T23:16:10.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:10.859+0000 7fa4b647b640 1 -- 172.21.15.123:0/219517046 wait complete. 2024-09-15T23:16:11.274 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 53, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:15:54.225983+0000', 'modified': '2024-09-15T23:16:10.023816+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 86, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6930}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6930': {'gid': 6930, 'name': 'c', 'rank': 0, 'incarnation': 50, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.123:6835/3648891779', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6834', 'nonce': 3648891779}, {'type': 'v1', 'addr': '172.21.15.123:6835', 'nonce': 3648891779}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6930, 'qdb_cluster': [6930]} 2024-09-15T23:16:11.274 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:16:11.274 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-15T23:16:11.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.376+0000 7f1981fd8640 1 Processor -- start 2024-09-15T23:16:11.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.376+0000 7f1981fd8640 1 -- start start 2024-09-15T23:16:11.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.377+0000 7f1981fd8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f197c073890 0x7f197c0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:11.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.377+0000 7f1981fd8640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f197c0b4020 con 0x7f197c0b5880 2024-09-15T23:16:11.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.377+0000 7f1981fd8640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f197c0b42c0 con 0x7f197c145ed0 2024-09-15T23:16:11.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.377+0000 7f1981fd8640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f197c0b63f0 con 0x7f197c073890 2024-09-15T23:16:11.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.377+0000 7f197bfff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f197c0b5880 0x7f197c0b5ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40936/0 (socket says 172.21.15.123:40936) 2024-09-15T23:16:11.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.377+0000 7f197bfff640 1 -- 172.21.15.123:0/1625688517 learned_addr learned my addr 172.21.15.123:0/1625688517 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:11.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.378+0000 7f197a7fc640 1 -- 172.21.15.123:0/1625688517 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 566725010 0 0) 0x7f197c0b4020 con 0x7f197c0b5880 2024-09-15T23:16:11.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.378+0000 7f197a7fc640 1 -- 172.21.15.123:0/1625688517 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1964003520 con 0x7f197c0b5880 2024-09-15T23:16:11.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.378+0000 7f197affd640 1 --2- 172.21.15.123:0/1625688517 >> v2:172.21.15.188:3300/0 conn(0x7f197c073890 0x7f197c0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:11.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.378+0000 7f197a7fc640 1 -- 172.21.15.123:0/1625688517 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2222634750 0 0) 0x7f1964003520 con 0x7f197c0b5880 2024-09-15T23:16:11.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.378+0000 7f197a7fc640 1 -- 172.21.15.123:0/1625688517 >> v2:172.21.15.188:3300/0 conn(0x7f197c073890 msgr2=0x7f197c0b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:11.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.378+0000 7f197a7fc640 1 --2- 172.21.15.123:0/1625688517 >> v2:172.21.15.188:3300/0 conn(0x7f197c073890 0x7f197c0b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.378+0000 7f197a7fc640 1 -- 172.21.15.123:0/1625688517 >> v1:172.21.15.188:6789/0 conn(0x7f197c145ed0 legacy=0x7f197c073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:11.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.378+0000 7f197a7fc640 1 -- 172.21.15.123:0/1625688517 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f197c0b45a0 con 0x7f197c0b5880 2024-09-15T23:16:11.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.378+0000 7f197a7fc640 1 -- 172.21.15.123:0/1625688517 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f1974001a10 con 0x7f197c0b5880 2024-09-15T23:16:11.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.378+0000 7f197a7fc640 1 -- 172.21.15.123:0/1625688517 >> v1:172.21.15.123:6789/0 conn(0x7f197c0b5880 legacy=0x7f197c0b5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:11.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.378+0000 7f197a7fc640 1 --2- 172.21.15.123:0/1625688517 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19640039b0 0x7f1964003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:11.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.378+0000 7f197a7fc640 1 --2- 172.21.15.123:0/1625688517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1964004800 0x7f1964004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:11.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.378+0000 7f197a7fc640 1 --2- 172.21.15.123:0/1625688517 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19640051c0 0x7f196400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:11.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.378+0000 7f197a7fc640 1 -- 172.21.15.123:0/1625688517 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f196400c030 con 0x7f1964004800 2024-09-15T23:16:11.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.378+0000 7f197a7fc640 1 -- 172.21.15.123:0/1625688517 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f196400c1e0 con 0x7f19640039b0 2024-09-15T23:16:11.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.378+0000 7f197a7fc640 1 -- 172.21.15.123:0/1625688517 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f196400c3e0 con 0x7f19640051c0 2024-09-15T23:16:11.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.378+0000 7f197affd640 1 --2- 172.21.15.123:0/1625688517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1964004800 0x7f1964004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:11.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.378+0000 7f197b7fe640 1 --2- 172.21.15.123:0/1625688517 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19640039b0 0x7f1964003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:11.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.378+0000 7f197bfff640 1 --2- 172.21.15.123:0/1625688517 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19640051c0 0x7f196400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:11.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.378+0000 7f197affd640 1 -- 172.21.15.123:0/1625688517 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19640051c0 msgr2=0x7f196400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:11.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.378+0000 7f197affd640 1 --2- 172.21.15.123:0/1625688517 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19640051c0 0x7f196400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.378+0000 7f197affd640 1 -- 172.21.15.123:0/1625688517 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19640039b0 msgr2=0x7f1964003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:11.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.378+0000 7f197affd640 1 --2- 172.21.15.123:0/1625688517 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19640039b0 0x7f1964003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.378+0000 7f197affd640 1 -- 172.21.15.123:0/1625688517 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1964003520 con 0x7f1964004800 2024-09-15T23:16:11.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.378+0000 7f197bfff640 1 -- 172.21.15.123:0/1625688517 reap_dead start 2024-09-15T23:16:11.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.379+0000 7f197affd640 1 --2- 172.21.15.123:0/1625688517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1964004800 0x7f1964004c80 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f1970009ac0 tx=0x7f1964005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cdd76188b740206 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:11.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.379+0000 7f197a7fc640 1 -- 172.21.15.123:0/1625688517 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1970036070 con 0x7f1964004800 2024-09-15T23:16:11.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.379+0000 7f197a7fc640 1 -- 172.21.15.123:0/1625688517 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1970031400 con 0x7f1964004800 2024-09-15T23:16:11.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.379+0000 7f197a7fc640 1 -- 172.21.15.123:0/1625688517 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1970009690 con 0x7f1964004800 2024-09-15T23:16:11.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.380+0000 7f1981fd8640 1 -- 172.21.15.123:0/1625688517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1964004800 msgr2=0x7f1964004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:11.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.380+0000 7f1981fd8640 1 --2- 172.21.15.123:0/1625688517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1964004800 0x7f1964004c80 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f1970009ac0 tx=0x7f1964005830 comp rx=0 tx=0).stop 2024-09-15T23:16:11.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.380+0000 7f1981fd8640 1 -- 172.21.15.123:0/1625688517 shutdown_connections 2024-09-15T23:16:11.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.380+0000 7f1981fd8640 1 --2- 172.21.15.123:0/1625688517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1964004800 0x7f1964004c80 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.380+0000 7f1981fd8640 1 -- 172.21.15.123:0/1625688517 >> 172.21.15.123:0/1625688517 conn(0x7f197c0ccec0 msgr2=0x7f197c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:11.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.380+0000 7f1981fd8640 1 -- 172.21.15.123:0/1625688517 shutdown_connections 2024-09-15T23:16:11.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.380+0000 7f1981fd8640 1 -- 172.21.15.123:0/1625688517 wait complete. 2024-09-15T23:16:11.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.381+0000 7f1981fd8640 1 Processor -- start 2024-09-15T23:16:11.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.381+0000 7f1981fd8640 1 -- start start 2024-09-15T23:16:11.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.382+0000 7f1981fd8640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1964004800 0x7f197c158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:11.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.382+0000 7f1981fd8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f197c142420 0x7f197c135dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:11.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.382+0000 7f1981fd8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f197c13d9d0 0x7f197c13de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:11.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.382+0000 7f1981fd8640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f197c1462b0 con 0x7f197c13d9d0 2024-09-15T23:16:11.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.382+0000 7f1981fd8640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f197c0b4b60 con 0x7f197c142420 2024-09-15T23:16:11.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.382+0000 7f1981fd8640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f197c146430 con 0x7f1964004800 2024-09-15T23:16:11.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.382+0000 7f197bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f197c13d9d0 0x7f197c13de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:11.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.382+0000 7f197bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f197c13d9d0 0x7f197c13de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46588/0 (socket says 172.21.15.123:46588) 2024-09-15T23:16:11.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.382+0000 7f197bfff640 1 -- 172.21.15.123:0/2502548835 learned_addr learned my addr 172.21.15.123:0/2502548835 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:11.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.382+0000 7f197affd640 1 --2- 172.21.15.123:0/2502548835 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f197c142420 0x7f197c135dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:11.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.382+0000 7f197b7fe640 1 --2- 172.21.15.123:0/2502548835 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1964004800 0x7f197c158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:11.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.382+0000 7f197bfff640 1 -- 172.21.15.123:0/2502548835 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1964004800 msgr2=0x7f197c158b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:11.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.382+0000 7f197bfff640 1 --2- 172.21.15.123:0/2502548835 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1964004800 0x7f197c158b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.382+0000 7f197bfff640 1 -- 172.21.15.123:0/2502548835 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f197c142420 msgr2=0x7f197c135dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:11.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.382+0000 7f197bfff640 1 --2- 172.21.15.123:0/2502548835 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f197c142420 0x7f197c135dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.382+0000 7f197bfff640 1 -- 172.21.15.123:0/2502548835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f197c1f3c40 con 0x7f197c13d9d0 2024-09-15T23:16:11.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.382+0000 7f197affd640 1 --2- 172.21.15.123:0/2502548835 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f197c142420 0x7f197c135dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:16:11.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.382+0000 7f197bfff640 1 --2- 172.21.15.123:0/2502548835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f197c13d9d0 0x7f197c13de50 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f197c073dd0 tx=0x7f1974007b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:11.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.382+0000 7f1963fff640 1 -- 172.21.15.123:0/2502548835 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f197400abc0 con 0x7f197c13d9d0 2024-09-15T23:16:11.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.382+0000 7f1963fff640 1 -- 172.21.15.123:0/2502548835 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1974018070 con 0x7f197c13d9d0 2024-09-15T23:16:11.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.382+0000 7f1981fd8640 1 -- 172.21.15.123:0/2502548835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f197c1f3f20 con 0x7f197c13d9d0 2024-09-15T23:16:11.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.383+0000 7f1963fff640 1 -- 172.21.15.123:0/2502548835 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19740133f0 con 0x7f197c13d9d0 2024-09-15T23:16:11.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.383+0000 7f1981fd8640 1 -- 172.21.15.123:0/2502548835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f197c136310 con 0x7f197c13d9d0 2024-09-15T23:16:11.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.385+0000 7f1963fff640 1 -- 172.21.15.123:0/2502548835 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1974013590 con 0x7f197c13d9d0 2024-09-15T23:16:11.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.385+0000 7f1963fff640 1 --2- 172.21.15.123:0/2502548835 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f196806c2e0 0x7f196806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:11.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.385+0000 7f1963fff640 1 -- 172.21.15.123:0/2502548835 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5967+0+0 (secure 0 0 0) 0x7f197408bba0 con 0x7f197c13d9d0 2024-09-15T23:16:11.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.385+0000 7f197b7fe640 1 --2- 172.21.15.123:0/2502548835 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f196806c2e0 0x7f196806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:11.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.385+0000 7f1984e4d740 1 Processor -- start 2024-09-15T23:16:11.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.386+0000 7f1984e4d740 1 -- start start 2024-09-15T23:16:11.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.386+0000 7f197b7fe640 1 --2- 172.21.15.123:0/2502548835 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f196806c2e0 0x7f196806e7a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f196c000c00 tx=0x7f196c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:11.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.386+0000 7f1984e4d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bfd051120 0x563bfd051500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:11.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.386+0000 7f1984e4d740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563bfd06bae0 0x563bfd06d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:11.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.386+0000 7f1984e4d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bfd024a80 0x563bfd06d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:11.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.386+0000 7f1984e4d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x563bfcf89520 con 0x563bfd051120 2024-09-15T23:16:11.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.386+0000 7f1984e4d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x563bfcf313e0 con 0x563bfd024a80 2024-09-15T23:16:11.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.386+0000 7f1984e4d740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x563bfcf854e0 con 0x563bfd06bae0 2024-09-15T23:16:11.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.386+0000 7f197b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bfd051120 0x563bfd051500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:11.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.387+0000 7f197b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bfd051120 0x563bfd051500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46596/0 (socket says 172.21.15.123:46596) 2024-09-15T23:16:11.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.387+0000 7f197b7fe640 1 -- 172.21.15.123:0/558069493 learned_addr learned my addr 172.21.15.123:0/558069493 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:11.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.387+0000 7f197b7fe640 1 -- 172.21.15.123:0/558069493 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563bfd06bae0 msgr2=0x563bfd06d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:11.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.387+0000 7f197b7fe640 1 --2- 172.21.15.123:0/558069493 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563bfd06bae0 0x563bfd06d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.387+0000 7f197b7fe640 1 -- 172.21.15.123:0/558069493 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bfd024a80 msgr2=0x563bfd06d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:11.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.387+0000 7f197bfff640 1 --2- 172.21.15.123:0/558069493 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bfd024a80 0x563bfd06d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:11.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.387+0000 7f197b7fe640 1 --2- 172.21.15.123:0/558069493 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bfd024a80 0x563bfd06d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.387+0000 7f197b7fe640 1 -- 172.21.15.123:0/558069493 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bfcf4c2f0 con 0x563bfd051120 2024-09-15T23:16:11.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.387+0000 7f197b7fe640 1 --2- 172.21.15.123:0/558069493 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bfd051120 0x563bfd051500 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f196c0017d0 tx=0x7f196c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af5d25c2db427470 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:11.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.387+0000 7f19617fa640 1 -- 172.21.15.123:0/558069493 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196c028070 con 0x563bfd051120 2024-09-15T23:16:11.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.387+0000 7f19617fa640 1 -- 172.21.15.123:0/558069493 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f196c0159f0 con 0x563bfd051120 2024-09-15T23:16:11.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.387+0000 7f19617fa640 1 -- 172.21.15.123:0/558069493 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196c015da0 con 0x563bfd051120 2024-09-15T23:16:11.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.388+0000 7f1984e4d740 1 -- 172.21.15.123:0/558069493 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bfd051120 msgr2=0x563bfd051500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:11.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.388+0000 7f1984e4d740 1 --2- 172.21.15.123:0/558069493 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bfd051120 0x563bfd051500 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f196c0017d0 tx=0x7f196c014000 comp rx=0 tx=0).stop 2024-09-15T23:16:11.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.388+0000 7f1984e4d740 1 -- 172.21.15.123:0/558069493 shutdown_connections 2024-09-15T23:16:11.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.388+0000 7f1984e4d740 1 --2- 172.21.15.123:0/558069493 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bfd024a80 0x563bfd06d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.388+0000 7f1984e4d740 1 --2- 172.21.15.123:0/558069493 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563bfd06bae0 0x563bfd06d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.388+0000 7f1984e4d740 1 --2- 172.21.15.123:0/558069493 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bfd051120 0x563bfd051500 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.388+0000 7f1984e4d740 1 -- 172.21.15.123:0/558069493 >> 172.21.15.123:0/558069493 conn(0x563bfd023a80 msgr2=0x563bfd06bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:11.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.388+0000 7f1984e4d740 1 -- 172.21.15.123:0/558069493 shutdown_connections 2024-09-15T23:16:11.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.388+0000 7f1984e4d740 1 -- 172.21.15.123:0/558069493 wait complete. 2024-09-15T23:16:11.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.388+0000 7f1984e4d740 1 -- start start 2024-09-15T23:16:11.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.388+0000 7f1984e4d740 1 Processor -- start 2024-09-15T23:16:11.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.389+0000 7f1984e4d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bfd051120 0x563bfd04b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:11.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.389+0000 7f1984e4d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bfd06bae0 0x563bfd052e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:11.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.389+0000 7f1984e4d740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563bfd054f20 0x563bfd0533b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:11.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.389+0000 7f1984e4d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x563bfd051ee0 con 0x563bfd051120 2024-09-15T23:16:11.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.389+0000 7f1984e4d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x563bfcf12450 con 0x563bfd06bae0 2024-09-15T23:16:11.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.389+0000 7f1984e4d740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x563bfd06c770 con 0x563bfd054f20 2024-09-15T23:16:11.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.389+0000 7f1984e4d740 10 client.0 _ll_register_callbacks cb 0x563bfcc9bac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:16:11.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.389+0000 7f197b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bfd051120 0x563bfd04b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:11.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.389+0000 7f197b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bfd051120 0x563bfd04b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46608/0 (socket says 172.21.15.123:46608) 2024-09-15T23:16:11.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.389+0000 7f197b7fe640 1 -- 172.21.15.123:0/1570678146 learned_addr learned my addr 172.21.15.123:0/1570678146 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:11.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.389+0000 7f197b7fe640 1 -- 172.21.15.123:0/1570678146 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563bfd054f20 msgr2=0x563bfd0533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:11.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.389+0000 7f197b7fe640 1 --2- 172.21.15.123:0/1570678146 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563bfd054f20 0x563bfd0533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.389+0000 7f197b7fe640 1 -- 172.21.15.123:0/1570678146 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bfd06bae0 msgr2=0x563bfd052e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:11.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.389+0000 7f197b7fe640 1 --2- 172.21.15.123:0/1570678146 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bfd06bae0 0x563bfd052e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.389+0000 7f197b7fe640 1 -- 172.21.15.123:0/1570678146 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bfcc9c2d0 con 0x563bfd051120 2024-09-15T23:16:11.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.390+0000 7f197b7fe640 1 --2- 172.21.15.123:0/1570678146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bfd051120 0x563bfd04b360 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x563bfd04eab0 tx=0x7f196c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6000bdd3215b82b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:11.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.390+0000 7f195a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:16:11.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.390+0000 7f195a7fc640 1 -- 172.21.15.123:0/1570678146 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196c028040 con 0x563bfd051120 2024-09-15T23:16:11.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.390+0000 7f195a7fc640 1 -- 172.21.15.123:0/1570678146 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 5967+0+0 (secure 0 0 0) 0x7f196c024870 con 0x563bfd051120 2024-09-15T23:16:11.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.390+0000 7f1984e4d740 1 -- 172.21.15.123:0/1570678146 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f196c0159f0 con 0x563bfd051120 2024-09-15T23:16:11.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.390+0000 7f195a7fc640 1 -- 172.21.15.123:0/1570678146 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f196c03a050 con 0x563bfd051120 2024-09-15T23:16:11.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.390+0000 7f1984e4d740 10 client.6966 fetch_fsmap learned FSMap version 53 2024-09-15T23:16:11.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.390+0000 7f1984e4d740 1 -- 172.21.15.123:0/1570678146 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x563bfcd666b0 con 0x563bfd051120 2024-09-15T23:16:11.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.390+0000 7f195a7fc640 1 -- 172.21.15.123:0/1570678146 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f196c0159f0 con 0x563bfd051120 2024-09-15T23:16:11.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.390+0000 7f195a7fc640 1 -- 172.21.15.123:0/1570678146 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 53) ==== 3502+0+0 (secure 0 0 0) 0x7f196c03d020 con 0x563bfd051120 2024-09-15T23:16:11.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.390+0000 7f1984e4d740 10 client.6966 fetch_fsmap finished waiting for FSMap version 53 2024-09-15T23:16:11.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.390+0000 7f1984e4d740 10 client.6966 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T23:16:11.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.390+0000 7f1984e4d740 20 client.6966 populate_metadata read hostname 'smithi123' 2024-09-15T23:16:11.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.390+0000 7f1984e4d740 1 --2- 172.21.15.123:0/1570678146 >> [v2:172.21.15.123:6834/3648891779,v1:172.21.15.123:6835/3648891779] conn(0x563bfd06d990 0x563bfd021920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:11.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.390+0000 7f1984e4d740 4 client.6966 mds_command: new command op to 6930 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:16:11.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.390+0000 7f1984e4d740 1 -- 172.21.15.123:0/1570678146 --> [v2:172.21.15.123:6834/3648891779,v1:172.21.15.123:6835/3648891779] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563bfcf96c50 con 0x563bfd06d990 2024-09-15T23:16:11.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.390+0000 7f197affd640 1 --2- 172.21.15.123:0/1570678146 >> [v2:172.21.15.123:6834/3648891779,v1:172.21.15.123:6835/3648891779] conn(0x563bfd06d990 0x563bfd021920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:11.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.391+0000 7f197affd640 1 --2- 172.21.15.123:0/1570678146 >> [v2:172.21.15.123:6834/3648891779,v1:172.21.15.123:6835/3648891779] conn(0x563bfd06d990 0x563bfd021920 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5e8eca8267117ef server_cookie=9fedee607bc4b8fc in_seq=0 out_seq=0 2024-09-15T23:16:11.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.391+0000 7f195a7fc640 10 client.6966 ms_handle_connect on v2:172.21.15.123:6834/3648891779 2024-09-15T23:16:11.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.391+0000 7f195a7fc640 1 -- 172.21.15.123:0/1570678146 <== mds.0 v2:172.21.15.123:6834/3648891779 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563bfcf96c50 con 0x563bfd06d990 2024-09-15T23:16:11.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.391+0000 7f195a7fc640 10 client.6966 handle_command_reply: tid=0 2024-09-15T23:16:11.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.391+0000 7f1984e4d740 1 client.6966 shutdown 2024-09-15T23:16:11.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.391+0000 7f1984e4d740 1 -- 172.21.15.123:0/1570678146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bfd051120 msgr2=0x563bfd04b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:11.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.391+0000 7f1984e4d740 1 --2- 172.21.15.123:0/1570678146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bfd051120 0x563bfd04b360 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x563bfd04eab0 tx=0x7f196c001120 comp rx=0 tx=0).stop 2024-09-15T23:16:11.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.391+0000 7f1984e4d740 1 -- 172.21.15.123:0/1570678146 shutdown_connections 2024-09-15T23:16:11.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.391+0000 7f1984e4d740 1 --2- 172.21.15.123:0/1570678146 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563bfd054f20 0x563bfd0533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.391+0000 7f1984e4d740 1 --2- 172.21.15.123:0/1570678146 >> [v2:172.21.15.123:6834/3648891779,v1:172.21.15.123:6835/3648891779] conn(0x563bfd06d990 0x563bfd021920 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.391+0000 7f1984e4d740 1 --2- 172.21.15.123:0/1570678146 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bfd06bae0 0x563bfd052e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.391+0000 7f1984e4d740 1 --2- 172.21.15.123:0/1570678146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bfd051120 0x563bfd04b360 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.391+0000 7f195a7fc640 0 client.6966 ms_handle_reset on v2:172.21.15.123:6834/3648891779 2024-09-15T23:16:11.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.391+0000 7f1984e4d740 1 -- 172.21.15.123:0/1570678146 >> 172.21.15.123:0/1570678146 conn(0x563bfd024a80 msgr2=0x563bfd0207d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:11.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.392+0000 7f1984e4d740 1 -- 172.21.15.123:0/1570678146 shutdown_connections 2024-09-15T23:16:11.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.392+0000 7f1984e4d740 1 -- 172.21.15.123:0/1570678146 wait complete. 2024-09-15T23:16:11.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.392+0000 7f1984e4d740 20 client.6966 trim_cache size 0 max 16384 2024-09-15T23:16:11.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.409+0000 7f1984e4d740 1 Processor -- start 2024-09-15T23:16:11.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.409+0000 7f1984e4d740 1 -- start start 2024-09-15T23:16:11.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.410+0000 7f1984e4d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bfd051120 0x563bfd06c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:11.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.410+0000 7f1984e4d740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563bfd054f20 0x563bfd0272e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:11.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.410+0000 7f1984e4d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bfd06bae0 0x563bfd027820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:11.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.410+0000 7f1984e4d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f197c072a40 con 0x563bfd06bae0 2024-09-15T23:16:11.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.410+0000 7f1984e4d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f197c1f2c20 con 0x563bfd051120 2024-09-15T23:16:11.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.410+0000 7f1984e4d740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f197c0723f0 con 0x563bfd054f20 2024-09-15T23:16:11.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.410+0000 7f197bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bfd06bae0 0x563bfd027820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:11.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.410+0000 7f197bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bfd06bae0 0x563bfd027820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46618/0 (socket says 172.21.15.123:46618) 2024-09-15T23:16:11.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.410+0000 7f197bfff640 1 -- 172.21.15.123:0/3902884289 learned_addr learned my addr 172.21.15.123:0/3902884289 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:11.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.410+0000 7f197bfff640 1 -- 172.21.15.123:0/3902884289 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563bfd054f20 msgr2=0x563bfd0272e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:11.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.410+0000 7f197b7fe640 1 --2- 172.21.15.123:0/3902884289 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bfd051120 0x563bfd06c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:11.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.410+0000 7f197affd640 1 --2- 172.21.15.123:0/3902884289 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563bfd054f20 0x563bfd0272e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:11.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.410+0000 7f197bfff640 1 --2- 172.21.15.123:0/3902884289 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563bfd054f20 0x563bfd0272e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.410+0000 7f197bfff640 1 -- 172.21.15.123:0/3902884289 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bfd051120 msgr2=0x563bfd06c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:11.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.410+0000 7f197bfff640 1 --2- 172.21.15.123:0/3902884289 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bfd051120 0x563bfd06c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.410+0000 7f197bfff640 1 -- 172.21.15.123:0/3902884289 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bfd06e1e0 con 0x563bfd06bae0 2024-09-15T23:16:11.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.411+0000 7f197b7fe640 1 --2- 172.21.15.123:0/3902884289 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bfd051120 0x563bfd06c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:16:11.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.411+0000 7f197bfff640 1 --2- 172.21.15.123:0/3902884289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bfd06bae0 0x563bfd027820 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f1974089f40 tx=0x7f19740593e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffca202d5ee86e2a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:11.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.411+0000 7f1960ff9640 1 -- 172.21.15.123:0/3902884289 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f197405de30 con 0x563bfd06bae0 2024-09-15T23:16:11.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.411+0000 7f1960ff9640 1 -- 172.21.15.123:0/3902884289 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19740626f0 con 0x563bfd06bae0 2024-09-15T23:16:11.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.411+0000 7f1960ff9640 1 -- 172.21.15.123:0/3902884289 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19740560f0 con 0x563bfd06bae0 2024-09-15T23:16:11.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.411+0000 7f1984e4d740 1 -- 172.21.15.123:0/3902884289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bfd06bae0 msgr2=0x563bfd027820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:11.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.411+0000 7f1984e4d740 1 --2- 172.21.15.123:0/3902884289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bfd06bae0 0x563bfd027820 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f1974089f40 tx=0x7f19740593e0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.411+0000 7f1984e4d740 1 -- 172.21.15.123:0/3902884289 shutdown_connections 2024-09-15T23:16:11.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.411+0000 7f1984e4d740 1 --2- 172.21.15.123:0/3902884289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bfd06bae0 0x563bfd027820 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.411+0000 7f1984e4d740 1 --2- 172.21.15.123:0/3902884289 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563bfd054f20 0x563bfd0272e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.411+0000 7f1984e4d740 1 --2- 172.21.15.123:0/3902884289 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bfd051120 0x563bfd06c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.411+0000 7f1984e4d740 1 -- 172.21.15.123:0/3902884289 >> 172.21.15.123:0/3902884289 conn(0x563bfd024a80 msgr2=0x563bfd04dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:11.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.411+0000 7f1984e4d740 1 -- 172.21.15.123:0/3902884289 shutdown_connections 2024-09-15T23:16:11.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.412+0000 7f1984e4d740 1 -- 172.21.15.123:0/3902884289 wait complete. 2024-09-15T23:16:11.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.412+0000 7f1984e4d740 1 -- start start 2024-09-15T23:16:11.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.412+0000 7f1984e4d740 1 Processor -- start 2024-09-15T23:16:11.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.413+0000 7f1984e4d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bfd051120 0x563bfd0f0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:11.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.413+0000 7f1984e4d740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563bfd054f20 0x563bfd082ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:11.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.413+0000 7f1984e4d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bfd06bae0 0x563bfd082ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:11.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.413+0000 7f1984e4d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x563bfd06d810 con 0x563bfd051120 2024-09-15T23:16:11.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.413+0000 7f1984e4d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x563bfd054720 con 0x563bfd06bae0 2024-09-15T23:16:11.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.413+0000 7f1984e4d740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x563bfd04bad0 con 0x563bfd054f20 2024-09-15T23:16:11.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.413+0000 7f1984e4d740 10 client.0 _ll_register_callbacks cb 0x7f196c026070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:16:11.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.413+0000 7f197b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bfd051120 0x563bfd0f0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:11.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.413+0000 7f197b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bfd051120 0x563bfd0f0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46622/0 (socket says 172.21.15.123:46622) 2024-09-15T23:16:11.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.413+0000 7f197b7fe640 1 -- 172.21.15.123:0/3462848126 learned_addr learned my addr 172.21.15.123:0/3462848126 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:11.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.413+0000 7f197bfff640 1 --2- 172.21.15.123:0/3462848126 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bfd06bae0 0x563bfd082ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:11.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.413+0000 7f197affd640 1 --2- 172.21.15.123:0/3462848126 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563bfd054f20 0x563bfd082ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:11.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.413+0000 7f197b7fe640 1 -- 172.21.15.123:0/3462848126 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563bfd054f20 msgr2=0x563bfd082ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:11.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.413+0000 7f197b7fe640 1 --2- 172.21.15.123:0/3462848126 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563bfd054f20 0x563bfd082ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.413+0000 7f197b7fe640 1 -- 172.21.15.123:0/3462848126 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bfd06bae0 msgr2=0x563bfd082ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:11.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.413+0000 7f197b7fe640 1 --2- 172.21.15.123:0/3462848126 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bfd06bae0 0x563bfd082ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.413+0000 7f197b7fe640 1 -- 172.21.15.123:0/3462848126 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bfd053000 con 0x563bfd051120 2024-09-15T23:16:11.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.413+0000 7f197bfff640 1 --2- 172.21.15.123:0/3462848126 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bfd06bae0 0x563bfd082ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:16:11.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.413+0000 7f197b7fe640 1 --2- 172.21.15.123:0/3462848126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bfd051120 0x563bfd0f0fb0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f196c003f70 tx=0x7f196c00c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4426b72b82eec9e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:11.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.413+0000 7f195a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:16:11.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.413+0000 7f195a7fc640 1 -- 172.21.15.123:0/3462848126 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196c028070 con 0x563bfd051120 2024-09-15T23:16:11.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.414+0000 7f195a7fc640 1 -- 172.21.15.123:0/3462848126 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 5967+0+0 (secure 0 0 0) 0x7f196c024850 con 0x563bfd051120 2024-09-15T23:16:11.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.414+0000 7f1984e4d740 1 -- 172.21.15.123:0/3462848126 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19740626f0 con 0x563bfd051120 2024-09-15T23:16:11.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.414+0000 7f195a7fc640 1 -- 172.21.15.123:0/3462848126 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f196c04d050 con 0x563bfd051120 2024-09-15T23:16:11.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.414+0000 7f1984e4d740 10 client.6972 fetch_fsmap learned FSMap version 53 2024-09-15T23:16:11.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.414+0000 7f1984e4d740 1 -- 172.21.15.123:0/3462848126 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x563bfd0f14f0 con 0x563bfd051120 2024-09-15T23:16:11.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.414+0000 7f195a7fc640 1 -- 172.21.15.123:0/3462848126 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19740626f0 con 0x563bfd051120 2024-09-15T23:16:11.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.414+0000 7f195a7fc640 1 -- 172.21.15.123:0/3462848126 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 53) ==== 3502+0+0 (secure 0 0 0) 0x7f196c050020 con 0x563bfd051120 2024-09-15T23:16:11.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.414+0000 7f1984e4d740 10 client.6972 fetch_fsmap finished waiting for FSMap version 53 2024-09-15T23:16:11.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.414+0000 7f1984e4d740 10 client.6972 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T23:16:11.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.414+0000 7f1984e4d740 20 client.6972 populate_metadata read hostname 'smithi123' 2024-09-15T23:16:11.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.414+0000 7f1984e4d740 1 --2- 172.21.15.123:0/3462848126 >> [v2:172.21.15.123:6834/3648891779,v1:172.21.15.123:6835/3648891779] conn(0x563bfd073a80 0x563bfd06f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:11.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.414+0000 7f1984e4d740 4 client.6972 mds_command: new command op to 6930 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:16:11.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.414+0000 7f1984e4d740 1 -- 172.21.15.123:0/3462848126 --> [v2:172.21.15.123:6834/3648891779,v1:172.21.15.123:6835/3648891779] -- command(tid 0: {"prefix": "status"}) -- 0x563bfd06f1f0 con 0x563bfd073a80 2024-09-15T23:16:11.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.414+0000 7f197affd640 1 --2- 172.21.15.123:0/3462848126 >> [v2:172.21.15.123:6834/3648891779,v1:172.21.15.123:6835/3648891779] conn(0x563bfd073a80 0x563bfd06f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:11.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.414+0000 7f195a7fc640 10 client.6972 ms_handle_connect on v2:172.21.15.123:6834/3648891779 2024-09-15T23:16:11.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.414+0000 7f197affd640 1 --2- 172.21.15.123:0/3462848126 >> [v2:172.21.15.123:6834/3648891779,v1:172.21.15.123:6835/3648891779] conn(0x563bfd073a80 0x563bfd06f440 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8dc4f25642f26bd2 server_cookie=4f2e33af07ced567 in_seq=0 out_seq=0 2024-09-15T23:16:11.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.414+0000 7f195a7fc640 1 -- 172.21.15.123:0/3462848126 <== mds.0 v2:172.21.15.123:6834/3648891779 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x563bfd06f1f0 con 0x563bfd073a80 2024-09-15T23:16:11.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.414+0000 7f195a7fc640 10 client.6972 handle_command_reply: tid=0 2024-09-15T23:16:11.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.414+0000 7f1984e4d740 1 client.6972 shutdown 2024-09-15T23:16:11.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.415+0000 7f1984e4d740 1 -- 172.21.15.123:0/3462848126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bfd051120 msgr2=0x563bfd0f0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:11.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.415+0000 7f1984e4d740 1 --2- 172.21.15.123:0/3462848126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bfd051120 0x563bfd0f0fb0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f196c003f70 tx=0x7f196c00c000 comp rx=0 tx=0).stop 2024-09-15T23:16:11.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.415+0000 7f1984e4d740 1 -- 172.21.15.123:0/3462848126 shutdown_connections 2024-09-15T23:16:11.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.415+0000 7f1984e4d740 1 --2- 172.21.15.123:0/3462848126 >> [v2:172.21.15.123:6834/3648891779,v1:172.21.15.123:6835/3648891779] conn(0x563bfd073a80 0x563bfd06f440 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.415+0000 7f1984e4d740 1 --2- 172.21.15.123:0/3462848126 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bfd06bae0 0x563bfd082ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.415+0000 7f1984e4d740 1 --2- 172.21.15.123:0/3462848126 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563bfd054f20 0x563bfd082ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.415+0000 7f1984e4d740 1 --2- 172.21.15.123:0/3462848126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bfd051120 0x563bfd0f0fb0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.415+0000 7f195a7fc640 0 client.6972 ms_handle_reset on v2:172.21.15.123:6834/3648891779 2024-09-15T23:16:11.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.415+0000 7f1984e4d740 1 -- 172.21.15.123:0/3462848126 >> 172.21.15.123:0/3462848126 conn(0x563bfd024a80 msgr2=0x563bfd0270d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:11.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.415+0000 7f1984e4d740 1 -- 172.21.15.123:0/3462848126 shutdown_connections 2024-09-15T23:16:11.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.415+0000 7f1984e4d740 1 -- 172.21.15.123:0/3462848126 wait complete. 2024-09-15T23:16:11.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.415+0000 7f1984e4d740 20 client.6972 trim_cache size 0 max 16384 2024-09-15T23:16:11.424 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:16:11.424 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "cb968ac4-8d3a-4b17-a673-6177aeaea589", 2024-09-15T23:16:11.424 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2024-09-15T23:16:11.424 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 6930, 2024-09-15T23:16:11.424 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-09-15T23:16:11.424 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-09-15T23:16:11.424 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-09-15T23:16:11.424 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 4.3998388730000002, 2024-09-15T23:16:11.424 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 53, 2024-09-15T23:16:11.424 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 86, 2024-09-15T23:16:11.425 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 86, 2024-09-15T23:16:11.425 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 4.5655980200000004 2024-09-15T23:16:11.425 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:16:11.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.415+0000 7f1981fd8640 1 -- 172.21.15.123:0/2502548835 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f196806c2e0 msgr2=0x7f196806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:11.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.415+0000 7f1981fd8640 1 --2- 172.21.15.123:0/2502548835 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f196806c2e0 0x7f196806e7a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f196c000c00 tx=0x7f196c009040 comp rx=0 tx=0).stop 2024-09-15T23:16:11.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.415+0000 7f1981fd8640 1 -- 172.21.15.123:0/2502548835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f197c13d9d0 msgr2=0x7f197c13de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:11.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.415+0000 7f1981fd8640 1 --2- 172.21.15.123:0/2502548835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f197c13d9d0 0x7f197c13de50 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f197c073dd0 tx=0x7f1974007b20 comp rx=0 tx=0).stop 2024-09-15T23:16:11.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.415+0000 7f1981fd8640 1 -- 172.21.15.123:0/2502548835 shutdown_connections 2024-09-15T23:16:11.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.415+0000 7f1981fd8640 1 --2- 172.21.15.123:0/2502548835 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f196806c2e0 0x7f196806e7a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.415+0000 7f1981fd8640 1 --2- 172.21.15.123:0/2502548835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f197c13d9d0 0x7f197c13de50 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.415+0000 7f1981fd8640 1 --2- 172.21.15.123:0/2502548835 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f197c142420 0x7f197c135dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.415+0000 7f1981fd8640 1 --2- 172.21.15.123:0/2502548835 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1964004800 0x7f197c158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.415+0000 7f1981fd8640 1 -- 172.21.15.123:0/2502548835 >> 172.21.15.123:0/2502548835 conn(0x7f197c0ccec0 msgr2=0x7f197c144090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:11.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.415+0000 7f1981fd8640 1 -- 172.21.15.123:0/2502548835 shutdown_connections 2024-09-15T23:16:11.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.415+0000 7f1981fd8640 1 -- 172.21.15.123:0/2502548835 wait complete. 2024-09-15T23:16:11.428 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:16:11.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.525+0000 7f7ba5b1f640 1 Processor -- start 2024-09-15T23:16:11.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.525+0000 7f7ba5b1f640 1 -- start start 2024-09-15T23:16:11.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.526+0000 7f7ba5b1f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ba00b6970 0x7f7ba00b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:11.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.526+0000 7f7ba5b1f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7ba00d23b0 0x7f7ba00b8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:11.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.526+0000 7f7ba5b1f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ba00d0e70 con 0x7f7ba015ed20 2024-09-15T23:16:11.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.526+0000 7f7ba5b1f640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f7ba00d41c0 con 0x7f7ba00d23b0 2024-09-15T23:16:11.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.526+0000 7f7ba5b1f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7ba00d35b0 con 0x7f7ba00b6970 2024-09-15T23:16:11.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.527+0000 7f7b9effd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ba00b6970 0x7f7ba00b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:11.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.527+0000 7f7b9ffff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7ba00d23b0 0x7f7ba00b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:11.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.527+0000 7f7b9f7fe640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f7ba015ed20 0x7f7ba00b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:39960/0 (socket says 172.21.15.123:39960) 2024-09-15T23:16:11.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.527+0000 7f7b9ffff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7ba00d23b0 0x7f7ba00b8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:58382/0 (socket says 172.21.15.123:58382) 2024-09-15T23:16:11.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.527+0000 7f7b9effd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ba00b6970 0x7f7ba00b80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:50920/0 (socket says 172.21.15.123:50920) 2024-09-15T23:16:11.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.527+0000 7f7b9f7fe640 1 -- 172.21.15.123:0/2716056914 learned_addr learned my addr 172.21.15.123:0/2716056914 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:11.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.527+0000 7f7b9effd640 1 -- 172.21.15.123:0/2716056914 >> v2:172.21.15.188:3300/0 conn(0x7f7ba00d23b0 msgr2=0x7f7ba00b8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:11.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.527+0000 7f7b9effd640 1 --2- 172.21.15.123:0/2716056914 >> v2:172.21.15.188:3300/0 conn(0x7f7ba00d23b0 0x7f7ba00b8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.527+0000 7f7b9effd640 1 -- 172.21.15.123:0/2716056914 >> v1:172.21.15.188:6789/0 conn(0x7f7ba015ed20 legacy=0x7f7ba00b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:11.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.527+0000 7f7b9effd640 1 -- 172.21.15.123:0/2716056914 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ba00d3890 con 0x7f7ba00b6970 2024-09-15T23:16:11.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.527+0000 7f7b9ffff640 1 --2- 172.21.15.123:0/2716056914 >> v2:172.21.15.188:3300/0 conn(0x7f7ba00d23b0 0x7f7ba00b8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:16:11.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.528+0000 7f7b9effd640 1 --2- 172.21.15.123:0/2716056914 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ba00b6970 0x7f7ba00b80d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7b94009d90 tx=0x7f7b9402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfebea4bb3197006 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:11.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.528+0000 7f7b9e7fc640 1 -- 172.21.15.123:0/2716056914 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b94031600 con 0x7f7ba00b6970 2024-09-15T23:16:11.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.528+0000 7f7b9e7fc640 1 -- 172.21.15.123:0/2716056914 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b940317a0 con 0x7f7ba00b6970 2024-09-15T23:16:11.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.528+0000 7f7b9e7fc640 1 -- 172.21.15.123:0/2716056914 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b94031b70 con 0x7f7ba00b6970 2024-09-15T23:16:11.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.528+0000 7f7ba5b1f640 1 -- 172.21.15.123:0/2716056914 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ba00b6970 msgr2=0x7f7ba00b80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:11.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.528+0000 7f7ba5b1f640 1 --2- 172.21.15.123:0/2716056914 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ba00b6970 0x7f7ba00b80d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7b94009d90 tx=0x7f7b9402a5d0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.528+0000 7f7ba5b1f640 1 -- 172.21.15.123:0/2716056914 shutdown_connections 2024-09-15T23:16:11.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.528+0000 7f7ba5b1f640 1 --2- 172.21.15.123:0/2716056914 >> v2:172.21.15.188:3300/0 conn(0x7f7ba00d23b0 0x7f7ba00b8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.528+0000 7f7ba5b1f640 1 --2- 172.21.15.123:0/2716056914 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ba00b6970 0x7f7ba00b80d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.528+0000 7f7ba5b1f640 1 -- 172.21.15.123:0/2716056914 >> 172.21.15.123:0/2716056914 conn(0x7f7ba00d1260 msgr2=0x7f7ba00d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:11.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.528+0000 7f7ba5b1f640 1 -- 172.21.15.123:0/2716056914 shutdown_connections 2024-09-15T23:16:11.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.528+0000 7f7ba5b1f640 1 -- 172.21.15.123:0/2716056914 wait complete. 2024-09-15T23:16:11.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.530+0000 7f7ba5b1f640 1 Processor -- start 2024-09-15T23:16:11.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.530+0000 7f7ba5b1f640 1 -- start start 2024-09-15T23:16:11.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.531+0000 7f7ba5b1f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ba00b6970 0x7f7ba015bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:11.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.531+0000 7f7ba5b1f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ba00d23b0 0x7f7ba00ab130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:11.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.531+0000 7f7ba5b1f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ba015ed20 0x7f7ba01f5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:11.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.531+0000 7f7ba5b1f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba00d32a0 con 0x7f7ba015ed20 2024-09-15T23:16:11.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.531+0000 7f7ba5b1f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba00d3e50 con 0x7f7ba00d23b0 2024-09-15T23:16:11.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.531+0000 7f7ba5b1f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7ba015f100 con 0x7f7ba00b6970 2024-09-15T23:16:11.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.531+0000 7f7b9ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ba015ed20 0x7f7ba01f5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:11.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.531+0000 7f7b9ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ba015ed20 0x7f7ba01f5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46626/0 (socket says 172.21.15.123:46626) 2024-09-15T23:16:11.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.531+0000 7f7b9ffff640 1 -- 172.21.15.123:0/2344637711 learned_addr learned my addr 172.21.15.123:0/2344637711 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:11.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.531+0000 7f7b9f7fe640 1 --2- 172.21.15.123:0/2344637711 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ba00b6970 0x7f7ba015bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:11.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.531+0000 7f7b9effd640 1 --2- 172.21.15.123:0/2344637711 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ba00d23b0 0x7f7ba00ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:11.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.531+0000 7f7b9ffff640 1 -- 172.21.15.123:0/2344637711 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ba00b6970 msgr2=0x7f7ba015bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:11.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.531+0000 7f7b9ffff640 1 --2- 172.21.15.123:0/2344637711 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ba00b6970 0x7f7ba015bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.531+0000 7f7b9ffff640 1 -- 172.21.15.123:0/2344637711 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ba00d23b0 msgr2=0x7f7ba00ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:11.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.531+0000 7f7b9ffff640 1 --2- 172.21.15.123:0/2344637711 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ba00d23b0 0x7f7ba00ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.531+0000 7f7b9ffff640 1 -- 172.21.15.123:0/2344637711 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ba00ab670 con 0x7f7ba015ed20 2024-09-15T23:16:11.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.531+0000 7f7b9ffff640 1 --2- 172.21.15.123:0/2344637711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ba015ed20 0x7f7ba01f5930 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f7b9800e930 tx=0x7f7b9800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:11.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.531+0000 7f7b87fff640 1 -- 172.21.15.123:0/2344637711 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b98017070 con 0x7f7ba015ed20 2024-09-15T23:16:11.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.531+0000 7f7b87fff640 1 -- 172.21.15.123:0/2344637711 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b9800ca00 con 0x7f7ba015ed20 2024-09-15T23:16:11.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.531+0000 7f7b87fff640 1 -- 172.21.15.123:0/2344637711 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b9800cdd0 con 0x7f7ba015ed20 2024-09-15T23:16:11.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.531+0000 7f7ba5b1f640 1 -- 172.21.15.123:0/2344637711 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ba01f5e70 con 0x7f7ba015ed20 2024-09-15T23:16:11.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.532+0000 7f7ba5b1f640 1 -- 172.21.15.123:0/2344637711 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ba015f5b0 con 0x7f7ba015ed20 2024-09-15T23:16:11.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.532+0000 7f7ba5b1f640 1 -- 172.21.15.123:0/2344637711 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ba00d0490 con 0x7f7ba015ed20 2024-09-15T23:16:11.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.533+0000 7f7b87fff640 1 -- 172.21.15.123:0/2344637711 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7b98013470 con 0x7f7ba015ed20 2024-09-15T23:16:11.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.533+0000 7f7b87fff640 1 --2- 172.21.15.123:0/2344637711 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7b8c06c2b0 0x7f7b8c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:11.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.534+0000 7f7b87fff640 1 -- 172.21.15.123:0/2344637711 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5967+0+0 (secure 0 0 0) 0x7f7b9808b000 con 0x7f7ba015ed20 2024-09-15T23:16:11.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.534+0000 7f7b9f7fe640 1 --2- 172.21.15.123:0/2344637711 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7b8c06c2b0 0x7f7b8c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:11.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.534+0000 7f7b9f7fe640 1 --2- 172.21.15.123:0/2344637711 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7b8c06c2b0 0x7f7b8c06e770 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7b90007fd0 tx=0x7f7b90007e80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:11.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.538+0000 7f7b87fff640 1 -- 172.21.15.123:0/2344637711 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7ba00d0490 con 0x7f7ba015ed20 2024-09-15T23:16:11.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.740+0000 7f7ba5b1f640 1 -- 172.21.15.123:0/2344637711 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7ba00b7010 con 0x7f7ba015ed20 2024-09-15T23:16:11.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.741+0000 7f7b87fff640 1 -- 172.21.15.123:0/2344637711 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v53) ==== 53+0+73 (secure 0 0 0) 0x7f7ba01f5e70 con 0x7f7ba015ed20 2024-09-15T23:16:11.742 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:16:11.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.742+0000 7f7ba5b1f640 1 -- 172.21.15.123:0/2344637711 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7b8c06c2b0 msgr2=0x7f7b8c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:11.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.742+0000 7f7ba5b1f640 1 --2- 172.21.15.123:0/2344637711 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7b8c06c2b0 0x7f7b8c06e770 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7b90007fd0 tx=0x7f7b90007e80 comp rx=0 tx=0).stop 2024-09-15T23:16:11.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.742+0000 7f7ba5b1f640 1 -- 172.21.15.123:0/2344637711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ba015ed20 msgr2=0x7f7ba01f5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:11.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.742+0000 7f7ba5b1f640 1 --2- 172.21.15.123:0/2344637711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ba015ed20 0x7f7ba01f5930 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f7b9800e930 tx=0x7f7b9800edf0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.742+0000 7f7ba5b1f640 1 -- 172.21.15.123:0/2344637711 shutdown_connections 2024-09-15T23:16:11.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.742+0000 7f7ba5b1f640 1 --2- 172.21.15.123:0/2344637711 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7b8c06c2b0 0x7f7b8c06e770 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.742+0000 7f7ba5b1f640 1 --2- 172.21.15.123:0/2344637711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ba015ed20 0x7f7ba01f5930 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.742+0000 7f7ba5b1f640 1 --2- 172.21.15.123:0/2344637711 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ba00d23b0 0x7f7ba00ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.742+0000 7f7ba5b1f640 1 --2- 172.21.15.123:0/2344637711 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ba00b6970 0x7f7ba015bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:11.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.743+0000 7f7ba5b1f640 1 -- 172.21.15.123:0/2344637711 >> 172.21.15.123:0/2344637711 conn(0x7f7ba00d1260 msgr2=0x7f7ba00b7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:11.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.743+0000 7f7ba5b1f640 1 -- 172.21.15.123:0/2344637711 shutdown_connections 2024-09-15T23:16:11.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11.743+0000 7f7ba5b1f640 1 -- 172.21.15.123:0/2344637711 wait complete. 2024-09-15T23:16:11.754 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T23:16:11.754 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:16:11.755 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-09-15T23:16:11.755 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T23:16:11.755 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T23:16:11.755 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T23:16:11.755 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T23:16:11.755 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:16:11.755 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:16:11.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:16:11.755 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-09-15T23:16:11.771 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:16:11.771 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:16:11.771 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:16:11.771 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:16:11.771 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-09-15T23:16:11.771 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:16:11.771 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:16:11.772 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-09-15T23:16:11.772 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f0 2024-09-15T23:16:11.772 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:16:11.772 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:16:11.772 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f1 2024-09-15T23:16:11.772 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:16:11.772 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:16:11.772 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:16:11.772 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:16:11.772 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T23:16:11.772 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42568sec preferred_lft 42568sec 2024-09-15T23:16:11.772 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link noprefixroute 2024-09-15T23:16:11.773 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:16:11.773 INFO:teuthology.orchestra.run.smithi123.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:16:11.773 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 46:55:5a:e0:32:4d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:16:11.773 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:16:11.773 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:16:11.773 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::1c6f:d5ff:fe19:ff05/64 scope link 2024-09-15T23:16:11.773 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:16:11.773 INFO:teuthology.orchestra.run.smithi123.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:16:11.773 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 46:55:5a:e0:32:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:16:11.773 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::4455:5aff:fee0:324d/64 scope link 2024-09-15T23:16:11.773 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:16:11.773 INFO:teuthology.orchestra.run.smithi123.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:16:11.773 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether be:c1:f3:63:cb:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:16:11.774 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::bcc1:f3ff:fe63:cb24/64 scope link 2024-09-15T23:16:11.774 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:16:11.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:16:11.774 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:16:11.835 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-09-15T23:16:11.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:16:11.837 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-09-15T23:16:11.893 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-09-15T23:16:11.893 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:16:11.893 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:16:11.894 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:16:11.894 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:16:11.894 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:16:11.894 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:16:11.894 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:16:11.894 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:16:11.894 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:16:11.894 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:16:11.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:16:12.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:16:12.017 INFO:tasks.ceph.mds.c.smithi123.stderr:2024-09-15T23:16:12.016+0000 7f0527090640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:16:12.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:16:12.020 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-09-15T23:16:12.035 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T23:16:12.035 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:16:12.036 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:16:12.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:16:12.036 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2024-09-15T23:16:12.101 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:16:12.101 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T23:16:12.157 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:16:12.157 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:16:12.157 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:16:12.211 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T23:16:12.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:16:12.212 DEBUG:teuthology.orchestra.run.smithi123:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:16:12.294 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:16:12.295 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:16:12.295 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:16:12.303 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:16:12.303 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:16:12.303 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:16:12.303 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.188:3300,172.21.15.188:3301" 2024-09-15T23:16:12.303 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T23:16:12.309 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:16:12.309 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:16:12.309 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:16:12.309 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.188:3300,172.21.15.188:3301" 2024-09-15T23:16:12.309 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T23:16:12.309 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:6789,172.21.15.188:6789,172.21.15.188:6790" 2024-09-15T23:16:12.309 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.123:6789,172.21.15.188:6789,172.21.15.188:6790:/ 2024-09-15T23:16:12.309 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=cb968ac4-8d3a-4b17-a673-6177aeaea589" will pass to kernel 2024-09-15T23:16:12.310 INFO:teuthology.orchestra.run.smithi123.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-15T23:16:12.310 INFO:teuthology.orchestra.run.smithi123.stdout: You just mounted a file system that supports labels which does not 2024-09-15T23:16:12.310 INFO:teuthology.orchestra.run.smithi123.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T23:16:12.310 INFO:teuthology.orchestra.run.smithi123.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T23:16:12.310 INFO:teuthology.orchestra.run.smithi123.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T23:16:12.311 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T23:16:12.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:16:12.311 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:16:12.375 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T23:16:12.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:16:12.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:16:12.471 INFO:teuthology.orchestra.run.smithi123.stdout:client6238 2024-09-15T23:16:12.472 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:16:12.472 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:16:12.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:16:12.488 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir scrub_repair_path) 2024-09-15T23:16:12.544 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:16:12.544 INFO:teuthology.orchestra.run.smithi123.stderr:rmdir: failed to remove 'scrub_repair_path': Directory not empty 2024-09-15T23:16:12.544 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_repair_path repair' 2024-09-15T23:16:12.545 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 scrub start /scrub_repair_path repair 2024-09-15T23:16:12.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.685+0000 7f4b3c2a6640 1 Processor -- start 2024-09-15T23:16:12.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.685+0000 7f4b3c2a6640 1 -- start start 2024-09-15T23:16:12.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.686+0000 7f4b3c2a6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4b340b1880 0x7f4b340b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:12.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.686+0000 7f4b3c2a6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4b340b48f0 0x7f4b340b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:12.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.686+0000 7f4b3c2a6640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b340d1210 con 0x7f4b3415c520 2024-09-15T23:16:12.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.686+0000 7f4b3c2a6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f4b340d0fc0 con 0x7f4b340b1880 2024-09-15T23:16:12.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.686+0000 7f4b3c2a6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4b340b5610 con 0x7f4b340b48f0 2024-09-15T23:16:12.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.686+0000 7f4b39841640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4b340b1880 0x7f4b340b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:12.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.686+0000 7f4b3a843640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4b340b48f0 0x7f4b340b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:12.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.686+0000 7f4b3a042640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f4b3415c520 0x7f4b340b41e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:39968/0 (socket says 172.21.15.123:39968) 2024-09-15T23:16:12.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.686+0000 7f4b3a042640 1 -- 172.21.15.123:0/1517936106 learned_addr learned my addr 172.21.15.123:0/1517936106 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:12.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.687+0000 7f4b3a843640 1 -- 172.21.15.123:0/1517936106 >> v2:172.21.15.188:3300/0 conn(0x7f4b340b1880 msgr2=0x7f4b340b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:12.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.687+0000 7f4b3a843640 1 --2- 172.21.15.123:0/1517936106 >> v2:172.21.15.188:3300/0 conn(0x7f4b340b1880 0x7f4b340b5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:12.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.687+0000 7f4b3a843640 1 -- 172.21.15.123:0/1517936106 >> v1:172.21.15.188:6789/0 conn(0x7f4b3415c520 legacy=0x7f4b340b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:12.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.687+0000 7f4b3a843640 1 -- 172.21.15.123:0/1517936106 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b340d14f0 con 0x7f4b340b48f0 2024-09-15T23:16:12.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.687+0000 7f4b3a843640 1 --2- 172.21.15.123:0/1517936106 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4b340b48f0 0x7f4b340b5fe0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4b300097a0 tx=0x7f4b3002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7e7eb1ff65eb4cb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:12.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.688+0000 7f4b39040640 1 -- 172.21.15.123:0/1517936106 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b30037070 con 0x7f4b340b48f0 2024-09-15T23:16:12.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.688+0000 7f4b39040640 1 -- 172.21.15.123:0/1517936106 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b30032440 con 0x7f4b340b48f0 2024-09-15T23:16:12.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.688+0000 7f4b39040640 1 -- 172.21.15.123:0/1517936106 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b30032810 con 0x7f4b340b48f0 2024-09-15T23:16:12.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.688+0000 7f4b3c2a6640 1 -- 172.21.15.123:0/1517936106 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4b340b48f0 msgr2=0x7f4b340b5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:12.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.688+0000 7f4b3c2a6640 1 --2- 172.21.15.123:0/1517936106 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4b340b48f0 0x7f4b340b5fe0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4b300097a0 tx=0x7f4b3002a180 comp rx=0 tx=0).stop 2024-09-15T23:16:12.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.688+0000 7f4b3c2a6640 1 -- 172.21.15.123:0/1517936106 shutdown_connections 2024-09-15T23:16:12.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.688+0000 7f4b3c2a6640 1 --2- 172.21.15.123:0/1517936106 >> v2:172.21.15.188:3300/0 conn(0x7f4b340b1880 0x7f4b340b5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:12.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.688+0000 7f4b3c2a6640 1 --2- 172.21.15.123:0/1517936106 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4b340b48f0 0x7f4b340b5fe0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:12.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.688+0000 7f4b3c2a6640 1 -- 172.21.15.123:0/1517936106 >> 172.21.15.123:0/1517936106 conn(0x7f4b34067950 msgr2=0x7f4b34067d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:12.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.688+0000 7f4b3c2a6640 1 -- 172.21.15.123:0/1517936106 shutdown_connections 2024-09-15T23:16:12.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.688+0000 7f4b3c2a6640 1 -- 172.21.15.123:0/1517936106 wait complete. 2024-09-15T23:16:12.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.689+0000 7f4b3c2a6640 1 Processor -- start 2024-09-15T23:16:12.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.690+0000 7f4b3c2a6640 1 -- start start 2024-09-15T23:16:12.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.690+0000 7f4b3c2a6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b340b48f0 0x7f4b341f5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:12.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.690+0000 7f4b3c2a6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4b3415c520 0x7f4b3415ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:12.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.690+0000 7f4b3c2a6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b341f8fa0 0x7f4b340afba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:12.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.690+0000 7f4b3c2a6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3415ca80 con 0x7f4b341f8fa0 2024-09-15T23:16:12.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.690+0000 7f4b3c2a6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3415c900 con 0x7f4b340b48f0 2024-09-15T23:16:12.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.690+0000 7f4b3c2a6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4b340733e0 con 0x7f4b3415c520 2024-09-15T23:16:12.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.690+0000 7f4b3a843640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b341f8fa0 0x7f4b340afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:12.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.690+0000 7f4b3a843640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b341f8fa0 0x7f4b340afba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46640/0 (socket says 172.21.15.123:46640) 2024-09-15T23:16:12.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.690+0000 7f4b3a843640 1 -- 172.21.15.123:0/287645921 learned_addr learned my addr 172.21.15.123:0/287645921 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:12.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.690+0000 7f4b39841640 1 --2- 172.21.15.123:0/287645921 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4b3415c520 0x7f4b3415ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:12.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.691+0000 7f4b3a042640 1 --2- 172.21.15.123:0/287645921 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b340b48f0 0x7f4b341f5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:12.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.691+0000 7f4b3a843640 1 -- 172.21.15.123:0/287645921 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4b3415c520 msgr2=0x7f4b3415ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:12.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.691+0000 7f4b3a843640 1 --2- 172.21.15.123:0/287645921 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4b3415c520 0x7f4b3415ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:12.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.691+0000 7f4b3a843640 1 -- 172.21.15.123:0/287645921 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b340b48f0 msgr2=0x7f4b341f5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:12.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.691+0000 7f4b3a843640 1 --2- 172.21.15.123:0/287645921 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b340b48f0 0x7f4b341f5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:12.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.691+0000 7f4b3a843640 1 -- 172.21.15.123:0/287645921 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b3415fa40 con 0x7f4b341f8fa0 2024-09-15T23:16:12.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.691+0000 7f4b3a843640 1 --2- 172.21.15.123:0/287645921 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b341f8fa0 0x7f4b340afba0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f4b3002a1c0 tx=0x7f4b300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:12.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.691+0000 7f4b2affd640 1 -- 172.21.15.123:0/287645921 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b30041030 con 0x7f4b341f8fa0 2024-09-15T23:16:12.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.691+0000 7f4b2affd640 1 -- 172.21.15.123:0/287645921 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b30030440 con 0x7f4b341f8fa0 2024-09-15T23:16:12.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.691+0000 7f4b2affd640 1 -- 172.21.15.123:0/287645921 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b30037040 con 0x7f4b341f8fa0 2024-09-15T23:16:12.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.691+0000 7f4b3c2a6640 1 -- 172.21.15.123:0/287645921 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b3415fd20 con 0x7f4b341f8fa0 2024-09-15T23:16:12.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.691+0000 7f4b3c2a6640 1 -- 172.21.15.123:0/287645921 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b341f5240 con 0x7f4b341f8fa0 2024-09-15T23:16:12.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.693+0000 7f4b2affd640 1 -- 172.21.15.123:0/287645921 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4b30044070 con 0x7f4b341f8fa0 2024-09-15T23:16:12.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.693+0000 7f4b2affd640 1 --2- 172.21.15.123:0/287645921 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4b1806c2b0 0x7f4b1806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:12.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.694+0000 7f4b2affd640 1 -- 172.21.15.123:0/287645921 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5967+0+0 (secure 0 0 0) 0x7f4b300abad0 con 0x7f4b341f8fa0 2024-09-15T23:16:12.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.694+0000 7f4b3a042640 1 --2- 172.21.15.123:0/287645921 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4b1806c2b0 0x7f4b1806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:12.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.694+0000 7f4b3a042640 1 --2- 172.21.15.123:0/287645921 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4b1806c2b0 0x7f4b1806e770 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c0012e0 tx=0x7f4b2c001990 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:12.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.694+0000 7f4b3f038740 1 Processor -- start 2024-09-15T23:16:12.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.695+0000 7f4b3f038740 1 -- start start 2024-09-15T23:16:12.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.695+0000 7f4b3f038740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6faefc780 0x55d6faefcb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:12.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.695+0000 7f4b3f038740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6faef9f40 0x55d6faefbad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:12.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.695+0000 7f4b3f038740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d6faefa3a0 0x55d6faedc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:12.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.695+0000 7f4b3f038740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d6fae18be0 con 0x55d6faefc780 2024-09-15T23:16:12.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.695+0000 7f4b3f038740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55d6fadc0820 con 0x55d6faef9f40 2024-09-15T23:16:12.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.695+0000 7f4b3f038740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55d6fae14ba0 con 0x55d6faefa3a0 2024-09-15T23:16:12.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.696+0000 7f4b3a042640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6faefc780 0x55d6faefcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:12.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.696+0000 7f4b3a042640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6faefc780 0x55d6faefcb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46654/0 (socket says 172.21.15.123:46654) 2024-09-15T23:16:12.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.696+0000 7f4b3a042640 1 -- 172.21.15.123:0/906498505 learned_addr learned my addr 172.21.15.123:0/906498505 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:12.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.696+0000 7f4b39841640 1 --2- 172.21.15.123:0/906498505 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6faef9f40 0x55d6faefbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:12.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.696+0000 7f4b3a843640 1 --2- 172.21.15.123:0/906498505 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d6faefa3a0 0x55d6faedc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:12.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.696+0000 7f4b3a042640 1 -- 172.21.15.123:0/906498505 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d6faefa3a0 msgr2=0x55d6faedc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:12.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.696+0000 7f4b3a042640 1 --2- 172.21.15.123:0/906498505 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d6faefa3a0 0x55d6faedc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:12.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.696+0000 7f4b3a042640 1 -- 172.21.15.123:0/906498505 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6faef9f40 msgr2=0x55d6faefbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:12.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.696+0000 7f4b3a042640 1 --2- 172.21.15.123:0/906498505 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6faef9f40 0x55d6faefbad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:12.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.696+0000 7f4b3a042640 1 -- 172.21.15.123:0/906498505 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6fabf7af0 con 0x55d6faefc780 2024-09-15T23:16:12.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.696+0000 7f4b3a042640 1 --2- 172.21.15.123:0/906498505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6faefc780 0x55d6faefcb60 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c007c20 tx=0x7f4b2c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5781e844c59152 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:12.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.696+0000 7f4b17fff640 1 -- 172.21.15.123:0/906498505 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c026070 con 0x55d6faefc780 2024-09-15T23:16:12.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.696+0000 7f4b17fff640 1 -- 172.21.15.123:0/906498505 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b2c012560 con 0x55d6faefc780 2024-09-15T23:16:12.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.696+0000 7f4b17fff640 1 -- 172.21.15.123:0/906498505 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c012910 con 0x55d6faefc780 2024-09-15T23:16:12.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.697+0000 7f4b3f038740 1 -- 172.21.15.123:0/906498505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6faefc780 msgr2=0x55d6faefcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:12.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.697+0000 7f4b3f038740 1 --2- 172.21.15.123:0/906498505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6faefc780 0x55d6faefcb60 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c007c20 tx=0x7f4b2c013000 comp rx=0 tx=0).stop 2024-09-15T23:16:12.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.697+0000 7f4b3f038740 1 -- 172.21.15.123:0/906498505 shutdown_connections 2024-09-15T23:16:12.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.697+0000 7f4b3f038740 1 --2- 172.21.15.123:0/906498505 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d6faefa3a0 0x55d6faedc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:12.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.697+0000 7f4b3f038740 1 --2- 172.21.15.123:0/906498505 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6faef9f40 0x55d6faefbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:12.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.697+0000 7f4b3f038740 1 --2- 172.21.15.123:0/906498505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6faefc780 0x55d6faefcb60 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:12.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.697+0000 7f4b3f038740 1 -- 172.21.15.123:0/906498505 >> 172.21.15.123:0/906498505 conn(0x55d6faeb2670 msgr2=0x55d6faefa7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:12.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.697+0000 7f4b3f038740 1 -- 172.21.15.123:0/906498505 shutdown_connections 2024-09-15T23:16:12.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.697+0000 7f4b3f038740 1 -- 172.21.15.123:0/906498505 wait complete. 2024-09-15T23:16:12.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.697+0000 7f4b3f038740 1 -- start start 2024-09-15T23:16:12.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.698+0000 7f4b3f038740 1 Processor -- start 2024-09-15T23:16:12.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.698+0000 7f4b3f038740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6faefa3a0 0x55d6faedb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:12.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.698+0000 7f4b3f038740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6faefc780 0x55d6faedb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:12.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.698+0000 7f4b3f038740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d6faef7240 0x55d6faef76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:12.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.698+0000 7f4b3f038740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d6faef8ea0 con 0x55d6faefc780 2024-09-15T23:16:12.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.698+0000 7f4b3f038740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55d6fada1950 con 0x55d6faefa3a0 2024-09-15T23:16:12.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.698+0000 7f4b3f038740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55d6faef9180 con 0x55d6faef7240 2024-09-15T23:16:12.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.699+0000 7f4b3f038740 10 client.0 _ll_register_callbacks cb 0x55d6fadd95b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:16:12.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.699+0000 7f4b39841640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6faefc780 0x55d6faedb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:12.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.699+0000 7f4b39841640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6faefc780 0x55d6faedb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46666/0 (socket says 172.21.15.123:46666) 2024-09-15T23:16:12.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.699+0000 7f4b39841640 1 -- 172.21.15.123:0/3352353391 learned_addr learned my addr 172.21.15.123:0/3352353391 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:12.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.699+0000 7f4b3a042640 1 --2- 172.21.15.123:0/3352353391 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6faefa3a0 0x55d6faedb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:12.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.699+0000 7f4b3a843640 1 --2- 172.21.15.123:0/3352353391 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d6faef7240 0x55d6faef76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:12.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.699+0000 7f4b39841640 1 -- 172.21.15.123:0/3352353391 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d6faef7240 msgr2=0x55d6faef76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:12.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.699+0000 7f4b39841640 1 --2- 172.21.15.123:0/3352353391 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d6faef7240 0x55d6faef76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:12.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.699+0000 7f4b39841640 1 -- 172.21.15.123:0/3352353391 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6faefa3a0 msgr2=0x55d6faedb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:12.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.699+0000 7f4b39841640 1 --2- 172.21.15.123:0/3352353391 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6faefa3a0 0x55d6faedb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:12.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.699+0000 7f4b39841640 1 -- 172.21.15.123:0/3352353391 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6faaeb3e0 con 0x55d6faefc780 2024-09-15T23:16:12.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.699+0000 7f4b3a843640 1 --2- 172.21.15.123:0/3352353391 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d6faef7240 0x55d6faef76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:16:12.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.699+0000 7f4b39841640 1 --2- 172.21.15.123:0/3352353391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6faefc780 0x55d6faedb050 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f4b240149e0 tx=0x7f4b24014ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a1b0807c0f739f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:12.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.699+0000 7f4b157fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:16:12.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.699+0000 7f4b157fa640 1 -- 172.21.15.123:0/3352353391 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b24022060 con 0x55d6faefc780 2024-09-15T23:16:12.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.699+0000 7f4b157fa640 1 -- 172.21.15.123:0/3352353391 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 5967+0+0 (secure 0 0 0) 0x7f4b24012af0 con 0x55d6faefc780 2024-09-15T23:16:12.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.699+0000 7f4b3f038740 1 -- 172.21.15.123:0/3352353391 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b2c012560 con 0x55d6faefc780 2024-09-15T23:16:12.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.699+0000 7f4b157fa640 1 -- 172.21.15.123:0/3352353391 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f4b24028050 con 0x55d6faefc780 2024-09-15T23:16:12.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.699+0000 7f4b3f038740 10 client.6984 fetch_fsmap learned FSMap version 53 2024-09-15T23:16:12.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.699+0000 7f4b3f038740 1 -- 172.21.15.123:0/3352353391 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x55d6fac58280 con 0x55d6faefc780 2024-09-15T23:16:12.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.700+0000 7f4b157fa640 1 -- 172.21.15.123:0/3352353391 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b2c012560 con 0x55d6faefc780 2024-09-15T23:16:12.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.700+0000 7f4b157fa640 1 -- 172.21.15.123:0/3352353391 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 53) ==== 3502+0+0 (secure 0 0 0) 0x7f4b2402b020 con 0x55d6faefc780 2024-09-15T23:16:12.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.700+0000 7f4b3f038740 10 client.6984 fetch_fsmap finished waiting for FSMap version 53 2024-09-15T23:16:12.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.700+0000 7f4b3f038740 10 client.6984 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-09-15T23:16:12.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.700+0000 7f4b3f038740 20 client.6984 populate_metadata read hostname 'smithi123' 2024-09-15T23:16:12.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.700+0000 7f4b3f038740 1 --2- 172.21.15.123:0/3352353391 >> [v2:172.21.15.123:6834/3648891779,v1:172.21.15.123:6835/3648891779] conn(0x55d6faf0e390 0x55d6faf0e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:12.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.700+0000 7f4b3f038740 4 client.6984 mds_command: new command op to 6930 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:16:12.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.700+0000 7f4b3f038740 1 -- 172.21.15.123:0/3352353391 --> [v2:172.21.15.123:6834/3648891779,v1:172.21.15.123:6835/3648891779] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6fae26310 con 0x55d6faf0e390 2024-09-15T23:16:12.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.700+0000 7f4b3a042640 1 --2- 172.21.15.123:0/3352353391 >> [v2:172.21.15.123:6834/3648891779,v1:172.21.15.123:6835/3648891779] conn(0x55d6faf0e390 0x55d6faf0e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:12.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.700+0000 7f4b157fa640 10 client.6984 ms_handle_connect on v2:172.21.15.123:6834/3648891779 2024-09-15T23:16:12.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.700+0000 7f4b3a042640 1 --2- 172.21.15.123:0/3352353391 >> [v2:172.21.15.123:6834/3648891779,v1:172.21.15.123:6835/3648891779] conn(0x55d6faf0e390 0x55d6faf0e770 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4794c8e9d40c92f server_cookie=ef4c49483590ce68 in_seq=0 out_seq=0 2024-09-15T23:16:12.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.701+0000 7f4b157fa640 1 -- 172.21.15.123:0/3352353391 <== mds.0 v2:172.21.15.123:6834/3648891779 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d6fae26310 con 0x55d6faf0e390 2024-09-15T23:16:12.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.701+0000 7f4b157fa640 10 client.6984 handle_command_reply: tid=0 2024-09-15T23:16:12.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.701+0000 7f4b3f038740 1 client.6984 shutdown 2024-09-15T23:16:12.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.701+0000 7f4b3f038740 1 -- 172.21.15.123:0/3352353391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6faefc780 msgr2=0x55d6faedb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:12.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.701+0000 7f4b3f038740 1 --2- 172.21.15.123:0/3352353391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6faefc780 0x55d6faedb050 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f4b240149e0 tx=0x7f4b24014ea0 comp rx=0 tx=0).stop 2024-09-15T23:16:12.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.701+0000 7f4b3f038740 1 -- 172.21.15.123:0/3352353391 shutdown_connections 2024-09-15T23:16:12.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.701+0000 7f4b3f038740 1 --2- 172.21.15.123:0/3352353391 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d6faef7240 0x55d6faef76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:12.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.701+0000 7f4b3f038740 1 --2- 172.21.15.123:0/3352353391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6faefc780 0x55d6faedb050 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:12.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.701+0000 7f4b3f038740 1 --2- 172.21.15.123:0/3352353391 >> [v2:172.21.15.123:6834/3648891779,v1:172.21.15.123:6835/3648891779] conn(0x55d6faf0e390 0x55d6faf0e770 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:12.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.701+0000 7f4b3f038740 1 --2- 172.21.15.123:0/3352353391 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6faefa3a0 0x55d6faedb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:12.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.701+0000 7f4b157fa640 0 client.6984 ms_handle_reset on v2:172.21.15.123:6834/3648891779 2024-09-15T23:16:12.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.701+0000 7f4b3f038740 1 -- 172.21.15.123:0/3352353391 >> 172.21.15.123:0/3352353391 conn(0x55d6faef9f40 msgr2=0x55d6faeb13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:12.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.701+0000 7f4b3f038740 1 -- 172.21.15.123:0/3352353391 shutdown_connections 2024-09-15T23:16:12.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.701+0000 7f4b3f038740 1 -- 172.21.15.123:0/3352353391 wait complete. 2024-09-15T23:16:12.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.701+0000 7f4b3f038740 20 client.6984 trim_cache size 0 max 16384 2024-09-15T23:16:12.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.718+0000 7f4b3f038740 1 Processor -- start 2024-09-15T23:16:12.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.718+0000 7f4b3f038740 1 -- start start 2024-09-15T23:16:12.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.719+0000 7f4b3f038740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d6faef7240 0x55d6faeb1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:12.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.719+0000 7f4b3f038740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6faefa3a0 0x55d6faef08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:12.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.719+0000 7f4b3f038740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6faefc780 0x55d6faef0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:12.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.719+0000 7f4b3f038740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4b340af240 con 0x55d6faefa3a0 2024-09-15T23:16:12.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.719+0000 7f4b3f038740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3414ffc0 con 0x55d6faefc780 2024-09-15T23:16:12.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.719+0000 7f4b3f038740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4b3406d700 con 0x55d6faef7240 2024-09-15T23:16:12.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.719+0000 7f4b39841640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6faefa3a0 0x55d6faef08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:12.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.719+0000 7f4b39841640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6faefa3a0 0x55d6faef08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46682/0 (socket says 172.21.15.123:46682) 2024-09-15T23:16:12.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.719+0000 7f4b39841640 1 -- 172.21.15.123:0/1683814819 learned_addr learned my addr 172.21.15.123:0/1683814819 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:12.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.719+0000 7f4b39841640 1 -- 172.21.15.123:0/1683814819 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d6faef7240 msgr2=0x55d6faeb1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:12.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.719+0000 7f4b39841640 1 --2- 172.21.15.123:0/1683814819 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d6faef7240 0x55d6faeb1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:12.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.719+0000 7f4b39841640 1 -- 172.21.15.123:0/1683814819 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6faefc780 msgr2=0x55d6faef0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:12.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.719+0000 7f4b39841640 1 --2- 172.21.15.123:0/1683814819 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6faefc780 0x55d6faef0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:12.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.719+0000 7f4b39841640 1 -- 172.21.15.123:0/1683814819 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6faac44a0 con 0x55d6faefa3a0 2024-09-15T23:16:12.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.720+0000 7f4b39841640 1 --2- 172.21.15.123:0/1683814819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6faefa3a0 0x55d6faef08b0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f4b24015010 tx=0x7f4b24017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99e2c3c785be178f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:12.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.720+0000 7f4b177fe640 1 -- 172.21.15.123:0/1683814819 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b24005990 con 0x55d6faefa3a0 2024-09-15T23:16:12.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.720+0000 7f4b177fe640 1 -- 172.21.15.123:0/1683814819 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b24005b30 con 0x55d6faefa3a0 2024-09-15T23:16:12.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.720+0000 7f4b177fe640 1 -- 172.21.15.123:0/1683814819 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b24006030 con 0x55d6faefa3a0 2024-09-15T23:16:12.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.720+0000 7f4b3f038740 1 -- 172.21.15.123:0/1683814819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6faefa3a0 msgr2=0x55d6faef08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:12.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.720+0000 7f4b3f038740 1 --2- 172.21.15.123:0/1683814819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6faefa3a0 0x55d6faef08b0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f4b24015010 tx=0x7f4b24017000 comp rx=0 tx=0).stop 2024-09-15T23:16:12.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.720+0000 7f4b3f038740 1 -- 172.21.15.123:0/1683814819 shutdown_connections 2024-09-15T23:16:12.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.720+0000 7f4b3f038740 1 --2- 172.21.15.123:0/1683814819 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6faefc780 0x55d6faef0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:12.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.720+0000 7f4b3f038740 1 --2- 172.21.15.123:0/1683814819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6faefa3a0 0x55d6faef08b0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:12.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.720+0000 7f4b3f038740 1 --2- 172.21.15.123:0/1683814819 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d6faef7240 0x55d6faeb1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:12.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.720+0000 7f4b3f038740 1 -- 172.21.15.123:0/1683814819 >> 172.21.15.123:0/1683814819 conn(0x55d6faef9f40 msgr2=0x55d6faedc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:12.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.720+0000 7f4b3f038740 1 -- 172.21.15.123:0/1683814819 shutdown_connections 2024-09-15T23:16:12.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.720+0000 7f4b3f038740 1 -- 172.21.15.123:0/1683814819 wait complete. 2024-09-15T23:16:12.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.721+0000 7f4b3f038740 1 -- start start 2024-09-15T23:16:12.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.721+0000 7f4b3f038740 1 Processor -- start 2024-09-15T23:16:12.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.722+0000 7f4b3f038740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6faef7240 0x55d6faf1dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:12.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.722+0000 7f4b3f038740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6faefa3a0 0x55d6faf78630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:12.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.722+0000 7f4b3f038740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d6faefc780 0x55d6faf1e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:12.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.722+0000 7f4b3f038740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3414f970 con 0x55d6faef7240 2024-09-15T23:16:12.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.722+0000 7f4b3f038740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55d6fadd03e0 con 0x55d6faefa3a0 2024-09-15T23:16:12.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.722+0000 7f4b3f038740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55d6faedc990 con 0x55d6faefc780 2024-09-15T23:16:12.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.722+0000 7f4b3f038740 10 client.0 _ll_register_callbacks cb 0x7f4b240098a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:16:12.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.722+0000 7f4b3a042640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6faef7240 0x55d6faf1dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:12.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.722+0000 7f4b3a042640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6faef7240 0x55d6faf1dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46698/0 (socket says 172.21.15.123:46698) 2024-09-15T23:16:12.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.722+0000 7f4b3a042640 1 -- 172.21.15.123:0/3206594080 learned_addr learned my addr 172.21.15.123:0/3206594080 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:12.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.722+0000 7f4b3a042640 1 -- 172.21.15.123:0/3206594080 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d6faefc780 msgr2=0x55d6faf1e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:12.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.722+0000 7f4b3a042640 1 --2- 172.21.15.123:0/3206594080 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d6faefc780 0x55d6faf1e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:12.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.722+0000 7f4b3a042640 1 -- 172.21.15.123:0/3206594080 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6faefa3a0 msgr2=0x55d6faf78630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:12.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.722+0000 7f4b3a042640 1 --2- 172.21.15.123:0/3206594080 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6faefa3a0 0x55d6faf78630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:12.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.722+0000 7f4b3a042640 1 -- 172.21.15.123:0/3206594080 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6faedb200 con 0x55d6faef7240 2024-09-15T23:16:12.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.722+0000 7f4b3a042640 1 --2- 172.21.15.123:0/3206594080 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6faef7240 0x55d6faf1dc60 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c0074f0 tx=0x7f4b2c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=478981230ad58d18 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:12.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.722+0000 7f4b157fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:16:12.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.722+0000 7f4b157fa640 1 -- 172.21.15.123:0/3206594080 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c026040 con 0x55d6faef7240 2024-09-15T23:16:12.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.722+0000 7f4b157fa640 1 -- 172.21.15.123:0/3206594080 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 5967+0+0 (secure 0 0 0) 0x7f4b2c0227f0 con 0x55d6faef7240 2024-09-15T23:16:12.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.722+0000 7f4b3f038740 1 -- 172.21.15.123:0/3206594080 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b24005b30 con 0x55d6faef7240 2024-09-15T23:16:12.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.723+0000 7f4b157fa640 1 -- 172.21.15.123:0/3206594080 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f4b2c012560 con 0x55d6faef7240 2024-09-15T23:16:12.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.723+0000 7f4b3f038740 10 client.6990 fetch_fsmap learned FSMap version 53 2024-09-15T23:16:12.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.723+0000 7f4b3f038740 1 -- 172.21.15.123:0/3206594080 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x55d6faefa940 con 0x55d6faef7240 2024-09-15T23:16:12.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.723+0000 7f4b157fa640 1 -- 172.21.15.123:0/3206594080 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b24005b30 con 0x55d6faef7240 2024-09-15T23:16:12.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.723+0000 7f4b157fa640 1 -- 172.21.15.123:0/3206594080 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 53) ==== 3502+0+0 (secure 0 0 0) 0x7f4b2c040070 con 0x55d6faef7240 2024-09-15T23:16:12.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.723+0000 7f4b3f038740 10 client.6990 fetch_fsmap finished waiting for FSMap version 53 2024-09-15T23:16:12.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.723+0000 7f4b3f038740 10 client.6990 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-09-15T23:16:12.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.723+0000 7f4b3f038740 20 client.6990 populate_metadata read hostname 'smithi123' 2024-09-15T23:16:12.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.723+0000 7f4b3f038740 1 --2- 172.21.15.123:0/3206594080 >> [v2:172.21.15.123:6834/3648891779,v1:172.21.15.123:6835/3648891779] conn(0x55d6faedc220 0x55d6faef08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:12.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.723+0000 7f4b3f038740 4 client.6990 mds_command: new command op to 6930 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_repair_path", "scrubops": ["repair"]}] 2024-09-15T23:16:12.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.723+0000 7f4b3f038740 1 -- 172.21.15.123:0/3206594080 --> [v2:172.21.15.123:6834/3648891779,v1:172.21.15.123:6835/3648891779] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_repair_path", "scrubops": ["repair"]}) -- 0x55d6faef2bb0 con 0x55d6faedc220 2024-09-15T23:16:12.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.723+0000 7f4b39841640 1 --2- 172.21.15.123:0/3206594080 >> [v2:172.21.15.123:6834/3648891779,v1:172.21.15.123:6835/3648891779] conn(0x55d6faedc220 0x55d6faef08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:12.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.723+0000 7f4b157fa640 10 client.6990 ms_handle_connect on v2:172.21.15.123:6834/3648891779 2024-09-15T23:16:12.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.723+0000 7f4b39841640 1 --2- 172.21.15.123:0/3206594080 >> [v2:172.21.15.123:6834/3648891779,v1:172.21.15.123:6835/3648891779] conn(0x55d6faedc220 0x55d6faef08b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7283fe6ca591af6 server_cookie=44214ddfbc7b2d96 in_seq=0 out_seq=0 2024-09-15T23:16:12.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.724+0000 7f4b157fa640 1 -- 172.21.15.123:0/3206594080 <== mds.0 v2:172.21.15.123:6834/3648891779 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d6faef2bb0 con 0x55d6faedc220 2024-09-15T23:16:12.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.724+0000 7f4b157fa640 10 client.6990 handle_command_reply: tid=0 2024-09-15T23:16:12.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.724+0000 7f4b3f038740 1 client.6990 shutdown 2024-09-15T23:16:12.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.724+0000 7f4b3f038740 1 -- 172.21.15.123:0/3206594080 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6faef7240 msgr2=0x55d6faf1dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:12.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.724+0000 7f4b3f038740 1 --2- 172.21.15.123:0/3206594080 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6faef7240 0x55d6faf1dc60 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c0074f0 tx=0x7f4b2c001250 comp rx=0 tx=0).stop 2024-09-15T23:16:12.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.724+0000 7f4b3f038740 1 -- 172.21.15.123:0/3206594080 shutdown_connections 2024-09-15T23:16:12.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.724+0000 7f4b3f038740 1 --2- 172.21.15.123:0/3206594080 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d6faefc780 0x55d6faf1e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:12.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.724+0000 7f4b3f038740 1 --2- 172.21.15.123:0/3206594080 >> [v2:172.21.15.123:6834/3648891779,v1:172.21.15.123:6835/3648891779] conn(0x55d6faedc220 0x55d6faef08b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:12.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.724+0000 7f4b3f038740 1 --2- 172.21.15.123:0/3206594080 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d6faefa3a0 0x55d6faf78630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:12.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.724+0000 7f4b3f038740 1 --2- 172.21.15.123:0/3206594080 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6faef7240 0x55d6faf1dc60 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:12.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.724+0000 7f4b157fa640 0 client.6990 ms_handle_reset on v2:172.21.15.123:6834/3648891779 2024-09-15T23:16:12.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.724+0000 7f4b3f038740 1 -- 172.21.15.123:0/3206594080 >> 172.21.15.123:0/3206594080 conn(0x55d6faef9f40 msgr2=0x55d6faeb1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:12.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.724+0000 7f4b3f038740 1 -- 172.21.15.123:0/3206594080 shutdown_connections 2024-09-15T23:16:12.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.724+0000 7f4b3f038740 1 -- 172.21.15.123:0/3206594080 wait complete. 2024-09-15T23:16:12.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.724+0000 7f4b3f038740 20 client.6990 trim_cache size 0 max 16384 2024-09-15T23:16:12.731 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:16:12.731 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0, 2024-09-15T23:16:12.731 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_tag": "498431cb-23b8-48c0-93fe-fccad633f9b6", 2024-09-15T23:16:12.731 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": "asynchronous" 2024-09-15T23:16:12.731 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:16:12.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.725+0000 7f4b3c2a6640 1 -- 172.21.15.123:0/287645921 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4b1806c2b0 msgr2=0x7f4b1806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:12.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.725+0000 7f4b3c2a6640 1 --2- 172.21.15.123:0/287645921 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4b1806c2b0 0x7f4b1806e770 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c0012e0 tx=0x7f4b2c001990 comp rx=0 tx=0).stop 2024-09-15T23:16:12.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.725+0000 7f4b3c2a6640 1 -- 172.21.15.123:0/287645921 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b341f8fa0 msgr2=0x7f4b340afba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:12.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.725+0000 7f4b3c2a6640 1 --2- 172.21.15.123:0/287645921 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b341f8fa0 0x7f4b340afba0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f4b3002a1c0 tx=0x7f4b300046c0 comp rx=0 tx=0).stop 2024-09-15T23:16:12.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.725+0000 7f4b3c2a6640 1 -- 172.21.15.123:0/287645921 shutdown_connections 2024-09-15T23:16:12.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.725+0000 7f4b3c2a6640 1 --2- 172.21.15.123:0/287645921 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4b1806c2b0 0x7f4b1806e770 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:12.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.725+0000 7f4b3c2a6640 1 --2- 172.21.15.123:0/287645921 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b341f8fa0 0x7f4b340afba0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:12.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.725+0000 7f4b3c2a6640 1 --2- 172.21.15.123:0/287645921 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4b3415c520 0x7f4b3415ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:12.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.725+0000 7f4b3c2a6640 1 --2- 172.21.15.123:0/287645921 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4b340b48f0 0x7f4b341f5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:12.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.725+0000 7f4b3c2a6640 1 -- 172.21.15.123:0/287645921 >> 172.21.15.123:0/287645921 conn(0x7f4b34067950 msgr2=0x7f4b3415ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:12.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.725+0000 7f4b3c2a6640 1 -- 172.21.15.123:0/287645921 shutdown_connections 2024-09-15T23:16:12.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:12.725+0000 7f4b3c2a6640 1 -- 172.21.15.123:0/287645921 wait complete. 2024-09-15T23:16:12.737 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_repair_path repair' returned '{'return_code': 0, 'scrub_tag': '498431cb-23b8-48c0-93fe-fccad633f9b6', 'mode': 'asynchronous'}' 2024-09-15T23:16:22.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:16:22.738 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir scrub_repair_path) 2024-09-15T23:16:22.760 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:16:22.760 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:16:22.841 DEBUG:teuthology.orchestra.run.smithi188:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:16:22.884 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:16:22.884 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:16:22.884 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:16:22.884 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:16:22.904 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:16:22.904 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:16:22.963 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:16:23.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.118+0000 7ff0b8726640 1 Processor -- start 2024-09-15T23:16:23.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.118+0000 7ff0b8726640 1 -- start start 2024-09-15T23:16:23.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.119+0000 7ff0b8726640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff0b00cc1c0 0x7ff0b00cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:23.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.119+0000 7ff0b8726640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff0b00cefa0 0x7ff0b00cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:23.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.119+0000 7ff0b8726640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0b00cf910 con 0x7ff0b015e960 2024-09-15T23:16:23.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.119+0000 7ff0b8726640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7ff0b006d080 con 0x7ff0b00cc1c0 2024-09-15T23:16:23.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.119+0000 7ff0b8726640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7ff0b006d360 con 0x7ff0b00cefa0 2024-09-15T23:16:23.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.119+0000 7ff0b5cc1640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff0b00cc1c0 0x7ff0b00cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:23.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.120+0000 7ff0b5cc1640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff0b00cc1c0 0x7ff0b00cc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43992/0 (socket says 172.21.15.123:43992) 2024-09-15T23:16:23.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.120+0000 7ff0b5cc1640 1 -- 172.21.15.123:0/1133582200 learned_addr learned my addr 172.21.15.123:0/1133582200 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:23.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.120+0000 7ff0b5cc1640 1 -- 172.21.15.123:0/1133582200 >> v2:172.21.15.188:3300/0 conn(0x7ff0b00cefa0 msgr2=0x7ff0b00cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:23.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.120+0000 7ff0b6cc3640 1 --2- 172.21.15.123:0/1133582200 >> v2:172.21.15.188:3300/0 conn(0x7ff0b00cefa0 0x7ff0b00cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:23.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.120+0000 7ff0b5cc1640 1 --2- 172.21.15.123:0/1133582200 >> v2:172.21.15.188:3300/0 conn(0x7ff0b00cefa0 0x7ff0b00cf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:23.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.120+0000 7ff0b5cc1640 1 -- 172.21.15.123:0/1133582200 >> v1:172.21.15.188:6789/0 conn(0x7ff0b015e960 legacy=0x7ff0b00d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:23.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.120+0000 7ff0b5cc1640 1 -- 172.21.15.123:0/1133582200 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0b006d640 con 0x7ff0b00cc1c0 2024-09-15T23:16:23.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.121+0000 7ff0b5cc1640 1 --2- 172.21.15.123:0/1133582200 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0b00cc1c0 0x7ff0b00cc610 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7ff0b006f0c0 tx=0x7ff0a002a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=980c7a675640bfed server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:23.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.121+0000 7ff0b54c0640 1 -- 172.21.15.123:0/1133582200 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0037070 con 0x7ff0b00cc1c0 2024-09-15T23:16:23.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.121+0000 7ff0b54c0640 1 -- 172.21.15.123:0/1133582200 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0a0032440 con 0x7ff0b00cc1c0 2024-09-15T23:16:23.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.121+0000 7ff0b54c0640 1 -- 172.21.15.123:0/1133582200 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0032810 con 0x7ff0b00cc1c0 2024-09-15T23:16:23.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.121+0000 7ff0b8726640 1 -- 172.21.15.123:0/1133582200 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0b00cc1c0 msgr2=0x7ff0b00cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:23.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.121+0000 7ff0b8726640 1 --2- 172.21.15.123:0/1133582200 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0b00cc1c0 0x7ff0b00cc610 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7ff0b006f0c0 tx=0x7ff0a002a160 comp rx=0 tx=0).stop 2024-09-15T23:16:23.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.121+0000 7ff0b8726640 1 -- 172.21.15.123:0/1133582200 shutdown_connections 2024-09-15T23:16:23.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.121+0000 7ff0b8726640 1 --2- 172.21.15.123:0/1133582200 >> v2:172.21.15.188:3300/0 conn(0x7ff0b00cefa0 0x7ff0b00cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:23.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.121+0000 7ff0b8726640 1 --2- 172.21.15.123:0/1133582200 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0b00cc1c0 0x7ff0b00cc610 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:23.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.121+0000 7ff0b8726640 1 -- 172.21.15.123:0/1133582200 >> 172.21.15.123:0/1133582200 conn(0x7ff0b00b4300 msgr2=0x7ff0b00b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:23.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.121+0000 7ff0b8726640 1 -- 172.21.15.123:0/1133582200 shutdown_connections 2024-09-15T23:16:23.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.121+0000 7ff0b8726640 1 -- 172.21.15.123:0/1133582200 wait complete. 2024-09-15T23:16:23.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.123+0000 7ff0b8726640 1 Processor -- start 2024-09-15T23:16:23.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.123+0000 7ff0b8726640 1 -- start start 2024-09-15T23:16:23.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.123+0000 7ff0b8726640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0b00cc1c0 0x7ff0b01f46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:23.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.123+0000 7ff0b8726640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0b00cefa0 0x7ff0b0151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:23.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.123+0000 7ff0b8726640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0b015e960 0x7ff0b01524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:23.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.123+0000 7ff0b8726640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b00d0a10 con 0x7ff0b00cc1c0 2024-09-15T23:16:23.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.123+0000 7ff0b8726640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b015ed40 con 0x7ff0b015e960 2024-09-15T23:16:23.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.123+0000 7ff0b8726640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ff0b0073520 con 0x7ff0b00cefa0 2024-09-15T23:16:23.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.124+0000 7ff0b64c2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0b00cc1c0 0x7ff0b01f46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:23.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.124+0000 7ff0b64c2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0b00cc1c0 0x7ff0b01f46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43994/0 (socket says 172.21.15.123:43994) 2024-09-15T23:16:23.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.124+0000 7ff0b64c2640 1 -- 172.21.15.123:0/3623938755 learned_addr learned my addr 172.21.15.123:0/3623938755 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:23.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.124+0000 7ff0b6cc3640 1 --2- 172.21.15.123:0/3623938755 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0b015e960 0x7ff0b01524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:23.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.124+0000 7ff0b64c2640 1 -- 172.21.15.123:0/3623938755 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0b00cefa0 msgr2=0x7ff0b0151fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:23.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.124+0000 7ff0b64c2640 1 --2- 172.21.15.123:0/3623938755 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0b00cefa0 0x7ff0b0151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:23.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.124+0000 7ff0b64c2640 1 -- 172.21.15.123:0/3623938755 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0b015e960 msgr2=0x7ff0b01524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:23.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.124+0000 7ff0b64c2640 1 --2- 172.21.15.123:0/3623938755 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0b015e960 0x7ff0b01524f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:23.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.124+0000 7ff0b64c2640 1 -- 172.21.15.123:0/3623938755 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0b0156bc0 con 0x7ff0b00cc1c0 2024-09-15T23:16:23.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.124+0000 7ff0b64c2640 1 --2- 172.21.15.123:0/3623938755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0b00cc1c0 0x7ff0b01f46b0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac00b3f0 tx=0x7ff0ac00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:23.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.124+0000 7ff0a6ffd640 1 -- 172.21.15.123:0/3623938755 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac015020 con 0x7ff0b00cc1c0 2024-09-15T23:16:23.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.124+0000 7ff0a6ffd640 1 -- 172.21.15.123:0/3623938755 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0ac011830 con 0x7ff0b00cc1c0 2024-09-15T23:16:23.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.124+0000 7ff0a6ffd640 1 -- 172.21.15.123:0/3623938755 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac011c20 con 0x7ff0b00cc1c0 2024-09-15T23:16:23.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.124+0000 7ff0b8726640 1 -- 172.21.15.123:0/3623938755 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0b0156ea0 con 0x7ff0b00cc1c0 2024-09-15T23:16:23.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.124+0000 7ff0b8726640 1 -- 172.21.15.123:0/3623938755 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0b00b7fa0 con 0x7ff0b00cc1c0 2024-09-15T23:16:23.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.125+0000 7ff0b8726640 1 -- 172.21.15.123:0/3623938755 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0b01601b0 con 0x7ff0b00cc1c0 2024-09-15T23:16:23.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.126+0000 7ff0a6ffd640 1 -- 172.21.15.123:0/3623938755 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff0ac018020 con 0x7ff0b00cc1c0 2024-09-15T23:16:23.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.126+0000 7ff0a6ffd640 1 --2- 172.21.15.123:0/3623938755 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff09406c2e0 0x7ff09406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:23.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.126+0000 7ff0a6ffd640 1 -- 172.21.15.123:0/3623938755 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5967+0+0 (secure 0 0 0) 0x7ff0ac08b0a0 con 0x7ff0b00cc1c0 2024-09-15T23:16:23.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.126+0000 7ff0b5cc1640 1 --2- 172.21.15.123:0/3623938755 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff09406c2e0 0x7ff09406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:23.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.127+0000 7ff0b5cc1640 1 --2- 172.21.15.123:0/3623938755 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff09406c2e0 0x7ff09406e7a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0034000 tx=0x7ff0a002c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:23.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.131+0000 7ff0a6ffd640 1 -- 172.21.15.123:0/3623938755 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff0ac01f030 con 0x7ff0b00cc1c0 2024-09-15T23:16:23.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.310+0000 7ff0b8726640 1 -- 172.21.15.123:0/3623938755 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff0b00cf3d0 con 0x7ff0b00cc1c0 2024-09-15T23:16:23.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.311+0000 7ff0a6ffd640 1 -- 172.21.15.123:0/3623938755 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v86) ==== 80+0+370 (secure 0 0 0) 0x7ff0ac0172c0 con 0x7ff0b00cc1c0 2024-09-15T23:16:23.312 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.188:6837/2597191885 2024-09-16T23:16:07.004532+0000 2024-09-15T23:16:23.312 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.188:6835/2597191885 2024-09-16T23:16:07.004532+0000 2024-09-15T23:16:23.312 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6834/3814257760 2024-09-16T23:16:06.705374+0000 2024-09-15T23:16:23.312 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6832/3814257760 2024-09-16T23:16:06.705374+0000 2024-09-15T23:16:23.312 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6835/839817134 2024-09-16T23:16:06.696474+0000 2024-09-15T23:16:23.312 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6833/839817134 2024-09-16T23:16:06.696474+0000 2024-09-15T23:16:23.313 INFO:teuthology.orchestra.run.smithi123.stderr:listed 6 entries 2024-09-15T23:16:23.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.313+0000 7ff0b8726640 1 -- 172.21.15.123:0/3623938755 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff09406c2e0 msgr2=0x7ff09406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:23.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.313+0000 7ff0b8726640 1 --2- 172.21.15.123:0/3623938755 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff09406c2e0 0x7ff09406e7a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0034000 tx=0x7ff0a002c000 comp rx=0 tx=0).stop 2024-09-15T23:16:23.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.313+0000 7ff0b8726640 1 -- 172.21.15.123:0/3623938755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0b00cc1c0 msgr2=0x7ff0b01f46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:23.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.313+0000 7ff0b8726640 1 --2- 172.21.15.123:0/3623938755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0b00cc1c0 0x7ff0b01f46b0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac00b3f0 tx=0x7ff0ac00b8b0 comp rx=0 tx=0).stop 2024-09-15T23:16:23.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.313+0000 7ff0b8726640 1 -- 172.21.15.123:0/3623938755 shutdown_connections 2024-09-15T23:16:23.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.313+0000 7ff0b8726640 1 --2- 172.21.15.123:0/3623938755 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0b015e960 0x7ff0b01524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:23.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.313+0000 7ff0b8726640 1 --2- 172.21.15.123:0/3623938755 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff0b00cefa0 0x7ff0b0151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:23.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.313+0000 7ff0b8726640 1 --2- 172.21.15.123:0/3623938755 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff09406c2e0 0x7ff09406e7a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:23.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.313+0000 7ff0b8726640 1 --2- 172.21.15.123:0/3623938755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0b00cc1c0 0x7ff0b01f46b0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:23.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.313+0000 7ff0b8726640 1 -- 172.21.15.123:0/3623938755 >> 172.21.15.123:0/3623938755 conn(0x7ff0b00b4300 msgr2=0x7ff0b00d2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:23.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.313+0000 7ff0b8726640 1 -- 172.21.15.123:0/3623938755 shutdown_connections 2024-09-15T23:16:23.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.313+0000 7ff0b8726640 1 -- 172.21.15.123:0/3623938755 wait complete. 2024-09-15T23:16:23.325 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-15T23:16:23.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:16:23.325 DEBUG:teuthology.orchestra.run.smithi123:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-15T23:16:23.355 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-09-15T23:16:23.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:16:23.355 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T23:16:23.410 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:16:23.410 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:16:23.411 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:16:23.430 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:16:23.430 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:16:23.430 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:16:23.430 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:16:23.468 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:16:23.468 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:16:23.468 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:16:23.468 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:16:23.489 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:16:23.489 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:16:23.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.605+0000 7f8f2241e640 1 Processor -- start 2024-09-15T23:16:23.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.605+0000 7f8f2241e640 1 -- start start 2024-09-15T23:16:23.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.606+0000 7f8f2241e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8f1c162c60 0x7f8f1c073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:23.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.606+0000 7f8f2241e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8f1c06f730 0x7f8f1c06fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:23.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.606+0000 7f8f2241e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f1c1631c0 con 0x7f8f1c15e790 2024-09-15T23:16:23.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.606+0000 7f8f2241e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f8f1c15eb70 con 0x7f8f1c162c60 2024-09-15T23:16:23.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.606+0000 7f8f2241e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8f1c0ae9a0 con 0x7f8f1c06f730 2024-09-15T23:16:23.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.606+0000 7f8f1bfff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8f1c15e790 0x7f8f1c0b5430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58112/0 (socket says 172.21.15.123:58112) 2024-09-15T23:16:23.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.606+0000 7f8f1bfff640 1 -- 172.21.15.123:0/3934607737 learned_addr learned my addr 172.21.15.123:0/3934607737 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:23.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.606+0000 7f8f1b7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8f1c162c60 0x7f8f1c073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:23.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.606+0000 7f8f1b7fe640 1 -- 172.21.15.123:0/3934607737 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8f1c06f730 msgr2=0x7f8f1c06fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:23.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.606+0000 7f8f1b7fe640 1 --2- 172.21.15.123:0/3934607737 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8f1c06f730 0x7f8f1c06fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:23.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.606+0000 7f8f1b7fe640 1 -- 172.21.15.123:0/3934607737 >> v1:172.21.15.123:6789/0 conn(0x7f8f1c15e790 legacy=0x7f8f1c0b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:23.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.606+0000 7f8f1b7fe640 1 -- 172.21.15.123:0/3934607737 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f1c0aec40 con 0x7f8f1c162c60 2024-09-15T23:16:23.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.606+0000 7f8f1affd640 1 -- 172.21.15.123:0/3934607737 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 571423068 0 0) 0x7f8f1c1631c0 con 0x7f8f1c15e790 2024-09-15T23:16:23.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.607+0000 7f8f1b7fe640 1 --2- 172.21.15.123:0/3934607737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f1c162c60 0x7f8f1c073a40 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f8f100097a0 tx=0x7f8f1002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b34f2e04d972a190 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:23.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.607+0000 7f8f1affd640 1 -- 172.21.15.123:0/3934607737 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f10037070 con 0x7f8f1c162c60 2024-09-15T23:16:23.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.607+0000 7f8f1affd640 1 -- 172.21.15.123:0/3934607737 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f1002ae50 con 0x7f8f1c162c60 2024-09-15T23:16:23.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.607+0000 7f8f1affd640 1 -- 172.21.15.123:0/3934607737 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f10032660 con 0x7f8f1c162c60 2024-09-15T23:16:23.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.608+0000 7f8f2241e640 1 -- 172.21.15.123:0/3934607737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f1c162c60 msgr2=0x7f8f1c073a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:23.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.608+0000 7f8f2241e640 1 --2- 172.21.15.123:0/3934607737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f1c162c60 0x7f8f1c073a40 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f8f100097a0 tx=0x7f8f1002a100 comp rx=0 tx=0).stop 2024-09-15T23:16:23.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.608+0000 7f8f2241e640 1 -- 172.21.15.123:0/3934607737 shutdown_connections 2024-09-15T23:16:23.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.608+0000 7f8f2241e640 1 --2- 172.21.15.123:0/3934607737 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8f1c06f730 0x7f8f1c06fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:23.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.608+0000 7f8f2241e640 1 --2- 172.21.15.123:0/3934607737 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f1c162c60 0x7f8f1c073a40 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:23.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.608+0000 7f8f2241e640 1 -- 172.21.15.123:0/3934607737 >> 172.21.15.123:0/3934607737 conn(0x7f8f1c0b0a80 msgr2=0x7f8f1c0b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:23.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.608+0000 7f8f2241e640 1 -- 172.21.15.123:0/3934607737 shutdown_connections 2024-09-15T23:16:23.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.608+0000 7f8f2241e640 1 -- 172.21.15.123:0/3934607737 wait complete. 2024-09-15T23:16:23.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.609+0000 7f8f2241e640 1 Processor -- start 2024-09-15T23:16:23.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.609+0000 7f8f2241e640 1 -- start start 2024-09-15T23:16:23.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.610+0000 7f8f2241e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f1c06f730 0x7f8f1c154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:23.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.610+0000 7f8f2241e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8f1c15e790 0x7f8f1c1580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:23.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.610+0000 7f8f2241e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f1c162c60 0x7f8f1c153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:23.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.610+0000 7f8f2241e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1c0b5b40 con 0x7f8f1c06f730 2024-09-15T23:16:23.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.610+0000 7f8f2241e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1c0af200 con 0x7f8f1c162c60 2024-09-15T23:16:23.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.610+0000 7f8f2241e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8f1c06f430 con 0x7f8f1c15e790 2024-09-15T23:16:23.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.610+0000 7f8f1bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f1c06f730 0x7f8f1c154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:23.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.610+0000 7f8f1bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f1c06f730 0x7f8f1c154380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44006/0 (socket says 172.21.15.123:44006) 2024-09-15T23:16:23.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.610+0000 7f8f1bfff640 1 -- 172.21.15.123:0/1583276138 learned_addr learned my addr 172.21.15.123:0/1583276138 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:23.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.610+0000 7f8f1b7fe640 1 --2- 172.21.15.123:0/1583276138 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8f1c15e790 0x7f8f1c1580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:23.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.610+0000 7f8f209bb640 1 --2- 172.21.15.123:0/1583276138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f1c162c60 0x7f8f1c153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:23.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.610+0000 7f8f1bfff640 1 -- 172.21.15.123:0/1583276138 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8f1c15e790 msgr2=0x7f8f1c1580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:23.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.610+0000 7f8f1bfff640 1 --2- 172.21.15.123:0/1583276138 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8f1c15e790 0x7f8f1c1580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:23.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.610+0000 7f8f1bfff640 1 -- 172.21.15.123:0/1583276138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f1c162c60 msgr2=0x7f8f1c153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:23.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.610+0000 7f8f1bfff640 1 --2- 172.21.15.123:0/1583276138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f1c162c60 0x7f8f1c153b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:23.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.610+0000 7f8f1bfff640 1 -- 172.21.15.123:0/1583276138 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f1c1f7b50 con 0x7f8f1c06f730 2024-09-15T23:16:23.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.610+0000 7f8f1b7fe640 1 --2- 172.21.15.123:0/1583276138 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8f1c15e790 0x7f8f1c1580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:16:23.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.610+0000 7f8f209bb640 1 --2- 172.21.15.123:0/1583276138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f1c162c60 0x7f8f1c153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:16:23.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.610+0000 7f8f1bfff640 1 --2- 172.21.15.123:0/1583276138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f1c06f730 0x7f8f1c154380 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c00c500 tx=0x7f8f0c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:23.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.610+0000 7f8f18ff9640 1 -- 172.21.15.123:0/1583276138 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c018070 con 0x7f8f1c06f730 2024-09-15T23:16:23.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.610+0000 7f8f18ff9640 1 -- 172.21.15.123:0/1583276138 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f0c007580 con 0x7f8f1c06f730 2024-09-15T23:16:23.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.610+0000 7f8f2241e640 1 -- 172.21.15.123:0/1583276138 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f1c1f7e30 con 0x7f8f1c06f730 2024-09-15T23:16:23.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.610+0000 7f8f18ff9640 1 -- 172.21.15.123:0/1583276138 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c004a20 con 0x7f8f1c06f730 2024-09-15T23:16:23.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.611+0000 7f8f2241e640 1 -- 172.21.15.123:0/1583276138 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f1c1f83f0 con 0x7f8f1c06f730 2024-09-15T23:16:23.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.612+0000 7f8f2241e640 1 -- 172.21.15.123:0/1583276138 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f1c1585e0 con 0x7f8f1c06f730 2024-09-15T23:16:23.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.612+0000 7f8f18ff9640 1 -- 172.21.15.123:0/1583276138 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8f0c01b070 con 0x7f8f1c06f730 2024-09-15T23:16:23.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.612+0000 7f8f18ff9640 1 --2- 172.21.15.123:0/1583276138 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8f0806c2b0 0x7f8f0806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:23.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.612+0000 7f8f18ff9640 1 -- 172.21.15.123:0/1583276138 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5967+0+0 (secure 0 0 0) 0x7f8f0c08a7a0 con 0x7f8f1c06f730 2024-09-15T23:16:23.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.613+0000 7f8f1b7fe640 1 --2- 172.21.15.123:0/1583276138 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8f0806c2b0 0x7f8f0806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:23.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.613+0000 7f8f1b7fe640 1 --2- 172.21.15.123:0/1583276138 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8f0806c2b0 0x7f8f0806e770 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8f10034000 tx=0x7f8f1002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:23.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.616+0000 7f8f18ff9640 1 -- 172.21.15.123:0/1583276138 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8f1c1585e0 con 0x7f8f1c06f730 2024-09-15T23:16:23.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.816+0000 7f8f2241e640 1 -- 172.21.15.123:0/1583276138 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8f1c073a40 con 0x7f8f1c06f730 2024-09-15T23:16:23.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.816+0000 7f8f18ff9640 1 -- 172.21.15.123:0/1583276138 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5238 (secure 0 0 0) 0x7f8f0c058ea0 con 0x7f8f1c06f730 2024-09-15T23:16:23.818 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:16:23.818 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":53,"btime":"2024-09-15T23:16:10:023819+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/2007918144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2007918144},{"type":"v1","addr":"172.21.15.188:6835","nonce":2007918144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":6199,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2540326254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":2540326254},{"type":"v1","addr":"172.21.15.188:6837","nonce":2540326254}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6918,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/1092174152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":1092174152},{"type":"v1","addr":"172.21.15.123:6833","nonce":1092174152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:15:54.225983+0000","modified":"2024-09-15T23:16:10.023816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6930":{"gid":6930,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6835/3648891779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3648891779},{"type":"v1","addr":"172.21.15.123:6835","nonce":3648891779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6930,"qdb_cluster":[6930]},"id":5}]} 2024-09-15T23:16:23.818 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 53 2024-09-15T23:16:23.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.818+0000 7f8f2241e640 1 -- 172.21.15.123:0/1583276138 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8f0806c2b0 msgr2=0x7f8f0806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:23.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.818+0000 7f8f2241e640 1 --2- 172.21.15.123:0/1583276138 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8f0806c2b0 0x7f8f0806e770 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8f10034000 tx=0x7f8f1002e000 comp rx=0 tx=0).stop 2024-09-15T23:16:23.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.818+0000 7f8f2241e640 1 -- 172.21.15.123:0/1583276138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f1c06f730 msgr2=0x7f8f1c154380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:23.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.818+0000 7f8f2241e640 1 --2- 172.21.15.123:0/1583276138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f1c06f730 0x7f8f1c154380 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c00c500 tx=0x7f8f0c00c9c0 comp rx=0 tx=0).stop 2024-09-15T23:16:23.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.818+0000 7f8f2241e640 1 -- 172.21.15.123:0/1583276138 shutdown_connections 2024-09-15T23:16:23.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.818+0000 7f8f2241e640 1 --2- 172.21.15.123:0/1583276138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f1c162c60 0x7f8f1c153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:23.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.818+0000 7f8f2241e640 1 --2- 172.21.15.123:0/1583276138 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8f1c15e790 0x7f8f1c1580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:23.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.818+0000 7f8f2241e640 1 --2- 172.21.15.123:0/1583276138 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8f0806c2b0 0x7f8f0806e770 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:23.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.818+0000 7f8f2241e640 1 --2- 172.21.15.123:0/1583276138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f1c06f730 0x7f8f1c154380 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:23.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.818+0000 7f8f2241e640 1 -- 172.21.15.123:0/1583276138 >> 172.21.15.123:0/1583276138 conn(0x7f8f1c0b0a80 msgr2=0x7f8f1c0b1370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:23.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.818+0000 7f8f2241e640 1 -- 172.21.15.123:0/1583276138 shutdown_connections 2024-09-15T23:16:23.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.818+0000 7f8f2241e640 1 -- 172.21.15.123:0/1583276138 wait complete. 2024-09-15T23:16:23.831 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:16:23.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.927+0000 7fc7c88c9640 1 Processor -- start 2024-09-15T23:16:23.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.927+0000 7fc7c88c9640 1 -- start start 2024-09-15T23:16:23.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.928+0000 7fc7c88c9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc7c415ed20 0x7fc7c40b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:23.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.928+0000 7fc7c88c9640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc7c40d23b0 0x7fc7c40b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:23.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.928+0000 7fc7c88c9640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7c40d0e70 con 0x7fc7c40cf2d0 2024-09-15T23:16:23.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.928+0000 7fc7c88c9640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fc7c40d41c0 con 0x7fc7c40d23b0 2024-09-15T23:16:23.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.928+0000 7fc7c88c9640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc7c40d35b0 con 0x7fc7c415ed20 2024-09-15T23:16:23.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.928+0000 7fc7c259c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc7c415ed20 0x7fc7c40b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:23.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.928+0000 7fc7c1d9b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc7c40d23b0 0x7fc7c40b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:23.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.928+0000 7fc7c259c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc7c415ed20 0x7fc7c40b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:32980/0 (socket says 172.21.15.123:32980) 2024-09-15T23:16:23.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.928+0000 7fc7c259c640 1 -- 172.21.15.123:0/2712144948 learned_addr learned my addr 172.21.15.123:0/2712144948 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:23.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.928+0000 7fc7c259c640 1 -- 172.21.15.123:0/2712144948 >> v2:172.21.15.188:3300/0 conn(0x7fc7c40d23b0 msgr2=0x7fc7c40b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:23.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.928+0000 7fc7c259c640 1 --2- 172.21.15.123:0/2712144948 >> v2:172.21.15.188:3300/0 conn(0x7fc7c40d23b0 0x7fc7c40b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:23.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.928+0000 7fc7c259c640 1 -- 172.21.15.123:0/2712144948 >> v1:172.21.15.188:6789/0 conn(0x7fc7c40cf2d0 legacy=0x7fc7c40cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:23.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.928+0000 7fc7c259c640 1 -- 172.21.15.123:0/2712144948 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c40d3890 con 0x7fc7c415ed20 2024-09-15T23:16:23.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.928+0000 7fc7c1d9b640 1 --2- 172.21.15.123:0/2712144948 >> v2:172.21.15.188:3300/0 conn(0x7fc7c40d23b0 0x7fc7c40b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:16:23.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.929+0000 7fc7c259c640 1 --2- 172.21.15.123:0/2712144948 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc7c415ed20 0x7fc7c40b6260 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009e50 tx=0x7fc7bc02a730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e46b3d66e792d66 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:23.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.929+0000 7fc7c159a640 1 -- 172.21.15.123:0/2712144948 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc036070 con 0x7fc7c415ed20 2024-09-15T23:16:23.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.929+0000 7fc7c159a640 1 -- 172.21.15.123:0/2712144948 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7bc031600 con 0x7fc7c415ed20 2024-09-15T23:16:23.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.929+0000 7fc7c159a640 1 -- 172.21.15.123:0/2712144948 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc0319d0 con 0x7fc7c415ed20 2024-09-15T23:16:23.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.930+0000 7fc7c88c9640 1 -- 172.21.15.123:0/2712144948 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc7c415ed20 msgr2=0x7fc7c40b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:23.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.930+0000 7fc7c88c9640 1 --2- 172.21.15.123:0/2712144948 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc7c415ed20 0x7fc7c40b6260 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009e50 tx=0x7fc7bc02a730 comp rx=0 tx=0).stop 2024-09-15T23:16:23.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.930+0000 7fc7c88c9640 1 -- 172.21.15.123:0/2712144948 shutdown_connections 2024-09-15T23:16:23.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.930+0000 7fc7c88c9640 1 --2- 172.21.15.123:0/2712144948 >> v2:172.21.15.188:3300/0 conn(0x7fc7c40d23b0 0x7fc7c40b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:23.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.930+0000 7fc7c88c9640 1 --2- 172.21.15.123:0/2712144948 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc7c415ed20 0x7fc7c40b6260 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:23.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.930+0000 7fc7c88c9640 1 -- 172.21.15.123:0/2712144948 >> 172.21.15.123:0/2712144948 conn(0x7fc7c40d1260 msgr2=0x7fc7c40d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:23.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.930+0000 7fc7c88c9640 1 -- 172.21.15.123:0/2712144948 shutdown_connections 2024-09-15T23:16:23.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.930+0000 7fc7c88c9640 1 -- 172.21.15.123:0/2712144948 wait complete. 2024-09-15T23:16:23.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.931+0000 7fc7c88c9640 1 Processor -- start 2024-09-15T23:16:23.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.931+0000 7fc7c88c9640 1 -- start start 2024-09-15T23:16:23.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.932+0000 7fc7c88c9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc7c40cf2d0 0x7fc7c41e8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:23.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.932+0000 7fc7c88c9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7c40d23b0 0x7fc7c40caf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:23.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.932+0000 7fc7c88c9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc7c415ed20 0x7fc7c41f7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:23.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.932+0000 7fc7c88c9640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c40d32a0 con 0x7fc7c40d23b0 2024-09-15T23:16:23.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.932+0000 7fc7c88c9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc7c40d3e50 con 0x7fc7c40cf2d0 2024-09-15T23:16:23.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.932+0000 7fc7c88c9640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc7c415f100 con 0x7fc7c415ed20 2024-09-15T23:16:23.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.932+0000 7fc7c1d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7c40d23b0 0x7fc7c40caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:23.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.932+0000 7fc7c1d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7c40d23b0 0x7fc7c40caf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44010/0 (socket says 172.21.15.123:44010) 2024-09-15T23:16:23.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.932+0000 7fc7c1d9b640 1 -- 172.21.15.123:0/452534778 learned_addr learned my addr 172.21.15.123:0/452534778 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:23.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.932+0000 7fc7c259c640 1 --2- 172.21.15.123:0/452534778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc7c40cf2d0 0x7fc7c41e8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:23.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.932+0000 7fc7c2d9d640 1 --2- 172.21.15.123:0/452534778 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc7c415ed20 0x7fc7c41f7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:23.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.932+0000 7fc7c1d9b640 1 -- 172.21.15.123:0/452534778 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc7c415ed20 msgr2=0x7fc7c41f7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:23.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.932+0000 7fc7c1d9b640 1 --2- 172.21.15.123:0/452534778 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc7c415ed20 0x7fc7c41f7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:23.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.932+0000 7fc7c1d9b640 1 -- 172.21.15.123:0/452534778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc7c40cf2d0 msgr2=0x7fc7c41e8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:23.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.932+0000 7fc7c1d9b640 1 --2- 172.21.15.123:0/452534778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc7c40cf2d0 0x7fc7c41e8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:23.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.932+0000 7fc7c1d9b640 1 -- 172.21.15.123:0/452534778 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7c41e8b50 con 0x7fc7c40d23b0 2024-09-15T23:16:23.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.932+0000 7fc7c1d9b640 1 --2- 172.21.15.123:0/452534778 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7c40d23b0 0x7fc7c40caf00 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac00ebb0 tx=0x7fc7ac00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:23.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.933+0000 7fc7baffd640 1 -- 172.21.15.123:0/452534778 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac017070 con 0x7fc7c40d23b0 2024-09-15T23:16:23.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.933+0000 7fc7baffd640 1 -- 172.21.15.123:0/452534778 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7ac00cc30 con 0x7fc7c40d23b0 2024-09-15T23:16:23.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.933+0000 7fc7c88c9640 1 -- 172.21.15.123:0/452534778 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7c41e8e30 con 0x7fc7c40d23b0 2024-09-15T23:16:23.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.933+0000 7fc7baffd640 1 -- 172.21.15.123:0/452534778 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac013470 con 0x7fc7c40d23b0 2024-09-15T23:16:23.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.933+0000 7fc7c88c9640 1 -- 172.21.15.123:0/452534778 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7c41e93f0 con 0x7fc7c40d23b0 2024-09-15T23:16:23.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.934+0000 7fc7c88c9640 1 -- 172.21.15.123:0/452534778 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7c40b7010 con 0x7fc7c40d23b0 2024-09-15T23:16:23.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.934+0000 7fc7baffd640 1 -- 172.21.15.123:0/452534778 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc7ac01a070 con 0x7fc7c40d23b0 2024-09-15T23:16:23.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.934+0000 7fc7baffd640 1 --2- 172.21.15.123:0/452534778 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc7a406c2e0 0x7fc7a406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:23.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.935+0000 7fc7baffd640 1 -- 172.21.15.123:0/452534778 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5967+0+0 (secure 0 0 0) 0x7fc7ac08b750 con 0x7fc7c40d23b0 2024-09-15T23:16:23.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.935+0000 7fc7c259c640 1 --2- 172.21.15.123:0/452534778 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc7a406c2e0 0x7fc7a406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:23.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.935+0000 7fc7c259c640 1 --2- 172.21.15.123:0/452534778 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc7a406c2e0 0x7fc7a406e7a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc033000 tx=0x7fc7bc009000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:23.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:23.939+0000 7fc7baffd640 1 -- 172.21.15.123:0/452534778 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc7ac059770 con 0x7fc7c40d23b0 2024-09-15T23:16:24.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.143+0000 7fc7c88c9640 1 -- 172.21.15.123:0/452534778 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7c40b3f20 con 0x7fc7c40d23b0 2024-09-15T23:16:24.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.144+0000 7fc7baffd640 1 -- 172.21.15.123:0/452534778 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5238 (secure 0 0 0) 0x7fc7ac05da70 con 0x7fc7c40d23b0 2024-09-15T23:16:24.145 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:16:24.145 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":53,"btime":"2024-09-15T23:16:10:023819+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/2007918144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2007918144},{"type":"v1","addr":"172.21.15.188:6835","nonce":2007918144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":6199,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2540326254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":2540326254},{"type":"v1","addr":"172.21.15.188:6837","nonce":2540326254}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6918,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/1092174152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":1092174152},{"type":"v1","addr":"172.21.15.123:6833","nonce":1092174152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:15:54.225983+0000","modified":"2024-09-15T23:16:10.023816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6930":{"gid":6930,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6835/3648891779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3648891779},{"type":"v1","addr":"172.21.15.123:6835","nonce":3648891779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6930,"qdb_cluster":[6930]},"id":5}]} 2024-09-15T23:16:24.145 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 53 2024-09-15T23:16:24.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.146+0000 7fc7c88c9640 1 -- 172.21.15.123:0/452534778 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc7a406c2e0 msgr2=0x7fc7a406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:24.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.146+0000 7fc7c88c9640 1 --2- 172.21.15.123:0/452534778 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc7a406c2e0 0x7fc7a406e7a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc033000 tx=0x7fc7bc009000 comp rx=0 tx=0).stop 2024-09-15T23:16:24.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.146+0000 7fc7c88c9640 1 -- 172.21.15.123:0/452534778 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7c40d23b0 msgr2=0x7fc7c40caf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:24.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.146+0000 7fc7c88c9640 1 --2- 172.21.15.123:0/452534778 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7c40d23b0 0x7fc7c40caf00 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac00ebb0 tx=0x7fc7ac00c520 comp rx=0 tx=0).stop 2024-09-15T23:16:24.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.146+0000 7fc7c88c9640 1 -- 172.21.15.123:0/452534778 shutdown_connections 2024-09-15T23:16:24.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.146+0000 7fc7c88c9640 1 --2- 172.21.15.123:0/452534778 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc7c415ed20 0x7fc7c41f7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:24.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.146+0000 7fc7c88c9640 1 --2- 172.21.15.123:0/452534778 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc7a406c2e0 0x7fc7a406e7a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:24.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.146+0000 7fc7c88c9640 1 --2- 172.21.15.123:0/452534778 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7c40d23b0 0x7fc7c40caf00 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:24.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.146+0000 7fc7c88c9640 1 --2- 172.21.15.123:0/452534778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc7c40cf2d0 0x7fc7c41e8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:24.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.146+0000 7fc7c88c9640 1 -- 172.21.15.123:0/452534778 >> 172.21.15.123:0/452534778 conn(0x7fc7c40d1260 msgr2=0x7fc7c40b5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:24.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.146+0000 7fc7c88c9640 1 -- 172.21.15.123:0/452534778 shutdown_connections 2024-09-15T23:16:24.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.146+0000 7fc7c88c9640 1 -- 172.21.15.123:0/452534778 wait complete. 2024-09-15T23:16:24.158 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:16:24.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.255+0000 7f075b918640 1 Processor -- start 2024-09-15T23:16:24.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.255+0000 7f075b918640 1 -- start start 2024-09-15T23:16:24.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.256+0000 7f075b918640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0754162490 0x7f075415ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:24.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.256+0000 7f075b918640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f07540b66b0 0x7f07540b6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:24.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.256+0000 7f075b918640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07540b7000 con 0x7f075415eab0 2024-09-15T23:16:24.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.256+0000 7f075b918640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f075415f570 con 0x7f0754162490 2024-09-15T23:16:24.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.256+0000 7f075b918640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f075415f850 con 0x7f07540b66b0 2024-09-15T23:16:24.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.256+0000 7f0758eb3640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0754162490 0x7f075415ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:24.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.256+0000 7f0758eb3640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0754162490 0x7f075415ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44012/0 (socket says 172.21.15.123:44012) 2024-09-15T23:16:24.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.256+0000 7f0758eb3640 1 -- 172.21.15.123:0/889790766 learned_addr learned my addr 172.21.15.123:0/889790766 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:24.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.256+0000 7f0759eb5640 1 --2- 172.21.15.123:0/889790766 >> v2:172.21.15.188:3300/0 conn(0x7f07540b66b0 0x7f07540b6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:24.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.256+0000 7f0758eb3640 1 -- 172.21.15.123:0/889790766 >> v2:172.21.15.188:3300/0 conn(0x7f07540b66b0 msgr2=0x7f07540b6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:24.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.256+0000 7f0758eb3640 1 --2- 172.21.15.123:0/889790766 >> v2:172.21.15.188:3300/0 conn(0x7f07540b66b0 0x7f07540b6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:24.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.256+0000 7f0758eb3640 1 -- 172.21.15.123:0/889790766 >> v1:172.21.15.188:6789/0 conn(0x7f075415eab0 legacy=0x7f07540d2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:24.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.256+0000 7f0758eb3640 1 -- 172.21.15.123:0/889790766 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f075415fb30 con 0x7f0754162490 2024-09-15T23:16:24.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.257+0000 7f0758eb3640 1 --2- 172.21.15.123:0/889790766 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0754162490 0x7f075415ee90 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f075408d8c0 tx=0x7f074402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c131f1be67277194 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:24.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.257+0000 7f074bfff640 1 -- 172.21.15.123:0/889790766 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0744037070 con 0x7f0754162490 2024-09-15T23:16:24.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.257+0000 7f074bfff640 1 -- 172.21.15.123:0/889790766 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0744032440 con 0x7f0754162490 2024-09-15T23:16:24.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.257+0000 7f074bfff640 1 -- 172.21.15.123:0/889790766 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0744032810 con 0x7f0754162490 2024-09-15T23:16:24.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.258+0000 7f075b918640 1 -- 172.21.15.123:0/889790766 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0754162490 msgr2=0x7f075415ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:24.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.258+0000 7f075b918640 1 --2- 172.21.15.123:0/889790766 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0754162490 0x7f075415ee90 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f075408d8c0 tx=0x7f074402a230 comp rx=0 tx=0).stop 2024-09-15T23:16:24.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.258+0000 7f075b918640 1 -- 172.21.15.123:0/889790766 shutdown_connections 2024-09-15T23:16:24.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.258+0000 7f075b918640 1 --2- 172.21.15.123:0/889790766 >> v2:172.21.15.188:3300/0 conn(0x7f07540b66b0 0x7f07540b6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:24.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.258+0000 7f075b918640 1 --2- 172.21.15.123:0/889790766 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0754162490 0x7f075415ee90 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:24.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.258+0000 7f075b918640 1 -- 172.21.15.123:0/889790766 >> 172.21.15.123:0/889790766 conn(0x7f07540d16d0 msgr2=0x7f07540d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:24.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.258+0000 7f075b918640 1 -- 172.21.15.123:0/889790766 shutdown_connections 2024-09-15T23:16:24.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.258+0000 7f075b918640 1 -- 172.21.15.123:0/889790766 wait complete. 2024-09-15T23:16:24.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.259+0000 7f075b918640 1 Processor -- start 2024-09-15T23:16:24.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.259+0000 7f075b918640 1 -- start start 2024-09-15T23:16:24.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.260+0000 7f075b918640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f07540b66b0 0x7f07540b9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:24.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.260+0000 7f075b918640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f075415eab0 0x7f075415cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:24.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.260+0000 7f075b918640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0754162490 0x7f07540b8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:24.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.260+0000 7f075b918640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f07540d4460 con 0x7f0754162490 2024-09-15T23:16:24.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.260+0000 7f075b918640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f07540cef20 con 0x7f075415eab0 2024-09-15T23:16:24.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.260+0000 7f075b918640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f07540d45e0 con 0x7f07540b66b0 2024-09-15T23:16:24.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.260+0000 7f0759eb5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0754162490 0x7f07540b8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:24.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.260+0000 7f0759eb5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0754162490 0x7f07540b8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44024/0 (socket says 172.21.15.123:44024) 2024-09-15T23:16:24.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.260+0000 7f0759eb5640 1 -- 172.21.15.123:0/3498567658 learned_addr learned my addr 172.21.15.123:0/3498567658 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:24.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.260+0000 7f0758eb3640 1 --2- 172.21.15.123:0/3498567658 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f075415eab0 0x7f075415cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:24.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.260+0000 7f07596b4640 1 --2- 172.21.15.123:0/3498567658 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f07540b66b0 0x7f07540b9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:24.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.260+0000 7f0759eb5640 1 -- 172.21.15.123:0/3498567658 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f07540b66b0 msgr2=0x7f07540b9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:24.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.260+0000 7f0759eb5640 1 --2- 172.21.15.123:0/3498567658 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f07540b66b0 0x7f07540b9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:24.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.260+0000 7f0759eb5640 1 -- 172.21.15.123:0/3498567658 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f075415eab0 msgr2=0x7f075415cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:24.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.260+0000 7f0759eb5640 1 --2- 172.21.15.123:0/3498567658 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f075415eab0 0x7f075415cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:24.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.260+0000 7f0759eb5640 1 -- 172.21.15.123:0/3498567658 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07540cba80 con 0x7f0754162490 2024-09-15T23:16:24.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.260+0000 7f0759eb5640 1 --2- 172.21.15.123:0/3498567658 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0754162490 0x7f07540b8ce0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f074c007e60 tx=0x7f074c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:24.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.261+0000 7f0749ffb640 1 -- 172.21.15.123:0/3498567658 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f074c014420 con 0x7f0754162490 2024-09-15T23:16:24.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.261+0000 7f0749ffb640 1 -- 172.21.15.123:0/3498567658 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f074c019070 con 0x7f0754162490 2024-09-15T23:16:24.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.261+0000 7f075b918640 1 -- 172.21.15.123:0/3498567658 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07540cbd60 con 0x7f0754162490 2024-09-15T23:16:24.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.261+0000 7f0749ffb640 1 -- 172.21.15.123:0/3498567658 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f074c014820 con 0x7f0754162490 2024-09-15T23:16:24.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.261+0000 7f075b918640 1 -- 172.21.15.123:0/3498567658 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f075415d320 con 0x7f0754162490 2024-09-15T23:16:24.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.262+0000 7f075b918640 1 -- 172.21.15.123:0/3498567658 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07540b6ac0 con 0x7f0754162490 2024-09-15T23:16:24.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.262+0000 7f0749ffb640 1 -- 172.21.15.123:0/3498567658 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f074c0149c0 con 0x7f0754162490 2024-09-15T23:16:24.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.262+0000 7f0749ffb640 1 --2- 172.21.15.123:0/3498567658 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f073806c2b0 0x7f073806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:24.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.263+0000 7f0749ffb640 1 -- 172.21.15.123:0/3498567658 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5967+0+0 (secure 0 0 0) 0x7f074c08bbc0 con 0x7f0754162490 2024-09-15T23:16:24.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.263+0000 7f07596b4640 1 --2- 172.21.15.123:0/3498567658 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f073806c2b0 0x7f073806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:24.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.263+0000 7f07596b4640 1 --2- 172.21.15.123:0/3498567658 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f073806c2b0 0x7f073806e770 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f07541e9e80 tx=0x7f0750009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:24.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.267+0000 7f0749ffb640 1 -- 172.21.15.123:0/3498567658 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f074c059c70 con 0x7f0754162490 2024-09-15T23:16:24.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.433+0000 7f075b918640 1 -- 172.21.15.123:0/3498567658 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f07540d2500 con 0x7f0754162490 2024-09-15T23:16:24.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.434+0000 7f0749ffb640 1 -- 172.21.15.123:0/3498567658 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+17085 (secure 0 0 0) 0x7f074c05df70 con 0x7f0754162490 2024-09-15T23:16:24.435 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:16:24.435 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":86,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:16:07.004552+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:15:52.548725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-15T23:15:53.192974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.188:6837/2597191885":"2024-09-16T23:16:07.004532+0000","172.21.15.188:6835/2597191885":"2024-09-16T23:16:07.004532+0000","172.21.15.123:6834/3814257760":"2024-09-16T23:16:06.705374+0000","172.21.15.123:6832/3814257760":"2024-09-16T23:16:06.705374+0000","172.21.15.123:6835/839817134":"2024-09-16T23:16:06.696474+0000","172.21.15.123:6833/839817134":"2024-09-16T23:16:06.696474+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:16:24.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.436+0000 7f075b918640 1 -- 172.21.15.123:0/3498567658 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f073806c2b0 msgr2=0x7f073806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:24.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.436+0000 7f075b918640 1 --2- 172.21.15.123:0/3498567658 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f073806c2b0 0x7f073806e770 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f07541e9e80 tx=0x7f0750009060 comp rx=0 tx=0).stop 2024-09-15T23:16:24.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.436+0000 7f075b918640 1 -- 172.21.15.123:0/3498567658 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0754162490 msgr2=0x7f07540b8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:24.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.436+0000 7f075b918640 1 --2- 172.21.15.123:0/3498567658 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0754162490 0x7f07540b8ce0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f074c007e60 tx=0x7f074c00e4b0 comp rx=0 tx=0).stop 2024-09-15T23:16:24.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.436+0000 7f075b918640 1 -- 172.21.15.123:0/3498567658 shutdown_connections 2024-09-15T23:16:24.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.436+0000 7f075b918640 1 --2- 172.21.15.123:0/3498567658 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f073806c2b0 0x7f073806e770 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:24.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.436+0000 7f075b918640 1 --2- 172.21.15.123:0/3498567658 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0754162490 0x7f07540b8ce0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:24.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.436+0000 7f075b918640 1 --2- 172.21.15.123:0/3498567658 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f075415eab0 0x7f075415cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:24.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.436+0000 7f075b918640 1 --2- 172.21.15.123:0/3498567658 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f07540b66b0 0x7f07540b9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:24.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.436+0000 7f075b918640 1 -- 172.21.15.123:0/3498567658 >> 172.21.15.123:0/3498567658 conn(0x7f07540d16d0 msgr2=0x7f07540d3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:24.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.436+0000 7f075b918640 1 -- 172.21.15.123:0/3498567658 shutdown_connections 2024-09-15T23:16:24.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.436+0000 7f075b918640 1 -- 172.21.15.123:0/3498567658 wait complete. 2024-09-15T23:16:24.448 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T23:16:24.448 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:16:24.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.546+0000 7fa8e77cf640 1 Processor -- start 2024-09-15T23:16:24.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.546+0000 7fa8e77cf640 1 -- start start 2024-09-15T23:16:24.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.547+0000 7fa8e77cf640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa8e006c320 0x7fa8e015bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:24.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.547+0000 7fa8e77cf640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8e013eb20 0x7fa8e015c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:24.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.547+0000 7fa8e77cf640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8e0071180 con 0x7fa8e00b2d40 2024-09-15T23:16:24.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.547+0000 7fa8e77cf640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fa8e0071ab0 con 0x7fa8e006c320 2024-09-15T23:16:24.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.547+0000 7fa8e77cf640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa8e0071460 con 0x7fa8e013eb20 2024-09-15T23:16:24.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.547+0000 7fa8e4d6a640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa8e006c320 0x7fa8e015bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:24.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.547+0000 7fa8e5d6c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8e013eb20 0x7fa8e015c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:24.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.547+0000 7fa8e4d6a640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa8e006c320 0x7fa8e015bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:48826/0 (socket says 172.21.15.123:48826) 2024-09-15T23:16:24.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.547+0000 7fa8e4d6a640 1 -- 172.21.15.123:0/1891404094 learned_addr learned my addr 172.21.15.123:0/1891404094 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:24.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.547+0000 7fa8e5d6c640 1 -- 172.21.15.123:0/1891404094 >> v2:172.21.15.188:3300/0 conn(0x7fa8e006c320 msgr2=0x7fa8e015bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:24.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.547+0000 7fa8e5d6c640 1 --2- 172.21.15.123:0/1891404094 >> v2:172.21.15.188:3300/0 conn(0x7fa8e006c320 0x7fa8e015bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:24.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.547+0000 7fa8e5d6c640 1 -- 172.21.15.123:0/1891404094 >> v1:172.21.15.188:6789/0 conn(0x7fa8e00b2d40 legacy=0x7fa8e006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:24.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.547+0000 7fa8e5d6c640 1 -- 172.21.15.123:0/1891404094 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8e0071740 con 0x7fa8e013eb20 2024-09-15T23:16:24.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.548+0000 7fa8e5d6c640 1 --2- 172.21.15.123:0/1891404094 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8e013eb20 0x7fa8e015c230 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8009d90 tx=0x7fa8d802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16b6204a432bcdfc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:24.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.548+0000 7fa8d3fff640 1 -- 172.21.15.123:0/1891404094 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d8007740 con 0x7fa8e013eb20 2024-09-15T23:16:24.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.548+0000 7fa8d3fff640 1 -- 172.21.15.123:0/1891404094 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8d80078e0 con 0x7fa8e013eb20 2024-09-15T23:16:24.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.548+0000 7fa8d3fff640 1 -- 172.21.15.123:0/1891404094 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d8007cb0 con 0x7fa8e013eb20 2024-09-15T23:16:24.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.549+0000 7fa8e77cf640 1 -- 172.21.15.123:0/1891404094 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8e013eb20 msgr2=0x7fa8e015c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:24.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.549+0000 7fa8e77cf640 1 --2- 172.21.15.123:0/1891404094 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8e013eb20 0x7fa8e015c230 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8009d90 tx=0x7fa8d802a660 comp rx=0 tx=0).stop 2024-09-15T23:16:24.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.549+0000 7fa8e77cf640 1 -- 172.21.15.123:0/1891404094 shutdown_connections 2024-09-15T23:16:24.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.549+0000 7fa8e77cf640 1 --2- 172.21.15.123:0/1891404094 >> v2:172.21.15.188:3300/0 conn(0x7fa8e006c320 0x7fa8e015bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:24.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.549+0000 7fa8e77cf640 1 --2- 172.21.15.123:0/1891404094 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8e013eb20 0x7fa8e015c230 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:24.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.549+0000 7fa8e77cf640 1 -- 172.21.15.123:0/1891404094 >> 172.21.15.123:0/1891404094 conn(0x7fa8e00ccec0 msgr2=0x7fa8e00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:24.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.549+0000 7fa8e77cf640 1 -- 172.21.15.123:0/1891404094 shutdown_connections 2024-09-15T23:16:24.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.549+0000 7fa8e77cf640 1 -- 172.21.15.123:0/1891404094 wait complete. 2024-09-15T23:16:24.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.550+0000 7fa8e77cf640 1 Processor -- start 2024-09-15T23:16:24.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.550+0000 7fa8e77cf640 1 -- start start 2024-09-15T23:16:24.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.551+0000 7fa8e77cf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8e006c320 0x7fa8e013d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:24.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.551+0000 7fa8e77cf640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8e00b2d40 0x7fa8e01f25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:24.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.551+0000 7fa8e77cf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8e013eb20 0x7fa8e0157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:24.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.551+0000 7fa8e77cf640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e00720c0 con 0x7fa8e013eb20 2024-09-15T23:16:24.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.551+0000 7fa8e77cf640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e0071f40 con 0x7fa8e006c320 2024-09-15T23:16:24.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.551+0000 7fa8e77cf640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa8e0072240 con 0x7fa8e00b2d40 2024-09-15T23:16:24.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.551+0000 7fa8e5d6c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8e013eb20 0x7fa8e0157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:24.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.551+0000 7fa8e5d6c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8e013eb20 0x7fa8e0157b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44032/0 (socket says 172.21.15.123:44032) 2024-09-15T23:16:24.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.551+0000 7fa8e5d6c640 1 -- 172.21.15.123:0/1151515897 learned_addr learned my addr 172.21.15.123:0/1151515897 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:24.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.551+0000 7fa8e556b640 1 --2- 172.21.15.123:0/1151515897 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8e006c320 0x7fa8e013d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:24.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.551+0000 7fa8e4d6a640 1 --2- 172.21.15.123:0/1151515897 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8e00b2d40 0x7fa8e01f25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:24.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.551+0000 7fa8e5d6c640 1 -- 172.21.15.123:0/1151515897 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8e00b2d40 msgr2=0x7fa8e01f25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:24.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.551+0000 7fa8e5d6c640 1 --2- 172.21.15.123:0/1151515897 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8e00b2d40 0x7fa8e01f25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:24.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.551+0000 7fa8e5d6c640 1 -- 172.21.15.123:0/1151515897 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8e006c320 msgr2=0x7fa8e013d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:24.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.551+0000 7fa8e5d6c640 1 --2- 172.21.15.123:0/1151515897 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8e006c320 0x7fa8e013d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:24.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.551+0000 7fa8e5d6c640 1 -- 172.21.15.123:0/1151515897 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8e01f3020 con 0x7fa8e013eb20 2024-09-15T23:16:24.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.552+0000 7fa8e5d6c640 1 --2- 172.21.15.123:0/1151515897 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8e013eb20 0x7fa8e0157b00 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fa8d802ac50 tx=0x7fa8d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:24.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.552+0000 7fa8d1ffb640 1 -- 172.21.15.123:0/1151515897 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d803f070 con 0x7fa8e013eb20 2024-09-15T23:16:24.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.552+0000 7fa8d1ffb640 1 -- 172.21.15.123:0/1151515897 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8d8031bc0 con 0x7fa8e013eb20 2024-09-15T23:16:24.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.552+0000 7fa8d1ffb640 1 -- 172.21.15.123:0/1151515897 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d8009450 con 0x7fa8e013eb20 2024-09-15T23:16:24.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.552+0000 7fa8e77cf640 1 -- 172.21.15.123:0/1151515897 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8e01f3300 con 0x7fa8e013eb20 2024-09-15T23:16:24.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.552+0000 7fa8e77cf640 1 -- 172.21.15.123:0/1151515897 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8e015f380 con 0x7fa8e013eb20 2024-09-15T23:16:24.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.553+0000 7fa8e77cf640 1 -- 172.21.15.123:0/1151515897 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8e006bc10 con 0x7fa8e013eb20 2024-09-15T23:16:24.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.553+0000 7fa8d1ffb640 1 -- 172.21.15.123:0/1151515897 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa8d803b410 con 0x7fa8e013eb20 2024-09-15T23:16:24.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.554+0000 7fa8d1ffb640 1 --2- 172.21.15.123:0/1151515897 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa8c406c2b0 0x7fa8c406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:24.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.554+0000 7fa8d1ffb640 1 -- 172.21.15.123:0/1151515897 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5967+0+0 (secure 0 0 0) 0x7fa8d80acb60 con 0x7fa8e013eb20 2024-09-15T23:16:24.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.554+0000 7fa8e556b640 1 --2- 172.21.15.123:0/1151515897 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa8c406c2b0 0x7fa8c406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:24.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.554+0000 7fa8e556b640 1 --2- 172.21.15.123:0/1151515897 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa8c406c2b0 0x7fa8c406e770 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa8e00b2aa0 tx=0x7fa8dc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:24.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.558+0000 7fa8d1ffb640 1 -- 172.21.15.123:0/1151515897 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa8d807ab80 con 0x7fa8e013eb20 2024-09-15T23:16:24.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.755+0000 7fa8e77cf640 1 -- 172.21.15.123:0/1151515897 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa8e006c9c0 con 0x7fa8e013eb20 2024-09-15T23:16:24.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.756+0000 7fa8d1ffb640 1 -- 172.21.15.123:0/1151515897 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5238 (secure 0 0 0) 0x7fa8d807ee80 con 0x7fa8e013eb20 2024-09-15T23:16:24.757 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:16:24.757 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":53,"btime":"2024-09-15T23:16:10:023819+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/2007918144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2007918144},{"type":"v1","addr":"172.21.15.188:6835","nonce":2007918144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":6199,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2540326254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":2540326254},{"type":"v1","addr":"172.21.15.188:6837","nonce":2540326254}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6918,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/1092174152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":1092174152},{"type":"v1","addr":"172.21.15.123:6833","nonce":1092174152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:15:54.225983+0000","modified":"2024-09-15T23:16:10.023816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6930":{"gid":6930,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6835/3648891779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3648891779},{"type":"v1","addr":"172.21.15.123:6835","nonce":3648891779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6930,"qdb_cluster":[6930]},"id":5}]} 2024-09-15T23:16:24.757 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 53 2024-09-15T23:16:24.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.758+0000 7fa8e77cf640 1 -- 172.21.15.123:0/1151515897 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa8c406c2b0 msgr2=0x7fa8c406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:24.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.758+0000 7fa8e77cf640 1 --2- 172.21.15.123:0/1151515897 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa8c406c2b0 0x7fa8c406e770 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa8e00b2aa0 tx=0x7fa8dc009040 comp rx=0 tx=0).stop 2024-09-15T23:16:24.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.758+0000 7fa8e77cf640 1 -- 172.21.15.123:0/1151515897 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8e013eb20 msgr2=0x7fa8e0157b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:24.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.758+0000 7fa8e77cf640 1 --2- 172.21.15.123:0/1151515897 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8e013eb20 0x7fa8e0157b00 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fa8d802ac50 tx=0x7fa8d8004a40 comp rx=0 tx=0).stop 2024-09-15T23:16:24.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.758+0000 7fa8e77cf640 1 -- 172.21.15.123:0/1151515897 shutdown_connections 2024-09-15T23:16:24.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.758+0000 7fa8e77cf640 1 --2- 172.21.15.123:0/1151515897 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa8c406c2b0 0x7fa8c406e770 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:24.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.758+0000 7fa8e77cf640 1 --2- 172.21.15.123:0/1151515897 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8e013eb20 0x7fa8e0157b00 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:24.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.758+0000 7fa8e77cf640 1 --2- 172.21.15.123:0/1151515897 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8e00b2d40 0x7fa8e01f25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:24.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.758+0000 7fa8e77cf640 1 --2- 172.21.15.123:0/1151515897 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8e006c320 0x7fa8e013d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:24.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.758+0000 7fa8e77cf640 1 -- 172.21.15.123:0/1151515897 >> 172.21.15.123:0/1151515897 conn(0x7fa8e00ccec0 msgr2=0x7fa8e00cf820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:24.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.758+0000 7fa8e77cf640 1 -- 172.21.15.123:0/1151515897 shutdown_connections 2024-09-15T23:16:24.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.758+0000 7fa8e77cf640 1 -- 172.21.15.123:0/1151515897 wait complete. 2024-09-15T23:16:24.770 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:16:24.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.867+0000 7f98a0e1e640 1 Processor -- start 2024-09-15T23:16:24.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.867+0000 7f98a0e1e640 1 -- start start 2024-09-15T23:16:24.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.868+0000 7f98a0e1e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f989c06c320 0x7f989c15bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:24.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.868+0000 7f98a0e1e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f989c13eb20 0x7f989c15c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:24.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.868+0000 7f98a0e1e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f989c071180 con 0x7f989c0b2d40 2024-09-15T23:16:24.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.868+0000 7f98a0e1e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f989c071ab0 con 0x7f989c13eb20 2024-09-15T23:16:24.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.868+0000 7f98a0e1e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f989c071460 con 0x7f989c06c320 2024-09-15T23:16:24.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.868+0000 7f989ad9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f989c13eb20 0x7f989c15c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:24.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.868+0000 7f989a59c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f989c0b2d40 0x7f989c06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58128/0 (socket says 172.21.15.123:58128) 2024-09-15T23:16:24.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.868+0000 7f989a59c640 1 -- 172.21.15.123:0/4002113469 learned_addr learned my addr 172.21.15.123:0/4002113469 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:24.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.868+0000 7f989ad9d640 1 -- 172.21.15.123:0/4002113469 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f989c06c320 msgr2=0x7f989c15bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:24.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.868+0000 7f9893fff640 1 --2- 172.21.15.123:0/4002113469 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f989c06c320 0x7f989c15bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:24.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.868+0000 7f989ad9d640 1 --2- 172.21.15.123:0/4002113469 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f989c06c320 0x7f989c15bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:24.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.868+0000 7f9899d9b640 1 -- 172.21.15.123:0/4002113469 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 682798382 0 0) 0x7f989c071180 con 0x7f989c0b2d40 2024-09-15T23:16:24.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.868+0000 7f989ad9d640 1 -- 172.21.15.123:0/4002113469 >> v1:172.21.15.123:6789/0 conn(0x7f989c0b2d40 legacy=0x7f989c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:24.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.868+0000 7f989ad9d640 1 -- 172.21.15.123:0/4002113469 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f989c071740 con 0x7f989c13eb20 2024-09-15T23:16:24.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.868+0000 7f9893fff640 1 --2- 172.21.15.123:0/4002113469 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f989c06c320 0x7f989c15bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:16:24.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.869+0000 7f989ad9d640 1 --2- 172.21.15.123:0/4002113469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f989c13eb20 0x7f989c15c230 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f9894009d90 tx=0x7f989402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aab2bf04cf92f37 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:24.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.869+0000 7f9899d9b640 1 -- 172.21.15.123:0/4002113469 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9894007740 con 0x7f989c13eb20 2024-09-15T23:16:24.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.869+0000 7f9899d9b640 1 -- 172.21.15.123:0/4002113469 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98940078e0 con 0x7f989c13eb20 2024-09-15T23:16:24.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.869+0000 7f9899d9b640 1 -- 172.21.15.123:0/4002113469 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9894007cb0 con 0x7f989c13eb20 2024-09-15T23:16:24.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.869+0000 7f98a0e1e640 1 -- 172.21.15.123:0/4002113469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f989c13eb20 msgr2=0x7f989c15c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:24.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.869+0000 7f98a0e1e640 1 --2- 172.21.15.123:0/4002113469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f989c13eb20 0x7f989c15c230 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f9894009d90 tx=0x7f989402a660 comp rx=0 tx=0).stop 2024-09-15T23:16:24.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.870+0000 7f98a0e1e640 1 -- 172.21.15.123:0/4002113469 shutdown_connections 2024-09-15T23:16:24.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.870+0000 7f98a0e1e640 1 --2- 172.21.15.123:0/4002113469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f989c13eb20 0x7f989c15c230 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:24.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.870+0000 7f98a0e1e640 1 --2- 172.21.15.123:0/4002113469 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f989c06c320 0x7f989c15bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:24.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.870+0000 7f98a0e1e640 1 -- 172.21.15.123:0/4002113469 >> 172.21.15.123:0/4002113469 conn(0x7f989c0ccec0 msgr2=0x7f989c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:24.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.870+0000 7f98a0e1e640 1 -- 172.21.15.123:0/4002113469 shutdown_connections 2024-09-15T23:16:24.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.870+0000 7f98a0e1e640 1 -- 172.21.15.123:0/4002113469 wait complete. 2024-09-15T23:16:24.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.871+0000 7f98a0e1e640 1 Processor -- start 2024-09-15T23:16:24.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.871+0000 7f98a0e1e640 1 -- start start 2024-09-15T23:16:24.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.872+0000 7f98a0e1e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f989c06c320 0x7f989c15f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:24.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.872+0000 7f98a0e1e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f989c0b2d40 0x7f989c154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:24.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.872+0000 7f98a0e1e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f989c13eb20 0x7f989c0b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:24.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.872+0000 7f98a0e1e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f989c0720c0 con 0x7f989c0b2d40 2024-09-15T23:16:24.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.872+0000 7f98a0e1e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f989c071f40 con 0x7f989c13eb20 2024-09-15T23:16:24.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.872+0000 7f98a0e1e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f989c072240 con 0x7f989c06c320 2024-09-15T23:16:24.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.872+0000 7f9893fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f989c0b2d40 0x7f989c154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:24.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.872+0000 7f9893fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f989c0b2d40 0x7f989c154540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44048/0 (socket says 172.21.15.123:44048) 2024-09-15T23:16:24.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.872+0000 7f9893fff640 1 -- 172.21.15.123:0/3064513387 learned_addr learned my addr 172.21.15.123:0/3064513387 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:24.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.872+0000 7f989a59c640 1 --2- 172.21.15.123:0/3064513387 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f989c06c320 0x7f989c15f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:24.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.872+0000 7f989ad9d640 1 --2- 172.21.15.123:0/3064513387 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f989c13eb20 0x7f989c0b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:24.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.872+0000 7f9893fff640 1 -- 172.21.15.123:0/3064513387 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f989c06c320 msgr2=0x7f989c15f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:24.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.872+0000 7f9893fff640 1 --2- 172.21.15.123:0/3064513387 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f989c06c320 0x7f989c15f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:24.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.872+0000 7f9893fff640 1 -- 172.21.15.123:0/3064513387 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f989c13eb20 msgr2=0x7f989c0b5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:24.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.872+0000 7f9893fff640 1 --2- 172.21.15.123:0/3064513387 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f989c13eb20 0x7f989c0b5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:24.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.872+0000 7f9893fff640 1 -- 172.21.15.123:0/3064513387 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f989c154a80 con 0x7f989c0b2d40 2024-09-15T23:16:24.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.872+0000 7f9893fff640 1 --2- 172.21.15.123:0/3064513387 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f989c0b2d40 0x7f989c154540 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f988400c7f0 tx=0x7f988400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:24.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.872+0000 7f9892ffd640 1 -- 172.21.15.123:0/3064513387 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9884015070 con 0x7f989c0b2d40 2024-09-15T23:16:24.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.872+0000 7f9892ffd640 1 -- 172.21.15.123:0/3064513387 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9884007a30 con 0x7f989c0b2d40 2024-09-15T23:16:24.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.872+0000 7f9892ffd640 1 -- 172.21.15.123:0/3064513387 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9884007e00 con 0x7f989c0b2d40 2024-09-15T23:16:24.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.872+0000 7f98a0e1e640 1 -- 172.21.15.123:0/3064513387 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f989c15e4d0 con 0x7f989c0b2d40 2024-09-15T23:16:24.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.872+0000 7f98a0e1e640 1 -- 172.21.15.123:0/3064513387 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f989c15ea90 con 0x7f989c0b2d40 2024-09-15T23:16:24.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.873+0000 7f98a0e1e640 1 -- 172.21.15.123:0/3064513387 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f989c06bc10 con 0x7f989c0b2d40 2024-09-15T23:16:24.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.874+0000 7f9892ffd640 1 -- 172.21.15.123:0/3064513387 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9884018070 con 0x7f989c0b2d40 2024-09-15T23:16:24.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.874+0000 7f9892ffd640 1 --2- 172.21.15.123:0/3064513387 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f987c06c2b0 0x7f987c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:24.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.874+0000 7f9892ffd640 1 -- 172.21.15.123:0/3064513387 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5967+0+0 (secure 0 0 0) 0x7f988408b3f0 con 0x7f989c0b2d40 2024-09-15T23:16:24.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.874+0000 7f989a59c640 1 --2- 172.21.15.123:0/3064513387 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f987c06c2b0 0x7f987c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:24.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.875+0000 7f989a59c640 1 --2- 172.21.15.123:0/3064513387 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f987c06c2b0 0x7f987c06e770 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f988c000f60 tx=0x7f988c007b50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:24.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:24.879+0000 7f9892ffd640 1 -- 172.21.15.123:0/3064513387 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9884059af0 con 0x7f989c0b2d40 2024-09-15T23:16:25.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.079+0000 7f98a0e1e640 1 -- 172.21.15.123:0/3064513387 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f989c155920 con 0x7f989c0b2d40 2024-09-15T23:16:25.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.080+0000 7f9892ffd640 1 -- 172.21.15.123:0/3064513387 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5238 (secure 0 0 0) 0x7f98840593f0 con 0x7f989c0b2d40 2024-09-15T23:16:25.081 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:16:25.081 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":53,"btime":"2024-09-15T23:16:10:023819+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/2007918144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2007918144},{"type":"v1","addr":"172.21.15.188:6835","nonce":2007918144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":6199,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2540326254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":2540326254},{"type":"v1","addr":"172.21.15.188:6837","nonce":2540326254}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6918,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/1092174152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":1092174152},{"type":"v1","addr":"172.21.15.123:6833","nonce":1092174152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:15:54.225983+0000","modified":"2024-09-15T23:16:10.023816+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":86,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6930},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6930":{"gid":6930,"name":"c","rank":0,"incarnation":50,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6835/3648891779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3648891779},{"type":"v1","addr":"172.21.15.123:6835","nonce":3648891779}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6930,"qdb_cluster":[6930]},"id":5}]} 2024-09-15T23:16:25.082 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 53 2024-09-15T23:16:25.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.082+0000 7f98a0e1e640 1 -- 172.21.15.123:0/3064513387 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f987c06c2b0 msgr2=0x7f987c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:25.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.082+0000 7f98a0e1e640 1 --2- 172.21.15.123:0/3064513387 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f987c06c2b0 0x7f987c06e770 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f988c000f60 tx=0x7f988c007b50 comp rx=0 tx=0).stop 2024-09-15T23:16:25.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.082+0000 7f98a0e1e640 1 -- 172.21.15.123:0/3064513387 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f989c0b2d40 msgr2=0x7f989c154540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:25.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.082+0000 7f98a0e1e640 1 --2- 172.21.15.123:0/3064513387 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f989c0b2d40 0x7f989c154540 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f988400c7f0 tx=0x7f988400ccb0 comp rx=0 tx=0).stop 2024-09-15T23:16:25.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.082+0000 7f98a0e1e640 1 -- 172.21.15.123:0/3064513387 shutdown_connections 2024-09-15T23:16:25.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.082+0000 7f98a0e1e640 1 --2- 172.21.15.123:0/3064513387 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f989c13eb20 0x7f989c0b5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:25.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.082+0000 7f98a0e1e640 1 --2- 172.21.15.123:0/3064513387 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f987c06c2b0 0x7f987c06e770 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:25.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.082+0000 7f98a0e1e640 1 --2- 172.21.15.123:0/3064513387 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f989c0b2d40 0x7f989c154540 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:25.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.082+0000 7f98a0e1e640 1 --2- 172.21.15.123:0/3064513387 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f989c06c320 0x7f989c15f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:25.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.082+0000 7f98a0e1e640 1 -- 172.21.15.123:0/3064513387 >> 172.21.15.123:0/3064513387 conn(0x7f989c0ccec0 msgr2=0x7f989c140680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:25.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.082+0000 7f98a0e1e640 1 -- 172.21.15.123:0/3064513387 shutdown_connections 2024-09-15T23:16:25.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.082+0000 7f98a0e1e640 1 -- 172.21.15.123:0/3064513387 wait complete. 2024-09-15T23:16:25.094 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:16:25.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.190+0000 7fef370a4640 1 Processor -- start 2024-09-15T23:16:25.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.190+0000 7fef370a4640 1 -- start start 2024-09-15T23:16:25.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.191+0000 7fef370a4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fef300b2d40 0x7fef3006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:25.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.191+0000 7fef370a4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef30071180 con 0x7fef3006c150 2024-09-15T23:16:25.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.191+0000 7fef370a4640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef30071460 con 0x7fef3013eb20 2024-09-15T23:16:25.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.191+0000 7fef370a4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fef30071ab0 con 0x7fef300b2d40 2024-09-15T23:16:25.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.191+0000 7fef35641640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fef3006c150 0x7fef30071f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58138/0 (socket says 172.21.15.123:58138) 2024-09-15T23:16:25.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.191+0000 7fef35641640 1 -- 172.21.15.123:0/3637428462 learned_addr learned my addr 172.21.15.123:0/3637428462 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:25.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.191+0000 7fef277fe640 1 -- 172.21.15.123:0/3637428462 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 739724908 0 0) 0x7fef30071180 con 0x7fef3006c150 2024-09-15T23:16:25.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.191+0000 7fef277fe640 1 -- 172.21.15.123:0/3637428462 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef18003520 con 0x7fef3006c150 2024-09-15T23:16:25.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.191+0000 7fef34e40640 1 --2- 172.21.15.123:0/3637428462 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fef300b2d40 0x7fef3006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:25.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.191+0000 7fef277fe640 1 -- 172.21.15.123:0/3637428462 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1811072866 0 0) 0x7fef18003520 con 0x7fef3006c150 2024-09-15T23:16:25.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.191+0000 7fef277fe640 1 -- 172.21.15.123:0/3637428462 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fef300b2d40 msgr2=0x7fef3006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:25.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.191+0000 7fef277fe640 1 --2- 172.21.15.123:0/3637428462 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fef300b2d40 0x7fef3006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:25.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.191+0000 7fef277fe640 1 -- 172.21.15.123:0/3637428462 >> v1:172.21.15.188:6789/0 conn(0x7fef3013eb20 legacy=0x7fef3015bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:25.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.191+0000 7fef277fe640 1 -- 172.21.15.123:0/3637428462 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef30071740 con 0x7fef3006c150 2024-09-15T23:16:25.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.191+0000 7fef277fe640 1 -- 172.21.15.123:0/3637428462 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fef280019f0 con 0x7fef3006c150 2024-09-15T23:16:25.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.191+0000 7fef277fe640 1 -- 172.21.15.123:0/3637428462 >> v1:172.21.15.123:6789/0 conn(0x7fef3006c150 legacy=0x7fef30071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:25.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.192+0000 7fef277fe640 1 --2- 172.21.15.123:0/3637428462 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef180039e0 0x7fef18003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:25.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.192+0000 7fef277fe640 1 --2- 172.21.15.123:0/3637428462 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fef300b2d40 0x7fef18004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:25.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.192+0000 7fef277fe640 1 --2- 172.21.15.123:0/3637428462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef18004d40 0x7fef180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:25.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.192+0000 7fef277fe640 1 -- 172.21.15.123:0/3637428462 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fef30071ab0 con 0x7fef18004d40 2024-09-15T23:16:25.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.192+0000 7fef277fe640 1 -- 172.21.15.123:0/3637428462 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fef1800dc80 con 0x7fef180039e0 2024-09-15T23:16:25.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.192+0000 7fef277fe640 1 -- 172.21.15.123:0/3637428462 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fef1800de80 con 0x7fef300b2d40 2024-09-15T23:16:25.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.192+0000 7fef35641640 1 --2- 172.21.15.123:0/3637428462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef18004d40 0x7fef180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:25.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.192+0000 7fef34e40640 1 --2- 172.21.15.123:0/3637428462 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef180039e0 0x7fef18003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:25.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.192+0000 7fef27fff640 1 --2- 172.21.15.123:0/3637428462 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fef300b2d40 0x7fef18004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:25.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.192+0000 7fef35641640 1 -- 172.21.15.123:0/3637428462 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fef300b2d40 msgr2=0x7fef18004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:25.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.192+0000 7fef35641640 1 --2- 172.21.15.123:0/3637428462 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fef300b2d40 0x7fef18004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:25.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.192+0000 7fef35641640 1 -- 172.21.15.123:0/3637428462 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef180039e0 msgr2=0x7fef18003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:25.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.192+0000 7fef35641640 1 --2- 172.21.15.123:0/3637428462 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef180039e0 0x7fef18003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:25.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.192+0000 7fef35641640 1 -- 172.21.15.123:0/3637428462 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef18003520 con 0x7fef18004d40 2024-09-15T23:16:25.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.193+0000 7fef35641640 1 --2- 172.21.15.123:0/3637428462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef18004d40 0x7fef180051c0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fef2800a810 tx=0x7fef18005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=894bf97710a059c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:25.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.193+0000 7fef277fe640 1 -- 172.21.15.123:0/3637428462 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2800a460 con 0x7fef18004d40 2024-09-15T23:16:25.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.193+0000 7fef277fe640 1 -- 172.21.15.123:0/3637428462 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef2802f070 con 0x7fef18004d40 2024-09-15T23:16:25.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.193+0000 7fef277fe640 1 -- 172.21.15.123:0/3637428462 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2802bc90 con 0x7fef18004d40 2024-09-15T23:16:25.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.193+0000 7fef370a4640 1 -- 172.21.15.123:0/3637428462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef18004d40 msgr2=0x7fef180051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:25.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.193+0000 7fef370a4640 1 --2- 172.21.15.123:0/3637428462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef18004d40 0x7fef180051c0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fef2800a810 tx=0x7fef18005830 comp rx=0 tx=0).stop 2024-09-15T23:16:25.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.193+0000 7fef35641640 1 -- 172.21.15.123:0/3637428462 reap_dead start 2024-09-15T23:16:25.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.193+0000 7fef370a4640 1 -- 172.21.15.123:0/3637428462 shutdown_connections 2024-09-15T23:16:25.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.193+0000 7fef370a4640 1 -- 172.21.15.123:0/3637428462 >> 172.21.15.123:0/3637428462 conn(0x7fef300ccec0 msgr2=0x7fef300cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:25.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.193+0000 7fef370a4640 1 -- 172.21.15.123:0/3637428462 shutdown_connections 2024-09-15T23:16:25.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.193+0000 7fef370a4640 1 -- 172.21.15.123:0/3637428462 wait complete. 2024-09-15T23:16:25.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.195+0000 7fef370a4640 1 Processor -- start 2024-09-15T23:16:25.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.195+0000 7fef370a4640 1 -- start start 2024-09-15T23:16:25.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.195+0000 7fef370a4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef30154bf0 0x7fef300b5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:25.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.195+0000 7fef370a4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef300b5b60 0x7fef30137220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:25.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.195+0000 7fef370a4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fef30137760 0x7fef30137be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:25.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.195+0000 7fef370a4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fef3006bfa0 con 0x7fef30154bf0 2024-09-15T23:16:25.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.195+0000 7fef370a4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fef3006be20 con 0x7fef300b5b60 2024-09-15T23:16:25.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.195+0000 7fef370a4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fef3015c400 con 0x7fef30137760 2024-09-15T23:16:25.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.195+0000 7fef34e40640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef30154bf0 0x7fef300b5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:25.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.196+0000 7fef34e40640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef30154bf0 0x7fef300b5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44058/0 (socket says 172.21.15.123:44058) 2024-09-15T23:16:25.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.196+0000 7fef34e40640 1 -- 172.21.15.123:0/4130964636 learned_addr learned my addr 172.21.15.123:0/4130964636 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:25.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.196+0000 7fef35641640 1 --2- 172.21.15.123:0/4130964636 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fef30137760 0x7fef30137be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:25.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.196+0000 7fef27fff640 1 --2- 172.21.15.123:0/4130964636 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef300b5b60 0x7fef30137220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:25.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.196+0000 7fef34e40640 1 -- 172.21.15.123:0/4130964636 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fef30137760 msgr2=0x7fef30137be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:25.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.196+0000 7fef34e40640 1 --2- 172.21.15.123:0/4130964636 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fef30137760 0x7fef30137be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:25.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.196+0000 7fef34e40640 1 -- 172.21.15.123:0/4130964636 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef300b5b60 msgr2=0x7fef30137220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:25.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.196+0000 7fef34e40640 1 --2- 172.21.15.123:0/4130964636 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef300b5b60 0x7fef30137220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:25.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.196+0000 7fef34e40640 1 -- 172.21.15.123:0/4130964636 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef300b4470 con 0x7fef30154bf0 2024-09-15T23:16:25.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.196+0000 7fef34e40640 1 --2- 172.21.15.123:0/4130964636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef30154bf0 0x7fef300b5620 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0119d0 tx=0x7fef2c011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:25.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.196+0000 7fef257fa640 1 -- 172.21.15.123:0/4130964636 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c00fa90 con 0x7fef30154bf0 2024-09-15T23:16:25.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.196+0000 7fef257fa640 1 -- 172.21.15.123:0/4130964636 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef2c00fc30 con 0x7fef30154bf0 2024-09-15T23:16:25.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.196+0000 7fef257fa640 1 -- 172.21.15.123:0/4130964636 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2c014440 con 0x7fef30154bf0 2024-09-15T23:16:25.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.196+0000 7fef370a4640 1 -- 172.21.15.123:0/4130964636 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef300b4750 con 0x7fef30154bf0 2024-09-15T23:16:25.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.196+0000 7fef370a4640 1 -- 172.21.15.123:0/4130964636 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef300b4d10 con 0x7fef30154bf0 2024-09-15T23:16:25.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.197+0000 7fef370a4640 1 -- 172.21.15.123:0/4130964636 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef3015bcf0 con 0x7fef30154bf0 2024-09-15T23:16:25.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.198+0000 7fef257fa640 1 -- 172.21.15.123:0/4130964636 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fef2c012040 con 0x7fef30154bf0 2024-09-15T23:16:25.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.198+0000 7fef257fa640 1 --2- 172.21.15.123:0/4130964636 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fef1c06c2b0 0x7fef1c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:25.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.198+0000 7fef257fa640 1 -- 172.21.15.123:0/4130964636 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5967+0+0 (secure 0 0 0) 0x7fef2c08ba80 con 0x7fef30154bf0 2024-09-15T23:16:25.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.198+0000 7fef27fff640 1 --2- 172.21.15.123:0/4130964636 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fef1c06c2b0 0x7fef1c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:25.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.199+0000 7fef27fff640 1 --2- 172.21.15.123:0/4130964636 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fef1c06c2b0 0x7fef1c06e770 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fef30138b40 tx=0x7fef20009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:25.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.203+0000 7fef257fa640 1 -- 172.21.15.123:0/4130964636 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fef2c019030 con 0x7fef30154bf0 2024-09-15T23:16:25.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.372+0000 7fef370a4640 1 -- 172.21.15.123:0/4130964636 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fef300b5f40 con 0x7fef30154bf0 2024-09-15T23:16:25.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.373+0000 7fef257fa640 1 -- 172.21.15.123:0/4130964636 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+17085 (secure 0 0 0) 0x7fef2c05a180 con 0x7fef30154bf0 2024-09-15T23:16:25.374 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:16:25.374 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":86,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:16:07.004552+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:15:52.548725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-15T23:15:53.192974+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.188:6837/2597191885":"2024-09-16T23:16:07.004532+0000","172.21.15.188:6835/2597191885":"2024-09-16T23:16:07.004532+0000","172.21.15.123:6834/3814257760":"2024-09-16T23:16:06.705374+0000","172.21.15.123:6832/3814257760":"2024-09-16T23:16:06.705374+0000","172.21.15.123:6835/839817134":"2024-09-16T23:16:06.696474+0000","172.21.15.123:6833/839817134":"2024-09-16T23:16:06.696474+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:16:25.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.375+0000 7fef370a4640 1 -- 172.21.15.123:0/4130964636 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fef1c06c2b0 msgr2=0x7fef1c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:25.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.375+0000 7fef370a4640 1 --2- 172.21.15.123:0/4130964636 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fef1c06c2b0 0x7fef1c06e770 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fef30138b40 tx=0x7fef20009040 comp rx=0 tx=0).stop 2024-09-15T23:16:25.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.375+0000 7fef370a4640 1 -- 172.21.15.123:0/4130964636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef30154bf0 msgr2=0x7fef300b5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:25.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.375+0000 7fef370a4640 1 --2- 172.21.15.123:0/4130964636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef30154bf0 0x7fef300b5620 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fef2c0119d0 tx=0x7fef2c011e90 comp rx=0 tx=0).stop 2024-09-15T23:16:25.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.375+0000 7fef370a4640 1 -- 172.21.15.123:0/4130964636 shutdown_connections 2024-09-15T23:16:25.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.375+0000 7fef370a4640 1 --2- 172.21.15.123:0/4130964636 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fef30137760 0x7fef30137be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:25.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.375+0000 7fef370a4640 1 --2- 172.21.15.123:0/4130964636 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef300b5b60 0x7fef30137220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:25.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.375+0000 7fef370a4640 1 --2- 172.21.15.123:0/4130964636 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fef1c06c2b0 0x7fef1c06e770 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:25.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.375+0000 7fef370a4640 1 --2- 172.21.15.123:0/4130964636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef30154bf0 0x7fef300b5620 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:25.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.375+0000 7fef370a4640 1 -- 172.21.15.123:0/4130964636 >> 172.21.15.123:0/4130964636 conn(0x7fef300ccec0 msgr2=0x7fef3013efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:25.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.375+0000 7fef370a4640 1 -- 172.21.15.123:0/4130964636 shutdown_connections 2024-09-15T23:16:25.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.375+0000 7fef370a4640 1 -- 172.21.15.123:0/4130964636 wait complete. 2024-09-15T23:16:25.387 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T23:16:25.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.486+0000 7f8600791640 1 Processor -- start 2024-09-15T23:16:25.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.486+0000 7f8600791640 1 -- start start 2024-09-15T23:16:25.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.487+0000 7f8600791640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f85f815eab0 0x7f85f815ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:25.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.487+0000 7f8600791640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f85f8162490 0x7f85f80d2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:25.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.487+0000 7f8600791640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85f815f570 con 0x7f85f80b66b0 2024-09-15T23:16:25.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.487+0000 7f8600791640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f85f815f850 con 0x7f85f8162490 2024-09-15T23:16:25.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.487+0000 7f8600791640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f85f815fb30 con 0x7f85f815eab0 2024-09-15T23:16:25.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.487+0000 7f85fdd2c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f85f8162490 0x7f85f80d2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:25.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.487+0000 7f85fdd2c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f85f8162490 0x7f85f80d2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44070/0 (socket says 172.21.15.123:44070) 2024-09-15T23:16:25.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.487+0000 7f85fdd2c640 1 -- 172.21.15.123:0/3721125597 learned_addr learned my addr 172.21.15.123:0/3721125597 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:25.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.487+0000 7f85fe52d640 1 --2- 172.21.15.123:0/3721125597 >> v2:172.21.15.188:3300/0 conn(0x7f85f815eab0 0x7f85f815ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:25.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.487+0000 7f85fdd2c640 1 -- 172.21.15.123:0/3721125597 >> v2:172.21.15.188:3300/0 conn(0x7f85f815eab0 msgr2=0x7f85f815ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:25.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.487+0000 7f85fdd2c640 1 --2- 172.21.15.123:0/3721125597 >> v2:172.21.15.188:3300/0 conn(0x7f85f815eab0 0x7f85f815ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:25.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.487+0000 7f85fdd2c640 1 -- 172.21.15.123:0/3721125597 >> v1:172.21.15.188:6789/0 conn(0x7f85f80b66b0 legacy=0x7f85f80b6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:25.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.487+0000 7f85fdd2c640 1 -- 172.21.15.123:0/3721125597 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f815fe10 con 0x7f85f8162490 2024-09-15T23:16:25.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.487+0000 7f85fe52d640 1 --2- 172.21.15.123:0/3721125597 >> v2:172.21.15.188:3300/0 conn(0x7f85f815eab0 0x7f85f815ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:16:25.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.488+0000 7f85fdd2c640 1 --2- 172.21.15.123:0/3721125597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85f8162490 0x7f85f80d2c30 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f85f80cb8b0 tx=0x7f85e802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7741d83f2aee41e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:25.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.488+0000 7f85fd52b640 1 -- 172.21.15.123:0/3721125597 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e8037070 con 0x7f85f8162490 2024-09-15T23:16:25.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.488+0000 7f85fd52b640 1 -- 172.21.15.123:0/3721125597 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85e8032440 con 0x7f85f8162490 2024-09-15T23:16:25.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.488+0000 7f85fd52b640 1 -- 172.21.15.123:0/3721125597 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e8032810 con 0x7f85f8162490 2024-09-15T23:16:25.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.488+0000 7f8600791640 1 -- 172.21.15.123:0/3721125597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85f8162490 msgr2=0x7f85f80d2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:25.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.488+0000 7f8600791640 1 --2- 172.21.15.123:0/3721125597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85f8162490 0x7f85f80d2c30 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f85f80cb8b0 tx=0x7f85e802a230 comp rx=0 tx=0).stop 2024-09-15T23:16:25.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.489+0000 7f8600791640 1 -- 172.21.15.123:0/3721125597 shutdown_connections 2024-09-15T23:16:25.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.489+0000 7f8600791640 1 --2- 172.21.15.123:0/3721125597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85f8162490 0x7f85f80d2c30 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:25.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.489+0000 7f8600791640 1 --2- 172.21.15.123:0/3721125597 >> v2:172.21.15.188:3300/0 conn(0x7f85f815eab0 0x7f85f815ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:25.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.489+0000 7f8600791640 1 -- 172.21.15.123:0/3721125597 >> 172.21.15.123:0/3721125597 conn(0x7f85f80d16d0 msgr2=0x7f85f80d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:25.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.489+0000 7f8600791640 1 -- 172.21.15.123:0/3721125597 shutdown_connections 2024-09-15T23:16:25.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.489+0000 7f8600791640 1 -- 172.21.15.123:0/3721125597 wait complete. 2024-09-15T23:16:25.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.490+0000 7f8600791640 1 Processor -- start 2024-09-15T23:16:25.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.490+0000 7f8600791640 1 -- start start 2024-09-15T23:16:25.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.490+0000 7f8600791640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85f80b66b0 0x7f85f80c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:25.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.490+0000 7f8600791640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85f815eab0 0x7f85f814fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:25.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.490+0000 7f8600791640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85f8162490 0x7f85f81e9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:25.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.490+0000 7f8600791640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f85f80d4460 con 0x7f85f80b66b0 2024-09-15T23:16:25.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.490+0000 7f8600791640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f85f80d3170 con 0x7f85f815eab0 2024-09-15T23:16:25.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.490+0000 7f8600791640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f85f80d45e0 con 0x7f85f8162490 2024-09-15T23:16:25.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.491+0000 7f85fe52d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85f80b66b0 0x7f85f80c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:25.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.491+0000 7f85fe52d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85f80b66b0 0x7f85f80c8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44074/0 (socket says 172.21.15.123:44074) 2024-09-15T23:16:25.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.491+0000 7f85fe52d640 1 -- 172.21.15.123:0/821529330 learned_addr learned my addr 172.21.15.123:0/821529330 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:25.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.491+0000 7f85fdd2c640 1 --2- 172.21.15.123:0/821529330 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85f815eab0 0x7f85f814fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:25.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.491+0000 7f85fed2e640 1 --2- 172.21.15.123:0/821529330 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85f8162490 0x7f85f81e9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:25.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.491+0000 7f85fe52d640 1 -- 172.21.15.123:0/821529330 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85f8162490 msgr2=0x7f85f81e9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:25.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.491+0000 7f85fe52d640 1 --2- 172.21.15.123:0/821529330 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85f8162490 0x7f85f81e9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:25.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.491+0000 7f85fe52d640 1 -- 172.21.15.123:0/821529330 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85f815eab0 msgr2=0x7f85f814fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:25.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.491+0000 7f85fe52d640 1 --2- 172.21.15.123:0/821529330 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85f815eab0 0x7f85f814fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:25.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.491+0000 7f85fe52d640 1 -- 172.21.15.123:0/821529330 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f80c88a0 con 0x7f85f80b66b0 2024-09-15T23:16:25.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.491+0000 7f85fe52d640 1 --2- 172.21.15.123:0/821529330 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85f80b66b0 0x7f85f80c8360 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f85f400ce00 tx=0x7f85f400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:25.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.491+0000 7f85eeffd640 1 -- 172.21.15.123:0/821529330 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f400f890 con 0x7f85f80b66b0 2024-09-15T23:16:25.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.491+0000 7f85eeffd640 1 -- 172.21.15.123:0/821529330 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85f400fa30 con 0x7f85f80b66b0 2024-09-15T23:16:25.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.491+0000 7f8600791640 1 -- 172.21.15.123:0/821529330 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85f80c8b40 con 0x7f85f80b66b0 2024-09-15T23:16:25.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.491+0000 7f85eeffd640 1 -- 172.21.15.123:0/821529330 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f400fe40 con 0x7f85f80b66b0 2024-09-15T23:16:25.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.491+0000 7f8600791640 1 -- 172.21.15.123:0/821529330 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85f80c9100 con 0x7f85f80b66b0 2024-09-15T23:16:25.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.492+0000 7f8600791640 1 -- 172.21.15.123:0/821529330 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85f80c9800 con 0x7f85f80b66b0 2024-09-15T23:16:25.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.493+0000 7f85eeffd640 1 -- 172.21.15.123:0/821529330 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f85f4018400 con 0x7f85f80b66b0 2024-09-15T23:16:25.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.493+0000 7f85eeffd640 1 --2- 172.21.15.123:0/821529330 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f85dc06c2e0 0x7f85dc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:25.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.493+0000 7f85eeffd640 1 -- 172.21.15.123:0/821529330 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5967+0+0 (secure 0 0 0) 0x7f85f408c0a0 con 0x7f85f80b66b0 2024-09-15T23:16:25.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.493+0000 7f85fdd2c640 1 --2- 172.21.15.123:0/821529330 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f85dc06c2e0 0x7f85dc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:25.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.494+0000 7f85fdd2c640 1 --2- 172.21.15.123:0/821529330 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f85dc06c2e0 0x7f85dc06e7a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f85e8034000 tx=0x7f85e802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:25.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.497+0000 7f85eeffd640 1 -- 172.21.15.123:0/821529330 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f85f4014030 con 0x7f85f80b66b0 2024-09-15T23:16:25.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.697+0000 7f8600791640 1 -- 172.21.15.123:0/821529330 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f85f80d2500 con 0x7f85f80b66b0 2024-09-15T23:16:25.698 INFO:tasks.ceph.mon.a.smithi123.stderr:2024-09-15T23:16:25.697+0000 7f8a6ccf0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:16:25.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.698+0000 7f85eeffd640 1 -- 172.21.15.123:0/821529330 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v54) ==== 161+0+0 (secure 0 0 0) 0x7f85f400ae20 con 0x7f85f80b66b0 2024-09-15T23:16:25.699 INFO:teuthology.orchestra.run.smithi123.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T23:16:25.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.701+0000 7f8600791640 1 -- 172.21.15.123:0/821529330 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f85dc06c2e0 msgr2=0x7f85dc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:25.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.701+0000 7f8600791640 1 --2- 172.21.15.123:0/821529330 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f85dc06c2e0 0x7f85dc06e7a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f85e8034000 tx=0x7f85e802e000 comp rx=0 tx=0).stop 2024-09-15T23:16:25.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.701+0000 7f8600791640 1 -- 172.21.15.123:0/821529330 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85f80b66b0 msgr2=0x7f85f80c8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:25.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.701+0000 7f8600791640 1 --2- 172.21.15.123:0/821529330 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85f80b66b0 0x7f85f80c8360 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f85f400ce00 tx=0x7f85f400a650 comp rx=0 tx=0).stop 2024-09-15T23:16:25.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.701+0000 7f8600791640 1 -- 172.21.15.123:0/821529330 shutdown_connections 2024-09-15T23:16:25.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.701+0000 7f8600791640 1 --2- 172.21.15.123:0/821529330 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85f8162490 0x7f85f81e9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:25.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.701+0000 7f8600791640 1 --2- 172.21.15.123:0/821529330 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85f815eab0 0x7f85f814fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:25.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.701+0000 7f8600791640 1 --2- 172.21.15.123:0/821529330 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f85dc06c2e0 0x7f85dc06e7a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:25.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.701+0000 7f8600791640 1 --2- 172.21.15.123:0/821529330 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85f80b66b0 0x7f85f80c8360 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:25.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.701+0000 7f8600791640 1 -- 172.21.15.123:0/821529330 >> 172.21.15.123:0/821529330 conn(0x7f85f80d16d0 msgr2=0x7f85f80d3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:25.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.701+0000 7f8600791640 1 -- 172.21.15.123:0/821529330 shutdown_connections 2024-09-15T23:16:25.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.701+0000 7f8600791640 1 -- 172.21.15.123:0/821529330 wait complete. 2024-09-15T23:16:25.704 INFO:tasks.ceph.mds.c.smithi123.stderr: -2354> 2024-09-15T23:16:12.016+0000 7f0527090640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:16:25.714 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T23:16:25.731 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-15T23:16:25.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.815+0000 7f5f6d88b640 1 Processor -- start 2024-09-15T23:16:25.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.815+0000 7f5f6d88b640 1 -- start start 2024-09-15T23:16:25.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.815+0000 7f5f6d88b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f5f680b6e00 0x7f5f680d3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:25.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.815+0000 7f5f6d88b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5f68071160 0x7f5f6806cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:25.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.815+0000 7f5f6d88b640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f6815ec10 con 0x7f5f68162d90 2024-09-15T23:16:25.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.815+0000 7f5f6d88b640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f5f6806e7f0 con 0x7f5f68071160 2024-09-15T23:16:25.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.815+0000 7f5f6d88b640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f5f681631d0 con 0x7f5f680b6e00 2024-09-15T23:16:25.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.816+0000 7f5f677fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5f68071160 0x7f5f6806cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:25.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.816+0000 7f5f677fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5f68071160 0x7f5f6806cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44090/0 (socket says 172.21.15.123:44090) 2024-09-15T23:16:25.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.816+0000 7f5f667fc640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f5f68162d90 0x7f5f680b71e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58154/0 (socket says 172.21.15.123:58154) 2024-09-15T23:16:25.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.816+0000 7f5f677fe640 1 -- 172.21.15.123:0/3568868344 learned_addr learned my addr 172.21.15.123:0/3568868344 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:25.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.816+0000 7f5f66ffd640 1 --2- 172.21.15.123:0/3568868344 >> v2:172.21.15.188:3300/0 conn(0x7f5f680b6e00 0x7f5f680d3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:25.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.816+0000 7f5f677fe640 1 -- 172.21.15.123:0/3568868344 >> v2:172.21.15.188:3300/0 conn(0x7f5f680b6e00 msgr2=0x7f5f680d3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:25.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.816+0000 7f5f677fe640 1 --2- 172.21.15.123:0/3568868344 >> v2:172.21.15.188:3300/0 conn(0x7f5f680b6e00 0x7f5f680d3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:25.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.816+0000 7f5f677fe640 1 -- 172.21.15.123:0/3568868344 >> v1:172.21.15.123:6789/0 conn(0x7f5f68162d90 legacy=0x7f5f680b71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:25.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.816+0000 7f5f65ffb640 1 -- 172.21.15.123:0/3568868344 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2745282238 0 0) 0x7f5f6815ec10 con 0x7f5f68162d90 2024-09-15T23:16:25.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.816+0000 7f5f677fe640 1 -- 172.21.15.123:0/3568868344 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f6806ed20 con 0x7f5f68071160 2024-09-15T23:16:25.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.817+0000 7f5f677fe640 1 --2- 172.21.15.123:0/3568868344 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f68071160 0x7f5f6806cd20 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f5f6806b0d0 tx=0x7f5f6002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=739388286753d401 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:25.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.817+0000 7f5f65ffb640 1 -- 172.21.15.123:0/3568868344 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f60036070 con 0x7f5f68071160 2024-09-15T23:16:25.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.817+0000 7f5f65ffb640 1 -- 172.21.15.123:0/3568868344 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f60031600 con 0x7f5f68071160 2024-09-15T23:16:25.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.817+0000 7f5f65ffb640 1 -- 172.21.15.123:0/3568868344 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f600319d0 con 0x7f5f68071160 2024-09-15T23:16:25.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.817+0000 7f5f6d88b640 1 -- 172.21.15.123:0/3568868344 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f68071160 msgr2=0x7f5f6806cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:25.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.817+0000 7f5f6d88b640 1 --2- 172.21.15.123:0/3568868344 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f68071160 0x7f5f6806cd20 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f5f6806b0d0 tx=0x7f5f6002a610 comp rx=0 tx=0).stop 2024-09-15T23:16:25.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.817+0000 7f5f6d88b640 1 -- 172.21.15.123:0/3568868344 shutdown_connections 2024-09-15T23:16:25.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.817+0000 7f5f6d88b640 1 --2- 172.21.15.123:0/3568868344 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f68071160 0x7f5f6806cd20 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:25.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.817+0000 7f5f6d88b640 1 --2- 172.21.15.123:0/3568868344 >> v2:172.21.15.188:3300/0 conn(0x7f5f680b6e00 0x7f5f680d3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:25.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.817+0000 7f5f6d88b640 1 -- 172.21.15.123:0/3568868344 >> 172.21.15.123:0/3568868344 conn(0x7f5f680d2550 msgr2=0x7f5f680d2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:25.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.817+0000 7f5f6d88b640 1 -- 172.21.15.123:0/3568868344 shutdown_connections 2024-09-15T23:16:25.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.817+0000 7f5f6d88b640 1 -- 172.21.15.123:0/3568868344 wait complete. 2024-09-15T23:16:25.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.818+0000 7f5f6d88b640 1 Processor -- start 2024-09-15T23:16:25.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.819+0000 7f5f6d88b640 1 -- start start 2024-09-15T23:16:25.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.819+0000 7f5f6d88b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f68071160 0x7f5f68150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:25.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.819+0000 7f5f6d88b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5f680b6e00 0x7f5f680b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:25.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.819+0000 7f5f6d88b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5f68162d90 0x7f5f68159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:25.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.819+0000 7f5f6d88b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5f68070c40 con 0x7f5f68071160 2024-09-15T23:16:25.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.819+0000 7f5f6d88b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5f68070960 con 0x7f5f68162d90 2024-09-15T23:16:25.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.819+0000 7f5f6d88b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5f680d1a70 con 0x7f5f680b6e00 2024-09-15T23:16:25.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.819+0000 7f5f66ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f68071160 0x7f5f68150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:25.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.819+0000 7f5f66ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f68071160 0x7f5f68150f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44094/0 (socket says 172.21.15.123:44094) 2024-09-15T23:16:25.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.819+0000 7f5f66ffd640 1 -- 172.21.15.123:0/1873702712 learned_addr learned my addr 172.21.15.123:0/1873702712 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:25.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.820+0000 7f5f677fe640 1 --2- 172.21.15.123:0/1873702712 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5f68162d90 0x7f5f68159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:25.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.820+0000 7f5f667fc640 1 --2- 172.21.15.123:0/1873702712 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5f680b6e00 0x7f5f680b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:25.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.820+0000 7f5f66ffd640 1 -- 172.21.15.123:0/1873702712 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5f680b6e00 msgr2=0x7f5f680b2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:25.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.820+0000 7f5f66ffd640 1 --2- 172.21.15.123:0/1873702712 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5f680b6e00 0x7f5f680b2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:25.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.820+0000 7f5f66ffd640 1 -- 172.21.15.123:0/1873702712 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5f68162d90 msgr2=0x7f5f68159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:25.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.820+0000 7f5f66ffd640 1 --2- 172.21.15.123:0/1873702712 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5f68162d90 0x7f5f68159fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:25.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.820+0000 7f5f66ffd640 1 -- 172.21.15.123:0/1873702712 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f6815eea0 con 0x7f5f68071160 2024-09-15T23:16:25.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.820+0000 7f5f66ffd640 1 --2- 172.21.15.123:0/1873702712 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f68071160 0x7f5f68150f70 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f5f5800c7f0 tx=0x7f5f5800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:25.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.820+0000 7f5f5ffff640 1 -- 172.21.15.123:0/1873702712 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f58015070 con 0x7f5f68071160 2024-09-15T23:16:25.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.820+0000 7f5f5ffff640 1 -- 172.21.15.123:0/1873702712 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f58004240 con 0x7f5f68071160 2024-09-15T23:16:25.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.820+0000 7f5f6d88b640 1 -- 172.21.15.123:0/1873702712 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f6815f180 con 0x7f5f68071160 2024-09-15T23:16:25.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.820+0000 7f5f5ffff640 1 -- 172.21.15.123:0/1873702712 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f58007620 con 0x7f5f68071160 2024-09-15T23:16:25.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.820+0000 7f5f6d88b640 1 -- 172.21.15.123:0/1873702712 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f6815f740 con 0x7f5f68071160 2024-09-15T23:16:25.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.821+0000 7f5f6d88b640 1 -- 172.21.15.123:0/1873702712 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f680715d0 con 0x7f5f68071160 2024-09-15T23:16:25.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.822+0000 7f5f5ffff640 1 -- 172.21.15.123:0/1873702712 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5f580079d0 con 0x7f5f68071160 2024-09-15T23:16:25.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.822+0000 7f5f5ffff640 1 --2- 172.21.15.123:0/1873702712 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5f4806c2b0 0x7f5f4806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:25.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.822+0000 7f5f5ffff640 1 -- 172.21.15.123:0/1873702712 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6053+0+0 (secure 0 0 0) 0x7f5f5808b640 con 0x7f5f68071160 2024-09-15T23:16:25.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.822+0000 7f5f667fc640 1 --2- 172.21.15.123:0/1873702712 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5f4806c2b0 0x7f5f4806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:25.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.823+0000 7f5f667fc640 1 --2- 172.21.15.123:0/1873702712 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5f4806c2b0 0x7f5f4806e770 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5f68076210 tx=0x7f5f50007c00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:25.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:25.826+0000 7f5f5ffff640 1 -- 172.21.15.123:0/1873702712 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5f58059ce0 con 0x7f5f68071160 2024-09-15T23:16:26.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.028+0000 7f5f6d88b640 1 -- 172.21.15.123:0/1873702712 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f5f680b32a0 con 0x7f5f68071160 2024-09-15T23:16:26.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.700+0000 7f5f5ffff640 1 -- 172.21.15.123:0/1873702712 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v55) ==== 104+0+0 (secure 0 0 0) 0x7f5f580595e0 con 0x7f5f68071160 2024-09-15T23:16:26.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.702+0000 7f5f6d88b640 1 -- 172.21.15.123:0/1873702712 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5f4806c2b0 msgr2=0x7f5f4806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:26.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.702+0000 7f5f6d88b640 1 --2- 172.21.15.123:0/1873702712 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5f4806c2b0 0x7f5f4806e770 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5f68076210 tx=0x7f5f50007c00 comp rx=0 tx=0).stop 2024-09-15T23:16:26.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.702+0000 7f5f6d88b640 1 -- 172.21.15.123:0/1873702712 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f68071160 msgr2=0x7f5f68150f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:26.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.702+0000 7f5f6d88b640 1 --2- 172.21.15.123:0/1873702712 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f68071160 0x7f5f68150f70 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f5f5800c7f0 tx=0x7f5f5800ccb0 comp rx=0 tx=0).stop 2024-09-15T23:16:26.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.702+0000 7f5f6d88b640 1 -- 172.21.15.123:0/1873702712 shutdown_connections 2024-09-15T23:16:26.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.702+0000 7f5f6d88b640 1 --2- 172.21.15.123:0/1873702712 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5f68162d90 0x7f5f68159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:26.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.702+0000 7f5f6d88b640 1 --2- 172.21.15.123:0/1873702712 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5f680b6e00 0x7f5f680b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:26.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.702+0000 7f5f6d88b640 1 --2- 172.21.15.123:0/1873702712 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5f4806c2b0 0x7f5f4806e770 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:26.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.702+0000 7f5f6d88b640 1 --2- 172.21.15.123:0/1873702712 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f68071160 0x7f5f68150f70 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:26.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.702+0000 7f5f6d88b640 1 -- 172.21.15.123:0/1873702712 >> 172.21.15.123:0/1873702712 conn(0x7f5f680d2550 msgr2=0x7f5f680b2140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:26.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.702+0000 7f5f6d88b640 1 -- 172.21.15.123:0/1873702712 shutdown_connections 2024-09-15T23:16:26.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.703+0000 7f5f6d88b640 1 -- 172.21.15.123:0/1873702712 wait complete. 2024-09-15T23:16:26.715 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T23:16:26.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.860+0000 7f6f5d76d640 1 Processor -- start 2024-09-15T23:16:26.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.861+0000 7f6f5d76d640 1 -- start start 2024-09-15T23:16:26.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.861+0000 7f6f5d76d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f6f5815bab0 0x7f6f580b5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:26.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.861+0000 7f6f5d76d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f580b5dc0 con 0x7f6f580b59c0 2024-09-15T23:16:26.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.861+0000 7f6f5d76d640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f580b35e0 con 0x7f6f5815b6d0 2024-09-15T23:16:26.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.861+0000 7f6f5d76d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f6f580b38a0 con 0x7f6f5815bab0 2024-09-15T23:16:26.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.861+0000 7f6f577fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6f580b59c0 0x7f6f580b0b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38388/0 (socket says 172.21.15.123:38388) 2024-09-15T23:16:26.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.862+0000 7f6f577fe640 1 -- 172.21.15.123:0/416657680 learned_addr learned my addr 172.21.15.123:0/416657680 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:26.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.862+0000 7f6f55ffb640 1 -- 172.21.15.123:0/416657680 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 411938997 0 0) 0x7f6f580b5dc0 con 0x7f6f580b59c0 2024-09-15T23:16:26.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.862+0000 7f6f567fc640 1 --2- 172.21.15.123:0/416657680 >> v2:172.21.15.188:3300/0 conn(0x7f6f5815bab0 0x7f6f580b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:26.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.862+0000 7f6f55ffb640 1 -- 172.21.15.123:0/416657680 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f40005730 con 0x7f6f580b59c0 2024-09-15T23:16:26.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.862+0000 7f6f55ffb640 1 -- 172.21.15.123:0/416657680 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 201200496 0 0) 0x7f6f40005730 con 0x7f6f580b59c0 2024-09-15T23:16:26.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.862+0000 7f6f55ffb640 1 -- 172.21.15.123:0/416657680 >> v2:172.21.15.188:3300/0 conn(0x7f6f5815bab0 msgr2=0x7f6f580b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:26.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.862+0000 7f6f55ffb640 1 --2- 172.21.15.123:0/416657680 >> v2:172.21.15.188:3300/0 conn(0x7f6f5815bab0 0x7f6f580b5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:26.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.862+0000 7f6f55ffb640 1 -- 172.21.15.123:0/416657680 >> v1:172.21.15.188:6789/0 conn(0x7f6f5815b6d0 legacy=0x7f6f580b4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:26.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.862+0000 7f6f55ffb640 1 -- 172.21.15.123:0/416657680 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f580b3b80 con 0x7f6f580b59c0 2024-09-15T23:16:26.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.862+0000 7f6f55ffb640 1 -- 172.21.15.123:0/416657680 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f6f500019f0 con 0x7f6f580b59c0 2024-09-15T23:16:26.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.862+0000 7f6f55ffb640 1 -- 172.21.15.123:0/416657680 >> v1:172.21.15.123:6789/0 conn(0x7f6f580b59c0 legacy=0x7f6f580b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:26.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.862+0000 7f6f55ffb640 1 --2- 172.21.15.123:0/416657680 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f40005bc0 0x7f6f40005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:26.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.862+0000 7f6f55ffb640 1 --2- 172.21.15.123:0/416657680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f40006a10 0x7f6f40006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:26.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.862+0000 7f6f55ffb640 1 --2- 172.21.15.123:0/416657680 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6f400073d0 0x7f6f4000dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:26.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.862+0000 7f6f55ffb640 1 -- 172.21.15.123:0/416657680 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6f580b38a0 con 0x7f6f40006a10 2024-09-15T23:16:26.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.862+0000 7f6f55ffb640 1 -- 172.21.15.123:0/416657680 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6f4000e270 con 0x7f6f400073d0 2024-09-15T23:16:26.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.862+0000 7f6f55ffb640 1 -- 172.21.15.123:0/416657680 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6f4000e470 con 0x7f6f40005bc0 2024-09-15T23:16:26.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.862+0000 7f6f567fc640 1 --2- 172.21.15.123:0/416657680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f40006a10 0x7f6f40006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:26.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.862+0000 7f6f56ffd640 1 --2- 172.21.15.123:0/416657680 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f40005bc0 0x7f6f40005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:26.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.862+0000 7f6f577fe640 1 --2- 172.21.15.123:0/416657680 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6f400073d0 0x7f6f4000dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:26.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.862+0000 7f6f567fc640 1 -- 172.21.15.123:0/416657680 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f40005bc0 msgr2=0x7f6f40005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:26.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.862+0000 7f6f567fc640 1 --2- 172.21.15.123:0/416657680 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f40005bc0 0x7f6f40005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:26.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.862+0000 7f6f567fc640 1 -- 172.21.15.123:0/416657680 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6f400073d0 msgr2=0x7f6f4000dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:26.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.862+0000 7f6f567fc640 1 --2- 172.21.15.123:0/416657680 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6f400073d0 0x7f6f4000dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:26.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.863+0000 7f6f567fc640 1 -- 172.21.15.123:0/416657680 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f40005730 con 0x7f6f40006a10 2024-09-15T23:16:26.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.863+0000 7f6f577fe640 1 -- 172.21.15.123:0/416657680 reap_dead start 2024-09-15T23:16:26.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.863+0000 7f6f56ffd640 1 --2- 172.21.15.123:0/416657680 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f40005bc0 0x7f6f40005fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:16:26.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.863+0000 7f6f567fc640 1 --2- 172.21.15.123:0/416657680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f40006a10 0x7f6f40006e90 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c009ac0 tx=0x7f6f40007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=387882077d6029e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:26.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.863+0000 7f6f55ffb640 1 -- 172.21.15.123:0/416657680 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c036070 con 0x7f6f40006a10 2024-09-15T23:16:26.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.863+0000 7f6f55ffb640 1 -- 172.21.15.123:0/416657680 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f4c031400 con 0x7f6f40006a10 2024-09-15T23:16:26.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.863+0000 7f6f55ffb640 1 -- 172.21.15.123:0/416657680 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c009690 con 0x7f6f40006a10 2024-09-15T23:16:26.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.864+0000 7f6f5d76d640 1 -- 172.21.15.123:0/416657680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f40006a10 msgr2=0x7f6f40006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:26.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.864+0000 7f6f5d76d640 1 --2- 172.21.15.123:0/416657680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f40006a10 0x7f6f40006e90 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c009ac0 tx=0x7f6f40007a40 comp rx=0 tx=0).stop 2024-09-15T23:16:26.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.864+0000 7f6f5d76d640 1 -- 172.21.15.123:0/416657680 shutdown_connections 2024-09-15T23:16:26.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.864+0000 7f6f5d76d640 1 --2- 172.21.15.123:0/416657680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f40006a10 0x7f6f40006e90 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:26.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.864+0000 7f6f5d76d640 1 -- 172.21.15.123:0/416657680 >> 172.21.15.123:0/416657680 conn(0x7f6f5806c240 msgr2=0x7f6f5806d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:26.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.864+0000 7f6f5d76d640 1 -- 172.21.15.123:0/416657680 shutdown_connections 2024-09-15T23:16:26.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.864+0000 7f6f5d76d640 1 -- 172.21.15.123:0/416657680 wait complete. 2024-09-15T23:16:26.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.865+0000 7f6f5d76d640 1 Processor -- start 2024-09-15T23:16:26.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.865+0000 7f6f5d76d640 1 -- start start 2024-09-15T23:16:26.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.866+0000 7f6f5d76d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f40006a10 0x7f6f581f0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:26.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.866+0000 7f6f5d76d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6f5814d030 0x7f6f5814d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:26.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.866+0000 7f6f5d76d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f580b0fa0 0x7f6f580b1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:26.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.866+0000 7f6f5d76d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5815bf20 con 0x7f6f40006a10 2024-09-15T23:16:26.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.866+0000 7f6f5d76d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6f580b4140 con 0x7f6f5814d030 2024-09-15T23:16:26.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.866+0000 7f6f5d76d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6f5815c0a0 con 0x7f6f580b0fa0 2024-09-15T23:16:26.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.866+0000 7f6f56ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f40006a10 0x7f6f581f0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:26.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.866+0000 7f6f56ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f40006a10 0x7f6f581f0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41750/0 (socket says 172.21.15.123:41750) 2024-09-15T23:16:26.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.866+0000 7f6f56ffd640 1 -- 172.21.15.123:0/1543108448 learned_addr learned my addr 172.21.15.123:0/1543108448 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:26.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.866+0000 7f6f567fc640 1 --2- 172.21.15.123:0/1543108448 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6f5814d030 0x7f6f5814d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:26.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.866+0000 7f6f577fe640 1 --2- 172.21.15.123:0/1543108448 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f580b0fa0 0x7f6f580b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:26.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.866+0000 7f6f56ffd640 1 -- 172.21.15.123:0/1543108448 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f580b0fa0 msgr2=0x7f6f580b1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:26.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.866+0000 7f6f56ffd640 1 --2- 172.21.15.123:0/1543108448 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f580b0fa0 0x7f6f580b1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:26.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.866+0000 7f6f56ffd640 1 -- 172.21.15.123:0/1543108448 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6f5814d030 msgr2=0x7f6f5814d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:26.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.866+0000 7f6f56ffd640 1 --2- 172.21.15.123:0/1543108448 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6f5814d030 0x7f6f5814d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:26.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.866+0000 7f6f56ffd640 1 -- 172.21.15.123:0/1543108448 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f5814db80 con 0x7f6f40006a10 2024-09-15T23:16:26.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.866+0000 7f6f577fe640 1 --2- 172.21.15.123:0/1543108448 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f580b0fa0 0x7f6f580b1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:16:26.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.867+0000 7f6f56ffd640 1 --2- 172.21.15.123:0/1543108448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f40006a10 0x7f6f581f0190 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f6f4800e4b0 tx=0x7f6f4800e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:26.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.867+0000 7f6f3f7fe640 1 -- 172.21.15.123:0/1543108448 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f480052e0 con 0x7f6f40006a10 2024-09-15T23:16:26.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.867+0000 7f6f3f7fe640 1 -- 172.21.15.123:0/1543108448 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f48007020 con 0x7f6f40006a10 2024-09-15T23:16:26.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.867+0000 7f6f5d76d640 1 -- 172.21.15.123:0/1543108448 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f5814e140 con 0x7f6f40006a10 2024-09-15T23:16:26.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.867+0000 7f6f3f7fe640 1 -- 172.21.15.123:0/1543108448 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f48007210 con 0x7f6f40006a10 2024-09-15T23:16:26.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.867+0000 7f6f5d76d640 1 -- 172.21.15.123:0/1543108448 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f5814e700 con 0x7f6f40006a10 2024-09-15T23:16:26.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.868+0000 7f6f5d76d640 1 -- 172.21.15.123:0/1543108448 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f5814df30 con 0x7f6f40006a10 2024-09-15T23:16:26.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.868+0000 7f6f3f7fe640 1 -- 172.21.15.123:0/1543108448 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6f4801a030 con 0x7f6f40006a10 2024-09-15T23:16:26.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.869+0000 7f6f3f7fe640 1 --2- 172.21.15.123:0/1543108448 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6f4406c2e0 0x7f6f4406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:26.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.869+0000 7f6f3f7fe640 1 -- 172.21.15.123:0/1543108448 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6053+0+0 (secure 0 0 0) 0x7f6f4808a9e0 con 0x7f6f40006a10 2024-09-15T23:16:26.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.869+0000 7f6f567fc640 1 --2- 172.21.15.123:0/1543108448 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6f4406c2e0 0x7f6f4406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:26.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.869+0000 7f6f567fc640 1 --2- 172.21.15.123:0/1543108448 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6f4406c2e0 0x7f6f4406e7a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c033000 tx=0x7f6f4c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:26.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:26.873+0000 7f6f3f7fe640 1 -- 172.21.15.123:0/1543108448 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6f48021020 con 0x7f6f40006a10 2024-09-15T23:16:27.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.045+0000 7f6f5d76d640 1 -- 172.21.15.123:0/1543108448 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6f580b5480 con 0x7f6f40006a10 2024-09-15T23:16:27.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.701+0000 7f6f3f7fe640 1 -- 172.21.15.123:0/1543108448 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v88) ==== 181+0+0 (secure 0 0 0) 0x7f6f48059080 con 0x7f6f40006a10 2024-09-15T23:16:27.703 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' removed 2024-09-15T23:16:27.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.705+0000 7f6f5d76d640 1 -- 172.21.15.123:0/1543108448 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6f4406c2e0 msgr2=0x7f6f4406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:27.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.705+0000 7f6f5d76d640 1 --2- 172.21.15.123:0/1543108448 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6f4406c2e0 0x7f6f4406e7a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c033000 tx=0x7f6f4c008030 comp rx=0 tx=0).stop 2024-09-15T23:16:27.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.705+0000 7f6f5d76d640 1 -- 172.21.15.123:0/1543108448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f40006a10 msgr2=0x7f6f581f0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:27.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.705+0000 7f6f5d76d640 1 --2- 172.21.15.123:0/1543108448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f40006a10 0x7f6f581f0190 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f6f4800e4b0 tx=0x7f6f4800e970 comp rx=0 tx=0).stop 2024-09-15T23:16:27.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.706+0000 7f6f5d76d640 1 -- 172.21.15.123:0/1543108448 shutdown_connections 2024-09-15T23:16:27.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.706+0000 7f6f5d76d640 1 --2- 172.21.15.123:0/1543108448 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f580b0fa0 0x7f6f580b1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:27.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.706+0000 7f6f5d76d640 1 --2- 172.21.15.123:0/1543108448 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6f5814d030 0x7f6f5814d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:27.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.706+0000 7f6f5d76d640 1 --2- 172.21.15.123:0/1543108448 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6f4406c2e0 0x7f6f4406e7a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:27.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.706+0000 7f6f5d76d640 1 --2- 172.21.15.123:0/1543108448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f40006a10 0x7f6f581f0190 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:27.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.706+0000 7f6f5d76d640 1 -- 172.21.15.123:0/1543108448 >> 172.21.15.123:0/1543108448 conn(0x7f6f5806c240 msgr2=0x7f6f58072150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:27.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.708+0000 7f6f5d76d640 1 -- 172.21.15.123:0/1543108448 shutdown_connections 2024-09-15T23:16:27.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.708+0000 7f6f5d76d640 1 -- 172.21.15.123:0/1543108448 wait complete. 2024-09-15T23:16:27.722 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T23:16:27.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.828+0000 7fedc8766640 1 Processor -- start 2024-09-15T23:16:27.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.828+0000 7fedc8766640 1 -- start start 2024-09-15T23:16:27.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.829+0000 7fedc8766640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fedc015edb0 0x7fedc00b4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:27.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.829+0000 7fedc8766640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedc0073910 con 0x7fedc015c470 2024-09-15T23:16:27.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.829+0000 7fedc8766640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedc00b4de0 con 0x7fedc0073030 2024-09-15T23:16:27.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.829+0000 7fedc8766640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fedc015c850 con 0x7fedc015edb0 2024-09-15T23:16:27.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.829+0000 7fedc6502640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fedc015c470 0x7fedc0072920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38394/0 (socket says 172.21.15.123:38394) 2024-09-15T23:16:27.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.829+0000 7fedc6502640 1 -- 172.21.15.123:0/3830629524 learned_addr learned my addr 172.21.15.123:0/3830629524 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:27.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.829+0000 7fedc6d03640 1 --2- 172.21.15.123:0/3830629524 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fedc015edb0 0x7fedc00b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:27.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.829+0000 7fedc5500640 1 -- 172.21.15.123:0/3830629524 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2634168933 0 0) 0x7fedc0073910 con 0x7fedc015c470 2024-09-15T23:16:27.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.829+0000 7fedc5500640 1 -- 172.21.15.123:0/3830629524 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedac003520 con 0x7fedc015c470 2024-09-15T23:16:27.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.829+0000 7fedc5500640 1 -- 172.21.15.123:0/3830629524 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2714954094 0 0) 0x7fedac003520 con 0x7fedc015c470 2024-09-15T23:16:27.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.829+0000 7fedc5500640 1 -- 172.21.15.123:0/3830629524 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fedc015edb0 msgr2=0x7fedc00b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:27.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.829+0000 7fedc5500640 1 --2- 172.21.15.123:0/3830629524 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fedc015edb0 0x7fedc00b4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:27.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.829+0000 7fedc5500640 1 -- 172.21.15.123:0/3830629524 >> v1:172.21.15.188:6789/0 conn(0x7fedc0073030 legacy=0x7fedc006ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:27.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.829+0000 7fedc5500640 1 -- 172.21.15.123:0/3830629524 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedc00b50c0 con 0x7fedc015c470 2024-09-15T23:16:27.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.829+0000 7fedc5500640 1 -- 172.21.15.123:0/3830629524 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fedbc001690 con 0x7fedc015c470 2024-09-15T23:16:27.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.829+0000 7fedc5500640 1 -- 172.21.15.123:0/3830629524 >> v1:172.21.15.123:6789/0 conn(0x7fedc015c470 legacy=0x7fedc0072920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:27.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.830+0000 7fedc5500640 1 --2- 172.21.15.123:0/3830629524 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fedc015edb0 0x7fedac0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:27.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.830+0000 7fedc5500640 1 --2- 172.21.15.123:0/3830629524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fedac003f20 0x7fedac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:27.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.830+0000 7fedc5500640 1 --2- 172.21.15.123:0/3830629524 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fedac004d40 0x7fedac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:27.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.830+0000 7fedc5500640 1 -- 172.21.15.123:0/3830629524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fedc015c850 con 0x7fedac003f20 2024-09-15T23:16:27.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.830+0000 7fedc5500640 1 -- 172.21.15.123:0/3830629524 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fedac00ba70 con 0x7fedac004d40 2024-09-15T23:16:27.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.830+0000 7fedc5500640 1 -- 172.21.15.123:0/3830629524 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fedac00bc70 con 0x7fedc015edb0 2024-09-15T23:16:27.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.830+0000 7fedc5d01640 1 --2- 172.21.15.123:0/3830629524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fedac003f20 0x7fedac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:27.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.830+0000 7fedc6502640 1 --2- 172.21.15.123:0/3830629524 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fedc015edb0 0x7fedac0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:27.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.830+0000 7fedc6d03640 1 --2- 172.21.15.123:0/3830629524 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fedac004d40 0x7fedac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:27.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.830+0000 7fedc5d01640 1 -- 172.21.15.123:0/3830629524 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fedc015edb0 msgr2=0x7fedac0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:27.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.830+0000 7fedc5d01640 1 --2- 172.21.15.123:0/3830629524 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fedc015edb0 0x7fedac0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:27.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.830+0000 7fedc5d01640 1 -- 172.21.15.123:0/3830629524 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fedac004d40 msgr2=0x7fedac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:27.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.830+0000 7fedc5d01640 1 --2- 172.21.15.123:0/3830629524 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fedac004d40 0x7fedac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:27.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.830+0000 7fedc5d01640 1 -- 172.21.15.123:0/3830629524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedac003520 con 0x7fedac003f20 2024-09-15T23:16:27.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.831+0000 7fedc5d01640 1 --2- 172.21.15.123:0/3830629524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fedac003f20 0x7fedac004800 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fedb0001860 tx=0x7fedac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75356d64b86e0eab server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:27.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.831+0000 7fedc5500640 1 -- 172.21.15.123:0/3830629524 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb0037070 con 0x7fedac003f20 2024-09-15T23:16:27.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.831+0000 7fedc5500640 1 -- 172.21.15.123:0/3830629524 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedb002abf0 con 0x7fedac003f20 2024-09-15T23:16:27.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.831+0000 7fedc5500640 1 -- 172.21.15.123:0/3830629524 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb0001430 con 0x7fedac003f20 2024-09-15T23:16:27.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.831+0000 7fedc8766640 1 -- 172.21.15.123:0/3830629524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fedac003f20 msgr2=0x7fedac004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:27.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.831+0000 7fedc8766640 1 --2- 172.21.15.123:0/3830629524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fedac003f20 0x7fedac004800 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fedb0001860 tx=0x7fedac005830 comp rx=0 tx=0).stop 2024-09-15T23:16:27.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.831+0000 7fedc6d03640 1 -- 172.21.15.123:0/3830629524 reap_dead start 2024-09-15T23:16:27.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.831+0000 7fedc8766640 1 -- 172.21.15.123:0/3830629524 shutdown_connections 2024-09-15T23:16:27.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.831+0000 7fedc8766640 1 -- 172.21.15.123:0/3830629524 >> 172.21.15.123:0/3830629524 conn(0x7fedc006c030 msgr2=0x7fedc006c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:27.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.831+0000 7fedc8766640 1 -- 172.21.15.123:0/3830629524 shutdown_connections 2024-09-15T23:16:27.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.831+0000 7fedc8766640 1 -- 172.21.15.123:0/3830629524 wait complete. 2024-09-15T23:16:27.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.833+0000 7fedc8766640 1 Processor -- start 2024-09-15T23:16:27.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.833+0000 7fedc8766640 1 -- start start 2024-09-15T23:16:27.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.833+0000 7fedc8766640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fedac003f20 0x7fedc01f3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:27.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.833+0000 7fedc8766640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fedc01521e0 0x7fedc01f5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:27.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.833+0000 7fedc8766640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fedc01f4b10 0x7fedc0151520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:27.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.833+0000 7fedc8766640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fedc006e690 con 0x7fedc01f4b10 2024-09-15T23:16:27.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.833+0000 7fedc8766640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fedc00b5680 con 0x7fedc01521e0 2024-09-15T23:16:27.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.833+0000 7fedc8766640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fedc00b4750 con 0x7fedac003f20 2024-09-15T23:16:27.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.833+0000 7fedc6d03640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fedc01f4b10 0x7fedc0151520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:27.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.833+0000 7fedc6d03640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fedc01f4b10 0x7fedc0151520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41764/0 (socket says 172.21.15.123:41764) 2024-09-15T23:16:27.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.833+0000 7fedc6d03640 1 -- 172.21.15.123:0/1293089274 learned_addr learned my addr 172.21.15.123:0/1293089274 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:27.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.834+0000 7fedc6502640 1 --2- 172.21.15.123:0/1293089274 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fedac003f20 0x7fedc01f3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:27.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.834+0000 7fedc5d01640 1 --2- 172.21.15.123:0/1293089274 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fedc01521e0 0x7fedc01f5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:27.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.834+0000 7fedc6d03640 1 -- 172.21.15.123:0/1293089274 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fedac003f20 msgr2=0x7fedc01f3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:27.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.834+0000 7fedc6d03640 1 --2- 172.21.15.123:0/1293089274 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fedac003f20 0x7fedc01f3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:27.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.834+0000 7fedc6d03640 1 -- 172.21.15.123:0/1293089274 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fedc01521e0 msgr2=0x7fedc01f5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:27.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.834+0000 7fedc6d03640 1 --2- 172.21.15.123:0/1293089274 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fedc01521e0 0x7fedc01f5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:27.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.834+0000 7fedc6d03640 1 -- 172.21.15.123:0/1293089274 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedc01f5010 con 0x7fedc01f4b10 2024-09-15T23:16:27.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.834+0000 7fedc6502640 1 --2- 172.21.15.123:0/1293089274 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fedac003f20 0x7fedc01f3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:16:27.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.834+0000 7fedc5d01640 1 --2- 172.21.15.123:0/1293089274 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fedc01521e0 0x7fedc01f5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:16:27.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.834+0000 7fedc6d03640 1 --2- 172.21.15.123:0/1293089274 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fedc01f4b10 0x7fedc0151520 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fedc00cd5b0 tx=0x7fedb800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:27.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.834+0000 7fedb6ffd640 1 -- 172.21.15.123:0/1293089274 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb800fd80 con 0x7fedc01f4b10 2024-09-15T23:16:27.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.834+0000 7fedb6ffd640 1 -- 172.21.15.123:0/1293089274 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedb801d070 con 0x7fedc01f4b10 2024-09-15T23:16:27.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.834+0000 7fedc8766640 1 -- 172.21.15.123:0/1293089274 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedc0160580 con 0x7fedc01f4b10 2024-09-15T23:16:27.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.834+0000 7fedb6ffd640 1 -- 172.21.15.123:0/1293089274 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb8015670 con 0x7fedc01f4b10 2024-09-15T23:16:27.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.834+0000 7fedc8766640 1 -- 172.21.15.123:0/1293089274 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedc0160b40 con 0x7fedc01f4b10 2024-09-15T23:16:27.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.835+0000 7fedc8766640 1 -- 172.21.15.123:0/1293089274 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedc0072920 con 0x7fedc01f4b10 2024-09-15T23:16:27.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.835+0000 7fedb6ffd640 1 -- 172.21.15.123:0/1293089274 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fedb8015810 con 0x7fedc01f4b10 2024-09-15T23:16:27.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.836+0000 7fedb6ffd640 1 --2- 172.21.15.123:0/1293089274 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7feda406c2b0 0x7feda406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:27.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.836+0000 7fedb6ffd640 1 -- 172.21.15.123:0/1293089274 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5615+0+0 (secure 0 0 0) 0x7fedb808bdb0 con 0x7fedc01f4b10 2024-09-15T23:16:27.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.836+0000 7fedc6502640 1 --2- 172.21.15.123:0/1293089274 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7feda406c2b0 0x7feda406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:27.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.837+0000 7fedc6502640 1 --2- 172.21.15.123:0/1293089274 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7feda406c2b0 0x7feda406e770 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fedbc001eb0 tx=0x7fedbc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:27.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:27.840+0000 7fedb6ffd640 1 -- 172.21.15.123:0/1293089274 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fedb8010040 con 0x7fedc01f4b10 2024-09-15T23:16:28.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.005+0000 7fedc8766640 1 -- 172.21.15.123:0/1293089274 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fedc00b21c0 con 0x7fedc01f4b10 2024-09-15T23:16:28.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.703+0000 7fedb6ffd640 1 -- 172.21.15.123:0/1293089274 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v89) ==== 169+0+0 (secure 0 0 0) 0x7fedb805a500 con 0x7fedc01f4b10 2024-09-15T23:16:28.704 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' removed 2024-09-15T23:16:28.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.706+0000 7fedc8766640 1 -- 172.21.15.123:0/1293089274 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7feda406c2b0 msgr2=0x7feda406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:28.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.706+0000 7fedc8766640 1 --2- 172.21.15.123:0/1293089274 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7feda406c2b0 0x7feda406e770 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fedbc001eb0 tx=0x7fedbc009040 comp rx=0 tx=0).stop 2024-09-15T23:16:28.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.706+0000 7fedc8766640 1 -- 172.21.15.123:0/1293089274 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fedc01f4b10 msgr2=0x7fedc0151520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:28.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.706+0000 7fedc8766640 1 --2- 172.21.15.123:0/1293089274 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fedc01f4b10 0x7fedc0151520 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fedc00cd5b0 tx=0x7fedb800f580 comp rx=0 tx=0).stop 2024-09-15T23:16:28.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.707+0000 7fedc8766640 1 -- 172.21.15.123:0/1293089274 shutdown_connections 2024-09-15T23:16:28.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.707+0000 7fedc8766640 1 --2- 172.21.15.123:0/1293089274 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7feda406c2b0 0x7feda406e770 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:28.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.707+0000 7fedc8766640 1 --2- 172.21.15.123:0/1293089274 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fedc01f4b10 0x7fedc0151520 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:28.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.707+0000 7fedc8766640 1 --2- 172.21.15.123:0/1293089274 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fedc01521e0 0x7fedc01f5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:28.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.707+0000 7fedc8766640 1 --2- 172.21.15.123:0/1293089274 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fedac003f20 0x7fedc01f3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:28.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.708+0000 7fedc8766640 1 -- 172.21.15.123:0/1293089274 >> 172.21.15.123:0/1293089274 conn(0x7fedc006c030 msgr2=0x7fedc015dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:28.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.709+0000 7fedc8766640 1 -- 172.21.15.123:0/1293089274 shutdown_connections 2024-09-15T23:16:28.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.709+0000 7fedc8766640 1 -- 172.21.15.123:0/1293089274 wait complete. 2024-09-15T23:16:28.725 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T23:16:28.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.827+0000 7f095b991640 1 Processor -- start 2024-09-15T23:16:28.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.827+0000 7f095b991640 1 -- start start 2024-09-15T23:16:28.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.828+0000 7f095b991640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f09540ccf30 0x7f09540b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:28.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.828+0000 7f095b991640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f095415b7c0 0x7f09540cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:28.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.828+0000 7f095b991640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09540cd850 con 0x7f09540cead0 2024-09-15T23:16:28.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.828+0000 7f095b991640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f09540cf2e0 con 0x7f09540ccf30 2024-09-15T23:16:28.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.828+0000 7f095b991640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f0954070fe0 con 0x7f095415b7c0 2024-09-15T23:16:28.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.828+0000 7f095972d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f09540ccf30 0x7f09540b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:28.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.828+0000 7f0959f2e640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f09540cead0 0x7f095415f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38396/0 (socket says 172.21.15.123:38396) 2024-09-15T23:16:28.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.828+0000 7f095972d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f09540ccf30 0x7f09540b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41768/0 (socket says 172.21.15.123:41768) 2024-09-15T23:16:28.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.828+0000 7f0959f2e640 1 -- 172.21.15.123:0/648520092 learned_addr learned my addr 172.21.15.123:0/648520092 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:28.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.828+0000 7f0958f2c640 1 --2- 172.21.15.123:0/648520092 >> v2:172.21.15.188:3300/0 conn(0x7f095415b7c0 0x7f09540cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:28.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.828+0000 7f095972d640 1 -- 172.21.15.123:0/648520092 >> v2:172.21.15.188:3300/0 conn(0x7f095415b7c0 msgr2=0x7f09540cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:28.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.829+0000 7f095972d640 1 --2- 172.21.15.123:0/648520092 >> v2:172.21.15.188:3300/0 conn(0x7f095415b7c0 0x7f09540cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:28.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.829+0000 7f095972d640 1 -- 172.21.15.123:0/648520092 >> v1:172.21.15.123:6789/0 conn(0x7f09540cead0 legacy=0x7f095415f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:28.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.829+0000 7f095972d640 1 -- 172.21.15.123:0/648520092 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09540712c0 con 0x7f09540ccf30 2024-09-15T23:16:28.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.829+0000 7f0953fff640 1 -- 172.21.15.123:0/648520092 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 648342687 0 0) 0x7f09540cd850 con 0x7f09540cead0 2024-09-15T23:16:28.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.829+0000 7f095972d640 1 --2- 172.21.15.123:0/648520092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09540ccf30 0x7f09540b2c50 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f09541601f0 tx=0x7f094c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2067f96a92d9864 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:28.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.829+0000 7f0953fff640 1 -- 172.21.15.123:0/648520092 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f094c037070 con 0x7f09540ccf30 2024-09-15T23:16:28.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.829+0000 7f0953fff640 1 -- 172.21.15.123:0/648520092 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f094c032440 con 0x7f09540ccf30 2024-09-15T23:16:28.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.829+0000 7f0953fff640 1 -- 172.21.15.123:0/648520092 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f094c02ae60 con 0x7f09540ccf30 2024-09-15T23:16:28.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.830+0000 7f095b991640 1 -- 172.21.15.123:0/648520092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09540ccf30 msgr2=0x7f09540b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:28.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.830+0000 7f095b991640 1 --2- 172.21.15.123:0/648520092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09540ccf30 0x7f09540b2c50 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f09541601f0 tx=0x7f094c02a110 comp rx=0 tx=0).stop 2024-09-15T23:16:28.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.830+0000 7f095b991640 1 -- 172.21.15.123:0/648520092 shutdown_connections 2024-09-15T23:16:28.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.830+0000 7f095b991640 1 --2- 172.21.15.123:0/648520092 >> v2:172.21.15.188:3300/0 conn(0x7f095415b7c0 0x7f09540cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:28.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.830+0000 7f095b991640 1 --2- 172.21.15.123:0/648520092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09540ccf30 0x7f09540b2c50 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:28.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.830+0000 7f095b991640 1 -- 172.21.15.123:0/648520092 >> 172.21.15.123:0/648520092 conn(0x7f095406d0f0 msgr2=0x7f095406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:28.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.830+0000 7f095b991640 1 -- 172.21.15.123:0/648520092 shutdown_connections 2024-09-15T23:16:28.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.830+0000 7f095b991640 1 -- 172.21.15.123:0/648520092 wait complete. 2024-09-15T23:16:28.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.831+0000 7f095b991640 1 Processor -- start 2024-09-15T23:16:28.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.831+0000 7f095b991640 1 -- start start 2024-09-15T23:16:28.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.832+0000 7f095b991640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f09540ccf30 0x7f09541f6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:28.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.832+0000 7f095b991640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09540cead0 0x7f0954140370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:28.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.832+0000 7f095b991640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f095415b7c0 0x7f095406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:28.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.832+0000 7f095b991640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f09540ceee0 con 0x7f09540cead0 2024-09-15T23:16:28.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.832+0000 7f095b991640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f09540cf5c0 con 0x7f09540ccf30 2024-09-15T23:16:28.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.832+0000 7f095b991640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f09540cf060 con 0x7f095415b7c0 2024-09-15T23:16:28.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.832+0000 7f0958f2c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09540cead0 0x7f0954140370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:28.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.832+0000 7f0958f2c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09540cead0 0x7f0954140370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41774/0 (socket says 172.21.15.123:41774) 2024-09-15T23:16:28.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.832+0000 7f0958f2c640 1 -- 172.21.15.123:0/2063057944 learned_addr learned my addr 172.21.15.123:0/2063057944 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:28.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.832+0000 7f095972d640 1 --2- 172.21.15.123:0/2063057944 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f09540ccf30 0x7f09541f6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:28.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.832+0000 7f0959f2e640 1 --2- 172.21.15.123:0/2063057944 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f095415b7c0 0x7f095406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:28.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.832+0000 7f0958f2c640 1 -- 172.21.15.123:0/2063057944 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f095415b7c0 msgr2=0x7f095406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:28.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.832+0000 7f0958f2c640 1 --2- 172.21.15.123:0/2063057944 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f095415b7c0 0x7f095406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:28.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.832+0000 7f0958f2c640 1 -- 172.21.15.123:0/2063057944 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f09540ccf30 msgr2=0x7f09541f6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:28.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.832+0000 7f0958f2c640 1 --2- 172.21.15.123:0/2063057944 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f09540ccf30 0x7f09541f6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:28.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.832+0000 7f0958f2c640 1 -- 172.21.15.123:0/2063057944 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09541438a0 con 0x7f09540cead0 2024-09-15T23:16:28.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.832+0000 7f0958f2c640 1 --2- 172.21.15.123:0/2063057944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09540cead0 0x7f0954140370 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f094800d5f0 tx=0x7f094800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:28.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.833+0000 7f0951ffb640 1 -- 172.21.15.123:0/2063057944 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09480125f0 con 0x7f09540cead0 2024-09-15T23:16:28.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.833+0000 7f0951ffb640 1 -- 172.21.15.123:0/2063057944 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0948019070 con 0x7f09540cead0 2024-09-15T23:16:28.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.833+0000 7f0951ffb640 1 -- 172.21.15.123:0/2063057944 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09480129d0 con 0x7f09540cead0 2024-09-15T23:16:28.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.833+0000 7f095b991640 1 -- 172.21.15.123:0/2063057944 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0954143b80 con 0x7f09540cead0 2024-09-15T23:16:28.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.833+0000 7f095b991640 1 -- 172.21.15.123:0/2063057944 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09541f5a00 con 0x7f09540cead0 2024-09-15T23:16:28.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.834+0000 7f095b991640 1 -- 172.21.15.123:0/2063057944 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09540b2c50 con 0x7f09540cead0 2024-09-15T23:16:28.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.834+0000 7f0951ffb640 1 -- 172.21.15.123:0/2063057944 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0948012b70 con 0x7f09540cead0 2024-09-15T23:16:28.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.835+0000 7f0951ffb640 1 --2- 172.21.15.123:0/2063057944 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f094006c2b0 0x7f094006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:28.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.835+0000 7f0951ffb640 1 -- 172.21.15.123:0/2063057944 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5201+0+0 (secure 0 0 0) 0x7f094808b5f0 con 0x7f09540cead0 2024-09-15T23:16:28.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.835+0000 7f095972d640 1 --2- 172.21.15.123:0/2063057944 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f094006c2b0 0x7f094006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:28.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.835+0000 7f095972d640 1 --2- 172.21.15.123:0/2063057944 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f094006c2b0 0x7f094006e770 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f094c034000 tx=0x7f094c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:28.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:28.839+0000 7f0951ffb640 1 -- 172.21.15.123:0/2063057944 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0948059f50 con 0x7f09540cead0 2024-09-15T23:16:29.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.006+0000 7f095b991640 1 -- 172.21.15.123:0/2063057944 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f09540cc960 con 0x7f09540cead0 2024-09-15T23:16:29.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.009+0000 7f0951ffb640 1 -- 172.21.15.123:0/2063057944 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) ==== 104+0+0 (secure 0 0 0) 0x7f0948059850 con 0x7f09540cead0 2024-09-15T23:16:29.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.011+0000 7f095b991640 1 -- 172.21.15.123:0/2063057944 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f094006c2b0 msgr2=0x7f094006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:29.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.011+0000 7f095b991640 1 --2- 172.21.15.123:0/2063057944 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f094006c2b0 0x7f094006e770 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f094c034000 tx=0x7f094c02e000 comp rx=0 tx=0).stop 2024-09-15T23:16:29.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.011+0000 7f095b991640 1 -- 172.21.15.123:0/2063057944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09540cead0 msgr2=0x7f0954140370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:29.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.011+0000 7f095b991640 1 --2- 172.21.15.123:0/2063057944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09540cead0 0x7f0954140370 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f094800d5f0 tx=0x7f094800dab0 comp rx=0 tx=0).stop 2024-09-15T23:16:29.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.011+0000 7f095b991640 1 -- 172.21.15.123:0/2063057944 shutdown_connections 2024-09-15T23:16:29.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.011+0000 7f095b991640 1 --2- 172.21.15.123:0/2063057944 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f095415b7c0 0x7f095406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:29.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.011+0000 7f095b991640 1 --2- 172.21.15.123:0/2063057944 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f094006c2b0 0x7f094006e770 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:29.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.011+0000 7f095b991640 1 --2- 172.21.15.123:0/2063057944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09540cead0 0x7f0954140370 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:29.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.011+0000 7f095b991640 1 --2- 172.21.15.123:0/2063057944 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f09540ccf30 0x7f09541f6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:29.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.011+0000 7f095b991640 1 -- 172.21.15.123:0/2063057944 >> 172.21.15.123:0/2063057944 conn(0x7f095406d0f0 msgr2=0x7f095415aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:29.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.012+0000 7f095b991640 1 -- 172.21.15.123:0/2063057944 shutdown_connections 2024-09-15T23:16:29.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.012+0000 7f095b991640 1 -- 172.21.15.123:0/2063057944 wait complete. 2024-09-15T23:16:29.024 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair' 2024-09-15T23:16:29.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.121+0000 7f4233a1e640 1 Processor -- start 2024-09-15T23:16:29.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.121+0000 7f4233a1e640 1 -- start start 2024-09-15T23:16:29.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.122+0000 7f4233a1e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f422c145ed0 0x7f422c0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:29.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.122+0000 7f4233a1e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f422c0b5f90 0x7f422c0735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:29.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.122+0000 7f4233a1e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f422c0b4020 con 0x7f422c073180 2024-09-15T23:16:29.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.122+0000 7f4233a1e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f422c073b00 con 0x7f422c0b5f90 2024-09-15T23:16:29.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.122+0000 7f4233a1e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f422c0b42c0 con 0x7f422c145ed0 2024-09-15T23:16:29.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.122+0000 7f4231fbb640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f422c0b5f90 0x7f422c0735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:29.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.122+0000 7f4231fbb640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f422c0b5f90 0x7f422c0735c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41790/0 (socket says 172.21.15.123:41790) 2024-09-15T23:16:29.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.122+0000 7f4231fbb640 1 -- 172.21.15.123:0/164527788 learned_addr learned my addr 172.21.15.123:0/164527788 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:29.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.122+0000 7f4230fb9640 1 --1- 172.21.15.123:0/164527788 >> v1:172.21.15.123:6789/0 conn(0x7f422c073180 0x7f422c0b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38404/0 (socket says 172.21.15.123:38404) 2024-09-15T23:16:29.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.122+0000 7f4231fbb640 1 -- 172.21.15.123:0/164527788 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f422c145ed0 msgr2=0x7f422c0b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:29.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.122+0000 7f42317ba640 1 --2- 172.21.15.123:0/164527788 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f422c145ed0 0x7f422c0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:29.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.122+0000 7f4223fff640 1 -- 172.21.15.123:0/164527788 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3388935306 0 0) 0x7f422c0b4020 con 0x7f422c073180 2024-09-15T23:16:29.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.122+0000 7f4231fbb640 1 --2- 172.21.15.123:0/164527788 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f422c145ed0 0x7f422c0b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:29.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.122+0000 7f4231fbb640 1 -- 172.21.15.123:0/164527788 >> v1:172.21.15.123:6789/0 conn(0x7f422c073180 legacy=0x7f422c0b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:29.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.122+0000 7f4231fbb640 1 -- 172.21.15.123:0/164527788 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f422c0b45a0 con 0x7f422c0b5f90 2024-09-15T23:16:29.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.123+0000 7f4231fbb640 1 --2- 172.21.15.123:0/164527788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f422c0b5f90 0x7f422c0735c0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f4224009e50 tx=0x7f422402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f4b84c210c6049b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:29.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.123+0000 7f4223fff640 1 -- 172.21.15.123:0/164527788 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4224036070 con 0x7f422c0b5f90 2024-09-15T23:16:29.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.123+0000 7f4223fff640 1 -- 172.21.15.123:0/164527788 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4224031600 con 0x7f422c0b5f90 2024-09-15T23:16:29.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.123+0000 7f4223fff640 1 -- 172.21.15.123:0/164527788 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42240319d0 con 0x7f422c0b5f90 2024-09-15T23:16:29.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.124+0000 7f4233a1e640 1 -- 172.21.15.123:0/164527788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f422c0b5f90 msgr2=0x7f422c0735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:29.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.124+0000 7f4233a1e640 1 --2- 172.21.15.123:0/164527788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f422c0b5f90 0x7f422c0735c0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f4224009e50 tx=0x7f422402a710 comp rx=0 tx=0).stop 2024-09-15T23:16:29.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.124+0000 7f4233a1e640 1 -- 172.21.15.123:0/164527788 shutdown_connections 2024-09-15T23:16:29.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.124+0000 7f4233a1e640 1 --2- 172.21.15.123:0/164527788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f422c0b5f90 0x7f422c0735c0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:29.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.124+0000 7f4233a1e640 1 --2- 172.21.15.123:0/164527788 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f422c145ed0 0x7f422c0b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:29.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.124+0000 7f4233a1e640 1 -- 172.21.15.123:0/164527788 >> 172.21.15.123:0/164527788 conn(0x7f422c0ccec0 msgr2=0x7f422c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:29.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.124+0000 7f4233a1e640 1 -- 172.21.15.123:0/164527788 shutdown_connections 2024-09-15T23:16:29.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.124+0000 7f4233a1e640 1 -- 172.21.15.123:0/164527788 wait complete. 2024-09-15T23:16:29.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.125+0000 7f4233a1e640 1 Processor -- start 2024-09-15T23:16:29.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.125+0000 7f4233a1e640 1 -- start start 2024-09-15T23:16:29.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.126+0000 7f4233a1e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f422c073180 0x7f422c0aadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:29.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.126+0000 7f4233a1e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f422c0b5f90 0x7f422c15be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:29.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.126+0000 7f4233a1e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f422c145ed0 0x7f422c15c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:29.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.126+0000 7f4233a1e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f422c1462b0 con 0x7f422c073180 2024-09-15T23:16:29.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.126+0000 7f4233a1e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f422c0b4b60 con 0x7f422c145ed0 2024-09-15T23:16:29.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.126+0000 7f4233a1e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f422c146430 con 0x7f422c0b5f90 2024-09-15T23:16:29.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.126+0000 7f42317ba640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f422c073180 0x7f422c0aadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:29.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.126+0000 7f42317ba640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f422c073180 0x7f422c0aadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41798/0 (socket says 172.21.15.123:41798) 2024-09-15T23:16:29.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.126+0000 7f42317ba640 1 -- 172.21.15.123:0/1038844166 learned_addr learned my addr 172.21.15.123:0/1038844166 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:29.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.126+0000 7f4230fb9640 1 --2- 172.21.15.123:0/1038844166 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f422c0b5f90 0x7f422c15be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:29.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.126+0000 7f4231fbb640 1 --2- 172.21.15.123:0/1038844166 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f422c145ed0 0x7f422c15c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:29.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.126+0000 7f42317ba640 1 -- 172.21.15.123:0/1038844166 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f422c0b5f90 msgr2=0x7f422c15be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:29.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.126+0000 7f42317ba640 1 --2- 172.21.15.123:0/1038844166 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f422c0b5f90 0x7f422c15be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:29.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.126+0000 7f42317ba640 1 -- 172.21.15.123:0/1038844166 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f422c145ed0 msgr2=0x7f422c15c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:29.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.126+0000 7f42317ba640 1 --2- 172.21.15.123:0/1038844166 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f422c145ed0 0x7f422c15c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:29.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.126+0000 7f42317ba640 1 -- 172.21.15.123:0/1038844166 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f422c0ca090 con 0x7f422c073180 2024-09-15T23:16:29.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.126+0000 7f4230fb9640 1 --2- 172.21.15.123:0/1038844166 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f422c0b5f90 0x7f422c15be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:16:29.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.126+0000 7f4231fbb640 1 --2- 172.21.15.123:0/1038844166 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f422c145ed0 0x7f422c15c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:16:29.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.126+0000 7f42317ba640 1 --2- 172.21.15.123:0/1038844166 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f422c073180 0x7f422c0aadc0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f422800c7f0 tx=0x7f422800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:29.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.126+0000 7f4221ffb640 1 -- 172.21.15.123:0/1038844166 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4228015070 con 0x7f422c073180 2024-09-15T23:16:29.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.126+0000 7f4221ffb640 1 -- 172.21.15.123:0/1038844166 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4228004220 con 0x7f422c073180 2024-09-15T23:16:29.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.126+0000 7f4221ffb640 1 -- 172.21.15.123:0/1038844166 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4228007620 con 0x7f422c073180 2024-09-15T23:16:29.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.126+0000 7f4233a1e640 1 -- 172.21.15.123:0/1038844166 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f422c0c9db0 con 0x7f422c073180 2024-09-15T23:16:29.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.127+0000 7f4233a1e640 1 -- 172.21.15.123:0/1038844166 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f422c0cafe0 con 0x7f422c073180 2024-09-15T23:16:29.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.127+0000 7f4233a1e640 1 -- 172.21.15.123:0/1038844166 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f422c0735c0 con 0x7f422c073180 2024-09-15T23:16:29.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.128+0000 7f4221ffb640 1 -- 172.21.15.123:0/1038844166 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f42280079d0 con 0x7f422c073180 2024-09-15T23:16:29.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.128+0000 7f4221ffb640 1 --2- 172.21.15.123:0/1038844166 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f421006c2b0 0x7f421006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:29.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.128+0000 7f4221ffb640 1 -- 172.21.15.123:0/1038844166 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5201+0+0 (secure 0 0 0) 0x7f422808b560 con 0x7f422c073180 2024-09-15T23:16:29.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.129+0000 7f4230fb9640 1 --2- 172.21.15.123:0/1038844166 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f421006c2b0 0x7f421006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:29.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.129+0000 7f4230fb9640 1 --2- 172.21.15.123:0/1038844166 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f421006c2b0 0x7f421006e770 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f422c13f810 tx=0x7f421c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:29.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.133+0000 7f4221ffb640 1 -- 172.21.15.123:0/1038844166 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4228059ec0 con 0x7f422c073180 2024-09-15T23:16:29.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.368+0000 7f4233a1e640 1 -- 172.21.15.123:0/1038844166 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]} v 0) -- 0x7f422c0b5120 con 0x7f422c073180 2024-09-15T23:16:29.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.710+0000 7f4221ffb640 1 -- 172.21.15.123:0/1038844166 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]}]=0 v228) ==== 143+0+0 (secure 0 0 0) 0x7f42280597c0 con 0x7f422c073180 2024-09-15T23:16:29.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.712+0000 7f4233a1e640 1 -- 172.21.15.123:0/1038844166 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f421006c2b0 msgr2=0x7f421006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:29.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.712+0000 7f4233a1e640 1 --2- 172.21.15.123:0/1038844166 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f421006c2b0 0x7f421006e770 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f422c13f810 tx=0x7f421c009040 comp rx=0 tx=0).stop 2024-09-15T23:16:29.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.712+0000 7f4233a1e640 1 -- 172.21.15.123:0/1038844166 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f422c073180 msgr2=0x7f422c0aadc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:29.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.712+0000 7f4233a1e640 1 --2- 172.21.15.123:0/1038844166 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f422c073180 0x7f422c0aadc0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f422800c7f0 tx=0x7f422800ccb0 comp rx=0 tx=0).stop 2024-09-15T23:16:29.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.712+0000 7f4233a1e640 1 -- 172.21.15.123:0/1038844166 shutdown_connections 2024-09-15T23:16:29.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.712+0000 7f4233a1e640 1 --2- 172.21.15.123:0/1038844166 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f422c145ed0 0x7f422c15c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:29.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.712+0000 7f4233a1e640 1 --2- 172.21.15.123:0/1038844166 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f422c0b5f90 0x7f422c15be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:29.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.712+0000 7f4233a1e640 1 --2- 172.21.15.123:0/1038844166 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f421006c2b0 0x7f421006e770 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:29.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.712+0000 7f4233a1e640 1 --2- 172.21.15.123:0/1038844166 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f422c073180 0x7f422c0aadc0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:29.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.712+0000 7f4233a1e640 1 -- 172.21.15.123:0/1038844166 >> 172.21.15.123:0/1038844166 conn(0x7f422c0ccec0 msgr2=0x7f422c0cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:29.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.712+0000 7f4233a1e640 1 -- 172.21.15.123:0/1038844166 shutdown_connections 2024-09-15T23:16:29.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.712+0000 7f4233a1e640 1 -- 172.21.15.123:0/1038844166 wait complete. 2024-09-15T23:16:29.725 INFO:tasks.cephfs_test_runner:test_scrub_repair (tasks.cephfs.test_scrub_checks.TestScrubChecks) ... ok 2024-09-15T23:16:29.725 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_split_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) That a directory is split during scrub. 2024-09-15T23:16:29.725 INFO:tasks.cephfs_test_runner:test_scrub_split_dirfrags (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-15T23:16:29.725 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:16:29.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.823+0000 7fe165c27640 1 Processor -- start 2024-09-15T23:16:29.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.823+0000 7fe165c27640 1 -- start start 2024-09-15T23:16:29.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.824+0000 7fe165c27640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe16013eb20 0x7fe16015c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:29.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.824+0000 7fe165c27640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe160071180 con 0x7fe16006c320 2024-09-15T23:16:29.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.824+0000 7fe165c27640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe160071460 con 0x7fe1600b2d40 2024-09-15T23:16:29.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.824+0000 7fe165c27640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe160071ab0 con 0x7fe16013eb20 2024-09-15T23:16:29.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.824+0000 7fe15effd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe16006c320 0x7fe16015bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38420/0 (socket says 172.21.15.123:38420) 2024-09-15T23:16:29.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.824+0000 7fe15effd640 1 -- 172.21.15.123:0/1437013911 learned_addr learned my addr 172.21.15.123:0/1437013911 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:29.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.824+0000 7fe15e7fc640 1 -- 172.21.15.123:0/1437013911 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3576575449 0 0) 0x7fe160071180 con 0x7fe16006c320 2024-09-15T23:16:29.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.824+0000 7fe15ffff640 1 --2- 172.21.15.123:0/1437013911 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe16013eb20 0x7fe16015c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:29.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.824+0000 7fe15e7fc640 1 -- 172.21.15.123:0/1437013911 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe148003520 con 0x7fe16006c320 2024-09-15T23:16:29.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.824+0000 7fe15e7fc640 1 -- 172.21.15.123:0/1437013911 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 238886514 0 0) 0x7fe148003520 con 0x7fe16006c320 2024-09-15T23:16:29.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.824+0000 7fe15e7fc640 1 -- 172.21.15.123:0/1437013911 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe16013eb20 msgr2=0x7fe16015c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:29.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.824+0000 7fe15e7fc640 1 --2- 172.21.15.123:0/1437013911 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe16013eb20 0x7fe16015c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:29.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.824+0000 7fe15e7fc640 1 -- 172.21.15.123:0/1437013911 >> v1:172.21.15.188:6789/0 conn(0x7fe1600b2d40 legacy=0x7fe16006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:29.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.824+0000 7fe15e7fc640 1 -- 172.21.15.123:0/1437013911 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe160071740 con 0x7fe16006c320 2024-09-15T23:16:29.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.824+0000 7fe15e7fc640 1 -- 172.21.15.123:0/1437013911 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fe154001670 con 0x7fe16006c320 2024-09-15T23:16:29.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.824+0000 7fe15e7fc640 1 -- 172.21.15.123:0/1437013911 >> v1:172.21.15.123:6789/0 conn(0x7fe16006c320 legacy=0x7fe16015bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:29.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.824+0000 7fe15e7fc640 1 --2- 172.21.15.123:0/1437013911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1480039e0 0x7fe148003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:29.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.824+0000 7fe15e7fc640 1 --2- 172.21.15.123:0/1437013911 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe16013eb20 0x7fe148004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:29.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.824+0000 7fe15e7fc640 1 --2- 172.21.15.123:0/1437013911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe148004d40 0x7fe1480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:29.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.824+0000 7fe15e7fc640 1 -- 172.21.15.123:0/1437013911 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe160071ab0 con 0x7fe148004d40 2024-09-15T23:16:29.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.824+0000 7fe15e7fc640 1 -- 172.21.15.123:0/1437013911 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe14800baa0 con 0x7fe1480039e0 2024-09-15T23:16:29.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.824+0000 7fe15e7fc640 1 -- 172.21.15.123:0/1437013911 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe14800bca0 con 0x7fe16013eb20 2024-09-15T23:16:29.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.824+0000 7fe15ffff640 1 --2- 172.21.15.123:0/1437013911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe148004d40 0x7fe1480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:29.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.824+0000 7fe15effd640 1 --2- 172.21.15.123:0/1437013911 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe16013eb20 0x7fe148004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:29.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.824+0000 7fe15f7fe640 1 --2- 172.21.15.123:0/1437013911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1480039e0 0x7fe148003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:29.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.825+0000 7fe15ffff640 1 -- 172.21.15.123:0/1437013911 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe16013eb20 msgr2=0x7fe148004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:29.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.825+0000 7fe15ffff640 1 --2- 172.21.15.123:0/1437013911 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe16013eb20 0x7fe148004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.825+0000 7fe15ffff640 1 -- 172.21.15.123:0/1437013911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1480039e0 msgr2=0x7fe148003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.825+0000 7fe15ffff640 1 --2- 172.21.15.123:0/1437013911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1480039e0 0x7fe148003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.825+0000 7fe15ffff640 1 -- 172.21.15.123:0/1437013911 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe148003520 con 0x7fe148004d40 2024-09-15T23:16:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.825+0000 7fe15effd640 1 --2- 172.21.15.123:0/1437013911 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe16013eb20 0x7fe148004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:16:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.825+0000 7fe15f7fe640 1 --2- 172.21.15.123:0/1437013911 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe1480039e0 0x7fe148003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:16:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.825+0000 7fe15ffff640 1 --2- 172.21.15.123:0/1437013911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe148004d40 0x7fe1480051c0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fe158009f90 tx=0x7fe148005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f55f94aad6ce97b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.825+0000 7fe15e7fc640 1 -- 172.21.15.123:0/1437013911 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe158009c10 con 0x7fe148004d40 2024-09-15T23:16:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.825+0000 7fe15e7fc640 1 -- 172.21.15.123:0/1437013911 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe158036070 con 0x7fe148004d40 2024-09-15T23:16:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.825+0000 7fe15e7fc640 1 -- 172.21.15.123:0/1437013911 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe158031850 con 0x7fe148004d40 2024-09-15T23:16:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.826+0000 7fe165c27640 1 -- 172.21.15.123:0/1437013911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe148004d40 msgr2=0x7fe1480051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.826+0000 7fe165c27640 1 --2- 172.21.15.123:0/1437013911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe148004d40 0x7fe1480051c0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fe158009f90 tx=0x7fe148005830 comp rx=0 tx=0).stop 2024-09-15T23:16:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.826+0000 7fe15ffff640 1 -- 172.21.15.123:0/1437013911 reap_dead start 2024-09-15T23:16:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.826+0000 7fe165c27640 1 -- 172.21.15.123:0/1437013911 shutdown_connections 2024-09-15T23:16:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.826+0000 7fe165c27640 1 -- 172.21.15.123:0/1437013911 >> 172.21.15.123:0/1437013911 conn(0x7fe1600ccec0 msgr2=0x7fe1600cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:29.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.826+0000 7fe165c27640 1 -- 172.21.15.123:0/1437013911 shutdown_connections 2024-09-15T23:16:29.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.826+0000 7fe165c27640 1 -- 172.21.15.123:0/1437013911 wait complete. 2024-09-15T23:16:29.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.827+0000 7fe165c27640 1 Processor -- start 2024-09-15T23:16:29.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.827+0000 7fe165c27640 1 -- start start 2024-09-15T23:16:29.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.828+0000 7fe165c27640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe148004d40 0x7fe160157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:29.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.828+0000 7fe165c27640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe160142290 0x7fe1600b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:29.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.828+0000 7fe165c27640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe16013e010 0x7fe1600b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:29.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.828+0000 7fe165c27640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe16015c7d0 con 0x7fe160142290 2024-09-15T23:16:29.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.828+0000 7fe165c27640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe16015c650 con 0x7fe148004d40 2024-09-15T23:16:29.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.828+0000 7fe165c27640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe160164340 con 0x7fe16013e010 2024-09-15T23:16:29.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.828+0000 7fe15effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe160142290 0x7fe1600b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:29.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.828+0000 7fe15effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe160142290 0x7fe1600b3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41804/0 (socket says 172.21.15.123:41804) 2024-09-15T23:16:29.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.828+0000 7fe15effd640 1 -- 172.21.15.123:0/1998582616 learned_addr learned my addr 172.21.15.123:0/1998582616 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:29.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.828+0000 7fe15f7fe640 1 --2- 172.21.15.123:0/1998582616 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe148004d40 0x7fe160157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:29.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.829+0000 7fe15ffff640 1 --2- 172.21.15.123:0/1998582616 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe16013e010 0x7fe1600b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:29.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.829+0000 7fe15effd640 1 -- 172.21.15.123:0/1998582616 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe16013e010 msgr2=0x7fe1600b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:29.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.829+0000 7fe15effd640 1 --2- 172.21.15.123:0/1998582616 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe16013e010 0x7fe1600b3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:29.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.829+0000 7fe15effd640 1 -- 172.21.15.123:0/1998582616 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe148004d40 msgr2=0x7fe160157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:29.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.829+0000 7fe15effd640 1 --2- 172.21.15.123:0/1998582616 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe148004d40 0x7fe160157f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:29.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.829+0000 7fe15effd640 1 -- 172.21.15.123:0/1998582616 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe160142800 con 0x7fe160142290 2024-09-15T23:16:29.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.829+0000 7fe15f7fe640 1 --2- 172.21.15.123:0/1998582616 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe148004d40 0x7fe160157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:16:29.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.829+0000 7fe15effd640 1 --2- 172.21.15.123:0/1998582616 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe160142290 0x7fe1600b3570 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fe15400e870 tx=0x7fe15400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:29.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.829+0000 7fe147fff640 1 -- 172.21.15.123:0/1998582616 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15400c870 con 0x7fe160142290 2024-09-15T23:16:29.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.829+0000 7fe147fff640 1 -- 172.21.15.123:0/1998582616 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe154018070 con 0x7fe160142290 2024-09-15T23:16:29.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.829+0000 7fe165c27640 1 -- 172.21.15.123:0/1998582616 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe160142ae0 con 0x7fe160142290 2024-09-15T23:16:29.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.829+0000 7fe147fff640 1 -- 172.21.15.123:0/1998582616 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15400cc10 con 0x7fe160142290 2024-09-15T23:16:29.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.829+0000 7fe165c27640 1 -- 172.21.15.123:0/1998582616 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1601430a0 con 0x7fe160142290 2024-09-15T23:16:29.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.830+0000 7fe165c27640 1 -- 172.21.15.123:0/1998582616 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe16015bcf0 con 0x7fe160142290 2024-09-15T23:16:29.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.830+0000 7fe147fff640 1 -- 172.21.15.123:0/1998582616 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe15401d460 con 0x7fe160142290 2024-09-15T23:16:29.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.831+0000 7fe147fff640 1 --2- 172.21.15.123:0/1998582616 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe14c06c2b0 0x7fe14c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:29.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.831+0000 7fe147fff640 1 -- 172.21.15.123:0/1998582616 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5201+0+0 (secure 0 0 0) 0x7fe15408b2d0 con 0x7fe160142290 2024-09-15T23:16:29.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.831+0000 7fe15f7fe640 1 --2- 172.21.15.123:0/1998582616 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe14c06c2b0 0x7fe14c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:29.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.832+0000 7fe15f7fe640 1 --2- 172.21.15.123:0/1998582616 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe14c06c2b0 0x7fe14c06e770 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe150001630 tx=0x7fe150009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:29.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:29.835+0000 7fe147fff640 1 -- 172.21.15.123:0/1998582616 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe154059ba0 con 0x7fe160142290 2024-09-15T23:16:30.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.002+0000 7fe165c27640 1 -- 172.21.15.123:0/1998582616 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe16006c9c0 con 0x7fe160142290 2024-09-15T23:16:30.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.003+0000 7fe147fff640 1 -- 172.21.15.123:0/1998582616 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+13453 (secure 0 0 0) 0x7fe1540594a0 con 0x7fe160142290 2024-09-15T23:16:30.004 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:16:30.004 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":89,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:16:28.702659+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6834/3648891779":"2024-09-16T23:16:25.698331+0000","172.21.15.188:6837/2597191885":"2024-09-16T23:16:07.004532+0000","172.21.15.188:6835/2597191885":"2024-09-16T23:16:07.004532+0000","172.21.15.123:6834/3814257760":"2024-09-16T23:16:06.705374+0000","172.21.15.123:6832/3814257760":"2024-09-16T23:16:06.705374+0000","172.21.15.123:6835/3648891779":"2024-09-16T23:16:25.698331+0000","172.21.15.123:6835/839817134":"2024-09-16T23:16:06.696474+0000","172.21.15.123:6833/839817134":"2024-09-16T23:16:06.696474+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:16:30.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.005+0000 7fe165c27640 1 -- 172.21.15.123:0/1998582616 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe14c06c2b0 msgr2=0x7fe14c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:30.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.005+0000 7fe165c27640 1 --2- 172.21.15.123:0/1998582616 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe14c06c2b0 0x7fe14c06e770 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe150001630 tx=0x7fe150009040 comp rx=0 tx=0).stop 2024-09-15T23:16:30.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.005+0000 7fe165c27640 1 -- 172.21.15.123:0/1998582616 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe160142290 msgr2=0x7fe1600b3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:30.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.005+0000 7fe165c27640 1 --2- 172.21.15.123:0/1998582616 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe160142290 0x7fe1600b3570 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fe15400e870 tx=0x7fe15400ed30 comp rx=0 tx=0).stop 2024-09-15T23:16:30.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.005+0000 7fe165c27640 1 -- 172.21.15.123:0/1998582616 shutdown_connections 2024-09-15T23:16:30.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.005+0000 7fe165c27640 1 --2- 172.21.15.123:0/1998582616 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe16013e010 0x7fe1600b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:30.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.005+0000 7fe165c27640 1 --2- 172.21.15.123:0/1998582616 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe14c06c2b0 0x7fe14c06e770 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:30.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.005+0000 7fe165c27640 1 --2- 172.21.15.123:0/1998582616 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe160142290 0x7fe1600b3570 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:30.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.005+0000 7fe165c27640 1 --2- 172.21.15.123:0/1998582616 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe148004d40 0x7fe160157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:30.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.005+0000 7fe165c27640 1 -- 172.21.15.123:0/1998582616 >> 172.21.15.123:0/1998582616 conn(0x7fe1600ccec0 msgr2=0x7fe160159870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:30.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.005+0000 7fe165c27640 1 -- 172.21.15.123:0/1998582616 shutdown_connections 2024-09-15T23:16:30.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.005+0000 7fe165c27640 1 -- 172.21.15.123:0/1998582616 wait complete. 2024-09-15T23:16:30.017 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T23:12:01.531886+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T23:16:30.018 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T23:16:30.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.119+0000 7f634a1af640 1 Processor -- start 2024-09-15T23:16:30.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.119+0000 7f634a1af640 1 -- start start 2024-09-15T23:16:30.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.119+0000 7f634a1af640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f634406bfd0 0x7f634406c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:30.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.119+0000 7f634a1af640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63441631c0 con 0x7f63440b3350 2024-09-15T23:16:30.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.119+0000 7f634a1af640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f634406c8f0 con 0x7f63440d3930 2024-09-15T23:16:30.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.119+0000 7f634a1af640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f63440b78a0 con 0x7f634406bfd0 2024-09-15T23:16:30.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.120+0000 7f63437fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f634406bfd0 0x7f634406c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:30.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.120+0000 7f633bfff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f63440b3350 0x7f63441623a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38426/0 (socket says 172.21.15.123:38426) 2024-09-15T23:16:30.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.120+0000 7f633bfff640 1 -- 172.21.15.123:0/2899929915 learned_addr learned my addr 172.21.15.123:0/2899929915 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:30.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.120+0000 7f63437fe640 1 -- 172.21.15.123:0/2899929915 >> v1:172.21.15.188:6789/0 conn(0x7f63440d3930 legacy=0x7f6344162ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:30.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.120+0000 7f63437fe640 1 -- 172.21.15.123:0/2899929915 >> v1:172.21.15.123:6789/0 conn(0x7f63440b3350 legacy=0x7f63441623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:30.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.120+0000 7f63437fe640 1 -- 172.21.15.123:0/2899929915 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63440cf710 con 0x7f634406bfd0 2024-09-15T23:16:30.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.120+0000 7f6342ffd640 1 -- 172.21.15.123:0/2899929915 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2008921040 0 0) 0x7f63441631c0 con 0x7f63440b3350 2024-09-15T23:16:30.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.121+0000 7f63437fe640 1 --2- 172.21.15.123:0/2899929915 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f634406bfd0 0x7f634406c3b0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f63340097a0 tx=0x7f633402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd9a12392617683 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:30.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.121+0000 7f6342ffd640 1 -- 172.21.15.123:0/2899929915 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6334037070 con 0x7f634406bfd0 2024-09-15T23:16:30.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.121+0000 7f6342ffd640 1 -- 172.21.15.123:0/2899929915 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6334032440 con 0x7f634406bfd0 2024-09-15T23:16:30.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.121+0000 7f6342ffd640 1 -- 172.21.15.123:0/2899929915 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6334032810 con 0x7f634406bfd0 2024-09-15T23:16:30.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.121+0000 7f634a1af640 1 -- 172.21.15.123:0/2899929915 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f634406bfd0 msgr2=0x7f634406c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:30.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.121+0000 7f634a1af640 1 --2- 172.21.15.123:0/2899929915 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f634406bfd0 0x7f634406c3b0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f63340097a0 tx=0x7f633402a1e0 comp rx=0 tx=0).stop 2024-09-15T23:16:30.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.121+0000 7f634a1af640 1 -- 172.21.15.123:0/2899929915 shutdown_connections 2024-09-15T23:16:30.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.121+0000 7f634a1af640 1 --2- 172.21.15.123:0/2899929915 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f634406bfd0 0x7f634406c3b0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:30.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.121+0000 7f634a1af640 1 -- 172.21.15.123:0/2899929915 >> 172.21.15.123:0/2899929915 conn(0x7f63440d11c0 msgr2=0x7f63440d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:30.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.121+0000 7f634a1af640 1 -- 172.21.15.123:0/2899929915 shutdown_connections 2024-09-15T23:16:30.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.121+0000 7f634a1af640 1 -- 172.21.15.123:0/2899929915 wait complete. 2024-09-15T23:16:30.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.123+0000 7f634a1af640 1 Processor -- start 2024-09-15T23:16:30.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.123+0000 7f634a1af640 1 -- start start 2024-09-15T23:16:30.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.123+0000 7f634a1af640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f634406bfd0 0x7f6344160230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:30.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.123+0000 7f634a1af640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63440b3350 0x7f6344160770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:30.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.123+0000 7f634a1af640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f63440d3930 0x7f63440cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:30.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.123+0000 7f634a1af640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f63440cfcd0 con 0x7f63440b3350 2024-09-15T23:16:30.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.123+0000 7f634a1af640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f63440cffb0 con 0x7f634406bfd0 2024-09-15T23:16:30.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.123+0000 7f634a1af640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f63440d2400 con 0x7f63440d3930 2024-09-15T23:16:30.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.123+0000 7f633bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63440b3350 0x7f6344160770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:30.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.124+0000 7f633bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63440b3350 0x7f6344160770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41812/0 (socket says 172.21.15.123:41812) 2024-09-15T23:16:30.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.124+0000 7f633bfff640 1 -- 172.21.15.123:0/3220740909 learned_addr learned my addr 172.21.15.123:0/3220740909 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:30.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.124+0000 7f633bfff640 1 -- 172.21.15.123:0/3220740909 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f63440d3930 msgr2=0x7f63440cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:30.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.124+0000 7f633bfff640 1 --2- 172.21.15.123:0/3220740909 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f63440d3930 0x7f63440cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:30.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.124+0000 7f633bfff640 1 -- 172.21.15.123:0/3220740909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f634406bfd0 msgr2=0x7f6344160230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:30.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.124+0000 7f633bfff640 1 --2- 172.21.15.123:0/3220740909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f634406bfd0 0x7f6344160230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:30.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.124+0000 7f633bfff640 1 -- 172.21.15.123:0/3220740909 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6344160fa0 con 0x7f63440b3350 2024-09-15T23:16:30.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.124+0000 7f633bfff640 1 --2- 172.21.15.123:0/3220740909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63440b3350 0x7f6344160770 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f632c00c4d0 tx=0x7f632c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:30.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.124+0000 7f6340ff9640 1 -- 172.21.15.123:0/3220740909 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c018070 con 0x7f63440b3350 2024-09-15T23:16:30.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.124+0000 7f6340ff9640 1 -- 172.21.15.123:0/3220740909 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f632c007500 con 0x7f63440b3350 2024-09-15T23:16:30.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.124+0000 7f634a1af640 1 -- 172.21.15.123:0/3220740909 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6344161280 con 0x7f63440b3350 2024-09-15T23:16:30.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.124+0000 7f6340ff9640 1 -- 172.21.15.123:0/3220740909 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c004a20 con 0x7f63440b3350 2024-09-15T23:16:30.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.124+0000 7f634a1af640 1 -- 172.21.15.123:0/3220740909 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63441f4d00 con 0x7f63440b3350 2024-09-15T23:16:30.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.125+0000 7f634a1af640 1 -- 172.21.15.123:0/3220740909 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6344161450 con 0x7f63440b3350 2024-09-15T23:16:30.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.126+0000 7f6340ff9640 1 -- 172.21.15.123:0/3220740909 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f632c01b070 con 0x7f63440b3350 2024-09-15T23:16:30.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.126+0000 7f6340ff9640 1 --2- 172.21.15.123:0/3220740909 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f632406c2b0 0x7f632406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:30.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.126+0000 7f6340ff9640 1 -- 172.21.15.123:0/3220740909 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5201+0+0 (secure 0 0 0) 0x7f632c08a540 con 0x7f63440b3350 2024-09-15T23:16:30.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.126+0000 7f63437fe640 1 --2- 172.21.15.123:0/3220740909 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f632406c2b0 0x7f632406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:30.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.127+0000 7f63437fe640 1 --2- 172.21.15.123:0/3220740909 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f632406c2b0 0x7f632406e770 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6334034000 tx=0x7f633402c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:30.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.130+0000 7f6340ff9640 1 -- 172.21.15.123:0/3220740909 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f632c058f30 con 0x7f63440b3350 2024-09-15T23:16:30.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.293+0000 7f634a1af640 1 -- 172.21.15.123:0/3220740909 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f63440d0cf0 con 0x7f63440b3350 2024-09-15T23:16:30.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.293+0000 7f6340ff9640 1 -- 172.21.15.123:0/3220740909 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) ==== 93+0+10 (secure 0 0 0) 0x7f632c058830 con 0x7f63440b3350 2024-09-15T23:16:30.294 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-15T23:16:30.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.295+0000 7f634a1af640 1 -- 172.21.15.123:0/3220740909 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f632406c2b0 msgr2=0x7f632406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:30.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.295+0000 7f634a1af640 1 --2- 172.21.15.123:0/3220740909 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f632406c2b0 0x7f632406e770 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6334034000 tx=0x7f633402c000 comp rx=0 tx=0).stop 2024-09-15T23:16:30.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.295+0000 7f634a1af640 1 -- 172.21.15.123:0/3220740909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63440b3350 msgr2=0x7f6344160770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:30.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.295+0000 7f634a1af640 1 --2- 172.21.15.123:0/3220740909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63440b3350 0x7f6344160770 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f632c00c4d0 tx=0x7f632c00c990 comp rx=0 tx=0).stop 2024-09-15T23:16:30.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.295+0000 7f634a1af640 1 -- 172.21.15.123:0/3220740909 shutdown_connections 2024-09-15T23:16:30.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.295+0000 7f634a1af640 1 --2- 172.21.15.123:0/3220740909 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f63440d3930 0x7f63440cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:30.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.295+0000 7f634a1af640 1 --2- 172.21.15.123:0/3220740909 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f632406c2b0 0x7f632406e770 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:30.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.295+0000 7f634a1af640 1 --2- 172.21.15.123:0/3220740909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63440b3350 0x7f6344160770 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:30.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.295+0000 7f634a1af640 1 --2- 172.21.15.123:0/3220740909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f634406bfd0 0x7f6344160230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:30.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.295+0000 7f634a1af640 1 -- 172.21.15.123:0/3220740909 >> 172.21.15.123:0/3220740909 conn(0x7f63440d11c0 msgr2=0x7f634415c640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:30.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.295+0000 7f634a1af640 1 -- 172.21.15.123:0/3220740909 shutdown_connections 2024-09-15T23:16:30.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.295+0000 7f634a1af640 1 -- 172.21.15.123:0/3220740909 wait complete. 2024-09-15T23:16:30.308 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags' 2024-09-15T23:16:30.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.405+0000 7f72f9d8f640 1 Processor -- start 2024-09-15T23:16:30.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.405+0000 7f72f9d8f640 1 -- start start 2024-09-15T23:16:30.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.406+0000 7f72f9d8f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f72f413eb20 0x7f72f415c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:30.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.406+0000 7f72f9d8f640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72f4071180 con 0x7f72f406c320 2024-09-15T23:16:30.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.406+0000 7f72f9d8f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72f4071460 con 0x7f72f40b2d40 2024-09-15T23:16:30.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.406+0000 7f72f9d8f640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f72f4071ab0 con 0x7f72f413eb20 2024-09-15T23:16:30.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.406+0000 7f72f2ffd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f72f406c320 0x7f72f415bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38434/0 (socket says 172.21.15.123:38434) 2024-09-15T23:16:30.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.406+0000 7f72f2ffd640 1 -- 172.21.15.123:0/1226536593 learned_addr learned my addr 172.21.15.123:0/1226536593 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:30.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.406+0000 7f72f3fff640 1 --2- 172.21.15.123:0/1226536593 >> v2:172.21.15.188:3300/0 conn(0x7f72f413eb20 0x7f72f415c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:30.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.406+0000 7f72f27fc640 1 -- 172.21.15.123:0/1226536593 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1954853748 0 0) 0x7f72f4071180 con 0x7f72f406c320 2024-09-15T23:16:30.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.406+0000 7f72f27fc640 1 -- 172.21.15.123:0/1226536593 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72dc003520 con 0x7f72f406c320 2024-09-15T23:16:30.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.406+0000 7f72f27fc640 1 -- 172.21.15.123:0/1226536593 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2230966471 0 0) 0x7f72dc003520 con 0x7f72f406c320 2024-09-15T23:16:30.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.406+0000 7f72f27fc640 1 -- 172.21.15.123:0/1226536593 >> v2:172.21.15.188:3300/0 conn(0x7f72f413eb20 msgr2=0x7f72f415c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:30.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.406+0000 7f72f27fc640 1 --2- 172.21.15.123:0/1226536593 >> v2:172.21.15.188:3300/0 conn(0x7f72f413eb20 0x7f72f415c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:30.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.406+0000 7f72f27fc640 1 -- 172.21.15.123:0/1226536593 >> v1:172.21.15.188:6789/0 conn(0x7f72f40b2d40 legacy=0x7f72f406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:30.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.406+0000 7f72f27fc640 1 -- 172.21.15.123:0/1226536593 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f4071740 con 0x7f72f406c320 2024-09-15T23:16:30.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.406+0000 7f72f27fc640 1 -- 172.21.15.123:0/1226536593 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f72e8001670 con 0x7f72f406c320 2024-09-15T23:16:30.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.406+0000 7f72f27fc640 1 -- 172.21.15.123:0/1226536593 >> v1:172.21.15.123:6789/0 conn(0x7f72f406c320 legacy=0x7f72f415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:30.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.406+0000 7f72f27fc640 1 --2- 172.21.15.123:0/1226536593 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72dc0039b0 0x7f72dc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:30.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.406+0000 7f72f27fc640 1 --2- 172.21.15.123:0/1226536593 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f72dc004800 0x7f72dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:30.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.406+0000 7f72f27fc640 1 --2- 172.21.15.123:0/1226536593 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72dc0051c0 0x7f72dc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:30.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.406+0000 7f72f27fc640 1 -- 172.21.15.123:0/1226536593 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f72f4071ab0 con 0x7f72dc0051c0 2024-09-15T23:16:30.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.407+0000 7f72f27fc640 1 -- 172.21.15.123:0/1226536593 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f72dc00c060 con 0x7f72dc004800 2024-09-15T23:16:30.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.407+0000 7f72f27fc640 1 -- 172.21.15.123:0/1226536593 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f72dc00c260 con 0x7f72dc0039b0 2024-09-15T23:16:30.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.407+0000 7f72f3fff640 1 --2- 172.21.15.123:0/1226536593 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72dc0051c0 0x7f72dc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:30.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.407+0000 7f72f2ffd640 1 --2- 172.21.15.123:0/1226536593 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f72dc004800 0x7f72dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:30.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.407+0000 7f72f37fe640 1 --2- 172.21.15.123:0/1226536593 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72dc0039b0 0x7f72dc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:30.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.407+0000 7f72f3fff640 1 -- 172.21.15.123:0/1226536593 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72dc0039b0 msgr2=0x7f72dc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:30.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.407+0000 7f72f3fff640 1 --2- 172.21.15.123:0/1226536593 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72dc0039b0 0x7f72dc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:30.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.407+0000 7f72f3fff640 1 -- 172.21.15.123:0/1226536593 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f72dc004800 msgr2=0x7f72dc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:30.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.407+0000 7f72f3fff640 1 --2- 172.21.15.123:0/1226536593 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f72dc004800 0x7f72dc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:30.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.407+0000 7f72f3fff640 1 -- 172.21.15.123:0/1226536593 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72dc003520 con 0x7f72dc0051c0 2024-09-15T23:16:30.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.408+0000 7f72f3fff640 1 -- 172.21.15.123:0/1226536593 reap_dead start 2024-09-15T23:16:30.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.408+0000 7f72f3fff640 1 --2- 172.21.15.123:0/1226536593 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72dc0051c0 0x7f72dc00b9c0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f72ec009fc0 tx=0x7f72dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=720b1209216f8ed3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:30.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.408+0000 7f72f27fc640 1 -- 172.21.15.123:0/1226536593 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ec035020 con 0x7f72dc0051c0 2024-09-15T23:16:30.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.408+0000 7f72f27fc640 1 -- 172.21.15.123:0/1226536593 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72ec003b90 con 0x7f72dc0051c0 2024-09-15T23:16:30.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.408+0000 7f72f27fc640 1 -- 172.21.15.123:0/1226536593 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ec009c10 con 0x7f72dc0051c0 2024-09-15T23:16:30.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.408+0000 7f72f9d8f640 1 -- 172.21.15.123:0/1226536593 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72dc0051c0 msgr2=0x7f72dc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:30.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.408+0000 7f72f9d8f640 1 --2- 172.21.15.123:0/1226536593 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72dc0051c0 0x7f72dc00b9c0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f72ec009fc0 tx=0x7f72dc005830 comp rx=0 tx=0).stop 2024-09-15T23:16:30.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.408+0000 7f72f9d8f640 1 -- 172.21.15.123:0/1226536593 shutdown_connections 2024-09-15T23:16:30.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.408+0000 7f72f9d8f640 1 --2- 172.21.15.123:0/1226536593 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72dc0051c0 0x7f72dc00b9c0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:30.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.408+0000 7f72f9d8f640 1 -- 172.21.15.123:0/1226536593 >> 172.21.15.123:0/1226536593 conn(0x7f72f40ccec0 msgr2=0x7f72f40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:30.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.408+0000 7f72f9d8f640 1 -- 172.21.15.123:0/1226536593 shutdown_connections 2024-09-15T23:16:30.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.408+0000 7f72f9d8f640 1 -- 172.21.15.123:0/1226536593 wait complete. 2024-09-15T23:16:30.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.409+0000 7f72f9d8f640 1 Processor -- start 2024-09-15T23:16:30.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.410+0000 7f72f9d8f640 1 -- start start 2024-09-15T23:16:30.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.410+0000 7f72f9d8f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f72dc0051c0 0x7f72f4142b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:30.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.410+0000 7f72f9d8f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72f4158d20 0x7f72f413ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:30.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.410+0000 7f72f9d8f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72f41591a0 0x7f72f415ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:30.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.410+0000 7f72f9d8f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f72f406bfa0 con 0x7f72f4158d20 2024-09-15T23:16:30.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.410+0000 7f72f9d8f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f72f406be20 con 0x7f72dc0051c0 2024-09-15T23:16:30.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.410+0000 7f72f9d8f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f72f406c120 con 0x7f72f41591a0 2024-09-15T23:16:30.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.410+0000 7f72f2ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72f4158d20 0x7f72f413ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:30.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.410+0000 7f72f2ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72f4158d20 0x7f72f413ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41820/0 (socket says 172.21.15.123:41820) 2024-09-15T23:16:30.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.410+0000 7f72f2ffd640 1 -- 172.21.15.123:0/2156355778 learned_addr learned my addr 172.21.15.123:0/2156355778 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:30.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.411+0000 7f72f2ffd640 1 -- 172.21.15.123:0/2156355778 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72f41591a0 msgr2=0x7f72f415ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:30.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.411+0000 7f72f2ffd640 1 --2- 172.21.15.123:0/2156355778 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72f41591a0 0x7f72f415ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:30.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.411+0000 7f72f37fe640 1 --2- 172.21.15.123:0/2156355778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f72dc0051c0 0x7f72f4142b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:30.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.411+0000 7f72f2ffd640 1 -- 172.21.15.123:0/2156355778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f72dc0051c0 msgr2=0x7f72f4142b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:30.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.411+0000 7f72f2ffd640 1 --2- 172.21.15.123:0/2156355778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f72dc0051c0 0x7f72f4142b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:30.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.411+0000 7f72f2ffd640 1 -- 172.21.15.123:0/2156355778 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f4141e10 con 0x7f72f4158d20 2024-09-15T23:16:30.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.411+0000 7f72f37fe640 1 --2- 172.21.15.123:0/2156355778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f72dc0051c0 0x7f72f4142b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:16:30.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.411+0000 7f72f2ffd640 1 --2- 172.21.15.123:0/2156355778 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72f4158d20 0x7f72f413ef70 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f72e8004ef0 tx=0x7f72e8007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:30.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.411+0000 7f72dbfff640 1 -- 172.21.15.123:0/2156355778 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e800f7b0 con 0x7f72f4158d20 2024-09-15T23:16:30.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.411+0000 7f72dbfff640 1 -- 172.21.15.123:0/2156355778 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72e8018070 con 0x7f72f4158d20 2024-09-15T23:16:30.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.411+0000 7f72f9d8f640 1 -- 172.21.15.123:0/2156355778 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72f413f950 con 0x7f72f4158d20 2024-09-15T23:16:30.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.411+0000 7f72dbfff640 1 -- 172.21.15.123:0/2156355778 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e800fbd0 con 0x7f72f4158d20 2024-09-15T23:16:30.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.411+0000 7f72f9d8f640 1 -- 172.21.15.123:0/2156355778 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72f4142390 con 0x7f72f4158d20 2024-09-15T23:16:30.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.412+0000 7f72f9d8f640 1 -- 172.21.15.123:0/2156355778 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72f415bcf0 con 0x7f72f4158d20 2024-09-15T23:16:30.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.413+0000 7f72dbfff640 1 -- 172.21.15.123:0/2156355778 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f72e801d460 con 0x7f72f4158d20 2024-09-15T23:16:30.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.413+0000 7f72dbfff640 1 --2- 172.21.15.123:0/2156355778 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f72e006c2b0 0x7f72e006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:30.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.413+0000 7f72dbfff640 1 -- 172.21.15.123:0/2156355778 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5201+0+0 (secure 0 0 0) 0x7f72e808b180 con 0x7f72f4158d20 2024-09-15T23:16:30.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.413+0000 7f72f37fe640 1 --2- 172.21.15.123:0/2156355778 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f72e006c2b0 0x7f72e006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:30.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.414+0000 7f72f37fe640 1 --2- 172.21.15.123:0/2156355778 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f72e006c2b0 0x7f72e006e770 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f72e4005580 tx=0x7f72e4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:30.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.417+0000 7f72dbfff640 1 -- 172.21.15.123:0/2156355778 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f72e8059b70 con 0x7f72f4158d20 2024-09-15T23:16:30.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.646+0000 7f72f9d8f640 1 -- 172.21.15.123:0/2156355778 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]} v 0) -- 0x7f72f415ba00 con 0x7f72f4158d20 2024-09-15T23:16:30.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.711+0000 7f72dbfff640 1 -- 172.21.15.123:0/2156355778 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]}]=0 v229) ==== 154+0+0 (secure 0 0 0) 0x7f72e8059470 con 0x7f72f4158d20 2024-09-15T23:16:30.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.713+0000 7f72f9d8f640 1 -- 172.21.15.123:0/2156355778 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f72e006c2b0 msgr2=0x7f72e006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:30.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.713+0000 7f72f9d8f640 1 --2- 172.21.15.123:0/2156355778 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f72e006c2b0 0x7f72e006e770 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f72e4005580 tx=0x7f72e4009040 comp rx=0 tx=0).stop 2024-09-15T23:16:30.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.713+0000 7f72f9d8f640 1 -- 172.21.15.123:0/2156355778 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72f4158d20 msgr2=0x7f72f413ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:30.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.713+0000 7f72f9d8f640 1 --2- 172.21.15.123:0/2156355778 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72f4158d20 0x7f72f413ef70 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f72e8004ef0 tx=0x7f72e8007430 comp rx=0 tx=0).stop 2024-09-15T23:16:30.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.713+0000 7f72f9d8f640 1 -- 172.21.15.123:0/2156355778 shutdown_connections 2024-09-15T23:16:30.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.713+0000 7f72f9d8f640 1 --2- 172.21.15.123:0/2156355778 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72f41591a0 0x7f72f415ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:30.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.713+0000 7f72f9d8f640 1 --2- 172.21.15.123:0/2156355778 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f72e006c2b0 0x7f72e006e770 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:30.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.713+0000 7f72f9d8f640 1 --2- 172.21.15.123:0/2156355778 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72f4158d20 0x7f72f413ef70 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:30.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.713+0000 7f72f9d8f640 1 --2- 172.21.15.123:0/2156355778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f72dc0051c0 0x7f72f4142b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:30.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.713+0000 7f72f9d8f640 1 -- 172.21.15.123:0/2156355778 >> 172.21.15.123:0/2156355778 conn(0x7f72f40ccec0 msgr2=0x7f72f41595c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:30.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.713+0000 7f72f9d8f640 1 -- 172.21.15.123:0/2156355778 shutdown_connections 2024-09-15T23:16:30.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.713+0000 7f72f9d8f640 1 -- 172.21.15.123:0/2156355778 wait complete. 2024-09-15T23:16:30.726 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T23:16:30.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.826+0000 7f13d3331640 1 Processor -- start 2024-09-15T23:16:30.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.826+0000 7f13d3331640 1 -- start start 2024-09-15T23:16:30.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.827+0000 7f13d3331640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f13cc15e9d0 0x7f13cc1697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:30.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.827+0000 7f13d3331640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13cc06f020 con 0x7f13cc06c320 2024-09-15T23:16:30.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.827+0000 7f13d3331640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13cc06e2a0 con 0x7f13cc15e5f0 2024-09-15T23:16:30.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.827+0000 7f13d3331640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f13cc06eb90 con 0x7f13cc15e9d0 2024-09-15T23:16:30.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.827+0000 7f13d08cc640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f13cc06c320 0x7f13cc0cd060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38442/0 (socket says 172.21.15.123:38442) 2024-09-15T23:16:30.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.827+0000 7f13d08cc640 1 -- 172.21.15.123:0/3023377906 learned_addr learned my addr 172.21.15.123:0/3023377906 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:30.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.828+0000 7f13cbfff640 1 -- 172.21.15.123:0/3023377906 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2691232363 0 0) 0x7f13cc06f020 con 0x7f13cc06c320 2024-09-15T23:16:30.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.828+0000 7f13cbfff640 1 -- 172.21.15.123:0/3023377906 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13b4003520 con 0x7f13cc06c320 2024-09-15T23:16:30.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.828+0000 7f13d18ce640 1 --2- 172.21.15.123:0/3023377906 >> v2:172.21.15.188:3300/0 conn(0x7f13cc15e9d0 0x7f13cc1697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:30.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.828+0000 7f13cbfff640 1 -- 172.21.15.123:0/3023377906 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1919369948 0 0) 0x7f13b4003520 con 0x7f13cc06c320 2024-09-15T23:16:30.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.828+0000 7f13cbfff640 1 -- 172.21.15.123:0/3023377906 >> v2:172.21.15.188:3300/0 conn(0x7f13cc15e9d0 msgr2=0x7f13cc1697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:30.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.828+0000 7f13cbfff640 1 --2- 172.21.15.123:0/3023377906 >> v2:172.21.15.188:3300/0 conn(0x7f13cc15e9d0 0x7f13cc1697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:30.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.828+0000 7f13cbfff640 1 -- 172.21.15.123:0/3023377906 >> v1:172.21.15.188:6789/0 conn(0x7f13cc15e5f0 legacy=0x7f13cc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:30.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.828+0000 7f13cbfff640 1 -- 172.21.15.123:0/3023377906 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13cc06e540 con 0x7f13cc06c320 2024-09-15T23:16:30.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.828+0000 7f13cbfff640 1 -- 172.21.15.123:0/3023377906 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f13c0001670 con 0x7f13cc06c320 2024-09-15T23:16:30.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.828+0000 7f13d18ce640 1 --2- 172.21.15.123:0/3023377906 >> v2:172.21.15.188:3300/0 conn(0x7f13cc15e9d0 0x7f13cc1697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:16:30.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.828+0000 7f13cbfff640 1 -- 172.21.15.123:0/3023377906 >> v1:172.21.15.123:6789/0 conn(0x7f13cc06c320 legacy=0x7f13cc0cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:30.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.828+0000 7f13cbfff640 1 --2- 172.21.15.123:0/3023377906 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f13b40039b0 0x7f13b4003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:30.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.828+0000 7f13cbfff640 1 --2- 172.21.15.123:0/3023377906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13b4004800 0x7f13b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:30.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.828+0000 7f13cbfff640 1 --2- 172.21.15.123:0/3023377906 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f13b4005210 0x7f13b400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:30.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.828+0000 7f13cbfff640 1 -- 172.21.15.123:0/3023377906 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc06eb90 con 0x7f13b4004800 2024-09-15T23:16:30.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.828+0000 7f13cbfff640 1 -- 172.21.15.123:0/3023377906 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f13b400c140 con 0x7f13b4005210 2024-09-15T23:16:30.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.828+0000 7f13cbfff640 1 -- 172.21.15.123:0/3023377906 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f13b400c340 con 0x7f13b40039b0 2024-09-15T23:16:30.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.828+0000 7f13d08cc640 1 --2- 172.21.15.123:0/3023377906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13b4004800 0x7f13b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:30.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.828+0000 7f13d10cd640 1 --2- 172.21.15.123:0/3023377906 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f13b40039b0 0x7f13b4003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:30.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.828+0000 7f13d18ce640 1 --2- 172.21.15.123:0/3023377906 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f13b4005210 0x7f13b400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:30.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.828+0000 7f13d08cc640 1 -- 172.21.15.123:0/3023377906 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f13b40039b0 msgr2=0x7f13b4003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:30.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.828+0000 7f13d08cc640 1 --2- 172.21.15.123:0/3023377906 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f13b40039b0 0x7f13b4003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:30.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.828+0000 7f13d08cc640 1 -- 172.21.15.123:0/3023377906 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f13b4005210 msgr2=0x7f13b400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:30.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.828+0000 7f13d08cc640 1 --2- 172.21.15.123:0/3023377906 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f13b4005210 0x7f13b400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:30.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.828+0000 7f13d08cc640 1 -- 172.21.15.123:0/3023377906 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13b4003520 con 0x7f13b4004800 2024-09-15T23:16:30.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.828+0000 7f13d18ce640 1 --2- 172.21.15.123:0/3023377906 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f13b4005210 0x7f13b400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:16:30.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.828+0000 7f13d18ce640 1 -- 172.21.15.123:0/3023377906 reap_dead start 2024-09-15T23:16:30.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.829+0000 7f13d08cc640 1 --2- 172.21.15.123:0/3023377906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13b4004800 0x7f13b4004c80 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f13c000c240 tx=0x7f13b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1796172c9f77c03 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:30.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.829+0000 7f13cbfff640 1 -- 172.21.15.123:0/3023377906 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c0007d10 con 0x7f13b4004800 2024-09-15T23:16:30.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.829+0000 7f13cbfff640 1 -- 172.21.15.123:0/3023377906 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13c0005ad0 con 0x7f13b4004800 2024-09-15T23:16:30.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.829+0000 7f13cbfff640 1 -- 172.21.15.123:0/3023377906 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c0007070 con 0x7f13b4004800 2024-09-15T23:16:30.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.830+0000 7f13d3331640 1 -- 172.21.15.123:0/3023377906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13b4004800 msgr2=0x7f13b4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:30.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.830+0000 7f13d3331640 1 --2- 172.21.15.123:0/3023377906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13b4004800 0x7f13b4004c80 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f13c000c240 tx=0x7f13b4005830 comp rx=0 tx=0).stop 2024-09-15T23:16:30.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.830+0000 7f13d3331640 1 -- 172.21.15.123:0/3023377906 shutdown_connections 2024-09-15T23:16:30.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.830+0000 7f13d3331640 1 --2- 172.21.15.123:0/3023377906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13b4004800 0x7f13b4004c80 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:30.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.830+0000 7f13d3331640 1 -- 172.21.15.123:0/3023377906 >> 172.21.15.123:0/3023377906 conn(0x7f13cc0d14d0 msgr2=0x7f13cc0d18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:30.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.830+0000 7f13d3331640 1 -- 172.21.15.123:0/3023377906 shutdown_connections 2024-09-15T23:16:30.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.830+0000 7f13d3331640 1 -- 172.21.15.123:0/3023377906 wait complete. 2024-09-15T23:16:30.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.831+0000 7f13d3331640 1 Processor -- start 2024-09-15T23:16:30.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.831+0000 7f13d3331640 1 -- start start 2024-09-15T23:16:30.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.832+0000 7f13d3331640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13b4004800 0x7f13cc0b4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:30.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.832+0000 7f13d3331640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f13cc0c8ab0 0x7f13cc156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:30.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.832+0000 7f13d3331640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f13cc157630 0x7f13cc157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:30.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.832+0000 7f13d3331640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc06bc10 con 0x7f13b4004800 2024-09-15T23:16:30.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.832+0000 7f13d3331640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f13cc06c860 con 0x7f13cc157630 2024-09-15T23:16:30.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.832+0000 7f13d3331640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f13cc06bd90 con 0x7f13cc0c8ab0 2024-09-15T23:16:30.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.832+0000 7f13d10cd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13b4004800 0x7f13cc0b4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:30.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.832+0000 7f13d10cd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13b4004800 0x7f13cc0b4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41836/0 (socket says 172.21.15.123:41836) 2024-09-15T23:16:30.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.832+0000 7f13d10cd640 1 -- 172.21.15.123:0/958626078 learned_addr learned my addr 172.21.15.123:0/958626078 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:30.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.832+0000 7f13d08cc640 1 --2- 172.21.15.123:0/958626078 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f13cc0c8ab0 0x7f13cc156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:30.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.832+0000 7f13d18ce640 1 --2- 172.21.15.123:0/958626078 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f13cc157630 0x7f13cc157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:30.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.832+0000 7f13d10cd640 1 -- 172.21.15.123:0/958626078 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f13cc0c8ab0 msgr2=0x7f13cc156de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:30.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.832+0000 7f13d10cd640 1 --2- 172.21.15.123:0/958626078 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f13cc0c8ab0 0x7f13cc156de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:30.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.832+0000 7f13d10cd640 1 -- 172.21.15.123:0/958626078 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f13cc157630 msgr2=0x7f13cc157ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:30.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.832+0000 7f13d10cd640 1 --2- 172.21.15.123:0/958626078 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f13cc157630 0x7f13cc157ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:30.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.832+0000 7f13d10cd640 1 -- 172.21.15.123:0/958626078 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13cc157320 con 0x7f13b4004800 2024-09-15T23:16:30.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.832+0000 7f13d08cc640 1 --2- 172.21.15.123:0/958626078 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f13cc0c8ab0 0x7f13cc156de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:16:30.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.832+0000 7f13d18ce640 1 --2- 172.21.15.123:0/958626078 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f13cc157630 0x7f13cc157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:16:30.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.832+0000 7f13d10cd640 1 --2- 172.21.15.123:0/958626078 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13b4004800 0x7f13cc0b4d10 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f13bc00f850 tx=0x7f13bc00fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:30.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.832+0000 7f13c9ffb640 1 -- 172.21.15.123:0/958626078 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13bc00fe40 con 0x7f13b4004800 2024-09-15T23:16:30.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.832+0000 7f13c9ffb640 1 -- 172.21.15.123:0/958626078 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13bc018070 con 0x7f13b4004800 2024-09-15T23:16:30.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.832+0000 7f13d3331640 1 -- 172.21.15.123:0/958626078 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13cc0b57b0 con 0x7f13b4004800 2024-09-15T23:16:30.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.832+0000 7f13c9ffb640 1 -- 172.21.15.123:0/958626078 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13bc00d6d0 con 0x7f13b4004800 2024-09-15T23:16:30.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.833+0000 7f13d3331640 1 -- 172.21.15.123:0/958626078 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13cc0b5d70 con 0x7f13b4004800 2024-09-15T23:16:30.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.833+0000 7f13d3331640 1 -- 172.21.15.123:0/958626078 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13cc157ff0 con 0x7f13b4004800 2024-09-15T23:16:30.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.834+0000 7f13c9ffb640 1 -- 172.21.15.123:0/958626078 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f13bc00d870 con 0x7f13b4004800 2024-09-15T23:16:30.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.834+0000 7f13c9ffb640 1 --2- 172.21.15.123:0/958626078 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f13b806c2b0 0x7f13b806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:30.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.834+0000 7f13c9ffb640 1 -- 172.21.15.123:0/958626078 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5201+0+0 (secure 0 0 0) 0x7f13bc08b020 con 0x7f13b4004800 2024-09-15T23:16:30.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.834+0000 7f13d08cc640 1 --2- 172.21.15.123:0/958626078 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f13b806c2b0 0x7f13b806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:30.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.835+0000 7f13d08cc640 1 --2- 172.21.15.123:0/958626078 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f13b806c2b0 0x7f13b806e770 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f13c0033000 tx=0x7f13c002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:30.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:30.838+0000 7f13c9ffb640 1 -- 172.21.15.123:0/958626078 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f13bc059980 con 0x7f13b4004800 2024-09-15T23:16:31.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.005+0000 7f13d3331640 1 -- 172.21.15.123:0/958626078 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f13cc0b6430 con 0x7f13b4004800 2024-09-15T23:16:31.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.009+0000 7f13c9ffb640 1 -- 172.21.15.123:0/958626078 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7f13cc0b6430 con 0x7f13b4004800 2024-09-15T23:16:31.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.011+0000 7f13d3331640 1 -- 172.21.15.123:0/958626078 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f13b806c2b0 msgr2=0x7f13b806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:31.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.011+0000 7f13d3331640 1 --2- 172.21.15.123:0/958626078 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f13b806c2b0 0x7f13b806e770 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f13c0033000 tx=0x7f13c002e000 comp rx=0 tx=0).stop 2024-09-15T23:16:31.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.011+0000 7f13d3331640 1 -- 172.21.15.123:0/958626078 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13b4004800 msgr2=0x7f13cc0b4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:31.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.011+0000 7f13d3331640 1 --2- 172.21.15.123:0/958626078 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13b4004800 0x7f13cc0b4d10 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f13bc00f850 tx=0x7f13bc00fd10 comp rx=0 tx=0).stop 2024-09-15T23:16:31.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.011+0000 7f13d3331640 1 -- 172.21.15.123:0/958626078 shutdown_connections 2024-09-15T23:16:31.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.011+0000 7f13d3331640 1 --2- 172.21.15.123:0/958626078 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f13cc157630 0x7f13cc157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:31.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.011+0000 7f13d3331640 1 --2- 172.21.15.123:0/958626078 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f13cc0c8ab0 0x7f13cc156de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:31.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.011+0000 7f13d3331640 1 --2- 172.21.15.123:0/958626078 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f13b806c2b0 0x7f13b806e770 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:31.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.011+0000 7f13d3331640 1 --2- 172.21.15.123:0/958626078 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13b4004800 0x7f13cc0b4d10 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:31.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.011+0000 7f13d3331640 1 -- 172.21.15.123:0/958626078 >> 172.21.15.123:0/958626078 conn(0x7f13cc0d14d0 msgr2=0x7f13cc0b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:31.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.011+0000 7f13d3331640 1 -- 172.21.15.123:0/958626078 shutdown_connections 2024-09-15T23:16:31.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.011+0000 7f13d3331640 1 -- 172.21.15.123:0/958626078 wait complete. 2024-09-15T23:16:31.023 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:16:31.023 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:16:31.057 DEBUG:teuthology.orchestra.run.smithi188:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:16:31.100 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:16:31.100 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:16:31.100 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:16:31.116 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:16:31.116 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:16:31.116 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:16:31.159 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:16:31.159 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:16:31.159 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:16:31.174 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:16:31.175 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:16:31.175 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:16:31.217 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:16:31.217 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-15T23:16:31.217 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:16:31.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.314+0000 7f6fabc77640 1 Processor -- start 2024-09-15T23:16:31.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.314+0000 7f6fabc77640 1 -- start start 2024-09-15T23:16:31.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.315+0000 7f6fabc77640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f6fa415c4f0 0x7f6fa415d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:31.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.315+0000 7f6fabc77640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6fa40d0200 0x7f6fa40d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:31.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.315+0000 7f6fabc77640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fa4073400 con 0x7f6fa4160100 2024-09-15T23:16:31.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.315+0000 7f6fabc77640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f6fa40d0bb0 con 0x7f6fa40d0200 2024-09-15T23:16:31.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.315+0000 7f6fabc77640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f6fa40736e0 con 0x7f6fa415c4f0 2024-09-15T23:16:31.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.315+0000 7f6fa9212640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6fa40d0200 0x7f6fa40d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:31.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.316+0000 7f6fa9212640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6fa40d0200 0x7f6fa40d0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41848/0 (socket says 172.21.15.123:41848) 2024-09-15T23:16:31.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.316+0000 7f6fa9212640 1 -- 172.21.15.123:0/3490306440 learned_addr learned my addr 172.21.15.123:0/3490306440 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:31.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.316+0000 7f6fa9a13640 1 --2- 172.21.15.123:0/3490306440 >> v2:172.21.15.188:3300/0 conn(0x7f6fa415c4f0 0x7f6fa415d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:31.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.316+0000 7f6fa9212640 1 -- 172.21.15.123:0/3490306440 >> v2:172.21.15.188:3300/0 conn(0x7f6fa415c4f0 msgr2=0x7f6fa415d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:31.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.316+0000 7f6fa9212640 1 --2- 172.21.15.123:0/3490306440 >> v2:172.21.15.188:3300/0 conn(0x7f6fa415c4f0 0x7f6fa415d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:31.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.316+0000 7f6fa9212640 1 -- 172.21.15.123:0/3490306440 >> v1:172.21.15.188:6789/0 conn(0x7f6fa4160100 legacy=0x7f6fa4160550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:31.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.316+0000 7f6fa9212640 1 -- 172.21.15.123:0/3490306440 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fa40739c0 con 0x7f6fa40d0200 2024-09-15T23:16:31.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.316+0000 7f6fa9212640 1 --2- 172.21.15.123:0/3490306440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa40d0200 0x7f6fa40d0670 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f6fa40d00f0 tx=0x7f6f9802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f66d240f151d4b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:31.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.317+0000 7f6fa8a11640 1 -- 172.21.15.123:0/3490306440 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f98037070 con 0x7f6fa40d0200 2024-09-15T23:16:31.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.317+0000 7f6fa8a11640 1 -- 172.21.15.123:0/3490306440 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f98032440 con 0x7f6fa40d0200 2024-09-15T23:16:31.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.317+0000 7f6fa8a11640 1 -- 172.21.15.123:0/3490306440 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f98032810 con 0x7f6fa40d0200 2024-09-15T23:16:31.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.317+0000 7f6fabc77640 1 -- 172.21.15.123:0/3490306440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa40d0200 msgr2=0x7f6fa40d0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:31.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.317+0000 7f6fabc77640 1 --2- 172.21.15.123:0/3490306440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa40d0200 0x7f6fa40d0670 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f6fa40d00f0 tx=0x7f6f9802a230 comp rx=0 tx=0).stop 2024-09-15T23:16:31.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.317+0000 7f6fabc77640 1 -- 172.21.15.123:0/3490306440 shutdown_connections 2024-09-15T23:16:31.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.317+0000 7f6fabc77640 1 --2- 172.21.15.123:0/3490306440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa40d0200 0x7f6fa40d0670 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:31.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.317+0000 7f6fabc77640 1 --2- 172.21.15.123:0/3490306440 >> v2:172.21.15.188:3300/0 conn(0x7f6fa415c4f0 0x7f6fa415d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:31.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.317+0000 7f6fabc77640 1 -- 172.21.15.123:0/3490306440 >> 172.21.15.123:0/3490306440 conn(0x7f6fa406f400 msgr2=0x7f6fa406f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:31.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.317+0000 7f6fabc77640 1 -- 172.21.15.123:0/3490306440 shutdown_connections 2024-09-15T23:16:31.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.317+0000 7f6fabc77640 1 -- 172.21.15.123:0/3490306440 wait complete. 2024-09-15T23:16:31.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.318+0000 7f6fabc77640 1 Processor -- start 2024-09-15T23:16:31.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.318+0000 7f6fabc77640 1 -- start start 2024-09-15T23:16:31.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.319+0000 7f6fabc77640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa40d0200 0x7f6fa4158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:31.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.319+0000 7f6fabc77640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6fa415c4f0 0x7f6fa4159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:31.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.319+0000 7f6fabc77640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6fa4160100 0x7f6fa4159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:31.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.319+0000 7f6fabc77640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa40d0fa0 con 0x7f6fa40d0200 2024-09-15T23:16:31.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.319+0000 7f6fabc77640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa4073f80 con 0x7f6fa4160100 2024-09-15T23:16:31.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.319+0000 7f6fabc77640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6fa415c8d0 con 0x7f6fa415c4f0 2024-09-15T23:16:31.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.319+0000 7f6fa9a13640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa40d0200 0x7f6fa4158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:31.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.319+0000 7f6fa9a13640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa40d0200 0x7f6fa4158120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41856/0 (socket says 172.21.15.123:41856) 2024-09-15T23:16:31.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.319+0000 7f6fa9a13640 1 -- 172.21.15.123:0/3911683517 learned_addr learned my addr 172.21.15.123:0/3911683517 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:31.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.319+0000 7f6faa214640 1 --2- 172.21.15.123:0/3911683517 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6fa4160100 0x7f6fa4159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:31.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.319+0000 7f6fa9212640 1 --2- 172.21.15.123:0/3911683517 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6fa415c4f0 0x7f6fa4159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:31.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.319+0000 7f6fa9a13640 1 -- 172.21.15.123:0/3911683517 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6fa415c4f0 msgr2=0x7f6fa4159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:31.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.319+0000 7f6fa9a13640 1 --2- 172.21.15.123:0/3911683517 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6fa415c4f0 0x7f6fa4159a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:31.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.319+0000 7f6fa9a13640 1 -- 172.21.15.123:0/3911683517 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6fa4160100 msgr2=0x7f6fa4159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:31.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.319+0000 7f6fa9a13640 1 --2- 172.21.15.123:0/3911683517 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6fa4160100 0x7f6fa4159fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:31.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.319+0000 7f6fa9a13640 1 -- 172.21.15.123:0/3911683517 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fa40b3060 con 0x7f6fa40d0200 2024-09-15T23:16:31.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.320+0000 7f6fa9a13640 1 --2- 172.21.15.123:0/3911683517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa40d0200 0x7f6fa4158120 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f6f94007e40 tx=0x7f6f9400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:31.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.320+0000 7f6fa27fc640 1 -- 172.21.15.123:0/3911683517 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f94014620 con 0x7f6fa40d0200 2024-09-15T23:16:31.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.320+0000 7f6fa27fc640 1 -- 172.21.15.123:0/3911683517 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f94019070 con 0x7f6fa40d0200 2024-09-15T23:16:31.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.320+0000 7f6fabc77640 1 -- 172.21.15.123:0/3911683517 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fa40b3550 con 0x7f6fa40d0200 2024-09-15T23:16:31.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.320+0000 7f6fa27fc640 1 -- 172.21.15.123:0/3911683517 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f94014a00 con 0x7f6fa40d0200 2024-09-15T23:16:31.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.320+0000 7f6fabc77640 1 -- 172.21.15.123:0/3911683517 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fa40b3b10 con 0x7f6fa40d0200 2024-09-15T23:16:31.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.321+0000 7f6fabc77640 1 -- 172.21.15.123:0/3911683517 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fa4073080 con 0x7f6fa40d0200 2024-09-15T23:16:31.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.321+0000 7f6fa27fc640 1 -- 172.21.15.123:0/3911683517 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6f94014ba0 con 0x7f6fa40d0200 2024-09-15T23:16:31.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.322+0000 7f6fa27fc640 1 --2- 172.21.15.123:0/3911683517 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6f9006c2b0 0x7f6f9006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:31.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.322+0000 7f6fa27fc640 1 -- 172.21.15.123:0/3911683517 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5201+0+0 (secure 0 0 0) 0x7f6f9408ba10 con 0x7f6fa40d0200 2024-09-15T23:16:31.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.322+0000 7f6fa9212640 1 --2- 172.21.15.123:0/3911683517 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6f9006c2b0 0x7f6f9006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:31.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.322+0000 7f6fa9212640 1 --2- 172.21.15.123:0/3911683517 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6f9006c2b0 0x7f6f9006e770 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6f98034000 tx=0x7f6f9802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:31.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.326+0000 7f6fa27fc640 1 -- 172.21.15.123:0/3911683517 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6f9405a400 con 0x7f6fa40d0200 2024-09-15T23:16:31.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.523+0000 7f6fabc77640 1 -- 172.21.15.123:0/3911683517 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6fa40b7880 con 0x7f6fa40d0200 2024-09-15T23:16:31.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.524+0000 7f6fa27fc640 1 -- 172.21.15.123:0/3911683517 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+3920 (secure 0 0 0) 0x7f6f94059d00 con 0x7f6fa40d0200 2024-09-15T23:16:31.525 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:16:31.525 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":55,"btime":"2024-09-15T23:16:26:699782+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/2007918144","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2007918144},{"type":"v1","addr":"172.21.15.188:6835","nonce":2007918144}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":6199,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2540326254","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":2540326254},{"type":"v1","addr":"172.21.15.188:6837","nonce":2540326254}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6918,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/1092174152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":1092174152},{"type":"v1","addr":"172.21.15.123:6833","nonce":1092174152}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49},{"gid":7047,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/418545537","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":418545537},{"type":"v1","addr":"172.21.15.123:6835","nonce":418545537}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55}],"filesystems":[]} 2024-09-15T23:16:31.525 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 55 2024-09-15T23:16:31.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.526+0000 7f6fabc77640 1 -- 172.21.15.123:0/3911683517 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6f9006c2b0 msgr2=0x7f6f9006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:31.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.526+0000 7f6fabc77640 1 --2- 172.21.15.123:0/3911683517 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6f9006c2b0 0x7f6f9006e770 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6f98034000 tx=0x7f6f9802e000 comp rx=0 tx=0).stop 2024-09-15T23:16:31.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.526+0000 7f6fabc77640 1 -- 172.21.15.123:0/3911683517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa40d0200 msgr2=0x7f6fa4158120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:31.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.526+0000 7f6fabc77640 1 --2- 172.21.15.123:0/3911683517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa40d0200 0x7f6fa4158120 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f6f94007e40 tx=0x7f6f9400e4b0 comp rx=0 tx=0).stop 2024-09-15T23:16:31.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.526+0000 7f6fabc77640 1 -- 172.21.15.123:0/3911683517 shutdown_connections 2024-09-15T23:16:31.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.526+0000 7f6fabc77640 1 --2- 172.21.15.123:0/3911683517 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6fa4160100 0x7f6fa4159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:31.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.526+0000 7f6fabc77640 1 --2- 172.21.15.123:0/3911683517 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6fa415c4f0 0x7f6fa4159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:31.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.526+0000 7f6fabc77640 1 --2- 172.21.15.123:0/3911683517 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6f9006c2b0 0x7f6f9006e770 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:31.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.526+0000 7f6fabc77640 1 --2- 172.21.15.123:0/3911683517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa40d0200 0x7f6fa4158120 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:31.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.526+0000 7f6fabc77640 1 -- 172.21.15.123:0/3911683517 >> 172.21.15.123:0/3911683517 conn(0x7f6fa406f400 msgr2=0x7f6fa4160510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:31.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.526+0000 7f6fabc77640 1 -- 172.21.15.123:0/3911683517 shutdown_connections 2024-09-15T23:16:31.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.526+0000 7f6fabc77640 1 -- 172.21.15.123:0/3911683517 wait complete. 2024-09-15T23:16:31.538 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T23:16:31.538 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T23:16:31.538 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T23:16:31.539 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:16:31.539 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T23:16:31.539 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T23:16:31.539 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T23:16:31.539 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:16:31.539 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T23:16:31.539 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T23:16:31.540 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T23:16:31.540 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:16:31.540 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T23:16:31.540 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T23:16:31.540 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T23:16:31.540 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:16:31.548 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T23:16:31.549 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T23:16:31.549 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T23:16:31.550 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T23:16:31.552 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T23:16:31.552 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T23:16:31.553 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T23:16:31.553 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T23:16:31.591 INFO:tasks.ceph.mds.a:Started 2024-09-15T23:16:31.592 DEBUG:teuthology.parallel:result is None 2024-09-15T23:16:31.592 INFO:tasks.ceph.mds.c:Started 2024-09-15T23:16:31.593 DEBUG:teuthology.parallel:result is None 2024-09-15T23:16:31.595 INFO:tasks.ceph.mds.d:Started 2024-09-15T23:16:31.595 DEBUG:teuthology.parallel:result is None 2024-09-15T23:16:31.595 INFO:tasks.ceph.mds.b:Started 2024-09-15T23:16:31.596 DEBUG:teuthology.parallel:result is None 2024-09-15T23:16:31.596 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T23:16:31.666 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-15T23:16:31.667 INFO:tasks.ceph.mds.a.smithi123.stdout:starting mds.a at 2024-09-15T23:16:31.676 INFO:tasks.ceph.mds.b.smithi188.stdout:starting mds.b at 2024-09-15T23:16:31.676 INFO:tasks.ceph.mds.d.smithi188.stdout:starting mds.d at 2024-09-15T23:16:31.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.700+0000 7fe5b3265640 1 Processor -- start 2024-09-15T23:16:31.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.700+0000 7fe5b3265640 1 -- start start 2024-09-15T23:16:31.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.701+0000 7fe5b3265640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe5ac15ed20 0x7fe5ac0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:31.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.701+0000 7fe5b3265640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe5ac0b90e0 0x7fe5ac0b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:31.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.701+0000 7fe5b3265640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5ac0d0e70 con 0x7fe5ac0d23b0 2024-09-15T23:16:31.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.701+0000 7fe5b3265640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fe5ac0d41c0 con 0x7fe5ac15ed20 2024-09-15T23:16:31.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.701+0000 7fe5b3265640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe5ac0d35b0 con 0x7fe5ac0b90e0 2024-09-15T23:16:31.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.701+0000 7fe5b0800640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe5ac0d23b0 0x7fe5ac0cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38458/0 (socket says 172.21.15.123:38458) 2024-09-15T23:16:31.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.701+0000 7fe5b0800640 1 -- 172.21.15.123:0/328492349 learned_addr learned my addr 172.21.15.123:0/328492349 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:31.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.702+0000 7fe5b1001640 1 --2- 172.21.15.123:0/328492349 >> v2:172.21.15.188:3300/0 conn(0x7fe5ac15ed20 0x7fe5ac0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:31.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.702+0000 7fe5b1802640 1 --2- 172.21.15.123:0/328492349 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe5ac0b90e0 0x7fe5ac0b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:31.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.702+0000 7fe5a3fff640 1 -- 172.21.15.123:0/328492349 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1813770936 0 0) 0x7fe59c001110 con 0x7fe5ac0d23b0 2024-09-15T23:16:31.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.702+0000 7fe5a3fff640 1 -- 172.21.15.123:0/328492349 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe598003520 con 0x7fe5ac0d23b0 2024-09-15T23:16:31.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.702+0000 7fe5b1001640 1 -- 172.21.15.123:0/328492349 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe5ac0b90e0 msgr2=0x7fe5ac0b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:31.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.702+0000 7fe5b1001640 1 --2- 172.21.15.123:0/328492349 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe5ac0b90e0 0x7fe5ac0b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:31.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.702+0000 7fe5a3fff640 1 -- 172.21.15.123:0/328492349 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 85999582 0 0) 0x7fe598003520 con 0x7fe5ac0d23b0 2024-09-15T23:16:31.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.702+0000 7fe5b1001640 1 -- 172.21.15.123:0/328492349 >> v1:172.21.15.123:6789/0 conn(0x7fe5ac0d23b0 legacy=0x7fe5ac0cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:31.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.702+0000 7fe5b1001640 1 -- 172.21.15.123:0/328492349 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5ac0d3890 con 0x7fe5ac15ed20 2024-09-15T23:16:31.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.703+0000 7fe5b1001640 1 --2- 172.21.15.123:0/328492349 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5ac15ed20 0x7fe5ac0b6260 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80097a0 tx=0x7fe5a802a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e08bcc2c71fd0d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:31.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.703+0000 7fe5a3fff640 1 -- 172.21.15.123:0/328492349 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8037070 con 0x7fe5ac15ed20 2024-09-15T23:16:31.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.703+0000 7fe5a3fff640 1 -- 172.21.15.123:0/328492349 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5a802ab10 con 0x7fe5ac15ed20 2024-09-15T23:16:31.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.703+0000 7fe5a3fff640 1 -- 172.21.15.123:0/328492349 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59c001840 con 0x7fe5ac15ed20 2024-09-15T23:16:31.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.704+0000 7fe5b3265640 1 -- 172.21.15.123:0/328492349 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5ac15ed20 msgr2=0x7fe5ac0b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:31.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.704+0000 7fe5b3265640 1 --2- 172.21.15.123:0/328492349 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5ac15ed20 0x7fe5ac0b6260 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80097a0 tx=0x7fe5a802a080 comp rx=0 tx=0).stop 2024-09-15T23:16:31.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.704+0000 7fe5b3265640 1 -- 172.21.15.123:0/328492349 shutdown_connections 2024-09-15T23:16:31.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.704+0000 7fe5b3265640 1 --2- 172.21.15.123:0/328492349 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe5ac0b90e0 0x7fe5ac0b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:31.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.704+0000 7fe5b3265640 1 --2- 172.21.15.123:0/328492349 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5ac15ed20 0x7fe5ac0b6260 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:31.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.704+0000 7fe5b3265640 1 -- 172.21.15.123:0/328492349 >> 172.21.15.123:0/328492349 conn(0x7fe5ac0d1260 msgr2=0x7fe5ac0d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:31.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.704+0000 7fe5b3265640 1 -- 172.21.15.123:0/328492349 shutdown_connections 2024-09-15T23:16:31.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.704+0000 7fe5b3265640 1 -- 172.21.15.123:0/328492349 wait complete. 2024-09-15T23:16:31.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.705+0000 7fe5b3265640 1 Processor -- start 2024-09-15T23:16:31.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.705+0000 7fe5b3265640 1 -- start start 2024-09-15T23:16:31.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.706+0000 7fe5b3265640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5ac0b90e0 0x7fe5ac150b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:31.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.706+0000 7fe5b3265640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5ac0d23b0 0x7fe5ac0ce020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:31.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.706+0000 7fe5b3265640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe5ac15ed20 0x7fe5ac0b4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:31.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.706+0000 7fe5b3265640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac0d32a0 con 0x7fe5ac0b90e0 2024-09-15T23:16:31.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.706+0000 7fe5b1001640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5ac0b90e0 0x7fe5ac150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:31.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.706+0000 7fe5b3265640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac0d3e50 con 0x7fe5ac0d23b0 2024-09-15T23:16:31.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.706+0000 7fe5b1001640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5ac0b90e0 0x7fe5ac150b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41884/0 (socket says 172.21.15.123:41884) 2024-09-15T23:16:31.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.706+0000 7fe5b3265640 1 -- 172.21.15.123:0/3112010863 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe5ac15f100 con 0x7fe5ac15ed20 2024-09-15T23:16:31.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.706+0000 7fe5b1001640 1 -- 172.21.15.123:0/3112010863 learned_addr learned my addr 172.21.15.123:0/3112010863 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:31.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.706+0000 7fe5b0800640 1 --2- 172.21.15.123:0/3112010863 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5ac0d23b0 0x7fe5ac0ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:31.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.706+0000 7fe5b1802640 1 --2- 172.21.15.123:0/3112010863 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe5ac15ed20 0x7fe5ac0b4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:31.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.706+0000 7fe5b1001640 1 -- 172.21.15.123:0/3112010863 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe5ac15ed20 msgr2=0x7fe5ac0b4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:31.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.706+0000 7fe5b1001640 1 --2- 172.21.15.123:0/3112010863 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe5ac15ed20 0x7fe5ac0b4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:31.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.706+0000 7fe5b1001640 1 -- 172.21.15.123:0/3112010863 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5ac0d23b0 msgr2=0x7fe5ac0ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:31.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.706+0000 7fe5b1001640 1 --2- 172.21.15.123:0/3112010863 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5ac0d23b0 0x7fe5ac0ce020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:31.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.706+0000 7fe5b1001640 1 -- 172.21.15.123:0/3112010863 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5ac15f460 con 0x7fe5ac0b90e0 2024-09-15T23:16:31.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.706+0000 7fe5b1001640 1 --2- 172.21.15.123:0/3112010863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5ac0b90e0 0x7fe5ac150b10 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80098c0 tx=0x7fe5a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:31.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.706+0000 7fe5a1ffb640 1 -- 172.21.15.123:0/3112010863 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8037050 con 0x7fe5ac0b90e0 2024-09-15T23:16:31.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.706+0000 7fe5a1ffb640 1 -- 172.21.15.123:0/3112010863 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5a8043070 con 0x7fe5ac0b90e0 2024-09-15T23:16:31.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.706+0000 7fe5b3265640 1 -- 172.21.15.123:0/3112010863 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5ac15f720 con 0x7fe5ac0b90e0 2024-09-15T23:16:31.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.707+0000 7fe5a1ffb640 1 -- 172.21.15.123:0/3112010863 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8006e10 con 0x7fe5ac0b90e0 2024-09-15T23:16:31.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.707+0000 7fe5b3265640 1 -- 172.21.15.123:0/3112010863 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5ac15fce0 con 0x7fe5ac0b90e0 2024-09-15T23:16:31.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.708+0000 7fe5b3265640 1 -- 172.21.15.123:0/3112010863 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5ac0b7010 con 0x7fe5ac0b90e0 2024-09-15T23:16:31.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.708+0000 7fe5a1ffb640 1 -- 172.21.15.123:0/3112010863 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe5a803ca10 con 0x7fe5ac0b90e0 2024-09-15T23:16:31.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.709+0000 7fe5a1ffb640 1 --2- 172.21.15.123:0/3112010863 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe59006c2b0 0x7fe59006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:31.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.709+0000 7fe5a1ffb640 1 -- 172.21.15.123:0/3112010863 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5201+0+0 (secure 0 0 0) 0x7fe5a80abba0 con 0x7fe5ac0b90e0 2024-09-15T23:16:31.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.709+0000 7fe5b0800640 1 --2- 172.21.15.123:0/3112010863 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe59006c2b0 0x7fe59006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:31.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.709+0000 7fe5b0800640 1 --2- 172.21.15.123:0/3112010863 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe59006c2b0 0x7fe59006e770 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac0b6280 tx=0x7fe59c0012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:31.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.713+0000 7fe5a1ffb640 1 -- 172.21.15.123:0/3112010863 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe5a8079fd0 con 0x7fe5ac0b90e0 2024-09-15T23:16:31.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:31.896+0000 7fe5b3265640 1 -- 172.21.15.123:0/3112010863 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fe5ac0d0a90 con 0x7fe5ac0b90e0 2024-09-15T23:16:32.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.727+0000 7fe5a1ffb640 1 -- 172.21.15.123:0/3112010863 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v94) ==== 97+0+0 (secure 0 0 0) 0x7fe5a807e2d0 con 0x7fe5ac0b90e0 2024-09-15T23:16:32.728 INFO:teuthology.orchestra.run.smithi123.stderr: removed all blocklist entries 2024-09-15T23:16:32.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.731+0000 7fe5b3265640 1 -- 172.21.15.123:0/3112010863 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe59006c2b0 msgr2=0x7fe59006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:32.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.731+0000 7fe5b3265640 1 --2- 172.21.15.123:0/3112010863 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe59006c2b0 0x7fe59006e770 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac0b6280 tx=0x7fe59c0012d0 comp rx=0 tx=0).stop 2024-09-15T23:16:32.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.731+0000 7fe5b3265640 1 -- 172.21.15.123:0/3112010863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5ac0b90e0 msgr2=0x7fe5ac150b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:32.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.731+0000 7fe5b3265640 1 --2- 172.21.15.123:0/3112010863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5ac0b90e0 0x7fe5ac150b10 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80098c0 tx=0x7fe5a80046c0 comp rx=0 tx=0).stop 2024-09-15T23:16:32.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.731+0000 7fe5b3265640 1 -- 172.21.15.123:0/3112010863 shutdown_connections 2024-09-15T23:16:32.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.731+0000 7fe5b3265640 1 --2- 172.21.15.123:0/3112010863 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe5ac15ed20 0x7fe5ac0b4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:32.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.731+0000 7fe5b3265640 1 --2- 172.21.15.123:0/3112010863 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5ac0d23b0 0x7fe5ac0ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:32.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.731+0000 7fe5b3265640 1 --2- 172.21.15.123:0/3112010863 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe59006c2b0 0x7fe59006e770 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:32.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.731+0000 7fe5b3265640 1 --2- 172.21.15.123:0/3112010863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5ac0b90e0 0x7fe5ac150b10 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:32.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.731+0000 7fe5b3265640 1 -- 172.21.15.123:0/3112010863 >> 172.21.15.123:0/3112010863 conn(0x7fe5ac0d1260 msgr2=0x7fe5ac0b95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:32.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.731+0000 7fe5b3265640 1 -- 172.21.15.123:0/3112010863 shutdown_connections 2024-09-15T23:16:32.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.731+0000 7fe5b3265640 1 -- 172.21.15.123:0/3112010863 wait complete. 2024-09-15T23:16:32.746 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T23:16:32.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.849+0000 7f734b178640 1 Processor -- start 2024-09-15T23:16:32.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.849+0000 7f734b178640 1 -- start start 2024-09-15T23:16:32.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.850+0000 7f734b178640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f73440b2d40 0x7f734406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:32.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.850+0000 7f734b178640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f734406c150 0x7f734415c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:32.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.850+0000 7f734b178640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7344071180 con 0x7f734413eb20 2024-09-15T23:16:32.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.850+0000 7f734b178640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f7344071ab0 con 0x7f734406c150 2024-09-15T23:16:32.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.850+0000 7f734b178640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f7344071460 con 0x7f73440b2d40 2024-09-15T23:16:32.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.850+0000 7f7349715640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f734406c150 0x7f734415c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:32.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.850+0000 7f7349715640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f734406c150 0x7f734415c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41896/0 (socket says 172.21.15.123:41896) 2024-09-15T23:16:32.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.850+0000 7f733bfff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f734413eb20 0x7f734415bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38460/0 (socket says 172.21.15.123:38460) 2024-09-15T23:16:32.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.850+0000 7f7349715640 1 -- 172.21.15.123:0/656195715 learned_addr learned my addr 172.21.15.123:0/656195715 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:32.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.850+0000 7f7348f14640 1 --2- 172.21.15.123:0/656195715 >> v2:172.21.15.188:3300/0 conn(0x7f73440b2d40 0x7f734406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:32.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.850+0000 7f7349715640 1 -- 172.21.15.123:0/656195715 >> v2:172.21.15.188:3300/0 conn(0x7f73440b2d40 msgr2=0x7f734406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:32.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.850+0000 7f7349715640 1 --2- 172.21.15.123:0/656195715 >> v2:172.21.15.188:3300/0 conn(0x7f73440b2d40 0x7f734406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:32.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.850+0000 7f7349715640 1 -- 172.21.15.123:0/656195715 >> v1:172.21.15.123:6789/0 conn(0x7f734413eb20 legacy=0x7f734415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:32.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.850+0000 7f7349715640 1 -- 172.21.15.123:0/656195715 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7344071740 con 0x7f734406c150 2024-09-15T23:16:32.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.850+0000 7f733b7fe640 1 -- 172.21.15.123:0/656195715 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4070117176 0 0) 0x7f7344071180 con 0x7f734413eb20 2024-09-15T23:16:32.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.850+0000 7f7348f14640 1 --2- 172.21.15.123:0/656195715 >> v2:172.21.15.188:3300/0 conn(0x7f73440b2d40 0x7f734406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:16:32.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.851+0000 7f7349715640 1 --2- 172.21.15.123:0/656195715 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f734406c150 0x7f734415c400 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f7344069be0 tx=0x7f733c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=627e19967f8d1647 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:32.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.851+0000 7f733b7fe640 1 -- 172.21.15.123:0/656195715 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733c036070 con 0x7f734406c150 2024-09-15T23:16:32.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.851+0000 7f733b7fe640 1 -- 172.21.15.123:0/656195715 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f733c031600 con 0x7f734406c150 2024-09-15T23:16:32.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.851+0000 7f733b7fe640 1 -- 172.21.15.123:0/656195715 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733c0319d0 con 0x7f734406c150 2024-09-15T23:16:32.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.851+0000 7f734b178640 1 -- 172.21.15.123:0/656195715 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f734406c150 msgr2=0x7f734415c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:32.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.851+0000 7f734b178640 1 --2- 172.21.15.123:0/656195715 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f734406c150 0x7f734415c400 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f7344069be0 tx=0x7f733c02a730 comp rx=0 tx=0).stop 2024-09-15T23:16:32.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.852+0000 7f734b178640 1 -- 172.21.15.123:0/656195715 shutdown_connections 2024-09-15T23:16:32.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.852+0000 7f734b178640 1 --2- 172.21.15.123:0/656195715 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f734406c150 0x7f734415c400 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:32.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.852+0000 7f734b178640 1 --2- 172.21.15.123:0/656195715 >> v2:172.21.15.188:3300/0 conn(0x7f73440b2d40 0x7f734406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:32.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.852+0000 7f734b178640 1 -- 172.21.15.123:0/656195715 >> 172.21.15.123:0/656195715 conn(0x7f73440ccec0 msgr2=0x7f73440cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:32.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.852+0000 7f734b178640 1 -- 172.21.15.123:0/656195715 shutdown_connections 2024-09-15T23:16:32.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.852+0000 7f734b178640 1 -- 172.21.15.123:0/656195715 wait complete. 2024-09-15T23:16:32.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.853+0000 7f734b178640 1 Processor -- start 2024-09-15T23:16:32.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.853+0000 7f734b178640 1 -- start start 2024-09-15T23:16:32.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.854+0000 7f734b178640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f734406c150 0x7f734415bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:32.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.854+0000 7f734b178640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73440b2d40 0x7f734415f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:32.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.854+0000 7f734b178640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f734413eb20 0x7f734415ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:32.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.854+0000 7f734b178640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f73440722b0 con 0x7f73440b2d40 2024-09-15T23:16:32.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.854+0000 7f734b178640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7344072130 con 0x7f734406c150 2024-09-15T23:16:32.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.854+0000 7f734b178640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7344072430 con 0x7f734413eb20 2024-09-15T23:16:32.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.854+0000 7f733bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73440b2d40 0x7f734415f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:32.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.854+0000 7f733bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73440b2d40 0x7f734415f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41908/0 (socket says 172.21.15.123:41908) 2024-09-15T23:16:32.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.854+0000 7f733bfff640 1 -- 172.21.15.123:0/690406053 learned_addr learned my addr 172.21.15.123:0/690406053 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:32.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.854+0000 7f7348f14640 1 --2- 172.21.15.123:0/690406053 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f734406c150 0x7f734415bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:32.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.854+0000 7f7349715640 1 --2- 172.21.15.123:0/690406053 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f734413eb20 0x7f734415ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:32.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.854+0000 7f733bfff640 1 -- 172.21.15.123:0/690406053 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f734413eb20 msgr2=0x7f734415ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:32.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.854+0000 7f733bfff640 1 --2- 172.21.15.123:0/690406053 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f734413eb20 0x7f734415ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:32.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.854+0000 7f733bfff640 1 -- 172.21.15.123:0/690406053 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f734406c150 msgr2=0x7f734415bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:32.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.854+0000 7f733bfff640 1 --2- 172.21.15.123:0/690406053 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f734406c150 0x7f734415bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:32.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.854+0000 7f733bfff640 1 -- 172.21.15.123:0/690406053 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f734415a0a0 con 0x7f73440b2d40 2024-09-15T23:16:32.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.854+0000 7f733bfff640 1 --2- 172.21.15.123:0/690406053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73440b2d40 0x7f734415f0c0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f733400c410 tx=0x7f733400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:32.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.854+0000 7f73397fa640 1 -- 172.21.15.123:0/690406053 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73340074e0 con 0x7f73440b2d40 2024-09-15T23:16:32.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.854+0000 7f73397fa640 1 -- 172.21.15.123:0/690406053 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73340047e0 con 0x7f73440b2d40 2024-09-15T23:16:32.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.854+0000 7f734b178640 1 -- 172.21.15.123:0/690406053 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f734415a380 con 0x7f73440b2d40 2024-09-15T23:16:32.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.854+0000 7f73397fa640 1 -- 172.21.15.123:0/690406053 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7334004bd0 con 0x7f73440b2d40 2024-09-15T23:16:32.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.854+0000 7f734b178640 1 -- 172.21.15.123:0/690406053 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f734415a940 con 0x7f73440b2d40 2024-09-15T23:16:32.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.855+0000 7f734b178640 1 -- 172.21.15.123:0/690406053 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f734406bc10 con 0x7f73440b2d40 2024-09-15T23:16:32.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.856+0000 7f73397fa640 1 -- 172.21.15.123:0/690406053 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7334011070 con 0x7f73440b2d40 2024-09-15T23:16:32.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.856+0000 7f73397fa640 1 --2- 172.21.15.123:0/690406053 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f733006c2b0 0x7f733006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:32.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.857+0000 7f73397fa640 1 -- 172.21.15.123:0/690406053 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 4857+0+0 (secure 0 0 0) 0x7f733408abc0 con 0x7f73440b2d40 2024-09-15T23:16:32.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.857+0000 7f7348f14640 1 --2- 172.21.15.123:0/690406053 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f733006c2b0 0x7f733006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:32.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.857+0000 7f7348f14640 1 --2- 172.21.15.123:0/690406053 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f733006c2b0 0x7f733006e770 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f734000ab60 tx=0x7f7340008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:32.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:32.861+0000 7f73397fa640 1 -- 172.21.15.123:0/690406053 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7334059030 con 0x7f73440b2d40 2024-09-15T23:16:33.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.090+0000 7f734b178640 1 -- 172.21.15.123:0/690406053 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f734415b3e0 con 0x7f73440b2d40 2024-09-15T23:16:33.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.090+0000 7f73397fa640 1 -- 172.21.15.123:0/690406053 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) ==== 80+0+5304 (secure 0 0 0) 0x7f733405d330 con 0x7f73440b2d40 2024-09-15T23:16:33.091 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:16:33.091 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:16:33.092 INFO:teuthology.orchestra.run.smithi123.stdout: "auth_dump": [ 2024-09-15T23:16:33.092 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:16:33.092 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.a", 2024-09-15T23:16:33.092 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm9ATVDhAAnukyZogTuG4YCbzRXSCkiQ==", 2024-09-15T23:16:33.092 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:16:33.092 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:16:33.092 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:16:33.092 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:16:33.092 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:16:33.092 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:16:33.092 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:16:33.092 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:16:33.092 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.b", 2024-09-15T23:16:33.093 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm4KmaGhAAbf6vcffqiJTOYXK5DCXcZA==", 2024-09-15T23:16:33.093 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:16:33.093 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:16:33.093 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:16:33.093 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:16:33.093 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:16:33.093 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:16:33.093 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:16:33.093 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:16:33.093 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.c", 2024-09-15T23:16:33.093 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmua/VFRAAwbPm2TslrfQkrvHiO8oeLg==", 2024-09-15T23:16:33.093 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:16:33.093 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:16:33.094 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:16:33.094 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:16:33.094 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:16:33.094 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:16:33.094 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:16:33.094 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:16:33.094 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.d", 2024-09-15T23:16:33.094 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmzw3eIRAAaE+5y9USwp+xM3MTAndn7Q==", 2024-09-15T23:16:33.094 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:16:33.094 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:16:33.094 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:16:33.094 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:16:33.094 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:16:33.094 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:16:33.095 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:16:33.095 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:16:33.095 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.0", 2024-09-15T23:16:33.095 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCRaedmFrHGAxAAy/jTkothESNn2DC9xcHDAQ==", 2024-09-15T23:16:33.095 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:16:33.095 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:16:33.095 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:16:33.095 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:16:33.095 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:16:33.095 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:16:33.095 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:16:33.095 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.1", 2024-09-15T23:16:33.096 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCUaedm6vZlIxAAdsnLqFSng6SRpCT6UZKGsw==", 2024-09-15T23:16:33.096 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:16:33.096 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:16:33.096 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:16:33.096 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:16:33.096 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:16:33.096 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:16:33.096 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:16:33.096 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.2", 2024-09-15T23:16:33.096 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCYaedmXgVwFRAA1mOzzRafhKMsU7kTAT6TqA==", 2024-09-15T23:16:33.096 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:16:33.096 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:16:33.097 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:16:33.097 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:16:33.097 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:16:33.097 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:16:33.097 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:16:33.097 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.3", 2024-09-15T23:16:33.097 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCcaedm+APAFhAAb8blNFzswwHriSmCrMuA0A==", 2024-09-15T23:16:33.097 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:16:33.097 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:16:33.097 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:16:33.097 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:16:33.097 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:16:33.098 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:16:33.098 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:16:33.098 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.4", 2024-09-15T23:16:33.098 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCjaedmReUmABAAXpxsK7osxn/ZelVXKiCLOw==", 2024-09-15T23:16:33.098 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:16:33.098 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:16:33.098 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:16:33.098 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:16:33.098 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:16:33.098 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:16:33.098 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:16:33.098 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.5", 2024-09-15T23:16:33.098 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCnaedmtbdmARAAdxguBdtwBmtiaIx/y992GA==", 2024-09-15T23:16:33.098 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:16:33.099 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:16:33.099 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:16:33.099 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:16:33.099 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:16:33.099 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:16:33.099 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:16:33.099 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.6", 2024-09-15T23:16:33.099 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCraedmkR+NAxAAd2GAAH0BgOMonU8iTSn+Fw==", 2024-09-15T23:16:33.099 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:16:33.099 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:16:33.099 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:16:33.099 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:16:33.099 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:16:33.099 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:16:33.100 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:16:33.100 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.7", 2024-09-15T23:16:33.100 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCvaedmAaCwBBAAdpDtCbXchArmy019wiOdSQ==", 2024-09-15T23:16:33.100 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:16:33.100 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:16:33.100 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:16:33.100 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:16:33.100 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:16:33.100 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:16:33.100 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:16:33.100 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.0", 2024-09-15T23:16:33.100 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmzQPqJRAAhUf1dnVYohN4obCfeu8+7g==", 2024-09-15T23:16:33.100 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:16:33.100 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:16:33.100 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow r", 2024-09-15T23:16:33.101 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-15T23:16:33.101 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:16:33.101 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:16:33.101 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:16:33.101 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.1", 2024-09-15T23:16:33.101 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmdKK0LhAAXXmUkxVwMEjRTRXUh9CL/g==", 2024-09-15T23:16:33.101 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:16:33.101 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:16:33.101 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:16:33.101 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:16:33.101 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:16:33.101 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:16:33.101 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:16:33.102 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:16:33.102 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.2", 2024-09-15T23:16:33.102 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmRz55KxAARi7B4WYOY1QqH1CK81z9pA==", 2024-09-15T23:16:33.102 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:16:33.102 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:16:33.102 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:16:33.102 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:16:33.102 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:16:33.102 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:16:33.102 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:16:33.102 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:16:33.102 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.3", 2024-09-15T23:16:33.102 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmbWo8NBAAR1qGX1bs35ojx6lMxftcfg==", 2024-09-15T23:16:33.102 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:16:33.103 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:16:33.103 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:16:33.103 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:16:33.103 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:16:33.103 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:16:33.103 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:16:33.103 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:16:33.103 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.admin", 2024-09-15T23:16:33.103 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCMaedmVUW0LhAAqgPFk1HtxsZXcIStNN43pA==", 2024-09-15T23:16:33.103 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:16:33.103 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:16:33.103 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:16:33.103 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:16:33.103 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:16:33.104 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:16:33.104 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:16:33.104 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:16:33.104 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.x", 2024-09-15T23:16:33.104 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmGPSBCxAAHAhXQERogdAOm0ZPNtlxpw==", 2024-09-15T23:16:33.104 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:16:33.104 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:16:33.104 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-15T23:16:33.104 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:16:33.104 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:16:33.104 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:16:33.104 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:16:33.104 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.y", 2024-09-15T23:16:33.105 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm5Om4BxAA/7ZtMMlbUA3bvMCfaNMQyg==", 2024-09-15T23:16:33.105 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:16:33.105 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:16:33.105 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-15T23:16:33.105 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:16:33.105 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:16:33.105 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:16:33.105 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-15T23:16:33.105 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:16:33.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.092+0000 7f734b178640 1 -- 172.21.15.123:0/690406053 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f733006c2b0 msgr2=0x7f733006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:33.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.092+0000 7f734b178640 1 --2- 172.21.15.123:0/690406053 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f733006c2b0 0x7f733006e770 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f734000ab60 tx=0x7f7340008040 comp rx=0 tx=0).stop 2024-09-15T23:16:33.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.092+0000 7f734b178640 1 -- 172.21.15.123:0/690406053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73440b2d40 msgr2=0x7f734415f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:33.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.092+0000 7f734b178640 1 --2- 172.21.15.123:0/690406053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73440b2d40 0x7f734415f0c0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f733400c410 tx=0x7f733400c8d0 comp rx=0 tx=0).stop 2024-09-15T23:16:33.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.092+0000 7f734b178640 1 -- 172.21.15.123:0/690406053 shutdown_connections 2024-09-15T23:16:33.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.092+0000 7f734b178640 1 --2- 172.21.15.123:0/690406053 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f734413eb20 0x7f734415ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:33.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.092+0000 7f734b178640 1 --2- 172.21.15.123:0/690406053 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f733006c2b0 0x7f733006e770 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:33.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.092+0000 7f734b178640 1 --2- 172.21.15.123:0/690406053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73440b2d40 0x7f734415f0c0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:33.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.092+0000 7f734b178640 1 --2- 172.21.15.123:0/690406053 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f734406c150 0x7f734415bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:33.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.092+0000 7f734b178640 1 -- 172.21.15.123:0/690406053 >> 172.21.15.123:0/690406053 conn(0x7f73440ccec0 msgr2=0x7f7344156190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:33.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.092+0000 7f734b178640 1 -- 172.21.15.123:0/690406053 shutdown_connections 2024-09-15T23:16:33.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.092+0000 7f734b178640 1 -- 172.21.15.123:0/690406053 wait complete. 2024-09-15T23:16:33.108 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T23:16:33.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.205+0000 7f26ca64c640 1 Processor -- start 2024-09-15T23:16:33.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.205+0000 7f26ca64c640 1 -- start start 2024-09-15T23:16:33.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.205+0000 7f26ca64c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26c40b2d40 0x7f26c406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:33.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.205+0000 7f26ca64c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f26c413eb20 0x7f26c406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:33.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.205+0000 7f26ca64c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f26c415bcf0 0x7f26c415c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:33.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.205+0000 7f26ca64c640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f26c4071ab0 con 0x7f26c413eb20 2024-09-15T23:16:33.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.205+0000 7f26ca64c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f26c4071180 con 0x7f26c415bcf0 2024-09-15T23:16:33.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.205+0000 7f26ca64c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f26c4071460 con 0x7f26c40b2d40 2024-09-15T23:16:33.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.206+0000 7f26c37fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f26c413eb20 0x7f26c406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:33.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.206+0000 7f26c37fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f26c413eb20 0x7f26c406c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41912/0 (socket says 172.21.15.123:41912) 2024-09-15T23:16:33.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.206+0000 7f26c37fe640 1 -- 172.21.15.123:0/2678091441 learned_addr learned my addr 172.21.15.123:0/2678091441 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:33.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.206+0000 7f26c37fe640 1 -- 172.21.15.123:0/2678091441 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26c40b2d40 msgr2=0x7f26c406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:33.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.206+0000 7f26c37fe640 1 --2- 172.21.15.123:0/2678091441 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26c40b2d40 0x7f26c406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:33.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.206+0000 7f26c37fe640 1 -- 172.21.15.123:0/2678091441 >> v2:172.21.15.188:3300/0 conn(0x7f26c415bcf0 msgr2=0x7f26c415c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:33.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.206+0000 7f26c37fe640 1 --2- 172.21.15.123:0/2678091441 >> v2:172.21.15.188:3300/0 conn(0x7f26c415bcf0 0x7f26c415c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:33.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.206+0000 7f26c37fe640 1 -- 172.21.15.123:0/2678091441 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26c4071740 con 0x7f26c413eb20 2024-09-15T23:16:33.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.207+0000 7f26c37fe640 1 --2- 172.21.15.123:0/2678091441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26c413eb20 0x7f26c406c150 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f26c41595c0 tx=0x7f26ac02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7412f77cc2224071 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:33.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.207+0000 7f26c2ffd640 1 -- 172.21.15.123:0/2678091441 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ac037070 con 0x7f26c413eb20 2024-09-15T23:16:33.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.207+0000 7f26c2ffd640 1 -- 172.21.15.123:0/2678091441 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26ac032440 con 0x7f26c413eb20 2024-09-15T23:16:33.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.207+0000 7f26c2ffd640 1 -- 172.21.15.123:0/2678091441 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ac032810 con 0x7f26c413eb20 2024-09-15T23:16:33.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.207+0000 7f26ca64c640 1 -- 172.21.15.123:0/2678091441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26c413eb20 msgr2=0x7f26c406c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:33.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.207+0000 7f26ca64c640 1 --2- 172.21.15.123:0/2678091441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26c413eb20 0x7f26c406c150 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f26c41595c0 tx=0x7f26ac02a1e0 comp rx=0 tx=0).stop 2024-09-15T23:16:33.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.207+0000 7f26ca64c640 1 -- 172.21.15.123:0/2678091441 shutdown_connections 2024-09-15T23:16:33.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.207+0000 7f26ca64c640 1 --2- 172.21.15.123:0/2678091441 >> v2:172.21.15.188:3300/0 conn(0x7f26c415bcf0 0x7f26c415c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:33.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.207+0000 7f26ca64c640 1 --2- 172.21.15.123:0/2678091441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26c413eb20 0x7f26c406c150 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:33.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.207+0000 7f26ca64c640 1 --2- 172.21.15.123:0/2678091441 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26c40b2d40 0x7f26c406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:33.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.207+0000 7f26ca64c640 1 -- 172.21.15.123:0/2678091441 >> 172.21.15.123:0/2678091441 conn(0x7f26c40ccec0 msgr2=0x7f26c40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:33.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.207+0000 7f26ca64c640 1 -- 172.21.15.123:0/2678091441 shutdown_connections 2024-09-15T23:16:33.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.207+0000 7f26ca64c640 1 -- 172.21.15.123:0/2678091441 wait complete. 2024-09-15T23:16:33.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.208+0000 7f26ca64c640 1 Processor -- start 2024-09-15T23:16:33.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.209+0000 7f26ca64c640 1 -- start start 2024-09-15T23:16:33.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.209+0000 7f26ca64c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26c40b2d40 0x7f26c4142540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:33.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.209+0000 7f26ca64c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26c413eb20 0x7f26c4158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:33.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.209+0000 7f26ca64c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26c415bcf0 0x7f26c413e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:33.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.209+0000 7f26ca64c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f26c415f140 con 0x7f26c415bcf0 2024-09-15T23:16:33.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.209+0000 7f26ca64c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f26c415efc0 con 0x7f26c40b2d40 2024-09-15T23:16:33.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.209+0000 7f26ca64c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f26c415f2c0 con 0x7f26c413eb20 2024-09-15T23:16:33.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.209+0000 7f26c8be9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26c415bcf0 0x7f26c413e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:33.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.210+0000 7f26c8be9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26c415bcf0 0x7f26c413e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41914/0 (socket says 172.21.15.123:41914) 2024-09-15T23:16:33.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.210+0000 7f26c8be9640 1 -- 172.21.15.123:0/3363155485 learned_addr learned my addr 172.21.15.123:0/3363155485 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:33.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.210+0000 7f26c3fff640 1 --2- 172.21.15.123:0/3363155485 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26c40b2d40 0x7f26c4142540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:33.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.210+0000 7f26c37fe640 1 --2- 172.21.15.123:0/3363155485 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26c413eb20 0x7f26c4158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:33.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.210+0000 7f26c8be9640 1 -- 172.21.15.123:0/3363155485 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26c413eb20 msgr2=0x7f26c4158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:33.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.210+0000 7f26c8be9640 1 --2- 172.21.15.123:0/3363155485 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26c413eb20 0x7f26c4158080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:33.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.210+0000 7f26c8be9640 1 -- 172.21.15.123:0/3363155485 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26c40b2d40 msgr2=0x7f26c4142540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:33.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.210+0000 7f26c8be9640 1 --2- 172.21.15.123:0/3363155485 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26c40b2d40 0x7f26c4142540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:33.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.210+0000 7f26c8be9640 1 -- 172.21.15.123:0/3363155485 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26c4142bb0 con 0x7f26c415bcf0 2024-09-15T23:16:33.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.210+0000 7f26c3fff640 1 --2- 172.21.15.123:0/3363155485 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26c40b2d40 0x7f26c4142540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:16:33.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.210+0000 7f26c37fe640 1 --2- 172.21.15.123:0/3363155485 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26c413eb20 0x7f26c4158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:16:33.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.210+0000 7f26c8be9640 1 --2- 172.21.15.123:0/3363155485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26c415bcf0 0x7f26c413e000 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f26bc00b970 tx=0x7f26bc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:33.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.210+0000 7f26c0ff9640 1 -- 172.21.15.123:0/3363155485 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26bc019070 con 0x7f26c415bcf0 2024-09-15T23:16:33.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.210+0000 7f26c0ff9640 1 -- 172.21.15.123:0/3363155485 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26bc00cb60 con 0x7f26c415bcf0 2024-09-15T23:16:33.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.210+0000 7f26ca64c640 1 -- 172.21.15.123:0/3363155485 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26c4142e90 con 0x7f26c415bcf0 2024-09-15T23:16:33.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.210+0000 7f26c0ff9640 1 -- 172.21.15.123:0/3363155485 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26bc014440 con 0x7f26c415bcf0 2024-09-15T23:16:33.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.210+0000 7f26ca64c640 1 -- 172.21.15.123:0/3363155485 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26c4143450 con 0x7f26c415bcf0 2024-09-15T23:16:33.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.211+0000 7f26ca64c640 1 -- 172.21.15.123:0/3363155485 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26c415c1a0 con 0x7f26c415bcf0 2024-09-15T23:16:33.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.212+0000 7f26c0ff9640 1 -- 172.21.15.123:0/3363155485 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f26bc01c070 con 0x7f26c415bcf0 2024-09-15T23:16:33.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.212+0000 7f26c0ff9640 1 --2- 172.21.15.123:0/3363155485 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f26a406c2b0 0x7f26a406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:33.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.212+0000 7f26c0ff9640 1 -- 172.21.15.123:0/3363155485 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 4857+0+0 (secure 0 0 0) 0x7f26bc08ada0 con 0x7f26c415bcf0 2024-09-15T23:16:33.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.212+0000 7f26c3fff640 1 --2- 172.21.15.123:0/3363155485 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f26a406c2b0 0x7f26a406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:33.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.213+0000 7f26c3fff640 1 --2- 172.21.15.123:0/3363155485 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f26a406c2b0 0x7f26a406e770 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f26b4009930 tx=0x7f26b4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:33.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.216+0000 7f26c0ff9640 1 -- 172.21.15.123:0/3363155485 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f26bc0598f0 con 0x7f26c415bcf0 2024-09-15T23:16:33.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.383+0000 7f26ca64c640 1 -- 172.21.15.123:0/3363155485 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f26c406c9c0 con 0x7f26c415bcf0 2024-09-15T23:16:33.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.383+0000 7f26c0ff9640 1 -- 172.21.15.123:0/3363155485 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v94) ==== 84+0+65 (secure 0 0 0) 0x7f26bc0591f0 con 0x7f26c415bcf0 2024-09-15T23:16:33.385 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:16:33.385 INFO:teuthology.orchestra.run.smithi123.stdout:[ 2024-09-15T23:16:33.385 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:16:33.385 INFO:teuthology.orchestra.run.smithi123.stdout: "poolnum": 1, 2024-09-15T23:16:33.385 INFO:teuthology.orchestra.run.smithi123.stdout: "poolname": ".mgr" 2024-09-15T23:16:33.385 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:16:33.385 INFO:teuthology.orchestra.run.smithi123.stdout:] 2024-09-15T23:16:33.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.386+0000 7f26ca64c640 1 -- 172.21.15.123:0/3363155485 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f26a406c2b0 msgr2=0x7f26a406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:33.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.386+0000 7f26ca64c640 1 --2- 172.21.15.123:0/3363155485 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f26a406c2b0 0x7f26a406e770 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f26b4009930 tx=0x7f26b4008040 comp rx=0 tx=0).stop 2024-09-15T23:16:33.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.386+0000 7f26ca64c640 1 -- 172.21.15.123:0/3363155485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26c415bcf0 msgr2=0x7f26c413e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:33.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.386+0000 7f26ca64c640 1 --2- 172.21.15.123:0/3363155485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26c415bcf0 0x7f26c413e000 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f26bc00b970 tx=0x7f26bc00be30 comp rx=0 tx=0).stop 2024-09-15T23:16:33.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.386+0000 7f26ca64c640 1 -- 172.21.15.123:0/3363155485 shutdown_connections 2024-09-15T23:16:33.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.386+0000 7f26ca64c640 1 --2- 172.21.15.123:0/3363155485 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f26a406c2b0 0x7f26a406e770 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:33.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.386+0000 7f26ca64c640 1 --2- 172.21.15.123:0/3363155485 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26c415bcf0 0x7f26c413e000 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:33.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.386+0000 7f26ca64c640 1 --2- 172.21.15.123:0/3363155485 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26c413eb20 0x7f26c4158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:33.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.386+0000 7f26ca64c640 1 --2- 172.21.15.123:0/3363155485 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26c40b2d40 0x7f26c4142540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:33.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.386+0000 7f26ca64c640 1 -- 172.21.15.123:0/3363155485 >> 172.21.15.123:0/3363155485 conn(0x7f26c40ccec0 msgr2=0x7f26c415d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:33.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.386+0000 7f26ca64c640 1 -- 172.21.15.123:0/3363155485 shutdown_connections 2024-09-15T23:16:33.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.386+0000 7f26ca64c640 1 -- 172.21.15.123:0/3363155485 wait complete. 2024-09-15T23:16:33.397 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T23:16:33.398 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T23:16:33.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.498+0000 7f1d17b23640 1 Processor -- start 2024-09-15T23:16:33.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.498+0000 7f1d17b23640 1 -- start start 2024-09-15T23:16:33.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.499+0000 7f1d17b23640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1d10073500 0x7f1d1006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:33.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.499+0000 7f1d17b23640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d1015ee80 con 0x7f1d100b4a80 2024-09-15T23:16:33.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.499+0000 7f1d17b23640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d1015f160 con 0x7f1d100738e0 2024-09-15T23:16:33.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.499+0000 7f1d17b23640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f1d1015fa90 con 0x7f1d10073500 2024-09-15T23:16:33.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.499+0000 7f1d160c0640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1d100b4a80 0x7f1d10162410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38470/0 (socket says 172.21.15.123:38470) 2024-09-15T23:16:33.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.499+0000 7f1d160c0640 1 -- 172.21.15.123:0/3582629376 learned_addr learned my addr 172.21.15.123:0/3582629376 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:33.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.500+0000 7f1d158bf640 1 --2- 172.21.15.123:0/3582629376 >> v2:172.21.15.188:3300/0 conn(0x7f1d10073500 0x7f1d1006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:33.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.500+0000 7f1d148bd640 1 -- 172.21.15.123:0/3582629376 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 493475281 0 0) 0x7f1d1015ee80 con 0x7f1d100b4a80 2024-09-15T23:16:33.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.500+0000 7f1d148bd640 1 -- 172.21.15.123:0/3582629376 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1cf8003520 con 0x7f1d100b4a80 2024-09-15T23:16:33.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.500+0000 7f1d158bf640 1 -- 172.21.15.123:0/3582629376 >> v1:172.21.15.188:6789/0 conn(0x7f1d100738e0 legacy=0x7f1d100b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:33.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.500+0000 7f1d158bf640 1 -- 172.21.15.123:0/3582629376 >> v1:172.21.15.123:6789/0 conn(0x7f1d100b4a80 legacy=0x7f1d10162410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:33.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.500+0000 7f1d158bf640 1 -- 172.21.15.123:0/3582629376 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d1015f440 con 0x7f1d10073500 2024-09-15T23:16:33.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.501+0000 7f1d158bf640 1 --2- 172.21.15.123:0/3582629376 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1d10073500 0x7f1d1006cd20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1d00009d90 tx=0x7f1d0002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0f14d78206895f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:33.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.501+0000 7f1d148bd640 1 -- 172.21.15.123:0/3582629376 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d00007740 con 0x7f1d10073500 2024-09-15T23:16:33.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.501+0000 7f1d148bd640 1 -- 172.21.15.123:0/3582629376 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d000078e0 con 0x7f1d10073500 2024-09-15T23:16:33.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.501+0000 7f1d148bd640 1 -- 172.21.15.123:0/3582629376 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d00007cb0 con 0x7f1d10073500 2024-09-15T23:16:33.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.501+0000 7f1d17b23640 1 -- 172.21.15.123:0/3582629376 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1d10073500 msgr2=0x7f1d1006cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:33.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.501+0000 7f1d17b23640 1 --2- 172.21.15.123:0/3582629376 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1d10073500 0x7f1d1006cd20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1d00009d90 tx=0x7f1d0002a6f0 comp rx=0 tx=0).stop 2024-09-15T23:16:33.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.501+0000 7f1d17b23640 1 -- 172.21.15.123:0/3582629376 shutdown_connections 2024-09-15T23:16:33.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.501+0000 7f1d17b23640 1 --2- 172.21.15.123:0/3582629376 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1d10073500 0x7f1d1006cd20 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:33.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.501+0000 7f1d17b23640 1 -- 172.21.15.123:0/3582629376 >> 172.21.15.123:0/3582629376 conn(0x7f1d10067950 msgr2=0x7f1d10067d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:33.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.501+0000 7f1d17b23640 1 -- 172.21.15.123:0/3582629376 shutdown_connections 2024-09-15T23:16:33.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.501+0000 7f1d17b23640 1 -- 172.21.15.123:0/3582629376 wait complete. 2024-09-15T23:16:33.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.502+0000 7f1d17b23640 1 Processor -- start 2024-09-15T23:16:33.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.503+0000 7f1d17b23640 1 -- start start 2024-09-15T23:16:33.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.503+0000 7f1d17b23640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d10073500 0x7f1d100ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:33.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.503+0000 7f1d17b23640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1d100738e0 0x7f1d101f8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:33.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.503+0000 7f1d17b23640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1d100b4a80 0x7f1d1015deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:33.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.503+0000 7f1d17b23640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1d10159120 con 0x7f1d10073500 2024-09-15T23:16:33.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.503+0000 7f1d17b23640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1d10158fa0 con 0x7f1d100b4a80 2024-09-15T23:16:33.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.503+0000 7f1d17b23640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1d10073d00 con 0x7f1d100738e0 2024-09-15T23:16:33.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.503+0000 7f1d158bf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d10073500 0x7f1d100ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:33.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.503+0000 7f1d158bf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d10073500 0x7f1d100ccd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41918/0 (socket says 172.21.15.123:41918) 2024-09-15T23:16:33.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.503+0000 7f1d158bf640 1 -- 172.21.15.123:0/2008862626 learned_addr learned my addr 172.21.15.123:0/2008862626 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:33.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.504+0000 7f1d160c0640 1 --2- 172.21.15.123:0/2008862626 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1d100b4a80 0x7f1d1015deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:33.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.504+0000 7f1d150be640 1 --2- 172.21.15.123:0/2008862626 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1d100738e0 0x7f1d101f8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:33.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.504+0000 7f1d158bf640 1 -- 172.21.15.123:0/2008862626 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1d100738e0 msgr2=0x7f1d101f8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:33.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.504+0000 7f1d158bf640 1 --2- 172.21.15.123:0/2008862626 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1d100738e0 0x7f1d101f8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:33.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.504+0000 7f1d158bf640 1 -- 172.21.15.123:0/2008862626 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1d100b4a80 msgr2=0x7f1d1015deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:33.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.504+0000 7f1d158bf640 1 --2- 172.21.15.123:0/2008862626 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1d100b4a80 0x7f1d1015deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:33.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.504+0000 7f1d158bf640 1 -- 172.21.15.123:0/2008862626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d101f8750 con 0x7f1d10073500 2024-09-15T23:16:33.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.504+0000 7f1d160c0640 1 --2- 172.21.15.123:0/2008862626 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1d100b4a80 0x7f1d1015deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:16:33.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.504+0000 7f1d150be640 1 --2- 172.21.15.123:0/2008862626 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1d100738e0 0x7f1d101f8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:16:33.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.504+0000 7f1d158bf640 1 --2- 172.21.15.123:0/2008862626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d10073500 0x7f1d100ccd50 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f1d00009d90 tx=0x7f1d00004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:33.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.504+0000 7f1d0e7fc640 1 -- 172.21.15.123:0/2008862626 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d00040070 con 0x7f1d10073500 2024-09-15T23:16:33.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.504+0000 7f1d0e7fc640 1 -- 172.21.15.123:0/2008862626 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d00031c40 con 0x7f1d10073500 2024-09-15T23:16:33.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.504+0000 7f1d0e7fc640 1 -- 172.21.15.123:0/2008862626 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d00009450 con 0x7f1d10073500 2024-09-15T23:16:33.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.504+0000 7f1d17b23640 1 -- 172.21.15.123:0/2008862626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d100cbcb0 con 0x7f1d10073500 2024-09-15T23:16:33.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.504+0000 7f1d17b23640 1 -- 172.21.15.123:0/2008862626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d100cc270 con 0x7f1d10073500 2024-09-15T23:16:33.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.505+0000 7f1d17b23640 1 -- 172.21.15.123:0/2008862626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d1006cd20 con 0x7f1d10073500 2024-09-15T23:16:33.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.505+0000 7f1d0e7fc640 1 -- 172.21.15.123:0/2008862626 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1d00039040 con 0x7f1d10073500 2024-09-15T23:16:33.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.506+0000 7f1d0e7fc640 1 --2- 172.21.15.123:0/2008862626 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1cfc06c2b0 0x7f1cfc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:33.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.506+0000 7f1d0e7fc640 1 -- 172.21.15.123:0/2008862626 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 4857+0+0 (secure 0 0 0) 0x7f1d000ac560 con 0x7f1d10073500 2024-09-15T23:16:33.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.506+0000 7f1d150be640 1 --2- 172.21.15.123:0/2008862626 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1cfc06c2b0 0x7f1cfc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:33.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.506+0000 7f1d150be640 1 --2- 172.21.15.123:0/2008862626 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1cfc06c2b0 0x7f1cfc06e770 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1d100cd470 tx=0x7f1d04009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:33.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.510+0000 7f1d0e7fc640 1 -- 172.21.15.123:0/2008862626 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1d101f8750 con 0x7f1d10073500 2024-09-15T23:16:33.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.677+0000 7f1d17b23640 1 -- 172.21.15.123:0/2008862626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f1d10068140 con 0x7f1d10073500 2024-09-15T23:16:33.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.732+0000 7f1d0e7fc640 1 -- 172.21.15.123:0/2008862626 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v95) ==== 138+0+0 (secure 0 0 0) 0x7f1d0007b0b0 con 0x7f1d10073500 2024-09-15T23:16:33.733 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' created 2024-09-15T23:16:33.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.734+0000 7f1d17b23640 1 -- 172.21.15.123:0/2008862626 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1cfc06c2b0 msgr2=0x7f1cfc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:33.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.734+0000 7f1d17b23640 1 --2- 172.21.15.123:0/2008862626 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1cfc06c2b0 0x7f1cfc06e770 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1d100cd470 tx=0x7f1d04009040 comp rx=0 tx=0).stop 2024-09-15T23:16:33.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.734+0000 7f1d17b23640 1 -- 172.21.15.123:0/2008862626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d10073500 msgr2=0x7f1d100ccd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:33.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.734+0000 7f1d17b23640 1 --2- 172.21.15.123:0/2008862626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d10073500 0x7f1d100ccd50 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f1d00009d90 tx=0x7f1d00004a40 comp rx=0 tx=0).stop 2024-09-15T23:16:33.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.734+0000 7f1d17b23640 1 -- 172.21.15.123:0/2008862626 shutdown_connections 2024-09-15T23:16:33.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.734+0000 7f1d17b23640 1 --2- 172.21.15.123:0/2008862626 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1d100b4a80 0x7f1d1015deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:33.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.734+0000 7f1d17b23640 1 --2- 172.21.15.123:0/2008862626 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1d100738e0 0x7f1d101f8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:33.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.734+0000 7f1d17b23640 1 --2- 172.21.15.123:0/2008862626 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1cfc06c2b0 0x7f1cfc06e770 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:33.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.734+0000 7f1d17b23640 1 --2- 172.21.15.123:0/2008862626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d10073500 0x7f1d100ccd50 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:33.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.734+0000 7f1d17b23640 1 -- 172.21.15.123:0/2008862626 >> 172.21.15.123:0/2008862626 conn(0x7f1d10067950 msgr2=0x7f1d100d2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:33.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.734+0000 7f1d17b23640 1 -- 172.21.15.123:0/2008862626 shutdown_connections 2024-09-15T23:16:33.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.734+0000 7f1d17b23640 1 -- 172.21.15.123:0/2008862626 wait complete. 2024-09-15T23:16:33.749 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T23:16:33.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.853+0000 7f88508a6640 1 Processor -- start 2024-09-15T23:16:33.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.853+0000 7f88508a6640 1 -- start start 2024-09-15T23:16:33.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.853+0000 7f88508a6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f884c0732e0 0x7f884c0736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:33.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.853+0000 7f88508a6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f884c0cce30 0x7f884c0cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:33.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.853+0000 7f88508a6640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f884c0714b0 con 0x7f884c071c70 2024-09-15T23:16:33.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.854+0000 7f88508a6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f884c073c00 con 0x7f884c0732e0 2024-09-15T23:16:33.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.854+0000 7f88508a6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f884c0cd880 con 0x7f884c0cce30 2024-09-15T23:16:33.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.854+0000 7f884a59c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f884c0732e0 0x7f884c0736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:33.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.854+0000 7f8841d9b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f884c0cce30 0x7f884c0cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:33.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.854+0000 7f884ad9d640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f884c071c70 0x7f884c15c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:45414/0 (socket says 172.21.15.123:45414) 2024-09-15T23:16:33.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.854+0000 7f884ad9d640 1 -- 172.21.15.123:0/3775704348 learned_addr learned my addr 172.21.15.123:0/3775704348 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:33.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.854+0000 7f8849d9b640 1 -- 172.21.15.123:0/3775704348 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1621384143 0 0) 0x7f884c0714b0 con 0x7f884c071c70 2024-09-15T23:16:33.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.854+0000 7f8849d9b640 1 -- 172.21.15.123:0/3775704348 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8838003520 con 0x7f884c071c70 2024-09-15T23:16:33.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.854+0000 7f884a59c640 1 -- 172.21.15.123:0/3775704348 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f884c0cce30 msgr2=0x7f884c0cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:33.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.854+0000 7f884a59c640 1 --2- 172.21.15.123:0/3775704348 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f884c0cce30 0x7f884c0cd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:33.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.854+0000 7f884a59c640 1 -- 172.21.15.123:0/3775704348 >> v1:172.21.15.188:6789/0 conn(0x7f884c071c70 legacy=0x7f884c15c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:33.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.854+0000 7f884a59c640 1 -- 172.21.15.123:0/3775704348 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f884c0cdb60 con 0x7f884c0732e0 2024-09-15T23:16:33.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.854+0000 7f8841d9b640 1 --2- 172.21.15.123:0/3775704348 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f884c0cce30 0x7f884c0cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:16:33.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.855+0000 7f884a59c640 1 --2- 172.21.15.123:0/3775704348 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f884c0732e0 0x7f884c0736c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f883c0097a0 tx=0x7f883c02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1126a46cbb4f601b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:33.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.855+0000 7f8849d9b640 1 -- 172.21.15.123:0/3775704348 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883c037070 con 0x7f884c0732e0 2024-09-15T23:16:33.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.855+0000 7f8849d9b640 1 -- 172.21.15.123:0/3775704348 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f883c02ae50 con 0x7f884c0732e0 2024-09-15T23:16:33.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.855+0000 7f8849d9b640 1 -- 172.21.15.123:0/3775704348 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883c032640 con 0x7f884c0732e0 2024-09-15T23:16:33.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.856+0000 7f88508a6640 1 -- 172.21.15.123:0/3775704348 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f884c0732e0 msgr2=0x7f884c0736c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:33.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.856+0000 7f88508a6640 1 --2- 172.21.15.123:0/3775704348 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f884c0732e0 0x7f884c0736c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f883c0097a0 tx=0x7f883c02a100 comp rx=0 tx=0).stop 2024-09-15T23:16:33.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.856+0000 7f88508a6640 1 -- 172.21.15.123:0/3775704348 shutdown_connections 2024-09-15T23:16:33.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.856+0000 7f88508a6640 1 --2- 172.21.15.123:0/3775704348 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f884c0cce30 0x7f884c0cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:33.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.856+0000 7f88508a6640 1 --2- 172.21.15.123:0/3775704348 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f884c0732e0 0x7f884c0736c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:33.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.856+0000 7f88508a6640 1 -- 172.21.15.123:0/3775704348 >> 172.21.15.123:0/3775704348 conn(0x7f884c06d0f0 msgr2=0x7f884c06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:33.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.856+0000 7f88508a6640 1 -- 172.21.15.123:0/3775704348 shutdown_connections 2024-09-15T23:16:33.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.856+0000 7f88508a6640 1 -- 172.21.15.123:0/3775704348 wait complete. 2024-09-15T23:16:33.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.857+0000 7f88508a6640 1 Processor -- start 2024-09-15T23:16:33.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.857+0000 7f88508a6640 1 -- start start 2024-09-15T23:16:33.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.858+0000 7f88508a6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f884c071c70 0x7f884c0c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:33.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.858+0000 7f88508a6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f884c0732e0 0x7f884c0c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:33.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.858+0000 7f88508a6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f884c0cce30 0x7f884c149fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:33.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.858+0000 7f88508a6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f884c06bf70 con 0x7f884c0cce30 2024-09-15T23:16:33.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.858+0000 7f88508a6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f884c06bdf0 con 0x7f884c0732e0 2024-09-15T23:16:33.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.858+0000 7f88508a6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f884c072120 con 0x7f884c071c70 2024-09-15T23:16:33.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.858+0000 7f884ad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f884c0cce30 0x7f884c149fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:33.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.858+0000 7f884ad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f884c0cce30 0x7f884c149fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41920/0 (socket says 172.21.15.123:41920) 2024-09-15T23:16:33.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.858+0000 7f884ad9d640 1 -- 172.21.15.123:0/2827084901 learned_addr learned my addr 172.21.15.123:0/2827084901 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:33.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.858+0000 7f884a59c640 1 --2- 172.21.15.123:0/2827084901 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f884c071c70 0x7f884c0c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:33.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.858+0000 7f8841d9b640 1 --2- 172.21.15.123:0/2827084901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f884c0732e0 0x7f884c0c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:33.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.859+0000 7f884ad9d640 1 -- 172.21.15.123:0/2827084901 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f884c071c70 msgr2=0x7f884c0c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:33.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.859+0000 7f884ad9d640 1 --2- 172.21.15.123:0/2827084901 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f884c071c70 0x7f884c0c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:33.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.859+0000 7f884ad9d640 1 -- 172.21.15.123:0/2827084901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f884c0732e0 msgr2=0x7f884c0c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:33.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.859+0000 7f884ad9d640 1 --2- 172.21.15.123:0/2827084901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f884c0732e0 0x7f884c0c6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:33.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.859+0000 7f884ad9d640 1 -- 172.21.15.123:0/2827084901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f884c0c7190 con 0x7f884c0cce30 2024-09-15T23:16:33.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.859+0000 7f884ad9d640 1 --2- 172.21.15.123:0/2827084901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f884c0cce30 0x7f884c149fe0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f884400cb40 tx=0x7f884400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:33.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.859+0000 7f88437fe640 1 -- 172.21.15.123:0/2827084901 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8844017070 con 0x7f884c0cce30 2024-09-15T23:16:33.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.859+0000 7f88437fe640 1 -- 172.21.15.123:0/2827084901 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f884400aca0 con 0x7f884c0cce30 2024-09-15T23:16:33.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.859+0000 7f88508a6640 1 -- 172.21.15.123:0/2827084901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f884c0c7460 con 0x7f884c0cce30 2024-09-15T23:16:33.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.859+0000 7f88437fe640 1 -- 172.21.15.123:0/2827084901 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8844012620 con 0x7f884c0cce30 2024-09-15T23:16:33.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.859+0000 7f88508a6640 1 -- 172.21.15.123:0/2827084901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f884c0c7a20 con 0x7f884c0cce30 2024-09-15T23:16:33.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.860+0000 7f88508a6640 1 -- 172.21.15.123:0/2827084901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f884c0724b0 con 0x7f884c0cce30 2024-09-15T23:16:33.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.861+0000 7f88437fe640 1 -- 172.21.15.123:0/2827084901 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f884401a070 con 0x7f884c0cce30 2024-09-15T23:16:33.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.861+0000 7f88437fe640 1 --2- 172.21.15.123:0/2827084901 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f882c06c2b0 0x7f882c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:33.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.861+0000 7f88437fe640 1 -- 172.21.15.123:0/2827084901 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5227+0+0 (secure 0 0 0) 0x7f884408b030 con 0x7f884c0cce30 2024-09-15T23:16:33.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.861+0000 7f884a59c640 1 --2- 172.21.15.123:0/2827084901 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f882c06c2b0 0x7f882c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:33.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.862+0000 7f884a59c640 1 --2- 172.21.15.123:0/2827084901 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f882c06c2b0 0x7f882c06e770 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f883c034000 tx=0x7f883c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:33.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:33.866+0000 7f88437fe640 1 -- 172.21.15.123:0/2827084901 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8844059a10 con 0x7f884c0cce30 2024-09-15T23:16:34.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.031+0000 7f88508a6640 1 -- 172.21.15.123:0/2827084901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f884c0711f0 con 0x7f884c0cce30 2024-09-15T23:16:34.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.737+0000 7f88437fe640 1 -- 172.21.15.123:0/2827084901 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v96) ==== 170+0+0 (secure 0 0 0) 0x7f8844059310 con 0x7f884c0cce30 2024-09-15T23:16:34.738 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' created 2024-09-15T23:16:34.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.739+0000 7f88508a6640 1 -- 172.21.15.123:0/2827084901 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f882c06c2b0 msgr2=0x7f882c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:34.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.739+0000 7f88508a6640 1 --2- 172.21.15.123:0/2827084901 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f882c06c2b0 0x7f882c06e770 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f883c034000 tx=0x7f883c02e000 comp rx=0 tx=0).stop 2024-09-15T23:16:34.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.739+0000 7f88508a6640 1 -- 172.21.15.123:0/2827084901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f884c0cce30 msgr2=0x7f884c149fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:34.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.739+0000 7f88508a6640 1 --2- 172.21.15.123:0/2827084901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f884c0cce30 0x7f884c149fe0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f884400cb40 tx=0x7f884400a060 comp rx=0 tx=0).stop 2024-09-15T23:16:34.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.739+0000 7f88508a6640 1 -- 172.21.15.123:0/2827084901 shutdown_connections 2024-09-15T23:16:34.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.739+0000 7f88508a6640 1 --2- 172.21.15.123:0/2827084901 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f882c06c2b0 0x7f882c06e770 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:34.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.739+0000 7f88508a6640 1 --2- 172.21.15.123:0/2827084901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f884c0cce30 0x7f884c149fe0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:34.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.739+0000 7f88508a6640 1 --2- 172.21.15.123:0/2827084901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f884c0732e0 0x7f884c0c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:34.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.739+0000 7f88508a6640 1 --2- 172.21.15.123:0/2827084901 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f884c071c70 0x7f884c0c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:34.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.739+0000 7f88508a6640 1 -- 172.21.15.123:0/2827084901 >> 172.21.15.123:0/2827084901 conn(0x7f884c06d0f0 msgr2=0x7f884c06c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:34.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.740+0000 7f88508a6640 1 -- 172.21.15.123:0/2827084901 shutdown_connections 2024-09-15T23:16:34.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.740+0000 7f88508a6640 1 -- 172.21.15.123:0/2827084901 wait complete. 2024-09-15T23:16:34.765 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T23:16:34.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.867+0000 7f6ee2cf1640 1 Processor -- start 2024-09-15T23:16:34.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.867+0000 7f6ee2cf1640 1 -- start start 2024-09-15T23:16:34.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.867+0000 7f6ee2cf1640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6edc0732e0 0x7f6edc0736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:34.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.867+0000 7f6ee2cf1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6edc0cd2a0 0x7f6edc15c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:34.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.867+0000 7f6ee2cf1640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6edc0714b0 con 0x7f6edc0cce30 2024-09-15T23:16:34.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.867+0000 7f6ee2cf1640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f6edc073c00 con 0x7f6edc0732e0 2024-09-15T23:16:34.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.867+0000 7f6ee2cf1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6edc0cd880 con 0x7f6edc0cd2a0 2024-09-15T23:16:34.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.868+0000 7f6ee0a8d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6edc0732e0 0x7f6edc0736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:34.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.868+0000 7f6ee0a8d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6edc0732e0 0x7f6edc0736c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41932/0 (socket says 172.21.15.123:41932) 2024-09-15T23:16:34.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.868+0000 7f6ee0a8d640 1 -- 172.21.15.123:0/2410860919 learned_addr learned my addr 172.21.15.123:0/2410860919 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:34.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.868+0000 7f6ee128e640 1 --2- 172.21.15.123:0/2410860919 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6edc0cd2a0 0x7f6edc15c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:34.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.868+0000 7f6ee0a8d640 1 -- 172.21.15.123:0/2410860919 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6edc0cd2a0 msgr2=0x7f6edc15c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:34.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.868+0000 7f6ee0a8d640 1 --2- 172.21.15.123:0/2410860919 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6edc0cd2a0 0x7f6edc15c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:34.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.868+0000 7f6ee0a8d640 1 -- 172.21.15.123:0/2410860919 >> v1:172.21.15.188:6789/0 conn(0x7f6edc0cce30 legacy=0x7f6edc071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:34.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.868+0000 7f6ee0a8d640 1 -- 172.21.15.123:0/2410860919 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6edc0cdb60 con 0x7f6edc0732e0 2024-09-15T23:16:34.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.869+0000 7f6ee0a8d640 1 --2- 172.21.15.123:0/2410860919 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6edc0732e0 0x7f6edc0736c0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0009870 tx=0x7f6ed002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2f163de7fe7719 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:34.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.869+0000 7f6edb7fe640 1 -- 172.21.15.123:0/2410860919 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0037070 con 0x7f6edc0732e0 2024-09-15T23:16:34.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.869+0000 7f6edb7fe640 1 -- 172.21.15.123:0/2410860919 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ed0032440 con 0x7f6edc0732e0 2024-09-15T23:16:34.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.869+0000 7f6edb7fe640 1 -- 172.21.15.123:0/2410860919 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0032810 con 0x7f6edc0732e0 2024-09-15T23:16:34.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.869+0000 7f6ee2cf1640 1 -- 172.21.15.123:0/2410860919 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6edc0732e0 msgr2=0x7f6edc0736c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:34.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.869+0000 7f6ee2cf1640 1 --2- 172.21.15.123:0/2410860919 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6edc0732e0 0x7f6edc0736c0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0009870 tx=0x7f6ed002a1c0 comp rx=0 tx=0).stop 2024-09-15T23:16:34.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.869+0000 7f6ee2cf1640 1 -- 172.21.15.123:0/2410860919 shutdown_connections 2024-09-15T23:16:34.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.869+0000 7f6ee2cf1640 1 --2- 172.21.15.123:0/2410860919 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6edc0cd2a0 0x7f6edc15c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:34.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.869+0000 7f6ee2cf1640 1 --2- 172.21.15.123:0/2410860919 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6edc0732e0 0x7f6edc0736c0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:34.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.869+0000 7f6ee2cf1640 1 -- 172.21.15.123:0/2410860919 >> 172.21.15.123:0/2410860919 conn(0x7f6edc06d0f0 msgr2=0x7f6edc06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:34.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.869+0000 7f6ee2cf1640 1 -- 172.21.15.123:0/2410860919 shutdown_connections 2024-09-15T23:16:34.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.869+0000 7f6ee2cf1640 1 -- 172.21.15.123:0/2410860919 wait complete. 2024-09-15T23:16:34.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.871+0000 7f6ee2cf1640 1 Processor -- start 2024-09-15T23:16:34.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.871+0000 7f6ee2cf1640 1 -- start start 2024-09-15T23:16:34.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.871+0000 7f6ee2cf1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6edc0732e0 0x7f6edc0cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:34.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.871+0000 7f6ee2cf1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6edc0cce30 0x7f6edc143d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:34.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.871+0000 7f6ee2cf1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6edc0cd2a0 0x7f6edc0cf810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:34.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.871+0000 7f6ee2cf1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6edc06bf70 con 0x7f6edc0cce30 2024-09-15T23:16:34.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.872+0000 7f6ee2cf1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6edc06bdf0 con 0x7f6edc0cd2a0 2024-09-15T23:16:34.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.872+0000 7f6ee2cf1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6edc072380 con 0x7f6edc0732e0 2024-09-15T23:16:34.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.872+0000 7f6edbfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6edc0cce30 0x7f6edc143d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:34.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.872+0000 7f6edbfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6edc0cce30 0x7f6edc143d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41946/0 (socket says 172.21.15.123:41946) 2024-09-15T23:16:34.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.872+0000 7f6edbfff640 1 -- 172.21.15.123:0/861452412 learned_addr learned my addr 172.21.15.123:0/861452412 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:34.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.872+0000 7f6ee0a8d640 1 --2- 172.21.15.123:0/861452412 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6edc0732e0 0x7f6edc0cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:34.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.872+0000 7f6ee128e640 1 --2- 172.21.15.123:0/861452412 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6edc0cd2a0 0x7f6edc0cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:34.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.872+0000 7f6edbfff640 1 -- 172.21.15.123:0/861452412 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6edc0732e0 msgr2=0x7f6edc0cbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:34.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.872+0000 7f6edbfff640 1 --2- 172.21.15.123:0/861452412 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6edc0732e0 0x7f6edc0cbdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:34.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.872+0000 7f6edbfff640 1 -- 172.21.15.123:0/861452412 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6edc0cd2a0 msgr2=0x7f6edc0cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:34.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.872+0000 7f6edbfff640 1 --2- 172.21.15.123:0/861452412 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6edc0cd2a0 0x7f6edc0cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:34.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.872+0000 7f6edbfff640 1 -- 172.21.15.123:0/861452412 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6edc0cc310 con 0x7f6edc0cce30 2024-09-15T23:16:34.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.872+0000 7f6edbfff640 1 --2- 172.21.15.123:0/861452412 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6edc0cce30 0x7f6edc143d40 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f6ec800c430 tx=0x7f6ec800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:34.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.872+0000 7f6ed97fa640 1 -- 172.21.15.123:0/861452412 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec8017070 con 0x7f6edc0cce30 2024-09-15T23:16:34.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.872+0000 7f6ed97fa640 1 -- 172.21.15.123:0/861452412 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ec80052d0 con 0x7f6edc0cce30 2024-09-15T23:16:34.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.872+0000 7f6ed97fa640 1 -- 172.21.15.123:0/861452412 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec8003830 con 0x7f6edc0cce30 2024-09-15T23:16:34.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.872+0000 7f6ee2cf1640 1 -- 172.21.15.123:0/861452412 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6edc0cad50 con 0x7f6edc0cce30 2024-09-15T23:16:34.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.872+0000 7f6ee2cf1640 1 -- 172.21.15.123:0/861452412 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6edc0cb5d0 con 0x7f6edc0cce30 2024-09-15T23:16:34.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.873+0000 7f6ee2cf1640 1 -- 172.21.15.123:0/861452412 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6edc0736c0 con 0x7f6edc0cce30 2024-09-15T23:16:34.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.874+0000 7f6ed97fa640 1 -- 172.21.15.123:0/861452412 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6ec801a070 con 0x7f6edc0cce30 2024-09-15T23:16:34.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.874+0000 7f6ed97fa640 1 --2- 172.21.15.123:0/861452412 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6ec006c2b0 0x7f6ec006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:34.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.874+0000 7f6ed97fa640 1 -- 172.21.15.123:0/861452412 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 5609+0+0 (secure 0 0 0) 0x7f6ec808aaf0 con 0x7f6edc0cce30 2024-09-15T23:16:34.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.875+0000 7f6ee0a8d640 1 --2- 172.21.15.123:0/861452412 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6ec006c2b0 0x7f6ec006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:34.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.875+0000 7f6ee0a8d640 1 --2- 172.21.15.123:0/861452412 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6ec006c2b0 0x7f6ec006e770 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0034000 tx=0x7f6ed002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:34.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:34.879+0000 7f6ed97fa640 1 -- 172.21.15.123:0/861452412 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6ec8021020 con 0x7f6edc0cce30 2024-09-15T23:16:35.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.079+0000 7f6ee2cf1640 1 -- 172.21.15.123:0/861452412 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f6edc0cb0c0 con 0x7f6edc0cce30 2024-09-15T23:16:35.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.748+0000 7f6ed97fa640 1 -- 172.21.15.123:0/861452412 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v57) ==== 174+0+0 (secure 0 0 0) 0x7f6ec80593a0 con 0x7f6edc0cce30 2024-09-15T23:16:35.749 INFO:teuthology.orchestra.run.smithi123.stderr:new fs with metadata pool 12 and data pool 13 2024-09-15T23:16:35.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.750+0000 7f6ee2cf1640 1 -- 172.21.15.123:0/861452412 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6ec006c2b0 msgr2=0x7f6ec006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:35.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.750+0000 7f6ee2cf1640 1 --2- 172.21.15.123:0/861452412 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6ec006c2b0 0x7f6ec006e770 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0034000 tx=0x7f6ed002e000 comp rx=0 tx=0).stop 2024-09-15T23:16:35.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.750+0000 7f6ee2cf1640 1 -- 172.21.15.123:0/861452412 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6edc0cce30 msgr2=0x7f6edc143d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:35.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.750+0000 7f6ee2cf1640 1 --2- 172.21.15.123:0/861452412 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6edc0cce30 0x7f6edc143d40 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f6ec800c430 tx=0x7f6ec800c8f0 comp rx=0 tx=0).stop 2024-09-15T23:16:35.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.750+0000 7f6ee2cf1640 1 -- 172.21.15.123:0/861452412 shutdown_connections 2024-09-15T23:16:35.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.750+0000 7f6ee2cf1640 1 --2- 172.21.15.123:0/861452412 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6edc0cd2a0 0x7f6edc0cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:35.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.750+0000 7f6ee2cf1640 1 --2- 172.21.15.123:0/861452412 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6ec006c2b0 0x7f6ec006e770 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:35.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.750+0000 7f6ee2cf1640 1 --2- 172.21.15.123:0/861452412 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6edc0cce30 0x7f6edc143d40 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:35.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.750+0000 7f6ee2cf1640 1 --2- 172.21.15.123:0/861452412 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6edc0732e0 0x7f6edc0cbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:35.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.750+0000 7f6ee2cf1640 1 -- 172.21.15.123:0/861452412 >> 172.21.15.123:0/861452412 conn(0x7f6edc06d0f0 msgr2=0x7f6edc15eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:35.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.750+0000 7f6ee2cf1640 1 -- 172.21.15.123:0/861452412 shutdown_connections 2024-09-15T23:16:35.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.750+0000 7f6ee2cf1640 1 -- 172.21.15.123:0/861452412 wait complete. 2024-09-15T23:16:35.775 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:16:35.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.874+0000 7f4eeb198640 1 Processor -- start 2024-09-15T23:16:35.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.874+0000 7f4eeb198640 1 -- start start 2024-09-15T23:16:35.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.875+0000 7f4eeb198640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4ee406c320 0x7f4ee415bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:35.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.875+0000 7f4eeb198640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4ee413eb20 0x7f4ee415c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:35.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.875+0000 7f4eeb198640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ee4071180 con 0x7f4ee40b2d40 2024-09-15T23:16:35.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.875+0000 7f4eeb198640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f4ee4071ab0 con 0x7f4ee413eb20 2024-09-15T23:16:35.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.875+0000 7f4eeb198640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f4ee4071460 con 0x7f4ee406c320 2024-09-15T23:16:35.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.875+0000 7f4ee8f34640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f4ee40b2d40 0x7f4ee406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38478/0 (socket says 172.21.15.123:38478) 2024-09-15T23:16:35.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.875+0000 7f4ee8f34640 1 -- 172.21.15.123:0/2941129287 learned_addr learned my addr 172.21.15.123:0/2941129287 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:35.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.875+0000 7f4ee9735640 1 --2- 172.21.15.123:0/2941129287 >> v2:172.21.15.123:3300/0 conn(0x7f4ee413eb20 0x7f4ee415c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:35.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.875+0000 7f4edbfff640 1 --2- 172.21.15.123:0/2941129287 >> v2:172.21.15.188:3300/0 conn(0x7f4ee406c320 0x7f4ee415bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:35.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.875+0000 7f4edb7fe640 1 -- 172.21.15.123:0/2941129287 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3132461317 0 0) 0x7f4ee4071180 con 0x7f4ee40b2d40 2024-09-15T23:16:35.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.875+0000 7f4edb7fe640 1 -- 172.21.15.123:0/2941129287 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ecc003520 con 0x7f4ee40b2d40 2024-09-15T23:16:35.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.875+0000 7f4ee9735640 1 -- 172.21.15.123:0/2941129287 >> v2:172.21.15.188:3300/0 conn(0x7f4ee406c320 msgr2=0x7f4ee415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:35.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.875+0000 7f4ee9735640 1 --2- 172.21.15.123:0/2941129287 >> v2:172.21.15.188:3300/0 conn(0x7f4ee406c320 0x7f4ee415bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:35.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.875+0000 7f4ee9735640 1 -- 172.21.15.123:0/2941129287 >> v1:172.21.15.123:6789/0 conn(0x7f4ee40b2d40 legacy=0x7f4ee406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:35.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.875+0000 7f4ee9735640 1 -- 172.21.15.123:0/2941129287 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ee4071740 con 0x7f4ee413eb20 2024-09-15T23:16:35.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.876+0000 7f4ee9735640 1 --2- 172.21.15.123:0/2941129287 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ee413eb20 0x7f4ee415c230 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f4ee40d1500 tx=0x7f4edc02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7a63c9887134d55 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:35.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.876+0000 7f4edb7fe640 1 -- 172.21.15.123:0/2941129287 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4edc007740 con 0x7f4ee413eb20 2024-09-15T23:16:35.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.876+0000 7f4edb7fe640 1 -- 172.21.15.123:0/2941129287 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4edc0078e0 con 0x7f4ee413eb20 2024-09-15T23:16:35.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.876+0000 7f4edb7fe640 1 -- 172.21.15.123:0/2941129287 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4edc007c90 con 0x7f4ee413eb20 2024-09-15T23:16:35.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.877+0000 7f4eeb198640 1 -- 172.21.15.123:0/2941129287 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ee413eb20 msgr2=0x7f4ee415c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:35.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.877+0000 7f4eeb198640 1 --2- 172.21.15.123:0/2941129287 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ee413eb20 0x7f4ee415c230 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f4ee40d1500 tx=0x7f4edc02a680 comp rx=0 tx=0).stop 2024-09-15T23:16:35.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.877+0000 7f4eeb198640 1 -- 172.21.15.123:0/2941129287 shutdown_connections 2024-09-15T23:16:35.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.877+0000 7f4eeb198640 1 --2- 172.21.15.123:0/2941129287 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ee413eb20 0x7f4ee415c230 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:35.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.877+0000 7f4eeb198640 1 --2- 172.21.15.123:0/2941129287 >> v2:172.21.15.188:3300/0 conn(0x7f4ee406c320 0x7f4ee415bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:35.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.877+0000 7f4eeb198640 1 -- 172.21.15.123:0/2941129287 >> 172.21.15.123:0/2941129287 conn(0x7f4ee40ccec0 msgr2=0x7f4ee40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:35.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.877+0000 7f4eeb198640 1 -- 172.21.15.123:0/2941129287 shutdown_connections 2024-09-15T23:16:35.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.877+0000 7f4eeb198640 1 -- 172.21.15.123:0/2941129287 wait complete. 2024-09-15T23:16:35.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.878+0000 7f4eeb198640 1 Processor -- start 2024-09-15T23:16:35.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.878+0000 7f4eeb198640 1 -- start start 2024-09-15T23:16:35.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.879+0000 7f4eeb198640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4ee406c320 0x7f4ee41548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:35.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.879+0000 7f4eeb198640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ee40b2d40 0x7f4ee4156750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:35.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.879+0000 7f4eeb198640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4ee413eb20 0x7f4ee40b3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:35.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.879+0000 7f4eeb198640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee40720c0 con 0x7f4ee40b2d40 2024-09-15T23:16:35.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.879+0000 7f4eeb198640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee4071f40 con 0x7f4ee406c320 2024-09-15T23:16:35.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.879+0000 7f4eeb198640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4ee4072240 con 0x7f4ee413eb20 2024-09-15T23:16:35.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.879+0000 7f4edbfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ee40b2d40 0x7f4ee4156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:35.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.879+0000 7f4edbfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ee40b2d40 0x7f4ee4156750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41966/0 (socket says 172.21.15.123:41966) 2024-09-15T23:16:35.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.879+0000 7f4edbfff640 1 -- 172.21.15.123:0/925991086 learned_addr learned my addr 172.21.15.123:0/925991086 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:35.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.879+0000 7f4ee8f34640 1 --2- 172.21.15.123:0/925991086 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4ee406c320 0x7f4ee41548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:35.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.879+0000 7f4ee9735640 1 --2- 172.21.15.123:0/925991086 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4ee413eb20 0x7f4ee40b3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:35.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.879+0000 7f4edbfff640 1 -- 172.21.15.123:0/925991086 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4ee413eb20 msgr2=0x7f4ee40b3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:35.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.879+0000 7f4edbfff640 1 --2- 172.21.15.123:0/925991086 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4ee413eb20 0x7f4ee40b3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:35.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.879+0000 7f4edbfff640 1 -- 172.21.15.123:0/925991086 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4ee406c320 msgr2=0x7f4ee41548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:35.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.879+0000 7f4edbfff640 1 --2- 172.21.15.123:0/925991086 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4ee406c320 0x7f4ee41548a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:35.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.879+0000 7f4edbfff640 1 -- 172.21.15.123:0/925991086 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ee40cc270 con 0x7f4ee40b2d40 2024-09-15T23:16:35.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.879+0000 7f4ee8f34640 1 --2- 172.21.15.123:0/925991086 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4ee406c320 0x7f4ee41548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:16:35.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.879+0000 7f4edbfff640 1 --2- 172.21.15.123:0/925991086 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ee40b2d40 0x7f4ee4156750 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f4ed400e9e0 tx=0x7f4ed400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:35.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.880+0000 7f4ed97fa640 1 -- 172.21.15.123:0/925991086 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed4017070 con 0x7f4ee40b2d40 2024-09-15T23:16:35.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.880+0000 7f4ed97fa640 1 -- 172.21.15.123:0/925991086 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ed400c9d0 con 0x7f4ee40b2d40 2024-09-15T23:16:35.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.880+0000 7f4eeb198640 1 -- 172.21.15.123:0/925991086 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ee40cb750 con 0x7f4ee40b2d40 2024-09-15T23:16:35.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.880+0000 7f4ed97fa640 1 -- 172.21.15.123:0/925991086 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed400cdc0 con 0x7f4ee40b2d40 2024-09-15T23:16:35.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.880+0000 7f4eeb198640 1 -- 172.21.15.123:0/925991086 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ee40cbf90 con 0x7f4ee40b2d40 2024-09-15T23:16:35.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.881+0000 7f4eeb198640 1 -- 172.21.15.123:0/925991086 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ee406bc10 con 0x7f4ee40b2d40 2024-09-15T23:16:35.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.881+0000 7f4ed97fa640 1 -- 172.21.15.123:0/925991086 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4ed401a070 con 0x7f4ee40b2d40 2024-09-15T23:16:35.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.882+0000 7f4ed97fa640 1 --2- 172.21.15.123:0/925991086 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4ed006c2b0 0x7f4ed006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:35.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.882+0000 7f4ed97fa640 1 -- 172.21.15.123:0/925991086 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5709+0+0 (secure 0 0 0) 0x7f4ed408b4f0 con 0x7f4ee40b2d40 2024-09-15T23:16:35.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.882+0000 7f4ee8f34640 1 --2- 172.21.15.123:0/925991086 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4ed006c2b0 0x7f4ed006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:35.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.882+0000 7f4ee8f34640 1 --2- 172.21.15.123:0/925991086 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4ed006c2b0 0x7f4ed006e770 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0007fd0 tx=0x7f4ee0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:35.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:35.886+0000 7f4ed97fa640 1 -- 172.21.15.123:0/925991086 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4ee40cb750 con 0x7f4ee40b2d40 2024-09-15T23:16:36.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.053+0000 7f4eeb198640 1 -- 172.21.15.123:0/925991086 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4ee4071220 con 0x7f4ee40b2d40 2024-09-15T23:16:36.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.054+0000 7f4ed97fa640 1 -- 172.21.15.123:0/925991086 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+16769 (secure 0 0 0) 0x7f4ed4059bd0 con 0x7f4ee40b2d40 2024-09-15T23:16:36.055 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:16:36.056 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":97,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:16:35.080470+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:16:33.696407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-15T23:16:34.051030+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:16:36.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.056+0000 7f4eeb198640 1 -- 172.21.15.123:0/925991086 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4ed006c2b0 msgr2=0x7f4ed006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:36.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.056+0000 7f4eeb198640 1 --2- 172.21.15.123:0/925991086 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4ed006c2b0 0x7f4ed006e770 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0007fd0 tx=0x7f4ee0009040 comp rx=0 tx=0).stop 2024-09-15T23:16:36.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.056+0000 7f4eeb198640 1 -- 172.21.15.123:0/925991086 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ee40b2d40 msgr2=0x7f4ee4156750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:36.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.056+0000 7f4eeb198640 1 --2- 172.21.15.123:0/925991086 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ee40b2d40 0x7f4ee4156750 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f4ed400e9e0 tx=0x7f4ed400eea0 comp rx=0 tx=0).stop 2024-09-15T23:16:36.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.056+0000 7f4eeb198640 1 -- 172.21.15.123:0/925991086 shutdown_connections 2024-09-15T23:16:36.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.056+0000 7f4eeb198640 1 --2- 172.21.15.123:0/925991086 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4ee413eb20 0x7f4ee40b3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:36.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.056+0000 7f4eeb198640 1 --2- 172.21.15.123:0/925991086 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4ed006c2b0 0x7f4ed006e770 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:36.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.056+0000 7f4eeb198640 1 --2- 172.21.15.123:0/925991086 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ee40b2d40 0x7f4ee4156750 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:36.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.056+0000 7f4eeb198640 1 --2- 172.21.15.123:0/925991086 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4ee406c320 0x7f4ee41548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:36.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.056+0000 7f4eeb198640 1 -- 172.21.15.123:0/925991086 >> 172.21.15.123:0/925991086 conn(0x7f4ee40ccec0 msgr2=0x7f4ee413f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:36.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.056+0000 7f4eeb198640 1 -- 172.21.15.123:0/925991086 shutdown_connections 2024-09-15T23:16:36.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.057+0000 7f4eeb198640 1 -- 172.21.15.123:0/925991086 wait complete. 2024-09-15T23:16:36.069 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:16:36.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.165+0000 7f67c46e6640 1 Processor -- start 2024-09-15T23:16:36.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.165+0000 7f67c46e6640 1 -- start start 2024-09-15T23:16:36.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.166+0000 7f67c46e6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f67bc0b2d40 0x7f67bc06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:36.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.166+0000 7f67c46e6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f67bc13eb20 0x7f67bc06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:36.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.166+0000 7f67c46e6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f67bc15bcf0 0x7f67bc15c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:36.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.166+0000 7f67c46e6640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f67bc071ab0 con 0x7f67bc15bcf0 2024-09-15T23:16:36.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.166+0000 7f67c46e6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f67bc071180 con 0x7f67bc0b2d40 2024-09-15T23:16:36.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.166+0000 7f67c46e6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f67bc071460 con 0x7f67bc13eb20 2024-09-15T23:16:36.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.167+0000 7f67c2c83640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f67bc15bcf0 0x7f67bc15c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:36.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.167+0000 7f67c2c83640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f67bc15bcf0 0x7f67bc15c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41970/0 (socket says 172.21.15.123:41970) 2024-09-15T23:16:36.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.167+0000 7f67c2c83640 1 -- 172.21.15.123:0/1149611724 learned_addr learned my addr 172.21.15.123:0/1149611724 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:36.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.167+0000 7f67c2482640 1 --2- 172.21.15.123:0/1149611724 >> v2:172.21.15.188:3300/0 conn(0x7f67bc0b2d40 0x7f67bc06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:36.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.167+0000 7f67c1c81640 1 --2- 172.21.15.123:0/1149611724 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f67bc13eb20 0x7f67bc06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:36.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.167+0000 7f67c2c83640 1 -- 172.21.15.123:0/1149611724 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f67bc13eb20 msgr2=0x7f67bc06c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:36.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.167+0000 7f67c2c83640 1 --2- 172.21.15.123:0/1149611724 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f67bc13eb20 0x7f67bc06c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:36.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.167+0000 7f67c2c83640 1 -- 172.21.15.123:0/1149611724 >> v2:172.21.15.188:3300/0 conn(0x7f67bc0b2d40 msgr2=0x7f67bc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:36.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.167+0000 7f67c2c83640 1 --2- 172.21.15.123:0/1149611724 >> v2:172.21.15.188:3300/0 conn(0x7f67bc0b2d40 0x7f67bc06bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:36.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.167+0000 7f67c2c83640 1 -- 172.21.15.123:0/1149611724 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67bc071740 con 0x7f67bc15bcf0 2024-09-15T23:16:36.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.168+0000 7f67c2c83640 1 --2- 172.21.15.123:0/1149611724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67bc15bcf0 0x7f67bc15c1a0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f67bc069be0 tx=0x7f67b402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df4725ea72fb6acd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:36.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.168+0000 7f67c1480640 1 -- 172.21.15.123:0/1149611724 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b4036070 con 0x7f67bc15bcf0 2024-09-15T23:16:36.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.168+0000 7f67c1480640 1 -- 172.21.15.123:0/1149611724 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67b4031600 con 0x7f67bc15bcf0 2024-09-15T23:16:36.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.168+0000 7f67c1480640 1 -- 172.21.15.123:0/1149611724 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b40319d0 con 0x7f67bc15bcf0 2024-09-15T23:16:36.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.168+0000 7f67c46e6640 1 -- 172.21.15.123:0/1149611724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67bc15bcf0 msgr2=0x7f67bc15c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:36.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.168+0000 7f67c46e6640 1 --2- 172.21.15.123:0/1149611724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67bc15bcf0 0x7f67bc15c1a0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f67bc069be0 tx=0x7f67b402a6a0 comp rx=0 tx=0).stop 2024-09-15T23:16:36.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.168+0000 7f67c46e6640 1 -- 172.21.15.123:0/1149611724 shutdown_connections 2024-09-15T23:16:36.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.168+0000 7f67c46e6640 1 --2- 172.21.15.123:0/1149611724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67bc15bcf0 0x7f67bc15c1a0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:36.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.168+0000 7f67c46e6640 1 --2- 172.21.15.123:0/1149611724 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f67bc13eb20 0x7f67bc06c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:36.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.168+0000 7f67c46e6640 1 --2- 172.21.15.123:0/1149611724 >> v2:172.21.15.188:3300/0 conn(0x7f67bc0b2d40 0x7f67bc06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:36.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.168+0000 7f67c46e6640 1 -- 172.21.15.123:0/1149611724 >> 172.21.15.123:0/1149611724 conn(0x7f67bc0ccec0 msgr2=0x7f67bc0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:36.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.168+0000 7f67c46e6640 1 -- 172.21.15.123:0/1149611724 shutdown_connections 2024-09-15T23:16:36.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.168+0000 7f67c46e6640 1 -- 172.21.15.123:0/1149611724 wait complete. 2024-09-15T23:16:36.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.170+0000 7f67c46e6640 1 Processor -- start 2024-09-15T23:16:36.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.170+0000 7f67c46e6640 1 -- start start 2024-09-15T23:16:36.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.170+0000 7f67c46e6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67bc0b2d40 0x7f67bc154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:36.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.170+0000 7f67c46e6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67bc13eb20 0x7f67bc071f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:36.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.170+0000 7f67c46e6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f67bc15bcf0 0x7f67bc072480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:36.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.170+0000 7f67c46e6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f67bc15f140 con 0x7f67bc13eb20 2024-09-15T23:16:36.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.170+0000 7f67c46e6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f67bc15efc0 con 0x7f67bc0b2d40 2024-09-15T23:16:36.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.170+0000 7f67c46e6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f67bc15f2c0 con 0x7f67bc15bcf0 2024-09-15T23:16:36.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.170+0000 7f67c1c81640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67bc13eb20 0x7f67bc071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:36.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.170+0000 7f67c1c81640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67bc13eb20 0x7f67bc071f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41976/0 (socket says 172.21.15.123:41976) 2024-09-15T23:16:36.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.170+0000 7f67c1c81640 1 -- 172.21.15.123:0/2352606429 learned_addr learned my addr 172.21.15.123:0/2352606429 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:36.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.170+0000 7f67c2482640 1 --2- 172.21.15.123:0/2352606429 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67bc0b2d40 0x7f67bc154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:36.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.170+0000 7f67c2c83640 1 --2- 172.21.15.123:0/2352606429 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f67bc15bcf0 0x7f67bc072480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:36.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.171+0000 7f67c1c81640 1 -- 172.21.15.123:0/2352606429 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f67bc15bcf0 msgr2=0x7f67bc072480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:36.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.171+0000 7f67c1c81640 1 --2- 172.21.15.123:0/2352606429 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f67bc15bcf0 0x7f67bc072480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:36.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.171+0000 7f67c1c81640 1 -- 172.21.15.123:0/2352606429 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67bc0b2d40 msgr2=0x7f67bc154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:36.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.171+0000 7f67c1c81640 1 --2- 172.21.15.123:0/2352606429 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67bc0b2d40 0x7f67bc154860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:36.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.171+0000 7f67c1c81640 1 -- 172.21.15.123:0/2352606429 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67bc1f30b0 con 0x7f67bc13eb20 2024-09-15T23:16:36.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.171+0000 7f67c1c81640 1 --2- 172.21.15.123:0/2352606429 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67bc13eb20 0x7f67bc071f40 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f67b000c820 tx=0x7f67b000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:36.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.171+0000 7f67aeffd640 1 -- 172.21.15.123:0/2352606429 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b0015070 con 0x7f67bc13eb20 2024-09-15T23:16:36.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.171+0000 7f67aeffd640 1 -- 172.21.15.123:0/2352606429 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67b0004220 con 0x7f67bc13eb20 2024-09-15T23:16:36.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.171+0000 7f67c46e6640 1 -- 172.21.15.123:0/2352606429 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67bc157210 con 0x7f67bc13eb20 2024-09-15T23:16:36.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.171+0000 7f67aeffd640 1 -- 172.21.15.123:0/2352606429 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b000ce10 con 0x7f67bc13eb20 2024-09-15T23:16:36.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.171+0000 7f67c46e6640 1 -- 172.21.15.123:0/2352606429 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67bc1f2380 con 0x7f67bc13eb20 2024-09-15T23:16:36.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.172+0000 7f67c46e6640 1 -- 172.21.15.123:0/2352606429 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67bc157000 con 0x7f67bc13eb20 2024-09-15T23:16:36.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.173+0000 7f67aeffd640 1 -- 172.21.15.123:0/2352606429 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f67b0007830 con 0x7f67bc13eb20 2024-09-15T23:16:36.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.173+0000 7f67aeffd640 1 --2- 172.21.15.123:0/2352606429 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f67a006c2b0 0x7f67a006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:36.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.173+0000 7f67aeffd640 1 -- 172.21.15.123:0/2352606429 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5709+0+0 (secure 0 0 0) 0x7f67b008b230 con 0x7f67bc13eb20 2024-09-15T23:16:36.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.173+0000 7f67c2482640 1 --2- 172.21.15.123:0/2352606429 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f67a006c2b0 0x7f67a006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:36.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.174+0000 7f67c2482640 1 --2- 172.21.15.123:0/2352606429 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f67a006c2b0 0x7f67a006e770 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f67b800aaf0 tx=0x7f67b8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:36.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.177+0000 7f67aeffd640 1 -- 172.21.15.123:0/2352606429 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f67b0059350 con 0x7f67bc13eb20 2024-09-15T23:16:36.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.343+0000 7f67c46e6640 1 -- 172.21.15.123:0/2352606429 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f67bc06c9c0 con 0x7f67bc13eb20 2024-09-15T23:16:36.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.344+0000 7f67aeffd640 1 -- 172.21.15.123:0/2352606429 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) ==== 74+0+16769 (secure 0 0 0) 0x7f67b005d650 con 0x7f67bc13eb20 2024-09-15T23:16:36.346 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:16:36.346 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":97,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:16:35.080470+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:16:33.696407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-15T23:16:34.051030+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:16:36.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.347+0000 7f67c46e6640 1 -- 172.21.15.123:0/2352606429 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f67a006c2b0 msgr2=0x7f67a006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:36.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.347+0000 7f67c46e6640 1 --2- 172.21.15.123:0/2352606429 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f67a006c2b0 0x7f67a006e770 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f67b800aaf0 tx=0x7f67b8008040 comp rx=0 tx=0).stop 2024-09-15T23:16:36.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.347+0000 7f67c46e6640 1 -- 172.21.15.123:0/2352606429 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67bc13eb20 msgr2=0x7f67bc071f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:36.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.347+0000 7f67c46e6640 1 --2- 172.21.15.123:0/2352606429 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67bc13eb20 0x7f67bc071f40 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f67b000c820 tx=0x7f67b000cce0 comp rx=0 tx=0).stop 2024-09-15T23:16:36.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.347+0000 7f67c46e6640 1 -- 172.21.15.123:0/2352606429 shutdown_connections 2024-09-15T23:16:36.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.347+0000 7f67c46e6640 1 --2- 172.21.15.123:0/2352606429 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f67bc15bcf0 0x7f67bc072480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:36.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.347+0000 7f67c46e6640 1 --2- 172.21.15.123:0/2352606429 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f67a006c2b0 0x7f67a006e770 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:36.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.347+0000 7f67c46e6640 1 --2- 172.21.15.123:0/2352606429 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67bc13eb20 0x7f67bc071f40 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:36.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.347+0000 7f67c46e6640 1 --2- 172.21.15.123:0/2352606429 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67bc0b2d40 0x7f67bc154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:36.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.347+0000 7f67c46e6640 1 -- 172.21.15.123:0/2352606429 >> 172.21.15.123:0/2352606429 conn(0x7f67bc0ccec0 msgr2=0x7f67bc15e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:36.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.347+0000 7f67c46e6640 1 -- 172.21.15.123:0/2352606429 shutdown_connections 2024-09-15T23:16:36.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.347+0000 7f67c46e6640 1 -- 172.21.15.123:0/2352606429 wait complete. 2024-09-15T23:16:36.359 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T23:16:36.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.460+0000 7fb94c8f8640 1 Processor -- start 2024-09-15T23:16:36.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.460+0000 7fb94c8f8640 1 -- start start 2024-09-15T23:16:36.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.460+0000 7fb94c8f8640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb9480732e0 0x7fb9480736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:36.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.460+0000 7fb94c8f8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb9480cce30 0x7fb9480cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:36.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.461+0000 7fb94c8f8640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9480714b0 con 0x7fb948071c70 2024-09-15T23:16:36.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.461+0000 7fb94c8f8640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fb948073c00 con 0x7fb9480cce30 2024-09-15T23:16:36.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.461+0000 7fb94c8f8640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb9480cd880 con 0x7fb9480732e0 2024-09-15T23:16:36.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.461+0000 7fb93dd9b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb9480cce30 0x7fb9480cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:36.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.461+0000 7fb946d9d640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fb948071c70 0x7fb94815c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:60638/0 (socket says 172.21.15.123:60638) 2024-09-15T23:16:36.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.461+0000 7fb946d9d640 1 -- 172.21.15.123:0/807292066 learned_addr learned my addr 172.21.15.123:0/807292066 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:36.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.461+0000 7fb94659c640 1 --2- 172.21.15.123:0/807292066 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb9480732e0 0x7fb9480736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:36.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.461+0000 7fb94659c640 1 -- 172.21.15.123:0/807292066 >> v2:172.21.15.188:3300/0 conn(0x7fb9480cce30 msgr2=0x7fb9480cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:36.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.461+0000 7fb94659c640 1 --2- 172.21.15.123:0/807292066 >> v2:172.21.15.188:3300/0 conn(0x7fb9480cce30 0x7fb9480cd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:36.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.461+0000 7fb94659c640 1 -- 172.21.15.123:0/807292066 >> v1:172.21.15.188:6789/0 conn(0x7fb948071c70 legacy=0x7fb94815c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:36.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.461+0000 7fb94659c640 1 -- 172.21.15.123:0/807292066 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9480cdb60 con 0x7fb9480732e0 2024-09-15T23:16:36.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.461+0000 7fb945d9b640 1 -- 172.21.15.123:0/807292066 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3357224562 0 0) 0x7fb9480714b0 con 0x7fb948071c70 2024-09-15T23:16:36.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.461+0000 7fb93dd9b640 1 --2- 172.21.15.123:0/807292066 >> v2:172.21.15.188:3300/0 conn(0x7fb9480cce30 0x7fb9480cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:16:36.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.462+0000 7fb94659c640 1 --2- 172.21.15.123:0/807292066 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb9480732e0 0x7fb9480736c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb9380097a0 tx=0x7fb93802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7139642e18dc3bae server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:36.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.462+0000 7fb945d9b640 1 -- 172.21.15.123:0/807292066 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb938037070 con 0x7fb9480732e0 2024-09-15T23:16:36.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.462+0000 7fb945d9b640 1 -- 172.21.15.123:0/807292066 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb93802ae50 con 0x7fb9480732e0 2024-09-15T23:16:36.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.462+0000 7fb945d9b640 1 -- 172.21.15.123:0/807292066 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb938032660 con 0x7fb9480732e0 2024-09-15T23:16:36.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.463+0000 7fb94c8f8640 1 -- 172.21.15.123:0/807292066 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb9480732e0 msgr2=0x7fb9480736c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:36.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.463+0000 7fb94c8f8640 1 --2- 172.21.15.123:0/807292066 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb9480732e0 0x7fb9480736c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb9380097a0 tx=0x7fb93802a100 comp rx=0 tx=0).stop 2024-09-15T23:16:36.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.463+0000 7fb94c8f8640 1 -- 172.21.15.123:0/807292066 shutdown_connections 2024-09-15T23:16:36.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.463+0000 7fb94c8f8640 1 --2- 172.21.15.123:0/807292066 >> v2:172.21.15.188:3300/0 conn(0x7fb9480cce30 0x7fb9480cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:36.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.463+0000 7fb94c8f8640 1 --2- 172.21.15.123:0/807292066 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb9480732e0 0x7fb9480736c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:36.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.463+0000 7fb94c8f8640 1 -- 172.21.15.123:0/807292066 >> 172.21.15.123:0/807292066 conn(0x7fb94806d0f0 msgr2=0x7fb94806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:36.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.463+0000 7fb94c8f8640 1 -- 172.21.15.123:0/807292066 shutdown_connections 2024-09-15T23:16:36.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.463+0000 7fb94c8f8640 1 -- 172.21.15.123:0/807292066 wait complete. 2024-09-15T23:16:36.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.464+0000 7fb94c8f8640 1 Processor -- start 2024-09-15T23:16:36.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.464+0000 7fb94c8f8640 1 -- start start 2024-09-15T23:16:36.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.465+0000 7fb94c8f8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb948071c70 0x7fb9480b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:36.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.465+0000 7fb94c8f8640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb9480732e0 0x7fb9480c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:36.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.465+0000 7fb94c8f8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9480cce30 0x7fb9480cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:36.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.465+0000 7fb94c8f8640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb94806bf70 con 0x7fb948071c70 2024-09-15T23:16:36.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.465+0000 7fb94c8f8640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb94806bdf0 con 0x7fb9480cce30 2024-09-15T23:16:36.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.465+0000 7fb94c8f8640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb948072120 con 0x7fb9480732e0 2024-09-15T23:16:36.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.465+0000 7fb94659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb948071c70 0x7fb9480b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:36.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.465+0000 7fb94659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb948071c70 0x7fb9480b29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46530/0 (socket says 172.21.15.123:46530) 2024-09-15T23:16:36.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.465+0000 7fb94659c640 1 -- 172.21.15.123:0/2414229874 learned_addr learned my addr 172.21.15.123:0/2414229874 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:36.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.465+0000 7fb93dd9b640 1 --2- 172.21.15.123:0/2414229874 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb9480732e0 0x7fb9480c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:36.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.465+0000 7fb946d9d640 1 --2- 172.21.15.123:0/2414229874 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9480cce30 0x7fb9480cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:36.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.465+0000 7fb94659c640 1 -- 172.21.15.123:0/2414229874 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb9480732e0 msgr2=0x7fb9480c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:36.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.465+0000 7fb94659c640 1 --2- 172.21.15.123:0/2414229874 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb9480732e0 0x7fb9480c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:36.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.465+0000 7fb94659c640 1 -- 172.21.15.123:0/2414229874 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9480cce30 msgr2=0x7fb9480cb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:36.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.465+0000 7fb94659c640 1 --2- 172.21.15.123:0/2414229874 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9480cce30 0x7fb9480cb8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:36.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.465+0000 7fb94659c640 1 -- 172.21.15.123:0/2414229874 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb948157b90 con 0x7fb948071c70 2024-09-15T23:16:36.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.465+0000 7fb94659c640 1 --2- 172.21.15.123:0/2414229874 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb948071c70 0x7fb9480b29a0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fb9380097a0 tx=0x7fb9380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:36.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.466+0000 7fb93f7fe640 1 -- 172.21.15.123:0/2414229874 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb938037040 con 0x7fb948071c70 2024-09-15T23:16:36.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.466+0000 7fb93f7fe640 1 -- 172.21.15.123:0/2414229874 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb938004030 con 0x7fb948071c70 2024-09-15T23:16:36.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.466+0000 7fb94c8f8640 1 -- 172.21.15.123:0/2414229874 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb948157e70 con 0x7fb948071c70 2024-09-15T23:16:36.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.466+0000 7fb93f7fe640 1 -- 172.21.15.123:0/2414229874 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb938004420 con 0x7fb948071c70 2024-09-15T23:16:36.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.466+0000 7fb94c8f8640 1 -- 172.21.15.123:0/2414229874 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb948158430 con 0x7fb948071c70 2024-09-15T23:16:36.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.467+0000 7fb94c8f8640 1 -- 172.21.15.123:0/2414229874 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9480724b0 con 0x7fb948071c70 2024-09-15T23:16:36.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.467+0000 7fb93f7fe640 1 -- 172.21.15.123:0/2414229874 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb938003610 con 0x7fb948071c70 2024-09-15T23:16:36.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.468+0000 7fb93f7fe640 1 --2- 172.21.15.123:0/2414229874 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb92806c2e0 0x7fb92806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:36.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.468+0000 7fb93f7fe640 1 -- 172.21.15.123:0/2414229874 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5709+0+0 (secure 0 0 0) 0x7fb9380abfc0 con 0x7fb948071c70 2024-09-15T23:16:36.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.468+0000 7fb93dd9b640 1 --2- 172.21.15.123:0/2414229874 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb92806c2e0 0x7fb92806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:36.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.468+0000 7fb93dd9b640 1 --2- 172.21.15.123:0/2414229874 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb92806c2e0 0x7fb92806e7a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb930009560 tx=0x7fb930009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:36.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.472+0000 7fb93f7fe640 1 -- 172.21.15.123:0/2414229874 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb93807a170 con 0x7fb948071c70 2024-09-15T23:16:36.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.673+0000 7fb94c8f8640 1 -- 172.21.15.123:0/2414229874 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb9480711f0 con 0x7fb948071c70 2024-09-15T23:16:36.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.761+0000 7fb93f7fe640 1 -- 172.21.15.123:0/2414229874 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v58) ==== 118+0+0 (secure 0 0 0) 0x7fb93807e470 con 0x7fb948071c70 2024-09-15T23:16:36.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.763+0000 7fb94c8f8640 1 -- 172.21.15.123:0/2414229874 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb92806c2e0 msgr2=0x7fb92806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:36.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.763+0000 7fb94c8f8640 1 --2- 172.21.15.123:0/2414229874 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb92806c2e0 0x7fb92806e7a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb930009560 tx=0x7fb930009190 comp rx=0 tx=0).stop 2024-09-15T23:16:36.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.763+0000 7fb94c8f8640 1 -- 172.21.15.123:0/2414229874 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb948071c70 msgr2=0x7fb9480b29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:36.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.763+0000 7fb94c8f8640 1 --2- 172.21.15.123:0/2414229874 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb948071c70 0x7fb9480b29a0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fb9380097a0 tx=0x7fb9380046c0 comp rx=0 tx=0).stop 2024-09-15T23:16:36.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.763+0000 7fb94c8f8640 1 -- 172.21.15.123:0/2414229874 shutdown_connections 2024-09-15T23:16:36.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.763+0000 7fb94c8f8640 1 --2- 172.21.15.123:0/2414229874 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9480cce30 0x7fb9480cb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:36.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.763+0000 7fb94c8f8640 1 --2- 172.21.15.123:0/2414229874 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb9480732e0 0x7fb9480c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:36.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.763+0000 7fb94c8f8640 1 --2- 172.21.15.123:0/2414229874 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb92806c2e0 0x7fb92806e7a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:36.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.763+0000 7fb94c8f8640 1 --2- 172.21.15.123:0/2414229874 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb948071c70 0x7fb9480b29a0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:36.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.763+0000 7fb94c8f8640 1 -- 172.21.15.123:0/2414229874 >> 172.21.15.123:0/2414229874 conn(0x7fb94806d0f0 msgr2=0x7fb94815d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:36.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.763+0000 7fb94c8f8640 1 -- 172.21.15.123:0/2414229874 shutdown_connections 2024-09-15T23:16:36.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.763+0000 7fb94c8f8640 1 -- 172.21.15.123:0/2414229874 wait complete. 2024-09-15T23:16:36.775 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T23:16:36.776 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T23:16:36.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.876+0000 7fcfe4b9f640 1 Processor -- start 2024-09-15T23:16:36.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.876+0000 7fcfe4b9f640 1 -- start start 2024-09-15T23:16:36.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.877+0000 7fcfe4b9f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fcfe015e7d0 0x7fcfe00d4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:36.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.877+0000 7fcfe4b9f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcfe00d3110 0x7fcfe00b7b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:36.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.877+0000 7fcfe4b9f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfe00d42b0 con 0x7fcfe00d4a90 2024-09-15T23:16:36.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.877+0000 7fcfe4b9f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fcfe00d4ee0 con 0x7fcfe00d3110 2024-09-15T23:16:36.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.877+0000 7fcfe4b9f640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fcfe00d3730 con 0x7fcfe015e7d0 2024-09-15T23:16:36.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.877+0000 7fcfdffff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcfe00d3110 0x7fcfe00b7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:36.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.877+0000 7fcfdffff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcfe00d3110 0x7fcfe00b7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46538/0 (socket says 172.21.15.123:46538) 2024-09-15T23:16:36.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.877+0000 7fcfdffff640 1 -- 172.21.15.123:0/1888555443 learned_addr learned my addr 172.21.15.123:0/1888555443 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:36.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.877+0000 7fcfdffff640 1 -- 172.21.15.123:0/1888555443 >> v2:172.21.15.188:3300/0 conn(0x7fcfe015e7d0 msgr2=0x7fcfe00d4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:36.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.877+0000 7fcfdffff640 1 --2- 172.21.15.123:0/1888555443 >> v2:172.21.15.188:3300/0 conn(0x7fcfe015e7d0 0x7fcfe00d4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:36.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.877+0000 7fcfdffff640 1 -- 172.21.15.123:0/1888555443 >> v1:172.21.15.188:6789/0 conn(0x7fcfe00d4a90 legacy=0x7fcfe00d2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:36.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.877+0000 7fcfdffff640 1 -- 172.21.15.123:0/1888555443 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe00d3a10 con 0x7fcfe00d3110 2024-09-15T23:16:36.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.878+0000 7fcfdffff640 1 --2- 172.21.15.123:0/1888555443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfe00d3110 0x7fcfe00b7b40 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fcfe00b70c0 tx=0x7fcfd802a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e03dc7ca724986 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:36.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.878+0000 7fcfde7fc640 1 -- 172.21.15.123:0/1888555443 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8036070 con 0x7fcfe00d3110 2024-09-15T23:16:36.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.878+0000 7fcfde7fc640 1 -- 172.21.15.123:0/1888555443 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfd8031600 con 0x7fcfe00d3110 2024-09-15T23:16:36.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.878+0000 7fcfde7fc640 1 -- 172.21.15.123:0/1888555443 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd80319d0 con 0x7fcfe00d3110 2024-09-15T23:16:36.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.878+0000 7fcfe4b9f640 1 -- 172.21.15.123:0/1888555443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfe00d3110 msgr2=0x7fcfe00b7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:36.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.878+0000 7fcfe4b9f640 1 --2- 172.21.15.123:0/1888555443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfe00d3110 0x7fcfe00b7b40 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fcfe00b70c0 tx=0x7fcfd802a780 comp rx=0 tx=0).stop 2024-09-15T23:16:36.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.878+0000 7fcfe4b9f640 1 -- 172.21.15.123:0/1888555443 shutdown_connections 2024-09-15T23:16:36.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.878+0000 7fcfe4b9f640 1 --2- 172.21.15.123:0/1888555443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfe00d3110 0x7fcfe00b7b40 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:36.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.878+0000 7fcfe4b9f640 1 --2- 172.21.15.123:0/1888555443 >> v2:172.21.15.188:3300/0 conn(0x7fcfe015e7d0 0x7fcfe00d4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:36.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.878+0000 7fcfe4b9f640 1 -- 172.21.15.123:0/1888555443 >> 172.21.15.123:0/1888555443 conn(0x7fcfe0067d40 msgr2=0x7fcfe0068150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:36.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.879+0000 7fcfe4b9f640 1 -- 172.21.15.123:0/1888555443 shutdown_connections 2024-09-15T23:16:36.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.879+0000 7fcfe4b9f640 1 -- 172.21.15.123:0/1888555443 wait complete. 2024-09-15T23:16:36.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.880+0000 7fcfe4b9f640 1 Processor -- start 2024-09-15T23:16:36.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.880+0000 7fcfe4b9f640 1 -- start start 2024-09-15T23:16:36.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.881+0000 7fcfe4b9f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcfe00d3110 0x7fcfe0153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:36.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.881+0000 7fcfe4b9f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfe00d4a90 0x7fcfe00c9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:36.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.881+0000 7fcfe4b9f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcfe015e7d0 0x7fcfe01602a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:36.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.881+0000 7fcfe4b9f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe00b8080 con 0x7fcfe00d4a90 2024-09-15T23:16:36.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.881+0000 7fcfe4b9f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe00d3fd0 con 0x7fcfe00d3110 2024-09-15T23:16:36.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.881+0000 7fcfe4b9f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fcfe00b8200 con 0x7fcfe015e7d0 2024-09-15T23:16:36.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.881+0000 7fcfdeffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfe00d4a90 0x7fcfe00c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:36.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.881+0000 7fcfdeffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfe00d4a90 0x7fcfe00c9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46550/0 (socket says 172.21.15.123:46550) 2024-09-15T23:16:36.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.881+0000 7fcfdeffd640 1 -- 172.21.15.123:0/2150255924 learned_addr learned my addr 172.21.15.123:0/2150255924 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:36.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.881+0000 7fcfdf7fe640 1 --2- 172.21.15.123:0/2150255924 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcfe00d3110 0x7fcfe0153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:36.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.881+0000 7fcfdffff640 1 --2- 172.21.15.123:0/2150255924 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcfe015e7d0 0x7fcfe01602a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:36.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.881+0000 7fcfdeffd640 1 -- 172.21.15.123:0/2150255924 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcfe015e7d0 msgr2=0x7fcfe01602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:36.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.881+0000 7fcfdeffd640 1 --2- 172.21.15.123:0/2150255924 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcfe015e7d0 0x7fcfe01602a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:36.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.881+0000 7fcfdeffd640 1 -- 172.21.15.123:0/2150255924 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcfe00d3110 msgr2=0x7fcfe0153e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:36.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.881+0000 7fcfdeffd640 1 --2- 172.21.15.123:0/2150255924 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcfe00d3110 0x7fcfe0153e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:36.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.881+0000 7fcfdeffd640 1 -- 172.21.15.123:0/2150255924 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe00ca9a0 con 0x7fcfe00d4a90 2024-09-15T23:16:36.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.881+0000 7fcfdeffd640 1 --2- 172.21.15.123:0/2150255924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfe00d4a90 0x7fcfe00c9430 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fcfc800c440 tx=0x7fcfc800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:36.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.881+0000 7fcfd7fff640 1 -- 172.21.15.123:0/2150255924 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8017070 con 0x7fcfe00d4a90 2024-09-15T23:16:36.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.881+0000 7fcfd7fff640 1 -- 172.21.15.123:0/2150255924 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfc80035f0 con 0x7fcfe00d4a90 2024-09-15T23:16:36.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.881+0000 7fcfd7fff640 1 -- 172.21.15.123:0/2150255924 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc80039e0 con 0x7fcfe00d4a90 2024-09-15T23:16:36.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.881+0000 7fcfe4b9f640 1 -- 172.21.15.123:0/2150255924 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfe00ca3e0 con 0x7fcfe00d4a90 2024-09-15T23:16:36.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.881+0000 7fcfe4b9f640 1 -- 172.21.15.123:0/2150255924 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfe00c8c30 con 0x7fcfe00d4a90 2024-09-15T23:16:36.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.882+0000 7fcfe4b9f640 1 -- 172.21.15.123:0/2150255924 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfe00d0b80 con 0x7fcfe00d4a90 2024-09-15T23:16:36.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.883+0000 7fcfd7fff640 1 -- 172.21.15.123:0/2150255924 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcfc8003b80 con 0x7fcfe00d4a90 2024-09-15T23:16:36.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.883+0000 7fcfd7fff640 1 --2- 172.21.15.123:0/2150255924 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcfc006c2e0 0x7fcfc006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:36.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.883+0000 7fcfd7fff640 1 -- 172.21.15.123:0/2150255924 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5709+0+0 (secure 0 0 0) 0x7fcfc808a4f0 con 0x7fcfe00d4a90 2024-09-15T23:16:36.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.883+0000 7fcfdf7fe640 1 --2- 172.21.15.123:0/2150255924 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcfc006c2e0 0x7fcfc006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:36.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.884+0000 7fcfdf7fe640 1 --2- 172.21.15.123:0/2150255924 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcfc006c2e0 0x7fcfc006e7a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fcfd00098e0 tx=0x7fcfd0009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:36.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:36.887+0000 7fcfd7fff640 1 -- 172.21.15.123:0/2150255924 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcfe00d0b80 con 0x7fcfe00d4a90 2024-09-15T23:16:37.018 INFO:tasks.ceph.mds.b.smithi188.stderr:2024-09-15T23:16:37.018+0000 7f9988120640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:16:37.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.089+0000 7fcfe4b9f640 1 -- 172.21.15.123:0/2150255924 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fcfe00b7b40 con 0x7fcfe00d4a90 2024-09-15T23:16:37.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.775+0000 7fcfd7fff640 1 -- 172.21.15.123:0/2150255924 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v59) ==== 122+0+0 (secure 0 0 0) 0x7fcfc80010c0 con 0x7fcfe00d4a90 2024-09-15T23:16:37.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.777+0000 7fcfe4b9f640 1 -- 172.21.15.123:0/2150255924 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcfc006c2e0 msgr2=0x7fcfc006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:37.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.777+0000 7fcfe4b9f640 1 --2- 172.21.15.123:0/2150255924 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcfc006c2e0 0x7fcfc006e7a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fcfd00098e0 tx=0x7fcfd0009060 comp rx=0 tx=0).stop 2024-09-15T23:16:37.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.777+0000 7fcfe4b9f640 1 -- 172.21.15.123:0/2150255924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfe00d4a90 msgr2=0x7fcfe00c9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:37.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.777+0000 7fcfe4b9f640 1 --2- 172.21.15.123:0/2150255924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfe00d4a90 0x7fcfe00c9430 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fcfc800c440 tx=0x7fcfc800c900 comp rx=0 tx=0).stop 2024-09-15T23:16:37.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.777+0000 7fcfe4b9f640 1 -- 172.21.15.123:0/2150255924 shutdown_connections 2024-09-15T23:16:37.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.777+0000 7fcfe4b9f640 1 --2- 172.21.15.123:0/2150255924 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcfe015e7d0 0x7fcfe01602a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:37.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.777+0000 7fcfe4b9f640 1 --2- 172.21.15.123:0/2150255924 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcfc006c2e0 0x7fcfc006e7a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:37.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.777+0000 7fcfe4b9f640 1 --2- 172.21.15.123:0/2150255924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcfe00d4a90 0x7fcfe00c9430 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:37.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.777+0000 7fcfe4b9f640 1 --2- 172.21.15.123:0/2150255924 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcfe00d3110 0x7fcfe0153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:37.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.777+0000 7fcfe4b9f640 1 -- 172.21.15.123:0/2150255924 >> 172.21.15.123:0/2150255924 conn(0x7fcfe0067d40 msgr2=0x7fcfe00b68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:37.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.778+0000 7fcfe4b9f640 1 -- 172.21.15.123:0/2150255924 shutdown_connections 2024-09-15T23:16:37.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.778+0000 7fcfe4b9f640 1 -- 172.21.15.123:0/2150255924 wait complete. 2024-09-15T23:16:37.792 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T23:16:37.792 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:16:37.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.894+0000 7f4af735f640 1 Processor -- start 2024-09-15T23:16:37.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.894+0000 7f4af735f640 1 -- start start 2024-09-15T23:16:37.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.895+0000 7f4af735f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4af006bc10 0x7f4af006bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:37.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.895+0000 7f4af735f640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4af006c530 con 0x7f4af00cef60 2024-09-15T23:16:37.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.895+0000 7f4af735f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4af00b4090 con 0x7f4af00b3790 2024-09-15T23:16:37.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.895+0000 7f4af735f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f4af00cd690 con 0x7f4af006bc10 2024-09-15T23:16:37.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.895+0000 7f4af50fb640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4af006bc10 0x7f4af006bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:37.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.895+0000 7f4af48fa640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f4af00cef60 0x7f4af015eb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:57212/0 (socket says 172.21.15.123:57212) 2024-09-15T23:16:37.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.895+0000 7f4af48fa640 1 -- 172.21.15.123:0/1965694259 learned_addr learned my addr 172.21.15.123:0/1965694259 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:37.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.895+0000 7f4af50fb640 1 -- 172.21.15.123:0/1965694259 >> v1:172.21.15.188:6789/0 conn(0x7f4af00b3790 legacy=0x7f4af01624e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:37.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.895+0000 7f4af50fb640 1 -- 172.21.15.123:0/1965694259 >> v1:172.21.15.123:6789/0 conn(0x7f4af00cef60 legacy=0x7f4af015eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:37.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.896+0000 7f4af50fb640 1 -- 172.21.15.123:0/1965694259 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af00d0950 con 0x7f4af006bc10 2024-09-15T23:16:37.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.896+0000 7f4ae7fff640 1 -- 172.21.15.123:0/1965694259 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2650747546 0 0) 0x7f4af006c530 con 0x7f4af00cef60 2024-09-15T23:16:37.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.896+0000 7f4af50fb640 1 --2- 172.21.15.123:0/1965694259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4af006bc10 0x7f4af006bff0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f4aec009d90 tx=0x7f4aec02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b5718d978e5dfa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:37.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.896+0000 7f4ae7fff640 1 -- 172.21.15.123:0/1965694259 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aec007740 con 0x7f4af006bc10 2024-09-15T23:16:37.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.896+0000 7f4ae7fff640 1 -- 172.21.15.123:0/1965694259 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4aec0078e0 con 0x7f4af006bc10 2024-09-15T23:16:37.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.896+0000 7f4ae7fff640 1 -- 172.21.15.123:0/1965694259 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aec007cb0 con 0x7f4af006bc10 2024-09-15T23:16:37.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.897+0000 7f4af735f640 1 -- 172.21.15.123:0/1965694259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4af006bc10 msgr2=0x7f4af006bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:37.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.897+0000 7f4af735f640 1 --2- 172.21.15.123:0/1965694259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4af006bc10 0x7f4af006bff0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f4aec009d90 tx=0x7f4aec02a6a0 comp rx=0 tx=0).stop 2024-09-15T23:16:37.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.897+0000 7f4af735f640 1 -- 172.21.15.123:0/1965694259 shutdown_connections 2024-09-15T23:16:37.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.897+0000 7f4af735f640 1 --2- 172.21.15.123:0/1965694259 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4af006bc10 0x7f4af006bff0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:37.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.897+0000 7f4af735f640 1 -- 172.21.15.123:0/1965694259 >> 172.21.15.123:0/1965694259 conn(0x7f4af006cd20 msgr2=0x7f4af006d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:37.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.897+0000 7f4af735f640 1 -- 172.21.15.123:0/1965694259 shutdown_connections 2024-09-15T23:16:37.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.897+0000 7f4af735f640 1 -- 172.21.15.123:0/1965694259 wait complete. 2024-09-15T23:16:37.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.898+0000 7f4af735f640 1 Processor -- start 2024-09-15T23:16:37.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.898+0000 7f4af735f640 1 -- start start 2024-09-15T23:16:37.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.899+0000 7f4af735f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4af006bc10 0x7f4af01f8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:37.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.899+0000 7f4af735f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4af00b3790 0x7f4af015c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:37.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.899+0000 7f4af735f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4af00cef60 0x7f4af00cb630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:37.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.899+0000 7f4af735f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4af00d0f10 con 0x7f4af00b3790 2024-09-15T23:16:37.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.899+0000 7f4af735f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4af00d06f0 con 0x7f4af00cef60 2024-09-15T23:16:37.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.899+0000 7f4af735f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4af00b3bc0 con 0x7f4af006bc10 2024-09-15T23:16:37.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.899+0000 7f4af48fa640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4af00b3790 0x7f4af015c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:37.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.899+0000 7f4af48fa640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4af00b3790 0x7f4af015c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46560/0 (socket says 172.21.15.123:46560) 2024-09-15T23:16:37.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.899+0000 7f4af48fa640 1 -- 172.21.15.123:0/708986543 learned_addr learned my addr 172.21.15.123:0/708986543 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:37.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.899+0000 7f4af50fb640 1 --2- 172.21.15.123:0/708986543 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4af006bc10 0x7f4af01f8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:37.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.899+0000 7f4af58fc640 1 --2- 172.21.15.123:0/708986543 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4af00cef60 0x7f4af00cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:37.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.899+0000 7f4af48fa640 1 -- 172.21.15.123:0/708986543 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4af006bc10 msgr2=0x7f4af01f8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:37.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.899+0000 7f4af48fa640 1 --2- 172.21.15.123:0/708986543 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4af006bc10 0x7f4af01f8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:37.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.899+0000 7f4af48fa640 1 -- 172.21.15.123:0/708986543 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4af00cef60 msgr2=0x7f4af00cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:37.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.899+0000 7f4af48fa640 1 --2- 172.21.15.123:0/708986543 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4af00cef60 0x7f4af00cb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:37.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.899+0000 7f4af48fa640 1 -- 172.21.15.123:0/708986543 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af01f8cb0 con 0x7f4af00b3790 2024-09-15T23:16:37.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.899+0000 7f4af48fa640 1 --2- 172.21.15.123:0/708986543 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4af00b3790 0x7f4af015c1c0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f4ae000c420 tx=0x7f4ae000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:37.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.899+0000 7f4ae5ffb640 1 -- 172.21.15.123:0/708986543 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae00074e0 con 0x7f4af00b3790 2024-09-15T23:16:37.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.900+0000 7f4ae5ffb640 1 -- 172.21.15.123:0/708986543 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae00047e0 con 0x7f4af00b3790 2024-09-15T23:16:37.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.900+0000 7f4af735f640 1 -- 172.21.15.123:0/708986543 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4af00aa5e0 con 0x7f4af00b3790 2024-09-15T23:16:37.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.900+0000 7f4ae5ffb640 1 -- 172.21.15.123:0/708986543 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae0004c10 con 0x7f4af00b3790 2024-09-15T23:16:37.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.900+0000 7f4af735f640 1 -- 172.21.15.123:0/708986543 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4af00aab80 con 0x7f4af00b3790 2024-09-15T23:16:37.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.901+0000 7f4af735f640 1 -- 172.21.15.123:0/708986543 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4af006bff0 con 0x7f4af00b3790 2024-09-15T23:16:37.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.901+0000 7f4ae5ffb640 1 -- 172.21.15.123:0/708986543 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4ae0011070 con 0x7f4af00b3790 2024-09-15T23:16:37.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.901+0000 7f4ae5ffb640 1 --2- 172.21.15.123:0/708986543 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4ad406c2b0 0x7f4ad406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:37.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.902+0000 7f4ae5ffb640 1 -- 172.21.15.123:0/708986543 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5709+0+0 (secure 0 0 0) 0x7f4ae008b000 con 0x7f4af00b3790 2024-09-15T23:16:37.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.902+0000 7f4af50fb640 1 --2- 172.21.15.123:0/708986543 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4ad406c2b0 0x7f4ad406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:37.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.902+0000 7f4af50fb640 1 --2- 172.21.15.123:0/708986543 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4ad406c2b0 0x7f4ad406e770 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4aec034000 tx=0x7f4aec02f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:37.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:37.906+0000 7f4ae5ffb640 1 -- 172.21.15.123:0/708986543 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4af01f8cb0 con 0x7f4af00b3790 2024-09-15T23:16:38.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.107+0000 7f4af735f640 1 -- 172.21.15.123:0/708986543 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4af0072f20 con 0x7f4af00b3790 2024-09-15T23:16:38.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.107+0000 7f4ae5ffb640 1 -- 172.21.15.123:0/708986543 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+5234 (secure 0 0 0) 0x7f4ae000e280 con 0x7f4af00b3790 2024-09-15T23:16:38.109 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:16:38.109 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":59,"btime":"2024-09-15T23:16:37:768064+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7131,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/3875308284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3875308284},{"type":"v1","addr":"172.21.15.123:6834","nonce":3875308284}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":7134,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/799549293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":799549293},{"type":"v1","addr":"172.21.15.123:6835","nonce":799549293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":7146,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2244093297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2244093297},{"type":"v1","addr":"172.21.15.188:6836","nonce":2244093297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:16:35.080780+0000","modified":"2024-09-15T23:16:37.091111+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7149},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7149":{"gid":7149,"name":"b","rank":0,"incarnation":57,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6837/2840550551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2840550551},{"type":"v1","addr":"172.21.15.188:6837","nonce":2840550551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7149,"qdb_cluster":[7149]},"id":6}]} 2024-09-15T23:16:38.109 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 59 2024-09-15T23:16:38.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.109+0000 7f4af735f640 1 -- 172.21.15.123:0/708986543 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4ad406c2b0 msgr2=0x7f4ad406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:38.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.109+0000 7f4af735f640 1 --2- 172.21.15.123:0/708986543 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4ad406c2b0 0x7f4ad406e770 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4aec034000 tx=0x7f4aec02f000 comp rx=0 tx=0).stop 2024-09-15T23:16:38.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.109+0000 7f4af735f640 1 -- 172.21.15.123:0/708986543 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4af00b3790 msgr2=0x7f4af015c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:38.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.109+0000 7f4af735f640 1 --2- 172.21.15.123:0/708986543 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4af00b3790 0x7f4af015c1c0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f4ae000c420 tx=0x7f4ae000c8e0 comp rx=0 tx=0).stop 2024-09-15T23:16:38.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.109+0000 7f4af735f640 1 -- 172.21.15.123:0/708986543 shutdown_connections 2024-09-15T23:16:38.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.109+0000 7f4af735f640 1 --2- 172.21.15.123:0/708986543 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4af00cef60 0x7f4af00cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:38.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.109+0000 7f4af735f640 1 --2- 172.21.15.123:0/708986543 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4ad406c2b0 0x7f4ad406e770 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:38.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.109+0000 7f4af735f640 1 --2- 172.21.15.123:0/708986543 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4af00b3790 0x7f4af015c1c0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:38.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.109+0000 7f4af735f640 1 --2- 172.21.15.123:0/708986543 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4af006bc10 0x7f4af01f8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:38.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.109+0000 7f4af735f640 1 -- 172.21.15.123:0/708986543 >> 172.21.15.123:0/708986543 conn(0x7f4af006cd20 msgr2=0x7f4af00ce0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:38.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.109+0000 7f4af735f640 1 -- 172.21.15.123:0/708986543 shutdown_connections 2024-09-15T23:16:38.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.109+0000 7f4af735f640 1 -- 172.21.15.123:0/708986543 wait complete. 2024-09-15T23:16:38.122 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:16:38.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.219+0000 7f87f0dfd640 1 Processor -- start 2024-09-15T23:16:38.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.219+0000 7f87f0dfd640 1 -- start start 2024-09-15T23:16:38.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.220+0000 7f87f0dfd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f87ec13eb20 0x7f87ec15c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:38.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.220+0000 7f87f0dfd640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87ec071180 con 0x7f87ec0b2d40 2024-09-15T23:16:38.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.220+0000 7f87f0dfd640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87ec071460 con 0x7f87ec06c320 2024-09-15T23:16:38.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.220+0000 7f87f0dfd640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f87ec071ab0 con 0x7f87ec13eb20 2024-09-15T23:16:38.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.220+0000 7f87ead9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f87ec13eb20 0x7f87ec15c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:38.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.220+0000 7f87ead9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f87ec13eb20 0x7f87ec15c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46564/0 (socket says 172.21.15.123:46564) 2024-09-15T23:16:38.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.220+0000 7f87ea59c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f87ec0b2d40 0x7f87ec06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:57224/0 (socket says 172.21.15.123:57224) 2024-09-15T23:16:38.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.220+0000 7f87ead9d640 1 -- 172.21.15.123:0/1390537520 learned_addr learned my addr 172.21.15.123:0/1390537520 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:38.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.220+0000 7f87ead9d640 1 -- 172.21.15.123:0/1390537520 >> v1:172.21.15.188:6789/0 conn(0x7f87ec06c320 legacy=0x7f87ec15bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:38.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.220+0000 7f87ead9d640 1 -- 172.21.15.123:0/1390537520 >> v1:172.21.15.123:6789/0 conn(0x7f87ec0b2d40 legacy=0x7f87ec06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:38.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.220+0000 7f87e9d9b640 1 -- 172.21.15.123:0/1390537520 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 694343602 0 0) 0x7f87ec071180 con 0x7f87ec0b2d40 2024-09-15T23:16:38.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.220+0000 7f87ead9d640 1 -- 172.21.15.123:0/1390537520 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87ec071740 con 0x7f87ec13eb20 2024-09-15T23:16:38.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.221+0000 7f87ead9d640 1 --2- 172.21.15.123:0/1390537520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87ec13eb20 0x7f87ec15c400 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f87e4009e50 tx=0x7f87e402a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9811a2427b235640 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:38.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.221+0000 7f87e9d9b640 1 -- 172.21.15.123:0/1390537520 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e4036070 con 0x7f87ec13eb20 2024-09-15T23:16:38.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.221+0000 7f87e9d9b640 1 -- 172.21.15.123:0/1390537520 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87e4031600 con 0x7f87ec13eb20 2024-09-15T23:16:38.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.221+0000 7f87e9d9b640 1 -- 172.21.15.123:0/1390537520 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e40319d0 con 0x7f87ec13eb20 2024-09-15T23:16:38.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.221+0000 7f87f0dfd640 1 -- 172.21.15.123:0/1390537520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87ec13eb20 msgr2=0x7f87ec15c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:38.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.221+0000 7f87f0dfd640 1 --2- 172.21.15.123:0/1390537520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87ec13eb20 0x7f87ec15c400 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f87e4009e50 tx=0x7f87e402a760 comp rx=0 tx=0).stop 2024-09-15T23:16:38.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.221+0000 7f87f0dfd640 1 -- 172.21.15.123:0/1390537520 shutdown_connections 2024-09-15T23:16:38.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.221+0000 7f87f0dfd640 1 --2- 172.21.15.123:0/1390537520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87ec13eb20 0x7f87ec15c400 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:38.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.221+0000 7f87f0dfd640 1 -- 172.21.15.123:0/1390537520 >> 172.21.15.123:0/1390537520 conn(0x7f87ec0ccec0 msgr2=0x7f87ec0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:38.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.221+0000 7f87f0dfd640 1 -- 172.21.15.123:0/1390537520 shutdown_connections 2024-09-15T23:16:38.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.221+0000 7f87f0dfd640 1 -- 172.21.15.123:0/1390537520 wait complete. 2024-09-15T23:16:38.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.223+0000 7f87f0dfd640 1 Processor -- start 2024-09-15T23:16:38.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.223+0000 7f87f0dfd640 1 -- start start 2024-09-15T23:16:38.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.223+0000 7f87f0dfd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87ec06c320 0x7f87ec165d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:38.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.223+0000 7f87f0dfd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87ec0b2d40 0x7f87ec154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:38.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.224+0000 7f87f0dfd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87ec13eb20 0x7f87ec13d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:38.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.224+0000 7f87f0dfd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f87ec1666e0 con 0x7f87ec13eb20 2024-09-15T23:16:38.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.224+0000 7f87f0dfd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f87ec166560 con 0x7f87ec0b2d40 2024-09-15T23:16:38.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.224+0000 7f87f0dfd640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f87ec166860 con 0x7f87ec06c320 2024-09-15T23:16:38.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.224+0000 7f87ead9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87ec13eb20 0x7f87ec13d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:38.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.224+0000 7f87ead9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87ec13eb20 0x7f87ec13d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46568/0 (socket says 172.21.15.123:46568) 2024-09-15T23:16:38.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.224+0000 7f87ead9d640 1 -- 172.21.15.123:0/1148141840 learned_addr learned my addr 172.21.15.123:0/1148141840 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:38.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.224+0000 7f87ea59c640 1 --2- 172.21.15.123:0/1148141840 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87ec06c320 0x7f87ec165d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:38.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.224+0000 7f87e1d9b640 1 --2- 172.21.15.123:0/1148141840 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87ec0b2d40 0x7f87ec154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:38.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.224+0000 7f87ead9d640 1 -- 172.21.15.123:0/1148141840 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87ec06c320 msgr2=0x7f87ec165d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:38.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.224+0000 7f87ead9d640 1 --2- 172.21.15.123:0/1148141840 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87ec06c320 0x7f87ec165d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:38.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.224+0000 7f87ead9d640 1 -- 172.21.15.123:0/1148141840 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87ec0b2d40 msgr2=0x7f87ec154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:38.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.224+0000 7f87ead9d640 1 --2- 172.21.15.123:0/1148141840 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87ec0b2d40 0x7f87ec154ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:38.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.224+0000 7f87ead9d640 1 -- 172.21.15.123:0/1148141840 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87ec15cb90 con 0x7f87ec13eb20 2024-09-15T23:16:38.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.224+0000 7f87ead9d640 1 --2- 172.21.15.123:0/1148141840 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87ec13eb20 0x7f87ec13d1f0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f87e4034040 tx=0x7f87e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:38.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.224+0000 7f87e37fe640 1 -- 172.21.15.123:0/1148141840 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e4041020 con 0x7f87ec13eb20 2024-09-15T23:16:38.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.224+0000 7f87e37fe640 1 -- 172.21.15.123:0/1148141840 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87e4007780 con 0x7f87ec13eb20 2024-09-15T23:16:38.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.224+0000 7f87f0dfd640 1 -- 172.21.15.123:0/1148141840 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87ec15ce70 con 0x7f87ec13eb20 2024-09-15T23:16:38.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.224+0000 7f87e37fe640 1 -- 172.21.15.123:0/1148141840 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e4036040 con 0x7f87ec13eb20 2024-09-15T23:16:38.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.224+0000 7f87f0dfd640 1 -- 172.21.15.123:0/1148141840 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87ec15d430 con 0x7f87ec13eb20 2024-09-15T23:16:38.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.225+0000 7f87f0dfd640 1 -- 172.21.15.123:0/1148141840 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87ec06bc10 con 0x7f87ec13eb20 2024-09-15T23:16:38.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.226+0000 7f87e37fe640 1 -- 172.21.15.123:0/1148141840 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f87e4044020 con 0x7f87ec13eb20 2024-09-15T23:16:38.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.226+0000 7f87e37fe640 1 --2- 172.21.15.123:0/1148141840 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f87cc06c2b0 0x7f87cc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:38.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.226+0000 7f87e37fe640 1 -- 172.21.15.123:0/1148141840 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5709+0+0 (secure 0 0 0) 0x7f87e40ac020 con 0x7f87ec13eb20 2024-09-15T23:16:38.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.226+0000 7f87ea59c640 1 --2- 172.21.15.123:0/1148141840 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f87cc06c2b0 0x7f87cc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:38.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.227+0000 7f87ea59c640 1 --2- 172.21.15.123:0/1148141840 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f87cc06c2b0 0x7f87cc06e770 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f87dc000f60 tx=0x7f87dc007d50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:38.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.230+0000 7f87e37fe640 1 -- 172.21.15.123:0/1148141840 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f87e404b030 con 0x7f87ec13eb20 2024-09-15T23:16:38.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.396+0000 7f87f0dfd640 1 -- 172.21.15.123:0/1148141840 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f87ec06c9c0 con 0x7f87ec13eb20 2024-09-15T23:16:38.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.397+0000 7f87e37fe640 1 -- 172.21.15.123:0/1148141840 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) ==== 74+0+16756 (secure 0 0 0) 0x7f87e407a200 con 0x7f87ec13eb20 2024-09-15T23:16:38.399 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:16:38.399 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":98,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:16:36.748838+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:16:33.696407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-15T23:16:34.051030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:16:38.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.400+0000 7f87f0dfd640 1 -- 172.21.15.123:0/1148141840 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f87cc06c2b0 msgr2=0x7f87cc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:38.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.400+0000 7f87f0dfd640 1 --2- 172.21.15.123:0/1148141840 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f87cc06c2b0 0x7f87cc06e770 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f87dc000f60 tx=0x7f87dc007d50 comp rx=0 tx=0).stop 2024-09-15T23:16:38.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.400+0000 7f87f0dfd640 1 -- 172.21.15.123:0/1148141840 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87ec13eb20 msgr2=0x7f87ec13d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:38.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.400+0000 7f87f0dfd640 1 --2- 172.21.15.123:0/1148141840 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87ec13eb20 0x7f87ec13d1f0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f87e4034040 tx=0x7f87e4004a40 comp rx=0 tx=0).stop 2024-09-15T23:16:38.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.400+0000 7f87f0dfd640 1 -- 172.21.15.123:0/1148141840 shutdown_connections 2024-09-15T23:16:38.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.400+0000 7f87f0dfd640 1 --2- 172.21.15.123:0/1148141840 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f87cc06c2b0 0x7f87cc06e770 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:38.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.400+0000 7f87f0dfd640 1 --2- 172.21.15.123:0/1148141840 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87ec13eb20 0x7f87ec13d1f0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:38.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.400+0000 7f87f0dfd640 1 --2- 172.21.15.123:0/1148141840 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87ec0b2d40 0x7f87ec154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:38.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.400+0000 7f87f0dfd640 1 --2- 172.21.15.123:0/1148141840 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87ec06c320 0x7f87ec165d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:38.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.400+0000 7f87f0dfd640 1 -- 172.21.15.123:0/1148141840 >> 172.21.15.123:0/1148141840 conn(0x7f87ec0ccec0 msgr2=0x7f87ec157870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:38.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.400+0000 7f87f0dfd640 1 -- 172.21.15.123:0/1148141840 shutdown_connections 2024-09-15T23:16:38.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.400+0000 7f87f0dfd640 1 -- 172.21.15.123:0/1148141840 wait complete. 2024-09-15T23:16:38.412 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T23:16:38.412 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:16:38.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.509+0000 7f66edfa6640 1 Processor -- start 2024-09-15T23:16:38.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.509+0000 7f66edfa6640 1 -- start start 2024-09-15T23:16:38.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.510+0000 7f66edfa6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f66e815e6d0 0x7f66e8071390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:38.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.510+0000 7f66edfa6640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66e815eab0 con 0x7f66e806cd20 2024-09-15T23:16:38.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.510+0000 7f66edfa6640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66e815ed70 con 0x7f66e8070b80 2024-09-15T23:16:38.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.510+0000 7f66edfa6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f66e815f050 con 0x7f66e815e6d0 2024-09-15T23:16:38.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.510+0000 7f66e6ffd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f66e806cd20 0x7f66e80b6d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:57228/0 (socket says 172.21.15.123:57228) 2024-09-15T23:16:38.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.510+0000 7f66e6ffd640 1 -- 172.21.15.123:0/3177914400 learned_addr learned my addr 172.21.15.123:0/3177914400 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:38.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.510+0000 7f66e77fe640 1 --2- 172.21.15.123:0/3177914400 >> v2:172.21.15.188:3300/0 conn(0x7f66e815e6d0 0x7f66e8071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:38.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.510+0000 7f66e67fc640 1 -- 172.21.15.123:0/3177914400 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3739505593 0 0) 0x7f66e815eab0 con 0x7f66e806cd20 2024-09-15T23:16:38.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.510+0000 7f66e67fc640 1 -- 172.21.15.123:0/3177914400 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66d0003520 con 0x7f66e806cd20 2024-09-15T23:16:38.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.510+0000 7f66e67fc640 1 -- 172.21.15.123:0/3177914400 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3419672572 0 0) 0x7f66e815ed70 con 0x7f66e8070b80 2024-09-15T23:16:38.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.510+0000 7f66e67fc640 1 -- 172.21.15.123:0/3177914400 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66e815eab0 con 0x7f66e8070b80 2024-09-15T23:16:38.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.510+0000 7f66e67fc640 1 -- 172.21.15.123:0/3177914400 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1387612781 0 0) 0x7f66d0003520 con 0x7f66e806cd20 2024-09-15T23:16:38.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.510+0000 7f66e67fc640 1 -- 172.21.15.123:0/3177914400 >> v2:172.21.15.188:3300/0 conn(0x7f66e815e6d0 msgr2=0x7f66e8071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:38.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.510+0000 7f66e67fc640 1 --2- 172.21.15.123:0/3177914400 >> v2:172.21.15.188:3300/0 conn(0x7f66e815e6d0 0x7f66e8071390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:38.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.510+0000 7f66e67fc640 1 -- 172.21.15.123:0/3177914400 >> v1:172.21.15.188:6789/0 conn(0x7f66e8070b80 legacy=0x7f66e81622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:38.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.510+0000 7f66e67fc640 1 -- 172.21.15.123:0/3177914400 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66e815f330 con 0x7f66e806cd20 2024-09-15T23:16:38.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.510+0000 7f66e67fc640 1 -- 172.21.15.123:0/3177914400 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f66dc001670 con 0x7f66e806cd20 2024-09-15T23:16:38.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.510+0000 7f66e67fc640 1 -- 172.21.15.123:0/3177914400 >> v1:172.21.15.123:6789/0 conn(0x7f66e806cd20 legacy=0x7f66e80b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:38.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.510+0000 7f66e67fc640 1 --2- 172.21.15.123:0/3177914400 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66d0003b90 0x7f66d0003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:38.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.511+0000 7f66e67fc640 1 --2- 172.21.15.123:0/3177914400 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66d0004800 0x7f66d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:38.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.511+0000 7f66e67fc640 1 --2- 172.21.15.123:0/3177914400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66d00051c0 0x7f66d000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:38.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.511+0000 7f66e67fc640 1 -- 172.21.15.123:0/3177914400 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f66e815f050 con 0x7f66d00051c0 2024-09-15T23:16:38.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.511+0000 7f66e67fc640 1 -- 172.21.15.123:0/3177914400 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f66d000c090 con 0x7f66d0003b90 2024-09-15T23:16:38.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.511+0000 7f66e67fc640 1 -- 172.21.15.123:0/3177914400 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f66d000c290 con 0x7f66d0004800 2024-09-15T23:16:38.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.511+0000 7f66e7fff640 1 --2- 172.21.15.123:0/3177914400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66d00051c0 0x7f66d000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:38.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.511+0000 7f66e77fe640 1 --2- 172.21.15.123:0/3177914400 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66d0003b90 0x7f66d0003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:38.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.511+0000 7f66e6ffd640 1 --2- 172.21.15.123:0/3177914400 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66d0004800 0x7f66d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:38.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.511+0000 7f66e7fff640 1 -- 172.21.15.123:0/3177914400 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66d0004800 msgr2=0x7f66d0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:38.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.511+0000 7f66e7fff640 1 --2- 172.21.15.123:0/3177914400 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66d0004800 0x7f66d0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:38.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.511+0000 7f66e7fff640 1 -- 172.21.15.123:0/3177914400 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66d0003b90 msgr2=0x7f66d0003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:38.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.511+0000 7f66e7fff640 1 --2- 172.21.15.123:0/3177914400 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66d0003b90 0x7f66d0003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:38.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.511+0000 7f66e7fff640 1 -- 172.21.15.123:0/3177914400 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d0003520 con 0x7f66d00051c0 2024-09-15T23:16:38.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.512+0000 7f66e7fff640 1 -- 172.21.15.123:0/3177914400 reap_dead start 2024-09-15T23:16:38.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.512+0000 7f66e7fff640 1 --2- 172.21.15.123:0/3177914400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66d00051c0 0x7f66d000b9c0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f66e0001fd0 tx=0x7f66d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71c39bbf7b3fc0cb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:38.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.512+0000 7f66e67fc640 1 -- 172.21.15.123:0/3177914400 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e0001bf0 con 0x7f66d00051c0 2024-09-15T23:16:38.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.512+0000 7f66e67fc640 1 -- 172.21.15.123:0/3177914400 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66e0003b70 con 0x7f66d00051c0 2024-09-15T23:16:38.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.512+0000 7f66e67fc640 1 -- 172.21.15.123:0/3177914400 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e00050d0 con 0x7f66d00051c0 2024-09-15T23:16:38.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.512+0000 7f66edfa6640 1 -- 172.21.15.123:0/3177914400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66d00051c0 msgr2=0x7f66d000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:38.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.512+0000 7f66edfa6640 1 --2- 172.21.15.123:0/3177914400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66d00051c0 0x7f66d000b9c0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f66e0001fd0 tx=0x7f66d0005830 comp rx=0 tx=0).stop 2024-09-15T23:16:38.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.512+0000 7f66edfa6640 1 -- 172.21.15.123:0/3177914400 shutdown_connections 2024-09-15T23:16:38.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.512+0000 7f66edfa6640 1 --2- 172.21.15.123:0/3177914400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66d00051c0 0x7f66d000b9c0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:38.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.512+0000 7f66edfa6640 1 -- 172.21.15.123:0/3177914400 >> 172.21.15.123:0/3177914400 conn(0x7f66e8067fb0 msgr2=0x7f66e806f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:38.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.512+0000 7f66edfa6640 1 -- 172.21.15.123:0/3177914400 shutdown_connections 2024-09-15T23:16:38.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.512+0000 7f66edfa6640 1 -- 172.21.15.123:0/3177914400 wait complete. 2024-09-15T23:16:38.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.513+0000 7f66edfa6640 1 Processor -- start 2024-09-15T23:16:38.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.514+0000 7f66edfa6640 1 -- start start 2024-09-15T23:16:38.519 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:16:38.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.514+0000 7f66edfa6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66d00051c0 0x7f66e81e9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:38.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.514+0000 7f66edfa6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66e814ce70 0x7f66e814b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:38.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.514+0000 7f66edfa6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66e814c050 0x7f66e80b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:38.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.514+0000 7f66edfa6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f66e8071390 con 0x7f66e814c050 2024-09-15T23:16:38.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.514+0000 7f66edfa6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f66e815f8f0 con 0x7f66d00051c0 2024-09-15T23:16:38.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.514+0000 7f66edfa6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f66e8071510 con 0x7f66e814ce70 2024-09-15T23:16:38.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.514+0000 7f66e7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66e814c050 0x7f66e80b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:38.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.515+0000 7f66e7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66e814c050 0x7f66e80b42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46574/0 (socket says 172.21.15.123:46574) 2024-09-15T23:16:38.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.515+0000 7f66e7fff640 1 -- 172.21.15.123:0/1736406237 learned_addr learned my addr 172.21.15.123:0/1736406237 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:38.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.515+0000 7f66e77fe640 1 --2- 172.21.15.123:0/1736406237 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66d00051c0 0x7f66e81e9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:38.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.515+0000 7f66e6ffd640 1 --2- 172.21.15.123:0/1736406237 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66e814ce70 0x7f66e814b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:38.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.515+0000 7f66e7fff640 1 -- 172.21.15.123:0/1736406237 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66e814ce70 msgr2=0x7f66e814b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:38.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.515+0000 7f66e7fff640 1 --2- 172.21.15.123:0/1736406237 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66e814ce70 0x7f66e814b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:38.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.515+0000 7f66e7fff640 1 -- 172.21.15.123:0/1736406237 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66d00051c0 msgr2=0x7f66e81e9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:38.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.515+0000 7f66e7fff640 1 --2- 172.21.15.123:0/1736406237 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66d00051c0 0x7f66e81e9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:38.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.515+0000 7f66e7fff640 1 -- 172.21.15.123:0/1736406237 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66e814c830 con 0x7f66e814c050 2024-09-15T23:16:38.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.515+0000 7f66e77fe640 1 --2- 172.21.15.123:0/1736406237 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66d00051c0 0x7f66e81e9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:16:38.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.515+0000 7f66e7fff640 1 --2- 172.21.15.123:0/1736406237 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66e814c050 0x7f66e80b42b0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f66e002aab0 tx=0x7f66e0001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:38.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.515+0000 7f66cffff640 1 -- 172.21.15.123:0/1736406237 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e0003970 con 0x7f66e814c050 2024-09-15T23:16:38.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.515+0000 7f66cffff640 1 -- 172.21.15.123:0/1736406237 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66e00052e0 con 0x7f66e814c050 2024-09-15T23:16:38.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.515+0000 7f66cffff640 1 -- 172.21.15.123:0/1736406237 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e00056d0 con 0x7f66e814c050 2024-09-15T23:16:38.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.515+0000 7f66edfa6640 1 -- 172.21.15.123:0/1736406237 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66e81ea420 con 0x7f66e814c050 2024-09-15T23:16:38.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.515+0000 7f66edfa6640 1 -- 172.21.15.123:0/1736406237 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66e81ea9e0 con 0x7f66e814c050 2024-09-15T23:16:38.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.516+0000 7f66edfa6640 1 -- 172.21.15.123:0/1736406237 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66e80718a0 con 0x7f66e814c050 2024-09-15T23:16:38.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.517+0000 7f66cffff640 1 -- 172.21.15.123:0/1736406237 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f66e0039070 con 0x7f66e814c050 2024-09-15T23:16:38.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.517+0000 7f66cffff640 1 --2- 172.21.15.123:0/1736406237 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f66d406c2e0 0x7f66d406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:38.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.517+0000 7f66cffff640 1 -- 172.21.15.123:0/1736406237 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5709+0+0 (secure 0 0 0) 0x7f66e00aa8c0 con 0x7f66e814c050 2024-09-15T23:16:38.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.517+0000 7f66e77fe640 1 --2- 172.21.15.123:0/1736406237 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f66d406c2e0 0x7f66d406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:38.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.518+0000 7f66e77fe640 1 --2- 172.21.15.123:0/1736406237 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f66d406c2e0 0x7f66d406e7a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f66d8009b40 tx=0x7f66d8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:38.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.521+0000 7f66cffff640 1 -- 172.21.15.123:0/1736406237 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f66e0078fa0 con 0x7f66e814c050 2024-09-15T23:16:38.525 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:16:38.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.688+0000 7f66edfa6640 1 -- 172.21.15.123:0/1736406237 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f66e8162d20 con 0x7f66d406c2e0 2024-09-15T23:16:38.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.695+0000 7f66cffff640 1 -- 172.21.15.123:0/1736406237 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243985 (secure 0 0 0) 0x7f66e8162d20 con 0x7f66d406c2e0 2024-09-15T23:16:38.698 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:16:38.699 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:16:38.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.698+0000 7f66edfa6640 1 -- 172.21.15.123:0/1736406237 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f66d406c2e0 msgr2=0x7f66d406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:38.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.698+0000 7f66edfa6640 1 --2- 172.21.15.123:0/1736406237 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f66d406c2e0 0x7f66d406e7a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f66d8009b40 tx=0x7f66d8008040 comp rx=0 tx=0).stop 2024-09-15T23:16:38.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.698+0000 7f66edfa6640 1 -- 172.21.15.123:0/1736406237 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66e814c050 msgr2=0x7f66e80b42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:38.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.698+0000 7f66edfa6640 1 --2- 172.21.15.123:0/1736406237 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66e814c050 0x7f66e80b42b0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f66e002aab0 tx=0x7f66e0001650 comp rx=0 tx=0).stop 2024-09-15T23:16:38.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.698+0000 7f66edfa6640 1 -- 172.21.15.123:0/1736406237 shutdown_connections 2024-09-15T23:16:38.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.698+0000 7f66edfa6640 1 --2- 172.21.15.123:0/1736406237 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f66d406c2e0 0x7f66d406e7a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:38.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.698+0000 7f66edfa6640 1 --2- 172.21.15.123:0/1736406237 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66e814c050 0x7f66e80b42b0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:38.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.698+0000 7f66edfa6640 1 --2- 172.21.15.123:0/1736406237 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66e814ce70 0x7f66e814b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:38.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.698+0000 7f66edfa6640 1 --2- 172.21.15.123:0/1736406237 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f66d00051c0 0x7f66e81e9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:38.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.698+0000 7f66edfa6640 1 -- 172.21.15.123:0/1736406237 >> 172.21.15.123:0/1736406237 conn(0x7f66e8067fb0 msgr2=0x7f66e8161d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:38.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.698+0000 7f66edfa6640 1 -- 172.21.15.123:0/1736406237 shutdown_connections 2024-09-15T23:16:38.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.698+0000 7f66edfa6640 1 -- 172.21.15.123:0/1736406237 wait complete. 2024-09-15T23:16:38.709 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":229,"stamp":"2024-09-15T23:16:37.565063+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":187,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":86,"acting":86,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":47,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":297228,"kb_used_data":10240,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754677492,"statfs":{"total":773094113280,"available":772789751808,"internally_reserved":0,"allocated":10485760,"data_stored":5223384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":293654064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000880"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.773117+0000","last_change":"2024-09-15T23:16:35.771914+0000","last_active":"2024-09-15T23:16:35.773117+0000","last_peered":"2024-09-15T23:16:35.773117+0000","last_clean":"2024-09-15T23:16:35.773117+0000","last_became_active":"2024-09-15T23:16:35.771622+0000","last_became_peered":"2024-09-15T23:16:35.771622+0000","last_unstale":"2024-09-15T23:16:35.773117+0000","last_undegraded":"2024-09-15T23:16:35.773117+0000","last_fullsized":"2024-09-15T23:16:35.773117+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:22:11.059322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.778059+0000","last_change":"2024-09-15T23:16:35.776062+0000","last_active":"2024-09-15T23:16:35.778059+0000","last_peered":"2024-09-15T23:16:35.778059+0000","last_clean":"2024-09-15T23:16:35.778059+0000","last_became_active":"2024-09-15T23:16:35.775769+0000","last_became_peered":"2024-09-15T23:16:35.775769+0000","last_unstale":"2024-09-15T23:16:35.778059+0000","last_undegraded":"2024-09-15T23:16:35.778059+0000","last_fullsized":"2024-09-15T23:16:35.778059+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:38.505005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.765752+0000","last_change":"2024-09-15T23:16:35.763764+0000","last_active":"2024-09-15T23:16:35.765752+0000","last_peered":"2024-09-15T23:16:35.765752+0000","last_clean":"2024-09-15T23:16:35.765752+0000","last_became_active":"2024-09-15T23:16:35.763503+0000","last_became_peered":"2024-09-15T23:16:35.763503+0000","last_unstale":"2024-09-15T23:16:35.765752+0000","last_undegraded":"2024-09-15T23:16:35.765752+0000","last_fullsized":"2024-09-15T23:16:35.765752+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:07:18.485990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.778657+0000","last_change":"2024-09-15T23:16:35.773476+0000","last_active":"2024-09-15T23:16:35.778657+0000","last_peered":"2024-09-15T23:16:35.778657+0000","last_clean":"2024-09-15T23:16:35.778657+0000","last_became_active":"2024-09-15T23:16:35.773179+0000","last_became_peered":"2024-09-15T23:16:35.773179+0000","last_unstale":"2024-09-15T23:16:35.778657+0000","last_undegraded":"2024-09-15T23:16:35.778657+0000","last_fullsized":"2024-09-15T23:16:35.778657+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:44.282467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.771688+0000","last_change":"2024-09-15T23:16:35.770221+0000","last_active":"2024-09-15T23:16:35.771688+0000","last_peered":"2024-09-15T23:16:35.771688+0000","last_clean":"2024-09-15T23:16:35.771688+0000","last_became_active":"2024-09-15T23:16:35.769976+0000","last_became_peered":"2024-09-15T23:16:35.769976+0000","last_unstale":"2024-09-15T23:16:35.771688+0000","last_undegraded":"2024-09-15T23:16:35.771688+0000","last_fullsized":"2024-09-15T23:16:35.771688+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:49:41.912501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.774690+0000","last_change":"2024-09-15T23:16:35.772327+0000","last_active":"2024-09-15T23:16:35.774690+0000","last_peered":"2024-09-15T23:16:35.774690+0000","last_clean":"2024-09-15T23:16:35.774690+0000","last_became_active":"2024-09-15T23:16:35.772066+0000","last_became_peered":"2024-09-15T23:16:35.772066+0000","last_unstale":"2024-09-15T23:16:35.774690+0000","last_undegraded":"2024-09-15T23:16:35.774690+0000","last_fullsized":"2024-09-15T23:16:35.774690+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:51.344866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.778039+0000","last_change":"2024-09-15T23:16:35.777304+0000","last_active":"2024-09-15T23:16:35.778039+0000","last_peered":"2024-09-15T23:16:35.778039+0000","last_clean":"2024-09-15T23:16:35.778039+0000","last_became_active":"2024-09-15T23:16:35.777034+0000","last_became_peered":"2024-09-15T23:16:35.777034+0000","last_unstale":"2024-09-15T23:16:35.778039+0000","last_undegraded":"2024-09-15T23:16:35.778039+0000","last_fullsized":"2024-09-15T23:16:35.778039+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:03.652263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.770606+0000","last_change":"2024-09-15T23:16:35.769413+0000","last_active":"2024-09-15T23:16:35.770606+0000","last_peered":"2024-09-15T23:16:35.770606+0000","last_clean":"2024-09-15T23:16:35.770606+0000","last_became_active":"2024-09-15T23:16:35.769094+0000","last_became_peered":"2024-09-15T23:16:35.769094+0000","last_unstale":"2024-09-15T23:16:35.770606+0000","last_undegraded":"2024-09-15T23:16:35.770606+0000","last_fullsized":"2024-09-15T23:16:35.770606+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:41.759033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.778820+0000","last_change":"2024-09-15T23:16:35.778170+0000","last_active":"2024-09-15T23:16:35.778820+0000","last_peered":"2024-09-15T23:16:35.778820+0000","last_clean":"2024-09-15T23:16:35.778820+0000","last_became_active":"2024-09-15T23:16:35.777298+0000","last_became_peered":"2024-09-15T23:16:35.777298+0000","last_unstale":"2024-09-15T23:16:35.778820+0000","last_undegraded":"2024-09-15T23:16:35.778820+0000","last_fullsized":"2024-09-15T23:16:35.778820+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:05:53.779144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.774573+0000","last_change":"2024-09-15T23:16:35.771684+0000","last_active":"2024-09-15T23:16:35.774573+0000","last_peered":"2024-09-15T23:16:35.774573+0000","last_clean":"2024-09-15T23:16:35.774573+0000","last_became_active":"2024-09-15T23:16:35.771290+0000","last_became_peered":"2024-09-15T23:16:35.771290+0000","last_unstale":"2024-09-15T23:16:35.774573+0000","last_undegraded":"2024-09-15T23:16:35.774573+0000","last_fullsized":"2024-09-15T23:16:35.774573+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:02.475226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.759797+0000","last_change":"2024-09-15T23:16:35.756737+0000","last_active":"2024-09-15T23:16:35.759797+0000","last_peered":"2024-09-15T23:16:35.759797+0000","last_clean":"2024-09-15T23:16:35.759797+0000","last_became_active":"2024-09-15T23:16:35.756446+0000","last_became_peered":"2024-09-15T23:16:35.756446+0000","last_unstale":"2024-09-15T23:16:35.759797+0000","last_undegraded":"2024-09-15T23:16:35.759797+0000","last_fullsized":"2024-09-15T23:16:35.759797+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:39.354753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.775973+0000","last_change":"2024-09-15T23:16:35.769734+0000","last_active":"2024-09-15T23:16:35.775973+0000","last_peered":"2024-09-15T23:16:35.775973+0000","last_clean":"2024-09-15T23:16:35.775973+0000","last_became_active":"2024-09-15T23:16:35.767578+0000","last_became_peered":"2024-09-15T23:16:35.767578+0000","last_unstale":"2024-09-15T23:16:35.775973+0000","last_undegraded":"2024-09-15T23:16:35.775973+0000","last_fullsized":"2024-09-15T23:16:35.775973+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:49.711543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.776568+0000","last_change":"2024-09-15T23:16:35.769074+0000","last_active":"2024-09-15T23:16:35.776568+0000","last_peered":"2024-09-15T23:16:35.776568+0000","last_clean":"2024-09-15T23:16:35.776568+0000","last_became_active":"2024-09-15T23:16:35.766732+0000","last_became_peered":"2024-09-15T23:16:35.766732+0000","last_unstale":"2024-09-15T23:16:35.776568+0000","last_undegraded":"2024-09-15T23:16:35.776568+0000","last_fullsized":"2024-09-15T23:16:35.776568+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:07:56.105249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.774070+0000","last_change":"2024-09-15T23:16:35.770923+0000","last_active":"2024-09-15T23:16:35.774070+0000","last_peered":"2024-09-15T23:16:35.774070+0000","last_clean":"2024-09-15T23:16:35.774070+0000","last_became_active":"2024-09-15T23:16:35.770571+0000","last_became_peered":"2024-09-15T23:16:35.770571+0000","last_unstale":"2024-09-15T23:16:35.774070+0000","last_undegraded":"2024-09-15T23:16:35.774070+0000","last_fullsized":"2024-09-15T23:16:35.774070+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:53:28.010064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.771666+0000","last_change":"2024-09-15T23:16:35.769677+0000","last_active":"2024-09-15T23:16:35.771666+0000","last_peered":"2024-09-15T23:16:35.771666+0000","last_clean":"2024-09-15T23:16:35.771666+0000","last_became_active":"2024-09-15T23:16:35.769124+0000","last_became_peered":"2024-09-15T23:16:35.769124+0000","last_unstale":"2024-09-15T23:16:35.771666+0000","last_undegraded":"2024-09-15T23:16:35.771666+0000","last_fullsized":"2024-09-15T23:16:35.771666+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:16:33.252218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.774005+0000","last_change":"2024-09-15T23:16:34.758559+0000","last_active":"2024-09-15T23:16:35.774005+0000","last_peered":"2024-09-15T23:16:35.774005+0000","last_clean":"2024-09-15T23:16:35.774005+0000","last_became_active":"2024-09-15T23:16:34.757938+0000","last_became_peered":"2024-09-15T23:16:34.757938+0000","last_unstale":"2024-09-15T23:16:35.774005+0000","last_undegraded":"2024-09-15T23:16:35.774005+0000","last_fullsized":"2024-09-15T23:16:35.774005+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:32:40.873218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.779693+0000","last_change":"2024-09-15T23:16:34.753714+0000","last_active":"2024-09-15T23:16:35.779693+0000","last_peered":"2024-09-15T23:16:35.779693+0000","last_clean":"2024-09-15T23:16:35.779693+0000","last_became_active":"2024-09-15T23:16:34.753394+0000","last_became_peered":"2024-09-15T23:16:34.753394+0000","last_unstale":"2024-09-15T23:16:35.779693+0000","last_undegraded":"2024-09-15T23:16:35.779693+0000","last_fullsized":"2024-09-15T23:16:35.779693+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:17.679671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.779964+0000","last_change":"2024-09-15T23:16:35.779140+0000","last_active":"2024-09-15T23:16:35.779964+0000","last_peered":"2024-09-15T23:16:35.779964+0000","last_clean":"2024-09-15T23:16:35.779964+0000","last_became_active":"2024-09-15T23:16:35.777178+0000","last_became_peered":"2024-09-15T23:16:35.777178+0000","last_unstale":"2024-09-15T23:16:35.779964+0000","last_undegraded":"2024-09-15T23:16:35.779964+0000","last_fullsized":"2024-09-15T23:16:35.779964+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:59.282013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.753198+0000","last_change":"2024-09-15T23:16:34.754647+0000","last_active":"2024-09-15T23:16:35.753198+0000","last_peered":"2024-09-15T23:16:35.753198+0000","last_clean":"2024-09-15T23:16:35.753198+0000","last_became_active":"2024-09-15T23:16:34.754348+0000","last_became_peered":"2024-09-15T23:16:34.754348+0000","last_unstale":"2024-09-15T23:16:35.753198+0000","last_undegraded":"2024-09-15T23:16:35.753198+0000","last_fullsized":"2024-09-15T23:16:35.753198+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:40.263650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.766047+0000","last_change":"2024-09-15T23:16:35.762911+0000","last_active":"2024-09-15T23:16:35.766047+0000","last_peered":"2024-09-15T23:16:35.766047+0000","last_clean":"2024-09-15T23:16:35.766047+0000","last_became_active":"2024-09-15T23:16:35.762046+0000","last_became_peered":"2024-09-15T23:16:35.762046+0000","last_unstale":"2024-09-15T23:16:35.766047+0000","last_undegraded":"2024-09-15T23:16:35.766047+0000","last_fullsized":"2024-09-15T23:16:35.766047+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:51:33.627499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.753068+0000","last_change":"2024-09-15T23:16:34.757604+0000","last_active":"2024-09-15T23:16:35.753068+0000","last_peered":"2024-09-15T23:16:35.753068+0000","last_clean":"2024-09-15T23:16:35.753068+0000","last_became_active":"2024-09-15T23:16:34.757332+0000","last_became_peered":"2024-09-15T23:16:34.757332+0000","last_unstale":"2024-09-15T23:16:35.753068+0000","last_undegraded":"2024-09-15T23:16:35.753068+0000","last_fullsized":"2024-09-15T23:16:35.753068+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:17:52.432695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.770633+0000","last_change":"2024-09-15T23:16:35.768029+0000","last_active":"2024-09-15T23:16:35.770633+0000","last_peered":"2024-09-15T23:16:35.770633+0000","last_clean":"2024-09-15T23:16:35.770633+0000","last_became_active":"2024-09-15T23:16:35.767759+0000","last_became_peered":"2024-09-15T23:16:35.767759+0000","last_unstale":"2024-09-15T23:16:35.770633+0000","last_undegraded":"2024-09-15T23:16:35.770633+0000","last_fullsized":"2024-09-15T23:16:35.770633+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:18.266560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.776244+0000","last_change":"2024-09-15T23:16:35.768727+0000","last_active":"2024-09-15T23:16:35.776244+0000","last_peered":"2024-09-15T23:16:35.776244+0000","last_clean":"2024-09-15T23:16:35.776244+0000","last_became_active":"2024-09-15T23:16:35.768122+0000","last_became_peered":"2024-09-15T23:16:35.768122+0000","last_unstale":"2024-09-15T23:16:35.776244+0000","last_undegraded":"2024-09-15T23:16:35.776244+0000","last_fullsized":"2024-09-15T23:16:35.776244+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:28:48.387265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.776045+0000","last_change":"2024-09-15T23:16:35.766409+0000","last_active":"2024-09-15T23:16:35.776045+0000","last_peered":"2024-09-15T23:16:35.776045+0000","last_clean":"2024-09-15T23:16:35.776045+0000","last_became_active":"2024-09-15T23:16:35.766132+0000","last_became_peered":"2024-09-15T23:16:35.766132+0000","last_unstale":"2024-09-15T23:16:35.776045+0000","last_undegraded":"2024-09-15T23:16:35.776045+0000","last_fullsized":"2024-09-15T23:16:35.776045+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:47.333764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.776218+0000","last_change":"2024-09-15T23:16:34.759842+0000","last_active":"2024-09-15T23:16:35.776218+0000","last_peered":"2024-09-15T23:16:35.776218+0000","last_clean":"2024-09-15T23:16:35.776218+0000","last_became_active":"2024-09-15T23:16:34.759564+0000","last_became_peered":"2024-09-15T23:16:34.759564+0000","last_unstale":"2024-09-15T23:16:35.776218+0000","last_undegraded":"2024-09-15T23:16:35.776218+0000","last_fullsized":"2024-09-15T23:16:35.776218+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:05.285912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.753048+0000","last_change":"2024-09-15T23:16:34.757740+0000","last_active":"2024-09-15T23:16:35.753048+0000","last_peered":"2024-09-15T23:16:35.753048+0000","last_clean":"2024-09-15T23:16:35.753048+0000","last_became_active":"2024-09-15T23:16:34.757307+0000","last_became_peered":"2024-09-15T23:16:34.757307+0000","last_unstale":"2024-09-15T23:16:35.753048+0000","last_undegraded":"2024-09-15T23:16:35.753048+0000","last_fullsized":"2024-09-15T23:16:35.753048+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:30.211666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.775421+0000","last_change":"2024-09-15T23:16:35.773222+0000","last_active":"2024-09-15T23:16:35.775421+0000","last_peered":"2024-09-15T23:16:35.775421+0000","last_clean":"2024-09-15T23:16:35.775421+0000","last_became_active":"2024-09-15T23:16:35.772920+0000","last_became_peered":"2024-09-15T23:16:35.772920+0000","last_unstale":"2024-09-15T23:16:35.775421+0000","last_undegraded":"2024-09-15T23:16:35.775421+0000","last_fullsized":"2024-09-15T23:16:35.775421+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:07.690414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.777091+0000","last_change":"2024-09-15T23:16:35.766539+0000","last_active":"2024-09-15T23:16:35.777091+0000","last_peered":"2024-09-15T23:16:35.777091+0000","last_clean":"2024-09-15T23:16:35.777091+0000","last_became_active":"2024-09-15T23:16:35.766275+0000","last_became_peered":"2024-09-15T23:16:35.766275+0000","last_unstale":"2024-09-15T23:16:35.777091+0000","last_undegraded":"2024-09-15T23:16:35.777091+0000","last_fullsized":"2024-09-15T23:16:35.777091+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:37.401188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"97'8","reported_seq":20,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.775599+0000","last_change":"2024-09-15T23:16:34.761125+0000","last_active":"2024-09-15T23:16:35.775599+0000","last_peered":"2024-09-15T23:16:35.775599+0000","last_clean":"2024-09-15T23:16:35.775599+0000","last_became_active":"2024-09-15T23:16:34.760875+0000","last_became_peered":"2024-09-15T23:16:34.760875+0000","last_unstale":"2024-09-15T23:16:35.775599+0000","last_undegraded":"2024-09-15T23:16:35.775599+0000","last_fullsized":"2024-09-15T23:16:35.775599+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:24:28.230255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.775278+0000","last_change":"2024-09-15T23:16:34.756814+0000","last_active":"2024-09-15T23:16:35.775278+0000","last_peered":"2024-09-15T23:16:35.775278+0000","last_clean":"2024-09-15T23:16:35.775278+0000","last_became_active":"2024-09-15T23:16:34.755902+0000","last_became_peered":"2024-09-15T23:16:34.755902+0000","last_unstale":"2024-09-15T23:16:35.775278+0000","last_undegraded":"2024-09-15T23:16:35.775278+0000","last_fullsized":"2024-09-15T23:16:35.775278+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:21.905853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.752863+0000","last_change":"2024-09-15T23:16:34.760013+0000","last_active":"2024-09-15T23:16:35.752863+0000","last_peered":"2024-09-15T23:16:35.752863+0000","last_clean":"2024-09-15T23:16:35.752863+0000","last_became_active":"2024-09-15T23:16:34.759697+0000","last_became_peered":"2024-09-15T23:16:34.759697+0000","last_unstale":"2024-09-15T23:16:35.752863+0000","last_undegraded":"2024-09-15T23:16:35.752863+0000","last_fullsized":"2024-09-15T23:16:35.752863+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:44.346565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.773234+0000","last_change":"2024-09-15T23:16:35.770304+0000","last_active":"2024-09-15T23:16:35.773234+0000","last_peered":"2024-09-15T23:16:35.773234+0000","last_clean":"2024-09-15T23:16:35.773234+0000","last_became_active":"2024-09-15T23:16:35.769929+0000","last_became_peered":"2024-09-15T23:16:35.769929+0000","last_unstale":"2024-09-15T23:16:35.773234+0000","last_undegraded":"2024-09-15T23:16:35.773234+0000","last_fullsized":"2024-09-15T23:16:35.773234+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:44.316822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.773360+0000","last_change":"2024-09-15T23:16:34.760353+0000","last_active":"2024-09-15T23:16:35.773360+0000","last_peered":"2024-09-15T23:16:35.773360+0000","last_clean":"2024-09-15T23:16:35.773360+0000","last_became_active":"2024-09-15T23:16:34.760092+0000","last_became_peered":"2024-09-15T23:16:34.760092+0000","last_unstale":"2024-09-15T23:16:35.773360+0000","last_undegraded":"2024-09-15T23:16:35.773360+0000","last_fullsized":"2024-09-15T23:16:35.773360+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:58:41.895104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.753048+0000","last_change":"2024-09-15T23:16:34.757928+0000","last_active":"2024-09-15T23:16:35.753048+0000","last_peered":"2024-09-15T23:16:35.753048+0000","last_clean":"2024-09-15T23:16:35.753048+0000","last_became_active":"2024-09-15T23:16:34.757648+0000","last_became_peered":"2024-09-15T23:16:34.757648+0000","last_unstale":"2024-09-15T23:16:35.753048+0000","last_undegraded":"2024-09-15T23:16:35.753048+0000","last_fullsized":"2024-09-15T23:16:35.753048+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:00.288336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.774566+0000","last_change":"2024-09-15T23:16:35.770911+0000","last_active":"2024-09-15T23:16:35.774566+0000","last_peered":"2024-09-15T23:16:35.774566+0000","last_clean":"2024-09-15T23:16:35.774566+0000","last_became_active":"2024-09-15T23:16:35.770620+0000","last_became_peered":"2024-09-15T23:16:35.770620+0000","last_unstale":"2024-09-15T23:16:35.774566+0000","last_undegraded":"2024-09-15T23:16:35.774566+0000","last_fullsized":"2024-09-15T23:16:35.774566+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:45.455400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.757278+0000","last_change":"2024-09-15T23:16:34.755273+0000","last_active":"2024-09-15T23:16:35.757278+0000","last_peered":"2024-09-15T23:16:35.757278+0000","last_clean":"2024-09-15T23:16:35.757278+0000","last_became_active":"2024-09-15T23:16:34.754300+0000","last_became_peered":"2024-09-15T23:16:34.754300+0000","last_unstale":"2024-09-15T23:16:35.757278+0000","last_undegraded":"2024-09-15T23:16:35.757278+0000","last_fullsized":"2024-09-15T23:16:35.757278+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:28.685685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.753258+0000","last_change":"2024-09-15T23:16:34.760017+0000","last_active":"2024-09-15T23:16:35.753258+0000","last_peered":"2024-09-15T23:16:35.753258+0000","last_clean":"2024-09-15T23:16:35.753258+0000","last_became_active":"2024-09-15T23:16:34.759429+0000","last_became_peered":"2024-09-15T23:16:34.759429+0000","last_unstale":"2024-09-15T23:16:35.753258+0000","last_undegraded":"2024-09-15T23:16:35.753258+0000","last_fullsized":"2024-09-15T23:16:35.753258+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:53:35.052932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.775667+0000","last_change":"2024-09-15T23:16:34.757623+0000","last_active":"2024-09-15T23:16:35.775667+0000","last_peered":"2024-09-15T23:16:35.775667+0000","last_clean":"2024-09-15T23:16:35.775667+0000","last_became_active":"2024-09-15T23:16:34.757259+0000","last_became_peered":"2024-09-15T23:16:34.757259+0000","last_unstale":"2024-09-15T23:16:35.775667+0000","last_undegraded":"2024-09-15T23:16:35.775667+0000","last_fullsized":"2024-09-15T23:16:35.775667+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:34.782116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.759608+0000","last_change":"2024-09-15T23:16:34.760115+0000","last_active":"2024-09-15T23:16:35.759608+0000","last_peered":"2024-09-15T23:16:35.759608+0000","last_clean":"2024-09-15T23:16:35.759608+0000","last_became_active":"2024-09-15T23:16:34.759725+0000","last_became_peered":"2024-09-15T23:16:34.759725+0000","last_unstale":"2024-09-15T23:16:35.759608+0000","last_undegraded":"2024-09-15T23:16:35.759608+0000","last_fullsized":"2024-09-15T23:16:35.759608+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:14.836727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.752566+0000","last_change":"2024-09-15T23:16:34.757464+0000","last_active":"2024-09-15T23:16:35.752566+0000","last_peered":"2024-09-15T23:16:35.752566+0000","last_clean":"2024-09-15T23:16:35.752566+0000","last_became_active":"2024-09-15T23:16:34.757190+0000","last_became_peered":"2024-09-15T23:16:34.757190+0000","last_unstale":"2024-09-15T23:16:35.752566+0000","last_undegraded":"2024-09-15T23:16:35.752566+0000","last_fullsized":"2024-09-15T23:16:35.752566+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:24.571810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.775735+0000","last_change":"2024-09-15T23:16:35.767564+0000","last_active":"2024-09-15T23:16:35.775735+0000","last_peered":"2024-09-15T23:16:35.775735+0000","last_clean":"2024-09-15T23:16:35.775735+0000","last_became_active":"2024-09-15T23:16:35.767284+0000","last_became_peered":"2024-09-15T23:16:35.767284+0000","last_unstale":"2024-09-15T23:16:35.775735+0000","last_undegraded":"2024-09-15T23:16:35.775735+0000","last_fullsized":"2024-09-15T23:16:35.775735+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:52.495611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.776267+0000","last_change":"2024-09-15T23:16:35.769591+0000","last_active":"2024-09-15T23:16:35.776267+0000","last_peered":"2024-09-15T23:16:35.776267+0000","last_clean":"2024-09-15T23:16:35.776267+0000","last_became_active":"2024-09-15T23:16:35.769282+0000","last_became_peered":"2024-09-15T23:16:35.769282+0000","last_unstale":"2024-09-15T23:16:35.776267+0000","last_undegraded":"2024-09-15T23:16:35.776267+0000","last_fullsized":"2024-09-15T23:16:35.776267+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:06:59.030627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":301,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-15T23:16:31.728381+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:16:31.728381+0000","last_peered":"2024-09-15T23:16:31.728381+0000","last_clean":"2024-09-15T23:16:31.728381+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:16:31.728381+0000","last_undegraded":"2024-09-15T23:16:31.728381+0000","last_fullsized":"2024-09-15T23:16:31.728381+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":52,"acting":52,"num_store_stats":4},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":32,"acting":32,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476796,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40640,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331200,"statfs":{"total":96636764160,"available":96595148800,"internally_reserved":0,"allocated":1142784,"data_stored":496929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476793,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40612,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331228,"statfs":{"total":96636764160,"available":96595177472,"internally_reserved":0,"allocated":1130496,"data_stored":491592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476795,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37036,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334804,"statfs":{"total":96636764160,"available":96598839296,"internally_reserved":0,"allocated":1724416,"data_stored":1081960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476795,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32316,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339524,"statfs":{"total":96636764160,"available":96603672576,"internally_reserved":0,"allocated":1142784,"data_stored":496929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542202,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36504,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335336,"statfs":{"total":96636764160,"available":96599384064,"internally_reserved":0,"allocated":1183744,"data_stored":515866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542202,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36508,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335332,"statfs":{"total":96636764160,"available":96599379968,"internally_reserved":0,"allocated":1187840,"data_stored":516468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542201,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37096,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334744,"statfs":{"total":96636764160,"available":96598777856,"internally_reserved":0,"allocated":1789952,"data_stored":1107810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542203,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36516,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335324,"statfs":{"total":96636764160,"available":96599371776,"internally_reserved":0,"allocated":1183744,"data_stored":515830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:16:38.714 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:16:38.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.847+0000 7f547ae4c640 1 Processor -- start 2024-09-15T23:16:38.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.847+0000 7f547ae4c640 1 -- start start 2024-09-15T23:16:38.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.847+0000 7f547ae4c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f547415ed20 0x7f54740b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:38.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.847+0000 7f547ae4c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54740b90e0 0x7f54740b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:38.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.847+0000 7f547ae4c640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54740d0e70 con 0x7f54740d23b0 2024-09-15T23:16:38.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.847+0000 7f547ae4c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f54740d41c0 con 0x7f547415ed20 2024-09-15T23:16:38.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.847+0000 7f547ae4c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f54740d35b0 con 0x7f54740b90e0 2024-09-15T23:16:38.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.848+0000 7f5473fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f54740d23b0 0x7f54740cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:57230/0 (socket says 172.21.15.123:57230) 2024-09-15T23:16:38.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.848+0000 7f5473fff640 1 -- 172.21.15.123:0/243789018 learned_addr learned my addr 172.21.15.123:0/243789018 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:38.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.848+0000 7f54737fe640 1 -- 172.21.15.123:0/243789018 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3557650464 0 0) 0x7f5464001490 con 0x7f54740d23b0 2024-09-15T23:16:38.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.848+0000 7f54737fe640 1 -- 172.21.15.123:0/243789018 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5460003520 con 0x7f54740d23b0 2024-09-15T23:16:38.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.848+0000 7f54793e9640 1 --2- 172.21.15.123:0/243789018 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54740b90e0 0x7f54740b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:38.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.848+0000 7f5478be8640 1 --2- 172.21.15.123:0/243789018 >> v2:172.21.15.188:3300/0 conn(0x7f547415ed20 0x7f54740b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:38.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.848+0000 7f54737fe640 1 -- 172.21.15.123:0/243789018 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3771347491 0 0) 0x7f5460003520 con 0x7f54740d23b0 2024-09-15T23:16:38.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.848+0000 7f54737fe640 1 -- 172.21.15.123:0/243789018 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54740b90e0 msgr2=0x7f54740b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:38.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.848+0000 7f54737fe640 1 --2- 172.21.15.123:0/243789018 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54740b90e0 0x7f54740b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:38.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.848+0000 7f54737fe640 1 -- 172.21.15.123:0/243789018 >> v2:172.21.15.188:3300/0 conn(0x7f547415ed20 msgr2=0x7f54740b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:38.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.848+0000 7f54737fe640 1 --2- 172.21.15.123:0/243789018 >> v2:172.21.15.188:3300/0 conn(0x7f547415ed20 0x7f54740b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:38.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.848+0000 7f54737fe640 1 -- 172.21.15.123:0/243789018 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54740d3890 con 0x7f54740d23b0 2024-09-15T23:16:38.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.848+0000 7f54737fe640 1 -- 172.21.15.123:0/243789018 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f5464001bc0 con 0x7f54740d23b0 2024-09-15T23:16:38.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.848+0000 7f54737fe640 1 -- 172.21.15.123:0/243789018 >> v1:172.21.15.123:6789/0 conn(0x7f54740d23b0 legacy=0x7f54740cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:38.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.848+0000 7f54737fe640 1 --2- 172.21.15.123:0/243789018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54600039b0 0x7f5460003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:38.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.848+0000 7f54737fe640 1 --2- 172.21.15.123:0/243789018 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5460004800 0x7f5460004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:38.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.848+0000 7f54737fe640 1 --2- 172.21.15.123:0/243789018 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54740b90e0 0x7f54600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:38.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.848+0000 7f54737fe640 1 -- 172.21.15.123:0/243789018 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f54740d41c0 con 0x7f54600039b0 2024-09-15T23:16:38.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.848+0000 7f54737fe640 1 -- 172.21.15.123:0/243789018 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f54740d35b0 con 0x7f5460004800 2024-09-15T23:16:38.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.848+0000 7f54737fe640 1 -- 172.21.15.123:0/243789018 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f546000bb20 con 0x7f54740b90e0 2024-09-15T23:16:38.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.848+0000 7f5478be8640 1 --2- 172.21.15.123:0/243789018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54600039b0 0x7f5460003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:38.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.848+0000 7f5473fff640 1 --2- 172.21.15.123:0/243789018 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5460004800 0x7f5460004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:38.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.848+0000 7f54793e9640 1 --2- 172.21.15.123:0/243789018 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54740b90e0 0x7f54600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:38.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.848+0000 7f5478be8640 1 -- 172.21.15.123:0/243789018 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54740b90e0 msgr2=0x7f54600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:38.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.848+0000 7f5478be8640 1 --2- 172.21.15.123:0/243789018 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54740b90e0 0x7f54600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:38.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.848+0000 7f5478be8640 1 -- 172.21.15.123:0/243789018 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5460004800 msgr2=0x7f5460004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:38.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.848+0000 7f5478be8640 1 --2- 172.21.15.123:0/243789018 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5460004800 0x7f5460004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:38.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.848+0000 7f5478be8640 1 -- 172.21.15.123:0/243789018 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5460003520 con 0x7f54600039b0 2024-09-15T23:16:38.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.849+0000 7f5478be8640 1 --2- 172.21.15.123:0/243789018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54600039b0 0x7f5460003dd0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f545c00ba00 tx=0x7f5460005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd92ad26fb0465a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:38.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.849+0000 7f54737fe640 1 -- 172.21.15.123:0/243789018 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545c030070 con 0x7f54600039b0 2024-09-15T23:16:38.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.849+0000 7f54737fe640 1 -- 172.21.15.123:0/243789018 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f545c02adb0 con 0x7f54600039b0 2024-09-15T23:16:38.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.849+0000 7f54737fe640 1 -- 172.21.15.123:0/243789018 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545c00b600 con 0x7f54600039b0 2024-09-15T23:16:38.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.850+0000 7f547ae4c640 1 -- 172.21.15.123:0/243789018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54600039b0 msgr2=0x7f5460003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:38.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.850+0000 7f547ae4c640 1 --2- 172.21.15.123:0/243789018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54600039b0 0x7f5460003dd0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f545c00ba00 tx=0x7f5460005830 comp rx=0 tx=0).stop 2024-09-15T23:16:38.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.850+0000 7f54793e9640 1 -- 172.21.15.123:0/243789018 reap_dead start 2024-09-15T23:16:38.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.850+0000 7f547ae4c640 1 -- 172.21.15.123:0/243789018 shutdown_connections 2024-09-15T23:16:38.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.850+0000 7f547ae4c640 1 -- 172.21.15.123:0/243789018 >> 172.21.15.123:0/243789018 conn(0x7f54740d1260 msgr2=0x7f54740d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:38.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.850+0000 7f547ae4c640 1 -- 172.21.15.123:0/243789018 shutdown_connections 2024-09-15T23:16:38.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.850+0000 7f547ae4c640 1 -- 172.21.15.123:0/243789018 wait complete. 2024-09-15T23:16:38.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.851+0000 7f547ae4c640 1 Processor -- start 2024-09-15T23:16:38.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.851+0000 7f547ae4c640 1 -- start start 2024-09-15T23:16:38.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.852+0000 7f547ae4c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54600039b0 0x7f547414ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:38.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.852+0000 7f547ae4c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f54740ca5c0 0x7f547414a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:38.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.852+0000 7f547ae4c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f547414c4a0 0x7f54740cc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:38.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.852+0000 7f547ae4c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f54740d32a0 con 0x7f547414c4a0 2024-09-15T23:16:38.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.852+0000 7f547ae4c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f54740d3e50 con 0x7f54740ca5c0 2024-09-15T23:16:38.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.852+0000 7f547ae4c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f547415f100 con 0x7f54600039b0 2024-09-15T23:16:38.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.852+0000 7f54793e9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f547414c4a0 0x7f54740cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:38.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.852+0000 7f54793e9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f547414c4a0 0x7f54740cc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46592/0 (socket says 172.21.15.123:46592) 2024-09-15T23:16:38.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.852+0000 7f54793e9640 1 -- 172.21.15.123:0/3635803335 learned_addr learned my addr 172.21.15.123:0/3635803335 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:38.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.852+0000 7f5478be8640 1 --2- 172.21.15.123:0/3635803335 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54600039b0 0x7f547414ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:38.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.852+0000 7f54793e9640 1 -- 172.21.15.123:0/3635803335 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54600039b0 msgr2=0x7f547414ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:38.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.852+0000 7f54793e9640 1 --2- 172.21.15.123:0/3635803335 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54600039b0 0x7f547414ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:38.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.852+0000 7f54793e9640 1 -- 172.21.15.123:0/3635803335 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f54740ca5c0 msgr2=0x7f547414a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:38.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.852+0000 7f5473fff640 1 --2- 172.21.15.123:0/3635803335 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f54740ca5c0 0x7f547414a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:38.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.852+0000 7f54793e9640 1 --2- 172.21.15.123:0/3635803335 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f54740ca5c0 0x7f547414a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:38.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.852+0000 7f54793e9640 1 -- 172.21.15.123:0/3635803335 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f547414b400 con 0x7f547414c4a0 2024-09-15T23:16:38.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.853+0000 7f54793e9640 1 --2- 172.21.15.123:0/3635803335 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f547414c4a0 0x7f54740cc230 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f546c006fd0 tx=0x7f546c00f8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:38.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.853+0000 7f54717fa640 1 -- 172.21.15.123:0/3635803335 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c004440 con 0x7f547414c4a0 2024-09-15T23:16:38.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.853+0000 7f54717fa640 1 -- 172.21.15.123:0/3635803335 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f546c019070 con 0x7f547414c4a0 2024-09-15T23:16:38.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.853+0000 7f547ae4c640 1 -- 172.21.15.123:0/3635803335 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f547414b6e0 con 0x7f547414c4a0 2024-09-15T23:16:38.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.853+0000 7f54717fa640 1 -- 172.21.15.123:0/3635803335 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f546c003850 con 0x7f547414c4a0 2024-09-15T23:16:38.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.853+0000 7f547ae4c640 1 -- 172.21.15.123:0/3635803335 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f547414bca0 con 0x7f547414c4a0 2024-09-15T23:16:38.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.854+0000 7f547ae4c640 1 -- 172.21.15.123:0/3635803335 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54740d21a0 con 0x7f547414c4a0 2024-09-15T23:16:38.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.854+0000 7f54717fa640 1 -- 172.21.15.123:0/3635803335 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f546c012070 con 0x7f547414c4a0 2024-09-15T23:16:38.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.855+0000 7f54717fa640 1 --2- 172.21.15.123:0/3635803335 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f545406c2b0 0x7f545406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:38.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.855+0000 7f54717fa640 1 -- 172.21.15.123:0/3635803335 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5709+0+0 (secure 0 0 0) 0x7f546c08ace0 con 0x7f547414c4a0 2024-09-15T23:16:38.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.855+0000 7f5478be8640 1 --2- 172.21.15.123:0/3635803335 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f545406c2b0 0x7f545406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:38.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.855+0000 7f5478be8640 1 --2- 172.21.15.123:0/3635803335 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f545406c2b0 0x7f545406e770 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f54600057e0 tx=0x7f545c030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:38.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:38.859+0000 7f54717fa640 1 -- 172.21.15.123:0/3635803335 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f546c059450 con 0x7f547414c4a0 2024-09-15T23:16:39.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.020+0000 7f547ae4c640 1 -- 172.21.15.123:0/3635803335 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f54740d0a90 con 0x7f545406c2b0 2024-09-15T23:16:39.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.026+0000 7f54717fa640 1 -- 172.21.15.123:0/3635803335 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243985 (secure 0 0 0) 0x7f545c07e930 con 0x7f545406c2b0 2024-09-15T23:16:39.029 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:16:39.030 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:16:39.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.029+0000 7f547ae4c640 1 -- 172.21.15.123:0/3635803335 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f545406c2b0 msgr2=0x7f545406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:39.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.029+0000 7f547ae4c640 1 --2- 172.21.15.123:0/3635803335 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f545406c2b0 0x7f545406e770 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f54600057e0 tx=0x7f545c030000 comp rx=0 tx=0).stop 2024-09-15T23:16:39.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.029+0000 7f547ae4c640 1 -- 172.21.15.123:0/3635803335 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f547414c4a0 msgr2=0x7f54740cc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:39.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.029+0000 7f547ae4c640 1 --2- 172.21.15.123:0/3635803335 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f547414c4a0 0x7f54740cc230 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f546c006fd0 tx=0x7f546c00f8a0 comp rx=0 tx=0).stop 2024-09-15T23:16:39.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.029+0000 7f547ae4c640 1 -- 172.21.15.123:0/3635803335 shutdown_connections 2024-09-15T23:16:39.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.029+0000 7f547ae4c640 1 --2- 172.21.15.123:0/3635803335 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f545406c2b0 0x7f545406e770 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:39.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.029+0000 7f547ae4c640 1 --2- 172.21.15.123:0/3635803335 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f547414c4a0 0x7f54740cc230 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:39.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.029+0000 7f547ae4c640 1 --2- 172.21.15.123:0/3635803335 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f54740ca5c0 0x7f547414a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:39.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.029+0000 7f547ae4c640 1 --2- 172.21.15.123:0/3635803335 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54600039b0 0x7f547414ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:39.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.029+0000 7f547ae4c640 1 -- 172.21.15.123:0/3635803335 >> 172.21.15.123:0/3635803335 conn(0x7f54740d1260 msgr2=0x7f54740b9580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:39.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.029+0000 7f547ae4c640 1 -- 172.21.15.123:0/3635803335 shutdown_connections 2024-09-15T23:16:39.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.029+0000 7f547ae4c640 1 -- 172.21.15.123:0/3635803335 wait complete. 2024-09-15T23:16:39.041 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":229,"stamp":"2024-09-15T23:16:37.565063+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":187,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":86,"acting":86,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":47,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":297228,"kb_used_data":10240,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754677492,"statfs":{"total":773094113280,"available":772789751808,"internally_reserved":0,"allocated":10485760,"data_stored":5223384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":293654064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000880"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.773117+0000","last_change":"2024-09-15T23:16:35.771914+0000","last_active":"2024-09-15T23:16:35.773117+0000","last_peered":"2024-09-15T23:16:35.773117+0000","last_clean":"2024-09-15T23:16:35.773117+0000","last_became_active":"2024-09-15T23:16:35.771622+0000","last_became_peered":"2024-09-15T23:16:35.771622+0000","last_unstale":"2024-09-15T23:16:35.773117+0000","last_undegraded":"2024-09-15T23:16:35.773117+0000","last_fullsized":"2024-09-15T23:16:35.773117+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:22:11.059322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.778059+0000","last_change":"2024-09-15T23:16:35.776062+0000","last_active":"2024-09-15T23:16:35.778059+0000","last_peered":"2024-09-15T23:16:35.778059+0000","last_clean":"2024-09-15T23:16:35.778059+0000","last_became_active":"2024-09-15T23:16:35.775769+0000","last_became_peered":"2024-09-15T23:16:35.775769+0000","last_unstale":"2024-09-15T23:16:35.778059+0000","last_undegraded":"2024-09-15T23:16:35.778059+0000","last_fullsized":"2024-09-15T23:16:35.778059+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:38.505005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.765752+0000","last_change":"2024-09-15T23:16:35.763764+0000","last_active":"2024-09-15T23:16:35.765752+0000","last_peered":"2024-09-15T23:16:35.765752+0000","last_clean":"2024-09-15T23:16:35.765752+0000","last_became_active":"2024-09-15T23:16:35.763503+0000","last_became_peered":"2024-09-15T23:16:35.763503+0000","last_unstale":"2024-09-15T23:16:35.765752+0000","last_undegraded":"2024-09-15T23:16:35.765752+0000","last_fullsized":"2024-09-15T23:16:35.765752+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:07:18.485990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.778657+0000","last_change":"2024-09-15T23:16:35.773476+0000","last_active":"2024-09-15T23:16:35.778657+0000","last_peered":"2024-09-15T23:16:35.778657+0000","last_clean":"2024-09-15T23:16:35.778657+0000","last_became_active":"2024-09-15T23:16:35.773179+0000","last_became_peered":"2024-09-15T23:16:35.773179+0000","last_unstale":"2024-09-15T23:16:35.778657+0000","last_undegraded":"2024-09-15T23:16:35.778657+0000","last_fullsized":"2024-09-15T23:16:35.778657+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:44.282467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.771688+0000","last_change":"2024-09-15T23:16:35.770221+0000","last_active":"2024-09-15T23:16:35.771688+0000","last_peered":"2024-09-15T23:16:35.771688+0000","last_clean":"2024-09-15T23:16:35.771688+0000","last_became_active":"2024-09-15T23:16:35.769976+0000","last_became_peered":"2024-09-15T23:16:35.769976+0000","last_unstale":"2024-09-15T23:16:35.771688+0000","last_undegraded":"2024-09-15T23:16:35.771688+0000","last_fullsized":"2024-09-15T23:16:35.771688+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:49:41.912501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.774690+0000","last_change":"2024-09-15T23:16:35.772327+0000","last_active":"2024-09-15T23:16:35.774690+0000","last_peered":"2024-09-15T23:16:35.774690+0000","last_clean":"2024-09-15T23:16:35.774690+0000","last_became_active":"2024-09-15T23:16:35.772066+0000","last_became_peered":"2024-09-15T23:16:35.772066+0000","last_unstale":"2024-09-15T23:16:35.774690+0000","last_undegraded":"2024-09-15T23:16:35.774690+0000","last_fullsized":"2024-09-15T23:16:35.774690+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:51.344866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.778039+0000","last_change":"2024-09-15T23:16:35.777304+0000","last_active":"2024-09-15T23:16:35.778039+0000","last_peered":"2024-09-15T23:16:35.778039+0000","last_clean":"2024-09-15T23:16:35.778039+0000","last_became_active":"2024-09-15T23:16:35.777034+0000","last_became_peered":"2024-09-15T23:16:35.777034+0000","last_unstale":"2024-09-15T23:16:35.778039+0000","last_undegraded":"2024-09-15T23:16:35.778039+0000","last_fullsized":"2024-09-15T23:16:35.778039+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:03.652263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.770606+0000","last_change":"2024-09-15T23:16:35.769413+0000","last_active":"2024-09-15T23:16:35.770606+0000","last_peered":"2024-09-15T23:16:35.770606+0000","last_clean":"2024-09-15T23:16:35.770606+0000","last_became_active":"2024-09-15T23:16:35.769094+0000","last_became_peered":"2024-09-15T23:16:35.769094+0000","last_unstale":"2024-09-15T23:16:35.770606+0000","last_undegraded":"2024-09-15T23:16:35.770606+0000","last_fullsized":"2024-09-15T23:16:35.770606+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:41.759033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.778820+0000","last_change":"2024-09-15T23:16:35.778170+0000","last_active":"2024-09-15T23:16:35.778820+0000","last_peered":"2024-09-15T23:16:35.778820+0000","last_clean":"2024-09-15T23:16:35.778820+0000","last_became_active":"2024-09-15T23:16:35.777298+0000","last_became_peered":"2024-09-15T23:16:35.777298+0000","last_unstale":"2024-09-15T23:16:35.778820+0000","last_undegraded":"2024-09-15T23:16:35.778820+0000","last_fullsized":"2024-09-15T23:16:35.778820+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:05:53.779144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.774573+0000","last_change":"2024-09-15T23:16:35.771684+0000","last_active":"2024-09-15T23:16:35.774573+0000","last_peered":"2024-09-15T23:16:35.774573+0000","last_clean":"2024-09-15T23:16:35.774573+0000","last_became_active":"2024-09-15T23:16:35.771290+0000","last_became_peered":"2024-09-15T23:16:35.771290+0000","last_unstale":"2024-09-15T23:16:35.774573+0000","last_undegraded":"2024-09-15T23:16:35.774573+0000","last_fullsized":"2024-09-15T23:16:35.774573+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:02.475226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.759797+0000","last_change":"2024-09-15T23:16:35.756737+0000","last_active":"2024-09-15T23:16:35.759797+0000","last_peered":"2024-09-15T23:16:35.759797+0000","last_clean":"2024-09-15T23:16:35.759797+0000","last_became_active":"2024-09-15T23:16:35.756446+0000","last_became_peered":"2024-09-15T23:16:35.756446+0000","last_unstale":"2024-09-15T23:16:35.759797+0000","last_undegraded":"2024-09-15T23:16:35.759797+0000","last_fullsized":"2024-09-15T23:16:35.759797+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:39.354753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.775973+0000","last_change":"2024-09-15T23:16:35.769734+0000","last_active":"2024-09-15T23:16:35.775973+0000","last_peered":"2024-09-15T23:16:35.775973+0000","last_clean":"2024-09-15T23:16:35.775973+0000","last_became_active":"2024-09-15T23:16:35.767578+0000","last_became_peered":"2024-09-15T23:16:35.767578+0000","last_unstale":"2024-09-15T23:16:35.775973+0000","last_undegraded":"2024-09-15T23:16:35.775973+0000","last_fullsized":"2024-09-15T23:16:35.775973+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:49.711543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.776568+0000","last_change":"2024-09-15T23:16:35.769074+0000","last_active":"2024-09-15T23:16:35.776568+0000","last_peered":"2024-09-15T23:16:35.776568+0000","last_clean":"2024-09-15T23:16:35.776568+0000","last_became_active":"2024-09-15T23:16:35.766732+0000","last_became_peered":"2024-09-15T23:16:35.766732+0000","last_unstale":"2024-09-15T23:16:35.776568+0000","last_undegraded":"2024-09-15T23:16:35.776568+0000","last_fullsized":"2024-09-15T23:16:35.776568+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:07:56.105249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.774070+0000","last_change":"2024-09-15T23:16:35.770923+0000","last_active":"2024-09-15T23:16:35.774070+0000","last_peered":"2024-09-15T23:16:35.774070+0000","last_clean":"2024-09-15T23:16:35.774070+0000","last_became_active":"2024-09-15T23:16:35.770571+0000","last_became_peered":"2024-09-15T23:16:35.770571+0000","last_unstale":"2024-09-15T23:16:35.774070+0000","last_undegraded":"2024-09-15T23:16:35.774070+0000","last_fullsized":"2024-09-15T23:16:35.774070+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:53:28.010064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.771666+0000","last_change":"2024-09-15T23:16:35.769677+0000","last_active":"2024-09-15T23:16:35.771666+0000","last_peered":"2024-09-15T23:16:35.771666+0000","last_clean":"2024-09-15T23:16:35.771666+0000","last_became_active":"2024-09-15T23:16:35.769124+0000","last_became_peered":"2024-09-15T23:16:35.769124+0000","last_unstale":"2024-09-15T23:16:35.771666+0000","last_undegraded":"2024-09-15T23:16:35.771666+0000","last_fullsized":"2024-09-15T23:16:35.771666+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:16:33.252218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.774005+0000","last_change":"2024-09-15T23:16:34.758559+0000","last_active":"2024-09-15T23:16:35.774005+0000","last_peered":"2024-09-15T23:16:35.774005+0000","last_clean":"2024-09-15T23:16:35.774005+0000","last_became_active":"2024-09-15T23:16:34.757938+0000","last_became_peered":"2024-09-15T23:16:34.757938+0000","last_unstale":"2024-09-15T23:16:35.774005+0000","last_undegraded":"2024-09-15T23:16:35.774005+0000","last_fullsized":"2024-09-15T23:16:35.774005+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:32:40.873218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.779693+0000","last_change":"2024-09-15T23:16:34.753714+0000","last_active":"2024-09-15T23:16:35.779693+0000","last_peered":"2024-09-15T23:16:35.779693+0000","last_clean":"2024-09-15T23:16:35.779693+0000","last_became_active":"2024-09-15T23:16:34.753394+0000","last_became_peered":"2024-09-15T23:16:34.753394+0000","last_unstale":"2024-09-15T23:16:35.779693+0000","last_undegraded":"2024-09-15T23:16:35.779693+0000","last_fullsized":"2024-09-15T23:16:35.779693+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:17.679671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.779964+0000","last_change":"2024-09-15T23:16:35.779140+0000","last_active":"2024-09-15T23:16:35.779964+0000","last_peered":"2024-09-15T23:16:35.779964+0000","last_clean":"2024-09-15T23:16:35.779964+0000","last_became_active":"2024-09-15T23:16:35.777178+0000","last_became_peered":"2024-09-15T23:16:35.777178+0000","last_unstale":"2024-09-15T23:16:35.779964+0000","last_undegraded":"2024-09-15T23:16:35.779964+0000","last_fullsized":"2024-09-15T23:16:35.779964+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:59.282013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.753198+0000","last_change":"2024-09-15T23:16:34.754647+0000","last_active":"2024-09-15T23:16:35.753198+0000","last_peered":"2024-09-15T23:16:35.753198+0000","last_clean":"2024-09-15T23:16:35.753198+0000","last_became_active":"2024-09-15T23:16:34.754348+0000","last_became_peered":"2024-09-15T23:16:34.754348+0000","last_unstale":"2024-09-15T23:16:35.753198+0000","last_undegraded":"2024-09-15T23:16:35.753198+0000","last_fullsized":"2024-09-15T23:16:35.753198+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:40.263650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.766047+0000","last_change":"2024-09-15T23:16:35.762911+0000","last_active":"2024-09-15T23:16:35.766047+0000","last_peered":"2024-09-15T23:16:35.766047+0000","last_clean":"2024-09-15T23:16:35.766047+0000","last_became_active":"2024-09-15T23:16:35.762046+0000","last_became_peered":"2024-09-15T23:16:35.762046+0000","last_unstale":"2024-09-15T23:16:35.766047+0000","last_undegraded":"2024-09-15T23:16:35.766047+0000","last_fullsized":"2024-09-15T23:16:35.766047+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:51:33.627499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.753068+0000","last_change":"2024-09-15T23:16:34.757604+0000","last_active":"2024-09-15T23:16:35.753068+0000","last_peered":"2024-09-15T23:16:35.753068+0000","last_clean":"2024-09-15T23:16:35.753068+0000","last_became_active":"2024-09-15T23:16:34.757332+0000","last_became_peered":"2024-09-15T23:16:34.757332+0000","last_unstale":"2024-09-15T23:16:35.753068+0000","last_undegraded":"2024-09-15T23:16:35.753068+0000","last_fullsized":"2024-09-15T23:16:35.753068+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:17:52.432695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.770633+0000","last_change":"2024-09-15T23:16:35.768029+0000","last_active":"2024-09-15T23:16:35.770633+0000","last_peered":"2024-09-15T23:16:35.770633+0000","last_clean":"2024-09-15T23:16:35.770633+0000","last_became_active":"2024-09-15T23:16:35.767759+0000","last_became_peered":"2024-09-15T23:16:35.767759+0000","last_unstale":"2024-09-15T23:16:35.770633+0000","last_undegraded":"2024-09-15T23:16:35.770633+0000","last_fullsized":"2024-09-15T23:16:35.770633+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:18.266560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.776244+0000","last_change":"2024-09-15T23:16:35.768727+0000","last_active":"2024-09-15T23:16:35.776244+0000","last_peered":"2024-09-15T23:16:35.776244+0000","last_clean":"2024-09-15T23:16:35.776244+0000","last_became_active":"2024-09-15T23:16:35.768122+0000","last_became_peered":"2024-09-15T23:16:35.768122+0000","last_unstale":"2024-09-15T23:16:35.776244+0000","last_undegraded":"2024-09-15T23:16:35.776244+0000","last_fullsized":"2024-09-15T23:16:35.776244+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:28:48.387265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.776045+0000","last_change":"2024-09-15T23:16:35.766409+0000","last_active":"2024-09-15T23:16:35.776045+0000","last_peered":"2024-09-15T23:16:35.776045+0000","last_clean":"2024-09-15T23:16:35.776045+0000","last_became_active":"2024-09-15T23:16:35.766132+0000","last_became_peered":"2024-09-15T23:16:35.766132+0000","last_unstale":"2024-09-15T23:16:35.776045+0000","last_undegraded":"2024-09-15T23:16:35.776045+0000","last_fullsized":"2024-09-15T23:16:35.776045+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:47.333764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.776218+0000","last_change":"2024-09-15T23:16:34.759842+0000","last_active":"2024-09-15T23:16:35.776218+0000","last_peered":"2024-09-15T23:16:35.776218+0000","last_clean":"2024-09-15T23:16:35.776218+0000","last_became_active":"2024-09-15T23:16:34.759564+0000","last_became_peered":"2024-09-15T23:16:34.759564+0000","last_unstale":"2024-09-15T23:16:35.776218+0000","last_undegraded":"2024-09-15T23:16:35.776218+0000","last_fullsized":"2024-09-15T23:16:35.776218+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:05.285912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.753048+0000","last_change":"2024-09-15T23:16:34.757740+0000","last_active":"2024-09-15T23:16:35.753048+0000","last_peered":"2024-09-15T23:16:35.753048+0000","last_clean":"2024-09-15T23:16:35.753048+0000","last_became_active":"2024-09-15T23:16:34.757307+0000","last_became_peered":"2024-09-15T23:16:34.757307+0000","last_unstale":"2024-09-15T23:16:35.753048+0000","last_undegraded":"2024-09-15T23:16:35.753048+0000","last_fullsized":"2024-09-15T23:16:35.753048+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:30.211666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.775421+0000","last_change":"2024-09-15T23:16:35.773222+0000","last_active":"2024-09-15T23:16:35.775421+0000","last_peered":"2024-09-15T23:16:35.775421+0000","last_clean":"2024-09-15T23:16:35.775421+0000","last_became_active":"2024-09-15T23:16:35.772920+0000","last_became_peered":"2024-09-15T23:16:35.772920+0000","last_unstale":"2024-09-15T23:16:35.775421+0000","last_undegraded":"2024-09-15T23:16:35.775421+0000","last_fullsized":"2024-09-15T23:16:35.775421+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:07.690414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.777091+0000","last_change":"2024-09-15T23:16:35.766539+0000","last_active":"2024-09-15T23:16:35.777091+0000","last_peered":"2024-09-15T23:16:35.777091+0000","last_clean":"2024-09-15T23:16:35.777091+0000","last_became_active":"2024-09-15T23:16:35.766275+0000","last_became_peered":"2024-09-15T23:16:35.766275+0000","last_unstale":"2024-09-15T23:16:35.777091+0000","last_undegraded":"2024-09-15T23:16:35.777091+0000","last_fullsized":"2024-09-15T23:16:35.777091+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:37.401188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"97'8","reported_seq":20,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.775599+0000","last_change":"2024-09-15T23:16:34.761125+0000","last_active":"2024-09-15T23:16:35.775599+0000","last_peered":"2024-09-15T23:16:35.775599+0000","last_clean":"2024-09-15T23:16:35.775599+0000","last_became_active":"2024-09-15T23:16:34.760875+0000","last_became_peered":"2024-09-15T23:16:34.760875+0000","last_unstale":"2024-09-15T23:16:35.775599+0000","last_undegraded":"2024-09-15T23:16:35.775599+0000","last_fullsized":"2024-09-15T23:16:35.775599+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:24:28.230255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.775278+0000","last_change":"2024-09-15T23:16:34.756814+0000","last_active":"2024-09-15T23:16:35.775278+0000","last_peered":"2024-09-15T23:16:35.775278+0000","last_clean":"2024-09-15T23:16:35.775278+0000","last_became_active":"2024-09-15T23:16:34.755902+0000","last_became_peered":"2024-09-15T23:16:34.755902+0000","last_unstale":"2024-09-15T23:16:35.775278+0000","last_undegraded":"2024-09-15T23:16:35.775278+0000","last_fullsized":"2024-09-15T23:16:35.775278+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:21.905853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.752863+0000","last_change":"2024-09-15T23:16:34.760013+0000","last_active":"2024-09-15T23:16:35.752863+0000","last_peered":"2024-09-15T23:16:35.752863+0000","last_clean":"2024-09-15T23:16:35.752863+0000","last_became_active":"2024-09-15T23:16:34.759697+0000","last_became_peered":"2024-09-15T23:16:34.759697+0000","last_unstale":"2024-09-15T23:16:35.752863+0000","last_undegraded":"2024-09-15T23:16:35.752863+0000","last_fullsized":"2024-09-15T23:16:35.752863+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:44.346565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.773234+0000","last_change":"2024-09-15T23:16:35.770304+0000","last_active":"2024-09-15T23:16:35.773234+0000","last_peered":"2024-09-15T23:16:35.773234+0000","last_clean":"2024-09-15T23:16:35.773234+0000","last_became_active":"2024-09-15T23:16:35.769929+0000","last_became_peered":"2024-09-15T23:16:35.769929+0000","last_unstale":"2024-09-15T23:16:35.773234+0000","last_undegraded":"2024-09-15T23:16:35.773234+0000","last_fullsized":"2024-09-15T23:16:35.773234+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:44.316822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.773360+0000","last_change":"2024-09-15T23:16:34.760353+0000","last_active":"2024-09-15T23:16:35.773360+0000","last_peered":"2024-09-15T23:16:35.773360+0000","last_clean":"2024-09-15T23:16:35.773360+0000","last_became_active":"2024-09-15T23:16:34.760092+0000","last_became_peered":"2024-09-15T23:16:34.760092+0000","last_unstale":"2024-09-15T23:16:35.773360+0000","last_undegraded":"2024-09-15T23:16:35.773360+0000","last_fullsized":"2024-09-15T23:16:35.773360+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:58:41.895104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.753048+0000","last_change":"2024-09-15T23:16:34.757928+0000","last_active":"2024-09-15T23:16:35.753048+0000","last_peered":"2024-09-15T23:16:35.753048+0000","last_clean":"2024-09-15T23:16:35.753048+0000","last_became_active":"2024-09-15T23:16:34.757648+0000","last_became_peered":"2024-09-15T23:16:34.757648+0000","last_unstale":"2024-09-15T23:16:35.753048+0000","last_undegraded":"2024-09-15T23:16:35.753048+0000","last_fullsized":"2024-09-15T23:16:35.753048+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:00.288336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.774566+0000","last_change":"2024-09-15T23:16:35.770911+0000","last_active":"2024-09-15T23:16:35.774566+0000","last_peered":"2024-09-15T23:16:35.774566+0000","last_clean":"2024-09-15T23:16:35.774566+0000","last_became_active":"2024-09-15T23:16:35.770620+0000","last_became_peered":"2024-09-15T23:16:35.770620+0000","last_unstale":"2024-09-15T23:16:35.774566+0000","last_undegraded":"2024-09-15T23:16:35.774566+0000","last_fullsized":"2024-09-15T23:16:35.774566+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:45.455400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.757278+0000","last_change":"2024-09-15T23:16:34.755273+0000","last_active":"2024-09-15T23:16:35.757278+0000","last_peered":"2024-09-15T23:16:35.757278+0000","last_clean":"2024-09-15T23:16:35.757278+0000","last_became_active":"2024-09-15T23:16:34.754300+0000","last_became_peered":"2024-09-15T23:16:34.754300+0000","last_unstale":"2024-09-15T23:16:35.757278+0000","last_undegraded":"2024-09-15T23:16:35.757278+0000","last_fullsized":"2024-09-15T23:16:35.757278+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:28.685685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.753258+0000","last_change":"2024-09-15T23:16:34.760017+0000","last_active":"2024-09-15T23:16:35.753258+0000","last_peered":"2024-09-15T23:16:35.753258+0000","last_clean":"2024-09-15T23:16:35.753258+0000","last_became_active":"2024-09-15T23:16:34.759429+0000","last_became_peered":"2024-09-15T23:16:34.759429+0000","last_unstale":"2024-09-15T23:16:35.753258+0000","last_undegraded":"2024-09-15T23:16:35.753258+0000","last_fullsized":"2024-09-15T23:16:35.753258+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:53:35.052932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.775667+0000","last_change":"2024-09-15T23:16:34.757623+0000","last_active":"2024-09-15T23:16:35.775667+0000","last_peered":"2024-09-15T23:16:35.775667+0000","last_clean":"2024-09-15T23:16:35.775667+0000","last_became_active":"2024-09-15T23:16:34.757259+0000","last_became_peered":"2024-09-15T23:16:34.757259+0000","last_unstale":"2024-09-15T23:16:35.775667+0000","last_undegraded":"2024-09-15T23:16:35.775667+0000","last_fullsized":"2024-09-15T23:16:35.775667+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:34.782116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.759608+0000","last_change":"2024-09-15T23:16:34.760115+0000","last_active":"2024-09-15T23:16:35.759608+0000","last_peered":"2024-09-15T23:16:35.759608+0000","last_clean":"2024-09-15T23:16:35.759608+0000","last_became_active":"2024-09-15T23:16:34.759725+0000","last_became_peered":"2024-09-15T23:16:34.759725+0000","last_unstale":"2024-09-15T23:16:35.759608+0000","last_undegraded":"2024-09-15T23:16:35.759608+0000","last_fullsized":"2024-09-15T23:16:35.759608+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:14.836727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.752566+0000","last_change":"2024-09-15T23:16:34.757464+0000","last_active":"2024-09-15T23:16:35.752566+0000","last_peered":"2024-09-15T23:16:35.752566+0000","last_clean":"2024-09-15T23:16:35.752566+0000","last_became_active":"2024-09-15T23:16:34.757190+0000","last_became_peered":"2024-09-15T23:16:34.757190+0000","last_unstale":"2024-09-15T23:16:35.752566+0000","last_undegraded":"2024-09-15T23:16:35.752566+0000","last_fullsized":"2024-09-15T23:16:35.752566+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:24.571810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.775735+0000","last_change":"2024-09-15T23:16:35.767564+0000","last_active":"2024-09-15T23:16:35.775735+0000","last_peered":"2024-09-15T23:16:35.775735+0000","last_clean":"2024-09-15T23:16:35.775735+0000","last_became_active":"2024-09-15T23:16:35.767284+0000","last_became_peered":"2024-09-15T23:16:35.767284+0000","last_unstale":"2024-09-15T23:16:35.775735+0000","last_undegraded":"2024-09-15T23:16:35.775735+0000","last_fullsized":"2024-09-15T23:16:35.775735+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:52.495611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.776267+0000","last_change":"2024-09-15T23:16:35.769591+0000","last_active":"2024-09-15T23:16:35.776267+0000","last_peered":"2024-09-15T23:16:35.776267+0000","last_clean":"2024-09-15T23:16:35.776267+0000","last_became_active":"2024-09-15T23:16:35.769282+0000","last_became_peered":"2024-09-15T23:16:35.769282+0000","last_unstale":"2024-09-15T23:16:35.776267+0000","last_undegraded":"2024-09-15T23:16:35.776267+0000","last_fullsized":"2024-09-15T23:16:35.776267+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:06:59.030627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":301,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-15T23:16:31.728381+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:16:31.728381+0000","last_peered":"2024-09-15T23:16:31.728381+0000","last_clean":"2024-09-15T23:16:31.728381+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:16:31.728381+0000","last_undegraded":"2024-09-15T23:16:31.728381+0000","last_fullsized":"2024-09-15T23:16:31.728381+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":52,"acting":52,"num_store_stats":4},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":32,"acting":32,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476796,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40640,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331200,"statfs":{"total":96636764160,"available":96595148800,"internally_reserved":0,"allocated":1142784,"data_stored":496929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476793,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40612,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331228,"statfs":{"total":96636764160,"available":96595177472,"internally_reserved":0,"allocated":1130496,"data_stored":491592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476795,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37036,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334804,"statfs":{"total":96636764160,"available":96598839296,"internally_reserved":0,"allocated":1724416,"data_stored":1081960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476795,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32316,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339524,"statfs":{"total":96636764160,"available":96603672576,"internally_reserved":0,"allocated":1142784,"data_stored":496929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542202,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36504,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335336,"statfs":{"total":96636764160,"available":96599384064,"internally_reserved":0,"allocated":1183744,"data_stored":515866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542202,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36508,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335332,"statfs":{"total":96636764160,"available":96599379968,"internally_reserved":0,"allocated":1187840,"data_stored":516468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542201,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37096,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334744,"statfs":{"total":96636764160,"available":96598777856,"internally_reserved":0,"allocated":1789952,"data_stored":1107810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542203,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36516,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335324,"statfs":{"total":96636764160,"available":96599371776,"internally_reserved":0,"allocated":1183744,"data_stored":515830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:16:39.045 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:16:39.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.179+0000 7fd7254b7640 1 Processor -- start 2024-09-15T23:16:39.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.179+0000 7fd7254b7640 1 -- start start 2024-09-15T23:16:39.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.180+0000 7fd7254b7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd72015e6d0 0x7fd72015f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:39.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.180+0000 7fd7254b7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd7200cb980 0x7fd720162c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:39.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.180+0000 7fd7254b7640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd72006cf30 0x7fd72006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:39.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.180+0000 7fd7254b7640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fd7200cc990 con 0x7fd7200cb980 2024-09-15T23:16:39.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.180+0000 7fd7254b7640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fd72015fcd0 con 0x7fd72006cf30 2024-09-15T23:16:39.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.180+0000 7fd7254b7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd720162440 con 0x7fd72015e6d0 2024-09-15T23:16:39.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.180+0000 7fd7167fc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd7200cb980 0x7fd720162c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:39.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.180+0000 7fd7167fc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd7200cb980 0x7fd720162c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46604/0 (socket says 172.21.15.123:46604) 2024-09-15T23:16:39.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.180+0000 7fd7167fc640 1 -- 172.21.15.123:0/2652931577 learned_addr learned my addr 172.21.15.123:0/2652931577 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:39.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.180+0000 7fd71f7fe640 1 --2- 172.21.15.123:0/2652931577 >> v2:172.21.15.188:3300/0 conn(0x7fd72006cf30 0x7fd72006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:39.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.180+0000 7fd71effd640 1 --2- 172.21.15.123:0/2652931577 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd72015e6d0 0x7fd72015f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:39.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.180+0000 7fd7167fc640 1 -- 172.21.15.123:0/2652931577 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd72015e6d0 msgr2=0x7fd72015f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:39.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.180+0000 7fd7167fc640 1 --2- 172.21.15.123:0/2652931577 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd72015e6d0 0x7fd72015f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:39.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.180+0000 7fd7167fc640 1 -- 172.21.15.123:0/2652931577 >> v2:172.21.15.188:3300/0 conn(0x7fd72006cf30 msgr2=0x7fd72006d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:39.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.180+0000 7fd7167fc640 1 --2- 172.21.15.123:0/2652931577 >> v2:172.21.15.188:3300/0 conn(0x7fd72006cf30 0x7fd72006d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:39.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.180+0000 7fd7167fc640 1 -- 172.21.15.123:0/2652931577 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7200cc3d0 con 0x7fd7200cb980 2024-09-15T23:16:39.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.181+0000 7fd7167fc640 1 --2- 172.21.15.123:0/2652931577 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7200cb980 0x7fd720162c00 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fd7200cfdd0 tx=0x7fd70802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7489c98e31f9ee7a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:39.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.181+0000 7fd71e7fc640 1 -- 172.21.15.123:0/2652931577 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd708037070 con 0x7fd7200cb980 2024-09-15T23:16:39.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.181+0000 7fd71e7fc640 1 -- 172.21.15.123:0/2652931577 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd70802ae00 con 0x7fd7200cb980 2024-09-15T23:16:39.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.181+0000 7fd71e7fc640 1 -- 172.21.15.123:0/2652931577 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd708032660 con 0x7fd7200cb980 2024-09-15T23:16:39.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.182+0000 7fd7254b7640 1 -- 172.21.15.123:0/2652931577 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7200cb980 msgr2=0x7fd720162c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:39.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.182+0000 7fd7254b7640 1 --2- 172.21.15.123:0/2652931577 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7200cb980 0x7fd720162c00 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fd7200cfdd0 tx=0x7fd70802a0b0 comp rx=0 tx=0).stop 2024-09-15T23:16:39.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.182+0000 7fd7254b7640 1 -- 172.21.15.123:0/2652931577 shutdown_connections 2024-09-15T23:16:39.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.182+0000 7fd7254b7640 1 --2- 172.21.15.123:0/2652931577 >> v2:172.21.15.188:3300/0 conn(0x7fd72006cf30 0x7fd72006d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:39.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.182+0000 7fd7254b7640 1 --2- 172.21.15.123:0/2652931577 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7200cb980 0x7fd720162c00 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:39.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.182+0000 7fd7254b7640 1 --2- 172.21.15.123:0/2652931577 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd72015e6d0 0x7fd72015f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:39.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.182+0000 7fd7254b7640 1 -- 172.21.15.123:0/2652931577 >> 172.21.15.123:0/2652931577 conn(0x7fd7200b4300 msgr2=0x7fd7200b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:39.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.182+0000 7fd7254b7640 1 -- 172.21.15.123:0/2652931577 shutdown_connections 2024-09-15T23:16:39.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.182+0000 7fd7254b7640 1 -- 172.21.15.123:0/2652931577 wait complete. 2024-09-15T23:16:39.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.183+0000 7fd7254b7640 1 Processor -- start 2024-09-15T23:16:39.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.183+0000 7fd7254b7640 1 -- start start 2024-09-15T23:16:39.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.184+0000 7fd7254b7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd72006cf30 0x7fd7200b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:39.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.184+0000 7fd7254b7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd7200cb980 0x7fd72014c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:39.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.184+0000 7fd7254b7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd72015e6d0 0x7fd7200ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:39.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.184+0000 7fd7254b7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd720163140 con 0x7fd72006cf30 2024-09-15T23:16:39.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.184+0000 7fd7254b7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd7201626e0 con 0x7fd72015e6d0 2024-09-15T23:16:39.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.184+0000 7fd7254b7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd72015eab0 con 0x7fd7200cb980 2024-09-15T23:16:39.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.184+0000 7fd71effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd72006cf30 0x7fd7200b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:39.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.184+0000 7fd71effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd72006cf30 0x7fd7200b6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46610/0 (socket says 172.21.15.123:46610) 2024-09-15T23:16:39.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.184+0000 7fd71effd640 1 -- 172.21.15.123:0/3626679110 learned_addr learned my addr 172.21.15.123:0/3626679110 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:39.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.184+0000 7fd7167fc640 1 --2- 172.21.15.123:0/3626679110 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd7200cb980 0x7fd72014c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:39.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.184+0000 7fd71f7fe640 1 --2- 172.21.15.123:0/3626679110 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd72015e6d0 0x7fd7200ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:39.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.184+0000 7fd71effd640 1 -- 172.21.15.123:0/3626679110 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd7200cb980 msgr2=0x7fd72014c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:39.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.184+0000 7fd71effd640 1 --2- 172.21.15.123:0/3626679110 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd7200cb980 0x7fd72014c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:39.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.184+0000 7fd71effd640 1 -- 172.21.15.123:0/3626679110 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd72015e6d0 msgr2=0x7fd7200ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:39.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.184+0000 7fd71effd640 1 --2- 172.21.15.123:0/3626679110 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd72015e6d0 0x7fd7200ccc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:39.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.184+0000 7fd71effd640 1 -- 172.21.15.123:0/3626679110 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7200b70e0 con 0x7fd72006cf30 2024-09-15T23:16:39.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.185+0000 7fd71effd640 1 --2- 172.21.15.123:0/3626679110 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd72006cf30 0x7fd7200b6b00 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fd71000d5f0 tx=0x7fd71000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:39.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.185+0000 7fd717fff640 1 -- 172.21.15.123:0/3626679110 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7100125f0 con 0x7fd72006cf30 2024-09-15T23:16:39.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.185+0000 7fd717fff640 1 -- 172.21.15.123:0/3626679110 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd710019070 con 0x7fd72006cf30 2024-09-15T23:16:39.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.185+0000 7fd717fff640 1 -- 172.21.15.123:0/3626679110 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7100129d0 con 0x7fd72006cf30 2024-09-15T23:16:39.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.185+0000 7fd7254b7640 1 -- 172.21.15.123:0/3626679110 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7200b73c0 con 0x7fd72006cf30 2024-09-15T23:16:39.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.185+0000 7fd7254b7640 1 -- 172.21.15.123:0/3626679110 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7200b7980 con 0x7fd72006cf30 2024-09-15T23:16:39.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.186+0000 7fd7254b7640 1 -- 172.21.15.123:0/3626679110 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd720162c00 con 0x7fd72006cf30 2024-09-15T23:16:39.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.186+0000 7fd717fff640 1 -- 172.21.15.123:0/3626679110 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd710012b70 con 0x7fd72006cf30 2024-09-15T23:16:39.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.187+0000 7fd717fff640 1 --2- 172.21.15.123:0/3626679110 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd70006c2b0 0x7fd70006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:39.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.187+0000 7fd717fff640 1 -- 172.21.15.123:0/3626679110 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5709+0+0 (secure 0 0 0) 0x7fd71008b6b0 con 0x7fd72006cf30 2024-09-15T23:16:39.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.187+0000 7fd7167fc640 1 --2- 172.21.15.123:0/3626679110 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd70006c2b0 0x7fd70006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:39.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.187+0000 7fd7167fc640 1 --2- 172.21.15.123:0/3626679110 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd70006c2b0 0x7fd70006e770 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd708034000 tx=0x7fd70802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:39.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.191+0000 7fd717fff640 1 -- 172.21.15.123:0/3626679110 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd710059eb0 con 0x7fd72006cf30 2024-09-15T23:16:39.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.354+0000 7fd7254b7640 1 -- 172.21.15.123:0/3626679110 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd7200b3290 con 0x7fd70006c2b0 2024-09-15T23:16:39.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.360+0000 7fd717fff640 1 -- 172.21.15.123:0/3626679110 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243985 (secure 0 0 0) 0x7fd7200b3290 con 0x7fd70006c2b0 2024-09-15T23:16:39.363 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:16:39.364 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:16:39.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.363+0000 7fd7254b7640 1 -- 172.21.15.123:0/3626679110 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd70006c2b0 msgr2=0x7fd70006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:39.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.363+0000 7fd7254b7640 1 --2- 172.21.15.123:0/3626679110 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd70006c2b0 0x7fd70006e770 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd708034000 tx=0x7fd70802e000 comp rx=0 tx=0).stop 2024-09-15T23:16:39.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.363+0000 7fd7254b7640 1 -- 172.21.15.123:0/3626679110 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd72006cf30 msgr2=0x7fd7200b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:39.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.363+0000 7fd7254b7640 1 --2- 172.21.15.123:0/3626679110 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd72006cf30 0x7fd7200b6b00 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fd71000d5f0 tx=0x7fd71000dab0 comp rx=0 tx=0).stop 2024-09-15T23:16:39.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.363+0000 7fd7254b7640 1 -- 172.21.15.123:0/3626679110 shutdown_connections 2024-09-15T23:16:39.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.363+0000 7fd7254b7640 1 --2- 172.21.15.123:0/3626679110 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd72015e6d0 0x7fd7200ccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:39.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.363+0000 7fd7254b7640 1 --2- 172.21.15.123:0/3626679110 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd7200cb980 0x7fd72014c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:39.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.363+0000 7fd7254b7640 1 --2- 172.21.15.123:0/3626679110 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd70006c2b0 0x7fd70006e770 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:39.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.363+0000 7fd7254b7640 1 --2- 172.21.15.123:0/3626679110 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd72006cf30 0x7fd7200b6b00 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:39.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.363+0000 7fd7254b7640 1 -- 172.21.15.123:0/3626679110 >> 172.21.15.123:0/3626679110 conn(0x7fd7200b4300 msgr2=0x7fd7200b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:39.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.363+0000 7fd7254b7640 1 -- 172.21.15.123:0/3626679110 shutdown_connections 2024-09-15T23:16:39.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.363+0000 7fd7254b7640 1 -- 172.21.15.123:0/3626679110 wait complete. 2024-09-15T23:16:39.374 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":229,"stamp":"2024-09-15T23:16:37.565063+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":187,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":86,"acting":86,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":47,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":297228,"kb_used_data":10240,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754677492,"statfs":{"total":773094113280,"available":772789751808,"internally_reserved":0,"allocated":10485760,"data_stored":5223384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":293654064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000880"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.773117+0000","last_change":"2024-09-15T23:16:35.771914+0000","last_active":"2024-09-15T23:16:35.773117+0000","last_peered":"2024-09-15T23:16:35.773117+0000","last_clean":"2024-09-15T23:16:35.773117+0000","last_became_active":"2024-09-15T23:16:35.771622+0000","last_became_peered":"2024-09-15T23:16:35.771622+0000","last_unstale":"2024-09-15T23:16:35.773117+0000","last_undegraded":"2024-09-15T23:16:35.773117+0000","last_fullsized":"2024-09-15T23:16:35.773117+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:22:11.059322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.778059+0000","last_change":"2024-09-15T23:16:35.776062+0000","last_active":"2024-09-15T23:16:35.778059+0000","last_peered":"2024-09-15T23:16:35.778059+0000","last_clean":"2024-09-15T23:16:35.778059+0000","last_became_active":"2024-09-15T23:16:35.775769+0000","last_became_peered":"2024-09-15T23:16:35.775769+0000","last_unstale":"2024-09-15T23:16:35.778059+0000","last_undegraded":"2024-09-15T23:16:35.778059+0000","last_fullsized":"2024-09-15T23:16:35.778059+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:38.505005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.765752+0000","last_change":"2024-09-15T23:16:35.763764+0000","last_active":"2024-09-15T23:16:35.765752+0000","last_peered":"2024-09-15T23:16:35.765752+0000","last_clean":"2024-09-15T23:16:35.765752+0000","last_became_active":"2024-09-15T23:16:35.763503+0000","last_became_peered":"2024-09-15T23:16:35.763503+0000","last_unstale":"2024-09-15T23:16:35.765752+0000","last_undegraded":"2024-09-15T23:16:35.765752+0000","last_fullsized":"2024-09-15T23:16:35.765752+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:07:18.485990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.778657+0000","last_change":"2024-09-15T23:16:35.773476+0000","last_active":"2024-09-15T23:16:35.778657+0000","last_peered":"2024-09-15T23:16:35.778657+0000","last_clean":"2024-09-15T23:16:35.778657+0000","last_became_active":"2024-09-15T23:16:35.773179+0000","last_became_peered":"2024-09-15T23:16:35.773179+0000","last_unstale":"2024-09-15T23:16:35.778657+0000","last_undegraded":"2024-09-15T23:16:35.778657+0000","last_fullsized":"2024-09-15T23:16:35.778657+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:44.282467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.771688+0000","last_change":"2024-09-15T23:16:35.770221+0000","last_active":"2024-09-15T23:16:35.771688+0000","last_peered":"2024-09-15T23:16:35.771688+0000","last_clean":"2024-09-15T23:16:35.771688+0000","last_became_active":"2024-09-15T23:16:35.769976+0000","last_became_peered":"2024-09-15T23:16:35.769976+0000","last_unstale":"2024-09-15T23:16:35.771688+0000","last_undegraded":"2024-09-15T23:16:35.771688+0000","last_fullsized":"2024-09-15T23:16:35.771688+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:49:41.912501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.774690+0000","last_change":"2024-09-15T23:16:35.772327+0000","last_active":"2024-09-15T23:16:35.774690+0000","last_peered":"2024-09-15T23:16:35.774690+0000","last_clean":"2024-09-15T23:16:35.774690+0000","last_became_active":"2024-09-15T23:16:35.772066+0000","last_became_peered":"2024-09-15T23:16:35.772066+0000","last_unstale":"2024-09-15T23:16:35.774690+0000","last_undegraded":"2024-09-15T23:16:35.774690+0000","last_fullsized":"2024-09-15T23:16:35.774690+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:51.344866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.778039+0000","last_change":"2024-09-15T23:16:35.777304+0000","last_active":"2024-09-15T23:16:35.778039+0000","last_peered":"2024-09-15T23:16:35.778039+0000","last_clean":"2024-09-15T23:16:35.778039+0000","last_became_active":"2024-09-15T23:16:35.777034+0000","last_became_peered":"2024-09-15T23:16:35.777034+0000","last_unstale":"2024-09-15T23:16:35.778039+0000","last_undegraded":"2024-09-15T23:16:35.778039+0000","last_fullsized":"2024-09-15T23:16:35.778039+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:03.652263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.770606+0000","last_change":"2024-09-15T23:16:35.769413+0000","last_active":"2024-09-15T23:16:35.770606+0000","last_peered":"2024-09-15T23:16:35.770606+0000","last_clean":"2024-09-15T23:16:35.770606+0000","last_became_active":"2024-09-15T23:16:35.769094+0000","last_became_peered":"2024-09-15T23:16:35.769094+0000","last_unstale":"2024-09-15T23:16:35.770606+0000","last_undegraded":"2024-09-15T23:16:35.770606+0000","last_fullsized":"2024-09-15T23:16:35.770606+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:41.759033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.778820+0000","last_change":"2024-09-15T23:16:35.778170+0000","last_active":"2024-09-15T23:16:35.778820+0000","last_peered":"2024-09-15T23:16:35.778820+0000","last_clean":"2024-09-15T23:16:35.778820+0000","last_became_active":"2024-09-15T23:16:35.777298+0000","last_became_peered":"2024-09-15T23:16:35.777298+0000","last_unstale":"2024-09-15T23:16:35.778820+0000","last_undegraded":"2024-09-15T23:16:35.778820+0000","last_fullsized":"2024-09-15T23:16:35.778820+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:05:53.779144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.774573+0000","last_change":"2024-09-15T23:16:35.771684+0000","last_active":"2024-09-15T23:16:35.774573+0000","last_peered":"2024-09-15T23:16:35.774573+0000","last_clean":"2024-09-15T23:16:35.774573+0000","last_became_active":"2024-09-15T23:16:35.771290+0000","last_became_peered":"2024-09-15T23:16:35.771290+0000","last_unstale":"2024-09-15T23:16:35.774573+0000","last_undegraded":"2024-09-15T23:16:35.774573+0000","last_fullsized":"2024-09-15T23:16:35.774573+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:02.475226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.759797+0000","last_change":"2024-09-15T23:16:35.756737+0000","last_active":"2024-09-15T23:16:35.759797+0000","last_peered":"2024-09-15T23:16:35.759797+0000","last_clean":"2024-09-15T23:16:35.759797+0000","last_became_active":"2024-09-15T23:16:35.756446+0000","last_became_peered":"2024-09-15T23:16:35.756446+0000","last_unstale":"2024-09-15T23:16:35.759797+0000","last_undegraded":"2024-09-15T23:16:35.759797+0000","last_fullsized":"2024-09-15T23:16:35.759797+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:39.354753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.775973+0000","last_change":"2024-09-15T23:16:35.769734+0000","last_active":"2024-09-15T23:16:35.775973+0000","last_peered":"2024-09-15T23:16:35.775973+0000","last_clean":"2024-09-15T23:16:35.775973+0000","last_became_active":"2024-09-15T23:16:35.767578+0000","last_became_peered":"2024-09-15T23:16:35.767578+0000","last_unstale":"2024-09-15T23:16:35.775973+0000","last_undegraded":"2024-09-15T23:16:35.775973+0000","last_fullsized":"2024-09-15T23:16:35.775973+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:49.711543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.776568+0000","last_change":"2024-09-15T23:16:35.769074+0000","last_active":"2024-09-15T23:16:35.776568+0000","last_peered":"2024-09-15T23:16:35.776568+0000","last_clean":"2024-09-15T23:16:35.776568+0000","last_became_active":"2024-09-15T23:16:35.766732+0000","last_became_peered":"2024-09-15T23:16:35.766732+0000","last_unstale":"2024-09-15T23:16:35.776568+0000","last_undegraded":"2024-09-15T23:16:35.776568+0000","last_fullsized":"2024-09-15T23:16:35.776568+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:07:56.105249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.774070+0000","last_change":"2024-09-15T23:16:35.770923+0000","last_active":"2024-09-15T23:16:35.774070+0000","last_peered":"2024-09-15T23:16:35.774070+0000","last_clean":"2024-09-15T23:16:35.774070+0000","last_became_active":"2024-09-15T23:16:35.770571+0000","last_became_peered":"2024-09-15T23:16:35.770571+0000","last_unstale":"2024-09-15T23:16:35.774070+0000","last_undegraded":"2024-09-15T23:16:35.774070+0000","last_fullsized":"2024-09-15T23:16:35.774070+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:53:28.010064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.771666+0000","last_change":"2024-09-15T23:16:35.769677+0000","last_active":"2024-09-15T23:16:35.771666+0000","last_peered":"2024-09-15T23:16:35.771666+0000","last_clean":"2024-09-15T23:16:35.771666+0000","last_became_active":"2024-09-15T23:16:35.769124+0000","last_became_peered":"2024-09-15T23:16:35.769124+0000","last_unstale":"2024-09-15T23:16:35.771666+0000","last_undegraded":"2024-09-15T23:16:35.771666+0000","last_fullsized":"2024-09-15T23:16:35.771666+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:16:33.252218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.774005+0000","last_change":"2024-09-15T23:16:34.758559+0000","last_active":"2024-09-15T23:16:35.774005+0000","last_peered":"2024-09-15T23:16:35.774005+0000","last_clean":"2024-09-15T23:16:35.774005+0000","last_became_active":"2024-09-15T23:16:34.757938+0000","last_became_peered":"2024-09-15T23:16:34.757938+0000","last_unstale":"2024-09-15T23:16:35.774005+0000","last_undegraded":"2024-09-15T23:16:35.774005+0000","last_fullsized":"2024-09-15T23:16:35.774005+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:32:40.873218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.779693+0000","last_change":"2024-09-15T23:16:34.753714+0000","last_active":"2024-09-15T23:16:35.779693+0000","last_peered":"2024-09-15T23:16:35.779693+0000","last_clean":"2024-09-15T23:16:35.779693+0000","last_became_active":"2024-09-15T23:16:34.753394+0000","last_became_peered":"2024-09-15T23:16:34.753394+0000","last_unstale":"2024-09-15T23:16:35.779693+0000","last_undegraded":"2024-09-15T23:16:35.779693+0000","last_fullsized":"2024-09-15T23:16:35.779693+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:17.679671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.779964+0000","last_change":"2024-09-15T23:16:35.779140+0000","last_active":"2024-09-15T23:16:35.779964+0000","last_peered":"2024-09-15T23:16:35.779964+0000","last_clean":"2024-09-15T23:16:35.779964+0000","last_became_active":"2024-09-15T23:16:35.777178+0000","last_became_peered":"2024-09-15T23:16:35.777178+0000","last_unstale":"2024-09-15T23:16:35.779964+0000","last_undegraded":"2024-09-15T23:16:35.779964+0000","last_fullsized":"2024-09-15T23:16:35.779964+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:59.282013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.753198+0000","last_change":"2024-09-15T23:16:34.754647+0000","last_active":"2024-09-15T23:16:35.753198+0000","last_peered":"2024-09-15T23:16:35.753198+0000","last_clean":"2024-09-15T23:16:35.753198+0000","last_became_active":"2024-09-15T23:16:34.754348+0000","last_became_peered":"2024-09-15T23:16:34.754348+0000","last_unstale":"2024-09-15T23:16:35.753198+0000","last_undegraded":"2024-09-15T23:16:35.753198+0000","last_fullsized":"2024-09-15T23:16:35.753198+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:40.263650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.766047+0000","last_change":"2024-09-15T23:16:35.762911+0000","last_active":"2024-09-15T23:16:35.766047+0000","last_peered":"2024-09-15T23:16:35.766047+0000","last_clean":"2024-09-15T23:16:35.766047+0000","last_became_active":"2024-09-15T23:16:35.762046+0000","last_became_peered":"2024-09-15T23:16:35.762046+0000","last_unstale":"2024-09-15T23:16:35.766047+0000","last_undegraded":"2024-09-15T23:16:35.766047+0000","last_fullsized":"2024-09-15T23:16:35.766047+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:51:33.627499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.753068+0000","last_change":"2024-09-15T23:16:34.757604+0000","last_active":"2024-09-15T23:16:35.753068+0000","last_peered":"2024-09-15T23:16:35.753068+0000","last_clean":"2024-09-15T23:16:35.753068+0000","last_became_active":"2024-09-15T23:16:34.757332+0000","last_became_peered":"2024-09-15T23:16:34.757332+0000","last_unstale":"2024-09-15T23:16:35.753068+0000","last_undegraded":"2024-09-15T23:16:35.753068+0000","last_fullsized":"2024-09-15T23:16:35.753068+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:17:52.432695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.770633+0000","last_change":"2024-09-15T23:16:35.768029+0000","last_active":"2024-09-15T23:16:35.770633+0000","last_peered":"2024-09-15T23:16:35.770633+0000","last_clean":"2024-09-15T23:16:35.770633+0000","last_became_active":"2024-09-15T23:16:35.767759+0000","last_became_peered":"2024-09-15T23:16:35.767759+0000","last_unstale":"2024-09-15T23:16:35.770633+0000","last_undegraded":"2024-09-15T23:16:35.770633+0000","last_fullsized":"2024-09-15T23:16:35.770633+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:18.266560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.776244+0000","last_change":"2024-09-15T23:16:35.768727+0000","last_active":"2024-09-15T23:16:35.776244+0000","last_peered":"2024-09-15T23:16:35.776244+0000","last_clean":"2024-09-15T23:16:35.776244+0000","last_became_active":"2024-09-15T23:16:35.768122+0000","last_became_peered":"2024-09-15T23:16:35.768122+0000","last_unstale":"2024-09-15T23:16:35.776244+0000","last_undegraded":"2024-09-15T23:16:35.776244+0000","last_fullsized":"2024-09-15T23:16:35.776244+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:28:48.387265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.776045+0000","last_change":"2024-09-15T23:16:35.766409+0000","last_active":"2024-09-15T23:16:35.776045+0000","last_peered":"2024-09-15T23:16:35.776045+0000","last_clean":"2024-09-15T23:16:35.776045+0000","last_became_active":"2024-09-15T23:16:35.766132+0000","last_became_peered":"2024-09-15T23:16:35.766132+0000","last_unstale":"2024-09-15T23:16:35.776045+0000","last_undegraded":"2024-09-15T23:16:35.776045+0000","last_fullsized":"2024-09-15T23:16:35.776045+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:47.333764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.776218+0000","last_change":"2024-09-15T23:16:34.759842+0000","last_active":"2024-09-15T23:16:35.776218+0000","last_peered":"2024-09-15T23:16:35.776218+0000","last_clean":"2024-09-15T23:16:35.776218+0000","last_became_active":"2024-09-15T23:16:34.759564+0000","last_became_peered":"2024-09-15T23:16:34.759564+0000","last_unstale":"2024-09-15T23:16:35.776218+0000","last_undegraded":"2024-09-15T23:16:35.776218+0000","last_fullsized":"2024-09-15T23:16:35.776218+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:05.285912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.753048+0000","last_change":"2024-09-15T23:16:34.757740+0000","last_active":"2024-09-15T23:16:35.753048+0000","last_peered":"2024-09-15T23:16:35.753048+0000","last_clean":"2024-09-15T23:16:35.753048+0000","last_became_active":"2024-09-15T23:16:34.757307+0000","last_became_peered":"2024-09-15T23:16:34.757307+0000","last_unstale":"2024-09-15T23:16:35.753048+0000","last_undegraded":"2024-09-15T23:16:35.753048+0000","last_fullsized":"2024-09-15T23:16:35.753048+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:30.211666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.775421+0000","last_change":"2024-09-15T23:16:35.773222+0000","last_active":"2024-09-15T23:16:35.775421+0000","last_peered":"2024-09-15T23:16:35.775421+0000","last_clean":"2024-09-15T23:16:35.775421+0000","last_became_active":"2024-09-15T23:16:35.772920+0000","last_became_peered":"2024-09-15T23:16:35.772920+0000","last_unstale":"2024-09-15T23:16:35.775421+0000","last_undegraded":"2024-09-15T23:16:35.775421+0000","last_fullsized":"2024-09-15T23:16:35.775421+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:07.690414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.777091+0000","last_change":"2024-09-15T23:16:35.766539+0000","last_active":"2024-09-15T23:16:35.777091+0000","last_peered":"2024-09-15T23:16:35.777091+0000","last_clean":"2024-09-15T23:16:35.777091+0000","last_became_active":"2024-09-15T23:16:35.766275+0000","last_became_peered":"2024-09-15T23:16:35.766275+0000","last_unstale":"2024-09-15T23:16:35.777091+0000","last_undegraded":"2024-09-15T23:16:35.777091+0000","last_fullsized":"2024-09-15T23:16:35.777091+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:37.401188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"97'8","reported_seq":20,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.775599+0000","last_change":"2024-09-15T23:16:34.761125+0000","last_active":"2024-09-15T23:16:35.775599+0000","last_peered":"2024-09-15T23:16:35.775599+0000","last_clean":"2024-09-15T23:16:35.775599+0000","last_became_active":"2024-09-15T23:16:34.760875+0000","last_became_peered":"2024-09-15T23:16:34.760875+0000","last_unstale":"2024-09-15T23:16:35.775599+0000","last_undegraded":"2024-09-15T23:16:35.775599+0000","last_fullsized":"2024-09-15T23:16:35.775599+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:24:28.230255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.775278+0000","last_change":"2024-09-15T23:16:34.756814+0000","last_active":"2024-09-15T23:16:35.775278+0000","last_peered":"2024-09-15T23:16:35.775278+0000","last_clean":"2024-09-15T23:16:35.775278+0000","last_became_active":"2024-09-15T23:16:34.755902+0000","last_became_peered":"2024-09-15T23:16:34.755902+0000","last_unstale":"2024-09-15T23:16:35.775278+0000","last_undegraded":"2024-09-15T23:16:35.775278+0000","last_fullsized":"2024-09-15T23:16:35.775278+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:21.905853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.752863+0000","last_change":"2024-09-15T23:16:34.760013+0000","last_active":"2024-09-15T23:16:35.752863+0000","last_peered":"2024-09-15T23:16:35.752863+0000","last_clean":"2024-09-15T23:16:35.752863+0000","last_became_active":"2024-09-15T23:16:34.759697+0000","last_became_peered":"2024-09-15T23:16:34.759697+0000","last_unstale":"2024-09-15T23:16:35.752863+0000","last_undegraded":"2024-09-15T23:16:35.752863+0000","last_fullsized":"2024-09-15T23:16:35.752863+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:44.346565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.773234+0000","last_change":"2024-09-15T23:16:35.770304+0000","last_active":"2024-09-15T23:16:35.773234+0000","last_peered":"2024-09-15T23:16:35.773234+0000","last_clean":"2024-09-15T23:16:35.773234+0000","last_became_active":"2024-09-15T23:16:35.769929+0000","last_became_peered":"2024-09-15T23:16:35.769929+0000","last_unstale":"2024-09-15T23:16:35.773234+0000","last_undegraded":"2024-09-15T23:16:35.773234+0000","last_fullsized":"2024-09-15T23:16:35.773234+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:44.316822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.773360+0000","last_change":"2024-09-15T23:16:34.760353+0000","last_active":"2024-09-15T23:16:35.773360+0000","last_peered":"2024-09-15T23:16:35.773360+0000","last_clean":"2024-09-15T23:16:35.773360+0000","last_became_active":"2024-09-15T23:16:34.760092+0000","last_became_peered":"2024-09-15T23:16:34.760092+0000","last_unstale":"2024-09-15T23:16:35.773360+0000","last_undegraded":"2024-09-15T23:16:35.773360+0000","last_fullsized":"2024-09-15T23:16:35.773360+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:58:41.895104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.753048+0000","last_change":"2024-09-15T23:16:34.757928+0000","last_active":"2024-09-15T23:16:35.753048+0000","last_peered":"2024-09-15T23:16:35.753048+0000","last_clean":"2024-09-15T23:16:35.753048+0000","last_became_active":"2024-09-15T23:16:34.757648+0000","last_became_peered":"2024-09-15T23:16:34.757648+0000","last_unstale":"2024-09-15T23:16:35.753048+0000","last_undegraded":"2024-09-15T23:16:35.753048+0000","last_fullsized":"2024-09-15T23:16:35.753048+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:00.288336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.774566+0000","last_change":"2024-09-15T23:16:35.770911+0000","last_active":"2024-09-15T23:16:35.774566+0000","last_peered":"2024-09-15T23:16:35.774566+0000","last_clean":"2024-09-15T23:16:35.774566+0000","last_became_active":"2024-09-15T23:16:35.770620+0000","last_became_peered":"2024-09-15T23:16:35.770620+0000","last_unstale":"2024-09-15T23:16:35.774566+0000","last_undegraded":"2024-09-15T23:16:35.774566+0000","last_fullsized":"2024-09-15T23:16:35.774566+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:45.455400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.757278+0000","last_change":"2024-09-15T23:16:34.755273+0000","last_active":"2024-09-15T23:16:35.757278+0000","last_peered":"2024-09-15T23:16:35.757278+0000","last_clean":"2024-09-15T23:16:35.757278+0000","last_became_active":"2024-09-15T23:16:34.754300+0000","last_became_peered":"2024-09-15T23:16:34.754300+0000","last_unstale":"2024-09-15T23:16:35.757278+0000","last_undegraded":"2024-09-15T23:16:35.757278+0000","last_fullsized":"2024-09-15T23:16:35.757278+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:28.685685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.753258+0000","last_change":"2024-09-15T23:16:34.760017+0000","last_active":"2024-09-15T23:16:35.753258+0000","last_peered":"2024-09-15T23:16:35.753258+0000","last_clean":"2024-09-15T23:16:35.753258+0000","last_became_active":"2024-09-15T23:16:34.759429+0000","last_became_peered":"2024-09-15T23:16:34.759429+0000","last_unstale":"2024-09-15T23:16:35.753258+0000","last_undegraded":"2024-09-15T23:16:35.753258+0000","last_fullsized":"2024-09-15T23:16:35.753258+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:53:35.052932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.775667+0000","last_change":"2024-09-15T23:16:34.757623+0000","last_active":"2024-09-15T23:16:35.775667+0000","last_peered":"2024-09-15T23:16:35.775667+0000","last_clean":"2024-09-15T23:16:35.775667+0000","last_became_active":"2024-09-15T23:16:34.757259+0000","last_became_peered":"2024-09-15T23:16:34.757259+0000","last_unstale":"2024-09-15T23:16:35.775667+0000","last_undegraded":"2024-09-15T23:16:35.775667+0000","last_fullsized":"2024-09-15T23:16:35.775667+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:34.782116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.759608+0000","last_change":"2024-09-15T23:16:34.760115+0000","last_active":"2024-09-15T23:16:35.759608+0000","last_peered":"2024-09-15T23:16:35.759608+0000","last_clean":"2024-09-15T23:16:35.759608+0000","last_became_active":"2024-09-15T23:16:34.759725+0000","last_became_peered":"2024-09-15T23:16:34.759725+0000","last_unstale":"2024-09-15T23:16:35.759608+0000","last_undegraded":"2024-09-15T23:16:35.759608+0000","last_fullsized":"2024-09-15T23:16:35.759608+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:14.836727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.752566+0000","last_change":"2024-09-15T23:16:34.757464+0000","last_active":"2024-09-15T23:16:35.752566+0000","last_peered":"2024-09-15T23:16:35.752566+0000","last_clean":"2024-09-15T23:16:35.752566+0000","last_became_active":"2024-09-15T23:16:34.757190+0000","last_became_peered":"2024-09-15T23:16:34.757190+0000","last_unstale":"2024-09-15T23:16:35.752566+0000","last_undegraded":"2024-09-15T23:16:35.752566+0000","last_fullsized":"2024-09-15T23:16:35.752566+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:24.571810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.775735+0000","last_change":"2024-09-15T23:16:35.767564+0000","last_active":"2024-09-15T23:16:35.775735+0000","last_peered":"2024-09-15T23:16:35.775735+0000","last_clean":"2024-09-15T23:16:35.775735+0000","last_became_active":"2024-09-15T23:16:35.767284+0000","last_became_peered":"2024-09-15T23:16:35.767284+0000","last_unstale":"2024-09-15T23:16:35.775735+0000","last_undegraded":"2024-09-15T23:16:35.775735+0000","last_fullsized":"2024-09-15T23:16:35.775735+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:52.495611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:34.733097+0000","last_change":"2024-09-15T23:16:34.733097+0000","last_active":"2024-09-15T23:16:34.733097+0000","last_peered":"2024-09-15T23:16:34.733097+0000","last_clean":"2024-09-15T23:16:34.733097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:34.733097+0000","last_undegraded":"2024-09-15T23:16:34.733097+0000","last_fullsized":"2024-09-15T23:16:34.733097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.776267+0000","last_change":"2024-09-15T23:16:35.769591+0000","last_active":"2024-09-15T23:16:35.776267+0000","last_peered":"2024-09-15T23:16:35.776267+0000","last_clean":"2024-09-15T23:16:35.776267+0000","last_became_active":"2024-09-15T23:16:35.769282+0000","last_became_peered":"2024-09-15T23:16:35.769282+0000","last_unstale":"2024-09-15T23:16:35.776267+0000","last_undegraded":"2024-09-15T23:16:35.776267+0000","last_fullsized":"2024-09-15T23:16:35.776267+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:06:59.030627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:16:33.728634+0000","last_change":"2024-09-15T23:16:33.728634+0000","last_active":"2024-09-15T23:16:33.728634+0000","last_peered":"2024-09-15T23:16:33.728634+0000","last_clean":"2024-09-15T23:16:33.728634+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:16:33.728634+0000","last_undegraded":"2024-09-15T23:16:33.728634+0000","last_fullsized":"2024-09-15T23:16:33.728634+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":301,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-09-15T23:16:31.728381+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:16:31.728381+0000","last_peered":"2024-09-15T23:16:31.728381+0000","last_clean":"2024-09-15T23:16:31.728381+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:16:31.728381+0000","last_undegraded":"2024-09-15T23:16:31.728381+0000","last_fullsized":"2024-09-15T23:16:31.728381+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":52,"acting":52,"num_store_stats":4},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":32,"acting":32,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476796,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40640,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331200,"statfs":{"total":96636764160,"available":96595148800,"internally_reserved":0,"allocated":1142784,"data_stored":496929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476793,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":40612,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331228,"statfs":{"total":96636764160,"available":96595177472,"internally_reserved":0,"allocated":1130496,"data_stored":491592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476795,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37036,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334804,"statfs":{"total":96636764160,"available":96598839296,"internally_reserved":0,"allocated":1724416,"data_stored":1081960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476795,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32316,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339524,"statfs":{"total":96636764160,"available":96603672576,"internally_reserved":0,"allocated":1142784,"data_stored":496929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542202,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36504,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335336,"statfs":{"total":96636764160,"available":96599384064,"internally_reserved":0,"allocated":1183744,"data_stored":515866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542202,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36508,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335332,"statfs":{"total":96636764160,"available":96599379968,"internally_reserved":0,"allocated":1187840,"data_stored":516468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542201,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37096,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334744,"statfs":{"total":96636764160,"available":96598777856,"internally_reserved":0,"allocated":1789952,"data_stored":1107810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542203,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36516,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335324,"statfs":{"total":96636764160,"available":96599371776,"internally_reserved":0,"allocated":1183744,"data_stored":515830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:16:39.378 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3f is not active+clean 2024-09-15T23:16:39.378 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.378 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3d is not active+clean 2024-09-15T23:16:39.378 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.378 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3b is not active+clean 2024-09-15T23:16:39.378 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.378 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3a is not active+clean 2024-09-15T23:16:39.378 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.379 INFO:tasks.ceph.ceph_manager.ceph:PG 13.38 is not active+clean 2024-09-15T23:16:39.379 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.379 INFO:tasks.ceph.ceph_manager.ceph:PG 13.37 is not active+clean 2024-09-15T23:16:39.379 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.379 INFO:tasks.ceph.ceph_manager.ceph:PG 13.36 is not active+clean 2024-09-15T23:16:39.379 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.379 INFO:tasks.ceph.ceph_manager.ceph:PG 13.34 is not active+clean 2024-09-15T23:16:39.379 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.379 INFO:tasks.ceph.ceph_manager.ceph:PG 13.33 is not active+clean 2024-09-15T23:16:39.379 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.379 INFO:tasks.ceph.ceph_manager.ceph:PG 13.30 is not active+clean 2024-09-15T23:16:39.380 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.380 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2f is not active+clean 2024-09-15T23:16:39.380 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.380 INFO:tasks.ceph.ceph_manager.ceph:PG 13.29 is not active+clean 2024-09-15T23:16:39.380 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.380 INFO:tasks.ceph.ceph_manager.ceph:PG 13.26 is not active+clean 2024-09-15T23:16:39.380 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.380 INFO:tasks.ceph.ceph_manager.ceph:PG 13.25 is not active+clean 2024-09-15T23:16:39.380 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.380 INFO:tasks.ceph.ceph_manager.ceph:PG 13.24 is not active+clean 2024-09-15T23:16:39.380 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.380 INFO:tasks.ceph.ceph_manager.ceph:PG 13.21 is not active+clean 2024-09-15T23:16:39.381 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.381 INFO:tasks.ceph.ceph_manager.ceph:PG 13.20 is not active+clean 2024-09-15T23:16:39.381 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.381 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1e is not active+clean 2024-09-15T23:16:39.381 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.381 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1f is not active+clean 2024-09-15T23:16:39.381 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:33.728634+0000', 'last_change': '2024-09-15T23:16:33.728634+0000', 'last_active': '2024-09-15T23:16:33.728634+0000', 'last_peered': '2024-09-15T23:16:33.728634+0000', 'last_clean': '2024-09-15T23:16:33.728634+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:33.728634+0000', 'last_undegraded': '2024-09-15T23:16:33.728634+0000', 'last_fullsized': '2024-09-15T23:16:33.728634+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.381 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1f is not active+clean 2024-09-15T23:16:39.381 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.381 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1e is not active+clean 2024-09-15T23:16:39.381 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:33.728634+0000', 'last_change': '2024-09-15T23:16:33.728634+0000', 'last_active': '2024-09-15T23:16:33.728634+0000', 'last_peered': '2024-09-15T23:16:33.728634+0000', 'last_clean': '2024-09-15T23:16:33.728634+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:33.728634+0000', 'last_undegraded': '2024-09-15T23:16:33.728634+0000', 'last_fullsized': '2024-09-15T23:16:33.728634+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.382 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1c is not active+clean 2024-09-15T23:16:39.382 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.382 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1d is not active+clean 2024-09-15T23:16:39.382 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.382 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1b is not active+clean 2024-09-15T23:16:39.382 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:33.728634+0000', 'last_change': '2024-09-15T23:16:33.728634+0000', 'last_active': '2024-09-15T23:16:33.728634+0000', 'last_peered': '2024-09-15T23:16:33.728634+0000', 'last_clean': '2024-09-15T23:16:33.728634+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:33.728634+0000', 'last_undegraded': '2024-09-15T23:16:33.728634+0000', 'last_fullsized': '2024-09-15T23:16:33.728634+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.382 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1b is not active+clean 2024-09-15T23:16:39.382 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.382 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1a is not active+clean 2024-09-15T23:16:39.382 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:33.728634+0000', 'last_change': '2024-09-15T23:16:33.728634+0000', 'last_active': '2024-09-15T23:16:33.728634+0000', 'last_peered': '2024-09-15T23:16:33.728634+0000', 'last_clean': '2024-09-15T23:16:33.728634+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:33.728634+0000', 'last_undegraded': '2024-09-15T23:16:33.728634+0000', 'last_fullsized': '2024-09-15T23:16:33.728634+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.382 INFO:tasks.ceph.ceph_manager.ceph:PG 13.18 is not active+clean 2024-09-15T23:16:39.383 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.383 INFO:tasks.ceph.ceph_manager.ceph:PG 12.17 is not active+clean 2024-09-15T23:16:39.383 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:33.728634+0000', 'last_change': '2024-09-15T23:16:33.728634+0000', 'last_active': '2024-09-15T23:16:33.728634+0000', 'last_peered': '2024-09-15T23:16:33.728634+0000', 'last_clean': '2024-09-15T23:16:33.728634+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:33.728634+0000', 'last_undegraded': '2024-09-15T23:16:33.728634+0000', 'last_fullsized': '2024-09-15T23:16:33.728634+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.383 INFO:tasks.ceph.ceph_manager.ceph:PG 13.17 is not active+clean 2024-09-15T23:16:39.383 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.383 INFO:tasks.ceph.ceph_manager.ceph:PG 12.16 is not active+clean 2024-09-15T23:16:39.383 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:33.728634+0000', 'last_change': '2024-09-15T23:16:33.728634+0000', 'last_active': '2024-09-15T23:16:33.728634+0000', 'last_peered': '2024-09-15T23:16:33.728634+0000', 'last_clean': '2024-09-15T23:16:33.728634+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:33.728634+0000', 'last_undegraded': '2024-09-15T23:16:33.728634+0000', 'last_fullsized': '2024-09-15T23:16:33.728634+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.383 INFO:tasks.ceph.ceph_manager.ceph:PG 12.15 is not active+clean 2024-09-15T23:16:39.383 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:33.728634+0000', 'last_change': '2024-09-15T23:16:33.728634+0000', 'last_active': '2024-09-15T23:16:33.728634+0000', 'last_peered': '2024-09-15T23:16:33.728634+0000', 'last_clean': '2024-09-15T23:16:33.728634+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:33.728634+0000', 'last_undegraded': '2024-09-15T23:16:33.728634+0000', 'last_fullsized': '2024-09-15T23:16:33.728634+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.383 INFO:tasks.ceph.ceph_manager.ceph:PG 13.15 is not active+clean 2024-09-15T23:16:39.383 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.384 INFO:tasks.ceph.ceph_manager.ceph:PG 12.14 is not active+clean 2024-09-15T23:16:39.384 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:33.728634+0000', 'last_change': '2024-09-15T23:16:33.728634+0000', 'last_active': '2024-09-15T23:16:33.728634+0000', 'last_peered': '2024-09-15T23:16:33.728634+0000', 'last_clean': '2024-09-15T23:16:33.728634+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:33.728634+0000', 'last_undegraded': '2024-09-15T23:16:33.728634+0000', 'last_fullsized': '2024-09-15T23:16:33.728634+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.384 INFO:tasks.ceph.ceph_manager.ceph:PG 13.13 is not active+clean 2024-09-15T23:16:39.384 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.384 INFO:tasks.ceph.ceph_manager.ceph:PG 12.11 is not active+clean 2024-09-15T23:16:39.384 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:33.728634+0000', 'last_change': '2024-09-15T23:16:33.728634+0000', 'last_active': '2024-09-15T23:16:33.728634+0000', 'last_peered': '2024-09-15T23:16:33.728634+0000', 'last_clean': '2024-09-15T23:16:33.728634+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:33.728634+0000', 'last_undegraded': '2024-09-15T23:16:33.728634+0000', 'last_fullsized': '2024-09-15T23:16:33.728634+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.384 INFO:tasks.ceph.ceph_manager.ceph:PG 13.e is not active+clean 2024-09-15T23:16:39.384 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.384 INFO:tasks.ceph.ceph_manager.ceph:PG 12.f is not active+clean 2024-09-15T23:16:39.384 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:33.728634+0000', 'last_change': '2024-09-15T23:16:33.728634+0000', 'last_active': '2024-09-15T23:16:33.728634+0000', 'last_peered': '2024-09-15T23:16:33.728634+0000', 'last_clean': '2024-09-15T23:16:33.728634+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:33.728634+0000', 'last_undegraded': '2024-09-15T23:16:33.728634+0000', 'last_fullsized': '2024-09-15T23:16:33.728634+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.384 INFO:tasks.ceph.ceph_manager.ceph:PG 13.f is not active+clean 2024-09-15T23:16:39.385 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.385 INFO:tasks.ceph.ceph_manager.ceph:PG 13.d is not active+clean 2024-09-15T23:16:39.385 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.385 INFO:tasks.ceph.ceph_manager.ceph:PG 13.b is not active+clean 2024-09-15T23:16:39.385 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.385 INFO:tasks.ceph.ceph_manager.ceph:PG 13.9 is not active+clean 2024-09-15T23:16:39.385 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.385 INFO:tasks.ceph.ceph_manager.ceph:PG 13.6 is not active+clean 2024-09-15T23:16:39.385 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.385 INFO:tasks.ceph.ceph_manager.ceph:PG 13.7 is not active+clean 2024-09-15T23:16:39.385 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.386 INFO:tasks.ceph.ceph_manager.ceph:PG 13.4 is not active+clean 2024-09-15T23:16:39.386 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.386 INFO:tasks.ceph.ceph_manager.ceph:PG 12.5 is not active+clean 2024-09-15T23:16:39.386 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:33.728634+0000', 'last_change': '2024-09-15T23:16:33.728634+0000', 'last_active': '2024-09-15T23:16:33.728634+0000', 'last_peered': '2024-09-15T23:16:33.728634+0000', 'last_clean': '2024-09-15T23:16:33.728634+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:33.728634+0000', 'last_undegraded': '2024-09-15T23:16:33.728634+0000', 'last_fullsized': '2024-09-15T23:16:33.728634+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.386 INFO:tasks.ceph.ceph_manager.ceph:PG 13.5 is not active+clean 2024-09-15T23:16:39.386 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.387 INFO:tasks.ceph.ceph_manager.ceph:PG 12.4 is not active+clean 2024-09-15T23:16:39.387 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:33.728634+0000', 'last_change': '2024-09-15T23:16:33.728634+0000', 'last_active': '2024-09-15T23:16:33.728634+0000', 'last_peered': '2024-09-15T23:16:33.728634+0000', 'last_clean': '2024-09-15T23:16:33.728634+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:33.728634+0000', 'last_undegraded': '2024-09-15T23:16:33.728634+0000', 'last_fullsized': '2024-09-15T23:16:33.728634+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.387 INFO:tasks.ceph.ceph_manager.ceph:PG 13.2 is not active+clean 2024-09-15T23:16:39.387 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.387 INFO:tasks.ceph.ceph_manager.ceph:PG 12.2 is not active+clean 2024-09-15T23:16:39.387 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:33.728634+0000', 'last_change': '2024-09-15T23:16:33.728634+0000', 'last_active': '2024-09-15T23:16:33.728634+0000', 'last_peered': '2024-09-15T23:16:33.728634+0000', 'last_clean': '2024-09-15T23:16:33.728634+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:33.728634+0000', 'last_undegraded': '2024-09-15T23:16:33.728634+0000', 'last_fullsized': '2024-09-15T23:16:33.728634+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.387 INFO:tasks.ceph.ceph_manager.ceph:PG 13.0 is not active+clean 2024-09-15T23:16:39.387 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.387 INFO:tasks.ceph.ceph_manager.ceph:PG 12.1 is not active+clean 2024-09-15T23:16:39.387 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:33.728634+0000', 'last_change': '2024-09-15T23:16:33.728634+0000', 'last_active': '2024-09-15T23:16:33.728634+0000', 'last_peered': '2024-09-15T23:16:33.728634+0000', 'last_clean': '2024-09-15T23:16:33.728634+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:33.728634+0000', 'last_undegraded': '2024-09-15T23:16:33.728634+0000', 'last_fullsized': '2024-09-15T23:16:33.728634+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.388 INFO:tasks.ceph.ceph_manager.ceph:PG 13.1 is not active+clean 2024-09-15T23:16:39.388 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:34.733097+0000', 'last_change': '2024-09-15T23:16:34.733097+0000', 'last_active': '2024-09-15T23:16:34.733097+0000', 'last_peered': '2024-09-15T23:16:34.733097+0000', 'last_clean': '2024-09-15T23:16:34.733097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:34.733097+0000', 'last_undegraded': '2024-09-15T23:16:34.733097+0000', 'last_fullsized': '2024-09-15T23:16:34.733097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:34.733097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.388 INFO:tasks.ceph.ceph_manager.ceph:PG 12.0 is not active+clean 2024-09-15T23:16:39.388 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:33.728634+0000', 'last_change': '2024-09-15T23:16:33.728634+0000', 'last_active': '2024-09-15T23:16:33.728634+0000', 'last_peered': '2024-09-15T23:16:33.728634+0000', 'last_clean': '2024-09-15T23:16:33.728634+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:33.728634+0000', 'last_undegraded': '2024-09-15T23:16:33.728634+0000', 'last_fullsized': '2024-09-15T23:16:33.728634+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.388 INFO:tasks.ceph.ceph_manager.ceph:PG 12.d is not active+clean 2024-09-15T23:16:39.388 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:16:33.728634+0000', 'last_change': '2024-09-15T23:16:33.728634+0000', 'last_active': '2024-09-15T23:16:33.728634+0000', 'last_peered': '2024-09-15T23:16:33.728634+0000', 'last_clean': '2024-09-15T23:16:33.728634+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:16:33.728634+0000', 'last_undegraded': '2024-09-15T23:16:33.728634+0000', 'last_fullsized': '2024-09-15T23:16:33.728634+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'last_clean_scrub_stamp': '2024-09-15T23:16:33.728634+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:16:39.389 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:16:39.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.511+0000 7fddff111640 1 Processor -- start 2024-09-15T23:16:39.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.511+0000 7fddff111640 1 -- start start 2024-09-15T23:16:39.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.512+0000 7fddff111640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fddf815e790 0x7fddf8073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:39.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.512+0000 7fddff111640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddf81631c0 con 0x7fddf806f730 2024-09-15T23:16:39.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.512+0000 7fddff111640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddf80ae9a0 con 0x7fddf8162c60 2024-09-15T23:16:39.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.512+0000 7fddff111640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fddf815eb70 con 0x7fddf815e790 2024-09-15T23:16:39.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.512+0000 7fddfd6ae640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fddf806f730 0x7fddf806fb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:57234/0 (socket says 172.21.15.123:57234) 2024-09-15T23:16:39.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.512+0000 7fddfd6ae640 1 -- 172.21.15.123:0/1271043802 learned_addr learned my addr 172.21.15.123:0/1271043802 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:39.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.512+0000 7fddf77fe640 1 -- 172.21.15.123:0/1271043802 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4183987964 0 0) 0x7fddf81631c0 con 0x7fddf806f730 2024-09-15T23:16:39.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.512+0000 7fddf77fe640 1 -- 172.21.15.123:0/1271043802 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdde8003520 con 0x7fddf806f730 2024-09-15T23:16:39.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.512+0000 7fddfcead640 1 --2- 172.21.15.123:0/1271043802 >> v2:172.21.15.188:3300/0 conn(0x7fddf815e790 0x7fddf8073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:39.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.512+0000 7fddf77fe640 1 -- 172.21.15.123:0/1271043802 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2357967585 0 0) 0x7fdde8003520 con 0x7fddf806f730 2024-09-15T23:16:39.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.512+0000 7fddf77fe640 1 -- 172.21.15.123:0/1271043802 >> v2:172.21.15.188:3300/0 conn(0x7fddf815e790 msgr2=0x7fddf8073a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:39.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.512+0000 7fddf77fe640 1 --2- 172.21.15.123:0/1271043802 >> v2:172.21.15.188:3300/0 conn(0x7fddf815e790 0x7fddf8073a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:39.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.512+0000 7fddf77fe640 1 -- 172.21.15.123:0/1271043802 >> v1:172.21.15.188:6789/0 conn(0x7fddf8162c60 legacy=0x7fddf80b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:39.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.512+0000 7fddf77fe640 1 -- 172.21.15.123:0/1271043802 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf80aec40 con 0x7fddf806f730 2024-09-15T23:16:39.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.512+0000 7fddf77fe640 1 -- 172.21.15.123:0/1271043802 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fddf00019f0 con 0x7fddf806f730 2024-09-15T23:16:39.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.512+0000 7fddfcead640 1 --2- 172.21.15.123:0/1271043802 >> v2:172.21.15.188:3300/0 conn(0x7fddf815e790 0x7fddf8073a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:16:39.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.512+0000 7fddf77fe640 1 -- 172.21.15.123:0/1271043802 >> v1:172.21.15.123:6789/0 conn(0x7fddf806f730 legacy=0x7fddf806fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:39.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.512+0000 7fddf77fe640 1 --2- 172.21.15.123:0/1271043802 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdde80039b0 0x7fdde8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:39.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.512+0000 7fddf77fe640 1 --2- 172.21.15.123:0/1271043802 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdde8004800 0x7fdde8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:39.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.512+0000 7fddf77fe640 1 --2- 172.21.15.123:0/1271043802 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdde80053c0 0x7fdde800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:39.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.512+0000 7fddf77fe640 1 -- 172.21.15.123:0/1271043802 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdde800c230 con 0x7fdde8004800 2024-09-15T23:16:39.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.512+0000 7fddf77fe640 1 -- 172.21.15.123:0/1271043802 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fdde800c3e0 con 0x7fdde80039b0 2024-09-15T23:16:39.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.512+0000 7fddf77fe640 1 -- 172.21.15.123:0/1271043802 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fdde800c5e0 con 0x7fdde80053c0 2024-09-15T23:16:39.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.512+0000 7fddf7fff640 1 --2- 172.21.15.123:0/1271043802 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdde8004800 0x7fdde8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:39.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.512+0000 7fddfcead640 1 --2- 172.21.15.123:0/1271043802 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdde80039b0 0x7fdde8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:39.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.513+0000 7fddfd6ae640 1 --2- 172.21.15.123:0/1271043802 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdde80053c0 0x7fdde800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:39.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.513+0000 7fddf7fff640 1 -- 172.21.15.123:0/1271043802 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdde80053c0 msgr2=0x7fdde800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:39.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.513+0000 7fddf7fff640 1 --2- 172.21.15.123:0/1271043802 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdde80053c0 0x7fdde800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:39.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.513+0000 7fddf7fff640 1 -- 172.21.15.123:0/1271043802 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdde80039b0 msgr2=0x7fdde8003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:39.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.513+0000 7fddf7fff640 1 --2- 172.21.15.123:0/1271043802 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdde80039b0 0x7fdde8003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:39.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.513+0000 7fddf7fff640 1 -- 172.21.15.123:0/1271043802 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdde8003520 con 0x7fdde8004800 2024-09-15T23:16:39.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.513+0000 7fddfd6ae640 1 -- 172.21.15.123:0/1271043802 reap_dead start 2024-09-15T23:16:39.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.513+0000 7fddfcead640 1 --2- 172.21.15.123:0/1271043802 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdde80039b0 0x7fdde8003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:16:39.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.513+0000 7fddf7fff640 1 --2- 172.21.15.123:0/1271043802 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdde8004800 0x7fdde8004c80 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fdde4001750 tx=0x7fdde8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ede03e7682ef582 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:39.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.513+0000 7fddf77fe640 1 -- 172.21.15.123:0/1271043802 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde4001370 con 0x7fdde8004800 2024-09-15T23:16:39.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.514+0000 7fddf77fe640 1 -- 172.21.15.123:0/1271043802 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdde40052d0 con 0x7fdde8004800 2024-09-15T23:16:39.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.514+0000 7fddf77fe640 1 -- 172.21.15.123:0/1271043802 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde402abe0 con 0x7fdde8004800 2024-09-15T23:16:39.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.514+0000 7fddff111640 1 -- 172.21.15.123:0/1271043802 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdde8004800 msgr2=0x7fdde8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:39.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.514+0000 7fddff111640 1 --2- 172.21.15.123:0/1271043802 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdde8004800 0x7fdde8004c80 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fdde4001750 tx=0x7fdde8005830 comp rx=0 tx=0).stop 2024-09-15T23:16:39.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.514+0000 7fddff111640 1 -- 172.21.15.123:0/1271043802 shutdown_connections 2024-09-15T23:16:39.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.514+0000 7fddff111640 1 --2- 172.21.15.123:0/1271043802 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdde8004800 0x7fdde8004c80 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:39.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.514+0000 7fddff111640 1 -- 172.21.15.123:0/1271043802 >> 172.21.15.123:0/1271043802 conn(0x7fddf80b0a80 msgr2=0x7fddf80b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:39.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.514+0000 7fddff111640 1 -- 172.21.15.123:0/1271043802 shutdown_connections 2024-09-15T23:16:39.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.514+0000 7fddff111640 1 -- 172.21.15.123:0/1271043802 wait complete. 2024-09-15T23:16:39.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.515+0000 7fddff111640 1 Processor -- start 2024-09-15T23:16:39.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.515+0000 7fddff111640 1 -- start start 2024-09-15T23:16:39.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.516+0000 7fddff111640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdde8004800 0x7fddf814f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:39.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.516+0000 7fddff111640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fddf8153bb0 0x7fddf8150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:39.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.516+0000 7fddff111640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fddf8154030 0x7fddf815cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:39.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.516+0000 7fddff111640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fddf806f430 con 0x7fdde8004800 2024-09-15T23:16:39.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.516+0000 7fddff111640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fddf80af200 con 0x7fddf8154030 2024-09-15T23:16:39.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.516+0000 7fddff111640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fddf8073a40 con 0x7fddf8153bb0 2024-09-15T23:16:39.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.516+0000 7fddfcead640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdde8004800 0x7fddf814f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:39.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.516+0000 7fddfcead640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdde8004800 0x7fddf814f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46632/0 (socket says 172.21.15.123:46632) 2024-09-15T23:16:39.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.516+0000 7fddfcead640 1 -- 172.21.15.123:0/2100575739 learned_addr learned my addr 172.21.15.123:0/2100575739 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:39.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.517+0000 7fddf7fff640 1 --2- 172.21.15.123:0/2100575739 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fddf8153bb0 0x7fddf8150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:39.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.517+0000 7fddfd6ae640 1 --2- 172.21.15.123:0/2100575739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fddf8154030 0x7fddf815cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:39.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.517+0000 7fddfcead640 1 -- 172.21.15.123:0/2100575739 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fddf8153bb0 msgr2=0x7fddf8150d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:39.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.517+0000 7fddfcead640 1 --2- 172.21.15.123:0/2100575739 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fddf8153bb0 0x7fddf8150d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:39.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.517+0000 7fddfcead640 1 -- 172.21.15.123:0/2100575739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fddf8154030 msgr2=0x7fddf815cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:39.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.517+0000 7fddfcead640 1 --2- 172.21.15.123:0/2100575739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fddf8154030 0x7fddf815cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:39.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.517+0000 7fddfcead640 1 -- 172.21.15.123:0/2100575739 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf815c1f0 con 0x7fdde8004800 2024-09-15T23:16:39.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.517+0000 7fddfcead640 1 --2- 172.21.15.123:0/2100575739 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdde8004800 0x7fddf814f830 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fddec010870 tx=0x7fddec010d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:39.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.517+0000 7fddf57fa640 1 -- 172.21.15.123:0/2100575739 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddec01a020 con 0x7fdde8004800 2024-09-15T23:16:39.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.517+0000 7fddf57fa640 1 -- 172.21.15.123:0/2100575739 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddec009e50 con 0x7fdde8004800 2024-09-15T23:16:39.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.517+0000 7fddf57fa640 1 -- 172.21.15.123:0/2100575739 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddec00f040 con 0x7fdde8004800 2024-09-15T23:16:39.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.517+0000 7fddff111640 1 -- 172.21.15.123:0/2100575739 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddf815c4d0 con 0x7fdde8004800 2024-09-15T23:16:39.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.517+0000 7fddff111640 1 -- 172.21.15.123:0/2100575739 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddf815ca90 con 0x7fdde8004800 2024-09-15T23:16:39.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.518+0000 7fddff111640 1 -- 172.21.15.123:0/2100575739 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddf806fb40 con 0x7fdde8004800 2024-09-15T23:16:39.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.518+0000 7fddf57fa640 1 -- 172.21.15.123:0/2100575739 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fddec01d020 con 0x7fdde8004800 2024-09-15T23:16:39.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.519+0000 7fddf57fa640 1 --2- 172.21.15.123:0/2100575739 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdddc06c2b0 0x7fdddc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:39.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.519+0000 7fddf57fa640 1 -- 172.21.15.123:0/2100575739 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5709+0+0 (secure 0 0 0) 0x7fddec08bcc0 con 0x7fdde8004800 2024-09-15T23:16:39.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.519+0000 7fddf7fff640 1 --2- 172.21.15.123:0/2100575739 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdddc06c2b0 0x7fdddc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:39.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.520+0000 7fddf7fff640 1 --2- 172.21.15.123:0/2100575739 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdddc06c2b0 0x7fdddc06e770 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fdde4032000 tx=0x7fdde402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:39.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.523+0000 7fddf57fa640 1 -- 172.21.15.123:0/2100575739 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fddec024020 con 0x7fdde8004800 2024-09-15T23:16:39.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.750+0000 7fddff111640 1 -- 172.21.15.123:0/2100575739 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fddf8070210 con 0x7fdde8004800 2024-09-15T23:16:39.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.751+0000 7fddf57fa640 1 -- 172.21.15.123:0/2100575739 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1680 (secure 0 0 0) 0x7fddec027350 con 0x7fdde8004800 2024-09-15T23:16:39.754 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:16:39.754 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":290,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":98,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":54},{"state_name":"active+clean","count":43}],"num_pgs":97,"num_pools":3,"num_objects":13,"data_bytes":590402,"bytes_used":304361472,"bytes_avail":772789751808,"bytes_total":773094113280,"unknown_pgs_ratio":0.55670100450515747,"write_bytes_sec":1791,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":59,"btime":"2024-09-15T23:16:37:768064+0000","id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"b","status":"up:active","gid":7149}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":14,"modified":"2024-09-15T23:16:27.563128+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T23:16:39.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.753+0000 7fddff111640 1 -- 172.21.15.123:0/2100575739 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdddc06c2b0 msgr2=0x7fdddc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:39.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.753+0000 7fddff111640 1 --2- 172.21.15.123:0/2100575739 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdddc06c2b0 0x7fdddc06e770 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fdde4032000 tx=0x7fdde402e000 comp rx=0 tx=0).stop 2024-09-15T23:16:39.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.753+0000 7fddff111640 1 -- 172.21.15.123:0/2100575739 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdde8004800 msgr2=0x7fddf814f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:39.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.753+0000 7fddff111640 1 --2- 172.21.15.123:0/2100575739 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdde8004800 0x7fddf814f830 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fddec010870 tx=0x7fddec010d30 comp rx=0 tx=0).stop 2024-09-15T23:16:39.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.753+0000 7fddff111640 1 -- 172.21.15.123:0/2100575739 shutdown_connections 2024-09-15T23:16:39.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.753+0000 7fddff111640 1 --2- 172.21.15.123:0/2100575739 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fddf8154030 0x7fddf815cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:39.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.753+0000 7fddff111640 1 --2- 172.21.15.123:0/2100575739 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fddf8153bb0 0x7fddf8150d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:39.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.753+0000 7fddff111640 1 --2- 172.21.15.123:0/2100575739 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdddc06c2b0 0x7fdddc06e770 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:39.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.753+0000 7fddff111640 1 --2- 172.21.15.123:0/2100575739 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdde8004800 0x7fddf814f830 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:39.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.753+0000 7fddff111640 1 -- 172.21.15.123:0/2100575739 >> 172.21.15.123:0/2100575739 conn(0x7fddf80b0a80 msgr2=0x7fddf80af5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:39.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.753+0000 7fddff111640 1 -- 172.21.15.123:0/2100575739 shutdown_connections 2024-09-15T23:16:39.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.753+0000 7fddff111640 1 -- 172.21.15.123:0/2100575739 wait complete. 2024-09-15T23:16:39.765 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-15T23:16:39.765 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:16:39.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.862+0000 7fc358b1a640 1 Processor -- start 2024-09-15T23:16:39.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.862+0000 7fc358b1a640 1 -- start start 2024-09-15T23:16:39.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.863+0000 7fc358b1a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc3540b5080 0x7fc3540b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:39.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.863+0000 7fc358b1a640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3540b4020 con 0x7fc354073890 2024-09-15T23:16:39.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.863+0000 7fc358b1a640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3540b42c0 con 0x7fc354145ed0 2024-09-15T23:16:39.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.863+0000 7fc358b1a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc3540b45a0 con 0x7fc3540b5080 2024-09-15T23:16:39.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.863+0000 7fc349d9b640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc354073890 0x7fc3540b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:57246/0 (socket says 172.21.15.123:57246) 2024-09-15T23:16:39.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.863+0000 7fc349d9b640 1 -- 172.21.15.123:0/3470576978 learned_addr learned my addr 172.21.15.123:0/3470576978 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:39.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.863+0000 7fc351d9b640 1 -- 172.21.15.123:0/3470576978 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2960028570 0 0) 0x7fc3540b4020 con 0x7fc354073890 2024-09-15T23:16:39.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.863+0000 7fc351d9b640 1 -- 172.21.15.123:0/3470576978 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc340003520 con 0x7fc354073890 2024-09-15T23:16:39.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.863+0000 7fc352d9d640 1 --2- 172.21.15.123:0/3470576978 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc3540b5080 0x7fc3540b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:39.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.863+0000 7fc351d9b640 1 -- 172.21.15.123:0/3470576978 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 694098646 0 0) 0x7fc340003520 con 0x7fc354073890 2024-09-15T23:16:39.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.863+0000 7fc351d9b640 1 -- 172.21.15.123:0/3470576978 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc3540b5080 msgr2=0x7fc3540b5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:39.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.863+0000 7fc351d9b640 1 --2- 172.21.15.123:0/3470576978 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc3540b5080 0x7fc3540b5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:39.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.863+0000 7fc351d9b640 1 -- 172.21.15.123:0/3470576978 >> v1:172.21.15.188:6789/0 conn(0x7fc354145ed0 legacy=0x7fc354073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:39.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.863+0000 7fc351d9b640 1 -- 172.21.15.123:0/3470576978 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3540b4880 con 0x7fc354073890 2024-09-15T23:16:39.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.863+0000 7fc351d9b640 1 -- 172.21.15.123:0/3470576978 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fc33c001690 con 0x7fc354073890 2024-09-15T23:16:39.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.863+0000 7fc351d9b640 1 -- 172.21.15.123:0/3470576978 >> v1:172.21.15.123:6789/0 conn(0x7fc354073890 legacy=0x7fc3540b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:39.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.864+0000 7fc351d9b640 1 --2- 172.21.15.123:0/3470576978 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc3540b5080 0x7fc3400039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:39.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.864+0000 7fc351d9b640 1 --2- 172.21.15.123:0/3470576978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc340003f60 0x7fc340004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:39.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.864+0000 7fc351d9b640 1 --2- 172.21.15.123:0/3470576978 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc340004d40 0x7fc3400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:39.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.864+0000 7fc351d9b640 1 -- 172.21.15.123:0/3470576978 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc3540b45a0 con 0x7fc340003f60 2024-09-15T23:16:39.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.864+0000 7fc351d9b640 1 -- 172.21.15.123:0/3470576978 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc34000bb30 con 0x7fc340004d40 2024-09-15T23:16:39.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.864+0000 7fc351d9b640 1 -- 172.21.15.123:0/3470576978 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc34000bd30 con 0x7fc3540b5080 2024-09-15T23:16:39.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.864+0000 7fc349d9b640 1 --2- 172.21.15.123:0/3470576978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc340003f60 0x7fc340004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:39.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.864+0000 7fc35259c640 1 --2- 172.21.15.123:0/3470576978 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc3540b5080 0x7fc3400039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:39.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.864+0000 7fc352d9d640 1 --2- 172.21.15.123:0/3470576978 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc340004d40 0x7fc3400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:39.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.864+0000 7fc349d9b640 1 -- 172.21.15.123:0/3470576978 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc3540b5080 msgr2=0x7fc3400039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:39.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.864+0000 7fc349d9b640 1 --2- 172.21.15.123:0/3470576978 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc3540b5080 0x7fc3400039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:39.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.864+0000 7fc349d9b640 1 -- 172.21.15.123:0/3470576978 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc340004d40 msgr2=0x7fc3400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:39.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.864+0000 7fc349d9b640 1 --2- 172.21.15.123:0/3470576978 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc340004d40 0x7fc3400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:39.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.864+0000 7fc349d9b640 1 -- 172.21.15.123:0/3470576978 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc340003520 con 0x7fc340003f60 2024-09-15T23:16:39.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.865+0000 7fc349d9b640 1 --2- 172.21.15.123:0/3470576978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc340003f60 0x7fc340004800 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fc33c00c210 tx=0x7fc340005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f171833ee11553a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:39.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.865+0000 7fc351d9b640 1 -- 172.21.15.123:0/3470576978 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33c007d10 con 0x7fc340003f60 2024-09-15T23:16:39.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.865+0000 7fc351d9b640 1 -- 172.21.15.123:0/3470576978 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc33c005ad0 con 0x7fc340003f60 2024-09-15T23:16:39.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.865+0000 7fc351d9b640 1 -- 172.21.15.123:0/3470576978 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33c007070 con 0x7fc340003f60 2024-09-15T23:16:39.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.865+0000 7fc358b1a640 1 -- 172.21.15.123:0/3470576978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc340003f60 msgr2=0x7fc340004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:39.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.865+0000 7fc358b1a640 1 --2- 172.21.15.123:0/3470576978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc340003f60 0x7fc340004800 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fc33c00c210 tx=0x7fc340005830 comp rx=0 tx=0).stop 2024-09-15T23:16:39.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.865+0000 7fc352d9d640 1 -- 172.21.15.123:0/3470576978 reap_dead start 2024-09-15T23:16:39.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.865+0000 7fc358b1a640 1 -- 172.21.15.123:0/3470576978 shutdown_connections 2024-09-15T23:16:39.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.865+0000 7fc358b1a640 1 -- 172.21.15.123:0/3470576978 >> 172.21.15.123:0/3470576978 conn(0x7fc3540ccec0 msgr2=0x7fc3540cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:39.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.865+0000 7fc358b1a640 1 -- 172.21.15.123:0/3470576978 shutdown_connections 2024-09-15T23:16:39.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.865+0000 7fc358b1a640 1 -- 172.21.15.123:0/3470576978 wait complete. 2024-09-15T23:16:39.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.867+0000 7fc358b1a640 1 Processor -- start 2024-09-15T23:16:39.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.867+0000 7fc358b1a640 1 -- start start 2024-09-15T23:16:39.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.868+0000 7fc358b1a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc340003f60 0x7fc3541561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:39.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.868+0000 7fc358b1a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc354155aa0 0x7fc354154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:39.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.868+0000 7fc358b1a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc3541546b0 0x7fc354072250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:39.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.868+0000 7fc358b1a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc354146430 con 0x7fc340003f60 2024-09-15T23:16:39.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.868+0000 7fc358b1a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc3541462b0 con 0x7fc354155aa0 2024-09-15T23:16:39.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.868+0000 7fc358b1a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc3540b5f90 con 0x7fc3541546b0 2024-09-15T23:16:39.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.868+0000 7fc35259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc340003f60 0x7fc3541561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:39.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.868+0000 7fc35259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc340003f60 0x7fc3541561a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46646/0 (socket says 172.21.15.123:46646) 2024-09-15T23:16:39.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.868+0000 7fc35259c640 1 -- 172.21.15.123:0/2856743633 learned_addr learned my addr 172.21.15.123:0/2856743633 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:39.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.868+0000 7fc349d9b640 1 --2- 172.21.15.123:0/2856743633 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc354155aa0 0x7fc354154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:39.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.868+0000 7fc352d9d640 1 --2- 172.21.15.123:0/2856743633 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc3541546b0 0x7fc354072250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:39.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.868+0000 7fc35259c640 1 -- 172.21.15.123:0/2856743633 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc3541546b0 msgr2=0x7fc354072250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:39.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.868+0000 7fc35259c640 1 --2- 172.21.15.123:0/2856743633 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc3541546b0 0x7fc354072250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:39.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.868+0000 7fc35259c640 1 -- 172.21.15.123:0/2856743633 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc354155aa0 msgr2=0x7fc354154170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:39.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.868+0000 7fc35259c640 1 --2- 172.21.15.123:0/2856743633 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc354155aa0 0x7fc354154170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:39.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.868+0000 7fc35259c640 1 -- 172.21.15.123:0/2856743633 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc354072fd0 con 0x7fc340003f60 2024-09-15T23:16:39.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.868+0000 7fc35259c640 1 --2- 172.21.15.123:0/2856743633 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc340003f60 0x7fc3541561a0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fc34400f820 tx=0x7fc34400fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:39.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.868+0000 7fc34b7fe640 1 -- 172.21.15.123:0/2856743633 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3440050d0 con 0x7fc340003f60 2024-09-15T23:16:39.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.868+0000 7fc34b7fe640 1 -- 172.21.15.123:0/2856743633 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc344018070 con 0x7fc340003f60 2024-09-15T23:16:39.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.868+0000 7fc34b7fe640 1 -- 172.21.15.123:0/2856743633 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc344005490 con 0x7fc340003f60 2024-09-15T23:16:39.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.868+0000 7fc358b1a640 1 -- 172.21.15.123:0/2856743633 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc354154ce0 con 0x7fc340003f60 2024-09-15T23:16:39.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.868+0000 7fc358b1a640 1 -- 172.21.15.123:0/2856743633 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3541552a0 con 0x7fc340003f60 2024-09-15T23:16:39.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.869+0000 7fc358b1a640 1 -- 172.21.15.123:0/2856743633 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc354154ac0 con 0x7fc340003f60 2024-09-15T23:16:39.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.870+0000 7fc34b7fe640 1 -- 172.21.15.123:0/2856743633 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc34400d6d0 con 0x7fc340003f60 2024-09-15T23:16:39.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.870+0000 7fc34b7fe640 1 --2- 172.21.15.123:0/2856743633 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc33406c2e0 0x7fc33406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:39.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.870+0000 7fc34b7fe640 1 -- 172.21.15.123:0/2856743633 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5709+0+0 (secure 0 0 0) 0x7fc34408b0d0 con 0x7fc340003f60 2024-09-15T23:16:39.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.870+0000 7fc349d9b640 1 --2- 172.21.15.123:0/2856743633 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc33406c2e0 0x7fc33406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:39.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.871+0000 7fc349d9b640 1 --2- 172.21.15.123:0/2856743633 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc33406c2e0 0x7fc33406e7a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc33c032000 tx=0x7fc33c009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:39.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:39.874+0000 7fc34b7fe640 1 -- 172.21.15.123:0/2856743633 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc3440591f0 con 0x7fc340003f60 2024-09-15T23:16:40.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:40.036+0000 7fc358b1a640 1 -- 172.21.15.123:0/2856743633 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc3541442e0 con 0x7fc33406c2e0 2024-09-15T23:16:40.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:40.042+0000 7fc34b7fe640 1 -- 172.21.15.123:0/2856743633 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252056 (secure 0 0 0) 0x7fc3541442e0 con 0x7fc33406c2e0 2024-09-15T23:16:40.046 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:16:40.047 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:16:40.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:40.045+0000 7fc358b1a640 1 -- 172.21.15.123:0/2856743633 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc33406c2e0 msgr2=0x7fc33406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:40.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:40.045+0000 7fc358b1a640 1 --2- 172.21.15.123:0/2856743633 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc33406c2e0 0x7fc33406e7a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc33c032000 tx=0x7fc33c009030 comp rx=0 tx=0).stop 2024-09-15T23:16:40.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:40.045+0000 7fc358b1a640 1 -- 172.21.15.123:0/2856743633 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc340003f60 msgr2=0x7fc3541561a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:40.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:40.045+0000 7fc358b1a640 1 --2- 172.21.15.123:0/2856743633 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc340003f60 0x7fc3541561a0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fc34400f820 tx=0x7fc34400fce0 comp rx=0 tx=0).stop 2024-09-15T23:16:40.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:40.045+0000 7fc358b1a640 1 -- 172.21.15.123:0/2856743633 shutdown_connections 2024-09-15T23:16:40.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:40.045+0000 7fc358b1a640 1 --2- 172.21.15.123:0/2856743633 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc3541546b0 0x7fc354072250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:40.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:40.045+0000 7fc358b1a640 1 --2- 172.21.15.123:0/2856743633 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc354155aa0 0x7fc354154170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:40.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:40.045+0000 7fc358b1a640 1 --2- 172.21.15.123:0/2856743633 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc33406c2e0 0x7fc33406e7a0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:40.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:40.045+0000 7fc358b1a640 1 --2- 172.21.15.123:0/2856743633 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc340003f60 0x7fc3541561a0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:40.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:40.045+0000 7fc358b1a640 1 -- 172.21.15.123:0/2856743633 >> 172.21.15.123:0/2856743633 conn(0x7fc3540ccec0 msgr2=0x7fc3540cdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:40.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:40.045+0000 7fc358b1a640 1 -- 172.21.15.123:0/2856743633 shutdown_connections 2024-09-15T23:16:40.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:40.045+0000 7fc358b1a640 1 -- 172.21.15.123:0/2856743633 wait complete. 2024-09-15T23:16:40.057 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":230,"stamp":"2024-09-15T23:16:39.565604+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":118,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":297472,"kb_used_data":10488,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754677248,"statfs":{"total":773094113280,"available":772789501952,"internally_reserved":0,"allocated":10739712,"data_stored":5337124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":293654064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.829606"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250772+0000","last_change":"2024-09-15T23:16:35.772502+0000","last_active":"2024-09-15T23:16:37.250772+0000","last_peered":"2024-09-15T23:16:37.250772+0000","last_clean":"2024-09-15T23:16:37.250772+0000","last_became_active":"2024-09-15T23:16:35.772251+0000","last_became_peered":"2024-09-15T23:16:35.772251+0000","last_unstale":"2024-09-15T23:16:37.250772+0000","last_undegraded":"2024-09-15T23:16:37.250772+0000","last_fullsized":"2024-09-15T23:16:37.250772+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:53:27.451846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.773117+0000","last_change":"2024-09-15T23:16:35.771914+0000","last_active":"2024-09-15T23:16:35.773117+0000","last_peered":"2024-09-15T23:16:35.773117+0000","last_clean":"2024-09-15T23:16:35.773117+0000","last_became_active":"2024-09-15T23:16:35.771622+0000","last_became_peered":"2024-09-15T23:16:35.771622+0000","last_unstale":"2024-09-15T23:16:35.773117+0000","last_undegraded":"2024-09-15T23:16:35.773117+0000","last_fullsized":"2024-09-15T23:16:35.773117+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:22:11.059322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.755182+0000","last_change":"2024-09-15T23:16:35.773003+0000","last_active":"2024-09-15T23:16:36.755182+0000","last_peered":"2024-09-15T23:16:36.755182+0000","last_clean":"2024-09-15T23:16:36.755182+0000","last_became_active":"2024-09-15T23:16:35.772707+0000","last_became_peered":"2024-09-15T23:16:35.772707+0000","last_unstale":"2024-09-15T23:16:36.755182+0000","last_undegraded":"2024-09-15T23:16:36.755182+0000","last_fullsized":"2024-09-15T23:16:36.755182+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:48.740884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.778059+0000","last_change":"2024-09-15T23:16:35.776062+0000","last_active":"2024-09-15T23:16:35.778059+0000","last_peered":"2024-09-15T23:16:35.778059+0000","last_clean":"2024-09-15T23:16:35.778059+0000","last_became_active":"2024-09-15T23:16:35.775769+0000","last_became_peered":"2024-09-15T23:16:35.775769+0000","last_unstale":"2024-09-15T23:16:35.778059+0000","last_undegraded":"2024-09-15T23:16:35.778059+0000","last_fullsized":"2024-09-15T23:16:35.778059+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:38.505005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.249966+0000","last_change":"2024-09-15T23:16:35.767606+0000","last_active":"2024-09-15T23:16:37.249966+0000","last_peered":"2024-09-15T23:16:37.249966+0000","last_clean":"2024-09-15T23:16:37.249966+0000","last_became_active":"2024-09-15T23:16:35.767351+0000","last_became_peered":"2024-09-15T23:16:35.767351+0000","last_unstale":"2024-09-15T23:16:37.249966+0000","last_undegraded":"2024-09-15T23:16:37.249966+0000","last_fullsized":"2024-09-15T23:16:37.249966+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:45.159737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.755413+0000","last_change":"2024-09-15T23:16:35.777680+0000","last_active":"2024-09-15T23:16:36.755413+0000","last_peered":"2024-09-15T23:16:36.755413+0000","last_clean":"2024-09-15T23:16:36.755413+0000","last_became_active":"2024-09-15T23:16:35.776995+0000","last_became_peered":"2024-09-15T23:16:35.776995+0000","last_unstale":"2024-09-15T23:16:36.755413+0000","last_undegraded":"2024-09-15T23:16:36.755413+0000","last_fullsized":"2024-09-15T23:16:36.755413+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:20.518011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.765752+0000","last_change":"2024-09-15T23:16:35.763764+0000","last_active":"2024-09-15T23:16:35.765752+0000","last_peered":"2024-09-15T23:16:35.765752+0000","last_clean":"2024-09-15T23:16:35.765752+0000","last_became_active":"2024-09-15T23:16:35.763503+0000","last_became_peered":"2024-09-15T23:16:35.763503+0000","last_unstale":"2024-09-15T23:16:35.765752+0000","last_undegraded":"2024-09-15T23:16:35.765752+0000","last_fullsized":"2024-09-15T23:16:35.765752+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:07:18.485990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.751801+0000","last_change":"2024-09-15T23:16:35.777518+0000","last_active":"2024-09-15T23:16:36.751801+0000","last_peered":"2024-09-15T23:16:36.751801+0000","last_clean":"2024-09-15T23:16:36.751801+0000","last_became_active":"2024-09-15T23:16:35.777242+0000","last_became_peered":"2024-09-15T23:16:35.777242+0000","last_unstale":"2024-09-15T23:16:36.751801+0000","last_undegraded":"2024-09-15T23:16:36.751801+0000","last_fullsized":"2024-09-15T23:16:36.751801+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:15.239111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250862+0000","last_change":"2024-09-15T23:16:35.767381+0000","last_active":"2024-09-15T23:16:37.250862+0000","last_peered":"2024-09-15T23:16:37.250862+0000","last_clean":"2024-09-15T23:16:37.250862+0000","last_became_active":"2024-09-15T23:16:35.767083+0000","last_became_peered":"2024-09-15T23:16:35.767083+0000","last_unstale":"2024-09-15T23:16:37.250862+0000","last_undegraded":"2024-09-15T23:16:37.250862+0000","last_fullsized":"2024-09-15T23:16:37.250862+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:32.099575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.755224+0000","last_change":"2024-09-15T23:16:35.775413+0000","last_active":"2024-09-15T23:16:36.755224+0000","last_peered":"2024-09-15T23:16:36.755224+0000","last_clean":"2024-09-15T23:16:36.755224+0000","last_became_active":"2024-09-15T23:16:35.775115+0000","last_became_peered":"2024-09-15T23:16:35.775115+0000","last_unstale":"2024-09-15T23:16:36.755224+0000","last_undegraded":"2024-09-15T23:16:36.755224+0000","last_fullsized":"2024-09-15T23:16:36.755224+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:38:13.236740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.778657+0000","last_change":"2024-09-15T23:16:35.773476+0000","last_active":"2024-09-15T23:16:35.778657+0000","last_peered":"2024-09-15T23:16:35.778657+0000","last_clean":"2024-09-15T23:16:35.778657+0000","last_became_active":"2024-09-15T23:16:35.773179+0000","last_became_peered":"2024-09-15T23:16:35.773179+0000","last_unstale":"2024-09-15T23:16:35.778657+0000","last_undegraded":"2024-09-15T23:16:35.778657+0000","last_fullsized":"2024-09-15T23:16:35.778657+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:44.282467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.752073+0000","last_change":"2024-09-15T23:16:35.758729+0000","last_active":"2024-09-15T23:16:36.752073+0000","last_peered":"2024-09-15T23:16:36.752073+0000","last_clean":"2024-09-15T23:16:36.752073+0000","last_became_active":"2024-09-15T23:16:35.756666+0000","last_became_peered":"2024-09-15T23:16:35.756666+0000","last_unstale":"2024-09-15T23:16:36.752073+0000","last_undegraded":"2024-09-15T23:16:36.752073+0000","last_fullsized":"2024-09-15T23:16:36.752073+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:43.751162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250099+0000","last_change":"2024-09-15T23:16:35.768306+0000","last_active":"2024-09-15T23:16:37.250099+0000","last_peered":"2024-09-15T23:16:37.250099+0000","last_clean":"2024-09-15T23:16:37.250099+0000","last_became_active":"2024-09-15T23:16:35.768067+0000","last_became_peered":"2024-09-15T23:16:35.768067+0000","last_unstale":"2024-09-15T23:16:37.250099+0000","last_undegraded":"2024-09-15T23:16:37.250099+0000","last_fullsized":"2024-09-15T23:16:37.250099+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:19:42.756806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.771688+0000","last_change":"2024-09-15T23:16:35.770221+0000","last_active":"2024-09-15T23:16:35.771688+0000","last_peered":"2024-09-15T23:16:35.771688+0000","last_clean":"2024-09-15T23:16:35.771688+0000","last_became_active":"2024-09-15T23:16:35.769976+0000","last_became_peered":"2024-09-15T23:16:35.769976+0000","last_unstale":"2024-09-15T23:16:35.771688+0000","last_undegraded":"2024-09-15T23:16:35.771688+0000","last_fullsized":"2024-09-15T23:16:35.771688+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:49:41.912501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.774690+0000","last_change":"2024-09-15T23:16:35.772327+0000","last_active":"2024-09-15T23:16:35.774690+0000","last_peered":"2024-09-15T23:16:35.774690+0000","last_clean":"2024-09-15T23:16:35.774690+0000","last_became_active":"2024-09-15T23:16:35.772066+0000","last_became_peered":"2024-09-15T23:16:35.772066+0000","last_unstale":"2024-09-15T23:16:35.774690+0000","last_undegraded":"2024-09-15T23:16:35.774690+0000","last_fullsized":"2024-09-15T23:16:35.774690+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:51.344866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.755048+0000","last_change":"2024-09-15T23:16:35.772313+0000","last_active":"2024-09-15T23:16:36.755048+0000","last_peered":"2024-09-15T23:16:36.755048+0000","last_clean":"2024-09-15T23:16:36.755048+0000","last_became_active":"2024-09-15T23:16:35.772049+0000","last_became_peered":"2024-09-15T23:16:35.772049+0000","last_unstale":"2024-09-15T23:16:36.755048+0000","last_undegraded":"2024-09-15T23:16:36.755048+0000","last_fullsized":"2024-09-15T23:16:36.755048+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:15.239111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.751960+0000","last_change":"2024-09-15T23:16:35.757672+0000","last_active":"2024-09-15T23:16:36.751960+0000","last_peered":"2024-09-15T23:16:36.751960+0000","last_clean":"2024-09-15T23:16:36.751960+0000","last_became_active":"2024-09-15T23:16:35.757400+0000","last_became_peered":"2024-09-15T23:16:35.757400+0000","last_unstale":"2024-09-15T23:16:36.751960+0000","last_undegraded":"2024-09-15T23:16:36.751960+0000","last_fullsized":"2024-09-15T23:16:36.751960+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:49.249561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.778039+0000","last_change":"2024-09-15T23:16:35.777304+0000","last_active":"2024-09-15T23:16:35.778039+0000","last_peered":"2024-09-15T23:16:35.778039+0000","last_clean":"2024-09-15T23:16:35.778039+0000","last_became_active":"2024-09-15T23:16:35.777034+0000","last_became_peered":"2024-09-15T23:16:35.777034+0000","last_unstale":"2024-09-15T23:16:35.778039+0000","last_undegraded":"2024-09-15T23:16:35.778039+0000","last_fullsized":"2024-09-15T23:16:35.778039+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:03.652263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.770606+0000","last_change":"2024-09-15T23:16:35.769413+0000","last_active":"2024-09-15T23:16:35.770606+0000","last_peered":"2024-09-15T23:16:35.770606+0000","last_clean":"2024-09-15T23:16:35.770606+0000","last_became_active":"2024-09-15T23:16:35.769094+0000","last_became_peered":"2024-09-15T23:16:35.769094+0000","last_unstale":"2024-09-15T23:16:35.770606+0000","last_undegraded":"2024-09-15T23:16:35.770606+0000","last_fullsized":"2024-09-15T23:16:35.770606+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:41.759033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.778820+0000","last_change":"2024-09-15T23:16:35.778170+0000","last_active":"2024-09-15T23:16:35.778820+0000","last_peered":"2024-09-15T23:16:35.778820+0000","last_clean":"2024-09-15T23:16:35.778820+0000","last_became_active":"2024-09-15T23:16:35.777298+0000","last_became_peered":"2024-09-15T23:16:35.777298+0000","last_unstale":"2024-09-15T23:16:35.778820+0000","last_undegraded":"2024-09-15T23:16:35.778820+0000","last_fullsized":"2024-09-15T23:16:35.778820+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:05:53.779144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.774573+0000","last_change":"2024-09-15T23:16:35.771684+0000","last_active":"2024-09-15T23:16:35.774573+0000","last_peered":"2024-09-15T23:16:35.774573+0000","last_clean":"2024-09-15T23:16:35.774573+0000","last_became_active":"2024-09-15T23:16:35.771290+0000","last_became_peered":"2024-09-15T23:16:35.771290+0000","last_unstale":"2024-09-15T23:16:35.774573+0000","last_undegraded":"2024-09-15T23:16:35.774573+0000","last_fullsized":"2024-09-15T23:16:35.774573+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:02.475226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.759797+0000","last_change":"2024-09-15T23:16:35.756737+0000","last_active":"2024-09-15T23:16:35.759797+0000","last_peered":"2024-09-15T23:16:35.759797+0000","last_clean":"2024-09-15T23:16:35.759797+0000","last_became_active":"2024-09-15T23:16:35.756446+0000","last_became_peered":"2024-09-15T23:16:35.756446+0000","last_unstale":"2024-09-15T23:16:35.759797+0000","last_undegraded":"2024-09-15T23:16:35.759797+0000","last_fullsized":"2024-09-15T23:16:35.759797+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:39.354753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.751841+0000","last_change":"2024-09-15T23:16:35.757013+0000","last_active":"2024-09-15T23:16:36.751841+0000","last_peered":"2024-09-15T23:16:36.751841+0000","last_clean":"2024-09-15T23:16:36.751841+0000","last_became_active":"2024-09-15T23:16:35.756749+0000","last_became_peered":"2024-09-15T23:16:35.756749+0000","last_unstale":"2024-09-15T23:16:36.751841+0000","last_undegraded":"2024-09-15T23:16:36.751841+0000","last_fullsized":"2024-09-15T23:16:36.751841+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:48.740884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.775973+0000","last_change":"2024-09-15T23:16:35.769734+0000","last_active":"2024-09-15T23:16:35.775973+0000","last_peered":"2024-09-15T23:16:35.775973+0000","last_clean":"2024-09-15T23:16:35.775973+0000","last_became_active":"2024-09-15T23:16:35.767578+0000","last_became_peered":"2024-09-15T23:16:35.767578+0000","last_unstale":"2024-09-15T23:16:35.775973+0000","last_undegraded":"2024-09-15T23:16:35.775973+0000","last_fullsized":"2024-09-15T23:16:35.775973+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:49.711543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.776568+0000","last_change":"2024-09-15T23:16:35.769074+0000","last_active":"2024-09-15T23:16:35.776568+0000","last_peered":"2024-09-15T23:16:35.776568+0000","last_clean":"2024-09-15T23:16:35.776568+0000","last_became_active":"2024-09-15T23:16:35.766732+0000","last_became_peered":"2024-09-15T23:16:35.766732+0000","last_unstale":"2024-09-15T23:16:35.776568+0000","last_undegraded":"2024-09-15T23:16:35.776568+0000","last_fullsized":"2024-09-15T23:16:35.776568+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:07:56.105249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250612+0000","last_change":"2024-09-15T23:16:35.766643+0000","last_active":"2024-09-15T23:16:37.250612+0000","last_peered":"2024-09-15T23:16:37.250612+0000","last_clean":"2024-09-15T23:16:37.250612+0000","last_became_active":"2024-09-15T23:16:35.766383+0000","last_became_peered":"2024-09-15T23:16:35.766383+0000","last_unstale":"2024-09-15T23:16:37.250612+0000","last_undegraded":"2024-09-15T23:16:37.250612+0000","last_fullsized":"2024-09-15T23:16:37.250612+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:37:18.218025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250966+0000","last_change":"2024-09-15T23:16:35.774720+0000","last_active":"2024-09-15T23:16:37.250966+0000","last_peered":"2024-09-15T23:16:37.250966+0000","last_clean":"2024-09-15T23:16:37.250966+0000","last_became_active":"2024-09-15T23:16:35.774450+0000","last_became_peered":"2024-09-15T23:16:35.774450+0000","last_unstale":"2024-09-15T23:16:37.250966+0000","last_undegraded":"2024-09-15T23:16:37.250966+0000","last_fullsized":"2024-09-15T23:16:37.250966+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:12:35.625135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250169+0000","last_change":"2024-09-15T23:16:35.767278+0000","last_active":"2024-09-15T23:16:37.250169+0000","last_peered":"2024-09-15T23:16:37.250169+0000","last_clean":"2024-09-15T23:16:37.250169+0000","last_became_active":"2024-09-15T23:16:35.767040+0000","last_became_peered":"2024-09-15T23:16:35.767040+0000","last_unstale":"2024-09-15T23:16:37.250169+0000","last_undegraded":"2024-09-15T23:16:37.250169+0000","last_fullsized":"2024-09-15T23:16:37.250169+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:03.820400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.774070+0000","last_change":"2024-09-15T23:16:35.770923+0000","last_active":"2024-09-15T23:16:35.774070+0000","last_peered":"2024-09-15T23:16:35.774070+0000","last_clean":"2024-09-15T23:16:35.774070+0000","last_became_active":"2024-09-15T23:16:35.770571+0000","last_became_peered":"2024-09-15T23:16:35.770571+0000","last_unstale":"2024-09-15T23:16:35.774070+0000","last_undegraded":"2024-09-15T23:16:35.774070+0000","last_fullsized":"2024-09-15T23:16:35.774070+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:53:28.010064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.771666+0000","last_change":"2024-09-15T23:16:35.769677+0000","last_active":"2024-09-15T23:16:35.771666+0000","last_peered":"2024-09-15T23:16:35.771666+0000","last_clean":"2024-09-15T23:16:35.771666+0000","last_became_active":"2024-09-15T23:16:35.769124+0000","last_became_peered":"2024-09-15T23:16:35.769124+0000","last_unstale":"2024-09-15T23:16:35.771666+0000","last_undegraded":"2024-09-15T23:16:35.771666+0000","last_fullsized":"2024-09-15T23:16:35.771666+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:16:33.252218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.755471+0000","last_change":"2024-09-15T23:16:35.770421+0000","last_active":"2024-09-15T23:16:36.755471+0000","last_peered":"2024-09-15T23:16:36.755471+0000","last_clean":"2024-09-15T23:16:36.755471+0000","last_became_active":"2024-09-15T23:16:35.770177+0000","last_became_peered":"2024-09-15T23:16:35.770177+0000","last_unstale":"2024-09-15T23:16:36.755471+0000","last_undegraded":"2024-09-15T23:16:36.755471+0000","last_fullsized":"2024-09-15T23:16:36.755471+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:43.751162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.755436+0000","last_change":"2024-09-15T23:16:35.778288+0000","last_active":"2024-09-15T23:16:36.755436+0000","last_peered":"2024-09-15T23:16:36.755436+0000","last_clean":"2024-09-15T23:16:36.755436+0000","last_became_active":"2024-09-15T23:16:35.777992+0000","last_became_peered":"2024-09-15T23:16:35.777992+0000","last_unstale":"2024-09-15T23:16:36.755436+0000","last_undegraded":"2024-09-15T23:16:36.755436+0000","last_fullsized":"2024-09-15T23:16:36.755436+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:53.713683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.751954+0000","last_change":"2024-09-15T23:16:35.764215+0000","last_active":"2024-09-15T23:16:36.751954+0000","last_peered":"2024-09-15T23:16:36.751954+0000","last_clean":"2024-09-15T23:16:36.751954+0000","last_became_active":"2024-09-15T23:16:35.763965+0000","last_became_peered":"2024-09-15T23:16:35.763965+0000","last_unstale":"2024-09-15T23:16:36.751954+0000","last_undegraded":"2024-09-15T23:16:36.751954+0000","last_fullsized":"2024-09-15T23:16:36.751954+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:12.605610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"97'4","reported_seq":18,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.251120+0000","last_change":"2024-09-15T23:16:34.760444+0000","last_active":"2024-09-15T23:16:37.251120+0000","last_peered":"2024-09-15T23:16:37.251120+0000","last_clean":"2024-09-15T23:16:37.251120+0000","last_became_active":"2024-09-15T23:16:34.760221+0000","last_became_peered":"2024-09-15T23:16:34.760221+0000","last_unstale":"2024-09-15T23:16:37.251120+0000","last_undegraded":"2024-09-15T23:16:37.251120+0000","last_fullsized":"2024-09-15T23:16:37.251120+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:54.926823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250960+0000","last_change":"2024-09-15T23:16:35.771965+0000","last_active":"2024-09-15T23:16:37.250960+0000","last_peered":"2024-09-15T23:16:37.250960+0000","last_clean":"2024-09-15T23:16:37.250960+0000","last_became_active":"2024-09-15T23:16:35.771706+0000","last_became_peered":"2024-09-15T23:16:35.771706+0000","last_unstale":"2024-09-15T23:16:37.250960+0000","last_undegraded":"2024-09-15T23:16:37.250960+0000","last_fullsized":"2024-09-15T23:16:37.250960+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:29.690148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"97'1","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.755322+0000","last_change":"2024-09-15T23:16:34.750262+0000","last_active":"2024-09-15T23:16:36.755322+0000","last_peered":"2024-09-15T23:16:36.755322+0000","last_clean":"2024-09-15T23:16:36.755322+0000","last_became_active":"2024-09-15T23:16:34.749937+0000","last_became_peered":"2024-09-15T23:16:34.749937+0000","last_unstale":"2024-09-15T23:16:36.755322+0000","last_undegraded":"2024-09-15T23:16:36.755322+0000","last_fullsized":"2024-09-15T23:16:36.755322+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:09.673716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.752062+0000","last_change":"2024-09-15T23:16:35.773435+0000","last_active":"2024-09-15T23:16:36.752062+0000","last_peered":"2024-09-15T23:16:36.752062+0000","last_clean":"2024-09-15T23:16:36.752062+0000","last_became_active":"2024-09-15T23:16:35.773189+0000","last_became_peered":"2024-09-15T23:16:35.773189+0000","last_unstale":"2024-09-15T23:16:36.752062+0000","last_undegraded":"2024-09-15T23:16:36.752062+0000","last_fullsized":"2024-09-15T23:16:36.752062+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:53.713683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.774005+0000","last_change":"2024-09-15T23:16:34.758559+0000","last_active":"2024-09-15T23:16:35.774005+0000","last_peered":"2024-09-15T23:16:35.774005+0000","last_clean":"2024-09-15T23:16:35.774005+0000","last_became_active":"2024-09-15T23:16:34.757938+0000","last_became_peered":"2024-09-15T23:16:34.757938+0000","last_unstale":"2024-09-15T23:16:35.774005+0000","last_undegraded":"2024-09-15T23:16:35.774005+0000","last_fullsized":"2024-09-15T23:16:35.774005+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:32:40.873218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250614+0000","last_change":"2024-09-15T23:16:35.779697+0000","last_active":"2024-09-15T23:16:37.250614+0000","last_peered":"2024-09-15T23:16:37.250614+0000","last_clean":"2024-09-15T23:16:37.250614+0000","last_became_active":"2024-09-15T23:16:35.779433+0000","last_became_peered":"2024-09-15T23:16:35.779433+0000","last_unstale":"2024-09-15T23:16:37.250614+0000","last_undegraded":"2024-09-15T23:16:37.250614+0000","last_fullsized":"2024-09-15T23:16:37.250614+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:41.814102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.779693+0000","last_change":"2024-09-15T23:16:34.753714+0000","last_active":"2024-09-15T23:16:35.779693+0000","last_peered":"2024-09-15T23:16:35.779693+0000","last_clean":"2024-09-15T23:16:35.779693+0000","last_became_active":"2024-09-15T23:16:34.753394+0000","last_became_peered":"2024-09-15T23:16:34.753394+0000","last_unstale":"2024-09-15T23:16:35.779693+0000","last_undegraded":"2024-09-15T23:16:35.779693+0000","last_fullsized":"2024-09-15T23:16:35.779693+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:17.679671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.779964+0000","last_change":"2024-09-15T23:16:35.779140+0000","last_active":"2024-09-15T23:16:35.779964+0000","last_peered":"2024-09-15T23:16:35.779964+0000","last_clean":"2024-09-15T23:16:35.779964+0000","last_became_active":"2024-09-15T23:16:35.777178+0000","last_became_peered":"2024-09-15T23:16:35.777178+0000","last_unstale":"2024-09-15T23:16:35.779964+0000","last_undegraded":"2024-09-15T23:16:35.779964+0000","last_fullsized":"2024-09-15T23:16:35.779964+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:59.282013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"97'1","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.751926+0000","last_change":"2024-09-15T23:16:34.748118+0000","last_active":"2024-09-15T23:16:36.751926+0000","last_peered":"2024-09-15T23:16:36.751926+0000","last_clean":"2024-09-15T23:16:36.751926+0000","last_became_active":"2024-09-15T23:16:34.747846+0000","last_became_peered":"2024-09-15T23:16:34.747846+0000","last_unstale":"2024-09-15T23:16:36.751926+0000","last_undegraded":"2024-09-15T23:16:36.751926+0000","last_fullsized":"2024-09-15T23:16:36.751926+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:40:47.601462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.755284+0000","last_change":"2024-09-15T23:16:35.768826+0000","last_active":"2024-09-15T23:16:36.755284+0000","last_peered":"2024-09-15T23:16:36.755284+0000","last_clean":"2024-09-15T23:16:36.755284+0000","last_became_active":"2024-09-15T23:16:35.768017+0000","last_became_peered":"2024-09-15T23:16:35.768017+0000","last_unstale":"2024-09-15T23:16:36.755284+0000","last_undegraded":"2024-09-15T23:16:36.755284+0000","last_fullsized":"2024-09-15T23:16:36.755284+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:12.605610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"97'1","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.755053+0000","last_change":"2024-09-15T23:16:34.750483+0000","last_active":"2024-09-15T23:16:36.755053+0000","last_peered":"2024-09-15T23:16:36.755053+0000","last_clean":"2024-09-15T23:16:36.755053+0000","last_became_active":"2024-09-15T23:16:34.749988+0000","last_became_peered":"2024-09-15T23:16:34.749988+0000","last_unstale":"2024-09-15T23:16:36.755053+0000","last_undegraded":"2024-09-15T23:16:36.755053+0000","last_fullsized":"2024-09-15T23:16:36.755053+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:02.647800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250062+0000","last_change":"2024-09-15T23:16:35.769049+0000","last_active":"2024-09-15T23:16:37.250062+0000","last_peered":"2024-09-15T23:16:37.250062+0000","last_clean":"2024-09-15T23:16:37.250062+0000","last_became_active":"2024-09-15T23:16:35.768767+0000","last_became_peered":"2024-09-15T23:16:35.768767+0000","last_unstale":"2024-09-15T23:16:37.250062+0000","last_undegraded":"2024-09-15T23:16:37.250062+0000","last_fullsized":"2024-09-15T23:16:37.250062+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:03.670178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.753198+0000","last_change":"2024-09-15T23:16:34.754647+0000","last_active":"2024-09-15T23:16:35.753198+0000","last_peered":"2024-09-15T23:16:35.753198+0000","last_clean":"2024-09-15T23:16:35.753198+0000","last_became_active":"2024-09-15T23:16:34.754348+0000","last_became_peered":"2024-09-15T23:16:34.754348+0000","last_unstale":"2024-09-15T23:16:35.753198+0000","last_undegraded":"2024-09-15T23:16:35.753198+0000","last_fullsized":"2024-09-15T23:16:35.753198+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:40.263650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.766047+0000","last_change":"2024-09-15T23:16:35.762911+0000","last_active":"2024-09-15T23:16:35.766047+0000","last_peered":"2024-09-15T23:16:35.766047+0000","last_clean":"2024-09-15T23:16:35.766047+0000","last_became_active":"2024-09-15T23:16:35.762046+0000","last_became_peered":"2024-09-15T23:16:35.762046+0000","last_unstale":"2024-09-15T23:16:35.766047+0000","last_undegraded":"2024-09-15T23:16:35.766047+0000","last_fullsized":"2024-09-15T23:16:35.766047+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:51:33.627499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.753068+0000","last_change":"2024-09-15T23:16:34.757604+0000","last_active":"2024-09-15T23:16:35.753068+0000","last_peered":"2024-09-15T23:16:35.753068+0000","last_clean":"2024-09-15T23:16:35.753068+0000","last_became_active":"2024-09-15T23:16:34.757332+0000","last_became_peered":"2024-09-15T23:16:34.757332+0000","last_unstale":"2024-09-15T23:16:35.753068+0000","last_undegraded":"2024-09-15T23:16:35.753068+0000","last_fullsized":"2024-09-15T23:16:35.753068+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:17:52.432695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.770633+0000","last_change":"2024-09-15T23:16:35.768029+0000","last_active":"2024-09-15T23:16:35.770633+0000","last_peered":"2024-09-15T23:16:35.770633+0000","last_clean":"2024-09-15T23:16:35.770633+0000","last_became_active":"2024-09-15T23:16:35.767759+0000","last_became_peered":"2024-09-15T23:16:35.767759+0000","last_unstale":"2024-09-15T23:16:35.770633+0000","last_undegraded":"2024-09-15T23:16:35.770633+0000","last_fullsized":"2024-09-15T23:16:35.770633+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:18.266560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250987+0000","last_change":"2024-09-15T23:16:34.755719+0000","last_active":"2024-09-15T23:16:37.250987+0000","last_peered":"2024-09-15T23:16:37.250987+0000","last_clean":"2024-09-15T23:16:37.250987+0000","last_became_active":"2024-09-15T23:16:34.755360+0000","last_became_peered":"2024-09-15T23:16:34.755360+0000","last_unstale":"2024-09-15T23:16:37.250987+0000","last_undegraded":"2024-09-15T23:16:37.250987+0000","last_fullsized":"2024-09-15T23:16:37.250987+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:34.782116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250938+0000","last_change":"2024-09-15T23:16:35.777206+0000","last_active":"2024-09-15T23:16:37.250938+0000","last_peered":"2024-09-15T23:16:37.250938+0000","last_clean":"2024-09-15T23:16:37.250938+0000","last_became_active":"2024-09-15T23:16:35.776955+0000","last_became_peered":"2024-09-15T23:16:35.776955+0000","last_unstale":"2024-09-15T23:16:37.250938+0000","last_undegraded":"2024-09-15T23:16:37.250938+0000","last_fullsized":"2024-09-15T23:16:37.250938+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:53:35.241774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.755325+0000","last_change":"2024-09-15T23:16:34.752778+0000","last_active":"2024-09-15T23:16:36.755325+0000","last_peered":"2024-09-15T23:16:36.755325+0000","last_clean":"2024-09-15T23:16:36.755325+0000","last_became_active":"2024-09-15T23:16:34.752500+0000","last_became_peered":"2024-09-15T23:16:34.752500+0000","last_unstale":"2024-09-15T23:16:36.755325+0000","last_undegraded":"2024-09-15T23:16:36.755325+0000","last_fullsized":"2024-09-15T23:16:36.755325+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:26.811447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.776244+0000","last_change":"2024-09-15T23:16:35.768727+0000","last_active":"2024-09-15T23:16:35.776244+0000","last_peered":"2024-09-15T23:16:35.776244+0000","last_clean":"2024-09-15T23:16:35.776244+0000","last_became_active":"2024-09-15T23:16:35.768122+0000","last_became_peered":"2024-09-15T23:16:35.768122+0000","last_unstale":"2024-09-15T23:16:35.776244+0000","last_undegraded":"2024-09-15T23:16:35.776244+0000","last_fullsized":"2024-09-15T23:16:35.776244+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:28:48.387265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"97'3","reported_seq":17,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250707+0000","last_change":"2024-09-15T23:16:34.759305+0000","last_active":"2024-09-15T23:16:37.250707+0000","last_peered":"2024-09-15T23:16:37.250707+0000","last_clean":"2024-09-15T23:16:37.250707+0000","last_became_active":"2024-09-15T23:16:34.758950+0000","last_became_peered":"2024-09-15T23:16:34.758950+0000","last_unstale":"2024-09-15T23:16:37.250707+0000","last_undegraded":"2024-09-15T23:16:37.250707+0000","last_fullsized":"2024-09-15T23:16:37.250707+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:17:52.432695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250840+0000","last_change":"2024-09-15T23:16:35.775547+0000","last_active":"2024-09-15T23:16:37.250840+0000","last_peered":"2024-09-15T23:16:37.250840+0000","last_clean":"2024-09-15T23:16:37.250840+0000","last_became_active":"2024-09-15T23:16:35.775287+0000","last_became_peered":"2024-09-15T23:16:35.775287+0000","last_unstale":"2024-09-15T23:16:37.250840+0000","last_undegraded":"2024-09-15T23:16:37.250840+0000","last_fullsized":"2024-09-15T23:16:37.250840+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:36:57.006574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"97'6","reported_seq":20,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.752114+0000","last_change":"2024-09-15T23:16:34.750641+0000","last_active":"2024-09-15T23:16:36.752114+0000","last_peered":"2024-09-15T23:16:36.752114+0000","last_clean":"2024-09-15T23:16:36.752114+0000","last_became_active":"2024-09-15T23:16:34.750397+0000","last_became_peered":"2024-09-15T23:16:34.750397+0000","last_unstale":"2024-09-15T23:16:36.752114+0000","last_undegraded":"2024-09-15T23:16:36.752114+0000","last_fullsized":"2024-09-15T23:16:36.752114+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:26.811447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.776045+0000","last_change":"2024-09-15T23:16:35.766409+0000","last_active":"2024-09-15T23:16:35.776045+0000","last_peered":"2024-09-15T23:16:35.776045+0000","last_clean":"2024-09-15T23:16:35.776045+0000","last_became_active":"2024-09-15T23:16:35.766132+0000","last_became_peered":"2024-09-15T23:16:35.766132+0000","last_unstale":"2024-09-15T23:16:35.776045+0000","last_undegraded":"2024-09-15T23:16:35.776045+0000","last_fullsized":"2024-09-15T23:16:35.776045+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:47.333764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.776218+0000","last_change":"2024-09-15T23:16:34.759842+0000","last_active":"2024-09-15T23:16:35.776218+0000","last_peered":"2024-09-15T23:16:35.776218+0000","last_clean":"2024-09-15T23:16:35.776218+0000","last_became_active":"2024-09-15T23:16:34.759564+0000","last_became_peered":"2024-09-15T23:16:34.759564+0000","last_unstale":"2024-09-15T23:16:35.776218+0000","last_undegraded":"2024-09-15T23:16:35.776218+0000","last_fullsized":"2024-09-15T23:16:35.776218+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:05.285912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250227+0000","last_change":"2024-09-15T23:16:35.769018+0000","last_active":"2024-09-15T23:16:37.250227+0000","last_peered":"2024-09-15T23:16:37.250227+0000","last_clean":"2024-09-15T23:16:37.250227+0000","last_became_active":"2024-09-15T23:16:35.768724+0000","last_became_peered":"2024-09-15T23:16:35.768724+0000","last_unstale":"2024-09-15T23:16:37.250227+0000","last_undegraded":"2024-09-15T23:16:37.250227+0000","last_fullsized":"2024-09-15T23:16:37.250227+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:19:47.133158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.753048+0000","last_change":"2024-09-15T23:16:34.757740+0000","last_active":"2024-09-15T23:16:35.753048+0000","last_peered":"2024-09-15T23:16:35.753048+0000","last_clean":"2024-09-15T23:16:35.753048+0000","last_became_active":"2024-09-15T23:16:34.757307+0000","last_became_peered":"2024-09-15T23:16:34.757307+0000","last_unstale":"2024-09-15T23:16:35.753048+0000","last_undegraded":"2024-09-15T23:16:35.753048+0000","last_fullsized":"2024-09-15T23:16:35.753048+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:30.211666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.775421+0000","last_change":"2024-09-15T23:16:35.773222+0000","last_active":"2024-09-15T23:16:35.775421+0000","last_peered":"2024-09-15T23:16:35.775421+0000","last_clean":"2024-09-15T23:16:35.775421+0000","last_became_active":"2024-09-15T23:16:35.772920+0000","last_became_peered":"2024-09-15T23:16:35.772920+0000","last_unstale":"2024-09-15T23:16:35.775421+0000","last_undegraded":"2024-09-15T23:16:35.775421+0000","last_fullsized":"2024-09-15T23:16:35.775421+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:07.690414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.755018+0000","last_change":"2024-09-15T23:16:34.752080+0000","last_active":"2024-09-15T23:16:36.755018+0000","last_peered":"2024-09-15T23:16:36.755018+0000","last_clean":"2024-09-15T23:16:36.755018+0000","last_became_active":"2024-09-15T23:16:34.751579+0000","last_became_peered":"2024-09-15T23:16:34.751579+0000","last_unstale":"2024-09-15T23:16:36.755018+0000","last_undegraded":"2024-09-15T23:16:36.755018+0000","last_fullsized":"2024-09-15T23:16:36.755018+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:48.707081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.777091+0000","last_change":"2024-09-15T23:16:35.766539+0000","last_active":"2024-09-15T23:16:35.777091+0000","last_peered":"2024-09-15T23:16:35.777091+0000","last_clean":"2024-09-15T23:16:35.777091+0000","last_became_active":"2024-09-15T23:16:35.766275+0000","last_became_peered":"2024-09-15T23:16:35.766275+0000","last_unstale":"2024-09-15T23:16:35.777091+0000","last_undegraded":"2024-09-15T23:16:35.777091+0000","last_fullsized":"2024-09-15T23:16:35.777091+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:37.401188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"97'8","reported_seq":20,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.775599+0000","last_change":"2024-09-15T23:16:34.761125+0000","last_active":"2024-09-15T23:16:35.775599+0000","last_peered":"2024-09-15T23:16:35.775599+0000","last_clean":"2024-09-15T23:16:35.775599+0000","last_became_active":"2024-09-15T23:16:34.760875+0000","last_became_peered":"2024-09-15T23:16:34.760875+0000","last_unstale":"2024-09-15T23:16:35.775599+0000","last_undegraded":"2024-09-15T23:16:35.775599+0000","last_fullsized":"2024-09-15T23:16:35.775599+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:24:28.230255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.751974+0000","last_change":"2024-09-15T23:16:35.769852+0000","last_active":"2024-09-15T23:16:36.751974+0000","last_peered":"2024-09-15T23:16:36.751974+0000","last_clean":"2024-09-15T23:16:36.751974+0000","last_became_active":"2024-09-15T23:16:35.769570+0000","last_became_peered":"2024-09-15T23:16:35.769570+0000","last_unstale":"2024-09-15T23:16:36.751974+0000","last_undegraded":"2024-09-15T23:16:36.751974+0000","last_fullsized":"2024-09-15T23:16:36.751974+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:08:08.193790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"97'1","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250793+0000","last_change":"2024-09-15T23:16:34.757760+0000","last_active":"2024-09-15T23:16:37.250793+0000","last_peered":"2024-09-15T23:16:37.250793+0000","last_clean":"2024-09-15T23:16:37.250793+0000","last_became_active":"2024-09-15T23:16:34.757448+0000","last_became_peered":"2024-09-15T23:16:34.757448+0000","last_unstale":"2024-09-15T23:16:37.250793+0000","last_undegraded":"2024-09-15T23:16:37.250793+0000","last_fullsized":"2024-09-15T23:16:37.250793+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:21:50.814999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.755359+0000","last_change":"2024-09-15T23:16:35.772336+0000","last_active":"2024-09-15T23:16:36.755359+0000","last_peered":"2024-09-15T23:16:36.755359+0000","last_clean":"2024-09-15T23:16:36.755359+0000","last_became_active":"2024-09-15T23:16:35.772083+0000","last_became_peered":"2024-09-15T23:16:35.772083+0000","last_unstale":"2024-09-15T23:16:36.755359+0000","last_undegraded":"2024-09-15T23:16:36.755359+0000","last_fullsized":"2024-09-15T23:16:36.755359+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:08:08.193790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.775278+0000","last_change":"2024-09-15T23:16:34.756814+0000","last_active":"2024-09-15T23:16:35.775278+0000","last_peered":"2024-09-15T23:16:35.775278+0000","last_clean":"2024-09-15T23:16:35.775278+0000","last_became_active":"2024-09-15T23:16:34.755902+0000","last_became_peered":"2024-09-15T23:16:34.755902+0000","last_unstale":"2024-09-15T23:16:35.775278+0000","last_undegraded":"2024-09-15T23:16:35.775278+0000","last_fullsized":"2024-09-15T23:16:35.775278+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:21.905853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.751856+0000","last_change":"2024-09-15T23:16:35.769171+0000","last_active":"2024-09-15T23:16:36.751856+0000","last_peered":"2024-09-15T23:16:36.751856+0000","last_clean":"2024-09-15T23:16:36.751856+0000","last_became_active":"2024-09-15T23:16:35.768920+0000","last_became_peered":"2024-09-15T23:16:35.768920+0000","last_unstale":"2024-09-15T23:16:36.751856+0000","last_undegraded":"2024-09-15T23:16:36.751856+0000","last_fullsized":"2024-09-15T23:16:36.751856+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:38:13.236740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.752863+0000","last_change":"2024-09-15T23:16:34.760013+0000","last_active":"2024-09-15T23:16:35.752863+0000","last_peered":"2024-09-15T23:16:35.752863+0000","last_clean":"2024-09-15T23:16:35.752863+0000","last_became_active":"2024-09-15T23:16:34.759697+0000","last_became_peered":"2024-09-15T23:16:34.759697+0000","last_unstale":"2024-09-15T23:16:35.752863+0000","last_undegraded":"2024-09-15T23:16:35.752863+0000","last_fullsized":"2024-09-15T23:16:35.752863+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:44.346565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.773234+0000","last_change":"2024-09-15T23:16:35.770304+0000","last_active":"2024-09-15T23:16:35.773234+0000","last_peered":"2024-09-15T23:16:35.773234+0000","last_clean":"2024-09-15T23:16:35.773234+0000","last_became_active":"2024-09-15T23:16:35.769929+0000","last_became_peered":"2024-09-15T23:16:35.769929+0000","last_unstale":"2024-09-15T23:16:35.773234+0000","last_undegraded":"2024-09-15T23:16:35.773234+0000","last_fullsized":"2024-09-15T23:16:35.773234+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:44.316822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.773360+0000","last_change":"2024-09-15T23:16:34.760353+0000","last_active":"2024-09-15T23:16:35.773360+0000","last_peered":"2024-09-15T23:16:35.773360+0000","last_clean":"2024-09-15T23:16:35.773360+0000","last_became_active":"2024-09-15T23:16:34.760092+0000","last_became_peered":"2024-09-15T23:16:34.760092+0000","last_unstale":"2024-09-15T23:16:35.773360+0000","last_undegraded":"2024-09-15T23:16:35.773360+0000","last_fullsized":"2024-09-15T23:16:35.773360+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:58:41.895104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250228+0000","last_change":"2024-09-15T23:16:35.774231+0000","last_active":"2024-09-15T23:16:37.250228+0000","last_peered":"2024-09-15T23:16:37.250228+0000","last_clean":"2024-09-15T23:16:37.250228+0000","last_became_active":"2024-09-15T23:16:35.773956+0000","last_became_peered":"2024-09-15T23:16:35.773956+0000","last_unstale":"2024-09-15T23:16:37.250228+0000","last_undegraded":"2024-09-15T23:16:37.250228+0000","last_fullsized":"2024-09-15T23:16:37.250228+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:21.324613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.753048+0000","last_change":"2024-09-15T23:16:34.757928+0000","last_active":"2024-09-15T23:16:35.753048+0000","last_peered":"2024-09-15T23:16:35.753048+0000","last_clean":"2024-09-15T23:16:35.753048+0000","last_became_active":"2024-09-15T23:16:34.757648+0000","last_became_peered":"2024-09-15T23:16:34.757648+0000","last_unstale":"2024-09-15T23:16:35.753048+0000","last_undegraded":"2024-09-15T23:16:35.753048+0000","last_fullsized":"2024-09-15T23:16:35.753048+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:00.288336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.774566+0000","last_change":"2024-09-15T23:16:35.770911+0000","last_active":"2024-09-15T23:16:35.774566+0000","last_peered":"2024-09-15T23:16:35.774566+0000","last_clean":"2024-09-15T23:16:35.774566+0000","last_became_active":"2024-09-15T23:16:35.770620+0000","last_became_peered":"2024-09-15T23:16:35.770620+0000","last_unstale":"2024-09-15T23:16:35.774566+0000","last_undegraded":"2024-09-15T23:16:35.774566+0000","last_fullsized":"2024-09-15T23:16:35.774566+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:45.455400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.757278+0000","last_change":"2024-09-15T23:16:34.755273+0000","last_active":"2024-09-15T23:16:35.757278+0000","last_peered":"2024-09-15T23:16:35.757278+0000","last_clean":"2024-09-15T23:16:35.757278+0000","last_became_active":"2024-09-15T23:16:34.754300+0000","last_became_peered":"2024-09-15T23:16:34.754300+0000","last_unstale":"2024-09-15T23:16:35.757278+0000","last_undegraded":"2024-09-15T23:16:35.757278+0000","last_fullsized":"2024-09-15T23:16:35.757278+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:28.685685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.751777+0000","last_change":"2024-09-15T23:16:35.771612+0000","last_active":"2024-09-15T23:16:36.751777+0000","last_peered":"2024-09-15T23:16:36.751777+0000","last_clean":"2024-09-15T23:16:36.751777+0000","last_became_active":"2024-09-15T23:16:35.771357+0000","last_became_peered":"2024-09-15T23:16:35.771357+0000","last_unstale":"2024-09-15T23:16:36.751777+0000","last_undegraded":"2024-09-15T23:16:36.751777+0000","last_fullsized":"2024-09-15T23:16:36.751777+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:20.518011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.753258+0000","last_change":"2024-09-15T23:16:34.760017+0000","last_active":"2024-09-15T23:16:35.753258+0000","last_peered":"2024-09-15T23:16:35.753258+0000","last_clean":"2024-09-15T23:16:35.753258+0000","last_became_active":"2024-09-15T23:16:34.759429+0000","last_became_peered":"2024-09-15T23:16:34.759429+0000","last_unstale":"2024-09-15T23:16:35.753258+0000","last_undegraded":"2024-09-15T23:16:35.753258+0000","last_fullsized":"2024-09-15T23:16:35.753258+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:53:35.052932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250736+0000","last_change":"2024-09-15T23:16:35.769357+0000","last_active":"2024-09-15T23:16:37.250736+0000","last_peered":"2024-09-15T23:16:37.250736+0000","last_clean":"2024-09-15T23:16:37.250736+0000","last_became_active":"2024-09-15T23:16:35.769044+0000","last_became_peered":"2024-09-15T23:16:35.769044+0000","last_unstale":"2024-09-15T23:16:37.250736+0000","last_undegraded":"2024-09-15T23:16:37.250736+0000","last_fullsized":"2024-09-15T23:16:37.250736+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:34:00.825682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"97'2","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.775667+0000","last_change":"2024-09-15T23:16:34.757623+0000","last_active":"2024-09-15T23:16:35.775667+0000","last_peered":"2024-09-15T23:16:35.775667+0000","last_clean":"2024-09-15T23:16:35.775667+0000","last_became_active":"2024-09-15T23:16:34.757259+0000","last_became_peered":"2024-09-15T23:16:34.757259+0000","last_unstale":"2024-09-15T23:16:35.775667+0000","last_undegraded":"2024-09-15T23:16:35.775667+0000","last_fullsized":"2024-09-15T23:16:35.775667+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:34.782116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250639+0000","last_change":"2024-09-15T23:16:35.766800+0000","last_active":"2024-09-15T23:16:37.250639+0000","last_peered":"2024-09-15T23:16:37.250639+0000","last_clean":"2024-09-15T23:16:37.250639+0000","last_became_active":"2024-09-15T23:16:35.766037+0000","last_became_peered":"2024-09-15T23:16:35.766037+0000","last_unstale":"2024-09-15T23:16:37.250639+0000","last_undegraded":"2024-09-15T23:16:37.250639+0000","last_fullsized":"2024-09-15T23:16:37.250639+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:21.538460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.759608+0000","last_change":"2024-09-15T23:16:34.760115+0000","last_active":"2024-09-15T23:16:35.759608+0000","last_peered":"2024-09-15T23:16:35.759608+0000","last_clean":"2024-09-15T23:16:35.759608+0000","last_became_active":"2024-09-15T23:16:34.759725+0000","last_became_peered":"2024-09-15T23:16:34.759725+0000","last_unstale":"2024-09-15T23:16:35.759608+0000","last_undegraded":"2024-09-15T23:16:35.759608+0000","last_fullsized":"2024-09-15T23:16:35.759608+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:14.836727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250617+0000","last_change":"2024-09-15T23:16:35.767354+0000","last_active":"2024-09-15T23:16:37.250617+0000","last_peered":"2024-09-15T23:16:37.250617+0000","last_clean":"2024-09-15T23:16:37.250617+0000","last_became_active":"2024-09-15T23:16:35.767135+0000","last_became_peered":"2024-09-15T23:16:35.767135+0000","last_unstale":"2024-09-15T23:16:37.250617+0000","last_undegraded":"2024-09-15T23:16:37.250617+0000","last_fullsized":"2024-09-15T23:16:37.250617+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:47:05.422107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.751874+0000","last_change":"2024-09-15T23:16:34.756863+0000","last_active":"2024-09-15T23:16:36.751874+0000","last_peered":"2024-09-15T23:16:36.751874+0000","last_clean":"2024-09-15T23:16:36.751874+0000","last_became_active":"2024-09-15T23:16:34.756563+0000","last_became_peered":"2024-09-15T23:16:34.756563+0000","last_unstale":"2024-09-15T23:16:36.751874+0000","last_undegraded":"2024-09-15T23:16:36.751874+0000","last_fullsized":"2024-09-15T23:16:36.751874+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:09.673716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.755355+0000","last_change":"2024-09-15T23:16:35.773555+0000","last_active":"2024-09-15T23:16:36.755355+0000","last_peered":"2024-09-15T23:16:36.755355+0000","last_clean":"2024-09-15T23:16:36.755355+0000","last_became_active":"2024-09-15T23:16:35.773307+0000","last_became_peered":"2024-09-15T23:16:35.773307+0000","last_unstale":"2024-09-15T23:16:36.755355+0000","last_undegraded":"2024-09-15T23:16:36.755355+0000","last_fullsized":"2024-09-15T23:16:36.755355+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:49.249561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.755151+0000","last_change":"2024-09-15T23:16:34.756107+0000","last_active":"2024-09-15T23:16:36.755151+0000","last_peered":"2024-09-15T23:16:36.755151+0000","last_clean":"2024-09-15T23:16:36.755151+0000","last_became_active":"2024-09-15T23:16:34.755830+0000","last_became_peered":"2024-09-15T23:16:34.755830+0000","last_unstale":"2024-09-15T23:16:36.755151+0000","last_undegraded":"2024-09-15T23:16:36.755151+0000","last_fullsized":"2024-09-15T23:16:36.755151+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:43.278004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250087+0000","last_change":"2024-09-15T23:16:35.775907+0000","last_active":"2024-09-15T23:16:37.250087+0000","last_peered":"2024-09-15T23:16:37.250087+0000","last_clean":"2024-09-15T23:16:37.250087+0000","last_became_active":"2024-09-15T23:16:35.775645+0000","last_became_peered":"2024-09-15T23:16:35.775645+0000","last_unstale":"2024-09-15T23:16:37.250087+0000","last_undegraded":"2024-09-15T23:16:37.250087+0000","last_fullsized":"2024-09-15T23:16:37.250087+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:36.679954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.752566+0000","last_change":"2024-09-15T23:16:34.757464+0000","last_active":"2024-09-15T23:16:35.752566+0000","last_peered":"2024-09-15T23:16:35.752566+0000","last_clean":"2024-09-15T23:16:35.752566+0000","last_became_active":"2024-09-15T23:16:34.757190+0000","last_became_peered":"2024-09-15T23:16:34.757190+0000","last_unstale":"2024-09-15T23:16:35.752566+0000","last_undegraded":"2024-09-15T23:16:35.752566+0000","last_fullsized":"2024-09-15T23:16:35.752566+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:24.571810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.775735+0000","last_change":"2024-09-15T23:16:35.767564+0000","last_active":"2024-09-15T23:16:35.775735+0000","last_peered":"2024-09-15T23:16:35.775735+0000","last_clean":"2024-09-15T23:16:35.775735+0000","last_became_active":"2024-09-15T23:16:35.767284+0000","last_became_peered":"2024-09-15T23:16:35.767284+0000","last_unstale":"2024-09-15T23:16:35.775735+0000","last_undegraded":"2024-09-15T23:16:35.775735+0000","last_fullsized":"2024-09-15T23:16:35.775735+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:52.495611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.755157+0000","last_change":"2024-09-15T23:16:34.750259+0000","last_active":"2024-09-15T23:16:36.755157+0000","last_peered":"2024-09-15T23:16:36.755157+0000","last_clean":"2024-09-15T23:16:36.755157+0000","last_became_active":"2024-09-15T23:16:34.749647+0000","last_became_peered":"2024-09-15T23:16:34.749647+0000","last_unstale":"2024-09-15T23:16:36.755157+0000","last_undegraded":"2024-09-15T23:16:36.755157+0000","last_fullsized":"2024-09-15T23:16:36.755157+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:40:47.601462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250123+0000","last_change":"2024-09-15T23:16:35.771292+0000","last_active":"2024-09-15T23:16:37.250123+0000","last_peered":"2024-09-15T23:16:37.250123+0000","last_clean":"2024-09-15T23:16:37.250123+0000","last_became_active":"2024-09-15T23:16:35.771032+0000","last_became_peered":"2024-09-15T23:16:35.771032+0000","last_unstale":"2024-09-15T23:16:37.250123+0000","last_undegraded":"2024-09-15T23:16:37.250123+0000","last_fullsized":"2024-09-15T23:16:37.250123+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:41:02.503484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250547+0000","last_change":"2024-09-15T23:16:34.758195+0000","last_active":"2024-09-15T23:16:37.250547+0000","last_peered":"2024-09-15T23:16:37.250547+0000","last_clean":"2024-09-15T23:16:37.250547+0000","last_became_active":"2024-09-15T23:16:34.757947+0000","last_became_peered":"2024-09-15T23:16:34.757947+0000","last_unstale":"2024-09-15T23:16:37.250547+0000","last_undegraded":"2024-09-15T23:16:37.250547+0000","last_fullsized":"2024-09-15T23:16:37.250547+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:44.346565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250454+0000","last_change":"2024-09-15T23:16:35.768342+0000","last_active":"2024-09-15T23:16:37.250454+0000","last_peered":"2024-09-15T23:16:37.250454+0000","last_clean":"2024-09-15T23:16:37.250454+0000","last_became_active":"2024-09-15T23:16:35.768094+0000","last_became_peered":"2024-09-15T23:16:35.768094+0000","last_unstale":"2024-09-15T23:16:37.250454+0000","last_undegraded":"2024-09-15T23:16:37.250454+0000","last_fullsized":"2024-09-15T23:16:37.250454+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:39:23.122386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.751784+0000","last_change":"2024-09-15T23:16:34.753399+0000","last_active":"2024-09-15T23:16:36.751784+0000","last_peered":"2024-09-15T23:16:36.751784+0000","last_clean":"2024-09-15T23:16:36.751784+0000","last_became_active":"2024-09-15T23:16:34.753079+0000","last_became_peered":"2024-09-15T23:16:34.753079+0000","last_unstale":"2024-09-15T23:16:36.751784+0000","last_undegraded":"2024-09-15T23:16:36.751784+0000","last_fullsized":"2024-09-15T23:16:36.751784+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:02.647800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2024-09-15T23:16:35.776267+0000","last_change":"2024-09-15T23:16:35.769591+0000","last_active":"2024-09-15T23:16:35.776267+0000","last_peered":"2024-09-15T23:16:35.776267+0000","last_clean":"2024-09-15T23:16:35.776267+0000","last_became_active":"2024-09-15T23:16:35.769282+0000","last_became_peered":"2024-09-15T23:16:35.769282+0000","last_unstale":"2024-09-15T23:16:35.776267+0000","last_undegraded":"2024-09-15T23:16:35.776267+0000","last_fullsized":"2024-09-15T23:16:35.776267+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:06:59.030627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"97'1","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.251055+0000","last_change":"2024-09-15T23:16:34.759083+0000","last_active":"2024-09-15T23:16:37.251055+0000","last_peered":"2024-09-15T23:16:37.251055+0000","last_clean":"2024-09-15T23:16:37.251055+0000","last_became_active":"2024-09-15T23:16:34.758789+0000","last_became_peered":"2024-09-15T23:16:34.758789+0000","last_unstale":"2024-09-15T23:16:37.251055+0000","last_undegraded":"2024-09-15T23:16:37.251055+0000","last_fullsized":"2024-09-15T23:16:37.251055+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:06.650439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":310,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250113+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:16:37.250113+0000","last_peered":"2024-09-15T23:16:37.250113+0000","last_clean":"2024-09-15T23:16:37.250113+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:16:37.250113+0000","last_undegraded":"2024-09-15T23:16:37.250113+0000","last_fullsized":"2024-09-15T23:16:37.250113+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476797,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40692,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331148,"statfs":{"total":96636764160,"available":96595095552,"internally_reserved":0,"allocated":1204224,"data_stored":522770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476794,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40676,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331164,"statfs":{"total":96636764160,"available":96595111936,"internally_reserved":0,"allocated":1191936,"data_stored":522096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476796,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37104,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334736,"statfs":{"total":96636764160,"available":96598769664,"internally_reserved":0,"allocated":1789952,"data_stored":1112554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476796,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1208320,"data_stored":523730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542202,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36504,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335336,"statfs":{"total":96636764160,"available":96599384064,"internally_reserved":0,"allocated":1183744,"data_stored":515866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542202,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36508,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335332,"statfs":{"total":96636764160,"available":96599379968,"internally_reserved":0,"allocated":1187840,"data_stored":516468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542201,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37096,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334744,"statfs":{"total":96636764160,"available":96598777856,"internally_reserved":0,"allocated":1789952,"data_stored":1107810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542203,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36516,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335324,"statfs":{"total":96636764160,"available":96599371776,"internally_reserved":0,"allocated":1183744,"data_stored":515830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:16:43.062 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:16:43.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.170+0000 7fd84d19f640 1 Processor -- start 2024-09-15T23:16:43.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.170+0000 7fd84d19f640 1 -- start start 2024-09-15T23:16:43.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.171+0000 7fd84d19f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd848145ed0 0x7fd8480b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:43.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.171+0000 7fd84d19f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd8480b5f90 0x7fd8480735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:43.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.171+0000 7fd84d19f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8480b4020 con 0x7fd848073180 2024-09-15T23:16:43.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.171+0000 7fd84d19f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fd848073b00 con 0x7fd848145ed0 2024-09-15T23:16:43.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.171+0000 7fd84d19f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd8480b42c0 con 0x7fd8480b5f90 2024-09-15T23:16:43.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.171+0000 7fd846d9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd848145ed0 0x7fd8480b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:43.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.171+0000 7fd846d9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd848145ed0 0x7fd8480b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46648/0 (socket says 172.21.15.123:46648) 2024-09-15T23:16:43.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.171+0000 7fd846d9d640 1 -- 172.21.15.123:0/3456299876 learned_addr learned my addr 172.21.15.123:0/3456299876 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:43.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.171+0000 7fd84759e640 1 --2- 172.21.15.123:0/3456299876 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd8480b5f90 0x7fd8480735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:43.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.171+0000 7fd846d9d640 1 -- 172.21.15.123:0/3456299876 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd8480b5f90 msgr2=0x7fd8480735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:43.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.171+0000 7fd846d9d640 1 --2- 172.21.15.123:0/3456299876 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd8480b5f90 0x7fd8480735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:43.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.171+0000 7fd846d9d640 1 -- 172.21.15.123:0/3456299876 >> v1:172.21.15.188:6789/0 conn(0x7fd848073180 legacy=0x7fd8480b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:43.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.171+0000 7fd846d9d640 1 -- 172.21.15.123:0/3456299876 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8480b45a0 con 0x7fd848145ed0 2024-09-15T23:16:43.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.172+0000 7fd846d9d640 1 --2- 172.21.15.123:0/3456299876 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd848145ed0 0x7fd8480b5080 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fd848073c80 tx=0x7fd83802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a30b5d71f2243b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:43.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.172+0000 7fd84659c640 1 -- 172.21.15.123:0/3456299876 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd838037070 con 0x7fd848145ed0 2024-09-15T23:16:43.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.172+0000 7fd84659c640 1 -- 172.21.15.123:0/3456299876 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd838032440 con 0x7fd848145ed0 2024-09-15T23:16:43.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.172+0000 7fd84659c640 1 -- 172.21.15.123:0/3456299876 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd838032810 con 0x7fd848145ed0 2024-09-15T23:16:43.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.173+0000 7fd84d19f640 1 -- 172.21.15.123:0/3456299876 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd848145ed0 msgr2=0x7fd8480b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:43.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.173+0000 7fd84d19f640 1 --2- 172.21.15.123:0/3456299876 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd848145ed0 0x7fd8480b5080 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fd848073c80 tx=0x7fd83802a250 comp rx=0 tx=0).stop 2024-09-15T23:16:43.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.173+0000 7fd84d19f640 1 -- 172.21.15.123:0/3456299876 shutdown_connections 2024-09-15T23:16:43.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.173+0000 7fd84d19f640 1 --2- 172.21.15.123:0/3456299876 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd8480b5f90 0x7fd8480735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:43.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.173+0000 7fd84d19f640 1 --2- 172.21.15.123:0/3456299876 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd848145ed0 0x7fd8480b5080 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:43.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.173+0000 7fd84d19f640 1 -- 172.21.15.123:0/3456299876 >> 172.21.15.123:0/3456299876 conn(0x7fd8480ccec0 msgr2=0x7fd8480cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:43.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.173+0000 7fd84d19f640 1 -- 172.21.15.123:0/3456299876 shutdown_connections 2024-09-15T23:16:43.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.173+0000 7fd84d19f640 1 -- 172.21.15.123:0/3456299876 wait complete. 2024-09-15T23:16:43.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.174+0000 7fd84d19f640 1 Processor -- start 2024-09-15T23:16:43.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.174+0000 7fd84d19f640 1 -- start start 2024-09-15T23:16:43.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.175+0000 7fd84d19f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd848073180 0x7fd8480724f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:43.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.175+0000 7fd84d19f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd8480b5f90 0x7fd848157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:43.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.175+0000 7fd84d19f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd848145ed0 0x7fd848157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:43.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.175+0000 7fd84d19f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd8481462b0 con 0x7fd848145ed0 2024-09-15T23:16:43.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.175+0000 7fd84d19f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd8480b4b60 con 0x7fd848073180 2024-09-15T23:16:43.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.175+0000 7fd84d19f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd848146430 con 0x7fd8480b5f90 2024-09-15T23:16:43.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.175+0000 7fd84759e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd848145ed0 0x7fd848157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:43.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.175+0000 7fd84759e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd848145ed0 0x7fd848157220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46658/0 (socket says 172.21.15.123:46658) 2024-09-15T23:16:43.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.175+0000 7fd846d9d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd848073180 0x7fd8480724f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:43.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.175+0000 7fd84759e640 1 -- 172.21.15.123:0/1876903840 learned_addr learned my addr 172.21.15.123:0/1876903840 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:43.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.175+0000 7fd83ffff640 1 --2- 172.21.15.123:0/1876903840 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd8480b5f90 0x7fd848157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:43.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.175+0000 7fd84759e640 1 -- 172.21.15.123:0/1876903840 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd8480b5f90 msgr2=0x7fd848157bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:43.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.175+0000 7fd84759e640 1 --2- 172.21.15.123:0/1876903840 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd8480b5f90 0x7fd848157bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:43.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.175+0000 7fd84759e640 1 -- 172.21.15.123:0/1876903840 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd848073180 msgr2=0x7fd8480724f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:43.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.175+0000 7fd84759e640 1 --2- 172.21.15.123:0/1876903840 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd848073180 0x7fd8480724f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:43.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.175+0000 7fd84759e640 1 -- 172.21.15.123:0/1876903840 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd848072b00 con 0x7fd848145ed0 2024-09-15T23:16:43.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.176+0000 7fd84759e640 1 --2- 172.21.15.123:0/1876903840 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd848145ed0 0x7fd848157220 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fd840007e70 tx=0x7fd84000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:43.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.176+0000 7fd83f7fe640 1 -- 172.21.15.123:0/1876903840 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd840014620 con 0x7fd848145ed0 2024-09-15T23:16:43.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.176+0000 7fd83f7fe640 1 -- 172.21.15.123:0/1876903840 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd840019070 con 0x7fd848145ed0 2024-09-15T23:16:43.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.176+0000 7fd84d19f640 1 -- 172.21.15.123:0/1876903840 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd848072de0 con 0x7fd848145ed0 2024-09-15T23:16:43.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.176+0000 7fd83f7fe640 1 -- 172.21.15.123:0/1876903840 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd840014a20 con 0x7fd848145ed0 2024-09-15T23:16:43.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.176+0000 7fd84d19f640 1 -- 172.21.15.123:0/1876903840 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd848071fd0 con 0x7fd848145ed0 2024-09-15T23:16:43.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.177+0000 7fd84d19f640 1 -- 172.21.15.123:0/1876903840 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8480735c0 con 0x7fd848145ed0 2024-09-15T23:16:43.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.177+0000 7fd83f7fe640 1 -- 172.21.15.123:0/1876903840 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd840014bc0 con 0x7fd848145ed0 2024-09-15T23:16:43.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.178+0000 7fd83f7fe640 1 --2- 172.21.15.123:0/1876903840 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd82806c2b0 0x7fd82806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:43.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.178+0000 7fd83f7fe640 1 -- 172.21.15.123:0/1876903840 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5709+0+0 (secure 0 0 0) 0x7fd84008bb90 con 0x7fd848145ed0 2024-09-15T23:16:43.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.178+0000 7fd846d9d640 1 --2- 172.21.15.123:0/1876903840 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd82806c2b0 0x7fd82806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:43.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.179+0000 7fd846d9d640 1 --2- 172.21.15.123:0/1876903840 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd82806c2b0 0x7fd82806e770 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd838034000 tx=0x7fd83802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:43.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.182+0000 7fd83f7fe640 1 -- 172.21.15.123:0/1876903840 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd840059d40 con 0x7fd848145ed0 2024-09-15T23:16:43.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.346+0000 7fd84d19f640 1 -- 172.21.15.123:0/1876903840 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd8480cfac0 con 0x7fd82806c2b0 2024-09-15T23:16:43.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.352+0000 7fd83f7fe640 1 -- 172.21.15.123:0/1876903840 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252038 (secure 0 0 0) 0x7fd8480cfac0 con 0x7fd82806c2b0 2024-09-15T23:16:43.356 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:16:43.358 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:16:43.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.355+0000 7fd84d19f640 1 -- 172.21.15.123:0/1876903840 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd82806c2b0 msgr2=0x7fd82806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:43.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.355+0000 7fd84d19f640 1 --2- 172.21.15.123:0/1876903840 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd82806c2b0 0x7fd82806e770 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd838034000 tx=0x7fd83802e000 comp rx=0 tx=0).stop 2024-09-15T23:16:43.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.355+0000 7fd84d19f640 1 -- 172.21.15.123:0/1876903840 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd848145ed0 msgr2=0x7fd848157220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:43.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.355+0000 7fd84d19f640 1 --2- 172.21.15.123:0/1876903840 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd848145ed0 0x7fd848157220 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fd840007e70 tx=0x7fd84000e4b0 comp rx=0 tx=0).stop 2024-09-15T23:16:43.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.355+0000 7fd84d19f640 1 -- 172.21.15.123:0/1876903840 shutdown_connections 2024-09-15T23:16:43.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.355+0000 7fd84d19f640 1 --2- 172.21.15.123:0/1876903840 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd82806c2b0 0x7fd82806e770 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:43.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.355+0000 7fd84d19f640 1 --2- 172.21.15.123:0/1876903840 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd848145ed0 0x7fd848157220 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:43.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.355+0000 7fd84d19f640 1 --2- 172.21.15.123:0/1876903840 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd8480b5f90 0x7fd848157bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:43.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.355+0000 7fd84d19f640 1 --2- 172.21.15.123:0/1876903840 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd848073180 0x7fd8480724f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:43.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.355+0000 7fd84d19f640 1 -- 172.21.15.123:0/1876903840 >> 172.21.15.123:0/1876903840 conn(0x7fd8480ccec0 msgr2=0x7fd8480b2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:43.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.355+0000 7fd84d19f640 1 -- 172.21.15.123:0/1876903840 shutdown_connections 2024-09-15T23:16:43.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.355+0000 7fd84d19f640 1 -- 172.21.15.123:0/1876903840 wait complete. 2024-09-15T23:16:43.369 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":231,"stamp":"2024-09-15T23:16:41.566224+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":190,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":297520,"kb_used_data":10536,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754677200,"statfs":{"total":773094113280,"available":772789452800,"internally_reserved":0,"allocated":10788864,"data_stored":5362324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":293654064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.825711"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250772+0000","last_change":"2024-09-15T23:16:35.772502+0000","last_active":"2024-09-15T23:16:37.250772+0000","last_peered":"2024-09-15T23:16:37.250772+0000","last_clean":"2024-09-15T23:16:37.250772+0000","last_became_active":"2024-09-15T23:16:35.772251+0000","last_became_peered":"2024-09-15T23:16:35.772251+0000","last_unstale":"2024-09-15T23:16:37.250772+0000","last_undegraded":"2024-09-15T23:16:37.250772+0000","last_fullsized":"2024-09-15T23:16:37.250772+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:53:27.451846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.756062+0000","last_change":"2024-09-15T23:16:35.771914+0000","last_active":"2024-09-15T23:16:36.756062+0000","last_peered":"2024-09-15T23:16:36.756062+0000","last_clean":"2024-09-15T23:16:36.756062+0000","last_became_active":"2024-09-15T23:16:35.771622+0000","last_became_peered":"2024-09-15T23:16:35.771622+0000","last_unstale":"2024-09-15T23:16:36.756062+0000","last_undegraded":"2024-09-15T23:16:36.756062+0000","last_fullsized":"2024-09-15T23:16:36.756062+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:31:07.561001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.755182+0000","last_change":"2024-09-15T23:16:35.773003+0000","last_active":"2024-09-15T23:16:36.755182+0000","last_peered":"2024-09-15T23:16:36.755182+0000","last_clean":"2024-09-15T23:16:36.755182+0000","last_became_active":"2024-09-15T23:16:35.772707+0000","last_became_peered":"2024-09-15T23:16:35.772707+0000","last_unstale":"2024-09-15T23:16:36.755182+0000","last_undegraded":"2024-09-15T23:16:36.755182+0000","last_fullsized":"2024-09-15T23:16:36.755182+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:48.740884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250533+0000","last_change":"2024-09-15T23:16:35.776062+0000","last_active":"2024-09-15T23:16:37.250533+0000","last_peered":"2024-09-15T23:16:37.250533+0000","last_clean":"2024-09-15T23:16:37.250533+0000","last_became_active":"2024-09-15T23:16:35.775769+0000","last_became_peered":"2024-09-15T23:16:35.775769+0000","last_unstale":"2024-09-15T23:16:37.250533+0000","last_undegraded":"2024-09-15T23:16:37.250533+0000","last_fullsized":"2024-09-15T23:16:37.250533+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:49:01.036924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.249966+0000","last_change":"2024-09-15T23:16:35.767606+0000","last_active":"2024-09-15T23:16:37.249966+0000","last_peered":"2024-09-15T23:16:37.249966+0000","last_clean":"2024-09-15T23:16:37.249966+0000","last_became_active":"2024-09-15T23:16:35.767351+0000","last_became_peered":"2024-09-15T23:16:35.767351+0000","last_unstale":"2024-09-15T23:16:37.249966+0000","last_undegraded":"2024-09-15T23:16:37.249966+0000","last_fullsized":"2024-09-15T23:16:37.249966+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:45.159737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.755413+0000","last_change":"2024-09-15T23:16:35.777680+0000","last_active":"2024-09-15T23:16:36.755413+0000","last_peered":"2024-09-15T23:16:36.755413+0000","last_clean":"2024-09-15T23:16:36.755413+0000","last_became_active":"2024-09-15T23:16:35.776995+0000","last_became_peered":"2024-09-15T23:16:35.776995+0000","last_unstale":"2024-09-15T23:16:36.755413+0000","last_undegraded":"2024-09-15T23:16:36.755413+0000","last_fullsized":"2024-09-15T23:16:36.755413+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:20.518011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.755925+0000","last_change":"2024-09-15T23:16:35.763764+0000","last_active":"2024-09-15T23:16:36.755925+0000","last_peered":"2024-09-15T23:16:36.755925+0000","last_clean":"2024-09-15T23:16:36.755925+0000","last_became_active":"2024-09-15T23:16:35.763503+0000","last_became_peered":"2024-09-15T23:16:35.763503+0000","last_unstale":"2024-09-15T23:16:36.755925+0000","last_undegraded":"2024-09-15T23:16:36.755925+0000","last_fullsized":"2024-09-15T23:16:36.755925+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:57:26.754089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.751801+0000","last_change":"2024-09-15T23:16:35.777518+0000","last_active":"2024-09-15T23:16:36.751801+0000","last_peered":"2024-09-15T23:16:36.751801+0000","last_clean":"2024-09-15T23:16:36.751801+0000","last_became_active":"2024-09-15T23:16:35.777242+0000","last_became_peered":"2024-09-15T23:16:35.777242+0000","last_unstale":"2024-09-15T23:16:36.751801+0000","last_undegraded":"2024-09-15T23:16:36.751801+0000","last_fullsized":"2024-09-15T23:16:36.751801+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:15.239111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250862+0000","last_change":"2024-09-15T23:16:35.767381+0000","last_active":"2024-09-15T23:16:37.250862+0000","last_peered":"2024-09-15T23:16:37.250862+0000","last_clean":"2024-09-15T23:16:37.250862+0000","last_became_active":"2024-09-15T23:16:35.767083+0000","last_became_peered":"2024-09-15T23:16:35.767083+0000","last_unstale":"2024-09-15T23:16:37.250862+0000","last_undegraded":"2024-09-15T23:16:37.250862+0000","last_fullsized":"2024-09-15T23:16:37.250862+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:50:32.099575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.755224+0000","last_change":"2024-09-15T23:16:35.775413+0000","last_active":"2024-09-15T23:16:36.755224+0000","last_peered":"2024-09-15T23:16:36.755224+0000","last_clean":"2024-09-15T23:16:36.755224+0000","last_became_active":"2024-09-15T23:16:35.775115+0000","last_became_peered":"2024-09-15T23:16:35.775115+0000","last_unstale":"2024-09-15T23:16:36.755224+0000","last_undegraded":"2024-09-15T23:16:36.755224+0000","last_fullsized":"2024-09-15T23:16:36.755224+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:38:13.236740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.981707+0000","last_change":"2024-09-15T23:16:35.773476+0000","last_active":"2024-09-15T23:16:36.981707+0000","last_peered":"2024-09-15T23:16:36.981707+0000","last_clean":"2024-09-15T23:16:36.981707+0000","last_became_active":"2024-09-15T23:16:35.773179+0000","last_became_peered":"2024-09-15T23:16:35.773179+0000","last_unstale":"2024-09-15T23:16:36.981707+0000","last_undegraded":"2024-09-15T23:16:36.981707+0000","last_fullsized":"2024-09-15T23:16:36.981707+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:55:12.572556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.752073+0000","last_change":"2024-09-15T23:16:35.758729+0000","last_active":"2024-09-15T23:16:36.752073+0000","last_peered":"2024-09-15T23:16:36.752073+0000","last_clean":"2024-09-15T23:16:36.752073+0000","last_became_active":"2024-09-15T23:16:35.756666+0000","last_became_peered":"2024-09-15T23:16:35.756666+0000","last_unstale":"2024-09-15T23:16:36.752073+0000","last_undegraded":"2024-09-15T23:16:36.752073+0000","last_fullsized":"2024-09-15T23:16:36.752073+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:43.751162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250099+0000","last_change":"2024-09-15T23:16:35.768306+0000","last_active":"2024-09-15T23:16:37.250099+0000","last_peered":"2024-09-15T23:16:37.250099+0000","last_clean":"2024-09-15T23:16:37.250099+0000","last_became_active":"2024-09-15T23:16:35.768067+0000","last_became_peered":"2024-09-15T23:16:35.768067+0000","last_unstale":"2024-09-15T23:16:37.250099+0000","last_undegraded":"2024-09-15T23:16:37.250099+0000","last_fullsized":"2024-09-15T23:16:37.250099+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:19:42.756806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250297+0000","last_change":"2024-09-15T23:16:35.770221+0000","last_active":"2024-09-15T23:16:37.250297+0000","last_peered":"2024-09-15T23:16:37.250297+0000","last_clean":"2024-09-15T23:16:37.250297+0000","last_became_active":"2024-09-15T23:16:35.769976+0000","last_became_peered":"2024-09-15T23:16:35.769976+0000","last_unstale":"2024-09-15T23:16:37.250297+0000","last_undegraded":"2024-09-15T23:16:37.250297+0000","last_fullsized":"2024-09-15T23:16:37.250297+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:36.679954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.755691+0000","last_change":"2024-09-15T23:16:35.772327+0000","last_active":"2024-09-15T23:16:36.755691+0000","last_peered":"2024-09-15T23:16:36.755691+0000","last_clean":"2024-09-15T23:16:36.755691+0000","last_became_active":"2024-09-15T23:16:35.772066+0000","last_became_peered":"2024-09-15T23:16:35.772066+0000","last_unstale":"2024-09-15T23:16:36.755691+0000","last_undegraded":"2024-09-15T23:16:36.755691+0000","last_fullsized":"2024-09-15T23:16:36.755691+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:55:46.232241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.755048+0000","last_change":"2024-09-15T23:16:35.772313+0000","last_active":"2024-09-15T23:16:36.755048+0000","last_peered":"2024-09-15T23:16:36.755048+0000","last_clean":"2024-09-15T23:16:36.755048+0000","last_became_active":"2024-09-15T23:16:35.772049+0000","last_became_peered":"2024-09-15T23:16:35.772049+0000","last_unstale":"2024-09-15T23:16:36.755048+0000","last_undegraded":"2024-09-15T23:16:36.755048+0000","last_fullsized":"2024-09-15T23:16:36.755048+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:15.239111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.751960+0000","last_change":"2024-09-15T23:16:35.757672+0000","last_active":"2024-09-15T23:16:36.751960+0000","last_peered":"2024-09-15T23:16:36.751960+0000","last_clean":"2024-09-15T23:16:36.751960+0000","last_became_active":"2024-09-15T23:16:35.757400+0000","last_became_peered":"2024-09-15T23:16:35.757400+0000","last_unstale":"2024-09-15T23:16:36.751960+0000","last_undegraded":"2024-09-15T23:16:36.751960+0000","last_fullsized":"2024-09-15T23:16:36.751960+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:49.249561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.981679+0000","last_change":"2024-09-15T23:16:35.777304+0000","last_active":"2024-09-15T23:16:36.981679+0000","last_peered":"2024-09-15T23:16:36.981679+0000","last_clean":"2024-09-15T23:16:36.981679+0000","last_became_active":"2024-09-15T23:16:35.777034+0000","last_became_peered":"2024-09-15T23:16:35.777034+0000","last_unstale":"2024-09-15T23:16:36.981679+0000","last_undegraded":"2024-09-15T23:16:36.981679+0000","last_fullsized":"2024-09-15T23:16:36.981679+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:06.171092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.251019+0000","last_change":"2024-09-15T23:16:35.769413+0000","last_active":"2024-09-15T23:16:37.251019+0000","last_peered":"2024-09-15T23:16:37.251019+0000","last_clean":"2024-09-15T23:16:37.251019+0000","last_became_active":"2024-09-15T23:16:35.769094+0000","last_became_peered":"2024-09-15T23:16:35.769094+0000","last_unstale":"2024-09-15T23:16:37.251019+0000","last_undegraded":"2024-09-15T23:16:37.251019+0000","last_fullsized":"2024-09-15T23:16:37.251019+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:39:23.122386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250736+0000","last_change":"2024-09-15T23:16:35.778170+0000","last_active":"2024-09-15T23:16:37.250736+0000","last_peered":"2024-09-15T23:16:37.250736+0000","last_clean":"2024-09-15T23:16:37.250736+0000","last_became_active":"2024-09-15T23:16:35.777298+0000","last_became_peered":"2024-09-15T23:16:35.777298+0000","last_unstale":"2024-09-15T23:16:37.250736+0000","last_undegraded":"2024-09-15T23:16:37.250736+0000","last_fullsized":"2024-09-15T23:16:37.250736+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:19:47.133158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250241+0000","last_change":"2024-09-15T23:16:35.771684+0000","last_active":"2024-09-15T23:16:37.250241+0000","last_peered":"2024-09-15T23:16:37.250241+0000","last_clean":"2024-09-15T23:16:37.250241+0000","last_became_active":"2024-09-15T23:16:35.771290+0000","last_became_peered":"2024-09-15T23:16:35.771290+0000","last_unstale":"2024-09-15T23:16:37.250241+0000","last_undegraded":"2024-09-15T23:16:37.250241+0000","last_fullsized":"2024-09-15T23:16:37.250241+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:54.022322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250429+0000","last_change":"2024-09-15T23:16:35.756737+0000","last_active":"2024-09-15T23:16:37.250429+0000","last_peered":"2024-09-15T23:16:37.250429+0000","last_clean":"2024-09-15T23:16:37.250429+0000","last_became_active":"2024-09-15T23:16:35.756446+0000","last_became_peered":"2024-09-15T23:16:35.756446+0000","last_unstale":"2024-09-15T23:16:37.250429+0000","last_undegraded":"2024-09-15T23:16:37.250429+0000","last_fullsized":"2024-09-15T23:16:37.250429+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:41:02.503484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.751841+0000","last_change":"2024-09-15T23:16:35.757013+0000","last_active":"2024-09-15T23:16:36.751841+0000","last_peered":"2024-09-15T23:16:36.751841+0000","last_clean":"2024-09-15T23:16:36.751841+0000","last_became_active":"2024-09-15T23:16:35.756749+0000","last_became_peered":"2024-09-15T23:16:35.756749+0000","last_unstale":"2024-09-15T23:16:36.751841+0000","last_undegraded":"2024-09-15T23:16:36.751841+0000","last_fullsized":"2024-09-15T23:16:36.751841+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:48.740884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.981335+0000","last_change":"2024-09-15T23:16:35.769734+0000","last_active":"2024-09-15T23:16:36.981335+0000","last_peered":"2024-09-15T23:16:36.981335+0000","last_clean":"2024-09-15T23:16:36.981335+0000","last_became_active":"2024-09-15T23:16:35.767578+0000","last_became_peered":"2024-09-15T23:16:35.767578+0000","last_unstale":"2024-09-15T23:16:36.981335+0000","last_undegraded":"2024-09-15T23:16:36.981335+0000","last_fullsized":"2024-09-15T23:16:36.981335+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:10.678179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.981709+0000","last_change":"2024-09-15T23:16:35.769074+0000","last_active":"2024-09-15T23:16:36.981709+0000","last_peered":"2024-09-15T23:16:36.981709+0000","last_clean":"2024-09-15T23:16:36.981709+0000","last_became_active":"2024-09-15T23:16:35.766732+0000","last_became_peered":"2024-09-15T23:16:35.766732+0000","last_unstale":"2024-09-15T23:16:36.981709+0000","last_undegraded":"2024-09-15T23:16:36.981709+0000","last_fullsized":"2024-09-15T23:16:36.981709+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:58:08.117929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250612+0000","last_change":"2024-09-15T23:16:35.766643+0000","last_active":"2024-09-15T23:16:37.250612+0000","last_peered":"2024-09-15T23:16:37.250612+0000","last_clean":"2024-09-15T23:16:37.250612+0000","last_became_active":"2024-09-15T23:16:35.766383+0000","last_became_peered":"2024-09-15T23:16:35.766383+0000","last_unstale":"2024-09-15T23:16:37.250612+0000","last_undegraded":"2024-09-15T23:16:37.250612+0000","last_fullsized":"2024-09-15T23:16:37.250612+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:37:18.218025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250966+0000","last_change":"2024-09-15T23:16:35.774720+0000","last_active":"2024-09-15T23:16:37.250966+0000","last_peered":"2024-09-15T23:16:37.250966+0000","last_clean":"2024-09-15T23:16:37.250966+0000","last_became_active":"2024-09-15T23:16:35.774450+0000","last_became_peered":"2024-09-15T23:16:35.774450+0000","last_unstale":"2024-09-15T23:16:37.250966+0000","last_undegraded":"2024-09-15T23:16:37.250966+0000","last_fullsized":"2024-09-15T23:16:37.250966+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:12:35.625135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250169+0000","last_change":"2024-09-15T23:16:35.767278+0000","last_active":"2024-09-15T23:16:37.250169+0000","last_peered":"2024-09-15T23:16:37.250169+0000","last_clean":"2024-09-15T23:16:37.250169+0000","last_became_active":"2024-09-15T23:16:35.767040+0000","last_became_peered":"2024-09-15T23:16:35.767040+0000","last_unstale":"2024-09-15T23:16:37.250169+0000","last_undegraded":"2024-09-15T23:16:37.250169+0000","last_fullsized":"2024-09-15T23:16:37.250169+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:03.820400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250539+0000","last_change":"2024-09-15T23:16:35.770923+0000","last_active":"2024-09-15T23:16:37.250539+0000","last_peered":"2024-09-15T23:16:37.250539+0000","last_clean":"2024-09-15T23:16:37.250539+0000","last_became_active":"2024-09-15T23:16:35.770571+0000","last_became_peered":"2024-09-15T23:16:35.770571+0000","last_unstale":"2024-09-15T23:16:37.250539+0000","last_undegraded":"2024-09-15T23:16:37.250539+0000","last_fullsized":"2024-09-15T23:16:37.250539+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:13:29.084303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250598+0000","last_change":"2024-09-15T23:16:35.769677+0000","last_active":"2024-09-15T23:16:37.250598+0000","last_peered":"2024-09-15T23:16:37.250598+0000","last_clean":"2024-09-15T23:16:37.250598+0000","last_became_active":"2024-09-15T23:16:35.769124+0000","last_became_peered":"2024-09-15T23:16:35.769124+0000","last_unstale":"2024-09-15T23:16:37.250598+0000","last_undegraded":"2024-09-15T23:16:37.250598+0000","last_fullsized":"2024-09-15T23:16:37.250598+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:03.820400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.755471+0000","last_change":"2024-09-15T23:16:35.770421+0000","last_active":"2024-09-15T23:16:36.755471+0000","last_peered":"2024-09-15T23:16:36.755471+0000","last_clean":"2024-09-15T23:16:36.755471+0000","last_became_active":"2024-09-15T23:16:35.770177+0000","last_became_peered":"2024-09-15T23:16:35.770177+0000","last_unstale":"2024-09-15T23:16:36.755471+0000","last_undegraded":"2024-09-15T23:16:36.755471+0000","last_fullsized":"2024-09-15T23:16:36.755471+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:23:43.751162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.755436+0000","last_change":"2024-09-15T23:16:35.778288+0000","last_active":"2024-09-15T23:16:36.755436+0000","last_peered":"2024-09-15T23:16:36.755436+0000","last_clean":"2024-09-15T23:16:36.755436+0000","last_became_active":"2024-09-15T23:16:35.777992+0000","last_became_peered":"2024-09-15T23:16:35.777992+0000","last_unstale":"2024-09-15T23:16:36.755436+0000","last_undegraded":"2024-09-15T23:16:36.755436+0000","last_fullsized":"2024-09-15T23:16:36.755436+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:53.713683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.751954+0000","last_change":"2024-09-15T23:16:35.764215+0000","last_active":"2024-09-15T23:16:36.751954+0000","last_peered":"2024-09-15T23:16:36.751954+0000","last_clean":"2024-09-15T23:16:36.751954+0000","last_became_active":"2024-09-15T23:16:35.763965+0000","last_became_peered":"2024-09-15T23:16:35.763965+0000","last_unstale":"2024-09-15T23:16:36.751954+0000","last_undegraded":"2024-09-15T23:16:36.751954+0000","last_fullsized":"2024-09-15T23:16:36.751954+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:12.605610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"97'4","reported_seq":18,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.251120+0000","last_change":"2024-09-15T23:16:34.760444+0000","last_active":"2024-09-15T23:16:37.251120+0000","last_peered":"2024-09-15T23:16:37.251120+0000","last_clean":"2024-09-15T23:16:37.251120+0000","last_became_active":"2024-09-15T23:16:34.760221+0000","last_became_peered":"2024-09-15T23:16:34.760221+0000","last_unstale":"2024-09-15T23:16:37.251120+0000","last_undegraded":"2024-09-15T23:16:37.251120+0000","last_fullsized":"2024-09-15T23:16:37.251120+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:54.926823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250960+0000","last_change":"2024-09-15T23:16:35.771965+0000","last_active":"2024-09-15T23:16:37.250960+0000","last_peered":"2024-09-15T23:16:37.250960+0000","last_clean":"2024-09-15T23:16:37.250960+0000","last_became_active":"2024-09-15T23:16:35.771706+0000","last_became_peered":"2024-09-15T23:16:35.771706+0000","last_unstale":"2024-09-15T23:16:37.250960+0000","last_undegraded":"2024-09-15T23:16:37.250960+0000","last_fullsized":"2024-09-15T23:16:37.250960+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:29.690148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"97'1","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.755322+0000","last_change":"2024-09-15T23:16:34.750262+0000","last_active":"2024-09-15T23:16:36.755322+0000","last_peered":"2024-09-15T23:16:36.755322+0000","last_clean":"2024-09-15T23:16:36.755322+0000","last_became_active":"2024-09-15T23:16:34.749937+0000","last_became_peered":"2024-09-15T23:16:34.749937+0000","last_unstale":"2024-09-15T23:16:36.755322+0000","last_undegraded":"2024-09-15T23:16:36.755322+0000","last_fullsized":"2024-09-15T23:16:36.755322+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:09.673716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.752062+0000","last_change":"2024-09-15T23:16:35.773435+0000","last_active":"2024-09-15T23:16:36.752062+0000","last_peered":"2024-09-15T23:16:36.752062+0000","last_clean":"2024-09-15T23:16:36.752062+0000","last_became_active":"2024-09-15T23:16:35.773189+0000","last_became_peered":"2024-09-15T23:16:35.773189+0000","last_unstale":"2024-09-15T23:16:36.752062+0000","last_undegraded":"2024-09-15T23:16:36.752062+0000","last_fullsized":"2024-09-15T23:16:36.752062+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:53.713683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"97'2","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.981680+0000","last_change":"2024-09-15T23:16:34.758559+0000","last_active":"2024-09-15T23:16:36.981680+0000","last_peered":"2024-09-15T23:16:36.981680+0000","last_clean":"2024-09-15T23:16:36.981680+0000","last_became_active":"2024-09-15T23:16:34.757938+0000","last_became_peered":"2024-09-15T23:16:34.757938+0000","last_unstale":"2024-09-15T23:16:36.981680+0000","last_undegraded":"2024-09-15T23:16:36.981680+0000","last_fullsized":"2024-09-15T23:16:36.981680+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:32:40.873218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250614+0000","last_change":"2024-09-15T23:16:35.779697+0000","last_active":"2024-09-15T23:16:37.250614+0000","last_peered":"2024-09-15T23:16:37.250614+0000","last_clean":"2024-09-15T23:16:37.250614+0000","last_became_active":"2024-09-15T23:16:35.779433+0000","last_became_peered":"2024-09-15T23:16:35.779433+0000","last_unstale":"2024-09-15T23:16:37.250614+0000","last_undegraded":"2024-09-15T23:16:37.250614+0000","last_fullsized":"2024-09-15T23:16:37.250614+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:41.814102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"97'2","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250518+0000","last_change":"2024-09-15T23:16:34.753714+0000","last_active":"2024-09-15T23:16:37.250518+0000","last_peered":"2024-09-15T23:16:37.250518+0000","last_clean":"2024-09-15T23:16:37.250518+0000","last_became_active":"2024-09-15T23:16:34.753394+0000","last_became_peered":"2024-09-15T23:16:34.753394+0000","last_unstale":"2024-09-15T23:16:37.250518+0000","last_undegraded":"2024-09-15T23:16:37.250518+0000","last_fullsized":"2024-09-15T23:16:37.250518+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:17.679671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250656+0000","last_change":"2024-09-15T23:16:35.779140+0000","last_active":"2024-09-15T23:16:37.250656+0000","last_peered":"2024-09-15T23:16:37.250656+0000","last_clean":"2024-09-15T23:16:37.250656+0000","last_became_active":"2024-09-15T23:16:35.777178+0000","last_became_peered":"2024-09-15T23:16:35.777178+0000","last_unstale":"2024-09-15T23:16:37.250656+0000","last_undegraded":"2024-09-15T23:16:37.250656+0000","last_fullsized":"2024-09-15T23:16:37.250656+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:52.004884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"97'1","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.751926+0000","last_change":"2024-09-15T23:16:34.748118+0000","last_active":"2024-09-15T23:16:36.751926+0000","last_peered":"2024-09-15T23:16:36.751926+0000","last_clean":"2024-09-15T23:16:36.751926+0000","last_became_active":"2024-09-15T23:16:34.747846+0000","last_became_peered":"2024-09-15T23:16:34.747846+0000","last_unstale":"2024-09-15T23:16:36.751926+0000","last_undegraded":"2024-09-15T23:16:36.751926+0000","last_fullsized":"2024-09-15T23:16:36.751926+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:40:47.601462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.755284+0000","last_change":"2024-09-15T23:16:35.768826+0000","last_active":"2024-09-15T23:16:36.755284+0000","last_peered":"2024-09-15T23:16:36.755284+0000","last_clean":"2024-09-15T23:16:36.755284+0000","last_became_active":"2024-09-15T23:16:35.768017+0000","last_became_peered":"2024-09-15T23:16:35.768017+0000","last_unstale":"2024-09-15T23:16:36.755284+0000","last_undegraded":"2024-09-15T23:16:36.755284+0000","last_fullsized":"2024-09-15T23:16:36.755284+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:12.605610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"97'1","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.755053+0000","last_change":"2024-09-15T23:16:34.750483+0000","last_active":"2024-09-15T23:16:36.755053+0000","last_peered":"2024-09-15T23:16:36.755053+0000","last_clean":"2024-09-15T23:16:36.755053+0000","last_became_active":"2024-09-15T23:16:34.749988+0000","last_became_peered":"2024-09-15T23:16:34.749988+0000","last_unstale":"2024-09-15T23:16:36.755053+0000","last_undegraded":"2024-09-15T23:16:36.755053+0000","last_fullsized":"2024-09-15T23:16:36.755053+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:02.647800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250062+0000","last_change":"2024-09-15T23:16:35.769049+0000","last_active":"2024-09-15T23:16:37.250062+0000","last_peered":"2024-09-15T23:16:37.250062+0000","last_clean":"2024-09-15T23:16:37.250062+0000","last_became_active":"2024-09-15T23:16:35.768767+0000","last_became_peered":"2024-09-15T23:16:35.768767+0000","last_unstale":"2024-09-15T23:16:37.250062+0000","last_undegraded":"2024-09-15T23:16:37.250062+0000","last_fullsized":"2024-09-15T23:16:37.250062+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:03.670178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250238+0000","last_change":"2024-09-15T23:16:34.754647+0000","last_active":"2024-09-15T23:16:37.250238+0000","last_peered":"2024-09-15T23:16:37.250238+0000","last_clean":"2024-09-15T23:16:37.250238+0000","last_became_active":"2024-09-15T23:16:34.754348+0000","last_became_peered":"2024-09-15T23:16:34.754348+0000","last_unstale":"2024-09-15T23:16:37.250238+0000","last_undegraded":"2024-09-15T23:16:37.250238+0000","last_fullsized":"2024-09-15T23:16:37.250238+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:40.263650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250258+0000","last_change":"2024-09-15T23:16:35.762911+0000","last_active":"2024-09-15T23:16:37.250258+0000","last_peered":"2024-09-15T23:16:37.250258+0000","last_clean":"2024-09-15T23:16:37.250258+0000","last_became_active":"2024-09-15T23:16:35.762046+0000","last_became_peered":"2024-09-15T23:16:35.762046+0000","last_unstale":"2024-09-15T23:16:37.250258+0000","last_undegraded":"2024-09-15T23:16:37.250258+0000","last_fullsized":"2024-09-15T23:16:37.250258+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:03.670178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.249948+0000","last_change":"2024-09-15T23:16:34.757604+0000","last_active":"2024-09-15T23:16:37.249948+0000","last_peered":"2024-09-15T23:16:37.249948+0000","last_clean":"2024-09-15T23:16:37.249948+0000","last_became_active":"2024-09-15T23:16:34.757332+0000","last_became_peered":"2024-09-15T23:16:34.757332+0000","last_unstale":"2024-09-15T23:16:37.249948+0000","last_undegraded":"2024-09-15T23:16:37.249948+0000","last_fullsized":"2024-09-15T23:16:37.249948+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:17:52.432695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.251026+0000","last_change":"2024-09-15T23:16:35.768029+0000","last_active":"2024-09-15T23:16:37.251026+0000","last_peered":"2024-09-15T23:16:37.251026+0000","last_clean":"2024-09-15T23:16:37.251026+0000","last_became_active":"2024-09-15T23:16:35.767759+0000","last_became_peered":"2024-09-15T23:16:35.767759+0000","last_unstale":"2024-09-15T23:16:37.251026+0000","last_undegraded":"2024-09-15T23:16:37.251026+0000","last_fullsized":"2024-09-15T23:16:37.251026+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:41.814102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250987+0000","last_change":"2024-09-15T23:16:34.755719+0000","last_active":"2024-09-15T23:16:37.250987+0000","last_peered":"2024-09-15T23:16:37.250987+0000","last_clean":"2024-09-15T23:16:37.250987+0000","last_became_active":"2024-09-15T23:16:34.755360+0000","last_became_peered":"2024-09-15T23:16:34.755360+0000","last_unstale":"2024-09-15T23:16:37.250987+0000","last_undegraded":"2024-09-15T23:16:37.250987+0000","last_fullsized":"2024-09-15T23:16:37.250987+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:34.782116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250938+0000","last_change":"2024-09-15T23:16:35.777206+0000","last_active":"2024-09-15T23:16:37.250938+0000","last_peered":"2024-09-15T23:16:37.250938+0000","last_clean":"2024-09-15T23:16:37.250938+0000","last_became_active":"2024-09-15T23:16:35.776955+0000","last_became_peered":"2024-09-15T23:16:35.776955+0000","last_unstale":"2024-09-15T23:16:37.250938+0000","last_undegraded":"2024-09-15T23:16:37.250938+0000","last_fullsized":"2024-09-15T23:16:37.250938+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:53:35.241774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.755325+0000","last_change":"2024-09-15T23:16:34.752778+0000","last_active":"2024-09-15T23:16:36.755325+0000","last_peered":"2024-09-15T23:16:36.755325+0000","last_clean":"2024-09-15T23:16:36.755325+0000","last_became_active":"2024-09-15T23:16:34.752500+0000","last_became_peered":"2024-09-15T23:16:34.752500+0000","last_unstale":"2024-09-15T23:16:36.755325+0000","last_undegraded":"2024-09-15T23:16:36.755325+0000","last_fullsized":"2024-09-15T23:16:36.755325+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:26.811447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.981451+0000","last_change":"2024-09-15T23:16:35.768727+0000","last_active":"2024-09-15T23:16:36.981451+0000","last_peered":"2024-09-15T23:16:36.981451+0000","last_clean":"2024-09-15T23:16:36.981451+0000","last_became_active":"2024-09-15T23:16:35.768122+0000","last_became_peered":"2024-09-15T23:16:35.768122+0000","last_unstale":"2024-09-15T23:16:36.981451+0000","last_undegraded":"2024-09-15T23:16:36.981451+0000","last_fullsized":"2024-09-15T23:16:36.981451+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:40:47.125066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"97'3","reported_seq":17,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250707+0000","last_change":"2024-09-15T23:16:34.759305+0000","last_active":"2024-09-15T23:16:37.250707+0000","last_peered":"2024-09-15T23:16:37.250707+0000","last_clean":"2024-09-15T23:16:37.250707+0000","last_became_active":"2024-09-15T23:16:34.758950+0000","last_became_peered":"2024-09-15T23:16:34.758950+0000","last_unstale":"2024-09-15T23:16:37.250707+0000","last_undegraded":"2024-09-15T23:16:37.250707+0000","last_fullsized":"2024-09-15T23:16:37.250707+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:17:52.432695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250840+0000","last_change":"2024-09-15T23:16:35.775547+0000","last_active":"2024-09-15T23:16:37.250840+0000","last_peered":"2024-09-15T23:16:37.250840+0000","last_clean":"2024-09-15T23:16:37.250840+0000","last_became_active":"2024-09-15T23:16:35.775287+0000","last_became_peered":"2024-09-15T23:16:35.775287+0000","last_unstale":"2024-09-15T23:16:37.250840+0000","last_undegraded":"2024-09-15T23:16:37.250840+0000","last_fullsized":"2024-09-15T23:16:37.250840+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:36:57.006574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"97'6","reported_seq":20,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.752114+0000","last_change":"2024-09-15T23:16:34.750641+0000","last_active":"2024-09-15T23:16:36.752114+0000","last_peered":"2024-09-15T23:16:36.752114+0000","last_clean":"2024-09-15T23:16:36.752114+0000","last_became_active":"2024-09-15T23:16:34.750397+0000","last_became_peered":"2024-09-15T23:16:34.750397+0000","last_unstale":"2024-09-15T23:16:36.752114+0000","last_undegraded":"2024-09-15T23:16:36.752114+0000","last_fullsized":"2024-09-15T23:16:36.752114+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:26.811447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.981517+0000","last_change":"2024-09-15T23:16:35.766409+0000","last_active":"2024-09-15T23:16:36.981517+0000","last_peered":"2024-09-15T23:16:36.981517+0000","last_clean":"2024-09-15T23:16:36.981517+0000","last_became_active":"2024-09-15T23:16:35.766132+0000","last_became_peered":"2024-09-15T23:16:35.766132+0000","last_unstale":"2024-09-15T23:16:36.981517+0000","last_undegraded":"2024-09-15T23:16:36.981517+0000","last_fullsized":"2024-09-15T23:16:36.981517+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:29:34.995314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"97'2","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250648+0000","last_change":"2024-09-15T23:16:34.759842+0000","last_active":"2024-09-15T23:16:37.250648+0000","last_peered":"2024-09-15T23:16:37.250648+0000","last_clean":"2024-09-15T23:16:37.250648+0000","last_became_active":"2024-09-15T23:16:34.759564+0000","last_became_peered":"2024-09-15T23:16:34.759564+0000","last_unstale":"2024-09-15T23:16:37.250648+0000","last_undegraded":"2024-09-15T23:16:37.250648+0000","last_fullsized":"2024-09-15T23:16:37.250648+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:05.285912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250227+0000","last_change":"2024-09-15T23:16:35.769018+0000","last_active":"2024-09-15T23:16:37.250227+0000","last_peered":"2024-09-15T23:16:37.250227+0000","last_clean":"2024-09-15T23:16:37.250227+0000","last_became_active":"2024-09-15T23:16:35.768724+0000","last_became_peered":"2024-09-15T23:16:35.768724+0000","last_unstale":"2024-09-15T23:16:37.250227+0000","last_undegraded":"2024-09-15T23:16:37.250227+0000","last_fullsized":"2024-09-15T23:16:37.250227+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:19:47.133158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.755631+0000","last_change":"2024-09-15T23:16:34.757740+0000","last_active":"2024-09-15T23:16:36.755631+0000","last_peered":"2024-09-15T23:16:36.755631+0000","last_clean":"2024-09-15T23:16:36.755631+0000","last_became_active":"2024-09-15T23:16:34.757307+0000","last_became_peered":"2024-09-15T23:16:34.757307+0000","last_unstale":"2024-09-15T23:16:36.755631+0000","last_undegraded":"2024-09-15T23:16:36.755631+0000","last_fullsized":"2024-09-15T23:16:36.755631+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:30.211666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250044+0000","last_change":"2024-09-15T23:16:35.773222+0000","last_active":"2024-09-15T23:16:37.250044+0000","last_peered":"2024-09-15T23:16:37.250044+0000","last_clean":"2024-09-15T23:16:37.250044+0000","last_became_active":"2024-09-15T23:16:35.772920+0000","last_became_peered":"2024-09-15T23:16:35.772920+0000","last_unstale":"2024-09-15T23:16:37.250044+0000","last_undegraded":"2024-09-15T23:16:37.250044+0000","last_fullsized":"2024-09-15T23:16:37.250044+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:35:58.817258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.755018+0000","last_change":"2024-09-15T23:16:34.752080+0000","last_active":"2024-09-15T23:16:36.755018+0000","last_peered":"2024-09-15T23:16:36.755018+0000","last_clean":"2024-09-15T23:16:36.755018+0000","last_became_active":"2024-09-15T23:16:34.751579+0000","last_became_peered":"2024-09-15T23:16:34.751579+0000","last_unstale":"2024-09-15T23:16:36.755018+0000","last_undegraded":"2024-09-15T23:16:36.755018+0000","last_fullsized":"2024-09-15T23:16:36.755018+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:48.707081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.981270+0000","last_change":"2024-09-15T23:16:35.766539+0000","last_active":"2024-09-15T23:16:36.981270+0000","last_peered":"2024-09-15T23:16:36.981270+0000","last_clean":"2024-09-15T23:16:36.981270+0000","last_became_active":"2024-09-15T23:16:35.766275+0000","last_became_peered":"2024-09-15T23:16:35.766275+0000","last_unstale":"2024-09-15T23:16:36.981270+0000","last_undegraded":"2024-09-15T23:16:36.981270+0000","last_fullsized":"2024-09-15T23:16:36.981270+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:27.815910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"97'8","reported_seq":22,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.981424+0000","last_change":"2024-09-15T23:16:34.761125+0000","last_active":"2024-09-15T23:16:36.981424+0000","last_peered":"2024-09-15T23:16:36.981424+0000","last_clean":"2024-09-15T23:16:36.981424+0000","last_became_active":"2024-09-15T23:16:34.760875+0000","last_became_peered":"2024-09-15T23:16:34.760875+0000","last_unstale":"2024-09-15T23:16:36.981424+0000","last_undegraded":"2024-09-15T23:16:36.981424+0000","last_fullsized":"2024-09-15T23:16:36.981424+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:24:28.230255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.751974+0000","last_change":"2024-09-15T23:16:35.769852+0000","last_active":"2024-09-15T23:16:36.751974+0000","last_peered":"2024-09-15T23:16:36.751974+0000","last_clean":"2024-09-15T23:16:36.751974+0000","last_became_active":"2024-09-15T23:16:35.769570+0000","last_became_peered":"2024-09-15T23:16:35.769570+0000","last_unstale":"2024-09-15T23:16:36.751974+0000","last_undegraded":"2024-09-15T23:16:36.751974+0000","last_fullsized":"2024-09-15T23:16:36.751974+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:08:08.193790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"97'1","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250793+0000","last_change":"2024-09-15T23:16:34.757760+0000","last_active":"2024-09-15T23:16:37.250793+0000","last_peered":"2024-09-15T23:16:37.250793+0000","last_clean":"2024-09-15T23:16:37.250793+0000","last_became_active":"2024-09-15T23:16:34.757448+0000","last_became_peered":"2024-09-15T23:16:34.757448+0000","last_unstale":"2024-09-15T23:16:37.250793+0000","last_undegraded":"2024-09-15T23:16:37.250793+0000","last_fullsized":"2024-09-15T23:16:37.250793+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:21:50.814999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.755359+0000","last_change":"2024-09-15T23:16:35.772336+0000","last_active":"2024-09-15T23:16:36.755359+0000","last_peered":"2024-09-15T23:16:36.755359+0000","last_clean":"2024-09-15T23:16:36.755359+0000","last_became_active":"2024-09-15T23:16:35.772083+0000","last_became_peered":"2024-09-15T23:16:35.772083+0000","last_unstale":"2024-09-15T23:16:36.755359+0000","last_undegraded":"2024-09-15T23:16:36.755359+0000","last_fullsized":"2024-09-15T23:16:36.755359+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:08:08.193790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"97'2","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.251080+0000","last_change":"2024-09-15T23:16:34.756814+0000","last_active":"2024-09-15T23:16:37.251080+0000","last_peered":"2024-09-15T23:16:37.251080+0000","last_clean":"2024-09-15T23:16:37.251080+0000","last_became_active":"2024-09-15T23:16:34.755902+0000","last_became_peered":"2024-09-15T23:16:34.755902+0000","last_unstale":"2024-09-15T23:16:37.251080+0000","last_undegraded":"2024-09-15T23:16:37.251080+0000","last_fullsized":"2024-09-15T23:16:37.251080+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:21.905853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.751856+0000","last_change":"2024-09-15T23:16:35.769171+0000","last_active":"2024-09-15T23:16:36.751856+0000","last_peered":"2024-09-15T23:16:36.751856+0000","last_clean":"2024-09-15T23:16:36.751856+0000","last_became_active":"2024-09-15T23:16:35.768920+0000","last_became_peered":"2024-09-15T23:16:35.768920+0000","last_unstale":"2024-09-15T23:16:36.751856+0000","last_undegraded":"2024-09-15T23:16:36.751856+0000","last_fullsized":"2024-09-15T23:16:36.751856+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:38:13.236740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250866+0000","last_change":"2024-09-15T23:16:34.760013+0000","last_active":"2024-09-15T23:16:37.250866+0000","last_peered":"2024-09-15T23:16:37.250866+0000","last_clean":"2024-09-15T23:16:37.250866+0000","last_became_active":"2024-09-15T23:16:34.759697+0000","last_became_peered":"2024-09-15T23:16:34.759697+0000","last_unstale":"2024-09-15T23:16:37.250866+0000","last_undegraded":"2024-09-15T23:16:37.250866+0000","last_fullsized":"2024-09-15T23:16:37.250866+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:44.346565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.755970+0000","last_change":"2024-09-15T23:16:35.770304+0000","last_active":"2024-09-15T23:16:36.755970+0000","last_peered":"2024-09-15T23:16:36.755970+0000","last_clean":"2024-09-15T23:16:36.755970+0000","last_became_active":"2024-09-15T23:16:35.769929+0000","last_became_peered":"2024-09-15T23:16:35.769929+0000","last_unstale":"2024-09-15T23:16:36.755970+0000","last_undegraded":"2024-09-15T23:16:36.755970+0000","last_fullsized":"2024-09-15T23:16:36.755970+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:58.992648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"97'2","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250716+0000","last_change":"2024-09-15T23:16:34.760353+0000","last_active":"2024-09-15T23:16:37.250716+0000","last_peered":"2024-09-15T23:16:37.250716+0000","last_clean":"2024-09-15T23:16:37.250716+0000","last_became_active":"2024-09-15T23:16:34.760092+0000","last_became_peered":"2024-09-15T23:16:34.760092+0000","last_unstale":"2024-09-15T23:16:37.250716+0000","last_undegraded":"2024-09-15T23:16:37.250716+0000","last_fullsized":"2024-09-15T23:16:37.250716+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:58:41.895104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250228+0000","last_change":"2024-09-15T23:16:35.774231+0000","last_active":"2024-09-15T23:16:37.250228+0000","last_peered":"2024-09-15T23:16:37.250228+0000","last_clean":"2024-09-15T23:16:37.250228+0000","last_became_active":"2024-09-15T23:16:35.773956+0000","last_became_peered":"2024-09-15T23:16:35.773956+0000","last_unstale":"2024-09-15T23:16:37.250228+0000","last_undegraded":"2024-09-15T23:16:37.250228+0000","last_fullsized":"2024-09-15T23:16:37.250228+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:34:21.324613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.755788+0000","last_change":"2024-09-15T23:16:34.757928+0000","last_active":"2024-09-15T23:16:36.755788+0000","last_peered":"2024-09-15T23:16:36.755788+0000","last_clean":"2024-09-15T23:16:36.755788+0000","last_became_active":"2024-09-15T23:16:34.757648+0000","last_became_peered":"2024-09-15T23:16:34.757648+0000","last_unstale":"2024-09-15T23:16:36.755788+0000","last_undegraded":"2024-09-15T23:16:36.755788+0000","last_fullsized":"2024-09-15T23:16:36.755788+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:00.288336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250047+0000","last_change":"2024-09-15T23:16:35.770911+0000","last_active":"2024-09-15T23:16:37.250047+0000","last_peered":"2024-09-15T23:16:37.250047+0000","last_clean":"2024-09-15T23:16:37.250047+0000","last_became_active":"2024-09-15T23:16:35.770620+0000","last_became_peered":"2024-09-15T23:16:35.770620+0000","last_unstale":"2024-09-15T23:16:37.250047+0000","last_undegraded":"2024-09-15T23:16:37.250047+0000","last_fullsized":"2024-09-15T23:16:37.250047+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:45:49.901107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.981273+0000","last_change":"2024-09-15T23:16:34.755273+0000","last_active":"2024-09-15T23:16:36.981273+0000","last_peered":"2024-09-15T23:16:36.981273+0000","last_clean":"2024-09-15T23:16:36.981273+0000","last_became_active":"2024-09-15T23:16:34.754300+0000","last_became_peered":"2024-09-15T23:16:34.754300+0000","last_unstale":"2024-09-15T23:16:36.981273+0000","last_undegraded":"2024-09-15T23:16:36.981273+0000","last_fullsized":"2024-09-15T23:16:36.981273+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:28.685685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.751777+0000","last_change":"2024-09-15T23:16:35.771612+0000","last_active":"2024-09-15T23:16:36.751777+0000","last_peered":"2024-09-15T23:16:36.751777+0000","last_clean":"2024-09-15T23:16:36.751777+0000","last_became_active":"2024-09-15T23:16:35.771357+0000","last_became_peered":"2024-09-15T23:16:35.771357+0000","last_unstale":"2024-09-15T23:16:36.751777+0000","last_undegraded":"2024-09-15T23:16:36.751777+0000","last_fullsized":"2024-09-15T23:16:36.751777+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:20.518011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250070+0000","last_change":"2024-09-15T23:16:34.760017+0000","last_active":"2024-09-15T23:16:37.250070+0000","last_peered":"2024-09-15T23:16:37.250070+0000","last_clean":"2024-09-15T23:16:37.250070+0000","last_became_active":"2024-09-15T23:16:34.759429+0000","last_became_peered":"2024-09-15T23:16:34.759429+0000","last_unstale":"2024-09-15T23:16:37.250070+0000","last_undegraded":"2024-09-15T23:16:37.250070+0000","last_fullsized":"2024-09-15T23:16:37.250070+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:53:35.052932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250736+0000","last_change":"2024-09-15T23:16:35.769357+0000","last_active":"2024-09-15T23:16:37.250736+0000","last_peered":"2024-09-15T23:16:37.250736+0000","last_clean":"2024-09-15T23:16:37.250736+0000","last_became_active":"2024-09-15T23:16:35.769044+0000","last_became_peered":"2024-09-15T23:16:35.769044+0000","last_unstale":"2024-09-15T23:16:37.250736+0000","last_undegraded":"2024-09-15T23:16:37.250736+0000","last_fullsized":"2024-09-15T23:16:37.250736+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:34:00.825682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"97'2","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.251029+0000","last_change":"2024-09-15T23:16:34.757623+0000","last_active":"2024-09-15T23:16:37.251029+0000","last_peered":"2024-09-15T23:16:37.251029+0000","last_clean":"2024-09-15T23:16:37.251029+0000","last_became_active":"2024-09-15T23:16:34.757259+0000","last_became_peered":"2024-09-15T23:16:34.757259+0000","last_unstale":"2024-09-15T23:16:37.251029+0000","last_undegraded":"2024-09-15T23:16:37.251029+0000","last_fullsized":"2024-09-15T23:16:37.251029+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:34.782116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250639+0000","last_change":"2024-09-15T23:16:35.766800+0000","last_active":"2024-09-15T23:16:37.250639+0000","last_peered":"2024-09-15T23:16:37.250639+0000","last_clean":"2024-09-15T23:16:37.250639+0000","last_became_active":"2024-09-15T23:16:35.766037+0000","last_became_peered":"2024-09-15T23:16:35.766037+0000","last_unstale":"2024-09-15T23:16:37.250639+0000","last_undegraded":"2024-09-15T23:16:37.250639+0000","last_fullsized":"2024-09-15T23:16:37.250639+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:21.538460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"98'1","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.981812+0000","last_change":"2024-09-15T23:16:34.760115+0000","last_active":"2024-09-15T23:16:36.981812+0000","last_peered":"2024-09-15T23:16:36.981812+0000","last_clean":"2024-09-15T23:16:36.981812+0000","last_became_active":"2024-09-15T23:16:34.759725+0000","last_became_peered":"2024-09-15T23:16:34.759725+0000","last_unstale":"2024-09-15T23:16:36.981812+0000","last_undegraded":"2024-09-15T23:16:36.981812+0000","last_fullsized":"2024-09-15T23:16:36.981812+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:14.836727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250617+0000","last_change":"2024-09-15T23:16:35.767354+0000","last_active":"2024-09-15T23:16:37.250617+0000","last_peered":"2024-09-15T23:16:37.250617+0000","last_clean":"2024-09-15T23:16:37.250617+0000","last_became_active":"2024-09-15T23:16:35.767135+0000","last_became_peered":"2024-09-15T23:16:35.767135+0000","last_unstale":"2024-09-15T23:16:37.250617+0000","last_undegraded":"2024-09-15T23:16:37.250617+0000","last_fullsized":"2024-09-15T23:16:37.250617+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:47:05.422107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.751874+0000","last_change":"2024-09-15T23:16:34.756863+0000","last_active":"2024-09-15T23:16:36.751874+0000","last_peered":"2024-09-15T23:16:36.751874+0000","last_clean":"2024-09-15T23:16:36.751874+0000","last_became_active":"2024-09-15T23:16:34.756563+0000","last_became_peered":"2024-09-15T23:16:34.756563+0000","last_unstale":"2024-09-15T23:16:36.751874+0000","last_undegraded":"2024-09-15T23:16:36.751874+0000","last_fullsized":"2024-09-15T23:16:36.751874+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:09.673716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.755355+0000","last_change":"2024-09-15T23:16:35.773555+0000","last_active":"2024-09-15T23:16:36.755355+0000","last_peered":"2024-09-15T23:16:36.755355+0000","last_clean":"2024-09-15T23:16:36.755355+0000","last_became_active":"2024-09-15T23:16:35.773307+0000","last_became_peered":"2024-09-15T23:16:35.773307+0000","last_unstale":"2024-09-15T23:16:36.755355+0000","last_undegraded":"2024-09-15T23:16:36.755355+0000","last_fullsized":"2024-09-15T23:16:36.755355+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:49.249561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.755151+0000","last_change":"2024-09-15T23:16:34.756107+0000","last_active":"2024-09-15T23:16:36.755151+0000","last_peered":"2024-09-15T23:16:36.755151+0000","last_clean":"2024-09-15T23:16:36.755151+0000","last_became_active":"2024-09-15T23:16:34.755830+0000","last_became_peered":"2024-09-15T23:16:34.755830+0000","last_unstale":"2024-09-15T23:16:36.755151+0000","last_undegraded":"2024-09-15T23:16:36.755151+0000","last_fullsized":"2024-09-15T23:16:36.755151+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:43.278004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250087+0000","last_change":"2024-09-15T23:16:35.775907+0000","last_active":"2024-09-15T23:16:37.250087+0000","last_peered":"2024-09-15T23:16:37.250087+0000","last_clean":"2024-09-15T23:16:37.250087+0000","last_became_active":"2024-09-15T23:16:35.775645+0000","last_became_peered":"2024-09-15T23:16:35.775645+0000","last_unstale":"2024-09-15T23:16:37.250087+0000","last_undegraded":"2024-09-15T23:16:37.250087+0000","last_fullsized":"2024-09-15T23:16:37.250087+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:36.679954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.755854+0000","last_change":"2024-09-15T23:16:34.757464+0000","last_active":"2024-09-15T23:16:36.755854+0000","last_peered":"2024-09-15T23:16:36.755854+0000","last_clean":"2024-09-15T23:16:36.755854+0000","last_became_active":"2024-09-15T23:16:34.757190+0000","last_became_peered":"2024-09-15T23:16:34.757190+0000","last_unstale":"2024-09-15T23:16:36.755854+0000","last_undegraded":"2024-09-15T23:16:36.755854+0000","last_fullsized":"2024-09-15T23:16:36.755854+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:24.571810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.981673+0000","last_change":"2024-09-15T23:16:35.767564+0000","last_active":"2024-09-15T23:16:36.981673+0000","last_peered":"2024-09-15T23:16:36.981673+0000","last_clean":"2024-09-15T23:16:36.981673+0000","last_became_active":"2024-09-15T23:16:35.767284+0000","last_became_peered":"2024-09-15T23:16:35.767284+0000","last_unstale":"2024-09-15T23:16:36.981673+0000","last_undegraded":"2024-09-15T23:16:36.981673+0000","last_fullsized":"2024-09-15T23:16:36.981673+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:59.079455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.755157+0000","last_change":"2024-09-15T23:16:34.750259+0000","last_active":"2024-09-15T23:16:36.755157+0000","last_peered":"2024-09-15T23:16:36.755157+0000","last_clean":"2024-09-15T23:16:36.755157+0000","last_became_active":"2024-09-15T23:16:34.749647+0000","last_became_peered":"2024-09-15T23:16:34.749647+0000","last_unstale":"2024-09-15T23:16:36.755157+0000","last_undegraded":"2024-09-15T23:16:36.755157+0000","last_fullsized":"2024-09-15T23:16:36.755157+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:40:47.601462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250123+0000","last_change":"2024-09-15T23:16:35.771292+0000","last_active":"2024-09-15T23:16:37.250123+0000","last_peered":"2024-09-15T23:16:37.250123+0000","last_clean":"2024-09-15T23:16:37.250123+0000","last_became_active":"2024-09-15T23:16:35.771032+0000","last_became_peered":"2024-09-15T23:16:35.771032+0000","last_unstale":"2024-09-15T23:16:37.250123+0000","last_undegraded":"2024-09-15T23:16:37.250123+0000","last_fullsized":"2024-09-15T23:16:37.250123+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:41:02.503484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250547+0000","last_change":"2024-09-15T23:16:34.758195+0000","last_active":"2024-09-15T23:16:37.250547+0000","last_peered":"2024-09-15T23:16:37.250547+0000","last_clean":"2024-09-15T23:16:37.250547+0000","last_became_active":"2024-09-15T23:16:34.757947+0000","last_became_peered":"2024-09-15T23:16:34.757947+0000","last_unstale":"2024-09-15T23:16:37.250547+0000","last_undegraded":"2024-09-15T23:16:37.250547+0000","last_fullsized":"2024-09-15T23:16:37.250547+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:44.346565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250454+0000","last_change":"2024-09-15T23:16:35.768342+0000","last_active":"2024-09-15T23:16:37.250454+0000","last_peered":"2024-09-15T23:16:37.250454+0000","last_clean":"2024-09-15T23:16:37.250454+0000","last_became_active":"2024-09-15T23:16:35.768094+0000","last_became_peered":"2024-09-15T23:16:35.768094+0000","last_unstale":"2024-09-15T23:16:37.250454+0000","last_undegraded":"2024-09-15T23:16:37.250454+0000","last_fullsized":"2024-09-15T23:16:37.250454+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:39:23.122386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.751784+0000","last_change":"2024-09-15T23:16:34.753399+0000","last_active":"2024-09-15T23:16:36.751784+0000","last_peered":"2024-09-15T23:16:36.751784+0000","last_clean":"2024-09-15T23:16:36.751784+0000","last_became_active":"2024-09-15T23:16:34.753079+0000","last_became_peered":"2024-09-15T23:16:34.753079+0000","last_unstale":"2024-09-15T23:16:36.751784+0000","last_undegraded":"2024-09-15T23:16:36.751784+0000","last_fullsized":"2024-09-15T23:16:36.751784+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:02.647800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:36.981477+0000","last_change":"2024-09-15T23:16:35.769591+0000","last_active":"2024-09-15T23:16:36.981477+0000","last_peered":"2024-09-15T23:16:36.981477+0000","last_clean":"2024-09-15T23:16:36.981477+0000","last_became_active":"2024-09-15T23:16:35.769282+0000","last_became_peered":"2024-09-15T23:16:35.769282+0000","last_unstale":"2024-09-15T23:16:36.981477+0000","last_undegraded":"2024-09-15T23:16:36.981477+0000","last_fullsized":"2024-09-15T23:16:36.981477+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:34.733097+0000","last_clean_scrub_stamp":"2024-09-15T23:16:34.733097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:43.635495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"97'1","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.251055+0000","last_change":"2024-09-15T23:16:34.759083+0000","last_active":"2024-09-15T23:16:37.251055+0000","last_peered":"2024-09-15T23:16:37.251055+0000","last_clean":"2024-09-15T23:16:37.251055+0000","last_became_active":"2024-09-15T23:16:34.758789+0000","last_became_peered":"2024-09-15T23:16:34.758789+0000","last_unstale":"2024-09-15T23:16:37.251055+0000","last_undegraded":"2024-09-15T23:16:37.251055+0000","last_fullsized":"2024-09-15T23:16:37.251055+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:16:33.728634+0000","last_clean_scrub_stamp":"2024-09-15T23:16:33.728634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:06.650439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":310,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-15T23:16:37.250113+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:16:37.250113+0000","last_peered":"2024-09-15T23:16:37.250113+0000","last_clean":"2024-09-15T23:16:37.250113+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:16:37.250113+0000","last_undegraded":"2024-09-15T23:16:37.250113+0000","last_fullsized":"2024-09-15T23:16:37.250113+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476797,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40692,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331148,"statfs":{"total":96636764160,"available":96595095552,"internally_reserved":0,"allocated":1204224,"data_stored":522770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476794,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40676,"kb_used_data":1164,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331164,"statfs":{"total":96636764160,"available":96595111936,"internally_reserved":0,"allocated":1191936,"data_stored":522096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476796,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37104,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334736,"statfs":{"total":96636764160,"available":96598769664,"internally_reserved":0,"allocated":1789952,"data_stored":1112554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476796,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1180,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1208320,"data_stored":523730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542203,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36520,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335320,"statfs":{"total":96636764160,"available":96599367680,"internally_reserved":0,"allocated":1196032,"data_stored":522166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542203,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36524,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335316,"statfs":{"total":96636764160,"available":96599363584,"internally_reserved":0,"allocated":1200128,"data_stored":522768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542202,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37112,"kb_used_data":1760,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334728,"statfs":{"total":96636764160,"available":96598761472,"internally_reserved":0,"allocated":1802240,"data_stored":1114110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542204,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36516,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335324,"statfs":{"total":96636764160,"available":96599371776,"internally_reserved":0,"allocated":1196032,"data_stored":522130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:16:43.374 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T23:16:43.374 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T23:16:43.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.513+0000 7f5d02e5c640 1 Processor -- start 2024-09-15T23:16:43.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.513+0000 7f5d02e5c640 1 -- start start 2024-09-15T23:16:43.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.514+0000 7f5d02e5c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f5cfc0b6a70 0x7f5cfc0b8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:43.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.514+0000 7f5d02e5c640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cfc0d4560 con 0x7f5cfc0b6620 2024-09-15T23:16:43.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.514+0000 7f5d02e5c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cfc0d2c80 con 0x7f5cfc15ea80 2024-09-15T23:16:43.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.514+0000 7f5d02e5c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f5cfc0d2f60 con 0x7f5cfc0b6a70 2024-09-15T23:16:43.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.514+0000 7f5cfbfff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f5cfc0b6620 0x7f5cfc0b7af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:57254/0 (socket says 172.21.15.123:57254) 2024-09-15T23:16:43.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.514+0000 7f5cfbfff640 1 -- 172.21.15.123:0/540361168 learned_addr learned my addr 172.21.15.123:0/540361168 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:43.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.514+0000 7f5d013f9640 1 --2- 172.21.15.123:0/540361168 >> v2:172.21.15.188:3300/0 conn(0x7f5cfc0b6a70 0x7f5cfc0b8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:43.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.514+0000 7f5cfb7fe640 1 -- 172.21.15.123:0/540361168 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4149604640 0 0) 0x7f5cfc0d4560 con 0x7f5cfc0b6620 2024-09-15T23:16:43.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.514+0000 7f5cfb7fe640 1 -- 172.21.15.123:0/540361168 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cec003520 con 0x7f5cfc0b6620 2024-09-15T23:16:43.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.514+0000 7f5d013f9640 1 -- 172.21.15.123:0/540361168 >> v1:172.21.15.188:6789/0 conn(0x7f5cfc15ea80 legacy=0x7f5cfc0d3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:43.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.514+0000 7f5d013f9640 1 -- 172.21.15.123:0/540361168 >> v1:172.21.15.123:6789/0 conn(0x7f5cfc0b6620 legacy=0x7f5cfc0b7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:43.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.514+0000 7f5d013f9640 1 -- 172.21.15.123:0/540361168 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cfc0d3240 con 0x7f5cfc0b6a70 2024-09-15T23:16:43.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.515+0000 7f5d013f9640 1 --2- 172.21.15.123:0/540361168 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5cfc0b6a70 0x7f5cfc0b8200 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4009d90 tx=0x7f5cf402a780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a494a837a53b14 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:43.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.515+0000 7f5cfb7fe640 1 -- 172.21.15.123:0/540361168 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf4037070 con 0x7f5cfc0b6a70 2024-09-15T23:16:43.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.515+0000 7f5cfb7fe640 1 -- 172.21.15.123:0/540361168 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf4007740 con 0x7f5cfc0b6a70 2024-09-15T23:16:43.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.515+0000 7f5cfb7fe640 1 -- 172.21.15.123:0/540361168 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf4007af0 con 0x7f5cfc0b6a70 2024-09-15T23:16:43.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.516+0000 7f5d02e5c640 1 -- 172.21.15.123:0/540361168 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5cfc0b6a70 msgr2=0x7f5cfc0b8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:43.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.516+0000 7f5d02e5c640 1 --2- 172.21.15.123:0/540361168 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5cfc0b6a70 0x7f5cfc0b8200 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4009d90 tx=0x7f5cf402a780 comp rx=0 tx=0).stop 2024-09-15T23:16:43.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.516+0000 7f5d02e5c640 1 -- 172.21.15.123:0/540361168 shutdown_connections 2024-09-15T23:16:43.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.516+0000 7f5d02e5c640 1 --2- 172.21.15.123:0/540361168 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5cfc0b6a70 0x7f5cfc0b8200 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:43.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.516+0000 7f5d02e5c640 1 -- 172.21.15.123:0/540361168 >> 172.21.15.123:0/540361168 conn(0x7f5cfc0d1620 msgr2=0x7f5cfc0d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:43.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.516+0000 7f5d02e5c640 1 -- 172.21.15.123:0/540361168 shutdown_connections 2024-09-15T23:16:43.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.516+0000 7f5d02e5c640 1 -- 172.21.15.123:0/540361168 wait complete. 2024-09-15T23:16:43.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.517+0000 7f5d02e5c640 1 Processor -- start 2024-09-15T23:16:43.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.517+0000 7f5d02e5c640 1 -- start start 2024-09-15T23:16:43.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.518+0000 7f5d02e5c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cfc0b6620 0x7f5cfc0c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:43.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.518+0000 7f5d02e5c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5cfc0b6a70 0x7f5cfc1f82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:43.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.518+0000 7f5d02e5c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5cfc15ea80 0x7f5cfc1547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:43.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.518+0000 7f5d02e5c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5cfc0b6ee0 con 0x7f5cfc0b6620 2024-09-15T23:16:43.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.518+0000 7f5d02e5c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5cfc0d3800 con 0x7f5cfc0b6a70 2024-09-15T23:16:43.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.518+0000 7f5d02e5c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5cfc15ee60 con 0x7f5cfc15ea80 2024-09-15T23:16:43.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.518+0000 7f5d00bf8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cfc0b6620 0x7f5cfc0c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:43.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.518+0000 7f5d00bf8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cfc0b6620 0x7f5cfc0c8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46660/0 (socket says 172.21.15.123:46660) 2024-09-15T23:16:43.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.518+0000 7f5d00bf8640 1 -- 172.21.15.123:0/3635086722 learned_addr learned my addr 172.21.15.123:0/3635086722 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:43.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.518+0000 7f5cfbfff640 1 --2- 172.21.15.123:0/3635086722 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5cfc0b6a70 0x7f5cfc1f82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:43.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.518+0000 7f5d013f9640 1 --2- 172.21.15.123:0/3635086722 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5cfc15ea80 0x7f5cfc1547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:43.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.518+0000 7f5d00bf8640 1 -- 172.21.15.123:0/3635086722 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5cfc15ea80 msgr2=0x7f5cfc1547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:43.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.518+0000 7f5d00bf8640 1 --2- 172.21.15.123:0/3635086722 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5cfc15ea80 0x7f5cfc1547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:43.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.518+0000 7f5d00bf8640 1 -- 172.21.15.123:0/3635086722 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5cfc0b6a70 msgr2=0x7f5cfc1f82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:43.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.518+0000 7f5d00bf8640 1 --2- 172.21.15.123:0/3635086722 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5cfc0b6a70 0x7f5cfc1f82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:43.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.518+0000 7f5d00bf8640 1 -- 172.21.15.123:0/3635086722 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cfc0cd400 con 0x7f5cfc0b6620 2024-09-15T23:16:43.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.518+0000 7f5d00bf8640 1 --2- 172.21.15.123:0/3635086722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cfc0b6620 0x7f5cfc0c8880 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000c3f0 tx=0x7f5cf000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:43.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.519+0000 7f5cf97fa640 1 -- 172.21.15.123:0/3635086722 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf00052d0 con 0x7f5cfc0b6620 2024-09-15T23:16:43.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.519+0000 7f5cf97fa640 1 -- 172.21.15.123:0/3635086722 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf0005490 con 0x7f5cfc0b6620 2024-09-15T23:16:43.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.519+0000 7f5d02e5c640 1 -- 172.21.15.123:0/3635086722 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cfc0cdf20 con 0x7f5cfc0b6620 2024-09-15T23:16:43.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.519+0000 7f5cf97fa640 1 -- 172.21.15.123:0/3635086722 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf0007260 con 0x7f5cfc0b6620 2024-09-15T23:16:43.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.519+0000 7f5d02e5c640 1 -- 172.21.15.123:0/3635086722 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cfc0ce4e0 con 0x7f5cfc0b6620 2024-09-15T23:16:43.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.520+0000 7f5d02e5c640 1 -- 172.21.15.123:0/3635086722 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cfc0cff60 con 0x7f5cfc0b6620 2024-09-15T23:16:43.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.520+0000 7f5cf97fa640 1 -- 172.21.15.123:0/3635086722 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5cf0007400 con 0x7f5cfc0b6620 2024-09-15T23:16:43.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.520+0000 7f5cf97fa640 1 --2- 172.21.15.123:0/3635086722 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5ce006c2b0 0x7f5ce006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:43.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.521+0000 7f5cf97fa640 1 -- 172.21.15.123:0/3635086722 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5709+0+0 (secure 0 0 0) 0x7f5cf008a7b0 con 0x7f5cfc0b6620 2024-09-15T23:16:43.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.521+0000 7f5cfbfff640 1 --2- 172.21.15.123:0/3635086722 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5ce006c2b0 0x7f5ce006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:43.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.521+0000 7f5cfbfff640 1 --2- 172.21.15.123:0/3635086722 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5ce006c2b0 0x7f5ce006e770 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc0cda10 tx=0x7f5ce8007be0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:43.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.525+0000 7f5cf97fa640 1 -- 172.21.15.123:0/3635086722 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5cfc0cff60 con 0x7f5cfc0b6620 2024-09-15T23:16:43.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.756+0000 7f5d02e5c640 1 -- 172.21.15.123:0/3635086722 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f5cfc0d2810 con 0x7f5cfc0b6620 2024-09-15T23:16:43.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.758+0000 7f5cf97fa640 1 -- 172.21.15.123:0/3635086722 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7f5cf0058960 con 0x7f5cfc0b6620 2024-09-15T23:16:43.760 INFO:teuthology.orchestra.run.smithi123.stdout:[client.0] 2024-09-15T23:16:43.760 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCNaedmzQPqJRAAhUf1dnVYohN4obCfeu8+7g== 2024-09-15T23:16:43.761 INFO:teuthology.orchestra.run.smithi123.stdout: caps mds = "allow" 2024-09-15T23:16:43.761 INFO:teuthology.orchestra.run.smithi123.stdout: caps mon = "allow r" 2024-09-15T23:16:43.761 INFO:teuthology.orchestra.run.smithi123.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T23:16:43.761 INFO:teuthology.orchestra.run.smithi123.stderr:updated caps for client.0 2024-09-15T23:16:43.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.761+0000 7f5d02e5c640 1 -- 172.21.15.123:0/3635086722 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5ce006c2b0 msgr2=0x7f5ce006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:43.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.761+0000 7f5d02e5c640 1 --2- 172.21.15.123:0/3635086722 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5ce006c2b0 0x7f5ce006e770 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc0cda10 tx=0x7f5ce8007be0 comp rx=0 tx=0).stop 2024-09-15T23:16:43.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.761+0000 7f5d02e5c640 1 -- 172.21.15.123:0/3635086722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cfc0b6620 msgr2=0x7f5cfc0c8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:43.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.761+0000 7f5d02e5c640 1 --2- 172.21.15.123:0/3635086722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cfc0b6620 0x7f5cfc0c8880 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000c3f0 tx=0x7f5cf000c8b0 comp rx=0 tx=0).stop 2024-09-15T23:16:43.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.761+0000 7f5d02e5c640 1 -- 172.21.15.123:0/3635086722 shutdown_connections 2024-09-15T23:16:43.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.761+0000 7f5d02e5c640 1 --2- 172.21.15.123:0/3635086722 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5cfc15ea80 0x7f5cfc1547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:43.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.761+0000 7f5d02e5c640 1 --2- 172.21.15.123:0/3635086722 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5cfc0b6a70 0x7f5cfc1f82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:43.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.761+0000 7f5d02e5c640 1 --2- 172.21.15.123:0/3635086722 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5ce006c2b0 0x7f5ce006e770 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:43.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.761+0000 7f5d02e5c640 1 --2- 172.21.15.123:0/3635086722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cfc0b6620 0x7f5cfc0c8880 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:43.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.761+0000 7f5d02e5c640 1 -- 172.21.15.123:0/3635086722 >> 172.21.15.123:0/3635086722 conn(0x7f5cfc0d1620 msgr2=0x7f5cfc06d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:43.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.761+0000 7f5d02e5c640 1 -- 172.21.15.123:0/3635086722 shutdown_connections 2024-09-15T23:16:43.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.761+0000 7f5d02e5c640 1 -- 172.21.15.123:0/3635086722 wait complete. 2024-09-15T23:16:43.775 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:16:43.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.870+0000 7f597e398640 1 Processor -- start 2024-09-15T23:16:43.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.870+0000 7f597e398640 1 -- start start 2024-09-15T23:16:43.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.871+0000 7f597e398640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5978145ed0 0x7f59780b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:43.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.871+0000 7f597e398640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f5978073180 0x7f59780735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:43.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.871+0000 7f597e398640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59780b4020 con 0x7f59780b5880 2024-09-15T23:16:43.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.871+0000 7f597e398640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f5978073b00 con 0x7f5978073180 2024-09-15T23:16:43.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.871+0000 7f597e398640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f59780b42c0 con 0x7f5978145ed0 2024-09-15T23:16:43.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.871+0000 7f5977fff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5978145ed0 0x7f59780b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:43.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.871+0000 7f59777fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f5978073180 0x7f59780735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:43.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.871+0000 7f597c935640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f59780b5880 0x7f59780b5d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:60716/0 (socket says 172.21.15.123:60716) 2024-09-15T23:16:43.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.871+0000 7f597c935640 1 -- 172.21.15.123:0/2449663419 learned_addr learned my addr 172.21.15.123:0/2449663419 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:43.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.871+0000 7f59777fe640 1 --2- 172.21.15.123:0/2449663419 >> v2:172.21.15.188:3300/0 conn(0x7f5978073180 0x7f59780735c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:52434/0 (socket says 172.21.15.123:52434) 2024-09-15T23:16:43.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.871+0000 7f5977fff640 1 -- 172.21.15.123:0/2449663419 >> v2:172.21.15.188:3300/0 conn(0x7f5978073180 msgr2=0x7f59780735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:43.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.871+0000 7f5977fff640 1 --2- 172.21.15.123:0/2449663419 >> v2:172.21.15.188:3300/0 conn(0x7f5978073180 0x7f59780735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:43.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.871+0000 7f5977fff640 1 -- 172.21.15.123:0/2449663419 >> v1:172.21.15.188:6789/0 conn(0x7f59780b5880 legacy=0x7f59780b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:43.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.871+0000 7f5977fff640 1 -- 172.21.15.123:0/2449663419 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59780b45a0 con 0x7f5978145ed0 2024-09-15T23:16:43.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.871+0000 7f59777fe640 1 --2- 172.21.15.123:0/2449663419 >> v2:172.21.15.188:3300/0 conn(0x7f5978073180 0x7f59780735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:16:43.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.872+0000 7f5977fff640 1 --2- 172.21.15.123:0/2449663419 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5978145ed0 0x7f59780b5080 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f59600097a0 tx=0x7f596002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6afa7bcc19c2e2f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:43.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.872+0000 7f5976ffd640 1 -- 172.21.15.123:0/2449663419 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5960037070 con 0x7f5978145ed0 2024-09-15T23:16:43.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.872+0000 7f5976ffd640 1 -- 172.21.15.123:0/2449663419 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5960032440 con 0x7f5978145ed0 2024-09-15T23:16:43.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.872+0000 7f5976ffd640 1 -- 172.21.15.123:0/2449663419 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5960032810 con 0x7f5978145ed0 2024-09-15T23:16:43.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.873+0000 7f597e398640 1 -- 172.21.15.123:0/2449663419 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5978145ed0 msgr2=0x7f59780b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:43.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.873+0000 7f597e398640 1 --2- 172.21.15.123:0/2449663419 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5978145ed0 0x7f59780b5080 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f59600097a0 tx=0x7f596002a180 comp rx=0 tx=0).stop 2024-09-15T23:16:43.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.873+0000 7f597e398640 1 -- 172.21.15.123:0/2449663419 shutdown_connections 2024-09-15T23:16:43.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.873+0000 7f597e398640 1 --2- 172.21.15.123:0/2449663419 >> v2:172.21.15.188:3300/0 conn(0x7f5978073180 0x7f59780735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:43.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.873+0000 7f597e398640 1 --2- 172.21.15.123:0/2449663419 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5978145ed0 0x7f59780b5080 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:43.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.873+0000 7f597e398640 1 -- 172.21.15.123:0/2449663419 >> 172.21.15.123:0/2449663419 conn(0x7f59780ccec0 msgr2=0x7f59780cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:43.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.873+0000 7f597e398640 1 -- 172.21.15.123:0/2449663419 shutdown_connections 2024-09-15T23:16:43.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.873+0000 7f597e398640 1 -- 172.21.15.123:0/2449663419 wait complete. 2024-09-15T23:16:43.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.874+0000 7f597e398640 1 Processor -- start 2024-09-15T23:16:43.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.874+0000 7f597e398640 1 -- start start 2024-09-15T23:16:43.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.875+0000 7f597e398640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5978073180 0x7f5978159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:43.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.875+0000 7f597e398640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f59780b5880 0x7f597815a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:43.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.875+0000 7f597e398640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5978145ed0 0x7f597813c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:43.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.875+0000 7f597e398640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f59781462b0 con 0x7f5978073180 2024-09-15T23:16:43.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.875+0000 7f597e398640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f59780b4b60 con 0x7f59780b5880 2024-09-15T23:16:43.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.875+0000 7f597e398640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5978146430 con 0x7f5978145ed0 2024-09-15T23:16:43.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.875+0000 7f5977fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5978073180 0x7f5978159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:43.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.875+0000 7f5977fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5978073180 0x7f5978159fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46676/0 (socket says 172.21.15.123:46676) 2024-09-15T23:16:43.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.875+0000 7f5977fff640 1 -- 172.21.15.123:0/1537739420 learned_addr learned my addr 172.21.15.123:0/1537739420 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:43.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.875+0000 7f59777fe640 1 --2- 172.21.15.123:0/1537739420 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f59780b5880 0x7f597815a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:43.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.875+0000 7f597c935640 1 --2- 172.21.15.123:0/1537739420 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5978145ed0 0x7f597813c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:43.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.875+0000 7f5977fff640 1 -- 172.21.15.123:0/1537739420 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5978145ed0 msgr2=0x7f597813c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:43.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.875+0000 7f5977fff640 1 --2- 172.21.15.123:0/1537739420 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5978145ed0 0x7f597813c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:43.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.875+0000 7f5977fff640 1 -- 172.21.15.123:0/1537739420 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f59780b5880 msgr2=0x7f597815a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:43.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.875+0000 7f5977fff640 1 --2- 172.21.15.123:0/1537739420 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f59780b5880 0x7f597815a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:43.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.875+0000 7f5977fff640 1 -- 172.21.15.123:0/1537739420 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5978141250 con 0x7f5978073180 2024-09-15T23:16:43.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.876+0000 7f5977fff640 1 --2- 172.21.15.123:0/1537739420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5978073180 0x7f5978159fd0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f5960000c00 tx=0x7f59600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:43.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.876+0000 7f5974ff9640 1 -- 172.21.15.123:0/1537739420 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5960037040 con 0x7f5978073180 2024-09-15T23:16:43.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.876+0000 7f5974ff9640 1 -- 172.21.15.123:0/1537739420 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5960042070 con 0x7f5978073180 2024-09-15T23:16:43.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.876+0000 7f5974ff9640 1 -- 172.21.15.123:0/1537739420 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5960030920 con 0x7f5978073180 2024-09-15T23:16:43.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.876+0000 7f597e398640 1 -- 172.21.15.123:0/1537739420 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5978141530 con 0x7f5978073180 2024-09-15T23:16:43.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.876+0000 7f597e398640 1 -- 172.21.15.123:0/1537739420 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5978141af0 con 0x7f5978073180 2024-09-15T23:16:43.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.877+0000 7f597e398640 1 -- 172.21.15.123:0/1537739420 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59780735c0 con 0x7f5978073180 2024-09-15T23:16:43.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.877+0000 7f5974ff9640 1 -- 172.21.15.123:0/1537739420 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5960030ac0 con 0x7f5978073180 2024-09-15T23:16:43.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.878+0000 7f5974ff9640 1 --2- 172.21.15.123:0/1537739420 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f595806c2e0 0x7f595806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:43.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.878+0000 7f5974ff9640 1 -- 172.21.15.123:0/1537739420 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5709+0+0 (secure 0 0 0) 0x7f59600abc00 con 0x7f5978073180 2024-09-15T23:16:43.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.878+0000 7f59777fe640 1 --2- 172.21.15.123:0/1537739420 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f595806c2e0 0x7f595806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:43.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.879+0000 7f59777fe640 1 --2- 172.21.15.123:0/1537739420 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f595806c2e0 0x7f595806e7a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5978144060 tx=0x7f5968009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:43.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:43.882+0000 7f5974ff9640 1 -- 172.21.15.123:0/1537739420 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f59600b2080 con 0x7f5978073180 2024-09-15T23:16:44.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.081+0000 7f597e398640 1 -- 172.21.15.123:0/1537739420 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f59780cea60 con 0x7f5978073180 2024-09-15T23:16:44.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.082+0000 7f5974ff9640 1 -- 172.21.15.123:0/1537739420 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+5234 (secure 0 0 0) 0x7f5960080020 con 0x7f5978073180 2024-09-15T23:16:44.084 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:16:44.084 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":59,"btime":"2024-09-15T23:16:37:768064+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7131,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/3875308284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3875308284},{"type":"v1","addr":"172.21.15.123:6834","nonce":3875308284}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":7134,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/799549293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":799549293},{"type":"v1","addr":"172.21.15.123:6835","nonce":799549293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":7146,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2244093297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2244093297},{"type":"v1","addr":"172.21.15.188:6836","nonce":2244093297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:16:35.080780+0000","modified":"2024-09-15T23:16:37.091111+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7149},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7149":{"gid":7149,"name":"b","rank":0,"incarnation":57,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6837/2840550551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2840550551},{"type":"v1","addr":"172.21.15.188:6837","nonce":2840550551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7149,"qdb_cluster":[7149]},"id":6}]} 2024-09-15T23:16:44.084 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 59 2024-09-15T23:16:44.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.083+0000 7f597e398640 1 -- 172.21.15.123:0/1537739420 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f595806c2e0 msgr2=0x7f595806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:44.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.083+0000 7f597e398640 1 --2- 172.21.15.123:0/1537739420 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f595806c2e0 0x7f595806e7a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5978144060 tx=0x7f5968009190 comp rx=0 tx=0).stop 2024-09-15T23:16:44.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.084+0000 7f597e398640 1 -- 172.21.15.123:0/1537739420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5978073180 msgr2=0x7f5978159fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:44.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.084+0000 7f597e398640 1 --2- 172.21.15.123:0/1537739420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5978073180 0x7f5978159fd0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f5960000c00 tx=0x7f59600046c0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.084+0000 7f597e398640 1 -- 172.21.15.123:0/1537739420 shutdown_connections 2024-09-15T23:16:44.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.084+0000 7f597e398640 1 --2- 172.21.15.123:0/1537739420 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5978145ed0 0x7f597813c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.084+0000 7f597e398640 1 --2- 172.21.15.123:0/1537739420 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f59780b5880 0x7f597815a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.084+0000 7f597e398640 1 --2- 172.21.15.123:0/1537739420 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f595806c2e0 0x7f595806e7a0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.084+0000 7f597e398640 1 --2- 172.21.15.123:0/1537739420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5978073180 0x7f5978159fd0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.084+0000 7f597e398640 1 -- 172.21.15.123:0/1537739420 >> 172.21.15.123:0/1537739420 conn(0x7f59780ccec0 msgr2=0x7f59780cdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:44.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.084+0000 7f597e398640 1 -- 172.21.15.123:0/1537739420 shutdown_connections 2024-09-15T23:16:44.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.084+0000 7f597e398640 1 -- 172.21.15.123:0/1537739420 wait complete. 2024-09-15T23:16:44.499 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 59, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:16:35.080780+0000', 'modified': '2024-09-15T23:16:37.091111+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7149}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7149': {'gid': 7149, 'name': 'b', 'rank': 0, 'incarnation': 57, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.188:6837/2840550551', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6835', 'nonce': 2840550551}, {'type': 'v1', 'addr': '172.21.15.188:6837', 'nonce': 2840550551}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7149, 'qdb_cluster': [7149]} 2024-09-15T23:16:44.499 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:16:44.499 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-15T23:16:44.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.598+0000 7f61c3731640 1 Processor -- start 2024-09-15T23:16:44.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.598+0000 7f61c3731640 1 -- start start 2024-09-15T23:16:44.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.599+0000 7f61c3731640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f61bc06c6a0 0x7f61bc0720b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:44.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.599+0000 7f61c3731640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61bc071010 con 0x7f61bc15ab40 2024-09-15T23:16:44.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.599+0000 7f61c3731640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61bc0712f0 con 0x7f61bc15af20 2024-09-15T23:16:44.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.599+0000 7f61c3731640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f61bc06cb10 con 0x7f61bc06c6a0 2024-09-15T23:16:44.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.599+0000 7f61c14cd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f61bc15ab40 0x7f61bc073990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:57264/0 (socket says 172.21.15.123:57264) 2024-09-15T23:16:44.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.599+0000 7f61c14cd640 1 -- 172.21.15.123:0/2276230660 learned_addr learned my addr 172.21.15.123:0/2276230660 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:44.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.600+0000 7f61bbfff640 1 -- 172.21.15.123:0/2276230660 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1189764797 0 0) 0x7f61bc071010 con 0x7f61bc15ab40 2024-09-15T23:16:44.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.600+0000 7f61bbfff640 1 -- 172.21.15.123:0/2276230660 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61a4003440 con 0x7f61bc15ab40 2024-09-15T23:16:44.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.600+0000 7f61c0ccc640 1 --2- 172.21.15.123:0/2276230660 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f61bc06c6a0 0x7f61bc0720b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:44.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.600+0000 7f61bbfff640 1 -- 172.21.15.123:0/2276230660 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3081739630 0 0) 0x7f61a4003440 con 0x7f61bc15ab40 2024-09-15T23:16:44.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.600+0000 7f61bbfff640 1 -- 172.21.15.123:0/2276230660 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f61bc06c6a0 msgr2=0x7f61bc0720b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:44.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.600+0000 7f61bbfff640 1 --2- 172.21.15.123:0/2276230660 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f61bc06c6a0 0x7f61bc0720b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.600+0000 7f61bbfff640 1 -- 172.21.15.123:0/2276230660 >> v1:172.21.15.188:6789/0 conn(0x7f61bc15af20 legacy=0x7f61bc15b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:44.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.600+0000 7f61bbfff640 1 -- 172.21.15.123:0/2276230660 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61bc0715d0 con 0x7f61bc15ab40 2024-09-15T23:16:44.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.600+0000 7f61bbfff640 1 -- 172.21.15.123:0/2276230660 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f61ac001a10 con 0x7f61bc15ab40 2024-09-15T23:16:44.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.600+0000 7f61bbfff640 1 -- 172.21.15.123:0/2276230660 >> v1:172.21.15.123:6789/0 conn(0x7f61bc15ab40 legacy=0x7f61bc073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:44.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.600+0000 7f61bbfff640 1 --2- 172.21.15.123:0/2276230660 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61a4003ad0 0x7f61a4003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:44.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.600+0000 7f61bbfff640 1 --2- 172.21.15.123:0/2276230660 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f61bc06c6a0 0x7f61a400a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:44.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.600+0000 7f61bbfff640 1 --2- 172.21.15.123:0/2276230660 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61a400afe0 0x7f61a400d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:44.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.600+0000 7f61bbfff640 1 -- 172.21.15.123:0/2276230660 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f61a400dcf0 con 0x7f61a4003ad0 2024-09-15T23:16:44.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.600+0000 7f61bbfff640 1 -- 172.21.15.123:0/2276230660 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f61a400dea0 con 0x7f61a400afe0 2024-09-15T23:16:44.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.600+0000 7f61bbfff640 1 -- 172.21.15.123:0/2276230660 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f61a400e0a0 con 0x7f61bc06c6a0 2024-09-15T23:16:44.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.600+0000 7f61c14cd640 1 --2- 172.21.15.123:0/2276230660 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61a4003ad0 0x7f61a4003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:44.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.600+0000 7f61c0ccc640 1 --2- 172.21.15.123:0/2276230660 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f61bc06c6a0 0x7f61a400a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:44.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.600+0000 7f61c1cce640 1 --2- 172.21.15.123:0/2276230660 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61a400afe0 0x7f61a400d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:44.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.600+0000 7f61c14cd640 1 -- 172.21.15.123:0/2276230660 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f61bc06c6a0 msgr2=0x7f61a400a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:44.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.600+0000 7f61c14cd640 1 --2- 172.21.15.123:0/2276230660 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f61bc06c6a0 0x7f61a400a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.600+0000 7f61c14cd640 1 -- 172.21.15.123:0/2276230660 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61a400afe0 msgr2=0x7f61a400d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:44.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.600+0000 7f61c14cd640 1 --2- 172.21.15.123:0/2276230660 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61a400afe0 0x7f61a400d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.600+0000 7f61c14cd640 1 -- 172.21.15.123:0/2276230660 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61a4003440 con 0x7f61a4003ad0 2024-09-15T23:16:44.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.600+0000 7f61c1cce640 1 --2- 172.21.15.123:0/2276230660 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61a400afe0 0x7f61a400d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:16:44.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.601+0000 7f61c14cd640 1 --2- 172.21.15.123:0/2276230660 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61a4003ad0 0x7f61a4003ef0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f61ac00a830 tx=0x7f61a4003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be4c88d3ac26d9ac server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:44.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.601+0000 7f61bbfff640 1 -- 172.21.15.123:0/2276230660 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ac00a480 con 0x7f61a4003ad0 2024-09-15T23:16:44.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.601+0000 7f61bbfff640 1 -- 172.21.15.123:0/2276230660 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61ac02f070 con 0x7f61a4003ad0 2024-09-15T23:16:44.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.601+0000 7f61bbfff640 1 -- 172.21.15.123:0/2276230660 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ac02bc90 con 0x7f61a4003ad0 2024-09-15T23:16:44.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.602+0000 7f61c3731640 1 -- 172.21.15.123:0/2276230660 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61a4003ad0 msgr2=0x7f61a4003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:44.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.602+0000 7f61c3731640 1 --2- 172.21.15.123:0/2276230660 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61a4003ad0 0x7f61a4003ef0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f61ac00a830 tx=0x7f61a4003730 comp rx=0 tx=0).stop 2024-09-15T23:16:44.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.602+0000 7f61c1cce640 1 -- 172.21.15.123:0/2276230660 reap_dead start 2024-09-15T23:16:44.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.602+0000 7f61c3731640 1 -- 172.21.15.123:0/2276230660 shutdown_connections 2024-09-15T23:16:44.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.602+0000 7f61c3731640 1 -- 172.21.15.123:0/2276230660 >> 172.21.15.123:0/2276230660 conn(0x7f61bc0ccec0 msgr2=0x7f61bc0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:44.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.602+0000 7f61c3731640 1 -- 172.21.15.123:0/2276230660 shutdown_connections 2024-09-15T23:16:44.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.602+0000 7f61c3731640 1 -- 172.21.15.123:0/2276230660 wait complete. 2024-09-15T23:16:44.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.603+0000 7f61c3731640 1 Processor -- start 2024-09-15T23:16:44.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.603+0000 7f61c3731640 1 -- start start 2024-09-15T23:16:44.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.604+0000 7f61c3731640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61a4003ad0 0x7f61bc145ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:44.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.604+0000 7f61c3731640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f61bc1f3a60 0x7f61bc1f3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:44.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.604+0000 7f61c3731640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61bc1560e0 0x7f61bc156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:44.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.604+0000 7f61c3731640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f61bc0720b0 con 0x7f61a4003ad0 2024-09-15T23:16:44.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.604+0000 7f61c3731640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f61bc15baa0 con 0x7f61bc1560e0 2024-09-15T23:16:44.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.604+0000 7f61c3731640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f61bc072230 con 0x7f61bc1f3a60 2024-09-15T23:16:44.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.604+0000 7f61c14cd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61a4003ad0 0x7f61bc145ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:44.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.604+0000 7f61c14cd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61a4003ad0 0x7f61bc145ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46690/0 (socket says 172.21.15.123:46690) 2024-09-15T23:16:44.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.604+0000 7f61c14cd640 1 -- 172.21.15.123:0/1564017687 learned_addr learned my addr 172.21.15.123:0/1564017687 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:44.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.604+0000 7f61c0ccc640 1 --2- 172.21.15.123:0/1564017687 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f61bc1f3a60 0x7f61bc1f3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:44.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.604+0000 7f61c1cce640 1 --2- 172.21.15.123:0/1564017687 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61bc1560e0 0x7f61bc156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:44.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.604+0000 7f61c14cd640 1 -- 172.21.15.123:0/1564017687 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f61bc1f3a60 msgr2=0x7f61bc1f3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:44.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.604+0000 7f61c14cd640 1 --2- 172.21.15.123:0/1564017687 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f61bc1f3a60 0x7f61bc1f3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.604+0000 7f61c14cd640 1 -- 172.21.15.123:0/1564017687 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61bc1560e0 msgr2=0x7f61bc156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:44.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.604+0000 7f61c14cd640 1 --2- 172.21.15.123:0/1564017687 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61bc1560e0 0x7f61bc156560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.604+0000 7f61c14cd640 1 -- 172.21.15.123:0/1564017687 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61bc1f44e0 con 0x7f61a4003ad0 2024-09-15T23:16:44.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.604+0000 7f61c14cd640 1 --2- 172.21.15.123:0/1564017687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61a4003ad0 0x7f61bc145ed0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f61ac00a830 tx=0x7f61bc0714c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:44.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.604+0000 7f61b9ffb640 1 -- 172.21.15.123:0/1564017687 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ac001fd0 con 0x7f61a4003ad0 2024-09-15T23:16:44.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.604+0000 7f61b9ffb640 1 -- 172.21.15.123:0/1564017687 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61ac004d60 con 0x7f61a4003ad0 2024-09-15T23:16:44.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.604+0000 7f61b9ffb640 1 -- 172.21.15.123:0/1564017687 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ac034670 con 0x7f61a4003ad0 2024-09-15T23:16:44.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.604+0000 7f61c3731640 1 -- 172.21.15.123:0/1564017687 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61bc1f47c0 con 0x7f61a4003ad0 2024-09-15T23:16:44.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.605+0000 7f61c3731640 1 -- 172.21.15.123:0/1564017687 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61bc146410 con 0x7f61a4003ad0 2024-09-15T23:16:44.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.606+0000 7f61b9ffb640 1 -- 172.21.15.123:0/1564017687 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f61ac034810 con 0x7f61a4003ad0 2024-09-15T23:16:44.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.606+0000 7f61b9ffb640 1 --2- 172.21.15.123:0/1564017687 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f61a806c2b0 0x7f61a806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:44.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.607+0000 7f61b9ffb640 1 -- 172.21.15.123:0/1564017687 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5709+0+0 (secure 0 0 0) 0x7f61ac0ab9d0 con 0x7f61a4003ad0 2024-09-15T23:16:44.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.607+0000 7f61c0ccc640 1 --2- 172.21.15.123:0/1564017687 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f61a806c2b0 0x7f61a806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:44.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.607+0000 7f61c64cb740 1 Processor -- start 2024-09-15T23:16:44.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.607+0000 7f61c0ccc640 1 --2- 172.21.15.123:0/1564017687 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f61a806c2b0 0x7f61a806e770 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f61b0009a20 tx=0x7f61b0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:44.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.607+0000 7f61c64cb740 1 -- start start 2024-09-15T23:16:44.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.608+0000 7f61c64cb740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f10ce2120 0x558f10ce2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:44.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.608+0000 7f61c64cb740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558f10cfcae0 0x558f10cfe290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:44.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.608+0000 7f61c64cb740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558f10cb5a80 0x558f10cfe7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:44.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.608+0000 7f61c64cb740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x558f10c1a520 con 0x558f10cfcae0 2024-09-15T23:16:44.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.608+0000 7f61c64cb740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x558f10bc23e0 con 0x558f10ce2120 2024-09-15T23:16:44.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.608+0000 7f61c64cb740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x558f10c164e0 con 0x558f10cb5a80 2024-09-15T23:16:44.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.608+0000 7f61c0ccc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558f10cfcae0 0x558f10cfe290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:44.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.608+0000 7f61c0ccc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558f10cfcae0 0x558f10cfe290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46696/0 (socket says 172.21.15.123:46696) 2024-09-15T23:16:44.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.608+0000 7f61c0ccc640 1 -- 172.21.15.123:0/1513213492 learned_addr learned my addr 172.21.15.123:0/1513213492 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:44.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.608+0000 7f61c1cce640 1 --2- 172.21.15.123:0/1513213492 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558f10cb5a80 0x558f10cfe7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:44.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.608+0000 7f61c14cd640 1 --2- 172.21.15.123:0/1513213492 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f10ce2120 0x558f10ce2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:44.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.608+0000 7f61c0ccc640 1 -- 172.21.15.123:0/1513213492 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558f10cb5a80 msgr2=0x558f10cfe7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:44.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.608+0000 7f61c0ccc640 1 --2- 172.21.15.123:0/1513213492 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558f10cb5a80 0x558f10cfe7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.608+0000 7f61c0ccc640 1 -- 172.21.15.123:0/1513213492 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f10ce2120 msgr2=0x558f10ce2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:44.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.608+0000 7f61c0ccc640 1 --2- 172.21.15.123:0/1513213492 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f10ce2120 0x558f10ce2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.608+0000 7f61c0ccc640 1 -- 172.21.15.123:0/1513213492 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f10bdd2f0 con 0x558f10cfcae0 2024-09-15T23:16:44.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.608+0000 7f61c1cce640 1 --2- 172.21.15.123:0/1513213492 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558f10cb5a80 0x558f10cfe7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:16:44.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.608+0000 7f61c14cd640 1 --2- 172.21.15.123:0/1513213492 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f10ce2120 0x558f10ce2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:16:44.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.609+0000 7f61c0ccc640 1 --2- 172.21.15.123:0/1513213492 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558f10cfcae0 0x558f10cfe290 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f61b0014d40 tx=0x7f61b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=336386aa48aee4cc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:44.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.609+0000 7f61a2ffd640 1 -- 172.21.15.123:0/1513213492 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b0027070 con 0x558f10cfcae0 2024-09-15T23:16:44.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.609+0000 7f61a2ffd640 1 -- 172.21.15.123:0/1513213492 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61b0023450 con 0x558f10cfcae0 2024-09-15T23:16:44.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.609+0000 7f61a2ffd640 1 -- 172.21.15.123:0/1513213492 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b0006bd0 con 0x558f10cfcae0 2024-09-15T23:16:44.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.609+0000 7f61c64cb740 1 -- 172.21.15.123:0/1513213492 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558f10cfcae0 msgr2=0x558f10cfe290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:44.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.609+0000 7f61c64cb740 1 --2- 172.21.15.123:0/1513213492 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558f10cfcae0 0x558f10cfe290 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f61b0014d40 tx=0x7f61b0017000 comp rx=0 tx=0).stop 2024-09-15T23:16:44.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.609+0000 7f61c64cb740 1 -- 172.21.15.123:0/1513213492 shutdown_connections 2024-09-15T23:16:44.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.609+0000 7f61c64cb740 1 --2- 172.21.15.123:0/1513213492 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558f10cb5a80 0x558f10cfe7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.609+0000 7f61c64cb740 1 --2- 172.21.15.123:0/1513213492 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558f10cfcae0 0x558f10cfe290 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.609+0000 7f61c64cb740 1 --2- 172.21.15.123:0/1513213492 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f10ce2120 0x558f10ce2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.609+0000 7f61c64cb740 1 -- 172.21.15.123:0/1513213492 >> 172.21.15.123:0/1513213492 conn(0x558f10cb4a80 msgr2=0x558f10cfcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:44.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.609+0000 7f61c64cb740 1 -- 172.21.15.123:0/1513213492 shutdown_connections 2024-09-15T23:16:44.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.609+0000 7f61c64cb740 1 -- 172.21.15.123:0/1513213492 wait complete. 2024-09-15T23:16:44.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.610+0000 7f61c64cb740 1 -- start start 2024-09-15T23:16:44.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.610+0000 7f61c64cb740 1 Processor -- start 2024-09-15T23:16:44.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.611+0000 7f61c64cb740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f10ce2120 0x558f10cb68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:44.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.611+0000 7f61c64cb740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558f10cfcae0 0x558f10cde7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:44.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.611+0000 7f61c64cb740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558f10cfb620 0x558f10cfba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:44.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.611+0000 7f61c64cb740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x558f10ce2ee0 con 0x558f10cfcae0 2024-09-15T23:16:44.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.611+0000 7f61c64cb740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x558f10ba3450 con 0x558f10ce2120 2024-09-15T23:16:44.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.611+0000 7f61c64cb740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x558f10cfd770 con 0x558f10cfb620 2024-09-15T23:16:44.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.611+0000 7f61c64cb740 10 client.0 _ll_register_callbacks cb 0x558f1092cac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:16:44.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.611+0000 7f61c0ccc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558f10cfcae0 0x558f10cde7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:44.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.611+0000 7f61c0ccc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558f10cfcae0 0x558f10cde7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46700/0 (socket says 172.21.15.123:46700) 2024-09-15T23:16:44.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.611+0000 7f61c0ccc640 1 -- 172.21.15.123:0/3519509668 learned_addr learned my addr 172.21.15.123:0/3519509668 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:44.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.611+0000 7f61c14cd640 1 --2- 172.21.15.123:0/3519509668 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f10ce2120 0x558f10cb68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:44.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.611+0000 7f61c1cce640 1 --2- 172.21.15.123:0/3519509668 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558f10cfb620 0x558f10cfba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:44.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.611+0000 7f61c0ccc640 1 -- 172.21.15.123:0/3519509668 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558f10cfb620 msgr2=0x558f10cfba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:44.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.611+0000 7f61c0ccc640 1 --2- 172.21.15.123:0/3519509668 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558f10cfb620 0x558f10cfba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.611+0000 7f61c0ccc640 1 -- 172.21.15.123:0/3519509668 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f10ce2120 msgr2=0x558f10cb68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:44.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.611+0000 7f61c0ccc640 1 --2- 172.21.15.123:0/3519509668 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f10ce2120 0x558f10cb68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.611+0000 7f61c0ccc640 1 -- 172.21.15.123:0/3519509668 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f1092d2d0 con 0x558f10cfcae0 2024-09-15T23:16:44.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.611+0000 7f61c0ccc640 1 --2- 172.21.15.123:0/3519509668 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558f10cfcae0 0x558f10cde7a0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x558f10cdfab0 tx=0x7f61b0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71709004643dab68 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:44.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.611+0000 7f6197fff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:16:44.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.612+0000 7f6197fff640 1 -- 172.21.15.123:0/3519509668 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b0027040 con 0x558f10cfcae0 2024-09-15T23:16:44.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.612+0000 7f6197fff640 1 -- 172.21.15.123:0/3519509668 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 5709+0+0 (secure 0 0 0) 0x7f61b0037680 con 0x558f10cfcae0 2024-09-15T23:16:44.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.612+0000 7f61c64cb740 1 -- 172.21.15.123:0/3519509668 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61b0023450 con 0x558f10cfcae0 2024-09-15T23:16:44.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.612+0000 7f6197fff640 1 -- 172.21.15.123:0/3519509668 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f61b003f050 con 0x558f10cfcae0 2024-09-15T23:16:44.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.612+0000 7f61c64cb740 10 client.7284 fetch_fsmap learned FSMap version 59 2024-09-15T23:16:44.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.612+0000 7f61c64cb740 1 -- 172.21.15.123:0/3519509668 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) -- 0x558f109f76b0 con 0x558f10cfcae0 2024-09-15T23:16:44.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.612+0000 7f6197fff640 1 -- 172.21.15.123:0/3519509668 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61b0023450 con 0x558f10cfcae0 2024-09-15T23:16:44.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.612+0000 7f6197fff640 1 -- 172.21.15.123:0/3519509668 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 59) ==== 3502+0+0 (secure 0 0 0) 0x7f61b0042020 con 0x558f10cfcae0 2024-09-15T23:16:44.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.612+0000 7f61c64cb740 10 client.7284 fetch_fsmap finished waiting for FSMap version 59 2024-09-15T23:16:44.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.612+0000 7f61c64cb740 10 client.7284 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T23:16:44.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.612+0000 7f61c64cb740 20 client.7284 populate_metadata read hostname 'smithi123' 2024-09-15T23:16:44.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.612+0000 7f61c64cb740 1 --2- 172.21.15.123:0/3519509668 >> [v2:172.21.15.188:6835/2840550551,v1:172.21.15.188:6837/2840550551] conn(0x558f10d14b20 0x558f10d14f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:44.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.612+0000 7f61c64cb740 4 client.7284 mds_command: new command op to 7149 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:16:44.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.612+0000 7f61c64cb740 1 -- 172.21.15.123:0/3519509668 --> [v2:172.21.15.188:6835/2840550551,v1:172.21.15.188:6837/2840550551] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f10c27c50 con 0x558f10d14b20 2024-09-15T23:16:44.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.612+0000 7f61c14cd640 1 --2- 172.21.15.123:0/3519509668 >> [v2:172.21.15.188:6835/2840550551,v1:172.21.15.188:6837/2840550551] conn(0x558f10d14b20 0x558f10d14f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:44.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.613+0000 7f6197fff640 10 client.7284 ms_handle_connect on v2:172.21.15.188:6835/2840550551 2024-09-15T23:16:44.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.613+0000 7f61c14cd640 1 --2- 172.21.15.123:0/3519509668 >> [v2:172.21.15.188:6835/2840550551,v1:172.21.15.188:6837/2840550551] conn(0x558f10d14b20 0x558f10d14f00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b274e08364ba7ef server_cookie=7ccafdc7728c3a6b in_seq=0 out_seq=0 2024-09-15T23:16:44.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.613+0000 7f6197fff640 1 -- 172.21.15.123:0/3519509668 <== mds.0 v2:172.21.15.188:6835/2840550551 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558f10c27c50 con 0x558f10d14b20 2024-09-15T23:16:44.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.613+0000 7f6197fff640 10 client.7284 handle_command_reply: tid=0 2024-09-15T23:16:44.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.613+0000 7f61c64cb740 1 client.7284 shutdown 2024-09-15T23:16:44.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.614+0000 7f61c64cb740 1 -- 172.21.15.123:0/3519509668 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558f10cfcae0 msgr2=0x558f10cde7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:44.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.614+0000 7f61c64cb740 1 --2- 172.21.15.123:0/3519509668 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558f10cfcae0 0x558f10cde7a0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x558f10cdfab0 tx=0x7f61b0004730 comp rx=0 tx=0).stop 2024-09-15T23:16:44.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.614+0000 7f61c64cb740 1 -- 172.21.15.123:0/3519509668 shutdown_connections 2024-09-15T23:16:44.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.614+0000 7f61c64cb740 1 --2- 172.21.15.123:0/3519509668 >> [v2:172.21.15.188:6835/2840550551,v1:172.21.15.188:6837/2840550551] conn(0x558f10d14b20 0x558f10d14f00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.614+0000 7f61c64cb740 1 --2- 172.21.15.123:0/3519509668 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558f10cfb620 0x558f10cfba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.614+0000 7f61c64cb740 1 --2- 172.21.15.123:0/3519509668 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558f10cfcae0 0x558f10cde7a0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.614+0000 7f6197fff640 0 client.7284 ms_handle_reset on v2:172.21.15.188:6835/2840550551 2024-09-15T23:16:44.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.614+0000 7f61c64cb740 1 --2- 172.21.15.123:0/3519509668 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f10ce2120 0x558f10cb68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.614+0000 7f61c64cb740 1 -- 172.21.15.123:0/3519509668 >> 172.21.15.123:0/3519509668 conn(0x558f10cb5a80 msgr2=0x558f10d068d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:44.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.614+0000 7f61c64cb740 1 -- 172.21.15.123:0/3519509668 shutdown_connections 2024-09-15T23:16:44.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.614+0000 7f61c64cb740 1 -- 172.21.15.123:0/3519509668 wait complete. 2024-09-15T23:16:44.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.614+0000 7f61c64cb740 20 client.7284 trim_cache size 0 max 16384 2024-09-15T23:16:44.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.631+0000 7f61c64cb740 1 Processor -- start 2024-09-15T23:16:44.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.631+0000 7f61c64cb740 1 -- start start 2024-09-15T23:16:44.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.632+0000 7f61c64cb740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558f10ce2120 0x558f10ce5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:44.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.632+0000 7f61c64cb740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f10cfb620 0x558f10d1b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:44.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.632+0000 7f61c64cb740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558f10cfcae0 0x558f10cde260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:44.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.632+0000 7f61c64cb740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f61bc1fbf70 con 0x558f10cfcae0 2024-09-15T23:16:44.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.632+0000 7f61c64cb740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f61bc157e80 con 0x558f10cfb620 2024-09-15T23:16:44.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.632+0000 7f61c64cb740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f61bc1584d0 con 0x558f10ce2120 2024-09-15T23:16:44.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.632+0000 7f61c1cce640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558f10cfcae0 0x558f10cde260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:44.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.632+0000 7f61c1cce640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558f10cfcae0 0x558f10cde260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46704/0 (socket says 172.21.15.123:46704) 2024-09-15T23:16:44.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.632+0000 7f61c1cce640 1 -- 172.21.15.123:0/3511679372 learned_addr learned my addr 172.21.15.123:0/3511679372 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:44.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.632+0000 7f61c1cce640 1 -- 172.21.15.123:0/3511679372 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558f10ce2120 msgr2=0x558f10ce5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:44.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.632+0000 7f61c1cce640 1 --2- 172.21.15.123:0/3511679372 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558f10ce2120 0x558f10ce5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.632+0000 7f61c1cce640 1 -- 172.21.15.123:0/3511679372 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f10cfb620 msgr2=0x558f10d1b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:44.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.632+0000 7f61c1cce640 1 --2- 172.21.15.123:0/3511679372 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f10cfb620 0x558f10d1b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.632+0000 7f61c1cce640 1 -- 172.21.15.123:0/3511679372 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f10ce2870 con 0x558f10cfcae0 2024-09-15T23:16:44.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.633+0000 7f61c1cce640 1 --2- 172.21.15.123:0/3511679372 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558f10cfcae0 0x558f10cde260 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f61bc06f3c0 tx=0x7f61b4001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8520ace43419573 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:44.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.633+0000 7f61a27fc640 1 -- 172.21.15.123:0/3511679372 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b4010040 con 0x558f10cfcae0 2024-09-15T23:16:44.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.633+0000 7f61a27fc640 1 -- 172.21.15.123:0/3511679372 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61b401b070 con 0x558f10cfcae0 2024-09-15T23:16:44.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.633+0000 7f61a27fc640 1 -- 172.21.15.123:0/3511679372 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b4001d00 con 0x558f10cfcae0 2024-09-15T23:16:44.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.633+0000 7f61c64cb740 1 -- 172.21.15.123:0/3511679372 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558f10cfcae0 msgr2=0x558f10cde260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:44.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.633+0000 7f61c64cb740 1 --2- 172.21.15.123:0/3511679372 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558f10cfcae0 0x558f10cde260 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f61bc06f3c0 tx=0x7f61b4001ab0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.633+0000 7f61c64cb740 1 -- 172.21.15.123:0/3511679372 shutdown_connections 2024-09-15T23:16:44.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.633+0000 7f61c64cb740 1 --2- 172.21.15.123:0/3511679372 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558f10cfcae0 0x558f10cde260 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.633+0000 7f61c64cb740 1 --2- 172.21.15.123:0/3511679372 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f10cfb620 0x558f10d1b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.633+0000 7f61c64cb740 1 --2- 172.21.15.123:0/3511679372 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558f10ce2120 0x558f10ce5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.633+0000 7f61c64cb740 1 -- 172.21.15.123:0/3511679372 >> 172.21.15.123:0/3511679372 conn(0x558f10cb5a80 msgr2=0x558f10cfaee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:44.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.633+0000 7f61c64cb740 1 -- 172.21.15.123:0/3511679372 shutdown_connections 2024-09-15T23:16:44.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.633+0000 7f61c64cb740 1 -- 172.21.15.123:0/3511679372 wait complete. 2024-09-15T23:16:44.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.634+0000 7f61c64cb740 1 -- start start 2024-09-15T23:16:44.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.634+0000 7f61c64cb740 1 Processor -- start 2024-09-15T23:16:44.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.635+0000 7f61c64cb740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558f10ce2120 0x558f10d06fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:44.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.635+0000 7f61c64cb740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f10cfb620 0x558f10d7f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:44.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.635+0000 7f61c64cb740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558f10cfcae0 0x558f10d75720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:44.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.635+0000 7f61c64cb740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x558f10cf87d0 con 0x558f10ce2120 2024-09-15T23:16:44.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.635+0000 7f61c64cb740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x558f10cf8040 con 0x558f10cfb620 2024-09-15T23:16:44.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.635+0000 7f61c64cb740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x558f10cdee00 con 0x558f10cfcae0 2024-09-15T23:16:44.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.635+0000 7f61c64cb740 10 client.0 _ll_register_callbacks cb 0x7f61b0014c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:16:44.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.635+0000 7f61c14cd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558f10ce2120 0x558f10d06fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:44.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.635+0000 7f61c14cd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558f10ce2120 0x558f10d06fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46706/0 (socket says 172.21.15.123:46706) 2024-09-15T23:16:44.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.635+0000 7f61c14cd640 1 -- 172.21.15.123:0/651311729 learned_addr learned my addr 172.21.15.123:0/651311729 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:44.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.635+0000 7f61c0ccc640 1 --2- 172.21.15.123:0/651311729 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f10cfb620 0x558f10d7f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:44.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.635+0000 7f61c14cd640 1 -- 172.21.15.123:0/651311729 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558f10cfcae0 msgr2=0x558f10d75720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:44.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.635+0000 7f61c1cce640 1 --2- 172.21.15.123:0/651311729 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558f10cfcae0 0x558f10d75720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:44.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.635+0000 7f61c14cd640 1 --2- 172.21.15.123:0/651311729 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558f10cfcae0 0x558f10d75720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.635+0000 7f61c14cd640 1 -- 172.21.15.123:0/651311729 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f10cfb620 msgr2=0x558f10d7f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:44.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.635+0000 7f61c14cd640 1 --2- 172.21.15.123:0/651311729 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f10cfb620 0x558f10d7f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.635+0000 7f61c14cd640 1 -- 172.21.15.123:0/651311729 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f10cf6d70 con 0x558f10ce2120 2024-09-15T23:16:44.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.635+0000 7f61c14cd640 1 --2- 172.21.15.123:0/651311729 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558f10ce2120 0x558f10d06fd0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f61ac001d10 tx=0x7f61ac079b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87eaf5bd05ad1698 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:44.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.635+0000 7f6197fff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:16:44.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.635+0000 7f6197fff640 1 -- 172.21.15.123:0/651311729 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ac082620 con 0x558f10ce2120 2024-09-15T23:16:44.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.635+0000 7f6197fff640 1 -- 172.21.15.123:0/651311729 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 5709+0+0 (secure 0 0 0) 0x7f61ac00a4a0 con 0x558f10ce2120 2024-09-15T23:16:44.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.635+0000 7f61c64cb740 1 -- 172.21.15.123:0/651311729 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61b401b070 con 0x558f10ce2120 2024-09-15T23:16:44.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.636+0000 7f6197fff640 1 -- 172.21.15.123:0/651311729 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f61ac077d40 con 0x558f10ce2120 2024-09-15T23:16:44.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.636+0000 7f61c64cb740 10 client.7290 fetch_fsmap learned FSMap version 59 2024-09-15T23:16:44.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.636+0000 7f61c64cb740 1 -- 172.21.15.123:0/651311729 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) -- 0x558f10ce4d40 con 0x558f10ce2120 2024-09-15T23:16:44.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.636+0000 7f6197fff640 1 -- 172.21.15.123:0/651311729 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61b401b070 con 0x558f10ce2120 2024-09-15T23:16:44.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.636+0000 7f6197fff640 1 -- 172.21.15.123:0/651311729 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 59) ==== 3502+0+0 (secure 0 0 0) 0x7f61ac0760b0 con 0x558f10ce2120 2024-09-15T23:16:44.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.636+0000 7f61c64cb740 10 client.7290 fetch_fsmap finished waiting for FSMap version 59 2024-09-15T23:16:44.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.636+0000 7f61c64cb740 10 client.7290 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-15T23:16:44.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.636+0000 7f61c64cb740 20 client.7290 populate_metadata read hostname 'smithi123' 2024-09-15T23:16:44.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.636+0000 7f61c64cb740 1 --2- 172.21.15.123:0/651311729 >> [v2:172.21.15.188:6835/2840550551,v1:172.21.15.188:6837/2840550551] conn(0x558f10cde260 0x558f10cde640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:44.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.636+0000 7f61c64cb740 4 client.7290 mds_command: new command op to 7149 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:16:44.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.636+0000 7f61c64cb740 1 -- 172.21.15.123:0/651311729 --> [v2:172.21.15.188:6835/2840550551,v1:172.21.15.188:6837/2840550551] -- command(tid 0: {"prefix": "status"}) -- 0x558f10c21fa0 con 0x558f10cde260 2024-09-15T23:16:44.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.636+0000 7f61c0ccc640 1 --2- 172.21.15.123:0/651311729 >> [v2:172.21.15.188:6835/2840550551,v1:172.21.15.188:6837/2840550551] conn(0x558f10cde260 0x558f10cde640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:44.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.636+0000 7f6197fff640 10 client.7290 ms_handle_connect on v2:172.21.15.188:6835/2840550551 2024-09-15T23:16:44.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.636+0000 7f61c0ccc640 1 --2- 172.21.15.123:0/651311729 >> [v2:172.21.15.188:6835/2840550551,v1:172.21.15.188:6837/2840550551] conn(0x558f10cde260 0x558f10cde640 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3e6fe0ab4c8dc80 server_cookie=7446294a036a8ce7 in_seq=0 out_seq=0 2024-09-15T23:16:44.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.637+0000 7f6197fff640 1 -- 172.21.15.123:0/651311729 <== mds.0 v2:172.21.15.188:6835/2840550551 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x558f10c21fa0 con 0x558f10cde260 2024-09-15T23:16:44.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.637+0000 7f6197fff640 10 client.7290 handle_command_reply: tid=0 2024-09-15T23:16:44.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.637+0000 7f61c64cb740 1 client.7290 shutdown 2024-09-15T23:16:44.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.637+0000 7f61c64cb740 1 -- 172.21.15.123:0/651311729 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558f10ce2120 msgr2=0x558f10d06fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:44.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.637+0000 7f61c64cb740 1 --2- 172.21.15.123:0/651311729 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558f10ce2120 0x558f10d06fd0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f61ac001d10 tx=0x7f61ac079b00 comp rx=0 tx=0).stop 2024-09-15T23:16:44.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.637+0000 7f61c64cb740 1 -- 172.21.15.123:0/651311729 shutdown_connections 2024-09-15T23:16:44.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.637+0000 7f61c64cb740 1 --2- 172.21.15.123:0/651311729 >> [v2:172.21.15.188:6835/2840550551,v1:172.21.15.188:6837/2840550551] conn(0x558f10cde260 0x558f10cde640 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.637+0000 7f61c64cb740 1 --2- 172.21.15.123:0/651311729 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x558f10cfcae0 0x558f10d75720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.637+0000 7f6197fff640 0 client.7290 ms_handle_reset on v2:172.21.15.188:6835/2840550551 2024-09-15T23:16:44.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.637+0000 7f61c64cb740 1 --2- 172.21.15.123:0/651311729 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x558f10cfb620 0x558f10d7f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.637+0000 7f61c64cb740 1 --2- 172.21.15.123:0/651311729 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x558f10ce2120 0x558f10d06fd0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.637+0000 7f61c64cb740 1 -- 172.21.15.123:0/651311729 >> 172.21.15.123:0/651311729 conn(0x558f10cb5a80 msgr2=0x558f10cfba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:44.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.637+0000 7f61c64cb740 1 -- 172.21.15.123:0/651311729 shutdown_connections 2024-09-15T23:16:44.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.637+0000 7f61c64cb740 1 -- 172.21.15.123:0/651311729 wait complete. 2024-09-15T23:16:44.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.637+0000 7f61c64cb740 20 client.7290 trim_cache size 0 max 16384 2024-09-15T23:16:44.645 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:16:44.645 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "cb968ac4-8d3a-4b17-a673-6177aeaea589", 2024-09-15T23:16:44.645 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2024-09-15T23:16:44.646 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 7149, 2024-09-15T23:16:44.646 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-09-15T23:16:44.646 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-09-15T23:16:44.646 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-09-15T23:16:44.646 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 8.8893841810000005, 2024-09-15T23:16:44.646 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 59, 2024-09-15T23:16:44.646 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 98, 2024-09-15T23:16:44.646 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 98, 2024-09-15T23:16:44.646 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 12.961566885 2024-09-15T23:16:44.646 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:16:44.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.638+0000 7f61c3731640 1 -- 172.21.15.123:0/1564017687 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f61a806c2b0 msgr2=0x7f61a806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:44.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.638+0000 7f61c3731640 1 --2- 172.21.15.123:0/1564017687 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f61a806c2b0 0x7f61a806e770 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f61b0009a20 tx=0x7f61b0008040 comp rx=0 tx=0).stop 2024-09-15T23:16:44.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.638+0000 7f61c3731640 1 -- 172.21.15.123:0/1564017687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61a4003ad0 msgr2=0x7f61bc145ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:44.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.638+0000 7f61c3731640 1 --2- 172.21.15.123:0/1564017687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61a4003ad0 0x7f61bc145ed0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f61ac00a830 tx=0x7f61bc0714c0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.638+0000 7f61c3731640 1 -- 172.21.15.123:0/1564017687 shutdown_connections 2024-09-15T23:16:44.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.638+0000 7f61c3731640 1 --2- 172.21.15.123:0/1564017687 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f61bc1560e0 0x7f61bc156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.638+0000 7f61c3731640 1 --2- 172.21.15.123:0/1564017687 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f61bc1f3a60 0x7f61bc1f3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.638+0000 7f61c3731640 1 --2- 172.21.15.123:0/1564017687 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f61a806c2b0 0x7f61a806e770 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.638+0000 7f61c3731640 1 --2- 172.21.15.123:0/1564017687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61a4003ad0 0x7f61bc145ed0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.638+0000 7f61c3731640 1 -- 172.21.15.123:0/1564017687 >> 172.21.15.123:0/1564017687 conn(0x7f61bc0ccec0 msgr2=0x7f61bc0cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:44.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.638+0000 7f61c3731640 1 -- 172.21.15.123:0/1564017687 shutdown_connections 2024-09-15T23:16:44.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.638+0000 7f61c3731640 1 -- 172.21.15.123:0/1564017687 wait complete. 2024-09-15T23:16:44.650 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:16:44.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.747+0000 7fe391e77640 1 Processor -- start 2024-09-15T23:16:44.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.747+0000 7fe391e77640 1 -- start start 2024-09-15T23:16:44.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.748+0000 7fe391e77640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe38c06c6a0 0x7fe38c0720b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:44.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.748+0000 7fe391e77640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe38c071010 con 0x7fe38c15af20 2024-09-15T23:16:44.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.748+0000 7fe391e77640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe38c0712f0 con 0x7fe38c15ab40 2024-09-15T23:16:44.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.748+0000 7fe391e77640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fe38c06cb10 con 0x7fe38c06c6a0 2024-09-15T23:16:44.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.748+0000 7fe38bfff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe38c15af20 0x7fe38c15b370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:57272/0 (socket says 172.21.15.123:57272) 2024-09-15T23:16:44.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.748+0000 7fe38bfff640 1 -- 172.21.15.123:0/298684408 learned_addr learned my addr 172.21.15.123:0/298684408 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:44.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.748+0000 7fe38a7fc640 1 -- 172.21.15.123:0/298684408 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1715913609 0 0) 0x7fe38c071010 con 0x7fe38c15af20 2024-09-15T23:16:44.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.748+0000 7fe38affd640 1 --2- 172.21.15.123:0/298684408 >> v2:172.21.15.188:3300/0 conn(0x7fe38c06c6a0 0x7fe38c0720b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:44.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.748+0000 7fe38a7fc640 1 -- 172.21.15.123:0/298684408 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe378004630 con 0x7fe38c15af20 2024-09-15T23:16:44.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.748+0000 7fe38a7fc640 1 -- 172.21.15.123:0/298684408 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3385042461 0 0) 0x7fe378004630 con 0x7fe38c15af20 2024-09-15T23:16:44.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.748+0000 7fe38a7fc640 1 -- 172.21.15.123:0/298684408 >> v2:172.21.15.188:3300/0 conn(0x7fe38c06c6a0 msgr2=0x7fe38c0720b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:44.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.748+0000 7fe38a7fc640 1 --2- 172.21.15.123:0/298684408 >> v2:172.21.15.188:3300/0 conn(0x7fe38c06c6a0 0x7fe38c0720b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.748+0000 7fe38a7fc640 1 -- 172.21.15.123:0/298684408 >> v1:172.21.15.188:6789/0 conn(0x7fe38c15ab40 legacy=0x7fe38c073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:44.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.748+0000 7fe38a7fc640 1 -- 172.21.15.123:0/298684408 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe38c0715d0 con 0x7fe38c15af20 2024-09-15T23:16:44.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.748+0000 7fe38a7fc640 1 -- 172.21.15.123:0/298684408 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fe3840019f0 con 0x7fe38c15af20 2024-09-15T23:16:44.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.748+0000 7fe38a7fc640 1 -- 172.21.15.123:0/298684408 >> v1:172.21.15.123:6789/0 conn(0x7fe38c15af20 legacy=0x7fe38c15b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:44.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.748+0000 7fe38a7fc640 1 --2- 172.21.15.123:0/298684408 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe378004ac0 0x7fe378004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:44.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.748+0000 7fe38a7fc640 1 --2- 172.21.15.123:0/298684408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe378005910 0x7fe378005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:44.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.748+0000 7fe38a7fc640 1 --2- 172.21.15.123:0/298684408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3780063f0 0x7fe37800cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:44.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.748+0000 7fe38a7fc640 1 -- 172.21.15.123:0/298684408 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe37800d290 con 0x7fe3780063f0 2024-09-15T23:16:44.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.748+0000 7fe38a7fc640 1 -- 172.21.15.123:0/298684408 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe37800d440 con 0x7fe378005910 2024-09-15T23:16:44.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.748+0000 7fe38a7fc640 1 -- 172.21.15.123:0/298684408 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe37800d640 con 0x7fe378004ac0 2024-09-15T23:16:44.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.749+0000 7fe38bfff640 1 --2- 172.21.15.123:0/298684408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3780063f0 0x7fe37800cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:44.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.749+0000 7fe38affd640 1 --2- 172.21.15.123:0/298684408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe378005910 0x7fe378005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:44.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.749+0000 7fe38b7fe640 1 --2- 172.21.15.123:0/298684408 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe378004ac0 0x7fe378004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:44.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.749+0000 7fe38bfff640 1 -- 172.21.15.123:0/298684408 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe378004ac0 msgr2=0x7fe378004ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:44.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.749+0000 7fe38bfff640 1 --2- 172.21.15.123:0/298684408 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe378004ac0 0x7fe378004ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.749+0000 7fe38bfff640 1 -- 172.21.15.123:0/298684408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe378005910 msgr2=0x7fe378005d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:44.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.749+0000 7fe38bfff640 1 --2- 172.21.15.123:0/298684408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe378005910 0x7fe378005d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.749+0000 7fe38bfff640 1 -- 172.21.15.123:0/298684408 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe378004630 con 0x7fe3780063f0 2024-09-15T23:16:44.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.749+0000 7fe38bfff640 1 -- 172.21.15.123:0/298684408 reap_dead start 2024-09-15T23:16:44.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.749+0000 7fe38bfff640 1 --2- 172.21.15.123:0/298684408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3780063f0 0x7fe37800cad0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fe38400a810 tx=0x7fe378006940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72674d3dee64cb84 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:44.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.750+0000 7fe38a7fc640 1 -- 172.21.15.123:0/298684408 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38400a460 con 0x7fe3780063f0 2024-09-15T23:16:44.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.750+0000 7fe38a7fc640 1 -- 172.21.15.123:0/298684408 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe38402f070 con 0x7fe3780063f0 2024-09-15T23:16:44.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.750+0000 7fe38a7fc640 1 -- 172.21.15.123:0/298684408 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38402bc90 con 0x7fe3780063f0 2024-09-15T23:16:44.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.750+0000 7fe391e77640 1 -- 172.21.15.123:0/298684408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3780063f0 msgr2=0x7fe37800cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:44.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.750+0000 7fe391e77640 1 --2- 172.21.15.123:0/298684408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3780063f0 0x7fe37800cad0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fe38400a810 tx=0x7fe378006940 comp rx=0 tx=0).stop 2024-09-15T23:16:44.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.750+0000 7fe391e77640 1 -- 172.21.15.123:0/298684408 shutdown_connections 2024-09-15T23:16:44.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.750+0000 7fe391e77640 1 --2- 172.21.15.123:0/298684408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3780063f0 0x7fe37800cad0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.750+0000 7fe391e77640 1 -- 172.21.15.123:0/298684408 >> 172.21.15.123:0/298684408 conn(0x7fe38c0ccec0 msgr2=0x7fe38c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:44.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.750+0000 7fe391e77640 1 -- 172.21.15.123:0/298684408 shutdown_connections 2024-09-15T23:16:44.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.750+0000 7fe391e77640 1 -- 172.21.15.123:0/298684408 wait complete. 2024-09-15T23:16:44.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.751+0000 7fe391e77640 1 Processor -- start 2024-09-15T23:16:44.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.752+0000 7fe391e77640 1 -- start start 2024-09-15T23:16:44.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.752+0000 7fe391e77640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe3780063f0 0x7fe38c0cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:44.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.752+0000 7fe391e77640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe38c0aae70 0x7fe38c1510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:44.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.752+0000 7fe391e77640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe38c0ac5c0 0x7fe38c0aca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:44.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.752+0000 7fe391e77640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe38c072230 con 0x7fe38c0aae70 2024-09-15T23:16:44.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.752+0000 7fe391e77640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe38c0720b0 con 0x7fe3780063f0 2024-09-15T23:16:44.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.752+0000 7fe391e77640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe38c0723b0 con 0x7fe38c0ac5c0 2024-09-15T23:16:44.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.752+0000 7fe38affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe38c0aae70 0x7fe38c1510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:44.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.752+0000 7fe38affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe38c0aae70 0x7fe38c1510d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46726/0 (socket says 172.21.15.123:46726) 2024-09-15T23:16:44.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.752+0000 7fe38affd640 1 -- 172.21.15.123:0/3405624396 learned_addr learned my addr 172.21.15.123:0/3405624396 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:44.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.752+0000 7fe38bfff640 1 --2- 172.21.15.123:0/3405624396 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe38c0ac5c0 0x7fe38c0aca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:44.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.752+0000 7fe38b7fe640 1 --2- 172.21.15.123:0/3405624396 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe3780063f0 0x7fe38c0cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:44.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.753+0000 7fe38affd640 1 -- 172.21.15.123:0/3405624396 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe38c0ac5c0 msgr2=0x7fe38c0aca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:44.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.753+0000 7fe38affd640 1 --2- 172.21.15.123:0/3405624396 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe38c0ac5c0 0x7fe38c0aca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.753+0000 7fe38affd640 1 -- 172.21.15.123:0/3405624396 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe3780063f0 msgr2=0x7fe38c0cb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:44.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.753+0000 7fe38affd640 1 --2- 172.21.15.123:0/3405624396 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe3780063f0 0x7fe38c0cb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.753+0000 7fe38affd640 1 -- 172.21.15.123:0/3405624396 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe38c0ab370 con 0x7fe38c0aae70 2024-09-15T23:16:44.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.753+0000 7fe38affd640 1 --2- 172.21.15.123:0/3405624396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe38c0aae70 0x7fe38c1510d0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fe37400b7c0 tx=0x7fe37400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:44.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.753+0000 7fe383fff640 1 -- 172.21.15.123:0/3405624396 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe374018070 con 0x7fe38c0aae70 2024-09-15T23:16:44.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.753+0000 7fe383fff640 1 -- 172.21.15.123:0/3405624396 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe374010830 con 0x7fe38c0aae70 2024-09-15T23:16:44.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.753+0000 7fe383fff640 1 -- 172.21.15.123:0/3405624396 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe374010c00 con 0x7fe38c0aae70 2024-09-15T23:16:44.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.753+0000 7fe391e77640 1 -- 172.21.15.123:0/3405624396 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe38c0ab650 con 0x7fe38c0aae70 2024-09-15T23:16:44.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.753+0000 7fe391e77640 1 -- 172.21.15.123:0/3405624396 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe38c0abc10 con 0x7fe38c0aae70 2024-09-15T23:16:44.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.754+0000 7fe391e77640 1 -- 172.21.15.123:0/3405624396 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe38c0abe10 con 0x7fe38c0aae70 2024-09-15T23:16:44.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.755+0000 7fe383fff640 1 -- 172.21.15.123:0/3405624396 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe37401b070 con 0x7fe38c0aae70 2024-09-15T23:16:44.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.755+0000 7fe383fff640 1 --2- 172.21.15.123:0/3405624396 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe36c06c2b0 0x7fe36c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:44.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.755+0000 7fe383fff640 1 -- 172.21.15.123:0/3405624396 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5709+0+0 (secure 0 0 0) 0x7fe37408b760 con 0x7fe38c0aae70 2024-09-15T23:16:44.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.755+0000 7fe38b7fe640 1 --2- 172.21.15.123:0/3405624396 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe36c06c2b0 0x7fe36c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:44.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.756+0000 7fe38b7fe640 1 --2- 172.21.15.123:0/3405624396 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe36c06c2b0 0x7fe36c06e770 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe37c000c00 tx=0x7fe37c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:44.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.759+0000 7fe383fff640 1 -- 172.21.15.123:0/3405624396 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe374059910 con 0x7fe38c0aae70 2024-09-15T23:16:44.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.961+0000 7fe391e77640 1 -- 172.21.15.123:0/3405624396 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe38c073990 con 0x7fe38c0aae70 2024-09-15T23:16:44.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.962+0000 7fe383fff640 1 -- 172.21.15.123:0/3405624396 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v59) ==== 53+0+73 (secure 0 0 0) 0x7fe37405dc10 con 0x7fe38c0aae70 2024-09-15T23:16:44.964 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:16:44.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.964+0000 7fe391e77640 1 -- 172.21.15.123:0/3405624396 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe36c06c2b0 msgr2=0x7fe36c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:44.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.964+0000 7fe391e77640 1 --2- 172.21.15.123:0/3405624396 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe36c06c2b0 0x7fe36c06e770 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe37c000c00 tx=0x7fe37c009040 comp rx=0 tx=0).stop 2024-09-15T23:16:44.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.964+0000 7fe391e77640 1 -- 172.21.15.123:0/3405624396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe38c0aae70 msgr2=0x7fe38c1510d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:44.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.964+0000 7fe391e77640 1 --2- 172.21.15.123:0/3405624396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe38c0aae70 0x7fe38c1510d0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fe37400b7c0 tx=0x7fe37400bc80 comp rx=0 tx=0).stop 2024-09-15T23:16:44.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.964+0000 7fe391e77640 1 -- 172.21.15.123:0/3405624396 shutdown_connections 2024-09-15T23:16:44.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.964+0000 7fe391e77640 1 --2- 172.21.15.123:0/3405624396 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe38c0ac5c0 0x7fe38c0aca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.964+0000 7fe391e77640 1 --2- 172.21.15.123:0/3405624396 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe36c06c2b0 0x7fe36c06e770 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.964+0000 7fe391e77640 1 --2- 172.21.15.123:0/3405624396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe38c0aae70 0x7fe38c1510d0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.964+0000 7fe391e77640 1 --2- 172.21.15.123:0/3405624396 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe3780063f0 0x7fe38c0cb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:44.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.964+0000 7fe391e77640 1 -- 172.21.15.123:0/3405624396 >> 172.21.15.123:0/3405624396 conn(0x7fe38c0ccec0 msgr2=0x7fe38c15b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:44.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.964+0000 7fe391e77640 1 -- 172.21.15.123:0/3405624396 shutdown_connections 2024-09-15T23:16:44.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:44.964+0000 7fe391e77640 1 -- 172.21.15.123:0/3405624396 wait complete. 2024-09-15T23:16:44.977 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T23:16:44.977 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:16:44.977 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-09-15T23:16:44.977 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T23:16:44.977 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T23:16:44.977 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T23:16:44.977 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T23:16:44.977 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:16:44.977 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:16:44.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:16:44.978 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-09-15T23:16:44.994 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:16:44.994 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:16:44.994 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:16:44.994 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:16:44.995 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-09-15T23:16:44.995 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:16:44.995 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:16:44.995 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-09-15T23:16:44.995 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f0 2024-09-15T23:16:44.995 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:16:44.995 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:16:44.995 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f1 2024-09-15T23:16:44.995 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:16:44.995 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:16:44.995 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:16:44.995 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:16:44.995 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T23:16:44.996 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42535sec preferred_lft 42535sec 2024-09-15T23:16:44.996 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link noprefixroute 2024-09-15T23:16:44.996 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:16:44.996 INFO:teuthology.orchestra.run.smithi123.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:16:44.996 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 46:55:5a:e0:32:4d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:16:44.996 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:16:44.996 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:16:44.996 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::1c6f:d5ff:fe19:ff05/64 scope link 2024-09-15T23:16:44.996 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:16:44.996 INFO:teuthology.orchestra.run.smithi123.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:16:44.996 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 46:55:5a:e0:32:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:16:44.996 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::4455:5aff:fee0:324d/64 scope link 2024-09-15T23:16:44.996 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:16:44.997 INFO:teuthology.orchestra.run.smithi123.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:16:44.997 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether be:c1:f3:63:cb:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:16:44.997 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::bcc1:f3ff:fe63:cb24/64 scope link 2024-09-15T23:16:44.997 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:16:44.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:16:44.997 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:16:45.058 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-09-15T23:16:45.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:16:45.059 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-09-15T23:16:45.116 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-09-15T23:16:45.116 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:16:45.116 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:16:45.116 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:16:45.116 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:16:45.117 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:16:45.117 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:16:45.117 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:16:45.117 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:16:45.117 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:16:45.117 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:16:45.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:16:45.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:16:45.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:16:45.240 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-09-15T23:16:45.256 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T23:16:45.256 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:16:45.257 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:16:45.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:16:45.257 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2024-09-15T23:16:45.322 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:16:45.323 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T23:16:45.380 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:16:45.381 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:16:45.381 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:16:45.436 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T23:16:45.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:16:45.436 DEBUG:teuthology.orchestra.run.smithi123:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:16:45.518 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:16:45.519 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:16:45.519 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:16:45.527 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:16:45.527 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:16:45.527 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:16:45.527 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.188:3300,172.21.15.188:3301" 2024-09-15T23:16:45.527 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T23:16:45.533 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:16:45.533 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:16:45.533 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:16:45.533 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.188:3300,172.21.15.188:3301" 2024-09-15T23:16:45.533 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T23:16:45.533 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:6789,172.21.15.188:6789,172.21.15.188:6790" 2024-09-15T23:16:45.533 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.123:6789,172.21.15.188:6789,172.21.15.188:6790:/ 2024-09-15T23:16:45.533 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=cb968ac4-8d3a-4b17-a673-6177aeaea589" will pass to kernel 2024-09-15T23:16:45.534 INFO:teuthology.orchestra.run.smithi123.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-15T23:16:45.534 INFO:teuthology.orchestra.run.smithi123.stdout: You just mounted a file system that supports labels which does not 2024-09-15T23:16:45.534 INFO:teuthology.orchestra.run.smithi123.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T23:16:45.534 INFO:teuthology.orchestra.run.smithi123.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T23:16:45.534 INFO:teuthology.orchestra.run.smithi123.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T23:16:45.535 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T23:16:45.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:16:45.536 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:16:45.601 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T23:16:45.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:16:45.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:16:45.702 INFO:teuthology.orchestra.run.smithi123.stdout:client7299 2024-09-15T23:16:45.702 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:16:45.702 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:16:45.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:16:45.718 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2024-09-15T23:16:45.779 DEBUG:teuthology.orchestra.run.smithi123:> stdin-killer -- python3 -c ' 2024-09-15T23:16:45.779 DEBUG:teuthology.orchestra.run.smithi123:> import os 2024-09-15T23:16:45.779 DEBUG:teuthology.orchestra.run.smithi123:> import stat 2024-09-15T23:16:45.779 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-15T23:16:45.780 DEBUG:teuthology.orchestra.run.smithi123:> print(os.stat("/home/ubuntu/cephtest/mnt.0/testdir").st_ino) 2024-09-15T23:16:45.780 DEBUG:teuthology.orchestra.run.smithi123:> ' 2024-09-15T23:16:45.883 INFO:teuthology.orchestra.run.smithi123.stdout:1099511627776 2024-09-15T23:16:45.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:16:45.891 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:16:46.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.027+0000 7f04d0a7b640 1 Processor -- start 2024-09-15T23:16:46.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.027+0000 7f04d0a7b640 1 -- start start 2024-09-15T23:16:46.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.028+0000 7f04d0a7b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f04cc145ed0 0x7f04cc0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:46.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.028+0000 7f04d0a7b640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04cc0b4020 con 0x7f04cc073180 2024-09-15T23:16:46.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.028+0000 7f04d0a7b640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04cc0b42c0 con 0x7f04cc0b5f90 2024-09-15T23:16:46.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.028+0000 7f04d0a7b640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f04cc0b63d0 con 0x7f04cc145ed0 2024-09-15T23:16:46.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.028+0000 7f04c1d9b640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f04cc073180 0x7f04cc0b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:57284/0 (socket says 172.21.15.123:57284) 2024-09-15T23:16:46.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.028+0000 7f04c1d9b640 1 -- 172.21.15.123:0/4055672486 learned_addr learned my addr 172.21.15.123:0/4055672486 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:46.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.028+0000 7f04ca59c640 1 --2- 172.21.15.123:0/4055672486 >> v2:172.21.15.188:3300/0 conn(0x7f04cc145ed0 0x7f04cc0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:46.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.028+0000 7f04c9d9b640 1 -- 172.21.15.123:0/4055672486 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3674556366 0 0) 0x7f04cc0b4020 con 0x7f04cc073180 2024-09-15T23:16:46.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.028+0000 7f04c9d9b640 1 -- 172.21.15.123:0/4055672486 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04b8003520 con 0x7f04cc073180 2024-09-15T23:16:46.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.028+0000 7f04c9d9b640 1 -- 172.21.15.123:0/4055672486 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2903213788 0 0) 0x7f04b8003520 con 0x7f04cc073180 2024-09-15T23:16:46.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.028+0000 7f04c9d9b640 1 -- 172.21.15.123:0/4055672486 >> v2:172.21.15.188:3300/0 conn(0x7f04cc145ed0 msgr2=0x7f04cc0b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:46.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.028+0000 7f04c9d9b640 1 --2- 172.21.15.123:0/4055672486 >> v2:172.21.15.188:3300/0 conn(0x7f04cc145ed0 0x7f04cc0b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:46.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.028+0000 7f04c9d9b640 1 -- 172.21.15.123:0/4055672486 >> v1:172.21.15.188:6789/0 conn(0x7f04cc0b5f90 legacy=0x7f04cc15cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:46.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.028+0000 7f04c9d9b640 1 -- 172.21.15.123:0/4055672486 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04cc0b45a0 con 0x7f04cc073180 2024-09-15T23:16:46.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.028+0000 7f04c9d9b640 1 -- 172.21.15.123:0/4055672486 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f04b4001690 con 0x7f04cc073180 2024-09-15T23:16:46.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.028+0000 7f04c9d9b640 1 -- 172.21.15.123:0/4055672486 >> v1:172.21.15.123:6789/0 conn(0x7f04cc073180 legacy=0x7f04cc0b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:46.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.028+0000 7f04c9d9b640 1 --2- 172.21.15.123:0/4055672486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04b80039b0 0x7f04b8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:46.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.028+0000 7f04c9d9b640 1 --2- 172.21.15.123:0/4055672486 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04b80043b0 0x7f04b8004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:46.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.028+0000 7f04c9d9b640 1 --2- 172.21.15.123:0/4055672486 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04b8005080 0x7f04b800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:46.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.028+0000 7f04c9d9b640 1 -- 172.21.15.123:0/4055672486 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f04cc0b63d0 con 0x7f04b80039b0 2024-09-15T23:16:46.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.028+0000 7f04c9d9b640 1 -- 172.21.15.123:0/4055672486 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f04b800bfe0 con 0x7f04b8005080 2024-09-15T23:16:46.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.028+0000 7f04c9d9b640 1 -- 172.21.15.123:0/4055672486 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f04b800c1e0 con 0x7f04b80043b0 2024-09-15T23:16:46.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.028+0000 7f04ca59c640 1 --2- 172.21.15.123:0/4055672486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04b80039b0 0x7f04b8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:46.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.028+0000 7f04c1d9b640 1 --2- 172.21.15.123:0/4055672486 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04b80043b0 0x7f04b8004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:46.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.029+0000 7f04cad9d640 1 --2- 172.21.15.123:0/4055672486 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04b8005080 0x7f04b800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:46.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.029+0000 7f04ca59c640 1 -- 172.21.15.123:0/4055672486 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04b80043b0 msgr2=0x7f04b8004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:46.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.029+0000 7f04ca59c640 1 --2- 172.21.15.123:0/4055672486 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04b80043b0 0x7f04b8004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:46.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.029+0000 7f04ca59c640 1 -- 172.21.15.123:0/4055672486 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04b8005080 msgr2=0x7f04b800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:46.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.029+0000 7f04ca59c640 1 --2- 172.21.15.123:0/4055672486 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04b8005080 0x7f04b800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:46.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.029+0000 7f04ca59c640 1 -- 172.21.15.123:0/4055672486 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04b8003520 con 0x7f04b80039b0 2024-09-15T23:16:46.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.029+0000 7f04cad9d640 1 -- 172.21.15.123:0/4055672486 reap_dead start 2024-09-15T23:16:46.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.029+0000 7f04ca59c640 1 --2- 172.21.15.123:0/4055672486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04b80039b0 0x7f04b8003d90 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f04bc009ac0 tx=0x7f04b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c5c506c8fd775aa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:46.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.029+0000 7f04c9d9b640 1 -- 172.21.15.123:0/4055672486 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc036070 con 0x7f04b80039b0 2024-09-15T23:16:46.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.029+0000 7f04c9d9b640 1 -- 172.21.15.123:0/4055672486 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04bc031400 con 0x7f04b80039b0 2024-09-15T23:16:46.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.029+0000 7f04c9d9b640 1 -- 172.21.15.123:0/4055672486 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04bc009690 con 0x7f04b80039b0 2024-09-15T23:16:46.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.030+0000 7f04d0a7b640 1 -- 172.21.15.123:0/4055672486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04b80039b0 msgr2=0x7f04b8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:46.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.030+0000 7f04d0a7b640 1 --2- 172.21.15.123:0/4055672486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04b80039b0 0x7f04b8003d90 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f04bc009ac0 tx=0x7f04b8005830 comp rx=0 tx=0).stop 2024-09-15T23:16:46.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.030+0000 7f04d0a7b640 1 -- 172.21.15.123:0/4055672486 shutdown_connections 2024-09-15T23:16:46.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.030+0000 7f04d0a7b640 1 --2- 172.21.15.123:0/4055672486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04b80039b0 0x7f04b8003d90 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:46.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.030+0000 7f04d0a7b640 1 -- 172.21.15.123:0/4055672486 >> 172.21.15.123:0/4055672486 conn(0x7f04cc0ccec0 msgr2=0x7f04cc0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:46.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.030+0000 7f04d0a7b640 1 -- 172.21.15.123:0/4055672486 shutdown_connections 2024-09-15T23:16:46.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.030+0000 7f04d0a7b640 1 -- 172.21.15.123:0/4055672486 wait complete. 2024-09-15T23:16:46.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.031+0000 7f04d0a7b640 1 Processor -- start 2024-09-15T23:16:46.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.032+0000 7f04d0a7b640 1 -- start start 2024-09-15T23:16:46.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.032+0000 7f04d0a7b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04b80039b0 0x7f04cc1419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:46.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.032+0000 7f04d0a7b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04cc0ae870 0x7f04cc0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:46.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.032+0000 7f04d0a7b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04cc0aecf0 0x7f04cc0cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:46.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.032+0000 7f04d0a7b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f04cc1462b0 con 0x7f04cc0ae870 2024-09-15T23:16:46.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.032+0000 7f04d0a7b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f04cc0b4b60 con 0x7f04cc0aecf0 2024-09-15T23:16:46.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.032+0000 7f04d0a7b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f04cc146430 con 0x7f04b80039b0 2024-09-15T23:16:46.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.032+0000 7f04c1d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04cc0ae870 0x7f04cc0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:46.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.032+0000 7f04c1d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04cc0ae870 0x7f04cc0cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46740/0 (socket says 172.21.15.123:46740) 2024-09-15T23:16:46.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.032+0000 7f04c1d9b640 1 -- 172.21.15.123:0/884497478 learned_addr learned my addr 172.21.15.123:0/884497478 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:46.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.033+0000 7f04c1d9b640 1 -- 172.21.15.123:0/884497478 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04b80039b0 msgr2=0x7f04cc1419d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:46.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.033+0000 7f04c1d9b640 1 --2- 172.21.15.123:0/884497478 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04b80039b0 0x7f04cc1419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:46.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.033+0000 7f04c1d9b640 1 -- 172.21.15.123:0/884497478 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04cc0aecf0 msgr2=0x7f04cc0cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:46.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.033+0000 7f04c1d9b640 1 --2- 172.21.15.123:0/884497478 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04cc0aecf0 0x7f04cc0cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:46.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.033+0000 7f04c1d9b640 1 -- 172.21.15.123:0/884497478 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04cc1f54c0 con 0x7f04cc0ae870 2024-09-15T23:16:46.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.033+0000 7f04c1d9b640 1 --2- 172.21.15.123:0/884497478 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04cc0ae870 0x7f04cc0cb6f0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f04b400e780 tx=0x7f04b400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:46.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.033+0000 7f04c37fe640 1 -- 172.21.15.123:0/884497478 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b400c850 con 0x7f04cc0ae870 2024-09-15T23:16:46.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.033+0000 7f04c37fe640 1 -- 172.21.15.123:0/884497478 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04b4018070 con 0x7f04cc0ae870 2024-09-15T23:16:46.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.033+0000 7f04d0a7b640 1 -- 172.21.15.123:0/884497478 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04cc0ca930 con 0x7f04cc0ae870 2024-09-15T23:16:46.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.033+0000 7f04c37fe640 1 -- 172.21.15.123:0/884497478 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b400cc10 con 0x7f04cc0ae870 2024-09-15T23:16:46.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.033+0000 7f04d0a7b640 1 -- 172.21.15.123:0/884497478 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04cc0caef0 con 0x7f04cc0ae870 2024-09-15T23:16:46.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.034+0000 7f04d0a7b640 1 -- 172.21.15.123:0/884497478 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04cc0b5080 con 0x7f04cc0ae870 2024-09-15T23:16:46.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.034+0000 7f04c37fe640 1 -- 172.21.15.123:0/884497478 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f04b401d460 con 0x7f04cc0ae870 2024-09-15T23:16:46.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.035+0000 7f04c37fe640 1 --2- 172.21.15.123:0/884497478 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f04ac06c2b0 0x7f04ac06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:46.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.035+0000 7f04c37fe640 1 -- 172.21.15.123:0/884497478 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5709+0+0 (secure 0 0 0) 0x7f04b408b260 con 0x7f04cc0ae870 2024-09-15T23:16:46.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.035+0000 7f04ca59c640 1 --2- 172.21.15.123:0/884497478 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f04ac06c2b0 0x7f04ac06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:46.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.036+0000 7f04ca59c640 1 --2- 172.21.15.123:0/884497478 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f04ac06c2b0 0x7f04ac06e770 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f04bc033000 tx=0x7f04bc02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:46.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.039+0000 7f04c37fe640 1 -- 172.21.15.123:0/884497478 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f04b4059a60 con 0x7f04cc0ae870 2024-09-15T23:16:46.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.235+0000 7f04d0a7b640 1 -- 172.21.15.123:0/884497478 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f04cc0b2f90 con 0x7f04cc0ae870 2024-09-15T23:16:46.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.236+0000 7f04c37fe640 1 -- 172.21.15.123:0/884497478 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+5234 (secure 0 0 0) 0x7f04b4059360 con 0x7f04cc0ae870 2024-09-15T23:16:46.238 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:16:46.238 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":59,"btime":"2024-09-15T23:16:37:768064+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7131,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/3875308284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3875308284},{"type":"v1","addr":"172.21.15.123:6834","nonce":3875308284}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":7134,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/799549293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":799549293},{"type":"v1","addr":"172.21.15.123:6835","nonce":799549293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":7146,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2244093297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2244093297},{"type":"v1","addr":"172.21.15.188:6836","nonce":2244093297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:16:35.080780+0000","modified":"2024-09-15T23:16:37.091111+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7149},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7149":{"gid":7149,"name":"b","rank":0,"incarnation":57,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6837/2840550551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2840550551},{"type":"v1","addr":"172.21.15.188:6837","nonce":2840550551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7149,"qdb_cluster":[7149]},"id":6}]} 2024-09-15T23:16:46.239 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 59 2024-09-15T23:16:46.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.238+0000 7f04d0a7b640 1 -- 172.21.15.123:0/884497478 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f04ac06c2b0 msgr2=0x7f04ac06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:46.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.238+0000 7f04d0a7b640 1 --2- 172.21.15.123:0/884497478 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f04ac06c2b0 0x7f04ac06e770 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f04bc033000 tx=0x7f04bc02e000 comp rx=0 tx=0).stop 2024-09-15T23:16:46.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.238+0000 7f04d0a7b640 1 -- 172.21.15.123:0/884497478 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04cc0ae870 msgr2=0x7f04cc0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:46.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.238+0000 7f04d0a7b640 1 --2- 172.21.15.123:0/884497478 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04cc0ae870 0x7f04cc0cb6f0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f04b400e780 tx=0x7f04b400ec40 comp rx=0 tx=0).stop 2024-09-15T23:16:46.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.238+0000 7f04d0a7b640 1 -- 172.21.15.123:0/884497478 shutdown_connections 2024-09-15T23:16:46.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.238+0000 7f04d0a7b640 1 --2- 172.21.15.123:0/884497478 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04cc0aecf0 0x7f04cc0cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:46.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.238+0000 7f04d0a7b640 1 --2- 172.21.15.123:0/884497478 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f04ac06c2b0 0x7f04ac06e770 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:46.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.238+0000 7f04d0a7b640 1 --2- 172.21.15.123:0/884497478 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04cc0ae870 0x7f04cc0cb6f0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:46.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.238+0000 7f04d0a7b640 1 --2- 172.21.15.123:0/884497478 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04b80039b0 0x7f04cc1419d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:46.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.238+0000 7f04d0a7b640 1 -- 172.21.15.123:0/884497478 >> 172.21.15.123:0/884497478 conn(0x7f04cc0ccec0 msgr2=0x7f04cc1421e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:46.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.238+0000 7f04d0a7b640 1 -- 172.21.15.123:0/884497478 shutdown_connections 2024-09-15T23:16:46.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.238+0000 7f04d0a7b640 1 -- 172.21.15.123:0/884497478 wait complete. 2024-09-15T23:16:46.252 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dump inode 1099511627776 2024-09-15T23:16:46.376 INFO:teuthology.orchestra.run.smithi188.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-15T23:16:45.773879+0000","btime":"2024-09-15T23:16:45.773879+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-15T23:16:45.773879+0000","atime":"2024-09-15T23:16:45.773879+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"version":2,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"excl","type":"iauth","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","type":"ifile","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{"gather_set":[],"state":"excl","type":"ixattr","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":7299,"pending":"pAsxLsXsxFsx","issued":"pAsxLsXsxFsx","wanted":"-","last_sent":1}],"loner":7299,"want_loner":7299,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-15T23:16:46.376 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-15T23:16:45.773879+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "iauth", "xlock_by": {} }, "backtrace_version": 2, "btime": "2024-09-15T23:16:45.773879+0000", "change_attr": 0, "client_caps": [ { "client_id": 7299, "issued": "pAsxLsXsxFsx", "last_sent": 1, "pending": "pAsxLsXsxFsx", "wanted": "-" } ], "client_ranges": [], "ctime": "2024-09-15T23:16:45.773879+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ifile", "xlock_by": {} }, "flocklock": {}, "gid": 1333, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 7299, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-15T23:16:45.773879+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "request": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": 7299, "xattr_version": 1, "xattrlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ixattr", "xlock_by": {} }, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-15T23:16:46.377 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:16:46.377 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:16:46.393 DEBUG:teuthology.orchestra.run.smithi123:> stdin-killer -- python3 -c ' 2024-09-15T23:16:46.393 DEBUG:teuthology.orchestra.run.smithi123:> import os 2024-09-15T23:16:46.393 DEBUG:teuthology.orchestra.run.smithi123:> import uuid 2024-09-15T23:16:46.393 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-15T23:16:46.394 DEBUG:teuthology.orchestra.run.smithi123:> n = 21 2024-09-15T23:16:46.394 DEBUG:teuthology.orchestra.run.smithi123:> create_hard_links = False 2024-09-15T23:16:46.394 DEBUG:teuthology.orchestra.run.smithi123:> if 0 > 0: 2024-09-15T23:16:46.394 DEBUG:teuthology.orchestra.run.smithi123:> create_hard_links = True 2024-09-15T23:16:46.394 DEBUG:teuthology.orchestra.run.smithi123:> path = "/home/ubuntu/cephtest/mnt.0/testdir/file" 2024-09-15T23:16:46.394 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-15T23:16:46.394 DEBUG:teuthology.orchestra.run.smithi123:> dpath = os.path.dirname(path) 2024-09-15T23:16:46.394 DEBUG:teuthology.orchestra.run.smithi123:> fnameprefix = os.path.basename(path) 2024-09-15T23:16:46.394 DEBUG:teuthology.orchestra.run.smithi123:> os.makedirs(dpath, exist_ok=True) 2024-09-15T23:16:46.394 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-15T23:16:46.394 DEBUG:teuthology.orchestra.run.smithi123:> try: 2024-09-15T23:16:46.394 DEBUG:teuthology.orchestra.run.smithi123:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-15T23:16:46.394 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-15T23:16:46.394 DEBUG:teuthology.orchestra.run.smithi123:> for i in range(n): 2024-09-15T23:16:46.394 DEBUG:teuthology.orchestra.run.smithi123:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-15T23:16:46.394 DEBUG:teuthology.orchestra.run.smithi123:> with open(fpath, '"'"'w'"'"') as f: 2024-09-15T23:16:46.395 DEBUG:teuthology.orchestra.run.smithi123:> f.write(f"{i}") 2024-09-15T23:16:46.395 DEBUG:teuthology.orchestra.run.smithi123:> if False: 2024-09-15T23:16:46.395 DEBUG:teuthology.orchestra.run.smithi123:> f.flush() 2024-09-15T23:16:46.395 DEBUG:teuthology.orchestra.run.smithi123:> os.fsync(f.fileno()) 2024-09-15T23:16:46.395 DEBUG:teuthology.orchestra.run.smithi123:> if False: 2024-09-15T23:16:46.395 DEBUG:teuthology.orchestra.run.smithi123:> os.unlink(fpath) 2024-09-15T23:16:46.395 DEBUG:teuthology.orchestra.run.smithi123:> if False: 2024-09-15T23:16:46.395 DEBUG:teuthology.orchestra.run.smithi123:> os.fsync(dirfd) 2024-09-15T23:16:46.395 DEBUG:teuthology.orchestra.run.smithi123:> if create_hard_links: 2024-09-15T23:16:46.395 DEBUG:teuthology.orchestra.run.smithi123:> for j in range(0): 2024-09-15T23:16:46.395 DEBUG:teuthology.orchestra.run.smithi123:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-15T23:16:46.395 DEBUG:teuthology.orchestra.run.smithi123:> if False: 2024-09-15T23:16:46.395 DEBUG:teuthology.orchestra.run.smithi123:> os.fsync(dirfd) 2024-09-15T23:16:46.395 DEBUG:teuthology.orchestra.run.smithi123:> finally: 2024-09-15T23:16:46.395 DEBUG:teuthology.orchestra.run.smithi123:> os.close(dirfd) 2024-09-15T23:16:46.395 DEBUG:teuthology.orchestra.run.smithi123:> ' 2024-09-15T23:16:46.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:16:46.533 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:16:46.533 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:16:46.589 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:16:46.589 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:16:46.646 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:16:46.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.783+0000 7fefc4e77640 1 Processor -- start 2024-09-15T23:16:46.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.783+0000 7fefc4e77640 1 -- start start 2024-09-15T23:16:46.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.784+0000 7fefc4e77640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fefc015c4b0 0x7fefc00b6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:46.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.784+0000 7fefc4e77640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefc0067b50 con 0x7fefc00b02b0 2024-09-15T23:16:46.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.784+0000 7fefc4e77640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefc0160f40 con 0x7fefc00d08e0 2024-09-15T23:16:46.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.784+0000 7fefc4e77640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fefc00ce860 con 0x7fefc015c4b0 2024-09-15T23:16:46.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.784+0000 7fefbe59c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fefc015c4b0 0x7fefc00b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:46.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.784+0000 7fefbe59c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fefc015c4b0 0x7fefc00b6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47578/0 (socket says 172.21.15.123:47578) 2024-09-15T23:16:46.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.784+0000 7fefbe59c640 1 -- 172.21.15.123:0/4159431362 learned_addr learned my addr 172.21.15.123:0/4159431362 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:46.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.784+0000 7fefbdd9b640 1 --1- 172.21.15.123:0/4159431362 >> v1:172.21.15.123:6789/0 conn(0x7fefc00b02b0 0x7fefc0160120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51508/0 (socket says 172.21.15.123:51508) 2024-09-15T23:16:46.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.785+0000 7fefbe59c640 1 -- 172.21.15.123:0/4159431362 >> v1:172.21.15.188:6789/0 conn(0x7fefc00d08e0 legacy=0x7fefc0160830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:46.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.785+0000 7fefbe59c640 1 -- 172.21.15.123:0/4159431362 >> v1:172.21.15.123:6789/0 conn(0x7fefc00b02b0 legacy=0x7fefc0160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:46.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.785+0000 7fefbd59a640 1 -- 172.21.15.123:0/4159431362 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2740198799 0 0) 0x7fefb4001110 con 0x7fefc00b02b0 2024-09-15T23:16:46.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.785+0000 7fefbe59c640 1 -- 172.21.15.123:0/4159431362 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefc0070130 con 0x7fefc015c4b0 2024-09-15T23:16:46.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.785+0000 7fefbe59c640 1 --2- 172.21.15.123:0/4159431362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefc015c4b0 0x7fefc00b6120 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fefb0009e50 tx=0x7fefb002a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c6de9aeb65adadf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:46.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.786+0000 7fefbd59a640 1 -- 172.21.15.123:0/4159431362 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb0036070 con 0x7fefc015c4b0 2024-09-15T23:16:46.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.786+0000 7fefbd59a640 1 -- 172.21.15.123:0/4159431362 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb0031600 con 0x7fefc015c4b0 2024-09-15T23:16:46.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.786+0000 7fefbd59a640 1 -- 172.21.15.123:0/4159431362 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb00319d0 con 0x7fefc015c4b0 2024-09-15T23:16:46.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.786+0000 7fefc4e77640 1 -- 172.21.15.123:0/4159431362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefc015c4b0 msgr2=0x7fefc00b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:46.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.786+0000 7fefc4e77640 1 --2- 172.21.15.123:0/4159431362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefc015c4b0 0x7fefc00b6120 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fefb0009e50 tx=0x7fefb002a760 comp rx=0 tx=0).stop 2024-09-15T23:16:46.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.786+0000 7fefc4e77640 1 -- 172.21.15.123:0/4159431362 shutdown_connections 2024-09-15T23:16:46.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.786+0000 7fefc4e77640 1 --2- 172.21.15.123:0/4159431362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefc015c4b0 0x7fefc00b6120 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:46.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.786+0000 7fefc4e77640 1 -- 172.21.15.123:0/4159431362 >> 172.21.15.123:0/4159431362 conn(0x7fefc00b0a80 msgr2=0x7fefc00b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:46.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.786+0000 7fefc4e77640 1 -- 172.21.15.123:0/4159431362 shutdown_connections 2024-09-15T23:16:46.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.786+0000 7fefc4e77640 1 -- 172.21.15.123:0/4159431362 wait complete. 2024-09-15T23:16:46.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.788+0000 7fefc4e77640 1 Processor -- start 2024-09-15T23:16:46.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.788+0000 7fefc4e77640 1 -- start start 2024-09-15T23:16:46.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.788+0000 7fefc4e77640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefc00b02b0 0x7fefc014a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:46.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.788+0000 7fefc4e77640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fefc00d08e0 0x7fefc014dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:46.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.788+0000 7fefc4e77640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fefc015c4b0 0x7fefc015b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:46.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.788+0000 7fefc4e77640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fefc00ce580 con 0x7fefc00b02b0 2024-09-15T23:16:46.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.788+0000 7fefc4e77640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fefc00ce2a0 con 0x7fefc00d08e0 2024-09-15T23:16:46.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.788+0000 7fefc4e77640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fefc006dcc0 con 0x7fefc015c4b0 2024-09-15T23:16:46.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.788+0000 7fefbe59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefc00b02b0 0x7fefc014a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:46.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.788+0000 7fefbe59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefc00b02b0 0x7fefc014a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47580/0 (socket says 172.21.15.123:47580) 2024-09-15T23:16:46.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.788+0000 7fefbe59c640 1 -- 172.21.15.123:0/2931040358 learned_addr learned my addr 172.21.15.123:0/2931040358 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:46.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.789+0000 7fefbdd9b640 1 --2- 172.21.15.123:0/2931040358 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fefc00d08e0 0x7fefc014dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:46.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.789+0000 7fefbed9d640 1 --2- 172.21.15.123:0/2931040358 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fefc015c4b0 0x7fefc015b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:46.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.789+0000 7fefbe59c640 1 -- 172.21.15.123:0/2931040358 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fefc015c4b0 msgr2=0x7fefc015b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:46.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.789+0000 7fefbe59c640 1 --2- 172.21.15.123:0/2931040358 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fefc015c4b0 0x7fefc015b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:46.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.789+0000 7fefbe59c640 1 -- 172.21.15.123:0/2931040358 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fefc00d08e0 msgr2=0x7fefc014dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:46.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.789+0000 7fefbe59c640 1 --2- 172.21.15.123:0/2931040358 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fefc00d08e0 0x7fefc014dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:46.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.789+0000 7fefbe59c640 1 -- 172.21.15.123:0/2931040358 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefc015a2e0 con 0x7fefc00b02b0 2024-09-15T23:16:46.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.789+0000 7fefbdd9b640 1 --2- 172.21.15.123:0/2931040358 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fefc00d08e0 0x7fefc014dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:16:46.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.789+0000 7fefbed9d640 1 --2- 172.21.15.123:0/2931040358 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fefc015c4b0 0x7fefc015b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:16:46.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.789+0000 7fefbe59c640 1 --2- 172.21.15.123:0/2931040358 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefc00b02b0 0x7fefc014a290 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fefb0034040 tx=0x7fefb0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:46.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.789+0000 7fefaeffd640 1 -- 172.21.15.123:0/2931040358 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb0041030 con 0x7fefc00b02b0 2024-09-15T23:16:46.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.789+0000 7fefaeffd640 1 -- 172.21.15.123:0/2931040358 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefb0031400 con 0x7fefc00b02b0 2024-09-15T23:16:46.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.789+0000 7fefc4e77640 1 -- 172.21.15.123:0/2931040358 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefc015a5c0 con 0x7fefc00b02b0 2024-09-15T23:16:46.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.789+0000 7fefaeffd640 1 -- 172.21.15.123:0/2931040358 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb0036040 con 0x7fefc00b02b0 2024-09-15T23:16:46.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.789+0000 7fefc4e77640 1 -- 172.21.15.123:0/2931040358 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefc015ab80 con 0x7fefc00b02b0 2024-09-15T23:16:46.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.790+0000 7fefc4e77640 1 -- 172.21.15.123:0/2931040358 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefc015c890 con 0x7fefc00b02b0 2024-09-15T23:16:46.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.791+0000 7fefaeffd640 1 -- 172.21.15.123:0/2931040358 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fefb0044070 con 0x7fefc00b02b0 2024-09-15T23:16:46.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.791+0000 7fefaeffd640 1 --2- 172.21.15.123:0/2931040358 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fefa006c2b0 0x7fefa006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:46.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.791+0000 7fefaeffd640 1 -- 172.21.15.123:0/2931040358 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5709+0+0 (secure 0 0 0) 0x7fefb00abdd0 con 0x7fefc00b02b0 2024-09-15T23:16:46.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.791+0000 7fefbdd9b640 1 --2- 172.21.15.123:0/2931040358 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fefa006c2b0 0x7fefa006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:46.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.792+0000 7fefbdd9b640 1 --2- 172.21.15.123:0/2931040358 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fefa006c2b0 0x7fefa006e770 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fefb40013b0 tx=0x7fefb4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:46.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.795+0000 7fefaeffd640 1 -- 172.21.15.123:0/2931040358 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fefb004b070 con 0x7fefc00b02b0 2024-09-15T23:16:46.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.972+0000 7fefc4e77640 1 -- 172.21.15.123:0/2931040358 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fefc01528d0 con 0x7fefc00b02b0 2024-09-15T23:16:46.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.972+0000 7fefaeffd640 1 -- 172.21.15.123:0/2931040358 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v98) ==== 80+0+0 (secure 0 0 0) 0x7fefb007a540 con 0x7fefc00b02b0 2024-09-15T23:16:46.974 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-15T23:16:46.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.974+0000 7fefc4e77640 1 -- 172.21.15.123:0/2931040358 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fefa006c2b0 msgr2=0x7fefa006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:46.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.974+0000 7fefc4e77640 1 --2- 172.21.15.123:0/2931040358 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fefa006c2b0 0x7fefa006e770 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fefb40013b0 tx=0x7fefb4009040 comp rx=0 tx=0).stop 2024-09-15T23:16:46.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.974+0000 7fefc4e77640 1 -- 172.21.15.123:0/2931040358 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefc00b02b0 msgr2=0x7fefc014a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:46.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.974+0000 7fefc4e77640 1 --2- 172.21.15.123:0/2931040358 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefc00b02b0 0x7fefc014a290 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fefb0034040 tx=0x7fefb0004a40 comp rx=0 tx=0).stop 2024-09-15T23:16:46.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.974+0000 7fefc4e77640 1 -- 172.21.15.123:0/2931040358 shutdown_connections 2024-09-15T23:16:46.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.974+0000 7fefc4e77640 1 --2- 172.21.15.123:0/2931040358 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fefc015c4b0 0x7fefc015b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:46.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.974+0000 7fefc4e77640 1 --2- 172.21.15.123:0/2931040358 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fefc00d08e0 0x7fefc014dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:46.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.974+0000 7fefc4e77640 1 --2- 172.21.15.123:0/2931040358 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fefa006c2b0 0x7fefa006e770 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:46.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.974+0000 7fefc4e77640 1 --2- 172.21.15.123:0/2931040358 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fefc00b02b0 0x7fefc014a290 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:46.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.974+0000 7fefc4e77640 1 -- 172.21.15.123:0/2931040358 >> 172.21.15.123:0/2931040358 conn(0x7fefc00b0a80 msgr2=0x7fefc00717a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:46.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.974+0000 7fefc4e77640 1 -- 172.21.15.123:0/2931040358 shutdown_connections 2024-09-15T23:16:46.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:46.974+0000 7fefc4e77640 1 -- 172.21.15.123:0/2931040358 wait complete. 2024-09-15T23:16:46.987 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-15T23:16:46.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:16:46.987 DEBUG:teuthology.orchestra.run.smithi123:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-15T23:16:47.057 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-09-15T23:16:47.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:16:47.058 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T23:16:47.077 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 flush journal 2024-09-15T23:16:47.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.215+0000 7f659a98d640 1 Processor -- start 2024-09-15T23:16:47.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.215+0000 7f659a98d640 1 -- start start 2024-09-15T23:16:47.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.216+0000 7f659a98d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f65940732e0 0x7f65940736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.216+0000 7f659a98d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65940714b0 con 0x7f65940cce30 2024-09-15T23:16:47.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.216+0000 7f659a98d640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6594073c00 con 0x7f65940cd270 2024-09-15T23:16:47.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.216+0000 7f659a98d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f65940cd880 con 0x7f65940732e0 2024-09-15T23:16:47.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.216+0000 7f65937fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f65940cce30 0x7f6594071c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51522/0 (socket says 172.21.15.123:51522) 2024-09-15T23:16:47.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.216+0000 7f65937fe640 1 -- 172.21.15.123:0/258309497 learned_addr learned my addr 172.21.15.123:0/258309497 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:47.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.216+0000 7f6593fff640 1 --2- 172.21.15.123:0/258309497 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f65940732e0 0x7f65940736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.216+0000 7f6592ffd640 1 -- 172.21.15.123:0/258309497 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1351566749 0 0) 0x7f65940714b0 con 0x7f65940cce30 2024-09-15T23:16:47.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.216+0000 7f6592ffd640 1 -- 172.21.15.123:0/258309497 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f657c003520 con 0x7f65940cce30 2024-09-15T23:16:47.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.216+0000 7f6592ffd640 1 -- 172.21.15.123:0/258309497 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 907139908 0 0) 0x7f657c003520 con 0x7f65940cce30 2024-09-15T23:16:47.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.216+0000 7f6592ffd640 1 -- 172.21.15.123:0/258309497 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f65940732e0 msgr2=0x7f65940736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:47.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.216+0000 7f6592ffd640 1 --2- 172.21.15.123:0/258309497 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f65940732e0 0x7f65940736c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.216+0000 7f6592ffd640 1 -- 172.21.15.123:0/258309497 >> v1:172.21.15.188:6789/0 conn(0x7f65940cd270 legacy=0x7f659415c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:47.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.216+0000 7f6592ffd640 1 -- 172.21.15.123:0/258309497 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65940cdb60 con 0x7f65940cce30 2024-09-15T23:16:47.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.216+0000 7f6592ffd640 1 -- 172.21.15.123:0/258309497 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f6588001670 con 0x7f65940cce30 2024-09-15T23:16:47.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.216+0000 7f6592ffd640 1 -- 172.21.15.123:0/258309497 >> v1:172.21.15.123:6789/0 conn(0x7f65940cce30 legacy=0x7f6594071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:47.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.216+0000 7f6592ffd640 1 --2- 172.21.15.123:0/258309497 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f657c0039e0 0x7f657c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.217+0000 7f6592ffd640 1 --2- 172.21.15.123:0/258309497 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f65940732e0 0x7f657c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.217+0000 7f6592ffd640 1 --2- 172.21.15.123:0/258309497 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f657c004d40 0x7f657c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.217+0000 7f6592ffd640 1 -- 172.21.15.123:0/258309497 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f65940cd880 con 0x7f657c004d40 2024-09-15T23:16:47.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.217+0000 7f6592ffd640 1 -- 172.21.15.123:0/258309497 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f657c00ba70 con 0x7f657c0039e0 2024-09-15T23:16:47.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.217+0000 7f6592ffd640 1 -- 172.21.15.123:0/258309497 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f657c00bc70 con 0x7f65940732e0 2024-09-15T23:16:47.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.217+0000 7f6598f2a640 1 --2- 172.21.15.123:0/258309497 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f657c004d40 0x7f657c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.217+0000 7f65937fe640 1 --2- 172.21.15.123:0/258309497 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f65940732e0 0x7f657c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.217+0000 7f6593fff640 1 --2- 172.21.15.123:0/258309497 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f657c0039e0 0x7f657c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.217+0000 7f6598f2a640 1 -- 172.21.15.123:0/258309497 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f65940732e0 msgr2=0x7f657c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:47.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.217+0000 7f6598f2a640 1 --2- 172.21.15.123:0/258309497 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f65940732e0 0x7f657c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.217+0000 7f6598f2a640 1 -- 172.21.15.123:0/258309497 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f657c0039e0 msgr2=0x7f657c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:47.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.217+0000 7f6598f2a640 1 --2- 172.21.15.123:0/258309497 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f657c0039e0 0x7f657c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.217+0000 7f6598f2a640 1 -- 172.21.15.123:0/258309497 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f657c003520 con 0x7f657c004d40 2024-09-15T23:16:47.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.218+0000 7f6598f2a640 1 --2- 172.21.15.123:0/258309497 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f657c004d40 0x7f657c0051c0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f658c002010 tx=0x7f657c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56d240602fb95d0d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:47.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.218+0000 7f6592ffd640 1 -- 172.21.15.123:0/258309497 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658c036070 con 0x7f657c004d40 2024-09-15T23:16:47.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.218+0000 7f6592ffd640 1 -- 172.21.15.123:0/258309497 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f658c031600 con 0x7f657c004d40 2024-09-15T23:16:47.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.218+0000 7f6592ffd640 1 -- 172.21.15.123:0/258309497 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658c001be0 con 0x7f657c004d40 2024-09-15T23:16:47.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.218+0000 7f659a98d640 1 -- 172.21.15.123:0/258309497 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f657c004d40 msgr2=0x7f657c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:47.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.218+0000 7f659a98d640 1 --2- 172.21.15.123:0/258309497 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f657c004d40 0x7f657c0051c0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f658c002010 tx=0x7f657c005830 comp rx=0 tx=0).stop 2024-09-15T23:16:47.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.218+0000 7f6598f2a640 1 -- 172.21.15.123:0/258309497 reap_dead start 2024-09-15T23:16:47.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.218+0000 7f659a98d640 1 -- 172.21.15.123:0/258309497 shutdown_connections 2024-09-15T23:16:47.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.218+0000 7f659a98d640 1 -- 172.21.15.123:0/258309497 >> 172.21.15.123:0/258309497 conn(0x7f659406d0f0 msgr2=0x7f659406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:47.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.218+0000 7f659a98d640 1 -- 172.21.15.123:0/258309497 shutdown_connections 2024-09-15T23:16:47.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.218+0000 7f659a98d640 1 -- 172.21.15.123:0/258309497 wait complete. 2024-09-15T23:16:47.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.219+0000 7f659a98d640 1 Processor -- start 2024-09-15T23:16:47.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.220+0000 7f659a98d640 1 -- start start 2024-09-15T23:16:47.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.220+0000 7f659a98d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f657c004d40 0x7f6594152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.220+0000 7f659a98d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6594153d00 0x7f65941f2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.220+0000 7f659a98d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6594154160 0x7f65941f2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.220+0000 7f659a98d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f659406bf70 con 0x7f657c004d40 2024-09-15T23:16:47.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.220+0000 7f659a98d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f659406bdf0 con 0x7f6594153d00 2024-09-15T23:16:47.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.220+0000 7f659a98d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6594072380 con 0x7f6594154160 2024-09-15T23:16:47.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.220+0000 7f6593fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f657c004d40 0x7f6594152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.220+0000 7f6593fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f657c004d40 0x7f6594152270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47602/0 (socket says 172.21.15.123:47602) 2024-09-15T23:16:47.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.220+0000 7f6593fff640 1 -- 172.21.15.123:0/4093692394 learned_addr learned my addr 172.21.15.123:0/4093692394 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:47.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.221+0000 7f65937fe640 1 --2- 172.21.15.123:0/4093692394 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6594153d00 0x7f65941f2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.221+0000 7f6598f2a640 1 --2- 172.21.15.123:0/4093692394 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6594154160 0x7f65941f2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.221+0000 7f6593fff640 1 -- 172.21.15.123:0/4093692394 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6594154160 msgr2=0x7f65941f2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:47.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.221+0000 7f6593fff640 1 --2- 172.21.15.123:0/4093692394 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6594154160 0x7f65941f2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.221+0000 7f6593fff640 1 -- 172.21.15.123:0/4093692394 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6594153d00 msgr2=0x7f65941f2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:47.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.221+0000 7f6593fff640 1 --2- 172.21.15.123:0/4093692394 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6594153d00 0x7f65941f2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.221+0000 7f6593fff640 1 -- 172.21.15.123:0/4093692394 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65941527b0 con 0x7f657c004d40 2024-09-15T23:16:47.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.221+0000 7f6598f2a640 1 --2- 172.21.15.123:0/4093692394 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6594154160 0x7f65941f2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:16:47.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.221+0000 7f65937fe640 1 --2- 172.21.15.123:0/4093692394 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6594153d00 0x7f65941f2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:16:47.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.221+0000 7f6593fff640 1 --2- 172.21.15.123:0/4093692394 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f657c004d40 0x7f6594152270 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f6584011a00 tx=0x7f6584011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:47.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.221+0000 7f6590ff9640 1 -- 172.21.15.123:0/4093692394 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658400faf0 con 0x7f657c004d40 2024-09-15T23:16:47.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.221+0000 7f6590ff9640 1 -- 172.21.15.123:0/4093692394 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f658400fc90 con 0x7f657c004d40 2024-09-15T23:16:47.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.221+0000 7f659a98d640 1 -- 172.21.15.123:0/4093692394 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65941546c0 con 0x7f657c004d40 2024-09-15T23:16:47.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.221+0000 7f6590ff9640 1 -- 172.21.15.123:0/4093692394 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6584014440 con 0x7f657c004d40 2024-09-15T23:16:47.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.221+0000 7f659a98d640 1 -- 172.21.15.123:0/4093692394 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6594154c80 con 0x7f657c004d40 2024-09-15T23:16:47.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.222+0000 7f6590ff9640 1 -- 172.21.15.123:0/4093692394 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6584012040 con 0x7f657c004d40 2024-09-15T23:16:47.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.223+0000 7f6590ff9640 1 --2- 172.21.15.123:0/4093692394 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f658006c2b0 0x7f658006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.223+0000 7f6590ff9640 1 -- 172.21.15.123:0/4093692394 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5709+0+0 (secure 0 0 0) 0x7f658408bad0 con 0x7f657c004d40 2024-09-15T23:16:47.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.223+0000 7f65937fe640 1 --2- 172.21.15.123:0/4093692394 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f658006c2b0 0x7f658006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.224+0000 7f65937fe640 1 --2- 172.21.15.123:0/4093692394 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f658006c2b0 0x7f658006e770 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f65940b5270 tx=0x7f6588009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:47.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.224+0000 7f659d805740 1 Processor -- start 2024-09-15T23:16:47.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.224+0000 7f659d805740 1 -- start start 2024-09-15T23:16:47.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.224+0000 7f659d805740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5643f2bb3920 0x5643f2bf90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.224+0000 7f659d805740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5643f2bb10e0 0x5643f2bb3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.224+0000 7f659d805740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5643f2bb50b0 0x5643f2bae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.224+0000 7f659d805740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5643f2b166f0 con 0x5643f2bb50b0 2024-09-15T23:16:47.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.224+0000 7f659d805740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5643f2abe330 con 0x5643f2bb10e0 2024-09-15T23:16:47.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.224+0000 7f659d805740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5643f2b126b0 con 0x5643f2bb3920 2024-09-15T23:16:47.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.225+0000 7f6598f2a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5643f2bb50b0 0x5643f2bae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.225+0000 7f6598f2a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5643f2bb50b0 0x5643f2bae1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47606/0 (socket says 172.21.15.123:47606) 2024-09-15T23:16:47.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.225+0000 7f6598f2a640 1 -- 172.21.15.123:0/227428071 learned_addr learned my addr 172.21.15.123:0/227428071 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:47.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.225+0000 7f6593fff640 1 --2- 172.21.15.123:0/227428071 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5643f2bb3920 0x5643f2bf90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.225+0000 7f65937fe640 1 --2- 172.21.15.123:0/227428071 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5643f2bb10e0 0x5643f2bb3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.225+0000 7f6598f2a640 1 -- 172.21.15.123:0/227428071 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5643f2bb3920 msgr2=0x5643f2bf90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:47.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.225+0000 7f6598f2a640 1 --2- 172.21.15.123:0/227428071 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5643f2bb3920 0x5643f2bf90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.225+0000 7f6598f2a640 1 -- 172.21.15.123:0/227428071 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5643f2bb10e0 msgr2=0x5643f2bb3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:47.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.225+0000 7f6598f2a640 1 --2- 172.21.15.123:0/227428071 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5643f2bb10e0 0x5643f2bb3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.225+0000 7f6598f2a640 1 -- 172.21.15.123:0/227428071 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643f2ae40d0 con 0x5643f2bb50b0 2024-09-15T23:16:47.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.225+0000 7f6598f2a640 1 --2- 172.21.15.123:0/227428071 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5643f2bb50b0 0x5643f2bae1a0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f658c034040 tx=0x7f658c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a67d247029ee353 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:47.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.225+0000 7f6579ffb640 1 -- 172.21.15.123:0/227428071 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658c036040 con 0x5643f2bb50b0 2024-09-15T23:16:47.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.225+0000 7f6579ffb640 1 -- 172.21.15.123:0/227428071 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f658c003b70 con 0x5643f2bb50b0 2024-09-15T23:16:47.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.225+0000 7f6579ffb640 1 -- 172.21.15.123:0/227428071 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658c005030 con 0x5643f2bb50b0 2024-09-15T23:16:47.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.226+0000 7f659d805740 1 -- 172.21.15.123:0/227428071 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5643f2bb50b0 msgr2=0x5643f2bae1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:47.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.226+0000 7f659d805740 1 --2- 172.21.15.123:0/227428071 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5643f2bb50b0 0x5643f2bae1a0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f658c034040 tx=0x7f658c02e000 comp rx=0 tx=0).stop 2024-09-15T23:16:47.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.226+0000 7f659d805740 1 -- 172.21.15.123:0/227428071 shutdown_connections 2024-09-15T23:16:47.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.226+0000 7f659d805740 1 --2- 172.21.15.123:0/227428071 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5643f2bb50b0 0x5643f2bae1a0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.226+0000 7f659d805740 1 --2- 172.21.15.123:0/227428071 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5643f2bb10e0 0x5643f2bb3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.226+0000 7f659d805740 1 --2- 172.21.15.123:0/227428071 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5643f2bb3920 0x5643f2bf90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.226+0000 7f659d805740 1 -- 172.21.15.123:0/227428071 >> 172.21.15.123:0/227428071 conn(0x5643f2bb0370 msgr2=0x5643f2bf8590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:47.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.226+0000 7f659d805740 1 -- 172.21.15.123:0/227428071 shutdown_connections 2024-09-15T23:16:47.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.226+0000 7f659d805740 1 -- 172.21.15.123:0/227428071 wait complete. 2024-09-15T23:16:47.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.226+0000 7f659d805740 1 -- start start 2024-09-15T23:16:47.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.227+0000 7f659d805740 1 Processor -- start 2024-09-15T23:16:47.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.227+0000 7f659d805740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5643f2bb3920 0x5643f2bf3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.227+0000 7f659d805740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5643f2bb50b0 0x5643f2bdc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.227+0000 7f659d805740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5643f2bd7d70 0x5643f2bdb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.227+0000 7f659d805740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5643f2baf810 con 0x5643f2bb3920 2024-09-15T23:16:47.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.227+0000 7f659d805740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5643f2a9f4f0 con 0x5643f2bd7d70 2024-09-15T23:16:47.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.227+0000 7f659d805740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5643f2bf98f0 con 0x5643f2bb50b0 2024-09-15T23:16:47.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.227+0000 7f659d805740 10 client.0 _ll_register_callbacks cb 0x5643f2ac0b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:16:47.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.227+0000 7f6593fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5643f2bb3920 0x5643f2bf3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.228+0000 7f6593fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5643f2bb3920 0x5643f2bf3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47618/0 (socket says 172.21.15.123:47618) 2024-09-15T23:16:47.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.228+0000 7f6593fff640 1 -- 172.21.15.123:0/3333949785 learned_addr learned my addr 172.21.15.123:0/3333949785 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:47.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.228+0000 7f65937fe640 1 --2- 172.21.15.123:0/3333949785 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5643f2bb50b0 0x5643f2bdc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.228+0000 7f6598f2a640 1 --2- 172.21.15.123:0/3333949785 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5643f2bd7d70 0x5643f2bdb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.228+0000 7f6593fff640 1 -- 172.21.15.123:0/3333949785 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5643f2bb50b0 msgr2=0x5643f2bdc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:47.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.228+0000 7f6593fff640 1 --2- 172.21.15.123:0/3333949785 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5643f2bb50b0 0x5643f2bdc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.228+0000 7f6593fff640 1 -- 172.21.15.123:0/3333949785 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5643f2bd7d70 msgr2=0x5643f2bdb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:47.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.228+0000 7f6593fff640 1 --2- 172.21.15.123:0/3333949785 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5643f2bd7d70 0x5643f2bdb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.228+0000 7f6593fff640 1 -- 172.21.15.123:0/3333949785 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643f28f37d0 con 0x5643f2bb3920 2024-09-15T23:16:47.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.228+0000 7f6593fff640 1 --2- 172.21.15.123:0/3333949785 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5643f2bb3920 0x5643f2bf3bd0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f65840119d0 tx=0x7f6584059c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8195fdc0b6372b9c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:47.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.228+0000 7f6572ffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:16:47.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.228+0000 7f6572ffd640 1 -- 172.21.15.123:0/3333949785 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6584071020 con 0x5643f2bb3920 2024-09-15T23:16:47.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.228+0000 7f6572ffd640 1 -- 172.21.15.123:0/3333949785 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 5709+0+0 (secure 0 0 0) 0x7f6584062490 con 0x5643f2bb3920 2024-09-15T23:16:47.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.228+0000 7f659d805740 1 -- 172.21.15.123:0/3333949785 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f658c003b70 con 0x5643f2bb3920 2024-09-15T23:16:47.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.228+0000 7f6572ffd640 1 -- 172.21.15.123:0/3333949785 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f6584058f90 con 0x5643f2bb3920 2024-09-15T23:16:47.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.228+0000 7f659d805740 10 client.7326 fetch_fsmap learned FSMap version 59 2024-09-15T23:16:47.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.228+0000 7f659d805740 1 -- 172.21.15.123:0/3333949785 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) -- 0x5643f28293f0 con 0x5643f2bb3920 2024-09-15T23:16:47.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.228+0000 7f6572ffd640 1 -- 172.21.15.123:0/3333949785 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f658c003b70 con 0x5643f2bb3920 2024-09-15T23:16:47.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.228+0000 7f6572ffd640 1 -- 172.21.15.123:0/3333949785 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 59) ==== 3502+0+0 (secure 0 0 0) 0x7f6584025030 con 0x5643f2bb3920 2024-09-15T23:16:47.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.228+0000 7f659d805740 10 client.7326 fetch_fsmap finished waiting for FSMap version 59 2024-09-15T23:16:47.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.228+0000 7f659d805740 10 client.7326 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.b 2024-09-15T23:16:47.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.229+0000 7f659d805740 20 client.7326 populate_metadata read hostname 'smithi123' 2024-09-15T23:16:47.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.229+0000 7f659d805740 1 --2- 172.21.15.123:0/3333949785 >> [v2:172.21.15.188:6835/2840550551,v1:172.21.15.188:6837/2840550551] conn(0x5643f2bf4830 0x5643f2bf4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.229+0000 7f659d805740 4 client.7326 mds_command: new command op to 7149 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:16:47.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.229+0000 7f659d805740 1 -- 172.21.15.123:0/3333949785 --> [v2:172.21.15.188:6835/2840550551,v1:172.21.15.188:6837/2840550551] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643f2b23e20 con 0x5643f2bf4830 2024-09-15T23:16:47.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.229+0000 7f65937fe640 1 --2- 172.21.15.123:0/3333949785 >> [v2:172.21.15.188:6835/2840550551,v1:172.21.15.188:6837/2840550551] conn(0x5643f2bf4830 0x5643f2bf4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.229+0000 7f6572ffd640 10 client.7326 ms_handle_connect on v2:172.21.15.188:6835/2840550551 2024-09-15T23:16:47.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.229+0000 7f65937fe640 1 --2- 172.21.15.123:0/3333949785 >> [v2:172.21.15.188:6835/2840550551,v1:172.21.15.188:6837/2840550551] conn(0x5643f2bf4830 0x5643f2bf4c40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68f8bb4d9fc080e server_cookie=aabd97d2df819852 in_seq=0 out_seq=0 2024-09-15T23:16:47.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.230+0000 7f6572ffd640 1 -- 172.21.15.123:0/3333949785 <== mds.0 v2:172.21.15.188:6835/2840550551 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5643f2b23e20 con 0x5643f2bf4830 2024-09-15T23:16:47.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.230+0000 7f6572ffd640 10 client.7326 handle_command_reply: tid=0 2024-09-15T23:16:47.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.230+0000 7f659d805740 1 client.7326 shutdown 2024-09-15T23:16:47.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.230+0000 7f659d805740 1 -- 172.21.15.123:0/3333949785 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5643f2bb3920 msgr2=0x5643f2bf3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:47.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.230+0000 7f659d805740 1 --2- 172.21.15.123:0/3333949785 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5643f2bb3920 0x5643f2bf3bd0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f65840119d0 tx=0x7f6584059c00 comp rx=0 tx=0).stop 2024-09-15T23:16:47.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.230+0000 7f659d805740 1 -- 172.21.15.123:0/3333949785 shutdown_connections 2024-09-15T23:16:47.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.230+0000 7f659d805740 1 --2- 172.21.15.123:0/3333949785 >> [v2:172.21.15.188:6835/2840550551,v1:172.21.15.188:6837/2840550551] conn(0x5643f2bf4830 0x5643f2bf4c40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.230+0000 7f659d805740 1 --2- 172.21.15.123:0/3333949785 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5643f2bd7d70 0x5643f2bdb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.230+0000 7f659d805740 1 --2- 172.21.15.123:0/3333949785 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5643f2bb50b0 0x5643f2bdc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.230+0000 7f6572ffd640 0 client.7326 ms_handle_reset on v2:172.21.15.188:6835/2840550551 2024-09-15T23:16:47.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.230+0000 7f659d805740 1 --2- 172.21.15.123:0/3333949785 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5643f2bb3920 0x5643f2bf3bd0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.230+0000 7f659d805740 1 -- 172.21.15.123:0/3333949785 >> 172.21.15.123:0/3333949785 conn(0x5643f2bb10e0 msgr2=0x5643f2bf6540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:47.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.230+0000 7f659d805740 1 -- 172.21.15.123:0/3333949785 shutdown_connections 2024-09-15T23:16:47.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.230+0000 7f659d805740 1 -- 172.21.15.123:0/3333949785 wait complete. 2024-09-15T23:16:47.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.230+0000 7f659d805740 20 client.7326 trim_cache size 0 max 16384 2024-09-15T23:16:47.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.245+0000 7f659d805740 1 Processor -- start 2024-09-15T23:16:47.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.245+0000 7f659d805740 1 -- start start 2024-09-15T23:16:47.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.245+0000 7f659d805740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5643f2bb3920 0x5643f2c1c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.245+0000 7f659d805740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5643f2bb50b0 0x5643f2bd68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.245+0000 7f659d805740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5643f2bd7d70 0x5643f2bfa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.245+0000 7f659d805740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f65941fef70 con 0x5643f2bb50b0 2024-09-15T23:16:47.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.245+0000 7f659d805740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f65941fdfa0 con 0x5643f2bd7d70 2024-09-15T23:16:47.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.245+0000 7f659d805740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f65941572b0 con 0x5643f2bb3920 2024-09-15T23:16:47.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.245+0000 7f65937fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5643f2bb50b0 0x5643f2bd68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.245+0000 7f65937fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5643f2bb50b0 0x5643f2bd68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47630/0 (socket says 172.21.15.123:47630) 2024-09-15T23:16:47.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.245+0000 7f65937fe640 1 -- 172.21.15.123:0/2073988413 learned_addr learned my addr 172.21.15.123:0/2073988413 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:47.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.245+0000 7f65937fe640 1 -- 172.21.15.123:0/2073988413 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5643f2bb3920 msgr2=0x5643f2c1c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:47.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.245+0000 7f65937fe640 1 --2- 172.21.15.123:0/2073988413 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5643f2bb3920 0x5643f2c1c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.245+0000 7f65937fe640 1 -- 172.21.15.123:0/2073988413 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5643f2bd7d70 msgr2=0x5643f2bfa0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:47.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.245+0000 7f65937fe640 1 --2- 172.21.15.123:0/2073988413 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5643f2bd7d70 0x5643f2bfa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.245+0000 7f65937fe640 1 -- 172.21.15.123:0/2073988413 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643f2bb4070 con 0x5643f2bb50b0 2024-09-15T23:16:47.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.246+0000 7f65937fe640 1 --2- 172.21.15.123:0/2073988413 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5643f2bb50b0 0x5643f2bd68e0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f6588006fe0 tx=0x7f658800c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30cb07e77fbc74c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:47.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.246+0000 7f65797fa640 1 -- 172.21.15.123:0/2073988413 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6588030070 con 0x5643f2bb50b0 2024-09-15T23:16:47.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.246+0000 7f65797fa640 1 -- 172.21.15.123:0/2073988413 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6588016e10 con 0x5643f2bb50b0 2024-09-15T23:16:47.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.246+0000 7f65797fa640 1 -- 172.21.15.123:0/2073988413 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658802b530 con 0x5643f2bb50b0 2024-09-15T23:16:47.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.246+0000 7f659d805740 1 -- 172.21.15.123:0/2073988413 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5643f2bb50b0 msgr2=0x5643f2bd68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:47.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.246+0000 7f659d805740 1 --2- 172.21.15.123:0/2073988413 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5643f2bb50b0 0x5643f2bd68e0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f6588006fe0 tx=0x7f658800c000 comp rx=0 tx=0).stop 2024-09-15T23:16:47.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.246+0000 7f659d805740 1 -- 172.21.15.123:0/2073988413 shutdown_connections 2024-09-15T23:16:47.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.246+0000 7f659d805740 1 --2- 172.21.15.123:0/2073988413 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5643f2bd7d70 0x5643f2bfa0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.246+0000 7f659d805740 1 --2- 172.21.15.123:0/2073988413 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5643f2bb50b0 0x5643f2bd68e0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.246+0000 7f659d805740 1 --2- 172.21.15.123:0/2073988413 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5643f2bb3920 0x5643f2c1c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.246+0000 7f659d805740 1 -- 172.21.15.123:0/2073988413 >> 172.21.15.123:0/2073988413 conn(0x5643f2bb10e0 msgr2=0x5643f2bd9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:47.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.246+0000 7f659d805740 1 -- 172.21.15.123:0/2073988413 shutdown_connections 2024-09-15T23:16:47.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.246+0000 7f659d805740 1 -- 172.21.15.123:0/2073988413 wait complete. 2024-09-15T23:16:47.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.247+0000 7f659d805740 1 -- start start 2024-09-15T23:16:47.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.247+0000 7f659d805740 1 Processor -- start 2024-09-15T23:16:47.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.248+0000 7f659d805740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5643f2bb3920 0x5643f2c5fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.248+0000 7f659d805740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5643f2bb50b0 0x5643f2bf6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.248+0000 7f659d805740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5643f2bd7d70 0x5643f2bf6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.248+0000 7f659d805740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5643f2bd7a60 con 0x5643f2bb50b0 2024-09-15T23:16:47.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.248+0000 7f659d805740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f65941fd980 con 0x5643f2bd7d70 2024-09-15T23:16:47.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.248+0000 7f659d805740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5643f2bdb4d0 con 0x5643f2bb3920 2024-09-15T23:16:47.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.248+0000 7f659d805740 10 client.0 _ll_register_callbacks cb 0x7f6584059680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:16:47.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.248+0000 7f65937fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5643f2bb50b0 0x5643f2bf6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.248+0000 7f65937fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5643f2bb50b0 0x5643f2bf6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47636/0 (socket says 172.21.15.123:47636) 2024-09-15T23:16:47.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.248+0000 7f65937fe640 1 -- 172.21.15.123:0/3746056278 learned_addr learned my addr 172.21.15.123:0/3746056278 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:47.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.248+0000 7f6598f2a640 1 --2- 172.21.15.123:0/3746056278 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5643f2bd7d70 0x5643f2bf6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.248+0000 7f6593fff640 1 --2- 172.21.15.123:0/3746056278 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5643f2bb3920 0x5643f2c5fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.248+0000 7f65937fe640 1 -- 172.21.15.123:0/3746056278 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5643f2bb3920 msgr2=0x5643f2c5fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:47.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.248+0000 7f65937fe640 1 --2- 172.21.15.123:0/3746056278 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5643f2bb3920 0x5643f2c5fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.248+0000 7f65937fe640 1 -- 172.21.15.123:0/3746056278 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5643f2bd7d70 msgr2=0x5643f2bf6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:47.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.248+0000 7f65937fe640 1 --2- 172.21.15.123:0/3746056278 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5643f2bd7d70 0x5643f2bf6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.248+0000 7f65937fe640 1 -- 172.21.15.123:0/3746056278 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643f2bdb670 con 0x5643f2bb50b0 2024-09-15T23:16:47.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.248+0000 7f65937fe640 1 --2- 172.21.15.123:0/3746056278 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5643f2bb50b0 0x5643f2bf6540 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x5643f2ad2ae0 tx=0x7f65880019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b7c31481f1ec6b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:47.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.248+0000 7f6572ffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:16:47.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.248+0000 7f6572ffd640 1 -- 172.21.15.123:0/3746056278 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658803a060 con 0x5643f2bb50b0 2024-09-15T23:16:47.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.249+0000 7f6572ffd640 1 -- 172.21.15.123:0/3746056278 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 5709+0+0 (secure 0 0 0) 0x7f6588006890 con 0x5643f2bb50b0 2024-09-15T23:16:47.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.249+0000 7f659d805740 1 -- 172.21.15.123:0/3746056278 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6588016e10 con 0x5643f2bb50b0 2024-09-15T23:16:47.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.249+0000 7f6572ffd640 1 -- 172.21.15.123:0/3746056278 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7f6588040050 con 0x5643f2bb50b0 2024-09-15T23:16:47.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.249+0000 7f659d805740 10 client.7332 fetch_fsmap learned FSMap version 59 2024-09-15T23:16:47.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.249+0000 7f659d805740 1 -- 172.21.15.123:0/3746056278 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=2+}) -- 0x5643f27e90f0 con 0x5643f2bb50b0 2024-09-15T23:16:47.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.249+0000 7f6572ffd640 1 -- 172.21.15.123:0/3746056278 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6588016e10 con 0x5643f2bb50b0 2024-09-15T23:16:47.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.249+0000 7f6572ffd640 1 -- 172.21.15.123:0/3746056278 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 59) ==== 3502+0+0 (secure 0 0 0) 0x7f6588043020 con 0x5643f2bb50b0 2024-09-15T23:16:47.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.249+0000 7f659d805740 10 client.7332 fetch_fsmap finished waiting for FSMap version 59 2024-09-15T23:16:47.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.249+0000 7f659d805740 10 client.7332 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.b 2024-09-15T23:16:47.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.249+0000 7f659d805740 20 client.7332 populate_metadata read hostname 'smithi123' 2024-09-15T23:16:47.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.249+0000 7f659d805740 1 --2- 172.21.15.123:0/3746056278 >> [v2:172.21.15.188:6835/2840550551,v1:172.21.15.188:6837/2840550551] conn(0x5643f2bfab00 0x5643f2c1b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.249+0000 7f659d805740 4 client.7332 mds_command: new command op to 7149 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T23:16:47.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.249+0000 7f659d805740 1 -- 172.21.15.123:0/3746056278 --> [v2:172.21.15.188:6835/2840550551,v1:172.21.15.188:6837/2840550551] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5643f2b1e170 con 0x5643f2bfab00 2024-09-15T23:16:47.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.249+0000 7f6593fff640 1 --2- 172.21.15.123:0/3746056278 >> [v2:172.21.15.188:6835/2840550551,v1:172.21.15.188:6837/2840550551] conn(0x5643f2bfab00 0x5643f2c1b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.249+0000 7f6572ffd640 10 client.7332 ms_handle_connect on v2:172.21.15.188:6835/2840550551 2024-09-15T23:16:47.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.249+0000 7f6593fff640 1 --2- 172.21.15.123:0/3746056278 >> [v2:172.21.15.188:6835/2840550551,v1:172.21.15.188:6837/2840550551] conn(0x5643f2bfab00 0x5643f2c1b1e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7aa3cde945f3395 server_cookie=886e5cbbe95d59d5 in_seq=0 out_seq=0 2024-09-15T23:16:47.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.260+0000 7f6572ffd640 1 -- 172.21.15.123:0/3746056278 <== mds.0 v2:172.21.15.188:6835/2840550551 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5643f2b1e170 con 0x5643f2bfab00 2024-09-15T23:16:47.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.260+0000 7f6572ffd640 10 client.7332 handle_command_reply: tid=0 2024-09-15T23:16:47.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.260+0000 7f659d805740 1 client.7332 shutdown 2024-09-15T23:16:47.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.260+0000 7f659d805740 1 -- 172.21.15.123:0/3746056278 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5643f2bb50b0 msgr2=0x5643f2bf6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:47.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.260+0000 7f659d805740 1 --2- 172.21.15.123:0/3746056278 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5643f2bb50b0 0x5643f2bf6540 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x5643f2ad2ae0 tx=0x7f65880019c0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.260+0000 7f659d805740 1 -- 172.21.15.123:0/3746056278 shutdown_connections 2024-09-15T23:16:47.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.260+0000 7f659d805740 1 --2- 172.21.15.123:0/3746056278 >> [v2:172.21.15.188:6835/2840550551,v1:172.21.15.188:6837/2840550551] conn(0x5643f2bfab00 0x5643f2c1b1e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.260+0000 7f659d805740 1 --2- 172.21.15.123:0/3746056278 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5643f2bd7d70 0x5643f2bf6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.260+0000 7f6572ffd640 0 client.7332 ms_handle_reset on v2:172.21.15.188:6835/2840550551 2024-09-15T23:16:47.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.260+0000 7f659d805740 1 --2- 172.21.15.123:0/3746056278 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5643f2bb50b0 0x5643f2bf6540 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.260+0000 7f659d805740 1 --2- 172.21.15.123:0/3746056278 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5643f2bb3920 0x5643f2c5fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.260+0000 7f659d805740 1 -- 172.21.15.123:0/3746056278 >> 172.21.15.123:0/3746056278 conn(0x5643f2bb10e0 msgr2=0x5643f2bf59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:47.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.261+0000 7f659d805740 1 -- 172.21.15.123:0/3746056278 shutdown_connections 2024-09-15T23:16:47.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.261+0000 7f659d805740 1 -- 172.21.15.123:0/3746056278 wait complete. 2024-09-15T23:16:47.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.261+0000 7f659d805740 20 client.7332 trim_cache size 0 max 16384 2024-09-15T23:16:47.264 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:16:47.265 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "", 2024-09-15T23:16:47.265 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0 2024-09-15T23:16:47.265 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:16:47.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.261+0000 7f659a98d640 1 -- 172.21.15.123:0/4093692394 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f658006c2b0 msgr2=0x7f658006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:47.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.261+0000 7f659a98d640 1 --2- 172.21.15.123:0/4093692394 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f658006c2b0 0x7f658006e770 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f65940b5270 tx=0x7f6588009040 comp rx=0 tx=0).stop 2024-09-15T23:16:47.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.261+0000 7f659a98d640 1 -- 172.21.15.123:0/4093692394 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f657c004d40 msgr2=0x7f6594152270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:47.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.261+0000 7f659a98d640 1 --2- 172.21.15.123:0/4093692394 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f657c004d40 0x7f6594152270 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f6584011a00 tx=0x7f6584011ec0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.261+0000 7f659a98d640 1 -- 172.21.15.123:0/4093692394 shutdown_connections 2024-09-15T23:16:47.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.261+0000 7f659a98d640 1 --2- 172.21.15.123:0/4093692394 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6594154160 0x7f65941f2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.261+0000 7f659a98d640 1 --2- 172.21.15.123:0/4093692394 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6594153d00 0x7f65941f2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.261+0000 7f659a98d640 1 --2- 172.21.15.123:0/4093692394 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f658006c2b0 0x7f658006e770 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.261+0000 7f659a98d640 1 --2- 172.21.15.123:0/4093692394 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f657c004d40 0x7f6594152270 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.261+0000 7f659a98d640 1 -- 172.21.15.123:0/4093692394 >> 172.21.15.123:0/4093692394 conn(0x7f659406d0f0 msgr2=0x7f65940b45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:47.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.261+0000 7f659a98d640 1 -- 172.21.15.123:0/4093692394 shutdown_connections 2024-09-15T23:16:47.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.261+0000 7f659a98d640 1 -- 172.21.15.123:0/4093692394 wait complete. 2024-09-15T23:16:47.274 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T23:16:47.274 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:16:47.275 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T23:16:47.275 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:16:47.275 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T23:16:47.275 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:16:47.275 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T23:16:47.275 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:16:47.286 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T23:16:47.286 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2024-09-15T23:16:47.287 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T23:16:47.287 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2024-09-15T23:16:47.289 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T23:16:47.290 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2024-09-15T23:16:47.291 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T23:16:47.291 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2024-09-15T23:16:47.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.429+0000 7f4117949640 1 Processor -- start 2024-09-15T23:16:47.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.429+0000 7f205ce96640 1 Processor -- start 2024-09-15T23:16:47.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.429+0000 7f467ff7f640 1 Processor -- start 2024-09-15T23:16:47.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.429+0000 7f205ce96640 1 -- start start 2024-09-15T23:16:47.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.430+0000 7f03b947b640 1 Processor -- start 2024-09-15T23:16:47.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.430+0000 7f03b947b640 1 -- start start 2024-09-15T23:16:47.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.430+0000 7f4117949640 1 -- start start 2024-09-15T23:16:47.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.430+0000 7f467ff7f640 1 -- start start 2024-09-15T23:16:47.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.430+0000 7f205ce96640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f205815eab0 0x7f205815ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.430+0000 7f205ce96640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2058162490 0x7f20580d2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f205ce96640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f205815f570 con 0x7f20580b66b0 2024-09-15T23:16:47.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f205ce96640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f205815f850 con 0x7f2058162490 2024-09-15T23:16:47.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f205ce96640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f205815fb30 con 0x7f205815eab0 2024-09-15T23:16:47.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.430+0000 7f467ff7f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f467815ed20 0x7f46780b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f467ff7f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46780d23b0 0x7f46780b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f467ff7f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f46780cf2d0 0x7f46780cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f467ff7f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f46780d0e70 con 0x7f467815ed20 2024-09-15T23:16:47.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f467ff7f640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f46780d41c0 con 0x7f46780cf2d0 2024-09-15T23:16:47.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f467ff7f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f46780d35b0 con 0x7f46780d23b0 2024-09-15T23:16:47.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f4117949640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f411015ed20 0x7f41100b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f03b947b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f03b4072880 0x7f03b4071830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f4117949640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f41100d23b0 0x7f41100b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f03b947b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f03b415acc0 0x7f03b406f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f4117949640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41100d0e70 con 0x7f41100cf2d0 2024-09-15T23:16:47.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f467dd1b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f467815ed20 0x7f46780b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f467dd1b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f467815ed20 0x7f46780b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47646/0 (socket says 172.21.15.123:47646) 2024-09-15T23:16:47.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f467dd1b640 1 -- 172.21.15.123:0/1268211735 learned_addr learned my addr 172.21.15.123:0/1268211735 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:47.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f03b947b640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03b4071ef0 con 0x7f03b4072c60 2024-09-15T23:16:47.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f4115ee6640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f41100cf2d0 0x7f41100cf760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51524/0 (socket says 172.21.15.123:51524) 2024-09-15T23:16:47.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f03b947b640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f03b40b5200 con 0x7f03b4072880 2024-09-15T23:16:47.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f03b947b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f03b40721d0 con 0x7f03b415acc0 2024-09-15T23:16:47.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f205659c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f205815eab0 0x7f205815ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f2055d9b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2058162490 0x7f20580d2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f205659c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f205815eab0 0x7f205815ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:41628/0 (socket says 172.21.15.123:41628) 2024-09-15T23:16:47.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f205659c640 1 -- 172.21.15.123:0/1306537070 learned_addr learned my addr 172.21.15.123:0/1306537070 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:47.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f03b2ffd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f03b4072880 0x7f03b4071830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f467d51a640 1 --2- 172.21.15.123:0/1268211735 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46780d23b0 0x7f46780b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f03b37fe640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f03b4072c60 0x7f03b406db10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:50536/0 (socket says 172.21.15.123:50536) 2024-09-15T23:16:47.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f03b37fe640 1 -- 172.21.15.123:0/2107132537 learned_addr learned my addr 172.21.15.123:0/2107132537 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:47.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f03b2ffd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f03b4072880 0x7f03b4071830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:52498/0 (socket says 172.21.15.123:52498) 2024-09-15T23:16:47.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f03b27fc640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f03b415acc0 0x7f03b406f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f4115ee6640 1 -- 172.21.15.123:0/237563840 learned_addr learned my addr 172.21.15.123:0/237563840 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:47.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f467e51c640 1 --2- 172.21.15.123:0/1268211735 >> v2:172.21.15.188:3300/0 conn(0x7f46780cf2d0 0x7f46780cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f4114ee4640 1 --2- 172.21.15.123:0/237563840 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f41100d23b0 0x7f41100b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f467dd1b640 1 -- 172.21.15.123:0/1268211735 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46780d23b0 msgr2=0x7f46780b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:47.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f467dd1b640 1 --2- 172.21.15.123:0/1268211735 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46780d23b0 0x7f46780b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f4117949640 1 -- 172.21.15.123:0/237563840 --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f41100d41c0 con 0x7f411015ed20 2024-09-15T23:16:47.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f4117949640 1 -- 172.21.15.123:0/237563840 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f41100d35b0 con 0x7f41100d23b0 2024-09-15T23:16:47.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f467dd1b640 1 -- 172.21.15.123:0/1268211735 >> v2:172.21.15.188:3300/0 conn(0x7f46780cf2d0 msgr2=0x7f46780cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:47.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f467dd1b640 1 --2- 172.21.15.123:0/1268211735 >> v2:172.21.15.188:3300/0 conn(0x7f46780cf2d0 0x7f46780cf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f41156e5640 1 --2- 172.21.15.123:0/237563840 >> v2:172.21.15.188:3300/0 conn(0x7f411015ed20 0x7f41100b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f467dd1b640 1 -- 172.21.15.123:0/1268211735 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46780d3890 con 0x7f467815ed20 2024-09-15T23:16:47.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f03b1ffb640 1 -- 172.21.15.123:0/2107132537 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3578766020 0 0) 0x7f03b4071ef0 con 0x7f03b4072c60 2024-09-15T23:16:47.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f03b1ffb640 1 -- 172.21.15.123:0/2107132537 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f039c003520 con 0x7f03b4072c60 2024-09-15T23:16:47.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.432+0000 7f03b2ffd640 1 -- 172.21.15.123:0/2107132537 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f03b415acc0 msgr2=0x7f03b406f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:47.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.432+0000 7f4107fff640 1 -- 172.21.15.123:0/237563840 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2425178987 0 0) 0x7f4108001490 con 0x7f41100cf2d0 2024-09-15T23:16:47.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f205559a640 1 -- 172.21.15.123:0/1306537070 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1866342855 0 0) 0x7f205815f570 con 0x7f20580b66b0 2024-09-15T23:16:47.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f205659c640 1 -- 172.21.15.123:0/1306537070 >> v2:172.21.15.188:3300/0 conn(0x7f2058162490 msgr2=0x7f20580d2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:47.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f205659c640 1 --2- 172.21.15.123:0/1306537070 >> v2:172.21.15.188:3300/0 conn(0x7f2058162490 0x7f20580d2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f205659c640 1 -- 172.21.15.123:0/1306537070 >> v1:172.21.15.188:6789/0 conn(0x7f20580b66b0 legacy=0x7f20580d35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:47.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.431+0000 7f205659c640 1 -- 172.21.15.123:0/1306537070 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f205815fe10 con 0x7f205815eab0 2024-09-15T23:16:47.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.432+0000 7f4107fff640 1 -- 172.21.15.123:0/237563840 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40fc003520 con 0x7f41100cf2d0 2024-09-15T23:16:47.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.432+0000 7f03b2ffd640 1 --2- 172.21.15.123:0/2107132537 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f03b415acc0 0x7f03b406f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.432+0000 7f03b2ffd640 1 -- 172.21.15.123:0/2107132537 >> v1:172.21.15.188:6789/0 conn(0x7f03b4072c60 legacy=0x7f03b406db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:47.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.432+0000 7f03b2ffd640 1 -- 172.21.15.123:0/2107132537 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b40724b0 con 0x7f03b4072880 2024-09-15T23:16:47.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.432+0000 7f41156e5640 1 -- 172.21.15.123:0/237563840 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f41100d23b0 msgr2=0x7f41100b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:47.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.432+0000 7f41156e5640 1 --2- 172.21.15.123:0/237563840 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f41100d23b0 0x7f41100b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.432+0000 7f41156e5640 1 -- 172.21.15.123:0/237563840 >> v1:172.21.15.123:6789/0 conn(0x7f41100cf2d0 legacy=0x7f41100cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:47.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.432+0000 7f41156e5640 1 -- 172.21.15.123:0/237563840 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41100d3890 con 0x7f411015ed20 2024-09-15T23:16:47.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.432+0000 7f4107fff640 1 -- 172.21.15.123:0/237563840 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 17155570 0 0) 0x7f40fc003520 con 0x7f41100cf2d0 2024-09-15T23:16:47.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.432+0000 7f205659c640 1 --2- 172.21.15.123:0/1306537070 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f205815eab0 0x7f205815ee90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2048009870 tx=0x7f204802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=798fc3723493db89 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:47.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.432+0000 7f467dd1b640 1 --2- 172.21.15.123:0/1268211735 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f467815ed20 0x7f46780b6260 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f467806ee30 tx=0x7f467402a1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff6d2196adbfd2ca server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:47.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.433+0000 7f03b2ffd640 1 --2- 172.21.15.123:0/2107132537 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f03b4072880 0x7f03b4071830 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f03a40097a0 tx=0x7f03a402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2054fd80d64aad1b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:47.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.433+0000 7f467cd19640 1 -- 172.21.15.123:0/1268211735 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4674037070 con 0x7f467815ed20 2024-09-15T23:16:47.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.433+0000 7f205559a640 1 -- 172.21.15.123:0/1306537070 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2048037070 con 0x7f205815eab0 2024-09-15T23:16:47.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.433+0000 7f205559a640 1 -- 172.21.15.123:0/1306537070 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2048032440 con 0x7f205815eab0 2024-09-15T23:16:47.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.433+0000 7f205559a640 1 -- 172.21.15.123:0/1306537070 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2048032810 con 0x7f205815eab0 2024-09-15T23:16:47.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.433+0000 7f03b1ffb640 1 -- 172.21.15.123:0/2107132537 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a4037070 con 0x7f03b4072880 2024-09-15T23:16:47.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.433+0000 7f467cd19640 1 -- 172.21.15.123:0/1268211735 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4674032440 con 0x7f467815ed20 2024-09-15T23:16:47.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.433+0000 7f467cd19640 1 -- 172.21.15.123:0/1268211735 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4674032810 con 0x7f467815ed20 2024-09-15T23:16:47.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.433+0000 7f03b1ffb640 1 -- 172.21.15.123:0/2107132537 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03a4032440 con 0x7f03b4072880 2024-09-15T23:16:47.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.433+0000 7f03b1ffb640 1 -- 172.21.15.123:0/2107132537 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a40327f0 con 0x7f03b4072880 2024-09-15T23:16:47.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.433+0000 7f41156e5640 1 --2- 172.21.15.123:0/237563840 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f411015ed20 0x7f41100b6260 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f410c0097a0 tx=0x7f410c02a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76633a9d7faf4bb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:47.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.433+0000 7f4107fff640 1 -- 172.21.15.123:0/237563840 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f410c037070 con 0x7f411015ed20 2024-09-15T23:16:47.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.433+0000 7f4107fff640 1 -- 172.21.15.123:0/237563840 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f410c02aba0 con 0x7f411015ed20 2024-09-15T23:16:47.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.433+0000 7f4107fff640 1 -- 172.21.15.123:0/237563840 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4108001bc0 con 0x7f411015ed20 2024-09-15T23:16:47.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.434+0000 7f205ce96640 1 -- 172.21.15.123:0/1306537070 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f205815eab0 msgr2=0x7f205815ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:47.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.434+0000 7f205ce96640 1 --2- 172.21.15.123:0/1306537070 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f205815eab0 0x7f205815ee90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2048009870 tx=0x7f204802a250 comp rx=0 tx=0).stop 2024-09-15T23:16:47.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.434+0000 7f467ff7f640 1 -- 172.21.15.123:0/1268211735 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f467815ed20 msgr2=0x7f46780b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:47.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.434+0000 7f03b947b640 1 -- 172.21.15.123:0/2107132537 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f03b4072880 msgr2=0x7f03b4071830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:47.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.434+0000 7f03b947b640 1 --2- 172.21.15.123:0/2107132537 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f03b4072880 0x7f03b4071830 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f03a40097a0 tx=0x7f03a402a180 comp rx=0 tx=0).stop 2024-09-15T23:16:47.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.434+0000 7f467ff7f640 1 --2- 172.21.15.123:0/1268211735 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f467815ed20 0x7f46780b6260 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f467806ee30 tx=0x7f467402a1d0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.434+0000 7f205ce96640 1 -- 172.21.15.123:0/1306537070 shutdown_connections 2024-09-15T23:16:47.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.434+0000 7f205ce96640 1 --2- 172.21.15.123:0/1306537070 >> v2:172.21.15.188:3300/0 conn(0x7f2058162490 0x7f20580d2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.434+0000 7f205ce96640 1 --2- 172.21.15.123:0/1306537070 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f205815eab0 0x7f205815ee90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.434+0000 7f205ce96640 1 -- 172.21.15.123:0/1306537070 >> 172.21.15.123:0/1306537070 conn(0x7f20580d16d0 msgr2=0x7f20580d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:47.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.434+0000 7f03b947b640 1 -- 172.21.15.123:0/2107132537 shutdown_connections 2024-09-15T23:16:47.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.434+0000 7f03b947b640 1 --2- 172.21.15.123:0/2107132537 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f03b415acc0 0x7f03b406f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.434+0000 7f03b947b640 1 --2- 172.21.15.123:0/2107132537 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f03b4072880 0x7f03b4071830 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.434+0000 7f03b947b640 1 -- 172.21.15.123:0/2107132537 >> 172.21.15.123:0/2107132537 conn(0x7f03b406cb50 msgr2=0x7f03b406cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:47.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.434+0000 7f03b947b640 1 -- 172.21.15.123:0/2107132537 shutdown_connections 2024-09-15T23:16:47.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.434+0000 7f205ce96640 1 -- 172.21.15.123:0/1306537070 shutdown_connections 2024-09-15T23:16:47.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.434+0000 7f205ce96640 1 -- 172.21.15.123:0/1306537070 wait complete. 2024-09-15T23:16:47.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.434+0000 7f03b947b640 1 -- 172.21.15.123:0/2107132537 wait complete. 2024-09-15T23:16:47.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.434+0000 7f467ff7f640 1 -- 172.21.15.123:0/1268211735 shutdown_connections 2024-09-15T23:16:47.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.434+0000 7f467ff7f640 1 --2- 172.21.15.123:0/1268211735 >> v2:172.21.15.188:3300/0 conn(0x7f46780cf2d0 0x7f46780cf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.434+0000 7f467ff7f640 1 --2- 172.21.15.123:0/1268211735 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46780d23b0 0x7f46780b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.434+0000 7f467ff7f640 1 --2- 172.21.15.123:0/1268211735 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f467815ed20 0x7f46780b6260 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.434+0000 7f467ff7f640 1 -- 172.21.15.123:0/1268211735 >> 172.21.15.123:0/1268211735 conn(0x7f46780d1260 msgr2=0x7f46780d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:47.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.434+0000 7f467ff7f640 1 -- 172.21.15.123:0/1268211735 shutdown_connections 2024-09-15T23:16:47.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.434+0000 7f467ff7f640 1 -- 172.21.15.123:0/1268211735 wait complete. 2024-09-15T23:16:47.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.434+0000 7f4117949640 1 -- 172.21.15.123:0/237563840 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f411015ed20 msgr2=0x7f41100b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:47.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.434+0000 7f4117949640 1 --2- 172.21.15.123:0/237563840 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f411015ed20 0x7f41100b6260 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f410c0097a0 tx=0x7f410c02a110 comp rx=0 tx=0).stop 2024-09-15T23:16:47.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.434+0000 7f4117949640 1 -- 172.21.15.123:0/237563840 shutdown_connections 2024-09-15T23:16:47.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.434+0000 7f4117949640 1 --2- 172.21.15.123:0/237563840 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f41100d23b0 0x7f41100b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.434+0000 7f4117949640 1 --2- 172.21.15.123:0/237563840 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f411015ed20 0x7f41100b6260 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.434+0000 7f4117949640 1 -- 172.21.15.123:0/237563840 >> 172.21.15.123:0/237563840 conn(0x7f41100d1260 msgr2=0x7f41100d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:47.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.434+0000 7f4117949640 1 -- 172.21.15.123:0/237563840 shutdown_connections 2024-09-15T23:16:47.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.434+0000 7f4117949640 1 -- 172.21.15.123:0/237563840 wait complete. 2024-09-15T23:16:47.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.435+0000 7f467ff7f640 1 Processor -- start 2024-09-15T23:16:47.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.435+0000 7f03b947b640 1 Processor -- start 2024-09-15T23:16:47.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.435+0000 7f205ce96640 1 Processor -- start 2024-09-15T23:16:47.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.435+0000 7f03b947b640 1 -- start start 2024-09-15T23:16:47.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.435+0000 7f467ff7f640 1 -- start start 2024-09-15T23:16:47.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.435+0000 7f205ce96640 1 -- start start 2024-09-15T23:16:47.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.436+0000 7f4117949640 1 Processor -- start 2024-09-15T23:16:47.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.436+0000 7f4117949640 1 -- start start 2024-09-15T23:16:47.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.436+0000 7f467ff7f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46780cf2d0 0x7f46781e9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.436+0000 7f467ff7f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46780d23b0 0x7f46780cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.436+0000 7f467ff7f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f467815ed20 0x7f4678161550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.436+0000 7f467ff7f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f46780d32a0 con 0x7f46780d23b0 2024-09-15T23:16:47.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.436+0000 7f467ff7f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f46780d3e50 con 0x7f46780cf2d0 2024-09-15T23:16:47.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.436+0000 7f467ff7f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f467815f100 con 0x7f467815ed20 2024-09-15T23:16:47.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.436+0000 7f03b947b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f03b4072880 0x7f03b40ad1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.436+0000 7f205ce96640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20580b66b0 0x7f20580ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.436+0000 7f03b947b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03b4072c60 0x7f03b414f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.436+0000 7f467d51a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46780d23b0 0x7f46780cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.436+0000 7f467dd1b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46780cf2d0 0x7f46781e9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.436+0000 7f467dd1b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46780cf2d0 0x7f46781e9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:52512/0 (socket says 172.21.15.123:52512) 2024-09-15T23:16:47.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.436+0000 7f467dd1b640 1 -- 172.21.15.123:0/2319591311 learned_addr learned my addr 172.21.15.123:0/2319591311 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:47.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.436+0000 7f03b947b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f03b415acc0 0x7f03b414f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.436+0000 7f205ce96640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f205815eab0 0x7f20580c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.436+0000 7f467e51c640 1 --2- 172.21.15.123:0/2319591311 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f467815ed20 0x7f4678161550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.436+0000 7f03b947b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f03b40730f0 con 0x7f03b4072c60 2024-09-15T23:16:47.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.436+0000 7f03b947b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f03b40ce370 con 0x7f03b415acc0 2024-09-15T23:16:47.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.436+0000 7f4117949640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f41100cf2d0 0x7f41101f5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f4117949640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41100d23b0 0x7f41100acd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f4117949640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f411015ed20 0x7f411015ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f4117949640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f41100d32a0 con 0x7f41100d23b0 2024-09-15T23:16:47.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f4117949640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f41100d3e50 con 0x7f411015ed20 2024-09-15T23:16:47.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f4117949640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f411015f100 con 0x7f41100cf2d0 2024-09-15T23:16:47.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f205ce96640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2058162490 0x7f2058159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.436+0000 7f03b947b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f03b40cfbb0 con 0x7f03b4072880 2024-09-15T23:16:47.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.436+0000 7f03b2ffd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f03b4072880 0x7f03b40ad1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.436+0000 7f03b2ffd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f03b4072880 0x7f03b40ad1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:41678/0 (socket says 172.21.15.123:41678) 2024-09-15T23:16:47.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.436+0000 7f03b2ffd640 1 -- 172.21.15.123:0/2086214988 learned_addr learned my addr 172.21.15.123:0/2086214988 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:47.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.436+0000 7f03b37fe640 1 --2- 172.21.15.123:0/2086214988 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f03b415acc0 0x7f03b414f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.436+0000 7f03b27fc640 1 --2- 172.21.15.123:0/2086214988 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03b4072c60 0x7f03b414f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f2055d9b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f205815eab0 0x7f20580c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f2055d9b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f205815eab0 0x7f20580c9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:41688/0 (socket says 172.21.15.123:41688) 2024-09-15T23:16:47.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f4115ee6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f411015ed20 0x7f411015ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f41156e5640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f41100cf2d0 0x7f41101f5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f4115ee6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f411015ed20 0x7f411015ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:52532/0 (socket says 172.21.15.123:52532) 2024-09-15T23:16:47.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f41156e5640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f41100cf2d0 0x7f41101f5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:41692/0 (socket says 172.21.15.123:41692) 2024-09-15T23:16:47.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f4115ee6640 1 -- 172.21.15.123:0/759948687 learned_addr learned my addr 172.21.15.123:0/759948687 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:47.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f2055d9b640 1 -- 172.21.15.123:0/2632587412 learned_addr learned my addr 172.21.15.123:0/2632587412 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:47.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f205ce96640 1 -- 172.21.15.123:0/2632587412 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f20580d4460 con 0x7f2058162490 2024-09-15T23:16:47.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f205ce96640 1 -- 172.21.15.123:0/2632587412 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f20580d3170 con 0x7f20580b66b0 2024-09-15T23:16:47.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f205ce96640 1 -- 172.21.15.123:0/2632587412 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f20580d45e0 con 0x7f205815eab0 2024-09-15T23:16:47.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f205659c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20580b66b0 0x7f20580ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f2056d9d640 1 --2- 172.21.15.123:0/2632587412 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2058162490 0x7f2058159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f03b2ffd640 1 -- 172.21.15.123:0/2086214988 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f03b415acc0 msgr2=0x7f03b414f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:47.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f03b2ffd640 1 --2- 172.21.15.123:0/2086214988 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f03b415acc0 0x7f03b414f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f03b2ffd640 1 -- 172.21.15.123:0/2086214988 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03b4072c60 msgr2=0x7f03b414f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:47.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f03b2ffd640 1 --2- 172.21.15.123:0/2086214988 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03b4072c60 0x7f03b414f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f03b2ffd640 1 -- 172.21.15.123:0/2086214988 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b413e380 con 0x7f03b4072880 2024-09-15T23:16:47.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f467dd1b640 1 -- 172.21.15.123:0/2319591311 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f467815ed20 msgr2=0x7f4678161550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:47.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f467dd1b640 1 --2- 172.21.15.123:0/2319591311 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f467815ed20 0x7f4678161550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f467dd1b640 1 -- 172.21.15.123:0/2319591311 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46780d23b0 msgr2=0x7f46780cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:47.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f467dd1b640 1 --2- 172.21.15.123:0/2319591311 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46780d23b0 0x7f46780cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f4114ee4640 1 --2- 172.21.15.123:0/759948687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41100d23b0 0x7f41100acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f205659c640 1 -- 172.21.15.123:0/2632587412 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f205815eab0 msgr2=0x7f20580c9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:47.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f205659c640 1 --2- 172.21.15.123:0/2632587412 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f205815eab0 0x7f20580c9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f205659c640 1 -- 172.21.15.123:0/2632587412 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2058162490 msgr2=0x7f2058159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:47.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f205659c640 1 --2- 172.21.15.123:0/2632587412 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2058162490 0x7f2058159fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f467dd1b640 1 -- 172.21.15.123:0/2319591311 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46781e8700 con 0x7f46780cf2d0 2024-09-15T23:16:47.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f467d51a640 1 --2- 172.21.15.123:0/2319591311 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46780d23b0 0x7f46780cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:16:47.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f467dd1b640 1 --2- 172.21.15.123:0/2319591311 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46780cf2d0 0x7f46781e9480 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f467402a210 tx=0x7f46740046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:47.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f205659c640 1 -- 172.21.15.123:0/2632587412 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20580c97c0 con 0x7f20580b66b0 2024-09-15T23:16:47.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f41156e5640 1 -- 172.21.15.123:0/759948687 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f411015ed20 msgr2=0x7f411015ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:47.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f41156e5640 1 --2- 172.21.15.123:0/759948687 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f411015ed20 0x7f411015ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f2055d9b640 1 --2- 172.21.15.123:0/2632587412 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f205815eab0 0x7f20580c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:16:47.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f41156e5640 1 -- 172.21.15.123:0/759948687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41100d23b0 msgr2=0x7f41100acd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:47.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f41156e5640 1 --2- 172.21.15.123:0/759948687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41100d23b0 0x7f41100acd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f41156e5640 1 -- 172.21.15.123:0/759948687 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41101f5c40 con 0x7f41100cf2d0 2024-09-15T23:16:47.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f2056d9d640 1 --2- 172.21.15.123:0/2632587412 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2058162490 0x7f2058159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:16:47.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f03b2ffd640 1 --2- 172.21.15.123:0/2086214988 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f03b4072880 0x7f03b40ad1d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f03a4035040 tx=0x7f03a40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:47.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f4115ee6640 1 --2- 172.21.15.123:0/759948687 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f411015ed20 0x7f411015ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:16:47.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f4114ee4640 1 --2- 172.21.15.123:0/759948687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41100d23b0 0x7f41100acd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:16:47.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.437+0000 7f466e7fc640 1 -- 172.21.15.123:0/2319591311 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4674041020 con 0x7f46780cf2d0 2024-09-15T23:16:47.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.438+0000 7f466e7fc640 1 -- 172.21.15.123:0/2319591311 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f467403d620 con 0x7f46780cf2d0 2024-09-15T23:16:47.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.438+0000 7f466e7fc640 1 -- 172.21.15.123:0/2319591311 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4674037040 con 0x7f46780cf2d0 2024-09-15T23:16:47.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.438+0000 7f41156e5640 1 --2- 172.21.15.123:0/759948687 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f41100cf2d0 0x7f41101f5700 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f410c031000 tx=0x7f410c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:47.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.438+0000 7f205659c640 1 --2- 172.21.15.123:0/2632587412 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20580b66b0 0x7f20580ccc20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2048031000 tx=0x7f20480046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:47.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.438+0000 7f467ff7f640 1 -- 172.21.15.123:0/2319591311 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4678161ec0 con 0x7f46780cf2d0 2024-09-15T23:16:47.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.438+0000 7f039b7fe640 1 -- 172.21.15.123:0/2086214988 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a4037040 con 0x7f03b4072880 2024-09-15T23:16:47.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.438+0000 7f039b7fe640 1 -- 172.21.15.123:0/2086214988 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03a4042070 con 0x7f03b4072880 2024-09-15T23:16:47.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.438+0000 7f467ff7f640 1 -- 172.21.15.123:0/2319591311 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46781e8c80 con 0x7f46780cf2d0 2024-09-15T23:16:47.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.438+0000 7f039b7fe640 1 -- 172.21.15.123:0/2086214988 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a4006e10 con 0x7f03b4072880 2024-09-15T23:16:47.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.438+0000 7f03b947b640 1 -- 172.21.15.123:0/2086214988 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03b413b4a0 con 0x7f03b4072880 2024-09-15T23:16:47.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.438+0000 7f03b947b640 1 -- 172.21.15.123:0/2086214988 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f03b413ba60 con 0x7f03b4072880 2024-09-15T23:16:47.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.438+0000 7f4105ffb640 1 -- 172.21.15.123:0/759948687 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f410c041020 con 0x7f41100cf2d0 2024-09-15T23:16:47.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.438+0000 7f4117949640 1 -- 172.21.15.123:0/759948687 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41100abcc0 con 0x7f41100cf2d0 2024-09-15T23:16:47.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.438+0000 7f4117949640 1 -- 172.21.15.123:0/759948687 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f41100ac280 con 0x7f41100cf2d0 2024-09-15T23:16:47.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.438+0000 7f2046ffd640 1 -- 172.21.15.123:0/2632587412 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2048041020 con 0x7f20580b66b0 2024-09-15T23:16:47.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.438+0000 7f2046ffd640 1 -- 172.21.15.123:0/2632587412 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f204803d6e0 con 0x7f20580b66b0 2024-09-15T23:16:47.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.438+0000 7f205ce96640 1 -- 172.21.15.123:0/2632587412 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20580cd290 con 0x7f20580b66b0 2024-09-15T23:16:47.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.439+0000 7f467ff7f640 1 -- 172.21.15.123:0/2319591311 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46780b7010 con 0x7f46780cf2d0 2024-09-15T23:16:47.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.438+0000 7f2046ffd640 1 -- 172.21.15.123:0/2632587412 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2048041020 con 0x7f20580b66b0 2024-09-15T23:16:47.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.439+0000 7f205ce96640 1 -- 172.21.15.123:0/2632587412 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20580cd850 con 0x7f20580b66b0 2024-09-15T23:16:47.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.438+0000 7f4105ffb640 1 -- 172.21.15.123:0/759948687 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f410c02aba0 con 0x7f41100cf2d0 2024-09-15T23:16:47.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.439+0000 7f03b947b640 1 -- 172.21.15.123:0/2086214988 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03b4071810 con 0x7f03b4072880 2024-09-15T23:16:47.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.439+0000 7f4105ffb640 1 -- 172.21.15.123:0/759948687 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f410c041020 con 0x7f41100cf2d0 2024-09-15T23:16:47.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.440+0000 7f4117949640 1 -- 172.21.15.123:0/759948687 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40f0005290 con 0x7f41100cf2d0 2024-09-15T23:16:47.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.440+0000 7f466e7fc640 1 -- 172.21.15.123:0/2319591311 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4674044020 con 0x7f46780cf2d0 2024-09-15T23:16:47.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.440+0000 7f205ce96640 1 -- 172.21.15.123:0/2632587412 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20580d2500 con 0x7f20580b66b0 2024-09-15T23:16:47.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.440+0000 7f466e7fc640 1 --2- 172.21.15.123:0/2319591311 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f465c06c2b0 0x7f465c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.440+0000 7f039b7fe640 1 -- 172.21.15.123:0/2086214988 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f03a4032830 con 0x7f03b4072880 2024-09-15T23:16:47.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.440+0000 7f466e7fc640 1 -- 172.21.15.123:0/2319591311 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5709+0+0 (secure 0 0 0) 0x7f46740aba10 con 0x7f46780cf2d0 2024-09-15T23:16:47.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.441+0000 7f467d51a640 1 --2- 172.21.15.123:0/2319591311 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f465c06c2b0 0x7f465c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.441+0000 7f2046ffd640 1 -- 172.21.15.123:0/2632587412 <== mon.1 v2:172.21.15.188:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2048044020 con 0x7f20580b66b0 2024-09-15T23:16:47.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.441+0000 7f039b7fe640 1 --2- 172.21.15.123:0/2086214988 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f03a006c2b0 0x7f03a006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.441+0000 7f03b27fc640 1 --2- 172.21.15.123:0/2086214988 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f03a006c2b0 0x7f03a006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.441+0000 7f039b7fe640 1 -- 172.21.15.123:0/2086214988 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(98..98 src has 1..98) ==== 5709+0+0 (secure 0 0 0) 0x7f03a40abc10 con 0x7f03b4072880 2024-09-15T23:16:47.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.441+0000 7f2046ffd640 1 --2- 172.21.15.123:0/2632587412 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f203806c4e0 0x7f203806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.441+0000 7f4105ffb640 1 -- 172.21.15.123:0/759948687 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f410c044020 con 0x7f41100cf2d0 2024-09-15T23:16:47.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.441+0000 7f467d51a640 1 --2- 172.21.15.123:0/2319591311 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f465c06c2b0 0x7f465c06e770 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4678161080 tx=0x7f4668009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:47.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.441+0000 7f2046ffd640 1 -- 172.21.15.123:0/2632587412 <== mon.1 v2:172.21.15.188:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5709+0+0 (secure 0 0 0) 0x7f20480ab590 con 0x7f20580b66b0 2024-09-15T23:16:47.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.441+0000 7f2055d9b640 1 --2- 172.21.15.123:0/2632587412 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f203806c4e0 0x7f203806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.441+0000 7f03b27fc640 1 --2- 172.21.15.123:0/2086214988 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f03a006c2b0 0x7f03a006e770 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f03b40ae810 tx=0x7f03a8009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:47.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.441+0000 7f4105ffb640 1 --2- 172.21.15.123:0/759948687 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f40f406c6b0 0x7f40f406eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:47.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.442+0000 7f4105ffb640 1 -- 172.21.15.123:0/759948687 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(98..98 src has 1..98) ==== 5709+0+0 (secure 0 0 0) 0x7f410c03d420 con 0x7f41100cf2d0 2024-09-15T23:16:47.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.442+0000 7f4114ee4640 1 --2- 172.21.15.123:0/759948687 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f40f406c6b0 0x7f40f406eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:47.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.442+0000 7f2055d9b640 1 --2- 172.21.15.123:0/2632587412 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f203806c4e0 0x7f203806e9a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f20580cf5e0 tx=0x7f204c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:47.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.442+0000 7f4114ee4640 1 --2- 172.21.15.123:0/759948687 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f40f406c6b0 0x7f40f406eb70 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f41100cb370 tx=0x7f4100008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:47.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.446+0000 7f466e7fc640 1 -- 172.21.15.123:0/2319591311 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f467404b030 con 0x7f46780cf2d0 2024-09-15T23:16:47.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.446+0000 7f4105ffb640 1 -- 172.21.15.123:0/759948687 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f410c04b030 con 0x7f41100cf2d0 2024-09-15T23:16:47.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.450+0000 7f039b7fe640 1 -- 172.21.15.123:0/2086214988 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f03a4079db0 con 0x7f03b4072880 2024-09-15T23:16:47.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.450+0000 7f2046ffd640 1 -- 172.21.15.123:0/2632587412 <== mon.1 v2:172.21.15.188:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f204804b030 con 0x7f20580b66b0 2024-09-15T23:16:47.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.688+0000 7f467ff7f640 1 -- 172.21.15.123:0/2319591311 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) -- 0x7f46780b3f20 con 0x7f46780cf2d0 2024-09-15T23:16:47.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.688+0000 7f4117949640 1 -- 172.21.15.123:0/759948687 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) -- 0x7f40f0005850 con 0x7f41100cf2d0 2024-09-15T23:16:47.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.691+0000 7f03b947b640 1 -- 172.21.15.123:0/2086214988 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) -- 0x7f03b4153d00 con 0x7f03b4072880 2024-09-15T23:16:47.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.694+0000 7f205ce96640 1 -- 172.21.15.123:0/2632587412 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) -- 0x7f20580ba7b0 con 0x7f20580b66b0 2024-09-15T23:16:47.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.807+0000 7f466e7fc640 1 -- 172.21.15.123:0/2319591311 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 7134 v60) ==== 95+0+0 (secure 0 0 0) 0x7f4674079b30 con 0x7f46780cf2d0 2024-09-15T23:16:47.809 INFO:teuthology.orchestra.run.smithi123.stderr:failed mds gid 7134 2024-09-15T23:16:47.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.809+0000 7f467ff7f640 1 -- 172.21.15.123:0/2319591311 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f465c06c2b0 msgr2=0x7f465c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:47.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.809+0000 7f467ff7f640 1 --2- 172.21.15.123:0/2319591311 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f465c06c2b0 0x7f465c06e770 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4678161080 tx=0x7f4668009190 comp rx=0 tx=0).stop 2024-09-15T23:16:47.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.809+0000 7f467ff7f640 1 -- 172.21.15.123:0/2319591311 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46780cf2d0 msgr2=0x7f46781e9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:47.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.809+0000 7f467ff7f640 1 --2- 172.21.15.123:0/2319591311 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46780cf2d0 0x7f46781e9480 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f467402a210 tx=0x7f46740046c0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.809+0000 7f467ff7f640 1 -- 172.21.15.123:0/2319591311 shutdown_connections 2024-09-15T23:16:47.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.809+0000 7f467ff7f640 1 --2- 172.21.15.123:0/2319591311 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f467815ed20 0x7f4678161550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.809+0000 7f467ff7f640 1 --2- 172.21.15.123:0/2319591311 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f465c06c2b0 0x7f465c06e770 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.809+0000 7f467ff7f640 1 --2- 172.21.15.123:0/2319591311 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46780d23b0 0x7f46780cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.809+0000 7f467ff7f640 1 --2- 172.21.15.123:0/2319591311 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46780cf2d0 0x7f46781e9480 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.809+0000 7f467ff7f640 1 -- 172.21.15.123:0/2319591311 >> 172.21.15.123:0/2319591311 conn(0x7f46780d1260 msgr2=0x7f46780d1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:47.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.810+0000 7f467ff7f640 1 -- 172.21.15.123:0/2319591311 shutdown_connections 2024-09-15T23:16:47.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.810+0000 7f467ff7f640 1 -- 172.21.15.123:0/2319591311 wait complete. 2024-09-15T23:16:47.813 INFO:tasks.ceph.mon.a.smithi123.stderr:2024-09-15T23:16:47.810+0000 7f8a6a4eb640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:16:47.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.822+0000 7f4105ffb640 1 -- 172.21.15.123:0/759948687 <== mon.2 v2:172.21.15.188:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 7131 v61) ==== 95+0+0 (secure 0 0 0) 0x7f410c04b030 con 0x7f41100cf2d0 2024-09-15T23:16:47.824 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T23:16:47.825 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T23:16:47.825 INFO:teuthology.orchestra.run.smithi123.stderr:failed mds gid 7131 2024-09-15T23:16:47.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.822+0000 7f039b7fe640 1 -- 172.21.15.123:0/2086214988 <== mon.2 v2:172.21.15.188:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 7149 v61) ==== 95+0+0 (secure 0 0 0) 0x7f03a407e0b0 con 0x7f03b4072880 2024-09-15T23:16:47.826 INFO:teuthology.orchestra.run.smithi123.stderr:failed mds gid 7149 2024-09-15T23:16:47.828 INFO:tasks.ceph.mds.a:Started 2024-09-15T23:16:47.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.825+0000 7f03b947b640 1 -- 172.21.15.123:0/2086214988 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f03a006c2b0 msgr2=0x7f03a006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:47.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.825+0000 7f03b947b640 1 --2- 172.21.15.123:0/2086214988 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f03a006c2b0 0x7f03a006e770 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f03b40ae810 tx=0x7f03a8009190 comp rx=0 tx=0).stop 2024-09-15T23:16:47.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.825+0000 7f03b947b640 1 -- 172.21.15.123:0/2086214988 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f03b4072880 msgr2=0x7f03b40ad1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:47.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.825+0000 7f03b947b640 1 --2- 172.21.15.123:0/2086214988 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f03b4072880 0x7f03b40ad1d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f03a4035040 tx=0x7f03a40046c0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.826+0000 7f03b947b640 1 -- 172.21.15.123:0/2086214988 shutdown_connections 2024-09-15T23:16:47.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.826+0000 7f03b947b640 1 --2- 172.21.15.123:0/2086214988 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f03b415acc0 0x7f03b414f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.826+0000 7f03b947b640 1 --2- 172.21.15.123:0/2086214988 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f03a006c2b0 0x7f03a006e770 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.826+0000 7f03b947b640 1 --2- 172.21.15.123:0/2086214988 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f03b4072c60 0x7f03b414f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.826+0000 7f03b947b640 1 --2- 172.21.15.123:0/2086214988 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f03b4072880 0x7f03b40ad1d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.826+0000 7f03b947b640 1 -- 172.21.15.123:0/2086214988 >> 172.21.15.123:0/2086214988 conn(0x7f03b406cb50 msgr2=0x7f03b406f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:47.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.826+0000 7f03b947b640 1 -- 172.21.15.123:0/2086214988 shutdown_connections 2024-09-15T23:16:47.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.826+0000 7f03b947b640 1 -- 172.21.15.123:0/2086214988 wait complete. 2024-09-15T23:16:47.830 DEBUG:teuthology.parallel:result is None 2024-09-15T23:16:47.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.826+0000 7f4117949640 1 -- 172.21.15.123:0/759948687 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f40f406c6b0 msgr2=0x7f40f406eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:47.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.826+0000 7f4117949640 1 --2- 172.21.15.123:0/759948687 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f40f406c6b0 0x7f40f406eb70 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f41100cb370 tx=0x7f4100008040 comp rx=0 tx=0).stop 2024-09-15T23:16:47.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.826+0000 7f4117949640 1 -- 172.21.15.123:0/759948687 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f41100cf2d0 msgr2=0x7f41101f5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:47.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.826+0000 7f4117949640 1 --2- 172.21.15.123:0/759948687 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f41100cf2d0 0x7f41101f5700 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f410c031000 tx=0x7f410c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.826+0000 7f4117949640 1 -- 172.21.15.123:0/759948687 shutdown_connections 2024-09-15T23:16:47.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.826+0000 7f4117949640 1 --2- 172.21.15.123:0/759948687 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f411015ed20 0x7f411015ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.826+0000 7f4117949640 1 --2- 172.21.15.123:0/759948687 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f40f406c6b0 0x7f40f406eb70 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.826+0000 7f4117949640 1 --2- 172.21.15.123:0/759948687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41100d23b0 0x7f41100acd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.826+0000 7f4117949640 1 --2- 172.21.15.123:0/759948687 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f41100cf2d0 0x7f41101f5700 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:47.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.826+0000 7f4117949640 1 -- 172.21.15.123:0/759948687 >> 172.21.15.123:0/759948687 conn(0x7f41100d1260 msgr2=0x7f41100d1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:47.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.826+0000 7f4117949640 1 -- 172.21.15.123:0/759948687 shutdown_connections 2024-09-15T23:16:47.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:47.826+0000 7f4117949640 1 -- 172.21.15.123:0/759948687 wait complete. 2024-09-15T23:16:47.841 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T23:16:47.842 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T23:16:47.842 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T23:16:47.843 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T23:16:47.845 INFO:tasks.ceph.mds.b:Started 2024-09-15T23:16:47.845 DEBUG:teuthology.parallel:result is None 2024-09-15T23:16:47.884 INFO:tasks.ceph.mds.c:Started 2024-09-15T23:16:47.884 DEBUG:teuthology.parallel:result is None 2024-09-15T23:16:47.902 INFO:tasks.ceph.mds.a.smithi123.stdout:starting mds.a at 2024-09-15T23:16:47.924 INFO:tasks.ceph.mds.b.smithi188.stdout:starting mds.b at 2024-09-15T23:16:47.958 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-15T23:16:48.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.820+0000 7f2046ffd640 1 -- 172.21.15.123:0/2632587412 <== mon.1 v2:172.21.15.188:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 7146 v62) ==== 95+0+0 (secure 0 0 0) 0x7f2048079740 con 0x7f20580b66b0 2024-09-15T23:16:48.822 INFO:teuthology.orchestra.run.smithi123.stderr:failed mds gid 7146 2024-09-15T23:16:48.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.823+0000 7f205ce96640 1 -- 172.21.15.123:0/2632587412 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f203806c4e0 msgr2=0x7f203806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:48.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.823+0000 7f205ce96640 1 --2- 172.21.15.123:0/2632587412 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f203806c4e0 0x7f203806e9a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f20580cf5e0 tx=0x7f204c009190 comp rx=0 tx=0).stop 2024-09-15T23:16:48.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.823+0000 7f205ce96640 1 -- 172.21.15.123:0/2632587412 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20580b66b0 msgr2=0x7f20580ccc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:48.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.823+0000 7f205ce96640 1 --2- 172.21.15.123:0/2632587412 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20580b66b0 0x7f20580ccc20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2048031000 tx=0x7f20480046c0 comp rx=0 tx=0).stop 2024-09-15T23:16:48.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.823+0000 7f205ce96640 1 -- 172.21.15.123:0/2632587412 shutdown_connections 2024-09-15T23:16:48.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.823+0000 7f205ce96640 1 --2- 172.21.15.123:0/2632587412 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f203806c4e0 0x7f203806e9a0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:48.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.823+0000 7f205ce96640 1 --2- 172.21.15.123:0/2632587412 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2058162490 0x7f2058159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:48.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.823+0000 7f205ce96640 1 --2- 172.21.15.123:0/2632587412 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f205815eab0 0x7f20580c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:48.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.824+0000 7f205ce96640 1 --2- 172.21.15.123:0/2632587412 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20580b66b0 0x7f20580ccc20 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:48.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.824+0000 7f205ce96640 1 -- 172.21.15.123:0/2632587412 >> 172.21.15.123:0/2632587412 conn(0x7f20580d16d0 msgr2=0x7f20580b50f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:48.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.824+0000 7f205ce96640 1 -- 172.21.15.123:0/2632587412 shutdown_connections 2024-09-15T23:16:48.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.824+0000 7f205ce96640 1 -- 172.21.15.123:0/2632587412 wait complete. 2024-09-15T23:16:48.841 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T23:16:48.841 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T23:16:48.843 INFO:tasks.ceph.mds.d:Started 2024-09-15T23:16:48.844 DEBUG:teuthology.parallel:result is None 2024-09-15T23:16:48.844 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:16:48.921 INFO:tasks.ceph.mds.d.smithi188.stdout:starting mds.d at 2024-09-15T23:16:48.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.984+0000 7f1f549c4640 1 Processor -- start 2024-09-15T23:16:48.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.984+0000 7f1f549c4640 1 -- start start 2024-09-15T23:16:48.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.985+0000 7f1f549c4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1f5006c320 0x7f1f5015bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:48.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.985+0000 7f1f549c4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f5013eb20 0x7f1f5015c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:48.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.985+0000 7f1f549c4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f50071180 con 0x7f1f500b2d40 2024-09-15T23:16:48.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.985+0000 7f1f549c4640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f1f50071ab0 con 0x7f1f5006c320 2024-09-15T23:16:48.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.985+0000 7f1f549c4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1f50071460 con 0x7f1f5013eb20 2024-09-15T23:16:48.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.985+0000 7f1f4dd9b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1f5006c320 0x7f1f5015bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:48.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.985+0000 7f1f4dd9b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1f5006c320 0x7f1f5015bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47746/0 (socket says 172.21.15.123:47746) 2024-09-15T23:16:48.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.985+0000 7f1f4dd9b640 1 -- 172.21.15.123:0/725080256 learned_addr learned my addr 172.21.15.123:0/725080256 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:48.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.985+0000 7f1f4e59c640 1 --1- 172.21.15.123:0/725080256 >> v1:172.21.15.123:6789/0 conn(0x7f1f500b2d40 0x7f1f5006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51542/0 (socket says 172.21.15.123:51542) 2024-09-15T23:16:48.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.986+0000 7f1f4ed9d640 1 --2- 172.21.15.123:0/725080256 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f5013eb20 0x7f1f5015c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:48.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.986+0000 7f1f4dd9b640 1 -- 172.21.15.123:0/725080256 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f5013eb20 msgr2=0x7f1f5015c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:48.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.986+0000 7f1f4dd9b640 1 --2- 172.21.15.123:0/725080256 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f5013eb20 0x7f1f5015c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:48.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.986+0000 7f1f4dd9b640 1 -- 172.21.15.123:0/725080256 >> v1:172.21.15.123:6789/0 conn(0x7f1f500b2d40 legacy=0x7f1f5006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:48.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.986+0000 7f1f4dd9b640 1 -- 172.21.15.123:0/725080256 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f50071740 con 0x7f1f5006c320 2024-09-15T23:16:48.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.986+0000 7f1f4d59a640 1 -- 172.21.15.123:0/725080256 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2201177612 0 0) 0x7f1f50071180 con 0x7f1f500b2d40 2024-09-15T23:16:48.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.986+0000 7f1f4ed9d640 1 --2- 172.21.15.123:0/725080256 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f5013eb20 0x7f1f5015c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:16:48.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.986+0000 7f1f4dd9b640 1 --2- 172.21.15.123:0/725080256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f5006c320 0x7f1f5015bcf0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f1f38009870 tx=0x7f1f3802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc97e50b7e463cf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:48.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.987+0000 7f1f4d59a640 1 -- 172.21.15.123:0/725080256 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f38037070 con 0x7f1f5006c320 2024-09-15T23:16:48.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.987+0000 7f1f4d59a640 1 -- 172.21.15.123:0/725080256 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f38032440 con 0x7f1f5006c320 2024-09-15T23:16:48.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.987+0000 7f1f4d59a640 1 -- 172.21.15.123:0/725080256 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f38032810 con 0x7f1f5006c320 2024-09-15T23:16:48.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.987+0000 7f1f549c4640 1 -- 172.21.15.123:0/725080256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f5006c320 msgr2=0x7f1f5015bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:48.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.987+0000 7f1f549c4640 1 --2- 172.21.15.123:0/725080256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f5006c320 0x7f1f5015bcf0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f1f38009870 tx=0x7f1f3802a270 comp rx=0 tx=0).stop 2024-09-15T23:16:48.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.987+0000 7f1f549c4640 1 -- 172.21.15.123:0/725080256 shutdown_connections 2024-09-15T23:16:48.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.987+0000 7f1f549c4640 1 --2- 172.21.15.123:0/725080256 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f5013eb20 0x7f1f5015c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:48.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.987+0000 7f1f549c4640 1 --2- 172.21.15.123:0/725080256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f5006c320 0x7f1f5015bcf0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:48.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.987+0000 7f1f549c4640 1 -- 172.21.15.123:0/725080256 >> 172.21.15.123:0/725080256 conn(0x7f1f500ccec0 msgr2=0x7f1f500cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:48.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.987+0000 7f1f549c4640 1 -- 172.21.15.123:0/725080256 shutdown_connections 2024-09-15T23:16:48.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.987+0000 7f1f549c4640 1 -- 172.21.15.123:0/725080256 wait complete. 2024-09-15T23:16:48.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.989+0000 7f1f549c4640 1 Processor -- start 2024-09-15T23:16:48.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.989+0000 7f1f549c4640 1 -- start start 2024-09-15T23:16:48.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.989+0000 7f1f549c4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f5006c320 0x7f1f5013de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:48.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.989+0000 7f1f549c4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f500b2d40 0x7f1f500c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:48.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.989+0000 7f1f549c4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f5013eb20 0x7f1f500c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:48.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.989+0000 7f1f549c4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1f500720c0 con 0x7f1f500b2d40 2024-09-15T23:16:48.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.989+0000 7f1f549c4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1f50071f40 con 0x7f1f5013eb20 2024-09-15T23:16:48.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.989+0000 7f1f549c4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1f50072240 con 0x7f1f5006c320 2024-09-15T23:16:48.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.990+0000 7f1f4dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f500b2d40 0x7f1f500c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:48.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.990+0000 7f1f4dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f500b2d40 0x7f1f500c6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47750/0 (socket says 172.21.15.123:47750) 2024-09-15T23:16:48.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.990+0000 7f1f4dd9b640 1 -- 172.21.15.123:0/4119958643 learned_addr learned my addr 172.21.15.123:0/4119958643 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:48.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.990+0000 7f1f4dd9b640 1 -- 172.21.15.123:0/4119958643 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f5006c320 msgr2=0x7f1f5013de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:48.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.990+0000 7f1f4ed9d640 1 --2- 172.21.15.123:0/4119958643 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f5013eb20 0x7f1f500c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:48.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.990+0000 7f1f4e59c640 1 --2- 172.21.15.123:0/4119958643 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f5006c320 0x7f1f5013de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:48.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.990+0000 7f1f4dd9b640 1 --2- 172.21.15.123:0/4119958643 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f5006c320 0x7f1f5013de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:48.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.990+0000 7f1f4dd9b640 1 -- 172.21.15.123:0/4119958643 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f5013eb20 msgr2=0x7f1f500c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:48.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.990+0000 7f1f4dd9b640 1 --2- 172.21.15.123:0/4119958643 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f5013eb20 0x7f1f500c53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:48.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.990+0000 7f1f4dd9b640 1 -- 172.21.15.123:0/4119958643 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f500c5920 con 0x7f1f500b2d40 2024-09-15T23:16:48.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.990+0000 7f1f4dd9b640 1 --2- 172.21.15.123:0/4119958643 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f500b2d40 0x7f1f500c6c60 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f1f38000c00 tx=0x7f1f380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:48.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.990+0000 7f1f46ffd640 1 -- 172.21.15.123:0/4119958643 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f38041020 con 0x7f1f500b2d40 2024-09-15T23:16:48.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.990+0000 7f1f46ffd640 1 -- 172.21.15.123:0/4119958643 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f380306c0 con 0x7f1f500b2d40 2024-09-15T23:16:48.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.990+0000 7f1f549c4640 1 -- 172.21.15.123:0/4119958643 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f500c5bc0 con 0x7f1f500b2d40 2024-09-15T23:16:48.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.990+0000 7f1f46ffd640 1 -- 172.21.15.123:0/4119958643 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f38037040 con 0x7f1f500b2d40 2024-09-15T23:16:48.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.990+0000 7f1f549c4640 1 -- 172.21.15.123:0/4119958643 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f500c6180 con 0x7f1f500b2d40 2024-09-15T23:16:48.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.991+0000 7f1f549c4640 1 -- 172.21.15.123:0/4119958643 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f5006bc10 con 0x7f1f500b2d40 2024-09-15T23:16:48.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.992+0000 7f1f46ffd640 1 -- 172.21.15.123:0/4119958643 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1f38044020 con 0x7f1f500b2d40 2024-09-15T23:16:48.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.992+0000 7f1f46ffd640 1 --2- 172.21.15.123:0/4119958643 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1f3006c2b0 0x7f1f3006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:48.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.992+0000 7f1f46ffd640 1 -- 172.21.15.123:0/4119958643 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5795+0+0 (secure 0 0 0) 0x7f1f380ab940 con 0x7f1f500b2d40 2024-09-15T23:16:48.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.992+0000 7f1f4e59c640 1 --2- 172.21.15.123:0/4119958643 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1f3006c2b0 0x7f1f3006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:48.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.993+0000 7f1f4e59c640 1 --2- 172.21.15.123:0/4119958643 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1f3006c2b0 0x7f1f3006e770 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1f400012e0 tx=0x7f1f40009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:48.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:48.997+0000 7f1f46ffd640 1 -- 172.21.15.123:0/4119958643 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1f3804b070 con 0x7f1f500b2d40 2024-09-15T23:16:49.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:49.194+0000 7f1f549c4640 1 -- 172.21.15.123:0/4119958643 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f500739c0 con 0x7f1f500b2d40 2024-09-15T23:16:49.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:49.195+0000 7f1f46ffd640 1 -- 172.21.15.123:0/4119958643 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+4401 (secure 0 0 0) 0x7f1f3807a050 con 0x7f1f500b2d40 2024-09-15T23:16:49.196 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:16:49.196 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":63,"btime":"2024-09-15T23:16:48:821319+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6556,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/488079964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":488079964},{"type":"v1","addr":"172.21.15.188:6835","nonce":488079964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":7356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/2179085155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2179085155},{"type":"v1","addr":"172.21.15.123:6833","nonce":2179085155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:16:35.080780+0000","modified":"2024-09-15T23:16:48.821304+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7365":{"gid":7365,"name":"c","rank":0,"incarnation":63,"state":"up:replay","state_seq":1,"addr":"172.21.15.123:6835/2621254224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2621254224},{"type":"v1","addr":"172.21.15.123:6835","nonce":2621254224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-15T23:16:49.197 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 63 2024-09-15T23:16:49.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:49.197+0000 7f1f549c4640 1 -- 172.21.15.123:0/4119958643 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1f3006c2b0 msgr2=0x7f1f3006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:49.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:49.197+0000 7f1f549c4640 1 --2- 172.21.15.123:0/4119958643 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1f3006c2b0 0x7f1f3006e770 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1f400012e0 tx=0x7f1f40009040 comp rx=0 tx=0).stop 2024-09-15T23:16:49.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:49.197+0000 7f1f549c4640 1 -- 172.21.15.123:0/4119958643 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f500b2d40 msgr2=0x7f1f500c6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:49.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:49.197+0000 7f1f549c4640 1 --2- 172.21.15.123:0/4119958643 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f500b2d40 0x7f1f500c6c60 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f1f38000c00 tx=0x7f1f380046c0 comp rx=0 tx=0).stop 2024-09-15T23:16:49.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:49.197+0000 7f1f549c4640 1 -- 172.21.15.123:0/4119958643 shutdown_connections 2024-09-15T23:16:49.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:49.197+0000 7f1f549c4640 1 --2- 172.21.15.123:0/4119958643 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1f5013eb20 0x7f1f500c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:49.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:49.197+0000 7f1f549c4640 1 --2- 172.21.15.123:0/4119958643 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1f3006c2b0 0x7f1f3006e770 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:49.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:49.197+0000 7f1f549c4640 1 --2- 172.21.15.123:0/4119958643 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f500b2d40 0x7f1f500c6c60 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:49.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:49.197+0000 7f1f549c4640 1 --2- 172.21.15.123:0/4119958643 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1f5006c320 0x7f1f5013de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:49.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:49.197+0000 7f1f549c4640 1 -- 172.21.15.123:0/4119958643 >> 172.21.15.123:0/4119958643 conn(0x7f1f500ccec0 msgr2=0x7f1f50157900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:49.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:49.197+0000 7f1f549c4640 1 -- 172.21.15.123:0/4119958643 shutdown_connections 2024-09-15T23:16:49.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:49.197+0000 7f1f549c4640 1 -- 172.21.15.123:0/4119958643 wait complete. 2024-09-15T23:16:49.612 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 63, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:16:35.080780+0000', 'modified': '2024-09-15T23:16:48.821304+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 101, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7365}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7365': {'gid': 7365, 'name': 'c', 'rank': 0, 'incarnation': 63, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.123:6835/2621254224', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6834', 'nonce': 2621254224}, {'type': 'v1', 'addr': '172.21.15.123:6835', 'nonce': 2621254224}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-15T23:16:49.612 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7365:up:replay 2024-09-15T23:16:50.613 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:16:50.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.721+0000 7fb559f28640 1 Processor -- start 2024-09-15T23:16:50.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.721+0000 7fb559f28640 1 -- start start 2024-09-15T23:16:50.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.722+0000 7fb559f28640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5540b2d40 0x7fb55406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:50.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.722+0000 7fb559f28640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb55406c150 0x7fb55415c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:50.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.722+0000 7fb559f28640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb554071180 con 0x7fb55413eb20 2024-09-15T23:16:50.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.722+0000 7fb559f28640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fb554071ab0 con 0x7fb55406c150 2024-09-15T23:16:50.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.722+0000 7fb559f28640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb554071460 con 0x7fb5540b2d40 2024-09-15T23:16:50.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.722+0000 7fb553fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb55406c150 0x7fb55415c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:50.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.722+0000 7fb552ffd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb55413eb20 0x7fb55415bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51556/0 (socket says 172.21.15.123:51556) 2024-09-15T23:16:50.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.722+0000 7fb552ffd640 1 -- 172.21.15.123:0/2256798648 learned_addr learned my addr 172.21.15.123:0/2256798648 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:50.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.723+0000 7fb553fff640 1 -- 172.21.15.123:0/2256798648 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5540b2d40 msgr2=0x7fb55406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:50.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.723+0000 7fb5537fe640 1 --2- 172.21.15.123:0/2256798648 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5540b2d40 0x7fb55406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:50.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.723+0000 7fb553fff640 1 --2- 172.21.15.123:0/2256798648 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5540b2d40 0x7fb55406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:50.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.723+0000 7fb5527fc640 1 -- 172.21.15.123:0/2256798648 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1023432424 0 0) 0x7fb554071180 con 0x7fb55413eb20 2024-09-15T23:16:50.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.723+0000 7fb553fff640 1 -- 172.21.15.123:0/2256798648 >> v1:172.21.15.123:6789/0 conn(0x7fb55413eb20 legacy=0x7fb55415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:50.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.723+0000 7fb553fff640 1 -- 172.21.15.123:0/2256798648 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb554071740 con 0x7fb55406c150 2024-09-15T23:16:50.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.723+0000 7fb5537fe640 1 --2- 172.21.15.123:0/2256798648 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5540b2d40 0x7fb55406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:16:50.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.723+0000 7fb553fff640 1 --2- 172.21.15.123:0/2256798648 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb55406c150 0x7fb55415c400 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fb554071c30 tx=0x7fb54c02a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b21439fdd3ad6eb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:50.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.723+0000 7fb5527fc640 1 -- 172.21.15.123:0/2256798648 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c02ae60 con 0x7fb55406c150 2024-09-15T23:16:50.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.724+0000 7fb5527fc640 1 -- 172.21.15.123:0/2256798648 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb54c007740 con 0x7fb55406c150 2024-09-15T23:16:50.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.724+0000 7fb5527fc640 1 -- 172.21.15.123:0/2256798648 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c007b10 con 0x7fb55406c150 2024-09-15T23:16:50.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.724+0000 7fb559f28640 1 -- 172.21.15.123:0/2256798648 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb55406c150 msgr2=0x7fb55415c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:50.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.724+0000 7fb559f28640 1 --2- 172.21.15.123:0/2256798648 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb55406c150 0x7fb55415c400 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fb554071c30 tx=0x7fb54c02a640 comp rx=0 tx=0).stop 2024-09-15T23:16:50.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.724+0000 7fb559f28640 1 -- 172.21.15.123:0/2256798648 shutdown_connections 2024-09-15T23:16:50.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.724+0000 7fb559f28640 1 --2- 172.21.15.123:0/2256798648 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb55406c150 0x7fb55415c400 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:50.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.724+0000 7fb559f28640 1 --2- 172.21.15.123:0/2256798648 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5540b2d40 0x7fb55406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:50.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.724+0000 7fb559f28640 1 -- 172.21.15.123:0/2256798648 >> 172.21.15.123:0/2256798648 conn(0x7fb5540ccec0 msgr2=0x7fb5540cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:50.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.724+0000 7fb559f28640 1 -- 172.21.15.123:0/2256798648 shutdown_connections 2024-09-15T23:16:50.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.724+0000 7fb559f28640 1 -- 172.21.15.123:0/2256798648 wait complete. 2024-09-15T23:16:50.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.725+0000 7fb559f28640 1 Processor -- start 2024-09-15T23:16:50.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.726+0000 7fb559f28640 1 -- start start 2024-09-15T23:16:50.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.726+0000 7fb559f28640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb55406c150 0x7fb554154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:50.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.726+0000 7fb559f28640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5540b2d40 0x7fb55415bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:50.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.726+0000 7fb559f28640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb55413eb20 0x7fb5540b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:50.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.726+0000 7fb559f28640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb5540722d0 con 0x7fb5540b2d40 2024-09-15T23:16:50.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.726+0000 7fb559f28640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb554072150 con 0x7fb55406c150 2024-09-15T23:16:50.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.726+0000 7fb559f28640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb554072450 con 0x7fb55413eb20 2024-09-15T23:16:50.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.726+0000 7fb552ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5540b2d40 0x7fb55415bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:50.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.726+0000 7fb552ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5540b2d40 0x7fb55415bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47758/0 (socket says 172.21.15.123:47758) 2024-09-15T23:16:50.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.726+0000 7fb552ffd640 1 -- 172.21.15.123:0/2614079336 learned_addr learned my addr 172.21.15.123:0/2614079336 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:50.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.727+0000 7fb5537fe640 1 --2- 172.21.15.123:0/2614079336 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb55406c150 0x7fb554154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:50.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.727+0000 7fb553fff640 1 --2- 172.21.15.123:0/2614079336 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb55413eb20 0x7fb5540b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:50.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.727+0000 7fb552ffd640 1 -- 172.21.15.123:0/2614079336 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb55413eb20 msgr2=0x7fb5540b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:50.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.727+0000 7fb552ffd640 1 --2- 172.21.15.123:0/2614079336 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb55413eb20 0x7fb5540b3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:50.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.727+0000 7fb552ffd640 1 -- 172.21.15.123:0/2614079336 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb55406c150 msgr2=0x7fb554154310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:50.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.727+0000 7fb552ffd640 1 --2- 172.21.15.123:0/2614079336 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb55406c150 0x7fb554154310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:50.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.727+0000 7fb552ffd640 1 -- 172.21.15.123:0/2614079336 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb554155f00 con 0x7fb5540b2d40 2024-09-15T23:16:50.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.727+0000 7fb553fff640 1 --2- 172.21.15.123:0/2614079336 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb55413eb20 0x7fb5540b3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:16:50.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.727+0000 7fb5537fe640 1 --2- 172.21.15.123:0/2614079336 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb55406c150 0x7fb554154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:16:50.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.727+0000 7fb552ffd640 1 --2- 172.21.15.123:0/2614079336 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5540b2d40 0x7fb55415bff0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fb54800c410 tx=0x7fb54800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:50.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.727+0000 7fb53bfff640 1 -- 172.21.15.123:0/2614079336 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5480074e0 con 0x7fb5540b2d40 2024-09-15T23:16:50.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.727+0000 7fb53bfff640 1 -- 172.21.15.123:0/2614079336 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5480047e0 con 0x7fb5540b2d40 2024-09-15T23:16:50.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.727+0000 7fb53bfff640 1 -- 172.21.15.123:0/2614079336 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb548004bd0 con 0x7fb5540b2d40 2024-09-15T23:16:50.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.727+0000 7fb559f28640 1 -- 172.21.15.123:0/2614079336 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5541561e0 con 0x7fb5540b2d40 2024-09-15T23:16:50.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.727+0000 7fb559f28640 1 -- 172.21.15.123:0/2614079336 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5541567a0 con 0x7fb5540b2d40 2024-09-15T23:16:50.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.728+0000 7fb559f28640 1 -- 172.21.15.123:0/2614079336 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5540d1550 con 0x7fb5540b2d40 2024-09-15T23:16:50.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.728+0000 7fb53bfff640 1 -- 172.21.15.123:0/2614079336 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb548011070 con 0x7fb5540b2d40 2024-09-15T23:16:50.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.729+0000 7fb53bfff640 1 --2- 172.21.15.123:0/2614079336 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb54006c2b0 0x7fb54006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:50.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.729+0000 7fb53bfff640 1 -- 172.21.15.123:0/2614079336 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5795+0+0 (secure 0 0 0) 0x7fb54808b130 con 0x7fb5540b2d40 2024-09-15T23:16:50.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.729+0000 7fb5537fe640 1 --2- 172.21.15.123:0/2614079336 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb54006c2b0 0x7fb54006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:50.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.730+0000 7fb5537fe640 1 --2- 172.21.15.123:0/2614079336 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb54006c2b0 0x7fb54006e770 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb5540b3d30 tx=0x7fb544008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:50.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.733+0000 7fb53bfff640 1 -- 172.21.15.123:0/2614079336 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb5540d1550 con 0x7fb5540b2d40 2024-09-15T23:16:50.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.935+0000 7fb559f28640 1 -- 172.21.15.123:0/2614079336 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb55406bc10 con 0x7fb5540b2d40 2024-09-15T23:16:50.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.936+0000 7fb53bfff640 1 -- 172.21.15.123:0/2614079336 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+5229 (secure 0 0 0) 0x7fb54800e280 con 0x7fb5540b2d40 2024-09-15T23:16:50.937 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:16:50.938 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":65,"btime":"2024-09-15T23:16:50:829772+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6556,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/488079964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":488079964},{"type":"v1","addr":"172.21.15.188:6835","nonce":488079964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/4123673242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":4123673242},{"type":"v1","addr":"172.21.15.188:6837","nonce":4123673242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":7356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/2179085155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2179085155},{"type":"v1","addr":"172.21.15.123:6833","nonce":2179085155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:16:35.080780+0000","modified":"2024-09-15T23:16:49.831023+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7365":{"gid":7365,"name":"c","rank":0,"incarnation":63,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.123:6835/2621254224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2621254224},{"type":"v1","addr":"172.21.15.123:6835","nonce":2621254224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":6}]} 2024-09-15T23:16:50.938 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 65 2024-09-15T23:16:50.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.938+0000 7fb559f28640 1 -- 172.21.15.123:0/2614079336 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb54006c2b0 msgr2=0x7fb54006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:50.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.938+0000 7fb559f28640 1 --2- 172.21.15.123:0/2614079336 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb54006c2b0 0x7fb54006e770 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb5540b3d30 tx=0x7fb544008040 comp rx=0 tx=0).stop 2024-09-15T23:16:50.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.938+0000 7fb559f28640 1 -- 172.21.15.123:0/2614079336 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5540b2d40 msgr2=0x7fb55415bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:50.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.938+0000 7fb559f28640 1 --2- 172.21.15.123:0/2614079336 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5540b2d40 0x7fb55415bff0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fb54800c410 tx=0x7fb54800c8d0 comp rx=0 tx=0).stop 2024-09-15T23:16:50.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.938+0000 7fb559f28640 1 -- 172.21.15.123:0/2614079336 shutdown_connections 2024-09-15T23:16:50.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.938+0000 7fb559f28640 1 --2- 172.21.15.123:0/2614079336 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb55413eb20 0x7fb5540b3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:50.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.938+0000 7fb559f28640 1 --2- 172.21.15.123:0/2614079336 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb54006c2b0 0x7fb54006e770 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:50.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.938+0000 7fb559f28640 1 --2- 172.21.15.123:0/2614079336 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5540b2d40 0x7fb55415bff0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:50.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.938+0000 7fb559f28640 1 --2- 172.21.15.123:0/2614079336 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb55406c150 0x7fb554154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:50.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.938+0000 7fb559f28640 1 -- 172.21.15.123:0/2614079336 >> 172.21.15.123:0/2614079336 conn(0x7fb5540ccec0 msgr2=0x7fb5540728b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:50.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.938+0000 7fb559f28640 1 -- 172.21.15.123:0/2614079336 shutdown_connections 2024-09-15T23:16:50.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:50.938+0000 7fb559f28640 1 -- 172.21.15.123:0/2614079336 wait complete. 2024-09-15T23:16:51.352 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 65, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:16:35.080780+0000', 'modified': '2024-09-15T23:16:49.831023+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 101, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7365}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7365': {'gid': 7365, 'name': 'c', 'rank': 0, 'incarnation': 63, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.123:6835/2621254224', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6834', 'nonce': 2621254224}, {'type': 'v1', 'addr': '172.21.15.123:6835', 'nonce': 2621254224}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-15T23:16:51.353 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7365:up:rejoin 2024-09-15T23:16:52.353 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:16:52.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.460+0000 7fe6c3a1e640 1 Processor -- start 2024-09-15T23:16:52.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.460+0000 7fe6c3a1e640 1 -- start start 2024-09-15T23:16:52.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.461+0000 7fe6c3a1e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6bc073330 0x7fe6bc073990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:52.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.461+0000 7fe6c3a1e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe6bc162b10 0x7fe6bc0ce260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:52.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.461+0000 7fe6c3a1e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6bc1632f0 con 0x7fe6bc15e740 2024-09-15T23:16:52.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.461+0000 7fe6c3a1e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fe6bc06d430 con 0x7fe6bc162b10 2024-09-15T23:16:52.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.461+0000 7fe6c3a1e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe6bc06cb00 con 0x7fe6bc073330 2024-09-15T23:16:52.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.462+0000 7fe6c0fb9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6bc073330 0x7fe6bc073990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:52.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.462+0000 7fe6c1fbb640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe6bc162b10 0x7fe6bc0ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:52.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.462+0000 7fe6c0fb9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6bc073330 0x7fe6bc073990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:41748/0 (socket says 172.21.15.123:41748) 2024-09-15T23:16:52.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.462+0000 7fe6c17ba640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fe6bc15e740 0x7fe6bc162400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:50572/0 (socket says 172.21.15.123:50572) 2024-09-15T23:16:52.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.462+0000 7fe6c0fb9640 1 -- 172.21.15.123:0/440429380 learned_addr learned my addr 172.21.15.123:0/440429380 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:52.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.462+0000 7fe6c1fbb640 1 -- 172.21.15.123:0/440429380 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6bc073330 msgr2=0x7fe6bc073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:52.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.462+0000 7fe6c1fbb640 1 --2- 172.21.15.123:0/440429380 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6bc073330 0x7fe6bc073990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:52.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.462+0000 7fe6c1fbb640 1 -- 172.21.15.123:0/440429380 >> v1:172.21.15.188:6789/0 conn(0x7fe6bc15e740 legacy=0x7fe6bc162400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:52.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.462+0000 7fe6c1fbb640 1 -- 172.21.15.123:0/440429380 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6bc06cde0 con 0x7fe6bc162b10 2024-09-15T23:16:52.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.462+0000 7fe6c0fb9640 1 --2- 172.21.15.123:0/440429380 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6bc073330 0x7fe6bc073990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:16:52.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.463+0000 7fe6c1fbb640 1 --2- 172.21.15.123:0/440429380 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6bc162b10 0x7fe6bc0ce260 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc06d5b0 tx=0x7fe6b402a640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7aaccdc0e33f02de server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:52.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.463+0000 7fe6b3fff640 1 -- 172.21.15.123:0/440429380 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b402ae60 con 0x7fe6bc162b10 2024-09-15T23:16:52.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.463+0000 7fe6b3fff640 1 -- 172.21.15.123:0/440429380 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b4007740 con 0x7fe6bc162b10 2024-09-15T23:16:52.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.463+0000 7fe6b3fff640 1 -- 172.21.15.123:0/440429380 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b4007b10 con 0x7fe6bc162b10 2024-09-15T23:16:52.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.463+0000 7fe6c3a1e640 1 -- 172.21.15.123:0/440429380 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6bc162b10 msgr2=0x7fe6bc0ce260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:52.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.463+0000 7fe6c3a1e640 1 --2- 172.21.15.123:0/440429380 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6bc162b10 0x7fe6bc0ce260 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc06d5b0 tx=0x7fe6b402a640 comp rx=0 tx=0).stop 2024-09-15T23:16:52.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.463+0000 7fe6c3a1e640 1 -- 172.21.15.123:0/440429380 shutdown_connections 2024-09-15T23:16:52.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.463+0000 7fe6c3a1e640 1 --2- 172.21.15.123:0/440429380 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6bc162b10 0x7fe6bc0ce260 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:52.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.463+0000 7fe6c3a1e640 1 --2- 172.21.15.123:0/440429380 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6bc073330 0x7fe6bc073990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:52.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.463+0000 7fe6c3a1e640 1 -- 172.21.15.123:0/440429380 >> 172.21.15.123:0/440429380 conn(0x7fe6bc06f400 msgr2=0x7fe6bc06f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:52.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.464+0000 7fe6c3a1e640 1 -- 172.21.15.123:0/440429380 shutdown_connections 2024-09-15T23:16:52.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.464+0000 7fe6c3a1e640 1 -- 172.21.15.123:0/440429380 wait complete. 2024-09-15T23:16:52.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.465+0000 7fe6c3a1e640 1 Processor -- start 2024-09-15T23:16:52.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.465+0000 7fe6c3a1e640 1 -- start start 2024-09-15T23:16:52.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.465+0000 7fe6c3a1e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6bc073330 0x7fe6bc14d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:52.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.465+0000 7fe6c3a1e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6bc15e740 0x7fe6bc0b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:52.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.466+0000 7fe6c3a1e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6bc162b10 0x7fe6bc0b3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:52.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.466+0000 7fe6c3a1e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc162f40 con 0x7fe6bc162b10 2024-09-15T23:16:52.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.466+0000 7fe6c3a1e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc0ae880 con 0x7fe6bc15e740 2024-09-15T23:16:52.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.466+0000 7fe6c3a1e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe6bc0b56c0 con 0x7fe6bc073330 2024-09-15T23:16:52.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.466+0000 7fe6c1fbb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6bc162b10 0x7fe6bc0b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:52.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.466+0000 7fe6c1fbb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6bc162b10 0x7fe6bc0b3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47766/0 (socket says 172.21.15.123:47766) 2024-09-15T23:16:52.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.466+0000 7fe6c1fbb640 1 -- 172.21.15.123:0/49403952 learned_addr learned my addr 172.21.15.123:0/49403952 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:52.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.466+0000 7fe6c0fb9640 1 --2- 172.21.15.123:0/49403952 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6bc15e740 0x7fe6bc0b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:52.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.466+0000 7fe6c17ba640 1 --2- 172.21.15.123:0/49403952 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6bc073330 0x7fe6bc14d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:52.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.466+0000 7fe6c1fbb640 1 -- 172.21.15.123:0/49403952 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6bc073330 msgr2=0x7fe6bc14d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:52.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.466+0000 7fe6c1fbb640 1 --2- 172.21.15.123:0/49403952 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6bc073330 0x7fe6bc14d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:52.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.466+0000 7fe6c1fbb640 1 -- 172.21.15.123:0/49403952 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6bc15e740 msgr2=0x7fe6bc0b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:52.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.466+0000 7fe6c1fbb640 1 --2- 172.21.15.123:0/49403952 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6bc15e740 0x7fe6bc0b49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:52.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.466+0000 7fe6c1fbb640 1 -- 172.21.15.123:0/49403952 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6bc0b59a0 con 0x7fe6bc162b10 2024-09-15T23:16:52.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.466+0000 7fe6c0fb9640 1 --2- 172.21.15.123:0/49403952 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6bc15e740 0x7fe6bc0b49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:16:52.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.466+0000 7fe6c1fbb640 1 --2- 172.21.15.123:0/49403952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6bc162b10 0x7fe6bc0b3740 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fe6b402ac30 tx=0x7fe6b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:52.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.466+0000 7fe6b1ffb640 1 -- 172.21.15.123:0/49403952 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b4040070 con 0x7fe6bc162b10 2024-09-15T23:16:52.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.466+0000 7fe6b1ffb640 1 -- 172.21.15.123:0/49403952 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b402ae60 con 0x7fe6bc162b10 2024-09-15T23:16:52.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.466+0000 7fe6b1ffb640 1 -- 172.21.15.123:0/49403952 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b4031c60 con 0x7fe6bc162b10 2024-09-15T23:16:52.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.466+0000 7fe6c3a1e640 1 -- 172.21.15.123:0/49403952 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6bc0b5c80 con 0x7fe6bc162b10 2024-09-15T23:16:52.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.467+0000 7fe6c3a1e640 1 -- 172.21.15.123:0/49403952 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6bc0b6240 con 0x7fe6bc162b10 2024-09-15T23:16:52.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.468+0000 7fe6c3a1e640 1 -- 172.21.15.123:0/49403952 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6bc162220 con 0x7fe6bc162b10 2024-09-15T23:16:52.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.468+0000 7fe6b1ffb640 1 -- 172.21.15.123:0/49403952 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe6b4039040 con 0x7fe6bc162b10 2024-09-15T23:16:52.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.469+0000 7fe6b1ffb640 1 --2- 172.21.15.123:0/49403952 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe6a006c2b0 0x7fe6a006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:52.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.469+0000 7fe6b1ffb640 1 -- 172.21.15.123:0/49403952 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5795+0+0 (secure 0 0 0) 0x7fe6b40ac640 con 0x7fe6bc162b10 2024-09-15T23:16:52.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.469+0000 7fe6c17ba640 1 --2- 172.21.15.123:0/49403952 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe6a006c2b0 0x7fe6a006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:52.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.469+0000 7fe6c17ba640 1 --2- 172.21.15.123:0/49403952 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe6a006c2b0 0x7fe6a006e770 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8007fd0 tx=0x7fe6b8007e80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:52.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.473+0000 7fe6b1ffb640 1 -- 172.21.15.123:0/49403952 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe6bc162220 con 0x7fe6bc162b10 2024-09-15T23:16:52.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.673+0000 7fe6c3a1e640 1 -- 172.21.15.123:0/49403952 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe6bc0b6440 con 0x7fe6bc162b10 2024-09-15T23:16:52.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.673+0000 7fe6b1ffb640 1 -- 172.21.15.123:0/49403952 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5236 (secure 0 0 0) 0x7fe6bc0b6440 con 0x7fe6bc162b10 2024-09-15T23:16:52.675 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:16:52.675 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":66,"btime":"2024-09-15T23:16:51:834717+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6556,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/488079964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":488079964},{"type":"v1","addr":"172.21.15.188:6835","nonce":488079964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/4123673242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":4123673242},{"type":"v1","addr":"172.21.15.188:6837","nonce":4123673242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":7356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/2179085155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2179085155},{"type":"v1","addr":"172.21.15.123:6833","nonce":2179085155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:16:35.080780+0000","modified":"2024-09-15T23:16:51.834712+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7365":{"gid":7365,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6835/2621254224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2621254224},{"type":"v1","addr":"172.21.15.123:6835","nonce":2621254224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7365,"qdb_cluster":[7365]},"id":6}]} 2024-09-15T23:16:52.675 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 66 2024-09-15T23:16:52.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.675+0000 7fe6c3a1e640 1 -- 172.21.15.123:0/49403952 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe6a006c2b0 msgr2=0x7fe6a006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:52.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.675+0000 7fe6c3a1e640 1 --2- 172.21.15.123:0/49403952 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe6a006c2b0 0x7fe6a006e770 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8007fd0 tx=0x7fe6b8007e80 comp rx=0 tx=0).stop 2024-09-15T23:16:52.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.676+0000 7fe6c3a1e640 1 -- 172.21.15.123:0/49403952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6bc162b10 msgr2=0x7fe6bc0b3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:52.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.676+0000 7fe6c3a1e640 1 --2- 172.21.15.123:0/49403952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6bc162b10 0x7fe6bc0b3740 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fe6b402ac30 tx=0x7fe6b4004a40 comp rx=0 tx=0).stop 2024-09-15T23:16:52.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.676+0000 7fe6c3a1e640 1 -- 172.21.15.123:0/49403952 shutdown_connections 2024-09-15T23:16:52.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.676+0000 7fe6c3a1e640 1 --2- 172.21.15.123:0/49403952 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe6a006c2b0 0x7fe6a006e770 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:52.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.676+0000 7fe6c3a1e640 1 --2- 172.21.15.123:0/49403952 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6bc162b10 0x7fe6bc0b3740 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:52.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.676+0000 7fe6c3a1e640 1 --2- 172.21.15.123:0/49403952 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe6bc15e740 0x7fe6bc0b49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:52.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.676+0000 7fe6c3a1e640 1 --2- 172.21.15.123:0/49403952 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe6bc073330 0x7fe6bc14d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:52.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.676+0000 7fe6c3a1e640 1 -- 172.21.15.123:0/49403952 >> 172.21.15.123:0/49403952 conn(0x7fe6bc06f400 msgr2=0x7fe6bc0d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:52.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.676+0000 7fe6c3a1e640 1 -- 172.21.15.123:0/49403952 shutdown_connections 2024-09-15T23:16:52.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:52.676+0000 7fe6c3a1e640 1 -- 172.21.15.123:0/49403952 wait complete. 2024-09-15T23:16:53.090 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:16:35.080780+0000', 'modified': '2024-09-15T23:16:51.834712+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 101, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7365}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7365': {'gid': 7365, 'name': 'c', 'rank': 0, 'incarnation': 63, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.123:6835/2621254224', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6834', 'nonce': 2621254224}, {'type': 'v1', 'addr': '172.21.15.123:6835', 'nonce': 2621254224}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7365, 'qdb_cluster': [7365]} 2024-09-15T23:16:53.090 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:16:53.091 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-15T23:16:53.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.194+0000 7f9b0adbd640 1 Processor -- start 2024-09-15T23:16:53.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.194+0000 7f9b0adbd640 1 -- start start 2024-09-15T23:16:53.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.195+0000 7f9b0adbd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f9b0406cd20 0x7f9b040b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.195+0000 7f9b0adbd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9b04070b80 0x7f9b040b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.195+0000 7f9b0adbd640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b0415eab0 con 0x7f9b0415e6d0 2024-09-15T23:16:53.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.195+0000 7f9b0adbd640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f9b040b77e0 con 0x7f9b04070b80 2024-09-15T23:16:53.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.195+0000 7f9b0adbd640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f9b0415ed70 con 0x7f9b0406cd20 2024-09-15T23:16:53.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.195+0000 7f9b0935a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9b04070b80 0x7f9b040b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.195+0000 7f9b0935a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9b04070b80 0x7f9b040b72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47782/0 (socket says 172.21.15.123:47782) 2024-09-15T23:16:53.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.195+0000 7f9b0935a640 1 -- 172.21.15.123:0/377160903 learned_addr learned my addr 172.21.15.123:0/377160903 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:53.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.195+0000 7f9b0935a640 1 -- 172.21.15.123:0/377160903 >> v2:172.21.15.188:3300/0 conn(0x7f9b0406cd20 msgr2=0x7f9b040b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:53.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.195+0000 7f9b0935a640 1 --2- 172.21.15.123:0/377160903 >> v2:172.21.15.188:3300/0 conn(0x7f9b0406cd20 0x7f9b040b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.195+0000 7f9b0935a640 1 -- 172.21.15.123:0/377160903 >> v1:172.21.15.188:6789/0 conn(0x7f9b0415e6d0 legacy=0x7f9b04071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:53.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.195+0000 7f9b0935a640 1 -- 172.21.15.123:0/377160903 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b0415f050 con 0x7f9b04070b80 2024-09-15T23:16:53.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.196+0000 7f9b0935a640 1 --2- 172.21.15.123:0/377160903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b04070b80 0x7f9b040b72a0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f9b04072f80 tx=0x7f9afc02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=982b2b38939acf76 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:53.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.196+0000 7f9b037fe640 1 -- 172.21.15.123:0/377160903 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9afc036070 con 0x7f9b04070b80 2024-09-15T23:16:53.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.196+0000 7f9b037fe640 1 -- 172.21.15.123:0/377160903 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9afc031600 con 0x7f9b04070b80 2024-09-15T23:16:53.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.196+0000 7f9b037fe640 1 -- 172.21.15.123:0/377160903 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9afc0319d0 con 0x7f9b04070b80 2024-09-15T23:16:53.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.197+0000 7f9b0adbd640 1 -- 172.21.15.123:0/377160903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b04070b80 msgr2=0x7f9b040b72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:53.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.197+0000 7f9b0adbd640 1 --2- 172.21.15.123:0/377160903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b04070b80 0x7f9b040b72a0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f9b04072f80 tx=0x7f9afc02a6f0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.197+0000 7f9b0adbd640 1 -- 172.21.15.123:0/377160903 shutdown_connections 2024-09-15T23:16:53.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.197+0000 7f9b0adbd640 1 --2- 172.21.15.123:0/377160903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b04070b80 0x7f9b040b72a0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.197+0000 7f9b0adbd640 1 --2- 172.21.15.123:0/377160903 >> v2:172.21.15.188:3300/0 conn(0x7f9b0406cd20 0x7f9b040b6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.197+0000 7f9b0adbd640 1 -- 172.21.15.123:0/377160903 >> 172.21.15.123:0/377160903 conn(0x7f9b04067fb0 msgr2=0x7f9b0406f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:53.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.197+0000 7f9b0adbd640 1 -- 172.21.15.123:0/377160903 shutdown_connections 2024-09-15T23:16:53.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.197+0000 7f9b0adbd640 1 -- 172.21.15.123:0/377160903 wait complete. 2024-09-15T23:16:53.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.198+0000 7f9b0adbd640 1 Processor -- start 2024-09-15T23:16:53.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.198+0000 7f9b0adbd640 1 -- start start 2024-09-15T23:16:53.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.199+0000 7f9b0adbd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b0406cd20 0x7f9b041514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.199+0000 7f9b0adbd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b04070b80 0x7f9b04153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.199+0000 7f9b0adbd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b0415e6d0 0x7f9b041521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.199+0000 7f9b0adbd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0415f8f0 con 0x7f9b04070b80 2024-09-15T23:16:53.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.199+0000 7f9b0adbd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0415f610 con 0x7f9b0406cd20 2024-09-15T23:16:53.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.199+0000 7f9b0adbd640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9b041622a0 con 0x7f9b0415e6d0 2024-09-15T23:16:53.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.199+0000 7f9b03fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b04070b80 0x7f9b04153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.199+0000 7f9b03fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b04070b80 0x7f9b04153ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47788/0 (socket says 172.21.15.123:47788) 2024-09-15T23:16:53.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.199+0000 7f9b03fff640 1 -- 172.21.15.123:0/1734770552 learned_addr learned my addr 172.21.15.123:0/1734770552 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:53.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.199+0000 7f9b08b59640 1 --2- 172.21.15.123:0/1734770552 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b0406cd20 0x7f9b041514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.199+0000 7f9b03fff640 1 -- 172.21.15.123:0/1734770552 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b0415e6d0 msgr2=0x7f9b041521e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:53.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.199+0000 7f9b0935a640 1 --2- 172.21.15.123:0/1734770552 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b0415e6d0 0x7f9b041521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.199+0000 7f9b03fff640 1 --2- 172.21.15.123:0/1734770552 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b0415e6d0 0x7f9b041521e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.199+0000 7f9b03fff640 1 -- 172.21.15.123:0/1734770552 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b0406cd20 msgr2=0x7f9b041514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:53.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.199+0000 7f9b03fff640 1 --2- 172.21.15.123:0/1734770552 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b0406cd20 0x7f9b041514c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.199+0000 7f9b03fff640 1 -- 172.21.15.123:0/1734770552 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b04154470 con 0x7f9b04070b80 2024-09-15T23:16:53.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.200+0000 7f9b08b59640 1 --2- 172.21.15.123:0/1734770552 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b0406cd20 0x7f9b041514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:16:53.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.200+0000 7f9b03fff640 1 --2- 172.21.15.123:0/1734770552 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b04070b80 0x7f9b04153ce0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f9af000b450 tx=0x7f9af000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:53.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.200+0000 7f9b017fa640 1 -- 172.21.15.123:0/1734770552 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af0015020 con 0x7f9b04070b80 2024-09-15T23:16:53.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.200+0000 7f9b017fa640 1 -- 172.21.15.123:0/1734770552 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9af0011890 con 0x7f9b04070b80 2024-09-15T23:16:53.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.200+0000 7f9b0adbd640 1 -- 172.21.15.123:0/1734770552 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b04154750 con 0x7f9b04070b80 2024-09-15T23:16:53.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.200+0000 7f9b017fa640 1 -- 172.21.15.123:0/1734770552 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af0011c80 con 0x7f9b04070b80 2024-09-15T23:16:53.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.200+0000 7f9b0adbd640 1 -- 172.21.15.123:0/1734770552 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b04154d10 con 0x7f9b04070b80 2024-09-15T23:16:53.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.201+0000 7f9b017fa640 1 -- 172.21.15.123:0/1734770552 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9af0018020 con 0x7f9b04070b80 2024-09-15T23:16:53.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.202+0000 7f9b017fa640 1 --2- 172.21.15.123:0/1734770552 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9ae806c2b0 0x7f9ae806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.202+0000 7f9b017fa640 1 -- 172.21.15.123:0/1734770552 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5795+0+0 (secure 0 0 0) 0x7f9af008b5d0 con 0x7f9b04070b80 2024-09-15T23:16:53.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.202+0000 7f9b08b59640 1 --2- 172.21.15.123:0/1734770552 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9ae806c2b0 0x7f9ae806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.203+0000 7f9b0dc34740 1 Processor -- start 2024-09-15T23:16:53.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.203+0000 7f9b0dc34740 1 -- start start 2024-09-15T23:16:53.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.203+0000 7f9b08b59640 1 --2- 172.21.15.123:0/1734770552 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9ae806c2b0 0x7f9ae806e770 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9af800a810 tx=0x7f9af8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:53.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.203+0000 7f9b0dc34740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563bdb8a2c0 0x5563bdbcfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.203+0000 7f9b0dc34740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563bdb87a80 0x5563bdb8a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.203+0000 7f9b0dc34740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563bdb8ba50 0x5563bdb848b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.203+0000 7f9b0dc34740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5563bdaec520 con 0x5563bdb87a80 2024-09-15T23:16:53.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.203+0000 7f9b0dc34740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5563bda943e0 con 0x5563bdb8ba50 2024-09-15T23:16:53.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.203+0000 7f9b0dc34740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5563bdae84e0 con 0x5563bdb8a2c0 2024-09-15T23:16:53.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.204+0000 7f9b03fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563bdb87a80 0x5563bdb8a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.204+0000 7f9b03fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563bdb87a80 0x5563bdb8a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47796/0 (socket says 172.21.15.123:47796) 2024-09-15T23:16:53.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.204+0000 7f9b03fff640 1 -- 172.21.15.123:0/4145301777 learned_addr learned my addr 172.21.15.123:0/4145301777 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:53.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.204+0000 7f9b08b59640 1 --2- 172.21.15.123:0/4145301777 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563bdb8a2c0 0x5563bdbcfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.204+0000 7f9b0935a640 1 --2- 172.21.15.123:0/4145301777 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563bdb8ba50 0x5563bdb848b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.204+0000 7f9b03fff640 1 -- 172.21.15.123:0/4145301777 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563bdb8a2c0 msgr2=0x5563bdbcfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:53.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.204+0000 7f9b03fff640 1 --2- 172.21.15.123:0/4145301777 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563bdb8a2c0 0x5563bdbcfa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.204+0000 7f9b03fff640 1 -- 172.21.15.123:0/4145301777 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563bdb8ba50 msgr2=0x5563bdb848b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:53.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.204+0000 7f9b03fff640 1 --2- 172.21.15.123:0/4145301777 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563bdb8ba50 0x5563bdb848b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.204+0000 7f9b03fff640 1 -- 172.21.15.123:0/4145301777 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563bdaaf2f0 con 0x5563bdb87a80 2024-09-15T23:16:53.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.204+0000 7f9b03fff640 1 --2- 172.21.15.123:0/4145301777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563bdb87a80 0x5563bdb8a6a0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f9af0089ad0 tx=0x7f9af0011f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=989756978d10f65b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:53.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.204+0000 7f9aee7fc640 1 -- 172.21.15.123:0/4145301777 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af0071020 con 0x5563bdb87a80 2024-09-15T23:16:53.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.204+0000 7f9aee7fc640 1 -- 172.21.15.123:0/4145301777 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9af0062250 con 0x5563bdb87a80 2024-09-15T23:16:53.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.204+0000 7f9aee7fc640 1 -- 172.21.15.123:0/4145301777 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af0055ce0 con 0x5563bdb87a80 2024-09-15T23:16:53.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.205+0000 7f9b0dc34740 1 -- 172.21.15.123:0/4145301777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563bdb87a80 msgr2=0x5563bdb8a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:53.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.205+0000 7f9b0dc34740 1 --2- 172.21.15.123:0/4145301777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563bdb87a80 0x5563bdb8a6a0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f9af0089ad0 tx=0x7f9af0011f50 comp rx=0 tx=0).stop 2024-09-15T23:16:53.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.205+0000 7f9b0dc34740 1 -- 172.21.15.123:0/4145301777 shutdown_connections 2024-09-15T23:16:53.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.205+0000 7f9b0dc34740 1 --2- 172.21.15.123:0/4145301777 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563bdb8ba50 0x5563bdb848b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.205+0000 7f9b0dc34740 1 --2- 172.21.15.123:0/4145301777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563bdb87a80 0x5563bdb8a6a0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.205+0000 7f9b0dc34740 1 --2- 172.21.15.123:0/4145301777 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563bdb8a2c0 0x5563bdbcfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.205+0000 7f9b0dc34740 1 -- 172.21.15.123:0/4145301777 >> 172.21.15.123:0/4145301777 conn(0x5563bdb86a80 msgr2=0x5563bdbcef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:53.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.205+0000 7f9b0dc34740 1 -- 172.21.15.123:0/4145301777 shutdown_connections 2024-09-15T23:16:53.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.205+0000 7f9b0dc34740 1 -- 172.21.15.123:0/4145301777 wait complete. 2024-09-15T23:16:53.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.205+0000 7f9b0dc34740 1 -- start start 2024-09-15T23:16:53.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.205+0000 7f9b0dc34740 1 Processor -- start 2024-09-15T23:16:53.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.206+0000 7f9b0dc34740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563bdb8a2c0 0x5563bdbcc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.206+0000 7f9b0dc34740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563bdb8ba50 0x5563bdbb7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.206+0000 7f9b0dc34740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563bdbb4c00 0x5563bdbb7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.206+0000 7f9b0dc34740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5563bdb85f20 con 0x5563bdb8ba50 2024-09-15T23:16:53.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.206+0000 7f9b0dc34740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5563bda75450 con 0x5563bdbb4c00 2024-09-15T23:16:53.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.206+0000 7f9b0dc34740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5563bdbd0290 con 0x5563bdb8a2c0 2024-09-15T23:16:53.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.206+0000 7f9b03fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563bdb8ba50 0x5563bdbb7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.206+0000 7f9b0dc34740 10 client.0 _ll_register_callbacks cb 0x5563bd7feac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:16:53.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.206+0000 7f9b03fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563bdb8ba50 0x5563bdbb7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47802/0 (socket says 172.21.15.123:47802) 2024-09-15T23:16:53.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.206+0000 7f9b03fff640 1 -- 172.21.15.123:0/3304790099 learned_addr learned my addr 172.21.15.123:0/3304790099 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:53.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.206+0000 7f9b08b59640 1 --2- 172.21.15.123:0/3304790099 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563bdb8a2c0 0x5563bdbcc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.206+0000 7f9b0935a640 1 --2- 172.21.15.123:0/3304790099 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563bdbb4c00 0x5563bdbb7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.207+0000 7f9b03fff640 1 -- 172.21.15.123:0/3304790099 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563bdb8a2c0 msgr2=0x5563bdbcc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:53.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.207+0000 7f9b03fff640 1 --2- 172.21.15.123:0/3304790099 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563bdb8a2c0 0x5563bdbcc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.207+0000 7f9b03fff640 1 -- 172.21.15.123:0/3304790099 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563bdbb4c00 msgr2=0x5563bdbb7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:53.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.207+0000 7f9b03fff640 1 --2- 172.21.15.123:0/3304790099 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563bdbb4c00 0x5563bdbb7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.207+0000 7f9b03fff640 1 -- 172.21.15.123:0/3304790099 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563bd7ff2d0 con 0x5563bdb8ba50 2024-09-15T23:16:53.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.207+0000 7f9b08b59640 1 --2- 172.21.15.123:0/3304790099 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563bdb8a2c0 0x5563bdbcc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:16:53.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.207+0000 7f9b0935a640 1 --2- 172.21.15.123:0/3304790099 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563bdbb4c00 0x5563bdbb7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:16:53.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.207+0000 7f9b03fff640 1 --2- 172.21.15.123:0/3304790099 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563bdb8ba50 0x5563bdbb7680 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f9af0089b80 tx=0x7f9af00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a7119a424d1043d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:53.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.207+0000 7f9ae37fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:16:53.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.207+0000 7f9ae37fe640 1 -- 172.21.15.123:0/3304790099 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af0071040 con 0x5563bdb8ba50 2024-09-15T23:16:53.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.207+0000 7f9ae37fe640 1 -- 172.21.15.123:0/3304790099 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 5795+0+0 (secure 0 0 0) 0x7f9af005edc0 con 0x5563bdb8ba50 2024-09-15T23:16:53.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.207+0000 7f9b0dc34740 1 -- 172.21.15.123:0/3304790099 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9af0062250 con 0x5563bdb8ba50 2024-09-15T23:16:53.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.207+0000 7f9ae37fe640 1 -- 172.21.15.123:0/3304790099 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f9af0082050 con 0x5563bdb8ba50 2024-09-15T23:16:53.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.207+0000 7f9b0dc34740 10 client.7407 fetch_fsmap learned FSMap version 66 2024-09-15T23:16:53.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.207+0000 7f9b0dc34740 1 -- 172.21.15.123:0/3304790099 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) -- 0x5563bd8c96b0 con 0x5563bdb8ba50 2024-09-15T23:16:53.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.207+0000 7f9ae37fe640 1 -- 172.21.15.123:0/3304790099 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9af0062250 con 0x5563bdb8ba50 2024-09-15T23:16:53.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.207+0000 7f9ae37fe640 1 -- 172.21.15.123:0/3304790099 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 66) ==== 3502+0+0 (secure 0 0 0) 0x7f9af0058ac0 con 0x5563bdb8ba50 2024-09-15T23:16:53.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.207+0000 7f9b0dc34740 10 client.7407 fetch_fsmap finished waiting for FSMap version 66 2024-09-15T23:16:53.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.207+0000 7f9b0dc34740 10 client.7407 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T23:16:53.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.207+0000 7f9b0dc34740 20 client.7407 populate_metadata read hostname 'smithi123' 2024-09-15T23:16:53.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.207+0000 7f9b0dc34740 1 --2- 172.21.15.123:0/3304790099 >> [v2:172.21.15.123:6834/2621254224,v1:172.21.15.123:6835/2621254224] conn(0x5563bdbea0d0 0x5563bdbec4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.207+0000 7f9b0dc34740 4 client.7407 mds_command: new command op to 7365 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:16:53.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.207+0000 7f9b0dc34740 1 -- 172.21.15.123:0/3304790099 --> [v2:172.21.15.123:6834/2621254224,v1:172.21.15.123:6835/2621254224] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563bdaf9c50 con 0x5563bdbea0d0 2024-09-15T23:16:53.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.207+0000 7f9b08b59640 1 --2- 172.21.15.123:0/3304790099 >> [v2:172.21.15.123:6834/2621254224,v1:172.21.15.123:6835/2621254224] conn(0x5563bdbea0d0 0x5563bdbec4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.208+0000 7f9ae37fe640 10 client.7407 ms_handle_connect on v2:172.21.15.123:6834/2621254224 2024-09-15T23:16:53.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.208+0000 7f9b08b59640 1 --2- 172.21.15.123:0/3304790099 >> [v2:172.21.15.123:6834/2621254224,v1:172.21.15.123:6835/2621254224] conn(0x5563bdbea0d0 0x5563bdbec4c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bfb5daa57980333 server_cookie=f5db21f3b3bb7adb in_seq=0 out_seq=0 2024-09-15T23:16:53.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.208+0000 7f9ae37fe640 1 -- 172.21.15.123:0/3304790099 <== mds.0 v2:172.21.15.123:6834/2621254224 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5563bdaf9c50 con 0x5563bdbea0d0 2024-09-15T23:16:53.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.208+0000 7f9ae37fe640 10 client.7407 handle_command_reply: tid=0 2024-09-15T23:16:53.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.208+0000 7f9b0dc34740 1 client.7407 shutdown 2024-09-15T23:16:53.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.209+0000 7f9b0dc34740 1 -- 172.21.15.123:0/3304790099 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563bdb8ba50 msgr2=0x5563bdbb7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:53.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.209+0000 7f9b0dc34740 1 --2- 172.21.15.123:0/3304790099 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563bdb8ba50 0x5563bdbb7680 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f9af0089b80 tx=0x7f9af00046c0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.209+0000 7f9b0dc34740 1 -- 172.21.15.123:0/3304790099 shutdown_connections 2024-09-15T23:16:53.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.209+0000 7f9b0dc34740 1 --2- 172.21.15.123:0/3304790099 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563bdbb4c00 0x5563bdbb7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.209+0000 7f9b0dc34740 1 --2- 172.21.15.123:0/3304790099 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563bdb8ba50 0x5563bdbb7680 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.209+0000 7f9b0dc34740 1 --2- 172.21.15.123:0/3304790099 >> [v2:172.21.15.123:6834/2621254224,v1:172.21.15.123:6835/2621254224] conn(0x5563bdbea0d0 0x5563bdbec4c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.209+0000 7f9b0dc34740 1 --2- 172.21.15.123:0/3304790099 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563bdb8a2c0 0x5563bdbcc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.209+0000 7f9ae37fe640 0 client.7407 ms_handle_reset on v2:172.21.15.123:6834/2621254224 2024-09-15T23:16:53.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.209+0000 7f9b0dc34740 1 -- 172.21.15.123:0/3304790099 >> 172.21.15.123:0/3304790099 conn(0x5563bdb87a80 msgr2=0x5563bdbd2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:53.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.209+0000 7f9b0dc34740 1 -- 172.21.15.123:0/3304790099 shutdown_connections 2024-09-15T23:16:53.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.209+0000 7f9b0dc34740 1 -- 172.21.15.123:0/3304790099 wait complete. 2024-09-15T23:16:53.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.209+0000 7f9b0dc34740 20 client.7407 trim_cache size 0 max 16384 2024-09-15T23:16:53.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.226+0000 7f9b0dc34740 1 Processor -- start 2024-09-15T23:16:53.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.226+0000 7f9b0dc34740 1 -- start start 2024-09-15T23:16:53.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.227+0000 7f9b0dc34740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563bdb8a2c0 0x5563bdbb72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.227+0000 7f9b0dc34740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563bdb8ba50 0x5563bdbb1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.227+0000 7f9b0dc34740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563bdbb4c00 0x5563bdbafe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.227+0000 7f9b0dc34740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9b041ffe90 con 0x5563bdbb4c00 2024-09-15T23:16:53.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.227+0000 7f9b0dc34740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0413eeb0 con 0x5563bdb8a2c0 2024-09-15T23:16:53.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.227+0000 7f9b0dc34740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9b0413f500 con 0x5563bdb8ba50 2024-09-15T23:16:53.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.227+0000 7f9b0935a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563bdbb4c00 0x5563bdbafe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.227+0000 7f9b0935a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563bdbb4c00 0x5563bdbafe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47804/0 (socket says 172.21.15.123:47804) 2024-09-15T23:16:53.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.227+0000 7f9b0935a640 1 -- 172.21.15.123:0/3262949942 learned_addr learned my addr 172.21.15.123:0/3262949942 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:53.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.227+0000 7f9b03fff640 1 --2- 172.21.15.123:0/3262949942 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563bdb8ba50 0x5563bdbb1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.227+0000 7f9b0935a640 1 -- 172.21.15.123:0/3262949942 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563bdb8ba50 msgr2=0x5563bdbb1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:53.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.227+0000 7f9b0935a640 1 --2- 172.21.15.123:0/3262949942 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563bdb8ba50 0x5563bdbb1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.227+0000 7f9b08b59640 1 --2- 172.21.15.123:0/3262949942 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563bdb8a2c0 0x5563bdbb72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.227+0000 7f9b0935a640 1 -- 172.21.15.123:0/3262949942 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563bdb8a2c0 msgr2=0x5563bdbb72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:53.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.227+0000 7f9b0935a640 1 --2- 172.21.15.123:0/3262949942 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563bdb8a2c0 0x5563bdbb72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.227+0000 7f9b0935a640 1 -- 172.21.15.123:0/3262949942 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563bdb808b0 con 0x5563bdbb4c00 2024-09-15T23:16:53.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.227+0000 7f9b03fff640 1 --2- 172.21.15.123:0/3262949942 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563bdb8ba50 0x5563bdbb1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:16:53.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.227+0000 7f9b08b59640 1 --2- 172.21.15.123:0/3262949942 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563bdb8a2c0 0x5563bdbb72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:16:53.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.228+0000 7f9b0935a640 1 --2- 172.21.15.123:0/3262949942 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563bdbb4c00 0x5563bdbafe20 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f9afc034040 tx=0x7f9afc02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d944766bd666ee92 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:53.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.228+0000 7f9aedffb640 1 -- 172.21.15.123:0/3262949942 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9afc049070 con 0x5563bdbb4c00 2024-09-15T23:16:53.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.228+0000 7f9aedffb640 1 -- 172.21.15.123:0/3262949942 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9afc044410 con 0x5563bdbb4c00 2024-09-15T23:16:53.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.228+0000 7f9aedffb640 1 -- 172.21.15.123:0/3262949942 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9afc036040 con 0x5563bdbb4c00 2024-09-15T23:16:53.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.228+0000 7f9b0dc34740 1 -- 172.21.15.123:0/3262949942 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563bdbb4c00 msgr2=0x5563bdbafe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:53.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.228+0000 7f9b0dc34740 1 --2- 172.21.15.123:0/3262949942 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563bdbb4c00 0x5563bdbafe20 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f9afc034040 tx=0x7f9afc02e000 comp rx=0 tx=0).stop 2024-09-15T23:16:53.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.228+0000 7f9b0dc34740 1 -- 172.21.15.123:0/3262949942 shutdown_connections 2024-09-15T23:16:53.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.228+0000 7f9b0dc34740 1 --2- 172.21.15.123:0/3262949942 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563bdbb4c00 0x5563bdbafe20 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.228+0000 7f9b0dc34740 1 --2- 172.21.15.123:0/3262949942 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563bdb8ba50 0x5563bdbb1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.228+0000 7f9b0dc34740 1 --2- 172.21.15.123:0/3262949942 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563bdb8a2c0 0x5563bdbb72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.228+0000 7f9b0dc34740 1 -- 172.21.15.123:0/3262949942 >> 172.21.15.123:0/3262949942 conn(0x5563bdb87a80 msgr2=0x5563bdbb8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:53.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.228+0000 7f9b0dc34740 1 -- 172.21.15.123:0/3262949942 shutdown_connections 2024-09-15T23:16:53.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.228+0000 7f9b0dc34740 1 -- 172.21.15.123:0/3262949942 wait complete. 2024-09-15T23:16:53.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.229+0000 7f9b0dc34740 1 -- start start 2024-09-15T23:16:53.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.229+0000 7f9b0dc34740 1 Processor -- start 2024-09-15T23:16:53.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.230+0000 7f9b0dc34740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563bdb8a2c0 0x5563bdc4c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.230+0000 7f9b0dc34740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563bdb8ba50 0x5563bdbce100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.230+0000 7f9b0dc34740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563bdbb4c00 0x5563bdbce640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.230+0000 7f9b0dc34740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5563bdbaf5d0 con 0x5563bdb8a2c0 2024-09-15T23:16:53.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.230+0000 7f9b0dc34740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5563bdb85f20 con 0x5563bdb8ba50 2024-09-15T23:16:53.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.230+0000 7f9b0dc34740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5563bdbe82e0 con 0x5563bdbb4c00 2024-09-15T23:16:53.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.230+0000 7f9b0dc34740 10 client.0 _ll_register_callbacks cb 0x7f9af0011e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:16:53.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.230+0000 7f9b08b59640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563bdb8a2c0 0x5563bdc4c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.230+0000 7f9b08b59640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563bdb8a2c0 0x5563bdc4c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47816/0 (socket says 172.21.15.123:47816) 2024-09-15T23:16:53.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.230+0000 7f9b08b59640 1 -- 172.21.15.123:0/400145804 learned_addr learned my addr 172.21.15.123:0/400145804 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:53.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.230+0000 7f9b0935a640 1 --2- 172.21.15.123:0/400145804 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563bdbb4c00 0x5563bdbce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.230+0000 7f9b03fff640 1 --2- 172.21.15.123:0/400145804 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563bdb8ba50 0x5563bdbce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.230+0000 7f9b08b59640 1 -- 172.21.15.123:0/400145804 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563bdbb4c00 msgr2=0x5563bdbce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:53.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.230+0000 7f9b08b59640 1 --2- 172.21.15.123:0/400145804 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563bdbb4c00 0x5563bdbce640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.230+0000 7f9b08b59640 1 -- 172.21.15.123:0/400145804 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563bdb8ba50 msgr2=0x5563bdbce100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:53.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.230+0000 7f9b08b59640 1 --2- 172.21.15.123:0/400145804 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563bdb8ba50 0x5563bdbce100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.230+0000 7f9b08b59640 1 -- 172.21.15.123:0/400145804 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563bdbe79c0 con 0x5563bdb8a2c0 2024-09-15T23:16:53.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.230+0000 7f9b03fff640 1 --2- 172.21.15.123:0/400145804 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563bdb8ba50 0x5563bdbce100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:16:53.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.230+0000 7f9b0935a640 1 --2- 172.21.15.123:0/400145804 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563bdbb4c00 0x5563bdbce640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:16:53.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.230+0000 7f9b08b59640 1 --2- 172.21.15.123:0/400145804 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563bdb8a2c0 0x5563bdc4c720 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x5563bdbe8810 tx=0x7f9af8004640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67cb906babc07449 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:53.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.230+0000 7f9ae37fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:16:53.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.231+0000 7f9ae37fe640 1 -- 172.21.15.123:0/400145804 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af8023840 con 0x5563bdb8a2c0 2024-09-15T23:16:53.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.231+0000 7f9ae37fe640 1 -- 172.21.15.123:0/400145804 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 5795+0+0 (secure 0 0 0) 0x7f9af80239e0 con 0x5563bdb8a2c0 2024-09-15T23:16:53.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.231+0000 7f9b0dc34740 1 -- 172.21.15.123:0/400145804 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9afc044410 con 0x5563bdb8a2c0 2024-09-15T23:16:53.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.231+0000 7f9ae37fe640 1 -- 172.21.15.123:0/400145804 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f9af8023be0 con 0x5563bdb8a2c0 2024-09-15T23:16:53.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.231+0000 7f9b0dc34740 10 client.7413 fetch_fsmap learned FSMap version 66 2024-09-15T23:16:53.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.231+0000 7f9b0dc34740 1 -- 172.21.15.123:0/400145804 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) -- 0x5563bdc4cc60 con 0x5563bdb8a2c0 2024-09-15T23:16:53.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.231+0000 7f9ae37fe640 1 -- 172.21.15.123:0/400145804 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9afc044410 con 0x5563bdb8a2c0 2024-09-15T23:16:53.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.231+0000 7f9ae37fe640 1 -- 172.21.15.123:0/400145804 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 66) ==== 3502+0+0 (secure 0 0 0) 0x7f9af8004020 con 0x5563bdb8a2c0 2024-09-15T23:16:53.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.231+0000 7f9b0dc34740 10 client.7413 fetch_fsmap finished waiting for FSMap version 66 2024-09-15T23:16:53.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.231+0000 7f9b0dc34740 10 client.7413 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T23:16:53.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.231+0000 7f9b0dc34740 20 client.7413 populate_metadata read hostname 'smithi123' 2024-09-15T23:16:53.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.231+0000 7f9b0dc34740 1 --2- 172.21.15.123:0/400145804 >> [v2:172.21.15.123:6834/2621254224,v1:172.21.15.123:6835/2621254224] conn(0x5563bdc50d40 0x5563bdbe62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.231+0000 7f9b0dc34740 4 client.7413 mds_command: new command op to 7365 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:16:53.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.231+0000 7f9b0dc34740 1 -- 172.21.15.123:0/400145804 --> [v2:172.21.15.123:6834/2621254224,v1:172.21.15.123:6835/2621254224] -- command(tid 0: {"prefix": "status"}) -- 0x5563bdb8b5c0 con 0x5563bdc50d40 2024-09-15T23:16:53.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.231+0000 7f9b03fff640 1 --2- 172.21.15.123:0/400145804 >> [v2:172.21.15.123:6834/2621254224,v1:172.21.15.123:6835/2621254224] conn(0x5563bdc50d40 0x5563bdbe62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.231+0000 7f9ae37fe640 10 client.7413 ms_handle_connect on v2:172.21.15.123:6834/2621254224 2024-09-15T23:16:53.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.231+0000 7f9b03fff640 1 --2- 172.21.15.123:0/400145804 >> [v2:172.21.15.123:6834/2621254224,v1:172.21.15.123:6835/2621254224] conn(0x5563bdc50d40 0x5563bdbe62c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c1e5317054b24eb server_cookie=484e039a52662947 in_seq=0 out_seq=0 2024-09-15T23:16:53.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.232+0000 7f9ae37fe640 1 -- 172.21.15.123:0/400145804 <== mds.0 v2:172.21.15.123:6834/2621254224 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x5563bdb8b5c0 con 0x5563bdc50d40 2024-09-15T23:16:53.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.232+0000 7f9ae37fe640 10 client.7413 handle_command_reply: tid=0 2024-09-15T23:16:53.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.232+0000 7f9b0dc34740 1 client.7413 shutdown 2024-09-15T23:16:53.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.232+0000 7f9b0dc34740 1 -- 172.21.15.123:0/400145804 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563bdb8a2c0 msgr2=0x5563bdc4c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:53.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.232+0000 7f9b0dc34740 1 --2- 172.21.15.123:0/400145804 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563bdb8a2c0 0x5563bdc4c720 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x5563bdbe8810 tx=0x7f9af8004640 comp rx=0 tx=0).stop 2024-09-15T23:16:53.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.232+0000 7f9b0dc34740 1 -- 172.21.15.123:0/400145804 shutdown_connections 2024-09-15T23:16:53.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.232+0000 7f9b0dc34740 1 --2- 172.21.15.123:0/400145804 >> [v2:172.21.15.123:6834/2621254224,v1:172.21.15.123:6835/2621254224] conn(0x5563bdc50d40 0x5563bdbe62c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.232+0000 7f9b0dc34740 1 --2- 172.21.15.123:0/400145804 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5563bdbb4c00 0x5563bdbce640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.232+0000 7f9b0dc34740 1 --2- 172.21.15.123:0/400145804 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5563bdb8ba50 0x5563bdbce100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.232+0000 7f9b0dc34740 1 --2- 172.21.15.123:0/400145804 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5563bdb8a2c0 0x5563bdc4c720 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.232+0000 7f9ae37fe640 0 client.7413 ms_handle_reset on v2:172.21.15.123:6834/2621254224 2024-09-15T23:16:53.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.232+0000 7f9b0dc34740 1 -- 172.21.15.123:0/400145804 >> 172.21.15.123:0/400145804 conn(0x5563bdb87a80 msgr2=0x5563bdbb1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:53.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.232+0000 7f9b0dc34740 1 -- 172.21.15.123:0/400145804 shutdown_connections 2024-09-15T23:16:53.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.232+0000 7f9b0dc34740 1 -- 172.21.15.123:0/400145804 wait complete. 2024-09-15T23:16:53.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.232+0000 7f9b0dc34740 20 client.7413 trim_cache size 0 max 16384 2024-09-15T23:16:53.241 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:16:53.241 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "cb968ac4-8d3a-4b17-a673-6177aeaea589", 2024-09-15T23:16:53.241 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2024-09-15T23:16:53.241 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 7365, 2024-09-15T23:16:53.241 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-09-15T23:16:53.241 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-09-15T23:16:53.241 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-09-15T23:16:53.242 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 4.407047554, 2024-09-15T23:16:53.242 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 66, 2024-09-15T23:16:53.242 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 102, 2024-09-15T23:16:53.242 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 102, 2024-09-15T23:16:53.242 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 5.2735108310000003 2024-09-15T23:16:53.242 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:16:53.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.232+0000 7f9b0adbd640 1 -- 172.21.15.123:0/1734770552 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9ae806c2b0 msgr2=0x7f9ae806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:53.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.232+0000 7f9b0adbd640 1 --2- 172.21.15.123:0/1734770552 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9ae806c2b0 0x7f9ae806e770 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9af800a810 tx=0x7f9af8008040 comp rx=0 tx=0).stop 2024-09-15T23:16:53.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.232+0000 7f9b0adbd640 1 -- 172.21.15.123:0/1734770552 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b04070b80 msgr2=0x7f9b04153ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:53.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.232+0000 7f9b0adbd640 1 --2- 172.21.15.123:0/1734770552 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b04070b80 0x7f9b04153ce0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f9af000b450 tx=0x7f9af000b910 comp rx=0 tx=0).stop 2024-09-15T23:16:53.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.233+0000 7f9b0adbd640 1 -- 172.21.15.123:0/1734770552 shutdown_connections 2024-09-15T23:16:53.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.233+0000 7f9b0adbd640 1 --2- 172.21.15.123:0/1734770552 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b0415e6d0 0x7f9b041521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.233+0000 7f9b0adbd640 1 --2- 172.21.15.123:0/1734770552 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9ae806c2b0 0x7f9ae806e770 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.233+0000 7f9b0adbd640 1 --2- 172.21.15.123:0/1734770552 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b04070b80 0x7f9b04153ce0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.233+0000 7f9b0adbd640 1 --2- 172.21.15.123:0/1734770552 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b0406cd20 0x7f9b041514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.233+0000 7f9b0adbd640 1 -- 172.21.15.123:0/1734770552 >> 172.21.15.123:0/1734770552 conn(0x7f9b04067fb0 msgr2=0x7f9b0406f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:53.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.233+0000 7f9b0adbd640 1 -- 172.21.15.123:0/1734770552 shutdown_connections 2024-09-15T23:16:53.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.233+0000 7f9b0adbd640 1 -- 172.21.15.123:0/1734770552 wait complete. 2024-09-15T23:16:53.246 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_size 20 2024-09-15T23:16:53.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.346+0000 7fb6c9dd8640 1 Processor -- start 2024-09-15T23:16:53.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.346+0000 7fb6c9dd8640 1 -- start start 2024-09-15T23:16:53.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.347+0000 7fb6c9dd8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb6c40ccf30 0x7fb6c40b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.347+0000 7fb6c9dd8640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb6c415b7c0 0x7fb6c40cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.347+0000 7fb6c9dd8640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6c40cd850 con 0x7fb6c40cead0 2024-09-15T23:16:53.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.347+0000 7fb6c9dd8640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fb6c40cf2e0 con 0x7fb6c40ccf30 2024-09-15T23:16:53.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.347+0000 7fb6c9dd8640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb6c4070fe0 con 0x7fb6c415b7c0 2024-09-15T23:16:53.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.347+0000 7fb6c37fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb6c40ccf30 0x7fb6c40b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.347+0000 7fb6c37fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb6c40ccf30 0x7fb6c40b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47818/0 (socket says 172.21.15.123:47818) 2024-09-15T23:16:53.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.347+0000 7fb6c37fe640 1 -- 172.21.15.123:0/1986933825 learned_addr learned my addr 172.21.15.123:0/1986933825 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:53.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.348+0000 7fb6c37fe640 1 -- 172.21.15.123:0/1986933825 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb6c415b7c0 msgr2=0x7fb6c40cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:53.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.348+0000 7fb6c2ffd640 1 --2- 172.21.15.123:0/1986933825 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb6c415b7c0 0x7fb6c40cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.348+0000 7fb6c37fe640 1 --2- 172.21.15.123:0/1986933825 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb6c415b7c0 0x7fb6c40cd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.348+0000 7fb6c37fe640 1 -- 172.21.15.123:0/1986933825 >> v1:172.21.15.188:6789/0 conn(0x7fb6c40cead0 legacy=0x7fb6c415f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:53.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.348+0000 7fb6c37fe640 1 -- 172.21.15.123:0/1986933825 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c40712c0 con 0x7fb6c40ccf30 2024-09-15T23:16:53.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.348+0000 7fb6c37fe640 1 --2- 172.21.15.123:0/1986933825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6c40ccf30 0x7fb6c40b2c50 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fb6b400bb10 tx=0x7fb6b402c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e65150402fb8d2c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:53.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.348+0000 7fb6c27fc640 1 -- 172.21.15.123:0/1986933825 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b403a070 con 0x7fb6c40ccf30 2024-09-15T23:16:53.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.348+0000 7fb6c27fc640 1 -- 172.21.15.123:0/1986933825 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6b40326f0 con 0x7fb6c40ccf30 2024-09-15T23:16:53.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.348+0000 7fb6c27fc640 1 -- 172.21.15.123:0/1986933825 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b4032ac0 con 0x7fb6c40ccf30 2024-09-15T23:16:53.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.349+0000 7fb6c9dd8640 1 -- 172.21.15.123:0/1986933825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6c40ccf30 msgr2=0x7fb6c40b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:53.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.349+0000 7fb6c9dd8640 1 --2- 172.21.15.123:0/1986933825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6c40ccf30 0x7fb6c40b2c50 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fb6b400bb10 tx=0x7fb6b402c830 comp rx=0 tx=0).stop 2024-09-15T23:16:53.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.349+0000 7fb6c9dd8640 1 -- 172.21.15.123:0/1986933825 shutdown_connections 2024-09-15T23:16:53.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.349+0000 7fb6c9dd8640 1 --2- 172.21.15.123:0/1986933825 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb6c415b7c0 0x7fb6c40cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.349+0000 7fb6c9dd8640 1 --2- 172.21.15.123:0/1986933825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6c40ccf30 0x7fb6c40b2c50 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.349+0000 7fb6c9dd8640 1 -- 172.21.15.123:0/1986933825 >> 172.21.15.123:0/1986933825 conn(0x7fb6c406d0f0 msgr2=0x7fb6c406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:53.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.349+0000 7fb6c9dd8640 1 -- 172.21.15.123:0/1986933825 shutdown_connections 2024-09-15T23:16:53.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.349+0000 7fb6c9dd8640 1 -- 172.21.15.123:0/1986933825 wait complete. 2024-09-15T23:16:53.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.350+0000 7fb6c9dd8640 1 Processor -- start 2024-09-15T23:16:53.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.350+0000 7fb6c9dd8640 1 -- start start 2024-09-15T23:16:53.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.351+0000 7fb6c9dd8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb6c40ccf30 0x7fb6c40c9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.351+0000 7fb6c9dd8640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb6c40cead0 0x7fb6c4071d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.351+0000 7fb6c9dd8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6c415b7c0 0x7fb6c415bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.351+0000 7fb6c9dd8640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c40cef20 con 0x7fb6c415b7c0 2024-09-15T23:16:53.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.351+0000 7fb6c9dd8640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c40cf5c0 con 0x7fb6c40ccf30 2024-09-15T23:16:53.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.351+0000 7fb6c9dd8640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb6c40cf0a0 con 0x7fb6c40cead0 2024-09-15T23:16:53.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.351+0000 7fb6c3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6c415b7c0 0x7fb6c415bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.351+0000 7fb6c3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6c415b7c0 0x7fb6c415bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47830/0 (socket says 172.21.15.123:47830) 2024-09-15T23:16:53.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.351+0000 7fb6c3fff640 1 -- 172.21.15.123:0/1043038896 learned_addr learned my addr 172.21.15.123:0/1043038896 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:53.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.351+0000 7fb6c37fe640 1 --2- 172.21.15.123:0/1043038896 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb6c40ccf30 0x7fb6c40c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.351+0000 7fb6c2ffd640 1 --2- 172.21.15.123:0/1043038896 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb6c40cead0 0x7fb6c4071d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.352+0000 7fb6c3fff640 1 -- 172.21.15.123:0/1043038896 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb6c40cead0 msgr2=0x7fb6c4071d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:53.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.352+0000 7fb6c3fff640 1 --2- 172.21.15.123:0/1043038896 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb6c40cead0 0x7fb6c4071d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.352+0000 7fb6c3fff640 1 -- 172.21.15.123:0/1043038896 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb6c40ccf30 msgr2=0x7fb6c40c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:53.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.352+0000 7fb6c3fff640 1 --2- 172.21.15.123:0/1043038896 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb6c40ccf30 0x7fb6c40c9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.352+0000 7fb6c3fff640 1 -- 172.21.15.123:0/1043038896 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c4149c00 con 0x7fb6c415b7c0 2024-09-15T23:16:53.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.352+0000 7fb6c3fff640 1 --2- 172.21.15.123:0/1043038896 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6c415b7c0 0x7fb6c415bbd0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc00c780 tx=0x7fb6bc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:53.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.352+0000 7fb6abfff640 1 -- 172.21.15.123:0/1043038896 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc004b60 con 0x7fb6c415b7c0 2024-09-15T23:16:53.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.352+0000 7fb6abfff640 1 -- 172.21.15.123:0/1043038896 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6bc004d00 con 0x7fb6c415b7c0 2024-09-15T23:16:53.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.352+0000 7fb6c9dd8640 1 -- 172.21.15.123:0/1043038896 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6c40cc3e0 con 0x7fb6c415b7c0 2024-09-15T23:16:53.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.352+0000 7fb6abfff640 1 -- 172.21.15.123:0/1043038896 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc00aa90 con 0x7fb6c415b7c0 2024-09-15T23:16:53.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.352+0000 7fb6c9dd8640 1 -- 172.21.15.123:0/1043038896 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6c4149640 con 0x7fb6c415b7c0 2024-09-15T23:16:53.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.353+0000 7fb6c9dd8640 1 -- 172.21.15.123:0/1043038896 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6c40b2c50 con 0x7fb6c415b7c0 2024-09-15T23:16:53.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.353+0000 7fb6abfff640 1 -- 172.21.15.123:0/1043038896 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb6bc00ac30 con 0x7fb6c415b7c0 2024-09-15T23:16:53.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.354+0000 7fb6abfff640 1 --2- 172.21.15.123:0/1043038896 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb6b006c2b0 0x7fb6b006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.354+0000 7fb6abfff640 1 -- 172.21.15.123:0/1043038896 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5795+0+0 (secure 0 0 0) 0x7fb6bc08b570 con 0x7fb6c415b7c0 2024-09-15T23:16:53.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.354+0000 7fb6c37fe640 1 --2- 172.21.15.123:0/1043038896 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb6b006c2b0 0x7fb6b006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.354+0000 7fb6c37fe640 1 --2- 172.21.15.123:0/1043038896 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb6b006c2b0 0x7fb6b006e770 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4037000 tx=0x7fb6b4032000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:53.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.358+0000 7fb6abfff640 1 -- 172.21.15.123:0/1043038896 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb6bc020070 con 0x7fb6c415b7c0 2024-09-15T23:16:53.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.523+0000 7fb6c9dd8640 1 -- 172.21.15.123:0/1043038896 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7fb6c40cc960 con 0x7fb6c415b7c0 2024-09-15T23:16:53.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.526+0000 7fb6abfff640 1 -- 172.21.15.123:0/1043038896 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v27)=0 v27) ==== 117+0+0 (secure 0 0 0) 0x7fb6bc0596c0 con 0x7fb6c415b7c0 2024-09-15T23:16:53.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.529+0000 7fb6c9dd8640 1 -- 172.21.15.123:0/1043038896 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb6b006c2b0 msgr2=0x7fb6b006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:53.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.529+0000 7fb6c9dd8640 1 --2- 172.21.15.123:0/1043038896 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb6b006c2b0 0x7fb6b006e770 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb6b4037000 tx=0x7fb6b4032000 comp rx=0 tx=0).stop 2024-09-15T23:16:53.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.529+0000 7fb6c9dd8640 1 -- 172.21.15.123:0/1043038896 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6c415b7c0 msgr2=0x7fb6c415bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:53.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.529+0000 7fb6c9dd8640 1 --2- 172.21.15.123:0/1043038896 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6c415b7c0 0x7fb6c415bbd0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc00c780 tx=0x7fb6bc00cc40 comp rx=0 tx=0).stop 2024-09-15T23:16:53.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.529+0000 7fb6c9dd8640 1 -- 172.21.15.123:0/1043038896 shutdown_connections 2024-09-15T23:16:53.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.529+0000 7fb6c9dd8640 1 --2- 172.21.15.123:0/1043038896 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb6b006c2b0 0x7fb6b006e770 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.529+0000 7fb6c9dd8640 1 --2- 172.21.15.123:0/1043038896 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6c415b7c0 0x7fb6c415bbd0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.529+0000 7fb6c9dd8640 1 --2- 172.21.15.123:0/1043038896 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb6c40cead0 0x7fb6c4071d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.529+0000 7fb6c9dd8640 1 --2- 172.21.15.123:0/1043038896 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb6c40ccf30 0x7fb6c40c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.529+0000 7fb6c9dd8640 1 -- 172.21.15.123:0/1043038896 >> 172.21.15.123:0/1043038896 conn(0x7fb6c406d0f0 msgr2=0x7fb6c41518d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:53.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.529+0000 7fb6c9dd8640 1 -- 172.21.15.123:0/1043038896 shutdown_connections 2024-09-15T23:16:53.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.529+0000 7fb6c9dd8640 1 -- 172.21.15.123:0/1043038896 wait complete. 2024-09-15T23:16:53.541 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_merge_size 5 2024-09-15T23:16:53.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.642+0000 7f0891627640 1 Processor -- start 2024-09-15T23:16:53.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.642+0000 7f0891627640 1 -- start start 2024-09-15T23:16:53.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.643+0000 7f0891627640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f088c15c6d0 0x7f088c1608d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.643+0000 7f0891627640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f088c0cf070 0x7f088c0cf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.643+0000 7f0891627640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f088c0cdd30 con 0x7f088c0b7ce0 2024-09-15T23:16:53.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.643+0000 7f0891627640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f088c0cdfd0 con 0x7f088c15c6d0 2024-09-15T23:16:53.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.643+0000 7f0891627640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f088c0ce2b0 con 0x7f088c0cf070 2024-09-15T23:16:53.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.644+0000 7f088affd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f088c15c6d0 0x7f088c1608d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.644+0000 7f088b7fe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f088c0cf070 0x7f088c0cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.644+0000 7f088a7fc640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f088c0b7ce0 0x7f088c0d01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:50582/0 (socket says 172.21.15.123:50582) 2024-09-15T23:16:53.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.644+0000 7f088a7fc640 1 -- 172.21.15.123:0/4063859150 learned_addr learned my addr 172.21.15.123:0/4063859150 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:53.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.644+0000 7f088b7fe640 1 -- 172.21.15.123:0/4063859150 >> v2:172.21.15.188:3300/0 conn(0x7f088c15c6d0 msgr2=0x7f088c1608d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:53.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.644+0000 7f088b7fe640 1 --2- 172.21.15.123:0/4063859150 >> v2:172.21.15.188:3300/0 conn(0x7f088c15c6d0 0x7f088c1608d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.644+0000 7f088b7fe640 1 -- 172.21.15.123:0/4063859150 >> v1:172.21.15.188:6789/0 conn(0x7f088c0b7ce0 legacy=0x7f088c0d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:53.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.644+0000 7f088b7fe640 1 -- 172.21.15.123:0/4063859150 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f088c0ce590 con 0x7f088c0cf070 2024-09-15T23:16:53.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.644+0000 7f088affd640 1 --2- 172.21.15.123:0/4063859150 >> v2:172.21.15.188:3300/0 conn(0x7f088c15c6d0 0x7f088c1608d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:16:53.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.645+0000 7f088b7fe640 1 --2- 172.21.15.123:0/4063859150 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f088c0cf070 0x7f088c0cf500 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f08840097a0 tx=0x7f088402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3169c6d16951630b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:53.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.645+0000 7f0889ffb640 1 -- 172.21.15.123:0/4063859150 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0884037070 con 0x7f088c0cf070 2024-09-15T23:16:53.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.645+0000 7f0889ffb640 1 -- 172.21.15.123:0/4063859150 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0884032440 con 0x7f088c0cf070 2024-09-15T23:16:53.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.645+0000 7f0889ffb640 1 -- 172.21.15.123:0/4063859150 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0884032810 con 0x7f088c0cf070 2024-09-15T23:16:53.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.645+0000 7f0891627640 1 -- 172.21.15.123:0/4063859150 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f088c0cf070 msgr2=0x7f088c0cf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:53.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.645+0000 7f0891627640 1 --2- 172.21.15.123:0/4063859150 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f088c0cf070 0x7f088c0cf500 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f08840097a0 tx=0x7f088402a180 comp rx=0 tx=0).stop 2024-09-15T23:16:53.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.645+0000 7f0891627640 1 -- 172.21.15.123:0/4063859150 shutdown_connections 2024-09-15T23:16:53.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.645+0000 7f0891627640 1 --2- 172.21.15.123:0/4063859150 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f088c0cf070 0x7f088c0cf500 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.645+0000 7f0891627640 1 --2- 172.21.15.123:0/4063859150 >> v2:172.21.15.188:3300/0 conn(0x7f088c15c6d0 0x7f088c1608d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.645+0000 7f0891627640 1 -- 172.21.15.123:0/4063859150 >> 172.21.15.123:0/4063859150 conn(0x7f088c067f80 msgr2=0x7f088c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:53.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.646+0000 7f0891627640 1 -- 172.21.15.123:0/4063859150 shutdown_connections 2024-09-15T23:16:53.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.646+0000 7f0891627640 1 -- 172.21.15.123:0/4063859150 wait complete. 2024-09-15T23:16:53.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.647+0000 7f0891627640 1 Processor -- start 2024-09-15T23:16:53.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.647+0000 7f0891627640 1 -- start start 2024-09-15T23:16:53.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.648+0000 7f0891627640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f088c0b7ce0 0x7f088c0b0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.648+0000 7f0891627640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f088c0cf070 0x7f088c155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.648+0000 7f0891627640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f088c15c6d0 0x7f088c06dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.648+0000 7f0891627640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f088c0d08c0 con 0x7f088c15c6d0 2024-09-15T23:16:53.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.648+0000 7f0891627640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f088c0ceb50 con 0x7f088c0b7ce0 2024-09-15T23:16:53.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.648+0000 7f0891627640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f088c160e10 con 0x7f088c0cf070 2024-09-15T23:16:53.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.648+0000 7f088b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f088c15c6d0 0x7f088c06dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.648+0000 7f088b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f088c15c6d0 0x7f088c06dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47842/0 (socket says 172.21.15.123:47842) 2024-09-15T23:16:53.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.648+0000 7f088b7fe640 1 -- 172.21.15.123:0/3687716050 learned_addr learned my addr 172.21.15.123:0/3687716050 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:53.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.648+0000 7f088affd640 1 --2- 172.21.15.123:0/3687716050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f088c0b7ce0 0x7f088c0b0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.648+0000 7f088a7fc640 1 --2- 172.21.15.123:0/3687716050 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f088c0cf070 0x7f088c155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.648+0000 7f088b7fe640 1 -- 172.21.15.123:0/3687716050 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f088c0cf070 msgr2=0x7f088c155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:53.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.648+0000 7f088b7fe640 1 --2- 172.21.15.123:0/3687716050 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f088c0cf070 0x7f088c155ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.648+0000 7f088b7fe640 1 -- 172.21.15.123:0/3687716050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f088c0b7ce0 msgr2=0x7f088c0b0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:53.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.648+0000 7f088b7fe640 1 --2- 172.21.15.123:0/3687716050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f088c0b7ce0 0x7f088c0b0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.648+0000 7f088b7fe640 1 -- 172.21.15.123:0/3687716050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f088c06d7d0 con 0x7f088c15c6d0 2024-09-15T23:16:53.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.648+0000 7f088b7fe640 1 --2- 172.21.15.123:0/3687716050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f088c15c6d0 0x7f088c06dcb0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f0884035040 tx=0x7f08840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:53.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.648+0000 7f08737fe640 1 -- 172.21.15.123:0/3687716050 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0884037040 con 0x7f088c15c6d0 2024-09-15T23:16:53.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.648+0000 7f08737fe640 1 -- 172.21.15.123:0/3687716050 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0884042070 con 0x7f088c15c6d0 2024-09-15T23:16:53.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.648+0000 7f0891627640 1 -- 172.21.15.123:0/3687716050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f088c155ff0 con 0x7f088c15c6d0 2024-09-15T23:16:53.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.648+0000 7f08737fe640 1 -- 172.21.15.123:0/3687716050 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08840308a0 con 0x7f088c15c6d0 2024-09-15T23:16:53.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.648+0000 7f0891627640 1 -- 172.21.15.123:0/3687716050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f088c0af330 con 0x7f088c15c6d0 2024-09-15T23:16:53.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.649+0000 7f0891627640 1 -- 172.21.15.123:0/3687716050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f088c069180 con 0x7f088c15c6d0 2024-09-15T23:16:53.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.650+0000 7f08737fe640 1 -- 172.21.15.123:0/3687716050 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0884030a40 con 0x7f088c15c6d0 2024-09-15T23:16:53.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.650+0000 7f08737fe640 1 --2- 172.21.15.123:0/3687716050 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f087806c2b0 0x7f087806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.650+0000 7f08737fe640 1 -- 172.21.15.123:0/3687716050 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5795+0+0 (secure 0 0 0) 0x7f08840abd00 con 0x7f088c15c6d0 2024-09-15T23:16:53.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.651+0000 7f088affd640 1 --2- 172.21.15.123:0/3687716050 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f087806c2b0 0x7f087806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.651+0000 7f088affd640 1 --2- 172.21.15.123:0/3687716050 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f087806c2b0 0x7f087806e770 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f087c009bd0 tx=0x7f087c00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:53.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.655+0000 7f08737fe640 1 -- 172.21.15.123:0/3687716050 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0884079cb0 con 0x7f088c15c6d0 2024-09-15T23:16:53.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.821+0000 7f0891627640 1 -- 172.21.15.123:0/3687716050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f088c1608b0 con 0x7f088c15c6d0 2024-09-15T23:16:53.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.826+0000 7f08737fe640 1 -- 172.21.15.123:0/3687716050 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v28)=0 v28) ==== 116+0+0 (secure 0 0 0) 0x7f088407dfb0 con 0x7f088c15c6d0 2024-09-15T23:16:53.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.829+0000 7f0891627640 1 -- 172.21.15.123:0/3687716050 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f087806c2b0 msgr2=0x7f087806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:53.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.829+0000 7f0891627640 1 --2- 172.21.15.123:0/3687716050 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f087806c2b0 0x7f087806e770 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f087c009bd0 tx=0x7f087c00b040 comp rx=0 tx=0).stop 2024-09-15T23:16:53.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.829+0000 7f0891627640 1 -- 172.21.15.123:0/3687716050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f088c15c6d0 msgr2=0x7f088c06dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:53.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.829+0000 7f0891627640 1 --2- 172.21.15.123:0/3687716050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f088c15c6d0 0x7f088c06dcb0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f0884035040 tx=0x7f08840046c0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.829+0000 7f0891627640 1 -- 172.21.15.123:0/3687716050 shutdown_connections 2024-09-15T23:16:53.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.829+0000 7f0891627640 1 --2- 172.21.15.123:0/3687716050 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f087806c2b0 0x7f087806e770 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.829+0000 7f0891627640 1 --2- 172.21.15.123:0/3687716050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f088c15c6d0 0x7f088c06dcb0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.829+0000 7f0891627640 1 --2- 172.21.15.123:0/3687716050 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f088c0cf070 0x7f088c155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.829+0000 7f0891627640 1 --2- 172.21.15.123:0/3687716050 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f088c0b7ce0 0x7f088c0b0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.829+0000 7f0891627640 1 -- 172.21.15.123:0/3687716050 >> 172.21.15.123:0/3687716050 conn(0x7f088c067f80 msgr2=0x7f088c0b22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:53.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.829+0000 7f0891627640 1 -- 172.21.15.123:0/3687716050 shutdown_connections 2024-09-15T23:16:53.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.829+0000 7f0891627640 1 -- 172.21.15.123:0/3687716050 wait complete. 2024-09-15T23:16:53.841 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_bal_split_bits 1 2024-09-15T23:16:53.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.941+0000 7f39066e6640 1 Processor -- start 2024-09-15T23:16:53.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.941+0000 7f39066e6640 1 -- start start 2024-09-15T23:16:53.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.941+0000 7f39066e6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f390006bfd0 0x7f390006c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.941+0000 7f39066e6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39000d3930 0x7f3900162ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.941+0000 7f39066e6640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f390006c8f0 con 0x7f39000b3350 2024-09-15T23:16:53.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.941+0000 7f39066e6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f39000b78a0 con 0x7f390006bfd0 2024-09-15T23:16:53.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.941+0000 7f39066e6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f39000cffb0 con 0x7f39000d3930 2024-09-15T23:16:53.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.942+0000 7f38ff7fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f39000b3350 0x7f39001623a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51572/0 (socket says 172.21.15.123:51572) 2024-09-15T23:16:53.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.942+0000 7f38ff7fe640 1 -- 172.21.15.123:0/1565251514 learned_addr learned my addr 172.21.15.123:0/1565251514 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:53.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.942+0000 7f38fffff640 1 --2- 172.21.15.123:0/1565251514 >> v2:172.21.15.188:3300/0 conn(0x7f390006bfd0 0x7f390006c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.942+0000 7f3904c83640 1 --2- 172.21.15.123:0/1565251514 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39000d3930 0x7f3900162ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.942+0000 7f38feffd640 1 -- 172.21.15.123:0/1565251514 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1378005764 0 0) 0x7f390006c8f0 con 0x7f39000b3350 2024-09-15T23:16:53.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.942+0000 7f38feffd640 1 -- 172.21.15.123:0/1565251514 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38e8003520 con 0x7f39000b3350 2024-09-15T23:16:53.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.942+0000 7f38feffd640 1 -- 172.21.15.123:0/1565251514 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2074941330 0 0) 0x7f38e8003520 con 0x7f39000b3350 2024-09-15T23:16:53.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.942+0000 7f38feffd640 1 -- 172.21.15.123:0/1565251514 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39000d3930 msgr2=0x7f3900162ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:53.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.942+0000 7f38feffd640 1 --2- 172.21.15.123:0/1565251514 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39000d3930 0x7f3900162ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.942+0000 7f38feffd640 1 -- 172.21.15.123:0/1565251514 >> v2:172.21.15.188:3300/0 conn(0x7f390006bfd0 msgr2=0x7f390006c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:53.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.942+0000 7f38feffd640 1 --2- 172.21.15.123:0/1565251514 >> v2:172.21.15.188:3300/0 conn(0x7f390006bfd0 0x7f390006c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.942+0000 7f38feffd640 1 -- 172.21.15.123:0/1565251514 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39000cf710 con 0x7f39000b3350 2024-09-15T23:16:53.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.942+0000 7f38feffd640 1 -- 172.21.15.123:0/1565251514 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f38f4001670 con 0x7f39000b3350 2024-09-15T23:16:53.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.942+0000 7f38feffd640 1 -- 172.21.15.123:0/1565251514 >> v1:172.21.15.123:6789/0 conn(0x7f39000b3350 legacy=0x7f39001623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:53.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.942+0000 7f38feffd640 1 --2- 172.21.15.123:0/1565251514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38e80039e0 0x7f38e8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.942+0000 7f38feffd640 1 --2- 172.21.15.123:0/1565251514 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39000d3930 0x7f38e8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.942+0000 7f38feffd640 1 --2- 172.21.15.123:0/1565251514 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f38e8004d40 0x7f38e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.942+0000 7f38feffd640 1 -- 172.21.15.123:0/1565251514 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f39000cffb0 con 0x7f38e80039e0 2024-09-15T23:16:53.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.942+0000 7f38feffd640 1 -- 172.21.15.123:0/1565251514 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f38e800b9c0 con 0x7f38e8004d40 2024-09-15T23:16:53.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.942+0000 7f38feffd640 1 -- 172.21.15.123:0/1565251514 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f38e800bb40 con 0x7f39000d3930 2024-09-15T23:16:53.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.942+0000 7f38fffff640 1 --2- 172.21.15.123:0/1565251514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38e80039e0 0x7f38e8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.942+0000 7f38ff7fe640 1 --2- 172.21.15.123:0/1565251514 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39000d3930 0x7f38e8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.942+0000 7f3904c83640 1 --2- 172.21.15.123:0/1565251514 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f38e8004d40 0x7f38e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.943+0000 7f38fffff640 1 -- 172.21.15.123:0/1565251514 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39000d3930 msgr2=0x7f38e8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:53.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.943+0000 7f38fffff640 1 --2- 172.21.15.123:0/1565251514 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39000d3930 0x7f38e8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.943+0000 7f38fffff640 1 -- 172.21.15.123:0/1565251514 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f38e8004d40 msgr2=0x7f38e80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:53.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.943+0000 7f38fffff640 1 --2- 172.21.15.123:0/1565251514 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f38e8004d40 0x7f38e80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.943+0000 7f38fffff640 1 -- 172.21.15.123:0/1565251514 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38e8003520 con 0x7f38e80039e0 2024-09-15T23:16:53.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.943+0000 7f38ff7fe640 1 --2- 172.21.15.123:0/1565251514 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39000d3930 0x7f38e8004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:16:53.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.943+0000 7f38fffff640 1 --2- 172.21.15.123:0/1565251514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38e80039e0 0x7f38e8003e00 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f38f0009ac0 tx=0x7f38e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e2a3423911e44 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:53.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.943+0000 7f38feffd640 1 -- 172.21.15.123:0/1565251514 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f0036070 con 0x7f38e80039e0 2024-09-15T23:16:53.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.943+0000 7f38feffd640 1 -- 172.21.15.123:0/1565251514 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38f0031400 con 0x7f38e80039e0 2024-09-15T23:16:53.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.943+0000 7f38feffd640 1 -- 172.21.15.123:0/1565251514 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f0009690 con 0x7f38e80039e0 2024-09-15T23:16:53.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.944+0000 7f39066e6640 1 -- 172.21.15.123:0/1565251514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38e80039e0 msgr2=0x7f38e8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:53.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.944+0000 7f39066e6640 1 --2- 172.21.15.123:0/1565251514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38e80039e0 0x7f38e8003e00 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f38f0009ac0 tx=0x7f38e8005830 comp rx=0 tx=0).stop 2024-09-15T23:16:53.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.944+0000 7f3904c83640 1 -- 172.21.15.123:0/1565251514 reap_dead start 2024-09-15T23:16:53.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.944+0000 7f39066e6640 1 -- 172.21.15.123:0/1565251514 shutdown_connections 2024-09-15T23:16:53.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.944+0000 7f39066e6640 1 -- 172.21.15.123:0/1565251514 >> 172.21.15.123:0/1565251514 conn(0x7f39000d11c0 msgr2=0x7f39000d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:53.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.944+0000 7f39066e6640 1 -- 172.21.15.123:0/1565251514 shutdown_connections 2024-09-15T23:16:53.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.944+0000 7f39066e6640 1 -- 172.21.15.123:0/1565251514 wait complete. 2024-09-15T23:16:53.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.945+0000 7f39066e6640 1 Processor -- start 2024-09-15T23:16:53.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.945+0000 7f39066e6640 1 -- start start 2024-09-15T23:16:53.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.946+0000 7f39066e6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38e80039e0 0x7f3900156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.946+0000 7f39066e6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39001619f0 0x7f39000c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.946+0000 7f39066e6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39000ca430 0x7f39000cb780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.946+0000 7f39066e6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f39000d2400 con 0x7f38e80039e0 2024-09-15T23:16:53.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.946+0000 7f39066e6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f39000cfcd0 con 0x7f39001619f0 2024-09-15T23:16:53.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.946+0000 7f39066e6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f390006cd50 con 0x7f39000ca430 2024-09-15T23:16:53.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.946+0000 7f38fffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38e80039e0 0x7f3900156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.946+0000 7f38fffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38e80039e0 0x7f3900156840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47856/0 (socket says 172.21.15.123:47856) 2024-09-15T23:16:53.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.946+0000 7f38fffff640 1 -- 172.21.15.123:0/2091131641 learned_addr learned my addr 172.21.15.123:0/2091131641 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:53.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.946+0000 7f38ff7fe640 1 --2- 172.21.15.123:0/2091131641 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39001619f0 0x7f39000c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.946+0000 7f3904c83640 1 --2- 172.21.15.123:0/2091131641 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39000ca430 0x7f39000cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.946+0000 7f38fffff640 1 -- 172.21.15.123:0/2091131641 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39000ca430 msgr2=0x7f39000cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:53.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.946+0000 7f38fffff640 1 --2- 172.21.15.123:0/2091131641 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39000ca430 0x7f39000cb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.946+0000 7f38fffff640 1 -- 172.21.15.123:0/2091131641 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39001619f0 msgr2=0x7f39000c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:53.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.946+0000 7f38fffff640 1 --2- 172.21.15.123:0/2091131641 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39001619f0 0x7f39000c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:53.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.946+0000 7f38fffff640 1 -- 172.21.15.123:0/2091131641 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39000cb070 con 0x7f38e80039e0 2024-09-15T23:16:53.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.947+0000 7f38fffff640 1 --2- 172.21.15.123:0/2091131641 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38e80039e0 0x7f3900156840 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f38f0034040 tx=0x7f38f0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:53.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.947+0000 7f38fcff9640 1 -- 172.21.15.123:0/2091131641 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f0040020 con 0x7f38e80039e0 2024-09-15T23:16:53.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.947+0000 7f38fcff9640 1 -- 172.21.15.123:0/2091131641 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38f0003920 con 0x7f38e80039e0 2024-09-15T23:16:53.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.947+0000 7f39066e6640 1 -- 172.21.15.123:0/2091131641 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39000cad90 con 0x7f38e80039e0 2024-09-15T23:16:53.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.947+0000 7f38fcff9640 1 -- 172.21.15.123:0/2091131641 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f0036040 con 0x7f38e80039e0 2024-09-15T23:16:53.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.947+0000 7f39066e6640 1 -- 172.21.15.123:0/2091131641 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39001611f0 con 0x7f38e80039e0 2024-09-15T23:16:53.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.948+0000 7f39066e6640 1 -- 172.21.15.123:0/2091131641 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f390015eae0 con 0x7f38e80039e0 2024-09-15T23:16:53.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.948+0000 7f38fcff9640 1 -- 172.21.15.123:0/2091131641 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f38f0043020 con 0x7f38e80039e0 2024-09-15T23:16:53.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.949+0000 7f38fcff9640 1 --2- 172.21.15.123:0/2091131641 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f38ec06c2e0 0x7f38ec06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:53.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.949+0000 7f38fcff9640 1 -- 172.21.15.123:0/2091131641 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5795+0+0 (secure 0 0 0) 0x7f38f00ab400 con 0x7f38e80039e0 2024-09-15T23:16:53.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.949+0000 7f38ff7fe640 1 --2- 172.21.15.123:0/2091131641 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f38ec06c2e0 0x7f38ec06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:53.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.949+0000 7f38ff7fe640 1 --2- 172.21.15.123:0/2091131641 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f38ec06c2e0 0x7f38ec06e7a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f39001f8510 tx=0x7f38f4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:53.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:53.953+0000 7f38fcff9640 1 -- 172.21.15.123:0/2091131641 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f38f004a070 con 0x7f38e80039e0 2024-09-15T23:16:54.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.117+0000 7f39066e6640 1 -- 172.21.15.123:0/2091131641 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f390006c8a0 con 0x7f38e80039e0 2024-09-15T23:16:54.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.121+0000 7f38fcff9640 1 -- 172.21.15.123:0/2091131641 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v29)=0 v29) ==== 116+0+0 (secure 0 0 0) 0x7f38f0079ba0 con 0x7f38e80039e0 2024-09-15T23:16:54.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.123+0000 7f39066e6640 1 -- 172.21.15.123:0/2091131641 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f38ec06c2e0 msgr2=0x7f38ec06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:54.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.123+0000 7f39066e6640 1 --2- 172.21.15.123:0/2091131641 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f38ec06c2e0 0x7f38ec06e7a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f39001f8510 tx=0x7f38f4009040 comp rx=0 tx=0).stop 2024-09-15T23:16:54.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.123+0000 7f39066e6640 1 -- 172.21.15.123:0/2091131641 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38e80039e0 msgr2=0x7f3900156840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:54.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.123+0000 7f39066e6640 1 --2- 172.21.15.123:0/2091131641 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38e80039e0 0x7f3900156840 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f38f0034040 tx=0x7f38f0004730 comp rx=0 tx=0).stop 2024-09-15T23:16:54.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.123+0000 7f39066e6640 1 -- 172.21.15.123:0/2091131641 shutdown_connections 2024-09-15T23:16:54.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.123+0000 7f39066e6640 1 --2- 172.21.15.123:0/2091131641 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39000ca430 0x7f39000cb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.123+0000 7f39066e6640 1 --2- 172.21.15.123:0/2091131641 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39001619f0 0x7f39000c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.123+0000 7f39066e6640 1 --2- 172.21.15.123:0/2091131641 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f38ec06c2e0 0x7f38ec06e7a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.123+0000 7f39066e6640 1 --2- 172.21.15.123:0/2091131641 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38e80039e0 0x7f3900156840 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.123+0000 7f39066e6640 1 -- 172.21.15.123:0/2091131641 >> 172.21.15.123:0/2091131641 conn(0x7f39000d11c0 msgr2=0x7f39000b9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:54.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.123+0000 7f39066e6640 1 -- 172.21.15.123:0/2091131641 shutdown_connections 2024-09-15T23:16:54.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.123+0000 7f39066e6640 1 -- 172.21.15.123:0/2091131641 wait complete. 2024-09-15T23:16:54.135 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:16:54.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.232+0000 7f406d1a8640 1 Processor -- start 2024-09-15T23:16:54.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.232+0000 7f406d1a8640 1 -- start start 2024-09-15T23:16:54.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.233+0000 7f406d1a8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f406806c320 0x7f406815bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:54.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.233+0000 7f406d1a8640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f406813eb20 0x7f406815c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:54.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.233+0000 7f406d1a8640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4068071180 con 0x7f40680b2d40 2024-09-15T23:16:54.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.233+0000 7f406d1a8640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f4068071ab0 con 0x7f406806c320 2024-09-15T23:16:54.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.233+0000 7f406d1a8640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4068071460 con 0x7f406813eb20 2024-09-15T23:16:54.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.233+0000 7f405e59c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f406806c320 0x7f406815bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:54.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.233+0000 7f406759e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f406813eb20 0x7f406815c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:54.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.233+0000 7f4066d9d640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f40680b2d40 0x7f406806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:50590/0 (socket says 172.21.15.123:50590) 2024-09-15T23:16:54.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.233+0000 7f4066d9d640 1 -- 172.21.15.123:0/23316280 learned_addr learned my addr 172.21.15.123:0/23316280 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:54.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.233+0000 7f405e59c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f406806c320 0x7f406815bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:52726/0 (socket says 172.21.15.123:52726) 2024-09-15T23:16:54.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.234+0000 7f406659c640 1 -- 172.21.15.123:0/23316280 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1073833581 0 0) 0x7f4068071180 con 0x7f40680b2d40 2024-09-15T23:16:54.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.234+0000 7f406659c640 1 -- 172.21.15.123:0/23316280 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4054003520 con 0x7f40680b2d40 2024-09-15T23:16:54.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.234+0000 7f405e59c640 1 -- 172.21.15.123:0/23316280 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f406813eb20 msgr2=0x7f406815c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:54.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.234+0000 7f405e59c640 1 --2- 172.21.15.123:0/23316280 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f406813eb20 0x7f406815c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.234+0000 7f405e59c640 1 -- 172.21.15.123:0/23316280 >> v1:172.21.15.188:6789/0 conn(0x7f40680b2d40 legacy=0x7f406806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:54.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.234+0000 7f405e59c640 1 -- 172.21.15.123:0/23316280 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4068071740 con 0x7f406806c320 2024-09-15T23:16:54.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.234+0000 7f406759e640 1 --2- 172.21.15.123:0/23316280 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f406813eb20 0x7f406815c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:16:54.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.235+0000 7f405e59c640 1 --2- 172.21.15.123:0/23316280 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f406806c320 0x7f406815bcf0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f40500097a0 tx=0x7f405002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68be6d8f391d8c05 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:54.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.235+0000 7f406659c640 1 -- 172.21.15.123:0/23316280 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4050037070 con 0x7f406806c320 2024-09-15T23:16:54.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.235+0000 7f406659c640 1 -- 172.21.15.123:0/23316280 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4050032440 con 0x7f406806c320 2024-09-15T23:16:54.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.235+0000 7f406659c640 1 -- 172.21.15.123:0/23316280 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4050032810 con 0x7f406806c320 2024-09-15T23:16:54.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.235+0000 7f406d1a8640 1 -- 172.21.15.123:0/23316280 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f406806c320 msgr2=0x7f406815bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:54.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.235+0000 7f406d1a8640 1 --2- 172.21.15.123:0/23316280 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f406806c320 0x7f406815bcf0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f40500097a0 tx=0x7f405002a180 comp rx=0 tx=0).stop 2024-09-15T23:16:54.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.235+0000 7f406d1a8640 1 -- 172.21.15.123:0/23316280 shutdown_connections 2024-09-15T23:16:54.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.235+0000 7f406d1a8640 1 --2- 172.21.15.123:0/23316280 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f406806c320 0x7f406815bcf0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.235+0000 7f406d1a8640 1 --2- 172.21.15.123:0/23316280 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f406813eb20 0x7f406815c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.235+0000 7f406d1a8640 1 -- 172.21.15.123:0/23316280 >> 172.21.15.123:0/23316280 conn(0x7f40680ccec0 msgr2=0x7f40680cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:54.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.235+0000 7f406d1a8640 1 -- 172.21.15.123:0/23316280 shutdown_connections 2024-09-15T23:16:54.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.235+0000 7f406d1a8640 1 -- 172.21.15.123:0/23316280 wait complete. 2024-09-15T23:16:54.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.237+0000 7f406d1a8640 1 Processor -- start 2024-09-15T23:16:54.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.237+0000 7f406d1a8640 1 -- start start 2024-09-15T23:16:54.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.238+0000 7f406d1a8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f406806c320 0x7f40681f8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:54.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.238+0000 7f406d1a8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f40680b2d40 0x7f40681672c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:54.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.238+0000 7f406d1a8640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f406813eb20 0x7f406815ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:54.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.238+0000 7f406d1a8640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f40680720c0 con 0x7f406806c320 2024-09-15T23:16:54.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.238+0000 7f406d1a8640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4068071f40 con 0x7f40680b2d40 2024-09-15T23:16:54.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.238+0000 7f406d1a8640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4068072240 con 0x7f406813eb20 2024-09-15T23:16:54.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.238+0000 7f4066d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f406806c320 0x7f40681f8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:54.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.238+0000 7f4066d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f406806c320 0x7f40681f8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47870/0 (socket says 172.21.15.123:47870) 2024-09-15T23:16:54.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.238+0000 7f4066d9d640 1 -- 172.21.15.123:0/1180174082 learned_addr learned my addr 172.21.15.123:0/1180174082 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:54.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.238+0000 7f405e59c640 1 --2- 172.21.15.123:0/1180174082 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f40680b2d40 0x7f40681672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:54.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.238+0000 7f406759e640 1 --2- 172.21.15.123:0/1180174082 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f406813eb20 0x7f406815ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:54.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.238+0000 7f4066d9d640 1 -- 172.21.15.123:0/1180174082 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f406813eb20 msgr2=0x7f406815ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:54.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.238+0000 7f4066d9d640 1 --2- 172.21.15.123:0/1180174082 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f406813eb20 0x7f406815ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.238+0000 7f4066d9d640 1 -- 172.21.15.123:0/1180174082 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f40680b2d40 msgr2=0x7f40681672c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:54.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.238+0000 7f4066d9d640 1 --2- 172.21.15.123:0/1180174082 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f40680b2d40 0x7f40681672c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.238+0000 7f4066d9d640 1 -- 172.21.15.123:0/1180174082 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40681f8dc0 con 0x7f406806c320 2024-09-15T23:16:54.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.238+0000 7f4066d9d640 1 --2- 172.21.15.123:0/1180174082 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f406806c320 0x7f40681f8880 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f405800c430 tx=0x7f405800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:54.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.238+0000 7f405ffff640 1 -- 172.21.15.123:0/1180174082 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4058017070 con 0x7f406806c320 2024-09-15T23:16:54.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.238+0000 7f405ffff640 1 -- 172.21.15.123:0/1180174082 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4058005ce0 con 0x7f406806c320 2024-09-15T23:16:54.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.238+0000 7f406d1a8640 1 -- 172.21.15.123:0/1180174082 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4068168340 con 0x7f406806c320 2024-09-15T23:16:54.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.238+0000 7f405ffff640 1 -- 172.21.15.123:0/1180174082 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40580072f0 con 0x7f406806c320 2024-09-15T23:16:54.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.238+0000 7f406d1a8640 1 -- 172.21.15.123:0/1180174082 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4068168060 con 0x7f406806c320 2024-09-15T23:16:54.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.239+0000 7f406d1a8640 1 -- 172.21.15.123:0/1180174082 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f406806bc10 con 0x7f406806c320 2024-09-15T23:16:54.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.240+0000 7f405ffff640 1 -- 172.21.15.123:0/1180174082 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f405801a070 con 0x7f406806c320 2024-09-15T23:16:54.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.240+0000 7f405ffff640 1 --2- 172.21.15.123:0/1180174082 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f404806c2b0 0x7f404806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:54.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.240+0000 7f405ffff640 1 -- 172.21.15.123:0/1180174082 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5795+0+0 (secure 0 0 0) 0x7f405808a7f0 con 0x7f406806c320 2024-09-15T23:16:54.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.241+0000 7f405e59c640 1 --2- 172.21.15.123:0/1180174082 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f404806c2b0 0x7f404806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:54.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.241+0000 7f405e59c640 1 --2- 172.21.15.123:0/1180174082 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f404806c2b0 0x7f404806e770 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4050034000 tx=0x7f405002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:54.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.245+0000 7f405ffff640 1 -- 172.21.15.123:0/1180174082 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f40580588c0 con 0x7f406806c320 2024-09-15T23:16:54.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.446+0000 7f406d1a8640 1 -- 172.21.15.123:0/1180174082 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f406806c9c0 con 0x7f406806c320 2024-09-15T23:16:54.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.447+0000 7f405ffff640 1 -- 172.21.15.123:0/1180174082 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5236 (secure 0 0 0) 0x7f405805cbc0 con 0x7f406806c320 2024-09-15T23:16:54.448 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:16:54.448 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":66,"btime":"2024-09-15T23:16:51:834717+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6556,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/488079964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":488079964},{"type":"v1","addr":"172.21.15.188:6835","nonce":488079964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/4123673242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":4123673242},{"type":"v1","addr":"172.21.15.188:6837","nonce":4123673242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":7356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/2179085155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2179085155},{"type":"v1","addr":"172.21.15.123:6833","nonce":2179085155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:16:35.080780+0000","modified":"2024-09-15T23:16:51.834712+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7365":{"gid":7365,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6835/2621254224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2621254224},{"type":"v1","addr":"172.21.15.123:6835","nonce":2621254224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7365,"qdb_cluster":[7365]},"id":6}]} 2024-09-15T23:16:54.448 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 66 2024-09-15T23:16:54.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.448+0000 7f406d1a8640 1 -- 172.21.15.123:0/1180174082 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f404806c2b0 msgr2=0x7f404806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:54.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.448+0000 7f406d1a8640 1 --2- 172.21.15.123:0/1180174082 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f404806c2b0 0x7f404806e770 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4050034000 tx=0x7f405002e000 comp rx=0 tx=0).stop 2024-09-15T23:16:54.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.449+0000 7f406d1a8640 1 -- 172.21.15.123:0/1180174082 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f406806c320 msgr2=0x7f40681f8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:54.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.449+0000 7f406d1a8640 1 --2- 172.21.15.123:0/1180174082 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f406806c320 0x7f40681f8880 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f405800c430 tx=0x7f405800c830 comp rx=0 tx=0).stop 2024-09-15T23:16:54.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.449+0000 7f406d1a8640 1 -- 172.21.15.123:0/1180174082 shutdown_connections 2024-09-15T23:16:54.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.449+0000 7f406d1a8640 1 --2- 172.21.15.123:0/1180174082 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f406813eb20 0x7f406815ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.449+0000 7f406d1a8640 1 --2- 172.21.15.123:0/1180174082 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f40680b2d40 0x7f40681672c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.449+0000 7f406d1a8640 1 --2- 172.21.15.123:0/1180174082 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f404806c2b0 0x7f404806e770 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.449+0000 7f406d1a8640 1 --2- 172.21.15.123:0/1180174082 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f406806c320 0x7f40681f8880 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.449+0000 7f406d1a8640 1 -- 172.21.15.123:0/1180174082 >> 172.21.15.123:0/1180174082 conn(0x7f40680ccec0 msgr2=0x7f406813d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:54.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.449+0000 7f406d1a8640 1 -- 172.21.15.123:0/1180174082 shutdown_connections 2024-09-15T23:16:54.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.449+0000 7f406d1a8640 1 -- 172.21.15.123:0/1180174082 wait complete. 2024-09-15T23:16:54.461 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump inode 1099511627776 2024-09-15T23:16:54.575 INFO:teuthology.orchestra.run.smithi123.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-15T23:16:46.520862+0000","btime":"2024-09-15T23:16:45.773879+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-15T23:16:46.520862+0000","atime":"2024-09-15T23:16:45.773879+0000","time_warp_seq":0,"change_attr":21,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-15T23:16:46.520862+0000","num_files":21,"num_subdirs":0,"change_attr":21},"rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-15T23:16:46.520862+0000"},"accounted_rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-15T23:16:46.520862+0000"},"version":128,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{},"nref":0,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-15T23:16:54.576 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 32, "rctime": "2024-09-15T23:16:46.520862+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-15T23:16:45.773879+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-15T23:16:45.773879+0000", "change_attr": 21, "client_caps": [], "client_ranges": [], "ctime": "2024-09-15T23:16:46.520862+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 21, "mtime": "2024-09-15T23:16:46.520862+0000", "num_files": 21, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1333, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-15T23:16:46.520862+0000", "nestlock": {}, "nlink": 1, "nref": 0, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": {}, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 32, "rctime": "2024-09-15T23:16:46.520862+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 128, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-15T23:16:54.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:16:54.576 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /testdir recursive 2024-09-15T23:16:54.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.678+0000 7f50653bd640 1 Processor -- start 2024-09-15T23:16:54.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.679+0000 7f50653bd640 1 -- start start 2024-09-15T23:16:54.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.679+0000 7f50653bd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f50600b2370 0x7f50600cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:54.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.679+0000 7f50653bd640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50600b0680 con 0x7f5060155b20 2024-09-15T23:16:54.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.679+0000 7f50653bd640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50600ccf70 con 0x7f50600cf960 2024-09-15T23:16:54.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.679+0000 7f50653bd640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f50600b01e0 con 0x7f50600b2370 2024-09-15T23:16:54.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.679+0000 7f50567fc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f50600b2370 0x7f50600cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:54.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.679+0000 7f505effd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f5060155b20 0x7f50600b1c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51574/0 (socket says 172.21.15.123:51574) 2024-09-15T23:16:54.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.680+0000 7f505effd640 1 -- 172.21.15.123:0/105425843 learned_addr learned my addr 172.21.15.123:0/105425843 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:16:54.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.680+0000 7f50567fc640 1 -- 172.21.15.123:0/105425843 >> v1:172.21.15.188:6789/0 conn(0x7f50600cf960 legacy=0x7f506015c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:54.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.680+0000 7f50567fc640 1 -- 172.21.15.123:0/105425843 >> v1:172.21.15.123:6789/0 conn(0x7f5060155b20 legacy=0x7f50600b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:54.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.680+0000 7f50567fc640 1 -- 172.21.15.123:0/105425843 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50600ce940 con 0x7f50600b2370 2024-09-15T23:16:54.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.680+0000 7f505e7fc640 1 -- 172.21.15.123:0/105425843 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2996271103 0 0) 0x7f50600b0680 con 0x7f5060155b20 2024-09-15T23:16:54.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.681+0000 7f50567fc640 1 --2- 172.21.15.123:0/105425843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50600b2370 0x7f50600cf420 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f504800ba40 tx=0x7f504802c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54724ac7e54f5308 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:54.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.681+0000 7f505e7fc640 1 -- 172.21.15.123:0/105425843 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f504802f070 con 0x7f50600b2370 2024-09-15T23:16:54.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.681+0000 7f505e7fc640 1 -- 172.21.15.123:0/105425843 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5048038070 con 0x7f50600b2370 2024-09-15T23:16:54.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.681+0000 7f505e7fc640 1 -- 172.21.15.123:0/105425843 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5048032a00 con 0x7f50600b2370 2024-09-15T23:16:54.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.681+0000 7f50653bd640 1 -- 172.21.15.123:0/105425843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50600b2370 msgr2=0x7f50600cf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:54.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.681+0000 7f50653bd640 1 --2- 172.21.15.123:0/105425843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50600b2370 0x7f50600cf420 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f504800ba40 tx=0x7f504802c8e0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.681+0000 7f50653bd640 1 -- 172.21.15.123:0/105425843 shutdown_connections 2024-09-15T23:16:54.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.681+0000 7f50653bd640 1 --2- 172.21.15.123:0/105425843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50600b2370 0x7f50600cf420 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.681+0000 7f50653bd640 1 -- 172.21.15.123:0/105425843 >> 172.21.15.123:0/105425843 conn(0x7f506006c240 msgr2=0x7f506006d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:54.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.681+0000 7f50653bd640 1 -- 172.21.15.123:0/105425843 shutdown_connections 2024-09-15T23:16:54.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.681+0000 7f50653bd640 1 -- 172.21.15.123:0/105425843 wait complete. 2024-09-15T23:16:54.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.682+0000 7f50653bd640 1 Processor -- start 2024-09-15T23:16:54.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.683+0000 7f50653bd640 1 -- start start 2024-09-15T23:16:54.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.683+0000 7f50653bd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50600b2370 0x7f50600b5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:54.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.683+0000 7f50653bd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50600cf960 0x7f506014e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:54.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.683+0000 7f50653bd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5060155b20 0x7f50601589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:54.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.683+0000 7f50653bd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f50600cfdf0 con 0x7f5060155b20 2024-09-15T23:16:54.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.683+0000 7f50653bd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f50600cef00 con 0x7f50600b2370 2024-09-15T23:16:54.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.683+0000 7f50653bd640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f50600ce610 con 0x7f50600cf960 2024-09-15T23:16:54.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.683+0000 7f505f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5060155b20 0x7f50601589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:54.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.683+0000 7f505f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5060155b20 0x7f50601589f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47880/0 (socket says 172.21.15.123:47880) 2024-09-15T23:16:54.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.683+0000 7f505f7fe640 1 -- 172.21.15.123:0/1098748782 learned_addr learned my addr 172.21.15.123:0/1098748782 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:54.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.684+0000 7f50567fc640 1 --2- 172.21.15.123:0/1098748782 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50600cf960 0x7f506014e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:54.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.684+0000 7f505effd640 1 --2- 172.21.15.123:0/1098748782 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50600b2370 0x7f50600b5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:54.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.684+0000 7f505f7fe640 1 -- 172.21.15.123:0/1098748782 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50600cf960 msgr2=0x7f506014e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:54.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.684+0000 7f505f7fe640 1 --2- 172.21.15.123:0/1098748782 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50600cf960 0x7f506014e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.684+0000 7f505f7fe640 1 -- 172.21.15.123:0/1098748782 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50600b2370 msgr2=0x7f50600b5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:54.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.684+0000 7f505f7fe640 1 --2- 172.21.15.123:0/1098748782 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50600b2370 0x7f50600b5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.684+0000 7f505f7fe640 1 -- 172.21.15.123:0/1098748782 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f506014e7c0 con 0x7f5060155b20 2024-09-15T23:16:54.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.684+0000 7f505f7fe640 1 --2- 172.21.15.123:0/1098748782 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5060155b20 0x7f50601589f0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f505800c7d0 tx=0x7f505800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:54.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.684+0000 7f5057fff640 1 -- 172.21.15.123:0/1098748782 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5058003b70 con 0x7f5060155b20 2024-09-15T23:16:54.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.684+0000 7f5057fff640 1 -- 172.21.15.123:0/1098748782 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5058003d30 con 0x7f5060155b20 2024-09-15T23:16:54.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.684+0000 7f50653bd640 1 -- 172.21.15.123:0/1098748782 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50600b6000 con 0x7f5060155b20 2024-09-15T23:16:54.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.684+0000 7f5057fff640 1 -- 172.21.15.123:0/1098748782 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f505800aa90 con 0x7f5060155b20 2024-09-15T23:16:54.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.684+0000 7f50653bd640 1 -- 172.21.15.123:0/1098748782 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f506015bae0 con 0x7f5060155b20 2024-09-15T23:16:54.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.686+0000 7f5057fff640 1 -- 172.21.15.123:0/1098748782 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f505800ac30 con 0x7f5060155b20 2024-09-15T23:16:54.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.686+0000 7f5057fff640 1 --2- 172.21.15.123:0/1098748782 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f504006c2b0 0x7f504006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:54.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.686+0000 7f5057fff640 1 -- 172.21.15.123:0/1098748782 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5795+0+0 (secure 0 0 0) 0x7f505808b1f0 con 0x7f5060155b20 2024-09-15T23:16:54.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.686+0000 7f505effd640 1 --2- 172.21.15.123:0/1098748782 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f504006c2b0 0x7f504006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:54.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.687+0000 7f505effd640 1 --2- 172.21.15.123:0/1098748782 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f504006c2b0 0x7f504006e770 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5050000f60 tx=0x7f5050007e40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:54.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.687+0000 7f5068232740 1 Processor -- start 2024-09-15T23:16:54.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.687+0000 7f5068232740 1 -- start start 2024-09-15T23:16:54.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.688+0000 7f5068232740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562e54345500 0x562e543458e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:54.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.688+0000 7f5068232740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e54342cc0 0x562e54344850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:54.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.688+0000 7f5068232740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e54343120 0x562e54325480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:54.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.688+0000 7f5068232740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x562e54261ac0 con 0x562e54342cc0 2024-09-15T23:16:54.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.688+0000 7f5068232740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x562e542097b0 con 0x562e54343120 2024-09-15T23:16:54.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.688+0000 7f5068232740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x562e5425da80 con 0x562e54345500 2024-09-15T23:16:54.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.688+0000 7f50567fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e54342cc0 0x562e54344850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:54.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.688+0000 7f50567fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e54342cc0 0x562e54344850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47882/0 (socket says 172.21.15.123:47882) 2024-09-15T23:16:54.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.688+0000 7f50567fc640 1 -- 172.21.15.123:0/530866213 learned_addr learned my addr 172.21.15.123:0/530866213 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:54.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.688+0000 7f505effd640 1 --2- 172.21.15.123:0/530866213 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562e54345500 0x562e543458e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:54.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.688+0000 7f505f7fe640 1 --2- 172.21.15.123:0/530866213 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e54343120 0x562e54325480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:54.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.688+0000 7f50567fc640 1 -- 172.21.15.123:0/530866213 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562e54345500 msgr2=0x562e543458e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:54.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.688+0000 7f50567fc640 1 --2- 172.21.15.123:0/530866213 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562e54345500 0x562e543458e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.688+0000 7f50567fc640 1 -- 172.21.15.123:0/530866213 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e54343120 msgr2=0x562e54325480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:54.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.688+0000 7f50567fc640 1 --2- 172.21.15.123:0/530866213 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e54343120 0x562e54325480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.688+0000 7f50567fc640 1 -- 172.21.15.123:0/530866213 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e54040a20 con 0x562e54342cc0 2024-09-15T23:16:54.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.688+0000 7f505f7fe640 1 --2- 172.21.15.123:0/530866213 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e54343120 0x562e54325480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:16:54.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.688+0000 7f50567fc640 1 --2- 172.21.15.123:0/530866213 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e54342cc0 0x562e54344850 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f5048035040 tx=0x7f5048031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=780300deba5220cf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:54.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.689+0000 7f5054ff9640 1 -- 172.21.15.123:0/530866213 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5048003810 con 0x562e54342cc0 2024-09-15T23:16:54.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.689+0000 7f5054ff9640 1 -- 172.21.15.123:0/530866213 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5048038040 con 0x562e54342cc0 2024-09-15T23:16:54.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.689+0000 7f5054ff9640 1 -- 172.21.15.123:0/530866213 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5048003bd0 con 0x562e54342cc0 2024-09-15T23:16:54.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.689+0000 7f5068232740 1 -- 172.21.15.123:0/530866213 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e54342cc0 msgr2=0x562e54344850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:54.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.689+0000 7f5068232740 1 --2- 172.21.15.123:0/530866213 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e54342cc0 0x562e54344850 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f5048035040 tx=0x7f5048031000 comp rx=0 tx=0).stop 2024-09-15T23:16:54.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.689+0000 7f5068232740 1 -- 172.21.15.123:0/530866213 shutdown_connections 2024-09-15T23:16:54.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.689+0000 7f5068232740 1 --2- 172.21.15.123:0/530866213 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e54343120 0x562e54325480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.689+0000 7f5068232740 1 --2- 172.21.15.123:0/530866213 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e54342cc0 0x562e54344850 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.689+0000 7f5068232740 1 --2- 172.21.15.123:0/530866213 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562e54345500 0x562e543458e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.689+0000 7f5068232740 1 -- 172.21.15.123:0/530866213 >> 172.21.15.123:0/530866213 conn(0x562e542fb160 msgr2=0x562e54343570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:54.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.689+0000 7f5068232740 1 -- 172.21.15.123:0/530866213 shutdown_connections 2024-09-15T23:16:54.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.689+0000 7f5068232740 1 -- 172.21.15.123:0/530866213 wait complete. 2024-09-15T23:16:54.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.690+0000 7f5068232740 1 -- start start 2024-09-15T23:16:54.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.690+0000 7f5068232740 1 Processor -- start 2024-09-15T23:16:54.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.691+0000 7f5068232740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562e54343120 0x562e54327f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:54.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.691+0000 7f5068232740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e54345500 0x562e543208c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:54.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.691+0000 7f5068232740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e5433cba0 0x562e5433d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:54.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.691+0000 7f5068232740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x562e54341c20 con 0x562e5433cba0 2024-09-15T23:16:54.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.691+0000 7f5068232740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x562e541ea7b0 con 0x562e54345500 2024-09-15T23:16:54.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.691+0000 7f5068232740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x562e54341f00 con 0x562e54343120 2024-09-15T23:16:54.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.691+0000 7f5068232740 10 client.0 _ll_register_callbacks cb 0x562e53f73e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:16:54.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.691+0000 7f505f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e5433cba0 0x562e5433d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:54.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.691+0000 7f505f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e5433cba0 0x562e5433d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47892/0 (socket says 172.21.15.123:47892) 2024-09-15T23:16:54.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.691+0000 7f505f7fe640 1 -- 172.21.15.123:0/869970314 learned_addr learned my addr 172.21.15.123:0/869970314 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:54.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.691+0000 7f505effd640 1 --2- 172.21.15.123:0/869970314 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562e54343120 0x562e54327f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:54.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.691+0000 7f50567fc640 1 --2- 172.21.15.123:0/869970314 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e54345500 0x562e543208c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:54.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.691+0000 7f505f7fe640 1 -- 172.21.15.123:0/869970314 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562e54343120 msgr2=0x562e54327f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:54.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.691+0000 7f505f7fe640 1 --2- 172.21.15.123:0/869970314 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562e54343120 0x562e54327f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.691+0000 7f505f7fe640 1 -- 172.21.15.123:0/869970314 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e54345500 msgr2=0x562e543208c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:54.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.691+0000 7f505f7fe640 1 --2- 172.21.15.123:0/869970314 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e54345500 0x562e543208c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.691+0000 7f505f7fe640 1 -- 172.21.15.123:0/869970314 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e53f34310 con 0x562e5433cba0 2024-09-15T23:16:54.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.691+0000 7f505f7fe640 1 --2- 172.21.15.123:0/869970314 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e5433cba0 0x562e5433d000 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f505800c7a0 tx=0x7f5058058d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e20127b2eba98b0e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:54.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.691+0000 7f503dffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:16:54.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.691+0000 7f503dffb640 1 -- 172.21.15.123:0/869970314 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5058071020 con 0x562e5433cba0 2024-09-15T23:16:54.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.691+0000 7f503dffb640 1 -- 172.21.15.123:0/869970314 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 5795+0+0 (secure 0 0 0) 0x7f50580559b0 con 0x562e5433cba0 2024-09-15T23:16:54.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.691+0000 7f5068232740 1 -- 172.21.15.123:0/869970314 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5048038040 con 0x562e5433cba0 2024-09-15T23:16:54.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.692+0000 7f503dffb640 1 -- 172.21.15.123:0/869970314 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f5058076050 con 0x562e5433cba0 2024-09-15T23:16:54.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.692+0000 7f5068232740 10 client.7446 fetch_fsmap learned FSMap version 66 2024-09-15T23:16:54.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.692+0000 7f5068232740 1 -- 172.21.15.123:0/869970314 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) -- 0x562e540a11b0 con 0x562e5433cba0 2024-09-15T23:16:54.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.692+0000 7f503dffb640 1 -- 172.21.15.123:0/869970314 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5048038040 con 0x562e5433cba0 2024-09-15T23:16:54.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.692+0000 7f503dffb640 1 -- 172.21.15.123:0/869970314 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 66) ==== 3502+0+0 (secure 0 0 0) 0x7f505805d170 con 0x562e5433cba0 2024-09-15T23:16:54.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.692+0000 7f5068232740 10 client.7446 fetch_fsmap finished waiting for FSMap version 66 2024-09-15T23:16:54.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.692+0000 7f5068232740 10 client.7446 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-09-15T23:16:54.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.692+0000 7f5068232740 20 client.7446 populate_metadata read hostname 'smithi123' 2024-09-15T23:16:54.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.692+0000 7f5068232740 1 --2- 172.21.15.123:0/869970314 >> [v2:172.21.15.123:6834/2621254224,v1:172.21.15.123:6835/2621254224] conn(0x562e543573e0 0x562e543577c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:54.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.692+0000 7f5068232740 4 client.7446 mds_command: new command op to 7365 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:16:54.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.692+0000 7f5068232740 1 -- 172.21.15.123:0/869970314 --> [v2:172.21.15.123:6834/2621254224,v1:172.21.15.123:6835/2621254224] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e5426f1f0 con 0x562e543573e0 2024-09-15T23:16:54.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.692+0000 7f505effd640 1 --2- 172.21.15.123:0/869970314 >> [v2:172.21.15.123:6834/2621254224,v1:172.21.15.123:6835/2621254224] conn(0x562e543573e0 0x562e543577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:54.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.692+0000 7f503dffb640 10 client.7446 ms_handle_connect on v2:172.21.15.123:6834/2621254224 2024-09-15T23:16:54.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.692+0000 7f505effd640 1 --2- 172.21.15.123:0/869970314 >> [v2:172.21.15.123:6834/2621254224,v1:172.21.15.123:6835/2621254224] conn(0x562e543573e0 0x562e543577c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dba13062f85e177 server_cookie=3fb4231c180a8062 in_seq=0 out_seq=0 2024-09-15T23:16:54.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.693+0000 7f503dffb640 1 -- 172.21.15.123:0/869970314 <== mds.0 v2:172.21.15.123:6834/2621254224 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562e5426f1f0 con 0x562e543573e0 2024-09-15T23:16:54.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.693+0000 7f503dffb640 10 client.7446 handle_command_reply: tid=0 2024-09-15T23:16:54.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.693+0000 7f5068232740 1 client.7446 shutdown 2024-09-15T23:16:54.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.693+0000 7f5068232740 1 -- 172.21.15.123:0/869970314 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e5433cba0 msgr2=0x562e5433d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:54.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.693+0000 7f5068232740 1 --2- 172.21.15.123:0/869970314 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e5433cba0 0x562e5433d000 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f505800c7a0 tx=0x7f5058058d20 comp rx=0 tx=0).stop 2024-09-15T23:16:54.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.693+0000 7f5068232740 1 -- 172.21.15.123:0/869970314 shutdown_connections 2024-09-15T23:16:54.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.693+0000 7f5068232740 1 --2- 172.21.15.123:0/869970314 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e5433cba0 0x562e5433d000 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.693+0000 7f5068232740 1 --2- 172.21.15.123:0/869970314 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e54345500 0x562e543208c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.693+0000 7f5068232740 1 --2- 172.21.15.123:0/869970314 >> [v2:172.21.15.123:6834/2621254224,v1:172.21.15.123:6835/2621254224] conn(0x562e543573e0 0x562e543577c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.693+0000 7f5068232740 1 --2- 172.21.15.123:0/869970314 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562e54343120 0x562e54327f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.693+0000 7f503dffb640 0 client.7446 ms_handle_reset on v2:172.21.15.123:6834/2621254224 2024-09-15T23:16:54.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.693+0000 7f5068232740 1 -- 172.21.15.123:0/869970314 >> 172.21.15.123:0/869970314 conn(0x562e54342cc0 msgr2=0x562e54325250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:54.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.693+0000 7f5068232740 1 -- 172.21.15.123:0/869970314 shutdown_connections 2024-09-15T23:16:54.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.693+0000 7f5068232740 1 -- 172.21.15.123:0/869970314 wait complete. 2024-09-15T23:16:54.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.693+0000 7f5068232740 20 client.7446 trim_cache size 0 max 16384 2024-09-15T23:16:54.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.710+0000 7f5068232740 1 Processor -- start 2024-09-15T23:16:54.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.710+0000 7f5068232740 1 -- start start 2024-09-15T23:16:54.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.711+0000 7f5068232740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e5433cba0 0x562e5433df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:54.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.711+0000 7f5068232740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e54343120 0x562e542fe710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:54.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.711+0000 7f5068232740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562e54345500 0x562e542fec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:54.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.711+0000 7f5068232740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x562e54346230 con 0x562e54343120 2024-09-15T23:16:54.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.711+0000 7f5068232740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5060200cc0 con 0x562e5433cba0 2024-09-15T23:16:54.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.711+0000 7f5068232740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f50601ffd70 con 0x562e54345500 2024-09-15T23:16:54.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.711+0000 7f50567fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e54343120 0x562e542fe710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:54.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.711+0000 7f50567fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e54343120 0x562e542fe710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47896/0 (socket says 172.21.15.123:47896) 2024-09-15T23:16:54.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.711+0000 7f50567fc640 1 -- 172.21.15.123:0/3456667692 learned_addr learned my addr 172.21.15.123:0/3456667692 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:54.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.711+0000 7f505f7fe640 1 --2- 172.21.15.123:0/3456667692 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562e54345500 0x562e542fec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:54.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.711+0000 7f505effd640 1 --2- 172.21.15.123:0/3456667692 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e5433cba0 0x562e5433df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:54.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.711+0000 7f50567fc640 1 -- 172.21.15.123:0/3456667692 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562e54345500 msgr2=0x562e542fec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:54.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.711+0000 7f50567fc640 1 --2- 172.21.15.123:0/3456667692 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562e54345500 0x562e542fec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.711+0000 7f50567fc640 1 -- 172.21.15.123:0/3456667692 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e5433cba0 msgr2=0x562e5433df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:54.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.711+0000 7f50567fc640 1 --2- 172.21.15.123:0/3456667692 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e5433cba0 0x562e5433df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.711+0000 7f50567fc640 1 -- 172.21.15.123:0/3456667692 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e53f0d3d0 con 0x562e54343120 2024-09-15T23:16:54.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.711+0000 7f50567fc640 1 --2- 172.21.15.123:0/3456667692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e54343120 0x562e542fe710 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f504800ba40 tx=0x7f5048008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e85281f76061890 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:54.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.712+0000 7f503ffff640 1 -- 172.21.15.123:0/3456667692 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5048056070 con 0x562e54343120 2024-09-15T23:16:54.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.712+0000 7f503ffff640 1 -- 172.21.15.123:0/3456667692 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5048038040 con 0x562e54343120 2024-09-15T23:16:54.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.712+0000 7f503ffff640 1 -- 172.21.15.123:0/3456667692 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5048032800 con 0x562e54343120 2024-09-15T23:16:54.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.712+0000 7f5068232740 1 -- 172.21.15.123:0/3456667692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e54343120 msgr2=0x562e542fe710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:54.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.712+0000 7f5068232740 1 --2- 172.21.15.123:0/3456667692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e54343120 0x562e542fe710 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f504800ba40 tx=0x7f5048008040 comp rx=0 tx=0).stop 2024-09-15T23:16:54.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.712+0000 7f5068232740 1 -- 172.21.15.123:0/3456667692 shutdown_connections 2024-09-15T23:16:54.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.712+0000 7f5068232740 1 --2- 172.21.15.123:0/3456667692 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562e54345500 0x562e542fec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.712+0000 7f5068232740 1 --2- 172.21.15.123:0/3456667692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e54343120 0x562e542fe710 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.712+0000 7f5068232740 1 --2- 172.21.15.123:0/3456667692 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e5433cba0 0x562e5433df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.712+0000 7f5068232740 1 -- 172.21.15.123:0/3456667692 >> 172.21.15.123:0/3456667692 conn(0x562e54342cc0 msgr2=0x562e54325480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:54.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.712+0000 7f5068232740 1 -- 172.21.15.123:0/3456667692 shutdown_connections 2024-09-15T23:16:54.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.712+0000 7f5068232740 1 -- 172.21.15.123:0/3456667692 wait complete. 2024-09-15T23:16:54.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.713+0000 7f5068232740 1 -- start start 2024-09-15T23:16:54.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.713+0000 7f5068232740 1 Processor -- start 2024-09-15T23:16:54.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.714+0000 7f5068232740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562e5433cba0 0x562e54366dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:54.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.714+0000 7f5068232740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e54343120 0x562e543c0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:54.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.714+0000 7f5068232740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e54345500 0x562e5431c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:54.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.714+0000 7f5068232740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x562e5433c9d0 con 0x562e54343120 2024-09-15T23:16:54.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.714+0000 7f5068232740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f506015d0c0 con 0x562e54345500 2024-09-15T23:16:54.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.714+0000 7f5068232740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x562e54341ab0 con 0x562e5433cba0 2024-09-15T23:16:54.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.714+0000 7f5068232740 10 client.0 _ll_register_callbacks cb 0x7f5058058ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:16:54.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.714+0000 7f50567fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e54343120 0x562e543c0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:54.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.714+0000 7f50567fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e54343120 0x562e543c0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47900/0 (socket says 172.21.15.123:47900) 2024-09-15T23:16:54.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.714+0000 7f50567fc640 1 -- 172.21.15.123:0/241378443 learned_addr learned my addr 172.21.15.123:0/241378443 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:54.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.714+0000 7f505effd640 1 --2- 172.21.15.123:0/241378443 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562e5433cba0 0x562e54366dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:54.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.714+0000 7f505f7fe640 1 --2- 172.21.15.123:0/241378443 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e54345500 0x562e5431c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:54.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.714+0000 7f50567fc640 1 -- 172.21.15.123:0/241378443 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562e5433cba0 msgr2=0x562e54366dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:54.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.714+0000 7f50567fc640 1 --2- 172.21.15.123:0/241378443 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562e5433cba0 0x562e54366dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.714+0000 7f50567fc640 1 -- 172.21.15.123:0/241378443 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e54345500 msgr2=0x562e5431c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:54.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.714+0000 7f50567fc640 1 --2- 172.21.15.123:0/241378443 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e54345500 0x562e5431c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.714+0000 7f50567fc640 1 -- 172.21.15.123:0/241378443 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e5433fb40 con 0x562e54343120 2024-09-15T23:16:54.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.714+0000 7f50567fc640 1 --2- 172.21.15.123:0/241378443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e54343120 0x562e543c0610 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f504802c920 tx=0x7f5048004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efdf0349f5299993 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:54.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.714+0000 7f503dffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:16:54.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.714+0000 7f503dffb640 1 -- 172.21.15.123:0/241378443 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5048056040 con 0x562e54343120 2024-09-15T23:16:54.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.714+0000 7f503dffb640 1 -- 172.21.15.123:0/241378443 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 5795+0+0 (secure 0 0 0) 0x7f50480327e0 con 0x562e54343120 2024-09-15T23:16:54.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.714+0000 7f5068232740 1 -- 172.21.15.123:0/241378443 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5048038040 con 0x562e54343120 2024-09-15T23:16:54.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.714+0000 7f503dffb640 1 -- 172.21.15.123:0/241378443 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f50480044d0 con 0x562e54343120 2024-09-15T23:16:54.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.714+0000 7f5068232740 10 client.7452 fetch_fsmap learned FSMap version 66 2024-09-15T23:16:54.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.714+0000 7f5068232740 1 -- 172.21.15.123:0/241378443 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) -- 0x562e542fa120 con 0x562e54343120 2024-09-15T23:16:54.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.715+0000 7f503dffb640 1 -- 172.21.15.123:0/241378443 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5048038040 con 0x562e54343120 2024-09-15T23:16:54.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.715+0000 7f503dffb640 1 -- 172.21.15.123:0/241378443 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 66) ==== 3502+0+0 (secure 0 0 0) 0x7f5048064030 con 0x562e54343120 2024-09-15T23:16:54.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.715+0000 7f5068232740 10 client.7452 fetch_fsmap finished waiting for FSMap version 66 2024-09-15T23:16:54.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.715+0000 7f5068232740 10 client.7452 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-09-15T23:16:54.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.715+0000 7f5068232740 20 client.7452 populate_metadata read hostname 'smithi123' 2024-09-15T23:16:54.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.715+0000 7f5068232740 1 --2- 172.21.15.123:0/241378443 >> [v2:172.21.15.123:6834/2621254224,v1:172.21.15.123:6835/2621254224] conn(0x562e543c0b50 0x562e5431ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:54.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.715+0000 7f5068232740 4 client.7452 mds_command: new command op to 7365 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}] 2024-09-15T23:16:54.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.715+0000 7f5068232740 1 -- 172.21.15.123:0/241378443 --> [v2:172.21.15.123:6834/2621254224,v1:172.21.15.123:6835/2621254224] -- command(tid 0: {"prefix": "scrub start", "path": "/testdir", "scrubops": ["recursive"]}) -- 0x562e54269540 con 0x562e543c0b50 2024-09-15T23:16:54.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.715+0000 7f505effd640 1 --2- 172.21.15.123:0/241378443 >> [v2:172.21.15.123:6834/2621254224,v1:172.21.15.123:6835/2621254224] conn(0x562e543c0b50 0x562e5431ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:54.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.715+0000 7f503dffb640 10 client.7452 ms_handle_connect on v2:172.21.15.123:6834/2621254224 2024-09-15T23:16:54.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.715+0000 7f505effd640 1 --2- 172.21.15.123:0/241378443 >> [v2:172.21.15.123:6834/2621254224,v1:172.21.15.123:6835/2621254224] conn(0x562e543c0b50 0x562e5431ccf0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98bad667c1bb9a45 server_cookie=218299e704825772 in_seq=0 out_seq=0 2024-09-15T23:16:54.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.716+0000 7f503dffb640 1 -- 172.21.15.123:0/241378443 <== mds.0 v2:172.21.15.123:6834/2621254224 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562e54269540 con 0x562e543c0b50 2024-09-15T23:16:54.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.716+0000 7f503dffb640 10 client.7452 handle_command_reply: tid=0 2024-09-15T23:16:54.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.716+0000 7f5068232740 1 client.7452 shutdown 2024-09-15T23:16:54.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.716+0000 7f5068232740 1 -- 172.21.15.123:0/241378443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e54343120 msgr2=0x562e543c0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:54.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.716+0000 7f5068232740 1 --2- 172.21.15.123:0/241378443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e54343120 0x562e543c0610 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f504802c920 tx=0x7f5048004730 comp rx=0 tx=0).stop 2024-09-15T23:16:54.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.716+0000 7f5068232740 1 -- 172.21.15.123:0/241378443 shutdown_connections 2024-09-15T23:16:54.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.716+0000 7f5068232740 1 --2- 172.21.15.123:0/241378443 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x562e54345500 0x562e5431c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.716+0000 7f5068232740 1 --2- 172.21.15.123:0/241378443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e54343120 0x562e543c0610 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.716+0000 7f5068232740 1 --2- 172.21.15.123:0/241378443 >> [v2:172.21.15.123:6834/2621254224,v1:172.21.15.123:6835/2621254224] conn(0x562e543c0b50 0x562e5431ccf0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.716+0000 7f5068232740 1 --2- 172.21.15.123:0/241378443 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x562e5433cba0 0x562e54366dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.716+0000 7f5068232740 1 -- 172.21.15.123:0/241378443 >> 172.21.15.123:0/241378443 conn(0x562e54342cc0 msgr2=0x562e5433df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:54.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.716+0000 7f503dffb640 0 client.7452 ms_handle_reset on v2:172.21.15.123:6834/2621254224 2024-09-15T23:16:54.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.716+0000 7f5068232740 1 -- 172.21.15.123:0/241378443 shutdown_connections 2024-09-15T23:16:54.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.716+0000 7f5068232740 1 -- 172.21.15.123:0/241378443 wait complete. 2024-09-15T23:16:54.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.716+0000 7f5068232740 20 client.7452 trim_cache size 0 max 16384 2024-09-15T23:16:54.725 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:16:54.725 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0, 2024-09-15T23:16:54.725 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_tag": "db4db606-c1ff-4e16-92db-b5cc29e879bc", 2024-09-15T23:16:54.725 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": "asynchronous" 2024-09-15T23:16:54.725 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:16:54.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.716+0000 7f50653bd640 1 -- 172.21.15.123:0/1098748782 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f504006c2b0 msgr2=0x7f504006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:54.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.716+0000 7f50653bd640 1 --2- 172.21.15.123:0/1098748782 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f504006c2b0 0x7f504006e770 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5050000f60 tx=0x7f5050007e40 comp rx=0 tx=0).stop 2024-09-15T23:16:54.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.716+0000 7f50653bd640 1 -- 172.21.15.123:0/1098748782 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5060155b20 msgr2=0x7f50601589f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:54.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.716+0000 7f50653bd640 1 --2- 172.21.15.123:0/1098748782 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5060155b20 0x7f50601589f0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f505800c7d0 tx=0x7f505800cc90 comp rx=0 tx=0).stop 2024-09-15T23:16:54.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.716+0000 7f50653bd640 1 -- 172.21.15.123:0/1098748782 shutdown_connections 2024-09-15T23:16:54.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.716+0000 7f50653bd640 1 --2- 172.21.15.123:0/1098748782 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f504006c2b0 0x7f504006e770 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.716+0000 7f50653bd640 1 --2- 172.21.15.123:0/1098748782 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5060155b20 0x7f50601589f0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.716+0000 7f50653bd640 1 --2- 172.21.15.123:0/1098748782 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50600cf960 0x7f506014e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.716+0000 7f50653bd640 1 --2- 172.21.15.123:0/1098748782 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50600b2370 0x7f50600b5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.716+0000 7f50653bd640 1 -- 172.21.15.123:0/1098748782 >> 172.21.15.123:0/1098748782 conn(0x7f506006c240 msgr2=0x7f5060159570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:54.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.717+0000 7f50653bd640 1 -- 172.21.15.123:0/1098748782 shutdown_connections 2024-09-15T23:16:54.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.717+0000 7f50653bd640 1 -- 172.21.15.123:0/1098748782 wait complete. 2024-09-15T23:16:54.729 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:16:54.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.825+0000 7f8bd1142640 1 Processor -- start 2024-09-15T23:16:54.826 INFO:tasks.ceph.mds.c.smithi123.stderr:2024-09-15T23:16:54.825+0000 7fdef0fe1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:16:54.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.825+0000 7f8bd1142640 1 -- start start 2024-09-15T23:16:54.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.825+0000 7f8bd1142640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f8bcc06c320 0x7f8bcc15bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:54.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.825+0000 7f8bd1142640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8bcc13eb20 0x7f8bcc15c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:54.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.825+0000 7f8bd1142640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bcc071180 con 0x7f8bcc0b2d40 2024-09-15T23:16:54.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.825+0000 7f8bd1142640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f8bcc071ab0 con 0x7f8bcc06c320 2024-09-15T23:16:54.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.825+0000 7f8bd1142640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8bcc071460 con 0x7f8bcc13eb20 2024-09-15T23:16:54.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.826+0000 7f8bcb59e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8bcc13eb20 0x7f8bcc15c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:54.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.826+0000 7f8bca59c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f8bcc06c320 0x7f8bcc15bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:54.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.826+0000 7f8bcb59e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8bcc13eb20 0x7f8bcc15c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:41972/0 (socket says 172.21.15.123:41972) 2024-09-15T23:16:54.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.826+0000 7f8bcb59e640 1 -- 172.21.15.123:0/527879474 learned_addr learned my addr 172.21.15.123:0/527879474 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:54.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.826+0000 7f8bcb59e640 1 -- 172.21.15.123:0/527879474 >> v2:172.21.15.188:3300/0 conn(0x7f8bcc06c320 msgr2=0x7f8bcc15bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:16:54.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.826+0000 7f8bcb59e640 1 --2- 172.21.15.123:0/527879474 >> v2:172.21.15.188:3300/0 conn(0x7f8bcc06c320 0x7f8bcc15bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.826+0000 7f8bcb59e640 1 -- 172.21.15.123:0/527879474 >> v1:172.21.15.188:6789/0 conn(0x7f8bcc0b2d40 legacy=0x7f8bcc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:54.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.826+0000 7f8bcb59e640 1 -- 172.21.15.123:0/527879474 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bcc071740 con 0x7f8bcc13eb20 2024-09-15T23:16:54.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.826+0000 7f8bc9d9b640 1 -- 172.21.15.123:0/527879474 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3110220781 0 0) 0x7f8bcc071180 con 0x7f8bcc0b2d40 2024-09-15T23:16:54.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.826+0000 7f8bca59c640 1 --2- 172.21.15.123:0/527879474 >> v2:172.21.15.188:3300/0 conn(0x7f8bcc06c320 0x7f8bcc15bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:16:54.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.827+0000 7f8bcb59e640 1 --2- 172.21.15.123:0/527879474 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8bcc13eb20 0x7f8bcc15c230 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4009e50 tx=0x7f8bc402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=738fb5c8f19225e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:54.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.827+0000 7f8bc9d9b640 1 -- 172.21.15.123:0/527879474 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc4036070 con 0x7f8bcc13eb20 2024-09-15T23:16:54.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.827+0000 7f8bc9d9b640 1 -- 172.21.15.123:0/527879474 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bc4031600 con 0x7f8bcc13eb20 2024-09-15T23:16:54.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.827+0000 7f8bc9d9b640 1 -- 172.21.15.123:0/527879474 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc40319d0 con 0x7f8bcc13eb20 2024-09-15T23:16:54.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.828+0000 7f8bd1142640 1 -- 172.21.15.123:0/527879474 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8bcc13eb20 msgr2=0x7f8bcc15c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:54.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.828+0000 7f8bd1142640 1 --2- 172.21.15.123:0/527879474 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8bcc13eb20 0x7f8bcc15c230 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4009e50 tx=0x7f8bc402a710 comp rx=0 tx=0).stop 2024-09-15T23:16:54.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.828+0000 7f8bd1142640 1 -- 172.21.15.123:0/527879474 shutdown_connections 2024-09-15T23:16:54.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.828+0000 7f8bd1142640 1 --2- 172.21.15.123:0/527879474 >> v2:172.21.15.188:3300/0 conn(0x7f8bcc06c320 0x7f8bcc15bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.828+0000 7f8bd1142640 1 --2- 172.21.15.123:0/527879474 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8bcc13eb20 0x7f8bcc15c230 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.828+0000 7f8bd1142640 1 -- 172.21.15.123:0/527879474 >> 172.21.15.123:0/527879474 conn(0x7f8bcc0ccec0 msgr2=0x7f8bcc0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:54.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.828+0000 7f8bd1142640 1 -- 172.21.15.123:0/527879474 shutdown_connections 2024-09-15T23:16:54.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.828+0000 7f8bd1142640 1 -- 172.21.15.123:0/527879474 wait complete. 2024-09-15T23:16:54.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.829+0000 7f8bd1142640 1 Processor -- start 2024-09-15T23:16:54.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.829+0000 7f8bd1142640 1 -- start start 2024-09-15T23:16:54.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.830+0000 7f8bd1142640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8bcc06c320 0x7f8bcc0cb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:54.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.830+0000 7f8bd1142640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bcc0b2d40 0x7f8bcc0cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:54.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.830+0000 7f8bd1142640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8bcc13eb20 0x7f8bcc15b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:54.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.830+0000 7f8bd1142640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8bcc0720c0 con 0x7f8bcc0b2d40 2024-09-15T23:16:54.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.830+0000 7f8bd1142640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8bcc071f40 con 0x7f8bcc06c320 2024-09-15T23:16:54.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.830+0000 7f8bd1142640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8bcc072240 con 0x7f8bcc13eb20 2024-09-15T23:16:54.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.830+0000 7f8bca59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bcc0b2d40 0x7f8bcc0cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:54.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.830+0000 7f8bca59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bcc0b2d40 0x7f8bcc0cbce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47902/0 (socket says 172.21.15.123:47902) 2024-09-15T23:16:54.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.830+0000 7f8bca59c640 1 -- 172.21.15.123:0/3416276452 learned_addr learned my addr 172.21.15.123:0/3416276452 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:16:54.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.830+0000 7f8bcad9d640 1 --2- 172.21.15.123:0/3416276452 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8bcc06c320 0x7f8bcc0cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:54.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.830+0000 7f8bcb59e640 1 --2- 172.21.15.123:0/3416276452 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8bcc13eb20 0x7f8bcc15b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:54.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.830+0000 7f8bca59c640 1 -- 172.21.15.123:0/3416276452 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8bcc13eb20 msgr2=0x7f8bcc15b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:54.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.830+0000 7f8bca59c640 1 --2- 172.21.15.123:0/3416276452 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8bcc13eb20 0x7f8bcc15b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.830+0000 7f8bca59c640 1 -- 172.21.15.123:0/3416276452 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8bcc06c320 msgr2=0x7f8bcc0cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:54.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.830+0000 7f8bca59c640 1 --2- 172.21.15.123:0/3416276452 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8bcc06c320 0x7f8bcc0cb570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:54.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.830+0000 7f8bca59c640 1 -- 172.21.15.123:0/3416276452 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bcc1f44a0 con 0x7f8bcc0b2d40 2024-09-15T23:16:54.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.831+0000 7f8bca59c640 1 --2- 172.21.15.123:0/3416276452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bcc0b2d40 0x7f8bcc0cbce0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f8bc000ebe0 tx=0x7f8bc000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:54.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.831+0000 7f8bb37fe640 1 -- 172.21.15.123:0/3416276452 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0017070 con 0x7f8bcc0b2d40 2024-09-15T23:16:54.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.831+0000 7f8bd1142640 1 -- 172.21.15.123:0/3416276452 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bcc1f4780 con 0x7f8bcc0b2d40 2024-09-15T23:16:54.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.831+0000 7f8bb37fe640 1 -- 172.21.15.123:0/3416276452 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bc000cc30 con 0x7f8bcc0b2d40 2024-09-15T23:16:54.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.831+0000 7f8bb37fe640 1 -- 172.21.15.123:0/3416276452 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0013470 con 0x7f8bcc0b2d40 2024-09-15T23:16:54.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.831+0000 7f8bd1142640 1 -- 172.21.15.123:0/3416276452 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bcc1f4d40 con 0x7f8bcc0b2d40 2024-09-15T23:16:54.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.832+0000 7f8bd1142640 1 -- 172.21.15.123:0/3416276452 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bcc06bc10 con 0x7f8bcc0b2d40 2024-09-15T23:16:54.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.832+0000 7f8bb37fe640 1 -- 172.21.15.123:0/3416276452 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8bc001a070 con 0x7f8bcc0b2d40 2024-09-15T23:16:54.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.832+0000 7f8bb37fe640 1 --2- 172.21.15.123:0/3416276452 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8bb806c2b0 0x7f8bb806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:16:54.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.833+0000 7f8bb37fe640 1 -- 172.21.15.123:0/3416276452 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5795+0+0 (secure 0 0 0) 0x7f8bc008b840 con 0x7f8bcc0b2d40 2024-09-15T23:16:54.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.833+0000 7f8bcad9d640 1 --2- 172.21.15.123:0/3416276452 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8bb806c2b0 0x7f8bb806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:16:54.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.833+0000 7f8bcad9d640 1 --2- 172.21.15.123:0/3416276452 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8bb806c2b0 0x7f8bb806e770 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc000f60 tx=0x7f8bbc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:16:54.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:54.837+0000 7f8bb37fe640 1 -- 172.21.15.123:0/3416276452 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8bc0059ed0 con 0x7f8bcc0b2d40 2024-09-15T23:16:55.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:55.034+0000 7f8bd1142640 1 -- 172.21.15.123:0/3416276452 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8bcc06c9c0 con 0x7f8bcc0b2d40 2024-09-15T23:16:55.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:55.035+0000 7f8bb37fe640 1 -- 172.21.15.123:0/3416276452 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5236 (secure 0 0 0) 0x7f8bc00597d0 con 0x7f8bcc0b2d40 2024-09-15T23:16:55.036 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:16:55.036 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":66,"btime":"2024-09-15T23:16:51:834717+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6556,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/488079964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":488079964},{"type":"v1","addr":"172.21.15.188:6835","nonce":488079964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/4123673242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":4123673242},{"type":"v1","addr":"172.21.15.188:6837","nonce":4123673242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":7356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/2179085155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2179085155},{"type":"v1","addr":"172.21.15.123:6833","nonce":2179085155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:16:35.080780+0000","modified":"2024-09-15T23:16:51.834712+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7365":{"gid":7365,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6835/2621254224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2621254224},{"type":"v1","addr":"172.21.15.123:6835","nonce":2621254224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7365,"qdb_cluster":[7365]},"id":6}]} 2024-09-15T23:16:55.037 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 66 2024-09-15T23:16:55.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:55.037+0000 7f8bd1142640 1 -- 172.21.15.123:0/3416276452 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8bb806c2b0 msgr2=0x7f8bb806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:55.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:55.037+0000 7f8bd1142640 1 --2- 172.21.15.123:0/3416276452 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8bb806c2b0 0x7f8bb806e770 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc000f60 tx=0x7f8bbc009040 comp rx=0 tx=0).stop 2024-09-15T23:16:55.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:55.037+0000 7f8bd1142640 1 -- 172.21.15.123:0/3416276452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bcc0b2d40 msgr2=0x7f8bcc0cbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:16:55.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:55.037+0000 7f8bd1142640 1 --2- 172.21.15.123:0/3416276452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bcc0b2d40 0x7f8bcc0cbce0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f8bc000ebe0 tx=0x7f8bc000c520 comp rx=0 tx=0).stop 2024-09-15T23:16:55.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:55.037+0000 7f8bd1142640 1 -- 172.21.15.123:0/3416276452 shutdown_connections 2024-09-15T23:16:55.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:55.037+0000 7f8bd1142640 1 --2- 172.21.15.123:0/3416276452 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8bcc13eb20 0x7f8bcc15b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:55.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:55.037+0000 7f8bd1142640 1 --2- 172.21.15.123:0/3416276452 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8bb806c2b0 0x7f8bb806e770 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:55.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:55.037+0000 7f8bd1142640 1 --2- 172.21.15.123:0/3416276452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bcc0b2d40 0x7f8bcc0cbce0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:55.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:55.037+0000 7f8bd1142640 1 --2- 172.21.15.123:0/3416276452 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8bcc06c320 0x7f8bcc0cb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:16:55.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:55.037+0000 7f8bd1142640 1 -- 172.21.15.123:0/3416276452 >> 172.21.15.123:0/3416276452 conn(0x7f8bcc0ccec0 msgr2=0x7f8bcc0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:16:55.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:55.037+0000 7f8bd1142640 1 -- 172.21.15.123:0/3416276452 shutdown_connections 2024-09-15T23:16:55.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:16:55.037+0000 7f8bd1142640 1 -- 172.21.15.123:0/3416276452 wait complete. 2024-09-15T23:16:55.049 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump inode 1099511627776 2024-09-15T23:16:55.160 INFO:teuthology.orchestra.run.smithi123.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-15T23:16:46.520862+0000","btime":"2024-09-15T23:16:45.773879+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-15T23:16:46.520862+0000","atime":"2024-09-15T23:16:45.773879+0000","time_warp_seq":0,"change_attr":21,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-15T23:16:46.520862+0000","num_files":21,"num_subdirs":0,"change_attr":21},"rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-15T23:16:46.520862+0000"},"accounted_rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-15T23:16:46.520862+0000"},"version":128,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dirfrag":1,"authpin":0,"scrubqueue":0},"nref":1,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-15T23:16:55.161 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 32, "rctime": "2024-09-15T23:16:46.520862+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-15T23:16:45.773879+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-15T23:16:45.773879+0000", "change_attr": 21, "client_caps": [], "client_ranges": [], "ctime": "2024-09-15T23:16:46.520862+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 21, "mtime": "2024-09-15T23:16:46.520862+0000", "num_files": 21, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1333, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-15T23:16:46.520862+0000", "nestlock": {}, "nlink": 1, "nref": 1, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 1, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 32, "rctime": "2024-09-15T23:16:46.520862+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 128, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-15T23:16:55.161 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30 retry_count=0)... 2024-09-15T23:17:00.162 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:17:00.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.270+0000 7f3913def640 1 Processor -- start 2024-09-15T23:17:00.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.270+0000 7f3913def640 1 -- start start 2024-09-15T23:17:00.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.271+0000 7f3913def640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f390c0b2d40 0x7f390c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:00.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.271+0000 7f3913def640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f390c071180 con 0x7f390c06c150 2024-09-15T23:17:00.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.271+0000 7f3913def640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f390c071460 con 0x7f390c13eb20 2024-09-15T23:17:00.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.271+0000 7f3913def640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f390c071ab0 con 0x7f390c0b2d40 2024-09-15T23:17:00.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.271+0000 7f3911b8b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f390c0b2d40 0x7f390c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:00.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.271+0000 7f391238c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f390c06c150 0x7f390c071f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49128/0 (socket says 172.21.15.123:49128) 2024-09-15T23:17:00.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.271+0000 7f391238c640 1 -- 172.21.15.123:0/1205117201 learned_addr learned my addr 172.21.15.123:0/1205117201 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:17:00.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.271+0000 7f3911b8b640 1 --2- 172.21.15.123:0/1205117201 >> v2:172.21.15.123:3300/0 conn(0x7f390c0b2d40 0x7f390c06bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46470/0 (socket says 172.21.15.123:46470) 2024-09-15T23:17:00.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.272+0000 7f3911b8b640 1 -- 172.21.15.123:0/1205117201 >> v1:172.21.15.188:6789/0 conn(0x7f390c13eb20 legacy=0x7f390c15bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:00.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.272+0000 7f3911b8b640 1 -- 172.21.15.123:0/1205117201 >> v1:172.21.15.123:6789/0 conn(0x7f390c06c150 legacy=0x7f390c071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:00.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.272+0000 7f3911b8b640 1 -- 172.21.15.123:0/1205117201 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f390c071740 con 0x7f390c0b2d40 2024-09-15T23:17:00.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.272+0000 7f3910b89640 1 -- 172.21.15.123:0/1205117201 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3071761282 0 0) 0x7f390c071180 con 0x7f390c06c150 2024-09-15T23:17:00.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.272+0000 7f3911b8b640 1 --2- 172.21.15.123:0/1205117201 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f390c0b2d40 0x7f390c06bc10 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f39080097a0 tx=0x7f390802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b0a43bc31a27e62 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:00.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.273+0000 7f3910b89640 1 -- 172.21.15.123:0/1205117201 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3908037070 con 0x7f390c0b2d40 2024-09-15T23:17:00.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.273+0000 7f3910b89640 1 -- 172.21.15.123:0/1205117201 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3908032440 con 0x7f390c0b2d40 2024-09-15T23:17:00.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.273+0000 7f3910b89640 1 -- 172.21.15.123:0/1205117201 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3908032810 con 0x7f390c0b2d40 2024-09-15T23:17:00.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.273+0000 7f3913def640 1 -- 172.21.15.123:0/1205117201 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f390c0b2d40 msgr2=0x7f390c06bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:00.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.273+0000 7f3913def640 1 --2- 172.21.15.123:0/1205117201 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f390c0b2d40 0x7f390c06bc10 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f39080097a0 tx=0x7f390802a1e0 comp rx=0 tx=0).stop 2024-09-15T23:17:00.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.273+0000 7f3913def640 1 -- 172.21.15.123:0/1205117201 shutdown_connections 2024-09-15T23:17:00.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.273+0000 7f3913def640 1 --2- 172.21.15.123:0/1205117201 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f390c0b2d40 0x7f390c06bc10 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:00.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.273+0000 7f3913def640 1 -- 172.21.15.123:0/1205117201 >> 172.21.15.123:0/1205117201 conn(0x7f390c0ccec0 msgr2=0x7f390c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:00.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.273+0000 7f3913def640 1 -- 172.21.15.123:0/1205117201 shutdown_connections 2024-09-15T23:17:00.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.273+0000 7f3913def640 1 -- 172.21.15.123:0/1205117201 wait complete. 2024-09-15T23:17:00.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.274+0000 7f3913def640 1 Processor -- start 2024-09-15T23:17:00.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.274+0000 7f3913def640 1 -- start start 2024-09-15T23:17:00.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.275+0000 7f3913def640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f390c06c150 0x7f390c13d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:00.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.275+0000 7f3913def640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f390c0b2d40 0x7f390c15cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:00.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.275+0000 7f3913def640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f390c13eb20 0x7f390c15ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:00.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.275+0000 7f3913def640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f390c15c7d0 con 0x7f390c06c150 2024-09-15T23:17:00.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.275+0000 7f3913def640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f390c15c650 con 0x7f390c13eb20 2024-09-15T23:17:00.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.275+0000 7f3913def640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f390c072650 con 0x7f390c0b2d40 2024-09-15T23:17:00.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.275+0000 7f3911b8b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f390c06c150 0x7f390c13d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:00.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.275+0000 7f3911b8b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f390c06c150 0x7f390c13d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46472/0 (socket says 172.21.15.123:46472) 2024-09-15T23:17:00.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.275+0000 7f3911b8b640 1 -- 172.21.15.123:0/1022018673 learned_addr learned my addr 172.21.15.123:0/1022018673 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:00.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.275+0000 7f391238c640 1 --2- 172.21.15.123:0/1022018673 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f390c13eb20 0x7f390c15ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:00.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.275+0000 7f391138a640 1 --2- 172.21.15.123:0/1022018673 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f390c0b2d40 0x7f390c15cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:00.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.276+0000 7f3911b8b640 1 -- 172.21.15.123:0/1022018673 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f390c0b2d40 msgr2=0x7f390c15cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:00.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.276+0000 7f3911b8b640 1 --2- 172.21.15.123:0/1022018673 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f390c0b2d40 0x7f390c15cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:00.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.276+0000 7f3911b8b640 1 -- 172.21.15.123:0/1022018673 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f390c13eb20 msgr2=0x7f390c15ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:00.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.276+0000 7f3911b8b640 1 --2- 172.21.15.123:0/1022018673 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f390c13eb20 0x7f390c15ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:00.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.276+0000 7f3911b8b640 1 -- 172.21.15.123:0/1022018673 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f390c0c98b0 con 0x7f390c06c150 2024-09-15T23:17:00.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.276+0000 7f3911b8b640 1 --2- 172.21.15.123:0/1022018673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f390c06c150 0x7f390c13d420 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f39080098c0 tx=0x7f39080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:00.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.276+0000 7f39027fc640 1 -- 172.21.15.123:0/1022018673 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3908041070 con 0x7f390c06c150 2024-09-15T23:17:00.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.276+0000 7f39027fc640 1 -- 172.21.15.123:0/1022018673 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f390803c870 con 0x7f390c06c150 2024-09-15T23:17:00.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.276+0000 7f3913def640 1 -- 172.21.15.123:0/1022018673 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f390c0c9b90 con 0x7f390c06c150 2024-09-15T23:17:00.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.276+0000 7f39027fc640 1 -- 172.21.15.123:0/1022018673 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3908037040 con 0x7f390c06c150 2024-09-15T23:17:00.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.276+0000 7f3913def640 1 -- 172.21.15.123:0/1022018673 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f390c0ca150 con 0x7f390c06c150 2024-09-15T23:17:00.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.277+0000 7f3913def640 1 -- 172.21.15.123:0/1022018673 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f390c06bc10 con 0x7f390c06c150 2024-09-15T23:17:00.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.277+0000 7f39027fc640 1 -- 172.21.15.123:0/1022018673 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3908044070 con 0x7f390c06c150 2024-09-15T23:17:00.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.278+0000 7f39027fc640 1 --2- 172.21.15.123:0/1022018673 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f38f006c2e0 0x7f38f006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:00.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.278+0000 7f39027fc640 1 -- 172.21.15.123:0/1022018673 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5795+0+0 (secure 0 0 0) 0x7f39080ac090 con 0x7f390c06c150 2024-09-15T23:17:00.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.278+0000 7f391138a640 1 --2- 172.21.15.123:0/1022018673 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f38f006c2e0 0x7f38f006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:00.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.279+0000 7f391138a640 1 --2- 172.21.15.123:0/1022018673 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f38f006c2e0 0x7f38f006e7a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f390c1f7990 tx=0x7f38fc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:00.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.283+0000 7f39027fc640 1 -- 172.21.15.123:0/1022018673 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f390807a830 con 0x7f390c06c150 2024-09-15T23:17:00.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.485+0000 7f3913def640 1 -- 172.21.15.123:0/1022018673 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f390c06c9c0 con 0x7f390c06c150 2024-09-15T23:17:00.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.485+0000 7f39027fc640 1 -- 172.21.15.123:0/1022018673 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5236 (secure 0 0 0) 0x7f390807a130 con 0x7f390c06c150 2024-09-15T23:17:00.487 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:17:00.487 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":66,"btime":"2024-09-15T23:16:51:834717+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6556,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/488079964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":488079964},{"type":"v1","addr":"172.21.15.188:6835","nonce":488079964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/4123673242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":4123673242},{"type":"v1","addr":"172.21.15.188:6837","nonce":4123673242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":7356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/2179085155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2179085155},{"type":"v1","addr":"172.21.15.123:6833","nonce":2179085155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:16:35.080780+0000","modified":"2024-09-15T23:16:51.834712+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7365":{"gid":7365,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6835/2621254224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2621254224},{"type":"v1","addr":"172.21.15.123:6835","nonce":2621254224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7365,"qdb_cluster":[7365]},"id":6}]} 2024-09-15T23:17:00.487 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 66 2024-09-15T23:17:00.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.487+0000 7f3913def640 1 -- 172.21.15.123:0/1022018673 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f38f006c2e0 msgr2=0x7f38f006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:00.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.487+0000 7f3913def640 1 --2- 172.21.15.123:0/1022018673 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f38f006c2e0 0x7f38f006e7a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f390c1f7990 tx=0x7f38fc008040 comp rx=0 tx=0).stop 2024-09-15T23:17:00.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.487+0000 7f3913def640 1 -- 172.21.15.123:0/1022018673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f390c06c150 msgr2=0x7f390c13d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:00.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.487+0000 7f3913def640 1 --2- 172.21.15.123:0/1022018673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f390c06c150 0x7f390c13d420 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f39080098c0 tx=0x7f39080046c0 comp rx=0 tx=0).stop 2024-09-15T23:17:00.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.487+0000 7f3913def640 1 -- 172.21.15.123:0/1022018673 shutdown_connections 2024-09-15T23:17:00.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.487+0000 7f3913def640 1 --2- 172.21.15.123:0/1022018673 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f390c13eb20 0x7f390c15ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:00.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.487+0000 7f3913def640 1 --2- 172.21.15.123:0/1022018673 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f390c0b2d40 0x7f390c15cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:00.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.487+0000 7f3913def640 1 --2- 172.21.15.123:0/1022018673 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f38f006c2e0 0x7f38f006e7a0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:00.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.487+0000 7f3913def640 1 --2- 172.21.15.123:0/1022018673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f390c06c150 0x7f390c13d420 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:00.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.487+0000 7f3913def640 1 -- 172.21.15.123:0/1022018673 >> 172.21.15.123:0/1022018673 conn(0x7f390c0ccec0 msgr2=0x7f390c13f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:00.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.487+0000 7f3913def640 1 -- 172.21.15.123:0/1022018673 shutdown_connections 2024-09-15T23:17:00.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.487+0000 7f3913def640 1 -- 172.21.15.123:0/1022018673 wait complete. 2024-09-15T23:17:00.500 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump inode 1099511627776 2024-09-15T23:17:00.611 INFO:teuthology.orchestra.run.smithi123.stdout:{"path":"/testdir","ino":1099511627776,"rdev":0,"ctime":"2024-09-15T23:16:46.520862+0000","btime":"2024-09-15T23:16:45.773879+0000","mode":16877,"uid":1000,"gid":1333,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-09-15T23:16:46.520862+0000","atime":"2024-09-15T23:16:45.773879+0000","time_warp_seq":0,"change_attr":21,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"quiesce_block":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-09-15T23:16:46.520862+0000","num_files":21,"num_subdirs":0,"change_attr":21},"rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-15T23:16:46.520862+0000"},"accounted_rstat":{"version":0,"rbytes":32,"rfiles":21,"rsubdirs":1,"rsnaps":0,"rctime":"2024-09-15T23:16:46.520862+0000"},"version":131,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"2024-09-15T23:16:54.717712+0000","last_scrub_version":128,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[{"frag":"*","children":1}]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"lock":0,"dirfrag":2,"dirtyrstat":1,"dirty":1,"authpin":0,"scrubqueue":0},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"quiescelock":{"gather_set":[],"state":"lock","type":"iquiesce","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty","dirtyrstat"],"client_caps":[],"loner":-1,"want_loner":-1,"mds_caps_wanted":[],"is_subvolume":false} 2024-09-15T23:17:00.659 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 32, "rctime": "2024-09-15T23:16:46.520862+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-09-15T23:16:45.773879+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-09-15T23:16:45.773879+0000", "change_attr": 21, "client_caps": [], "client_ranges": [], "ctime": "2024-09-15T23:16:46.520862+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [ { "children": 1, "frag": "*" } ] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 21, "mtime": "2024-09-15T23:16:46.520862+0000", "num_files": 21, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1333, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_subvolume": false, "last_scrub_stamp": "2024-09-15T23:16:54.717712+0000", "last_scrub_version": 128, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-09-15T23:16:46.520862+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/testdir", "pins": { "authpin": 0, "dirfrag": 2, "dirty": 1, "dirtyrstat": 1, "lock": 0, "scrubqueue": 0 }, "policylock": {}, "quiesce_block": false, "quiescelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iquiesce", "xlock_by": {} }, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 32, "rctime": "2024-09-15T23:16:46.520862+0000", "rfiles": 21, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyrstat" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 131, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } 2024-09-15T23:17:00.659 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-15T23:17:00.659 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:17:00.659 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:17:00.699 DEBUG:teuthology.orchestra.run.smithi188:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:17:00.743 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:17:00.743 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:17:00.743 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:17:00.743 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:17:00.759 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:17:00.759 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:17:00.759 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:17:00.759 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:17:00.801 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:17:00.801 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:17:00.801 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:17:00.801 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:17:00.818 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:17:00.818 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:17:00.818 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:17:00.818 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:17:00.859 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:17:00.859 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:17:00.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.955+0000 7f5f07edd640 1 Processor -- start 2024-09-15T23:17:00.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.955+0000 7f5f07edd640 1 -- start start 2024-09-15T23:17:00.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.956+0000 7f5f07edd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5f0015ab40 0x7f5f0006c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:00.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.956+0000 7f5f07edd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5f000720b0 0x7f5f00073990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:00.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.956+0000 7f5f07edd640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f000724f0 con 0x7f5f0015af20 2024-09-15T23:17:00.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.956+0000 7f5f07edd640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f5f00071010 con 0x7f5f000720b0 2024-09-15T23:17:00.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.956+0000 7f5f07edd640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5f000712f0 con 0x7f5f0015ab40 2024-09-15T23:17:00.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.956+0000 7f5f05478640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5f000720b0 0x7f5f00073990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:00.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.956+0000 7f5f05478640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5f000720b0 0x7f5f00073990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46484/0 (socket says 172.21.15.123:46484) 2024-09-15T23:17:00.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.956+0000 7f5f05478640 1 -- 172.21.15.123:0/1955772845 learned_addr learned my addr 172.21.15.123:0/1955772845 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:00.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.957+0000 7f5f05c79640 1 --2- 172.21.15.123:0/1955772845 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5f0015ab40 0x7f5f0006c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:00.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.957+0000 7f5f05478640 1 -- 172.21.15.123:0/1955772845 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5f0015ab40 msgr2=0x7f5f0006c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:00.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.957+0000 7f5f05478640 1 --2- 172.21.15.123:0/1955772845 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5f0015ab40 0x7f5f0006c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:00.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.957+0000 7f5f05478640 1 -- 172.21.15.123:0/1955772845 >> v1:172.21.15.188:6789/0 conn(0x7f5f0015af20 legacy=0x7f5f0015b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:00.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.957+0000 7f5f05478640 1 -- 172.21.15.123:0/1955772845 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f000715d0 con 0x7f5f000720b0 2024-09-15T23:17:00.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.957+0000 7f5f05c79640 1 --2- 172.21.15.123:0/1955772845 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5f0015ab40 0x7f5f0006c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:17:00.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.957+0000 7f5f05478640 1 --2- 172.21.15.123:0/1955772845 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f000720b0 0x7f5f00073990 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0009870 tx=0x7f5ef002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49718d08d5ff6fe3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:00.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.957+0000 7f5f04c77640 1 -- 172.21.15.123:0/1955772845 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0037070 con 0x7f5f000720b0 2024-09-15T23:17:00.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.958+0000 7f5f04c77640 1 -- 172.21.15.123:0/1955772845 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ef0032440 con 0x7f5f000720b0 2024-09-15T23:17:00.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.958+0000 7f5f04c77640 1 -- 172.21.15.123:0/1955772845 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0032810 con 0x7f5f000720b0 2024-09-15T23:17:00.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.958+0000 7f5f07edd640 1 -- 172.21.15.123:0/1955772845 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f000720b0 msgr2=0x7f5f00073990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:00.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.958+0000 7f5f07edd640 1 --2- 172.21.15.123:0/1955772845 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f000720b0 0x7f5f00073990 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f5ef0009870 tx=0x7f5ef002a1c0 comp rx=0 tx=0).stop 2024-09-15T23:17:00.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.958+0000 7f5f07edd640 1 -- 172.21.15.123:0/1955772845 shutdown_connections 2024-09-15T23:17:00.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.958+0000 7f5f07edd640 1 --2- 172.21.15.123:0/1955772845 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f000720b0 0x7f5f00073990 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:00.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.958+0000 7f5f07edd640 1 --2- 172.21.15.123:0/1955772845 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5f0015ab40 0x7f5f0006c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:00.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.958+0000 7f5f07edd640 1 -- 172.21.15.123:0/1955772845 >> 172.21.15.123:0/1955772845 conn(0x7f5f000ccec0 msgr2=0x7f5f000cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:00.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.958+0000 7f5f07edd640 1 -- 172.21.15.123:0/1955772845 shutdown_connections 2024-09-15T23:17:00.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.958+0000 7f5f07edd640 1 -- 172.21.15.123:0/1955772845 wait complete. 2024-09-15T23:17:00.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.959+0000 7f5f07edd640 1 Processor -- start 2024-09-15T23:17:00.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.959+0000 7f5f07edd640 1 -- start start 2024-09-15T23:17:00.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.960+0000 7f5f07edd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5f000720b0 0x7f5f0013aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:00.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.960+0000 7f5f07edd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f0015ab40 0x7f5f001e3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:00.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.960+0000 7f5f07edd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5f0015af20 0x7f5f001f58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:00.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.960+0000 7f5f07edd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5f00073ed0 con 0x7f5f0015ab40 2024-09-15T23:17:00.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.960+0000 7f5f07edd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5f0015ba80 con 0x7f5f0015af20 2024-09-15T23:17:00.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.960+0000 7f5f07edd640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5f0015c1d0 con 0x7f5f000720b0 2024-09-15T23:17:00.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.960+0000 7f5f05478640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f0015ab40 0x7f5f001e3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:00.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.960+0000 7f5f05478640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f0015ab40 0x7f5f001e3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46486/0 (socket says 172.21.15.123:46486) 2024-09-15T23:17:00.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.960+0000 7f5f05478640 1 -- 172.21.15.123:0/853162026 learned_addr learned my addr 172.21.15.123:0/853162026 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:00.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.960+0000 7f5f05c79640 1 --2- 172.21.15.123:0/853162026 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5f000720b0 0x7f5f0013aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:00.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.960+0000 7f5f0647a640 1 --2- 172.21.15.123:0/853162026 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5f0015af20 0x7f5f001f58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:00.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.960+0000 7f5f05478640 1 -- 172.21.15.123:0/853162026 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5f000720b0 msgr2=0x7f5f0013aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:00.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.960+0000 7f5f05478640 1 --2- 172.21.15.123:0/853162026 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5f000720b0 0x7f5f0013aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:00.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.960+0000 7f5f05478640 1 -- 172.21.15.123:0/853162026 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5f0015af20 msgr2=0x7f5f001f58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:00.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.961+0000 7f5f05478640 1 --2- 172.21.15.123:0/853162026 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5f0015af20 0x7f5f001f58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:00.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.961+0000 7f5f05478640 1 -- 172.21.15.123:0/853162026 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f001e4450 con 0x7f5f0015ab40 2024-09-15T23:17:00.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.961+0000 7f5f0647a640 1 --2- 172.21.15.123:0/853162026 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5f0015af20 0x7f5f001f58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:17:00.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.961+0000 7f5f05478640 1 --2- 172.21.15.123:0/853162026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f0015ab40 0x7f5f001e3f10 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f5ef002a200 tx=0x7f5ef00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:00.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.961+0000 7f5ef67fc640 1 -- 172.21.15.123:0/853162026 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0041020 con 0x7f5f0015ab40 2024-09-15T23:17:00.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.961+0000 7f5ef67fc640 1 -- 172.21.15.123:0/853162026 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ef00306c0 con 0x7f5f0015ab40 2024-09-15T23:17:00.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.961+0000 7f5f07edd640 1 -- 172.21.15.123:0/853162026 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f001f5e30 con 0x7f5f0015ab40 2024-09-15T23:17:00.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.961+0000 7f5ef67fc640 1 -- 172.21.15.123:0/853162026 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0037040 con 0x7f5f0015ab40 2024-09-15T23:17:00.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.961+0000 7f5f07edd640 1 -- 172.21.15.123:0/853162026 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f001f63b0 con 0x7f5f0015ab40 2024-09-15T23:17:00.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.962+0000 7f5f07edd640 1 -- 172.21.15.123:0/853162026 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f001e1340 con 0x7f5f0015ab40 2024-09-15T23:17:00.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.962+0000 7f5ef67fc640 1 -- 172.21.15.123:0/853162026 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5ef0044020 con 0x7f5f0015ab40 2024-09-15T23:17:00.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.963+0000 7f5ef67fc640 1 --2- 172.21.15.123:0/853162026 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5ee406c2e0 0x7f5ee406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:00.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.963+0000 7f5ef67fc640 1 -- 172.21.15.123:0/853162026 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5795+0+0 (secure 0 0 0) 0x7f5ef00abc00 con 0x7f5f0015ab40 2024-09-15T23:17:00.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.963+0000 7f5f05c79640 1 --2- 172.21.15.123:0/853162026 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5ee406c2e0 0x7f5ee406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:00.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.964+0000 7f5f05c79640 1 --2- 172.21.15.123:0/853162026 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5ee406c2e0 0x7f5ee406e7a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5efc006fd0 tx=0x7f5efc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:00.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:00.967+0000 7f5ef67fc640 1 -- 172.21.15.123:0/853162026 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5ef00b2080 con 0x7f5f0015ab40 2024-09-15T23:17:01.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.166+0000 7f5f07edd640 1 -- 172.21.15.123:0/853162026 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5f001e4620 con 0x7f5f0015ab40 2024-09-15T23:17:01.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.166+0000 7f5ef67fc640 1 -- 172.21.15.123:0/853162026 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5236 (secure 0 0 0) 0x7f5ef004b030 con 0x7f5f0015ab40 2024-09-15T23:17:01.168 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:17:01.168 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":66,"btime":"2024-09-15T23:16:51:834717+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6556,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/488079964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":488079964},{"type":"v1","addr":"172.21.15.188:6835","nonce":488079964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/4123673242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":4123673242},{"type":"v1","addr":"172.21.15.188:6837","nonce":4123673242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":7356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/2179085155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2179085155},{"type":"v1","addr":"172.21.15.123:6833","nonce":2179085155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:16:35.080780+0000","modified":"2024-09-15T23:16:51.834712+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7365":{"gid":7365,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6835/2621254224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2621254224},{"type":"v1","addr":"172.21.15.123:6835","nonce":2621254224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7365,"qdb_cluster":[7365]},"id":6}]} 2024-09-15T23:17:01.168 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 66 2024-09-15T23:17:01.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.168+0000 7f5f07edd640 1 -- 172.21.15.123:0/853162026 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5ee406c2e0 msgr2=0x7f5ee406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:01.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.168+0000 7f5f07edd640 1 --2- 172.21.15.123:0/853162026 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5ee406c2e0 0x7f5ee406e7a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5efc006fd0 tx=0x7f5efc008040 comp rx=0 tx=0).stop 2024-09-15T23:17:01.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.168+0000 7f5f07edd640 1 -- 172.21.15.123:0/853162026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f0015ab40 msgr2=0x7f5f001e3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:01.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.168+0000 7f5f07edd640 1 --2- 172.21.15.123:0/853162026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f0015ab40 0x7f5f001e3f10 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f5ef002a200 tx=0x7f5ef00046c0 comp rx=0 tx=0).stop 2024-09-15T23:17:01.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.168+0000 7f5f07edd640 1 -- 172.21.15.123:0/853162026 shutdown_connections 2024-09-15T23:17:01.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.168+0000 7f5f07edd640 1 --2- 172.21.15.123:0/853162026 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5f0015af20 0x7f5f001f58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:01.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.168+0000 7f5f07edd640 1 --2- 172.21.15.123:0/853162026 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5ee406c2e0 0x7f5ee406e7a0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:01.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.168+0000 7f5f07edd640 1 --2- 172.21.15.123:0/853162026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f0015ab40 0x7f5f001e3f10 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:01.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.168+0000 7f5f07edd640 1 --2- 172.21.15.123:0/853162026 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5f000720b0 0x7f5f0013aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:01.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.168+0000 7f5f07edd640 1 -- 172.21.15.123:0/853162026 >> 172.21.15.123:0/853162026 conn(0x7f5f000ccec0 msgr2=0x7f5f000b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:01.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.168+0000 7f5f07edd640 1 -- 172.21.15.123:0/853162026 shutdown_connections 2024-09-15T23:17:01.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.168+0000 7f5f07edd640 1 -- 172.21.15.123:0/853162026 wait complete. 2024-09-15T23:17:01.180 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:17:01.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.277+0000 7f35124f1640 1 Processor -- start 2024-09-15T23:17:01.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.277+0000 7f35124f1640 1 -- start start 2024-09-15T23:17:01.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.278+0000 7f35124f1640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f350c06c6a0 0x7f350c0720b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:01.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.278+0000 7f35124f1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f350c15af20 0x7f350c15b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:01.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.278+0000 7f35124f1640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f350c071010 con 0x7f350c15ab40 2024-09-15T23:17:01.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.278+0000 7f35124f1640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f350c06cb10 con 0x7f350c06c6a0 2024-09-15T23:17:01.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.278+0000 7f35124f1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f350c0712f0 con 0x7f350c15af20 2024-09-15T23:17:01.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.278+0000 7f350b7fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f350c06c6a0 0x7f350c0720b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:01.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.278+0000 7f3510a8e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f350c15af20 0x7f350c15b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:01.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.278+0000 7f350bfff640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f350c15ab40 0x7f350c073990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:43270/0 (socket says 172.21.15.123:43270) 2024-09-15T23:17:01.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.279+0000 7f350b7fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f350c06c6a0 0x7f350c0720b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:55488/0 (socket says 172.21.15.123:55488) 2024-09-15T23:17:01.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.279+0000 7f350bfff640 1 -- 172.21.15.123:0/1752482512 learned_addr learned my addr 172.21.15.123:0/1752482512 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:17:01.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.279+0000 7f3510a8e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f350c15af20 0x7f350c15b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:33650/0 (socket says 172.21.15.123:33650) 2024-09-15T23:17:01.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.279+0000 7f3510a8e640 1 -- 172.21.15.123:0/1752482512 >> v2:172.21.15.188:3300/0 conn(0x7f350c06c6a0 msgr2=0x7f350c0720b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:01.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.279+0000 7f3510a8e640 1 --2- 172.21.15.123:0/1752482512 >> v2:172.21.15.188:3300/0 conn(0x7f350c06c6a0 0x7f350c0720b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:01.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.279+0000 7f3510a8e640 1 -- 172.21.15.123:0/1752482512 >> v1:172.21.15.188:6789/0 conn(0x7f350c15ab40 legacy=0x7f350c073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:01.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.279+0000 7f3510a8e640 1 -- 172.21.15.123:0/1752482512 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f350c0715d0 con 0x7f350c15af20 2024-09-15T23:17:01.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.280+0000 7f3510a8e640 1 --2- 172.21.15.123:0/1752482512 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f350c15af20 0x7f350c15b370 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f350400aea0 tx=0x7f350402b720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a336d9773f257601 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:01.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.280+0000 7f350affd640 1 -- 172.21.15.123:0/1752482512 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3504037070 con 0x7f350c15af20 2024-09-15T23:17:01.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.280+0000 7f350affd640 1 -- 172.21.15.123:0/1752482512 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3504008640 con 0x7f350c15af20 2024-09-15T23:17:01.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.280+0000 7f350affd640 1 -- 172.21.15.123:0/1752482512 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3504008a10 con 0x7f350c15af20 2024-09-15T23:17:01.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.280+0000 7f35124f1640 1 -- 172.21.15.123:0/1752482512 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f350c15af20 msgr2=0x7f350c15b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:01.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.280+0000 7f35124f1640 1 --2- 172.21.15.123:0/1752482512 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f350c15af20 0x7f350c15b370 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f350400aea0 tx=0x7f350402b720 comp rx=0 tx=0).stop 2024-09-15T23:17:01.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.280+0000 7f35124f1640 1 -- 172.21.15.123:0/1752482512 shutdown_connections 2024-09-15T23:17:01.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.280+0000 7f35124f1640 1 --2- 172.21.15.123:0/1752482512 >> v2:172.21.15.188:3300/0 conn(0x7f350c06c6a0 0x7f350c0720b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:01.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.280+0000 7f35124f1640 1 --2- 172.21.15.123:0/1752482512 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f350c15af20 0x7f350c15b370 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:01.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.280+0000 7f35124f1640 1 -- 172.21.15.123:0/1752482512 >> 172.21.15.123:0/1752482512 conn(0x7f350c0ccec0 msgr2=0x7f350c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:01.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.280+0000 7f35124f1640 1 -- 172.21.15.123:0/1752482512 shutdown_connections 2024-09-15T23:17:01.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.280+0000 7f35124f1640 1 -- 172.21.15.123:0/1752482512 wait complete. 2024-09-15T23:17:01.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.281+0000 7f35124f1640 1 Processor -- start 2024-09-15T23:17:01.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.282+0000 7f35124f1640 1 -- start start 2024-09-15T23:17:01.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.282+0000 7f35124f1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f350c06c6a0 0x7f350c0c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:01.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.282+0000 7f35124f1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f350c15ab40 0x7f350c1f4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:01.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.282+0000 7f35124f1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f350c15af20 0x7f350c1467b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:01.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.282+0000 7f35124f1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f350c15ba30 con 0x7f350c15ab40 2024-09-15T23:17:01.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.282+0000 7f35124f1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f350c15b8b0 con 0x7f350c15af20 2024-09-15T23:17:01.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.282+0000 7f35124f1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f350c06bc10 con 0x7f350c06c6a0 2024-09-15T23:17:01.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.283+0000 7f350b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f350c15ab40 0x7f350c1f4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:01.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.283+0000 7f350b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f350c15ab40 0x7f350c1f4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46488/0 (socket says 172.21.15.123:46488) 2024-09-15T23:17:01.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.283+0000 7f350b7fe640 1 -- 172.21.15.123:0/3933511299 learned_addr learned my addr 172.21.15.123:0/3933511299 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:01.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.283+0000 7f350bfff640 1 --2- 172.21.15.123:0/3933511299 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f350c06c6a0 0x7f350c0c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:01.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.283+0000 7f3510a8e640 1 --2- 172.21.15.123:0/3933511299 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f350c15af20 0x7f350c1467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:01.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.283+0000 7f350b7fe640 1 -- 172.21.15.123:0/3933511299 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f350c06c6a0 msgr2=0x7f350c0c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:01.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.283+0000 7f350b7fe640 1 --2- 172.21.15.123:0/3933511299 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f350c06c6a0 0x7f350c0c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:01.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.283+0000 7f350b7fe640 1 -- 172.21.15.123:0/3933511299 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f350c15af20 msgr2=0x7f350c1467b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:01.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.283+0000 7f350b7fe640 1 --2- 172.21.15.123:0/3933511299 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f350c15af20 0x7f350c1467b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:01.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.283+0000 7f350b7fe640 1 -- 172.21.15.123:0/3933511299 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f350c1f46c0 con 0x7f350c15ab40 2024-09-15T23:17:01.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.283+0000 7f350b7fe640 1 --2- 172.21.15.123:0/3933511299 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f350c15ab40 0x7f350c1f4180 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f350000e9b0 tx=0x7f350000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:01.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.283+0000 7f3508ff9640 1 -- 172.21.15.123:0/3933511299 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3500017070 con 0x7f350c15ab40 2024-09-15T23:17:01.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.283+0000 7f3508ff9640 1 -- 172.21.15.123:0/3933511299 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f350000c9a0 con 0x7f350c15ab40 2024-09-15T23:17:01.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.283+0000 7f35124f1640 1 -- 172.21.15.123:0/3933511299 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f350c0c69f0 con 0x7f350c15ab40 2024-09-15T23:17:01.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.283+0000 7f3508ff9640 1 -- 172.21.15.123:0/3933511299 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350000cd90 con 0x7f350c15ab40 2024-09-15T23:17:01.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.283+0000 7f35124f1640 1 -- 172.21.15.123:0/3933511299 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f350c0c6fb0 con 0x7f350c15ab40 2024-09-15T23:17:01.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.284+0000 7f35124f1640 1 -- 172.21.15.123:0/3933511299 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f350c06bfd0 con 0x7f350c15ab40 2024-09-15T23:17:01.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.285+0000 7f3508ff9640 1 -- 172.21.15.123:0/3933511299 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f350001a070 con 0x7f350c15ab40 2024-09-15T23:17:01.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.285+0000 7f3508ff9640 1 --2- 172.21.15.123:0/3933511299 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f34f806c2b0 0x7f34f806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.285+0000 7f3508ff9640 1 -- 172.21.15.123:0/3933511299 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5795+0+0 (secure 0 0 0) 0x7f350008b410 con 0x7f350c15ab40 2024-09-15T23:17:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.285+0000 7f350bfff640 1 --2- 172.21.15.123:0/3933511299 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f34f806c2b0 0x7f34f806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.286+0000 7f350bfff640 1 --2- 172.21.15.123:0/3933511299 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f34f806c2b0 0x7f34f806e770 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f34fc000f60 tx=0x7f34fc007e80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:01.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.289+0000 7f3508ff9640 1 -- 172.21.15.123:0/3933511299 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f350c1f46c0 con 0x7f350c15ab40 2024-09-15T23:17:01.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.491+0000 7f35124f1640 1 -- 172.21.15.123:0/3933511299 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f350c0b3eb0 con 0x7f350c15ab40 2024-09-15T23:17:01.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.491+0000 7f3508ff9640 1 -- 172.21.15.123:0/3933511299 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5236 (secure 0 0 0) 0x7f35000594d0 con 0x7f350c15ab40 2024-09-15T23:17:01.492 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:17:01.492 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":66,"btime":"2024-09-15T23:16:51:834717+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6556,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/488079964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":488079964},{"type":"v1","addr":"172.21.15.188:6835","nonce":488079964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/4123673242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":4123673242},{"type":"v1","addr":"172.21.15.188:6837","nonce":4123673242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":7356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/2179085155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2179085155},{"type":"v1","addr":"172.21.15.123:6833","nonce":2179085155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:16:35.080780+0000","modified":"2024-09-15T23:16:51.834712+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7365":{"gid":7365,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6835/2621254224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2621254224},{"type":"v1","addr":"172.21.15.123:6835","nonce":2621254224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7365,"qdb_cluster":[7365]},"id":6}]} 2024-09-15T23:17:01.493 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 66 2024-09-15T23:17:01.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.493+0000 7f35124f1640 1 -- 172.21.15.123:0/3933511299 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f34f806c2b0 msgr2=0x7f34f806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:01.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.493+0000 7f35124f1640 1 --2- 172.21.15.123:0/3933511299 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f34f806c2b0 0x7f34f806e770 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f34fc000f60 tx=0x7f34fc007e80 comp rx=0 tx=0).stop 2024-09-15T23:17:01.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.493+0000 7f35124f1640 1 -- 172.21.15.123:0/3933511299 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f350c15ab40 msgr2=0x7f350c1f4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:01.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.493+0000 7f35124f1640 1 --2- 172.21.15.123:0/3933511299 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f350c15ab40 0x7f350c1f4180 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f350000e9b0 tx=0x7f350000ee70 comp rx=0 tx=0).stop 2024-09-15T23:17:01.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.493+0000 7f35124f1640 1 -- 172.21.15.123:0/3933511299 shutdown_connections 2024-09-15T23:17:01.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.493+0000 7f35124f1640 1 --2- 172.21.15.123:0/3933511299 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f350c15af20 0x7f350c1467b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:01.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.493+0000 7f35124f1640 1 --2- 172.21.15.123:0/3933511299 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f34f806c2b0 0x7f34f806e770 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:01.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.493+0000 7f35124f1640 1 --2- 172.21.15.123:0/3933511299 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f350c15ab40 0x7f350c1f4180 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:01.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.493+0000 7f35124f1640 1 --2- 172.21.15.123:0/3933511299 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f350c06c6a0 0x7f350c0c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:01.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.493+0000 7f35124f1640 1 -- 172.21.15.123:0/3933511299 >> 172.21.15.123:0/3933511299 conn(0x7f350c0ccec0 msgr2=0x7f350c071fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:01.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.493+0000 7f35124f1640 1 -- 172.21.15.123:0/3933511299 shutdown_connections 2024-09-15T23:17:01.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.493+0000 7f35124f1640 1 -- 172.21.15.123:0/3933511299 wait complete. 2024-09-15T23:17:01.505 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:17:01.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.603+0000 7f5500ca5640 1 Processor -- start 2024-09-15T23:17:01.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.603+0000 7f5500ca5640 1 -- start start 2024-09-15T23:17:01.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.604+0000 7f5500ca5640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54fc073890 0x7f54fc0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:01.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.604+0000 7f5500ca5640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54fc0b4020 con 0x7f54fc0b5880 2024-09-15T23:17:01.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.604+0000 7f5500ca5640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54fc0b42c0 con 0x7f54fc145ed0 2024-09-15T23:17:01.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.604+0000 7f5500ca5640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f54fc0b45a0 con 0x7f54fc073890 2024-09-15T23:17:01.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.604+0000 7f54fad9d640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f54fc0b5880 0x7f54fc0b5d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49136/0 (socket says 172.21.15.123:49136) 2024-09-15T23:17:01.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.604+0000 7f54fad9d640 1 -- 172.21.15.123:0/2184984389 learned_addr learned my addr 172.21.15.123:0/2184984389 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:17:01.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.604+0000 7f54f9d9b640 1 -- 172.21.15.123:0/2184984389 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1742077880 0 0) 0x7f54fc0b4020 con 0x7f54fc0b5880 2024-09-15T23:17:01.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.604+0000 7f54f1d9b640 1 --2- 172.21.15.123:0/2184984389 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54fc073890 0x7f54fc0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:01.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.604+0000 7f54f9d9b640 1 -- 172.21.15.123:0/2184984389 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54e8003520 con 0x7f54fc0b5880 2024-09-15T23:17:01.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.604+0000 7f54f9d9b640 1 -- 172.21.15.123:0/2184984389 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3338675505 0 0) 0x7f54e8003520 con 0x7f54fc0b5880 2024-09-15T23:17:01.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.604+0000 7f54f9d9b640 1 -- 172.21.15.123:0/2184984389 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54fc073890 msgr2=0x7f54fc0b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:01.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.604+0000 7f54f9d9b640 1 --2- 172.21.15.123:0/2184984389 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54fc073890 0x7f54fc0b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:01.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.604+0000 7f54f9d9b640 1 -- 172.21.15.123:0/2184984389 >> v1:172.21.15.188:6789/0 conn(0x7f54fc145ed0 legacy=0x7f54fc073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:01.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.604+0000 7f54f9d9b640 1 -- 172.21.15.123:0/2184984389 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54fc0b4880 con 0x7f54fc0b5880 2024-09-15T23:17:01.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.605+0000 7f54f9d9b640 1 -- 172.21.15.123:0/2184984389 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f54f40019f0 con 0x7f54fc0b5880 2024-09-15T23:17:01.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.605+0000 7f54f9d9b640 1 -- 172.21.15.123:0/2184984389 >> v1:172.21.15.123:6789/0 conn(0x7f54fc0b5880 legacy=0x7f54fc0b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:01.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.605+0000 7f54f9d9b640 1 --2- 172.21.15.123:0/2184984389 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f54e80039e0 0x7f54e8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:01.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.605+0000 7f54f9d9b640 1 --2- 172.21.15.123:0/2184984389 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54fc073890 0x7f54e8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:01.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.605+0000 7f54f9d9b640 1 --2- 172.21.15.123:0/2184984389 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54e8004d40 0x7f54e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:01.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.605+0000 7f54f9d9b640 1 -- 172.21.15.123:0/2184984389 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f54fc0b45a0 con 0x7f54e8004d40 2024-09-15T23:17:01.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.605+0000 7f54f9d9b640 1 -- 172.21.15.123:0/2184984389 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f54e800ba70 con 0x7f54e80039e0 2024-09-15T23:17:01.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.605+0000 7f54f9d9b640 1 -- 172.21.15.123:0/2184984389 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f54e800bc70 con 0x7f54fc073890 2024-09-15T23:17:01.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.605+0000 7f54fad9d640 1 --2- 172.21.15.123:0/2184984389 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54e8004d40 0x7f54e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:01.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.605+0000 7f54fa59c640 1 --2- 172.21.15.123:0/2184984389 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f54e80039e0 0x7f54e8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:01.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.605+0000 7f54f1d9b640 1 --2- 172.21.15.123:0/2184984389 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54fc073890 0x7f54e8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:01.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.605+0000 7f54fad9d640 1 -- 172.21.15.123:0/2184984389 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54fc073890 msgr2=0x7f54e8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:01.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.605+0000 7f54fad9d640 1 --2- 172.21.15.123:0/2184984389 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54fc073890 0x7f54e8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:01.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.605+0000 7f54fad9d640 1 -- 172.21.15.123:0/2184984389 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f54e80039e0 msgr2=0x7f54e8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:01.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.605+0000 7f54fad9d640 1 --2- 172.21.15.123:0/2184984389 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f54e80039e0 0x7f54e8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:01.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.605+0000 7f54fad9d640 1 -- 172.21.15.123:0/2184984389 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54e8003520 con 0x7f54e8004d40 2024-09-15T23:17:01.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.606+0000 7f54fad9d640 1 --2- 172.21.15.123:0/2184984389 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54e8004d40 0x7f54e80051c0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f54f400a810 tx=0x7f54e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0abc3ad76cc21a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:01.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.606+0000 7f54f9d9b640 1 -- 172.21.15.123:0/2184984389 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f400a460 con 0x7f54e8004d40 2024-09-15T23:17:01.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.606+0000 7f54f9d9b640 1 -- 172.21.15.123:0/2184984389 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54f402f070 con 0x7f54e8004d40 2024-09-15T23:17:01.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.606+0000 7f54f9d9b640 1 -- 172.21.15.123:0/2184984389 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f402bc90 con 0x7f54e8004d40 2024-09-15T23:17:01.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.606+0000 7f5500ca5640 1 -- 172.21.15.123:0/2184984389 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54e8004d40 msgr2=0x7f54e80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:01.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.606+0000 7f5500ca5640 1 --2- 172.21.15.123:0/2184984389 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54e8004d40 0x7f54e80051c0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f54f400a810 tx=0x7f54e8005830 comp rx=0 tx=0).stop 2024-09-15T23:17:01.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.606+0000 7f54fad9d640 1 -- 172.21.15.123:0/2184984389 reap_dead start 2024-09-15T23:17:01.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.606+0000 7f5500ca5640 1 -- 172.21.15.123:0/2184984389 shutdown_connections 2024-09-15T23:17:01.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.606+0000 7f5500ca5640 1 -- 172.21.15.123:0/2184984389 >> 172.21.15.123:0/2184984389 conn(0x7f54fc0ccec0 msgr2=0x7f54fc0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:01.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.606+0000 7f5500ca5640 1 -- 172.21.15.123:0/2184984389 shutdown_connections 2024-09-15T23:17:01.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.606+0000 7f5500ca5640 1 -- 172.21.15.123:0/2184984389 wait complete. 2024-09-15T23:17:01.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.608+0000 7f5500ca5640 1 Processor -- start 2024-09-15T23:17:01.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.608+0000 7f5500ca5640 1 -- start start 2024-09-15T23:17:01.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.609+0000 7f5500ca5640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54fc1ee2c0 0x7f54fc1549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:01.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.609+0000 7f5500ca5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f54fc159690 0x7f54fc159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:01.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.609+0000 7f5500ca5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54fc156c50 0x7f54fc1570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:01.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.609+0000 7f5500ca5640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f54fc146430 con 0x7f54fc156c50 2024-09-15T23:17:01.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.609+0000 7f5500ca5640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f54fc1462b0 con 0x7f54fc159690 2024-09-15T23:17:01.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.609+0000 7f5500ca5640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f54fc0b5080 con 0x7f54fc1ee2c0 2024-09-15T23:17:01.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.609+0000 7f54fad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54fc156c50 0x7f54fc1570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:01.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.609+0000 7f54fad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54fc156c50 0x7f54fc1570d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46510/0 (socket says 172.21.15.123:46510) 2024-09-15T23:17:01.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.609+0000 7f54fad9d640 1 -- 172.21.15.123:0/765629104 learned_addr learned my addr 172.21.15.123:0/765629104 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:01.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.609+0000 7f54fa59c640 1 --2- 172.21.15.123:0/765629104 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54fc1ee2c0 0x7f54fc1549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:01.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.609+0000 7f54f1d9b640 1 --2- 172.21.15.123:0/765629104 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f54fc159690 0x7f54fc159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:01.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.609+0000 7f54fad9d640 1 -- 172.21.15.123:0/765629104 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54fc1ee2c0 msgr2=0x7f54fc1549b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:01.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.609+0000 7f54fad9d640 1 --2- 172.21.15.123:0/765629104 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54fc1ee2c0 0x7f54fc1549b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:01.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.609+0000 7f54fad9d640 1 -- 172.21.15.123:0/765629104 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f54fc159690 msgr2=0x7f54fc159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:01.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.609+0000 7f54fad9d640 1 --2- 172.21.15.123:0/765629104 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f54fc159690 0x7f54fc159b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:01.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.609+0000 7f54fad9d640 1 -- 172.21.15.123:0/765629104 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54fc1f4590 con 0x7f54fc156c50 2024-09-15T23:17:01.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.609+0000 7f54fad9d640 1 --2- 172.21.15.123:0/765629104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54fc156c50 0x7f54fc1570d0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f54f402b4e0 tx=0x7f54fc0c6400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:01.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.609+0000 7f54f37fe640 1 -- 172.21.15.123:0/765629104 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f4044070 con 0x7f54fc156c50 2024-09-15T23:17:01.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.609+0000 7f54f37fe640 1 -- 172.21.15.123:0/765629104 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54f4001a00 con 0x7f54fc156c50 2024-09-15T23:17:01.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.609+0000 7f5500ca5640 1 -- 172.21.15.123:0/765629104 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54fc1f4870 con 0x7f54fc156c50 2024-09-15T23:17:01.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.610+0000 7f54f37fe640 1 -- 172.21.15.123:0/765629104 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f400a460 con 0x7f54fc156c50 2024-09-15T23:17:01.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.610+0000 7f5500ca5640 1 -- 172.21.15.123:0/765629104 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54fc1f4e30 con 0x7f54fc156c50 2024-09-15T23:17:01.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.610+0000 7f5500ca5640 1 -- 172.21.15.123:0/765629104 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54fc15a050 con 0x7f54fc156c50 2024-09-15T23:17:01.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.611+0000 7f54f37fe640 1 -- 172.21.15.123:0/765629104 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f54f4047070 con 0x7f54fc156c50 2024-09-15T23:17:01.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.611+0000 7f54f37fe640 1 --2- 172.21.15.123:0/765629104 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f54dc06c2b0 0x7f54dc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:01.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.612+0000 7f54f37fe640 1 -- 172.21.15.123:0/765629104 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5795+0+0 (secure 0 0 0) 0x7f54f40ab2b0 con 0x7f54fc156c50 2024-09-15T23:17:01.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.612+0000 7f54fa59c640 1 --2- 172.21.15.123:0/765629104 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f54dc06c2b0 0x7f54dc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:01.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.612+0000 7f54fa59c640 1 --2- 172.21.15.123:0/765629104 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f54dc06c2b0 0x7f54dc06e770 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f54ec0017e0 tx=0x7f54ec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:01.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.616+0000 7f54f37fe640 1 -- 172.21.15.123:0/765629104 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f54f40794c0 con 0x7f54fc156c50 2024-09-15T23:17:01.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.784+0000 7f5500ca5640 1 -- 172.21.15.123:0/765629104 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f54fc073180 con 0x7f54fc156c50 2024-09-15T23:17:01.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.785+0000 7f54f37fe640 1 -- 172.21.15.123:0/765629104 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) ==== 74+0+16888 (secure 0 0 0) 0x7f54f40ab0d0 con 0x7f54fc156c50 2024-09-15T23:17:01.787 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:17:01.787 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":102,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:16:47.820565+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:16:33.696407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-15T23:16:34.051030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.188:6837/2840550551":"2024-09-16T23:16:47.812432+0000","172.21.15.188:6835/2840550551":"2024-09-16T23:16:47.812432+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:17:01.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.787+0000 7f5500ca5640 1 -- 172.21.15.123:0/765629104 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f54dc06c2b0 msgr2=0x7f54dc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:01.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.787+0000 7f5500ca5640 1 --2- 172.21.15.123:0/765629104 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f54dc06c2b0 0x7f54dc06e770 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f54ec0017e0 tx=0x7f54ec009040 comp rx=0 tx=0).stop 2024-09-15T23:17:01.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.787+0000 7f5500ca5640 1 -- 172.21.15.123:0/765629104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54fc156c50 msgr2=0x7f54fc1570d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:01.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.787+0000 7f5500ca5640 1 --2- 172.21.15.123:0/765629104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54fc156c50 0x7f54fc1570d0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f54f402b4e0 tx=0x7f54fc0c6400 comp rx=0 tx=0).stop 2024-09-15T23:17:01.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.787+0000 7f5500ca5640 1 -- 172.21.15.123:0/765629104 shutdown_connections 2024-09-15T23:17:01.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.787+0000 7f5500ca5640 1 --2- 172.21.15.123:0/765629104 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f54dc06c2b0 0x7f54dc06e770 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:01.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.787+0000 7f5500ca5640 1 --2- 172.21.15.123:0/765629104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54fc156c50 0x7f54fc1570d0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:01.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.787+0000 7f5500ca5640 1 --2- 172.21.15.123:0/765629104 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f54fc159690 0x7f54fc159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:01.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.787+0000 7f5500ca5640 1 --2- 172.21.15.123:0/765629104 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54fc1ee2c0 0x7f54fc1549b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:01.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.787+0000 7f5500ca5640 1 -- 172.21.15.123:0/765629104 >> 172.21.15.123:0/765629104 conn(0x7f54fc0ccec0 msgr2=0x7f54fc143c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:01.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.788+0000 7f5500ca5640 1 -- 172.21.15.123:0/765629104 shutdown_connections 2024-09-15T23:17:01.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.788+0000 7f5500ca5640 1 -- 172.21.15.123:0/765629104 wait complete. 2024-09-15T23:17:01.801 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T23:17:01.801 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:17:01.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.899+0000 7f3652d2c640 1 Processor -- start 2024-09-15T23:17:01.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.899+0000 7f3652d2c640 1 -- start start 2024-09-15T23:17:01.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.900+0000 7f3652d2c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f364c0cef60 0x7f364c15eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:01.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.900+0000 7f3652d2c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f364c0b3790 0x7f364c1624e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:01.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.900+0000 7f3652d2c640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f364c15f060 con 0x7f364c06bc10 2024-09-15T23:17:01.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.900+0000 7f3652d2c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f364c0cd690 con 0x7f364c0b3790 2024-09-15T23:17:01.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.900+0000 7f3652d2c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f364c0d06f0 con 0x7f364c0cef60 2024-09-15T23:17:01.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.900+0000 7f3650ac8640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f364c06bc10 0x7f364c06bff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49138/0 (socket says 172.21.15.123:49138) 2024-09-15T23:17:01.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.900+0000 7f3650ac8640 1 -- 172.21.15.123:0/1237104320 learned_addr learned my addr 172.21.15.123:0/1237104320 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:17:01.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.900+0000 7f364b7fe640 1 -- 172.21.15.123:0/1237104320 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1981469940 0 0) 0x7f364c15f060 con 0x7f364c06bc10 2024-09-15T23:17:01.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.900+0000 7f364b7fe640 1 -- 172.21.15.123:0/1237104320 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3634003520 con 0x7f364c06bc10 2024-09-15T23:17:01.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.900+0000 7f36512c9640 1 --2- 172.21.15.123:0/1237104320 >> v2:172.21.15.188:3300/0 conn(0x7f364c0b3790 0x7f364c1624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:01.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.900+0000 7f364bfff640 1 --2- 172.21.15.123:0/1237104320 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f364c0cef60 0x7f364c15eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:01.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.901+0000 7f364b7fe640 1 -- 172.21.15.123:0/1237104320 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2197240464 0 0) 0x7f3634003520 con 0x7f364c06bc10 2024-09-15T23:17:01.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.901+0000 7f364b7fe640 1 -- 172.21.15.123:0/1237104320 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f364c0cef60 msgr2=0x7f364c15eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:01.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.901+0000 7f364b7fe640 1 --2- 172.21.15.123:0/1237104320 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f364c0cef60 0x7f364c15eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:01.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.901+0000 7f364b7fe640 1 -- 172.21.15.123:0/1237104320 >> v2:172.21.15.188:3300/0 conn(0x7f364c0b3790 msgr2=0x7f364c1624e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:01.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.901+0000 7f364b7fe640 1 --2- 172.21.15.123:0/1237104320 >> v2:172.21.15.188:3300/0 conn(0x7f364c0b3790 0x7f364c1624e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:01.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.901+0000 7f364b7fe640 1 -- 172.21.15.123:0/1237104320 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f364c0b4090 con 0x7f364c06bc10 2024-09-15T23:17:01.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.901+0000 7f364b7fe640 1 -- 172.21.15.123:0/1237104320 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f363c001670 con 0x7f364c06bc10 2024-09-15T23:17:01.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.901+0000 7f364b7fe640 1 -- 172.21.15.123:0/1237104320 >> v1:172.21.15.123:6789/0 conn(0x7f364c06bc10 legacy=0x7f364c06bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:01.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.901+0000 7f364b7fe640 1 --2- 172.21.15.123:0/1237104320 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f364c0cef60 0x7f36340039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:01.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.901+0000 7f364b7fe640 1 --2- 172.21.15.123:0/1237104320 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3634004010 0x7f3634004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:01.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.901+0000 7f364b7fe640 1 --2- 172.21.15.123:0/1237104320 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3634004d40 0x7f36340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:01.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.901+0000 7f364b7fe640 1 -- 172.21.15.123:0/1237104320 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f364c0cd690 con 0x7f3634004d40 2024-09-15T23:17:01.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.901+0000 7f364b7fe640 1 -- 172.21.15.123:0/1237104320 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f364c0d06f0 con 0x7f3634004010 2024-09-15T23:17:01.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.901+0000 7f364b7fe640 1 -- 172.21.15.123:0/1237104320 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f363400baf0 con 0x7f364c0cef60 2024-09-15T23:17:01.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.901+0000 7f36512c9640 1 --2- 172.21.15.123:0/1237104320 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3634004d40 0x7f36340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:01.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.901+0000 7f3650ac8640 1 --2- 172.21.15.123:0/1237104320 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f364c0cef60 0x7f36340039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:01.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.901+0000 7f364bfff640 1 --2- 172.21.15.123:0/1237104320 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3634004010 0x7f3634004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:01.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.901+0000 7f36512c9640 1 -- 172.21.15.123:0/1237104320 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f364c0cef60 msgr2=0x7f36340039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:01.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.901+0000 7f36512c9640 1 --2- 172.21.15.123:0/1237104320 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f364c0cef60 0x7f36340039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:01.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.901+0000 7f36512c9640 1 -- 172.21.15.123:0/1237104320 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3634004010 msgr2=0x7f3634004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:01.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.901+0000 7f36512c9640 1 --2- 172.21.15.123:0/1237104320 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3634004010 0x7f3634004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:01.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.901+0000 7f36512c9640 1 -- 172.21.15.123:0/1237104320 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3634003520 con 0x7f3634004d40 2024-09-15T23:17:01.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.902+0000 7f36512c9640 1 --2- 172.21.15.123:0/1237104320 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3634004d40 0x7f36340051c0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f3644007360 tx=0x7f3634005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31a543d66b7d15ba server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:01.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.902+0000 7f364b7fe640 1 -- 172.21.15.123:0/1237104320 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3644009be0 con 0x7f3634004d40 2024-09-15T23:17:01.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.902+0000 7f364b7fe640 1 -- 172.21.15.123:0/1237104320 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f364402e620 con 0x7f3634004d40 2024-09-15T23:17:01.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.902+0000 7f364b7fe640 1 -- 172.21.15.123:0/1237104320 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f364402e9f0 con 0x7f3634004d40 2024-09-15T23:17:01.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.902+0000 7f3652d2c640 1 -- 172.21.15.123:0/1237104320 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3634004d40 msgr2=0x7f36340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:01.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.902+0000 7f3652d2c640 1 --2- 172.21.15.123:0/1237104320 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3634004d40 0x7f36340051c0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f3644007360 tx=0x7f3634005830 comp rx=0 tx=0).stop 2024-09-15T23:17:01.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.902+0000 7f36512c9640 1 -- 172.21.15.123:0/1237104320 reap_dead start 2024-09-15T23:17:01.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.902+0000 7f3652d2c640 1 -- 172.21.15.123:0/1237104320 shutdown_connections 2024-09-15T23:17:01.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.902+0000 7f3652d2c640 1 -- 172.21.15.123:0/1237104320 >> 172.21.15.123:0/1237104320 conn(0x7f364c06cd20 msgr2=0x7f364c06d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:01.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.903+0000 7f3652d2c640 1 -- 172.21.15.123:0/1237104320 shutdown_connections 2024-09-15T23:17:01.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.903+0000 7f3652d2c640 1 -- 172.21.15.123:0/1237104320 wait complete. 2024-09-15T23:17:01.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.904+0000 7f3652d2c640 1 Processor -- start 2024-09-15T23:17:01.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.904+0000 7f3652d2c640 1 -- start start 2024-09-15T23:17:01.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.905+0000 7f3652d2c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3634004d40 0x7f364c150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:01.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.905+0000 7f3652d2c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f364c0cbaf0 0x7f364c0cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:01.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.905+0000 7f3652d2c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f364c0b67c0 0x7f364c0b6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:01.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.905+0000 7f3652d2c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f364c0d0f10 con 0x7f364c0b67c0 2024-09-15T23:17:01.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.905+0000 7f3652d2c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f364c0d0c30 con 0x7f364c0cbaf0 2024-09-15T23:17:01.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.905+0000 7f3652d2c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f364c0b3c20 con 0x7f3634004d40 2024-09-15T23:17:01.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.905+0000 7f36512c9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f364c0b67c0 0x7f364c0b6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:01.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.905+0000 7f36512c9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f364c0b67c0 0x7f364c0b6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46536/0 (socket says 172.21.15.123:46536) 2024-09-15T23:17:01.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.905+0000 7f36512c9640 1 -- 172.21.15.123:0/1351599999 learned_addr learned my addr 172.21.15.123:0/1351599999 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:01.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.905+0000 7f3650ac8640 1 --2- 172.21.15.123:0/1351599999 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3634004d40 0x7f364c150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:01.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.905+0000 7f364bfff640 1 --2- 172.21.15.123:0/1351599999 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f364c0cbaf0 0x7f364c0cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:01.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.905+0000 7f36512c9640 1 -- 172.21.15.123:0/1351599999 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3634004d40 msgr2=0x7f364c150240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:01.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.905+0000 7f36512c9640 1 --2- 172.21.15.123:0/1351599999 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3634004d40 0x7f364c150240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:01.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.905+0000 7f36512c9640 1 -- 172.21.15.123:0/1351599999 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f364c0cbaf0 msgr2=0x7f364c0cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:01.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.905+0000 7f36512c9640 1 --2- 172.21.15.123:0/1351599999 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f364c0cbaf0 0x7f364c0cbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:01.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.905+0000 7f36512c9640 1 -- 172.21.15.123:0/1351599999 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f364c153f70 con 0x7f364c0b67c0 2024-09-15T23:17:01.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.905+0000 7f36512c9640 1 --2- 172.21.15.123:0/1351599999 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f364c0b67c0 0x7f364c0b6c40 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f364402b0a0 tx=0x7f3644004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:01.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.905+0000 7f36497fa640 1 -- 172.21.15.123:0/1351599999 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3644009be0 con 0x7f364c0b67c0 2024-09-15T23:17:01.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.905+0000 7f36497fa640 1 -- 172.21.15.123:0/1351599999 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3644045070 con 0x7f364c0b67c0 2024-09-15T23:17:01.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.905+0000 7f3652d2c640 1 -- 172.21.15.123:0/1351599999 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f364c154250 con 0x7f364c0b67c0 2024-09-15T23:17:01.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.905+0000 7f36497fa640 1 -- 172.21.15.123:0/1351599999 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3644036a80 con 0x7f364c0b67c0 2024-09-15T23:17:01.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.905+0000 7f3652d2c640 1 -- 172.21.15.123:0/1351599999 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f364c154810 con 0x7f364c0b67c0 2024-09-15T23:17:01.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.906+0000 7f3652d2c640 1 -- 172.21.15.123:0/1351599999 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f364c15eb20 con 0x7f364c0b67c0 2024-09-15T23:17:01.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.907+0000 7f36497fa640 1 -- 172.21.15.123:0/1351599999 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3644036c20 con 0x7f364c0b67c0 2024-09-15T23:17:01.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.907+0000 7f36497fa640 1 --2- 172.21.15.123:0/1351599999 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f363806c2e0 0x7f363806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:01.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.907+0000 7f36497fa640 1 -- 172.21.15.123:0/1351599999 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5795+0+0 (secure 0 0 0) 0x7f36440ac3a0 con 0x7f364c0b67c0 2024-09-15T23:17:01.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.908+0000 7f3650ac8640 1 --2- 172.21.15.123:0/1351599999 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f363806c2e0 0x7f363806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:01.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.908+0000 7f3650ac8640 1 --2- 172.21.15.123:0/1351599999 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f363806c2e0 0x7f363806e7a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f363c001eb0 tx=0x7f363c001430 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:01.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:01.912+0000 7f36497fa640 1 -- 172.21.15.123:0/1351599999 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f364403d070 con 0x7f364c0b67c0 2024-09-15T23:17:02.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.110+0000 7f3652d2c640 1 -- 172.21.15.123:0/1351599999 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f364c072f20 con 0x7f364c0b67c0 2024-09-15T23:17:02.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.111+0000 7f36497fa640 1 -- 172.21.15.123:0/1351599999 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5236 (secure 0 0 0) 0x7f3644032030 con 0x7f364c0b67c0 2024-09-15T23:17:02.113 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:17:02.113 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":66,"btime":"2024-09-15T23:16:51:834717+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6556,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/488079964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":488079964},{"type":"v1","addr":"172.21.15.188:6835","nonce":488079964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/4123673242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":4123673242},{"type":"v1","addr":"172.21.15.188:6837","nonce":4123673242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":7356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/2179085155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2179085155},{"type":"v1","addr":"172.21.15.123:6833","nonce":2179085155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:16:35.080780+0000","modified":"2024-09-15T23:16:51.834712+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7365":{"gid":7365,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6835/2621254224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2621254224},{"type":"v1","addr":"172.21.15.123:6835","nonce":2621254224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7365,"qdb_cluster":[7365]},"id":6}]} 2024-09-15T23:17:02.113 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 66 2024-09-15T23:17:02.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.113+0000 7f3652d2c640 1 -- 172.21.15.123:0/1351599999 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f363806c2e0 msgr2=0x7f363806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:02.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.113+0000 7f3652d2c640 1 --2- 172.21.15.123:0/1351599999 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f363806c2e0 0x7f363806e7a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f363c001eb0 tx=0x7f363c001430 comp rx=0 tx=0).stop 2024-09-15T23:17:02.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.113+0000 7f3652d2c640 1 -- 172.21.15.123:0/1351599999 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f364c0b67c0 msgr2=0x7f364c0b6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:02.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.113+0000 7f3652d2c640 1 --2- 172.21.15.123:0/1351599999 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f364c0b67c0 0x7f364c0b6c40 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f364402b0a0 tx=0x7f3644004ab0 comp rx=0 tx=0).stop 2024-09-15T23:17:02.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.113+0000 7f3652d2c640 1 -- 172.21.15.123:0/1351599999 shutdown_connections 2024-09-15T23:17:02.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.113+0000 7f3652d2c640 1 --2- 172.21.15.123:0/1351599999 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f363806c2e0 0x7f363806e7a0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:02.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.113+0000 7f3652d2c640 1 --2- 172.21.15.123:0/1351599999 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f364c0b67c0 0x7f364c0b6c40 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:02.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.113+0000 7f3652d2c640 1 --2- 172.21.15.123:0/1351599999 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f364c0cbaf0 0x7f364c0cbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:02.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.113+0000 7f3652d2c640 1 --2- 172.21.15.123:0/1351599999 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3634004d40 0x7f364c150240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:02.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.113+0000 7f3652d2c640 1 -- 172.21.15.123:0/1351599999 >> 172.21.15.123:0/1351599999 conn(0x7f364c06cd20 msgr2=0x7f364c06f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:02.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.113+0000 7f3652d2c640 1 -- 172.21.15.123:0/1351599999 shutdown_connections 2024-09-15T23:17:02.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.113+0000 7f3652d2c640 1 -- 172.21.15.123:0/1351599999 wait complete. 2024-09-15T23:17:02.125 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:17:02.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.222+0000 7f80c808d640 1 Processor -- start 2024-09-15T23:17:02.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.223+0000 7f80c808d640 1 -- start start 2024-09-15T23:17:02.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.223+0000 7f80c808d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f80c0145ed0 0x7f80c00b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:02.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.223+0000 7f80c808d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f80c0073180 0x7f80c00735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:02.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.223+0000 7f80c808d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80c00b4020 con 0x7f80c00b5880 2024-09-15T23:17:02.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.224+0000 7f80c808d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f80c0073b00 con 0x7f80c0073180 2024-09-15T23:17:02.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.224+0000 7f80c808d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f80c00b42c0 con 0x7f80c0145ed0 2024-09-15T23:17:02.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.224+0000 7f80c5628640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f80c0073180 0x7f80c00735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:02.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.224+0000 7f80c662a640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f80c00b5880 0x7f80c00b5d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49140/0 (socket says 172.21.15.123:49140) 2024-09-15T23:17:02.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.224+0000 7f80c5628640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f80c0073180 0x7f80c00735c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46542/0 (socket says 172.21.15.123:46542) 2024-09-15T23:17:02.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.224+0000 7f80c662a640 1 -- 172.21.15.123:0/2548762831 learned_addr learned my addr 172.21.15.123:0/2548762831 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:17:02.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.224+0000 7f80c5e29640 1 --2- 172.21.15.123:0/2548762831 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f80c0145ed0 0x7f80c00b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:02.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.224+0000 7f80c5628640 1 -- 172.21.15.123:0/2548762831 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f80c0145ed0 msgr2=0x7f80c00b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:02.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.224+0000 7f80c5628640 1 --2- 172.21.15.123:0/2548762831 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f80c0145ed0 0x7f80c00b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:02.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.224+0000 7f80c5628640 1 -- 172.21.15.123:0/2548762831 >> v1:172.21.15.123:6789/0 conn(0x7f80c00b5880 legacy=0x7f80c00b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:02.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.224+0000 7f80c5628640 1 -- 172.21.15.123:0/2548762831 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80c00b45a0 con 0x7f80c0073180 2024-09-15T23:17:02.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.224+0000 7f80c4e27640 1 -- 172.21.15.123:0/2548762831 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1017090093 0 0) 0x7f80c00b4020 con 0x7f80c00b5880 2024-09-15T23:17:02.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.225+0000 7f80c5628640 1 --2- 172.21.15.123:0/2548762831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80c0073180 0x7f80c00735c0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f80b40097a0 tx=0x7f80b402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be3bf63eac5a3b89 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:02.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.225+0000 7f80c4e27640 1 -- 172.21.15.123:0/2548762831 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b4037070 con 0x7f80c0073180 2024-09-15T23:17:02.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.225+0000 7f80c4e27640 1 -- 172.21.15.123:0/2548762831 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80b4032440 con 0x7f80c0073180 2024-09-15T23:17:02.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.225+0000 7f80c4e27640 1 -- 172.21.15.123:0/2548762831 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b4032810 con 0x7f80c0073180 2024-09-15T23:17:02.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.225+0000 7f80c808d640 1 -- 172.21.15.123:0/2548762831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80c0073180 msgr2=0x7f80c00735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:02.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.225+0000 7f80c808d640 1 --2- 172.21.15.123:0/2548762831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80c0073180 0x7f80c00735c0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f80b40097a0 tx=0x7f80b402a180 comp rx=0 tx=0).stop 2024-09-15T23:17:02.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.225+0000 7f80c808d640 1 -- 172.21.15.123:0/2548762831 shutdown_connections 2024-09-15T23:17:02.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.225+0000 7f80c808d640 1 --2- 172.21.15.123:0/2548762831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80c0073180 0x7f80c00735c0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:02.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.225+0000 7f80c808d640 1 --2- 172.21.15.123:0/2548762831 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f80c0145ed0 0x7f80c00b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:02.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.225+0000 7f80c808d640 1 -- 172.21.15.123:0/2548762831 >> 172.21.15.123:0/2548762831 conn(0x7f80c00ccec0 msgr2=0x7f80c00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:02.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.225+0000 7f80c808d640 1 -- 172.21.15.123:0/2548762831 shutdown_connections 2024-09-15T23:17:02.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.225+0000 7f80c808d640 1 -- 172.21.15.123:0/2548762831 wait complete. 2024-09-15T23:17:02.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.227+0000 7f80c808d640 1 Processor -- start 2024-09-15T23:17:02.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.227+0000 7f80c808d640 1 -- start start 2024-09-15T23:17:02.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.227+0000 7f80c808d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80c0073180 0x7f80c015c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:02.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.227+0000 7f80c808d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f80c00b5880 0x7f80c00c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:02.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.227+0000 7f80c808d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f80c0145ed0 0x7f80c00c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:02.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.227+0000 7f80c808d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f80c01462b0 con 0x7f80c0073180 2024-09-15T23:17:02.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.227+0000 7f80c808d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f80c00b4b60 con 0x7f80c0145ed0 2024-09-15T23:17:02.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.227+0000 7f80c808d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f80c0146430 con 0x7f80c00b5880 2024-09-15T23:17:02.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.227+0000 7f80c5e29640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80c0073180 0x7f80c015c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:02.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.227+0000 7f80c5e29640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80c0073180 0x7f80c015c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46552/0 (socket says 172.21.15.123:46552) 2024-09-15T23:17:02.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.227+0000 7f80c5e29640 1 -- 172.21.15.123:0/1728340966 learned_addr learned my addr 172.21.15.123:0/1728340966 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:02.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.228+0000 7f80c5628640 1 --2- 172.21.15.123:0/1728340966 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f80c00b5880 0x7f80c00c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:02.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.228+0000 7f80c662a640 1 --2- 172.21.15.123:0/1728340966 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f80c0145ed0 0x7f80c00c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:02.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.228+0000 7f80c5e29640 1 -- 172.21.15.123:0/1728340966 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f80c00b5880 msgr2=0x7f80c00c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:02.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.228+0000 7f80c5e29640 1 --2- 172.21.15.123:0/1728340966 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f80c00b5880 0x7f80c00c95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:02.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.228+0000 7f80c5e29640 1 -- 172.21.15.123:0/1728340966 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f80c0145ed0 msgr2=0x7f80c00c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:02.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.228+0000 7f80c5e29640 1 --2- 172.21.15.123:0/1728340966 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f80c0145ed0 0x7f80c00c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:02.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.228+0000 7f80c5e29640 1 -- 172.21.15.123:0/1728340966 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80c01f3270 con 0x7f80c0073180 2024-09-15T23:17:02.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.228+0000 7f80c662a640 1 --2- 172.21.15.123:0/1728340966 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f80c0145ed0 0x7f80c00c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:17:02.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.228+0000 7f80c5e29640 1 --2- 172.21.15.123:0/1728340966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80c0073180 0x7f80c015c1e0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f80bc00d620 tx=0x7f80bc00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:02.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.228+0000 7f80b27fc640 1 -- 172.21.15.123:0/1728340966 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80bc0125f0 con 0x7f80c0073180 2024-09-15T23:17:02.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.228+0000 7f80b27fc640 1 -- 172.21.15.123:0/1728340966 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80bc019070 con 0x7f80c0073180 2024-09-15T23:17:02.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.228+0000 7f80c808d640 1 -- 172.21.15.123:0/1728340966 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80c01e1be0 con 0x7f80c0073180 2024-09-15T23:17:02.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.228+0000 7f80b27fc640 1 -- 172.21.15.123:0/1728340966 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80bc0129d0 con 0x7f80c0073180 2024-09-15T23:17:02.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.228+0000 7f80c808d640 1 -- 172.21.15.123:0/1728340966 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80c01e21a0 con 0x7f80c0073180 2024-09-15T23:17:02.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.229+0000 7f80c808d640 1 -- 172.21.15.123:0/1728340966 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80c01436e0 con 0x7f80c0073180 2024-09-15T23:17:02.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.229+0000 7f80b27fc640 1 -- 172.21.15.123:0/1728340966 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f80bc012b70 con 0x7f80c0073180 2024-09-15T23:17:02.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.230+0000 7f80b27fc640 1 --2- 172.21.15.123:0/1728340966 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f80a406c2b0 0x7f80a406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:02.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.230+0000 7f80b27fc640 1 -- 172.21.15.123:0/1728340966 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5795+0+0 (secure 0 0 0) 0x7f80bc08b880 con 0x7f80c0073180 2024-09-15T23:17:02.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.230+0000 7f80c5628640 1 --2- 172.21.15.123:0/1728340966 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f80a406c2b0 0x7f80a406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:02.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.231+0000 7f80c5628640 1 --2- 172.21.15.123:0/1728340966 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f80a406c2b0 0x7f80a406e770 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f80b4034000 tx=0x7f80b402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:02.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.234+0000 7f80b27fc640 1 -- 172.21.15.123:0/1728340966 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f80bc059f90 con 0x7f80c0073180 2024-09-15T23:17:02.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.432+0000 7f80c808d640 1 -- 172.21.15.123:0/1728340966 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80c0143400 con 0x7f80c0073180 2024-09-15T23:17:02.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.432+0000 7f80b27fc640 1 -- 172.21.15.123:0/1728340966 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5236 (secure 0 0 0) 0x7f80bc059890 con 0x7f80c0073180 2024-09-15T23:17:02.434 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:17:02.435 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":66,"btime":"2024-09-15T23:16:51:834717+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6556,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/488079964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":488079964},{"type":"v1","addr":"172.21.15.188:6835","nonce":488079964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/4123673242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":4123673242},{"type":"v1","addr":"172.21.15.188:6837","nonce":4123673242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":7356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/2179085155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2179085155},{"type":"v1","addr":"172.21.15.123:6833","nonce":2179085155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:16:35.080780+0000","modified":"2024-09-15T23:16:51.834712+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7365},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7365":{"gid":7365,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":4,"addr":"172.21.15.123:6835/2621254224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2621254224},{"type":"v1","addr":"172.21.15.123:6835","nonce":2621254224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7365,"qdb_cluster":[7365]},"id":6}]} 2024-09-15T23:17:02.436 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 66 2024-09-15T23:17:02.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.434+0000 7f80c808d640 1 -- 172.21.15.123:0/1728340966 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f80a406c2b0 msgr2=0x7f80a406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:02.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.434+0000 7f80c808d640 1 --2- 172.21.15.123:0/1728340966 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f80a406c2b0 0x7f80a406e770 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f80b4034000 tx=0x7f80b402e000 comp rx=0 tx=0).stop 2024-09-15T23:17:02.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.435+0000 7f80c808d640 1 -- 172.21.15.123:0/1728340966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80c0073180 msgr2=0x7f80c015c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:02.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.435+0000 7f80c808d640 1 --2- 172.21.15.123:0/1728340966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80c0073180 0x7f80c015c1e0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f80bc00d620 tx=0x7f80bc00dae0 comp rx=0 tx=0).stop 2024-09-15T23:17:02.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.435+0000 7f80c808d640 1 -- 172.21.15.123:0/1728340966 shutdown_connections 2024-09-15T23:17:02.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.435+0000 7f80c808d640 1 --2- 172.21.15.123:0/1728340966 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f80c0145ed0 0x7f80c00c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:02.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.435+0000 7f80c808d640 1 --2- 172.21.15.123:0/1728340966 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f80c00b5880 0x7f80c00c95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:02.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.435+0000 7f80c808d640 1 --2- 172.21.15.123:0/1728340966 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f80a406c2b0 0x7f80a406e770 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:02.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.435+0000 7f80c808d640 1 --2- 172.21.15.123:0/1728340966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80c0073180 0x7f80c015c1e0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:02.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.435+0000 7f80c808d640 1 -- 172.21.15.123:0/1728340966 >> 172.21.15.123:0/1728340966 conn(0x7f80c00ccec0 msgr2=0x7f80c0142040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:02.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.435+0000 7f80c808d640 1 -- 172.21.15.123:0/1728340966 shutdown_connections 2024-09-15T23:17:02.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.435+0000 7f80c808d640 1 -- 172.21.15.123:0/1728340966 wait complete. 2024-09-15T23:17:02.446 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:17:02.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.544+0000 7f7ed68ae640 1 Processor -- start 2024-09-15T23:17:02.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.544+0000 7f7ed68ae640 1 -- start start 2024-09-15T23:17:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.544+0000 7f7ed68ae640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7ed00b6970 0x7f7ed00b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.544+0000 7f7ed68ae640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ed00d23b0 0x7f7ed00b8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.544+0000 7f7ed68ae640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ed00d0e70 con 0x7f7ed015ed20 2024-09-15T23:17:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.544+0000 7f7ed68ae640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f7ed00d41c0 con 0x7f7ed00b6970 2024-09-15T23:17:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.544+0000 7f7ed68ae640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7ed00d35b0 con 0x7f7ed00d23b0 2024-09-15T23:17:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.545+0000 7f7ec7fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7ed00b6970 0x7f7ed00b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.545+0000 7f7ec7fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7ed00b6970 0x7f7ed00b80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46562/0 (socket says 172.21.15.123:46562) 2024-09-15T23:17:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.545+0000 7f7ec7fff640 1 -- 172.21.15.123:0/3478761949 learned_addr learned my addr 172.21.15.123:0/3478761949 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.545+0000 7f7ed4e4b640 1 --2- 172.21.15.123:0/3478761949 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ed00d23b0 0x7f7ed00b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.545+0000 7f7ec7fff640 1 -- 172.21.15.123:0/3478761949 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ed00d23b0 msgr2=0x7f7ed00b8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.545+0000 7f7ec7fff640 1 --2- 172.21.15.123:0/3478761949 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ed00d23b0 0x7f7ed00b8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:02.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.545+0000 7f7ec7fff640 1 -- 172.21.15.123:0/3478761949 >> v1:172.21.15.188:6789/0 conn(0x7f7ed015ed20 legacy=0x7f7ed00b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:02.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.545+0000 7f7ec7fff640 1 -- 172.21.15.123:0/3478761949 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ed00d3890 con 0x7f7ed00b6970 2024-09-15T23:17:02.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.545+0000 7f7ed4e4b640 1 --2- 172.21.15.123:0/3478761949 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ed00d23b0 0x7f7ed00b8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:17:02.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.546+0000 7f7ec7fff640 1 --2- 172.21.15.123:0/3478761949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ed00b6970 0x7f7ed00b80d0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009870 tx=0x7f7eb802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6376e9989a25390 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:02.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.546+0000 7f7ecf7fe640 1 -- 172.21.15.123:0/3478761949 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8037070 con 0x7f7ed00b6970 2024-09-15T23:17:02.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.546+0000 7f7ecf7fe640 1 -- 172.21.15.123:0/3478761949 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eb8032440 con 0x7f7ed00b6970 2024-09-15T23:17:02.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.546+0000 7f7ecf7fe640 1 -- 172.21.15.123:0/3478761949 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8032810 con 0x7f7ed00b6970 2024-09-15T23:17:02.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.546+0000 7f7ed68ae640 1 -- 172.21.15.123:0/3478761949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ed00b6970 msgr2=0x7f7ed00b80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:02.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.546+0000 7f7ed68ae640 1 --2- 172.21.15.123:0/3478761949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ed00b6970 0x7f7ed00b80d0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009870 tx=0x7f7eb802a1c0 comp rx=0 tx=0).stop 2024-09-15T23:17:02.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.546+0000 7f7ed68ae640 1 -- 172.21.15.123:0/3478761949 shutdown_connections 2024-09-15T23:17:02.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.546+0000 7f7ed68ae640 1 --2- 172.21.15.123:0/3478761949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ed00b6970 0x7f7ed00b80d0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:02.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.546+0000 7f7ed68ae640 1 --2- 172.21.15.123:0/3478761949 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ed00d23b0 0x7f7ed00b8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:02.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.546+0000 7f7ed68ae640 1 -- 172.21.15.123:0/3478761949 >> 172.21.15.123:0/3478761949 conn(0x7f7ed00d1260 msgr2=0x7f7ed00d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:02.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.546+0000 7f7ed68ae640 1 -- 172.21.15.123:0/3478761949 shutdown_connections 2024-09-15T23:17:02.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.546+0000 7f7ed68ae640 1 -- 172.21.15.123:0/3478761949 wait complete. 2024-09-15T23:17:02.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.547+0000 7f7ed68ae640 1 Processor -- start 2024-09-15T23:17:02.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.548+0000 7f7ed68ae640 1 -- start start 2024-09-15T23:17:02.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.548+0000 7f7ed68ae640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ed00b6970 0x7f7ed0156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:02.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.548+0000 7f7ed68ae640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ed00d23b0 0x7f7ed0159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:02.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.548+0000 7f7ed68ae640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ed015ed20 0x7f7ed015a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:02.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.548+0000 7f7ed68ae640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed00d32a0 con 0x7f7ed00d23b0 2024-09-15T23:17:02.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.548+0000 7f7ed68ae640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed00d3e50 con 0x7f7ed00b6970 2024-09-15T23:17:02.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.548+0000 7f7ed68ae640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7ed015f100 con 0x7f7ed015ed20 2024-09-15T23:17:02.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.548+0000 7f7ec7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ed00d23b0 0x7f7ed0159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:02.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.548+0000 7f7ec7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ed00d23b0 0x7f7ed0159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46578/0 (socket says 172.21.15.123:46578) 2024-09-15T23:17:02.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.548+0000 7f7ec7fff640 1 -- 172.21.15.123:0/411876531 learned_addr learned my addr 172.21.15.123:0/411876531 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:02.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.548+0000 7f7ecffff640 1 --2- 172.21.15.123:0/411876531 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ed00b6970 0x7f7ed0156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:02.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.548+0000 7f7ed4e4b640 1 --2- 172.21.15.123:0/411876531 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ed015ed20 0x7f7ed015a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:02.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.549+0000 7f7ec7fff640 1 -- 172.21.15.123:0/411876531 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ed015ed20 msgr2=0x7f7ed015a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:02.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.549+0000 7f7ec7fff640 1 --2- 172.21.15.123:0/411876531 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ed015ed20 0x7f7ed015a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:02.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.549+0000 7f7ec7fff640 1 -- 172.21.15.123:0/411876531 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ed00b6970 msgr2=0x7f7ed0156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:02.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.549+0000 7f7ec7fff640 1 --2- 172.21.15.123:0/411876531 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ed00b6970 0x7f7ed0156300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:02.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.549+0000 7f7ec7fff640 1 -- 172.21.15.123:0/411876531 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ed0155610 con 0x7f7ed00d23b0 2024-09-15T23:17:02.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.549+0000 7f7ecffff640 1 --2- 172.21.15.123:0/411876531 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ed00b6970 0x7f7ed0156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:17:02.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.549+0000 7f7ec7fff640 1 --2- 172.21.15.123:0/411876531 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ed00d23b0 0x7f7ed0159b90 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8000c00 tx=0x7f7eb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:02.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.549+0000 7f7ecd7fa640 1 -- 172.21.15.123:0/411876531 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8041020 con 0x7f7ed00d23b0 2024-09-15T23:17:02.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.549+0000 7f7ecd7fa640 1 -- 172.21.15.123:0/411876531 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7eb80306c0 con 0x7f7ed00d23b0 2024-09-15T23:17:02.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.549+0000 7f7ed68ae640 1 -- 172.21.15.123:0/411876531 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ed015f2e0 con 0x7f7ed00d23b0 2024-09-15T23:17:02.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.549+0000 7f7ecd7fa640 1 -- 172.21.15.123:0/411876531 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8037040 con 0x7f7ed00d23b0 2024-09-15T23:17:02.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.549+0000 7f7ed68ae640 1 -- 172.21.15.123:0/411876531 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ed015fb80 con 0x7f7ed00d23b0 2024-09-15T23:17:02.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.550+0000 7f7ed68ae640 1 -- 172.21.15.123:0/411876531 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ed00b7010 con 0x7f7ed00d23b0 2024-09-15T23:17:02.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.550+0000 7f7ecd7fa640 1 -- 172.21.15.123:0/411876531 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7eb8044020 con 0x7f7ed00d23b0 2024-09-15T23:17:02.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.551+0000 7f7ecd7fa640 1 --2- 172.21.15.123:0/411876531 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7eb006c2b0 0x7f7eb006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:02.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.551+0000 7f7ecd7fa640 1 -- 172.21.15.123:0/411876531 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5795+0+0 (secure 0 0 0) 0x7f7eb80abc90 con 0x7f7ed00d23b0 2024-09-15T23:17:02.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.551+0000 7f7ecffff640 1 --2- 172.21.15.123:0/411876531 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7eb006c2b0 0x7f7eb006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:02.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.551+0000 7f7ecffff640 1 --2- 172.21.15.123:0/411876531 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7eb006c2b0 0x7f7eb006e770 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7ed00b3a50 tx=0x7f7ec0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:02.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.555+0000 7f7ecd7fa640 1 -- 172.21.15.123:0/411876531 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7eb804b030 con 0x7f7ed00d23b0 2024-09-15T23:17:02.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.721+0000 7f7ed68ae640 1 -- 172.21.15.123:0/411876531 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7ed00b3f20 con 0x7f7ed00d23b0 2024-09-15T23:17:02.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.722+0000 7f7ecd7fa640 1 -- 172.21.15.123:0/411876531 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) ==== 74+0+16888 (secure 0 0 0) 0x7f7eb807a3a0 con 0x7f7ed00d23b0 2024-09-15T23:17:02.724 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:17:02.724 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":102,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:16:47.820565+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:16:33.696407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-15T23:16:34.051030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.188:6837/2840550551":"2024-09-16T23:16:47.812432+0000","172.21.15.188:6835/2840550551":"2024-09-16T23:16:47.812432+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:17:02.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.724+0000 7f7ed68ae640 1 -- 172.21.15.123:0/411876531 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7eb006c2b0 msgr2=0x7f7eb006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:02.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.724+0000 7f7ed68ae640 1 --2- 172.21.15.123:0/411876531 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7eb006c2b0 0x7f7eb006e770 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7ed00b3a50 tx=0x7f7ec0009040 comp rx=0 tx=0).stop 2024-09-15T23:17:02.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.724+0000 7f7ed68ae640 1 -- 172.21.15.123:0/411876531 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ed00d23b0 msgr2=0x7f7ed0159b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:02.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.724+0000 7f7ed68ae640 1 --2- 172.21.15.123:0/411876531 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ed00d23b0 0x7f7ed0159b90 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8000c00 tx=0x7f7eb80046c0 comp rx=0 tx=0).stop 2024-09-15T23:17:02.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.724+0000 7f7ed68ae640 1 -- 172.21.15.123:0/411876531 shutdown_connections 2024-09-15T23:17:02.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.724+0000 7f7ed68ae640 1 --2- 172.21.15.123:0/411876531 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ed015ed20 0x7f7ed015a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:02.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.724+0000 7f7ed68ae640 1 --2- 172.21.15.123:0/411876531 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7eb006c2b0 0x7f7eb006e770 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:02.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.724+0000 7f7ed68ae640 1 --2- 172.21.15.123:0/411876531 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ed00d23b0 0x7f7ed0159b90 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:02.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.724+0000 7f7ed68ae640 1 --2- 172.21.15.123:0/411876531 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ed00b6970 0x7f7ed0156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:02.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.724+0000 7f7ed68ae640 1 -- 172.21.15.123:0/411876531 >> 172.21.15.123:0/411876531 conn(0x7f7ed00d1260 msgr2=0x7f7ed00cf0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:02.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.724+0000 7f7ed68ae640 1 -- 172.21.15.123:0/411876531 shutdown_connections 2024-09-15T23:17:02.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.724+0000 7f7ed68ae640 1 -- 172.21.15.123:0/411876531 wait complete. 2024-09-15T23:17:02.737 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T23:17:02.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.835+0000 7fad056b7640 1 Processor -- start 2024-09-15T23:17:02.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.835+0000 7fad056b7640 1 -- start start 2024-09-15T23:17:02.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.836+0000 7fad056b7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fad000d23b0 0x7fad000b87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:02.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.836+0000 7fad056b7640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad000d0e70 con 0x7fad0015ed20 2024-09-15T23:17:02.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.836+0000 7fad056b7640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad000d41c0 con 0x7fad000b6970 2024-09-15T23:17:02.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.836+0000 7fad056b7640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fad000d35b0 con 0x7fad000d23b0 2024-09-15T23:17:02.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.836+0000 7facfeffd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fad0015ed20 0x7fad000b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49142/0 (socket says 172.21.15.123:49142) 2024-09-15T23:17:02.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.836+0000 7facfeffd640 1 -- 172.21.15.123:0/2941860090 learned_addr learned my addr 172.21.15.123:0/2941860090 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:17:02.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.836+0000 7facff7fe640 1 --2- 172.21.15.123:0/2941860090 >> v2:172.21.15.123:3300/0 conn(0x7fad000d23b0 0x7fad000b87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:02.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.836+0000 7facfe7fc640 1 -- 172.21.15.123:0/2941860090 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1840087649 0 0) 0x7facf0001110 con 0x7fad0015ed20 2024-09-15T23:17:02.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.836+0000 7facfe7fc640 1 -- 172.21.15.123:0/2941860090 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facec003520 con 0x7fad0015ed20 2024-09-15T23:17:02.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.836+0000 7facff7fe640 1 -- 172.21.15.123:0/2941860090 >> v1:172.21.15.188:6789/0 conn(0x7fad000b6970 legacy=0x7fad000b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:02.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.836+0000 7facff7fe640 1 -- 172.21.15.123:0/2941860090 >> v1:172.21.15.123:6789/0 conn(0x7fad0015ed20 legacy=0x7fad000b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:02.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.836+0000 7facff7fe640 1 -- 172.21.15.123:0/2941860090 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad000d3890 con 0x7fad000d23b0 2024-09-15T23:17:02.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.837+0000 7facff7fe640 1 --2- 172.21.15.123:0/2941860090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad000d23b0 0x7fad000b87e0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7facf8009d90 tx=0x7facf802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=229a0bdf549b3240 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:02.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.837+0000 7facfe7fc640 1 -- 172.21.15.123:0/2941860090 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf8031600 con 0x7fad000d23b0 2024-09-15T23:17:02.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.837+0000 7facfe7fc640 1 -- 172.21.15.123:0/2941860090 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facf80317a0 con 0x7fad000d23b0 2024-09-15T23:17:02.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.837+0000 7facfe7fc640 1 -- 172.21.15.123:0/2941860090 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf8031b70 con 0x7fad000d23b0 2024-09-15T23:17:02.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.837+0000 7fad056b7640 1 -- 172.21.15.123:0/2941860090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad000d23b0 msgr2=0x7fad000b87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:02.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.837+0000 7fad056b7640 1 --2- 172.21.15.123:0/2941860090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad000d23b0 0x7fad000b87e0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7facf8009d90 tx=0x7facf802a610 comp rx=0 tx=0).stop 2024-09-15T23:17:02.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.838+0000 7fad056b7640 1 -- 172.21.15.123:0/2941860090 shutdown_connections 2024-09-15T23:17:02.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.838+0000 7fad056b7640 1 --2- 172.21.15.123:0/2941860090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad000d23b0 0x7fad000b87e0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:02.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.838+0000 7fad056b7640 1 -- 172.21.15.123:0/2941860090 >> 172.21.15.123:0/2941860090 conn(0x7fad000d1260 msgr2=0x7fad000d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:02.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.838+0000 7fad056b7640 1 -- 172.21.15.123:0/2941860090 shutdown_connections 2024-09-15T23:17:02.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.838+0000 7fad056b7640 1 -- 172.21.15.123:0/2941860090 wait complete. 2024-09-15T23:17:02.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.839+0000 7fad056b7640 1 Processor -- start 2024-09-15T23:17:02.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.839+0000 7fad056b7640 1 -- start start 2024-09-15T23:17:02.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.840+0000 7fad056b7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad000b6970 0x7fad0014fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:02.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.840+0000 7fad056b7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad000d23b0 0x7fad00161710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:02.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.840+0000 7fad056b7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fad0015ed20 0x7fad001ea2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:02.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.840+0000 7fad056b7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fad000d32a0 con 0x7fad000d23b0 2024-09-15T23:17:02.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.840+0000 7fad056b7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fad000d3e50 con 0x7fad0015ed20 2024-09-15T23:17:02.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.840+0000 7fad056b7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fad0015f100 con 0x7fad000b6970 2024-09-15T23:17:02.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.840+0000 7facf67fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad000d23b0 0x7fad00161710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:02.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.840+0000 7facf67fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad000d23b0 0x7fad00161710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46590/0 (socket says 172.21.15.123:46590) 2024-09-15T23:17:02.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.840+0000 7facf67fc640 1 -- 172.21.15.123:0/3915033667 learned_addr learned my addr 172.21.15.123:0/3915033667 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:02.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.840+0000 7facfeffd640 1 --2- 172.21.15.123:0/3915033667 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad000b6970 0x7fad0014fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:02.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.840+0000 7facf67fc640 1 -- 172.21.15.123:0/3915033667 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad000b6970 msgr2=0x7fad0014fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:02.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.840+0000 7facf67fc640 1 --2- 172.21.15.123:0/3915033667 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad000b6970 0x7fad0014fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:02.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.840+0000 7facf67fc640 1 -- 172.21.15.123:0/3915033667 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fad0015ed20 msgr2=0x7fad001ea2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:02.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.840+0000 7facff7fe640 1 --2- 172.21.15.123:0/3915033667 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fad0015ed20 0x7fad001ea2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:02.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.840+0000 7facf67fc640 1 --2- 172.21.15.123:0/3915033667 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fad0015ed20 0x7fad001ea2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:02.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.840+0000 7facf67fc640 1 -- 172.21.15.123:0/3915033667 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad001e8ac0 con 0x7fad000d23b0 2024-09-15T23:17:02.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.840+0000 7facf67fc640 1 --2- 172.21.15.123:0/3915033667 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad000d23b0 0x7fad00161710 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7face800b3e0 tx=0x7face800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:02.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.840+0000 7facf7fff640 1 -- 172.21.15.123:0/3915033667 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face8015020 con 0x7fad000d23b0 2024-09-15T23:17:02.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.840+0000 7facf7fff640 1 -- 172.21.15.123:0/3915033667 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7face8011850 con 0x7fad000d23b0 2024-09-15T23:17:02.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.840+0000 7fad056b7640 1 -- 172.21.15.123:0/3915033667 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad001e8da0 con 0x7fad000d23b0 2024-09-15T23:17:02.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.840+0000 7facf7fff640 1 -- 172.21.15.123:0/3915033667 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face8011c40 con 0x7fad000d23b0 2024-09-15T23:17:02.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.840+0000 7fad056b7640 1 -- 172.21.15.123:0/3915033667 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad001e9360 con 0x7fad000d23b0 2024-09-15T23:17:02.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.841+0000 7fad056b7640 1 -- 172.21.15.123:0/3915033667 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad000b7010 con 0x7fad000d23b0 2024-09-15T23:17:02.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.842+0000 7facf7fff640 1 -- 172.21.15.123:0/3915033667 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7face8018020 con 0x7fad000d23b0 2024-09-15T23:17:02.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.842+0000 7facf7fff640 1 --2- 172.21.15.123:0/3915033667 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7face006c2b0 0x7face006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:02.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.843+0000 7facf7fff640 1 -- 172.21.15.123:0/3915033667 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5795+0+0 (secure 0 0 0) 0x7face808b390 con 0x7fad000d23b0 2024-09-15T23:17:02.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.843+0000 7facfeffd640 1 --2- 172.21.15.123:0/3915033667 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7face006c2b0 0x7face006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:02.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.843+0000 7facfeffd640 1 --2- 172.21.15.123:0/3915033667 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7face006c2b0 0x7face006e770 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7facf00012b0 tx=0x7facf0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:02.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:02.847+0000 7facf7fff640 1 -- 172.21.15.123:0/3915033667 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7face801f020 con 0x7fad000d23b0 2024-09-15T23:17:03.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.048+0000 7fad056b7640 1 -- 172.21.15.123:0/3915033667 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fad000b3f20 con 0x7fad000d23b0 2024-09-15T23:17:03.049 INFO:tasks.ceph.mon.a.smithi123.stderr:2024-09-15T23:17:03.048+0000 7f8a6ccf0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:17:03.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.050+0000 7facf7fff640 1 -- 172.21.15.123:0/3915033667 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v67) ==== 161+0+0 (secure 0 0 0) 0x7face80172c0 con 0x7fad000d23b0 2024-09-15T23:17:03.051 INFO:teuthology.orchestra.run.smithi123.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T23:17:03.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.052+0000 7fad056b7640 1 -- 172.21.15.123:0/3915033667 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7face006c2b0 msgr2=0x7face006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:03.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.052+0000 7fad056b7640 1 --2- 172.21.15.123:0/3915033667 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7face006c2b0 0x7face006e770 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7facf00012b0 tx=0x7facf0009040 comp rx=0 tx=0).stop 2024-09-15T23:17:03.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.052+0000 7fad056b7640 1 -- 172.21.15.123:0/3915033667 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad000d23b0 msgr2=0x7fad00161710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:03.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.052+0000 7fad056b7640 1 --2- 172.21.15.123:0/3915033667 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad000d23b0 0x7fad00161710 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7face800b3e0 tx=0x7face800b8a0 comp rx=0 tx=0).stop 2024-09-15T23:17:03.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.052+0000 7fad056b7640 1 -- 172.21.15.123:0/3915033667 shutdown_connections 2024-09-15T23:17:03.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.052+0000 7fad056b7640 1 --2- 172.21.15.123:0/3915033667 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fad0015ed20 0x7fad001ea2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:03.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.052+0000 7fad056b7640 1 --2- 172.21.15.123:0/3915033667 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7face006c2b0 0x7face006e770 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:03.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.052+0000 7fad056b7640 1 --2- 172.21.15.123:0/3915033667 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad000d23b0 0x7fad00161710 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:03.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.052+0000 7fad056b7640 1 --2- 172.21.15.123:0/3915033667 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad000b6970 0x7fad0014fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:03.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.053+0000 7fad056b7640 1 -- 172.21.15.123:0/3915033667 >> 172.21.15.123:0/3915033667 conn(0x7fad000d1260 msgr2=0x7fad000b54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:03.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.053+0000 7fad056b7640 1 -- 172.21.15.123:0/3915033667 shutdown_connections 2024-09-15T23:17:03.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.053+0000 7fad056b7640 1 -- 172.21.15.123:0/3915033667 wait complete. 2024-09-15T23:17:03.056 INFO:tasks.ceph.mds.c.smithi123.stderr: -589> 2024-09-15T23:16:54.825+0000 7fdef0fe1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:17:03.065 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T23:17:03.081 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-15T23:17:03.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.164+0000 7fd1ab918640 1 Processor -- start 2024-09-15T23:17:03.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.165+0000 7fd1ab918640 1 -- start start 2024-09-15T23:17:03.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.165+0000 7fd1ab918640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd1a415ebd0 0x7fd1a415f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:03.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.165+0000 7fd1ab918640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd1a4162400 0x7fd1a406f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:03.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.165+0000 7fd1ab918640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1a4162e50 con 0x7fd1a40d1680 2024-09-15T23:17:03.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.165+0000 7fd1ab918640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fd1a415f4c0 con 0x7fd1a4162400 2024-09-15T23:17:03.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.165+0000 7fd1ab918640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd1a4163130 con 0x7fd1a415ebd0 2024-09-15T23:17:03.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.166+0000 7fd1a9eb5640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd1a4162400 0x7fd1a406f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:03.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.166+0000 7fd1a9eb5640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd1a4162400 0x7fd1a406f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46600/0 (socket says 172.21.15.123:46600) 2024-09-15T23:17:03.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.166+0000 7fd1a9eb5640 1 -- 172.21.15.123:0/4028794119 learned_addr learned my addr 172.21.15.123:0/4028794119 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:03.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.166+0000 7fd1a8eb3640 1 --2- 172.21.15.123:0/4028794119 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd1a415ebd0 0x7fd1a415f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:03.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.166+0000 7fd1a9eb5640 1 -- 172.21.15.123:0/4028794119 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd1a415ebd0 msgr2=0x7fd1a415f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:03.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.166+0000 7fd1a9eb5640 1 --2- 172.21.15.123:0/4028794119 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd1a415ebd0 0x7fd1a415f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:03.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.166+0000 7fd1a9eb5640 1 -- 172.21.15.123:0/4028794119 >> v1:172.21.15.188:6789/0 conn(0x7fd1a40d1680 legacy=0x7fd1a40d1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:03.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.166+0000 7fd1a9eb5640 1 -- 172.21.15.123:0/4028794119 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1a415f150 con 0x7fd1a4162400 2024-09-15T23:17:03.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.166+0000 7fd1a8eb3640 1 --2- 172.21.15.123:0/4028794119 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd1a415ebd0 0x7fd1a415f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:17:03.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.167+0000 7fd1a9eb5640 1 --2- 172.21.15.123:0/4028794119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1a4162400 0x7fd1a406f2f0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fd194009e50 tx=0x7fd19402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13207db027b5ba25 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:03.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.167+0000 7fd1a3fff640 1 -- 172.21.15.123:0/4028794119 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd194036070 con 0x7fd1a4162400 2024-09-15T23:17:03.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.167+0000 7fd1a3fff640 1 -- 172.21.15.123:0/4028794119 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd194031600 con 0x7fd1a4162400 2024-09-15T23:17:03.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.167+0000 7fd1a3fff640 1 -- 172.21.15.123:0/4028794119 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1940319d0 con 0x7fd1a4162400 2024-09-15T23:17:03.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.167+0000 7fd1ab918640 1 -- 172.21.15.123:0/4028794119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1a4162400 msgr2=0x7fd1a406f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:03.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.167+0000 7fd1ab918640 1 --2- 172.21.15.123:0/4028794119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1a4162400 0x7fd1a406f2f0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fd194009e50 tx=0x7fd19402a680 comp rx=0 tx=0).stop 2024-09-15T23:17:03.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.167+0000 7fd1ab918640 1 -- 172.21.15.123:0/4028794119 shutdown_connections 2024-09-15T23:17:03.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.167+0000 7fd1ab918640 1 --2- 172.21.15.123:0/4028794119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1a4162400 0x7fd1a406f2f0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:03.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.167+0000 7fd1ab918640 1 --2- 172.21.15.123:0/4028794119 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd1a415ebd0 0x7fd1a415f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:03.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.167+0000 7fd1ab918640 1 -- 172.21.15.123:0/4028794119 >> 172.21.15.123:0/4028794119 conn(0x7fd1a40d2570 msgr2=0x7fd1a40d2980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:03.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.167+0000 7fd1ab918640 1 -- 172.21.15.123:0/4028794119 shutdown_connections 2024-09-15T23:17:03.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.167+0000 7fd1ab918640 1 -- 172.21.15.123:0/4028794119 wait complete. 2024-09-15T23:17:03.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.168+0000 7fd1ab918640 1 Processor -- start 2024-09-15T23:17:03.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.169+0000 7fd1ab918640 1 -- start start 2024-09-15T23:17:03.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.169+0000 7fd1ab918640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd1a40d1680 0x7fd1a41f5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:03.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.169+0000 7fd1ab918640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1a415ebd0 0x7fd1a4153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:03.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.169+0000 7fd1ab918640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd1a4162400 0x7fd1a40b7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:03.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.169+0000 7fd1ab918640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a4162a30 con 0x7fd1a415ebd0 2024-09-15T23:17:03.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.169+0000 7fd1ab918640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a41628b0 con 0x7fd1a40d1680 2024-09-15T23:17:03.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.169+0000 7fd1ab918640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd1a4162bb0 con 0x7fd1a4162400 2024-09-15T23:17:03.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.169+0000 7fd1a8eb3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1a415ebd0 0x7fd1a4153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:03.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.169+0000 7fd1a8eb3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1a415ebd0 0x7fd1a4153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46614/0 (socket says 172.21.15.123:46614) 2024-09-15T23:17:03.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.169+0000 7fd1a8eb3640 1 -- 172.21.15.123:0/2790885769 learned_addr learned my addr 172.21.15.123:0/2790885769 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:03.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.170+0000 7fd1a9eb5640 1 --2- 172.21.15.123:0/2790885769 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd1a4162400 0x7fd1a40b7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:03.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.170+0000 7fd1a96b4640 1 --2- 172.21.15.123:0/2790885769 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd1a40d1680 0x7fd1a41f5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:03.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.170+0000 7fd1a8eb3640 1 -- 172.21.15.123:0/2790885769 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd1a4162400 msgr2=0x7fd1a40b7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:03.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.170+0000 7fd1a8eb3640 1 --2- 172.21.15.123:0/2790885769 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd1a4162400 0x7fd1a40b7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:03.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.170+0000 7fd1a8eb3640 1 -- 172.21.15.123:0/2790885769 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd1a40d1680 msgr2=0x7fd1a41f5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:03.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.170+0000 7fd1a8eb3640 1 --2- 172.21.15.123:0/2790885769 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd1a40d1680 0x7fd1a41f5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:03.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.170+0000 7fd1a8eb3640 1 -- 172.21.15.123:0/2790885769 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1a40aecd0 con 0x7fd1a415ebd0 2024-09-15T23:17:03.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.170+0000 7fd1a96b4640 1 --2- 172.21.15.123:0/2790885769 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd1a40d1680 0x7fd1a41f5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:17:03.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.170+0000 7fd1a8eb3640 1 --2- 172.21.15.123:0/2790885769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1a415ebd0 0x7fd1a4153cd0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fd19800e7e0 tx=0x7fd19800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:03.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.170+0000 7fd1a1ffb640 1 -- 172.21.15.123:0/2790885769 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd198017070 con 0x7fd1a415ebd0 2024-09-15T23:17:03.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.170+0000 7fd1a1ffb640 1 -- 172.21.15.123:0/2790885769 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd19800c6d0 con 0x7fd1a415ebd0 2024-09-15T23:17:03.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.170+0000 7fd1ab918640 1 -- 172.21.15.123:0/2790885769 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1a40aefb0 con 0x7fd1a415ebd0 2024-09-15T23:17:03.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.170+0000 7fd1a1ffb640 1 -- 172.21.15.123:0/2790885769 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd19800f040 con 0x7fd1a415ebd0 2024-09-15T23:17:03.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.170+0000 7fd1ab918640 1 -- 172.21.15.123:0/2790885769 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1a40af570 con 0x7fd1a415ebd0 2024-09-15T23:17:03.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.171+0000 7fd1ab918640 1 -- 172.21.15.123:0/2790885769 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1a415f950 con 0x7fd1a415ebd0 2024-09-15T23:17:03.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.172+0000 7fd1a1ffb640 1 -- 172.21.15.123:0/2790885769 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd19801a070 con 0x7fd1a415ebd0 2024-09-15T23:17:03.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.172+0000 7fd1a1ffb640 1 --2- 172.21.15.123:0/2790885769 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd19006c2b0 0x7fd19006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:03.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.172+0000 7fd1a1ffb640 1 -- 172.21.15.123:0/2790885769 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5881+0+0 (secure 0 0 0) 0x7fd19808b4a0 con 0x7fd1a415ebd0 2024-09-15T23:17:03.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.172+0000 7fd1a96b4640 1 --2- 172.21.15.123:0/2790885769 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd19006c2b0 0x7fd19006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:03.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.173+0000 7fd1a96b4640 1 --2- 172.21.15.123:0/2790885769 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd19006c2b0 0x7fd19006e770 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd19c001660 tx=0x7fd19c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:03.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.176+0000 7fd1a1ffb640 1 -- 172.21.15.123:0/2790885769 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd198059480 con 0x7fd1a415ebd0 2024-09-15T23:17:03.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:03.379+0000 7fd1ab918640 1 -- 172.21.15.123:0/2790885769 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fd1a406c640 con 0x7fd1a415ebd0 2024-09-15T23:17:04.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.054+0000 7fd1a1ffb640 1 -- 172.21.15.123:0/2790885769 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v68) ==== 104+0+0 (secure 0 0 0) 0x7fd19805d780 con 0x7fd1a415ebd0 2024-09-15T23:17:04.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.057+0000 7fd1ab918640 1 -- 172.21.15.123:0/2790885769 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd19006c2b0 msgr2=0x7fd19006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:04.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.057+0000 7fd1ab918640 1 --2- 172.21.15.123:0/2790885769 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd19006c2b0 0x7fd19006e770 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd19c001660 tx=0x7fd19c009040 comp rx=0 tx=0).stop 2024-09-15T23:17:04.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.057+0000 7fd1ab918640 1 -- 172.21.15.123:0/2790885769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1a415ebd0 msgr2=0x7fd1a4153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:04.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.057+0000 7fd1ab918640 1 --2- 172.21.15.123:0/2790885769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1a415ebd0 0x7fd1a4153cd0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fd19800e7e0 tx=0x7fd19800eca0 comp rx=0 tx=0).stop 2024-09-15T23:17:04.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.057+0000 7fd1ab918640 1 -- 172.21.15.123:0/2790885769 shutdown_connections 2024-09-15T23:17:04.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.057+0000 7fd1ab918640 1 --2- 172.21.15.123:0/2790885769 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd1a4162400 0x7fd1a40b7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:04.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.057+0000 7fd1ab918640 1 --2- 172.21.15.123:0/2790885769 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd19006c2b0 0x7fd19006e770 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:04.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.057+0000 7fd1ab918640 1 --2- 172.21.15.123:0/2790885769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1a415ebd0 0x7fd1a4153cd0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:04.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.057+0000 7fd1ab918640 1 --2- 172.21.15.123:0/2790885769 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd1a40d1680 0x7fd1a41f5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:04.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.057+0000 7fd1ab918640 1 -- 172.21.15.123:0/2790885769 >> 172.21.15.123:0/2790885769 conn(0x7fd1a40d2570 msgr2=0x7fd1a40cee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:04.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.057+0000 7fd1ab918640 1 -- 172.21.15.123:0/2790885769 shutdown_connections 2024-09-15T23:17:04.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.057+0000 7fd1ab918640 1 -- 172.21.15.123:0/2790885769 wait complete. 2024-09-15T23:17:04.070 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T23:17:04.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.215+0000 7fbbe6742640 1 Processor -- start 2024-09-15T23:17:04.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.215+0000 7fbbe6742640 1 -- start start 2024-09-15T23:17:04.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.216+0000 7fbbe6742640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbbe01454b0 0x7fbbe00b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:04.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.216+0000 7fbbe6742640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fbbe01459a0 0x7fbbe00b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:04.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.216+0000 7fbbe6742640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbe0146220 con 0x7fbbe00b1db0 2024-09-15T23:17:04.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.216+0000 7fbbe6742640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fbbe00b1920 con 0x7fbbe01454b0 2024-09-15T23:17:04.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.216+0000 7fbbe6742640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fbbe00cf640 con 0x7fbbe01459a0 2024-09-15T23:17:04.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.216+0000 7fbbdffff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbbe01454b0 0x7fbbe00b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:04.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.216+0000 7fbbdffff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbbe01454b0 0x7fbbe00b58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46628/0 (socket says 172.21.15.123:46628) 2024-09-15T23:17:04.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.216+0000 7fbbdffff640 1 -- 172.21.15.123:0/395039594 learned_addr learned my addr 172.21.15.123:0/395039594 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:04.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.216+0000 7fbbdf7fe640 1 --2- 172.21.15.123:0/395039594 >> v2:172.21.15.188:3300/0 conn(0x7fbbe01459a0 0x7fbbe00b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:04.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.216+0000 7fbbdffff640 1 -- 172.21.15.123:0/395039594 >> v2:172.21.15.188:3300/0 conn(0x7fbbe01459a0 msgr2=0x7fbbe00b5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:04.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.216+0000 7fbbdffff640 1 --2- 172.21.15.123:0/395039594 >> v2:172.21.15.188:3300/0 conn(0x7fbbe01459a0 0x7fbbe00b5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:04.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.216+0000 7fbbdffff640 1 -- 172.21.15.123:0/395039594 >> v1:172.21.15.123:6789/0 conn(0x7fbbe00b1db0 legacy=0x7fbbe00b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:04.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.216+0000 7fbbdffff640 1 -- 172.21.15.123:0/395039594 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbe00cf8e0 con 0x7fbbe01454b0 2024-09-15T23:17:04.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.216+0000 7fbbdeffd640 1 -- 172.21.15.123:0/395039594 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1452502871 0 0) 0x7fbbd8001490 con 0x7fbbe00b1db0 2024-09-15T23:17:04.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.216+0000 7fbbdf7fe640 1 --2- 172.21.15.123:0/395039594 >> v2:172.21.15.188:3300/0 conn(0x7fbbe01459a0 0x7fbbe00b5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:17:04.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.217+0000 7fbbdffff640 1 --2- 172.21.15.123:0/395039594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbe01454b0 0x7fbbe00b58f0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fbbe00b6490 tx=0x7fbbd002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee36c90e64bc502d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:04.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.217+0000 7fbbdeffd640 1 -- 172.21.15.123:0/395039594 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd0037070 con 0x7fbbe01454b0 2024-09-15T23:17:04.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.217+0000 7fbbdeffd640 1 -- 172.21.15.123:0/395039594 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbd002ae50 con 0x7fbbe01454b0 2024-09-15T23:17:04.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.217+0000 7fbbdeffd640 1 -- 172.21.15.123:0/395039594 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd0032860 con 0x7fbbe01454b0 2024-09-15T23:17:04.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.218+0000 7fbbe6742640 1 -- 172.21.15.123:0/395039594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbe01454b0 msgr2=0x7fbbe00b58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:04.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.218+0000 7fbbe6742640 1 --2- 172.21.15.123:0/395039594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbe01454b0 0x7fbbe00b58f0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fbbe00b6490 tx=0x7fbbd002a300 comp rx=0 tx=0).stop 2024-09-15T23:17:04.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.218+0000 7fbbe6742640 1 -- 172.21.15.123:0/395039594 shutdown_connections 2024-09-15T23:17:04.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.218+0000 7fbbe6742640 1 --2- 172.21.15.123:0/395039594 >> v2:172.21.15.188:3300/0 conn(0x7fbbe01459a0 0x7fbbe00b5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:04.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.218+0000 7fbbe6742640 1 --2- 172.21.15.123:0/395039594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbe01454b0 0x7fbbe00b58f0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:04.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.218+0000 7fbbe6742640 1 -- 172.21.15.123:0/395039594 >> 172.21.15.123:0/395039594 conn(0x7fbbe006c240 msgr2=0x7fbbe006d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:04.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.218+0000 7fbbe6742640 1 -- 172.21.15.123:0/395039594 shutdown_connections 2024-09-15T23:17:04.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.218+0000 7fbbe6742640 1 -- 172.21.15.123:0/395039594 wait complete. 2024-09-15T23:17:04.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.219+0000 7fbbe6742640 1 Processor -- start 2024-09-15T23:17:04.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.219+0000 7fbbe6742640 1 -- start start 2024-09-15T23:17:04.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.220+0000 7fbbe6742640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbe00b1db0 0x7fbbe015efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:04.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.220+0000 7fbbe6742640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbbe01454b0 0x7fbbe015d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:04.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.220+0000 7fbbe6742640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbe01459a0 0x7fbbe013cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:04.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.220+0000 7fbbe6742640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe00d0180 con 0x7fbbe01459a0 2024-09-15T23:17:04.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.220+0000 7fbbe6742640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe00cfea0 con 0x7fbbe00b1db0 2024-09-15T23:17:04.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.220+0000 7fbbe6742640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbbe00b0e50 con 0x7fbbe01454b0 2024-09-15T23:17:04.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.220+0000 7fbbe4cdf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbe01459a0 0x7fbbe013cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:04.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.220+0000 7fbbe4cdf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbe01459a0 0x7fbbe013cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46636/0 (socket says 172.21.15.123:46636) 2024-09-15T23:17:04.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.220+0000 7fbbe4cdf640 1 -- 172.21.15.123:0/318067869 learned_addr learned my addr 172.21.15.123:0/318067869 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:04.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.220+0000 7fbbdffff640 1 --2- 172.21.15.123:0/318067869 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbe00b1db0 0x7fbbe015efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:04.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.220+0000 7fbbdf7fe640 1 --2- 172.21.15.123:0/318067869 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbbe01454b0 0x7fbbe015d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:04.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.220+0000 7fbbe4cdf640 1 -- 172.21.15.123:0/318067869 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbbe01454b0 msgr2=0x7fbbe015d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:04.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.220+0000 7fbbe4cdf640 1 --2- 172.21.15.123:0/318067869 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbbe01454b0 0x7fbbe015d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:04.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.220+0000 7fbbe4cdf640 1 -- 172.21.15.123:0/318067869 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbe00b1db0 msgr2=0x7fbbe015efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:04.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.220+0000 7fbbe4cdf640 1 --2- 172.21.15.123:0/318067869 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbe00b1db0 0x7fbbe015efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:04.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.220+0000 7fbbe4cdf640 1 -- 172.21.15.123:0/318067869 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbe015df30 con 0x7fbbe01459a0 2024-09-15T23:17:04.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.220+0000 7fbbe4cdf640 1 --2- 172.21.15.123:0/318067869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbe01459a0 0x7fbbe013cad0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fbbd800c7c0 tx=0x7fbbd800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:04.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.220+0000 7fbbdcff9640 1 -- 172.21.15.123:0/318067869 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd8003da0 con 0x7fbbe01459a0 2024-09-15T23:17:04.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.220+0000 7fbbdcff9640 1 -- 172.21.15.123:0/318067869 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbd8005070 con 0x7fbbe01459a0 2024-09-15T23:17:04.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.220+0000 7fbbe6742640 1 -- 172.21.15.123:0/318067869 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbe015e210 con 0x7fbbe01459a0 2024-09-15T23:17:04.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.220+0000 7fbbdcff9640 1 -- 172.21.15.123:0/318067869 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd8005460 con 0x7fbbe01459a0 2024-09-15T23:17:04.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.221+0000 7fbbe6742640 1 -- 172.21.15.123:0/318067869 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbe015e7d0 con 0x7fbbe01459a0 2024-09-15T23:17:04.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.221+0000 7fbbe6742640 1 -- 172.21.15.123:0/318067869 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbe00b58f0 con 0x7fbbe01459a0 2024-09-15T23:17:04.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.222+0000 7fbbdcff9640 1 -- 172.21.15.123:0/318067869 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbbd8005600 con 0x7fbbe01459a0 2024-09-15T23:17:04.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.222+0000 7fbbdcff9640 1 --2- 172.21.15.123:0/318067869 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbbcc06c2b0 0x7fbbcc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:04.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.223+0000 7fbbdcff9640 1 -- 172.21.15.123:0/318067869 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5881+0+0 (secure 0 0 0) 0x7fbbd808b290 con 0x7fbbe01459a0 2024-09-15T23:17:04.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.223+0000 7fbbdffff640 1 --2- 172.21.15.123:0/318067869 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbbcc06c2b0 0x7fbbcc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:04.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.223+0000 7fbbdffff640 1 --2- 172.21.15.123:0/318067869 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbbcc06c2b0 0x7fbbcc06e770 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0034000 tx=0x7fbbd002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:04.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.227+0000 7fbbdcff9640 1 -- 172.21.15.123:0/318067869 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbbe0146220 con 0x7fbbe01459a0 2024-09-15T23:17:04.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:04.392+0000 7fbbe6742640 1 -- 172.21.15.123:0/318067869 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbbe0068790 con 0x7fbbe01459a0 2024-09-15T23:17:05.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.056+0000 7fbbdcff9640 1 -- 172.21.15.123:0/318067869 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v104) ==== 181+0+0 (secure 0 0 0) 0x7fbbd8059390 con 0x7fbbe01459a0 2024-09-15T23:17:05.057 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' removed 2024-09-15T23:17:05.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.059+0000 7fbbe6742640 1 -- 172.21.15.123:0/318067869 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbbcc06c2b0 msgr2=0x7fbbcc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:05.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.059+0000 7fbbe6742640 1 --2- 172.21.15.123:0/318067869 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbbcc06c2b0 0x7fbbcc06e770 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0034000 tx=0x7fbbd002e000 comp rx=0 tx=0).stop 2024-09-15T23:17:05.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.059+0000 7fbbe6742640 1 -- 172.21.15.123:0/318067869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbe01459a0 msgr2=0x7fbbe013cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:05.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.059+0000 7fbbe6742640 1 --2- 172.21.15.123:0/318067869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbe01459a0 0x7fbbe013cad0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fbbd800c7c0 tx=0x7fbbd800cc80 comp rx=0 tx=0).stop 2024-09-15T23:17:05.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.059+0000 7fbbe6742640 1 -- 172.21.15.123:0/318067869 shutdown_connections 2024-09-15T23:17:05.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.059+0000 7fbbe6742640 1 --2- 172.21.15.123:0/318067869 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbbcc06c2b0 0x7fbbcc06e770 secure :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0034000 tx=0x7fbbd002e000 comp rx=0 tx=0).stop 2024-09-15T23:17:05.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.059+0000 7fbbe6742640 1 --2- 172.21.15.123:0/318067869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbe01459a0 0x7fbbe013cad0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:05.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.059+0000 7fbbe6742640 1 --2- 172.21.15.123:0/318067869 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbbe01454b0 0x7fbbe015d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:05.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.059+0000 7fbbe6742640 1 --2- 172.21.15.123:0/318067869 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbe00b1db0 0x7fbbe015efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:05.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.059+0000 7fbbe6742640 1 -- 172.21.15.123:0/318067869 >> 172.21.15.123:0/318067869 conn(0x7fbbe006c240 msgr2=0x7fbbe00cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:05.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.060+0000 7fbbe6742640 1 -- 172.21.15.123:0/318067869 shutdown_connections 2024-09-15T23:17:05.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.060+0000 7fbbe6742640 1 -- 172.21.15.123:0/318067869 wait complete. 2024-09-15T23:17:05.075 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T23:17:05.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.182+0000 7feb93482640 1 Processor -- start 2024-09-15T23:17:05.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.182+0000 7feb93482640 1 -- start start 2024-09-15T23:17:05.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.183+0000 7feb93482640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7feb8c155b20 0x7feb8c0b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:05.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.183+0000 7feb93482640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feb8c0cfb30 0x7feb8c15c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:05.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.183+0000 7feb93482640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb8c0b0680 con 0x7feb8c0b21a0 2024-09-15T23:17:05.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.183+0000 7feb93482640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7feb8c0b01e0 con 0x7feb8c155b20 2024-09-15T23:17:05.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.183+0000 7feb93482640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7feb8c0ccf70 con 0x7feb8c0cfb30 2024-09-15T23:17:05.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.183+0000 7feb90a1d640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7feb8c0b21a0 0x7feb8c0cf420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49164/0 (socket says 172.21.15.123:49164) 2024-09-15T23:17:05.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.183+0000 7feb90a1d640 1 -- 172.21.15.123:0/1479540090 learned_addr learned my addr 172.21.15.123:0/1479540090 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:17:05.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.184+0000 7feb8bfff640 1 -- 172.21.15.123:0/1479540090 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1862073275 0 0) 0x7feb8c0b0680 con 0x7feb8c0b21a0 2024-09-15T23:17:05.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.184+0000 7feb8bfff640 1 -- 172.21.15.123:0/1479540090 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb74003520 con 0x7feb8c0b21a0 2024-09-15T23:17:05.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.184+0000 7feb91a1f640 1 --2- 172.21.15.123:0/1479540090 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feb8c0cfb30 0x7feb8c15c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:05.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.184+0000 7feb9121e640 1 --2- 172.21.15.123:0/1479540090 >> v2:172.21.15.188:3300/0 conn(0x7feb8c155b20 0x7feb8c0b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:05.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.184+0000 7feb8bfff640 1 -- 172.21.15.123:0/1479540090 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3998777673 0 0) 0x7feb74003520 con 0x7feb8c0b21a0 2024-09-15T23:17:05.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.184+0000 7feb8bfff640 1 -- 172.21.15.123:0/1479540090 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feb8c0cfb30 msgr2=0x7feb8c15c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:05.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.184+0000 7feb8bfff640 1 --2- 172.21.15.123:0/1479540090 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feb8c0cfb30 0x7feb8c15c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:05.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.184+0000 7feb8bfff640 1 -- 172.21.15.123:0/1479540090 >> v2:172.21.15.188:3300/0 conn(0x7feb8c155b20 msgr2=0x7feb8c0b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:05.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.184+0000 7feb8bfff640 1 --2- 172.21.15.123:0/1479540090 >> v2:172.21.15.188:3300/0 conn(0x7feb8c155b20 0x7feb8c0b1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:05.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.184+0000 7feb8bfff640 1 -- 172.21.15.123:0/1479540090 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb8c0ce940 con 0x7feb8c0b21a0 2024-09-15T23:17:05.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.184+0000 7feb8bfff640 1 -- 172.21.15.123:0/1479540090 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7feb80001670 con 0x7feb8c0b21a0 2024-09-15T23:17:05.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.184+0000 7feb8bfff640 1 -- 172.21.15.123:0/1479540090 >> v1:172.21.15.123:6789/0 conn(0x7feb8c0b21a0 legacy=0x7feb8c0cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:05.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.184+0000 7feb8bfff640 1 --2- 172.21.15.123:0/1479540090 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feb8c0cfb30 0x7feb740039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:05.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.184+0000 7feb8bfff640 1 --2- 172.21.15.123:0/1479540090 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feb74003fe0 0x7feb74004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:05.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.184+0000 7feb8bfff640 1 --2- 172.21.15.123:0/1479540090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb74004d40 0x7feb740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:05.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.184+0000 7feb8bfff640 1 -- 172.21.15.123:0/1479540090 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c0b01e0 con 0x7feb74004d40 2024-09-15T23:17:05.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.184+0000 7feb8bfff640 1 -- 172.21.15.123:0/1479540090 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c0ccf70 con 0x7feb74003fe0 2024-09-15T23:17:05.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.184+0000 7feb8bfff640 1 -- 172.21.15.123:0/1479540090 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7feb7400dcd0 con 0x7feb8c0cfb30 2024-09-15T23:17:05.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.184+0000 7feb91a1f640 1 --2- 172.21.15.123:0/1479540090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb74004d40 0x7feb740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:05.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.184+0000 7feb9121e640 1 --2- 172.21.15.123:0/1479540090 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feb8c0cfb30 0x7feb740039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:05.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.184+0000 7feb90a1d640 1 --2- 172.21.15.123:0/1479540090 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feb74003fe0 0x7feb74004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:05.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.184+0000 7feb91a1f640 1 -- 172.21.15.123:0/1479540090 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feb8c0cfb30 msgr2=0x7feb740039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:05.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.184+0000 7feb91a1f640 1 --2- 172.21.15.123:0/1479540090 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feb8c0cfb30 0x7feb740039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:05.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.184+0000 7feb91a1f640 1 -- 172.21.15.123:0/1479540090 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feb74003fe0 msgr2=0x7feb74004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:05.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.184+0000 7feb91a1f640 1 --2- 172.21.15.123:0/1479540090 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feb74003fe0 0x7feb74004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:05.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.184+0000 7feb91a1f640 1 -- 172.21.15.123:0/1479540090 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb74003520 con 0x7feb74004d40 2024-09-15T23:17:05.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.185+0000 7feb91a1f640 1 --2- 172.21.15.123:0/1479540090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb74004d40 0x7feb740051c0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7feb84007360 tx=0x7feb74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c682aeba414a204 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:05.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.185+0000 7feb8bfff640 1 -- 172.21.15.123:0/1479540090 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb84009be0 con 0x7feb74004d40 2024-09-15T23:17:05.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.185+0000 7feb8bfff640 1 -- 172.21.15.123:0/1479540090 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb84036600 con 0x7feb74004d40 2024-09-15T23:17:05.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.185+0000 7feb8bfff640 1 -- 172.21.15.123:0/1479540090 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb840369d0 con 0x7feb74004d40 2024-09-15T23:17:05.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.186+0000 7feb93482640 1 -- 172.21.15.123:0/1479540090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb74004d40 msgr2=0x7feb740051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:05.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.186+0000 7feb93482640 1 --2- 172.21.15.123:0/1479540090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb74004d40 0x7feb740051c0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7feb84007360 tx=0x7feb74005830 comp rx=0 tx=0).stop 2024-09-15T23:17:05.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.186+0000 7feb91a1f640 1 -- 172.21.15.123:0/1479540090 reap_dead start 2024-09-15T23:17:05.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.186+0000 7feb93482640 1 -- 172.21.15.123:0/1479540090 shutdown_connections 2024-09-15T23:17:05.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.186+0000 7feb93482640 1 -- 172.21.15.123:0/1479540090 >> 172.21.15.123:0/1479540090 conn(0x7feb8c06c240 msgr2=0x7feb8c06d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:05.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.186+0000 7feb93482640 1 -- 172.21.15.123:0/1479540090 shutdown_connections 2024-09-15T23:17:05.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.186+0000 7feb93482640 1 -- 172.21.15.123:0/1479540090 wait complete. 2024-09-15T23:17:05.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.187+0000 7feb93482640 1 Processor -- start 2024-09-15T23:17:05.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.187+0000 7feb93482640 1 -- start start 2024-09-15T23:17:05.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.188+0000 7feb93482640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feb74004d40 0x7feb8c15f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:05.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.188+0000 7feb93482640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb8c157db0 0x7feb8c158230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:05.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.188+0000 7feb93482640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feb8c0ae870 0x7feb8c0aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:05.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.188+0000 7feb93482640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c0ce610 con 0x7feb8c157db0 2024-09-15T23:17:05.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.188+0000 7feb93482640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c0cef00 con 0x7feb74004d40 2024-09-15T23:17:05.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.188+0000 7feb93482640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7feb8c0ccb20 con 0x7feb8c0ae870 2024-09-15T23:17:05.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.188+0000 7feb90a1d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb8c157db0 0x7feb8c158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:05.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.188+0000 7feb90a1d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb8c157db0 0x7feb8c158230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46656/0 (socket says 172.21.15.123:46656) 2024-09-15T23:17:05.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.188+0000 7feb90a1d640 1 -- 172.21.15.123:0/1919222927 learned_addr learned my addr 172.21.15.123:0/1919222927 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:05.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.188+0000 7feb9121e640 1 --2- 172.21.15.123:0/1919222927 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feb74004d40 0x7feb8c15f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:05.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.188+0000 7feb91a1f640 1 --2- 172.21.15.123:0/1919222927 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feb8c0ae870 0x7feb8c0aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:05.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.188+0000 7feb90a1d640 1 -- 172.21.15.123:0/1919222927 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feb8c0ae870 msgr2=0x7feb8c0aecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:05.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.188+0000 7feb90a1d640 1 --2- 172.21.15.123:0/1919222927 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feb8c0ae870 0x7feb8c0aecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:05.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.188+0000 7feb90a1d640 1 -- 172.21.15.123:0/1919222927 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feb74004d40 msgr2=0x7feb8c15f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:05.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.188+0000 7feb90a1d640 1 --2- 172.21.15.123:0/1919222927 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feb74004d40 0x7feb8c15f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:05.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.188+0000 7feb90a1d640 1 -- 172.21.15.123:0/1919222927 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb8c158920 con 0x7feb8c157db0 2024-09-15T23:17:05.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.188+0000 7feb90a1d640 1 --2- 172.21.15.123:0/1919222927 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb8c157db0 0x7feb8c158230 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7feb80007370 tx=0x7feb80007770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:05.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.188+0000 7feb89ffb640 1 -- 172.21.15.123:0/1919222927 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8001a070 con 0x7feb8c157db0 2024-09-15T23:17:05.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.189+0000 7feb89ffb640 1 -- 172.21.15.123:0/1919222927 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb8000f940 con 0x7feb8c157db0 2024-09-15T23:17:05.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.189+0000 7feb93482640 1 -- 172.21.15.123:0/1919222927 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb8c158c00 con 0x7feb8c157db0 2024-09-15T23:17:05.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.189+0000 7feb89ffb640 1 -- 172.21.15.123:0/1919222927 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8000fd30 con 0x7feb8c157db0 2024-09-15T23:17:05.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.189+0000 7feb93482640 1 -- 172.21.15.123:0/1919222927 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb8c1591c0 con 0x7feb8c157db0 2024-09-15T23:17:05.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.190+0000 7feb93482640 1 -- 172.21.15.123:0/1919222927 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb8c0af210 con 0x7feb8c157db0 2024-09-15T23:17:05.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.190+0000 7feb89ffb640 1 -- 172.21.15.123:0/1919222927 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7feb8001d070 con 0x7feb8c157db0 2024-09-15T23:17:05.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.191+0000 7feb89ffb640 1 --2- 172.21.15.123:0/1919222927 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7feb7806c2b0 0x7feb7806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:05.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.191+0000 7feb89ffb640 1 -- 172.21.15.123:0/1919222927 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5443+0+0 (secure 0 0 0) 0x7feb8008ac30 con 0x7feb8c157db0 2024-09-15T23:17:05.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.191+0000 7feb9121e640 1 --2- 172.21.15.123:0/1919222927 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7feb7806c2b0 0x7feb7806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:05.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.191+0000 7feb9121e640 1 --2- 172.21.15.123:0/1919222927 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7feb7806c2b0 0x7feb7806e770 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7feb7c006fd0 tx=0x7feb7c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:05.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.195+0000 7feb89ffb640 1 -- 172.21.15.123:0/1919222927 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feb80058e50 con 0x7feb8c157db0 2024-09-15T23:17:05.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:05.360+0000 7feb93482640 1 -- 172.21.15.123:0/1919222927 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7feb8c0b0930 con 0x7feb8c157db0 2024-09-15T23:17:06.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.060+0000 7feb89ffb640 1 -- 172.21.15.123:0/1919222927 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v105) ==== 169+0+0 (secure 0 0 0) 0x7feb8005d150 con 0x7feb8c157db0 2024-09-15T23:17:06.062 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' removed 2024-09-15T23:17:06.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.064+0000 7feb93482640 1 -- 172.21.15.123:0/1919222927 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7feb7806c2b0 msgr2=0x7feb7806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:06.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.064+0000 7feb93482640 1 --2- 172.21.15.123:0/1919222927 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7feb7806c2b0 0x7feb7806e770 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7feb7c006fd0 tx=0x7feb7c008040 comp rx=0 tx=0).stop 2024-09-15T23:17:06.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.064+0000 7feb93482640 1 -- 172.21.15.123:0/1919222927 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb8c157db0 msgr2=0x7feb8c158230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:06.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.064+0000 7feb93482640 1 --2- 172.21.15.123:0/1919222927 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb8c157db0 0x7feb8c158230 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7feb80007370 tx=0x7feb80007770 comp rx=0 tx=0).stop 2024-09-15T23:17:06.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.064+0000 7feb93482640 1 -- 172.21.15.123:0/1919222927 shutdown_connections 2024-09-15T23:17:06.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.064+0000 7feb93482640 1 --2- 172.21.15.123:0/1919222927 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feb8c0ae870 0x7feb8c0aecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:06.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.064+0000 7feb93482640 1 --2- 172.21.15.123:0/1919222927 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7feb7806c2b0 0x7feb7806e770 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:06.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.064+0000 7feb93482640 1 --2- 172.21.15.123:0/1919222927 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb8c157db0 0x7feb8c158230 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:06.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.064+0000 7feb93482640 1 --2- 172.21.15.123:0/1919222927 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feb74004d40 0x7feb8c15f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:06.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.064+0000 7feb93482640 1 -- 172.21.15.123:0/1919222927 >> 172.21.15.123:0/1919222927 conn(0x7feb8c06c240 msgr2=0x7feb8c072270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:06.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.064+0000 7feb93482640 1 -- 172.21.15.123:0/1919222927 shutdown_connections 2024-09-15T23:17:06.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.064+0000 7feb93482640 1 -- 172.21.15.123:0/1919222927 wait complete. 2024-09-15T23:17:06.079 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T23:17:06.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.182+0000 7fce75f4b640 1 Processor -- start 2024-09-15T23:17:06.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.182+0000 7fce75f4b640 1 -- start start 2024-09-15T23:17:06.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.182+0000 7fce75f4b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fce7006bfd0 0x7fce7006c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:06.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.182+0000 7fce75f4b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fce700b3350 0x7fce701623a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:06.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.182+0000 7fce75f4b640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce7006c8f0 con 0x7fce700b38a0 2024-09-15T23:17:06.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.182+0000 7fce75f4b640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fce700b78a0 con 0x7fce700b3350 2024-09-15T23:17:06.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.182+0000 7fce75f4b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fce700cffb0 con 0x7fce7006bfd0 2024-09-15T23:17:06.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.183+0000 7fce6effd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fce700b3350 0x7fce701623a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:06.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.183+0000 7fce6effd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fce700b3350 0x7fce701623a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46668/0 (socket says 172.21.15.123:46668) 2024-09-15T23:17:06.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.183+0000 7fce6ffff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fce700b38a0 0x7fce701628e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49172/0 (socket says 172.21.15.123:49172) 2024-09-15T23:17:06.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.183+0000 7fce6effd640 1 -- 172.21.15.123:0/163674091 learned_addr learned my addr 172.21.15.123:0/163674091 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:06.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.183+0000 7fce6effd640 1 -- 172.21.15.123:0/163674091 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fce7006bfd0 msgr2=0x7fce7006c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:06.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.183+0000 7fce6f7fe640 1 --2- 172.21.15.123:0/163674091 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fce7006bfd0 0x7fce7006c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:06.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.183+0000 7fce6effd640 1 --2- 172.21.15.123:0/163674091 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fce7006bfd0 0x7fce7006c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:06.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.183+0000 7fce6effd640 1 -- 172.21.15.123:0/163674091 >> v1:172.21.15.123:6789/0 conn(0x7fce700b38a0 legacy=0x7fce701628e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:06.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.183+0000 7fce6effd640 1 -- 172.21.15.123:0/163674091 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce700cf710 con 0x7fce700b3350 2024-09-15T23:17:06.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.183+0000 7fce6f7fe640 1 --2- 172.21.15.123:0/163674091 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fce7006bfd0 0x7fce7006c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:17:06.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.183+0000 7fce6e7fc640 1 -- 172.21.15.123:0/163674091 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3067226230 0 0) 0x7fce7006c8f0 con 0x7fce700b38a0 2024-09-15T23:17:06.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.184+0000 7fce6effd640 1 --2- 172.21.15.123:0/163674091 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce700b3350 0x7fce701623a0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fce640098a0 tx=0x7fce6402a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6df0bb57f775e874 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:06.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.184+0000 7fce6e7fc640 1 -- 172.21.15.123:0/163674091 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce64037070 con 0x7fce700b3350 2024-09-15T23:17:06.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.184+0000 7fce6e7fc640 1 -- 172.21.15.123:0/163674091 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce64032440 con 0x7fce700b3350 2024-09-15T23:17:06.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.184+0000 7fce6e7fc640 1 -- 172.21.15.123:0/163674091 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce64032810 con 0x7fce700b3350 2024-09-15T23:17:06.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.184+0000 7fce75f4b640 1 -- 172.21.15.123:0/163674091 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce700b3350 msgr2=0x7fce701623a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:06.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.184+0000 7fce75f4b640 1 --2- 172.21.15.123:0/163674091 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce700b3350 0x7fce701623a0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fce640098a0 tx=0x7fce6402a290 comp rx=0 tx=0).stop 2024-09-15T23:17:06.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.184+0000 7fce75f4b640 1 -- 172.21.15.123:0/163674091 shutdown_connections 2024-09-15T23:17:06.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.184+0000 7fce75f4b640 1 --2- 172.21.15.123:0/163674091 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce700b3350 0x7fce701623a0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:06.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.184+0000 7fce75f4b640 1 --2- 172.21.15.123:0/163674091 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fce7006bfd0 0x7fce7006c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:06.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.184+0000 7fce75f4b640 1 -- 172.21.15.123:0/163674091 >> 172.21.15.123:0/163674091 conn(0x7fce700d11c0 msgr2=0x7fce700d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:06.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.184+0000 7fce75f4b640 1 -- 172.21.15.123:0/163674091 shutdown_connections 2024-09-15T23:17:06.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.184+0000 7fce75f4b640 1 -- 172.21.15.123:0/163674091 wait complete. 2024-09-15T23:17:06.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.186+0000 7fce75f4b640 1 Processor -- start 2024-09-15T23:17:06.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.186+0000 7fce75f4b640 1 -- start start 2024-09-15T23:17:06.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.186+0000 7fce75f4b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fce7006bfd0 0x7fce70157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:06.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.186+0000 7fce75f4b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fce700b3350 0x7fce700ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:06.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.186+0000 7fce75f4b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce700b38a0 0x7fce700caf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:06.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.186+0000 7fce75f4b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fce700d2400 con 0x7fce700b38a0 2024-09-15T23:17:06.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.186+0000 7fce75f4b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fce700cfcd0 con 0x7fce700b3350 2024-09-15T23:17:06.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.186+0000 7fce75f4b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fce7006cd50 con 0x7fce7006bfd0 2024-09-15T23:17:06.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.187+0000 7fce6ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce700b38a0 0x7fce700caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:06.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.187+0000 7fce6ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce700b38a0 0x7fce700caf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46678/0 (socket says 172.21.15.123:46678) 2024-09-15T23:17:06.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.187+0000 7fce6ffff640 1 -- 172.21.15.123:0/3621859330 learned_addr learned my addr 172.21.15.123:0/3621859330 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:06.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.187+0000 7fce6f7fe640 1 --2- 172.21.15.123:0/3621859330 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fce7006bfd0 0x7fce70157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:06.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.187+0000 7fce6effd640 1 --2- 172.21.15.123:0/3621859330 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fce700b3350 0x7fce700ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:06.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.187+0000 7fce6ffff640 1 -- 172.21.15.123:0/3621859330 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fce7006bfd0 msgr2=0x7fce70157870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:06.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.187+0000 7fce6ffff640 1 --2- 172.21.15.123:0/3621859330 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fce7006bfd0 0x7fce70157870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:06.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.187+0000 7fce6ffff640 1 -- 172.21.15.123:0/3621859330 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fce700b3350 msgr2=0x7fce700ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:06.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.187+0000 7fce6ffff640 1 --2- 172.21.15.123:0/3621859330 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fce700b3350 0x7fce700ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:06.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.187+0000 7fce6ffff640 1 -- 172.21.15.123:0/3621859330 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce7015a390 con 0x7fce700b38a0 2024-09-15T23:17:06.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.187+0000 7fce6ffff640 1 --2- 172.21.15.123:0/3621859330 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce700b38a0 0x7fce700caf30 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fce6800c730 tx=0x7fce6800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:06.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.187+0000 7fce57fff640 1 -- 172.21.15.123:0/3621859330 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce68018070 con 0x7fce700b38a0 2024-09-15T23:17:06.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.187+0000 7fce57fff640 1 -- 172.21.15.123:0/3621859330 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce6800ce40 con 0x7fce700b38a0 2024-09-15T23:17:06.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.188+0000 7fce75f4b640 1 -- 172.21.15.123:0/3621859330 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce7015a670 con 0x7fce700b38a0 2024-09-15T23:17:06.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.188+0000 7fce75f4b640 1 -- 172.21.15.123:0/3621859330 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce70159fc0 con 0x7fce700b38a0 2024-09-15T23:17:06.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.188+0000 7fce57fff640 1 -- 172.21.15.123:0/3621859330 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6800a860 con 0x7fce700b38a0 2024-09-15T23:17:06.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.189+0000 7fce75f4b640 1 -- 172.21.15.123:0/3621859330 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce7015ab90 con 0x7fce700b38a0 2024-09-15T23:17:06.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.190+0000 7fce57fff640 1 -- 172.21.15.123:0/3621859330 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fce6801b070 con 0x7fce700b38a0 2024-09-15T23:17:06.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.191+0000 7fce57fff640 1 --2- 172.21.15.123:0/3621859330 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fce5c06c2b0 0x7fce5c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:06.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.191+0000 7fce57fff640 1 -- 172.21.15.123:0/3621859330 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5029+0+0 (secure 0 0 0) 0x7fce6808a8c0 con 0x7fce700b38a0 2024-09-15T23:17:06.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.191+0000 7fce6f7fe640 1 --2- 172.21.15.123:0/3621859330 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fce5c06c2b0 0x7fce5c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:06.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.193+0000 7fce6f7fe640 1 --2- 172.21.15.123:0/3621859330 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fce5c06c2b0 0x7fce5c06e770 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fce6000a990 tx=0x7fce60008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:06.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.197+0000 7fce57fff640 1 -- 172.21.15.123:0/3621859330 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fce7015ab90 con 0x7fce700b38a0 2024-09-15T23:17:06.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.370+0000 7fce75f4b640 1 -- 172.21.15.123:0/3621859330 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fce7015eae0 con 0x7fce700b38a0 2024-09-15T23:17:06.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.373+0000 7fce57fff640 1 -- 172.21.15.123:0/3621859330 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v30) ==== 104+0+0 (secure 0 0 0) 0x7fce680592c0 con 0x7fce700b38a0 2024-09-15T23:17:06.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.375+0000 7fce75f4b640 1 -- 172.21.15.123:0/3621859330 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fce5c06c2b0 msgr2=0x7fce5c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:06.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.375+0000 7fce75f4b640 1 --2- 172.21.15.123:0/3621859330 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fce5c06c2b0 0x7fce5c06e770 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fce6000a990 tx=0x7fce60008040 comp rx=0 tx=0).stop 2024-09-15T23:17:06.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.375+0000 7fce75f4b640 1 -- 172.21.15.123:0/3621859330 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce700b38a0 msgr2=0x7fce700caf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:06.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.375+0000 7fce75f4b640 1 --2- 172.21.15.123:0/3621859330 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce700b38a0 0x7fce700caf30 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fce6800c730 tx=0x7fce6800cbf0 comp rx=0 tx=0).stop 2024-09-15T23:17:06.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.375+0000 7fce75f4b640 1 -- 172.21.15.123:0/3621859330 shutdown_connections 2024-09-15T23:17:06.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.375+0000 7fce75f4b640 1 --2- 172.21.15.123:0/3621859330 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fce5c06c2b0 0x7fce5c06e770 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:06.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.375+0000 7fce75f4b640 1 --2- 172.21.15.123:0/3621859330 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce700b38a0 0x7fce700caf30 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:06.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.375+0000 7fce75f4b640 1 --2- 172.21.15.123:0/3621859330 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fce700b3350 0x7fce700ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:06.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.375+0000 7fce75f4b640 1 --2- 172.21.15.123:0/3621859330 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fce7006bfd0 0x7fce70157870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:06.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.375+0000 7fce75f4b640 1 -- 172.21.15.123:0/3621859330 >> 172.21.15.123:0/3621859330 conn(0x7fce700d11c0 msgr2=0x7fce70162330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:06.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.375+0000 7fce75f4b640 1 -- 172.21.15.123:0/3621859330 shutdown_connections 2024-09-15T23:17:06.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.375+0000 7fce75f4b640 1 -- 172.21.15.123:0/3621859330 wait complete. 2024-09-15T23:17:06.388 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_split_bits 2024-09-15T23:17:06.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.487+0000 7f9cac45e640 1 Processor -- start 2024-09-15T23:17:06.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.487+0000 7f9cac45e640 1 -- start start 2024-09-15T23:17:06.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.488+0000 7f9cac45e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f9ca4162d90 0x7f9ca406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:06.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.488+0000 7f9cac45e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ca4071870 con 0x7f9ca40b6e00 2024-09-15T23:17:06.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.488+0000 7f9cac45e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ca415ec10 con 0x7f9ca40d3040 2024-09-15T23:17:06.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.488+0000 7f9cac45e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f9ca40d3480 con 0x7f9ca4162d90 2024-09-15T23:17:06.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.488+0000 7f9caa1fa640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f9ca40b6e00 0x7f9ca40b71e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41400/0 (socket says 172.21.15.123:41400) 2024-09-15T23:17:06.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.488+0000 7f9caa1fa640 1 -- 172.21.15.123:0/3673386289 learned_addr learned my addr 172.21.15.123:0/3673386289 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:17:06.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.489+0000 7f9caa9fb640 1 --2- 172.21.15.123:0/3673386289 >> v2:172.21.15.188:3300/0 conn(0x7f9ca4162d90 0x7f9ca406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:06.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.489+0000 7f9ca91f8640 1 -- 172.21.15.123:0/3673386289 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1881051415 0 0) 0x7f9ca4071870 con 0x7f9ca40b6e00 2024-09-15T23:17:06.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.489+0000 7f9ca91f8640 1 -- 172.21.15.123:0/3673386289 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c90003520 con 0x7f9ca40b6e00 2024-09-15T23:17:06.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.489+0000 7f9ca91f8640 1 -- 172.21.15.123:0/3673386289 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2163944576 0 0) 0x7f9c90003520 con 0x7f9ca40b6e00 2024-09-15T23:17:06.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.489+0000 7f9ca91f8640 1 -- 172.21.15.123:0/3673386289 >> v2:172.21.15.188:3300/0 conn(0x7f9ca4162d90 msgr2=0x7f9ca406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:06.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.489+0000 7f9ca91f8640 1 --2- 172.21.15.123:0/3673386289 >> v2:172.21.15.188:3300/0 conn(0x7f9ca4162d90 0x7f9ca406cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:06.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.489+0000 7f9ca91f8640 1 -- 172.21.15.123:0/3673386289 >> v1:172.21.15.188:6789/0 conn(0x7f9ca40d3040 legacy=0x7f9ca4071160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:06.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.489+0000 7f9ca91f8640 1 -- 172.21.15.123:0/3673386289 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca406ed20 con 0x7f9ca40b6e00 2024-09-15T23:17:06.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.489+0000 7f9ca91f8640 1 -- 172.21.15.123:0/3673386289 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f9ca0001670 con 0x7f9ca40b6e00 2024-09-15T23:17:06.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.489+0000 7f9ca91f8640 1 -- 172.21.15.123:0/3673386289 >> v1:172.21.15.123:6789/0 conn(0x7f9ca40b6e00 legacy=0x7f9ca40b71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:06.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.489+0000 7f9ca91f8640 1 --2- 172.21.15.123:0/3673386289 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9c900039b0 0x7f9c90003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:06.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.489+0000 7f9ca91f8640 1 --2- 172.21.15.123:0/3673386289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c90004800 0x7f9c90004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:06.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.489+0000 7f9ca91f8640 1 --2- 172.21.15.123:0/3673386289 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9c900052e0 0x7f9c9000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:06.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.489+0000 7f9ca91f8640 1 -- 172.21.15.123:0/3673386289 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca40d3480 con 0x7f9c90004800 2024-09-15T23:17:06.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.489+0000 7f9ca91f8640 1 -- 172.21.15.123:0/3673386289 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9c9000c1b0 con 0x7f9c900039b0 2024-09-15T23:17:06.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.489+0000 7f9ca91f8640 1 -- 172.21.15.123:0/3673386289 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9c9000c3b0 con 0x7f9c900052e0 2024-09-15T23:17:06.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.489+0000 7f9ca99f9640 1 --2- 172.21.15.123:0/3673386289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c90004800 0x7f9c90004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:06.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.489+0000 7f9caa1fa640 1 --2- 172.21.15.123:0/3673386289 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9c900039b0 0x7f9c90003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:06.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.489+0000 7f9caa9fb640 1 --2- 172.21.15.123:0/3673386289 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9c900052e0 0x7f9c9000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:06.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.489+0000 7f9ca99f9640 1 -- 172.21.15.123:0/3673386289 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9c900052e0 msgr2=0x7f9c9000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:06.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.489+0000 7f9ca99f9640 1 --2- 172.21.15.123:0/3673386289 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9c900052e0 0x7f9c9000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:06.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.489+0000 7f9ca99f9640 1 -- 172.21.15.123:0/3673386289 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9c900039b0 msgr2=0x7f9c90003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:06.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.489+0000 7f9ca99f9640 1 --2- 172.21.15.123:0/3673386289 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9c900039b0 0x7f9c90003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:06.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.489+0000 7f9ca99f9640 1 -- 172.21.15.123:0/3673386289 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c90003520 con 0x7f9c90004800 2024-09-15T23:17:06.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.489+0000 7f9caa1fa640 1 --2- 172.21.15.123:0/3673386289 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9c900039b0 0x7f9c90003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:17:06.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.489+0000 7f9caa9fb640 1 -- 172.21.15.123:0/3673386289 reap_dead start 2024-09-15T23:17:06.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.490+0000 7f9ca99f9640 1 --2- 172.21.15.123:0/3673386289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c90004800 0x7f9c90004c80 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f9c94001720 tx=0x7f9c90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d5d32910dfbb1f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:06.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.490+0000 7f9ca91f8640 1 -- 172.21.15.123:0/3673386289 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c94001370 con 0x7f9c90004800 2024-09-15T23:17:06.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.490+0000 7f9ca91f8640 1 -- 172.21.15.123:0/3673386289 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c940052d0 con 0x7f9c90004800 2024-09-15T23:17:06.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.490+0000 7f9ca91f8640 1 -- 172.21.15.123:0/3673386289 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9402ab70 con 0x7f9c90004800 2024-09-15T23:17:06.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.491+0000 7f9cac45e640 1 -- 172.21.15.123:0/3673386289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c90004800 msgr2=0x7f9c90004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:06.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.491+0000 7f9cac45e640 1 --2- 172.21.15.123:0/3673386289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c90004800 0x7f9c90004c80 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f9c94001720 tx=0x7f9c90005830 comp rx=0 tx=0).stop 2024-09-15T23:17:06.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.491+0000 7f9cac45e640 1 -- 172.21.15.123:0/3673386289 shutdown_connections 2024-09-15T23:17:06.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.491+0000 7f9cac45e640 1 --2- 172.21.15.123:0/3673386289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c90004800 0x7f9c90004c80 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:06.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.491+0000 7f9cac45e640 1 -- 172.21.15.123:0/3673386289 >> 172.21.15.123:0/3673386289 conn(0x7f9ca40d2550 msgr2=0x7f9ca40d2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:06.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.491+0000 7f9cac45e640 1 -- 172.21.15.123:0/3673386289 shutdown_connections 2024-09-15T23:17:06.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.491+0000 7f9cac45e640 1 -- 172.21.15.123:0/3673386289 wait complete. 2024-09-15T23:17:06.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.492+0000 7f9cac45e640 1 Processor -- start 2024-09-15T23:17:06.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.492+0000 7f9cac45e640 1 -- start start 2024-09-15T23:17:06.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.493+0000 7f9cac45e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9c90004800 0x7f9ca4150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:06.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.493+0000 7f9cac45e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ca41606f0 0x7f9ca4152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:06.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.493+0000 7f9cac45e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9ca4152ea0 0x7f9ca415ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:06.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.493+0000 7f9cac45e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca406e7f0 con 0x7f9ca41606f0 2024-09-15T23:17:06.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.493+0000 7f9cac45e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca4163200 con 0x7f9c90004800 2024-09-15T23:17:06.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.493+0000 7f9cac45e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9ca4070960 con 0x7f9ca4152ea0 2024-09-15T23:17:06.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.493+0000 7f9ca99f9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ca41606f0 0x7f9ca4152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:06.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.493+0000 7f9ca99f9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ca41606f0 0x7f9ca4152960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56174/0 (socket says 172.21.15.123:56174) 2024-09-15T23:17:06.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.493+0000 7f9ca99f9640 1 -- 172.21.15.123:0/2389252966 learned_addr learned my addr 172.21.15.123:0/2389252966 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:06.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.493+0000 7f9caa1fa640 1 --2- 172.21.15.123:0/2389252966 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9c90004800 0x7f9ca4150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:06.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.493+0000 7f9caa9fb640 1 --2- 172.21.15.123:0/2389252966 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9ca4152ea0 0x7f9ca415ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:06.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.493+0000 7f9ca99f9640 1 -- 172.21.15.123:0/2389252966 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9ca4152ea0 msgr2=0x7f9ca415ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:06.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.493+0000 7f9ca99f9640 1 --2- 172.21.15.123:0/2389252966 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9ca4152ea0 0x7f9ca415ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:06.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.493+0000 7f9ca99f9640 1 -- 172.21.15.123:0/2389252966 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9c90004800 msgr2=0x7f9ca4150bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:06.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.493+0000 7f9ca99f9640 1 --2- 172.21.15.123:0/2389252966 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9c90004800 0x7f9ca4150bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:06.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.493+0000 7f9ca99f9640 1 -- 172.21.15.123:0/2389252966 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca41e8f90 con 0x7f9ca41606f0 2024-09-15T23:17:06.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.493+0000 7f9caa9fb640 1 --2- 172.21.15.123:0/2389252966 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9ca4152ea0 0x7f9ca415ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:17:06.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.493+0000 7f9ca99f9640 1 --2- 172.21.15.123:0/2389252966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ca41606f0 0x7f9ca4152960 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f9c94005040 tx=0x7f9c94001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:06.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.493+0000 7f9c9affd640 1 -- 172.21.15.123:0/2389252966 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9403f030 con 0x7f9ca41606f0 2024-09-15T23:17:06.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.493+0000 7f9c9affd640 1 -- 172.21.15.123:0/2389252966 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c94005480 con 0x7f9ca41606f0 2024-09-15T23:17:06.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.493+0000 7f9cac45e640 1 -- 172.21.15.123:0/2389252966 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ca41e9270 con 0x7f9ca41606f0 2024-09-15T23:17:06.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.493+0000 7f9c9affd640 1 -- 172.21.15.123:0/2389252966 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c94037040 con 0x7f9ca41606f0 2024-09-15T23:17:06.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.494+0000 7f9cac45e640 1 -- 172.21.15.123:0/2389252966 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ca41e9830 con 0x7f9ca41606f0 2024-09-15T23:17:06.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.494+0000 7f9cac45e640 1 -- 172.21.15.123:0/2389252966 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ca4070c40 con 0x7f9ca41606f0 2024-09-15T23:17:06.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.495+0000 7f9c9affd640 1 -- 172.21.15.123:0/2389252966 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9c94042070 con 0x7f9ca41606f0 2024-09-15T23:17:06.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.495+0000 7f9c9affd640 1 --2- 172.21.15.123:0/2389252966 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9c8806c2e0 0x7f9c8806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:06.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.496+0000 7f9c9affd640 1 -- 172.21.15.123:0/2389252966 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5029+0+0 (secure 0 0 0) 0x7f9c940aa550 con 0x7f9ca41606f0 2024-09-15T23:17:06.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.496+0000 7f9caa1fa640 1 --2- 172.21.15.123:0/2389252966 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9c8806c2e0 0x7f9c8806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:06.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.496+0000 7f9caa1fa640 1 --2- 172.21.15.123:0/2389252966 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9c8806c2e0 0x7f9c8806e7a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0000ff0 tx=0x7f9ca0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:06.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.500+0000 7f9c9affd640 1 -- 172.21.15.123:0/2389252966 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9c9404a020 con 0x7f9ca41606f0 2024-09-15T23:17:06.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.664+0000 7f9cac45e640 1 -- 172.21.15.123:0/2389252966 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_split_bits"} v 0) -- 0x7f9ca4153280 con 0x7f9ca41606f0 2024-09-15T23:17:06.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.667+0000 7f9c9affd640 1 -- 172.21.15.123:0/2389252966 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_split_bits"}]=0 v31) ==== 101+0+0 (secure 0 0 0) 0x7f9c94078ed0 con 0x7f9ca41606f0 2024-09-15T23:17:06.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.669+0000 7f9cac45e640 1 -- 172.21.15.123:0/2389252966 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9c8806c2e0 msgr2=0x7f9c8806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:06.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.669+0000 7f9cac45e640 1 --2- 172.21.15.123:0/2389252966 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9c8806c2e0 0x7f9c8806e7a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0000ff0 tx=0x7f9ca0009040 comp rx=0 tx=0).stop 2024-09-15T23:17:06.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.669+0000 7f9cac45e640 1 -- 172.21.15.123:0/2389252966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ca41606f0 msgr2=0x7f9ca4152960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:06.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.669+0000 7f9cac45e640 1 --2- 172.21.15.123:0/2389252966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ca41606f0 0x7f9ca4152960 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f9c94005040 tx=0x7f9c94001120 comp rx=0 tx=0).stop 2024-09-15T23:17:06.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.670+0000 7f9cac45e640 1 -- 172.21.15.123:0/2389252966 shutdown_connections 2024-09-15T23:17:06.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.670+0000 7f9cac45e640 1 --2- 172.21.15.123:0/2389252966 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9ca4152ea0 0x7f9ca415ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:06.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.670+0000 7f9cac45e640 1 --2- 172.21.15.123:0/2389252966 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9c8806c2e0 0x7f9c8806e7a0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:06.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.670+0000 7f9cac45e640 1 --2- 172.21.15.123:0/2389252966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ca41606f0 0x7f9ca4152960 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:06.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.670+0000 7f9cac45e640 1 --2- 172.21.15.123:0/2389252966 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9c90004800 0x7f9ca4150bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:06.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.670+0000 7f9cac45e640 1 -- 172.21.15.123:0/2389252966 >> 172.21.15.123:0/2389252966 conn(0x7f9ca40d2550 msgr2=0x7f9ca415d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:06.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.670+0000 7f9cac45e640 1 -- 172.21.15.123:0/2389252966 shutdown_connections 2024-09-15T23:17:06.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.670+0000 7f9cac45e640 1 -- 172.21.15.123:0/2389252966 wait complete. 2024-09-15T23:17:06.682 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_merge_size 2024-09-15T23:17:06.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.782+0000 7fc13d48d640 1 Processor -- start 2024-09-15T23:17:06.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.782+0000 7fc13d48d640 1 -- start start 2024-09-15T23:17:06.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.783+0000 7fc13d48d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc138158c80 0x7fc138162230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:06.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.783+0000 7fc13d48d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc13806c320 0x7fc1380729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:06.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.783+0000 7fc13d48d640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc138144090 con 0x7fc1380afb90 2024-09-15T23:17:06.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.783+0000 7fc13d48d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc138141a00 con 0x7fc138158c80 2024-09-15T23:17:06.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.783+0000 7fc13d48d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc138072f10 con 0x7fc13806c320 2024-09-15T23:17:06.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.783+0000 7fc136ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc138158c80 0x7fc138162230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:06.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.783+0000 7fc136ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc138158c80 0x7fc138162230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56180/0 (socket says 172.21.15.123:56180) 2024-09-15T23:17:06.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.783+0000 7fc136ffd640 1 -- 172.21.15.123:0/3829960172 learned_addr learned my addr 172.21.15.123:0/3829960172 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:06.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.783+0000 7fc136ffd640 1 -- 172.21.15.123:0/3829960172 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc13806c320 msgr2=0x7fc1380729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:06.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.783+0000 7fc136ffd640 1 --2- 172.21.15.123:0/3829960172 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc13806c320 0x7fc1380729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:06.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.783+0000 7fc136ffd640 1 -- 172.21.15.123:0/3829960172 >> v1:172.21.15.188:6789/0 conn(0x7fc1380afb90 legacy=0x7fc13806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:06.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.783+0000 7fc136ffd640 1 -- 172.21.15.123:0/3829960172 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc138144370 con 0x7fc138158c80 2024-09-15T23:17:06.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.784+0000 7fc136ffd640 1 --2- 172.21.15.123:0/3829960172 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc138158c80 0x7fc138162230 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fc128009870 tx=0x7fc12802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=504fca140b79fec2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:06.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.784+0000 7fc1367fc640 1 -- 172.21.15.123:0/3829960172 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128037070 con 0x7fc138158c80 2024-09-15T23:17:06.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.784+0000 7fc1367fc640 1 -- 172.21.15.123:0/3829960172 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc128032440 con 0x7fc138158c80 2024-09-15T23:17:06.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.784+0000 7fc1367fc640 1 -- 172.21.15.123:0/3829960172 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128032810 con 0x7fc138158c80 2024-09-15T23:17:06.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.784+0000 7fc13d48d640 1 -- 172.21.15.123:0/3829960172 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc138158c80 msgr2=0x7fc138162230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:06.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.784+0000 7fc13d48d640 1 --2- 172.21.15.123:0/3829960172 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc138158c80 0x7fc138162230 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fc128009870 tx=0x7fc12802a210 comp rx=0 tx=0).stop 2024-09-15T23:17:06.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.785+0000 7fc13d48d640 1 -- 172.21.15.123:0/3829960172 shutdown_connections 2024-09-15T23:17:06.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.785+0000 7fc13d48d640 1 --2- 172.21.15.123:0/3829960172 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc13806c320 0x7fc1380729d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:06.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.785+0000 7fc13d48d640 1 --2- 172.21.15.123:0/3829960172 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc138158c80 0x7fc138162230 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:06.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.785+0000 7fc13d48d640 1 -- 172.21.15.123:0/3829960172 >> 172.21.15.123:0/3829960172 conn(0x7fc13806cd20 msgr2=0x7fc13806d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:06.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.785+0000 7fc13d48d640 1 -- 172.21.15.123:0/3829960172 shutdown_connections 2024-09-15T23:17:06.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.785+0000 7fc13d48d640 1 -- 172.21.15.123:0/3829960172 wait complete. 2024-09-15T23:17:06.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.786+0000 7fc13d48d640 1 Processor -- start 2024-09-15T23:17:06.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.786+0000 7fc13d48d640 1 -- start start 2024-09-15T23:17:06.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.787+0000 7fc13d48d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc13806c320 0x7fc13813f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:06.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.787+0000 7fc13d48d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc1380afb90 0x7fc1380b29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:06.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.787+0000 7fc13d48d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc138158c80 0x7fc13813fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:06.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.787+0000 7fc13d48d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc138144c10 con 0x7fc13806c320 2024-09-15T23:17:06.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.787+0000 7fc13d48d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc138144930 con 0x7fc138158c80 2024-09-15T23:17:06.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.787+0000 7fc13d48d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc138159060 con 0x7fc1380afb90 2024-09-15T23:17:06.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.787+0000 7fc136ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc13806c320 0x7fc13813f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:06.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.787+0000 7fc136ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc13806c320 0x7fc13813f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56192/0 (socket says 172.21.15.123:56192) 2024-09-15T23:17:06.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.787+0000 7fc136ffd640 1 -- 172.21.15.123:0/1483784535 learned_addr learned my addr 172.21.15.123:0/1483784535 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:06.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.787+0000 7fc1377fe640 1 --2- 172.21.15.123:0/1483784535 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc138158c80 0x7fc13813fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:06.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.787+0000 7fc12e7fc640 1 --2- 172.21.15.123:0/1483784535 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc1380afb90 0x7fc1380b29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:06.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.787+0000 7fc136ffd640 1 -- 172.21.15.123:0/1483784535 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc1380afb90 msgr2=0x7fc1380b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:06.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.787+0000 7fc136ffd640 1 --2- 172.21.15.123:0/1483784535 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc1380afb90 0x7fc1380b29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:06.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.787+0000 7fc136ffd640 1 -- 172.21.15.123:0/1483784535 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc138158c80 msgr2=0x7fc13813fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:06.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.787+0000 7fc136ffd640 1 --2- 172.21.15.123:0/1483784535 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc138158c80 0x7fc13813fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:06.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.787+0000 7fc136ffd640 1 -- 172.21.15.123:0/1483784535 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1380b1630 con 0x7fc13806c320 2024-09-15T23:17:06.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.787+0000 7fc1377fe640 1 --2- 172.21.15.123:0/1483784535 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc138158c80 0x7fc13813fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:17:06.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.787+0000 7fc136ffd640 1 --2- 172.21.15.123:0/1483784535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc13806c320 0x7fc13813f430 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fc128000c00 tx=0x7fc1280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:06.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.787+0000 7fc12ffff640 1 -- 172.21.15.123:0/1483784535 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128041070 con 0x7fc13806c320 2024-09-15T23:17:06.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.787+0000 7fc12ffff640 1 -- 172.21.15.123:0/1483784535 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc12803c870 con 0x7fc13806c320 2024-09-15T23:17:06.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.787+0000 7fc13d48d640 1 -- 172.21.15.123:0/1483784535 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1380b1910 con 0x7fc13806c320 2024-09-15T23:17:06.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.787+0000 7fc12ffff640 1 -- 172.21.15.123:0/1483784535 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128037040 con 0x7fc13806c320 2024-09-15T23:17:06.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.787+0000 7fc13d48d640 1 -- 172.21.15.123:0/1483784535 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1380b1ed0 con 0x7fc13806c320 2024-09-15T23:17:06.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.788+0000 7fc13d48d640 1 -- 172.21.15.123:0/1483784535 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc138143d20 con 0x7fc13806c320 2024-09-15T23:17:06.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.789+0000 7fc12ffff640 1 -- 172.21.15.123:0/1483784535 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc128044070 con 0x7fc13806c320 2024-09-15T23:17:06.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.789+0000 7fc12ffff640 1 --2- 172.21.15.123:0/1483784535 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc11806c2b0 0x7fc11806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:06.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.789+0000 7fc12ffff640 1 -- 172.21.15.123:0/1483784535 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5029+0+0 (secure 0 0 0) 0x7fc1280abd00 con 0x7fc13806c320 2024-09-15T23:17:06.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.789+0000 7fc12e7fc640 1 --2- 172.21.15.123:0/1483784535 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc11806c2b0 0x7fc11806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:06.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.790+0000 7fc12e7fc640 1 --2- 172.21.15.123:0/1483784535 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc11806c2b0 0x7fc11806e770 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc1381589b0 tx=0x7fc120009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:06.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.794+0000 7fc12ffff640 1 -- 172.21.15.123:0/1483784535 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc12807a830 con 0x7fc13806c320 2024-09-15T23:17:06.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.961+0000 7fc13d48d640 1 -- 172.21.15.123:0/1483784535 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_merge_size"} v 0) -- 0x7fc138141f60 con 0x7fc13806c320 2024-09-15T23:17:06.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.964+0000 7fc12ffff640 1 -- 172.21.15.123:0/1483784535 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_merge_size"}]=0 v32) ==== 101+0+0 (secure 0 0 0) 0x7fc12807a130 con 0x7fc13806c320 2024-09-15T23:17:06.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.966+0000 7fc13d48d640 1 -- 172.21.15.123:0/1483784535 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc11806c2b0 msgr2=0x7fc11806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:06.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.967+0000 7fc13d48d640 1 --2- 172.21.15.123:0/1483784535 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc11806c2b0 0x7fc11806e770 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc1381589b0 tx=0x7fc120009040 comp rx=0 tx=0).stop 2024-09-15T23:17:06.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.967+0000 7fc13d48d640 1 -- 172.21.15.123:0/1483784535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc13806c320 msgr2=0x7fc13813f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:06.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.967+0000 7fc13d48d640 1 --2- 172.21.15.123:0/1483784535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc13806c320 0x7fc13813f430 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fc128000c00 tx=0x7fc1280046c0 comp rx=0 tx=0).stop 2024-09-15T23:17:06.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.967+0000 7fc13d48d640 1 -- 172.21.15.123:0/1483784535 shutdown_connections 2024-09-15T23:17:06.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.967+0000 7fc13d48d640 1 --2- 172.21.15.123:0/1483784535 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc138158c80 0x7fc13813fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:06.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.967+0000 7fc13d48d640 1 --2- 172.21.15.123:0/1483784535 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc1380afb90 0x7fc1380b29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:06.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.967+0000 7fc13d48d640 1 --2- 172.21.15.123:0/1483784535 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc11806c2b0 0x7fc11806e770 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:06.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.967+0000 7fc13d48d640 1 --2- 172.21.15.123:0/1483784535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc13806c320 0x7fc13813f430 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:06.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.967+0000 7fc13d48d640 1 -- 172.21.15.123:0/1483784535 >> 172.21.15.123:0/1483784535 conn(0x7fc13806cd20 msgr2=0x7fc138140850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:06.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.967+0000 7fc13d48d640 1 -- 172.21.15.123:0/1483784535 shutdown_connections 2024-09-15T23:17:06.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:06.967+0000 7fc13d48d640 1 -- 172.21.15.123:0/1483784535 wait complete. 2024-09-15T23:17:06.979 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_bal_split_size 2024-09-15T23:17:07.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.079+0000 7f2a5b2ba640 1 Processor -- start 2024-09-15T23:17:07.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.080+0000 7f2a5b2ba640 1 -- start start 2024-09-15T23:17:07.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.080+0000 7f2a5b2ba640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2a5406bfd0 0x7f2a5406c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:07.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.080+0000 7f2a5b2ba640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a540d3930 0x7f2a54162ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:07.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.080+0000 7f2a5b2ba640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a5406c8f0 con 0x7f2a540b3350 2024-09-15T23:17:07.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.080+0000 7f2a5b2ba640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f2a540b78a0 con 0x7f2a5406bfd0 2024-09-15T23:17:07.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.080+0000 7f2a5b2ba640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f2a540cffb0 con 0x7f2a540d3930 2024-09-15T23:17:07.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.081+0000 7f2a58855640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f2a540b3350 0x7f2a541623a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41408/0 (socket says 172.21.15.123:41408) 2024-09-15T23:17:07.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.081+0000 7f2a58855640 1 -- 172.21.15.123:0/1358551036 learned_addr learned my addr 172.21.15.123:0/1358551036 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:17:07.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.081+0000 7f2a59857640 1 --2- 172.21.15.123:0/1358551036 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a540d3930 0x7f2a54162ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:07.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.081+0000 7f2a59056640 1 --2- 172.21.15.123:0/1358551036 >> v2:172.21.15.188:3300/0 conn(0x7f2a5406bfd0 0x7f2a5406c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:07.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.081+0000 7f2a53fff640 1 -- 172.21.15.123:0/1358551036 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2142313125 0 0) 0x7f2a5406c8f0 con 0x7f2a540b3350 2024-09-15T23:17:07.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.081+0000 7f2a53fff640 1 -- 172.21.15.123:0/1358551036 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a3c003520 con 0x7f2a540b3350 2024-09-15T23:17:07.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.081+0000 7f2a53fff640 1 -- 172.21.15.123:0/1358551036 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3187203152 0 0) 0x7f2a3c003520 con 0x7f2a540b3350 2024-09-15T23:17:07.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.081+0000 7f2a53fff640 1 -- 172.21.15.123:0/1358551036 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a540d3930 msgr2=0x7f2a54162ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:07.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.081+0000 7f2a53fff640 1 --2- 172.21.15.123:0/1358551036 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a540d3930 0x7f2a54162ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:07.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.081+0000 7f2a53fff640 1 -- 172.21.15.123:0/1358551036 >> v2:172.21.15.188:3300/0 conn(0x7f2a5406bfd0 msgr2=0x7f2a5406c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:07.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.081+0000 7f2a53fff640 1 --2- 172.21.15.123:0/1358551036 >> v2:172.21.15.188:3300/0 conn(0x7f2a5406bfd0 0x7f2a5406c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:07.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.081+0000 7f2a53fff640 1 -- 172.21.15.123:0/1358551036 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a540cf710 con 0x7f2a540b3350 2024-09-15T23:17:07.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.081+0000 7f2a53fff640 1 -- 172.21.15.123:0/1358551036 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f2a48001670 con 0x7f2a540b3350 2024-09-15T23:17:07.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.081+0000 7f2a53fff640 1 -- 172.21.15.123:0/1358551036 >> v1:172.21.15.123:6789/0 conn(0x7f2a540b3350 legacy=0x7f2a541623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:07.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.081+0000 7f2a53fff640 1 --2- 172.21.15.123:0/1358551036 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a3c0039e0 0x7f2a3c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:07.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.081+0000 7f2a53fff640 1 --2- 172.21.15.123:0/1358551036 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a540d3930 0x7f2a3c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:07.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.081+0000 7f2a53fff640 1 --2- 172.21.15.123:0/1358551036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a3c004d40 0x7f2a3c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:07.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.081+0000 7f2a53fff640 1 -- 172.21.15.123:0/1358551036 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2a540cffb0 con 0x7f2a3c004d40 2024-09-15T23:17:07.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.081+0000 7f2a53fff640 1 -- 172.21.15.123:0/1358551036 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3c00b9c0 con 0x7f2a3c0039e0 2024-09-15T23:17:07.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.081+0000 7f2a53fff640 1 -- 172.21.15.123:0/1358551036 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f2a3c00bb40 con 0x7f2a540d3930 2024-09-15T23:17:07.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.081+0000 7f2a59056640 1 --2- 172.21.15.123:0/1358551036 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a3c0039e0 0x7f2a3c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:07.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.081+0000 7f2a59857640 1 --2- 172.21.15.123:0/1358551036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a3c004d40 0x7f2a3c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:07.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.081+0000 7f2a58855640 1 --2- 172.21.15.123:0/1358551036 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a540d3930 0x7f2a3c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:07.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.082+0000 7f2a59857640 1 -- 172.21.15.123:0/1358551036 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a540d3930 msgr2=0x7f2a3c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:07.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.082+0000 7f2a59857640 1 --2- 172.21.15.123:0/1358551036 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a540d3930 0x7f2a3c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:07.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.082+0000 7f2a59857640 1 -- 172.21.15.123:0/1358551036 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a3c0039e0 msgr2=0x7f2a3c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:07.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.082+0000 7f2a59857640 1 --2- 172.21.15.123:0/1358551036 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a3c0039e0 0x7f2a3c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:07.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.082+0000 7f2a59857640 1 -- 172.21.15.123:0/1358551036 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a3c003520 con 0x7f2a3c004d40 2024-09-15T23:17:07.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.082+0000 7f2a59857640 1 --2- 172.21.15.123:0/1358551036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a3c004d40 0x7f2a3c0051c0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c009a90 tx=0x7f2a3c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b8b0b35dcf485f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:07.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.082+0000 7f2a53fff640 1 -- 172.21.15.123:0/1358551036 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c036070 con 0x7f2a3c004d40 2024-09-15T23:17:07.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.082+0000 7f2a53fff640 1 -- 172.21.15.123:0/1358551036 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a4c031400 con 0x7f2a3c004d40 2024-09-15T23:17:07.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.082+0000 7f2a53fff640 1 -- 172.21.15.123:0/1358551036 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c009690 con 0x7f2a3c004d40 2024-09-15T23:17:07.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.083+0000 7f2a5b2ba640 1 -- 172.21.15.123:0/1358551036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a3c004d40 msgr2=0x7f2a3c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:07.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.083+0000 7f2a5b2ba640 1 --2- 172.21.15.123:0/1358551036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a3c004d40 0x7f2a3c0051c0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c009a90 tx=0x7f2a3c005830 comp rx=0 tx=0).stop 2024-09-15T23:17:07.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.083+0000 7f2a59857640 1 -- 172.21.15.123:0/1358551036 reap_dead start 2024-09-15T23:17:07.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.083+0000 7f2a5b2ba640 1 -- 172.21.15.123:0/1358551036 shutdown_connections 2024-09-15T23:17:07.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.083+0000 7f2a5b2ba640 1 -- 172.21.15.123:0/1358551036 >> 172.21.15.123:0/1358551036 conn(0x7f2a540d11c0 msgr2=0x7f2a540d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:07.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.083+0000 7f2a5b2ba640 1 -- 172.21.15.123:0/1358551036 shutdown_connections 2024-09-15T23:17:07.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.083+0000 7f2a5b2ba640 1 -- 172.21.15.123:0/1358551036 wait complete. 2024-09-15T23:17:07.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.084+0000 7f2a5b2ba640 1 Processor -- start 2024-09-15T23:17:07.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.084+0000 7f2a5b2ba640 1 -- start start 2024-09-15T23:17:07.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.085+0000 7f2a5b2ba640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a3c004d40 0x7f2a54160620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:07.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.085+0000 7f2a5b2ba640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a540cb780 0x7f2a541532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:07.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.085+0000 7f2a5b2ba640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a54153820 0x7f2a540b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:07.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.085+0000 7f2a5b2ba640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2a540d2400 con 0x7f2a540cb780 2024-09-15T23:17:07.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.085+0000 7f2a5b2ba640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2a540cfcd0 con 0x7f2a54153820 2024-09-15T23:17:07.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.085+0000 7f2a5b2ba640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f2a5406cd50 con 0x7f2a3c004d40 2024-09-15T23:17:07.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.085+0000 7f2a58855640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a540cb780 0x7f2a541532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:07.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.085+0000 7f2a58855640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a540cb780 0x7f2a541532e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56206/0 (socket says 172.21.15.123:56206) 2024-09-15T23:17:07.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.085+0000 7f2a58855640 1 -- 172.21.15.123:0/1592454160 learned_addr learned my addr 172.21.15.123:0/1592454160 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:07.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.085+0000 7f2a59056640 1 --2- 172.21.15.123:0/1592454160 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a3c004d40 0x7f2a54160620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:07.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.085+0000 7f2a59857640 1 --2- 172.21.15.123:0/1592454160 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a54153820 0x7f2a540b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:07.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.085+0000 7f2a58855640 1 -- 172.21.15.123:0/1592454160 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a3c004d40 msgr2=0x7f2a54160620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:07.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.085+0000 7f2a58855640 1 --2- 172.21.15.123:0/1592454160 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a3c004d40 0x7f2a54160620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:07.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.085+0000 7f2a58855640 1 -- 172.21.15.123:0/1592454160 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a54153820 msgr2=0x7f2a540b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:07.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.085+0000 7f2a58855640 1 --2- 172.21.15.123:0/1592454160 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a54153820 0x7f2a540b8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:07.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.085+0000 7f2a58855640 1 -- 172.21.15.123:0/1592454160 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a540c7f20 con 0x7f2a540cb780 2024-09-15T23:17:07.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.085+0000 7f2a59857640 1 --2- 172.21.15.123:0/1592454160 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a54153820 0x7f2a540b8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:17:07.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.085+0000 7f2a59056640 1 --2- 172.21.15.123:0/1592454160 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a3c004d40 0x7f2a54160620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:17:07.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.085+0000 7f2a58855640 1 --2- 172.21.15.123:0/1592454160 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a540cb780 0x7f2a541532e0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f2a4800e840 tx=0x7f2a4800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:07.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.086+0000 7f2a51ffb640 1 -- 172.21.15.123:0/1592454160 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4800c870 con 0x7f2a540cb780 2024-09-15T23:17:07.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.086+0000 7f2a51ffb640 1 -- 172.21.15.123:0/1592454160 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a48018070 con 0x7f2a540cb780 2024-09-15T23:17:07.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.086+0000 7f2a5b2ba640 1 -- 172.21.15.123:0/1592454160 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a54160ff0 con 0x7f2a540cb780 2024-09-15T23:17:07.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.086+0000 7f2a51ffb640 1 -- 172.21.15.123:0/1592454160 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4800cc50 con 0x7f2a540cb780 2024-09-15T23:17:07.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.086+0000 7f2a5b2ba640 1 -- 172.21.15.123:0/1592454160 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a54161890 con 0x7f2a540cb780 2024-09-15T23:17:07.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.087+0000 7f2a5b2ba640 1 -- 172.21.15.123:0/1592454160 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a540d0cf0 con 0x7f2a540cb780 2024-09-15T23:17:07.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.087+0000 7f2a51ffb640 1 -- 172.21.15.123:0/1592454160 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2a48013420 con 0x7f2a540cb780 2024-09-15T23:17:07.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.087+0000 7f2a51ffb640 1 --2- 172.21.15.123:0/1592454160 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2a4006c2e0 0x7f2a4006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:07.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.088+0000 7f2a51ffb640 1 -- 172.21.15.123:0/1592454160 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5029+0+0 (secure 0 0 0) 0x7f2a4808adc0 con 0x7f2a540cb780 2024-09-15T23:17:07.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.088+0000 7f2a59056640 1 --2- 172.21.15.123:0/1592454160 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2a4006c2e0 0x7f2a4006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:07.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.088+0000 7f2a59056640 1 --2- 172.21.15.123:0/1592454160 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2a4006c2e0 0x7f2a4006e7a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2a44007520 tx=0x7f2a4400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:07.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.092+0000 7f2a51ffb640 1 -- 172.21.15.123:0/1592454160 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2a480597d0 con 0x7f2a540cb780 2024-09-15T23:17:07.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.258+0000 7f2a5b2ba640 1 -- 172.21.15.123:0/1592454160 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_bal_split_size"} v 0) -- 0x7f2a540ba3d0 con 0x7f2a540cb780 2024-09-15T23:17:07.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.261+0000 7f2a51ffb640 1 -- 172.21.15.123:0/1592454160 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_bal_split_size"}]=0 v33) ==== 101+0+0 (secure 0 0 0) 0x7f2a480590d0 con 0x7f2a540cb780 2024-09-15T23:17:07.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.263+0000 7f2a5b2ba640 1 -- 172.21.15.123:0/1592454160 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2a4006c2e0 msgr2=0x7f2a4006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:07.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.263+0000 7f2a5b2ba640 1 --2- 172.21.15.123:0/1592454160 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2a4006c2e0 0x7f2a4006e7a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2a44007520 tx=0x7f2a4400b040 comp rx=0 tx=0).stop 2024-09-15T23:17:07.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.263+0000 7f2a5b2ba640 1 -- 172.21.15.123:0/1592454160 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a540cb780 msgr2=0x7f2a541532e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:07.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.263+0000 7f2a5b2ba640 1 --2- 172.21.15.123:0/1592454160 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a540cb780 0x7f2a541532e0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f2a4800e840 tx=0x7f2a4800ed00 comp rx=0 tx=0).stop 2024-09-15T23:17:07.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.263+0000 7f2a5b2ba640 1 -- 172.21.15.123:0/1592454160 shutdown_connections 2024-09-15T23:17:07.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.263+0000 7f2a5b2ba640 1 --2- 172.21.15.123:0/1592454160 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2a54153820 0x7f2a540b8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:07.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.263+0000 7f2a5b2ba640 1 --2- 172.21.15.123:0/1592454160 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2a4006c2e0 0x7f2a4006e7a0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:07.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.263+0000 7f2a5b2ba640 1 --2- 172.21.15.123:0/1592454160 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a540cb780 0x7f2a541532e0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:07.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.263+0000 7f2a5b2ba640 1 --2- 172.21.15.123:0/1592454160 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2a3c004d40 0x7f2a54160620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:07.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.263+0000 7f2a5b2ba640 1 -- 172.21.15.123:0/1592454160 >> 172.21.15.123:0/1592454160 conn(0x7f2a540d11c0 msgr2=0x7f2a5406c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:07.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.263+0000 7f2a5b2ba640 1 -- 172.21.15.123:0/1592454160 shutdown_connections 2024-09-15T23:17:07.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.263+0000 7f2a5b2ba640 1 -- 172.21.15.123:0/1592454160 wait complete. 2024-09-15T23:17:07.275 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags' 2024-09-15T23:17:07.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.372+0000 7fc6e91b7640 1 Processor -- start 2024-09-15T23:17:07.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.372+0000 7fc6e91b7640 1 -- start start 2024-09-15T23:17:07.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.373+0000 7fc6e91b7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc6e415ed20 0x7fc6e40b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:07.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.373+0000 7fc6e91b7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6e40d23b0 0x7fc6e40b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:07.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.373+0000 7fc6e91b7640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6e40d0e70 con 0x7fc6e40cf2d0 2024-09-15T23:17:07.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.373+0000 7fc6e91b7640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc6e40d41c0 con 0x7fc6e415ed20 2024-09-15T23:17:07.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.373+0000 7fc6e91b7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc6e40d35b0 con 0x7fc6e40d23b0 2024-09-15T23:17:07.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.373+0000 7fc6e2d9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc6e415ed20 0x7fc6e40b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:07.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.373+0000 7fc6e359e640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc6e40cf2d0 0x7fc6e40cf760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41416/0 (socket says 172.21.15.123:41416) 2024-09-15T23:17:07.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.373+0000 7fc6e359e640 1 -- 172.21.15.123:0/1569574557 learned_addr learned my addr 172.21.15.123:0/1569574557 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:17:07.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.373+0000 7fc6e2d9d640 1 --2- 172.21.15.123:0/1569574557 >> v2:172.21.15.123:3300/0 conn(0x7fc6e415ed20 0x7fc6e40b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56210/0 (socket says 172.21.15.123:56210) 2024-09-15T23:17:07.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.374+0000 7fc6e259c640 1 --2- 172.21.15.123:0/1569574557 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6e40d23b0 0x7fc6e40b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:07.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.374+0000 7fc6e2d9d640 1 -- 172.21.15.123:0/1569574557 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6e40d23b0 msgr2=0x7fc6e40b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:07.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.374+0000 7fc6e2d9d640 1 --2- 172.21.15.123:0/1569574557 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6e40d23b0 0x7fc6e40b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:07.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.374+0000 7fc6e2d9d640 1 -- 172.21.15.123:0/1569574557 >> v1:172.21.15.123:6789/0 conn(0x7fc6e40cf2d0 legacy=0x7fc6e40cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:07.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.374+0000 7fc6e2d9d640 1 -- 172.21.15.123:0/1569574557 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6e40d3890 con 0x7fc6e415ed20 2024-09-15T23:17:07.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.374+0000 7fc6e1d9b640 1 -- 172.21.15.123:0/1569574557 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 621376790 0 0) 0x7fc6dc001110 con 0x7fc6e40cf2d0 2024-09-15T23:17:07.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.374+0000 7fc6e259c640 1 --2- 172.21.15.123:0/1569574557 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6e40d23b0 0x7fc6e40b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:17:07.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.374+0000 7fc6e2d9d640 1 --2- 172.21.15.123:0/1569574557 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6e415ed20 0x7fc6e40b6260 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4009d90 tx=0x7fc6d402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc31ca7a810498da server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:07.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.375+0000 7fc6e1d9b640 1 -- 172.21.15.123:0/1569574557 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d4007740 con 0x7fc6e415ed20 2024-09-15T23:17:07.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.375+0000 7fc6e1d9b640 1 -- 172.21.15.123:0/1569574557 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d40078e0 con 0x7fc6e415ed20 2024-09-15T23:17:07.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.375+0000 7fc6e1d9b640 1 -- 172.21.15.123:0/1569574557 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d4007cb0 con 0x7fc6e415ed20 2024-09-15T23:17:07.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.375+0000 7fc6e91b7640 1 -- 172.21.15.123:0/1569574557 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6e415ed20 msgr2=0x7fc6e40b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:07.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.375+0000 7fc6e91b7640 1 --2- 172.21.15.123:0/1569574557 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6e415ed20 0x7fc6e40b6260 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4009d90 tx=0x7fc6d402a660 comp rx=0 tx=0).stop 2024-09-15T23:17:07.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.375+0000 7fc6e91b7640 1 -- 172.21.15.123:0/1569574557 shutdown_connections 2024-09-15T23:17:07.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.375+0000 7fc6e91b7640 1 --2- 172.21.15.123:0/1569574557 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6e40d23b0 0x7fc6e40b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:07.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.375+0000 7fc6e91b7640 1 --2- 172.21.15.123:0/1569574557 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6e415ed20 0x7fc6e40b6260 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:07.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.375+0000 7fc6e91b7640 1 -- 172.21.15.123:0/1569574557 >> 172.21.15.123:0/1569574557 conn(0x7fc6e40d1260 msgr2=0x7fc6e40d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:07.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.375+0000 7fc6e91b7640 1 -- 172.21.15.123:0/1569574557 shutdown_connections 2024-09-15T23:17:07.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.375+0000 7fc6e91b7640 1 -- 172.21.15.123:0/1569574557 wait complete. 2024-09-15T23:17:07.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.377+0000 7fc6e91b7640 1 Processor -- start 2024-09-15T23:17:07.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.377+0000 7fc6e91b7640 1 -- start start 2024-09-15T23:17:07.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.377+0000 7fc6e91b7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6e40cf2d0 0x7fc6e4154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:07.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.377+0000 7fc6e91b7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6e40d23b0 0x7fc6e41e8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:07.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.377+0000 7fc6e91b7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6e415ed20 0x7fc6e40cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:07.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.377+0000 7fc6e91b7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e40d32a0 con 0x7fc6e40cf2d0 2024-09-15T23:17:07.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.377+0000 7fc6e91b7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc6e40d3e50 con 0x7fc6e40d23b0 2024-09-15T23:17:07.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.377+0000 7fc6e91b7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc6e415f100 con 0x7fc6e415ed20 2024-09-15T23:17:07.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.377+0000 7fc6e2d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6e40cf2d0 0x7fc6e4154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:07.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.377+0000 7fc6e2d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6e40cf2d0 0x7fc6e4154e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56212/0 (socket says 172.21.15.123:56212) 2024-09-15T23:17:07.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.377+0000 7fc6e2d9d640 1 -- 172.21.15.123:0/681782288 learned_addr learned my addr 172.21.15.123:0/681782288 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:07.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.378+0000 7fc6e359e640 1 --2- 172.21.15.123:0/681782288 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6e415ed20 0x7fc6e40cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:07.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.378+0000 7fc6e259c640 1 --2- 172.21.15.123:0/681782288 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6e40d23b0 0x7fc6e41e8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:07.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.378+0000 7fc6e2d9d640 1 -- 172.21.15.123:0/681782288 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6e415ed20 msgr2=0x7fc6e40cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:07.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.378+0000 7fc6e2d9d640 1 --2- 172.21.15.123:0/681782288 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6e415ed20 0x7fc6e40cb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:07.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.378+0000 7fc6e2d9d640 1 -- 172.21.15.123:0/681782288 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6e40d23b0 msgr2=0x7fc6e41e8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:07.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.378+0000 7fc6e2d9d640 1 --2- 172.21.15.123:0/681782288 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6e40d23b0 0x7fc6e41e8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:07.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.378+0000 7fc6e2d9d640 1 -- 172.21.15.123:0/681782288 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6e40cc750 con 0x7fc6e40cf2d0 2024-09-15T23:17:07.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.378+0000 7fc6e259c640 1 --2- 172.21.15.123:0/681782288 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6e40d23b0 0x7fc6e41e8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:17:07.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.378+0000 7fc6e359e640 1 --2- 172.21.15.123:0/681782288 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6e415ed20 0x7fc6e40cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:17:07.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.378+0000 7fc6e2d9d640 1 --2- 172.21.15.123:0/681782288 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6e40cf2d0 0x7fc6e4154e10 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4009d90 tx=0x7fc6d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:07.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.378+0000 7fc6cb7fe640 1 -- 172.21.15.123:0/681782288 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d403f070 con 0x7fc6e40cf2d0 2024-09-15T23:17:07.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.378+0000 7fc6cb7fe640 1 -- 172.21.15.123:0/681782288 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d4031c40 con 0x7fc6e40cf2d0 2024-09-15T23:17:07.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.378+0000 7fc6e91b7640 1 -- 172.21.15.123:0/681782288 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6e40cca30 con 0x7fc6e40cf2d0 2024-09-15T23:17:07.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.378+0000 7fc6cb7fe640 1 -- 172.21.15.123:0/681782288 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d4043410 con 0x7fc6e40cf2d0 2024-09-15T23:17:07.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.378+0000 7fc6e91b7640 1 -- 172.21.15.123:0/681782288 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6e41e8c70 con 0x7fc6e40cf2d0 2024-09-15T23:17:07.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.379+0000 7fc6e91b7640 1 -- 172.21.15.123:0/681782288 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6e40b7010 con 0x7fc6e40cf2d0 2024-09-15T23:17:07.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.380+0000 7fc6cb7fe640 1 -- 172.21.15.123:0/681782288 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc6d40435b0 con 0x7fc6e40cf2d0 2024-09-15T23:17:07.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.380+0000 7fc6cb7fe640 1 --2- 172.21.15.123:0/681782288 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc6d006c2b0 0x7fc6d006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:07.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.380+0000 7fc6cb7fe640 1 -- 172.21.15.123:0/681782288 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5029+0+0 (secure 0 0 0) 0x7fc6d40ac6f0 con 0x7fc6e40cf2d0 2024-09-15T23:17:07.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.381+0000 7fc6e259c640 1 --2- 172.21.15.123:0/681782288 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc6d006c2b0 0x7fc6d006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:07.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.381+0000 7fc6e259c640 1 --2- 172.21.15.123:0/681782288 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc6d006c2b0 0x7fc6d006e770 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc6e41557e0 tx=0x7fc6d8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:07.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.384+0000 7fc6cb7fe640 1 -- 172.21.15.123:0/681782288 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc6d407b190 con 0x7fc6e40cf2d0 2024-09-15T23:17:07.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:07.615+0000 7fc6e91b7640 1 -- 172.21.15.123:0/681782288 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]} v 0) -- 0x7fc6e40b3f20 con 0x7fc6e40cf2d0 2024-09-15T23:17:08.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.063+0000 7fc6cb7fe640 1 -- 172.21.15.123:0/681782288 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_split_dirfrags"]}]=0 v263) ==== 151+0+0 (secure 0 0 0) 0x7fc6d407aa90 con 0x7fc6e40cf2d0 2024-09-15T23:17:08.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.066+0000 7fc6e91b7640 1 -- 172.21.15.123:0/681782288 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc6d006c2b0 msgr2=0x7fc6d006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:08.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.066+0000 7fc6e91b7640 1 --2- 172.21.15.123:0/681782288 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc6d006c2b0 0x7fc6d006e770 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc6e41557e0 tx=0x7fc6d8008040 comp rx=0 tx=0).stop 2024-09-15T23:17:08.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.066+0000 7fc6e91b7640 1 -- 172.21.15.123:0/681782288 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6e40cf2d0 msgr2=0x7fc6e4154e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:08.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.066+0000 7fc6e91b7640 1 --2- 172.21.15.123:0/681782288 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6e40cf2d0 0x7fc6e4154e10 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4009d90 tx=0x7fc6d4004a40 comp rx=0 tx=0).stop 2024-09-15T23:17:08.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.066+0000 7fc6e91b7640 1 -- 172.21.15.123:0/681782288 shutdown_connections 2024-09-15T23:17:08.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.066+0000 7fc6e91b7640 1 --2- 172.21.15.123:0/681782288 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6e415ed20 0x7fc6e40cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:08.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.066+0000 7fc6e91b7640 1 --2- 172.21.15.123:0/681782288 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6e40d23b0 0x7fc6e41e8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:08.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.066+0000 7fc6e91b7640 1 --2- 172.21.15.123:0/681782288 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc6d006c2b0 0x7fc6d006e770 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:08.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.066+0000 7fc6e91b7640 1 --2- 172.21.15.123:0/681782288 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6e40cf2d0 0x7fc6e4154e10 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:08.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.066+0000 7fc6e91b7640 1 -- 172.21.15.123:0/681782288 >> 172.21.15.123:0/681782288 conn(0x7fc6e40d1260 msgr2=0x7fc6e40d4740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:08.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.066+0000 7fc6e91b7640 1 -- 172.21.15.123:0/681782288 shutdown_connections 2024-09-15T23:17:08.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.066+0000 7fc6e91b7640 1 -- 172.21.15.123:0/681782288 wait complete. 2024-09-15T23:17:08.079 INFO:tasks.cephfs_test_runner:That a directory is split during scrub. ... ok 2024-09-15T23:17:08.079 INFO:tasks.cephfs_test_runner:Starting test: test_stray_evaluation_with_scrub (tasks.cephfs.test_scrub_checks.TestScrubChecks) test that scrub can iterate over ~mdsdir and evaluate strays 2024-09-15T23:17:08.079 INFO:tasks.cephfs_test_runner:test_stray_evaluation_with_scrub (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2024-09-15T23:17:08.079 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:17:08.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.178+0000 7fbc60cc9640 1 Processor -- start 2024-09-15T23:17:08.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.178+0000 7fbc60cc9640 1 -- start start 2024-09-15T23:17:08.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.179+0000 7fbc60cc9640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fbc5c0b2d40 0x7fbc5c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:08.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.179+0000 7fbc60cc9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc5c13eb20 0x7fbc5c06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:08.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.179+0000 7fbc60cc9640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc5c071180 con 0x7fbc5c15bcf0 2024-09-15T23:17:08.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.179+0000 7fbc60cc9640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fbc5c071ab0 con 0x7fbc5c0b2d40 2024-09-15T23:17:08.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.179+0000 7fbc60cc9640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbc5c071460 con 0x7fbc5c13eb20 2024-09-15T23:17:08.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.179+0000 7fbc5a59c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fbc5c0b2d40 0x7fbc5c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:08.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.179+0000 7fbc51d9b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc5c13eb20 0x7fbc5c06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:08.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.179+0000 7fbc5a59c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fbc5c0b2d40 0x7fbc5c06bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:39594/0 (socket says 172.21.15.123:39594) 2024-09-15T23:17:08.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.179+0000 7fbc51d9b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc5c13eb20 0x7fbc5c06c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:55464/0 (socket says 172.21.15.123:55464) 2024-09-15T23:17:08.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.179+0000 7fbc5a59c640 1 -- 172.21.15.123:0/3040719003 learned_addr learned my addr 172.21.15.123:0/3040719003 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:08.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.179+0000 7fbc5a59c640 1 -- 172.21.15.123:0/3040719003 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc5c13eb20 msgr2=0x7fbc5c06c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:08.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.179+0000 7fbc5a59c640 1 --2- 172.21.15.123:0/3040719003 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc5c13eb20 0x7fbc5c06c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:08.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.179+0000 7fbc5a59c640 1 -- 172.21.15.123:0/3040719003 >> v1:172.21.15.188:6789/0 conn(0x7fbc5c15bcf0 legacy=0x7fbc5c15c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:08.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.179+0000 7fbc5a59c640 1 -- 172.21.15.123:0/3040719003 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc5c071740 con 0x7fbc5c0b2d40 2024-09-15T23:17:08.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.179+0000 7fbc59d9b640 1 -- 172.21.15.123:0/3040719003 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 415716037 0 0) 0x7fbc5c071180 con 0x7fbc5c15bcf0 2024-09-15T23:17:08.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.179+0000 7fbc51d9b640 1 --2- 172.21.15.123:0/3040719003 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc5c13eb20 0x7fbc5c06c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:17:08.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.180+0000 7fbc5a59c640 1 --2- 172.21.15.123:0/3040719003 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc5c0b2d40 0x7fbc5c06bc10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c071c30 tx=0x7fbc4c02a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7404568c418ca95d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:08.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.180+0000 7fbc59d9b640 1 -- 172.21.15.123:0/3040719003 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c037070 con 0x7fbc5c0b2d40 2024-09-15T23:17:08.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.180+0000 7fbc59d9b640 1 -- 172.21.15.123:0/3040719003 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc4c032440 con 0x7fbc5c0b2d40 2024-09-15T23:17:08.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.180+0000 7fbc59d9b640 1 -- 172.21.15.123:0/3040719003 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c032810 con 0x7fbc5c0b2d40 2024-09-15T23:17:08.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.181+0000 7fbc60cc9640 1 -- 172.21.15.123:0/3040719003 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc5c0b2d40 msgr2=0x7fbc5c06bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:08.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.181+0000 7fbc60cc9640 1 --2- 172.21.15.123:0/3040719003 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc5c0b2d40 0x7fbc5c06bc10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c071c30 tx=0x7fbc4c02a250 comp rx=0 tx=0).stop 2024-09-15T23:17:08.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.181+0000 7fbc60cc9640 1 -- 172.21.15.123:0/3040719003 shutdown_connections 2024-09-15T23:17:08.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.181+0000 7fbc60cc9640 1 --2- 172.21.15.123:0/3040719003 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc5c13eb20 0x7fbc5c06c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:08.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.181+0000 7fbc60cc9640 1 --2- 172.21.15.123:0/3040719003 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc5c0b2d40 0x7fbc5c06bc10 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:08.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.181+0000 7fbc60cc9640 1 -- 172.21.15.123:0/3040719003 >> 172.21.15.123:0/3040719003 conn(0x7fbc5c0ccec0 msgr2=0x7fbc5c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:08.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.181+0000 7fbc60cc9640 1 -- 172.21.15.123:0/3040719003 shutdown_connections 2024-09-15T23:17:08.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.181+0000 7fbc60cc9640 1 -- 172.21.15.123:0/3040719003 wait complete. 2024-09-15T23:17:08.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.182+0000 7fbc60cc9640 1 Processor -- start 2024-09-15T23:17:08.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.182+0000 7fbc60cc9640 1 -- start start 2024-09-15T23:17:08.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.183+0000 7fbc60cc9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc5c0b2d40 0x7fbc5c13e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:08.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.183+0000 7fbc60cc9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc5c13eb20 0x7fbc5c0c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:08.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.183+0000 7fbc60cc9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc5c15bcf0 0x7fbc5c0c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:08.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.183+0000 7fbc60cc9640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c0722d0 con 0x7fbc5c0b2d40 2024-09-15T23:17:08.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.183+0000 7fbc60cc9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5c072150 con 0x7fbc5c15bcf0 2024-09-15T23:17:08.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.183+0000 7fbc60cc9640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbc5c072450 con 0x7fbc5c13eb20 2024-09-15T23:17:08.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.183+0000 7fbc5a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc5c0b2d40 0x7fbc5c13e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:08.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.183+0000 7fbc5a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc5c0b2d40 0x7fbc5c13e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56222/0 (socket says 172.21.15.123:56222) 2024-09-15T23:17:08.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.183+0000 7fbc5a59c640 1 -- 172.21.15.123:0/1953052670 learned_addr learned my addr 172.21.15.123:0/1953052670 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:08.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.183+0000 7fbc5a59c640 1 -- 172.21.15.123:0/1953052670 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc5c13eb20 msgr2=0x7fbc5c0c5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:08.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.183+0000 7fbc51d9b640 1 --2- 172.21.15.123:0/1953052670 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc5c13eb20 0x7fbc5c0c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:08.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.183+0000 7fbc5ad9d640 1 --2- 172.21.15.123:0/1953052670 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc5c15bcf0 0x7fbc5c0c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:08.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.183+0000 7fbc5a59c640 1 --2- 172.21.15.123:0/1953052670 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc5c13eb20 0x7fbc5c0c5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:08.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.183+0000 7fbc5a59c640 1 -- 172.21.15.123:0/1953052670 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc5c15bcf0 msgr2=0x7fbc5c0c96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:08.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.183+0000 7fbc5a59c640 1 --2- 172.21.15.123:0/1953052670 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc5c15bcf0 0x7fbc5c0c96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:08.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.183+0000 7fbc5a59c640 1 -- 172.21.15.123:0/1953052670 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc5c156130 con 0x7fbc5c0b2d40 2024-09-15T23:17:08.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.184+0000 7fbc5a59c640 1 --2- 172.21.15.123:0/1953052670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc5c0b2d40 0x7fbc5c13e230 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c0090b0 tx=0x7fbc4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:08.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.184+0000 7fbc537fe640 1 -- 172.21.15.123:0/1953052670 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c037040 con 0x7fbc5c0b2d40 2024-09-15T23:17:08.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.184+0000 7fbc537fe640 1 -- 172.21.15.123:0/1953052670 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc4c004230 con 0x7fbc5c0b2d40 2024-09-15T23:17:08.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.184+0000 7fbc60cc9640 1 -- 172.21.15.123:0/1953052670 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc5c156410 con 0x7fbc5c0b2d40 2024-09-15T23:17:08.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.184+0000 7fbc537fe640 1 -- 172.21.15.123:0/1953052670 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c003610 con 0x7fbc5c0b2d40 2024-09-15T23:17:08.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.184+0000 7fbc60cc9640 1 -- 172.21.15.123:0/1953052670 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc5c0c6330 con 0x7fbc5c0b2d40 2024-09-15T23:17:08.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.185+0000 7fbc60cc9640 1 -- 172.21.15.123:0/1953052670 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc5c072840 con 0x7fbc5c0b2d40 2024-09-15T23:17:08.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.185+0000 7fbc537fe640 1 -- 172.21.15.123:0/1953052670 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbc4c0037b0 con 0x7fbc5c0b2d40 2024-09-15T23:17:08.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.186+0000 7fbc537fe640 1 --2- 172.21.15.123:0/1953052670 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbc3c06c2b0 0x7fbc3c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:08.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.186+0000 7fbc537fe640 1 -- 172.21.15.123:0/1953052670 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5029+0+0 (secure 0 0 0) 0x7fbc4c0abed0 con 0x7fbc5c0b2d40 2024-09-15T23:17:08.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.186+0000 7fbc51d9b640 1 --2- 172.21.15.123:0/1953052670 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbc3c06c2b0 0x7fbc3c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:08.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.186+0000 7fbc51d9b640 1 --2- 172.21.15.123:0/1953052670 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbc3c06c2b0 0x7fbc3c06e770 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c13e770 tx=0x7fbc44008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:08.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.190+0000 7fbc537fe640 1 -- 172.21.15.123:0/1953052670 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbc4c07a970 con 0x7fbc5c0b2d40 2024-09-15T23:17:08.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.355+0000 7fbc60cc9640 1 -- 172.21.15.123:0/1953052670 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbc5c06c9c0 con 0x7fbc5c0b2d40 2024-09-15T23:17:08.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.356+0000 7fbc537fe640 1 -- 172.21.15.123:0/1953052670 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) ==== 74+0+13192 (secure 0 0 0) 0x7fbc4c07a270 con 0x7fbc5c0b2d40 2024-09-15T23:17:08.358 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:17:08.358 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":105,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:17:06.057001+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6835/2621254224":"2024-09-16T23:17:03.049334+0000","172.21.15.123:6834/2621254224":"2024-09-16T23:17:03.049334+0000","172.21.15.188:6837/2840550551":"2024-09-16T23:16:47.812432+0000","172.21.15.188:6835/2840550551":"2024-09-16T23:16:47.812432+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:17:08.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.358+0000 7fbc60cc9640 1 -- 172.21.15.123:0/1953052670 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbc3c06c2b0 msgr2=0x7fbc3c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:08.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.358+0000 7fbc60cc9640 1 --2- 172.21.15.123:0/1953052670 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbc3c06c2b0 0x7fbc3c06e770 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c13e770 tx=0x7fbc44008040 comp rx=0 tx=0).stop 2024-09-15T23:17:08.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.358+0000 7fbc60cc9640 1 -- 172.21.15.123:0/1953052670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc5c0b2d40 msgr2=0x7fbc5c13e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:08.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.358+0000 7fbc60cc9640 1 --2- 172.21.15.123:0/1953052670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc5c0b2d40 0x7fbc5c13e230 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c0090b0 tx=0x7fbc4c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:17:08.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.358+0000 7fbc60cc9640 1 -- 172.21.15.123:0/1953052670 shutdown_connections 2024-09-15T23:17:08.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.358+0000 7fbc60cc9640 1 --2- 172.21.15.123:0/1953052670 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc5c15bcf0 0x7fbc5c0c96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:08.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.358+0000 7fbc60cc9640 1 --2- 172.21.15.123:0/1953052670 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc5c13eb20 0x7fbc5c0c5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:08.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.358+0000 7fbc60cc9640 1 --2- 172.21.15.123:0/1953052670 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbc3c06c2b0 0x7fbc3c06e770 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:08.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.358+0000 7fbc60cc9640 1 --2- 172.21.15.123:0/1953052670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc5c0b2d40 0x7fbc5c13e230 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:08.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.358+0000 7fbc60cc9640 1 -- 172.21.15.123:0/1953052670 >> 172.21.15.123:0/1953052670 conn(0x7fbc5c0ccec0 msgr2=0x7fbc5c072a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:08.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.358+0000 7fbc60cc9640 1 -- 172.21.15.123:0/1953052670 shutdown_connections 2024-09-15T23:17:08.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.358+0000 7fbc60cc9640 1 -- 172.21.15.123:0/1953052670 wait complete. 2024-09-15T23:17:08.372 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T23:12:01.531886+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T23:17:08.373 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T23:17:08.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.474+0000 7f6fb03b7640 1 Processor -- start 2024-09-15T23:17:08.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.474+0000 7f6fb03b7640 1 -- start start 2024-09-15T23:17:08.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.475+0000 7f6fb03b7640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f6fa815b7c0 0x7f6fa80b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:08.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.475+0000 7f6fb03b7640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fa80cf2e0 con 0x7f6fa80ccf30 2024-09-15T23:17:08.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.475+0000 7f6fb03b7640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fa8070fe0 con 0x7f6fa80cead0 2024-09-15T23:17:08.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.475+0000 7f6fb03b7640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f6fa80712c0 con 0x7f6fa815b7c0 2024-09-15T23:17:08.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.475+0000 7f6fae153640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6fa80ccf30 0x7f6fa80cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41428/0 (socket says 172.21.15.123:41428) 2024-09-15T23:17:08.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.475+0000 7f6fae153640 1 -- 172.21.15.123:0/2399537165 learned_addr learned my addr 172.21.15.123:0/2399537165 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:17:08.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.475+0000 7f6fad952640 1 --2- 172.21.15.123:0/2399537165 >> v2:172.21.15.188:3300/0 conn(0x7f6fa815b7c0 0x7f6fa80b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:08.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.475+0000 7f6fad151640 1 -- 172.21.15.123:0/2399537165 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 727017026 0 0) 0x7f6fa80cf2e0 con 0x7f6fa80ccf30 2024-09-15T23:17:08.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.475+0000 7f6fad151640 1 -- 172.21.15.123:0/2399537165 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f94003520 con 0x7f6fa80ccf30 2024-09-15T23:17:08.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.475+0000 7f6fad952640 1 -- 172.21.15.123:0/2399537165 >> v1:172.21.15.188:6789/0 conn(0x7f6fa80cead0 legacy=0x7f6fa8071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:08.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.475+0000 7f6fad151640 1 -- 172.21.15.123:0/2399537165 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2500283129 0 0) 0x7f6f94003520 con 0x7f6fa80ccf30 2024-09-15T23:17:08.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.476+0000 7f6fad952640 1 -- 172.21.15.123:0/2399537165 >> v1:172.21.15.123:6789/0 conn(0x7f6fa80ccf30 legacy=0x7f6fa80cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:08.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.476+0000 7f6fad952640 1 -- 172.21.15.123:0/2399537165 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fa80715a0 con 0x7f6fa815b7c0 2024-09-15T23:17:08.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.476+0000 7f6fad952640 1 --2- 172.21.15.123:0/2399537165 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6fa815b7c0 0x7f6fa80b2c50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6f980097a0 tx=0x7f6f9802a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be58e8d084d8ce35 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:08.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.476+0000 7f6fad151640 1 -- 172.21.15.123:0/2399537165 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f98037070 con 0x7f6fa815b7c0 2024-09-15T23:17:08.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.477+0000 7f6fad151640 1 -- 172.21.15.123:0/2399537165 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f9802abc0 con 0x7f6fa815b7c0 2024-09-15T23:17:08.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.477+0000 7f6fad151640 1 -- 172.21.15.123:0/2399537165 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa4001670 con 0x7f6fa815b7c0 2024-09-15T23:17:08.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.477+0000 7f6fb03b7640 1 -- 172.21.15.123:0/2399537165 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6fa815b7c0 msgr2=0x7f6fa80b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:08.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.477+0000 7f6fb03b7640 1 --2- 172.21.15.123:0/2399537165 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6fa815b7c0 0x7f6fa80b2c50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6f980097a0 tx=0x7f6f9802a130 comp rx=0 tx=0).stop 2024-09-15T23:17:08.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.477+0000 7f6fb03b7640 1 -- 172.21.15.123:0/2399537165 shutdown_connections 2024-09-15T23:17:08.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.477+0000 7f6fb03b7640 1 --2- 172.21.15.123:0/2399537165 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6fa815b7c0 0x7f6fa80b2c50 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:08.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.477+0000 7f6fb03b7640 1 -- 172.21.15.123:0/2399537165 >> 172.21.15.123:0/2399537165 conn(0x7f6fa806d0f0 msgr2=0x7f6fa806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:08.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.477+0000 7f6fb03b7640 1 -- 172.21.15.123:0/2399537165 shutdown_connections 2024-09-15T23:17:08.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.477+0000 7f6fb03b7640 1 -- 172.21.15.123:0/2399537165 wait complete. 2024-09-15T23:17:08.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.478+0000 7f6fb03b7640 1 Processor -- start 2024-09-15T23:17:08.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.478+0000 7f6fb03b7640 1 -- start start 2024-09-15T23:17:08.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.479+0000 7f6fb03b7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa80ccf30 0x7f6fa81522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:08.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.479+0000 7f6fb03b7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6fa80cead0 0x7f6fa806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:08.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.479+0000 7f6fb03b7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6fa815b7c0 0x7f6fa814e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:08.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.479+0000 7f6fb03b7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa80cf080 con 0x7f6fa80ccf30 2024-09-15T23:17:08.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.479+0000 7f6fb03b7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa80cef00 con 0x7f6fa80cead0 2024-09-15T23:17:08.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.479+0000 7f6fb03b7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6fa80721d0 con 0x7f6fa815b7c0 2024-09-15T23:17:08.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.479+0000 7f6fae153640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa80ccf30 0x7f6fa81522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:08.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.479+0000 7f6fae153640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa80ccf30 0x7f6fa81522b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56224/0 (socket says 172.21.15.123:56224) 2024-09-15T23:17:08.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.479+0000 7f6fae153640 1 -- 172.21.15.123:0/3032173137 learned_addr learned my addr 172.21.15.123:0/3032173137 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:08.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.479+0000 7f6fad952640 1 --2- 172.21.15.123:0/3032173137 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6fa80cead0 0x7f6fa806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:08.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.479+0000 7f6fae954640 1 --2- 172.21.15.123:0/3032173137 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6fa815b7c0 0x7f6fa814e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:08.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.479+0000 7f6fae153640 1 -- 172.21.15.123:0/3032173137 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6fa815b7c0 msgr2=0x7f6fa814e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:08.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.479+0000 7f6fae153640 1 --2- 172.21.15.123:0/3032173137 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6fa815b7c0 0x7f6fa814e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:08.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.479+0000 7f6fae153640 1 -- 172.21.15.123:0/3032173137 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6fa80cead0 msgr2=0x7f6fa806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:08.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.479+0000 7f6fae153640 1 --2- 172.21.15.123:0/3032173137 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6fa80cead0 0x7f6fa806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:08.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.479+0000 7f6fae153640 1 -- 172.21.15.123:0/3032173137 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fa806c440 con 0x7f6fa80ccf30 2024-09-15T23:17:08.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.480+0000 7f6fae153640 1 --2- 172.21.15.123:0/3032173137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa80ccf30 0x7f6fa81522b0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4001eb0 tx=0x7f6fa400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:08.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.480+0000 7f6f9effd640 1 -- 172.21.15.123:0/3032173137 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa4017070 con 0x7f6fa80ccf30 2024-09-15T23:17:08.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.480+0000 7f6f9effd640 1 -- 172.21.15.123:0/3032173137 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fa4005ad0 con 0x7f6fa80ccf30 2024-09-15T23:17:08.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.480+0000 7f6fb03b7640 1 -- 172.21.15.123:0/3032173137 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fa814fde0 con 0x7f6fa80ccf30 2024-09-15T23:17:08.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.480+0000 7f6f9effd640 1 -- 172.21.15.123:0/3032173137 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa4007070 con 0x7f6fa80ccf30 2024-09-15T23:17:08.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.480+0000 7f6fb03b7640 1 -- 172.21.15.123:0/3032173137 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fa81503a0 con 0x7f6fa80ccf30 2024-09-15T23:17:08.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.481+0000 7f6fb03b7640 1 -- 172.21.15.123:0/3032173137 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fa81505a0 con 0x7f6fa80ccf30 2024-09-15T23:17:08.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.481+0000 7f6f9effd640 1 -- 172.21.15.123:0/3032173137 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6fa401a070 con 0x7f6fa80ccf30 2024-09-15T23:17:08.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.482+0000 7f6f9effd640 1 --2- 172.21.15.123:0/3032173137 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6f8c06c2e0 0x7f6f8c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:08.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.482+0000 7f6f9effd640 1 -- 172.21.15.123:0/3032173137 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5029+0+0 (secure 0 0 0) 0x7f6fa408a6a0 con 0x7f6fa80ccf30 2024-09-15T23:17:08.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.482+0000 7f6fad952640 1 --2- 172.21.15.123:0/3032173137 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6f8c06c2e0 0x7f6f8c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:08.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.483+0000 7f6fad952640 1 --2- 172.21.15.123:0/3032173137 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6f8c06c2e0 0x7f6f8c06e7a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f6f98034000 tx=0x7f6f9802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:08.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.486+0000 7f6f9effd640 1 -- 172.21.15.123:0/3032173137 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6fa81505a0 con 0x7f6fa80ccf30 2024-09-15T23:17:08.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.652+0000 7f6fb03b7640 1 -- 172.21.15.123:0/3032173137 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6fa80b2c50 con 0x7f6fa80ccf30 2024-09-15T23:17:08.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.652+0000 7f6f9effd640 1 -- 172.21.15.123:0/3032173137 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v105) ==== 93+0+10 (secure 0 0 0) 0x7f6fa40590b0 con 0x7f6fa80ccf30 2024-09-15T23:17:08.654 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-15T23:17:08.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.654+0000 7f6fb03b7640 1 -- 172.21.15.123:0/3032173137 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6f8c06c2e0 msgr2=0x7f6f8c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:08.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.654+0000 7f6fb03b7640 1 --2- 172.21.15.123:0/3032173137 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6f8c06c2e0 0x7f6f8c06e7a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f6f98034000 tx=0x7f6f9802e000 comp rx=0 tx=0).stop 2024-09-15T23:17:08.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.654+0000 7f6fb03b7640 1 -- 172.21.15.123:0/3032173137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa80ccf30 msgr2=0x7f6fa81522b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:08.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.654+0000 7f6fb03b7640 1 --2- 172.21.15.123:0/3032173137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa80ccf30 0x7f6fa81522b0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f6fa4001eb0 tx=0x7f6fa400cbe0 comp rx=0 tx=0).stop 2024-09-15T23:17:08.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.654+0000 7f6fb03b7640 1 -- 172.21.15.123:0/3032173137 shutdown_connections 2024-09-15T23:17:08.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.654+0000 7f6fb03b7640 1 --2- 172.21.15.123:0/3032173137 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6fa815b7c0 0x7f6fa814e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:08.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.654+0000 7f6fb03b7640 1 --2- 172.21.15.123:0/3032173137 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6fa80cead0 0x7f6fa806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:08.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.654+0000 7f6fb03b7640 1 --2- 172.21.15.123:0/3032173137 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6f8c06c2e0 0x7f6f8c06e7a0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:08.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.654+0000 7f6fb03b7640 1 --2- 172.21.15.123:0/3032173137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6fa80ccf30 0x7f6fa81522b0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:08.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.654+0000 7f6fb03b7640 1 -- 172.21.15.123:0/3032173137 >> 172.21.15.123:0/3032173137 conn(0x7f6fa806d0f0 msgr2=0x7f6fa815eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:08.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.654+0000 7f6fb03b7640 1 -- 172.21.15.123:0/3032173137 shutdown_connections 2024-09-15T23:17:08.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.654+0000 7f6fb03b7640 1 -- 172.21.15.123:0/3032173137 wait complete. 2024-09-15T23:17:08.662 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:17:08.665 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:17:08.666 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub' 2024-09-15T23:17:08.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.804+0000 7fac4df31640 1 Processor -- start 2024-09-15T23:17:08.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.804+0000 7fac4df31640 1 -- start start 2024-09-15T23:17:08.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.805+0000 7fac4df31640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fac48145ed0 0x7fac480b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:08.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.805+0000 7fac4df31640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac480b5f90 0x7fac480735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:08.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.805+0000 7fac4df31640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac480b4020 con 0x7fac48073180 2024-09-15T23:17:08.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.805+0000 7fac4df31640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fac48073b00 con 0x7fac48145ed0 2024-09-15T23:17:08.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.805+0000 7fac4df31640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fac480b42c0 con 0x7fac480b5f90 2024-09-15T23:17:08.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.805+0000 7fac477fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fac48145ed0 0x7fac480b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:08.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.805+0000 7fac477fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fac48145ed0 0x7fac480b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56234/0 (socket says 172.21.15.123:56234) 2024-09-15T23:17:08.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.805+0000 7fac477fe640 1 -- 172.21.15.123:0/2444271477 learned_addr learned my addr 172.21.15.123:0/2444271477 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:08.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.805+0000 7fac477fe640 1 -- 172.21.15.123:0/2444271477 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac480b5f90 msgr2=0x7fac480735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:08.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.805+0000 7fac477fe640 1 --2- 172.21.15.123:0/2444271477 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac480b5f90 0x7fac480735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:08.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.805+0000 7fac477fe640 1 -- 172.21.15.123:0/2444271477 >> v1:172.21.15.188:6789/0 conn(0x7fac48073180 legacy=0x7fac480b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:08.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.805+0000 7fac477fe640 1 -- 172.21.15.123:0/2444271477 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac480b45a0 con 0x7fac48145ed0 2024-09-15T23:17:08.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.806+0000 7fac477fe640 1 --2- 172.21.15.123:0/2444271477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac48145ed0 0x7fac480b5080 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fac48073c80 tx=0x7fac3002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea5c1edc626f83c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:08.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.806+0000 7fac467fc640 1 -- 172.21.15.123:0/2444271477 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac30037070 con 0x7fac48145ed0 2024-09-15T23:17:08.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.806+0000 7fac467fc640 1 -- 172.21.15.123:0/2444271477 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac30032440 con 0x7fac48145ed0 2024-09-15T23:17:08.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.806+0000 7fac467fc640 1 -- 172.21.15.123:0/2444271477 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac30032810 con 0x7fac48145ed0 2024-09-15T23:17:08.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.806+0000 7fac4df31640 1 -- 172.21.15.123:0/2444271477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac48145ed0 msgr2=0x7fac480b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:08.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.806+0000 7fac4df31640 1 --2- 172.21.15.123:0/2444271477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac48145ed0 0x7fac480b5080 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fac48073c80 tx=0x7fac3002a1e0 comp rx=0 tx=0).stop 2024-09-15T23:17:08.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.806+0000 7fac4df31640 1 -- 172.21.15.123:0/2444271477 shutdown_connections 2024-09-15T23:17:08.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.806+0000 7fac4df31640 1 --2- 172.21.15.123:0/2444271477 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac480b5f90 0x7fac480735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:08.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.806+0000 7fac4df31640 1 --2- 172.21.15.123:0/2444271477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac48145ed0 0x7fac480b5080 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:08.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.806+0000 7fac4df31640 1 -- 172.21.15.123:0/2444271477 >> 172.21.15.123:0/2444271477 conn(0x7fac480ccec0 msgr2=0x7fac480cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:08.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.806+0000 7fac4df31640 1 -- 172.21.15.123:0/2444271477 shutdown_connections 2024-09-15T23:17:08.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.806+0000 7fac4df31640 1 -- 172.21.15.123:0/2444271477 wait complete. 2024-09-15T23:17:08.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.808+0000 7fac4df31640 1 Processor -- start 2024-09-15T23:17:08.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.808+0000 7fac4df31640 1 -- start start 2024-09-15T23:17:08.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.808+0000 7fac4df31640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac48073180 0x7fac481f4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:08.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.808+0000 7fac4df31640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac480b5f90 0x7fac4813d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:08.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.809+0000 7fac4df31640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac48145ed0 0x7fac48156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:08.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.809+0000 7fac4df31640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fac481462b0 con 0x7fac48073180 2024-09-15T23:17:08.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.809+0000 7fac4df31640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fac480b4b60 con 0x7fac480b5f90 2024-09-15T23:17:08.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.809+0000 7fac4df31640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fac48146430 con 0x7fac48145ed0 2024-09-15T23:17:08.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.809+0000 7fac477fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac48073180 0x7fac481f4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:08.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.809+0000 7fac477fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac48073180 0x7fac481f4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56244/0 (socket says 172.21.15.123:56244) 2024-09-15T23:17:08.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.809+0000 7fac477fe640 1 -- 172.21.15.123:0/2860964131 learned_addr learned my addr 172.21.15.123:0/2860964131 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:08.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.809+0000 7fac46ffd640 1 --2- 172.21.15.123:0/2860964131 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac480b5f90 0x7fac4813d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:08.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.809+0000 7fac47fff640 1 --2- 172.21.15.123:0/2860964131 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac48145ed0 0x7fac48156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:08.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.809+0000 7fac477fe640 1 -- 172.21.15.123:0/2860964131 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac48145ed0 msgr2=0x7fac48156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:08.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.809+0000 7fac477fe640 1 --2- 172.21.15.123:0/2860964131 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac48145ed0 0x7fac48156e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:08.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.809+0000 7fac477fe640 1 -- 172.21.15.123:0/2860964131 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac480b5f90 msgr2=0x7fac4813d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:08.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.809+0000 7fac477fe640 1 --2- 172.21.15.123:0/2860964131 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac480b5f90 0x7fac4813d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:08.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.809+0000 7fac477fe640 1 -- 172.21.15.123:0/2860964131 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac48157370 con 0x7fac48073180 2024-09-15T23:17:08.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.809+0000 7fac47fff640 1 --2- 172.21.15.123:0/2860964131 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac48145ed0 0x7fac48156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:17:08.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.809+0000 7fac46ffd640 1 --2- 172.21.15.123:0/2860964131 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac480b5f90 0x7fac4813d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:17:08.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.809+0000 7fac477fe640 1 --2- 172.21.15.123:0/2860964131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac48073180 0x7fac481f4750 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fac30000c00 tx=0x7fac300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:08.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.809+0000 7fac3ffff640 1 -- 172.21.15.123:0/2860964131 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac30041070 con 0x7fac48073180 2024-09-15T23:17:08.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.809+0000 7fac3ffff640 1 -- 172.21.15.123:0/2860964131 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac3003c890 con 0x7fac48073180 2024-09-15T23:17:08.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.809+0000 7fac4df31640 1 -- 172.21.15.123:0/2860964131 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac48157610 con 0x7fac48073180 2024-09-15T23:17:08.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.809+0000 7fac3ffff640 1 -- 172.21.15.123:0/2860964131 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac30037040 con 0x7fac48073180 2024-09-15T23:17:08.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.809+0000 7fac4df31640 1 -- 172.21.15.123:0/2860964131 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac48157bd0 con 0x7fac48073180 2024-09-15T23:17:08.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.810+0000 7fac4df31640 1 -- 172.21.15.123:0/2860964131 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac480735c0 con 0x7fac48073180 2024-09-15T23:17:08.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.811+0000 7fac3ffff640 1 -- 172.21.15.123:0/2860964131 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fac30044070 con 0x7fac48073180 2024-09-15T23:17:08.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.811+0000 7fac3ffff640 1 --2- 172.21.15.123:0/2860964131 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fac2806c2b0 0x7fac2806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:08.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.811+0000 7fac3ffff640 1 -- 172.21.15.123:0/2860964131 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5029+0+0 (secure 0 0 0) 0x7fac300abe80 con 0x7fac48073180 2024-09-15T23:17:08.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.812+0000 7fac46ffd640 1 --2- 172.21.15.123:0/2860964131 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fac2806c2b0 0x7fac2806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:08.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.812+0000 7fac46ffd640 1 --2- 172.21.15.123:0/2860964131 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fac2806c2b0 0x7fac2806e770 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fac48154c90 tx=0x7fac38009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:08.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:08.816+0000 7fac3ffff640 1 -- 172.21.15.123:0/2860964131 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fac3007aa40 con 0x7fac48073180 2024-09-15T23:17:09.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.044+0000 7fac4df31640 1 -- 172.21.15.123:0/2860964131 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]} v 0) -- 0x7fac480cf990 con 0x7fac48073180 2024-09-15T23:17:09.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.064+0000 7fac3ffff640 1 -- 172.21.15.123:0/2860964131 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]}]=0 v264) ==== 161+0+0 (secure 0 0 0) 0x7fac3007a340 con 0x7fac48073180 2024-09-15T23:17:09.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.067+0000 7fac4df31640 1 -- 172.21.15.123:0/2860964131 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fac2806c2b0 msgr2=0x7fac2806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:09.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.067+0000 7fac4df31640 1 --2- 172.21.15.123:0/2860964131 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fac2806c2b0 0x7fac2806e770 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fac48154c90 tx=0x7fac38009040 comp rx=0 tx=0).stop 2024-09-15T23:17:09.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.067+0000 7fac4df31640 1 -- 172.21.15.123:0/2860964131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac48073180 msgr2=0x7fac481f4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:09.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.067+0000 7fac4df31640 1 --2- 172.21.15.123:0/2860964131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac48073180 0x7fac481f4750 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fac30000c00 tx=0x7fac300046c0 comp rx=0 tx=0).stop 2024-09-15T23:17:09.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.067+0000 7fac4df31640 1 -- 172.21.15.123:0/2860964131 shutdown_connections 2024-09-15T23:17:09.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.067+0000 7fac4df31640 1 --2- 172.21.15.123:0/2860964131 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac48145ed0 0x7fac48156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:09.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.067+0000 7fac4df31640 1 --2- 172.21.15.123:0/2860964131 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac480b5f90 0x7fac4813d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:09.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.067+0000 7fac4df31640 1 --2- 172.21.15.123:0/2860964131 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fac2806c2b0 0x7fac2806e770 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:09.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.067+0000 7fac4df31640 1 --2- 172.21.15.123:0/2860964131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac48073180 0x7fac481f4750 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:09.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.067+0000 7fac4df31640 1 -- 172.21.15.123:0/2860964131 >> 172.21.15.123:0/2860964131 conn(0x7fac480ccec0 msgr2=0x7fac480cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:09.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.067+0000 7fac4df31640 1 -- 172.21.15.123:0/2860964131 shutdown_connections 2024-09-15T23:17:09.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.067+0000 7fac4df31640 1 -- 172.21.15.123:0/2860964131 wait complete. 2024-09-15T23:17:09.079 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T23:17:09.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.179+0000 7f38bfed0640 1 Processor -- start 2024-09-15T23:17:09.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.180+0000 7f38bfed0640 1 -- start start 2024-09-15T23:17:09.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.180+0000 7f38bfed0640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f38b80d3040 0x7f38b8162d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:09.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.180+0000 7f38bfed0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f38b8071160 0x7f38b806cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:09.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.180+0000 7f38bfed0640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38b815ec10 con 0x7f38b80b6e00 2024-09-15T23:17:09.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.180+0000 7f38bfed0640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f38b80d3480 con 0x7f38b80d3040 2024-09-15T23:17:09.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.180+0000 7f38bfed0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f38b806e7f0 con 0x7f38b8071160 2024-09-15T23:17:09.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.181+0000 7f38bd46b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f38b80d3040 0x7f38b8162d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:09.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.181+0000 7f38be46d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f38b8071160 0x7f38b806cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:09.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.181+0000 7f38bdc6c640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f38b80b6e00 0x7f38b80b71e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:48982/0 (socket says 172.21.15.123:48982) 2024-09-15T23:17:09.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.181+0000 7f38bdc6c640 1 -- 172.21.15.123:0/1488118938 learned_addr learned my addr 172.21.15.123:0/1488118938 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:17:09.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.181+0000 7f38be46d640 1 --2- 172.21.15.123:0/1488118938 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f38b8071160 0x7f38b806cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:55516/0 (socket says 172.21.15.123:55516) 2024-09-15T23:17:09.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.181+0000 7f38bd46b640 1 -- 172.21.15.123:0/1488118938 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f38b8071160 msgr2=0x7f38b806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:09.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.181+0000 7f38bd46b640 1 --2- 172.21.15.123:0/1488118938 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f38b8071160 0x7f38b806cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:09.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.181+0000 7f38bd46b640 1 -- 172.21.15.123:0/1488118938 >> v1:172.21.15.188:6789/0 conn(0x7f38b80b6e00 legacy=0x7f38b80b71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:09.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.181+0000 7f38bd46b640 1 -- 172.21.15.123:0/1488118938 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b806ed20 con 0x7f38b80d3040 2024-09-15T23:17:09.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.181+0000 7f38be46d640 1 --2- 172.21.15.123:0/1488118938 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f38b8071160 0x7f38b806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:17:09.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.182+0000 7f38bd46b640 1 --2- 172.21.15.123:0/1488118938 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f38b80d3040 0x7f38b8162d90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f38a80097a0 tx=0x7f38a802a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54d9891dd80d5a4e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:09.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.182+0000 7f38bcc6a640 1 -- 172.21.15.123:0/1488118938 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a8037070 con 0x7f38b80d3040 2024-09-15T23:17:09.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.182+0000 7f38bcc6a640 1 -- 172.21.15.123:0/1488118938 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38a802adb0 con 0x7f38b80d3040 2024-09-15T23:17:09.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.182+0000 7f38bcc6a640 1 -- 172.21.15.123:0/1488118938 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a8032660 con 0x7f38b80d3040 2024-09-15T23:17:09.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.183+0000 7f38bfed0640 1 -- 172.21.15.123:0/1488118938 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f38b80d3040 msgr2=0x7f38b8162d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:09.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.183+0000 7f38bfed0640 1 --2- 172.21.15.123:0/1488118938 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f38b80d3040 0x7f38b8162d90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f38a80097a0 tx=0x7f38a802a060 comp rx=0 tx=0).stop 2024-09-15T23:17:09.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.183+0000 7f38bfed0640 1 -- 172.21.15.123:0/1488118938 shutdown_connections 2024-09-15T23:17:09.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.183+0000 7f38bfed0640 1 --2- 172.21.15.123:0/1488118938 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f38b80d3040 0x7f38b8162d90 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:09.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.183+0000 7f38bfed0640 1 --2- 172.21.15.123:0/1488118938 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f38b8071160 0x7f38b806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:09.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.183+0000 7f38bfed0640 1 -- 172.21.15.123:0/1488118938 >> 172.21.15.123:0/1488118938 conn(0x7f38b80d2550 msgr2=0x7f38b80d2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:09.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.183+0000 7f38bfed0640 1 -- 172.21.15.123:0/1488118938 shutdown_connections 2024-09-15T23:17:09.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.183+0000 7f38bfed0640 1 -- 172.21.15.123:0/1488118938 wait complete. 2024-09-15T23:17:09.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.184+0000 7f38bfed0640 1 Processor -- start 2024-09-15T23:17:09.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.184+0000 7f38bfed0640 1 -- start start 2024-09-15T23:17:09.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.185+0000 7f38bfed0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38b8071160 0x7f38b8153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:09.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.185+0000 7f38bfed0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f38b80b6e00 0x7f38b806f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:09.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.185+0000 7f38bfed0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f38b80d3040 0x7f38b806fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:09.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.185+0000 7f38bfed0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f38b8070c40 con 0x7f38b8071160 2024-09-15T23:17:09.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.185+0000 7f38bfed0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f38b8070960 con 0x7f38b80d3040 2024-09-15T23:17:09.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.185+0000 7f38bfed0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f38b80d1a70 con 0x7f38b80b6e00 2024-09-15T23:17:09.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.185+0000 7f38bdc6c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38b8071160 0x7f38b8153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:09.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.185+0000 7f38bdc6c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38b8071160 0x7f38b8153180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56260/0 (socket says 172.21.15.123:56260) 2024-09-15T23:17:09.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.185+0000 7f38bdc6c640 1 -- 172.21.15.123:0/1742839273 learned_addr learned my addr 172.21.15.123:0/1742839273 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:09.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.185+0000 7f38bd46b640 1 --2- 172.21.15.123:0/1742839273 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f38b80b6e00 0x7f38b806f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:09.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.185+0000 7f38be46d640 1 --2- 172.21.15.123:0/1742839273 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f38b80d3040 0x7f38b806fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:09.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.185+0000 7f38bdc6c640 1 -- 172.21.15.123:0/1742839273 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f38b80b6e00 msgr2=0x7f38b806f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:09.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.185+0000 7f38bdc6c640 1 --2- 172.21.15.123:0/1742839273 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f38b80b6e00 0x7f38b806f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:09.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.185+0000 7f38bdc6c640 1 -- 172.21.15.123:0/1742839273 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f38b80d3040 msgr2=0x7f38b806fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:09.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.185+0000 7f38bdc6c640 1 --2- 172.21.15.123:0/1742839273 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f38b80d3040 0x7f38b806fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:09.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.185+0000 7f38bdc6c640 1 -- 172.21.15.123:0/1742839273 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b81f7df0 con 0x7f38b8071160 2024-09-15T23:17:09.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.185+0000 7f38be46d640 1 --2- 172.21.15.123:0/1742839273 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f38b80d3040 0x7f38b806fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:17:09.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.185+0000 7f38bd46b640 1 --2- 172.21.15.123:0/1742839273 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f38b80b6e00 0x7f38b806f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:17:09.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.186+0000 7f38bdc6c640 1 --2- 172.21.15.123:0/1742839273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38b8071160 0x7f38b8153180 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f38b400c400 tx=0x7f38b400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:09.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.186+0000 7f38ae7fc640 1 -- 172.21.15.123:0/1742839273 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b4017070 con 0x7f38b8071160 2024-09-15T23:17:09.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.186+0000 7f38ae7fc640 1 -- 172.21.15.123:0/1742839273 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38b4005ce0 con 0x7f38b8071160 2024-09-15T23:17:09.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.186+0000 7f38bfed0640 1 -- 172.21.15.123:0/1742839273 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38b81f80d0 con 0x7f38b8071160 2024-09-15T23:17:09.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.186+0000 7f38ae7fc640 1 -- 172.21.15.123:0/1742839273 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b40072f0 con 0x7f38b8071160 2024-09-15T23:17:09.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.186+0000 7f38bfed0640 1 -- 172.21.15.123:0/1742839273 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38b81f8690 con 0x7f38b8071160 2024-09-15T23:17:09.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.187+0000 7f38bfed0640 1 -- 172.21.15.123:0/1742839273 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38b80715f0 con 0x7f38b8071160 2024-09-15T23:17:09.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.187+0000 7f38ae7fc640 1 -- 172.21.15.123:0/1742839273 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f38b401a070 con 0x7f38b8071160 2024-09-15T23:17:09.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.188+0000 7f38ae7fc640 1 --2- 172.21.15.123:0/1742839273 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f389c06c2b0 0x7f389c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:09.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.188+0000 7f38ae7fc640 1 -- 172.21.15.123:0/1742839273 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5029+0+0 (secure 0 0 0) 0x7f38b408a5c0 con 0x7f38b8071160 2024-09-15T23:17:09.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.188+0000 7f38bd46b640 1 --2- 172.21.15.123:0/1742839273 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f389c06c2b0 0x7f389c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:09.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.189+0000 7f38bd46b640 1 --2- 172.21.15.123:0/1742839273 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f389c06c2b0 0x7f389c06e770 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f38a8034000 tx=0x7f38a802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:09.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.192+0000 7f38ae7fc640 1 -- 172.21.15.123:0/1742839273 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f38b4058fd0 con 0x7f38b8071160 2024-09-15T23:17:09.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.360+0000 7f38bfed0640 1 -- 172.21.15.123:0/1742839273 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f38b81f8860 con 0x7f38b8071160 2024-09-15T23:17:09.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.365+0000 7f38ae7fc640 1 -- 172.21.15.123:0/1742839273 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) ==== 122+0+0 (secure 0 0 0) 0x7f38b408a030 con 0x7f38b8071160 2024-09-15T23:17:09.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.368+0000 7f38bfed0640 1 -- 172.21.15.123:0/1742839273 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f389c06c2b0 msgr2=0x7f389c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:09.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.368+0000 7f38bfed0640 1 --2- 172.21.15.123:0/1742839273 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f389c06c2b0 0x7f389c06e770 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f38a8034000 tx=0x7f38a802e000 comp rx=0 tx=0).stop 2024-09-15T23:17:09.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.368+0000 7f38bfed0640 1 -- 172.21.15.123:0/1742839273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38b8071160 msgr2=0x7f38b8153180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:09.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.368+0000 7f38bfed0640 1 --2- 172.21.15.123:0/1742839273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38b8071160 0x7f38b8153180 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f38b400c400 tx=0x7f38b400c8c0 comp rx=0 tx=0).stop 2024-09-15T23:17:09.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.368+0000 7f38bfed0640 1 -- 172.21.15.123:0/1742839273 shutdown_connections 2024-09-15T23:17:09.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.368+0000 7f38bfed0640 1 --2- 172.21.15.123:0/1742839273 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f38b80d3040 0x7f38b806fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:09.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.368+0000 7f38bfed0640 1 --2- 172.21.15.123:0/1742839273 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f38b80b6e00 0x7f38b806f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:09.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.368+0000 7f38bfed0640 1 --2- 172.21.15.123:0/1742839273 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f389c06c2b0 0x7f389c06e770 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:09.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.368+0000 7f38bfed0640 1 --2- 172.21.15.123:0/1742839273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38b8071160 0x7f38b8153180 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:09.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.368+0000 7f38bfed0640 1 -- 172.21.15.123:0/1742839273 >> 172.21.15.123:0/1742839273 conn(0x7f38b80d2550 msgr2=0x7f38b80d0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:09.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.368+0000 7f38bfed0640 1 -- 172.21.15.123:0/1742839273 shutdown_connections 2024-09-15T23:17:09.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.368+0000 7f38bfed0640 1 -- 172.21.15.123:0/1742839273 wait complete. 2024-09-15T23:17:09.380 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:17:09.380 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:17:09.418 DEBUG:teuthology.orchestra.run.smithi188:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:17:09.470 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:17:09.471 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:17:09.471 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:17:09.487 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:17:09.487 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:17:09.487 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:17:09.505 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:17:09.505 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:17:09.505 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:17:09.542 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:17:09.543 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:17:09.543 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:17:09.562 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:17:09.562 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-15T23:17:09.563 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:17:09.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.681+0000 7f30b4759640 1 Processor -- start 2024-09-15T23:17:09.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.681+0000 7f30b4759640 1 -- start start 2024-09-15T23:17:09.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.682+0000 7f30b4759640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f30ac0b6970 0x7f30ac0b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:09.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.682+0000 7f30b4759640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30ac0d0e70 con 0x7f30ac15ed20 2024-09-15T23:17:09.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.682+0000 7f30b4759640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30ac0d41c0 con 0x7f30ac0d23b0 2024-09-15T23:17:09.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.682+0000 7f30b4759640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f30ac0d35b0 con 0x7f30ac0b6970 2024-09-15T23:17:09.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.682+0000 7f30b24f5640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f30ac15ed20 0x7f30ac0b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41440/0 (socket says 172.21.15.123:41440) 2024-09-15T23:17:09.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.682+0000 7f30b1cf4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f30ac0b6970 0x7f30ac0b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:09.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.682+0000 7f30b24f5640 1 -- 172.21.15.123:0/4003744180 learned_addr learned my addr 172.21.15.123:0/4003744180 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:17:09.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.682+0000 7f30b1cf4640 1 -- 172.21.15.123:0/4003744180 >> v1:172.21.15.188:6789/0 conn(0x7f30ac0d23b0 legacy=0x7f30ac0b8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:09.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.682+0000 7f30b1cf4640 1 -- 172.21.15.123:0/4003744180 >> v1:172.21.15.123:6789/0 conn(0x7f30ac15ed20 legacy=0x7f30ac0b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:09.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.682+0000 7f30b1cf4640 1 -- 172.21.15.123:0/4003744180 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30ac0d3890 con 0x7f30ac0b6970 2024-09-15T23:17:09.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.683+0000 7f30b1cf4640 1 --2- 172.21.15.123:0/4003744180 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30ac0b6970 0x7f30ac0b80d0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f309c0097a0 tx=0x7f309c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b767fa04b9019dc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:09.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.683+0000 7f30b14f3640 1 -- 172.21.15.123:0/4003744180 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c037070 con 0x7f30ac0b6970 2024-09-15T23:17:09.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.683+0000 7f30b14f3640 1 -- 172.21.15.123:0/4003744180 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f309c02ae50 con 0x7f30ac0b6970 2024-09-15T23:17:09.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.683+0000 7f30b14f3640 1 -- 172.21.15.123:0/4003744180 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309c032660 con 0x7f30ac0b6970 2024-09-15T23:17:09.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.684+0000 7f30b4759640 1 -- 172.21.15.123:0/4003744180 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30ac0b6970 msgr2=0x7f30ac0b80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:09.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.684+0000 7f30b4759640 1 --2- 172.21.15.123:0/4003744180 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30ac0b6970 0x7f30ac0b80d0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f309c0097a0 tx=0x7f309c02a140 comp rx=0 tx=0).stop 2024-09-15T23:17:09.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.684+0000 7f30b4759640 1 -- 172.21.15.123:0/4003744180 shutdown_connections 2024-09-15T23:17:09.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.684+0000 7f30b4759640 1 --2- 172.21.15.123:0/4003744180 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30ac0b6970 0x7f30ac0b80d0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:09.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.684+0000 7f30b4759640 1 -- 172.21.15.123:0/4003744180 >> 172.21.15.123:0/4003744180 conn(0x7f30ac0d1260 msgr2=0x7f30ac0d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:09.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.684+0000 7f30b4759640 1 -- 172.21.15.123:0/4003744180 shutdown_connections 2024-09-15T23:17:09.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.684+0000 7f30b4759640 1 -- 172.21.15.123:0/4003744180 wait complete. 2024-09-15T23:17:09.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.685+0000 7f30b4759640 1 Processor -- start 2024-09-15T23:17:09.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.685+0000 7f30b4759640 1 -- start start 2024-09-15T23:17:09.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.686+0000 7f30b4759640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30ac0b6970 0x7f30ac154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:09.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.686+0000 7f30b4759640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30ac0d23b0 0x7f30ac0cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:09.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.686+0000 7f30b4759640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30ac15ed20 0x7f30ac0cd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:09.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.686+0000 7f30b4759640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac0d32a0 con 0x7f30ac0b6970 2024-09-15T23:17:09.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.686+0000 7f30b4759640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac0d3e50 con 0x7f30ac15ed20 2024-09-15T23:17:09.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.686+0000 7f30b4759640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f30ac15f100 con 0x7f30ac0d23b0 2024-09-15T23:17:09.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.686+0000 7f30b24f5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30ac0b6970 0x7f30ac154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:09.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.686+0000 7f30b24f5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30ac0b6970 0x7f30ac154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56282/0 (socket says 172.21.15.123:56282) 2024-09-15T23:17:09.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.686+0000 7f30b24f5640 1 -- 172.21.15.123:0/1249314034 learned_addr learned my addr 172.21.15.123:0/1249314034 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:09.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.686+0000 7f30b1cf4640 1 --2- 172.21.15.123:0/1249314034 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30ac0d23b0 0x7f30ac0cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:09.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.686+0000 7f30b2cf6640 1 --2- 172.21.15.123:0/1249314034 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30ac15ed20 0x7f30ac0cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:09.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.686+0000 7f30b24f5640 1 -- 172.21.15.123:0/1249314034 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30ac0d23b0 msgr2=0x7f30ac0cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:09.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.686+0000 7f30b24f5640 1 --2- 172.21.15.123:0/1249314034 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30ac0d23b0 0x7f30ac0cb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:09.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.686+0000 7f30b24f5640 1 -- 172.21.15.123:0/1249314034 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30ac15ed20 msgr2=0x7f30ac0cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:09.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.686+0000 7f30b24f5640 1 --2- 172.21.15.123:0/1249314034 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30ac15ed20 0x7f30ac0cd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:09.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.686+0000 7f30b24f5640 1 -- 172.21.15.123:0/1249314034 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30ac161360 con 0x7f30ac0b6970 2024-09-15T23:17:09.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.686+0000 7f30b1cf4640 1 --2- 172.21.15.123:0/1249314034 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30ac0d23b0 0x7f30ac0cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:17:09.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.686+0000 7f30b2cf6640 1 --2- 172.21.15.123:0/1249314034 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30ac15ed20 0x7f30ac0cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:17:09.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.686+0000 7f30b24f5640 1 --2- 172.21.15.123:0/1249314034 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30ac0b6970 0x7f30ac154830 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f30a800c400 tx=0x7f30a800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:09.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.687+0000 7f30a2ffd640 1 -- 172.21.15.123:0/1249314034 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a8017070 con 0x7f30ac0b6970 2024-09-15T23:17:09.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.687+0000 7f30a2ffd640 1 -- 172.21.15.123:0/1249314034 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a8005ce0 con 0x7f30ac0b6970 2024-09-15T23:17:09.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.687+0000 7f30b4759640 1 -- 172.21.15.123:0/1249314034 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30ac0cc1b0 con 0x7f30ac0b6970 2024-09-15T23:17:09.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.687+0000 7f30a2ffd640 1 -- 172.21.15.123:0/1249314034 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a80072f0 con 0x7f30ac0b6970 2024-09-15T23:17:09.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.687+0000 7f30b4759640 1 -- 172.21.15.123:0/1249314034 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30ac0cc770 con 0x7f30ac0b6970 2024-09-15T23:17:09.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.688+0000 7f30b4759640 1 -- 172.21.15.123:0/1249314034 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30ac0b7010 con 0x7f30ac0b6970 2024-09-15T23:17:09.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.688+0000 7f30a2ffd640 1 -- 172.21.15.123:0/1249314034 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f30a801a070 con 0x7f30ac0b6970 2024-09-15T23:17:09.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.689+0000 7f30a2ffd640 1 --2- 172.21.15.123:0/1249314034 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f309006c2b0 0x7f309006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:09.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.689+0000 7f30a2ffd640 1 -- 172.21.15.123:0/1249314034 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5029+0+0 (secure 0 0 0) 0x7f30a808a5c0 con 0x7f30ac0b6970 2024-09-15T23:17:09.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.689+0000 7f30b1cf4640 1 --2- 172.21.15.123:0/1249314034 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f309006c2b0 0x7f309006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:09.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.690+0000 7f30b1cf4640 1 --2- 172.21.15.123:0/1249314034 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f309006c2b0 0x7f309006e770 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f309c034000 tx=0x7f309c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:09.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.693+0000 7f30a2ffd640 1 -- 172.21.15.123:0/1249314034 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f30ac0d0e70 con 0x7f30ac0b6970 2024-09-15T23:17:09.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.892+0000 7f30b4759640 1 -- 172.21.15.123:0/1249314034 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f30ac0b3f20 con 0x7f30ac0b6970 2024-09-15T23:17:09.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.892+0000 7f30a2ffd640 1 -- 172.21.15.123:0/1249314034 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+3920 (secure 0 0 0) 0x7f30a808a030 con 0x7f30ac0b6970 2024-09-15T23:17:09.894 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:17:09.894 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":68,"btime":"2024-09-15T23:17:04:051260+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6556,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6835/488079964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":488079964},{"type":"v1","addr":"172.21.15.188:6835","nonce":488079964}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":6571,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/4123673242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6836","nonce":4123673242},{"type":"v1","addr":"172.21.15.188:6837","nonce":4123673242}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":7356,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/2179085155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2179085155},{"type":"v1","addr":"172.21.15.123:6833","nonce":2179085155}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62},{"gid":7512,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1155683883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1155683883},{"type":"v1","addr":"172.21.15.123:6835","nonce":1155683883}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68}],"filesystems":[]} 2024-09-15T23:17:09.894 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 68 2024-09-15T23:17:09.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.894+0000 7f30b4759640 1 -- 172.21.15.123:0/1249314034 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f309006c2b0 msgr2=0x7f309006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:09.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.894+0000 7f30b4759640 1 --2- 172.21.15.123:0/1249314034 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f309006c2b0 0x7f309006e770 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f309c034000 tx=0x7f309c02e000 comp rx=0 tx=0).stop 2024-09-15T23:17:09.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.894+0000 7f30b4759640 1 -- 172.21.15.123:0/1249314034 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30ac0b6970 msgr2=0x7f30ac154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:09.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.894+0000 7f30b4759640 1 --2- 172.21.15.123:0/1249314034 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30ac0b6970 0x7f30ac154830 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f30a800c400 tx=0x7f30a800c8c0 comp rx=0 tx=0).stop 2024-09-15T23:17:09.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.894+0000 7f30b4759640 1 -- 172.21.15.123:0/1249314034 shutdown_connections 2024-09-15T23:17:09.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.894+0000 7f30b4759640 1 --2- 172.21.15.123:0/1249314034 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30ac15ed20 0x7f30ac0cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:09.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.894+0000 7f30b4759640 1 --2- 172.21.15.123:0/1249314034 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30ac0d23b0 0x7f30ac0cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:09.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.894+0000 7f30b4759640 1 --2- 172.21.15.123:0/1249314034 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f309006c2b0 0x7f309006e770 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:09.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.894+0000 7f30b4759640 1 --2- 172.21.15.123:0/1249314034 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30ac0b6970 0x7f30ac154830 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:09.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.894+0000 7f30b4759640 1 -- 172.21.15.123:0/1249314034 >> 172.21.15.123:0/1249314034 conn(0x7f30ac0d1260 msgr2=0x7f30ac0b5440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:09.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.894+0000 7f30b4759640 1 -- 172.21.15.123:0/1249314034 shutdown_connections 2024-09-15T23:17:09.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:09.894+0000 7f30b4759640 1 -- 172.21.15.123:0/1249314034 wait complete. 2024-09-15T23:17:09.907 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T23:17:09.907 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T23:17:09.907 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T23:17:09.907 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:17:09.907 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T23:17:09.908 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T23:17:09.908 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T23:17:09.908 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:17:09.908 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T23:17:09.908 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T23:17:09.908 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T23:17:09.908 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:17:09.909 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T23:17:09.909 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T23:17:09.909 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T23:17:09.909 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:17:09.917 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T23:17:09.917 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T23:17:09.918 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T23:17:09.918 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T23:17:09.920 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T23:17:09.920 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T23:17:09.921 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T23:17:09.921 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T23:17:09.959 INFO:tasks.ceph.mds.a:Started 2024-09-15T23:17:09.960 DEBUG:teuthology.parallel:result is None 2024-09-15T23:17:09.960 INFO:tasks.ceph.mds.c:Started 2024-09-15T23:17:09.961 DEBUG:teuthology.parallel:result is None 2024-09-15T23:17:09.963 INFO:tasks.ceph.mds.b:Started 2024-09-15T23:17:09.964 DEBUG:teuthology.parallel:result is None 2024-09-15T23:17:09.964 INFO:tasks.ceph.mds.d:Started 2024-09-15T23:17:09.964 DEBUG:teuthology.parallel:result is None 2024-09-15T23:17:09.965 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T23:17:10.034 INFO:tasks.ceph.mds.a.smithi123.stdout:starting mds.a at 2024-09-15T23:17:10.034 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-15T23:17:10.045 INFO:tasks.ceph.mds.b.smithi188.stdout:starting mds.b at 2024-09-15T23:17:10.045 INFO:tasks.ceph.mds.d.smithi188.stdout:starting mds.d at 2024-09-15T23:17:10.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.068+0000 7efee14af640 1 Processor -- start 2024-09-15T23:17:10.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.068+0000 7efee14af640 1 -- start start 2024-09-15T23:17:10.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.070+0000 7efee14af640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7efedc15ed20 0x7efedc0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:10.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.070+0000 7efee14af640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efedc0b90e0 0x7efedc0b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:10.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.070+0000 7efee14af640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efedc0d0e70 con 0x7efedc0d23b0 2024-09-15T23:17:10.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.070+0000 7efee14af640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7efedc0d41c0 con 0x7efedc0b90e0 2024-09-15T23:17:10.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.070+0000 7efee14af640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7efedc0d35b0 con 0x7efedc15ed20 2024-09-15T23:17:10.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.070+0000 7efedb7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efedc0b90e0 0x7efedc0b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:10.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.070+0000 7efedb7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efedc0b90e0 0x7efedc0b67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56306/0 (socket says 172.21.15.123:56306) 2024-09-15T23:17:10.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.070+0000 7efedb7fe640 1 -- 172.21.15.123:0/3302702361 learned_addr learned my addr 172.21.15.123:0/3302702361 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:10.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.070+0000 7efedaffd640 1 --2- 172.21.15.123:0/3302702361 >> v2:172.21.15.188:3300/0 conn(0x7efedc15ed20 0x7efedc0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:10.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.070+0000 7efedb7fe640 1 -- 172.21.15.123:0/3302702361 >> v2:172.21.15.188:3300/0 conn(0x7efedc15ed20 msgr2=0x7efedc0b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:10.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.070+0000 7efedb7fe640 1 --2- 172.21.15.123:0/3302702361 >> v2:172.21.15.188:3300/0 conn(0x7efedc15ed20 0x7efedc0b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:10.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.070+0000 7efedb7fe640 1 -- 172.21.15.123:0/3302702361 >> v1:172.21.15.188:6789/0 conn(0x7efedc0d23b0 legacy=0x7efedc0cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:10.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.070+0000 7efedb7fe640 1 -- 172.21.15.123:0/3302702361 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efedc0d3890 con 0x7efedc0b90e0 2024-09-15T23:17:10.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.070+0000 7efedaffd640 1 --2- 172.21.15.123:0/3302702361 >> v2:172.21.15.188:3300/0 conn(0x7efedc15ed20 0x7efedc0b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:17:10.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.071+0000 7efedb7fe640 1 --2- 172.21.15.123:0/3302702361 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efedc0b90e0 0x7efedc0b67a0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7efedc0d47b0 tx=0x7efed40331d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98ec494f1e081b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:10.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.071+0000 7efed9ffb640 1 -- 172.21.15.123:0/3302702361 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed40110d0 con 0x7efedc0b90e0 2024-09-15T23:17:10.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.071+0000 7efed9ffb640 1 -- 172.21.15.123:0/3302702361 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efed4011270 con 0x7efedc0b90e0 2024-09-15T23:17:10.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.071+0000 7efed9ffb640 1 -- 172.21.15.123:0/3302702361 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed4011640 con 0x7efedc0b90e0 2024-09-15T23:17:10.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.072+0000 7efee14af640 1 -- 172.21.15.123:0/3302702361 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efedc0b90e0 msgr2=0x7efedc0b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:10.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.072+0000 7efee14af640 1 --2- 172.21.15.123:0/3302702361 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efedc0b90e0 0x7efedc0b67a0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7efedc0d47b0 tx=0x7efed40331d0 comp rx=0 tx=0).stop 2024-09-15T23:17:10.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.072+0000 7efee14af640 1 -- 172.21.15.123:0/3302702361 shutdown_connections 2024-09-15T23:17:10.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.072+0000 7efee14af640 1 --2- 172.21.15.123:0/3302702361 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efedc0b90e0 0x7efedc0b67a0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:10.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.072+0000 7efee14af640 1 --2- 172.21.15.123:0/3302702361 >> v2:172.21.15.188:3300/0 conn(0x7efedc15ed20 0x7efedc0b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:10.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.072+0000 7efee14af640 1 -- 172.21.15.123:0/3302702361 >> 172.21.15.123:0/3302702361 conn(0x7efedc0d1260 msgr2=0x7efedc0d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:10.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.072+0000 7efee14af640 1 -- 172.21.15.123:0/3302702361 shutdown_connections 2024-09-15T23:17:10.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.072+0000 7efee14af640 1 -- 172.21.15.123:0/3302702361 wait complete. 2024-09-15T23:17:10.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.073+0000 7efee14af640 1 Processor -- start 2024-09-15T23:17:10.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.073+0000 7efee14af640 1 -- start start 2024-09-15T23:17:10.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.074+0000 7efee14af640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efedc0b90e0 0x7efedc1efcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:10.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.074+0000 7efee14af640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efedc0d23b0 0x7efedc0cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:10.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.074+0000 7efee14af640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efedc15ed20 0x7efedc1545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:10.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.074+0000 7efee14af640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efedc0d32a0 con 0x7efedc0d23b0 2024-09-15T23:17:10.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.074+0000 7efee14af640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7efedc0d3e50 con 0x7efedc15ed20 2024-09-15T23:17:10.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.074+0000 7efee14af640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7efedc15f100 con 0x7efedc0b90e0 2024-09-15T23:17:10.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.074+0000 7efeda7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efedc0d23b0 0x7efedc0cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:10.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.074+0000 7efeda7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efedc0d23b0 0x7efedc0cbb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56322/0 (socket says 172.21.15.123:56322) 2024-09-15T23:17:10.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.074+0000 7efeda7fc640 1 -- 172.21.15.123:0/2809906531 learned_addr learned my addr 172.21.15.123:0/2809906531 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:10.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.074+0000 7efedb7fe640 1 --2- 172.21.15.123:0/2809906531 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efedc15ed20 0x7efedc1545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:10.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.074+0000 7efedaffd640 1 --2- 172.21.15.123:0/2809906531 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efedc0b90e0 0x7efedc1efcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:10.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.075+0000 7efeda7fc640 1 -- 172.21.15.123:0/2809906531 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efedc0b90e0 msgr2=0x7efedc1efcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:10.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.075+0000 7efeda7fc640 1 --2- 172.21.15.123:0/2809906531 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efedc0b90e0 0x7efedc1efcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:10.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.075+0000 7efeda7fc640 1 -- 172.21.15.123:0/2809906531 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efedc15ed20 msgr2=0x7efedc1545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:10.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.075+0000 7efeda7fc640 1 --2- 172.21.15.123:0/2809906531 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efedc15ed20 0x7efedc1545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:10.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.075+0000 7efeda7fc640 1 -- 172.21.15.123:0/2809906531 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efedc154af0 con 0x7efedc0d23b0 2024-09-15T23:17:10.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.075+0000 7efeda7fc640 1 --2- 172.21.15.123:0/2809906531 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efedc0d23b0 0x7efedc0cbb90 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7efed000c450 tx=0x7efed000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:10.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.078+0000 7efec37fe640 1 -- 172.21.15.123:0/2809906531 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed0017070 con 0x7efedc0d23b0 2024-09-15T23:17:10.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.078+0000 7efec37fe640 1 -- 172.21.15.123:0/2809906531 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efed00052d0 con 0x7efedc0d23b0 2024-09-15T23:17:10.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.078+0000 7efee14af640 1 -- 172.21.15.123:0/2809906531 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efedc0cc700 con 0x7efedc0d23b0 2024-09-15T23:17:10.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.078+0000 7efec37fe640 1 -- 172.21.15.123:0/2809906531 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed0003830 con 0x7efedc0d23b0 2024-09-15T23:17:10.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.078+0000 7efee14af640 1 -- 172.21.15.123:0/2809906531 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efedc160570 con 0x7efedc0d23b0 2024-09-15T23:17:10.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.079+0000 7efee14af640 1 -- 172.21.15.123:0/2809906531 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efedc0b7010 con 0x7efedc0d23b0 2024-09-15T23:17:10.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.080+0000 7efec37fe640 1 -- 172.21.15.123:0/2809906531 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7efed001a070 con 0x7efedc0d23b0 2024-09-15T23:17:10.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.080+0000 7efec37fe640 1 --2- 172.21.15.123:0/2809906531 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efec806c2b0 0x7efec806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:10.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.080+0000 7efec37fe640 1 -- 172.21.15.123:0/2809906531 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5029+0+0 (secure 0 0 0) 0x7efed008a3a0 con 0x7efedc0d23b0 2024-09-15T23:17:10.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.081+0000 7efedaffd640 1 --2- 172.21.15.123:0/2809906531 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efec806c2b0 0x7efec806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:10.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.081+0000 7efedaffd640 1 --2- 172.21.15.123:0/2809906531 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efec806c2b0 0x7efec806e770 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7efecc009560 tx=0x7efecc009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:10.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.085+0000 7efec37fe640 1 -- 172.21.15.123:0/2809906531 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efedc0d0e70 con 0x7efedc0d23b0 2024-09-15T23:17:10.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:10.262+0000 7efee14af640 1 -- 172.21.15.123:0/2809906531 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7efedc0d0a90 con 0x7efedc0d23b0 2024-09-15T23:17:11.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.091+0000 7efec37fe640 1 -- 172.21.15.123:0/2809906531 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v110) ==== 97+0+0 (secure 0 0 0) 0x7efed00587f0 con 0x7efedc0d23b0 2024-09-15T23:17:11.093 INFO:teuthology.orchestra.run.smithi123.stderr: removed all blocklist entries 2024-09-15T23:17:11.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.094+0000 7efee14af640 1 -- 172.21.15.123:0/2809906531 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efec806c2b0 msgr2=0x7efec806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:11.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.094+0000 7efee14af640 1 --2- 172.21.15.123:0/2809906531 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efec806c2b0 0x7efec806e770 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7efecc009560 tx=0x7efecc009190 comp rx=0 tx=0).stop 2024-09-15T23:17:11.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.094+0000 7efee14af640 1 -- 172.21.15.123:0/2809906531 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efedc0d23b0 msgr2=0x7efedc0cbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:11.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.094+0000 7efee14af640 1 --2- 172.21.15.123:0/2809906531 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efedc0d23b0 0x7efedc0cbb90 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7efed000c450 tx=0x7efed000c910 comp rx=0 tx=0).stop 2024-09-15T23:17:11.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.094+0000 7efee14af640 1 -- 172.21.15.123:0/2809906531 shutdown_connections 2024-09-15T23:17:11.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.094+0000 7efee14af640 1 --2- 172.21.15.123:0/2809906531 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efedc15ed20 0x7efedc1545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:11.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.094+0000 7efee14af640 1 --2- 172.21.15.123:0/2809906531 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efec806c2b0 0x7efec806e770 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:11.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.094+0000 7efee14af640 1 --2- 172.21.15.123:0/2809906531 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efedc0d23b0 0x7efedc0cbb90 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:11.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.094+0000 7efee14af640 1 --2- 172.21.15.123:0/2809906531 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efedc0b90e0 0x7efedc1efcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:11.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.094+0000 7efee14af640 1 -- 172.21.15.123:0/2809906531 >> 172.21.15.123:0/2809906531 conn(0x7efedc0d1260 msgr2=0x7efedc15da80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:11.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.094+0000 7efee14af640 1 -- 172.21.15.123:0/2809906531 shutdown_connections 2024-09-15T23:17:11.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.094+0000 7efee14af640 1 -- 172.21.15.123:0/2809906531 wait complete. 2024-09-15T23:17:11.108 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T23:17:11.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.210+0000 7fcf535fd640 1 Processor -- start 2024-09-15T23:17:11.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.210+0000 7fcf535fd640 1 -- start start 2024-09-15T23:17:11.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.211+0000 7fcf535fd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcf4c15ed20 0x7fcf4c0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:11.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.211+0000 7fcf535fd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcf4c0d23b0 0x7fcf4c0b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:11.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.211+0000 7fcf535fd640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf4c0d0e70 con 0x7fcf4c0cf2d0 2024-09-15T23:17:11.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.211+0000 7fcf535fd640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fcf4c0d41c0 con 0x7fcf4c0d23b0 2024-09-15T23:17:11.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.211+0000 7fcf535fd640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fcf4c0d35b0 con 0x7fcf4c15ed20 2024-09-15T23:17:11.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.211+0000 7fcf50b98640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcf4c0d23b0 0x7fcf4c0b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:11.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.211+0000 7fcf51b9a640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fcf4c0cf2d0 0x7fcf4c0cf760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41462/0 (socket says 172.21.15.123:41462) 2024-09-15T23:17:11.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.211+0000 7fcf51b9a640 1 -- 172.21.15.123:0/3389165599 learned_addr learned my addr 172.21.15.123:0/3389165599 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:17:11.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.211+0000 7fcf50b98640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcf4c0d23b0 0x7fcf4c0b67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56330/0 (socket says 172.21.15.123:56330) 2024-09-15T23:17:11.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.211+0000 7fcf51399640 1 --2- 172.21.15.123:0/3389165599 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcf4c15ed20 0x7fcf4c0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:11.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.211+0000 7fcf50b98640 1 -- 172.21.15.123:0/3389165599 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcf4c15ed20 msgr2=0x7fcf4c0b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:11.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.211+0000 7fcf50b98640 1 --2- 172.21.15.123:0/3389165599 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcf4c15ed20 0x7fcf4c0b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:11.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.211+0000 7fcf50b98640 1 -- 172.21.15.123:0/3389165599 >> v1:172.21.15.123:6789/0 conn(0x7fcf4c0cf2d0 legacy=0x7fcf4c0cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:11.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.211+0000 7fcf50b98640 1 -- 172.21.15.123:0/3389165599 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf4c0d3890 con 0x7fcf4c0d23b0 2024-09-15T23:17:11.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.211+0000 7fcf43fff640 1 -- 172.21.15.123:0/3389165599 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 213127842 0 0) 0x7fcf44001110 con 0x7fcf4c0cf2d0 2024-09-15T23:17:11.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.211+0000 7fcf51399640 1 --2- 172.21.15.123:0/3389165599 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcf4c15ed20 0x7fcf4c0b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:17:11.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.212+0000 7fcf50b98640 1 --2- 172.21.15.123:0/3389165599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf4c0d23b0 0x7fcf4c0b67a0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0097a0 tx=0x7fcf3c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3c0b4b6d2314b98 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:11.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.212+0000 7fcf43fff640 1 -- 172.21.15.123:0/3389165599 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c037070 con 0x7fcf4c0d23b0 2024-09-15T23:17:11.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.212+0000 7fcf43fff640 1 -- 172.21.15.123:0/3389165599 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf3c032440 con 0x7fcf4c0d23b0 2024-09-15T23:17:11.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.212+0000 7fcf43fff640 1 -- 172.21.15.123:0/3389165599 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c032810 con 0x7fcf4c0d23b0 2024-09-15T23:17:11.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.213+0000 7fcf535fd640 1 -- 172.21.15.123:0/3389165599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf4c0d23b0 msgr2=0x7fcf4c0b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:11.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.213+0000 7fcf535fd640 1 --2- 172.21.15.123:0/3389165599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf4c0d23b0 0x7fcf4c0b67a0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0097a0 tx=0x7fcf3c02a180 comp rx=0 tx=0).stop 2024-09-15T23:17:11.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.213+0000 7fcf535fd640 1 -- 172.21.15.123:0/3389165599 shutdown_connections 2024-09-15T23:17:11.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.213+0000 7fcf535fd640 1 --2- 172.21.15.123:0/3389165599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf4c0d23b0 0x7fcf4c0b67a0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:11.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.213+0000 7fcf535fd640 1 --2- 172.21.15.123:0/3389165599 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcf4c15ed20 0x7fcf4c0b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:11.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.213+0000 7fcf535fd640 1 -- 172.21.15.123:0/3389165599 >> 172.21.15.123:0/3389165599 conn(0x7fcf4c0d1260 msgr2=0x7fcf4c0d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:11.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.213+0000 7fcf535fd640 1 -- 172.21.15.123:0/3389165599 shutdown_connections 2024-09-15T23:17:11.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.213+0000 7fcf535fd640 1 -- 172.21.15.123:0/3389165599 wait complete. 2024-09-15T23:17:11.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.214+0000 7fcf535fd640 1 Processor -- start 2024-09-15T23:17:11.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.214+0000 7fcf535fd640 1 -- start start 2024-09-15T23:17:11.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.215+0000 7fcf535fd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf4c0cf2d0 0x7fcf4c153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:11.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.215+0000 7fcf535fd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf4c0d23b0 0x7fcf4c0cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:11.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.215+0000 7fcf535fd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcf4c15ed20 0x7fcf4c1e9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:11.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.215+0000 7fcf535fd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4c0d32a0 con 0x7fcf4c0d23b0 2024-09-15T23:17:11.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.215+0000 7fcf535fd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fcf4c0d3e50 con 0x7fcf4c0cf2d0 2024-09-15T23:17:11.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.215+0000 7fcf535fd640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fcf4c15f100 con 0x7fcf4c15ed20 2024-09-15T23:17:11.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.215+0000 7fcf50b98640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf4c0d23b0 0x7fcf4c0cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:11.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.215+0000 7fcf50b98640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf4c0d23b0 0x7fcf4c0cd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56340/0 (socket says 172.21.15.123:56340) 2024-09-15T23:17:11.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.215+0000 7fcf50b98640 1 -- 172.21.15.123:0/296141903 learned_addr learned my addr 172.21.15.123:0/296141903 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:11.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.215+0000 7fcf51399640 1 --2- 172.21.15.123:0/296141903 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf4c0cf2d0 0x7fcf4c153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:11.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.215+0000 7fcf51b9a640 1 --2- 172.21.15.123:0/296141903 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcf4c15ed20 0x7fcf4c1e9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:11.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.215+0000 7fcf50b98640 1 -- 172.21.15.123:0/296141903 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcf4c15ed20 msgr2=0x7fcf4c1e9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:11.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.215+0000 7fcf50b98640 1 --2- 172.21.15.123:0/296141903 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcf4c15ed20 0x7fcf4c1e9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:11.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.215+0000 7fcf50b98640 1 -- 172.21.15.123:0/296141903 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf4c0cf2d0 msgr2=0x7fcf4c153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:11.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.215+0000 7fcf50b98640 1 --2- 172.21.15.123:0/296141903 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf4c0cf2d0 0x7fcf4c153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:11.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.215+0000 7fcf50b98640 1 -- 172.21.15.123:0/296141903 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf4c0cd980 con 0x7fcf4c0d23b0 2024-09-15T23:17:11.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.215+0000 7fcf51399640 1 --2- 172.21.15.123:0/296141903 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf4c0cf2d0 0x7fcf4c153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:17:11.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.215+0000 7fcf51b9a640 1 --2- 172.21.15.123:0/296141903 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcf4c15ed20 0x7fcf4c1e9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:17:11.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.215+0000 7fcf50b98640 1 --2- 172.21.15.123:0/296141903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf4c0d23b0 0x7fcf4c0cd0c0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0097a0 tx=0x7fcf3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:11.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.215+0000 7fcf41ffb640 1 -- 172.21.15.123:0/296141903 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c037050 con 0x7fcf4c0d23b0 2024-09-15T23:17:11.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.215+0000 7fcf41ffb640 1 -- 172.21.15.123:0/296141903 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf3c038040 con 0x7fcf4c0d23b0 2024-09-15T23:17:11.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.215+0000 7fcf535fd640 1 -- 172.21.15.123:0/296141903 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf4c0cdc60 con 0x7fcf4c0d23b0 2024-09-15T23:17:11.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.215+0000 7fcf41ffb640 1 -- 172.21.15.123:0/296141903 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c004490 con 0x7fcf4c0d23b0 2024-09-15T23:17:11.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.216+0000 7fcf535fd640 1 -- 172.21.15.123:0/296141903 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf4c0ce220 con 0x7fcf4c0d23b0 2024-09-15T23:17:11.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.217+0000 7fcf535fd640 1 -- 172.21.15.123:0/296141903 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf4c0b7010 con 0x7fcf4c0d23b0 2024-09-15T23:17:11.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.217+0000 7fcf41ffb640 1 -- 172.21.15.123:0/296141903 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcf3c030980 con 0x7fcf4c0d23b0 2024-09-15T23:17:11.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.217+0000 7fcf41ffb640 1 --2- 172.21.15.123:0/296141903 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcf3006c2b0 0x7fcf3006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:11.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.218+0000 7fcf41ffb640 1 -- 172.21.15.123:0/296141903 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 4857+0+0 (secure 0 0 0) 0x7fcf3c0abdc0 con 0x7fcf4c0d23b0 2024-09-15T23:17:11.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.218+0000 7fcf51399640 1 --2- 172.21.15.123:0/296141903 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcf3006c2b0 0x7fcf3006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:11.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.218+0000 7fcf51399640 1 --2- 172.21.15.123:0/296141903 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcf3006c2b0 0x7fcf3006e770 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c0d5790 tx=0x7fcf480074b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:11.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.222+0000 7fcf41ffb640 1 -- 172.21.15.123:0/296141903 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcf3c07aa30 con 0x7fcf4c0d23b0 2024-09-15T23:17:11.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.449+0000 7fcf535fd640 1 -- 172.21.15.123:0/296141903 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fcf4c0b3f20 con 0x7fcf4c0d23b0 2024-09-15T23:17:11.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.450+0000 7fcf41ffb640 1 -- 172.21.15.123:0/296141903 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) ==== 80+0+5304 (secure 0 0 0) 0x7fcf3c07a330 con 0x7fcf4c0d23b0 2024-09-15T23:17:11.451 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:17:11.451 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:17:11.451 INFO:teuthology.orchestra.run.smithi123.stdout: "auth_dump": [ 2024-09-15T23:17:11.451 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:17:11.451 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.a", 2024-09-15T23:17:11.451 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm9ATVDhAAnukyZogTuG4YCbzRXSCkiQ==", 2024-09-15T23:17:11.452 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:17:11.452 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:17:11.452 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:17:11.452 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:17:11.452 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:17:11.452 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:17:11.452 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:17:11.452 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:17:11.452 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.b", 2024-09-15T23:17:11.452 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm4KmaGhAAbf6vcffqiJTOYXK5DCXcZA==", 2024-09-15T23:17:11.452 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:17:11.452 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:17:11.453 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:17:11.453 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:17:11.453 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:17:11.453 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:17:11.453 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:17:11.453 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:17:11.453 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.c", 2024-09-15T23:17:11.453 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmua/VFRAAwbPm2TslrfQkrvHiO8oeLg==", 2024-09-15T23:17:11.453 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:17:11.453 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:17:11.453 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:17:11.453 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:17:11.453 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:17:11.453 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:17:11.454 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:17:11.454 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:17:11.454 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.d", 2024-09-15T23:17:11.454 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmzw3eIRAAaE+5y9USwp+xM3MTAndn7Q==", 2024-09-15T23:17:11.454 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:17:11.454 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:17:11.454 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:17:11.454 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:17:11.454 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:17:11.454 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:17:11.454 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:17:11.454 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:17:11.454 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.0", 2024-09-15T23:17:11.455 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCRaedmFrHGAxAAy/jTkothESNn2DC9xcHDAQ==", 2024-09-15T23:17:11.455 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:17:11.455 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:17:11.455 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:17:11.455 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:17:11.455 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:17:11.455 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:17:11.455 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:17:11.455 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.1", 2024-09-15T23:17:11.456 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCUaedm6vZlIxAAdsnLqFSng6SRpCT6UZKGsw==", 2024-09-15T23:17:11.456 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:17:11.456 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:17:11.456 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:17:11.456 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:17:11.456 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:17:11.456 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:17:11.456 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:17:11.456 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.2", 2024-09-15T23:17:11.456 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCYaedmXgVwFRAA1mOzzRafhKMsU7kTAT6TqA==", 2024-09-15T23:17:11.456 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:17:11.456 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:17:11.457 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:17:11.457 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:17:11.457 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:17:11.457 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:17:11.457 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:17:11.457 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.3", 2024-09-15T23:17:11.457 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCcaedm+APAFhAAb8blNFzswwHriSmCrMuA0A==", 2024-09-15T23:17:11.457 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:17:11.457 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:17:11.457 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:17:11.457 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:17:11.457 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:17:11.457 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:17:11.457 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:17:11.458 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.4", 2024-09-15T23:17:11.458 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCjaedmReUmABAAXpxsK7osxn/ZelVXKiCLOw==", 2024-09-15T23:17:11.458 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:17:11.458 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:17:11.458 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:17:11.458 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:17:11.458 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:17:11.458 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:17:11.458 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:17:11.458 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.5", 2024-09-15T23:17:11.458 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCnaedmtbdmARAAdxguBdtwBmtiaIx/y992GA==", 2024-09-15T23:17:11.458 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:17:11.458 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:17:11.459 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:17:11.459 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:17:11.459 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:17:11.459 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:17:11.459 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:17:11.459 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.6", 2024-09-15T23:17:11.459 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCraedmkR+NAxAAd2GAAH0BgOMonU8iTSn+Fw==", 2024-09-15T23:17:11.459 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:17:11.459 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:17:11.459 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:17:11.459 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:17:11.459 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:17:11.459 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:17:11.460 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:17:11.460 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.7", 2024-09-15T23:17:11.460 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCvaedmAaCwBBAAdpDtCbXchArmy019wiOdSQ==", 2024-09-15T23:17:11.460 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:17:11.460 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:17:11.460 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:17:11.460 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:17:11.460 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:17:11.460 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:17:11.460 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:17:11.460 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.0", 2024-09-15T23:17:11.460 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmzQPqJRAAhUf1dnVYohN4obCfeu8+7g==", 2024-09-15T23:17:11.460 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:17:11.460 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:17:11.461 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow r", 2024-09-15T23:17:11.461 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-15T23:17:11.461 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:17:11.461 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:17:11.461 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:17:11.461 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.1", 2024-09-15T23:17:11.461 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmdKK0LhAAXXmUkxVwMEjRTRXUh9CL/g==", 2024-09-15T23:17:11.461 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:17:11.461 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:17:11.461 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:17:11.462 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:17:11.462 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:17:11.462 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:17:11.462 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:17:11.462 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:17:11.462 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.2", 2024-09-15T23:17:11.462 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmRz55KxAARi7B4WYOY1QqH1CK81z9pA==", 2024-09-15T23:17:11.462 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:17:11.462 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:17:11.462 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:17:11.462 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:17:11.463 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:17:11.463 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:17:11.463 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:17:11.463 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:17:11.463 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.3", 2024-09-15T23:17:11.463 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmbWo8NBAAR1qGX1bs35ojx6lMxftcfg==", 2024-09-15T23:17:11.463 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:17:11.463 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:17:11.463 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:17:11.463 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:17:11.463 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:17:11.463 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:17:11.464 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:17:11.464 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:17:11.464 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.admin", 2024-09-15T23:17:11.464 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCMaedmVUW0LhAAqgPFk1HtxsZXcIStNN43pA==", 2024-09-15T23:17:11.464 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:17:11.464 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:17:11.464 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:17:11.464 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:17:11.464 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:17:11.464 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:17:11.464 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:17:11.464 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:17:11.464 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.x", 2024-09-15T23:17:11.464 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmGPSBCxAAHAhXQERogdAOm0ZPNtlxpw==", 2024-09-15T23:17:11.465 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:17:11.465 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:17:11.465 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-15T23:17:11.465 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:17:11.465 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:17:11.465 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:17:11.465 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:17:11.465 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.y", 2024-09-15T23:17:11.465 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm5Om4BxAA/7ZtMMlbUA3bvMCfaNMQyg==", 2024-09-15T23:17:11.465 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:17:11.465 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:17:11.465 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-15T23:17:11.466 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:17:11.466 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:17:11.466 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:17:11.466 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-15T23:17:11.466 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:17:11.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.452+0000 7fcf535fd640 1 -- 172.21.15.123:0/296141903 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcf3006c2b0 msgr2=0x7fcf3006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:11.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.452+0000 7fcf535fd640 1 --2- 172.21.15.123:0/296141903 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcf3006c2b0 0x7fcf3006e770 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c0d5790 tx=0x7fcf480074b0 comp rx=0 tx=0).stop 2024-09-15T23:17:11.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.452+0000 7fcf535fd640 1 -- 172.21.15.123:0/296141903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf4c0d23b0 msgr2=0x7fcf4c0cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:11.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.452+0000 7fcf535fd640 1 --2- 172.21.15.123:0/296141903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf4c0d23b0 0x7fcf4c0cd0c0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0097a0 tx=0x7fcf3c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:17:11.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.452+0000 7fcf535fd640 1 -- 172.21.15.123:0/296141903 shutdown_connections 2024-09-15T23:17:11.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.452+0000 7fcf535fd640 1 --2- 172.21.15.123:0/296141903 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcf4c15ed20 0x7fcf4c1e9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:11.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.452+0000 7fcf535fd640 1 --2- 172.21.15.123:0/296141903 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcf3006c2b0 0x7fcf3006e770 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:11.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.452+0000 7fcf535fd640 1 --2- 172.21.15.123:0/296141903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcf4c0d23b0 0x7fcf4c0cd0c0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:11.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.452+0000 7fcf535fd640 1 --2- 172.21.15.123:0/296141903 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcf4c0cf2d0 0x7fcf4c153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:11.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.452+0000 7fcf535fd640 1 -- 172.21.15.123:0/296141903 >> 172.21.15.123:0/296141903 conn(0x7fcf4c0d1260 msgr2=0x7fcf4c15dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:11.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.452+0000 7fcf535fd640 1 -- 172.21.15.123:0/296141903 shutdown_connections 2024-09-15T23:17:11.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.452+0000 7fcf535fd640 1 -- 172.21.15.123:0/296141903 wait complete. 2024-09-15T23:17:11.469 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T23:17:11.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.565+0000 7f5541ef1640 1 Processor -- start 2024-09-15T23:17:11.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.565+0000 7f5541ef1640 1 -- start start 2024-09-15T23:17:11.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.566+0000 7f5541ef1640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f553c15c420 0x7f553c160a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:11.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.566+0000 7f5541ef1640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f553c071b60 con 0x7f553c0d2c30 2024-09-15T23:17:11.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.566+0000 7f5541ef1640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f553c0715a0 con 0x7f553c0b1990 2024-09-15T23:17:11.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.566+0000 7f5541ef1640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f553c0d04c0 con 0x7f553c15c420 2024-09-15T23:17:11.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.566+0000 7f553bfff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f553c0d2c30 0x7f553c0d0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41472/0 (socket says 172.21.15.123:41472) 2024-09-15T23:17:11.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.566+0000 7f553bfff640 1 -- 172.21.15.123:0/53341513 learned_addr learned my addr 172.21.15.123:0/53341513 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:17:11.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.566+0000 7f553a7fc640 1 -- 172.21.15.123:0/53341513 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2863839563 0 0) 0x7f553c071b60 con 0x7f553c0d2c30 2024-09-15T23:17:11.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.566+0000 7f553a7fc640 1 -- 172.21.15.123:0/53341513 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5524003520 con 0x7f553c0d2c30 2024-09-15T23:17:11.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.566+0000 7f553b7fe640 1 --2- 172.21.15.123:0/53341513 >> v2:172.21.15.188:3300/0 conn(0x7f553c15c420 0x7f553c160a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:11.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.566+0000 7f553a7fc640 1 -- 172.21.15.123:0/53341513 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1678243973 0 0) 0x7f5524003520 con 0x7f553c0d2c30 2024-09-15T23:17:11.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.566+0000 7f553a7fc640 1 -- 172.21.15.123:0/53341513 >> v2:172.21.15.188:3300/0 conn(0x7f553c15c420 msgr2=0x7f553c160a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:11.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.566+0000 7f553a7fc640 1 --2- 172.21.15.123:0/53341513 >> v2:172.21.15.188:3300/0 conn(0x7f553c15c420 0x7f553c160a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:11.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.566+0000 7f553a7fc640 1 -- 172.21.15.123:0/53341513 >> v1:172.21.15.188:6789/0 conn(0x7f553c0b1990 legacy=0x7f553c0d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:11.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.566+0000 7f553a7fc640 1 -- 172.21.15.123:0/53341513 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f553c071880 con 0x7f553c0d2c30 2024-09-15T23:17:11.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.566+0000 7f553a7fc640 1 -- 172.21.15.123:0/53341513 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f55340019f0 con 0x7f553c0d2c30 2024-09-15T23:17:11.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.566+0000 7f553a7fc640 1 -- 172.21.15.123:0/53341513 >> v1:172.21.15.123:6789/0 conn(0x7f553c0d2c30 legacy=0x7f553c0d0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:11.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.567+0000 7f553a7fc640 1 --2- 172.21.15.123:0/53341513 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f55240039b0 0x7f5524003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:11.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.567+0000 7f553a7fc640 1 --2- 172.21.15.123:0/53341513 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5524004800 0x7f5524004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:11.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.567+0000 7f553a7fc640 1 --2- 172.21.15.123:0/53341513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55240052e0 0x7f552400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:11.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.567+0000 7f553a7fc640 1 -- 172.21.15.123:0/53341513 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f553c0d04c0 con 0x7f55240052e0 2024-09-15T23:17:11.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.567+0000 7f553a7fc640 1 -- 172.21.15.123:0/53341513 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f552400c1e0 con 0x7f55240039b0 2024-09-15T23:17:11.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.567+0000 7f553a7fc640 1 -- 172.21.15.123:0/53341513 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f552400c3e0 con 0x7f5524004800 2024-09-15T23:17:11.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.567+0000 7f553bfff640 1 --2- 172.21.15.123:0/53341513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55240052e0 0x7f552400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:11.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.567+0000 7f553b7fe640 1 --2- 172.21.15.123:0/53341513 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f55240039b0 0x7f5524003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:11.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.567+0000 7f553affd640 1 --2- 172.21.15.123:0/53341513 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5524004800 0x7f5524004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:11.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.567+0000 7f553bfff640 1 -- 172.21.15.123:0/53341513 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5524004800 msgr2=0x7f5524004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:11.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.567+0000 7f553bfff640 1 --2- 172.21.15.123:0/53341513 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5524004800 0x7f5524004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:11.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.567+0000 7f553bfff640 1 -- 172.21.15.123:0/53341513 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f55240039b0 msgr2=0x7f5524003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:11.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.567+0000 7f553bfff640 1 --2- 172.21.15.123:0/53341513 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f55240039b0 0x7f5524003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:11.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.567+0000 7f553bfff640 1 -- 172.21.15.123:0/53341513 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5524003520 con 0x7f55240052e0 2024-09-15T23:17:11.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.568+0000 7f553bfff640 1 -- 172.21.15.123:0/53341513 reap_dead start 2024-09-15T23:17:11.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.568+0000 7f553bfff640 1 --2- 172.21.15.123:0/53341513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55240052e0 0x7f552400b9c0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f553400a810 tx=0x7f5524005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd297a6ce7a70053 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:11.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.568+0000 7f553a7fc640 1 -- 172.21.15.123:0/53341513 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553400a460 con 0x7f55240052e0 2024-09-15T23:17:11.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.568+0000 7f553a7fc640 1 -- 172.21.15.123:0/53341513 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f553402f070 con 0x7f55240052e0 2024-09-15T23:17:11.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.568+0000 7f553a7fc640 1 -- 172.21.15.123:0/53341513 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553402bc90 con 0x7f55240052e0 2024-09-15T23:17:11.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.568+0000 7f5541ef1640 1 -- 172.21.15.123:0/53341513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55240052e0 msgr2=0x7f552400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:11.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.568+0000 7f5541ef1640 1 --2- 172.21.15.123:0/53341513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55240052e0 0x7f552400b9c0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f553400a810 tx=0x7f5524005830 comp rx=0 tx=0).stop 2024-09-15T23:17:11.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.568+0000 7f5541ef1640 1 -- 172.21.15.123:0/53341513 shutdown_connections 2024-09-15T23:17:11.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.568+0000 7f5541ef1640 1 --2- 172.21.15.123:0/53341513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55240052e0 0x7f552400b9c0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:11.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.568+0000 7f5541ef1640 1 -- 172.21.15.123:0/53341513 >> 172.21.15.123:0/53341513 conn(0x7f553c067fb0 msgr2=0x7f553c06f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:11.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.568+0000 7f5541ef1640 1 -- 172.21.15.123:0/53341513 shutdown_connections 2024-09-15T23:17:11.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.568+0000 7f5541ef1640 1 -- 172.21.15.123:0/53341513 wait complete. 2024-09-15T23:17:11.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.570+0000 7f5541ef1640 1 Processor -- start 2024-09-15T23:17:11.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.570+0000 7f5541ef1640 1 -- start start 2024-09-15T23:17:11.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.570+0000 7f5541ef1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55240052e0 0x7f553c15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:11.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.570+0000 7f5541ef1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f553c06e3e0 0x7f553c14d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:11.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.570+0000 7f5541ef1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f553c158f10 0x7f553c159390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:11.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.570+0000 7f5541ef1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f553c160a40 con 0x7f55240052e0 2024-09-15T23:17:11.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.570+0000 7f5541ef1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f553c15c800 con 0x7f553c158f10 2024-09-15T23:17:11.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.570+0000 7f5541ef1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f553c160bc0 con 0x7f553c06e3e0 2024-09-15T23:17:11.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.571+0000 7f553b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55240052e0 0x7f553c15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:11.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.571+0000 7f553b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55240052e0 0x7f553c15b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56370/0 (socket says 172.21.15.123:56370) 2024-09-15T23:17:11.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.571+0000 7f553b7fe640 1 -- 172.21.15.123:0/2826706214 learned_addr learned my addr 172.21.15.123:0/2826706214 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:11.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.571+0000 7f553bfff640 1 --2- 172.21.15.123:0/2826706214 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f553c158f10 0x7f553c159390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:11.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.571+0000 7f553affd640 1 --2- 172.21.15.123:0/2826706214 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f553c06e3e0 0x7f553c14d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:11.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.571+0000 7f553b7fe640 1 -- 172.21.15.123:0/2826706214 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f553c06e3e0 msgr2=0x7f553c14d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:11.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.571+0000 7f553b7fe640 1 --2- 172.21.15.123:0/2826706214 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f553c06e3e0 0x7f553c14d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:11.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.571+0000 7f553b7fe640 1 -- 172.21.15.123:0/2826706214 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f553c158f10 msgr2=0x7f553c159390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:11.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.571+0000 7f553b7fe640 1 --2- 172.21.15.123:0/2826706214 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f553c158f10 0x7f553c159390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:11.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.571+0000 7f553b7fe640 1 -- 172.21.15.123:0/2826706214 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f553c15b6a0 con 0x7f55240052e0 2024-09-15T23:17:11.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.571+0000 7f553bfff640 1 --2- 172.21.15.123:0/2826706214 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f553c158f10 0x7f553c159390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:17:11.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.571+0000 7f553affd640 1 --2- 172.21.15.123:0/2826706214 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f553c06e3e0 0x7f553c14d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:17:11.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.571+0000 7f553b7fe640 1 --2- 172.21.15.123:0/2826706214 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55240052e0 0x7f553c15b0a0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f552c00b7c0 tx=0x7f552c00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:11.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.571+0000 7f5523fff640 1 -- 172.21.15.123:0/2826706214 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552c018070 con 0x7f55240052e0 2024-09-15T23:17:11.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.571+0000 7f5523fff640 1 -- 172.21.15.123:0/2826706214 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f552c0107d0 con 0x7f55240052e0 2024-09-15T23:17:11.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.571+0000 7f5541ef1640 1 -- 172.21.15.123:0/2826706214 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f553c06d900 con 0x7f55240052e0 2024-09-15T23:17:11.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.571+0000 7f5523fff640 1 -- 172.21.15.123:0/2826706214 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552c010ba0 con 0x7f55240052e0 2024-09-15T23:17:11.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.571+0000 7f5541ef1640 1 -- 172.21.15.123:0/2826706214 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f553c151760 con 0x7f55240052e0 2024-09-15T23:17:11.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.572+0000 7f5541ef1640 1 -- 172.21.15.123:0/2826706214 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f553c06d730 con 0x7f55240052e0 2024-09-15T23:17:11.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.573+0000 7f5523fff640 1 -- 172.21.15.123:0/2826706214 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f552c01b070 con 0x7f55240052e0 2024-09-15T23:17:11.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.573+0000 7f5523fff640 1 --2- 172.21.15.123:0/2826706214 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f552806c2e0 0x7f552806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:11.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.573+0000 7f5523fff640 1 -- 172.21.15.123:0/2826706214 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 4857+0+0 (secure 0 0 0) 0x7f552c08b4b0 con 0x7f55240052e0 2024-09-15T23:17:11.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.574+0000 7f553affd640 1 --2- 172.21.15.123:0/2826706214 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f552806c2e0 0x7f552806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:11.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.574+0000 7f553affd640 1 --2- 172.21.15.123:0/2826706214 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f552806c2e0 0x7f552806e7a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5530000c00 tx=0x7f5530009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:11.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.578+0000 7f5523fff640 1 -- 172.21.15.123:0/2826706214 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f552c05a000 con 0x7f55240052e0 2024-09-15T23:17:11.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.744+0000 7f5541ef1640 1 -- 172.21.15.123:0/2826706214 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f553c06e7c0 con 0x7f55240052e0 2024-09-15T23:17:11.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.745+0000 7f5523fff640 1 -- 172.21.15.123:0/2826706214 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v110) ==== 84+0+65 (secure 0 0 0) 0x7f552c059900 con 0x7f55240052e0 2024-09-15T23:17:11.746 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:17:11.746 INFO:teuthology.orchestra.run.smithi123.stdout:[ 2024-09-15T23:17:11.746 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:17:11.746 INFO:teuthology.orchestra.run.smithi123.stdout: "poolnum": 1, 2024-09-15T23:17:11.746 INFO:teuthology.orchestra.run.smithi123.stdout: "poolname": ".mgr" 2024-09-15T23:17:11.746 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:17:11.747 INFO:teuthology.orchestra.run.smithi123.stdout:] 2024-09-15T23:17:11.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.747+0000 7f5541ef1640 1 -- 172.21.15.123:0/2826706214 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f552806c2e0 msgr2=0x7f552806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:11.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.747+0000 7f5541ef1640 1 --2- 172.21.15.123:0/2826706214 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f552806c2e0 0x7f552806e7a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5530000c00 tx=0x7f5530009040 comp rx=0 tx=0).stop 2024-09-15T23:17:11.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.747+0000 7f5541ef1640 1 -- 172.21.15.123:0/2826706214 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55240052e0 msgr2=0x7f553c15b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:11.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.747+0000 7f5541ef1640 1 --2- 172.21.15.123:0/2826706214 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55240052e0 0x7f553c15b0a0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f552c00b7c0 tx=0x7f552c00bc80 comp rx=0 tx=0).stop 2024-09-15T23:17:11.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.747+0000 7f5541ef1640 1 -- 172.21.15.123:0/2826706214 shutdown_connections 2024-09-15T23:17:11.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.747+0000 7f5541ef1640 1 --2- 172.21.15.123:0/2826706214 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f553c158f10 0x7f553c159390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:11.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.747+0000 7f5541ef1640 1 --2- 172.21.15.123:0/2826706214 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f553c06e3e0 0x7f553c14d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:11.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.747+0000 7f5541ef1640 1 --2- 172.21.15.123:0/2826706214 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f552806c2e0 0x7f552806e7a0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:11.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.747+0000 7f5541ef1640 1 --2- 172.21.15.123:0/2826706214 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55240052e0 0x7f553c15b0a0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:11.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.747+0000 7f5541ef1640 1 -- 172.21.15.123:0/2826706214 >> 172.21.15.123:0/2826706214 conn(0x7f553c067fb0 msgr2=0x7f553c06f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:11.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.747+0000 7f5541ef1640 1 -- 172.21.15.123:0/2826706214 shutdown_connections 2024-09-15T23:17:11.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.747+0000 7f5541ef1640 1 -- 172.21.15.123:0/2826706214 wait complete. 2024-09-15T23:17:11.758 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T23:17:11.758 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T23:17:11.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.860+0000 7f4527b3b640 1 Processor -- start 2024-09-15T23:17:11.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.860+0000 7f4527b3b640 1 -- start start 2024-09-15T23:17:11.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.861+0000 7f4527b3b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f45201454b0 0x7f45200b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:11.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.861+0000 7f4527b3b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f45200b0e50 0x7f45200b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:11.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.861+0000 7f4527b3b640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4520146220 con 0x7f45201459a0 2024-09-15T23:17:11.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.861+0000 7f4527b3b640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f45200b1920 con 0x7f45201454b0 2024-09-15T23:17:11.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.861+0000 7f4527b3b640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f45200cf640 con 0x7f45200b0e50 2024-09-15T23:17:11.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.861+0000 7f45258d7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f45201454b0 0x7f45200b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:11.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.861+0000 7f45258d7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f45201454b0 0x7f45200b58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56380/0 (socket says 172.21.15.123:56380) 2024-09-15T23:17:11.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.861+0000 7f45258d7640 1 -- 172.21.15.123:0/3181855875 learned_addr learned my addr 172.21.15.123:0/3181855875 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:11.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.862+0000 7f45260d8640 1 --2- 172.21.15.123:0/3181855875 >> v2:172.21.15.188:3300/0 conn(0x7f45200b0e50 0x7f45200b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:11.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.862+0000 7f45258d7640 1 -- 172.21.15.123:0/3181855875 >> v2:172.21.15.188:3300/0 conn(0x7f45200b0e50 msgr2=0x7f45200b5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:11.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.862+0000 7f45258d7640 1 --2- 172.21.15.123:0/3181855875 >> v2:172.21.15.188:3300/0 conn(0x7f45200b0e50 0x7f45200b5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:11.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.862+0000 7f45258d7640 1 -- 172.21.15.123:0/3181855875 >> v1:172.21.15.188:6789/0 conn(0x7f45201459a0 legacy=0x7f45200b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:11.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.862+0000 7f45258d7640 1 -- 172.21.15.123:0/3181855875 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45200cf8e0 con 0x7f45201454b0 2024-09-15T23:17:11.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.862+0000 7f45258d7640 1 --2- 172.21.15.123:0/3181855875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45201454b0 0x7f45200b58f0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f45200cf3f0 tx=0x7f451c02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97edbb01916c3a51 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:11.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.863+0000 7f45248d5640 1 -- 172.21.15.123:0/3181855875 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f451c037070 con 0x7f45201454b0 2024-09-15T23:17:11.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.863+0000 7f45248d5640 1 -- 172.21.15.123:0/3181855875 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f451c032440 con 0x7f45201454b0 2024-09-15T23:17:11.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.863+0000 7f45248d5640 1 -- 172.21.15.123:0/3181855875 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f451c032810 con 0x7f45201454b0 2024-09-15T23:17:11.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.863+0000 7f4527b3b640 1 -- 172.21.15.123:0/3181855875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45201454b0 msgr2=0x7f45200b58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:11.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.863+0000 7f4527b3b640 1 --2- 172.21.15.123:0/3181855875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45201454b0 0x7f45200b58f0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f45200cf3f0 tx=0x7f451c02a2c0 comp rx=0 tx=0).stop 2024-09-15T23:17:11.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.863+0000 7f4527b3b640 1 -- 172.21.15.123:0/3181855875 shutdown_connections 2024-09-15T23:17:11.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.863+0000 7f4527b3b640 1 --2- 172.21.15.123:0/3181855875 >> v2:172.21.15.188:3300/0 conn(0x7f45200b0e50 0x7f45200b5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:11.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.863+0000 7f4527b3b640 1 --2- 172.21.15.123:0/3181855875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45201454b0 0x7f45200b58f0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:11.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.863+0000 7f4527b3b640 1 -- 172.21.15.123:0/3181855875 >> 172.21.15.123:0/3181855875 conn(0x7f452006c240 msgr2=0x7f452006d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:11.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.863+0000 7f4527b3b640 1 -- 172.21.15.123:0/3181855875 shutdown_connections 2024-09-15T23:17:11.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.863+0000 7f4527b3b640 1 -- 172.21.15.123:0/3181855875 wait complete. 2024-09-15T23:17:11.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.864+0000 7f4527b3b640 1 Processor -- start 2024-09-15T23:17:11.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.864+0000 7f4527b3b640 1 -- start start 2024-09-15T23:17:11.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.865+0000 7f4527b3b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f45200b0e50 0x7f452015cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:11.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.865+0000 7f4527b3b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45201454b0 0x7f452013ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:11.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.865+0000 7f4527b3b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f45201459a0 0x7f452014c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:11.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.865+0000 7f4527b3b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f45200d0180 con 0x7f45201454b0 2024-09-15T23:17:11.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.865+0000 7f4527b3b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f45200cfea0 con 0x7f45201459a0 2024-09-15T23:17:11.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.865+0000 7f4527b3b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f45200b24c0 con 0x7f45200b0e50 2024-09-15T23:17:11.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.865+0000 7f45250d6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45201454b0 0x7f452013ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:11.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.865+0000 7f45250d6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45201454b0 0x7f452013ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56390/0 (socket says 172.21.15.123:56390) 2024-09-15T23:17:11.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.865+0000 7f45250d6640 1 -- 172.21.15.123:0/731687212 learned_addr learned my addr 172.21.15.123:0/731687212 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:11.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.865+0000 7f45260d8640 1 --2- 172.21.15.123:0/731687212 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f45201459a0 0x7f452014c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:11.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.865+0000 7f45258d7640 1 --2- 172.21.15.123:0/731687212 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f45200b0e50 0x7f452015cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:11.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.866+0000 7f45250d6640 1 -- 172.21.15.123:0/731687212 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f45200b0e50 msgr2=0x7f452015cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:11.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.866+0000 7f45250d6640 1 --2- 172.21.15.123:0/731687212 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f45200b0e50 0x7f452015cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:11.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.866+0000 7f45250d6640 1 -- 172.21.15.123:0/731687212 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f45201459a0 msgr2=0x7f452014c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:11.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.866+0000 7f45250d6640 1 --2- 172.21.15.123:0/731687212 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f45201459a0 0x7f452014c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:11.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.866+0000 7f45250d6640 1 -- 172.21.15.123:0/731687212 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f452013c5f0 con 0x7f45201454b0 2024-09-15T23:17:11.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.866+0000 7f45250d6640 1 --2- 172.21.15.123:0/731687212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45201454b0 0x7f452013ab90 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f451000b3f0 tx=0x7f451000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:11.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.866+0000 7f45167fc640 1 -- 172.21.15.123:0/731687212 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4510015020 con 0x7f45201454b0 2024-09-15T23:17:11.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.866+0000 7f45167fc640 1 -- 172.21.15.123:0/731687212 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4510011830 con 0x7f45201454b0 2024-09-15T23:17:11.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.866+0000 7f4527b3b640 1 -- 172.21.15.123:0/731687212 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f452013b550 con 0x7f45201454b0 2024-09-15T23:17:11.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.866+0000 7f45167fc640 1 -- 172.21.15.123:0/731687212 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4510011c20 con 0x7f45201454b0 2024-09-15T23:17:11.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.866+0000 7f4527b3b640 1 -- 172.21.15.123:0/731687212 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f452013bb10 con 0x7f45201454b0 2024-09-15T23:17:11.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.867+0000 7f4527b3b640 1 -- 172.21.15.123:0/731687212 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f452013c120 con 0x7f45201454b0 2024-09-15T23:17:11.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.868+0000 7f45167fc640 1 -- 172.21.15.123:0/731687212 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4510018020 con 0x7f45201454b0 2024-09-15T23:17:11.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.868+0000 7f45167fc640 1 --2- 172.21.15.123:0/731687212 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f450406c2e0 0x7f450406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:11.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.868+0000 7f45167fc640 1 -- 172.21.15.123:0/731687212 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 4857+0+0 (secure 0 0 0) 0x7f451008ac00 con 0x7f45201454b0 2024-09-15T23:17:11.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.868+0000 7f45258d7640 1 --2- 172.21.15.123:0/731687212 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f450406c2e0 0x7f450406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:11.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.869+0000 7f45258d7640 1 --2- 172.21.15.123:0/731687212 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f450406c2e0 0x7f450406e7a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f451c034000 tx=0x7f451c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:11.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:11.872+0000 7f45167fc640 1 -- 172.21.15.123:0/731687212 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4510091080 con 0x7f45201454b0 2024-09-15T23:17:12.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.037+0000 7f4527b3b640 1 -- 172.21.15.123:0/731687212 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f45200cd0d0 con 0x7f45201454b0 2024-09-15T23:17:12.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.096+0000 7f45167fc640 1 -- 172.21.15.123:0/731687212 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v111) ==== 138+0+0 (secure 0 0 0) 0x7f451001f030 con 0x7f45201454b0 2024-09-15T23:17:12.097 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' created 2024-09-15T23:17:12.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.099+0000 7f4527b3b640 1 -- 172.21.15.123:0/731687212 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f450406c2e0 msgr2=0x7f450406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:12.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.099+0000 7f4527b3b640 1 --2- 172.21.15.123:0/731687212 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f450406c2e0 0x7f450406e7a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f451c034000 tx=0x7f451c02e000 comp rx=0 tx=0).stop 2024-09-15T23:17:12.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.099+0000 7f4527b3b640 1 -- 172.21.15.123:0/731687212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45201454b0 msgr2=0x7f452013ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:12.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.099+0000 7f4527b3b640 1 --2- 172.21.15.123:0/731687212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45201454b0 0x7f452013ab90 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f451000b3f0 tx=0x7f451000b8b0 comp rx=0 tx=0).stop 2024-09-15T23:17:12.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.099+0000 7f4527b3b640 1 -- 172.21.15.123:0/731687212 shutdown_connections 2024-09-15T23:17:12.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.099+0000 7f4527b3b640 1 --2- 172.21.15.123:0/731687212 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f45201459a0 0x7f452014c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:12.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.099+0000 7f4527b3b640 1 --2- 172.21.15.123:0/731687212 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f450406c2e0 0x7f450406e7a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:12.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.099+0000 7f4527b3b640 1 --2- 172.21.15.123:0/731687212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45201454b0 0x7f452013ab90 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:12.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.099+0000 7f4527b3b640 1 --2- 172.21.15.123:0/731687212 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f45200b0e50 0x7f452015cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:12.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.099+0000 7f4527b3b640 1 -- 172.21.15.123:0/731687212 >> 172.21.15.123:0/731687212 conn(0x7f452006c240 msgr2=0x7f452015b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:12.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.099+0000 7f4527b3b640 1 -- 172.21.15.123:0/731687212 shutdown_connections 2024-09-15T23:17:12.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.099+0000 7f4527b3b640 1 -- 172.21.15.123:0/731687212 wait complete. 2024-09-15T23:17:12.113 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T23:17:12.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.217+0000 7f1a726f1640 1 Processor -- start 2024-09-15T23:17:12.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.217+0000 7f1a726f1640 1 -- start start 2024-09-15T23:17:12.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.218+0000 7f1a726f1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a6c0b4060 0x7f1a6c0b4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:12.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.218+0000 7f1a726f1640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a6c0b49c0 con 0x7f1a6c0cde30 2024-09-15T23:17:12.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.218+0000 7f1a726f1640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a6c0741c0 con 0x7f1a6c15c7e0 2024-09-15T23:17:12.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.218+0000 7f1a726f1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1a6c15cbc0 con 0x7f1a6c0b4060 2024-09-15T23:17:12.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.218+0000 7f1a70c8e640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1a6c0cde30 0x7f1a6c0ce2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41488/0 (socket says 172.21.15.123:41488) 2024-09-15T23:17:12.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.218+0000 7f1a70c8e640 1 -- 172.21.15.123:0/2505808459 learned_addr learned my addr 172.21.15.123:0/2505808459 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:17:12.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.218+0000 7f1a63fff640 1 --2- 172.21.15.123:0/2505808459 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a6c0b4060 0x7f1a6c0b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:12.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.218+0000 7f1a6b7fe640 1 -- 172.21.15.123:0/2505808459 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4154036668 0 0) 0x7f1a6c0b49c0 con 0x7f1a6c0cde30 2024-09-15T23:17:12.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.218+0000 7f1a6b7fe640 1 -- 172.21.15.123:0/2505808459 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a58003520 con 0x7f1a6c0cde30 2024-09-15T23:17:12.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.218+0000 7f1a6b7fe640 1 -- 172.21.15.123:0/2505808459 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1528516617 0 0) 0x7f1a5c001160 con 0x7f1a6c15c7e0 2024-09-15T23:17:12.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.218+0000 7f1a6b7fe640 1 -- 172.21.15.123:0/2505808459 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a6c0b49c0 con 0x7f1a6c15c7e0 2024-09-15T23:17:12.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.218+0000 7f1a63fff640 1 -- 172.21.15.123:0/2505808459 >> v1:172.21.15.188:6789/0 conn(0x7f1a6c15c7e0 legacy=0x7f1a6c073ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:12.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.218+0000 7f1a63fff640 1 -- 172.21.15.123:0/2505808459 >> v1:172.21.15.123:6789/0 conn(0x7f1a6c0cde30 legacy=0x7f1a6c0ce2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:12.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.218+0000 7f1a63fff640 1 -- 172.21.15.123:0/2505808459 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a6c0d0240 con 0x7f1a6c0b4060 2024-09-15T23:17:12.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.219+0000 7f1a63fff640 1 --2- 172.21.15.123:0/2505808459 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a6c0b4060 0x7f1a6c0b4480 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1a540097d0 tx=0x7f1a5402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebc5f863f558bce3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:12.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.219+0000 7f1a6b7fe640 1 -- 172.21.15.123:0/2505808459 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a54037070 con 0x7f1a6c0b4060 2024-09-15T23:17:12.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.219+0000 7f1a6b7fe640 1 -- 172.21.15.123:0/2505808459 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a54032440 con 0x7f1a6c0b4060 2024-09-15T23:17:12.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.219+0000 7f1a6b7fe640 1 -- 172.21.15.123:0/2505808459 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a540327f0 con 0x7f1a6c0b4060 2024-09-15T23:17:12.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.220+0000 7f1a726f1640 1 -- 172.21.15.123:0/2505808459 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a6c0b4060 msgr2=0x7f1a6c0b4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:12.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.220+0000 7f1a726f1640 1 --2- 172.21.15.123:0/2505808459 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a6c0b4060 0x7f1a6c0b4480 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1a540097d0 tx=0x7f1a5402a210 comp rx=0 tx=0).stop 2024-09-15T23:17:12.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.220+0000 7f1a726f1640 1 -- 172.21.15.123:0/2505808459 shutdown_connections 2024-09-15T23:17:12.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.220+0000 7f1a726f1640 1 --2- 172.21.15.123:0/2505808459 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a6c0b4060 0x7f1a6c0b4480 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:12.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.220+0000 7f1a726f1640 1 -- 172.21.15.123:0/2505808459 >> 172.21.15.123:0/2505808459 conn(0x7f1a6c0cefe0 msgr2=0x7f1a6c0cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:12.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.220+0000 7f1a726f1640 1 -- 172.21.15.123:0/2505808459 shutdown_connections 2024-09-15T23:17:12.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.220+0000 7f1a726f1640 1 -- 172.21.15.123:0/2505808459 wait complete. 2024-09-15T23:17:12.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.221+0000 7f1a726f1640 1 Processor -- start 2024-09-15T23:17:12.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.221+0000 7f1a726f1640 1 -- start start 2024-09-15T23:17:12.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.222+0000 7f1a726f1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a6c0b4060 0x7f1a6c14c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:12.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.222+0000 7f1a726f1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a6c0cde30 0x7f1a6c0cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:12.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.222+0000 7f1a726f1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a6c15c7e0 0x7f1a6c15de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:12.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.222+0000 7f1a726f1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6c0d0ae0 con 0x7f1a6c0b4060 2024-09-15T23:17:12.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.222+0000 7f1a726f1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6c0d0800 con 0x7f1a6c0cde30 2024-09-15T23:17:12.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.222+0000 7f1a726f1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1a6c073110 con 0x7f1a6c15c7e0 2024-09-15T23:17:12.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.222+0000 7f1a6bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a6c0b4060 0x7f1a6c14c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:12.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.222+0000 7f1a6bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a6c0b4060 0x7f1a6c14c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56402/0 (socket says 172.21.15.123:56402) 2024-09-15T23:17:12.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.222+0000 7f1a6bfff640 1 -- 172.21.15.123:0/1799379396 learned_addr learned my addr 172.21.15.123:0/1799379396 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:12.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.222+0000 7f1a70c8e640 1 --2- 172.21.15.123:0/1799379396 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a6c15c7e0 0x7f1a6c15de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:12.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.222+0000 7f1a63fff640 1 --2- 172.21.15.123:0/1799379396 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a6c0cde30 0x7f1a6c0cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:12.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.222+0000 7f1a6bfff640 1 -- 172.21.15.123:0/1799379396 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a6c15c7e0 msgr2=0x7f1a6c15de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:12.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.222+0000 7f1a6bfff640 1 --2- 172.21.15.123:0/1799379396 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a6c15c7e0 0x7f1a6c15de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:12.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.222+0000 7f1a6bfff640 1 -- 172.21.15.123:0/1799379396 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a6c0cde30 msgr2=0x7f1a6c0cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:12.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.222+0000 7f1a6bfff640 1 --2- 172.21.15.123:0/1799379396 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a6c0cde30 0x7f1a6c0cbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:12.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.222+0000 7f1a6bfff640 1 -- 172.21.15.123:0/1799379396 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a6c14cee0 con 0x7f1a6c0b4060 2024-09-15T23:17:12.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.222+0000 7f1a6bfff640 1 --2- 172.21.15.123:0/1799379396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a6c0b4060 0x7f1a6c14c9a0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00c700 tx=0x7f1a5c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:12.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.222+0000 7f1a697fa640 1 -- 172.21.15.123:0/1799379396 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c0050d0 con 0x7f1a6c0b4060 2024-09-15T23:17:12.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.222+0000 7f1a697fa640 1 -- 172.21.15.123:0/1799379396 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a5c005290 con 0x7f1a6c0b4060 2024-09-15T23:17:12.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.222+0000 7f1a726f1640 1 -- 172.21.15.123:0/1799379396 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a6c158f50 con 0x7f1a6c0b4060 2024-09-15T23:17:12.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.222+0000 7f1a697fa640 1 -- 172.21.15.123:0/1799379396 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c003640 con 0x7f1a6c0b4060 2024-09-15T23:17:12.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.223+0000 7f1a726f1640 1 -- 172.21.15.123:0/1799379396 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a6c159510 con 0x7f1a6c0b4060 2024-09-15T23:17:12.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.224+0000 7f1a726f1640 1 -- 172.21.15.123:0/1799379396 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a6c0b53d0 con 0x7f1a6c0b4060 2024-09-15T23:17:12.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.224+0000 7f1a697fa640 1 -- 172.21.15.123:0/1799379396 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1a5c0037e0 con 0x7f1a6c0b4060 2024-09-15T23:17:12.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.224+0000 7f1a697fa640 1 --2- 172.21.15.123:0/1799379396 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1a4c06c2b0 0x7f1a4c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:12.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.225+0000 7f1a697fa640 1 -- 172.21.15.123:0/1799379396 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5227+0+0 (secure 0 0 0) 0x7f1a5c08aef0 con 0x7f1a6c0b4060 2024-09-15T23:17:12.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.225+0000 7f1a63fff640 1 --2- 172.21.15.123:0/1799379396 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1a4c06c2b0 0x7f1a4c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:12.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.225+0000 7f1a63fff640 1 --2- 172.21.15.123:0/1799379396 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1a4c06c2b0 0x7f1a4c06e770 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f1a54034000 tx=0x7f1a5402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:12.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.229+0000 7f1a697fa640 1 -- 172.21.15.123:0/1799379396 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1a6c14cee0 con 0x7f1a6c0b4060 2024-09-15T23:17:12.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:12.396+0000 7f1a726f1640 1 -- 172.21.15.123:0/1799379396 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f1a6c0b21c0 con 0x7f1a6c0b4060 2024-09-15T23:17:13.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.098+0000 7f1a697fa640 1 -- 172.21.15.123:0/1799379396 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v112) ==== 170+0+0 (secure 0 0 0) 0x7f1a6c0741c0 con 0x7f1a6c0b4060 2024-09-15T23:17:13.099 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' created 2024-09-15T23:17:13.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.102+0000 7f1a726f1640 1 -- 172.21.15.123:0/1799379396 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1a4c06c2b0 msgr2=0x7f1a4c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:13.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.102+0000 7f1a726f1640 1 --2- 172.21.15.123:0/1799379396 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1a4c06c2b0 0x7f1a4c06e770 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f1a54034000 tx=0x7f1a5402e000 comp rx=0 tx=0).stop 2024-09-15T23:17:13.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.102+0000 7f1a726f1640 1 -- 172.21.15.123:0/1799379396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a6c0b4060 msgr2=0x7f1a6c14c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:13.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.102+0000 7f1a726f1640 1 --2- 172.21.15.123:0/1799379396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a6c0b4060 0x7f1a6c14c9a0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00c700 tx=0x7f1a5c00cbc0 comp rx=0 tx=0).stop 2024-09-15T23:17:13.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.105+0000 7f1a726f1640 1 -- 172.21.15.123:0/1799379396 shutdown_connections 2024-09-15T23:17:13.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.105+0000 7f1a726f1640 1 --2- 172.21.15.123:0/1799379396 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a6c15c7e0 0x7f1a6c15de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:13.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.105+0000 7f1a726f1640 1 --2- 172.21.15.123:0/1799379396 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a6c0cde30 0x7f1a6c0cbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:13.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.105+0000 7f1a726f1640 1 --2- 172.21.15.123:0/1799379396 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1a4c06c2b0 0x7f1a4c06e770 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:13.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.105+0000 7f1a726f1640 1 --2- 172.21.15.123:0/1799379396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a6c0b4060 0x7f1a6c14c9a0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:13.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.105+0000 7f1a726f1640 1 -- 172.21.15.123:0/1799379396 >> 172.21.15.123:0/1799379396 conn(0x7f1a6c0cefe0 msgr2=0x7f1a6c0cf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:13.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.107+0000 7f1a726f1640 1 -- 172.21.15.123:0/1799379396 shutdown_connections 2024-09-15T23:17:13.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.108+0000 7f1a726f1640 1 -- 172.21.15.123:0/1799379396 wait complete. 2024-09-15T23:17:13.126 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T23:17:13.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.229+0000 7fedaa96d640 1 Processor -- start 2024-09-15T23:17:13.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.229+0000 7fedaa96d640 1 -- start start 2024-09-15T23:17:13.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.229+0000 7fedaa96d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7feda4072ad0 0x7feda40b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:13.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.229+0000 7fedaa96d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feda40cf2e0 con 0x7feda415b7c0 2024-09-15T23:17:13.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.229+0000 7fedaa96d640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feda4070fe0 con 0x7feda40ccf30 2024-09-15T23:17:13.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.229+0000 7fedaa96d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7feda40712c0 con 0x7feda4072ad0 2024-09-15T23:17:13.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.230+0000 7feda37fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7feda415b7c0 0x7feda40cead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41504/0 (socket says 172.21.15.123:41504) 2024-09-15T23:17:13.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.230+0000 7feda37fe640 1 -- 172.21.15.123:0/2429419362 learned_addr learned my addr 172.21.15.123:0/2429419362 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:17:13.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.230+0000 7feda8f0a640 1 --2- 172.21.15.123:0/2429419362 >> v2:172.21.15.188:3300/0 conn(0x7feda4072ad0 0x7feda40b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:13.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.230+0000 7feda2ffd640 1 -- 172.21.15.123:0/2429419362 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3198448152 0 0) 0x7feda40cf2e0 con 0x7feda415b7c0 2024-09-15T23:17:13.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.230+0000 7feda2ffd640 1 -- 172.21.15.123:0/2429419362 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed90003520 con 0x7feda415b7c0 2024-09-15T23:17:13.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.230+0000 7feda2ffd640 1 -- 172.21.15.123:0/2429419362 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2457600687 0 0) 0x7fed90003520 con 0x7feda415b7c0 2024-09-15T23:17:13.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.230+0000 7feda2ffd640 1 -- 172.21.15.123:0/2429419362 >> v2:172.21.15.188:3300/0 conn(0x7feda4072ad0 msgr2=0x7feda40b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:13.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.230+0000 7feda2ffd640 1 --2- 172.21.15.123:0/2429419362 >> v2:172.21.15.188:3300/0 conn(0x7feda4072ad0 0x7feda40b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:13.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.230+0000 7feda2ffd640 1 -- 172.21.15.123:0/2429419362 >> v1:172.21.15.188:6789/0 conn(0x7feda40ccf30 legacy=0x7feda40cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:13.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.230+0000 7feda2ffd640 1 -- 172.21.15.123:0/2429419362 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda40715a0 con 0x7feda415b7c0 2024-09-15T23:17:13.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.230+0000 7feda2ffd640 1 -- 172.21.15.123:0/2429419362 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fed8c001670 con 0x7feda415b7c0 2024-09-15T23:17:13.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.230+0000 7feda2ffd640 1 -- 172.21.15.123:0/2429419362 >> v1:172.21.15.123:6789/0 conn(0x7feda415b7c0 legacy=0x7feda40cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:13.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.230+0000 7feda2ffd640 1 --2- 172.21.15.123:0/2429419362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed900039b0 0x7fed90003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:13.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.230+0000 7feda2ffd640 1 --2- 172.21.15.123:0/2429419362 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed90004800 0x7fed90004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:13.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.230+0000 7feda2ffd640 1 --2- 172.21.15.123:0/2429419362 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed900051c0 0x7fed9000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:13.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.230+0000 7feda2ffd640 1 -- 172.21.15.123:0/2429419362 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7feda40712c0 con 0x7fed900039b0 2024-09-15T23:17:13.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.230+0000 7feda2ffd640 1 -- 172.21.15.123:0/2429419362 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fed9000c160 con 0x7fed90004800 2024-09-15T23:17:13.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.230+0000 7feda2ffd640 1 -- 172.21.15.123:0/2429419362 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fed9000c360 con 0x7fed900051c0 2024-09-15T23:17:13.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.230+0000 7feda3fff640 1 --2- 172.21.15.123:0/2429419362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed900039b0 0x7fed90003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:13.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.230+0000 7feda37fe640 1 --2- 172.21.15.123:0/2429419362 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed90004800 0x7fed90004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:13.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.230+0000 7feda8f0a640 1 --2- 172.21.15.123:0/2429419362 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed900051c0 0x7fed9000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:13.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.231+0000 7feda3fff640 1 -- 172.21.15.123:0/2429419362 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed900051c0 msgr2=0x7fed9000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:13.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.231+0000 7feda3fff640 1 --2- 172.21.15.123:0/2429419362 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed900051c0 0x7fed9000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:13.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.231+0000 7feda3fff640 1 -- 172.21.15.123:0/2429419362 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed90004800 msgr2=0x7fed90004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:13.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.231+0000 7feda3fff640 1 --2- 172.21.15.123:0/2429419362 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed90004800 0x7fed90004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:13.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.231+0000 7feda3fff640 1 -- 172.21.15.123:0/2429419362 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed90003520 con 0x7fed900039b0 2024-09-15T23:17:13.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.231+0000 7feda8f0a640 1 -- 172.21.15.123:0/2429419362 reap_dead start 2024-09-15T23:17:13.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.231+0000 7feda3fff640 1 --2- 172.21.15.123:0/2429419362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed900039b0 0x7fed90003dd0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fed94001750 tx=0x7fed90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0c56f31a0fc41ea server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:13.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.231+0000 7feda2ffd640 1 -- 172.21.15.123:0/2429419362 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed94001370 con 0x7fed900039b0 2024-09-15T23:17:13.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.231+0000 7feda2ffd640 1 -- 172.21.15.123:0/2429419362 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed940052d0 con 0x7fed900039b0 2024-09-15T23:17:13.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.231+0000 7feda2ffd640 1 -- 172.21.15.123:0/2429419362 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed9402abc0 con 0x7fed900039b0 2024-09-15T23:17:13.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.232+0000 7fedaa96d640 1 -- 172.21.15.123:0/2429419362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed900039b0 msgr2=0x7fed90003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:13.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.232+0000 7fedaa96d640 1 --2- 172.21.15.123:0/2429419362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed900039b0 0x7fed90003dd0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fed94001750 tx=0x7fed90005830 comp rx=0 tx=0).stop 2024-09-15T23:17:13.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.232+0000 7fedaa96d640 1 -- 172.21.15.123:0/2429419362 shutdown_connections 2024-09-15T23:17:13.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.232+0000 7fedaa96d640 1 --2- 172.21.15.123:0/2429419362 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed900039b0 0x7fed90003dd0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:13.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.232+0000 7fedaa96d640 1 -- 172.21.15.123:0/2429419362 >> 172.21.15.123:0/2429419362 conn(0x7feda406d0f0 msgr2=0x7feda406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:13.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.232+0000 7fedaa96d640 1 -- 172.21.15.123:0/2429419362 shutdown_connections 2024-09-15T23:17:13.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.232+0000 7fedaa96d640 1 -- 172.21.15.123:0/2429419362 wait complete. 2024-09-15T23:17:13.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.233+0000 7fedaa96d640 1 Processor -- start 2024-09-15T23:17:13.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.233+0000 7fedaa96d640 1 -- start start 2024-09-15T23:17:13.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.234+0000 7fedaa96d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed900039b0 0x7feda4157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:13.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.234+0000 7fedaa96d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feda41f0fb0 0x7feda41f1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:13.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.234+0000 7fedaa96d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feda41599e0 0x7feda4159e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:13.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.234+0000 7fedaa96d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7feda40b2dd0 con 0x7feda41f0fb0 2024-09-15T23:17:13.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.234+0000 7fedaa96d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7feda40b2c50 con 0x7feda41599e0 2024-09-15T23:17:13.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.234+0000 7fedaa96d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7feda40b2f50 con 0x7fed900039b0 2024-09-15T23:17:13.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.234+0000 7feda37fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feda41f0fb0 0x7feda41f1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:13.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.234+0000 7feda37fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feda41f0fb0 0x7feda41f1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56412/0 (socket says 172.21.15.123:56412) 2024-09-15T23:17:13.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.234+0000 7feda37fe640 1 -- 172.21.15.123:0/413149134 learned_addr learned my addr 172.21.15.123:0/413149134 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:13.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.234+0000 7feda8f0a640 1 --2- 172.21.15.123:0/413149134 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feda41599e0 0x7feda4159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:13.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.234+0000 7feda3fff640 1 --2- 172.21.15.123:0/413149134 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed900039b0 0x7feda4157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:13.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.234+0000 7feda37fe640 1 -- 172.21.15.123:0/413149134 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed900039b0 msgr2=0x7feda4157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:13.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.234+0000 7feda37fe640 1 --2- 172.21.15.123:0/413149134 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed900039b0 0x7feda4157bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:13.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.234+0000 7feda37fe640 1 -- 172.21.15.123:0/413149134 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feda41599e0 msgr2=0x7feda4159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:13.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.234+0000 7feda37fe640 1 --2- 172.21.15.123:0/413149134 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feda41599e0 0x7feda4159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:13.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.234+0000 7feda37fe640 1 -- 172.21.15.123:0/413149134 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda4140e40 con 0x7feda41f0fb0 2024-09-15T23:17:13.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.235+0000 7feda37fe640 1 --2- 172.21.15.123:0/413149134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feda41f0fb0 0x7feda41f1430 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fed8c004a10 tx=0x7fed8c004ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:13.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.235+0000 7feda0ff9640 1 -- 172.21.15.123:0/413149134 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8c01c070 con 0x7feda41f0fb0 2024-09-15T23:17:13.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.235+0000 7feda0ff9640 1 -- 172.21.15.123:0/413149134 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed8c011c40 con 0x7feda41f0fb0 2024-09-15T23:17:13.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.235+0000 7fedaa96d640 1 -- 172.21.15.123:0/413149134 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feda415acd0 con 0x7feda41f0fb0 2024-09-15T23:17:13.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.235+0000 7feda0ff9640 1 -- 172.21.15.123:0/413149134 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8c010040 con 0x7feda41f0fb0 2024-09-15T23:17:13.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.235+0000 7fedaa96d640 1 -- 172.21.15.123:0/413149134 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feda415a9f0 con 0x7feda41f0fb0 2024-09-15T23:17:13.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.236+0000 7fedaa96d640 1 -- 172.21.15.123:0/413149134 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feda40cd310 con 0x7feda41f0fb0 2024-09-15T23:17:13.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.236+0000 7feda0ff9640 1 -- 172.21.15.123:0/413149134 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fed8c01f070 con 0x7feda41f0fb0 2024-09-15T23:17:13.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.237+0000 7feda0ff9640 1 --2- 172.21.15.123:0/413149134 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fed8406c2b0 0x7fed8406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:13.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.237+0000 7feda0ff9640 1 -- 172.21.15.123:0/413149134 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 5609+0+0 (secure 0 0 0) 0x7fed8c08d4d0 con 0x7feda41f0fb0 2024-09-15T23:17:13.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.237+0000 7feda3fff640 1 --2- 172.21.15.123:0/413149134 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fed8406c2b0 0x7fed8406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:13.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.238+0000 7feda3fff640 1 --2- 172.21.15.123:0/413149134 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fed8406c2b0 0x7fed8406e770 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fed94032000 tx=0x7fed9402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:13.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.241+0000 7feda0ff9640 1 -- 172.21.15.123:0/413149134 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fed8c05b7c0 con 0x7feda41f0fb0 2024-09-15T23:17:13.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:13.442+0000 7fedaa96d640 1 -- 172.21.15.123:0/413149134 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7feda40d0290 con 0x7feda41f0fb0 2024-09-15T23:17:14.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.118+0000 7feda0ff9640 1 -- 172.21.15.123:0/413149134 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v70) ==== 174+0+0 (secure 0 0 0) 0x7fed8c05fac0 con 0x7feda41f0fb0 2024-09-15T23:17:14.119 INFO:teuthology.orchestra.run.smithi123.stderr:new fs with metadata pool 14 and data pool 15 2024-09-15T23:17:14.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.124+0000 7fedaa96d640 1 -- 172.21.15.123:0/413149134 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fed8406c2b0 msgr2=0x7fed8406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:14.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.124+0000 7fedaa96d640 1 --2- 172.21.15.123:0/413149134 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fed8406c2b0 0x7fed8406e770 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fed94032000 tx=0x7fed9402e000 comp rx=0 tx=0).stop 2024-09-15T23:17:14.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.124+0000 7fedaa96d640 1 -- 172.21.15.123:0/413149134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feda41f0fb0 msgr2=0x7feda41f1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:14.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.124+0000 7fedaa96d640 1 --2- 172.21.15.123:0/413149134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feda41f0fb0 0x7feda41f1430 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fed8c004a10 tx=0x7fed8c004ed0 comp rx=0 tx=0).stop 2024-09-15T23:17:14.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.126+0000 7fedaa96d640 1 -- 172.21.15.123:0/413149134 shutdown_connections 2024-09-15T23:17:14.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.126+0000 7fedaa96d640 1 --2- 172.21.15.123:0/413149134 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feda41599e0 0x7feda4159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:14.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.126+0000 7fedaa96d640 1 --2- 172.21.15.123:0/413149134 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fed8406c2b0 0x7fed8406e770 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:14.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.126+0000 7fedaa96d640 1 --2- 172.21.15.123:0/413149134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feda41f0fb0 0x7feda41f1430 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:14.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.126+0000 7fedaa96d640 1 --2- 172.21.15.123:0/413149134 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed900039b0 0x7feda4157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:14.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.126+0000 7fedaa96d640 1 -- 172.21.15.123:0/413149134 >> 172.21.15.123:0/413149134 conn(0x7feda406d0f0 msgr2=0x7feda415fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:14.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.128+0000 7fedaa96d640 1 -- 172.21.15.123:0/413149134 shutdown_connections 2024-09-15T23:17:14.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.129+0000 7fedaa96d640 1 -- 172.21.15.123:0/413149134 wait complete. 2024-09-15T23:17:14.149 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:17:14.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.247+0000 7fa670dcf640 1 Processor -- start 2024-09-15T23:17:14.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.247+0000 7fa670dcf640 1 -- start start 2024-09-15T23:17:14.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.248+0000 7fa670dcf640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa66c06c320 0x7fa66c15bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:14.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.248+0000 7fa670dcf640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa66c071180 con 0x7fa66c0b2d40 2024-09-15T23:17:14.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.248+0000 7fa670dcf640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa66c071460 con 0x7fa66c13eb20 2024-09-15T23:17:14.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.248+0000 7fa670dcf640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa66c071ab0 con 0x7fa66c06c320 2024-09-15T23:17:14.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.249+0000 7fa66a59c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa66c0b2d40 0x7fa66c06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41510/0 (socket says 172.21.15.123:41510) 2024-09-15T23:17:14.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.249+0000 7fa66a59c640 1 -- 172.21.15.123:0/3366080699 learned_addr learned my addr 172.21.15.123:0/3366080699 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:17:14.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.249+0000 7fa669d9b640 1 --2- 172.21.15.123:0/3366080699 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa66c06c320 0x7fa66c15bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:14.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.249+0000 7fa66959a640 1 -- 172.21.15.123:0/3366080699 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3035598793 0 0) 0x7fa66c071180 con 0x7fa66c0b2d40 2024-09-15T23:17:14.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.249+0000 7fa66959a640 1 -- 172.21.15.123:0/3366080699 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa658005730 con 0x7fa66c0b2d40 2024-09-15T23:17:14.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.249+0000 7fa66959a640 1 -- 172.21.15.123:0/3366080699 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 953934737 0 0) 0x7fa658005730 con 0x7fa66c0b2d40 2024-09-15T23:17:14.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.249+0000 7fa66959a640 1 -- 172.21.15.123:0/3366080699 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa66c06c320 msgr2=0x7fa66c15bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:14.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.249+0000 7fa66959a640 1 --2- 172.21.15.123:0/3366080699 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa66c06c320 0x7fa66c15bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:14.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.249+0000 7fa66959a640 1 -- 172.21.15.123:0/3366080699 >> v1:172.21.15.188:6789/0 conn(0x7fa66c13eb20 legacy=0x7fa66c15c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:14.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.249+0000 7fa66959a640 1 -- 172.21.15.123:0/3366080699 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa66c071740 con 0x7fa66c0b2d40 2024-09-15T23:17:14.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.249+0000 7fa66959a640 1 -- 172.21.15.123:0/3366080699 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fa654001670 con 0x7fa66c0b2d40 2024-09-15T23:17:14.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.249+0000 7fa66959a640 1 -- 172.21.15.123:0/3366080699 >> v1:172.21.15.123:6789/0 conn(0x7fa66c0b2d40 legacy=0x7fa66c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:14.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.249+0000 7fa66959a640 1 --2- 172.21.15.123:0/3366080699 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa66c06c320 0x7fa658005bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:14.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.249+0000 7fa66959a640 1 --2- 172.21.15.123:0/3366080699 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa658006130 0x7fa658006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:14.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.249+0000 7fa66959a640 1 --2- 172.21.15.123:0/3366080699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa658006f50 0x7fa6580073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:14.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.249+0000 7fa66959a640 1 -- 172.21.15.123:0/3366080699 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c071ab0 con 0x7fa658006f50 2024-09-15T23:17:14.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.249+0000 7fa66959a640 1 -- 172.21.15.123:0/3366080699 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa65800dc30 con 0x7fa658006130 2024-09-15T23:17:14.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.249+0000 7fa66959a640 1 -- 172.21.15.123:0/3366080699 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa65800de30 con 0x7fa66c06c320 2024-09-15T23:17:14.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.249+0000 7fa66ad9d640 1 --2- 172.21.15.123:0/3366080699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa658006f50 0x7fa6580073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:14.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.249+0000 7fa66a59c640 1 --2- 172.21.15.123:0/3366080699 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa66c06c320 0x7fa658005bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:14.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.249+0000 7fa669d9b640 1 --2- 172.21.15.123:0/3366080699 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa658006130 0x7fa658006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:14.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.249+0000 7fa66ad9d640 1 -- 172.21.15.123:0/3366080699 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa66c06c320 msgr2=0x7fa658005bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:14.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.249+0000 7fa66ad9d640 1 --2- 172.21.15.123:0/3366080699 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa66c06c320 0x7fa658005bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:14.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.249+0000 7fa66ad9d640 1 -- 172.21.15.123:0/3366080699 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa658006130 msgr2=0x7fa658006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:14.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.250+0000 7fa66ad9d640 1 --2- 172.21.15.123:0/3366080699 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa658006130 0x7fa658006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:14.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.250+0000 7fa66ad9d640 1 -- 172.21.15.123:0/3366080699 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa658005730 con 0x7fa658006f50 2024-09-15T23:17:14.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.250+0000 7fa66ad9d640 1 --2- 172.21.15.123:0/3366080699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa658006f50 0x7fa6580073d0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fa664001f30 tx=0x7fa658007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb57e432214d127 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:14.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.250+0000 7fa66959a640 1 -- 172.21.15.123:0/3366080699 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa664001b30 con 0x7fa658006f50 2024-09-15T23:17:14.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.250+0000 7fa66959a640 1 -- 172.21.15.123:0/3366080699 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa664031620 con 0x7fa658006f50 2024-09-15T23:17:14.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.250+0000 7fa66959a640 1 -- 172.21.15.123:0/3366080699 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa664031a10 con 0x7fa658006f50 2024-09-15T23:17:14.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.251+0000 7fa670dcf640 1 -- 172.21.15.123:0/3366080699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa658006f50 msgr2=0x7fa6580073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:14.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.251+0000 7fa670dcf640 1 --2- 172.21.15.123:0/3366080699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa658006f50 0x7fa6580073d0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fa664001f30 tx=0x7fa658007a40 comp rx=0 tx=0).stop 2024-09-15T23:17:14.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.251+0000 7fa66ad9d640 1 -- 172.21.15.123:0/3366080699 reap_dead start 2024-09-15T23:17:14.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.251+0000 7fa670dcf640 1 -- 172.21.15.123:0/3366080699 shutdown_connections 2024-09-15T23:17:14.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.251+0000 7fa670dcf640 1 -- 172.21.15.123:0/3366080699 >> 172.21.15.123:0/3366080699 conn(0x7fa66c0ccec0 msgr2=0x7fa66c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:14.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.251+0000 7fa670dcf640 1 -- 172.21.15.123:0/3366080699 shutdown_connections 2024-09-15T23:17:14.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.251+0000 7fa670dcf640 1 -- 172.21.15.123:0/3366080699 wait complete. 2024-09-15T23:17:14.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.252+0000 7fa670dcf640 1 Processor -- start 2024-09-15T23:17:14.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.252+0000 7fa670dcf640 1 -- start start 2024-09-15T23:17:14.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.253+0000 7fa670dcf640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa658006f50 0x7fa66c15e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:14.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.253+0000 7fa670dcf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa66c1570e0 0x7fa66c157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:14.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.253+0000 7fa670dcf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa66c157a80 0x7fa66c141f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:14.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.253+0000 7fa670dcf640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c15c080 con 0x7fa66c1570e0 2024-09-15T23:17:14.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.253+0000 7fa670dcf640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa66c15bf00 con 0x7fa66c157a80 2024-09-15T23:17:14.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.253+0000 7fa670dcf640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa66c0b3570 con 0x7fa658006f50 2024-09-15T23:17:14.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.253+0000 7fa669d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa66c1570e0 0x7fa66c157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:14.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.253+0000 7fa669d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa66c1570e0 0x7fa66c157540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56442/0 (socket says 172.21.15.123:56442) 2024-09-15T23:17:14.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.253+0000 7fa669d9b640 1 -- 172.21.15.123:0/3417005159 learned_addr learned my addr 172.21.15.123:0/3417005159 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:14.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.253+0000 7fa66ad9d640 1 --2- 172.21.15.123:0/3417005159 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa66c157a80 0x7fa66c141f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:14.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.253+0000 7fa66a59c640 1 --2- 172.21.15.123:0/3417005159 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa658006f50 0x7fa66c15e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:14.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.253+0000 7fa669d9b640 1 -- 172.21.15.123:0/3417005159 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa658006f50 msgr2=0x7fa66c15e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:14.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.253+0000 7fa669d9b640 1 --2- 172.21.15.123:0/3417005159 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa658006f50 0x7fa66c15e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:14.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.253+0000 7fa669d9b640 1 -- 172.21.15.123:0/3417005159 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa66c157a80 msgr2=0x7fa66c141f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:14.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.253+0000 7fa669d9b640 1 --2- 172.21.15.123:0/3417005159 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa66c157a80 0x7fa66c141f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:14.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.253+0000 7fa669d9b640 1 -- 172.21.15.123:0/3417005159 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa66c141a70 con 0x7fa66c1570e0 2024-09-15T23:17:14.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.254+0000 7fa669d9b640 1 --2- 172.21.15.123:0/3417005159 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa66c1570e0 0x7fa66c157540 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fa65c011940 tx=0x7fa65c011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:14.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.254+0000 7fa662ffd640 1 -- 172.21.15.123:0/3417005159 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa65c019070 con 0x7fa66c1570e0 2024-09-15T23:17:14.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.254+0000 7fa662ffd640 1 -- 172.21.15.123:0/3417005159 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa65c004240 con 0x7fa66c1570e0 2024-09-15T23:17:14.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.254+0000 7fa662ffd640 1 -- 172.21.15.123:0/3417005159 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa65c00f8e0 con 0x7fa66c1570e0 2024-09-15T23:17:14.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.254+0000 7fa670dcf640 1 -- 172.21.15.123:0/3417005159 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa66c157f00 con 0x7fa66c1570e0 2024-09-15T23:17:14.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.254+0000 7fa670dcf640 1 -- 172.21.15.123:0/3417005159 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa66c15f110 con 0x7fa66c1570e0 2024-09-15T23:17:14.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.255+0000 7fa670dcf640 1 -- 172.21.15.123:0/3417005159 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa66c06bc10 con 0x7fa66c1570e0 2024-09-15T23:17:14.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.255+0000 7fa662ffd640 1 -- 172.21.15.123:0/3417005159 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa65c01c070 con 0x7fa66c1570e0 2024-09-15T23:17:14.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.256+0000 7fa662ffd640 1 --2- 172.21.15.123:0/3417005159 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa64c06c2b0 0x7fa64c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:14.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.256+0000 7fa662ffd640 1 -- 172.21.15.123:0/3417005159 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5709+0+0 (secure 0 0 0) 0x7fa65c08b810 con 0x7fa66c1570e0 2024-09-15T23:17:14.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.256+0000 7fa66a59c640 1 --2- 172.21.15.123:0/3417005159 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa64c06c2b0 0x7fa64c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:14.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.257+0000 7fa66a59c640 1 --2- 172.21.15.123:0/3417005159 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa64c06c2b0 0x7fa64c06e770 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa654007d90 tx=0x7fa6540078f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:14.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.260+0000 7fa662ffd640 1 -- 172.21.15.123:0/3417005159 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa65c059930 con 0x7fa66c1570e0 2024-09-15T23:17:14.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.428+0000 7fa670dcf640 1 -- 172.21.15.123:0/3417005159 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa66c0cdb10 con 0x7fa66c1570e0 2024-09-15T23:17:14.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.429+0000 7fa662ffd640 1 -- 172.21.15.123:0/3417005159 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) ==== 74+0+16716 (secure 0 0 0) 0x7fa65c05dc30 con 0x7fa66c1570e0 2024-09-15T23:17:14.430 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:17:14.430 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":113,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:17:13.443333+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:17:12.056649+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-15T23:17:12.415562+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:17:14.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.431+0000 7fa670dcf640 1 -- 172.21.15.123:0/3417005159 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa64c06c2b0 msgr2=0x7fa64c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:14.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.431+0000 7fa670dcf640 1 --2- 172.21.15.123:0/3417005159 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa64c06c2b0 0x7fa64c06e770 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa654007d90 tx=0x7fa6540078f0 comp rx=0 tx=0).stop 2024-09-15T23:17:14.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.431+0000 7fa670dcf640 1 -- 172.21.15.123:0/3417005159 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa66c1570e0 msgr2=0x7fa66c157540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:14.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.431+0000 7fa670dcf640 1 --2- 172.21.15.123:0/3417005159 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa66c1570e0 0x7fa66c157540 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fa65c011940 tx=0x7fa65c011e00 comp rx=0 tx=0).stop 2024-09-15T23:17:14.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.431+0000 7fa670dcf640 1 -- 172.21.15.123:0/3417005159 shutdown_connections 2024-09-15T23:17:14.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.431+0000 7fa670dcf640 1 --2- 172.21.15.123:0/3417005159 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa66c157a80 0x7fa66c141f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:14.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.431+0000 7fa670dcf640 1 --2- 172.21.15.123:0/3417005159 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa64c06c2b0 0x7fa64c06e770 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:14.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.431+0000 7fa670dcf640 1 --2- 172.21.15.123:0/3417005159 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa66c1570e0 0x7fa66c157540 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:14.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.431+0000 7fa670dcf640 1 --2- 172.21.15.123:0/3417005159 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa658006f50 0x7fa66c15e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:14.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.431+0000 7fa670dcf640 1 -- 172.21.15.123:0/3417005159 >> 172.21.15.123:0/3417005159 conn(0x7fa66c0ccec0 msgr2=0x7fa66c0ceb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:14.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.431+0000 7fa670dcf640 1 -- 172.21.15.123:0/3417005159 shutdown_connections 2024-09-15T23:17:14.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.431+0000 7fa670dcf640 1 -- 172.21.15.123:0/3417005159 wait complete. 2024-09-15T23:17:14.444 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:17:14.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.542+0000 7f9c33766640 1 Processor -- start 2024-09-15T23:17:14.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.542+0000 7f9c33766640 1 -- start start 2024-09-15T23:17:14.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.543+0000 7f9c33766640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f9c2c0b2d40 0x7f9c2c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:14.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.543+0000 7f9c33766640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9c2c06c150 0x7f9c2c15c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:14.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.543+0000 7f9c33766640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c2c071180 con 0x7f9c2c13eb20 2024-09-15T23:17:14.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.543+0000 7f9c33766640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f9c2c071ab0 con 0x7f9c2c0b2d40 2024-09-15T23:17:14.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.543+0000 7f9c33766640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9c2c071460 con 0x7f9c2c06c150 2024-09-15T23:17:14.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.543+0000 7f9c30d01640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f9c2c13eb20 0x7f9c2c15bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41518/0 (socket says 172.21.15.123:41518) 2024-09-15T23:17:14.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.543+0000 7f9c30d01640 1 -- 172.21.15.123:0/162328917 learned_addr learned my addr 172.21.15.123:0/162328917 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:17:14.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.543+0000 7f9c31502640 1 --2- 172.21.15.123:0/162328917 >> v2:172.21.15.188:3300/0 conn(0x7f9c2c0b2d40 0x7f9c2c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:14.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.543+0000 7f9c31d03640 1 --2- 172.21.15.123:0/162328917 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9c2c06c150 0x7f9c2c15c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:14.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.543+0000 7f9c23fff640 1 -- 172.21.15.123:0/162328917 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 119718696 0 0) 0x7f9c2c071180 con 0x7f9c2c13eb20 2024-09-15T23:17:14.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.543+0000 7f9c23fff640 1 -- 172.21.15.123:0/162328917 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c18003520 con 0x7f9c2c13eb20 2024-09-15T23:17:14.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.543+0000 7f9c23fff640 1 -- 172.21.15.123:0/162328917 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1704635732 0 0) 0x7f9c18003520 con 0x7f9c2c13eb20 2024-09-15T23:17:14.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.543+0000 7f9c31502640 1 -- 172.21.15.123:0/162328917 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9c2c06c150 msgr2=0x7f9c2c15c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:14.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.543+0000 7f9c31502640 1 --2- 172.21.15.123:0/162328917 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9c2c06c150 0x7f9c2c15c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:14.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.543+0000 7f9c31502640 1 -- 172.21.15.123:0/162328917 >> v1:172.21.15.123:6789/0 conn(0x7f9c2c13eb20 legacy=0x7f9c2c15bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:14.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.543+0000 7f9c31502640 1 -- 172.21.15.123:0/162328917 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c2c071740 con 0x7f9c2c0b2d40 2024-09-15T23:17:14.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.543+0000 7f9c31d03640 1 --2- 172.21.15.123:0/162328917 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9c2c06c150 0x7f9c2c15c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:17:14.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.544+0000 7f9c31502640 1 --2- 172.21.15.123:0/162328917 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9c2c0b2d40 0x7f9c2c06bc10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9c280097a0 tx=0x7f9c2802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f4e4accbce9ff07 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:14.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.544+0000 7f9c23fff640 1 -- 172.21.15.123:0/162328917 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c28037070 con 0x7f9c2c0b2d40 2024-09-15T23:17:14.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.544+0000 7f9c23fff640 1 -- 172.21.15.123:0/162328917 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c2802aba0 con 0x7f9c2c0b2d40 2024-09-15T23:17:14.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.544+0000 7f9c23fff640 1 -- 172.21.15.123:0/162328917 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c001670 con 0x7f9c2c0b2d40 2024-09-15T23:17:14.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.545+0000 7f9c33766640 1 -- 172.21.15.123:0/162328917 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9c2c0b2d40 msgr2=0x7f9c2c06bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:14.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.545+0000 7f9c33766640 1 --2- 172.21.15.123:0/162328917 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9c2c0b2d40 0x7f9c2c06bc10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9c280097a0 tx=0x7f9c2802a110 comp rx=0 tx=0).stop 2024-09-15T23:17:14.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.545+0000 7f9c33766640 1 -- 172.21.15.123:0/162328917 shutdown_connections 2024-09-15T23:17:14.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.545+0000 7f9c33766640 1 --2- 172.21.15.123:0/162328917 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9c2c06c150 0x7f9c2c15c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:14.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.545+0000 7f9c33766640 1 --2- 172.21.15.123:0/162328917 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9c2c0b2d40 0x7f9c2c06bc10 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:14.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.545+0000 7f9c33766640 1 -- 172.21.15.123:0/162328917 >> 172.21.15.123:0/162328917 conn(0x7f9c2c0ccec0 msgr2=0x7f9c2c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:14.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.545+0000 7f9c33766640 1 -- 172.21.15.123:0/162328917 shutdown_connections 2024-09-15T23:17:14.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.545+0000 7f9c33766640 1 -- 172.21.15.123:0/162328917 wait complete. 2024-09-15T23:17:14.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.546+0000 7f9c33766640 1 Processor -- start 2024-09-15T23:17:14.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.546+0000 7f9c33766640 1 -- start start 2024-09-15T23:17:14.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.547+0000 7f9c33766640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9c2c06c150 0x7f9c2c154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:14.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.547+0000 7f9c33766640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9c2c0b2d40 0x7f9c2c1f16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:14.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.547+0000 7f9c33766640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c2c13eb20 0x7f9c2c15d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:14.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.547+0000 7f9c33766640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2c0722d0 con 0x7f9c2c13eb20 2024-09-15T23:17:14.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.547+0000 7f9c33766640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2c072150 con 0x7f9c2c0b2d40 2024-09-15T23:17:14.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.547+0000 7f9c33766640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9c2c072450 con 0x7f9c2c06c150 2024-09-15T23:17:14.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.547+0000 7f9c31d03640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c2c13eb20 0x7f9c2c15d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:14.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.547+0000 7f9c31d03640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c2c13eb20 0x7f9c2c15d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56452/0 (socket says 172.21.15.123:56452) 2024-09-15T23:17:14.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.547+0000 7f9c31d03640 1 -- 172.21.15.123:0/1736211792 learned_addr learned my addr 172.21.15.123:0/1736211792 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:14.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.547+0000 7f9c31502640 1 --2- 172.21.15.123:0/1736211792 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9c2c06c150 0x7f9c2c154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:14.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.547+0000 7f9c30d01640 1 --2- 172.21.15.123:0/1736211792 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9c2c0b2d40 0x7f9c2c1f16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:14.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.547+0000 7f9c31d03640 1 -- 172.21.15.123:0/1736211792 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9c2c06c150 msgr2=0x7f9c2c154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:14.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.547+0000 7f9c31d03640 1 --2- 172.21.15.123:0/1736211792 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9c2c06c150 0x7f9c2c154150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:14.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.547+0000 7f9c31d03640 1 -- 172.21.15.123:0/1736211792 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9c2c0b2d40 msgr2=0x7f9c2c1f16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:14.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.547+0000 7f9c31d03640 1 --2- 172.21.15.123:0/1736211792 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9c2c0b2d40 0x7f9c2c1f16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:14.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.547+0000 7f9c31d03640 1 -- 172.21.15.123:0/1736211792 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c2c154690 con 0x7f9c2c13eb20 2024-09-15T23:17:14.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.547+0000 7f9c31d03640 1 --2- 172.21.15.123:0/1736211792 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c2c13eb20 0x7f9c2c15d8b0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f9c2400efc0 tx=0x7f9c24009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:14.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.548+0000 7f9c21ffb640 1 -- 172.21.15.123:0/1736211792 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c24018030 con 0x7f9c2c13eb20 2024-09-15T23:17:14.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.548+0000 7f9c21ffb640 1 -- 172.21.15.123:0/1736211792 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c2400cd80 con 0x7f9c2c13eb20 2024-09-15T23:17:14.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.548+0000 7f9c33766640 1 -- 172.21.15.123:0/1736211792 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c2c15ab90 con 0x7f9c2c13eb20 2024-09-15T23:17:14.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.548+0000 7f9c21ffb640 1 -- 172.21.15.123:0/1736211792 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c24003bb0 con 0x7f9c2c13eb20 2024-09-15T23:17:14.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.548+0000 7f9c33766640 1 -- 172.21.15.123:0/1736211792 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c2c15d360 con 0x7f9c2c13eb20 2024-09-15T23:17:14.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.549+0000 7f9c33766640 1 -- 172.21.15.123:0/1736211792 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c2c06bc10 con 0x7f9c2c13eb20 2024-09-15T23:17:14.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.549+0000 7f9c21ffb640 1 -- 172.21.15.123:0/1736211792 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9c24005d10 con 0x7f9c2c13eb20 2024-09-15T23:17:14.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.550+0000 7f9c21ffb640 1 --2- 172.21.15.123:0/1736211792 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9c1006c2b0 0x7f9c1006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:14.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.550+0000 7f9c21ffb640 1 -- 172.21.15.123:0/1736211792 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5709+0+0 (secure 0 0 0) 0x7f9c2408bd80 con 0x7f9c2c13eb20 2024-09-15T23:17:14.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.550+0000 7f9c31502640 1 --2- 172.21.15.123:0/1736211792 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9c1006c2b0 0x7f9c1006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:14.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.550+0000 7f9c31502640 1 --2- 172.21.15.123:0/1736211792 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9c1006c2b0 0x7f9c1006e770 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f9c28034000 tx=0x7f9c2802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:14.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.554+0000 7f9c21ffb640 1 -- 172.21.15.123:0/1736211792 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9c24022070 con 0x7f9c2c13eb20 2024-09-15T23:17:14.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.719+0000 7f9c33766640 1 -- 172.21.15.123:0/1736211792 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9c2c06c9c0 con 0x7f9c2c13eb20 2024-09-15T23:17:14.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.720+0000 7f9c21ffb640 1 -- 172.21.15.123:0/1736211792 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) ==== 74+0+16716 (secure 0 0 0) 0x7f9c24010040 con 0x7f9c2c13eb20 2024-09-15T23:17:14.722 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:17:14.722 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":113,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:17:13.443333+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:17:12.056649+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-15T23:17:12.415562+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:17:14.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.722+0000 7f9c33766640 1 -- 172.21.15.123:0/1736211792 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9c1006c2b0 msgr2=0x7f9c1006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:14.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.722+0000 7f9c33766640 1 --2- 172.21.15.123:0/1736211792 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9c1006c2b0 0x7f9c1006e770 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f9c28034000 tx=0x7f9c2802e000 comp rx=0 tx=0).stop 2024-09-15T23:17:14.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.722+0000 7f9c33766640 1 -- 172.21.15.123:0/1736211792 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c2c13eb20 msgr2=0x7f9c2c15d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:14.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.722+0000 7f9c33766640 1 --2- 172.21.15.123:0/1736211792 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c2c13eb20 0x7f9c2c15d8b0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f9c2400efc0 tx=0x7f9c24009f90 comp rx=0 tx=0).stop 2024-09-15T23:17:14.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.722+0000 7f9c33766640 1 -- 172.21.15.123:0/1736211792 shutdown_connections 2024-09-15T23:17:14.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.722+0000 7f9c33766640 1 --2- 172.21.15.123:0/1736211792 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9c1006c2b0 0x7f9c1006e770 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:14.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.722+0000 7f9c33766640 1 --2- 172.21.15.123:0/1736211792 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c2c13eb20 0x7f9c2c15d8b0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:14.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.722+0000 7f9c33766640 1 --2- 172.21.15.123:0/1736211792 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9c2c0b2d40 0x7f9c2c1f16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:14.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.722+0000 7f9c33766640 1 --2- 172.21.15.123:0/1736211792 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9c2c06c150 0x7f9c2c154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:14.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.722+0000 7f9c33766640 1 -- 172.21.15.123:0/1736211792 >> 172.21.15.123:0/1736211792 conn(0x7f9c2c0ccec0 msgr2=0x7f9c2c0cf580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:14.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.722+0000 7f9c33766640 1 -- 172.21.15.123:0/1736211792 shutdown_connections 2024-09-15T23:17:14.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.722+0000 7f9c33766640 1 -- 172.21.15.123:0/1736211792 wait complete. 2024-09-15T23:17:14.735 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T23:17:14.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.835+0000 7fdceca27640 1 Processor -- start 2024-09-15T23:17:14.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.835+0000 7fdceca27640 1 -- start start 2024-09-15T23:17:14.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.836+0000 7fdceca27640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fdce80732e0 0x7fdce80736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:14.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.836+0000 7fdceca27640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdce80cce30 0x7fdce80cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:14.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.836+0000 7fdceca27640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdce8071c70 0x7fdce80720e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:14.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.836+0000 7fdceca27640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fdce80714b0 con 0x7fdce80cce30 2024-09-15T23:17:14.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.836+0000 7fdceca27640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fdce8073c00 con 0x7fdce80732e0 2024-09-15T23:17:14.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.836+0000 7fdceca27640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fdce80cd880 con 0x7fdce8071c70 2024-09-15T23:17:14.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.836+0000 7fdce5d9b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdce80cce30 0x7fdce80cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:14.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.836+0000 7fdce5d9b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdce80cce30 0x7fdce80cd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56456/0 (socket says 172.21.15.123:56456) 2024-09-15T23:17:14.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.836+0000 7fdce5d9b640 1 -- 172.21.15.123:0/634979889 learned_addr learned my addr 172.21.15.123:0/634979889 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:14.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.836+0000 7fdce6d9d640 1 --2- 172.21.15.123:0/634979889 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdce8071c70 0x7fdce80720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:14.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.836+0000 7fdce659c640 1 --2- 172.21.15.123:0/634979889 >> v2:172.21.15.188:3300/0 conn(0x7fdce80732e0 0x7fdce80736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:14.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.836+0000 7fdce5d9b640 1 -- 172.21.15.123:0/634979889 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdce8071c70 msgr2=0x7fdce80720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:14.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.836+0000 7fdce5d9b640 1 --2- 172.21.15.123:0/634979889 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdce8071c70 0x7fdce80720e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:14.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.836+0000 7fdce5d9b640 1 -- 172.21.15.123:0/634979889 >> v2:172.21.15.188:3300/0 conn(0x7fdce80732e0 msgr2=0x7fdce80736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:14.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.836+0000 7fdce5d9b640 1 --2- 172.21.15.123:0/634979889 >> v2:172.21.15.188:3300/0 conn(0x7fdce80732e0 0x7fdce80736c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:14.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.836+0000 7fdce5d9b640 1 -- 172.21.15.123:0/634979889 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce80cdb60 con 0x7fdce80cce30 2024-09-15T23:17:14.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.836+0000 7fdce6d9d640 1 --2- 172.21.15.123:0/634979889 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdce8071c70 0x7fdce80720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:17:14.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.836+0000 7fdce659c640 1 --2- 172.21.15.123:0/634979889 >> v2:172.21.15.188:3300/0 conn(0x7fdce80732e0 0x7fdce80736c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:17:14.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.837+0000 7fdce5d9b640 1 --2- 172.21.15.123:0/634979889 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdce80cce30 0x7fdce80cd2a0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fdce80b6780 tx=0x7fdcdc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b8b403f7821d13b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:14.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.837+0000 7fdce559a640 1 -- 172.21.15.123:0/634979889 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc037070 con 0x7fdce80cce30 2024-09-15T23:17:14.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.837+0000 7fdce559a640 1 -- 172.21.15.123:0/634979889 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcdc032440 con 0x7fdce80cce30 2024-09-15T23:17:14.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.837+0000 7fdce559a640 1 -- 172.21.15.123:0/634979889 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc032810 con 0x7fdce80cce30 2024-09-15T23:17:14.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.838+0000 7fdceca27640 1 -- 172.21.15.123:0/634979889 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdce80cce30 msgr2=0x7fdce80cd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:14.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.838+0000 7fdceca27640 1 --2- 172.21.15.123:0/634979889 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdce80cce30 0x7fdce80cd2a0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fdce80b6780 tx=0x7fdcdc02a140 comp rx=0 tx=0).stop 2024-09-15T23:17:14.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.838+0000 7fdceca27640 1 -- 172.21.15.123:0/634979889 shutdown_connections 2024-09-15T23:17:14.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.838+0000 7fdceca27640 1 --2- 172.21.15.123:0/634979889 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdce8071c70 0x7fdce80720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:14.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.838+0000 7fdceca27640 1 --2- 172.21.15.123:0/634979889 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdce80cce30 0x7fdce80cd2a0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:14.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.838+0000 7fdceca27640 1 --2- 172.21.15.123:0/634979889 >> v2:172.21.15.188:3300/0 conn(0x7fdce80732e0 0x7fdce80736c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:14.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.838+0000 7fdceca27640 1 -- 172.21.15.123:0/634979889 >> 172.21.15.123:0/634979889 conn(0x7fdce806d0f0 msgr2=0x7fdce806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:14.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.838+0000 7fdceca27640 1 -- 172.21.15.123:0/634979889 shutdown_connections 2024-09-15T23:17:14.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.838+0000 7fdceca27640 1 -- 172.21.15.123:0/634979889 wait complete. 2024-09-15T23:17:14.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.839+0000 7fdceca27640 1 Processor -- start 2024-09-15T23:17:14.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.839+0000 7fdceca27640 1 -- start start 2024-09-15T23:17:14.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.840+0000 7fdceca27640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdce8071c70 0x7fdce80b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:14.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.840+0000 7fdceca27640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdce80732e0 0x7fdce81578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:14.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.840+0000 7fdceca27640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdce80cce30 0x7fdce81554b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:14.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.840+0000 7fdceca27640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdce806bf70 con 0x7fdce8071c70 2024-09-15T23:17:14.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.840+0000 7fdceca27640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fdce806bdf0 con 0x7fdce80732e0 2024-09-15T23:17:14.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.840+0000 7fdceca27640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fdce815c8d0 con 0x7fdce80cce30 2024-09-15T23:17:14.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.840+0000 7fdce659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdce8071c70 0x7fdce80b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:14.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.840+0000 7fdce659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdce8071c70 0x7fdce80b2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56462/0 (socket says 172.21.15.123:56462) 2024-09-15T23:17:14.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.840+0000 7fdce659c640 1 -- 172.21.15.123:0/2370823655 learned_addr learned my addr 172.21.15.123:0/2370823655 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:14.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.840+0000 7fdce6d9d640 1 --2- 172.21.15.123:0/2370823655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdce80cce30 0x7fdce81554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:14.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.840+0000 7fdce5d9b640 1 --2- 172.21.15.123:0/2370823655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdce80732e0 0x7fdce81578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:14.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.840+0000 7fdce659c640 1 -- 172.21.15.123:0/2370823655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdce80cce30 msgr2=0x7fdce81554b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:14.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.840+0000 7fdce659c640 1 --2- 172.21.15.123:0/2370823655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdce80cce30 0x7fdce81554b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:14.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.840+0000 7fdce659c640 1 -- 172.21.15.123:0/2370823655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdce80732e0 msgr2=0x7fdce81578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:14.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.840+0000 7fdce659c640 1 --2- 172.21.15.123:0/2370823655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdce80732e0 0x7fdce81578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:14.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.840+0000 7fdce659c640 1 -- 172.21.15.123:0/2370823655 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce8157e30 con 0x7fdce8071c70 2024-09-15T23:17:14.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.840+0000 7fdce659c640 1 --2- 172.21.15.123:0/2370823655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdce8071c70 0x7fdce80b2d10 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fdcd800e7e0 tx=0x7fdcd800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:14.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.841+0000 7fdcd6ffd640 1 -- 172.21.15.123:0/2370823655 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd800f040 con 0x7fdce8071c70 2024-09-15T23:17:14.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.841+0000 7fdcd6ffd640 1 -- 172.21.15.123:0/2370823655 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcd8004030 con 0x7fdce8071c70 2024-09-15T23:17:14.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.841+0000 7fdceca27640 1 -- 172.21.15.123:0/2370823655 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdce81583b0 con 0x7fdce8071c70 2024-09-15T23:17:14.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.841+0000 7fdcd6ffd640 1 -- 172.21.15.123:0/2370823655 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8004400 con 0x7fdce8071c70 2024-09-15T23:17:14.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.841+0000 7fdceca27640 1 -- 172.21.15.123:0/2370823655 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdce8158970 con 0x7fdce8071c70 2024-09-15T23:17:14.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.842+0000 7fdceca27640 1 -- 172.21.15.123:0/2370823655 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdce80736c0 con 0x7fdce8071c70 2024-09-15T23:17:14.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.842+0000 7fdcd6ffd640 1 -- 172.21.15.123:0/2370823655 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdcd800c6d0 con 0x7fdce8071c70 2024-09-15T23:17:14.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.843+0000 7fdcd6ffd640 1 --2- 172.21.15.123:0/2370823655 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdcc806c2e0 0x7fdcc806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:14.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.843+0000 7fdcd6ffd640 1 -- 172.21.15.123:0/2370823655 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5709+0+0 (secure 0 0 0) 0x7fdcd808b0f0 con 0x7fdce8071c70 2024-09-15T23:17:14.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.843+0000 7fdce5d9b640 1 --2- 172.21.15.123:0/2370823655 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdcc806c2e0 0x7fdcc806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:14.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.843+0000 7fdce5d9b640 1 --2- 172.21.15.123:0/2370823655 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdcc806c2e0 0x7fdcc806e7a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc034000 tx=0x7fdcdc02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:14.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:14.847+0000 7fdcd6ffd640 1 -- 172.21.15.123:0/2370823655 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdcd8017020 con 0x7fdce8071c70 2024-09-15T23:17:15.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.046+0000 7fdceca27640 1 -- 172.21.15.123:0/2370823655 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fdce80711f0 con 0x7fdce8071c70 2024-09-15T23:17:15.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.265+0000 7fdcd6ffd640 1 -- 172.21.15.123:0/2370823655 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v72) ==== 118+0+0 (secure 0 0 0) 0x7fdcd80598f0 con 0x7fdce8071c70 2024-09-15T23:17:15.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.267+0000 7fdceca27640 1 -- 172.21.15.123:0/2370823655 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdcc806c2e0 msgr2=0x7fdcc806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:15.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.267+0000 7fdceca27640 1 --2- 172.21.15.123:0/2370823655 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdcc806c2e0 0x7fdcc806e7a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc034000 tx=0x7fdcdc02e000 comp rx=0 tx=0).stop 2024-09-15T23:17:15.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.267+0000 7fdceca27640 1 -- 172.21.15.123:0/2370823655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdce8071c70 msgr2=0x7fdce80b2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:15.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.267+0000 7fdceca27640 1 --2- 172.21.15.123:0/2370823655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdce8071c70 0x7fdce80b2d10 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fdcd800e7e0 tx=0x7fdcd800eca0 comp rx=0 tx=0).stop 2024-09-15T23:17:15.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.267+0000 7fdceca27640 1 -- 172.21.15.123:0/2370823655 shutdown_connections 2024-09-15T23:17:15.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.267+0000 7fdceca27640 1 --2- 172.21.15.123:0/2370823655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdce80cce30 0x7fdce81554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:15.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.267+0000 7fdceca27640 1 --2- 172.21.15.123:0/2370823655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdce80732e0 0x7fdce81578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:15.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.267+0000 7fdceca27640 1 --2- 172.21.15.123:0/2370823655 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdcc806c2e0 0x7fdcc806e7a0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:15.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.267+0000 7fdceca27640 1 --2- 172.21.15.123:0/2370823655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdce8071c70 0x7fdce80b2d10 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:15.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.267+0000 7fdceca27640 1 -- 172.21.15.123:0/2370823655 >> 172.21.15.123:0/2370823655 conn(0x7fdce806d0f0 msgr2=0x7fdce80b5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:15.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.267+0000 7fdceca27640 1 -- 172.21.15.123:0/2370823655 shutdown_connections 2024-09-15T23:17:15.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.267+0000 7fdceca27640 1 -- 172.21.15.123:0/2370823655 wait complete. 2024-09-15T23:17:15.279 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T23:17:15.279 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T23:17:15.373 INFO:tasks.ceph.mds.c.smithi123.stderr:2024-09-15T23:17:15.372+0000 7f671bc74640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:17:15.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.379+0000 7fb6ec4ae640 1 Processor -- start 2024-09-15T23:17:15.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.379+0000 7fb6ec4ae640 1 -- start start 2024-09-15T23:17:15.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.381+0000 7fb6ec4ae640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb6e40afb90 0x7fb6e4162230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:15.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.381+0000 7fb6ec4ae640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb6e406c320 0x7fb6e40729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:15.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.381+0000 7fb6ec4ae640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6e4144090 con 0x7fb6e4158c80 2024-09-15T23:17:15.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.381+0000 7fb6ec4ae640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fb6e4141a00 con 0x7fb6e406c320 2024-09-15T23:17:15.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.381+0000 7fb6ec4ae640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fb6e4072f10 con 0x7fb6e40afb90 2024-09-15T23:17:15.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.381+0000 7fb6eaa4b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb6e406c320 0x7fb6e40729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:15.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.381+0000 7fb6eaa4b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb6e406c320 0x7fb6e40729d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56466/0 (socket says 172.21.15.123:56466) 2024-09-15T23:17:15.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.381+0000 7fb6eaa4b640 1 -- 172.21.15.123:0/592110076 learned_addr learned my addr 172.21.15.123:0/592110076 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:15.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.381+0000 7fb6ea24a640 1 --1- 172.21.15.123:0/592110076 >> v1:172.21.15.123:6789/0 conn(0x7fb6e4158c80 0x7fb6e406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41520/0 (socket says 172.21.15.123:41520) 2024-09-15T23:17:15.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.381+0000 7fb6eaa4b640 1 -- 172.21.15.123:0/592110076 >> v2:172.21.15.188:3300/0 conn(0x7fb6e40afb90 msgr2=0x7fb6e4162230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:15.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.381+0000 7fb6eaa4b640 1 --2- 172.21.15.123:0/592110076 >> v2:172.21.15.188:3300/0 conn(0x7fb6e40afb90 0x7fb6e4162230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:15.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.381+0000 7fb6eaa4b640 1 -- 172.21.15.123:0/592110076 >> v1:172.21.15.123:6789/0 conn(0x7fb6e4158c80 legacy=0x7fb6e406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:15.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.381+0000 7fb6eaa4b640 1 -- 172.21.15.123:0/592110076 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6e4144370 con 0x7fb6e406c320 2024-09-15T23:17:15.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.381+0000 7fb6e9248640 1 -- 172.21.15.123:0/592110076 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1058292320 0 0) 0x7fb6e4144090 con 0x7fb6e4158c80 2024-09-15T23:17:15.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.382+0000 7fb6eaa4b640 1 --2- 172.21.15.123:0/592110076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6e406c320 0x7fb6e40729d0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4070870 tx=0x7fb6dc02a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f15aca7939de3bae server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:15.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.382+0000 7fb6e9248640 1 -- 172.21.15.123:0/592110076 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc036070 con 0x7fb6e406c320 2024-09-15T23:17:15.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.382+0000 7fb6e9248640 1 -- 172.21.15.123:0/592110076 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6dc031600 con 0x7fb6e406c320 2024-09-15T23:17:15.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.382+0000 7fb6e9248640 1 -- 172.21.15.123:0/592110076 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc0319d0 con 0x7fb6e406c320 2024-09-15T23:17:15.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.382+0000 7fb6ec4ae640 1 -- 172.21.15.123:0/592110076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6e406c320 msgr2=0x7fb6e40729d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:15.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.382+0000 7fb6ec4ae640 1 --2- 172.21.15.123:0/592110076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6e406c320 0x7fb6e40729d0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4070870 tx=0x7fb6dc02a750 comp rx=0 tx=0).stop 2024-09-15T23:17:15.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.382+0000 7fb6ec4ae640 1 -- 172.21.15.123:0/592110076 shutdown_connections 2024-09-15T23:17:15.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.382+0000 7fb6ec4ae640 1 --2- 172.21.15.123:0/592110076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6e406c320 0x7fb6e40729d0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:15.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.382+0000 7fb6ec4ae640 1 --2- 172.21.15.123:0/592110076 >> v2:172.21.15.188:3300/0 conn(0x7fb6e40afb90 0x7fb6e4162230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:15.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.382+0000 7fb6ec4ae640 1 -- 172.21.15.123:0/592110076 >> 172.21.15.123:0/592110076 conn(0x7fb6e406cd20 msgr2=0x7fb6e406d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:15.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.383+0000 7fb6ec4ae640 1 -- 172.21.15.123:0/592110076 shutdown_connections 2024-09-15T23:17:15.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.383+0000 7fb6ec4ae640 1 -- 172.21.15.123:0/592110076 wait complete. 2024-09-15T23:17:15.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.384+0000 7fb6ec4ae640 1 Processor -- start 2024-09-15T23:17:15.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.384+0000 7fb6ec4ae640 1 -- start start 2024-09-15T23:17:15.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.384+0000 7fb6ec4ae640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb6e406c320 0x7fb6e413ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:15.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.384+0000 7fb6ec4ae640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6e40afb90 0x7fb6e4159260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:15.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.384+0000 7fb6ec4ae640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb6e4158c80 0x7fb6e41597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:15.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.384+0000 7fb6ec4ae640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e4144c10 con 0x7fb6e40afb90 2024-09-15T23:17:15.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.384+0000 7fb6ec4ae640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e4144930 con 0x7fb6e4158c80 2024-09-15T23:17:15.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.384+0000 7fb6ec4ae640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb6e4159060 con 0x7fb6e406c320 2024-09-15T23:17:15.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.384+0000 7fb6e9a49640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6e40afb90 0x7fb6e4159260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:15.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.384+0000 7fb6e9a49640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6e40afb90 0x7fb6e4159260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56482/0 (socket says 172.21.15.123:56482) 2024-09-15T23:17:15.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.385+0000 7fb6e9a49640 1 -- 172.21.15.123:0/466591671 learned_addr learned my addr 172.21.15.123:0/466591671 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:15.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.385+0000 7fb6eaa4b640 1 --2- 172.21.15.123:0/466591671 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb6e4158c80 0x7fb6e41597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:15.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.385+0000 7fb6e9a49640 1 -- 172.21.15.123:0/466591671 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb6e406c320 msgr2=0x7fb6e413ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:15.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.385+0000 7fb6ea24a640 1 --2- 172.21.15.123:0/466591671 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb6e406c320 0x7fb6e413ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:15.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.385+0000 7fb6e9a49640 1 --2- 172.21.15.123:0/466591671 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb6e406c320 0x7fb6e413ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:15.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.385+0000 7fb6e9a49640 1 -- 172.21.15.123:0/466591671 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb6e4158c80 msgr2=0x7fb6e41597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:15.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.385+0000 7fb6e9a49640 1 --2- 172.21.15.123:0/466591671 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb6e4158c80 0x7fb6e41597a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:15.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.385+0000 7fb6e9a49640 1 -- 172.21.15.123:0/466591671 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6e40b5d70 con 0x7fb6e40afb90 2024-09-15T23:17:15.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.385+0000 7fb6e9a49640 1 --2- 172.21.15.123:0/466591671 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6e40afb90 0x7fb6e4159260 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0006fd0 tx=0x7fb6e000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:15.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.385+0000 7fb6d6ffd640 1 -- 172.21.15.123:0/466591671 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e0011830 con 0x7fb6e40afb90 2024-09-15T23:17:15.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.385+0000 7fb6d6ffd640 1 -- 172.21.15.123:0/466591671 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6e0016070 con 0x7fb6e40afb90 2024-09-15T23:17:15.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.385+0000 7fb6ec4ae640 1 -- 172.21.15.123:0/466591671 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6e40b6050 con 0x7fb6e40afb90 2024-09-15T23:17:15.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.385+0000 7fb6d6ffd640 1 -- 172.21.15.123:0/466591671 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e0011c30 con 0x7fb6e40afb90 2024-09-15T23:17:15.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.385+0000 7fb6ec4ae640 1 -- 172.21.15.123:0/466591671 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6e40b6610 con 0x7fb6e40afb90 2024-09-15T23:17:15.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.386+0000 7fb6ec4ae640 1 -- 172.21.15.123:0/466591671 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6e40b6810 con 0x7fb6e40afb90 2024-09-15T23:17:15.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.386+0000 7fb6d6ffd640 1 -- 172.21.15.123:0/466591671 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb6e001b460 con 0x7fb6e40afb90 2024-09-15T23:17:15.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.387+0000 7fb6d6ffd640 1 --2- 172.21.15.123:0/466591671 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb6c806c2b0 0x7fb6c806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:15.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.387+0000 7fb6d6ffd640 1 -- 172.21.15.123:0/466591671 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5709+0+0 (secure 0 0 0) 0x7fb6e008b100 con 0x7fb6e40afb90 2024-09-15T23:17:15.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.387+0000 7fb6ea24a640 1 --2- 172.21.15.123:0/466591671 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb6c806c2b0 0x7fb6c806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:15.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.388+0000 7fb6ea24a640 1 --2- 172.21.15.123:0/466591671 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb6c806c2b0 0x7fb6c806e770 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8000f60 tx=0x7fb6d8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:15.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.391+0000 7fb6d6ffd640 1 -- 172.21.15.123:0/466591671 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb6e40b6810 con 0x7fb6e40afb90 2024-09-15T23:17:15.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:15.591+0000 7fb6ec4ae640 1 -- 172.21.15.123:0/466591671 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb6e4143d20 con 0x7fb6e40afb90 2024-09-15T23:17:16.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.272+0000 7fb6d6ffd640 1 -- 172.21.15.123:0/466591671 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v73) ==== 122+0+0 (secure 0 0 0) 0x7fb6e0059900 con 0x7fb6e40afb90 2024-09-15T23:17:16.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.274+0000 7fb6ec4ae640 1 -- 172.21.15.123:0/466591671 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb6c806c2b0 msgr2=0x7fb6c806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:16.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.274+0000 7fb6ec4ae640 1 --2- 172.21.15.123:0/466591671 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb6c806c2b0 0x7fb6c806e770 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8000f60 tx=0x7fb6d8009040 comp rx=0 tx=0).stop 2024-09-15T23:17:16.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.274+0000 7fb6ec4ae640 1 -- 172.21.15.123:0/466591671 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6e40afb90 msgr2=0x7fb6e4159260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:16.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.274+0000 7fb6ec4ae640 1 --2- 172.21.15.123:0/466591671 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6e40afb90 0x7fb6e4159260 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0006fd0 tx=0x7fb6e000b8e0 comp rx=0 tx=0).stop 2024-09-15T23:17:16.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.274+0000 7fb6ec4ae640 1 -- 172.21.15.123:0/466591671 shutdown_connections 2024-09-15T23:17:16.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.274+0000 7fb6ec4ae640 1 --2- 172.21.15.123:0/466591671 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb6e4158c80 0x7fb6e41597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:16.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.274+0000 7fb6ec4ae640 1 --2- 172.21.15.123:0/466591671 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb6c806c2b0 0x7fb6c806e770 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:16.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.274+0000 7fb6ec4ae640 1 --2- 172.21.15.123:0/466591671 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6e40afb90 0x7fb6e4159260 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:16.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.274+0000 7fb6ec4ae640 1 --2- 172.21.15.123:0/466591671 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb6e406c320 0x7fb6e413ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:16.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.274+0000 7fb6ec4ae640 1 -- 172.21.15.123:0/466591671 >> 172.21.15.123:0/466591671 conn(0x7fb6e406cd20 msgr2=0x7fb6e4142410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:16.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.274+0000 7fb6ec4ae640 1 -- 172.21.15.123:0/466591671 shutdown_connections 2024-09-15T23:17:16.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.274+0000 7fb6ec4ae640 1 -- 172.21.15.123:0/466591671 wait complete. 2024-09-15T23:17:16.287 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T23:17:16.287 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:17:16.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.385+0000 7f18f5efa640 1 Processor -- start 2024-09-15T23:17:16.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.385+0000 7f18f5efa640 1 -- start start 2024-09-15T23:17:16.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.386+0000 7f18f5efa640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f18f00b2d40 0x7f18f006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:16.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.386+0000 7f18f5efa640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f18f006c150 0x7f18f015c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:16.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.386+0000 7f18f5efa640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18f0071180 con 0x7f18f013eb20 2024-09-15T23:17:16.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.386+0000 7f18f5efa640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f18f0071ab0 con 0x7f18f00b2d40 2024-09-15T23:17:16.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.386+0000 7f18f5efa640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f18f0071460 con 0x7f18f006c150 2024-09-15T23:17:16.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.386+0000 7f18ef7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f18f00b2d40 0x7f18f006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:16.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.386+0000 7f18eeffd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f18f013eb20 0x7f18f015bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40546/0 (socket says 172.21.15.123:40546) 2024-09-15T23:17:16.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.386+0000 7f18ef7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f18f00b2d40 0x7f18f006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48118/0 (socket says 172.21.15.123:48118) 2024-09-15T23:17:16.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.386+0000 7f18eeffd640 1 -- 172.21.15.123:0/3486867648 learned_addr learned my addr 172.21.15.123:0/3486867648 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:17:16.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.386+0000 7f18effff640 1 --2- 172.21.15.123:0/3486867648 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f18f006c150 0x7f18f015c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:16.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.386+0000 7f18ef7fe640 1 -- 172.21.15.123:0/3486867648 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f18f006c150 msgr2=0x7f18f015c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:16.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.386+0000 7f18ef7fe640 1 --2- 172.21.15.123:0/3486867648 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f18f006c150 0x7f18f015c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:16.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.386+0000 7f18ef7fe640 1 -- 172.21.15.123:0/3486867648 >> v1:172.21.15.123:6789/0 conn(0x7f18f013eb20 legacy=0x7f18f015bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:16.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.387+0000 7f18ef7fe640 1 -- 172.21.15.123:0/3486867648 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18f0071740 con 0x7f18f00b2d40 2024-09-15T23:17:16.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.386+0000 7f18ee7fc640 1 -- 172.21.15.123:0/3486867648 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1635257045 0 0) 0x7f18f0071180 con 0x7f18f013eb20 2024-09-15T23:17:16.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.387+0000 7f18ef7fe640 1 --2- 172.21.15.123:0/3486867648 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18f00b2d40 0x7f18f006bc10 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f18e000ba40 tx=0x7f18e002c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8218007fe33644e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:16.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.387+0000 7f18ee7fc640 1 -- 172.21.15.123:0/3486867648 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e0032750 con 0x7f18f00b2d40 2024-09-15T23:17:16.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.387+0000 7f18ee7fc640 1 -- 172.21.15.123:0/3486867648 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18e0030050 con 0x7f18f00b2d40 2024-09-15T23:17:16.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.387+0000 7f18ee7fc640 1 -- 172.21.15.123:0/3486867648 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e0032b10 con 0x7f18f00b2d40 2024-09-15T23:17:16.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.388+0000 7f18f5efa640 1 -- 172.21.15.123:0/3486867648 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18f00b2d40 msgr2=0x7f18f006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:16.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.388+0000 7f18f5efa640 1 --2- 172.21.15.123:0/3486867648 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18f00b2d40 0x7f18f006bc10 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f18e000ba40 tx=0x7f18e002c850 comp rx=0 tx=0).stop 2024-09-15T23:17:16.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.388+0000 7f18f5efa640 1 -- 172.21.15.123:0/3486867648 shutdown_connections 2024-09-15T23:17:16.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.388+0000 7f18f5efa640 1 --2- 172.21.15.123:0/3486867648 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f18f006c150 0x7f18f015c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:16.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.388+0000 7f18f5efa640 1 --2- 172.21.15.123:0/3486867648 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18f00b2d40 0x7f18f006bc10 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:16.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.388+0000 7f18f5efa640 1 -- 172.21.15.123:0/3486867648 >> 172.21.15.123:0/3486867648 conn(0x7f18f00ccec0 msgr2=0x7f18f00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:16.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.388+0000 7f18f5efa640 1 -- 172.21.15.123:0/3486867648 shutdown_connections 2024-09-15T23:17:16.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.388+0000 7f18f5efa640 1 -- 172.21.15.123:0/3486867648 wait complete. 2024-09-15T23:17:16.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.389+0000 7f18f5efa640 1 Processor -- start 2024-09-15T23:17:16.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.389+0000 7f18f5efa640 1 -- start start 2024-09-15T23:17:16.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.390+0000 7f18f5efa640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f18f006c150 0x7f18f01582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:16.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.390+0000 7f18f5efa640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18f00b2d40 0x7f18f0155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:16.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.390+0000 7f18f5efa640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f18f013eb20 0x7f18f0156340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:16.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.390+0000 7f18f5efa640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f18f00722d0 con 0x7f18f00b2d40 2024-09-15T23:17:16.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.390+0000 7f18f5efa640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f18f0072150 con 0x7f18f013eb20 2024-09-15T23:17:16.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.390+0000 7f18f5efa640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f18f0072450 con 0x7f18f006c150 2024-09-15T23:17:16.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.390+0000 7f18eeffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18f00b2d40 0x7f18f0155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:16.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.390+0000 7f18eeffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18f00b2d40 0x7f18f0155e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48122/0 (socket says 172.21.15.123:48122) 2024-09-15T23:17:16.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.390+0000 7f18eeffd640 1 -- 172.21.15.123:0/422578979 learned_addr learned my addr 172.21.15.123:0/422578979 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:16.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.390+0000 7f18ef7fe640 1 --2- 172.21.15.123:0/422578979 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f18f006c150 0x7f18f01582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:16.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.390+0000 7f18effff640 1 --2- 172.21.15.123:0/422578979 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f18f013eb20 0x7f18f0156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:16.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.390+0000 7f18eeffd640 1 -- 172.21.15.123:0/422578979 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f18f006c150 msgr2=0x7f18f01582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:16.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.390+0000 7f18eeffd640 1 --2- 172.21.15.123:0/422578979 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f18f006c150 0x7f18f01582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:16.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.390+0000 7f18eeffd640 1 -- 172.21.15.123:0/422578979 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f18f013eb20 msgr2=0x7f18f0156340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:16.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.390+0000 7f18eeffd640 1 --2- 172.21.15.123:0/422578979 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f18f013eb20 0x7f18f0156340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:16.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.390+0000 7f18eeffd640 1 -- 172.21.15.123:0/422578979 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18f0158d60 con 0x7f18f00b2d40 2024-09-15T23:17:16.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.390+0000 7f18ef7fe640 1 --2- 172.21.15.123:0/422578979 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f18f006c150 0x7f18f01582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:17:16.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.391+0000 7f18eeffd640 1 --2- 172.21.15.123:0/422578979 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18f00b2d40 0x7f18f0155e00 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f18e400c410 tx=0x7f18e400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:16.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.391+0000 7f18d7fff640 1 -- 172.21.15.123:0/422578979 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e40074e0 con 0x7f18f00b2d40 2024-09-15T23:17:16.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.391+0000 7f18d7fff640 1 -- 172.21.15.123:0/422578979 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18e40047e0 con 0x7f18f00b2d40 2024-09-15T23:17:16.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.391+0000 7f18f5efa640 1 -- 172.21.15.123:0/422578979 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18f0159a50 con 0x7f18f00b2d40 2024-09-15T23:17:16.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.391+0000 7f18d7fff640 1 -- 172.21.15.123:0/422578979 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e4004bd0 con 0x7f18f00b2d40 2024-09-15T23:17:16.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.391+0000 7f18f5efa640 1 -- 172.21.15.123:0/422578979 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18f0159040 con 0x7f18f00b2d40 2024-09-15T23:17:16.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.392+0000 7f18f5efa640 1 -- 172.21.15.123:0/422578979 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18f006bc10 con 0x7f18f00b2d40 2024-09-15T23:17:16.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.392+0000 7f18d7fff640 1 -- 172.21.15.123:0/422578979 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f18e4011070 con 0x7f18f00b2d40 2024-09-15T23:17:16.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.393+0000 7f18d7fff640 1 --2- 172.21.15.123:0/422578979 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f18dc06c2b0 0x7f18dc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:16.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.393+0000 7f18d7fff640 1 -- 172.21.15.123:0/422578979 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5709+0+0 (secure 0 0 0) 0x7f18e408b0d0 con 0x7f18f00b2d40 2024-09-15T23:17:16.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.393+0000 7f18ef7fe640 1 --2- 172.21.15.123:0/422578979 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f18dc06c2b0 0x7f18dc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:16.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.393+0000 7f18ef7fe640 1 --2- 172.21.15.123:0/422578979 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f18dc06c2b0 0x7f18dc06e770 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f18e0037000 tx=0x7f18e0032000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:16.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.397+0000 7f18d7fff640 1 -- 172.21.15.123:0/422578979 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f18e4059840 con 0x7f18f00b2d40 2024-09-15T23:17:16.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.595+0000 7f18f5efa640 1 -- 172.21.15.123:0/422578979 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f18f006c9c0 con 0x7f18f00b2d40 2024-09-15T23:17:16.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.596+0000 7f18d7fff640 1 -- 172.21.15.123:0/422578979 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) ==== 94+0+5237 (secure 0 0 0) 0x7f18e4059140 con 0x7f18f00b2d40 2024-09-15T23:17:16.597 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:17:16.597 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":73,"btime":"2024-09-15T23:17:16:266707+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6158,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/3864460389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3864460389},{"type":"v1","addr":"172.21.15.188:6836","nonce":3864460389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":6769,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2483934450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2483934450},{"type":"v1","addr":"172.21.15.188:6837","nonce":2483934450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7605,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/1769288917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":1769288917},{"type":"v1","addr":"172.21.15.123:6834","nonce":1769288917}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:17:13.443625+0000","modified":"2024-09-15T23:17:15.592652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7608},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7608":{"gid":7608,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/3823805081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":3823805081},{"type":"v1","addr":"172.21.15.123:6835","nonce":3823805081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7608,"qdb_cluster":[7608]},"id":7}]} 2024-09-15T23:17:16.597 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 73 2024-09-15T23:17:16.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.597+0000 7f18f5efa640 1 -- 172.21.15.123:0/422578979 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f18dc06c2b0 msgr2=0x7f18dc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:16.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.597+0000 7f18f5efa640 1 --2- 172.21.15.123:0/422578979 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f18dc06c2b0 0x7f18dc06e770 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f18e0037000 tx=0x7f18e0032000 comp rx=0 tx=0).stop 2024-09-15T23:17:16.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.597+0000 7f18f5efa640 1 -- 172.21.15.123:0/422578979 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18f00b2d40 msgr2=0x7f18f0155e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:16.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.597+0000 7f18f5efa640 1 --2- 172.21.15.123:0/422578979 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18f00b2d40 0x7f18f0155e00 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f18e400c410 tx=0x7f18e400c8d0 comp rx=0 tx=0).stop 2024-09-15T23:17:16.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.597+0000 7f18f5efa640 1 -- 172.21.15.123:0/422578979 shutdown_connections 2024-09-15T23:17:16.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.597+0000 7f18f5efa640 1 --2- 172.21.15.123:0/422578979 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f18f013eb20 0x7f18f0156340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:16.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.597+0000 7f18f5efa640 1 --2- 172.21.15.123:0/422578979 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f18dc06c2b0 0x7f18dc06e770 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:16.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.597+0000 7f18f5efa640 1 --2- 172.21.15.123:0/422578979 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18f00b2d40 0x7f18f0155e00 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:16.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.597+0000 7f18f5efa640 1 --2- 172.21.15.123:0/422578979 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f18f006c150 0x7f18f01582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:16.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.597+0000 7f18f5efa640 1 -- 172.21.15.123:0/422578979 >> 172.21.15.123:0/422578979 conn(0x7f18f00ccec0 msgr2=0x7f18f00b3950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:16.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.598+0000 7f18f5efa640 1 -- 172.21.15.123:0/422578979 shutdown_connections 2024-09-15T23:17:16.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.598+0000 7f18f5efa640 1 -- 172.21.15.123:0/422578979 wait complete. 2024-09-15T23:17:16.610 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:17:16.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.707+0000 7f8225542640 1 Processor -- start 2024-09-15T23:17:16.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.707+0000 7f8225542640 1 -- start start 2024-09-15T23:17:16.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.708+0000 7f8225542640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f822015ed20 0x7f82200b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:16.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.708+0000 7f8225542640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f82200b90e0 0x7f82200b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:16.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.708+0000 7f8225542640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82200d0e70 con 0x7f82200d23b0 2024-09-15T23:17:16.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.708+0000 7f8225542640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f82200d41c0 con 0x7f822015ed20 2024-09-15T23:17:16.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.708+0000 7f8225542640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f82200d35b0 con 0x7f82200b90e0 2024-09-15T23:17:16.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.708+0000 7f821e7fc640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f82200d23b0 0x7f82200cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40562/0 (socket says 172.21.15.123:40562) 2024-09-15T23:17:16.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.708+0000 7f821e7fc640 1 -- 172.21.15.123:0/3484466593 learned_addr learned my addr 172.21.15.123:0/3484466593 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:17:16.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.708+0000 7f821effd640 1 --2- 172.21.15.123:0/3484466593 >> v2:172.21.15.188:3300/0 conn(0x7f822015ed20 0x7f82200b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:16.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.708+0000 7f821f7fe640 1 --2- 172.21.15.123:0/3484466593 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f82200b90e0 0x7f82200b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:16.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.708+0000 7f821dffb640 1 -- 172.21.15.123:0/3484466593 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 261278742 0 0) 0x7f8214001110 con 0x7f82200d23b0 2024-09-15T23:17:16.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.708+0000 7f821dffb640 1 -- 172.21.15.123:0/3484466593 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8208003520 con 0x7f82200d23b0 2024-09-15T23:17:16.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.709+0000 7f821dffb640 1 -- 172.21.15.123:0/3484466593 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3083770195 0 0) 0x7f8208003520 con 0x7f82200d23b0 2024-09-15T23:17:16.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.709+0000 7f821dffb640 1 -- 172.21.15.123:0/3484466593 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f82200b90e0 msgr2=0x7f82200b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:16.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.709+0000 7f821dffb640 1 --2- 172.21.15.123:0/3484466593 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f82200b90e0 0x7f82200b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:16.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.709+0000 7f821dffb640 1 -- 172.21.15.123:0/3484466593 >> v2:172.21.15.188:3300/0 conn(0x7f822015ed20 msgr2=0x7f82200b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:16.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.709+0000 7f821dffb640 1 --2- 172.21.15.123:0/3484466593 >> v2:172.21.15.188:3300/0 conn(0x7f822015ed20 0x7f82200b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:16.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.709+0000 7f821dffb640 1 -- 172.21.15.123:0/3484466593 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82200d3890 con 0x7f82200d23b0 2024-09-15T23:17:16.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.709+0000 7f821dffb640 1 -- 172.21.15.123:0/3484466593 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f8214001840 con 0x7f82200d23b0 2024-09-15T23:17:16.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.709+0000 7f821dffb640 1 -- 172.21.15.123:0/3484466593 >> v1:172.21.15.123:6789/0 conn(0x7f82200d23b0 legacy=0x7f82200cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:16.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.709+0000 7f821dffb640 1 --2- 172.21.15.123:0/3484466593 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f82200b90e0 0x7f82080039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:16.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.709+0000 7f821dffb640 1 --2- 172.21.15.123:0/3484466593 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8208003f30 0x7f8208004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:16.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.709+0000 7f821dffb640 1 --2- 172.21.15.123:0/3484466593 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8208004d40 0x7f82080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:16.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.709+0000 7f821dffb640 1 -- 172.21.15.123:0/3484466593 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f82200d41c0 con 0x7f8208004d40 2024-09-15T23:17:16.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.709+0000 7f821dffb640 1 -- 172.21.15.123:0/3484466593 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f82200d35b0 con 0x7f8208003f30 2024-09-15T23:17:16.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.709+0000 7f821dffb640 1 -- 172.21.15.123:0/3484466593 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f820800ba10 con 0x7f82200b90e0 2024-09-15T23:17:16.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.709+0000 7f821f7fe640 1 --2- 172.21.15.123:0/3484466593 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8208004d40 0x7f82080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:16.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.709+0000 7f821effd640 1 --2- 172.21.15.123:0/3484466593 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f82200b90e0 0x7f82080039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:16.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.709+0000 7f821e7fc640 1 --2- 172.21.15.123:0/3484466593 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8208003f30 0x7f8208004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:16.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.709+0000 7f821f7fe640 1 -- 172.21.15.123:0/3484466593 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f82200b90e0 msgr2=0x7f82080039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:16.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.709+0000 7f821f7fe640 1 --2- 172.21.15.123:0/3484466593 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f82200b90e0 0x7f82080039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:16.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.709+0000 7f821f7fe640 1 -- 172.21.15.123:0/3484466593 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8208003f30 msgr2=0x7f8208004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:16.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.709+0000 7f821f7fe640 1 --2- 172.21.15.123:0/3484466593 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8208003f30 0x7f8208004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:16.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.709+0000 7f821f7fe640 1 -- 172.21.15.123:0/3484466593 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8208003520 con 0x7f8208004d40 2024-09-15T23:17:16.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.710+0000 7f821f7fe640 1 --2- 172.21.15.123:0/3484466593 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8208004d40 0x7f82080051c0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f821800e170 tx=0x7f8208005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e32481b456f05528 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:16.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.710+0000 7f821dffb640 1 -- 172.21.15.123:0/3484466593 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8218034020 con 0x7f8208004d40 2024-09-15T23:17:16.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.710+0000 7f821dffb640 1 -- 172.21.15.123:0/3484466593 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82180305f0 con 0x7f8208004d40 2024-09-15T23:17:16.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.710+0000 7f821dffb640 1 -- 172.21.15.123:0/3484466593 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8218009c10 con 0x7f8208004d40 2024-09-15T23:17:16.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.711+0000 7f8225542640 1 -- 172.21.15.123:0/3484466593 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8208004d40 msgr2=0x7f82080051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:16.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.711+0000 7f8225542640 1 --2- 172.21.15.123:0/3484466593 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8208004d40 0x7f82080051c0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f821800e170 tx=0x7f8208005830 comp rx=0 tx=0).stop 2024-09-15T23:17:16.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.711+0000 7f821f7fe640 1 -- 172.21.15.123:0/3484466593 reap_dead start 2024-09-15T23:17:16.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.711+0000 7f8225542640 1 -- 172.21.15.123:0/3484466593 shutdown_connections 2024-09-15T23:17:16.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.711+0000 7f8225542640 1 -- 172.21.15.123:0/3484466593 >> 172.21.15.123:0/3484466593 conn(0x7f82200d1260 msgr2=0x7f82200d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:16.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.711+0000 7f8225542640 1 -- 172.21.15.123:0/3484466593 shutdown_connections 2024-09-15T23:17:16.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.711+0000 7f8225542640 1 -- 172.21.15.123:0/3484466593 wait complete. 2024-09-15T23:17:16.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.712+0000 7f8225542640 1 Processor -- start 2024-09-15T23:17:16.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.712+0000 7f8225542640 1 -- start start 2024-09-15T23:17:16.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.713+0000 7f8225542640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8208004d40 0x7f82201e9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:16.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.713+0000 7f8225542640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f822015a890 0x7f8220161a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:16.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.713+0000 7f8225542640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8220161fc0 0x7f82200cd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:16.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.713+0000 7f8225542640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f82200d32a0 con 0x7f8208004d40 2024-09-15T23:17:16.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.713+0000 7f8225542640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f82200d3e50 con 0x7f8220161fc0 2024-09-15T23:17:16.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.713+0000 7f8225542640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f822015f100 con 0x7f822015a890 2024-09-15T23:17:16.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.713+0000 7f821effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8208004d40 0x7f82201e9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:16.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.713+0000 7f821effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8208004d40 0x7f82201e9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48136/0 (socket says 172.21.15.123:48136) 2024-09-15T23:17:16.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.713+0000 7f821effd640 1 -- 172.21.15.123:0/2607896786 learned_addr learned my addr 172.21.15.123:0/2607896786 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:16.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.713+0000 7f821e7fc640 1 --2- 172.21.15.123:0/2607896786 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f822015a890 0x7f8220161a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:16.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.713+0000 7f821f7fe640 1 --2- 172.21.15.123:0/2607896786 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8220161fc0 0x7f82200cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:16.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.713+0000 7f821effd640 1 -- 172.21.15.123:0/2607896786 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f822015a890 msgr2=0x7f8220161a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:16.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.713+0000 7f821effd640 1 --2- 172.21.15.123:0/2607896786 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f822015a890 0x7f8220161a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:16.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.713+0000 7f821effd640 1 -- 172.21.15.123:0/2607896786 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8220161fc0 msgr2=0x7f82200cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:16.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.713+0000 7f821effd640 1 --2- 172.21.15.123:0/2607896786 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8220161fc0 0x7f82200cd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:16.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.713+0000 7f821effd640 1 -- 172.21.15.123:0/2607896786 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82201611d0 con 0x7f8208004d40 2024-09-15T23:17:16.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.713+0000 7f821effd640 1 --2- 172.21.15.123:0/2607896786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8208004d40 0x7f82201e9b60 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f8210011a70 tx=0x7f8210011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:16.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.713+0000 7f82077fe640 1 -- 172.21.15.123:0/2607896786 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821000fb50 con 0x7f8208004d40 2024-09-15T23:17:16.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.713+0000 7f82077fe640 1 -- 172.21.15.123:0/2607896786 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f821000fcf0 con 0x7f8208004d40 2024-09-15T23:17:16.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.713+0000 7f8225542640 1 -- 172.21.15.123:0/2607896786 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82201597f0 con 0x7f8208004d40 2024-09-15T23:17:16.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.713+0000 7f82077fe640 1 -- 172.21.15.123:0/2607896786 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821000fea0 con 0x7f8208004d40 2024-09-15T23:17:16.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.713+0000 7f8225542640 1 -- 172.21.15.123:0/2607896786 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8220159db0 con 0x7f8208004d40 2024-09-15T23:17:16.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.714+0000 7f8225542640 1 -- 172.21.15.123:0/2607896786 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82200b7010 con 0x7f8208004d40 2024-09-15T23:17:16.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.715+0000 7f82077fe640 1 -- 172.21.15.123:0/2607896786 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8210012040 con 0x7f8208004d40 2024-09-15T23:17:16.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.716+0000 7f82077fe640 1 --2- 172.21.15.123:0/2607896786 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f820c06c2e0 0x7f820c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:16.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.716+0000 7f82077fe640 1 -- 172.21.15.123:0/2607896786 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5709+0+0 (secure 0 0 0) 0x7f821008bb70 con 0x7f8208004d40 2024-09-15T23:17:16.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.716+0000 7f821e7fc640 1 --2- 172.21.15.123:0/2607896786 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f820c06c2e0 0x7f820c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:16.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.716+0000 7f821e7fc640 1 --2- 172.21.15.123:0/2607896786 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f820c06c2e0 0x7f820c06e7a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f82140012b0 tx=0x7f8214009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:16.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.720+0000 7f82077fe640 1 -- 172.21.15.123:0/2607896786 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f82201611d0 con 0x7f8208004d40 2024-09-15T23:17:16.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.885+0000 7f8225542640 1 -- 172.21.15.123:0/2607896786 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f82200b3f20 con 0x7f8208004d40 2024-09-15T23:17:16.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.886+0000 7f82077fe640 1 -- 172.21.15.123:0/2607896786 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) ==== 74+0+16703 (secure 0 0 0) 0x7f8210019030 con 0x7f8208004d40 2024-09-15T23:17:16.887 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:17:16.888 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":114,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:17:15.107894+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:17:12.056649+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-15T23:17:12.415562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:17:16.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.888+0000 7f8225542640 1 -- 172.21.15.123:0/2607896786 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f820c06c2e0 msgr2=0x7f820c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:16.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.888+0000 7f8225542640 1 --2- 172.21.15.123:0/2607896786 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f820c06c2e0 0x7f820c06e7a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f82140012b0 tx=0x7f8214009040 comp rx=0 tx=0).stop 2024-09-15T23:17:16.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.888+0000 7f8225542640 1 -- 172.21.15.123:0/2607896786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8208004d40 msgr2=0x7f82201e9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:16.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.888+0000 7f8225542640 1 --2- 172.21.15.123:0/2607896786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8208004d40 0x7f82201e9b60 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f8210011a70 tx=0x7f8210011f30 comp rx=0 tx=0).stop 2024-09-15T23:17:16.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.888+0000 7f8225542640 1 -- 172.21.15.123:0/2607896786 shutdown_connections 2024-09-15T23:17:16.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.888+0000 7f8225542640 1 --2- 172.21.15.123:0/2607896786 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8220161fc0 0x7f82200cd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:16.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.888+0000 7f8225542640 1 --2- 172.21.15.123:0/2607896786 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f822015a890 0x7f8220161a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:16.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.888+0000 7f8225542640 1 --2- 172.21.15.123:0/2607896786 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f820c06c2e0 0x7f820c06e7a0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:16.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.888+0000 7f8225542640 1 --2- 172.21.15.123:0/2607896786 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8208004d40 0x7f82201e9b60 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:16.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.888+0000 7f8225542640 1 -- 172.21.15.123:0/2607896786 >> 172.21.15.123:0/2607896786 conn(0x7f82200d1260 msgr2=0x7f82200cf0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:16.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.888+0000 7f8225542640 1 -- 172.21.15.123:0/2607896786 shutdown_connections 2024-09-15T23:17:16.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.888+0000 7f8225542640 1 -- 172.21.15.123:0/2607896786 wait complete. 2024-09-15T23:17:16.901 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T23:17:16.901 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:17:16.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.997+0000 7ffa72274640 1 Processor -- start 2024-09-15T23:17:16.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.997+0000 7ffa72274640 1 -- start start 2024-09-15T23:17:17.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.998+0000 7ffa72274640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa6c0b02b0 0x7ffa6c06e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:17.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.998+0000 7ffa72274640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa6c067b50 con 0x7ffa6c0b6830 2024-09-15T23:17:17.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.998+0000 7ffa72274640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa6c0ce860 con 0x7ffa6c15c4b0 2024-09-15T23:17:17.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.998+0000 7ffa72274640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ffa6c070130 con 0x7ffa6c0b02b0 2024-09-15T23:17:17.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.998+0000 7ffa6b7fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ffa6c0b6830 0x7ffa6c06e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40574/0 (socket says 172.21.15.123:40574) 2024-09-15T23:17:17.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.998+0000 7ffa6b7fe640 1 -- 172.21.15.123:0/1758576676 learned_addr learned my addr 172.21.15.123:0/1758576676 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:17:17.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.998+0000 7ffa6affd640 1 -- 172.21.15.123:0/1758576676 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4160805169 0 0) 0x7ffa60001110 con 0x7ffa6c0b6830 2024-09-15T23:17:17.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.998+0000 7ffa6affd640 1 -- 172.21.15.123:0/1758576676 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa54003520 con 0x7ffa6c0b6830 2024-09-15T23:17:17.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.998+0000 7ffa70811640 1 --2- 172.21.15.123:0/1758576676 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa6c0b02b0 0x7ffa6c06e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:17.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.998+0000 7ffa6affd640 1 -- 172.21.15.123:0/1758576676 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 148105256 0 0) 0x7ffa54003520 con 0x7ffa6c0b6830 2024-09-15T23:17:17.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.998+0000 7ffa6affd640 1 -- 172.21.15.123:0/1758576676 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa6c0b02b0 msgr2=0x7ffa6c06e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:17.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.998+0000 7ffa6affd640 1 --2- 172.21.15.123:0/1758576676 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa6c0b02b0 0x7ffa6c06e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:17.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.998+0000 7ffa6affd640 1 -- 172.21.15.123:0/1758576676 >> v1:172.21.15.188:6789/0 conn(0x7ffa6c15c4b0 legacy=0x7ffa6c0b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:17.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.998+0000 7ffa6affd640 1 -- 172.21.15.123:0/1758576676 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa6c06fe50 con 0x7ffa6c0b6830 2024-09-15T23:17:17.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.998+0000 7ffa6affd640 1 -- 172.21.15.123:0/1758576676 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7ffa60001840 con 0x7ffa6c0b6830 2024-09-15T23:17:17.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.998+0000 7ffa6affd640 1 -- 172.21.15.123:0/1758576676 >> v1:172.21.15.123:6789/0 conn(0x7ffa6c0b6830 legacy=0x7ffa6c06e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:17.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.998+0000 7ffa6affd640 1 --2- 172.21.15.123:0/1758576676 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa540039e0 0x7ffa54003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:17.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.999+0000 7ffa6affd640 1 --2- 172.21.15.123:0/1758576676 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa6c0b02b0 0x7ffa54004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:17.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.999+0000 7ffa6affd640 1 --2- 172.21.15.123:0/1758576676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa54004d40 0x7ffa540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:17.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.999+0000 7ffa6affd640 1 -- 172.21.15.123:0/1758576676 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6c070130 con 0x7ffa54004d40 2024-09-15T23:17:17.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.999+0000 7ffa6affd640 1 -- 172.21.15.123:0/1758576676 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ffa5400baa0 con 0x7ffa540039e0 2024-09-15T23:17:17.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.999+0000 7ffa6affd640 1 -- 172.21.15.123:0/1758576676 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ffa5400bca0 con 0x7ffa6c0b02b0 2024-09-15T23:17:17.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.999+0000 7ffa70811640 1 --2- 172.21.15.123:0/1758576676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa54004d40 0x7ffa540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:17.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.999+0000 7ffa6bfff640 1 --2- 172.21.15.123:0/1758576676 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa540039e0 0x7ffa54003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:17.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.999+0000 7ffa6b7fe640 1 --2- 172.21.15.123:0/1758576676 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa6c0b02b0 0x7ffa54004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:17.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.999+0000 7ffa70811640 1 -- 172.21.15.123:0/1758576676 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa6c0b02b0 msgr2=0x7ffa54004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:17.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.999+0000 7ffa70811640 1 --2- 172.21.15.123:0/1758576676 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa6c0b02b0 0x7ffa54004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:17.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.999+0000 7ffa70811640 1 -- 172.21.15.123:0/1758576676 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa540039e0 msgr2=0x7ffa54003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:17.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.999+0000 7ffa70811640 1 --2- 172.21.15.123:0/1758576676 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa540039e0 0x7ffa54003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:17.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:16.999+0000 7ffa70811640 1 -- 172.21.15.123:0/1758576676 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa54003520 con 0x7ffa54004d40 2024-09-15T23:17:17.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.000+0000 7ffa70811640 1 --2- 172.21.15.123:0/1758576676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa54004d40 0x7ffa540051c0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0b06f0 tx=0x7ffa54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad2b2145209bda8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:17.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.000+0000 7ffa6affd640 1 -- 172.21.15.123:0/1758576676 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa64037070 con 0x7ffa54004d40 2024-09-15T23:17:17.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.000+0000 7ffa6affd640 1 -- 172.21.15.123:0/1758576676 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa6402e050 con 0x7ffa54004d40 2024-09-15T23:17:17.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.000+0000 7ffa6affd640 1 -- 172.21.15.123:0/1758576676 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa64009c10 con 0x7ffa54004d40 2024-09-15T23:17:17.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.000+0000 7ffa72274640 1 -- 172.21.15.123:0/1758576676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa54004d40 msgr2=0x7ffa540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:17.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.000+0000 7ffa72274640 1 --2- 172.21.15.123:0/1758576676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa54004d40 0x7ffa540051c0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0b06f0 tx=0x7ffa54005830 comp rx=0 tx=0).stop 2024-09-15T23:17:17.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.000+0000 7ffa70811640 1 -- 172.21.15.123:0/1758576676 reap_dead start 2024-09-15T23:17:17.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.000+0000 7ffa72274640 1 -- 172.21.15.123:0/1758576676 shutdown_connections 2024-09-15T23:17:17.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.000+0000 7ffa72274640 1 -- 172.21.15.123:0/1758576676 >> 172.21.15.123:0/1758576676 conn(0x7ffa6c0b0a80 msgr2=0x7ffa6c0b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:17.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.000+0000 7ffa72274640 1 -- 172.21.15.123:0/1758576676 shutdown_connections 2024-09-15T23:17:17.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.000+0000 7ffa72274640 1 -- 172.21.15.123:0/1758576676 wait complete. 2024-09-15T23:17:17.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.001+0000 7ffa72274640 1 Processor -- start 2024-09-15T23:17:17.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.002+0000 7ffa72274640 1 -- start start 2024-09-15T23:17:17.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.002+0000 7ffa72274640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa54004d40 0x7ffa6c15eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:17.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.002+0000 7ffa72274640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa6c15a4a0 0x7ffa6c149560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:17.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.002+0000 7ffa72274640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa6c0aad70 0x7ffa6c0ab1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:17.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.002+0000 7ffa72274640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6c06dcc0 con 0x7ffa54004d40 2024-09-15T23:17:17.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.002+0000 7ffa72274640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6c0ce580 con 0x7ffa6c15a4a0 2024-09-15T23:17:17.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.002+0000 7ffa72274640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ffa6c15c890 con 0x7ffa6c0aad70 2024-09-15T23:17:17.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.002+0000 7ffa6bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa54004d40 0x7ffa6c15eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:17.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.002+0000 7ffa6bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa54004d40 0x7ffa6c15eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48150/0 (socket says 172.21.15.123:48150) 2024-09-15T23:17:17.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.002+0000 7ffa6bfff640 1 -- 172.21.15.123:0/3306202968 learned_addr learned my addr 172.21.15.123:0/3306202968 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:17.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.003+0000 7ffa70811640 1 --2- 172.21.15.123:0/3306202968 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa6c0aad70 0x7ffa6c0ab1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:17.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.003+0000 7ffa6b7fe640 1 --2- 172.21.15.123:0/3306202968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa6c15a4a0 0x7ffa6c149560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:17.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.003+0000 7ffa6bfff640 1 -- 172.21.15.123:0/3306202968 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa6c0aad70 msgr2=0x7ffa6c0ab1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:17.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.003+0000 7ffa6bfff640 1 --2- 172.21.15.123:0/3306202968 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa6c0aad70 0x7ffa6c0ab1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:17.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.003+0000 7ffa6bfff640 1 -- 172.21.15.123:0/3306202968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa6c15a4a0 msgr2=0x7ffa6c149560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:17.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.003+0000 7ffa6bfff640 1 --2- 172.21.15.123:0/3306202968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa6c15a4a0 0x7ffa6c149560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:17.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.003+0000 7ffa6bfff640 1 -- 172.21.15.123:0/3306202968 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa6c15ac10 con 0x7ffa54004d40 2024-09-15T23:17:17.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.003+0000 7ffa6b7fe640 1 --2- 172.21.15.123:0/3306202968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa6c15a4a0 0x7ffa6c149560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:17:17.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.003+0000 7ffa6bfff640 1 --2- 172.21.15.123:0/3306202968 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa54004d40 0x7ffa6c15eb50 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c00f820 tx=0x7ffa5c00fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:17.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.003+0000 7ffa68ff9640 1 -- 172.21.15.123:0/3306202968 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c0050d0 con 0x7ffa54004d40 2024-09-15T23:17:17.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.003+0000 7ffa68ff9640 1 -- 172.21.15.123:0/3306202968 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa5c018070 con 0x7ffa54004d40 2024-09-15T23:17:17.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.003+0000 7ffa72274640 1 -- 172.21.15.123:0/3306202968 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa6c15aef0 con 0x7ffa54004d40 2024-09-15T23:17:17.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.003+0000 7ffa68ff9640 1 -- 172.21.15.123:0/3306202968 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c005490 con 0x7ffa54004d40 2024-09-15T23:17:17.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.003+0000 7ffa72274640 1 -- 172.21.15.123:0/3306202968 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa6c15b4b0 con 0x7ffa54004d40 2024-09-15T23:17:17.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.004+0000 7ffa72274640 1 -- 172.21.15.123:0/3306202968 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa6c0d08e0 con 0x7ffa54004d40 2024-09-15T23:17:17.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.005+0000 7ffa68ff9640 1 -- 172.21.15.123:0/3306202968 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ffa5c00d730 con 0x7ffa54004d40 2024-09-15T23:17:17.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.005+0000 7ffa68ff9640 1 --2- 172.21.15.123:0/3306202968 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ffa5806c2e0 0x7ffa5806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:17.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.005+0000 7ffa68ff9640 1 -- 172.21.15.123:0/3306202968 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5709+0+0 (secure 0 0 0) 0x7ffa5c08b210 con 0x7ffa54004d40 2024-09-15T23:17:17.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.005+0000 7ffa6b7fe640 1 --2- 172.21.15.123:0/3306202968 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ffa5806c2e0 0x7ffa5806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:17.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.006+0000 7ffa6b7fe640 1 --2- 172.21.15.123:0/3306202968 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ffa5806c2e0 0x7ffa5806e7a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c15f290 tx=0x7ffa60009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:17.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.009+0000 7ffa68ff9640 1 -- 172.21.15.123:0/3306202968 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffa5c059a10 con 0x7ffa54004d40 2024-09-15T23:17:17.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.172+0000 7ffa72274640 1 -- 172.21.15.123:0/3306202968 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffa6c071cd0 con 0x7ffa5806c2e0 2024-09-15T23:17:17.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.178+0000 7ffa68ff9640 1 -- 172.21.15.123:0/3306202968 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241672 (secure 0 0 0) 0x7ffa6c071cd0 con 0x7ffa5806c2e0 2024-09-15T23:17:17.181 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:17:17.183 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:17:17.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.181+0000 7ffa72274640 1 -- 172.21.15.123:0/3306202968 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ffa5806c2e0 msgr2=0x7ffa5806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:17.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.181+0000 7ffa72274640 1 --2- 172.21.15.123:0/3306202968 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ffa5806c2e0 0x7ffa5806e7a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c15f290 tx=0x7ffa60009040 comp rx=0 tx=0).stop 2024-09-15T23:17:17.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.181+0000 7ffa72274640 1 -- 172.21.15.123:0/3306202968 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa54004d40 msgr2=0x7ffa6c15eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:17.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.181+0000 7ffa72274640 1 --2- 172.21.15.123:0/3306202968 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa54004d40 0x7ffa6c15eb50 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c00f820 tx=0x7ffa5c00fce0 comp rx=0 tx=0).stop 2024-09-15T23:17:17.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.181+0000 7ffa72274640 1 -- 172.21.15.123:0/3306202968 shutdown_connections 2024-09-15T23:17:17.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.181+0000 7ffa72274640 1 --2- 172.21.15.123:0/3306202968 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa6c0aad70 0x7ffa6c0ab1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:17.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.181+0000 7ffa72274640 1 --2- 172.21.15.123:0/3306202968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa6c15a4a0 0x7ffa6c149560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:17.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.181+0000 7ffa72274640 1 --2- 172.21.15.123:0/3306202968 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ffa5806c2e0 0x7ffa5806e7a0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:17.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.181+0000 7ffa72274640 1 --2- 172.21.15.123:0/3306202968 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa54004d40 0x7ffa6c15eb50 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:17.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.181+0000 7ffa72274640 1 -- 172.21.15.123:0/3306202968 >> 172.21.15.123:0/3306202968 conn(0x7ffa6c0b0a80 msgr2=0x7ffa6c0724d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:17.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.181+0000 7ffa72274640 1 -- 172.21.15.123:0/3306202968 shutdown_connections 2024-09-15T23:17:17.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.181+0000 7ffa72274640 1 -- 172.21.15.123:0/3306202968 wait complete. 2024-09-15T23:17:17.192 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":264,"stamp":"2024-09-15T23:17:15.574594+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":84,"acting":84,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":302836,"kb_used_data":11700,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754671884,"statfs":{"total":773094113280,"available":772784009216,"internally_reserved":0,"allocated":11980800,"data_stored":5910617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":297913904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000842"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.104133+0000","last_change":"2024-09-15T23:17:13.104133+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.104133+0000","last_undegraded":"2024-09-15T23:17:13.104133+0000","last_fullsized":"2024-09-15T23:17:13.104133+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.101901+0000","last_change":"2024-09-15T23:17:13.101901+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.101901+0000","last_undegraded":"2024-09-15T23:17:13.101901+0000","last_fullsized":"2024-09-15T23:17:13.101901+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.102308+0000","last_change":"2024-09-15T23:17:13.102308+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.102308+0000","last_undegraded":"2024-09-15T23:17:13.102308+0000","last_fullsized":"2024-09-15T23:17:13.102308+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.103556+0000","last_change":"2024-09-15T23:17:13.103556+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.103556+0000","last_undegraded":"2024-09-15T23:17:13.103556+0000","last_fullsized":"2024-09-15T23:17:13.103556+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.106231+0000","last_change":"2024-09-15T23:17:13.106231+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.106231+0000","last_undegraded":"2024-09-15T23:17:13.106231+0000","last_fullsized":"2024-09-15T23:17:13.106231+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.106027+0000","last_change":"2024-09-15T23:17:13.106027+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.106027+0000","last_undegraded":"2024-09-15T23:17:13.106027+0000","last_fullsized":"2024-09-15T23:17:13.106027+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.106694+0000","last_change":"2024-09-15T23:17:13.106694+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.106694+0000","last_undegraded":"2024-09-15T23:17:13.106694+0000","last_fullsized":"2024-09-15T23:17:13.106694+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.102341+0000","last_change":"2024-09-15T23:17:13.102341+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.102341+0000","last_undegraded":"2024-09-15T23:17:13.102341+0000","last_fullsized":"2024-09-15T23:17:13.102341+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.106292+0000","last_change":"2024-09-15T23:17:13.106292+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.106292+0000","last_undegraded":"2024-09-15T23:17:13.106292+0000","last_fullsized":"2024-09-15T23:17:13.106292+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.106750+0000","last_change":"2024-09-15T23:17:13.106750+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.106750+0000","last_undegraded":"2024-09-15T23:17:13.106750+0000","last_fullsized":"2024-09-15T23:17:13.106750+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.106036+0000","last_change":"2024-09-15T23:17:13.106036+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.106036+0000","last_undegraded":"2024-09-15T23:17:13.106036+0000","last_fullsized":"2024-09-15T23:17:13.106036+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.108049+0000","last_change":"2024-09-15T23:17:13.108049+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.108049+0000","last_undegraded":"2024-09-15T23:17:13.108049+0000","last_fullsized":"2024-09-15T23:17:13.108049+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.107769+0000","last_change":"2024-09-15T23:17:13.107769+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.107769+0000","last_undegraded":"2024-09-15T23:17:13.107769+0000","last_fullsized":"2024-09-15T23:17:13.107769+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.119121+0000","last_change":"2024-09-15T23:17:13.115752+0000","last_active":"2024-09-15T23:17:13.119121+0000","last_peered":"2024-09-15T23:17:13.119121+0000","last_clean":"2024-09-15T23:17:13.119121+0000","last_became_active":"2024-09-15T23:17:13.114959+0000","last_became_peered":"2024-09-15T23:17:13.114959+0000","last_unstale":"2024-09-15T23:17:13.119121+0000","last_undegraded":"2024-09-15T23:17:13.119121+0000","last_fullsized":"2024-09-15T23:17:13.119121+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:52:26.259605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.105624+0000","last_change":"2024-09-15T23:17:13.105624+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.105624+0000","last_undegraded":"2024-09-15T23:17:13.105624+0000","last_fullsized":"2024-09-15T23:17:13.105624+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.105392+0000","last_change":"2024-09-15T23:17:13.105392+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.105392+0000","last_undegraded":"2024-09-15T23:17:13.105392+0000","last_fullsized":"2024-09-15T23:17:13.105392+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.103763+0000","last_change":"2024-09-15T23:17:13.103763+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.103763+0000","last_undegraded":"2024-09-15T23:17:13.103763+0000","last_fullsized":"2024-09-15T23:17:13.103763+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.111495+0000","last_change":"2024-09-15T23:17:13.105562+0000","last_active":"2024-09-15T23:17:13.111495+0000","last_peered":"2024-09-15T23:17:13.111495+0000","last_clean":"2024-09-15T23:17:13.111495+0000","last_became_active":"2024-09-15T23:17:13.105267+0000","last_became_peered":"2024-09-15T23:17:13.105267+0000","last_unstale":"2024-09-15T23:17:13.111495+0000","last_undegraded":"2024-09-15T23:17:13.111495+0000","last_fullsized":"2024-09-15T23:17:13.111495+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:20:15.465328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.105367+0000","last_change":"2024-09-15T23:17:13.105367+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.105367+0000","last_undegraded":"2024-09-15T23:17:13.105367+0000","last_fullsized":"2024-09-15T23:17:13.105367+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.108131+0000","last_change":"2024-09-15T23:17:13.108131+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.108131+0000","last_undegraded":"2024-09-15T23:17:13.108131+0000","last_fullsized":"2024-09-15T23:17:13.108131+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.101926+0000","last_change":"2024-09-15T23:17:13.101926+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.101926+0000","last_undegraded":"2024-09-15T23:17:13.101926+0000","last_fullsized":"2024-09-15T23:17:13.101926+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.111145+0000","last_change":"2024-09-15T23:17:13.107378+0000","last_active":"2024-09-15T23:17:13.111145+0000","last_peered":"2024-09-15T23:17:13.111145+0000","last_clean":"2024-09-15T23:17:13.111145+0000","last_became_active":"2024-09-15T23:17:13.107092+0000","last_became_peered":"2024-09-15T23:17:13.107092+0000","last_unstale":"2024-09-15T23:17:13.111145+0000","last_undegraded":"2024-09-15T23:17:13.111145+0000","last_fullsized":"2024-09-15T23:17:13.111145+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:49.003531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.108493+0000","last_change":"2024-09-15T23:17:13.108493+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.108493+0000","last_undegraded":"2024-09-15T23:17:13.108493+0000","last_fullsized":"2024-09-15T23:17:13.108493+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.118962+0000","last_change":"2024-09-15T23:17:13.115247+0000","last_active":"2024-09-15T23:17:13.118962+0000","last_peered":"2024-09-15T23:17:13.118962+0000","last_clean":"2024-09-15T23:17:13.118962+0000","last_became_active":"2024-09-15T23:17:13.114968+0000","last_became_peered":"2024-09-15T23:17:13.114968+0000","last_unstale":"2024-09-15T23:17:13.118962+0000","last_undegraded":"2024-09-15T23:17:13.118962+0000","last_fullsized":"2024-09-15T23:17:13.118962+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:30:12.355202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.101884+0000","last_change":"2024-09-15T23:17:13.101884+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.101884+0000","last_undegraded":"2024-09-15T23:17:13.101884+0000","last_fullsized":"2024-09-15T23:17:13.101884+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.113359+0000","last_change":"2024-09-15T23:17:13.108829+0000","last_active":"2024-09-15T23:17:13.113359+0000","last_peered":"2024-09-15T23:17:13.113359+0000","last_clean":"2024-09-15T23:17:13.113359+0000","last_became_active":"2024-09-15T23:17:13.108553+0000","last_became_peered":"2024-09-15T23:17:13.108553+0000","last_unstale":"2024-09-15T23:17:13.113359+0000","last_undegraded":"2024-09-15T23:17:13.113359+0000","last_fullsized":"2024-09-15T23:17:13.113359+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:25.965813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.107693+0000","last_change":"2024-09-15T23:17:13.107693+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.107693+0000","last_undegraded":"2024-09-15T23:17:13.107693+0000","last_fullsized":"2024-09-15T23:17:13.107693+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.119007+0000","last_change":"2024-09-15T23:17:13.115236+0000","last_active":"2024-09-15T23:17:13.119007+0000","last_peered":"2024-09-15T23:17:13.119007+0000","last_clean":"2024-09-15T23:17:13.119007+0000","last_became_active":"2024-09-15T23:17:13.114937+0000","last_became_peered":"2024-09-15T23:17:13.114937+0000","last_unstale":"2024-09-15T23:17:13.119007+0000","last_undegraded":"2024-09-15T23:17:13.119007+0000","last_fullsized":"2024-09-15T23:17:13.119007+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:48.038067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.106914+0000","last_change":"2024-09-15T23:17:13.106914+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.106914+0000","last_undegraded":"2024-09-15T23:17:13.106914+0000","last_fullsized":"2024-09-15T23:17:13.106914+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.119081+0000","last_change":"2024-09-15T23:17:13.113950+0000","last_active":"2024-09-15T23:17:13.119081+0000","last_peered":"2024-09-15T23:17:13.119081+0000","last_clean":"2024-09-15T23:17:13.119081+0000","last_became_active":"2024-09-15T23:17:13.113680+0000","last_became_peered":"2024-09-15T23:17:13.113680+0000","last_unstale":"2024-09-15T23:17:13.119081+0000","last_undegraded":"2024-09-15T23:17:13.119081+0000","last_fullsized":"2024-09-15T23:17:13.119081+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:21.358088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.104924+0000","last_change":"2024-09-15T23:17:13.104924+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.104924+0000","last_undegraded":"2024-09-15T23:17:13.104924+0000","last_fullsized":"2024-09-15T23:17:13.104924+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.121726+0000","last_change":"2024-09-15T23:17:13.115998+0000","last_active":"2024-09-15T23:17:13.121726+0000","last_peered":"2024-09-15T23:17:13.121726+0000","last_clean":"2024-09-15T23:17:13.121726+0000","last_became_active":"2024-09-15T23:17:13.115703+0000","last_became_peered":"2024-09-15T23:17:13.115703+0000","last_unstale":"2024-09-15T23:17:13.121726+0000","last_undegraded":"2024-09-15T23:17:13.121726+0000","last_fullsized":"2024-09-15T23:17:13.121726+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:06:48.045653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.121676+0000","last_change":"2024-09-15T23:17:13.115923+0000","last_active":"2024-09-15T23:17:13.121676+0000","last_peered":"2024-09-15T23:17:13.121676+0000","last_clean":"2024-09-15T23:17:13.121676+0000","last_became_active":"2024-09-15T23:17:13.115642+0000","last_became_peered":"2024-09-15T23:17:13.115642+0000","last_unstale":"2024-09-15T23:17:13.121676+0000","last_undegraded":"2024-09-15T23:17:13.121676+0000","last_fullsized":"2024-09-15T23:17:13.121676+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:39.622535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.105629+0000","last_change":"2024-09-15T23:17:13.105629+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.105629+0000","last_undegraded":"2024-09-15T23:17:13.105629+0000","last_fullsized":"2024-09-15T23:17:13.105629+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.116106+0000","last_change":"2024-09-15T23:17:13.111438+0000","last_active":"2024-09-15T23:17:13.116106+0000","last_peered":"2024-09-15T23:17:13.116106+0000","last_clean":"2024-09-15T23:17:13.116106+0000","last_became_active":"2024-09-15T23:17:13.111139+0000","last_became_peered":"2024-09-15T23:17:13.111139+0000","last_unstale":"2024-09-15T23:17:13.116106+0000","last_undegraded":"2024-09-15T23:17:13.116106+0000","last_fullsized":"2024-09-15T23:17:13.116106+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:05.175799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.103127+0000","last_change":"2024-09-15T23:17:13.103127+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.103127+0000","last_undegraded":"2024-09-15T23:17:13.103127+0000","last_fullsized":"2024-09-15T23:17:13.103127+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.118923+0000","last_change":"2024-09-15T23:17:13.113961+0000","last_active":"2024-09-15T23:17:13.118923+0000","last_peered":"2024-09-15T23:17:13.118923+0000","last_clean":"2024-09-15T23:17:13.118923+0000","last_became_active":"2024-09-15T23:17:13.113690+0000","last_became_peered":"2024-09-15T23:17:13.113690+0000","last_unstale":"2024-09-15T23:17:13.118923+0000","last_undegraded":"2024-09-15T23:17:13.118923+0000","last_fullsized":"2024-09-15T23:17:13.118923+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:39.622535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.103335+0000","last_change":"2024-09-15T23:17:13.103335+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.103335+0000","last_undegraded":"2024-09-15T23:17:13.103335+0000","last_fullsized":"2024-09-15T23:17:13.103335+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.118956+0000","last_change":"2024-09-15T23:17:13.114546+0000","last_active":"2024-09-15T23:17:13.118956+0000","last_peered":"2024-09-15T23:17:13.118956+0000","last_clean":"2024-09-15T23:17:13.118956+0000","last_became_active":"2024-09-15T23:17:13.114310+0000","last_became_peered":"2024-09-15T23:17:13.114310+0000","last_unstale":"2024-09-15T23:17:13.118956+0000","last_undegraded":"2024-09-15T23:17:13.118956+0000","last_fullsized":"2024-09-15T23:17:13.118956+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:42:38.571629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.104922+0000","last_change":"2024-09-15T23:17:13.104922+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.104922+0000","last_undegraded":"2024-09-15T23:17:13.104922+0000","last_fullsized":"2024-09-15T23:17:13.104922+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.118953+0000","last_change":"2024-09-15T23:17:13.115287+0000","last_active":"2024-09-15T23:17:13.118953+0000","last_peered":"2024-09-15T23:17:13.118953+0000","last_clean":"2024-09-15T23:17:13.118953+0000","last_became_active":"2024-09-15T23:17:13.114980+0000","last_became_peered":"2024-09-15T23:17:13.114980+0000","last_unstale":"2024-09-15T23:17:13.118953+0000","last_undegraded":"2024-09-15T23:17:13.118953+0000","last_fullsized":"2024-09-15T23:17:13.118953+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:24.484954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":335,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.100707+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:17:13.100707+0000","last_peered":"2024-09-15T23:17:13.100707+0000","last_clean":"2024-09-15T23:17:13.100707+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:17:13.100707+0000","last_undegraded":"2024-09-15T23:17:13.100707+0000","last_fullsized":"2024-09-15T23:17:13.100707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":56,"acting":56,"num_store_stats":4},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":26,"acting":26,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476804,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40856,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330984,"statfs":{"total":96636764160,"available":96594927616,"internally_reserved":0,"allocated":1372160,"data_stored":602102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476801,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40836,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331004,"statfs":{"total":96636764160,"available":96594948096,"internally_reserved":0,"allocated":1359872,"data_stored":595827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476803,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37276,"kb_used_data":1920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334564,"statfs":{"total":96636764160,"available":96598593536,"internally_reserved":0,"allocated":1966080,"data_stored":1192470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36680,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335160,"statfs":{"total":96636764160,"available":96599203840,"internally_reserved":0,"allocated":1359872,"data_stored":595827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542209,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36660,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335180,"statfs":{"total":96636764160,"available":96599224320,"internally_reserved":0,"allocated":1335296,"data_stored":584813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542209,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36640,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335200,"statfs":{"total":96636764160,"available":96599244800,"internally_reserved":0,"allocated":1323008,"data_stored":579584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542208,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37236,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334604,"statfs":{"total":96636764160,"available":96598634496,"internally_reserved":0,"allocated":1929216,"data_stored":1175181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542210,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36652,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335188,"statfs":{"total":96636764160,"available":96599232512,"internally_reserved":0,"allocated":1335296,"data_stored":584813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:17:17.197 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:17:17.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.330+0000 7eff0e19f640 1 Processor -- start 2024-09-15T23:17:17.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.330+0000 7eff0e19f640 1 -- start start 2024-09-15T23:17:17.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.331+0000 7eff0e19f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7eff080cf670 0x7eff0815df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:17.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.331+0000 7eff0e19f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7eff080b7a30 0x7eff0815e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:17.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.331+0000 7eff0e19f640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff080cfb40 con 0x7eff080b63f0 2024-09-15T23:17:17.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.331+0000 7eff0e19f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7eff080d27f0 con 0x7eff080cf670 2024-09-15T23:17:17.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.331+0000 7eff0e19f640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7eff080cfe20 con 0x7eff080b7a30 2024-09-15T23:17:17.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.331+0000 7eff0c99c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7eff080cf670 0x7eff0815df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:17.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.331+0000 7eff0c99c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7eff080cf670 0x7eff0815df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48154/0 (socket says 172.21.15.123:48154) 2024-09-15T23:17:17.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.331+0000 7eff0d19d640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7eff080b63f0 0x7eff080cef60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40578/0 (socket says 172.21.15.123:40578) 2024-09-15T23:17:17.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.331+0000 7eff0c99c640 1 -- 172.21.15.123:0/162086684 learned_addr learned my addr 172.21.15.123:0/162086684 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:17.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.331+0000 7eff0d99e640 1 --2- 172.21.15.123:0/162086684 >> v2:172.21.15.188:3300/0 conn(0x7eff080b7a30 0x7eff0815e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:17.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.331+0000 7eff0c99c640 1 -- 172.21.15.123:0/162086684 >> v2:172.21.15.188:3300/0 conn(0x7eff080b7a30 msgr2=0x7eff0815e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:17.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.331+0000 7eff0c99c640 1 --2- 172.21.15.123:0/162086684 >> v2:172.21.15.188:3300/0 conn(0x7eff080b7a30 0x7eff0815e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:17.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.331+0000 7eff0c99c640 1 -- 172.21.15.123:0/162086684 >> v1:172.21.15.123:6789/0 conn(0x7eff080b63f0 legacy=0x7eff080cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:17.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.331+0000 7eff0c99c640 1 -- 172.21.15.123:0/162086684 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff080d2e00 con 0x7eff080cf670 2024-09-15T23:17:17.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.331+0000 7efefffff640 1 -- 172.21.15.123:0/162086684 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1019544464 0 0) 0x7eff080cfb40 con 0x7eff080b63f0 2024-09-15T23:17:17.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.332+0000 7eff0c99c640 1 --2- 172.21.15.123:0/162086684 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff080cf670 0x7eff0815df80 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7eff080d0790 tx=0x7efef802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=428ab9f0b9411bdf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:17.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.332+0000 7efefffff640 1 -- 172.21.15.123:0/162086684 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef8037070 con 0x7eff080cf670 2024-09-15T23:17:17.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.332+0000 7efefffff640 1 -- 172.21.15.123:0/162086684 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efef8032440 con 0x7eff080cf670 2024-09-15T23:17:17.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.332+0000 7efefffff640 1 -- 172.21.15.123:0/162086684 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef8032810 con 0x7eff080cf670 2024-09-15T23:17:17.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.332+0000 7eff0e19f640 1 -- 172.21.15.123:0/162086684 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff080cf670 msgr2=0x7eff0815df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:17.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.332+0000 7eff0e19f640 1 --2- 172.21.15.123:0/162086684 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff080cf670 0x7eff0815df80 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7eff080d0790 tx=0x7efef802a1e0 comp rx=0 tx=0).stop 2024-09-15T23:17:17.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.333+0000 7eff0e19f640 1 -- 172.21.15.123:0/162086684 shutdown_connections 2024-09-15T23:17:17.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.333+0000 7eff0e19f640 1 --2- 172.21.15.123:0/162086684 >> v2:172.21.15.188:3300/0 conn(0x7eff080b7a30 0x7eff0815e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:17.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.333+0000 7eff0e19f640 1 --2- 172.21.15.123:0/162086684 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff080cf670 0x7eff0815df80 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:17.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.333+0000 7eff0e19f640 1 -- 172.21.15.123:0/162086684 >> 172.21.15.123:0/162086684 conn(0x7eff080d1360 msgr2=0x7eff080d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:17.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.333+0000 7eff0e19f640 1 -- 172.21.15.123:0/162086684 shutdown_connections 2024-09-15T23:17:17.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.333+0000 7eff0e19f640 1 -- 172.21.15.123:0/162086684 wait complete. 2024-09-15T23:17:17.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.334+0000 7eff0e19f640 1 Processor -- start 2024-09-15T23:17:17.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.334+0000 7eff0e19f640 1 -- start start 2024-09-15T23:17:17.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.334+0000 7eff0e19f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7eff080b63f0 0x7eff080cc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:17.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.334+0000 7eff0e19f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff080b7a30 0x7eff080c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:17.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.334+0000 7eff0e19f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7eff080cf670 0x7eff080c8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:17.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.334+0000 7eff0e19f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7eff0815eb80 con 0x7eff080b7a30 2024-09-15T23:17:17.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.334+0000 7eff0e19f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7eff0815ea00 con 0x7eff080cf670 2024-09-15T23:17:17.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.334+0000 7eff0e19f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7eff080b67d0 con 0x7eff080b63f0 2024-09-15T23:17:17.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.335+0000 7eff0c99c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff080b7a30 0x7eff080c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:17.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.335+0000 7eff0c99c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff080b7a30 0x7eff080c81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48160/0 (socket says 172.21.15.123:48160) 2024-09-15T23:17:17.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.335+0000 7eff0c99c640 1 -- 172.21.15.123:0/2763589486 learned_addr learned my addr 172.21.15.123:0/2763589486 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:17.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.335+0000 7eff0d99e640 1 --2- 172.21.15.123:0/2763589486 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7eff080cf670 0x7eff080c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:17.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.335+0000 7eff0d19d640 1 --2- 172.21.15.123:0/2763589486 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7eff080b63f0 0x7eff080cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:17.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.335+0000 7eff0c99c640 1 -- 172.21.15.123:0/2763589486 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7eff080b63f0 msgr2=0x7eff080cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:17.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.335+0000 7eff0c99c640 1 --2- 172.21.15.123:0/2763589486 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7eff080b63f0 0x7eff080cc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:17.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.335+0000 7eff0c99c640 1 -- 172.21.15.123:0/2763589486 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7eff080cf670 msgr2=0x7eff080c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:17.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.335+0000 7eff0c99c640 1 --2- 172.21.15.123:0/2763589486 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7eff080cf670 0x7eff080c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:17.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.335+0000 7eff0c99c640 1 -- 172.21.15.123:0/2763589486 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff080cd050 con 0x7eff080b7a30 2024-09-15T23:17:17.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.335+0000 7eff0c99c640 1 --2- 172.21.15.123:0/2763589486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff080b7a30 0x7eff080c81f0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7efef8035040 tx=0x7efef80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:17.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.335+0000 7efefdffb640 1 -- 172.21.15.123:0/2763589486 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef8037040 con 0x7eff080b7a30 2024-09-15T23:17:17.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.335+0000 7efefdffb640 1 -- 172.21.15.123:0/2763589486 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efef8004230 con 0x7eff080b7a30 2024-09-15T23:17:17.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.335+0000 7eff0e19f640 1 -- 172.21.15.123:0/2763589486 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff080cd330 con 0x7eff080b7a30 2024-09-15T23:17:17.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.335+0000 7efefdffb640 1 -- 172.21.15.123:0/2763589486 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef8003610 con 0x7eff080b7a30 2024-09-15T23:17:17.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.335+0000 7eff0e19f640 1 -- 172.21.15.123:0/2763589486 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff080cd8f0 con 0x7eff080b7a30 2024-09-15T23:17:17.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.336+0000 7eff0e19f640 1 -- 172.21.15.123:0/2763589486 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff080cef60 con 0x7eff080b7a30 2024-09-15T23:17:17.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.337+0000 7efefdffb640 1 -- 172.21.15.123:0/2763589486 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7efef80037b0 con 0x7eff080b7a30 2024-09-15T23:17:17.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.337+0000 7efefdffb640 1 --2- 172.21.15.123:0/2763589486 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efeec06c2b0 0x7efeec06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:17.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.337+0000 7efefdffb640 1 -- 172.21.15.123:0/2763589486 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5709+0+0 (secure 0 0 0) 0x7efef80ac250 con 0x7eff080b7a30 2024-09-15T23:17:17.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.337+0000 7eff0d19d640 1 --2- 172.21.15.123:0/2763589486 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efeec06c2b0 0x7efeec06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:17.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.338+0000 7eff0d19d640 1 --2- 172.21.15.123:0/2763589486 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efeec06c2b0 0x7efeec06e770 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7eff04000f60 tx=0x7eff04007b50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:17.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.341+0000 7efefdffb640 1 -- 172.21.15.123:0/2763589486 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efef807a9c0 con 0x7eff080b7a30 2024-09-15T23:17:17.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.506+0000 7eff0e19f640 1 -- 172.21.15.123:0/2763589486 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7eff08161d00 con 0x7efeec06c2b0 2024-09-15T23:17:17.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.512+0000 7efefdffb640 1 -- 172.21.15.123:0/2763589486 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241672 (secure 0 0 0) 0x7eff08161d00 con 0x7efeec06c2b0 2024-09-15T23:17:17.516 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:17:17.517 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:17:17.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.515+0000 7eff0e19f640 1 -- 172.21.15.123:0/2763589486 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efeec06c2b0 msgr2=0x7efeec06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:17.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.515+0000 7eff0e19f640 1 --2- 172.21.15.123:0/2763589486 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efeec06c2b0 0x7efeec06e770 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7eff04000f60 tx=0x7eff04007b50 comp rx=0 tx=0).stop 2024-09-15T23:17:17.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.515+0000 7eff0e19f640 1 -- 172.21.15.123:0/2763589486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff080b7a30 msgr2=0x7eff080c81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:17.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.515+0000 7eff0e19f640 1 --2- 172.21.15.123:0/2763589486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff080b7a30 0x7eff080c81f0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7efef8035040 tx=0x7efef80046c0 comp rx=0 tx=0).stop 2024-09-15T23:17:17.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.515+0000 7eff0e19f640 1 -- 172.21.15.123:0/2763589486 shutdown_connections 2024-09-15T23:17:17.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.515+0000 7eff0e19f640 1 --2- 172.21.15.123:0/2763589486 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7eff080cf670 0x7eff080c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:17.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.515+0000 7eff0e19f640 1 --2- 172.21.15.123:0/2763589486 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efeec06c2b0 0x7efeec06e770 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:17.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.515+0000 7eff0e19f640 1 --2- 172.21.15.123:0/2763589486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7eff080b7a30 0x7eff080c81f0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:17.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.515+0000 7eff0e19f640 1 --2- 172.21.15.123:0/2763589486 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7eff080b63f0 0x7eff080cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:17.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.515+0000 7eff0e19f640 1 -- 172.21.15.123:0/2763589486 >> 172.21.15.123:0/2763589486 conn(0x7eff080d1360 msgr2=0x7eff08160720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:17.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.515+0000 7eff0e19f640 1 -- 172.21.15.123:0/2763589486 shutdown_connections 2024-09-15T23:17:17.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.515+0000 7eff0e19f640 1 -- 172.21.15.123:0/2763589486 wait complete. 2024-09-15T23:17:17.527 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":264,"stamp":"2024-09-15T23:17:15.574594+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":84,"acting":84,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":23,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":302836,"kb_used_data":11700,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754671884,"statfs":{"total":773094113280,"available":772784009216,"internally_reserved":0,"allocated":11980800,"data_stored":5910617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":297913904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000842"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.104133+0000","last_change":"2024-09-15T23:17:13.104133+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.104133+0000","last_undegraded":"2024-09-15T23:17:13.104133+0000","last_fullsized":"2024-09-15T23:17:13.104133+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.101901+0000","last_change":"2024-09-15T23:17:13.101901+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.101901+0000","last_undegraded":"2024-09-15T23:17:13.101901+0000","last_fullsized":"2024-09-15T23:17:13.101901+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.102308+0000","last_change":"2024-09-15T23:17:13.102308+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.102308+0000","last_undegraded":"2024-09-15T23:17:13.102308+0000","last_fullsized":"2024-09-15T23:17:13.102308+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.103556+0000","last_change":"2024-09-15T23:17:13.103556+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.103556+0000","last_undegraded":"2024-09-15T23:17:13.103556+0000","last_fullsized":"2024-09-15T23:17:13.103556+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.106231+0000","last_change":"2024-09-15T23:17:13.106231+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.106231+0000","last_undegraded":"2024-09-15T23:17:13.106231+0000","last_fullsized":"2024-09-15T23:17:13.106231+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.106027+0000","last_change":"2024-09-15T23:17:13.106027+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.106027+0000","last_undegraded":"2024-09-15T23:17:13.106027+0000","last_fullsized":"2024-09-15T23:17:13.106027+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.106694+0000","last_change":"2024-09-15T23:17:13.106694+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.106694+0000","last_undegraded":"2024-09-15T23:17:13.106694+0000","last_fullsized":"2024-09-15T23:17:13.106694+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.102341+0000","last_change":"2024-09-15T23:17:13.102341+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.102341+0000","last_undegraded":"2024-09-15T23:17:13.102341+0000","last_fullsized":"2024-09-15T23:17:13.102341+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.106292+0000","last_change":"2024-09-15T23:17:13.106292+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.106292+0000","last_undegraded":"2024-09-15T23:17:13.106292+0000","last_fullsized":"2024-09-15T23:17:13.106292+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.106750+0000","last_change":"2024-09-15T23:17:13.106750+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.106750+0000","last_undegraded":"2024-09-15T23:17:13.106750+0000","last_fullsized":"2024-09-15T23:17:13.106750+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.106036+0000","last_change":"2024-09-15T23:17:13.106036+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.106036+0000","last_undegraded":"2024-09-15T23:17:13.106036+0000","last_fullsized":"2024-09-15T23:17:13.106036+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.108049+0000","last_change":"2024-09-15T23:17:13.108049+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.108049+0000","last_undegraded":"2024-09-15T23:17:13.108049+0000","last_fullsized":"2024-09-15T23:17:13.108049+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.107769+0000","last_change":"2024-09-15T23:17:13.107769+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.107769+0000","last_undegraded":"2024-09-15T23:17:13.107769+0000","last_fullsized":"2024-09-15T23:17:13.107769+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.119121+0000","last_change":"2024-09-15T23:17:13.115752+0000","last_active":"2024-09-15T23:17:13.119121+0000","last_peered":"2024-09-15T23:17:13.119121+0000","last_clean":"2024-09-15T23:17:13.119121+0000","last_became_active":"2024-09-15T23:17:13.114959+0000","last_became_peered":"2024-09-15T23:17:13.114959+0000","last_unstale":"2024-09-15T23:17:13.119121+0000","last_undegraded":"2024-09-15T23:17:13.119121+0000","last_fullsized":"2024-09-15T23:17:13.119121+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:52:26.259605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.105624+0000","last_change":"2024-09-15T23:17:13.105624+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.105624+0000","last_undegraded":"2024-09-15T23:17:13.105624+0000","last_fullsized":"2024-09-15T23:17:13.105624+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.105392+0000","last_change":"2024-09-15T23:17:13.105392+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.105392+0000","last_undegraded":"2024-09-15T23:17:13.105392+0000","last_fullsized":"2024-09-15T23:17:13.105392+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.103763+0000","last_change":"2024-09-15T23:17:13.103763+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.103763+0000","last_undegraded":"2024-09-15T23:17:13.103763+0000","last_fullsized":"2024-09-15T23:17:13.103763+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.111495+0000","last_change":"2024-09-15T23:17:13.105562+0000","last_active":"2024-09-15T23:17:13.111495+0000","last_peered":"2024-09-15T23:17:13.111495+0000","last_clean":"2024-09-15T23:17:13.111495+0000","last_became_active":"2024-09-15T23:17:13.105267+0000","last_became_peered":"2024-09-15T23:17:13.105267+0000","last_unstale":"2024-09-15T23:17:13.111495+0000","last_undegraded":"2024-09-15T23:17:13.111495+0000","last_fullsized":"2024-09-15T23:17:13.111495+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:20:15.465328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.105367+0000","last_change":"2024-09-15T23:17:13.105367+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.105367+0000","last_undegraded":"2024-09-15T23:17:13.105367+0000","last_fullsized":"2024-09-15T23:17:13.105367+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.108131+0000","last_change":"2024-09-15T23:17:13.108131+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.108131+0000","last_undegraded":"2024-09-15T23:17:13.108131+0000","last_fullsized":"2024-09-15T23:17:13.108131+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.101926+0000","last_change":"2024-09-15T23:17:13.101926+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.101926+0000","last_undegraded":"2024-09-15T23:17:13.101926+0000","last_fullsized":"2024-09-15T23:17:13.101926+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.111145+0000","last_change":"2024-09-15T23:17:13.107378+0000","last_active":"2024-09-15T23:17:13.111145+0000","last_peered":"2024-09-15T23:17:13.111145+0000","last_clean":"2024-09-15T23:17:13.111145+0000","last_became_active":"2024-09-15T23:17:13.107092+0000","last_became_peered":"2024-09-15T23:17:13.107092+0000","last_unstale":"2024-09-15T23:17:13.111145+0000","last_undegraded":"2024-09-15T23:17:13.111145+0000","last_fullsized":"2024-09-15T23:17:13.111145+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:49.003531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.108493+0000","last_change":"2024-09-15T23:17:13.108493+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.108493+0000","last_undegraded":"2024-09-15T23:17:13.108493+0000","last_fullsized":"2024-09-15T23:17:13.108493+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.118962+0000","last_change":"2024-09-15T23:17:13.115247+0000","last_active":"2024-09-15T23:17:13.118962+0000","last_peered":"2024-09-15T23:17:13.118962+0000","last_clean":"2024-09-15T23:17:13.118962+0000","last_became_active":"2024-09-15T23:17:13.114968+0000","last_became_peered":"2024-09-15T23:17:13.114968+0000","last_unstale":"2024-09-15T23:17:13.118962+0000","last_undegraded":"2024-09-15T23:17:13.118962+0000","last_fullsized":"2024-09-15T23:17:13.118962+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:30:12.355202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.101884+0000","last_change":"2024-09-15T23:17:13.101884+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.101884+0000","last_undegraded":"2024-09-15T23:17:13.101884+0000","last_fullsized":"2024-09-15T23:17:13.101884+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.113359+0000","last_change":"2024-09-15T23:17:13.108829+0000","last_active":"2024-09-15T23:17:13.113359+0000","last_peered":"2024-09-15T23:17:13.113359+0000","last_clean":"2024-09-15T23:17:13.113359+0000","last_became_active":"2024-09-15T23:17:13.108553+0000","last_became_peered":"2024-09-15T23:17:13.108553+0000","last_unstale":"2024-09-15T23:17:13.113359+0000","last_undegraded":"2024-09-15T23:17:13.113359+0000","last_fullsized":"2024-09-15T23:17:13.113359+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:25.965813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.107693+0000","last_change":"2024-09-15T23:17:13.107693+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.107693+0000","last_undegraded":"2024-09-15T23:17:13.107693+0000","last_fullsized":"2024-09-15T23:17:13.107693+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.119007+0000","last_change":"2024-09-15T23:17:13.115236+0000","last_active":"2024-09-15T23:17:13.119007+0000","last_peered":"2024-09-15T23:17:13.119007+0000","last_clean":"2024-09-15T23:17:13.119007+0000","last_became_active":"2024-09-15T23:17:13.114937+0000","last_became_peered":"2024-09-15T23:17:13.114937+0000","last_unstale":"2024-09-15T23:17:13.119007+0000","last_undegraded":"2024-09-15T23:17:13.119007+0000","last_fullsized":"2024-09-15T23:17:13.119007+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:48.038067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.106914+0000","last_change":"2024-09-15T23:17:13.106914+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.106914+0000","last_undegraded":"2024-09-15T23:17:13.106914+0000","last_fullsized":"2024-09-15T23:17:13.106914+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.119081+0000","last_change":"2024-09-15T23:17:13.113950+0000","last_active":"2024-09-15T23:17:13.119081+0000","last_peered":"2024-09-15T23:17:13.119081+0000","last_clean":"2024-09-15T23:17:13.119081+0000","last_became_active":"2024-09-15T23:17:13.113680+0000","last_became_peered":"2024-09-15T23:17:13.113680+0000","last_unstale":"2024-09-15T23:17:13.119081+0000","last_undegraded":"2024-09-15T23:17:13.119081+0000","last_fullsized":"2024-09-15T23:17:13.119081+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:21.358088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.104924+0000","last_change":"2024-09-15T23:17:13.104924+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.104924+0000","last_undegraded":"2024-09-15T23:17:13.104924+0000","last_fullsized":"2024-09-15T23:17:13.104924+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.121726+0000","last_change":"2024-09-15T23:17:13.115998+0000","last_active":"2024-09-15T23:17:13.121726+0000","last_peered":"2024-09-15T23:17:13.121726+0000","last_clean":"2024-09-15T23:17:13.121726+0000","last_became_active":"2024-09-15T23:17:13.115703+0000","last_became_peered":"2024-09-15T23:17:13.115703+0000","last_unstale":"2024-09-15T23:17:13.121726+0000","last_undegraded":"2024-09-15T23:17:13.121726+0000","last_fullsized":"2024-09-15T23:17:13.121726+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:06:48.045653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.121676+0000","last_change":"2024-09-15T23:17:13.115923+0000","last_active":"2024-09-15T23:17:13.121676+0000","last_peered":"2024-09-15T23:17:13.121676+0000","last_clean":"2024-09-15T23:17:13.121676+0000","last_became_active":"2024-09-15T23:17:13.115642+0000","last_became_peered":"2024-09-15T23:17:13.115642+0000","last_unstale":"2024-09-15T23:17:13.121676+0000","last_undegraded":"2024-09-15T23:17:13.121676+0000","last_fullsized":"2024-09-15T23:17:13.121676+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:39.622535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.105629+0000","last_change":"2024-09-15T23:17:13.105629+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.105629+0000","last_undegraded":"2024-09-15T23:17:13.105629+0000","last_fullsized":"2024-09-15T23:17:13.105629+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.116106+0000","last_change":"2024-09-15T23:17:13.111438+0000","last_active":"2024-09-15T23:17:13.116106+0000","last_peered":"2024-09-15T23:17:13.116106+0000","last_clean":"2024-09-15T23:17:13.116106+0000","last_became_active":"2024-09-15T23:17:13.111139+0000","last_became_peered":"2024-09-15T23:17:13.111139+0000","last_unstale":"2024-09-15T23:17:13.116106+0000","last_undegraded":"2024-09-15T23:17:13.116106+0000","last_fullsized":"2024-09-15T23:17:13.116106+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:05.175799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.103127+0000","last_change":"2024-09-15T23:17:13.103127+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.103127+0000","last_undegraded":"2024-09-15T23:17:13.103127+0000","last_fullsized":"2024-09-15T23:17:13.103127+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.118923+0000","last_change":"2024-09-15T23:17:13.113961+0000","last_active":"2024-09-15T23:17:13.118923+0000","last_peered":"2024-09-15T23:17:13.118923+0000","last_clean":"2024-09-15T23:17:13.118923+0000","last_became_active":"2024-09-15T23:17:13.113690+0000","last_became_peered":"2024-09-15T23:17:13.113690+0000","last_unstale":"2024-09-15T23:17:13.118923+0000","last_undegraded":"2024-09-15T23:17:13.118923+0000","last_fullsized":"2024-09-15T23:17:13.118923+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:39.622535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.103335+0000","last_change":"2024-09-15T23:17:13.103335+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.103335+0000","last_undegraded":"2024-09-15T23:17:13.103335+0000","last_fullsized":"2024-09-15T23:17:13.103335+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.118956+0000","last_change":"2024-09-15T23:17:13.114546+0000","last_active":"2024-09-15T23:17:13.118956+0000","last_peered":"2024-09-15T23:17:13.118956+0000","last_clean":"2024-09-15T23:17:13.118956+0000","last_became_active":"2024-09-15T23:17:13.114310+0000","last_became_peered":"2024-09-15T23:17:13.114310+0000","last_unstale":"2024-09-15T23:17:13.118956+0000","last_undegraded":"2024-09-15T23:17:13.118956+0000","last_fullsized":"2024-09-15T23:17:13.118956+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:42:38.571629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.104922+0000","last_change":"2024-09-15T23:17:13.104922+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.104922+0000","last_undegraded":"2024-09-15T23:17:13.104922+0000","last_fullsized":"2024-09-15T23:17:13.104922+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:12.092985+0000","last_change":"2024-09-15T23:17:12.092985+0000","last_active":"2024-09-15T23:17:12.092985+0000","last_peered":"2024-09-15T23:17:12.092985+0000","last_clean":"2024-09-15T23:17:12.092985+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:12.092985+0000","last_undegraded":"2024-09-15T23:17:12.092985+0000","last_fullsized":"2024-09-15T23:17:12.092985+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:17:13.097077+0000","last_change":"2024-09-15T23:17:13.097077+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.097077+0000","last_undegraded":"2024-09-15T23:17:13.097077+0000","last_fullsized":"2024-09-15T23:17:13.097077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.118953+0000","last_change":"2024-09-15T23:17:13.115287+0000","last_active":"2024-09-15T23:17:13.118953+0000","last_peered":"2024-09-15T23:17:13.118953+0000","last_clean":"2024-09-15T23:17:13.118953+0000","last_became_active":"2024-09-15T23:17:13.114980+0000","last_became_peered":"2024-09-15T23:17:13.114980+0000","last_unstale":"2024-09-15T23:17:13.118953+0000","last_undegraded":"2024-09-15T23:17:13.118953+0000","last_fullsized":"2024-09-15T23:17:13.118953+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:24.484954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":335,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.100707+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:17:13.100707+0000","last_peered":"2024-09-15T23:17:13.100707+0000","last_clean":"2024-09-15T23:17:13.100707+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:17:13.100707+0000","last_undegraded":"2024-09-15T23:17:13.100707+0000","last_fullsized":"2024-09-15T23:17:13.100707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":56,"acting":56,"num_store_stats":4},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":26,"acting":26,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476804,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40856,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330984,"statfs":{"total":96636764160,"available":96594927616,"internally_reserved":0,"allocated":1372160,"data_stored":602102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476801,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40836,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331004,"statfs":{"total":96636764160,"available":96594948096,"internally_reserved":0,"allocated":1359872,"data_stored":595827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476803,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37276,"kb_used_data":1920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334564,"statfs":{"total":96636764160,"available":96598593536,"internally_reserved":0,"allocated":1966080,"data_stored":1192470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36680,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335160,"statfs":{"total":96636764160,"available":96599203840,"internally_reserved":0,"allocated":1359872,"data_stored":595827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542209,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36660,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335180,"statfs":{"total":96636764160,"available":96599224320,"internally_reserved":0,"allocated":1335296,"data_stored":584813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542209,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36640,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335200,"statfs":{"total":96636764160,"available":96599244800,"internally_reserved":0,"allocated":1323008,"data_stored":579584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542208,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37236,"kb_used_data":1884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334604,"statfs":{"total":96636764160,"available":96598634496,"internally_reserved":0,"allocated":1929216,"data_stored":1175181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542210,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36652,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335188,"statfs":{"total":96636764160,"available":96599232512,"internally_reserved":0,"allocated":1335296,"data_stored":584813,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:17:17.532 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:17:17.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.666+0000 7fad368af640 1 Processor -- start 2024-09-15T23:17:17.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.666+0000 7fad368af640 1 -- start start 2024-09-15T23:17:17.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.666+0000 7fad368af640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad3015ed20 0x7fad300b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:17.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.666+0000 7fad368af640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fad300d23b0 0x7fad300b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:17.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.666+0000 7fad368af640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad300d0e70 con 0x7fad300cf2d0 2024-09-15T23:17:17.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.666+0000 7fad368af640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fad300d41c0 con 0x7fad300d23b0 2024-09-15T23:17:17.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.666+0000 7fad368af640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fad300d35b0 con 0x7fad3015ed20 2024-09-15T23:17:17.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.667+0000 7fad2f7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fad300d23b0 0x7fad300b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:17.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.667+0000 7fad2f7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fad300d23b0 0x7fad300b67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48170/0 (socket says 172.21.15.123:48170) 2024-09-15T23:17:17.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.667+0000 7fad2f7fe640 1 -- 172.21.15.123:0/436648481 learned_addr learned my addr 172.21.15.123:0/436648481 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:17.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.667+0000 7fad2f7fe640 1 -- 172.21.15.123:0/436648481 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad3015ed20 msgr2=0x7fad300b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:17.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.667+0000 7fad2f7fe640 1 --2- 172.21.15.123:0/436648481 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad3015ed20 0x7fad300b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:17.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.667+0000 7fad2f7fe640 1 -- 172.21.15.123:0/436648481 >> v1:172.21.15.188:6789/0 conn(0x7fad300cf2d0 legacy=0x7fad300cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:17.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.667+0000 7fad2f7fe640 1 -- 172.21.15.123:0/436648481 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad300d3890 con 0x7fad300d23b0 2024-09-15T23:17:17.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.668+0000 7fad2f7fe640 1 --2- 172.21.15.123:0/436648481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad300d23b0 0x7fad300b67a0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fad18009870 tx=0x7fad1802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6966583bd9fe93 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:17.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.668+0000 7fad2effd640 1 -- 172.21.15.123:0/436648481 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad18037070 con 0x7fad300d23b0 2024-09-15T23:17:17.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.668+0000 7fad2effd640 1 -- 172.21.15.123:0/436648481 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad18032440 con 0x7fad300d23b0 2024-09-15T23:17:17.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.668+0000 7fad2effd640 1 -- 172.21.15.123:0/436648481 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad18032810 con 0x7fad300d23b0 2024-09-15T23:17:17.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.668+0000 7fad368af640 1 -- 172.21.15.123:0/436648481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad300d23b0 msgr2=0x7fad300b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:17.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.668+0000 7fad368af640 1 --2- 172.21.15.123:0/436648481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad300d23b0 0x7fad300b67a0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fad18009870 tx=0x7fad1802a210 comp rx=0 tx=0).stop 2024-09-15T23:17:17.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.668+0000 7fad368af640 1 -- 172.21.15.123:0/436648481 shutdown_connections 2024-09-15T23:17:17.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.668+0000 7fad368af640 1 --2- 172.21.15.123:0/436648481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad300d23b0 0x7fad300b67a0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:17.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.668+0000 7fad368af640 1 --2- 172.21.15.123:0/436648481 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad3015ed20 0x7fad300b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:17.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.668+0000 7fad368af640 1 -- 172.21.15.123:0/436648481 >> 172.21.15.123:0/436648481 conn(0x7fad300d1260 msgr2=0x7fad300d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:17.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.668+0000 7fad368af640 1 -- 172.21.15.123:0/436648481 shutdown_connections 2024-09-15T23:17:17.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.668+0000 7fad368af640 1 -- 172.21.15.123:0/436648481 wait complete. 2024-09-15T23:17:17.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.669+0000 7fad368af640 1 Processor -- start 2024-09-15T23:17:17.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.670+0000 7fad368af640 1 -- start start 2024-09-15T23:17:17.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.670+0000 7fad368af640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad300cf2d0 0x7fad301f8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:17.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.670+0000 7fad368af640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fad300d23b0 0x7fad300ae860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:17.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.670+0000 7fad368af640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad3015ed20 0x7fad300b2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:17.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.670+0000 7fad368af640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fad300d32a0 con 0x7fad300cf2d0 2024-09-15T23:17:17.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.670+0000 7fad368af640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fad300d3e50 con 0x7fad300d23b0 2024-09-15T23:17:17.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.670+0000 7fad368af640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fad3015f100 con 0x7fad3015ed20 2024-09-15T23:17:17.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.670+0000 7fad2ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad300cf2d0 0x7fad301f8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:17.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.670+0000 7fad2ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad300cf2d0 0x7fad301f8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48172/0 (socket says 172.21.15.123:48172) 2024-09-15T23:17:17.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.671+0000 7fad2ffff640 1 -- 172.21.15.123:0/1418984611 learned_addr learned my addr 172.21.15.123:0/1418984611 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:17.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.671+0000 7fad2f7fe640 1 --2- 172.21.15.123:0/1418984611 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fad300d23b0 0x7fad300ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:17.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.671+0000 7fad34e4c640 1 --2- 172.21.15.123:0/1418984611 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad3015ed20 0x7fad300b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:17.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.671+0000 7fad2ffff640 1 -- 172.21.15.123:0/1418984611 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad3015ed20 msgr2=0x7fad300b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:17.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.671+0000 7fad2ffff640 1 --2- 172.21.15.123:0/1418984611 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad3015ed20 0x7fad300b2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:17.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.671+0000 7fad2ffff640 1 -- 172.21.15.123:0/1418984611 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fad300d23b0 msgr2=0x7fad300ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:17.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.671+0000 7fad2ffff640 1 --2- 172.21.15.123:0/1418984611 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fad300d23b0 0x7fad300ae860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:17.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.671+0000 7fad2ffff640 1 -- 172.21.15.123:0/1418984611 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad300ac0f0 con 0x7fad300cf2d0 2024-09-15T23:17:17.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.671+0000 7fad34e4c640 1 --2- 172.21.15.123:0/1418984611 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad3015ed20 0x7fad300b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:17:17.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.671+0000 7fad2f7fe640 1 --2- 172.21.15.123:0/1418984611 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fad300d23b0 0x7fad300ae860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:17:17.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.671+0000 7fad2ffff640 1 --2- 172.21.15.123:0/1418984611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad300cf2d0 0x7fad301f8950 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fad2000b410 tx=0x7fad2000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:17.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.671+0000 7fad2cff9640 1 -- 172.21.15.123:0/1418984611 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad20015020 con 0x7fad300cf2d0 2024-09-15T23:17:17.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.671+0000 7fad2cff9640 1 -- 172.21.15.123:0/1418984611 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad20011850 con 0x7fad300cf2d0 2024-09-15T23:17:17.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.671+0000 7fad368af640 1 -- 172.21.15.123:0/1418984611 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad300ac660 con 0x7fad300cf2d0 2024-09-15T23:17:17.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.671+0000 7fad2cff9640 1 -- 172.21.15.123:0/1418984611 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad20011c40 con 0x7fad300cf2d0 2024-09-15T23:17:17.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.671+0000 7fad368af640 1 -- 172.21.15.123:0/1418984611 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad300acc20 con 0x7fad300cf2d0 2024-09-15T23:17:17.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.672+0000 7fad368af640 1 -- 172.21.15.123:0/1418984611 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad300b7010 con 0x7fad300cf2d0 2024-09-15T23:17:17.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.673+0000 7fad2cff9640 1 -- 172.21.15.123:0/1418984611 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fad20018020 con 0x7fad300cf2d0 2024-09-15T23:17:17.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.673+0000 7fad2cff9640 1 --2- 172.21.15.123:0/1418984611 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fad1006c2b0 0x7fad1006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:17.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.673+0000 7fad2cff9640 1 -- 172.21.15.123:0/1418984611 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5709+0+0 (secure 0 0 0) 0x7fad2008b350 con 0x7fad300cf2d0 2024-09-15T23:17:17.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.674+0000 7fad2f7fe640 1 --2- 172.21.15.123:0/1418984611 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fad1006c2b0 0x7fad1006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:17.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.675+0000 7fad2f7fe640 1 --2- 172.21.15.123:0/1418984611 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fad1006c2b0 0x7fad1006e770 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fad18034000 tx=0x7fad1802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:17.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.678+0000 7fad2cff9640 1 -- 172.21.15.123:0/1418984611 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fad2001f020 con 0x7fad300cf2d0 2024-09-15T23:17:17.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.841+0000 7fad368af640 1 -- 172.21.15.123:0/1418984611 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fad300b3f20 con 0x7fad1006c2b0 2024-09-15T23:17:17.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.847+0000 7fad2cff9640 1 -- 172.21.15.123:0/1418984611 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250130 (secure 0 0 0) 0x7fad300b3f20 con 0x7fad1006c2b0 2024-09-15T23:17:17.850 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:17:17.852 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:17:17.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.850+0000 7fad368af640 1 -- 172.21.15.123:0/1418984611 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fad1006c2b0 msgr2=0x7fad1006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:17.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.850+0000 7fad368af640 1 --2- 172.21.15.123:0/1418984611 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fad1006c2b0 0x7fad1006e770 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fad18034000 tx=0x7fad1802e000 comp rx=0 tx=0).stop 2024-09-15T23:17:17.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.850+0000 7fad368af640 1 -- 172.21.15.123:0/1418984611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad300cf2d0 msgr2=0x7fad301f8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:17.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.850+0000 7fad368af640 1 --2- 172.21.15.123:0/1418984611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad300cf2d0 0x7fad301f8950 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fad2000b410 tx=0x7fad2000b8d0 comp rx=0 tx=0).stop 2024-09-15T23:17:17.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.850+0000 7fad368af640 1 -- 172.21.15.123:0/1418984611 shutdown_connections 2024-09-15T23:17:17.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.850+0000 7fad368af640 1 --2- 172.21.15.123:0/1418984611 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fad3015ed20 0x7fad300b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:17.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.850+0000 7fad368af640 1 --2- 172.21.15.123:0/1418984611 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fad300d23b0 0x7fad300ae860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:17.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.850+0000 7fad368af640 1 --2- 172.21.15.123:0/1418984611 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fad1006c2b0 0x7fad1006e770 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:17.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.850+0000 7fad368af640 1 --2- 172.21.15.123:0/1418984611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad300cf2d0 0x7fad301f8950 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:17.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.850+0000 7fad368af640 1 -- 172.21.15.123:0/1418984611 >> 172.21.15.123:0/1418984611 conn(0x7fad300d1260 msgr2=0x7fad300d1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:17.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.850+0000 7fad368af640 1 -- 172.21.15.123:0/1418984611 shutdown_connections 2024-09-15T23:17:17.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.850+0000 7fad368af640 1 -- 172.21.15.123:0/1418984611 wait complete. 2024-09-15T23:17:17.861 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":265,"stamp":"2024-09-15T23:17:17.575033+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":186,"num_write_kb":2424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":101,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":303100,"kb_used_data":11956,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754671620,"statfs":{"total":773094113280,"available":772783738880,"internally_reserved":0,"allocated":12242944,"data_stored":6027534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":297913904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.476182"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147783+0000","last_change":"2024-09-15T23:17:14.128999+0000","last_active":"2024-09-15T23:17:16.147783+0000","last_peered":"2024-09-15T23:17:16.147783+0000","last_clean":"2024-09-15T23:17:16.147783+0000","last_became_active":"2024-09-15T23:17:14.128723+0000","last_became_peered":"2024-09-15T23:17:14.128723+0000","last_unstale":"2024-09-15T23:17:16.147783+0000","last_undegraded":"2024-09-15T23:17:16.147783+0000","last_fullsized":"2024-09-15T23:17:16.147783+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:44:08.687064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148110+0000","last_change":"2024-09-15T23:17:14.136518+0000","last_active":"2024-09-15T23:17:16.148110+0000","last_peered":"2024-09-15T23:17:16.148110+0000","last_clean":"2024-09-15T23:17:16.148110+0000","last_became_active":"2024-09-15T23:17:14.136230+0000","last_became_peered":"2024-09-15T23:17:14.136230+0000","last_unstale":"2024-09-15T23:17:16.148110+0000","last_undegraded":"2024-09-15T23:17:16.148110+0000","last_fullsized":"2024-09-15T23:17:16.148110+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:11:42.871940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131971+0000","last_change":"2024-09-15T23:17:14.124836+0000","last_active":"2024-09-15T23:17:15.131971+0000","last_peered":"2024-09-15T23:17:15.131971+0000","last_clean":"2024-09-15T23:17:15.131971+0000","last_became_active":"2024-09-15T23:17:14.124567+0000","last_became_peered":"2024-09-15T23:17:14.124567+0000","last_unstale":"2024-09-15T23:17:15.131971+0000","last_undegraded":"2024-09-15T23:17:15.131971+0000","last_fullsized":"2024-09-15T23:17:15.131971+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:11.615199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147870+0000","last_change":"2024-09-15T23:17:14.133656+0000","last_active":"2024-09-15T23:17:16.147870+0000","last_peered":"2024-09-15T23:17:16.147870+0000","last_clean":"2024-09-15T23:17:16.147870+0000","last_became_active":"2024-09-15T23:17:14.132595+0000","last_became_peered":"2024-09-15T23:17:14.132595+0000","last_unstale":"2024-09-15T23:17:16.147870+0000","last_undegraded":"2024-09-15T23:17:16.147870+0000","last_fullsized":"2024-09-15T23:17:16.147870+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:23.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.104133+0000","last_change":"2024-09-15T23:17:13.104133+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.104133+0000","last_undegraded":"2024-09-15T23:17:13.104133+0000","last_fullsized":"2024-09-15T23:17:13.104133+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.101901+0000","last_change":"2024-09-15T23:17:13.101901+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.101901+0000","last_undegraded":"2024-09-15T23:17:13.101901+0000","last_fullsized":"2024-09-15T23:17:13.101901+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.102308+0000","last_change":"2024-09-15T23:17:13.102308+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.102308+0000","last_undegraded":"2024-09-15T23:17:13.102308+0000","last_fullsized":"2024-09-15T23:17:13.102308+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131508+0000","last_change":"2024-09-15T23:17:14.116714+0000","last_active":"2024-09-15T23:17:15.131508+0000","last_peered":"2024-09-15T23:17:15.131508+0000","last_clean":"2024-09-15T23:17:15.131508+0000","last_became_active":"2024-09-15T23:17:14.116402+0000","last_became_peered":"2024-09-15T23:17:14.116402+0000","last_unstale":"2024-09-15T23:17:15.131508+0000","last_undegraded":"2024-09-15T23:17:15.131508+0000","last_fullsized":"2024-09-15T23:17:15.131508+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:46.780974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.103556+0000","last_change":"2024-09-15T23:17:13.103556+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.103556+0000","last_undegraded":"2024-09-15T23:17:13.103556+0000","last_fullsized":"2024-09-15T23:17:13.103556+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.106231+0000","last_change":"2024-09-15T23:17:13.106231+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.106231+0000","last_undegraded":"2024-09-15T23:17:13.106231+0000","last_fullsized":"2024-09-15T23:17:13.106231+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.106027+0000","last_change":"2024-09-15T23:17:13.106027+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.106027+0000","last_undegraded":"2024-09-15T23:17:13.106027+0000","last_fullsized":"2024-09-15T23:17:13.106027+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.106694+0000","last_change":"2024-09-15T23:17:13.106694+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.106694+0000","last_undegraded":"2024-09-15T23:17:13.106694+0000","last_fullsized":"2024-09-15T23:17:13.106694+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147960+0000","last_change":"2024-09-15T23:17:14.124715+0000","last_active":"2024-09-15T23:17:16.147960+0000","last_peered":"2024-09-15T23:17:16.147960+0000","last_clean":"2024-09-15T23:17:16.147960+0000","last_became_active":"2024-09-15T23:17:14.124463+0000","last_became_peered":"2024-09-15T23:17:14.124463+0000","last_unstale":"2024-09-15T23:17:16.147960+0000","last_undegraded":"2024-09-15T23:17:16.147960+0000","last_fullsized":"2024-09-15T23:17:16.147960+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:05.213822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147468+0000","last_change":"2024-09-15T23:17:14.140450+0000","last_active":"2024-09-15T23:17:16.147468+0000","last_peered":"2024-09-15T23:17:16.147468+0000","last_clean":"2024-09-15T23:17:16.147468+0000","last_became_active":"2024-09-15T23:17:14.139838+0000","last_became_peered":"2024-09-15T23:17:14.139838+0000","last_unstale":"2024-09-15T23:17:16.147468+0000","last_undegraded":"2024-09-15T23:17:16.147468+0000","last_fullsized":"2024-09-15T23:17:16.147468+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:46.018882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148205+0000","last_change":"2024-09-15T23:17:14.133339+0000","last_active":"2024-09-15T23:17:16.148205+0000","last_peered":"2024-09-15T23:17:16.148205+0000","last_clean":"2024-09-15T23:17:16.148205+0000","last_became_active":"2024-09-15T23:17:14.132322+0000","last_became_peered":"2024-09-15T23:17:14.132322+0000","last_unstale":"2024-09-15T23:17:16.148205+0000","last_undegraded":"2024-09-15T23:17:16.148205+0000","last_fullsized":"2024-09-15T23:17:16.148205+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:22.753014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.102341+0000","last_change":"2024-09-15T23:17:13.102341+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.102341+0000","last_undegraded":"2024-09-15T23:17:13.102341+0000","last_fullsized":"2024-09-15T23:17:13.102341+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129435+0000","last_change":"2024-09-15T23:17:14.130776+0000","last_active":"2024-09-15T23:17:15.129435+0000","last_peered":"2024-09-15T23:17:15.129435+0000","last_clean":"2024-09-15T23:17:15.129435+0000","last_became_active":"2024-09-15T23:17:14.130503+0000","last_became_peered":"2024-09-15T23:17:14.130503+0000","last_unstale":"2024-09-15T23:17:15.129435+0000","last_undegraded":"2024-09-15T23:17:15.129435+0000","last_fullsized":"2024-09-15T23:17:15.129435+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:20.514822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148179+0000","last_change":"2024-09-15T23:17:14.135879+0000","last_active":"2024-09-15T23:17:16.148179+0000","last_peered":"2024-09-15T23:17:16.148179+0000","last_clean":"2024-09-15T23:17:16.148179+0000","last_became_active":"2024-09-15T23:17:14.134228+0000","last_became_peered":"2024-09-15T23:17:14.134228+0000","last_unstale":"2024-09-15T23:17:16.148179+0000","last_undegraded":"2024-09-15T23:17:16.148179+0000","last_fullsized":"2024-09-15T23:17:16.148179+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:11.837562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129487+0000","last_change":"2024-09-15T23:17:14.128723+0000","last_active":"2024-09-15T23:17:15.129487+0000","last_peered":"2024-09-15T23:17:15.129487+0000","last_clean":"2024-09-15T23:17:15.129487+0000","last_became_active":"2024-09-15T23:17:14.128230+0000","last_became_peered":"2024-09-15T23:17:14.128230+0000","last_unstale":"2024-09-15T23:17:15.129487+0000","last_undegraded":"2024-09-15T23:17:15.129487+0000","last_fullsized":"2024-09-15T23:17:15.129487+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:58.401688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.106292+0000","last_change":"2024-09-15T23:17:13.106292+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.106292+0000","last_undegraded":"2024-09-15T23:17:13.106292+0000","last_fullsized":"2024-09-15T23:17:13.106292+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131928+0000","last_change":"2024-09-15T23:17:14.122919+0000","last_active":"2024-09-15T23:17:15.131928+0000","last_peered":"2024-09-15T23:17:15.131928+0000","last_clean":"2024-09-15T23:17:15.131928+0000","last_became_active":"2024-09-15T23:17:14.122645+0000","last_became_peered":"2024-09-15T23:17:14.122645+0000","last_unstale":"2024-09-15T23:17:15.131928+0000","last_undegraded":"2024-09-15T23:17:15.131928+0000","last_fullsized":"2024-09-15T23:17:15.131928+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:30:14.079626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131664+0000","last_change":"2024-09-15T23:17:14.131221+0000","last_active":"2024-09-15T23:17:15.131664+0000","last_peered":"2024-09-15T23:17:15.131664+0000","last_clean":"2024-09-15T23:17:15.131664+0000","last_became_active":"2024-09-15T23:17:14.130594+0000","last_became_peered":"2024-09-15T23:17:14.130594+0000","last_unstale":"2024-09-15T23:17:15.131664+0000","last_undegraded":"2024-09-15T23:17:15.131664+0000","last_fullsized":"2024-09-15T23:17:15.131664+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:47:03.357343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147505+0000","last_change":"2024-09-15T23:17:14.140814+0000","last_active":"2024-09-15T23:17:16.147505+0000","last_peered":"2024-09-15T23:17:16.147505+0000","last_clean":"2024-09-15T23:17:16.147505+0000","last_became_active":"2024-09-15T23:17:14.140517+0000","last_became_peered":"2024-09-15T23:17:14.140517+0000","last_unstale":"2024-09-15T23:17:16.147505+0000","last_undegraded":"2024-09-15T23:17:16.147505+0000","last_fullsized":"2024-09-15T23:17:16.147505+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:48.303033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.106750+0000","last_change":"2024-09-15T23:17:13.106750+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.106750+0000","last_undegraded":"2024-09-15T23:17:13.106750+0000","last_fullsized":"2024-09-15T23:17:13.106750+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.106036+0000","last_change":"2024-09-15T23:17:13.106036+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.106036+0000","last_undegraded":"2024-09-15T23:17:13.106036+0000","last_fullsized":"2024-09-15T23:17:13.106036+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148056+0000","last_change":"2024-09-15T23:17:14.126059+0000","last_active":"2024-09-15T23:17:16.148056+0000","last_peered":"2024-09-15T23:17:16.148056+0000","last_clean":"2024-09-15T23:17:16.148056+0000","last_became_active":"2024-09-15T23:17:14.125760+0000","last_became_peered":"2024-09-15T23:17:14.125760+0000","last_unstale":"2024-09-15T23:17:16.148056+0000","last_undegraded":"2024-09-15T23:17:16.148056+0000","last_fullsized":"2024-09-15T23:17:16.148056+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:20.023859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.108049+0000","last_change":"2024-09-15T23:17:13.108049+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.108049+0000","last_undegraded":"2024-09-15T23:17:13.108049+0000","last_fullsized":"2024-09-15T23:17:13.108049+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.107769+0000","last_change":"2024-09-15T23:17:13.107769+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.107769+0000","last_undegraded":"2024-09-15T23:17:13.107769+0000","last_fullsized":"2024-09-15T23:17:13.107769+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148125+0000","last_change":"2024-09-15T23:17:14.119496+0000","last_active":"2024-09-15T23:17:16.148125+0000","last_peered":"2024-09-15T23:17:16.148125+0000","last_clean":"2024-09-15T23:17:16.148125+0000","last_became_active":"2024-09-15T23:17:14.119238+0000","last_became_peered":"2024-09-15T23:17:14.119238+0000","last_unstale":"2024-09-15T23:17:16.148125+0000","last_undegraded":"2024-09-15T23:17:16.148125+0000","last_fullsized":"2024-09-15T23:17:16.148125+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:58.881990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148335+0000","last_change":"2024-09-15T23:17:14.130119+0000","last_active":"2024-09-15T23:17:16.148335+0000","last_peered":"2024-09-15T23:17:16.148335+0000","last_clean":"2024-09-15T23:17:16.148335+0000","last_became_active":"2024-09-15T23:17:14.129832+0000","last_became_peered":"2024-09-15T23:17:14.129832+0000","last_unstale":"2024-09-15T23:17:16.148335+0000","last_undegraded":"2024-09-15T23:17:16.148335+0000","last_fullsized":"2024-09-15T23:17:16.148335+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:53.603091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131665+0000","last_change":"2024-09-15T23:17:14.120902+0000","last_active":"2024-09-15T23:17:15.131665+0000","last_peered":"2024-09-15T23:17:15.131665+0000","last_clean":"2024-09-15T23:17:15.131665+0000","last_became_active":"2024-09-15T23:17:14.120629+0000","last_became_peered":"2024-09-15T23:17:14.120629+0000","last_unstale":"2024-09-15T23:17:15.131665+0000","last_undegraded":"2024-09-15T23:17:15.131665+0000","last_fullsized":"2024-09-15T23:17:15.131665+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:25:18.338252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147988+0000","last_change":"2024-09-15T23:17:14.134985+0000","last_active":"2024-09-15T23:17:16.147988+0000","last_peered":"2024-09-15T23:17:16.147988+0000","last_clean":"2024-09-15T23:17:16.147988+0000","last_became_active":"2024-09-15T23:17:14.134639+0000","last_became_peered":"2024-09-15T23:17:14.134639+0000","last_unstale":"2024-09-15T23:17:16.147988+0000","last_undegraded":"2024-09-15T23:17:16.147988+0000","last_fullsized":"2024-09-15T23:17:16.147988+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:42.147757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129323+0000","last_change":"2024-09-15T23:17:14.127011+0000","last_active":"2024-09-15T23:17:15.129323+0000","last_peered":"2024-09-15T23:17:15.129323+0000","last_clean":"2024-09-15T23:17:15.129323+0000","last_became_active":"2024-09-15T23:17:14.126694+0000","last_became_peered":"2024-09-15T23:17:14.126694+0000","last_unstale":"2024-09-15T23:17:15.129323+0000","last_undegraded":"2024-09-15T23:17:15.129323+0000","last_fullsized":"2024-09-15T23:17:15.129323+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:02:57.119296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"113'4","reported_seq":18,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147990+0000","last_change":"2024-09-15T23:17:13.116670+0000","last_active":"2024-09-15T23:17:16.147990+0000","last_peered":"2024-09-15T23:17:16.147990+0000","last_clean":"2024-09-15T23:17:16.147990+0000","last_became_active":"2024-09-15T23:17:13.116343+0000","last_became_peered":"2024-09-15T23:17:13.116343+0000","last_unstale":"2024-09-15T23:17:16.147990+0000","last_undegraded":"2024-09-15T23:17:16.147990+0000","last_fullsized":"2024-09-15T23:17:16.147990+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:25.965813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147869+0000","last_change":"2024-09-15T23:17:14.118601+0000","last_active":"2024-09-15T23:17:16.147869+0000","last_peered":"2024-09-15T23:17:16.147869+0000","last_clean":"2024-09-15T23:17:16.147869+0000","last_became_active":"2024-09-15T23:17:14.118303+0000","last_became_peered":"2024-09-15T23:17:14.118303+0000","last_unstale":"2024-09-15T23:17:16.147869+0000","last_undegraded":"2024-09-15T23:17:16.147869+0000","last_fullsized":"2024-09-15T23:17:16.147869+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:58:46.481909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.119121+0000","last_change":"2024-09-15T23:17:13.115752+0000","last_active":"2024-09-15T23:17:13.119121+0000","last_peered":"2024-09-15T23:17:13.119121+0000","last_clean":"2024-09-15T23:17:13.119121+0000","last_became_active":"2024-09-15T23:17:13.114959+0000","last_became_peered":"2024-09-15T23:17:13.114959+0000","last_unstale":"2024-09-15T23:17:13.119121+0000","last_undegraded":"2024-09-15T23:17:13.119121+0000","last_fullsized":"2024-09-15T23:17:13.119121+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:52:26.259605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147985+0000","last_change":"2024-09-15T23:17:14.132832+0000","last_active":"2024-09-15T23:17:16.147985+0000","last_peered":"2024-09-15T23:17:16.147985+0000","last_clean":"2024-09-15T23:17:16.147985+0000","last_became_active":"2024-09-15T23:17:14.132210+0000","last_became_peered":"2024-09-15T23:17:14.132210+0000","last_unstale":"2024-09-15T23:17:16.147985+0000","last_undegraded":"2024-09-15T23:17:16.147985+0000","last_fullsized":"2024-09-15T23:17:16.147985+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:45:02.819477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131964+0000","last_change":"2024-09-15T23:17:13.116873+0000","last_active":"2024-09-15T23:17:15.131964+0000","last_peered":"2024-09-15T23:17:15.131964+0000","last_clean":"2024-09-15T23:17:15.131964+0000","last_became_active":"2024-09-15T23:17:13.116544+0000","last_became_peered":"2024-09-15T23:17:13.116544+0000","last_unstale":"2024-09-15T23:17:15.131964+0000","last_undegraded":"2024-09-15T23:17:15.131964+0000","last_fullsized":"2024-09-15T23:17:15.131964+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:10:32.250679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.105624+0000","last_change":"2024-09-15T23:17:13.105624+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.105624+0000","last_undegraded":"2024-09-15T23:17:13.105624+0000","last_fullsized":"2024-09-15T23:17:13.105624+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148027+0000","last_change":"2024-09-15T23:17:13.118603+0000","last_active":"2024-09-15T23:17:16.148027+0000","last_peered":"2024-09-15T23:17:16.148027+0000","last_clean":"2024-09-15T23:17:16.148027+0000","last_became_active":"2024-09-15T23:17:13.118338+0000","last_became_peered":"2024-09-15T23:17:13.118338+0000","last_unstale":"2024-09-15T23:17:16.148027+0000","last_undegraded":"2024-09-15T23:17:16.148027+0000","last_fullsized":"2024-09-15T23:17:16.148027+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:13:54.700643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.105392+0000","last_change":"2024-09-15T23:17:13.105392+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.105392+0000","last_undegraded":"2024-09-15T23:17:13.105392+0000","last_fullsized":"2024-09-15T23:17:13.105392+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"113'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147965+0000","last_change":"2024-09-15T23:17:13.117008+0000","last_active":"2024-09-15T23:17:16.147965+0000","last_peered":"2024-09-15T23:17:16.147965+0000","last_clean":"2024-09-15T23:17:16.147965+0000","last_became_active":"2024-09-15T23:17:13.116742+0000","last_became_peered":"2024-09-15T23:17:13.116742+0000","last_unstale":"2024-09-15T23:17:16.147965+0000","last_undegraded":"2024-09-15T23:17:16.147965+0000","last_fullsized":"2024-09-15T23:17:16.147965+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:05:45.151293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.103763+0000","last_change":"2024-09-15T23:17:13.103763+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.103763+0000","last_undegraded":"2024-09-15T23:17:13.103763+0000","last_fullsized":"2024-09-15T23:17:13.103763+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"113'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131677+0000","last_change":"2024-09-15T23:17:13.117608+0000","last_active":"2024-09-15T23:17:15.131677+0000","last_peered":"2024-09-15T23:17:15.131677+0000","last_clean":"2024-09-15T23:17:15.131677+0000","last_became_active":"2024-09-15T23:17:13.117303+0000","last_became_peered":"2024-09-15T23:17:13.117303+0000","last_unstale":"2024-09-15T23:17:15.131677+0000","last_undegraded":"2024-09-15T23:17:15.131677+0000","last_fullsized":"2024-09-15T23:17:15.131677+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:36:12.510949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147498+0000","last_change":"2024-09-15T23:17:14.118298+0000","last_active":"2024-09-15T23:17:16.147498+0000","last_peered":"2024-09-15T23:17:16.147498+0000","last_clean":"2024-09-15T23:17:16.147498+0000","last_became_active":"2024-09-15T23:17:14.118015+0000","last_became_peered":"2024-09-15T23:17:14.118015+0000","last_unstale":"2024-09-15T23:17:16.147498+0000","last_undegraded":"2024-09-15T23:17:16.147498+0000","last_fullsized":"2024-09-15T23:17:16.147498+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:55:50.936536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.111495+0000","last_change":"2024-09-15T23:17:13.105562+0000","last_active":"2024-09-15T23:17:13.111495+0000","last_peered":"2024-09-15T23:17:13.111495+0000","last_clean":"2024-09-15T23:17:13.111495+0000","last_became_active":"2024-09-15T23:17:13.105267+0000","last_became_peered":"2024-09-15T23:17:13.105267+0000","last_unstale":"2024-09-15T23:17:13.111495+0000","last_undegraded":"2024-09-15T23:17:13.111495+0000","last_fullsized":"2024-09-15T23:17:13.111495+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:20:15.465328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.105367+0000","last_change":"2024-09-15T23:17:13.105367+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.105367+0000","last_undegraded":"2024-09-15T23:17:13.105367+0000","last_fullsized":"2024-09-15T23:17:13.105367+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129422+0000","last_change":"2024-09-15T23:17:13.120992+0000","last_active":"2024-09-15T23:17:15.129422+0000","last_peered":"2024-09-15T23:17:15.129422+0000","last_clean":"2024-09-15T23:17:15.129422+0000","last_became_active":"2024-09-15T23:17:13.120668+0000","last_became_peered":"2024-09-15T23:17:13.120668+0000","last_unstale":"2024-09-15T23:17:15.129422+0000","last_undegraded":"2024-09-15T23:17:15.129422+0000","last_fullsized":"2024-09-15T23:17:15.129422+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:01:28.019600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148315+0000","last_change":"2024-09-15T23:17:14.129965+0000","last_active":"2024-09-15T23:17:16.148315+0000","last_peered":"2024-09-15T23:17:16.148315+0000","last_clean":"2024-09-15T23:17:16.148315+0000","last_became_active":"2024-09-15T23:17:14.129527+0000","last_became_peered":"2024-09-15T23:17:14.129527+0000","last_unstale":"2024-09-15T23:17:16.148315+0000","last_undegraded":"2024-09-15T23:17:16.148315+0000","last_fullsized":"2024-09-15T23:17:16.148315+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:23.523717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.132127+0000","last_change":"2024-09-15T23:17:13.117392+0000","last_active":"2024-09-15T23:17:15.132127+0000","last_peered":"2024-09-15T23:17:15.132127+0000","last_clean":"2024-09-15T23:17:15.132127+0000","last_became_active":"2024-09-15T23:17:13.117084+0000","last_became_peered":"2024-09-15T23:17:13.117084+0000","last_unstale":"2024-09-15T23:17:15.132127+0000","last_undegraded":"2024-09-15T23:17:15.132127+0000","last_fullsized":"2024-09-15T23:17:15.132127+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:02.927244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.108131+0000","last_change":"2024-09-15T23:17:13.108131+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.108131+0000","last_undegraded":"2024-09-15T23:17:13.108131+0000","last_fullsized":"2024-09-15T23:17:13.108131+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148287+0000","last_change":"2024-09-15T23:17:13.119920+0000","last_active":"2024-09-15T23:17:16.148287+0000","last_peered":"2024-09-15T23:17:16.148287+0000","last_clean":"2024-09-15T23:17:16.148287+0000","last_became_active":"2024-09-15T23:17:13.119565+0000","last_became_peered":"2024-09-15T23:17:13.119565+0000","last_unstale":"2024-09-15T23:17:16.148287+0000","last_undegraded":"2024-09-15T23:17:16.148287+0000","last_fullsized":"2024-09-15T23:17:16.148287+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:18:26.179680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.101926+0000","last_change":"2024-09-15T23:17:13.101926+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.101926+0000","last_undegraded":"2024-09-15T23:17:13.101926+0000","last_fullsized":"2024-09-15T23:17:13.101926+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.111145+0000","last_change":"2024-09-15T23:17:13.107378+0000","last_active":"2024-09-15T23:17:13.111145+0000","last_peered":"2024-09-15T23:17:13.111145+0000","last_clean":"2024-09-15T23:17:13.111145+0000","last_became_active":"2024-09-15T23:17:13.107092+0000","last_became_peered":"2024-09-15T23:17:13.107092+0000","last_unstale":"2024-09-15T23:17:13.111145+0000","last_undegraded":"2024-09-15T23:17:13.111145+0000","last_fullsized":"2024-09-15T23:17:13.111145+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:49.003531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.108493+0000","last_change":"2024-09-15T23:17:13.108493+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.108493+0000","last_undegraded":"2024-09-15T23:17:13.108493+0000","last_fullsized":"2024-09-15T23:17:13.108493+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.118962+0000","last_change":"2024-09-15T23:17:13.115247+0000","last_active":"2024-09-15T23:17:13.118962+0000","last_peered":"2024-09-15T23:17:13.118962+0000","last_clean":"2024-09-15T23:17:13.118962+0000","last_became_active":"2024-09-15T23:17:13.114968+0000","last_became_peered":"2024-09-15T23:17:13.114968+0000","last_unstale":"2024-09-15T23:17:13.118962+0000","last_undegraded":"2024-09-15T23:17:13.118962+0000","last_fullsized":"2024-09-15T23:17:13.118962+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:30:12.355202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148217+0000","last_change":"2024-09-15T23:17:14.128333+0000","last_active":"2024-09-15T23:17:16.148217+0000","last_peered":"2024-09-15T23:17:16.148217+0000","last_clean":"2024-09-15T23:17:16.148217+0000","last_became_active":"2024-09-15T23:17:14.128067+0000","last_became_peered":"2024-09-15T23:17:14.128067+0000","last_unstale":"2024-09-15T23:17:16.148217+0000","last_undegraded":"2024-09-15T23:17:16.148217+0000","last_fullsized":"2024-09-15T23:17:16.148217+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:14.453192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129207+0000","last_change":"2024-09-15T23:17:13.117368+0000","last_active":"2024-09-15T23:17:15.129207+0000","last_peered":"2024-09-15T23:17:15.129207+0000","last_clean":"2024-09-15T23:17:15.129207+0000","last_became_active":"2024-09-15T23:17:13.117082+0000","last_became_peered":"2024-09-15T23:17:13.117082+0000","last_unstale":"2024-09-15T23:17:15.129207+0000","last_undegraded":"2024-09-15T23:17:15.129207+0000","last_fullsized":"2024-09-15T23:17:15.129207+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:44.068584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131891+0000","last_change":"2024-09-15T23:17:14.131213+0000","last_active":"2024-09-15T23:17:15.131891+0000","last_peered":"2024-09-15T23:17:15.131891+0000","last_clean":"2024-09-15T23:17:15.131891+0000","last_became_active":"2024-09-15T23:17:14.127591+0000","last_became_peered":"2024-09-15T23:17:14.127591+0000","last_unstale":"2024-09-15T23:17:15.131891+0000","last_undegraded":"2024-09-15T23:17:15.131891+0000","last_fullsized":"2024-09-15T23:17:15.131891+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:01:29.023692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147713+0000","last_change":"2024-09-15T23:17:13.116393+0000","last_active":"2024-09-15T23:17:16.147713+0000","last_peered":"2024-09-15T23:17:16.147713+0000","last_clean":"2024-09-15T23:17:16.147713+0000","last_became_active":"2024-09-15T23:17:13.116112+0000","last_became_peered":"2024-09-15T23:17:13.116112+0000","last_unstale":"2024-09-15T23:17:16.147713+0000","last_undegraded":"2024-09-15T23:17:16.147713+0000","last_fullsized":"2024-09-15T23:17:16.147713+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:12.306832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.101884+0000","last_change":"2024-09-15T23:17:13.101884+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.101884+0000","last_undegraded":"2024-09-15T23:17:13.101884+0000","last_fullsized":"2024-09-15T23:17:13.101884+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.113359+0000","last_change":"2024-09-15T23:17:13.108829+0000","last_active":"2024-09-15T23:17:13.113359+0000","last_peered":"2024-09-15T23:17:13.113359+0000","last_clean":"2024-09-15T23:17:13.113359+0000","last_became_active":"2024-09-15T23:17:13.108553+0000","last_became_peered":"2024-09-15T23:17:13.108553+0000","last_unstale":"2024-09-15T23:17:13.113359+0000","last_undegraded":"2024-09-15T23:17:13.113359+0000","last_fullsized":"2024-09-15T23:17:13.113359+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:25.965813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131655+0000","last_change":"2024-09-15T23:17:14.120108+0000","last_active":"2024-09-15T23:17:15.131655+0000","last_peered":"2024-09-15T23:17:15.131655+0000","last_clean":"2024-09-15T23:17:15.131655+0000","last_became_active":"2024-09-15T23:17:14.119851+0000","last_became_peered":"2024-09-15T23:17:14.119851+0000","last_unstale":"2024-09-15T23:17:15.131655+0000","last_undegraded":"2024-09-15T23:17:15.131655+0000","last_fullsized":"2024-09-15T23:17:15.131655+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:45.072675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.10","version":"113'8","reported_seq":22,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148262+0000","last_change":"2024-09-15T23:17:13.118354+0000","last_active":"2024-09-15T23:17:16.148262+0000","last_peered":"2024-09-15T23:17:16.148262+0000","last_clean":"2024-09-15T23:17:16.148262+0000","last_became_active":"2024-09-15T23:17:13.117785+0000","last_became_peered":"2024-09-15T23:17:13.117785+0000","last_unstale":"2024-09-15T23:17:16.148262+0000","last_undegraded":"2024-09-15T23:17:16.148262+0000","last_fullsized":"2024-09-15T23:17:16.148262+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:07:03.677453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.107693+0000","last_change":"2024-09-15T23:17:13.107693+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.107693+0000","last_undegraded":"2024-09-15T23:17:13.107693+0000","last_fullsized":"2024-09-15T23:17:13.107693+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.119007+0000","last_change":"2024-09-15T23:17:13.115236+0000","last_active":"2024-09-15T23:17:13.119007+0000","last_peered":"2024-09-15T23:17:13.119007+0000","last_clean":"2024-09-15T23:17:13.119007+0000","last_became_active":"2024-09-15T23:17:13.114937+0000","last_became_peered":"2024-09-15T23:17:13.114937+0000","last_unstale":"2024-09-15T23:17:13.119007+0000","last_undegraded":"2024-09-15T23:17:13.119007+0000","last_fullsized":"2024-09-15T23:17:13.119007+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:48.038067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.106914+0000","last_change":"2024-09-15T23:17:13.106914+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.106914+0000","last_undegraded":"2024-09-15T23:17:13.106914+0000","last_fullsized":"2024-09-15T23:17:13.106914+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.119081+0000","last_change":"2024-09-15T23:17:13.113950+0000","last_active":"2024-09-15T23:17:13.119081+0000","last_peered":"2024-09-15T23:17:13.119081+0000","last_clean":"2024-09-15T23:17:13.119081+0000","last_became_active":"2024-09-15T23:17:13.113680+0000","last_became_peered":"2024-09-15T23:17:13.113680+0000","last_unstale":"2024-09-15T23:17:13.119081+0000","last_undegraded":"2024-09-15T23:17:13.119081+0000","last_fullsized":"2024-09-15T23:17:13.119081+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:21.358088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.104924+0000","last_change":"2024-09-15T23:17:13.104924+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.104924+0000","last_undegraded":"2024-09-15T23:17:13.104924+0000","last_fullsized":"2024-09-15T23:17:13.104924+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129522+0000","last_change":"2024-09-15T23:17:13.120403+0000","last_active":"2024-09-15T23:17:15.129522+0000","last_peered":"2024-09-15T23:17:15.129522+0000","last_clean":"2024-09-15T23:17:15.129522+0000","last_became_active":"2024-09-15T23:17:13.120082+0000","last_became_peered":"2024-09-15T23:17:13.120082+0000","last_unstale":"2024-09-15T23:17:15.129522+0000","last_undegraded":"2024-09-15T23:17:15.129522+0000","last_fullsized":"2024-09-15T23:17:15.129522+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:25:17.334161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129570+0000","last_change":"2024-09-15T23:17:14.137236+0000","last_active":"2024-09-15T23:17:15.129570+0000","last_peered":"2024-09-15T23:17:15.129570+0000","last_clean":"2024-09-15T23:17:15.129570+0000","last_became_active":"2024-09-15T23:17:14.135291+0000","last_became_peered":"2024-09-15T23:17:14.135291+0000","last_unstale":"2024-09-15T23:17:15.129570+0000","last_undegraded":"2024-09-15T23:17:15.129570+0000","last_fullsized":"2024-09-15T23:17:15.129570+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:21:57.537259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148104+0000","last_change":"2024-09-15T23:17:13.118920+0000","last_active":"2024-09-15T23:17:16.148104+0000","last_peered":"2024-09-15T23:17:16.148104+0000","last_clean":"2024-09-15T23:17:16.148104+0000","last_became_active":"2024-09-15T23:17:13.118368+0000","last_became_peered":"2024-09-15T23:17:13.118368+0000","last_unstale":"2024-09-15T23:17:16.148104+0000","last_undegraded":"2024-09-15T23:17:16.148104+0000","last_fullsized":"2024-09-15T23:17:16.148104+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:34.758267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129327+0000","last_change":"2024-09-15T23:17:14.135869+0000","last_active":"2024-09-15T23:17:15.129327+0000","last_peered":"2024-09-15T23:17:15.129327+0000","last_clean":"2024-09-15T23:17:15.129327+0000","last_became_active":"2024-09-15T23:17:14.135547+0000","last_became_peered":"2024-09-15T23:17:14.135547+0000","last_unstale":"2024-09-15T23:17:15.129327+0000","last_undegraded":"2024-09-15T23:17:15.129327+0000","last_fullsized":"2024-09-15T23:17:15.129327+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:38.244015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.121726+0000","last_change":"2024-09-15T23:17:13.115998+0000","last_active":"2024-09-15T23:17:13.121726+0000","last_peered":"2024-09-15T23:17:13.121726+0000","last_clean":"2024-09-15T23:17:13.121726+0000","last_became_active":"2024-09-15T23:17:13.115703+0000","last_became_peered":"2024-09-15T23:17:13.115703+0000","last_unstale":"2024-09-15T23:17:13.121726+0000","last_undegraded":"2024-09-15T23:17:13.121726+0000","last_fullsized":"2024-09-15T23:17:13.121726+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:06:48.045653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148639+0000","last_change":"2024-09-15T23:17:14.140352+0000","last_active":"2024-09-15T23:17:16.148639+0000","last_peered":"2024-09-15T23:17:16.148639+0000","last_clean":"2024-09-15T23:17:16.148639+0000","last_became_active":"2024-09-15T23:17:14.140068+0000","last_became_peered":"2024-09-15T23:17:14.140068+0000","last_unstale":"2024-09-15T23:17:16.148639+0000","last_undegraded":"2024-09-15T23:17:16.148639+0000","last_fullsized":"2024-09-15T23:17:16.148639+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:21.120785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.121676+0000","last_change":"2024-09-15T23:17:13.115923+0000","last_active":"2024-09-15T23:17:13.121676+0000","last_peered":"2024-09-15T23:17:13.121676+0000","last_clean":"2024-09-15T23:17:13.121676+0000","last_became_active":"2024-09-15T23:17:13.115642+0000","last_became_peered":"2024-09-15T23:17:13.115642+0000","last_unstale":"2024-09-15T23:17:13.121676+0000","last_undegraded":"2024-09-15T23:17:13.121676+0000","last_fullsized":"2024-09-15T23:17:13.121676+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:39.622535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.105629+0000","last_change":"2024-09-15T23:17:13.105629+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.105629+0000","last_undegraded":"2024-09-15T23:17:13.105629+0000","last_fullsized":"2024-09-15T23:17:13.105629+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131511+0000","last_change":"2024-09-15T23:17:13.116590+0000","last_active":"2024-09-15T23:17:15.131511+0000","last_peered":"2024-09-15T23:17:15.131511+0000","last_clean":"2024-09-15T23:17:15.131511+0000","last_became_active":"2024-09-15T23:17:13.116231+0000","last_became_peered":"2024-09-15T23:17:13.116231+0000","last_unstale":"2024-09-15T23:17:15.131511+0000","last_undegraded":"2024-09-15T23:17:15.131511+0000","last_fullsized":"2024-09-15T23:17:15.131511+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:55.924454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129501+0000","last_change":"2024-09-15T23:17:14.129416+0000","last_active":"2024-09-15T23:17:15.129501+0000","last_peered":"2024-09-15T23:17:15.129501+0000","last_clean":"2024-09-15T23:17:15.129501+0000","last_became_active":"2024-09-15T23:17:14.127497+0000","last_became_peered":"2024-09-15T23:17:14.127497+0000","last_unstale":"2024-09-15T23:17:15.129501+0000","last_undegraded":"2024-09-15T23:17:15.129501+0000","last_fullsized":"2024-09-15T23:17:15.129501+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:38.026467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.116106+0000","last_change":"2024-09-15T23:17:13.111438+0000","last_active":"2024-09-15T23:17:13.116106+0000","last_peered":"2024-09-15T23:17:13.116106+0000","last_clean":"2024-09-15T23:17:13.116106+0000","last_became_active":"2024-09-15T23:17:13.111139+0000","last_became_peered":"2024-09-15T23:17:13.111139+0000","last_unstale":"2024-09-15T23:17:13.116106+0000","last_undegraded":"2024-09-15T23:17:13.116106+0000","last_fullsized":"2024-09-15T23:17:13.116106+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:05.175799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129514+0000","last_change":"2024-09-15T23:17:14.128647+0000","last_active":"2024-09-15T23:17:15.129514+0000","last_peered":"2024-09-15T23:17:15.129514+0000","last_clean":"2024-09-15T23:17:15.129514+0000","last_became_active":"2024-09-15T23:17:14.128369+0000","last_became_peered":"2024-09-15T23:17:14.128369+0000","last_unstale":"2024-09-15T23:17:15.129514+0000","last_undegraded":"2024-09-15T23:17:15.129514+0000","last_fullsized":"2024-09-15T23:17:15.129514+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:08.741132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"114'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131035+0000","last_change":"2024-09-15T23:17:13.118913+0000","last_active":"2024-09-15T23:17:15.131035+0000","last_peered":"2024-09-15T23:17:15.131035+0000","last_clean":"2024-09-15T23:17:15.131035+0000","last_became_active":"2024-09-15T23:17:13.115889+0000","last_became_peered":"2024-09-15T23:17:13.115889+0000","last_unstale":"2024-09-15T23:17:15.131035+0000","last_undegraded":"2024-09-15T23:17:15.131035+0000","last_fullsized":"2024-09-15T23:17:15.131035+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:45.776883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.132003+0000","last_change":"2024-09-15T23:17:14.125081+0000","last_active":"2024-09-15T23:17:15.132003+0000","last_peered":"2024-09-15T23:17:15.132003+0000","last_clean":"2024-09-15T23:17:15.132003+0000","last_became_active":"2024-09-15T23:17:14.124730+0000","last_became_peered":"2024-09-15T23:17:14.124730+0000","last_unstale":"2024-09-15T23:17:15.132003+0000","last_undegraded":"2024-09-15T23:17:15.132003+0000","last_fullsized":"2024-09-15T23:17:15.132003+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:56.765821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129345+0000","last_change":"2024-09-15T23:17:13.114547+0000","last_active":"2024-09-15T23:17:15.129345+0000","last_peered":"2024-09-15T23:17:15.129345+0000","last_clean":"2024-09-15T23:17:15.129345+0000","last_became_active":"2024-09-15T23:17:13.114261+0000","last_became_peered":"2024-09-15T23:17:13.114261+0000","last_unstale":"2024-09-15T23:17:15.129345+0000","last_undegraded":"2024-09-15T23:17:15.129345+0000","last_fullsized":"2024-09-15T23:17:15.129345+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:47:02.353252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.103127+0000","last_change":"2024-09-15T23:17:13.103127+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.103127+0000","last_undegraded":"2024-09-15T23:17:13.103127+0000","last_fullsized":"2024-09-15T23:17:13.103127+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.118923+0000","last_change":"2024-09-15T23:17:13.113961+0000","last_active":"2024-09-15T23:17:13.118923+0000","last_peered":"2024-09-15T23:17:13.118923+0000","last_clean":"2024-09-15T23:17:13.118923+0000","last_became_active":"2024-09-15T23:17:13.113690+0000","last_became_peered":"2024-09-15T23:17:13.113690+0000","last_unstale":"2024-09-15T23:17:13.118923+0000","last_undegraded":"2024-09-15T23:17:13.118923+0000","last_fullsized":"2024-09-15T23:17:13.118923+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:39.622535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129217+0000","last_change":"2024-09-15T23:17:14.128314+0000","last_active":"2024-09-15T23:17:15.129217+0000","last_peered":"2024-09-15T23:17:15.129217+0000","last_clean":"2024-09-15T23:17:15.129217+0000","last_became_active":"2024-09-15T23:17:14.128027+0000","last_became_peered":"2024-09-15T23:17:14.128027+0000","last_unstale":"2024-09-15T23:17:15.129217+0000","last_undegraded":"2024-09-15T23:17:15.129217+0000","last_fullsized":"2024-09-15T23:17:15.129217+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:48:19.614946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131975+0000","last_change":"2024-09-15T23:17:13.116982+0000","last_active":"2024-09-15T23:17:15.131975+0000","last_peered":"2024-09-15T23:17:15.131975+0000","last_clean":"2024-09-15T23:17:15.131975+0000","last_became_active":"2024-09-15T23:17:13.116634+0000","last_became_peered":"2024-09-15T23:17:13.116634+0000","last_unstale":"2024-09-15T23:17:15.131975+0000","last_undegraded":"2024-09-15T23:17:15.131975+0000","last_fullsized":"2024-09-15T23:17:15.131975+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:29.604651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.103335+0000","last_change":"2024-09-15T23:17:13.103335+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.103335+0000","last_undegraded":"2024-09-15T23:17:13.103335+0000","last_fullsized":"2024-09-15T23:17:13.103335+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.118956+0000","last_change":"2024-09-15T23:17:13.114546+0000","last_active":"2024-09-15T23:17:13.118956+0000","last_peered":"2024-09-15T23:17:13.118956+0000","last_clean":"2024-09-15T23:17:13.118956+0000","last_became_active":"2024-09-15T23:17:13.114310+0000","last_became_peered":"2024-09-15T23:17:13.114310+0000","last_unstale":"2024-09-15T23:17:13.118956+0000","last_undegraded":"2024-09-15T23:17:13.118956+0000","last_fullsized":"2024-09-15T23:17:13.118956+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:42:38.571629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129213+0000","last_change":"2024-09-15T23:17:14.130298+0000","last_active":"2024-09-15T23:17:15.129213+0000","last_peered":"2024-09-15T23:17:15.129213+0000","last_clean":"2024-09-15T23:17:15.129213+0000","last_became_active":"2024-09-15T23:17:14.130022+0000","last_became_peered":"2024-09-15T23:17:14.130022+0000","last_unstale":"2024-09-15T23:17:15.129213+0000","last_undegraded":"2024-09-15T23:17:15.129213+0000","last_fullsized":"2024-09-15T23:17:15.129213+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:54.412546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147562+0000","last_change":"2024-09-15T23:17:13.115530+0000","last_active":"2024-09-15T23:17:16.147562+0000","last_peered":"2024-09-15T23:17:16.147562+0000","last_clean":"2024-09-15T23:17:16.147562+0000","last_became_active":"2024-09-15T23:17:13.115259+0000","last_became_peered":"2024-09-15T23:17:13.115259+0000","last_unstale":"2024-09-15T23:17:16.147562+0000","last_undegraded":"2024-09-15T23:17:16.147562+0000","last_fullsized":"2024-09-15T23:17:16.147562+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:05.175799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.104922+0000","last_change":"2024-09-15T23:17:13.104922+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.104922+0000","last_undegraded":"2024-09-15T23:17:13.104922+0000","last_fullsized":"2024-09-15T23:17:13.104922+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131643+0000","last_change":"2024-09-15T23:17:13.115842+0000","last_active":"2024-09-15T23:17:15.131643+0000","last_peered":"2024-09-15T23:17:15.131643+0000","last_clean":"2024-09-15T23:17:15.131643+0000","last_became_active":"2024-09-15T23:17:13.115274+0000","last_became_peered":"2024-09-15T23:17:13.115274+0000","last_unstale":"2024-09-15T23:17:15.131643+0000","last_undegraded":"2024-09-15T23:17:15.131643+0000","last_fullsized":"2024-09-15T23:17:15.131643+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:12.992861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.132167+0000","last_change":"2024-09-15T23:17:14.128611+0000","last_active":"2024-09-15T23:17:15.132167+0000","last_peered":"2024-09-15T23:17:15.132167+0000","last_clean":"2024-09-15T23:17:15.132167+0000","last_became_active":"2024-09-15T23:17:14.128331+0000","last_became_peered":"2024-09-15T23:17:14.128331+0000","last_unstale":"2024-09-15T23:17:15.132167+0000","last_undegraded":"2024-09-15T23:17:15.132167+0000","last_fullsized":"2024-09-15T23:17:15.132167+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:58:17.851554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.118953+0000","last_change":"2024-09-15T23:17:13.115287+0000","last_active":"2024-09-15T23:17:13.118953+0000","last_peered":"2024-09-15T23:17:13.118953+0000","last_clean":"2024-09-15T23:17:13.118953+0000","last_became_active":"2024-09-15T23:17:13.114980+0000","last_became_peered":"2024-09-15T23:17:13.114980+0000","last_unstale":"2024-09-15T23:17:13.118953+0000","last_undegraded":"2024-09-15T23:17:13.118953+0000","last_fullsized":"2024-09-15T23:17:13.118953+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:24.484954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":335,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.100707+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:17:13.100707+0000","last_peered":"2024-09-15T23:17:13.100707+0000","last_clean":"2024-09-15T23:17:13.100707+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:17:13.100707+0000","last_undegraded":"2024-09-15T23:17:13.100707+0000","last_fullsized":"2024-09-15T23:17:13.100707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23,"ondisk_log_size":23,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476804,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40856,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330984,"statfs":{"total":96636764160,"available":96594927616,"internally_reserved":0,"allocated":1372160,"data_stored":602102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476801,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40836,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331004,"statfs":{"total":96636764160,"available":96594948096,"internally_reserved":0,"allocated":1359872,"data_stored":595827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476803,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37276,"kb_used_data":1920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334564,"statfs":{"total":96636764160,"available":96598593536,"internally_reserved":0,"allocated":1966080,"data_stored":1192470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36680,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335160,"statfs":{"total":96636764160,"available":96599203840,"internally_reserved":0,"allocated":1359872,"data_stored":595827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542210,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36712,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335128,"statfs":{"total":96636764160,"available":96599171072,"internally_reserved":0,"allocated":1388544,"data_stored":609459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542210,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36708,"kb_used_data":1352,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335132,"statfs":{"total":96636764160,"available":96599175168,"internally_reserved":0,"allocated":1384448,"data_stored":608877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542209,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37316,"kb_used_data":1964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334524,"statfs":{"total":96636764160,"available":96598552576,"internally_reserved":0,"allocated":2011136,"data_stored":1207213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542211,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36716,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335124,"statfs":{"total":96636764160,"available":96599166976,"internally_reserved":0,"allocated":1400832,"data_stored":615759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:17:17.865 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3b is not active+clean 2024-09-15T23:17:17.865 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:17:13.104133+0000', 'last_change': '2024-09-15T23:17:13.104133+0000', 'last_active': '2024-09-15T23:17:13.097077+0000', 'last_peered': '2024-09-15T23:17:13.097077+0000', 'last_clean': '2024-09-15T23:17:13.097077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:17:13.104133+0000', 'last_undegraded': '2024-09-15T23:17:13.104133+0000', 'last_fullsized': '2024-09-15T23:17:13.104133+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_clean_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:17:17.865 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3a is not active+clean 2024-09-15T23:17:17.865 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:17:13.101901+0000', 'last_change': '2024-09-15T23:17:13.101901+0000', 'last_active': '2024-09-15T23:17:13.097077+0000', 'last_peered': '2024-09-15T23:17:13.097077+0000', 'last_clean': '2024-09-15T23:17:13.097077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:17:13.101901+0000', 'last_undegraded': '2024-09-15T23:17:13.101901+0000', 'last_fullsized': '2024-09-15T23:17:13.101901+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_clean_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:17:17.866 INFO:tasks.ceph.ceph_manager.ceph:PG 15.39 is not active+clean 2024-09-15T23:17:17.866 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:17:13.102308+0000', 'last_change': '2024-09-15T23:17:13.102308+0000', 'last_active': '2024-09-15T23:17:13.097077+0000', 'last_peered': '2024-09-15T23:17:13.097077+0000', 'last_clean': '2024-09-15T23:17:13.097077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:17:13.102308+0000', 'last_undegraded': '2024-09-15T23:17:13.102308+0000', 'last_fullsized': '2024-09-15T23:17:13.102308+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_clean_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:17:17.866 INFO:tasks.ceph.ceph_manager.ceph:PG 15.37 is not active+clean 2024-09-15T23:17:17.866 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:17:13.103556+0000', 'last_change': '2024-09-15T23:17:13.103556+0000', 'last_active': '2024-09-15T23:17:13.097077+0000', 'last_peered': '2024-09-15T23:17:13.097077+0000', 'last_clean': '2024-09-15T23:17:13.097077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:17:13.103556+0000', 'last_undegraded': '2024-09-15T23:17:13.103556+0000', 'last_fullsized': '2024-09-15T23:17:13.103556+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_clean_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:17:17.866 INFO:tasks.ceph.ceph_manager.ceph:PG 15.36 is not active+clean 2024-09-15T23:17:17.866 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:17:13.106231+0000', 'last_change': '2024-09-15T23:17:13.106231+0000', 'last_active': '2024-09-15T23:17:13.097077+0000', 'last_peered': '2024-09-15T23:17:13.097077+0000', 'last_clean': '2024-09-15T23:17:13.097077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:17:13.106231+0000', 'last_undegraded': '2024-09-15T23:17:13.106231+0000', 'last_fullsized': '2024-09-15T23:17:13.106231+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_clean_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:17:17.866 INFO:tasks.ceph.ceph_manager.ceph:PG 15.35 is not active+clean 2024-09-15T23:17:17.866 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:17:13.106027+0000', 'last_change': '2024-09-15T23:17:13.106027+0000', 'last_active': '2024-09-15T23:17:13.097077+0000', 'last_peered': '2024-09-15T23:17:13.097077+0000', 'last_clean': '2024-09-15T23:17:13.097077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:17:13.106027+0000', 'last_undegraded': '2024-09-15T23:17:13.106027+0000', 'last_fullsized': '2024-09-15T23:17:13.106027+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_clean_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:17:17.866 INFO:tasks.ceph.ceph_manager.ceph:PG 15.34 is not active+clean 2024-09-15T23:17:17.866 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:17:13.106694+0000', 'last_change': '2024-09-15T23:17:13.106694+0000', 'last_active': '2024-09-15T23:17:13.097077+0000', 'last_peered': '2024-09-15T23:17:13.097077+0000', 'last_clean': '2024-09-15T23:17:13.097077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:17:13.106694+0000', 'last_undegraded': '2024-09-15T23:17:13.106694+0000', 'last_fullsized': '2024-09-15T23:17:13.106694+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_clean_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:17:17.866 INFO:tasks.ceph.ceph_manager.ceph:PG 15.30 is not active+clean 2024-09-15T23:17:17.866 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:17:13.102341+0000', 'last_change': '2024-09-15T23:17:13.102341+0000', 'last_active': '2024-09-15T23:17:13.097077+0000', 'last_peered': '2024-09-15T23:17:13.097077+0000', 'last_clean': '2024-09-15T23:17:13.097077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:17:13.102341+0000', 'last_undegraded': '2024-09-15T23:17:13.102341+0000', 'last_fullsized': '2024-09-15T23:17:13.102341+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_clean_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:17:17.867 INFO:tasks.ceph.ceph_manager.ceph:PG 15.2c is not active+clean 2024-09-15T23:17:17.867 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:17:13.106292+0000', 'last_change': '2024-09-15T23:17:13.106292+0000', 'last_active': '2024-09-15T23:17:13.097077+0000', 'last_peered': '2024-09-15T23:17:13.097077+0000', 'last_clean': '2024-09-15T23:17:13.097077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:17:13.106292+0000', 'last_undegraded': '2024-09-15T23:17:13.106292+0000', 'last_fullsized': '2024-09-15T23:17:13.106292+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_clean_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:17:17.867 INFO:tasks.ceph.ceph_manager.ceph:PG 15.28 is not active+clean 2024-09-15T23:17:17.867 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:17:13.106750+0000', 'last_change': '2024-09-15T23:17:13.106750+0000', 'last_active': '2024-09-15T23:17:13.097077+0000', 'last_peered': '2024-09-15T23:17:13.097077+0000', 'last_clean': '2024-09-15T23:17:13.097077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:17:13.106750+0000', 'last_undegraded': '2024-09-15T23:17:13.106750+0000', 'last_fullsized': '2024-09-15T23:17:13.106750+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_clean_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:17:17.867 INFO:tasks.ceph.ceph_manager.ceph:PG 15.27 is not active+clean 2024-09-15T23:17:17.867 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:17:13.106036+0000', 'last_change': '2024-09-15T23:17:13.106036+0000', 'last_active': '2024-09-15T23:17:13.097077+0000', 'last_peered': '2024-09-15T23:17:13.097077+0000', 'last_clean': '2024-09-15T23:17:13.097077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:17:13.106036+0000', 'last_undegraded': '2024-09-15T23:17:13.106036+0000', 'last_fullsized': '2024-09-15T23:17:13.106036+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_clean_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:17:17.867 INFO:tasks.ceph.ceph_manager.ceph:PG 15.25 is not active+clean 2024-09-15T23:17:17.867 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:17:13.108049+0000', 'last_change': '2024-09-15T23:17:13.108049+0000', 'last_active': '2024-09-15T23:17:13.097077+0000', 'last_peered': '2024-09-15T23:17:13.097077+0000', 'last_clean': '2024-09-15T23:17:13.097077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:17:13.108049+0000', 'last_undegraded': '2024-09-15T23:17:13.108049+0000', 'last_fullsized': '2024-09-15T23:17:13.108049+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_clean_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:17:17.867 INFO:tasks.ceph.ceph_manager.ceph:PG 15.24 is not active+clean 2024-09-15T23:17:17.867 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:17:13.107769+0000', 'last_change': '2024-09-15T23:17:13.107769+0000', 'last_active': '2024-09-15T23:17:13.097077+0000', 'last_peered': '2024-09-15T23:17:13.097077+0000', 'last_clean': '2024-09-15T23:17:13.097077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:17:13.107769+0000', 'last_undegraded': '2024-09-15T23:17:13.107769+0000', 'last_fullsized': '2024-09-15T23:17:13.107769+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_clean_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:17:17.867 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1d is not active+clean 2024-09-15T23:17:17.868 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:17:13.105624+0000', 'last_change': '2024-09-15T23:17:13.105624+0000', 'last_active': '2024-09-15T23:17:13.097077+0000', 'last_peered': '2024-09-15T23:17:13.097077+0000', 'last_clean': '2024-09-15T23:17:13.097077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:17:13.105624+0000', 'last_undegraded': '2024-09-15T23:17:13.105624+0000', 'last_fullsized': '2024-09-15T23:17:13.105624+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_clean_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:17:17.868 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1a is not active+clean 2024-09-15T23:17:17.868 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:17:13.105392+0000', 'last_change': '2024-09-15T23:17:13.105392+0000', 'last_active': '2024-09-15T23:17:13.097077+0000', 'last_peered': '2024-09-15T23:17:13.097077+0000', 'last_clean': '2024-09-15T23:17:13.097077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:17:13.105392+0000', 'last_undegraded': '2024-09-15T23:17:13.105392+0000', 'last_fullsized': '2024-09-15T23:17:13.105392+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_clean_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:17:17.868 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1b is not active+clean 2024-09-15T23:17:17.868 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:17:13.103763+0000', 'last_change': '2024-09-15T23:17:13.103763+0000', 'last_active': '2024-09-15T23:17:13.097077+0000', 'last_peered': '2024-09-15T23:17:13.097077+0000', 'last_clean': '2024-09-15T23:17:13.097077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:17:13.103763+0000', 'last_undegraded': '2024-09-15T23:17:13.103763+0000', 'last_fullsized': '2024-09-15T23:17:13.103763+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_clean_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:17:17.868 INFO:tasks.ceph.ceph_manager.ceph:PG 15.19 is not active+clean 2024-09-15T23:17:17.868 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:17:13.105367+0000', 'last_change': '2024-09-15T23:17:13.105367+0000', 'last_active': '2024-09-15T23:17:13.097077+0000', 'last_peered': '2024-09-15T23:17:13.097077+0000', 'last_clean': '2024-09-15T23:17:13.097077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:17:13.105367+0000', 'last_undegraded': '2024-09-15T23:17:13.105367+0000', 'last_fullsized': '2024-09-15T23:17:13.105367+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_clean_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:17:17.868 INFO:tasks.ceph.ceph_manager.ceph:PG 15.17 is not active+clean 2024-09-15T23:17:17.868 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:17:13.108131+0000', 'last_change': '2024-09-15T23:17:13.108131+0000', 'last_active': '2024-09-15T23:17:13.097077+0000', 'last_peered': '2024-09-15T23:17:13.097077+0000', 'last_clean': '2024-09-15T23:17:13.097077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:17:13.108131+0000', 'last_undegraded': '2024-09-15T23:17:13.108131+0000', 'last_fullsized': '2024-09-15T23:17:13.108131+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_clean_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:17:17.868 INFO:tasks.ceph.ceph_manager.ceph:PG 15.14 is not active+clean 2024-09-15T23:17:17.868 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:17:13.101926+0000', 'last_change': '2024-09-15T23:17:13.101926+0000', 'last_active': '2024-09-15T23:17:13.097077+0000', 'last_peered': '2024-09-15T23:17:13.097077+0000', 'last_clean': '2024-09-15T23:17:13.097077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:17:13.101926+0000', 'last_undegraded': '2024-09-15T23:17:13.101926+0000', 'last_fullsized': '2024-09-15T23:17:13.101926+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_clean_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:17:17.869 INFO:tasks.ceph.ceph_manager.ceph:PG 15.15 is not active+clean 2024-09-15T23:17:17.869 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:17:13.108493+0000', 'last_change': '2024-09-15T23:17:13.108493+0000', 'last_active': '2024-09-15T23:17:13.097077+0000', 'last_peered': '2024-09-15T23:17:13.097077+0000', 'last_clean': '2024-09-15T23:17:13.097077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:17:13.108493+0000', 'last_undegraded': '2024-09-15T23:17:13.108493+0000', 'last_fullsized': '2024-09-15T23:17:13.108493+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_clean_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:17:17.869 INFO:tasks.ceph.ceph_manager.ceph:PG 15.10 is not active+clean 2024-09-15T23:17:17.869 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:17:13.101884+0000', 'last_change': '2024-09-15T23:17:13.101884+0000', 'last_active': '2024-09-15T23:17:13.097077+0000', 'last_peered': '2024-09-15T23:17:13.097077+0000', 'last_clean': '2024-09-15T23:17:13.097077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:17:13.101884+0000', 'last_undegraded': '2024-09-15T23:17:13.101884+0000', 'last_fullsized': '2024-09-15T23:17:13.101884+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_clean_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:17:17.869 INFO:tasks.ceph.ceph_manager.ceph:PG 15.f is not active+clean 2024-09-15T23:17:17.869 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:17:13.107693+0000', 'last_change': '2024-09-15T23:17:13.107693+0000', 'last_active': '2024-09-15T23:17:13.097077+0000', 'last_peered': '2024-09-15T23:17:13.097077+0000', 'last_clean': '2024-09-15T23:17:13.097077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:17:13.107693+0000', 'last_undegraded': '2024-09-15T23:17:13.107693+0000', 'last_fullsized': '2024-09-15T23:17:13.107693+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_clean_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:17:17.869 INFO:tasks.ceph.ceph_manager.ceph:PG 15.c is not active+clean 2024-09-15T23:17:17.869 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:17:13.106914+0000', 'last_change': '2024-09-15T23:17:13.106914+0000', 'last_active': '2024-09-15T23:17:13.097077+0000', 'last_peered': '2024-09-15T23:17:13.097077+0000', 'last_clean': '2024-09-15T23:17:13.097077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:17:13.106914+0000', 'last_undegraded': '2024-09-15T23:17:13.106914+0000', 'last_fullsized': '2024-09-15T23:17:13.106914+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_clean_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:17:17.869 INFO:tasks.ceph.ceph_manager.ceph:PG 15.d is not active+clean 2024-09-15T23:17:17.869 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:17:13.104924+0000', 'last_change': '2024-09-15T23:17:13.104924+0000', 'last_active': '2024-09-15T23:17:13.097077+0000', 'last_peered': '2024-09-15T23:17:13.097077+0000', 'last_clean': '2024-09-15T23:17:13.097077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:17:13.104924+0000', 'last_undegraded': '2024-09-15T23:17:13.104924+0000', 'last_fullsized': '2024-09-15T23:17:13.104924+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_clean_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:17:17.869 INFO:tasks.ceph.ceph_manager.ceph:PG 15.9 is not active+clean 2024-09-15T23:17:17.869 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:17:13.105629+0000', 'last_change': '2024-09-15T23:17:13.105629+0000', 'last_active': '2024-09-15T23:17:13.097077+0000', 'last_peered': '2024-09-15T23:17:13.097077+0000', 'last_clean': '2024-09-15T23:17:13.097077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:17:13.105629+0000', 'last_undegraded': '2024-09-15T23:17:13.105629+0000', 'last_fullsized': '2024-09-15T23:17:13.105629+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_clean_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:17:17.870 INFO:tasks.ceph.ceph_manager.ceph:PG 15.5 is not active+clean 2024-09-15T23:17:17.870 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:17:13.103127+0000', 'last_change': '2024-09-15T23:17:13.103127+0000', 'last_active': '2024-09-15T23:17:13.097077+0000', 'last_peered': '2024-09-15T23:17:13.097077+0000', 'last_clean': '2024-09-15T23:17:13.097077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:17:13.103127+0000', 'last_undegraded': '2024-09-15T23:17:13.103127+0000', 'last_fullsized': '2024-09-15T23:17:13.103127+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_clean_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:17:17.870 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3 is not active+clean 2024-09-15T23:17:17.870 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:17:13.103335+0000', 'last_change': '2024-09-15T23:17:13.103335+0000', 'last_active': '2024-09-15T23:17:13.097077+0000', 'last_peered': '2024-09-15T23:17:13.097077+0000', 'last_clean': '2024-09-15T23:17:13.097077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:17:13.103335+0000', 'last_undegraded': '2024-09-15T23:17:13.103335+0000', 'last_fullsized': '2024-09-15T23:17:13.103335+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_clean_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:17:17.870 INFO:tasks.ceph.ceph_manager.ceph:PG 15.1 is not active+clean 2024-09-15T23:17:17.870 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 112, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:17:13.104922+0000', 'last_change': '2024-09-15T23:17:13.104922+0000', 'last_active': '2024-09-15T23:17:13.097077+0000', 'last_peered': '2024-09-15T23:17:13.097077+0000', 'last_clean': '2024-09-15T23:17:13.097077+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:17:13.104922+0000', 'last_undegraded': '2024-09-15T23:17:13.104922+0000', 'last_fullsized': '2024-09-15T23:17:13.104922+0000', 'mapping_epoch': 112, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 112, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'last_clean_scrub_stamp': '2024-09-15T23:17:13.097077+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:17:17.870 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:17:17.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.998+0000 7f6cb776d640 1 Processor -- start 2024-09-15T23:17:17.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.998+0000 7f6cb776d640 1 -- start start 2024-09-15T23:17:18.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.999+0000 7f6cb776d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f6cb0073890 0x7f6cb00b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:18.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.999+0000 7f6cb776d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cb00b4020 con 0x7f6cb00b5880 2024-09-15T23:17:18.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.999+0000 7f6cb776d640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cb00b42c0 con 0x7f6cb0145ed0 2024-09-15T23:17:18.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.999+0000 7f6cb776d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f6cb00b63f0 con 0x7f6cb0073890 2024-09-15T23:17:18.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.999+0000 7f6cb5d0a640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6cb00b5880 0x7f6cb00b5ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40590/0 (socket says 172.21.15.123:40590) 2024-09-15T23:17:18.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.999+0000 7f6cb5d0a640 1 -- 172.21.15.123:0/3493590882 learned_addr learned my addr 172.21.15.123:0/3493590882 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:17:18.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.999+0000 7f6cb4d08640 1 --2- 172.21.15.123:0/3493590882 >> v2:172.21.15.188:3300/0 conn(0x7f6cb0073890 0x7f6cb00b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:18.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.999+0000 7f6ca7fff640 1 -- 172.21.15.123:0/3493590882 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3791075557 0 0) 0x7f6cb00b4020 con 0x7f6cb00b5880 2024-09-15T23:17:18.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:17.999+0000 7f6ca7fff640 1 -- 172.21.15.123:0/3493590882 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c9c003520 con 0x7f6cb00b5880 2024-09-15T23:17:18.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.000+0000 7f6ca7fff640 1 -- 172.21.15.123:0/3493590882 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1416875738 0 0) 0x7f6c9c003520 con 0x7f6cb00b5880 2024-09-15T23:17:18.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.000+0000 7f6ca7fff640 1 -- 172.21.15.123:0/3493590882 >> v2:172.21.15.188:3300/0 conn(0x7f6cb0073890 msgr2=0x7f6cb00b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:18.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.000+0000 7f6ca7fff640 1 --2- 172.21.15.123:0/3493590882 >> v2:172.21.15.188:3300/0 conn(0x7f6cb0073890 0x7f6cb00b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:18.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.000+0000 7f6ca7fff640 1 -- 172.21.15.123:0/3493590882 >> v1:172.21.15.188:6789/0 conn(0x7f6cb0145ed0 legacy=0x7f6cb0073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:18.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.000+0000 7f6ca7fff640 1 -- 172.21.15.123:0/3493590882 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cb00b45a0 con 0x7f6cb00b5880 2024-09-15T23:17:18.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.000+0000 7f6ca7fff640 1 -- 172.21.15.123:0/3493590882 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f6cac001690 con 0x7f6cb00b5880 2024-09-15T23:17:18.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.000+0000 7f6ca7fff640 1 -- 172.21.15.123:0/3493590882 >> v1:172.21.15.123:6789/0 conn(0x7f6cb00b5880 legacy=0x7f6cb00b5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:18.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.000+0000 7f6ca7fff640 1 --2- 172.21.15.123:0/3493590882 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6c9c0039b0 0x7f6c9c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:18.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.000+0000 7f6ca7fff640 1 --2- 172.21.15.123:0/3493590882 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6c9c0043b0 0x7f6c9c004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:18.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.000+0000 7f6ca7fff640 1 --2- 172.21.15.123:0/3493590882 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6c9c005080 0x7f6c9c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:18.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.000+0000 7f6ca7fff640 1 -- 172.21.15.123:0/3493590882 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6c9c00bfb0 con 0x7f6c9c005080 2024-09-15T23:17:18.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.000+0000 7f6ca7fff640 1 -- 172.21.15.123:0/3493590882 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6c9c00c160 con 0x7f6c9c0039b0 2024-09-15T23:17:18.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.000+0000 7f6ca7fff640 1 -- 172.21.15.123:0/3493590882 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6c9c00c360 con 0x7f6c9c0043b0 2024-09-15T23:17:18.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.000+0000 7f6cb4d08640 1 --2- 172.21.15.123:0/3493590882 >> v2:172.21.15.188:3300/0 conn(0x7f6cb0073890 0x7f6cb00b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:17:18.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.000+0000 7f6cb5d0a640 1 --2- 172.21.15.123:0/3493590882 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6c9c005080 0x7f6c9c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:18.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.000+0000 7f6cb5509640 1 --2- 172.21.15.123:0/3493590882 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6c9c0039b0 0x7f6c9c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:18.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.000+0000 7f6cb4d08640 1 --2- 172.21.15.123:0/3493590882 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6c9c0043b0 0x7f6c9c004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:18.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.000+0000 7f6cb5d0a640 1 -- 172.21.15.123:0/3493590882 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6c9c0043b0 msgr2=0x7f6c9c004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:18.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.000+0000 7f6cb5d0a640 1 --2- 172.21.15.123:0/3493590882 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6c9c0043b0 0x7f6c9c004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:18.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.000+0000 7f6cb5d0a640 1 -- 172.21.15.123:0/3493590882 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6c9c0039b0 msgr2=0x7f6c9c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:18.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.000+0000 7f6cb5d0a640 1 --2- 172.21.15.123:0/3493590882 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6c9c0039b0 0x7f6c9c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:18.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.000+0000 7f6cb5d0a640 1 -- 172.21.15.123:0/3493590882 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c9c003520 con 0x7f6c9c005080 2024-09-15T23:17:18.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.000+0000 7f6cb5509640 1 --2- 172.21.15.123:0/3493590882 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6c9c0039b0 0x7f6c9c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:17:18.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.001+0000 7f6cb5d0a640 1 -- 172.21.15.123:0/3493590882 reap_dead start 2024-09-15T23:17:18.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.001+0000 7f6cb5d0a640 1 --2- 172.21.15.123:0/3493590882 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6c9c005080 0x7f6c9c00b9c0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f6cac00c210 tx=0x7f6c9c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8045cba3cb63d6e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:18.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.001+0000 7f6ca7fff640 1 -- 172.21.15.123:0/3493590882 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac007d30 con 0x7f6c9c005080 2024-09-15T23:17:18.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.001+0000 7f6ca7fff640 1 -- 172.21.15.123:0/3493590882 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cac005ad0 con 0x7f6c9c005080 2024-09-15T23:17:18.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.001+0000 7f6ca7fff640 1 -- 172.21.15.123:0/3493590882 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac007070 con 0x7f6c9c005080 2024-09-15T23:17:18.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.001+0000 7f6cb776d640 1 -- 172.21.15.123:0/3493590882 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6c9c005080 msgr2=0x7f6c9c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:18.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.001+0000 7f6cb776d640 1 --2- 172.21.15.123:0/3493590882 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6c9c005080 0x7f6c9c00b9c0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f6cac00c210 tx=0x7f6c9c005830 comp rx=0 tx=0).stop 2024-09-15T23:17:18.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.001+0000 7f6cb776d640 1 -- 172.21.15.123:0/3493590882 shutdown_connections 2024-09-15T23:17:18.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.001+0000 7f6cb776d640 1 --2- 172.21.15.123:0/3493590882 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6c9c005080 0x7f6c9c00b9c0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:18.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.001+0000 7f6cb776d640 1 -- 172.21.15.123:0/3493590882 >> 172.21.15.123:0/3493590882 conn(0x7f6cb00ccec0 msgr2=0x7f6cb00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:18.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.002+0000 7f6cb776d640 1 -- 172.21.15.123:0/3493590882 shutdown_connections 2024-09-15T23:17:18.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.002+0000 7f6cb776d640 1 -- 172.21.15.123:0/3493590882 wait complete. 2024-09-15T23:17:18.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.003+0000 7f6cb776d640 1 Processor -- start 2024-09-15T23:17:18.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.003+0000 7f6cb776d640 1 -- start start 2024-09-15T23:17:18.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.003+0000 7f6cb776d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6c9c005080 0x7f6cb013c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:18.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.003+0000 7f6cb776d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6cb013d9d0 0x7f6cb013de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:18.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.003+0000 7f6cb776d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6cb013ef60 0x7f6cb013f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:18.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.003+0000 7f6cb776d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb01462b0 con 0x7f6cb013ef60 2024-09-15T23:17:18.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.003+0000 7f6cb776d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb00b4b60 con 0x7f6cb013d9d0 2024-09-15T23:17:18.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.003+0000 7f6cb776d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6cb0146430 con 0x7f6c9c005080 2024-09-15T23:17:18.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.003+0000 7f6cb5d0a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6cb013ef60 0x7f6cb013f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:18.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.003+0000 7f6cb5d0a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6cb013ef60 0x7f6cb013f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48204/0 (socket says 172.21.15.123:48204) 2024-09-15T23:17:18.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.004+0000 7f6cb5d0a640 1 -- 172.21.15.123:0/1550489752 learned_addr learned my addr 172.21.15.123:0/1550489752 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:18.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.004+0000 7f6cb4d08640 1 --2- 172.21.15.123:0/1550489752 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6cb013d9d0 0x7f6cb013de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:18.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.004+0000 7f6cb5509640 1 --2- 172.21.15.123:0/1550489752 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6c9c005080 0x7f6cb013c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:18.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.004+0000 7f6cb5d0a640 1 -- 172.21.15.123:0/1550489752 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6c9c005080 msgr2=0x7f6cb013c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:18.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.004+0000 7f6cb5d0a640 1 --2- 172.21.15.123:0/1550489752 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6c9c005080 0x7f6cb013c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:18.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.004+0000 7f6cb5d0a640 1 -- 172.21.15.123:0/1550489752 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6cb013d9d0 msgr2=0x7f6cb013de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:18.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.004+0000 7f6cb5d0a640 1 --2- 172.21.15.123:0/1550489752 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6cb013d9d0 0x7f6cb013de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:18.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.004+0000 7f6cb5d0a640 1 -- 172.21.15.123:0/1550489752 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cb013c9f0 con 0x7f6cb013ef60 2024-09-15T23:17:18.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.004+0000 7f6cb5d0a640 1 --2- 172.21.15.123:0/1550489752 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6cb013ef60 0x7f6cb013f410 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f6cac00c330 tx=0x7f6cb00b4770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:18.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.004+0000 7f6ca5ffb640 1 -- 172.21.15.123:0/1550489752 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac001660 con 0x7f6cb013ef60 2024-09-15T23:17:18.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.004+0000 7f6ca5ffb640 1 -- 172.21.15.123:0/1550489752 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cac040070 con 0x7f6cb013ef60 2024-09-15T23:17:18.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.004+0000 7f6cb776d640 1 -- 172.21.15.123:0/1550489752 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cb013e6c0 con 0x7f6cb013ef60 2024-09-15T23:17:18.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.004+0000 7f6ca5ffb640 1 -- 172.21.15.123:0/1550489752 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac004a00 con 0x7f6cb013ef60 2024-09-15T23:17:18.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.004+0000 7f6cb776d640 1 -- 172.21.15.123:0/1550489752 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cb013ec80 con 0x7f6cb013ef60 2024-09-15T23:17:18.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.005+0000 7f6cb776d640 1 -- 172.21.15.123:0/1550489752 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cb00b5080 con 0x7f6cb013ef60 2024-09-15T23:17:18.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.006+0000 7f6ca5ffb640 1 -- 172.21.15.123:0/1550489752 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6cac03a070 con 0x7f6cb013ef60 2024-09-15T23:17:18.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.006+0000 7f6ca5ffb640 1 --2- 172.21.15.123:0/1550489752 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6c9406c2e0 0x7f6c9406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:18.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.006+0000 7f6ca5ffb640 1 -- 172.21.15.123:0/1550489752 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5709+0+0 (secure 0 0 0) 0x7f6cac0aacb0 con 0x7f6cb013ef60 2024-09-15T23:17:18.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.006+0000 7f6cb5509640 1 --2- 172.21.15.123:0/1550489752 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6c9406c2e0 0x7f6c9406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:18.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.007+0000 7f6cb5509640 1 --2- 172.21.15.123:0/1550489752 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6c9406c2e0 0x7f6c9406e7a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8007fd0 tx=0x7f6ca8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:18.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.010+0000 7f6ca5ffb640 1 -- 172.21.15.123:0/1550489752 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6cb013c9f0 con 0x7f6cb013ef60 2024-09-15T23:17:18.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.238+0000 7f6cb776d640 1 -- 172.21.15.123:0/1550489752 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f6cb00b3680 con 0x7f6cb013ef60 2024-09-15T23:17:18.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.239+0000 7f6ca5ffb640 1 -- 172.21.15.123:0/1550489752 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1573 (secure 0 0 0) 0x7f6cac0313d0 con 0x7f6cb013ef60 2024-09-15T23:17:18.240 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:17:18.240 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":328,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":114,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":55},{"state_name":"creating+peering","count":28},{"state_name":"active+clean","count":14}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":310104064,"bytes_avail":772784009216,"bytes_total":773094113280,"unknown_pgs_ratio":0.56701028347015381,"inactive_pgs_ratio":0.28865978121757507},"fsmap":{"epoch":73,"btime":"2024-09-15T23:17:16:266707+0000","id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":7608}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":16,"modified":"2024-09-15T23:17:03.572263+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T23:17:18.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.241+0000 7f6cb776d640 1 -- 172.21.15.123:0/1550489752 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6c9406c2e0 msgr2=0x7f6c9406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:18.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.241+0000 7f6cb776d640 1 --2- 172.21.15.123:0/1550489752 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6c9406c2e0 0x7f6c9406e7a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8007fd0 tx=0x7f6ca8009040 comp rx=0 tx=0).stop 2024-09-15T23:17:18.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.241+0000 7f6cb776d640 1 -- 172.21.15.123:0/1550489752 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6cb013ef60 msgr2=0x7f6cb013f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:18.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.241+0000 7f6cb776d640 1 --2- 172.21.15.123:0/1550489752 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6cb013ef60 0x7f6cb013f410 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f6cac00c330 tx=0x7f6cb00b4770 comp rx=0 tx=0).stop 2024-09-15T23:17:18.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.241+0000 7f6cb776d640 1 -- 172.21.15.123:0/1550489752 shutdown_connections 2024-09-15T23:17:18.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.241+0000 7f6cb776d640 1 --2- 172.21.15.123:0/1550489752 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6c9406c2e0 0x7f6c9406e7a0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:18.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.241+0000 7f6cb776d640 1 --2- 172.21.15.123:0/1550489752 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6cb013ef60 0x7f6cb013f410 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:18.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.241+0000 7f6cb776d640 1 --2- 172.21.15.123:0/1550489752 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6cb013d9d0 0x7f6cb013de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:18.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.241+0000 7f6cb776d640 1 --2- 172.21.15.123:0/1550489752 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6c9c005080 0x7f6cb013c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:18.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.241+0000 7f6cb776d640 1 -- 172.21.15.123:0/1550489752 >> 172.21.15.123:0/1550489752 conn(0x7f6cb00ccec0 msgr2=0x7f6cb00d0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:18.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.241+0000 7f6cb776d640 1 -- 172.21.15.123:0/1550489752 shutdown_connections 2024-09-15T23:17:18.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.241+0000 7f6cb776d640 1 -- 172.21.15.123:0/1550489752 wait complete. 2024-09-15T23:17:18.252 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-15T23:17:18.253 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:17:18.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.350+0000 7f2f56b86640 1 Processor -- start 2024-09-15T23:17:18.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.350+0000 7f2f56b86640 1 -- start start 2024-09-15T23:17:18.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.351+0000 7f2f56b86640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f500b2d40 0x7f2f5006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:18.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.351+0000 7f2f56b86640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2f5013eb20 0x7f2f5006c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:18.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.351+0000 7f2f56b86640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2f5015bcf0 0x7f2f5015c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:18.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.351+0000 7f2f56b86640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f2f50071ab0 con 0x7f2f5015bcf0 2024-09-15T23:17:18.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.351+0000 7f2f56b86640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f2f50071180 con 0x7f2f5013eb20 2024-09-15T23:17:18.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.351+0000 7f2f56b86640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f2f50071460 con 0x7f2f500b2d40 2024-09-15T23:17:18.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.351+0000 7f2f55123640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2f5015bcf0 0x7f2f5015c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:18.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.351+0000 7f2f55123640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2f5015bcf0 0x7f2f5015c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48208/0 (socket says 172.21.15.123:48208) 2024-09-15T23:17:18.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.351+0000 7f2f55123640 1 -- 172.21.15.123:0/45351346 learned_addr learned my addr 172.21.15.123:0/45351346 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:18.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.351+0000 7f2f54922640 1 --2- 172.21.15.123:0/45351346 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f500b2d40 0x7f2f5006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:18.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.351+0000 7f2f47fff640 1 --2- 172.21.15.123:0/45351346 >> v2:172.21.15.188:3300/0 conn(0x7f2f5013eb20 0x7f2f5006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:18.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.351+0000 7f2f55123640 1 -- 172.21.15.123:0/45351346 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f500b2d40 msgr2=0x7f2f5006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:18.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.351+0000 7f2f55123640 1 --2- 172.21.15.123:0/45351346 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f500b2d40 0x7f2f5006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:18.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.351+0000 7f2f55123640 1 -- 172.21.15.123:0/45351346 >> v2:172.21.15.188:3300/0 conn(0x7f2f5013eb20 msgr2=0x7f2f5006c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:18.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.351+0000 7f2f55123640 1 --2- 172.21.15.123:0/45351346 >> v2:172.21.15.188:3300/0 conn(0x7f2f5013eb20 0x7f2f5006c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:18.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.351+0000 7f2f55123640 1 -- 172.21.15.123:0/45351346 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f50071740 con 0x7f2f5015bcf0 2024-09-15T23:17:18.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.351+0000 7f2f47fff640 1 --2- 172.21.15.123:0/45351346 >> v2:172.21.15.188:3300/0 conn(0x7f2f5013eb20 0x7f2f5006c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:17:18.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.352+0000 7f2f55123640 1 --2- 172.21.15.123:0/45351346 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f5015bcf0 0x7f2f5015c1a0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f2f50073460 tx=0x7f2f4802c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b88b9b6ac8f1444 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:18.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.352+0000 7f2f477fe640 1 -- 172.21.15.123:0/45351346 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f48033400 con 0x7f2f5015bcf0 2024-09-15T23:17:18.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.352+0000 7f2f477fe640 1 -- 172.21.15.123:0/45351346 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f480335a0 con 0x7f2f5015bcf0 2024-09-15T23:17:18.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.352+0000 7f2f477fe640 1 -- 172.21.15.123:0/45351346 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f48033970 con 0x7f2f5015bcf0 2024-09-15T23:17:18.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.353+0000 7f2f56b86640 1 -- 172.21.15.123:0/45351346 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f5015bcf0 msgr2=0x7f2f5015c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:18.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.353+0000 7f2f56b86640 1 --2- 172.21.15.123:0/45351346 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f5015bcf0 0x7f2f5015c1a0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f2f50073460 tx=0x7f2f4802c8b0 comp rx=0 tx=0).stop 2024-09-15T23:17:18.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.353+0000 7f2f56b86640 1 -- 172.21.15.123:0/45351346 shutdown_connections 2024-09-15T23:17:18.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.353+0000 7f2f56b86640 1 --2- 172.21.15.123:0/45351346 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f5015bcf0 0x7f2f5015c1a0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:18.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.353+0000 7f2f56b86640 1 --2- 172.21.15.123:0/45351346 >> v2:172.21.15.188:3300/0 conn(0x7f2f5013eb20 0x7f2f5006c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:18.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.353+0000 7f2f56b86640 1 --2- 172.21.15.123:0/45351346 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f500b2d40 0x7f2f5006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:18.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.353+0000 7f2f56b86640 1 -- 172.21.15.123:0/45351346 >> 172.21.15.123:0/45351346 conn(0x7f2f500ccec0 msgr2=0x7f2f500cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:18.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.353+0000 7f2f56b86640 1 -- 172.21.15.123:0/45351346 shutdown_connections 2024-09-15T23:17:18.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.353+0000 7f2f56b86640 1 -- 172.21.15.123:0/45351346 wait complete. 2024-09-15T23:17:18.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.354+0000 7f2f56b86640 1 Processor -- start 2024-09-15T23:17:18.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.354+0000 7f2f56b86640 1 -- start start 2024-09-15T23:17:18.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.355+0000 7f2f56b86640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f500b2d40 0x7f2f50154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:18.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.355+0000 7f2f56b86640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f5013eb20 0x7f2f500b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:18.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.355+0000 7f2f56b86640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f5015bcf0 0x7f2f500b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:18.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.355+0000 7f2f56b86640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5015f140 con 0x7f2f500b2d40 2024-09-15T23:17:18.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.355+0000 7f2f56b86640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5015efc0 con 0x7f2f5015bcf0 2024-09-15T23:17:18.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.355+0000 7f2f56b86640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f2f5015f2c0 con 0x7f2f5013eb20 2024-09-15T23:17:18.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.355+0000 7f2f54922640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f500b2d40 0x7f2f50154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:18.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.355+0000 7f2f54922640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f500b2d40 0x7f2f50154a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48214/0 (socket says 172.21.15.123:48214) 2024-09-15T23:17:18.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.355+0000 7f2f54922640 1 -- 172.21.15.123:0/3973392809 learned_addr learned my addr 172.21.15.123:0/3973392809 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:18.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.355+0000 7f2f54922640 1 -- 172.21.15.123:0/3973392809 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f5013eb20 msgr2=0x7f2f500b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:18.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.355+0000 7f2f47fff640 1 --2- 172.21.15.123:0/3973392809 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f5013eb20 0x7f2f500b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:18.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.355+0000 7f2f54922640 1 --2- 172.21.15.123:0/3973392809 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f5013eb20 0x7f2f500b5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:18.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.355+0000 7f2f54922640 1 -- 172.21.15.123:0/3973392809 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f5015bcf0 msgr2=0x7f2f500b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:18.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.355+0000 7f2f54922640 1 --2- 172.21.15.123:0/3973392809 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f5015bcf0 0x7f2f500b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:18.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.355+0000 7f2f54922640 1 -- 172.21.15.123:0/3973392809 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f50157040 con 0x7f2f500b2d40 2024-09-15T23:17:18.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.355+0000 7f2f54922640 1 --2- 172.21.15.123:0/3973392809 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f500b2d40 0x7f2f50154a50 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c00e8c0 tx=0x7f2f4c00ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:18.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.355+0000 7f2f457fa640 1 -- 172.21.15.123:0/3973392809 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c017070 con 0x7f2f500b2d40 2024-09-15T23:17:18.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.355+0000 7f2f457fa640 1 -- 172.21.15.123:0/3973392809 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f4c00c940 con 0x7f2f500b2d40 2024-09-15T23:17:18.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.355+0000 7f2f56b86640 1 -- 172.21.15.123:0/3973392809 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f50155fa0 con 0x7f2f500b2d40 2024-09-15T23:17:18.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.355+0000 7f2f457fa640 1 -- 172.21.15.123:0/3973392809 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4c00cd10 con 0x7f2f500b2d40 2024-09-15T23:17:18.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.356+0000 7f2f56b86640 1 -- 172.21.15.123:0/3973392809 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f50156560 con 0x7f2f500b2d40 2024-09-15T23:17:18.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.357+0000 7f2f56b86640 1 -- 172.21.15.123:0/3973392809 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f5015c1a0 con 0x7f2f500b2d40 2024-09-15T23:17:18.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.357+0000 7f2f457fa640 1 -- 172.21.15.123:0/3973392809 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2f4c01a070 con 0x7f2f500b2d40 2024-09-15T23:17:18.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.357+0000 7f2f457fa640 1 --2- 172.21.15.123:0/3973392809 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2f3c06c2b0 0x7f2f3c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:18.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.358+0000 7f2f457fa640 1 -- 172.21.15.123:0/3973392809 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5709+0+0 (secure 0 0 0) 0x7f2f4c08b790 con 0x7f2f500b2d40 2024-09-15T23:17:18.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.358+0000 7f2f47fff640 1 --2- 172.21.15.123:0/3973392809 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2f3c06c2b0 0x7f2f3c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:18.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.358+0000 7f2f47fff640 1 --2- 172.21.15.123:0/3973392809 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2f3c06c2b0 0x7f2f3c06e770 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2f40006fd0 tx=0x7f2f40008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:18.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.362+0000 7f2f457fa640 1 -- 172.21.15.123:0/3973392809 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2f4c059f00 con 0x7f2f500b2d40 2024-09-15T23:17:18.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.524+0000 7f2f56b86640 1 -- 172.21.15.123:0/3973392809 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2f50155d50 con 0x7f2f3c06c2b0 2024-09-15T23:17:18.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.530+0000 7f2f457fa640 1 -- 172.21.15.123:0/3973392809 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250130 (secure 0 0 0) 0x7f2f50155d50 con 0x7f2f3c06c2b0 2024-09-15T23:17:18.534 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:17:18.535 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:17:18.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.533+0000 7f2f56b86640 1 -- 172.21.15.123:0/3973392809 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2f3c06c2b0 msgr2=0x7f2f3c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:18.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.533+0000 7f2f56b86640 1 --2- 172.21.15.123:0/3973392809 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2f3c06c2b0 0x7f2f3c06e770 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2f40006fd0 tx=0x7f2f40008040 comp rx=0 tx=0).stop 2024-09-15T23:17:18.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.533+0000 7f2f56b86640 1 -- 172.21.15.123:0/3973392809 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f500b2d40 msgr2=0x7f2f50154a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:18.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.533+0000 7f2f56b86640 1 --2- 172.21.15.123:0/3973392809 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f500b2d40 0x7f2f50154a50 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c00e8c0 tx=0x7f2f4c00ed80 comp rx=0 tx=0).stop 2024-09-15T23:17:18.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.533+0000 7f2f56b86640 1 -- 172.21.15.123:0/3973392809 shutdown_connections 2024-09-15T23:17:18.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.533+0000 7f2f56b86640 1 --2- 172.21.15.123:0/3973392809 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f5015bcf0 0x7f2f500b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:18.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.533+0000 7f2f56b86640 1 --2- 172.21.15.123:0/3973392809 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f5013eb20 0x7f2f500b5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:18.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.533+0000 7f2f56b86640 1 --2- 172.21.15.123:0/3973392809 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2f3c06c2b0 0x7f2f3c06e770 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:18.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.533+0000 7f2f56b86640 1 --2- 172.21.15.123:0/3973392809 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f500b2d40 0x7f2f50154a50 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:18.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.533+0000 7f2f56b86640 1 -- 172.21.15.123:0/3973392809 >> 172.21.15.123:0/3973392809 conn(0x7f2f500ccec0 msgr2=0x7f2f50140fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:18.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.533+0000 7f2f56b86640 1 -- 172.21.15.123:0/3973392809 shutdown_connections 2024-09-15T23:17:18.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:18.533+0000 7f2f56b86640 1 -- 172.21.15.123:0/3973392809 wait complete. 2024-09-15T23:17:18.545 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":265,"stamp":"2024-09-15T23:17:17.575033+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":186,"num_write_kb":2424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":101,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":303100,"kb_used_data":11956,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754671620,"statfs":{"total":773094113280,"available":772783738880,"internally_reserved":0,"allocated":12242944,"data_stored":6027534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":297913904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.476182"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147783+0000","last_change":"2024-09-15T23:17:14.128999+0000","last_active":"2024-09-15T23:17:16.147783+0000","last_peered":"2024-09-15T23:17:16.147783+0000","last_clean":"2024-09-15T23:17:16.147783+0000","last_became_active":"2024-09-15T23:17:14.128723+0000","last_became_peered":"2024-09-15T23:17:14.128723+0000","last_unstale":"2024-09-15T23:17:16.147783+0000","last_undegraded":"2024-09-15T23:17:16.147783+0000","last_fullsized":"2024-09-15T23:17:16.147783+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:44:08.687064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148110+0000","last_change":"2024-09-15T23:17:14.136518+0000","last_active":"2024-09-15T23:17:16.148110+0000","last_peered":"2024-09-15T23:17:16.148110+0000","last_clean":"2024-09-15T23:17:16.148110+0000","last_became_active":"2024-09-15T23:17:14.136230+0000","last_became_peered":"2024-09-15T23:17:14.136230+0000","last_unstale":"2024-09-15T23:17:16.148110+0000","last_undegraded":"2024-09-15T23:17:16.148110+0000","last_fullsized":"2024-09-15T23:17:16.148110+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:11:42.871940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131971+0000","last_change":"2024-09-15T23:17:14.124836+0000","last_active":"2024-09-15T23:17:15.131971+0000","last_peered":"2024-09-15T23:17:15.131971+0000","last_clean":"2024-09-15T23:17:15.131971+0000","last_became_active":"2024-09-15T23:17:14.124567+0000","last_became_peered":"2024-09-15T23:17:14.124567+0000","last_unstale":"2024-09-15T23:17:15.131971+0000","last_undegraded":"2024-09-15T23:17:15.131971+0000","last_fullsized":"2024-09-15T23:17:15.131971+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:11.615199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147870+0000","last_change":"2024-09-15T23:17:14.133656+0000","last_active":"2024-09-15T23:17:16.147870+0000","last_peered":"2024-09-15T23:17:16.147870+0000","last_clean":"2024-09-15T23:17:16.147870+0000","last_became_active":"2024-09-15T23:17:14.132595+0000","last_became_peered":"2024-09-15T23:17:14.132595+0000","last_unstale":"2024-09-15T23:17:16.147870+0000","last_undegraded":"2024-09-15T23:17:16.147870+0000","last_fullsized":"2024-09-15T23:17:16.147870+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:23.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.104133+0000","last_change":"2024-09-15T23:17:13.104133+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.104133+0000","last_undegraded":"2024-09-15T23:17:13.104133+0000","last_fullsized":"2024-09-15T23:17:13.104133+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.101901+0000","last_change":"2024-09-15T23:17:13.101901+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.101901+0000","last_undegraded":"2024-09-15T23:17:13.101901+0000","last_fullsized":"2024-09-15T23:17:13.101901+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.102308+0000","last_change":"2024-09-15T23:17:13.102308+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.102308+0000","last_undegraded":"2024-09-15T23:17:13.102308+0000","last_fullsized":"2024-09-15T23:17:13.102308+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131508+0000","last_change":"2024-09-15T23:17:14.116714+0000","last_active":"2024-09-15T23:17:15.131508+0000","last_peered":"2024-09-15T23:17:15.131508+0000","last_clean":"2024-09-15T23:17:15.131508+0000","last_became_active":"2024-09-15T23:17:14.116402+0000","last_became_peered":"2024-09-15T23:17:14.116402+0000","last_unstale":"2024-09-15T23:17:15.131508+0000","last_undegraded":"2024-09-15T23:17:15.131508+0000","last_fullsized":"2024-09-15T23:17:15.131508+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:46.780974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.103556+0000","last_change":"2024-09-15T23:17:13.103556+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.103556+0000","last_undegraded":"2024-09-15T23:17:13.103556+0000","last_fullsized":"2024-09-15T23:17:13.103556+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.106231+0000","last_change":"2024-09-15T23:17:13.106231+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.106231+0000","last_undegraded":"2024-09-15T23:17:13.106231+0000","last_fullsized":"2024-09-15T23:17:13.106231+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.106027+0000","last_change":"2024-09-15T23:17:13.106027+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.106027+0000","last_undegraded":"2024-09-15T23:17:13.106027+0000","last_fullsized":"2024-09-15T23:17:13.106027+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.106694+0000","last_change":"2024-09-15T23:17:13.106694+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.106694+0000","last_undegraded":"2024-09-15T23:17:13.106694+0000","last_fullsized":"2024-09-15T23:17:13.106694+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147960+0000","last_change":"2024-09-15T23:17:14.124715+0000","last_active":"2024-09-15T23:17:16.147960+0000","last_peered":"2024-09-15T23:17:16.147960+0000","last_clean":"2024-09-15T23:17:16.147960+0000","last_became_active":"2024-09-15T23:17:14.124463+0000","last_became_peered":"2024-09-15T23:17:14.124463+0000","last_unstale":"2024-09-15T23:17:16.147960+0000","last_undegraded":"2024-09-15T23:17:16.147960+0000","last_fullsized":"2024-09-15T23:17:16.147960+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:05.213822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147468+0000","last_change":"2024-09-15T23:17:14.140450+0000","last_active":"2024-09-15T23:17:16.147468+0000","last_peered":"2024-09-15T23:17:16.147468+0000","last_clean":"2024-09-15T23:17:16.147468+0000","last_became_active":"2024-09-15T23:17:14.139838+0000","last_became_peered":"2024-09-15T23:17:14.139838+0000","last_unstale":"2024-09-15T23:17:16.147468+0000","last_undegraded":"2024-09-15T23:17:16.147468+0000","last_fullsized":"2024-09-15T23:17:16.147468+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:46.018882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148205+0000","last_change":"2024-09-15T23:17:14.133339+0000","last_active":"2024-09-15T23:17:16.148205+0000","last_peered":"2024-09-15T23:17:16.148205+0000","last_clean":"2024-09-15T23:17:16.148205+0000","last_became_active":"2024-09-15T23:17:14.132322+0000","last_became_peered":"2024-09-15T23:17:14.132322+0000","last_unstale":"2024-09-15T23:17:16.148205+0000","last_undegraded":"2024-09-15T23:17:16.148205+0000","last_fullsized":"2024-09-15T23:17:16.148205+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:22.753014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.102341+0000","last_change":"2024-09-15T23:17:13.102341+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.102341+0000","last_undegraded":"2024-09-15T23:17:13.102341+0000","last_fullsized":"2024-09-15T23:17:13.102341+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129435+0000","last_change":"2024-09-15T23:17:14.130776+0000","last_active":"2024-09-15T23:17:15.129435+0000","last_peered":"2024-09-15T23:17:15.129435+0000","last_clean":"2024-09-15T23:17:15.129435+0000","last_became_active":"2024-09-15T23:17:14.130503+0000","last_became_peered":"2024-09-15T23:17:14.130503+0000","last_unstale":"2024-09-15T23:17:15.129435+0000","last_undegraded":"2024-09-15T23:17:15.129435+0000","last_fullsized":"2024-09-15T23:17:15.129435+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:20.514822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148179+0000","last_change":"2024-09-15T23:17:14.135879+0000","last_active":"2024-09-15T23:17:16.148179+0000","last_peered":"2024-09-15T23:17:16.148179+0000","last_clean":"2024-09-15T23:17:16.148179+0000","last_became_active":"2024-09-15T23:17:14.134228+0000","last_became_peered":"2024-09-15T23:17:14.134228+0000","last_unstale":"2024-09-15T23:17:16.148179+0000","last_undegraded":"2024-09-15T23:17:16.148179+0000","last_fullsized":"2024-09-15T23:17:16.148179+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:11.837562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129487+0000","last_change":"2024-09-15T23:17:14.128723+0000","last_active":"2024-09-15T23:17:15.129487+0000","last_peered":"2024-09-15T23:17:15.129487+0000","last_clean":"2024-09-15T23:17:15.129487+0000","last_became_active":"2024-09-15T23:17:14.128230+0000","last_became_peered":"2024-09-15T23:17:14.128230+0000","last_unstale":"2024-09-15T23:17:15.129487+0000","last_undegraded":"2024-09-15T23:17:15.129487+0000","last_fullsized":"2024-09-15T23:17:15.129487+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:58.401688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.106292+0000","last_change":"2024-09-15T23:17:13.106292+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.106292+0000","last_undegraded":"2024-09-15T23:17:13.106292+0000","last_fullsized":"2024-09-15T23:17:13.106292+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131928+0000","last_change":"2024-09-15T23:17:14.122919+0000","last_active":"2024-09-15T23:17:15.131928+0000","last_peered":"2024-09-15T23:17:15.131928+0000","last_clean":"2024-09-15T23:17:15.131928+0000","last_became_active":"2024-09-15T23:17:14.122645+0000","last_became_peered":"2024-09-15T23:17:14.122645+0000","last_unstale":"2024-09-15T23:17:15.131928+0000","last_undegraded":"2024-09-15T23:17:15.131928+0000","last_fullsized":"2024-09-15T23:17:15.131928+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:30:14.079626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131664+0000","last_change":"2024-09-15T23:17:14.131221+0000","last_active":"2024-09-15T23:17:15.131664+0000","last_peered":"2024-09-15T23:17:15.131664+0000","last_clean":"2024-09-15T23:17:15.131664+0000","last_became_active":"2024-09-15T23:17:14.130594+0000","last_became_peered":"2024-09-15T23:17:14.130594+0000","last_unstale":"2024-09-15T23:17:15.131664+0000","last_undegraded":"2024-09-15T23:17:15.131664+0000","last_fullsized":"2024-09-15T23:17:15.131664+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:47:03.357343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147505+0000","last_change":"2024-09-15T23:17:14.140814+0000","last_active":"2024-09-15T23:17:16.147505+0000","last_peered":"2024-09-15T23:17:16.147505+0000","last_clean":"2024-09-15T23:17:16.147505+0000","last_became_active":"2024-09-15T23:17:14.140517+0000","last_became_peered":"2024-09-15T23:17:14.140517+0000","last_unstale":"2024-09-15T23:17:16.147505+0000","last_undegraded":"2024-09-15T23:17:16.147505+0000","last_fullsized":"2024-09-15T23:17:16.147505+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:48.303033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.106750+0000","last_change":"2024-09-15T23:17:13.106750+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.106750+0000","last_undegraded":"2024-09-15T23:17:13.106750+0000","last_fullsized":"2024-09-15T23:17:13.106750+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.106036+0000","last_change":"2024-09-15T23:17:13.106036+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.106036+0000","last_undegraded":"2024-09-15T23:17:13.106036+0000","last_fullsized":"2024-09-15T23:17:13.106036+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148056+0000","last_change":"2024-09-15T23:17:14.126059+0000","last_active":"2024-09-15T23:17:16.148056+0000","last_peered":"2024-09-15T23:17:16.148056+0000","last_clean":"2024-09-15T23:17:16.148056+0000","last_became_active":"2024-09-15T23:17:14.125760+0000","last_became_peered":"2024-09-15T23:17:14.125760+0000","last_unstale":"2024-09-15T23:17:16.148056+0000","last_undegraded":"2024-09-15T23:17:16.148056+0000","last_fullsized":"2024-09-15T23:17:16.148056+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:20.023859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.108049+0000","last_change":"2024-09-15T23:17:13.108049+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.108049+0000","last_undegraded":"2024-09-15T23:17:13.108049+0000","last_fullsized":"2024-09-15T23:17:13.108049+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.107769+0000","last_change":"2024-09-15T23:17:13.107769+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.107769+0000","last_undegraded":"2024-09-15T23:17:13.107769+0000","last_fullsized":"2024-09-15T23:17:13.107769+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148125+0000","last_change":"2024-09-15T23:17:14.119496+0000","last_active":"2024-09-15T23:17:16.148125+0000","last_peered":"2024-09-15T23:17:16.148125+0000","last_clean":"2024-09-15T23:17:16.148125+0000","last_became_active":"2024-09-15T23:17:14.119238+0000","last_became_peered":"2024-09-15T23:17:14.119238+0000","last_unstale":"2024-09-15T23:17:16.148125+0000","last_undegraded":"2024-09-15T23:17:16.148125+0000","last_fullsized":"2024-09-15T23:17:16.148125+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:58.881990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148335+0000","last_change":"2024-09-15T23:17:14.130119+0000","last_active":"2024-09-15T23:17:16.148335+0000","last_peered":"2024-09-15T23:17:16.148335+0000","last_clean":"2024-09-15T23:17:16.148335+0000","last_became_active":"2024-09-15T23:17:14.129832+0000","last_became_peered":"2024-09-15T23:17:14.129832+0000","last_unstale":"2024-09-15T23:17:16.148335+0000","last_undegraded":"2024-09-15T23:17:16.148335+0000","last_fullsized":"2024-09-15T23:17:16.148335+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:53.603091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131665+0000","last_change":"2024-09-15T23:17:14.120902+0000","last_active":"2024-09-15T23:17:15.131665+0000","last_peered":"2024-09-15T23:17:15.131665+0000","last_clean":"2024-09-15T23:17:15.131665+0000","last_became_active":"2024-09-15T23:17:14.120629+0000","last_became_peered":"2024-09-15T23:17:14.120629+0000","last_unstale":"2024-09-15T23:17:15.131665+0000","last_undegraded":"2024-09-15T23:17:15.131665+0000","last_fullsized":"2024-09-15T23:17:15.131665+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:25:18.338252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147988+0000","last_change":"2024-09-15T23:17:14.134985+0000","last_active":"2024-09-15T23:17:16.147988+0000","last_peered":"2024-09-15T23:17:16.147988+0000","last_clean":"2024-09-15T23:17:16.147988+0000","last_became_active":"2024-09-15T23:17:14.134639+0000","last_became_peered":"2024-09-15T23:17:14.134639+0000","last_unstale":"2024-09-15T23:17:16.147988+0000","last_undegraded":"2024-09-15T23:17:16.147988+0000","last_fullsized":"2024-09-15T23:17:16.147988+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:42.147757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129323+0000","last_change":"2024-09-15T23:17:14.127011+0000","last_active":"2024-09-15T23:17:15.129323+0000","last_peered":"2024-09-15T23:17:15.129323+0000","last_clean":"2024-09-15T23:17:15.129323+0000","last_became_active":"2024-09-15T23:17:14.126694+0000","last_became_peered":"2024-09-15T23:17:14.126694+0000","last_unstale":"2024-09-15T23:17:15.129323+0000","last_undegraded":"2024-09-15T23:17:15.129323+0000","last_fullsized":"2024-09-15T23:17:15.129323+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:02:57.119296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"113'4","reported_seq":18,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147990+0000","last_change":"2024-09-15T23:17:13.116670+0000","last_active":"2024-09-15T23:17:16.147990+0000","last_peered":"2024-09-15T23:17:16.147990+0000","last_clean":"2024-09-15T23:17:16.147990+0000","last_became_active":"2024-09-15T23:17:13.116343+0000","last_became_peered":"2024-09-15T23:17:13.116343+0000","last_unstale":"2024-09-15T23:17:16.147990+0000","last_undegraded":"2024-09-15T23:17:16.147990+0000","last_fullsized":"2024-09-15T23:17:16.147990+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:25.965813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147869+0000","last_change":"2024-09-15T23:17:14.118601+0000","last_active":"2024-09-15T23:17:16.147869+0000","last_peered":"2024-09-15T23:17:16.147869+0000","last_clean":"2024-09-15T23:17:16.147869+0000","last_became_active":"2024-09-15T23:17:14.118303+0000","last_became_peered":"2024-09-15T23:17:14.118303+0000","last_unstale":"2024-09-15T23:17:16.147869+0000","last_undegraded":"2024-09-15T23:17:16.147869+0000","last_fullsized":"2024-09-15T23:17:16.147869+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:58:46.481909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.119121+0000","last_change":"2024-09-15T23:17:13.115752+0000","last_active":"2024-09-15T23:17:13.119121+0000","last_peered":"2024-09-15T23:17:13.119121+0000","last_clean":"2024-09-15T23:17:13.119121+0000","last_became_active":"2024-09-15T23:17:13.114959+0000","last_became_peered":"2024-09-15T23:17:13.114959+0000","last_unstale":"2024-09-15T23:17:13.119121+0000","last_undegraded":"2024-09-15T23:17:13.119121+0000","last_fullsized":"2024-09-15T23:17:13.119121+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:52:26.259605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147985+0000","last_change":"2024-09-15T23:17:14.132832+0000","last_active":"2024-09-15T23:17:16.147985+0000","last_peered":"2024-09-15T23:17:16.147985+0000","last_clean":"2024-09-15T23:17:16.147985+0000","last_became_active":"2024-09-15T23:17:14.132210+0000","last_became_peered":"2024-09-15T23:17:14.132210+0000","last_unstale":"2024-09-15T23:17:16.147985+0000","last_undegraded":"2024-09-15T23:17:16.147985+0000","last_fullsized":"2024-09-15T23:17:16.147985+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:45:02.819477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131964+0000","last_change":"2024-09-15T23:17:13.116873+0000","last_active":"2024-09-15T23:17:15.131964+0000","last_peered":"2024-09-15T23:17:15.131964+0000","last_clean":"2024-09-15T23:17:15.131964+0000","last_became_active":"2024-09-15T23:17:13.116544+0000","last_became_peered":"2024-09-15T23:17:13.116544+0000","last_unstale":"2024-09-15T23:17:15.131964+0000","last_undegraded":"2024-09-15T23:17:15.131964+0000","last_fullsized":"2024-09-15T23:17:15.131964+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:10:32.250679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.105624+0000","last_change":"2024-09-15T23:17:13.105624+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.105624+0000","last_undegraded":"2024-09-15T23:17:13.105624+0000","last_fullsized":"2024-09-15T23:17:13.105624+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148027+0000","last_change":"2024-09-15T23:17:13.118603+0000","last_active":"2024-09-15T23:17:16.148027+0000","last_peered":"2024-09-15T23:17:16.148027+0000","last_clean":"2024-09-15T23:17:16.148027+0000","last_became_active":"2024-09-15T23:17:13.118338+0000","last_became_peered":"2024-09-15T23:17:13.118338+0000","last_unstale":"2024-09-15T23:17:16.148027+0000","last_undegraded":"2024-09-15T23:17:16.148027+0000","last_fullsized":"2024-09-15T23:17:16.148027+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:13:54.700643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.105392+0000","last_change":"2024-09-15T23:17:13.105392+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.105392+0000","last_undegraded":"2024-09-15T23:17:13.105392+0000","last_fullsized":"2024-09-15T23:17:13.105392+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"113'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147965+0000","last_change":"2024-09-15T23:17:13.117008+0000","last_active":"2024-09-15T23:17:16.147965+0000","last_peered":"2024-09-15T23:17:16.147965+0000","last_clean":"2024-09-15T23:17:16.147965+0000","last_became_active":"2024-09-15T23:17:13.116742+0000","last_became_peered":"2024-09-15T23:17:13.116742+0000","last_unstale":"2024-09-15T23:17:16.147965+0000","last_undegraded":"2024-09-15T23:17:16.147965+0000","last_fullsized":"2024-09-15T23:17:16.147965+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:05:45.151293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.103763+0000","last_change":"2024-09-15T23:17:13.103763+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.103763+0000","last_undegraded":"2024-09-15T23:17:13.103763+0000","last_fullsized":"2024-09-15T23:17:13.103763+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"113'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131677+0000","last_change":"2024-09-15T23:17:13.117608+0000","last_active":"2024-09-15T23:17:15.131677+0000","last_peered":"2024-09-15T23:17:15.131677+0000","last_clean":"2024-09-15T23:17:15.131677+0000","last_became_active":"2024-09-15T23:17:13.117303+0000","last_became_peered":"2024-09-15T23:17:13.117303+0000","last_unstale":"2024-09-15T23:17:15.131677+0000","last_undegraded":"2024-09-15T23:17:15.131677+0000","last_fullsized":"2024-09-15T23:17:15.131677+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:36:12.510949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147498+0000","last_change":"2024-09-15T23:17:14.118298+0000","last_active":"2024-09-15T23:17:16.147498+0000","last_peered":"2024-09-15T23:17:16.147498+0000","last_clean":"2024-09-15T23:17:16.147498+0000","last_became_active":"2024-09-15T23:17:14.118015+0000","last_became_peered":"2024-09-15T23:17:14.118015+0000","last_unstale":"2024-09-15T23:17:16.147498+0000","last_undegraded":"2024-09-15T23:17:16.147498+0000","last_fullsized":"2024-09-15T23:17:16.147498+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:55:50.936536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.111495+0000","last_change":"2024-09-15T23:17:13.105562+0000","last_active":"2024-09-15T23:17:13.111495+0000","last_peered":"2024-09-15T23:17:13.111495+0000","last_clean":"2024-09-15T23:17:13.111495+0000","last_became_active":"2024-09-15T23:17:13.105267+0000","last_became_peered":"2024-09-15T23:17:13.105267+0000","last_unstale":"2024-09-15T23:17:13.111495+0000","last_undegraded":"2024-09-15T23:17:13.111495+0000","last_fullsized":"2024-09-15T23:17:13.111495+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:20:15.465328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.105367+0000","last_change":"2024-09-15T23:17:13.105367+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.105367+0000","last_undegraded":"2024-09-15T23:17:13.105367+0000","last_fullsized":"2024-09-15T23:17:13.105367+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129422+0000","last_change":"2024-09-15T23:17:13.120992+0000","last_active":"2024-09-15T23:17:15.129422+0000","last_peered":"2024-09-15T23:17:15.129422+0000","last_clean":"2024-09-15T23:17:15.129422+0000","last_became_active":"2024-09-15T23:17:13.120668+0000","last_became_peered":"2024-09-15T23:17:13.120668+0000","last_unstale":"2024-09-15T23:17:15.129422+0000","last_undegraded":"2024-09-15T23:17:15.129422+0000","last_fullsized":"2024-09-15T23:17:15.129422+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:01:28.019600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148315+0000","last_change":"2024-09-15T23:17:14.129965+0000","last_active":"2024-09-15T23:17:16.148315+0000","last_peered":"2024-09-15T23:17:16.148315+0000","last_clean":"2024-09-15T23:17:16.148315+0000","last_became_active":"2024-09-15T23:17:14.129527+0000","last_became_peered":"2024-09-15T23:17:14.129527+0000","last_unstale":"2024-09-15T23:17:16.148315+0000","last_undegraded":"2024-09-15T23:17:16.148315+0000","last_fullsized":"2024-09-15T23:17:16.148315+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:23.523717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.132127+0000","last_change":"2024-09-15T23:17:13.117392+0000","last_active":"2024-09-15T23:17:15.132127+0000","last_peered":"2024-09-15T23:17:15.132127+0000","last_clean":"2024-09-15T23:17:15.132127+0000","last_became_active":"2024-09-15T23:17:13.117084+0000","last_became_peered":"2024-09-15T23:17:13.117084+0000","last_unstale":"2024-09-15T23:17:15.132127+0000","last_undegraded":"2024-09-15T23:17:15.132127+0000","last_fullsized":"2024-09-15T23:17:15.132127+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:02.927244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.108131+0000","last_change":"2024-09-15T23:17:13.108131+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.108131+0000","last_undegraded":"2024-09-15T23:17:13.108131+0000","last_fullsized":"2024-09-15T23:17:13.108131+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148287+0000","last_change":"2024-09-15T23:17:13.119920+0000","last_active":"2024-09-15T23:17:16.148287+0000","last_peered":"2024-09-15T23:17:16.148287+0000","last_clean":"2024-09-15T23:17:16.148287+0000","last_became_active":"2024-09-15T23:17:13.119565+0000","last_became_peered":"2024-09-15T23:17:13.119565+0000","last_unstale":"2024-09-15T23:17:16.148287+0000","last_undegraded":"2024-09-15T23:17:16.148287+0000","last_fullsized":"2024-09-15T23:17:16.148287+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:18:26.179680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.101926+0000","last_change":"2024-09-15T23:17:13.101926+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.101926+0000","last_undegraded":"2024-09-15T23:17:13.101926+0000","last_fullsized":"2024-09-15T23:17:13.101926+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.111145+0000","last_change":"2024-09-15T23:17:13.107378+0000","last_active":"2024-09-15T23:17:13.111145+0000","last_peered":"2024-09-15T23:17:13.111145+0000","last_clean":"2024-09-15T23:17:13.111145+0000","last_became_active":"2024-09-15T23:17:13.107092+0000","last_became_peered":"2024-09-15T23:17:13.107092+0000","last_unstale":"2024-09-15T23:17:13.111145+0000","last_undegraded":"2024-09-15T23:17:13.111145+0000","last_fullsized":"2024-09-15T23:17:13.111145+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:49.003531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.108493+0000","last_change":"2024-09-15T23:17:13.108493+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.108493+0000","last_undegraded":"2024-09-15T23:17:13.108493+0000","last_fullsized":"2024-09-15T23:17:13.108493+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.118962+0000","last_change":"2024-09-15T23:17:13.115247+0000","last_active":"2024-09-15T23:17:13.118962+0000","last_peered":"2024-09-15T23:17:13.118962+0000","last_clean":"2024-09-15T23:17:13.118962+0000","last_became_active":"2024-09-15T23:17:13.114968+0000","last_became_peered":"2024-09-15T23:17:13.114968+0000","last_unstale":"2024-09-15T23:17:13.118962+0000","last_undegraded":"2024-09-15T23:17:13.118962+0000","last_fullsized":"2024-09-15T23:17:13.118962+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:30:12.355202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148217+0000","last_change":"2024-09-15T23:17:14.128333+0000","last_active":"2024-09-15T23:17:16.148217+0000","last_peered":"2024-09-15T23:17:16.148217+0000","last_clean":"2024-09-15T23:17:16.148217+0000","last_became_active":"2024-09-15T23:17:14.128067+0000","last_became_peered":"2024-09-15T23:17:14.128067+0000","last_unstale":"2024-09-15T23:17:16.148217+0000","last_undegraded":"2024-09-15T23:17:16.148217+0000","last_fullsized":"2024-09-15T23:17:16.148217+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:14.453192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129207+0000","last_change":"2024-09-15T23:17:13.117368+0000","last_active":"2024-09-15T23:17:15.129207+0000","last_peered":"2024-09-15T23:17:15.129207+0000","last_clean":"2024-09-15T23:17:15.129207+0000","last_became_active":"2024-09-15T23:17:13.117082+0000","last_became_peered":"2024-09-15T23:17:13.117082+0000","last_unstale":"2024-09-15T23:17:15.129207+0000","last_undegraded":"2024-09-15T23:17:15.129207+0000","last_fullsized":"2024-09-15T23:17:15.129207+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:44.068584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131891+0000","last_change":"2024-09-15T23:17:14.131213+0000","last_active":"2024-09-15T23:17:15.131891+0000","last_peered":"2024-09-15T23:17:15.131891+0000","last_clean":"2024-09-15T23:17:15.131891+0000","last_became_active":"2024-09-15T23:17:14.127591+0000","last_became_peered":"2024-09-15T23:17:14.127591+0000","last_unstale":"2024-09-15T23:17:15.131891+0000","last_undegraded":"2024-09-15T23:17:15.131891+0000","last_fullsized":"2024-09-15T23:17:15.131891+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:01:29.023692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147713+0000","last_change":"2024-09-15T23:17:13.116393+0000","last_active":"2024-09-15T23:17:16.147713+0000","last_peered":"2024-09-15T23:17:16.147713+0000","last_clean":"2024-09-15T23:17:16.147713+0000","last_became_active":"2024-09-15T23:17:13.116112+0000","last_became_peered":"2024-09-15T23:17:13.116112+0000","last_unstale":"2024-09-15T23:17:16.147713+0000","last_undegraded":"2024-09-15T23:17:16.147713+0000","last_fullsized":"2024-09-15T23:17:16.147713+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:12.306832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.101884+0000","last_change":"2024-09-15T23:17:13.101884+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.101884+0000","last_undegraded":"2024-09-15T23:17:13.101884+0000","last_fullsized":"2024-09-15T23:17:13.101884+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.113359+0000","last_change":"2024-09-15T23:17:13.108829+0000","last_active":"2024-09-15T23:17:13.113359+0000","last_peered":"2024-09-15T23:17:13.113359+0000","last_clean":"2024-09-15T23:17:13.113359+0000","last_became_active":"2024-09-15T23:17:13.108553+0000","last_became_peered":"2024-09-15T23:17:13.108553+0000","last_unstale":"2024-09-15T23:17:13.113359+0000","last_undegraded":"2024-09-15T23:17:13.113359+0000","last_fullsized":"2024-09-15T23:17:13.113359+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:25.965813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131655+0000","last_change":"2024-09-15T23:17:14.120108+0000","last_active":"2024-09-15T23:17:15.131655+0000","last_peered":"2024-09-15T23:17:15.131655+0000","last_clean":"2024-09-15T23:17:15.131655+0000","last_became_active":"2024-09-15T23:17:14.119851+0000","last_became_peered":"2024-09-15T23:17:14.119851+0000","last_unstale":"2024-09-15T23:17:15.131655+0000","last_undegraded":"2024-09-15T23:17:15.131655+0000","last_fullsized":"2024-09-15T23:17:15.131655+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:45.072675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.10","version":"113'8","reported_seq":22,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148262+0000","last_change":"2024-09-15T23:17:13.118354+0000","last_active":"2024-09-15T23:17:16.148262+0000","last_peered":"2024-09-15T23:17:16.148262+0000","last_clean":"2024-09-15T23:17:16.148262+0000","last_became_active":"2024-09-15T23:17:13.117785+0000","last_became_peered":"2024-09-15T23:17:13.117785+0000","last_unstale":"2024-09-15T23:17:16.148262+0000","last_undegraded":"2024-09-15T23:17:16.148262+0000","last_fullsized":"2024-09-15T23:17:16.148262+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:07:03.677453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.107693+0000","last_change":"2024-09-15T23:17:13.107693+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.107693+0000","last_undegraded":"2024-09-15T23:17:13.107693+0000","last_fullsized":"2024-09-15T23:17:13.107693+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.119007+0000","last_change":"2024-09-15T23:17:13.115236+0000","last_active":"2024-09-15T23:17:13.119007+0000","last_peered":"2024-09-15T23:17:13.119007+0000","last_clean":"2024-09-15T23:17:13.119007+0000","last_became_active":"2024-09-15T23:17:13.114937+0000","last_became_peered":"2024-09-15T23:17:13.114937+0000","last_unstale":"2024-09-15T23:17:13.119007+0000","last_undegraded":"2024-09-15T23:17:13.119007+0000","last_fullsized":"2024-09-15T23:17:13.119007+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:48.038067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.106914+0000","last_change":"2024-09-15T23:17:13.106914+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.106914+0000","last_undegraded":"2024-09-15T23:17:13.106914+0000","last_fullsized":"2024-09-15T23:17:13.106914+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.119081+0000","last_change":"2024-09-15T23:17:13.113950+0000","last_active":"2024-09-15T23:17:13.119081+0000","last_peered":"2024-09-15T23:17:13.119081+0000","last_clean":"2024-09-15T23:17:13.119081+0000","last_became_active":"2024-09-15T23:17:13.113680+0000","last_became_peered":"2024-09-15T23:17:13.113680+0000","last_unstale":"2024-09-15T23:17:13.119081+0000","last_undegraded":"2024-09-15T23:17:13.119081+0000","last_fullsized":"2024-09-15T23:17:13.119081+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:10:21.358088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.104924+0000","last_change":"2024-09-15T23:17:13.104924+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.104924+0000","last_undegraded":"2024-09-15T23:17:13.104924+0000","last_fullsized":"2024-09-15T23:17:13.104924+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129522+0000","last_change":"2024-09-15T23:17:13.120403+0000","last_active":"2024-09-15T23:17:15.129522+0000","last_peered":"2024-09-15T23:17:15.129522+0000","last_clean":"2024-09-15T23:17:15.129522+0000","last_became_active":"2024-09-15T23:17:13.120082+0000","last_became_peered":"2024-09-15T23:17:13.120082+0000","last_unstale":"2024-09-15T23:17:15.129522+0000","last_undegraded":"2024-09-15T23:17:15.129522+0000","last_fullsized":"2024-09-15T23:17:15.129522+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:25:17.334161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129570+0000","last_change":"2024-09-15T23:17:14.137236+0000","last_active":"2024-09-15T23:17:15.129570+0000","last_peered":"2024-09-15T23:17:15.129570+0000","last_clean":"2024-09-15T23:17:15.129570+0000","last_became_active":"2024-09-15T23:17:14.135291+0000","last_became_peered":"2024-09-15T23:17:14.135291+0000","last_unstale":"2024-09-15T23:17:15.129570+0000","last_undegraded":"2024-09-15T23:17:15.129570+0000","last_fullsized":"2024-09-15T23:17:15.129570+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:21:57.537259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148104+0000","last_change":"2024-09-15T23:17:13.118920+0000","last_active":"2024-09-15T23:17:16.148104+0000","last_peered":"2024-09-15T23:17:16.148104+0000","last_clean":"2024-09-15T23:17:16.148104+0000","last_became_active":"2024-09-15T23:17:13.118368+0000","last_became_peered":"2024-09-15T23:17:13.118368+0000","last_unstale":"2024-09-15T23:17:16.148104+0000","last_undegraded":"2024-09-15T23:17:16.148104+0000","last_fullsized":"2024-09-15T23:17:16.148104+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:34.758267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129327+0000","last_change":"2024-09-15T23:17:14.135869+0000","last_active":"2024-09-15T23:17:15.129327+0000","last_peered":"2024-09-15T23:17:15.129327+0000","last_clean":"2024-09-15T23:17:15.129327+0000","last_became_active":"2024-09-15T23:17:14.135547+0000","last_became_peered":"2024-09-15T23:17:14.135547+0000","last_unstale":"2024-09-15T23:17:15.129327+0000","last_undegraded":"2024-09-15T23:17:15.129327+0000","last_fullsized":"2024-09-15T23:17:15.129327+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:38.244015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.121726+0000","last_change":"2024-09-15T23:17:13.115998+0000","last_active":"2024-09-15T23:17:13.121726+0000","last_peered":"2024-09-15T23:17:13.121726+0000","last_clean":"2024-09-15T23:17:13.121726+0000","last_became_active":"2024-09-15T23:17:13.115703+0000","last_became_peered":"2024-09-15T23:17:13.115703+0000","last_unstale":"2024-09-15T23:17:13.121726+0000","last_undegraded":"2024-09-15T23:17:13.121726+0000","last_fullsized":"2024-09-15T23:17:13.121726+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:06:48.045653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148639+0000","last_change":"2024-09-15T23:17:14.140352+0000","last_active":"2024-09-15T23:17:16.148639+0000","last_peered":"2024-09-15T23:17:16.148639+0000","last_clean":"2024-09-15T23:17:16.148639+0000","last_became_active":"2024-09-15T23:17:14.140068+0000","last_became_peered":"2024-09-15T23:17:14.140068+0000","last_unstale":"2024-09-15T23:17:16.148639+0000","last_undegraded":"2024-09-15T23:17:16.148639+0000","last_fullsized":"2024-09-15T23:17:16.148639+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:21.120785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.121676+0000","last_change":"2024-09-15T23:17:13.115923+0000","last_active":"2024-09-15T23:17:13.121676+0000","last_peered":"2024-09-15T23:17:13.121676+0000","last_clean":"2024-09-15T23:17:13.121676+0000","last_became_active":"2024-09-15T23:17:13.115642+0000","last_became_peered":"2024-09-15T23:17:13.115642+0000","last_unstale":"2024-09-15T23:17:13.121676+0000","last_undegraded":"2024-09-15T23:17:13.121676+0000","last_fullsized":"2024-09-15T23:17:13.121676+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:39.622535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.105629+0000","last_change":"2024-09-15T23:17:13.105629+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.105629+0000","last_undegraded":"2024-09-15T23:17:13.105629+0000","last_fullsized":"2024-09-15T23:17:13.105629+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131511+0000","last_change":"2024-09-15T23:17:13.116590+0000","last_active":"2024-09-15T23:17:15.131511+0000","last_peered":"2024-09-15T23:17:15.131511+0000","last_clean":"2024-09-15T23:17:15.131511+0000","last_became_active":"2024-09-15T23:17:13.116231+0000","last_became_peered":"2024-09-15T23:17:13.116231+0000","last_unstale":"2024-09-15T23:17:15.131511+0000","last_undegraded":"2024-09-15T23:17:15.131511+0000","last_fullsized":"2024-09-15T23:17:15.131511+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:55.924454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129501+0000","last_change":"2024-09-15T23:17:14.129416+0000","last_active":"2024-09-15T23:17:15.129501+0000","last_peered":"2024-09-15T23:17:15.129501+0000","last_clean":"2024-09-15T23:17:15.129501+0000","last_became_active":"2024-09-15T23:17:14.127497+0000","last_became_peered":"2024-09-15T23:17:14.127497+0000","last_unstale":"2024-09-15T23:17:15.129501+0000","last_undegraded":"2024-09-15T23:17:15.129501+0000","last_fullsized":"2024-09-15T23:17:15.129501+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:38.026467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.116106+0000","last_change":"2024-09-15T23:17:13.111438+0000","last_active":"2024-09-15T23:17:13.116106+0000","last_peered":"2024-09-15T23:17:13.116106+0000","last_clean":"2024-09-15T23:17:13.116106+0000","last_became_active":"2024-09-15T23:17:13.111139+0000","last_became_peered":"2024-09-15T23:17:13.111139+0000","last_unstale":"2024-09-15T23:17:13.116106+0000","last_undegraded":"2024-09-15T23:17:13.116106+0000","last_fullsized":"2024-09-15T23:17:13.116106+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:05.175799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129514+0000","last_change":"2024-09-15T23:17:14.128647+0000","last_active":"2024-09-15T23:17:15.129514+0000","last_peered":"2024-09-15T23:17:15.129514+0000","last_clean":"2024-09-15T23:17:15.129514+0000","last_became_active":"2024-09-15T23:17:14.128369+0000","last_became_peered":"2024-09-15T23:17:14.128369+0000","last_unstale":"2024-09-15T23:17:15.129514+0000","last_undegraded":"2024-09-15T23:17:15.129514+0000","last_fullsized":"2024-09-15T23:17:15.129514+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:08.741132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"114'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131035+0000","last_change":"2024-09-15T23:17:13.118913+0000","last_active":"2024-09-15T23:17:15.131035+0000","last_peered":"2024-09-15T23:17:15.131035+0000","last_clean":"2024-09-15T23:17:15.131035+0000","last_became_active":"2024-09-15T23:17:13.115889+0000","last_became_peered":"2024-09-15T23:17:13.115889+0000","last_unstale":"2024-09-15T23:17:15.131035+0000","last_undegraded":"2024-09-15T23:17:15.131035+0000","last_fullsized":"2024-09-15T23:17:15.131035+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:45.776883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.132003+0000","last_change":"2024-09-15T23:17:14.125081+0000","last_active":"2024-09-15T23:17:15.132003+0000","last_peered":"2024-09-15T23:17:15.132003+0000","last_clean":"2024-09-15T23:17:15.132003+0000","last_became_active":"2024-09-15T23:17:14.124730+0000","last_became_peered":"2024-09-15T23:17:14.124730+0000","last_unstale":"2024-09-15T23:17:15.132003+0000","last_undegraded":"2024-09-15T23:17:15.132003+0000","last_fullsized":"2024-09-15T23:17:15.132003+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:56.765821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129345+0000","last_change":"2024-09-15T23:17:13.114547+0000","last_active":"2024-09-15T23:17:15.129345+0000","last_peered":"2024-09-15T23:17:15.129345+0000","last_clean":"2024-09-15T23:17:15.129345+0000","last_became_active":"2024-09-15T23:17:13.114261+0000","last_became_peered":"2024-09-15T23:17:13.114261+0000","last_unstale":"2024-09-15T23:17:15.129345+0000","last_undegraded":"2024-09-15T23:17:15.129345+0000","last_fullsized":"2024-09-15T23:17:15.129345+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:47:02.353252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.103127+0000","last_change":"2024-09-15T23:17:13.103127+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.103127+0000","last_undegraded":"2024-09-15T23:17:13.103127+0000","last_fullsized":"2024-09-15T23:17:13.103127+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.118923+0000","last_change":"2024-09-15T23:17:13.113961+0000","last_active":"2024-09-15T23:17:13.118923+0000","last_peered":"2024-09-15T23:17:13.118923+0000","last_clean":"2024-09-15T23:17:13.118923+0000","last_became_active":"2024-09-15T23:17:13.113690+0000","last_became_peered":"2024-09-15T23:17:13.113690+0000","last_unstale":"2024-09-15T23:17:13.118923+0000","last_undegraded":"2024-09-15T23:17:13.118923+0000","last_fullsized":"2024-09-15T23:17:13.118923+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:39.622535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129217+0000","last_change":"2024-09-15T23:17:14.128314+0000","last_active":"2024-09-15T23:17:15.129217+0000","last_peered":"2024-09-15T23:17:15.129217+0000","last_clean":"2024-09-15T23:17:15.129217+0000","last_became_active":"2024-09-15T23:17:14.128027+0000","last_became_peered":"2024-09-15T23:17:14.128027+0000","last_unstale":"2024-09-15T23:17:15.129217+0000","last_undegraded":"2024-09-15T23:17:15.129217+0000","last_fullsized":"2024-09-15T23:17:15.129217+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:48:19.614946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131975+0000","last_change":"2024-09-15T23:17:13.116982+0000","last_active":"2024-09-15T23:17:15.131975+0000","last_peered":"2024-09-15T23:17:15.131975+0000","last_clean":"2024-09-15T23:17:15.131975+0000","last_became_active":"2024-09-15T23:17:13.116634+0000","last_became_peered":"2024-09-15T23:17:13.116634+0000","last_unstale":"2024-09-15T23:17:15.131975+0000","last_undegraded":"2024-09-15T23:17:15.131975+0000","last_fullsized":"2024-09-15T23:17:15.131975+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:29.604651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.103335+0000","last_change":"2024-09-15T23:17:13.103335+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.103335+0000","last_undegraded":"2024-09-15T23:17:13.103335+0000","last_fullsized":"2024-09-15T23:17:13.103335+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.118956+0000","last_change":"2024-09-15T23:17:13.114546+0000","last_active":"2024-09-15T23:17:13.118956+0000","last_peered":"2024-09-15T23:17:13.118956+0000","last_clean":"2024-09-15T23:17:13.118956+0000","last_became_active":"2024-09-15T23:17:13.114310+0000","last_became_peered":"2024-09-15T23:17:13.114310+0000","last_unstale":"2024-09-15T23:17:13.118956+0000","last_undegraded":"2024-09-15T23:17:13.118956+0000","last_fullsized":"2024-09-15T23:17:13.118956+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:42:38.571629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129213+0000","last_change":"2024-09-15T23:17:14.130298+0000","last_active":"2024-09-15T23:17:15.129213+0000","last_peered":"2024-09-15T23:17:15.129213+0000","last_clean":"2024-09-15T23:17:15.129213+0000","last_became_active":"2024-09-15T23:17:14.130022+0000","last_became_peered":"2024-09-15T23:17:14.130022+0000","last_unstale":"2024-09-15T23:17:15.129213+0000","last_undegraded":"2024-09-15T23:17:15.129213+0000","last_fullsized":"2024-09-15T23:17:15.129213+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:54.412546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147562+0000","last_change":"2024-09-15T23:17:13.115530+0000","last_active":"2024-09-15T23:17:16.147562+0000","last_peered":"2024-09-15T23:17:16.147562+0000","last_clean":"2024-09-15T23:17:16.147562+0000","last_became_active":"2024-09-15T23:17:13.115259+0000","last_became_peered":"2024-09-15T23:17:13.115259+0000","last_unstale":"2024-09-15T23:17:16.147562+0000","last_undegraded":"2024-09-15T23:17:16.147562+0000","last_fullsized":"2024-09-15T23:17:16.147562+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:05.175799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":112,"state":"creating+peering","last_fresh":"2024-09-15T23:17:13.104922+0000","last_change":"2024-09-15T23:17:13.104922+0000","last_active":"2024-09-15T23:17:13.097077+0000","last_peered":"2024-09-15T23:17:13.097077+0000","last_clean":"2024-09-15T23:17:13.097077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:17:13.104922+0000","last_undegraded":"2024-09-15T23:17:13.104922+0000","last_fullsized":"2024-09-15T23:17:13.104922+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131643+0000","last_change":"2024-09-15T23:17:13.115842+0000","last_active":"2024-09-15T23:17:15.131643+0000","last_peered":"2024-09-15T23:17:15.131643+0000","last_clean":"2024-09-15T23:17:15.131643+0000","last_became_active":"2024-09-15T23:17:13.115274+0000","last_became_peered":"2024-09-15T23:17:13.115274+0000","last_unstale":"2024-09-15T23:17:15.131643+0000","last_undegraded":"2024-09-15T23:17:15.131643+0000","last_fullsized":"2024-09-15T23:17:15.131643+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:12.992861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.132167+0000","last_change":"2024-09-15T23:17:14.128611+0000","last_active":"2024-09-15T23:17:15.132167+0000","last_peered":"2024-09-15T23:17:15.132167+0000","last_clean":"2024-09-15T23:17:15.132167+0000","last_became_active":"2024-09-15T23:17:14.128331+0000","last_became_peered":"2024-09-15T23:17:14.128331+0000","last_unstale":"2024-09-15T23:17:15.132167+0000","last_undegraded":"2024-09-15T23:17:15.132167+0000","last_fullsized":"2024-09-15T23:17:15.132167+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:58:17.851554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.118953+0000","last_change":"2024-09-15T23:17:13.115287+0000","last_active":"2024-09-15T23:17:13.118953+0000","last_peered":"2024-09-15T23:17:13.118953+0000","last_clean":"2024-09-15T23:17:13.118953+0000","last_became_active":"2024-09-15T23:17:13.114980+0000","last_became_peered":"2024-09-15T23:17:13.114980+0000","last_unstale":"2024-09-15T23:17:13.118953+0000","last_undegraded":"2024-09-15T23:17:13.118953+0000","last_fullsized":"2024-09-15T23:17:13.118953+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:41:24.484954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":335,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-15T23:17:13.100707+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:17:13.100707+0000","last_peered":"2024-09-15T23:17:13.100707+0000","last_clean":"2024-09-15T23:17:13.100707+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:17:13.100707+0000","last_undegraded":"2024-09-15T23:17:13.100707+0000","last_fullsized":"2024-09-15T23:17:13.100707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23,"ondisk_log_size":23,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476804,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40856,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330984,"statfs":{"total":96636764160,"available":96594927616,"internally_reserved":0,"allocated":1372160,"data_stored":602102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476801,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40836,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331004,"statfs":{"total":96636764160,"available":96594948096,"internally_reserved":0,"allocated":1359872,"data_stored":595827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476803,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37276,"kb_used_data":1920,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334564,"statfs":{"total":96636764160,"available":96598593536,"internally_reserved":0,"allocated":1966080,"data_stored":1192470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476803,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36680,"kb_used_data":1328,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335160,"statfs":{"total":96636764160,"available":96599203840,"internally_reserved":0,"allocated":1359872,"data_stored":595827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542210,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36712,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335128,"statfs":{"total":96636764160,"available":96599171072,"internally_reserved":0,"allocated":1388544,"data_stored":609459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542210,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36708,"kb_used_data":1352,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335132,"statfs":{"total":96636764160,"available":96599175168,"internally_reserved":0,"allocated":1384448,"data_stored":608877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542209,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37316,"kb_used_data":1964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334524,"statfs":{"total":96636764160,"available":96598552576,"internally_reserved":0,"allocated":2011136,"data_stored":1207213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542211,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36716,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335124,"statfs":{"total":96636764160,"available":96599166976,"internally_reserved":0,"allocated":1400832,"data_stored":615759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:17:21.549 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:17:21.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.658+0000 7f9a78cba640 1 Processor -- start 2024-09-15T23:17:21.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.658+0000 7f9a78cba640 1 -- start start 2024-09-15T23:17:21.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.659+0000 7f9a78cba640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f9a7406c320 0x7f9a7415bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:21.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.659+0000 7f9a78cba640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9a7413eb20 0x7f9a7415c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:21.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.659+0000 7f9a78cba640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a74071180 con 0x7f9a740b2d40 2024-09-15T23:17:21.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.659+0000 7f9a78cba640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f9a74071ab0 con 0x7f9a7406c320 2024-09-15T23:17:21.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.659+0000 7f9a78cba640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9a74071460 con 0x7f9a7413eb20 2024-09-15T23:17:21.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.659+0000 7f9a7259c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f9a740b2d40 0x7f9a7406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40594/0 (socket says 172.21.15.123:40594) 2024-09-15T23:17:21.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.659+0000 7f9a7259c640 1 -- 172.21.15.123:0/261007353 learned_addr learned my addr 172.21.15.123:0/261007353 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:17:21.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.660+0000 7f9a7159a640 1 -- 172.21.15.123:0/261007353 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3856276436 0 0) 0x7f9a74071180 con 0x7f9a740b2d40 2024-09-15T23:17:21.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.660+0000 7f9a7159a640 1 -- 172.21.15.123:0/261007353 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a60003520 con 0x7f9a740b2d40 2024-09-15T23:17:21.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.660+0000 7f9a72d9d640 1 --2- 172.21.15.123:0/261007353 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9a7413eb20 0x7f9a7415c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:21.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.660+0000 7f9a71d9b640 1 --2- 172.21.15.123:0/261007353 >> v2:172.21.15.188:3300/0 conn(0x7f9a7406c320 0x7f9a7415bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:21.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.660+0000 7f9a7159a640 1 -- 172.21.15.123:0/261007353 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1768364269 0 0) 0x7f9a60003520 con 0x7f9a740b2d40 2024-09-15T23:17:21.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.660+0000 7f9a7159a640 1 -- 172.21.15.123:0/261007353 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9a7413eb20 msgr2=0x7f9a7415c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:21.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.660+0000 7f9a7159a640 1 --2- 172.21.15.123:0/261007353 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9a7413eb20 0x7f9a7415c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:21.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.660+0000 7f9a7159a640 1 -- 172.21.15.123:0/261007353 >> v2:172.21.15.188:3300/0 conn(0x7f9a7406c320 msgr2=0x7f9a7415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:21.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.660+0000 7f9a7159a640 1 --2- 172.21.15.123:0/261007353 >> v2:172.21.15.188:3300/0 conn(0x7f9a7406c320 0x7f9a7415bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:21.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.660+0000 7f9a7159a640 1 -- 172.21.15.123:0/261007353 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a74071740 con 0x7f9a740b2d40 2024-09-15T23:17:21.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.660+0000 7f9a7159a640 1 -- 172.21.15.123:0/261007353 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f9a640019f0 con 0x7f9a740b2d40 2024-09-15T23:17:21.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.660+0000 7f9a7159a640 1 -- 172.21.15.123:0/261007353 >> v1:172.21.15.123:6789/0 conn(0x7f9a740b2d40 legacy=0x7f9a7406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:21.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.660+0000 7f9a7159a640 1 --2- 172.21.15.123:0/261007353 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a600039b0 0x7f9a60003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:21.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.660+0000 7f9a7159a640 1 --2- 172.21.15.123:0/261007353 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9a60004800 0x7f9a60004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:21.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.660+0000 7f9a7159a640 1 --2- 172.21.15.123:0/261007353 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9a7413eb20 0x7f9a600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:21.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.660+0000 7f9a7159a640 1 -- 172.21.15.123:0/261007353 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9a74071ab0 con 0x7f9a600039b0 2024-09-15T23:17:21.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.660+0000 7f9a7159a640 1 -- 172.21.15.123:0/261007353 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9a74071460 con 0x7f9a60004800 2024-09-15T23:17:21.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.660+0000 7f9a7159a640 1 -- 172.21.15.123:0/261007353 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9a6000b9c0 con 0x7f9a7413eb20 2024-09-15T23:17:21.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.660+0000 7f9a7259c640 1 --2- 172.21.15.123:0/261007353 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a600039b0 0x7f9a60003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:21.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.660+0000 7f9a71d9b640 1 --2- 172.21.15.123:0/261007353 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9a60004800 0x7f9a60004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:21.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.660+0000 7f9a72d9d640 1 --2- 172.21.15.123:0/261007353 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9a7413eb20 0x7f9a600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:21.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.660+0000 7f9a7259c640 1 -- 172.21.15.123:0/261007353 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9a7413eb20 msgr2=0x7f9a600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:21.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.660+0000 7f9a7259c640 1 --2- 172.21.15.123:0/261007353 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9a7413eb20 0x7f9a600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:21.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.660+0000 7f9a7259c640 1 -- 172.21.15.123:0/261007353 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9a60004800 msgr2=0x7f9a60004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:21.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.660+0000 7f9a7259c640 1 --2- 172.21.15.123:0/261007353 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9a60004800 0x7f9a60004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:21.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.660+0000 7f9a7259c640 1 -- 172.21.15.123:0/261007353 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a60003520 con 0x7f9a600039b0 2024-09-15T23:17:21.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.661+0000 7f9a7259c640 1 --2- 172.21.15.123:0/261007353 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a600039b0 0x7f9a60003dd0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f9a6400a880 tx=0x7f9a60005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15e67603c3028146 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:21.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.661+0000 7f9a7159a640 1 -- 172.21.15.123:0/261007353 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6400a4a0 con 0x7f9a600039b0 2024-09-15T23:17:21.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.661+0000 7f9a7159a640 1 -- 172.21.15.123:0/261007353 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a6402f070 con 0x7f9a600039b0 2024-09-15T23:17:21.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.661+0000 7f9a7159a640 1 -- 172.21.15.123:0/261007353 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6402bd00 con 0x7f9a600039b0 2024-09-15T23:17:21.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.662+0000 7f9a78cba640 1 -- 172.21.15.123:0/261007353 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a600039b0 msgr2=0x7f9a60003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:21.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.662+0000 7f9a78cba640 1 --2- 172.21.15.123:0/261007353 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a600039b0 0x7f9a60003dd0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f9a6400a880 tx=0x7f9a60005830 comp rx=0 tx=0).stop 2024-09-15T23:17:21.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.662+0000 7f9a72d9d640 1 -- 172.21.15.123:0/261007353 reap_dead start 2024-09-15T23:17:21.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.662+0000 7f9a78cba640 1 -- 172.21.15.123:0/261007353 shutdown_connections 2024-09-15T23:17:21.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.662+0000 7f9a78cba640 1 -- 172.21.15.123:0/261007353 >> 172.21.15.123:0/261007353 conn(0x7f9a740ccec0 msgr2=0x7f9a740cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:21.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.662+0000 7f9a78cba640 1 -- 172.21.15.123:0/261007353 shutdown_connections 2024-09-15T23:17:21.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.662+0000 7f9a78cba640 1 -- 172.21.15.123:0/261007353 wait complete. 2024-09-15T23:17:21.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.663+0000 7f9a78cba640 1 Processor -- start 2024-09-15T23:17:21.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.663+0000 7f9a78cba640 1 -- start start 2024-09-15T23:17:21.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.664+0000 7f9a78cba640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9a600039b0 0x7f9a741f42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:21.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.664+0000 7f9a78cba640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a740c9b70 0x7f9a741f47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:21.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.664+0000 7f9a78cba640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9a740b3550 0x7f9a741f4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:21.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.664+0000 7f9a78cba640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7415c600 con 0x7f9a740c9b70 2024-09-15T23:17:21.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.664+0000 7f9a78cba640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7415c480 con 0x7f9a600039b0 2024-09-15T23:17:21.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.664+0000 7f9a78cba640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9a7415c780 con 0x7f9a740b3550 2024-09-15T23:17:21.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.664+0000 7f9a71d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a740c9b70 0x7f9a741f47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:21.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.664+0000 7f9a71d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a740c9b70 0x7f9a741f47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48232/0 (socket says 172.21.15.123:48232) 2024-09-15T23:17:21.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.664+0000 7f9a71d9b640 1 -- 172.21.15.123:0/1031572256 learned_addr learned my addr 172.21.15.123:0/1031572256 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:21.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.664+0000 7f9a72d9d640 1 --2- 172.21.15.123:0/1031572256 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9a740b3550 0x7f9a741f4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:21.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.664+0000 7f9a7259c640 1 --2- 172.21.15.123:0/1031572256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9a600039b0 0x7f9a741f42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:21.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.665+0000 7f9a71d9b640 1 -- 172.21.15.123:0/1031572256 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9a740b3550 msgr2=0x7f9a741f4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:21.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.665+0000 7f9a71d9b640 1 --2- 172.21.15.123:0/1031572256 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9a740b3550 0x7f9a741f4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:21.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.665+0000 7f9a71d9b640 1 -- 172.21.15.123:0/1031572256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9a600039b0 msgr2=0x7f9a741f42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:21.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.665+0000 7f9a71d9b640 1 --2- 172.21.15.123:0/1031572256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9a600039b0 0x7f9a741f42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:21.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.665+0000 7f9a71d9b640 1 -- 172.21.15.123:0/1031572256 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a74159650 con 0x7f9a740c9b70 2024-09-15T23:17:21.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.665+0000 7f9a7259c640 1 --2- 172.21.15.123:0/1031572256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9a600039b0 0x7f9a741f42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:17:21.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.665+0000 7f9a71d9b640 1 --2- 172.21.15.123:0/1031572256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a740c9b70 0x7f9a741f47f0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c011960 tx=0x7f9a5c011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:21.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.665+0000 7f9a6affd640 1 -- 172.21.15.123:0/1031572256 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c00fa30 con 0x7f9a740c9b70 2024-09-15T23:17:21.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.665+0000 7f9a6affd640 1 -- 172.21.15.123:0/1031572256 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a5c00fbd0 con 0x7f9a740c9b70 2024-09-15T23:17:21.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.665+0000 7f9a78cba640 1 -- 172.21.15.123:0/1031572256 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a741f5470 con 0x7f9a740c9b70 2024-09-15T23:17:21.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.665+0000 7f9a6affd640 1 -- 172.21.15.123:0/1031572256 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c014440 con 0x7f9a740c9b70 2024-09-15T23:17:21.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.665+0000 7f9a78cba640 1 -- 172.21.15.123:0/1031572256 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a740b61a0 con 0x7f9a740c9b70 2024-09-15T23:17:21.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.666+0000 7f9a78cba640 1 -- 172.21.15.123:0/1031572256 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a7415bcf0 con 0x7f9a740c9b70 2024-09-15T23:17:21.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.666+0000 7f9a6affd640 1 -- 172.21.15.123:0/1031572256 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9a5c012040 con 0x7f9a740c9b70 2024-09-15T23:17:21.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.667+0000 7f9a6affd640 1 --2- 172.21.15.123:0/1031572256 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9a5406c2b0 0x7f9a5406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:21.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.667+0000 7f9a6affd640 1 -- 172.21.15.123:0/1031572256 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5709+0+0 (secure 0 0 0) 0x7f9a5c08b910 con 0x7f9a740c9b70 2024-09-15T23:17:21.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.667+0000 7f9a7259c640 1 --2- 172.21.15.123:0/1031572256 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9a5406c2b0 0x7f9a5406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:21.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.668+0000 7f9a7259c640 1 --2- 172.21.15.123:0/1031572256 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9a5406c2b0 0x7f9a5406e770 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f9a64033000 tx=0x7f9a64007000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:21.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.671+0000 7f9a6affd640 1 -- 172.21.15.123:0/1031572256 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9a5c019030 con 0x7f9a740c9b70 2024-09-15T23:17:21.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.833+0000 7f9a78cba640 1 -- 172.21.15.123:0/1031572256 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9a7413ff20 con 0x7f9a5406c2b0 2024-09-15T23:17:21.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.840+0000 7f9a6affd640 1 -- 172.21.15.123:0/1031572256 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252436 (secure 0 0 0) 0x7f9a7413ff20 con 0x7f9a5406c2b0 2024-09-15T23:17:21.844 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:17:21.845 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:17:21.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.843+0000 7f9a78cba640 1 -- 172.21.15.123:0/1031572256 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9a5406c2b0 msgr2=0x7f9a5406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:21.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.843+0000 7f9a78cba640 1 --2- 172.21.15.123:0/1031572256 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9a5406c2b0 0x7f9a5406e770 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f9a64033000 tx=0x7f9a64007000 comp rx=0 tx=0).stop 2024-09-15T23:17:21.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.843+0000 7f9a78cba640 1 -- 172.21.15.123:0/1031572256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a740c9b70 msgr2=0x7f9a741f47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:21.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.843+0000 7f9a78cba640 1 --2- 172.21.15.123:0/1031572256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a740c9b70 0x7f9a741f47f0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c011960 tx=0x7f9a5c011d60 comp rx=0 tx=0).stop 2024-09-15T23:17:21.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.843+0000 7f9a78cba640 1 -- 172.21.15.123:0/1031572256 shutdown_connections 2024-09-15T23:17:21.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.843+0000 7f9a78cba640 1 --2- 172.21.15.123:0/1031572256 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9a740b3550 0x7f9a741f4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:21.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.843+0000 7f9a78cba640 1 --2- 172.21.15.123:0/1031572256 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9a5406c2b0 0x7f9a5406e770 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:21.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.843+0000 7f9a78cba640 1 --2- 172.21.15.123:0/1031572256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a740c9b70 0x7f9a741f47f0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:21.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.843+0000 7f9a78cba640 1 --2- 172.21.15.123:0/1031572256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9a600039b0 0x7f9a741f42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:21.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.843+0000 7f9a78cba640 1 -- 172.21.15.123:0/1031572256 >> 172.21.15.123:0/1031572256 conn(0x7f9a740ccec0 msgr2=0x7f9a741404e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:21.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.843+0000 7f9a78cba640 1 -- 172.21.15.123:0/1031572256 shutdown_connections 2024-09-15T23:17:21.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:21.843+0000 7f9a78cba640 1 -- 172.21.15.123:0/1031572256 wait complete. 2024-09-15T23:17:21.855 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":267,"stamp":"2024-09-15T23:17:21.576128+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":303256,"kb_used_data":12136,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754671464,"statfs":{"total":773094113280,"available":772783579136,"internally_reserved":0,"allocated":12427264,"data_stored":6106972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":297913904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002011"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147783+0000","last_change":"2024-09-15T23:17:14.128999+0000","last_active":"2024-09-15T23:17:16.147783+0000","last_peered":"2024-09-15T23:17:16.147783+0000","last_clean":"2024-09-15T23:17:16.147783+0000","last_became_active":"2024-09-15T23:17:14.128723+0000","last_became_peered":"2024-09-15T23:17:14.128723+0000","last_unstale":"2024-09-15T23:17:16.147783+0000","last_undegraded":"2024-09-15T23:17:16.147783+0000","last_fullsized":"2024-09-15T23:17:16.147783+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:44:08.687064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148110+0000","last_change":"2024-09-15T23:17:14.136518+0000","last_active":"2024-09-15T23:17:16.148110+0000","last_peered":"2024-09-15T23:17:16.148110+0000","last_clean":"2024-09-15T23:17:16.148110+0000","last_became_active":"2024-09-15T23:17:14.136230+0000","last_became_peered":"2024-09-15T23:17:14.136230+0000","last_unstale":"2024-09-15T23:17:16.148110+0000","last_undegraded":"2024-09-15T23:17:16.148110+0000","last_fullsized":"2024-09-15T23:17:16.148110+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:11:42.871940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131971+0000","last_change":"2024-09-15T23:17:14.124836+0000","last_active":"2024-09-15T23:17:15.131971+0000","last_peered":"2024-09-15T23:17:15.131971+0000","last_clean":"2024-09-15T23:17:15.131971+0000","last_became_active":"2024-09-15T23:17:14.124567+0000","last_became_peered":"2024-09-15T23:17:14.124567+0000","last_unstale":"2024-09-15T23:17:15.131971+0000","last_undegraded":"2024-09-15T23:17:15.131971+0000","last_fullsized":"2024-09-15T23:17:15.131971+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:11.615199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147870+0000","last_change":"2024-09-15T23:17:14.133656+0000","last_active":"2024-09-15T23:17:16.147870+0000","last_peered":"2024-09-15T23:17:16.147870+0000","last_clean":"2024-09-15T23:17:16.147870+0000","last_became_active":"2024-09-15T23:17:14.132595+0000","last_became_peered":"2024-09-15T23:17:14.132595+0000","last_unstale":"2024-09-15T23:17:16.147870+0000","last_undegraded":"2024-09-15T23:17:16.147870+0000","last_fullsized":"2024-09-15T23:17:16.147870+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:23.891374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.114191+0000","last_change":"2024-09-15T23:17:14.130229+0000","last_active":"2024-09-15T23:17:15.114191+0000","last_peered":"2024-09-15T23:17:15.114191+0000","last_clean":"2024-09-15T23:17:15.114191+0000","last_became_active":"2024-09-15T23:17:14.129958+0000","last_became_peered":"2024-09-15T23:17:14.129958+0000","last_unstale":"2024-09-15T23:17:15.114191+0000","last_undegraded":"2024-09-15T23:17:15.114191+0000","last_fullsized":"2024-09-15T23:17:15.114191+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:37.993396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.114286+0000","last_change":"2024-09-15T23:17:14.132256+0000","last_active":"2024-09-15T23:17:15.114286+0000","last_peered":"2024-09-15T23:17:15.114286+0000","last_clean":"2024-09-15T23:17:15.114286+0000","last_became_active":"2024-09-15T23:17:14.131977+0000","last_became_peered":"2024-09-15T23:17:14.131977+0000","last_unstale":"2024-09-15T23:17:15.114286+0000","last_undegraded":"2024-09-15T23:17:15.114286+0000","last_fullsized":"2024-09-15T23:17:15.114286+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:47:25.341534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.114006+0000","last_change":"2024-09-15T23:17:14.127534+0000","last_active":"2024-09-15T23:17:15.114006+0000","last_peered":"2024-09-15T23:17:15.114006+0000","last_clean":"2024-09-15T23:17:15.114006+0000","last_became_active":"2024-09-15T23:17:14.127258+0000","last_became_peered":"2024-09-15T23:17:14.127258+0000","last_unstale":"2024-09-15T23:17:15.114006+0000","last_undegraded":"2024-09-15T23:17:15.114006+0000","last_fullsized":"2024-09-15T23:17:15.114006+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:00.054234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131508+0000","last_change":"2024-09-15T23:17:14.116714+0000","last_active":"2024-09-15T23:17:15.131508+0000","last_peered":"2024-09-15T23:17:15.131508+0000","last_clean":"2024-09-15T23:17:15.131508+0000","last_became_active":"2024-09-15T23:17:14.116402+0000","last_became_peered":"2024-09-15T23:17:14.116402+0000","last_unstale":"2024-09-15T23:17:15.131508+0000","last_undegraded":"2024-09-15T23:17:15.131508+0000","last_fullsized":"2024-09-15T23:17:15.131508+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:46.780974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.114586+0000","last_change":"2024-09-15T23:17:14.132529+0000","last_active":"2024-09-15T23:17:15.114586+0000","last_peered":"2024-09-15T23:17:15.114586+0000","last_clean":"2024-09-15T23:17:15.114586+0000","last_became_active":"2024-09-15T23:17:14.132267+0000","last_became_peered":"2024-09-15T23:17:14.132267+0000","last_unstale":"2024-09-15T23:17:15.114586+0000","last_undegraded":"2024-09-15T23:17:15.114586+0000","last_fullsized":"2024-09-15T23:17:15.114586+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:46:46.478661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.113520+0000","last_change":"2024-09-15T23:17:14.136365+0000","last_active":"2024-09-15T23:17:15.113520+0000","last_peered":"2024-09-15T23:17:15.113520+0000","last_clean":"2024-09-15T23:17:15.113520+0000","last_became_active":"2024-09-15T23:17:14.136100+0000","last_became_peered":"2024-09-15T23:17:14.136100+0000","last_unstale":"2024-09-15T23:17:15.113520+0000","last_undegraded":"2024-09-15T23:17:15.113520+0000","last_fullsized":"2024-09-15T23:17:15.113520+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:54:27.368483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.114720+0000","last_change":"2024-09-15T23:17:14.127288+0000","last_active":"2024-09-15T23:17:15.114720+0000","last_peered":"2024-09-15T23:17:15.114720+0000","last_clean":"2024-09-15T23:17:15.114720+0000","last_became_active":"2024-09-15T23:17:14.127001+0000","last_became_peered":"2024-09-15T23:17:14.127001+0000","last_unstale":"2024-09-15T23:17:15.114720+0000","last_undegraded":"2024-09-15T23:17:15.114720+0000","last_fullsized":"2024-09-15T23:17:15.114720+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:00.303943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147223+0000","last_change":"2024-09-15T23:17:14.135252+0000","last_active":"2024-09-15T23:17:16.147223+0000","last_peered":"2024-09-15T23:17:16.147223+0000","last_clean":"2024-09-15T23:17:16.147223+0000","last_became_active":"2024-09-15T23:17:14.134975+0000","last_became_peered":"2024-09-15T23:17:14.134975+0000","last_unstale":"2024-09-15T23:17:16.147223+0000","last_undegraded":"2024-09-15T23:17:16.147223+0000","last_fullsized":"2024-09-15T23:17:16.147223+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:24:53.702354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147960+0000","last_change":"2024-09-15T23:17:14.124715+0000","last_active":"2024-09-15T23:17:16.147960+0000","last_peered":"2024-09-15T23:17:16.147960+0000","last_clean":"2024-09-15T23:17:16.147960+0000","last_became_active":"2024-09-15T23:17:14.124463+0000","last_became_peered":"2024-09-15T23:17:14.124463+0000","last_unstale":"2024-09-15T23:17:16.147960+0000","last_undegraded":"2024-09-15T23:17:16.147960+0000","last_fullsized":"2024-09-15T23:17:16.147960+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:05.213822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147468+0000","last_change":"2024-09-15T23:17:14.140450+0000","last_active":"2024-09-15T23:17:16.147468+0000","last_peered":"2024-09-15T23:17:16.147468+0000","last_clean":"2024-09-15T23:17:16.147468+0000","last_became_active":"2024-09-15T23:17:14.139838+0000","last_became_peered":"2024-09-15T23:17:14.139838+0000","last_unstale":"2024-09-15T23:17:16.147468+0000","last_undegraded":"2024-09-15T23:17:16.147468+0000","last_fullsized":"2024-09-15T23:17:16.147468+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:46.018882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148205+0000","last_change":"2024-09-15T23:17:14.133339+0000","last_active":"2024-09-15T23:17:16.148205+0000","last_peered":"2024-09-15T23:17:16.148205+0000","last_clean":"2024-09-15T23:17:16.148205+0000","last_became_active":"2024-09-15T23:17:14.132322+0000","last_became_peered":"2024-09-15T23:17:14.132322+0000","last_unstale":"2024-09-15T23:17:16.148205+0000","last_undegraded":"2024-09-15T23:17:16.148205+0000","last_fullsized":"2024-09-15T23:17:16.148205+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:22.753014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.113889+0000","last_change":"2024-09-15T23:17:14.127442+0000","last_active":"2024-09-15T23:17:15.113889+0000","last_peered":"2024-09-15T23:17:15.113889+0000","last_clean":"2024-09-15T23:17:15.113889+0000","last_became_active":"2024-09-15T23:17:14.127082+0000","last_became_peered":"2024-09-15T23:17:14.127082+0000","last_unstale":"2024-09-15T23:17:15.113889+0000","last_undegraded":"2024-09-15T23:17:15.113889+0000","last_fullsized":"2024-09-15T23:17:15.113889+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:33:00.257654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129435+0000","last_change":"2024-09-15T23:17:14.130776+0000","last_active":"2024-09-15T23:17:15.129435+0000","last_peered":"2024-09-15T23:17:15.129435+0000","last_clean":"2024-09-15T23:17:15.129435+0000","last_became_active":"2024-09-15T23:17:14.130503+0000","last_became_peered":"2024-09-15T23:17:14.130503+0000","last_unstale":"2024-09-15T23:17:15.129435+0000","last_undegraded":"2024-09-15T23:17:15.129435+0000","last_fullsized":"2024-09-15T23:17:15.129435+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:20.514822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148179+0000","last_change":"2024-09-15T23:17:14.135879+0000","last_active":"2024-09-15T23:17:16.148179+0000","last_peered":"2024-09-15T23:17:16.148179+0000","last_clean":"2024-09-15T23:17:16.148179+0000","last_became_active":"2024-09-15T23:17:14.134228+0000","last_became_peered":"2024-09-15T23:17:14.134228+0000","last_unstale":"2024-09-15T23:17:16.148179+0000","last_undegraded":"2024-09-15T23:17:16.148179+0000","last_fullsized":"2024-09-15T23:17:16.148179+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:11.837562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129487+0000","last_change":"2024-09-15T23:17:14.128723+0000","last_active":"2024-09-15T23:17:15.129487+0000","last_peered":"2024-09-15T23:17:15.129487+0000","last_clean":"2024-09-15T23:17:15.129487+0000","last_became_active":"2024-09-15T23:17:14.128230+0000","last_became_peered":"2024-09-15T23:17:14.128230+0000","last_unstale":"2024-09-15T23:17:15.129487+0000","last_undegraded":"2024-09-15T23:17:15.129487+0000","last_fullsized":"2024-09-15T23:17:15.129487+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:58.401688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147246+0000","last_change":"2024-09-15T23:17:14.116216+0000","last_active":"2024-09-15T23:17:16.147246+0000","last_peered":"2024-09-15T23:17:16.147246+0000","last_clean":"2024-09-15T23:17:16.147246+0000","last_became_active":"2024-09-15T23:17:14.115960+0000","last_became_peered":"2024-09-15T23:17:14.115960+0000","last_unstale":"2024-09-15T23:17:16.147246+0000","last_undegraded":"2024-09-15T23:17:16.147246+0000","last_fullsized":"2024-09-15T23:17:16.147246+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:52:44.678329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131928+0000","last_change":"2024-09-15T23:17:14.122919+0000","last_active":"2024-09-15T23:17:15.131928+0000","last_peered":"2024-09-15T23:17:15.131928+0000","last_clean":"2024-09-15T23:17:15.131928+0000","last_became_active":"2024-09-15T23:17:14.122645+0000","last_became_peered":"2024-09-15T23:17:14.122645+0000","last_unstale":"2024-09-15T23:17:15.131928+0000","last_undegraded":"2024-09-15T23:17:15.131928+0000","last_fullsized":"2024-09-15T23:17:15.131928+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:30:14.079626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131664+0000","last_change":"2024-09-15T23:17:14.131221+0000","last_active":"2024-09-15T23:17:15.131664+0000","last_peered":"2024-09-15T23:17:15.131664+0000","last_clean":"2024-09-15T23:17:15.131664+0000","last_became_active":"2024-09-15T23:17:14.130594+0000","last_became_peered":"2024-09-15T23:17:14.130594+0000","last_unstale":"2024-09-15T23:17:15.131664+0000","last_undegraded":"2024-09-15T23:17:15.131664+0000","last_fullsized":"2024-09-15T23:17:15.131664+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:47:03.357343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147505+0000","last_change":"2024-09-15T23:17:14.140814+0000","last_active":"2024-09-15T23:17:16.147505+0000","last_peered":"2024-09-15T23:17:16.147505+0000","last_clean":"2024-09-15T23:17:16.147505+0000","last_became_active":"2024-09-15T23:17:14.140517+0000","last_became_peered":"2024-09-15T23:17:14.140517+0000","last_unstale":"2024-09-15T23:17:16.147505+0000","last_undegraded":"2024-09-15T23:17:16.147505+0000","last_fullsized":"2024-09-15T23:17:16.147505+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:48.303033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.114387+0000","last_change":"2024-09-15T23:17:14.130921+0000","last_active":"2024-09-15T23:17:15.114387+0000","last_peered":"2024-09-15T23:17:15.114387+0000","last_clean":"2024-09-15T23:17:15.114387+0000","last_became_active":"2024-09-15T23:17:14.130623+0000","last_became_peered":"2024-09-15T23:17:14.130623+0000","last_unstale":"2024-09-15T23:17:15.114387+0000","last_undegraded":"2024-09-15T23:17:15.114387+0000","last_fullsized":"2024-09-15T23:17:15.114387+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:45:02.819477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.113520+0000","last_change":"2024-09-15T23:17:14.126318+0000","last_active":"2024-09-15T23:17:15.113520+0000","last_peered":"2024-09-15T23:17:15.113520+0000","last_clean":"2024-09-15T23:17:15.113520+0000","last_became_active":"2024-09-15T23:17:14.126075+0000","last_became_peered":"2024-09-15T23:17:14.126075+0000","last_unstale":"2024-09-15T23:17:15.113520+0000","last_undegraded":"2024-09-15T23:17:15.113520+0000","last_fullsized":"2024-09-15T23:17:15.113520+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:37:44.398548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148056+0000","last_change":"2024-09-15T23:17:14.126059+0000","last_active":"2024-09-15T23:17:16.148056+0000","last_peered":"2024-09-15T23:17:16.148056+0000","last_clean":"2024-09-15T23:17:16.148056+0000","last_became_active":"2024-09-15T23:17:14.125760+0000","last_became_peered":"2024-09-15T23:17:14.125760+0000","last_unstale":"2024-09-15T23:17:16.148056+0000","last_undegraded":"2024-09-15T23:17:16.148056+0000","last_fullsized":"2024-09-15T23:17:16.148056+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:20.023859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.115021+0000","last_change":"2024-09-15T23:17:14.130571+0000","last_active":"2024-09-15T23:17:15.115021+0000","last_peered":"2024-09-15T23:17:15.115021+0000","last_clean":"2024-09-15T23:17:15.115021+0000","last_became_active":"2024-09-15T23:17:14.130322+0000","last_became_peered":"2024-09-15T23:17:14.130322+0000","last_unstale":"2024-09-15T23:17:15.115021+0000","last_undegraded":"2024-09-15T23:17:15.115021+0000","last_fullsized":"2024-09-15T23:17:15.115021+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:14.453192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.114711+0000","last_change":"2024-09-15T23:17:14.131679+0000","last_active":"2024-09-15T23:17:15.114711+0000","last_peered":"2024-09-15T23:17:15.114711+0000","last_clean":"2024-09-15T23:17:15.114711+0000","last_became_active":"2024-09-15T23:17:14.131408+0000","last_became_peered":"2024-09-15T23:17:14.131408+0000","last_unstale":"2024-09-15T23:17:15.114711+0000","last_undegraded":"2024-09-15T23:17:15.114711+0000","last_fullsized":"2024-09-15T23:17:15.114711+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:42.147757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148125+0000","last_change":"2024-09-15T23:17:14.119496+0000","last_active":"2024-09-15T23:17:16.148125+0000","last_peered":"2024-09-15T23:17:16.148125+0000","last_clean":"2024-09-15T23:17:16.148125+0000","last_became_active":"2024-09-15T23:17:14.119238+0000","last_became_peered":"2024-09-15T23:17:14.119238+0000","last_unstale":"2024-09-15T23:17:16.148125+0000","last_undegraded":"2024-09-15T23:17:16.148125+0000","last_fullsized":"2024-09-15T23:17:16.148125+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:58.881990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148335+0000","last_change":"2024-09-15T23:17:14.130119+0000","last_active":"2024-09-15T23:17:16.148335+0000","last_peered":"2024-09-15T23:17:16.148335+0000","last_clean":"2024-09-15T23:17:16.148335+0000","last_became_active":"2024-09-15T23:17:14.129832+0000","last_became_peered":"2024-09-15T23:17:14.129832+0000","last_unstale":"2024-09-15T23:17:16.148335+0000","last_undegraded":"2024-09-15T23:17:16.148335+0000","last_fullsized":"2024-09-15T23:17:16.148335+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:36:53.603091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131665+0000","last_change":"2024-09-15T23:17:14.120902+0000","last_active":"2024-09-15T23:17:15.131665+0000","last_peered":"2024-09-15T23:17:15.131665+0000","last_clean":"2024-09-15T23:17:15.131665+0000","last_became_active":"2024-09-15T23:17:14.120629+0000","last_became_peered":"2024-09-15T23:17:14.120629+0000","last_unstale":"2024-09-15T23:17:15.131665+0000","last_undegraded":"2024-09-15T23:17:15.131665+0000","last_fullsized":"2024-09-15T23:17:15.131665+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:25:18.338252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147988+0000","last_change":"2024-09-15T23:17:14.134985+0000","last_active":"2024-09-15T23:17:16.147988+0000","last_peered":"2024-09-15T23:17:16.147988+0000","last_clean":"2024-09-15T23:17:16.147988+0000","last_became_active":"2024-09-15T23:17:14.134639+0000","last_became_peered":"2024-09-15T23:17:14.134639+0000","last_unstale":"2024-09-15T23:17:16.147988+0000","last_undegraded":"2024-09-15T23:17:16.147988+0000","last_fullsized":"2024-09-15T23:17:16.147988+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:42.147757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129323+0000","last_change":"2024-09-15T23:17:14.127011+0000","last_active":"2024-09-15T23:17:15.129323+0000","last_peered":"2024-09-15T23:17:15.129323+0000","last_clean":"2024-09-15T23:17:15.129323+0000","last_became_active":"2024-09-15T23:17:14.126694+0000","last_became_peered":"2024-09-15T23:17:14.126694+0000","last_unstale":"2024-09-15T23:17:15.129323+0000","last_undegraded":"2024-09-15T23:17:15.129323+0000","last_fullsized":"2024-09-15T23:17:15.129323+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:02:57.119296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"113'4","reported_seq":18,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147990+0000","last_change":"2024-09-15T23:17:13.116670+0000","last_active":"2024-09-15T23:17:16.147990+0000","last_peered":"2024-09-15T23:17:16.147990+0000","last_clean":"2024-09-15T23:17:16.147990+0000","last_became_active":"2024-09-15T23:17:13.116343+0000","last_became_peered":"2024-09-15T23:17:13.116343+0000","last_unstale":"2024-09-15T23:17:16.147990+0000","last_undegraded":"2024-09-15T23:17:16.147990+0000","last_fullsized":"2024-09-15T23:17:16.147990+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:25.965813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147869+0000","last_change":"2024-09-15T23:17:14.118601+0000","last_active":"2024-09-15T23:17:16.147869+0000","last_peered":"2024-09-15T23:17:16.147869+0000","last_clean":"2024-09-15T23:17:16.147869+0000","last_became_active":"2024-09-15T23:17:14.118303+0000","last_became_peered":"2024-09-15T23:17:14.118303+0000","last_unstale":"2024-09-15T23:17:16.147869+0000","last_undegraded":"2024-09-15T23:17:16.147869+0000","last_fullsized":"2024-09-15T23:17:16.147869+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:58:46.481909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1e","version":"113'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.114484+0000","last_change":"2024-09-15T23:17:13.115752+0000","last_active":"2024-09-15T23:17:15.114484+0000","last_peered":"2024-09-15T23:17:15.114484+0000","last_clean":"2024-09-15T23:17:15.114484+0000","last_became_active":"2024-09-15T23:17:13.114959+0000","last_became_peered":"2024-09-15T23:17:13.114959+0000","last_unstale":"2024-09-15T23:17:15.114484+0000","last_undegraded":"2024-09-15T23:17:15.114484+0000","last_fullsized":"2024-09-15T23:17:15.114484+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:53:38.725911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147985+0000","last_change":"2024-09-15T23:17:14.132832+0000","last_active":"2024-09-15T23:17:16.147985+0000","last_peered":"2024-09-15T23:17:16.147985+0000","last_clean":"2024-09-15T23:17:16.147985+0000","last_became_active":"2024-09-15T23:17:14.132210+0000","last_became_peered":"2024-09-15T23:17:14.132210+0000","last_unstale":"2024-09-15T23:17:16.147985+0000","last_undegraded":"2024-09-15T23:17:16.147985+0000","last_fullsized":"2024-09-15T23:17:16.147985+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:45:02.819477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131964+0000","last_change":"2024-09-15T23:17:13.116873+0000","last_active":"2024-09-15T23:17:15.131964+0000","last_peered":"2024-09-15T23:17:15.131964+0000","last_clean":"2024-09-15T23:17:15.131964+0000","last_became_active":"2024-09-15T23:17:13.116544+0000","last_became_peered":"2024-09-15T23:17:13.116544+0000","last_unstale":"2024-09-15T23:17:15.131964+0000","last_undegraded":"2024-09-15T23:17:15.131964+0000","last_fullsized":"2024-09-15T23:17:15.131964+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:10:32.250679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.113374+0000","last_change":"2024-09-15T23:17:14.127799+0000","last_active":"2024-09-15T23:17:15.113374+0000","last_peered":"2024-09-15T23:17:15.113374+0000","last_clean":"2024-09-15T23:17:15.113374+0000","last_became_active":"2024-09-15T23:17:14.127522+0000","last_became_peered":"2024-09-15T23:17:14.127522+0000","last_unstale":"2024-09-15T23:17:15.113374+0000","last_undegraded":"2024-09-15T23:17:15.113374+0000","last_fullsized":"2024-09-15T23:17:15.113374+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:39:13.396122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148027+0000","last_change":"2024-09-15T23:17:13.118603+0000","last_active":"2024-09-15T23:17:16.148027+0000","last_peered":"2024-09-15T23:17:16.148027+0000","last_clean":"2024-09-15T23:17:16.148027+0000","last_became_active":"2024-09-15T23:17:13.118338+0000","last_became_peered":"2024-09-15T23:17:13.118338+0000","last_unstale":"2024-09-15T23:17:16.148027+0000","last_undegraded":"2024-09-15T23:17:16.148027+0000","last_fullsized":"2024-09-15T23:17:16.148027+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:13:54.700643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.146963+0000","last_change":"2024-09-15T23:17:14.128898+0000","last_active":"2024-09-15T23:17:16.146963+0000","last_peered":"2024-09-15T23:17:16.146963+0000","last_clean":"2024-09-15T23:17:16.146963+0000","last_became_active":"2024-09-15T23:17:14.128621+0000","last_became_peered":"2024-09-15T23:17:14.128621+0000","last_unstale":"2024-09-15T23:17:16.146963+0000","last_undegraded":"2024-09-15T23:17:16.146963+0000","last_fullsized":"2024-09-15T23:17:16.146963+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:32.077663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"113'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147965+0000","last_change":"2024-09-15T23:17:13.117008+0000","last_active":"2024-09-15T23:17:16.147965+0000","last_peered":"2024-09-15T23:17:16.147965+0000","last_clean":"2024-09-15T23:17:16.147965+0000","last_became_active":"2024-09-15T23:17:13.116742+0000","last_became_peered":"2024-09-15T23:17:13.116742+0000","last_unstale":"2024-09-15T23:17:16.147965+0000","last_undegraded":"2024-09-15T23:17:16.147965+0000","last_fullsized":"2024-09-15T23:17:16.147965+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:05:45.151293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.114235+0000","last_change":"2024-09-15T23:17:14.132291+0000","last_active":"2024-09-15T23:17:15.114235+0000","last_peered":"2024-09-15T23:17:15.114235+0000","last_clean":"2024-09-15T23:17:15.114235+0000","last_became_active":"2024-09-15T23:17:14.132021+0000","last_became_peered":"2024-09-15T23:17:14.132021+0000","last_unstale":"2024-09-15T23:17:15.114235+0000","last_undegraded":"2024-09-15T23:17:15.114235+0000","last_fullsized":"2024-09-15T23:17:15.114235+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:18.092993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"113'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131677+0000","last_change":"2024-09-15T23:17:13.117608+0000","last_active":"2024-09-15T23:17:15.131677+0000","last_peered":"2024-09-15T23:17:15.131677+0000","last_clean":"2024-09-15T23:17:15.131677+0000","last_became_active":"2024-09-15T23:17:13.117303+0000","last_became_peered":"2024-09-15T23:17:13.117303+0000","last_unstale":"2024-09-15T23:17:15.131677+0000","last_undegraded":"2024-09-15T23:17:15.131677+0000","last_fullsized":"2024-09-15T23:17:15.131677+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:36:12.510949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147498+0000","last_change":"2024-09-15T23:17:14.118298+0000","last_active":"2024-09-15T23:17:16.147498+0000","last_peered":"2024-09-15T23:17:16.147498+0000","last_clean":"2024-09-15T23:17:16.147498+0000","last_became_active":"2024-09-15T23:17:14.118015+0000","last_became_peered":"2024-09-15T23:17:14.118015+0000","last_unstale":"2024-09-15T23:17:16.147498+0000","last_undegraded":"2024-09-15T23:17:16.147498+0000","last_fullsized":"2024-09-15T23:17:16.147498+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:55:50.936536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.114051+0000","last_change":"2024-09-15T23:17:13.105562+0000","last_active":"2024-09-15T23:17:15.114051+0000","last_peered":"2024-09-15T23:17:15.114051+0000","last_clean":"2024-09-15T23:17:15.114051+0000","last_became_active":"2024-09-15T23:17:13.105267+0000","last_became_peered":"2024-09-15T23:17:13.105267+0000","last_unstale":"2024-09-15T23:17:15.114051+0000","last_undegraded":"2024-09-15T23:17:15.114051+0000","last_fullsized":"2024-09-15T23:17:15.114051+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:28:50.408768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.146871+0000","last_change":"2024-09-15T23:17:14.129035+0000","last_active":"2024-09-15T23:17:16.146871+0000","last_peered":"2024-09-15T23:17:16.146871+0000","last_clean":"2024-09-15T23:17:16.146871+0000","last_became_active":"2024-09-15T23:17:14.128761+0000","last_became_peered":"2024-09-15T23:17:14.128761+0000","last_unstale":"2024-09-15T23:17:16.146871+0000","last_undegraded":"2024-09-15T23:17:16.146871+0000","last_fullsized":"2024-09-15T23:17:16.146871+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:16:27.613541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129422+0000","last_change":"2024-09-15T23:17:13.120992+0000","last_active":"2024-09-15T23:17:15.129422+0000","last_peered":"2024-09-15T23:17:15.129422+0000","last_clean":"2024-09-15T23:17:15.129422+0000","last_became_active":"2024-09-15T23:17:13.120668+0000","last_became_peered":"2024-09-15T23:17:13.120668+0000","last_unstale":"2024-09-15T23:17:15.129422+0000","last_undegraded":"2024-09-15T23:17:15.129422+0000","last_fullsized":"2024-09-15T23:17:15.129422+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:01:28.019600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148315+0000","last_change":"2024-09-15T23:17:14.129965+0000","last_active":"2024-09-15T23:17:16.148315+0000","last_peered":"2024-09-15T23:17:16.148315+0000","last_clean":"2024-09-15T23:17:16.148315+0000","last_became_active":"2024-09-15T23:17:14.129527+0000","last_became_peered":"2024-09-15T23:17:14.129527+0000","last_unstale":"2024-09-15T23:17:16.148315+0000","last_undegraded":"2024-09-15T23:17:16.148315+0000","last_fullsized":"2024-09-15T23:17:16.148315+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:23.523717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.132127+0000","last_change":"2024-09-15T23:17:13.117392+0000","last_active":"2024-09-15T23:17:15.132127+0000","last_peered":"2024-09-15T23:17:15.132127+0000","last_clean":"2024-09-15T23:17:15.132127+0000","last_became_active":"2024-09-15T23:17:13.117084+0000","last_became_peered":"2024-09-15T23:17:13.117084+0000","last_unstale":"2024-09-15T23:17:15.132127+0000","last_undegraded":"2024-09-15T23:17:15.132127+0000","last_fullsized":"2024-09-15T23:17:15.132127+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:02.927244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.115098+0000","last_change":"2024-09-15T23:17:14.127587+0000","last_active":"2024-09-15T23:17:15.115098+0000","last_peered":"2024-09-15T23:17:15.115098+0000","last_clean":"2024-09-15T23:17:15.115098+0000","last_became_active":"2024-09-15T23:17:14.127320+0000","last_became_peered":"2024-09-15T23:17:14.127320+0000","last_unstale":"2024-09-15T23:17:15.115098+0000","last_undegraded":"2024-09-15T23:17:15.115098+0000","last_fullsized":"2024-09-15T23:17:15.115098+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:23.523717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148287+0000","last_change":"2024-09-15T23:17:13.119920+0000","last_active":"2024-09-15T23:17:16.148287+0000","last_peered":"2024-09-15T23:17:16.148287+0000","last_clean":"2024-09-15T23:17:16.148287+0000","last_became_active":"2024-09-15T23:17:13.119565+0000","last_became_peered":"2024-09-15T23:17:13.119565+0000","last_unstale":"2024-09-15T23:17:16.148287+0000","last_undegraded":"2024-09-15T23:17:16.148287+0000","last_fullsized":"2024-09-15T23:17:16.148287+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:18:26.179680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.114252+0000","last_change":"2024-09-15T23:17:14.139666+0000","last_active":"2024-09-15T23:17:15.114252+0000","last_peered":"2024-09-15T23:17:15.114252+0000","last_clean":"2024-09-15T23:17:15.114252+0000","last_became_active":"2024-09-15T23:17:14.139383+0000","last_became_peered":"2024-09-15T23:17:14.139383+0000","last_unstale":"2024-09-15T23:17:15.114252+0000","last_undegraded":"2024-09-15T23:17:15.114252+0000","last_fullsized":"2024-09-15T23:17:15.114252+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:22:16.028123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"113'3","reported_seq":17,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.114644+0000","last_change":"2024-09-15T23:17:13.107378+0000","last_active":"2024-09-15T23:17:15.114644+0000","last_peered":"2024-09-15T23:17:15.114644+0000","last_clean":"2024-09-15T23:17:15.114644+0000","last_became_active":"2024-09-15T23:17:13.107092+0000","last_became_peered":"2024-09-15T23:17:13.107092+0000","last_unstale":"2024-09-15T23:17:15.114644+0000","last_undegraded":"2024-09-15T23:17:15.114644+0000","last_fullsized":"2024-09-15T23:17:15.114644+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:56.034468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.114981+0000","last_change":"2024-09-15T23:17:14.129406+0000","last_active":"2024-09-15T23:17:15.114981+0000","last_peered":"2024-09-15T23:17:15.114981+0000","last_clean":"2024-09-15T23:17:15.114981+0000","last_became_active":"2024-09-15T23:17:14.129135+0000","last_became_peered":"2024-09-15T23:17:14.129135+0000","last_unstale":"2024-09-15T23:17:15.114981+0000","last_undegraded":"2024-09-15T23:17:15.114981+0000","last_fullsized":"2024-09-15T23:17:15.114981+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:11.837562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"113'6","reported_seq":20,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147286+0000","last_change":"2024-09-15T23:17:13.115247+0000","last_active":"2024-09-15T23:17:16.147286+0000","last_peered":"2024-09-15T23:17:16.147286+0000","last_clean":"2024-09-15T23:17:16.147286+0000","last_became_active":"2024-09-15T23:17:13.114968+0000","last_became_peered":"2024-09-15T23:17:13.114968+0000","last_unstale":"2024-09-15T23:17:16.147286+0000","last_undegraded":"2024-09-15T23:17:16.147286+0000","last_fullsized":"2024-09-15T23:17:16.147286+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:04.209731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148217+0000","last_change":"2024-09-15T23:17:14.128333+0000","last_active":"2024-09-15T23:17:16.148217+0000","last_peered":"2024-09-15T23:17:16.148217+0000","last_clean":"2024-09-15T23:17:16.148217+0000","last_became_active":"2024-09-15T23:17:14.128067+0000","last_became_peered":"2024-09-15T23:17:14.128067+0000","last_unstale":"2024-09-15T23:17:16.148217+0000","last_undegraded":"2024-09-15T23:17:16.148217+0000","last_fullsized":"2024-09-15T23:17:16.148217+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:14.453192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129207+0000","last_change":"2024-09-15T23:17:13.117368+0000","last_active":"2024-09-15T23:17:15.129207+0000","last_peered":"2024-09-15T23:17:15.129207+0000","last_clean":"2024-09-15T23:17:15.129207+0000","last_became_active":"2024-09-15T23:17:13.117082+0000","last_became_peered":"2024-09-15T23:17:13.117082+0000","last_unstale":"2024-09-15T23:17:15.129207+0000","last_undegraded":"2024-09-15T23:17:15.129207+0000","last_fullsized":"2024-09-15T23:17:15.129207+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:44.068584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131891+0000","last_change":"2024-09-15T23:17:14.131213+0000","last_active":"2024-09-15T23:17:15.131891+0000","last_peered":"2024-09-15T23:17:15.131891+0000","last_clean":"2024-09-15T23:17:15.131891+0000","last_became_active":"2024-09-15T23:17:14.127591+0000","last_became_peered":"2024-09-15T23:17:14.127591+0000","last_unstale":"2024-09-15T23:17:15.131891+0000","last_undegraded":"2024-09-15T23:17:15.131891+0000","last_fullsized":"2024-09-15T23:17:15.131891+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:01:29.023692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147713+0000","last_change":"2024-09-15T23:17:13.116393+0000","last_active":"2024-09-15T23:17:16.147713+0000","last_peered":"2024-09-15T23:17:16.147713+0000","last_clean":"2024-09-15T23:17:16.147713+0000","last_became_active":"2024-09-15T23:17:13.116112+0000","last_became_peered":"2024-09-15T23:17:13.116112+0000","last_unstale":"2024-09-15T23:17:16.147713+0000","last_undegraded":"2024-09-15T23:17:16.147713+0000","last_fullsized":"2024-09-15T23:17:16.147713+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:12.306832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.113949+0000","last_change":"2024-09-15T23:17:14.126709+0000","last_active":"2024-09-15T23:17:15.113949+0000","last_peered":"2024-09-15T23:17:15.113949+0000","last_clean":"2024-09-15T23:17:15.113949+0000","last_became_active":"2024-09-15T23:17:14.126438+0000","last_became_peered":"2024-09-15T23:17:14.126438+0000","last_unstale":"2024-09-15T23:17:15.113949+0000","last_undegraded":"2024-09-15T23:17:15.113949+0000","last_fullsized":"2024-09-15T23:17:15.113949+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:46:51.857999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.146997+0000","last_change":"2024-09-15T23:17:13.108829+0000","last_active":"2024-09-15T23:17:16.146997+0000","last_peered":"2024-09-15T23:17:16.146997+0000","last_clean":"2024-09-15T23:17:16.146997+0000","last_became_active":"2024-09-15T23:17:13.108553+0000","last_became_peered":"2024-09-15T23:17:13.108553+0000","last_unstale":"2024-09-15T23:17:16.146997+0000","last_undegraded":"2024-09-15T23:17:16.146997+0000","last_fullsized":"2024-09-15T23:17:16.146997+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:58:45.477818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131655+0000","last_change":"2024-09-15T23:17:14.120108+0000","last_active":"2024-09-15T23:17:15.131655+0000","last_peered":"2024-09-15T23:17:15.131655+0000","last_clean":"2024-09-15T23:17:15.131655+0000","last_became_active":"2024-09-15T23:17:14.119851+0000","last_became_peered":"2024-09-15T23:17:14.119851+0000","last_unstale":"2024-09-15T23:17:15.131655+0000","last_undegraded":"2024-09-15T23:17:15.131655+0000","last_fullsized":"2024-09-15T23:17:15.131655+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:45.072675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.10","version":"113'8","reported_seq":22,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148262+0000","last_change":"2024-09-15T23:17:13.118354+0000","last_active":"2024-09-15T23:17:16.148262+0000","last_peered":"2024-09-15T23:17:16.148262+0000","last_clean":"2024-09-15T23:17:16.148262+0000","last_became_active":"2024-09-15T23:17:13.117785+0000","last_became_peered":"2024-09-15T23:17:13.117785+0000","last_unstale":"2024-09-15T23:17:16.148262+0000","last_undegraded":"2024-09-15T23:17:16.148262+0000","last_fullsized":"2024-09-15T23:17:16.148262+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:07:03.677453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.115123+0000","last_change":"2024-09-15T23:17:14.126055+0000","last_active":"2024-09-15T23:17:15.115123+0000","last_peered":"2024-09-15T23:17:15.115123+0000","last_clean":"2024-09-15T23:17:15.115123+0000","last_became_active":"2024-09-15T23:17:14.125634+0000","last_became_peered":"2024-09-15T23:17:14.125634+0000","last_unstale":"2024-09-15T23:17:15.115123+0000","last_undegraded":"2024-09-15T23:17:15.115123+0000","last_fullsized":"2024-09-15T23:17:15.115123+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:21.120785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147125+0000","last_change":"2024-09-15T23:17:13.115236+0000","last_active":"2024-09-15T23:17:16.147125+0000","last_peered":"2024-09-15T23:17:16.147125+0000","last_clean":"2024-09-15T23:17:16.147125+0000","last_became_active":"2024-09-15T23:17:13.114937+0000","last_became_peered":"2024-09-15T23:17:13.114937+0000","last_unstale":"2024-09-15T23:17:16.147125+0000","last_undegraded":"2024-09-15T23:17:16.147125+0000","last_fullsized":"2024-09-15T23:17:16.147125+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:43.530980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.114858+0000","last_change":"2024-09-15T23:17:14.122498+0000","last_active":"2024-09-15T23:17:15.114858+0000","last_peered":"2024-09-15T23:17:15.114858+0000","last_clean":"2024-09-15T23:17:15.114858+0000","last_became_active":"2024-09-15T23:17:14.122225+0000","last_became_peered":"2024-09-15T23:17:14.122225+0000","last_unstale":"2024-09-15T23:17:15.114858+0000","last_undegraded":"2024-09-15T23:17:15.114858+0000","last_fullsized":"2024-09-15T23:17:15.114858+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:11:42.871940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"113'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.114744+0000","last_change":"2024-09-15T23:17:13.113950+0000","last_active":"2024-09-15T23:17:15.114744+0000","last_peered":"2024-09-15T23:17:15.114744+0000","last_clean":"2024-09-15T23:17:15.114744+0000","last_became_active":"2024-09-15T23:17:13.113680+0000","last_became_peered":"2024-09-15T23:17:13.113680+0000","last_unstale":"2024-09-15T23:17:15.114744+0000","last_undegraded":"2024-09-15T23:17:15.114744+0000","last_fullsized":"2024-09-15T23:17:15.114744+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:28:37.466375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147147+0000","last_change":"2024-09-15T23:17:14.116862+0000","last_active":"2024-09-15T23:17:16.147147+0000","last_peered":"2024-09-15T23:17:16.147147+0000","last_clean":"2024-09-15T23:17:16.147147+0000","last_became_active":"2024-09-15T23:17:14.116601+0000","last_became_peered":"2024-09-15T23:17:14.116601+0000","last_unstale":"2024-09-15T23:17:16.147147+0000","last_undegraded":"2024-09-15T23:17:16.147147+0000","last_fullsized":"2024-09-15T23:17:16.147147+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:24:22.115142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129522+0000","last_change":"2024-09-15T23:17:13.120403+0000","last_active":"2024-09-15T23:17:15.129522+0000","last_peered":"2024-09-15T23:17:15.129522+0000","last_clean":"2024-09-15T23:17:15.129522+0000","last_became_active":"2024-09-15T23:17:13.120082+0000","last_became_peered":"2024-09-15T23:17:13.120082+0000","last_unstale":"2024-09-15T23:17:15.129522+0000","last_undegraded":"2024-09-15T23:17:15.129522+0000","last_fullsized":"2024-09-15T23:17:15.129522+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:25:17.334161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129570+0000","last_change":"2024-09-15T23:17:14.137236+0000","last_active":"2024-09-15T23:17:15.129570+0000","last_peered":"2024-09-15T23:17:15.129570+0000","last_clean":"2024-09-15T23:17:15.129570+0000","last_became_active":"2024-09-15T23:17:14.135291+0000","last_became_peered":"2024-09-15T23:17:14.135291+0000","last_unstale":"2024-09-15T23:17:15.129570+0000","last_undegraded":"2024-09-15T23:17:15.129570+0000","last_fullsized":"2024-09-15T23:17:15.129570+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:21:57.537259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148104+0000","last_change":"2024-09-15T23:17:13.118920+0000","last_active":"2024-09-15T23:17:16.148104+0000","last_peered":"2024-09-15T23:17:16.148104+0000","last_clean":"2024-09-15T23:17:16.148104+0000","last_became_active":"2024-09-15T23:17:13.118368+0000","last_became_peered":"2024-09-15T23:17:13.118368+0000","last_unstale":"2024-09-15T23:17:16.148104+0000","last_undegraded":"2024-09-15T23:17:16.148104+0000","last_fullsized":"2024-09-15T23:17:16.148104+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:34.758267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129327+0000","last_change":"2024-09-15T23:17:14.135869+0000","last_active":"2024-09-15T23:17:15.129327+0000","last_peered":"2024-09-15T23:17:15.129327+0000","last_clean":"2024-09-15T23:17:15.129327+0000","last_became_active":"2024-09-15T23:17:14.135547+0000","last_became_peered":"2024-09-15T23:17:14.135547+0000","last_unstale":"2024-09-15T23:17:15.129327+0000","last_undegraded":"2024-09-15T23:17:15.129327+0000","last_fullsized":"2024-09-15T23:17:15.129327+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:38.244015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.114465+0000","last_change":"2024-09-15T23:17:13.115998+0000","last_active":"2024-09-15T23:17:15.114465+0000","last_peered":"2024-09-15T23:17:15.114465+0000","last_clean":"2024-09-15T23:17:15.114465+0000","last_became_active":"2024-09-15T23:17:13.115703+0000","last_became_peered":"2024-09-15T23:17:13.115703+0000","last_unstale":"2024-09-15T23:17:15.114465+0000","last_undegraded":"2024-09-15T23:17:15.114465+0000","last_fullsized":"2024-09-15T23:17:15.114465+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:10.009604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.148639+0000","last_change":"2024-09-15T23:17:14.140352+0000","last_active":"2024-09-15T23:17:16.148639+0000","last_peered":"2024-09-15T23:17:16.148639+0000","last_clean":"2024-09-15T23:17:16.148639+0000","last_became_active":"2024-09-15T23:17:14.140068+0000","last_became_peered":"2024-09-15T23:17:14.140068+0000","last_unstale":"2024-09-15T23:17:16.148639+0000","last_undegraded":"2024-09-15T23:17:16.148639+0000","last_fullsized":"2024-09-15T23:17:16.148639+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:21.120785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.113229+0000","last_change":"2024-09-15T23:17:13.115923+0000","last_active":"2024-09-15T23:17:15.113229+0000","last_peered":"2024-09-15T23:17:15.113229+0000","last_clean":"2024-09-15T23:17:15.113229+0000","last_became_active":"2024-09-15T23:17:13.115642+0000","last_became_peered":"2024-09-15T23:17:13.115642+0000","last_unstale":"2024-09-15T23:17:15.113229+0000","last_undegraded":"2024-09-15T23:17:15.113229+0000","last_fullsized":"2024-09-15T23:17:15.113229+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:42:38.571629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.114990+0000","last_change":"2024-09-15T23:17:14.126570+0000","last_active":"2024-09-15T23:17:15.114990+0000","last_peered":"2024-09-15T23:17:15.114990+0000","last_clean":"2024-09-15T23:17:15.114990+0000","last_became_active":"2024-09-15T23:17:14.126263+0000","last_became_peered":"2024-09-15T23:17:14.126263+0000","last_unstale":"2024-09-15T23:17:15.114990+0000","last_undegraded":"2024-09-15T23:17:15.114990+0000","last_fullsized":"2024-09-15T23:17:15.114990+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:22.753014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131511+0000","last_change":"2024-09-15T23:17:13.116590+0000","last_active":"2024-09-15T23:17:15.131511+0000","last_peered":"2024-09-15T23:17:15.131511+0000","last_clean":"2024-09-15T23:17:15.131511+0000","last_became_active":"2024-09-15T23:17:13.116231+0000","last_became_peered":"2024-09-15T23:17:13.116231+0000","last_unstale":"2024-09-15T23:17:15.131511+0000","last_undegraded":"2024-09-15T23:17:15.131511+0000","last_fullsized":"2024-09-15T23:17:15.131511+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:55.924454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129501+0000","last_change":"2024-09-15T23:17:14.129416+0000","last_active":"2024-09-15T23:17:15.129501+0000","last_peered":"2024-09-15T23:17:15.129501+0000","last_clean":"2024-09-15T23:17:15.129501+0000","last_became_active":"2024-09-15T23:17:14.127497+0000","last_became_peered":"2024-09-15T23:17:14.127497+0000","last_unstale":"2024-09-15T23:17:15.129501+0000","last_undegraded":"2024-09-15T23:17:15.129501+0000","last_fullsized":"2024-09-15T23:17:15.129501+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:11:38.026467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"113'2","reported_seq":16,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147196+0000","last_change":"2024-09-15T23:17:13.111438+0000","last_active":"2024-09-15T23:17:16.147196+0000","last_peered":"2024-09-15T23:17:16.147196+0000","last_clean":"2024-09-15T23:17:16.147196+0000","last_became_active":"2024-09-15T23:17:13.111139+0000","last_became_peered":"2024-09-15T23:17:13.111139+0000","last_unstale":"2024-09-15T23:17:16.147196+0000","last_undegraded":"2024-09-15T23:17:16.147196+0000","last_fullsized":"2024-09-15T23:17:16.147196+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:36.439343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129514+0000","last_change":"2024-09-15T23:17:14.128647+0000","last_active":"2024-09-15T23:17:15.129514+0000","last_peered":"2024-09-15T23:17:15.129514+0000","last_clean":"2024-09-15T23:17:15.129514+0000","last_became_active":"2024-09-15T23:17:14.128369+0000","last_became_peered":"2024-09-15T23:17:14.128369+0000","last_unstale":"2024-09-15T23:17:15.129514+0000","last_undegraded":"2024-09-15T23:17:15.129514+0000","last_fullsized":"2024-09-15T23:17:15.129514+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:08.741132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"114'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131035+0000","last_change":"2024-09-15T23:17:13.118913+0000","last_active":"2024-09-15T23:17:15.131035+0000","last_peered":"2024-09-15T23:17:15.131035+0000","last_clean":"2024-09-15T23:17:15.131035+0000","last_became_active":"2024-09-15T23:17:13.115889+0000","last_became_peered":"2024-09-15T23:17:13.115889+0000","last_unstale":"2024-09-15T23:17:15.131035+0000","last_undegraded":"2024-09-15T23:17:15.131035+0000","last_fullsized":"2024-09-15T23:17:15.131035+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:45.776883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.132003+0000","last_change":"2024-09-15T23:17:14.125081+0000","last_active":"2024-09-15T23:17:15.132003+0000","last_peered":"2024-09-15T23:17:15.132003+0000","last_clean":"2024-09-15T23:17:15.132003+0000","last_became_active":"2024-09-15T23:17:14.124730+0000","last_became_peered":"2024-09-15T23:17:14.124730+0000","last_unstale":"2024-09-15T23:17:15.132003+0000","last_undegraded":"2024-09-15T23:17:15.132003+0000","last_fullsized":"2024-09-15T23:17:15.132003+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:56.765821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129345+0000","last_change":"2024-09-15T23:17:13.114547+0000","last_active":"2024-09-15T23:17:15.129345+0000","last_peered":"2024-09-15T23:17:15.129345+0000","last_clean":"2024-09-15T23:17:15.129345+0000","last_became_active":"2024-09-15T23:17:13.114261+0000","last_became_peered":"2024-09-15T23:17:13.114261+0000","last_unstale":"2024-09-15T23:17:15.129345+0000","last_undegraded":"2024-09-15T23:17:15.129345+0000","last_fullsized":"2024-09-15T23:17:15.129345+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:47:02.353252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.114559+0000","last_change":"2024-09-15T23:17:14.127722+0000","last_active":"2024-09-15T23:17:15.114559+0000","last_peered":"2024-09-15T23:17:15.114559+0000","last_clean":"2024-09-15T23:17:15.114559+0000","last_became_active":"2024-09-15T23:17:14.127341+0000","last_became_peered":"2024-09-15T23:17:14.127341+0000","last_unstale":"2024-09-15T23:17:15.114559+0000","last_undegraded":"2024-09-15T23:17:15.114559+0000","last_fullsized":"2024-09-15T23:17:15.114559+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:21.930285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.114868+0000","last_change":"2024-09-15T23:17:13.113961+0000","last_active":"2024-09-15T23:17:15.114868+0000","last_peered":"2024-09-15T23:17:15.114868+0000","last_clean":"2024-09-15T23:17:15.114868+0000","last_became_active":"2024-09-15T23:17:13.113690+0000","last_became_peered":"2024-09-15T23:17:13.113690+0000","last_unstale":"2024-09-15T23:17:15.114868+0000","last_undegraded":"2024-09-15T23:17:15.114868+0000","last_fullsized":"2024-09-15T23:17:15.114868+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:54:26.364392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129217+0000","last_change":"2024-09-15T23:17:14.128314+0000","last_active":"2024-09-15T23:17:15.129217+0000","last_peered":"2024-09-15T23:17:15.129217+0000","last_clean":"2024-09-15T23:17:15.129217+0000","last_became_active":"2024-09-15T23:17:14.128027+0000","last_became_peered":"2024-09-15T23:17:14.128027+0000","last_unstale":"2024-09-15T23:17:15.129217+0000","last_undegraded":"2024-09-15T23:17:15.129217+0000","last_fullsized":"2024-09-15T23:17:15.129217+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:48:19.614946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131975+0000","last_change":"2024-09-15T23:17:13.116982+0000","last_active":"2024-09-15T23:17:15.131975+0000","last_peered":"2024-09-15T23:17:15.131975+0000","last_clean":"2024-09-15T23:17:15.131975+0000","last_became_active":"2024-09-15T23:17:13.116634+0000","last_became_peered":"2024-09-15T23:17:13.116634+0000","last_unstale":"2024-09-15T23:17:15.131975+0000","last_undegraded":"2024-09-15T23:17:15.131975+0000","last_fullsized":"2024-09-15T23:17:15.131975+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:29.604651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.114344+0000","last_change":"2024-09-15T23:17:14.133652+0000","last_active":"2024-09-15T23:17:15.114344+0000","last_peered":"2024-09-15T23:17:15.114344+0000","last_clean":"2024-09-15T23:17:15.114344+0000","last_became_active":"2024-09-15T23:17:14.132844+0000","last_became_peered":"2024-09-15T23:17:14.132844+0000","last_unstale":"2024-09-15T23:17:15.114344+0000","last_undegraded":"2024-09-15T23:17:15.114344+0000","last_fullsized":"2024-09-15T23:17:15.114344+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:16:58.599373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.114485+0000","last_change":"2024-09-15T23:17:13.114546+0000","last_active":"2024-09-15T23:17:15.114485+0000","last_peered":"2024-09-15T23:17:15.114485+0000","last_clean":"2024-09-15T23:17:15.114485+0000","last_became_active":"2024-09-15T23:17:13.114310+0000","last_became_peered":"2024-09-15T23:17:13.114310+0000","last_unstale":"2024-09-15T23:17:15.114485+0000","last_undegraded":"2024-09-15T23:17:15.114485+0000","last_fullsized":"2024-09-15T23:17:15.114485+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:39:12.392031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.129213+0000","last_change":"2024-09-15T23:17:14.130298+0000","last_active":"2024-09-15T23:17:15.129213+0000","last_peered":"2024-09-15T23:17:15.129213+0000","last_clean":"2024-09-15T23:17:15.129213+0000","last_became_active":"2024-09-15T23:17:14.130022+0000","last_became_peered":"2024-09-15T23:17:14.130022+0000","last_unstale":"2024-09-15T23:17:15.129213+0000","last_undegraded":"2024-09-15T23:17:15.129213+0000","last_fullsized":"2024-09-15T23:17:15.129213+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:54.412546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147562+0000","last_change":"2024-09-15T23:17:13.115530+0000","last_active":"2024-09-15T23:17:16.147562+0000","last_peered":"2024-09-15T23:17:16.147562+0000","last_clean":"2024-09-15T23:17:16.147562+0000","last_became_active":"2024-09-15T23:17:13.115259+0000","last_became_peered":"2024-09-15T23:17:13.115259+0000","last_unstale":"2024-09-15T23:17:16.147562+0000","last_undegraded":"2024-09-15T23:17:16.147562+0000","last_fullsized":"2024-09-15T23:17:16.147562+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:57:05.175799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.146880+0000","last_change":"2024-09-15T23:17:14.135227+0000","last_active":"2024-09-15T23:17:16.146880+0000","last_peered":"2024-09-15T23:17:16.146880+0000","last_clean":"2024-09-15T23:17:16.146880+0000","last_became_active":"2024-09-15T23:17:14.134938+0000","last_became_peered":"2024-09-15T23:17:14.134938+0000","last_unstale":"2024-09-15T23:17:16.146880+0000","last_undegraded":"2024-09-15T23:17:16.146880+0000","last_fullsized":"2024-09-15T23:17:16.146880+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:08:46.557770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":14,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.131643+0000","last_change":"2024-09-15T23:17:13.115842+0000","last_active":"2024-09-15T23:17:15.131643+0000","last_peered":"2024-09-15T23:17:15.131643+0000","last_clean":"2024-09-15T23:17:15.131643+0000","last_became_active":"2024-09-15T23:17:13.115274+0000","last_became_peered":"2024-09-15T23:17:13.115274+0000","last_unstale":"2024-09-15T23:17:15.131643+0000","last_undegraded":"2024-09-15T23:17:15.131643+0000","last_fullsized":"2024-09-15T23:17:15.131643+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:12.992861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":12,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:15.132167+0000","last_change":"2024-09-15T23:17:14.128611+0000","last_active":"2024-09-15T23:17:15.132167+0000","last_peered":"2024-09-15T23:17:15.132167+0000","last_clean":"2024-09-15T23:17:15.132167+0000","last_became_active":"2024-09-15T23:17:14.128331+0000","last_became_peered":"2024-09-15T23:17:14.128331+0000","last_unstale":"2024-09-15T23:17:15.132167+0000","last_undegraded":"2024-09-15T23:17:15.132167+0000","last_fullsized":"2024-09-15T23:17:15.132167+0000","mapping_epoch":112,"log_start":"0'0","ondisk_log_start":"0'0","created":112,"last_epoch_clean":113,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:13.097077+0000","last_clean_scrub_stamp":"2024-09-15T23:17:13.097077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:58:17.851554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.f","version":"113'1","reported_seq":15,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.147188+0000","last_change":"2024-09-15T23:17:13.115287+0000","last_active":"2024-09-15T23:17:16.147188+0000","last_peered":"2024-09-15T23:17:16.147188+0000","last_clean":"2024-09-15T23:17:16.147188+0000","last_became_active":"2024-09-15T23:17:13.114980+0000","last_became_peered":"2024-09-15T23:17:13.114980+0000","last_unstale":"2024-09-15T23:17:16.147188+0000","last_undegraded":"2024-09-15T23:17:16.147188+0000","last_fullsized":"2024-09-15T23:17:16.147188+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:17:12.092985+0000","last_clean_scrub_stamp":"2024-09-15T23:17:12.092985+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:55:49.932445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":339,"reported_epoch":114,"state":"active+clean","last_fresh":"2024-09-15T23:17:16.146731+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:17:16.146731+0000","last_peered":"2024-09-15T23:17:16.146731+0000","last_clean":"2024-09-15T23:17:16.146731+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:17:16.146731+0000","last_undegraded":"2024-09-15T23:17:16.146731+0000","last_fullsized":"2024-09-15T23:17:16.146731+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476805,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40888,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330952,"statfs":{"total":96636764160,"available":96594894848,"internally_reserved":0,"allocated":1409024,"data_stored":615371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476802,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40876,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330964,"statfs":{"total":96636764160,"available":96594907136,"internally_reserved":0,"allocated":1400832,"data_stored":615247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476804,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37316,"kb_used_data":1964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334524,"statfs":{"total":96636764160,"available":96598552576,"internally_reserved":0,"allocated":2011136,"data_stored":1207269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476804,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36716,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335124,"statfs":{"total":96636764160,"available":96599166976,"internally_reserved":0,"allocated":1396736,"data_stored":615177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542211,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36716,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335124,"statfs":{"total":96636764160,"available":96599166976,"internally_reserved":0,"allocated":1400832,"data_stored":615759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542211,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36712,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335128,"statfs":{"total":96636764160,"available":96599171072,"internally_reserved":0,"allocated":1396736,"data_stored":615177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542210,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37316,"kb_used_data":1964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334524,"statfs":{"total":96636764160,"available":96598552576,"internally_reserved":0,"allocated":2011136,"data_stored":1207213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542212,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36716,"kb_used_data":1368,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335124,"statfs":{"total":96636764160,"available":96599166976,"internally_reserved":0,"allocated":1400832,"data_stored":615759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:17:21.859 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T23:17:21.859 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T23:17:22.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.000+0000 7fe3092f1640 1 Processor -- start 2024-09-15T23:17:22.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.000+0000 7fe3092f1640 1 -- start start 2024-09-15T23:17:22.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.001+0000 7fe3092f1640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe30406bfd0 0x7fe30406c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:22.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.001+0000 7fe3092f1640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3041631c0 con 0x7fe3040b3350 2024-09-15T23:17:22.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.001+0000 7fe3092f1640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe30406c8f0 con 0x7fe3040d3930 2024-09-15T23:17:22.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.001+0000 7fe3092f1640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fe3040b78a0 con 0x7fe30406bfd0 2024-09-15T23:17:22.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.001+0000 7fe2fa7fc640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe3040b3350 0x7fe3041623a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40604/0 (socket says 172.21.15.123:40604) 2024-09-15T23:17:22.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.001+0000 7fe2fa7fc640 1 -- 172.21.15.123:0/580641026 learned_addr learned my addr 172.21.15.123:0/580641026 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:17:22.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.001+0000 7fe302ffd640 1 --2- 172.21.15.123:0/580641026 >> v2:172.21.15.188:3300/0 conn(0x7fe30406bfd0 0x7fe30406c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:22.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.001+0000 7fe3027fc640 1 -- 172.21.15.123:0/580641026 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 290829199 0 0) 0x7fe3041631c0 con 0x7fe3040b3350 2024-09-15T23:17:22.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.001+0000 7fe3027fc640 1 -- 172.21.15.123:0/580641026 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2f0003520 con 0x7fe3040b3350 2024-09-15T23:17:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.001+0000 7fe3027fc640 1 -- 172.21.15.123:0/580641026 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2104197532 0 0) 0x7fe2f0003520 con 0x7fe3040b3350 2024-09-15T23:17:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.001+0000 7fe3027fc640 1 -- 172.21.15.123:0/580641026 >> v2:172.21.15.188:3300/0 conn(0x7fe30406bfd0 msgr2=0x7fe30406c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.001+0000 7fe3027fc640 1 --2- 172.21.15.123:0/580641026 >> v2:172.21.15.188:3300/0 conn(0x7fe30406bfd0 0x7fe30406c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.001+0000 7fe3027fc640 1 -- 172.21.15.123:0/580641026 >> v1:172.21.15.188:6789/0 conn(0x7fe3040d3930 legacy=0x7fe304162ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.001+0000 7fe3027fc640 1 -- 172.21.15.123:0/580641026 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3040cf710 con 0x7fe3040b3350 2024-09-15T23:17:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.001+0000 7fe3027fc640 1 -- 172.21.15.123:0/580641026 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fe2ec001670 con 0x7fe3040b3350 2024-09-15T23:17:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.001+0000 7fe3027fc640 1 -- 172.21.15.123:0/580641026 >> v1:172.21.15.123:6789/0 conn(0x7fe3040b3350 legacy=0x7fe3041623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.001+0000 7fe3027fc640 1 --2- 172.21.15.123:0/580641026 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe2f00039b0 0x7fe2f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.001+0000 7fe3027fc640 1 --2- 172.21.15.123:0/580641026 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe2f0004800 0x7fe2f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.001+0000 7fe3027fc640 1 --2- 172.21.15.123:0/580641026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2f00051c0 0x7fe2f000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.001+0000 7fe3027fc640 1 -- 172.21.15.123:0/580641026 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f000c030 con 0x7fe2f00051c0 2024-09-15T23:17:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.001+0000 7fe3027fc640 1 -- 172.21.15.123:0/580641026 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f000c1e0 con 0x7fe2f0004800 2024-09-15T23:17:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.001+0000 7fe3027fc640 1 -- 172.21.15.123:0/580641026 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe2f000c3e0 con 0x7fe2f00039b0 2024-09-15T23:17:22.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.001+0000 7fe3037fe640 1 --2- 172.21.15.123:0/580641026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2f00051c0 0x7fe2f000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:22.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.002+0000 7fe302ffd640 1 --2- 172.21.15.123:0/580641026 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe2f00039b0 0x7fe2f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:22.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.002+0000 7fe2fa7fc640 1 --2- 172.21.15.123:0/580641026 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe2f0004800 0x7fe2f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:22.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.002+0000 7fe3037fe640 1 -- 172.21.15.123:0/580641026 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe2f00039b0 msgr2=0x7fe2f0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:22.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.002+0000 7fe3037fe640 1 --2- 172.21.15.123:0/580641026 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe2f00039b0 0x7fe2f0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:22.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.002+0000 7fe3037fe640 1 -- 172.21.15.123:0/580641026 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe2f0004800 msgr2=0x7fe2f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:22.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.002+0000 7fe3037fe640 1 --2- 172.21.15.123:0/580641026 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe2f0004800 0x7fe2f0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:22.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.002+0000 7fe3037fe640 1 -- 172.21.15.123:0/580641026 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f0003520 con 0x7fe2f00051c0 2024-09-15T23:17:22.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.002+0000 7fe302ffd640 1 --2- 172.21.15.123:0/580641026 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe2f00039b0 0x7fe2f0003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:17:22.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.002+0000 7fe2fa7fc640 1 --2- 172.21.15.123:0/580641026 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe2f0004800 0x7fe2f0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:17:22.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.002+0000 7fe3037fe640 1 -- 172.21.15.123:0/580641026 reap_dead start 2024-09-15T23:17:22.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.002+0000 7fe3037fe640 1 --2- 172.21.15.123:0/580641026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2f00051c0 0x7fe2f000b9c0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc001e20 tx=0x7fe2f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d0daa97643f35bf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:22.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.002+0000 7fe3027fc640 1 -- 172.21.15.123:0/580641026 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc001a70 con 0x7fe2f00051c0 2024-09-15T23:17:22.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.003+0000 7fe3027fc640 1 -- 172.21.15.123:0/580641026 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2fc02ae40 con 0x7fe2f00051c0 2024-09-15T23:17:22.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.003+0000 7fe3027fc640 1 -- 172.21.15.123:0/580641026 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc003b90 con 0x7fe2f00051c0 2024-09-15T23:17:22.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.003+0000 7fe3092f1640 1 -- 172.21.15.123:0/580641026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2f00051c0 msgr2=0x7fe2f000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:22.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.003+0000 7fe3092f1640 1 --2- 172.21.15.123:0/580641026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2f00051c0 0x7fe2f000b9c0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc001e20 tx=0x7fe2f0005830 comp rx=0 tx=0).stop 2024-09-15T23:17:22.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.003+0000 7fe3092f1640 1 -- 172.21.15.123:0/580641026 shutdown_connections 2024-09-15T23:17:22.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.003+0000 7fe3092f1640 1 --2- 172.21.15.123:0/580641026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2f00051c0 0x7fe2f000b9c0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:22.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.003+0000 7fe3092f1640 1 -- 172.21.15.123:0/580641026 >> 172.21.15.123:0/580641026 conn(0x7fe3040d11c0 msgr2=0x7fe3040d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:22.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.003+0000 7fe3092f1640 1 -- 172.21.15.123:0/580641026 shutdown_connections 2024-09-15T23:17:22.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.003+0000 7fe3092f1640 1 -- 172.21.15.123:0/580641026 wait complete. 2024-09-15T23:17:22.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.004+0000 7fe3092f1640 1 Processor -- start 2024-09-15T23:17:22.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.005+0000 7fe3092f1640 1 -- start start 2024-09-15T23:17:22.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.005+0000 7fe3092f1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe2f00051c0 0x7fe304153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:22.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.005+0000 7fe3092f1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe304159850 0x7fe304157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:22.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.005+0000 7fe3092f1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe304157bc0 0x7fe3041f4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:22.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.005+0000 7fe3092f1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe3040cfcd0 con 0x7fe304159850 2024-09-15T23:17:22.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.005+0000 7fe3092f1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe3040cffb0 con 0x7fe304157bc0 2024-09-15T23:17:22.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.005+0000 7fe3092f1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe3040d2400 con 0x7fe2f00051c0 2024-09-15T23:17:22.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.005+0000 7fe2fa7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe304159850 0x7fe304157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:22.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.005+0000 7fe2fa7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe304159850 0x7fe304157680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48256/0 (socket says 172.21.15.123:48256) 2024-09-15T23:17:22.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.005+0000 7fe2fa7fc640 1 -- 172.21.15.123:0/3621411923 learned_addr learned my addr 172.21.15.123:0/3621411923 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:22.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.006+0000 7fe2fa7fc640 1 -- 172.21.15.123:0/3621411923 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe2f00051c0 msgr2=0x7fe304153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:22.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.006+0000 7fe2fa7fc640 1 --2- 172.21.15.123:0/3621411923 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe2f00051c0 0x7fe304153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:22.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.006+0000 7fe2fa7fc640 1 -- 172.21.15.123:0/3621411923 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe304157bc0 msgr2=0x7fe3041f4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:22.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.006+0000 7fe2fa7fc640 1 --2- 172.21.15.123:0/3621411923 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe304157bc0 0x7fe3041f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:22.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.006+0000 7fe2fa7fc640 1 -- 172.21.15.123:0/3621411923 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe304158ad0 con 0x7fe304159850 2024-09-15T23:17:22.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.006+0000 7fe2fa7fc640 1 --2- 172.21.15.123:0/3621411923 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe304159850 0x7fe304157680 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec001200 tx=0x7fe2ec00ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:22.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.006+0000 7fe2fbfff640 1 -- 172.21.15.123:0/3621411923 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec00c8d0 con 0x7fe304159850 2024-09-15T23:17:22.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.006+0000 7fe2fbfff640 1 -- 172.21.15.123:0/3621411923 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2ec018070 con 0x7fe304159850 2024-09-15T23:17:22.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.006+0000 7fe2fbfff640 1 -- 172.21.15.123:0/3621411923 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec00cc70 con 0x7fe304159850 2024-09-15T23:17:22.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.006+0000 7fe3092f1640 1 -- 172.21.15.123:0/3621411923 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe304158d70 con 0x7fe304159850 2024-09-15T23:17:22.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.006+0000 7fe3092f1640 1 -- 172.21.15.123:0/3621411923 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe304159330 con 0x7fe304159850 2024-09-15T23:17:22.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.007+0000 7fe3092f1640 1 -- 172.21.15.123:0/3621411923 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe304159500 con 0x7fe304159850 2024-09-15T23:17:22.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.007+0000 7fe2fbfff640 1 -- 172.21.15.123:0/3621411923 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe2ec01d460 con 0x7fe304159850 2024-09-15T23:17:22.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.008+0000 7fe2fbfff640 1 --2- 172.21.15.123:0/3621411923 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe2e406c2b0 0x7fe2e406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:22.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.008+0000 7fe2fbfff640 1 -- 172.21.15.123:0/3621411923 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5709+0+0 (secure 0 0 0) 0x7fe2ec08b2a0 con 0x7fe304159850 2024-09-15T23:17:22.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.008+0000 7fe302ffd640 1 --2- 172.21.15.123:0/3621411923 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe2e406c2b0 0x7fe2e406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:22.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.009+0000 7fe302ffd640 1 --2- 172.21.15.123:0/3621411923 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe2e406c2b0 0x7fe2e406e770 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4009830 tx=0x7fe2f4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:22.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.012+0000 7fe2fbfff640 1 -- 172.21.15.123:0/3621411923 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe2ec059a10 con 0x7fe304159850 2024-09-15T23:17:22.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.246+0000 7fe3092f1640 1 -- 172.21.15.123:0/3621411923 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fe3040d0cf0 con 0x7fe304159850 2024-09-15T23:17:22.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.248+0000 7fe2fbfff640 1 -- 172.21.15.123:0/3621411923 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7fe2ec059310 con 0x7fe304159850 2024-09-15T23:17:22.249 INFO:teuthology.orchestra.run.smithi123.stdout:[client.0] 2024-09-15T23:17:22.249 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCNaedmzQPqJRAAhUf1dnVYohN4obCfeu8+7g== 2024-09-15T23:17:22.249 INFO:teuthology.orchestra.run.smithi123.stdout: caps mds = "allow" 2024-09-15T23:17:22.249 INFO:teuthology.orchestra.run.smithi123.stdout: caps mon = "allow r" 2024-09-15T23:17:22.249 INFO:teuthology.orchestra.run.smithi123.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T23:17:22.250 INFO:teuthology.orchestra.run.smithi123.stderr:updated caps for client.0 2024-09-15T23:17:22.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.250+0000 7fe3092f1640 1 -- 172.21.15.123:0/3621411923 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe2e406c2b0 msgr2=0x7fe2e406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:22.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.250+0000 7fe3092f1640 1 --2- 172.21.15.123:0/3621411923 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe2e406c2b0 0x7fe2e406e770 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4009830 tx=0x7fe2f4008040 comp rx=0 tx=0).stop 2024-09-15T23:17:22.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.250+0000 7fe3092f1640 1 -- 172.21.15.123:0/3621411923 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe304159850 msgr2=0x7fe304157680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:22.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.250+0000 7fe3092f1640 1 --2- 172.21.15.123:0/3621411923 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe304159850 0x7fe304157680 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec001200 tx=0x7fe2ec00ec60 comp rx=0 tx=0).stop 2024-09-15T23:17:22.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.250+0000 7fe3092f1640 1 -- 172.21.15.123:0/3621411923 shutdown_connections 2024-09-15T23:17:22.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.250+0000 7fe3092f1640 1 --2- 172.21.15.123:0/3621411923 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe304157bc0 0x7fe3041f4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:22.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.250+0000 7fe3092f1640 1 --2- 172.21.15.123:0/3621411923 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe2e406c2b0 0x7fe2e406e770 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:22.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.250+0000 7fe3092f1640 1 --2- 172.21.15.123:0/3621411923 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe304159850 0x7fe304157680 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:22.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.250+0000 7fe3092f1640 1 --2- 172.21.15.123:0/3621411923 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe2f00051c0 0x7fe304153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:22.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.250+0000 7fe3092f1640 1 -- 172.21.15.123:0/3621411923 >> 172.21.15.123:0/3621411923 conn(0x7fe3040d11c0 msgr2=0x7fe3040b61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:22.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.251+0000 7fe3092f1640 1 -- 172.21.15.123:0/3621411923 shutdown_connections 2024-09-15T23:17:22.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.251+0000 7fe3092f1640 1 -- 172.21.15.123:0/3621411923 wait complete. 2024-09-15T23:17:22.262 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:17:22.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.359+0000 7faab270c640 1 Processor -- start 2024-09-15T23:17:22.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.359+0000 7faab270c640 1 -- start start 2024-09-15T23:17:22.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.360+0000 7faab270c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7faaac145ed0 0x7faaac0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:22.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.360+0000 7faab270c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7faaac0b5f90 0x7faaac0735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:22.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.360+0000 7faab270c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaac0b4020 con 0x7faaac073180 2024-09-15T23:17:22.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.360+0000 7faab270c640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7faaac0b63d0 con 0x7faaac0b5f90 2024-09-15T23:17:22.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.360+0000 7faab270c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7faaac073b00 con 0x7faaac145ed0 2024-09-15T23:17:22.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.360+0000 7faab0ca9640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7faaac0b5f90 0x7faaac0735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:22.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.360+0000 7faab0ca9640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7faaac0b5f90 0x7faaac0735c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48266/0 (socket says 172.21.15.123:48266) 2024-09-15T23:17:22.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.360+0000 7faab0ca9640 1 -- 172.21.15.123:0/3736312654 learned_addr learned my addr 172.21.15.123:0/3736312654 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:22.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.360+0000 7faaabfff640 1 --2- 172.21.15.123:0/3736312654 >> v2:172.21.15.188:3300/0 conn(0x7faaac145ed0 0x7faaac0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:22.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.360+0000 7faab0ca9640 1 -- 172.21.15.123:0/3736312654 >> v2:172.21.15.188:3300/0 conn(0x7faaac145ed0 msgr2=0x7faaac0b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:22.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.360+0000 7faab0ca9640 1 --2- 172.21.15.123:0/3736312654 >> v2:172.21.15.188:3300/0 conn(0x7faaac145ed0 0x7faaac0b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:22.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.360+0000 7faab0ca9640 1 -- 172.21.15.123:0/3736312654 >> v1:172.21.15.188:6789/0 conn(0x7faaac073180 legacy=0x7faaac0b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:22.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.361+0000 7faab0ca9640 1 -- 172.21.15.123:0/3736312654 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaac0b42c0 con 0x7faaac0b5f90 2024-09-15T23:17:22.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.361+0000 7faab0ca9640 1 --2- 172.21.15.123:0/3736312654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaac0b5f90 0x7faaac0735c0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7faaac070080 tx=0x7faaa402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b075c43d485dcf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:22.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.361+0000 7faaab7fe640 1 -- 172.21.15.123:0/3736312654 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa4036070 con 0x7faaac0b5f90 2024-09-15T23:17:22.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.361+0000 7faaab7fe640 1 -- 172.21.15.123:0/3736312654 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaa4031600 con 0x7faaac0b5f90 2024-09-15T23:17:22.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.361+0000 7faaab7fe640 1 -- 172.21.15.123:0/3736312654 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa40319d0 con 0x7faaac0b5f90 2024-09-15T23:17:22.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.362+0000 7faab270c640 1 -- 172.21.15.123:0/3736312654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaac0b5f90 msgr2=0x7faaac0735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:22.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.362+0000 7faab270c640 1 --2- 172.21.15.123:0/3736312654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaac0b5f90 0x7faaac0735c0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7faaac070080 tx=0x7faaa402a6c0 comp rx=0 tx=0).stop 2024-09-15T23:17:22.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.362+0000 7faab270c640 1 -- 172.21.15.123:0/3736312654 shutdown_connections 2024-09-15T23:17:22.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.362+0000 7faab270c640 1 --2- 172.21.15.123:0/3736312654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaac0b5f90 0x7faaac0735c0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:22.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.362+0000 7faab270c640 1 --2- 172.21.15.123:0/3736312654 >> v2:172.21.15.188:3300/0 conn(0x7faaac145ed0 0x7faaac0b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:22.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.362+0000 7faab270c640 1 -- 172.21.15.123:0/3736312654 >> 172.21.15.123:0/3736312654 conn(0x7faaac0ccec0 msgr2=0x7faaac0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:22.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.362+0000 7faab270c640 1 -- 172.21.15.123:0/3736312654 shutdown_connections 2024-09-15T23:17:22.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.362+0000 7faab270c640 1 -- 172.21.15.123:0/3736312654 wait complete. 2024-09-15T23:17:22.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.363+0000 7faab270c640 1 Processor -- start 2024-09-15T23:17:22.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.363+0000 7faab270c640 1 -- start start 2024-09-15T23:17:22.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.364+0000 7faab270c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaac073180 0x7faaac1f3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:22.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.364+0000 7faab270c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faaac0b5f90 0x7faaac1555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:22.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.364+0000 7faab270c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faaac145ed0 0x7faaac142e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:22.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.364+0000 7faab270c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7faaac0b4b60 con 0x7faaac073180 2024-09-15T23:17:22.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.364+0000 7faab270c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7faaac0b4880 con 0x7faaac145ed0 2024-09-15T23:17:22.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.364+0000 7faab270c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7faaac1462b0 con 0x7faaac0b5f90 2024-09-15T23:17:22.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.364+0000 7faaabfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaac073180 0x7faaac1f3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:22.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.364+0000 7faaabfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaac073180 0x7faaac1f3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48276/0 (socket says 172.21.15.123:48276) 2024-09-15T23:17:22.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.364+0000 7faaabfff640 1 -- 172.21.15.123:0/1556127672 learned_addr learned my addr 172.21.15.123:0/1556127672 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:22.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.364+0000 7faab0ca9640 1 --2- 172.21.15.123:0/1556127672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faaac145ed0 0x7faaac142e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:22.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.364+0000 7faaa3fff640 1 --2- 172.21.15.123:0/1556127672 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faaac0b5f90 0x7faaac1555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:22.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.364+0000 7faaabfff640 1 -- 172.21.15.123:0/1556127672 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faaac0b5f90 msgr2=0x7faaac1555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:22.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.364+0000 7faaabfff640 1 --2- 172.21.15.123:0/1556127672 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faaac0b5f90 0x7faaac1555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:22.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.364+0000 7faaabfff640 1 -- 172.21.15.123:0/1556127672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faaac145ed0 msgr2=0x7faaac142e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:22.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.364+0000 7faaabfff640 1 --2- 172.21.15.123:0/1556127672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faaac145ed0 0x7faaac142e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:22.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.364+0000 7faaabfff640 1 -- 172.21.15.123:0/1556127672 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaac155cf0 con 0x7faaac073180 2024-09-15T23:17:22.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.364+0000 7faaa3fff640 1 --2- 172.21.15.123:0/1556127672 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faaac0b5f90 0x7faaac1555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:17:22.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.364+0000 7faaabfff640 1 --2- 172.21.15.123:0/1556127672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaac073180 0x7faaac1f3060 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7faa9c00d830 tx=0x7faa9c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:22.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.364+0000 7faaa97fa640 1 -- 172.21.15.123:0/1556127672 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9c00b6c0 con 0x7faaac073180 2024-09-15T23:17:22.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.365+0000 7faaa97fa640 1 -- 172.21.15.123:0/1556127672 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa9c019070 con 0x7faaac073180 2024-09-15T23:17:22.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.365+0000 7faab270c640 1 -- 172.21.15.123:0/1556127672 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaac155fd0 con 0x7faaac073180 2024-09-15T23:17:22.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.365+0000 7faaa97fa640 1 -- 172.21.15.123:0/1556127672 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9c00bac0 con 0x7faaac073180 2024-09-15T23:17:22.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.365+0000 7faab270c640 1 -- 172.21.15.123:0/1556127672 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaac1f2860 con 0x7faaac073180 2024-09-15T23:17:22.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.365+0000 7faab270c640 1 -- 172.21.15.123:0/1556127672 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaac0cf830 con 0x7faaac073180 2024-09-15T23:17:22.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.366+0000 7faaa97fa640 1 -- 172.21.15.123:0/1556127672 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7faa9c01e460 con 0x7faaac073180 2024-09-15T23:17:22.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.366+0000 7faaa97fa640 1 --2- 172.21.15.123:0/1556127672 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7faa8c06c2b0 0x7faa8c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:22.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.366+0000 7faaa97fa640 1 -- 172.21.15.123:0/1556127672 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5709+0+0 (secure 0 0 0) 0x7faa9c08bb80 con 0x7faaac073180 2024-09-15T23:17:22.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.367+0000 7faaa3fff640 1 --2- 172.21.15.123:0/1556127672 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7faa8c06c2b0 0x7faa8c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:22.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.367+0000 7faaa3fff640 1 --2- 172.21.15.123:0/1556127672 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7faa8c06c2b0 0x7faa8c06e770 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7faaac143620 tx=0x7faa94008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:22.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.371+0000 7faaa97fa640 1 -- 172.21.15.123:0/1556127672 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faa9c05a2f0 con 0x7faaac073180 2024-09-15T23:17:22.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.569+0000 7faab270c640 1 -- 172.21.15.123:0/1556127672 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faaac0cd860 con 0x7faaac073180 2024-09-15T23:17:22.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.570+0000 7faaa97fa640 1 -- 172.21.15.123:0/1556127672 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) ==== 94+0+5237 (secure 0 0 0) 0x7faa9c059bf0 con 0x7faaac073180 2024-09-15T23:17:22.571 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:17:22.571 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":73,"btime":"2024-09-15T23:17:16:266707+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6158,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/3864460389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3864460389},{"type":"v1","addr":"172.21.15.188:6836","nonce":3864460389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":6769,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2483934450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2483934450},{"type":"v1","addr":"172.21.15.188:6837","nonce":2483934450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7605,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/1769288917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":1769288917},{"type":"v1","addr":"172.21.15.123:6834","nonce":1769288917}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:17:13.443625+0000","modified":"2024-09-15T23:17:15.592652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7608},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7608":{"gid":7608,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/3823805081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":3823805081},{"type":"v1","addr":"172.21.15.123:6835","nonce":3823805081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7608,"qdb_cluster":[7608]},"id":7}]} 2024-09-15T23:17:22.571 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 73 2024-09-15T23:17:22.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.571+0000 7faab270c640 1 -- 172.21.15.123:0/1556127672 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7faa8c06c2b0 msgr2=0x7faa8c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:22.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.571+0000 7faab270c640 1 --2- 172.21.15.123:0/1556127672 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7faa8c06c2b0 0x7faa8c06e770 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7faaac143620 tx=0x7faa94008040 comp rx=0 tx=0).stop 2024-09-15T23:17:22.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.572+0000 7faab270c640 1 -- 172.21.15.123:0/1556127672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaac073180 msgr2=0x7faaac1f3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:22.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.572+0000 7faab270c640 1 --2- 172.21.15.123:0/1556127672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaac073180 0x7faaac1f3060 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7faa9c00d830 tx=0x7faa9c00dcf0 comp rx=0 tx=0).stop 2024-09-15T23:17:22.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.572+0000 7faab270c640 1 -- 172.21.15.123:0/1556127672 shutdown_connections 2024-09-15T23:17:22.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.572+0000 7faab270c640 1 --2- 172.21.15.123:0/1556127672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faaac145ed0 0x7faaac142e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:22.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.572+0000 7faab270c640 1 --2- 172.21.15.123:0/1556127672 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faaac0b5f90 0x7faaac1555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:22.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.572+0000 7faab270c640 1 --2- 172.21.15.123:0/1556127672 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7faa8c06c2b0 0x7faa8c06e770 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:22.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.572+0000 7faab270c640 1 --2- 172.21.15.123:0/1556127672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faaac073180 0x7faaac1f3060 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:22.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.572+0000 7faab270c640 1 -- 172.21.15.123:0/1556127672 >> 172.21.15.123:0/1556127672 conn(0x7faaac0ccec0 msgr2=0x7faaac0ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:22.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.572+0000 7faab270c640 1 -- 172.21.15.123:0/1556127672 shutdown_connections 2024-09-15T23:17:22.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:22.572+0000 7faab270c640 1 -- 172.21.15.123:0/1556127672 wait complete. 2024-09-15T23:17:22.986 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 73, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:17:13.443625+0000', 'modified': '2024-09-15T23:17:15.592652+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7608}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7608': {'gid': 7608, 'name': 'c', 'rank': 0, 'incarnation': 70, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.123:6835/3823805081', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6833', 'nonce': 3823805081}, {'type': 'v1', 'addr': '172.21.15.123:6835', 'nonce': 3823805081}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7608, 'qdb_cluster': [7608]} 2024-09-15T23:17:22.986 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:17:22.987 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-15T23:17:23.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.083+0000 7fbe7ee3c640 1 Processor -- start 2024-09-15T23:17:23.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.084+0000 7fbe7ee3c640 1 -- start start 2024-09-15T23:17:23.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.084+0000 7fbe7ee3c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbe7815ed20 0x7fbe780b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:23.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.084+0000 7fbe7ee3c640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe780d0e70 con 0x7fbe780d23b0 2024-09-15T23:17:23.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.084+0000 7fbe7ee3c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe780d00f0 con 0x7fbe780b90e0 2024-09-15T23:17:23.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.084+0000 7fbe7ee3c640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fbe780d41c0 con 0x7fbe7815ed20 2024-09-15T23:17:23.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.084+0000 7fbe7cbd8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbe7815ed20 0x7fbe780b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:23.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.084+0000 7fbe6ffff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fbe780d23b0 0x7fbe780cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40608/0 (socket says 172.21.15.123:40608) 2024-09-15T23:17:23.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.084+0000 7fbe7cbd8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbe7815ed20 0x7fbe780b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48278/0 (socket says 172.21.15.123:48278) 2024-09-15T23:17:23.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.084+0000 7fbe6ffff640 1 -- 172.21.15.123:0/3948996441 learned_addr learned my addr 172.21.15.123:0/3948996441 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:17:23.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.085+0000 7fbe7cbd8640 1 -- 172.21.15.123:0/3948996441 >> v1:172.21.15.188:6789/0 conn(0x7fbe780b90e0 legacy=0x7fbe780cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:23.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.085+0000 7fbe7cbd8640 1 -- 172.21.15.123:0/3948996441 >> v1:172.21.15.123:6789/0 conn(0x7fbe780d23b0 legacy=0x7fbe780cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:23.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.085+0000 7fbe7cbd8640 1 -- 172.21.15.123:0/3948996441 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe780d35b0 con 0x7fbe7815ed20 2024-09-15T23:17:23.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.085+0000 7fbe6f7fe640 1 -- 172.21.15.123:0/3948996441 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2848573859 0 0) 0x7fbe68001110 con 0x7fbe780d23b0 2024-09-15T23:17:23.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.085+0000 7fbe7cbd8640 1 --2- 172.21.15.123:0/3948996441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe7815ed20 0x7fbe780b6260 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fbe740097a0 tx=0x7fbe7402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c9cc7667f5b7621 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:23.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.086+0000 7fbe6f7fe640 1 -- 172.21.15.123:0/3948996441 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe74037070 con 0x7fbe7815ed20 2024-09-15T23:17:23.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.086+0000 7fbe6f7fe640 1 -- 172.21.15.123:0/3948996441 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe7402ae50 con 0x7fbe7815ed20 2024-09-15T23:17:23.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.086+0000 7fbe6f7fe640 1 -- 172.21.15.123:0/3948996441 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe74032660 con 0x7fbe7815ed20 2024-09-15T23:17:23.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.086+0000 7fbe7ee3c640 1 -- 172.21.15.123:0/3948996441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe7815ed20 msgr2=0x7fbe780b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:23.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.086+0000 7fbe7ee3c640 1 --2- 172.21.15.123:0/3948996441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe7815ed20 0x7fbe780b6260 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fbe740097a0 tx=0x7fbe7402a140 comp rx=0 tx=0).stop 2024-09-15T23:17:23.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.086+0000 7fbe7ee3c640 1 -- 172.21.15.123:0/3948996441 shutdown_connections 2024-09-15T23:17:23.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.086+0000 7fbe7ee3c640 1 --2- 172.21.15.123:0/3948996441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe7815ed20 0x7fbe780b6260 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.086+0000 7fbe7ee3c640 1 -- 172.21.15.123:0/3948996441 >> 172.21.15.123:0/3948996441 conn(0x7fbe780d1260 msgr2=0x7fbe780d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:23.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.086+0000 7fbe7ee3c640 1 -- 172.21.15.123:0/3948996441 shutdown_connections 2024-09-15T23:17:23.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.086+0000 7fbe7ee3c640 1 -- 172.21.15.123:0/3948996441 wait complete. 2024-09-15T23:17:23.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.087+0000 7fbe7ee3c640 1 Processor -- start 2024-09-15T23:17:23.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.087+0000 7fbe7ee3c640 1 -- start start 2024-09-15T23:17:23.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.088+0000 7fbe7ee3c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe780b90e0 0x7fbe7815b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:23.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.088+0000 7fbe7ee3c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbe780d23b0 0x7fbe780ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:23.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.088+0000 7fbe7ee3c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbe7815ed20 0x7fbe780cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:23.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.088+0000 7fbe7ee3c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbe780d3e50 con 0x7fbe780b90e0 2024-09-15T23:17:23.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.088+0000 7fbe7ee3c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbe780d3b70 con 0x7fbe7815ed20 2024-09-15T23:17:23.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.088+0000 7fbe7ee3c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbe780d32a0 con 0x7fbe780d23b0 2024-09-15T23:17:23.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.088+0000 7fbe7cbd8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe780b90e0 0x7fbe7815b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:23.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.088+0000 7fbe7cbd8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe780b90e0 0x7fbe7815b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48280/0 (socket says 172.21.15.123:48280) 2024-09-15T23:17:23.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.088+0000 7fbe7cbd8640 1 -- 172.21.15.123:0/2418975479 learned_addr learned my addr 172.21.15.123:0/2418975479 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:23.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.089+0000 7fbe7cbd8640 1 -- 172.21.15.123:0/2418975479 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbe780d23b0 msgr2=0x7fbe780ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:23.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.089+0000 7fbe7cbd8640 1 --2- 172.21.15.123:0/2418975479 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbe780d23b0 0x7fbe780ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.089+0000 7fbe7cbd8640 1 -- 172.21.15.123:0/2418975479 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbe7815ed20 msgr2=0x7fbe780cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:23.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.089+0000 7fbe7cbd8640 1 --2- 172.21.15.123:0/2418975479 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbe7815ed20 0x7fbe780cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.089+0000 7fbe7cbd8640 1 -- 172.21.15.123:0/2418975479 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe780cd3b0 con 0x7fbe780b90e0 2024-09-15T23:17:23.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.089+0000 7fbe7cbd8640 1 --2- 172.21.15.123:0/2418975479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe780b90e0 0x7fbe7815b880 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fbe740098c0 tx=0x7fbe740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:23.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.089+0000 7fbe6d7fa640 1 -- 172.21.15.123:0/2418975479 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe74042070 con 0x7fbe780b90e0 2024-09-15T23:17:23.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.089+0000 7fbe6d7fa640 1 -- 172.21.15.123:0/2418975479 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe7403e670 con 0x7fbe780b90e0 2024-09-15T23:17:23.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.089+0000 7fbe6d7fa640 1 -- 172.21.15.123:0/2418975479 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe74037040 con 0x7fbe780b90e0 2024-09-15T23:17:23.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.089+0000 7fbe7ee3c640 1 -- 172.21.15.123:0/2418975479 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe780cd690 con 0x7fbe780b90e0 2024-09-15T23:17:23.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.089+0000 7fbe7ee3c640 1 -- 172.21.15.123:0/2418975479 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe780cb580 con 0x7fbe780b90e0 2024-09-15T23:17:23.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.090+0000 7fbe6d7fa640 1 -- 172.21.15.123:0/2418975479 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbe74045070 con 0x7fbe780b90e0 2024-09-15T23:17:23.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.091+0000 7fbe6d7fa640 1 --2- 172.21.15.123:0/2418975479 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbe6406c2b0 0x7fbe6406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:23.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.091+0000 7fbe6d7fa640 1 -- 172.21.15.123:0/2418975479 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5709+0+0 (secure 0 0 0) 0x7fbe740abf50 con 0x7fbe780b90e0 2024-09-15T23:17:23.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.091+0000 7fbe6ffff640 1 --2- 172.21.15.123:0/2418975479 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbe6406c2b0 0x7fbe6406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:23.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.092+0000 7fbe6ffff640 1 --2- 172.21.15.123:0/2418975479 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbe6406c2b0 0x7fbe6406e770 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fbe780c83a0 tx=0x7fbe68001310 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:23.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.092+0000 7fbe81bd5740 1 Processor -- start 2024-09-15T23:17:23.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.092+0000 7fbe81bd5740 1 -- start start 2024-09-15T23:17:23.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.093+0000 7fbe81bd5740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a4554782c0 0x55a4554bda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:23.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.093+0000 7fbe81bd5740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55a455475a80 0x55a4554786a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:23.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.093+0000 7fbe81bd5740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a455479a50 0x55a4554728b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:23.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.093+0000 7fbe81bd5740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55a4553da520 con 0x55a4554782c0 2024-09-15T23:17:23.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.093+0000 7fbe81bd5740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55a4553823e0 con 0x55a455479a50 2024-09-15T23:17:23.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.093+0000 7fbe81bd5740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55a4553d64e0 con 0x55a455475a80 2024-09-15T23:17:23.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.093+0000 7fbe7cbd8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a4554782c0 0x55a4554bda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:23.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.093+0000 7fbe7cbd8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a4554782c0 0x55a4554bda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48282/0 (socket says 172.21.15.123:48282) 2024-09-15T23:17:23.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.093+0000 7fbe7cbd8640 1 -- 172.21.15.123:0/43317469 learned_addr learned my addr 172.21.15.123:0/43317469 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:23.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.093+0000 7fbe6ffff640 1 --2- 172.21.15.123:0/43317469 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55a455475a80 0x55a4554786a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:23.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.093+0000 7fbe7d3d9640 1 --2- 172.21.15.123:0/43317469 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a455479a50 0x55a4554728b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:23.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.093+0000 7fbe7cbd8640 1 -- 172.21.15.123:0/43317469 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55a455475a80 msgr2=0x55a4554786a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:23.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.093+0000 7fbe7cbd8640 1 --2- 172.21.15.123:0/43317469 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55a455475a80 0x55a4554786a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.093+0000 7fbe7cbd8640 1 -- 172.21.15.123:0/43317469 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a455479a50 msgr2=0x55a4554728b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:23.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.093+0000 7fbe7cbd8640 1 --2- 172.21.15.123:0/43317469 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a455479a50 0x55a4554728b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.093+0000 7fbe7cbd8640 1 -- 172.21.15.123:0/43317469 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a45539d2f0 con 0x55a4554782c0 2024-09-15T23:17:23.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.093+0000 7fbe6ffff640 1 --2- 172.21.15.123:0/43317469 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55a455475a80 0x55a4554786a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:17:23.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.093+0000 7fbe7d3d9640 1 --2- 172.21.15.123:0/43317469 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a455479a50 0x55a4554728b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:17:23.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.093+0000 7fbe7cbd8640 1 --2- 172.21.15.123:0/43317469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a4554782c0 0x55a4554bda60 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fbe740aa320 tx=0x7fbe740799a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9d8cb19a89cd5ef server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:23.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.093+0000 7fbe5e7fc640 1 -- 172.21.15.123:0/43317469 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7404c070 con 0x55a4554782c0 2024-09-15T23:17:23.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.093+0000 7fbe5e7fc640 1 -- 172.21.15.123:0/43317469 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe7402ae50 con 0x55a4554782c0 2024-09-15T23:17:23.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.093+0000 7fbe5e7fc640 1 -- 172.21.15.123:0/43317469 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7407e3f0 con 0x55a4554782c0 2024-09-15T23:17:23.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.094+0000 7fbe81bd5740 1 -- 172.21.15.123:0/43317469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a4554782c0 msgr2=0x55a4554bda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:23.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.094+0000 7fbe81bd5740 1 --2- 172.21.15.123:0/43317469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a4554782c0 0x55a4554bda60 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fbe740aa320 tx=0x7fbe740799a0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.094+0000 7fbe81bd5740 1 -- 172.21.15.123:0/43317469 shutdown_connections 2024-09-15T23:17:23.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.094+0000 7fbe81bd5740 1 --2- 172.21.15.123:0/43317469 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a455479a50 0x55a4554728b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.094+0000 7fbe81bd5740 1 --2- 172.21.15.123:0/43317469 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55a455475a80 0x55a4554786a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.094+0000 7fbe81bd5740 1 --2- 172.21.15.123:0/43317469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a4554782c0 0x55a4554bda60 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.094+0000 7fbe81bd5740 1 -- 172.21.15.123:0/43317469 >> 172.21.15.123:0/43317469 conn(0x55a455474a80 msgr2=0x55a4554bcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:23.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.094+0000 7fbe81bd5740 1 -- 172.21.15.123:0/43317469 shutdown_connections 2024-09-15T23:17:23.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.094+0000 7fbe81bd5740 1 -- 172.21.15.123:0/43317469 wait complete. 2024-09-15T23:17:23.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.095+0000 7fbe81bd5740 1 -- start start 2024-09-15T23:17:23.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.095+0000 7fbe81bd5740 1 Processor -- start 2024-09-15T23:17:23.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.096+0000 7fbe81bd5740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55a4554782c0 0x55a455472a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:23.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.096+0000 7fbe81bd5740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a455479a50 0x55a455476a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:23.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.096+0000 7fbe81bd5740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a455476f50 0x55a455496a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:23.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.096+0000 7fbe81bd5740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55a455473f20 con 0x55a455479a50 2024-09-15T23:17:23.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.096+0000 7fbe81bd5740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55a455363450 con 0x55a455476f50 2024-09-15T23:17:23.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.096+0000 7fbe81bd5740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55a4554be290 con 0x55a4554782c0 2024-09-15T23:17:23.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.096+0000 7fbe81bd5740 10 client.0 _ll_register_callbacks cb 0x55a4550ecac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:17:23.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.096+0000 7fbe6ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a455479a50 0x55a455476a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:23.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.096+0000 7fbe6ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a455479a50 0x55a455476a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48286/0 (socket says 172.21.15.123:48286) 2024-09-15T23:17:23.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.096+0000 7fbe6ffff640 1 -- 172.21.15.123:0/638981997 learned_addr learned my addr 172.21.15.123:0/638981997 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:23.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.096+0000 7fbe7d3d9640 1 --2- 172.21.15.123:0/638981997 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a455476f50 0x55a455496a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:23.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.096+0000 7fbe7cbd8640 1 --2- 172.21.15.123:0/638981997 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55a4554782c0 0x55a455472a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:23.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.096+0000 7fbe6ffff640 1 -- 172.21.15.123:0/638981997 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55a4554782c0 msgr2=0x55a455472a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:23.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.096+0000 7fbe6ffff640 1 --2- 172.21.15.123:0/638981997 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55a4554782c0 0x55a455472a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.096+0000 7fbe6ffff640 1 -- 172.21.15.123:0/638981997 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a455476f50 msgr2=0x55a455496a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:23.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.096+0000 7fbe6ffff640 1 --2- 172.21.15.123:0/638981997 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a455476f50 0x55a455496a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.096+0000 7fbe6ffff640 1 -- 172.21.15.123:0/638981997 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4550ed2d0 con 0x55a455479a50 2024-09-15T23:17:23.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.096+0000 7fbe6ffff640 1 --2- 172.21.15.123:0/638981997 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a455479a50 0x55a455476a10 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fbe68005da0 tx=0x7fbe68001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df508aa2443cb007 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:23.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.096+0000 7fbe577fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:17:23.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.096+0000 7fbe577fe640 1 -- 172.21.15.123:0/638981997 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe68012640 con 0x55a455479a50 2024-09-15T23:17:23.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.096+0000 7fbe577fe640 1 -- 172.21.15.123:0/638981997 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 5709+0+0 (secure 0 0 0) 0x7fbe68022ad0 con 0x55a455479a50 2024-09-15T23:17:23.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.096+0000 7fbe81bd5740 1 -- 172.21.15.123:0/638981997 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe7402ae50 con 0x55a455479a50 2024-09-15T23:17:23.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.097+0000 7fbe577fe640 1 -- 172.21.15.123:0/638981997 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7fbe680076a0 con 0x55a455479a50 2024-09-15T23:17:23.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.097+0000 7fbe81bd5740 10 client.7767 fetch_fsmap learned FSMap version 73 2024-09-15T23:17:23.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.097+0000 7fbe81bd5740 1 -- 172.21.15.123:0/638981997 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) -- 0x55a4551b76b0 con 0x55a455479a50 2024-09-15T23:17:23.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.097+0000 7fbe577fe640 1 -- 172.21.15.123:0/638981997 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe7402ae50 con 0x55a455479a50 2024-09-15T23:17:23.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.097+0000 7fbe577fe640 1 -- 172.21.15.123:0/638981997 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 73) ==== 3502+0+0 (secure 0 0 0) 0x7fbe68029050 con 0x55a455479a50 2024-09-15T23:17:23.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.097+0000 7fbe81bd5740 10 client.7767 fetch_fsmap finished waiting for FSMap version 73 2024-09-15T23:17:23.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.097+0000 7fbe81bd5740 10 client.7767 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T23:17:23.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.097+0000 7fbe81bd5740 20 client.7767 populate_metadata read hostname 'smithi123' 2024-09-15T23:17:23.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.097+0000 7fbe81bd5740 1 --2- 172.21.15.123:0/638981997 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x55a4554982b0 0x55a4554718c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:23.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.097+0000 7fbe81bd5740 4 client.7767 mds_command: new command op to 7608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:17:23.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.097+0000 7fbe81bd5740 1 -- 172.21.15.123:0/638981997 --> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a4553e7c50 con 0x55a4554982b0 2024-09-15T23:17:23.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.097+0000 7fbe7cbd8640 1 --2- 172.21.15.123:0/638981997 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x55a4554982b0 0x55a4554718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:23.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.097+0000 7fbe577fe640 10 client.7767 ms_handle_connect on v2:172.21.15.123:6833/3823805081 2024-09-15T23:17:23.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.097+0000 7fbe7cbd8640 1 --2- 172.21.15.123:0/638981997 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x55a4554982b0 0x55a4554718c0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7607de94a52e15bd server_cookie=4a94f79cc9c5fbd6 in_seq=0 out_seq=0 2024-09-15T23:17:23.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.098+0000 7fbe577fe640 1 -- 172.21.15.123:0/638981997 <== mds.0 v2:172.21.15.123:6833/3823805081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a4553e7c50 con 0x55a4554982b0 2024-09-15T23:17:23.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.098+0000 7fbe577fe640 10 client.7767 handle_command_reply: tid=0 2024-09-15T23:17:23.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.098+0000 7fbe81bd5740 1 client.7767 shutdown 2024-09-15T23:17:23.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.098+0000 7fbe81bd5740 1 -- 172.21.15.123:0/638981997 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a455479a50 msgr2=0x55a455476a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:23.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.098+0000 7fbe81bd5740 1 --2- 172.21.15.123:0/638981997 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a455479a50 0x55a455476a10 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fbe68005da0 tx=0x7fbe68001080 comp rx=0 tx=0).stop 2024-09-15T23:17:23.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.098+0000 7fbe81bd5740 1 -- 172.21.15.123:0/638981997 shutdown_connections 2024-09-15T23:17:23.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.098+0000 7fbe81bd5740 1 --2- 172.21.15.123:0/638981997 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x55a4554982b0 0x55a4554718c0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.098+0000 7fbe81bd5740 1 --2- 172.21.15.123:0/638981997 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a455476f50 0x55a455496a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.098+0000 7fbe81bd5740 1 --2- 172.21.15.123:0/638981997 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a455479a50 0x55a455476a10 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.098+0000 7fbe577fe640 0 client.7767 ms_handle_reset on v2:172.21.15.123:6833/3823805081 2024-09-15T23:17:23.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.098+0000 7fbe81bd5740 1 --2- 172.21.15.123:0/638981997 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55a4554782c0 0x55a455472a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.098+0000 7fbe81bd5740 1 -- 172.21.15.123:0/638981997 >> 172.21.15.123:0/638981997 conn(0x55a455475a80 msgr2=0x55a4554bc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:23.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.098+0000 7fbe81bd5740 1 -- 172.21.15.123:0/638981997 shutdown_connections 2024-09-15T23:17:23.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.098+0000 7fbe81bd5740 1 -- 172.21.15.123:0/638981997 wait complete. 2024-09-15T23:17:23.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.098+0000 7fbe81bd5740 20 client.7767 trim_cache size 0 max 16384 2024-09-15T23:17:23.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.116+0000 7fbe81bd5740 1 Processor -- start 2024-09-15T23:17:23.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.116+0000 7fbe81bd5740 1 -- start start 2024-09-15T23:17:23.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.117+0000 7fbe81bd5740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a455476f50 0x55a4554e12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:23.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.117+0000 7fbe81bd5740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a4554782c0 0x55a4554bafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:23.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.117+0000 7fbe81bd5740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55a455479a50 0x55a4554bb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:23.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.117+0000 7fbe81bd5740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbe780c9160 con 0x55a4554782c0 2024-09-15T23:17:23.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.117+0000 7fbe81bd5740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbe780ce150 con 0x55a455476f50 2024-09-15T23:17:23.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.117+0000 7fbe81bd5740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbe780c9c00 con 0x55a455479a50 2024-09-15T23:17:23.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.117+0000 7fbe6ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a4554782c0 0x55a4554bafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:23.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.117+0000 7fbe6ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a4554782c0 0x55a4554bafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48292/0 (socket says 172.21.15.123:48292) 2024-09-15T23:17:23.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.117+0000 7fbe6ffff640 1 -- 172.21.15.123:0/1974746197 learned_addr learned my addr 172.21.15.123:0/1974746197 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:23.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.117+0000 7fbe7cbd8640 1 --2- 172.21.15.123:0/1974746197 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a455476f50 0x55a4554e12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:23.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.117+0000 7fbe7d3d9640 1 --2- 172.21.15.123:0/1974746197 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55a455479a50 0x55a4554bb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:23.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.117+0000 7fbe6ffff640 1 -- 172.21.15.123:0/1974746197 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55a455479a50 msgr2=0x55a4554bb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:23.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.117+0000 7fbe6ffff640 1 --2- 172.21.15.123:0/1974746197 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55a455479a50 0x55a4554bb4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.117+0000 7fbe6ffff640 1 -- 172.21.15.123:0/1974746197 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a455476f50 msgr2=0x55a4554e12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:23.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.117+0000 7fbe6ffff640 1 --2- 172.21.15.123:0/1974746197 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a455476f50 0x55a4554e12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.117+0000 7fbe6ffff640 1 -- 172.21.15.123:0/1974746197 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a455476d80 con 0x55a4554782c0 2024-09-15T23:17:23.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.117+0000 7fbe7d3d9640 1 --2- 172.21.15.123:0/1974746197 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55a455479a50 0x55a4554bb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:17:23.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.117+0000 7fbe6ffff640 1 --2- 172.21.15.123:0/1974746197 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a4554782c0 0x55a4554bafb0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fbe6800c100 tx=0x7fbe6801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b38aa613d913033 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:23.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.117+0000 7fbe5dffb640 1 -- 172.21.15.123:0/1974746197 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6802b770 con 0x55a4554782c0 2024-09-15T23:17:23.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.117+0000 7fbe5dffb640 1 -- 172.21.15.123:0/1974746197 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe6802b910 con 0x55a4554782c0 2024-09-15T23:17:23.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.117+0000 7fbe5dffb640 1 -- 172.21.15.123:0/1974746197 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6802bd40 con 0x55a4554782c0 2024-09-15T23:17:23.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.118+0000 7fbe81bd5740 1 -- 172.21.15.123:0/1974746197 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a4554782c0 msgr2=0x55a4554bafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:23.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.118+0000 7fbe81bd5740 1 --2- 172.21.15.123:0/1974746197 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a4554782c0 0x55a4554bafb0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fbe6800c100 tx=0x7fbe6801c000 comp rx=0 tx=0).stop 2024-09-15T23:17:23.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.118+0000 7fbe81bd5740 1 -- 172.21.15.123:0/1974746197 shutdown_connections 2024-09-15T23:17:23.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.118+0000 7fbe81bd5740 1 --2- 172.21.15.123:0/1974746197 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55a455479a50 0x55a4554bb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.118+0000 7fbe81bd5740 1 --2- 172.21.15.123:0/1974746197 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a4554782c0 0x55a4554bafb0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.118+0000 7fbe81bd5740 1 --2- 172.21.15.123:0/1974746197 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a455476f50 0x55a4554e12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.118+0000 7fbe81bd5740 1 -- 172.21.15.123:0/1974746197 >> 172.21.15.123:0/1974746197 conn(0x55a455475a80 msgr2=0x55a4554cfca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:23.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.118+0000 7fbe81bd5740 1 -- 172.21.15.123:0/1974746197 shutdown_connections 2024-09-15T23:17:23.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.118+0000 7fbe81bd5740 1 -- 172.21.15.123:0/1974746197 wait complete. 2024-09-15T23:17:23.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.118+0000 7fbe81bd5740 1 -- start start 2024-09-15T23:17:23.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.119+0000 7fbe81bd5740 1 Processor -- start 2024-09-15T23:17:23.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.119+0000 7fbe81bd5740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55a455476f50 0x55a455531c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:23.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.119+0000 7fbe81bd5740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a4554782c0 0x55a4554e0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:23.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.119+0000 7fbe81bd5740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a455479a50 0x55a4554e0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:23.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.119+0000 7fbe81bd5740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55a455473350 con 0x55a4554782c0 2024-09-15T23:17:23.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.119+0000 7fbe81bd5740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55a4554a2060 con 0x55a455479a50 2024-09-15T23:17:23.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.119+0000 7fbe81bd5740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55a4554a14d0 con 0x55a455476f50 2024-09-15T23:17:23.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.119+0000 7fbe81bd5740 10 client.0 _ll_register_callbacks cb 0x7fbe68005a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:17:23.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.119+0000 7fbe6ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a4554782c0 0x55a4554e0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:23.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.119+0000 7fbe6ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a4554782c0 0x55a4554e0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48298/0 (socket says 172.21.15.123:48298) 2024-09-15T23:17:23.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.119+0000 7fbe6ffff640 1 -- 172.21.15.123:0/366759273 learned_addr learned my addr 172.21.15.123:0/366759273 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:23.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.120+0000 7fbe7cbd8640 1 --2- 172.21.15.123:0/366759273 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55a455476f50 0x55a455531c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:23.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.120+0000 7fbe7d3d9640 1 --2- 172.21.15.123:0/366759273 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a455479a50 0x55a4554e0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:23.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.120+0000 7fbe6ffff640 1 -- 172.21.15.123:0/366759273 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55a455476f50 msgr2=0x55a455531c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:23.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.120+0000 7fbe6ffff640 1 --2- 172.21.15.123:0/366759273 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55a455476f50 0x55a455531c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.120+0000 7fbe6ffff640 1 -- 172.21.15.123:0/366759273 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a455479a50 msgr2=0x55a4554e0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:23.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.120+0000 7fbe6ffff640 1 --2- 172.21.15.123:0/366759273 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a455479a50 0x55a4554e0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.120+0000 7fbe6ffff640 1 -- 172.21.15.123:0/366759273 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4555321b0 con 0x55a4554782c0 2024-09-15T23:17:23.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.120+0000 7fbe6ffff640 1 --2- 172.21.15.123:0/366759273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a4554782c0 0x55a4554e0120 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fbe68015fd0 tx=0x7fbe68016070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=120c20f6ec604090 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:23.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.120+0000 7fbe577fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:17:23.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.120+0000 7fbe577fe640 1 -- 172.21.15.123:0/366759273 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe68012850 con 0x55a4554782c0 2024-09-15T23:17:23.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.120+0000 7fbe577fe640 1 -- 172.21.15.123:0/366759273 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 5709+0+0 (secure 0 0 0) 0x7fbe6803dac0 con 0x55a4554782c0 2024-09-15T23:17:23.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.120+0000 7fbe81bd5740 1 -- 172.21.15.123:0/366759273 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe6802b910 con 0x55a4554782c0 2024-09-15T23:17:23.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.120+0000 7fbe577fe640 1 -- 172.21.15.123:0/366759273 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7fbe68014c90 con 0x55a4554782c0 2024-09-15T23:17:23.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.120+0000 7fbe81bd5740 10 client.7773 fetch_fsmap learned FSMap version 73 2024-09-15T23:17:23.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.120+0000 7fbe81bd5740 1 -- 172.21.15.123:0/366759273 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) -- 0x55a4554960b0 con 0x55a4554782c0 2024-09-15T23:17:23.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.120+0000 7fbe577fe640 1 -- 172.21.15.123:0/366759273 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe6802b910 con 0x55a4554782c0 2024-09-15T23:17:23.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.120+0000 7fbe577fe640 1 -- 172.21.15.123:0/366759273 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 73) ==== 3502+0+0 (secure 0 0 0) 0x7fbe68029040 con 0x55a4554782c0 2024-09-15T23:17:23.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.120+0000 7fbe81bd5740 10 client.7773 fetch_fsmap finished waiting for FSMap version 73 2024-09-15T23:17:23.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.120+0000 7fbe81bd5740 10 client.7773 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T23:17:23.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.120+0000 7fbe81bd5740 20 client.7773 populate_metadata read hostname 'smithi123' 2024-09-15T23:17:23.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.121+0000 7fbe81bd5740 1 --2- 172.21.15.123:0/366759273 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x55a45553b710 0x55a45553baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:23.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.121+0000 7fbe81bd5740 4 client.7773 mds_command: new command op to 7608 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:17:23.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.121+0000 7fbe81bd5740 1 -- 172.21.15.123:0/366759273 --> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] -- command(tid 0: {"prefix": "status"}) -- 0x55a4553e1fa0 con 0x55a45553b710 2024-09-15T23:17:23.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.121+0000 7fbe7cbd8640 1 --2- 172.21.15.123:0/366759273 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x55a45553b710 0x55a45553baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:23.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.121+0000 7fbe577fe640 10 client.7773 ms_handle_connect on v2:172.21.15.123:6833/3823805081 2024-09-15T23:17:23.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.121+0000 7fbe7cbd8640 1 --2- 172.21.15.123:0/366759273 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x55a45553b710 0x55a45553baf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e60028e6910ce8 server_cookie=f94ca2bac7708ce9 in_seq=0 out_seq=0 2024-09-15T23:17:23.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.121+0000 7fbe577fe640 1 -- 172.21.15.123:0/366759273 <== mds.0 v2:172.21.15.123:6833/3823805081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55a4553e1fa0 con 0x55a45553b710 2024-09-15T23:17:23.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.121+0000 7fbe577fe640 10 client.7773 handle_command_reply: tid=0 2024-09-15T23:17:23.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.121+0000 7fbe81bd5740 1 client.7773 shutdown 2024-09-15T23:17:23.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.121+0000 7fbe81bd5740 1 -- 172.21.15.123:0/366759273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a4554782c0 msgr2=0x55a4554e0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:23.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.121+0000 7fbe81bd5740 1 --2- 172.21.15.123:0/366759273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a4554782c0 0x55a4554e0120 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fbe68015fd0 tx=0x7fbe68016070 comp rx=0 tx=0).stop 2024-09-15T23:17:23.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.121+0000 7fbe81bd5740 1 -- 172.21.15.123:0/366759273 shutdown_connections 2024-09-15T23:17:23.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.121+0000 7fbe81bd5740 1 --2- 172.21.15.123:0/366759273 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x55a45553b710 0x55a45553baf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.121+0000 7fbe81bd5740 1 --2- 172.21.15.123:0/366759273 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55a455479a50 0x55a4554e0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.121+0000 7fbe81bd5740 1 --2- 172.21.15.123:0/366759273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a4554782c0 0x55a4554e0120 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.121+0000 7fbe577fe640 0 client.7773 ms_handle_reset on v2:172.21.15.123:6833/3823805081 2024-09-15T23:17:23.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.121+0000 7fbe81bd5740 1 --2- 172.21.15.123:0/366759273 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55a455476f50 0x55a455531c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.121+0000 7fbe81bd5740 1 -- 172.21.15.123:0/366759273 >> 172.21.15.123:0/366759273 conn(0x55a455475a80 msgr2=0x55a4554c0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:23.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.121+0000 7fbe81bd5740 1 -- 172.21.15.123:0/366759273 shutdown_connections 2024-09-15T23:17:23.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.121+0000 7fbe81bd5740 1 -- 172.21.15.123:0/366759273 wait complete. 2024-09-15T23:17:23.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.121+0000 7fbe81bd5740 20 client.7773 trim_cache size 0 max 16384 2024-09-15T23:17:23.131 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:17:23.131 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "cb968ac4-8d3a-4b17-a673-6177aeaea589", 2024-09-15T23:17:23.131 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2024-09-15T23:17:23.131 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 7608, 2024-09-15T23:17:23.131 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-09-15T23:17:23.131 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-09-15T23:17:23.131 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-09-15T23:17:23.131 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 9.0033619999999992, 2024-09-15T23:17:23.131 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 73, 2024-09-15T23:17:23.131 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 114, 2024-09-15T23:17:23.131 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 114, 2024-09-15T23:17:23.132 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 13.087700954000001 2024-09-15T23:17:23.132 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:17:23.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.122+0000 7fbe7ee3c640 1 -- 172.21.15.123:0/2418975479 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbe6406c2b0 msgr2=0x7fbe6406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:23.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.122+0000 7fbe7ee3c640 1 --2- 172.21.15.123:0/2418975479 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbe6406c2b0 0x7fbe6406e770 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fbe780c83a0 tx=0x7fbe68001310 comp rx=0 tx=0).stop 2024-09-15T23:17:23.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.122+0000 7fbe7ee3c640 1 -- 172.21.15.123:0/2418975479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe780b90e0 msgr2=0x7fbe7815b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:23.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.122+0000 7fbe7ee3c640 1 --2- 172.21.15.123:0/2418975479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe780b90e0 0x7fbe7815b880 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fbe740098c0 tx=0x7fbe740046c0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.122+0000 7fbe7ee3c640 1 -- 172.21.15.123:0/2418975479 shutdown_connections 2024-09-15T23:17:23.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.122+0000 7fbe7ee3c640 1 --2- 172.21.15.123:0/2418975479 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbe7815ed20 0x7fbe780cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.122+0000 7fbe7ee3c640 1 --2- 172.21.15.123:0/2418975479 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbe780d23b0 0x7fbe780ca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.122+0000 7fbe7ee3c640 1 --2- 172.21.15.123:0/2418975479 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbe6406c2b0 0x7fbe6406e770 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.122+0000 7fbe7ee3c640 1 --2- 172.21.15.123:0/2418975479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe780b90e0 0x7fbe7815b880 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.122+0000 7fbe7ee3c640 1 -- 172.21.15.123:0/2418975479 >> 172.21.15.123:0/2418975479 conn(0x7fbe780d1260 msgr2=0x7fbe7815dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:23.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.122+0000 7fbe7ee3c640 1 -- 172.21.15.123:0/2418975479 shutdown_connections 2024-09-15T23:17:23.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.122+0000 7fbe7ee3c640 1 -- 172.21.15.123:0/2418975479 wait complete. 2024-09-15T23:17:23.135 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:17:23.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.230+0000 7f0e25423640 1 Processor -- start 2024-09-15T23:17:23.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.230+0000 7f0e25423640 1 -- start start 2024-09-15T23:17:23.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.231+0000 7f0e25423640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0e200d23b0 0x7f0e200b87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:23.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.231+0000 7f0e25423640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e200d0e70 con 0x7f0e200b6970 2024-09-15T23:17:23.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.231+0000 7f0e25423640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e200d41c0 con 0x7f0e2015ed20 2024-09-15T23:17:23.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.231+0000 7f0e25423640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f0e200d35b0 con 0x7f0e200d23b0 2024-09-15T23:17:23.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.231+0000 7f0e167fc640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f0e200b6970 0x7f0e200b80d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40622/0 (socket says 172.21.15.123:40622) 2024-09-15T23:17:23.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.231+0000 7f0e1f7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0e200d23b0 0x7f0e200b87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:23.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.231+0000 7f0e167fc640 1 -- 172.21.15.123:0/2492328950 learned_addr learned my addr 172.21.15.123:0/2492328950 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:17:23.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.231+0000 7f0e1f7fe640 1 -- 172.21.15.123:0/2492328950 >> v1:172.21.15.188:6789/0 conn(0x7f0e2015ed20 legacy=0x7f0e200b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:23.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.231+0000 7f0e1f7fe640 1 -- 172.21.15.123:0/2492328950 >> v1:172.21.15.123:6789/0 conn(0x7f0e200b6970 legacy=0x7f0e200b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:23.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.231+0000 7f0e1e7fc640 1 -- 172.21.15.123:0/2492328950 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1864827190 0 0) 0x7f0e08001110 con 0x7f0e200b6970 2024-09-15T23:17:23.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.231+0000 7f0e1f7fe640 1 -- 172.21.15.123:0/2492328950 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e200d3890 con 0x7f0e200d23b0 2024-09-15T23:17:23.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.232+0000 7f0e1f7fe640 1 --2- 172.21.15.123:0/2492328950 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e200d23b0 0x7f0e200b87e0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009d90 tx=0x7f0e1802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b96b2c0cf0882e24 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:23.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.232+0000 7f0e1e7fc640 1 -- 172.21.15.123:0/2492328950 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e18031600 con 0x7f0e200d23b0 2024-09-15T23:17:23.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.232+0000 7f0e1e7fc640 1 -- 172.21.15.123:0/2492328950 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e180317a0 con 0x7f0e200d23b0 2024-09-15T23:17:23.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.232+0000 7f0e1e7fc640 1 -- 172.21.15.123:0/2492328950 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e18031b70 con 0x7f0e200d23b0 2024-09-15T23:17:23.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.233+0000 7f0e25423640 1 -- 172.21.15.123:0/2492328950 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e200d23b0 msgr2=0x7f0e200b87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:23.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.233+0000 7f0e25423640 1 --2- 172.21.15.123:0/2492328950 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e200d23b0 0x7f0e200b87e0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009d90 tx=0x7f0e1802a610 comp rx=0 tx=0).stop 2024-09-15T23:17:23.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.233+0000 7f0e25423640 1 -- 172.21.15.123:0/2492328950 shutdown_connections 2024-09-15T23:17:23.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.233+0000 7f0e25423640 1 --2- 172.21.15.123:0/2492328950 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e200d23b0 0x7f0e200b87e0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.233+0000 7f0e25423640 1 -- 172.21.15.123:0/2492328950 >> 172.21.15.123:0/2492328950 conn(0x7f0e200d1260 msgr2=0x7f0e200d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:23.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.233+0000 7f0e25423640 1 -- 172.21.15.123:0/2492328950 shutdown_connections 2024-09-15T23:17:23.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.233+0000 7f0e25423640 1 -- 172.21.15.123:0/2492328950 wait complete. 2024-09-15T23:17:23.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.234+0000 7f0e25423640 1 Processor -- start 2024-09-15T23:17:23.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.234+0000 7f0e25423640 1 -- start start 2024-09-15T23:17:23.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.235+0000 7f0e25423640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0e200b6970 0x7f0e201f5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:23.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.235+0000 7f0e25423640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0e200d23b0 0x7f0e201577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:23.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.235+0000 7f0e25423640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e2015ed20 0x7f0e20157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:23.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.235+0000 7f0e25423640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0e200d32a0 con 0x7f0e2015ed20 2024-09-15T23:17:23.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.235+0000 7f0e25423640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0e200d3e50 con 0x7f0e200d23b0 2024-09-15T23:17:23.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.235+0000 7f0e25423640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0e2015f100 con 0x7f0e200b6970 2024-09-15T23:17:23.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.235+0000 7f0e1f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e2015ed20 0x7f0e20157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:23.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.235+0000 7f0e1f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e2015ed20 0x7f0e20157d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48308/0 (socket says 172.21.15.123:48308) 2024-09-15T23:17:23.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.235+0000 7f0e1f7fe640 1 -- 172.21.15.123:0/4180461377 learned_addr learned my addr 172.21.15.123:0/4180461377 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:23.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.235+0000 7f0e167fc640 1 --2- 172.21.15.123:0/4180461377 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0e200d23b0 0x7f0e201577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:23.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.235+0000 7f0e1effd640 1 --2- 172.21.15.123:0/4180461377 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0e200b6970 0x7f0e201f5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:23.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.235+0000 7f0e1f7fe640 1 -- 172.21.15.123:0/4180461377 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0e200b6970 msgr2=0x7f0e201f5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:23.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.235+0000 7f0e1f7fe640 1 --2- 172.21.15.123:0/4180461377 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0e200b6970 0x7f0e201f5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.235+0000 7f0e1f7fe640 1 -- 172.21.15.123:0/4180461377 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0e200d23b0 msgr2=0x7f0e201577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:23.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.235+0000 7f0e1f7fe640 1 --2- 172.21.15.123:0/4180461377 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0e200d23b0 0x7f0e201577e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.235+0000 7f0e1f7fe640 1 -- 172.21.15.123:0/4180461377 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e201f6250 con 0x7f0e2015ed20 2024-09-15T23:17:23.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.235+0000 7f0e1f7fe640 1 --2- 172.21.15.123:0/4180461377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e2015ed20 0x7f0e20157d20 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009d90 tx=0x7f0e18004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:23.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.236+0000 7f0e17fff640 1 -- 172.21.15.123:0/4180461377 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e18040070 con 0x7f0e2015ed20 2024-09-15T23:17:23.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.236+0000 7f0e17fff640 1 -- 172.21.15.123:0/4180461377 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e18030be0 con 0x7f0e2015ed20 2024-09-15T23:17:23.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.236+0000 7f0e25423640 1 -- 172.21.15.123:0/4180461377 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e20155a70 con 0x7f0e2015ed20 2024-09-15T23:17:23.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.236+0000 7f0e17fff640 1 -- 172.21.15.123:0/4180461377 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e18009450 con 0x7f0e2015ed20 2024-09-15T23:17:23.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.236+0000 7f0e25423640 1 -- 172.21.15.123:0/4180461377 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e20156030 con 0x7f0e2015ed20 2024-09-15T23:17:23.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.237+0000 7f0e25423640 1 -- 172.21.15.123:0/4180461377 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e200d1f60 con 0x7f0e2015ed20 2024-09-15T23:17:23.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.237+0000 7f0e17fff640 1 -- 172.21.15.123:0/4180461377 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0e18039040 con 0x7f0e2015ed20 2024-09-15T23:17:23.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.237+0000 7f0e17fff640 1 --2- 172.21.15.123:0/4180461377 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0e0006c2e0 0x7f0e0006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:23.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.238+0000 7f0e17fff640 1 -- 172.21.15.123:0/4180461377 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5709+0+0 (secure 0 0 0) 0x7f0e180ac280 con 0x7f0e2015ed20 2024-09-15T23:17:23.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.238+0000 7f0e1effd640 1 --2- 172.21.15.123:0/4180461377 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0e0006c2e0 0x7f0e0006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:23.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.238+0000 7f0e1effd640 1 --2- 172.21.15.123:0/4180461377 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0e0006c2e0 0x7f0e0006e7a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f0e10004ea0 tx=0x7f0e10009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:23.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.242+0000 7f0e17fff640 1 -- 172.21.15.123:0/4180461377 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0e200d1f60 con 0x7f0e2015ed20 2024-09-15T23:17:23.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.441+0000 7f0e25423640 1 -- 172.21.15.123:0/4180461377 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0e200b3f20 con 0x7f0e2015ed20 2024-09-15T23:17:23.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.441+0000 7f0e17fff640 1 -- 172.21.15.123:0/4180461377 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v73) ==== 53+0+73 (secure 0 0 0) 0x7f0e201f6250 con 0x7f0e2015ed20 2024-09-15T23:17:23.443 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:17:23.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.443+0000 7f0e25423640 1 -- 172.21.15.123:0/4180461377 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0e0006c2e0 msgr2=0x7f0e0006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:23.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.443+0000 7f0e25423640 1 --2- 172.21.15.123:0/4180461377 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0e0006c2e0 0x7f0e0006e7a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f0e10004ea0 tx=0x7f0e10009040 comp rx=0 tx=0).stop 2024-09-15T23:17:23.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.443+0000 7f0e25423640 1 -- 172.21.15.123:0/4180461377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e2015ed20 msgr2=0x7f0e20157d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:23.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.443+0000 7f0e25423640 1 --2- 172.21.15.123:0/4180461377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e2015ed20 0x7f0e20157d20 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009d90 tx=0x7f0e18004a40 comp rx=0 tx=0).stop 2024-09-15T23:17:23.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.443+0000 7f0e25423640 1 -- 172.21.15.123:0/4180461377 shutdown_connections 2024-09-15T23:17:23.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.443+0000 7f0e25423640 1 --2- 172.21.15.123:0/4180461377 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0e0006c2e0 0x7f0e0006e7a0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.443+0000 7f0e25423640 1 --2- 172.21.15.123:0/4180461377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e2015ed20 0x7f0e20157d20 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.443+0000 7f0e25423640 1 --2- 172.21.15.123:0/4180461377 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0e200d23b0 0x7f0e201577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.443+0000 7f0e25423640 1 --2- 172.21.15.123:0/4180461377 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0e200b6970 0x7f0e201f5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:23.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.443+0000 7f0e25423640 1 -- 172.21.15.123:0/4180461377 >> 172.21.15.123:0/4180461377 conn(0x7f0e200d1260 msgr2=0x7f0e200b4920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:23.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.443+0000 7f0e25423640 1 -- 172.21.15.123:0/4180461377 shutdown_connections 2024-09-15T23:17:23.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23.443+0000 7f0e25423640 1 -- 172.21.15.123:0/4180461377 wait complete. 2024-09-15T23:17:23.456 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T23:17:23.456 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:17:23.456 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-09-15T23:17:23.456 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T23:17:23.456 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T23:17:23.456 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T23:17:23.457 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T23:17:23.457 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:17:23.457 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:17:23.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:17:23.457 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-09-15T23:17:23.472 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:17:23.473 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:17:23.473 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:17:23.473 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:17:23.473 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-09-15T23:17:23.473 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:17:23.473 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:17:23.473 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-09-15T23:17:23.473 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f0 2024-09-15T23:17:23.473 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:17:23.473 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:17:23.473 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f1 2024-09-15T23:17:23.473 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:17:23.473 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:17:23.474 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:17:23.474 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:17:23.474 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T23:17:23.474 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42497sec preferred_lft 42497sec 2024-09-15T23:17:23.474 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link noprefixroute 2024-09-15T23:17:23.474 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:17:23.474 INFO:teuthology.orchestra.run.smithi123.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:17:23.474 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 46:55:5a:e0:32:4d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:17:23.474 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:17:23.474 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:17:23.474 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::1c6f:d5ff:fe19:ff05/64 scope link 2024-09-15T23:17:23.474 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:17:23.474 INFO:teuthology.orchestra.run.smithi123.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:17:23.475 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 46:55:5a:e0:32:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:17:23.475 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::4455:5aff:fee0:324d/64 scope link 2024-09-15T23:17:23.475 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:17:23.475 INFO:teuthology.orchestra.run.smithi123.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:17:23.475 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether be:c1:f3:63:cb:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:17:23.475 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::bcc1:f3ff:fe63:cb24/64 scope link 2024-09-15T23:17:23.475 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:17:23.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:17:23.475 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:17:23.536 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-09-15T23:17:23.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:17:23.538 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-09-15T23:17:23.594 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-09-15T23:17:23.594 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:17:23.594 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:17:23.594 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:17:23.594 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:17:23.594 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:17:23.594 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:17:23.595 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:17:23.595 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:17:23.595 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:17:23.595 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:17:23.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:17:23.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:17:23.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:17:23.719 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-09-15T23:17:23.735 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T23:17:23.735 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:17:23.735 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:17:23.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:17:23.735 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2024-09-15T23:17:23.799 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:17:23.800 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T23:17:23.855 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:17:23.855 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:17:23.855 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:17:23.911 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T23:17:23.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:17:23.911 DEBUG:teuthology.orchestra.run.smithi123:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:17:23.994 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:17:23.994 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:17:23.995 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:17:24.003 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:17:24.003 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:17:24.003 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:17:24.003 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.188:3300,172.21.15.188:3301" 2024-09-15T23:17:24.003 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T23:17:24.009 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:17:24.009 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:17:24.009 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:17:24.009 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.188:3300,172.21.15.188:3301" 2024-09-15T23:17:24.010 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T23:17:24.010 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:6789,172.21.15.188:6789,172.21.15.188:6790" 2024-09-15T23:17:24.010 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.123:6789,172.21.15.188:6789,172.21.15.188:6790:/ 2024-09-15T23:17:24.010 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=cb968ac4-8d3a-4b17-a673-6177aeaea589" will pass to kernel 2024-09-15T23:17:24.010 INFO:teuthology.orchestra.run.smithi123.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-15T23:17:24.010 INFO:teuthology.orchestra.run.smithi123.stdout: You just mounted a file system that supports labels which does not 2024-09-15T23:17:24.010 INFO:teuthology.orchestra.run.smithi123.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T23:17:24.010 INFO:teuthology.orchestra.run.smithi123.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T23:17:24.011 INFO:teuthology.orchestra.run.smithi123.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T23:17:24.012 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T23:17:24.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:17:24.012 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:17:24.077 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T23:17:24.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:17:24.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:17:24.178 INFO:teuthology.orchestra.run.smithi123.stdout:client6880 2024-09-15T23:17:24.178 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:17:24.178 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:17:24.194 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2024-09-15T23:17:24.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.336+0000 7fb5ca566640 1 Processor -- start 2024-09-15T23:17:24.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.336+0000 7fb5ca566640 1 -- start start 2024-09-15T23:17:24.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.337+0000 7fb5ca566640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5c4155b20 0x7fb5c40b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:24.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.337+0000 7fb5ca566640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb5c40b21a0 0x7fb5c40cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:24.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.337+0000 7fb5ca566640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5c40b0680 con 0x7fb5c40cf960 2024-09-15T23:17:24.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.337+0000 7fb5ca566640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fb5c40b2600 con 0x7fb5c40b21a0 2024-09-15T23:17:24.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.337+0000 7fb5ca566640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb5c40b01e0 con 0x7fb5c4155b20 2024-09-15T23:17:24.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.337+0000 7fb5c8b03640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb5c40cf960 0x7fb5c415ef70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:40632/0 (socket says 172.21.15.123:40632) 2024-09-15T23:17:24.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.337+0000 7fb5c8b03640 1 -- 172.21.15.123:0/3207443828 learned_addr learned my addr 172.21.15.123:0/3207443828 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:17:24.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.337+0000 7fb5c37fe640 1 --2- 172.21.15.123:0/3207443828 >> v2:172.21.15.188:3300/0 conn(0x7fb5c40b21a0 0x7fb5c40cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:24.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.337+0000 7fb5c3fff640 1 --2- 172.21.15.123:0/3207443828 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5c4155b20 0x7fb5c40b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:24.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.337+0000 7fb5c2ffd640 1 -- 172.21.15.123:0/3207443828 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2818442734 0 0) 0x7fb5c40b0680 con 0x7fb5c40cf960 2024-09-15T23:17:24.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.337+0000 7fb5c2ffd640 1 -- 172.21.15.123:0/3207443828 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5ac003520 con 0x7fb5c40cf960 2024-09-15T23:17:24.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.337+0000 7fb5c2ffd640 1 -- 172.21.15.123:0/3207443828 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3004312984 0 0) 0x7fb5ac003520 con 0x7fb5c40cf960 2024-09-15T23:17:24.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.337+0000 7fb5c2ffd640 1 -- 172.21.15.123:0/3207443828 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5c4155b20 msgr2=0x7fb5c40b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:24.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.337+0000 7fb5c2ffd640 1 --2- 172.21.15.123:0/3207443828 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5c4155b20 0x7fb5c40b1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:24.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.337+0000 7fb5c2ffd640 1 -- 172.21.15.123:0/3207443828 >> v2:172.21.15.188:3300/0 conn(0x7fb5c40b21a0 msgr2=0x7fb5c40cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:24.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.337+0000 7fb5c2ffd640 1 --2- 172.21.15.123:0/3207443828 >> v2:172.21.15.188:3300/0 conn(0x7fb5c40b21a0 0x7fb5c40cf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:24.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.337+0000 7fb5c2ffd640 1 -- 172.21.15.123:0/3207443828 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c40ccf70 con 0x7fb5c40cf960 2024-09-15T23:17:24.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.337+0000 7fb5c2ffd640 1 -- 172.21.15.123:0/3207443828 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fb5bc001a10 con 0x7fb5c40cf960 2024-09-15T23:17:24.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.338+0000 7fb5c2ffd640 1 -- 172.21.15.123:0/3207443828 >> v1:172.21.15.123:6789/0 conn(0x7fb5c40cf960 legacy=0x7fb5c415ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:24.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.338+0000 7fb5c2ffd640 1 --2- 172.21.15.123:0/3207443828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5ac0039e0 0x7fb5ac003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:24.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.338+0000 7fb5c2ffd640 1 --2- 172.21.15.123:0/3207443828 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb5ac004800 0x7fb5ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:24.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.338+0000 7fb5c2ffd640 1 --2- 172.21.15.123:0/3207443828 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5c4155b20 0x7fb5ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:24.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.338+0000 7fb5c2ffd640 1 -- 172.21.15.123:0/3207443828 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c40b01e0 con 0x7fb5ac0039e0 2024-09-15T23:17:24.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.338+0000 7fb5c2ffd640 1 -- 172.21.15.123:0/3207443828 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ac00b9c0 con 0x7fb5ac004800 2024-09-15T23:17:24.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.338+0000 7fb5c2ffd640 1 -- 172.21.15.123:0/3207443828 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb5ac00bb40 con 0x7fb5c4155b20 2024-09-15T23:17:24.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.338+0000 7fb5c3fff640 1 --2- 172.21.15.123:0/3207443828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5ac0039e0 0x7fb5ac003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:24.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.338+0000 7fb5c37fe640 1 --2- 172.21.15.123:0/3207443828 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb5ac004800 0x7fb5ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:24.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.338+0000 7fb5c8b03640 1 --2- 172.21.15.123:0/3207443828 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5c4155b20 0x7fb5ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:24.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.338+0000 7fb5c3fff640 1 -- 172.21.15.123:0/3207443828 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5c4155b20 msgr2=0x7fb5ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:24.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.338+0000 7fb5c3fff640 1 --2- 172.21.15.123:0/3207443828 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5c4155b20 0x7fb5ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:24.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.338+0000 7fb5c3fff640 1 -- 172.21.15.123:0/3207443828 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb5ac004800 msgr2=0x7fb5ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:17:24.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.338+0000 7fb5c3fff640 1 --2- 172.21.15.123:0/3207443828 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb5ac004800 0x7fb5ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:24.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.338+0000 7fb5c3fff640 1 -- 172.21.15.123:0/3207443828 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5ac003520 con 0x7fb5ac0039e0 2024-09-15T23:17:24.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.339+0000 7fb5c3fff640 1 --2- 172.21.15.123:0/3207443828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5ac0039e0 0x7fb5ac003e00 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4009ac0 tx=0x7fb5ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=350079811050dbf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:24.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.339+0000 7fb5c2ffd640 1 -- 172.21.15.123:0/3207443828 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b4036070 con 0x7fb5ac0039e0 2024-09-15T23:17:24.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.339+0000 7fb5c2ffd640 1 -- 172.21.15.123:0/3207443828 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b4031400 con 0x7fb5ac0039e0 2024-09-15T23:17:24.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.339+0000 7fb5c2ffd640 1 -- 172.21.15.123:0/3207443828 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b4009690 con 0x7fb5ac0039e0 2024-09-15T23:17:24.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.339+0000 7fb5ca566640 1 -- 172.21.15.123:0/3207443828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5ac0039e0 msgr2=0x7fb5ac003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:24.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.339+0000 7fb5ca566640 1 --2- 172.21.15.123:0/3207443828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5ac0039e0 0x7fb5ac003e00 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4009ac0 tx=0x7fb5ac005830 comp rx=0 tx=0).stop 2024-09-15T23:17:24.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.339+0000 7fb5c8b03640 1 -- 172.21.15.123:0/3207443828 reap_dead start 2024-09-15T23:17:24.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.339+0000 7fb5ca566640 1 -- 172.21.15.123:0/3207443828 shutdown_connections 2024-09-15T23:17:24.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.339+0000 7fb5ca566640 1 -- 172.21.15.123:0/3207443828 >> 172.21.15.123:0/3207443828 conn(0x7fb5c406c240 msgr2=0x7fb5c406d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:24.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.339+0000 7fb5ca566640 1 -- 172.21.15.123:0/3207443828 shutdown_connections 2024-09-15T23:17:24.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.339+0000 7fb5ca566640 1 -- 172.21.15.123:0/3207443828 wait complete. 2024-09-15T23:17:24.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.340+0000 7fb5ca566640 1 Processor -- start 2024-09-15T23:17:24.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.341+0000 7fb5ca566640 1 -- start start 2024-09-15T23:17:24.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.341+0000 7fb5ca566640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb5ac0039e0 0x7fb5c41ee2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:24.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.341+0000 7fb5ca566640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5c415d280 0x7fb5c4150c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:24.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.341+0000 7fb5ca566640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5c40ae870 0x7fb5c40aecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:24.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.341+0000 7fb5ca566640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c40cef00 con 0x7fb5c415d280 2024-09-15T23:17:24.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.341+0000 7fb5ca566640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c40cec20 con 0x7fb5ac0039e0 2024-09-15T23:17:24.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.341+0000 7fb5ca566640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb5c40cfdb0 con 0x7fb5c40ae870 2024-09-15T23:17:24.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.341+0000 7fb5c37fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5c415d280 0x7fb5c4150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:24.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.342+0000 7fb5c37fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5c415d280 0x7fb5c4150c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48320/0 (socket says 172.21.15.123:48320) 2024-09-15T23:17:24.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.342+0000 7fb5c37fe640 1 -- 172.21.15.123:0/2171421379 learned_addr learned my addr 172.21.15.123:0/2171421379 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:17:24.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.342+0000 7fb5c3fff640 1 --2- 172.21.15.123:0/2171421379 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb5ac0039e0 0x7fb5c41ee2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:24.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.342+0000 7fb5c8b03640 1 --2- 172.21.15.123:0/2171421379 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5c40ae870 0x7fb5c40aecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:24.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.342+0000 7fb5c37fe640 1 -- 172.21.15.123:0/2171421379 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5c40ae870 msgr2=0x7fb5c40aecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:24.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.342+0000 7fb5c37fe640 1 --2- 172.21.15.123:0/2171421379 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5c40ae870 0x7fb5c40aecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:24.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.342+0000 7fb5c37fe640 1 -- 172.21.15.123:0/2171421379 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb5ac0039e0 msgr2=0x7fb5c41ee2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:24.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.342+0000 7fb5c37fe640 1 --2- 172.21.15.123:0/2171421379 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb5ac0039e0 0x7fb5c41ee2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:24.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.342+0000 7fb5c37fe640 1 -- 172.21.15.123:0/2171421379 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c415e8e0 con 0x7fb5c415d280 2024-09-15T23:17:24.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.342+0000 7fb5c3fff640 1 --2- 172.21.15.123:0/2171421379 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb5ac0039e0 0x7fb5c41ee2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:17:24.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.342+0000 7fb5c37fe640 1 --2- 172.21.15.123:0/2171421379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5c415d280 0x7fb5c4150c90 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8011aa0 tx=0x7fb5b8011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:24.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.342+0000 7fb5c0ff9640 1 -- 172.21.15.123:0/2171421379 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b800fb80 con 0x7fb5c415d280 2024-09-15T23:17:24.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.342+0000 7fb5c0ff9640 1 -- 172.21.15.123:0/2171421379 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5b800fd20 con 0x7fb5c415d280 2024-09-15T23:17:24.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.342+0000 7fb5ca566640 1 -- 172.21.15.123:0/2171421379 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5c415d840 con 0x7fb5c415d280 2024-09-15T23:17:24.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.342+0000 7fb5c0ff9640 1 -- 172.21.15.123:0/2171421379 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8014660 con 0x7fb5c415d280 2024-09-15T23:17:24.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.342+0000 7fb5ca566640 1 -- 172.21.15.123:0/2171421379 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5c415de00 con 0x7fb5c415d280 2024-09-15T23:17:24.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.343+0000 7fb5ca566640 1 -- 172.21.15.123:0/2171421379 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5c40af230 con 0x7fb5c415d280 2024-09-15T23:17:24.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.344+0000 7fb5c0ff9640 1 -- 172.21.15.123:0/2171421379 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb5b8012040 con 0x7fb5c415d280 2024-09-15T23:17:24.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.344+0000 7fb5c0ff9640 1 --2- 172.21.15.123:0/2171421379 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb5b006c2e0 0x7fb5b006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:17:24.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.344+0000 7fb5c0ff9640 1 -- 172.21.15.123:0/2171421379 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5709+0+0 (secure 0 0 0) 0x7fb5b808ba30 con 0x7fb5c415d280 2024-09-15T23:17:24.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.344+0000 7fb5c3fff640 1 --2- 172.21.15.123:0/2171421379 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb5b006c2e0 0x7fb5b006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:17:24.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.345+0000 7fb5c3fff640 1 --2- 172.21.15.123:0/2171421379 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb5b006c2e0 0x7fb5b006e7a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4033000 tx=0x7fb5b4008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:17:24.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.348+0000 7fb5c0ff9640 1 -- 172.21.15.123:0/2171421379 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb5b8019030 con 0x7fb5c415d280 2024-09-15T23:17:24.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:24.549+0000 7fb5ca566640 1 -- 172.21.15.123:0/2171421379 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fb5c40b0930 con 0x7fb5c415d280 2024-09-15T23:17:25.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:25.297+0000 7fb5c0ff9640 1 -- 172.21.15.123:0/2171421379 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v74) ==== 167+0+0 (secure 0 0 0) 0x7fb5b805a230 con 0x7fb5c415d280 2024-09-15T23:17:25.299 INFO:teuthology.orchestra.run.smithi123.stderr:enabled new snapshots 2024-09-15T23:17:25.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:25.299+0000 7fb5ca566640 1 -- 172.21.15.123:0/2171421379 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb5b006c2e0 msgr2=0x7fb5b006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:25.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:25.299+0000 7fb5ca566640 1 --2- 172.21.15.123:0/2171421379 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb5b006c2e0 0x7fb5b006e7a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4033000 tx=0x7fb5b4008030 comp rx=0 tx=0).stop 2024-09-15T23:17:25.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:25.299+0000 7fb5ca566640 1 -- 172.21.15.123:0/2171421379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5c415d280 msgr2=0x7fb5c4150c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:17:25.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:25.299+0000 7fb5ca566640 1 --2- 172.21.15.123:0/2171421379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5c415d280 0x7fb5c4150c90 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8011aa0 tx=0x7fb5b8011f60 comp rx=0 tx=0).stop 2024-09-15T23:17:25.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:25.300+0000 7fb5ca566640 1 -- 172.21.15.123:0/2171421379 shutdown_connections 2024-09-15T23:17:25.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:25.300+0000 7fb5ca566640 1 --2- 172.21.15.123:0/2171421379 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5c40ae870 0x7fb5c40aecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:25.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:25.300+0000 7fb5ca566640 1 --2- 172.21.15.123:0/2171421379 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb5b006c2e0 0x7fb5b006e7a0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:25.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:25.300+0000 7fb5ca566640 1 --2- 172.21.15.123:0/2171421379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5c415d280 0x7fb5c4150c90 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:25.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:25.300+0000 7fb5ca566640 1 --2- 172.21.15.123:0/2171421379 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb5ac0039e0 0x7fb5c41ee2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:17:25.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:25.300+0000 7fb5ca566640 1 -- 172.21.15.123:0/2171421379 >> 172.21.15.123:0/2171421379 conn(0x7fb5c406c240 msgr2=0x7fb5c4072140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:17:25.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:25.300+0000 7fb5ca566640 1 -- 172.21.15.123:0/2171421379 shutdown_connections 2024-09-15T23:17:25.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:25.300+0000 7fb5ca566640 1 -- 172.21.15.123:0/2171421379 wait complete. 2024-09-15T23:17:25.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:17:25.315 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir stray_eval_dir) 2024-09-15T23:17:25.335 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:17:25.336 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:17:25.393 DEBUG:teuthology.orchestra.run.smithi123:> stdin-killer -- python3 -c ' 2024-09-15T23:17:25.393 DEBUG:teuthology.orchestra.run.smithi123:> import os 2024-09-15T23:17:25.393 DEBUG:teuthology.orchestra.run.smithi123:> import uuid 2024-09-15T23:17:25.393 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-15T23:17:25.393 DEBUG:teuthology.orchestra.run.smithi123:> n = 2000 2024-09-15T23:17:25.393 DEBUG:teuthology.orchestra.run.smithi123:> create_hard_links = False 2024-09-15T23:17:25.394 DEBUG:teuthology.orchestra.run.smithi123:> if 3 > 0: 2024-09-15T23:17:25.394 DEBUG:teuthology.orchestra.run.smithi123:> create_hard_links = True 2024-09-15T23:17:25.394 DEBUG:teuthology.orchestra.run.smithi123:> path = "/home/ubuntu/cephtest/mnt.0/stray_eval_dir/file" 2024-09-15T23:17:25.394 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-15T23:17:25.394 DEBUG:teuthology.orchestra.run.smithi123:> dpath = os.path.dirname(path) 2024-09-15T23:17:25.394 DEBUG:teuthology.orchestra.run.smithi123:> fnameprefix = os.path.basename(path) 2024-09-15T23:17:25.394 DEBUG:teuthology.orchestra.run.smithi123:> os.makedirs(dpath, exist_ok=True) 2024-09-15T23:17:25.394 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-15T23:17:25.394 DEBUG:teuthology.orchestra.run.smithi123:> try: 2024-09-15T23:17:25.394 DEBUG:teuthology.orchestra.run.smithi123:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-15T23:17:25.394 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-15T23:17:25.395 DEBUG:teuthology.orchestra.run.smithi123:> for i in range(n): 2024-09-15T23:17:25.395 DEBUG:teuthology.orchestra.run.smithi123:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-15T23:17:25.395 DEBUG:teuthology.orchestra.run.smithi123:> with open(fpath, '"'"'w'"'"') as f: 2024-09-15T23:17:25.395 DEBUG:teuthology.orchestra.run.smithi123:> f.write(f"{i}") 2024-09-15T23:17:25.395 DEBUG:teuthology.orchestra.run.smithi123:> if False: 2024-09-15T23:17:25.395 DEBUG:teuthology.orchestra.run.smithi123:> f.flush() 2024-09-15T23:17:25.395 DEBUG:teuthology.orchestra.run.smithi123:> os.fsync(f.fileno()) 2024-09-15T23:17:25.395 DEBUG:teuthology.orchestra.run.smithi123:> if False: 2024-09-15T23:17:25.395 DEBUG:teuthology.orchestra.run.smithi123:> os.unlink(fpath) 2024-09-15T23:17:25.395 DEBUG:teuthology.orchestra.run.smithi123:> if False: 2024-09-15T23:17:25.395 DEBUG:teuthology.orchestra.run.smithi123:> os.fsync(dirfd) 2024-09-15T23:17:25.395 DEBUG:teuthology.orchestra.run.smithi123:> if create_hard_links: 2024-09-15T23:17:25.395 DEBUG:teuthology.orchestra.run.smithi123:> for j in range(3): 2024-09-15T23:17:25.395 DEBUG:teuthology.orchestra.run.smithi123:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-15T23:17:25.395 DEBUG:teuthology.orchestra.run.smithi123:> if False: 2024-09-15T23:17:25.396 DEBUG:teuthology.orchestra.run.smithi123:> os.fsync(dirfd) 2024-09-15T23:17:25.396 DEBUG:teuthology.orchestra.run.smithi123:> finally: 2024-09-15T23:17:25.396 DEBUG:teuthology.orchestra.run.smithi123:> os.close(dirfd) 2024-09-15T23:17:25.396 DEBUG:teuthology.orchestra.run.smithi123:> ' 2024-09-15T23:17:38.783 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:17:38.786 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:17:43.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:17:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:17:43.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:17:43.868 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-09-15T23:17:44.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:17:44.117 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec find /home/ubuntu/cephtest/mnt.0/stray_eval_dir/ -type f -delete) 2024-09-15T23:18:08.879 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:18:08.882 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:18:11.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:18:11.334 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2024-09-15T23:18:11.498 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 perf dump 2024-09-15T23:18:11.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.596+0000 7fa0619b7640 1 Processor -- start 2024-09-15T23:18:11.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.596+0000 7fa0619b7640 1 -- start start 2024-09-15T23:18:11.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.597+0000 7fa0619b7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa05c0b5050 0x7fa05c0cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.597+0000 7fa0619b7640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa05c0b38b0 con 0x7fa05c06f8b0 2024-09-15T23:18:11.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.597+0000 7fa0619b7640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa05c0cfee0 con 0x7fa05c1607d0 2024-09-15T23:18:11.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.597+0000 7fa0619b7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa05c0d01c0 con 0x7fa05c0b5050 2024-09-15T23:18:11.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.597+0000 7fa05affd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa05c06f8b0 0x7fa05c1600c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55880/0 (socket says 172.21.15.123:55880) 2024-09-15T23:18:11.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.597+0000 7fa05affd640 1 -- 172.21.15.123:0/937317820 learned_addr learned my addr 172.21.15.123:0/937317820 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:18:11.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.597+0000 7fa05b7fe640 1 --2- 172.21.15.123:0/937317820 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa05c0b5050 0x7fa05c0cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:11.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.597+0000 7fa059ffb640 1 -- 172.21.15.123:0/937317820 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3545764190 0 0) 0x7fa05c0b38b0 con 0x7fa05c06f8b0 2024-09-15T23:18:11.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.597+0000 7fa059ffb640 1 -- 172.21.15.123:0/937317820 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa044003520 con 0x7fa05c06f8b0 2024-09-15T23:18:11.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.598+0000 7fa059ffb640 1 -- 172.21.15.123:0/937317820 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2937804494 0 0) 0x7fa05c0cfee0 con 0x7fa05c1607d0 2024-09-15T23:18:11.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.598+0000 7fa05b7fe640 1 -- 172.21.15.123:0/937317820 >> v1:172.21.15.188:6789/0 conn(0x7fa05c1607d0 legacy=0x7fa05c0cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:11.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.598+0000 7fa05b7fe640 1 -- 172.21.15.123:0/937317820 >> v1:172.21.15.123:6789/0 conn(0x7fa05c06f8b0 legacy=0x7fa05c1600c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:11.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.598+0000 7fa05b7fe640 1 -- 172.21.15.123:0/937317820 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa05c0b3b20 con 0x7fa05c0b5050 2024-09-15T23:18:11.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.598+0000 7fa05b7fe640 1 --2- 172.21.15.123:0/937317820 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa05c0b5050 0x7fa05c0cf8c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa0540097d0 tx=0x7fa05402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=955a9a38891de293 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:11.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.598+0000 7fa059ffb640 1 -- 172.21.15.123:0/937317820 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa054037070 con 0x7fa05c0b5050 2024-09-15T23:18:11.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.598+0000 7fa059ffb640 1 -- 172.21.15.123:0/937317820 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa054032440 con 0x7fa05c0b5050 2024-09-15T23:18:11.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.599+0000 7fa059ffb640 1 -- 172.21.15.123:0/937317820 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa054032810 con 0x7fa05c0b5050 2024-09-15T23:18:11.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.599+0000 7fa0619b7640 1 -- 172.21.15.123:0/937317820 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa05c0b5050 msgr2=0x7fa05c0cf8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:11.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.599+0000 7fa0619b7640 1 --2- 172.21.15.123:0/937317820 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa05c0b5050 0x7fa05c0cf8c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa0540097d0 tx=0x7fa05402a180 comp rx=0 tx=0).stop 2024-09-15T23:18:11.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.599+0000 7fa0619b7640 1 -- 172.21.15.123:0/937317820 shutdown_connections 2024-09-15T23:18:11.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.599+0000 7fa0619b7640 1 --2- 172.21.15.123:0/937317820 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa05c0b5050 0x7fa05c0cf8c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.599+0000 7fa0619b7640 1 -- 172.21.15.123:0/937317820 >> 172.21.15.123:0/937317820 conn(0x7fa05c0b2510 msgr2=0x7fa05c0b28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:11.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.599+0000 7fa0619b7640 1 -- 172.21.15.123:0/937317820 shutdown_connections 2024-09-15T23:18:11.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.599+0000 7fa0619b7640 1 -- 172.21.15.123:0/937317820 wait complete. 2024-09-15T23:18:11.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.600+0000 7fa0619b7640 1 Processor -- start 2024-09-15T23:18:11.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.600+0000 7fa0619b7640 1 -- start start 2024-09-15T23:18:11.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.601+0000 7fa0619b7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa05c06f8b0 0x7fa05c155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.601+0000 7fa0619b7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa05c0b5050 0x7fa05c156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.601+0000 7fa0619b7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa05c1607d0 0x7fa05c1655e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.601+0000 7fa0619b7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c167220 con 0x7fa05c06f8b0 2024-09-15T23:18:11.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.601+0000 7fa0619b7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c06fc90 con 0x7fa05c1607d0 2024-09-15T23:18:11.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.601+0000 7fa0619b7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa05c1673a0 con 0x7fa05c0b5050 2024-09-15T23:18:11.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.601+0000 7fa05affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa05c06f8b0 0x7fa05c155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:11.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.601+0000 7fa05affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa05c06f8b0 0x7fa05c155a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33682/0 (socket says 172.21.15.123:33682) 2024-09-15T23:18:11.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.601+0000 7fa05affd640 1 -- 172.21.15.123:0/3344441585 learned_addr learned my addr 172.21.15.123:0/3344441585 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:11.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.601+0000 7fa05a7fc640 1 --2- 172.21.15.123:0/3344441585 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa05c0b5050 0x7fa05c156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:11.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.601+0000 7fa05b7fe640 1 --2- 172.21.15.123:0/3344441585 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa05c1607d0 0x7fa05c1655e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:11.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.601+0000 7fa05affd640 1 -- 172.21.15.123:0/3344441585 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa05c0b5050 msgr2=0x7fa05c156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:11.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.601+0000 7fa05affd640 1 --2- 172.21.15.123:0/3344441585 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa05c0b5050 0x7fa05c156290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.601+0000 7fa05affd640 1 -- 172.21.15.123:0/3344441585 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa05c1607d0 msgr2=0x7fa05c1655e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:11.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.601+0000 7fa05affd640 1 --2- 172.21.15.123:0/3344441585 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa05c1607d0 0x7fa05c1655e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.601+0000 7fa05affd640 1 -- 172.21.15.123:0/3344441585 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa05c15a3b0 con 0x7fa05c06f8b0 2024-09-15T23:18:11.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.602+0000 7fa05a7fc640 1 --2- 172.21.15.123:0/3344441585 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa05c0b5050 0x7fa05c156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:18:11.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.602+0000 7fa05b7fe640 1 --2- 172.21.15.123:0/3344441585 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa05c1607d0 0x7fa05c1655e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:18:11.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.602+0000 7fa05affd640 1 --2- 172.21.15.123:0/3344441585 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa05c06f8b0 0x7fa05c155a50 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fa04c00cad0 tx=0x7fa04c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:11.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.602+0000 7fa043fff640 1 -- 172.21.15.123:0/3344441585 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c017070 con 0x7fa05c06f8b0 2024-09-15T23:18:11.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.602+0000 7fa043fff640 1 -- 172.21.15.123:0/3344441585 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa04c00ac30 con 0x7fa05c06f8b0 2024-09-15T23:18:11.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.602+0000 7fa0619b7640 1 -- 172.21.15.123:0/3344441585 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa05c15a690 con 0x7fa05c06f8b0 2024-09-15T23:18:11.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.602+0000 7fa043fff640 1 -- 172.21.15.123:0/3344441585 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c012400 con 0x7fa05c06f8b0 2024-09-15T23:18:11.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.602+0000 7fa0619b7640 1 -- 172.21.15.123:0/3344441585 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa05c15ac50 con 0x7fa05c06f8b0 2024-09-15T23:18:11.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.603+0000 7fa043fff640 1 -- 172.21.15.123:0/3344441585 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa04c01a070 con 0x7fa05c06f8b0 2024-09-15T23:18:11.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.604+0000 7fa043fff640 1 --2- 172.21.15.123:0/3344441585 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa04806c2b0 0x7fa04806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.604+0000 7fa043fff640 1 -- 172.21.15.123:0/3344441585 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5767+0+0 (secure 0 0 0) 0x7fa04c08b250 con 0x7fa05c06f8b0 2024-09-15T23:18:11.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.604+0000 7fa05a7fc640 1 --2- 172.21.15.123:0/3344441585 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa04806c2b0 0x7fa04806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:11.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.604+0000 7fa05a7fc640 1 --2- 172.21.15.123:0/3344441585 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa04806c2b0 0x7fa04806e770 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa05c0cbea0 tx=0x7fa050009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:11.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.605+0000 7fa06482c740 1 Processor -- start 2024-09-15T23:18:11.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.605+0000 7fa06482c740 1 -- start start 2024-09-15T23:18:11.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.605+0000 7fa06482c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559542c155e0 0x559542c159c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.605+0000 7fa06482c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559542c12da0 0x559542c14930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.605+0000 7fa06482c740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559542c13200 0x559542bf5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.605+0000 7fa06482c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x559542b318d0 con 0x559542c12da0 2024-09-15T23:18:11.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.605+0000 7fa06482c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x559542ad9620 con 0x559542c155e0 2024-09-15T23:18:11.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.605+0000 7fa06482c740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x559542b2d890 con 0x559542c13200 2024-09-15T23:18:11.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.606+0000 7fa05a7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559542c12da0 0x559542c14930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:11.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.606+0000 7fa05a7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559542c12da0 0x559542c14930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33688/0 (socket says 172.21.15.123:33688) 2024-09-15T23:18:11.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.606+0000 7fa05a7fc640 1 -- 172.21.15.123:0/2131086794 learned_addr learned my addr 172.21.15.123:0/2131086794 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:11.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.606+0000 7fa05affd640 1 --2- 172.21.15.123:0/2131086794 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559542c155e0 0x559542c159c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:11.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.606+0000 7fa05b7fe640 1 --2- 172.21.15.123:0/2131086794 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559542c13200 0x559542bf5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:11.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.606+0000 7fa05a7fc640 1 -- 172.21.15.123:0/2131086794 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559542c13200 msgr2=0x559542bf5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:11.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.606+0000 7fa05a7fc640 1 --2- 172.21.15.123:0/2131086794 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559542c13200 0x559542bf5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.606+0000 7fa05a7fc640 1 -- 172.21.15.123:0/2131086794 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559542c155e0 msgr2=0x559542c159c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:11.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.606+0000 7fa05a7fc640 1 --2- 172.21.15.123:0/2131086794 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559542c155e0 0x559542c159c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.606+0000 7fa05a7fc640 1 -- 172.21.15.123:0/2131086794 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55954290e7d0 con 0x559542c12da0 2024-09-15T23:18:11.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.606+0000 7fa05a7fc640 1 --2- 172.21.15.123:0/2131086794 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559542c12da0 0x559542c14930 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fa0500011e0 tx=0x7fa050011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df659b8d91fc16b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:11.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.606+0000 7fa0417fa640 1 -- 172.21.15.123:0/2131086794 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0500035f0 con 0x559542c12da0 2024-09-15T23:18:11.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.606+0000 7fa0417fa640 1 -- 172.21.15.123:0/2131086794 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa050003790 con 0x559542c12da0 2024-09-15T23:18:11.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.606+0000 7fa0417fa640 1 -- 172.21.15.123:0/2131086794 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa050003b40 con 0x559542c12da0 2024-09-15T23:18:11.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.607+0000 7fa06482c740 1 -- 172.21.15.123:0/2131086794 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559542c12da0 msgr2=0x559542c14930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:11.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.607+0000 7fa06482c740 1 --2- 172.21.15.123:0/2131086794 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559542c12da0 0x559542c14930 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fa0500011e0 tx=0x7fa050011000 comp rx=0 tx=0).stop 2024-09-15T23:18:11.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.607+0000 7fa06482c740 1 -- 172.21.15.123:0/2131086794 shutdown_connections 2024-09-15T23:18:11.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.607+0000 7fa06482c740 1 --2- 172.21.15.123:0/2131086794 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559542c13200 0x559542bf5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.607+0000 7fa06482c740 1 --2- 172.21.15.123:0/2131086794 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559542c12da0 0x559542c14930 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.607+0000 7fa06482c740 1 --2- 172.21.15.123:0/2131086794 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559542c155e0 0x559542c159c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.607+0000 7fa06482c740 1 -- 172.21.15.123:0/2131086794 >> 172.21.15.123:0/2131086794 conn(0x559542bcb240 msgr2=0x559542c13650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:11.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.607+0000 7fa06482c740 1 -- 172.21.15.123:0/2131086794 shutdown_connections 2024-09-15T23:18:11.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.607+0000 7fa06482c740 1 -- 172.21.15.123:0/2131086794 wait complete. 2024-09-15T23:18:11.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.608+0000 7fa06482c740 1 -- start start 2024-09-15T23:18:11.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.608+0000 7fa06482c740 1 Processor -- start 2024-09-15T23:18:11.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.608+0000 7fa06482c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559542c13200 0x559542bce040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.608+0000 7fa06482c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559542c155e0 0x559542c268c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.608+0000 7fa06482c740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559542bf3410 0x559542c26e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.608+0000 7fa06482c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x559542c11d00 con 0x559542c13200 2024-09-15T23:18:11.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.608+0000 7fa06482c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x559542aba750 con 0x559542c155e0 2024-09-15T23:18:11.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.608+0000 7fa06482c740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x559542c11fe0 con 0x559542bf3410 2024-09-15T23:18:11.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.608+0000 7fa06482c740 10 client.0 _ll_register_callbacks cb 0x559542ade780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:18:11.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.608+0000 7fa05affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559542c13200 0x559542bce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:11.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.608+0000 7fa05affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559542c13200 0x559542bce040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33698/0 (socket says 172.21.15.123:33698) 2024-09-15T23:18:11.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.608+0000 7fa05affd640 1 -- 172.21.15.123:0/2827619955 learned_addr learned my addr 172.21.15.123:0/2827619955 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:11.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.609+0000 7fa05b7fe640 1 --2- 172.21.15.123:0/2827619955 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559542bf3410 0x559542c26e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:11.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.609+0000 7fa05a7fc640 1 --2- 172.21.15.123:0/2827619955 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559542c155e0 0x559542c268c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:11.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.609+0000 7fa05affd640 1 -- 172.21.15.123:0/2827619955 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559542bf3410 msgr2=0x559542c26e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:11.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.609+0000 7fa05affd640 1 --2- 172.21.15.123:0/2827619955 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559542bf3410 0x559542c26e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.609+0000 7fa05affd640 1 -- 172.21.15.123:0/2827619955 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559542c155e0 msgr2=0x559542c268c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:11.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.609+0000 7fa05affd640 1 --2- 172.21.15.123:0/2827619955 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559542c155e0 0x559542c268c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.609+0000 7fa05affd640 1 -- 172.21.15.123:0/2827619955 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595428040f0 con 0x559542c13200 2024-09-15T23:18:11.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.609+0000 7fa05affd640 1 --2- 172.21.15.123:0/2827619955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559542c13200 0x559542bce040 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fa04c089740 tx=0x7fa04c059280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31c7ceda229c0f60 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:11.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.609+0000 7fa03a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:18:11.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.609+0000 7fa03a7fc640 1 -- 172.21.15.123:0/2827619955 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c05d1b0 con 0x559542c13200 2024-09-15T23:18:11.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.609+0000 7fa03a7fc640 1 -- 172.21.15.123:0/2827619955 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 5767+0+0 (secure 0 0 0) 0x7fa04c05d350 con 0x559542c13200 2024-09-15T23:18:11.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.609+0000 7fa06482c740 1 -- 172.21.15.123:0/2827619955 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa050003790 con 0x559542c13200 2024-09-15T23:18:11.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.609+0000 7fa03a7fc640 1 -- 172.21.15.123:0/2827619955 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fa04c0619d0 con 0x559542c13200 2024-09-15T23:18:11.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.609+0000 7fa06482c740 10 client.7800 fetch_fsmap learned FSMap version 74 2024-09-15T23:18:11.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.609+0000 7fa06482c740 1 -- 172.21.15.123:0/2827619955 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x55954296ef60 con 0x559542c13200 2024-09-15T23:18:11.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.609+0000 7fa03a7fc640 1 -- 172.21.15.123:0/2827619955 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa050003790 con 0x559542c13200 2024-09-15T23:18:11.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.609+0000 7fa03a7fc640 1 -- 172.21.15.123:0/2827619955 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 74) ==== 3502+0+0 (secure 0 0 0) 0x7fa04c089b60 con 0x559542c13200 2024-09-15T23:18:11.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.609+0000 7fa06482c740 10 client.7800 fetch_fsmap finished waiting for FSMap version 74 2024-09-15T23:18:11.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.609+0000 7fa06482c740 10 client.7800 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-15T23:18:11.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.609+0000 7fa06482c740 20 client.7800 populate_metadata read hostname 'smithi123' 2024-09-15T23:18:11.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.609+0000 7fa06482c740 1 --2- 172.21.15.123:0/2827619955 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x559542be5e80 0x559542be6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.609+0000 7fa06482c740 4 client.7800 mds_command: new command op to 7608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:18:11.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.609+0000 7fa06482c740 1 -- 172.21.15.123:0/2827619955 --> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559542b3f000 con 0x559542be5e80 2024-09-15T23:18:11.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.610+0000 7fa05a7fc640 1 --2- 172.21.15.123:0/2827619955 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x559542be5e80 0x559542be6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:11.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.610+0000 7fa03a7fc640 10 client.7800 ms_handle_connect on v2:172.21.15.123:6833/3823805081 2024-09-15T23:18:11.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.610+0000 7fa05a7fc640 1 --2- 172.21.15.123:0/2827619955 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x559542be5e80 0x559542be6280 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b838e9745fece355 server_cookie=134a0173f2231cf8 in_seq=0 out_seq=0 2024-09-15T23:18:11.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.610+0000 7fa03a7fc640 1 -- 172.21.15.123:0/2827619955 <== mds.0 v2:172.21.15.123:6833/3823805081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559542b3f000 con 0x559542be5e80 2024-09-15T23:18:11.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.610+0000 7fa03a7fc640 10 client.7800 handle_command_reply: tid=0 2024-09-15T23:18:11.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.610+0000 7fa06482c740 1 client.7800 shutdown 2024-09-15T23:18:11.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.611+0000 7fa06482c740 1 -- 172.21.15.123:0/2827619955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559542c13200 msgr2=0x559542bce040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:11.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.611+0000 7fa06482c740 1 --2- 172.21.15.123:0/2827619955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559542c13200 0x559542bce040 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fa04c089740 tx=0x7fa04c059280 comp rx=0 tx=0).stop 2024-09-15T23:18:11.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.611+0000 7fa06482c740 1 -- 172.21.15.123:0/2827619955 shutdown_connections 2024-09-15T23:18:11.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.611+0000 7fa06482c740 1 --2- 172.21.15.123:0/2827619955 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x559542be5e80 0x559542be6280 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.611+0000 7fa06482c740 1 --2- 172.21.15.123:0/2827619955 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559542bf3410 0x559542c26e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.611+0000 7fa06482c740 1 --2- 172.21.15.123:0/2827619955 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559542c155e0 0x559542c268c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.611+0000 7fa03a7fc640 0 client.7800 ms_handle_reset on v2:172.21.15.123:6833/3823805081 2024-09-15T23:18:11.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.611+0000 7fa06482c740 1 --2- 172.21.15.123:0/2827619955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559542c13200 0x559542bce040 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.611+0000 7fa06482c740 1 -- 172.21.15.123:0/2827619955 >> 172.21.15.123:0/2827619955 conn(0x559542c12da0 msgr2=0x559542bf5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:11.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.611+0000 7fa06482c740 1 -- 172.21.15.123:0/2827619955 shutdown_connections 2024-09-15T23:18:11.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.611+0000 7fa06482c740 1 -- 172.21.15.123:0/2827619955 wait complete. 2024-09-15T23:18:11.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.611+0000 7fa06482c740 20 client.7800 trim_cache size 0 max 16384 2024-09-15T23:18:11.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.627+0000 7fa06482c740 1 Processor -- start 2024-09-15T23:18:11.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.627+0000 7fa06482c740 1 -- start start 2024-09-15T23:18:11.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.628+0000 7fa06482c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559542bf3410 0x559542be6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.628+0000 7fa06482c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559542c13200 0x559542c0a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.628+0000 7fa06482c740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559542c155e0 0x559542c16bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.628+0000 7fa06482c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c200a10 con 0x559542bf3410 2024-09-15T23:18:11.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.628+0000 7fa06482c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c1ffae0 con 0x559542c13200 2024-09-15T23:18:11.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.628+0000 7fa06482c740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa05c071f90 con 0x559542c155e0 2024-09-15T23:18:11.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.628+0000 7fa05affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559542bf3410 0x559542be6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:11.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.628+0000 7fa05affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559542bf3410 0x559542be6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33708/0 (socket says 172.21.15.123:33708) 2024-09-15T23:18:11.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.628+0000 7fa05affd640 1 -- 172.21.15.123:0/4028817599 learned_addr learned my addr 172.21.15.123:0/4028817599 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:11.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.628+0000 7fa05b7fe640 1 --2- 172.21.15.123:0/4028817599 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559542c155e0 0x559542c16bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:11.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.628+0000 7fa05a7fc640 1 --2- 172.21.15.123:0/4028817599 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559542c13200 0x559542c0a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:11.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.628+0000 7fa05affd640 1 -- 172.21.15.123:0/4028817599 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559542c155e0 msgr2=0x559542c16bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:11.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.628+0000 7fa05affd640 1 --2- 172.21.15.123:0/4028817599 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559542c155e0 0x559542c16bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.628+0000 7fa05affd640 1 -- 172.21.15.123:0/4028817599 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559542c13200 msgr2=0x559542c0a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:11.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.628+0000 7fa05affd640 1 --2- 172.21.15.123:0/4028817599 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559542c13200 0x559542c0a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.628+0000 7fa05affd640 1 -- 172.21.15.123:0/4028817599 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595427dd1b0 con 0x559542bf3410 2024-09-15T23:18:11.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.628+0000 7fa05a7fc640 1 --2- 172.21.15.123:0/4028817599 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559542c13200 0x559542c0a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:18:11.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.628+0000 7fa05affd640 1 --2- 172.21.15.123:0/4028817599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559542bf3410 0x559542be6360 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fa04c057530 tx=0x7fa04c05b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2837429ee7114b83 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:11.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.628+0000 7fa040ff9640 1 -- 172.21.15.123:0/4028817599 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c071180 con 0x559542bf3410 2024-09-15T23:18:11.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.628+0000 7fa040ff9640 1 -- 172.21.15.123:0/4028817599 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa04c089b60 con 0x559542bf3410 2024-09-15T23:18:11.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.628+0000 7fa040ff9640 1 -- 172.21.15.123:0/4028817599 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c05d3f0 con 0x559542bf3410 2024-09-15T23:18:11.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.629+0000 7fa06482c740 1 -- 172.21.15.123:0/4028817599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559542bf3410 msgr2=0x559542be6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:11.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.629+0000 7fa06482c740 1 --2- 172.21.15.123:0/4028817599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559542bf3410 0x559542be6360 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fa04c057530 tx=0x7fa04c05b000 comp rx=0 tx=0).stop 2024-09-15T23:18:11.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.629+0000 7fa06482c740 1 -- 172.21.15.123:0/4028817599 shutdown_connections 2024-09-15T23:18:11.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.629+0000 7fa06482c740 1 --2- 172.21.15.123:0/4028817599 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559542c155e0 0x559542c16bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.629+0000 7fa06482c740 1 --2- 172.21.15.123:0/4028817599 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559542c13200 0x559542c0a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.629+0000 7fa06482c740 1 --2- 172.21.15.123:0/4028817599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559542bf3410 0x559542be6360 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.629+0000 7fa06482c740 1 -- 172.21.15.123:0/4028817599 >> 172.21.15.123:0/4028817599 conn(0x559542c12da0 msgr2=0x559542bf8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:11.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.629+0000 7fa06482c740 1 -- 172.21.15.123:0/4028817599 shutdown_connections 2024-09-15T23:18:11.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.629+0000 7fa06482c740 1 -- 172.21.15.123:0/4028817599 wait complete. 2024-09-15T23:18:11.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.630+0000 7fa06482c740 1 -- start start 2024-09-15T23:18:11.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.630+0000 7fa06482c740 1 Processor -- start 2024-09-15T23:18:11.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.630+0000 7fa06482c740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559542bf3410 0x559542c139c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.630+0000 7fa06482c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559542c13200 0x559542bc9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.630+0000 7fa06482c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559542c155e0 0x559542c90810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.630+0000 7fa06482c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x559542c0a9f0 con 0x559542c13200 2024-09-15T23:18:11.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.630+0000 7fa06482c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c15bfb0 con 0x559542c155e0 2024-09-15T23:18:11.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.630+0000 7fa06482c740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x559542bc84a0 con 0x559542bf3410 2024-09-15T23:18:11.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.630+0000 7fa06482c740 10 client.0 _ll_register_callbacks cb 0x7fa04c08b0f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:18:11.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.630+0000 7fa05a7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559542c13200 0x559542bc9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:11.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.630+0000 7fa05a7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559542c13200 0x559542bc9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33716/0 (socket says 172.21.15.123:33716) 2024-09-15T23:18:11.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.630+0000 7fa05a7fc640 1 -- 172.21.15.123:0/2007884085 learned_addr learned my addr 172.21.15.123:0/2007884085 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:11.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.631+0000 7fa05affd640 1 --2- 172.21.15.123:0/2007884085 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559542bf3410 0x559542c139c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:11.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.631+0000 7fa05b7fe640 1 --2- 172.21.15.123:0/2007884085 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559542c155e0 0x559542c90810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:11.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.631+0000 7fa05a7fc640 1 -- 172.21.15.123:0/2007884085 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559542bf3410 msgr2=0x559542c139c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:11.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.631+0000 7fa05a7fc640 1 --2- 172.21.15.123:0/2007884085 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559542bf3410 0x559542c139c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.631+0000 7fa05a7fc640 1 -- 172.21.15.123:0/2007884085 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559542c155e0 msgr2=0x559542c90810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:11.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.631+0000 7fa05a7fc640 1 --2- 172.21.15.123:0/2007884085 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559542c155e0 0x559542c90810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.631+0000 7fa05a7fc640 1 -- 172.21.15.123:0/2007884085 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559542bcd520 con 0x559542c13200 2024-09-15T23:18:11.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.631+0000 7fa05b7fe640 1 --2- 172.21.15.123:0/2007884085 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559542c155e0 0x559542c90810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:18:11.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.631+0000 7fa05a7fc640 1 --2- 172.21.15.123:0/2007884085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559542c13200 0x559542bc9af0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fa050000f60 tx=0x7fa050013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=727053bf0f54afd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:11.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.631+0000 7fa03a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:18:11.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.631+0000 7fa03a7fc640 1 -- 172.21.15.123:0/2007884085 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa050003cc0 con 0x559542c13200 2024-09-15T23:18:11.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.631+0000 7fa03a7fc640 1 -- 172.21.15.123:0/2007884085 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 5767+0+0 (secure 0 0 0) 0x7fa05002d460 con 0x559542c13200 2024-09-15T23:18:11.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.631+0000 7fa06482c740 1 -- 172.21.15.123:0/2007884085 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa04c089b60 con 0x559542c13200 2024-09-15T23:18:11.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.631+0000 7fa03a7fc640 1 -- 172.21.15.123:0/2007884085 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fa050036050 con 0x559542c13200 2024-09-15T23:18:11.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.631+0000 7fa06482c740 10 client.7806 fetch_fsmap learned FSMap version 74 2024-09-15T23:18:11.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.631+0000 7fa06482c740 1 -- 172.21.15.123:0/2007884085 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x559542c0a070 con 0x559542c13200 2024-09-15T23:18:11.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.631+0000 7fa03a7fc640 1 -- 172.21.15.123:0/2007884085 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa04c089b60 con 0x559542c13200 2024-09-15T23:18:11.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.631+0000 7fa03a7fc640 1 -- 172.21.15.123:0/2007884085 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 74) ==== 3502+0+0 (secure 0 0 0) 0x7fa050039020 con 0x559542c13200 2024-09-15T23:18:11.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.631+0000 7fa06482c740 10 client.7806 fetch_fsmap finished waiting for FSMap version 74 2024-09-15T23:18:11.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.631+0000 7fa06482c740 10 client.7806 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-15T23:18:11.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.631+0000 7fa06482c740 20 client.7806 populate_metadata read hostname 'smithi123' 2024-09-15T23:18:11.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.631+0000 7fa06482c740 1 --2- 172.21.15.123:0/2007884085 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x559542c09430 0x559542c16bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.631+0000 7fa06482c740 4 client.7806 mds_command: new command op to 7608 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-09-15T23:18:11.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.631+0000 7fa06482c740 1 -- 172.21.15.123:0/2007884085 --> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] -- command(tid 0: {"prefix": "perf dump"}) -- 0x559542b39350 con 0x559542c09430 2024-09-15T23:18:11.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.632+0000 7fa05affd640 1 --2- 172.21.15.123:0/2007884085 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x559542c09430 0x559542c16bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:11.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.632+0000 7fa03a7fc640 10 client.7806 ms_handle_connect on v2:172.21.15.123:6833/3823805081 2024-09-15T23:18:11.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.632+0000 7fa05affd640 1 --2- 172.21.15.123:0/2007884085 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x559542c09430 0x559542c16bb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12768ae67f586eb8 server_cookie=db9030ab409945c8 in_seq=0 out_seq=0 2024-09-15T23:18:11.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.632+0000 7fa03a7fc640 1 -- 172.21.15.123:0/2007884085 <== mds.0 v2:172.21.15.123:6833/3823805081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+17987 (crc 0 0 0) 0x559542b39350 con 0x559542c09430 2024-09-15T23:18:11.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.632+0000 7fa03a7fc640 10 client.7806 handle_command_reply: tid=0 2024-09-15T23:18:11.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.632+0000 7fa06482c740 1 client.7806 shutdown 2024-09-15T23:18:11.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.632+0000 7fa06482c740 1 -- 172.21.15.123:0/2007884085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559542c13200 msgr2=0x559542bc9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:11.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.632+0000 7fa06482c740 1 --2- 172.21.15.123:0/2007884085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559542c13200 0x559542bc9af0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fa050000f60 tx=0x7fa050013000 comp rx=0 tx=0).stop 2024-09-15T23:18:11.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.632+0000 7fa06482c740 1 -- 172.21.15.123:0/2007884085 shutdown_connections 2024-09-15T23:18:11.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.632+0000 7fa06482c740 1 --2- 172.21.15.123:0/2007884085 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x559542c09430 0x559542c16bb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.632+0000 7fa06482c740 1 --2- 172.21.15.123:0/2007884085 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559542c155e0 0x559542c90810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.632+0000 7fa06482c740 1 --2- 172.21.15.123:0/2007884085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559542c13200 0x559542bc9af0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.632+0000 7fa06482c740 1 --2- 172.21.15.123:0/2007884085 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559542bf3410 0x559542c139c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.632+0000 7fa03a7fc640 0 client.7806 ms_handle_reset on v2:172.21.15.123:6833/3823805081 2024-09-15T23:18:11.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.632+0000 7fa06482c740 1 -- 172.21.15.123:0/2007884085 >> 172.21.15.123:0/2007884085 conn(0x559542c12da0 msgr2=0x559542c0b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:11.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.633+0000 7fa06482c740 1 -- 172.21.15.123:0/2007884085 shutdown_connections 2024-09-15T23:18:11.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.633+0000 7fa06482c740 1 -- 172.21.15.123:0/2007884085 wait complete. 2024-09-15T23:18:11.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.633+0000 7fa06482c740 20 client.7806 trim_cache size 0 max 16384 2024-09-15T23:18:11.644 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:18:11.644 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T23:18:11.644 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 28547, 2024-09-15T23:18:11.644 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 50981, 2024-09-15T23:18:11.644 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 9370581, 2024-09-15T23:18:11.645 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 49143962, 2024-09-15T23:18:11.645 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 11, 2024-09-15T23:18:11.645 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 3, 2024-09-15T23:18:11.645 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 2.769418400, 2024-09-15T23:18:11.645 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 2.134562852, 2024-09-15T23:18:11.645 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 1.543228768, 2024-09-15T23:18:11.645 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.035693479, 2024-09-15T23:18:11.645 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:18:11.645 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 50979, 2024-09-15T23:18:11.645 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 1.123637618, 2024-09-15T23:18:11.645 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000022041 2024-09-15T23:18:11.646 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.646 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:18:11.646 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 49413, 2024-09-15T23:18:11.646 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.008298925, 2024-09-15T23:18:11.646 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000167 2024-09-15T23:18:11.646 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.646 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T23:18:11.646 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T23:18:11.646 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.646 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T23:18:11.646 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 2009, 2024-09-15T23:18:11.647 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 2022, 2024-09-15T23:18:11.647 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 693134, 2024-09-15T23:18:11.647 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 42335746, 2024-09-15T23:18:11.647 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 6, 2024-09-15T23:18:11.647 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 4, 2024-09-15T23:18:11.647 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.250066462, 2024-09-15T23:18:11.647 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.140872164, 2024-09-15T23:18:11.647 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.035095175, 2024-09-15T23:18:11.647 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.061989034, 2024-09-15T23:18:11.647 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:18:11.647 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2021, 2024-09-15T23:18:11.647 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.233051205, 2024-09-15T23:18:11.648 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000115314 2024-09-15T23:18:11.648 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.648 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:18:11.648 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:11.648 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:11.648 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:11.648 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.648 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 1728, 2024-09-15T23:18:11.648 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 110400 2024-09-15T23:18:11.648 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.648 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T23:18:11.648 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 1656, 2024-09-15T23:18:11.649 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 1650, 2024-09-15T23:18:11.649 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 517881, 2024-09-15T23:18:11.649 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 27618120, 2024-09-15T23:18:11.649 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 5, 2024-09-15T23:18:11.649 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 4, 2024-09-15T23:18:11.649 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.233633522, 2024-09-15T23:18:11.649 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.098694800, 2024-09-15T23:18:11.649 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.036273908, 2024-09-15T23:18:11.649 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.095956944, 2024-09-15T23:18:11.649 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:18:11.649 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1650, 2024-09-15T23:18:11.649 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.245137881, 2024-09-15T23:18:11.649 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000148568 2024-09-15T23:18:11.650 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.650 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:18:11.650 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:11.650 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:11.650 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:11.650 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.650 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 118848, 2024-09-15T23:18:11.650 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 19120 2024-09-15T23:18:11.650 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.650 INFO:teuthology.orchestra.run.smithi123.stdout: "cct": { 2024-09-15T23:18:11.650 INFO:teuthology.orchestra.run.smithi123.stdout: "total_workers": 1, 2024-09-15T23:18:11.650 INFO:teuthology.orchestra.run.smithi123.stdout: "unhealthy_workers": 0 2024-09-15T23:18:11.650 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.651 INFO:teuthology.orchestra.run.smithi123.stdout: "finisher-MDSRank": { 2024-09-15T23:18:11.651 INFO:teuthology.orchestra.run.smithi123.stdout: "queue_len": 0, 2024-09-15T23:18:11.651 INFO:teuthology.orchestra.run.smithi123.stdout: "complete_latency": { 2024-09-15T23:18:11.651 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1317, 2024-09-15T23:18:11.651 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 17.055158287, 2024-09-15T23:18:11.651 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.012950006 2024-09-15T23:18:11.651 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:11.651 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.651 INFO:teuthology.orchestra.run.smithi123.stdout: "finisher-PurgeQueue": { 2024-09-15T23:18:11.651 INFO:teuthology.orchestra.run.smithi123.stdout: "queue_len": 0, 2024-09-15T23:18:11.651 INFO:teuthology.orchestra.run.smithi123.stdout: "complete_latency": { 2024-09-15T23:18:11.651 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1995, 2024-09-15T23:18:11.651 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.922022850, 2024-09-15T23:18:11.651 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000462166 2024-09-15T23:18:11.651 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:11.652 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.652 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-09-15T23:18:11.652 INFO:teuthology.orchestra.run.smithi123.stdout: "request": 25667, 2024-09-15T23:18:11.652 INFO:teuthology.orchestra.run.smithi123.stdout: "reply": 25667, 2024-09-15T23:18:11.652 INFO:teuthology.orchestra.run.smithi123.stdout: "reply_latency": { 2024-09-15T23:18:11.652 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 25667, 2024-09-15T23:18:11.652 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 301.730484568, 2024-09-15T23:18:11.652 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.011755580 2024-09-15T23:18:11.652 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.652 INFO:teuthology.orchestra.run.smithi123.stdout: "slow_reply": 0, 2024-09-15T23:18:11.652 INFO:teuthology.orchestra.run.smithi123.stdout: "forward": 0, 2024-09-15T23:18:11.652 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_fetch_complete": 0, 2024-09-15T23:18:11.653 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_fetch_keys": 0, 2024-09-15T23:18:11.653 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_commit": 12, 2024-09-15T23:18:11.653 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_split": 0, 2024-09-15T23:18:11.653 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_merge": 0, 2024-09-15T23:18:11.653 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes": 19839, 2024-09-15T23:18:11.653 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_top": 0, 2024-09-15T23:18:11.653 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_bottom": 19839, 2024-09-15T23:18:11.653 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_pin_tail": 0, 2024-09-15T23:18:11.653 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_pinned": 19838, 2024-09-15T23:18:11.653 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_expired": 0, 2024-09-15T23:18:11.653 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_with_caps": 68, 2024-09-15T23:18:11.653 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": 68, 2024-09-15T23:18:11.653 INFO:teuthology.orchestra.run.smithi123.stdout: "subtrees": 2, 2024-09-15T23:18:11.654 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse": 46596, 2024-09-15T23:18:11.654 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_hit": 46116, 2024-09-15T23:18:11.654 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_forward": 0, 2024-09-15T23:18:11.654 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_discover": 0, 2024-09-15T23:18:11.654 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_dir_fetch": 0, 2024-09-15T23:18:11.654 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_remote_ino": 0, 2024-09-15T23:18:11.654 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_lock": 81, 2024-09-15T23:18:11.654 INFO:teuthology.orchestra.run.smithi123.stdout: "load_cent": 0, 2024-09-15T23:18:11.654 INFO:teuthology.orchestra.run.smithi123.stdout: "q": 0, 2024-09-15T23:18:11.654 INFO:teuthology.orchestra.run.smithi123.stdout: "exported": 0, 2024-09-15T23:18:11.654 INFO:teuthology.orchestra.run.smithi123.stdout: "exported_inodes": 0, 2024-09-15T23:18:11.655 INFO:teuthology.orchestra.run.smithi123.stdout: "imported": 0, 2024-09-15T23:18:11.655 INFO:teuthology.orchestra.run.smithi123.stdout: "imported_inodes": 0, 2024-09-15T23:18:11.655 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_dir_fetch": 0, 2024-09-15T23:18:11.655 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_backtrace_fetch": 0, 2024-09-15T23:18:11.655 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_peer_discover": 0, 2024-09-15T23:18:11.655 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rfiles": 0, 2024-09-15T23:18:11.655 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rbytes": 0, 2024-09-15T23:18:11.655 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rsnaps": 0, 2024-09-15T23:18:11.655 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_backtrace_fetch": 0, 2024-09-15T23:18:11.656 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_set_tag": 0, 2024-09-15T23:18:11.656 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T23:18:11.656 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_inotable_repaired": 0, 2024-09-15T23:18:11.656 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dir_inodes": 0, 2024-09-15T23:18:11.656 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dir_base_inodes": 0, 2024-09-15T23:18:11.656 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dirfrag_rstats": 0, 2024-09-15T23:18:11.656 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_file_inodes": 0, 2024-09-15T23:18:11.656 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_inode_file_caps": 0, 2024-09-15T23:18:11.656 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_revoke": 1145, 2024-09-15T23:18:11.656 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_grant": 4044, 2024-09-15T23:18:11.656 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_trunc": 0, 2024-09-15T23:18:11.656 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T23:18:11.657 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T23:18:11.657 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_caps": 4002, 2024-09-15T23:18:11.657 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_caps_dirty": 3328, 2024-09-15T23:18:11.657 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_cap_release": 40, 2024-09-15T23:18:11.657 INFO:teuthology.orchestra.run.smithi123.stdout: "process_request_cap_release": 14102 2024-09-15T23:18:11.657 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.657 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_cache": { 2024-09-15T23:18:11.657 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_update": 0, 2024-09-15T23:18:11.657 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_update_receipt": 0, 2024-09-15T23:18:11.657 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_try_discover": 0, 2024-09-15T23:18:11.657 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_send_discover": 0, 2024-09-15T23:18:11.658 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_handle_discover": 0, 2024-09-15T23:18:11.658 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays": 2000, 2024-09-15T23:18:11.658 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays_delayed": 162, 2024-09-15T23:18:11.658 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays_enqueuing": 0, 2024-09-15T23:18:11.658 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_created": 4156, 2024-09-15T23:18:11.658 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_enqueued": 1772, 2024-09-15T23:18:11.658 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_reintegrated": 2234, 2024-09-15T23:18:11.658 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_migrated": 0, 2024-09-15T23:18:11.658 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_processing": 0, 2024-09-15T23:18:11.658 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_enqueued": 0, 2024-09-15T23:18:11.658 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_prioritized": 0, 2024-09-15T23:18:11.658 INFO:teuthology.orchestra.run.smithi123.stdout: "recovery_started": 0, 2024-09-15T23:18:11.659 INFO:teuthology.orchestra.run.smithi123.stdout: "recovery_completed": 0, 2024-09-15T23:18:11.659 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_quiesce_path": 0, 2024-09-15T23:18:11.659 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_quiesce_inode": 0, 2024-09-15T23:18:11.659 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_enqueue_scrub": 0, 2024-09-15T23:18:11.659 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_exportdir": 0, 2024-09-15T23:18:11.659 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_flush": 0, 2024-09-15T23:18:11.659 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_fragmentdir": 0, 2024-09-15T23:18:11.659 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_fragstats": 0, 2024-09-15T23:18:11.659 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_inodestats": 0 2024-09-15T23:18:11.659 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.660 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_log": { 2024-09-15T23:18:11.660 INFO:teuthology.orchestra.run.smithi123.stdout: "evlrg": 0, 2024-09-15T23:18:11.660 INFO:teuthology.orchestra.run.smithi123.stdout: "evadd": 26444, 2024-09-15T23:18:11.660 INFO:teuthology.orchestra.run.smithi123.stdout: "evex": 0, 2024-09-15T23:18:11.660 INFO:teuthology.orchestra.run.smithi123.stdout: "evtrm": 0, 2024-09-15T23:18:11.660 INFO:teuthology.orchestra.run.smithi123.stdout: "ev": 26444, 2024-09-15T23:18:11.660 INFO:teuthology.orchestra.run.smithi123.stdout: "evexg": 0, 2024-09-15T23:18:11.660 INFO:teuthology.orchestra.run.smithi123.stdout: "evexd": 0, 2024-09-15T23:18:11.660 INFO:teuthology.orchestra.run.smithi123.stdout: "segadd": 40, 2024-09-15T23:18:11.660 INFO:teuthology.orchestra.run.smithi123.stdout: "segex": 0, 2024-09-15T23:18:11.660 INFO:teuthology.orchestra.run.smithi123.stdout: "segtrm": 0, 2024-09-15T23:18:11.660 INFO:teuthology.orchestra.run.smithi123.stdout: "seg": 40, 2024-09-15T23:18:11.661 INFO:teuthology.orchestra.run.smithi123.stdout: "segmjr": 4, 2024-09-15T23:18:11.661 INFO:teuthology.orchestra.run.smithi123.stdout: "segexg": 0, 2024-09-15T23:18:11.661 INFO:teuthology.orchestra.run.smithi123.stdout: "segexd": 0, 2024-09-15T23:18:11.661 INFO:teuthology.orchestra.run.smithi123.stdout: "expos": 4194304, 2024-09-15T23:18:11.661 INFO:teuthology.orchestra.run.smithi123.stdout: "wrpos": 99326457, 2024-09-15T23:18:11.661 INFO:teuthology.orchestra.run.smithi123.stdout: "rdpos": 0, 2024-09-15T23:18:11.661 INFO:teuthology.orchestra.run.smithi123.stdout: "jlat": { 2024-09-15T23:18:11.661 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2620, 2024-09-15T23:18:11.661 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 85.285560844, 2024-09-15T23:18:11.661 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.032551740 2024-09-15T23:18:11.661 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.661 INFO:teuthology.orchestra.run.smithi123.stdout: "replayed": 0 2024-09-15T23:18:11.661 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.662 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_mem": { 2024-09-15T23:18:11.662 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 2014, 2024-09-15T23:18:11.662 INFO:teuthology.orchestra.run.smithi123.stdout: "ino+": 2014, 2024-09-15T23:18:11.662 INFO:teuthology.orchestra.run.smithi123.stdout: "ino-": 0, 2024-09-15T23:18:11.662 INFO:teuthology.orchestra.run.smithi123.stdout: "dir": 13, 2024-09-15T23:18:11.662 INFO:teuthology.orchestra.run.smithi123.stdout: "dir+": 13, 2024-09-15T23:18:11.662 INFO:teuthology.orchestra.run.smithi123.stdout: "dir-": 0, 2024-09-15T23:18:11.662 INFO:teuthology.orchestra.run.smithi123.stdout: "dn": 19839, 2024-09-15T23:18:11.662 INFO:teuthology.orchestra.run.smithi123.stdout: "dn+": 19840, 2024-09-15T23:18:11.662 INFO:teuthology.orchestra.run.smithi123.stdout: "dn-": 1, 2024-09-15T23:18:11.662 INFO:teuthology.orchestra.run.smithi123.stdout: "cap": 68, 2024-09-15T23:18:11.662 INFO:teuthology.orchestra.run.smithi123.stdout: "cap+": 6055, 2024-09-15T23:18:11.663 INFO:teuthology.orchestra.run.smithi123.stdout: "cap-": 5987, 2024-09-15T23:18:11.663 INFO:teuthology.orchestra.run.smithi123.stdout: "rss": 113684, 2024-09-15T23:18:11.663 INFO:teuthology.orchestra.run.smithi123.stdout: "heap": 231788 2024-09-15T23:18:11.663 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.663 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_server": { 2024-09-15T23:18:11.663 INFO:teuthology.orchestra.run.smithi123.stdout: "dispatch_client_request": 28551, 2024-09-15T23:18:11.663 INFO:teuthology.orchestra.run.smithi123.stdout: "dispatch_server_request": 0, 2024-09-15T23:18:11.663 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_request": 25667, 2024-09-15T23:18:11.663 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_session": 3, 2024-09-15T23:18:11.663 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_peer_request": 0, 2024-09-15T23:18:11.663 INFO:teuthology.orchestra.run.smithi123.stdout: "req_create_latency": { 2024-09-15T23:18:11.663 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2000, 2024-09-15T23:18:11.663 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 1.735919280, 2024-09-15T23:18:11.664 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000867959 2024-09-15T23:18:11.664 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.664 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getattr_latency": { 2024-09-15T23:18:11.664 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 25, 2024-09-15T23:18:11.664 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.003444449, 2024-09-15T23:18:11.664 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000137777 2024-09-15T23:18:11.664 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.664 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getfilelock_latency": { 2024-09-15T23:18:11.664 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:11.664 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:11.664 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:11.665 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.665 INFO:teuthology.orchestra.run.smithi123.stdout: "req_link_latency": { 2024-09-15T23:18:11.665 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 6000, 2024-09-15T23:18:11.665 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 6.767079046, 2024-09-15T23:18:11.665 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.001127846 2024-09-15T23:18:11.665 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.665 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookup_latency": { 2024-09-15T23:18:11.665 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 7394, 2024-09-15T23:18:11.665 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 5.333378574, 2024-09-15T23:18:11.665 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000721311 2024-09-15T23:18:11.665 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.665 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookuphash_latency": { 2024-09-15T23:18:11.665 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:11.666 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:11.666 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:11.666 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.666 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupino_latency": { 2024-09-15T23:18:11.666 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:11.666 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:11.666 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:11.666 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.666 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupname_latency": { 2024-09-15T23:18:11.666 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:11.666 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:11.667 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:11.667 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.667 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupparent_latency": { 2024-09-15T23:18:11.667 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:11.667 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:11.667 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:11.667 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.667 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupsnap_latency": { 2024-09-15T23:18:11.667 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1, 2024-09-15T23:18:11.667 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000037358, 2024-09-15T23:18:11.667 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000037358 2024-09-15T23:18:11.667 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.668 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lssnap_latency": { 2024-09-15T23:18:11.668 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:11.668 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:11.668 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:11.668 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.668 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mkdir_latency": { 2024-09-15T23:18:11.668 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1, 2024-09-15T23:18:11.668 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.002762232, 2024-09-15T23:18:11.668 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.002762232 2024-09-15T23:18:11.668 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.668 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mknod_latency": { 2024-09-15T23:18:11.668 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:11.669 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:11.669 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:11.669 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.669 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mksnap_latency": { 2024-09-15T23:18:11.669 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1, 2024-09-15T23:18:11.669 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.229594131, 2024-09-15T23:18:11.669 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.229594131 2024-09-15T23:18:11.669 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.669 INFO:teuthology.orchestra.run.smithi123.stdout: "req_open_latency": { 2024-09-15T23:18:11.669 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1, 2024-09-15T23:18:11.669 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000079997, 2024-09-15T23:18:11.670 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000079997 2024-09-15T23:18:11.670 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.670 INFO:teuthology.orchestra.run.smithi123.stdout: "req_readdir_latency": { 2024-09-15T23:18:11.670 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 8, 2024-09-15T23:18:11.670 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 1.644402548, 2024-09-15T23:18:11.670 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.205550318 2024-09-15T23:18:11.670 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.670 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rename_latency": { 2024-09-15T23:18:11.670 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2234, 2024-09-15T23:18:11.670 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 267.593087982, 2024-09-15T23:18:11.670 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.119782044 2024-09-15T23:18:11.671 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.671 INFO:teuthology.orchestra.run.smithi123.stdout: "req_renamesnap_latency": { 2024-09-15T23:18:11.671 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:11.671 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:11.671 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:11.671 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.671 INFO:teuthology.orchestra.run.smithi123.stdout: "req_snapdiff_latency": { 2024-09-15T23:18:11.671 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:11.671 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:11.671 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:11.671 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.671 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmdir_latency": { 2024-09-15T23:18:11.671 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:11.672 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:11.672 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:11.672 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.672 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmsnap_latency": { 2024-09-15T23:18:11.672 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1, 2024-09-15T23:18:11.672 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.141160562, 2024-09-15T23:18:11.672 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.141160562 2024-09-15T23:18:11.672 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.672 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmxattr_latency": { 2024-09-15T23:18:11.672 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:11.672 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:11.672 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:11.672 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.673 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setattr_latency": { 2024-09-15T23:18:11.673 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1, 2024-09-15T23:18:11.673 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000249191, 2024-09-15T23:18:11.673 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000249191 2024-09-15T23:18:11.673 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.673 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setdirlayout_latency": { 2024-09-15T23:18:11.673 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:11.673 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:11.673 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:11.673 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.673 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setfilelock_latency": { 2024-09-15T23:18:11.673 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:11.673 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:11.673 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:11.674 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.674 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setlayout_latency": { 2024-09-15T23:18:11.674 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:11.674 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:11.674 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:11.674 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.674 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setxattr_latency": { 2024-09-15T23:18:11.674 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:11.674 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:11.674 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:11.674 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.675 INFO:teuthology.orchestra.run.smithi123.stdout: "req_symlink_latency": { 2024-09-15T23:18:11.675 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:11.675 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:11.675 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:11.675 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.675 INFO:teuthology.orchestra.run.smithi123.stdout: "req_unlink_latency": { 2024-09-15T23:18:11.675 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 8000, 2024-09-15T23:18:11.675 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 18.279289218, 2024-09-15T23:18:11.675 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.002284911 2024-09-15T23:18:11.675 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.675 INFO:teuthology.orchestra.run.smithi123.stdout: "cap_revoke_eviction": 0, 2024-09-15T23:18:11.676 INFO:teuthology.orchestra.run.smithi123.stdout: "cap_acquisition_throttle": 0, 2024-09-15T23:18:11.676 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getvxattr_latency": { 2024-09-15T23:18:11.676 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:11.676 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:11.676 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:11.676 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:11.676 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.676 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_sessions": { 2024-09-15T23:18:11.676 INFO:teuthology.orchestra.run.smithi123.stdout: "session_count": 1, 2024-09-15T23:18:11.676 INFO:teuthology.orchestra.run.smithi123.stdout: "session_add": 1, 2024-09-15T23:18:11.677 INFO:teuthology.orchestra.run.smithi123.stdout: "session_remove": 0, 2024-09-15T23:18:11.677 INFO:teuthology.orchestra.run.smithi123.stdout: "sessions_open": 1, 2024-09-15T23:18:11.677 INFO:teuthology.orchestra.run.smithi123.stdout: "sessions_stale": 0, 2024-09-15T23:18:11.677 INFO:teuthology.orchestra.run.smithi123.stdout: "total_load": 18630, 2024-09-15T23:18:11.677 INFO:teuthology.orchestra.run.smithi123.stdout: "average_load": 18630, 2024-09-15T23:18:11.677 INFO:teuthology.orchestra.run.smithi123.stdout: "avg_session_uptime": 46, 2024-09-15T23:18:11.677 INFO:teuthology.orchestra.run.smithi123.stdout: "mdthresh_evicted": 0 2024-09-15T23:18:11.677 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.677 INFO:teuthology.orchestra.run.smithi123.stdout: "mempool": { 2024-09-15T23:18:11.677 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_bytes": 0, 2024-09-15T23:18:11.677 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_items": 0, 2024-09-15T23:18:11.677 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T23:18:11.678 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_items": 0, 2024-09-15T23:18:11.678 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T23:18:11.678 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_items": 0, 2024-09-15T23:18:11.678 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T23:18:11.678 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T23:18:11.678 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T23:18:11.678 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T23:18:11.678 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T23:18:11.679 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_items": 0, 2024-09-15T23:18:11.679 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T23:18:11.679 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T23:18:11.679 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_bytes": 0, 2024-09-15T23:18:11.679 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_items": 0, 2024-09-15T23:18:11.679 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_bytes": 0, 2024-09-15T23:18:11.679 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_items": 0, 2024-09-15T23:18:11.679 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T23:18:11.680 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T23:18:11.680 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T23:18:11.680 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T23:18:11.680 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T23:18:11.680 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_items": 0, 2024-09-15T23:18:11.680 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_bytes": 0, 2024-09-15T23:18:11.680 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_items": 0, 2024-09-15T23:18:11.680 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T23:18:11.681 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T23:18:11.681 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_bytes": 0, 2024-09-15T23:18:11.681 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_items": 0, 2024-09-15T23:18:11.681 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_bytes": 0, 2024-09-15T23:18:11.681 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_items": 0, 2024-09-15T23:18:11.681 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T23:18:11.681 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_items": 0, 2024-09-15T23:18:11.681 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T23:18:11.682 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_items": 0, 2024-09-15T23:18:11.682 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_bytes": 19047827, 2024-09-15T23:18:11.682 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_items": 6862, 2024-09-15T23:18:11.682 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_bytes": 440, 2024-09-15T23:18:11.682 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_items": 5, 2024-09-15T23:18:11.682 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_bytes": 0, 2024-09-15T23:18:11.682 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_items": 0, 2024-09-15T23:18:11.682 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_bytes": 0, 2024-09-15T23:18:11.683 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_items": 0, 2024-09-15T23:18:11.683 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_bytes": 0, 2024-09-15T23:18:11.683 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_items": 0, 2024-09-15T23:18:11.683 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_bytes": 5504, 2024-09-15T23:18:11.683 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_items": 79, 2024-09-15T23:18:11.683 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T23:18:11.683 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_items": 0, 2024-09-15T23:18:11.683 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_bytes": 0, 2024-09-15T23:18:11.684 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_items": 0, 2024-09-15T23:18:11.684 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_bytes": 21613823, 2024-09-15T23:18:11.684 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_items": 886993, 2024-09-15T23:18:11.684 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_bytes": 0, 2024-09-15T23:18:11.684 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_items": 0, 2024-09-15T23:18:11.684 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_bytes": 0, 2024-09-15T23:18:11.684 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_items": 0 2024-09-15T23:18:11.685 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.685 INFO:teuthology.orchestra.run.smithi123.stdout: "objecter": { 2024-09-15T23:18:11.685 INFO:teuthology.orchestra.run.smithi123.stdout: "op_active": 0, 2024-09-15T23:18:11.685 INFO:teuthology.orchestra.run.smithi123.stdout: "op_laggy": 0, 2024-09-15T23:18:11.685 INFO:teuthology.orchestra.run.smithi123.stdout: "op_send": 4605, 2024-09-15T23:18:11.685 INFO:teuthology.orchestra.run.smithi123.stdout: "op_send_bytes": 95601688, 2024-09-15T23:18:11.685 INFO:teuthology.orchestra.run.smithi123.stdout: "op_resend": 37, 2024-09-15T23:18:11.686 INFO:teuthology.orchestra.run.smithi123.stdout: "op_reply": 4605, 2024-09-15T23:18:11.686 INFO:teuthology.orchestra.run.smithi123.stdout: "op_latency": { 2024-09-15T23:18:11.686 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 4605, 2024-09-15T23:18:11.686 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 19.906527689, 2024-09-15T23:18:11.686 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.004322807 2024-09-15T23:18:11.686 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.686 INFO:teuthology.orchestra.run.smithi123.stdout: "op_inflight": 0, 2024-09-15T23:18:11.686 INFO:teuthology.orchestra.run.smithi123.stdout: "oplen_avg": { 2024-09-15T23:18:11.686 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 4605, 2024-09-15T23:18:11.687 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 4697 2024-09-15T23:18:11.687 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.687 INFO:teuthology.orchestra.run.smithi123.stdout: "op": 4605, 2024-09-15T23:18:11.687 INFO:teuthology.orchestra.run.smithi123.stdout: "op_r": 41, 2024-09-15T23:18:11.687 INFO:teuthology.orchestra.run.smithi123.stdout: "op_w": 4564, 2024-09-15T23:18:11.687 INFO:teuthology.orchestra.run.smithi123.stdout: "op_rmw": 0, 2024-09-15T23:18:11.687 INFO:teuthology.orchestra.run.smithi123.stdout: "op_pg": 0, 2024-09-15T23:18:11.688 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_stat": 0, 2024-09-15T23:18:11.688 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_create": 11, 2024-09-15T23:18:11.688 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_read": 41, 2024-09-15T23:18:11.688 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_write": 2661, 2024-09-15T23:18:11.688 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_writefull": 26, 2024-09-15T23:18:11.688 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_writesame": 0, 2024-09-15T23:18:11.688 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_append": 0, 2024-09-15T23:18:11.689 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_zero": 1772, 2024-09-15T23:18:11.689 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_truncate": 0, 2024-09-15T23:18:11.689 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_delete": 34, 2024-09-15T23:18:11.689 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_mapext": 0, 2024-09-15T23:18:11.689 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_sparse_read": 0, 2024-09-15T23:18:11.689 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_clonerange": 0, 2024-09-15T23:18:11.689 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_getxattr": 0, 2024-09-15T23:18:11.689 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_setxattr": 22, 2024-09-15T23:18:11.689 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_cmpxattr": 0, 2024-09-15T23:18:11.690 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_rmxattr": 0, 2024-09-15T23:18:11.690 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_resetxattrs": 0, 2024-09-15T23:18:11.690 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_call": 0, 2024-09-15T23:18:11.690 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_watch": 0, 2024-09-15T23:18:11.690 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_notify": 0, 2024-09-15T23:18:11.690 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T23:18:11.690 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_pgls": 0, 2024-09-15T23:18:11.690 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_pgls_filter": 0, 2024-09-15T23:18:11.691 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_other": 0, 2024-09-15T23:18:11.691 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_active": 0, 2024-09-15T23:18:11.691 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_send": 0, 2024-09-15T23:18:11.691 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_resend": 0, 2024-09-15T23:18:11.691 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_ping": 0, 2024-09-15T23:18:11.691 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_active": 0, 2024-09-15T23:18:11.691 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_send": 0, 2024-09-15T23:18:11.691 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_resend": 0, 2024-09-15T23:18:11.692 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_active": 0, 2024-09-15T23:18:11.692 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_send": 0, 2024-09-15T23:18:11.692 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_resend": 0, 2024-09-15T23:18:11.692 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_active": 0, 2024-09-15T23:18:11.692 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_send": 0, 2024-09-15T23:18:11.692 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_resend": 0, 2024-09-15T23:18:11.692 INFO:teuthology.orchestra.run.smithi123.stdout: "command_active": 0, 2024-09-15T23:18:11.692 INFO:teuthology.orchestra.run.smithi123.stdout: "command_send": 0, 2024-09-15T23:18:11.693 INFO:teuthology.orchestra.run.smithi123.stdout: "command_resend": 0, 2024-09-15T23:18:11.693 INFO:teuthology.orchestra.run.smithi123.stdout: "map_epoch": 116, 2024-09-15T23:18:11.693 INFO:teuthology.orchestra.run.smithi123.stdout: "map_full": 0, 2024-09-15T23:18:11.693 INFO:teuthology.orchestra.run.smithi123.stdout: "map_inc": 3, 2024-09-15T23:18:11.693 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_sessions": 8, 2024-09-15T23:18:11.693 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_session_open": 8, 2024-09-15T23:18:11.693 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_session_close": 0, 2024-09-15T23:18:11.693 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_laggy": 0, 2024-09-15T23:18:11.693 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_wr": 100, 2024-09-15T23:18:11.693 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_rd": 0, 2024-09-15T23:18:11.693 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_del": 30 2024-09-15T23:18:11.694 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.694 INFO:teuthology.orchestra.run.smithi123.stdout: "oft": { 2024-09-15T23:18:11.694 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_objs": 1, 2024-09-15T23:18:11.694 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_kv_pairs": 0, 2024-09-15T23:18:11.694 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_updates": 0, 2024-09-15T23:18:11.694 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_removes": 0 2024-09-15T23:18:11.694 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.694 INFO:teuthology.orchestra.run.smithi123.stdout: "osd-slow-ops": { 2024-09-15T23:18:11.694 INFO:teuthology.orchestra.run.smithi123.stdout: "slow_ops_count": 0 2024-09-15T23:18:11.694 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.694 INFO:teuthology.orchestra.run.smithi123.stdout: "purge_queue": { 2024-09-15T23:18:11.695 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_ops": 0, 2024-09-15T23:18:11.695 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_ops_high_water": 32, 2024-09-15T23:18:11.695 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing": 0, 2024-09-15T23:18:11.695 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_high_water": 32, 2024-09-15T23:18:11.695 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executed_ops": 1772, 2024-09-15T23:18:11.695 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executed": 1772, 2024-09-15T23:18:11.695 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_item_in_journal": 0 2024-09-15T23:18:11.695 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.695 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T23:18:11.695 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-15T23:18:11.695 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-09-15T23:18:11.695 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-15T23:18:11.695 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 32207, 2024-09-15T23:18:11.696 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 8118389, 2024-09-15T23:18:11.696 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-15T23:18:11.696 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 32207, 2024-09-15T23:18:11.696 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-15T23:18:11.696 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-15T23:18:11.696 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 32207, 2024-09-15T23:18:11.696 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 8118389, 2024-09-15T23:18:11.696 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-15T23:18:11.696 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:11.696 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:11.696 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:11.696 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:11.696 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.697 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-objecter_bytes": { 2024-09-15T23:18:11.697 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-15T23:18:11.697 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-09-15T23:18:11.697 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-15T23:18:11.697 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-15T23:18:11.697 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-15T23:18:11.697 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-15T23:18:11.697 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-15T23:18:11.697 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 4605, 2024-09-15T23:18:11.697 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 95794836, 2024-09-15T23:18:11.697 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 4605, 2024-09-15T23:18:11.698 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 95794836, 2024-09-15T23:18:11.698 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-15T23:18:11.698 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:11.698 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:11.698 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:11.698 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:11.698 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.698 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-objecter_ops": { 2024-09-15T23:18:11.698 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-15T23:18:11.698 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 1024, 2024-09-15T23:18:11.698 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-15T23:18:11.698 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-15T23:18:11.698 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-15T23:18:11.698 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-15T23:18:11.699 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-15T23:18:11.699 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 4605, 2024-09-15T23:18:11.699 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 4605, 2024-09-15T23:18:11.699 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 4605, 2024-09-15T23:18:11.699 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 4605, 2024-09-15T23:18:11.699 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-15T23:18:11.699 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:11.699 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:11.699 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:11.699 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:11.699 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.699 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-write_buf_throttle": { 2024-09-15T23:18:11.699 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-15T23:18:11.700 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 3758096384, 2024-09-15T23:18:11.700 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-15T23:18:11.700 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 1772, 2024-09-15T23:18:11.700 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 193148, 2024-09-15T23:18:11.700 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-15T23:18:11.700 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 1772, 2024-09-15T23:18:11.700 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-15T23:18:11.700 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-15T23:18:11.700 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 41, 2024-09-15T23:18:11.700 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 193148, 2024-09-15T23:18:11.700 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-15T23:18:11.700 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:11.700 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:11.700 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:11.701 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:11.701 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:11.701 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-write_buf_throttle-0x55a456710500": { 2024-09-15T23:18:11.701 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 84, 2024-09-15T23:18:11.701 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 3758096384, 2024-09-15T23:18:11.701 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-15T23:18:11.701 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 26444, 2024-09-15T23:18:11.701 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 95132153, 2024-09-15T23:18:11.701 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-15T23:18:11.701 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 26444, 2024-09-15T23:18:11.701 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-15T23:18:11.701 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-15T23:18:11.702 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 2620, 2024-09-15T23:18:11.702 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 95132069, 2024-09-15T23:18:11.702 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-15T23:18:11.702 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:11.702 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:11.702 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:11.702 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:11.702 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:11.702 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:18:11.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.633+0000 7fa0619b7640 1 -- 172.21.15.123:0/3344441585 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa04806c2b0 msgr2=0x7fa04806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:11.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.633+0000 7fa0619b7640 1 --2- 172.21.15.123:0/3344441585 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa04806c2b0 0x7fa04806e770 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa05c0cbea0 tx=0x7fa050009040 comp rx=0 tx=0).stop 2024-09-15T23:18:11.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.633+0000 7fa0619b7640 1 -- 172.21.15.123:0/3344441585 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa05c06f8b0 msgr2=0x7fa05c155a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:11.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.633+0000 7fa0619b7640 1 --2- 172.21.15.123:0/3344441585 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa05c06f8b0 0x7fa05c155a50 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fa04c00cad0 tx=0x7fa04c00cf90 comp rx=0 tx=0).stop 2024-09-15T23:18:11.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.633+0000 7fa0619b7640 1 -- 172.21.15.123:0/3344441585 shutdown_connections 2024-09-15T23:18:11.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.633+0000 7fa0619b7640 1 --2- 172.21.15.123:0/3344441585 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa05c1607d0 0x7fa05c1655e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.633+0000 7fa0619b7640 1 --2- 172.21.15.123:0/3344441585 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa05c0b5050 0x7fa05c156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.633+0000 7fa0619b7640 1 --2- 172.21.15.123:0/3344441585 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa04806c2b0 0x7fa04806e770 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.633+0000 7fa0619b7640 1 --2- 172.21.15.123:0/3344441585 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa05c06f8b0 0x7fa05c155a50 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.633+0000 7fa0619b7640 1 -- 172.21.15.123:0/3344441585 >> 172.21.15.123:0/3344441585 conn(0x7fa05c0b2510 msgr2=0x7fa05c0cf640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:11.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.633+0000 7fa0619b7640 1 -- 172.21.15.123:0/3344441585 shutdown_connections 2024-09-15T23:18:11.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.633+0000 7fa0619b7640 1 -- 172.21.15.123:0/3344441585 wait complete. 2024-09-15T23:18:11.705 INFO:tasks.cephfs.test_scrub_checks:num of strays: 2000 2024-09-15T23:18:11.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:18:11.706 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start '~mdsdir' recursive 2024-09-15T23:18:11.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.806+0000 7fba93398640 1 Processor -- start 2024-09-15T23:18:11.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.806+0000 7fba93398640 1 -- start start 2024-09-15T23:18:11.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.807+0000 7fba93398640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fba8c0b2370 0x7fba8c0cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.807+0000 7fba93398640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fba8c0cf960 0x7fba8c15c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.807+0000 7fba93398640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba8c0b0680 con 0x7fba8c155b20 2024-09-15T23:18:11.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.807+0000 7fba93398640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fba8c0b01e0 con 0x7fba8c0b2370 2024-09-15T23:18:11.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.807+0000 7fba93398640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fba8c0ccf70 con 0x7fba8c0cf960 2024-09-15T23:18:11.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.807+0000 7fba91134640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fba8c155b20 0x7fba8c0b1c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55892/0 (socket says 172.21.15.123:55892) 2024-09-15T23:18:11.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.807+0000 7fba91134640 1 -- 172.21.15.123:0/1551561950 learned_addr learned my addr 172.21.15.123:0/1551561950 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:18:11.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.807+0000 7fba90933640 1 --2- 172.21.15.123:0/1551561950 >> v2:172.21.15.123:3300/0 conn(0x7fba8c0b2370 0x7fba8c0cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:11.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.808+0000 7fba90933640 1 -- 172.21.15.123:0/1551561950 >> v2:172.21.15.188:3300/0 conn(0x7fba8c0cf960 msgr2=0x7fba8c15c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:11.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.808+0000 7fba90933640 1 --2- 172.21.15.123:0/1551561950 >> v2:172.21.15.188:3300/0 conn(0x7fba8c0cf960 0x7fba8c15c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.808+0000 7fba90933640 1 -- 172.21.15.123:0/1551561950 >> v1:172.21.15.123:6789/0 conn(0x7fba8c155b20 legacy=0x7fba8c0b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:11.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.808+0000 7fba8bfff640 1 -- 172.21.15.123:0/1551561950 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1606483352 0 0) 0x7fba8c0b0680 con 0x7fba8c155b20 2024-09-15T23:18:11.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.808+0000 7fba90933640 1 -- 172.21.15.123:0/1551561950 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba8c0ce940 con 0x7fba8c0b2370 2024-09-15T23:18:11.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.808+0000 7fba90933640 1 --2- 172.21.15.123:0/1551561950 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba8c0b2370 0x7fba8c0cf420 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fba8c159570 tx=0x7fba8002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c23da60c31cd7b33 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:11.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.808+0000 7fba8bfff640 1 -- 172.21.15.123:0/1551561950 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba80037070 con 0x7fba8c0b2370 2024-09-15T23:18:11.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.809+0000 7fba8bfff640 1 -- 172.21.15.123:0/1551561950 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba80032440 con 0x7fba8c0b2370 2024-09-15T23:18:11.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.809+0000 7fba8bfff640 1 -- 172.21.15.123:0/1551561950 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba80032810 con 0x7fba8c0b2370 2024-09-15T23:18:11.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.809+0000 7fba93398640 1 -- 172.21.15.123:0/1551561950 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba8c0b2370 msgr2=0x7fba8c0cf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:11.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.809+0000 7fba93398640 1 --2- 172.21.15.123:0/1551561950 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba8c0b2370 0x7fba8c0cf420 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fba8c159570 tx=0x7fba8002a1a0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.809+0000 7fba93398640 1 -- 172.21.15.123:0/1551561950 shutdown_connections 2024-09-15T23:18:11.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.809+0000 7fba93398640 1 --2- 172.21.15.123:0/1551561950 >> v2:172.21.15.188:3300/0 conn(0x7fba8c0cf960 0x7fba8c15c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.809+0000 7fba93398640 1 --2- 172.21.15.123:0/1551561950 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba8c0b2370 0x7fba8c0cf420 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.809+0000 7fba93398640 1 -- 172.21.15.123:0/1551561950 >> 172.21.15.123:0/1551561950 conn(0x7fba8c06c240 msgr2=0x7fba8c06d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:11.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.809+0000 7fba93398640 1 -- 172.21.15.123:0/1551561950 shutdown_connections 2024-09-15T23:18:11.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.809+0000 7fba93398640 1 -- 172.21.15.123:0/1551561950 wait complete. 2024-09-15T23:18:11.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.810+0000 7fba93398640 1 Processor -- start 2024-09-15T23:18:11.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.810+0000 7fba93398640 1 -- start start 2024-09-15T23:18:11.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.811+0000 7fba93398640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fba8c0b2370 0x7fba8c14def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.811+0000 7fba93398640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba8c0cf960 0x7fba8c158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.811+0000 7fba93398640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba8c155b20 0x7fba8c0720f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.811+0000 7fba93398640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fba8c0cfdf0 con 0x7fba8c155b20 2024-09-15T23:18:11.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.811+0000 7fba93398640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fba8c0cef00 con 0x7fba8c0cf960 2024-09-15T23:18:11.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.811+0000 7fba93398640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fba8c0ce610 con 0x7fba8c0b2370 2024-09-15T23:18:11.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.811+0000 7fba91935640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba8c155b20 0x7fba8c0720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:11.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.811+0000 7fba91935640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba8c155b20 0x7fba8c0720f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33744/0 (socket says 172.21.15.123:33744) 2024-09-15T23:18:11.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.811+0000 7fba91935640 1 -- 172.21.15.123:0/1816914579 learned_addr learned my addr 172.21.15.123:0/1816914579 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:11.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.811+0000 7fba90933640 1 --2- 172.21.15.123:0/1816914579 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba8c0cf960 0x7fba8c158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:11.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.811+0000 7fba91134640 1 --2- 172.21.15.123:0/1816914579 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fba8c0b2370 0x7fba8c14def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:11.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.811+0000 7fba91935640 1 -- 172.21.15.123:0/1816914579 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fba8c0b2370 msgr2=0x7fba8c14def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:11.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.811+0000 7fba91935640 1 --2- 172.21.15.123:0/1816914579 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fba8c0b2370 0x7fba8c14def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.811+0000 7fba91935640 1 -- 172.21.15.123:0/1816914579 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba8c0cf960 msgr2=0x7fba8c158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:11.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.811+0000 7fba91935640 1 --2- 172.21.15.123:0/1816914579 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba8c0cf960 0x7fba8c158a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.811+0000 7fba91935640 1 -- 172.21.15.123:0/1816914579 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba8c1f27e0 con 0x7fba8c155b20 2024-09-15T23:18:11.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.812+0000 7fba91935640 1 --2- 172.21.15.123:0/1816914579 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba8c155b20 0x7fba8c0720f0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fba8400b440 tx=0x7fba8400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:11.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.812+0000 7fba89ffb640 1 -- 172.21.15.123:0/1816914579 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba84015020 con 0x7fba8c155b20 2024-09-15T23:18:11.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.812+0000 7fba89ffb640 1 -- 172.21.15.123:0/1816914579 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba84011830 con 0x7fba8c155b20 2024-09-15T23:18:11.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.812+0000 7fba93398640 1 -- 172.21.15.123:0/1816914579 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba8c1f2ac0 con 0x7fba8c155b20 2024-09-15T23:18:11.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.812+0000 7fba89ffb640 1 -- 172.21.15.123:0/1816914579 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba84011c20 con 0x7fba8c155b20 2024-09-15T23:18:11.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.812+0000 7fba93398640 1 -- 172.21.15.123:0/1816914579 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba8c1f3080 con 0x7fba8c155b20 2024-09-15T23:18:11.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.813+0000 7fba89ffb640 1 -- 172.21.15.123:0/1816914579 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fba84018020 con 0x7fba8c155b20 2024-09-15T23:18:11.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.814+0000 7fba89ffb640 1 --2- 172.21.15.123:0/1816914579 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fba7806c2b0 0x7fba7806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.814+0000 7fba89ffb640 1 -- 172.21.15.123:0/1816914579 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5767+0+0 (secure 0 0 0) 0x7fba8408b230 con 0x7fba8c155b20 2024-09-15T23:18:11.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.814+0000 7fba91134640 1 --2- 172.21.15.123:0/1816914579 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fba7806c2b0 0x7fba7806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:11.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.815+0000 7fba91134640 1 --2- 172.21.15.123:0/1816914579 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fba7806c2b0 0x7fba7806e770 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0012e0 tx=0x7fba7c001700 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:11.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.815+0000 7fba9620f740 1 Processor -- start 2024-09-15T23:18:11.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.815+0000 7fba9620f740 1 -- start start 2024-09-15T23:18:11.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.816+0000 7fba9620f740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5568db6b5500 0x5568db6b58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.816+0000 7fba9620f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568db6b2cc0 0x5568db6b4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.816+0000 7fba9620f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5568db6b3120 0x5568db695480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.816+0000 7fba9620f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5568db5d1ac0 con 0x5568db6b2cc0 2024-09-15T23:18:11.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.816+0000 7fba9620f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5568db5797b0 con 0x5568db6b3120 2024-09-15T23:18:11.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.816+0000 7fba9620f740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5568db5cda80 con 0x5568db6b5500 2024-09-15T23:18:11.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.816+0000 7fba90933640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568db6b2cc0 0x5568db6b4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:11.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.816+0000 7fba90933640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568db6b2cc0 0x5568db6b4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33748/0 (socket says 172.21.15.123:33748) 2024-09-15T23:18:11.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.816+0000 7fba90933640 1 -- 172.21.15.123:0/3012696233 learned_addr learned my addr 172.21.15.123:0/3012696233 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:11.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.816+0000 7fba91134640 1 --2- 172.21.15.123:0/3012696233 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5568db6b5500 0x5568db6b58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:11.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.816+0000 7fba91935640 1 --2- 172.21.15.123:0/3012696233 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5568db6b3120 0x5568db695480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:11.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.816+0000 7fba90933640 1 -- 172.21.15.123:0/3012696233 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5568db6b5500 msgr2=0x5568db6b58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:11.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.816+0000 7fba90933640 1 --2- 172.21.15.123:0/3012696233 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5568db6b5500 0x5568db6b58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.816+0000 7fba90933640 1 -- 172.21.15.123:0/3012696233 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5568db6b3120 msgr2=0x5568db695480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:11.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.816+0000 7fba90933640 1 --2- 172.21.15.123:0/3012696233 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5568db6b3120 0x5568db695480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.816+0000 7fba90933640 1 -- 172.21.15.123:0/3012696233 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568db3b0a20 con 0x5568db6b2cc0 2024-09-15T23:18:11.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.816+0000 7fba90933640 1 --2- 172.21.15.123:0/3012696233 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568db6b2cc0 0x5568db6b4850 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fba80000c00 tx=0x7fba8002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b509c2b656b2f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:11.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.817+0000 7fba72ffd640 1 -- 172.21.15.123:0/3012696233 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba80037040 con 0x5568db6b2cc0 2024-09-15T23:18:11.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.817+0000 7fba72ffd640 1 -- 172.21.15.123:0/3012696233 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba80032900 con 0x5568db6b2cc0 2024-09-15T23:18:11.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.817+0000 7fba72ffd640 1 -- 172.21.15.123:0/3012696233 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba80032cb0 con 0x5568db6b2cc0 2024-09-15T23:18:11.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.817+0000 7fba9620f740 1 -- 172.21.15.123:0/3012696233 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568db6b2cc0 msgr2=0x5568db6b4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:11.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.817+0000 7fba9620f740 1 --2- 172.21.15.123:0/3012696233 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568db6b2cc0 0x5568db6b4850 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fba80000c00 tx=0x7fba8002c000 comp rx=0 tx=0).stop 2024-09-15T23:18:11.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.817+0000 7fba9620f740 1 -- 172.21.15.123:0/3012696233 shutdown_connections 2024-09-15T23:18:11.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.817+0000 7fba9620f740 1 --2- 172.21.15.123:0/3012696233 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5568db6b3120 0x5568db695480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.817+0000 7fba9620f740 1 --2- 172.21.15.123:0/3012696233 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568db6b2cc0 0x5568db6b4850 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.817+0000 7fba9620f740 1 --2- 172.21.15.123:0/3012696233 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5568db6b5500 0x5568db6b58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.817+0000 7fba9620f740 1 -- 172.21.15.123:0/3012696233 >> 172.21.15.123:0/3012696233 conn(0x5568db66b160 msgr2=0x5568db6b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:11.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.817+0000 7fba9620f740 1 -- 172.21.15.123:0/3012696233 shutdown_connections 2024-09-15T23:18:11.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.817+0000 7fba9620f740 1 -- 172.21.15.123:0/3012696233 wait complete. 2024-09-15T23:18:11.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.818+0000 7fba9620f740 1 -- start start 2024-09-15T23:18:11.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.818+0000 7fba9620f740 1 Processor -- start 2024-09-15T23:18:11.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.819+0000 7fba9620f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5568db6b3120 0x5568db6ad180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.819+0000 7fba9620f740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5568db6b5500 0x5568db6b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.819+0000 7fba9620f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568db6c38b0 0x5568db6c3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.819+0000 7fba9620f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5568db6b1c20 con 0x5568db6c38b0 2024-09-15T23:18:11.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.819+0000 7fba9620f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5568db55a7b0 con 0x5568db6b3120 2024-09-15T23:18:11.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.819+0000 7fba9620f740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5568db6b1f00 con 0x5568db6b5500 2024-09-15T23:18:11.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.819+0000 7fba9620f740 10 client.0 _ll_register_callbacks cb 0x5568db2e3e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:18:11.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.819+0000 7fba91935640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568db6c38b0 0x5568db6c3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:11.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.819+0000 7fba91935640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568db6c38b0 0x5568db6c3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33760/0 (socket says 172.21.15.123:33760) 2024-09-15T23:18:11.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.819+0000 7fba91935640 1 -- 172.21.15.123:0/485224626 learned_addr learned my addr 172.21.15.123:0/485224626 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:11.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.819+0000 7fba91134640 1 --2- 172.21.15.123:0/485224626 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5568db6b3120 0x5568db6ad180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:11.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.819+0000 7fba90933640 1 --2- 172.21.15.123:0/485224626 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5568db6b5500 0x5568db6b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:11.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.819+0000 7fba91935640 1 -- 172.21.15.123:0/485224626 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5568db6b5500 msgr2=0x5568db6b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:11.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.819+0000 7fba91935640 1 --2- 172.21.15.123:0/485224626 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5568db6b5500 0x5568db6b0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.819+0000 7fba91935640 1 -- 172.21.15.123:0/485224626 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5568db6b3120 msgr2=0x5568db6ad180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:11.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.819+0000 7fba91935640 1 --2- 172.21.15.123:0/485224626 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5568db6b3120 0x5568db6ad180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.819+0000 7fba91935640 1 -- 172.21.15.123:0/485224626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568db2a4310 con 0x5568db6c38b0 2024-09-15T23:18:11.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.819+0000 7fba90933640 1 --2- 172.21.15.123:0/485224626 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5568db6b5500 0x5568db6b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:18:11.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.819+0000 7fba91935640 1 --2- 172.21.15.123:0/485224626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568db6c38b0 0x5568db6c3d30 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fba84089710 tx=0x7fba8405d6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56a73e3aa1314be4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:11.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.819+0000 7fba6bfff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:18:11.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.819+0000 7fba6bfff640 1 -- 172.21.15.123:0/485224626 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba84071070 con 0x5568db6c38b0 2024-09-15T23:18:11.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.819+0000 7fba6bfff640 1 -- 172.21.15.123:0/485224626 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 5767+0+0 (secure 0 0 0) 0x7fba84055970 con 0x5568db6c38b0 2024-09-15T23:18:11.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.819+0000 7fba9620f740 1 -- 172.21.15.123:0/485224626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba80032900 con 0x5568db6c38b0 2024-09-15T23:18:11.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.820+0000 7fba6bfff640 1 -- 172.21.15.123:0/485224626 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fba840892f0 con 0x5568db6c38b0 2024-09-15T23:18:11.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.820+0000 7fba9620f740 10 client.7821 fetch_fsmap learned FSMap version 74 2024-09-15T23:18:11.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.820+0000 7fba9620f740 1 -- 172.21.15.123:0/485224626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x5568db4111b0 con 0x5568db6c38b0 2024-09-15T23:18:11.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.820+0000 7fba6bfff640 1 -- 172.21.15.123:0/485224626 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba80032900 con 0x5568db6c38b0 2024-09-15T23:18:11.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.820+0000 7fba6bfff640 1 -- 172.21.15.123:0/485224626 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 74) ==== 3502+0+0 (secure 0 0 0) 0x7fba8405d160 con 0x5568db6c38b0 2024-09-15T23:18:11.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.820+0000 7fba9620f740 10 client.7821 fetch_fsmap finished waiting for FSMap version 74 2024-09-15T23:18:11.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.820+0000 7fba9620f740 10 client.7821 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-15T23:18:11.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.820+0000 7fba9620f740 20 client.7821 populate_metadata read hostname 'smithi123' 2024-09-15T23:18:11.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.820+0000 7fba9620f740 1 --2- 172.21.15.123:0/485224626 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x5568db697a70 0x5568db6c6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.820+0000 7fba9620f740 4 client.7821 mds_command: new command op to 7608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:18:11.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.820+0000 7fba9620f740 1 -- 172.21.15.123:0/485224626 --> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5568db5df1f0 con 0x5568db697a70 2024-09-15T23:18:11.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.820+0000 7fba91134640 1 --2- 172.21.15.123:0/485224626 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x5568db697a70 0x5568db6c6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:11.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.820+0000 7fba6bfff640 10 client.7821 ms_handle_connect on v2:172.21.15.123:6833/3823805081 2024-09-15T23:18:11.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.820+0000 7fba91134640 1 --2- 172.21.15.123:0/485224626 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x5568db697a70 0x5568db6c6ec0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dac15c992e4ac1c0 server_cookie=7ac946f5fd802b4d in_seq=0 out_seq=0 2024-09-15T23:18:11.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.821+0000 7fba6bfff640 1 -- 172.21.15.123:0/485224626 <== mds.0 v2:172.21.15.123:6833/3823805081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5568db5df1f0 con 0x5568db697a70 2024-09-15T23:18:11.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.821+0000 7fba6bfff640 10 client.7821 handle_command_reply: tid=0 2024-09-15T23:18:11.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.821+0000 7fba9620f740 1 client.7821 shutdown 2024-09-15T23:18:11.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.821+0000 7fba9620f740 1 -- 172.21.15.123:0/485224626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568db6c38b0 msgr2=0x5568db6c3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:11.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.821+0000 7fba9620f740 1 --2- 172.21.15.123:0/485224626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568db6c38b0 0x5568db6c3d30 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fba84089710 tx=0x7fba8405d6c0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.821+0000 7fba9620f740 1 -- 172.21.15.123:0/485224626 shutdown_connections 2024-09-15T23:18:11.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.821+0000 7fba9620f740 1 --2- 172.21.15.123:0/485224626 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x5568db697a70 0x5568db6c6ec0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.821+0000 7fba9620f740 1 --2- 172.21.15.123:0/485224626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568db6c38b0 0x5568db6c3d30 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.821+0000 7fba6bfff640 0 client.7821 ms_handle_reset on v2:172.21.15.123:6833/3823805081 2024-09-15T23:18:11.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.821+0000 7fba9620f740 1 --2- 172.21.15.123:0/485224626 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5568db6b5500 0x5568db6b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.821+0000 7fba9620f740 1 --2- 172.21.15.123:0/485224626 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5568db6b3120 0x5568db6ad180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.821+0000 7fba9620f740 1 -- 172.21.15.123:0/485224626 >> 172.21.15.123:0/485224626 conn(0x5568db6b2cc0 msgr2=0x5568db695250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:11.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.821+0000 7fba9620f740 1 -- 172.21.15.123:0/485224626 shutdown_connections 2024-09-15T23:18:11.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.821+0000 7fba9620f740 1 -- 172.21.15.123:0/485224626 wait complete. 2024-09-15T23:18:11.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.821+0000 7fba9620f740 20 client.7821 trim_cache size 0 max 16384 2024-09-15T23:18:11.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.838+0000 7fba9620f740 1 Processor -- start 2024-09-15T23:18:11.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.838+0000 7fba9620f740 1 -- start start 2024-09-15T23:18:11.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.839+0000 7fba9620f740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5568db6b3120 0x5568db6b3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.839+0000 7fba9620f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568db6b5500 0x5568db6b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.839+0000 7fba9620f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5568db6c38b0 0x5568db6d7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.839+0000 7fba9620f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fba8c1fe9e0 con 0x5568db6b5500 2024-09-15T23:18:11.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.839+0000 7fba9620f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fba8c0b4730 con 0x5568db6c38b0 2024-09-15T23:18:11.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.839+0000 7fba9620f740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fba8c071ac0 con 0x5568db6b3120 2024-09-15T23:18:11.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.839+0000 7fba90933640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568db6b5500 0x5568db6b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:11.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.839+0000 7fba90933640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568db6b5500 0x5568db6b3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33772/0 (socket says 172.21.15.123:33772) 2024-09-15T23:18:11.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.839+0000 7fba90933640 1 -- 172.21.15.123:0/3419650676 learned_addr learned my addr 172.21.15.123:0/3419650676 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:11.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.839+0000 7fba90933640 1 -- 172.21.15.123:0/3419650676 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5568db6b3120 msgr2=0x5568db6b3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:11.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.839+0000 7fba90933640 1 --2- 172.21.15.123:0/3419650676 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5568db6b3120 0x5568db6b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.839+0000 7fba90933640 1 -- 172.21.15.123:0/3419650676 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5568db6c38b0 msgr2=0x5568db6d7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:11.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.839+0000 7fba90933640 1 --2- 172.21.15.123:0/3419650676 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5568db6c38b0 0x5568db6d7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.839+0000 7fba90933640 1 -- 172.21.15.123:0/3419650676 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568db27d3d0 con 0x5568db6b5500 2024-09-15T23:18:11.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.840+0000 7fba90933640 1 --2- 172.21.15.123:0/3419650676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568db6b5500 0x5568db6b3a40 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fba80009890 tx=0x7fba80008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=474a9bfc49645a91 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:11.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.840+0000 7fba727fc640 1 -- 172.21.15.123:0/3419650676 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba80037040 con 0x5568db6b5500 2024-09-15T23:18:11.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.840+0000 7fba727fc640 1 -- 172.21.15.123:0/3419650676 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba80004450 con 0x5568db6b5500 2024-09-15T23:18:11.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.840+0000 7fba727fc640 1 -- 172.21.15.123:0/3419650676 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba80032920 con 0x5568db6b5500 2024-09-15T23:18:11.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.840+0000 7fba9620f740 1 -- 172.21.15.123:0/3419650676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568db6b5500 msgr2=0x5568db6b3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:11.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.840+0000 7fba9620f740 1 --2- 172.21.15.123:0/3419650676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568db6b5500 0x5568db6b3a40 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fba80009890 tx=0x7fba80008030 comp rx=0 tx=0).stop 2024-09-15T23:18:11.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.840+0000 7fba9620f740 1 -- 172.21.15.123:0/3419650676 shutdown_connections 2024-09-15T23:18:11.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.840+0000 7fba9620f740 1 --2- 172.21.15.123:0/3419650676 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5568db6c38b0 0x5568db6d7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.840+0000 7fba9620f740 1 --2- 172.21.15.123:0/3419650676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568db6b5500 0x5568db6b3a40 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.840+0000 7fba9620f740 1 --2- 172.21.15.123:0/3419650676 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5568db6b3120 0x5568db6b3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.840+0000 7fba9620f740 1 -- 172.21.15.123:0/3419650676 >> 172.21.15.123:0/3419650676 conn(0x5568db6b2cc0 msgr2=0x5568db664240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:11.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.840+0000 7fba9620f740 1 -- 172.21.15.123:0/3419650676 shutdown_connections 2024-09-15T23:18:11.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.840+0000 7fba9620f740 1 -- 172.21.15.123:0/3419650676 wait complete. 2024-09-15T23:18:11.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.841+0000 7fba9620f740 1 -- start start 2024-09-15T23:18:11.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.841+0000 7fba9620f740 1 Processor -- start 2024-09-15T23:18:11.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.842+0000 7fba9620f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5568db6b3120 0x5568db6ad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.842+0000 7fba9620f740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5568db6b5500 0x5568db6b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.842+0000 7fba9620f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568db6c38b0 0x5568db6d6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.842+0000 7fba9620f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fba8c0b40e0 con 0x5568db6c38b0 2024-09-15T23:18:11.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.842+0000 7fba9620f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5568db6d7650 con 0x5568db6b3120 2024-09-15T23:18:11.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.842+0000 7fba9620f740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5568db6ad6f0 con 0x5568db6b5500 2024-09-15T23:18:11.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.842+0000 7fba9620f740 10 client.0 _ll_register_callbacks cb 0x7fba84058f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:18:11.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.842+0000 7fba91935640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568db6c38b0 0x5568db6d6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:11.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.842+0000 7fba91935640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568db6c38b0 0x5568db6d6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33774/0 (socket says 172.21.15.123:33774) 2024-09-15T23:18:11.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.842+0000 7fba91935640 1 -- 172.21.15.123:0/1517706922 learned_addr learned my addr 172.21.15.123:0/1517706922 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:11.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.842+0000 7fba91134640 1 --2- 172.21.15.123:0/1517706922 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5568db6b3120 0x5568db6ad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:11.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.842+0000 7fba90933640 1 --2- 172.21.15.123:0/1517706922 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5568db6b5500 0x5568db6b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:11.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.842+0000 7fba91935640 1 -- 172.21.15.123:0/1517706922 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5568db6b5500 msgr2=0x5568db6b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:11.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.842+0000 7fba91935640 1 --2- 172.21.15.123:0/1517706922 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5568db6b5500 0x5568db6b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.842+0000 7fba91935640 1 -- 172.21.15.123:0/1517706922 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5568db6b3120 msgr2=0x5568db6ad0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:11.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.842+0000 7fba91935640 1 --2- 172.21.15.123:0/1517706922 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5568db6b3120 0x5568db6ad0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.842+0000 7fba91935640 1 -- 172.21.15.123:0/1517706922 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568db698430 con 0x5568db6c38b0 2024-09-15T23:18:11.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.842+0000 7fba91935640 1 --2- 172.21.15.123:0/1517706922 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568db6c38b0 0x5568db6d6bf0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fba84061900 tx=0x7fba840895e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1511cc5032b29809 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:11.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.842+0000 7fba6bfff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:18:11.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.842+0000 7fba6bfff640 1 -- 172.21.15.123:0/1517706922 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba84071040 con 0x5568db6c38b0 2024-09-15T23:18:11.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.842+0000 7fba6bfff640 1 -- 172.21.15.123:0/1517706922 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 5767+0+0 (secure 0 0 0) 0x7fba84055970 con 0x5568db6c38b0 2024-09-15T23:18:11.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.842+0000 7fba9620f740 1 -- 172.21.15.123:0/1517706922 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba80004450 con 0x5568db6c38b0 2024-09-15T23:18:11.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.843+0000 7fba6bfff640 1 -- 172.21.15.123:0/1517706922 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fba84061e30 con 0x5568db6c38b0 2024-09-15T23:18:11.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.843+0000 7fba9620f740 10 client.7827 fetch_fsmap learned FSMap version 74 2024-09-15T23:18:11.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.843+0000 7fba9620f740 1 -- 172.21.15.123:0/1517706922 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x5568db6d73e0 con 0x5568db6c38b0 2024-09-15T23:18:11.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.843+0000 7fba6bfff640 1 -- 172.21.15.123:0/1517706922 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba80004450 con 0x5568db6c38b0 2024-09-15T23:18:11.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.843+0000 7fba6bfff640 1 -- 172.21.15.123:0/1517706922 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 74) ==== 3502+0+0 (secure 0 0 0) 0x7fba84058750 con 0x5568db6c38b0 2024-09-15T23:18:11.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.843+0000 7fba9620f740 10 client.7827 fetch_fsmap finished waiting for FSMap version 74 2024-09-15T23:18:11.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.843+0000 7fba9620f740 10 client.7827 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-15T23:18:11.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.843+0000 7fba9620f740 20 client.7827 populate_metadata read hostname 'smithi123' 2024-09-15T23:18:11.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.843+0000 7fba9620f740 1 --2- 172.21.15.123:0/1517706922 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x5568db734510 0x5568db734920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:11.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.843+0000 7fba9620f740 4 client.7827 mds_command: new command op to 7608 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}] 2024-09-15T23:18:11.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.843+0000 7fba9620f740 1 -- 172.21.15.123:0/1517706922 --> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] -- command(tid 0: {"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}) -- 0x5568db5d9540 con 0x5568db734510 2024-09-15T23:18:11.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.843+0000 7fba91134640 1 --2- 172.21.15.123:0/1517706922 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x5568db734510 0x5568db734920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:11.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.843+0000 7fba6bfff640 10 client.7827 ms_handle_connect on v2:172.21.15.123:6833/3823805081 2024-09-15T23:18:11.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.843+0000 7fba91134640 1 --2- 172.21.15.123:0/1517706922 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x5568db734510 0x5568db734920 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2ba6da4f00299c0 server_cookie=98b6c56cabde40b3 in_seq=0 out_seq=0 2024-09-15T23:18:11.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.857+0000 7fba6bfff640 1 -- 172.21.15.123:0/1517706922 <== mds.0 v2:172.21.15.123:6833/3823805081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5568db5d9540 con 0x5568db734510 2024-09-15T23:18:11.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.857+0000 7fba6bfff640 10 client.7827 handle_command_reply: tid=0 2024-09-15T23:18:11.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.857+0000 7fba9620f740 1 client.7827 shutdown 2024-09-15T23:18:11.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.857+0000 7fba9620f740 1 -- 172.21.15.123:0/1517706922 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568db6c38b0 msgr2=0x5568db6d6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:11.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.857+0000 7fba9620f740 1 --2- 172.21.15.123:0/1517706922 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568db6c38b0 0x5568db6d6bf0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fba84061900 tx=0x7fba840895e0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.857+0000 7fba9620f740 1 -- 172.21.15.123:0/1517706922 shutdown_connections 2024-09-15T23:18:11.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.857+0000 7fba9620f740 1 --2- 172.21.15.123:0/1517706922 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x5568db734510 0x5568db734920 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.857+0000 7fba6bfff640 0 client.7827 ms_handle_reset on v2:172.21.15.123:6833/3823805081 2024-09-15T23:18:11.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.857+0000 7fba9620f740 1 --2- 172.21.15.123:0/1517706922 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5568db6c38b0 0x5568db6d6bf0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.857+0000 7fba9620f740 1 --2- 172.21.15.123:0/1517706922 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5568db6b5500 0x5568db6b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.857+0000 7fba9620f740 1 --2- 172.21.15.123:0/1517706922 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5568db6b3120 0x5568db6ad0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.857+0000 7fba9620f740 1 -- 172.21.15.123:0/1517706922 >> 172.21.15.123:0/1517706922 conn(0x5568db6b2cc0 msgr2=0x5568db6cd100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:11.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.857+0000 7fba9620f740 1 -- 172.21.15.123:0/1517706922 shutdown_connections 2024-09-15T23:18:11.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.857+0000 7fba9620f740 1 -- 172.21.15.123:0/1517706922 wait complete. 2024-09-15T23:18:11.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.857+0000 7fba9620f740 20 client.7827 trim_cache size 0 max 16384 2024-09-15T23:18:11.860 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:18:11.860 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0, 2024-09-15T23:18:11.860 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_tag": "8b1d9b34-478a-4e7a-bdd2-593a2c5d1a28", 2024-09-15T23:18:11.860 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": "asynchronous" 2024-09-15T23:18:11.860 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:18:11.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.857+0000 7fba93398640 1 -- 172.21.15.123:0/1816914579 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fba7806c2b0 msgr2=0x7fba7806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:11.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.857+0000 7fba93398640 1 --2- 172.21.15.123:0/1816914579 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fba7806c2b0 0x7fba7806e770 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0012e0 tx=0x7fba7c001700 comp rx=0 tx=0).stop 2024-09-15T23:18:11.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.857+0000 7fba93398640 1 -- 172.21.15.123:0/1816914579 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba8c155b20 msgr2=0x7fba8c0720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:11.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.857+0000 7fba93398640 1 --2- 172.21.15.123:0/1816914579 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba8c155b20 0x7fba8c0720f0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fba8400b440 tx=0x7fba8400b900 comp rx=0 tx=0).stop 2024-09-15T23:18:11.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.857+0000 7fba93398640 1 -- 172.21.15.123:0/1816914579 shutdown_connections 2024-09-15T23:18:11.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.857+0000 7fba93398640 1 --2- 172.21.15.123:0/1816914579 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fba7806c2b0 0x7fba7806e770 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.857+0000 7fba93398640 1 --2- 172.21.15.123:0/1816914579 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba8c155b20 0x7fba8c0720f0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.857+0000 7fba93398640 1 --2- 172.21.15.123:0/1816914579 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba8c0cf960 0x7fba8c158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.857+0000 7fba93398640 1 --2- 172.21.15.123:0/1816914579 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fba8c0b2370 0x7fba8c14def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:11.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.857+0000 7fba93398640 1 -- 172.21.15.123:0/1816914579 >> 172.21.15.123:0/1816914579 conn(0x7fba8c06c240 msgr2=0x7fba8c0b2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:11.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.857+0000 7fba93398640 1 -- 172.21.15.123:0/1816914579 shutdown_connections 2024-09-15T23:18:11.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:11.857+0000 7fba93398640 1 -- 172.21.15.123:0/1816914579 wait complete. 2024-09-15T23:18:11.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:18:11.871 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-09-15T23:18:12.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.017+0000 7fd9d2b52640 1 Processor -- start 2024-09-15T23:18:12.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.018+0000 7fd9d2b52640 1 -- start start 2024-09-15T23:18:12.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.019+0000 7fd9d2b52640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd9cc0730f0 0x7fd9cc073530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:12.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.019+0000 7fd9d2b52640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9cc15cbd0 con 0x7fd9cc06f460 2024-09-15T23:18:12.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.019+0000 7fd9d2b52640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9cc0ce0e0 con 0x7fd9cc15c7f0 2024-09-15T23:18:12.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.019+0000 7fd9d2b52640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fd9cc0cecf0 con 0x7fd9cc0730f0 2024-09-15T23:18:12.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.019+0000 7fd9d10ef640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd9cc06f460 0x7fd9cc06f8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55896/0 (socket says 172.21.15.123:55896) 2024-09-15T23:18:12.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.019+0000 7fd9d10ef640 1 -- 172.21.15.123:0/3349704430 learned_addr learned my addr 172.21.15.123:0/3349704430 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:18:12.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.019+0000 7fd9c3fff640 1 --2- 172.21.15.123:0/3349704430 >> v2:172.21.15.188:3300/0 conn(0x7fd9cc0730f0 0x7fd9cc073530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:12.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.019+0000 7fd9c37fe640 1 -- 172.21.15.123:0/3349704430 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2102245452 0 0) 0x7fd9cc15cbd0 con 0x7fd9cc06f460 2024-09-15T23:18:12.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.019+0000 7fd9c37fe640 1 -- 172.21.15.123:0/3349704430 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9b4003520 con 0x7fd9cc06f460 2024-09-15T23:18:12.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.019+0000 7fd9c37fe640 1 -- 172.21.15.123:0/3349704430 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1171175206 0 0) 0x7fd9cc0ce0e0 con 0x7fd9cc15c7f0 2024-09-15T23:18:12.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.019+0000 7fd9c37fe640 1 -- 172.21.15.123:0/3349704430 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9cc15cbd0 con 0x7fd9cc15c7f0 2024-09-15T23:18:12.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.019+0000 7fd9c3fff640 1 -- 172.21.15.123:0/3349704430 >> v1:172.21.15.188:6789/0 conn(0x7fd9cc15c7f0 legacy=0x7fd9cc0b16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:12.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.019+0000 7fd9c3fff640 1 -- 172.21.15.123:0/3349704430 >> v1:172.21.15.123:6789/0 conn(0x7fd9cc06f460 legacy=0x7fd9cc06f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:12.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.019+0000 7fd9c3fff640 1 -- 172.21.15.123:0/3349704430 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9cc0ce3c0 con 0x7fd9cc0730f0 2024-09-15T23:18:12.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.020+0000 7fd9c3fff640 1 --2- 172.21.15.123:0/3349704430 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9cc0730f0 0x7fd9cc073530 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc0097a0 tx=0x7fd9bc02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45bf26e4fa2a3eb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:12.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.021+0000 7fd9c37fe640 1 -- 172.21.15.123:0/3349704430 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc037070 con 0x7fd9cc0730f0 2024-09-15T23:18:12.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.021+0000 7fd9c37fe640 1 -- 172.21.15.123:0/3349704430 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9bc032440 con 0x7fd9cc0730f0 2024-09-15T23:18:12.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.021+0000 7fd9c37fe640 1 -- 172.21.15.123:0/3349704430 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc032810 con 0x7fd9cc0730f0 2024-09-15T23:18:12.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.021+0000 7fd9d2b52640 1 -- 172.21.15.123:0/3349704430 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9cc0730f0 msgr2=0x7fd9cc073530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:12.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.021+0000 7fd9d2b52640 1 --2- 172.21.15.123:0/3349704430 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9cc0730f0 0x7fd9cc073530 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc0097a0 tx=0x7fd9bc02a230 comp rx=0 tx=0).stop 2024-09-15T23:18:12.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.022+0000 7fd9d2b52640 1 -- 172.21.15.123:0/3349704430 shutdown_connections 2024-09-15T23:18:12.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.022+0000 7fd9d2b52640 1 --2- 172.21.15.123:0/3349704430 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9cc0730f0 0x7fd9cc073530 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:12.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.022+0000 7fd9d2b52640 1 -- 172.21.15.123:0/3349704430 >> 172.21.15.123:0/3349704430 conn(0x7fd9cc0d2570 msgr2=0x7fd9cc0d2980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:12.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.022+0000 7fd9d2b52640 1 -- 172.21.15.123:0/3349704430 shutdown_connections 2024-09-15T23:18:12.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.022+0000 7fd9d2b52640 1 -- 172.21.15.123:0/3349704430 wait complete. 2024-09-15T23:18:12.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.023+0000 7fd9d2b52640 1 Processor -- start 2024-09-15T23:18:12.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.023+0000 7fd9d2b52640 1 -- start start 2024-09-15T23:18:12.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.024+0000 7fd9d2b52640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9cc06f460 0x7fd9cc15f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:12.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.024+0000 7fd9d2b52640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9cc0730f0 0x7fd9cc0b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:12.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.024+0000 7fd9d2b52640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd9cc15c7f0 0x7fd9cc0ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:12.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.024+0000 7fd9d2b52640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd9cc0ce980 con 0x7fd9cc0730f0 2024-09-15T23:18:12.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.024+0000 7fd9d2b52640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd9cc073a70 con 0x7fd9cc06f460 2024-09-15T23:18:12.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.024+0000 7fd9d2b52640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd9cc0b1e00 con 0x7fd9cc15c7f0 2024-09-15T23:18:12.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.024+0000 7fd9c3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9cc0730f0 0x7fd9cc0b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:12.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.024+0000 7fd9d08ee640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9cc06f460 0x7fd9cc15f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:12.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.024+0000 7fd9d08ee640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9cc06f460 0x7fd9cc15f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:58996/0 (socket says 172.21.15.123:58996) 2024-09-15T23:18:12.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.024+0000 7fd9c3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9cc0730f0 0x7fd9cc0b12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33778/0 (socket says 172.21.15.123:33778) 2024-09-15T23:18:12.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.024+0000 7fd9d08ee640 1 -- 172.21.15.123:0/1094799226 learned_addr learned my addr 172.21.15.123:0/1094799226 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:12.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.024+0000 7fd9d10ef640 1 --2- 172.21.15.123:0/1094799226 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd9cc15c7f0 0x7fd9cc0ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:12.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.025+0000 7fd9d10ef640 1 -- 172.21.15.123:0/1094799226 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9cc06f460 msgr2=0x7fd9cc15f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:12.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.025+0000 7fd9d10ef640 1 --2- 172.21.15.123:0/1094799226 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9cc06f460 0x7fd9cc15f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:12.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.025+0000 7fd9d10ef640 1 -- 172.21.15.123:0/1094799226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9cc0730f0 msgr2=0x7fd9cc0b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:12.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.025+0000 7fd9d10ef640 1 --2- 172.21.15.123:0/1094799226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9cc0730f0 0x7fd9cc0b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:12.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.025+0000 7fd9d10ef640 1 -- 172.21.15.123:0/1094799226 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9cc15e330 con 0x7fd9cc15c7f0 2024-09-15T23:18:12.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.025+0000 7fd9c3fff640 1 --2- 172.21.15.123:0/1094799226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9cc0730f0 0x7fd9cc0b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:18:12.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.025+0000 7fd9d08ee640 1 --2- 172.21.15.123:0/1094799226 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9cc06f460 0x7fd9cc15f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:18:12.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.025+0000 7fd9d10ef640 1 --2- 172.21.15.123:0/1094799226 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd9cc15c7f0 0x7fd9cc0ae880 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4005c00 tx=0x7fd9c400a7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:12.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.025+0000 7fd9c17fa640 1 -- 172.21.15.123:0/1094799226 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c4007480 con 0x7fd9cc15c7f0 2024-09-15T23:18:12.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.025+0000 7fd9c17fa640 1 -- 172.21.15.123:0/1094799226 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9c4007620 con 0x7fd9cc15c7f0 2024-09-15T23:18:12.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.025+0000 7fd9d2b52640 1 -- 172.21.15.123:0/1094799226 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9cc15e610 con 0x7fd9cc15c7f0 2024-09-15T23:18:12.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.025+0000 7fd9c17fa640 1 -- 172.21.15.123:0/1094799226 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c4007a50 con 0x7fd9cc15c7f0 2024-09-15T23:18:12.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.025+0000 7fd9d2b52640 1 -- 172.21.15.123:0/1094799226 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9cc15ebd0 con 0x7fd9cc15c7f0 2024-09-15T23:18:12.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.028+0000 7fd9c17fa640 1 -- 172.21.15.123:0/1094799226 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd9c4026440 con 0x7fd9cc15c7f0 2024-09-15T23:18:12.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.028+0000 7fd9c17fa640 1 --2- 172.21.15.123:0/1094799226 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd9b806c2b0 0x7fd9b806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:12.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.028+0000 7fd9c17fa640 1 -- 172.21.15.123:0/1094799226 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(116..116 src has 1..116) ==== 5767+0+0 (secure 0 0 0) 0x7fd9c4094180 con 0x7fd9cc15c7f0 2024-09-15T23:18:12.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.029+0000 7fd9d08ee640 1 --2- 172.21.15.123:0/1094799226 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd9b806c2b0 0x7fd9b806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:12.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.030+0000 7fd9d08ee640 1 --2- 172.21.15.123:0/1094799226 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd9b806c2b0 0x7fd9b806e770 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8001010 tx=0x7fd9c8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:12.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.030+0000 7fd9d59c9740 1 Processor -- start 2024-09-15T23:18:12.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.030+0000 7fd9d59c9740 1 -- start start 2024-09-15T23:18:12.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.031+0000 7fd9d59c9740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5586eba08920 0x5586eba4e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:12.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.031+0000 7fd9d59c9740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5586eba060e0 0x5586eba08d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:12.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.031+0000 7fd9d59c9740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5586eba0a0b0 0x5586eba031a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:12.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.031+0000 7fd9d59c9740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5586eb96b6f0 con 0x5586eba060e0 2024-09-15T23:18:12.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.031+0000 7fd9d59c9740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5586eb913330 con 0x5586eba08920 2024-09-15T23:18:12.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.031+0000 7fd9d59c9740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5586eb9676b0 con 0x5586eba0a0b0 2024-09-15T23:18:12.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.031+0000 7fd9c3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5586eba060e0 0x5586eba08d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:12.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.031+0000 7fd9c3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5586eba060e0 0x5586eba08d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33780/0 (socket says 172.21.15.123:33780) 2024-09-15T23:18:12.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.031+0000 7fd9c3fff640 1 -- 172.21.15.123:0/3233954256 learned_addr learned my addr 172.21.15.123:0/3233954256 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:12.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.031+0000 7fd9d08ee640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5586eba08920 0x5586eba4e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:12.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.031+0000 7fd9d10ef640 1 --2- 172.21.15.123:0/3233954256 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5586eba0a0b0 0x5586eba031a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:12.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.031+0000 7fd9c3fff640 1 -- 172.21.15.123:0/3233954256 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5586eba0a0b0 msgr2=0x5586eba031a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:12.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.031+0000 7fd9c3fff640 1 --2- 172.21.15.123:0/3233954256 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5586eba0a0b0 0x5586eba031a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:12.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.031+0000 7fd9c3fff640 1 -- 172.21.15.123:0/3233954256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5586eba08920 msgr2=0x5586eba4e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:12.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.031+0000 7fd9c3fff640 1 --2- 172.21.15.123:0/3233954256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5586eba08920 0x5586eba4e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:12.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.031+0000 7fd9c3fff640 1 -- 172.21.15.123:0/3233954256 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586eb9390d0 con 0x5586eba060e0 2024-09-15T23:18:12.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.031+0000 7fd9d08ee640 1 --2- 172.21.15.123:0/3233954256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5586eba08920 0x5586eba4e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:18:12.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.031+0000 7fd9c3fff640 1 --2- 172.21.15.123:0/3233954256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5586eba060e0 0x5586eba08d00 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc009890 tx=0x7fd9bc02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e7fdb569e9782 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:12.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.032+0000 7fd9b27fc640 1 -- 172.21.15.123:0/3233954256 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc037040 con 0x5586eba060e0 2024-09-15T23:18:12.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.032+0000 7fd9b27fc640 1 -- 172.21.15.123:0/3233954256 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9bc032780 con 0x5586eba060e0 2024-09-15T23:18:12.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.032+0000 7fd9b27fc640 1 -- 172.21.15.123:0/3233954256 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc032b30 con 0x5586eba060e0 2024-09-15T23:18:12.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.032+0000 7fd9d59c9740 1 -- 172.21.15.123:0/3233954256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5586eba060e0 msgr2=0x5586eba08d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:12.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.032+0000 7fd9d59c9740 1 --2- 172.21.15.123:0/3233954256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5586eba060e0 0x5586eba08d00 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc009890 tx=0x7fd9bc02c000 comp rx=0 tx=0).stop 2024-09-15T23:18:12.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.033+0000 7fd9d59c9740 1 -- 172.21.15.123:0/3233954256 shutdown_connections 2024-09-15T23:18:12.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.033+0000 7fd9d59c9740 1 --2- 172.21.15.123:0/3233954256 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5586eba0a0b0 0x5586eba031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:12.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.033+0000 7fd9d59c9740 1 --2- 172.21.15.123:0/3233954256 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5586eba060e0 0x5586eba08d00 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:12.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.033+0000 7fd9d59c9740 1 --2- 172.21.15.123:0/3233954256 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5586eba08920 0x5586eba4e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:12.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.033+0000 7fd9d59c9740 1 -- 172.21.15.123:0/3233954256 >> 172.21.15.123:0/3233954256 conn(0x5586eba05370 msgr2=0x5586eba4d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:12.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.033+0000 7fd9d59c9740 1 -- 172.21.15.123:0/3233954256 shutdown_connections 2024-09-15T23:18:12.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.033+0000 7fd9d59c9740 1 -- 172.21.15.123:0/3233954256 wait complete. 2024-09-15T23:18:12.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.033+0000 7fd9d59c9740 1 -- start start 2024-09-15T23:18:12.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.034+0000 7fd9d59c9740 1 Processor -- start 2024-09-15T23:18:12.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.034+0000 7fd9d59c9740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5586eba08920 0x5586eba5d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:12.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.034+0000 7fd9d59c9740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5586eba0a0b0 0x5586eba30420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:12.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.035+0000 7fd9d59c9740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5586eba5d790 0x5586eba50aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:12.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.035+0000 7fd9d59c9740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5586eba04810 con 0x5586eba08920 2024-09-15T23:18:12.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.035+0000 7fd9d59c9740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5586eb8f44f0 con 0x5586eba0a0b0 2024-09-15T23:18:12.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.035+0000 7fd9d59c9740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5586eba4e8f0 con 0x5586eba5d790 2024-09-15T23:18:12.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.035+0000 7fd9d08ee640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5586eba08920 0x5586eba5d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:12.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.035+0000 7fd9c3fff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5586eba0a0b0 0x5586eba30420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:12.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.035+0000 7fd9d08ee640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5586eba08920 0x5586eba5d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33796/0 (socket says 172.21.15.123:33796) 2024-09-15T23:18:12.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.035+0000 7fd9d08ee640 1 -- 172.21.15.123:0/2748009652 learned_addr learned my addr 172.21.15.123:0/2748009652 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:12.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.035+0000 7fd9d59c9740 10 client.0 _ll_register_callbacks cb 0x5586eb915b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:18:12.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.035+0000 7fd9d10ef640 1 --2- 172.21.15.123:0/2748009652 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5586eba5d790 0x5586eba50aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:12.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.035+0000 7fd9c3fff640 1 -- 172.21.15.123:0/2748009652 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5586eba5d790 msgr2=0x5586eba50aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:12.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.035+0000 7fd9c3fff640 1 --2- 172.21.15.123:0/2748009652 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5586eba5d790 0x5586eba50aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:12.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.035+0000 7fd9c3fff640 1 -- 172.21.15.123:0/2748009652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5586eba08920 msgr2=0x5586eba5d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:12.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.035+0000 7fd9c3fff640 1 --2- 172.21.15.123:0/2748009652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5586eba08920 0x5586eba5d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:12.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.035+0000 7fd9c3fff640 1 -- 172.21.15.123:0/2748009652 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586eb7487d0 con 0x5586eba0a0b0 2024-09-15T23:18:12.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.035+0000 7fd9d08ee640 1 --2- 172.21.15.123:0/2748009652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5586eba08920 0x5586eba5d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:18:12.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.035+0000 7fd9c3fff640 1 --2- 172.21.15.123:0/2748009652 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5586eba0a0b0 0x5586eba30420 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc043000 tx=0x7fd9bc02c070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c25521abbcd9d5e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:12.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.035+0000 7fd9ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-09-15T23:18:12.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.036+0000 7fd9ab7fe640 1 -- 172.21.15.123:0/2748009652 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc04a020 con 0x5586eba0a0b0 2024-09-15T23:18:12.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.036+0000 7fd9ab7fe640 1 -- 172.21.15.123:0/2748009652 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 5767+0+0 (secure 0 0 0) 0x7fd9bc032d40 con 0x5586eba0a0b0 2024-09-15T23:18:12.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.036+0000 7fd9d59c9740 1 -- 172.21.15.123:0/2748009652 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9bc032780 con 0x5586eba0a0b0 2024-09-15T23:18:12.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.036+0000 7fd9ab7fe640 1 -- 172.21.15.123:0/2748009652 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fd9bc054050 con 0x5586eba0a0b0 2024-09-15T23:18:12.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.036+0000 7fd9d59c9740 10 client.6928 fetch_fsmap learned FSMap version 74 2024-09-15T23:18:12.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.036+0000 7fd9d59c9740 1 -- 172.21.15.123:0/2748009652 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x5586eb67e3f0 con 0x5586eba0a0b0 2024-09-15T23:18:12.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.036+0000 7fd9ab7fe640 1 -- 172.21.15.123:0/2748009652 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9bc003610 con 0x5586eba0a0b0 2024-09-15T23:18:12.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.036+0000 7fd9ab7fe640 1 -- 172.21.15.123:0/2748009652 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 74) ==== 3502+0+0 (secure 0 0 0) 0x7fd9bc057020 con 0x5586eba0a0b0 2024-09-15T23:18:12.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.036+0000 7fd9d59c9740 10 client.6928 fetch_fsmap finished waiting for FSMap version 74 2024-09-15T23:18:12.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.036+0000 7fd9d59c9740 10 client.6928 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-15T23:18:12.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.036+0000 7fd9d59c9740 20 client.6928 populate_metadata read hostname 'smithi123' 2024-09-15T23:18:12.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.036+0000 7fd9d59c9740 1 --2- 172.21.15.123:0/2748009652 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x5586eba30960 0x5586eba61310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:12.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.036+0000 7fd9d59c9740 4 client.6928 mds_command: new command op to 7608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:18:12.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.036+0000 7fd9d59c9740 1 -- 172.21.15.123:0/2748009652 --> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd9bc032780 con 0x5586eba30960 2024-09-15T23:18:12.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.037+0000 7fd9d08ee640 1 --2- 172.21.15.123:0/2748009652 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x5586eba30960 0x5586eba61310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:12.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.037+0000 7fd9ab7fe640 10 client.6928 ms_handle_connect on v2:172.21.15.123:6833/3823805081 2024-09-15T23:18:12.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.037+0000 7fd9d08ee640 1 --2- 172.21.15.123:0/2748009652 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x5586eba30960 0x5586eba61310 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=175cd974c41e1470 server_cookie=4664a9f65c1351e9 in_seq=0 out_seq=0 2024-09-15T23:18:12.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.038+0000 7fd9ab7fe640 1 -- 172.21.15.123:0/2748009652 <== mds.0 v2:172.21.15.123:6833/3823805081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fd9bc032780 con 0x5586eba30960 2024-09-15T23:18:12.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.038+0000 7fd9ab7fe640 10 client.6928 handle_command_reply: tid=0 2024-09-15T23:18:12.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.038+0000 7fd9d59c9740 1 client.6928 shutdown 2024-09-15T23:18:12.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.039+0000 7fd9d59c9740 1 -- 172.21.15.123:0/2748009652 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5586eba0a0b0 msgr2=0x5586eba30420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:12.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.039+0000 7fd9d59c9740 1 --2- 172.21.15.123:0/2748009652 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5586eba0a0b0 0x5586eba30420 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc043000 tx=0x7fd9bc02c070 comp rx=0 tx=0).stop 2024-09-15T23:18:12.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.039+0000 7fd9d59c9740 1 -- 172.21.15.123:0/2748009652 shutdown_connections 2024-09-15T23:18:12.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.039+0000 7fd9d59c9740 1 --2- 172.21.15.123:0/2748009652 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x5586eba30960 0x5586eba61310 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:12.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.039+0000 7fd9ab7fe640 0 client.6928 ms_handle_reset on v2:172.21.15.123:6833/3823805081 2024-09-15T23:18:12.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.039+0000 7fd9d59c9740 1 --2- 172.21.15.123:0/2748009652 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5586eba5d790 0x5586eba50aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:12.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.039+0000 7fd9d59c9740 1 --2- 172.21.15.123:0/2748009652 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5586eba0a0b0 0x5586eba30420 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:12.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.039+0000 7fd9d59c9740 1 --2- 172.21.15.123:0/2748009652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5586eba08920 0x5586eba5d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:12.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.039+0000 7fd9d59c9740 1 -- 172.21.15.123:0/2748009652 >> 172.21.15.123:0/2748009652 conn(0x5586eba060e0 msgr2=0x5586eba4b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:12.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.039+0000 7fd9d59c9740 1 -- 172.21.15.123:0/2748009652 shutdown_connections 2024-09-15T23:18:12.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.039+0000 7fd9d59c9740 1 -- 172.21.15.123:0/2748009652 wait complete. 2024-09-15T23:18:12.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.039+0000 7fd9d59c9740 20 client.6928 trim_cache size 0 max 16384 2024-09-15T23:18:12.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.061+0000 7fd9d59c9740 1 Processor -- start 2024-09-15T23:18:12.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.063+0000 7fd9d59c9740 1 -- start start 2024-09-15T23:18:12.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.063+0000 7fd9d59c9740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5586eba08920 0x5586eba29480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:12.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.063+0000 7fd9d59c9740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5586eba0a0b0 0x5586eba4b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:12.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.063+0000 7fd9d59c9740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5586eba30960 0x5586eba4ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:12.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.063+0000 7fd9d59c9740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd9cc0ac820 con 0x5586eba08920 2024-09-15T23:18:12.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.063+0000 7fd9d59c9740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd9cc0ab8c0 con 0x5586eba30960 2024-09-15T23:18:12.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.063+0000 7fd9d59c9740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd9cc14d770 con 0x5586eba0a0b0 2024-09-15T23:18:12.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.063+0000 7fd9d08ee640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5586eba08920 0x5586eba29480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:12.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.063+0000 7fd9d08ee640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5586eba08920 0x5586eba29480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33798/0 (socket says 172.21.15.123:33798) 2024-09-15T23:18:12.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.063+0000 7fd9d08ee640 1 -- 172.21.15.123:0/2111643212 learned_addr learned my addr 172.21.15.123:0/2111643212 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:12.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.063+0000 7fd9d10ef640 1 --2- 172.21.15.123:0/2111643212 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5586eba30960 0x5586eba4ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:12.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.063+0000 7fd9c3fff640 1 --2- 172.21.15.123:0/2111643212 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5586eba0a0b0 0x5586eba4b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:12.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.063+0000 7fd9d08ee640 1 -- 172.21.15.123:0/2111643212 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5586eba0a0b0 msgr2=0x5586eba4b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:12.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.063+0000 7fd9d08ee640 1 --2- 172.21.15.123:0/2111643212 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5586eba0a0b0 0x5586eba4b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:12.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.063+0000 7fd9d08ee640 1 -- 172.21.15.123:0/2111643212 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5586eba30960 msgr2=0x5586eba4ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:12.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.063+0000 7fd9d08ee640 1 --2- 172.21.15.123:0/2111643212 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5586eba30960 0x5586eba4ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:12.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.063+0000 7fd9d08ee640 1 -- 172.21.15.123:0/2111643212 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586eba50e10 con 0x5586eba08920 2024-09-15T23:18:12.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.063+0000 7fd9d10ef640 1 --2- 172.21.15.123:0/2111643212 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5586eba30960 0x5586eba4ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:18:12.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.063+0000 7fd9c3fff640 1 --2- 172.21.15.123:0/2111643212 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5586eba0a0b0 0x5586eba4b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:18:12.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.063+0000 7fd9d08ee640 1 --2- 172.21.15.123:0/2111643212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5586eba08920 0x5586eba29480 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8005280 tx=0x7fd9c8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=899682a24a5d0180 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:12.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.063+0000 7fd9b1ffb640 1 -- 172.21.15.123:0/2111643212 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c80035f0 con 0x5586eba08920 2024-09-15T23:18:12.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.063+0000 7fd9b1ffb640 1 -- 172.21.15.123:0/2111643212 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9c80037b0 con 0x5586eba08920 2024-09-15T23:18:12.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.063+0000 7fd9b1ffb640 1 -- 172.21.15.123:0/2111643212 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c80039a0 con 0x5586eba08920 2024-09-15T23:18:12.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.064+0000 7fd9d59c9740 1 -- 172.21.15.123:0/2111643212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5586eba08920 msgr2=0x5586eba29480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:12.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.064+0000 7fd9d59c9740 1 --2- 172.21.15.123:0/2111643212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5586eba08920 0x5586eba29480 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8005280 tx=0x7fd9c8012000 comp rx=0 tx=0).stop 2024-09-15T23:18:12.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.064+0000 7fd9d59c9740 1 -- 172.21.15.123:0/2111643212 shutdown_connections 2024-09-15T23:18:12.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.064+0000 7fd9d59c9740 1 --2- 172.21.15.123:0/2111643212 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5586eba30960 0x5586eba4ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:12.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.064+0000 7fd9d59c9740 1 --2- 172.21.15.123:0/2111643212 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5586eba0a0b0 0x5586eba4b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:12.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.064+0000 7fd9d59c9740 1 --2- 172.21.15.123:0/2111643212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5586eba08920 0x5586eba29480 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:12.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.064+0000 7fd9d59c9740 1 -- 172.21.15.123:0/2111643212 >> 172.21.15.123:0/2111643212 conn(0x5586eba060e0 msgr2=0x5586eba02fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:12.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.064+0000 7fd9d59c9740 1 -- 172.21.15.123:0/2111643212 shutdown_connections 2024-09-15T23:18:12.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.064+0000 7fd9d59c9740 1 -- 172.21.15.123:0/2111643212 wait complete. 2024-09-15T23:18:12.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.064+0000 7fd9d59c9740 1 -- start start 2024-09-15T23:18:12.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.065+0000 7fd9d59c9740 1 Processor -- start 2024-09-15T23:18:12.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.065+0000 7fd9d59c9740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5586eba08920 0x5586eba27fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:12.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.065+0000 7fd9d59c9740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5586eba0a0b0 0x5586ebacacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:12.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.065+0000 7fd9d59c9740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5586eba30960 0x5586eba71a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:12.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.066+0000 7fd9d59c9740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd9cc14b530 con 0x5586eba08920 2024-09-15T23:18:12.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.066+0000 7fd9d59c9740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5586ebacb500 con 0x5586eba0a0b0 2024-09-15T23:18:12.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.066+0000 7fd9d59c9740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5586eba4c550 con 0x5586eba30960 2024-09-15T23:18:12.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.066+0000 7fd9d08ee640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5586eba08920 0x5586eba27fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:12.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.066+0000 7fd9d08ee640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5586eba08920 0x5586eba27fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33814/0 (socket says 172.21.15.123:33814) 2024-09-15T23:18:12.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.066+0000 7fd9d59c9740 10 client.0 _ll_register_callbacks cb 0x7fd9c8001480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:18:12.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.066+0000 7fd9d08ee640 1 -- 172.21.15.123:0/2116861271 learned_addr learned my addr 172.21.15.123:0/2116861271 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:12.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.066+0000 7fd9d10ef640 1 --2- 172.21.15.123:0/2116861271 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5586eba30960 0x5586eba71a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:12.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.066+0000 7fd9c3fff640 1 --2- 172.21.15.123:0/2116861271 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5586eba0a0b0 0x5586ebacacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:12.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.066+0000 7fd9d08ee640 1 -- 172.21.15.123:0/2116861271 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5586eba30960 msgr2=0x5586eba71a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:12.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.066+0000 7fd9d08ee640 1 --2- 172.21.15.123:0/2116861271 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5586eba30960 0x5586eba71a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:12.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.066+0000 7fd9d08ee640 1 -- 172.21.15.123:0/2116861271 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5586eba0a0b0 msgr2=0x5586ebacacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:12.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.066+0000 7fd9d08ee640 1 --2- 172.21.15.123:0/2116861271 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5586eba0a0b0 0x5586ebacacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:12.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.066+0000 7fd9d08ee640 1 -- 172.21.15.123:0/2116861271 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586eb63e0f0 con 0x5586eba08920 2024-09-15T23:18:12.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.066+0000 7fd9d08ee640 1 --2- 172.21.15.123:0/2116861271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5586eba08920 0x5586eba27fc0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8015040 tx=0x7fd9c8001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2260437f325e2645 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:12.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.066+0000 7fd9ab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:18:12.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.066+0000 7fd9ab7fe640 1 -- 172.21.15.123:0/2116861271 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c802d440 con 0x5586eba08920 2024-09-15T23:18:12.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.066+0000 7fd9ab7fe640 1 -- 172.21.15.123:0/2116861271 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(116..116 src has 1..116) ==== 5767+0+0 (secure 0 0 0) 0x7fd9c802d5e0 con 0x5586eba08920 2024-09-15T23:18:12.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.066+0000 7fd9d59c9740 1 -- 172.21.15.123:0/2116861271 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9c80037b0 con 0x5586eba08920 2024-09-15T23:18:12.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.066+0000 7fd9ab7fe640 1 -- 172.21.15.123:0/2116861271 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fd9c803d050 con 0x5586eba08920 2024-09-15T23:18:12.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.066+0000 7fd9d59c9740 10 client.7845 fetch_fsmap learned FSMap version 74 2024-09-15T23:18:12.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.066+0000 7fd9d59c9740 1 -- 172.21.15.123:0/2116861271 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x5586eba2f8b0 con 0x5586eba08920 2024-09-15T23:18:12.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.067+0000 7fd9ab7fe640 1 -- 172.21.15.123:0/2116861271 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9c80037b0 con 0x5586eba08920 2024-09-15T23:18:12.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.067+0000 7fd9ab7fe640 1 -- 172.21.15.123:0/2116861271 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 74) ==== 3502+0+0 (secure 0 0 0) 0x7fd9c8040020 con 0x5586eba08920 2024-09-15T23:18:12.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.067+0000 7fd9d59c9740 10 client.7845 fetch_fsmap finished waiting for FSMap version 74 2024-09-15T23:18:12.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.067+0000 7fd9d59c9740 10 client.7845 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-15T23:18:12.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.067+0000 7fd9d59c9740 20 client.7845 populate_metadata read hostname 'smithi123' 2024-09-15T23:18:12.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.067+0000 7fd9d59c9740 1 --2- 172.21.15.123:0/2116861271 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x5586eba33340 0x5586eba4b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:12.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.067+0000 7fd9d59c9740 4 client.7845 mds_command: new command op to 7608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:18:12.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.067+0000 7fd9d59c9740 1 -- 172.21.15.123:0/2116861271 --> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5586eb978e20 con 0x5586eba33340 2024-09-15T23:18:12.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.067+0000 7fd9c3fff640 1 --2- 172.21.15.123:0/2116861271 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x5586eba33340 0x5586eba4b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:12.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.067+0000 7fd9ab7fe640 10 client.7845 ms_handle_connect on v2:172.21.15.123:6833/3823805081 2024-09-15T23:18:12.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.067+0000 7fd9c3fff640 1 --2- 172.21.15.123:0/2116861271 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x5586eba33340 0x5586eba4b540 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13e2a6683aabe9c2 server_cookie=c2ff35a5763c8ad9 in_seq=0 out_seq=0 2024-09-15T23:18:12.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.067+0000 7fd9ab7fe640 1 -- 172.21.15.123:0/2116861271 <== mds.0 v2:172.21.15.123:6833/3823805081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+257 (crc 0 0 0) 0x5586eb978e20 con 0x5586eba33340 2024-09-15T23:18:12.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.067+0000 7fd9ab7fe640 10 client.7845 handle_command_reply: tid=0 2024-09-15T23:18:12.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.067+0000 7fd9d59c9740 1 client.7845 shutdown 2024-09-15T23:18:12.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.068+0000 7fd9d59c9740 1 -- 172.21.15.123:0/2116861271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5586eba08920 msgr2=0x5586eba27fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:12.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.068+0000 7fd9d59c9740 1 --2- 172.21.15.123:0/2116861271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5586eba08920 0x5586eba27fc0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8015040 tx=0x7fd9c8001080 comp rx=0 tx=0).stop 2024-09-15T23:18:12.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.068+0000 7fd9d59c9740 1 -- 172.21.15.123:0/2116861271 shutdown_connections 2024-09-15T23:18:12.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.068+0000 7fd9d59c9740 1 --2- 172.21.15.123:0/2116861271 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x5586eba33340 0x5586eba4b540 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:12.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.068+0000 7fd9d59c9740 1 --2- 172.21.15.123:0/2116861271 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5586eba30960 0x5586eba71a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:12.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.068+0000 7fd9d59c9740 1 --2- 172.21.15.123:0/2116861271 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5586eba0a0b0 0x5586ebacacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:12.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.068+0000 7fd9d59c9740 1 --2- 172.21.15.123:0/2116861271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5586eba08920 0x5586eba27fc0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:12.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.068+0000 7fd9d59c9740 1 -- 172.21.15.123:0/2116861271 >> 172.21.15.123:0/2116861271 conn(0x5586eba060e0 msgr2=0x5586eba4f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:12.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.068+0000 7fd9ab7fe640 0 client.7845 ms_handle_reset on v2:172.21.15.123:6833/3823805081 2024-09-15T23:18:12.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.068+0000 7fd9d59c9740 1 -- 172.21.15.123:0/2116861271 shutdown_connections 2024-09-15T23:18:12.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.068+0000 7fd9d59c9740 1 -- 172.21.15.123:0/2116861271 wait complete. 2024-09-15T23:18:12.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.068+0000 7fd9d59c9740 20 client.7845 trim_cache size 0 max 16384 2024-09-15T23:18:12.077 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:18:12.077 INFO:teuthology.orchestra.run.smithi123.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-15T23:18:12.077 INFO:teuthology.orchestra.run.smithi123.stdout: "scrubs": { 2024-09-15T23:18:12.077 INFO:teuthology.orchestra.run.smithi123.stdout: "8b1d9b34-478a-4e7a-bdd2-593a2c5d1a28": { 2024-09-15T23:18:12.078 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "~mds0", 2024-09-15T23:18:12.078 INFO:teuthology.orchestra.run.smithi123.stdout: "tag": "8b1d9b34-478a-4e7a-bdd2-593a2c5d1a28", 2024-09-15T23:18:12.078 INFO:teuthology.orchestra.run.smithi123.stdout: "options": "recursive" 2024-09-15T23:18:12.078 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:12.078 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:12.078 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:18:12.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.068+0000 7fd9d2b52640 1 -- 172.21.15.123:0/1094799226 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd9b806c2b0 msgr2=0x7fd9b806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:12.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.068+0000 7fd9d2b52640 1 --2- 172.21.15.123:0/1094799226 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd9b806c2b0 0x7fd9b806e770 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8001010 tx=0x7fd9c8009040 comp rx=0 tx=0).stop 2024-09-15T23:18:12.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.068+0000 7fd9d2b52640 1 -- 172.21.15.123:0/1094799226 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd9cc15c7f0 msgr2=0x7fd9cc0ae880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:12.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.068+0000 7fd9d2b52640 1 --2- 172.21.15.123:0/1094799226 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd9cc15c7f0 0x7fd9cc0ae880 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4005c00 tx=0x7fd9c400a7a0 comp rx=0 tx=0).stop 2024-09-15T23:18:12.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.068+0000 7fd9d2b52640 1 -- 172.21.15.123:0/1094799226 shutdown_connections 2024-09-15T23:18:12.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.068+0000 7fd9d2b52640 1 --2- 172.21.15.123:0/1094799226 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd9cc15c7f0 0x7fd9cc0ae880 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:12.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.068+0000 7fd9d2b52640 1 --2- 172.21.15.123:0/1094799226 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd9b806c2b0 0x7fd9b806e770 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:12.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.068+0000 7fd9d2b52640 1 --2- 172.21.15.123:0/1094799226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9cc0730f0 0x7fd9cc0b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:12.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.068+0000 7fd9d2b52640 1 --2- 172.21.15.123:0/1094799226 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9cc06f460 0x7fd9cc15f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:12.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.068+0000 7fd9d2b52640 1 -- 172.21.15.123:0/1094799226 >> 172.21.15.123:0/1094799226 conn(0x7fd9cc0d2570 msgr2=0x7fd9cc0b3420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:12.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.068+0000 7fd9d2b52640 1 -- 172.21.15.123:0/1094799226 shutdown_connections 2024-09-15T23:18:12.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:12.068+0000 7fd9d2b52640 1 -- 172.21.15.123:0/1094799226 wait complete. 2024-09-15T23:18:12.081 INFO:tasks.cephfs.filesystem:scrub status for tag:8b1d9b34-478a-4e7a-bdd2-593a2c5d1a28 - {'path': '~mds0', 'tag': '8b1d9b34-478a-4e7a-bdd2-593a2c5d1a28', 'options': 'recursive'} 2024-09-15T23:18:39.214 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:18:39.218 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:18:42.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:18:42.082 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-09-15T23:18:42.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.200+0000 7fbd91882640 1 Processor -- start 2024-09-15T23:18:42.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.200+0000 7fbd91882640 1 -- start start 2024-09-15T23:18:42.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.201+0000 7fbd91882640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd8c0ccf30 0x7fbd8c0b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.201+0000 7fbd91882640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbd8c15b7c0 0x7fbd8c0cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.201+0000 7fbd91882640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fbd8c0cead0 0x7fbd8c15f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.201+0000 7fbd91882640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fbd8c0cd850 con 0x7fbd8c15b7c0 2024-09-15T23:18:42.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.201+0000 7fbd91882640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fbd8c0cf2e0 con 0x7fbd8c0cead0 2024-09-15T23:18:42.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.201+0000 7fbd91882640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbd8c070fe0 con 0x7fbd8c0ccf30 2024-09-15T23:18:42.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.201+0000 7fbd83fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbd8c15b7c0 0x7fbd8c0cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.201+0000 7fbd83fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbd8c15b7c0 0x7fbd8c0cd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50706/0 (socket says 172.21.15.123:50706) 2024-09-15T23:18:42.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.201+0000 7fbd83fff640 1 -- 172.21.15.123:0/3157723784 learned_addr learned my addr 172.21.15.123:0/3157723784 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:42.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.201+0000 7fbd8b7fe640 1 --2- 172.21.15.123:0/3157723784 >> v2:172.21.15.188:3300/0 conn(0x7fbd8c0cead0 0x7fbd8c15f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.201+0000 7fbd83fff640 1 -- 172.21.15.123:0/3157723784 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd8c0ccf30 msgr2=0x7fbd8c0b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:42.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.201+0000 7fbd83fff640 1 --2- 172.21.15.123:0/3157723784 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd8c0ccf30 0x7fbd8c0b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.201+0000 7fbd83fff640 1 -- 172.21.15.123:0/3157723784 >> v2:172.21.15.188:3300/0 conn(0x7fbd8c0cead0 msgr2=0x7fbd8c15f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:42.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.201+0000 7fbd83fff640 1 --2- 172.21.15.123:0/3157723784 >> v2:172.21.15.188:3300/0 conn(0x7fbd8c0cead0 0x7fbd8c15f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.201+0000 7fbd83fff640 1 -- 172.21.15.123:0/3157723784 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd8c0712c0 con 0x7fbd8c15b7c0 2024-09-15T23:18:42.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.202+0000 7fbd83fff640 1 --2- 172.21.15.123:0/3157723784 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd8c15b7c0 0x7fbd8c0cd310 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c06dc70 tx=0x7fbd7402c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a14880eab94d0d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:42.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.202+0000 7fbd8a7fc640 1 -- 172.21.15.123:0/3157723784 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd74032700 con 0x7fbd8c15b7c0 2024-09-15T23:18:42.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.202+0000 7fbd8a7fc640 1 -- 172.21.15.123:0/3157723784 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd740328a0 con 0x7fbd8c15b7c0 2024-09-15T23:18:42.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.202+0000 7fbd8a7fc640 1 -- 172.21.15.123:0/3157723784 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd74032c70 con 0x7fbd8c15b7c0 2024-09-15T23:18:42.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.203+0000 7fbd91882640 1 -- 172.21.15.123:0/3157723784 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd8c15b7c0 msgr2=0x7fbd8c0cd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:42.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.203+0000 7fbd91882640 1 --2- 172.21.15.123:0/3157723784 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd8c15b7c0 0x7fbd8c0cd310 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c06dc70 tx=0x7fbd7402c800 comp rx=0 tx=0).stop 2024-09-15T23:18:42.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.203+0000 7fbd91882640 1 -- 172.21.15.123:0/3157723784 shutdown_connections 2024-09-15T23:18:42.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.203+0000 7fbd91882640 1 --2- 172.21.15.123:0/3157723784 >> v2:172.21.15.188:3300/0 conn(0x7fbd8c0cead0 0x7fbd8c15f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.203+0000 7fbd91882640 1 --2- 172.21.15.123:0/3157723784 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd8c15b7c0 0x7fbd8c0cd310 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.203+0000 7fbd91882640 1 --2- 172.21.15.123:0/3157723784 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd8c0ccf30 0x7fbd8c0b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.203+0000 7fbd91882640 1 -- 172.21.15.123:0/3157723784 >> 172.21.15.123:0/3157723784 conn(0x7fbd8c06d0f0 msgr2=0x7fbd8c06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:42.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.203+0000 7fbd91882640 1 -- 172.21.15.123:0/3157723784 shutdown_connections 2024-09-15T23:18:42.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.203+0000 7fbd91882640 1 -- 172.21.15.123:0/3157723784 wait complete. 2024-09-15T23:18:42.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.204+0000 7fbd91882640 1 Processor -- start 2024-09-15T23:18:42.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.204+0000 7fbd91882640 1 -- start start 2024-09-15T23:18:42.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.205+0000 7fbd91882640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbd8c0ccf30 0x7fbd8c143280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.205+0000 7fbd91882640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd8c0cead0 0x7fbd8c15c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.205+0000 7fbd91882640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd8c15b7c0 0x7fbd8c15eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.205+0000 7fbd91882640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c0cef40 con 0x7fbd8c15b7c0 2024-09-15T23:18:42.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.205+0000 7fbd91882640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c0cf5c0 con 0x7fbd8c0ccf30 2024-09-15T23:18:42.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.205+0000 7fbd91882640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbd8c0cf0c0 con 0x7fbd8c0cead0 2024-09-15T23:18:42.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.205+0000 7fbd8b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd8c15b7c0 0x7fbd8c15eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.205+0000 7fbd8b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd8c15b7c0 0x7fbd8c15eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50712/0 (socket says 172.21.15.123:50712) 2024-09-15T23:18:42.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.205+0000 7fbd8b7fe640 1 -- 172.21.15.123:0/407631532 learned_addr learned my addr 172.21.15.123:0/407631532 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:42.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.205+0000 7fbd83fff640 1 --2- 172.21.15.123:0/407631532 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd8c0cead0 0x7fbd8c15c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.205+0000 7fbd8affd640 1 --2- 172.21.15.123:0/407631532 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbd8c0ccf30 0x7fbd8c143280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.206+0000 7fbd8b7fe640 1 -- 172.21.15.123:0/407631532 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd8c0cead0 msgr2=0x7fbd8c15c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:42.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.206+0000 7fbd8b7fe640 1 --2- 172.21.15.123:0/407631532 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd8c0cead0 0x7fbd8c15c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.206+0000 7fbd8b7fe640 1 -- 172.21.15.123:0/407631532 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbd8c0ccf30 msgr2=0x7fbd8c143280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:42.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.206+0000 7fbd8b7fe640 1 --2- 172.21.15.123:0/407631532 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbd8c0ccf30 0x7fbd8c143280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.206+0000 7fbd8b7fe640 1 -- 172.21.15.123:0/407631532 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd8c159550 con 0x7fbd8c15b7c0 2024-09-15T23:18:42.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.206+0000 7fbd8b7fe640 1 --2- 172.21.15.123:0/407631532 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd8c15b7c0 0x7fbd8c15eec0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400cd70 tx=0x7fbd8400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:42.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.206+0000 7fbd88ff9640 1 -- 172.21.15.123:0/407631532 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd84003b90 con 0x7fbd8c15b7c0 2024-09-15T23:18:42.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.206+0000 7fbd88ff9640 1 -- 172.21.15.123:0/407631532 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd84003d30 con 0x7fbd8c15b7c0 2024-09-15T23:18:42.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.206+0000 7fbd91882640 1 -- 172.21.15.123:0/407631532 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd8c159830 con 0x7fbd8c15b7c0 2024-09-15T23:18:42.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.206+0000 7fbd88ff9640 1 -- 172.21.15.123:0/407631532 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd84004240 con 0x7fbd8c15b7c0 2024-09-15T23:18:42.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.206+0000 7fbd91882640 1 -- 172.21.15.123:0/407631532 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd8c159df0 con 0x7fbd8c15b7c0 2024-09-15T23:18:42.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.208+0000 7fbd88ff9640 1 -- 172.21.15.123:0/407631532 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbd840043e0 con 0x7fbd8c15b7c0 2024-09-15T23:18:42.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.208+0000 7fbd88ff9640 1 --2- 172.21.15.123:0/407631532 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbd6c06c2b0 0x7fbd6c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.208+0000 7fbd88ff9640 1 -- 172.21.15.123:0/407631532 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5795+0+0 (secure 0 0 0) 0x7fbd8408be20 con 0x7fbd8c15b7c0 2024-09-15T23:18:42.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.209+0000 7fbd8affd640 1 --2- 172.21.15.123:0/407631532 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbd6c06c2b0 0x7fbd6c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.209+0000 7fbd9461e740 1 Processor -- start 2024-09-15T23:18:42.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.209+0000 7fbd8affd640 1 --2- 172.21.15.123:0/407631532 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbd6c06c2b0 0x7fbd6c06e770 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c0098e0 tx=0x7fbd7c009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:42.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.209+0000 7fbd9461e740 1 -- start start 2024-09-15T23:18:42.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.210+0000 7fbd9461e740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d515720780 0x55d515720b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.210+0000 7fbd9461e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d51573b140 0x55d51573c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.210+0000 7fbd9461e740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d5156f40e0 0x55d51573ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.210+0000 7fbd9461e740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d5156596f0 con 0x55d515720780 2024-09-15T23:18:42.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.210+0000 7fbd9461e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55d515601330 con 0x55d51573b140 2024-09-15T23:18:42.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.210+0000 7fbd9461e740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55d5156556b0 con 0x55d5156f40e0 2024-09-15T23:18:42.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.210+0000 7fbd8affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d515720780 0x55d515720b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.210+0000 7fbd8affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d515720780 0x55d515720b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50726/0 (socket says 172.21.15.123:50726) 2024-09-15T23:18:42.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.210+0000 7fbd8affd640 1 -- 172.21.15.123:0/3560192875 learned_addr learned my addr 172.21.15.123:0/3560192875 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:42.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.210+0000 7fbd83fff640 1 --2- 172.21.15.123:0/3560192875 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d51573b140 0x55d51573c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.210+0000 7fbd8b7fe640 1 --2- 172.21.15.123:0/3560192875 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d5156f40e0 0x55d51573ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.210+0000 7fbd8affd640 1 -- 172.21.15.123:0/3560192875 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d5156f40e0 msgr2=0x55d51573ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:42.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.210+0000 7fbd8affd640 1 --2- 172.21.15.123:0/3560192875 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d5156f40e0 0x55d51573ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.210+0000 7fbd8affd640 1 -- 172.21.15.123:0/3560192875 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d51573b140 msgr2=0x55d51573c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:42.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.210+0000 7fbd8affd640 1 --2- 172.21.15.123:0/3560192875 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d51573b140 0x55d51573c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.210+0000 7fbd8affd640 1 -- 172.21.15.123:0/3560192875 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5156270d0 con 0x55d515720780 2024-09-15T23:18:42.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.211+0000 7fbd8affd640 1 --2- 172.21.15.123:0/3560192875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d515720780 0x55d515720b60 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c00eba0 tx=0x7fbd7c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b04e0c6766eb4e74 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:42.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.211+0000 7fbd817fa640 1 -- 172.21.15.123:0/3560192875 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c01b040 con 0x55d515720780 2024-09-15T23:18:42.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.211+0000 7fbd817fa640 1 -- 172.21.15.123:0/3560192875 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd7c024070 con 0x55d515720780 2024-09-15T23:18:42.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.211+0000 7fbd817fa640 1 -- 172.21.15.123:0/3560192875 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c015ce0 con 0x55d515720780 2024-09-15T23:18:42.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.211+0000 7fbd9461e740 1 -- 172.21.15.123:0/3560192875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d515720780 msgr2=0x55d515720b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:42.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.211+0000 7fbd9461e740 1 --2- 172.21.15.123:0/3560192875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d515720780 0x55d515720b60 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c00eba0 tx=0x7fbd7c011000 comp rx=0 tx=0).stop 2024-09-15T23:18:42.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.211+0000 7fbd9461e740 1 -- 172.21.15.123:0/3560192875 shutdown_connections 2024-09-15T23:18:42.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.211+0000 7fbd9461e740 1 --2- 172.21.15.123:0/3560192875 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d5156f40e0 0x55d51573ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.211+0000 7fbd9461e740 1 --2- 172.21.15.123:0/3560192875 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d51573b140 0x55d51573c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.211+0000 7fbd9461e740 1 --2- 172.21.15.123:0/3560192875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d515720780 0x55d515720b60 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.211+0000 7fbd9461e740 1 -- 172.21.15.123:0/3560192875 >> 172.21.15.123:0/3560192875 conn(0x55d5156f3370 msgr2=0x55d51573b590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:42.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.212+0000 7fbd9461e740 1 -- 172.21.15.123:0/3560192875 shutdown_connections 2024-09-15T23:18:42.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.212+0000 7fbd9461e740 1 -- 172.21.15.123:0/3560192875 wait complete. 2024-09-15T23:18:42.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.212+0000 7fbd9461e740 1 -- start start 2024-09-15T23:18:42.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.212+0000 7fbd9461e740 1 Processor -- start 2024-09-15T23:18:42.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.213+0000 7fbd9461e740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d515720780 0x55d51571ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.213+0000 7fbd9461e740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d51573b140 0x55d5157247e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.213+0000 7fbd9461e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d51573ea80 0x55d51573eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.213+0000 7fbd9461e740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d515721540 con 0x55d515720780 2024-09-15T23:18:42.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.213+0000 7fbd9461e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55d5155e24f0 con 0x55d51573ea80 2024-09-15T23:18:42.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.213+0000 7fbd9461e740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55d51573bdd0 con 0x55d51573b140 2024-09-15T23:18:42.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.213+0000 7fbd9461e740 10 client.0 _ll_register_callbacks cb 0x55d515603b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:18:42.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.213+0000 7fbd8affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d515720780 0x55d51571ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.213+0000 7fbd8affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d515720780 0x55d51571ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50732/0 (socket says 172.21.15.123:50732) 2024-09-15T23:18:42.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.213+0000 7fbd8affd640 1 -- 172.21.15.123:0/2317517361 learned_addr learned my addr 172.21.15.123:0/2317517361 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:42.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.213+0000 7fbd83fff640 1 --2- 172.21.15.123:0/2317517361 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d51573b140 0x55d5157247e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.213+0000 7fbd8b7fe640 1 --2- 172.21.15.123:0/2317517361 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d51573ea80 0x55d51573eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.213+0000 7fbd8affd640 1 -- 172.21.15.123:0/2317517361 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d51573b140 msgr2=0x55d5157247e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:42.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.213+0000 7fbd8affd640 1 --2- 172.21.15.123:0/2317517361 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d51573b140 0x55d5157247e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.213+0000 7fbd8affd640 1 -- 172.21.15.123:0/2317517361 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d51573ea80 msgr2=0x55d51573eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:42.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.213+0000 7fbd8affd640 1 --2- 172.21.15.123:0/2317517361 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d51573ea80 0x55d51573eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.213+0000 7fbd8affd640 1 -- 172.21.15.123:0/2317517361 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5154367d0 con 0x55d515720780 2024-09-15T23:18:42.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.213+0000 7fbd8b7fe640 1 --2- 172.21.15.123:0/2317517361 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d51573ea80 0x55d51573eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:18:42.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.214+0000 7fbd8affd640 1 --2- 172.21.15.123:0/2317517361 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d515720780 0x55d51571ade0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x55d51571e110 tx=0x7fbd7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6acc2af9592cd63 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:42.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.214+0000 7fbd6a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:18:42.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.214+0000 7fbd6a7fc640 1 -- 172.21.15.123:0/2317517361 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c02e070 con 0x55d515720780 2024-09-15T23:18:42.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.214+0000 7fbd6a7fc640 1 -- 172.21.15.123:0/2317517361 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 5795+0+0 (secure 0 0 0) 0x7fbd7c0138e0 con 0x55d515720780 2024-09-15T23:18:42.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.214+0000 7fbd9461e740 1 -- 172.21.15.123:0/2317517361 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd7c024070 con 0x55d515720780 2024-09-15T23:18:42.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.214+0000 7fbd6a7fc640 1 -- 172.21.15.123:0/2317517361 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fbd7c03c050 con 0x55d515720780 2024-09-15T23:18:42.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.214+0000 7fbd9461e740 10 client.7857 fetch_fsmap learned FSMap version 74 2024-09-15T23:18:42.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.214+0000 7fbd9461e740 1 -- 172.21.15.123:0/2317517361 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x55d51536c3f0 con 0x55d515720780 2024-09-15T23:18:42.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.214+0000 7fbd6a7fc640 1 -- 172.21.15.123:0/2317517361 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd7c024070 con 0x55d515720780 2024-09-15T23:18:42.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.214+0000 7fbd6a7fc640 1 -- 172.21.15.123:0/2317517361 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 74) ==== 3502+0+0 (secure 0 0 0) 0x7fbd7c03f020 con 0x55d515720780 2024-09-15T23:18:42.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.214+0000 7fbd9461e740 10 client.7857 fetch_fsmap finished waiting for FSMap version 74 2024-09-15T23:18:42.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.214+0000 7fbd9461e740 10 client.7857 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-15T23:18:42.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.214+0000 7fbd9461e740 20 client.7857 populate_metadata read hostname 'smithi123' 2024-09-15T23:18:42.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.214+0000 7fbd9461e740 1 --2- 172.21.15.123:0/2317517361 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x55d51571b830 0x55d51571bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.214+0000 7fbd9461e740 4 client.7857 mds_command: new command op to 7608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:18:42.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.214+0000 7fbd9461e740 1 -- 172.21.15.123:0/2317517361 --> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d515666e20 con 0x55d51571b830 2024-09-15T23:18:42.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.214+0000 7fbd83fff640 1 --2- 172.21.15.123:0/2317517361 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x55d51571b830 0x55d51571bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.215+0000 7fbd6a7fc640 10 client.7857 ms_handle_connect on v2:172.21.15.123:6833/3823805081 2024-09-15T23:18:42.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.215+0000 7fbd83fff640 1 --2- 172.21.15.123:0/2317517361 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x55d51571b830 0x55d51571bc10 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46dc336d29f8f3ca server_cookie=229bc3f6b64e6f8d in_seq=0 out_seq=0 2024-09-15T23:18:42.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.215+0000 7fbd6a7fc640 1 -- 172.21.15.123:0/2317517361 <== mds.0 v2:172.21.15.123:6833/3823805081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d515666e20 con 0x55d51571b830 2024-09-15T23:18:42.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.215+0000 7fbd6a7fc640 10 client.7857 handle_command_reply: tid=0 2024-09-15T23:18:42.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.215+0000 7fbd9461e740 1 client.7857 shutdown 2024-09-15T23:18:42.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.216+0000 7fbd9461e740 1 -- 172.21.15.123:0/2317517361 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d515720780 msgr2=0x55d51571ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:42.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.216+0000 7fbd9461e740 1 --2- 172.21.15.123:0/2317517361 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d515720780 0x55d51571ade0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x55d51571e110 tx=0x7fbd7c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.216+0000 7fbd9461e740 1 -- 172.21.15.123:0/2317517361 shutdown_connections 2024-09-15T23:18:42.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.216+0000 7fbd9461e740 1 --2- 172.21.15.123:0/2317517361 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x55d51571b830 0x55d51571bc10 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.216+0000 7fbd9461e740 1 --2- 172.21.15.123:0/2317517361 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d51573ea80 0x55d51573eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.216+0000 7fbd6a7fc640 0 client.7857 ms_handle_reset on v2:172.21.15.123:6833/3823805081 2024-09-15T23:18:42.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.216+0000 7fbd9461e740 1 --2- 172.21.15.123:0/2317517361 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d51573b140 0x55d5157247e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.216+0000 7fbd9461e740 1 --2- 172.21.15.123:0/2317517361 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d515720780 0x55d51571ade0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.216+0000 7fbd9461e740 1 -- 172.21.15.123:0/2317517361 >> 172.21.15.123:0/2317517361 conn(0x55d5156f40e0 msgr2=0x55d5156f00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:42.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.216+0000 7fbd9461e740 1 -- 172.21.15.123:0/2317517361 shutdown_connections 2024-09-15T23:18:42.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.216+0000 7fbd9461e740 1 -- 172.21.15.123:0/2317517361 wait complete. 2024-09-15T23:18:42.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.216+0000 7fbd9461e740 20 client.7857 trim_cache size 0 max 16384 2024-09-15T23:18:42.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.233+0000 7fbd9461e740 1 Processor -- start 2024-09-15T23:18:42.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.233+0000 7fbd9461e740 1 -- start start 2024-09-15T23:18:42.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.234+0000 7fbd9461e740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d51571b830 0x55d51573bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.234+0000 7fbd9461e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d515720780 0x55d5156f6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.234+0000 7fbd9461e740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d51573b140 0x55d51573c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.234+0000 7fbd9461e740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c1fca90 con 0x55d51571b830 2024-09-15T23:18:42.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.234+0000 7fbd9461e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c157140 con 0x55d515720780 2024-09-15T23:18:42.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.234+0000 7fbd9461e740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbd8c1445a0 con 0x55d51573b140 2024-09-15T23:18:42.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.234+0000 7fbd8affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d51571b830 0x55d51573bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.234+0000 7fbd8affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d51571b830 0x55d51573bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50738/0 (socket says 172.21.15.123:50738) 2024-09-15T23:18:42.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.234+0000 7fbd8affd640 1 -- 172.21.15.123:0/3591695655 learned_addr learned my addr 172.21.15.123:0/3591695655 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:42.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.234+0000 7fbd83fff640 1 --2- 172.21.15.123:0/3591695655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d515720780 0x55d5156f6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.234+0000 7fbd8b7fe640 1 --2- 172.21.15.123:0/3591695655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d51573b140 0x55d51573c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.234+0000 7fbd8affd640 1 -- 172.21.15.123:0/3591695655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d51573b140 msgr2=0x55d51573c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:42.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.234+0000 7fbd8affd640 1 --2- 172.21.15.123:0/3591695655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d51573b140 0x55d51573c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.234+0000 7fbd8affd640 1 -- 172.21.15.123:0/3591695655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d515720780 msgr2=0x55d5156f6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:42.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.234+0000 7fbd8affd640 1 --2- 172.21.15.123:0/3591695655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d515720780 0x55d5156f6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.234+0000 7fbd8affd640 1 -- 172.21.15.123:0/3591695655 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d51532c0f0 con 0x55d51571b830 2024-09-15T23:18:42.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.234+0000 7fbd8affd640 1 --2- 172.21.15.123:0/3591695655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d51571b830 0x55d51573bed0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c004670 tx=0x7fbd7c02a070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb78aec7d256a17c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:42.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.235+0000 7fbd80ff9640 1 -- 172.21.15.123:0/3591695655 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c02e070 con 0x55d51571b830 2024-09-15T23:18:42.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.235+0000 7fbd80ff9640 1 -- 172.21.15.123:0/3591695655 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd7c024070 con 0x55d51571b830 2024-09-15T23:18:42.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.235+0000 7fbd80ff9640 1 -- 172.21.15.123:0/3591695655 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c0138e0 con 0x55d51571b830 2024-09-15T23:18:42.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.235+0000 7fbd9461e740 1 -- 172.21.15.123:0/3591695655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d51571b830 msgr2=0x55d51573bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:42.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.235+0000 7fbd9461e740 1 --2- 172.21.15.123:0/3591695655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d51571b830 0x55d51573bed0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c004670 tx=0x7fbd7c02a070 comp rx=0 tx=0).stop 2024-09-15T23:18:42.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.235+0000 7fbd9461e740 1 -- 172.21.15.123:0/3591695655 shutdown_connections 2024-09-15T23:18:42.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.235+0000 7fbd9461e740 1 --2- 172.21.15.123:0/3591695655 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d51573b140 0x55d51573c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.235+0000 7fbd9461e740 1 --2- 172.21.15.123:0/3591695655 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d515720780 0x55d5156f6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.235+0000 7fbd9461e740 1 --2- 172.21.15.123:0/3591695655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d51571b830 0x55d51573bed0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.235+0000 7fbd9461e740 1 -- 172.21.15.123:0/3591695655 >> 172.21.15.123:0/3591695655 conn(0x55d5156f40e0 msgr2=0x55d5156f2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:42.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.235+0000 7fbd9461e740 1 -- 172.21.15.123:0/3591695655 shutdown_connections 2024-09-15T23:18:42.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.235+0000 7fbd9461e740 1 -- 172.21.15.123:0/3591695655 wait complete. 2024-09-15T23:18:42.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.236+0000 7fbd9461e740 1 -- start start 2024-09-15T23:18:42.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.236+0000 7fbd9461e740 1 Processor -- start 2024-09-15T23:18:42.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.237+0000 7fbd9461e740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d51571b830 0x55d515723da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.237+0000 7fbd9461e740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d515720780 0x55d515722b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.237+0000 7fbd9461e740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d51573b140 0x55d515723070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.237+0000 7fbd9461e740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d51571abf0 con 0x55d51571b830 2024-09-15T23:18:42.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.237+0000 7fbd9461e740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c156af0 con 0x55d51573b140 2024-09-15T23:18:42.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.237+0000 7fbd9461e740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55d5156f2170 con 0x55d515720780 2024-09-15T23:18:42.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.237+0000 7fbd9461e740 10 client.0 _ll_register_callbacks cb 0x7fbd7c00ea70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:18:42.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.237+0000 7fbd8affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d51571b830 0x55d515723da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.237+0000 7fbd8affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d51571b830 0x55d515723da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50742/0 (socket says 172.21.15.123:50742) 2024-09-15T23:18:42.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.237+0000 7fbd8affd640 1 -- 172.21.15.123:0/1306899893 learned_addr learned my addr 172.21.15.123:0/1306899893 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:42.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.237+0000 7fbd83fff640 1 --2- 172.21.15.123:0/1306899893 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d515720780 0x55d515722b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.237+0000 7fbd8b7fe640 1 --2- 172.21.15.123:0/1306899893 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d51573b140 0x55d515723070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.237+0000 7fbd8affd640 1 -- 172.21.15.123:0/1306899893 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d515720780 msgr2=0x55d515722b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:42.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.237+0000 7fbd8affd640 1 --2- 172.21.15.123:0/1306899893 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d515720780 0x55d515722b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.237+0000 7fbd8affd640 1 -- 172.21.15.123:0/1306899893 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d51573b140 msgr2=0x55d515723070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:42.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.237+0000 7fbd8affd640 1 --2- 172.21.15.123:0/1306899893 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d51573b140 0x55d515723070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.237+0000 7fbd8affd640 1 -- 172.21.15.123:0/1306899893 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5157626b0 con 0x55d51571b830 2024-09-15T23:18:42.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.237+0000 7fbd8affd640 1 --2- 172.21.15.123:0/1306899893 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d51571b830 0x55d515723da0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c009140 tx=0x7fbd7c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=818391e6c3b37085 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:42.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.237+0000 7fbd6a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:18:42.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.237+0000 7fbd6a7fc640 1 -- 172.21.15.123:0/1306899893 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd7c04f060 con 0x55d51571b830 2024-09-15T23:18:42.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.238+0000 7fbd6a7fc640 1 -- 172.21.15.123:0/1306899893 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 5795+0+0 (secure 0 0 0) 0x7fbd7c032610 con 0x55d51571b830 2024-09-15T23:18:42.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.238+0000 7fbd9461e740 1 -- 172.21.15.123:0/1306899893 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd7c024070 con 0x55d51571b830 2024-09-15T23:18:42.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.238+0000 7fbd6a7fc640 1 -- 172.21.15.123:0/1306899893 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fbd7c055050 con 0x55d51571b830 2024-09-15T23:18:42.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.238+0000 7fbd9461e740 10 client.7863 fetch_fsmap learned FSMap version 74 2024-09-15T23:18:42.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.238+0000 7fbd9461e740 1 -- 172.21.15.123:0/1306899893 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x55d51573fee0 con 0x55d51571b830 2024-09-15T23:18:42.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.238+0000 7fbd6a7fc640 1 -- 172.21.15.123:0/1306899893 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd7c024070 con 0x55d51571b830 2024-09-15T23:18:42.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.238+0000 7fbd6a7fc640 1 -- 172.21.15.123:0/1306899893 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 74) ==== 3502+0+0 (secure 0 0 0) 0x7fbd7c058020 con 0x55d51571b830 2024-09-15T23:18:42.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.238+0000 7fbd9461e740 10 client.7863 fetch_fsmap finished waiting for FSMap version 74 2024-09-15T23:18:42.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.238+0000 7fbd9461e740 10 client.7863 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-15T23:18:42.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.238+0000 7fbd9461e740 20 client.7863 populate_metadata read hostname 'smithi123' 2024-09-15T23:18:42.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.238+0000 7fbd9461e740 1 --2- 172.21.15.123:0/1306899893 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x55d51573ea80 0x55d51571bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.238+0000 7fbd9461e740 4 client.7863 mds_command: new command op to 7608 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:18:42.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.238+0000 7fbd9461e740 1 -- 172.21.15.123:0/1306899893 --> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d515661170 con 0x55d51573ea80 2024-09-15T23:18:42.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.238+0000 7fbd83fff640 1 --2- 172.21.15.123:0/1306899893 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x55d51573ea80 0x55d51571bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.238+0000 7fbd6a7fc640 10 client.7863 ms_handle_connect on v2:172.21.15.123:6833/3823805081 2024-09-15T23:18:42.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.238+0000 7fbd83fff640 1 --2- 172.21.15.123:0/1306899893 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x55d51573ea80 0x55d51571bef0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87f2ab63f9dc0de6 server_cookie=fdc6632be01c052a in_seq=0 out_seq=0 2024-09-15T23:18:42.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.239+0000 7fbd6a7fc640 1 -- 172.21.15.123:0/1306899893 <== mds.0 v2:172.21.15.123:6833/3823805081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55d515661170 con 0x55d51573ea80 2024-09-15T23:18:42.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.239+0000 7fbd6a7fc640 10 client.7863 handle_command_reply: tid=0 2024-09-15T23:18:42.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.239+0000 7fbd9461e740 1 client.7863 shutdown 2024-09-15T23:18:42.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.239+0000 7fbd9461e740 1 -- 172.21.15.123:0/1306899893 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d51571b830 msgr2=0x55d515723da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:42.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.239+0000 7fbd9461e740 1 --2- 172.21.15.123:0/1306899893 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d51571b830 0x55d515723da0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c009140 tx=0x7fbd7c015000 comp rx=0 tx=0).stop 2024-09-15T23:18:42.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.239+0000 7fbd9461e740 1 -- 172.21.15.123:0/1306899893 shutdown_connections 2024-09-15T23:18:42.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.239+0000 7fbd9461e740 1 --2- 172.21.15.123:0/1306899893 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x55d51573ea80 0x55d51571bef0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.239+0000 7fbd9461e740 1 --2- 172.21.15.123:0/1306899893 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d51573b140 0x55d515723070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.239+0000 7fbd9461e740 1 --2- 172.21.15.123:0/1306899893 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d515720780 0x55d515722b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.239+0000 7fbd6a7fc640 0 client.7863 ms_handle_reset on v2:172.21.15.123:6833/3823805081 2024-09-15T23:18:42.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.239+0000 7fbd9461e740 1 --2- 172.21.15.123:0/1306899893 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d51571b830 0x55d515723da0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.239+0000 7fbd9461e740 1 -- 172.21.15.123:0/1306899893 >> 172.21.15.123:0/1306899893 conn(0x55d5156f40e0 msgr2=0x55d515763ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:42.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.239+0000 7fbd9461e740 1 -- 172.21.15.123:0/1306899893 shutdown_connections 2024-09-15T23:18:42.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.239+0000 7fbd9461e740 1 -- 172.21.15.123:0/1306899893 wait complete. 2024-09-15T23:18:42.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.239+0000 7fbd9461e740 20 client.7863 trim_cache size 0 max 16384 2024-09-15T23:18:42.248 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:18:42.248 INFO:teuthology.orchestra.run.smithi123.stdout: "status": "no active scrubs running", 2024-09-15T23:18:42.249 INFO:teuthology.orchestra.run.smithi123.stdout: "scrubs": {} 2024-09-15T23:18:42.249 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:18:42.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.239+0000 7fbd91882640 1 -- 172.21.15.123:0/407631532 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbd6c06c2b0 msgr2=0x7fbd6c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:42.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.239+0000 7fbd91882640 1 --2- 172.21.15.123:0/407631532 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbd6c06c2b0 0x7fbd6c06e770 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c0098e0 tx=0x7fbd7c009060 comp rx=0 tx=0).stop 2024-09-15T23:18:42.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.239+0000 7fbd91882640 1 -- 172.21.15.123:0/407631532 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd8c15b7c0 msgr2=0x7fbd8c15eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:42.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.239+0000 7fbd91882640 1 --2- 172.21.15.123:0/407631532 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd8c15b7c0 0x7fbd8c15eec0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400cd70 tx=0x7fbd8400a660 comp rx=0 tx=0).stop 2024-09-15T23:18:42.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.239+0000 7fbd91882640 1 -- 172.21.15.123:0/407631532 shutdown_connections 2024-09-15T23:18:42.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.239+0000 7fbd91882640 1 --2- 172.21.15.123:0/407631532 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbd6c06c2b0 0x7fbd6c06e770 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.239+0000 7fbd91882640 1 --2- 172.21.15.123:0/407631532 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd8c15b7c0 0x7fbd8c15eec0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.239+0000 7fbd91882640 1 --2- 172.21.15.123:0/407631532 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd8c0cead0 0x7fbd8c15c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.239+0000 7fbd91882640 1 --2- 172.21.15.123:0/407631532 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbd8c0ccf30 0x7fbd8c143280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.239+0000 7fbd91882640 1 -- 172.21.15.123:0/407631532 >> 172.21.15.123:0/407631532 conn(0x7fbd8c06d0f0 msgr2=0x7fbd8c072750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:42.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.239+0000 7fbd91882640 1 -- 172.21.15.123:0/407631532 shutdown_connections 2024-09-15T23:18:42.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.240+0000 7fbd91882640 1 -- 172.21.15.123:0/407631532 wait complete. 2024-09-15T23:18:42.252 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T23:18:42.252 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 perf dump 2024-09-15T23:18:42.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.353+0000 7fbc548ac640 1 Processor -- start 2024-09-15T23:18:42.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.353+0000 7fbc548ac640 1 -- start start 2024-09-15T23:18:42.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.354+0000 7fbc548ac640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc500732e0 0x7fbc500736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.354+0000 7fbc548ac640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbc500cd270 0x7fbc5015c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.354+0000 7fbc548ac640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc500714b0 con 0x7fbc500cce30 2024-09-15T23:18:42.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.354+0000 7fbc548ac640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fbc50073c00 con 0x7fbc500cd270 2024-09-15T23:18:42.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.354+0000 7fbc548ac640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbc500cd880 con 0x7fbc500732e0 2024-09-15T23:18:42.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.354+0000 7fbc4ed9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbc500cd270 0x7fbc5015c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.354+0000 7fbc4ed9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbc500cd270 0x7fbc5015c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50750/0 (socket says 172.21.15.123:50750) 2024-09-15T23:18:42.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.354+0000 7fbc45d9b640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fbc500cce30 0x7fbc50071c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35688/0 (socket says 172.21.15.123:35688) 2024-09-15T23:18:42.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.354+0000 7fbc4ed9d640 1 -- 172.21.15.123:0/4187601568 learned_addr learned my addr 172.21.15.123:0/4187601568 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:42.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.354+0000 7fbc4e59c640 1 --2- 172.21.15.123:0/4187601568 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc500732e0 0x7fbc500736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.354+0000 7fbc4ed9d640 1 -- 172.21.15.123:0/4187601568 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc500732e0 msgr2=0x7fbc500736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:42.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.354+0000 7fbc4ed9d640 1 --2- 172.21.15.123:0/4187601568 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc500732e0 0x7fbc500736c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.354+0000 7fbc4ed9d640 1 -- 172.21.15.123:0/4187601568 >> v1:172.21.15.123:6789/0 conn(0x7fbc500cce30 legacy=0x7fbc50071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:42.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.354+0000 7fbc4ed9d640 1 -- 172.21.15.123:0/4187601568 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc500cdb60 con 0x7fbc500cd270 2024-09-15T23:18:42.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.355+0000 7fbc4ed9d640 1 --2- 172.21.15.123:0/4187601568 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc500cd270 0x7fbc5015c8d0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fbc48009e50 tx=0x7fbc4802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2730d75cd25341bc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:42.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.355+0000 7fbc4dd9b640 1 -- 172.21.15.123:0/4187601568 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc48036070 con 0x7fbc500cd270 2024-09-15T23:18:42.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.355+0000 7fbc4dd9b640 1 -- 172.21.15.123:0/4187601568 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc48031600 con 0x7fbc500cd270 2024-09-15T23:18:42.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.355+0000 7fbc4dd9b640 1 -- 172.21.15.123:0/4187601568 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc480319d0 con 0x7fbc500cd270 2024-09-15T23:18:42.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.355+0000 7fbc548ac640 1 -- 172.21.15.123:0/4187601568 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc500cd270 msgr2=0x7fbc5015c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:42.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.355+0000 7fbc548ac640 1 --2- 172.21.15.123:0/4187601568 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc500cd270 0x7fbc5015c8d0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fbc48009e50 tx=0x7fbc4802a680 comp rx=0 tx=0).stop 2024-09-15T23:18:42.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.356+0000 7fbc548ac640 1 -- 172.21.15.123:0/4187601568 shutdown_connections 2024-09-15T23:18:42.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.356+0000 7fbc548ac640 1 --2- 172.21.15.123:0/4187601568 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc500cd270 0x7fbc5015c8d0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.356+0000 7fbc548ac640 1 --2- 172.21.15.123:0/4187601568 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc500732e0 0x7fbc500736c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.356+0000 7fbc548ac640 1 -- 172.21.15.123:0/4187601568 >> 172.21.15.123:0/4187601568 conn(0x7fbc5006d0f0 msgr2=0x7fbc5006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:42.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.356+0000 7fbc548ac640 1 -- 172.21.15.123:0/4187601568 shutdown_connections 2024-09-15T23:18:42.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.356+0000 7fbc548ac640 1 -- 172.21.15.123:0/4187601568 wait complete. 2024-09-15T23:18:42.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.357+0000 7fbc548ac640 1 Processor -- start 2024-09-15T23:18:42.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.357+0000 7fbc548ac640 1 -- start start 2024-09-15T23:18:42.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.358+0000 7fbc548ac640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc500732e0 0x7fbc500b2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.358+0000 7fbc548ac640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc500cce30 0x7fbc501e78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.358+0000 7fbc548ac640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc500cd270 0x7fbc501f4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.358+0000 7fbc548ac640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5006bf70 con 0x7fbc500732e0 2024-09-15T23:18:42.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.358+0000 7fbc548ac640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5006bdf0 con 0x7fbc500cce30 2024-09-15T23:18:42.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.358+0000 7fbc548ac640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbc50072380 con 0x7fbc500cd270 2024-09-15T23:18:42.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.358+0000 7fbc4e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc500732e0 0x7fbc500b2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.358+0000 7fbc4e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc500732e0 0x7fbc500b2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50756/0 (socket says 172.21.15.123:50756) 2024-09-15T23:18:42.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.358+0000 7fbc4e59c640 1 -- 172.21.15.123:0/4274877719 learned_addr learned my addr 172.21.15.123:0/4274877719 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:42.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.358+0000 7fbc45d9b640 1 --2- 172.21.15.123:0/4274877719 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc500cce30 0x7fbc501e78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.358+0000 7fbc4e59c640 1 -- 172.21.15.123:0/4274877719 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc500cd270 msgr2=0x7fbc501f4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:42.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.358+0000 7fbc4ed9d640 1 --2- 172.21.15.123:0/4274877719 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc500cd270 0x7fbc501f4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.358+0000 7fbc4e59c640 1 --2- 172.21.15.123:0/4274877719 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc500cd270 0x7fbc501f4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.359+0000 7fbc4e59c640 1 -- 172.21.15.123:0/4274877719 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc500cce30 msgr2=0x7fbc501e78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:42.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.359+0000 7fbc4e59c640 1 --2- 172.21.15.123:0/4274877719 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc500cce30 0x7fbc501e78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.359+0000 7fbc4e59c640 1 -- 172.21.15.123:0/4274877719 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc500ce7d0 con 0x7fbc500732e0 2024-09-15T23:18:42.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.359+0000 7fbc4e59c640 1 --2- 172.21.15.123:0/4274877719 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc500732e0 0x7fbc500b2980 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fbc4000c7f0 tx=0x7fbc4000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:42.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.359+0000 7fbc477fe640 1 -- 172.21.15.123:0/4274877719 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc40015070 con 0x7fbc500732e0 2024-09-15T23:18:42.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.359+0000 7fbc477fe640 1 -- 172.21.15.123:0/4274877719 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc40004220 con 0x7fbc500732e0 2024-09-15T23:18:42.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.359+0000 7fbc477fe640 1 -- 172.21.15.123:0/4274877719 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc40007620 con 0x7fbc500732e0 2024-09-15T23:18:42.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.359+0000 7fbc548ac640 1 -- 172.21.15.123:0/4274877719 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc500ceab0 con 0x7fbc500732e0 2024-09-15T23:18:42.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.359+0000 7fbc548ac640 1 -- 172.21.15.123:0/4274877719 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc500cf070 con 0x7fbc500732e0 2024-09-15T23:18:42.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.360+0000 7fbc477fe640 1 -- 172.21.15.123:0/4274877719 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbc400079d0 con 0x7fbc500732e0 2024-09-15T23:18:42.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.361+0000 7fbc477fe640 1 --2- 172.21.15.123:0/4274877719 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbc3006c2b0 0x7fbc3006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.361+0000 7fbc477fe640 1 -- 172.21.15.123:0/4274877719 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5795+0+0 (secure 0 0 0) 0x7fbc4008b7b0 con 0x7fbc500732e0 2024-09-15T23:18:42.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.361+0000 7fbc45d9b640 1 --2- 172.21.15.123:0/4274877719 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbc3006c2b0 0x7fbc3006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.362+0000 7fbc5764c740 1 Processor -- start 2024-09-15T23:18:42.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.362+0000 7fbc45d9b640 1 --2- 172.21.15.123:0/4274877719 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbc3006c2b0 0x7fbc3006e770 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fbc5006cc90 tx=0x7fbc38009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:42.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.362+0000 7fbc5764c740 1 -- start start 2024-09-15T23:18:42.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.363+0000 7fbc5764c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5645493845e0 0x5645493849c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.363+0000 7fbc5764c740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564549381da0 0x564549383930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.363+0000 7fbc5764c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564549382200 0x564549364560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.363+0000 7fbc5764c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5645492a08d0 con 0x5645493845e0 2024-09-15T23:18:42.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.363+0000 7fbc5764c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x564549248620 con 0x564549382200 2024-09-15T23:18:42.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.363+0000 7fbc5764c740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x56454929c890 con 0x564549381da0 2024-09-15T23:18:42.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.363+0000 7fbc4e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5645493845e0 0x5645493849c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.363+0000 7fbc4e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5645493845e0 0x5645493849c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50760/0 (socket says 172.21.15.123:50760) 2024-09-15T23:18:42.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.363+0000 7fbc4e59c640 1 -- 172.21.15.123:0/3937600545 learned_addr learned my addr 172.21.15.123:0/3937600545 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:42.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.363+0000 7fbc45d9b640 1 --2- 172.21.15.123:0/3937600545 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564549381da0 0x564549383930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.363+0000 7fbc4ed9d640 1 --2- 172.21.15.123:0/3937600545 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564549382200 0x564549364560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.363+0000 7fbc4e59c640 1 -- 172.21.15.123:0/3937600545 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564549381da0 msgr2=0x564549383930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:42.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.363+0000 7fbc4e59c640 1 --2- 172.21.15.123:0/3937600545 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564549381da0 0x564549383930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.363+0000 7fbc4e59c640 1 -- 172.21.15.123:0/3937600545 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564549382200 msgr2=0x564549364560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:42.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.363+0000 7fbc4e59c640 1 --2- 172.21.15.123:0/3937600545 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564549382200 0x564549364560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.363+0000 7fbc4e59c640 1 -- 172.21.15.123:0/3937600545 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56454907d7d0 con 0x5645493845e0 2024-09-15T23:18:42.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.363+0000 7fbc4e59c640 1 --2- 172.21.15.123:0/3937600545 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5645493845e0 0x5645493849c0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fbc4000c7c0 tx=0x7fbc40059430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32338cafe3e571ab server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:42.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.363+0000 7fbc2ffff640 1 -- 172.21.15.123:0/3937600545 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4001e040 con 0x5645493845e0 2024-09-15T23:18:42.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.363+0000 7fbc2ffff640 1 -- 172.21.15.123:0/3937600545 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc400600c0 con 0x5645493845e0 2024-09-15T23:18:42.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.363+0000 7fbc2ffff640 1 -- 172.21.15.123:0/3937600545 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc40055e30 con 0x5645493845e0 2024-09-15T23:18:42.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.364+0000 7fbc5764c740 1 -- 172.21.15.123:0/3937600545 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5645493845e0 msgr2=0x5645493849c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:42.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.364+0000 7fbc5764c740 1 --2- 172.21.15.123:0/3937600545 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5645493845e0 0x5645493849c0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fbc4000c7c0 tx=0x7fbc40059430 comp rx=0 tx=0).stop 2024-09-15T23:18:42.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.364+0000 7fbc5764c740 1 -- 172.21.15.123:0/3937600545 shutdown_connections 2024-09-15T23:18:42.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.364+0000 7fbc5764c740 1 --2- 172.21.15.123:0/3937600545 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564549382200 0x564549364560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.364+0000 7fbc5764c740 1 --2- 172.21.15.123:0/3937600545 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564549381da0 0x564549383930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.364+0000 7fbc5764c740 1 --2- 172.21.15.123:0/3937600545 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5645493845e0 0x5645493849c0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.364+0000 7fbc5764c740 1 -- 172.21.15.123:0/3937600545 >> 172.21.15.123:0/3937600545 conn(0x56454933a240 msgr2=0x564549382650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:42.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.364+0000 7fbc5764c740 1 -- 172.21.15.123:0/3937600545 shutdown_connections 2024-09-15T23:18:42.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.364+0000 7fbc5764c740 1 -- 172.21.15.123:0/3937600545 wait complete. 2024-09-15T23:18:42.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.364+0000 7fbc5764c740 1 -- start start 2024-09-15T23:18:42.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.365+0000 7fbc5764c740 1 Processor -- start 2024-09-15T23:18:42.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.365+0000 7fbc5764c740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564549382200 0x564549367490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.365+0000 7fbc5764c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5645493845e0 0x564549395370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.365+0000 7fbc5764c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564549364350 0x5645493647d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.365+0000 7fbc5764c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x564549380d00 con 0x5645493845e0 2024-09-15T23:18:42.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.365+0000 7fbc5764c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x564549229750 con 0x564549364350 2024-09-15T23:18:42.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.365+0000 7fbc5764c740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x564549380fe0 con 0x564549382200 2024-09-15T23:18:42.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.366+0000 7fbc5764c740 10 client.0 _ll_register_callbacks cb 0x56454924d780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:18:42.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.366+0000 7fbc45d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5645493845e0 0x564549395370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.366+0000 7fbc45d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5645493845e0 0x564549395370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50766/0 (socket says 172.21.15.123:50766) 2024-09-15T23:18:42.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.366+0000 7fbc45d9b640 1 -- 172.21.15.123:0/4179929817 learned_addr learned my addr 172.21.15.123:0/4179929817 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:42.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.366+0000 7fbc4e59c640 1 --2- 172.21.15.123:0/4179929817 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564549382200 0x564549367490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.366+0000 7fbc4ed9d640 1 --2- 172.21.15.123:0/4179929817 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564549364350 0x5645493647d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.366+0000 7fbc45d9b640 1 -- 172.21.15.123:0/4179929817 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564549382200 msgr2=0x564549367490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:42.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.366+0000 7fbc45d9b640 1 --2- 172.21.15.123:0/4179929817 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564549382200 0x564549367490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.366+0000 7fbc45d9b640 1 -- 172.21.15.123:0/4179929817 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564549364350 msgr2=0x5645493647d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:42.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.366+0000 7fbc45d9b640 1 --2- 172.21.15.123:0/4179929817 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564549364350 0x5645493647d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.366+0000 7fbc45d9b640 1 -- 172.21.15.123:0/4179929817 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564548f730f0 con 0x5645493845e0 2024-09-15T23:18:42.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.366+0000 7fbc45d9b640 1 --2- 172.21.15.123:0/4179929817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5645493845e0 0x564549395370 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fbc38005ac0 tx=0x7fbc38000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fef3d9327acf87 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:42.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.366+0000 7fbc2d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:18:42.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.366+0000 7fbc2d7fa640 1 -- 172.21.15.123:0/4179929817 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc38026060 con 0x5645493845e0 2024-09-15T23:18:42.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.366+0000 7fbc2d7fa640 1 -- 172.21.15.123:0/4179929817 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 5795+0+0 (secure 0 0 0) 0x7fbc38021af0 con 0x5645493845e0 2024-09-15T23:18:42.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.366+0000 7fbc5764c740 1 -- 172.21.15.123:0/4179929817 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc400600c0 con 0x5645493845e0 2024-09-15T23:18:42.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.366+0000 7fbc2d7fa640 1 -- 172.21.15.123:0/4179929817 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fbc38021cf0 con 0x5645493845e0 2024-09-15T23:18:42.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.366+0000 7fbc5764c740 10 client.7878 fetch_fsmap learned FSMap version 74 2024-09-15T23:18:42.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.366+0000 7fbc5764c740 1 -- 172.21.15.123:0/4179929817 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x5645490ddf60 con 0x5645493845e0 2024-09-15T23:18:42.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.366+0000 7fbc2d7fa640 1 -- 172.21.15.123:0/4179929817 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc400600c0 con 0x5645493845e0 2024-09-15T23:18:42.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.367+0000 7fbc2d7fa640 1 -- 172.21.15.123:0/4179929817 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 74) ==== 3502+0+0 (secure 0 0 0) 0x7fbc380149f0 con 0x5645493845e0 2024-09-15T23:18:42.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.367+0000 7fbc5764c740 10 client.7878 fetch_fsmap finished waiting for FSMap version 74 2024-09-15T23:18:42.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.367+0000 7fbc5764c740 10 client.7878 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-15T23:18:42.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.367+0000 7fbc5764c740 20 client.7878 populate_metadata read hostname 'smithi123' 2024-09-15T23:18:42.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.367+0000 7fbc5764c740 1 --2- 172.21.15.123:0/4179929817 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x564549379ee0 0x56454937a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.367+0000 7fbc5764c740 4 client.7878 mds_command: new command op to 7608 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:18:42.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.367+0000 7fbc5764c740 1 -- 172.21.15.123:0/4179929817 --> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5645492ae000 con 0x564549379ee0 2024-09-15T23:18:42.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.367+0000 7fbc4e59c640 1 --2- 172.21.15.123:0/4179929817 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x564549379ee0 0x56454937a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.367+0000 7fbc2d7fa640 10 client.7878 ms_handle_connect on v2:172.21.15.123:6833/3823805081 2024-09-15T23:18:42.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.367+0000 7fbc4e59c640 1 --2- 172.21.15.123:0/4179929817 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x564549379ee0 0x56454937a2c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91389b42f1d28adf server_cookie=cf50f857dc803695 in_seq=0 out_seq=0 2024-09-15T23:18:42.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.368+0000 7fbc2d7fa640 1 -- 172.21.15.123:0/4179929817 <== mds.0 v2:172.21.15.123:6833/3823805081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5645492ae000 con 0x564549379ee0 2024-09-15T23:18:42.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.368+0000 7fbc2d7fa640 10 client.7878 handle_command_reply: tid=0 2024-09-15T23:18:42.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.368+0000 7fbc5764c740 1 client.7878 shutdown 2024-09-15T23:18:42.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.368+0000 7fbc5764c740 1 -- 172.21.15.123:0/4179929817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5645493845e0 msgr2=0x564549395370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:42.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.368+0000 7fbc5764c740 1 --2- 172.21.15.123:0/4179929817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5645493845e0 0x564549395370 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fbc38005ac0 tx=0x7fbc38000bc0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.368+0000 7fbc5764c740 1 -- 172.21.15.123:0/4179929817 shutdown_connections 2024-09-15T23:18:42.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.368+0000 7fbc5764c740 1 --2- 172.21.15.123:0/4179929817 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x564549379ee0 0x56454937a2c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.368+0000 7fbc5764c740 1 --2- 172.21.15.123:0/4179929817 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564549364350 0x5645493647d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.368+0000 7fbc5764c740 1 --2- 172.21.15.123:0/4179929817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5645493845e0 0x564549395370 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.368+0000 7fbc5764c740 1 --2- 172.21.15.123:0/4179929817 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564549382200 0x564549367490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.368+0000 7fbc2d7fa640 0 client.7878 ms_handle_reset on v2:172.21.15.123:6833/3823805081 2024-09-15T23:18:42.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.368+0000 7fbc5764c740 1 -- 172.21.15.123:0/4179929817 >> 172.21.15.123:0/4179929817 conn(0x564549381da0 msgr2=0x564549382650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:42.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.368+0000 7fbc5764c740 1 -- 172.21.15.123:0/4179929817 shutdown_connections 2024-09-15T23:18:42.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.368+0000 7fbc5764c740 1 -- 172.21.15.123:0/4179929817 wait complete. 2024-09-15T23:18:42.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.368+0000 7fbc5764c740 20 client.7878 trim_cache size 0 max 16384 2024-09-15T23:18:42.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.384+0000 7fbc5764c740 1 Processor -- start 2024-09-15T23:18:42.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.384+0000 7fbc5764c740 1 -- start start 2024-09-15T23:18:42.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.385+0000 7fbc5764c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564549364350 0x564549363b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.385+0000 7fbc5764c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564549382200 0x5645493670a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.385+0000 7fbc5764c740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5645493845e0 0x5645493618c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.385+0000 7fbc5764c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbc50201050 con 0x564549364350 2024-09-15T23:18:42.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.385+0000 7fbc5764c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbc500cb860 con 0x564549382200 2024-09-15T23:18:42.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.385+0000 7fbc5764c740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbc500cabc0 con 0x5645493845e0 2024-09-15T23:18:42.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.385+0000 7fbc4e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564549364350 0x564549363b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.385+0000 7fbc4e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564549364350 0x564549363b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50780/0 (socket says 172.21.15.123:50780) 2024-09-15T23:18:42.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.385+0000 7fbc4e59c640 1 -- 172.21.15.123:0/2371874188 learned_addr learned my addr 172.21.15.123:0/2371874188 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:42.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.385+0000 7fbc45d9b640 1 --2- 172.21.15.123:0/2371874188 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564549382200 0x5645493670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.385+0000 7fbc4ed9d640 1 --2- 172.21.15.123:0/2371874188 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5645493845e0 0x5645493618c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.385+0000 7fbc4e59c640 1 -- 172.21.15.123:0/2371874188 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5645493845e0 msgr2=0x5645493618c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:42.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.385+0000 7fbc4e59c640 1 --2- 172.21.15.123:0/2371874188 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5645493845e0 0x5645493618c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.385+0000 7fbc4e59c640 1 -- 172.21.15.123:0/2371874188 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564549382200 msgr2=0x5645493670a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:42.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.385+0000 7fbc4e59c640 1 --2- 172.21.15.123:0/2371874188 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564549382200 0x5645493670a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.385+0000 7fbc4e59c640 1 -- 172.21.15.123:0/2371874188 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564548f4c1b0 con 0x564549364350 2024-09-15T23:18:42.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.385+0000 7fbc4e59c640 1 --2- 172.21.15.123:0/2371874188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564549364350 0x564549363b80 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fbc40059470 tx=0x7fbc40012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b45ed5e8ab05338 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:42.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.385+0000 7fbc2f7fe640 1 -- 172.21.15.123:0/2371874188 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4001e040 con 0x564549364350 2024-09-15T23:18:42.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.385+0000 7fbc2f7fe640 1 -- 172.21.15.123:0/2371874188 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc40057ac0 con 0x564549364350 2024-09-15T23:18:42.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.385+0000 7fbc2f7fe640 1 -- 172.21.15.123:0/2371874188 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc40055e30 con 0x564549364350 2024-09-15T23:18:42.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.386+0000 7fbc5764c740 1 -- 172.21.15.123:0/2371874188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564549364350 msgr2=0x564549363b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:42.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.386+0000 7fbc5764c740 1 --2- 172.21.15.123:0/2371874188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564549364350 0x564549363b80 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fbc40059470 tx=0x7fbc40012000 comp rx=0 tx=0).stop 2024-09-15T23:18:42.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.386+0000 7fbc5764c740 1 -- 172.21.15.123:0/2371874188 shutdown_connections 2024-09-15T23:18:42.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.386+0000 7fbc5764c740 1 --2- 172.21.15.123:0/2371874188 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5645493845e0 0x5645493618c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.386+0000 7fbc5764c740 1 --2- 172.21.15.123:0/2371874188 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x564549382200 0x5645493670a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.386+0000 7fbc5764c740 1 --2- 172.21.15.123:0/2371874188 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564549364350 0x564549363b80 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.386+0000 7fbc5764c740 1 -- 172.21.15.123:0/2371874188 >> 172.21.15.123:0/2371874188 conn(0x564549381da0 msgr2=0x564549378da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:42.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.386+0000 7fbc5764c740 1 -- 172.21.15.123:0/2371874188 shutdown_connections 2024-09-15T23:18:42.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.386+0000 7fbc5764c740 1 -- 172.21.15.123:0/2371874188 wait complete. 2024-09-15T23:18:42.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.386+0000 7fbc5764c740 1 -- start start 2024-09-15T23:18:42.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.386+0000 7fbc5764c740 1 Processor -- start 2024-09-15T23:18:42.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.387+0000 7fbc5764c740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564549364350 0x5645494015a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.387+0000 7fbc5764c740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564549382200 0x5645493fa930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.387+0000 7fbc5764c740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645493845e0 0x564549399e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.387+0000 7fbc5764c740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x564549367c20 con 0x564549364350 2024-09-15T23:18:42.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.387+0000 7fbc5764c740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbc500cb210 con 0x5645493845e0 2024-09-15T23:18:42.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.387+0000 7fbc5764c740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x564549367f90 con 0x564549382200 2024-09-15T23:18:42.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.387+0000 7fbc5764c740 10 client.0 _ll_register_callbacks cb 0x7fbc38007800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:18:42.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.387+0000 7fbc4e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564549364350 0x5645494015a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.387+0000 7fbc4e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564549364350 0x5645494015a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50784/0 (socket says 172.21.15.123:50784) 2024-09-15T23:18:42.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.387+0000 7fbc4e59c640 1 -- 172.21.15.123:0/1638544733 learned_addr learned my addr 172.21.15.123:0/1638544733 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:42.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.388+0000 7fbc4ed9d640 1 --2- 172.21.15.123:0/1638544733 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645493845e0 0x564549399e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.388+0000 7fbc45d9b640 1 --2- 172.21.15.123:0/1638544733 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564549382200 0x5645493fa930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.388+0000 7fbc4e59c640 1 -- 172.21.15.123:0/1638544733 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564549382200 msgr2=0x5645493fa930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:42.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.388+0000 7fbc4e59c640 1 --2- 172.21.15.123:0/1638544733 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564549382200 0x5645493fa930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.388+0000 7fbc4e59c640 1 -- 172.21.15.123:0/1638544733 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645493845e0 msgr2=0x564549399e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:42.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.388+0000 7fbc4e59c640 1 --2- 172.21.15.123:0/1638544733 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645493845e0 0x564549399e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.388+0000 7fbc4e59c640 1 -- 172.21.15.123:0/1638544733 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645493fae70 con 0x564549364350 2024-09-15T23:18:42.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.388+0000 7fbc45d9b640 1 --2- 172.21.15.123:0/1638544733 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564549382200 0x5645493fa930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:18:42.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.388+0000 7fbc4ed9d640 1 --2- 172.21.15.123:0/1638544733 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645493845e0 0x564549399e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:18:42.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.388+0000 7fbc4e59c640 1 --2- 172.21.15.123:0/1638544733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564549364350 0x5645494015a0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fbc40007410 tx=0x7fbc4001b070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f02ab43146bdd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:42.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.388+0000 7fbc2d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:18:42.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.388+0000 7fbc2d7fa640 1 -- 172.21.15.123:0/1638544733 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4001e070 con 0x564549364350 2024-09-15T23:18:42.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.388+0000 7fbc2d7fa640 1 -- 172.21.15.123:0/1638544733 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 5795+0+0 (secure 0 0 0) 0x7fbc40055e30 con 0x564549364350 2024-09-15T23:18:42.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.388+0000 7fbc5764c740 1 -- 172.21.15.123:0/1638544733 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc40057ac0 con 0x564549364350 2024-09-15T23:18:42.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.388+0000 7fbc2d7fa640 1 -- 172.21.15.123:0/1638544733 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fbc400600c0 con 0x564549364350 2024-09-15T23:18:42.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.388+0000 7fbc5764c740 10 client.7884 fetch_fsmap learned FSMap version 74 2024-09-15T23:18:42.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.388+0000 7fbc5764c740 1 -- 172.21.15.123:0/1638544733 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x56454939a940 con 0x564549364350 2024-09-15T23:18:42.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.388+0000 7fbc2d7fa640 1 -- 172.21.15.123:0/1638544733 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc40057ac0 con 0x564549364350 2024-09-15T23:18:42.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.388+0000 7fbc2d7fa640 1 -- 172.21.15.123:0/1638544733 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 74) ==== 3502+0+0 (secure 0 0 0) 0x7fbc40061f10 con 0x564549364350 2024-09-15T23:18:42.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.388+0000 7fbc5764c740 10 client.7884 fetch_fsmap finished waiting for FSMap version 74 2024-09-15T23:18:42.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.388+0000 7fbc5764c740 10 client.7884 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-15T23:18:42.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.388+0000 7fbc5764c740 20 client.7884 populate_metadata read hostname 'smithi123' 2024-09-15T23:18:42.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.388+0000 7fbc5764c740 1 --2- 172.21.15.123:0/1638544733 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x564549378fe0 0x56454939a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.388+0000 7fbc5764c740 4 client.7884 mds_command: new command op to 7608 tid=0 multi_id=0 [{"prefix": "perf dump"}] 2024-09-15T23:18:42.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.388+0000 7fbc5764c740 1 -- 172.21.15.123:0/1638544733 --> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] -- command(tid 0: {"prefix": "perf dump"}) -- 0x5645492a8350 con 0x564549378fe0 2024-09-15T23:18:42.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.389+0000 7fbc45d9b640 1 --2- 172.21.15.123:0/1638544733 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x564549378fe0 0x56454939a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.389+0000 7fbc2d7fa640 10 client.7884 ms_handle_connect on v2:172.21.15.123:6833/3823805081 2024-09-15T23:18:42.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.389+0000 7fbc45d9b640 1 --2- 172.21.15.123:0/1638544733 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x564549378fe0 0x56454939a3b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45f526d7abbecf26 server_cookie=29a23ad20cff24b5 in_seq=0 out_seq=0 2024-09-15T23:18:42.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.389+0000 7fbc2d7fa640 1 -- 172.21.15.123:0/1638544733 <== mds.0 v2:172.21.15.123:6833/3823805081 1 ==== command_reply(tid 0: 0 ) ==== 8+0+17998 (crc 0 0 0) 0x5645492a8350 con 0x564549378fe0 2024-09-15T23:18:42.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.389+0000 7fbc2d7fa640 10 client.7884 handle_command_reply: tid=0 2024-09-15T23:18:42.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.389+0000 7fbc5764c740 1 client.7884 shutdown 2024-09-15T23:18:42.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.389+0000 7fbc5764c740 1 -- 172.21.15.123:0/1638544733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564549364350 msgr2=0x5645494015a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:42.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.389+0000 7fbc5764c740 1 --2- 172.21.15.123:0/1638544733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564549364350 0x5645494015a0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fbc40007410 tx=0x7fbc4001b070 comp rx=0 tx=0).stop 2024-09-15T23:18:42.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.389+0000 7fbc5764c740 1 -- 172.21.15.123:0/1638544733 shutdown_connections 2024-09-15T23:18:42.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.390+0000 7fbc5764c740 1 --2- 172.21.15.123:0/1638544733 >> [v2:172.21.15.123:6833/3823805081,v1:172.21.15.123:6835/3823805081] conn(0x564549378fe0 0x56454939a3b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.390+0000 7fbc5764c740 1 --2- 172.21.15.123:0/1638544733 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5645493845e0 0x564549399e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.390+0000 7fbc5764c740 1 --2- 172.21.15.123:0/1638544733 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x564549382200 0x5645493fa930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.390+0000 7fbc2d7fa640 0 client.7884 ms_handle_reset on v2:172.21.15.123:6833/3823805081 2024-09-15T23:18:42.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.390+0000 7fbc5764c740 1 --2- 172.21.15.123:0/1638544733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564549364350 0x5645494015a0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.390+0000 7fbc5764c740 1 -- 172.21.15.123:0/1638544733 >> 172.21.15.123:0/1638544733 conn(0x564549381da0 msgr2=0x56454937f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:42.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.390+0000 7fbc5764c740 1 -- 172.21.15.123:0/1638544733 shutdown_connections 2024-09-15T23:18:42.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.390+0000 7fbc5764c740 1 -- 172.21.15.123:0/1638544733 wait complete. 2024-09-15T23:18:42.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.390+0000 7fbc5764c740 20 client.7884 trim_cache size 0 max 16384 2024-09-15T23:18:42.397 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:18:42.397 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-0": { 2024-09-15T23:18:42.398 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 29616, 2024-09-15T23:18:42.398 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 52018, 2024-09-15T23:18:42.398 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 9647157, 2024-09-15T23:18:42.398 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 49598311, 2024-09-15T23:18:42.398 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 19, 2024-09-15T23:18:42.398 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 6, 2024-09-15T23:18:42.398 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 2.842855308, 2024-09-15T23:18:42.398 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 2.162576239, 2024-09-15T23:18:42.398 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 1.561501091, 2024-09-15T23:18:42.398 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.058825002, 2024-09-15T23:18:42.398 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:18:42.398 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 52016, 2024-09-15T23:18:42.398 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 1.171714286, 2024-09-15T23:18:42.398 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000022526 2024-09-15T23:18:42.399 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.399 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:18:42.399 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 49423, 2024-09-15T23:18:42.399 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.008301135, 2024-09-15T23:18:42.399 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000167 2024-09-15T23:18:42.399 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.399 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-15T23:18:42.399 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 0 2024-09-15T23:18:42.399 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.399 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-1": { 2024-09-15T23:18:42.399 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 3481, 2024-09-15T23:18:42.399 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 3500, 2024-09-15T23:18:42.399 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 1269528, 2024-09-15T23:18:42.399 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 44235384, 2024-09-15T23:18:42.400 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 6, 2024-09-15T23:18:42.400 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 4, 2024-09-15T23:18:42.400 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.342477417, 2024-09-15T23:18:42.400 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.178480431, 2024-09-15T23:18:42.400 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.054781016, 2024-09-15T23:18:42.400 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.091715526, 2024-09-15T23:18:42.400 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:18:42.400 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 3499, 2024-09-15T23:18:42.400 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.320034995, 2024-09-15T23:18:42.400 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000091464 2024-09-15T23:18:42.400 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.400 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:18:42.400 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:42.400 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:42.401 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:42.401 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.401 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 1728, 2024-09-15T23:18:42.401 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 121296 2024-09-15T23:18:42.401 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.401 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-2": { 2024-09-15T23:18:42.401 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 3209, 2024-09-15T23:18:42.401 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 3203, 2024-09-15T23:18:42.401 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 913163, 2024-09-15T23:18:42.401 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 28131627, 2024-09-15T23:18:42.401 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 5, 2024-09-15T23:18:42.401 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 4, 2024-09-15T23:18:42.402 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.317411047, 2024-09-15T23:18:42.402 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.127363479, 2024-09-15T23:18:42.402 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.056246231, 2024-09-15T23:18:42.402 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.125889219, 2024-09-15T23:18:42.402 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-09-15T23:18:42.402 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 3203, 2024-09-15T23:18:42.402 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.325075994, 2024-09-15T23:18:42.402 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000101491 2024-09-15T23:18:42.402 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.402 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-09-15T23:18:42.402 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:42.402 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:42.402 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:42.403 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.403 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 123152, 2024-09-15T23:18:42.403 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 26288 2024-09-15T23:18:42.403 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.403 INFO:teuthology.orchestra.run.smithi123.stdout: "cct": { 2024-09-15T23:18:42.403 INFO:teuthology.orchestra.run.smithi123.stdout: "total_workers": 1, 2024-09-15T23:18:42.403 INFO:teuthology.orchestra.run.smithi123.stdout: "unhealthy_workers": 0 2024-09-15T23:18:42.403 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.403 INFO:teuthology.orchestra.run.smithi123.stdout: "finisher-MDSRank": { 2024-09-15T23:18:42.403 INFO:teuthology.orchestra.run.smithi123.stdout: "queue_len": 0, 2024-09-15T23:18:42.403 INFO:teuthology.orchestra.run.smithi123.stdout: "complete_latency": { 2024-09-15T23:18:42.403 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2766, 2024-09-15T23:18:42.403 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 17.354105498, 2024-09-15T23:18:42.403 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.006274080 2024-09-15T23:18:42.403 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:42.404 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.404 INFO:teuthology.orchestra.run.smithi123.stdout: "finisher-PurgeQueue": { 2024-09-15T23:18:42.404 INFO:teuthology.orchestra.run.smithi123.stdout: "queue_len": 0, 2024-09-15T23:18:42.404 INFO:teuthology.orchestra.run.smithi123.stdout: "complete_latency": { 2024-09-15T23:18:42.404 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 4278, 2024-09-15T23:18:42.404 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 1.106246481, 2024-09-15T23:18:42.404 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000258589 2024-09-15T23:18:42.404 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:42.404 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.404 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-09-15T23:18:42.404 INFO:teuthology.orchestra.run.smithi123.stdout: "request": 25667, 2024-09-15T23:18:42.404 INFO:teuthology.orchestra.run.smithi123.stdout: "reply": 25667, 2024-09-15T23:18:42.404 INFO:teuthology.orchestra.run.smithi123.stdout: "reply_latency": { 2024-09-15T23:18:42.405 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 25667, 2024-09-15T23:18:42.405 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 301.730484568, 2024-09-15T23:18:42.405 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.011755580 2024-09-15T23:18:42.405 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.405 INFO:teuthology.orchestra.run.smithi123.stdout: "slow_reply": 0, 2024-09-15T23:18:42.405 INFO:teuthology.orchestra.run.smithi123.stdout: "forward": 0, 2024-09-15T23:18:42.405 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_fetch_complete": 0, 2024-09-15T23:18:42.405 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_fetch_keys": 0, 2024-09-15T23:18:42.405 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_commit": 12, 2024-09-15T23:18:42.405 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_split": 0, 2024-09-15T23:18:42.405 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_merge": 0, 2024-09-15T23:18:42.405 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes": 17839, 2024-09-15T23:18:42.405 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_top": 0, 2024-09-15T23:18:42.406 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_bottom": 17839, 2024-09-15T23:18:42.406 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_pin_tail": 0, 2024-09-15T23:18:42.406 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_pinned": 17838, 2024-09-15T23:18:42.406 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_expired": 0, 2024-09-15T23:18:42.406 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_with_caps": 2, 2024-09-15T23:18:42.406 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": 2, 2024-09-15T23:18:42.406 INFO:teuthology.orchestra.run.smithi123.stdout: "subtrees": 2, 2024-09-15T23:18:42.406 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse": 46597, 2024-09-15T23:18:42.406 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_hit": 46117, 2024-09-15T23:18:42.406 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_forward": 0, 2024-09-15T23:18:42.406 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_discover": 0, 2024-09-15T23:18:42.406 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_dir_fetch": 0, 2024-09-15T23:18:42.406 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_remote_ino": 0, 2024-09-15T23:18:42.407 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_lock": 81, 2024-09-15T23:18:42.407 INFO:teuthology.orchestra.run.smithi123.stdout: "load_cent": 0, 2024-09-15T23:18:42.407 INFO:teuthology.orchestra.run.smithi123.stdout: "q": 0, 2024-09-15T23:18:42.407 INFO:teuthology.orchestra.run.smithi123.stdout: "exported": 0, 2024-09-15T23:18:42.407 INFO:teuthology.orchestra.run.smithi123.stdout: "exported_inodes": 0, 2024-09-15T23:18:42.407 INFO:teuthology.orchestra.run.smithi123.stdout: "imported": 0, 2024-09-15T23:18:42.407 INFO:teuthology.orchestra.run.smithi123.stdout: "imported_inodes": 0, 2024-09-15T23:18:42.407 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_dir_fetch": 0, 2024-09-15T23:18:42.407 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_backtrace_fetch": 2011, 2024-09-15T23:18:42.407 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_peer_discover": 0, 2024-09-15T23:18:42.407 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rfiles": 0, 2024-09-15T23:18:42.407 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rbytes": 0, 2024-09-15T23:18:42.407 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rsnaps": 0, 2024-09-15T23:18:42.407 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_backtrace_fetch": 2011, 2024-09-15T23:18:42.408 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_set_tag": 0, 2024-09-15T23:18:42.408 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_backtrace_repaired": 0, 2024-09-15T23:18:42.408 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_inotable_repaired": 0, 2024-09-15T23:18:42.408 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dir_inodes": 11, 2024-09-15T23:18:42.408 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dir_base_inodes": 1, 2024-09-15T23:18:42.408 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dirfrag_rstats": 10, 2024-09-15T23:18:42.408 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_file_inodes": 2000, 2024-09-15T23:18:42.408 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_inode_file_caps": 0, 2024-09-15T23:18:42.408 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_revoke": 1145, 2024-09-15T23:18:42.408 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_grant": 4044, 2024-09-15T23:18:42.408 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_trunc": 0, 2024-09-15T23:18:42.408 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-15T23:18:42.408 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-15T23:18:42.409 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_caps": 4002, 2024-09-15T23:18:42.409 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_caps_dirty": 3328, 2024-09-15T23:18:42.409 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_cap_release": 41, 2024-09-15T23:18:42.409 INFO:teuthology.orchestra.run.smithi123.stdout: "process_request_cap_release": 14102 2024-09-15T23:18:42.409 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.409 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_cache": { 2024-09-15T23:18:42.409 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_update": 0, 2024-09-15T23:18:42.409 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_update_receipt": 0, 2024-09-15T23:18:42.409 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_try_discover": 0, 2024-09-15T23:18:42.409 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_send_discover": 0, 2024-09-15T23:18:42.409 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_handle_discover": 0, 2024-09-15T23:18:42.409 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays": 0, 2024-09-15T23:18:42.409 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays_delayed": 0, 2024-09-15T23:18:42.409 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays_enqueuing": 0, 2024-09-15T23:18:42.410 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_created": 4156, 2024-09-15T23:18:42.410 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_enqueued": 3772, 2024-09-15T23:18:42.410 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_reintegrated": 2234, 2024-09-15T23:18:42.410 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_migrated": 0, 2024-09-15T23:18:42.410 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_processing": 0, 2024-09-15T23:18:42.410 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_enqueued": 0, 2024-09-15T23:18:42.410 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_prioritized": 0, 2024-09-15T23:18:42.410 INFO:teuthology.orchestra.run.smithi123.stdout: "recovery_started": 0, 2024-09-15T23:18:42.410 INFO:teuthology.orchestra.run.smithi123.stdout: "recovery_completed": 0, 2024-09-15T23:18:42.410 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_quiesce_path": 0, 2024-09-15T23:18:42.410 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_quiesce_inode": 0, 2024-09-15T23:18:42.410 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_enqueue_scrub": 1, 2024-09-15T23:18:42.410 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_exportdir": 0, 2024-09-15T23:18:42.410 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_flush": 0, 2024-09-15T23:18:42.411 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_fragmentdir": 0, 2024-09-15T23:18:42.411 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_fragstats": 0, 2024-09-15T23:18:42.411 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_inodestats": 0 2024-09-15T23:18:42.411 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.411 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_log": { 2024-09-15T23:18:42.411 INFO:teuthology.orchestra.run.smithi123.stdout: "evlrg": 0, 2024-09-15T23:18:42.411 INFO:teuthology.orchestra.run.smithi123.stdout: "evadd": 28451, 2024-09-15T23:18:42.411 INFO:teuthology.orchestra.run.smithi123.stdout: "evex": 0, 2024-09-15T23:18:42.411 INFO:teuthology.orchestra.run.smithi123.stdout: "evtrm": 0, 2024-09-15T23:18:42.411 INFO:teuthology.orchestra.run.smithi123.stdout: "ev": 28451, 2024-09-15T23:18:42.411 INFO:teuthology.orchestra.run.smithi123.stdout: "evexg": 0, 2024-09-15T23:18:42.411 INFO:teuthology.orchestra.run.smithi123.stdout: "evexd": 0, 2024-09-15T23:18:42.411 INFO:teuthology.orchestra.run.smithi123.stdout: "segadd": 42, 2024-09-15T23:18:42.411 INFO:teuthology.orchestra.run.smithi123.stdout: "segex": 0, 2024-09-15T23:18:42.412 INFO:teuthology.orchestra.run.smithi123.stdout: "segtrm": 0, 2024-09-15T23:18:42.412 INFO:teuthology.orchestra.run.smithi123.stdout: "seg": 42, 2024-09-15T23:18:42.412 INFO:teuthology.orchestra.run.smithi123.stdout: "segmjr": 4, 2024-09-15T23:18:42.412 INFO:teuthology.orchestra.run.smithi123.stdout: "segexg": 0, 2024-09-15T23:18:42.412 INFO:teuthology.orchestra.run.smithi123.stdout: "segexd": 0, 2024-09-15T23:18:42.412 INFO:teuthology.orchestra.run.smithi123.stdout: "expos": 4194304, 2024-09-15T23:18:42.412 INFO:teuthology.orchestra.run.smithi123.stdout: "wrpos": 100529013, 2024-09-15T23:18:42.412 INFO:teuthology.orchestra.run.smithi123.stdout: "rdpos": 0, 2024-09-15T23:18:42.412 INFO:teuthology.orchestra.run.smithi123.stdout: "jlat": { 2024-09-15T23:18:42.412 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2624, 2024-09-15T23:18:42.412 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 85.316128055, 2024-09-15T23:18:42.412 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.032513768 2024-09-15T23:18:42.412 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.413 INFO:teuthology.orchestra.run.smithi123.stdout: "replayed": 0 2024-09-15T23:18:42.413 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.413 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_mem": { 2024-09-15T23:18:42.413 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 14, 2024-09-15T23:18:42.413 INFO:teuthology.orchestra.run.smithi123.stdout: "ino+": 2015, 2024-09-15T23:18:42.413 INFO:teuthology.orchestra.run.smithi123.stdout: "ino-": 2001, 2024-09-15T23:18:42.413 INFO:teuthology.orchestra.run.smithi123.stdout: "dir": 13, 2024-09-15T23:18:42.413 INFO:teuthology.orchestra.run.smithi123.stdout: "dir+": 13, 2024-09-15T23:18:42.413 INFO:teuthology.orchestra.run.smithi123.stdout: "dir-": 0, 2024-09-15T23:18:42.413 INFO:teuthology.orchestra.run.smithi123.stdout: "dn": 17839, 2024-09-15T23:18:42.413 INFO:teuthology.orchestra.run.smithi123.stdout: "dn+": 19840, 2024-09-15T23:18:42.413 INFO:teuthology.orchestra.run.smithi123.stdout: "dn-": 2001, 2024-09-15T23:18:42.413 INFO:teuthology.orchestra.run.smithi123.stdout: "cap": 2, 2024-09-15T23:18:42.413 INFO:teuthology.orchestra.run.smithi123.stdout: "cap+": 6055, 2024-09-15T23:18:42.414 INFO:teuthology.orchestra.run.smithi123.stdout: "cap-": 6053, 2024-09-15T23:18:42.414 INFO:teuthology.orchestra.run.smithi123.stdout: "rss": 104144, 2024-09-15T23:18:42.414 INFO:teuthology.orchestra.run.smithi123.stdout: "heap": 231788 2024-09-15T23:18:42.414 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.414 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_server": { 2024-09-15T23:18:42.414 INFO:teuthology.orchestra.run.smithi123.stdout: "dispatch_client_request": 28551, 2024-09-15T23:18:42.414 INFO:teuthology.orchestra.run.smithi123.stdout: "dispatch_server_request": 0, 2024-09-15T23:18:42.414 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_request": 25667, 2024-09-15T23:18:42.414 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_session": 5, 2024-09-15T23:18:42.414 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_peer_request": 0, 2024-09-15T23:18:42.414 INFO:teuthology.orchestra.run.smithi123.stdout: "req_create_latency": { 2024-09-15T23:18:42.414 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2000, 2024-09-15T23:18:42.414 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 1.735919280, 2024-09-15T23:18:42.415 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000867959 2024-09-15T23:18:42.415 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.415 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getattr_latency": { 2024-09-15T23:18:42.415 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 25, 2024-09-15T23:18:42.415 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.003444449, 2024-09-15T23:18:42.415 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000137777 2024-09-15T23:18:42.415 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.415 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getfilelock_latency": { 2024-09-15T23:18:42.415 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:42.415 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:42.415 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:42.415 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.415 INFO:teuthology.orchestra.run.smithi123.stdout: "req_link_latency": { 2024-09-15T23:18:42.415 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 6000, 2024-09-15T23:18:42.416 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 6.767079046, 2024-09-15T23:18:42.416 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.001127846 2024-09-15T23:18:42.416 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.416 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookup_latency": { 2024-09-15T23:18:42.416 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 7394, 2024-09-15T23:18:42.416 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 5.333378574, 2024-09-15T23:18:42.416 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000721311 2024-09-15T23:18:42.416 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.416 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookuphash_latency": { 2024-09-15T23:18:42.416 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:42.416 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:42.416 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:42.416 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.416 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupino_latency": { 2024-09-15T23:18:42.417 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:42.417 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:42.417 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:42.417 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.417 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupname_latency": { 2024-09-15T23:18:42.417 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:42.417 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:42.417 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:42.417 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.417 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupparent_latency": { 2024-09-15T23:18:42.417 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:42.417 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:42.417 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:42.418 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.418 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupsnap_latency": { 2024-09-15T23:18:42.418 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1, 2024-09-15T23:18:42.418 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000037358, 2024-09-15T23:18:42.418 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000037358 2024-09-15T23:18:42.418 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.418 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lssnap_latency": { 2024-09-15T23:18:42.418 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:42.418 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:42.418 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:42.418 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.418 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mkdir_latency": { 2024-09-15T23:18:42.418 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1, 2024-09-15T23:18:42.419 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.002762232, 2024-09-15T23:18:42.419 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.002762232 2024-09-15T23:18:42.419 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.419 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mknod_latency": { 2024-09-15T23:18:42.419 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:42.419 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:42.419 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:42.419 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.419 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mksnap_latency": { 2024-09-15T23:18:42.419 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1, 2024-09-15T23:18:42.419 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.229594131, 2024-09-15T23:18:42.419 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.229594131 2024-09-15T23:18:42.419 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.420 INFO:teuthology.orchestra.run.smithi123.stdout: "req_open_latency": { 2024-09-15T23:18:42.420 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1, 2024-09-15T23:18:42.420 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000079997, 2024-09-15T23:18:42.420 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000079997 2024-09-15T23:18:42.420 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.420 INFO:teuthology.orchestra.run.smithi123.stdout: "req_readdir_latency": { 2024-09-15T23:18:42.420 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 8, 2024-09-15T23:18:42.420 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 1.644402548, 2024-09-15T23:18:42.420 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.205550318 2024-09-15T23:18:42.420 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.420 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rename_latency": { 2024-09-15T23:18:42.420 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 2234, 2024-09-15T23:18:42.420 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 267.593087982, 2024-09-15T23:18:42.421 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.119782044 2024-09-15T23:18:42.421 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.421 INFO:teuthology.orchestra.run.smithi123.stdout: "req_renamesnap_latency": { 2024-09-15T23:18:42.421 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:42.421 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:42.421 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:42.421 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.421 INFO:teuthology.orchestra.run.smithi123.stdout: "req_snapdiff_latency": { 2024-09-15T23:18:42.421 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:42.421 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:42.421 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:42.421 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.421 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmdir_latency": { 2024-09-15T23:18:42.422 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:42.422 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:42.422 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:42.422 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.422 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmsnap_latency": { 2024-09-15T23:18:42.422 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1, 2024-09-15T23:18:42.422 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.141160562, 2024-09-15T23:18:42.422 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.141160562 2024-09-15T23:18:42.422 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.422 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmxattr_latency": { 2024-09-15T23:18:42.422 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:42.422 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:42.422 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:42.422 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.423 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setattr_latency": { 2024-09-15T23:18:42.423 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1, 2024-09-15T23:18:42.423 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000249191, 2024-09-15T23:18:42.423 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000249191 2024-09-15T23:18:42.423 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.423 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setdirlayout_latency": { 2024-09-15T23:18:42.423 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:42.423 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:42.423 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:42.423 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.423 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setfilelock_latency": { 2024-09-15T23:18:42.423 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:42.423 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:42.424 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:42.424 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.424 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setlayout_latency": { 2024-09-15T23:18:42.424 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:42.424 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:42.424 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:42.424 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.424 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setxattr_latency": { 2024-09-15T23:18:42.424 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:42.424 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:42.424 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:42.424 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.425 INFO:teuthology.orchestra.run.smithi123.stdout: "req_symlink_latency": { 2024-09-15T23:18:42.425 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:42.425 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:42.425 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:42.425 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.425 INFO:teuthology.orchestra.run.smithi123.stdout: "req_unlink_latency": { 2024-09-15T23:18:42.425 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 8000, 2024-09-15T23:18:42.425 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 18.279289218, 2024-09-15T23:18:42.425 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.002284911 2024-09-15T23:18:42.425 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.425 INFO:teuthology.orchestra.run.smithi123.stdout: "cap_revoke_eviction": 0, 2024-09-15T23:18:42.425 INFO:teuthology.orchestra.run.smithi123.stdout: "cap_acquisition_throttle": 0, 2024-09-15T23:18:42.425 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getvxattr_latency": { 2024-09-15T23:18:42.426 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:42.426 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:42.426 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:42.426 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:42.426 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.426 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_sessions": { 2024-09-15T23:18:42.426 INFO:teuthology.orchestra.run.smithi123.stdout: "session_count": 1, 2024-09-15T23:18:42.426 INFO:teuthology.orchestra.run.smithi123.stdout: "session_add": 1, 2024-09-15T23:18:42.426 INFO:teuthology.orchestra.run.smithi123.stdout: "session_remove": 0, 2024-09-15T23:18:42.426 INFO:teuthology.orchestra.run.smithi123.stdout: "sessions_open": 1, 2024-09-15T23:18:42.426 INFO:teuthology.orchestra.run.smithi123.stdout: "sessions_stale": 0, 2024-09-15T23:18:42.426 INFO:teuthology.orchestra.run.smithi123.stdout: "total_load": 18630, 2024-09-15T23:18:42.426 INFO:teuthology.orchestra.run.smithi123.stdout: "average_load": 18630, 2024-09-15T23:18:42.427 INFO:teuthology.orchestra.run.smithi123.stdout: "avg_session_uptime": 76, 2024-09-15T23:18:42.427 INFO:teuthology.orchestra.run.smithi123.stdout: "mdthresh_evicted": 0 2024-09-15T23:18:42.427 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.427 INFO:teuthology.orchestra.run.smithi123.stdout: "mempool": { 2024-09-15T23:18:42.427 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_bytes": 0, 2024-09-15T23:18:42.427 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_items": 0, 2024-09-15T23:18:42.427 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_bytes": 0, 2024-09-15T23:18:42.427 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_items": 0, 2024-09-15T23:18:42.427 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_bytes": 0, 2024-09-15T23:18:42.427 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_items": 0, 2024-09-15T23:18:42.427 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-15T23:18:42.427 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_items": 0, 2024-09-15T23:18:42.427 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-15T23:18:42.428 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_items": 0, 2024-09-15T23:18:42.428 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_bytes": 0, 2024-09-15T23:18:42.428 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_items": 0, 2024-09-15T23:18:42.428 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-15T23:18:42.428 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_items": 0, 2024-09-15T23:18:42.428 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_bytes": 0, 2024-09-15T23:18:42.428 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_items": 0, 2024-09-15T23:18:42.428 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_bytes": 0, 2024-09-15T23:18:42.428 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_items": 0, 2024-09-15T23:18:42.428 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-15T23:18:42.428 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_items": 0, 2024-09-15T23:18:42.428 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-15T23:18:42.428 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_items": 0, 2024-09-15T23:18:42.429 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_bytes": 0, 2024-09-15T23:18:42.429 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_items": 0, 2024-09-15T23:18:42.429 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_bytes": 0, 2024-09-15T23:18:42.429 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_items": 0, 2024-09-15T23:18:42.429 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-15T23:18:42.429 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_items": 0, 2024-09-15T23:18:42.429 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_bytes": 0, 2024-09-15T23:18:42.429 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_items": 0, 2024-09-15T23:18:42.429 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_bytes": 0, 2024-09-15T23:18:42.429 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_items": 0, 2024-09-15T23:18:42.429 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_bytes": 0, 2024-09-15T23:18:42.429 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_items": 0, 2024-09-15T23:18:42.429 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_bytes": 0, 2024-09-15T23:18:42.430 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_items": 0, 2024-09-15T23:18:42.430 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_bytes": 250438, 2024-09-15T23:18:42.430 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_items": 92, 2024-09-15T23:18:42.430 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_bytes": 440, 2024-09-15T23:18:42.430 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_items": 5, 2024-09-15T23:18:42.430 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_bytes": 0, 2024-09-15T23:18:42.430 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_items": 0, 2024-09-15T23:18:42.430 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_bytes": 0, 2024-09-15T23:18:42.430 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_items": 0, 2024-09-15T23:18:42.430 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_bytes": 0, 2024-09-15T23:18:42.430 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_items": 0, 2024-09-15T23:18:42.430 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_bytes": 5608, 2024-09-15T23:18:42.430 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_items": 81, 2024-09-15T23:18:42.431 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_bytes": 0, 2024-09-15T23:18:42.431 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_items": 0, 2024-09-15T23:18:42.431 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_bytes": 0, 2024-09-15T23:18:42.431 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_items": 0, 2024-09-15T23:18:42.431 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_bytes": 13435405, 2024-09-15T23:18:42.431 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_items": 661110, 2024-09-15T23:18:42.431 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_bytes": 0, 2024-09-15T23:18:42.431 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_items": 0, 2024-09-15T23:18:42.431 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_bytes": 0, 2024-09-15T23:18:42.431 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_items": 0 2024-09-15T23:18:42.431 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.431 INFO:teuthology.orchestra.run.smithi123.stdout: "objecter": { 2024-09-15T23:18:42.431 INFO:teuthology.orchestra.run.smithi123.stdout: "op_active": 0, 2024-09-15T23:18:42.431 INFO:teuthology.orchestra.run.smithi123.stdout: "op_laggy": 0, 2024-09-15T23:18:42.431 INFO:teuthology.orchestra.run.smithi123.stdout: "op_send": 8642, 2024-09-15T23:18:42.432 INFO:teuthology.orchestra.run.smithi123.stdout: "op_send_bytes": 97019167, 2024-09-15T23:18:42.432 INFO:teuthology.orchestra.run.smithi123.stdout: "op_resend": 37, 2024-09-15T23:18:42.432 INFO:teuthology.orchestra.run.smithi123.stdout: "op_reply": 8642, 2024-09-15T23:18:42.432 INFO:teuthology.orchestra.run.smithi123.stdout: "op_latency": { 2024-09-15T23:18:42.432 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 8642, 2024-09-15T23:18:42.432 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 29.963289062, 2024-09-15T23:18:42.432 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.003467170 2024-09-15T23:18:42.432 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.432 INFO:teuthology.orchestra.run.smithi123.stdout: "op_inflight": 0, 2024-09-15T23:18:42.432 INFO:teuthology.orchestra.run.smithi123.stdout: "oplen_avg": { 2024-09-15T23:18:42.432 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 8642, 2024-09-15T23:18:42.432 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 8736 2024-09-15T23:18:42.432 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.432 INFO:teuthology.orchestra.run.smithi123.stdout: "op": 8642, 2024-09-15T23:18:42.433 INFO:teuthology.orchestra.run.smithi123.stdout: "op_r": 2060, 2024-09-15T23:18:42.433 INFO:teuthology.orchestra.run.smithi123.stdout: "op_w": 6582, 2024-09-15T23:18:42.433 INFO:teuthology.orchestra.run.smithi123.stdout: "op_rmw": 0, 2024-09-15T23:18:42.433 INFO:teuthology.orchestra.run.smithi123.stdout: "op_pg": 0, 2024-09-15T23:18:42.433 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_stat": 0, 2024-09-15T23:18:42.433 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_create": 11, 2024-09-15T23:18:42.433 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_read": 48, 2024-09-15T23:18:42.433 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_write": 2671, 2024-09-15T23:18:42.433 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_writefull": 31, 2024-09-15T23:18:42.433 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_writesame": 0, 2024-09-15T23:18:42.433 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_append": 0, 2024-09-15T23:18:42.433 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_zero": 1772, 2024-09-15T23:18:42.433 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_truncate": 0, 2024-09-15T23:18:42.434 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_delete": 2034, 2024-09-15T23:18:42.434 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_mapext": 0, 2024-09-15T23:18:42.434 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_sparse_read": 0, 2024-09-15T23:18:42.434 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_clonerange": 0, 2024-09-15T23:18:42.434 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_getxattr": 2012, 2024-09-15T23:18:42.434 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_setxattr": 22, 2024-09-15T23:18:42.434 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_cmpxattr": 0, 2024-09-15T23:18:42.434 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_rmxattr": 0, 2024-09-15T23:18:42.434 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_resetxattrs": 0, 2024-09-15T23:18:42.434 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_call": 0, 2024-09-15T23:18:42.434 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_watch": 0, 2024-09-15T23:18:42.434 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_notify": 0, 2024-09-15T23:18:42.434 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_src_cmpxattr": 0, 2024-09-15T23:18:42.434 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_pgls": 0, 2024-09-15T23:18:42.435 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_pgls_filter": 0, 2024-09-15T23:18:42.435 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_other": 0, 2024-09-15T23:18:42.435 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_active": 0, 2024-09-15T23:18:42.435 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_send": 0, 2024-09-15T23:18:42.435 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_resend": 0, 2024-09-15T23:18:42.435 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_ping": 0, 2024-09-15T23:18:42.435 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_active": 0, 2024-09-15T23:18:42.435 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_send": 0, 2024-09-15T23:18:42.435 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_resend": 0, 2024-09-15T23:18:42.435 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_active": 0, 2024-09-15T23:18:42.435 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_send": 0, 2024-09-15T23:18:42.435 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_resend": 0, 2024-09-15T23:18:42.435 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_active": 0, 2024-09-15T23:18:42.435 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_send": 0, 2024-09-15T23:18:42.436 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_resend": 0, 2024-09-15T23:18:42.436 INFO:teuthology.orchestra.run.smithi123.stdout: "command_active": 0, 2024-09-15T23:18:42.436 INFO:teuthology.orchestra.run.smithi123.stdout: "command_send": 0, 2024-09-15T23:18:42.436 INFO:teuthology.orchestra.run.smithi123.stdout: "command_resend": 0, 2024-09-15T23:18:42.436 INFO:teuthology.orchestra.run.smithi123.stdout: "map_epoch": 118, 2024-09-15T23:18:42.436 INFO:teuthology.orchestra.run.smithi123.stdout: "map_full": 0, 2024-09-15T23:18:42.436 INFO:teuthology.orchestra.run.smithi123.stdout: "map_inc": 5, 2024-09-15T23:18:42.436 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_sessions": 8, 2024-09-15T23:18:42.436 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_session_open": 8, 2024-09-15T23:18:42.436 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_session_close": 0, 2024-09-15T23:18:42.436 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_laggy": 0, 2024-09-15T23:18:42.436 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_wr": 104, 2024-09-15T23:18:42.437 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_rd": 0, 2024-09-15T23:18:42.437 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_del": 31 2024-09-15T23:18:42.437 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.437 INFO:teuthology.orchestra.run.smithi123.stdout: "oft": { 2024-09-15T23:18:42.437 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_objs": 1, 2024-09-15T23:18:42.437 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_kv_pairs": 0, 2024-09-15T23:18:42.437 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_updates": 0, 2024-09-15T23:18:42.437 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_removes": 0 2024-09-15T23:18:42.437 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.437 INFO:teuthology.orchestra.run.smithi123.stdout: "osd-slow-ops": { 2024-09-15T23:18:42.437 INFO:teuthology.orchestra.run.smithi123.stdout: "slow_ops_count": 0 2024-09-15T23:18:42.437 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.437 INFO:teuthology.orchestra.run.smithi123.stdout: "purge_queue": { 2024-09-15T23:18:42.437 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_ops": 0, 2024-09-15T23:18:42.438 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_ops_high_water": 32, 2024-09-15T23:18:42.438 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing": 0, 2024-09-15T23:18:42.438 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_high_water": 32, 2024-09-15T23:18:42.438 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executed_ops": 3772, 2024-09-15T23:18:42.438 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executed": 3772, 2024-09-15T23:18:42.438 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_item_in_journal": 0 2024-09-15T23:18:42.438 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.438 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-15T23:18:42.438 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-15T23:18:42.438 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-09-15T23:18:42.438 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-15T23:18:42.438 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 36301, 2024-09-15T23:18:42.438 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 8998010, 2024-09-15T23:18:42.438 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-15T23:18:42.439 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 36301, 2024-09-15T23:18:42.439 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-15T23:18:42.439 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-15T23:18:42.439 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 36301, 2024-09-15T23:18:42.439 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 8998010, 2024-09-15T23:18:42.439 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-15T23:18:42.439 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:42.439 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:42.439 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:42.439 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:42.439 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.439 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-objecter_bytes": { 2024-09-15T23:18:42.440 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-15T23:18:42.440 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-09-15T23:18:42.440 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-15T23:18:42.440 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-15T23:18:42.440 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-15T23:18:42.440 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-15T23:18:42.440 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-15T23:18:42.440 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 8642, 2024-09-15T23:18:42.440 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 97414315, 2024-09-15T23:18:42.440 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 8642, 2024-09-15T23:18:42.440 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 97414315, 2024-09-15T23:18:42.440 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-15T23:18:42.440 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:42.440 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:42.441 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:42.441 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:42.441 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.441 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-objecter_ops": { 2024-09-15T23:18:42.441 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-15T23:18:42.441 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 1024, 2024-09-15T23:18:42.441 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-15T23:18:42.441 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-09-15T23:18:42.441 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-09-15T23:18:42.441 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-15T23:18:42.441 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-09-15T23:18:42.441 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 8642, 2024-09-15T23:18:42.441 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 8642, 2024-09-15T23:18:42.441 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 8642, 2024-09-15T23:18:42.442 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 8642, 2024-09-15T23:18:42.442 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-15T23:18:42.442 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:42.442 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:42.442 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:42.442 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:42.442 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.442 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-write_buf_throttle": { 2024-09-15T23:18:42.442 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-15T23:18:42.442 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 3758096384, 2024-09-15T23:18:42.442 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-15T23:18:42.442 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 3772, 2024-09-15T23:18:42.442 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 395148, 2024-09-15T23:18:42.443 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-15T23:18:42.443 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 3772, 2024-09-15T23:18:42.443 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-15T23:18:42.443 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-15T23:18:42.443 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 47, 2024-09-15T23:18:42.443 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 395148, 2024-09-15T23:18:42.443 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-15T23:18:42.443 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:42.443 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:42.443 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:42.443 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:42.443 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:42.443 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-write_buf_throttle-0x55a456710500": { 2024-09-15T23:18:42.443 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-09-15T23:18:42.444 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 3758096384, 2024-09-15T23:18:42.444 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-09-15T23:18:42.444 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 28451, 2024-09-15T23:18:42.444 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 96334709, 2024-09-15T23:18:42.444 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-09-15T23:18:42.444 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 28451, 2024-09-15T23:18:42.444 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-09-15T23:18:42.444 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-09-15T23:18:42.444 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 2624, 2024-09-15T23:18:42.444 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 96334709, 2024-09-15T23:18:42.444 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-09-15T23:18:42.444 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-09-15T23:18:42.444 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-09-15T23:18:42.445 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-09-15T23:18:42.445 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:42.445 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:42.445 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:18:42.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.390+0000 7fbc548ac640 1 -- 172.21.15.123:0/4274877719 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbc3006c2b0 msgr2=0x7fbc3006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:42.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.390+0000 7fbc548ac640 1 --2- 172.21.15.123:0/4274877719 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbc3006c2b0 0x7fbc3006e770 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fbc5006cc90 tx=0x7fbc38009040 comp rx=0 tx=0).stop 2024-09-15T23:18:42.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.390+0000 7fbc548ac640 1 -- 172.21.15.123:0/4274877719 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc500732e0 msgr2=0x7fbc500b2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:42.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.390+0000 7fbc548ac640 1 --2- 172.21.15.123:0/4274877719 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc500732e0 0x7fbc500b2980 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fbc4000c7f0 tx=0x7fbc4000ccb0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.390+0000 7fbc548ac640 1 -- 172.21.15.123:0/4274877719 shutdown_connections 2024-09-15T23:18:42.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.390+0000 7fbc548ac640 1 --2- 172.21.15.123:0/4274877719 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc500cd270 0x7fbc501f4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.390+0000 7fbc548ac640 1 --2- 172.21.15.123:0/4274877719 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc500cce30 0x7fbc501e78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.390+0000 7fbc548ac640 1 --2- 172.21.15.123:0/4274877719 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbc3006c2b0 0x7fbc3006e770 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.390+0000 7fbc548ac640 1 --2- 172.21.15.123:0/4274877719 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc500732e0 0x7fbc500b2980 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.390+0000 7fbc548ac640 1 -- 172.21.15.123:0/4274877719 >> 172.21.15.123:0/4274877719 conn(0x7fbc5006d0f0 msgr2=0x7fbc50072970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:42.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.390+0000 7fbc548ac640 1 -- 172.21.15.123:0/4274877719 shutdown_connections 2024-09-15T23:18:42.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.390+0000 7fbc548ac640 1 -- 172.21.15.123:0/4274877719 wait complete. 2024-09-15T23:18:42.448 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:18:42.448 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:18:42.498 DEBUG:teuthology.orchestra.run.smithi188:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:18:42.542 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:18:42.543 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:18:42.543 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:18:42.543 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:18:42.559 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:18:42.559 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:18:42.615 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:18:42.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.753+0000 7fa41825e640 1 Processor -- start 2024-09-15T23:18:42.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.754+0000 7fa41825e640 1 -- start start 2024-09-15T23:18:42.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.754+0000 7fa41825e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa41015ed20 0x7fa4100b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.754+0000 7fa41825e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa4100d23b0 0x7fa4100b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.754+0000 7fa41825e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4100d0e70 con 0x7fa4100cf2d0 2024-09-15T23:18:42.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.754+0000 7fa41825e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fa4100d41c0 con 0x7fa4100d23b0 2024-09-15T23:18:42.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.754+0000 7fa41825e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fa4100d35b0 con 0x7fa41015ed20 2024-09-15T23:18:42.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.754+0000 7fa4157f9640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa4100d23b0 0x7fa4100b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.755+0000 7fa4167fb640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa4100cf2d0 0x7fa4100cf700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35704/0 (socket says 172.21.15.123:35704) 2024-09-15T23:18:42.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.755+0000 7fa4157f9640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa4100d23b0 0x7fa4100b67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50798/0 (socket says 172.21.15.123:50798) 2024-09-15T23:18:42.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.755+0000 7fa4167fb640 1 -- 172.21.15.123:0/91842165 learned_addr learned my addr 172.21.15.123:0/91842165 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:18:42.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.755+0000 7fa415ffa640 1 --2- 172.21.15.123:0/91842165 >> v2:172.21.15.188:3300/0 conn(0x7fa41015ed20 0x7fa4100b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.755+0000 7fa4157f9640 1 -- 172.21.15.123:0/91842165 >> v2:172.21.15.188:3300/0 conn(0x7fa41015ed20 msgr2=0x7fa4100b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:42.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.755+0000 7fa4157f9640 1 --2- 172.21.15.123:0/91842165 >> v2:172.21.15.188:3300/0 conn(0x7fa41015ed20 0x7fa4100b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.755+0000 7fa4157f9640 1 -- 172.21.15.123:0/91842165 >> v1:172.21.15.123:6789/0 conn(0x7fa4100cf2d0 legacy=0x7fa4100cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:42.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.755+0000 7fa4157f9640 1 -- 172.21.15.123:0/91842165 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4100d3890 con 0x7fa4100d23b0 2024-09-15T23:18:42.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.755+0000 7fa414ff8640 1 -- 172.21.15.123:0/91842165 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1579634821 0 0) 0x7fa408001110 con 0x7fa4100cf2d0 2024-09-15T23:18:42.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.755+0000 7fa415ffa640 1 --2- 172.21.15.123:0/91842165 >> v2:172.21.15.188:3300/0 conn(0x7fa41015ed20 0x7fa4100b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:18:42.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.755+0000 7fa4157f9640 1 --2- 172.21.15.123:0/91842165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4100d23b0 0x7fa4100b67a0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fa4100d47b0 tx=0x7fa40402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d56cc80c5bf3b2a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:42.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.756+0000 7fa414ff8640 1 -- 172.21.15.123:0/91842165 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa404037070 con 0x7fa4100d23b0 2024-09-15T23:18:42.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.756+0000 7fa414ff8640 1 -- 172.21.15.123:0/91842165 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa404032440 con 0x7fa4100d23b0 2024-09-15T23:18:42.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.756+0000 7fa414ff8640 1 -- 172.21.15.123:0/91842165 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40402ae60 con 0x7fa4100d23b0 2024-09-15T23:18:42.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.756+0000 7fa41825e640 1 -- 172.21.15.123:0/91842165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4100d23b0 msgr2=0x7fa4100b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:42.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.756+0000 7fa41825e640 1 --2- 172.21.15.123:0/91842165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4100d23b0 0x7fa4100b67a0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fa4100d47b0 tx=0x7fa40402a110 comp rx=0 tx=0).stop 2024-09-15T23:18:42.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.756+0000 7fa41825e640 1 -- 172.21.15.123:0/91842165 shutdown_connections 2024-09-15T23:18:42.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.756+0000 7fa41825e640 1 --2- 172.21.15.123:0/91842165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4100d23b0 0x7fa4100b67a0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.756+0000 7fa41825e640 1 --2- 172.21.15.123:0/91842165 >> v2:172.21.15.188:3300/0 conn(0x7fa41015ed20 0x7fa4100b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.756+0000 7fa41825e640 1 -- 172.21.15.123:0/91842165 >> 172.21.15.123:0/91842165 conn(0x7fa4100d1260 msgr2=0x7fa4100d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:42.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.756+0000 7fa41825e640 1 -- 172.21.15.123:0/91842165 shutdown_connections 2024-09-15T23:18:42.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.756+0000 7fa41825e640 1 -- 172.21.15.123:0/91842165 wait complete. 2024-09-15T23:18:42.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.757+0000 7fa41825e640 1 Processor -- start 2024-09-15T23:18:42.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.758+0000 7fa41825e640 1 -- start start 2024-09-15T23:18:42.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.758+0000 7fa41825e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4100cf2d0 0x7fa41014a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.758+0000 7fa41825e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4100d23b0 0x7fa410160c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.758+0000 7fa41825e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa41015ed20 0x7fa4101e72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.758+0000 7fa41825e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa4100d32a0 con 0x7fa4100d23b0 2024-09-15T23:18:42.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.758+0000 7fa41825e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa4100d3e50 con 0x7fa4100cf2d0 2024-09-15T23:18:42.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.758+0000 7fa41825e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa41015f100 con 0x7fa41015ed20 2024-09-15T23:18:42.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.758+0000 7fa4157f9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4100d23b0 0x7fa410160c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.758+0000 7fa4157f9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4100d23b0 0x7fa410160c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50806/0 (socket says 172.21.15.123:50806) 2024-09-15T23:18:42.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.758+0000 7fa4157f9640 1 -- 172.21.15.123:0/2410474845 learned_addr learned my addr 172.21.15.123:0/2410474845 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:42.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.759+0000 7fa415ffa640 1 --2- 172.21.15.123:0/2410474845 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4100cf2d0 0x7fa41014a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.759+0000 7fa4167fb640 1 --2- 172.21.15.123:0/2410474845 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa41015ed20 0x7fa4101e72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.759+0000 7fa4157f9640 1 -- 172.21.15.123:0/2410474845 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa41015ed20 msgr2=0x7fa4101e72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:42.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.759+0000 7fa4157f9640 1 --2- 172.21.15.123:0/2410474845 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa41015ed20 0x7fa4101e72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.759+0000 7fa4157f9640 1 -- 172.21.15.123:0/2410474845 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4100cf2d0 msgr2=0x7fa41014a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:42.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.759+0000 7fa4157f9640 1 --2- 172.21.15.123:0/2410474845 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4100cf2d0 0x7fa41014a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.759+0000 7fa4157f9640 1 -- 172.21.15.123:0/2410474845 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa410161d50 con 0x7fa4100d23b0 2024-09-15T23:18:42.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.759+0000 7fa415ffa640 1 --2- 172.21.15.123:0/2410474845 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4100cf2d0 0x7fa41014a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:18:42.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.759+0000 7fa4157f9640 1 --2- 172.21.15.123:0/2410474845 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4100d23b0 0x7fa410160c90 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fa404000c00 tx=0x7fa4040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:42.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.759+0000 7fa40e7fc640 1 -- 172.21.15.123:0/2410474845 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa404037040 con 0x7fa4100d23b0 2024-09-15T23:18:42.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.759+0000 7fa40e7fc640 1 -- 172.21.15.123:0/2410474845 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa404042070 con 0x7fa4100d23b0 2024-09-15T23:18:42.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.759+0000 7fa41825e640 1 -- 172.21.15.123:0/2410474845 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa41014a830 con 0x7fa4100d23b0 2024-09-15T23:18:42.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.759+0000 7fa40e7fc640 1 -- 172.21.15.123:0/2410474845 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa404030a50 con 0x7fa4100d23b0 2024-09-15T23:18:42.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.759+0000 7fa41825e640 1 -- 172.21.15.123:0/2410474845 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa410161a70 con 0x7fa4100d23b0 2024-09-15T23:18:42.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.760+0000 7fa41825e640 1 -- 172.21.15.123:0/2410474845 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4100d21a0 con 0x7fa4100d23b0 2024-09-15T23:18:42.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.760+0000 7fa40e7fc640 1 -- 172.21.15.123:0/2410474845 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa404030bf0 con 0x7fa4100d23b0 2024-09-15T23:18:42.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.761+0000 7fa40e7fc640 1 --2- 172.21.15.123:0/2410474845 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa3fc06c2b0 0x7fa3fc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:42.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.761+0000 7fa40e7fc640 1 -- 172.21.15.123:0/2410474845 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5795+0+0 (secure 0 0 0) 0x7fa4040abf10 con 0x7fa4100d23b0 2024-09-15T23:18:42.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.761+0000 7fa415ffa640 1 --2- 172.21.15.123:0/2410474845 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa3fc06c2b0 0x7fa3fc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:42.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.762+0000 7fa415ffa640 1 --2- 172.21.15.123:0/2410474845 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa3fc06c2b0 0x7fa3fc06e770 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa40000e550 tx=0x7fa400007ab0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:42.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.765+0000 7fa40e7fc640 1 -- 172.21.15.123:0/2410474845 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa404045360 con 0x7fa4100d23b0 2024-09-15T23:18:42.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.942+0000 7fa41825e640 1 -- 172.21.15.123:0/2410474845 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa4100b7010 con 0x7fa4100d23b0 2024-09-15T23:18:42.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.942+0000 7fa40e7fc640 1 -- 172.21.15.123:0/2410474845 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v118) ==== 80+0+0 (secure 0 0 0) 0x7fa40407a620 con 0x7fa4100d23b0 2024-09-15T23:18:42.943 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-15T23:18:42.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.944+0000 7fa41825e640 1 -- 172.21.15.123:0/2410474845 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa3fc06c2b0 msgr2=0x7fa3fc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:42.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.944+0000 7fa41825e640 1 --2- 172.21.15.123:0/2410474845 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa3fc06c2b0 0x7fa3fc06e770 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa40000e550 tx=0x7fa400007ab0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.944+0000 7fa41825e640 1 -- 172.21.15.123:0/2410474845 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4100d23b0 msgr2=0x7fa410160c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:42.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.944+0000 7fa41825e640 1 --2- 172.21.15.123:0/2410474845 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4100d23b0 0x7fa410160c90 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fa404000c00 tx=0x7fa4040046c0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.944+0000 7fa41825e640 1 -- 172.21.15.123:0/2410474845 shutdown_connections 2024-09-15T23:18:42.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.944+0000 7fa41825e640 1 --2- 172.21.15.123:0/2410474845 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa41015ed20 0x7fa4101e72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.944+0000 7fa41825e640 1 --2- 172.21.15.123:0/2410474845 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa3fc06c2b0 0x7fa3fc06e770 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.944+0000 7fa41825e640 1 --2- 172.21.15.123:0/2410474845 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4100d23b0 0x7fa410160c90 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.944+0000 7fa41825e640 1 --2- 172.21.15.123:0/2410474845 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4100cf2d0 0x7fa41014a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:42.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.944+0000 7fa41825e640 1 -- 172.21.15.123:0/2410474845 >> 172.21.15.123:0/2410474845 conn(0x7fa4100d1260 msgr2=0x7fa4100cf700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:42.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.944+0000 7fa41825e640 1 -- 172.21.15.123:0/2410474845 shutdown_connections 2024-09-15T23:18:42.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:42.944+0000 7fa41825e640 1 -- 172.21.15.123:0/2410474845 wait complete. 2024-09-15T23:18:42.956 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-15T23:18:42.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:18:42.956 DEBUG:teuthology.orchestra.run.smithi123:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-15T23:18:42.997 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-09-15T23:18:42.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:18:42.997 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T23:18:43.053 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:18:43.054 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:18:43.054 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:18:43.072 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:18:43.072 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:18:43.072 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:18:43.072 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:18:43.110 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:18:43.110 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:18:43.110 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:18:43.110 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:18:43.129 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:18:43.129 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:18:43.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.247+0000 7fa1f04ed640 1 Processor -- start 2024-09-15T23:18:43.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.247+0000 7fa1f04ed640 1 -- start start 2024-09-15T23:18:43.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.248+0000 7fa1f04ed640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa1e815c4b0 0x7fa1e80b6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:43.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.248+0000 7fa1f04ed640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1e80b02b0 0x7fa1e80b6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:43.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.248+0000 7fa1f04ed640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1e8067b50 con 0x7fa1e80d08e0 2024-09-15T23:18:43.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.248+0000 7fa1f04ed640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fa1e80ce860 con 0x7fa1e815c4b0 2024-09-15T23:18:43.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.248+0000 7fa1f04ed640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e8070130 con 0x7fa1e80b02b0 2024-09-15T23:18:43.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.248+0000 7fa1ee289640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa1e815c4b0 0x7fa1e80b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:43.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.248+0000 7fa1ee289640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa1e815c4b0 0x7fa1e80b6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50820/0 (socket says 172.21.15.123:50820) 2024-09-15T23:18:43.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.248+0000 7fa1ee289640 1 -- 172.21.15.123:0/3933302572 learned_addr learned my addr 172.21.15.123:0/3933302572 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:43.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.248+0000 7fa1ee289640 1 -- 172.21.15.123:0/3933302572 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1e80b02b0 msgr2=0x7fa1e80b6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:43.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.248+0000 7fa1ee289640 1 --2- 172.21.15.123:0/3933302572 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1e80b02b0 0x7fa1e80b6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:43.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.248+0000 7fa1ee289640 1 -- 172.21.15.123:0/3933302572 >> v1:172.21.15.188:6789/0 conn(0x7fa1e80d08e0 legacy=0x7fa1e8160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:43.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.248+0000 7fa1ee289640 1 -- 172.21.15.123:0/3933302572 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e806fe50 con 0x7fa1e815c4b0 2024-09-15T23:18:43.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.249+0000 7fa1ee289640 1 --2- 172.21.15.123:0/3933302572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1e815c4b0 0x7fa1e80b6120 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4009e50 tx=0x7fa1e402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e670c0844f1ef0aa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:43.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.249+0000 7fa1ed287640 1 -- 172.21.15.123:0/3933302572 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4036070 con 0x7fa1e815c4b0 2024-09-15T23:18:43.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.249+0000 7fa1ed287640 1 -- 172.21.15.123:0/3933302572 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1e4031600 con 0x7fa1e815c4b0 2024-09-15T23:18:43.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.249+0000 7fa1ed287640 1 -- 172.21.15.123:0/3933302572 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e40319d0 con 0x7fa1e815c4b0 2024-09-15T23:18:43.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.250+0000 7fa1f04ed640 1 -- 172.21.15.123:0/3933302572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1e815c4b0 msgr2=0x7fa1e80b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:43.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.250+0000 7fa1f04ed640 1 --2- 172.21.15.123:0/3933302572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1e815c4b0 0x7fa1e80b6120 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4009e50 tx=0x7fa1e402a6c0 comp rx=0 tx=0).stop 2024-09-15T23:18:43.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.250+0000 7fa1f04ed640 1 -- 172.21.15.123:0/3933302572 shutdown_connections 2024-09-15T23:18:43.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.250+0000 7fa1f04ed640 1 --2- 172.21.15.123:0/3933302572 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1e80b02b0 0x7fa1e80b6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:43.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.250+0000 7fa1f04ed640 1 --2- 172.21.15.123:0/3933302572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1e815c4b0 0x7fa1e80b6120 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:43.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.250+0000 7fa1f04ed640 1 -- 172.21.15.123:0/3933302572 >> 172.21.15.123:0/3933302572 conn(0x7fa1e80b0a80 msgr2=0x7fa1e80b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:43.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.250+0000 7fa1f04ed640 1 -- 172.21.15.123:0/3933302572 shutdown_connections 2024-09-15T23:18:43.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.250+0000 7fa1f04ed640 1 -- 172.21.15.123:0/3933302572 wait complete. 2024-09-15T23:18:43.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.251+0000 7fa1f04ed640 1 Processor -- start 2024-09-15T23:18:43.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.251+0000 7fa1f04ed640 1 -- start start 2024-09-15T23:18:43.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.252+0000 7fa1f04ed640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa1e80b02b0 0x7fa1e815b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:43.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.252+0000 7fa1f04ed640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1e80d08e0 0x7fa1e80b59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:43.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.252+0000 7fa1f04ed640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1e815c4b0 0x7fa1e8146020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:43.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.252+0000 7fa1f04ed640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e806dcc0 con 0x7fa1e815c4b0 2024-09-15T23:18:43.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.252+0000 7fa1f04ed640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e80ce580 con 0x7fa1e80b02b0 2024-09-15T23:18:43.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.252+0000 7fa1f04ed640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e815c890 con 0x7fa1e80d08e0 2024-09-15T23:18:43.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.252+0000 7fa1eea8a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1e815c4b0 0x7fa1e8146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:43.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.252+0000 7fa1eea8a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1e815c4b0 0x7fa1e8146020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50832/0 (socket says 172.21.15.123:50832) 2024-09-15T23:18:43.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.252+0000 7fa1eea8a640 1 -- 172.21.15.123:0/2446733382 learned_addr learned my addr 172.21.15.123:0/2446733382 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:43.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.252+0000 7fa1eda88640 1 --2- 172.21.15.123:0/2446733382 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1e80d08e0 0x7fa1e80b59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:43.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.252+0000 7fa1ee289640 1 --2- 172.21.15.123:0/2446733382 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa1e80b02b0 0x7fa1e815b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:43.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.252+0000 7fa1eea8a640 1 -- 172.21.15.123:0/2446733382 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1e80d08e0 msgr2=0x7fa1e80b59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:43.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.252+0000 7fa1eea8a640 1 --2- 172.21.15.123:0/2446733382 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1e80d08e0 0x7fa1e80b59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:43.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.252+0000 7fa1eea8a640 1 -- 172.21.15.123:0/2446733382 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa1e80b02b0 msgr2=0x7fa1e815b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:43.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.252+0000 7fa1eea8a640 1 --2- 172.21.15.123:0/2446733382 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa1e80b02b0 0x7fa1e815b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:43.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.252+0000 7fa1eea8a640 1 -- 172.21.15.123:0/2446733382 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e80b5f20 con 0x7fa1e815c4b0 2024-09-15T23:18:43.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.252+0000 7fa1eda88640 1 --2- 172.21.15.123:0/2446733382 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1e80d08e0 0x7fa1e80b59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:18:43.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.253+0000 7fa1eea8a640 1 --2- 172.21.15.123:0/2446733382 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1e815c4b0 0x7fa1e8146020 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fa1e000c390 tx=0x7fa1e000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:43.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.253+0000 7fa1deffd640 1 -- 172.21.15.123:0/2446733382 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e0017070 con 0x7fa1e815c4b0 2024-09-15T23:18:43.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.253+0000 7fa1deffd640 1 -- 172.21.15.123:0/2446733382 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1e00035f0 con 0x7fa1e815c4b0 2024-09-15T23:18:43.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.253+0000 7fa1deffd640 1 -- 172.21.15.123:0/2446733382 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e00039e0 con 0x7fa1e815c4b0 2024-09-15T23:18:43.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.253+0000 7fa1f04ed640 1 -- 172.21.15.123:0/2446733382 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1e8146560 con 0x7fa1e815c4b0 2024-09-15T23:18:43.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.253+0000 7fa1f04ed640 1 -- 172.21.15.123:0/2446733382 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1e80b4c20 con 0x7fa1e815c4b0 2024-09-15T23:18:43.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.254+0000 7fa1f04ed640 1 -- 172.21.15.123:0/2446733382 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1e80b6120 con 0x7fa1e815c4b0 2024-09-15T23:18:43.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.254+0000 7fa1deffd640 1 -- 172.21.15.123:0/2446733382 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa1e001a070 con 0x7fa1e815c4b0 2024-09-15T23:18:43.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.255+0000 7fa1deffd640 1 --2- 172.21.15.123:0/2446733382 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa1cc06c2b0 0x7fa1cc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:43.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.255+0000 7fa1deffd640 1 -- 172.21.15.123:0/2446733382 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5795+0+0 (secure 0 0 0) 0x7fa1e008a7f0 con 0x7fa1e815c4b0 2024-09-15T23:18:43.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.255+0000 7fa1ee289640 1 --2- 172.21.15.123:0/2446733382 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa1cc06c2b0 0x7fa1cc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:43.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.256+0000 7fa1ee289640 1 --2- 172.21.15.123:0/2446733382 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa1cc06c2b0 0x7fa1cc06e770 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4033000 tx=0x7fa1e4009000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:43.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.259+0000 7fa1deffd640 1 -- 172.21.15.123:0/2446733382 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa1e0058f90 con 0x7fa1e815c4b0 2024-09-15T23:18:43.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.460+0000 7fa1f04ed640 1 -- 172.21.15.123:0/2446733382 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa1e8071e90 con 0x7fa1e815c4b0 2024-09-15T23:18:43.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.460+0000 7fa1deffd640 1 -- 172.21.15.123:0/2446733382 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5237 (secure 0 0 0) 0x7fa1e0058890 con 0x7fa1e815c4b0 2024-09-15T23:18:43.462 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:18:43.462 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":74,"btime":"2024-09-15T23:17:25:298017+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6158,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/3864460389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3864460389},{"type":"v1","addr":"172.21.15.188:6836","nonce":3864460389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":6769,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2483934450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2483934450},{"type":"v1","addr":"172.21.15.188:6837","nonce":2483934450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7605,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/1769288917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":1769288917},{"type":"v1","addr":"172.21.15.123:6834","nonce":1769288917}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-15T23:17:13.443625+0000","modified":"2024-09-15T23:17:24.551458+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7608},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7608":{"gid":7608,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/3823805081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":3823805081},{"type":"v1","addr":"172.21.15.123:6835","nonce":3823805081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7608,"qdb_cluster":[7608]},"id":7}]} 2024-09-15T23:18:43.462 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 74 2024-09-15T23:18:43.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.462+0000 7fa1f04ed640 1 -- 172.21.15.123:0/2446733382 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa1cc06c2b0 msgr2=0x7fa1cc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:43.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.462+0000 7fa1f04ed640 1 --2- 172.21.15.123:0/2446733382 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa1cc06c2b0 0x7fa1cc06e770 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4033000 tx=0x7fa1e4009000 comp rx=0 tx=0).stop 2024-09-15T23:18:43.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.462+0000 7fa1f04ed640 1 -- 172.21.15.123:0/2446733382 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1e815c4b0 msgr2=0x7fa1e8146020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:43.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.462+0000 7fa1f04ed640 1 --2- 172.21.15.123:0/2446733382 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1e815c4b0 0x7fa1e8146020 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fa1e000c390 tx=0x7fa1e000c850 comp rx=0 tx=0).stop 2024-09-15T23:18:43.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.462+0000 7fa1f04ed640 1 -- 172.21.15.123:0/2446733382 shutdown_connections 2024-09-15T23:18:43.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.462+0000 7fa1f04ed640 1 --2- 172.21.15.123:0/2446733382 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa1cc06c2b0 0x7fa1cc06e770 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:43.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.462+0000 7fa1f04ed640 1 --2- 172.21.15.123:0/2446733382 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1e815c4b0 0x7fa1e8146020 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:43.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.462+0000 7fa1f04ed640 1 --2- 172.21.15.123:0/2446733382 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1e80d08e0 0x7fa1e80b59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:43.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.462+0000 7fa1f04ed640 1 --2- 172.21.15.123:0/2446733382 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa1e80b02b0 0x7fa1e815b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:43.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.462+0000 7fa1f04ed640 1 -- 172.21.15.123:0/2446733382 >> 172.21.15.123:0/2446733382 conn(0x7fa1e80b0a80 msgr2=0x7fa1e81519a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:43.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.462+0000 7fa1f04ed640 1 -- 172.21.15.123:0/2446733382 shutdown_connections 2024-09-15T23:18:43.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.462+0000 7fa1f04ed640 1 -- 172.21.15.123:0/2446733382 wait complete. 2024-09-15T23:18:43.474 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:18:43.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.571+0000 7f50224ba640 1 Processor -- start 2024-09-15T23:18:43.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.571+0000 7f50224ba640 1 -- start start 2024-09-15T23:18:43.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.571+0000 7f50224ba640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f501c0b6970 0x7f501c0b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:43.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.572+0000 7f50224ba640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f501c0d0e70 con 0x7f501c0d23b0 2024-09-15T23:18:43.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.572+0000 7f50224ba640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f501c0d41c0 con 0x7f501c15ed20 2024-09-15T23:18:43.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.572+0000 7f50224ba640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f501c0d35b0 con 0x7f501c0b6970 2024-09-15T23:18:43.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.572+0000 7f5020a57640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f501c0d23b0 0x7f501c0b8610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35706/0 (socket says 172.21.15.123:35706) 2024-09-15T23:18:43.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.572+0000 7f5020a57640 1 -- 172.21.15.123:0/3707578686 learned_addr learned my addr 172.21.15.123:0/3707578686 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:18:43.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.572+0000 7f501b7fe640 1 --2- 172.21.15.123:0/3707578686 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f501c0b6970 0x7f501c0b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:43.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.572+0000 7f501affd640 1 -- 172.21.15.123:0/3707578686 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3236104967 0 0) 0x7f5014001490 con 0x7f501c0d23b0 2024-09-15T23:18:43.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.572+0000 7f501affd640 1 -- 172.21.15.123:0/3707578686 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5004003520 con 0x7f501c0d23b0 2024-09-15T23:18:43.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.572+0000 7f501affd640 1 -- 172.21.15.123:0/3707578686 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1451624339 0 0) 0x7f5004003520 con 0x7f501c0d23b0 2024-09-15T23:18:43.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.572+0000 7f501affd640 1 -- 172.21.15.123:0/3707578686 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f501c0b6970 msgr2=0x7f501c0b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:43.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.572+0000 7f501affd640 1 --2- 172.21.15.123:0/3707578686 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f501c0b6970 0x7f501c0b80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:43.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.572+0000 7f501affd640 1 -- 172.21.15.123:0/3707578686 >> v1:172.21.15.188:6789/0 conn(0x7f501c15ed20 legacy=0x7f501c0b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:43.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.572+0000 7f501affd640 1 -- 172.21.15.123:0/3707578686 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f501c0d3890 con 0x7f501c0d23b0 2024-09-15T23:18:43.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.572+0000 7f501affd640 1 -- 172.21.15.123:0/3707578686 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f5014001bc0 con 0x7f501c0d23b0 2024-09-15T23:18:43.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.572+0000 7f501affd640 1 -- 172.21.15.123:0/3707578686 >> v1:172.21.15.123:6789/0 conn(0x7f501c0d23b0 legacy=0x7f501c0b8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:43.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.572+0000 7f501affd640 1 --2- 172.21.15.123:0/3707578686 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f501c0b6970 0x7f50040039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:43.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.572+0000 7f501affd640 1 --2- 172.21.15.123:0/3707578686 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5004003f20 0x7f5004004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:43.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.572+0000 7f501affd640 1 --2- 172.21.15.123:0/3707578686 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5004004d40 0x7f50040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:43.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.572+0000 7f501affd640 1 -- 172.21.15.123:0/3707578686 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f501c0d35b0 con 0x7f5004004d40 2024-09-15T23:18:43.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.572+0000 7f501affd640 1 -- 172.21.15.123:0/3707578686 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f500400bb00 con 0x7f5004003f20 2024-09-15T23:18:43.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.572+0000 7f501affd640 1 -- 172.21.15.123:0/3707578686 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f500400bd00 con 0x7f501c0b6970 2024-09-15T23:18:43.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.572+0000 7f5020a57640 1 --2- 172.21.15.123:0/3707578686 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5004004d40 0x7f50040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:43.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.572+0000 7f501bfff640 1 --2- 172.21.15.123:0/3707578686 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f501c0b6970 0x7f50040039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:43.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.572+0000 7f501b7fe640 1 --2- 172.21.15.123:0/3707578686 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5004003f20 0x7f5004004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:43.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.573+0000 7f5020a57640 1 -- 172.21.15.123:0/3707578686 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f501c0b6970 msgr2=0x7f50040039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:43.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.573+0000 7f5020a57640 1 --2- 172.21.15.123:0/3707578686 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f501c0b6970 0x7f50040039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:43.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.573+0000 7f5020a57640 1 -- 172.21.15.123:0/3707578686 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5004003f20 msgr2=0x7f5004004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:43.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.573+0000 7f5020a57640 1 --2- 172.21.15.123:0/3707578686 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5004003f20 0x7f5004004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:43.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.573+0000 7f5020a57640 1 -- 172.21.15.123:0/3707578686 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5004003520 con 0x7f5004004d40 2024-09-15T23:18:43.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.573+0000 7f5020a57640 1 --2- 172.21.15.123:0/3707578686 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5004004d40 0x7f50040051c0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f501400a9a0 tx=0x7f5004005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44a34f3968fb59a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:43.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.573+0000 7f501affd640 1 -- 172.21.15.123:0/3707578686 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501400a5c0 con 0x7f5004004d40 2024-09-15T23:18:43.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.573+0000 7f501affd640 1 -- 172.21.15.123:0/3707578686 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f501402f070 con 0x7f5004004d40 2024-09-15T23:18:43.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.574+0000 7f501affd640 1 -- 172.21.15.123:0/3707578686 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501402be20 con 0x7f5004004d40 2024-09-15T23:18:43.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.574+0000 7f50224ba640 1 -- 172.21.15.123:0/3707578686 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5004004d40 msgr2=0x7f50040051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:43.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.574+0000 7f50224ba640 1 --2- 172.21.15.123:0/3707578686 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5004004d40 0x7f50040051c0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f501400a9a0 tx=0x7f5004005830 comp rx=0 tx=0).stop 2024-09-15T23:18:43.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.574+0000 7f5020a57640 1 -- 172.21.15.123:0/3707578686 reap_dead start 2024-09-15T23:18:43.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.574+0000 7f50224ba640 1 -- 172.21.15.123:0/3707578686 shutdown_connections 2024-09-15T23:18:43.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.574+0000 7f50224ba640 1 -- 172.21.15.123:0/3707578686 >> 172.21.15.123:0/3707578686 conn(0x7f501c0d1260 msgr2=0x7f501c0d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:43.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.574+0000 7f50224ba640 1 -- 172.21.15.123:0/3707578686 shutdown_connections 2024-09-15T23:18:43.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.574+0000 7f50224ba640 1 -- 172.21.15.123:0/3707578686 wait complete. 2024-09-15T23:18:43.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.575+0000 7f50224ba640 1 Processor -- start 2024-09-15T23:18:43.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.575+0000 7f50224ba640 1 -- start start 2024-09-15T23:18:43.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.576+0000 7f50224ba640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5004004d40 0x7f501c154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:43.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.576+0000 7f50224ba640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f501c0cb8b0 0x7f501c155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:43.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.576+0000 7f50224ba640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f501c155b70 0x7f501c0ce160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:43.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.576+0000 7f50224ba640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f501c0d32a0 con 0x7f5004004d40 2024-09-15T23:18:43.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.576+0000 7f50224ba640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f501c0d3e50 con 0x7f501c0cb8b0 2024-09-15T23:18:43.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.576+0000 7f50224ba640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f501c15f100 con 0x7f501c155b70 2024-09-15T23:18:43.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.576+0000 7f501bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5004004d40 0x7f501c154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:43.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.576+0000 7f501bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5004004d40 0x7f501c154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50846/0 (socket says 172.21.15.123:50846) 2024-09-15T23:18:43.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.576+0000 7f501bfff640 1 -- 172.21.15.123:0/3511680260 learned_addr learned my addr 172.21.15.123:0/3511680260 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:43.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.576+0000 7f501bfff640 1 -- 172.21.15.123:0/3511680260 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f501c155b70 msgr2=0x7f501c0ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:43.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.576+0000 7f501b7fe640 1 --2- 172.21.15.123:0/3511680260 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f501c0cb8b0 0x7f501c155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:43.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.576+0000 7f5020a57640 1 --2- 172.21.15.123:0/3511680260 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f501c155b70 0x7f501c0ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:43.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.576+0000 7f501bfff640 1 --2- 172.21.15.123:0/3511680260 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f501c155b70 0x7f501c0ce160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:43.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.576+0000 7f501bfff640 1 -- 172.21.15.123:0/3511680260 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f501c0cb8b0 msgr2=0x7f501c155630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:43.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.576+0000 7f501bfff640 1 --2- 172.21.15.123:0/3511680260 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f501c0cb8b0 0x7f501c155630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:43.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.577+0000 7f501bfff640 1 -- 172.21.15.123:0/3511680260 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f501c156080 con 0x7f5004004d40 2024-09-15T23:18:43.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.577+0000 7f501bfff640 1 --2- 172.21.15.123:0/3511680260 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5004004d40 0x7f501c154830 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f500c00f770 tx=0x7f500c00fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:43.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.577+0000 7f5018ff9640 1 -- 172.21.15.123:0/3511680260 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500c00fe80 con 0x7f5004004d40 2024-09-15T23:18:43.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.577+0000 7f5018ff9640 1 -- 172.21.15.123:0/3511680260 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f500c018070 con 0x7f5004004d40 2024-09-15T23:18:43.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.577+0000 7f5018ff9640 1 -- 172.21.15.123:0/3511680260 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f500c00d730 con 0x7f5004004d40 2024-09-15T23:18:43.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.577+0000 7f50224ba640 1 -- 172.21.15.123:0/3511680260 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f501c156360 con 0x7f5004004d40 2024-09-15T23:18:43.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.577+0000 7f50224ba640 1 -- 172.21.15.123:0/3511680260 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f501c154d70 con 0x7f5004004d40 2024-09-15T23:18:43.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.578+0000 7f50224ba640 1 -- 172.21.15.123:0/3511680260 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f501c0b7010 con 0x7f5004004d40 2024-09-15T23:18:43.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.578+0000 7f5018ff9640 1 -- 172.21.15.123:0/3511680260 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f500c00d8d0 con 0x7f5004004d40 2024-09-15T23:18:43.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.579+0000 7f5018ff9640 1 --2- 172.21.15.123:0/3511680260 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f500806c2b0 0x7f500806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:43.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.579+0000 7f5018ff9640 1 -- 172.21.15.123:0/3511680260 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5795+0+0 (secure 0 0 0) 0x7f500c08b380 con 0x7f5004004d40 2024-09-15T23:18:43.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.579+0000 7f501b7fe640 1 --2- 172.21.15.123:0/3511680260 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f500806c2b0 0x7f500806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:43.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.579+0000 7f501b7fe640 1 --2- 172.21.15.123:0/3511680260 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f500806c2b0 0x7f500806e770 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f501c0b36e0 tx=0x7f5010008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:43.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.583+0000 7f5018ff9640 1 -- 172.21.15.123:0/3511680260 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f500c059b20 con 0x7f5004004d40 2024-09-15T23:18:43.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.782+0000 7f50224ba640 1 -- 172.21.15.123:0/3511680260 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f501c0b3f20 con 0x7f5004004d40 2024-09-15T23:18:43.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.783+0000 7f5018ff9640 1 -- 172.21.15.123:0/3511680260 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5237 (secure 0 0 0) 0x7f500c059420 con 0x7f5004004d40 2024-09-15T23:18:43.784 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:18:43.784 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":74,"btime":"2024-09-15T23:17:25:298017+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6158,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/3864460389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3864460389},{"type":"v1","addr":"172.21.15.188:6836","nonce":3864460389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":6769,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2483934450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2483934450},{"type":"v1","addr":"172.21.15.188:6837","nonce":2483934450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7605,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/1769288917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":1769288917},{"type":"v1","addr":"172.21.15.123:6834","nonce":1769288917}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-15T23:17:13.443625+0000","modified":"2024-09-15T23:17:24.551458+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7608},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7608":{"gid":7608,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/3823805081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":3823805081},{"type":"v1","addr":"172.21.15.123:6835","nonce":3823805081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7608,"qdb_cluster":[7608]},"id":7}]} 2024-09-15T23:18:43.785 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 74 2024-09-15T23:18:43.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.785+0000 7f50224ba640 1 -- 172.21.15.123:0/3511680260 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f500806c2b0 msgr2=0x7f500806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:43.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.785+0000 7f50224ba640 1 --2- 172.21.15.123:0/3511680260 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f500806c2b0 0x7f500806e770 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f501c0b36e0 tx=0x7f5010008040 comp rx=0 tx=0).stop 2024-09-15T23:18:43.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.785+0000 7f50224ba640 1 -- 172.21.15.123:0/3511680260 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5004004d40 msgr2=0x7f501c154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:43.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.785+0000 7f50224ba640 1 --2- 172.21.15.123:0/3511680260 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5004004d40 0x7f501c154830 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f500c00f770 tx=0x7f500c00fc30 comp rx=0 tx=0).stop 2024-09-15T23:18:43.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.785+0000 7f50224ba640 1 -- 172.21.15.123:0/3511680260 shutdown_connections 2024-09-15T23:18:43.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.785+0000 7f50224ba640 1 --2- 172.21.15.123:0/3511680260 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f501c155b70 0x7f501c0ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:43.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.785+0000 7f50224ba640 1 --2- 172.21.15.123:0/3511680260 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f501c0cb8b0 0x7f501c155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:43.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.785+0000 7f50224ba640 1 --2- 172.21.15.123:0/3511680260 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f500806c2b0 0x7f500806e770 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:43.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.785+0000 7f50224ba640 1 --2- 172.21.15.123:0/3511680260 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5004004d40 0x7f501c154830 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:43.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.785+0000 7f50224ba640 1 -- 172.21.15.123:0/3511680260 >> 172.21.15.123:0/3511680260 conn(0x7f501c0d1260 msgr2=0x7f501c0b51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:43.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.785+0000 7f50224ba640 1 -- 172.21.15.123:0/3511680260 shutdown_connections 2024-09-15T23:18:43.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.785+0000 7f50224ba640 1 -- 172.21.15.123:0/3511680260 wait complete. 2024-09-15T23:18:43.797 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:18:43.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.894+0000 7f6ede313640 1 Processor -- start 2024-09-15T23:18:43.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.894+0000 7f6ede313640 1 -- start start 2024-09-15T23:18:43.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.895+0000 7f6ede313640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ed80b2d40 0x7f6ed806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:43.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.895+0000 7f6ede313640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6ed813eb20 0x7f6ed806c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:43.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.895+0000 7f6ede313640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f6ed815bcf0 0x7f6ed815c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:43.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.895+0000 7f6ede313640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f6ed8071ab0 con 0x7f6ed813eb20 2024-09-15T23:18:43.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.895+0000 7f6ede313640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f6ed8071180 con 0x7f6ed815bcf0 2024-09-15T23:18:43.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.895+0000 7f6ede313640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6ed8071460 con 0x7f6ed80b2d40 2024-09-15T23:18:43.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.895+0000 7f6ed77fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6ed813eb20 0x7f6ed806c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:43.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.895+0000 7f6ed77fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6ed813eb20 0x7f6ed806c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50848/0 (socket says 172.21.15.123:50848) 2024-09-15T23:18:43.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.895+0000 7f6ed77fe640 1 -- 172.21.15.123:0/1702136301 learned_addr learned my addr 172.21.15.123:0/1702136301 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:43.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.895+0000 7f6edc8b0640 1 --2- 172.21.15.123:0/1702136301 >> v2:172.21.15.188:3300/0 conn(0x7f6ed815bcf0 0x7f6ed815c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:43.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.896+0000 7f6ed7fff640 1 --2- 172.21.15.123:0/1702136301 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ed80b2d40 0x7f6ed806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:43.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.896+0000 7f6ed77fe640 1 -- 172.21.15.123:0/1702136301 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ed80b2d40 msgr2=0x7f6ed806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:43.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.896+0000 7f6ed77fe640 1 --2- 172.21.15.123:0/1702136301 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ed80b2d40 0x7f6ed806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:43.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.896+0000 7f6ed77fe640 1 -- 172.21.15.123:0/1702136301 >> v2:172.21.15.188:3300/0 conn(0x7f6ed815bcf0 msgr2=0x7f6ed815c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:43.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.896+0000 7f6ed77fe640 1 --2- 172.21.15.123:0/1702136301 >> v2:172.21.15.188:3300/0 conn(0x7f6ed815bcf0 0x7f6ed815c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:43.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.896+0000 7f6ed77fe640 1 -- 172.21.15.123:0/1702136301 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ed8071740 con 0x7f6ed813eb20 2024-09-15T23:18:43.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.896+0000 7f6edc8b0640 1 --2- 172.21.15.123:0/1702136301 >> v2:172.21.15.188:3300/0 conn(0x7f6ed815bcf0 0x7f6ed815c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:18:43.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.896+0000 7f6ed77fe640 1 --2- 172.21.15.123:0/1702136301 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ed813eb20 0x7f6ed806c150 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f6ed81595c0 tx=0x7f6ecc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d37a8472d6a192 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:43.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.897+0000 7f6ed6ffd640 1 -- 172.21.15.123:0/1702136301 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc037070 con 0x7f6ed813eb20 2024-09-15T23:18:43.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.897+0000 7f6ed6ffd640 1 -- 172.21.15.123:0/1702136301 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ecc032440 con 0x7f6ed813eb20 2024-09-15T23:18:43.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.897+0000 7f6ed6ffd640 1 -- 172.21.15.123:0/1702136301 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc032810 con 0x7f6ed813eb20 2024-09-15T23:18:43.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.897+0000 7f6ede313640 1 -- 172.21.15.123:0/1702136301 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ed813eb20 msgr2=0x7f6ed806c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:43.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.897+0000 7f6ede313640 1 --2- 172.21.15.123:0/1702136301 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ed813eb20 0x7f6ed806c150 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f6ed81595c0 tx=0x7f6ecc02a1e0 comp rx=0 tx=0).stop 2024-09-15T23:18:43.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.897+0000 7f6ede313640 1 -- 172.21.15.123:0/1702136301 shutdown_connections 2024-09-15T23:18:43.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.897+0000 7f6ede313640 1 --2- 172.21.15.123:0/1702136301 >> v2:172.21.15.188:3300/0 conn(0x7f6ed815bcf0 0x7f6ed815c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:43.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.897+0000 7f6ede313640 1 --2- 172.21.15.123:0/1702136301 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ed813eb20 0x7f6ed806c150 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:43.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.897+0000 7f6ede313640 1 --2- 172.21.15.123:0/1702136301 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ed80b2d40 0x7f6ed806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:43.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.897+0000 7f6ede313640 1 -- 172.21.15.123:0/1702136301 >> 172.21.15.123:0/1702136301 conn(0x7f6ed80ccec0 msgr2=0x7f6ed80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:43.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.897+0000 7f6ede313640 1 -- 172.21.15.123:0/1702136301 shutdown_connections 2024-09-15T23:18:43.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.897+0000 7f6ede313640 1 -- 172.21.15.123:0/1702136301 wait complete. 2024-09-15T23:18:43.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.898+0000 7f6ede313640 1 Processor -- start 2024-09-15T23:18:43.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.899+0000 7f6ede313640 1 -- start start 2024-09-15T23:18:43.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.899+0000 7f6ede313640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ed80b2d40 0x7f6ed81f15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:43.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.899+0000 7f6ede313640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ed813eb20 0x7f6ed8156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:43.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.899+0000 7f6ede313640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ed815bcf0 0x7f6ed81572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:43.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.899+0000 7f6ede313640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed815f140 con 0x7f6ed80b2d40 2024-09-15T23:18:43.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.899+0000 7f6ede313640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed815efc0 con 0x7f6ed813eb20 2024-09-15T23:18:43.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.899+0000 7f6ede313640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6ed815f2c0 con 0x7f6ed815bcf0 2024-09-15T23:18:43.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.899+0000 7f6ed7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ed80b2d40 0x7f6ed81f15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:43.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.899+0000 7f6ed7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ed80b2d40 0x7f6ed81f15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50858/0 (socket says 172.21.15.123:50858) 2024-09-15T23:18:43.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.899+0000 7f6ed7fff640 1 -- 172.21.15.123:0/1772336538 learned_addr learned my addr 172.21.15.123:0/1772336538 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:43.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.899+0000 7f6edc8b0640 1 --2- 172.21.15.123:0/1772336538 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ed815bcf0 0x7f6ed81572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:43.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.899+0000 7f6ed77fe640 1 --2- 172.21.15.123:0/1772336538 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ed813eb20 0x7f6ed8156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:43.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.900+0000 7f6ed7fff640 1 -- 172.21.15.123:0/1772336538 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ed815bcf0 msgr2=0x7f6ed81572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:43.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.900+0000 7f6ed7fff640 1 --2- 172.21.15.123:0/1772336538 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ed815bcf0 0x7f6ed81572f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:43.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.900+0000 7f6ed7fff640 1 -- 172.21.15.123:0/1772336538 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ed813eb20 msgr2=0x7f6ed8156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:43.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.900+0000 7f6ed7fff640 1 --2- 172.21.15.123:0/1772336538 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ed813eb20 0x7f6ed8156db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:43.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.900+0000 7f6ed7fff640 1 -- 172.21.15.123:0/1772336538 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ed8155d50 con 0x7f6ed80b2d40 2024-09-15T23:18:43.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.900+0000 7f6ed77fe640 1 --2- 172.21.15.123:0/1772336538 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ed813eb20 0x7f6ed8156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:18:43.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.900+0000 7f6ed7fff640 1 --2- 172.21.15.123:0/1772336538 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ed80b2d40 0x7f6ed81f15d0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f6ec800fb00 tx=0x7f6ec80090e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:43.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.900+0000 7f6ed4ff9640 1 -- 172.21.15.123:0/1772336538 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec8009cc0 con 0x7f6ed80b2d40 2024-09-15T23:18:43.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.900+0000 7f6ed4ff9640 1 -- 172.21.15.123:0/1772336538 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ec8011450 con 0x7f6ed80b2d40 2024-09-15T23:18:43.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.900+0000 7f6ede313640 1 -- 172.21.15.123:0/1772336538 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ed8155ff0 con 0x7f6ed80b2d40 2024-09-15T23:18:43.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.900+0000 7f6ed4ff9640 1 -- 172.21.15.123:0/1772336538 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec8011840 con 0x7f6ed80b2d40 2024-09-15T23:18:43.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.900+0000 7f6ede313640 1 -- 172.21.15.123:0/1772336538 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ed81565b0 con 0x7f6ed80b2d40 2024-09-15T23:18:43.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.901+0000 7f6ede313640 1 -- 172.21.15.123:0/1772336538 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ed815c1a0 con 0x7f6ed80b2d40 2024-09-15T23:18:43.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.901+0000 7f6ed4ff9640 1 -- 172.21.15.123:0/1772336538 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6ec80119e0 con 0x7f6ed80b2d40 2024-09-15T23:18:43.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.902+0000 7f6ed4ff9640 1 --2- 172.21.15.123:0/1772336538 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6ec406c2b0 0x7f6ec406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:43.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.902+0000 7f6ed4ff9640 1 -- 172.21.15.123:0/1772336538 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5795+0+0 (secure 0 0 0) 0x7f6ec808d9d0 con 0x7f6ed80b2d40 2024-09-15T23:18:43.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.902+0000 7f6ed77fe640 1 --2- 172.21.15.123:0/1772336538 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6ec406c2b0 0x7f6ec406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:43.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.903+0000 7f6ed77fe640 1 --2- 172.21.15.123:0/1772336538 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6ec406c2b0 0x7f6ec406e770 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc034000 tx=0x7f6ecc02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:43.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:43.906+0000 7f6ed4ff9640 1 -- 172.21.15.123:0/1772336538 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6ec805c170 con 0x7f6ed80b2d40 2024-09-15T23:18:44.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.072+0000 7f6ede313640 1 -- 172.21.15.123:0/1772336538 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6ed806c9c0 con 0x7f6ed80b2d40 2024-09-15T23:18:44.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.073+0000 7f6ed4ff9640 1 -- 172.21.15.123:0/1772336538 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) ==== 74+0+16867 (secure 0 0 0) 0x7f6ec805ba70 con 0x7f6ed80b2d40 2024-09-15T23:18:44.075 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:18:44.075 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":118,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:18:24.272784+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:17:12.056649+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-15T23:17:12.415562+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":117,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.f","mappings":[{"from":5,"to":0}]},{"pgid":"14.1e","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:18:44.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.076+0000 7f6ede313640 1 -- 172.21.15.123:0/1772336538 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6ec406c2b0 msgr2=0x7f6ec406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:44.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.076+0000 7f6ede313640 1 --2- 172.21.15.123:0/1772336538 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6ec406c2b0 0x7f6ec406e770 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc034000 tx=0x7f6ecc02e000 comp rx=0 tx=0).stop 2024-09-15T23:18:44.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.076+0000 7f6ede313640 1 -- 172.21.15.123:0/1772336538 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ed80b2d40 msgr2=0x7f6ed81f15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:44.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.076+0000 7f6ede313640 1 --2- 172.21.15.123:0/1772336538 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ed80b2d40 0x7f6ed81f15d0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f6ec800fb00 tx=0x7f6ec80090e0 comp rx=0 tx=0).stop 2024-09-15T23:18:44.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.076+0000 7f6ede313640 1 -- 172.21.15.123:0/1772336538 shutdown_connections 2024-09-15T23:18:44.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.076+0000 7f6ede313640 1 --2- 172.21.15.123:0/1772336538 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ed815bcf0 0x7f6ed81572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:44.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.076+0000 7f6ede313640 1 --2- 172.21.15.123:0/1772336538 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ed813eb20 0x7f6ed8156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:44.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.076+0000 7f6ede313640 1 --2- 172.21.15.123:0/1772336538 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6ec406c2b0 0x7f6ec406e770 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:44.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.076+0000 7f6ede313640 1 --2- 172.21.15.123:0/1772336538 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ed80b2d40 0x7f6ed81f15d0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:44.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.076+0000 7f6ede313640 1 -- 172.21.15.123:0/1772336538 >> 172.21.15.123:0/1772336538 conn(0x7f6ed80ccec0 msgr2=0x7f6ed80cd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:44.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.076+0000 7f6ede313640 1 -- 172.21.15.123:0/1772336538 shutdown_connections 2024-09-15T23:18:44.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.076+0000 7f6ede313640 1 -- 172.21.15.123:0/1772336538 wait complete. 2024-09-15T23:18:44.088 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T23:18:44.088 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:18:44.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.185+0000 7f2e25677640 1 Processor -- start 2024-09-15T23:18:44.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.185+0000 7f2e25677640 1 -- start start 2024-09-15T23:18:44.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.186+0000 7f2e25677640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2e2015e950 0x7f2e200d1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:44.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.186+0000 7f2e25677640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e200d1bd0 0x7f2e200cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:44.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.186+0000 7f2e25677640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e200d47e0 con 0x7f2e200cf7f0 2024-09-15T23:18:44.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.186+0000 7f2e25677640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f2e200d2040 con 0x7f2e2015e950 2024-09-15T23:18:44.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.186+0000 7f2e25677640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f2e2015ed30 con 0x7f2e200d1bd0 2024-09-15T23:18:44.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.186+0000 7f2e1effd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2e2015e950 0x7f2e200d1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:44.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.186+0000 7f2e1effd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2e2015e950 0x7f2e200d1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50870/0 (socket says 172.21.15.123:50870) 2024-09-15T23:18:44.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.186+0000 7f2e1effd640 1 -- 172.21.15.123:0/1013582329 learned_addr learned my addr 172.21.15.123:0/1013582329 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:44.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.187+0000 7f2e1e7fc640 1 --2- 172.21.15.123:0/1013582329 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e200d1bd0 0x7f2e200cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:44.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.187+0000 7f2e1effd640 1 -- 172.21.15.123:0/1013582329 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e200d1bd0 msgr2=0x7f2e200cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:44.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.187+0000 7f2e1effd640 1 --2- 172.21.15.123:0/1013582329 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e200d1bd0 0x7f2e200cf2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:44.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.187+0000 7f2e1effd640 1 -- 172.21.15.123:0/1013582329 >> v1:172.21.15.188:6789/0 conn(0x7f2e200cf7f0 legacy=0x7f2e200d26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:44.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.187+0000 7f2e1effd640 1 -- 172.21.15.123:0/1013582329 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e200d4a80 con 0x7f2e2015e950 2024-09-15T23:18:44.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.187+0000 7f2e1effd640 1 --2- 172.21.15.123:0/1013582329 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e2015e950 0x7f2e200d1690 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f2e200d5920 tx=0x7f2e1002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70747cb21d7cdd0c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:44.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.187+0000 7f2e1dffb640 1 -- 172.21.15.123:0/1013582329 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e10036070 con 0x7f2e2015e950 2024-09-15T23:18:44.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.188+0000 7f2e1dffb640 1 -- 172.21.15.123:0/1013582329 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e10031400 con 0x7f2e2015e950 2024-09-15T23:18:44.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.188+0000 7f2e1dffb640 1 -- 172.21.15.123:0/1013582329 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e100317d0 con 0x7f2e2015e950 2024-09-15T23:18:44.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.188+0000 7f2e25677640 1 -- 172.21.15.123:0/1013582329 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e2015e950 msgr2=0x7f2e200d1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:44.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.188+0000 7f2e25677640 1 --2- 172.21.15.123:0/1013582329 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e2015e950 0x7f2e200d1690 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f2e200d5920 tx=0x7f2e1002a610 comp rx=0 tx=0).stop 2024-09-15T23:18:44.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.188+0000 7f2e25677640 1 -- 172.21.15.123:0/1013582329 shutdown_connections 2024-09-15T23:18:44.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.188+0000 7f2e25677640 1 --2- 172.21.15.123:0/1013582329 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e200d1bd0 0x7f2e200cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:44.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.188+0000 7f2e25677640 1 --2- 172.21.15.123:0/1013582329 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e2015e950 0x7f2e200d1690 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:44.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.188+0000 7f2e25677640 1 -- 172.21.15.123:0/1013582329 >> 172.21.15.123:0/1013582329 conn(0x7f2e20067b30 msgr2=0x7f2e20067f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:44.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.188+0000 7f2e25677640 1 -- 172.21.15.123:0/1013582329 shutdown_connections 2024-09-15T23:18:44.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.188+0000 7f2e25677640 1 -- 172.21.15.123:0/1013582329 wait complete. 2024-09-15T23:18:44.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.189+0000 7f2e25677640 1 Processor -- start 2024-09-15T23:18:44.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.190+0000 7f2e25677640 1 -- start start 2024-09-15T23:18:44.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.190+0000 7f2e25677640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e200cf7f0 0x7f2e200cb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:44.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.190+0000 7f2e25677640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e200d1bd0 0x7f2e200cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:44.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.190+0000 7f2e25677640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e2015e950 0x7f2e200cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:44.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.190+0000 7f2e25677640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2e200cfc60 con 0x7f2e200d1bd0 2024-09-15T23:18:44.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.190+0000 7f2e25677640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2e200d5040 con 0x7f2e2015e950 2024-09-15T23:18:44.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.190+0000 7f2e25677640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f2e200cfde0 con 0x7f2e200cf7f0 2024-09-15T23:18:44.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.190+0000 7f2e1e7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e200d1bd0 0x7f2e200cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:44.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.190+0000 7f2e1e7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e200d1bd0 0x7f2e200cd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50878/0 (socket says 172.21.15.123:50878) 2024-09-15T23:18:44.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.190+0000 7f2e1e7fc640 1 -- 172.21.15.123:0/1496286432 learned_addr learned my addr 172.21.15.123:0/1496286432 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:44.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.191+0000 7f2e1f7fe640 1 --2- 172.21.15.123:0/1496286432 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e2015e950 0x7f2e200cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:44.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.191+0000 7f2e1effd640 1 --2- 172.21.15.123:0/1496286432 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e200cf7f0 0x7f2e200cb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:44.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.191+0000 7f2e1e7fc640 1 -- 172.21.15.123:0/1496286432 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e200cf7f0 msgr2=0x7f2e200cb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:44.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.191+0000 7f2e1e7fc640 1 --2- 172.21.15.123:0/1496286432 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e200cf7f0 0x7f2e200cb1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:44.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.191+0000 7f2e1e7fc640 1 -- 172.21.15.123:0/1496286432 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e2015e950 msgr2=0x7f2e200cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:44.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.191+0000 7f2e1e7fc640 1 --2- 172.21.15.123:0/1496286432 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e2015e950 0x7f2e200cdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:44.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.191+0000 7f2e1e7fc640 1 -- 172.21.15.123:0/1496286432 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e200cb710 con 0x7f2e200d1bd0 2024-09-15T23:18:44.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.191+0000 7f2e1effd640 1 --2- 172.21.15.123:0/1496286432 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e200cf7f0 0x7f2e200cb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:18:44.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.191+0000 7f2e1e7fc640 1 --2- 172.21.15.123:0/1496286432 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e200d1bd0 0x7f2e200cd9f0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400c7f0 tx=0x7f2e1400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:44.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.191+0000 7f2e077fe640 1 -- 172.21.15.123:0/1496286432 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e14015070 con 0x7f2e200d1bd0 2024-09-15T23:18:44.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.191+0000 7f2e077fe640 1 -- 172.21.15.123:0/1496286432 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e14004240 con 0x7f2e200d1bd0 2024-09-15T23:18:44.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.191+0000 7f2e25677640 1 -- 172.21.15.123:0/1496286432 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e2015fd40 con 0x7f2e200d1bd0 2024-09-15T23:18:44.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.191+0000 7f2e077fe640 1 -- 172.21.15.123:0/1496286432 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e14007620 con 0x7f2e200d1bd0 2024-09-15T23:18:44.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.191+0000 7f2e25677640 1 -- 172.21.15.123:0/1496286432 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e20160300 con 0x7f2e200d1bd0 2024-09-15T23:18:44.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.192+0000 7f2e25677640 1 -- 172.21.15.123:0/1496286432 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e200cf2b0 con 0x7f2e200d1bd0 2024-09-15T23:18:44.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.193+0000 7f2e077fe640 1 -- 172.21.15.123:0/1496286432 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2e140077c0 con 0x7f2e200d1bd0 2024-09-15T23:18:44.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.193+0000 7f2e077fe640 1 --2- 172.21.15.123:0/1496286432 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2e0c06c2b0 0x7f2e0c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:44.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.193+0000 7f2e077fe640 1 -- 172.21.15.123:0/1496286432 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5795+0+0 (secure 0 0 0) 0x7f2e1408b6a0 con 0x7f2e200d1bd0 2024-09-15T23:18:44.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.193+0000 7f2e1effd640 1 --2- 172.21.15.123:0/1496286432 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2e0c06c2b0 0x7f2e0c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:44.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.194+0000 7f2e1effd640 1 --2- 172.21.15.123:0/1496286432 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2e0c06c2b0 0x7f2e0c06e770 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f2e10033000 tx=0x7f2e10009000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:44.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.198+0000 7f2e077fe640 1 -- 172.21.15.123:0/1496286432 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2e14059db0 con 0x7f2e200d1bd0 2024-09-15T23:18:44.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.398+0000 7f2e25677640 1 -- 172.21.15.123:0/1496286432 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e200b7990 con 0x7f2e200d1bd0 2024-09-15T23:18:44.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.399+0000 7f2e077fe640 1 -- 172.21.15.123:0/1496286432 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5237 (secure 0 0 0) 0x7f2e140596b0 con 0x7f2e200d1bd0 2024-09-15T23:18:44.400 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:18:44.400 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":74,"btime":"2024-09-15T23:17:25:298017+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6158,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/3864460389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3864460389},{"type":"v1","addr":"172.21.15.188:6836","nonce":3864460389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":6769,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2483934450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2483934450},{"type":"v1","addr":"172.21.15.188:6837","nonce":2483934450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7605,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/1769288917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":1769288917},{"type":"v1","addr":"172.21.15.123:6834","nonce":1769288917}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-15T23:17:13.443625+0000","modified":"2024-09-15T23:17:24.551458+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7608},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7608":{"gid":7608,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/3823805081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":3823805081},{"type":"v1","addr":"172.21.15.123:6835","nonce":3823805081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7608,"qdb_cluster":[7608]},"id":7}]} 2024-09-15T23:18:44.401 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 74 2024-09-15T23:18:44.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.401+0000 7f2e25677640 1 -- 172.21.15.123:0/1496286432 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2e0c06c2b0 msgr2=0x7f2e0c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:44.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.401+0000 7f2e25677640 1 --2- 172.21.15.123:0/1496286432 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2e0c06c2b0 0x7f2e0c06e770 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f2e10033000 tx=0x7f2e10009000 comp rx=0 tx=0).stop 2024-09-15T23:18:44.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.401+0000 7f2e25677640 1 -- 172.21.15.123:0/1496286432 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e200d1bd0 msgr2=0x7f2e200cd9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:44.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.401+0000 7f2e25677640 1 --2- 172.21.15.123:0/1496286432 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e200d1bd0 0x7f2e200cd9f0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400c7f0 tx=0x7f2e1400ccb0 comp rx=0 tx=0).stop 2024-09-15T23:18:44.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.401+0000 7f2e25677640 1 -- 172.21.15.123:0/1496286432 shutdown_connections 2024-09-15T23:18:44.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.401+0000 7f2e25677640 1 --2- 172.21.15.123:0/1496286432 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e2015e950 0x7f2e200cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:44.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.401+0000 7f2e25677640 1 --2- 172.21.15.123:0/1496286432 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2e0c06c2b0 0x7f2e0c06e770 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:44.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.401+0000 7f2e25677640 1 --2- 172.21.15.123:0/1496286432 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e200d1bd0 0x7f2e200cd9f0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:44.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.401+0000 7f2e25677640 1 --2- 172.21.15.123:0/1496286432 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e200cf7f0 0x7f2e200cb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:44.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.401+0000 7f2e25677640 1 -- 172.21.15.123:0/1496286432 >> 172.21.15.123:0/1496286432 conn(0x7f2e20067b30 msgr2=0x7f2e200b7de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:44.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.401+0000 7f2e25677640 1 -- 172.21.15.123:0/1496286432 shutdown_connections 2024-09-15T23:18:44.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.401+0000 7f2e25677640 1 -- 172.21.15.123:0/1496286432 wait complete. 2024-09-15T23:18:44.413 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:18:44.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.510+0000 7f7a8f627640 1 Processor -- start 2024-09-15T23:18:44.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.510+0000 7f7a8f627640 1 -- start start 2024-09-15T23:18:44.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.511+0000 7f7a8f627640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7a880b2d40 0x7f7a8806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:44.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.511+0000 7f7a8f627640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a88071180 con 0x7f7a8813eb20 2024-09-15T23:18:44.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.511+0000 7f7a8f627640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a88071460 con 0x7f7a8806c150 2024-09-15T23:18:44.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.511+0000 7f7a8f627640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f7a88071ab0 con 0x7f7a880b2d40 2024-09-15T23:18:44.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.511+0000 7f7a8cbc2640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7a8813eb20 0x7f7a8815bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35718/0 (socket says 172.21.15.123:35718) 2024-09-15T23:18:44.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.511+0000 7f7a8cbc2640 1 -- 172.21.15.123:0/47289787 learned_addr learned my addr 172.21.15.123:0/47289787 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:18:44.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.512+0000 7f7a8d3c3640 1 --2- 172.21.15.123:0/47289787 >> v2:172.21.15.188:3300/0 conn(0x7f7a880b2d40 0x7f7a8806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:44.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.512+0000 7f7a87fff640 1 -- 172.21.15.123:0/47289787 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3071263555 0 0) 0x7f7a88071180 con 0x7f7a8813eb20 2024-09-15T23:18:44.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.512+0000 7f7a87fff640 1 -- 172.21.15.123:0/47289787 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a70003520 con 0x7f7a8813eb20 2024-09-15T23:18:44.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.512+0000 7f7a87fff640 1 -- 172.21.15.123:0/47289787 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1601926023 0 0) 0x7f7a70003520 con 0x7f7a8813eb20 2024-09-15T23:18:44.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.512+0000 7f7a87fff640 1 -- 172.21.15.123:0/47289787 >> v2:172.21.15.188:3300/0 conn(0x7f7a880b2d40 msgr2=0x7f7a8806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:44.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.512+0000 7f7a87fff640 1 --2- 172.21.15.123:0/47289787 >> v2:172.21.15.188:3300/0 conn(0x7f7a880b2d40 0x7f7a8806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:44.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.512+0000 7f7a87fff640 1 -- 172.21.15.123:0/47289787 >> v1:172.21.15.188:6789/0 conn(0x7f7a8806c150 legacy=0x7f7a88071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:44.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.512+0000 7f7a87fff640 1 -- 172.21.15.123:0/47289787 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a88071740 con 0x7f7a8813eb20 2024-09-15T23:18:44.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.512+0000 7f7a87fff640 1 -- 172.21.15.123:0/47289787 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f7a7c001670 con 0x7f7a8813eb20 2024-09-15T23:18:44.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.512+0000 7f7a8d3c3640 1 --2- 172.21.15.123:0/47289787 >> v2:172.21.15.188:3300/0 conn(0x7f7a880b2d40 0x7f7a8806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:18:44.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.512+0000 7f7a87fff640 1 -- 172.21.15.123:0/47289787 >> v1:172.21.15.123:6789/0 conn(0x7f7a8813eb20 legacy=0x7f7a8815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:44.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.512+0000 7f7a87fff640 1 --2- 172.21.15.123:0/47289787 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a700039b0 0x7f7a70003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:44.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.512+0000 7f7a87fff640 1 --2- 172.21.15.123:0/47289787 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a700043b0 0x7f7a70004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:44.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.512+0000 7f7a87fff640 1 --2- 172.21.15.123:0/47289787 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a70005080 0x7f7a7000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:44.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.512+0000 7f7a87fff640 1 -- 172.21.15.123:0/47289787 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7a88071ab0 con 0x7f7a700043b0 2024-09-15T23:18:44.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.512+0000 7f7a87fff640 1 -- 172.21.15.123:0/47289787 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7000bfe0 con 0x7f7a700039b0 2024-09-15T23:18:44.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.512+0000 7f7a87fff640 1 -- 172.21.15.123:0/47289787 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7a7000c1e0 con 0x7f7a70005080 2024-09-15T23:18:44.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.512+0000 7f7a8cbc2640 1 --2- 172.21.15.123:0/47289787 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a700043b0 0x7f7a70004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:44.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.512+0000 7f7a8d3c3640 1 --2- 172.21.15.123:0/47289787 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a700039b0 0x7f7a70003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:44.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.512+0000 7f7a8dbc4640 1 --2- 172.21.15.123:0/47289787 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a70005080 0x7f7a7000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:44.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.512+0000 7f7a8cbc2640 1 -- 172.21.15.123:0/47289787 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a70005080 msgr2=0x7f7a7000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:44.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.512+0000 7f7a8cbc2640 1 --2- 172.21.15.123:0/47289787 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a70005080 0x7f7a7000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:44.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.512+0000 7f7a8cbc2640 1 -- 172.21.15.123:0/47289787 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a700039b0 msgr2=0x7f7a70003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:44.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.512+0000 7f7a8cbc2640 1 --2- 172.21.15.123:0/47289787 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a700039b0 0x7f7a70003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:44.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.512+0000 7f7a8cbc2640 1 -- 172.21.15.123:0/47289787 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a70003520 con 0x7f7a700043b0 2024-09-15T23:18:44.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.513+0000 7f7a8dbc4640 1 --2- 172.21.15.123:0/47289787 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a70005080 0x7f7a7000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:18:44.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.513+0000 7f7a8dbc4640 1 -- 172.21.15.123:0/47289787 reap_dead start 2024-09-15T23:18:44.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.513+0000 7f7a8cbc2640 1 --2- 172.21.15.123:0/47289787 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a700043b0 0x7f7a70004880 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c00c210 tx=0x7f7a70005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c04c76fcb70b73d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:44.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.513+0000 7f7a87fff640 1 -- 172.21.15.123:0/47289787 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c007d10 con 0x7f7a700043b0 2024-09-15T23:18:44.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.513+0000 7f7a87fff640 1 -- 172.21.15.123:0/47289787 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a7c005ad0 con 0x7f7a700043b0 2024-09-15T23:18:44.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.513+0000 7f7a87fff640 1 -- 172.21.15.123:0/47289787 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c007070 con 0x7f7a700043b0 2024-09-15T23:18:44.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.514+0000 7f7a8f627640 1 -- 172.21.15.123:0/47289787 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a700043b0 msgr2=0x7f7a70004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:44.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.514+0000 7f7a8f627640 1 --2- 172.21.15.123:0/47289787 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a700043b0 0x7f7a70004880 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c00c210 tx=0x7f7a70005830 comp rx=0 tx=0).stop 2024-09-15T23:18:44.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.514+0000 7f7a8f627640 1 -- 172.21.15.123:0/47289787 shutdown_connections 2024-09-15T23:18:44.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.514+0000 7f7a8f627640 1 --2- 172.21.15.123:0/47289787 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a700043b0 0x7f7a70004880 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:44.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.514+0000 7f7a8f627640 1 -- 172.21.15.123:0/47289787 >> 172.21.15.123:0/47289787 conn(0x7f7a880ccec0 msgr2=0x7f7a880cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:44.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.514+0000 7f7a8f627640 1 -- 172.21.15.123:0/47289787 shutdown_connections 2024-09-15T23:18:44.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.514+0000 7f7a8f627640 1 -- 172.21.15.123:0/47289787 wait complete. 2024-09-15T23:18:44.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.515+0000 7f7a8f627640 1 Processor -- start 2024-09-15T23:18:44.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.515+0000 7f7a8f627640 1 -- start start 2024-09-15T23:18:44.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.516+0000 7f7a8f627640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a700043b0 0x7f7a881f7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:44.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.516+0000 7f7a8f627640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a8813dd80 0x7f7a880b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:44.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.516+0000 7f7a8f627640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a8815e9c0 0x7f7a880b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:44.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.516+0000 7f7a8f627640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7a8806bfa0 con 0x7f7a8815e9c0 2024-09-15T23:18:44.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.516+0000 7f7a8f627640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7a8806be20 con 0x7f7a700043b0 2024-09-15T23:18:44.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.516+0000 7f7a8f627640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7a8815bcf0 con 0x7f7a8813dd80 2024-09-15T23:18:44.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.516+0000 7f7a8dbc4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a8815e9c0 0x7f7a880b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:44.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.516+0000 7f7a8dbc4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a8815e9c0 0x7f7a880b3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50888/0 (socket says 172.21.15.123:50888) 2024-09-15T23:18:44.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.516+0000 7f7a8dbc4640 1 -- 172.21.15.123:0/1385197139 learned_addr learned my addr 172.21.15.123:0/1385197139 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:44.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.516+0000 7f7a8dbc4640 1 -- 172.21.15.123:0/1385197139 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a8813dd80 msgr2=0x7f7a880b3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:44.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.516+0000 7f7a8cbc2640 1 --2- 172.21.15.123:0/1385197139 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a8813dd80 0x7f7a880b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:44.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.516+0000 7f7a8d3c3640 1 --2- 172.21.15.123:0/1385197139 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a700043b0 0x7f7a881f7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:44.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.516+0000 7f7a8dbc4640 1 --2- 172.21.15.123:0/1385197139 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a8813dd80 0x7f7a880b3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:44.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.516+0000 7f7a8dbc4640 1 -- 172.21.15.123:0/1385197139 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a700043b0 msgr2=0x7f7a881f7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:44.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.516+0000 7f7a8dbc4640 1 --2- 172.21.15.123:0/1385197139 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a700043b0 0x7f7a881f7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:44.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.516+0000 7f7a8dbc4640 1 -- 172.21.15.123:0/1385197139 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a8815ef80 con 0x7f7a8815e9c0 2024-09-15T23:18:44.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.516+0000 7f7a8d3c3640 1 --2- 172.21.15.123:0/1385197139 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a700043b0 0x7f7a881f7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:18:44.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.516+0000 7f7a8dbc4640 1 --2- 172.21.15.123:0/1385197139 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a8815e9c0 0x7f7a880b3ab0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f7a880cdf80 tx=0x7f7a8000e890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:44.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.516+0000 7f7a85ffb640 1 -- 172.21.15.123:0/1385197139 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a80019070 con 0x7f7a8815e9c0 2024-09-15T23:18:44.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.517+0000 7f7a85ffb640 1 -- 172.21.15.123:0/1385197139 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a800052e0 con 0x7f7a8815e9c0 2024-09-15T23:18:44.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.517+0000 7f7a8f627640 1 -- 172.21.15.123:0/1385197139 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a8815f260 con 0x7f7a8815e9c0 2024-09-15T23:18:44.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.517+0000 7f7a85ffb640 1 -- 172.21.15.123:0/1385197139 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a80003850 con 0x7f7a8815e9c0 2024-09-15T23:18:44.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.517+0000 7f7a8f627640 1 -- 172.21.15.123:0/1385197139 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a880c98b0 con 0x7f7a8815e9c0 2024-09-15T23:18:44.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.518+0000 7f7a8f627640 1 -- 172.21.15.123:0/1385197139 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a8815c080 con 0x7f7a8815e9c0 2024-09-15T23:18:44.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.518+0000 7f7a85ffb640 1 -- 172.21.15.123:0/1385197139 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7a8001c070 con 0x7f7a8815e9c0 2024-09-15T23:18:44.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.519+0000 7f7a85ffb640 1 --2- 172.21.15.123:0/1385197139 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7a7406c2b0 0x7f7a7406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:44.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.519+0000 7f7a85ffb640 1 -- 172.21.15.123:0/1385197139 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5795+0+0 (secure 0 0 0) 0x7f7a8008a920 con 0x7f7a8815e9c0 2024-09-15T23:18:44.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.519+0000 7f7a8d3c3640 1 --2- 172.21.15.123:0/1385197139 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7a7406c2b0 0x7f7a7406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:44.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.520+0000 7f7a8d3c3640 1 --2- 172.21.15.123:0/1385197139 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7a7406c2b0 0x7f7a7406e770 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f7a78009fd0 tx=0x7f7a7800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:44.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.523+0000 7f7a85ffb640 1 -- 172.21.15.123:0/1385197139 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7a80059030 con 0x7f7a8815e9c0 2024-09-15T23:18:44.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.721+0000 7f7a8f627640 1 -- 172.21.15.123:0/1385197139 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7a8806c9c0 con 0x7f7a8815e9c0 2024-09-15T23:18:44.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.721+0000 7f7a85ffb640 1 -- 172.21.15.123:0/1385197139 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5237 (secure 0 0 0) 0x7f7a80058930 con 0x7f7a8815e9c0 2024-09-15T23:18:44.723 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:18:44.723 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":74,"btime":"2024-09-15T23:17:25:298017+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6158,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/3864460389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3864460389},{"type":"v1","addr":"172.21.15.188:6836","nonce":3864460389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":6769,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2483934450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2483934450},{"type":"v1","addr":"172.21.15.188:6837","nonce":2483934450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7605,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/1769288917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":1769288917},{"type":"v1","addr":"172.21.15.123:6834","nonce":1769288917}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2024-09-15T23:17:13.443625+0000","modified":"2024-09-15T23:17:24.551458+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7608},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7608":{"gid":7608,"name":"c","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/3823805081","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":3823805081},{"type":"v1","addr":"172.21.15.123:6835","nonce":3823805081}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7608,"qdb_cluster":[7608]},"id":7}]} 2024-09-15T23:18:44.723 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 74 2024-09-15T23:18:44.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.723+0000 7f7a8f627640 1 -- 172.21.15.123:0/1385197139 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7a7406c2b0 msgr2=0x7f7a7406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:44.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.723+0000 7f7a8f627640 1 --2- 172.21.15.123:0/1385197139 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7a7406c2b0 0x7f7a7406e770 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f7a78009fd0 tx=0x7f7a7800b040 comp rx=0 tx=0).stop 2024-09-15T23:18:44.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.723+0000 7f7a8f627640 1 -- 172.21.15.123:0/1385197139 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a8815e9c0 msgr2=0x7f7a880b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:44.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.723+0000 7f7a8f627640 1 --2- 172.21.15.123:0/1385197139 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a8815e9c0 0x7f7a880b3ab0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f7a880cdf80 tx=0x7f7a8000e890 comp rx=0 tx=0).stop 2024-09-15T23:18:44.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.723+0000 7f7a8f627640 1 -- 172.21.15.123:0/1385197139 shutdown_connections 2024-09-15T23:18:44.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.723+0000 7f7a8f627640 1 --2- 172.21.15.123:0/1385197139 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7a7406c2b0 0x7f7a7406e770 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:44.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.723+0000 7f7a8f627640 1 --2- 172.21.15.123:0/1385197139 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a8815e9c0 0x7f7a880b3ab0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:44.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.723+0000 7f7a8f627640 1 --2- 172.21.15.123:0/1385197139 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a8813dd80 0x7f7a880b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:44.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.723+0000 7f7a8f627640 1 --2- 172.21.15.123:0/1385197139 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a700043b0 0x7f7a881f7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:44.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.723+0000 7f7a8f627640 1 -- 172.21.15.123:0/1385197139 >> 172.21.15.123:0/1385197139 conn(0x7f7a880ccec0 msgr2=0x7f7a880b5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:44.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.723+0000 7f7a8f627640 1 -- 172.21.15.123:0/1385197139 shutdown_connections 2024-09-15T23:18:44.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.723+0000 7f7a8f627640 1 -- 172.21.15.123:0/1385197139 wait complete. 2024-09-15T23:18:44.735 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:18:44.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.831+0000 7f5e34c30640 1 Processor -- start 2024-09-15T23:18:44.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.831+0000 7f5e34c30640 1 -- start start 2024-09-15T23:18:44.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.832+0000 7f5e34c30640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5e300b2d40 0x7f5e3006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:44.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.832+0000 7f5e34c30640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f5e3006c150 0x7f5e3015c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:44.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.832+0000 7f5e34c30640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e30071180 con 0x7f5e3013eb20 2024-09-15T23:18:44.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.832+0000 7f5e34c30640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f5e30071ab0 con 0x7f5e3006c150 2024-09-15T23:18:44.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.832+0000 7f5e34c30640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5e30071460 con 0x7f5e300b2d40 2024-09-15T23:18:44.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.832+0000 7f5e2e59c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5e300b2d40 0x7f5e3006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:44.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.832+0000 7f5e2ed9d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f5e3006c150 0x7f5e3015c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:44.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.832+0000 7f5e27fff640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f5e3013eb20 0x7f5e3015bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:54096/0 (socket says 172.21.15.123:54096) 2024-09-15T23:18:44.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.832+0000 7f5e2ed9d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f5e3006c150 0x7f5e3015c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:55458/0 (socket says 172.21.15.123:55458) 2024-09-15T23:18:44.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.832+0000 7f5e2e59c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5e300b2d40 0x7f5e3006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:39338/0 (socket says 172.21.15.123:39338) 2024-09-15T23:18:44.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.832+0000 7f5e27fff640 1 -- 172.21.15.123:0/3310333304 learned_addr learned my addr 172.21.15.123:0/3310333304 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:18:44.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.832+0000 7f5e2ed9d640 1 -- 172.21.15.123:0/3310333304 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5e300b2d40 msgr2=0x7f5e3006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:44.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.832+0000 7f5e2ed9d640 1 --2- 172.21.15.123:0/3310333304 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5e300b2d40 0x7f5e3006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:44.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.833+0000 7f5e2ed9d640 1 -- 172.21.15.123:0/3310333304 >> v1:172.21.15.188:6789/0 conn(0x7f5e3013eb20 legacy=0x7f5e3015bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:44.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.833+0000 7f5e2ed9d640 1 -- 172.21.15.123:0/3310333304 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e30071740 con 0x7f5e3006c150 2024-09-15T23:18:44.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.833+0000 7f5e2ed9d640 1 --2- 172.21.15.123:0/3310333304 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5e3006c150 0x7f5e3015c400 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5e30071c30 tx=0x7f5e2802c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7373c77f1e8f6661 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:44.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.833+0000 7f5e2dd9b640 1 -- 172.21.15.123:0/3310333304 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e28039070 con 0x7f5e3006c150 2024-09-15T23:18:44.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.834+0000 7f5e2dd9b640 1 -- 172.21.15.123:0/3310333304 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e28009540 con 0x7f5e3006c150 2024-09-15T23:18:44.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.834+0000 7f5e2dd9b640 1 -- 172.21.15.123:0/3310333304 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e28009910 con 0x7f5e3006c150 2024-09-15T23:18:44.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.834+0000 7f5e34c30640 1 -- 172.21.15.123:0/3310333304 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5e3006c150 msgr2=0x7f5e3015c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:44.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.834+0000 7f5e34c30640 1 --2- 172.21.15.123:0/3310333304 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5e3006c150 0x7f5e3015c400 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5e30071c30 tx=0x7f5e2802c860 comp rx=0 tx=0).stop 2024-09-15T23:18:44.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.834+0000 7f5e34c30640 1 -- 172.21.15.123:0/3310333304 shutdown_connections 2024-09-15T23:18:44.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.834+0000 7f5e34c30640 1 --2- 172.21.15.123:0/3310333304 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5e3006c150 0x7f5e3015c400 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:44.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.834+0000 7f5e34c30640 1 --2- 172.21.15.123:0/3310333304 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5e300b2d40 0x7f5e3006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:44.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.834+0000 7f5e34c30640 1 -- 172.21.15.123:0/3310333304 >> 172.21.15.123:0/3310333304 conn(0x7f5e300ccec0 msgr2=0x7f5e300cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:44.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.834+0000 7f5e34c30640 1 -- 172.21.15.123:0/3310333304 shutdown_connections 2024-09-15T23:18:44.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.834+0000 7f5e34c30640 1 -- 172.21.15.123:0/3310333304 wait complete. 2024-09-15T23:18:44.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.835+0000 7f5e34c30640 1 Processor -- start 2024-09-15T23:18:44.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.835+0000 7f5e34c30640 1 -- start start 2024-09-15T23:18:44.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.836+0000 7f5e34c30640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e3006c150 0x7f5e3013de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:44.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.836+0000 7f5e34c30640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5e300b2d40 0x7f5e300cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:44.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.836+0000 7f5e34c30640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5e3013eb20 0x7f5e30155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:44.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.836+0000 7f5e34c30640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5e300722d0 con 0x7f5e3006c150 2024-09-15T23:18:44.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.836+0000 7f5e34c30640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5e30072150 con 0x7f5e300b2d40 2024-09-15T23:18:44.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.836+0000 7f5e34c30640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5e30072450 con 0x7f5e3013eb20 2024-09-15T23:18:44.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.836+0000 7f5e2e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e3006c150 0x7f5e3013de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:44.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.836+0000 7f5e2e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e3006c150 0x7f5e3013de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50900/0 (socket says 172.21.15.123:50900) 2024-09-15T23:18:44.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.836+0000 7f5e2e59c640 1 -- 172.21.15.123:0/972019016 learned_addr learned my addr 172.21.15.123:0/972019016 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:44.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.836+0000 7f5e27fff640 1 --2- 172.21.15.123:0/972019016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5e300b2d40 0x7f5e300cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:44.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.836+0000 7f5e2ed9d640 1 --2- 172.21.15.123:0/972019016 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5e3013eb20 0x7f5e30155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:44.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.836+0000 7f5e2e59c640 1 -- 172.21.15.123:0/972019016 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5e3013eb20 msgr2=0x7f5e30155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:44.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.836+0000 7f5e2e59c640 1 --2- 172.21.15.123:0/972019016 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5e3013eb20 0x7f5e30155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:44.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.836+0000 7f5e2e59c640 1 -- 172.21.15.123:0/972019016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5e300b2d40 msgr2=0x7f5e300cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:44.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.836+0000 7f5e2e59c640 1 --2- 172.21.15.123:0/972019016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5e300b2d40 0x7f5e300cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:44.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.836+0000 7f5e2e59c640 1 -- 172.21.15.123:0/972019016 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e3015c4f0 con 0x7f5e3006c150 2024-09-15T23:18:44.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.837+0000 7f5e2e59c640 1 --2- 172.21.15.123:0/972019016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e3006c150 0x7f5e3013de50 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f5e2000e9e0 tx=0x7f5e2000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:44.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.837+0000 7f5e26ffd640 1 -- 172.21.15.123:0/972019016 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e20017070 con 0x7f5e3006c150 2024-09-15T23:18:44.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.837+0000 7f5e26ffd640 1 -- 172.21.15.123:0/972019016 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e2000c9d0 con 0x7f5e3006c150 2024-09-15T23:18:44.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.837+0000 7f5e26ffd640 1 -- 172.21.15.123:0/972019016 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2000cdc0 con 0x7f5e3006c150 2024-09-15T23:18:44.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.837+0000 7f5e34c30640 1 -- 172.21.15.123:0/972019016 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e300ca740 con 0x7f5e3006c150 2024-09-15T23:18:44.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.837+0000 7f5e34c30640 1 -- 172.21.15.123:0/972019016 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e300cafe0 con 0x7f5e3006c150 2024-09-15T23:18:44.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.838+0000 7f5e34c30640 1 -- 172.21.15.123:0/972019016 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e3006bc10 con 0x7f5e3006c150 2024-09-15T23:18:44.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.838+0000 7f5e26ffd640 1 -- 172.21.15.123:0/972019016 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5e2001a070 con 0x7f5e3006c150 2024-09-15T23:18:44.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.839+0000 7f5e26ffd640 1 --2- 172.21.15.123:0/972019016 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5e1006c2b0 0x7f5e1006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:44.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.839+0000 7f5e26ffd640 1 -- 172.21.15.123:0/972019016 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5795+0+0 (secure 0 0 0) 0x7f5e2008b410 con 0x7f5e3006c150 2024-09-15T23:18:44.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.839+0000 7f5e27fff640 1 --2- 172.21.15.123:0/972019016 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5e1006c2b0 0x7f5e1006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:44.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.839+0000 7f5e27fff640 1 --2- 172.21.15.123:0/972019016 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5e1006c2b0 0x7f5e1006e770 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f5e30141520 tx=0x7f5e18007e80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:44.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:44.843+0000 7f5e26ffd640 1 -- 172.21.15.123:0/972019016 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5e200594d0 con 0x7f5e3006c150 2024-09-15T23:18:45.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.009+0000 7f5e34c30640 1 -- 172.21.15.123:0/972019016 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5e3006c9c0 con 0x7f5e3006c150 2024-09-15T23:18:45.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.010+0000 7f5e26ffd640 1 -- 172.21.15.123:0/972019016 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) ==== 74+0+16867 (secure 0 0 0) 0x7f5e2005d7d0 con 0x7f5e3006c150 2024-09-15T23:18:45.012 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:18:45.012 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":118,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:18:24.272784+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:17:12.056649+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-15T23:17:12.415562+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":117,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.f","mappings":[{"from":5,"to":0}]},{"pgid":"14.1e","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":15,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:18:45.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.012+0000 7f5e34c30640 1 -- 172.21.15.123:0/972019016 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5e1006c2b0 msgr2=0x7f5e1006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:45.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.012+0000 7f5e34c30640 1 --2- 172.21.15.123:0/972019016 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5e1006c2b0 0x7f5e1006e770 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f5e30141520 tx=0x7f5e18007e80 comp rx=0 tx=0).stop 2024-09-15T23:18:45.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.012+0000 7f5e34c30640 1 -- 172.21.15.123:0/972019016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e3006c150 msgr2=0x7f5e3013de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:45.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.012+0000 7f5e34c30640 1 --2- 172.21.15.123:0/972019016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e3006c150 0x7f5e3013de50 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f5e2000e9e0 tx=0x7f5e2000eea0 comp rx=0 tx=0).stop 2024-09-15T23:18:45.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.013+0000 7f5e34c30640 1 -- 172.21.15.123:0/972019016 shutdown_connections 2024-09-15T23:18:45.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.013+0000 7f5e34c30640 1 --2- 172.21.15.123:0/972019016 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5e3013eb20 0x7f5e30155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:45.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.013+0000 7f5e34c30640 1 --2- 172.21.15.123:0/972019016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5e300b2d40 0x7f5e300cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:45.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.013+0000 7f5e34c30640 1 --2- 172.21.15.123:0/972019016 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5e1006c2b0 0x7f5e1006e770 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:45.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.013+0000 7f5e34c30640 1 --2- 172.21.15.123:0/972019016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e3006c150 0x7f5e3013de50 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:45.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.013+0000 7f5e34c30640 1 -- 172.21.15.123:0/972019016 >> 172.21.15.123:0/972019016 conn(0x7f5e300ccec0 msgr2=0x7f5e300cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:45.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.013+0000 7f5e34c30640 1 -- 172.21.15.123:0/972019016 shutdown_connections 2024-09-15T23:18:45.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.013+0000 7f5e34c30640 1 -- 172.21.15.123:0/972019016 wait complete. 2024-09-15T23:18:45.025 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T23:18:45.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.123+0000 7f43097e4640 1 Processor -- start 2024-09-15T23:18:45.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.123+0000 7f43097e4640 1 -- start start 2024-09-15T23:18:45.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.124+0000 7f43097e4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f430415e6d0 0x7f4304071390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:45.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.124+0000 7f43097e4640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f430406cd20 0x7f43040b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:45.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.124+0000 7f43097e4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f430415eab0 con 0x7f4304070b80 2024-09-15T23:18:45.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.124+0000 7f43097e4640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f430415ed70 con 0x7f430406cd20 2024-09-15T23:18:45.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.124+0000 7f43097e4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f430415f050 con 0x7f430415e6d0 2024-09-15T23:18:45.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.124+0000 7f43037fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f4304070b80 0x7f43040731a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35726/0 (socket says 172.21.15.123:35726) 2024-09-15T23:18:45.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.124+0000 7f43037fe640 1 -- 172.21.15.123:0/3562012699 learned_addr learned my addr 172.21.15.123:0/3562012699 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:18:45.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.124+0000 7f42fa7fc640 1 --2- 172.21.15.123:0/3562012699 >> v2:172.21.15.188:3300/0 conn(0x7f430406cd20 0x7f43040b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:45.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.124+0000 7f4302ffd640 1 --2- 172.21.15.123:0/3562012699 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f430415e6d0 0x7f4304071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:45.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.124+0000 7f43027fc640 1 -- 172.21.15.123:0/3562012699 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3085861439 0 0) 0x7f430415eab0 con 0x7f4304070b80 2024-09-15T23:18:45.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.124+0000 7f43027fc640 1 -- 172.21.15.123:0/3562012699 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42f0003520 con 0x7f4304070b80 2024-09-15T23:18:45.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.124+0000 7f43027fc640 1 -- 172.21.15.123:0/3562012699 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 246873249 0 0) 0x7f42f0003520 con 0x7f4304070b80 2024-09-15T23:18:45.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.124+0000 7f43027fc640 1 -- 172.21.15.123:0/3562012699 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f430415e6d0 msgr2=0x7f4304071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:45.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.124+0000 7f43027fc640 1 --2- 172.21.15.123:0/3562012699 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f430415e6d0 0x7f4304071390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:45.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.124+0000 7f43027fc640 1 -- 172.21.15.123:0/3562012699 >> v2:172.21.15.188:3300/0 conn(0x7f430406cd20 msgr2=0x7f43040b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:45.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.124+0000 7f43027fc640 1 --2- 172.21.15.123:0/3562012699 >> v2:172.21.15.188:3300/0 conn(0x7f430406cd20 0x7f43040b6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:45.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.124+0000 7f43027fc640 1 -- 172.21.15.123:0/3562012699 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f430415f330 con 0x7f4304070b80 2024-09-15T23:18:45.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.125+0000 7f43027fc640 1 -- 172.21.15.123:0/3562012699 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f42fc0019f0 con 0x7f4304070b80 2024-09-15T23:18:45.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.125+0000 7f43027fc640 1 -- 172.21.15.123:0/3562012699 >> v1:172.21.15.123:6789/0 conn(0x7f4304070b80 legacy=0x7f43040731a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:45.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.125+0000 7f43027fc640 1 --2- 172.21.15.123:0/3562012699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42f00039b0 0x7f42f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:45.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.125+0000 7f43027fc640 1 --2- 172.21.15.123:0/3562012699 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f430415e6d0 0x7f42f0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:45.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.125+0000 7f43027fc640 1 --2- 172.21.15.123:0/3562012699 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f42f0004d40 0x7f42f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:45.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.125+0000 7f43027fc640 1 -- 172.21.15.123:0/3562012699 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f430415ed70 con 0x7f42f00039b0 2024-09-15T23:18:45.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.125+0000 7f43027fc640 1 -- 172.21.15.123:0/3562012699 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f430415f050 con 0x7f42f0004d40 2024-09-15T23:18:45.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.125+0000 7f43027fc640 1 -- 172.21.15.123:0/3562012699 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f42f000b9c0 con 0x7f430415e6d0 2024-09-15T23:18:45.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.125+0000 7f4302ffd640 1 --2- 172.21.15.123:0/3562012699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42f00039b0 0x7f42f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:45.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.125+0000 7f42fa7fc640 1 --2- 172.21.15.123:0/3562012699 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f430415e6d0 0x7f42f0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:45.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.125+0000 7f43037fe640 1 --2- 172.21.15.123:0/3562012699 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f42f0004d40 0x7f42f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:45.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.125+0000 7f4302ffd640 1 -- 172.21.15.123:0/3562012699 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f430415e6d0 msgr2=0x7f42f0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:45.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.125+0000 7f4302ffd640 1 --2- 172.21.15.123:0/3562012699 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f430415e6d0 0x7f42f0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:45.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.125+0000 7f4302ffd640 1 -- 172.21.15.123:0/3562012699 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f42f0004d40 msgr2=0x7f42f00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:45.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.125+0000 7f4302ffd640 1 --2- 172.21.15.123:0/3562012699 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f42f0004d40 0x7f42f00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:45.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.125+0000 7f4302ffd640 1 -- 172.21.15.123:0/3562012699 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f0003520 con 0x7f42f00039b0 2024-09-15T23:18:45.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.126+0000 7f4302ffd640 1 --2- 172.21.15.123:0/3562012699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42f00039b0 0x7f42f0003dd0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f42f4009ac0 tx=0x7f42f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff50eb5ab5d77155 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:45.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.126+0000 7f43027fc640 1 -- 172.21.15.123:0/3562012699 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f4036070 con 0x7f42f00039b0 2024-09-15T23:18:45.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.126+0000 7f43027fc640 1 -- 172.21.15.123:0/3562012699 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f4031400 con 0x7f42f00039b0 2024-09-15T23:18:45.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.126+0000 7f43027fc640 1 -- 172.21.15.123:0/3562012699 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f4009690 con 0x7f42f00039b0 2024-09-15T23:18:45.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.126+0000 7f43097e4640 1 -- 172.21.15.123:0/3562012699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42f00039b0 msgr2=0x7f42f0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:45.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.126+0000 7f43097e4640 1 --2- 172.21.15.123:0/3562012699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42f00039b0 0x7f42f0003dd0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f42f4009ac0 tx=0x7f42f0005830 comp rx=0 tx=0).stop 2024-09-15T23:18:45.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.126+0000 7f43037fe640 1 -- 172.21.15.123:0/3562012699 reap_dead start 2024-09-15T23:18:45.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.126+0000 7f43097e4640 1 -- 172.21.15.123:0/3562012699 shutdown_connections 2024-09-15T23:18:45.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.126+0000 7f43097e4640 1 -- 172.21.15.123:0/3562012699 >> 172.21.15.123:0/3562012699 conn(0x7f4304067fb0 msgr2=0x7f430406f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:45.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.126+0000 7f43097e4640 1 -- 172.21.15.123:0/3562012699 shutdown_connections 2024-09-15T23:18:45.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.126+0000 7f43097e4640 1 -- 172.21.15.123:0/3562012699 wait complete. 2024-09-15T23:18:45.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.127+0000 7f43097e4640 1 Processor -- start 2024-09-15T23:18:45.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.128+0000 7f43097e4640 1 -- start start 2024-09-15T23:18:45.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.128+0000 7f43097e4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42f00039b0 0x7f430414fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:45.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.128+0000 7f43097e4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f430415b980 0x7f43041f5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:45.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.128+0000 7f43097e4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4304156090 0x7f430415c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:45.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.128+0000 7f43097e4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f43040b72a0 con 0x7f42f00039b0 2024-09-15T23:18:45.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.128+0000 7f43097e4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f430415f8f0 con 0x7f430415b980 2024-09-15T23:18:45.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.128+0000 7f43097e4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f43040b7420 con 0x7f4304156090 2024-09-15T23:18:45.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.128+0000 7f4302ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42f00039b0 0x7f430414fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:45.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.128+0000 7f4302ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42f00039b0 0x7f430414fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50920/0 (socket says 172.21.15.123:50920) 2024-09-15T23:18:45.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.128+0000 7f4302ffd640 1 -- 172.21.15.123:0/3868600858 learned_addr learned my addr 172.21.15.123:0/3868600858 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:45.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.129+0000 7f43037fe640 1 --2- 172.21.15.123:0/3868600858 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4304156090 0x7f430415c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:45.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.129+0000 7f42fa7fc640 1 --2- 172.21.15.123:0/3868600858 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f430415b980 0x7f43041f5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:45.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.129+0000 7f4302ffd640 1 -- 172.21.15.123:0/3868600858 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4304156090 msgr2=0x7f430415c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:45.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.129+0000 7f4302ffd640 1 --2- 172.21.15.123:0/3868600858 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4304156090 0x7f430415c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:45.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.129+0000 7f4302ffd640 1 -- 172.21.15.123:0/3868600858 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f430415b980 msgr2=0x7f43041f5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:45.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.129+0000 7f4302ffd640 1 --2- 172.21.15.123:0/3868600858 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f430415b980 0x7f43041f5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:45.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.129+0000 7f4302ffd640 1 -- 172.21.15.123:0/3868600858 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4304156ae0 con 0x7f42f00039b0 2024-09-15T23:18:45.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.129+0000 7f43037fe640 1 --2- 172.21.15.123:0/3868600858 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4304156090 0x7f430415c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:18:45.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.129+0000 7f42fa7fc640 1 --2- 172.21.15.123:0/3868600858 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f430415b980 0x7f43041f5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:18:45.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.129+0000 7f4302ffd640 1 --2- 172.21.15.123:0/3868600858 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42f00039b0 0x7f430414fec0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f42f4009ac0 tx=0x7f42f4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:45.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.129+0000 7f42fbfff640 1 -- 172.21.15.123:0/3868600858 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f4040020 con 0x7f42f00039b0 2024-09-15T23:18:45.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.129+0000 7f42fbfff640 1 -- 172.21.15.123:0/3868600858 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f4003bc0 con 0x7f42f00039b0 2024-09-15T23:18:45.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.129+0000 7f43097e4640 1 -- 172.21.15.123:0/3868600858 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4304153d00 con 0x7f42f00039b0 2024-09-15T23:18:45.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.129+0000 7f42fbfff640 1 -- 172.21.15.123:0/3868600858 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f4036040 con 0x7f42f00039b0 2024-09-15T23:18:45.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.129+0000 7f43097e4640 1 -- 172.21.15.123:0/3868600858 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43041542c0 con 0x7f42f00039b0 2024-09-15T23:18:45.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.130+0000 7f43097e4640 1 -- 172.21.15.123:0/3868600858 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43040b6d60 con 0x7f42f00039b0 2024-09-15T23:18:45.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.130+0000 7f42fbfff640 1 -- 172.21.15.123:0/3868600858 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f42f4043020 con 0x7f42f00039b0 2024-09-15T23:18:45.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.131+0000 7f42fbfff640 1 --2- 172.21.15.123:0/3868600858 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f42e406c2b0 0x7f42e406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:45.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.131+0000 7f42fbfff640 1 -- 172.21.15.123:0/3868600858 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5795+0+0 (secure 0 0 0) 0x7f42f40ab5f0 con 0x7f42f00039b0 2024-09-15T23:18:45.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.131+0000 7f42fa7fc640 1 --2- 172.21.15.123:0/3868600858 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f42e406c2b0 0x7f42e406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:45.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.132+0000 7f42fa7fc640 1 --2- 172.21.15.123:0/3868600858 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f42e406c2b0 0x7f42e406e770 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f4304159360 tx=0x7f42ec008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:45.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.135+0000 7f42fbfff640 1 -- 172.21.15.123:0/3868600858 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f42f404a070 con 0x7f42f00039b0 2024-09-15T23:18:45.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.333+0000 7f43097e4640 1 -- 172.21.15.123:0/3868600858 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f430406d860 con 0x7f42f00039b0 2024-09-15T23:18:45.335 INFO:tasks.ceph.mon.a.smithi123.stderr:2024-09-15T23:18:45.334+0000 7f8a6ccf0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:18:45.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.335+0000 7f42fbfff640 1 -- 172.21.15.123:0/3868600858 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v75) ==== 161+0+0 (secure 0 0 0) 0x7f42f40044e0 con 0x7f42f00039b0 2024-09-15T23:18:45.336 INFO:teuthology.orchestra.run.smithi123.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T23:18:45.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.338+0000 7f43097e4640 1 -- 172.21.15.123:0/3868600858 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f42e406c2b0 msgr2=0x7f42e406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:45.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.338+0000 7f43097e4640 1 --2- 172.21.15.123:0/3868600858 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f42e406c2b0 0x7f42e406e770 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f4304159360 tx=0x7f42ec008040 comp rx=0 tx=0).stop 2024-09-15T23:18:45.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.338+0000 7f43097e4640 1 -- 172.21.15.123:0/3868600858 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42f00039b0 msgr2=0x7f430414fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:45.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.338+0000 7f43097e4640 1 --2- 172.21.15.123:0/3868600858 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42f00039b0 0x7f430414fec0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f42f4009ac0 tx=0x7f42f4004730 comp rx=0 tx=0).stop 2024-09-15T23:18:45.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.340+0000 7f43097e4640 1 -- 172.21.15.123:0/3868600858 shutdown_connections 2024-09-15T23:18:45.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.340+0000 7f43097e4640 1 --2- 172.21.15.123:0/3868600858 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4304156090 0x7f430415c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:45.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.340+0000 7f43097e4640 1 --2- 172.21.15.123:0/3868600858 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f430415b980 0x7f43041f5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:45.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.340+0000 7f43097e4640 1 --2- 172.21.15.123:0/3868600858 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f42e406c2b0 0x7f42e406e770 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:45.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.340+0000 7f43097e4640 1 --2- 172.21.15.123:0/3868600858 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f42f00039b0 0x7f430414fec0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:45.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.340+0000 7f43097e4640 1 -- 172.21.15.123:0/3868600858 >> 172.21.15.123:0/3868600858 conn(0x7f4304067fb0 msgr2=0x7f4304161560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:45.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.341+0000 7f43097e4640 1 -- 172.21.15.123:0/3868600858 shutdown_connections 2024-09-15T23:18:45.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.341+0000 7f43097e4640 1 -- 172.21.15.123:0/3868600858 wait complete. 2024-09-15T23:18:45.354 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T23:18:45.379 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-15T23:18:45.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.453+0000 7f82eb5fd640 1 Processor -- start 2024-09-15T23:18:45.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.453+0000 7f82eb5fd640 1 -- start start 2024-09-15T23:18:45.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.454+0000 7f82eb5fd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f82e415b7c0 0x7f82e40b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:45.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.454+0000 7f82eb5fd640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82e40cf2e0 con 0x7f82e40ccf30 2024-09-15T23:18:45.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.454+0000 7f82eb5fd640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82e4070fe0 con 0x7f82e40cead0 2024-09-15T23:18:45.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.454+0000 7f82eb5fd640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f82e40712c0 con 0x7f82e415b7c0 2024-09-15T23:18:45.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.454+0000 7f82e9399640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f82e40ccf30 0x7f82e40cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35740/0 (socket says 172.21.15.123:35740) 2024-09-15T23:18:45.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.454+0000 7f82e9399640 1 -- 172.21.15.123:0/3103277557 learned_addr learned my addr 172.21.15.123:0/3103277557 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:18:45.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.454+0000 7f82e8b98640 1 --2- 172.21.15.123:0/3103277557 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f82e415b7c0 0x7f82e40b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:45.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.454+0000 7f82dbfff640 1 -- 172.21.15.123:0/3103277557 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3607542146 0 0) 0x7f82e40cf2e0 con 0x7f82e40ccf30 2024-09-15T23:18:45.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.455+0000 7f82dbfff640 1 -- 172.21.15.123:0/3103277557 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82d0003520 con 0x7f82e40ccf30 2024-09-15T23:18:45.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.455+0000 7f82dbfff640 1 -- 172.21.15.123:0/3103277557 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2640594862 0 0) 0x7f82d0003520 con 0x7f82e40ccf30 2024-09-15T23:18:45.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.455+0000 7f82dbfff640 1 -- 172.21.15.123:0/3103277557 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f82e415b7c0 msgr2=0x7f82e40b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:45.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.455+0000 7f82dbfff640 1 --2- 172.21.15.123:0/3103277557 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f82e415b7c0 0x7f82e40b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:45.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.455+0000 7f82dbfff640 1 -- 172.21.15.123:0/3103277557 >> v1:172.21.15.188:6789/0 conn(0x7f82e40cead0 legacy=0x7f82e4071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:45.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.455+0000 7f82dbfff640 1 -- 172.21.15.123:0/3103277557 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e40715a0 con 0x7f82e40ccf30 2024-09-15T23:18:45.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.455+0000 7f82dbfff640 1 -- 172.21.15.123:0/3103277557 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f82e0001670 con 0x7f82e40ccf30 2024-09-15T23:18:45.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.455+0000 7f82dbfff640 1 -- 172.21.15.123:0/3103277557 >> v1:172.21.15.123:6789/0 conn(0x7f82e40ccf30 legacy=0x7f82e40cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:45.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.455+0000 7f82dbfff640 1 --2- 172.21.15.123:0/3103277557 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82d00039e0 0x7f82d0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:45.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.455+0000 7f82dbfff640 1 --2- 172.21.15.123:0/3103277557 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f82e415b7c0 0x7f82d0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:45.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.455+0000 7f82dbfff640 1 --2- 172.21.15.123:0/3103277557 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d0004d40 0x7f82d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:45.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.455+0000 7f82dbfff640 1 -- 172.21.15.123:0/3103277557 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f82e40712c0 con 0x7f82d0004d40 2024-09-15T23:18:45.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.455+0000 7f82dbfff640 1 -- 172.21.15.123:0/3103277557 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f82d000baa0 con 0x7f82d00039e0 2024-09-15T23:18:45.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.455+0000 7f82dbfff640 1 -- 172.21.15.123:0/3103277557 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f82d000bca0 con 0x7f82e415b7c0 2024-09-15T23:18:45.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.455+0000 7f82e9b9a640 1 --2- 172.21.15.123:0/3103277557 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d0004d40 0x7f82d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:45.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.455+0000 7f82e8b98640 1 --2- 172.21.15.123:0/3103277557 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f82e415b7c0 0x7f82d0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:45.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.455+0000 7f82e9399640 1 --2- 172.21.15.123:0/3103277557 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82d00039e0 0x7f82d0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:45.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.455+0000 7f82e9b9a640 1 -- 172.21.15.123:0/3103277557 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f82e415b7c0 msgr2=0x7f82d0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:45.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.455+0000 7f82e9b9a640 1 --2- 172.21.15.123:0/3103277557 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f82e415b7c0 0x7f82d0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:45.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.455+0000 7f82e9b9a640 1 -- 172.21.15.123:0/3103277557 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82d00039e0 msgr2=0x7f82d0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:45.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.455+0000 7f82e9b9a640 1 --2- 172.21.15.123:0/3103277557 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82d00039e0 0x7f82d0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:45.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.455+0000 7f82e9b9a640 1 -- 172.21.15.123:0/3103277557 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d0003520 con 0x7f82d0004d40 2024-09-15T23:18:45.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.456+0000 7f82e9b9a640 1 --2- 172.21.15.123:0/3103277557 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d0004d40 0x7f82d00051c0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f82dc001f60 tx=0x7f82d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1692954d08c5e810 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:45.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.456+0000 7f82dbfff640 1 -- 172.21.15.123:0/3103277557 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82dc001b30 con 0x7f82d0004d40 2024-09-15T23:18:45.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.456+0000 7f82dbfff640 1 -- 172.21.15.123:0/3103277557 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82dc031620 con 0x7f82d0004d40 2024-09-15T23:18:45.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.456+0000 7f82dbfff640 1 -- 172.21.15.123:0/3103277557 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82dc031a10 con 0x7f82d0004d40 2024-09-15T23:18:45.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.457+0000 7f82eb5fd640 1 -- 172.21.15.123:0/3103277557 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d0004d40 msgr2=0x7f82d00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:45.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.457+0000 7f82eb5fd640 1 --2- 172.21.15.123:0/3103277557 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d0004d40 0x7f82d00051c0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f82dc001f60 tx=0x7f82d0005830 comp rx=0 tx=0).stop 2024-09-15T23:18:45.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.457+0000 7f82e9b9a640 1 -- 172.21.15.123:0/3103277557 reap_dead start 2024-09-15T23:18:45.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.457+0000 7f82eb5fd640 1 -- 172.21.15.123:0/3103277557 shutdown_connections 2024-09-15T23:18:45.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.457+0000 7f82eb5fd640 1 -- 172.21.15.123:0/3103277557 >> 172.21.15.123:0/3103277557 conn(0x7f82e406d0f0 msgr2=0x7f82e406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:45.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.457+0000 7f82eb5fd640 1 -- 172.21.15.123:0/3103277557 shutdown_connections 2024-09-15T23:18:45.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.457+0000 7f82eb5fd640 1 -- 172.21.15.123:0/3103277557 wait complete. 2024-09-15T23:18:45.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.458+0000 7f82eb5fd640 1 Processor -- start 2024-09-15T23:18:45.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.458+0000 7f82eb5fd640 1 -- start start 2024-09-15T23:18:45.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.459+0000 7f82eb5fd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d0004d40 0x7f82e4140370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:45.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.459+0000 7f82eb5fd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f82e415dc20 0x7f82e40b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:45.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.459+0000 7f82eb5fd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82e415e080 0x7f82e40b5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:45.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.459+0000 7f82eb5fd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f82e40cf0c0 con 0x7f82d0004d40 2024-09-15T23:18:45.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.459+0000 7f82eb5fd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f82e40cef40 con 0x7f82e415e080 2024-09-15T23:18:45.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.459+0000 7f82eb5fd640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f82e40b2c50 con 0x7f82e415dc20 2024-09-15T23:18:45.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.459+0000 7f82e9399640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d0004d40 0x7f82e4140370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:45.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.459+0000 7f82e9399640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d0004d40 0x7f82e4140370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50950/0 (socket says 172.21.15.123:50950) 2024-09-15T23:18:45.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.459+0000 7f82e9399640 1 -- 172.21.15.123:0/4259578406 learned_addr learned my addr 172.21.15.123:0/4259578406 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:45.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.459+0000 7f82e9b9a640 1 --2- 172.21.15.123:0/4259578406 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82e415e080 0x7f82e40b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:45.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.459+0000 7f82e8b98640 1 --2- 172.21.15.123:0/4259578406 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f82e415dc20 0x7f82e40b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:45.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.459+0000 7f82e9399640 1 -- 172.21.15.123:0/4259578406 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f82e415dc20 msgr2=0x7f82e40b4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:45.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.459+0000 7f82e9399640 1 --2- 172.21.15.123:0/4259578406 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f82e415dc20 0x7f82e40b4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:45.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.459+0000 7f82e9399640 1 -- 172.21.15.123:0/4259578406 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82e415e080 msgr2=0x7f82e40b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:45.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.459+0000 7f82e9399640 1 --2- 172.21.15.123:0/4259578406 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82e415e080 0x7f82e40b5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:45.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.459+0000 7f82e9399640 1 -- 172.21.15.123:0/4259578406 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e415e600 con 0x7f82d0004d40 2024-09-15T23:18:45.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.459+0000 7f82e9b9a640 1 --2- 172.21.15.123:0/4259578406 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82e415e080 0x7f82e40b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:18:45.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.459+0000 7f82e8b98640 1 --2- 172.21.15.123:0/4259578406 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f82e415dc20 0x7f82e40b4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:18:45.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.459+0000 7f82e9399640 1 --2- 172.21.15.123:0/4259578406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d0004d40 0x7f82e4140370 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f82e0007340 tx=0x7f82e0007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:45.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.459+0000 7f82d9ffb640 1 -- 172.21.15.123:0/4259578406 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e000f8c0 con 0x7f82d0004d40 2024-09-15T23:18:45.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.459+0000 7f82d9ffb640 1 -- 172.21.15.123:0/4259578406 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82e0018070 con 0x7f82d0004d40 2024-09-15T23:18:45.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.459+0000 7f82d9ffb640 1 -- 172.21.15.123:0/4259578406 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e000fce0 con 0x7f82d0004d40 2024-09-15T23:18:45.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.459+0000 7f82eb5fd640 1 -- 172.21.15.123:0/4259578406 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82e415e8e0 con 0x7f82d0004d40 2024-09-15T23:18:45.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.460+0000 7f82eb5fd640 1 -- 172.21.15.123:0/4259578406 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82e41f4ac0 con 0x7f82d0004d40 2024-09-15T23:18:45.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.460+0000 7f82eb5fd640 1 -- 172.21.15.123:0/4259578406 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82e40cdad0 con 0x7f82d0004d40 2024-09-15T23:18:45.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.461+0000 7f82d9ffb640 1 -- 172.21.15.123:0/4259578406 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f82e001d460 con 0x7f82d0004d40 2024-09-15T23:18:45.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.461+0000 7f82d9ffb640 1 --2- 172.21.15.123:0/4259578406 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f82c806c2b0 0x7f82c806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:45.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.461+0000 7f82d9ffb640 1 -- 172.21.15.123:0/4259578406 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5853+0+0 (secure 0 0 0) 0x7f82e008b5e0 con 0x7f82d0004d40 2024-09-15T23:18:45.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.461+0000 7f82e8b98640 1 --2- 172.21.15.123:0/4259578406 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f82c806c2b0 0x7f82c806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:45.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.462+0000 7f82e8b98640 1 --2- 172.21.15.123:0/4259578406 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f82c806c2b0 0x7f82c806e770 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f82e415bba0 tx=0x7f82d4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:45.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.465+0000 7f82d9ffb640 1 -- 172.21.15.123:0/4259578406 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f82e0059cc0 con 0x7f82d0004d40 2024-09-15T23:18:45.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:45.665+0000 7f82eb5fd640 1 -- 172.21.15.123:0/4259578406 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f82e40cc960 con 0x7f82d0004d40 2024-09-15T23:18:46.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.345+0000 7f82d9ffb640 1 -- 172.21.15.123:0/4259578406 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v76) ==== 104+0+0 (secure 0 0 0) 0x7f82e00595c0 con 0x7f82d0004d40 2024-09-15T23:18:46.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.347+0000 7f82eb5fd640 1 -- 172.21.15.123:0/4259578406 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f82c806c2b0 msgr2=0x7f82c806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:46.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.347+0000 7f82eb5fd640 1 --2- 172.21.15.123:0/4259578406 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f82c806c2b0 0x7f82c806e770 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f82e415bba0 tx=0x7f82d4008040 comp rx=0 tx=0).stop 2024-09-15T23:18:46.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.347+0000 7f82eb5fd640 1 -- 172.21.15.123:0/4259578406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d0004d40 msgr2=0x7f82e4140370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:46.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.347+0000 7f82eb5fd640 1 --2- 172.21.15.123:0/4259578406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d0004d40 0x7f82e4140370 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f82e0007340 tx=0x7f82e0007800 comp rx=0 tx=0).stop 2024-09-15T23:18:46.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.347+0000 7f82eb5fd640 1 -- 172.21.15.123:0/4259578406 shutdown_connections 2024-09-15T23:18:46.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.347+0000 7f82eb5fd640 1 --2- 172.21.15.123:0/4259578406 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82e415e080 0x7f82e40b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:46.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.347+0000 7f82eb5fd640 1 --2- 172.21.15.123:0/4259578406 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f82e415dc20 0x7f82e40b4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:46.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.347+0000 7f82eb5fd640 1 --2- 172.21.15.123:0/4259578406 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f82c806c2b0 0x7f82c806e770 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:46.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.347+0000 7f82eb5fd640 1 --2- 172.21.15.123:0/4259578406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82d0004d40 0x7f82e4140370 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:46.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.347+0000 7f82eb5fd640 1 -- 172.21.15.123:0/4259578406 >> 172.21.15.123:0/4259578406 conn(0x7f82e406d0f0 msgr2=0x7f82e40ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:46.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.347+0000 7f82eb5fd640 1 -- 172.21.15.123:0/4259578406 shutdown_connections 2024-09-15T23:18:46.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.347+0000 7f82eb5fd640 1 -- 172.21.15.123:0/4259578406 wait complete. 2024-09-15T23:18:46.360 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T23:18:46.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.502+0000 7f2ae9c42640 1 Processor -- start 2024-09-15T23:18:46.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.502+0000 7f2ae9c42640 1 -- start start 2024-09-15T23:18:46.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.503+0000 7f2ae9c42640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2ae41555b0 0x7f2ae415f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:46.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.503+0000 7f2ae9c42640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2ae4073030 0x7f2ae40b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:46.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.503+0000 7f2ae9c42640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ae40aee10 con 0x7f2ae40ae870 2024-09-15T23:18:46.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.503+0000 7f2ae9c42640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f2ae40af0f0 con 0x7f2ae41555b0 2024-09-15T23:18:46.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.503+0000 7f2ae9c42640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f2ae40af3d0 con 0x7f2ae4073030 2024-09-15T23:18:46.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.503+0000 7f2ae37fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2ae41555b0 0x7f2ae415f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:46.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.503+0000 7f2ae37fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2ae41555b0 0x7f2ae415f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57462/0 (socket says 172.21.15.123:57462) 2024-09-15T23:18:46.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.503+0000 7f2ae37fe640 1 -- 172.21.15.123:0/2825871469 learned_addr learned my addr 172.21.15.123:0/2825871469 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:46.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.503+0000 7f2ae3fff640 1 --2- 172.21.15.123:0/2825871469 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2ae4073030 0x7f2ae40b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:46.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.503+0000 7f2ae37fe640 1 -- 172.21.15.123:0/2825871469 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2ae4073030 msgr2=0x7f2ae40b4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:46.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.503+0000 7f2ae37fe640 1 --2- 172.21.15.123:0/2825871469 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2ae4073030 0x7f2ae40b4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:46.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.503+0000 7f2ae37fe640 1 -- 172.21.15.123:0/2825871469 >> v1:172.21.15.188:6789/0 conn(0x7f2ae40ae870 legacy=0x7f2ae4072920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:46.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.503+0000 7f2ae37fe640 1 -- 172.21.15.123:0/2825871469 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ae40af6b0 con 0x7f2ae41555b0 2024-09-15T23:18:46.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.503+0000 7f2ae3fff640 1 --2- 172.21.15.123:0/2825871469 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2ae4073030 0x7f2ae40b4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:18:46.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.504+0000 7f2ae37fe640 1 --2- 172.21.15.123:0/2825871469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ae41555b0 0x7f2ae415f6a0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4009870 tx=0x7f2ad402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9bfb1d5696d07a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:46.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.504+0000 7f2ae27fc640 1 -- 172.21.15.123:0/2825871469 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4037070 con 0x7f2ae41555b0 2024-09-15T23:18:46.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.504+0000 7f2ae27fc640 1 -- 172.21.15.123:0/2825871469 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ad4032440 con 0x7f2ae41555b0 2024-09-15T23:18:46.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.504+0000 7f2ae27fc640 1 -- 172.21.15.123:0/2825871469 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4032810 con 0x7f2ae41555b0 2024-09-15T23:18:46.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.505+0000 7f2ae9c42640 1 -- 172.21.15.123:0/2825871469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ae41555b0 msgr2=0x7f2ae415f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:46.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.505+0000 7f2ae9c42640 1 --2- 172.21.15.123:0/2825871469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ae41555b0 0x7f2ae415f6a0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4009870 tx=0x7f2ad402a210 comp rx=0 tx=0).stop 2024-09-15T23:18:46.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.505+0000 7f2ae9c42640 1 -- 172.21.15.123:0/2825871469 shutdown_connections 2024-09-15T23:18:46.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.505+0000 7f2ae9c42640 1 --2- 172.21.15.123:0/2825871469 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2ae4073030 0x7f2ae40b4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:46.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.505+0000 7f2ae9c42640 1 --2- 172.21.15.123:0/2825871469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ae41555b0 0x7f2ae415f6a0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:46.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.505+0000 7f2ae9c42640 1 -- 172.21.15.123:0/2825871469 >> 172.21.15.123:0/2825871469 conn(0x7f2ae406c030 msgr2=0x7f2ae406c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:46.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.505+0000 7f2ae9c42640 1 -- 172.21.15.123:0/2825871469 shutdown_connections 2024-09-15T23:18:46.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.505+0000 7f2ae9c42640 1 -- 172.21.15.123:0/2825871469 wait complete. 2024-09-15T23:18:46.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.506+0000 7f2ae9c42640 1 Processor -- start 2024-09-15T23:18:46.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.506+0000 7f2ae9c42640 1 -- start start 2024-09-15T23:18:46.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.507+0000 7f2ae9c42640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2ae4073030 0x7f2ae414c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:46.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.507+0000 7f2ae9c42640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2ae40ae870 0x7f2ae415bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:46.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.507+0000 7f2ae9c42640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ae41555b0 0x7f2ae4159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:46.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.507+0000 7f2ae9c42640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae4155b10 con 0x7f2ae41555b0 2024-09-15T23:18:46.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.507+0000 7f2ae9c42640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae4155990 con 0x7f2ae4073030 2024-09-15T23:18:46.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.507+0000 7f2ae9c42640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f2ae40b5440 con 0x7f2ae40ae870 2024-09-15T23:18:46.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.507+0000 7f2ae3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ae41555b0 0x7f2ae4159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:46.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.507+0000 7f2ae3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ae41555b0 0x7f2ae4159cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57478/0 (socket says 172.21.15.123:57478) 2024-09-15T23:18:46.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.507+0000 7f2ae3fff640 1 -- 172.21.15.123:0/3325766887 learned_addr learned my addr 172.21.15.123:0/3325766887 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:46.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.507+0000 7f2ae37fe640 1 --2- 172.21.15.123:0/3325766887 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2ae4073030 0x7f2ae414c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:46.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.507+0000 7f2ae3fff640 1 -- 172.21.15.123:0/3325766887 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2ae40ae870 msgr2=0x7f2ae415bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:46.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.507+0000 7f2ae2ffd640 1 --2- 172.21.15.123:0/3325766887 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2ae40ae870 0x7f2ae415bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:46.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.507+0000 7f2ae3fff640 1 --2- 172.21.15.123:0/3325766887 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2ae40ae870 0x7f2ae415bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:46.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.507+0000 7f2ae3fff640 1 -- 172.21.15.123:0/3325766887 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2ae4073030 msgr2=0x7f2ae414c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:46.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.507+0000 7f2ae3fff640 1 --2- 172.21.15.123:0/3325766887 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2ae4073030 0x7f2ae414c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:46.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.507+0000 7f2ae3fff640 1 -- 172.21.15.123:0/3325766887 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ae4159460 con 0x7f2ae41555b0 2024-09-15T23:18:46.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.508+0000 7f2ae3fff640 1 --2- 172.21.15.123:0/3325766887 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ae41555b0 0x7f2ae4159cd0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f2adc00cf20 tx=0x7f2adc00a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:46.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.508+0000 7f2acbfff640 1 -- 172.21.15.123:0/3325766887 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2adc01a070 con 0x7f2ae41555b0 2024-09-15T23:18:46.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.508+0000 7f2acbfff640 1 -- 172.21.15.123:0/3325766887 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2adc00d840 con 0x7f2ae41555b0 2024-09-15T23:18:46.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.508+0000 7f2ae9c42640 1 -- 172.21.15.123:0/3325766887 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ae4159740 con 0x7f2ae41555b0 2024-09-15T23:18:46.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.508+0000 7f2acbfff640 1 -- 172.21.15.123:0/3325766887 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2adc00dc30 con 0x7f2ae41555b0 2024-09-15T23:18:46.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.508+0000 7f2ae9c42640 1 -- 172.21.15.123:0/3325766887 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ae415d120 con 0x7f2ae41555b0 2024-09-15T23:18:46.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.509+0000 7f2ae9c42640 1 -- 172.21.15.123:0/3325766887 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ae415d320 con 0x7f2ae41555b0 2024-09-15T23:18:46.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.509+0000 7f2acbfff640 1 -- 172.21.15.123:0/3325766887 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2adc01d070 con 0x7f2ae41555b0 2024-09-15T23:18:46.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.510+0000 7f2acbfff640 1 --2- 172.21.15.123:0/3325766887 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2ad006c2b0 0x7f2ad006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:46.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.510+0000 7f2acbfff640 1 -- 172.21.15.123:0/3325766887 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5853+0+0 (secure 0 0 0) 0x7f2adc08bd70 con 0x7f2ae41555b0 2024-09-15T23:18:46.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.510+0000 7f2ae37fe640 1 --2- 172.21.15.123:0/3325766887 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2ad006c2b0 0x7f2ad006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:46.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.510+0000 7f2ae37fe640 1 --2- 172.21.15.123:0/3325766887 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2ad006c2b0 0x7f2ad006e770 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4034000 tx=0x7f2ad402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:46.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.514+0000 7f2acbfff640 1 -- 172.21.15.123:0/3325766887 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2ae415d320 con 0x7f2ae41555b0 2024-09-15T23:18:46.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:46.678+0000 7f2ae9c42640 1 -- 172.21.15.123:0/3325766887 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2ae4075180 con 0x7f2ae41555b0 2024-09-15T23:18:47.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.346+0000 7f2acbfff640 1 -- 172.21.15.123:0/3325766887 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v120) ==== 181+0+0 (secure 0 0 0) 0x7f2adc05a450 con 0x7f2ae41555b0 2024-09-15T23:18:47.348 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' removed 2024-09-15T23:18:47.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.348+0000 7f2ae9c42640 1 -- 172.21.15.123:0/3325766887 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2ad006c2b0 msgr2=0x7f2ad006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:47.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.348+0000 7f2ae9c42640 1 --2- 172.21.15.123:0/3325766887 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2ad006c2b0 0x7f2ad006e770 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2ad4034000 tx=0x7f2ad402e000 comp rx=0 tx=0).stop 2024-09-15T23:18:47.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.349+0000 7f2ae9c42640 1 -- 172.21.15.123:0/3325766887 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ae41555b0 msgr2=0x7f2ae4159cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:47.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.349+0000 7f2ae9c42640 1 --2- 172.21.15.123:0/3325766887 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ae41555b0 0x7f2ae4159cd0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f2adc00cf20 tx=0x7f2adc00a7d0 comp rx=0 tx=0).stop 2024-09-15T23:18:47.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.349+0000 7f2ae9c42640 1 -- 172.21.15.123:0/3325766887 shutdown_connections 2024-09-15T23:18:47.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.349+0000 7f2ae9c42640 1 --2- 172.21.15.123:0/3325766887 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2ad006c2b0 0x7f2ad006e770 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:47.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.349+0000 7f2ae9c42640 1 --2- 172.21.15.123:0/3325766887 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ae41555b0 0x7f2ae4159cd0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:47.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.349+0000 7f2ae9c42640 1 --2- 172.21.15.123:0/3325766887 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2ae40ae870 0x7f2ae415bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:47.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.349+0000 7f2ae9c42640 1 --2- 172.21.15.123:0/3325766887 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2ae4073030 0x7f2ae414c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:47.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.349+0000 7f2ae9c42640 1 -- 172.21.15.123:0/3325766887 >> 172.21.15.123:0/3325766887 conn(0x7f2ae406c030 msgr2=0x7f2ae4153b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:47.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.349+0000 7f2ae9c42640 1 -- 172.21.15.123:0/3325766887 shutdown_connections 2024-09-15T23:18:47.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.349+0000 7f2ae9c42640 1 -- 172.21.15.123:0/3325766887 wait complete. 2024-09-15T23:18:47.364 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T23:18:47.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.471+0000 7f52fb265640 1 Processor -- start 2024-09-15T23:18:47.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.471+0000 7f52fb265640 1 -- start start 2024-09-15T23:18:47.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.472+0000 7f52fb265640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f52f40b2dc0 0x7f52f40b0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:47.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.472+0000 7f52fb265640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52f4146220 con 0x7f52f41454b0 2024-09-15T23:18:47.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.472+0000 7f52fb265640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52f40cf640 con 0x7f52f40b6000 2024-09-15T23:18:47.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.472+0000 7f52fb265640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f52f40b1920 con 0x7f52f40b2dc0 2024-09-15T23:18:47.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.472+0000 7f52f9001640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f52f41454b0 0x7f52f40b58f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47302/0 (socket says 172.21.15.123:47302) 2024-09-15T23:18:47.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.472+0000 7f52f9001640 1 -- 172.21.15.123:0/4292575971 learned_addr learned my addr 172.21.15.123:0/4292575971 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:18:47.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.472+0000 7f52f9802640 1 --2- 172.21.15.123:0/4292575971 >> v2:172.21.15.188:3300/0 conn(0x7f52f40b2dc0 0x7f52f40b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:47.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.472+0000 7f52ebfff640 1 -- 172.21.15.123:0/4292575971 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1581552694 0 0) 0x7f52f0001110 con 0x7f52f41454b0 2024-09-15T23:18:47.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.473+0000 7f52ebfff640 1 -- 172.21.15.123:0/4292575971 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52e0003520 con 0x7f52f41454b0 2024-09-15T23:18:47.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.473+0000 7f52ebfff640 1 -- 172.21.15.123:0/4292575971 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3367979033 0 0) 0x7f52e0003520 con 0x7f52f41454b0 2024-09-15T23:18:47.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.473+0000 7f52ebfff640 1 -- 172.21.15.123:0/4292575971 >> v2:172.21.15.188:3300/0 conn(0x7f52f40b2dc0 msgr2=0x7f52f40b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:47.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.473+0000 7f52ebfff640 1 --2- 172.21.15.123:0/4292575971 >> v2:172.21.15.188:3300/0 conn(0x7f52f40b2dc0 0x7f52f40b0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:47.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.473+0000 7f52ebfff640 1 -- 172.21.15.123:0/4292575971 >> v1:172.21.15.188:6789/0 conn(0x7f52f40b6000 legacy=0x7f52f40afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:47.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.473+0000 7f52ebfff640 1 -- 172.21.15.123:0/4292575971 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52f40cf8e0 con 0x7f52f41454b0 2024-09-15T23:18:47.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.473+0000 7f52ebfff640 1 -- 172.21.15.123:0/4292575971 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f52f0001840 con 0x7f52f41454b0 2024-09-15T23:18:47.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.473+0000 7f52ebfff640 1 -- 172.21.15.123:0/4292575971 >> v1:172.21.15.123:6789/0 conn(0x7f52f41454b0 legacy=0x7f52f40b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:47.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.473+0000 7f52ebfff640 1 --2- 172.21.15.123:0/4292575971 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52e00039b0 0x7f52e0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:47.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.473+0000 7f52ebfff640 1 --2- 172.21.15.123:0/4292575971 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f52e0004800 0x7f52e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:47.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.473+0000 7f52ebfff640 1 --2- 172.21.15.123:0/4292575971 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f52e00051c0 0x7f52e000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:47.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.473+0000 7f52ebfff640 1 -- 172.21.15.123:0/4292575971 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f52f40b1920 con 0x7f52e00039b0 2024-09-15T23:18:47.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.473+0000 7f52ebfff640 1 -- 172.21.15.123:0/4292575971 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f52e000c070 con 0x7f52e0004800 2024-09-15T23:18:47.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.473+0000 7f52ebfff640 1 -- 172.21.15.123:0/4292575971 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f52e000c270 con 0x7f52e00051c0 2024-09-15T23:18:47.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.473+0000 7f52f9001640 1 --2- 172.21.15.123:0/4292575971 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52e00039b0 0x7f52e0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:47.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.473+0000 7f52f8800640 1 --2- 172.21.15.123:0/4292575971 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f52e0004800 0x7f52e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:47.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.473+0000 7f52f9802640 1 --2- 172.21.15.123:0/4292575971 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f52e00051c0 0x7f52e000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:47.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.473+0000 7f52f9001640 1 -- 172.21.15.123:0/4292575971 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f52e00051c0 msgr2=0x7f52e000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:47.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.473+0000 7f52f9001640 1 --2- 172.21.15.123:0/4292575971 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f52e00051c0 0x7f52e000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:47.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.473+0000 7f52f9001640 1 -- 172.21.15.123:0/4292575971 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f52e0004800 msgr2=0x7f52e0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:47.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.473+0000 7f52f9001640 1 --2- 172.21.15.123:0/4292575971 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f52e0004800 0x7f52e0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:47.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.473+0000 7f52f9001640 1 -- 172.21.15.123:0/4292575971 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e0003520 con 0x7f52e00039b0 2024-09-15T23:18:47.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.473+0000 7f52f9802640 1 --2- 172.21.15.123:0/4292575971 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f52e00051c0 0x7f52e000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:18:47.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.473+0000 7f52f9802640 1 -- 172.21.15.123:0/4292575971 reap_dead start 2024-09-15T23:18:47.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.474+0000 7f52f9001640 1 --2- 172.21.15.123:0/4292575971 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52e00039b0 0x7f52e0003dd0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f52f000c4c0 tx=0x7f52e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f287416d5197bd10 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:47.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.474+0000 7f52ebfff640 1 -- 172.21.15.123:0/4292575971 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f000c0e0 con 0x7f52e00039b0 2024-09-15T23:18:47.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.474+0000 7f52ebfff640 1 -- 172.21.15.123:0/4292575971 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52f0034070 con 0x7f52e00039b0 2024-09-15T23:18:47.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.474+0000 7f52ebfff640 1 -- 172.21.15.123:0/4292575971 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f0005d30 con 0x7f52e00039b0 2024-09-15T23:18:47.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.475+0000 7f52fb265640 1 -- 172.21.15.123:0/4292575971 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52e00039b0 msgr2=0x7f52e0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:47.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.475+0000 7f52fb265640 1 --2- 172.21.15.123:0/4292575971 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52e00039b0 0x7f52e0003dd0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f52f000c4c0 tx=0x7f52e0005830 comp rx=0 tx=0).stop 2024-09-15T23:18:47.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.475+0000 7f52fb265640 1 -- 172.21.15.123:0/4292575971 shutdown_connections 2024-09-15T23:18:47.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.475+0000 7f52fb265640 1 --2- 172.21.15.123:0/4292575971 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52e00039b0 0x7f52e0003dd0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:47.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.475+0000 7f52fb265640 1 -- 172.21.15.123:0/4292575971 >> 172.21.15.123:0/4292575971 conn(0x7f52f406c240 msgr2=0x7f52f406d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:47.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.475+0000 7f52fb265640 1 -- 172.21.15.123:0/4292575971 shutdown_connections 2024-09-15T23:18:47.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.475+0000 7f52fb265640 1 -- 172.21.15.123:0/4292575971 wait complete. 2024-09-15T23:18:47.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.476+0000 7f52fb265640 1 Processor -- start 2024-09-15T23:18:47.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.476+0000 7f52fb265640 1 -- start start 2024-09-15T23:18:47.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.477+0000 7f52fb265640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52e00039b0 0x7f52f413a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:47.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.477+0000 7f52fb265640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f52f415abe0 0x7f52f40b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:47.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.477+0000 7f52fb265640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f52f4140d10 0x7f52f4141190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:47.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.477+0000 7f52fb265640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f52f40d0180 con 0x7f52e00039b0 2024-09-15T23:18:47.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.477+0000 7f52fb265640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f52f40cfea0 con 0x7f52f415abe0 2024-09-15T23:18:47.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.477+0000 7f52fb265640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f52f41459a0 con 0x7f52f4140d10 2024-09-15T23:18:47.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.477+0000 7f52f9001640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52e00039b0 0x7f52f413a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:47.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.477+0000 7f52f9001640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52e00039b0 0x7f52f413a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57496/0 (socket says 172.21.15.123:57496) 2024-09-15T23:18:47.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.477+0000 7f52f9001640 1 -- 172.21.15.123:0/4138746501 learned_addr learned my addr 172.21.15.123:0/4138746501 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:47.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.477+0000 7f52f9001640 1 -- 172.21.15.123:0/4138746501 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f52f4140d10 msgr2=0x7f52f4141190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:47.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.477+0000 7f52f9001640 1 --2- 172.21.15.123:0/4138746501 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f52f4140d10 0x7f52f4141190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:47.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.477+0000 7f52f9001640 1 -- 172.21.15.123:0/4138746501 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f52f415abe0 msgr2=0x7f52f40b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:47.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.477+0000 7f52f9001640 1 --2- 172.21.15.123:0/4138746501 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f52f415abe0 0x7f52f40b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:47.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.477+0000 7f52f9001640 1 -- 172.21.15.123:0/4138746501 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52f415b440 con 0x7f52e00039b0 2024-09-15T23:18:47.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.477+0000 7f52f9001640 1 --2- 172.21.15.123:0/4138746501 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52e00039b0 0x7f52f413a1d0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f52f000c4c0 tx=0x7f52f40b1890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:47.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.477+0000 7f52e9ffb640 1 -- 172.21.15.123:0/4138746501 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f0007270 con 0x7f52e00039b0 2024-09-15T23:18:47.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.477+0000 7f52e9ffb640 1 -- 172.21.15.123:0/4138746501 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52f003f070 con 0x7f52e00039b0 2024-09-15T23:18:47.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.477+0000 7f52fb265640 1 -- 172.21.15.123:0/4138746501 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52f41396f0 con 0x7f52e00039b0 2024-09-15T23:18:47.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.478+0000 7f52e9ffb640 1 -- 172.21.15.123:0/4138746501 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f0007610 con 0x7f52e00039b0 2024-09-15T23:18:47.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.478+0000 7f52fb265640 1 -- 172.21.15.123:0/4138746501 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52f4139cb0 con 0x7f52e00039b0 2024-09-15T23:18:47.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.479+0000 7f52fb265640 1 -- 172.21.15.123:0/4138746501 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52f41436b0 con 0x7f52e00039b0 2024-09-15T23:18:47.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.479+0000 7f52e9ffb640 1 -- 172.21.15.123:0/4138746501 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f52f003b420 con 0x7f52e00039b0 2024-09-15T23:18:47.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.480+0000 7f52e9ffb640 1 --2- 172.21.15.123:0/4138746501 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f52d806c2e0 0x7f52d806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:47.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.480+0000 7f52e9ffb640 1 -- 172.21.15.123:0/4138746501 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5357+0+0 (secure 0 0 0) 0x7f52f00ac080 con 0x7f52e00039b0 2024-09-15T23:18:47.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.480+0000 7f52f8800640 1 --2- 172.21.15.123:0/4138746501 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f52d806c2e0 0x7f52d806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:47.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.480+0000 7f52f8800640 1 --2- 172.21.15.123:0/4138746501 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f52d806c2e0 0x7f52d806e7a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f52e4000c00 tx=0x7f52e4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:47.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.484+0000 7f52e9ffb640 1 -- 172.21.15.123:0/4138746501 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f52f41436b0 con 0x7f52e00039b0 2024-09-15T23:18:47.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:47.650+0000 7f52fb265640 1 -- 172.21.15.123:0/4138746501 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f52f40b58f0 con 0x7f52e00039b0 2024-09-15T23:18:48.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.350+0000 7f52e9ffb640 1 -- 172.21.15.123:0/4138746501 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v121) ==== 169+0+0 (secure 0 0 0) 0x7f52f0049060 con 0x7f52e00039b0 2024-09-15T23:18:48.353 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' removed 2024-09-15T23:18:48.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.356+0000 7f52fb265640 1 -- 172.21.15.123:0/4138746501 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f52d806c2e0 msgr2=0x7f52d806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:48.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.356+0000 7f52fb265640 1 --2- 172.21.15.123:0/4138746501 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f52d806c2e0 0x7f52d806e7a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f52e4000c00 tx=0x7f52e4009040 comp rx=0 tx=0).stop 2024-09-15T23:18:48.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.356+0000 7f52fb265640 1 -- 172.21.15.123:0/4138746501 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52e00039b0 msgr2=0x7f52f413a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:48.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.356+0000 7f52fb265640 1 --2- 172.21.15.123:0/4138746501 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52e00039b0 0x7f52f413a1d0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f52f000c4c0 tx=0x7f52f40b1890 comp rx=0 tx=0).stop 2024-09-15T23:18:48.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.357+0000 7f52fb265640 1 -- 172.21.15.123:0/4138746501 shutdown_connections 2024-09-15T23:18:48.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.357+0000 7f52fb265640 1 --2- 172.21.15.123:0/4138746501 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f52f4140d10 0x7f52f4141190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:48.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.357+0000 7f52fb265640 1 --2- 172.21.15.123:0/4138746501 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f52f415abe0 0x7f52f40b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:48.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.357+0000 7f52fb265640 1 --2- 172.21.15.123:0/4138746501 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f52d806c2e0 0x7f52d806e7a0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:48.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.357+0000 7f52fb265640 1 --2- 172.21.15.123:0/4138746501 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52e00039b0 0x7f52f413a1d0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:48.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.357+0000 7f52fb265640 1 -- 172.21.15.123:0/4138746501 >> 172.21.15.123:0/4138746501 conn(0x7f52f406c240 msgr2=0x7f52f4072920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:48.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.358+0000 7f52fb265640 1 -- 172.21.15.123:0/4138746501 shutdown_connections 2024-09-15T23:18:48.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.358+0000 7f52fb265640 1 -- 172.21.15.123:0/4138746501 wait complete. 2024-09-15T23:18:48.377 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T23:18:48.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.476+0000 7f75cbf78640 1 Processor -- start 2024-09-15T23:18:48.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.477+0000 7f75cbf78640 1 -- start start 2024-09-15T23:18:48.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.477+0000 7f75cbf78640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75c415c160 0x7f75c40713a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:48.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.478+0000 7f75cbf78640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75c415f0c0 con 0x7f75c40724c0 2024-09-15T23:18:48.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.478+0000 7f75cbf78640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75c415f3a0 con 0x7f75c415ec00 2024-09-15T23:18:48.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.478+0000 7f75cbf78640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f75c415f680 con 0x7f75c415c160 2024-09-15T23:18:48.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.478+0000 7f75ca515640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f75c40724c0 0x7f75c41601a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47314/0 (socket says 172.21.15.123:47314) 2024-09-15T23:18:48.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.478+0000 7f75ca515640 1 -- 172.21.15.123:0/878522635 learned_addr learned my addr 172.21.15.123:0/878522635 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:18:48.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.478+0000 7f75c8d12640 1 -- 172.21.15.123:0/878522635 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2846938142 0 0) 0x7f75c415f0c0 con 0x7f75c40724c0 2024-09-15T23:18:48.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.478+0000 7f75c8d12640 1 -- 172.21.15.123:0/878522635 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75b0003520 con 0x7f75c40724c0 2024-09-15T23:18:48.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.478+0000 7f75c9d14640 1 --2- 172.21.15.123:0/878522635 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75c415c160 0x7f75c40713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:48.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.478+0000 7f75c8d12640 1 -- 172.21.15.123:0/878522635 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2895633439 0 0) 0x7f75b0003520 con 0x7f75c40724c0 2024-09-15T23:18:48.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.478+0000 7f75c8d12640 1 -- 172.21.15.123:0/878522635 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75c415c160 msgr2=0x7f75c40713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:48.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.478+0000 7f75c8d12640 1 --2- 172.21.15.123:0/878522635 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75c415c160 0x7f75c40713a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:48.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.478+0000 7f75c8d12640 1 -- 172.21.15.123:0/878522635 >> v1:172.21.15.188:6789/0 conn(0x7f75c415ec00 legacy=0x7f75c4071db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:48.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.478+0000 7f75c8d12640 1 -- 172.21.15.123:0/878522635 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c415f960 con 0x7f75c40724c0 2024-09-15T23:18:48.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.478+0000 7f75c8d12640 1 -- 172.21.15.123:0/878522635 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f75bc0019f0 con 0x7f75c40724c0 2024-09-15T23:18:48.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.478+0000 7f75c8d12640 1 -- 172.21.15.123:0/878522635 >> v1:172.21.15.123:6789/0 conn(0x7f75c40724c0 legacy=0x7f75c41601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:48.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.478+0000 7f75c8d12640 1 --2- 172.21.15.123:0/878522635 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75b00039e0 0x7f75b0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:48.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.478+0000 7f75c8d12640 1 --2- 172.21.15.123:0/878522635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75b0004800 0x7f75b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:48.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.478+0000 7f75c8d12640 1 --2- 172.21.15.123:0/878522635 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75c415c160 0x7f75b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:48.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.478+0000 7f75c8d12640 1 -- 172.21.15.123:0/878522635 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f75c415f680 con 0x7f75b0004800 2024-09-15T23:18:48.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.478+0000 7f75c8d12640 1 -- 172.21.15.123:0/878522635 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f75b000ba70 con 0x7f75b00039e0 2024-09-15T23:18:48.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.478+0000 7f75c8d12640 1 -- 172.21.15.123:0/878522635 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f75b000bc70 con 0x7f75c415c160 2024-09-15T23:18:48.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.478+0000 7f75c9513640 1 --2- 172.21.15.123:0/878522635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75b0004800 0x7f75b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:48.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.478+0000 7f75c9d14640 1 --2- 172.21.15.123:0/878522635 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75b00039e0 0x7f75b0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:48.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.478+0000 7f75ca515640 1 --2- 172.21.15.123:0/878522635 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75c415c160 0x7f75b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:48.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.479+0000 7f75c9513640 1 -- 172.21.15.123:0/878522635 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75c415c160 msgr2=0x7f75b00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:48.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.479+0000 7f75c9513640 1 --2- 172.21.15.123:0/878522635 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75c415c160 0x7f75b00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:48.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.479+0000 7f75c9513640 1 -- 172.21.15.123:0/878522635 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75b00039e0 msgr2=0x7f75b0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:48.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.479+0000 7f75c9513640 1 --2- 172.21.15.123:0/878522635 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75b00039e0 0x7f75b0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:48.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.479+0000 7f75c9513640 1 -- 172.21.15.123:0/878522635 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75b0003520 con 0x7f75b0004800 2024-09-15T23:18:48.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.479+0000 7f75ca515640 1 --2- 172.21.15.123:0/878522635 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75c415c160 0x7f75b00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:18:48.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.479+0000 7f75c9513640 1 --2- 172.21.15.123:0/878522635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75b0004800 0x7f75b0004c80 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f75c40b24c0 tx=0x7f75b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f522eda8bbb9fb70 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:48.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.479+0000 7f75c8d12640 1 -- 172.21.15.123:0/878522635 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c0001370 con 0x7f75b0004800 2024-09-15T23:18:48.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.479+0000 7f75c8d12640 1 -- 172.21.15.123:0/878522635 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75c00052d0 con 0x7f75b0004800 2024-09-15T23:18:48.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.479+0000 7f75c8d12640 1 -- 172.21.15.123:0/878522635 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c002ab00 con 0x7f75b0004800 2024-09-15T23:18:48.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.480+0000 7f75cbf78640 1 -- 172.21.15.123:0/878522635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75b0004800 msgr2=0x7f75b0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:48.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.480+0000 7f75cbf78640 1 --2- 172.21.15.123:0/878522635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75b0004800 0x7f75b0004c80 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f75c40b24c0 tx=0x7f75b0005830 comp rx=0 tx=0).stop 2024-09-15T23:18:48.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.480+0000 7f75ca515640 1 -- 172.21.15.123:0/878522635 reap_dead start 2024-09-15T23:18:48.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.480+0000 7f75cbf78640 1 -- 172.21.15.123:0/878522635 shutdown_connections 2024-09-15T23:18:48.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.480+0000 7f75cbf78640 1 -- 172.21.15.123:0/878522635 >> 172.21.15.123:0/878522635 conn(0x7f75c40b2510 msgr2=0x7f75c40b28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:48.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.480+0000 7f75cbf78640 1 -- 172.21.15.123:0/878522635 shutdown_connections 2024-09-15T23:18:48.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.480+0000 7f75cbf78640 1 -- 172.21.15.123:0/878522635 wait complete. 2024-09-15T23:18:48.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.481+0000 7f75cbf78640 1 Processor -- start 2024-09-15T23:18:48.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.481+0000 7f75cbf78640 1 -- start start 2024-09-15T23:18:48.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.482+0000 7f75cbf78640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75b0004800 0x7f75c40cde90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:48.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.482+0000 7f75cbf78640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75c414d380 0x7f75c40cf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:48.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.482+0000 7f75cbf78640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75c4158f00 0x7f75c4159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:48.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.482+0000 7f75cbf78640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f75c4071520 con 0x7f75b0004800 2024-09-15T23:18:48.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.482+0000 7f75cbf78640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f75c40713a0 con 0x7f75c4158f00 2024-09-15T23:18:48.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.482+0000 7f75cbf78640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f75c40716a0 con 0x7f75c414d380 2024-09-15T23:18:48.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.482+0000 7f75c9d14640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75b0004800 0x7f75c40cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:48.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.482+0000 7f75c9d14640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75b0004800 0x7f75c40cde90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57524/0 (socket says 172.21.15.123:57524) 2024-09-15T23:18:48.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.482+0000 7f75c9d14640 1 -- 172.21.15.123:0/1829517324 learned_addr learned my addr 172.21.15.123:0/1829517324 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:48.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.482+0000 7f75ca515640 1 --2- 172.21.15.123:0/1829517324 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75c4158f00 0x7f75c4159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:48.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.482+0000 7f75c9513640 1 --2- 172.21.15.123:0/1829517324 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75c414d380 0x7f75c40cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:48.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.482+0000 7f75c9d14640 1 -- 172.21.15.123:0/1829517324 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75c414d380 msgr2=0x7f75c40cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:48.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.482+0000 7f75c9d14640 1 --2- 172.21.15.123:0/1829517324 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75c414d380 0x7f75c40cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:48.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.482+0000 7f75c9d14640 1 -- 172.21.15.123:0/1829517324 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75c4158f00 msgr2=0x7f75c4159380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:48.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.482+0000 7f75c9d14640 1 --2- 172.21.15.123:0/1829517324 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75c4158f00 0x7f75c4159380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:48.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.482+0000 7f75c9d14640 1 -- 172.21.15.123:0/1829517324 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c414d800 con 0x7f75b0004800 2024-09-15T23:18:48.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.482+0000 7f75c9d14640 1 --2- 172.21.15.123:0/1829517324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75b0004800 0x7f75c40cde90 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f75b80119a0 tx=0x7f75b8011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:48.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.483+0000 7f75b67fc640 1 -- 172.21.15.123:0/1829517324 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b800fa90 con 0x7f75b0004800 2024-09-15T23:18:48.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.483+0000 7f75b67fc640 1 -- 172.21.15.123:0/1829517324 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75b800fc30 con 0x7f75b0004800 2024-09-15T23:18:48.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.483+0000 7f75cbf78640 1 -- 172.21.15.123:0/1829517324 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75c41f4610 con 0x7f75b0004800 2024-09-15T23:18:48.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.483+0000 7f75b67fc640 1 -- 172.21.15.123:0/1829517324 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b8014440 con 0x7f75b0004800 2024-09-15T23:18:48.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.483+0000 7f75cbf78640 1 -- 172.21.15.123:0/1829517324 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75c41f4bd0 con 0x7f75b0004800 2024-09-15T23:18:48.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.484+0000 7f75cbf78640 1 -- 172.21.15.123:0/1829517324 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75c4071db0 con 0x7f75b0004800 2024-09-15T23:18:48.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.484+0000 7f75b67fc640 1 -- 172.21.15.123:0/1829517324 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f75b8012040 con 0x7f75b0004800 2024-09-15T23:18:48.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.484+0000 7f75b67fc640 1 --2- 172.21.15.123:0/1829517324 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f75a806c2e0 0x7f75a806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:48.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.485+0000 7f75b67fc640 1 -- 172.21.15.123:0/1829517324 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4943+0+0 (secure 0 0 0) 0x7f75b808b770 con 0x7f75b0004800 2024-09-15T23:18:48.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.485+0000 7f75c9513640 1 --2- 172.21.15.123:0/1829517324 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f75a806c2e0 0x7f75a806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:48.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.485+0000 7f75c9513640 1 --2- 172.21.15.123:0/1829517324 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f75a806c2e0 0x7f75a806e7a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f75c0032000 tx=0x7f75c002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:48.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.489+0000 7f75b67fc640 1 -- 172.21.15.123:0/1829517324 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f75b8019030 con 0x7f75b0004800 2024-09-15T23:18:48.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.660+0000 7f75cbf78640 1 -- 172.21.15.123:0/1829517324 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f75c406f060 con 0x7f75b0004800 2024-09-15T23:18:48.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.663+0000 7f75b67fc640 1 -- 172.21.15.123:0/1829517324 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v35) ==== 104+0+0 (secure 0 0 0) 0x7f75b805a1e0 con 0x7f75b0004800 2024-09-15T23:18:48.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.665+0000 7f75cbf78640 1 -- 172.21.15.123:0/1829517324 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f75a806c2e0 msgr2=0x7f75a806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:48.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.665+0000 7f75cbf78640 1 --2- 172.21.15.123:0/1829517324 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f75a806c2e0 0x7f75a806e7a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f75c0032000 tx=0x7f75c002e000 comp rx=0 tx=0).stop 2024-09-15T23:18:48.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.665+0000 7f75cbf78640 1 -- 172.21.15.123:0/1829517324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75b0004800 msgr2=0x7f75c40cde90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:48.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.665+0000 7f75cbf78640 1 --2- 172.21.15.123:0/1829517324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75b0004800 0x7f75c40cde90 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f75b80119a0 tx=0x7f75b8011e60 comp rx=0 tx=0).stop 2024-09-15T23:18:48.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.665+0000 7f75cbf78640 1 -- 172.21.15.123:0/1829517324 shutdown_connections 2024-09-15T23:18:48.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.665+0000 7f75cbf78640 1 --2- 172.21.15.123:0/1829517324 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75c4158f00 0x7f75c4159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:48.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.665+0000 7f75cbf78640 1 --2- 172.21.15.123:0/1829517324 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75c414d380 0x7f75c40cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:48.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.665+0000 7f75cbf78640 1 --2- 172.21.15.123:0/1829517324 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f75a806c2e0 0x7f75a806e7a0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:48.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.665+0000 7f75cbf78640 1 --2- 172.21.15.123:0/1829517324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75b0004800 0x7f75c40cde90 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:48.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.665+0000 7f75cbf78640 1 -- 172.21.15.123:0/1829517324 >> 172.21.15.123:0/1829517324 conn(0x7f75c40b2510 msgr2=0x7f75c406d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:48.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.665+0000 7f75cbf78640 1 -- 172.21.15.123:0/1829517324 shutdown_connections 2024-09-15T23:18:48.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.665+0000 7f75cbf78640 1 -- 172.21.15.123:0/1829517324 wait complete. 2024-09-15T23:18:48.678 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub' 2024-09-15T23:18:48.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.773+0000 7f5525368640 1 Processor -- start 2024-09-15T23:18:48.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.774+0000 7f5525368640 1 -- start start 2024-09-15T23:18:48.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.774+0000 7f5525368640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f55200d23b0 0x7f55200b87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:48.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.774+0000 7f5525368640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55200d0e70 con 0x7f552015ed20 2024-09-15T23:18:48.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.774+0000 7f5525368640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55200d41c0 con 0x7f55200b6970 2024-09-15T23:18:48.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.774+0000 7f5525368640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f55200d35b0 con 0x7f55200d23b0 2024-09-15T23:18:48.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.774+0000 7f551f7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f55200d23b0 0x7f55200b87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:48.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.774+0000 7f551f7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f55200d23b0 0x7f55200b87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57530/0 (socket says 172.21.15.123:57530) 2024-09-15T23:18:48.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.774+0000 7f551effd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f552015ed20 0x7f55200b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47322/0 (socket says 172.21.15.123:47322) 2024-09-15T23:18:48.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.774+0000 7f551f7fe640 1 -- 172.21.15.123:0/1408707673 learned_addr learned my addr 172.21.15.123:0/1408707673 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:48.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.775+0000 7f551f7fe640 1 -- 172.21.15.123:0/1408707673 >> v1:172.21.15.188:6789/0 conn(0x7f55200b6970 legacy=0x7f55200b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:48.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.775+0000 7f551f7fe640 1 -- 172.21.15.123:0/1408707673 >> v1:172.21.15.123:6789/0 conn(0x7f552015ed20 legacy=0x7f55200b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:48.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.775+0000 7f551dffb640 1 -- 172.21.15.123:0/1408707673 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4291967085 0 0) 0x7f5510001490 con 0x7f552015ed20 2024-09-15T23:18:48.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.775+0000 7f551f7fe640 1 -- 172.21.15.123:0/1408707673 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55200d3890 con 0x7f55200d23b0 2024-09-15T23:18:48.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.775+0000 7f551f7fe640 1 --2- 172.21.15.123:0/1408707673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55200d23b0 0x7f55200b87e0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f5518009870 tx=0x7f551802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0cf8571cd49b21a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:48.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.776+0000 7f551dffb640 1 -- 172.21.15.123:0/1408707673 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5518037070 con 0x7f55200d23b0 2024-09-15T23:18:48.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.776+0000 7f551dffb640 1 -- 172.21.15.123:0/1408707673 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5518032440 con 0x7f55200d23b0 2024-09-15T23:18:48.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.776+0000 7f551dffb640 1 -- 172.21.15.123:0/1408707673 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5518032810 con 0x7f55200d23b0 2024-09-15T23:18:48.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.776+0000 7f5525368640 1 -- 172.21.15.123:0/1408707673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55200d23b0 msgr2=0x7f55200b87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:48.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.776+0000 7f5525368640 1 --2- 172.21.15.123:0/1408707673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55200d23b0 0x7f55200b87e0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f5518009870 tx=0x7f551802a210 comp rx=0 tx=0).stop 2024-09-15T23:18:48.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.776+0000 7f5525368640 1 -- 172.21.15.123:0/1408707673 shutdown_connections 2024-09-15T23:18:48.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.776+0000 7f5525368640 1 --2- 172.21.15.123:0/1408707673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55200d23b0 0x7f55200b87e0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:48.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.776+0000 7f5525368640 1 -- 172.21.15.123:0/1408707673 >> 172.21.15.123:0/1408707673 conn(0x7f55200d1260 msgr2=0x7f55200d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:48.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.776+0000 7f5525368640 1 -- 172.21.15.123:0/1408707673 shutdown_connections 2024-09-15T23:18:48.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.776+0000 7f5525368640 1 -- 172.21.15.123:0/1408707673 wait complete. 2024-09-15T23:18:48.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.778+0000 7f5525368640 1 Processor -- start 2024-09-15T23:18:48.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.778+0000 7f5525368640 1 -- start start 2024-09-15T23:18:48.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.778+0000 7f5525368640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f55200b6970 0x7f55200ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:48.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.778+0000 7f5525368640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55200d23b0 0x7f55200cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:48.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.778+0000 7f5525368640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f552015ed20 0x7f552015b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:48.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.778+0000 7f5525368640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f55200d32a0 con 0x7f55200d23b0 2024-09-15T23:18:48.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.778+0000 7f5525368640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f55200d3e50 con 0x7f552015ed20 2024-09-15T23:18:48.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.778+0000 7f5525368640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f552015f100 con 0x7f55200b6970 2024-09-15T23:18:48.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.778+0000 7f551e7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55200d23b0 0x7f55200cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:48.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.778+0000 7f551e7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55200d23b0 0x7f55200cb8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57542/0 (socket says 172.21.15.123:57542) 2024-09-15T23:18:48.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.778+0000 7f551e7fc640 1 -- 172.21.15.123:0/4013570800 learned_addr learned my addr 172.21.15.123:0/4013570800 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:48.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.779+0000 7f551e7fc640 1 -- 172.21.15.123:0/4013570800 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f55200b6970 msgr2=0x7f55200ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:48.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.779+0000 7f551e7fc640 1 --2- 172.21.15.123:0/4013570800 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f55200b6970 0x7f55200ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:48.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.779+0000 7f551e7fc640 1 -- 172.21.15.123:0/4013570800 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f552015ed20 msgr2=0x7f552015b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:48.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.779+0000 7f551e7fc640 1 --2- 172.21.15.123:0/4013570800 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f552015ed20 0x7f552015b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:48.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.779+0000 7f551e7fc640 1 -- 172.21.15.123:0/4013570800 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55200cbeb0 con 0x7f55200d23b0 2024-09-15T23:18:48.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.779+0000 7f551e7fc640 1 --2- 172.21.15.123:0/4013570800 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55200d23b0 0x7f55200cb8b0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f551400c440 tx=0x7f551400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:48.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.779+0000 7f55077fe640 1 -- 172.21.15.123:0/4013570800 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5514017070 con 0x7f55200d23b0 2024-09-15T23:18:48.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.779+0000 7f55077fe640 1 -- 172.21.15.123:0/4013570800 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55140035f0 con 0x7f55200d23b0 2024-09-15T23:18:48.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.779+0000 7f55077fe640 1 -- 172.21.15.123:0/4013570800 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55140039e0 con 0x7f55200d23b0 2024-09-15T23:18:48.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.779+0000 7f5525368640 1 -- 172.21.15.123:0/4013570800 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55200cc190 con 0x7f55200d23b0 2024-09-15T23:18:48.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.779+0000 7f5525368640 1 -- 172.21.15.123:0/4013570800 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55200cc750 con 0x7f55200d23b0 2024-09-15T23:18:48.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.780+0000 7f5525368640 1 -- 172.21.15.123:0/4013570800 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55200b7010 con 0x7f55200d23b0 2024-09-15T23:18:48.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.781+0000 7f55077fe640 1 -- 172.21.15.123:0/4013570800 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f551401a070 con 0x7f55200d23b0 2024-09-15T23:18:48.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.781+0000 7f55077fe640 1 --2- 172.21.15.123:0/4013570800 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f550c06c2b0 0x7f550c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:48.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.781+0000 7f55077fe640 1 -- 172.21.15.123:0/4013570800 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4943+0+0 (secure 0 0 0) 0x7f551408a4f0 con 0x7f55200d23b0 2024-09-15T23:18:48.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.781+0000 7f551effd640 1 --2- 172.21.15.123:0/4013570800 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f550c06c2b0 0x7f550c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:48.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.782+0000 7f551effd640 1 --2- 172.21.15.123:0/4013570800 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f550c06c2b0 0x7f550c06e770 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f5510007fd0 tx=0x7f5510007ce0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:48.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:48.785+0000 7f55077fe640 1 -- 172.21.15.123:0/4013570800 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5514058f60 con 0x7f55200d23b0 2024-09-15T23:18:49.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.014+0000 7f5525368640 1 -- 172.21.15.123:0/4013570800 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]} v 0) -- 0x7f55200b3f20 con 0x7f55200d23b0 2024-09-15T23:18:49.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.351+0000 7f55077fe640 1 -- 172.21.15.123:0/4013570800 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]}]=0 v330) ==== 158+0+0 (secure 0 0 0) 0x7f55140010c0 con 0x7f55200d23b0 2024-09-15T23:18:49.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.354+0000 7f5525368640 1 -- 172.21.15.123:0/4013570800 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f550c06c2b0 msgr2=0x7f550c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:49.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.354+0000 7f5525368640 1 --2- 172.21.15.123:0/4013570800 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f550c06c2b0 0x7f550c06e770 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f5510007fd0 tx=0x7f5510007ce0 comp rx=0 tx=0).stop 2024-09-15T23:18:49.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.354+0000 7f5525368640 1 -- 172.21.15.123:0/4013570800 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55200d23b0 msgr2=0x7f55200cb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:49.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.354+0000 7f5525368640 1 --2- 172.21.15.123:0/4013570800 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55200d23b0 0x7f55200cb8b0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f551400c440 tx=0x7f551400c900 comp rx=0 tx=0).stop 2024-09-15T23:18:49.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.354+0000 7f5525368640 1 -- 172.21.15.123:0/4013570800 shutdown_connections 2024-09-15T23:18:49.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.354+0000 7f5525368640 1 --2- 172.21.15.123:0/4013570800 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f552015ed20 0x7f552015b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:49.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.354+0000 7f5525368640 1 --2- 172.21.15.123:0/4013570800 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f550c06c2b0 0x7f550c06e770 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:49.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.354+0000 7f5525368640 1 --2- 172.21.15.123:0/4013570800 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55200d23b0 0x7f55200cb8b0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:49.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.354+0000 7f5525368640 1 --2- 172.21.15.123:0/4013570800 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f55200b6970 0x7f55200ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:49.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.354+0000 7f5525368640 1 -- 172.21.15.123:0/4013570800 >> 172.21.15.123:0/4013570800 conn(0x7f55200d1260 msgr2=0x7f55200b50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:49.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.354+0000 7f5525368640 1 -- 172.21.15.123:0/4013570800 shutdown_connections 2024-09-15T23:18:49.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.354+0000 7f5525368640 1 -- 172.21.15.123:0/4013570800 wait complete. 2024-09-15T23:18:49.367 INFO:tasks.cephfs_test_runner:test that scrub can iterate over ~mdsdir and evaluate strays ... ok 2024-09-15T23:18:49.368 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-15T23:18:49.368 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:18:49.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.465+0000 7fddaf81e640 1 Processor -- start 2024-09-15T23:18:49.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.465+0000 7fddaf81e640 1 -- start start 2024-09-15T23:18:49.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.466+0000 7fddaf81e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdda8073890 0x7fdda80b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:49.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.466+0000 7fddaf81e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdda80b4020 con 0x7fdda8145ed0 2024-09-15T23:18:49.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.466+0000 7fddaf81e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdda80b42c0 con 0x7fdda80b5880 2024-09-15T23:18:49.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.466+0000 7fddaf81e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fdda80b45a0 con 0x7fdda8073890 2024-09-15T23:18:49.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.466+0000 7fddad5ba640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fdda8145ed0 0x7fdda8073180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47326/0 (socket says 172.21.15.123:47326) 2024-09-15T23:18:49.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.466+0000 7fddad5ba640 1 -- 172.21.15.123:0/694439028 learned_addr learned my addr 172.21.15.123:0/694439028 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:18:49.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.466+0000 7fddacdb9640 1 --2- 172.21.15.123:0/694439028 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdda8073890 0x7fdda80b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:49.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.466+0000 7fdd9ffff640 1 -- 172.21.15.123:0/694439028 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3159804030 0 0) 0x7fdda80b4020 con 0x7fdda8145ed0 2024-09-15T23:18:49.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.466+0000 7fdd9ffff640 1 -- 172.21.15.123:0/694439028 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd94003520 con 0x7fdda8145ed0 2024-09-15T23:18:49.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.467+0000 7fdd9ffff640 1 -- 172.21.15.123:0/694439028 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3805227863 0 0) 0x7fdd94003520 con 0x7fdda8145ed0 2024-09-15T23:18:49.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.467+0000 7fdd9ffff640 1 -- 172.21.15.123:0/694439028 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdda8073890 msgr2=0x7fdda80b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:49.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.467+0000 7fdd9ffff640 1 --2- 172.21.15.123:0/694439028 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdda8073890 0x7fdda80b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:49.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.467+0000 7fdd9ffff640 1 -- 172.21.15.123:0/694439028 >> v1:172.21.15.188:6789/0 conn(0x7fdda80b5880 legacy=0x7fdda80b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:49.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.467+0000 7fdd9ffff640 1 -- 172.21.15.123:0/694439028 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda80b4880 con 0x7fdda8145ed0 2024-09-15T23:18:49.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.467+0000 7fdd9ffff640 1 -- 172.21.15.123:0/694439028 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fdda40019f0 con 0x7fdda8145ed0 2024-09-15T23:18:49.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.467+0000 7fdd9ffff640 1 -- 172.21.15.123:0/694439028 >> v1:172.21.15.123:6789/0 conn(0x7fdda8145ed0 legacy=0x7fdda8073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:49.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.467+0000 7fdd9ffff640 1 --2- 172.21.15.123:0/694439028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdd940039e0 0x7fdd94003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:49.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.467+0000 7fdd9ffff640 1 --2- 172.21.15.123:0/694439028 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdda8073890 0x7fdd94004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:49.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.467+0000 7fdd9ffff640 1 --2- 172.21.15.123:0/694439028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd94004d40 0x7fdd940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:49.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.467+0000 7fdd9ffff640 1 -- 172.21.15.123:0/694439028 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdda80b45a0 con 0x7fdd94004d40 2024-09-15T23:18:49.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.467+0000 7fdd9ffff640 1 -- 172.21.15.123:0/694439028 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fdd9400fe80 con 0x7fdd940039e0 2024-09-15T23:18:49.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.467+0000 7fdd9ffff640 1 -- 172.21.15.123:0/694439028 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fdd94010080 con 0x7fdda8073890 2024-09-15T23:18:49.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.467+0000 7fddaddbb640 1 --2- 172.21.15.123:0/694439028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd94004d40 0x7fdd940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:49.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.467+0000 7fddad5ba640 1 --2- 172.21.15.123:0/694439028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdd940039e0 0x7fdd94003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:49.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.467+0000 7fddacdb9640 1 --2- 172.21.15.123:0/694439028 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdda8073890 0x7fdd94004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:49.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.467+0000 7fddaddbb640 1 -- 172.21.15.123:0/694439028 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdda8073890 msgr2=0x7fdd94004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:49.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.467+0000 7fddaddbb640 1 --2- 172.21.15.123:0/694439028 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdda8073890 0x7fdd94004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:49.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.467+0000 7fddaddbb640 1 -- 172.21.15.123:0/694439028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdd940039e0 msgr2=0x7fdd94003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:49.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.467+0000 7fddaddbb640 1 --2- 172.21.15.123:0/694439028 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdd940039e0 0x7fdd94003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:49.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.467+0000 7fddaddbb640 1 -- 172.21.15.123:0/694439028 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd94003520 con 0x7fdd94004d40 2024-09-15T23:18:49.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.468+0000 7fddaddbb640 1 --2- 172.21.15.123:0/694439028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd94004d40 0x7fdd940051c0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fdda0001720 tx=0x7fdd94005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9eb1836eb5eb29 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:49.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.468+0000 7fdd9ffff640 1 -- 172.21.15.123:0/694439028 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda0001370 con 0x7fdd94004d40 2024-09-15T23:18:49.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.468+0000 7fdd9ffff640 1 -- 172.21.15.123:0/694439028 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdda00052d0 con 0x7fdd94004d40 2024-09-15T23:18:49.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.468+0000 7fdd9ffff640 1 -- 172.21.15.123:0/694439028 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda002abc0 con 0x7fdd94004d40 2024-09-15T23:18:49.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.468+0000 7fddaf81e640 1 -- 172.21.15.123:0/694439028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd94004d40 msgr2=0x7fdd940051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:49.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.468+0000 7fddaf81e640 1 --2- 172.21.15.123:0/694439028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd94004d40 0x7fdd940051c0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fdda0001720 tx=0x7fdd94005830 comp rx=0 tx=0).stop 2024-09-15T23:18:49.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.468+0000 7fddaddbb640 1 -- 172.21.15.123:0/694439028 reap_dead start 2024-09-15T23:18:49.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.468+0000 7fddaf81e640 1 -- 172.21.15.123:0/694439028 shutdown_connections 2024-09-15T23:18:49.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.468+0000 7fddaf81e640 1 -- 172.21.15.123:0/694439028 >> 172.21.15.123:0/694439028 conn(0x7fdda80ccec0 msgr2=0x7fdda80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:49.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.469+0000 7fddaf81e640 1 -- 172.21.15.123:0/694439028 shutdown_connections 2024-09-15T23:18:49.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.469+0000 7fddaf81e640 1 -- 172.21.15.123:0/694439028 wait complete. 2024-09-15T23:18:49.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.470+0000 7fddaf81e640 1 Processor -- start 2024-09-15T23:18:49.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.470+0000 7fddaf81e640 1 -- start start 2024-09-15T23:18:49.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.470+0000 7fddaf81e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdd94004d40 0x7fdda8134a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:49.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.470+0000 7fddaf81e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdda8140a00 0x7fdda8140e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:49.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.470+0000 7fddaf81e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdda8159420 0x7fdda8159880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:49.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.470+0000 7fddaf81e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdda8146430 con 0x7fdda8159420 2024-09-15T23:18:49.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.470+0000 7fddaf81e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fdda81462b0 con 0x7fdda8140a00 2024-09-15T23:18:49.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.470+0000 7fddaf81e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fdda80b5080 con 0x7fdd94004d40 2024-09-15T23:18:49.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.471+0000 7fddaddbb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdda8159420 0x7fdda8159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:49.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.471+0000 7fddaddbb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdda8159420 0x7fdda8159880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57558/0 (socket says 172.21.15.123:57558) 2024-09-15T23:18:49.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.471+0000 7fddaddbb640 1 -- 172.21.15.123:0/2068271077 learned_addr learned my addr 172.21.15.123:0/2068271077 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:49.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.471+0000 7fddaddbb640 1 -- 172.21.15.123:0/2068271077 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdd94004d40 msgr2=0x7fdda8134a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:49.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.471+0000 7fddaddbb640 1 --2- 172.21.15.123:0/2068271077 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdd94004d40 0x7fdda8134a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:49.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.471+0000 7fddaddbb640 1 -- 172.21.15.123:0/2068271077 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdda8140a00 msgr2=0x7fdda8140e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:49.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.471+0000 7fddaddbb640 1 --2- 172.21.15.123:0/2068271077 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdda8140a00 0x7fdda8140e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:49.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.471+0000 7fddaddbb640 1 -- 172.21.15.123:0/2068271077 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda8135540 con 0x7fdda8159420 2024-09-15T23:18:49.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.471+0000 7fddaddbb640 1 --2- 172.21.15.123:0/2068271077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdda8159420 0x7fdda8159880 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fdda0001840 tx=0x7fdda0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:49.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.471+0000 7fdd9dffb640 1 -- 172.21.15.123:0/2068271077 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda0037040 con 0x7fdda8159420 2024-09-15T23:18:49.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.471+0000 7fdd9dffb640 1 -- 172.21.15.123:0/2068271077 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdda0040070 con 0x7fdda8159420 2024-09-15T23:18:49.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.471+0000 7fdd9dffb640 1 -- 172.21.15.123:0/2068271077 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda0001370 con 0x7fdda8159420 2024-09-15T23:18:49.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.471+0000 7fddaf81e640 1 -- 172.21.15.123:0/2068271077 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdda815a100 con 0x7fdda8159420 2024-09-15T23:18:49.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.471+0000 7fddaf81e640 1 -- 172.21.15.123:0/2068271077 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdda813e150 con 0x7fdda8159420 2024-09-15T23:18:49.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.472+0000 7fddaf81e640 1 -- 172.21.15.123:0/2068271077 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdda80b5380 con 0x7fdda8159420 2024-09-15T23:18:49.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.473+0000 7fdd9dffb640 1 -- 172.21.15.123:0/2068271077 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdda00052d0 con 0x7fdda8159420 2024-09-15T23:18:49.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.473+0000 7fdd9dffb640 1 --2- 172.21.15.123:0/2068271077 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdd8c06c2b0 0x7fdd8c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:49.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.473+0000 7fdd9dffb640 1 -- 172.21.15.123:0/2068271077 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4943+0+0 (secure 0 0 0) 0x7fdda00aa9f0 con 0x7fdda8159420 2024-09-15T23:18:49.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.473+0000 7fddad5ba640 1 --2- 172.21.15.123:0/2068271077 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdd8c06c2b0 0x7fdd8c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:49.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.474+0000 7fddad5ba640 1 --2- 172.21.15.123:0/2068271077 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdd8c06c2b0 0x7fdd8c06e770 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fdda4000f80 tx=0x7fdda40014d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:49.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.477+0000 7fdd9dffb640 1 -- 172.21.15.123:0/2068271077 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdda00793d0 con 0x7fdda8159420 2024-09-15T23:18:49.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.645+0000 7fddaf81e640 1 -- 172.21.15.123:0/2068271077 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdda80b2880 con 0x7fdda8159420 2024-09-15T23:18:49.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.645+0000 7fdd9dffb640 1 -- 172.21.15.123:0/2068271077 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) ==== 74+0+13068 (secure 0 0 0) 0x7fdda0078cd0 con 0x7fdda8159420 2024-09-15T23:18:49.648 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:18:49.648 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":121,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:18:48.348176+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":112,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6835/3823805081":"2024-09-16T23:18:45.334904+0000","172.21.15.123:6833/3823805081":"2024-09-16T23:18:45.334904+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:18:49.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.648+0000 7fddaf81e640 1 -- 172.21.15.123:0/2068271077 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdd8c06c2b0 msgr2=0x7fdd8c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:49.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.648+0000 7fddaf81e640 1 --2- 172.21.15.123:0/2068271077 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdd8c06c2b0 0x7fdd8c06e770 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fdda4000f80 tx=0x7fdda40014d0 comp rx=0 tx=0).stop 2024-09-15T23:18:49.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.648+0000 7fddaf81e640 1 -- 172.21.15.123:0/2068271077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdda8159420 msgr2=0x7fdda8159880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:49.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.648+0000 7fddaf81e640 1 --2- 172.21.15.123:0/2068271077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdda8159420 0x7fdda8159880 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fdda0001840 tx=0x7fdda0001120 comp rx=0 tx=0).stop 2024-09-15T23:18:49.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.648+0000 7fddaf81e640 1 -- 172.21.15.123:0/2068271077 shutdown_connections 2024-09-15T23:18:49.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.648+0000 7fddaf81e640 1 --2- 172.21.15.123:0/2068271077 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdd8c06c2b0 0x7fdd8c06e770 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:49.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.648+0000 7fddaf81e640 1 --2- 172.21.15.123:0/2068271077 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdda8159420 0x7fdda8159880 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:49.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.648+0000 7fddaf81e640 1 --2- 172.21.15.123:0/2068271077 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdda8140a00 0x7fdda8140e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:49.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.648+0000 7fddaf81e640 1 --2- 172.21.15.123:0/2068271077 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdd94004d40 0x7fdda8134a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:49.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.648+0000 7fddaf81e640 1 -- 172.21.15.123:0/2068271077 >> 172.21.15.123:0/2068271077 conn(0x7fdda80ccec0 msgr2=0x7fdda80ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:49.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.648+0000 7fddaf81e640 1 -- 172.21.15.123:0/2068271077 shutdown_connections 2024-09-15T23:18:49.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.648+0000 7fddaf81e640 1 -- 172.21.15.123:0/2068271077 wait complete. 2024-09-15T23:18:49.661 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T23:12:01.531886+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T23:18:49.661 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T23:18:49.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.760+0000 7fe5abf8d640 1 Processor -- start 2024-09-15T23:18:49.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.761+0000 7fe5abf8d640 1 -- start start 2024-09-15T23:18:49.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.761+0000 7fe5abf8d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe5a406bfd0 0x7fe5a406c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:49.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.761+0000 7fe5abf8d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe5a40d3930 0x7fe5a4162ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:49.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.761+0000 7fe5abf8d640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5a406c8f0 con 0x7fe5a40b3350 2024-09-15T23:18:49.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.761+0000 7fe5abf8d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fe5a40b78a0 con 0x7fe5a40d3930 2024-09-15T23:18:49.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.761+0000 7fe5abf8d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe5a40cffb0 con 0x7fe5a406bfd0 2024-09-15T23:18:49.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.762+0000 7fe5aa52a640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe5a40d3930 0x7fe5a4162ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:49.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.762+0000 7fe5a9d29640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe5a406bfd0 0x7fe5a406c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:49.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.762+0000 7fe5aa52a640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe5a40d3930 0x7fe5a4162ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:55388/0 (socket says 172.21.15.123:55388) 2024-09-15T23:18:49.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.762+0000 7fe5a9528640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fe5a40b3350 0x7fe5a41623a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:59280/0 (socket says 172.21.15.123:59280) 2024-09-15T23:18:49.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.762+0000 7fe5aa52a640 1 -- 172.21.15.123:0/3761374968 learned_addr learned my addr 172.21.15.123:0/3761374968 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:49.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.762+0000 7fe5a9d29640 1 --2- 172.21.15.123:0/3761374968 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe5a406bfd0 0x7fe5a406c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:38440/0 (socket says 172.21.15.123:38440) 2024-09-15T23:18:49.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.762+0000 7fe5aa52a640 1 -- 172.21.15.123:0/3761374968 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe5a406bfd0 msgr2=0x7fe5a406c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:49.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.762+0000 7fe5aa52a640 1 --2- 172.21.15.123:0/3761374968 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe5a406bfd0 0x7fe5a406c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:49.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.762+0000 7fe5aa52a640 1 -- 172.21.15.123:0/3761374968 >> v1:172.21.15.188:6789/0 conn(0x7fe5a40b3350 legacy=0x7fe5a41623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:49.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.762+0000 7fe5aa52a640 1 -- 172.21.15.123:0/3761374968 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5a40cf710 con 0x7fe5a40d3930 2024-09-15T23:18:49.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.762+0000 7fe5a8d27640 1 -- 172.21.15.123:0/3761374968 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 283206948 0 0) 0x7fe5a406c8f0 con 0x7fe5a40b3350 2024-09-15T23:18:49.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.763+0000 7fe5aa52a640 1 --2- 172.21.15.123:0/3761374968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5a40d3930 0x7fe5a4162ab0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe59c009e80 tx=0x7fe59c02a760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f897464344cdd9e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:49.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.763+0000 7fe5a8d27640 1 -- 172.21.15.123:0/3761374968 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59c036070 con 0x7fe5a40d3930 2024-09-15T23:18:49.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.763+0000 7fe5a8d27640 1 -- 172.21.15.123:0/3761374968 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe59c031600 con 0x7fe5a40d3930 2024-09-15T23:18:49.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.763+0000 7fe5a8d27640 1 -- 172.21.15.123:0/3761374968 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59c0319d0 con 0x7fe5a40d3930 2024-09-15T23:18:49.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.763+0000 7fe5abf8d640 1 -- 172.21.15.123:0/3761374968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5a40d3930 msgr2=0x7fe5a4162ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:49.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.763+0000 7fe5abf8d640 1 --2- 172.21.15.123:0/3761374968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5a40d3930 0x7fe5a4162ab0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe59c009e80 tx=0x7fe59c02a760 comp rx=0 tx=0).stop 2024-09-15T23:18:49.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.763+0000 7fe5abf8d640 1 -- 172.21.15.123:0/3761374968 shutdown_connections 2024-09-15T23:18:49.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.763+0000 7fe5abf8d640 1 --2- 172.21.15.123:0/3761374968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5a40d3930 0x7fe5a4162ab0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:49.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.763+0000 7fe5abf8d640 1 --2- 172.21.15.123:0/3761374968 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe5a406bfd0 0x7fe5a406c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:49.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.763+0000 7fe5abf8d640 1 -- 172.21.15.123:0/3761374968 >> 172.21.15.123:0/3761374968 conn(0x7fe5a40d11c0 msgr2=0x7fe5a40d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:49.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.764+0000 7fe5abf8d640 1 -- 172.21.15.123:0/3761374968 shutdown_connections 2024-09-15T23:18:49.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.764+0000 7fe5abf8d640 1 -- 172.21.15.123:0/3761374968 wait complete. 2024-09-15T23:18:49.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.765+0000 7fe5abf8d640 1 Processor -- start 2024-09-15T23:18:49.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.765+0000 7fe5abf8d640 1 -- start start 2024-09-15T23:18:49.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.765+0000 7fe5abf8d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5a406bfd0 0x7fe5a41f4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:49.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.765+0000 7fe5abf8d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe5a40b3350 0x7fe5a415d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:49.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.765+0000 7fe5abf8d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5a40d3930 0x7fe5a40cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:49.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.765+0000 7fe5abf8d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a40d2400 con 0x7fe5a406bfd0 2024-09-15T23:18:49.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.765+0000 7fe5abf8d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a40cfcd0 con 0x7fe5a40d3930 2024-09-15T23:18:49.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.765+0000 7fe5abf8d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe5a406cd50 con 0x7fe5a40b3350 2024-09-15T23:18:49.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.766+0000 7fe5a9d29640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5a406bfd0 0x7fe5a41f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:49.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.766+0000 7fe5a9d29640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5a406bfd0 0x7fe5a41f4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57566/0 (socket says 172.21.15.123:57566) 2024-09-15T23:18:49.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.766+0000 7fe5a9d29640 1 -- 172.21.15.123:0/4239872956 learned_addr learned my addr 172.21.15.123:0/4239872956 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:49.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.766+0000 7fe5a9528640 1 --2- 172.21.15.123:0/4239872956 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe5a40b3350 0x7fe5a415d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:49.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.766+0000 7fe5aa52a640 1 --2- 172.21.15.123:0/4239872956 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5a40d3930 0x7fe5a40cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:49.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.766+0000 7fe5a9d29640 1 -- 172.21.15.123:0/4239872956 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe5a40b3350 msgr2=0x7fe5a415d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:49.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.766+0000 7fe5a9d29640 1 --2- 172.21.15.123:0/4239872956 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe5a40b3350 0x7fe5a415d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:49.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.766+0000 7fe5a9d29640 1 -- 172.21.15.123:0/4239872956 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5a40d3930 msgr2=0x7fe5a40cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:49.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.766+0000 7fe5a9d29640 1 --2- 172.21.15.123:0/4239872956 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5a40d3930 0x7fe5a40cd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:49.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.766+0000 7fe5a9d29640 1 -- 172.21.15.123:0/4239872956 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5a41f5310 con 0x7fe5a406bfd0 2024-09-15T23:18:49.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.766+0000 7fe5aa52a640 1 --2- 172.21.15.123:0/4239872956 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5a40d3930 0x7fe5a40cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:18:49.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.766+0000 7fe5a9d29640 1 --2- 172.21.15.123:0/4239872956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5a406bfd0 0x7fe5a41f4cf0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fe59400e9b0 tx=0x7fe59400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:49.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.766+0000 7fe5a27fc640 1 -- 172.21.15.123:0/4239872956 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe594017070 con 0x7fe5a406bfd0 2024-09-15T23:18:49.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.766+0000 7fe5a27fc640 1 -- 172.21.15.123:0/4239872956 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe59400c9a0 con 0x7fe5a406bfd0 2024-09-15T23:18:49.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.766+0000 7fe5abf8d640 1 -- 172.21.15.123:0/4239872956 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5a41f55f0 con 0x7fe5a406bfd0 2024-09-15T23:18:49.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.766+0000 7fe5a27fc640 1 -- 172.21.15.123:0/4239872956 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59400cd90 con 0x7fe5a406bfd0 2024-09-15T23:18:49.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.766+0000 7fe5abf8d640 1 -- 172.21.15.123:0/4239872956 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5a41f5bb0 con 0x7fe5a406bfd0 2024-09-15T23:18:49.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.767+0000 7fe5abf8d640 1 -- 172.21.15.123:0/4239872956 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5a41f84f0 con 0x7fe5a406bfd0 2024-09-15T23:18:49.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.768+0000 7fe5a27fc640 1 -- 172.21.15.123:0/4239872956 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe59401a070 con 0x7fe5a406bfd0 2024-09-15T23:18:49.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.768+0000 7fe5a27fc640 1 --2- 172.21.15.123:0/4239872956 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe59006c2e0 0x7fe59006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:49.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.768+0000 7fe5a27fc640 1 -- 172.21.15.123:0/4239872956 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4943+0+0 (secure 0 0 0) 0x7fe59408b120 con 0x7fe5a406bfd0 2024-09-15T23:18:49.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.768+0000 7fe5a9528640 1 --2- 172.21.15.123:0/4239872956 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe59006c2e0 0x7fe59006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:49.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.769+0000 7fe5a9528640 1 --2- 172.21.15.123:0/4239872956 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe59006c2e0 0x7fe59006e7a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe5a40b2e20 tx=0x7fe598007b50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:49.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.773+0000 7fe5a27fc640 1 -- 172.21.15.123:0/4239872956 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe594059b90 con 0x7fe5a406bfd0 2024-09-15T23:18:49.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.938+0000 7fe5abf8d640 1 -- 172.21.15.123:0/4239872956 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe5a415eae0 con 0x7fe5a406bfd0 2024-09-15T23:18:49.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.939+0000 7fe5a27fc640 1 -- 172.21.15.123:0/4239872956 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v121) ==== 93+0+10 (secure 0 0 0) 0x7fe594059490 con 0x7fe5a406bfd0 2024-09-15T23:18:49.941 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-15T23:18:49.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.941+0000 7fe5abf8d640 1 -- 172.21.15.123:0/4239872956 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe59006c2e0 msgr2=0x7fe59006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:49.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.941+0000 7fe5abf8d640 1 --2- 172.21.15.123:0/4239872956 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe59006c2e0 0x7fe59006e7a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe5a40b2e20 tx=0x7fe598007b50 comp rx=0 tx=0).stop 2024-09-15T23:18:49.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.941+0000 7fe5abf8d640 1 -- 172.21.15.123:0/4239872956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5a406bfd0 msgr2=0x7fe5a41f4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:49.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.941+0000 7fe5abf8d640 1 --2- 172.21.15.123:0/4239872956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5a406bfd0 0x7fe5a41f4cf0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fe59400e9b0 tx=0x7fe59400ee70 comp rx=0 tx=0).stop 2024-09-15T23:18:49.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.941+0000 7fe5abf8d640 1 -- 172.21.15.123:0/4239872956 shutdown_connections 2024-09-15T23:18:49.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.941+0000 7fe5abf8d640 1 --2- 172.21.15.123:0/4239872956 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5a40d3930 0x7fe5a40cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:49.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.941+0000 7fe5abf8d640 1 --2- 172.21.15.123:0/4239872956 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe5a40b3350 0x7fe5a415d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:49.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.941+0000 7fe5abf8d640 1 --2- 172.21.15.123:0/4239872956 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe59006c2e0 0x7fe59006e7a0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:49.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.941+0000 7fe5abf8d640 1 --2- 172.21.15.123:0/4239872956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5a406bfd0 0x7fe5a41f4cf0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:49.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.941+0000 7fe5abf8d640 1 -- 172.21.15.123:0/4239872956 >> 172.21.15.123:0/4239872956 conn(0x7fe5a40d11c0 msgr2=0x7fe5a40b9390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:49.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.941+0000 7fe5abf8d640 1 -- 172.21.15.123:0/4239872956 shutdown_connections 2024-09-15T23:18:49.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:49.941+0000 7fe5abf8d640 1 -- 172.21.15.123:0/4239872956 wait complete. 2024-09-15T23:18:49.954 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort' 2024-09-15T23:18:50.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.050+0000 7fb4f8742640 1 Processor -- start 2024-09-15T23:18:50.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.050+0000 7fb4f8742640 1 -- start start 2024-09-15T23:18:50.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.051+0000 7fb4f8742640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb4f0145ed0 0x7fb4f00b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:50.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.051+0000 7fb4f8742640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4f00b4020 con 0x7fb4f0073180 2024-09-15T23:18:50.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.051+0000 7fb4f8742640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4f00b42c0 con 0x7fb4f00b5f90 2024-09-15T23:18:50.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.051+0000 7fb4f8742640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fb4f00b63d0 con 0x7fb4f0145ed0 2024-09-15T23:18:50.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.051+0000 7fb4f64de640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb4f0145ed0 0x7fb4f00b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:50.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.051+0000 7fb4f5cdd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb4f0073180 0x7fb4f00b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47328/0 (socket says 172.21.15.123:47328) 2024-09-15T23:18:50.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.051+0000 7fb4f5cdd640 1 -- 172.21.15.123:0/3277633805 learned_addr learned my addr 172.21.15.123:0/3277633805 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:18:50.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.051+0000 7fb4f64de640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb4f0145ed0 0x7fb4f00b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57582/0 (socket says 172.21.15.123:57582) 2024-09-15T23:18:50.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.051+0000 7fb4f64de640 1 -- 172.21.15.123:0/3277633805 >> v1:172.21.15.188:6789/0 conn(0x7fb4f00b5f90 legacy=0x7fb4f015cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:50.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.051+0000 7fb4f64de640 1 -- 172.21.15.123:0/3277633805 >> v1:172.21.15.123:6789/0 conn(0x7fb4f0073180 legacy=0x7fb4f00b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:50.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.051+0000 7fb4f54dc640 1 -- 172.21.15.123:0/3277633805 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2010584483 0 0) 0x7fb4f00b4020 con 0x7fb4f0073180 2024-09-15T23:18:50.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.051+0000 7fb4f64de640 1 -- 172.21.15.123:0/3277633805 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4f00b45a0 con 0x7fb4f0145ed0 2024-09-15T23:18:50.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.052+0000 7fb4f64de640 1 --2- 172.21.15.123:0/3277633805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4f0145ed0 0x7fb4f00b5080 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec0097a0 tx=0x7fb4ec02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb62a4d524dfb39e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:50.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.052+0000 7fb4f54dc640 1 -- 172.21.15.123:0/3277633805 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec037070 con 0x7fb4f0145ed0 2024-09-15T23:18:50.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.052+0000 7fb4f54dc640 1 -- 172.21.15.123:0/3277633805 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4ec032440 con 0x7fb4f0145ed0 2024-09-15T23:18:50.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.052+0000 7fb4f54dc640 1 -- 172.21.15.123:0/3277633805 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec032810 con 0x7fb4f0145ed0 2024-09-15T23:18:50.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.053+0000 7fb4f8742640 1 -- 172.21.15.123:0/3277633805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4f0145ed0 msgr2=0x7fb4f00b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:50.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.053+0000 7fb4f8742640 1 --2- 172.21.15.123:0/3277633805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4f0145ed0 0x7fb4f00b5080 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec0097a0 tx=0x7fb4ec02a230 comp rx=0 tx=0).stop 2024-09-15T23:18:50.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.053+0000 7fb4f8742640 1 -- 172.21.15.123:0/3277633805 shutdown_connections 2024-09-15T23:18:50.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.053+0000 7fb4f8742640 1 --2- 172.21.15.123:0/3277633805 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4f0145ed0 0x7fb4f00b5080 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:50.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.053+0000 7fb4f8742640 1 -- 172.21.15.123:0/3277633805 >> 172.21.15.123:0/3277633805 conn(0x7fb4f00ccec0 msgr2=0x7fb4f00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:50.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.053+0000 7fb4f8742640 1 -- 172.21.15.123:0/3277633805 shutdown_connections 2024-09-15T23:18:50.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.053+0000 7fb4f8742640 1 -- 172.21.15.123:0/3277633805 wait complete. 2024-09-15T23:18:50.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.054+0000 7fb4f8742640 1 Processor -- start 2024-09-15T23:18:50.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.054+0000 7fb4f8742640 1 -- start start 2024-09-15T23:18:50.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.055+0000 7fb4f8742640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4f0073180 0x7fb4f0136d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:50.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.055+0000 7fb4f8742640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb4f00b5f90 0x7fb4f0142820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:50.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.055+0000 7fb4f8742640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb4f0145ed0 0x7fb4f0142d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:50.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.055+0000 7fb4f8742640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f01462b0 con 0x7fb4f0073180 2024-09-15T23:18:50.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.055+0000 7fb4f8742640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f00b4b60 con 0x7fb4f00b5f90 2024-09-15T23:18:50.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.055+0000 7fb4f8742640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb4f0146430 con 0x7fb4f0145ed0 2024-09-15T23:18:50.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.055+0000 7fb4f64de640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4f0073180 0x7fb4f0136d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:50.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.055+0000 7fb4f64de640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4f0073180 0x7fb4f0136d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57584/0 (socket says 172.21.15.123:57584) 2024-09-15T23:18:50.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.055+0000 7fb4f64de640 1 -- 172.21.15.123:0/1472922953 learned_addr learned my addr 172.21.15.123:0/1472922953 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:50.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.055+0000 7fb4f5cdd640 1 --2- 172.21.15.123:0/1472922953 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb4f00b5f90 0x7fb4f0142820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:50.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.055+0000 7fb4f6cdf640 1 --2- 172.21.15.123:0/1472922953 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb4f0145ed0 0x7fb4f0142d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:50.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.055+0000 7fb4f64de640 1 -- 172.21.15.123:0/1472922953 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb4f0145ed0 msgr2=0x7fb4f0142d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:50.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.055+0000 7fb4f64de640 1 --2- 172.21.15.123:0/1472922953 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb4f0145ed0 0x7fb4f0142d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:50.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.055+0000 7fb4f64de640 1 -- 172.21.15.123:0/1472922953 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb4f00b5f90 msgr2=0x7fb4f0142820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:50.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.055+0000 7fb4f64de640 1 --2- 172.21.15.123:0/1472922953 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb4f00b5f90 0x7fb4f0142820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:50.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.055+0000 7fb4f64de640 1 -- 172.21.15.123:0/1472922953 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4f013ffe0 con 0x7fb4f0073180 2024-09-15T23:18:50.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.055+0000 7fb4f64de640 1 --2- 172.21.15.123:0/1472922953 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4f0073180 0x7fb4f0136d90 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec000c00 tx=0x7fb4ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:50.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.055+0000 7fb4e6ffd640 1 -- 172.21.15.123:0/1472922953 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec037040 con 0x7fb4f0073180 2024-09-15T23:18:50.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.056+0000 7fb4e6ffd640 1 -- 172.21.15.123:0/1472922953 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4ec042070 con 0x7fb4f0073180 2024-09-15T23:18:50.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.056+0000 7fb4e6ffd640 1 -- 172.21.15.123:0/1472922953 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec030a70 con 0x7fb4f0073180 2024-09-15T23:18:50.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.056+0000 7fb4f8742640 1 -- 172.21.15.123:0/1472922953 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4f013f080 con 0x7fb4f0073180 2024-09-15T23:18:50.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.056+0000 7fb4f8742640 1 -- 172.21.15.123:0/1472922953 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4f01402a0 con 0x7fb4f0073180 2024-09-15T23:18:50.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.056+0000 7fb4f8742640 1 -- 172.21.15.123:0/1472922953 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4f00b5080 con 0x7fb4f0073180 2024-09-15T23:18:50.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.057+0000 7fb4e6ffd640 1 -- 172.21.15.123:0/1472922953 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb4ec030c10 con 0x7fb4f0073180 2024-09-15T23:18:50.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.057+0000 7fb4e6ffd640 1 --2- 172.21.15.123:0/1472922953 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb4d406c2b0 0x7fb4d406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:50.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.057+0000 7fb4e6ffd640 1 -- 172.21.15.123:0/1472922953 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4943+0+0 (secure 0 0 0) 0x7fb4ec0aba80 con 0x7fb4f0073180 2024-09-15T23:18:50.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.058+0000 7fb4f5cdd640 1 --2- 172.21.15.123:0/1472922953 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb4d406c2b0 0x7fb4d406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:50.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.058+0000 7fb4f5cdd640 1 --2- 172.21.15.123:0/1472922953 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb4d406c2b0 0x7fb4d406e770 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb4f00d0f10 tx=0x7fb4e0007b80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:50.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.062+0000 7fb4e6ffd640 1 -- 172.21.15.123:0/1472922953 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb4ec079ea0 con 0x7fb4f0073180 2024-09-15T23:18:50.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.290+0000 7fb4f8742640 1 -- 172.21.15.123:0/1472922953 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]} v 0) -- 0x7fb4f015a5b0 con 0x7fb4f0073180 2024-09-15T23:18:50.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.356+0000 7fb4e6ffd640 1 -- 172.21.15.123:0/1472922953 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]}]=0 v331) ==== 147+0+0 (secure 0 0 0) 0x7fb4ec07e1a0 con 0x7fb4f0073180 2024-09-15T23:18:50.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.358+0000 7fb4f8742640 1 -- 172.21.15.123:0/1472922953 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb4d406c2b0 msgr2=0x7fb4d406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:50.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.358+0000 7fb4f8742640 1 --2- 172.21.15.123:0/1472922953 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb4d406c2b0 0x7fb4d406e770 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb4f00d0f10 tx=0x7fb4e0007b80 comp rx=0 tx=0).stop 2024-09-15T23:18:50.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.358+0000 7fb4f8742640 1 -- 172.21.15.123:0/1472922953 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4f0073180 msgr2=0x7fb4f0136d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:50.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.358+0000 7fb4f8742640 1 --2- 172.21.15.123:0/1472922953 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4f0073180 0x7fb4f0136d90 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec000c00 tx=0x7fb4ec0046c0 comp rx=0 tx=0).stop 2024-09-15T23:18:50.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.358+0000 7fb4f8742640 1 -- 172.21.15.123:0/1472922953 shutdown_connections 2024-09-15T23:18:50.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.358+0000 7fb4f8742640 1 --2- 172.21.15.123:0/1472922953 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb4f0145ed0 0x7fb4f0142d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:50.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.358+0000 7fb4f8742640 1 --2- 172.21.15.123:0/1472922953 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb4f00b5f90 0x7fb4f0142820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:50.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.358+0000 7fb4f8742640 1 --2- 172.21.15.123:0/1472922953 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb4d406c2b0 0x7fb4d406e770 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:50.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.358+0000 7fb4f8742640 1 --2- 172.21.15.123:0/1472922953 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4f0073180 0x7fb4f0136d90 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:50.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.358+0000 7fb4f8742640 1 -- 172.21.15.123:0/1472922953 >> 172.21.15.123:0/1472922953 conn(0x7fb4f00ccec0 msgr2=0x7fb4f00cd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:50.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.358+0000 7fb4f8742640 1 -- 172.21.15.123:0/1472922953 shutdown_connections 2024-09-15T23:18:50.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.358+0000 7fb4f8742640 1 -- 172.21.15.123:0/1472922953 wait complete. 2024-09-15T23:18:50.371 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T23:18:50.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.471+0000 7f6402fe8640 1 Processor -- start 2024-09-15T23:18:50.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.471+0000 7f6402fe8640 1 -- start start 2024-09-15T23:18:50.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.472+0000 7f6402fe8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f63fc0b0230 0x7f63fc162c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:50.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.472+0000 7f6402fe8640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63fc073cc0 con 0x7f63fc073600 2024-09-15T23:18:50.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.472+0000 7f6402fe8640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63fc071aa0 con 0x7f63fc155950 2024-09-15T23:18:50.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.472+0000 7f6402fe8640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f63fc1631c0 con 0x7f63fc0b0230 2024-09-15T23:18:50.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.472+0000 7f6401585640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f63fc0b0230 0x7f63fc162c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:50.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.472+0000 7f63fbfff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f63fc073600 0x7f63fc0afb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47330/0 (socket says 172.21.15.123:47330) 2024-09-15T23:18:50.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.472+0000 7f6401585640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f63fc0b0230 0x7f63fc162c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57596/0 (socket says 172.21.15.123:57596) 2024-09-15T23:18:50.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.472+0000 7f63fbfff640 1 -- 172.21.15.123:0/2195056756 learned_addr learned my addr 172.21.15.123:0/2195056756 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:18:50.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.472+0000 7f6401585640 1 -- 172.21.15.123:0/2195056756 >> v1:172.21.15.188:6789/0 conn(0x7f63fc155950 legacy=0x7f63fc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:50.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.472+0000 7f6401585640 1 -- 172.21.15.123:0/2195056756 >> v1:172.21.15.123:6789/0 conn(0x7f63fc073600 legacy=0x7f63fc0afb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:50.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.472+0000 7f6401585640 1 -- 172.21.15.123:0/2195056756 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63fc071d80 con 0x7f63fc0b0230 2024-09-15T23:18:50.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.472+0000 7f63fb7fe640 1 -- 172.21.15.123:0/2195056756 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 334426589 0 0) 0x7f63fc073cc0 con 0x7f63fc073600 2024-09-15T23:18:50.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.473+0000 7f6401585640 1 --2- 172.21.15.123:0/2195056756 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63fc0b0230 0x7f63fc162c80 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f63f4009d90 tx=0x7f63f402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e18f17356c408dd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:50.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.473+0000 7f63fb7fe640 1 -- 172.21.15.123:0/2195056756 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f4007740 con 0x7f63fc0b0230 2024-09-15T23:18:50.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.473+0000 7f63fb7fe640 1 -- 172.21.15.123:0/2195056756 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63f40078e0 con 0x7f63fc0b0230 2024-09-15T23:18:50.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.473+0000 7f63fb7fe640 1 -- 172.21.15.123:0/2195056756 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f4007cb0 con 0x7f63fc0b0230 2024-09-15T23:18:50.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.474+0000 7f6402fe8640 1 -- 172.21.15.123:0/2195056756 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63fc0b0230 msgr2=0x7f63fc162c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:50.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.474+0000 7f6402fe8640 1 --2- 172.21.15.123:0/2195056756 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63fc0b0230 0x7f63fc162c80 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f63f4009d90 tx=0x7f63f402a6a0 comp rx=0 tx=0).stop 2024-09-15T23:18:50.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.474+0000 7f6402fe8640 1 -- 172.21.15.123:0/2195056756 shutdown_connections 2024-09-15T23:18:50.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.474+0000 7f6402fe8640 1 --2- 172.21.15.123:0/2195056756 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63fc0b0230 0x7f63fc162c80 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:50.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.474+0000 7f6402fe8640 1 -- 172.21.15.123:0/2195056756 >> 172.21.15.123:0/2195056756 conn(0x7f63fc06db30 msgr2=0x7f63fc06df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:50.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.474+0000 7f6402fe8640 1 -- 172.21.15.123:0/2195056756 shutdown_connections 2024-09-15T23:18:50.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.474+0000 7f6402fe8640 1 -- 172.21.15.123:0/2195056756 wait complete. 2024-09-15T23:18:50.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.475+0000 7f6402fe8640 1 Processor -- start 2024-09-15T23:18:50.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.475+0000 7f6402fe8640 1 -- start start 2024-09-15T23:18:50.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.476+0000 7f6402fe8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f63fc073600 0x7f63fc0c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:50.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.476+0000 7f6402fe8640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f63fc0b0230 0x7f63fc0ce630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:50.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.476+0000 7f6402fe8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63fc0d0440 0x7f63fc147440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:50.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.476+0000 7f6402fe8640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc073a60 con 0x7f63fc0d0440 2024-09-15T23:18:50.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.476+0000 7f6402fe8640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc070370 con 0x7f63fc073600 2024-09-15T23:18:50.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.476+0000 7f6402fe8640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f63fc072060 con 0x7f63fc0b0230 2024-09-15T23:18:50.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.476+0000 7f6401585640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63fc0d0440 0x7f63fc147440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:50.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.476+0000 7f6401585640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63fc0d0440 0x7f63fc147440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57604/0 (socket says 172.21.15.123:57604) 2024-09-15T23:18:50.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.476+0000 7f6401585640 1 -- 172.21.15.123:0/1809370502 learned_addr learned my addr 172.21.15.123:0/1809370502 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:50.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.476+0000 7f63fbfff640 1 --2- 172.21.15.123:0/1809370502 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f63fc0b0230 0x7f63fc0ce630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:50.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.476+0000 7f6400d84640 1 --2- 172.21.15.123:0/1809370502 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f63fc073600 0x7f63fc0c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:50.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.476+0000 7f6401585640 1 -- 172.21.15.123:0/1809370502 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f63fc0b0230 msgr2=0x7f63fc0ce630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:50.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.476+0000 7f6401585640 1 --2- 172.21.15.123:0/1809370502 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f63fc0b0230 0x7f63fc0ce630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:50.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.476+0000 7f6401585640 1 -- 172.21.15.123:0/1809370502 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f63fc073600 msgr2=0x7f63fc0c5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:50.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.476+0000 7f6401585640 1 --2- 172.21.15.123:0/1809370502 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f63fc073600 0x7f63fc0c5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:50.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.476+0000 7f6401585640 1 -- 172.21.15.123:0/1809370502 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63fc0c6330 con 0x7f63fc0d0440 2024-09-15T23:18:50.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.476+0000 7f6401585640 1 --2- 172.21.15.123:0/1809370502 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63fc0d0440 0x7f63fc147440 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f63f402ac90 tx=0x7f63f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:50.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.477+0000 7f63f97fa640 1 -- 172.21.15.123:0/1809370502 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f4040070 con 0x7f63fc0d0440 2024-09-15T23:18:50.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.477+0000 7f63f97fa640 1 -- 172.21.15.123:0/1809370502 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63f4031c90 con 0x7f63fc0d0440 2024-09-15T23:18:50.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.477+0000 7f6402fe8640 1 -- 172.21.15.123:0/1809370502 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63fc0cdca0 con 0x7f63fc0d0440 2024-09-15T23:18:50.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.477+0000 7f63f97fa640 1 -- 172.21.15.123:0/1809370502 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f4045680 con 0x7f63fc0d0440 2024-09-15T23:18:50.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.477+0000 7f6402fe8640 1 -- 172.21.15.123:0/1809370502 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63fc0cf090 con 0x7f63fc0d0440 2024-09-15T23:18:50.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.478+0000 7f6402fe8640 1 -- 172.21.15.123:0/1809370502 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63fc0cf580 con 0x7f63fc0d0440 2024-09-15T23:18:50.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.478+0000 7f63f97fa640 1 -- 172.21.15.123:0/1809370502 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f63f4039040 con 0x7f63fc0d0440 2024-09-15T23:18:50.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.479+0000 7f63f97fa640 1 --2- 172.21.15.123:0/1809370502 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f63e806c2b0 0x7f63e806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:50.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.479+0000 7f63f97fa640 1 -- 172.21.15.123:0/1809370502 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4943+0+0 (secure 0 0 0) 0x7f63f40acb20 con 0x7f63fc0d0440 2024-09-15T23:18:50.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.479+0000 7f6400d84640 1 --2- 172.21.15.123:0/1809370502 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f63e806c2b0 0x7f63e806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:50.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.479+0000 7f6400d84640 1 --2- 172.21.15.123:0/1809370502 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f63e806c2b0 0x7f63e806e770 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f63ec006fd0 tx=0x7f63ec008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:50.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.483+0000 7f63f97fa640 1 -- 172.21.15.123:0/1809370502 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f63f407b6e0 con 0x7f63fc0d0440 2024-09-15T23:18:50.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.648+0000 7f6402fe8640 1 -- 172.21.15.123:0/1809370502 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f63fc162c80 con 0x7f63fc0d0440 2024-09-15T23:18:50.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.652+0000 7f63f97fa640 1 -- 172.21.15.123:0/1809370502 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v36)=0 v36) ==== 122+0+0 (secure 0 0 0) 0x7f63f407afe0 con 0x7f63fc0d0440 2024-09-15T23:18:50.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.654+0000 7f6402fe8640 1 -- 172.21.15.123:0/1809370502 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f63e806c2b0 msgr2=0x7f63e806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:50.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.654+0000 7f6402fe8640 1 --2- 172.21.15.123:0/1809370502 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f63e806c2b0 0x7f63e806e770 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f63ec006fd0 tx=0x7f63ec008040 comp rx=0 tx=0).stop 2024-09-15T23:18:50.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.654+0000 7f6402fe8640 1 -- 172.21.15.123:0/1809370502 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63fc0d0440 msgr2=0x7f63fc147440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:50.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.654+0000 7f6402fe8640 1 --2- 172.21.15.123:0/1809370502 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63fc0d0440 0x7f63fc147440 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f63f402ac90 tx=0x7f63f4004a40 comp rx=0 tx=0).stop 2024-09-15T23:18:50.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.654+0000 7f6402fe8640 1 -- 172.21.15.123:0/1809370502 shutdown_connections 2024-09-15T23:18:50.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.654+0000 7f6402fe8640 1 --2- 172.21.15.123:0/1809370502 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f63e806c2b0 0x7f63e806e770 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:50.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.654+0000 7f6402fe8640 1 --2- 172.21.15.123:0/1809370502 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63fc0d0440 0x7f63fc147440 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:50.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.654+0000 7f6402fe8640 1 --2- 172.21.15.123:0/1809370502 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f63fc0b0230 0x7f63fc0ce630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:50.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.654+0000 7f6402fe8640 1 --2- 172.21.15.123:0/1809370502 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f63fc073600 0x7f63fc0c5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:50.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.654+0000 7f6402fe8640 1 -- 172.21.15.123:0/1809370502 >> 172.21.15.123:0/1809370502 conn(0x7f63fc06db30 msgr2=0x7f63fc0b4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:50.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.654+0000 7f6402fe8640 1 -- 172.21.15.123:0/1809370502 shutdown_connections 2024-09-15T23:18:50.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.654+0000 7f6402fe8640 1 -- 172.21.15.123:0/1809370502 wait complete. 2024-09-15T23:18:50.667 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:18:50.667 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:18:50.714 DEBUG:teuthology.orchestra.run.smithi188:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:18:50.759 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:18:50.759 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:18:50.759 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:18:50.777 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:18:50.778 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:18:50.778 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:18:50.817 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:18:50.818 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:18:50.818 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:18:50.833 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:18:50.833 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:18:50.833 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:18:50.876 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:18:50.876 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-15T23:18:50.876 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:18:50.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.972+0000 7fa05b1f1640 1 Processor -- start 2024-09-15T23:18:50.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.972+0000 7fa05b1f1640 1 -- start start 2024-09-15T23:18:50.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.972+0000 7fa05b1f1640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa05415ed20 0x7fa0540b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:50.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.972+0000 7fa05b1f1640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa0540d23b0 0x7fa0540b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:50.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.972+0000 7fa05b1f1640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0540d0e70 con 0x7fa0540cf2d0 2024-09-15T23:18:50.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.972+0000 7fa05b1f1640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fa0540d41c0 con 0x7fa0540d23b0 2024-09-15T23:18:50.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.972+0000 7fa05b1f1640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fa0540d35b0 con 0x7fa05415ed20 2024-09-15T23:18:50.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.973+0000 7fa053fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa0540d23b0 0x7fa0540b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:50.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.973+0000 7fa053fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa0540d23b0 0x7fa0540b67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57618/0 (socket says 172.21.15.123:57618) 2024-09-15T23:18:50.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.973+0000 7fa053fff640 1 -- 172.21.15.123:0/3625079221 learned_addr learned my addr 172.21.15.123:0/3625079221 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:50.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.973+0000 7fa05978e640 1 --1- 172.21.15.123:0/3625079221 >> v1:172.21.15.123:6789/0 conn(0x7fa0540cf2d0 0x7fa0540cf700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47346/0 (socket says 172.21.15.123:47346) 2024-09-15T23:18:50.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.973+0000 7fa058f8d640 1 --2- 172.21.15.123:0/3625079221 >> v2:172.21.15.188:3300/0 conn(0x7fa05415ed20 0x7fa0540b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:50.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.973+0000 7fa053fff640 1 -- 172.21.15.123:0/3625079221 >> v2:172.21.15.188:3300/0 conn(0x7fa05415ed20 msgr2=0x7fa0540b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:50.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.973+0000 7fa053fff640 1 --2- 172.21.15.123:0/3625079221 >> v2:172.21.15.188:3300/0 conn(0x7fa05415ed20 0x7fa0540b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:50.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.973+0000 7fa053fff640 1 -- 172.21.15.123:0/3625079221 >> v1:172.21.15.123:6789/0 conn(0x7fa0540cf2d0 legacy=0x7fa0540cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:50.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.973+0000 7fa053fff640 1 -- 172.21.15.123:0/3625079221 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0540d3890 con 0x7fa0540d23b0 2024-09-15T23:18:50.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.973+0000 7fa0537fe640 1 -- 172.21.15.123:0/3625079221 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2071760578 0 0) 0x7fa03c001110 con 0x7fa0540cf2d0 2024-09-15T23:18:50.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.974+0000 7fa053fff640 1 --2- 172.21.15.123:0/3625079221 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0540d23b0 0x7fa0540b67a0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fa0540d47b0 tx=0x7fa04402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4c2dbdbf6d7e833 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:50.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.974+0000 7fa0537fe640 1 -- 172.21.15.123:0/3625079221 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa044036070 con 0x7fa0540d23b0 2024-09-15T23:18:50.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.974+0000 7fa0537fe640 1 -- 172.21.15.123:0/3625079221 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa044031600 con 0x7fa0540d23b0 2024-09-15T23:18:50.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.974+0000 7fa0537fe640 1 -- 172.21.15.123:0/3625079221 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0440319d0 con 0x7fa0540d23b0 2024-09-15T23:18:50.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.974+0000 7fa05b1f1640 1 -- 172.21.15.123:0/3625079221 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0540d23b0 msgr2=0x7fa0540b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:50.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.974+0000 7fa05b1f1640 1 --2- 172.21.15.123:0/3625079221 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0540d23b0 0x7fa0540b67a0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fa0540d47b0 tx=0x7fa04402a6a0 comp rx=0 tx=0).stop 2024-09-15T23:18:50.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.974+0000 7fa05b1f1640 1 -- 172.21.15.123:0/3625079221 shutdown_connections 2024-09-15T23:18:50.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.974+0000 7fa05b1f1640 1 --2- 172.21.15.123:0/3625079221 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0540d23b0 0x7fa0540b67a0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:50.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.974+0000 7fa05b1f1640 1 --2- 172.21.15.123:0/3625079221 >> v2:172.21.15.188:3300/0 conn(0x7fa05415ed20 0x7fa0540b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:50.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.974+0000 7fa05b1f1640 1 -- 172.21.15.123:0/3625079221 >> 172.21.15.123:0/3625079221 conn(0x7fa0540d1260 msgr2=0x7fa0540d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:50.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.974+0000 7fa05b1f1640 1 -- 172.21.15.123:0/3625079221 shutdown_connections 2024-09-15T23:18:50.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.974+0000 7fa05b1f1640 1 -- 172.21.15.123:0/3625079221 wait complete. 2024-09-15T23:18:50.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.975+0000 7fa05b1f1640 1 Processor -- start 2024-09-15T23:18:50.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.976+0000 7fa05b1f1640 1 -- start start 2024-09-15T23:18:50.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.976+0000 7fa05b1f1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0540cf2d0 0x7fa0541f4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:50.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.976+0000 7fa05b1f1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0540d23b0 0x7fa0541614b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:50.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.976+0000 7fa05b1f1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa05415ed20 0x7fa0541619f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:50.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.976+0000 7fa05b1f1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa0540d32a0 con 0x7fa0540cf2d0 2024-09-15T23:18:50.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.976+0000 7fa05b1f1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa0540d3e50 con 0x7fa0540d23b0 2024-09-15T23:18:50.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.976+0000 7fa05b1f1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa05415f100 con 0x7fa05415ed20 2024-09-15T23:18:50.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.977+0000 7fa058f8d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0540cf2d0 0x7fa0541f4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:50.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.977+0000 7fa058f8d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0540cf2d0 0x7fa0541f4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57622/0 (socket says 172.21.15.123:57622) 2024-09-15T23:18:50.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.977+0000 7fa058f8d640 1 -- 172.21.15.123:0/962400505 learned_addr learned my addr 172.21.15.123:0/962400505 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:50.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.977+0000 7fa053fff640 1 --2- 172.21.15.123:0/962400505 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0540d23b0 0x7fa0541614b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:50.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.977+0000 7fa05978e640 1 --2- 172.21.15.123:0/962400505 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa05415ed20 0x7fa0541619f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:50.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.977+0000 7fa058f8d640 1 -- 172.21.15.123:0/962400505 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa05415ed20 msgr2=0x7fa0541619f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:50.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.977+0000 7fa058f8d640 1 --2- 172.21.15.123:0/962400505 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa05415ed20 0x7fa0541619f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:50.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.977+0000 7fa058f8d640 1 -- 172.21.15.123:0/962400505 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0540d23b0 msgr2=0x7fa0541614b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:50.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.977+0000 7fa058f8d640 1 --2- 172.21.15.123:0/962400505 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0540d23b0 0x7fa0541614b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:50.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.977+0000 7fa058f8d640 1 -- 172.21.15.123:0/962400505 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0540c8370 con 0x7fa0540cf2d0 2024-09-15T23:18:50.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.977+0000 7fa058f8d640 1 --2- 172.21.15.123:0/962400505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0540cf2d0 0x7fa0541f4940 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fa04c00d800 tx=0x7fa04c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:50.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.977+0000 7fa0517fa640 1 -- 172.21.15.123:0/962400505 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c00b6c0 con 0x7fa0540cf2d0 2024-09-15T23:18:50.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.977+0000 7fa0517fa640 1 -- 172.21.15.123:0/962400505 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa04c019070 con 0x7fa0540cf2d0 2024-09-15T23:18:50.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.977+0000 7fa05b1f1640 1 -- 172.21.15.123:0/962400505 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0540c8650 con 0x7fa0540cf2d0 2024-09-15T23:18:50.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.977+0000 7fa0517fa640 1 -- 172.21.15.123:0/962400505 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c00ba80 con 0x7fa0540cf2d0 2024-09-15T23:18:50.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.977+0000 7fa05b1f1640 1 -- 172.21.15.123:0/962400505 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0540c8c10 con 0x7fa0540cf2d0 2024-09-15T23:18:50.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.978+0000 7fa05b1f1640 1 -- 172.21.15.123:0/962400505 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0540b7010 con 0x7fa0540cf2d0 2024-09-15T23:18:50.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.979+0000 7fa0517fa640 1 -- 172.21.15.123:0/962400505 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa04c00bc20 con 0x7fa0540cf2d0 2024-09-15T23:18:50.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.979+0000 7fa0517fa640 1 --2- 172.21.15.123:0/962400505 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa03406c2e0 0x7fa03406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:50.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.979+0000 7fa0517fa640 1 -- 172.21.15.123:0/962400505 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4943+0+0 (secure 0 0 0) 0x7fa04c08b530 con 0x7fa0540cf2d0 2024-09-15T23:18:50.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.979+0000 7fa053fff640 1 --2- 172.21.15.123:0/962400505 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa03406c2e0 0x7fa03406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:50.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.980+0000 7fa053fff640 1 --2- 172.21.15.123:0/962400505 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa03406c2e0 0x7fa03406e7a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa044033000 tx=0x7fa044009000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:50.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:50.983+0000 7fa0517fa640 1 -- 172.21.15.123:0/962400505 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa04c059fa0 con 0x7fa0540cf2d0 2024-09-15T23:18:51.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.182+0000 7fa05b1f1640 1 -- 172.21.15.123:0/962400505 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa0540b3f20 con 0x7fa0540cf2d0 2024-09-15T23:18:51.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.182+0000 7fa0517fa640 1 -- 172.21.15.123:0/962400505 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+3923 (secure 0 0 0) 0x7fa04c0598a0 con 0x7fa0540cf2d0 2024-09-15T23:18:51.187 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:18:51.187 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":76,"btime":"2024-09-15T23:18:46:336663+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6158,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/3864460389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3864460389},{"type":"v1","addr":"172.21.15.188:6836","nonce":3864460389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":6769,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2483934450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2483934450},{"type":"v1","addr":"172.21.15.188:6837","nonce":2483934450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7605,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/1769288917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":1769288917},{"type":"v1","addr":"172.21.15.123:6834","nonce":1769288917}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7941,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2711111491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":2711111491},{"type":"v1","addr":"172.21.15.123:6835","nonce":2711111491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[]} 2024-09-15T23:18:51.188 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 76 2024-09-15T23:18:51.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.184+0000 7fa05b1f1640 1 -- 172.21.15.123:0/962400505 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa03406c2e0 msgr2=0x7fa03406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:51.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.184+0000 7fa05b1f1640 1 --2- 172.21.15.123:0/962400505 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa03406c2e0 0x7fa03406e7a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa044033000 tx=0x7fa044009000 comp rx=0 tx=0).stop 2024-09-15T23:18:51.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.184+0000 7fa05b1f1640 1 -- 172.21.15.123:0/962400505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0540cf2d0 msgr2=0x7fa0541f4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:51.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.184+0000 7fa05b1f1640 1 --2- 172.21.15.123:0/962400505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0540cf2d0 0x7fa0541f4940 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fa04c00d800 tx=0x7fa04c00dcc0 comp rx=0 tx=0).stop 2024-09-15T23:18:51.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.185+0000 7fa05b1f1640 1 -- 172.21.15.123:0/962400505 shutdown_connections 2024-09-15T23:18:51.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.185+0000 7fa05b1f1640 1 --2- 172.21.15.123:0/962400505 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa05415ed20 0x7fa0541619f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:51.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.185+0000 7fa05b1f1640 1 --2- 172.21.15.123:0/962400505 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa0540d23b0 0x7fa0541614b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:51.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.185+0000 7fa05b1f1640 1 --2- 172.21.15.123:0/962400505 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa03406c2e0 0x7fa03406e7a0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:51.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.185+0000 7fa05b1f1640 1 --2- 172.21.15.123:0/962400505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0540cf2d0 0x7fa0541f4940 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:51.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.185+0000 7fa05b1f1640 1 -- 172.21.15.123:0/962400505 >> 172.21.15.123:0/962400505 conn(0x7fa0540d1260 msgr2=0x7fa054155150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:51.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.185+0000 7fa05b1f1640 1 -- 172.21.15.123:0/962400505 shutdown_connections 2024-09-15T23:18:51.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.185+0000 7fa05b1f1640 1 -- 172.21.15.123:0/962400505 wait complete. 2024-09-15T23:18:51.198 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T23:18:51.199 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T23:18:51.199 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T23:18:51.199 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:18:51.200 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T23:18:51.200 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T23:18:51.200 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T23:18:51.200 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:18:51.201 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T23:18:51.201 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T23:18:51.201 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T23:18:51.201 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:18:51.202 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T23:18:51.202 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T23:18:51.202 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T23:18:51.202 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:18:51.209 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T23:18:51.209 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T23:18:51.211 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T23:18:51.211 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T23:18:51.213 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T23:18:51.213 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T23:18:51.215 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T23:18:51.215 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T23:18:51.252 INFO:tasks.ceph.mds.a:Started 2024-09-15T23:18:51.252 DEBUG:teuthology.parallel:result is None 2024-09-15T23:18:51.253 INFO:tasks.ceph.mds.c:Started 2024-09-15T23:18:51.254 DEBUG:teuthology.parallel:result is None 2024-09-15T23:18:51.256 INFO:tasks.ceph.mds.b:Started 2024-09-15T23:18:51.257 DEBUG:teuthology.parallel:result is None 2024-09-15T23:18:51.258 INFO:tasks.ceph.mds.d:Started 2024-09-15T23:18:51.258 DEBUG:teuthology.parallel:result is None 2024-09-15T23:18:51.259 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T23:18:51.327 INFO:tasks.ceph.mds.a.smithi123.stdout:starting mds.a at 2024-09-15T23:18:51.328 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-15T23:18:51.342 INFO:tasks.ceph.mds.b.smithi188.stdout:starting mds.b at 2024-09-15T23:18:51.342 INFO:tasks.ceph.mds.d.smithi188.stdout:starting mds.d at 2024-09-15T23:18:51.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.361+0000 7f6f6835b640 1 Processor -- start 2024-09-15T23:18:51.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.361+0000 7f6f6835b640 1 -- start start 2024-09-15T23:18:51.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.363+0000 7f6f6835b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6f600d23b0 0x7f6f600b87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:51.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.363+0000 7f6f6835b640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f600d0e70 con 0x7f6f600b6970 2024-09-15T23:18:51.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.363+0000 7f6f6835b640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f600d41c0 con 0x7f6f6015ed20 2024-09-15T23:18:51.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.363+0000 7f6f6835b640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f6f600d35b0 con 0x7f6f600d23b0 2024-09-15T23:18:51.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.363+0000 7f6f658f6640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6f600b6970 0x7f6f600b80d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47360/0 (socket says 172.21.15.123:47360) 2024-09-15T23:18:51.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.363+0000 7f6f658f6640 1 -- 172.21.15.123:0/37891704 learned_addr learned my addr 172.21.15.123:0/37891704 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:18:51.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.363+0000 7f6f668f8640 1 --2- 172.21.15.123:0/37891704 >> v2:172.21.15.123:3300/0 conn(0x7f6f600d23b0 0x7f6f600b87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:51.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.363+0000 7f6f668f8640 1 -- 172.21.15.123:0/37891704 >> v1:172.21.15.188:6789/0 conn(0x7f6f6015ed20 legacy=0x7f6f600b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:51.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.363+0000 7f6f668f8640 1 -- 172.21.15.123:0/37891704 >> v1:172.21.15.123:6789/0 conn(0x7f6f600b6970 legacy=0x7f6f600b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:51.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.363+0000 7f6f668f8640 1 -- 172.21.15.123:0/37891704 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f600d3890 con 0x7f6f600d23b0 2024-09-15T23:18:51.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.364+0000 7f6f668f8640 1 --2- 172.21.15.123:0/37891704 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f600d23b0 0x7f6f600b87e0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f6f58009d90 tx=0x7f6f5802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c09d09210913dc9a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:51.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.364+0000 7f6f650f5640 1 -- 172.21.15.123:0/37891704 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f58007740 con 0x7f6f600d23b0 2024-09-15T23:18:51.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.364+0000 7f6f650f5640 1 -- 172.21.15.123:0/37891704 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f580078e0 con 0x7f6f600d23b0 2024-09-15T23:18:51.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.364+0000 7f6f650f5640 1 -- 172.21.15.123:0/37891704 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f58007cb0 con 0x7f6f600d23b0 2024-09-15T23:18:51.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.365+0000 7f6f6835b640 1 -- 172.21.15.123:0/37891704 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f600d23b0 msgr2=0x7f6f600b87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:51.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.365+0000 7f6f6835b640 1 --2- 172.21.15.123:0/37891704 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f600d23b0 0x7f6f600b87e0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f6f58009d90 tx=0x7f6f5802a660 comp rx=0 tx=0).stop 2024-09-15T23:18:51.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.365+0000 7f6f6835b640 1 -- 172.21.15.123:0/37891704 shutdown_connections 2024-09-15T23:18:51.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.365+0000 7f6f6835b640 1 --2- 172.21.15.123:0/37891704 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f600d23b0 0x7f6f600b87e0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:51.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.365+0000 7f6f6835b640 1 -- 172.21.15.123:0/37891704 >> 172.21.15.123:0/37891704 conn(0x7f6f600d1260 msgr2=0x7f6f600d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:51.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.365+0000 7f6f6835b640 1 -- 172.21.15.123:0/37891704 shutdown_connections 2024-09-15T23:18:51.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.365+0000 7f6f6835b640 1 -- 172.21.15.123:0/37891704 wait complete. 2024-09-15T23:18:51.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.367+0000 7f6f6835b640 1 Processor -- start 2024-09-15T23:18:51.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.367+0000 7f6f6835b640 1 -- start start 2024-09-15T23:18:51.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.368+0000 7f6f6835b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f600b6970 0x7f6f600ab130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:51.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.368+0000 7f6f6835b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f600d23b0 0x7f6f6015bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:51.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.368+0000 7f6f6835b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6f6015ed20 0x7f6f600aba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:51.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.368+0000 7f6f6835b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6f600d32a0 con 0x7f6f600b6970 2024-09-15T23:18:51.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.368+0000 7f6f6835b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6f600d3e50 con 0x7f6f6015ed20 2024-09-15T23:18:51.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.368+0000 7f6f6835b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6f6015f100 con 0x7f6f600d23b0 2024-09-15T23:18:51.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.368+0000 7f6f660f7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f600b6970 0x7f6f600ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:51.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.368+0000 7f6f660f7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f600b6970 0x7f6f600ab130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57664/0 (socket says 172.21.15.123:57664) 2024-09-15T23:18:51.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.368+0000 7f6f660f7640 1 -- 172.21.15.123:0/3646917263 learned_addr learned my addr 172.21.15.123:0/3646917263 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:51.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.368+0000 7f6f668f8640 1 --2- 172.21.15.123:0/3646917263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6f6015ed20 0x7f6f600aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:51.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.368+0000 7f6f658f6640 1 --2- 172.21.15.123:0/3646917263 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f600d23b0 0x7f6f6015bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:51.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.368+0000 7f6f660f7640 1 -- 172.21.15.123:0/3646917263 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f600d23b0 msgr2=0x7f6f6015bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:51.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.368+0000 7f6f660f7640 1 --2- 172.21.15.123:0/3646917263 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f600d23b0 0x7f6f6015bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:51.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.368+0000 7f6f660f7640 1 -- 172.21.15.123:0/3646917263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6f6015ed20 msgr2=0x7f6f600aba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:51.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.368+0000 7f6f660f7640 1 --2- 172.21.15.123:0/3646917263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6f6015ed20 0x7f6f600aba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:51.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.368+0000 7f6f660f7640 1 -- 172.21.15.123:0/3646917263 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f600ac860 con 0x7f6f600b6970 2024-09-15T23:18:51.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.368+0000 7f6f660f7640 1 --2- 172.21.15.123:0/3646917263 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f600b6970 0x7f6f600ab130 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c00c400 tx=0x7f6f5c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:51.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.369+0000 7f6f56ffd640 1 -- 172.21.15.123:0/3646917263 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c017070 con 0x7f6f600b6970 2024-09-15T23:18:51.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.369+0000 7f6f56ffd640 1 -- 172.21.15.123:0/3646917263 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f5c0052f0 con 0x7f6f600b6970 2024-09-15T23:18:51.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.369+0000 7f6f6835b640 1 -- 172.21.15.123:0/3646917263 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f6015f710 con 0x7f6f600b6970 2024-09-15T23:18:51.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.369+0000 7f6f56ffd640 1 -- 172.21.15.123:0/3646917263 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c003830 con 0x7f6f600b6970 2024-09-15T23:18:51.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.369+0000 7f6f6835b640 1 -- 172.21.15.123:0/3646917263 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f6015f9d0 con 0x7f6f600b6970 2024-09-15T23:18:51.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.370+0000 7f6f6835b640 1 -- 172.21.15.123:0/3646917263 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f600b7010 con 0x7f6f600b6970 2024-09-15T23:18:51.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.370+0000 7f6f56ffd640 1 -- 172.21.15.123:0/3646917263 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6f5c01a070 con 0x7f6f600b6970 2024-09-15T23:18:51.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.371+0000 7f6f56ffd640 1 --2- 172.21.15.123:0/3646917263 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6f4406c2b0 0x7f6f4406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:51.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.371+0000 7f6f56ffd640 1 -- 172.21.15.123:0/3646917263 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 4943+0+0 (secure 0 0 0) 0x7f6f5c08a480 con 0x7f6f600b6970 2024-09-15T23:18:51.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.371+0000 7f6f658f6640 1 --2- 172.21.15.123:0/3646917263 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6f4406c2b0 0x7f6f4406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:51.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.372+0000 7f6f658f6640 1 --2- 172.21.15.123:0/3646917263 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6f4406c2b0 0x7f6f4406e770 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f6f600cafe0 tx=0x7f6f50009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:51.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.379+0000 7f6f56ffd640 1 -- 172.21.15.123:0/3646917263 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6f5c058890 con 0x7f6f600b6970 2024-09-15T23:18:51.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:51.556+0000 7f6f6835b640 1 -- 172.21.15.123:0/3646917263 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f6f600d0a90 con 0x7f6f600b6970 2024-09-15T23:18:52.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.375+0000 7f6f56ffd640 1 -- 172.21.15.123:0/3646917263 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v126) ==== 97+0+0 (secure 0 0 0) 0x7f6f5c05cb90 con 0x7f6f600b6970 2024-09-15T23:18:52.378 INFO:teuthology.orchestra.run.smithi123.stderr: removed all blocklist entries 2024-09-15T23:18:52.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.378+0000 7f6f6835b640 1 -- 172.21.15.123:0/3646917263 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6f4406c2b0 msgr2=0x7f6f4406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:52.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.378+0000 7f6f6835b640 1 --2- 172.21.15.123:0/3646917263 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6f4406c2b0 0x7f6f4406e770 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f6f600cafe0 tx=0x7f6f50009040 comp rx=0 tx=0).stop 2024-09-15T23:18:52.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.378+0000 7f6f6835b640 1 -- 172.21.15.123:0/3646917263 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f600b6970 msgr2=0x7f6f600ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:52.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.378+0000 7f6f6835b640 1 --2- 172.21.15.123:0/3646917263 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f600b6970 0x7f6f600ab130 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c00c400 tx=0x7f6f5c00c8c0 comp rx=0 tx=0).stop 2024-09-15T23:18:52.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.378+0000 7f6f6835b640 1 -- 172.21.15.123:0/3646917263 shutdown_connections 2024-09-15T23:18:52.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.378+0000 7f6f6835b640 1 --2- 172.21.15.123:0/3646917263 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6f6015ed20 0x7f6f600aba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:52.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.378+0000 7f6f6835b640 1 --2- 172.21.15.123:0/3646917263 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6f600d23b0 0x7f6f6015bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:52.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.378+0000 7f6f6835b640 1 --2- 172.21.15.123:0/3646917263 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6f4406c2b0 0x7f6f4406e770 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:52.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.378+0000 7f6f6835b640 1 --2- 172.21.15.123:0/3646917263 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f600b6970 0x7f6f600ab130 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:52.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.378+0000 7f6f6835b640 1 -- 172.21.15.123:0/3646917263 >> 172.21.15.123:0/3646917263 conn(0x7f6f600d1260 msgr2=0x7f6f600cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:52.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.379+0000 7f6f6835b640 1 -- 172.21.15.123:0/3646917263 shutdown_connections 2024-09-15T23:18:52.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.379+0000 7f6f6835b640 1 -- 172.21.15.123:0/3646917263 wait complete. 2024-09-15T23:18:52.393 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T23:18:52.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.491+0000 7f8e832b7640 1 Processor -- start 2024-09-15T23:18:52.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.491+0000 7f8e832b7640 1 -- start start 2024-09-15T23:18:52.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.492+0000 7f8e832b7640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f8e7c15e790 0x7f8e7c073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:52.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.492+0000 7f8e832b7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8e7c162c60 0x7f8e7c0b5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:52.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.492+0000 7f8e832b7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8e7c0b5970 0x7f8e7c06f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:52.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.492+0000 7f8e832b7640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f8e7c15eb70 con 0x7f8e7c162c60 2024-09-15T23:18:52.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.492+0000 7f8e832b7640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f8e7c1631c0 con 0x7f8e7c15e790 2024-09-15T23:18:52.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.492+0000 7f8e832b7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8e7c0ae9a0 con 0x7f8e7c0b5970 2024-09-15T23:18:52.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.492+0000 7f8e80852640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8e7c162c60 0x7f8e7c0b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:52.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.492+0000 7f8e80852640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8e7c162c60 0x7f8e7c0b5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57674/0 (socket says 172.21.15.123:57674) 2024-09-15T23:18:52.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.492+0000 7f8e80852640 1 -- 172.21.15.123:0/3579456681 learned_addr learned my addr 172.21.15.123:0/3579456681 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:52.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.492+0000 7f8e81854640 1 --2- 172.21.15.123:0/3579456681 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8e7c0b5970 0x7f8e7c06f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:52.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.492+0000 7f8e81053640 1 --2- 172.21.15.123:0/3579456681 >> v2:172.21.15.188:3300/0 conn(0x7f8e7c15e790 0x7f8e7c073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:52.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.492+0000 7f8e80852640 1 -- 172.21.15.123:0/3579456681 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8e7c0b5970 msgr2=0x7f8e7c06f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:52.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.492+0000 7f8e80852640 1 --2- 172.21.15.123:0/3579456681 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8e7c0b5970 0x7f8e7c06f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:52.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.492+0000 7f8e80852640 1 -- 172.21.15.123:0/3579456681 >> v2:172.21.15.188:3300/0 conn(0x7f8e7c15e790 msgr2=0x7f8e7c073a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:52.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.492+0000 7f8e80852640 1 --2- 172.21.15.123:0/3579456681 >> v2:172.21.15.188:3300/0 conn(0x7f8e7c15e790 0x7f8e7c073a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:52.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.492+0000 7f8e80852640 1 -- 172.21.15.123:0/3579456681 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e7c0aec40 con 0x7f8e7c162c60 2024-09-15T23:18:52.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.492+0000 7f8e81053640 1 --2- 172.21.15.123:0/3579456681 >> v2:172.21.15.188:3300/0 conn(0x7f8e7c15e790 0x7f8e7c073a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:18:52.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.492+0000 7f8e81854640 1 --2- 172.21.15.123:0/3579456681 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8e7c0b5970 0x7f8e7c06f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:18:52.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.493+0000 7f8e80852640 1 --2- 172.21.15.123:0/3579456681 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e7c162c60 0x7f8e7c0b5430 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c0b27d0 tx=0x7f8e6c02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a0eab0ec9e2d1e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:52.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.493+0000 7f8e73fff640 1 -- 172.21.15.123:0/3579456681 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c037070 con 0x7f8e7c162c60 2024-09-15T23:18:52.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.493+0000 7f8e73fff640 1 -- 172.21.15.123:0/3579456681 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e6c02ae00 con 0x7f8e7c162c60 2024-09-15T23:18:52.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.493+0000 7f8e73fff640 1 -- 172.21.15.123:0/3579456681 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c032660 con 0x7f8e7c162c60 2024-09-15T23:18:52.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.494+0000 7f8e832b7640 1 -- 172.21.15.123:0/3579456681 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e7c162c60 msgr2=0x7f8e7c0b5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:52.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.494+0000 7f8e832b7640 1 --2- 172.21.15.123:0/3579456681 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e7c162c60 0x7f8e7c0b5430 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c0b27d0 tx=0x7f8e6c02a0b0 comp rx=0 tx=0).stop 2024-09-15T23:18:52.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.494+0000 7f8e832b7640 1 -- 172.21.15.123:0/3579456681 shutdown_connections 2024-09-15T23:18:52.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.494+0000 7f8e832b7640 1 --2- 172.21.15.123:0/3579456681 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8e7c0b5970 0x7f8e7c06f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:52.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.494+0000 7f8e832b7640 1 --2- 172.21.15.123:0/3579456681 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e7c162c60 0x7f8e7c0b5430 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:52.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.494+0000 7f8e832b7640 1 --2- 172.21.15.123:0/3579456681 >> v2:172.21.15.188:3300/0 conn(0x7f8e7c15e790 0x7f8e7c073a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:52.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.494+0000 7f8e832b7640 1 -- 172.21.15.123:0/3579456681 >> 172.21.15.123:0/3579456681 conn(0x7f8e7c0b0a80 msgr2=0x7f8e7c0b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:52.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.494+0000 7f8e832b7640 1 -- 172.21.15.123:0/3579456681 shutdown_connections 2024-09-15T23:18:52.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.494+0000 7f8e832b7640 1 -- 172.21.15.123:0/3579456681 wait complete. 2024-09-15T23:18:52.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.495+0000 7f8e832b7640 1 Processor -- start 2024-09-15T23:18:52.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.495+0000 7f8e832b7640 1 -- start start 2024-09-15T23:18:52.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.496+0000 7f8e832b7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e7c0b5970 0x7f8e7c0d07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:52.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.496+0000 7f8e832b7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e7c15e790 0x7f8e7c14c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:52.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.496+0000 7f8e832b7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8e7c162c60 0x7f8e7c1f4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:52.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.496+0000 7f8e832b7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8e7c06f430 con 0x7f8e7c15e790 2024-09-15T23:18:52.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.496+0000 7f8e832b7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8e7c0af200 con 0x7f8e7c0b5970 2024-09-15T23:18:52.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.496+0000 7f8e832b7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8e7c06fc70 con 0x7f8e7c162c60 2024-09-15T23:18:52.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.496+0000 7f8e80852640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e7c15e790 0x7f8e7c14c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:52.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.496+0000 7f8e80852640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e7c15e790 0x7f8e7c14c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57686/0 (socket says 172.21.15.123:57686) 2024-09-15T23:18:52.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.496+0000 7f8e80852640 1 -- 172.21.15.123:0/995043644 learned_addr learned my addr 172.21.15.123:0/995043644 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:52.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.496+0000 7f8e81854640 1 --2- 172.21.15.123:0/995043644 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8e7c162c60 0x7f8e7c1f4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:52.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.496+0000 7f8e81053640 1 --2- 172.21.15.123:0/995043644 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e7c0b5970 0x7f8e7c0d07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:52.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.496+0000 7f8e80852640 1 -- 172.21.15.123:0/995043644 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8e7c162c60 msgr2=0x7f8e7c1f4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:52.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.496+0000 7f8e80852640 1 --2- 172.21.15.123:0/995043644 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8e7c162c60 0x7f8e7c1f4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:52.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.496+0000 7f8e80852640 1 -- 172.21.15.123:0/995043644 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e7c0b5970 msgr2=0x7f8e7c0d07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:52.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.496+0000 7f8e80852640 1 --2- 172.21.15.123:0/995043644 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e7c0b5970 0x7f8e7c0d07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:52.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.496+0000 7f8e80852640 1 -- 172.21.15.123:0/995043644 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e7c1f4b90 con 0x7f8e7c15e790 2024-09-15T23:18:52.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.496+0000 7f8e81053640 1 --2- 172.21.15.123:0/995043644 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e7c0b5970 0x7f8e7c0d07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:18:52.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.496+0000 7f8e80852640 1 --2- 172.21.15.123:0/995043644 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e7c15e790 0x7f8e7c14c800 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c02a0f0 tx=0x7f8e6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:52.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.496+0000 7f8e71ffb640 1 -- 172.21.15.123:0/995043644 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c041070 con 0x7f8e7c15e790 2024-09-15T23:18:52.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.496+0000 7f8e71ffb640 1 -- 172.21.15.123:0/995043644 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e6c03c670 con 0x7f8e7c15e790 2024-09-15T23:18:52.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.496+0000 7f8e832b7640 1 -- 172.21.15.123:0/995043644 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e7c15c470 con 0x7f8e7c15e790 2024-09-15T23:18:52.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.496+0000 7f8e71ffb640 1 -- 172.21.15.123:0/995043644 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c037040 con 0x7f8e7c15e790 2024-09-15T23:18:52.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.497+0000 7f8e832b7640 1 -- 172.21.15.123:0/995043644 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e7c15ca30 con 0x7f8e7c15e790 2024-09-15T23:18:52.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.497+0000 7f8e832b7640 1 -- 172.21.15.123:0/995043644 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e7c070030 con 0x7f8e7c15e790 2024-09-15T23:18:52.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.498+0000 7f8e71ffb640 1 -- 172.21.15.123:0/995043644 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8e6c03a070 con 0x7f8e7c15e790 2024-09-15T23:18:52.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.498+0000 7f8e71ffb640 1 --2- 172.21.15.123:0/995043644 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8e6006c2e0 0x7f8e6006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:52.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.498+0000 7f8e71ffb640 1 -- 172.21.15.123:0/995043644 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 4857+0+0 (secure 0 0 0) 0x7f8e6c0ab3c0 con 0x7f8e7c15e790 2024-09-15T23:18:52.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.499+0000 7f8e81053640 1 --2- 172.21.15.123:0/995043644 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8e6006c2e0 0x7f8e6006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:52.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.499+0000 7f8e81053640 1 --2- 172.21.15.123:0/995043644 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8e6006c2e0 0x7f8e6006e7a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c0cfe60 tx=0x7f8e78008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:52.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.503+0000 7f8e71ffb640 1 -- 172.21.15.123:0/995043644 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8e6c079f10 con 0x7f8e7c15e790 2024-09-15T23:18:52.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.734+0000 7f8e832b7640 1 -- 172.21.15.123:0/995043644 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f8e7c0b11e0 con 0x7f8e7c15e790 2024-09-15T23:18:52.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.734+0000 7f8e71ffb640 1 -- 172.21.15.123:0/995043644 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5304 (secure 0 0 0) 0x7f8e6c0800e0 con 0x7f8e7c15e790 2024-09-15T23:18:52.736 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:18:52.737 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:18:52.737 INFO:teuthology.orchestra.run.smithi123.stdout: "auth_dump": [ 2024-09-15T23:18:52.737 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:18:52.737 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.a", 2024-09-15T23:18:52.737 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm9ATVDhAAnukyZogTuG4YCbzRXSCkiQ==", 2024-09-15T23:18:52.737 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:18:52.737 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:18:52.737 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:18:52.737 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:18:52.737 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:18:52.737 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:52.737 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:52.737 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:18:52.738 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.b", 2024-09-15T23:18:52.738 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm4KmaGhAAbf6vcffqiJTOYXK5DCXcZA==", 2024-09-15T23:18:52.738 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:18:52.738 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:18:52.738 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:18:52.738 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:18:52.738 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:18:52.738 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:52.738 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:52.738 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:18:52.738 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.c", 2024-09-15T23:18:52.738 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmua/VFRAAwbPm2TslrfQkrvHiO8oeLg==", 2024-09-15T23:18:52.738 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:18:52.739 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:18:52.739 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:18:52.739 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:18:52.739 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:18:52.739 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:52.739 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:52.739 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:18:52.739 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.d", 2024-09-15T23:18:52.739 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmzw3eIRAAaE+5y9USwp+xM3MTAndn7Q==", 2024-09-15T23:18:52.739 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:18:52.739 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:18:52.739 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:18:52.739 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:18:52.739 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:18:52.740 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:52.740 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:52.740 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:18:52.740 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.0", 2024-09-15T23:18:52.740 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCRaedmFrHGAxAAy/jTkothESNn2DC9xcHDAQ==", 2024-09-15T23:18:52.740 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:18:52.740 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:18:52.740 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:18:52.740 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:18:52.740 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:52.740 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:52.740 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:18:52.740 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.1", 2024-09-15T23:18:52.741 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCUaedm6vZlIxAAdsnLqFSng6SRpCT6UZKGsw==", 2024-09-15T23:18:52.741 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:18:52.741 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:18:52.741 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:18:52.741 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:18:52.741 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:52.741 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:52.741 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:18:52.741 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.2", 2024-09-15T23:18:52.741 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCYaedmXgVwFRAA1mOzzRafhKMsU7kTAT6TqA==", 2024-09-15T23:18:52.741 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:18:52.741 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:18:52.741 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:18:52.742 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:18:52.742 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:52.742 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:52.742 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:18:52.742 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.3", 2024-09-15T23:18:52.742 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCcaedm+APAFhAAb8blNFzswwHriSmCrMuA0A==", 2024-09-15T23:18:52.742 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:18:52.742 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:18:52.742 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:18:52.742 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:18:52.742 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:52.742 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:52.742 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:18:52.742 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.4", 2024-09-15T23:18:52.743 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCjaedmReUmABAAXpxsK7osxn/ZelVXKiCLOw==", 2024-09-15T23:18:52.743 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:18:52.743 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:18:52.743 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:18:52.743 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:18:52.743 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:52.743 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:52.743 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:18:52.743 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.5", 2024-09-15T23:18:52.743 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCnaedmtbdmARAAdxguBdtwBmtiaIx/y992GA==", 2024-09-15T23:18:52.743 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:18:52.743 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:18:52.743 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:18:52.744 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:18:52.744 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:52.744 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:52.744 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:18:52.744 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.6", 2024-09-15T23:18:52.744 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCraedmkR+NAxAAd2GAAH0BgOMonU8iTSn+Fw==", 2024-09-15T23:18:52.744 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:18:52.744 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:18:52.744 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:18:52.744 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:18:52.744 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:52.744 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:52.744 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:18:52.744 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.7", 2024-09-15T23:18:52.745 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCvaedmAaCwBBAAdpDtCbXchArmy019wiOdSQ==", 2024-09-15T23:18:52.745 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:18:52.745 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:18:52.745 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:18:52.745 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:18:52.745 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:52.745 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:52.745 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:18:52.745 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.0", 2024-09-15T23:18:52.745 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmzQPqJRAAhUf1dnVYohN4obCfeu8+7g==", 2024-09-15T23:18:52.745 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:18:52.745 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:18:52.745 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow r", 2024-09-15T23:18:52.746 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-15T23:18:52.746 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:52.746 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:52.746 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:18:52.746 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.1", 2024-09-15T23:18:52.746 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmdKK0LhAAXXmUkxVwMEjRTRXUh9CL/g==", 2024-09-15T23:18:52.746 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:18:52.746 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:18:52.746 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:18:52.746 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:18:52.746 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:18:52.746 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:52.746 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:52.747 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:18:52.747 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.2", 2024-09-15T23:18:52.747 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmRz55KxAARi7B4WYOY1QqH1CK81z9pA==", 2024-09-15T23:18:52.747 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:18:52.747 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:18:52.747 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:18:52.747 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:18:52.747 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:18:52.747 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:52.747 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:52.747 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:18:52.748 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.3", 2024-09-15T23:18:52.748 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmbWo8NBAAR1qGX1bs35ojx6lMxftcfg==", 2024-09-15T23:18:52.748 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:18:52.748 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:18:52.748 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:18:52.748 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:18:52.748 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:18:52.748 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:52.748 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:52.748 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:18:52.748 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.admin", 2024-09-15T23:18:52.748 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCMaedmVUW0LhAAqgPFk1HtxsZXcIStNN43pA==", 2024-09-15T23:18:52.748 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:18:52.749 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:18:52.749 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:18:52.749 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:18:52.749 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:18:52.749 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:52.749 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:52.749 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:18:52.749 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.x", 2024-09-15T23:18:52.749 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmGPSBCxAAHAhXQERogdAOm0ZPNtlxpw==", 2024-09-15T23:18:52.749 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:18:52.749 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:18:52.749 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-15T23:18:52.749 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:18:52.750 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:52.750 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:18:52.750 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:18:52.750 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.y", 2024-09-15T23:18:52.750 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm5Om4BxAA/7ZtMMlbUA3bvMCfaNMQyg==", 2024-09-15T23:18:52.750 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:18:52.750 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:18:52.750 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-15T23:18:52.750 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:18:52.750 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:52.750 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:52.751 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-15T23:18:52.751 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:18:52.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.736+0000 7f8e832b7640 1 -- 172.21.15.123:0/995043644 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8e6006c2e0 msgr2=0x7f8e6006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:52.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.736+0000 7f8e832b7640 1 --2- 172.21.15.123:0/995043644 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8e6006c2e0 0x7f8e6006e7a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c0cfe60 tx=0x7f8e78008040 comp rx=0 tx=0).stop 2024-09-15T23:18:52.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.736+0000 7f8e832b7640 1 -- 172.21.15.123:0/995043644 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e7c15e790 msgr2=0x7f8e7c14c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:52.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.736+0000 7f8e832b7640 1 --2- 172.21.15.123:0/995043644 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e7c15e790 0x7f8e7c14c800 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c02a0f0 tx=0x7f8e6c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:18:52.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.736+0000 7f8e832b7640 1 -- 172.21.15.123:0/995043644 shutdown_connections 2024-09-15T23:18:52.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.736+0000 7f8e832b7640 1 --2- 172.21.15.123:0/995043644 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8e7c162c60 0x7f8e7c1f4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:52.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.736+0000 7f8e832b7640 1 --2- 172.21.15.123:0/995043644 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8e6006c2e0 0x7f8e6006e7a0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:52.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.736+0000 7f8e832b7640 1 --2- 172.21.15.123:0/995043644 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e7c15e790 0x7f8e7c14c800 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:52.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.736+0000 7f8e832b7640 1 --2- 172.21.15.123:0/995043644 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e7c0b5970 0x7f8e7c0d07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:52.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.737+0000 7f8e832b7640 1 -- 172.21.15.123:0/995043644 >> 172.21.15.123:0/995043644 conn(0x7f8e7c0b0a80 msgr2=0x7f8e7c0735c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:52.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.737+0000 7f8e832b7640 1 -- 172.21.15.123:0/995043644 shutdown_connections 2024-09-15T23:18:52.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.737+0000 7f8e832b7640 1 -- 172.21.15.123:0/995043644 wait complete. 2024-09-15T23:18:52.753 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T23:18:52.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.850+0000 7f833d79f640 1 Processor -- start 2024-09-15T23:18:52.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.850+0000 7f833d79f640 1 -- start start 2024-09-15T23:18:52.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.851+0000 7f833d79f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f83380b2d40 0x7f833806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:52.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.851+0000 7f833d79f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f833806c150 0x7f833815c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:52.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.851+0000 7f833d79f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8338071180 con 0x7f833813eb20 2024-09-15T23:18:52.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.851+0000 7f833d79f640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f8338071ab0 con 0x7f833806c150 2024-09-15T23:18:52.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.851+0000 7f833d79f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8338071460 con 0x7f83380b2d40 2024-09-15T23:18:52.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.851+0000 7f8336ffd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f83380b2d40 0x7f833806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:52.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.851+0000 7f83377fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f833806c150 0x7f833815c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:52.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.851+0000 7f83367fc640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f833813eb20 0x7f833815bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:59322/0 (socket says 172.21.15.123:59322) 2024-09-15T23:18:52.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.851+0000 7f8336ffd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f83380b2d40 0x7f833806bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:38550/0 (socket says 172.21.15.123:38550) 2024-09-15T23:18:52.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.851+0000 7f83367fc640 1 -- 172.21.15.123:0/3803462311 learned_addr learned my addr 172.21.15.123:0/3803462311 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:18:52.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.852+0000 7f8336ffd640 1 -- 172.21.15.123:0/3803462311 >> v2:172.21.15.188:3300/0 conn(0x7f833806c150 msgr2=0x7f833815c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:52.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.852+0000 7f8336ffd640 1 --2- 172.21.15.123:0/3803462311 >> v2:172.21.15.188:3300/0 conn(0x7f833806c150 0x7f833815c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:52.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.852+0000 7f8336ffd640 1 -- 172.21.15.123:0/3803462311 >> v1:172.21.15.188:6789/0 conn(0x7f833813eb20 legacy=0x7f833815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:52.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.852+0000 7f8336ffd640 1 -- 172.21.15.123:0/3803462311 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8338071740 con 0x7f83380b2d40 2024-09-15T23:18:52.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.852+0000 7f83377fe640 1 --2- 172.21.15.123:0/3803462311 >> v2:172.21.15.188:3300/0 conn(0x7f833806c150 0x7f833815c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:18:52.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.852+0000 7f8336ffd640 1 --2- 172.21.15.123:0/3803462311 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f83380b2d40 0x7f833806bc10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8338071c30 tx=0x7f832802a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5160c8e20cf11fc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:52.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.853+0000 7f8335ffb640 1 -- 172.21.15.123:0/3803462311 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832802ae60 con 0x7f83380b2d40 2024-09-15T23:18:52.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.853+0000 7f8335ffb640 1 -- 172.21.15.123:0/3803462311 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8328007740 con 0x7f83380b2d40 2024-09-15T23:18:52.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.853+0000 7f8335ffb640 1 -- 172.21.15.123:0/3803462311 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8328007b10 con 0x7f83380b2d40 2024-09-15T23:18:52.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.853+0000 7f833d79f640 1 -- 172.21.15.123:0/3803462311 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f83380b2d40 msgr2=0x7f833806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:52.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.853+0000 7f833d79f640 1 --2- 172.21.15.123:0/3803462311 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f83380b2d40 0x7f833806bc10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8338071c30 tx=0x7f832802a640 comp rx=0 tx=0).stop 2024-09-15T23:18:52.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.853+0000 7f833d79f640 1 -- 172.21.15.123:0/3803462311 shutdown_connections 2024-09-15T23:18:52.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.853+0000 7f833d79f640 1 --2- 172.21.15.123:0/3803462311 >> v2:172.21.15.188:3300/0 conn(0x7f833806c150 0x7f833815c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:52.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.853+0000 7f833d79f640 1 --2- 172.21.15.123:0/3803462311 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f83380b2d40 0x7f833806bc10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:52.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.853+0000 7f833d79f640 1 -- 172.21.15.123:0/3803462311 >> 172.21.15.123:0/3803462311 conn(0x7f83380ccec0 msgr2=0x7f83380cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:52.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.853+0000 7f833d79f640 1 -- 172.21.15.123:0/3803462311 shutdown_connections 2024-09-15T23:18:52.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.853+0000 7f833d79f640 1 -- 172.21.15.123:0/3803462311 wait complete. 2024-09-15T23:18:52.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.855+0000 7f833d79f640 1 Processor -- start 2024-09-15T23:18:52.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.855+0000 7f833d79f640 1 -- start start 2024-09-15T23:18:52.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.855+0000 7f833d79f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f833806c150 0x7f8338154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:52.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.855+0000 7f833d79f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83380b2d40 0x7f833815af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:52.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.855+0000 7f833d79f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f833813eb20 0x7f833815b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:52.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.855+0000 7f833d79f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f83380722d0 con 0x7f83380b2d40 2024-09-15T23:18:52.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.855+0000 7f833d79f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8338072150 con 0x7f833806c150 2024-09-15T23:18:52.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.855+0000 7f833d79f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8338072450 con 0x7f833813eb20 2024-09-15T23:18:52.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.856+0000 7f83367fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83380b2d40 0x7f833815af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:52.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.856+0000 7f83367fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83380b2d40 0x7f833815af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57694/0 (socket says 172.21.15.123:57694) 2024-09-15T23:18:52.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.856+0000 7f83367fc640 1 -- 172.21.15.123:0/3539401223 learned_addr learned my addr 172.21.15.123:0/3539401223 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:52.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.856+0000 7f83377fe640 1 --2- 172.21.15.123:0/3539401223 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f833813eb20 0x7f833815b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:52.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.856+0000 7f8336ffd640 1 --2- 172.21.15.123:0/3539401223 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f833806c150 0x7f8338154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:52.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.856+0000 7f83367fc640 1 -- 172.21.15.123:0/3539401223 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f833813eb20 msgr2=0x7f833815b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:52.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.856+0000 7f83367fc640 1 --2- 172.21.15.123:0/3539401223 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f833813eb20 0x7f833815b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:52.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.856+0000 7f83367fc640 1 -- 172.21.15.123:0/3539401223 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f833806c150 msgr2=0x7f8338154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:52.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.856+0000 7f83367fc640 1 --2- 172.21.15.123:0/3539401223 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f833806c150 0x7f8338154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:52.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.856+0000 7f83367fc640 1 -- 172.21.15.123:0/3539401223 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f833815d6a0 con 0x7f83380b2d40 2024-09-15T23:18:52.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.856+0000 7f8336ffd640 1 --2- 172.21.15.123:0/3539401223 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f833806c150 0x7f8338154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:18:52.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.856+0000 7f83367fc640 1 --2- 172.21.15.123:0/3539401223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83380b2d40 0x7f833815af50 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f832c00c3f0 tx=0x7f832c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:52.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.856+0000 7f831f7fe640 1 -- 172.21.15.123:0/3539401223 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832c017070 con 0x7f83380b2d40 2024-09-15T23:18:52.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.856+0000 7f831f7fe640 1 -- 172.21.15.123:0/3539401223 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f832c005ce0 con 0x7f83380b2d40 2024-09-15T23:18:52.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.856+0000 7f831f7fe640 1 -- 172.21.15.123:0/3539401223 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832c0072d0 con 0x7f83380b2d40 2024-09-15T23:18:52.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.856+0000 7f833d79f640 1 -- 172.21.15.123:0/3539401223 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f833815d980 con 0x7f83380b2d40 2024-09-15T23:18:52.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.857+0000 7f833d79f640 1 -- 172.21.15.123:0/3539401223 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f833815df40 con 0x7f83380b2d40 2024-09-15T23:18:52.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.858+0000 7f833d79f640 1 -- 172.21.15.123:0/3539401223 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83380d1550 con 0x7f83380b2d40 2024-09-15T23:18:52.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.858+0000 7f831f7fe640 1 -- 172.21.15.123:0/3539401223 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f832c01a070 con 0x7f83380b2d40 2024-09-15T23:18:52.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.858+0000 7f831f7fe640 1 --2- 172.21.15.123:0/3539401223 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f832406c2b0 0x7f832406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:52.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.858+0000 7f831f7fe640 1 -- 172.21.15.123:0/3539401223 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 4857+0+0 (secure 0 0 0) 0x7f832c08a240 con 0x7f83380b2d40 2024-09-15T23:18:52.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.859+0000 7f8336ffd640 1 --2- 172.21.15.123:0/3539401223 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f832406c2b0 0x7f832406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:52.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.859+0000 7f8336ffd640 1 --2- 172.21.15.123:0/3539401223 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f832406c2b0 0x7f832406e770 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f8328034000 tx=0x7f832802f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:52.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:52.863+0000 7f831f7fe640 1 -- 172.21.15.123:0/3539401223 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f83380d1550 con 0x7f83380b2d40 2024-09-15T23:18:53.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.029+0000 7f833d79f640 1 -- 172.21.15.123:0/3539401223 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f833806bc10 con 0x7f83380b2d40 2024-09-15T23:18:53.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.030+0000 7f831f7fe640 1 -- 172.21.15.123:0/3539401223 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v126) ==== 84+0+65 (secure 0 0 0) 0x7f832c058740 con 0x7f83380b2d40 2024-09-15T23:18:53.032 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:18:53.032 INFO:teuthology.orchestra.run.smithi123.stdout:[ 2024-09-15T23:18:53.032 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:18:53.032 INFO:teuthology.orchestra.run.smithi123.stdout: "poolnum": 1, 2024-09-15T23:18:53.032 INFO:teuthology.orchestra.run.smithi123.stdout: "poolname": ".mgr" 2024-09-15T23:18:53.032 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:18:53.032 INFO:teuthology.orchestra.run.smithi123.stdout:] 2024-09-15T23:18:53.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.031+0000 7f833d79f640 1 -- 172.21.15.123:0/3539401223 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f832406c2b0 msgr2=0x7f832406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:53.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.031+0000 7f833d79f640 1 --2- 172.21.15.123:0/3539401223 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f832406c2b0 0x7f832406e770 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f8328034000 tx=0x7f832802f000 comp rx=0 tx=0).stop 2024-09-15T23:18:53.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.031+0000 7f833d79f640 1 -- 172.21.15.123:0/3539401223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83380b2d40 msgr2=0x7f833815af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:53.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.031+0000 7f833d79f640 1 --2- 172.21.15.123:0/3539401223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83380b2d40 0x7f833815af50 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f832c00c3f0 tx=0x7f832c00c7f0 comp rx=0 tx=0).stop 2024-09-15T23:18:53.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.032+0000 7f833d79f640 1 -- 172.21.15.123:0/3539401223 shutdown_connections 2024-09-15T23:18:53.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.032+0000 7f833d79f640 1 --2- 172.21.15.123:0/3539401223 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f833813eb20 0x7f833815b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:53.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.032+0000 7f833d79f640 1 --2- 172.21.15.123:0/3539401223 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f832406c2b0 0x7f832406e770 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:53.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.032+0000 7f833d79f640 1 --2- 172.21.15.123:0/3539401223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83380b2d40 0x7f833815af50 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:53.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.032+0000 7f833d79f640 1 --2- 172.21.15.123:0/3539401223 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f833806c150 0x7f8338154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:53.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.032+0000 7f833d79f640 1 -- 172.21.15.123:0/3539401223 >> 172.21.15.123:0/3539401223 conn(0x7f83380ccec0 msgr2=0x7f833813dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:53.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.032+0000 7f833d79f640 1 -- 172.21.15.123:0/3539401223 shutdown_connections 2024-09-15T23:18:53.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.032+0000 7f833d79f640 1 -- 172.21.15.123:0/3539401223 wait complete. 2024-09-15T23:18:53.045 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T23:18:53.045 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T23:18:53.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.145+0000 7fc298ad7640 1 Processor -- start 2024-09-15T23:18:53.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.145+0000 7fc298ad7640 1 -- start start 2024-09-15T23:18:53.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.146+0000 7fc298ad7640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc29415ea90 0x7fc2940d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:53.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.146+0000 7fc298ad7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2940d40b0 0x7fc2940d0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:53.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.146+0000 7fc298ad7640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2940cf060 con 0x7fc2940d1510 2024-09-15T23:18:53.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.146+0000 7fc298ad7640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fc2940d34c0 con 0x7fc29415ea90 2024-09-15T23:18:53.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.146+0000 7fc298ad7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc2940d1960 con 0x7fc2940d40b0 2024-09-15T23:18:53.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.147+0000 7fc29259c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc29415ea90 0x7fc2940d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:53.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.147+0000 7fc29259c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc29415ea90 0x7fc2940d2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:55482/0 (socket says 172.21.15.123:55482) 2024-09-15T23:18:53.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.147+0000 7fc291d9b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2940d40b0 0x7fc2940d0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:53.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.147+0000 7fc29259c640 1 -- 172.21.15.123:0/323914319 learned_addr learned my addr 172.21.15.123:0/323914319 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:53.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.147+0000 7fc292d9d640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fc2940d1510 0x7fc2940b6210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:59326/0 (socket says 172.21.15.123:59326) 2024-09-15T23:18:53.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.147+0000 7fc29259c640 1 -- 172.21.15.123:0/323914319 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2940d40b0 msgr2=0x7fc2940d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:53.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.147+0000 7fc29259c640 1 --2- 172.21.15.123:0/323914319 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2940d40b0 0x7fc2940d0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:53.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.147+0000 7fc29259c640 1 -- 172.21.15.123:0/323914319 >> v1:172.21.15.188:6789/0 conn(0x7fc2940d1510 legacy=0x7fc2940b6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:53.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.147+0000 7fc29259c640 1 -- 172.21.15.123:0/323914319 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2940cf340 con 0x7fc29415ea90 2024-09-15T23:18:53.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.148+0000 7fc29259c640 1 --2- 172.21.15.123:0/323914319 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc29415ea90 0x7fc2940d2f80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc284009870 tx=0x7fc28402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f352b01f260a91af server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:53.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.148+0000 7fc29159a640 1 -- 172.21.15.123:0/323914319 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc284037070 con 0x7fc29415ea90 2024-09-15T23:18:53.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.148+0000 7fc29159a640 1 -- 172.21.15.123:0/323914319 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc284032440 con 0x7fc29415ea90 2024-09-15T23:18:53.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.148+0000 7fc29159a640 1 -- 172.21.15.123:0/323914319 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc284032810 con 0x7fc29415ea90 2024-09-15T23:18:53.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.148+0000 7fc298ad7640 1 -- 172.21.15.123:0/323914319 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc29415ea90 msgr2=0x7fc2940d2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:53.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.148+0000 7fc298ad7640 1 --2- 172.21.15.123:0/323914319 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc29415ea90 0x7fc2940d2f80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc284009870 tx=0x7fc28402a270 comp rx=0 tx=0).stop 2024-09-15T23:18:53.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.148+0000 7fc298ad7640 1 -- 172.21.15.123:0/323914319 shutdown_connections 2024-09-15T23:18:53.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.148+0000 7fc298ad7640 1 --2- 172.21.15.123:0/323914319 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2940d40b0 0x7fc2940d0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:53.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.148+0000 7fc298ad7640 1 --2- 172.21.15.123:0/323914319 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc29415ea90 0x7fc2940d2f80 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:53.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.148+0000 7fc298ad7640 1 -- 172.21.15.123:0/323914319 >> 172.21.15.123:0/323914319 conn(0x7fc29406c0e0 msgr2=0x7fc29406c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:53.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.148+0000 7fc298ad7640 1 -- 172.21.15.123:0/323914319 shutdown_connections 2024-09-15T23:18:53.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.148+0000 7fc298ad7640 1 -- 172.21.15.123:0/323914319 wait complete. 2024-09-15T23:18:53.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.150+0000 7fc298ad7640 1 Processor -- start 2024-09-15T23:18:53.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.150+0000 7fc298ad7640 1 -- start start 2024-09-15T23:18:53.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.150+0000 7fc298ad7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2940d1510 0x7fc2941f4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:53.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.150+0000 7fc298ad7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2940d40b0 0x7fc2940cd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:53.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.151+0000 7fc298ad7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc29415ea90 0x7fc2940b9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:53.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.151+0000 7fc298ad7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc2940cfbe0 con 0x7fc2940d1510 2024-09-15T23:18:53.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.151+0000 7fc298ad7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc2940cf900 con 0x7fc29415ea90 2024-09-15T23:18:53.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.151+0000 7fc298ad7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc29415ee70 con 0x7fc2940d40b0 2024-09-15T23:18:53.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.151+0000 7fc29259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2940d1510 0x7fc2941f4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:53.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.151+0000 7fc29259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2940d1510 0x7fc2941f4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57696/0 (socket says 172.21.15.123:57696) 2024-09-15T23:18:53.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.151+0000 7fc29259c640 1 -- 172.21.15.123:0/1322795074 learned_addr learned my addr 172.21.15.123:0/1322795074 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:53.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.151+0000 7fc291d9b640 1 --2- 172.21.15.123:0/1322795074 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2940d40b0 0x7fc2940cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:53.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.151+0000 7fc292d9d640 1 --2- 172.21.15.123:0/1322795074 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc29415ea90 0x7fc2940b9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:53.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.151+0000 7fc29259c640 1 -- 172.21.15.123:0/1322795074 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2940d40b0 msgr2=0x7fc2940cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:53.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.151+0000 7fc29259c640 1 --2- 172.21.15.123:0/1322795074 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2940d40b0 0x7fc2940cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:53.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.151+0000 7fc29259c640 1 -- 172.21.15.123:0/1322795074 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc29415ea90 msgr2=0x7fc2940b9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:53.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.151+0000 7fc29259c640 1 --2- 172.21.15.123:0/1322795074 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc29415ea90 0x7fc2940b9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:53.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.151+0000 7fc29259c640 1 -- 172.21.15.123:0/1322795074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2940cde60 con 0x7fc2940d1510 2024-09-15T23:18:53.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.151+0000 7fc29259c640 1 --2- 172.21.15.123:0/1322795074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2940d1510 0x7fc2941f4df0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fc284000c00 tx=0x7fc2840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:53.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.151+0000 7fc282ffd640 1 -- 172.21.15.123:0/1322795074 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc284037040 con 0x7fc2940d1510 2024-09-15T23:18:53.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.151+0000 7fc282ffd640 1 -- 172.21.15.123:0/1322795074 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc284042070 con 0x7fc2940d1510 2024-09-15T23:18:53.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.151+0000 7fc298ad7640 1 -- 172.21.15.123:0/1322795074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2941f8550 con 0x7fc2940d1510 2024-09-15T23:18:53.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.151+0000 7fc282ffd640 1 -- 172.21.15.123:0/1322795074 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc284030880 con 0x7fc2940d1510 2024-09-15T23:18:53.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.151+0000 7fc298ad7640 1 -- 172.21.15.123:0/1322795074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2941f8b10 con 0x7fc2940d1510 2024-09-15T23:18:53.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.152+0000 7fc298ad7640 1 -- 172.21.15.123:0/1322795074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2940d0fd0 con 0x7fc2940d1510 2024-09-15T23:18:53.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.153+0000 7fc282ffd640 1 -- 172.21.15.123:0/1322795074 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc284030a20 con 0x7fc2940d1510 2024-09-15T23:18:53.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.153+0000 7fc282ffd640 1 --2- 172.21.15.123:0/1322795074 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc27406c2b0 0x7fc27406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:53.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.153+0000 7fc282ffd640 1 -- 172.21.15.123:0/1322795074 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 4857+0+0 (secure 0 0 0) 0x7fc2840ab770 con 0x7fc2940d1510 2024-09-15T23:18:53.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.153+0000 7fc291d9b640 1 --2- 172.21.15.123:0/1322795074 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc27406c2b0 0x7fc27406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:53.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.154+0000 7fc291d9b640 1 --2- 172.21.15.123:0/1322795074 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc27406c2b0 0x7fc27406e770 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc294158a20 tx=0x7fc288009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:53.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.157+0000 7fc282ffd640 1 -- 172.21.15.123:0/1322795074 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc284079c70 con 0x7fc2940d1510 2024-09-15T23:18:53.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.322+0000 7fc298ad7640 1 -- 172.21.15.123:0/1322795074 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc2940d2f80 con 0x7fc2940d1510 2024-09-15T23:18:53.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.381+0000 7fc282ffd640 1 -- 172.21.15.123:0/1322795074 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v127) ==== 138+0+0 (secure 0 0 0) 0x7fc28407df70 con 0x7fc2940d1510 2024-09-15T23:18:53.383 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' created 2024-09-15T23:18:53.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.384+0000 7fc298ad7640 1 -- 172.21.15.123:0/1322795074 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc27406c2b0 msgr2=0x7fc27406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:53.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.384+0000 7fc298ad7640 1 --2- 172.21.15.123:0/1322795074 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc27406c2b0 0x7fc27406e770 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc294158a20 tx=0x7fc288009190 comp rx=0 tx=0).stop 2024-09-15T23:18:53.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.384+0000 7fc298ad7640 1 -- 172.21.15.123:0/1322795074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2940d1510 msgr2=0x7fc2941f4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:53.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.384+0000 7fc298ad7640 1 --2- 172.21.15.123:0/1322795074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2940d1510 0x7fc2941f4df0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fc284000c00 tx=0x7fc2840046c0 comp rx=0 tx=0).stop 2024-09-15T23:18:53.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.384+0000 7fc298ad7640 1 -- 172.21.15.123:0/1322795074 shutdown_connections 2024-09-15T23:18:53.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.384+0000 7fc298ad7640 1 --2- 172.21.15.123:0/1322795074 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc29415ea90 0x7fc2940b9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:53.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.384+0000 7fc298ad7640 1 --2- 172.21.15.123:0/1322795074 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2940d40b0 0x7fc2940cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:53.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.384+0000 7fc298ad7640 1 --2- 172.21.15.123:0/1322795074 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc27406c2b0 0x7fc27406e770 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:53.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.384+0000 7fc298ad7640 1 --2- 172.21.15.123:0/1322795074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2940d1510 0x7fc2941f4df0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:53.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.384+0000 7fc298ad7640 1 -- 172.21.15.123:0/1322795074 >> 172.21.15.123:0/1322795074 conn(0x7fc29406c0e0 msgr2=0x7fc294160180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:53.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.384+0000 7fc298ad7640 1 -- 172.21.15.123:0/1322795074 shutdown_connections 2024-09-15T23:18:53.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.384+0000 7fc298ad7640 1 -- 172.21.15.123:0/1322795074 wait complete. 2024-09-15T23:18:53.398 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T23:18:53.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.501+0000 7f4a191c4640 1 Processor -- start 2024-09-15T23:18:53.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.502+0000 7f4a191c4640 1 -- start start 2024-09-15T23:18:53.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.502+0000 7f4a191c4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4a1415ea80 0x7f4a140d3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:53.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.502+0000 7f4a191c4640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4a140d4390 0x7f4a140b6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:53.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.502+0000 7f4a191c4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a140d2c80 con 0x7f4a140b6b60 2024-09-15T23:18:53.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.502+0000 7f4a191c4640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f4a140b6f90 con 0x7f4a1415ea80 2024-09-15T23:18:53.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.502+0000 7f4a191c4640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f4a140d2f60 con 0x7f4a140d4390 2024-09-15T23:18:53.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.502+0000 7f4a12d9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4a1415ea80 0x7f4a140d3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:53.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.502+0000 7f4a1359e640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f4a140b6b60 0x7f4a1406d8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47374/0 (socket says 172.21.15.123:47374) 2024-09-15T23:18:53.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.502+0000 7f4a1359e640 1 -- 172.21.15.123:0/3862266402 learned_addr learned my addr 172.21.15.123:0/3862266402 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:18:53.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.503+0000 7f4a12d9d640 1 -- 172.21.15.123:0/3862266402 >> v2:172.21.15.188:3300/0 conn(0x7f4a140d4390 msgr2=0x7f4a140b6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:53.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.503+0000 7f4a12d9d640 1 --2- 172.21.15.123:0/3862266402 >> v2:172.21.15.188:3300/0 conn(0x7f4a140d4390 0x7f4a140b6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:53.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.503+0000 7f4a12d9d640 1 -- 172.21.15.123:0/3862266402 >> v1:172.21.15.123:6789/0 conn(0x7f4a140b6b60 legacy=0x7f4a1406d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:53.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.503+0000 7f4a12d9d640 1 -- 172.21.15.123:0/3862266402 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a140d3240 con 0x7f4a1415ea80 2024-09-15T23:18:53.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.503+0000 7f4a11d9b640 1 -- 172.21.15.123:0/3862266402 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3536856650 0 0) 0x7f4a140d2c80 con 0x7f4a140b6b60 2024-09-15T23:18:53.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.503+0000 7f4a12d9d640 1 --2- 172.21.15.123:0/3862266402 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a1415ea80 0x7f4a140d3e50 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f4a1408d2a0 tx=0x7f4a0402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d994254db4001c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:53.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.504+0000 7f4a11d9b640 1 -- 172.21.15.123:0/3862266402 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a04037070 con 0x7f4a1415ea80 2024-09-15T23:18:53.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.504+0000 7f4a11d9b640 1 -- 172.21.15.123:0/3862266402 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a04032440 con 0x7f4a1415ea80 2024-09-15T23:18:53.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.504+0000 7f4a11d9b640 1 -- 172.21.15.123:0/3862266402 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a04032810 con 0x7f4a1415ea80 2024-09-15T23:18:53.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.504+0000 7f4a191c4640 1 -- 172.21.15.123:0/3862266402 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a1415ea80 msgr2=0x7f4a140d3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:53.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.504+0000 7f4a191c4640 1 --2- 172.21.15.123:0/3862266402 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a1415ea80 0x7f4a140d3e50 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f4a1408d2a0 tx=0x7f4a0402a230 comp rx=0 tx=0).stop 2024-09-15T23:18:53.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.504+0000 7f4a191c4640 1 -- 172.21.15.123:0/3862266402 shutdown_connections 2024-09-15T23:18:53.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.504+0000 7f4a191c4640 1 --2- 172.21.15.123:0/3862266402 >> v2:172.21.15.188:3300/0 conn(0x7f4a140d4390 0x7f4a140b6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:53.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.504+0000 7f4a191c4640 1 --2- 172.21.15.123:0/3862266402 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a1415ea80 0x7f4a140d3e50 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:53.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.504+0000 7f4a191c4640 1 -- 172.21.15.123:0/3862266402 >> 172.21.15.123:0/3862266402 conn(0x7f4a140d1620 msgr2=0x7f4a140d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:53.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.504+0000 7f4a191c4640 1 -- 172.21.15.123:0/3862266402 shutdown_connections 2024-09-15T23:18:53.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.504+0000 7f4a191c4640 1 -- 172.21.15.123:0/3862266402 wait complete. 2024-09-15T23:18:53.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.506+0000 7f4a191c4640 1 Processor -- start 2024-09-15T23:18:53.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.506+0000 7f4a191c4640 1 -- start start 2024-09-15T23:18:53.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.506+0000 7f4a191c4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a140b6b60 0x7f4a140c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:53.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.506+0000 7f4a191c4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a1415ea80 0x7f4a14157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:53.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.506+0000 7f4a191c4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a141f4d40 0x7f4a1415cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:53.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.506+0000 7f4a191c4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1415ee60 con 0x7f4a140b6b60 2024-09-15T23:18:53.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.506+0000 7f4a191c4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4a140d3800 con 0x7f4a141f4d40 2024-09-15T23:18:53.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.506+0000 7f4a191c4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4a140d2810 con 0x7f4a1415ea80 2024-09-15T23:18:53.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.506+0000 7f4a12d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a140b6b60 0x7f4a140c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:53.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.506+0000 7f4a12d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a140b6b60 0x7f4a140c9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57702/0 (socket says 172.21.15.123:57702) 2024-09-15T23:18:53.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.506+0000 7f4a12d9d640 1 -- 172.21.15.123:0/3810931326 learned_addr learned my addr 172.21.15.123:0/3810931326 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:53.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.507+0000 7f4a1359e640 1 --2- 172.21.15.123:0/3810931326 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a141f4d40 0x7f4a1415cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:53.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.507+0000 7f4a1259c640 1 --2- 172.21.15.123:0/3810931326 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a1415ea80 0x7f4a14157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:53.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.507+0000 7f4a12d9d640 1 -- 172.21.15.123:0/3810931326 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a1415ea80 msgr2=0x7f4a14157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:53.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.507+0000 7f4a12d9d640 1 --2- 172.21.15.123:0/3810931326 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a1415ea80 0x7f4a14157f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:53.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.507+0000 7f4a12d9d640 1 -- 172.21.15.123:0/3810931326 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a141f4d40 msgr2=0x7f4a1415cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:53.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.507+0000 7f4a12d9d640 1 --2- 172.21.15.123:0/3810931326 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a141f4d40 0x7f4a1415cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:53.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.507+0000 7f4a12d9d640 1 -- 172.21.15.123:0/3810931326 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a1415f110 con 0x7f4a140b6b60 2024-09-15T23:18:53.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.507+0000 7f4a1259c640 1 --2- 172.21.15.123:0/3810931326 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a1415ea80 0x7f4a14157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:18:53.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.507+0000 7f4a12d9d640 1 --2- 172.21.15.123:0/3810931326 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a140b6b60 0x7f4a140c9f10 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f4a04000c00 tx=0x7f4a040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:53.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.507+0000 7f4a0b7fe640 1 -- 172.21.15.123:0/3810931326 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a04041070 con 0x7f4a140b6b60 2024-09-15T23:18:53.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.507+0000 7f4a0b7fe640 1 -- 172.21.15.123:0/3810931326 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a0403c950 con 0x7f4a140b6b60 2024-09-15T23:18:53.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.507+0000 7f4a0b7fe640 1 -- 172.21.15.123:0/3810931326 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a04037040 con 0x7f4a140b6b60 2024-09-15T23:18:53.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.507+0000 7f4a191c4640 1 -- 172.21.15.123:0/3810931326 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a1415f3f0 con 0x7f4a140b6b60 2024-09-15T23:18:53.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.507+0000 7f4a191c4640 1 -- 172.21.15.123:0/3810931326 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a141f51d0 con 0x7f4a140b6b60 2024-09-15T23:18:53.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.508+0000 7f4a191c4640 1 -- 172.21.15.123:0/3810931326 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a140b6620 con 0x7f4a140b6b60 2024-09-15T23:18:53.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.509+0000 7f4a0b7fe640 1 -- 172.21.15.123:0/3810931326 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4a04044070 con 0x7f4a140b6b60 2024-09-15T23:18:53.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.509+0000 7f4a0b7fe640 1 --2- 172.21.15.123:0/3810931326 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f49f406c2b0 0x7f49f406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:53.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.509+0000 7f4a0b7fe640 1 -- 172.21.15.123:0/3810931326 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5227+0+0 (secure 0 0 0) 0x7f4a040ac000 con 0x7f4a140b6b60 2024-09-15T23:18:53.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.509+0000 7f4a1259c640 1 --2- 172.21.15.123:0/3810931326 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f49f406c2b0 0x7f49f406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:53.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.510+0000 7f4a1259c640 1 --2- 172.21.15.123:0/3810931326 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f49f406c2b0 0x7f49f406e770 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4a140b47c0 tx=0x7f49fc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:53.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.513+0000 7f4a0b7fe640 1 -- 172.21.15.123:0/3810931326 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4a0407ab00 con 0x7f4a140b6b60 2024-09-15T23:18:53.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:53.681+0000 7f4a191c4640 1 -- 172.21.15.123:0/3810931326 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f4a140ba100 con 0x7f4a140b6b60 2024-09-15T23:18:54.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.386+0000 7f4a0b7fe640 1 -- 172.21.15.123:0/3810931326 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v128) ==== 170+0+0 (secure 0 0 0) 0x7f4a0407a400 con 0x7f4a140b6b60 2024-09-15T23:18:54.388 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' created 2024-09-15T23:18:54.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.389+0000 7f4a191c4640 1 -- 172.21.15.123:0/3810931326 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f49f406c2b0 msgr2=0x7f49f406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:54.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.389+0000 7f4a191c4640 1 --2- 172.21.15.123:0/3810931326 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f49f406c2b0 0x7f49f406e770 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4a140b47c0 tx=0x7f49fc008040 comp rx=0 tx=0).stop 2024-09-15T23:18:54.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.389+0000 7f4a191c4640 1 -- 172.21.15.123:0/3810931326 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a140b6b60 msgr2=0x7f4a140c9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:54.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.389+0000 7f4a191c4640 1 --2- 172.21.15.123:0/3810931326 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a140b6b60 0x7f4a140c9f10 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f4a04000c00 tx=0x7f4a040046c0 comp rx=0 tx=0).stop 2024-09-15T23:18:54.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.390+0000 7f4a191c4640 1 -- 172.21.15.123:0/3810931326 shutdown_connections 2024-09-15T23:18:54.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.390+0000 7f4a191c4640 1 --2- 172.21.15.123:0/3810931326 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a141f4d40 0x7f4a1415cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:54.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.390+0000 7f4a191c4640 1 --2- 172.21.15.123:0/3810931326 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a1415ea80 0x7f4a14157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:54.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.390+0000 7f4a191c4640 1 --2- 172.21.15.123:0/3810931326 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f49f406c2b0 0x7f49f406e770 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:54.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.390+0000 7f4a191c4640 1 --2- 172.21.15.123:0/3810931326 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a140b6b60 0x7f4a140c9f10 secure :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f4a04000c00 tx=0x7f4a040046c0 comp rx=0 tx=0).stop 2024-09-15T23:18:54.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.390+0000 7f4a191c4640 1 -- 172.21.15.123:0/3810931326 >> 172.21.15.123:0/3810931326 conn(0x7f4a140d1620 msgr2=0x7f4a140cefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:54.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.390+0000 7f4a191c4640 1 -- 172.21.15.123:0/3810931326 shutdown_connections 2024-09-15T23:18:54.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.390+0000 7f4a191c4640 1 -- 172.21.15.123:0/3810931326 wait complete. 2024-09-15T23:18:54.414 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T23:18:54.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.514+0000 7fe21271a640 1 Processor -- start 2024-09-15T23:18:54.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.514+0000 7fe21271a640 1 -- start start 2024-09-15T23:18:54.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.514+0000 7fe21271a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe20c15c6d0 0x7fe20c1608d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:54.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.514+0000 7fe21271a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe20c0b7ce0 0x7fe20c0d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:54.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.515+0000 7fe21271a640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe20c0cdd30 con 0x7fe20c0d06f0 2024-09-15T23:18:54.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.515+0000 7fe21271a640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe20c0cdfd0 con 0x7fe20c0b7ce0 2024-09-15T23:18:54.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.515+0000 7fe21271a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe20c0ce2b0 con 0x7fe20c15c6d0 2024-09-15T23:18:54.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.515+0000 7fe20b7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe20c0b7ce0 0x7fe20c0d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:54.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.515+0000 7fe20b7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe20c0b7ce0 0x7fe20c0d01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57714/0 (socket says 172.21.15.123:57714) 2024-09-15T23:18:54.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.515+0000 7fe20b7fe640 1 -- 172.21.15.123:0/2501751579 learned_addr learned my addr 172.21.15.123:0/2501751579 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:54.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.515+0000 7fe20bfff640 1 --2- 172.21.15.123:0/2501751579 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe20c15c6d0 0x7fe20c1608d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:54.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.515+0000 7fe20b7fe640 1 -- 172.21.15.123:0/2501751579 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe20c15c6d0 msgr2=0x7fe20c1608d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:54.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.515+0000 7fe20b7fe640 1 --2- 172.21.15.123:0/2501751579 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe20c15c6d0 0x7fe20c1608d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:54.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.515+0000 7fe20b7fe640 1 -- 172.21.15.123:0/2501751579 >> v1:172.21.15.188:6789/0 conn(0x7fe20c0d06f0 legacy=0x7fe20c0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:54.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.515+0000 7fe20b7fe640 1 -- 172.21.15.123:0/2501751579 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe20c0ce590 con 0x7fe20c0b7ce0 2024-09-15T23:18:54.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.515+0000 7fe20bfff640 1 --2- 172.21.15.123:0/2501751579 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe20c15c6d0 0x7fe20c1608d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:18:54.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.516+0000 7fe20b7fe640 1 --2- 172.21.15.123:0/2501751579 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe20c0b7ce0 0x7fe20c0d01b0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7fe200009870 tx=0x7fe20002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54276d18003a2ddb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:54.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.516+0000 7fe20affd640 1 -- 172.21.15.123:0/2501751579 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe200037070 con 0x7fe20c0b7ce0 2024-09-15T23:18:54.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.516+0000 7fe20affd640 1 -- 172.21.15.123:0/2501751579 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe200032440 con 0x7fe20c0b7ce0 2024-09-15T23:18:54.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.516+0000 7fe20affd640 1 -- 172.21.15.123:0/2501751579 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe200032810 con 0x7fe20c0b7ce0 2024-09-15T23:18:54.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.516+0000 7fe21271a640 1 -- 172.21.15.123:0/2501751579 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe20c0b7ce0 msgr2=0x7fe20c0d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:54.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.516+0000 7fe21271a640 1 --2- 172.21.15.123:0/2501751579 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe20c0b7ce0 0x7fe20c0d01b0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7fe200009870 tx=0x7fe20002a270 comp rx=0 tx=0).stop 2024-09-15T23:18:54.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.516+0000 7fe21271a640 1 -- 172.21.15.123:0/2501751579 shutdown_connections 2024-09-15T23:18:54.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.516+0000 7fe21271a640 1 --2- 172.21.15.123:0/2501751579 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe20c0b7ce0 0x7fe20c0d01b0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:54.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.516+0000 7fe21271a640 1 --2- 172.21.15.123:0/2501751579 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe20c15c6d0 0x7fe20c1608d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:54.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.516+0000 7fe21271a640 1 -- 172.21.15.123:0/2501751579 >> 172.21.15.123:0/2501751579 conn(0x7fe20c067f80 msgr2=0x7fe20c0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:54.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.516+0000 7fe21271a640 1 -- 172.21.15.123:0/2501751579 shutdown_connections 2024-09-15T23:18:54.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.517+0000 7fe21271a640 1 -- 172.21.15.123:0/2501751579 wait complete. 2024-09-15T23:18:54.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.518+0000 7fe21271a640 1 Processor -- start 2024-09-15T23:18:54.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.518+0000 7fe21271a640 1 -- start start 2024-09-15T23:18:54.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.519+0000 7fe21271a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe20c0b7ce0 0x7fe20c1e6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:54.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.519+0000 7fe21271a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe20c0d06f0 0x7fe20c15b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:54.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.519+0000 7fe21271a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe20c15c6d0 0x7fe20c0cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:54.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.519+0000 7fe21271a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe20c160e10 con 0x7fe20c0d06f0 2024-09-15T23:18:54.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.519+0000 7fe21271a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe20c0ceb50 con 0x7fe20c0b7ce0 2024-09-15T23:18:54.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.519+0000 7fe21271a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe20c160f90 con 0x7fe20c15c6d0 2024-09-15T23:18:54.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.519+0000 7fe20b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe20c0d06f0 0x7fe20c15b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:54.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.519+0000 7fe20b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe20c0d06f0 0x7fe20c15b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57716/0 (socket says 172.21.15.123:57716) 2024-09-15T23:18:54.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.519+0000 7fe20b7fe640 1 -- 172.21.15.123:0/1316387867 learned_addr learned my addr 172.21.15.123:0/1316387867 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:54.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.519+0000 7fe20bfff640 1 --2- 172.21.15.123:0/1316387867 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe20c0b7ce0 0x7fe20c1e6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:54.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.519+0000 7fe210cb7640 1 --2- 172.21.15.123:0/1316387867 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe20c15c6d0 0x7fe20c0cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:54.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.519+0000 7fe20b7fe640 1 -- 172.21.15.123:0/1316387867 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe20c15c6d0 msgr2=0x7fe20c0cb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:54.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.519+0000 7fe20b7fe640 1 --2- 172.21.15.123:0/1316387867 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe20c15c6d0 0x7fe20c0cb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:54.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.519+0000 7fe20b7fe640 1 -- 172.21.15.123:0/1316387867 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe20c0b7ce0 msgr2=0x7fe20c1e6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:54.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.519+0000 7fe20b7fe640 1 --2- 172.21.15.123:0/1316387867 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe20c0b7ce0 0x7fe20c1e6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:54.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.519+0000 7fe20b7fe640 1 -- 172.21.15.123:0/1316387867 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe20c0c6730 con 0x7fe20c0d06f0 2024-09-15T23:18:54.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.519+0000 7fe20b7fe640 1 --2- 172.21.15.123:0/1316387867 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe20c0d06f0 0x7fe20c15b6c0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7fe200000c00 tx=0x7fe2000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:54.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.519+0000 7fe208ff9640 1 -- 172.21.15.123:0/1316387867 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe200041020 con 0x7fe20c0d06f0 2024-09-15T23:18:54.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.519+0000 7fe208ff9640 1 -- 172.21.15.123:0/1316387867 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2000306c0 con 0x7fe20c0d06f0 2024-09-15T23:18:54.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.519+0000 7fe21271a640 1 -- 172.21.15.123:0/1316387867 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe20c1e72b0 con 0x7fe20c0d06f0 2024-09-15T23:18:54.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.519+0000 7fe208ff9640 1 -- 172.21.15.123:0/1316387867 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe200037040 con 0x7fe20c0d06f0 2024-09-15T23:18:54.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.519+0000 7fe21271a640 1 -- 172.21.15.123:0/1316387867 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe20c0c69d0 con 0x7fe20c0d06f0 2024-09-15T23:18:54.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.520+0000 7fe21271a640 1 -- 172.21.15.123:0/1316387867 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe20c073790 con 0x7fe20c0d06f0 2024-09-15T23:18:54.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.521+0000 7fe208ff9640 1 -- 172.21.15.123:0/1316387867 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe200044020 con 0x7fe20c0d06f0 2024-09-15T23:18:54.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.521+0000 7fe208ff9640 1 --2- 172.21.15.123:0/1316387867 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe1f806c2b0 0x7fe1f806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:54.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.522+0000 7fe208ff9640 1 -- 172.21.15.123:0/1316387867 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5609+0+0 (secure 0 0 0) 0x7fe2000abac0 con 0x7fe20c0d06f0 2024-09-15T23:18:54.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.522+0000 7fe20bfff640 1 --2- 172.21.15.123:0/1316387867 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe1f806c2b0 0x7fe1f806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:54.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.522+0000 7fe20bfff640 1 --2- 172.21.15.123:0/1316387867 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe1f806c2b0 0x7fe1f806e770 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc007990 tx=0x7fe1fc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:54.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.527+0000 7fe208ff9640 1 -- 172.21.15.123:0/1316387867 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe20c073790 con 0x7fe20c0d06f0 2024-09-15T23:18:54.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:54.725+0000 7fe21271a640 1 -- 172.21.15.123:0/1316387867 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe20c069b20 con 0x7fe20c0d06f0 2024-09-15T23:18:55.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.388+0000 7fe208ff9640 1 -- 172.21.15.123:0/1316387867 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v78) ==== 174+0+0 (secure 0 0 0) 0x7fe20004b030 con 0x7fe20c0d06f0 2024-09-15T23:18:55.390 INFO:teuthology.orchestra.run.smithi123.stderr:new fs with metadata pool 16 and data pool 17 2024-09-15T23:18:55.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.394+0000 7fe21271a640 1 -- 172.21.15.123:0/1316387867 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe1f806c2b0 msgr2=0x7fe1f806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:55.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.395+0000 7fe21271a640 1 --2- 172.21.15.123:0/1316387867 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe1f806c2b0 0x7fe1f806e770 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc007990 tx=0x7fe1fc008040 comp rx=0 tx=0).stop 2024-09-15T23:18:55.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.395+0000 7fe21271a640 1 -- 172.21.15.123:0/1316387867 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe20c0d06f0 msgr2=0x7fe20c15b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:55.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.395+0000 7fe21271a640 1 --2- 172.21.15.123:0/1316387867 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe20c0d06f0 0x7fe20c15b6c0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7fe200000c00 tx=0x7fe2000046c0 comp rx=0 tx=0).stop 2024-09-15T23:18:55.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.395+0000 7fe21271a640 1 -- 172.21.15.123:0/1316387867 shutdown_connections 2024-09-15T23:18:55.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.395+0000 7fe21271a640 1 --2- 172.21.15.123:0/1316387867 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe20c15c6d0 0x7fe20c0cb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:55.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.395+0000 7fe21271a640 1 --2- 172.21.15.123:0/1316387867 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe1f806c2b0 0x7fe1f806e770 secure :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc007990 tx=0x7fe1fc008040 comp rx=0 tx=0).stop 2024-09-15T23:18:55.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.395+0000 7fe21271a640 1 --2- 172.21.15.123:0/1316387867 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe20c0d06f0 0x7fe20c15b6c0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:55.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.395+0000 7fe21271a640 1 --2- 172.21.15.123:0/1316387867 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe20c0b7ce0 0x7fe20c1e6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:55.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.395+0000 7fe21271a640 1 -- 172.21.15.123:0/1316387867 >> 172.21.15.123:0/1316387867 conn(0x7fe20c067f80 msgr2=0x7fe20c0b30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:55.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.398+0000 7fe21271a640 1 -- 172.21.15.123:0/1316387867 shutdown_connections 2024-09-15T23:18:55.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.399+0000 7fe21271a640 1 -- 172.21.15.123:0/1316387867 wait complete. 2024-09-15T23:18:55.422 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:18:55.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.521+0000 7f2871253640 1 Processor -- start 2024-09-15T23:18:55.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.521+0000 7f2871253640 1 -- start start 2024-09-15T23:18:55.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.522+0000 7f2871253640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f286c145ed0 0x7f286c0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:55.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.522+0000 7f2871253640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f286c0b5f90 0x7f286c0735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:55.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.522+0000 7f2871253640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f286c0b4020 con 0x7f286c073180 2024-09-15T23:18:55.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.522+0000 7f2871253640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f286c073b00 con 0x7f286c0b5f90 2024-09-15T23:18:55.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.522+0000 7f2871253640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f286c0b42c0 con 0x7f286c145ed0 2024-09-15T23:18:55.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.522+0000 7f286b59e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f286c0b5f90 0x7f286c0735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:55.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.522+0000 7f286a59c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f286c073180 0x7f286c0b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47382/0 (socket says 172.21.15.123:47382) 2024-09-15T23:18:55.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.522+0000 7f286a59c640 1 -- 172.21.15.123:0/289988482 learned_addr learned my addr 172.21.15.123:0/289988482 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:18:55.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.522+0000 7f286ad9d640 1 --2- 172.21.15.123:0/289988482 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f286c145ed0 0x7f286c0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:55.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.522+0000 7f286b59e640 1 -- 172.21.15.123:0/289988482 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f286c145ed0 msgr2=0x7f286c0b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:55.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.522+0000 7f286b59e640 1 --2- 172.21.15.123:0/289988482 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f286c145ed0 0x7f286c0b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:55.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.522+0000 7f286b59e640 1 -- 172.21.15.123:0/289988482 >> v1:172.21.15.123:6789/0 conn(0x7f286c073180 legacy=0x7f286c0b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:55.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.522+0000 7f286b59e640 1 -- 172.21.15.123:0/289988482 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f286c0b45a0 con 0x7f286c0b5f90 2024-09-15T23:18:55.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.522+0000 7f2869d9b640 1 -- 172.21.15.123:0/289988482 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1932898264 0 0) 0x7f286c0b4020 con 0x7f286c073180 2024-09-15T23:18:55.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.523+0000 7f286b59e640 1 --2- 172.21.15.123:0/289988482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f286c0b5f90 0x7f286c0735c0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f2864009d90 tx=0x7f286402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=773ffafd35f00858 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:55.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.523+0000 7f2869d9b640 1 -- 172.21.15.123:0/289988482 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2864007740 con 0x7f286c0b5f90 2024-09-15T23:18:55.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.523+0000 7f2869d9b640 1 -- 172.21.15.123:0/289988482 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28640078e0 con 0x7f286c0b5f90 2024-09-15T23:18:55.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.523+0000 7f2869d9b640 1 -- 172.21.15.123:0/289988482 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2864007cb0 con 0x7f286c0b5f90 2024-09-15T23:18:55.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.523+0000 7f2871253640 1 -- 172.21.15.123:0/289988482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f286c0b5f90 msgr2=0x7f286c0735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:55.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.523+0000 7f2871253640 1 --2- 172.21.15.123:0/289988482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f286c0b5f90 0x7f286c0735c0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f2864009d90 tx=0x7f286402a660 comp rx=0 tx=0).stop 2024-09-15T23:18:55.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.523+0000 7f2871253640 1 -- 172.21.15.123:0/289988482 shutdown_connections 2024-09-15T23:18:55.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.523+0000 7f2871253640 1 --2- 172.21.15.123:0/289988482 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f286c0b5f90 0x7f286c0735c0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:55.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.523+0000 7f2871253640 1 --2- 172.21.15.123:0/289988482 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f286c145ed0 0x7f286c0b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:55.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.523+0000 7f2871253640 1 -- 172.21.15.123:0/289988482 >> 172.21.15.123:0/289988482 conn(0x7f286c0ccec0 msgr2=0x7f286c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:55.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.523+0000 7f2871253640 1 -- 172.21.15.123:0/289988482 shutdown_connections 2024-09-15T23:18:55.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.523+0000 7f2871253640 1 -- 172.21.15.123:0/289988482 wait complete. 2024-09-15T23:18:55.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.525+0000 7f2871253640 1 Processor -- start 2024-09-15T23:18:55.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.525+0000 7f2871253640 1 -- start start 2024-09-15T23:18:55.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.526+0000 7f2871253640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f286c073180 0x7f286c1f20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:55.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.526+0000 7f2871253640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f286c0b5f90 0x7f286c1e3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:55.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.526+0000 7f2871253640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f286c145ed0 0x7f286c1e22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:55.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.526+0000 7f2871253640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f286c1462b0 con 0x7f286c145ed0 2024-09-15T23:18:55.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.526+0000 7f2871253640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f286c0b4b60 con 0x7f286c073180 2024-09-15T23:18:55.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.526+0000 7f2871253640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f286c146430 con 0x7f286c0b5f90 2024-09-15T23:18:55.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.526+0000 7f286b59e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f286c145ed0 0x7f286c1e22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:55.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.526+0000 7f286b59e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f286c145ed0 0x7f286c1e22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57728/0 (socket says 172.21.15.123:57728) 2024-09-15T23:18:55.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.526+0000 7f286b59e640 1 -- 172.21.15.123:0/1232678588 learned_addr learned my addr 172.21.15.123:0/1232678588 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:55.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.526+0000 7f286a59c640 1 --2- 172.21.15.123:0/1232678588 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f286c0b5f90 0x7f286c1e3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:55.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.526+0000 7f286ad9d640 1 --2- 172.21.15.123:0/1232678588 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f286c073180 0x7f286c1f20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:55.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.526+0000 7f286b59e640 1 -- 172.21.15.123:0/1232678588 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f286c0b5f90 msgr2=0x7f286c1e3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:55.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.526+0000 7f286b59e640 1 --2- 172.21.15.123:0/1232678588 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f286c0b5f90 0x7f286c1e3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:55.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.526+0000 7f286b59e640 1 -- 172.21.15.123:0/1232678588 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f286c073180 msgr2=0x7f286c1f20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:55.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.526+0000 7f286b59e640 1 --2- 172.21.15.123:0/1232678588 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f286c073180 0x7f286c1f20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:55.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.526+0000 7f286b59e640 1 -- 172.21.15.123:0/1232678588 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f286c1f2a50 con 0x7f286c145ed0 2024-09-15T23:18:55.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.526+0000 7f286ad9d640 1 --2- 172.21.15.123:0/1232678588 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f286c073180 0x7f286c1f20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:18:55.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.526+0000 7f286b59e640 1 --2- 172.21.15.123:0/1232678588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f286c145ed0 0x7f286c1e22e0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f286402a6a0 tx=0x7f2864004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:55.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.526+0000 7f28537fe640 1 -- 172.21.15.123:0/1232678588 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2864040070 con 0x7f286c145ed0 2024-09-15T23:18:55.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.526+0000 7f28537fe640 1 -- 172.21.15.123:0/1232678588 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2864031bc0 con 0x7f286c145ed0 2024-09-15T23:18:55.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.526+0000 7f28537fe640 1 -- 172.21.15.123:0/1232678588 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2864009450 con 0x7f286c145ed0 2024-09-15T23:18:55.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.527+0000 7f2871253640 1 -- 172.21.15.123:0/1232678588 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f286c1f2d30 con 0x7f286c145ed0 2024-09-15T23:18:55.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.527+0000 7f2871253640 1 -- 172.21.15.123:0/1232678588 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f286c1e1ae0 con 0x7f286c145ed0 2024-09-15T23:18:55.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.528+0000 7f2871253640 1 -- 172.21.15.123:0/1232678588 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f286c1e1fd0 con 0x7f286c145ed0 2024-09-15T23:18:55.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.528+0000 7f28537fe640 1 -- 172.21.15.123:0/1232678588 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2864039040 con 0x7f286c145ed0 2024-09-15T23:18:55.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.528+0000 7f28537fe640 1 --2- 172.21.15.123:0/1232678588 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f285806c2b0 0x7f285806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:55.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.528+0000 7f28537fe640 1 -- 172.21.15.123:0/1232678588 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7f28640ac600 con 0x7f286c145ed0 2024-09-15T23:18:55.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.529+0000 7f286ad9d640 1 --2- 172.21.15.123:0/1232678588 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f285806c2b0 0x7f285806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:55.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.529+0000 7f286ad9d640 1 --2- 172.21.15.123:0/1232678588 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f285806c2b0 0x7f285806e770 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f285c006fd0 tx=0x7f285c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:55.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.533+0000 7f28537fe640 1 -- 172.21.15.123:0/1232678588 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f286407a720 con 0x7f286c145ed0 2024-09-15T23:18:55.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.700+0000 7f2871253640 1 -- 172.21.15.123:0/1232678588 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f286c144fc0 con 0x7f286c145ed0 2024-09-15T23:18:55.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.701+0000 7f28537fe640 1 -- 172.21.15.123:0/1232678588 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) ==== 74+0+16780 (secure 0 0 0) 0x7f286407ea20 con 0x7f286c145ed0 2024-09-15T23:18:55.704 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:18:55.704 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":129,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:18:54.727590+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:18:53.342598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-15T23:18:53.702094+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:18:55.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.703+0000 7f2871253640 1 -- 172.21.15.123:0/1232678588 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f285806c2b0 msgr2=0x7f285806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:55.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.703+0000 7f2871253640 1 --2- 172.21.15.123:0/1232678588 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f285806c2b0 0x7f285806e770 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f285c006fd0 tx=0x7f285c008040 comp rx=0 tx=0).stop 2024-09-15T23:18:55.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.703+0000 7f2871253640 1 -- 172.21.15.123:0/1232678588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f286c145ed0 msgr2=0x7f286c1e22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:55.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.703+0000 7f2871253640 1 --2- 172.21.15.123:0/1232678588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f286c145ed0 0x7f286c1e22e0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f286402a6a0 tx=0x7f2864004a40 comp rx=0 tx=0).stop 2024-09-15T23:18:55.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.703+0000 7f2871253640 1 -- 172.21.15.123:0/1232678588 shutdown_connections 2024-09-15T23:18:55.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.703+0000 7f2871253640 1 --2- 172.21.15.123:0/1232678588 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f285806c2b0 0x7f285806e770 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:55.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.703+0000 7f2871253640 1 --2- 172.21.15.123:0/1232678588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f286c145ed0 0x7f286c1e22e0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:55.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.703+0000 7f2871253640 1 --2- 172.21.15.123:0/1232678588 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f286c0b5f90 0x7f286c1e3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:55.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.703+0000 7f2871253640 1 --2- 172.21.15.123:0/1232678588 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f286c073180 0x7f286c1f20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:55.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.703+0000 7f2871253640 1 -- 172.21.15.123:0/1232678588 >> 172.21.15.123:0/1232678588 conn(0x7f286c0ccec0 msgr2=0x7f286c0cf670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:55.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.703+0000 7f2871253640 1 -- 172.21.15.123:0/1232678588 shutdown_connections 2024-09-15T23:18:55.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.703+0000 7f2871253640 1 -- 172.21.15.123:0/1232678588 wait complete. 2024-09-15T23:18:55.716 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:18:55.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.813+0000 7f552f52a640 1 Processor -- start 2024-09-15T23:18:55.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.814+0000 7f552f52a640 1 -- start start 2024-09-15T23:18:55.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.814+0000 7f552f52a640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f552815ed20 0x7f55280b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:55.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.814+0000 7f552f52a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f55280d23b0 0x7f55280b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:55.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.814+0000 7f552f52a640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55280d0e70 con 0x7f55280cf2d0 2024-09-15T23:18:55.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.814+0000 7f552f52a640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f55280d41c0 con 0x7f552815ed20 2024-09-15T23:18:55.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.814+0000 7f552f52a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f55280d35b0 con 0x7f55280d23b0 2024-09-15T23:18:55.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.815+0000 7f552dac7640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f55280cf2d0 0x7f55280cf760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47394/0 (socket says 172.21.15.123:47394) 2024-09-15T23:18:55.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.815+0000 7f552dac7640 1 -- 172.21.15.123:0/2214169566 learned_addr learned my addr 172.21.15.123:0/2214169566 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:18:55.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.815+0000 7f551ffff640 1 -- 172.21.15.123:0/2214169566 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 944598168 0 0) 0x7f5520001490 con 0x7f55280cf2d0 2024-09-15T23:18:55.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.815+0000 7f551ffff640 1 -- 172.21.15.123:0/2214169566 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5514003520 con 0x7f55280cf2d0 2024-09-15T23:18:55.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.815+0000 7f552cac5640 1 --2- 172.21.15.123:0/2214169566 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f55280d23b0 0x7f55280b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:55.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.815+0000 7f552d2c6640 1 --2- 172.21.15.123:0/2214169566 >> v2:172.21.15.188:3300/0 conn(0x7f552815ed20 0x7f55280b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:55.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.815+0000 7f551ffff640 1 -- 172.21.15.123:0/2214169566 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1313455647 0 0) 0x7f5514003520 con 0x7f55280cf2d0 2024-09-15T23:18:55.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.815+0000 7f551ffff640 1 -- 172.21.15.123:0/2214169566 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f55280d23b0 msgr2=0x7f55280b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:55.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.815+0000 7f551ffff640 1 --2- 172.21.15.123:0/2214169566 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f55280d23b0 0x7f55280b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:55.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.815+0000 7f551ffff640 1 -- 172.21.15.123:0/2214169566 >> v2:172.21.15.188:3300/0 conn(0x7f552815ed20 msgr2=0x7f55280b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:55.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.815+0000 7f551ffff640 1 --2- 172.21.15.123:0/2214169566 >> v2:172.21.15.188:3300/0 conn(0x7f552815ed20 0x7f55280b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:55.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.815+0000 7f551ffff640 1 -- 172.21.15.123:0/2214169566 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55280d3890 con 0x7f55280cf2d0 2024-09-15T23:18:55.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.815+0000 7f551ffff640 1 -- 172.21.15.123:0/2214169566 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f5520001bc0 con 0x7f55280cf2d0 2024-09-15T23:18:55.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.815+0000 7f552cac5640 1 --2- 172.21.15.123:0/2214169566 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f55280d23b0 0x7f55280b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:18:55.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.815+0000 7f551ffff640 1 -- 172.21.15.123:0/2214169566 >> v1:172.21.15.123:6789/0 conn(0x7f55280cf2d0 legacy=0x7f55280cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:55.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.815+0000 7f551ffff640 1 --2- 172.21.15.123:0/2214169566 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55140039b0 0x7f5514003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:55.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.815+0000 7f551ffff640 1 --2- 172.21.15.123:0/2214169566 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f55280d23b0 0x7f5514004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:55.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.815+0000 7f551ffff640 1 --2- 172.21.15.123:0/2214169566 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5514004d40 0x7f55140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:55.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.815+0000 7f551ffff640 1 -- 172.21.15.123:0/2214169566 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f55280d41c0 con 0x7f55140039b0 2024-09-15T23:18:55.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.815+0000 7f551ffff640 1 -- 172.21.15.123:0/2214169566 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f55280d35b0 con 0x7f5514004d40 2024-09-15T23:18:55.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.815+0000 7f551ffff640 1 -- 172.21.15.123:0/2214169566 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f551400b9f0 con 0x7f55280d23b0 2024-09-15T23:18:55.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.815+0000 7f552d2c6640 1 --2- 172.21.15.123:0/2214169566 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55140039b0 0x7f5514003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:55.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.815+0000 7f552cac5640 1 --2- 172.21.15.123:0/2214169566 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f55280d23b0 0x7f5514004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:55.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.815+0000 7f552dac7640 1 --2- 172.21.15.123:0/2214169566 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5514004d40 0x7f55140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:55.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.816+0000 7f552d2c6640 1 -- 172.21.15.123:0/2214169566 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f55280d23b0 msgr2=0x7f5514004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:55.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.816+0000 7f552d2c6640 1 --2- 172.21.15.123:0/2214169566 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f55280d23b0 0x7f5514004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:55.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.816+0000 7f552d2c6640 1 -- 172.21.15.123:0/2214169566 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5514004d40 msgr2=0x7f55140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:55.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.816+0000 7f552d2c6640 1 --2- 172.21.15.123:0/2214169566 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5514004d40 0x7f55140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:55.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.816+0000 7f552d2c6640 1 -- 172.21.15.123:0/2214169566 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5514003520 con 0x7f55140039b0 2024-09-15T23:18:55.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.816+0000 7f552cac5640 1 --2- 172.21.15.123:0/2214169566 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f55280d23b0 0x7f5514004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:18:55.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.816+0000 7f552dac7640 1 --2- 172.21.15.123:0/2214169566 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5514004d40 0x7f55140051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:18:55.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.816+0000 7f552d2c6640 1 --2- 172.21.15.123:0/2214169566 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55140039b0 0x7f5514003dd0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f5524009ac0 tx=0x7f5514005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84ffb85e4d45b923 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:55.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.816+0000 7f551ffff640 1 -- 172.21.15.123:0/2214169566 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5524036070 con 0x7f55140039b0 2024-09-15T23:18:55.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.816+0000 7f551ffff640 1 -- 172.21.15.123:0/2214169566 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5524031400 con 0x7f55140039b0 2024-09-15T23:18:55.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.816+0000 7f551ffff640 1 -- 172.21.15.123:0/2214169566 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5524009690 con 0x7f55140039b0 2024-09-15T23:18:55.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.817+0000 7f552f52a640 1 -- 172.21.15.123:0/2214169566 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55140039b0 msgr2=0x7f5514003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:55.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.817+0000 7f552f52a640 1 --2- 172.21.15.123:0/2214169566 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55140039b0 0x7f5514003dd0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f5524009ac0 tx=0x7f5514005830 comp rx=0 tx=0).stop 2024-09-15T23:18:55.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.817+0000 7f552dac7640 1 -- 172.21.15.123:0/2214169566 reap_dead start 2024-09-15T23:18:55.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.817+0000 7f552f52a640 1 -- 172.21.15.123:0/2214169566 shutdown_connections 2024-09-15T23:18:55.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.817+0000 7f552f52a640 1 -- 172.21.15.123:0/2214169566 >> 172.21.15.123:0/2214169566 conn(0x7f55280d1260 msgr2=0x7f55280d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:55.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.817+0000 7f552f52a640 1 -- 172.21.15.123:0/2214169566 shutdown_connections 2024-09-15T23:18:55.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.817+0000 7f552f52a640 1 -- 172.21.15.123:0/2214169566 wait complete. 2024-09-15T23:18:55.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.818+0000 7f552f52a640 1 Processor -- start 2024-09-15T23:18:55.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.818+0000 7f552f52a640 1 -- start start 2024-09-15T23:18:55.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.819+0000 7f552f52a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f55140039b0 0x7f552814d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:55.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.819+0000 7f552f52a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f552815da00 0x7f55280b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:55.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.819+0000 7f552f52a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f55281e9a40 0x7f55281e9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:55.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.819+0000 7f552f52a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f55280d32a0 con 0x7f552815da00 2024-09-15T23:18:55.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.819+0000 7f552f52a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f55280d3e50 con 0x7f55281e9a40 2024-09-15T23:18:55.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.819+0000 7f552f52a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f552815f100 con 0x7f55140039b0 2024-09-15T23:18:55.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.819+0000 7f552cac5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f552815da00 0x7f55280b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:55.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.819+0000 7f552cac5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f552815da00 0x7f55280b2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57756/0 (socket says 172.21.15.123:57756) 2024-09-15T23:18:55.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.819+0000 7f552cac5640 1 -- 172.21.15.123:0/3770581150 learned_addr learned my addr 172.21.15.123:0/3770581150 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:55.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.819+0000 7f552cac5640 1 -- 172.21.15.123:0/3770581150 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f55140039b0 msgr2=0x7f552814d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:55.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.819+0000 7f552cac5640 1 --2- 172.21.15.123:0/3770581150 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f55140039b0 0x7f552814d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:55.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.819+0000 7f552cac5640 1 -- 172.21.15.123:0/3770581150 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f55281e9a40 msgr2=0x7f55281e9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:55.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.819+0000 7f552dac7640 1 --2- 172.21.15.123:0/3770581150 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f55281e9a40 0x7f55281e9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:55.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.819+0000 7f552cac5640 1 --2- 172.21.15.123:0/3770581150 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f55281e9a40 0x7f55281e9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:55.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.819+0000 7f552cac5640 1 -- 172.21.15.123:0/3770581150 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f552815e180 con 0x7f552815da00 2024-09-15T23:18:55.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.820+0000 7f552cac5640 1 --2- 172.21.15.123:0/3770581150 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f552815da00 0x7f55280b2c70 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f5518010890 tx=0x7f5518010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:55.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.820+0000 7f551dffb640 1 -- 172.21.15.123:0/3770581150 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f551801a020 con 0x7f552815da00 2024-09-15T23:18:55.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.820+0000 7f551dffb640 1 -- 172.21.15.123:0/3770581150 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f551800eb00 con 0x7f552815da00 2024-09-15T23:18:55.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.820+0000 7f552f52a640 1 -- 172.21.15.123:0/3770581150 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f552814ab50 con 0x7f552815da00 2024-09-15T23:18:55.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.820+0000 7f551dffb640 1 -- 172.21.15.123:0/3770581150 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f551800f040 con 0x7f552815da00 2024-09-15T23:18:55.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.820+0000 7f552f52a640 1 -- 172.21.15.123:0/3770581150 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f552814b110 con 0x7f552815da00 2024-09-15T23:18:55.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.821+0000 7f552f52a640 1 -- 172.21.15.123:0/3770581150 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55280b7010 con 0x7f552815da00 2024-09-15T23:18:55.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.821+0000 7f551dffb640 1 -- 172.21.15.123:0/3770581150 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f551801d020 con 0x7f552815da00 2024-09-15T23:18:55.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.822+0000 7f551dffb640 1 --2- 172.21.15.123:0/3770581150 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f550c06c2e0 0x7f550c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:55.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.822+0000 7f551dffb640 1 -- 172.21.15.123:0/3770581150 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7f551808bc80 con 0x7f552815da00 2024-09-15T23:18:55.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.822+0000 7f552d2c6640 1 --2- 172.21.15.123:0/3770581150 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f550c06c2e0 0x7f550c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:55.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.823+0000 7f552d2c6640 1 --2- 172.21.15.123:0/3770581150 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f550c06c2e0 0x7f550c06e7a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f5524033000 tx=0x7f552402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:55.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.826+0000 7f551dffb640 1 -- 172.21.15.123:0/3770581150 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5518024020 con 0x7f552815da00 2024-09-15T23:18:55.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.992+0000 7f552f52a640 1 -- 172.21.15.123:0/3770581150 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f55280b3f20 con 0x7f552815da00 2024-09-15T23:18:55.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.993+0000 7f551dffb640 1 -- 172.21.15.123:0/3770581150 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) ==== 74+0+16780 (secure 0 0 0) 0x7f5518027350 con 0x7f552815da00 2024-09-15T23:18:55.994 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:18:55.994 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":129,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:18:54.727590+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:18:53.342598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-15T23:18:53.702094+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:18:55.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.995+0000 7f552f52a640 1 -- 172.21.15.123:0/3770581150 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f550c06c2e0 msgr2=0x7f550c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:55.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.995+0000 7f552f52a640 1 --2- 172.21.15.123:0/3770581150 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f550c06c2e0 0x7f550c06e7a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f5524033000 tx=0x7f552402e000 comp rx=0 tx=0).stop 2024-09-15T23:18:55.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.995+0000 7f552f52a640 1 -- 172.21.15.123:0/3770581150 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f552815da00 msgr2=0x7f55280b2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:55.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.995+0000 7f552f52a640 1 --2- 172.21.15.123:0/3770581150 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f552815da00 0x7f55280b2c70 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f5518010890 tx=0x7f5518010d50 comp rx=0 tx=0).stop 2024-09-15T23:18:55.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.995+0000 7f552f52a640 1 -- 172.21.15.123:0/3770581150 shutdown_connections 2024-09-15T23:18:55.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.995+0000 7f552f52a640 1 --2- 172.21.15.123:0/3770581150 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f55281e9a40 0x7f55281e9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:55.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.995+0000 7f552f52a640 1 --2- 172.21.15.123:0/3770581150 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f550c06c2e0 0x7f550c06e7a0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:55.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.995+0000 7f552f52a640 1 --2- 172.21.15.123:0/3770581150 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f552815da00 0x7f55280b2c70 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:55.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.995+0000 7f552f52a640 1 --2- 172.21.15.123:0/3770581150 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f55140039b0 0x7f552814d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:55.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.995+0000 7f552f52a640 1 -- 172.21.15.123:0/3770581150 >> 172.21.15.123:0/3770581150 conn(0x7f55280d1260 msgr2=0x7f55280b5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:55.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.995+0000 7f552f52a640 1 -- 172.21.15.123:0/3770581150 shutdown_connections 2024-09-15T23:18:55.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:55.995+0000 7f552f52a640 1 -- 172.21.15.123:0/3770581150 wait complete. 2024-09-15T23:18:56.007 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T23:18:56.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.108+0000 7f264256f640 1 Processor -- start 2024-09-15T23:18:56.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.108+0000 7f264256f640 1 -- start start 2024-09-15T23:18:56.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.108+0000 7f264256f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f263c06bfd0 0x7f263c06c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:56.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.108+0000 7f264256f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f263c0b3350 0x7f263c1623a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:56.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.108+0000 7f264256f640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f263c06c8f0 con 0x7f263c0b38a0 2024-09-15T23:18:56.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.108+0000 7f264256f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f263c0b78a0 con 0x7f263c06bfd0 2024-09-15T23:18:56.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.108+0000 7f264256f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f263c0cffb0 con 0x7f263c0b3350 2024-09-15T23:18:56.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.109+0000 7f263bfff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f263c06bfd0 0x7f263c06c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:56.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.109+0000 7f2640b0c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f263c0b38a0 0x7f263c1628e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47398/0 (socket says 172.21.15.123:47398) 2024-09-15T23:18:56.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.109+0000 7f2640b0c640 1 -- 172.21.15.123:0/873323702 learned_addr learned my addr 172.21.15.123:0/873323702 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:18:56.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.109+0000 7f263bfff640 1 -- 172.21.15.123:0/873323702 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f263c0b3350 msgr2=0x7f263c1623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:56.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.109+0000 7f263bfff640 1 --2- 172.21.15.123:0/873323702 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f263c0b3350 0x7f263c1623a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:56.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.109+0000 7f263bfff640 1 -- 172.21.15.123:0/873323702 >> v1:172.21.15.123:6789/0 conn(0x7f263c0b38a0 legacy=0x7f263c1628e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:56.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.109+0000 7f263bfff640 1 -- 172.21.15.123:0/873323702 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f263c0cf710 con 0x7f263c06bfd0 2024-09-15T23:18:56.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.109+0000 7f263affd640 1 -- 172.21.15.123:0/873323702 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3202087965 0 0) 0x7f263c06c8f0 con 0x7f263c0b38a0 2024-09-15T23:18:56.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.110+0000 7f263bfff640 1 --2- 172.21.15.123:0/873323702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f263c06bfd0 0x7f263c06c3b0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f262c0097d0 tx=0x7f262c02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91af34644476f388 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:56.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.110+0000 7f263affd640 1 -- 172.21.15.123:0/873323702 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262c037070 con 0x7f263c06bfd0 2024-09-15T23:18:56.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.110+0000 7f263affd640 1 -- 172.21.15.123:0/873323702 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f262c032440 con 0x7f263c06bfd0 2024-09-15T23:18:56.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.110+0000 7f263affd640 1 -- 172.21.15.123:0/873323702 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262c032810 con 0x7f263c06bfd0 2024-09-15T23:18:56.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.110+0000 7f264256f640 1 -- 172.21.15.123:0/873323702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f263c06bfd0 msgr2=0x7f263c06c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:56.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.110+0000 7f264256f640 1 --2- 172.21.15.123:0/873323702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f263c06bfd0 0x7f263c06c3b0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f262c0097d0 tx=0x7f262c02a250 comp rx=0 tx=0).stop 2024-09-15T23:18:56.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.110+0000 7f264256f640 1 -- 172.21.15.123:0/873323702 shutdown_connections 2024-09-15T23:18:56.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.110+0000 7f264256f640 1 --2- 172.21.15.123:0/873323702 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f263c0b3350 0x7f263c1623a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:56.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.110+0000 7f264256f640 1 --2- 172.21.15.123:0/873323702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f263c06bfd0 0x7f263c06c3b0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:56.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.110+0000 7f264256f640 1 -- 172.21.15.123:0/873323702 >> 172.21.15.123:0/873323702 conn(0x7f263c0d11c0 msgr2=0x7f263c0d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:56.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.110+0000 7f264256f640 1 -- 172.21.15.123:0/873323702 shutdown_connections 2024-09-15T23:18:56.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.110+0000 7f264256f640 1 -- 172.21.15.123:0/873323702 wait complete. 2024-09-15T23:18:56.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.111+0000 7f264256f640 1 Processor -- start 2024-09-15T23:18:56.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.112+0000 7f264256f640 1 -- start start 2024-09-15T23:18:56.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.112+0000 7f264256f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f263c06bfd0 0x7f263c0cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:56.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.112+0000 7f264256f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f263c0b3350 0x7f263c0ce160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:56.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.112+0000 7f264256f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f263c0b38a0 0x7f263c1f8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:56.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.112+0000 7f264256f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f263c0d2400 con 0x7f263c0b3350 2024-09-15T23:18:56.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.112+0000 7f264256f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f263c0cfcd0 con 0x7f263c06bfd0 2024-09-15T23:18:56.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.112+0000 7f264256f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f263c06cd50 con 0x7f263c0b38a0 2024-09-15T23:18:56.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.112+0000 7f263b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f263c0b3350 0x7f263c0ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:56.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.112+0000 7f263b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f263c0b3350 0x7f263c0ce160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57772/0 (socket says 172.21.15.123:57772) 2024-09-15T23:18:56.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.112+0000 7f263b7fe640 1 -- 172.21.15.123:0/1899460247 learned_addr learned my addr 172.21.15.123:0/1899460247 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:56.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.113+0000 7f2640b0c640 1 --2- 172.21.15.123:0/1899460247 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f263c0b38a0 0x7f263c1f8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:56.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.113+0000 7f263bfff640 1 --2- 172.21.15.123:0/1899460247 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f263c06bfd0 0x7f263c0cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:56.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.113+0000 7f263b7fe640 1 -- 172.21.15.123:0/1899460247 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f263c0b38a0 msgr2=0x7f263c1f8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:56.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.113+0000 7f263b7fe640 1 --2- 172.21.15.123:0/1899460247 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f263c0b38a0 0x7f263c1f8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:56.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.113+0000 7f263b7fe640 1 -- 172.21.15.123:0/1899460247 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f263c06bfd0 msgr2=0x7f263c0cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:56.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.113+0000 7f263b7fe640 1 --2- 172.21.15.123:0/1899460247 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f263c06bfd0 0x7f263c0cdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:56.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.113+0000 7f263b7fe640 1 -- 172.21.15.123:0/1899460247 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f263c156950 con 0x7f263c0b3350 2024-09-15T23:18:56.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.113+0000 7f2640b0c640 1 --2- 172.21.15.123:0/1899460247 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f263c0b38a0 0x7f263c1f8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:18:56.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.113+0000 7f263bfff640 1 --2- 172.21.15.123:0/1899460247 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f263c06bfd0 0x7f263c0cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:18:56.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.113+0000 7f263b7fe640 1 --2- 172.21.15.123:0/1899460247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f263c0b3350 0x7f263c0ce160 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f263000b4d0 tx=0x7f263000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:56.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.113+0000 7f2638ff9640 1 -- 172.21.15.123:0/1899460247 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2630014070 con 0x7f263c0b3350 2024-09-15T23:18:56.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.113+0000 7f2638ff9640 1 -- 172.21.15.123:0/1899460247 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2630010870 con 0x7f263c0b3350 2024-09-15T23:18:56.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.113+0000 7f264256f640 1 -- 172.21.15.123:0/1899460247 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f263c156c30 con 0x7f263c0b3350 2024-09-15T23:18:56.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.113+0000 7f2638ff9640 1 -- 172.21.15.123:0/1899460247 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2630010c60 con 0x7f263c0b3350 2024-09-15T23:18:56.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.113+0000 7f264256f640 1 -- 172.21.15.123:0/1899460247 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f263c1571f0 con 0x7f263c0b3350 2024-09-15T23:18:56.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.114+0000 7f264256f640 1 -- 172.21.15.123:0/1899460247 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f263c15eae0 con 0x7f263c0b3350 2024-09-15T23:18:56.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.115+0000 7f2638ff9640 1 -- 172.21.15.123:0/1899460247 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2630017070 con 0x7f263c0b3350 2024-09-15T23:18:56.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.115+0000 7f2638ff9640 1 --2- 172.21.15.123:0/1899460247 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f262806c2b0 0x7f262806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:56.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.115+0000 7f2638ff9640 1 -- 172.21.15.123:0/1899460247 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5709+0+0 (secure 0 0 0) 0x7f263008b200 con 0x7f263c0b3350 2024-09-15T23:18:56.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.115+0000 7f263bfff640 1 --2- 172.21.15.123:0/1899460247 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f262806c2b0 0x7f262806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:56.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.116+0000 7f263bfff640 1 --2- 172.21.15.123:0/1899460247 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f262806c2b0 0x7f262806e770 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f262c034000 tx=0x7f262c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:56.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.119+0000 7f2638ff9640 1 -- 172.21.15.123:0/1899460247 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2630059a00 con 0x7f263c0b3350 2024-09-15T23:18:56.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.320+0000 7f264256f640 1 -- 172.21.15.123:0/1899460247 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f263c0d0cf0 con 0x7f263c0b3350 2024-09-15T23:18:56.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.401+0000 7f2638ff9640 1 -- 172.21.15.123:0/1899460247 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v79) ==== 118+0+0 (secure 0 0 0) 0x7f2630059300 con 0x7f263c0b3350 2024-09-15T23:18:56.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.404+0000 7f264256f640 1 -- 172.21.15.123:0/1899460247 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f262806c2b0 msgr2=0x7f262806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:56.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.404+0000 7f264256f640 1 --2- 172.21.15.123:0/1899460247 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f262806c2b0 0x7f262806e770 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f262c034000 tx=0x7f262c02e000 comp rx=0 tx=0).stop 2024-09-15T23:18:56.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.404+0000 7f264256f640 1 -- 172.21.15.123:0/1899460247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f263c0b3350 msgr2=0x7f263c0ce160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:56.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.404+0000 7f264256f640 1 --2- 172.21.15.123:0/1899460247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f263c0b3350 0x7f263c0ce160 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f263000b4d0 tx=0x7f263000b990 comp rx=0 tx=0).stop 2024-09-15T23:18:56.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.404+0000 7f264256f640 1 -- 172.21.15.123:0/1899460247 shutdown_connections 2024-09-15T23:18:56.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.404+0000 7f264256f640 1 --2- 172.21.15.123:0/1899460247 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f263c0b38a0 0x7f263c1f8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:56.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.404+0000 7f264256f640 1 --2- 172.21.15.123:0/1899460247 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f262806c2b0 0x7f262806e770 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:56.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.404+0000 7f264256f640 1 --2- 172.21.15.123:0/1899460247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f263c0b3350 0x7f263c0ce160 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:56.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.404+0000 7f264256f640 1 --2- 172.21.15.123:0/1899460247 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f263c06bfd0 0x7f263c0cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:56.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.404+0000 7f264256f640 1 -- 172.21.15.123:0/1899460247 >> 172.21.15.123:0/1899460247 conn(0x7f263c0d11c0 msgr2=0x7f263c0d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:56.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.404+0000 7f264256f640 1 -- 172.21.15.123:0/1899460247 shutdown_connections 2024-09-15T23:18:56.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.404+0000 7f264256f640 1 -- 172.21.15.123:0/1899460247 wait complete. 2024-09-15T23:18:56.417 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T23:18:56.417 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T23:18:56.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.517+0000 7f670fa27640 1 Processor -- start 2024-09-15T23:18:56.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.517+0000 7f670fa27640 1 -- start start 2024-09-15T23:18:56.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.518+0000 7f670fa27640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f670815c690 0x7f67080ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:56.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.518+0000 7f670fa27640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f67080b7320 0x7f670806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:56.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.518+0000 7f670fa27640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67080b5a80 con 0x7f670806c150 2024-09-15T23:18:56.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.518+0000 7f670fa27640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f67080b6620 con 0x7f670815c690 2024-09-15T23:18:56.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.518+0000 7f670fa27640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f67080b6ab0 con 0x7f67080b7320 2024-09-15T23:18:56.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.518+0000 7f670d7c3640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f670815c690 0x7f67080ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:56.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.518+0000 7f670d7c3640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f670815c690 0x7f67080ceaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38588/0 (socket says 172.21.15.123:38588) 2024-09-15T23:18:56.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.518+0000 7f670d7c3640 1 -- 172.21.15.123:0/2506234451 learned_addr learned my addr 172.21.15.123:0/2506234451 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:56.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.518+0000 7f670d7c3640 1 -- 172.21.15.123:0/2506234451 >> v2:172.21.15.188:3300/0 conn(0x7f67080b7320 msgr2=0x7f670806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:56.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.519+0000 7f670cfc2640 1 --2- 172.21.15.123:0/2506234451 >> v2:172.21.15.188:3300/0 conn(0x7f67080b7320 0x7f670806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:56.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.519+0000 7f670d7c3640 1 --2- 172.21.15.123:0/2506234451 >> v2:172.21.15.188:3300/0 conn(0x7f67080b7320 0x7f670806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:56.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.519+0000 7f670d7c3640 1 -- 172.21.15.123:0/2506234451 >> v1:172.21.15.188:6789/0 conn(0x7f670806c150 legacy=0x7f67080b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:56.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.519+0000 7f670d7c3640 1 -- 172.21.15.123:0/2506234451 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67080b5cf0 con 0x7f670815c690 2024-09-15T23:18:56.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.519+0000 7f670cfc2640 1 --2- 172.21.15.123:0/2506234451 >> v2:172.21.15.188:3300/0 conn(0x7f67080b7320 0x7f670806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:18:56.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.519+0000 7f670d7c3640 1 --2- 172.21.15.123:0/2506234451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f670815c690 0x7f67080ceaa0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f67080b7920 tx=0x7f670402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d492d6dc966796e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:56.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.519+0000 7f66fffff640 1 -- 172.21.15.123:0/2506234451 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6704037070 con 0x7f670815c690 2024-09-15T23:18:56.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.519+0000 7f66fffff640 1 -- 172.21.15.123:0/2506234451 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6704032440 con 0x7f670815c690 2024-09-15T23:18:56.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.519+0000 7f66fffff640 1 -- 172.21.15.123:0/2506234451 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6704032810 con 0x7f670815c690 2024-09-15T23:18:56.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.520+0000 7f670fa27640 1 -- 172.21.15.123:0/2506234451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f670815c690 msgr2=0x7f67080ceaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:56.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.520+0000 7f670fa27640 1 --2- 172.21.15.123:0/2506234451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f670815c690 0x7f67080ceaa0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f67080b7920 tx=0x7f670402a230 comp rx=0 tx=0).stop 2024-09-15T23:18:56.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.520+0000 7f670fa27640 1 -- 172.21.15.123:0/2506234451 shutdown_connections 2024-09-15T23:18:56.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.520+0000 7f670fa27640 1 --2- 172.21.15.123:0/2506234451 >> v2:172.21.15.188:3300/0 conn(0x7f67080b7320 0x7f670806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:56.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.520+0000 7f670fa27640 1 --2- 172.21.15.123:0/2506234451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f670815c690 0x7f67080ceaa0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:56.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.520+0000 7f670fa27640 1 -- 172.21.15.123:0/2506234451 >> 172.21.15.123:0/2506234451 conn(0x7f670806cd20 msgr2=0x7f670806d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:56.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.520+0000 7f670fa27640 1 -- 172.21.15.123:0/2506234451 shutdown_connections 2024-09-15T23:18:56.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.520+0000 7f670fa27640 1 -- 172.21.15.123:0/2506234451 wait complete. 2024-09-15T23:18:56.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.521+0000 7f670fa27640 1 Processor -- start 2024-09-15T23:18:56.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.521+0000 7f670fa27640 1 -- start start 2024-09-15T23:18:56.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.522+0000 7f670fa27640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f670806c150 0x7f6708145a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:56.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.522+0000 7f670fa27640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67080b7320 0x7f67081e5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:56.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.522+0000 7f670fa27640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f670815c690 0x7f67081e5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:56.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.522+0000 7f670fa27640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f670815da80 con 0x7f670806c150 2024-09-15T23:18:56.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.522+0000 7f670fa27640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f67080b62b0 con 0x7f67080b7320 2024-09-15T23:18:56.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.522+0000 7f670fa27640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f670815dc00 con 0x7f670815c690 2024-09-15T23:18:56.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.522+0000 7f670d7c3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f670806c150 0x7f6708145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:56.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.522+0000 7f670d7c3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f670806c150 0x7f6708145a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38596/0 (socket says 172.21.15.123:38596) 2024-09-15T23:18:56.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.522+0000 7f670d7c3640 1 -- 172.21.15.123:0/1239809428 learned_addr learned my addr 172.21.15.123:0/1239809428 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:56.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.522+0000 7f670cfc2640 1 --2- 172.21.15.123:0/1239809428 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67080b7320 0x7f67081e5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:56.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.522+0000 7f670dfc4640 1 --2- 172.21.15.123:0/1239809428 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f670815c690 0x7f67081e5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:56.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.522+0000 7f670d7c3640 1 -- 172.21.15.123:0/1239809428 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f670815c690 msgr2=0x7f67081e5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:56.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.522+0000 7f670d7c3640 1 --2- 172.21.15.123:0/1239809428 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f670815c690 0x7f67081e5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:56.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.522+0000 7f670d7c3640 1 -- 172.21.15.123:0/1239809428 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67080b7320 msgr2=0x7f67081e5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:56.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.522+0000 7f670d7c3640 1 --2- 172.21.15.123:0/1239809428 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67080b7320 0x7f67081e5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:56.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.522+0000 7f670d7c3640 1 -- 172.21.15.123:0/1239809428 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67081e6730 con 0x7f670806c150 2024-09-15T23:18:56.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.522+0000 7f670cfc2640 1 --2- 172.21.15.123:0/1239809428 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67080b7320 0x7f67081e5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:18:56.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.523+0000 7f670d7c3640 1 --2- 172.21.15.123:0/1239809428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f670806c150 0x7f6708145a90 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f6704000c00 tx=0x7f67040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:56.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.523+0000 7f66fdffb640 1 -- 172.21.15.123:0/1239809428 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6704041070 con 0x7f670806c150 2024-09-15T23:18:56.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.523+0000 7f66fdffb640 1 -- 172.21.15.123:0/1239809428 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f670403c870 con 0x7f670806c150 2024-09-15T23:18:56.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.523+0000 7f670fa27640 1 -- 172.21.15.123:0/1239809428 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67081e6170 con 0x7f670806c150 2024-09-15T23:18:56.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.523+0000 7f66fdffb640 1 -- 172.21.15.123:0/1239809428 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6704037040 con 0x7f670806c150 2024-09-15T23:18:56.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.523+0000 7f670fa27640 1 -- 172.21.15.123:0/1239809428 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6708146270 con 0x7f670806c150 2024-09-15T23:18:56.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.524+0000 7f670fa27640 1 -- 172.21.15.123:0/1239809428 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f670806bc10 con 0x7f670806c150 2024-09-15T23:18:56.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.524+0000 7f66fdffb640 1 -- 172.21.15.123:0/1239809428 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6704044070 con 0x7f670806c150 2024-09-15T23:18:56.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.525+0000 7f66fdffb640 1 --2- 172.21.15.123:0/1239809428 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f66ec06c2e0 0x7f66ec06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:56.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.525+0000 7f66fdffb640 1 -- 172.21.15.123:0/1239809428 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f67040abf40 con 0x7f670806c150 2024-09-15T23:18:56.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.525+0000 7f670cfc2640 1 --2- 172.21.15.123:0/1239809428 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f66ec06c2e0 0x7f66ec06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:56.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.526+0000 7f670cfc2640 1 --2- 172.21.15.123:0/1239809428 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f66ec06c2e0 0x7f66ec06e7a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f670814c850 tx=0x7f66f8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:56.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.529+0000 7f66fdffb640 1 -- 172.21.15.123:0/1239809428 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f670407a740 con 0x7f670806c150 2024-09-15T23:18:56.660 INFO:tasks.ceph.mds.d.smithi188.stderr:2024-09-15T23:18:56.659+0000 7fc3f0b49640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:18:56.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:56.729+0000 7f670fa27640 1 -- 172.21.15.123:0/1239809428 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f67080b18c0 con 0x7f670806c150 2024-09-15T23:18:57.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.410+0000 7f66fdffb640 1 -- 172.21.15.123:0/1239809428 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v80) ==== 122+0+0 (secure 0 0 0) 0x7f670407a040 con 0x7f670806c150 2024-09-15T23:18:57.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.412+0000 7f670fa27640 1 -- 172.21.15.123:0/1239809428 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f66ec06c2e0 msgr2=0x7f66ec06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:57.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.412+0000 7f670fa27640 1 --2- 172.21.15.123:0/1239809428 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f66ec06c2e0 0x7f66ec06e7a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f670814c850 tx=0x7f66f8008040 comp rx=0 tx=0).stop 2024-09-15T23:18:57.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.412+0000 7f670fa27640 1 -- 172.21.15.123:0/1239809428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f670806c150 msgr2=0x7f6708145a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:57.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.412+0000 7f670fa27640 1 --2- 172.21.15.123:0/1239809428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f670806c150 0x7f6708145a90 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f6704000c00 tx=0x7f67040046c0 comp rx=0 tx=0).stop 2024-09-15T23:18:57.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.412+0000 7f670fa27640 1 -- 172.21.15.123:0/1239809428 shutdown_connections 2024-09-15T23:18:57.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.412+0000 7f670fa27640 1 --2- 172.21.15.123:0/1239809428 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f670815c690 0x7f67081e5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:57.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.412+0000 7f670fa27640 1 --2- 172.21.15.123:0/1239809428 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f67080b7320 0x7f67081e5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:57.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.412+0000 7f670fa27640 1 --2- 172.21.15.123:0/1239809428 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f66ec06c2e0 0x7f66ec06e7a0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:57.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.412+0000 7f670fa27640 1 --2- 172.21.15.123:0/1239809428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f670806c150 0x7f6708145a90 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:57.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.412+0000 7f670fa27640 1 -- 172.21.15.123:0/1239809428 >> 172.21.15.123:0/1239809428 conn(0x7f670806cd20 msgr2=0x7f670806f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:57.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.413+0000 7f670fa27640 1 -- 172.21.15.123:0/1239809428 shutdown_connections 2024-09-15T23:18:57.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.413+0000 7f670fa27640 1 -- 172.21.15.123:0/1239809428 wait complete. 2024-09-15T23:18:57.425 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T23:18:57.425 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:18:57.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.523+0000 7f4a62850640 1 Processor -- start 2024-09-15T23:18:57.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.523+0000 7f4a62850640 1 -- start start 2024-09-15T23:18:57.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.524+0000 7f4a62850640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4a5c0b2d40 0x7f4a5c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:57.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.524+0000 7f4a62850640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a5c071180 con 0x7f4a5c06c150 2024-09-15T23:18:57.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.524+0000 7f4a62850640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a5c071460 con 0x7f4a5c13eb20 2024-09-15T23:18:57.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.524+0000 7f4a62850640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f4a5c071ab0 con 0x7f4a5c0b2d40 2024-09-15T23:18:57.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.524+0000 7f4a60ded640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f4a5c06c150 0x7f4a5c071f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35150/0 (socket says 172.21.15.123:35150) 2024-09-15T23:18:57.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.524+0000 7f4a60ded640 1 -- 172.21.15.123:0/422963442 learned_addr learned my addr 172.21.15.123:0/422963442 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:18:57.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.524+0000 7f4a5affd640 1 -- 172.21.15.123:0/422963442 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3995107098 0 0) 0x7f4a5c071180 con 0x7f4a5c06c150 2024-09-15T23:18:57.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.524+0000 7f4a5bfff640 1 --2- 172.21.15.123:0/422963442 >> v2:172.21.15.188:3300/0 conn(0x7f4a5c0b2d40 0x7f4a5c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:57.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.524+0000 7f4a5affd640 1 -- 172.21.15.123:0/422963442 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a44003520 con 0x7f4a5c06c150 2024-09-15T23:18:57.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.524+0000 7f4a5affd640 1 -- 172.21.15.123:0/422963442 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4137359288 0 0) 0x7f4a44003520 con 0x7f4a5c06c150 2024-09-15T23:18:57.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.524+0000 7f4a5affd640 1 -- 172.21.15.123:0/422963442 >> v2:172.21.15.188:3300/0 conn(0x7f4a5c0b2d40 msgr2=0x7f4a5c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:57.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.524+0000 7f4a5affd640 1 --2- 172.21.15.123:0/422963442 >> v2:172.21.15.188:3300/0 conn(0x7f4a5c0b2d40 0x7f4a5c06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:57.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.524+0000 7f4a5affd640 1 -- 172.21.15.123:0/422963442 >> v1:172.21.15.188:6789/0 conn(0x7f4a5c13eb20 legacy=0x7f4a5c15bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:57.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.524+0000 7f4a5affd640 1 -- 172.21.15.123:0/422963442 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a5c071740 con 0x7f4a5c06c150 2024-09-15T23:18:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.524+0000 7f4a5affd640 1 -- 172.21.15.123:0/422963442 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f4a540019f0 con 0x7f4a5c06c150 2024-09-15T23:18:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.524+0000 7f4a5affd640 1 -- 172.21.15.123:0/422963442 >> v1:172.21.15.123:6789/0 conn(0x7f4a5c06c150 legacy=0x7f4a5c071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.524+0000 7f4a5affd640 1 --2- 172.21.15.123:0/422963442 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a440039b0 0x7f4a44003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.524+0000 7f4a5affd640 1 --2- 172.21.15.123:0/422963442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a44004800 0x7f4a44004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.524+0000 7f4a5affd640 1 --2- 172.21.15.123:0/422963442 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a440051c0 0x7f4a4400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.524+0000 7f4a5affd640 1 -- 172.21.15.123:0/422963442 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4a5c071ab0 con 0x7f4a44004800 2024-09-15T23:18:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.524+0000 7f4a5affd640 1 -- 172.21.15.123:0/422963442 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4a4400c060 con 0x7f4a440051c0 2024-09-15T23:18:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.524+0000 7f4a5affd640 1 -- 172.21.15.123:0/422963442 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4a4400c260 con 0x7f4a440039b0 2024-09-15T23:18:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.525+0000 7f4a5b7fe640 1 --2- 172.21.15.123:0/422963442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a44004800 0x7f4a44004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.525+0000 7f4a5bfff640 1 --2- 172.21.15.123:0/422963442 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a440039b0 0x7f4a44003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.525+0000 7f4a60ded640 1 --2- 172.21.15.123:0/422963442 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a440051c0 0x7f4a4400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.525+0000 7f4a5b7fe640 1 -- 172.21.15.123:0/422963442 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a440039b0 msgr2=0x7f4a44003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:57.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.525+0000 7f4a5b7fe640 1 --2- 172.21.15.123:0/422963442 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a440039b0 0x7f4a44003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.525+0000 7f4a5b7fe640 1 -- 172.21.15.123:0/422963442 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a440051c0 msgr2=0x7f4a4400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.525+0000 7f4a5b7fe640 1 --2- 172.21.15.123:0/422963442 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a440051c0 0x7f4a4400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.525+0000 7f4a5b7fe640 1 -- 172.21.15.123:0/422963442 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a44003520 con 0x7f4a44004800 2024-09-15T23:18:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.525+0000 7f4a60ded640 1 --2- 172.21.15.123:0/422963442 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a440051c0 0x7f4a4400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:18:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.525+0000 7f4a60ded640 1 -- 172.21.15.123:0/422963442 reap_dead start 2024-09-15T23:18:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.525+0000 7f4a5b7fe640 1 --2- 172.21.15.123:0/422963442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a44004800 0x7f4a44004c80 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f4a50001720 tx=0x7f4a44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71f9299e7253e078 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.526+0000 7f4a5affd640 1 -- 172.21.15.123:0/422963442 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a50001370 con 0x7f4a44004800 2024-09-15T23:18:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.526+0000 7f4a5affd640 1 -- 172.21.15.123:0/422963442 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a500052d0 con 0x7f4a44004800 2024-09-15T23:18:57.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.526+0000 7f4a5affd640 1 -- 172.21.15.123:0/422963442 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a5002ab90 con 0x7f4a44004800 2024-09-15T23:18:57.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.526+0000 7f4a62850640 1 -- 172.21.15.123:0/422963442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a44004800 msgr2=0x7f4a44004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:57.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.526+0000 7f4a62850640 1 --2- 172.21.15.123:0/422963442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a44004800 0x7f4a44004c80 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f4a50001720 tx=0x7f4a44005830 comp rx=0 tx=0).stop 2024-09-15T23:18:57.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.526+0000 7f4a62850640 1 -- 172.21.15.123:0/422963442 shutdown_connections 2024-09-15T23:18:57.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.526+0000 7f4a62850640 1 --2- 172.21.15.123:0/422963442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a44004800 0x7f4a44004c80 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:57.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.526+0000 7f4a62850640 1 -- 172.21.15.123:0/422963442 >> 172.21.15.123:0/422963442 conn(0x7f4a5c0ccec0 msgr2=0x7f4a5c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:57.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.526+0000 7f4a62850640 1 -- 172.21.15.123:0/422963442 shutdown_connections 2024-09-15T23:18:57.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.526+0000 7f4a62850640 1 -- 172.21.15.123:0/422963442 wait complete. 2024-09-15T23:18:57.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.527+0000 7f4a62850640 1 Processor -- start 2024-09-15T23:18:57.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.528+0000 7f4a62850640 1 -- start start 2024-09-15T23:18:57.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.528+0000 7f4a62850640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a44004800 0x7f4a5c13db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:57.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.528+0000 7f4a62850640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a5c142800 0x7f4a5c0cc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:57.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.528+0000 7f4a62850640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a5c0cc670 0x7f4a5c15ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:57.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.528+0000 7f4a62850640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4a5c06bfa0 con 0x7f4a44004800 2024-09-15T23:18:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.528+0000 7f4a62850640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4a5c06be20 con 0x7f4a5c0cc670 2024-09-15T23:18:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.528+0000 7f4a62850640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4a5c15bcf0 con 0x7f4a5c142800 2024-09-15T23:18:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.528+0000 7f4a5bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a44004800 0x7f4a5c13db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.528+0000 7f4a5bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a44004800 0x7f4a5c13db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38608/0 (socket says 172.21.15.123:38608) 2024-09-15T23:18:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.528+0000 7f4a5bfff640 1 -- 172.21.15.123:0/768626505 learned_addr learned my addr 172.21.15.123:0/768626505 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.529+0000 7f4a5bfff640 1 -- 172.21.15.123:0/768626505 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a5c142800 msgr2=0x7f4a5c0cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.529+0000 7f4a5b7fe640 1 --2- 172.21.15.123:0/768626505 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a5c142800 0x7f4a5c0cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.529+0000 7f4a60ded640 1 --2- 172.21.15.123:0/768626505 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a5c0cc670 0x7f4a5c15ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.529+0000 7f4a5bfff640 1 --2- 172.21.15.123:0/768626505 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a5c142800 0x7f4a5c0cc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.529+0000 7f4a5bfff640 1 -- 172.21.15.123:0/768626505 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a5c0cc670 msgr2=0x7f4a5c15ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.529+0000 7f4a5bfff640 1 --2- 172.21.15.123:0/768626505 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a5c0cc670 0x7f4a5c15ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.529+0000 7f4a5bfff640 1 -- 172.21.15.123:0/768626505 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a5c15fca0 con 0x7f4a44004800 2024-09-15T23:18:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.529+0000 7f4a5b7fe640 1 --2- 172.21.15.123:0/768626505 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a5c142800 0x7f4a5c0cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:18:57.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.529+0000 7f4a60ded640 1 --2- 172.21.15.123:0/768626505 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a5c0cc670 0x7f4a5c15ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:18:57.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.529+0000 7f4a5bfff640 1 --2- 172.21.15.123:0/768626505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a44004800 0x7f4a5c13db30 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c011a70 tx=0x7f4a4c011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:57.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.529+0000 7f4a58ff9640 1 -- 172.21.15.123:0/768626505 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c00fb50 con 0x7f4a44004800 2024-09-15T23:18:57.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.529+0000 7f4a58ff9640 1 -- 172.21.15.123:0/768626505 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a4c00fcf0 con 0x7f4a44004800 2024-09-15T23:18:57.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.529+0000 7f4a58ff9640 1 -- 172.21.15.123:0/768626505 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c00fea0 con 0x7f4a44004800 2024-09-15T23:18:57.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.529+0000 7f4a62850640 1 -- 172.21.15.123:0/768626505 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a5c141d20 con 0x7f4a44004800 2024-09-15T23:18:57.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.529+0000 7f4a62850640 1 -- 172.21.15.123:0/768626505 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a5c15f470 con 0x7f4a44004800 2024-09-15T23:18:57.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.530+0000 7f4a62850640 1 -- 172.21.15.123:0/768626505 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a5c0cca80 con 0x7f4a44004800 2024-09-15T23:18:57.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.530+0000 7f4a58ff9640 1 -- 172.21.15.123:0/768626505 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4a4c012040 con 0x7f4a44004800 2024-09-15T23:18:57.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.531+0000 7f4a58ff9640 1 --2- 172.21.15.123:0/768626505 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4a4806c2e0 0x7f4a4806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:57.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.531+0000 7f4a58ff9640 1 -- 172.21.15.123:0/768626505 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f4a4c08ba60 con 0x7f4a44004800 2024-09-15T23:18:57.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.531+0000 7f4a5b7fe640 1 --2- 172.21.15.123:0/768626505 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4a4806c2e0 0x7f4a4806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:57.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.531+0000 7f4a5b7fe640 1 --2- 172.21.15.123:0/768626505 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4a4806c2e0 0x7f4a4806e7a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4a50032000 tx=0x7f4a5002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:57.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.535+0000 7f4a58ff9640 1 -- 172.21.15.123:0/768626505 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4a5c0cca80 con 0x7f4a44004800 2024-09-15T23:18:57.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.736+0000 7f4a62850640 1 -- 172.21.15.123:0/768626505 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4a5c15c080 con 0x7f4a44004800 2024-09-15T23:18:57.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.736+0000 7f4a58ff9640 1 -- 172.21.15.123:0/768626505 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) ==== 94+0+5237 (secure 0 0 0) 0x7f4a4c019030 con 0x7f4a44004800 2024-09-15T23:18:57.737 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:18:57.738 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":80,"btime":"2024-09-15T23:18:57:403025+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6386,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/1352396114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":1352396114},{"type":"v1","addr":"172.21.15.188:6836","nonce":1352396114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":8022,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2727961795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2727961795},{"type":"v1","addr":"172.21.15.123:6834","nonce":2727961795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":8025,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3879785466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":3879785466},{"type":"v1","addr":"172.21.15.123:6835","nonce":3879785466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:18:54.727897+0000","modified":"2024-09-15T23:18:56.730668+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8034},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8034":{"gid":8034,"name":"d","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6837/3551744094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":3551744094},{"type":"v1","addr":"172.21.15.188:6837","nonce":3551744094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8034,"qdb_cluster":[8034]},"id":8}]} 2024-09-15T23:18:57.738 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 80 2024-09-15T23:18:57.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.738+0000 7f4a62850640 1 -- 172.21.15.123:0/768626505 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4a4806c2e0 msgr2=0x7f4a4806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:57.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.738+0000 7f4a62850640 1 --2- 172.21.15.123:0/768626505 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4a4806c2e0 0x7f4a4806e7a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4a50032000 tx=0x7f4a5002e000 comp rx=0 tx=0).stop 2024-09-15T23:18:57.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.738+0000 7f4a62850640 1 -- 172.21.15.123:0/768626505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a44004800 msgr2=0x7f4a5c13db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:57.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.738+0000 7f4a62850640 1 --2- 172.21.15.123:0/768626505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a44004800 0x7f4a5c13db30 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c011a70 tx=0x7f4a4c011f30 comp rx=0 tx=0).stop 2024-09-15T23:18:57.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.738+0000 7f4a62850640 1 -- 172.21.15.123:0/768626505 shutdown_connections 2024-09-15T23:18:57.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.738+0000 7f4a62850640 1 --2- 172.21.15.123:0/768626505 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4a5c0cc670 0x7f4a5c15ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:57.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.738+0000 7f4a62850640 1 --2- 172.21.15.123:0/768626505 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4a5c142800 0x7f4a5c0cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:57.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.738+0000 7f4a62850640 1 --2- 172.21.15.123:0/768626505 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4a4806c2e0 0x7f4a4806e7a0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:57.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.738+0000 7f4a62850640 1 --2- 172.21.15.123:0/768626505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a44004800 0x7f4a5c13db30 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:57.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.738+0000 7f4a62850640 1 -- 172.21.15.123:0/768626505 >> 172.21.15.123:0/768626505 conn(0x7f4a5c0ccec0 msgr2=0x7f4a5c071e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:57.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.738+0000 7f4a62850640 1 -- 172.21.15.123:0/768626505 shutdown_connections 2024-09-15T23:18:57.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.738+0000 7f4a62850640 1 -- 172.21.15.123:0/768626505 wait complete. 2024-09-15T23:18:57.750 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:18:57.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.846+0000 7fe8980af640 1 Processor -- start 2024-09-15T23:18:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.847+0000 7fe8980af640 1 -- start start 2024-09-15T23:18:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.847+0000 7fe8980af640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe89015ed20 0x7fe8900b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.847+0000 7fe8980af640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe8900d23b0 0x7fe8900b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.847+0000 7fe8980af640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8900d0e70 con 0x7fe8900cf2d0 2024-09-15T23:18:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.848+0000 7fe8980af640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe8900d41c0 con 0x7fe8900d23b0 2024-09-15T23:18:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.848+0000 7fe8980af640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fe8900d35b0 con 0x7fe89015ed20 2024-09-15T23:18:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.848+0000 7fe89564a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe8900d23b0 0x7fe8900b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.848+0000 7fe89564a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe8900d23b0 0x7fe8900b67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38616/0 (socket says 172.21.15.123:38616) 2024-09-15T23:18:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.848+0000 7fe89564a640 1 -- 172.21.15.123:0/4064599878 learned_addr learned my addr 172.21.15.123:0/4064599878 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.848+0000 7fe895e4b640 1 --2- 172.21.15.123:0/4064599878 >> v2:172.21.15.188:3300/0 conn(0x7fe89015ed20 0x7fe8900b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.848+0000 7fe89564a640 1 -- 172.21.15.123:0/4064599878 >> v2:172.21.15.188:3300/0 conn(0x7fe89015ed20 msgr2=0x7fe8900b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.848+0000 7fe89564a640 1 --2- 172.21.15.123:0/4064599878 >> v2:172.21.15.188:3300/0 conn(0x7fe89015ed20 0x7fe8900b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.848+0000 7fe89564a640 1 -- 172.21.15.123:0/4064599878 >> v1:172.21.15.188:6789/0 conn(0x7fe8900cf2d0 legacy=0x7fe8900cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.848+0000 7fe89564a640 1 -- 172.21.15.123:0/4064599878 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8900d3890 con 0x7fe8900d23b0 2024-09-15T23:18:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.849+0000 7fe89564a640 1 --2- 172.21.15.123:0/4064599878 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8900d23b0 0x7fe8900b67a0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fe8900d47b0 tx=0x7fe88402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4758392ac4c29590 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.849+0000 7fe894e49640 1 -- 172.21.15.123:0/4064599878 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe884037070 con 0x7fe8900d23b0 2024-09-15T23:18:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.849+0000 7fe894e49640 1 -- 172.21.15.123:0/4064599878 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe884032440 con 0x7fe8900d23b0 2024-09-15T23:18:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.849+0000 7fe894e49640 1 -- 172.21.15.123:0/4064599878 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe884032810 con 0x7fe8900d23b0 2024-09-15T23:18:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.849+0000 7fe8980af640 1 -- 172.21.15.123:0/4064599878 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8900d23b0 msgr2=0x7fe8900b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.849+0000 7fe8980af640 1 --2- 172.21.15.123:0/4064599878 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8900d23b0 0x7fe8900b67a0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fe8900d47b0 tx=0x7fe88402a1e0 comp rx=0 tx=0).stop 2024-09-15T23:18:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.849+0000 7fe8980af640 1 -- 172.21.15.123:0/4064599878 shutdown_connections 2024-09-15T23:18:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.849+0000 7fe8980af640 1 --2- 172.21.15.123:0/4064599878 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8900d23b0 0x7fe8900b67a0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.849+0000 7fe8980af640 1 --2- 172.21.15.123:0/4064599878 >> v2:172.21.15.188:3300/0 conn(0x7fe89015ed20 0x7fe8900b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.849+0000 7fe8980af640 1 -- 172.21.15.123:0/4064599878 >> 172.21.15.123:0/4064599878 conn(0x7fe8900d1260 msgr2=0x7fe8900d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.849+0000 7fe8980af640 1 -- 172.21.15.123:0/4064599878 shutdown_connections 2024-09-15T23:18:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.850+0000 7fe8980af640 1 -- 172.21.15.123:0/4064599878 wait complete. 2024-09-15T23:18:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.851+0000 7fe8980af640 1 Processor -- start 2024-09-15T23:18:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.851+0000 7fe8980af640 1 -- start start 2024-09-15T23:18:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.851+0000 7fe8980af640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe8900cf2d0 0x7fe8900c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.851+0000 7fe8980af640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8900d23b0 0x7fe8900ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.851+0000 7fe8980af640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe89015ed20 0x7fe8900cd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.851+0000 7fe8980af640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe8900d32a0 con 0x7fe8900d23b0 2024-09-15T23:18:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.851+0000 7fe8980af640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe8900d3e50 con 0x7fe89015ed20 2024-09-15T23:18:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.851+0000 7fe8980af640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe89015f100 con 0x7fe8900cf2d0 2024-09-15T23:18:57.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.851+0000 7fe89564a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8900d23b0 0x7fe8900ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.851+0000 7fe89564a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8900d23b0 0x7fe8900ccbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38618/0 (socket says 172.21.15.123:38618) 2024-09-15T23:18:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.851+0000 7fe89564a640 1 -- 172.21.15.123:0/2410261721 learned_addr learned my addr 172.21.15.123:0/2410261721 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.852+0000 7fe89664c640 1 --2- 172.21.15.123:0/2410261721 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe89015ed20 0x7fe8900cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.852+0000 7fe895e4b640 1 --2- 172.21.15.123:0/2410261721 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe8900cf2d0 0x7fe8900c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.852+0000 7fe89564a640 1 -- 172.21.15.123:0/2410261721 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe8900cf2d0 msgr2=0x7fe8900c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.852+0000 7fe89564a640 1 --2- 172.21.15.123:0/2410261721 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe8900cf2d0 0x7fe8900c81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.852+0000 7fe89564a640 1 -- 172.21.15.123:0/2410261721 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe89015ed20 msgr2=0x7fe8900cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.852+0000 7fe89564a640 1 --2- 172.21.15.123:0/2410261721 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe89015ed20 0x7fe8900cd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.852+0000 7fe89564a640 1 -- 172.21.15.123:0/2410261721 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8900cd670 con 0x7fe8900d23b0 2024-09-15T23:18:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.852+0000 7fe89664c640 1 --2- 172.21.15.123:0/2410261721 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe89015ed20 0x7fe8900cd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:18:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.852+0000 7fe89564a640 1 --2- 172.21.15.123:0/2410261721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8900d23b0 0x7fe8900ccbf0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fe88402a220 tx=0x7fe8840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.852+0000 7fe8827fc640 1 -- 172.21.15.123:0/2410261721 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe884041020 con 0x7fe8900d23b0 2024-09-15T23:18:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.852+0000 7fe8827fc640 1 -- 172.21.15.123:0/2410261721 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8840306c0 con 0x7fe8900d23b0 2024-09-15T23:18:57.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.852+0000 7fe8980af640 1 -- 172.21.15.123:0/2410261721 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8900cabe0 con 0x7fe8900d23b0 2024-09-15T23:18:57.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.852+0000 7fe8827fc640 1 -- 172.21.15.123:0/2410261721 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe884037040 con 0x7fe8900d23b0 2024-09-15T23:18:57.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.852+0000 7fe8980af640 1 -- 172.21.15.123:0/2410261721 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8900cc3f0 con 0x7fe8900d23b0 2024-09-15T23:18:57.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.853+0000 7fe8980af640 1 -- 172.21.15.123:0/2410261721 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8900b7010 con 0x7fe8900d23b0 2024-09-15T23:18:57.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.853+0000 7fe8827fc640 1 -- 172.21.15.123:0/2410261721 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe884044020 con 0x7fe8900d23b0 2024-09-15T23:18:57.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.854+0000 7fe8827fc640 1 --2- 172.21.15.123:0/2410261721 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe87406c2e0 0x7fe87406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:57.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.854+0000 7fe8827fc640 1 -- 172.21.15.123:0/2410261721 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7fe8840abb10 con 0x7fe8900d23b0 2024-09-15T23:18:57.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.854+0000 7fe895e4b640 1 --2- 172.21.15.123:0/2410261721 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe87406c2e0 0x7fe87406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:57.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.855+0000 7fe895e4b640 1 --2- 172.21.15.123:0/2410261721 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe87406c2e0 0x7fe87406e7a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe88c006fd0 tx=0x7fe88c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:57.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:57.858+0000 7fe8827fc640 1 -- 172.21.15.123:0/2410261721 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe88404b030 con 0x7fe8900d23b0 2024-09-15T23:18:58.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.025+0000 7fe8980af640 1 -- 172.21.15.123:0/2410261721 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe8900b3f20 con 0x7fe8900d23b0 2024-09-15T23:18:58.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.026+0000 7fe8827fc640 1 -- 172.21.15.123:0/2410261721 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) ==== 74+0+16767 (secure 0 0 0) 0x7fe88407a310 con 0x7fe8900d23b0 2024-09-15T23:18:58.027 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:18:58.027 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":130,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:18:56.396511+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:18:53.342598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-15T23:18:53.702094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:18:58.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.028+0000 7fe8980af640 1 -- 172.21.15.123:0/2410261721 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe87406c2e0 msgr2=0x7fe87406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:58.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.028+0000 7fe8980af640 1 --2- 172.21.15.123:0/2410261721 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe87406c2e0 0x7fe87406e7a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe88c006fd0 tx=0x7fe88c008040 comp rx=0 tx=0).stop 2024-09-15T23:18:58.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.028+0000 7fe8980af640 1 -- 172.21.15.123:0/2410261721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8900d23b0 msgr2=0x7fe8900ccbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:58.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.028+0000 7fe8980af640 1 --2- 172.21.15.123:0/2410261721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8900d23b0 0x7fe8900ccbf0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fe88402a220 tx=0x7fe8840046c0 comp rx=0 tx=0).stop 2024-09-15T23:18:58.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.028+0000 7fe8980af640 1 -- 172.21.15.123:0/2410261721 shutdown_connections 2024-09-15T23:18:58.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.028+0000 7fe8980af640 1 --2- 172.21.15.123:0/2410261721 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe89015ed20 0x7fe8900cd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:58.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.028+0000 7fe8980af640 1 --2- 172.21.15.123:0/2410261721 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe87406c2e0 0x7fe87406e7a0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:58.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.028+0000 7fe8980af640 1 --2- 172.21.15.123:0/2410261721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8900d23b0 0x7fe8900ccbf0 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:58.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.028+0000 7fe8980af640 1 --2- 172.21.15.123:0/2410261721 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe8900cf2d0 0x7fe8900c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:58.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.028+0000 7fe8980af640 1 -- 172.21.15.123:0/2410261721 >> 172.21.15.123:0/2410261721 conn(0x7fe8900d1260 msgr2=0x7fe8900cf6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:58.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.028+0000 7fe8980af640 1 -- 172.21.15.123:0/2410261721 shutdown_connections 2024-09-15T23:18:58.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.028+0000 7fe8980af640 1 -- 172.21.15.123:0/2410261721 wait complete. 2024-09-15T23:18:58.040 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T23:18:58.041 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:18:58.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.138+0000 7fce0679f640 1 Processor -- start 2024-09-15T23:18:58.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.138+0000 7fce0679f640 1 -- start start 2024-09-15T23:18:58.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.138+0000 7fce0679f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fce0015ed20 0x7fce000b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:58.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.138+0000 7fce0679f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fce000b90e0 0x7fce000b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:58.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.138+0000 7fce0679f640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce000d0e70 con 0x7fce000d23b0 2024-09-15T23:18:58.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.138+0000 7fce0679f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fce000d41c0 con 0x7fce0015ed20 2024-09-15T23:18:58.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.138+0000 7fce0679f640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fce000d35b0 con 0x7fce000b90e0 2024-09-15T23:18:58.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.139+0000 7fcdfffff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fce0015ed20 0x7fce000b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:58.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.139+0000 7fcdff7fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fce000d23b0 0x7fce000cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35156/0 (socket says 172.21.15.123:35156) 2024-09-15T23:18:58.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.139+0000 7fcdff7fe640 1 -- 172.21.15.123:0/795885509 learned_addr learned my addr 172.21.15.123:0/795885509 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:18:58.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.139+0000 7fce04d3c640 1 --2- 172.21.15.123:0/795885509 >> v2:172.21.15.188:3300/0 conn(0x7fce000b90e0 0x7fce000b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:58.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.139+0000 7fcdfffff640 1 -- 172.21.15.123:0/795885509 >> v2:172.21.15.188:3300/0 conn(0x7fce000b90e0 msgr2=0x7fce000b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:58.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.139+0000 7fcdfffff640 1 --2- 172.21.15.123:0/795885509 >> v2:172.21.15.188:3300/0 conn(0x7fce000b90e0 0x7fce000b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:58.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.139+0000 7fcdfffff640 1 -- 172.21.15.123:0/795885509 >> v1:172.21.15.123:6789/0 conn(0x7fce000d23b0 legacy=0x7fce000cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:58.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.139+0000 7fcdfffff640 1 -- 172.21.15.123:0/795885509 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce000d3890 con 0x7fce0015ed20 2024-09-15T23:18:58.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.139+0000 7fcdfeffd640 1 -- 172.21.15.123:0/795885509 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3296624607 0 0) 0x7fcdf4001110 con 0x7fce000d23b0 2024-09-15T23:18:58.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.140+0000 7fcdfffff640 1 --2- 172.21.15.123:0/795885509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce0015ed20 0x7fce000b6260 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fce000cedc0 tx=0x7fcdf002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53f9927afc528cb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:58.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.140+0000 7fcdfeffd640 1 -- 172.21.15.123:0/795885509 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf0037070 con 0x7fce0015ed20 2024-09-15T23:18:58.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.140+0000 7fcdfeffd640 1 -- 172.21.15.123:0/795885509 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdf0032440 con 0x7fce0015ed20 2024-09-15T23:18:58.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.140+0000 7fcdfeffd640 1 -- 172.21.15.123:0/795885509 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf002ae60 con 0x7fce0015ed20 2024-09-15T23:18:58.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.140+0000 7fce0679f640 1 -- 172.21.15.123:0/795885509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce0015ed20 msgr2=0x7fce000b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:58.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.140+0000 7fce0679f640 1 --2- 172.21.15.123:0/795885509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce0015ed20 0x7fce000b6260 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fce000cedc0 tx=0x7fcdf002a110 comp rx=0 tx=0).stop 2024-09-15T23:18:58.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.140+0000 7fce0679f640 1 -- 172.21.15.123:0/795885509 shutdown_connections 2024-09-15T23:18:58.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.140+0000 7fce0679f640 1 --2- 172.21.15.123:0/795885509 >> v2:172.21.15.188:3300/0 conn(0x7fce000b90e0 0x7fce000b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:58.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.140+0000 7fce0679f640 1 --2- 172.21.15.123:0/795885509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce0015ed20 0x7fce000b6260 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:58.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.140+0000 7fce0679f640 1 -- 172.21.15.123:0/795885509 >> 172.21.15.123:0/795885509 conn(0x7fce000d1260 msgr2=0x7fce000d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:58.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.140+0000 7fce0679f640 1 -- 172.21.15.123:0/795885509 shutdown_connections 2024-09-15T23:18:58.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.140+0000 7fce0679f640 1 -- 172.21.15.123:0/795885509 wait complete. 2024-09-15T23:18:58.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.141+0000 7fce0679f640 1 Processor -- start 2024-09-15T23:18:58.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.142+0000 7fce0679f640 1 -- start start 2024-09-15T23:18:58.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.142+0000 7fce0679f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fce000b90e0 0x7fce000cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:58.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.142+0000 7fce0679f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fce000d23b0 0x7fce000c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:58.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.142+0000 7fce0679f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce0015ed20 0x7fce00154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:58.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.142+0000 7fce0679f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fce000d32a0 con 0x7fce0015ed20 2024-09-15T23:18:58.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.142+0000 7fce0679f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fce000d3e50 con 0x7fce000b90e0 2024-09-15T23:18:58.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.142+0000 7fce0679f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fce0015f100 con 0x7fce000d23b0 2024-09-15T23:18:58.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.143+0000 7fce04d3c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce0015ed20 0x7fce00154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:58.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.143+0000 7fce04d3c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce0015ed20 0x7fce00154d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38630/0 (socket says 172.21.15.123:38630) 2024-09-15T23:18:58.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.143+0000 7fce04d3c640 1 -- 172.21.15.123:0/2033865385 learned_addr learned my addr 172.21.15.123:0/2033865385 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.143+0000 7fcdfffff640 1 --2- 172.21.15.123:0/2033865385 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fce000b90e0 0x7fce000cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.143+0000 7fcdff7fe640 1 --2- 172.21.15.123:0/2033865385 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fce000d23b0 0x7fce000c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.143+0000 7fce04d3c640 1 -- 172.21.15.123:0/2033865385 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fce000d23b0 msgr2=0x7fce000c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.143+0000 7fce04d3c640 1 --2- 172.21.15.123:0/2033865385 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fce000d23b0 0x7fce000c8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.143+0000 7fce04d3c640 1 -- 172.21.15.123:0/2033865385 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fce000b90e0 msgr2=0x7fce000cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.143+0000 7fce04d3c640 1 --2- 172.21.15.123:0/2033865385 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fce000b90e0 0x7fce000cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.143+0000 7fce04d3c640 1 -- 172.21.15.123:0/2033865385 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce000c9330 con 0x7fce0015ed20 2024-09-15T23:18:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.143+0000 7fcdfffff640 1 --2- 172.21.15.123:0/2033865385 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fce000b90e0 0x7fce000cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:18:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.143+0000 7fcdff7fe640 1 --2- 172.21.15.123:0/2033865385 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fce000d23b0 0x7fce000c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:18:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.143+0000 7fce04d3c640 1 --2- 172.21.15.123:0/2033865385 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce0015ed20 0x7fce00154d10 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fcdf800efc0 tx=0x7fcdf800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.143+0000 7fcdfcff9640 1 -- 172.21.15.123:0/2033865385 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf8018020 con 0x7fce0015ed20 2024-09-15T23:18:58.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.143+0000 7fcdfcff9640 1 -- 172.21.15.123:0/2033865385 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdf8014480 con 0x7fce0015ed20 2024-09-15T23:18:58.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.143+0000 7fce0679f640 1 -- 172.21.15.123:0/2033865385 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce000c9610 con 0x7fce0015ed20 2024-09-15T23:18:58.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.143+0000 7fcdfcff9640 1 -- 172.21.15.123:0/2033865385 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf8014870 con 0x7fce0015ed20 2024-09-15T23:18:58.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.143+0000 7fce0679f640 1 -- 172.21.15.123:0/2033865385 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce000c9bd0 con 0x7fce0015ed20 2024-09-15T23:18:58.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.144+0000 7fce0679f640 1 -- 172.21.15.123:0/2033865385 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce000b7010 con 0x7fce0015ed20 2024-09-15T23:18:58.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.145+0000 7fcdfcff9640 1 -- 172.21.15.123:0/2033865385 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcdf8005d10 con 0x7fce0015ed20 2024-09-15T23:18:58.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.145+0000 7fcdfcff9640 1 --2- 172.21.15.123:0/2033865385 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcdec06c2b0 0x7fcdec06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:58.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.145+0000 7fcdfcff9640 1 -- 172.21.15.123:0/2033865385 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7fcdf808bf80 con 0x7fce0015ed20 2024-09-15T23:18:58.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.145+0000 7fcdfffff640 1 --2- 172.21.15.123:0/2033865385 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcdec06c2b0 0x7fcdec06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:58.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.146+0000 7fcdfffff640 1 --2- 172.21.15.123:0/2033865385 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcdec06c2b0 0x7fcdec06e770 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0034000 tx=0x7fcdf002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:58.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.149+0000 7fcdfcff9640 1 -- 172.21.15.123:0/2033865385 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcdf8022070 con 0x7fce0015ed20 2024-09-15T23:18:58.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.310+0000 7fce0679f640 1 -- 172.21.15.123:0/2033865385 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fce00155250 con 0x7fcdec06c2b0 2024-09-15T23:18:58.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.316+0000 7fcdfcff9640 1 -- 172.21.15.123:0/2033865385 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246419 (secure 0 0 0) 0x7fcdf0032610 con 0x7fcdec06c2b0 2024-09-15T23:18:58.320 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:18:58.322 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:18:58.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.319+0000 7fce0679f640 1 -- 172.21.15.123:0/2033865385 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcdec06c2b0 msgr2=0x7fcdec06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:58.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.319+0000 7fce0679f640 1 --2- 172.21.15.123:0/2033865385 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcdec06c2b0 0x7fcdec06e770 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0034000 tx=0x7fcdf002e000 comp rx=0 tx=0).stop 2024-09-15T23:18:58.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.319+0000 7fce0679f640 1 -- 172.21.15.123:0/2033865385 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce0015ed20 msgr2=0x7fce00154d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:58.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.319+0000 7fce0679f640 1 --2- 172.21.15.123:0/2033865385 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce0015ed20 0x7fce00154d10 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fcdf800efc0 tx=0x7fcdf800c490 comp rx=0 tx=0).stop 2024-09-15T23:18:58.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.319+0000 7fce0679f640 1 -- 172.21.15.123:0/2033865385 shutdown_connections 2024-09-15T23:18:58.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.319+0000 7fce0679f640 1 --2- 172.21.15.123:0/2033865385 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcdec06c2b0 0x7fcdec06e770 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:58.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.319+0000 7fce0679f640 1 --2- 172.21.15.123:0/2033865385 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce0015ed20 0x7fce00154d10 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:58.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.319+0000 7fce0679f640 1 --2- 172.21.15.123:0/2033865385 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fce000d23b0 0x7fce000c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:58.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.319+0000 7fce0679f640 1 --2- 172.21.15.123:0/2033865385 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fce000b90e0 0x7fce000cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:58.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.319+0000 7fce0679f640 1 -- 172.21.15.123:0/2033865385 >> 172.21.15.123:0/2033865385 conn(0x7fce000d1260 msgr2=0x7fce000d1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:58.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.319+0000 7fce0679f640 1 -- 172.21.15.123:0/2033865385 shutdown_connections 2024-09-15T23:18:58.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.319+0000 7fce0679f640 1 -- 172.21.15.123:0/2033865385 wait complete. 2024-09-15T23:18:58.331 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":331,"stamp":"2024-09-15T23:18:57.600357+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592126,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":198,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":124,"acting":124,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":41,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":392132,"kb_used_data":13488,"kb_used_omap":12,"kb_used_meta":378419,"kb_avail":754582588,"statfs":{"total":773094113280,"available":772692570112,"internally_reserved":0,"allocated":13811712,"data_stored":6730271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":387501616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1758,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.215521"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.405875+0000","last_change":"2024-09-15T23:18:55.410755+0000","last_active":"2024-09-15T23:18:56.405875+0000","last_peered":"2024-09-15T23:18:56.405875+0000","last_clean":"2024-09-15T23:18:56.405875+0000","last_became_active":"2024-09-15T23:18:55.410175+0000","last_became_peered":"2024-09-15T23:18:55.410175+0000","last_unstale":"2024-09-15T23:18:56.405875+0000","last_undegraded":"2024-09-15T23:18:56.405875+0000","last_fullsized":"2024-09-15T23:18:56.405875+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:43:05.591911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.423840+0000","last_change":"2024-09-15T23:18:55.418935+0000","last_active":"2024-09-15T23:18:55.423840+0000","last_peered":"2024-09-15T23:18:55.423840+0000","last_clean":"2024-09-15T23:18:55.423840+0000","last_became_active":"2024-09-15T23:18:55.418679+0000","last_became_peered":"2024-09-15T23:18:55.418679+0000","last_unstale":"2024-09-15T23:18:55.423840+0000","last_undegraded":"2024-09-15T23:18:55.423840+0000","last_fullsized":"2024-09-15T23:18:55.423840+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:16.210045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.412239+0000","last_change":"2024-09-15T23:18:55.408374+0000","last_active":"2024-09-15T23:18:55.412239+0000","last_peered":"2024-09-15T23:18:55.412239+0000","last_clean":"2024-09-15T23:18:55.412239+0000","last_became_active":"2024-09-15T23:18:55.408101+0000","last_became_peered":"2024-09-15T23:18:55.408101+0000","last_unstale":"2024-09-15T23:18:55.412239+0000","last_undegraded":"2024-09-15T23:18:55.412239+0000","last_fullsized":"2024-09-15T23:18:55.412239+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:31.293761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.420498+0000","last_change":"2024-09-15T23:18:55.419260+0000","last_active":"2024-09-15T23:18:55.420498+0000","last_peered":"2024-09-15T23:18:55.420498+0000","last_clean":"2024-09-15T23:18:55.420498+0000","last_became_active":"2024-09-15T23:18:55.418943+0000","last_became_peered":"2024-09-15T23:18:55.418943+0000","last_unstale":"2024-09-15T23:18:55.420498+0000","last_undegraded":"2024-09-15T23:18:55.420498+0000","last_fullsized":"2024-09-15T23:18:55.420498+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:30.448015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406063+0000","last_change":"2024-09-15T23:18:55.421369+0000","last_active":"2024-09-15T23:18:56.406063+0000","last_peered":"2024-09-15T23:18:56.406063+0000","last_clean":"2024-09-15T23:18:56.406063+0000","last_became_active":"2024-09-15T23:18:55.421014+0000","last_became_peered":"2024-09-15T23:18:55.421014+0000","last_unstale":"2024-09-15T23:18:56.406063+0000","last_undegraded":"2024-09-15T23:18:56.406063+0000","last_fullsized":"2024-09-15T23:18:56.406063+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:50.969453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.407113+0000","last_change":"2024-09-15T23:18:55.403062+0000","last_active":"2024-09-15T23:18:55.407113+0000","last_peered":"2024-09-15T23:18:55.407113+0000","last_clean":"2024-09-15T23:18:55.407113+0000","last_became_active":"2024-09-15T23:18:55.402715+0000","last_became_peered":"2024-09-15T23:18:55.402715+0000","last_unstale":"2024-09-15T23:18:55.407113+0000","last_undegraded":"2024-09-15T23:18:55.407113+0000","last_fullsized":"2024-09-15T23:18:55.407113+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:56.087785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.406426+0000","last_change":"2024-09-15T23:18:55.402262+0000","last_active":"2024-09-15T23:18:55.406426+0000","last_peered":"2024-09-15T23:18:55.406426+0000","last_clean":"2024-09-15T23:18:55.406426+0000","last_became_active":"2024-09-15T23:18:55.401993+0000","last_became_peered":"2024-09-15T23:18:55.401993+0000","last_unstale":"2024-09-15T23:18:55.406426+0000","last_undegraded":"2024-09-15T23:18:55.406426+0000","last_fullsized":"2024-09-15T23:18:55.406426+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:24.833753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.405868+0000","last_change":"2024-09-15T23:18:55.405009+0000","last_active":"2024-09-15T23:18:56.405868+0000","last_peered":"2024-09-15T23:18:56.405868+0000","last_clean":"2024-09-15T23:18:56.405868+0000","last_became_active":"2024-09-15T23:18:55.404627+0000","last_became_peered":"2024-09-15T23:18:55.404627+0000","last_unstale":"2024-09-15T23:18:56.405868+0000","last_undegraded":"2024-09-15T23:18:56.405868+0000","last_fullsized":"2024-09-15T23:18:56.405868+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:46.431898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.410005+0000","last_change":"2024-09-15T23:18:55.408322+0000","last_active":"2024-09-15T23:18:55.410005+0000","last_peered":"2024-09-15T23:18:55.410005+0000","last_clean":"2024-09-15T23:18:55.410005+0000","last_became_active":"2024-09-15T23:18:55.407499+0000","last_became_peered":"2024-09-15T23:18:55.407499+0000","last_unstale":"2024-09-15T23:18:55.410005+0000","last_undegraded":"2024-09-15T23:18:55.410005+0000","last_fullsized":"2024-09-15T23:18:55.410005+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:57.755558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.407195+0000","last_change":"2024-09-15T23:18:55.404066+0000","last_active":"2024-09-15T23:18:55.407195+0000","last_peered":"2024-09-15T23:18:55.407195+0000","last_clean":"2024-09-15T23:18:55.407195+0000","last_became_active":"2024-09-15T23:18:55.403800+0000","last_became_peered":"2024-09-15T23:18:55.403800+0000","last_unstale":"2024-09-15T23:18:55.407195+0000","last_undegraded":"2024-09-15T23:18:55.407195+0000","last_fullsized":"2024-09-15T23:18:55.407195+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:47.101262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.423809+0000","last_change":"2024-09-15T23:18:55.419619+0000","last_active":"2024-09-15T23:18:55.423809+0000","last_peered":"2024-09-15T23:18:55.423809+0000","last_clean":"2024-09-15T23:18:55.423809+0000","last_became_active":"2024-09-15T23:18:55.419359+0000","last_became_peered":"2024-09-15T23:18:55.419359+0000","last_unstale":"2024-09-15T23:18:55.423809+0000","last_undegraded":"2024-09-15T23:18:55.423809+0000","last_fullsized":"2024-09-15T23:18:55.423809+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:34.236072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.405710+0000","last_change":"2024-09-15T23:18:55.404025+0000","last_active":"2024-09-15T23:18:55.405710+0000","last_peered":"2024-09-15T23:18:55.405710+0000","last_clean":"2024-09-15T23:18:55.405710+0000","last_became_active":"2024-09-15T23:18:55.403532+0000","last_became_peered":"2024-09-15T23:18:55.403532+0000","last_unstale":"2024-09-15T23:18:55.405710+0000","last_undegraded":"2024-09-15T23:18:55.405710+0000","last_fullsized":"2024-09-15T23:18:55.405710+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:42.065674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.423787+0000","last_change":"2024-09-15T23:18:55.418863+0000","last_active":"2024-09-15T23:18:55.423787+0000","last_peered":"2024-09-15T23:18:55.423787+0000","last_clean":"2024-09-15T23:18:55.423787+0000","last_became_active":"2024-09-15T23:18:55.418588+0000","last_became_peered":"2024-09-15T23:18:55.418588+0000","last_unstale":"2024-09-15T23:18:55.423787+0000","last_undegraded":"2024-09-15T23:18:55.423787+0000","last_fullsized":"2024-09-15T23:18:55.423787+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:22:10.355949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.423738+0000","last_change":"2024-09-15T23:18:55.422451+0000","last_active":"2024-09-15T23:18:55.423738+0000","last_peered":"2024-09-15T23:18:55.423738+0000","last_clean":"2024-09-15T23:18:55.423738+0000","last_became_active":"2024-09-15T23:18:55.422162+0000","last_became_peered":"2024-09-15T23:18:55.422162+0000","last_unstale":"2024-09-15T23:18:55.423738+0000","last_undegraded":"2024-09-15T23:18:55.423738+0000","last_fullsized":"2024-09-15T23:18:55.423738+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:51.072258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406192+0000","last_change":"2024-09-15T23:18:55.411065+0000","last_active":"2024-09-15T23:18:56.406192+0000","last_peered":"2024-09-15T23:18:56.406192+0000","last_clean":"2024-09-15T23:18:56.406192+0000","last_became_active":"2024-09-15T23:18:55.410332+0000","last_became_peered":"2024-09-15T23:18:55.410332+0000","last_unstale":"2024-09-15T23:18:56.406192+0000","last_undegraded":"2024-09-15T23:18:56.406192+0000","last_fullsized":"2024-09-15T23:18:56.406192+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:04.081907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.410028+0000","last_change":"2024-09-15T23:18:55.408913+0000","last_active":"2024-09-15T23:18:55.410028+0000","last_peered":"2024-09-15T23:18:55.410028+0000","last_clean":"2024-09-15T23:18:55.410028+0000","last_became_active":"2024-09-15T23:18:55.408565+0000","last_became_peered":"2024-09-15T23:18:55.408565+0000","last_unstale":"2024-09-15T23:18:55.410028+0000","last_undegraded":"2024-09-15T23:18:55.410028+0000","last_fullsized":"2024-09-15T23:18:55.410028+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:12:03.648318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406037+0000","last_change":"2024-09-15T23:18:55.417434+0000","last_active":"2024-09-15T23:18:56.406037+0000","last_peered":"2024-09-15T23:18:56.406037+0000","last_clean":"2024-09-15T23:18:56.406037+0000","last_became_active":"2024-09-15T23:18:55.416979+0000","last_became_peered":"2024-09-15T23:18:55.416979+0000","last_unstale":"2024-09-15T23:18:56.406037+0000","last_undegraded":"2024-09-15T23:18:56.406037+0000","last_fullsized":"2024-09-15T23:18:56.406037+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:15.124012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-15T23:18:53.385151+0000","last_change":"2024-09-15T23:18:53.385151+0000","last_active":"2024-09-15T23:18:53.378158+0000","last_peered":"2024-09-15T23:18:53.378158+0000","last_clean":"2024-09-15T23:18:53.378158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:53.385151+0000","last_undegraded":"2024-09-15T23:18:53.385151+0000","last_fullsized":"2024-09-15T23:18:53.385151+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-15T23:18:53.386472+0000","last_change":"2024-09-15T23:18:53.386472+0000","last_active":"2024-09-15T23:18:53.378158+0000","last_peered":"2024-09-15T23:18:53.378158+0000","last_clean":"2024-09-15T23:18:53.378158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:53.386472+0000","last_undegraded":"2024-09-15T23:18:53.386472+0000","last_fullsized":"2024-09-15T23:18:53.386472+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.411110+0000","last_change":"2024-09-15T23:18:55.409732+0000","last_active":"2024-09-15T23:18:55.411110+0000","last_peered":"2024-09-15T23:18:55.411110+0000","last_clean":"2024-09-15T23:18:55.411110+0000","last_became_active":"2024-09-15T23:18:55.409301+0000","last_became_peered":"2024-09-15T23:18:55.409301+0000","last_unstale":"2024-09-15T23:18:55.411110+0000","last_undegraded":"2024-09-15T23:18:55.411110+0000","last_fullsized":"2024-09-15T23:18:55.411110+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:44.191737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1d","version":"129'2","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.422022+0000","last_change":"2024-09-15T23:18:54.406925+0000","last_active":"2024-09-15T23:18:55.422022+0000","last_peered":"2024-09-15T23:18:55.422022+0000","last_clean":"2024-09-15T23:18:55.422022+0000","last_became_active":"2024-09-15T23:18:54.406584+0000","last_became_peered":"2024-09-15T23:18:54.406584+0000","last_unstale":"2024-09-15T23:18:55.422022+0000","last_undegraded":"2024-09-15T23:18:55.422022+0000","last_fullsized":"2024-09-15T23:18:55.422022+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:41.060616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"129'2","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.422084+0000","last_change":"2024-09-15T23:18:54.407600+0000","last_active":"2024-09-15T23:18:55.422084+0000","last_peered":"2024-09-15T23:18:55.422084+0000","last_clean":"2024-09-15T23:18:55.422084+0000","last_became_active":"2024-09-15T23:18:54.407279+0000","last_became_peered":"2024-09-15T23:18:54.407279+0000","last_unstale":"2024-09-15T23:18:55.422084+0000","last_undegraded":"2024-09-15T23:18:55.422084+0000","last_fullsized":"2024-09-15T23:18:55.422084+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:43.186680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.422056+0000","last_change":"2024-09-15T23:18:55.417579+0000","last_active":"2024-09-15T23:18:55.422056+0000","last_peered":"2024-09-15T23:18:55.422056+0000","last_clean":"2024-09-15T23:18:55.422056+0000","last_became_active":"2024-09-15T23:18:55.417302+0000","last_became_peered":"2024-09-15T23:18:55.417302+0000","last_unstale":"2024-09-15T23:18:55.422056+0000","last_undegraded":"2024-09-15T23:18:55.422056+0000","last_fullsized":"2024-09-15T23:18:55.422056+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:48:22.001477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-15T23:18:53.388074+0000","last_change":"2024-09-15T23:18:53.388074+0000","last_active":"2024-09-15T23:18:53.378158+0000","last_peered":"2024-09-15T23:18:53.378158+0000","last_clean":"2024-09-15T23:18:53.378158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:53.388074+0000","last_undegraded":"2024-09-15T23:18:53.388074+0000","last_fullsized":"2024-09-15T23:18:53.388074+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"129'1","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.405710+0000","last_change":"2024-09-15T23:18:54.398393+0000","last_active":"2024-09-15T23:18:56.405710+0000","last_peered":"2024-09-15T23:18:56.405710+0000","last_clean":"2024-09-15T23:18:56.405710+0000","last_became_active":"2024-09-15T23:18:54.398134+0000","last_became_peered":"2024-09-15T23:18:54.398134+0000","last_unstale":"2024-09-15T23:18:56.405710+0000","last_undegraded":"2024-09-15T23:18:56.405710+0000","last_fullsized":"2024-09-15T23:18:56.405710+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:15.886461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.421409+0000","last_change":"2024-09-15T23:18:55.420328+0000","last_active":"2024-09-15T23:18:55.421409+0000","last_peered":"2024-09-15T23:18:55.421409+0000","last_clean":"2024-09-15T23:18:55.421409+0000","last_became_active":"2024-09-15T23:18:55.420023+0000","last_became_peered":"2024-09-15T23:18:55.420023+0000","last_unstale":"2024-09-15T23:18:55.421409+0000","last_undegraded":"2024-09-15T23:18:55.421409+0000","last_fullsized":"2024-09-15T23:18:55.421409+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:21.016141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:53.378158+0000","last_change":"2024-09-15T23:18:53.378158+0000","last_active":"2024-09-15T23:18:53.378158+0000","last_peered":"2024-09-15T23:18:53.378158+0000","last_clean":"2024-09-15T23:18:53.378158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:53.378158+0000","last_undegraded":"2024-09-15T23:18:53.378158+0000","last_fullsized":"2024-09-15T23:18:53.378158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.397832+0000","last_change":"2024-09-15T23:18:54.408733+0000","last_active":"2024-09-15T23:18:55.397832+0000","last_peered":"2024-09-15T23:18:55.397832+0000","last_clean":"2024-09-15T23:18:55.397832+0000","last_became_active":"2024-09-15T23:18:54.408453+0000","last_became_peered":"2024-09-15T23:18:54.408453+0000","last_unstale":"2024-09-15T23:18:55.397832+0000","last_undegraded":"2024-09-15T23:18:55.397832+0000","last_fullsized":"2024-09-15T23:18:55.397832+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:19:18.665458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.400530+0000","last_change":"2024-09-15T23:18:54.409517+0000","last_active":"2024-09-15T23:18:55.400530+0000","last_peered":"2024-09-15T23:18:55.400530+0000","last_clean":"2024-09-15T23:18:55.400530+0000","last_became_active":"2024-09-15T23:18:54.409082+0000","last_became_peered":"2024-09-15T23:18:54.409082+0000","last_unstale":"2024-09-15T23:18:55.400530+0000","last_undegraded":"2024-09-15T23:18:55.400530+0000","last_fullsized":"2024-09-15T23:18:55.400530+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:41:08.697739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.397924+0000","last_change":"2024-09-15T23:18:54.401049+0000","last_active":"2024-09-15T23:18:55.397924+0000","last_peered":"2024-09-15T23:18:55.397924+0000","last_clean":"2024-09-15T23:18:55.397924+0000","last_became_active":"2024-09-15T23:18:54.400776+0000","last_became_peered":"2024-09-15T23:18:54.400776+0000","last_unstale":"2024-09-15T23:18:55.397924+0000","last_undegraded":"2024-09-15T23:18:55.397924+0000","last_fullsized":"2024-09-15T23:18:55.397924+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:31.412905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.405676+0000","last_change":"2024-09-15T23:18:55.403705+0000","last_active":"2024-09-15T23:18:55.405676+0000","last_peered":"2024-09-15T23:18:55.405676+0000","last_clean":"2024-09-15T23:18:55.405676+0000","last_became_active":"2024-09-15T23:18:55.403391+0000","last_became_peered":"2024-09-15T23:18:55.403391+0000","last_unstale":"2024-09-15T23:18:55.405676+0000","last_undegraded":"2024-09-15T23:18:55.405676+0000","last_fullsized":"2024-09-15T23:18:55.405676+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:19.216199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"129'3","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.422572+0000","last_change":"2024-09-15T23:18:54.404045+0000","last_active":"2024-09-15T23:18:55.422572+0000","last_peered":"2024-09-15T23:18:55.422572+0000","last_clean":"2024-09-15T23:18:55.422572+0000","last_became_active":"2024-09-15T23:18:54.403773+0000","last_became_peered":"2024-09-15T23:18:54.403773+0000","last_unstale":"2024-09-15T23:18:55.422572+0000","last_undegraded":"2024-09-15T23:18:55.422572+0000","last_fullsized":"2024-09-15T23:18:55.422572+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:02:31.113880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"129'6","reported_seq":18,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.425154+0000","last_change":"2024-09-15T23:18:54.407446+0000","last_active":"2024-09-15T23:18:55.425154+0000","last_peered":"2024-09-15T23:18:55.425154+0000","last_clean":"2024-09-15T23:18:55.425154+0000","last_became_active":"2024-09-15T23:18:54.407141+0000","last_became_peered":"2024-09-15T23:18:54.407141+0000","last_unstale":"2024-09-15T23:18:55.425154+0000","last_undegraded":"2024-09-15T23:18:55.425154+0000","last_fullsized":"2024-09-15T23:18:55.425154+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:29.442958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.409717+0000","last_change":"2024-09-15T23:18:55.407912+0000","last_active":"2024-09-15T23:18:55.409717+0000","last_peered":"2024-09-15T23:18:55.409717+0000","last_clean":"2024-09-15T23:18:55.409717+0000","last_became_active":"2024-09-15T23:18:55.407554+0000","last_became_peered":"2024-09-15T23:18:55.407554+0000","last_unstale":"2024-09-15T23:18:55.409717+0000","last_undegraded":"2024-09-15T23:18:55.409717+0000","last_fullsized":"2024-09-15T23:18:55.409717+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:45:08.058331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"129'2","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.419017+0000","last_change":"2024-09-15T23:18:54.402978+0000","last_active":"2024-09-15T23:18:55.419017+0000","last_peered":"2024-09-15T23:18:55.419017+0000","last_clean":"2024-09-15T23:18:55.419017+0000","last_became_active":"2024-09-15T23:18:54.401842+0000","last_became_peered":"2024-09-15T23:18:54.401842+0000","last_unstale":"2024-09-15T23:18:55.419017+0000","last_undegraded":"2024-09-15T23:18:55.419017+0000","last_fullsized":"2024-09-15T23:18:55.419017+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:33.884558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.423768+0000","last_change":"2024-09-15T23:18:55.418699+0000","last_active":"2024-09-15T23:18:55.423768+0000","last_peered":"2024-09-15T23:18:55.423768+0000","last_clean":"2024-09-15T23:18:55.423768+0000","last_became_active":"2024-09-15T23:18:55.418360+0000","last_became_peered":"2024-09-15T23:18:55.418360+0000","last_unstale":"2024-09-15T23:18:55.423768+0000","last_undegraded":"2024-09-15T23:18:55.423768+0000","last_fullsized":"2024-09-15T23:18:55.423768+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:42:21.996440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-15T23:18:53.388068+0000","last_change":"2024-09-15T23:18:53.388068+0000","last_active":"2024-09-15T23:18:53.378158+0000","last_peered":"2024-09-15T23:18:53.378158+0000","last_clean":"2024-09-15T23:18:53.378158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:53.388068+0000","last_undegraded":"2024-09-15T23:18:53.388068+0000","last_fullsized":"2024-09-15T23:18:53.388068+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.421672+0000","last_change":"2024-09-15T23:18:55.414604+0000","last_active":"2024-09-15T23:18:55.421672+0000","last_peered":"2024-09-15T23:18:55.421672+0000","last_clean":"2024-09-15T23:18:55.421672+0000","last_became_active":"2024-09-15T23:18:55.414206+0000","last_became_peered":"2024-09-15T23:18:55.414206+0000","last_unstale":"2024-09-15T23:18:55.421672+0000","last_undegraded":"2024-09-15T23:18:55.421672+0000","last_fullsized":"2024-09-15T23:18:55.421672+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:51.072258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"129'8","reported_seq":22,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.405970+0000","last_change":"2024-09-15T23:18:54.396324+0000","last_active":"2024-09-15T23:18:56.405970+0000","last_peered":"2024-09-15T23:18:56.405970+0000","last_clean":"2024-09-15T23:18:56.405970+0000","last_became_active":"2024-09-15T23:18:54.395912+0000","last_became_peered":"2024-09-15T23:18:54.395912+0000","last_unstale":"2024-09-15T23:18:56.405970+0000","last_undegraded":"2024-09-15T23:18:56.405970+0000","last_fullsized":"2024-09-15T23:18:56.405970+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:40.585024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406206+0000","last_change":"2024-09-15T23:18:55.407625+0000","last_active":"2024-09-15T23:18:56.406206+0000","last_peered":"2024-09-15T23:18:56.406206+0000","last_clean":"2024-09-15T23:18:56.406206+0000","last_became_active":"2024-09-15T23:18:55.407035+0000","last_became_peered":"2024-09-15T23:18:55.407035+0000","last_unstale":"2024-09-15T23:18:56.406206+0000","last_undegraded":"2024-09-15T23:18:56.406206+0000","last_fullsized":"2024-09-15T23:18:56.406206+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:24.712832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.f","version":"129'1","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.407973+0000","last_change":"2024-09-15T23:18:54.408656+0000","last_active":"2024-09-15T23:18:55.407973+0000","last_peered":"2024-09-15T23:18:55.407973+0000","last_clean":"2024-09-15T23:18:55.407973+0000","last_became_active":"2024-09-15T23:18:54.408298+0000","last_became_peered":"2024-09-15T23:18:54.408298+0000","last_unstale":"2024-09-15T23:18:55.407973+0000","last_undegraded":"2024-09-15T23:18:55.407973+0000","last_fullsized":"2024-09-15T23:18:55.407973+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:41:08.697739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406051+0000","last_change":"2024-09-15T23:18:55.420952+0000","last_active":"2024-09-15T23:18:56.406051+0000","last_peered":"2024-09-15T23:18:56.406051+0000","last_clean":"2024-09-15T23:18:56.406051+0000","last_became_active":"2024-09-15T23:18:55.420608+0000","last_became_peered":"2024-09-15T23:18:55.420608+0000","last_unstale":"2024-09-15T23:18:56.406051+0000","last_undegraded":"2024-09-15T23:18:56.406051+0000","last_fullsized":"2024-09-15T23:18:56.406051+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:05.126336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"129'2","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.418055+0000","last_change":"2024-09-15T23:18:54.399080+0000","last_active":"2024-09-15T23:18:55.418055+0000","last_peered":"2024-09-15T23:18:55.418055+0000","last_clean":"2024-09-15T23:18:55.418055+0000","last_became_active":"2024-09-15T23:18:54.398761+0000","last_became_peered":"2024-09-15T23:18:54.398761+0000","last_unstale":"2024-09-15T23:18:55.418055+0000","last_undegraded":"2024-09-15T23:18:55.418055+0000","last_fullsized":"2024-09-15T23:18:55.418055+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:15:19.613132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-15T23:18:53.385105+0000","last_change":"2024-09-15T23:18:53.385105+0000","last_active":"2024-09-15T23:18:53.378158+0000","last_peered":"2024-09-15T23:18:53.378158+0000","last_clean":"2024-09-15T23:18:53.378158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:53.385105+0000","last_undegraded":"2024-09-15T23:18:53.385105+0000","last_fullsized":"2024-09-15T23:18:53.385105+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-15T23:18:53.385148+0000","last_change":"2024-09-15T23:18:53.385148+0000","last_active":"2024-09-15T23:18:53.378158+0000","last_peered":"2024-09-15T23:18:53.378158+0000","last_clean":"2024-09-15T23:18:53.378158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:53.385148+0000","last_undegraded":"2024-09-15T23:18:53.385148+0000","last_fullsized":"2024-09-15T23:18:53.385148+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"129'2","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.418282+0000","last_change":"2024-09-15T23:18:54.403225+0000","last_active":"2024-09-15T23:18:55.418282+0000","last_peered":"2024-09-15T23:18:55.418282+0000","last_clean":"2024-09-15T23:18:55.418282+0000","last_became_active":"2024-09-15T23:18:54.402587+0000","last_became_peered":"2024-09-15T23:18:54.402587+0000","last_unstale":"2024-09-15T23:18:55.418282+0000","last_undegraded":"2024-09-15T23:18:55.418282+0000","last_fullsized":"2024-09-15T23:18:55.418282+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:49.966929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.405777+0000","last_change":"2024-09-15T23:18:55.403788+0000","last_active":"2024-09-15T23:18:56.405777+0000","last_peered":"2024-09-15T23:18:56.405777+0000","last_clean":"2024-09-15T23:18:56.405777+0000","last_became_active":"2024-09-15T23:18:55.402873+0000","last_became_peered":"2024-09-15T23:18:55.402873+0000","last_unstale":"2024-09-15T23:18:56.405777+0000","last_undegraded":"2024-09-15T23:18:56.405777+0000","last_fullsized":"2024-09-15T23:18:56.405777+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:48.439573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.405920+0000","last_change":"2024-09-15T23:18:54.404950+0000","last_active":"2024-09-15T23:18:56.405920+0000","last_peered":"2024-09-15T23:18:56.405920+0000","last_clean":"2024-09-15T23:18:56.405920+0000","last_became_active":"2024-09-15T23:18:54.404532+0000","last_became_peered":"2024-09-15T23:18:54.404532+0000","last_unstale":"2024-09-15T23:18:56.405920+0000","last_undegraded":"2024-09-15T23:18:56.405920+0000","last_fullsized":"2024-09-15T23:18:56.405920+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:51:30.132064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.400203+0000","last_change":"2024-09-15T23:18:54.405325+0000","last_active":"2024-09-15T23:18:55.400203+0000","last_peered":"2024-09-15T23:18:55.400203+0000","last_clean":"2024-09-15T23:18:55.400203+0000","last_became_active":"2024-09-15T23:18:54.405043+0000","last_became_peered":"2024-09-15T23:18:54.405043+0000","last_unstale":"2024-09-15T23:18:55.400203+0000","last_undegraded":"2024-09-15T23:18:55.400203+0000","last_fullsized":"2024-09-15T23:18:55.400203+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:38:39.917102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.421103+0000","last_change":"2024-09-15T23:18:55.420197+0000","last_active":"2024-09-15T23:18:55.421103+0000","last_peered":"2024-09-15T23:18:55.421103+0000","last_clean":"2024-09-15T23:18:55.421103+0000","last_became_active":"2024-09-15T23:18:55.419859+0000","last_became_peered":"2024-09-15T23:18:55.419859+0000","last_unstale":"2024-09-15T23:18:55.421103+0000","last_undegraded":"2024-09-15T23:18:55.421103+0000","last_fullsized":"2024-09-15T23:18:55.421103+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:08.549835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.411690+0000","last_change":"2024-09-15T23:18:54.402999+0000","last_active":"2024-09-15T23:18:55.411690+0000","last_peered":"2024-09-15T23:18:55.411690+0000","last_clean":"2024-09-15T23:18:55.411690+0000","last_became_active":"2024-09-15T23:18:54.402530+0000","last_became_peered":"2024-09-15T23:18:54.402530+0000","last_unstale":"2024-09-15T23:18:55.411690+0000","last_undegraded":"2024-09-15T23:18:55.411690+0000","last_fullsized":"2024-09-15T23:18:55.411690+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:31.992688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"129'2","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.422002+0000","last_change":"2024-09-15T23:18:54.409345+0000","last_active":"2024-09-15T23:18:55.422002+0000","last_peered":"2024-09-15T23:18:55.422002+0000","last_clean":"2024-09-15T23:18:55.422002+0000","last_became_active":"2024-09-15T23:18:54.408730+0000","last_became_peered":"2024-09-15T23:18:54.408730+0000","last_unstale":"2024-09-15T23:18:55.422002+0000","last_undegraded":"2024-09-15T23:18:55.422002+0000","last_fullsized":"2024-09-15T23:18:55.422002+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:18.211142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.407857+0000","last_change":"2024-09-15T23:18:55.404465+0000","last_active":"2024-09-15T23:18:55.407857+0000","last_peered":"2024-09-15T23:18:55.407857+0000","last_clean":"2024-09-15T23:18:55.407857+0000","last_became_active":"2024-09-15T23:18:55.404184+0000","last_became_peered":"2024-09-15T23:18:55.404184+0000","last_unstale":"2024-09-15T23:18:55.407857+0000","last_undegraded":"2024-09-15T23:18:55.407857+0000","last_fullsized":"2024-09-15T23:18:55.407857+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:32.997745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:53.378158+0000","last_change":"2024-09-15T23:18:53.378158+0000","last_active":"2024-09-15T23:18:53.378158+0000","last_peered":"2024-09-15T23:18:53.378158+0000","last_clean":"2024-09-15T23:18:53.378158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:53.378158+0000","last_undegraded":"2024-09-15T23:18:53.378158+0000","last_fullsized":"2024-09-15T23:18:53.378158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406272+0000","last_change":"2024-09-15T23:18:55.413671+0000","last_active":"2024-09-15T23:18:56.406272+0000","last_peered":"2024-09-15T23:18:56.406272+0000","last_clean":"2024-09-15T23:18:56.406272+0000","last_became_active":"2024-09-15T23:18:55.413294+0000","last_became_peered":"2024-09-15T23:18:55.413294+0000","last_unstale":"2024-09-15T23:18:56.406272+0000","last_undegraded":"2024-09-15T23:18:56.406272+0000","last_fullsized":"2024-09-15T23:18:56.406272+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:20:38.130031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.410790+0000","last_change":"2024-09-15T23:18:54.402343+0000","last_active":"2024-09-15T23:18:55.410790+0000","last_peered":"2024-09-15T23:18:55.410790+0000","last_clean":"2024-09-15T23:18:55.410790+0000","last_became_active":"2024-09-15T23:18:54.402023+0000","last_became_peered":"2024-09-15T23:18:54.402023+0000","last_unstale":"2024-09-15T23:18:55.410790+0000","last_undegraded":"2024-09-15T23:18:55.410790+0000","last_fullsized":"2024-09-15T23:18:55.410790+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:46.096205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.413800+0000","last_change":"2024-09-15T23:18:54.409421+0000","last_active":"2024-09-15T23:18:55.413800+0000","last_peered":"2024-09-15T23:18:55.413800+0000","last_clean":"2024-09-15T23:18:55.413800+0000","last_became_active":"2024-09-15T23:18:54.409046+0000","last_became_peered":"2024-09-15T23:18:54.409046+0000","last_unstale":"2024-09-15T23:18:55.413800+0000","last_undegraded":"2024-09-15T23:18:55.413800+0000","last_fullsized":"2024-09-15T23:18:55.413800+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:22.012773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:53.378158+0000","last_change":"2024-09-15T23:18:53.378158+0000","last_active":"2024-09-15T23:18:53.378158+0000","last_peered":"2024-09-15T23:18:53.378158+0000","last_clean":"2024-09-15T23:18:53.378158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:53.378158+0000","last_undegraded":"2024-09-15T23:18:53.378158+0000","last_fullsized":"2024-09-15T23:18:53.378158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-15T23:18:53.385160+0000","last_change":"2024-09-15T23:18:53.385160+0000","last_active":"2024-09-15T23:18:53.378158+0000","last_peered":"2024-09-15T23:18:53.378158+0000","last_clean":"2024-09-15T23:18:53.378158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:53.385160+0000","last_undegraded":"2024-09-15T23:18:53.385160+0000","last_fullsized":"2024-09-15T23:18:53.385160+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406194+0000","last_change":"2024-09-15T23:18:54.399228+0000","last_active":"2024-09-15T23:18:56.406194+0000","last_peered":"2024-09-15T23:18:56.406194+0000","last_clean":"2024-09-15T23:18:56.406194+0000","last_became_active":"2024-09-15T23:18:54.398231+0000","last_became_peered":"2024-09-15T23:18:54.398231+0000","last_unstale":"2024-09-15T23:18:56.406194+0000","last_undegraded":"2024-09-15T23:18:56.406194+0000","last_fullsized":"2024-09-15T23:18:56.406194+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:17.495549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.413353+0000","last_change":"2024-09-15T23:18:55.412629+0000","last_active":"2024-09-15T23:18:55.413353+0000","last_peered":"2024-09-15T23:18:55.413353+0000","last_clean":"2024-09-15T23:18:55.413353+0000","last_became_active":"2024-09-15T23:18:55.411135+0000","last_became_peered":"2024-09-15T23:18:55.411135+0000","last_unstale":"2024-09-15T23:18:55.413353+0000","last_undegraded":"2024-09-15T23:18:55.413353+0000","last_fullsized":"2024-09-15T23:18:55.413353+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:23.017830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.397678+0000","last_change":"2024-09-15T23:18:54.408515+0000","last_active":"2024-09-15T23:18:55.397678+0000","last_peered":"2024-09-15T23:18:55.397678+0000","last_clean":"2024-09-15T23:18:55.397678+0000","last_became_active":"2024-09-15T23:18:54.408246+0000","last_became_peered":"2024-09-15T23:18:54.408246+0000","last_unstale":"2024-09-15T23:18:55.397678+0000","last_undegraded":"2024-09-15T23:18:55.397678+0000","last_fullsized":"2024-09-15T23:18:55.397678+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:38:39.917102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.423628+0000","last_change":"2024-09-15T23:18:55.418483+0000","last_active":"2024-09-15T23:18:55.423628+0000","last_peered":"2024-09-15T23:18:55.423628+0000","last_clean":"2024-09-15T23:18:55.423628+0000","last_became_active":"2024-09-15T23:18:55.418114+0000","last_became_peered":"2024-09-15T23:18:55.418114+0000","last_unstale":"2024-09-15T23:18:55.423628+0000","last_undegraded":"2024-09-15T23:18:55.423628+0000","last_fullsized":"2024-09-15T23:18:55.423628+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:03:26.735040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-15T23:18:53.386469+0000","last_change":"2024-09-15T23:18:53.386469+0000","last_active":"2024-09-15T23:18:53.378158+0000","last_peered":"2024-09-15T23:18:53.378158+0000","last_clean":"2024-09-15T23:18:53.378158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:53.386469+0000","last_undegraded":"2024-09-15T23:18:53.386469+0000","last_fullsized":"2024-09-15T23:18:53.386469+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":363,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-15T23:18:53.388370+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:18:53.388370+0000","last_peered":"2024-09-15T23:18:53.388370+0000","last_clean":"2024-09-15T23:18:53.388370+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:18:53.388370+0000","last_undegraded":"2024-09-15T23:18:53.388370+0000","last_fullsized":"2024-09-15T23:18:53.388370+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":1758,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":58,"acting":58,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476824,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50760,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321080,"statfs":{"total":96636764160,"available":96584785920,"internally_reserved":0,"allocated":1552384,"data_stored":683090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476821,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46616,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325224,"statfs":{"total":96636764160,"available":96589029376,"internally_reserved":0,"allocated":1564672,"data_stored":688907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476823,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63816,"kb_used_data":2096,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94308024,"statfs":{"total":96636764160,"available":96571416576,"internally_reserved":0,"allocated":2146304,"data_stored":1273458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476823,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41036,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330804,"statfs":{"total":96636764160,"available":96594743296,"internally_reserved":0,"allocated":1552384,"data_stored":683090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542230,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41080,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330760,"statfs":{"total":96636764160,"available":96594698240,"internally_reserved":0,"allocated":1609728,"data_stored":703693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542230,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46636,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325204,"statfs":{"total":96636764160,"available":96589008896,"internally_reserved":0,"allocated":1589248,"data_stored":701957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542229,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51380,"kb_used_data":2140,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320460,"statfs":{"total":96636764160,"available":96584151040,"internally_reserved":0,"allocated":2191360,"data_stored":1292417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542231,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50808,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321032,"statfs":{"total":96636764160,"available":96584736768,"internally_reserved":0,"allocated":1605632,"data_stored":703659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:18:58.336 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:18:58.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.469+0000 7f00734ba640 1 Processor -- start 2024-09-15T23:18:58.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.469+0000 7f00734ba640 1 -- start start 2024-09-15T23:18:58.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.470+0000 7f00734ba640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f006c06c320 0x7f006c15bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:58.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.470+0000 7f00734ba640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f006c13eb20 0x7f006c15c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:58.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.470+0000 7f00734ba640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f006c071180 con 0x7f006c0b2d40 2024-09-15T23:18:58.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.470+0000 7f00734ba640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f006c071ab0 con 0x7f006c13eb20 2024-09-15T23:18:58.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.470+0000 7f00734ba640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f006c071460 con 0x7f006c06c320 2024-09-15T23:18:58.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.470+0000 7f0071a57640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f006c13eb20 0x7f006c15c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:58.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.470+0000 7f0071256640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f006c0b2d40 0x7f006c06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35170/0 (socket says 172.21.15.123:35170) 2024-09-15T23:18:58.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.470+0000 7f0071256640 1 -- 172.21.15.123:0/232731873 learned_addr learned my addr 172.21.15.123:0/232731873 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:18:58.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.470+0000 7f0071a57640 1 -- 172.21.15.123:0/232731873 >> v2:172.21.15.188:3300/0 conn(0x7f006c06c320 msgr2=0x7f006c15bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:58.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.470+0000 7f0071a57640 1 --2- 172.21.15.123:0/232731873 >> v2:172.21.15.188:3300/0 conn(0x7f006c06c320 0x7f006c15bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:58.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.470+0000 7f0071a57640 1 -- 172.21.15.123:0/232731873 >> v1:172.21.15.123:6789/0 conn(0x7f006c0b2d40 legacy=0x7f006c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:58.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.470+0000 7f0071a57640 1 -- 172.21.15.123:0/232731873 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f006c071740 con 0x7f006c13eb20 2024-09-15T23:18:58.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.470+0000 7f0063fff640 1 -- 172.21.15.123:0/232731873 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 57251187 0 0) 0x7f006c071180 con 0x7f006c0b2d40 2024-09-15T23:18:58.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.471+0000 7f0071a57640 1 --2- 172.21.15.123:0/232731873 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f006c13eb20 0x7f006c15c230 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f006c0d1500 tx=0x7f006402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=358c57b24b726b53 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:58.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.471+0000 7f0063fff640 1 -- 172.21.15.123:0/232731873 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0064007740 con 0x7f006c13eb20 2024-09-15T23:18:58.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.471+0000 7f0063fff640 1 -- 172.21.15.123:0/232731873 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00640078e0 con 0x7f006c13eb20 2024-09-15T23:18:58.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.471+0000 7f0063fff640 1 -- 172.21.15.123:0/232731873 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0064007cb0 con 0x7f006c13eb20 2024-09-15T23:18:58.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.471+0000 7f00734ba640 1 -- 172.21.15.123:0/232731873 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f006c13eb20 msgr2=0x7f006c15c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:58.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.471+0000 7f00734ba640 1 --2- 172.21.15.123:0/232731873 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f006c13eb20 0x7f006c15c230 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f006c0d1500 tx=0x7f006402a680 comp rx=0 tx=0).stop 2024-09-15T23:18:58.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.471+0000 7f00734ba640 1 -- 172.21.15.123:0/232731873 shutdown_connections 2024-09-15T23:18:58.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.471+0000 7f00734ba640 1 --2- 172.21.15.123:0/232731873 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f006c13eb20 0x7f006c15c230 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:58.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.471+0000 7f00734ba640 1 --2- 172.21.15.123:0/232731873 >> v2:172.21.15.188:3300/0 conn(0x7f006c06c320 0x7f006c15bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:58.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.471+0000 7f00734ba640 1 -- 172.21.15.123:0/232731873 >> 172.21.15.123:0/232731873 conn(0x7f006c0ccec0 msgr2=0x7f006c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:58.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.472+0000 7f00734ba640 1 -- 172.21.15.123:0/232731873 shutdown_connections 2024-09-15T23:18:58.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.472+0000 7f00734ba640 1 -- 172.21.15.123:0/232731873 wait complete. 2024-09-15T23:18:58.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.473+0000 7f00734ba640 1 Processor -- start 2024-09-15T23:18:58.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.473+0000 7f00734ba640 1 -- start start 2024-09-15T23:18:58.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.473+0000 7f00734ba640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f006c06c320 0x7f006c1f5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:58.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.473+0000 7f00734ba640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f006c0b2d40 0x7f006c142290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:58.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.473+0000 7f00734ba640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f006c13eb20 0x7f006c1427d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:58.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.473+0000 7f00734ba640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f006c0720c0 con 0x7f006c13eb20 2024-09-15T23:18:58.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.473+0000 7f00734ba640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f006c071f40 con 0x7f006c0b2d40 2024-09-15T23:18:58.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.473+0000 7f00734ba640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f006c072240 con 0x7f006c06c320 2024-09-15T23:18:58.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.474+0000 7f0071a57640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f006c13eb20 0x7f006c1427d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:58.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.474+0000 7f0071a57640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f006c13eb20 0x7f006c1427d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38638/0 (socket says 172.21.15.123:38638) 2024-09-15T23:18:58.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.474+0000 7f0071a57640 1 -- 172.21.15.123:0/2898215214 learned_addr learned my addr 172.21.15.123:0/2898215214 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:58.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.474+0000 7f0071a57640 1 -- 172.21.15.123:0/2898215214 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f006c06c320 msgr2=0x7f006c1f5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:58.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.474+0000 7f0071a57640 1 --2- 172.21.15.123:0/2898215214 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f006c06c320 0x7f006c1f5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:58.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.474+0000 7f0071a57640 1 -- 172.21.15.123:0/2898215214 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f006c0b2d40 msgr2=0x7f006c142290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:58.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.474+0000 7f0070a55640 1 --2- 172.21.15.123:0/2898215214 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f006c0b2d40 0x7f006c142290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:58.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.474+0000 7f0071a57640 1 --2- 172.21.15.123:0/2898215214 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f006c0b2d40 0x7f006c142290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:58.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.474+0000 7f0071a57640 1 -- 172.21.15.123:0/2898215214 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f006c141cd0 con 0x7f006c13eb20 2024-09-15T23:18:58.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.474+0000 7f0071a57640 1 --2- 172.21.15.123:0/2898215214 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f006c13eb20 0x7f006c1427d0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f006402ac70 tx=0x7f0064004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:58.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.474+0000 7f0061ffb640 1 -- 172.21.15.123:0/2898215214 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0064040070 con 0x7f006c13eb20 2024-09-15T23:18:58.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.474+0000 7f0061ffb640 1 -- 172.21.15.123:0/2898215214 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0064031c40 con 0x7f006c13eb20 2024-09-15T23:18:58.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.474+0000 7f00734ba640 1 -- 172.21.15.123:0/2898215214 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f006c141fb0 con 0x7f006c13eb20 2024-09-15T23:18:58.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.474+0000 7f0061ffb640 1 -- 172.21.15.123:0/2898215214 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006403c620 con 0x7f006c13eb20 2024-09-15T23:18:58.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.474+0000 7f00734ba640 1 -- 172.21.15.123:0/2898215214 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f006c142d10 con 0x7f006c13eb20 2024-09-15T23:18:58.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.475+0000 7f00734ba640 1 -- 172.21.15.123:0/2898215214 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f006c06bc10 con 0x7f006c13eb20 2024-09-15T23:18:58.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.476+0000 7f0061ffb640 1 -- 172.21.15.123:0/2898215214 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0064039040 con 0x7f006c13eb20 2024-09-15T23:18:58.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.476+0000 7f0061ffb640 1 --2- 172.21.15.123:0/2898215214 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f005006c2e0 0x7f005006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:58.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.476+0000 7f0061ffb640 1 -- 172.21.15.123:0/2898215214 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f00640ac910 con 0x7f006c13eb20 2024-09-15T23:18:58.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.476+0000 7f0071256640 1 --2- 172.21.15.123:0/2898215214 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f005006c2e0 0x7f005006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:58.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.477+0000 7f0071256640 1 --2- 172.21.15.123:0/2898215214 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f005006c2e0 0x7f005006e7a0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0068007fd0 tx=0x7f0068007920 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:58.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.480+0000 7f0061ffb640 1 -- 172.21.15.123:0/2898215214 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f006407b110 con 0x7f006c13eb20 2024-09-15T23:18:58.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.641+0000 7f00734ba640 1 -- 172.21.15.123:0/2898215214 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f006c13da30 con 0x7f005006c2e0 2024-09-15T23:18:58.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.648+0000 7f0061ffb640 1 -- 172.21.15.123:0/2898215214 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246419 (secure 0 0 0) 0x7f006c13da30 con 0x7f005006c2e0 2024-09-15T23:18:58.651 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:18:58.653 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:18:58.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.651+0000 7f00734ba640 1 -- 172.21.15.123:0/2898215214 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f005006c2e0 msgr2=0x7f005006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:58.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.651+0000 7f00734ba640 1 --2- 172.21.15.123:0/2898215214 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f005006c2e0 0x7f005006e7a0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0068007fd0 tx=0x7f0068007920 comp rx=0 tx=0).stop 2024-09-15T23:18:58.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.651+0000 7f00734ba640 1 -- 172.21.15.123:0/2898215214 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f006c13eb20 msgr2=0x7f006c1427d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:58.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.651+0000 7f00734ba640 1 --2- 172.21.15.123:0/2898215214 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f006c13eb20 0x7f006c1427d0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f006402ac70 tx=0x7f0064004a40 comp rx=0 tx=0).stop 2024-09-15T23:18:58.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.651+0000 7f00734ba640 1 -- 172.21.15.123:0/2898215214 shutdown_connections 2024-09-15T23:18:58.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.651+0000 7f00734ba640 1 --2- 172.21.15.123:0/2898215214 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f005006c2e0 0x7f005006e7a0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:58.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.651+0000 7f00734ba640 1 --2- 172.21.15.123:0/2898215214 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f006c13eb20 0x7f006c1427d0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:58.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.651+0000 7f00734ba640 1 --2- 172.21.15.123:0/2898215214 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f006c0b2d40 0x7f006c142290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:58.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.651+0000 7f00734ba640 1 --2- 172.21.15.123:0/2898215214 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f006c06c320 0x7f006c1f5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:58.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.651+0000 7f00734ba640 1 -- 172.21.15.123:0/2898215214 >> 172.21.15.123:0/2898215214 conn(0x7f006c0ccec0 msgr2=0x7f006c0d0400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:58.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.651+0000 7f00734ba640 1 -- 172.21.15.123:0/2898215214 shutdown_connections 2024-09-15T23:18:58.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.651+0000 7f00734ba640 1 -- 172.21.15.123:0/2898215214 wait complete. 2024-09-15T23:18:58.663 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":331,"stamp":"2024-09-15T23:18:57.600357+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592126,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":198,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":124,"acting":124,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":41,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":392132,"kb_used_data":13488,"kb_used_omap":12,"kb_used_meta":378419,"kb_avail":754582588,"statfs":{"total":773094113280,"available":772692570112,"internally_reserved":0,"allocated":13811712,"data_stored":6730271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":387501616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1758,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.215521"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.405875+0000","last_change":"2024-09-15T23:18:55.410755+0000","last_active":"2024-09-15T23:18:56.405875+0000","last_peered":"2024-09-15T23:18:56.405875+0000","last_clean":"2024-09-15T23:18:56.405875+0000","last_became_active":"2024-09-15T23:18:55.410175+0000","last_became_peered":"2024-09-15T23:18:55.410175+0000","last_unstale":"2024-09-15T23:18:56.405875+0000","last_undegraded":"2024-09-15T23:18:56.405875+0000","last_fullsized":"2024-09-15T23:18:56.405875+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:43:05.591911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.423840+0000","last_change":"2024-09-15T23:18:55.418935+0000","last_active":"2024-09-15T23:18:55.423840+0000","last_peered":"2024-09-15T23:18:55.423840+0000","last_clean":"2024-09-15T23:18:55.423840+0000","last_became_active":"2024-09-15T23:18:55.418679+0000","last_became_peered":"2024-09-15T23:18:55.418679+0000","last_unstale":"2024-09-15T23:18:55.423840+0000","last_undegraded":"2024-09-15T23:18:55.423840+0000","last_fullsized":"2024-09-15T23:18:55.423840+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:16.210045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.412239+0000","last_change":"2024-09-15T23:18:55.408374+0000","last_active":"2024-09-15T23:18:55.412239+0000","last_peered":"2024-09-15T23:18:55.412239+0000","last_clean":"2024-09-15T23:18:55.412239+0000","last_became_active":"2024-09-15T23:18:55.408101+0000","last_became_peered":"2024-09-15T23:18:55.408101+0000","last_unstale":"2024-09-15T23:18:55.412239+0000","last_undegraded":"2024-09-15T23:18:55.412239+0000","last_fullsized":"2024-09-15T23:18:55.412239+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:31.293761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.420498+0000","last_change":"2024-09-15T23:18:55.419260+0000","last_active":"2024-09-15T23:18:55.420498+0000","last_peered":"2024-09-15T23:18:55.420498+0000","last_clean":"2024-09-15T23:18:55.420498+0000","last_became_active":"2024-09-15T23:18:55.418943+0000","last_became_peered":"2024-09-15T23:18:55.418943+0000","last_unstale":"2024-09-15T23:18:55.420498+0000","last_undegraded":"2024-09-15T23:18:55.420498+0000","last_fullsized":"2024-09-15T23:18:55.420498+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:30.448015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406063+0000","last_change":"2024-09-15T23:18:55.421369+0000","last_active":"2024-09-15T23:18:56.406063+0000","last_peered":"2024-09-15T23:18:56.406063+0000","last_clean":"2024-09-15T23:18:56.406063+0000","last_became_active":"2024-09-15T23:18:55.421014+0000","last_became_peered":"2024-09-15T23:18:55.421014+0000","last_unstale":"2024-09-15T23:18:56.406063+0000","last_undegraded":"2024-09-15T23:18:56.406063+0000","last_fullsized":"2024-09-15T23:18:56.406063+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:50.969453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.407113+0000","last_change":"2024-09-15T23:18:55.403062+0000","last_active":"2024-09-15T23:18:55.407113+0000","last_peered":"2024-09-15T23:18:55.407113+0000","last_clean":"2024-09-15T23:18:55.407113+0000","last_became_active":"2024-09-15T23:18:55.402715+0000","last_became_peered":"2024-09-15T23:18:55.402715+0000","last_unstale":"2024-09-15T23:18:55.407113+0000","last_undegraded":"2024-09-15T23:18:55.407113+0000","last_fullsized":"2024-09-15T23:18:55.407113+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:56.087785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.406426+0000","last_change":"2024-09-15T23:18:55.402262+0000","last_active":"2024-09-15T23:18:55.406426+0000","last_peered":"2024-09-15T23:18:55.406426+0000","last_clean":"2024-09-15T23:18:55.406426+0000","last_became_active":"2024-09-15T23:18:55.401993+0000","last_became_peered":"2024-09-15T23:18:55.401993+0000","last_unstale":"2024-09-15T23:18:55.406426+0000","last_undegraded":"2024-09-15T23:18:55.406426+0000","last_fullsized":"2024-09-15T23:18:55.406426+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:24.833753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.405868+0000","last_change":"2024-09-15T23:18:55.405009+0000","last_active":"2024-09-15T23:18:56.405868+0000","last_peered":"2024-09-15T23:18:56.405868+0000","last_clean":"2024-09-15T23:18:56.405868+0000","last_became_active":"2024-09-15T23:18:55.404627+0000","last_became_peered":"2024-09-15T23:18:55.404627+0000","last_unstale":"2024-09-15T23:18:56.405868+0000","last_undegraded":"2024-09-15T23:18:56.405868+0000","last_fullsized":"2024-09-15T23:18:56.405868+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:46.431898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.410005+0000","last_change":"2024-09-15T23:18:55.408322+0000","last_active":"2024-09-15T23:18:55.410005+0000","last_peered":"2024-09-15T23:18:55.410005+0000","last_clean":"2024-09-15T23:18:55.410005+0000","last_became_active":"2024-09-15T23:18:55.407499+0000","last_became_peered":"2024-09-15T23:18:55.407499+0000","last_unstale":"2024-09-15T23:18:55.410005+0000","last_undegraded":"2024-09-15T23:18:55.410005+0000","last_fullsized":"2024-09-15T23:18:55.410005+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:57.755558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.407195+0000","last_change":"2024-09-15T23:18:55.404066+0000","last_active":"2024-09-15T23:18:55.407195+0000","last_peered":"2024-09-15T23:18:55.407195+0000","last_clean":"2024-09-15T23:18:55.407195+0000","last_became_active":"2024-09-15T23:18:55.403800+0000","last_became_peered":"2024-09-15T23:18:55.403800+0000","last_unstale":"2024-09-15T23:18:55.407195+0000","last_undegraded":"2024-09-15T23:18:55.407195+0000","last_fullsized":"2024-09-15T23:18:55.407195+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:47.101262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.423809+0000","last_change":"2024-09-15T23:18:55.419619+0000","last_active":"2024-09-15T23:18:55.423809+0000","last_peered":"2024-09-15T23:18:55.423809+0000","last_clean":"2024-09-15T23:18:55.423809+0000","last_became_active":"2024-09-15T23:18:55.419359+0000","last_became_peered":"2024-09-15T23:18:55.419359+0000","last_unstale":"2024-09-15T23:18:55.423809+0000","last_undegraded":"2024-09-15T23:18:55.423809+0000","last_fullsized":"2024-09-15T23:18:55.423809+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:34.236072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.405710+0000","last_change":"2024-09-15T23:18:55.404025+0000","last_active":"2024-09-15T23:18:55.405710+0000","last_peered":"2024-09-15T23:18:55.405710+0000","last_clean":"2024-09-15T23:18:55.405710+0000","last_became_active":"2024-09-15T23:18:55.403532+0000","last_became_peered":"2024-09-15T23:18:55.403532+0000","last_unstale":"2024-09-15T23:18:55.405710+0000","last_undegraded":"2024-09-15T23:18:55.405710+0000","last_fullsized":"2024-09-15T23:18:55.405710+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:42.065674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.423787+0000","last_change":"2024-09-15T23:18:55.418863+0000","last_active":"2024-09-15T23:18:55.423787+0000","last_peered":"2024-09-15T23:18:55.423787+0000","last_clean":"2024-09-15T23:18:55.423787+0000","last_became_active":"2024-09-15T23:18:55.418588+0000","last_became_peered":"2024-09-15T23:18:55.418588+0000","last_unstale":"2024-09-15T23:18:55.423787+0000","last_undegraded":"2024-09-15T23:18:55.423787+0000","last_fullsized":"2024-09-15T23:18:55.423787+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:22:10.355949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.423738+0000","last_change":"2024-09-15T23:18:55.422451+0000","last_active":"2024-09-15T23:18:55.423738+0000","last_peered":"2024-09-15T23:18:55.423738+0000","last_clean":"2024-09-15T23:18:55.423738+0000","last_became_active":"2024-09-15T23:18:55.422162+0000","last_became_peered":"2024-09-15T23:18:55.422162+0000","last_unstale":"2024-09-15T23:18:55.423738+0000","last_undegraded":"2024-09-15T23:18:55.423738+0000","last_fullsized":"2024-09-15T23:18:55.423738+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:51.072258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406192+0000","last_change":"2024-09-15T23:18:55.411065+0000","last_active":"2024-09-15T23:18:56.406192+0000","last_peered":"2024-09-15T23:18:56.406192+0000","last_clean":"2024-09-15T23:18:56.406192+0000","last_became_active":"2024-09-15T23:18:55.410332+0000","last_became_peered":"2024-09-15T23:18:55.410332+0000","last_unstale":"2024-09-15T23:18:56.406192+0000","last_undegraded":"2024-09-15T23:18:56.406192+0000","last_fullsized":"2024-09-15T23:18:56.406192+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:04.081907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.410028+0000","last_change":"2024-09-15T23:18:55.408913+0000","last_active":"2024-09-15T23:18:55.410028+0000","last_peered":"2024-09-15T23:18:55.410028+0000","last_clean":"2024-09-15T23:18:55.410028+0000","last_became_active":"2024-09-15T23:18:55.408565+0000","last_became_peered":"2024-09-15T23:18:55.408565+0000","last_unstale":"2024-09-15T23:18:55.410028+0000","last_undegraded":"2024-09-15T23:18:55.410028+0000","last_fullsized":"2024-09-15T23:18:55.410028+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:12:03.648318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406037+0000","last_change":"2024-09-15T23:18:55.417434+0000","last_active":"2024-09-15T23:18:56.406037+0000","last_peered":"2024-09-15T23:18:56.406037+0000","last_clean":"2024-09-15T23:18:56.406037+0000","last_became_active":"2024-09-15T23:18:55.416979+0000","last_became_peered":"2024-09-15T23:18:55.416979+0000","last_unstale":"2024-09-15T23:18:56.406037+0000","last_undegraded":"2024-09-15T23:18:56.406037+0000","last_fullsized":"2024-09-15T23:18:56.406037+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:15.124012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-15T23:18:53.385151+0000","last_change":"2024-09-15T23:18:53.385151+0000","last_active":"2024-09-15T23:18:53.378158+0000","last_peered":"2024-09-15T23:18:53.378158+0000","last_clean":"2024-09-15T23:18:53.378158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:53.385151+0000","last_undegraded":"2024-09-15T23:18:53.385151+0000","last_fullsized":"2024-09-15T23:18:53.385151+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-15T23:18:53.386472+0000","last_change":"2024-09-15T23:18:53.386472+0000","last_active":"2024-09-15T23:18:53.378158+0000","last_peered":"2024-09-15T23:18:53.378158+0000","last_clean":"2024-09-15T23:18:53.378158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:53.386472+0000","last_undegraded":"2024-09-15T23:18:53.386472+0000","last_fullsized":"2024-09-15T23:18:53.386472+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.411110+0000","last_change":"2024-09-15T23:18:55.409732+0000","last_active":"2024-09-15T23:18:55.411110+0000","last_peered":"2024-09-15T23:18:55.411110+0000","last_clean":"2024-09-15T23:18:55.411110+0000","last_became_active":"2024-09-15T23:18:55.409301+0000","last_became_peered":"2024-09-15T23:18:55.409301+0000","last_unstale":"2024-09-15T23:18:55.411110+0000","last_undegraded":"2024-09-15T23:18:55.411110+0000","last_fullsized":"2024-09-15T23:18:55.411110+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:44.191737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1d","version":"129'2","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.422022+0000","last_change":"2024-09-15T23:18:54.406925+0000","last_active":"2024-09-15T23:18:55.422022+0000","last_peered":"2024-09-15T23:18:55.422022+0000","last_clean":"2024-09-15T23:18:55.422022+0000","last_became_active":"2024-09-15T23:18:54.406584+0000","last_became_peered":"2024-09-15T23:18:54.406584+0000","last_unstale":"2024-09-15T23:18:55.422022+0000","last_undegraded":"2024-09-15T23:18:55.422022+0000","last_fullsized":"2024-09-15T23:18:55.422022+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:41.060616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"129'2","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.422084+0000","last_change":"2024-09-15T23:18:54.407600+0000","last_active":"2024-09-15T23:18:55.422084+0000","last_peered":"2024-09-15T23:18:55.422084+0000","last_clean":"2024-09-15T23:18:55.422084+0000","last_became_active":"2024-09-15T23:18:54.407279+0000","last_became_peered":"2024-09-15T23:18:54.407279+0000","last_unstale":"2024-09-15T23:18:55.422084+0000","last_undegraded":"2024-09-15T23:18:55.422084+0000","last_fullsized":"2024-09-15T23:18:55.422084+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:43.186680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.422056+0000","last_change":"2024-09-15T23:18:55.417579+0000","last_active":"2024-09-15T23:18:55.422056+0000","last_peered":"2024-09-15T23:18:55.422056+0000","last_clean":"2024-09-15T23:18:55.422056+0000","last_became_active":"2024-09-15T23:18:55.417302+0000","last_became_peered":"2024-09-15T23:18:55.417302+0000","last_unstale":"2024-09-15T23:18:55.422056+0000","last_undegraded":"2024-09-15T23:18:55.422056+0000","last_fullsized":"2024-09-15T23:18:55.422056+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:48:22.001477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-15T23:18:53.388074+0000","last_change":"2024-09-15T23:18:53.388074+0000","last_active":"2024-09-15T23:18:53.378158+0000","last_peered":"2024-09-15T23:18:53.378158+0000","last_clean":"2024-09-15T23:18:53.378158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:53.388074+0000","last_undegraded":"2024-09-15T23:18:53.388074+0000","last_fullsized":"2024-09-15T23:18:53.388074+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"129'1","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.405710+0000","last_change":"2024-09-15T23:18:54.398393+0000","last_active":"2024-09-15T23:18:56.405710+0000","last_peered":"2024-09-15T23:18:56.405710+0000","last_clean":"2024-09-15T23:18:56.405710+0000","last_became_active":"2024-09-15T23:18:54.398134+0000","last_became_peered":"2024-09-15T23:18:54.398134+0000","last_unstale":"2024-09-15T23:18:56.405710+0000","last_undegraded":"2024-09-15T23:18:56.405710+0000","last_fullsized":"2024-09-15T23:18:56.405710+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:15.886461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.421409+0000","last_change":"2024-09-15T23:18:55.420328+0000","last_active":"2024-09-15T23:18:55.421409+0000","last_peered":"2024-09-15T23:18:55.421409+0000","last_clean":"2024-09-15T23:18:55.421409+0000","last_became_active":"2024-09-15T23:18:55.420023+0000","last_became_peered":"2024-09-15T23:18:55.420023+0000","last_unstale":"2024-09-15T23:18:55.421409+0000","last_undegraded":"2024-09-15T23:18:55.421409+0000","last_fullsized":"2024-09-15T23:18:55.421409+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:21.016141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:53.378158+0000","last_change":"2024-09-15T23:18:53.378158+0000","last_active":"2024-09-15T23:18:53.378158+0000","last_peered":"2024-09-15T23:18:53.378158+0000","last_clean":"2024-09-15T23:18:53.378158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:53.378158+0000","last_undegraded":"2024-09-15T23:18:53.378158+0000","last_fullsized":"2024-09-15T23:18:53.378158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.397832+0000","last_change":"2024-09-15T23:18:54.408733+0000","last_active":"2024-09-15T23:18:55.397832+0000","last_peered":"2024-09-15T23:18:55.397832+0000","last_clean":"2024-09-15T23:18:55.397832+0000","last_became_active":"2024-09-15T23:18:54.408453+0000","last_became_peered":"2024-09-15T23:18:54.408453+0000","last_unstale":"2024-09-15T23:18:55.397832+0000","last_undegraded":"2024-09-15T23:18:55.397832+0000","last_fullsized":"2024-09-15T23:18:55.397832+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:19:18.665458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.400530+0000","last_change":"2024-09-15T23:18:54.409517+0000","last_active":"2024-09-15T23:18:55.400530+0000","last_peered":"2024-09-15T23:18:55.400530+0000","last_clean":"2024-09-15T23:18:55.400530+0000","last_became_active":"2024-09-15T23:18:54.409082+0000","last_became_peered":"2024-09-15T23:18:54.409082+0000","last_unstale":"2024-09-15T23:18:55.400530+0000","last_undegraded":"2024-09-15T23:18:55.400530+0000","last_fullsized":"2024-09-15T23:18:55.400530+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:41:08.697739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.397924+0000","last_change":"2024-09-15T23:18:54.401049+0000","last_active":"2024-09-15T23:18:55.397924+0000","last_peered":"2024-09-15T23:18:55.397924+0000","last_clean":"2024-09-15T23:18:55.397924+0000","last_became_active":"2024-09-15T23:18:54.400776+0000","last_became_peered":"2024-09-15T23:18:54.400776+0000","last_unstale":"2024-09-15T23:18:55.397924+0000","last_undegraded":"2024-09-15T23:18:55.397924+0000","last_fullsized":"2024-09-15T23:18:55.397924+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:31.412905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.405676+0000","last_change":"2024-09-15T23:18:55.403705+0000","last_active":"2024-09-15T23:18:55.405676+0000","last_peered":"2024-09-15T23:18:55.405676+0000","last_clean":"2024-09-15T23:18:55.405676+0000","last_became_active":"2024-09-15T23:18:55.403391+0000","last_became_peered":"2024-09-15T23:18:55.403391+0000","last_unstale":"2024-09-15T23:18:55.405676+0000","last_undegraded":"2024-09-15T23:18:55.405676+0000","last_fullsized":"2024-09-15T23:18:55.405676+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:19.216199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"129'3","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.422572+0000","last_change":"2024-09-15T23:18:54.404045+0000","last_active":"2024-09-15T23:18:55.422572+0000","last_peered":"2024-09-15T23:18:55.422572+0000","last_clean":"2024-09-15T23:18:55.422572+0000","last_became_active":"2024-09-15T23:18:54.403773+0000","last_became_peered":"2024-09-15T23:18:54.403773+0000","last_unstale":"2024-09-15T23:18:55.422572+0000","last_undegraded":"2024-09-15T23:18:55.422572+0000","last_fullsized":"2024-09-15T23:18:55.422572+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:02:31.113880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"129'6","reported_seq":18,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.425154+0000","last_change":"2024-09-15T23:18:54.407446+0000","last_active":"2024-09-15T23:18:55.425154+0000","last_peered":"2024-09-15T23:18:55.425154+0000","last_clean":"2024-09-15T23:18:55.425154+0000","last_became_active":"2024-09-15T23:18:54.407141+0000","last_became_peered":"2024-09-15T23:18:54.407141+0000","last_unstale":"2024-09-15T23:18:55.425154+0000","last_undegraded":"2024-09-15T23:18:55.425154+0000","last_fullsized":"2024-09-15T23:18:55.425154+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:29.442958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.409717+0000","last_change":"2024-09-15T23:18:55.407912+0000","last_active":"2024-09-15T23:18:55.409717+0000","last_peered":"2024-09-15T23:18:55.409717+0000","last_clean":"2024-09-15T23:18:55.409717+0000","last_became_active":"2024-09-15T23:18:55.407554+0000","last_became_peered":"2024-09-15T23:18:55.407554+0000","last_unstale":"2024-09-15T23:18:55.409717+0000","last_undegraded":"2024-09-15T23:18:55.409717+0000","last_fullsized":"2024-09-15T23:18:55.409717+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:45:08.058331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"129'2","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.419017+0000","last_change":"2024-09-15T23:18:54.402978+0000","last_active":"2024-09-15T23:18:55.419017+0000","last_peered":"2024-09-15T23:18:55.419017+0000","last_clean":"2024-09-15T23:18:55.419017+0000","last_became_active":"2024-09-15T23:18:54.401842+0000","last_became_peered":"2024-09-15T23:18:54.401842+0000","last_unstale":"2024-09-15T23:18:55.419017+0000","last_undegraded":"2024-09-15T23:18:55.419017+0000","last_fullsized":"2024-09-15T23:18:55.419017+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:33.884558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.423768+0000","last_change":"2024-09-15T23:18:55.418699+0000","last_active":"2024-09-15T23:18:55.423768+0000","last_peered":"2024-09-15T23:18:55.423768+0000","last_clean":"2024-09-15T23:18:55.423768+0000","last_became_active":"2024-09-15T23:18:55.418360+0000","last_became_peered":"2024-09-15T23:18:55.418360+0000","last_unstale":"2024-09-15T23:18:55.423768+0000","last_undegraded":"2024-09-15T23:18:55.423768+0000","last_fullsized":"2024-09-15T23:18:55.423768+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:42:21.996440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-15T23:18:53.388068+0000","last_change":"2024-09-15T23:18:53.388068+0000","last_active":"2024-09-15T23:18:53.378158+0000","last_peered":"2024-09-15T23:18:53.378158+0000","last_clean":"2024-09-15T23:18:53.378158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:53.388068+0000","last_undegraded":"2024-09-15T23:18:53.388068+0000","last_fullsized":"2024-09-15T23:18:53.388068+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.421672+0000","last_change":"2024-09-15T23:18:55.414604+0000","last_active":"2024-09-15T23:18:55.421672+0000","last_peered":"2024-09-15T23:18:55.421672+0000","last_clean":"2024-09-15T23:18:55.421672+0000","last_became_active":"2024-09-15T23:18:55.414206+0000","last_became_peered":"2024-09-15T23:18:55.414206+0000","last_unstale":"2024-09-15T23:18:55.421672+0000","last_undegraded":"2024-09-15T23:18:55.421672+0000","last_fullsized":"2024-09-15T23:18:55.421672+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:51.072258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"129'8","reported_seq":22,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.405970+0000","last_change":"2024-09-15T23:18:54.396324+0000","last_active":"2024-09-15T23:18:56.405970+0000","last_peered":"2024-09-15T23:18:56.405970+0000","last_clean":"2024-09-15T23:18:56.405970+0000","last_became_active":"2024-09-15T23:18:54.395912+0000","last_became_peered":"2024-09-15T23:18:54.395912+0000","last_unstale":"2024-09-15T23:18:56.405970+0000","last_undegraded":"2024-09-15T23:18:56.405970+0000","last_fullsized":"2024-09-15T23:18:56.405970+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:40.585024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406206+0000","last_change":"2024-09-15T23:18:55.407625+0000","last_active":"2024-09-15T23:18:56.406206+0000","last_peered":"2024-09-15T23:18:56.406206+0000","last_clean":"2024-09-15T23:18:56.406206+0000","last_became_active":"2024-09-15T23:18:55.407035+0000","last_became_peered":"2024-09-15T23:18:55.407035+0000","last_unstale":"2024-09-15T23:18:56.406206+0000","last_undegraded":"2024-09-15T23:18:56.406206+0000","last_fullsized":"2024-09-15T23:18:56.406206+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:24.712832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.f","version":"129'1","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.407973+0000","last_change":"2024-09-15T23:18:54.408656+0000","last_active":"2024-09-15T23:18:55.407973+0000","last_peered":"2024-09-15T23:18:55.407973+0000","last_clean":"2024-09-15T23:18:55.407973+0000","last_became_active":"2024-09-15T23:18:54.408298+0000","last_became_peered":"2024-09-15T23:18:54.408298+0000","last_unstale":"2024-09-15T23:18:55.407973+0000","last_undegraded":"2024-09-15T23:18:55.407973+0000","last_fullsized":"2024-09-15T23:18:55.407973+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:41:08.697739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406051+0000","last_change":"2024-09-15T23:18:55.420952+0000","last_active":"2024-09-15T23:18:56.406051+0000","last_peered":"2024-09-15T23:18:56.406051+0000","last_clean":"2024-09-15T23:18:56.406051+0000","last_became_active":"2024-09-15T23:18:55.420608+0000","last_became_peered":"2024-09-15T23:18:55.420608+0000","last_unstale":"2024-09-15T23:18:56.406051+0000","last_undegraded":"2024-09-15T23:18:56.406051+0000","last_fullsized":"2024-09-15T23:18:56.406051+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:05.126336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"129'2","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.418055+0000","last_change":"2024-09-15T23:18:54.399080+0000","last_active":"2024-09-15T23:18:55.418055+0000","last_peered":"2024-09-15T23:18:55.418055+0000","last_clean":"2024-09-15T23:18:55.418055+0000","last_became_active":"2024-09-15T23:18:54.398761+0000","last_became_peered":"2024-09-15T23:18:54.398761+0000","last_unstale":"2024-09-15T23:18:55.418055+0000","last_undegraded":"2024-09-15T23:18:55.418055+0000","last_fullsized":"2024-09-15T23:18:55.418055+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:15:19.613132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-15T23:18:53.385105+0000","last_change":"2024-09-15T23:18:53.385105+0000","last_active":"2024-09-15T23:18:53.378158+0000","last_peered":"2024-09-15T23:18:53.378158+0000","last_clean":"2024-09-15T23:18:53.378158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:53.385105+0000","last_undegraded":"2024-09-15T23:18:53.385105+0000","last_fullsized":"2024-09-15T23:18:53.385105+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-15T23:18:53.385148+0000","last_change":"2024-09-15T23:18:53.385148+0000","last_active":"2024-09-15T23:18:53.378158+0000","last_peered":"2024-09-15T23:18:53.378158+0000","last_clean":"2024-09-15T23:18:53.378158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:53.385148+0000","last_undegraded":"2024-09-15T23:18:53.385148+0000","last_fullsized":"2024-09-15T23:18:53.385148+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"129'2","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.418282+0000","last_change":"2024-09-15T23:18:54.403225+0000","last_active":"2024-09-15T23:18:55.418282+0000","last_peered":"2024-09-15T23:18:55.418282+0000","last_clean":"2024-09-15T23:18:55.418282+0000","last_became_active":"2024-09-15T23:18:54.402587+0000","last_became_peered":"2024-09-15T23:18:54.402587+0000","last_unstale":"2024-09-15T23:18:55.418282+0000","last_undegraded":"2024-09-15T23:18:55.418282+0000","last_fullsized":"2024-09-15T23:18:55.418282+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:49.966929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.405777+0000","last_change":"2024-09-15T23:18:55.403788+0000","last_active":"2024-09-15T23:18:56.405777+0000","last_peered":"2024-09-15T23:18:56.405777+0000","last_clean":"2024-09-15T23:18:56.405777+0000","last_became_active":"2024-09-15T23:18:55.402873+0000","last_became_peered":"2024-09-15T23:18:55.402873+0000","last_unstale":"2024-09-15T23:18:56.405777+0000","last_undegraded":"2024-09-15T23:18:56.405777+0000","last_fullsized":"2024-09-15T23:18:56.405777+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:48.439573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.405920+0000","last_change":"2024-09-15T23:18:54.404950+0000","last_active":"2024-09-15T23:18:56.405920+0000","last_peered":"2024-09-15T23:18:56.405920+0000","last_clean":"2024-09-15T23:18:56.405920+0000","last_became_active":"2024-09-15T23:18:54.404532+0000","last_became_peered":"2024-09-15T23:18:54.404532+0000","last_unstale":"2024-09-15T23:18:56.405920+0000","last_undegraded":"2024-09-15T23:18:56.405920+0000","last_fullsized":"2024-09-15T23:18:56.405920+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:51:30.132064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.400203+0000","last_change":"2024-09-15T23:18:54.405325+0000","last_active":"2024-09-15T23:18:55.400203+0000","last_peered":"2024-09-15T23:18:55.400203+0000","last_clean":"2024-09-15T23:18:55.400203+0000","last_became_active":"2024-09-15T23:18:54.405043+0000","last_became_peered":"2024-09-15T23:18:54.405043+0000","last_unstale":"2024-09-15T23:18:55.400203+0000","last_undegraded":"2024-09-15T23:18:55.400203+0000","last_fullsized":"2024-09-15T23:18:55.400203+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:38:39.917102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.421103+0000","last_change":"2024-09-15T23:18:55.420197+0000","last_active":"2024-09-15T23:18:55.421103+0000","last_peered":"2024-09-15T23:18:55.421103+0000","last_clean":"2024-09-15T23:18:55.421103+0000","last_became_active":"2024-09-15T23:18:55.419859+0000","last_became_peered":"2024-09-15T23:18:55.419859+0000","last_unstale":"2024-09-15T23:18:55.421103+0000","last_undegraded":"2024-09-15T23:18:55.421103+0000","last_fullsized":"2024-09-15T23:18:55.421103+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:08.549835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.411690+0000","last_change":"2024-09-15T23:18:54.402999+0000","last_active":"2024-09-15T23:18:55.411690+0000","last_peered":"2024-09-15T23:18:55.411690+0000","last_clean":"2024-09-15T23:18:55.411690+0000","last_became_active":"2024-09-15T23:18:54.402530+0000","last_became_peered":"2024-09-15T23:18:54.402530+0000","last_unstale":"2024-09-15T23:18:55.411690+0000","last_undegraded":"2024-09-15T23:18:55.411690+0000","last_fullsized":"2024-09-15T23:18:55.411690+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:31.992688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"129'2","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.422002+0000","last_change":"2024-09-15T23:18:54.409345+0000","last_active":"2024-09-15T23:18:55.422002+0000","last_peered":"2024-09-15T23:18:55.422002+0000","last_clean":"2024-09-15T23:18:55.422002+0000","last_became_active":"2024-09-15T23:18:54.408730+0000","last_became_peered":"2024-09-15T23:18:54.408730+0000","last_unstale":"2024-09-15T23:18:55.422002+0000","last_undegraded":"2024-09-15T23:18:55.422002+0000","last_fullsized":"2024-09-15T23:18:55.422002+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:18.211142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.407857+0000","last_change":"2024-09-15T23:18:55.404465+0000","last_active":"2024-09-15T23:18:55.407857+0000","last_peered":"2024-09-15T23:18:55.407857+0000","last_clean":"2024-09-15T23:18:55.407857+0000","last_became_active":"2024-09-15T23:18:55.404184+0000","last_became_peered":"2024-09-15T23:18:55.404184+0000","last_unstale":"2024-09-15T23:18:55.407857+0000","last_undegraded":"2024-09-15T23:18:55.407857+0000","last_fullsized":"2024-09-15T23:18:55.407857+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:32.997745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:53.378158+0000","last_change":"2024-09-15T23:18:53.378158+0000","last_active":"2024-09-15T23:18:53.378158+0000","last_peered":"2024-09-15T23:18:53.378158+0000","last_clean":"2024-09-15T23:18:53.378158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:53.378158+0000","last_undegraded":"2024-09-15T23:18:53.378158+0000","last_fullsized":"2024-09-15T23:18:53.378158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406272+0000","last_change":"2024-09-15T23:18:55.413671+0000","last_active":"2024-09-15T23:18:56.406272+0000","last_peered":"2024-09-15T23:18:56.406272+0000","last_clean":"2024-09-15T23:18:56.406272+0000","last_became_active":"2024-09-15T23:18:55.413294+0000","last_became_peered":"2024-09-15T23:18:55.413294+0000","last_unstale":"2024-09-15T23:18:56.406272+0000","last_undegraded":"2024-09-15T23:18:56.406272+0000","last_fullsized":"2024-09-15T23:18:56.406272+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:20:38.130031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.410790+0000","last_change":"2024-09-15T23:18:54.402343+0000","last_active":"2024-09-15T23:18:55.410790+0000","last_peered":"2024-09-15T23:18:55.410790+0000","last_clean":"2024-09-15T23:18:55.410790+0000","last_became_active":"2024-09-15T23:18:54.402023+0000","last_became_peered":"2024-09-15T23:18:54.402023+0000","last_unstale":"2024-09-15T23:18:55.410790+0000","last_undegraded":"2024-09-15T23:18:55.410790+0000","last_fullsized":"2024-09-15T23:18:55.410790+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:46.096205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.413800+0000","last_change":"2024-09-15T23:18:54.409421+0000","last_active":"2024-09-15T23:18:55.413800+0000","last_peered":"2024-09-15T23:18:55.413800+0000","last_clean":"2024-09-15T23:18:55.413800+0000","last_became_active":"2024-09-15T23:18:54.409046+0000","last_became_peered":"2024-09-15T23:18:54.409046+0000","last_unstale":"2024-09-15T23:18:55.413800+0000","last_undegraded":"2024-09-15T23:18:55.413800+0000","last_fullsized":"2024-09-15T23:18:55.413800+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:22.012773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:53.378158+0000","last_change":"2024-09-15T23:18:53.378158+0000","last_active":"2024-09-15T23:18:53.378158+0000","last_peered":"2024-09-15T23:18:53.378158+0000","last_clean":"2024-09-15T23:18:53.378158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:53.378158+0000","last_undegraded":"2024-09-15T23:18:53.378158+0000","last_fullsized":"2024-09-15T23:18:53.378158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-15T23:18:53.385160+0000","last_change":"2024-09-15T23:18:53.385160+0000","last_active":"2024-09-15T23:18:53.378158+0000","last_peered":"2024-09-15T23:18:53.378158+0000","last_clean":"2024-09-15T23:18:53.378158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:53.385160+0000","last_undegraded":"2024-09-15T23:18:53.385160+0000","last_fullsized":"2024-09-15T23:18:53.385160+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406194+0000","last_change":"2024-09-15T23:18:54.399228+0000","last_active":"2024-09-15T23:18:56.406194+0000","last_peered":"2024-09-15T23:18:56.406194+0000","last_clean":"2024-09-15T23:18:56.406194+0000","last_became_active":"2024-09-15T23:18:54.398231+0000","last_became_peered":"2024-09-15T23:18:54.398231+0000","last_unstale":"2024-09-15T23:18:56.406194+0000","last_undegraded":"2024-09-15T23:18:56.406194+0000","last_fullsized":"2024-09-15T23:18:56.406194+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:17.495549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.413353+0000","last_change":"2024-09-15T23:18:55.412629+0000","last_active":"2024-09-15T23:18:55.413353+0000","last_peered":"2024-09-15T23:18:55.413353+0000","last_clean":"2024-09-15T23:18:55.413353+0000","last_became_active":"2024-09-15T23:18:55.411135+0000","last_became_peered":"2024-09-15T23:18:55.411135+0000","last_unstale":"2024-09-15T23:18:55.413353+0000","last_undegraded":"2024-09-15T23:18:55.413353+0000","last_fullsized":"2024-09-15T23:18:55.413353+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:23.017830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.397678+0000","last_change":"2024-09-15T23:18:54.408515+0000","last_active":"2024-09-15T23:18:55.397678+0000","last_peered":"2024-09-15T23:18:55.397678+0000","last_clean":"2024-09-15T23:18:55.397678+0000","last_became_active":"2024-09-15T23:18:54.408246+0000","last_became_peered":"2024-09-15T23:18:54.408246+0000","last_unstale":"2024-09-15T23:18:55.397678+0000","last_undegraded":"2024-09-15T23:18:55.397678+0000","last_fullsized":"2024-09-15T23:18:55.397678+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:38:39.917102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.423628+0000","last_change":"2024-09-15T23:18:55.418483+0000","last_active":"2024-09-15T23:18:55.423628+0000","last_peered":"2024-09-15T23:18:55.423628+0000","last_clean":"2024-09-15T23:18:55.423628+0000","last_became_active":"2024-09-15T23:18:55.418114+0000","last_became_peered":"2024-09-15T23:18:55.418114+0000","last_unstale":"2024-09-15T23:18:55.423628+0000","last_undegraded":"2024-09-15T23:18:55.423628+0000","last_fullsized":"2024-09-15T23:18:55.423628+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:03:26.735040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-15T23:18:53.386469+0000","last_change":"2024-09-15T23:18:53.386469+0000","last_active":"2024-09-15T23:18:53.378158+0000","last_peered":"2024-09-15T23:18:53.378158+0000","last_clean":"2024-09-15T23:18:53.378158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:53.386469+0000","last_undegraded":"2024-09-15T23:18:53.386469+0000","last_fullsized":"2024-09-15T23:18:53.386469+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":363,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-15T23:18:53.388370+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:18:53.388370+0000","last_peered":"2024-09-15T23:18:53.388370+0000","last_clean":"2024-09-15T23:18:53.388370+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:18:53.388370+0000","last_undegraded":"2024-09-15T23:18:53.388370+0000","last_fullsized":"2024-09-15T23:18:53.388370+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":1758,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":58,"acting":58,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476824,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50760,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321080,"statfs":{"total":96636764160,"available":96584785920,"internally_reserved":0,"allocated":1552384,"data_stored":683090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476821,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46616,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325224,"statfs":{"total":96636764160,"available":96589029376,"internally_reserved":0,"allocated":1564672,"data_stored":688907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476823,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63816,"kb_used_data":2096,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94308024,"statfs":{"total":96636764160,"available":96571416576,"internally_reserved":0,"allocated":2146304,"data_stored":1273458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476823,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41036,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330804,"statfs":{"total":96636764160,"available":96594743296,"internally_reserved":0,"allocated":1552384,"data_stored":683090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542230,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41080,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330760,"statfs":{"total":96636764160,"available":96594698240,"internally_reserved":0,"allocated":1609728,"data_stored":703693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542230,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46636,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325204,"statfs":{"total":96636764160,"available":96589008896,"internally_reserved":0,"allocated":1589248,"data_stored":701957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542229,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51380,"kb_used_data":2140,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320460,"statfs":{"total":96636764160,"available":96584151040,"internally_reserved":0,"allocated":2191360,"data_stored":1292417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542231,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50808,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321032,"statfs":{"total":96636764160,"available":96584736768,"internally_reserved":0,"allocated":1605632,"data_stored":703659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:18:58.667 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:18:58.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.800+0000 7f5b2483c640 1 Processor -- start 2024-09-15T23:18:58.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.800+0000 7f5b2483c640 1 -- start start 2024-09-15T23:18:58.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.801+0000 7f5b2483c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5b200b2d40 0x7f5b2006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:58.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.801+0000 7f5b2483c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f5b2013eb20 0x7f5b2006c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:58.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.801+0000 7f5b2483c640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b20071180 con 0x7f5b2015bcf0 2024-09-15T23:18:58.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.801+0000 7f5b2483c640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f5b2015c890 con 0x7f5b200b2d40 2024-09-15T23:18:58.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.801+0000 7f5b2483c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f5b20071ab0 con 0x7f5b2013eb20 2024-09-15T23:18:58.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.801+0000 7f5b1e59c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5b200b2d40 0x7f5b2006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:58.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.801+0000 7f5b1ed9d640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f5b2015bcf0 0x7f5b2015c180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35172/0 (socket says 172.21.15.123:35172) 2024-09-15T23:18:58.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.801+0000 7f5b1ed9d640 1 -- 172.21.15.123:0/489567853 learned_addr learned my addr 172.21.15.123:0/489567853 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:18:58.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.801+0000 7f5b1e59c640 1 -- 172.21.15.123:0/489567853 >> v2:172.21.15.188:3300/0 conn(0x7f5b2013eb20 msgr2=0x7f5b2006c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:58.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.801+0000 7f5b1e59c640 1 --2- 172.21.15.123:0/489567853 >> v2:172.21.15.188:3300/0 conn(0x7f5b2013eb20 0x7f5b2006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:58.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.801+0000 7f5b1e59c640 1 -- 172.21.15.123:0/489567853 >> v1:172.21.15.123:6789/0 conn(0x7f5b2015bcf0 legacy=0x7f5b2015c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:58.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.801+0000 7f5b1e59c640 1 -- 172.21.15.123:0/489567853 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b20071460 con 0x7f5b200b2d40 2024-09-15T23:18:58.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.801+0000 7f5b1dd9b640 1 -- 172.21.15.123:0/489567853 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 144444104 0 0) 0x7f5b20071180 con 0x7f5b2015bcf0 2024-09-15T23:18:58.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.802+0000 7f5b1e59c640 1 --2- 172.21.15.123:0/489567853 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b200b2d40 0x7f5b2006bc10 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f5b200d1500 tx=0x7f5b1002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b85ae945d22d38 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:58.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.802+0000 7f5b1dd9b640 1 -- 172.21.15.123:0/489567853 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b10037070 con 0x7f5b200b2d40 2024-09-15T23:18:58.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.802+0000 7f5b1dd9b640 1 -- 172.21.15.123:0/489567853 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b10032440 con 0x7f5b200b2d40 2024-09-15T23:18:58.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.802+0000 7f5b1dd9b640 1 -- 172.21.15.123:0/489567853 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b10032810 con 0x7f5b200b2d40 2024-09-15T23:18:58.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.802+0000 7f5b2483c640 1 -- 172.21.15.123:0/489567853 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b200b2d40 msgr2=0x7f5b2006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:58.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.802+0000 7f5b2483c640 1 --2- 172.21.15.123:0/489567853 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b200b2d40 0x7f5b2006bc10 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f5b200d1500 tx=0x7f5b1002a1a0 comp rx=0 tx=0).stop 2024-09-15T23:18:58.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.802+0000 7f5b2483c640 1 -- 172.21.15.123:0/489567853 shutdown_connections 2024-09-15T23:18:58.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.802+0000 7f5b2483c640 1 --2- 172.21.15.123:0/489567853 >> v2:172.21.15.188:3300/0 conn(0x7f5b2013eb20 0x7f5b2006c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:58.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.802+0000 7f5b2483c640 1 --2- 172.21.15.123:0/489567853 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b200b2d40 0x7f5b2006bc10 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:58.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.802+0000 7f5b2483c640 1 -- 172.21.15.123:0/489567853 >> 172.21.15.123:0/489567853 conn(0x7f5b200ccec0 msgr2=0x7f5b200cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:58.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.802+0000 7f5b2483c640 1 -- 172.21.15.123:0/489567853 shutdown_connections 2024-09-15T23:18:58.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.803+0000 7f5b2483c640 1 -- 172.21.15.123:0/489567853 wait complete. 2024-09-15T23:18:58.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.804+0000 7f5b2483c640 1 Processor -- start 2024-09-15T23:18:58.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.804+0000 7f5b2483c640 1 -- start start 2024-09-15T23:18:58.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.805+0000 7f5b2483c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b200b2d40 0x7f5b2013d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:58.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.805+0000 7f5b2483c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5b2013eb20 0x7f5b200c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:58.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.805+0000 7f5b2483c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5b2015bcf0 0x7f5b200b3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:58.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.805+0000 7f5b2483c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5b200720c0 con 0x7f5b200b2d40 2024-09-15T23:18:58.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.805+0000 7f5b2483c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5b20071f40 con 0x7f5b2015bcf0 2024-09-15T23:18:58.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.805+0000 7f5b2483c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5b20072240 con 0x7f5b2013eb20 2024-09-15T23:18:58.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.805+0000 7f5b1e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b200b2d40 0x7f5b2013d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:58.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.805+0000 7f5b1e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b200b2d40 0x7f5b2013d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38654/0 (socket says 172.21.15.123:38654) 2024-09-15T23:18:58.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.805+0000 7f5b1e59c640 1 -- 172.21.15.123:0/3702092502 learned_addr learned my addr 172.21.15.123:0/3702092502 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:58.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.805+0000 7f5b1ed9d640 1 --2- 172.21.15.123:0/3702092502 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5b2015bcf0 0x7f5b200b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:58.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.805+0000 7f5b15d9b640 1 --2- 172.21.15.123:0/3702092502 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5b2013eb20 0x7f5b200c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:58.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.805+0000 7f5b1e59c640 1 -- 172.21.15.123:0/3702092502 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5b2013eb20 msgr2=0x7f5b200c97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:58.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.805+0000 7f5b1e59c640 1 --2- 172.21.15.123:0/3702092502 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5b2013eb20 0x7f5b200c97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:58.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.805+0000 7f5b1e59c640 1 -- 172.21.15.123:0/3702092502 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5b2015bcf0 msgr2=0x7f5b200b3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:58.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.805+0000 7f5b1e59c640 1 --2- 172.21.15.123:0/3702092502 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5b2015bcf0 0x7f5b200b3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:58.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.805+0000 7f5b1e59c640 1 -- 172.21.15.123:0/3702092502 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b200ca2b0 con 0x7f5b200b2d40 2024-09-15T23:18:58.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.805+0000 7f5b15d9b640 1 --2- 172.21.15.123:0/3702092502 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5b2013eb20 0x7f5b200c97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:18:58.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.805+0000 7f5b1ed9d640 1 --2- 172.21.15.123:0/3702092502 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5b2015bcf0 0x7f5b200b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:18:58.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.805+0000 7f5b1e59c640 1 --2- 172.21.15.123:0/3702092502 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b200b2d40 0x7f5b2013d0e0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f5b10000c00 tx=0x7f5b100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:58.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.805+0000 7f5b177fe640 1 -- 172.21.15.123:0/3702092502 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b10041070 con 0x7f5b200b2d40 2024-09-15T23:18:58.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.806+0000 7f5b177fe640 1 -- 172.21.15.123:0/3702092502 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b1003c950 con 0x7f5b200b2d40 2024-09-15T23:18:58.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.806+0000 7f5b2483c640 1 -- 172.21.15.123:0/3702092502 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b200ca590 con 0x7f5b200b2d40 2024-09-15T23:18:58.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.806+0000 7f5b177fe640 1 -- 172.21.15.123:0/3702092502 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b10037040 con 0x7f5b200b2d40 2024-09-15T23:18:58.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.806+0000 7f5b2483c640 1 -- 172.21.15.123:0/3702092502 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b200cab50 con 0x7f5b200b2d40 2024-09-15T23:18:58.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.807+0000 7f5b2483c640 1 -- 172.21.15.123:0/3702092502 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b2015c180 con 0x7f5b200b2d40 2024-09-15T23:18:58.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.807+0000 7f5b177fe640 1 -- 172.21.15.123:0/3702092502 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5b10044070 con 0x7f5b200b2d40 2024-09-15T23:18:58.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.808+0000 7f5b177fe640 1 --2- 172.21.15.123:0/3702092502 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5b0006c2b0 0x7f5b0006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:58.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.808+0000 7f5b177fe640 1 -- 172.21.15.123:0/3702092502 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f5b100ac270 con 0x7f5b200b2d40 2024-09-15T23:18:58.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.808+0000 7f5b15d9b640 1 --2- 172.21.15.123:0/3702092502 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5b0006c2b0 0x7f5b0006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:58.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.808+0000 7f5b15d9b640 1 --2- 172.21.15.123:0/3702092502 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5b0006c2b0 0x7f5b0006e770 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f5b08006fd0 tx=0x7f5b08008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:58.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.812+0000 7f5b177fe640 1 -- 172.21.15.123:0/3702092502 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5b1007ab00 con 0x7f5b200b2d40 2024-09-15T23:18:58.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.975+0000 7f5b2483c640 1 -- 172.21.15.123:0/3702092502 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5b2006c9c0 con 0x7f5b0006c2b0 2024-09-15T23:18:58.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.981+0000 7f5b177fe640 1 -- 172.21.15.123:0/3702092502 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246419 (secure 0 0 0) 0x7f5b2006c9c0 con 0x7f5b0006c2b0 2024-09-15T23:18:58.985 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:18:58.986 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:18:58.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.984+0000 7f5b2483c640 1 -- 172.21.15.123:0/3702092502 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5b0006c2b0 msgr2=0x7f5b0006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:58.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.984+0000 7f5b2483c640 1 --2- 172.21.15.123:0/3702092502 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5b0006c2b0 0x7f5b0006e770 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f5b08006fd0 tx=0x7f5b08008040 comp rx=0 tx=0).stop 2024-09-15T23:18:58.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.984+0000 7f5b2483c640 1 -- 172.21.15.123:0/3702092502 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b200b2d40 msgr2=0x7f5b2013d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:58.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.984+0000 7f5b2483c640 1 --2- 172.21.15.123:0/3702092502 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b200b2d40 0x7f5b2013d0e0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f5b10000c00 tx=0x7f5b100046c0 comp rx=0 tx=0).stop 2024-09-15T23:18:58.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.984+0000 7f5b2483c640 1 -- 172.21.15.123:0/3702092502 shutdown_connections 2024-09-15T23:18:58.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.984+0000 7f5b2483c640 1 --2- 172.21.15.123:0/3702092502 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5b2015bcf0 0x7f5b200b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:58.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.984+0000 7f5b2483c640 1 --2- 172.21.15.123:0/3702092502 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5b2013eb20 0x7f5b200c97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:58.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.984+0000 7f5b2483c640 1 --2- 172.21.15.123:0/3702092502 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5b0006c2b0 0x7f5b0006e770 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:58.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.984+0000 7f5b2483c640 1 --2- 172.21.15.123:0/3702092502 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b200b2d40 0x7f5b2013d0e0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:58.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.984+0000 7f5b2483c640 1 -- 172.21.15.123:0/3702092502 >> 172.21.15.123:0/3702092502 conn(0x7f5b200ccec0 msgr2=0x7f5b2015b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:58.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.984+0000 7f5b2483c640 1 -- 172.21.15.123:0/3702092502 shutdown_connections 2024-09-15T23:18:58.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:58.984+0000 7f5b2483c640 1 -- 172.21.15.123:0/3702092502 wait complete. 2024-09-15T23:18:58.996 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":331,"stamp":"2024-09-15T23:18:57.600357+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592126,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":198,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":124,"acting":124,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":41,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":392132,"kb_used_data":13488,"kb_used_omap":12,"kb_used_meta":378419,"kb_avail":754582588,"statfs":{"total":773094113280,"available":772692570112,"internally_reserved":0,"allocated":13811712,"data_stored":6730271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":387501616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1758,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.215521"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.405875+0000","last_change":"2024-09-15T23:18:55.410755+0000","last_active":"2024-09-15T23:18:56.405875+0000","last_peered":"2024-09-15T23:18:56.405875+0000","last_clean":"2024-09-15T23:18:56.405875+0000","last_became_active":"2024-09-15T23:18:55.410175+0000","last_became_peered":"2024-09-15T23:18:55.410175+0000","last_unstale":"2024-09-15T23:18:56.405875+0000","last_undegraded":"2024-09-15T23:18:56.405875+0000","last_fullsized":"2024-09-15T23:18:56.405875+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:43:05.591911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.423840+0000","last_change":"2024-09-15T23:18:55.418935+0000","last_active":"2024-09-15T23:18:55.423840+0000","last_peered":"2024-09-15T23:18:55.423840+0000","last_clean":"2024-09-15T23:18:55.423840+0000","last_became_active":"2024-09-15T23:18:55.418679+0000","last_became_peered":"2024-09-15T23:18:55.418679+0000","last_unstale":"2024-09-15T23:18:55.423840+0000","last_undegraded":"2024-09-15T23:18:55.423840+0000","last_fullsized":"2024-09-15T23:18:55.423840+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:16.210045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.412239+0000","last_change":"2024-09-15T23:18:55.408374+0000","last_active":"2024-09-15T23:18:55.412239+0000","last_peered":"2024-09-15T23:18:55.412239+0000","last_clean":"2024-09-15T23:18:55.412239+0000","last_became_active":"2024-09-15T23:18:55.408101+0000","last_became_peered":"2024-09-15T23:18:55.408101+0000","last_unstale":"2024-09-15T23:18:55.412239+0000","last_undegraded":"2024-09-15T23:18:55.412239+0000","last_fullsized":"2024-09-15T23:18:55.412239+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:31.293761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.420498+0000","last_change":"2024-09-15T23:18:55.419260+0000","last_active":"2024-09-15T23:18:55.420498+0000","last_peered":"2024-09-15T23:18:55.420498+0000","last_clean":"2024-09-15T23:18:55.420498+0000","last_became_active":"2024-09-15T23:18:55.418943+0000","last_became_peered":"2024-09-15T23:18:55.418943+0000","last_unstale":"2024-09-15T23:18:55.420498+0000","last_undegraded":"2024-09-15T23:18:55.420498+0000","last_fullsized":"2024-09-15T23:18:55.420498+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:30.448015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406063+0000","last_change":"2024-09-15T23:18:55.421369+0000","last_active":"2024-09-15T23:18:56.406063+0000","last_peered":"2024-09-15T23:18:56.406063+0000","last_clean":"2024-09-15T23:18:56.406063+0000","last_became_active":"2024-09-15T23:18:55.421014+0000","last_became_peered":"2024-09-15T23:18:55.421014+0000","last_unstale":"2024-09-15T23:18:56.406063+0000","last_undegraded":"2024-09-15T23:18:56.406063+0000","last_fullsized":"2024-09-15T23:18:56.406063+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:50.969453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.407113+0000","last_change":"2024-09-15T23:18:55.403062+0000","last_active":"2024-09-15T23:18:55.407113+0000","last_peered":"2024-09-15T23:18:55.407113+0000","last_clean":"2024-09-15T23:18:55.407113+0000","last_became_active":"2024-09-15T23:18:55.402715+0000","last_became_peered":"2024-09-15T23:18:55.402715+0000","last_unstale":"2024-09-15T23:18:55.407113+0000","last_undegraded":"2024-09-15T23:18:55.407113+0000","last_fullsized":"2024-09-15T23:18:55.407113+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:56.087785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.406426+0000","last_change":"2024-09-15T23:18:55.402262+0000","last_active":"2024-09-15T23:18:55.406426+0000","last_peered":"2024-09-15T23:18:55.406426+0000","last_clean":"2024-09-15T23:18:55.406426+0000","last_became_active":"2024-09-15T23:18:55.401993+0000","last_became_peered":"2024-09-15T23:18:55.401993+0000","last_unstale":"2024-09-15T23:18:55.406426+0000","last_undegraded":"2024-09-15T23:18:55.406426+0000","last_fullsized":"2024-09-15T23:18:55.406426+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:24.833753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.405868+0000","last_change":"2024-09-15T23:18:55.405009+0000","last_active":"2024-09-15T23:18:56.405868+0000","last_peered":"2024-09-15T23:18:56.405868+0000","last_clean":"2024-09-15T23:18:56.405868+0000","last_became_active":"2024-09-15T23:18:55.404627+0000","last_became_peered":"2024-09-15T23:18:55.404627+0000","last_unstale":"2024-09-15T23:18:56.405868+0000","last_undegraded":"2024-09-15T23:18:56.405868+0000","last_fullsized":"2024-09-15T23:18:56.405868+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:46.431898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.410005+0000","last_change":"2024-09-15T23:18:55.408322+0000","last_active":"2024-09-15T23:18:55.410005+0000","last_peered":"2024-09-15T23:18:55.410005+0000","last_clean":"2024-09-15T23:18:55.410005+0000","last_became_active":"2024-09-15T23:18:55.407499+0000","last_became_peered":"2024-09-15T23:18:55.407499+0000","last_unstale":"2024-09-15T23:18:55.410005+0000","last_undegraded":"2024-09-15T23:18:55.410005+0000","last_fullsized":"2024-09-15T23:18:55.410005+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:57.755558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.407195+0000","last_change":"2024-09-15T23:18:55.404066+0000","last_active":"2024-09-15T23:18:55.407195+0000","last_peered":"2024-09-15T23:18:55.407195+0000","last_clean":"2024-09-15T23:18:55.407195+0000","last_became_active":"2024-09-15T23:18:55.403800+0000","last_became_peered":"2024-09-15T23:18:55.403800+0000","last_unstale":"2024-09-15T23:18:55.407195+0000","last_undegraded":"2024-09-15T23:18:55.407195+0000","last_fullsized":"2024-09-15T23:18:55.407195+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:47.101262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.423809+0000","last_change":"2024-09-15T23:18:55.419619+0000","last_active":"2024-09-15T23:18:55.423809+0000","last_peered":"2024-09-15T23:18:55.423809+0000","last_clean":"2024-09-15T23:18:55.423809+0000","last_became_active":"2024-09-15T23:18:55.419359+0000","last_became_peered":"2024-09-15T23:18:55.419359+0000","last_unstale":"2024-09-15T23:18:55.423809+0000","last_undegraded":"2024-09-15T23:18:55.423809+0000","last_fullsized":"2024-09-15T23:18:55.423809+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:34.236072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.405710+0000","last_change":"2024-09-15T23:18:55.404025+0000","last_active":"2024-09-15T23:18:55.405710+0000","last_peered":"2024-09-15T23:18:55.405710+0000","last_clean":"2024-09-15T23:18:55.405710+0000","last_became_active":"2024-09-15T23:18:55.403532+0000","last_became_peered":"2024-09-15T23:18:55.403532+0000","last_unstale":"2024-09-15T23:18:55.405710+0000","last_undegraded":"2024-09-15T23:18:55.405710+0000","last_fullsized":"2024-09-15T23:18:55.405710+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:42.065674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.423787+0000","last_change":"2024-09-15T23:18:55.418863+0000","last_active":"2024-09-15T23:18:55.423787+0000","last_peered":"2024-09-15T23:18:55.423787+0000","last_clean":"2024-09-15T23:18:55.423787+0000","last_became_active":"2024-09-15T23:18:55.418588+0000","last_became_peered":"2024-09-15T23:18:55.418588+0000","last_unstale":"2024-09-15T23:18:55.423787+0000","last_undegraded":"2024-09-15T23:18:55.423787+0000","last_fullsized":"2024-09-15T23:18:55.423787+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:22:10.355949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.423738+0000","last_change":"2024-09-15T23:18:55.422451+0000","last_active":"2024-09-15T23:18:55.423738+0000","last_peered":"2024-09-15T23:18:55.423738+0000","last_clean":"2024-09-15T23:18:55.423738+0000","last_became_active":"2024-09-15T23:18:55.422162+0000","last_became_peered":"2024-09-15T23:18:55.422162+0000","last_unstale":"2024-09-15T23:18:55.423738+0000","last_undegraded":"2024-09-15T23:18:55.423738+0000","last_fullsized":"2024-09-15T23:18:55.423738+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:51.072258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406192+0000","last_change":"2024-09-15T23:18:55.411065+0000","last_active":"2024-09-15T23:18:56.406192+0000","last_peered":"2024-09-15T23:18:56.406192+0000","last_clean":"2024-09-15T23:18:56.406192+0000","last_became_active":"2024-09-15T23:18:55.410332+0000","last_became_peered":"2024-09-15T23:18:55.410332+0000","last_unstale":"2024-09-15T23:18:56.406192+0000","last_undegraded":"2024-09-15T23:18:56.406192+0000","last_fullsized":"2024-09-15T23:18:56.406192+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:04.081907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.410028+0000","last_change":"2024-09-15T23:18:55.408913+0000","last_active":"2024-09-15T23:18:55.410028+0000","last_peered":"2024-09-15T23:18:55.410028+0000","last_clean":"2024-09-15T23:18:55.410028+0000","last_became_active":"2024-09-15T23:18:55.408565+0000","last_became_peered":"2024-09-15T23:18:55.408565+0000","last_unstale":"2024-09-15T23:18:55.410028+0000","last_undegraded":"2024-09-15T23:18:55.410028+0000","last_fullsized":"2024-09-15T23:18:55.410028+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:12:03.648318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406037+0000","last_change":"2024-09-15T23:18:55.417434+0000","last_active":"2024-09-15T23:18:56.406037+0000","last_peered":"2024-09-15T23:18:56.406037+0000","last_clean":"2024-09-15T23:18:56.406037+0000","last_became_active":"2024-09-15T23:18:55.416979+0000","last_became_peered":"2024-09-15T23:18:55.416979+0000","last_unstale":"2024-09-15T23:18:56.406037+0000","last_undegraded":"2024-09-15T23:18:56.406037+0000","last_fullsized":"2024-09-15T23:18:56.406037+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:15.124012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-15T23:18:53.385151+0000","last_change":"2024-09-15T23:18:53.385151+0000","last_active":"2024-09-15T23:18:53.378158+0000","last_peered":"2024-09-15T23:18:53.378158+0000","last_clean":"2024-09-15T23:18:53.378158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:53.385151+0000","last_undegraded":"2024-09-15T23:18:53.385151+0000","last_fullsized":"2024-09-15T23:18:53.385151+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-15T23:18:53.386472+0000","last_change":"2024-09-15T23:18:53.386472+0000","last_active":"2024-09-15T23:18:53.378158+0000","last_peered":"2024-09-15T23:18:53.378158+0000","last_clean":"2024-09-15T23:18:53.378158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:53.386472+0000","last_undegraded":"2024-09-15T23:18:53.386472+0000","last_fullsized":"2024-09-15T23:18:53.386472+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.411110+0000","last_change":"2024-09-15T23:18:55.409732+0000","last_active":"2024-09-15T23:18:55.411110+0000","last_peered":"2024-09-15T23:18:55.411110+0000","last_clean":"2024-09-15T23:18:55.411110+0000","last_became_active":"2024-09-15T23:18:55.409301+0000","last_became_peered":"2024-09-15T23:18:55.409301+0000","last_unstale":"2024-09-15T23:18:55.411110+0000","last_undegraded":"2024-09-15T23:18:55.411110+0000","last_fullsized":"2024-09-15T23:18:55.411110+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:44.191737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1d","version":"129'2","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.422022+0000","last_change":"2024-09-15T23:18:54.406925+0000","last_active":"2024-09-15T23:18:55.422022+0000","last_peered":"2024-09-15T23:18:55.422022+0000","last_clean":"2024-09-15T23:18:55.422022+0000","last_became_active":"2024-09-15T23:18:54.406584+0000","last_became_peered":"2024-09-15T23:18:54.406584+0000","last_unstale":"2024-09-15T23:18:55.422022+0000","last_undegraded":"2024-09-15T23:18:55.422022+0000","last_fullsized":"2024-09-15T23:18:55.422022+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:41.060616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"129'2","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.422084+0000","last_change":"2024-09-15T23:18:54.407600+0000","last_active":"2024-09-15T23:18:55.422084+0000","last_peered":"2024-09-15T23:18:55.422084+0000","last_clean":"2024-09-15T23:18:55.422084+0000","last_became_active":"2024-09-15T23:18:54.407279+0000","last_became_peered":"2024-09-15T23:18:54.407279+0000","last_unstale":"2024-09-15T23:18:55.422084+0000","last_undegraded":"2024-09-15T23:18:55.422084+0000","last_fullsized":"2024-09-15T23:18:55.422084+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:43.186680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.422056+0000","last_change":"2024-09-15T23:18:55.417579+0000","last_active":"2024-09-15T23:18:55.422056+0000","last_peered":"2024-09-15T23:18:55.422056+0000","last_clean":"2024-09-15T23:18:55.422056+0000","last_became_active":"2024-09-15T23:18:55.417302+0000","last_became_peered":"2024-09-15T23:18:55.417302+0000","last_unstale":"2024-09-15T23:18:55.422056+0000","last_undegraded":"2024-09-15T23:18:55.422056+0000","last_fullsized":"2024-09-15T23:18:55.422056+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:48:22.001477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-15T23:18:53.388074+0000","last_change":"2024-09-15T23:18:53.388074+0000","last_active":"2024-09-15T23:18:53.378158+0000","last_peered":"2024-09-15T23:18:53.378158+0000","last_clean":"2024-09-15T23:18:53.378158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:53.388074+0000","last_undegraded":"2024-09-15T23:18:53.388074+0000","last_fullsized":"2024-09-15T23:18:53.388074+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"129'1","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.405710+0000","last_change":"2024-09-15T23:18:54.398393+0000","last_active":"2024-09-15T23:18:56.405710+0000","last_peered":"2024-09-15T23:18:56.405710+0000","last_clean":"2024-09-15T23:18:56.405710+0000","last_became_active":"2024-09-15T23:18:54.398134+0000","last_became_peered":"2024-09-15T23:18:54.398134+0000","last_unstale":"2024-09-15T23:18:56.405710+0000","last_undegraded":"2024-09-15T23:18:56.405710+0000","last_fullsized":"2024-09-15T23:18:56.405710+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:15.886461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.421409+0000","last_change":"2024-09-15T23:18:55.420328+0000","last_active":"2024-09-15T23:18:55.421409+0000","last_peered":"2024-09-15T23:18:55.421409+0000","last_clean":"2024-09-15T23:18:55.421409+0000","last_became_active":"2024-09-15T23:18:55.420023+0000","last_became_peered":"2024-09-15T23:18:55.420023+0000","last_unstale":"2024-09-15T23:18:55.421409+0000","last_undegraded":"2024-09-15T23:18:55.421409+0000","last_fullsized":"2024-09-15T23:18:55.421409+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:21.016141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:53.378158+0000","last_change":"2024-09-15T23:18:53.378158+0000","last_active":"2024-09-15T23:18:53.378158+0000","last_peered":"2024-09-15T23:18:53.378158+0000","last_clean":"2024-09-15T23:18:53.378158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:53.378158+0000","last_undegraded":"2024-09-15T23:18:53.378158+0000","last_fullsized":"2024-09-15T23:18:53.378158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.397832+0000","last_change":"2024-09-15T23:18:54.408733+0000","last_active":"2024-09-15T23:18:55.397832+0000","last_peered":"2024-09-15T23:18:55.397832+0000","last_clean":"2024-09-15T23:18:55.397832+0000","last_became_active":"2024-09-15T23:18:54.408453+0000","last_became_peered":"2024-09-15T23:18:54.408453+0000","last_unstale":"2024-09-15T23:18:55.397832+0000","last_undegraded":"2024-09-15T23:18:55.397832+0000","last_fullsized":"2024-09-15T23:18:55.397832+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:19:18.665458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.400530+0000","last_change":"2024-09-15T23:18:54.409517+0000","last_active":"2024-09-15T23:18:55.400530+0000","last_peered":"2024-09-15T23:18:55.400530+0000","last_clean":"2024-09-15T23:18:55.400530+0000","last_became_active":"2024-09-15T23:18:54.409082+0000","last_became_peered":"2024-09-15T23:18:54.409082+0000","last_unstale":"2024-09-15T23:18:55.400530+0000","last_undegraded":"2024-09-15T23:18:55.400530+0000","last_fullsized":"2024-09-15T23:18:55.400530+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:41:08.697739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.397924+0000","last_change":"2024-09-15T23:18:54.401049+0000","last_active":"2024-09-15T23:18:55.397924+0000","last_peered":"2024-09-15T23:18:55.397924+0000","last_clean":"2024-09-15T23:18:55.397924+0000","last_became_active":"2024-09-15T23:18:54.400776+0000","last_became_peered":"2024-09-15T23:18:54.400776+0000","last_unstale":"2024-09-15T23:18:55.397924+0000","last_undegraded":"2024-09-15T23:18:55.397924+0000","last_fullsized":"2024-09-15T23:18:55.397924+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:31.412905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.405676+0000","last_change":"2024-09-15T23:18:55.403705+0000","last_active":"2024-09-15T23:18:55.405676+0000","last_peered":"2024-09-15T23:18:55.405676+0000","last_clean":"2024-09-15T23:18:55.405676+0000","last_became_active":"2024-09-15T23:18:55.403391+0000","last_became_peered":"2024-09-15T23:18:55.403391+0000","last_unstale":"2024-09-15T23:18:55.405676+0000","last_undegraded":"2024-09-15T23:18:55.405676+0000","last_fullsized":"2024-09-15T23:18:55.405676+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:19.216199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"129'3","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.422572+0000","last_change":"2024-09-15T23:18:54.404045+0000","last_active":"2024-09-15T23:18:55.422572+0000","last_peered":"2024-09-15T23:18:55.422572+0000","last_clean":"2024-09-15T23:18:55.422572+0000","last_became_active":"2024-09-15T23:18:54.403773+0000","last_became_peered":"2024-09-15T23:18:54.403773+0000","last_unstale":"2024-09-15T23:18:55.422572+0000","last_undegraded":"2024-09-15T23:18:55.422572+0000","last_fullsized":"2024-09-15T23:18:55.422572+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:02:31.113880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"129'6","reported_seq":18,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.425154+0000","last_change":"2024-09-15T23:18:54.407446+0000","last_active":"2024-09-15T23:18:55.425154+0000","last_peered":"2024-09-15T23:18:55.425154+0000","last_clean":"2024-09-15T23:18:55.425154+0000","last_became_active":"2024-09-15T23:18:54.407141+0000","last_became_peered":"2024-09-15T23:18:54.407141+0000","last_unstale":"2024-09-15T23:18:55.425154+0000","last_undegraded":"2024-09-15T23:18:55.425154+0000","last_fullsized":"2024-09-15T23:18:55.425154+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:29.442958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.409717+0000","last_change":"2024-09-15T23:18:55.407912+0000","last_active":"2024-09-15T23:18:55.409717+0000","last_peered":"2024-09-15T23:18:55.409717+0000","last_clean":"2024-09-15T23:18:55.409717+0000","last_became_active":"2024-09-15T23:18:55.407554+0000","last_became_peered":"2024-09-15T23:18:55.407554+0000","last_unstale":"2024-09-15T23:18:55.409717+0000","last_undegraded":"2024-09-15T23:18:55.409717+0000","last_fullsized":"2024-09-15T23:18:55.409717+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:45:08.058331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"129'2","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.419017+0000","last_change":"2024-09-15T23:18:54.402978+0000","last_active":"2024-09-15T23:18:55.419017+0000","last_peered":"2024-09-15T23:18:55.419017+0000","last_clean":"2024-09-15T23:18:55.419017+0000","last_became_active":"2024-09-15T23:18:54.401842+0000","last_became_peered":"2024-09-15T23:18:54.401842+0000","last_unstale":"2024-09-15T23:18:55.419017+0000","last_undegraded":"2024-09-15T23:18:55.419017+0000","last_fullsized":"2024-09-15T23:18:55.419017+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:33.884558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.423768+0000","last_change":"2024-09-15T23:18:55.418699+0000","last_active":"2024-09-15T23:18:55.423768+0000","last_peered":"2024-09-15T23:18:55.423768+0000","last_clean":"2024-09-15T23:18:55.423768+0000","last_became_active":"2024-09-15T23:18:55.418360+0000","last_became_peered":"2024-09-15T23:18:55.418360+0000","last_unstale":"2024-09-15T23:18:55.423768+0000","last_undegraded":"2024-09-15T23:18:55.423768+0000","last_fullsized":"2024-09-15T23:18:55.423768+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:42:21.996440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-15T23:18:53.388068+0000","last_change":"2024-09-15T23:18:53.388068+0000","last_active":"2024-09-15T23:18:53.378158+0000","last_peered":"2024-09-15T23:18:53.378158+0000","last_clean":"2024-09-15T23:18:53.378158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:53.388068+0000","last_undegraded":"2024-09-15T23:18:53.388068+0000","last_fullsized":"2024-09-15T23:18:53.388068+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.421672+0000","last_change":"2024-09-15T23:18:55.414604+0000","last_active":"2024-09-15T23:18:55.421672+0000","last_peered":"2024-09-15T23:18:55.421672+0000","last_clean":"2024-09-15T23:18:55.421672+0000","last_became_active":"2024-09-15T23:18:55.414206+0000","last_became_peered":"2024-09-15T23:18:55.414206+0000","last_unstale":"2024-09-15T23:18:55.421672+0000","last_undegraded":"2024-09-15T23:18:55.421672+0000","last_fullsized":"2024-09-15T23:18:55.421672+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:51.072258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"129'8","reported_seq":22,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.405970+0000","last_change":"2024-09-15T23:18:54.396324+0000","last_active":"2024-09-15T23:18:56.405970+0000","last_peered":"2024-09-15T23:18:56.405970+0000","last_clean":"2024-09-15T23:18:56.405970+0000","last_became_active":"2024-09-15T23:18:54.395912+0000","last_became_peered":"2024-09-15T23:18:54.395912+0000","last_unstale":"2024-09-15T23:18:56.405970+0000","last_undegraded":"2024-09-15T23:18:56.405970+0000","last_fullsized":"2024-09-15T23:18:56.405970+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:40.585024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406206+0000","last_change":"2024-09-15T23:18:55.407625+0000","last_active":"2024-09-15T23:18:56.406206+0000","last_peered":"2024-09-15T23:18:56.406206+0000","last_clean":"2024-09-15T23:18:56.406206+0000","last_became_active":"2024-09-15T23:18:55.407035+0000","last_became_peered":"2024-09-15T23:18:55.407035+0000","last_unstale":"2024-09-15T23:18:56.406206+0000","last_undegraded":"2024-09-15T23:18:56.406206+0000","last_fullsized":"2024-09-15T23:18:56.406206+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:24.712832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.f","version":"129'1","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.407973+0000","last_change":"2024-09-15T23:18:54.408656+0000","last_active":"2024-09-15T23:18:55.407973+0000","last_peered":"2024-09-15T23:18:55.407973+0000","last_clean":"2024-09-15T23:18:55.407973+0000","last_became_active":"2024-09-15T23:18:54.408298+0000","last_became_peered":"2024-09-15T23:18:54.408298+0000","last_unstale":"2024-09-15T23:18:55.407973+0000","last_undegraded":"2024-09-15T23:18:55.407973+0000","last_fullsized":"2024-09-15T23:18:55.407973+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:41:08.697739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406051+0000","last_change":"2024-09-15T23:18:55.420952+0000","last_active":"2024-09-15T23:18:56.406051+0000","last_peered":"2024-09-15T23:18:56.406051+0000","last_clean":"2024-09-15T23:18:56.406051+0000","last_became_active":"2024-09-15T23:18:55.420608+0000","last_became_peered":"2024-09-15T23:18:55.420608+0000","last_unstale":"2024-09-15T23:18:56.406051+0000","last_undegraded":"2024-09-15T23:18:56.406051+0000","last_fullsized":"2024-09-15T23:18:56.406051+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:05.126336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"129'2","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.418055+0000","last_change":"2024-09-15T23:18:54.399080+0000","last_active":"2024-09-15T23:18:55.418055+0000","last_peered":"2024-09-15T23:18:55.418055+0000","last_clean":"2024-09-15T23:18:55.418055+0000","last_became_active":"2024-09-15T23:18:54.398761+0000","last_became_peered":"2024-09-15T23:18:54.398761+0000","last_unstale":"2024-09-15T23:18:55.418055+0000","last_undegraded":"2024-09-15T23:18:55.418055+0000","last_fullsized":"2024-09-15T23:18:55.418055+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:15:19.613132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-15T23:18:53.385105+0000","last_change":"2024-09-15T23:18:53.385105+0000","last_active":"2024-09-15T23:18:53.378158+0000","last_peered":"2024-09-15T23:18:53.378158+0000","last_clean":"2024-09-15T23:18:53.378158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:53.385105+0000","last_undegraded":"2024-09-15T23:18:53.385105+0000","last_fullsized":"2024-09-15T23:18:53.385105+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-15T23:18:53.385148+0000","last_change":"2024-09-15T23:18:53.385148+0000","last_active":"2024-09-15T23:18:53.378158+0000","last_peered":"2024-09-15T23:18:53.378158+0000","last_clean":"2024-09-15T23:18:53.378158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:53.385148+0000","last_undegraded":"2024-09-15T23:18:53.385148+0000","last_fullsized":"2024-09-15T23:18:53.385148+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"129'2","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.418282+0000","last_change":"2024-09-15T23:18:54.403225+0000","last_active":"2024-09-15T23:18:55.418282+0000","last_peered":"2024-09-15T23:18:55.418282+0000","last_clean":"2024-09-15T23:18:55.418282+0000","last_became_active":"2024-09-15T23:18:54.402587+0000","last_became_peered":"2024-09-15T23:18:54.402587+0000","last_unstale":"2024-09-15T23:18:55.418282+0000","last_undegraded":"2024-09-15T23:18:55.418282+0000","last_fullsized":"2024-09-15T23:18:55.418282+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:49.966929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.405777+0000","last_change":"2024-09-15T23:18:55.403788+0000","last_active":"2024-09-15T23:18:56.405777+0000","last_peered":"2024-09-15T23:18:56.405777+0000","last_clean":"2024-09-15T23:18:56.405777+0000","last_became_active":"2024-09-15T23:18:55.402873+0000","last_became_peered":"2024-09-15T23:18:55.402873+0000","last_unstale":"2024-09-15T23:18:56.405777+0000","last_undegraded":"2024-09-15T23:18:56.405777+0000","last_fullsized":"2024-09-15T23:18:56.405777+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:48.439573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.405920+0000","last_change":"2024-09-15T23:18:54.404950+0000","last_active":"2024-09-15T23:18:56.405920+0000","last_peered":"2024-09-15T23:18:56.405920+0000","last_clean":"2024-09-15T23:18:56.405920+0000","last_became_active":"2024-09-15T23:18:54.404532+0000","last_became_peered":"2024-09-15T23:18:54.404532+0000","last_unstale":"2024-09-15T23:18:56.405920+0000","last_undegraded":"2024-09-15T23:18:56.405920+0000","last_fullsized":"2024-09-15T23:18:56.405920+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:51:30.132064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.400203+0000","last_change":"2024-09-15T23:18:54.405325+0000","last_active":"2024-09-15T23:18:55.400203+0000","last_peered":"2024-09-15T23:18:55.400203+0000","last_clean":"2024-09-15T23:18:55.400203+0000","last_became_active":"2024-09-15T23:18:54.405043+0000","last_became_peered":"2024-09-15T23:18:54.405043+0000","last_unstale":"2024-09-15T23:18:55.400203+0000","last_undegraded":"2024-09-15T23:18:55.400203+0000","last_fullsized":"2024-09-15T23:18:55.400203+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:38:39.917102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.421103+0000","last_change":"2024-09-15T23:18:55.420197+0000","last_active":"2024-09-15T23:18:55.421103+0000","last_peered":"2024-09-15T23:18:55.421103+0000","last_clean":"2024-09-15T23:18:55.421103+0000","last_became_active":"2024-09-15T23:18:55.419859+0000","last_became_peered":"2024-09-15T23:18:55.419859+0000","last_unstale":"2024-09-15T23:18:55.421103+0000","last_undegraded":"2024-09-15T23:18:55.421103+0000","last_fullsized":"2024-09-15T23:18:55.421103+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:08.549835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.411690+0000","last_change":"2024-09-15T23:18:54.402999+0000","last_active":"2024-09-15T23:18:55.411690+0000","last_peered":"2024-09-15T23:18:55.411690+0000","last_clean":"2024-09-15T23:18:55.411690+0000","last_became_active":"2024-09-15T23:18:54.402530+0000","last_became_peered":"2024-09-15T23:18:54.402530+0000","last_unstale":"2024-09-15T23:18:55.411690+0000","last_undegraded":"2024-09-15T23:18:55.411690+0000","last_fullsized":"2024-09-15T23:18:55.411690+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:31.992688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"129'2","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.422002+0000","last_change":"2024-09-15T23:18:54.409345+0000","last_active":"2024-09-15T23:18:55.422002+0000","last_peered":"2024-09-15T23:18:55.422002+0000","last_clean":"2024-09-15T23:18:55.422002+0000","last_became_active":"2024-09-15T23:18:54.408730+0000","last_became_peered":"2024-09-15T23:18:54.408730+0000","last_unstale":"2024-09-15T23:18:55.422002+0000","last_undegraded":"2024-09-15T23:18:55.422002+0000","last_fullsized":"2024-09-15T23:18:55.422002+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:18.211142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.407857+0000","last_change":"2024-09-15T23:18:55.404465+0000","last_active":"2024-09-15T23:18:55.407857+0000","last_peered":"2024-09-15T23:18:55.407857+0000","last_clean":"2024-09-15T23:18:55.407857+0000","last_became_active":"2024-09-15T23:18:55.404184+0000","last_became_peered":"2024-09-15T23:18:55.404184+0000","last_unstale":"2024-09-15T23:18:55.407857+0000","last_undegraded":"2024-09-15T23:18:55.407857+0000","last_fullsized":"2024-09-15T23:18:55.407857+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:32.997745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:53.378158+0000","last_change":"2024-09-15T23:18:53.378158+0000","last_active":"2024-09-15T23:18:53.378158+0000","last_peered":"2024-09-15T23:18:53.378158+0000","last_clean":"2024-09-15T23:18:53.378158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:53.378158+0000","last_undegraded":"2024-09-15T23:18:53.378158+0000","last_fullsized":"2024-09-15T23:18:53.378158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406272+0000","last_change":"2024-09-15T23:18:55.413671+0000","last_active":"2024-09-15T23:18:56.406272+0000","last_peered":"2024-09-15T23:18:56.406272+0000","last_clean":"2024-09-15T23:18:56.406272+0000","last_became_active":"2024-09-15T23:18:55.413294+0000","last_became_peered":"2024-09-15T23:18:55.413294+0000","last_unstale":"2024-09-15T23:18:56.406272+0000","last_undegraded":"2024-09-15T23:18:56.406272+0000","last_fullsized":"2024-09-15T23:18:56.406272+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:20:38.130031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.410790+0000","last_change":"2024-09-15T23:18:54.402343+0000","last_active":"2024-09-15T23:18:55.410790+0000","last_peered":"2024-09-15T23:18:55.410790+0000","last_clean":"2024-09-15T23:18:55.410790+0000","last_became_active":"2024-09-15T23:18:54.402023+0000","last_became_peered":"2024-09-15T23:18:54.402023+0000","last_unstale":"2024-09-15T23:18:55.410790+0000","last_undegraded":"2024-09-15T23:18:55.410790+0000","last_fullsized":"2024-09-15T23:18:55.410790+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:46.096205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.413800+0000","last_change":"2024-09-15T23:18:54.409421+0000","last_active":"2024-09-15T23:18:55.413800+0000","last_peered":"2024-09-15T23:18:55.413800+0000","last_clean":"2024-09-15T23:18:55.413800+0000","last_became_active":"2024-09-15T23:18:54.409046+0000","last_became_peered":"2024-09-15T23:18:54.409046+0000","last_unstale":"2024-09-15T23:18:55.413800+0000","last_undegraded":"2024-09-15T23:18:55.413800+0000","last_fullsized":"2024-09-15T23:18:55.413800+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:22.012773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:53.378158+0000","last_change":"2024-09-15T23:18:53.378158+0000","last_active":"2024-09-15T23:18:53.378158+0000","last_peered":"2024-09-15T23:18:53.378158+0000","last_clean":"2024-09-15T23:18:53.378158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:53.378158+0000","last_undegraded":"2024-09-15T23:18:53.378158+0000","last_fullsized":"2024-09-15T23:18:53.378158+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-15T23:18:53.385160+0000","last_change":"2024-09-15T23:18:53.385160+0000","last_active":"2024-09-15T23:18:53.378158+0000","last_peered":"2024-09-15T23:18:53.378158+0000","last_clean":"2024-09-15T23:18:53.378158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:53.385160+0000","last_undegraded":"2024-09-15T23:18:53.385160+0000","last_fullsized":"2024-09-15T23:18:53.385160+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:18:54.383215+0000","last_change":"2024-09-15T23:18:54.383215+0000","last_active":"2024-09-15T23:18:54.383215+0000","last_peered":"2024-09-15T23:18:54.383215+0000","last_clean":"2024-09-15T23:18:54.383215+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:54.383215+0000","last_undegraded":"2024-09-15T23:18:54.383215+0000","last_fullsized":"2024-09-15T23:18:54.383215+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406194+0000","last_change":"2024-09-15T23:18:54.399228+0000","last_active":"2024-09-15T23:18:56.406194+0000","last_peered":"2024-09-15T23:18:56.406194+0000","last_clean":"2024-09-15T23:18:56.406194+0000","last_became_active":"2024-09-15T23:18:54.398231+0000","last_became_peered":"2024-09-15T23:18:54.398231+0000","last_unstale":"2024-09-15T23:18:56.406194+0000","last_undegraded":"2024-09-15T23:18:56.406194+0000","last_fullsized":"2024-09-15T23:18:56.406194+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:17.495549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.413353+0000","last_change":"2024-09-15T23:18:55.412629+0000","last_active":"2024-09-15T23:18:55.413353+0000","last_peered":"2024-09-15T23:18:55.413353+0000","last_clean":"2024-09-15T23:18:55.413353+0000","last_became_active":"2024-09-15T23:18:55.411135+0000","last_became_peered":"2024-09-15T23:18:55.411135+0000","last_unstale":"2024-09-15T23:18:55.413353+0000","last_undegraded":"2024-09-15T23:18:55.413353+0000","last_fullsized":"2024-09-15T23:18:55.413353+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:23.017830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.397678+0000","last_change":"2024-09-15T23:18:54.408515+0000","last_active":"2024-09-15T23:18:55.397678+0000","last_peered":"2024-09-15T23:18:55.397678+0000","last_clean":"2024-09-15T23:18:55.397678+0000","last_became_active":"2024-09-15T23:18:54.408246+0000","last_became_peered":"2024-09-15T23:18:54.408246+0000","last_unstale":"2024-09-15T23:18:55.397678+0000","last_undegraded":"2024-09-15T23:18:55.397678+0000","last_fullsized":"2024-09-15T23:18:55.397678+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:38:39.917102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.423628+0000","last_change":"2024-09-15T23:18:55.418483+0000","last_active":"2024-09-15T23:18:55.423628+0000","last_peered":"2024-09-15T23:18:55.423628+0000","last_clean":"2024-09-15T23:18:55.423628+0000","last_became_active":"2024-09-15T23:18:55.418114+0000","last_became_peered":"2024-09-15T23:18:55.418114+0000","last_unstale":"2024-09-15T23:18:55.423628+0000","last_undegraded":"2024-09-15T23:18:55.423628+0000","last_fullsized":"2024-09-15T23:18:55.423628+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:03:26.735040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2024-09-15T23:18:53.386469+0000","last_change":"2024-09-15T23:18:53.386469+0000","last_active":"2024-09-15T23:18:53.378158+0000","last_peered":"2024-09-15T23:18:53.378158+0000","last_clean":"2024-09-15T23:18:53.378158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:18:53.386469+0000","last_undegraded":"2024-09-15T23:18:53.386469+0000","last_fullsized":"2024-09-15T23:18:53.386469+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":363,"reported_epoch":127,"state":"active+clean","last_fresh":"2024-09-15T23:18:53.388370+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:18:53.388370+0000","last_peered":"2024-09-15T23:18:53.388370+0000","last_clean":"2024-09-15T23:18:53.388370+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:18:53.388370+0000","last_undegraded":"2024-09-15T23:18:53.388370+0000","last_fullsized":"2024-09-15T23:18:53.388370+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":1758,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":58,"acting":58,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476824,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50760,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321080,"statfs":{"total":96636764160,"available":96584785920,"internally_reserved":0,"allocated":1552384,"data_stored":683090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476821,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46616,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325224,"statfs":{"total":96636764160,"available":96589029376,"internally_reserved":0,"allocated":1564672,"data_stored":688907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476823,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63816,"kb_used_data":2096,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94308024,"statfs":{"total":96636764160,"available":96571416576,"internally_reserved":0,"allocated":2146304,"data_stored":1273458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476823,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41036,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330804,"statfs":{"total":96636764160,"available":96594743296,"internally_reserved":0,"allocated":1552384,"data_stored":683090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542230,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41080,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330760,"statfs":{"total":96636764160,"available":96594698240,"internally_reserved":0,"allocated":1609728,"data_stored":703693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542230,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46636,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325204,"statfs":{"total":96636764160,"available":96589008896,"internally_reserved":0,"allocated":1589248,"data_stored":701957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542229,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51380,"kb_used_data":2140,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320460,"statfs":{"total":96636764160,"available":96584151040,"internally_reserved":0,"allocated":2191360,"data_stored":1292417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542231,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50808,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321032,"statfs":{"total":96636764160,"available":96584736768,"internally_reserved":0,"allocated":1605632,"data_stored":703659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:18:59.000 INFO:tasks.ceph.ceph_manager.ceph:PG 17.3e is not active+clean 2024-09-15T23:18:59.000 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:18:54.383215+0000', 'last_change': '2024-09-15T23:18:54.383215+0000', 'last_active': '2024-09-15T23:18:54.383215+0000', 'last_peered': '2024-09-15T23:18:54.383215+0000', 'last_clean': '2024-09-15T23:18:54.383215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:54.383215+0000', 'last_undegraded': '2024-09-15T23:18:54.383215+0000', 'last_fullsized': '2024-09-15T23:18:54.383215+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:18:59.000 INFO:tasks.ceph.ceph_manager.ceph:PG 17.3d is not active+clean 2024-09-15T23:18:59.000 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:18:54.383215+0000', 'last_change': '2024-09-15T23:18:54.383215+0000', 'last_active': '2024-09-15T23:18:54.383215+0000', 'last_peered': '2024-09-15T23:18:54.383215+0000', 'last_clean': '2024-09-15T23:18:54.383215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:54.383215+0000', 'last_undegraded': '2024-09-15T23:18:54.383215+0000', 'last_fullsized': '2024-09-15T23:18:54.383215+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:18:59.000 INFO:tasks.ceph.ceph_manager.ceph:PG 17.39 is not active+clean 2024-09-15T23:18:59.000 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:18:54.383215+0000', 'last_change': '2024-09-15T23:18:54.383215+0000', 'last_active': '2024-09-15T23:18:54.383215+0000', 'last_peered': '2024-09-15T23:18:54.383215+0000', 'last_clean': '2024-09-15T23:18:54.383215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:54.383215+0000', 'last_undegraded': '2024-09-15T23:18:54.383215+0000', 'last_fullsized': '2024-09-15T23:18:54.383215+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:18:59.001 INFO:tasks.ceph.ceph_manager.ceph:PG 17.38 is not active+clean 2024-09-15T23:18:59.001 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:18:54.383215+0000', 'last_change': '2024-09-15T23:18:54.383215+0000', 'last_active': '2024-09-15T23:18:54.383215+0000', 'last_peered': '2024-09-15T23:18:54.383215+0000', 'last_clean': '2024-09-15T23:18:54.383215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:54.383215+0000', 'last_undegraded': '2024-09-15T23:18:54.383215+0000', 'last_fullsized': '2024-09-15T23:18:54.383215+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:18:59.001 INFO:tasks.ceph.ceph_manager.ceph:PG 17.35 is not active+clean 2024-09-15T23:18:59.001 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:18:54.383215+0000', 'last_change': '2024-09-15T23:18:54.383215+0000', 'last_active': '2024-09-15T23:18:54.383215+0000', 'last_peered': '2024-09-15T23:18:54.383215+0000', 'last_clean': '2024-09-15T23:18:54.383215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:54.383215+0000', 'last_undegraded': '2024-09-15T23:18:54.383215+0000', 'last_fullsized': '2024-09-15T23:18:54.383215+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:18:59.001 INFO:tasks.ceph.ceph_manager.ceph:PG 17.33 is not active+clean 2024-09-15T23:18:59.001 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:18:54.383215+0000', 'last_change': '2024-09-15T23:18:54.383215+0000', 'last_active': '2024-09-15T23:18:54.383215+0000', 'last_peered': '2024-09-15T23:18:54.383215+0000', 'last_clean': '2024-09-15T23:18:54.383215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:54.383215+0000', 'last_undegraded': '2024-09-15T23:18:54.383215+0000', 'last_fullsized': '2024-09-15T23:18:54.383215+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:18:59.001 INFO:tasks.ceph.ceph_manager.ceph:PG 17.32 is not active+clean 2024-09-15T23:18:59.001 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:18:54.383215+0000', 'last_change': '2024-09-15T23:18:54.383215+0000', 'last_active': '2024-09-15T23:18:54.383215+0000', 'last_peered': '2024-09-15T23:18:54.383215+0000', 'last_clean': '2024-09-15T23:18:54.383215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:54.383215+0000', 'last_undegraded': '2024-09-15T23:18:54.383215+0000', 'last_fullsized': '2024-09-15T23:18:54.383215+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:18:59.001 INFO:tasks.ceph.ceph_manager.ceph:PG 17.2f is not active+clean 2024-09-15T23:18:59.001 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:18:54.383215+0000', 'last_change': '2024-09-15T23:18:54.383215+0000', 'last_active': '2024-09-15T23:18:54.383215+0000', 'last_peered': '2024-09-15T23:18:54.383215+0000', 'last_clean': '2024-09-15T23:18:54.383215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:54.383215+0000', 'last_undegraded': '2024-09-15T23:18:54.383215+0000', 'last_fullsized': '2024-09-15T23:18:54.383215+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:18:59.002 INFO:tasks.ceph.ceph_manager.ceph:PG 17.2e is not active+clean 2024-09-15T23:18:59.002 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:18:54.383215+0000', 'last_change': '2024-09-15T23:18:54.383215+0000', 'last_active': '2024-09-15T23:18:54.383215+0000', 'last_peered': '2024-09-15T23:18:54.383215+0000', 'last_clean': '2024-09-15T23:18:54.383215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:54.383215+0000', 'last_undegraded': '2024-09-15T23:18:54.383215+0000', 'last_fullsized': '2024-09-15T23:18:54.383215+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:18:59.002 INFO:tasks.ceph.ceph_manager.ceph:PG 17.2d is not active+clean 2024-09-15T23:18:59.002 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:18:54.383215+0000', 'last_change': '2024-09-15T23:18:54.383215+0000', 'last_active': '2024-09-15T23:18:54.383215+0000', 'last_peered': '2024-09-15T23:18:54.383215+0000', 'last_clean': '2024-09-15T23:18:54.383215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:54.383215+0000', 'last_undegraded': '2024-09-15T23:18:54.383215+0000', 'last_fullsized': '2024-09-15T23:18:54.383215+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:18:59.002 INFO:tasks.ceph.ceph_manager.ceph:PG 17.2c is not active+clean 2024-09-15T23:18:59.002 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:18:54.383215+0000', 'last_change': '2024-09-15T23:18:54.383215+0000', 'last_active': '2024-09-15T23:18:54.383215+0000', 'last_peered': '2024-09-15T23:18:54.383215+0000', 'last_clean': '2024-09-15T23:18:54.383215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:54.383215+0000', 'last_undegraded': '2024-09-15T23:18:54.383215+0000', 'last_fullsized': '2024-09-15T23:18:54.383215+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:18:59.002 INFO:tasks.ceph.ceph_manager.ceph:PG 17.2b is not active+clean 2024-09-15T23:18:59.002 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:18:54.383215+0000', 'last_change': '2024-09-15T23:18:54.383215+0000', 'last_active': '2024-09-15T23:18:54.383215+0000', 'last_peered': '2024-09-15T23:18:54.383215+0000', 'last_clean': '2024-09-15T23:18:54.383215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:54.383215+0000', 'last_undegraded': '2024-09-15T23:18:54.383215+0000', 'last_fullsized': '2024-09-15T23:18:54.383215+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:18:59.002 INFO:tasks.ceph.ceph_manager.ceph:PG 17.29 is not active+clean 2024-09-15T23:18:59.002 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:18:54.383215+0000', 'last_change': '2024-09-15T23:18:54.383215+0000', 'last_active': '2024-09-15T23:18:54.383215+0000', 'last_peered': '2024-09-15T23:18:54.383215+0000', 'last_clean': '2024-09-15T23:18:54.383215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:54.383215+0000', 'last_undegraded': '2024-09-15T23:18:54.383215+0000', 'last_fullsized': '2024-09-15T23:18:54.383215+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:18:59.003 INFO:tasks.ceph.ceph_manager.ceph:PG 17.27 is not active+clean 2024-09-15T23:18:59.003 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:18:54.383215+0000', 'last_change': '2024-09-15T23:18:54.383215+0000', 'last_active': '2024-09-15T23:18:54.383215+0000', 'last_peered': '2024-09-15T23:18:54.383215+0000', 'last_clean': '2024-09-15T23:18:54.383215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:54.383215+0000', 'last_undegraded': '2024-09-15T23:18:54.383215+0000', 'last_fullsized': '2024-09-15T23:18:54.383215+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:18:59.003 INFO:tasks.ceph.ceph_manager.ceph:PG 17.23 is not active+clean 2024-09-15T23:18:59.003 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:18:54.383215+0000', 'last_change': '2024-09-15T23:18:54.383215+0000', 'last_active': '2024-09-15T23:18:54.383215+0000', 'last_peered': '2024-09-15T23:18:54.383215+0000', 'last_clean': '2024-09-15T23:18:54.383215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:54.383215+0000', 'last_undegraded': '2024-09-15T23:18:54.383215+0000', 'last_fullsized': '2024-09-15T23:18:54.383215+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:18:59.003 INFO:tasks.ceph.ceph_manager.ceph:PG 17.22 is not active+clean 2024-09-15T23:18:59.003 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:18:54.383215+0000', 'last_change': '2024-09-15T23:18:54.383215+0000', 'last_active': '2024-09-15T23:18:54.383215+0000', 'last_peered': '2024-09-15T23:18:54.383215+0000', 'last_clean': '2024-09-15T23:18:54.383215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:54.383215+0000', 'last_undegraded': '2024-09-15T23:18:54.383215+0000', 'last_fullsized': '2024-09-15T23:18:54.383215+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:18:59.003 INFO:tasks.ceph.ceph_manager.ceph:PG 16.1f is not active+clean 2024-09-15T23:18:59.003 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:18:53.385151+0000', 'last_change': '2024-09-15T23:18:53.385151+0000', 'last_active': '2024-09-15T23:18:53.378158+0000', 'last_peered': '2024-09-15T23:18:53.378158+0000', 'last_clean': '2024-09-15T23:18:53.378158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:53.385151+0000', 'last_undegraded': '2024-09-15T23:18:53.385151+0000', 'last_fullsized': '2024-09-15T23:18:53.385151+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:53.378158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:53.378158+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:53.378158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:18:59.003 INFO:tasks.ceph.ceph_manager.ceph:PG 17.1f is not active+clean 2024-09-15T23:18:59.003 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:18:54.383215+0000', 'last_change': '2024-09-15T23:18:54.383215+0000', 'last_active': '2024-09-15T23:18:54.383215+0000', 'last_peered': '2024-09-15T23:18:54.383215+0000', 'last_clean': '2024-09-15T23:18:54.383215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:54.383215+0000', 'last_undegraded': '2024-09-15T23:18:54.383215+0000', 'last_fullsized': '2024-09-15T23:18:54.383215+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:18:59.003 INFO:tasks.ceph.ceph_manager.ceph:PG 16.1e is not active+clean 2024-09-15T23:18:59.004 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:18:53.386472+0000', 'last_change': '2024-09-15T23:18:53.386472+0000', 'last_active': '2024-09-15T23:18:53.378158+0000', 'last_peered': '2024-09-15T23:18:53.378158+0000', 'last_clean': '2024-09-15T23:18:53.378158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:53.386472+0000', 'last_undegraded': '2024-09-15T23:18:53.386472+0000', 'last_fullsized': '2024-09-15T23:18:53.386472+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:53.378158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:53.378158+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:53.378158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:18:59.004 INFO:tasks.ceph.ceph_manager.ceph:PG 17.1d is not active+clean 2024-09-15T23:18:59.004 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:18:54.383215+0000', 'last_change': '2024-09-15T23:18:54.383215+0000', 'last_active': '2024-09-15T23:18:54.383215+0000', 'last_peered': '2024-09-15T23:18:54.383215+0000', 'last_clean': '2024-09-15T23:18:54.383215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:54.383215+0000', 'last_undegraded': '2024-09-15T23:18:54.383215+0000', 'last_fullsized': '2024-09-15T23:18:54.383215+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:18:59.004 INFO:tasks.ceph.ceph_manager.ceph:PG 16.1b is not active+clean 2024-09-15T23:18:59.004 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:18:53.388074+0000', 'last_change': '2024-09-15T23:18:53.388074+0000', 'last_active': '2024-09-15T23:18:53.378158+0000', 'last_peered': '2024-09-15T23:18:53.378158+0000', 'last_clean': '2024-09-15T23:18:53.378158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:53.388074+0000', 'last_undegraded': '2024-09-15T23:18:53.388074+0000', 'last_fullsized': '2024-09-15T23:18:53.388074+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:53.378158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:53.378158+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:53.378158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:18:59.004 INFO:tasks.ceph.ceph_manager.ceph:PG 17.1b is not active+clean 2024-09-15T23:18:59.004 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:18:54.383215+0000', 'last_change': '2024-09-15T23:18:54.383215+0000', 'last_active': '2024-09-15T23:18:54.383215+0000', 'last_peered': '2024-09-15T23:18:54.383215+0000', 'last_clean': '2024-09-15T23:18:54.383215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:54.383215+0000', 'last_undegraded': '2024-09-15T23:18:54.383215+0000', 'last_fullsized': '2024-09-15T23:18:54.383215+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:18:59.004 INFO:tasks.ceph.ceph_manager.ceph:PG 16.19 is not active+clean 2024-09-15T23:18:59.004 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:18:53.378158+0000', 'last_change': '2024-09-15T23:18:53.378158+0000', 'last_active': '2024-09-15T23:18:53.378158+0000', 'last_peered': '2024-09-15T23:18:53.378158+0000', 'last_clean': '2024-09-15T23:18:53.378158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:53.378158+0000', 'last_undegraded': '2024-09-15T23:18:53.378158+0000', 'last_fullsized': '2024-09-15T23:18:53.378158+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:53.378158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:53.378158+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:53.378158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:18:59.004 INFO:tasks.ceph.ceph_manager.ceph:PG 17.19 is not active+clean 2024-09-15T23:18:59.005 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:18:54.383215+0000', 'last_change': '2024-09-15T23:18:54.383215+0000', 'last_active': '2024-09-15T23:18:54.383215+0000', 'last_peered': '2024-09-15T23:18:54.383215+0000', 'last_clean': '2024-09-15T23:18:54.383215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:54.383215+0000', 'last_undegraded': '2024-09-15T23:18:54.383215+0000', 'last_fullsized': '2024-09-15T23:18:54.383215+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:18:59.005 INFO:tasks.ceph.ceph_manager.ceph:PG 17.16 is not active+clean 2024-09-15T23:18:59.005 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:18:54.383215+0000', 'last_change': '2024-09-15T23:18:54.383215+0000', 'last_active': '2024-09-15T23:18:54.383215+0000', 'last_peered': '2024-09-15T23:18:54.383215+0000', 'last_clean': '2024-09-15T23:18:54.383215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:54.383215+0000', 'last_undegraded': '2024-09-15T23:18:54.383215+0000', 'last_fullsized': '2024-09-15T23:18:54.383215+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:18:59.005 INFO:tasks.ceph.ceph_manager.ceph:PG 17.17 is not active+clean 2024-09-15T23:18:59.005 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:18:54.383215+0000', 'last_change': '2024-09-15T23:18:54.383215+0000', 'last_active': '2024-09-15T23:18:54.383215+0000', 'last_peered': '2024-09-15T23:18:54.383215+0000', 'last_clean': '2024-09-15T23:18:54.383215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:54.383215+0000', 'last_undegraded': '2024-09-15T23:18:54.383215+0000', 'last_fullsized': '2024-09-15T23:18:54.383215+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:18:59.005 INFO:tasks.ceph.ceph_manager.ceph:PG 17.15 is not active+clean 2024-09-15T23:18:59.005 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:18:54.383215+0000', 'last_change': '2024-09-15T23:18:54.383215+0000', 'last_active': '2024-09-15T23:18:54.383215+0000', 'last_peered': '2024-09-15T23:18:54.383215+0000', 'last_clean': '2024-09-15T23:18:54.383215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:54.383215+0000', 'last_undegraded': '2024-09-15T23:18:54.383215+0000', 'last_fullsized': '2024-09-15T23:18:54.383215+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:18:59.005 INFO:tasks.ceph.ceph_manager.ceph:PG 16.12 is not active+clean 2024-09-15T23:18:59.005 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:18:53.388068+0000', 'last_change': '2024-09-15T23:18:53.388068+0000', 'last_active': '2024-09-15T23:18:53.378158+0000', 'last_peered': '2024-09-15T23:18:53.378158+0000', 'last_clean': '2024-09-15T23:18:53.378158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:53.388068+0000', 'last_undegraded': '2024-09-15T23:18:53.388068+0000', 'last_fullsized': '2024-09-15T23:18:53.388068+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:53.378158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:53.378158+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:53.378158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:18:59.005 INFO:tasks.ceph.ceph_manager.ceph:PG 17.c is not active+clean 2024-09-15T23:18:59.005 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:18:54.383215+0000', 'last_change': '2024-09-15T23:18:54.383215+0000', 'last_active': '2024-09-15T23:18:54.383215+0000', 'last_peered': '2024-09-15T23:18:54.383215+0000', 'last_clean': '2024-09-15T23:18:54.383215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:54.383215+0000', 'last_undegraded': '2024-09-15T23:18:54.383215+0000', 'last_fullsized': '2024-09-15T23:18:54.383215+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:18:59.006 INFO:tasks.ceph.ceph_manager.ceph:PG 16.d is not active+clean 2024-09-15T23:18:59.006 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:18:53.385105+0000', 'last_change': '2024-09-15T23:18:53.385105+0000', 'last_active': '2024-09-15T23:18:53.378158+0000', 'last_peered': '2024-09-15T23:18:53.378158+0000', 'last_clean': '2024-09-15T23:18:53.378158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:53.385105+0000', 'last_undegraded': '2024-09-15T23:18:53.385105+0000', 'last_fullsized': '2024-09-15T23:18:53.385105+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:53.378158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:53.378158+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:53.378158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:18:59.006 INFO:tasks.ceph.ceph_manager.ceph:PG 17.d is not active+clean 2024-09-15T23:18:59.006 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:18:54.383215+0000', 'last_change': '2024-09-15T23:18:54.383215+0000', 'last_active': '2024-09-15T23:18:54.383215+0000', 'last_peered': '2024-09-15T23:18:54.383215+0000', 'last_clean': '2024-09-15T23:18:54.383215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:54.383215+0000', 'last_undegraded': '2024-09-15T23:18:54.383215+0000', 'last_fullsized': '2024-09-15T23:18:54.383215+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:18:59.006 INFO:tasks.ceph.ceph_manager.ceph:PG 16.c is not active+clean 2024-09-15T23:18:59.006 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:18:53.385148+0000', 'last_change': '2024-09-15T23:18:53.385148+0000', 'last_active': '2024-09-15T23:18:53.378158+0000', 'last_peered': '2024-09-15T23:18:53.378158+0000', 'last_clean': '2024-09-15T23:18:53.378158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:53.385148+0000', 'last_undegraded': '2024-09-15T23:18:53.385148+0000', 'last_fullsized': '2024-09-15T23:18:53.385148+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:53.378158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:53.378158+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:53.378158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:18:59.006 INFO:tasks.ceph.ceph_manager.ceph:PG 17.a is not active+clean 2024-09-15T23:18:59.006 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:18:54.383215+0000', 'last_change': '2024-09-15T23:18:54.383215+0000', 'last_active': '2024-09-15T23:18:54.383215+0000', 'last_peered': '2024-09-15T23:18:54.383215+0000', 'last_clean': '2024-09-15T23:18:54.383215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:54.383215+0000', 'last_undegraded': '2024-09-15T23:18:54.383215+0000', 'last_fullsized': '2024-09-15T23:18:54.383215+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:18:59.006 INFO:tasks.ceph.ceph_manager.ceph:PG 17.8 is not active+clean 2024-09-15T23:18:59.006 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:18:54.383215+0000', 'last_change': '2024-09-15T23:18:54.383215+0000', 'last_active': '2024-09-15T23:18:54.383215+0000', 'last_peered': '2024-09-15T23:18:54.383215+0000', 'last_clean': '2024-09-15T23:18:54.383215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:54.383215+0000', 'last_undegraded': '2024-09-15T23:18:54.383215+0000', 'last_fullsized': '2024-09-15T23:18:54.383215+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:18:59.006 INFO:tasks.ceph.ceph_manager.ceph:PG 17.6 is not active+clean 2024-09-15T23:18:59.007 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:18:54.383215+0000', 'last_change': '2024-09-15T23:18:54.383215+0000', 'last_active': '2024-09-15T23:18:54.383215+0000', 'last_peered': '2024-09-15T23:18:54.383215+0000', 'last_clean': '2024-09-15T23:18:54.383215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:54.383215+0000', 'last_undegraded': '2024-09-15T23:18:54.383215+0000', 'last_fullsized': '2024-09-15T23:18:54.383215+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:18:59.007 INFO:tasks.ceph.ceph_manager.ceph:PG 16.6 is not active+clean 2024-09-15T23:18:59.007 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:18:53.378158+0000', 'last_change': '2024-09-15T23:18:53.378158+0000', 'last_active': '2024-09-15T23:18:53.378158+0000', 'last_peered': '2024-09-15T23:18:53.378158+0000', 'last_clean': '2024-09-15T23:18:53.378158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:53.378158+0000', 'last_undegraded': '2024-09-15T23:18:53.378158+0000', 'last_fullsized': '2024-09-15T23:18:53.378158+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:53.378158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:53.378158+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:53.378158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:18:59.007 INFO:tasks.ceph.ceph_manager.ceph:PG 17.5 is not active+clean 2024-09-15T23:18:59.007 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:18:54.383215+0000', 'last_change': '2024-09-15T23:18:54.383215+0000', 'last_active': '2024-09-15T23:18:54.383215+0000', 'last_peered': '2024-09-15T23:18:54.383215+0000', 'last_clean': '2024-09-15T23:18:54.383215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:54.383215+0000', 'last_undegraded': '2024-09-15T23:18:54.383215+0000', 'last_fullsized': '2024-09-15T23:18:54.383215+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:18:59.007 INFO:tasks.ceph.ceph_manager.ceph:PG 17.2 is not active+clean 2024-09-15T23:18:59.007 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:18:54.383215+0000', 'last_change': '2024-09-15T23:18:54.383215+0000', 'last_active': '2024-09-15T23:18:54.383215+0000', 'last_peered': '2024-09-15T23:18:54.383215+0000', 'last_clean': '2024-09-15T23:18:54.383215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:54.383215+0000', 'last_undegraded': '2024-09-15T23:18:54.383215+0000', 'last_fullsized': '2024-09-15T23:18:54.383215+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:18:59.007 INFO:tasks.ceph.ceph_manager.ceph:PG 16.3 is not active+clean 2024-09-15T23:18:59.007 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:18:53.378158+0000', 'last_change': '2024-09-15T23:18:53.378158+0000', 'last_active': '2024-09-15T23:18:53.378158+0000', 'last_peered': '2024-09-15T23:18:53.378158+0000', 'last_clean': '2024-09-15T23:18:53.378158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:53.378158+0000', 'last_undegraded': '2024-09-15T23:18:53.378158+0000', 'last_fullsized': '2024-09-15T23:18:53.378158+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:53.378158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:53.378158+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:53.378158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:18:59.007 INFO:tasks.ceph.ceph_manager.ceph:PG 17.3 is not active+clean 2024-09-15T23:18:59.007 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:18:54.383215+0000', 'last_change': '2024-09-15T23:18:54.383215+0000', 'last_active': '2024-09-15T23:18:54.383215+0000', 'last_peered': '2024-09-15T23:18:54.383215+0000', 'last_clean': '2024-09-15T23:18:54.383215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:54.383215+0000', 'last_undegraded': '2024-09-15T23:18:54.383215+0000', 'last_fullsized': '2024-09-15T23:18:54.383215+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:18:59.008 INFO:tasks.ceph.ceph_manager.ceph:PG 16.2 is not active+clean 2024-09-15T23:18:59.008 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:18:53.385160+0000', 'last_change': '2024-09-15T23:18:53.385160+0000', 'last_active': '2024-09-15T23:18:53.378158+0000', 'last_peered': '2024-09-15T23:18:53.378158+0000', 'last_clean': '2024-09-15T23:18:53.378158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:53.385160+0000', 'last_undegraded': '2024-09-15T23:18:53.385160+0000', 'last_fullsized': '2024-09-15T23:18:53.385160+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:53.378158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:53.378158+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:53.378158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:18:59.008 INFO:tasks.ceph.ceph_manager.ceph:PG 17.0 is not active+clean 2024-09-15T23:18:59.008 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:18:54.383215+0000', 'last_change': '2024-09-15T23:18:54.383215+0000', 'last_active': '2024-09-15T23:18:54.383215+0000', 'last_peered': '2024-09-15T23:18:54.383215+0000', 'last_clean': '2024-09-15T23:18:54.383215+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:54.383215+0000', 'last_undegraded': '2024-09-15T23:18:54.383215+0000', 'last_fullsized': '2024-09-15T23:18:54.383215+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:54.383215+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:18:59.008 INFO:tasks.ceph.ceph_manager.ceph:PG 16.11 is not active+clean 2024-09-15T23:18:59.008 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:18:53.386469+0000', 'last_change': '2024-09-15T23:18:53.386469+0000', 'last_active': '2024-09-15T23:18:53.378158+0000', 'last_peered': '2024-09-15T23:18:53.378158+0000', 'last_clean': '2024-09-15T23:18:53.378158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:18:53.386469+0000', 'last_undegraded': '2024-09-15T23:18:53.386469+0000', 'last_fullsized': '2024-09-15T23:18:53.386469+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:18:53.378158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:18:53.378158+0000', 'last_clean_scrub_stamp': '2024-09-15T23:18:53.378158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:18:59.009 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:18:59.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.133+0000 7f15c0f86640 1 Processor -- start 2024-09-15T23:18:59.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.133+0000 7f15c0f86640 1 -- start start 2024-09-15T23:18:59.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.133+0000 7f15c0f86640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f15bc0b6970 0x7f15bc0b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:59.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.133+0000 7f15c0f86640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f15bc0d23b0 0x7f15bc0b8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:59.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.133+0000 7f15c0f86640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15bc0d0e70 con 0x7f15bc15ed20 2024-09-15T23:18:59.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.133+0000 7f15c0f86640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f15bc0d41c0 con 0x7f15bc0d23b0 2024-09-15T23:18:59.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.133+0000 7f15c0f86640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f15bc0d35b0 con 0x7f15bc0b6970 2024-09-15T23:18:59.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.134+0000 7f15bad9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f15bc0d23b0 0x7f15bc0b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:59.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.134+0000 7f15ba59c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f15bc15ed20 0x7f15bc0b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35182/0 (socket says 172.21.15.123:35182) 2024-09-15T23:18:59.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.134+0000 7f15ba59c640 1 -- 172.21.15.123:0/1716460051 learned_addr learned my addr 172.21.15.123:0/1716460051 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:18:59.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.134+0000 7f15b3fff640 1 --2- 172.21.15.123:0/1716460051 >> v2:172.21.15.188:3300/0 conn(0x7f15bc0b6970 0x7f15bc0b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:59.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.134+0000 7f15bad9d640 1 -- 172.21.15.123:0/1716460051 >> v2:172.21.15.188:3300/0 conn(0x7f15bc0b6970 msgr2=0x7f15bc0b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:59.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.134+0000 7f15bad9d640 1 --2- 172.21.15.123:0/1716460051 >> v2:172.21.15.188:3300/0 conn(0x7f15bc0b6970 0x7f15bc0b80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:59.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.134+0000 7f15bad9d640 1 -- 172.21.15.123:0/1716460051 >> v1:172.21.15.123:6789/0 conn(0x7f15bc15ed20 legacy=0x7f15bc0b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:59.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.134+0000 7f15bad9d640 1 -- 172.21.15.123:0/1716460051 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15bc0d3890 con 0x7f15bc0d23b0 2024-09-15T23:18:59.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.134+0000 7f15b9d9b640 1 -- 172.21.15.123:0/1716460051 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 90634566 0 0) 0x7f15ac001110 con 0x7f15bc15ed20 2024-09-15T23:18:59.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.134+0000 7f15b3fff640 1 --2- 172.21.15.123:0/1716460051 >> v2:172.21.15.188:3300/0 conn(0x7f15bc0b6970 0x7f15bc0b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:18:59.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.135+0000 7f15bad9d640 1 --2- 172.21.15.123:0/1716460051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15bc0d23b0 0x7f15bc0b8610 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f15bc0d4690 tx=0x7f15b402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d24083ae4a0bc419 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:59.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.135+0000 7f15b9d9b640 1 -- 172.21.15.123:0/1716460051 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b4007740 con 0x7f15bc0d23b0 2024-09-15T23:18:59.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.135+0000 7f15b9d9b640 1 -- 172.21.15.123:0/1716460051 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15b40078e0 con 0x7f15bc0d23b0 2024-09-15T23:18:59.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.135+0000 7f15b9d9b640 1 -- 172.21.15.123:0/1716460051 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b4007cb0 con 0x7f15bc0d23b0 2024-09-15T23:18:59.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.135+0000 7f15c0f86640 1 -- 172.21.15.123:0/1716460051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15bc0d23b0 msgr2=0x7f15bc0b8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:59.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.135+0000 7f15c0f86640 1 --2- 172.21.15.123:0/1716460051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15bc0d23b0 0x7f15bc0b8610 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f15bc0d4690 tx=0x7f15b402a5f0 comp rx=0 tx=0).stop 2024-09-15T23:18:59.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.135+0000 7f15c0f86640 1 -- 172.21.15.123:0/1716460051 shutdown_connections 2024-09-15T23:18:59.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.135+0000 7f15c0f86640 1 --2- 172.21.15.123:0/1716460051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15bc0d23b0 0x7f15bc0b8610 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:59.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.135+0000 7f15c0f86640 1 --2- 172.21.15.123:0/1716460051 >> v2:172.21.15.188:3300/0 conn(0x7f15bc0b6970 0x7f15bc0b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:59.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.135+0000 7f15c0f86640 1 -- 172.21.15.123:0/1716460051 >> 172.21.15.123:0/1716460051 conn(0x7f15bc0d1260 msgr2=0x7f15bc0d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:59.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.135+0000 7f15c0f86640 1 -- 172.21.15.123:0/1716460051 shutdown_connections 2024-09-15T23:18:59.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.135+0000 7f15c0f86640 1 -- 172.21.15.123:0/1716460051 wait complete. 2024-09-15T23:18:59.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.137+0000 7f15c0f86640 1 Processor -- start 2024-09-15T23:18:59.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.137+0000 7f15c0f86640 1 -- start start 2024-09-15T23:18:59.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.137+0000 7f15c0f86640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f15bc0b6970 0x7f15bc15f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:59.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.137+0000 7f15c0f86640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f15bc0d23b0 0x7f15bc161010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:59.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.137+0000 7f15c0f86640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15bc15ed20 0x7f15bc1618f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:59.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.137+0000 7f15c0f86640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f15bc0d32a0 con 0x7f15bc15ed20 2024-09-15T23:18:59.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.137+0000 7f15c0f86640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f15bc0d3e50 con 0x7f15bc0b6970 2024-09-15T23:18:59.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.137+0000 7f15c0f86640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f15bc15f100 con 0x7f15bc0d23b0 2024-09-15T23:18:59.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.138+0000 7f15bad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15bc15ed20 0x7f15bc1618f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:59.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.138+0000 7f15bad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15bc15ed20 0x7f15bc1618f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38666/0 (socket says 172.21.15.123:38666) 2024-09-15T23:18:59.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.138+0000 7f15bad9d640 1 -- 172.21.15.123:0/1200657303 learned_addr learned my addr 172.21.15.123:0/1200657303 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:59.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.138+0000 7f15bad9d640 1 -- 172.21.15.123:0/1200657303 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f15bc0d23b0 msgr2=0x7f15bc161010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:59.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.138+0000 7f15b3fff640 1 --2- 172.21.15.123:0/1200657303 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f15bc0d23b0 0x7f15bc161010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:59.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.138+0000 7f15ba59c640 1 --2- 172.21.15.123:0/1200657303 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f15bc0b6970 0x7f15bc15f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:59.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.138+0000 7f15bad9d640 1 --2- 172.21.15.123:0/1200657303 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f15bc0d23b0 0x7f15bc161010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:59.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.138+0000 7f15bad9d640 1 -- 172.21.15.123:0/1200657303 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f15bc0b6970 msgr2=0x7f15bc15f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:59.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.138+0000 7f15bad9d640 1 --2- 172.21.15.123:0/1200657303 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f15bc0b6970 0x7f15bc15f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:59.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.138+0000 7f15bad9d640 1 -- 172.21.15.123:0/1200657303 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15bc1f8a00 con 0x7f15bc15ed20 2024-09-15T23:18:59.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.138+0000 7f15bad9d640 1 --2- 172.21.15.123:0/1200657303 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15bc15ed20 0x7f15bc1618f0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f15b402abe0 tx=0x7f15b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:59.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.138+0000 7f15b2ffd640 1 -- 172.21.15.123:0/1200657303 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b4040070 con 0x7f15bc15ed20 2024-09-15T23:18:59.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.138+0000 7f15b2ffd640 1 -- 172.21.15.123:0/1200657303 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15b4031c90 con 0x7f15bc15ed20 2024-09-15T23:18:59.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.138+0000 7f15c0f86640 1 -- 172.21.15.123:0/1200657303 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15bc154890 con 0x7f15bc15ed20 2024-09-15T23:18:59.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.138+0000 7f15b2ffd640 1 -- 172.21.15.123:0/1200657303 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b4045680 con 0x7f15bc15ed20 2024-09-15T23:18:59.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.138+0000 7f15c0f86640 1 -- 172.21.15.123:0/1200657303 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15bc154e50 con 0x7f15bc15ed20 2024-09-15T23:18:59.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.139+0000 7f15c0f86640 1 -- 172.21.15.123:0/1200657303 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15bc0d1f60 con 0x7f15bc15ed20 2024-09-15T23:18:59.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.140+0000 7f15b2ffd640 1 -- 172.21.15.123:0/1200657303 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f15b4039040 con 0x7f15bc15ed20 2024-09-15T23:18:59.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.140+0000 7f15b2ffd640 1 --2- 172.21.15.123:0/1200657303 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f159c06c2b0 0x7f159c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:59.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.140+0000 7f15b2ffd640 1 -- 172.21.15.123:0/1200657303 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f15b40ace70 con 0x7f15bc15ed20 2024-09-15T23:18:59.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.141+0000 7f15ba59c640 1 --2- 172.21.15.123:0/1200657303 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f159c06c2b0 0x7f159c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:59.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.141+0000 7f15ba59c640 1 --2- 172.21.15.123:0/1200657303 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f159c06c2b0 0x7f159c06e770 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f15ac000f60 tx=0x7f15ac009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:59.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.145+0000 7f15b2ffd640 1 -- 172.21.15.123:0/1200657303 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f15bc0d1f60 con 0x7f15bc15ed20 2024-09-15T23:18:59.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.376+0000 7f15c0f86640 1 -- 172.21.15.123:0/1200657303 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f15bc0b7010 con 0x7f15bc15ed20 2024-09-15T23:18:59.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.376+0000 7f15b2ffd640 1 -- 172.21.15.123:0/1200657303 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1219 (secure 0 0 0) 0x7f15bc1f8a00 con 0x7f15bc15ed20 2024-09-15T23:18:59.378 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:18:59.378 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":429,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":130,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":54},{"state_name":"unknown","count":35},{"state_name":"creating+peering","count":8}],"num_pgs":97,"num_pools":3,"num_objects":20,"data_bytes":592126,"bytes_used":401543168,"bytes_avail":772692570112,"bytes_total":773094113280,"unknown_pgs_ratio":0.36082473397254944,"inactive_pgs_ratio":0.082474224269390106,"write_bytes_sec":2914,"read_op_per_sec":0,"write_op_per_sec":9},"fsmap":{"epoch":80,"btime":"2024-09-15T23:18:57:403025+0000","id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"d","status":"up:active","gid":8034}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2024-09-15T23:18:45.597495+0000","services":{}},"progress_events":{}} 2024-09-15T23:18:59.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.378+0000 7f15c0f86640 1 -- 172.21.15.123:0/1200657303 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f159c06c2b0 msgr2=0x7f159c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:59.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.378+0000 7f15c0f86640 1 --2- 172.21.15.123:0/1200657303 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f159c06c2b0 0x7f159c06e770 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f15ac000f60 tx=0x7f15ac009040 comp rx=0 tx=0).stop 2024-09-15T23:18:59.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.378+0000 7f15c0f86640 1 -- 172.21.15.123:0/1200657303 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15bc15ed20 msgr2=0x7f15bc1618f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:59.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.378+0000 7f15c0f86640 1 --2- 172.21.15.123:0/1200657303 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15bc15ed20 0x7f15bc1618f0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f15b402abe0 tx=0x7f15b4004a40 comp rx=0 tx=0).stop 2024-09-15T23:18:59.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.378+0000 7f15c0f86640 1 -- 172.21.15.123:0/1200657303 shutdown_connections 2024-09-15T23:18:59.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.378+0000 7f15c0f86640 1 --2- 172.21.15.123:0/1200657303 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f159c06c2b0 0x7f159c06e770 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:59.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.378+0000 7f15c0f86640 1 --2- 172.21.15.123:0/1200657303 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15bc15ed20 0x7f15bc1618f0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:59.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.378+0000 7f15c0f86640 1 --2- 172.21.15.123:0/1200657303 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f15bc0d23b0 0x7f15bc161010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:59.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.378+0000 7f15c0f86640 1 --2- 172.21.15.123:0/1200657303 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f15bc0b6970 0x7f15bc15f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:59.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.378+0000 7f15c0f86640 1 -- 172.21.15.123:0/1200657303 >> 172.21.15.123:0/1200657303 conn(0x7f15bc0d1260 msgr2=0x7f15bc0b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:59.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.378+0000 7f15c0f86640 1 -- 172.21.15.123:0/1200657303 shutdown_connections 2024-09-15T23:18:59.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.378+0000 7f15c0f86640 1 -- 172.21.15.123:0/1200657303 wait complete. 2024-09-15T23:18:59.390 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-15T23:18:59.391 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:18:59.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.489+0000 7fc0aad68640 1 Processor -- start 2024-09-15T23:18:59.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.489+0000 7fc0aad68640 1 -- start start 2024-09-15T23:18:59.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.490+0000 7fc0aad68640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc0a40b2d40 0x7fc0a406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:59.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.490+0000 7fc0aad68640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc0a406c150 0x7fc0a415c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:59.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.490+0000 7fc0aad68640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0a4071180 con 0x7fc0a413eb20 2024-09-15T23:18:59.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.490+0000 7fc0aad68640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fc0a4071ab0 con 0x7fc0a40b2d40 2024-09-15T23:18:59.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.490+0000 7fc0aad68640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc0a4071460 con 0x7fc0a406c150 2024-09-15T23:18:59.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.490+0000 7fc0a3fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc0a413eb20 0x7fc0a415bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35198/0 (socket says 172.21.15.123:35198) 2024-09-15T23:18:59.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.490+0000 7fc0a3fff640 1 -- 172.21.15.123:0/2600974541 learned_addr learned my addr 172.21.15.123:0/2600974541 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:18:59.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.490+0000 7fc0a8b04640 1 --2- 172.21.15.123:0/2600974541 >> v2:172.21.15.188:3300/0 conn(0x7fc0a40b2d40 0x7fc0a406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:59.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.490+0000 7fc0a9305640 1 --2- 172.21.15.123:0/2600974541 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc0a406c150 0x7fc0a415c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:59.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.490+0000 7fc0a37fe640 1 -- 172.21.15.123:0/2600974541 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 5610586 0 0) 0x7fc0a4071180 con 0x7fc0a413eb20 2024-09-15T23:18:59.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.490+0000 7fc0a37fe640 1 -- 172.21.15.123:0/2600974541 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc090003520 con 0x7fc0a413eb20 2024-09-15T23:18:59.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.490+0000 7fc0a37fe640 1 -- 172.21.15.123:0/2600974541 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2814643450 0 0) 0x7fc090003520 con 0x7fc0a413eb20 2024-09-15T23:18:59.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.490+0000 7fc0a37fe640 1 -- 172.21.15.123:0/2600974541 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc0a406c150 msgr2=0x7fc0a415c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:59.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.490+0000 7fc0a37fe640 1 --2- 172.21.15.123:0/2600974541 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc0a406c150 0x7fc0a415c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:59.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.490+0000 7fc0a37fe640 1 -- 172.21.15.123:0/2600974541 >> v2:172.21.15.188:3300/0 conn(0x7fc0a40b2d40 msgr2=0x7fc0a406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:59.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.490+0000 7fc0a37fe640 1 --2- 172.21.15.123:0/2600974541 >> v2:172.21.15.188:3300/0 conn(0x7fc0a40b2d40 0x7fc0a406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:59.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.490+0000 7fc0a37fe640 1 -- 172.21.15.123:0/2600974541 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0a4071740 con 0x7fc0a413eb20 2024-09-15T23:18:59.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.490+0000 7fc0a37fe640 1 -- 172.21.15.123:0/2600974541 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fc0940019f0 con 0x7fc0a413eb20 2024-09-15T23:18:59.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.490+0000 7fc0a37fe640 1 -- 172.21.15.123:0/2600974541 >> v1:172.21.15.123:6789/0 conn(0x7fc0a413eb20 legacy=0x7fc0a415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:59.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.490+0000 7fc0a37fe640 1 --2- 172.21.15.123:0/2600974541 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc0a406c150 0x7fc0900039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:59.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.490+0000 7fc0a37fe640 1 --2- 172.21.15.123:0/2600974541 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc090003f30 0x7fc090004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:59.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.490+0000 7fc0a37fe640 1 --2- 172.21.15.123:0/2600974541 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc090004d40 0x7fc0900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:59.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.490+0000 7fc0a37fe640 1 -- 172.21.15.123:0/2600974541 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a4071ab0 con 0x7fc090003f30 2024-09-15T23:18:59.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.490+0000 7fc0a37fe640 1 -- 172.21.15.123:0/2600974541 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a4071460 con 0x7fc090004d40 2024-09-15T23:18:59.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.490+0000 7fc0a37fe640 1 -- 172.21.15.123:0/2600974541 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc09000b9c0 con 0x7fc0a406c150 2024-09-15T23:18:59.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.490+0000 7fc0a3fff640 1 --2- 172.21.15.123:0/2600974541 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc090003f30 0x7fc090004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:59.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.491+0000 7fc0a8b04640 1 --2- 172.21.15.123:0/2600974541 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc0a406c150 0x7fc0900039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:59.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.491+0000 7fc0a9305640 1 --2- 172.21.15.123:0/2600974541 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc090004d40 0x7fc0900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:59.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.491+0000 7fc0a3fff640 1 -- 172.21.15.123:0/2600974541 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc0a406c150 msgr2=0x7fc0900039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:59.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.491+0000 7fc0a3fff640 1 --2- 172.21.15.123:0/2600974541 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc0a406c150 0x7fc0900039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:59.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.491+0000 7fc0a3fff640 1 -- 172.21.15.123:0/2600974541 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc090004d40 msgr2=0x7fc0900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:18:59.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.491+0000 7fc0a3fff640 1 --2- 172.21.15.123:0/2600974541 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc090004d40 0x7fc0900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:59.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.491+0000 7fc0a3fff640 1 -- 172.21.15.123:0/2600974541 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc090003520 con 0x7fc090003f30 2024-09-15T23:18:59.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.491+0000 7fc0a9305640 1 --2- 172.21.15.123:0/2600974541 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc090004d40 0x7fc0900051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:18:59.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.492+0000 7fc0a3fff640 1 --2- 172.21.15.123:0/2600974541 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc090003f30 0x7fc090004800 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fc09400a8f0 tx=0x7fc090005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6544968ddedf9d85 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:59.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.492+0000 7fc0a37fe640 1 -- 172.21.15.123:0/2600974541 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09400a4c0 con 0x7fc090003f30 2024-09-15T23:18:59.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.492+0000 7fc0a37fe640 1 -- 172.21.15.123:0/2600974541 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc09402f070 con 0x7fc090003f30 2024-09-15T23:18:59.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.492+0000 7fc0a37fe640 1 -- 172.21.15.123:0/2600974541 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09402bd10 con 0x7fc090003f30 2024-09-15T23:18:59.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.492+0000 7fc0aad68640 1 -- 172.21.15.123:0/2600974541 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc090003f30 msgr2=0x7fc090004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:59.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.492+0000 7fc0aad68640 1 --2- 172.21.15.123:0/2600974541 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc090003f30 0x7fc090004800 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fc09400a8f0 tx=0x7fc090005830 comp rx=0 tx=0).stop 2024-09-15T23:18:59.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.492+0000 7fc0a9305640 1 -- 172.21.15.123:0/2600974541 reap_dead start 2024-09-15T23:18:59.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.492+0000 7fc0aad68640 1 -- 172.21.15.123:0/2600974541 shutdown_connections 2024-09-15T23:18:59.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.492+0000 7fc0aad68640 1 -- 172.21.15.123:0/2600974541 >> 172.21.15.123:0/2600974541 conn(0x7fc0a40ccec0 msgr2=0x7fc0a40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:59.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.492+0000 7fc0aad68640 1 -- 172.21.15.123:0/2600974541 shutdown_connections 2024-09-15T23:18:59.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.492+0000 7fc0aad68640 1 -- 172.21.15.123:0/2600974541 wait complete. 2024-09-15T23:18:59.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.493+0000 7fc0aad68640 1 Processor -- start 2024-09-15T23:18:59.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.494+0000 7fc0aad68640 1 -- start start 2024-09-15T23:18:59.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.494+0000 7fc0aad68640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc090003f30 0x7fc0a4143ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:59.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.494+0000 7fc0aad68640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc0a4144400 0x7fc0a413efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:59.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.494+0000 7fc0aad68640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0a413f520 0x7fc0a413f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:59.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.494+0000 7fc0aad68640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a415c790 con 0x7fc0a413f520 2024-09-15T23:18:59.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.494+0000 7fc0aad68640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a415c610 con 0x7fc0a4144400 2024-09-15T23:18:59.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.494+0000 7fc0aad68640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc0a4071f40 con 0x7fc090003f30 2024-09-15T23:18:59.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.494+0000 7fc0a9305640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0a413f520 0x7fc0a413f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:59.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.494+0000 7fc0a9305640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0a413f520 0x7fc0a413f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38698/0 (socket says 172.21.15.123:38698) 2024-09-15T23:18:59.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.495+0000 7fc0a9305640 1 -- 172.21.15.123:0/3879574582 learned_addr learned my addr 172.21.15.123:0/3879574582 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:18:59.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.495+0000 7fc0a8b04640 1 --2- 172.21.15.123:0/3879574582 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc090003f30 0x7fc0a4143ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:59.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.495+0000 7fc0a3fff640 1 --2- 172.21.15.123:0/3879574582 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc0a4144400 0x7fc0a413efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:59.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.495+0000 7fc0a9305640 1 -- 172.21.15.123:0/3879574582 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc090003f30 msgr2=0x7fc0a4143ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:59.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.495+0000 7fc0a9305640 1 --2- 172.21.15.123:0/3879574582 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc090003f30 0x7fc0a4143ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:59.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.495+0000 7fc0a9305640 1 -- 172.21.15.123:0/3879574582 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc0a4144400 msgr2=0x7fc0a413efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:59.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.495+0000 7fc0a9305640 1 --2- 172.21.15.123:0/3879574582 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc0a4144400 0x7fc0a413efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:59.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.495+0000 7fc0a9305640 1 -- 172.21.15.123:0/3879574582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0a4141800 con 0x7fc0a413f520 2024-09-15T23:18:59.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.495+0000 7fc0a9305640 1 --2- 172.21.15.123:0/3879574582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0a413f520 0x7fc0a413f9d0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fc0a413ef00 tx=0x7fc09c011860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:59.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.495+0000 7fc0a17fa640 1 -- 172.21.15.123:0/3879574582 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09c019020 con 0x7fc0a413f520 2024-09-15T23:18:59.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.495+0000 7fc0a17fa640 1 -- 172.21.15.123:0/3879574582 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc09c004440 con 0x7fc0a413f520 2024-09-15T23:18:59.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.495+0000 7fc0aad68640 1 -- 172.21.15.123:0/3879574582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0a4141ae0 con 0x7fc0a413f520 2024-09-15T23:18:59.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.495+0000 7fc0a17fa640 1 -- 172.21.15.123:0/3879574582 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09c003850 con 0x7fc0a413f520 2024-09-15T23:18:59.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.495+0000 7fc0aad68640 1 -- 172.21.15.123:0/3879574582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0a41425c0 con 0x7fc0a413f520 2024-09-15T23:18:59.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.496+0000 7fc0aad68640 1 -- 172.21.15.123:0/3879574582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0a406bc10 con 0x7fc0a413f520 2024-09-15T23:18:59.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.497+0000 7fc0a17fa640 1 -- 172.21.15.123:0/3879574582 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc09c01c020 con 0x7fc0a413f520 2024-09-15T23:18:59.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.497+0000 7fc0a17fa640 1 --2- 172.21.15.123:0/3879574582 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc08406c2b0 0x7fc08406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:18:59.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.497+0000 7fc0a17fa640 1 -- 172.21.15.123:0/3879574582 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7fc09c08b3f0 con 0x7fc0a413f520 2024-09-15T23:18:59.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.497+0000 7fc0a8b04640 1 --2- 172.21.15.123:0/3879574582 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc08406c2b0 0x7fc08406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:18:59.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.498+0000 7fc0a8b04640 1 --2- 172.21.15.123:0/3879574582 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc08406c2b0 0x7fc08406e770 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc08c009c40 tx=0x7fc08c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:18:59.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.502+0000 7fc0a17fa640 1 -- 172.21.15.123:0/3879574582 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc09c023030 con 0x7fc0a413f520 2024-09-15T23:18:59.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.664+0000 7fc0aad68640 1 -- 172.21.15.123:0/3879574582 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc0a406c9c0 con 0x7fc08406c2b0 2024-09-15T23:18:59.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.670+0000 7fc0a17fa640 1 -- 172.21.15.123:0/3879574582 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252453 (secure 0 0 0) 0x7fc0a406c9c0 con 0x7fc08406c2b0 2024-09-15T23:18:59.674 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:18:59.675 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:18:59.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.673+0000 7fc0aad68640 1 -- 172.21.15.123:0/3879574582 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc08406c2b0 msgr2=0x7fc08406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:59.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.673+0000 7fc0aad68640 1 --2- 172.21.15.123:0/3879574582 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc08406c2b0 0x7fc08406e770 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc08c009c40 tx=0x7fc08c009190 comp rx=0 tx=0).stop 2024-09-15T23:18:59.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.673+0000 7fc0aad68640 1 -- 172.21.15.123:0/3879574582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0a413f520 msgr2=0x7fc0a413f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:18:59.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.673+0000 7fc0aad68640 1 --2- 172.21.15.123:0/3879574582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0a413f520 0x7fc0a413f9d0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fc0a413ef00 tx=0x7fc09c011860 comp rx=0 tx=0).stop 2024-09-15T23:18:59.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.673+0000 7fc0aad68640 1 -- 172.21.15.123:0/3879574582 shutdown_connections 2024-09-15T23:18:59.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.673+0000 7fc0aad68640 1 --2- 172.21.15.123:0/3879574582 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc08406c2b0 0x7fc08406e770 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:59.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.673+0000 7fc0aad68640 1 --2- 172.21.15.123:0/3879574582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0a413f520 0x7fc0a413f9d0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:59.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.673+0000 7fc0aad68640 1 --2- 172.21.15.123:0/3879574582 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc0a4144400 0x7fc0a413efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:59.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.673+0000 7fc0aad68640 1 --2- 172.21.15.123:0/3879574582 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc090003f30 0x7fc0a4143ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:18:59.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.673+0000 7fc0aad68640 1 -- 172.21.15.123:0/3879574582 >> 172.21.15.123:0/3879574582 conn(0x7fc0a40ccec0 msgr2=0x7fc0a415b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:18:59.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.673+0000 7fc0aad68640 1 -- 172.21.15.123:0/3879574582 shutdown_connections 2024-09-15T23:18:59.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:18:59.673+0000 7fc0aad68640 1 -- 172.21.15.123:0/3879574582 wait complete. 2024-09-15T23:18:59.685 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":332,"stamp":"2024-09-15T23:18:59.600931+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":103,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":392304,"kb_used_data":13688,"kb_used_omap":12,"kb_used_meta":378419,"kb_avail":754582416,"statfs":{"total":773094113280,"available":772692393984,"internally_reserved":0,"allocated":14016512,"data_stored":6826412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":387501616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001650"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.405875+0000","last_change":"2024-09-15T23:18:55.410755+0000","last_active":"2024-09-15T23:18:56.405875+0000","last_peered":"2024-09-15T23:18:56.405875+0000","last_clean":"2024-09-15T23:18:56.405875+0000","last_became_active":"2024-09-15T23:18:55.410175+0000","last_became_peered":"2024-09-15T23:18:55.410175+0000","last_unstale":"2024-09-15T23:18:56.405875+0000","last_undegraded":"2024-09-15T23:18:56.405875+0000","last_fullsized":"2024-09-15T23:18:56.405875+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:43:05.591911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406799+0000","last_change":"2024-09-15T23:18:55.415215+0000","last_active":"2024-09-15T23:18:56.406799+0000","last_peered":"2024-09-15T23:18:56.406799+0000","last_clean":"2024-09-15T23:18:56.406799+0000","last_became_active":"2024-09-15T23:18:55.414844+0000","last_became_peered":"2024-09-15T23:18:55.414844+0000","last_unstale":"2024-09-15T23:18:56.406799+0000","last_undegraded":"2024-09-15T23:18:56.406799+0000","last_fullsized":"2024-09-15T23:18:56.406799+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:51:31.137122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406927+0000","last_change":"2024-09-15T23:18:55.400347+0000","last_active":"2024-09-15T23:18:56.406927+0000","last_peered":"2024-09-15T23:18:56.406927+0000","last_clean":"2024-09-15T23:18:56.406927+0000","last_became_active":"2024-09-15T23:18:55.400092+0000","last_became_peered":"2024-09-15T23:18:55.400092+0000","last_unstale":"2024-09-15T23:18:56.406927+0000","last_undegraded":"2024-09-15T23:18:56.406927+0000","last_fullsized":"2024-09-15T23:18:56.406927+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:48:38.324698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.423840+0000","last_change":"2024-09-15T23:18:55.418935+0000","last_active":"2024-09-15T23:18:55.423840+0000","last_peered":"2024-09-15T23:18:55.423840+0000","last_clean":"2024-09-15T23:18:55.423840+0000","last_became_active":"2024-09-15T23:18:55.418679+0000","last_became_peered":"2024-09-15T23:18:55.418679+0000","last_unstale":"2024-09-15T23:18:55.423840+0000","last_undegraded":"2024-09-15T23:18:55.423840+0000","last_fullsized":"2024-09-15T23:18:55.423840+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:16.210045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.412239+0000","last_change":"2024-09-15T23:18:55.408374+0000","last_active":"2024-09-15T23:18:55.412239+0000","last_peered":"2024-09-15T23:18:55.412239+0000","last_clean":"2024-09-15T23:18:55.412239+0000","last_became_active":"2024-09-15T23:18:55.408101+0000","last_became_peered":"2024-09-15T23:18:55.408101+0000","last_unstale":"2024-09-15T23:18:55.412239+0000","last_undegraded":"2024-09-15T23:18:55.412239+0000","last_fullsized":"2024-09-15T23:18:55.412239+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:31.293761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.420498+0000","last_change":"2024-09-15T23:18:55.419260+0000","last_active":"2024-09-15T23:18:55.420498+0000","last_peered":"2024-09-15T23:18:55.420498+0000","last_clean":"2024-09-15T23:18:55.420498+0000","last_became_active":"2024-09-15T23:18:55.418943+0000","last_became_peered":"2024-09-15T23:18:55.418943+0000","last_unstale":"2024-09-15T23:18:55.420498+0000","last_undegraded":"2024-09-15T23:18:55.420498+0000","last_fullsized":"2024-09-15T23:18:55.420498+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:30.448015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701052+0000","last_change":"2024-09-15T23:18:55.403999+0000","last_active":"2024-09-15T23:18:56.701052+0000","last_peered":"2024-09-15T23:18:56.701052+0000","last_clean":"2024-09-15T23:18:56.701052+0000","last_became_active":"2024-09-15T23:18:55.403726+0000","last_became_peered":"2024-09-15T23:18:55.403726+0000","last_unstale":"2024-09-15T23:18:56.701052+0000","last_undegraded":"2024-09-15T23:18:56.701052+0000","last_fullsized":"2024-09-15T23:18:56.701052+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:01.211423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700853+0000","last_change":"2024-09-15T23:18:55.398245+0000","last_active":"2024-09-15T23:18:56.700853+0000","last_peered":"2024-09-15T23:18:56.700853+0000","last_clean":"2024-09-15T23:18:56.700853+0000","last_became_active":"2024-09-15T23:18:55.397982+0000","last_became_peered":"2024-09-15T23:18:55.397982+0000","last_unstale":"2024-09-15T23:18:56.700853+0000","last_undegraded":"2024-09-15T23:18:56.700853+0000","last_fullsized":"2024-09-15T23:18:56.700853+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:55.222066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406063+0000","last_change":"2024-09-15T23:18:55.421369+0000","last_active":"2024-09-15T23:18:56.406063+0000","last_peered":"2024-09-15T23:18:56.406063+0000","last_clean":"2024-09-15T23:18:56.406063+0000","last_became_active":"2024-09-15T23:18:55.421014+0000","last_became_peered":"2024-09-15T23:18:55.421014+0000","last_unstale":"2024-09-15T23:18:56.406063+0000","last_undegraded":"2024-09-15T23:18:56.406063+0000","last_fullsized":"2024-09-15T23:18:56.406063+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:50.969453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.407113+0000","last_change":"2024-09-15T23:18:55.403062+0000","last_active":"2024-09-15T23:18:55.407113+0000","last_peered":"2024-09-15T23:18:55.407113+0000","last_clean":"2024-09-15T23:18:55.407113+0000","last_became_active":"2024-09-15T23:18:55.402715+0000","last_became_peered":"2024-09-15T23:18:55.402715+0000","last_unstale":"2024-09-15T23:18:55.407113+0000","last_undegraded":"2024-09-15T23:18:55.407113+0000","last_fullsized":"2024-09-15T23:18:55.407113+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:56.087785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701006+0000","last_change":"2024-09-15T23:18:55.410360+0000","last_active":"2024-09-15T23:18:56.701006+0000","last_peered":"2024-09-15T23:18:56.701006+0000","last_clean":"2024-09-15T23:18:56.701006+0000","last_became_active":"2024-09-15T23:18:55.410054+0000","last_became_peered":"2024-09-15T23:18:55.410054+0000","last_unstale":"2024-09-15T23:18:56.701006+0000","last_undegraded":"2024-09-15T23:18:56.701006+0000","last_fullsized":"2024-09-15T23:18:56.701006+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:15:00.338739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.406426+0000","last_change":"2024-09-15T23:18:55.402262+0000","last_active":"2024-09-15T23:18:55.406426+0000","last_peered":"2024-09-15T23:18:55.406426+0000","last_clean":"2024-09-15T23:18:55.406426+0000","last_became_active":"2024-09-15T23:18:55.401993+0000","last_became_peered":"2024-09-15T23:18:55.401993+0000","last_unstale":"2024-09-15T23:18:55.406426+0000","last_undegraded":"2024-09-15T23:18:55.406426+0000","last_fullsized":"2024-09-15T23:18:55.406426+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:43:24.833753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406749+0000","last_change":"2024-09-15T23:18:55.415683+0000","last_active":"2024-09-15T23:18:56.406749+0000","last_peered":"2024-09-15T23:18:56.406749+0000","last_clean":"2024-09-15T23:18:56.406749+0000","last_became_active":"2024-09-15T23:18:55.415448+0000","last_became_peered":"2024-09-15T23:18:55.415448+0000","last_unstale":"2024-09-15T23:18:56.406749+0000","last_undegraded":"2024-09-15T23:18:56.406749+0000","last_fullsized":"2024-09-15T23:18:56.406749+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:16.891519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700329+0000","last_change":"2024-09-15T23:18:55.404271+0000","last_active":"2024-09-15T23:18:56.700329+0000","last_peered":"2024-09-15T23:18:56.700329+0000","last_clean":"2024-09-15T23:18:56.700329+0000","last_became_active":"2024-09-15T23:18:55.404001+0000","last_became_peered":"2024-09-15T23:18:55.404001+0000","last_unstale":"2024-09-15T23:18:56.700329+0000","last_undegraded":"2024-09-15T23:18:56.700329+0000","last_fullsized":"2024-09-15T23:18:56.700329+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:16.891519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.405868+0000","last_change":"2024-09-15T23:18:55.405009+0000","last_active":"2024-09-15T23:18:56.405868+0000","last_peered":"2024-09-15T23:18:56.405868+0000","last_clean":"2024-09-15T23:18:56.405868+0000","last_became_active":"2024-09-15T23:18:55.404627+0000","last_became_peered":"2024-09-15T23:18:55.404627+0000","last_unstale":"2024-09-15T23:18:56.405868+0000","last_undegraded":"2024-09-15T23:18:56.405868+0000","last_fullsized":"2024-09-15T23:18:56.405868+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:46.431898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.410005+0000","last_change":"2024-09-15T23:18:55.408322+0000","last_active":"2024-09-15T23:18:55.410005+0000","last_peered":"2024-09-15T23:18:55.410005+0000","last_clean":"2024-09-15T23:18:55.410005+0000","last_became_active":"2024-09-15T23:18:55.407499+0000","last_became_peered":"2024-09-15T23:18:55.407499+0000","last_unstale":"2024-09-15T23:18:55.410005+0000","last_undegraded":"2024-09-15T23:18:55.410005+0000","last_fullsized":"2024-09-15T23:18:55.410005+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:57.755558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406586+0000","last_change":"2024-09-15T23:18:55.404358+0000","last_active":"2024-09-15T23:18:56.406586+0000","last_peered":"2024-09-15T23:18:56.406586+0000","last_clean":"2024-09-15T23:18:56.406586+0000","last_became_active":"2024-09-15T23:18:55.404100+0000","last_became_peered":"2024-09-15T23:18:55.404100+0000","last_unstale":"2024-09-15T23:18:56.406586+0000","last_undegraded":"2024-09-15T23:18:56.406586+0000","last_fullsized":"2024-09-15T23:18:56.406586+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:21.016141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701011+0000","last_change":"2024-09-15T23:18:55.407473+0000","last_active":"2024-09-15T23:18:56.701011+0000","last_peered":"2024-09-15T23:18:56.701011+0000","last_clean":"2024-09-15T23:18:56.701011+0000","last_became_active":"2024-09-15T23:18:55.407214+0000","last_became_peered":"2024-09-15T23:18:55.407214+0000","last_unstale":"2024-09-15T23:18:56.701011+0000","last_undegraded":"2024-09-15T23:18:56.701011+0000","last_fullsized":"2024-09-15T23:18:56.701011+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:40.177832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406997+0000","last_change":"2024-09-15T23:18:55.408609+0000","last_active":"2024-09-15T23:18:56.406997+0000","last_peered":"2024-09-15T23:18:56.406997+0000","last_clean":"2024-09-15T23:18:56.406997+0000","last_became_active":"2024-09-15T23:18:55.408329+0000","last_became_peered":"2024-09-15T23:18:55.408329+0000","last_unstale":"2024-09-15T23:18:56.406997+0000","last_undegraded":"2024-09-15T23:18:56.406997+0000","last_fullsized":"2024-09-15T23:18:56.406997+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:30:19.756605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406800+0000","last_change":"2024-09-15T23:18:55.420163+0000","last_active":"2024-09-15T23:18:56.406800+0000","last_peered":"2024-09-15T23:18:56.406800+0000","last_clean":"2024-09-15T23:18:56.406800+0000","last_became_active":"2024-09-15T23:18:55.419852+0000","last_became_peered":"2024-09-15T23:18:55.419852+0000","last_unstale":"2024-09-15T23:18:56.406800+0000","last_undegraded":"2024-09-15T23:18:56.406800+0000","last_fullsized":"2024-09-15T23:18:56.406800+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:30:32.698998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701221+0000","last_change":"2024-09-15T23:18:55.420726+0000","last_active":"2024-09-15T23:18:56.701221+0000","last_peered":"2024-09-15T23:18:56.701221+0000","last_clean":"2024-09-15T23:18:56.701221+0000","last_became_active":"2024-09-15T23:18:55.420451+0000","last_became_peered":"2024-09-15T23:18:55.420451+0000","last_unstale":"2024-09-15T23:18:56.701221+0000","last_undegraded":"2024-09-15T23:18:56.701221+0000","last_fullsized":"2024-09-15T23:18:56.701221+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:47:14.517683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.407195+0000","last_change":"2024-09-15T23:18:55.404066+0000","last_active":"2024-09-15T23:18:55.407195+0000","last_peered":"2024-09-15T23:18:55.407195+0000","last_clean":"2024-09-15T23:18:55.407195+0000","last_became_active":"2024-09-15T23:18:55.403800+0000","last_became_peered":"2024-09-15T23:18:55.403800+0000","last_unstale":"2024-09-15T23:18:55.407195+0000","last_undegraded":"2024-09-15T23:18:55.407195+0000","last_fullsized":"2024-09-15T23:18:55.407195+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:47.101262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700192+0000","last_change":"2024-09-15T23:18:55.400842+0000","last_active":"2024-09-15T23:18:56.700192+0000","last_peered":"2024-09-15T23:18:56.700192+0000","last_clean":"2024-09-15T23:18:56.700192+0000","last_became_active":"2024-09-15T23:18:55.400588+0000","last_became_peered":"2024-09-15T23:18:55.400588+0000","last_unstale":"2024-09-15T23:18:56.700192+0000","last_undegraded":"2024-09-15T23:18:56.700192+0000","last_fullsized":"2024-09-15T23:18:56.700192+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:39.885512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.423809+0000","last_change":"2024-09-15T23:18:55.419619+0000","last_active":"2024-09-15T23:18:55.423809+0000","last_peered":"2024-09-15T23:18:55.423809+0000","last_clean":"2024-09-15T23:18:55.423809+0000","last_became_active":"2024-09-15T23:18:55.419359+0000","last_became_peered":"2024-09-15T23:18:55.419359+0000","last_unstale":"2024-09-15T23:18:55.423809+0000","last_undegraded":"2024-09-15T23:18:55.423809+0000","last_fullsized":"2024-09-15T23:18:55.423809+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:34.236072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701073+0000","last_change":"2024-09-15T23:18:55.398562+0000","last_active":"2024-09-15T23:18:56.701073+0000","last_peered":"2024-09-15T23:18:56.701073+0000","last_clean":"2024-09-15T23:18:56.701073+0000","last_became_active":"2024-09-15T23:18:55.398281+0000","last_became_peered":"2024-09-15T23:18:55.398281+0000","last_unstale":"2024-09-15T23:18:56.701073+0000","last_undegraded":"2024-09-15T23:18:56.701073+0000","last_fullsized":"2024-09-15T23:18:56.701073+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:01.887504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.405710+0000","last_change":"2024-09-15T23:18:55.404025+0000","last_active":"2024-09-15T23:18:55.405710+0000","last_peered":"2024-09-15T23:18:55.405710+0000","last_clean":"2024-09-15T23:18:55.405710+0000","last_became_active":"2024-09-15T23:18:55.403532+0000","last_became_peered":"2024-09-15T23:18:55.403532+0000","last_unstale":"2024-09-15T23:18:55.405710+0000","last_undegraded":"2024-09-15T23:18:55.405710+0000","last_fullsized":"2024-09-15T23:18:55.405710+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:42.065674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.423787+0000","last_change":"2024-09-15T23:18:55.418863+0000","last_active":"2024-09-15T23:18:55.423787+0000","last_peered":"2024-09-15T23:18:55.423787+0000","last_clean":"2024-09-15T23:18:55.423787+0000","last_became_active":"2024-09-15T23:18:55.418588+0000","last_became_peered":"2024-09-15T23:18:55.418588+0000","last_unstale":"2024-09-15T23:18:55.423787+0000","last_undegraded":"2024-09-15T23:18:55.423787+0000","last_fullsized":"2024-09-15T23:18:55.423787+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:22:10.355949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.423738+0000","last_change":"2024-09-15T23:18:55.422451+0000","last_active":"2024-09-15T23:18:55.423738+0000","last_peered":"2024-09-15T23:18:55.423738+0000","last_clean":"2024-09-15T23:18:55.423738+0000","last_became_active":"2024-09-15T23:18:55.422162+0000","last_became_peered":"2024-09-15T23:18:55.422162+0000","last_unstale":"2024-09-15T23:18:55.423738+0000","last_undegraded":"2024-09-15T23:18:55.423738+0000","last_fullsized":"2024-09-15T23:18:55.423738+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:51.072258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700279+0000","last_change":"2024-09-15T23:18:55.404989+0000","last_active":"2024-09-15T23:18:56.700279+0000","last_peered":"2024-09-15T23:18:56.700279+0000","last_clean":"2024-09-15T23:18:56.700279+0000","last_became_active":"2024-09-15T23:18:55.404742+0000","last_became_peered":"2024-09-15T23:18:55.404742+0000","last_unstale":"2024-09-15T23:18:56.700279+0000","last_undegraded":"2024-09-15T23:18:56.700279+0000","last_fullsized":"2024-09-15T23:18:56.700279+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:27.764800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700977+0000","last_change":"2024-09-15T23:18:55.399851+0000","last_active":"2024-09-15T23:18:56.700977+0000","last_peered":"2024-09-15T23:18:56.700977+0000","last_clean":"2024-09-15T23:18:56.700977+0000","last_became_active":"2024-09-15T23:18:55.399565+0000","last_became_peered":"2024-09-15T23:18:55.399565+0000","last_unstale":"2024-09-15T23:18:56.700977+0000","last_undegraded":"2024-09-15T23:18:56.700977+0000","last_fullsized":"2024-09-15T23:18:56.700977+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:20.548159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406192+0000","last_change":"2024-09-15T23:18:55.411065+0000","last_active":"2024-09-15T23:18:56.406192+0000","last_peered":"2024-09-15T23:18:56.406192+0000","last_clean":"2024-09-15T23:18:56.406192+0000","last_became_active":"2024-09-15T23:18:55.410332+0000","last_became_peered":"2024-09-15T23:18:55.410332+0000","last_unstale":"2024-09-15T23:18:56.406192+0000","last_undegraded":"2024-09-15T23:18:56.406192+0000","last_fullsized":"2024-09-15T23:18:56.406192+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:04.081907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.410028+0000","last_change":"2024-09-15T23:18:55.408913+0000","last_active":"2024-09-15T23:18:55.410028+0000","last_peered":"2024-09-15T23:18:55.410028+0000","last_clean":"2024-09-15T23:18:55.410028+0000","last_became_active":"2024-09-15T23:18:55.408565+0000","last_became_peered":"2024-09-15T23:18:55.408565+0000","last_unstale":"2024-09-15T23:18:55.410028+0000","last_undegraded":"2024-09-15T23:18:55.410028+0000","last_fullsized":"2024-09-15T23:18:55.410028+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:12:03.648318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406037+0000","last_change":"2024-09-15T23:18:55.417434+0000","last_active":"2024-09-15T23:18:56.406037+0000","last_peered":"2024-09-15T23:18:56.406037+0000","last_clean":"2024-09-15T23:18:56.406037+0000","last_became_active":"2024-09-15T23:18:55.416979+0000","last_became_peered":"2024-09-15T23:18:55.416979+0000","last_unstale":"2024-09-15T23:18:56.406037+0000","last_undegraded":"2024-09-15T23:18:56.406037+0000","last_fullsized":"2024-09-15T23:18:56.406037+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:15.124012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"129'4","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700461+0000","last_change":"2024-09-15T23:18:54.398475+0000","last_active":"2024-09-15T23:18:56.700461+0000","last_peered":"2024-09-15T23:18:56.700461+0000","last_clean":"2024-09-15T23:18:56.700461+0000","last_became_active":"2024-09-15T23:18:54.398011+0000","last_became_peered":"2024-09-15T23:18:54.398011+0000","last_unstale":"2024-09-15T23:18:56.700461+0000","last_undegraded":"2024-09-15T23:18:56.700461+0000","last_fullsized":"2024-09-15T23:18:56.700461+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:30:20.062617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700530+0000","last_change":"2024-09-15T23:18:55.407002+0000","last_active":"2024-09-15T23:18:56.700530+0000","last_peered":"2024-09-15T23:18:56.700530+0000","last_clean":"2024-09-15T23:18:56.700530+0000","last_became_active":"2024-09-15T23:18:55.406555+0000","last_became_peered":"2024-09-15T23:18:55.406555+0000","last_unstale":"2024-09-15T23:18:56.700530+0000","last_undegraded":"2024-09-15T23:18:56.700530+0000","last_fullsized":"2024-09-15T23:18:56.700530+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:18.500607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1e","version":"129'1","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406860+0000","last_change":"2024-09-15T23:18:54.396189+0000","last_active":"2024-09-15T23:18:56.406860+0000","last_peered":"2024-09-15T23:18:56.406860+0000","last_clean":"2024-09-15T23:18:56.406860+0000","last_became_active":"2024-09-15T23:18:54.395896+0000","last_became_peered":"2024-09-15T23:18:54.395896+0000","last_unstale":"2024-09-15T23:18:56.406860+0000","last_undegraded":"2024-09-15T23:18:56.406860+0000","last_fullsized":"2024-09-15T23:18:56.406860+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:49:05.622615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.411110+0000","last_change":"2024-09-15T23:18:55.409732+0000","last_active":"2024-09-15T23:18:55.411110+0000","last_peered":"2024-09-15T23:18:55.411110+0000","last_clean":"2024-09-15T23:18:55.411110+0000","last_became_active":"2024-09-15T23:18:55.409301+0000","last_became_peered":"2024-09-15T23:18:55.409301+0000","last_unstale":"2024-09-15T23:18:55.411110+0000","last_undegraded":"2024-09-15T23:18:55.411110+0000","last_fullsized":"2024-09-15T23:18:55.411110+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:44.191737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1d","version":"129'2","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.422022+0000","last_change":"2024-09-15T23:18:54.406925+0000","last_active":"2024-09-15T23:18:55.422022+0000","last_peered":"2024-09-15T23:18:55.422022+0000","last_clean":"2024-09-15T23:18:55.422022+0000","last_became_active":"2024-09-15T23:18:54.406584+0000","last_became_peered":"2024-09-15T23:18:54.406584+0000","last_unstale":"2024-09-15T23:18:55.422022+0000","last_undegraded":"2024-09-15T23:18:55.422022+0000","last_fullsized":"2024-09-15T23:18:55.422022+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:41.060616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.407123+0000","last_change":"2024-09-15T23:18:55.410691+0000","last_active":"2024-09-15T23:18:56.407123+0000","last_peered":"2024-09-15T23:18:56.407123+0000","last_clean":"2024-09-15T23:18:56.407123+0000","last_became_active":"2024-09-15T23:18:55.410399+0000","last_became_peered":"2024-09-15T23:18:55.410399+0000","last_unstale":"2024-09-15T23:18:56.407123+0000","last_undegraded":"2024-09-15T23:18:56.407123+0000","last_fullsized":"2024-09-15T23:18:56.407123+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:56:42.354935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"129'2","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.422084+0000","last_change":"2024-09-15T23:18:54.407600+0000","last_active":"2024-09-15T23:18:55.422084+0000","last_peered":"2024-09-15T23:18:55.422084+0000","last_clean":"2024-09-15T23:18:55.422084+0000","last_became_active":"2024-09-15T23:18:54.407279+0000","last_became_peered":"2024-09-15T23:18:54.407279+0000","last_unstale":"2024-09-15T23:18:55.422084+0000","last_undegraded":"2024-09-15T23:18:55.422084+0000","last_fullsized":"2024-09-15T23:18:55.422084+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:43.186680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.422056+0000","last_change":"2024-09-15T23:18:55.417579+0000","last_active":"2024-09-15T23:18:55.422056+0000","last_peered":"2024-09-15T23:18:55.422056+0000","last_clean":"2024-09-15T23:18:55.422056+0000","last_became_active":"2024-09-15T23:18:55.417302+0000","last_became_peered":"2024-09-15T23:18:55.417302+0000","last_unstale":"2024-09-15T23:18:55.422056+0000","last_undegraded":"2024-09-15T23:18:55.422056+0000","last_fullsized":"2024-09-15T23:18:55.422056+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:48:22.001477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1b","version":"129'1","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406681+0000","last_change":"2024-09-15T23:18:54.409230+0000","last_active":"2024-09-15T23:18:56.406681+0000","last_peered":"2024-09-15T23:18:56.406681+0000","last_clean":"2024-09-15T23:18:56.406681+0000","last_became_active":"2024-09-15T23:18:54.408941+0000","last_became_peered":"2024-09-15T23:18:54.408941+0000","last_unstale":"2024-09-15T23:18:56.406681+0000","last_undegraded":"2024-09-15T23:18:56.406681+0000","last_fullsized":"2024-09-15T23:18:56.406681+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:19:18.665458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701163+0000","last_change":"2024-09-15T23:18:55.408319+0000","last_active":"2024-09-15T23:18:56.701163+0000","last_peered":"2024-09-15T23:18:56.701163+0000","last_clean":"2024-09-15T23:18:56.701163+0000","last_became_active":"2024-09-15T23:18:55.407909+0000","last_became_peered":"2024-09-15T23:18:55.407909+0000","last_unstale":"2024-09-15T23:18:56.701163+0000","last_undegraded":"2024-09-15T23:18:56.701163+0000","last_fullsized":"2024-09-15T23:18:56.701163+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:33.857493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1a","version":"129'1","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.405710+0000","last_change":"2024-09-15T23:18:54.398393+0000","last_active":"2024-09-15T23:18:56.405710+0000","last_peered":"2024-09-15T23:18:56.405710+0000","last_clean":"2024-09-15T23:18:56.405710+0000","last_became_active":"2024-09-15T23:18:54.398134+0000","last_became_peered":"2024-09-15T23:18:54.398134+0000","last_unstale":"2024-09-15T23:18:56.405710+0000","last_undegraded":"2024-09-15T23:18:56.405710+0000","last_fullsized":"2024-09-15T23:18:56.405710+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:15.886461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.421409+0000","last_change":"2024-09-15T23:18:55.420328+0000","last_active":"2024-09-15T23:18:55.421409+0000","last_peered":"2024-09-15T23:18:55.421409+0000","last_clean":"2024-09-15T23:18:55.421409+0000","last_became_active":"2024-09-15T23:18:55.420023+0000","last_became_peered":"2024-09-15T23:18:55.420023+0000","last_unstale":"2024-09-15T23:18:55.421409+0000","last_undegraded":"2024-09-15T23:18:55.421409+0000","last_fullsized":"2024-09-15T23:18:55.421409+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:21.016141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700931+0000","last_change":"2024-09-15T23:18:54.405165+0000","last_active":"2024-09-15T23:18:56.700931+0000","last_peered":"2024-09-15T23:18:56.700931+0000","last_clean":"2024-09-15T23:18:56.700931+0000","last_became_active":"2024-09-15T23:18:54.404908+0000","last_became_peered":"2024-09-15T23:18:54.404908+0000","last_unstale":"2024-09-15T23:18:56.700931+0000","last_undegraded":"2024-09-15T23:18:56.700931+0000","last_fullsized":"2024-09-15T23:18:56.700931+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:28.230682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700833+0000","last_change":"2024-09-15T23:18:55.402359+0000","last_active":"2024-09-15T23:18:56.700833+0000","last_peered":"2024-09-15T23:18:56.700833+0000","last_clean":"2024-09-15T23:18:56.700833+0000","last_became_active":"2024-09-15T23:18:55.402112+0000","last_became_peered":"2024-09-15T23:18:55.402112+0000","last_unstale":"2024-09-15T23:18:56.700833+0000","last_undegraded":"2024-09-15T23:18:56.700833+0000","last_fullsized":"2024-09-15T23:18:56.700833+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:21.974339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.397832+0000","last_change":"2024-09-15T23:18:54.408733+0000","last_active":"2024-09-15T23:18:55.397832+0000","last_peered":"2024-09-15T23:18:55.397832+0000","last_clean":"2024-09-15T23:18:55.397832+0000","last_became_active":"2024-09-15T23:18:54.408453+0000","last_became_peered":"2024-09-15T23:18:54.408453+0000","last_unstale":"2024-09-15T23:18:55.397832+0000","last_undegraded":"2024-09-15T23:18:55.397832+0000","last_fullsized":"2024-09-15T23:18:55.397832+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:19:18.665458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406872+0000","last_change":"2024-09-15T23:18:55.404975+0000","last_active":"2024-09-15T23:18:56.406872+0000","last_peered":"2024-09-15T23:18:56.406872+0000","last_clean":"2024-09-15T23:18:56.406872+0000","last_became_active":"2024-09-15T23:18:55.404699+0000","last_became_peered":"2024-09-15T23:18:55.404699+0000","last_unstale":"2024-09-15T23:18:56.406872+0000","last_undegraded":"2024-09-15T23:18:56.406872+0000","last_fullsized":"2024-09-15T23:18:56.406872+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:18.500607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.400530+0000","last_change":"2024-09-15T23:18:54.409517+0000","last_active":"2024-09-15T23:18:55.400530+0000","last_peered":"2024-09-15T23:18:55.400530+0000","last_clean":"2024-09-15T23:18:55.400530+0000","last_became_active":"2024-09-15T23:18:54.409082+0000","last_became_peered":"2024-09-15T23:18:54.409082+0000","last_unstale":"2024-09-15T23:18:55.400530+0000","last_undegraded":"2024-09-15T23:18:55.400530+0000","last_fullsized":"2024-09-15T23:18:55.400530+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:41:08.697739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.407359+0000","last_change":"2024-09-15T23:18:55.412597+0000","last_active":"2024-09-15T23:18:56.407359+0000","last_peered":"2024-09-15T23:18:56.407359+0000","last_clean":"2024-09-15T23:18:56.407359+0000","last_became_active":"2024-09-15T23:18:55.412363+0000","last_became_peered":"2024-09-15T23:18:55.412363+0000","last_unstale":"2024-09-15T23:18:56.407359+0000","last_undegraded":"2024-09-15T23:18:56.407359+0000","last_fullsized":"2024-09-15T23:18:56.407359+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:26.156621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.397924+0000","last_change":"2024-09-15T23:18:54.401049+0000","last_active":"2024-09-15T23:18:55.397924+0000","last_peered":"2024-09-15T23:18:55.397924+0000","last_clean":"2024-09-15T23:18:55.397924+0000","last_became_active":"2024-09-15T23:18:54.400776+0000","last_became_peered":"2024-09-15T23:18:54.400776+0000","last_unstale":"2024-09-15T23:18:55.397924+0000","last_undegraded":"2024-09-15T23:18:55.397924+0000","last_fullsized":"2024-09-15T23:18:55.397924+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:31.412905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.405676+0000","last_change":"2024-09-15T23:18:55.403705+0000","last_active":"2024-09-15T23:18:55.405676+0000","last_peered":"2024-09-15T23:18:55.405676+0000","last_clean":"2024-09-15T23:18:55.405676+0000","last_became_active":"2024-09-15T23:18:55.403391+0000","last_became_peered":"2024-09-15T23:18:55.403391+0000","last_unstale":"2024-09-15T23:18:55.405676+0000","last_undegraded":"2024-09-15T23:18:55.405676+0000","last_fullsized":"2024-09-15T23:18:55.405676+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:19.216199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"129'3","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.422572+0000","last_change":"2024-09-15T23:18:54.404045+0000","last_active":"2024-09-15T23:18:55.422572+0000","last_peered":"2024-09-15T23:18:55.422572+0000","last_clean":"2024-09-15T23:18:55.422572+0000","last_became_active":"2024-09-15T23:18:54.403773+0000","last_became_peered":"2024-09-15T23:18:54.403773+0000","last_unstale":"2024-09-15T23:18:55.422572+0000","last_undegraded":"2024-09-15T23:18:55.422572+0000","last_fullsized":"2024-09-15T23:18:55.422572+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:02:31.113880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701152+0000","last_change":"2024-09-15T23:18:55.397107+0000","last_active":"2024-09-15T23:18:56.701152+0000","last_peered":"2024-09-15T23:18:56.701152+0000","last_clean":"2024-09-15T23:18:56.701152+0000","last_became_active":"2024-09-15T23:18:55.396831+0000","last_became_peered":"2024-09-15T23:18:55.396831+0000","last_unstale":"2024-09-15T23:18:56.701152+0000","last_undegraded":"2024-09-15T23:18:56.701152+0000","last_fullsized":"2024-09-15T23:18:56.701152+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:36.994916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.14","version":"129'6","reported_seq":18,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.425154+0000","last_change":"2024-09-15T23:18:54.407446+0000","last_active":"2024-09-15T23:18:55.425154+0000","last_peered":"2024-09-15T23:18:55.425154+0000","last_clean":"2024-09-15T23:18:55.425154+0000","last_became_active":"2024-09-15T23:18:54.407141+0000","last_became_peered":"2024-09-15T23:18:54.407141+0000","last_unstale":"2024-09-15T23:18:55.425154+0000","last_undegraded":"2024-09-15T23:18:55.425154+0000","last_fullsized":"2024-09-15T23:18:55.425154+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:29.442958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.409717+0000","last_change":"2024-09-15T23:18:55.407912+0000","last_active":"2024-09-15T23:18:55.409717+0000","last_peered":"2024-09-15T23:18:55.409717+0000","last_clean":"2024-09-15T23:18:55.409717+0000","last_became_active":"2024-09-15T23:18:55.407554+0000","last_became_peered":"2024-09-15T23:18:55.407554+0000","last_unstale":"2024-09-15T23:18:55.409717+0000","last_undegraded":"2024-09-15T23:18:55.409717+0000","last_fullsized":"2024-09-15T23:18:55.409717+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:45:08.058331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"129'2","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.419017+0000","last_change":"2024-09-15T23:18:54.402978+0000","last_active":"2024-09-15T23:18:55.419017+0000","last_peered":"2024-09-15T23:18:55.419017+0000","last_clean":"2024-09-15T23:18:55.419017+0000","last_became_active":"2024-09-15T23:18:54.401842+0000","last_became_peered":"2024-09-15T23:18:54.401842+0000","last_unstale":"2024-09-15T23:18:55.419017+0000","last_undegraded":"2024-09-15T23:18:55.419017+0000","last_fullsized":"2024-09-15T23:18:55.419017+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:33.884558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.423768+0000","last_change":"2024-09-15T23:18:55.418699+0000","last_active":"2024-09-15T23:18:55.423768+0000","last_peered":"2024-09-15T23:18:55.423768+0000","last_clean":"2024-09-15T23:18:55.423768+0000","last_became_active":"2024-09-15T23:18:55.418360+0000","last_became_peered":"2024-09-15T23:18:55.418360+0000","last_unstale":"2024-09-15T23:18:55.423768+0000","last_undegraded":"2024-09-15T23:18:55.423768+0000","last_fullsized":"2024-09-15T23:18:55.423768+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:42:21.996440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406559+0000","last_change":"2024-09-15T23:18:54.404649+0000","last_active":"2024-09-15T23:18:56.406559+0000","last_peered":"2024-09-15T23:18:56.406559+0000","last_clean":"2024-09-15T23:18:56.406559+0000","last_became_active":"2024-09-15T23:18:54.404432+0000","last_became_peered":"2024-09-15T23:18:54.404432+0000","last_unstale":"2024-09-15T23:18:56.406559+0000","last_undegraded":"2024-09-15T23:18:56.406559+0000","last_fullsized":"2024-09-15T23:18:56.406559+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:31.412905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.421672+0000","last_change":"2024-09-15T23:18:55.414604+0000","last_active":"2024-09-15T23:18:55.421672+0000","last_peered":"2024-09-15T23:18:55.421672+0000","last_clean":"2024-09-15T23:18:55.421672+0000","last_became_active":"2024-09-15T23:18:55.414206+0000","last_became_peered":"2024-09-15T23:18:55.414206+0000","last_unstale":"2024-09-15T23:18:55.421672+0000","last_undegraded":"2024-09-15T23:18:55.421672+0000","last_fullsized":"2024-09-15T23:18:55.421672+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:51.072258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"129'8","reported_seq":22,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.405970+0000","last_change":"2024-09-15T23:18:54.396324+0000","last_active":"2024-09-15T23:18:56.405970+0000","last_peered":"2024-09-15T23:18:56.405970+0000","last_clean":"2024-09-15T23:18:56.405970+0000","last_became_active":"2024-09-15T23:18:54.395912+0000","last_became_peered":"2024-09-15T23:18:54.395912+0000","last_unstale":"2024-09-15T23:18:56.405970+0000","last_undegraded":"2024-09-15T23:18:56.405970+0000","last_fullsized":"2024-09-15T23:18:56.405970+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:40.585024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406206+0000","last_change":"2024-09-15T23:18:55.407625+0000","last_active":"2024-09-15T23:18:56.406206+0000","last_peered":"2024-09-15T23:18:56.406206+0000","last_clean":"2024-09-15T23:18:56.406206+0000","last_became_active":"2024-09-15T23:18:55.407035+0000","last_became_peered":"2024-09-15T23:18:55.407035+0000","last_unstale":"2024-09-15T23:18:56.406206+0000","last_undegraded":"2024-09-15T23:18:56.406206+0000","last_fullsized":"2024-09-15T23:18:56.406206+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:24.712832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.f","version":"129'1","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.407973+0000","last_change":"2024-09-15T23:18:54.408656+0000","last_active":"2024-09-15T23:18:55.407973+0000","last_peered":"2024-09-15T23:18:55.407973+0000","last_clean":"2024-09-15T23:18:55.407973+0000","last_became_active":"2024-09-15T23:18:54.408298+0000","last_became_peered":"2024-09-15T23:18:54.408298+0000","last_unstale":"2024-09-15T23:18:55.407973+0000","last_undegraded":"2024-09-15T23:18:55.407973+0000","last_fullsized":"2024-09-15T23:18:55.407973+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:41:08.697739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406051+0000","last_change":"2024-09-15T23:18:55.420952+0000","last_active":"2024-09-15T23:18:56.406051+0000","last_peered":"2024-09-15T23:18:56.406051+0000","last_clean":"2024-09-15T23:18:56.406051+0000","last_became_active":"2024-09-15T23:18:55.420608+0000","last_became_peered":"2024-09-15T23:18:55.420608+0000","last_unstale":"2024-09-15T23:18:56.406051+0000","last_undegraded":"2024-09-15T23:18:56.406051+0000","last_fullsized":"2024-09-15T23:18:56.406051+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:05.126336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"129'2","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.418055+0000","last_change":"2024-09-15T23:18:54.399080+0000","last_active":"2024-09-15T23:18:55.418055+0000","last_peered":"2024-09-15T23:18:55.418055+0000","last_clean":"2024-09-15T23:18:55.418055+0000","last_became_active":"2024-09-15T23:18:54.398761+0000","last_became_peered":"2024-09-15T23:18:54.398761+0000","last_unstale":"2024-09-15T23:18:55.418055+0000","last_undegraded":"2024-09-15T23:18:55.418055+0000","last_fullsized":"2024-09-15T23:18:55.418055+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:15:19.613132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701042+0000","last_change":"2024-09-15T23:18:55.407563+0000","last_active":"2024-09-15T23:18:56.701042+0000","last_peered":"2024-09-15T23:18:56.701042+0000","last_clean":"2024-09-15T23:18:56.701042+0000","last_became_active":"2024-09-15T23:18:55.407272+0000","last_became_peered":"2024-09-15T23:18:55.407272+0000","last_unstale":"2024-09-15T23:18:56.701042+0000","last_undegraded":"2024-09-15T23:18:56.701042+0000","last_fullsized":"2024-09-15T23:18:56.701042+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:45:46.712832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.d","version":"129'1","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700580+0000","last_change":"2024-09-15T23:18:54.408910+0000","last_active":"2024-09-15T23:18:56.700580+0000","last_peered":"2024-09-15T23:18:56.700580+0000","last_clean":"2024-09-15T23:18:56.700580+0000","last_became_active":"2024-09-15T23:18:54.408560+0000","last_became_peered":"2024-09-15T23:18:54.408560+0000","last_unstale":"2024-09-15T23:18:56.700580+0000","last_undegraded":"2024-09-15T23:18:56.700580+0000","last_fullsized":"2024-09-15T23:18:56.700580+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:12.663116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700530+0000","last_change":"2024-09-15T23:18:55.408070+0000","last_active":"2024-09-15T23:18:56.700530+0000","last_peered":"2024-09-15T23:18:56.700530+0000","last_clean":"2024-09-15T23:18:56.700530+0000","last_became_active":"2024-09-15T23:18:55.407757+0000","last_became_peered":"2024-09-15T23:18:55.407757+0000","last_unstale":"2024-09-15T23:18:56.700530+0000","last_undegraded":"2024-09-15T23:18:56.700530+0000","last_fullsized":"2024-09-15T23:18:56.700530+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:26.156621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700144+0000","last_change":"2024-09-15T23:18:54.403524+0000","last_active":"2024-09-15T23:18:56.700144+0000","last_peered":"2024-09-15T23:18:56.700144+0000","last_clean":"2024-09-15T23:18:56.700144+0000","last_became_active":"2024-09-15T23:18:54.403264+0000","last_became_peered":"2024-09-15T23:18:54.403264+0000","last_unstale":"2024-09-15T23:18:56.700144+0000","last_undegraded":"2024-09-15T23:18:56.700144+0000","last_fullsized":"2024-09-15T23:18:56.700144+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:18:38.675736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406417+0000","last_change":"2024-09-15T23:18:55.399612+0000","last_active":"2024-09-15T23:18:56.406417+0000","last_peered":"2024-09-15T23:18:56.406417+0000","last_clean":"2024-09-15T23:18:56.406417+0000","last_became_active":"2024-09-15T23:18:55.399306+0000","last_became_peered":"2024-09-15T23:18:55.399306+0000","last_unstale":"2024-09-15T23:18:56.406417+0000","last_undegraded":"2024-09-15T23:18:56.406417+0000","last_fullsized":"2024-09-15T23:18:56.406417+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:12:03.648318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.b","version":"129'2","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.418282+0000","last_change":"2024-09-15T23:18:54.403225+0000","last_active":"2024-09-15T23:18:55.418282+0000","last_peered":"2024-09-15T23:18:55.418282+0000","last_clean":"2024-09-15T23:18:55.418282+0000","last_became_active":"2024-09-15T23:18:54.402587+0000","last_became_peered":"2024-09-15T23:18:54.402587+0000","last_unstale":"2024-09-15T23:18:55.418282+0000","last_undegraded":"2024-09-15T23:18:55.418282+0000","last_fullsized":"2024-09-15T23:18:55.418282+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:49.966929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.405777+0000","last_change":"2024-09-15T23:18:55.403788+0000","last_active":"2024-09-15T23:18:56.405777+0000","last_peered":"2024-09-15T23:18:56.405777+0000","last_clean":"2024-09-15T23:18:56.405777+0000","last_became_active":"2024-09-15T23:18:55.402873+0000","last_became_peered":"2024-09-15T23:18:55.402873+0000","last_unstale":"2024-09-15T23:18:56.405777+0000","last_undegraded":"2024-09-15T23:18:56.405777+0000","last_fullsized":"2024-09-15T23:18:56.405777+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:48.439573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.405920+0000","last_change":"2024-09-15T23:18:54.404950+0000","last_active":"2024-09-15T23:18:56.405920+0000","last_peered":"2024-09-15T23:18:56.405920+0000","last_clean":"2024-09-15T23:18:56.405920+0000","last_became_active":"2024-09-15T23:18:54.404532+0000","last_became_peered":"2024-09-15T23:18:54.404532+0000","last_unstale":"2024-09-15T23:18:56.405920+0000","last_undegraded":"2024-09-15T23:18:56.405920+0000","last_fullsized":"2024-09-15T23:18:56.405920+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:51:30.132064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700080+0000","last_change":"2024-09-15T23:18:55.407538+0000","last_active":"2024-09-15T23:18:56.700080+0000","last_peered":"2024-09-15T23:18:56.700080+0000","last_clean":"2024-09-15T23:18:56.700080+0000","last_became_active":"2024-09-15T23:18:55.407296+0000","last_became_peered":"2024-09-15T23:18:55.407296+0000","last_unstale":"2024-09-15T23:18:56.700080+0000","last_undegraded":"2024-09-15T23:18:56.700080+0000","last_fullsized":"2024-09-15T23:18:56.700080+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:49:06.627673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.400203+0000","last_change":"2024-09-15T23:18:54.405325+0000","last_active":"2024-09-15T23:18:55.400203+0000","last_peered":"2024-09-15T23:18:55.400203+0000","last_clean":"2024-09-15T23:18:55.400203+0000","last_became_active":"2024-09-15T23:18:54.405043+0000","last_became_peered":"2024-09-15T23:18:54.405043+0000","last_unstale":"2024-09-15T23:18:55.400203+0000","last_undegraded":"2024-09-15T23:18:55.400203+0000","last_fullsized":"2024-09-15T23:18:55.400203+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:38:39.917102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.421103+0000","last_change":"2024-09-15T23:18:55.420197+0000","last_active":"2024-09-15T23:18:55.421103+0000","last_peered":"2024-09-15T23:18:55.421103+0000","last_clean":"2024-09-15T23:18:55.421103+0000","last_became_active":"2024-09-15T23:18:55.419859+0000","last_became_peered":"2024-09-15T23:18:55.419859+0000","last_unstale":"2024-09-15T23:18:55.421103+0000","last_undegraded":"2024-09-15T23:18:55.421103+0000","last_fullsized":"2024-09-15T23:18:55.421103+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:08.549835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.411690+0000","last_change":"2024-09-15T23:18:54.402999+0000","last_active":"2024-09-15T23:18:55.411690+0000","last_peered":"2024-09-15T23:18:55.411690+0000","last_clean":"2024-09-15T23:18:55.411690+0000","last_became_active":"2024-09-15T23:18:54.402530+0000","last_became_peered":"2024-09-15T23:18:54.402530+0000","last_unstale":"2024-09-15T23:18:55.411690+0000","last_undegraded":"2024-09-15T23:18:55.411690+0000","last_fullsized":"2024-09-15T23:18:55.411690+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:31.992688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700227+0000","last_change":"2024-09-15T23:18:55.408301+0000","last_active":"2024-09-15T23:18:56.700227+0000","last_peered":"2024-09-15T23:18:56.700227+0000","last_clean":"2024-09-15T23:18:56.700227+0000","last_became_active":"2024-09-15T23:18:55.408049+0000","last_became_peered":"2024-09-15T23:18:55.408049+0000","last_unstale":"2024-09-15T23:18:56.700227+0000","last_undegraded":"2024-09-15T23:18:56.700227+0000","last_fullsized":"2024-09-15T23:18:56.700227+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:03.216424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"129'2","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.422002+0000","last_change":"2024-09-15T23:18:54.409345+0000","last_active":"2024-09-15T23:18:55.422002+0000","last_peered":"2024-09-15T23:18:55.422002+0000","last_clean":"2024-09-15T23:18:55.422002+0000","last_became_active":"2024-09-15T23:18:54.408730+0000","last_became_peered":"2024-09-15T23:18:54.408730+0000","last_unstale":"2024-09-15T23:18:55.422002+0000","last_undegraded":"2024-09-15T23:18:55.422002+0000","last_fullsized":"2024-09-15T23:18:55.422002+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:18.211142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.407857+0000","last_change":"2024-09-15T23:18:55.404465+0000","last_active":"2024-09-15T23:18:55.407857+0000","last_peered":"2024-09-15T23:18:55.407857+0000","last_clean":"2024-09-15T23:18:55.407857+0000","last_became_active":"2024-09-15T23:18:55.404184+0000","last_became_peered":"2024-09-15T23:18:55.404184+0000","last_unstale":"2024-09-15T23:18:55.407857+0000","last_undegraded":"2024-09-15T23:18:55.407857+0000","last_fullsized":"2024-09-15T23:18:55.407857+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:32.997745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"130'1","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:57.395993+0000","last_change":"2024-09-15T23:18:54.409506+0000","last_active":"2024-09-15T23:18:57.395993+0000","last_peered":"2024-09-15T23:18:57.395993+0000","last_clean":"2024-09-15T23:18:57.395993+0000","last_became_active":"2024-09-15T23:18:54.409261+0000","last_became_peered":"2024-09-15T23:18:54.409261+0000","last_unstale":"2024-09-15T23:18:57.395993+0000","last_undegraded":"2024-09-15T23:18:57.395993+0000","last_fullsized":"2024-09-15T23:18:57.395993+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:53.078597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406272+0000","last_change":"2024-09-15T23:18:55.413671+0000","last_active":"2024-09-15T23:18:56.406272+0000","last_peered":"2024-09-15T23:18:56.406272+0000","last_clean":"2024-09-15T23:18:56.406272+0000","last_became_active":"2024-09-15T23:18:55.413294+0000","last_became_peered":"2024-09-15T23:18:55.413294+0000","last_unstale":"2024-09-15T23:18:56.406272+0000","last_undegraded":"2024-09-15T23:18:56.406272+0000","last_fullsized":"2024-09-15T23:18:56.406272+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:20:38.130031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.410790+0000","last_change":"2024-09-15T23:18:54.402343+0000","last_active":"2024-09-15T23:18:55.410790+0000","last_peered":"2024-09-15T23:18:55.410790+0000","last_clean":"2024-09-15T23:18:55.410790+0000","last_became_active":"2024-09-15T23:18:54.402023+0000","last_became_peered":"2024-09-15T23:18:54.402023+0000","last_unstale":"2024-09-15T23:18:55.410790+0000","last_undegraded":"2024-09-15T23:18:55.410790+0000","last_fullsized":"2024-09-15T23:18:55.410790+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:46.096205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700528+0000","last_change":"2024-09-15T23:18:55.419096+0000","last_active":"2024-09-15T23:18:56.700528+0000","last_peered":"2024-09-15T23:18:56.700528+0000","last_clean":"2024-09-15T23:18:56.700528+0000","last_became_active":"2024-09-15T23:18:55.418856+0000","last_became_peered":"2024-09-15T23:18:55.418856+0000","last_unstale":"2024-09-15T23:18:56.700528+0000","last_undegraded":"2024-09-15T23:18:56.700528+0000","last_fullsized":"2024-09-15T23:18:56.700528+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:51:31.137122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.413800+0000","last_change":"2024-09-15T23:18:54.409421+0000","last_active":"2024-09-15T23:18:55.413800+0000","last_peered":"2024-09-15T23:18:55.413800+0000","last_clean":"2024-09-15T23:18:55.413800+0000","last_became_active":"2024-09-15T23:18:54.409046+0000","last_became_peered":"2024-09-15T23:18:54.409046+0000","last_unstale":"2024-09-15T23:18:55.413800+0000","last_undegraded":"2024-09-15T23:18:55.413800+0000","last_fullsized":"2024-09-15T23:18:55.413800+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:22.012773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406558+0000","last_change":"2024-09-15T23:18:55.415353+0000","last_active":"2024-09-15T23:18:56.406558+0000","last_peered":"2024-09-15T23:18:56.406558+0000","last_clean":"2024-09-15T23:18:56.406558+0000","last_became_active":"2024-09-15T23:18:55.415056+0000","last_became_peered":"2024-09-15T23:18:55.415056+0000","last_unstale":"2024-09-15T23:18:56.406558+0000","last_undegraded":"2024-09-15T23:18:56.406558+0000","last_fullsized":"2024-09-15T23:18:56.406558+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:08.549835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701255+0000","last_change":"2024-09-15T23:18:54.403901+0000","last_active":"2024-09-15T23:18:56.701255+0000","last_peered":"2024-09-15T23:18:56.701255+0000","last_clean":"2024-09-15T23:18:56.701255+0000","last_became_active":"2024-09-15T23:18:54.403584+0000","last_became_peered":"2024-09-15T23:18:54.403584+0000","last_unstale":"2024-09-15T23:18:56.701255+0000","last_undegraded":"2024-09-15T23:18:56.701255+0000","last_fullsized":"2024-09-15T23:18:56.701255+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:27:42.458023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700315+0000","last_change":"2024-09-15T23:18:55.408533+0000","last_active":"2024-09-15T23:18:56.700315+0000","last_peered":"2024-09-15T23:18:56.700315+0000","last_clean":"2024-09-15T23:18:56.700315+0000","last_became_active":"2024-09-15T23:18:55.408256+0000","last_became_peered":"2024-09-15T23:18:55.408256+0000","last_unstale":"2024-09-15T23:18:56.700315+0000","last_undegraded":"2024-09-15T23:18:56.700315+0000","last_fullsized":"2024-09-15T23:18:56.700315+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:41.590081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700144+0000","last_change":"2024-09-15T23:18:54.403029+0000","last_active":"2024-09-15T23:18:56.700144+0000","last_peered":"2024-09-15T23:18:56.700144+0000","last_clean":"2024-09-15T23:18:56.700144+0000","last_became_active":"2024-09-15T23:18:54.402755+0000","last_became_peered":"2024-09-15T23:18:54.402755+0000","last_unstale":"2024-09-15T23:18:56.700144+0000","last_undegraded":"2024-09-15T23:18:56.700144+0000","last_fullsized":"2024-09-15T23:18:56.700144+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:29.178188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700189+0000","last_change":"2024-09-15T23:18:55.400347+0000","last_active":"2024-09-15T23:18:56.700189+0000","last_peered":"2024-09-15T23:18:56.700189+0000","last_clean":"2024-09-15T23:18:56.700189+0000","last_became_active":"2024-09-15T23:18:55.400062+0000","last_became_peered":"2024-09-15T23:18:55.400062+0000","last_unstale":"2024-09-15T23:18:56.700189+0000","last_undegraded":"2024-09-15T23:18:56.700189+0000","last_fullsized":"2024-09-15T23:18:56.700189+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:57.314262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406194+0000","last_change":"2024-09-15T23:18:54.399228+0000","last_active":"2024-09-15T23:18:56.406194+0000","last_peered":"2024-09-15T23:18:56.406194+0000","last_clean":"2024-09-15T23:18:56.406194+0000","last_became_active":"2024-09-15T23:18:54.398231+0000","last_became_peered":"2024-09-15T23:18:54.398231+0000","last_unstale":"2024-09-15T23:18:56.406194+0000","last_undegraded":"2024-09-15T23:18:56.406194+0000","last_fullsized":"2024-09-15T23:18:56.406194+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:17.495549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.413353+0000","last_change":"2024-09-15T23:18:55.412629+0000","last_active":"2024-09-15T23:18:55.413353+0000","last_peered":"2024-09-15T23:18:55.413353+0000","last_clean":"2024-09-15T23:18:55.413353+0000","last_became_active":"2024-09-15T23:18:55.411135+0000","last_became_peered":"2024-09-15T23:18:55.411135+0000","last_unstale":"2024-09-15T23:18:55.413353+0000","last_undegraded":"2024-09-15T23:18:55.413353+0000","last_fullsized":"2024-09-15T23:18:55.413353+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:23.017830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.397678+0000","last_change":"2024-09-15T23:18:54.408515+0000","last_active":"2024-09-15T23:18:55.397678+0000","last_peered":"2024-09-15T23:18:55.397678+0000","last_clean":"2024-09-15T23:18:55.397678+0000","last_became_active":"2024-09-15T23:18:54.408246+0000","last_became_peered":"2024-09-15T23:18:54.408246+0000","last_unstale":"2024-09-15T23:18:55.397678+0000","last_undegraded":"2024-09-15T23:18:55.397678+0000","last_fullsized":"2024-09-15T23:18:55.397678+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:38:39.917102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-15T23:18:55.423628+0000","last_change":"2024-09-15T23:18:55.418483+0000","last_active":"2024-09-15T23:18:55.423628+0000","last_peered":"2024-09-15T23:18:55.423628+0000","last_clean":"2024-09-15T23:18:55.423628+0000","last_became_active":"2024-09-15T23:18:55.418114+0000","last_became_peered":"2024-09-15T23:18:55.418114+0000","last_unstale":"2024-09-15T23:18:55.423628+0000","last_undegraded":"2024-09-15T23:18:55.423628+0000","last_fullsized":"2024-09-15T23:18:55.423628+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:03:26.735040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406584+0000","last_change":"2024-09-15T23:18:54.404148+0000","last_active":"2024-09-15T23:18:56.406584+0000","last_peered":"2024-09-15T23:18:56.406584+0000","last_clean":"2024-09-15T23:18:56.406584+0000","last_became_active":"2024-09-15T23:18:54.403861+0000","last_became_peered":"2024-09-15T23:18:54.403861+0000","last_unstale":"2024-09-15T23:18:56.406584+0000","last_undegraded":"2024-09-15T23:18:56.406584+0000","last_fullsized":"2024-09-15T23:18:56.406584+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:56.309204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":369,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406289+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:18:56.406289+0000","last_peered":"2024-09-15T23:18:56.406289+0000","last_clean":"2024-09-15T23:18:56.406289+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:18:56.406289+0000","last_undegraded":"2024-09-15T23:18:56.406289+0000","last_fullsized":"2024-09-15T23:18:56.406289+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476825,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50800,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321040,"statfs":{"total":96636764160,"available":96584744960,"internally_reserved":0,"allocated":1601536,"data_stored":708257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476822,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46660,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325180,"statfs":{"total":96636764160,"available":96588984320,"internally_reserved":0,"allocated":1613824,"data_stored":708895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476824,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63860,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307980,"statfs":{"total":96636764160,"available":96571371520,"internally_reserved":0,"allocated":2195456,"data_stored":1298625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476824,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41080,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330760,"statfs":{"total":96636764160,"available":96594698240,"internally_reserved":0,"allocated":1609728,"data_stored":708909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542230,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41080,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330760,"statfs":{"total":96636764160,"available":96594698240,"internally_reserved":0,"allocated":1609728,"data_stored":703693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542230,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46636,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325204,"statfs":{"total":96636764160,"available":96589008896,"internally_reserved":0,"allocated":1589248,"data_stored":701957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542229,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51380,"kb_used_data":2140,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320460,"statfs":{"total":96636764160,"available":96584151040,"internally_reserved":0,"allocated":2191360,"data_stored":1292417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542231,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50808,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321032,"statfs":{"total":96636764160,"available":96584736768,"internally_reserved":0,"allocated":1605632,"data_stored":703659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:19:02.690 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:19:02.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.807+0000 7fdee5b9f640 1 Processor -- start 2024-09-15T23:19:02.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.807+0000 7fdee5b9f640 1 -- start start 2024-09-15T23:19:02.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.808+0000 7fdee5b9f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fdee00b6970 0x7fdee00b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:02.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.808+0000 7fdee5b9f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdee00d23b0 0x7fdee00b8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:02.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.808+0000 7fdee5b9f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdee00d0e70 con 0x7fdee015ed20 2024-09-15T23:19:02.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.808+0000 7fdee5b9f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fdee00d41c0 con 0x7fdee00d23b0 2024-09-15T23:19:02.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.808+0000 7fdee5b9f640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fdee00d35b0 con 0x7fdee00b6970 2024-09-15T23:19:02.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.808+0000 7fdedffff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdee00d23b0 0x7fdee00b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:02.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.808+0000 7fdedffff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdee00d23b0 0x7fdee00b8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38714/0 (socket says 172.21.15.123:38714) 2024-09-15T23:19:02.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.808+0000 7fdedffff640 1 -- 172.21.15.123:0/215709487 learned_addr learned my addr 172.21.15.123:0/215709487 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:02.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.808+0000 7fdedeffd640 1 --2- 172.21.15.123:0/215709487 >> v2:172.21.15.188:3300/0 conn(0x7fdee00b6970 0x7fdee00b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:02.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.808+0000 7fdedffff640 1 -- 172.21.15.123:0/215709487 >> v2:172.21.15.188:3300/0 conn(0x7fdee00b6970 msgr2=0x7fdee00b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:02.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.808+0000 7fdedffff640 1 --2- 172.21.15.123:0/215709487 >> v2:172.21.15.188:3300/0 conn(0x7fdee00b6970 0x7fdee00b80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:02.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.808+0000 7fdedffff640 1 -- 172.21.15.123:0/215709487 >> v1:172.21.15.188:6789/0 conn(0x7fdee015ed20 legacy=0x7fdee00b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:02.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.808+0000 7fdedffff640 1 -- 172.21.15.123:0/215709487 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee00d3890 con 0x7fdee00d23b0 2024-09-15T23:19:02.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.809+0000 7fdedffff640 1 --2- 172.21.15.123:0/215709487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdee00d23b0 0x7fdee00b8610 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fdee00d4690 tx=0x7fded802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36b969803295fc14 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:02.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.809+0000 7fdede7fc640 1 -- 172.21.15.123:0/215709487 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded8036070 con 0x7fdee00d23b0 2024-09-15T23:19:02.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.809+0000 7fdede7fc640 1 -- 172.21.15.123:0/215709487 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fded8031600 con 0x7fdee00d23b0 2024-09-15T23:19:02.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.809+0000 7fdede7fc640 1 -- 172.21.15.123:0/215709487 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded80319d0 con 0x7fdee00d23b0 2024-09-15T23:19:02.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.810+0000 7fdee5b9f640 1 -- 172.21.15.123:0/215709487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdee00d23b0 msgr2=0x7fdee00b8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:02.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.810+0000 7fdee5b9f640 1 --2- 172.21.15.123:0/215709487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdee00d23b0 0x7fdee00b8610 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fdee00d4690 tx=0x7fded802a6a0 comp rx=0 tx=0).stop 2024-09-15T23:19:02.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.810+0000 7fdee5b9f640 1 -- 172.21.15.123:0/215709487 shutdown_connections 2024-09-15T23:19:02.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.810+0000 7fdee5b9f640 1 --2- 172.21.15.123:0/215709487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdee00d23b0 0x7fdee00b8610 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:02.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.810+0000 7fdee5b9f640 1 --2- 172.21.15.123:0/215709487 >> v2:172.21.15.188:3300/0 conn(0x7fdee00b6970 0x7fdee00b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:02.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.810+0000 7fdee5b9f640 1 -- 172.21.15.123:0/215709487 >> 172.21.15.123:0/215709487 conn(0x7fdee00d1260 msgr2=0x7fdee00d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:02.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.810+0000 7fdee5b9f640 1 -- 172.21.15.123:0/215709487 shutdown_connections 2024-09-15T23:19:02.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.810+0000 7fdee5b9f640 1 -- 172.21.15.123:0/215709487 wait complete. 2024-09-15T23:19:02.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.811+0000 7fdee5b9f640 1 Processor -- start 2024-09-15T23:19:02.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.811+0000 7fdee5b9f640 1 -- start start 2024-09-15T23:19:02.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.812+0000 7fdee5b9f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdee00b6970 0x7fdee01f7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:02.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.812+0000 7fdee5b9f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdee00d23b0 0x7fdee00ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:02.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.812+0000 7fdee5b9f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdee015ed20 0x7fdee00b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:02.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.812+0000 7fdee5b9f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdee00d32a0 con 0x7fdee015ed20 2024-09-15T23:19:02.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.812+0000 7fdee5b9f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fdee00d3e50 con 0x7fdee00d23b0 2024-09-15T23:19:02.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.812+0000 7fdee5b9f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fdee015f100 con 0x7fdee00b6970 2024-09-15T23:19:02.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.812+0000 7fdedffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdee015ed20 0x7fdee00b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:02.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.812+0000 7fdedffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdee015ed20 0x7fdee00b52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38718/0 (socket says 172.21.15.123:38718) 2024-09-15T23:19:02.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.812+0000 7fdedffff640 1 -- 172.21.15.123:0/2343077539 learned_addr learned my addr 172.21.15.123:0/2343077539 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:02.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.812+0000 7fdedeffd640 1 --2- 172.21.15.123:0/2343077539 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdee00d23b0 0x7fdee00ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:02.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.812+0000 7fdedf7fe640 1 --2- 172.21.15.123:0/2343077539 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdee00b6970 0x7fdee01f7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:02.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.812+0000 7fdedffff640 1 -- 172.21.15.123:0/2343077539 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdee00b6970 msgr2=0x7fdee01f7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:02.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.812+0000 7fdedffff640 1 --2- 172.21.15.123:0/2343077539 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdee00b6970 0x7fdee01f7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:02.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.812+0000 7fdedffff640 1 -- 172.21.15.123:0/2343077539 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdee00d23b0 msgr2=0x7fdee00ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:02.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.812+0000 7fdedffff640 1 --2- 172.21.15.123:0/2343077539 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdee00d23b0 0x7fdee00ce3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:02.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.812+0000 7fdedffff640 1 -- 172.21.15.123:0/2343077539 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee01f4ea0 con 0x7fdee015ed20 2024-09-15T23:19:02.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.813+0000 7fdedffff640 1 --2- 172.21.15.123:0/2343077539 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdee015ed20 0x7fdee00b52a0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fded8034040 tx=0x7fded8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:02.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.813+0000 7fdec7fff640 1 -- 172.21.15.123:0/2343077539 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded8036050 con 0x7fdee015ed20 2024-09-15T23:19:02.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.813+0000 7fdec7fff640 1 -- 172.21.15.123:0/2343077539 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fded8042070 con 0x7fdee015ed20 2024-09-15T23:19:02.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.813+0000 7fdee5b9f640 1 -- 172.21.15.123:0/2343077539 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdee01f5180 con 0x7fdee015ed20 2024-09-15T23:19:02.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.813+0000 7fdec7fff640 1 -- 172.21.15.123:0/2343077539 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded8009510 con 0x7fdee015ed20 2024-09-15T23:19:02.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.813+0000 7fdee5b9f640 1 -- 172.21.15.123:0/2343077539 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdee01f5740 con 0x7fdee015ed20 2024-09-15T23:19:02.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.814+0000 7fdee5b9f640 1 -- 172.21.15.123:0/2343077539 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdee00b7010 con 0x7fdee015ed20 2024-09-15T23:19:02.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.814+0000 7fdec7fff640 1 -- 172.21.15.123:0/2343077539 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fded8007bf0 con 0x7fdee015ed20 2024-09-15T23:19:02.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.815+0000 7fdec7fff640 1 --2- 172.21.15.123:0/2343077539 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdecc06c2b0 0x7fdecc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:02.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.815+0000 7fdec7fff640 1 -- 172.21.15.123:0/2343077539 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7fded80ac200 con 0x7fdee015ed20 2024-09-15T23:19:02.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.815+0000 7fdedf7fe640 1 --2- 172.21.15.123:0/2343077539 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdecc06c2b0 0x7fdecc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:02.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.816+0000 7fdedf7fe640 1 --2- 172.21.15.123:0/2343077539 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdecc06c2b0 0x7fdecc06e770 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fded0001640 tx=0x7fded0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:02.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.819+0000 7fdec7fff640 1 -- 172.21.15.123:0/2343077539 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fded807a9a0 con 0x7fdee015ed20 2024-09-15T23:19:02.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.982+0000 7fdee5b9f640 1 -- 172.21.15.123:0/2343077539 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdee00b3090 con 0x7fdecc06c2b0 2024-09-15T23:19:02.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.988+0000 7fdec7fff640 1 -- 172.21.15.123:0/2343077539 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252438 (secure 0 0 0) 0x7fdee00b3090 con 0x7fdecc06c2b0 2024-09-15T23:19:02.992 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:19:02.993 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:19:02.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.991+0000 7fdee5b9f640 1 -- 172.21.15.123:0/2343077539 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdecc06c2b0 msgr2=0x7fdecc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:02.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.991+0000 7fdee5b9f640 1 --2- 172.21.15.123:0/2343077539 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdecc06c2b0 0x7fdecc06e770 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fded0001640 tx=0x7fded0009040 comp rx=0 tx=0).stop 2024-09-15T23:19:02.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.991+0000 7fdee5b9f640 1 -- 172.21.15.123:0/2343077539 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdee015ed20 msgr2=0x7fdee00b52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:02.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.991+0000 7fdee5b9f640 1 --2- 172.21.15.123:0/2343077539 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdee015ed20 0x7fdee00b52a0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fded8034040 tx=0x7fded8004a40 comp rx=0 tx=0).stop 2024-09-15T23:19:02.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.991+0000 7fdee5b9f640 1 -- 172.21.15.123:0/2343077539 shutdown_connections 2024-09-15T23:19:02.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.991+0000 7fdee5b9f640 1 --2- 172.21.15.123:0/2343077539 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdecc06c2b0 0x7fdecc06e770 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:02.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.991+0000 7fdee5b9f640 1 --2- 172.21.15.123:0/2343077539 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdee015ed20 0x7fdee00b52a0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:02.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.991+0000 7fdee5b9f640 1 --2- 172.21.15.123:0/2343077539 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdee00d23b0 0x7fdee00ce3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:02.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.991+0000 7fdee5b9f640 1 --2- 172.21.15.123:0/2343077539 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdee00b6970 0x7fdee01f7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:02.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.991+0000 7fdee5b9f640 1 -- 172.21.15.123:0/2343077539 >> 172.21.15.123:0/2343077539 conn(0x7fdee00d1260 msgr2=0x7fdee0161590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:02.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.991+0000 7fdee5b9f640 1 -- 172.21.15.123:0/2343077539 shutdown_connections 2024-09-15T23:19:02.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:02.991+0000 7fdee5b9f640 1 -- 172.21.15.123:0/2343077539 wait complete. 2024-09-15T23:19:03.003 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":333,"stamp":"2024-09-15T23:19:01.601543+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":392356,"kb_used_data":13736,"kb_used_omap":12,"kb_used_meta":378419,"kb_avail":754582364,"statfs":{"total":773094113280,"available":772692340736,"internally_reserved":0,"allocated":14065664,"data_stored":6851612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":387501616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.211407"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.405875+0000","last_change":"2024-09-15T23:18:55.410755+0000","last_active":"2024-09-15T23:18:56.405875+0000","last_peered":"2024-09-15T23:18:56.405875+0000","last_clean":"2024-09-15T23:18:56.405875+0000","last_became_active":"2024-09-15T23:18:55.410175+0000","last_became_peered":"2024-09-15T23:18:55.410175+0000","last_unstale":"2024-09-15T23:18:56.405875+0000","last_undegraded":"2024-09-15T23:18:56.405875+0000","last_fullsized":"2024-09-15T23:18:56.405875+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:43:05.591911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406799+0000","last_change":"2024-09-15T23:18:55.415215+0000","last_active":"2024-09-15T23:18:56.406799+0000","last_peered":"2024-09-15T23:18:56.406799+0000","last_clean":"2024-09-15T23:18:56.406799+0000","last_became_active":"2024-09-15T23:18:55.414844+0000","last_became_peered":"2024-09-15T23:18:55.414844+0000","last_unstale":"2024-09-15T23:18:56.406799+0000","last_undegraded":"2024-09-15T23:18:56.406799+0000","last_fullsized":"2024-09-15T23:18:56.406799+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:51:31.137122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406927+0000","last_change":"2024-09-15T23:18:55.400347+0000","last_active":"2024-09-15T23:18:56.406927+0000","last_peered":"2024-09-15T23:18:56.406927+0000","last_clean":"2024-09-15T23:18:56.406927+0000","last_became_active":"2024-09-15T23:18:55.400092+0000","last_became_peered":"2024-09-15T23:18:55.400092+0000","last_unstale":"2024-09-15T23:18:56.406927+0000","last_undegraded":"2024-09-15T23:18:56.406927+0000","last_fullsized":"2024-09-15T23:18:56.406927+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:48:38.324698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.702240+0000","last_change":"2024-09-15T23:18:55.418935+0000","last_active":"2024-09-15T23:18:56.702240+0000","last_peered":"2024-09-15T23:18:56.702240+0000","last_clean":"2024-09-15T23:18:56.702240+0000","last_became_active":"2024-09-15T23:18:55.418679+0000","last_became_peered":"2024-09-15T23:18:55.418679+0000","last_unstale":"2024-09-15T23:18:56.702240+0000","last_undegraded":"2024-09-15T23:18:56.702240+0000","last_fullsized":"2024-09-15T23:18:56.702240+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:55:34.313802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701878+0000","last_change":"2024-09-15T23:18:55.408374+0000","last_active":"2024-09-15T23:18:56.701878+0000","last_peered":"2024-09-15T23:18:56.701878+0000","last_clean":"2024-09-15T23:18:56.701878+0000","last_became_active":"2024-09-15T23:18:55.408101+0000","last_became_peered":"2024-09-15T23:18:55.408101+0000","last_unstale":"2024-09-15T23:18:56.701878+0000","last_undegraded":"2024-09-15T23:18:56.701878+0000","last_fullsized":"2024-09-15T23:18:56.701878+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:36:26.272310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700690+0000","last_change":"2024-09-15T23:18:55.419260+0000","last_active":"2024-09-15T23:18:56.700690+0000","last_peered":"2024-09-15T23:18:56.700690+0000","last_clean":"2024-09-15T23:18:56.700690+0000","last_became_active":"2024-09-15T23:18:55.418943+0000","last_became_peered":"2024-09-15T23:18:55.418943+0000","last_unstale":"2024-09-15T23:18:56.700690+0000","last_undegraded":"2024-09-15T23:18:56.700690+0000","last_fullsized":"2024-09-15T23:18:56.700690+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:03:26.735040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701052+0000","last_change":"2024-09-15T23:18:55.403999+0000","last_active":"2024-09-15T23:18:56.701052+0000","last_peered":"2024-09-15T23:18:56.701052+0000","last_clean":"2024-09-15T23:18:56.701052+0000","last_became_active":"2024-09-15T23:18:55.403726+0000","last_became_peered":"2024-09-15T23:18:55.403726+0000","last_unstale":"2024-09-15T23:18:56.701052+0000","last_undegraded":"2024-09-15T23:18:56.701052+0000","last_fullsized":"2024-09-15T23:18:56.701052+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:01.211423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700853+0000","last_change":"2024-09-15T23:18:55.398245+0000","last_active":"2024-09-15T23:18:56.700853+0000","last_peered":"2024-09-15T23:18:56.700853+0000","last_clean":"2024-09-15T23:18:56.700853+0000","last_became_active":"2024-09-15T23:18:55.397982+0000","last_became_peered":"2024-09-15T23:18:55.397982+0000","last_unstale":"2024-09-15T23:18:56.700853+0000","last_undegraded":"2024-09-15T23:18:56.700853+0000","last_fullsized":"2024-09-15T23:18:56.700853+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:46:55.222066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406063+0000","last_change":"2024-09-15T23:18:55.421369+0000","last_active":"2024-09-15T23:18:56.406063+0000","last_peered":"2024-09-15T23:18:56.406063+0000","last_clean":"2024-09-15T23:18:56.406063+0000","last_became_active":"2024-09-15T23:18:55.421014+0000","last_became_peered":"2024-09-15T23:18:55.421014+0000","last_unstale":"2024-09-15T23:18:56.406063+0000","last_undegraded":"2024-09-15T23:18:56.406063+0000","last_fullsized":"2024-09-15T23:18:56.406063+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:04:50.969453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701308+0000","last_change":"2024-09-15T23:18:55.403062+0000","last_active":"2024-09-15T23:18:56.701308+0000","last_peered":"2024-09-15T23:18:56.701308+0000","last_clean":"2024-09-15T23:18:56.701308+0000","last_became_active":"2024-09-15T23:18:55.402715+0000","last_became_peered":"2024-09-15T23:18:55.402715+0000","last_unstale":"2024-09-15T23:18:56.701308+0000","last_undegraded":"2024-09-15T23:18:56.701308+0000","last_fullsized":"2024-09-15T23:18:56.701308+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:30:32.698998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701006+0000","last_change":"2024-09-15T23:18:55.410360+0000","last_active":"2024-09-15T23:18:56.701006+0000","last_peered":"2024-09-15T23:18:56.701006+0000","last_clean":"2024-09-15T23:18:56.701006+0000","last_became_active":"2024-09-15T23:18:55.410054+0000","last_became_peered":"2024-09-15T23:18:55.410054+0000","last_unstale":"2024-09-15T23:18:56.701006+0000","last_undegraded":"2024-09-15T23:18:56.701006+0000","last_fullsized":"2024-09-15T23:18:56.701006+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:15:00.338739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701242+0000","last_change":"2024-09-15T23:18:55.402262+0000","last_active":"2024-09-15T23:18:56.701242+0000","last_peered":"2024-09-15T23:18:56.701242+0000","last_clean":"2024-09-15T23:18:56.701242+0000","last_became_active":"2024-09-15T23:18:55.401993+0000","last_became_peered":"2024-09-15T23:18:55.401993+0000","last_unstale":"2024-09-15T23:18:56.701242+0000","last_undegraded":"2024-09-15T23:18:56.701242+0000","last_fullsized":"2024-09-15T23:18:56.701242+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:30:19.756605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406749+0000","last_change":"2024-09-15T23:18:55.415683+0000","last_active":"2024-09-15T23:18:56.406749+0000","last_peered":"2024-09-15T23:18:56.406749+0000","last_clean":"2024-09-15T23:18:56.406749+0000","last_became_active":"2024-09-15T23:18:55.415448+0000","last_became_peered":"2024-09-15T23:18:55.415448+0000","last_unstale":"2024-09-15T23:18:56.406749+0000","last_undegraded":"2024-09-15T23:18:56.406749+0000","last_fullsized":"2024-09-15T23:18:56.406749+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:16.891519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700329+0000","last_change":"2024-09-15T23:18:55.404271+0000","last_active":"2024-09-15T23:18:56.700329+0000","last_peered":"2024-09-15T23:18:56.700329+0000","last_clean":"2024-09-15T23:18:56.700329+0000","last_became_active":"2024-09-15T23:18:55.404001+0000","last_became_peered":"2024-09-15T23:18:55.404001+0000","last_unstale":"2024-09-15T23:18:56.700329+0000","last_undegraded":"2024-09-15T23:18:56.700329+0000","last_fullsized":"2024-09-15T23:18:56.700329+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:16.891519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.405868+0000","last_change":"2024-09-15T23:18:55.405009+0000","last_active":"2024-09-15T23:18:56.405868+0000","last_peered":"2024-09-15T23:18:56.405868+0000","last_clean":"2024-09-15T23:18:56.405868+0000","last_became_active":"2024-09-15T23:18:55.404627+0000","last_became_peered":"2024-09-15T23:18:55.404627+0000","last_unstale":"2024-09-15T23:18:56.405868+0000","last_undegraded":"2024-09-15T23:18:56.405868+0000","last_fullsized":"2024-09-15T23:18:56.405868+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:46.431898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701363+0000","last_change":"2024-09-15T23:18:55.408322+0000","last_active":"2024-09-15T23:18:56.701363+0000","last_peered":"2024-09-15T23:18:56.701363+0000","last_clean":"2024-09-15T23:18:56.701363+0000","last_became_active":"2024-09-15T23:18:55.407499+0000","last_became_peered":"2024-09-15T23:18:55.407499+0000","last_unstale":"2024-09-15T23:18:56.701363+0000","last_undegraded":"2024-09-15T23:18:56.701363+0000","last_fullsized":"2024-09-15T23:18:56.701363+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:48:38.324698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406586+0000","last_change":"2024-09-15T23:18:55.404358+0000","last_active":"2024-09-15T23:18:56.406586+0000","last_peered":"2024-09-15T23:18:56.406586+0000","last_clean":"2024-09-15T23:18:56.406586+0000","last_became_active":"2024-09-15T23:18:55.404100+0000","last_became_peered":"2024-09-15T23:18:55.404100+0000","last_unstale":"2024-09-15T23:18:56.406586+0000","last_undegraded":"2024-09-15T23:18:56.406586+0000","last_fullsized":"2024-09-15T23:18:56.406586+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:55:21.016141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701011+0000","last_change":"2024-09-15T23:18:55.407473+0000","last_active":"2024-09-15T23:18:56.701011+0000","last_peered":"2024-09-15T23:18:56.701011+0000","last_clean":"2024-09-15T23:18:56.701011+0000","last_became_active":"2024-09-15T23:18:55.407214+0000","last_became_peered":"2024-09-15T23:18:55.407214+0000","last_unstale":"2024-09-15T23:18:56.701011+0000","last_undegraded":"2024-09-15T23:18:56.701011+0000","last_fullsized":"2024-09-15T23:18:56.701011+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:22:40.177832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406997+0000","last_change":"2024-09-15T23:18:55.408609+0000","last_active":"2024-09-15T23:18:56.406997+0000","last_peered":"2024-09-15T23:18:56.406997+0000","last_clean":"2024-09-15T23:18:56.406997+0000","last_became_active":"2024-09-15T23:18:55.408329+0000","last_became_peered":"2024-09-15T23:18:55.408329+0000","last_unstale":"2024-09-15T23:18:56.406997+0000","last_undegraded":"2024-09-15T23:18:56.406997+0000","last_fullsized":"2024-09-15T23:18:56.406997+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:30:19.756605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406800+0000","last_change":"2024-09-15T23:18:55.420163+0000","last_active":"2024-09-15T23:18:56.406800+0000","last_peered":"2024-09-15T23:18:56.406800+0000","last_clean":"2024-09-15T23:18:56.406800+0000","last_became_active":"2024-09-15T23:18:55.419852+0000","last_became_peered":"2024-09-15T23:18:55.419852+0000","last_unstale":"2024-09-15T23:18:56.406800+0000","last_undegraded":"2024-09-15T23:18:56.406800+0000","last_fullsized":"2024-09-15T23:18:56.406800+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:30:32.698998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701221+0000","last_change":"2024-09-15T23:18:55.420726+0000","last_active":"2024-09-15T23:18:56.701221+0000","last_peered":"2024-09-15T23:18:56.701221+0000","last_clean":"2024-09-15T23:18:56.701221+0000","last_became_active":"2024-09-15T23:18:55.420451+0000","last_became_peered":"2024-09-15T23:18:55.420451+0000","last_unstale":"2024-09-15T23:18:56.701221+0000","last_undegraded":"2024-09-15T23:18:56.701221+0000","last_fullsized":"2024-09-15T23:18:56.701221+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:47:14.517683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700833+0000","last_change":"2024-09-15T23:18:55.404066+0000","last_active":"2024-09-15T23:18:56.700833+0000","last_peered":"2024-09-15T23:18:56.700833+0000","last_clean":"2024-09-15T23:18:56.700833+0000","last_became_active":"2024-09-15T23:18:55.403800+0000","last_became_peered":"2024-09-15T23:18:55.403800+0000","last_unstale":"2024-09-15T23:18:56.700833+0000","last_undegraded":"2024-09-15T23:18:56.700833+0000","last_fullsized":"2024-09-15T23:18:56.700833+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:42:21.996440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700192+0000","last_change":"2024-09-15T23:18:55.400842+0000","last_active":"2024-09-15T23:18:56.700192+0000","last_peered":"2024-09-15T23:18:56.700192+0000","last_clean":"2024-09-15T23:18:56.700192+0000","last_became_active":"2024-09-15T23:18:55.400588+0000","last_became_peered":"2024-09-15T23:18:55.400588+0000","last_unstale":"2024-09-15T23:18:56.700192+0000","last_undegraded":"2024-09-15T23:18:56.700192+0000","last_fullsized":"2024-09-15T23:18:56.700192+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:39.885512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.702024+0000","last_change":"2024-09-15T23:18:55.419619+0000","last_active":"2024-09-15T23:18:56.702024+0000","last_peered":"2024-09-15T23:18:56.702024+0000","last_clean":"2024-09-15T23:18:56.702024+0000","last_became_active":"2024-09-15T23:18:55.419359+0000","last_became_peered":"2024-09-15T23:18:55.419359+0000","last_unstale":"2024-09-15T23:18:56.702024+0000","last_undegraded":"2024-09-15T23:18:56.702024+0000","last_fullsized":"2024-09-15T23:18:56.702024+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:07.518417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701073+0000","last_change":"2024-09-15T23:18:55.398562+0000","last_active":"2024-09-15T23:18:56.701073+0000","last_peered":"2024-09-15T23:18:56.701073+0000","last_clean":"2024-09-15T23:18:56.701073+0000","last_became_active":"2024-09-15T23:18:55.398281+0000","last_became_peered":"2024-09-15T23:18:55.398281+0000","last_unstale":"2024-09-15T23:18:56.701073+0000","last_undegraded":"2024-09-15T23:18:56.701073+0000","last_fullsized":"2024-09-15T23:18:56.701073+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:01.887504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701456+0000","last_change":"2024-09-15T23:18:55.404025+0000","last_active":"2024-09-15T23:18:56.701456+0000","last_peered":"2024-09-15T23:18:56.701456+0000","last_clean":"2024-09-15T23:18:56.701456+0000","last_became_active":"2024-09-15T23:18:55.403532+0000","last_became_peered":"2024-09-15T23:18:55.403532+0000","last_unstale":"2024-09-15T23:18:56.701456+0000","last_undegraded":"2024-09-15T23:18:56.701456+0000","last_fullsized":"2024-09-15T23:18:56.701456+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:49.707250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.702227+0000","last_change":"2024-09-15T23:18:55.418863+0000","last_active":"2024-09-15T23:18:56.702227+0000","last_peered":"2024-09-15T23:18:56.702227+0000","last_clean":"2024-09-15T23:18:56.702227+0000","last_became_active":"2024-09-15T23:18:55.418588+0000","last_became_peered":"2024-09-15T23:18:55.418588+0000","last_unstale":"2024-09-15T23:18:56.702227+0000","last_undegraded":"2024-09-15T23:18:56.702227+0000","last_fullsized":"2024-09-15T23:18:56.702227+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:07.644657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700850+0000","last_change":"2024-09-15T23:18:55.422451+0000","last_active":"2024-09-15T23:18:56.700850+0000","last_peered":"2024-09-15T23:18:56.700850+0000","last_clean":"2024-09-15T23:18:56.700850+0000","last_became_active":"2024-09-15T23:18:55.422162+0000","last_became_peered":"2024-09-15T23:18:55.422162+0000","last_unstale":"2024-09-15T23:18:56.700850+0000","last_undegraded":"2024-09-15T23:18:56.700850+0000","last_fullsized":"2024-09-15T23:18:56.700850+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:22:10.355949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700279+0000","last_change":"2024-09-15T23:18:55.404989+0000","last_active":"2024-09-15T23:18:56.700279+0000","last_peered":"2024-09-15T23:18:56.700279+0000","last_clean":"2024-09-15T23:18:56.700279+0000","last_became_active":"2024-09-15T23:18:55.404742+0000","last_became_peered":"2024-09-15T23:18:55.404742+0000","last_unstale":"2024-09-15T23:18:56.700279+0000","last_undegraded":"2024-09-15T23:18:56.700279+0000","last_fullsized":"2024-09-15T23:18:56.700279+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:48:27.764800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700977+0000","last_change":"2024-09-15T23:18:55.399851+0000","last_active":"2024-09-15T23:18:56.700977+0000","last_peered":"2024-09-15T23:18:56.700977+0000","last_clean":"2024-09-15T23:18:56.700977+0000","last_became_active":"2024-09-15T23:18:55.399565+0000","last_became_peered":"2024-09-15T23:18:55.399565+0000","last_unstale":"2024-09-15T23:18:56.700977+0000","last_undegraded":"2024-09-15T23:18:56.700977+0000","last_fullsized":"2024-09-15T23:18:56.700977+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:20.548159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406192+0000","last_change":"2024-09-15T23:18:55.411065+0000","last_active":"2024-09-15T23:18:56.406192+0000","last_peered":"2024-09-15T23:18:56.406192+0000","last_clean":"2024-09-15T23:18:56.406192+0000","last_became_active":"2024-09-15T23:18:55.410332+0000","last_became_peered":"2024-09-15T23:18:55.410332+0000","last_unstale":"2024-09-15T23:18:56.406192+0000","last_undegraded":"2024-09-15T23:18:56.406192+0000","last_fullsized":"2024-09-15T23:18:56.406192+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:04.081907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701765+0000","last_change":"2024-09-15T23:18:55.408913+0000","last_active":"2024-09-15T23:18:56.701765+0000","last_peered":"2024-09-15T23:18:56.701765+0000","last_clean":"2024-09-15T23:18:56.701765+0000","last_became_active":"2024-09-15T23:18:55.408565+0000","last_became_peered":"2024-09-15T23:18:55.408565+0000","last_unstale":"2024-09-15T23:18:56.701765+0000","last_undegraded":"2024-09-15T23:18:56.701765+0000","last_fullsized":"2024-09-15T23:18:56.701765+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:30.183246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406037+0000","last_change":"2024-09-15T23:18:55.417434+0000","last_active":"2024-09-15T23:18:56.406037+0000","last_peered":"2024-09-15T23:18:56.406037+0000","last_clean":"2024-09-15T23:18:56.406037+0000","last_became_active":"2024-09-15T23:18:55.416979+0000","last_became_peered":"2024-09-15T23:18:55.416979+0000","last_unstale":"2024-09-15T23:18:56.406037+0000","last_undegraded":"2024-09-15T23:18:56.406037+0000","last_fullsized":"2024-09-15T23:18:56.406037+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:15.124012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"129'4","reported_seq":18,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700461+0000","last_change":"2024-09-15T23:18:54.398475+0000","last_active":"2024-09-15T23:18:56.700461+0000","last_peered":"2024-09-15T23:18:56.700461+0000","last_clean":"2024-09-15T23:18:56.700461+0000","last_became_active":"2024-09-15T23:18:54.398011+0000","last_became_peered":"2024-09-15T23:18:54.398011+0000","last_unstale":"2024-09-15T23:18:56.700461+0000","last_undegraded":"2024-09-15T23:18:56.700461+0000","last_fullsized":"2024-09-15T23:18:56.700461+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:30:20.062617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700530+0000","last_change":"2024-09-15T23:18:55.407002+0000","last_active":"2024-09-15T23:18:56.700530+0000","last_peered":"2024-09-15T23:18:56.700530+0000","last_clean":"2024-09-15T23:18:56.700530+0000","last_became_active":"2024-09-15T23:18:55.406555+0000","last_became_peered":"2024-09-15T23:18:55.406555+0000","last_unstale":"2024-09-15T23:18:56.700530+0000","last_undegraded":"2024-09-15T23:18:56.700530+0000","last_fullsized":"2024-09-15T23:18:56.700530+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:18.500607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1e","version":"129'1","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406860+0000","last_change":"2024-09-15T23:18:54.396189+0000","last_active":"2024-09-15T23:18:56.406860+0000","last_peered":"2024-09-15T23:18:56.406860+0000","last_clean":"2024-09-15T23:18:56.406860+0000","last_became_active":"2024-09-15T23:18:54.395896+0000","last_became_peered":"2024-09-15T23:18:54.395896+0000","last_unstale":"2024-09-15T23:18:56.406860+0000","last_undegraded":"2024-09-15T23:18:56.406860+0000","last_fullsized":"2024-09-15T23:18:56.406860+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:49:05.622615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700857+0000","last_change":"2024-09-15T23:18:55.409732+0000","last_active":"2024-09-15T23:18:56.700857+0000","last_peered":"2024-09-15T23:18:56.700857+0000","last_clean":"2024-09-15T23:18:56.700857+0000","last_became_active":"2024-09-15T23:18:55.409301+0000","last_became_peered":"2024-09-15T23:18:55.409301+0000","last_unstale":"2024-09-15T23:18:56.700857+0000","last_undegraded":"2024-09-15T23:18:56.700857+0000","last_fullsized":"2024-09-15T23:18:56.700857+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:16.210045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1d","version":"129'2","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.702284+0000","last_change":"2024-09-15T23:18:54.406925+0000","last_active":"2024-09-15T23:18:56.702284+0000","last_peered":"2024-09-15T23:18:56.702284+0000","last_clean":"2024-09-15T23:18:56.702284+0000","last_became_active":"2024-09-15T23:18:54.406584+0000","last_became_peered":"2024-09-15T23:18:54.406584+0000","last_unstale":"2024-09-15T23:18:56.702284+0000","last_undegraded":"2024-09-15T23:18:56.702284+0000","last_fullsized":"2024-09-15T23:18:56.702284+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:41.060616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.407123+0000","last_change":"2024-09-15T23:18:55.410691+0000","last_active":"2024-09-15T23:18:56.407123+0000","last_peered":"2024-09-15T23:18:56.407123+0000","last_clean":"2024-09-15T23:18:56.407123+0000","last_became_active":"2024-09-15T23:18:55.410399+0000","last_became_peered":"2024-09-15T23:18:55.410399+0000","last_unstale":"2024-09-15T23:18:56.407123+0000","last_undegraded":"2024-09-15T23:18:56.407123+0000","last_fullsized":"2024-09-15T23:18:56.407123+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:56:42.354935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"129'2","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701996+0000","last_change":"2024-09-15T23:18:54.407600+0000","last_active":"2024-09-15T23:18:56.701996+0000","last_peered":"2024-09-15T23:18:56.701996+0000","last_clean":"2024-09-15T23:18:56.701996+0000","last_became_active":"2024-09-15T23:18:54.407279+0000","last_became_peered":"2024-09-15T23:18:54.407279+0000","last_unstale":"2024-09-15T23:18:56.701996+0000","last_undegraded":"2024-09-15T23:18:56.701996+0000","last_fullsized":"2024-09-15T23:18:56.701996+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:43.186680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701368+0000","last_change":"2024-09-15T23:18:55.417579+0000","last_active":"2024-09-15T23:18:56.701368+0000","last_peered":"2024-09-15T23:18:56.701368+0000","last_clean":"2024-09-15T23:18:56.701368+0000","last_became_active":"2024-09-15T23:18:55.417302+0000","last_became_peered":"2024-09-15T23:18:55.417302+0000","last_unstale":"2024-09-15T23:18:56.701368+0000","last_undegraded":"2024-09-15T23:18:56.701368+0000","last_fullsized":"2024-09-15T23:18:56.701368+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:02:49.707250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1b","version":"129'1","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406681+0000","last_change":"2024-09-15T23:18:54.409230+0000","last_active":"2024-09-15T23:18:56.406681+0000","last_peered":"2024-09-15T23:18:56.406681+0000","last_clean":"2024-09-15T23:18:56.406681+0000","last_became_active":"2024-09-15T23:18:54.408941+0000","last_became_peered":"2024-09-15T23:18:54.408941+0000","last_unstale":"2024-09-15T23:18:56.406681+0000","last_undegraded":"2024-09-15T23:18:56.406681+0000","last_fullsized":"2024-09-15T23:18:56.406681+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:19:18.665458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701163+0000","last_change":"2024-09-15T23:18:55.408319+0000","last_active":"2024-09-15T23:18:56.701163+0000","last_peered":"2024-09-15T23:18:56.701163+0000","last_clean":"2024-09-15T23:18:56.701163+0000","last_became_active":"2024-09-15T23:18:55.407909+0000","last_became_peered":"2024-09-15T23:18:55.407909+0000","last_unstale":"2024-09-15T23:18:56.701163+0000","last_undegraded":"2024-09-15T23:18:56.701163+0000","last_fullsized":"2024-09-15T23:18:56.701163+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:33.857493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1a","version":"129'1","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.405710+0000","last_change":"2024-09-15T23:18:54.398393+0000","last_active":"2024-09-15T23:18:56.405710+0000","last_peered":"2024-09-15T23:18:56.405710+0000","last_clean":"2024-09-15T23:18:56.405710+0000","last_became_active":"2024-09-15T23:18:54.398134+0000","last_became_peered":"2024-09-15T23:18:54.398134+0000","last_unstale":"2024-09-15T23:18:56.405710+0000","last_undegraded":"2024-09-15T23:18:56.405710+0000","last_fullsized":"2024-09-15T23:18:56.405710+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:15.886461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701768+0000","last_change":"2024-09-15T23:18:55.420328+0000","last_active":"2024-09-15T23:18:56.701768+0000","last_peered":"2024-09-15T23:18:56.701768+0000","last_clean":"2024-09-15T23:18:56.701768+0000","last_became_active":"2024-09-15T23:18:55.420023+0000","last_became_peered":"2024-09-15T23:18:55.420023+0000","last_unstale":"2024-09-15T23:18:56.701768+0000","last_undegraded":"2024-09-15T23:18:56.701768+0000","last_fullsized":"2024-09-15T23:18:56.701768+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:59:50.378664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700931+0000","last_change":"2024-09-15T23:18:54.405165+0000","last_active":"2024-09-15T23:18:56.700931+0000","last_peered":"2024-09-15T23:18:56.700931+0000","last_clean":"2024-09-15T23:18:56.700931+0000","last_became_active":"2024-09-15T23:18:54.404908+0000","last_became_peered":"2024-09-15T23:18:54.404908+0000","last_unstale":"2024-09-15T23:18:56.700931+0000","last_undegraded":"2024-09-15T23:18:56.700931+0000","last_fullsized":"2024-09-15T23:18:56.700931+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:56:28.230682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700833+0000","last_change":"2024-09-15T23:18:55.402359+0000","last_active":"2024-09-15T23:18:56.700833+0000","last_peered":"2024-09-15T23:18:56.700833+0000","last_clean":"2024-09-15T23:18:56.700833+0000","last_became_active":"2024-09-15T23:18:55.402112+0000","last_became_peered":"2024-09-15T23:18:55.402112+0000","last_unstale":"2024-09-15T23:18:56.700833+0000","last_undegraded":"2024-09-15T23:18:56.700833+0000","last_fullsized":"2024-09-15T23:18:56.700833+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:21.974339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701887+0000","last_change":"2024-09-15T23:18:54.408733+0000","last_active":"2024-09-15T23:18:56.701887+0000","last_peered":"2024-09-15T23:18:56.701887+0000","last_clean":"2024-09-15T23:18:56.701887+0000","last_became_active":"2024-09-15T23:18:54.408453+0000","last_became_peered":"2024-09-15T23:18:54.408453+0000","last_unstale":"2024-09-15T23:18:56.701887+0000","last_undegraded":"2024-09-15T23:18:56.701887+0000","last_fullsized":"2024-09-15T23:18:56.701887+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:19:18.665458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406872+0000","last_change":"2024-09-15T23:18:55.404975+0000","last_active":"2024-09-15T23:18:56.406872+0000","last_peered":"2024-09-15T23:18:56.406872+0000","last_clean":"2024-09-15T23:18:56.406872+0000","last_became_active":"2024-09-15T23:18:55.404699+0000","last_became_peered":"2024-09-15T23:18:55.404699+0000","last_unstale":"2024-09-15T23:18:56.406872+0000","last_undegraded":"2024-09-15T23:18:56.406872+0000","last_fullsized":"2024-09-15T23:18:56.406872+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:18.500607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.702010+0000","last_change":"2024-09-15T23:18:54.409517+0000","last_active":"2024-09-15T23:18:56.702010+0000","last_peered":"2024-09-15T23:18:56.702010+0000","last_clean":"2024-09-15T23:18:56.702010+0000","last_became_active":"2024-09-15T23:18:54.409082+0000","last_became_peered":"2024-09-15T23:18:54.409082+0000","last_unstale":"2024-09-15T23:18:56.702010+0000","last_undegraded":"2024-09-15T23:18:56.702010+0000","last_fullsized":"2024-09-15T23:18:56.702010+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:41:08.697739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.407359+0000","last_change":"2024-09-15T23:18:55.412597+0000","last_active":"2024-09-15T23:18:56.407359+0000","last_peered":"2024-09-15T23:18:56.407359+0000","last_clean":"2024-09-15T23:18:56.407359+0000","last_became_active":"2024-09-15T23:18:55.412363+0000","last_became_peered":"2024-09-15T23:18:55.412363+0000","last_unstale":"2024-09-15T23:18:56.407359+0000","last_undegraded":"2024-09-15T23:18:56.407359+0000","last_fullsized":"2024-09-15T23:18:56.407359+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:26.156621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701481+0000","last_change":"2024-09-15T23:18:54.401049+0000","last_active":"2024-09-15T23:18:56.701481+0000","last_peered":"2024-09-15T23:18:56.701481+0000","last_clean":"2024-09-15T23:18:56.701481+0000","last_became_active":"2024-09-15T23:18:54.400776+0000","last_became_peered":"2024-09-15T23:18:54.400776+0000","last_unstale":"2024-09-15T23:18:56.701481+0000","last_undegraded":"2024-09-15T23:18:56.701481+0000","last_fullsized":"2024-09-15T23:18:56.701481+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:31.412905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701026+0000","last_change":"2024-09-15T23:18:55.403705+0000","last_active":"2024-09-15T23:18:56.701026+0000","last_peered":"2024-09-15T23:18:56.701026+0000","last_clean":"2024-09-15T23:18:56.701026+0000","last_became_active":"2024-09-15T23:18:55.403391+0000","last_became_peered":"2024-09-15T23:18:55.403391+0000","last_unstale":"2024-09-15T23:18:56.701026+0000","last_undegraded":"2024-09-15T23:18:56.701026+0000","last_fullsized":"2024-09-15T23:18:56.701026+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:27:05.228310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"129'3","reported_seq":17,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701491+0000","last_change":"2024-09-15T23:18:54.404045+0000","last_active":"2024-09-15T23:18:56.701491+0000","last_peered":"2024-09-15T23:18:56.701491+0000","last_clean":"2024-09-15T23:18:56.701491+0000","last_became_active":"2024-09-15T23:18:54.403773+0000","last_became_peered":"2024-09-15T23:18:54.403773+0000","last_unstale":"2024-09-15T23:18:56.701491+0000","last_undegraded":"2024-09-15T23:18:56.701491+0000","last_fullsized":"2024-09-15T23:18:56.701491+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:02:31.113880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701152+0000","last_change":"2024-09-15T23:18:55.397107+0000","last_active":"2024-09-15T23:18:56.701152+0000","last_peered":"2024-09-15T23:18:56.701152+0000","last_clean":"2024-09-15T23:18:56.701152+0000","last_became_active":"2024-09-15T23:18:55.396831+0000","last_became_peered":"2024-09-15T23:18:55.396831+0000","last_unstale":"2024-09-15T23:18:56.701152+0000","last_undegraded":"2024-09-15T23:18:56.701152+0000","last_fullsized":"2024-09-15T23:18:56.701152+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:33:36.994916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.14","version":"129'6","reported_seq":20,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.702150+0000","last_change":"2024-09-15T23:18:54.407446+0000","last_active":"2024-09-15T23:18:56.702150+0000","last_peered":"2024-09-15T23:18:56.702150+0000","last_clean":"2024-09-15T23:18:56.702150+0000","last_became_active":"2024-09-15T23:18:54.407141+0000","last_became_peered":"2024-09-15T23:18:54.407141+0000","last_unstale":"2024-09-15T23:18:56.702150+0000","last_undegraded":"2024-09-15T23:18:56.702150+0000","last_fullsized":"2024-09-15T23:18:56.702150+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:29.442958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701678+0000","last_change":"2024-09-15T23:18:55.407912+0000","last_active":"2024-09-15T23:18:56.701678+0000","last_peered":"2024-09-15T23:18:56.701678+0000","last_clean":"2024-09-15T23:18:56.701678+0000","last_became_active":"2024-09-15T23:18:55.407554+0000","last_became_peered":"2024-09-15T23:18:55.407554+0000","last_unstale":"2024-09-15T23:18:56.701678+0000","last_undegraded":"2024-09-15T23:18:56.701678+0000","last_fullsized":"2024-09-15T23:18:56.701678+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:18:39.680794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"129'2","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701956+0000","last_change":"2024-09-15T23:18:54.402978+0000","last_active":"2024-09-15T23:18:56.701956+0000","last_peered":"2024-09-15T23:18:56.701956+0000","last_clean":"2024-09-15T23:18:56.701956+0000","last_became_active":"2024-09-15T23:18:54.401842+0000","last_became_peered":"2024-09-15T23:18:54.401842+0000","last_unstale":"2024-09-15T23:18:56.701956+0000","last_undegraded":"2024-09-15T23:18:56.701956+0000","last_fullsized":"2024-09-15T23:18:56.701956+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:33.884558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701131+0000","last_change":"2024-09-15T23:18:55.418699+0000","last_active":"2024-09-15T23:18:56.701131+0000","last_peered":"2024-09-15T23:18:56.701131+0000","last_clean":"2024-09-15T23:18:56.701131+0000","last_became_active":"2024-09-15T23:18:55.418360+0000","last_became_peered":"2024-09-15T23:18:55.418360+0000","last_unstale":"2024-09-15T23:18:56.701131+0000","last_undegraded":"2024-09-15T23:18:56.701131+0000","last_fullsized":"2024-09-15T23:18:56.701131+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:27:05.228310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406559+0000","last_change":"2024-09-15T23:18:54.404649+0000","last_active":"2024-09-15T23:18:56.406559+0000","last_peered":"2024-09-15T23:18:56.406559+0000","last_clean":"2024-09-15T23:18:56.406559+0000","last_became_active":"2024-09-15T23:18:54.404432+0000","last_became_peered":"2024-09-15T23:18:54.404432+0000","last_unstale":"2024-09-15T23:18:56.406559+0000","last_undegraded":"2024-09-15T23:18:56.406559+0000","last_fullsized":"2024-09-15T23:18:56.406559+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:24:31.412905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701896+0000","last_change":"2024-09-15T23:18:55.414604+0000","last_active":"2024-09-15T23:18:56.701896+0000","last_peered":"2024-09-15T23:18:56.701896+0000","last_clean":"2024-09-15T23:18:56.701896+0000","last_became_active":"2024-09-15T23:18:55.414206+0000","last_became_peered":"2024-09-15T23:18:55.414206+0000","last_unstale":"2024-09-15T23:18:56.701896+0000","last_undegraded":"2024-09-15T23:18:56.701896+0000","last_fullsized":"2024-09-15T23:18:56.701896+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:11.622641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"129'8","reported_seq":22,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.405970+0000","last_change":"2024-09-15T23:18:54.396324+0000","last_active":"2024-09-15T23:18:56.405970+0000","last_peered":"2024-09-15T23:18:56.405970+0000","last_clean":"2024-09-15T23:18:56.405970+0000","last_became_active":"2024-09-15T23:18:54.395912+0000","last_became_peered":"2024-09-15T23:18:54.395912+0000","last_unstale":"2024-09-15T23:18:56.405970+0000","last_undegraded":"2024-09-15T23:18:56.405970+0000","last_fullsized":"2024-09-15T23:18:56.405970+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:40.585024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406206+0000","last_change":"2024-09-15T23:18:55.407625+0000","last_active":"2024-09-15T23:18:56.406206+0000","last_peered":"2024-09-15T23:18:56.406206+0000","last_clean":"2024-09-15T23:18:56.406206+0000","last_became_active":"2024-09-15T23:18:55.407035+0000","last_became_peered":"2024-09-15T23:18:55.407035+0000","last_unstale":"2024-09-15T23:18:56.406206+0000","last_undegraded":"2024-09-15T23:18:56.406206+0000","last_fullsized":"2024-09-15T23:18:56.406206+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:24.712832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.f","version":"129'1","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701121+0000","last_change":"2024-09-15T23:18:54.408656+0000","last_active":"2024-09-15T23:18:56.701121+0000","last_peered":"2024-09-15T23:18:56.701121+0000","last_clean":"2024-09-15T23:18:56.701121+0000","last_became_active":"2024-09-15T23:18:54.408298+0000","last_became_peered":"2024-09-15T23:18:54.408298+0000","last_unstale":"2024-09-15T23:18:56.701121+0000","last_undegraded":"2024-09-15T23:18:56.701121+0000","last_fullsized":"2024-09-15T23:18:56.701121+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:41:08.697739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406051+0000","last_change":"2024-09-15T23:18:55.420952+0000","last_active":"2024-09-15T23:18:56.406051+0000","last_peered":"2024-09-15T23:18:56.406051+0000","last_clean":"2024-09-15T23:18:56.406051+0000","last_became_active":"2024-09-15T23:18:55.420608+0000","last_became_peered":"2024-09-15T23:18:55.420608+0000","last_unstale":"2024-09-15T23:18:56.406051+0000","last_undegraded":"2024-09-15T23:18:56.406051+0000","last_fullsized":"2024-09-15T23:18:56.406051+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:05.126336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"129'2","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701516+0000","last_change":"2024-09-15T23:18:54.399080+0000","last_active":"2024-09-15T23:18:56.701516+0000","last_peered":"2024-09-15T23:18:56.701516+0000","last_clean":"2024-09-15T23:18:56.701516+0000","last_became_active":"2024-09-15T23:18:54.398761+0000","last_became_peered":"2024-09-15T23:18:54.398761+0000","last_unstale":"2024-09-15T23:18:56.701516+0000","last_undegraded":"2024-09-15T23:18:56.701516+0000","last_fullsized":"2024-09-15T23:18:56.701516+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:15:19.613132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701042+0000","last_change":"2024-09-15T23:18:55.407563+0000","last_active":"2024-09-15T23:18:56.701042+0000","last_peered":"2024-09-15T23:18:56.701042+0000","last_clean":"2024-09-15T23:18:56.701042+0000","last_became_active":"2024-09-15T23:18:55.407272+0000","last_became_peered":"2024-09-15T23:18:55.407272+0000","last_unstale":"2024-09-15T23:18:56.701042+0000","last_undegraded":"2024-09-15T23:18:56.701042+0000","last_fullsized":"2024-09-15T23:18:56.701042+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:45:46.712832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.d","version":"129'1","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700580+0000","last_change":"2024-09-15T23:18:54.408910+0000","last_active":"2024-09-15T23:18:56.700580+0000","last_peered":"2024-09-15T23:18:56.700580+0000","last_clean":"2024-09-15T23:18:56.700580+0000","last_became_active":"2024-09-15T23:18:54.408560+0000","last_became_peered":"2024-09-15T23:18:54.408560+0000","last_unstale":"2024-09-15T23:18:56.700580+0000","last_undegraded":"2024-09-15T23:18:56.700580+0000","last_fullsized":"2024-09-15T23:18:56.700580+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:12.663116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700530+0000","last_change":"2024-09-15T23:18:55.408070+0000","last_active":"2024-09-15T23:18:56.700530+0000","last_peered":"2024-09-15T23:18:56.700530+0000","last_clean":"2024-09-15T23:18:56.700530+0000","last_became_active":"2024-09-15T23:18:55.407757+0000","last_became_peered":"2024-09-15T23:18:55.407757+0000","last_unstale":"2024-09-15T23:18:56.700530+0000","last_undegraded":"2024-09-15T23:18:56.700530+0000","last_fullsized":"2024-09-15T23:18:56.700530+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:26.156621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700144+0000","last_change":"2024-09-15T23:18:54.403524+0000","last_active":"2024-09-15T23:18:56.700144+0000","last_peered":"2024-09-15T23:18:56.700144+0000","last_clean":"2024-09-15T23:18:56.700144+0000","last_became_active":"2024-09-15T23:18:54.403264+0000","last_became_peered":"2024-09-15T23:18:54.403264+0000","last_unstale":"2024-09-15T23:18:56.700144+0000","last_undegraded":"2024-09-15T23:18:56.700144+0000","last_fullsized":"2024-09-15T23:18:56.700144+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:18:38.675736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406417+0000","last_change":"2024-09-15T23:18:55.399612+0000","last_active":"2024-09-15T23:18:56.406417+0000","last_peered":"2024-09-15T23:18:56.406417+0000","last_clean":"2024-09-15T23:18:56.406417+0000","last_became_active":"2024-09-15T23:18:55.399306+0000","last_became_peered":"2024-09-15T23:18:55.399306+0000","last_unstale":"2024-09-15T23:18:56.406417+0000","last_undegraded":"2024-09-15T23:18:56.406417+0000","last_fullsized":"2024-09-15T23:18:56.406417+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:12:03.648318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.b","version":"129'2","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701986+0000","last_change":"2024-09-15T23:18:54.403225+0000","last_active":"2024-09-15T23:18:56.701986+0000","last_peered":"2024-09-15T23:18:56.701986+0000","last_clean":"2024-09-15T23:18:56.701986+0000","last_became_active":"2024-09-15T23:18:54.402587+0000","last_became_peered":"2024-09-15T23:18:54.402587+0000","last_unstale":"2024-09-15T23:18:56.701986+0000","last_undegraded":"2024-09-15T23:18:56.701986+0000","last_fullsized":"2024-09-15T23:18:56.701986+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:39:49.966929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.405777+0000","last_change":"2024-09-15T23:18:55.403788+0000","last_active":"2024-09-15T23:18:56.405777+0000","last_peered":"2024-09-15T23:18:56.405777+0000","last_clean":"2024-09-15T23:18:56.405777+0000","last_became_active":"2024-09-15T23:18:55.402873+0000","last_became_peered":"2024-09-15T23:18:55.402873+0000","last_unstale":"2024-09-15T23:18:56.405777+0000","last_undegraded":"2024-09-15T23:18:56.405777+0000","last_fullsized":"2024-09-15T23:18:56.405777+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:48.439573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.405920+0000","last_change":"2024-09-15T23:18:54.404950+0000","last_active":"2024-09-15T23:18:56.405920+0000","last_peered":"2024-09-15T23:18:56.405920+0000","last_clean":"2024-09-15T23:18:56.405920+0000","last_became_active":"2024-09-15T23:18:54.404532+0000","last_became_peered":"2024-09-15T23:18:54.404532+0000","last_unstale":"2024-09-15T23:18:56.405920+0000","last_undegraded":"2024-09-15T23:18:56.405920+0000","last_fullsized":"2024-09-15T23:18:56.405920+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:51:30.132064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700080+0000","last_change":"2024-09-15T23:18:55.407538+0000","last_active":"2024-09-15T23:18:56.700080+0000","last_peered":"2024-09-15T23:18:56.700080+0000","last_clean":"2024-09-15T23:18:56.700080+0000","last_became_active":"2024-09-15T23:18:55.407296+0000","last_became_peered":"2024-09-15T23:18:55.407296+0000","last_unstale":"2024-09-15T23:18:56.700080+0000","last_undegraded":"2024-09-15T23:18:56.700080+0000","last_fullsized":"2024-09-15T23:18:56.700080+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:49:06.627673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701715+0000","last_change":"2024-09-15T23:18:54.405325+0000","last_active":"2024-09-15T23:18:56.701715+0000","last_peered":"2024-09-15T23:18:56.701715+0000","last_clean":"2024-09-15T23:18:56.701715+0000","last_became_active":"2024-09-15T23:18:54.405043+0000","last_became_peered":"2024-09-15T23:18:54.405043+0000","last_unstale":"2024-09-15T23:18:56.701715+0000","last_undegraded":"2024-09-15T23:18:56.701715+0000","last_fullsized":"2024-09-15T23:18:56.701715+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:38:39.917102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701650+0000","last_change":"2024-09-15T23:18:55.420197+0000","last_active":"2024-09-15T23:18:56.701650+0000","last_peered":"2024-09-15T23:18:56.701650+0000","last_clean":"2024-09-15T23:18:56.701650+0000","last_became_active":"2024-09-15T23:18:55.419859+0000","last_became_peered":"2024-09-15T23:18:55.419859+0000","last_unstale":"2024-09-15T23:18:56.701650+0000","last_undegraded":"2024-09-15T23:18:56.701650+0000","last_fullsized":"2024-09-15T23:18:56.701650+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:56:42.354935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.702250+0000","last_change":"2024-09-15T23:18:54.402999+0000","last_active":"2024-09-15T23:18:56.702250+0000","last_peered":"2024-09-15T23:18:56.702250+0000","last_clean":"2024-09-15T23:18:56.702250+0000","last_became_active":"2024-09-15T23:18:54.402530+0000","last_became_peered":"2024-09-15T23:18:54.402530+0000","last_unstale":"2024-09-15T23:18:56.702250+0000","last_undegraded":"2024-09-15T23:18:56.702250+0000","last_fullsized":"2024-09-15T23:18:56.702250+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:31.992688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700227+0000","last_change":"2024-09-15T23:18:55.408301+0000","last_active":"2024-09-15T23:18:56.700227+0000","last_peered":"2024-09-15T23:18:56.700227+0000","last_clean":"2024-09-15T23:18:56.700227+0000","last_became_active":"2024-09-15T23:18:55.408049+0000","last_became_peered":"2024-09-15T23:18:55.408049+0000","last_unstale":"2024-09-15T23:18:56.700227+0000","last_undegraded":"2024-09-15T23:18:56.700227+0000","last_fullsized":"2024-09-15T23:18:56.700227+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:03.216424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"129'2","reported_seq":16,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.702153+0000","last_change":"2024-09-15T23:18:54.409345+0000","last_active":"2024-09-15T23:18:56.702153+0000","last_peered":"2024-09-15T23:18:56.702153+0000","last_clean":"2024-09-15T23:18:56.702153+0000","last_became_active":"2024-09-15T23:18:54.408730+0000","last_became_peered":"2024-09-15T23:18:54.408730+0000","last_unstale":"2024-09-15T23:18:56.702153+0000","last_undegraded":"2024-09-15T23:18:56.702153+0000","last_fullsized":"2024-09-15T23:18:56.702153+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:18.211142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701009+0000","last_change":"2024-09-15T23:18:55.404465+0000","last_active":"2024-09-15T23:18:56.701009+0000","last_peered":"2024-09-15T23:18:56.701009+0000","last_clean":"2024-09-15T23:18:56.701009+0000","last_became_active":"2024-09-15T23:18:55.404184+0000","last_became_peered":"2024-09-15T23:18:55.404184+0000","last_unstale":"2024-09-15T23:18:56.701009+0000","last_undegraded":"2024-09-15T23:18:56.701009+0000","last_fullsized":"2024-09-15T23:18:56.701009+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:54:34.236072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"130'1","reported_seq":15,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:57.395993+0000","last_change":"2024-09-15T23:18:54.409506+0000","last_active":"2024-09-15T23:18:57.395993+0000","last_peered":"2024-09-15T23:18:57.395993+0000","last_clean":"2024-09-15T23:18:57.395993+0000","last_became_active":"2024-09-15T23:18:54.409261+0000","last_became_peered":"2024-09-15T23:18:54.409261+0000","last_unstale":"2024-09-15T23:18:57.395993+0000","last_undegraded":"2024-09-15T23:18:57.395993+0000","last_fullsized":"2024-09-15T23:18:57.395993+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:44:53.078597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406272+0000","last_change":"2024-09-15T23:18:55.413671+0000","last_active":"2024-09-15T23:18:56.406272+0000","last_peered":"2024-09-15T23:18:56.406272+0000","last_clean":"2024-09-15T23:18:56.406272+0000","last_became_active":"2024-09-15T23:18:55.413294+0000","last_became_peered":"2024-09-15T23:18:55.413294+0000","last_unstale":"2024-09-15T23:18:56.406272+0000","last_undegraded":"2024-09-15T23:18:56.406272+0000","last_fullsized":"2024-09-15T23:18:56.406272+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:20:38.130031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.702345+0000","last_change":"2024-09-15T23:18:54.402343+0000","last_active":"2024-09-15T23:18:56.702345+0000","last_peered":"2024-09-15T23:18:56.702345+0000","last_clean":"2024-09-15T23:18:56.702345+0000","last_became_active":"2024-09-15T23:18:54.402023+0000","last_became_peered":"2024-09-15T23:18:54.402023+0000","last_unstale":"2024-09-15T23:18:56.702345+0000","last_undegraded":"2024-09-15T23:18:56.702345+0000","last_fullsized":"2024-09-15T23:18:56.702345+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:46.096205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700528+0000","last_change":"2024-09-15T23:18:55.419096+0000","last_active":"2024-09-15T23:18:56.700528+0000","last_peered":"2024-09-15T23:18:56.700528+0000","last_clean":"2024-09-15T23:18:56.700528+0000","last_became_active":"2024-09-15T23:18:55.418856+0000","last_became_peered":"2024-09-15T23:18:55.418856+0000","last_unstale":"2024-09-15T23:18:56.700528+0000","last_undegraded":"2024-09-15T23:18:56.700528+0000","last_fullsized":"2024-09-15T23:18:56.700528+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:51:31.137122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.702284+0000","last_change":"2024-09-15T23:18:54.409421+0000","last_active":"2024-09-15T23:18:56.702284+0000","last_peered":"2024-09-15T23:18:56.702284+0000","last_clean":"2024-09-15T23:18:56.702284+0000","last_became_active":"2024-09-15T23:18:54.409046+0000","last_became_peered":"2024-09-15T23:18:54.409046+0000","last_unstale":"2024-09-15T23:18:56.702284+0000","last_undegraded":"2024-09-15T23:18:56.702284+0000","last_fullsized":"2024-09-15T23:18:56.702284+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:01:22.012773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406558+0000","last_change":"2024-09-15T23:18:55.415353+0000","last_active":"2024-09-15T23:18:56.406558+0000","last_peered":"2024-09-15T23:18:56.406558+0000","last_clean":"2024-09-15T23:18:56.406558+0000","last_became_active":"2024-09-15T23:18:55.415056+0000","last_became_peered":"2024-09-15T23:18:55.415056+0000","last_unstale":"2024-09-15T23:18:56.406558+0000","last_undegraded":"2024-09-15T23:18:56.406558+0000","last_fullsized":"2024-09-15T23:18:56.406558+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:08.549835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.701255+0000","last_change":"2024-09-15T23:18:54.403901+0000","last_active":"2024-09-15T23:18:56.701255+0000","last_peered":"2024-09-15T23:18:56.701255+0000","last_clean":"2024-09-15T23:18:56.701255+0000","last_became_active":"2024-09-15T23:18:54.403584+0000","last_became_peered":"2024-09-15T23:18:54.403584+0000","last_unstale":"2024-09-15T23:18:56.701255+0000","last_undegraded":"2024-09-15T23:18:56.701255+0000","last_fullsized":"2024-09-15T23:18:56.701255+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:27:42.458023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700315+0000","last_change":"2024-09-15T23:18:55.408533+0000","last_active":"2024-09-15T23:18:56.700315+0000","last_peered":"2024-09-15T23:18:56.700315+0000","last_clean":"2024-09-15T23:18:56.700315+0000","last_became_active":"2024-09-15T23:18:55.408256+0000","last_became_peered":"2024-09-15T23:18:55.408256+0000","last_unstale":"2024-09-15T23:18:56.700315+0000","last_undegraded":"2024-09-15T23:18:56.700315+0000","last_fullsized":"2024-09-15T23:18:56.700315+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:41.590081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700144+0000","last_change":"2024-09-15T23:18:54.403029+0000","last_active":"2024-09-15T23:18:56.700144+0000","last_peered":"2024-09-15T23:18:56.700144+0000","last_clean":"2024-09-15T23:18:56.700144+0000","last_became_active":"2024-09-15T23:18:54.402755+0000","last_became_peered":"2024-09-15T23:18:54.402755+0000","last_unstale":"2024-09-15T23:18:56.700144+0000","last_undegraded":"2024-09-15T23:18:56.700144+0000","last_fullsized":"2024-09-15T23:18:56.700144+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:29.178188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700189+0000","last_change":"2024-09-15T23:18:55.400347+0000","last_active":"2024-09-15T23:18:56.700189+0000","last_peered":"2024-09-15T23:18:56.700189+0000","last_clean":"2024-09-15T23:18:56.700189+0000","last_became_active":"2024-09-15T23:18:55.400062+0000","last_became_peered":"2024-09-15T23:18:55.400062+0000","last_unstale":"2024-09-15T23:18:56.700189+0000","last_undegraded":"2024-09-15T23:18:56.700189+0000","last_fullsized":"2024-09-15T23:18:56.700189+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:57.314262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406194+0000","last_change":"2024-09-15T23:18:54.399228+0000","last_active":"2024-09-15T23:18:56.406194+0000","last_peered":"2024-09-15T23:18:56.406194+0000","last_clean":"2024-09-15T23:18:56.406194+0000","last_became_active":"2024-09-15T23:18:54.398231+0000","last_became_peered":"2024-09-15T23:18:54.398231+0000","last_unstale":"2024-09-15T23:18:56.406194+0000","last_undegraded":"2024-09-15T23:18:56.406194+0000","last_fullsized":"2024-09-15T23:18:56.406194+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:17.495549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700636+0000","last_change":"2024-09-15T23:18:55.412629+0000","last_active":"2024-09-15T23:18:56.700636+0000","last_peered":"2024-09-15T23:18:56.700636+0000","last_clean":"2024-09-15T23:18:56.700636+0000","last_became_active":"2024-09-15T23:18:55.411135+0000","last_became_peered":"2024-09-15T23:18:55.411135+0000","last_unstale":"2024-09-15T23:18:56.700636+0000","last_undegraded":"2024-09-15T23:18:56.700636+0000","last_fullsized":"2024-09-15T23:18:56.700636+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:01:11.622641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.700494+0000","last_change":"2024-09-15T23:18:54.408515+0000","last_active":"2024-09-15T23:18:56.700494+0000","last_peered":"2024-09-15T23:18:56.700494+0000","last_clean":"2024-09-15T23:18:56.700494+0000","last_became_active":"2024-09-15T23:18:54.408246+0000","last_became_peered":"2024-09-15T23:18:54.408246+0000","last_unstale":"2024-09-15T23:18:56.700494+0000","last_undegraded":"2024-09-15T23:18:56.700494+0000","last_fullsized":"2024-09-15T23:18:56.700494+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:38:39.917102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":12,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.702271+0000","last_change":"2024-09-15T23:18:55.418483+0000","last_active":"2024-09-15T23:18:56.702271+0000","last_peered":"2024-09-15T23:18:56.702271+0000","last_clean":"2024-09-15T23:18:56.702271+0000","last_became_active":"2024-09-15T23:18:55.418114+0000","last_became_peered":"2024-09-15T23:18:55.418114+0000","last_unstale":"2024-09-15T23:18:56.702271+0000","last_undegraded":"2024-09-15T23:18:56.702271+0000","last_fullsized":"2024-09-15T23:18:56.702271+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":128,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:54.383215+0000","last_clean_scrub_stamp":"2024-09-15T23:18:54.383215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:34.737894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":14,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406584+0000","last_change":"2024-09-15T23:18:54.404148+0000","last_active":"2024-09-15T23:18:56.406584+0000","last_peered":"2024-09-15T23:18:56.406584+0000","last_clean":"2024-09-15T23:18:56.406584+0000","last_became_active":"2024-09-15T23:18:54.403861+0000","last_became_peered":"2024-09-15T23:18:54.403861+0000","last_unstale":"2024-09-15T23:18:56.406584+0000","last_undegraded":"2024-09-15T23:18:56.406584+0000","last_fullsized":"2024-09-15T23:18:56.406584+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:18:53.378158+0000","last_clean_scrub_stamp":"2024-09-15T23:18:53.378158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:23:56.309204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":369,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-09-15T23:18:56.406289+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:18:56.406289+0000","last_peered":"2024-09-15T23:18:56.406289+0000","last_clean":"2024-09-15T23:18:56.406289+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:18:56.406289+0000","last_undegraded":"2024-09-15T23:18:56.406289+0000","last_fullsized":"2024-09-15T23:18:56.406289+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476825,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50800,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321040,"statfs":{"total":96636764160,"available":96584744960,"internally_reserved":0,"allocated":1601536,"data_stored":708257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476822,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46660,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325180,"statfs":{"total":96636764160,"available":96588984320,"internally_reserved":0,"allocated":1613824,"data_stored":708895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476824,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63860,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307980,"statfs":{"total":96636764160,"available":96571371520,"internally_reserved":0,"allocated":2195456,"data_stored":1298625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476824,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41080,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330760,"statfs":{"total":96636764160,"available":96594698240,"internally_reserved":0,"allocated":1609728,"data_stored":708909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542231,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41096,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330744,"statfs":{"total":96636764160,"available":96594681856,"internally_reserved":0,"allocated":1622016,"data_stored":709993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542231,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46640,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94325200,"statfs":{"total":96636764160,"available":96589004800,"internally_reserved":0,"allocated":1601536,"data_stored":708257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542230,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51396,"kb_used_data":2152,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320444,"statfs":{"total":96636764160,"available":96584134656,"internally_reserved":0,"allocated":2203648,"data_stored":1298717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542232,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50824,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321016,"statfs":{"total":96636764160,"available":96584720384,"internally_reserved":0,"allocated":1617920,"data_stored":709959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:19:03.008 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T23:19:03.008 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T23:19:03.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.149+0000 7f142da53640 1 Processor -- start 2024-09-15T23:19:03.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.149+0000 7f142da53640 1 -- start start 2024-09-15T23:19:03.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.149+0000 7f142da53640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f14280b38a0 0x7f14280d3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:03.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.149+0000 7f142da53640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14280cf710 con 0x7f142806bfd0 2024-09-15T23:19:03.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.149+0000 7f142da53640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14280cf9f0 con 0x7f14280b3350 2024-09-15T23:19:03.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.149+0000 7f142da53640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f14280b78a0 con 0x7f14280b38a0 2024-09-15T23:19:03.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.150+0000 7f1426ffd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f142806bfd0 0x7f142806c3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35210/0 (socket says 172.21.15.123:35210) 2024-09-15T23:19:03.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.150+0000 7f1426ffd640 1 -- 172.21.15.123:0/2561233036 learned_addr learned my addr 172.21.15.123:0/2561233036 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:19:03.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.150+0000 7f14277fe640 1 --2- 172.21.15.123:0/2561233036 >> v2:172.21.15.188:3300/0 conn(0x7f14280b38a0 0x7f14280d3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:03.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.150+0000 7f1425ffb640 1 -- 172.21.15.123:0/2561233036 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3346409499 0 0) 0x7f14280cf710 con 0x7f142806bfd0 2024-09-15T23:19:03.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.150+0000 7f1425ffb640 1 -- 172.21.15.123:0/2561233036 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1410003520 con 0x7f142806bfd0 2024-09-15T23:19:03.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.150+0000 7f1425ffb640 1 -- 172.21.15.123:0/2561233036 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3080572613 0 0) 0x7f1410003520 con 0x7f142806bfd0 2024-09-15T23:19:03.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.150+0000 7f1425ffb640 1 -- 172.21.15.123:0/2561233036 >> v2:172.21.15.188:3300/0 conn(0x7f14280b38a0 msgr2=0x7f14280d3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:03.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.150+0000 7f1425ffb640 1 --2- 172.21.15.123:0/2561233036 >> v2:172.21.15.188:3300/0 conn(0x7f14280b38a0 0x7f14280d3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:03.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.150+0000 7f1425ffb640 1 -- 172.21.15.123:0/2561233036 >> v1:172.21.15.188:6789/0 conn(0x7f14280b3350 legacy=0x7f14280d2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:03.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.150+0000 7f1425ffb640 1 -- 172.21.15.123:0/2561233036 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14280cfcd0 con 0x7f142806bfd0 2024-09-15T23:19:03.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.150+0000 7f1425ffb640 1 -- 172.21.15.123:0/2561233036 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f1418001670 con 0x7f142806bfd0 2024-09-15T23:19:03.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.150+0000 7f1425ffb640 1 -- 172.21.15.123:0/2561233036 >> v1:172.21.15.123:6789/0 conn(0x7f142806bfd0 legacy=0x7f142806c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:03.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.150+0000 7f1425ffb640 1 --2- 172.21.15.123:0/2561233036 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f14100039b0 0x7f1410003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:03.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.150+0000 7f1425ffb640 1 --2- 172.21.15.123:0/2561233036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14100043b0 0x7f1410004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:03.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.150+0000 7f1425ffb640 1 --2- 172.21.15.123:0/2561233036 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1410005080 0x7f141000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:03.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.150+0000 7f1425ffb640 1 -- 172.21.15.123:0/2561233036 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f141000bf00 con 0x7f14100043b0 2024-09-15T23:19:03.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.150+0000 7f1425ffb640 1 -- 172.21.15.123:0/2561233036 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f141000c0b0 con 0x7f14100039b0 2024-09-15T23:19:03.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.150+0000 7f1425ffb640 1 -- 172.21.15.123:0/2561233036 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f141000c2b0 con 0x7f1410005080 2024-09-15T23:19:03.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.150+0000 7f14267fc640 1 --2- 172.21.15.123:0/2561233036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14100043b0 0x7f1410004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:03.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.150+0000 7f1426ffd640 1 --2- 172.21.15.123:0/2561233036 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f14100039b0 0x7f1410003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:03.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.150+0000 7f14277fe640 1 --2- 172.21.15.123:0/2561233036 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1410005080 0x7f141000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:03.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.151+0000 7f14267fc640 1 -- 172.21.15.123:0/2561233036 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1410005080 msgr2=0x7f141000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:03.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.151+0000 7f14267fc640 1 --2- 172.21.15.123:0/2561233036 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1410005080 0x7f141000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:03.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.151+0000 7f14267fc640 1 -- 172.21.15.123:0/2561233036 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f14100039b0 msgr2=0x7f1410003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:03.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.151+0000 7f14267fc640 1 --2- 172.21.15.123:0/2561233036 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f14100039b0 0x7f1410003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:03.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.151+0000 7f14267fc640 1 -- 172.21.15.123:0/2561233036 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1410003520 con 0x7f14100043b0 2024-09-15T23:19:03.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.151+0000 7f14277fe640 1 -- 172.21.15.123:0/2561233036 reap_dead start 2024-09-15T23:19:03.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.151+0000 7f1426ffd640 1 --2- 172.21.15.123:0/2561233036 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f14100039b0 0x7f1410003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:19:03.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.151+0000 7f14267fc640 1 --2- 172.21.15.123:0/2561233036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14100043b0 0x7f1410004880 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f141c001860 tx=0x7f1410005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda7b21ce2a4db1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:03.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.152+0000 7f1425ffb640 1 -- 172.21.15.123:0/2561233036 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141c037070 con 0x7f14100043b0 2024-09-15T23:19:03.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.152+0000 7f1425ffb640 1 -- 172.21.15.123:0/2561233036 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f141c02abe0 con 0x7f14100043b0 2024-09-15T23:19:03.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.152+0000 7f1425ffb640 1 -- 172.21.15.123:0/2561233036 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141c001430 con 0x7f14100043b0 2024-09-15T23:19:03.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.152+0000 7f142da53640 1 -- 172.21.15.123:0/2561233036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14100043b0 msgr2=0x7f1410004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:03.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.152+0000 7f142da53640 1 --2- 172.21.15.123:0/2561233036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14100043b0 0x7f1410004880 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f141c001860 tx=0x7f1410005830 comp rx=0 tx=0).stop 2024-09-15T23:19:03.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.152+0000 7f142da53640 1 -- 172.21.15.123:0/2561233036 shutdown_connections 2024-09-15T23:19:03.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.152+0000 7f142da53640 1 --2- 172.21.15.123:0/2561233036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14100043b0 0x7f1410004880 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:03.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.152+0000 7f142da53640 1 -- 172.21.15.123:0/2561233036 >> 172.21.15.123:0/2561233036 conn(0x7f14280d11c0 msgr2=0x7f14280d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:03.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.152+0000 7f142da53640 1 -- 172.21.15.123:0/2561233036 shutdown_connections 2024-09-15T23:19:03.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.152+0000 7f142da53640 1 -- 172.21.15.123:0/2561233036 wait complete. 2024-09-15T23:19:03.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.153+0000 7f142da53640 1 Processor -- start 2024-09-15T23:19:03.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.154+0000 7f142da53640 1 -- start start 2024-09-15T23:19:03.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.154+0000 7f142da53640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14100043b0 0x7f142814bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:03.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.154+0000 7f142da53640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1428155e20 0x7f14281575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:03.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.154+0000 7f142da53640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1428157af0 0x7f1428161410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:03.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.154+0000 7f142da53640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f142806cd50 con 0x7f14100043b0 2024-09-15T23:19:03.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.154+0000 7f142da53640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f14280cffb0 con 0x7f1428155e20 2024-09-15T23:19:03.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.154+0000 7f142da53640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f142815eae0 con 0x7f1428157af0 2024-09-15T23:19:03.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.154+0000 7f1426ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14100043b0 0x7f142814bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:03.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.154+0000 7f1426ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14100043b0 0x7f142814bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38738/0 (socket says 172.21.15.123:38738) 2024-09-15T23:19:03.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.154+0000 7f1426ffd640 1 -- 172.21.15.123:0/1824740917 learned_addr learned my addr 172.21.15.123:0/1824740917 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:03.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.155+0000 7f1426ffd640 1 -- 172.21.15.123:0/1824740917 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1428157af0 msgr2=0x7f1428161410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:03.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.155+0000 7f1426ffd640 1 --2- 172.21.15.123:0/1824740917 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1428157af0 0x7f1428161410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:03.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.155+0000 7f1426ffd640 1 -- 172.21.15.123:0/1824740917 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1428155e20 msgr2=0x7f14281575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:03.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.155+0000 7f1426ffd640 1 --2- 172.21.15.123:0/1824740917 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1428155e20 0x7f14281575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:03.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.155+0000 7f1426ffd640 1 -- 172.21.15.123:0/1824740917 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1428157f90 con 0x7f14100043b0 2024-09-15T23:19:03.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.155+0000 7f1426ffd640 1 --2- 172.21.15.123:0/1824740917 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14100043b0 0x7f142814bae0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f1418007290 tx=0x7f1418007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:03.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.155+0000 7f140ffff640 1 -- 172.21.15.123:0/1824740917 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1418007d10 con 0x7f14100043b0 2024-09-15T23:19:03.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.155+0000 7f140ffff640 1 -- 172.21.15.123:0/1824740917 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1418018070 con 0x7f14100043b0 2024-09-15T23:19:03.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.155+0000 7f142da53640 1 -- 172.21.15.123:0/1824740917 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1428158270 con 0x7f14100043b0 2024-09-15T23:19:03.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.155+0000 7f140ffff640 1 -- 172.21.15.123:0/1824740917 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141800fb80 con 0x7f14100043b0 2024-09-15T23:19:03.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.155+0000 7f142da53640 1 -- 172.21.15.123:0/1824740917 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1428158830 con 0x7f14100043b0 2024-09-15T23:19:03.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.156+0000 7f142da53640 1 -- 172.21.15.123:0/1824740917 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f142806c3b0 con 0x7f14100043b0 2024-09-15T23:19:03.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.157+0000 7f140ffff640 1 -- 172.21.15.123:0/1824740917 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f141800fd20 con 0x7f14100043b0 2024-09-15T23:19:03.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.157+0000 7f140ffff640 1 --2- 172.21.15.123:0/1824740917 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f141406c2b0 0x7f141406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:03.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.157+0000 7f140ffff640 1 -- 172.21.15.123:0/1824740917 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f141808b3a0 con 0x7f14100043b0 2024-09-15T23:19:03.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.157+0000 7f14267fc640 1 --2- 172.21.15.123:0/1824740917 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f141406c2b0 0x7f141406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:03.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.158+0000 7f14267fc640 1 --2- 172.21.15.123:0/1824740917 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f141406c2b0 0x7f141406e770 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f141c034000 tx=0x7f141c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:03.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.161+0000 7f140ffff640 1 -- 172.21.15.123:0/1824740917 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1418059550 con 0x7f14100043b0 2024-09-15T23:19:03.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.389+0000 7f142da53640 1 -- 172.21.15.123:0/1824740917 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f14280d1df0 con 0x7f14100043b0 2024-09-15T23:19:03.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.391+0000 7f140ffff640 1 -- 172.21.15.123:0/1824740917 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7f141805d850 con 0x7f14100043b0 2024-09-15T23:19:03.392 INFO:teuthology.orchestra.run.smithi123.stdout:[client.0] 2024-09-15T23:19:03.392 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCNaedmzQPqJRAAhUf1dnVYohN4obCfeu8+7g== 2024-09-15T23:19:03.393 INFO:teuthology.orchestra.run.smithi123.stdout: caps mds = "allow" 2024-09-15T23:19:03.393 INFO:teuthology.orchestra.run.smithi123.stdout: caps mon = "allow r" 2024-09-15T23:19:03.393 INFO:teuthology.orchestra.run.smithi123.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T23:19:03.393 INFO:teuthology.orchestra.run.smithi123.stderr:updated caps for client.0 2024-09-15T23:19:03.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.393+0000 7f142da53640 1 -- 172.21.15.123:0/1824740917 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f141406c2b0 msgr2=0x7f141406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:03.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.393+0000 7f142da53640 1 --2- 172.21.15.123:0/1824740917 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f141406c2b0 0x7f141406e770 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f141c034000 tx=0x7f141c02e000 comp rx=0 tx=0).stop 2024-09-15T23:19:03.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.393+0000 7f142da53640 1 -- 172.21.15.123:0/1824740917 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14100043b0 msgr2=0x7f142814bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:03.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.393+0000 7f142da53640 1 --2- 172.21.15.123:0/1824740917 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14100043b0 0x7f142814bae0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f1418007290 tx=0x7f1418007750 comp rx=0 tx=0).stop 2024-09-15T23:19:03.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.393+0000 7f142da53640 1 -- 172.21.15.123:0/1824740917 shutdown_connections 2024-09-15T23:19:03.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.393+0000 7f142da53640 1 --2- 172.21.15.123:0/1824740917 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1428157af0 0x7f1428161410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:03.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.393+0000 7f142da53640 1 --2- 172.21.15.123:0/1824740917 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1428155e20 0x7f14281575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:03.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.393+0000 7f142da53640 1 --2- 172.21.15.123:0/1824740917 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f141406c2b0 0x7f141406e770 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:03.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.393+0000 7f142da53640 1 --2- 172.21.15.123:0/1824740917 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14100043b0 0x7f142814bae0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:03.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.393+0000 7f142da53640 1 -- 172.21.15.123:0/1824740917 >> 172.21.15.123:0/1824740917 conn(0x7f14280d11c0 msgr2=0x7f14280b7830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:03.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.394+0000 7f142da53640 1 -- 172.21.15.123:0/1824740917 shutdown_connections 2024-09-15T23:19:03.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.394+0000 7f142da53640 1 -- 172.21.15.123:0/1824740917 wait complete. 2024-09-15T23:19:03.407 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:19:03.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.504+0000 7f650e51a640 1 Processor -- start 2024-09-15T23:19:03.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.504+0000 7f650e51a640 1 -- start start 2024-09-15T23:19:03.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.505+0000 7f650e51a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f650806cd20 0x7f65080b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:03.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.505+0000 7f650e51a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6508070b80 0x7f65080b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:03.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.505+0000 7f650e51a640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f650815eab0 con 0x7f650815e6d0 2024-09-15T23:19:03.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.505+0000 7f650e51a640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f65080b77e0 con 0x7f650806cd20 2024-09-15T23:19:03.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.505+0000 7f650e51a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f650815ed70 con 0x7f6508070b80 2024-09-15T23:19:03.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.505+0000 7f65077fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f650806cd20 0x7f65080b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:03.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.506+0000 7f65077fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f650806cd20 0x7f65080b6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38754/0 (socket says 172.21.15.123:38754) 2024-09-15T23:19:03.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.506+0000 7f65077fe640 1 -- 172.21.15.123:0/455132798 learned_addr learned my addr 172.21.15.123:0/455132798 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:03.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.506+0000 7f650cab7640 1 --2- 172.21.15.123:0/455132798 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6508070b80 0x7f65080b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:03.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.506+0000 7f65077fe640 1 -- 172.21.15.123:0/455132798 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6508070b80 msgr2=0x7f65080b72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:03.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.506+0000 7f65077fe640 1 --2- 172.21.15.123:0/455132798 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6508070b80 0x7f65080b72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:03.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.506+0000 7f65077fe640 1 -- 172.21.15.123:0/455132798 >> v1:172.21.15.188:6789/0 conn(0x7f650815e6d0 legacy=0x7f6508071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:03.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.506+0000 7f65077fe640 1 -- 172.21.15.123:0/455132798 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f650815f050 con 0x7f650806cd20 2024-09-15T23:19:03.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.506+0000 7f650cab7640 1 --2- 172.21.15.123:0/455132798 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6508070b80 0x7f65080b72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:19:03.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.506+0000 7f65077fe640 1 --2- 172.21.15.123:0/455132798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f650806cd20 0x7f65080b6d60 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f64fc009870 tx=0x7f64fc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d311eb832ecc16f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:03.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.507+0000 7f6506ffd640 1 -- 172.21.15.123:0/455132798 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64fc037070 con 0x7f650806cd20 2024-09-15T23:19:03.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.507+0000 7f6506ffd640 1 -- 172.21.15.123:0/455132798 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64fc032440 con 0x7f650806cd20 2024-09-15T23:19:03.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.507+0000 7f6506ffd640 1 -- 172.21.15.123:0/455132798 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64fc032810 con 0x7f650806cd20 2024-09-15T23:19:03.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.507+0000 7f650e51a640 1 -- 172.21.15.123:0/455132798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f650806cd20 msgr2=0x7f65080b6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:03.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.507+0000 7f650e51a640 1 --2- 172.21.15.123:0/455132798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f650806cd20 0x7f65080b6d60 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f64fc009870 tx=0x7f64fc02a210 comp rx=0 tx=0).stop 2024-09-15T23:19:03.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.507+0000 7f650e51a640 1 -- 172.21.15.123:0/455132798 shutdown_connections 2024-09-15T23:19:03.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.507+0000 7f650e51a640 1 --2- 172.21.15.123:0/455132798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f650806cd20 0x7f65080b6d60 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:03.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.507+0000 7f650e51a640 1 --2- 172.21.15.123:0/455132798 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6508070b80 0x7f65080b72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:03.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.507+0000 7f650e51a640 1 -- 172.21.15.123:0/455132798 >> 172.21.15.123:0/455132798 conn(0x7f6508067fb0 msgr2=0x7f650806f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:03.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.507+0000 7f650e51a640 1 -- 172.21.15.123:0/455132798 shutdown_connections 2024-09-15T23:19:03.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.507+0000 7f650e51a640 1 -- 172.21.15.123:0/455132798 wait complete. 2024-09-15T23:19:03.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.508+0000 7f650e51a640 1 Processor -- start 2024-09-15T23:19:03.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.509+0000 7f650e51a640 1 -- start start 2024-09-15T23:19:03.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.509+0000 7f650e51a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f650806cd20 0x7f650814fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:03.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.509+0000 7f650e51a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6508070b80 0x7f6508157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:03.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.509+0000 7f650e51a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f650815e6d0 0x7f6508156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:03.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.509+0000 7f650e51a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f650815f8f0 con 0x7f650806cd20 2024-09-15T23:19:03.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.509+0000 7f650e51a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f650815f610 con 0x7f6508070b80 2024-09-15T23:19:03.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.509+0000 7f650e51a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f65081622a0 con 0x7f650815e6d0 2024-09-15T23:19:03.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.509+0000 7f6507fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f650806cd20 0x7f650814fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:03.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.509+0000 7f6507fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f650806cd20 0x7f650814fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38760/0 (socket says 172.21.15.123:38760) 2024-09-15T23:19:03.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.509+0000 7f6507fff640 1 -- 172.21.15.123:0/301156973 learned_addr learned my addr 172.21.15.123:0/301156973 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:03.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.510+0000 7f65077fe640 1 --2- 172.21.15.123:0/301156973 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6508070b80 0x7f6508157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:03.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.510+0000 7f650cab7640 1 --2- 172.21.15.123:0/301156973 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f650815e6d0 0x7f6508156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:03.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.510+0000 7f6507fff640 1 -- 172.21.15.123:0/301156973 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f650815e6d0 msgr2=0x7f6508156c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:03.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.510+0000 7f6507fff640 1 --2- 172.21.15.123:0/301156973 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f650815e6d0 0x7f6508156c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:03.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.510+0000 7f6507fff640 1 -- 172.21.15.123:0/301156973 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6508070b80 msgr2=0x7f6508157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:03.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.510+0000 7f6507fff640 1 --2- 172.21.15.123:0/301156973 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6508070b80 0x7f6508157de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:03.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.510+0000 7f6507fff640 1 -- 172.21.15.123:0/301156973 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6508150130 con 0x7f650806cd20 2024-09-15T23:19:03.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.510+0000 7f6507fff640 1 --2- 172.21.15.123:0/301156973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f650806cd20 0x7f650814fb00 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f64f800b3f0 tx=0x7f64f800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:03.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.510+0000 7f6504ff9640 1 -- 172.21.15.123:0/301156973 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f8015020 con 0x7f650806cd20 2024-09-15T23:19:03.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.510+0000 7f6504ff9640 1 -- 172.21.15.123:0/301156973 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64f8011830 con 0x7f650806cd20 2024-09-15T23:19:03.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.510+0000 7f6504ff9640 1 -- 172.21.15.123:0/301156973 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f8011c20 con 0x7f650806cd20 2024-09-15T23:19:03.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.510+0000 7f650e51a640 1 -- 172.21.15.123:0/301156973 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6508150410 con 0x7f650806cd20 2024-09-15T23:19:03.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.510+0000 7f650e51a640 1 -- 172.21.15.123:0/301156973 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65081509d0 con 0x7f650806cd20 2024-09-15T23:19:03.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.511+0000 7f650e51a640 1 -- 172.21.15.123:0/301156973 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6508071390 con 0x7f650806cd20 2024-09-15T23:19:03.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.512+0000 7f6504ff9640 1 -- 172.21.15.123:0/301156973 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f64f8018020 con 0x7f650806cd20 2024-09-15T23:19:03.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.512+0000 7f6504ff9640 1 --2- 172.21.15.123:0/301156973 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f64f406c2b0 0x7f64f406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:03.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.513+0000 7f6504ff9640 1 -- 172.21.15.123:0/301156973 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f64f808aec0 con 0x7f650806cd20 2024-09-15T23:19:03.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.513+0000 7f65077fe640 1 --2- 172.21.15.123:0/301156973 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f64f406c2b0 0x7f64f406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:03.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.513+0000 7f65077fe640 1 --2- 172.21.15.123:0/301156973 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f64f406c2b0 0x7f64f406e770 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f64fc034000 tx=0x7f64fc02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:03.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.517+0000 7f6504ff9640 1 -- 172.21.15.123:0/301156973 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f64f801f030 con 0x7f650806cd20 2024-09-15T23:19:03.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.717+0000 7f650e51a640 1 -- 172.21.15.123:0/301156973 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6508151fc0 con 0x7f650806cd20 2024-09-15T23:19:03.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.718+0000 7f6504ff9640 1 -- 172.21.15.123:0/301156973 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) ==== 94+0+5237 (secure 0 0 0) 0x7f64f8059070 con 0x7f650806cd20 2024-09-15T23:19:03.719 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:19:03.719 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":80,"btime":"2024-09-15T23:18:57:403025+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6386,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/1352396114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":1352396114},{"type":"v1","addr":"172.21.15.188:6836","nonce":1352396114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":8022,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2727961795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2727961795},{"type":"v1","addr":"172.21.15.123:6834","nonce":2727961795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":8025,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3879785466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":3879785466},{"type":"v1","addr":"172.21.15.123:6835","nonce":3879785466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:18:54.727897+0000","modified":"2024-09-15T23:18:56.730668+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8034},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8034":{"gid":8034,"name":"d","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6837/3551744094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":3551744094},{"type":"v1","addr":"172.21.15.188:6837","nonce":3551744094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8034,"qdb_cluster":[8034]},"id":8}]} 2024-09-15T23:19:03.719 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 80 2024-09-15T23:19:03.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.720+0000 7f650e51a640 1 -- 172.21.15.123:0/301156973 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f64f406c2b0 msgr2=0x7f64f406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:03.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.720+0000 7f650e51a640 1 --2- 172.21.15.123:0/301156973 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f64f406c2b0 0x7f64f406e770 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f64fc034000 tx=0x7f64fc02e000 comp rx=0 tx=0).stop 2024-09-15T23:19:03.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.720+0000 7f650e51a640 1 -- 172.21.15.123:0/301156973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f650806cd20 msgr2=0x7f650814fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:03.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.720+0000 7f650e51a640 1 --2- 172.21.15.123:0/301156973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f650806cd20 0x7f650814fb00 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f64f800b3f0 tx=0x7f64f800b8b0 comp rx=0 tx=0).stop 2024-09-15T23:19:03.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.720+0000 7f650e51a640 1 -- 172.21.15.123:0/301156973 shutdown_connections 2024-09-15T23:19:03.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.720+0000 7f650e51a640 1 --2- 172.21.15.123:0/301156973 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f650815e6d0 0x7f6508156c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:03.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.720+0000 7f650e51a640 1 --2- 172.21.15.123:0/301156973 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6508070b80 0x7f6508157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:03.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.720+0000 7f650e51a640 1 --2- 172.21.15.123:0/301156973 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f64f406c2b0 0x7f64f406e770 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:03.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.720+0000 7f650e51a640 1 --2- 172.21.15.123:0/301156973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f650806cd20 0x7f650814fb00 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:03.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.720+0000 7f650e51a640 1 -- 172.21.15.123:0/301156973 >> 172.21.15.123:0/301156973 conn(0x7f6508067fb0 msgr2=0x7f650806f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:03.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.720+0000 7f650e51a640 1 -- 172.21.15.123:0/301156973 shutdown_connections 2024-09-15T23:19:03.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:03.720+0000 7f650e51a640 1 -- 172.21.15.123:0/301156973 wait complete. 2024-09-15T23:19:04.135 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 80, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:18:54.727897+0000', 'modified': '2024-09-15T23:18:56.730668+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8034}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8034': {'gid': 8034, 'name': 'd', 'rank': 0, 'incarnation': 78, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.188:6837/3551744094', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6835', 'nonce': 3551744094}, {'type': 'v1', 'addr': '172.21.15.188:6837', 'nonce': 3551744094}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8034, 'qdb_cluster': [8034]} 2024-09-15T23:19:04.136 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:19:04.136 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-15T23:19:04.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.237+0000 7f7faf781640 1 Processor -- start 2024-09-15T23:19:04.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.237+0000 7f7faf781640 1 -- start start 2024-09-15T23:19:04.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.238+0000 7f7faf781640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7fa813eb20 0x7f7fa815c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:04.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.238+0000 7f7faf781640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fa8071180 con 0x7f7fa806c320 2024-09-15T23:19:04.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.238+0000 7f7faf781640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fa8071460 con 0x7f7fa80b2d40 2024-09-15T23:19:04.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.238+0000 7f7faf781640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7fa8071ab0 con 0x7f7fa813eb20 2024-09-15T23:19:04.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.238+0000 7f7facd1c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7fa806c320 0x7f7fa815bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35218/0 (socket says 172.21.15.123:35218) 2024-09-15T23:19:04.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.238+0000 7f7facd1c640 1 -- 172.21.15.123:0/2032606381 learned_addr learned my addr 172.21.15.123:0/2032606381 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:19:04.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.238+0000 7f7fa7fff640 1 -- 172.21.15.123:0/2032606381 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2378717523 0 0) 0x7f7fa8071180 con 0x7f7fa806c320 2024-09-15T23:19:04.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.238+0000 7f7fa7fff640 1 -- 172.21.15.123:0/2032606381 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f90003520 con 0x7f7fa806c320 2024-09-15T23:19:04.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.238+0000 7f7fadd1e640 1 --2- 172.21.15.123:0/2032606381 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7fa813eb20 0x7f7fa815c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:04.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.238+0000 7f7fa7fff640 1 -- 172.21.15.123:0/2032606381 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1733279303 0 0) 0x7f7f90003520 con 0x7f7fa806c320 2024-09-15T23:19:04.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.238+0000 7f7fa7fff640 1 -- 172.21.15.123:0/2032606381 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7fa813eb20 msgr2=0x7f7fa815c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:04.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.238+0000 7f7fa7fff640 1 --2- 172.21.15.123:0/2032606381 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7fa813eb20 0x7f7fa815c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.238+0000 7f7fa7fff640 1 -- 172.21.15.123:0/2032606381 >> v1:172.21.15.188:6789/0 conn(0x7f7fa80b2d40 legacy=0x7f7fa806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:04.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.238+0000 7f7fa7fff640 1 -- 172.21.15.123:0/2032606381 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa8071740 con 0x7f7fa806c320 2024-09-15T23:19:04.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.238+0000 7f7fa7fff640 1 -- 172.21.15.123:0/2032606381 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f7f9c001670 con 0x7f7fa806c320 2024-09-15T23:19:04.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.238+0000 7f7fa7fff640 1 -- 172.21.15.123:0/2032606381 >> v1:172.21.15.123:6789/0 conn(0x7f7fa806c320 legacy=0x7f7fa815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:04.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.238+0000 7f7fa7fff640 1 --2- 172.21.15.123:0/2032606381 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7fa813eb20 0x7f7f900039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:04.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.238+0000 7f7fa7fff640 1 --2- 172.21.15.123:0/2032606381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f90003ff0 0x7f7f90004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:04.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.238+0000 7f7fa7fff640 1 --2- 172.21.15.123:0/2032606381 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f90004d40 0x7f7f900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:04.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.238+0000 7f7fa7fff640 1 -- 172.21.15.123:0/2032606381 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa8071ab0 con 0x7f7f90003ff0 2024-09-15T23:19:04.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.238+0000 7f7fa7fff640 1 -- 172.21.15.123:0/2032606381 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9000bb50 con 0x7f7f90004d40 2024-09-15T23:19:04.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.238+0000 7f7fa7fff640 1 -- 172.21.15.123:0/2032606381 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7f9000df60 con 0x7f7fa813eb20 2024-09-15T23:19:04.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.238+0000 7f7facd1c640 1 --2- 172.21.15.123:0/2032606381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f90003ff0 0x7f7f90004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:04.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.239+0000 7f7fad51d640 1 --2- 172.21.15.123:0/2032606381 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7fa813eb20 0x7f7f900039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:04.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.239+0000 7f7fadd1e640 1 --2- 172.21.15.123:0/2032606381 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f90004d40 0x7f7f900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:04.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.239+0000 7f7facd1c640 1 -- 172.21.15.123:0/2032606381 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7fa813eb20 msgr2=0x7f7f900039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:04.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.239+0000 7f7facd1c640 1 --2- 172.21.15.123:0/2032606381 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7fa813eb20 0x7f7f900039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.239+0000 7f7facd1c640 1 -- 172.21.15.123:0/2032606381 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f90004d40 msgr2=0x7f7f900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:04.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.239+0000 7f7facd1c640 1 --2- 172.21.15.123:0/2032606381 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f90004d40 0x7f7f900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.239+0000 7f7facd1c640 1 -- 172.21.15.123:0/2032606381 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f90003520 con 0x7f7f90003ff0 2024-09-15T23:19:04.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.239+0000 7f7facd1c640 1 --2- 172.21.15.123:0/2032606381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f90003ff0 0x7f7f90004800 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00c210 tx=0x7f7f90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7533dc6d6acb809e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.240+0000 7f7fa7fff640 1 -- 172.21.15.123:0/2032606381 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c007d10 con 0x7f7f90003ff0 2024-09-15T23:19:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.240+0000 7f7fa7fff640 1 -- 172.21.15.123:0/2032606381 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f9c005ad0 con 0x7f7f90003ff0 2024-09-15T23:19:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.240+0000 7f7fa7fff640 1 -- 172.21.15.123:0/2032606381 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c007070 con 0x7f7f90003ff0 2024-09-15T23:19:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.240+0000 7f7faf781640 1 -- 172.21.15.123:0/2032606381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f90003ff0 msgr2=0x7f7f90004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.240+0000 7f7faf781640 1 --2- 172.21.15.123:0/2032606381 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f90003ff0 0x7f7f90004800 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00c210 tx=0x7f7f90005830 comp rx=0 tx=0).stop 2024-09-15T23:19:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.240+0000 7f7fadd1e640 1 -- 172.21.15.123:0/2032606381 reap_dead start 2024-09-15T23:19:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.240+0000 7f7faf781640 1 -- 172.21.15.123:0/2032606381 shutdown_connections 2024-09-15T23:19:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.240+0000 7f7faf781640 1 -- 172.21.15.123:0/2032606381 >> 172.21.15.123:0/2032606381 conn(0x7f7fa80ccec0 msgr2=0x7f7fa80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.240+0000 7f7faf781640 1 -- 172.21.15.123:0/2032606381 shutdown_connections 2024-09-15T23:19:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.240+0000 7f7faf781640 1 -- 172.21.15.123:0/2032606381 wait complete. 2024-09-15T23:19:04.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.241+0000 7f7faf781640 1 Processor -- start 2024-09-15T23:19:04.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.241+0000 7f7faf781640 1 -- start start 2024-09-15T23:19:04.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.242+0000 7f7faf781640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f90003ff0 0x7f7fa813d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:04.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.242+0000 7f7faf781640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fa813ded0 0x7f7fa81560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:04.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.242+0000 7f7faf781640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7fa81565e0 0x7f7fa8156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:04.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.242+0000 7f7faf781640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa815c790 con 0x7f7fa813ded0 2024-09-15T23:19:04.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.242+0000 7f7faf781640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa815c610 con 0x7f7fa81565e0 2024-09-15T23:19:04.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.242+0000 7f7faf781640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7fa80b3570 con 0x7f7f90003ff0 2024-09-15T23:19:04.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.242+0000 7f7facd1c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fa813ded0 0x7f7fa81560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:04.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.242+0000 7f7facd1c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fa813ded0 0x7f7fa81560a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38788/0 (socket says 172.21.15.123:38788) 2024-09-15T23:19:04.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.242+0000 7f7facd1c640 1 -- 172.21.15.123:0/4080164863 learned_addr learned my addr 172.21.15.123:0/4080164863 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:04.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.243+0000 7f7facd1c640 1 -- 172.21.15.123:0/4080164863 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f90003ff0 msgr2=0x7f7fa813d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:04.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.243+0000 7f7facd1c640 1 --2- 172.21.15.123:0/4080164863 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f90003ff0 0x7f7fa813d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.243+0000 7f7facd1c640 1 -- 172.21.15.123:0/4080164863 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7fa81565e0 msgr2=0x7f7fa8156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:04.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.243+0000 7f7facd1c640 1 --2- 172.21.15.123:0/4080164863 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7fa81565e0 0x7f7fa8156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.243+0000 7f7facd1c640 1 -- 172.21.15.123:0/4080164863 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa815cbf0 con 0x7f7fa813ded0 2024-09-15T23:19:04.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.243+0000 7f7facd1c640 1 --2- 172.21.15.123:0/4080164863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fa813ded0 0x7f7fa81560a0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00c330 tx=0x7f7fa8073ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:04.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.243+0000 7f7fa5ffb640 1 -- 172.21.15.123:0/4080164863 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c037040 con 0x7f7fa813ded0 2024-09-15T23:19:04.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.243+0000 7f7fa5ffb640 1 -- 172.21.15.123:0/4080164863 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f9c041070 con 0x7f7fa813ded0 2024-09-15T23:19:04.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.243+0000 7f7fa5ffb640 1 -- 172.21.15.123:0/4080164863 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c001630 con 0x7f7fa813ded0 2024-09-15T23:19:04.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.243+0000 7f7faf781640 1 -- 172.21.15.123:0/4080164863 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fa815ced0 con 0x7f7fa813ded0 2024-09-15T23:19:04.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.243+0000 7f7faf781640 1 -- 172.21.15.123:0/4080164863 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fa813e350 con 0x7f7fa813ded0 2024-09-15T23:19:04.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.244+0000 7f7fa5ffb640 1 -- 172.21.15.123:0/4080164863 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7f9c007070 con 0x7f7fa813ded0 2024-09-15T23:19:04.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.245+0000 7f7fa5ffb640 1 --2- 172.21.15.123:0/4080164863 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7f9406c2e0 0x7f7f9406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:04.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.245+0000 7f7fa5ffb640 1 -- 172.21.15.123:0/4080164863 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f7f9c0aadb0 con 0x7f7fa813ded0 2024-09-15T23:19:04.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.245+0000 7f7fad51d640 1 --2- 172.21.15.123:0/4080164863 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7f9406c2e0 0x7f7f9406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:04.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.246+0000 7f7fad51d640 1 --2- 172.21.15.123:0/4080164863 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7f9406c2e0 0x7f7f9406e7a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7f98007bd0 tx=0x7f7f98007b60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:04.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.246+0000 7f7fb25f4740 1 Processor -- start 2024-09-15T23:19:04.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.246+0000 7f7fb25f4740 1 -- start start 2024-09-15T23:19:04.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.247+0000 7f7fb25f4740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55eb5d8352c0 0x55eb5d87aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:04.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.247+0000 7f7fb25f4740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55eb5d832a80 0x55eb5d8356a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:04.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.247+0000 7f7fb25f4740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55eb5d836a50 0x55eb5d82f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:04.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.247+0000 7f7fb25f4740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55eb5d797520 con 0x55eb5d8352c0 2024-09-15T23:19:04.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.247+0000 7f7fb25f4740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55eb5d73f3e0 con 0x55eb5d832a80 2024-09-15T23:19:04.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.247+0000 7f7fb25f4740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55eb5d7934e0 con 0x55eb5d836a50 2024-09-15T23:19:04.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.247+0000 7f7fad51d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55eb5d8352c0 0x55eb5d87aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:04.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.247+0000 7f7fad51d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55eb5d8352c0 0x55eb5d87aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38790/0 (socket says 172.21.15.123:38790) 2024-09-15T23:19:04.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.247+0000 7f7fad51d640 1 -- 172.21.15.123:0/480144566 learned_addr learned my addr 172.21.15.123:0/480144566 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:04.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.247+0000 7f7facd1c640 1 --2- 172.21.15.123:0/480144566 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55eb5d832a80 0x55eb5d8356a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:04.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.247+0000 7f7fadd1e640 1 --2- 172.21.15.123:0/480144566 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55eb5d836a50 0x55eb5d82f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:04.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.247+0000 7f7fad51d640 1 -- 172.21.15.123:0/480144566 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55eb5d836a50 msgr2=0x55eb5d82f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:04.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.247+0000 7f7fad51d640 1 --2- 172.21.15.123:0/480144566 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55eb5d836a50 0x55eb5d82f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.247+0000 7f7fad51d640 1 -- 172.21.15.123:0/480144566 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55eb5d832a80 msgr2=0x55eb5d8356a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:04.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.247+0000 7f7fad51d640 1 --2- 172.21.15.123:0/480144566 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55eb5d832a80 0x55eb5d8356a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.247+0000 7f7fad51d640 1 -- 172.21.15.123:0/480144566 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb5d75a2f0 con 0x55eb5d8352c0 2024-09-15T23:19:04.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.247+0000 7f7fad51d640 1 --2- 172.21.15.123:0/480144566 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55eb5d8352c0 0x55eb5d87aa60 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f7f9800fe20 tx=0x7f7f98012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a453bb6859202da server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:04.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.247+0000 7f7f8effd640 1 -- 172.21.15.123:0/480144566 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9801b050 con 0x55eb5d8352c0 2024-09-15T23:19:04.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.248+0000 7f7f8effd640 1 -- 172.21.15.123:0/480144566 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f98025070 con 0x55eb5d8352c0 2024-09-15T23:19:04.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.248+0000 7f7f8effd640 1 -- 172.21.15.123:0/480144566 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f98020640 con 0x55eb5d8352c0 2024-09-15T23:19:04.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.248+0000 7f7fb25f4740 1 -- 172.21.15.123:0/480144566 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55eb5d8352c0 msgr2=0x55eb5d87aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:04.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.248+0000 7f7fb25f4740 1 --2- 172.21.15.123:0/480144566 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55eb5d8352c0 0x55eb5d87aa60 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f7f9800fe20 tx=0x7f7f98012000 comp rx=0 tx=0).stop 2024-09-15T23:19:04.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.248+0000 7f7fb25f4740 1 -- 172.21.15.123:0/480144566 shutdown_connections 2024-09-15T23:19:04.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.248+0000 7f7fb25f4740 1 --2- 172.21.15.123:0/480144566 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55eb5d836a50 0x55eb5d82f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.248+0000 7f7fb25f4740 1 --2- 172.21.15.123:0/480144566 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55eb5d832a80 0x55eb5d8356a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.248+0000 7f7fb25f4740 1 --2- 172.21.15.123:0/480144566 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55eb5d8352c0 0x55eb5d87aa60 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.248+0000 7f7fb25f4740 1 -- 172.21.15.123:0/480144566 >> 172.21.15.123:0/480144566 conn(0x55eb5d831a80 msgr2=0x55eb5d879f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:04.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.248+0000 7f7fb25f4740 1 -- 172.21.15.123:0/480144566 shutdown_connections 2024-09-15T23:19:04.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.248+0000 7f7fb25f4740 1 -- 172.21.15.123:0/480144566 wait complete. 2024-09-15T23:19:04.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.249+0000 7f7fb25f4740 1 -- start start 2024-09-15T23:19:04.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.249+0000 7f7fb25f4740 1 Processor -- start 2024-09-15T23:19:04.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.250+0000 7f7fb25f4740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55eb5d8352c0 0x55eb5d875980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:04.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.250+0000 7f7fb25f4740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55eb5d836a50 0x55eb5d875ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:04.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.250+0000 7f7fb25f4740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55eb5d85a4b0 0x55eb5d876400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:04.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.250+0000 7f7fb25f4740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55eb5d830f20 con 0x55eb5d836a50 2024-09-15T23:19:04.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.250+0000 7f7fb25f4740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55eb5d720450 con 0x55eb5d85a4b0 2024-09-15T23:19:04.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.250+0000 7f7fb25f4740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55eb5d87b290 con 0x55eb5d8352c0 2024-09-15T23:19:04.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.250+0000 7f7fb25f4740 10 client.0 _ll_register_callbacks cb 0x55eb5d4a9ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:19:04.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.250+0000 7f7facd1c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55eb5d836a50 0x55eb5d875ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:04.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.250+0000 7f7facd1c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55eb5d836a50 0x55eb5d875ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38804/0 (socket says 172.21.15.123:38804) 2024-09-15T23:19:04.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.250+0000 7f7facd1c640 1 -- 172.21.15.123:0/4255053645 learned_addr learned my addr 172.21.15.123:0/4255053645 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:04.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.250+0000 7f7fad51d640 1 --2- 172.21.15.123:0/4255053645 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55eb5d8352c0 0x55eb5d875980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:04.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.250+0000 7f7fadd1e640 1 --2- 172.21.15.123:0/4255053645 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55eb5d85a4b0 0x55eb5d876400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:04.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.250+0000 7f7facd1c640 1 -- 172.21.15.123:0/4255053645 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55eb5d8352c0 msgr2=0x55eb5d875980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:04.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.250+0000 7f7facd1c640 1 --2- 172.21.15.123:0/4255053645 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55eb5d8352c0 0x55eb5d875980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.250+0000 7f7facd1c640 1 -- 172.21.15.123:0/4255053645 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55eb5d85a4b0 msgr2=0x55eb5d876400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:04.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.250+0000 7f7facd1c640 1 --2- 172.21.15.123:0/4255053645 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55eb5d85a4b0 0x55eb5d876400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.250+0000 7f7facd1c640 1 -- 172.21.15.123:0/4255053645 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb5d4aa2d0 con 0x55eb5d836a50 2024-09-15T23:19:04.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.250+0000 7f7facd1c640 1 --2- 172.21.15.123:0/4255053645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55eb5d836a50 0x55eb5d875ec0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c078e40 tx=0x7f7f9c0788d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a9b6d879a105a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:04.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.250+0000 7f7f83fff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:19:04.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.250+0000 7f7f83fff640 1 -- 172.21.15.123:0/4255053645 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c07d260 con 0x55eb5d836a50 2024-09-15T23:19:04.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.250+0000 7f7f83fff640 1 -- 172.21.15.123:0/4255053645 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f7f9c075520 con 0x55eb5d836a50 2024-09-15T23:19:04.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.250+0000 7f7fb25f4740 1 -- 172.21.15.123:0/4255053645 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f98025070 con 0x55eb5d836a50 2024-09-15T23:19:04.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.250+0000 7f7f83fff640 1 -- 172.21.15.123:0/4255053645 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f7f9c081a90 con 0x55eb5d836a50 2024-09-15T23:19:04.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.251+0000 7f7fb25f4740 10 client.8184 fetch_fsmap learned FSMap version 80 2024-09-15T23:19:04.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.251+0000 7f7fb25f4740 1 -- 172.21.15.123:0/4255053645 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=2+}) -- 0x55eb5d5746b0 con 0x55eb5d836a50 2024-09-15T23:19:04.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.251+0000 7f7f83fff640 1 -- 172.21.15.123:0/4255053645 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f98025070 con 0x55eb5d836a50 2024-09-15T23:19:04.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.251+0000 7f7f83fff640 1 -- 172.21.15.123:0/4255053645 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 80) ==== 3502+0+0 (secure 0 0 0) 0x7f7f9c03b370 con 0x55eb5d836a50 2024-09-15T23:19:04.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.251+0000 7f7fb25f4740 10 client.8184 fetch_fsmap finished waiting for FSMap version 80 2024-09-15T23:19:04.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.251+0000 7f7fb25f4740 10 client.8184 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-15T23:19:04.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.251+0000 7f7fb25f4740 20 client.8184 populate_metadata read hostname 'smithi123' 2024-09-15T23:19:04.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.251+0000 7f7fb25f4740 1 --2- 172.21.15.123:0/4255053645 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x55eb5d895640 0x55eb5d897a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:04.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.251+0000 7f7fb25f4740 4 client.8184 mds_command: new command op to 8034 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:19:04.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.251+0000 7f7fb25f4740 1 -- 172.21.15.123:0/4255053645 --> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb5d7a4c50 con 0x55eb5d895640 2024-09-15T23:19:04.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.251+0000 7f7fad51d640 1 --2- 172.21.15.123:0/4255053645 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x55eb5d895640 0x55eb5d897a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:04.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.252+0000 7f7f83fff640 10 client.8184 ms_handle_connect on v2:172.21.15.188:6835/3551744094 2024-09-15T23:19:04.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.252+0000 7f7fad51d640 1 --2- 172.21.15.123:0/4255053645 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x55eb5d895640 0x55eb5d897a30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eafb0a2662c665cc server_cookie=78e90db2b5625303 in_seq=0 out_seq=0 2024-09-15T23:19:04.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.252+0000 7f7f83fff640 1 -- 172.21.15.123:0/4255053645 <== mds.0 v2:172.21.15.188:6835/3551744094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eb5d7a4c50 con 0x55eb5d895640 2024-09-15T23:19:04.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.252+0000 7f7f83fff640 10 client.8184 handle_command_reply: tid=0 2024-09-15T23:19:04.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.252+0000 7f7fb25f4740 1 client.8184 shutdown 2024-09-15T23:19:04.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.252+0000 7f7fb25f4740 1 -- 172.21.15.123:0/4255053645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55eb5d836a50 msgr2=0x55eb5d875ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:04.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.252+0000 7f7fb25f4740 1 --2- 172.21.15.123:0/4255053645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55eb5d836a50 0x55eb5d875ec0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c078e40 tx=0x7f7f9c0788d0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.252+0000 7f7fb25f4740 1 -- 172.21.15.123:0/4255053645 shutdown_connections 2024-09-15T23:19:04.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.253+0000 7f7fb25f4740 1 --2- 172.21.15.123:0/4255053645 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x55eb5d895640 0x55eb5d897a30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.253+0000 7f7fb25f4740 1 --2- 172.21.15.123:0/4255053645 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55eb5d85a4b0 0x55eb5d876400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.253+0000 7f7fb25f4740 1 --2- 172.21.15.123:0/4255053645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55eb5d836a50 0x55eb5d875ec0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.253+0000 7f7f83fff640 0 client.8184 ms_handle_reset on v2:172.21.15.188:6835/3551744094 2024-09-15T23:19:04.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.253+0000 7f7fb25f4740 1 --2- 172.21.15.123:0/4255053645 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55eb5d8352c0 0x55eb5d875980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.253+0000 7f7fb25f4740 1 -- 172.21.15.123:0/4255053645 >> 172.21.15.123:0/4255053645 conn(0x55eb5d832a80 msgr2=0x55eb5d877ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:04.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.253+0000 7f7fb25f4740 1 -- 172.21.15.123:0/4255053645 shutdown_connections 2024-09-15T23:19:04.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.253+0000 7f7fb25f4740 1 -- 172.21.15.123:0/4255053645 wait complete. 2024-09-15T23:19:04.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.253+0000 7f7fb25f4740 20 client.8184 trim_cache size 0 max 16384 2024-09-15T23:19:04.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.270+0000 7f7fb25f4740 1 Processor -- start 2024-09-15T23:19:04.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.270+0000 7f7fb25f4740 1 -- start start 2024-09-15T23:19:04.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.271+0000 7f7fb25f4740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55eb5d8352c0 0x55eb5d85e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:04.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.271+0000 7f7fb25f4740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55eb5d836a50 0x55eb5d878d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:04.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.271+0000 7f7fb25f4740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55eb5d85a4b0 0x55eb5d8746c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:04.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.271+0000 7f7fb25f4740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa81fc0b0 con 0x55eb5d836a50 2024-09-15T23:19:04.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.271+0000 7f7fb25f4740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa815e980 con 0x55eb5d8352c0 2024-09-15T23:19:04.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.271+0000 7f7fb25f4740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7fa81fbac0 con 0x55eb5d85a4b0 2024-09-15T23:19:04.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.271+0000 7f7facd1c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55eb5d836a50 0x55eb5d878d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:04.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.271+0000 7f7facd1c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55eb5d836a50 0x55eb5d878d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38818/0 (socket says 172.21.15.123:38818) 2024-09-15T23:19:04.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.271+0000 7f7facd1c640 1 -- 172.21.15.123:0/2261935301 learned_addr learned my addr 172.21.15.123:0/2261935301 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:04.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.271+0000 7f7facd1c640 1 -- 172.21.15.123:0/2261935301 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55eb5d85a4b0 msgr2=0x55eb5d8746c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:04.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.271+0000 7f7facd1c640 1 --2- 172.21.15.123:0/2261935301 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55eb5d85a4b0 0x55eb5d8746c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.271+0000 7f7facd1c640 1 -- 172.21.15.123:0/2261935301 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55eb5d8352c0 msgr2=0x55eb5d85e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:04.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.271+0000 7f7facd1c640 1 --2- 172.21.15.123:0/2261935301 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55eb5d8352c0 0x55eb5d85e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.271+0000 7f7facd1c640 1 -- 172.21.15.123:0/2261935301 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb5d835d90 con 0x55eb5d836a50 2024-09-15T23:19:04.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.271+0000 7f7facd1c640 1 --2- 172.21.15.123:0/2261935301 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55eb5d836a50 0x55eb5d878d80 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c02add0 tx=0x7f7f9c0a4000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e47648ac1164c233 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:04.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.272+0000 7f7f8e7fc640 1 -- 172.21.15.123:0/2261935301 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c086070 con 0x55eb5d836a50 2024-09-15T23:19:04.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.272+0000 7f7f8e7fc640 1 -- 172.21.15.123:0/2261935301 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f9c0a6070 con 0x55eb5d836a50 2024-09-15T23:19:04.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.272+0000 7f7f8e7fc640 1 -- 172.21.15.123:0/2261935301 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c07d260 con 0x55eb5d836a50 2024-09-15T23:19:04.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.272+0000 7f7fb25f4740 1 -- 172.21.15.123:0/2261935301 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55eb5d836a50 msgr2=0x55eb5d878d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:04.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.272+0000 7f7fb25f4740 1 --2- 172.21.15.123:0/2261935301 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55eb5d836a50 0x55eb5d878d80 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c02add0 tx=0x7f7f9c0a4000 comp rx=0 tx=0).stop 2024-09-15T23:19:04.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.272+0000 7f7fb25f4740 1 -- 172.21.15.123:0/2261935301 shutdown_connections 2024-09-15T23:19:04.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.272+0000 7f7fb25f4740 1 --2- 172.21.15.123:0/2261935301 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55eb5d85a4b0 0x55eb5d8746c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.272+0000 7f7fb25f4740 1 --2- 172.21.15.123:0/2261935301 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55eb5d836a50 0x55eb5d878d80 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.272+0000 7f7fb25f4740 1 --2- 172.21.15.123:0/2261935301 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55eb5d8352c0 0x55eb5d85e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.272+0000 7f7fb25f4740 1 -- 172.21.15.123:0/2261935301 >> 172.21.15.123:0/2261935301 conn(0x55eb5d832a80 msgr2=0x55eb5d85df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:04.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.272+0000 7f7fb25f4740 1 -- 172.21.15.123:0/2261935301 shutdown_connections 2024-09-15T23:19:04.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.272+0000 7f7fb25f4740 1 -- 172.21.15.123:0/2261935301 wait complete. 2024-09-15T23:19:04.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.273+0000 7f7fb25f4740 1 -- start start 2024-09-15T23:19:04.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.273+0000 7f7fb25f4740 1 Processor -- start 2024-09-15T23:19:04.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.274+0000 7f7fb25f4740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55eb5d8352c0 0x55eb5d8f1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:04.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.274+0000 7f7fb25f4740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55eb5d836a50 0x55eb5d85abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:04.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.274+0000 7f7fb25f4740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55eb5d85a4b0 0x55eb5d85b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:04.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.274+0000 7f7fb25f4740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55eb5d876a50 con 0x55eb5d85a4b0 2024-09-15T23:19:04.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.274+0000 7f7fb25f4740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55eb5d830f20 con 0x55eb5d8352c0 2024-09-15T23:19:04.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.274+0000 7f7fb25f4740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55eb5d85f250 con 0x55eb5d836a50 2024-09-15T23:19:04.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.274+0000 7f7fb25f4740 10 client.0 _ll_register_callbacks cb 0x7f7f9c0789f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:19:04.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.274+0000 7f7fadd1e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55eb5d85a4b0 0x55eb5d85b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:04.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.274+0000 7f7fadd1e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55eb5d85a4b0 0x55eb5d85b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38820/0 (socket says 172.21.15.123:38820) 2024-09-15T23:19:04.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.274+0000 7f7fadd1e640 1 -- 172.21.15.123:0/1303924603 learned_addr learned my addr 172.21.15.123:0/1303924603 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:04.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.274+0000 7f7facd1c640 1 --2- 172.21.15.123:0/1303924603 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55eb5d836a50 0x55eb5d85abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:04.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.274+0000 7f7fad51d640 1 --2- 172.21.15.123:0/1303924603 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55eb5d8352c0 0x55eb5d8f1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:04.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.274+0000 7f7fadd1e640 1 -- 172.21.15.123:0/1303924603 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55eb5d836a50 msgr2=0x55eb5d85abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:04.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.274+0000 7f7fadd1e640 1 --2- 172.21.15.123:0/1303924603 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55eb5d836a50 0x55eb5d85abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.274+0000 7f7fadd1e640 1 -- 172.21.15.123:0/1303924603 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55eb5d8352c0 msgr2=0x55eb5d8f1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:04.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.274+0000 7f7fadd1e640 1 --2- 172.21.15.123:0/1303924603 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55eb5d8352c0 0x55eb5d8f1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.274+0000 7f7fadd1e640 1 -- 172.21.15.123:0/1303924603 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb5d858cb0 con 0x55eb5d85a4b0 2024-09-15T23:19:04.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.274+0000 7f7fad51d640 1 --2- 172.21.15.123:0/1303924603 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55eb5d8352c0 0x55eb5d8f1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:19:04.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.274+0000 7f7facd1c640 1 --2- 172.21.15.123:0/1303924603 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55eb5d836a50 0x55eb5d85abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:19:04.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.274+0000 7f7fadd1e640 1 --2- 172.21.15.123:0/1303924603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55eb5d85a4b0 0x55eb5d85b110 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f7fa80b3520 tx=0x7f7fa000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44e0a3945ca55207 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:04.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.274+0000 7f7f83fff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:19:04.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.274+0000 7f7f83fff640 1 -- 172.21.15.123:0/1303924603 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0015630 con 0x55eb5d85a4b0 2024-09-15T23:19:04.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.274+0000 7f7f83fff640 1 -- 172.21.15.123:0/1303924603 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f7fa00157d0 con 0x55eb5d85a4b0 2024-09-15T23:19:04.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.274+0000 7f7fb25f4740 1 -- 172.21.15.123:0/1303924603 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f9c0a6070 con 0x55eb5d85a4b0 2024-09-15T23:19:04.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.275+0000 7f7f83fff640 1 -- 172.21.15.123:0/1303924603 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f7fa0027050 con 0x55eb5d85a4b0 2024-09-15T23:19:04.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.275+0000 7f7fb25f4740 10 client.8190 fetch_fsmap learned FSMap version 80 2024-09-15T23:19:04.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.275+0000 7f7fb25f4740 1 -- 172.21.15.123:0/1303924603 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=2+}) -- 0x55eb5d8780d0 con 0x55eb5d85a4b0 2024-09-15T23:19:04.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.275+0000 7f7f83fff640 1 -- 172.21.15.123:0/1303924603 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f9c0a6070 con 0x55eb5d85a4b0 2024-09-15T23:19:04.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.275+0000 7f7f83fff640 1 -- 172.21.15.123:0/1303924603 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 80) ==== 3502+0+0 (secure 0 0 0) 0x7f7fa002a020 con 0x55eb5d85a4b0 2024-09-15T23:19:04.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.275+0000 7f7fb25f4740 10 client.8190 fetch_fsmap finished waiting for FSMap version 80 2024-09-15T23:19:04.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.275+0000 7f7fb25f4740 10 client.8190 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-15T23:19:04.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.275+0000 7f7fb25f4740 20 client.8190 populate_metadata read hostname 'smithi123' 2024-09-15T23:19:04.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.275+0000 7f7fb25f4740 1 --2- 172.21.15.123:0/1303924603 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x55eb5d8f8520 0x55eb5d8575c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:04.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.275+0000 7f7fb25f4740 4 client.8190 mds_command: new command op to 8034 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:19:04.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.275+0000 7f7fb25f4740 1 -- 172.21.15.123:0/1303924603 --> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] -- command(tid 0: {"prefix": "status"}) -- 0x55eb5d79efa0 con 0x55eb5d8f8520 2024-09-15T23:19:04.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.275+0000 7f7fad51d640 1 --2- 172.21.15.123:0/1303924603 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x55eb5d8f8520 0x55eb5d8575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:04.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.275+0000 7f7f83fff640 10 client.8190 ms_handle_connect on v2:172.21.15.188:6835/3551744094 2024-09-15T23:19:04.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.275+0000 7f7fad51d640 1 --2- 172.21.15.123:0/1303924603 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x55eb5d8f8520 0x55eb5d8575c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e75d40b49914d122 server_cookie=154dfa828fbb88ba in_seq=0 out_seq=0 2024-09-15T23:19:04.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.276+0000 7f7f83fff640 1 -- 172.21.15.123:0/1303924603 <== mds.0 v2:172.21.15.188:6835/3551744094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55eb5d79efa0 con 0x55eb5d8f8520 2024-09-15T23:19:04.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.276+0000 7f7f83fff640 10 client.8190 handle_command_reply: tid=0 2024-09-15T23:19:04.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.276+0000 7f7fb25f4740 1 client.8190 shutdown 2024-09-15T23:19:04.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.276+0000 7f7fb25f4740 1 -- 172.21.15.123:0/1303924603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55eb5d85a4b0 msgr2=0x55eb5d85b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:04.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.276+0000 7f7fb25f4740 1 --2- 172.21.15.123:0/1303924603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55eb5d85a4b0 0x55eb5d85b110 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f7fa80b3520 tx=0x7f7fa000b870 comp rx=0 tx=0).stop 2024-09-15T23:19:04.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.276+0000 7f7fb25f4740 1 -- 172.21.15.123:0/1303924603 shutdown_connections 2024-09-15T23:19:04.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.276+0000 7f7fb25f4740 1 --2- 172.21.15.123:0/1303924603 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x55eb5d8f8520 0x55eb5d8575c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.276+0000 7f7fb25f4740 1 --2- 172.21.15.123:0/1303924603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55eb5d85a4b0 0x55eb5d85b110 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.276+0000 7f7fb25f4740 1 --2- 172.21.15.123:0/1303924603 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55eb5d836a50 0x55eb5d85abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.276+0000 7f7fb25f4740 1 --2- 172.21.15.123:0/1303924603 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55eb5d8352c0 0x55eb5d8f1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.276+0000 7f7fb25f4740 1 -- 172.21.15.123:0/1303924603 >> 172.21.15.123:0/1303924603 conn(0x55eb5d832a80 msgr2=0x55eb5d8746c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:04.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.276+0000 7f7f83fff640 0 client.8190 ms_handle_reset on v2:172.21.15.188:6835/3551744094 2024-09-15T23:19:04.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.276+0000 7f7fb25f4740 1 -- 172.21.15.123:0/1303924603 shutdown_connections 2024-09-15T23:19:04.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.276+0000 7f7fb25f4740 1 -- 172.21.15.123:0/1303924603 wait complete. 2024-09-15T23:19:04.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.276+0000 7f7fb25f4740 20 client.8190 trim_cache size 0 max 16384 2024-09-15T23:19:04.285 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:19:04.286 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "cb968ac4-8d3a-4b17-a673-6177aeaea589", 2024-09-15T23:19:04.286 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2024-09-15T23:19:04.286 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 8034, 2024-09-15T23:19:04.286 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-09-15T23:19:04.286 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-09-15T23:19:04.286 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-09-15T23:19:04.286 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 8.886605758, 2024-09-15T23:19:04.286 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 80, 2024-09-15T23:19:04.286 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 130, 2024-09-15T23:19:04.286 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 130, 2024-09-15T23:19:04.286 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 12.932803573999999 2024-09-15T23:19:04.287 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:19:04.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.277+0000 7f7faf781640 1 -- 172.21.15.123:0/4080164863 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7f9406c2e0 msgr2=0x7f7f9406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:04.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.277+0000 7f7faf781640 1 --2- 172.21.15.123:0/4080164863 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7f9406c2e0 0x7f7f9406e7a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7f98007bd0 tx=0x7f7f98007b60 comp rx=0 tx=0).stop 2024-09-15T23:19:04.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.277+0000 7f7faf781640 1 -- 172.21.15.123:0/4080164863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fa813ded0 msgr2=0x7f7fa81560a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:04.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.277+0000 7f7faf781640 1 --2- 172.21.15.123:0/4080164863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fa813ded0 0x7f7fa81560a0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00c330 tx=0x7f7fa8073ee0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.277+0000 7f7faf781640 1 -- 172.21.15.123:0/4080164863 shutdown_connections 2024-09-15T23:19:04.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.277+0000 7f7faf781640 1 --2- 172.21.15.123:0/4080164863 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7fa81565e0 0x7f7fa8156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.277+0000 7f7faf781640 1 --2- 172.21.15.123:0/4080164863 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7f9406c2e0 0x7f7f9406e7a0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.277+0000 7f7faf781640 1 --2- 172.21.15.123:0/4080164863 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fa813ded0 0x7f7fa81560a0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.277+0000 7f7faf781640 1 --2- 172.21.15.123:0/4080164863 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f90003ff0 0x7f7fa813d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.277+0000 7f7faf781640 1 -- 172.21.15.123:0/4080164863 >> 172.21.15.123:0/4080164863 conn(0x7f7fa80ccec0 msgr2=0x7f7fa80d01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:04.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.277+0000 7f7faf781640 1 -- 172.21.15.123:0/4080164863 shutdown_connections 2024-09-15T23:19:04.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.277+0000 7f7faf781640 1 -- 172.21.15.123:0/4080164863 wait complete. 2024-09-15T23:19:04.289 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:19:04.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.387+0000 7ff637b66640 1 Processor -- start 2024-09-15T23:19:04.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.387+0000 7ff637b66640 1 -- start start 2024-09-15T23:19:04.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.388+0000 7ff637b66640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff63015ab40 0x7ff63006c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:04.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.388+0000 7ff637b66640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff6300720b0 0x7ff630073990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:04.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.388+0000 7ff637b66640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff630072520 con 0x7ff63015af20 2024-09-15T23:19:04.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.388+0000 7ff637b66640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7ff630071010 con 0x7ff63015ab40 2024-09-15T23:19:04.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.388+0000 7ff637b66640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ff6300712f0 con 0x7ff6300720b0 2024-09-15T23:19:04.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.388+0000 7ff636103640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff63015af20 0x7ff63015b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:35232/0 (socket says 172.21.15.123:35232) 2024-09-15T23:19:04.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.388+0000 7ff636103640 1 -- 172.21.15.123:0/1841358465 learned_addr learned my addr 172.21.15.123:0/1841358465 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:19:04.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.388+0000 7ff634900640 1 -- 172.21.15.123:0/1841358465 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1858428347 0 0) 0x7ff630072520 con 0x7ff63015af20 2024-09-15T23:19:04.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.388+0000 7ff635902640 1 --2- 172.21.15.123:0/1841358465 >> v2:172.21.15.188:3300/0 conn(0x7ff63015ab40 0x7ff63006c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:04.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.388+0000 7ff634900640 1 -- 172.21.15.123:0/1841358465 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff61c003520 con 0x7ff63015af20 2024-09-15T23:19:04.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.388+0000 7ff635101640 1 --2- 172.21.15.123:0/1841358465 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff6300720b0 0x7ff630073990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:04.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.388+0000 7ff634900640 1 -- 172.21.15.123:0/1841358465 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3025320026 0 0) 0x7ff61c003520 con 0x7ff63015af20 2024-09-15T23:19:04.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.388+0000 7ff634900640 1 -- 172.21.15.123:0/1841358465 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff6300720b0 msgr2=0x7ff630073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:04.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.388+0000 7ff634900640 1 --2- 172.21.15.123:0/1841358465 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff6300720b0 0x7ff630073990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.388+0000 7ff634900640 1 -- 172.21.15.123:0/1841358465 >> v2:172.21.15.188:3300/0 conn(0x7ff63015ab40 msgr2=0x7ff63006c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:04.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.388+0000 7ff634900640 1 --2- 172.21.15.123:0/1841358465 >> v2:172.21.15.188:3300/0 conn(0x7ff63015ab40 0x7ff63006c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.388+0000 7ff634900640 1 -- 172.21.15.123:0/1841358465 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6300715d0 con 0x7ff63015af20 2024-09-15T23:19:04.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.388+0000 7ff634900640 1 -- 172.21.15.123:0/1841358465 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7ff6280019f0 con 0x7ff63015af20 2024-09-15T23:19:04.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.388+0000 7ff634900640 1 -- 172.21.15.123:0/1841358465 >> v1:172.21.15.123:6789/0 conn(0x7ff63015af20 legacy=0x7ff63015b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:04.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.388+0000 7ff634900640 1 --2- 172.21.15.123:0/1841358465 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff6300720b0 0x7ff61c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:04.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.388+0000 7ff634900640 1 --2- 172.21.15.123:0/1841358465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff61c003f30 0x7ff61c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:04.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.388+0000 7ff634900640 1 --2- 172.21.15.123:0/1841358465 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff61c004d40 0x7ff61c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:04.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.388+0000 7ff634900640 1 -- 172.21.15.123:0/1841358465 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff630071010 con 0x7ff61c003f30 2024-09-15T23:19:04.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.388+0000 7ff634900640 1 -- 172.21.15.123:0/1841358465 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff6300712f0 con 0x7ff61c004d40 2024-09-15T23:19:04.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.388+0000 7ff634900640 1 -- 172.21.15.123:0/1841358465 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ff61c00ba10 con 0x7ff6300720b0 2024-09-15T23:19:04.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.389+0000 7ff635101640 1 --2- 172.21.15.123:0/1841358465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff61c003f30 0x7ff61c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:04.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.389+0000 7ff635902640 1 --2- 172.21.15.123:0/1841358465 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff6300720b0 0x7ff61c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:04.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.389+0000 7ff636103640 1 --2- 172.21.15.123:0/1841358465 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff61c004d40 0x7ff61c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:04.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.389+0000 7ff635101640 1 -- 172.21.15.123:0/1841358465 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff6300720b0 msgr2=0x7ff61c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:04.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.389+0000 7ff635101640 1 --2- 172.21.15.123:0/1841358465 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff6300720b0 0x7ff61c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.389+0000 7ff635101640 1 -- 172.21.15.123:0/1841358465 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff61c004d40 msgr2=0x7ff61c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:04.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.389+0000 7ff635101640 1 --2- 172.21.15.123:0/1841358465 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff61c004d40 0x7ff61c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.389+0000 7ff635101640 1 -- 172.21.15.123:0/1841358465 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff61c003520 con 0x7ff61c003f30 2024-09-15T23:19:04.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.389+0000 7ff636103640 1 --2- 172.21.15.123:0/1841358465 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff61c004d40 0x7ff61c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:19:04.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.390+0000 7ff635101640 1 --2- 172.21.15.123:0/1841358465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff61c003f30 0x7ff61c004800 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7ff620009af0 tx=0x7ff61c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cae7c3d9404c80 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:04.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.390+0000 7ff634900640 1 -- 172.21.15.123:0/1841358465 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff620036070 con 0x7ff61c003f30 2024-09-15T23:19:04.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.390+0000 7ff634900640 1 -- 172.21.15.123:0/1841358465 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff620031400 con 0x7ff61c003f30 2024-09-15T23:19:04.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.390+0000 7ff634900640 1 -- 172.21.15.123:0/1841358465 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff620009690 con 0x7ff61c003f30 2024-09-15T23:19:04.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.390+0000 7ff637b66640 1 -- 172.21.15.123:0/1841358465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff61c003f30 msgr2=0x7ff61c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:04.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.390+0000 7ff637b66640 1 --2- 172.21.15.123:0/1841358465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff61c003f30 0x7ff61c004800 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7ff620009af0 tx=0x7ff61c005830 comp rx=0 tx=0).stop 2024-09-15T23:19:04.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.390+0000 7ff636103640 1 -- 172.21.15.123:0/1841358465 reap_dead start 2024-09-15T23:19:04.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.390+0000 7ff637b66640 1 -- 172.21.15.123:0/1841358465 shutdown_connections 2024-09-15T23:19:04.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.390+0000 7ff637b66640 1 -- 172.21.15.123:0/1841358465 >> 172.21.15.123:0/1841358465 conn(0x7ff6300ccec0 msgr2=0x7ff6300cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:04.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.390+0000 7ff637b66640 1 -- 172.21.15.123:0/1841358465 shutdown_connections 2024-09-15T23:19:04.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.390+0000 7ff637b66640 1 -- 172.21.15.123:0/1841358465 wait complete. 2024-09-15T23:19:04.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.391+0000 7ff637b66640 1 Processor -- start 2024-09-15T23:19:04.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.392+0000 7ff637b66640 1 -- start start 2024-09-15T23:19:04.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.392+0000 7ff637b66640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff61c003f30 0x7ff630149a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:04.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.392+0000 7ff637b66640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff63014b400 0x7ff6301688c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:04.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.392+0000 7ff637b66640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff630167900 0x7ff630158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:04.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.392+0000 7ff637b66640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff630073990 con 0x7ff61c003f30 2024-09-15T23:19:04.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.392+0000 7ff637b66640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff63015baa0 con 0x7ff630167900 2024-09-15T23:19:04.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.392+0000 7ff637b66640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ff630073b10 con 0x7ff63014b400 2024-09-15T23:19:04.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.392+0000 7ff635902640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff61c003f30 0x7ff630149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:04.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.392+0000 7ff635902640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff61c003f30 0x7ff630149a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38840/0 (socket says 172.21.15.123:38840) 2024-09-15T23:19:04.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.392+0000 7ff635902640 1 -- 172.21.15.123:0/1431992769 learned_addr learned my addr 172.21.15.123:0/1431992769 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:04.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.393+0000 7ff635902640 1 -- 172.21.15.123:0/1431992769 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff63014b400 msgr2=0x7ff6301688c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:04.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.393+0000 7ff636103640 1 --2- 172.21.15.123:0/1431992769 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff630167900 0x7ff630158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:04.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.393+0000 7ff635101640 1 --2- 172.21.15.123:0/1431992769 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff63014b400 0x7ff6301688c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:04.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.393+0000 7ff635902640 1 --2- 172.21.15.123:0/1431992769 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff63014b400 0x7ff6301688c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.393+0000 7ff635902640 1 -- 172.21.15.123:0/1431992769 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff630167900 msgr2=0x7ff630158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:04.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.393+0000 7ff635902640 1 --2- 172.21.15.123:0/1431992769 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff630167900 0x7ff630158eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.393+0000 7ff635902640 1 -- 172.21.15.123:0/1431992769 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff630168e00 con 0x7ff61c003f30 2024-09-15T23:19:04.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.393+0000 7ff635101640 1 --2- 172.21.15.123:0/1431992769 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff63014b400 0x7ff6301688c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:19:04.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.393+0000 7ff636103640 1 --2- 172.21.15.123:0/1431992769 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff630167900 0x7ff630158eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:19:04.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.393+0000 7ff635902640 1 --2- 172.21.15.123:0/1431992769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff61c003f30 0x7ff630149a50 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7ff62c011aa0 tx=0x7ff62c011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:04.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.393+0000 7ff6267fc640 1 -- 172.21.15.123:0/1431992769 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff62c00fb80 con 0x7ff61c003f30 2024-09-15T23:19:04.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.393+0000 7ff6267fc640 1 -- 172.21.15.123:0/1431992769 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff62c00fd20 con 0x7ff61c003f30 2024-09-15T23:19:04.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.393+0000 7ff6267fc640 1 -- 172.21.15.123:0/1431992769 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff62c014660 con 0x7ff61c003f30 2024-09-15T23:19:04.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.393+0000 7ff637b66640 1 -- 172.21.15.123:0/1431992769 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff63014fdd0 con 0x7ff61c003f30 2024-09-15T23:19:04.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.393+0000 7ff637b66640 1 -- 172.21.15.123:0/1431992769 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff630169560 con 0x7ff61c003f30 2024-09-15T23:19:04.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.394+0000 7ff637b66640 1 -- 172.21.15.123:0/1431992769 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff630073f70 con 0x7ff61c003f30 2024-09-15T23:19:04.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.394+0000 7ff6267fc640 1 -- 172.21.15.123:0/1431992769 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff62c012040 con 0x7ff61c003f30 2024-09-15T23:19:04.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.395+0000 7ff6267fc640 1 --2- 172.21.15.123:0/1431992769 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff61406c2e0 0x7ff61406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:04.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.395+0000 7ff6267fc640 1 -- 172.21.15.123:0/1431992769 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7ff62c08bb20 con 0x7ff61c003f30 2024-09-15T23:19:04.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.395+0000 7ff635101640 1 --2- 172.21.15.123:0/1431992769 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff61406c2e0 0x7ff61406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:04.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.396+0000 7ff635101640 1 --2- 172.21.15.123:0/1431992769 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff61406c2e0 0x7ff61406e7a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ff620033000 tx=0x7ff620008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:04.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.399+0000 7ff6267fc640 1 -- 172.21.15.123:0/1431992769 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff62c019030 con 0x7ff61c003f30 2024-09-15T23:19:04.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.600+0000 7ff637b66640 1 -- 172.21.15.123:0/1431992769 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff6300b43b0 con 0x7ff61c003f30 2024-09-15T23:19:04.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.600+0000 7ff6267fc640 1 -- 172.21.15.123:0/1431992769 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v80) ==== 53+0+73 (secure 0 0 0) 0x7ff62c05a290 con 0x7ff61c003f30 2024-09-15T23:19:04.601 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:19:04.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.602+0000 7ff637b66640 1 -- 172.21.15.123:0/1431992769 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff61406c2e0 msgr2=0x7ff61406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:04.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.602+0000 7ff637b66640 1 --2- 172.21.15.123:0/1431992769 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff61406c2e0 0x7ff61406e7a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ff620033000 tx=0x7ff620008030 comp rx=0 tx=0).stop 2024-09-15T23:19:04.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.602+0000 7ff637b66640 1 -- 172.21.15.123:0/1431992769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff61c003f30 msgr2=0x7ff630149a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:04.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.602+0000 7ff637b66640 1 --2- 172.21.15.123:0/1431992769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff61c003f30 0x7ff630149a50 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7ff62c011aa0 tx=0x7ff62c011f60 comp rx=0 tx=0).stop 2024-09-15T23:19:04.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.602+0000 7ff637b66640 1 -- 172.21.15.123:0/1431992769 shutdown_connections 2024-09-15T23:19:04.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.602+0000 7ff637b66640 1 --2- 172.21.15.123:0/1431992769 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff630167900 0x7ff630158eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.602+0000 7ff637b66640 1 --2- 172.21.15.123:0/1431992769 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff63014b400 0x7ff6301688c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.602+0000 7ff637b66640 1 --2- 172.21.15.123:0/1431992769 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff61406c2e0 0x7ff61406e7a0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.602+0000 7ff637b66640 1 --2- 172.21.15.123:0/1431992769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff61c003f30 0x7ff630149a50 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:04.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.602+0000 7ff637b66640 1 -- 172.21.15.123:0/1431992769 >> 172.21.15.123:0/1431992769 conn(0x7ff6300ccec0 msgr2=0x7ff6300cbed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:04.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.602+0000 7ff637b66640 1 -- 172.21.15.123:0/1431992769 shutdown_connections 2024-09-15T23:19:04.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04.602+0000 7ff637b66640 1 -- 172.21.15.123:0/1431992769 wait complete. 2024-09-15T23:19:04.614 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T23:19:04.614 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:19:04.614 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-09-15T23:19:04.614 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T23:19:04.614 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T23:19:04.614 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T23:19:04.614 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T23:19:04.615 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:19:04.615 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:19:04.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:19:04.615 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-09-15T23:19:04.631 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:19:04.631 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:19:04.631 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:19:04.631 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:19:04.631 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-09-15T23:19:04.631 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:19:04.631 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:19:04.631 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-09-15T23:19:04.631 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f0 2024-09-15T23:19:04.631 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:19:04.631 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:19:04.631 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f1 2024-09-15T23:19:04.632 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:19:04.632 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:19:04.632 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:19:04.632 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:19:04.632 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T23:19:04.632 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42396sec preferred_lft 42396sec 2024-09-15T23:19:04.632 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link noprefixroute 2024-09-15T23:19:04.632 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:19:04.632 INFO:teuthology.orchestra.run.smithi123.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:19:04.632 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 46:55:5a:e0:32:4d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:19:04.632 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:19:04.632 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:19:04.632 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::1c6f:d5ff:fe19:ff05/64 scope link 2024-09-15T23:19:04.633 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:19:04.633 INFO:teuthology.orchestra.run.smithi123.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:19:04.633 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 46:55:5a:e0:32:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:19:04.633 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::4455:5aff:fee0:324d/64 scope link 2024-09-15T23:19:04.633 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:19:04.633 INFO:teuthology.orchestra.run.smithi123.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:19:04.633 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether be:c1:f3:63:cb:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:19:04.633 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::bcc1:f3ff:fe63:cb24/64 scope link 2024-09-15T23:19:04.633 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:19:04.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:19:04.633 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:19:04.694 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-09-15T23:19:04.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:19:04.696 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-09-15T23:19:04.752 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-09-15T23:19:04.753 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:19:04.753 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:19:04.753 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:19:04.753 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:19:04.753 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:19:04.753 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:04.753 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:19:04.753 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:19:04.753 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:19:04.754 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:04.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:19:04.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:04.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:19:04.879 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-09-15T23:19:04.893 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T23:19:04.894 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:19:04.894 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:19:04.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:19:04.894 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2024-09-15T23:19:04.959 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:19:04.959 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T23:19:05.014 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:19:05.014 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:19:05.014 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:19:05.069 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T23:19:05.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:19:05.069 DEBUG:teuthology.orchestra.run.smithi123:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:19:05.152 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:19:05.153 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:19:05.153 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:19:05.161 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:19:05.161 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:19:05.161 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:19:05.161 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.188:3300,172.21.15.188:3301" 2024-09-15T23:19:05.162 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T23:19:05.179 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:19:05.179 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:19:05.179 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:19:05.180 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.188:3300,172.21.15.188:3301" 2024-09-15T23:19:05.180 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T23:19:05.180 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:6789,172.21.15.188:6789,172.21.15.188:6790" 2024-09-15T23:19:05.180 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.123:6789,172.21.15.188:6789,172.21.15.188:6790:/ 2024-09-15T23:19:05.180 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=cb968ac4-8d3a-4b17-a673-6177aeaea589" will pass to kernel 2024-09-15T23:19:05.180 INFO:teuthology.orchestra.run.smithi123.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-15T23:19:05.180 INFO:teuthology.orchestra.run.smithi123.stdout: You just mounted a file system that supports labels which does not 2024-09-15T23:19:05.180 INFO:teuthology.orchestra.run.smithi123.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T23:19:05.181 INFO:teuthology.orchestra.run.smithi123.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T23:19:05.181 INFO:teuthology.orchestra.run.smithi123.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T23:19:05.181 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T23:19:05.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:19:05.182 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:19:05.247 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T23:19:05.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:05.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:05.348 INFO:teuthology.orchestra.run.smithi123.stdout:client7153 2024-09-15T23:19:05.348 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:19:05.348 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:19:05.364 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:05.364 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:05.364 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.0 2024-09-15T23:19:05.365 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:05.365 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:05.365 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:05.365 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:05.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:05.475 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.475 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.475 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00959221 s, 109 MB/s 2024-09-15T23:19:05.483 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.484 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.484 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727751 s, 144 MB/s 2024-09-15T23:19:05.492 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.492 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.492 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657812 s, 159 MB/s 2024-09-15T23:19:05.501 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.501 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.501 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744301 s, 141 MB/s 2024-09-15T23:19:05.511 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.511 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.511 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00825252 s, 127 MB/s 2024-09-15T23:19:05.522 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.522 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.522 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00896679 s, 117 MB/s 2024-09-15T23:19:05.531 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.531 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.531 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718202 s, 146 MB/s 2024-09-15T23:19:05.541 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.541 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.541 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0080959 s, 130 MB/s 2024-09-15T23:19:05.550 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.550 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.550 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689118 s, 152 MB/s 2024-09-15T23:19:05.559 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.559 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.559 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00807444 s, 130 MB/s 2024-09-15T23:19:05.567 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.567 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.567 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620387 s, 169 MB/s 2024-09-15T23:19:05.576 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.576 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.577 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707706 s, 148 MB/s 2024-09-15T23:19:05.584 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.585 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.585 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643873 s, 163 MB/s 2024-09-15T23:19:05.594 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.594 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.595 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00842346 s, 124 MB/s 2024-09-15T23:19:05.603 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.603 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.603 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667703 s, 157 MB/s 2024-09-15T23:19:05.612 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.612 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.612 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699896 s, 150 MB/s 2024-09-15T23:19:05.620 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.620 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.620 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607325 s, 173 MB/s 2024-09-15T23:19:05.629 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.629 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.629 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748326 s, 140 MB/s 2024-09-15T23:19:05.636 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.636 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.636 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00562838 s, 186 MB/s 2024-09-15T23:19:05.645 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.645 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.645 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686866 s, 153 MB/s 2024-09-15T23:19:05.654 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.654 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.654 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733375 s, 143 MB/s 2024-09-15T23:19:05.664 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.665 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.665 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00880901 s, 119 MB/s 2024-09-15T23:19:05.673 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.673 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.673 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646694 s, 162 MB/s 2024-09-15T23:19:05.681 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.681 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.681 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064984 s, 161 MB/s 2024-09-15T23:19:05.690 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.690 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.690 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755355 s, 139 MB/s 2024-09-15T23:19:05.699 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.699 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.699 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713419 s, 147 MB/s 2024-09-15T23:19:05.707 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.707 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.707 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582892 s, 180 MB/s 2024-09-15T23:19:05.716 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.716 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.716 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723128 s, 145 MB/s 2024-09-15T23:19:05.725 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.725 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.725 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737395 s, 142 MB/s 2024-09-15T23:19:05.734 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.734 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.734 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745058 s, 141 MB/s 2024-09-15T23:19:05.742 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.742 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.742 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640787 s, 164 MB/s 2024-09-15T23:19:05.751 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.751 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.751 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711722 s, 147 MB/s 2024-09-15T23:19:05.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:05.758 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:05.758 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:05.758 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.1 2024-09-15T23:19:05.758 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:05.758 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:05.758 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:05.758 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:05.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:05.818 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.818 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.819 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739312 s, 142 MB/s 2024-09-15T23:19:05.826 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.827 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.827 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669751 s, 157 MB/s 2024-09-15T23:19:05.834 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.834 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.834 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580221 s, 181 MB/s 2024-09-15T23:19:05.841 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.842 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.842 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585781 s, 179 MB/s 2024-09-15T23:19:05.849 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.849 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.850 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594428 s, 176 MB/s 2024-09-15T23:19:05.857 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.857 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.857 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063069 s, 166 MB/s 2024-09-15T23:19:05.866 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.866 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.866 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723347 s, 145 MB/s 2024-09-15T23:19:05.874 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.874 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.874 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063982 s, 164 MB/s 2024-09-15T23:19:05.883 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.883 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.883 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721755 s, 145 MB/s 2024-09-15T23:19:05.892 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.892 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.892 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646377 s, 162 MB/s 2024-09-15T23:19:05.901 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.901 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.901 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074736 s, 140 MB/s 2024-09-15T23:19:05.909 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.909 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.909 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058772 s, 178 MB/s 2024-09-15T23:19:05.917 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.917 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.917 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680024 s, 154 MB/s 2024-09-15T23:19:05.925 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.925 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.925 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063392 s, 165 MB/s 2024-09-15T23:19:05.934 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.934 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.934 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733194 s, 143 MB/s 2024-09-15T23:19:05.942 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.942 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.943 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632003 s, 166 MB/s 2024-09-15T23:19:05.951 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.951 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.951 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725901 s, 144 MB/s 2024-09-15T23:19:05.960 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.960 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.960 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653127 s, 161 MB/s 2024-09-15T23:19:05.968 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.968 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.968 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660385 s, 159 MB/s 2024-09-15T23:19:05.977 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.977 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.977 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713875 s, 147 MB/s 2024-09-15T23:19:05.985 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.985 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.985 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670952 s, 156 MB/s 2024-09-15T23:19:05.993 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:05.993 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:05.993 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655857 s, 160 MB/s 2024-09-15T23:19:06.001 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.002 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.002 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006645 s, 158 MB/s 2024-09-15T23:19:06.009 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.009 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.010 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626772 s, 167 MB/s 2024-09-15T23:19:06.017 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.017 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.018 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642233 s, 163 MB/s 2024-09-15T23:19:06.026 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.026 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.026 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665562 s, 158 MB/s 2024-09-15T23:19:06.034 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.034 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.034 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659988 s, 159 MB/s 2024-09-15T23:19:06.043 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.043 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.043 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072694 s, 144 MB/s 2024-09-15T23:19:06.051 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.051 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.051 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635744 s, 165 MB/s 2024-09-15T23:19:06.059 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.059 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.059 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656546 s, 160 MB/s 2024-09-15T23:19:06.068 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.068 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.068 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687758 s, 152 MB/s 2024-09-15T23:19:06.076 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.076 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.076 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677402 s, 155 MB/s 2024-09-15T23:19:06.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:06.083 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:06.083 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:06.083 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.2 2024-09-15T23:19:06.083 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:06.083 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:06.083 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:06.083 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:06.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:06.141 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.141 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.141 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613449 s, 171 MB/s 2024-09-15T23:19:06.150 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.150 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.150 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713421 s, 147 MB/s 2024-09-15T23:19:06.159 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.159 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.159 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682032 s, 154 MB/s 2024-09-15T23:19:06.167 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.167 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.167 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063424 s, 165 MB/s 2024-09-15T23:19:06.175 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.176 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.176 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700663 s, 150 MB/s 2024-09-15T23:19:06.184 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.184 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.184 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657751 s, 159 MB/s 2024-09-15T23:19:06.193 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.193 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.193 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708987 s, 148 MB/s 2024-09-15T23:19:06.200 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.200 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.200 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585955 s, 179 MB/s 2024-09-15T23:19:06.209 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.209 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.209 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722385 s, 145 MB/s 2024-09-15T23:19:06.218 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.218 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.218 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720116 s, 146 MB/s 2024-09-15T23:19:06.226 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.226 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.226 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630583 s, 166 MB/s 2024-09-15T23:19:06.234 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.234 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.234 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644491 s, 163 MB/s 2024-09-15T23:19:06.243 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.244 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.244 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755933 s, 139 MB/s 2024-09-15T23:19:06.252 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.252 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.252 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692045 s, 152 MB/s 2024-09-15T23:19:06.261 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.261 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.261 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664795 s, 158 MB/s 2024-09-15T23:19:06.268 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.268 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.268 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593696 s, 177 MB/s 2024-09-15T23:19:06.276 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.276 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.276 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623874 s, 168 MB/s 2024-09-15T23:19:06.284 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.284 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.285 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654594 s, 160 MB/s 2024-09-15T23:19:06.292 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.292 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.292 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590749 s, 177 MB/s 2024-09-15T23:19:06.300 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.300 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.300 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635041 s, 165 MB/s 2024-09-15T23:19:06.308 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.308 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.308 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635157 s, 165 MB/s 2024-09-15T23:19:06.316 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.316 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.317 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648978 s, 162 MB/s 2024-09-15T23:19:06.324 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.324 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.325 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630846 s, 166 MB/s 2024-09-15T23:19:06.332 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.332 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.332 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584321 s, 179 MB/s 2024-09-15T23:19:06.341 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.341 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.341 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072217 s, 145 MB/s 2024-09-15T23:19:06.349 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.349 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.349 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678348 s, 155 MB/s 2024-09-15T23:19:06.358 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.358 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.358 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651339 s, 161 MB/s 2024-09-15T23:19:06.367 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.367 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.367 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664548 s, 158 MB/s 2024-09-15T23:19:06.376 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.376 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.376 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705554 s, 149 MB/s 2024-09-15T23:19:06.385 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.385 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.385 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673798 s, 156 MB/s 2024-09-15T23:19:06.393 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.393 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.393 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00567753 s, 185 MB/s 2024-09-15T23:19:06.402 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.403 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.403 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075736 s, 138 MB/s 2024-09-15T23:19:06.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:06.409 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:06.409 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:06.409 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.3 2024-09-15T23:19:06.410 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:06.410 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:06.410 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:06.410 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:06.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:06.469 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.469 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.469 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728749 s, 144 MB/s 2024-09-15T23:19:06.478 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.478 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.478 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731911 s, 143 MB/s 2024-09-15T23:19:06.486 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.486 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.486 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584686 s, 179 MB/s 2024-09-15T23:19:06.495 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.495 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.495 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710808 s, 148 MB/s 2024-09-15T23:19:06.503 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.503 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.503 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639334 s, 164 MB/s 2024-09-15T23:19:06.511 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.511 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.511 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703251 s, 149 MB/s 2024-09-15T23:19:06.519 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.519 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.520 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634767 s, 165 MB/s 2024-09-15T23:19:06.528 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.528 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.528 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657858 s, 159 MB/s 2024-09-15T23:19:06.536 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.536 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.536 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649002 s, 162 MB/s 2024-09-15T23:19:06.544 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.544 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.544 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065834 s, 159 MB/s 2024-09-15T23:19:06.552 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.552 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.552 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636563 s, 165 MB/s 2024-09-15T23:19:06.560 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.560 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.560 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656371 s, 160 MB/s 2024-09-15T23:19:06.568 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.568 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.569 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643123 s, 163 MB/s 2024-09-15T23:19:06.577 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.577 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.577 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671691 s, 156 MB/s 2024-09-15T23:19:06.584 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.584 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.584 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591275 s, 177 MB/s 2024-09-15T23:19:06.593 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.593 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.593 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654784 s, 160 MB/s 2024-09-15T23:19:06.601 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.602 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.602 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070708 s, 148 MB/s 2024-09-15T23:19:06.610 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.610 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.610 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713161 s, 147 MB/s 2024-09-15T23:19:06.618 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.618 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.618 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632207 s, 166 MB/s 2024-09-15T23:19:06.626 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.626 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.626 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592542 s, 177 MB/s 2024-09-15T23:19:06.635 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.635 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.636 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777005 s, 135 MB/s 2024-09-15T23:19:06.645 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.645 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.645 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737842 s, 142 MB/s 2024-09-15T23:19:06.653 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.653 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.653 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710167 s, 148 MB/s 2024-09-15T23:19:06.661 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.662 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.662 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652436 s, 161 MB/s 2024-09-15T23:19:06.670 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.670 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.670 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657177 s, 160 MB/s 2024-09-15T23:19:06.678 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.678 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.678 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641341 s, 163 MB/s 2024-09-15T23:19:06.686 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.686 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.686 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628974 s, 167 MB/s 2024-09-15T23:19:06.694 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.695 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.695 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690094 s, 152 MB/s 2024-09-15T23:19:06.702 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.702 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.703 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617225 s, 170 MB/s 2024-09-15T23:19:06.710 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.710 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.710 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594444 s, 176 MB/s 2024-09-15T23:19:06.719 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.719 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.719 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653057 s, 161 MB/s 2024-09-15T23:19:06.727 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.727 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.727 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630599 s, 166 MB/s 2024-09-15T23:19:06.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:06.733 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:06.734 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:06.734 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.4 2024-09-15T23:19:06.734 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:06.734 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:06.734 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:06.734 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:06.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:06.792 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.792 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.792 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588909 s, 178 MB/s 2024-09-15T23:19:06.800 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.800 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.800 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670842 s, 156 MB/s 2024-09-15T23:19:06.808 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.809 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.809 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641072 s, 164 MB/s 2024-09-15T23:19:06.818 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.818 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.818 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766954 s, 137 MB/s 2024-09-15T23:19:06.827 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.827 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.827 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719992 s, 146 MB/s 2024-09-15T23:19:06.835 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.835 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.835 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667212 s, 157 MB/s 2024-09-15T23:19:06.844 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.844 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.844 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664052 s, 158 MB/s 2024-09-15T23:19:06.851 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.852 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.852 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603786 s, 174 MB/s 2024-09-15T23:19:06.861 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.861 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.861 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742238 s, 141 MB/s 2024-09-15T23:19:06.870 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.870 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.870 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745966 s, 141 MB/s 2024-09-15T23:19:06.877 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.877 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.877 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00560895 s, 187 MB/s 2024-09-15T23:19:06.884 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.885 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.885 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578693 s, 181 MB/s 2024-09-15T23:19:06.892 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.892 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.892 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583087 s, 180 MB/s 2024-09-15T23:19:06.900 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.900 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.901 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657723 s, 159 MB/s 2024-09-15T23:19:06.909 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.910 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.910 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728215 s, 144 MB/s 2024-09-15T23:19:06.919 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.919 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.919 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750736 s, 140 MB/s 2024-09-15T23:19:06.927 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.928 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.928 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696294 s, 151 MB/s 2024-09-15T23:19:06.936 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.936 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.936 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674839 s, 155 MB/s 2024-09-15T23:19:06.944 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.944 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.944 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645827 s, 162 MB/s 2024-09-15T23:19:06.953 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.953 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.953 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710204 s, 148 MB/s 2024-09-15T23:19:06.961 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.961 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.961 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630282 s, 166 MB/s 2024-09-15T23:19:06.968 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.968 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.969 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563611 s, 186 MB/s 2024-09-15T23:19:06.978 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.978 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.978 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00778638 s, 135 MB/s 2024-09-15T23:19:06.986 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.986 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.986 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643207 s, 163 MB/s 2024-09-15T23:19:06.994 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:06.994 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:06.994 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628126 s, 167 MB/s 2024-09-15T23:19:07.003 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.003 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.003 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725586 s, 145 MB/s 2024-09-15T23:19:07.011 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.011 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.011 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633545 s, 166 MB/s 2024-09-15T23:19:07.019 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.019 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.019 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656201 s, 160 MB/s 2024-09-15T23:19:07.028 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.029 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.029 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764152 s, 137 MB/s 2024-09-15T23:19:07.037 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.037 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.037 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705856 s, 149 MB/s 2024-09-15T23:19:07.046 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.046 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.046 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067124 s, 156 MB/s 2024-09-15T23:19:07.053 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.053 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.053 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571607 s, 183 MB/s 2024-09-15T23:19:07.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:07.060 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:07.060 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:07.060 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.5 2024-09-15T23:19:07.060 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:07.060 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:07.060 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:07.060 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:07.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:07.119 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.119 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.119 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657531 s, 159 MB/s 2024-09-15T23:19:07.127 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.127 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.127 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657642 s, 159 MB/s 2024-09-15T23:19:07.135 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.135 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.135 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644695 s, 163 MB/s 2024-09-15T23:19:07.142 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.143 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.143 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594561 s, 176 MB/s 2024-09-15T23:19:07.151 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.151 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.151 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676204 s, 155 MB/s 2024-09-15T23:19:07.159 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.159 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.159 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660556 s, 159 MB/s 2024-09-15T23:19:07.167 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.167 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.167 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569986 s, 184 MB/s 2024-09-15T23:19:07.175 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.175 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.175 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664163 s, 158 MB/s 2024-09-15T23:19:07.184 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.184 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.184 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736004 s, 142 MB/s 2024-09-15T23:19:07.193 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.194 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.194 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735104 s, 143 MB/s 2024-09-15T23:19:07.202 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.202 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.202 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653279 s, 161 MB/s 2024-09-15T23:19:07.210 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.211 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.211 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629929 s, 166 MB/s 2024-09-15T23:19:07.218 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.218 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.219 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641192 s, 164 MB/s 2024-09-15T23:19:07.227 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.227 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.227 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657815 s, 159 MB/s 2024-09-15T23:19:07.235 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.235 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.236 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681464 s, 154 MB/s 2024-09-15T23:19:07.243 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.244 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.244 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659042 s, 159 MB/s 2024-09-15T23:19:07.251 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.251 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.251 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563781 s, 186 MB/s 2024-09-15T23:19:07.258 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.258 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.259 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00561016 s, 187 MB/s 2024-09-15T23:19:07.267 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.267 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.267 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737106 s, 142 MB/s 2024-09-15T23:19:07.275 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.276 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.276 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064566 s, 162 MB/s 2024-09-15T23:19:07.283 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.283 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.284 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622436 s, 168 MB/s 2024-09-15T23:19:07.292 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.292 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.292 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642157 s, 163 MB/s 2024-09-15T23:19:07.299 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.299 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.299 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603914 s, 174 MB/s 2024-09-15T23:19:07.308 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.308 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.308 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647256 s, 162 MB/s 2024-09-15T23:19:07.316 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.316 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.316 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621887 s, 169 MB/s 2024-09-15T23:19:07.324 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.324 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.324 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647017 s, 162 MB/s 2024-09-15T23:19:07.332 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.332 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.332 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655199 s, 160 MB/s 2024-09-15T23:19:07.340 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.340 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.340 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598835 s, 175 MB/s 2024-09-15T23:19:07.349 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.349 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.349 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732133 s, 143 MB/s 2024-09-15T23:19:07.357 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.357 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.357 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646184 s, 162 MB/s 2024-09-15T23:19:07.366 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.366 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.366 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663343 s, 158 MB/s 2024-09-15T23:19:07.374 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.374 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.374 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680593 s, 154 MB/s 2024-09-15T23:19:07.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:07.381 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:07.381 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:07.381 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.6 2024-09-15T23:19:07.381 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:07.381 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:07.381 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:07.381 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:07.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:07.439 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.439 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.439 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598673 s, 175 MB/s 2024-09-15T23:19:07.447 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.447 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.447 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654997 s, 160 MB/s 2024-09-15T23:19:07.456 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.456 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.456 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661057 s, 159 MB/s 2024-09-15T23:19:07.464 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.464 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.464 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714613 s, 147 MB/s 2024-09-15T23:19:07.473 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.473 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.473 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687254 s, 153 MB/s 2024-09-15T23:19:07.481 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.481 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.481 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630804 s, 166 MB/s 2024-09-15T23:19:07.490 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.490 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.490 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687677 s, 152 MB/s 2024-09-15T23:19:07.497 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.498 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.498 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610655 s, 172 MB/s 2024-09-15T23:19:07.506 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.506 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.506 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064174 s, 163 MB/s 2024-09-15T23:19:07.515 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.515 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.515 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735582 s, 143 MB/s 2024-09-15T23:19:07.523 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.523 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.523 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642572 s, 163 MB/s 2024-09-15T23:19:07.531 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.531 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.531 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586953 s, 179 MB/s 2024-09-15T23:19:07.538 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.538 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.538 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586356 s, 179 MB/s 2024-09-15T23:19:07.546 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.546 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.547 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655225 s, 160 MB/s 2024-09-15T23:19:07.554 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.555 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.555 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645762 s, 162 MB/s 2024-09-15T23:19:07.562 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.562 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.562 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612752 s, 171 MB/s 2024-09-15T23:19:07.570 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.570 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.570 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584056 s, 180 MB/s 2024-09-15T23:19:07.578 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.578 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.578 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613209 s, 171 MB/s 2024-09-15T23:19:07.586 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.586 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.586 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575251 s, 182 MB/s 2024-09-15T23:19:07.594 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.594 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.594 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645359 s, 162 MB/s 2024-09-15T23:19:07.602 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.602 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.602 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630355 s, 166 MB/s 2024-09-15T23:19:07.611 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.611 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.611 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738721 s, 142 MB/s 2024-09-15T23:19:07.619 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.619 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.619 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633782 s, 165 MB/s 2024-09-15T23:19:07.627 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.627 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.628 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670048 s, 156 MB/s 2024-09-15T23:19:07.635 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.636 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.636 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667215 s, 157 MB/s 2024-09-15T23:19:07.644 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.644 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.644 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066661 s, 157 MB/s 2024-09-15T23:19:07.652 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.652 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.652 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627536 s, 167 MB/s 2024-09-15T23:19:07.660 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.660 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.660 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647397 s, 162 MB/s 2024-09-15T23:19:07.670 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.670 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.670 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734077 s, 143 MB/s 2024-09-15T23:19:07.678 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.678 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.678 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611244 s, 172 MB/s 2024-09-15T23:19:07.686 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.686 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.686 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062766 s, 167 MB/s 2024-09-15T23:19:07.693 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.694 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.694 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606136 s, 173 MB/s 2024-09-15T23:19:07.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:07.700 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:07.700 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:07.700 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.7 2024-09-15T23:19:07.700 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:07.700 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:07.700 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:07.700 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:07.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:07.760 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.760 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.760 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074902 s, 140 MB/s 2024-09-15T23:19:07.769 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.769 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.769 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751304 s, 140 MB/s 2024-09-15T23:19:07.777 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.778 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.778 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620863 s, 169 MB/s 2024-09-15T23:19:07.785 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.785 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.786 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623904 s, 168 MB/s 2024-09-15T23:19:07.793 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.793 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.793 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642503 s, 163 MB/s 2024-09-15T23:19:07.801 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.802 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.802 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635413 s, 165 MB/s 2024-09-15T23:19:07.809 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.809 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.809 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588151 s, 178 MB/s 2024-09-15T23:19:07.817 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.817 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.817 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063504 s, 165 MB/s 2024-09-15T23:19:07.825 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.825 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.826 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671532 s, 156 MB/s 2024-09-15T23:19:07.833 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.833 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.833 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583287 s, 180 MB/s 2024-09-15T23:19:07.842 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.842 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.842 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723158 s, 145 MB/s 2024-09-15T23:19:07.850 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.850 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.850 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585684 s, 179 MB/s 2024-09-15T23:19:07.858 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.858 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.859 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636216 s, 165 MB/s 2024-09-15T23:19:07.866 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.866 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.866 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643304 s, 163 MB/s 2024-09-15T23:19:07.874 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.874 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.874 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603067 s, 174 MB/s 2024-09-15T23:19:07.883 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.883 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.883 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711003 s, 147 MB/s 2024-09-15T23:19:07.891 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.891 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.891 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592685 s, 177 MB/s 2024-09-15T23:19:07.900 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.900 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.900 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653979 s, 160 MB/s 2024-09-15T23:19:07.907 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.907 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.907 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625493 s, 168 MB/s 2024-09-15T23:19:07.916 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.916 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.916 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716911 s, 146 MB/s 2024-09-15T23:19:07.924 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.924 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.924 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635373 s, 165 MB/s 2024-09-15T23:19:07.932 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.932 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.932 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623767 s, 168 MB/s 2024-09-15T23:19:07.941 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.941 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.941 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679438 s, 154 MB/s 2024-09-15T23:19:07.950 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.950 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.950 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076801 s, 137 MB/s 2024-09-15T23:19:07.958 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.958 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.958 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059081 s, 177 MB/s 2024-09-15T23:19:07.966 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.967 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.967 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711596 s, 147 MB/s 2024-09-15T23:19:07.975 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.975 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.975 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681926 s, 154 MB/s 2024-09-15T23:19:07.983 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.983 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.983 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058281 s, 180 MB/s 2024-09-15T23:19:07.991 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.991 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.991 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640458 s, 164 MB/s 2024-09-15T23:19:07.999 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:07.999 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:07.999 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678331 s, 155 MB/s 2024-09-15T23:19:08.007 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.007 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.007 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629947 s, 166 MB/s 2024-09-15T23:19:08.014 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.015 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.015 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564717 s, 186 MB/s 2024-09-15T23:19:08.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:08.021 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:08.021 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:08.021 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.8 2024-09-15T23:19:08.021 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:08.021 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:08.022 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:08.022 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:08.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:08.081 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.081 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.081 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745823 s, 141 MB/s 2024-09-15T23:19:08.089 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.089 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.089 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638644 s, 164 MB/s 2024-09-15T23:19:08.099 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.099 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.099 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00835464 s, 126 MB/s 2024-09-15T23:19:08.107 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.107 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.107 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623851 s, 168 MB/s 2024-09-15T23:19:08.115 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.115 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.115 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631247 s, 166 MB/s 2024-09-15T23:19:08.124 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.124 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.125 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743995 s, 141 MB/s 2024-09-15T23:19:08.133 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.133 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.133 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691495 s, 152 MB/s 2024-09-15T23:19:08.142 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.143 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.143 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00812228 s, 129 MB/s 2024-09-15T23:19:08.151 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.151 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.151 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653507 s, 160 MB/s 2024-09-15T23:19:08.159 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.159 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.160 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657153 s, 160 MB/s 2024-09-15T23:19:08.167 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.167 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.167 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566817 s, 185 MB/s 2024-09-15T23:19:08.175 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.175 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.176 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643357 s, 163 MB/s 2024-09-15T23:19:08.184 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.184 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.184 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683922 s, 153 MB/s 2024-09-15T23:19:08.192 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.192 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.192 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639289 s, 164 MB/s 2024-09-15T23:19:08.199 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.199 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.199 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568749 s, 184 MB/s 2024-09-15T23:19:08.207 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.207 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.207 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657557 s, 159 MB/s 2024-09-15T23:19:08.215 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.215 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.215 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636446 s, 165 MB/s 2024-09-15T23:19:08.223 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.223 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.223 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00567904 s, 185 MB/s 2024-09-15T23:19:08.231 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.231 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.231 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648547 s, 162 MB/s 2024-09-15T23:19:08.240 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.240 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.240 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721696 s, 145 MB/s 2024-09-15T23:19:08.248 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.248 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.248 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063751 s, 164 MB/s 2024-09-15T23:19:08.257 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.257 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.257 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00790212 s, 133 MB/s 2024-09-15T23:19:08.267 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.267 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.267 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066154 s, 159 MB/s 2024-09-15T23:19:08.273 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.274 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.274 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623863 s, 168 MB/s 2024-09-15T23:19:08.281 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.281 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.282 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637615 s, 164 MB/s 2024-09-15T23:19:08.290 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.290 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.290 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737949 s, 142 MB/s 2024-09-15T23:19:08.299 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.299 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.299 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651047 s, 161 MB/s 2024-09-15T23:19:08.307 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.307 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.307 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600674 s, 175 MB/s 2024-09-15T23:19:08.314 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.314 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.314 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565169 s, 186 MB/s 2024-09-15T23:19:08.322 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.322 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.322 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656522 s, 160 MB/s 2024-09-15T23:19:08.332 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.332 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.332 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757829 s, 138 MB/s 2024-09-15T23:19:08.340 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.340 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.340 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673433 s, 156 MB/s 2024-09-15T23:19:08.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:08.347 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:08.347 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:08.347 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.9 2024-09-15T23:19:08.347 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:08.347 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:08.347 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:08.347 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:08.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:08.405 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.405 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.405 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626622 s, 167 MB/s 2024-09-15T23:19:08.413 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.413 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.413 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603602 s, 174 MB/s 2024-09-15T23:19:08.423 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.423 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.423 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0080341 s, 131 MB/s 2024-09-15T23:19:08.432 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.432 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.432 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731836 s, 143 MB/s 2024-09-15T23:19:08.441 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.441 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.441 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748776 s, 140 MB/s 2024-09-15T23:19:08.449 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.449 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.449 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577375 s, 182 MB/s 2024-09-15T23:19:08.457 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.457 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.457 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581077 s, 180 MB/s 2024-09-15T23:19:08.464 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.464 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.464 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057821 s, 181 MB/s 2024-09-15T23:19:08.472 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.472 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.473 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643818 s, 163 MB/s 2024-09-15T23:19:08.480 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.481 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.481 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646176 s, 162 MB/s 2024-09-15T23:19:08.489 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.489 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.489 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736596 s, 142 MB/s 2024-09-15T23:19:08.497 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.498 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.498 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064495 s, 163 MB/s 2024-09-15T23:19:08.505 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.505 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.505 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571531 s, 183 MB/s 2024-09-15T23:19:08.513 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.513 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.513 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063897 s, 164 MB/s 2024-09-15T23:19:08.521 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.521 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.521 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631533 s, 166 MB/s 2024-09-15T23:19:08.531 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.531 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.531 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00800489 s, 131 MB/s 2024-09-15T23:19:08.538 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.538 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.538 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590386 s, 178 MB/s 2024-09-15T23:19:08.546 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.546 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.546 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573284 s, 183 MB/s 2024-09-15T23:19:08.555 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.555 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.555 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710965 s, 147 MB/s 2024-09-15T23:19:08.563 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.563 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.563 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591576 s, 177 MB/s 2024-09-15T23:19:08.571 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.571 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.571 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668495 s, 157 MB/s 2024-09-15T23:19:08.584 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.584 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.584 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108943 s, 96.3 MB/s 2024-09-15T23:19:08.594 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.594 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.594 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779432 s, 135 MB/s 2024-09-15T23:19:08.601 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.602 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.602 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634016 s, 165 MB/s 2024-09-15T23:19:08.609 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.637 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.638 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632359 s, 166 MB/s 2024-09-15T23:19:08.639 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.639 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.639 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679925 s, 154 MB/s 2024-09-15T23:19:08.639 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.639 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.639 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586093 s, 179 MB/s 2024-09-15T23:19:08.639 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.639 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.639 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591586 s, 177 MB/s 2024-09-15T23:19:08.642 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.642 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.642 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716014 s, 146 MB/s 2024-09-15T23:19:08.650 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.650 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.650 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587528 s, 178 MB/s 2024-09-15T23:19:08.658 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.658 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.658 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642945 s, 163 MB/s 2024-09-15T23:19:08.666 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.666 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.666 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564827 s, 186 MB/s 2024-09-15T23:19:08.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:08.672 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:08.673 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:08.673 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.10 2024-09-15T23:19:08.673 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:08.673 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:08.673 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:08.673 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:08.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:08.731 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.731 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.731 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616348 s, 170 MB/s 2024-09-15T23:19:08.739 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.739 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.739 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640671 s, 164 MB/s 2024-09-15T23:19:08.747 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.747 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.747 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650986 s, 161 MB/s 2024-09-15T23:19:08.755 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.755 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.755 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639555 s, 164 MB/s 2024-09-15T23:19:08.765 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.765 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.765 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00819369 s, 128 MB/s 2024-09-15T23:19:08.773 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.773 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.773 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656757 s, 160 MB/s 2024-09-15T23:19:08.781 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.781 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.781 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064539 s, 162 MB/s 2024-09-15T23:19:08.790 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.790 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.790 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721935 s, 145 MB/s 2024-09-15T23:19:08.800 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.800 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.800 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726915 s, 144 MB/s 2024-09-15T23:19:08.808 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.808 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.808 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664995 s, 158 MB/s 2024-09-15T23:19:08.816 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.816 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.816 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653214 s, 161 MB/s 2024-09-15T23:19:08.824 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.824 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.824 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598491 s, 175 MB/s 2024-09-15T23:19:08.832 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.832 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.832 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664267 s, 158 MB/s 2024-09-15T23:19:08.840 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.840 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.840 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649515 s, 161 MB/s 2024-09-15T23:19:08.849 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.849 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.849 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729025 s, 144 MB/s 2024-09-15T23:19:08.857 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.858 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.858 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664856 s, 158 MB/s 2024-09-15T23:19:08.866 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.866 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.866 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645137 s, 163 MB/s 2024-09-15T23:19:08.874 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.874 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.874 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672182 s, 156 MB/s 2024-09-15T23:19:08.881 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.881 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.882 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057999 s, 181 MB/s 2024-09-15T23:19:08.890 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.890 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.890 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067519 s, 155 MB/s 2024-09-15T23:19:08.898 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.898 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.898 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671964 s, 156 MB/s 2024-09-15T23:19:08.905 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.906 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.906 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569918 s, 184 MB/s 2024-09-15T23:19:08.914 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.915 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.915 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726917 s, 144 MB/s 2024-09-15T23:19:08.922 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.922 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.922 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627626 s, 167 MB/s 2024-09-15T23:19:08.930 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.930 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.930 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585666 s, 179 MB/s 2024-09-15T23:19:08.938 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.939 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.939 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006728 s, 156 MB/s 2024-09-15T23:19:08.947 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.947 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.947 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668491 s, 157 MB/s 2024-09-15T23:19:08.955 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.955 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.955 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637432 s, 165 MB/s 2024-09-15T23:19:08.963 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.963 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.963 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654123 s, 160 MB/s 2024-09-15T23:19:08.971 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.971 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.971 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665255 s, 158 MB/s 2024-09-15T23:19:08.979 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.979 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.979 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633343 s, 166 MB/s 2024-09-15T23:19:08.987 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:08.987 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:08.987 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635171 s, 165 MB/s 2024-09-15T23:19:08.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:08.994 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:08.994 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:08.994 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.11 2024-09-15T23:19:08.994 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:08.994 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:08.994 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:08.994 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:09.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:09.051 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.051 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.051 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577392 s, 182 MB/s 2024-09-15T23:19:09.060 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.060 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.060 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676399 s, 155 MB/s 2024-09-15T23:19:09.068 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.068 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.068 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654761 s, 160 MB/s 2024-09-15T23:19:09.076 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.076 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.076 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626086 s, 167 MB/s 2024-09-15T23:19:09.083 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.083 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.084 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585663 s, 179 MB/s 2024-09-15T23:19:09.091 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.091 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.091 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617878 s, 170 MB/s 2024-09-15T23:19:09.100 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.100 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.100 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686217 s, 153 MB/s 2024-09-15T23:19:09.107 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.107 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.107 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581252 s, 180 MB/s 2024-09-15T23:19:09.115 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.115 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.115 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606711 s, 173 MB/s 2024-09-15T23:19:09.123 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.123 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.123 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593203 s, 177 MB/s 2024-09-15T23:19:09.132 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.132 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.132 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722459 s, 145 MB/s 2024-09-15T23:19:09.140 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.140 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.140 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063448 s, 165 MB/s 2024-09-15T23:19:09.148 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.148 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.149 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646384 s, 162 MB/s 2024-09-15T23:19:09.156 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.156 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.156 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635479 s, 165 MB/s 2024-09-15T23:19:09.164 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.164 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.164 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578796 s, 181 MB/s 2024-09-15T23:19:09.171 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.171 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.171 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585249 s, 179 MB/s 2024-09-15T23:19:09.179 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.179 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.179 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607993 s, 172 MB/s 2024-09-15T23:19:09.187 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.187 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.187 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609167 s, 172 MB/s 2024-09-15T23:19:09.195 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.195 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.195 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635771 s, 165 MB/s 2024-09-15T23:19:09.204 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.204 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.204 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693796 s, 151 MB/s 2024-09-15T23:19:09.212 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.212 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.212 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568367 s, 184 MB/s 2024-09-15T23:19:09.219 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.219 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.219 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582435 s, 180 MB/s 2024-09-15T23:19:09.227 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.227 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.227 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656964 s, 160 MB/s 2024-09-15T23:19:09.235 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.236 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.236 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658588 s, 159 MB/s 2024-09-15T23:19:09.244 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.244 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.245 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713544 s, 147 MB/s 2024-09-15T23:19:09.253 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.253 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.253 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633594 s, 165 MB/s 2024-09-15T23:19:09.260 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.260 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.260 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563082 s, 186 MB/s 2024-09-15T23:19:09.267 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.268 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.268 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00561392 s, 187 MB/s 2024-09-15T23:19:09.275 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.275 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.275 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588141 s, 178 MB/s 2024-09-15T23:19:09.283 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.284 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.284 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663852 s, 158 MB/s 2024-09-15T23:19:09.292 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.292 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.293 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715665 s, 147 MB/s 2024-09-15T23:19:09.300 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.301 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.301 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641415 s, 163 MB/s 2024-09-15T23:19:09.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:09.307 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:09.307 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:09.308 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.12 2024-09-15T23:19:09.308 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:09.308 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:09.308 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:09.308 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:09.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:09.365 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.366 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.366 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064699 s, 162 MB/s 2024-09-15T23:19:09.375 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.375 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.375 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772749 s, 136 MB/s 2024-09-15T23:19:09.384 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.384 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.384 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721513 s, 145 MB/s 2024-09-15T23:19:09.393 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.393 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.393 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698908 s, 150 MB/s 2024-09-15T23:19:09.401 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.401 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.401 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644078 s, 163 MB/s 2024-09-15T23:19:09.408 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.408 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.409 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581553 s, 180 MB/s 2024-09-15T23:19:09.417 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.417 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.417 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641243 s, 164 MB/s 2024-09-15T23:19:09.425 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.425 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.425 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637208 s, 165 MB/s 2024-09-15T23:19:09.434 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.434 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.434 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729492 s, 144 MB/s 2024-09-15T23:19:09.443 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.443 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.443 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642401 s, 163 MB/s 2024-09-15T23:19:09.452 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.452 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.452 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649271 s, 162 MB/s 2024-09-15T23:19:09.459 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.460 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.460 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627275 s, 167 MB/s 2024-09-15T23:19:09.468 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.468 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.468 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633376 s, 166 MB/s 2024-09-15T23:19:09.476 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.476 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.476 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649409 s, 161 MB/s 2024-09-15T23:19:09.484 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.484 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.484 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646979 s, 162 MB/s 2024-09-15T23:19:09.492 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.492 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.492 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581676 s, 180 MB/s 2024-09-15T23:19:09.500 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.501 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.501 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664733 s, 158 MB/s 2024-09-15T23:19:09.508 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.508 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.508 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0056398 s, 186 MB/s 2024-09-15T23:19:09.516 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.516 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.516 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641823 s, 163 MB/s 2024-09-15T23:19:09.525 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.525 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.525 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739104 s, 142 MB/s 2024-09-15T23:19:09.534 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.534 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.534 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779541 s, 135 MB/s 2024-09-15T23:19:09.542 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.543 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.543 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655112 s, 160 MB/s 2024-09-15T23:19:09.550 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.550 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.550 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580734 s, 181 MB/s 2024-09-15T23:19:09.557 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.558 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.558 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00562995 s, 186 MB/s 2024-09-15T23:19:09.566 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.566 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.566 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646758 s, 162 MB/s 2024-09-15T23:19:09.575 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.575 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.575 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690659 s, 152 MB/s 2024-09-15T23:19:09.582 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.582 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.582 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578889 s, 181 MB/s 2024-09-15T23:19:09.591 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.591 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.591 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074525 s, 141 MB/s 2024-09-15T23:19:09.600 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.600 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.600 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646245 s, 162 MB/s 2024-09-15T23:19:09.609 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.609 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.609 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733586 s, 143 MB/s 2024-09-15T23:19:09.617 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.617 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.617 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679397 s, 154 MB/s 2024-09-15T23:19:09.627 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.627 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.627 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00796417 s, 132 MB/s 2024-09-15T23:19:09.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:09.634 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:09.634 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:09.634 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.13 2024-09-15T23:19:09.634 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:09.634 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:09.634 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:09.634 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:09.657 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:19:09.679 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:19:09.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:09.692 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.692 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.693 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675655 s, 155 MB/s 2024-09-15T23:19:09.700 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.701 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.701 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670234 s, 156 MB/s 2024-09-15T23:19:09.709 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.709 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.709 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650797 s, 161 MB/s 2024-09-15T23:19:09.717 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.717 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.717 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643708 s, 163 MB/s 2024-09-15T23:19:09.724 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.725 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.725 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059664 s, 176 MB/s 2024-09-15T23:19:09.734 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.735 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.735 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708274 s, 148 MB/s 2024-09-15T23:19:09.741 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.741 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.742 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648051 s, 162 MB/s 2024-09-15T23:19:09.751 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.752 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.752 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00836447 s, 125 MB/s 2024-09-15T23:19:09.759 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.759 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.759 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577706 s, 182 MB/s 2024-09-15T23:19:09.768 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.768 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.768 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706298 s, 148 MB/s 2024-09-15T23:19:09.776 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.776 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.777 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066212 s, 158 MB/s 2024-09-15T23:19:09.784 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.785 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.785 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654116 s, 160 MB/s 2024-09-15T23:19:09.793 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.793 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.793 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644906 s, 163 MB/s 2024-09-15T23:19:09.800 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.800 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.800 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059458 s, 176 MB/s 2024-09-15T23:19:09.808 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.808 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.808 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582263 s, 180 MB/s 2024-09-15T23:19:09.816 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.816 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.816 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057328 s, 183 MB/s 2024-09-15T23:19:09.825 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.825 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.825 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695102 s, 151 MB/s 2024-09-15T23:19:09.833 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.833 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.833 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663995 s, 158 MB/s 2024-09-15T23:19:09.843 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.843 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.843 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747123 s, 140 MB/s 2024-09-15T23:19:09.851 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.851 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.851 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658334 s, 159 MB/s 2024-09-15T23:19:09.859 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.860 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.860 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656168 s, 160 MB/s 2024-09-15T23:19:09.868 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.869 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.869 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719848 s, 146 MB/s 2024-09-15T23:19:09.877 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.877 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.877 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659298 s, 159 MB/s 2024-09-15T23:19:09.884 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.885 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.885 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594678 s, 176 MB/s 2024-09-15T23:19:09.891 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.892 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.892 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00555204 s, 189 MB/s 2024-09-15T23:19:09.899 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.899 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.899 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058322 s, 180 MB/s 2024-09-15T23:19:09.907 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.908 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.908 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646386 s, 162 MB/s 2024-09-15T23:19:09.915 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.915 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.915 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633785 s, 165 MB/s 2024-09-15T23:19:09.923 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.923 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.923 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604704 s, 173 MB/s 2024-09-15T23:19:09.932 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.932 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.932 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709191 s, 148 MB/s 2024-09-15T23:19:09.940 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.940 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.941 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665357 s, 158 MB/s 2024-09-15T23:19:09.950 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:09.950 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:09.950 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00775285 s, 135 MB/s 2024-09-15T23:19:09.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:09.956 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:09.956 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:09.957 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.14 2024-09-15T23:19:09.957 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:09.957 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:09.957 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:09.957 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:10.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:10.055 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.055 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.055 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678561 s, 155 MB/s 2024-09-15T23:19:10.063 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.063 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.063 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615118 s, 170 MB/s 2024-09-15T23:19:10.071 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.071 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.071 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641143 s, 164 MB/s 2024-09-15T23:19:10.078 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.079 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.079 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580252 s, 181 MB/s 2024-09-15T23:19:10.088 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.088 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.088 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717397 s, 146 MB/s 2024-09-15T23:19:10.095 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.096 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.096 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607201 s, 173 MB/s 2024-09-15T23:19:10.104 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.104 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.104 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652726 s, 161 MB/s 2024-09-15T23:19:10.112 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.112 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.112 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640692 s, 164 MB/s 2024-09-15T23:19:10.120 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.120 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.120 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689725 s, 152 MB/s 2024-09-15T23:19:10.128 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.128 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.128 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594593 s, 176 MB/s 2024-09-15T23:19:10.137 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.137 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.137 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720139 s, 146 MB/s 2024-09-15T23:19:10.145 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.145 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.145 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617932 s, 170 MB/s 2024-09-15T23:19:10.152 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.152 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.152 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585516 s, 179 MB/s 2024-09-15T23:19:10.160 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.160 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.160 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622898 s, 168 MB/s 2024-09-15T23:19:10.168 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.169 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.169 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653996 s, 160 MB/s 2024-09-15T23:19:10.176 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.177 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.177 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637949 s, 164 MB/s 2024-09-15T23:19:10.184 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.184 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.184 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597701 s, 175 MB/s 2024-09-15T23:19:10.193 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.193 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.193 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071026 s, 148 MB/s 2024-09-15T23:19:10.202 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.202 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.202 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653794 s, 160 MB/s 2024-09-15T23:19:10.210 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.210 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.210 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622944 s, 168 MB/s 2024-09-15T23:19:10.218 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.218 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.218 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655449 s, 160 MB/s 2024-09-15T23:19:10.226 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.226 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.226 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577437 s, 182 MB/s 2024-09-15T23:19:10.236 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.236 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.236 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741233 s, 141 MB/s 2024-09-15T23:19:10.242 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.243 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.243 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566848 s, 185 MB/s 2024-09-15T23:19:10.251 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.251 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.251 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642662 s, 163 MB/s 2024-09-15T23:19:10.258 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.258 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.258 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057267 s, 183 MB/s 2024-09-15T23:19:10.266 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.266 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.266 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063875 s, 164 MB/s 2024-09-15T23:19:10.275 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.275 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.275 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664797 s, 158 MB/s 2024-09-15T23:19:10.283 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.283 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.283 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667908 s, 157 MB/s 2024-09-15T23:19:10.291 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.291 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.291 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059647 s, 176 MB/s 2024-09-15T23:19:10.300 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.300 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.300 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744918 s, 141 MB/s 2024-09-15T23:19:10.308 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.308 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.308 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663433 s, 158 MB/s 2024-09-15T23:19:10.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:10.315 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:10.315 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:10.315 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.15 2024-09-15T23:19:10.315 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:10.316 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:10.316 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:10.316 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:10.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:10.375 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.375 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.375 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722678 s, 145 MB/s 2024-09-15T23:19:10.383 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.383 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.383 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675874 s, 155 MB/s 2024-09-15T23:19:10.391 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.391 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.391 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596 s, 176 MB/s 2024-09-15T23:19:10.400 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.400 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.400 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757308 s, 138 MB/s 2024-09-15T23:19:10.408 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.408 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.408 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066276 s, 158 MB/s 2024-09-15T23:19:10.416 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.417 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.417 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656797 s, 160 MB/s 2024-09-15T23:19:10.426 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.426 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.426 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725237 s, 145 MB/s 2024-09-15T23:19:10.434 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.434 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.434 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710589 s, 148 MB/s 2024-09-15T23:19:10.444 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.444 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.444 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577191 s, 182 MB/s 2024-09-15T23:19:10.450 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.450 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.450 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643758 s, 163 MB/s 2024-09-15T23:19:10.459 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.459 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.459 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065006 s, 161 MB/s 2024-09-15T23:19:10.468 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.468 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.468 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00780526 s, 134 MB/s 2024-09-15T23:19:10.477 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.477 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.477 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705523 s, 149 MB/s 2024-09-15T23:19:10.486 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.486 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.486 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713697 s, 147 MB/s 2024-09-15T23:19:10.495 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.495 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.495 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737312 s, 142 MB/s 2024-09-15T23:19:10.502 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.502 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.502 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593907 s, 177 MB/s 2024-09-15T23:19:10.511 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.511 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.511 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006371 s, 165 MB/s 2024-09-15T23:19:10.519 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.519 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.519 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630341 s, 166 MB/s 2024-09-15T23:19:10.528 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.528 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.528 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716992 s, 146 MB/s 2024-09-15T23:19:10.536 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.536 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.536 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620676 s, 169 MB/s 2024-09-15T23:19:10.544 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.544 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.544 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624264 s, 168 MB/s 2024-09-15T23:19:10.552 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.552 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.552 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671126 s, 156 MB/s 2024-09-15T23:19:10.560 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.560 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.560 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641824 s, 163 MB/s 2024-09-15T23:19:10.568 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.568 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.568 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640193 s, 164 MB/s 2024-09-15T23:19:10.576 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.576 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.576 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622952 s, 168 MB/s 2024-09-15T23:19:10.585 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.585 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.585 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733156 s, 143 MB/s 2024-09-15T23:19:10.594 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.594 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.594 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709074 s, 148 MB/s 2024-09-15T23:19:10.601 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.601 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.601 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571517 s, 183 MB/s 2024-09-15T23:19:10.608 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.609 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.609 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566381 s, 185 MB/s 2024-09-15T23:19:10.617 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.617 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.617 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631201 s, 166 MB/s 2024-09-15T23:19:10.625 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.625 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.625 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629445 s, 167 MB/s 2024-09-15T23:19:10.632 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.633 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.633 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613797 s, 171 MB/s 2024-09-15T23:19:10.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:10.639 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:10.639 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:10.639 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.16 2024-09-15T23:19:10.639 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:10.640 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:10.640 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:10.640 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:10.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:10.698 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.698 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.698 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662468 s, 158 MB/s 2024-09-15T23:19:10.707 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.707 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.707 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708964 s, 148 MB/s 2024-09-15T23:19:10.715 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.716 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.716 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645785 s, 162 MB/s 2024-09-15T23:19:10.724 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.724 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.724 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743209 s, 141 MB/s 2024-09-15T23:19:10.732 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.732 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.732 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062209 s, 169 MB/s 2024-09-15T23:19:10.740 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.740 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.740 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576403 s, 182 MB/s 2024-09-15T23:19:10.748 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.749 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.749 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699201 s, 150 MB/s 2024-09-15T23:19:10.756 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.756 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.756 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585179 s, 179 MB/s 2024-09-15T23:19:10.764 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.764 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.764 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637514 s, 164 MB/s 2024-09-15T23:19:10.772 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.772 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.772 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006296 s, 167 MB/s 2024-09-15T23:19:10.780 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.780 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.780 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643108 s, 163 MB/s 2024-09-15T23:19:10.788 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.788 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.788 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635032 s, 165 MB/s 2024-09-15T23:19:10.796 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.796 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.796 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620907 s, 169 MB/s 2024-09-15T23:19:10.804 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.804 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.804 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638793 s, 164 MB/s 2024-09-15T23:19:10.812 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.812 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.812 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631088 s, 166 MB/s 2024-09-15T23:19:10.821 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.821 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.821 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703276 s, 149 MB/s 2024-09-15T23:19:10.830 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.830 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.830 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732181 s, 143 MB/s 2024-09-15T23:19:10.839 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.839 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.839 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662089 s, 158 MB/s 2024-09-15T23:19:10.847 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.847 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.847 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620981 s, 169 MB/s 2024-09-15T23:19:10.855 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.856 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.856 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071971 s, 146 MB/s 2024-09-15T23:19:10.863 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.864 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.864 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627149 s, 167 MB/s 2024-09-15T23:19:10.871 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.871 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.871 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570387 s, 184 MB/s 2024-09-15T23:19:10.879 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.880 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.880 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661964 s, 158 MB/s 2024-09-15T23:19:10.888 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.888 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.888 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695059 s, 151 MB/s 2024-09-15T23:19:10.897 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.898 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.898 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760816 s, 138 MB/s 2024-09-15T23:19:10.906 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.906 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.906 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636748 s, 165 MB/s 2024-09-15T23:19:10.914 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.914 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.914 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668011 s, 157 MB/s 2024-09-15T23:19:10.923 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.923 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.923 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762631 s, 137 MB/s 2024-09-15T23:19:10.931 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.931 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.931 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574925 s, 182 MB/s 2024-09-15T23:19:10.939 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.939 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.939 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656697 s, 160 MB/s 2024-09-15T23:19:10.948 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.948 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.948 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652015 s, 161 MB/s 2024-09-15T23:19:10.955 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:10.956 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:10.956 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648034 s, 162 MB/s 2024-09-15T23:19:10.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:10.963 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:10.963 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:10.963 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.17 2024-09-15T23:19:10.963 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:10.963 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:10.963 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:10.963 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:11.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:11.022 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.022 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.022 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693455 s, 151 MB/s 2024-09-15T23:19:11.030 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.030 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.031 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642288 s, 163 MB/s 2024-09-15T23:19:11.038 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.038 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.039 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647782 s, 162 MB/s 2024-09-15T23:19:11.047 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.047 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.047 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071601 s, 146 MB/s 2024-09-15T23:19:11.056 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.056 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.056 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586817 s, 179 MB/s 2024-09-15T23:19:11.063 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.063 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.063 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615986 s, 170 MB/s 2024-09-15T23:19:11.071 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.072 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.072 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668429 s, 157 MB/s 2024-09-15T23:19:11.081 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.081 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.081 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720189 s, 146 MB/s 2024-09-15T23:19:11.090 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.090 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.090 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740796 s, 142 MB/s 2024-09-15T23:19:11.098 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.098 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.098 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644185 s, 163 MB/s 2024-09-15T23:19:11.105 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.105 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.106 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568595 s, 184 MB/s 2024-09-15T23:19:11.114 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.115 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.115 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721778 s, 145 MB/s 2024-09-15T23:19:11.123 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.123 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.123 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708548 s, 148 MB/s 2024-09-15T23:19:11.131 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.131 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.131 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594918 s, 176 MB/s 2024-09-15T23:19:11.139 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.139 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.139 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063627 s, 165 MB/s 2024-09-15T23:19:11.147 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.147 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.147 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629022 s, 167 MB/s 2024-09-15T23:19:11.155 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.155 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.155 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636503 s, 165 MB/s 2024-09-15T23:19:11.164 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.164 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.164 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703225 s, 149 MB/s 2024-09-15T23:19:11.172 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.172 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.172 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658802 s, 159 MB/s 2024-09-15T23:19:11.180 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.180 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.180 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629767 s, 167 MB/s 2024-09-15T23:19:11.189 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.189 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.189 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705678 s, 149 MB/s 2024-09-15T23:19:11.197 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.197 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.197 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642644 s, 163 MB/s 2024-09-15T23:19:11.205 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.205 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.205 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655911 s, 160 MB/s 2024-09-15T23:19:11.213 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.213 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.213 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00556253 s, 189 MB/s 2024-09-15T23:19:11.222 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.222 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.222 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750445 s, 140 MB/s 2024-09-15T23:19:11.230 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.230 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.230 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654671 s, 160 MB/s 2024-09-15T23:19:11.238 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.238 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.238 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641705 s, 163 MB/s 2024-09-15T23:19:11.245 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.246 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.246 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581017 s, 180 MB/s 2024-09-15T23:19:11.254 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.254 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.254 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621825 s, 169 MB/s 2024-09-15T23:19:11.262 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.262 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.262 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645733 s, 162 MB/s 2024-09-15T23:19:11.270 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.270 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.270 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066295 s, 158 MB/s 2024-09-15T23:19:11.278 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.278 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.278 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064398 s, 163 MB/s 2024-09-15T23:19:11.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:11.285 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:11.285 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:11.285 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.18 2024-09-15T23:19:11.285 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:11.285 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:11.285 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:11.285 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:11.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:11.345 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.345 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.345 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734528 s, 143 MB/s 2024-09-15T23:19:11.352 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.353 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.353 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650171 s, 161 MB/s 2024-09-15T23:19:11.361 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.362 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.362 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732572 s, 143 MB/s 2024-09-15T23:19:11.370 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.370 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.370 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699446 s, 150 MB/s 2024-09-15T23:19:11.379 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.379 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.380 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729615 s, 144 MB/s 2024-09-15T23:19:11.389 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.389 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.389 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743881 s, 141 MB/s 2024-09-15T23:19:11.398 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.398 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.398 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758524 s, 138 MB/s 2024-09-15T23:19:11.408 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.408 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.408 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724282 s, 145 MB/s 2024-09-15T23:19:11.416 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.416 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.416 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668124 s, 157 MB/s 2024-09-15T23:19:11.424 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.424 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.424 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648558 s, 162 MB/s 2024-09-15T23:19:11.433 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.433 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.433 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667344 s, 157 MB/s 2024-09-15T23:19:11.441 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.441 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.441 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693134 s, 151 MB/s 2024-09-15T23:19:11.450 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.450 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.450 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615208 s, 170 MB/s 2024-09-15T23:19:11.458 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.458 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.458 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698362 s, 150 MB/s 2024-09-15T23:19:11.467 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.467 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.467 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667257 s, 157 MB/s 2024-09-15T23:19:11.474 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.474 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.474 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586226 s, 179 MB/s 2024-09-15T23:19:11.483 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.483 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.483 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741669 s, 141 MB/s 2024-09-15T23:19:11.491 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.491 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.491 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609657 s, 172 MB/s 2024-09-15T23:19:11.499 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.499 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.499 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678414 s, 155 MB/s 2024-09-15T23:19:11.508 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.508 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.508 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687164 s, 153 MB/s 2024-09-15T23:19:11.516 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.516 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.517 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071178 s, 147 MB/s 2024-09-15T23:19:11.524 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.525 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.525 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598025 s, 175 MB/s 2024-09-15T23:19:11.533 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.533 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.533 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006479 s, 162 MB/s 2024-09-15T23:19:11.541 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.541 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.541 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669426 s, 157 MB/s 2024-09-15T23:19:11.550 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.550 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.550 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065486 s, 160 MB/s 2024-09-15T23:19:11.557 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.557 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.557 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575714 s, 182 MB/s 2024-09-15T23:19:11.566 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.566 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.566 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651079 s, 161 MB/s 2024-09-15T23:19:11.574 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.574 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.574 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660362 s, 159 MB/s 2024-09-15T23:19:11.582 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.582 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.583 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065522 s, 160 MB/s 2024-09-15T23:19:11.590 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.591 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.591 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637778 s, 164 MB/s 2024-09-15T23:19:11.599 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.599 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.599 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651646 s, 161 MB/s 2024-09-15T23:19:11.608 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.608 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.608 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725645 s, 145 MB/s 2024-09-15T23:19:11.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:11.614 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:11.614 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:11.615 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.19 2024-09-15T23:19:11.615 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:11.615 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:11.615 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:11.615 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:11.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:11.674 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.674 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.674 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669348 s, 157 MB/s 2024-09-15T23:19:11.682 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.682 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.682 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643889 s, 163 MB/s 2024-09-15T23:19:11.690 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.690 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.690 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651214 s, 161 MB/s 2024-09-15T23:19:11.698 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.698 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.699 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678353 s, 155 MB/s 2024-09-15T23:19:11.707 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.707 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.707 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683891 s, 153 MB/s 2024-09-15T23:19:11.715 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.715 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.715 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579881 s, 181 MB/s 2024-09-15T23:19:11.724 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.724 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.724 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073108 s, 143 MB/s 2024-09-15T23:19:11.732 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.733 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.733 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696891 s, 150 MB/s 2024-09-15T23:19:11.740 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.740 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.740 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573771 s, 183 MB/s 2024-09-15T23:19:11.748 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.748 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.748 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059666 s, 176 MB/s 2024-09-15T23:19:11.756 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.756 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.756 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651778 s, 161 MB/s 2024-09-15T23:19:11.765 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.765 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.765 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707662 s, 148 MB/s 2024-09-15T23:19:11.773 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.773 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.773 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664222 s, 158 MB/s 2024-09-15T23:19:11.781 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.781 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.781 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663708 s, 158 MB/s 2024-09-15T23:19:11.789 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.789 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.789 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624834 s, 168 MB/s 2024-09-15T23:19:11.797 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.797 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.797 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634069 s, 165 MB/s 2024-09-15T23:19:11.805 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.805 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.805 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641508 s, 163 MB/s 2024-09-15T23:19:11.814 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.814 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.814 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725036 s, 145 MB/s 2024-09-15T23:19:11.822 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.822 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.822 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665443 s, 158 MB/s 2024-09-15T23:19:11.829 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.829 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.829 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00557208 s, 188 MB/s 2024-09-15T23:19:11.838 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.838 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.838 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657762 s, 159 MB/s 2024-09-15T23:19:11.847 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.847 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.848 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00783512 s, 134 MB/s 2024-09-15T23:19:11.856 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.856 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.857 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710138 s, 148 MB/s 2024-09-15T23:19:11.865 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.865 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.865 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662974 s, 158 MB/s 2024-09-15T23:19:11.873 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.873 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.873 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066857 s, 157 MB/s 2024-09-15T23:19:11.882 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.882 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.882 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683977 s, 153 MB/s 2024-09-15T23:19:11.890 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.890 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.890 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628739 s, 167 MB/s 2024-09-15T23:19:11.905 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.905 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.905 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139637 s, 75.1 MB/s 2024-09-15T23:19:11.913 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.913 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.913 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580754 s, 181 MB/s 2024-09-15T23:19:11.922 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.922 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.922 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717519 s, 146 MB/s 2024-09-15T23:19:11.930 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.930 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.930 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641273 s, 164 MB/s 2024-09-15T23:19:11.938 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:11.938 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:11.938 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606362 s, 173 MB/s 2024-09-15T23:19:11.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:11.944 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:11.945 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:11.945 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.20 2024-09-15T23:19:11.945 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:11.945 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:11.945 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:11.945 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:11.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:12.003 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.003 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.003 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641002 s, 164 MB/s 2024-09-15T23:19:12.011 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.011 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.011 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060958 s, 172 MB/s 2024-09-15T23:19:12.020 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.020 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.020 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684032 s, 153 MB/s 2024-09-15T23:19:12.028 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.028 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.029 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692073 s, 152 MB/s 2024-09-15T23:19:12.036 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.036 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.037 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628089 s, 167 MB/s 2024-09-15T23:19:12.045 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.045 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.045 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066624 s, 157 MB/s 2024-09-15T23:19:12.053 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.053 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.053 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658245 s, 159 MB/s 2024-09-15T23:19:12.061 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.061 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.061 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641966 s, 163 MB/s 2024-09-15T23:19:12.069 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.069 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.069 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634059 s, 165 MB/s 2024-09-15T23:19:12.077 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.077 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.077 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637638 s, 164 MB/s 2024-09-15T23:19:12.086 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.086 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.086 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677989 s, 155 MB/s 2024-09-15T23:19:12.093 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.093 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.093 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584935 s, 179 MB/s 2024-09-15T23:19:12.101 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.102 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.102 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629637 s, 167 MB/s 2024-09-15T23:19:12.111 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.111 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.111 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747878 s, 140 MB/s 2024-09-15T23:19:12.119 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.119 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.119 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667105 s, 157 MB/s 2024-09-15T23:19:12.128 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.128 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.128 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707027 s, 148 MB/s 2024-09-15T23:19:12.136 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.136 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.136 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632045 s, 166 MB/s 2024-09-15T23:19:12.144 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.144 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.144 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637234 s, 165 MB/s 2024-09-15T23:19:12.153 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.153 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.153 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669902 s, 157 MB/s 2024-09-15T23:19:12.161 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.161 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.161 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069545 s, 151 MB/s 2024-09-15T23:19:12.169 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.169 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.170 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668843 s, 157 MB/s 2024-09-15T23:19:12.177 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.177 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.178 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646483 s, 162 MB/s 2024-09-15T23:19:12.185 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.185 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.185 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629084 s, 167 MB/s 2024-09-15T23:19:12.193 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.194 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.194 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666122 s, 157 MB/s 2024-09-15T23:19:12.202 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.202 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.203 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737565 s, 142 MB/s 2024-09-15T23:19:12.210 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.210 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.210 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604379 s, 173 MB/s 2024-09-15T23:19:12.218 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.218 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.218 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643783 s, 163 MB/s 2024-09-15T23:19:12.226 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.226 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.226 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641246 s, 164 MB/s 2024-09-15T23:19:12.234 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.234 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.235 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644549 s, 163 MB/s 2024-09-15T23:19:12.243 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.244 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.244 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718134 s, 146 MB/s 2024-09-15T23:19:12.251 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.251 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.251 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604213 s, 174 MB/s 2024-09-15T23:19:12.260 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.260 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.260 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725227 s, 145 MB/s 2024-09-15T23:19:12.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:12.267 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:12.267 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:12.267 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.21 2024-09-15T23:19:12.267 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:12.267 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:12.267 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:12.267 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:12.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:12.325 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.325 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.325 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636348 s, 165 MB/s 2024-09-15T23:19:12.333 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.333 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.333 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629817 s, 166 MB/s 2024-09-15T23:19:12.342 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.342 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.342 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746735 s, 140 MB/s 2024-09-15T23:19:12.349 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.350 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.350 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588273 s, 178 MB/s 2024-09-15T23:19:12.358 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.358 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.358 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656717 s, 160 MB/s 2024-09-15T23:19:12.367 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.367 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.367 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709863 s, 148 MB/s 2024-09-15T23:19:12.374 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.375 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.375 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618092 s, 170 MB/s 2024-09-15T23:19:12.382 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.382 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.382 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00567205 s, 185 MB/s 2024-09-15T23:19:12.390 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.390 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.390 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576469 s, 182 MB/s 2024-09-15T23:19:12.398 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.398 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.398 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645311 s, 162 MB/s 2024-09-15T23:19:12.406 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.406 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.406 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063689 s, 165 MB/s 2024-09-15T23:19:12.414 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.414 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.414 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643412 s, 163 MB/s 2024-09-15T23:19:12.423 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.423 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.423 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641616 s, 163 MB/s 2024-09-15T23:19:12.430 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.430 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.430 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568604 s, 184 MB/s 2024-09-15T23:19:12.438 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.438 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.438 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576258 s, 182 MB/s 2024-09-15T23:19:12.445 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.445 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.445 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566507 s, 185 MB/s 2024-09-15T23:19:12.453 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.453 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.453 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064389 s, 163 MB/s 2024-09-15T23:19:12.462 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.462 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.463 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727115 s, 144 MB/s 2024-09-15T23:19:12.471 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.471 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.471 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663521 s, 158 MB/s 2024-09-15T23:19:12.479 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.479 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.479 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674629 s, 155 MB/s 2024-09-15T23:19:12.487 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.487 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.487 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645387 s, 162 MB/s 2024-09-15T23:19:12.494 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.495 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.495 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577366 s, 182 MB/s 2024-09-15T23:19:12.502 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.502 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.502 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576561 s, 182 MB/s 2024-09-15T23:19:12.510 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.510 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.510 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586034 s, 179 MB/s 2024-09-15T23:19:12.518 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.518 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.518 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651729 s, 161 MB/s 2024-09-15T23:19:12.526 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.526 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.526 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593858 s, 177 MB/s 2024-09-15T23:19:12.533 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.533 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.534 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593481 s, 177 MB/s 2024-09-15T23:19:12.541 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.541 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.541 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00560836 s, 187 MB/s 2024-09-15T23:19:12.550 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.550 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.550 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708343 s, 148 MB/s 2024-09-15T23:19:12.558 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.558 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.558 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646695 s, 162 MB/s 2024-09-15T23:19:12.566 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.566 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.566 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676851 s, 155 MB/s 2024-09-15T23:19:12.574 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.574 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.574 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598374 s, 175 MB/s 2024-09-15T23:19:12.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:12.581 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:12.581 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:12.581 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.22 2024-09-15T23:19:12.581 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:12.581 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:12.581 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:12.581 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:12.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:12.639 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.639 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.639 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607382 s, 173 MB/s 2024-09-15T23:19:12.647 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.647 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.647 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628876 s, 167 MB/s 2024-09-15T23:19:12.655 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.655 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.655 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641725 s, 163 MB/s 2024-09-15T23:19:12.662 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.662 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.662 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565265 s, 186 MB/s 2024-09-15T23:19:12.670 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.670 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.670 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615939 s, 170 MB/s 2024-09-15T23:19:12.678 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.679 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.679 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673932 s, 156 MB/s 2024-09-15T23:19:12.686 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.687 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.687 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632102 s, 166 MB/s 2024-09-15T23:19:12.695 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.695 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.695 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652609 s, 161 MB/s 2024-09-15T23:19:12.702 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.702 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.703 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579154 s, 181 MB/s 2024-09-15T23:19:12.712 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.712 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.712 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729885 s, 144 MB/s 2024-09-15T23:19:12.719 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.719 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.719 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563008 s, 186 MB/s 2024-09-15T23:19:12.727 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.727 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.727 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639889 s, 164 MB/s 2024-09-15T23:19:12.735 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.735 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.735 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666263 s, 157 MB/s 2024-09-15T23:19:12.744 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.745 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.745 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738678 s, 142 MB/s 2024-09-15T23:19:12.752 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.753 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.753 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632051 s, 166 MB/s 2024-09-15T23:19:12.761 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.761 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.761 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665175 s, 158 MB/s 2024-09-15T23:19:12.769 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.769 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.769 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704416 s, 149 MB/s 2024-09-15T23:19:12.777 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.777 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.777 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624052 s, 168 MB/s 2024-09-15T23:19:12.785 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.785 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.785 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058344 s, 180 MB/s 2024-09-15T23:19:12.793 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.793 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.793 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623626 s, 168 MB/s 2024-09-15T23:19:12.802 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.802 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.802 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770733 s, 136 MB/s 2024-09-15T23:19:12.810 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.810 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.810 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064398 s, 163 MB/s 2024-09-15T23:19:12.818 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.818 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.818 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630686 s, 166 MB/s 2024-09-15T23:19:12.827 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.827 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.827 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007276 s, 144 MB/s 2024-09-15T23:19:12.836 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.836 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.836 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704579 s, 149 MB/s 2024-09-15T23:19:12.844 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.844 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.844 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626524 s, 167 MB/s 2024-09-15T23:19:12.853 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.853 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.853 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655834 s, 160 MB/s 2024-09-15T23:19:12.861 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.861 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.861 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649473 s, 161 MB/s 2024-09-15T23:19:12.869 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.869 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.869 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652392 s, 161 MB/s 2024-09-15T23:19:12.878 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.878 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.878 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742519 s, 141 MB/s 2024-09-15T23:19:12.887 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.887 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.887 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639809 s, 164 MB/s 2024-09-15T23:19:12.896 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.896 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.896 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744682 s, 141 MB/s 2024-09-15T23:19:12.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:12.903 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:12.903 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:12.903 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.23 2024-09-15T23:19:12.903 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:12.903 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:12.903 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:12.903 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:12.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:12.962 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.962 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.962 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660332 s, 159 MB/s 2024-09-15T23:19:12.969 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.970 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.970 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581172 s, 180 MB/s 2024-09-15T23:19:12.978 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.978 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.978 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610055 s, 172 MB/s 2024-09-15T23:19:12.987 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.987 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.987 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742876 s, 141 MB/s 2024-09-15T23:19:12.994 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:12.994 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:12.994 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589901 s, 178 MB/s 2024-09-15T23:19:13.002 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.002 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.002 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612293 s, 171 MB/s 2024-09-15T23:19:13.011 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.011 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.011 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728941 s, 144 MB/s 2024-09-15T23:19:13.019 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.020 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.020 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651953 s, 161 MB/s 2024-09-15T23:19:13.029 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.029 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.029 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750919 s, 140 MB/s 2024-09-15T23:19:13.036 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.036 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.036 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573057 s, 183 MB/s 2024-09-15T23:19:13.044 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.044 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.044 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061463 s, 171 MB/s 2024-09-15T23:19:13.052 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.052 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.053 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065842 s, 159 MB/s 2024-09-15T23:19:13.061 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.062 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.062 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733401 s, 143 MB/s 2024-09-15T23:19:13.069 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.069 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.069 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564872 s, 186 MB/s 2024-09-15T23:19:13.077 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.077 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.077 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065787 s, 159 MB/s 2024-09-15T23:19:13.085 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.085 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.085 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594627 s, 176 MB/s 2024-09-15T23:19:13.093 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.093 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.093 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595157 s, 176 MB/s 2024-09-15T23:19:13.101 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.102 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.102 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642409 s, 163 MB/s 2024-09-15T23:19:13.110 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.110 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.110 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687176 s, 153 MB/s 2024-09-15T23:19:13.118 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.118 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.118 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660241 s, 159 MB/s 2024-09-15T23:19:13.127 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.127 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.127 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694168 s, 151 MB/s 2024-09-15T23:19:13.136 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.136 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.136 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715531 s, 147 MB/s 2024-09-15T23:19:13.144 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.144 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.144 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643844 s, 163 MB/s 2024-09-15T23:19:13.151 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.151 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.151 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00562635 s, 186 MB/s 2024-09-15T23:19:13.159 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.159 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.159 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653416 s, 160 MB/s 2024-09-15T23:19:13.168 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.168 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.168 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707846 s, 148 MB/s 2024-09-15T23:19:13.176 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.176 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.177 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666435 s, 157 MB/s 2024-09-15T23:19:13.185 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.185 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.185 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616902 s, 170 MB/s 2024-09-15T23:19:13.193 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.193 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.193 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666224 s, 157 MB/s 2024-09-15T23:19:13.202 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.202 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.202 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726514 s, 144 MB/s 2024-09-15T23:19:13.211 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.211 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.211 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658314 s, 159 MB/s 2024-09-15T23:19:13.218 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.218 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.219 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635713 s, 165 MB/s 2024-09-15T23:19:13.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:13.225 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:13.225 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:13.225 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.24 2024-09-15T23:19:13.225 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:13.225 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:13.225 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:13.225 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:13.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:13.284 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.285 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.285 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717029 s, 146 MB/s 2024-09-15T23:19:13.293 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.293 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.293 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672189 s, 156 MB/s 2024-09-15T23:19:13.301 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.301 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.301 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619875 s, 169 MB/s 2024-09-15T23:19:13.310 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.310 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.310 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739779 s, 142 MB/s 2024-09-15T23:19:13.318 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.318 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.318 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657079 s, 160 MB/s 2024-09-15T23:19:13.326 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.326 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.326 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062099 s, 169 MB/s 2024-09-15T23:19:13.333 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.333 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.334 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572123 s, 183 MB/s 2024-09-15T23:19:13.342 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.342 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.342 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650913 s, 161 MB/s 2024-09-15T23:19:13.350 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.350 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.350 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641032 s, 164 MB/s 2024-09-15T23:19:13.359 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.359 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.360 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717139 s, 146 MB/s 2024-09-15T23:19:13.367 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.367 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.367 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630223 s, 166 MB/s 2024-09-15T23:19:13.376 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.376 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.377 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734248 s, 143 MB/s 2024-09-15T23:19:13.385 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.386 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.386 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707168 s, 148 MB/s 2024-09-15T23:19:13.394 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.394 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.394 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667399 s, 157 MB/s 2024-09-15T23:19:13.402 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.402 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.402 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658168 s, 159 MB/s 2024-09-15T23:19:13.410 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.410 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.410 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631065 s, 166 MB/s 2024-09-15T23:19:13.418 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.418 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.418 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064981 s, 161 MB/s 2024-09-15T23:19:13.426 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.426 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.426 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595416 s, 176 MB/s 2024-09-15T23:19:13.434 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.434 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.435 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687401 s, 153 MB/s 2024-09-15T23:19:13.442 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.442 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.442 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574657 s, 182 MB/s 2024-09-15T23:19:13.452 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.452 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.452 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00874701 s, 120 MB/s 2024-09-15T23:19:13.460 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.460 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.461 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651054 s, 161 MB/s 2024-09-15T23:19:13.468 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.468 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.469 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643059 s, 163 MB/s 2024-09-15T23:19:13.476 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.477 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.477 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640531 s, 164 MB/s 2024-09-15T23:19:13.485 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.485 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.485 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072459 s, 145 MB/s 2024-09-15T23:19:13.493 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.493 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.493 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604217 s, 174 MB/s 2024-09-15T23:19:13.501 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.501 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.501 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657278 s, 160 MB/s 2024-09-15T23:19:13.512 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.512 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.512 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645654 s, 162 MB/s 2024-09-15T23:19:13.517 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.517 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.517 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00555941 s, 189 MB/s 2024-09-15T23:19:13.525 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.525 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.525 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652501 s, 161 MB/s 2024-09-15T23:19:13.533 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.533 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.533 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589928 s, 178 MB/s 2024-09-15T23:19:13.541 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.541 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.541 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642289 s, 163 MB/s 2024-09-15T23:19:13.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:13.548 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:13.548 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:13.549 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.25 2024-09-15T23:19:13.549 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:13.549 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:13.549 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:13.549 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:13.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:13.607 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.607 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.608 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661016 s, 159 MB/s 2024-09-15T23:19:13.615 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.615 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.615 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568376 s, 184 MB/s 2024-09-15T23:19:13.623 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.623 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.624 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686957 s, 153 MB/s 2024-09-15T23:19:13.631 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.632 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.632 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635007 s, 165 MB/s 2024-09-15T23:19:13.641 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.641 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.641 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739031 s, 142 MB/s 2024-09-15T23:19:13.649 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.649 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.649 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631682 s, 166 MB/s 2024-09-15T23:19:13.657 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.657 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.657 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644972 s, 163 MB/s 2024-09-15T23:19:13.665 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.665 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.665 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652762 s, 161 MB/s 2024-09-15T23:19:13.674 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.674 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.674 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651604 s, 161 MB/s 2024-09-15T23:19:13.682 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.682 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.682 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065262 s, 161 MB/s 2024-09-15T23:19:13.691 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.691 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.691 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752659 s, 139 MB/s 2024-09-15T23:19:13.700 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.700 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.700 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659714 s, 159 MB/s 2024-09-15T23:19:13.708 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.708 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.708 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659103 s, 159 MB/s 2024-09-15T23:19:13.716 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.716 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.716 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00567411 s, 185 MB/s 2024-09-15T23:19:13.723 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.723 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.724 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620086 s, 169 MB/s 2024-09-15T23:19:13.731 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.731 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.731 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569225 s, 184 MB/s 2024-09-15T23:19:13.740 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.740 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.740 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734582 s, 143 MB/s 2024-09-15T23:19:13.749 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.749 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.749 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666707 s, 157 MB/s 2024-09-15T23:19:13.758 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.758 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.758 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736935 s, 142 MB/s 2024-09-15T23:19:13.766 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.766 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.766 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694024 s, 151 MB/s 2024-09-15T23:19:13.775 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.776 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.776 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752704 s, 139 MB/s 2024-09-15T23:19:13.784 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.785 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.785 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730006 s, 144 MB/s 2024-09-15T23:19:13.793 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.794 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.794 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672462 s, 156 MB/s 2024-09-15T23:19:13.801 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.802 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.802 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651452 s, 161 MB/s 2024-09-15T23:19:13.809 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.809 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.810 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625824 s, 168 MB/s 2024-09-15T23:19:13.817 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.818 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.818 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064132 s, 164 MB/s 2024-09-15T23:19:13.826 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.826 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.826 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606611 s, 173 MB/s 2024-09-15T23:19:13.833 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.833 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.833 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584478 s, 179 MB/s 2024-09-15T23:19:13.841 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.841 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.841 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566763 s, 185 MB/s 2024-09-15T23:19:13.849 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.849 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.849 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672282 s, 156 MB/s 2024-09-15T23:19:13.857 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.857 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.857 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636477 s, 165 MB/s 2024-09-15T23:19:13.865 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.865 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.865 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654487 s, 160 MB/s 2024-09-15T23:19:13.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:13.872 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:13.872 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:13.872 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.26 2024-09-15T23:19:13.872 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:13.872 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:13.872 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:13.872 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:13.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:13.931 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.931 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.931 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615501 s, 170 MB/s 2024-09-15T23:19:13.938 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.939 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.939 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617521 s, 170 MB/s 2024-09-15T23:19:13.946 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.946 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.946 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634278 s, 165 MB/s 2024-09-15T23:19:13.954 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.955 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.955 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666357 s, 157 MB/s 2024-09-15T23:19:13.963 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.963 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.963 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676511 s, 155 MB/s 2024-09-15T23:19:13.971 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.971 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.972 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668793 s, 157 MB/s 2024-09-15T23:19:13.979 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.979 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.979 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572638 s, 183 MB/s 2024-09-15T23:19:13.987 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.987 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.987 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632481 s, 166 MB/s 2024-09-15T23:19:13.995 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:13.995 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:13.996 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704762 s, 149 MB/s 2024-09-15T23:19:14.005 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.005 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.005 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739193 s, 142 MB/s 2024-09-15T23:19:14.014 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.014 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.014 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074301 s, 141 MB/s 2024-09-15T23:19:14.023 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.023 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.023 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750507 s, 140 MB/s 2024-09-15T23:19:14.031 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.031 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.031 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590384 s, 178 MB/s 2024-09-15T23:19:14.041 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.041 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.041 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751372 s, 140 MB/s 2024-09-15T23:19:14.049 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.050 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.050 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072618 s, 144 MB/s 2024-09-15T23:19:14.058 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.058 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.058 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599826 s, 175 MB/s 2024-09-15T23:19:14.066 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.067 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.067 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703072 s, 149 MB/s 2024-09-15T23:19:14.074 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.074 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.074 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058257 s, 180 MB/s 2024-09-15T23:19:14.082 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.082 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.083 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059216 s, 177 MB/s 2024-09-15T23:19:14.091 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.091 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.091 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067084 s, 156 MB/s 2024-09-15T23:19:14.099 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.099 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.099 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645667 s, 162 MB/s 2024-09-15T23:19:14.108 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.108 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.108 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747117 s, 140 MB/s 2024-09-15T23:19:14.116 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.116 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.117 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652979 s, 161 MB/s 2024-09-15T23:19:14.124 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.124 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.124 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597549 s, 175 MB/s 2024-09-15T23:19:14.133 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.133 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.133 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725958 s, 144 MB/s 2024-09-15T23:19:14.142 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.142 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.142 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720885 s, 145 MB/s 2024-09-15T23:19:14.150 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.150 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.150 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575762 s, 182 MB/s 2024-09-15T23:19:14.157 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.157 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.157 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057572 s, 182 MB/s 2024-09-15T23:19:14.165 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.165 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.166 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064888 s, 162 MB/s 2024-09-15T23:19:14.174 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.174 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.174 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670241 s, 156 MB/s 2024-09-15T23:19:14.182 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.182 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.182 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643534 s, 163 MB/s 2024-09-15T23:19:14.191 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.191 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.191 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654794 s, 160 MB/s 2024-09-15T23:19:14.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:14.198 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:14.198 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:14.198 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.27 2024-09-15T23:19:14.198 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:14.198 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:14.198 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:14.198 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:14.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:14.255 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.256 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.256 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590167 s, 178 MB/s 2024-09-15T23:19:14.263 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.264 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.264 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633877 s, 165 MB/s 2024-09-15T23:19:14.272 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.272 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.272 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668101 s, 157 MB/s 2024-09-15T23:19:14.279 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.280 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.280 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596464 s, 176 MB/s 2024-09-15T23:19:14.287 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.287 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.287 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058655 s, 179 MB/s 2024-09-15T23:19:14.296 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.296 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.297 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745746 s, 141 MB/s 2024-09-15T23:19:14.305 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.305 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.305 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660718 s, 159 MB/s 2024-09-15T23:19:14.313 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.313 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.313 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658717 s, 159 MB/s 2024-09-15T23:19:14.321 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.321 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.321 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660997 s, 159 MB/s 2024-09-15T23:19:14.330 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.330 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.331 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736653 s, 142 MB/s 2024-09-15T23:19:14.339 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.339 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.339 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064199 s, 163 MB/s 2024-09-15T23:19:14.346 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.346 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.346 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594404 s, 176 MB/s 2024-09-15T23:19:14.355 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.355 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.355 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727293 s, 144 MB/s 2024-09-15T23:19:14.364 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.365 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.365 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073999 s, 142 MB/s 2024-09-15T23:19:14.373 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.373 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.373 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678953 s, 154 MB/s 2024-09-15T23:19:14.382 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.382 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.382 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071511 s, 147 MB/s 2024-09-15T23:19:14.390 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.390 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.390 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626936 s, 167 MB/s 2024-09-15T23:19:14.398 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.398 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.398 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643579 s, 163 MB/s 2024-09-15T23:19:14.407 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.407 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.407 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741697 s, 141 MB/s 2024-09-15T23:19:14.415 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.415 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.415 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591778 s, 177 MB/s 2024-09-15T23:19:14.424 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.424 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.424 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667234 s, 157 MB/s 2024-09-15T23:19:14.432 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.432 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.432 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636322 s, 165 MB/s 2024-09-15T23:19:14.441 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.441 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.441 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00769761 s, 136 MB/s 2024-09-15T23:19:14.451 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.451 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.451 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748621 s, 140 MB/s 2024-09-15T23:19:14.458 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.458 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.458 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589156 s, 178 MB/s 2024-09-15T23:19:14.468 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.468 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.468 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703793 s, 149 MB/s 2024-09-15T23:19:14.475 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.475 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.475 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594066 s, 177 MB/s 2024-09-15T23:19:14.484 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.484 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.485 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728287 s, 144 MB/s 2024-09-15T23:19:14.493 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.493 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.493 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717841 s, 146 MB/s 2024-09-15T23:19:14.501 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.501 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.501 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642078 s, 163 MB/s 2024-09-15T23:19:14.509 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.509 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.509 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587346 s, 179 MB/s 2024-09-15T23:19:14.517 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.517 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.517 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598584 s, 175 MB/s 2024-09-15T23:19:14.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:14.523 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:14.524 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:14.524 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.28 2024-09-15T23:19:14.524 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:14.524 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:14.524 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:14.524 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:14.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:14.581 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.581 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.582 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589006 s, 178 MB/s 2024-09-15T23:19:14.590 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.590 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.590 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667347 s, 157 MB/s 2024-09-15T23:19:14.598 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.598 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.598 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064177 s, 163 MB/s 2024-09-15T23:19:14.606 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.607 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.607 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648682 s, 162 MB/s 2024-09-15T23:19:14.614 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.614 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.614 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568501 s, 184 MB/s 2024-09-15T23:19:14.621 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.622 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.622 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565542 s, 185 MB/s 2024-09-15T23:19:14.629 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.630 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.630 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635936 s, 165 MB/s 2024-09-15T23:19:14.638 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.638 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.638 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713656 s, 147 MB/s 2024-09-15T23:19:14.646 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.646 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.647 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632155 s, 166 MB/s 2024-09-15T23:19:14.654 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.654 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.654 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574239 s, 183 MB/s 2024-09-15T23:19:14.662 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.662 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.662 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006407 s, 164 MB/s 2024-09-15T23:19:14.670 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.670 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.670 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061947 s, 169 MB/s 2024-09-15T23:19:14.679 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.679 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.679 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737407 s, 142 MB/s 2024-09-15T23:19:14.687 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.687 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.687 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657976 s, 159 MB/s 2024-09-15T23:19:14.696 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.696 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.696 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722469 s, 145 MB/s 2024-09-15T23:19:14.704 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.704 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.704 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637313 s, 165 MB/s 2024-09-15T23:19:14.713 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.713 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.713 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661488 s, 159 MB/s 2024-09-15T23:19:14.721 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.722 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.722 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674112 s, 156 MB/s 2024-09-15T23:19:14.730 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.730 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.730 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639341 s, 164 MB/s 2024-09-15T23:19:14.740 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.740 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.740 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765349 s, 137 MB/s 2024-09-15T23:19:14.748 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.748 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.748 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709305 s, 148 MB/s 2024-09-15T23:19:14.757 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.757 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.757 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724746 s, 145 MB/s 2024-09-15T23:19:14.765 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.765 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.765 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597202 s, 176 MB/s 2024-09-15T23:19:14.774 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.774 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.774 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708478 s, 148 MB/s 2024-09-15T23:19:14.782 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.782 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.782 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619962 s, 169 MB/s 2024-09-15T23:19:14.790 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.790 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.790 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624132 s, 168 MB/s 2024-09-15T23:19:14.798 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.798 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.798 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646748 s, 162 MB/s 2024-09-15T23:19:14.806 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.806 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.806 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642435 s, 163 MB/s 2024-09-15T23:19:14.814 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.815 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.815 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643156 s, 163 MB/s 2024-09-15T23:19:14.822 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.822 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.822 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00555185 s, 189 MB/s 2024-09-15T23:19:14.830 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.831 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.831 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638358 s, 164 MB/s 2024-09-15T23:19:14.838 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.838 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.838 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574772 s, 182 MB/s 2024-09-15T23:19:14.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:14.844 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:14.844 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:14.845 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.29 2024-09-15T23:19:14.845 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:14.845 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:14.845 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:14.845 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:14.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:14.904 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.904 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.904 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733754 s, 143 MB/s 2024-09-15T23:19:14.912 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.912 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.912 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657683 s, 159 MB/s 2024-09-15T23:19:14.920 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.920 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.920 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601064 s, 174 MB/s 2024-09-15T23:19:14.928 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.928 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.928 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626101 s, 167 MB/s 2024-09-15T23:19:14.937 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.937 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.937 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668286 s, 157 MB/s 2024-09-15T23:19:14.944 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.944 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.944 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632367 s, 166 MB/s 2024-09-15T23:19:14.952 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.953 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.953 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647683 s, 162 MB/s 2024-09-15T23:19:14.961 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.961 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.961 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645034 s, 163 MB/s 2024-09-15T23:19:14.970 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.970 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.970 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739464 s, 142 MB/s 2024-09-15T23:19:14.977 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.978 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.978 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603317 s, 174 MB/s 2024-09-15T23:19:14.986 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.986 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.986 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709889 s, 148 MB/s 2024-09-15T23:19:14.994 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:14.994 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:14.994 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598543 s, 175 MB/s 2024-09-15T23:19:15.002 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.002 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.002 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643091 s, 163 MB/s 2024-09-15T23:19:15.010 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.010 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.010 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623581 s, 168 MB/s 2024-09-15T23:19:15.017 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.018 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.018 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579325 s, 181 MB/s 2024-09-15T23:19:15.026 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.026 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.026 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670544 s, 156 MB/s 2024-09-15T23:19:15.034 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.034 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.034 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657895 s, 159 MB/s 2024-09-15T23:19:15.043 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.044 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.044 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074546 s, 141 MB/s 2024-09-15T23:19:15.052 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.052 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.052 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656575 s, 160 MB/s 2024-09-15T23:19:15.059 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.059 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.059 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563558 s, 186 MB/s 2024-09-15T23:19:15.067 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.067 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.068 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652226 s, 161 MB/s 2024-09-15T23:19:15.075 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.075 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.075 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057962 s, 181 MB/s 2024-09-15T23:19:15.083 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.083 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.083 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647136 s, 162 MB/s 2024-09-15T23:19:15.091 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.091 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.091 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649611 s, 161 MB/s 2024-09-15T23:19:15.100 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.100 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.101 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744992 s, 141 MB/s 2024-09-15T23:19:15.109 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.109 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.109 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688439 s, 152 MB/s 2024-09-15T23:19:15.117 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.117 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.117 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638852 s, 164 MB/s 2024-09-15T23:19:15.125 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.125 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.125 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629104 s, 167 MB/s 2024-09-15T23:19:15.133 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.133 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.133 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627959 s, 167 MB/s 2024-09-15T23:19:15.141 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.141 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.141 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629298 s, 167 MB/s 2024-09-15T23:19:15.149 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.149 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.149 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629945 s, 166 MB/s 2024-09-15T23:19:15.157 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.158 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.158 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661094 s, 159 MB/s 2024-09-15T23:19:15.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:15.164 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:15.164 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:15.164 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.30 2024-09-15T23:19:15.164 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:15.165 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:15.165 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:15.165 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:15.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:15.223 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.223 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.223 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589446 s, 178 MB/s 2024-09-15T23:19:15.230 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.230 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.230 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575901 s, 182 MB/s 2024-09-15T23:19:15.239 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.239 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.239 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740605 s, 142 MB/s 2024-09-15T23:19:15.247 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.248 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.248 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649934 s, 161 MB/s 2024-09-15T23:19:15.256 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.256 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.256 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666083 s, 157 MB/s 2024-09-15T23:19:15.263 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.263 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.263 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577675 s, 182 MB/s 2024-09-15T23:19:15.271 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.271 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.271 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594197 s, 176 MB/s 2024-09-15T23:19:15.278 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.278 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.278 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573162 s, 183 MB/s 2024-09-15T23:19:15.286 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.286 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.286 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569961 s, 184 MB/s 2024-09-15T23:19:15.294 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.295 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.295 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717866 s, 146 MB/s 2024-09-15T23:19:15.303 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.303 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.303 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639772 s, 164 MB/s 2024-09-15T23:19:15.312 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.312 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.312 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749581 s, 140 MB/s 2024-09-15T23:19:15.320 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.320 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.320 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637169 s, 165 MB/s 2024-09-15T23:19:15.329 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.329 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.329 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071772 s, 146 MB/s 2024-09-15T23:19:15.337 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.337 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.337 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582223 s, 180 MB/s 2024-09-15T23:19:15.346 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.346 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.346 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700427 s, 150 MB/s 2024-09-15T23:19:15.354 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.354 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.354 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667296 s, 157 MB/s 2024-09-15T23:19:15.362 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.362 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.362 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636585 s, 165 MB/s 2024-09-15T23:19:15.370 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.370 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.370 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644522 s, 163 MB/s 2024-09-15T23:19:15.379 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.379 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.379 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689658 s, 152 MB/s 2024-09-15T23:19:15.387 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.388 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.388 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658648 s, 159 MB/s 2024-09-15T23:19:15.395 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.395 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.395 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593224 s, 177 MB/s 2024-09-15T23:19:15.403 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.403 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.403 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644097 s, 163 MB/s 2024-09-15T23:19:15.411 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.411 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.411 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669009 s, 157 MB/s 2024-09-15T23:19:15.419 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.419 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.419 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631964 s, 166 MB/s 2024-09-15T23:19:15.428 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.428 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.428 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733486 s, 143 MB/s 2024-09-15T23:19:15.436 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.436 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.437 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063525 s, 165 MB/s 2024-09-15T23:19:15.445 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.445 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.445 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718362 s, 146 MB/s 2024-09-15T23:19:15.454 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.454 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.454 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696395 s, 151 MB/s 2024-09-15T23:19:15.462 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.463 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.463 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656182 s, 160 MB/s 2024-09-15T23:19:15.472 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.472 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.472 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762881 s, 137 MB/s 2024-09-15T23:19:15.479 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.479 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.479 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595278 s, 176 MB/s 2024-09-15T23:19:15.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:15.486 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:15.486 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:15.486 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.31 2024-09-15T23:19:15.486 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:15.486 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:15.487 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:15.487 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:15.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:15.545 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.545 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.545 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656138 s, 160 MB/s 2024-09-15T23:19:15.556 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.556 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.556 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060021 s, 175 MB/s 2024-09-15T23:19:15.561 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.561 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.561 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062088 s, 169 MB/s 2024-09-15T23:19:15.569 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.569 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.569 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062855 s, 167 MB/s 2024-09-15T23:19:15.578 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.578 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.578 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726932 s, 144 MB/s 2024-09-15T23:19:15.587 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.587 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.587 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066963 s, 157 MB/s 2024-09-15T23:19:15.595 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.595 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.595 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655992 s, 160 MB/s 2024-09-15T23:19:15.602 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.603 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.603 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584406 s, 179 MB/s 2024-09-15T23:19:15.611 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.611 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.611 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659059 s, 159 MB/s 2024-09-15T23:19:15.619 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.619 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.619 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579941 s, 181 MB/s 2024-09-15T23:19:15.627 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.627 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.627 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647879 s, 162 MB/s 2024-09-15T23:19:15.636 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.636 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.636 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640783 s, 164 MB/s 2024-09-15T23:19:15.643 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.643 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.643 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065917 s, 159 MB/s 2024-09-15T23:19:15.650 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.651 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.651 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577563 s, 182 MB/s 2024-09-15T23:19:15.659 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.659 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.659 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678011 s, 155 MB/s 2024-09-15T23:19:15.667 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.667 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.667 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622784 s, 168 MB/s 2024-09-15T23:19:15.675 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.675 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.675 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625571 s, 168 MB/s 2024-09-15T23:19:15.683 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.683 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.683 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643583 s, 163 MB/s 2024-09-15T23:19:15.692 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.692 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.692 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667741 s, 157 MB/s 2024-09-15T23:19:15.699 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.699 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.699 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571303 s, 184 MB/s 2024-09-15T23:19:15.708 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.708 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.708 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685342 s, 153 MB/s 2024-09-15T23:19:15.716 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.716 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.716 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641963 s, 163 MB/s 2024-09-15T23:19:15.723 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.723 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.723 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00556349 s, 188 MB/s 2024-09-15T23:19:15.732 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.732 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.732 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643193 s, 163 MB/s 2024-09-15T23:19:15.740 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.740 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.740 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677979 s, 155 MB/s 2024-09-15T23:19:15.748 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.748 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.748 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647103 s, 162 MB/s 2024-09-15T23:19:15.757 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.757 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.757 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007132 s, 147 MB/s 2024-09-15T23:19:15.765 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.765 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.765 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636994 s, 165 MB/s 2024-09-15T23:19:15.773 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.773 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.774 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644141 s, 163 MB/s 2024-09-15T23:19:15.782 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.782 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.782 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685245 s, 153 MB/s 2024-09-15T23:19:15.790 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.790 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.790 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621369 s, 169 MB/s 2024-09-15T23:19:15.799 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:15.799 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:15.799 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715875 s, 146 MB/s 2024-09-15T23:19:15.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:15.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:19:15.805 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub start /scrub_control_test_path recursive 2024-09-15T23:19:15.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.906+0000 7fdf989b9640 1 Processor -- start 2024-09-15T23:19:15.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.906+0000 7fdf989b9640 1 -- start start 2024-09-15T23:19:15.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.907+0000 7fdf989b9640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fdf940d40b0 0x7fdf940d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:15.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.907+0000 7fdf989b9640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf940cf060 con 0x7fdf940d16e0 2024-09-15T23:19:15.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.907+0000 7fdf989b9640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf940cf340 con 0x7fdf9415ea90 2024-09-15T23:19:15.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.907+0000 7fdf989b9640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fdf940d34c0 con 0x7fdf940d40b0 2024-09-15T23:19:15.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.907+0000 7fdf89d9b640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fdf940d16e0 0x7fdf940b7ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51138/0 (socket says 172.21.15.123:51138) 2024-09-15T23:19:15.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.907+0000 7fdf89d9b640 1 -- 172.21.15.123:0/3011891086 learned_addr learned my addr 172.21.15.123:0/3011891086 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:19:15.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.908+0000 7fdf91d9b640 1 -- 172.21.15.123:0/3011891086 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3322132209 0 0) 0x7fdf940cf060 con 0x7fdf940d16e0 2024-09-15T23:19:15.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.908+0000 7fdf91d9b640 1 -- 172.21.15.123:0/3011891086 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf80003520 con 0x7fdf940d16e0 2024-09-15T23:19:15.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.908+0000 7fdf92d9d640 1 --2- 172.21.15.123:0/3011891086 >> v2:172.21.15.188:3300/0 conn(0x7fdf940d40b0 0x7fdf940d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:15.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.908+0000 7fdf91d9b640 1 -- 172.21.15.123:0/3011891086 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 358183569 0 0) 0x7fdf80003520 con 0x7fdf940d16e0 2024-09-15T23:19:15.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.908+0000 7fdf91d9b640 1 -- 172.21.15.123:0/3011891086 >> v2:172.21.15.188:3300/0 conn(0x7fdf940d40b0 msgr2=0x7fdf940d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:15.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.908+0000 7fdf91d9b640 1 --2- 172.21.15.123:0/3011891086 >> v2:172.21.15.188:3300/0 conn(0x7fdf940d40b0 0x7fdf940d2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:15.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.908+0000 7fdf91d9b640 1 -- 172.21.15.123:0/3011891086 >> v1:172.21.15.188:6789/0 conn(0x7fdf9415ea90 legacy=0x7fdf940d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:15.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.908+0000 7fdf91d9b640 1 -- 172.21.15.123:0/3011891086 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf940cf620 con 0x7fdf940d16e0 2024-09-15T23:19:15.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.908+0000 7fdf91d9b640 1 -- 172.21.15.123:0/3011891086 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fdf7c001670 con 0x7fdf940d16e0 2024-09-15T23:19:15.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.908+0000 7fdf91d9b640 1 -- 172.21.15.123:0/3011891086 >> v1:172.21.15.123:6789/0 conn(0x7fdf940d16e0 legacy=0x7fdf940b7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:15.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.908+0000 7fdf91d9b640 1 --2- 172.21.15.123:0/3011891086 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdf800039b0 0x7fdf80003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:15.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.908+0000 7fdf91d9b640 1 --2- 172.21.15.123:0/3011891086 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdf80004800 0x7fdf80004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:15.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.908+0000 7fdf91d9b640 1 --2- 172.21.15.123:0/3011891086 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf800052e0 0x7fdf8000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:15.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.908+0000 7fdf91d9b640 1 -- 172.21.15.123:0/3011891086 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdf940d34c0 con 0x7fdf800052e0 2024-09-15T23:19:15.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.908+0000 7fdf91d9b640 1 -- 172.21.15.123:0/3011891086 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fdf8000c1b0 con 0x7fdf800039b0 2024-09-15T23:19:15.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.908+0000 7fdf91d9b640 1 -- 172.21.15.123:0/3011891086 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fdf8000c3b0 con 0x7fdf80004800 2024-09-15T23:19:15.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.908+0000 7fdf92d9d640 1 --2- 172.21.15.123:0/3011891086 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf800052e0 0x7fdf8000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:15.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.908+0000 7fdf9259c640 1 --2- 172.21.15.123:0/3011891086 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdf800039b0 0x7fdf80003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:15.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.908+0000 7fdf89d9b640 1 --2- 172.21.15.123:0/3011891086 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdf80004800 0x7fdf80004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:15.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.908+0000 7fdf92d9d640 1 -- 172.21.15.123:0/3011891086 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdf80004800 msgr2=0x7fdf80004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:15.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.908+0000 7fdf92d9d640 1 --2- 172.21.15.123:0/3011891086 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdf80004800 0x7fdf80004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:15.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.908+0000 7fdf92d9d640 1 -- 172.21.15.123:0/3011891086 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdf800039b0 msgr2=0x7fdf80003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:15.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.908+0000 7fdf92d9d640 1 --2- 172.21.15.123:0/3011891086 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdf800039b0 0x7fdf80003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:15.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.908+0000 7fdf92d9d640 1 -- 172.21.15.123:0/3011891086 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf80003520 con 0x7fdf800052e0 2024-09-15T23:19:15.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.909+0000 7fdf92d9d640 1 -- 172.21.15.123:0/3011891086 reap_dead start 2024-09-15T23:19:15.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.909+0000 7fdf92d9d640 1 --2- 172.21.15.123:0/3011891086 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf800052e0 0x7fdf8000b9c0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c007330 tx=0x7fdf80005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96cf74804097d4e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:15.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.909+0000 7fdf91d9b640 1 -- 172.21.15.123:0/3011891086 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c009be0 con 0x7fdf800052e0 2024-09-15T23:19:15.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.909+0000 7fdf91d9b640 1 -- 172.21.15.123:0/3011891086 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf8c003b90 con 0x7fdf800052e0 2024-09-15T23:19:15.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.909+0000 7fdf91d9b640 1 -- 172.21.15.123:0/3011891086 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c004020 con 0x7fdf800052e0 2024-09-15T23:19:15.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.910+0000 7fdf989b9640 1 -- 172.21.15.123:0/3011891086 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf800052e0 msgr2=0x7fdf8000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:15.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.910+0000 7fdf989b9640 1 --2- 172.21.15.123:0/3011891086 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf800052e0 0x7fdf8000b9c0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c007330 tx=0x7fdf80005830 comp rx=0 tx=0).stop 2024-09-15T23:19:15.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.910+0000 7fdf989b9640 1 -- 172.21.15.123:0/3011891086 shutdown_connections 2024-09-15T23:19:15.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.910+0000 7fdf989b9640 1 --2- 172.21.15.123:0/3011891086 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf800052e0 0x7fdf8000b9c0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:15.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.910+0000 7fdf989b9640 1 -- 172.21.15.123:0/3011891086 >> 172.21.15.123:0/3011891086 conn(0x7fdf9406c0e0 msgr2=0x7fdf9406c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:15.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.910+0000 7fdf989b9640 1 -- 172.21.15.123:0/3011891086 shutdown_connections 2024-09-15T23:19:15.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.910+0000 7fdf989b9640 1 -- 172.21.15.123:0/3011891086 wait complete. 2024-09-15T23:19:15.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.911+0000 7fdf989b9640 1 Processor -- start 2024-09-15T23:19:15.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.911+0000 7fdf989b9640 1 -- start start 2024-09-15T23:19:15.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.912+0000 7fdf989b9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf800052e0 0x7fdf940b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:15.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.912+0000 7fdf989b9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdf940ce320 0x7fdf940b4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:15.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.912+0000 7fdf989b9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdf940b4b60 0x7fdf94153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:15.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.912+0000 7fdf989b9640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdf9415ee70 con 0x7fdf800052e0 2024-09-15T23:19:15.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.912+0000 7fdf989b9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fdf940cfbe0 con 0x7fdf940ce320 2024-09-15T23:19:15.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.912+0000 7fdf989b9640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fdf940d2f80 con 0x7fdf940b4b60 2024-09-15T23:19:15.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.912+0000 7fdf9259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf800052e0 0x7fdf940b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:15.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.912+0000 7fdf9259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf800052e0 0x7fdf940b5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35572/0 (socket says 172.21.15.123:35572) 2024-09-15T23:19:15.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.912+0000 7fdf9259c640 1 -- 172.21.15.123:0/2451825014 learned_addr learned my addr 172.21.15.123:0/2451825014 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:15.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.912+0000 7fdf89d9b640 1 --2- 172.21.15.123:0/2451825014 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdf940ce320 0x7fdf940b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:15.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.912+0000 7fdf92d9d640 1 --2- 172.21.15.123:0/2451825014 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdf940b4b60 0x7fdf94153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:15.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.912+0000 7fdf9259c640 1 -- 172.21.15.123:0/2451825014 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdf940b4b60 msgr2=0x7fdf94153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:15.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.912+0000 7fdf9259c640 1 --2- 172.21.15.123:0/2451825014 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdf940b4b60 0x7fdf94153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:15.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.912+0000 7fdf9259c640 1 -- 172.21.15.123:0/2451825014 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdf940ce320 msgr2=0x7fdf940b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:15.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.912+0000 7fdf9259c640 1 --2- 172.21.15.123:0/2451825014 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdf940ce320 0x7fdf940b4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:15.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.912+0000 7fdf9259c640 1 -- 172.21.15.123:0/2451825014 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf9414daa0 con 0x7fdf800052e0 2024-09-15T23:19:15.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.912+0000 7fdf9259c640 1 --2- 172.21.15.123:0/2451825014 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf800052e0 0x7fdf940b5be0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fdf8400f570 tx=0x7fdf8400fa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:15.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.913+0000 7fdf8b7fe640 1 -- 172.21.15.123:0/2451825014 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf840052e0 con 0x7fdf800052e0 2024-09-15T23:19:15.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.913+0000 7fdf8b7fe640 1 -- 172.21.15.123:0/2451825014 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf84018070 con 0x7fdf800052e0 2024-09-15T23:19:15.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.913+0000 7fdf989b9640 1 -- 172.21.15.123:0/2451825014 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf940ce7a0 con 0x7fdf800052e0 2024-09-15T23:19:15.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.913+0000 7fdf8b7fe640 1 -- 172.21.15.123:0/2451825014 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf84003830 con 0x7fdf800052e0 2024-09-15T23:19:15.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.913+0000 7fdf989b9640 1 -- 172.21.15.123:0/2451825014 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf940b5100 con 0x7fdf800052e0 2024-09-15T23:19:15.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.914+0000 7fdf8b7fe640 1 -- 172.21.15.123:0/2451825014 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdf840039d0 con 0x7fdf800052e0 2024-09-15T23:19:15.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.914+0000 7fdf8b7fe640 1 --2- 172.21.15.123:0/2451825014 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdf7406c2e0 0x7fdf7406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:15.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.915+0000 7fdf8b7fe640 1 -- 172.21.15.123:0/2451825014 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7fdf8408abf0 con 0x7fdf800052e0 2024-09-15T23:19:15.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.915+0000 7fdf89d9b640 1 --2- 172.21.15.123:0/2451825014 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdf7406c2e0 0x7fdf7406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:15.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.915+0000 7fdf89d9b640 1 --2- 172.21.15.123:0/2451825014 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdf7406c2e0 0x7fdf7406e7a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fdf94154490 tx=0x7fdf7c000f80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:15.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.915+0000 7fdf9b827740 1 Processor -- start 2024-09-15T23:19:15.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.916+0000 7fdf9b827740 1 -- start start 2024-09-15T23:19:15.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.916+0000 7fdf9b827740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561a6a58aa70 0x561a6a58ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:15.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.916+0000 7fdf9b827740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561a6a5711f0 0x561a6a56fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:15.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.916+0000 7fdf9b827740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561a6a5bb420 0x561a6a5bb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:15.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.916+0000 7fdf9b827740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x561a6a4d8bc0 con 0x561a6a58aa70 2024-09-15T23:19:15.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.916+0000 7fdf9b827740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x561a6a480970 con 0x561a6a5711f0 2024-09-15T23:19:15.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.916+0000 7fdf9b827740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x561a6a4d4b80 con 0x561a6a5bb420 2024-09-15T23:19:15.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.916+0000 7fdf9259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561a6a58aa70 0x561a6a58ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:15.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.916+0000 7fdf9259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561a6a58aa70 0x561a6a58ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35584/0 (socket says 172.21.15.123:35584) 2024-09-15T23:19:15.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.916+0000 7fdf9259c640 1 -- 172.21.15.123:0/1117892440 learned_addr learned my addr 172.21.15.123:0/1117892440 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:15.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.917+0000 7fdf92d9d640 1 --2- 172.21.15.123:0/1117892440 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561a6a5bb420 0x561a6a5bb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:15.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.917+0000 7fdf89d9b640 1 --2- 172.21.15.123:0/1117892440 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561a6a5711f0 0x561a6a56fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:15.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.917+0000 7fdf9259c640 1 -- 172.21.15.123:0/1117892440 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561a6a5bb420 msgr2=0x561a6a5bb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:15.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.917+0000 7fdf9259c640 1 --2- 172.21.15.123:0/1117892440 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561a6a5bb420 0x561a6a5bb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:15.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.917+0000 7fdf9259c640 1 -- 172.21.15.123:0/1117892440 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561a6a5711f0 msgr2=0x561a6a56fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:15.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.917+0000 7fdf9259c640 1 --2- 172.21.15.123:0/1117892440 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561a6a5711f0 0x561a6a56fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:15.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.917+0000 7fdf9259c640 1 -- 172.21.15.123:0/1117892440 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a6a2b7ba0 con 0x561a6a58aa70 2024-09-15T23:19:15.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.917+0000 7fdf89d9b640 1 --2- 172.21.15.123:0/1117892440 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561a6a5711f0 0x561a6a56fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:19:15.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.917+0000 7fdf9259c640 1 --2- 172.21.15.123:0/1117892440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561a6a58aa70 0x561a6a58ae50 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fdf84089050 tx=0x7fdf84058d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c746dd3cddca0b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:15.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.917+0000 7fdf73fff640 1 -- 172.21.15.123:0/1117892440 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf84087070 con 0x561a6a58aa70 2024-09-15T23:19:15.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.917+0000 7fdf73fff640 1 -- 172.21.15.123:0/1117892440 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf8406f030 con 0x561a6a58aa70 2024-09-15T23:19:15.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.917+0000 7fdf73fff640 1 -- 172.21.15.123:0/1117892440 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf84055370 con 0x561a6a58aa70 2024-09-15T23:19:15.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.918+0000 7fdf9b827740 1 -- 172.21.15.123:0/1117892440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561a6a58aa70 msgr2=0x561a6a58ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:15.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.918+0000 7fdf9b827740 1 --2- 172.21.15.123:0/1117892440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561a6a58aa70 0x561a6a58ae50 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fdf84089050 tx=0x7fdf84058d00 comp rx=0 tx=0).stop 2024-09-15T23:19:15.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.918+0000 7fdf9b827740 1 -- 172.21.15.123:0/1117892440 shutdown_connections 2024-09-15T23:19:15.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.918+0000 7fdf9b827740 1 --2- 172.21.15.123:0/1117892440 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561a6a5bb420 0x561a6a5bb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:15.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.918+0000 7fdf9b827740 1 --2- 172.21.15.123:0/1117892440 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561a6a5711f0 0x561a6a56fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:15.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.918+0000 7fdf9b827740 1 --2- 172.21.15.123:0/1117892440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561a6a58aa70 0x561a6a58ae50 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:15.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.918+0000 7fdf9b827740 1 -- 172.21.15.123:0/1117892440 >> 172.21.15.123:0/1117892440 conn(0x561a6a571c20 msgr2=0x561a6a5b9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:15.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.918+0000 7fdf9b827740 1 -- 172.21.15.123:0/1117892440 shutdown_connections 2024-09-15T23:19:15.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.918+0000 7fdf9b827740 1 -- 172.21.15.123:0/1117892440 wait complete. 2024-09-15T23:19:15.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.918+0000 7fdf9b827740 1 -- start start 2024-09-15T23:19:15.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.918+0000 7fdf9b827740 1 Processor -- start 2024-09-15T23:19:15.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.919+0000 7fdf9b827740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561a6a58aa70 0x561a6a5ca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:15.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.919+0000 7fdf9b827740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561a6a5bb420 0x561a6a5b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:15.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.919+0000 7fdf9b827740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561a6a5b6000 0x561a6a5b6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:15.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.919+0000 7fdf9b827740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x561a6a570150 con 0x561a6a5bb420 2024-09-15T23:19:15.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.919+0000 7fdf9b827740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x561a6a493d70 con 0x561a6a5b6000 2024-09-15T23:19:15.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.919+0000 7fdf9b827740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x561a6a570430 con 0x561a6a58aa70 2024-09-15T23:19:15.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.919+0000 7fdf9b827740 10 client.0 _ll_register_callbacks cb 0x561a6a1eaf80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:19:15.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.919+0000 7fdf89d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561a6a5bb420 0x561a6a5b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:15.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.919+0000 7fdf89d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561a6a5bb420 0x561a6a5b0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35596/0 (socket says 172.21.15.123:35596) 2024-09-15T23:19:15.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.919+0000 7fdf89d9b640 1 -- 172.21.15.123:0/3853404300 learned_addr learned my addr 172.21.15.123:0/3853404300 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:15.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.919+0000 7fdf9259c640 1 --2- 172.21.15.123:0/3853404300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561a6a58aa70 0x561a6a5ca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:15.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.919+0000 7fdf92d9d640 1 --2- 172.21.15.123:0/3853404300 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561a6a5b6000 0x561a6a5b6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:15.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.920+0000 7fdf89d9b640 1 -- 172.21.15.123:0/3853404300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561a6a58aa70 msgr2=0x561a6a5ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:15.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.920+0000 7fdf89d9b640 1 --2- 172.21.15.123:0/3853404300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561a6a58aa70 0x561a6a5ca3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:15.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.920+0000 7fdf89d9b640 1 -- 172.21.15.123:0/3853404300 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561a6a5b6000 msgr2=0x561a6a5b6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:15.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.920+0000 7fdf89d9b640 1 --2- 172.21.15.123:0/3853404300 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561a6a5b6000 0x561a6a5b6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:15.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.920+0000 7fdf89d9b640 1 -- 172.21.15.123:0/3853404300 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a6a1ab490 con 0x561a6a5bb420 2024-09-15T23:19:15.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.920+0000 7fdf9259c640 1 --2- 172.21.15.123:0/3853404300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561a6a58aa70 0x561a6a5ca3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:19:15.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.920+0000 7fdf89d9b640 1 --2- 172.21.15.123:0/3853404300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561a6a5bb420 0x561a6a5b0240 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c015800 tx=0x7fdf940d0930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb47962ac48d3d51 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:15.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.920+0000 7fdf717fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:19:15.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.920+0000 7fdf717fa640 1 -- 172.21.15.123:0/3853404300 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c0225b0 con 0x561a6a5bb420 2024-09-15T23:19:15.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.920+0000 7fdf717fa640 1 -- 172.21.15.123:0/3853404300 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7fdf7c019790 con 0x561a6a5bb420 2024-09-15T23:19:15.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.920+0000 7fdf9b827740 1 -- 172.21.15.123:0/3853404300 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf8406f030 con 0x561a6a5bb420 2024-09-15T23:19:15.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.920+0000 7fdf717fa640 1 -- 172.21.15.123:0/3853404300 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fdf7c019990 con 0x561a6a5bb420 2024-09-15T23:19:15.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.920+0000 7fdf9b827740 10 client.8208 fetch_fsmap learned FSMap version 80 2024-09-15T23:19:15.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.920+0000 7fdf9b827740 1 -- 172.21.15.123:0/3853404300 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=2+}) -- 0x561a6a318330 con 0x561a6a5bb420 2024-09-15T23:19:15.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.920+0000 7fdf717fa640 1 -- 172.21.15.123:0/3853404300 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf8406f030 con 0x561a6a5bb420 2024-09-15T23:19:15.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.920+0000 7fdf717fa640 1 -- 172.21.15.123:0/3853404300 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 80) ==== 3502+0+0 (secure 0 0 0) 0x7fdf7c019b30 con 0x561a6a5bb420 2024-09-15T23:19:15.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.920+0000 7fdf9b827740 10 client.8208 fetch_fsmap finished waiting for FSMap version 80 2024-09-15T23:19:15.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.920+0000 7fdf9b827740 10 client.8208 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-09-15T23:19:15.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.920+0000 7fdf9b827740 20 client.8208 populate_metadata read hostname 'smithi123' 2024-09-15T23:19:15.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.920+0000 7fdf9b827740 1 --2- 172.21.15.123:0/3853404300 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x561a6a5b1480 0x561a6a5b1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:15.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.920+0000 7fdf9b827740 4 client.8208 mds_command: new command op to 8034 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:19:15.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.921+0000 7fdf9b827740 1 -- 172.21.15.123:0/3853404300 --> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a6a45dc80 con 0x561a6a5b1480 2024-09-15T23:19:15.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.921+0000 7fdf9259c640 1 --2- 172.21.15.123:0/3853404300 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x561a6a5b1480 0x561a6a5b1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:15.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.921+0000 7fdf717fa640 10 client.8208 ms_handle_connect on v2:172.21.15.188:6835/3551744094 2024-09-15T23:19:15.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.921+0000 7fdf9259c640 1 --2- 172.21.15.123:0/3853404300 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x561a6a5b1480 0x561a6a5b1910 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=369329a314d92d65 server_cookie=cc360c9eb0182346 in_seq=0 out_seq=0 2024-09-15T23:19:15.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.922+0000 7fdf717fa640 1 -- 172.21.15.123:0/3853404300 <== mds.0 v2:172.21.15.188:6835/3551744094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561a6a45dc80 con 0x561a6a5b1480 2024-09-15T23:19:15.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.922+0000 7fdf717fa640 10 client.8208 handle_command_reply: tid=0 2024-09-15T23:19:15.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.922+0000 7fdf9b827740 1 client.8208 shutdown 2024-09-15T23:19:15.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.922+0000 7fdf9b827740 1 -- 172.21.15.123:0/3853404300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561a6a5bb420 msgr2=0x561a6a5b0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:15.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.922+0000 7fdf9b827740 1 --2- 172.21.15.123:0/3853404300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561a6a5bb420 0x561a6a5b0240 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c015800 tx=0x7fdf940d0930 comp rx=0 tx=0).stop 2024-09-15T23:19:15.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.922+0000 7fdf9b827740 1 -- 172.21.15.123:0/3853404300 shutdown_connections 2024-09-15T23:19:15.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.922+0000 7fdf9b827740 1 --2- 172.21.15.123:0/3853404300 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x561a6a5b1480 0x561a6a5b1910 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:15.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.922+0000 7fdf9b827740 1 --2- 172.21.15.123:0/3853404300 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561a6a5b6000 0x561a6a5b6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:15.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.922+0000 7fdf717fa640 0 client.8208 ms_handle_reset on v2:172.21.15.188:6835/3551744094 2024-09-15T23:19:15.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.922+0000 7fdf9b827740 1 --2- 172.21.15.123:0/3853404300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561a6a5bb420 0x561a6a5b0240 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:15.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.922+0000 7fdf9b827740 1 --2- 172.21.15.123:0/3853404300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561a6a58aa70 0x561a6a5ca3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:15.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.922+0000 7fdf9b827740 1 -- 172.21.15.123:0/3853404300 >> 172.21.15.123:0/3853404300 conn(0x561a6a5711f0 msgr2=0x561a6a56e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:15.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.922+0000 7fdf9b827740 1 -- 172.21.15.123:0/3853404300 shutdown_connections 2024-09-15T23:19:15.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.922+0000 7fdf9b827740 1 -- 172.21.15.123:0/3853404300 wait complete. 2024-09-15T23:19:15.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.922+0000 7fdf9b827740 20 client.8208 trim_cache size 0 max 16384 2024-09-15T23:19:15.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.939+0000 7fdf9b827740 1 Processor -- start 2024-09-15T23:19:15.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.939+0000 7fdf9b827740 1 -- start start 2024-09-15T23:19:15.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.940+0000 7fdf9b827740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561a6a58aa70 0x561a6a56e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:15.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.940+0000 7fdf9b827740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561a6a5b6000 0x561a6a56eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:15.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.940+0000 7fdf9b827740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561a6a5bb420 0x561a6a5bd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:15.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.940+0000 7fdf9b827740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdf94201580 con 0x561a6a5bb420 2024-09-15T23:19:15.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.940+0000 7fdf9b827740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fdf94150080 con 0x561a6a5b6000 2024-09-15T23:19:15.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.940+0000 7fdf9b827740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fdf941f8dc0 con 0x561a6a58aa70 2024-09-15T23:19:15.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.940+0000 7fdf92d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561a6a5bb420 0x561a6a5bd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:15.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.940+0000 7fdf92d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561a6a5bb420 0x561a6a5bd4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35608/0 (socket says 172.21.15.123:35608) 2024-09-15T23:19:15.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.940+0000 7fdf92d9d640 1 -- 172.21.15.123:0/3493537549 learned_addr learned my addr 172.21.15.123:0/3493537549 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:15.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.940+0000 7fdf89d9b640 1 --2- 172.21.15.123:0/3493537549 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561a6a5b6000 0x561a6a56eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:15.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.940+0000 7fdf9259c640 1 --2- 172.21.15.123:0/3493537549 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561a6a58aa70 0x561a6a56e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:15.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.940+0000 7fdf92d9d640 1 -- 172.21.15.123:0/3493537549 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561a6a58aa70 msgr2=0x561a6a56e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:15.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.940+0000 7fdf92d9d640 1 --2- 172.21.15.123:0/3493537549 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561a6a58aa70 0x561a6a56e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:15.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.940+0000 7fdf92d9d640 1 -- 172.21.15.123:0/3493537549 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561a6a5b6000 msgr2=0x561a6a56eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:15.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.940+0000 7fdf92d9d640 1 --2- 172.21.15.123:0/3493537549 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561a6a5b6000 0x561a6a56eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:15.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.940+0000 7fdf92d9d640 1 -- 172.21.15.123:0/3493537549 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a6a5ca720 con 0x561a6a5bb420 2024-09-15T23:19:15.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.940+0000 7fdf89d9b640 1 --2- 172.21.15.123:0/3493537549 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561a6a5b6000 0x561a6a56eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:19:15.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.941+0000 7fdf92d9d640 1 --2- 172.21.15.123:0/3493537549 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561a6a5bb420 0x561a6a5bd4c0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c009540 tx=0x7fdf8c02f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3bc2e64e0262fd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:15.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.941+0000 7fdf737fe640 1 -- 172.21.15.123:0/3493537549 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c047070 con 0x561a6a5bb420 2024-09-15T23:19:15.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.941+0000 7fdf737fe640 1 -- 172.21.15.123:0/3493537549 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf8c0376e0 con 0x561a6a5bb420 2024-09-15T23:19:15.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.941+0000 7fdf737fe640 1 -- 172.21.15.123:0/3493537549 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c037ab0 con 0x561a6a5bb420 2024-09-15T23:19:15.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.941+0000 7fdf9b827740 1 -- 172.21.15.123:0/3493537549 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561a6a5bb420 msgr2=0x561a6a5bd4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:15.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.941+0000 7fdf9b827740 1 --2- 172.21.15.123:0/3493537549 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561a6a5bb420 0x561a6a5bd4c0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c009540 tx=0x7fdf8c02f000 comp rx=0 tx=0).stop 2024-09-15T23:19:15.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.941+0000 7fdf9b827740 1 -- 172.21.15.123:0/3493537549 shutdown_connections 2024-09-15T23:19:15.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.941+0000 7fdf9b827740 1 --2- 172.21.15.123:0/3493537549 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561a6a5bb420 0x561a6a5bd4c0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:15.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.941+0000 7fdf9b827740 1 --2- 172.21.15.123:0/3493537549 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561a6a5b6000 0x561a6a56eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:15.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.941+0000 7fdf9b827740 1 --2- 172.21.15.123:0/3493537549 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561a6a58aa70 0x561a6a56e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:15.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.941+0000 7fdf9b827740 1 -- 172.21.15.123:0/3493537549 >> 172.21.15.123:0/3493537549 conn(0x561a6a5711f0 msgr2=0x561a6a5b96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:15.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.941+0000 7fdf9b827740 1 -- 172.21.15.123:0/3493537549 shutdown_connections 2024-09-15T23:19:15.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.941+0000 7fdf9b827740 1 -- 172.21.15.123:0/3493537549 wait complete. 2024-09-15T23:19:15.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.942+0000 7fdf9b827740 1 -- start start 2024-09-15T23:19:15.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.942+0000 7fdf9b827740 1 Processor -- start 2024-09-15T23:19:15.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.943+0000 7fdf9b827740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561a6a58aa70 0x561a6a6382c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:15.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.943+0000 7fdf9b827740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561a6a5b6000 0x561a6a56e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:15.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.943+0000 7fdf9b827740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561a6a5bb420 0x561a6a56eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:15.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.943+0000 7fdf9b827740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdf9414e840 con 0x561a6a5b6000 2024-09-15T23:19:15.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.943+0000 7fdf9b827740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x561a6a56b9c0 con 0x561a6a5bb420 2024-09-15T23:19:15.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.943+0000 7fdf9b827740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x561a6a575950 con 0x561a6a58aa70 2024-09-15T23:19:15.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.943+0000 7fdf9b827740 10 client.0 _ll_register_callbacks cb 0x7fdf7c001610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:19:15.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.943+0000 7fdf89d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561a6a5b6000 0x561a6a56e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:15.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.943+0000 7fdf89d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561a6a5b6000 0x561a6a56e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35622/0 (socket says 172.21.15.123:35622) 2024-09-15T23:19:15.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.943+0000 7fdf89d9b640 1 -- 172.21.15.123:0/3562817382 learned_addr learned my addr 172.21.15.123:0/3562817382 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:15.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.943+0000 7fdf9259c640 1 --2- 172.21.15.123:0/3562817382 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561a6a58aa70 0x561a6a6382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:15.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.943+0000 7fdf92d9d640 1 --2- 172.21.15.123:0/3562817382 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561a6a5bb420 0x561a6a56eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:15.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.943+0000 7fdf89d9b640 1 -- 172.21.15.123:0/3562817382 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561a6a58aa70 msgr2=0x561a6a6382c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:15.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.943+0000 7fdf89d9b640 1 --2- 172.21.15.123:0/3562817382 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561a6a58aa70 0x561a6a6382c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:15.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.943+0000 7fdf89d9b640 1 -- 172.21.15.123:0/3562817382 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561a6a5bb420 msgr2=0x561a6a56eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:15.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.943+0000 7fdf89d9b640 1 --2- 172.21.15.123:0/3562817382 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561a6a5bb420 0x561a6a56eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:15.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.943+0000 7fdf89d9b640 1 -- 172.21.15.123:0/3562817382 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a6a184550 con 0x561a6a5b6000 2024-09-15T23:19:15.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.943+0000 7fdf89d9b640 1 --2- 172.21.15.123:0/3562817382 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561a6a5b6000 0x561a6a56e9b0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c01b040 tx=0x7fdf7c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e051785c082796d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:15.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.943+0000 7fdf717fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:19:15.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.943+0000 7fdf717fa640 1 -- 172.21.15.123:0/3562817382 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c03e060 con 0x561a6a5b6000 2024-09-15T23:19:15.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.944+0000 7fdf717fa640 1 -- 172.21.15.123:0/3562817382 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7fdf7c022ca0 con 0x561a6a5b6000 2024-09-15T23:19:15.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.944+0000 7fdf9b827740 1 -- 172.21.15.123:0/3562817382 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf8c0376e0 con 0x561a6a5b6000 2024-09-15T23:19:15.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.944+0000 7fdf717fa640 1 -- 172.21.15.123:0/3562817382 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fdf7c022670 con 0x561a6a5b6000 2024-09-15T23:19:15.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.944+0000 7fdf9b827740 10 client.8214 fetch_fsmap learned FSMap version 80 2024-09-15T23:19:15.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.944+0000 7fdf9b827740 1 -- 172.21.15.123:0/3562817382 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=2+}) -- 0x561a6a5c93e0 con 0x561a6a5b6000 2024-09-15T23:19:15.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.944+0000 7fdf717fa640 1 -- 172.21.15.123:0/3562817382 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf8c0376e0 con 0x561a6a5b6000 2024-09-15T23:19:15.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.944+0000 7fdf717fa640 1 -- 172.21.15.123:0/3562817382 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 80) ==== 3502+0+0 (secure 0 0 0) 0x7fdf7c0190f0 con 0x561a6a5b6000 2024-09-15T23:19:15.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.944+0000 7fdf9b827740 10 client.8214 fetch_fsmap finished waiting for FSMap version 80 2024-09-15T23:19:15.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.944+0000 7fdf9b827740 10 client.8214 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-09-15T23:19:15.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.944+0000 7fdf9b827740 20 client.8214 populate_metadata read hostname 'smithi123' 2024-09-15T23:19:15.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.944+0000 7fdf9b827740 1 --2- 172.21.15.123:0/3562817382 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x561a6a5bba10 0x561a6a5c8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:15.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.944+0000 7fdf9b827740 4 client.8214 mds_command: new command op to 8034 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-15T23:19:15.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.944+0000 7fdf9b827740 1 -- 172.21.15.123:0/3562817382 --> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x561a6a5afc50 con 0x561a6a5bba10 2024-09-15T23:19:15.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.944+0000 7fdf9259c640 1 --2- 172.21.15.123:0/3562817382 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x561a6a5bba10 0x561a6a5c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:15.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.944+0000 7fdf9259c640 1 --2- 172.21.15.123:0/3562817382 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x561a6a5bba10 0x561a6a5c8640 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a394d66872d8855 server_cookie=9d7ca3174d7e9861 in_seq=0 out_seq=0 2024-09-15T23:19:15.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.944+0000 7fdf717fa640 10 client.8214 ms_handle_connect on v2:172.21.15.188:6835/3551744094 2024-09-15T23:19:15.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.946+0000 7fdf717fa640 1 -- 172.21.15.123:0/3562817382 <== mds.0 v2:172.21.15.188:6835/3551744094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561a6a5afc50 con 0x561a6a5bba10 2024-09-15T23:19:15.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.946+0000 7fdf717fa640 10 client.8214 handle_command_reply: tid=0 2024-09-15T23:19:15.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.946+0000 7fdf9b827740 1 client.8214 shutdown 2024-09-15T23:19:15.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.947+0000 7fdf9b827740 1 -- 172.21.15.123:0/3562817382 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561a6a5b6000 msgr2=0x561a6a56e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:15.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.947+0000 7fdf9b827740 1 --2- 172.21.15.123:0/3562817382 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561a6a5b6000 0x561a6a56e9b0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c01b040 tx=0x7fdf7c016000 comp rx=0 tx=0).stop 2024-09-15T23:19:15.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.947+0000 7fdf9b827740 1 -- 172.21.15.123:0/3562817382 shutdown_connections 2024-09-15T23:19:15.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.947+0000 7fdf9b827740 1 --2- 172.21.15.123:0/3562817382 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x561a6a5bba10 0x561a6a5c8640 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:15.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.947+0000 7fdf9b827740 1 --2- 172.21.15.123:0/3562817382 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x561a6a5bb420 0x561a6a56eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:15.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.947+0000 7fdf717fa640 0 client.8214 ms_handle_reset on v2:172.21.15.188:6835/3551744094 2024-09-15T23:19:15.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.947+0000 7fdf9b827740 1 --2- 172.21.15.123:0/3562817382 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x561a6a5b6000 0x561a6a56e9b0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:15.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.947+0000 7fdf9b827740 1 --2- 172.21.15.123:0/3562817382 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x561a6a58aa70 0x561a6a6382c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:15.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.947+0000 7fdf9b827740 1 -- 172.21.15.123:0/3562817382 >> 172.21.15.123:0/3562817382 conn(0x561a6a5711f0 msgr2=0x561a6a58ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:15.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.947+0000 7fdf9b827740 1 -- 172.21.15.123:0/3562817382 shutdown_connections 2024-09-15T23:19:15.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.947+0000 7fdf9b827740 1 -- 172.21.15.123:0/3562817382 wait complete. 2024-09-15T23:19:15.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.947+0000 7fdf9b827740 20 client.8214 trim_cache size 0 max 16384 2024-09-15T23:19:15.953 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:19:15.953 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0, 2024-09-15T23:19:15.953 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_tag": "1fbb7dd9-1561-43ed-bf6d-d3b5f8fc6ea5", 2024-09-15T23:19:15.953 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": "asynchronous" 2024-09-15T23:19:15.953 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:19:15.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.947+0000 7fdf989b9640 1 -- 172.21.15.123:0/2451825014 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdf7406c2e0 msgr2=0x7fdf7406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:15.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.947+0000 7fdf989b9640 1 --2- 172.21.15.123:0/2451825014 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdf7406c2e0 0x7fdf7406e7a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fdf94154490 tx=0x7fdf7c000f80 comp rx=0 tx=0).stop 2024-09-15T23:19:15.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.947+0000 7fdf989b9640 1 -- 172.21.15.123:0/2451825014 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf800052e0 msgr2=0x7fdf940b5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:15.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.947+0000 7fdf989b9640 1 --2- 172.21.15.123:0/2451825014 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf800052e0 0x7fdf940b5be0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fdf8400f570 tx=0x7fdf8400fa30 comp rx=0 tx=0).stop 2024-09-15T23:19:15.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.947+0000 7fdf989b9640 1 -- 172.21.15.123:0/2451825014 shutdown_connections 2024-09-15T23:19:15.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.947+0000 7fdf989b9640 1 --2- 172.21.15.123:0/2451825014 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdf940b4b60 0x7fdf94153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:15.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.947+0000 7fdf989b9640 1 --2- 172.21.15.123:0/2451825014 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdf940ce320 0x7fdf940b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:15.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.947+0000 7fdf989b9640 1 --2- 172.21.15.123:0/2451825014 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdf7406c2e0 0x7fdf7406e7a0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:15.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.947+0000 7fdf989b9640 1 --2- 172.21.15.123:0/2451825014 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf800052e0 0x7fdf940b5be0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:15.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.947+0000 7fdf989b9640 1 -- 172.21.15.123:0/2451825014 >> 172.21.15.123:0/2451825014 conn(0x7fdf9406c0e0 msgr2=0x7fdf940b3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:15.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.947+0000 7fdf989b9640 1 -- 172.21.15.123:0/2451825014 shutdown_connections 2024-09-15T23:19:15.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:15.947+0000 7fdf989b9640 1 -- 172.21.15.123:0/2451825014 wait complete. 2024-09-15T23:19:15.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:19:15.959 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.8:0 scrub abort 2024-09-15T23:19:16.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.064+0000 7f888dd78640 1 Processor -- start 2024-09-15T23:19:16.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.064+0000 7f888dd78640 1 -- start start 2024-09-15T23:19:16.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.065+0000 7f888dd78640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f88880b38a0 0x7f88880d3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.065+0000 7f888dd78640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88880cf710 con 0x7f888806bfd0 2024-09-15T23:19:16.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.065+0000 7f888dd78640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88880cf9f0 con 0x7f88880b3350 2024-09-15T23:19:16.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.065+0000 7f888dd78640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f88880b78a0 con 0x7f88880b38a0 2024-09-15T23:19:16.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.065+0000 7f88877fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f888806bfd0 0x7f888806c3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51150/0 (socket says 172.21.15.123:51150) 2024-09-15T23:19:16.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.065+0000 7f88877fe640 1 -- 172.21.15.123:0/392946607 learned_addr learned my addr 172.21.15.123:0/392946607 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:19:16.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.065+0000 7f88867fc640 1 -- 172.21.15.123:0/392946607 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2905876484 0 0) 0x7f88880cf710 con 0x7f888806bfd0 2024-09-15T23:19:16.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.065+0000 7f88867fc640 1 -- 172.21.15.123:0/392946607 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8870003520 con 0x7f888806bfd0 2024-09-15T23:19:16.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.065+0000 7f8887fff640 1 --2- 172.21.15.123:0/392946607 >> v2:172.21.15.188:3300/0 conn(0x7f88880b38a0 0x7f88880d3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.065+0000 7f88867fc640 1 -- 172.21.15.123:0/392946607 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2803818773 0 0) 0x7f8870003520 con 0x7f888806bfd0 2024-09-15T23:19:16.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.065+0000 7f88867fc640 1 -- 172.21.15.123:0/392946607 >> v2:172.21.15.188:3300/0 conn(0x7f88880b38a0 msgr2=0x7f88880d3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:16.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.065+0000 7f88867fc640 1 --2- 172.21.15.123:0/392946607 >> v2:172.21.15.188:3300/0 conn(0x7f88880b38a0 0x7f88880d3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.065+0000 7f88867fc640 1 -- 172.21.15.123:0/392946607 >> v1:172.21.15.188:6789/0 conn(0x7f88880b3350 legacy=0x7f88880d2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:16.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.065+0000 7f88867fc640 1 -- 172.21.15.123:0/392946607 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88880cfcd0 con 0x7f888806bfd0 2024-09-15T23:19:16.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.065+0000 7f88867fc640 1 -- 172.21.15.123:0/392946607 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f8878001670 con 0x7f888806bfd0 2024-09-15T23:19:16.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.065+0000 7f88867fc640 1 -- 172.21.15.123:0/392946607 >> v1:172.21.15.123:6789/0 conn(0x7f888806bfd0 legacy=0x7f888806c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:16.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.065+0000 7f88867fc640 1 --2- 172.21.15.123:0/392946607 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88700039b0 0x7f8870003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.065+0000 7f88867fc640 1 --2- 172.21.15.123:0/392946607 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8870004800 0x7f8870004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.065+0000 7f88867fc640 1 --2- 172.21.15.123:0/392946607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88700051c0 0x7f887000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.065+0000 7f88867fc640 1 -- 172.21.15.123:0/392946607 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f887000c040 con 0x7f88700039b0 2024-09-15T23:19:16.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.065+0000 7f88867fc640 1 -- 172.21.15.123:0/392946607 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f887000c1f0 con 0x7f88700051c0 2024-09-15T23:19:16.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.065+0000 7f88867fc640 1 -- 172.21.15.123:0/392946607 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f887000c3f0 con 0x7f8870004800 2024-09-15T23:19:16.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.065+0000 7f88877fe640 1 --2- 172.21.15.123:0/392946607 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88700039b0 0x7f8870003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.065+0000 7f8886ffd640 1 --2- 172.21.15.123:0/392946607 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8870004800 0x7f8870004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.066+0000 7f8887fff640 1 --2- 172.21.15.123:0/392946607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88700051c0 0x7f887000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.066+0000 7f88877fe640 1 -- 172.21.15.123:0/392946607 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8870004800 msgr2=0x7f8870004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:16.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.066+0000 7f88877fe640 1 --2- 172.21.15.123:0/392946607 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8870004800 0x7f8870004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.066+0000 7f88877fe640 1 -- 172.21.15.123:0/392946607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88700051c0 msgr2=0x7f887000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:16.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.066+0000 7f88877fe640 1 --2- 172.21.15.123:0/392946607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88700051c0 0x7f887000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.066+0000 7f88877fe640 1 -- 172.21.15.123:0/392946607 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8870003520 con 0x7f88700039b0 2024-09-15T23:19:16.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.066+0000 7f8887fff640 1 --2- 172.21.15.123:0/392946607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88700051c0 0x7f887000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:19:16.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.066+0000 7f8887fff640 1 -- 172.21.15.123:0/392946607 reap_dead start 2024-09-15T23:19:16.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.066+0000 7f88877fe640 1 --2- 172.21.15.123:0/392946607 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88700039b0 0x7f8870003dd0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f887800c240 tx=0x7f8870005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edea778cc0f73a4a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:16.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.066+0000 7f88867fc640 1 -- 172.21.15.123:0/392946607 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8878007cf0 con 0x7f88700039b0 2024-09-15T23:19:16.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.067+0000 7f88867fc640 1 -- 172.21.15.123:0/392946607 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8878005af0 con 0x7f88700039b0 2024-09-15T23:19:16.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.067+0000 7f88867fc640 1 -- 172.21.15.123:0/392946607 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8878007070 con 0x7f88700039b0 2024-09-15T23:19:16.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.067+0000 7f888dd78640 1 -- 172.21.15.123:0/392946607 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88700039b0 msgr2=0x7f8870003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:16.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.067+0000 7f888dd78640 1 --2- 172.21.15.123:0/392946607 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88700039b0 0x7f8870003dd0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f887800c240 tx=0x7f8870005830 comp rx=0 tx=0).stop 2024-09-15T23:19:16.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.067+0000 7f888dd78640 1 -- 172.21.15.123:0/392946607 shutdown_connections 2024-09-15T23:19:16.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.067+0000 7f888dd78640 1 --2- 172.21.15.123:0/392946607 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88700039b0 0x7f8870003dd0 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.067+0000 7f888dd78640 1 -- 172.21.15.123:0/392946607 >> 172.21.15.123:0/392946607 conn(0x7f88880d11c0 msgr2=0x7f88880d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:16.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.067+0000 7f888dd78640 1 -- 172.21.15.123:0/392946607 shutdown_connections 2024-09-15T23:19:16.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.067+0000 7f888dd78640 1 -- 172.21.15.123:0/392946607 wait complete. 2024-09-15T23:19:16.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.068+0000 7f888dd78640 1 Processor -- start 2024-09-15T23:19:16.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.068+0000 7f888dd78640 1 -- start start 2024-09-15T23:19:16.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.069+0000 7f888dd78640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88700039b0 0x7f88881f7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.069+0000 7f888dd78640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88880cde20 0x7f88880abb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.069+0000 7f888dd78640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f88880b4640 0x7f88880b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.069+0000 7f888dd78640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f888806cd50 con 0x7f88700039b0 2024-09-15T23:19:16.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.069+0000 7f888dd78640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f88880cffb0 con 0x7f88880cde20 2024-09-15T23:19:16.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.069+0000 7f888dd78640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f888815eae0 con 0x7f88880b4640 2024-09-15T23:19:16.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.069+0000 7f88877fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88700039b0 0x7f88881f7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.069+0000 7f88877fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88700039b0 0x7f88881f7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35646/0 (socket says 172.21.15.123:35646) 2024-09-15T23:19:16.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.069+0000 7f88877fe640 1 -- 172.21.15.123:0/1738717636 learned_addr learned my addr 172.21.15.123:0/1738717636 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:16.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.069+0000 7f8886ffd640 1 --2- 172.21.15.123:0/1738717636 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88880cde20 0x7f88880abb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.069+0000 7f8887fff640 1 --2- 172.21.15.123:0/1738717636 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f88880b4640 0x7f88880b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.070+0000 7f88877fe640 1 -- 172.21.15.123:0/1738717636 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f88880b4640 msgr2=0x7f88880b4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:16.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.070+0000 7f88877fe640 1 --2- 172.21.15.123:0/1738717636 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f88880b4640 0x7f88880b4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.070+0000 7f88877fe640 1 -- 172.21.15.123:0/1738717636 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88880cde20 msgr2=0x7f88880abb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:16.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.070+0000 7f88877fe640 1 --2- 172.21.15.123:0/1738717636 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88880cde20 0x7f88880abb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.070+0000 7f88877fe640 1 -- 172.21.15.123:0/1738717636 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88881f7c80 con 0x7f88700039b0 2024-09-15T23:19:16.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.070+0000 7f88877fe640 1 --2- 172.21.15.123:0/1738717636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88700039b0 0x7f88881f7740 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f887800c360 tx=0x7f88880cfbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:16.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.070+0000 7f886ffff640 1 -- 172.21.15.123:0/1738717636 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8878037040 con 0x7f88700039b0 2024-09-15T23:19:16.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.070+0000 7f886ffff640 1 -- 172.21.15.123:0/1738717636 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8878041070 con 0x7f88700039b0 2024-09-15T23:19:16.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.070+0000 7f888dd78640 1 -- 172.21.15.123:0/1738717636 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88880ac360 con 0x7f88700039b0 2024-09-15T23:19:16.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.070+0000 7f886ffff640 1 -- 172.21.15.123:0/1738717636 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8878001c30 con 0x7f88700039b0 2024-09-15T23:19:16.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.070+0000 7f888dd78640 1 -- 172.21.15.123:0/1738717636 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88880ac920 con 0x7f88700039b0 2024-09-15T23:19:16.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.072+0000 7f886ffff640 1 -- 172.21.15.123:0/1738717636 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8878004a00 con 0x7f88700039b0 2024-09-15T23:19:16.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.072+0000 7f886ffff640 1 --2- 172.21.15.123:0/1738717636 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f887406c2b0 0x7f887406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.072+0000 7f886ffff640 1 -- 172.21.15.123:0/1738717636 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f88780aaf20 con 0x7f88700039b0 2024-09-15T23:19:16.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.072+0000 7f8886ffd640 1 --2- 172.21.15.123:0/1738717636 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f887406c2b0 0x7f887406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.073+0000 7f8886ffd640 1 --2- 172.21.15.123:0/1738717636 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f887406c2b0 0x7f887406e770 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f88880b9b70 tx=0x7f887c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:16.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.073+0000 7f8890bee740 1 Processor -- start 2024-09-15T23:19:16.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.073+0000 7f8890bee740 1 -- start start 2024-09-15T23:19:16.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.074+0000 7f8890bee740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c155a545e0 0x55c155a549c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.074+0000 7f8890bee740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c155a51da0 0x55c155a53930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.074+0000 7f8890bee740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c155a52200 0x55c155a34560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.074+0000 7f8890bee740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55c1559708d0 con 0x55c155a51da0 2024-09-15T23:19:16.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.074+0000 7f8890bee740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55c155918620 con 0x55c155a52200 2024-09-15T23:19:16.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.074+0000 7f8890bee740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55c15596c890 con 0x55c155a545e0 2024-09-15T23:19:16.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.074+0000 7f8886ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c155a51da0 0x55c155a53930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.074+0000 7f88877fe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c155a545e0 0x55c155a549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.074+0000 7f8886ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c155a51da0 0x55c155a53930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35652/0 (socket says 172.21.15.123:35652) 2024-09-15T23:19:16.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.074+0000 7f8886ffd640 1 -- 172.21.15.123:0/1814526893 learned_addr learned my addr 172.21.15.123:0/1814526893 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:16.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.074+0000 7f8887fff640 1 --2- 172.21.15.123:0/1814526893 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c155a52200 0x55c155a34560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.074+0000 7f8886ffd640 1 -- 172.21.15.123:0/1814526893 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c155a545e0 msgr2=0x55c155a549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:16.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.074+0000 7f8886ffd640 1 --2- 172.21.15.123:0/1814526893 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c155a545e0 0x55c155a549c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.074+0000 7f8886ffd640 1 -- 172.21.15.123:0/1814526893 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c155a52200 msgr2=0x55c155a34560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:16.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.074+0000 7f8886ffd640 1 --2- 172.21.15.123:0/1814526893 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c155a52200 0x55c155a34560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.074+0000 7f8886ffd640 1 -- 172.21.15.123:0/1814526893 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c15574d7d0 con 0x55c155a51da0 2024-09-15T23:19:16.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.074+0000 7f8886ffd640 1 --2- 172.21.15.123:0/1814526893 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c155a51da0 0x55c155a53930 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f887c012c90 tx=0x7f887c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ead7565a14dd21 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:16.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.074+0000 7f886d7fa640 1 -- 172.21.15.123:0/1814526893 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f887c027070 con 0x55c155a51da0 2024-09-15T23:19:16.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.074+0000 7f886d7fa640 1 -- 172.21.15.123:0/1814526893 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f887c01a040 con 0x55c155a51da0 2024-09-15T23:19:16.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.074+0000 7f886d7fa640 1 -- 172.21.15.123:0/1814526893 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f887c019070 con 0x55c155a51da0 2024-09-15T23:19:16.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.075+0000 7f8890bee740 1 -- 172.21.15.123:0/1814526893 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c155a51da0 msgr2=0x55c155a53930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:16.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.075+0000 7f8890bee740 1 --2- 172.21.15.123:0/1814526893 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c155a51da0 0x55c155a53930 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f887c012c90 tx=0x7f887c015000 comp rx=0 tx=0).stop 2024-09-15T23:19:16.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.075+0000 7f8890bee740 1 -- 172.21.15.123:0/1814526893 shutdown_connections 2024-09-15T23:19:16.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.075+0000 7f8890bee740 1 --2- 172.21.15.123:0/1814526893 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c155a52200 0x55c155a34560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.075+0000 7f8890bee740 1 --2- 172.21.15.123:0/1814526893 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c155a51da0 0x55c155a53930 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.075+0000 7f8890bee740 1 --2- 172.21.15.123:0/1814526893 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c155a545e0 0x55c155a549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.075+0000 7f8890bee740 1 -- 172.21.15.123:0/1814526893 >> 172.21.15.123:0/1814526893 conn(0x55c155a0a240 msgr2=0x55c155a52650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:16.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.075+0000 7f8890bee740 1 -- 172.21.15.123:0/1814526893 shutdown_connections 2024-09-15T23:19:16.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.075+0000 7f8890bee740 1 -- 172.21.15.123:0/1814526893 wait complete. 2024-09-15T23:19:16.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.076+0000 7f8890bee740 1 -- start start 2024-09-15T23:19:16.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.076+0000 7f8890bee740 1 Processor -- start 2024-09-15T23:19:16.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.077+0000 7f8890bee740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c155a52200 0x55c155a32e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.077+0000 7f8890bee740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c155a545e0 0x55c155a495d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.077+0000 7f8890bee740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c155a49b10 0x55c155a4b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.077+0000 7f8890bee740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55c155a50d00 con 0x55c155a49b10 2024-09-15T23:19:16.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.077+0000 7f8890bee740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55c1558f9750 con 0x55c155a52200 2024-09-15T23:19:16.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.077+0000 7f8890bee740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55c155a50fe0 con 0x55c155a545e0 2024-09-15T23:19:16.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.077+0000 7f8890bee740 10 client.0 _ll_register_callbacks cb 0x55c15591d780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:19:16.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.077+0000 7f8887fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c155a49b10 0x55c155a4b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.077+0000 7f88877fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c155a52200 0x55c155a32e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.077+0000 7f88877fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c155a52200 0x55c155a32e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:41888/0 (socket says 172.21.15.123:41888) 2024-09-15T23:19:16.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.077+0000 7f88877fe640 1 -- 172.21.15.123:0/2850957051 learned_addr learned my addr 172.21.15.123:0/2850957051 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:16.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.077+0000 7f8887fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c155a49b10 0x55c155a4b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35668/0 (socket says 172.21.15.123:35668) 2024-09-15T23:19:16.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.077+0000 7f8886ffd640 1 --2- 172.21.15.123:0/2850957051 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c155a545e0 0x55c155a495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.077+0000 7f88877fe640 1 -- 172.21.15.123:0/2850957051 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c155a545e0 msgr2=0x55c155a495d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:16.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.077+0000 7f88877fe640 1 --2- 172.21.15.123:0/2850957051 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c155a545e0 0x55c155a495d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.077+0000 7f88877fe640 1 -- 172.21.15.123:0/2850957051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c155a49b10 msgr2=0x55c155a4b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:16.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.077+0000 7f88877fe640 1 --2- 172.21.15.123:0/2850957051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c155a49b10 0x55c155a4b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.077+0000 7f88877fe640 1 -- 172.21.15.123:0/2850957051 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1556430f0 con 0x55c155a52200 2024-09-15T23:19:16.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.077+0000 7f8887fff640 1 --2- 172.21.15.123:0/2850957051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c155a49b10 0x55c155a4b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:19:16.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.077+0000 7f88877fe640 1 --2- 172.21.15.123:0/2850957051 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c155a52200 0x55c155a32e90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f887800c240 tx=0x7f8878079210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d2bbc66100eb1c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:16.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.077+0000 7f88667fc640 10 client.0 ms_handle_connect on v2:172.21.15.188:3300/0 2024-09-15T23:19:16.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.077+0000 7f88667fc640 1 -- 172.21.15.123:0/2850957051 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88780a6060 con 0x55c155a52200 2024-09-15T23:19:16.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.077+0000 7f8890bee740 1 -- 172.21.15.123:0/2850957051 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f887c01a040 con 0x55c155a52200 2024-09-15T23:19:16.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.077+0000 7f88667fc640 1 -- 172.21.15.123:0/2850957051 <== mon.1 v2:172.21.15.188:3300/0 2 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f8878078520 con 0x55c155a52200 2024-09-15T23:19:16.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.078+0000 7f88667fc640 1 -- 172.21.15.123:0/2850957051 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f8878078720 con 0x55c155a52200 2024-09-15T23:19:16.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.078+0000 7f8890bee740 10 client.7186 fetch_fsmap learned FSMap version 80 2024-09-15T23:19:16.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.078+0000 7f8890bee740 1 -- 172.21.15.123:0/2850957051 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=2+}) -- 0x55c1557adf60 con 0x55c155a52200 2024-09-15T23:19:16.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.078+0000 7f88667fc640 1 -- 172.21.15.123:0/2850957051 <== mon.1 v2:172.21.15.188:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f887c01a040 con 0x55c155a52200 2024-09-15T23:19:16.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.078+0000 7f88667fc640 1 -- 172.21.15.123:0/2850957051 <== mon.1 v2:172.21.15.188:3300/0 5 ==== fsmap(e 80) ==== 3502+0+0 (secure 0 0 0) 0x7f88780a9080 con 0x55c155a52200 2024-09-15T23:19:16.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.078+0000 7f8890bee740 10 client.7186 fetch_fsmap finished waiting for FSMap version 80 2024-09-15T23:19:16.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.078+0000 7f8890bee740 10 client.7186 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-09-15T23:19:16.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.078+0000 7f8890bee740 20 client.7186 populate_metadata read hostname 'smithi123' 2024-09-15T23:19:16.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.078+0000 7f8890bee740 1 --2- 172.21.15.123:0/2850957051 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x55c155a36680 0x55c155a36a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.078+0000 7f8890bee740 4 client.7186 mds_command: new command op to 8034 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:19:16.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.078+0000 7f8890bee740 1 -- 172.21.15.123:0/2850957051 --> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c15597e000 con 0x55c155a36680 2024-09-15T23:19:16.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.078+0000 7f8886ffd640 1 --2- 172.21.15.123:0/2850957051 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x55c155a36680 0x55c155a36a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.078+0000 7f88667fc640 10 client.7186 ms_handle_connect on v2:172.21.15.188:6835/3551744094 2024-09-15T23:19:16.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.078+0000 7f8886ffd640 1 --2- 172.21.15.123:0/2850957051 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x55c155a36680 0x55c155a36a60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86dc5c413eea43aa server_cookie=ab88dd0e9eb10ed5 in_seq=0 out_seq=0 2024-09-15T23:19:16.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.079+0000 7f88667fc640 1 -- 172.21.15.123:0/2850957051 <== mds.0 v2:172.21.15.188:6835/3551744094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c15597e000 con 0x55c155a36680 2024-09-15T23:19:16.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.079+0000 7f88667fc640 10 client.7186 handle_command_reply: tid=0 2024-09-15T23:19:16.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.079+0000 7f8890bee740 1 client.7186 shutdown 2024-09-15T23:19:16.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.079+0000 7f8890bee740 1 -- 172.21.15.123:0/2850957051 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c155a52200 msgr2=0x55c155a32e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:16.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.079+0000 7f8890bee740 1 --2- 172.21.15.123:0/2850957051 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c155a52200 0x55c155a32e90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f887800c240 tx=0x7f8878079210 comp rx=0 tx=0).stop 2024-09-15T23:19:16.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.079+0000 7f8890bee740 1 -- 172.21.15.123:0/2850957051 shutdown_connections 2024-09-15T23:19:16.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.079+0000 7f8890bee740 1 --2- 172.21.15.123:0/2850957051 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x55c155a36680 0x55c155a36a60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.079+0000 7f8890bee740 1 --2- 172.21.15.123:0/2850957051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c155a49b10 0x55c155a4b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.079+0000 7f8890bee740 1 --2- 172.21.15.123:0/2850957051 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c155a545e0 0x55c155a495d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.079+0000 7f8890bee740 1 --2- 172.21.15.123:0/2850957051 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c155a52200 0x55c155a32e90 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.079+0000 7f88667fc640 0 client.7186 ms_handle_reset on v2:172.21.15.188:6835/3551744094 2024-09-15T23:19:16.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.079+0000 7f8890bee740 1 -- 172.21.15.123:0/2850957051 >> 172.21.15.123:0/2850957051 conn(0x55c155a51da0 msgr2=0x55c155a34330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:16.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.079+0000 7f8890bee740 1 -- 172.21.15.123:0/2850957051 shutdown_connections 2024-09-15T23:19:16.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.079+0000 7f8890bee740 1 -- 172.21.15.123:0/2850957051 wait complete. 2024-09-15T23:19:16.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.079+0000 7f8890bee740 20 client.7186 trim_cache size 0 max 16384 2024-09-15T23:19:16.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.096+0000 7f8890bee740 1 Processor -- start 2024-09-15T23:19:16.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.096+0000 7f8890bee740 1 -- start start 2024-09-15T23:19:16.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.097+0000 7f8890bee740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c155a49b10 0x55c155a527d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.097+0000 7f8890bee740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c155a52200 0x55c155a52d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.097+0000 7f8890bee740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c155a545e0 0x55c155a36a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.097+0000 7f8890bee740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8888201310 con 0x55c155a49b10 2024-09-15T23:19:16.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.097+0000 7f8890bee740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f88882003e0 con 0x55c155a52200 2024-09-15T23:19:16.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.097+0000 7f8890bee740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f88881f54a0 con 0x55c155a545e0 2024-09-15T23:19:16.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.097+0000 7f88877fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c155a49b10 0x55c155a527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.097+0000 7f88877fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c155a49b10 0x55c155a527d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35672/0 (socket says 172.21.15.123:35672) 2024-09-15T23:19:16.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.097+0000 7f88877fe640 1 -- 172.21.15.123:0/1534038762 learned_addr learned my addr 172.21.15.123:0/1534038762 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:16.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.097+0000 7f88877fe640 1 -- 172.21.15.123:0/1534038762 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c155a545e0 msgr2=0x55c155a36a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:16.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.097+0000 7f88877fe640 1 --2- 172.21.15.123:0/1534038762 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c155a545e0 0x55c155a36a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.097+0000 7f88877fe640 1 -- 172.21.15.123:0/1534038762 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c155a52200 msgr2=0x55c155a52d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:16.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.097+0000 7f88877fe640 1 --2- 172.21.15.123:0/1534038762 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c155a52200 0x55c155a52d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.097+0000 7f88877fe640 1 -- 172.21.15.123:0/1534038762 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c15561c1b0 con 0x55c155a49b10 2024-09-15T23:19:16.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.097+0000 7f88877fe640 1 --2- 172.21.15.123:0/1534038762 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c155a49b10 0x55c155a527d0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f887800c330 tx=0x7f8878048070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ae13d68c7e0ae server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:16.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.097+0000 7f886cff9640 1 -- 172.21.15.123:0/1534038762 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f887809e070 con 0x55c155a49b10 2024-09-15T23:19:16.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.097+0000 7f886cff9640 1 -- 172.21.15.123:0/1534038762 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8878075740 con 0x55c155a49b10 2024-09-15T23:19:16.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.097+0000 7f886cff9640 1 -- 172.21.15.123:0/1534038762 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88780a6040 con 0x55c155a49b10 2024-09-15T23:19:16.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.098+0000 7f8890bee740 1 -- 172.21.15.123:0/1534038762 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c155a49b10 msgr2=0x55c155a527d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:16.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.098+0000 7f8890bee740 1 --2- 172.21.15.123:0/1534038762 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c155a49b10 0x55c155a527d0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f887800c330 tx=0x7f8878048070 comp rx=0 tx=0).stop 2024-09-15T23:19:16.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.098+0000 7f8890bee740 1 -- 172.21.15.123:0/1534038762 shutdown_connections 2024-09-15T23:19:16.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.098+0000 7f8890bee740 1 --2- 172.21.15.123:0/1534038762 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c155a545e0 0x55c155a36a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.098+0000 7f8890bee740 1 --2- 172.21.15.123:0/1534038762 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c155a52200 0x55c155a52d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.098+0000 7f8890bee740 1 --2- 172.21.15.123:0/1534038762 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c155a49b10 0x55c155a527d0 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.098+0000 7f8890bee740 1 -- 172.21.15.123:0/1534038762 >> 172.21.15.123:0/1534038762 conn(0x55c155a51da0 msgr2=0x55c155a53750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:16.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.098+0000 7f8890bee740 1 -- 172.21.15.123:0/1534038762 shutdown_connections 2024-09-15T23:19:16.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.098+0000 7f8890bee740 1 -- 172.21.15.123:0/1534038762 wait complete. 2024-09-15T23:19:16.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.099+0000 7f8890bee740 1 -- start start 2024-09-15T23:19:16.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.099+0000 7f8890bee740 1 Processor -- start 2024-09-15T23:19:16.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.099+0000 7f8890bee740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c155a49b10 0x55c155a0e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.099+0000 7f8890bee740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c155a52200 0x55c155a4a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.099+0000 7f8890bee740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c155a545e0 0x55c155a55c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.099+0000 7f8890bee740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f88881f5af0 con 0x55c155a52200 2024-09-15T23:19:16.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.099+0000 7f8890bee740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55c155a555a0 con 0x55c155a545e0 2024-09-15T23:19:16.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.099+0000 7f8890bee740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55c155a759a0 con 0x55c155a49b10 2024-09-15T23:19:16.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.099+0000 7f8890bee740 10 client.0 _ll_register_callbacks cb 0x7f8878078a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:19:16.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.099+0000 7f8886ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c155a52200 0x55c155a4a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.100+0000 7f8886ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c155a52200 0x55c155a4a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35674/0 (socket says 172.21.15.123:35674) 2024-09-15T23:19:16.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.100+0000 7f8886ffd640 1 -- 172.21.15.123:0/949628833 learned_addr learned my addr 172.21.15.123:0/949628833 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:16.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.100+0000 7f88877fe640 1 --2- 172.21.15.123:0/949628833 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c155a49b10 0x55c155a0e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.100+0000 7f8887fff640 1 --2- 172.21.15.123:0/949628833 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c155a545e0 0x55c155a55c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.100+0000 7f8886ffd640 1 -- 172.21.15.123:0/949628833 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c155a49b10 msgr2=0x55c155a0e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:16.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.100+0000 7f8886ffd640 1 --2- 172.21.15.123:0/949628833 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c155a49b10 0x55c155a0e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.100+0000 7f8886ffd640 1 -- 172.21.15.123:0/949628833 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c155a545e0 msgr2=0x55c155a55c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:16.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.100+0000 7f8886ffd640 1 --2- 172.21.15.123:0/949628833 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c155a545e0 0x55c155a55c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.100+0000 7f8886ffd640 1 -- 172.21.15.123:0/949628833 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c155a566e0 con 0x55c155a52200 2024-09-15T23:19:16.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.100+0000 7f8886ffd640 1 --2- 172.21.15.123:0/949628833 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c155a52200 0x55c155a4a490 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f887c025040 tx=0x7f887c007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87dcd7854821b259 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:16.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.100+0000 7f88667fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:19:16.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.100+0000 7f88667fc640 1 -- 172.21.15.123:0/949628833 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f887c027070 con 0x55c155a52200 2024-09-15T23:19:16.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.100+0000 7f88667fc640 1 -- 172.21.15.123:0/949628833 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f887c015dd0 con 0x55c155a52200 2024-09-15T23:19:16.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.100+0000 7f8890bee740 1 -- 172.21.15.123:0/949628833 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8878075740 con 0x55c155a52200 2024-09-15T23:19:16.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.100+0000 7f88667fc640 1 -- 172.21.15.123:0/949628833 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f887c03e050 con 0x55c155a52200 2024-09-15T23:19:16.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.100+0000 7f8890bee740 10 client.8232 fetch_fsmap learned FSMap version 80 2024-09-15T23:19:16.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.100+0000 7f8890bee740 1 -- 172.21.15.123:0/949628833 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=2+}) -- 0x55c155a4a9d0 con 0x55c155a52200 2024-09-15T23:19:16.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.100+0000 7f88667fc640 1 -- 172.21.15.123:0/949628833 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8878075740 con 0x55c155a52200 2024-09-15T23:19:16.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.100+0000 7f88667fc640 1 -- 172.21.15.123:0/949628833 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 80) ==== 3502+0+0 (secure 0 0 0) 0x7f887c041020 con 0x55c155a52200 2024-09-15T23:19:16.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.100+0000 7f8890bee740 10 client.8232 fetch_fsmap finished waiting for FSMap version 80 2024-09-15T23:19:16.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.100+0000 7f8890bee740 10 client.8232 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-09-15T23:19:16.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.100+0000 7f8890bee740 20 client.8232 populate_metadata read hostname 'smithi123' 2024-09-15T23:19:16.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.100+0000 7f8890bee740 1 --2- 172.21.15.123:0/949628833 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x55c155a30e60 0x55c155acf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.100+0000 7f8890bee740 4 client.8232 mds_command: new command op to 8034 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-09-15T23:19:16.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.100+0000 7f8890bee740 1 -- 172.21.15.123:0/949628833 --> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] -- command(tid 0: {"prefix": "scrub abort"}) -- 0x55c155978350 con 0x55c155a30e60 2024-09-15T23:19:16.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.101+0000 7f88877fe640 1 --2- 172.21.15.123:0/949628833 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x55c155a30e60 0x55c155acf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.101+0000 7f88877fe640 1 --2- 172.21.15.123:0/949628833 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x55c155a30e60 0x55c155acf520 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=258e3560a06c7937 server_cookie=15621dcb639c16e9 in_seq=0 out_seq=0 2024-09-15T23:19:16.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.101+0000 7f88667fc640 10 client.8232 ms_handle_connect on v2:172.21.15.188:6835/3551744094 2024-09-15T23:19:16.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.101+0000 7f88667fc640 1 -- 172.21.15.123:0/949628833 <== mds.0 v2:172.21.15.188:6835/3551744094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c155978350 con 0x55c155a30e60 2024-09-15T23:19:16.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.101+0000 7f88667fc640 10 client.8232 handle_command_reply: tid=0 2024-09-15T23:19:16.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.101+0000 7f8890bee740 1 client.8232 shutdown 2024-09-15T23:19:16.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.101+0000 7f8890bee740 1 -- 172.21.15.123:0/949628833 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c155a52200 msgr2=0x55c155a4a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:16.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.101+0000 7f8890bee740 1 --2- 172.21.15.123:0/949628833 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c155a52200 0x55c155a4a490 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f887c025040 tx=0x7f887c007c80 comp rx=0 tx=0).stop 2024-09-15T23:19:16.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.101+0000 7f8890bee740 1 -- 172.21.15.123:0/949628833 shutdown_connections 2024-09-15T23:19:16.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.101+0000 7f8890bee740 1 --2- 172.21.15.123:0/949628833 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x55c155a30e60 0x55c155acf520 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.101+0000 7f8890bee740 1 --2- 172.21.15.123:0/949628833 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c155a545e0 0x55c155a55c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.101+0000 7f8890bee740 1 --2- 172.21.15.123:0/949628833 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c155a52200 0x55c155a4a490 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.101+0000 7f88667fc640 0 client.8232 ms_handle_reset on v2:172.21.15.188:6835/3551744094 2024-09-15T23:19:16.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.101+0000 7f8890bee740 1 --2- 172.21.15.123:0/949628833 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c155a49b10 0x55c155a0e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.101+0000 7f8890bee740 1 -- 172.21.15.123:0/949628833 >> 172.21.15.123:0/949628833 conn(0x55c155a51da0 msgr2=0x55c155a527d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:16.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.101+0000 7f8890bee740 1 -- 172.21.15.123:0/949628833 shutdown_connections 2024-09-15T23:19:16.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.101+0000 7f8890bee740 1 -- 172.21.15.123:0/949628833 wait complete. 2024-09-15T23:19:16.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.101+0000 7f8890bee740 20 client.8232 trim_cache size 0 max 16384 2024-09-15T23:19:16.109 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:19:16.109 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "", 2024-09-15T23:19:16.109 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0 2024-09-15T23:19:16.109 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:19:16.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.102+0000 7f888dd78640 1 -- 172.21.15.123:0/1738717636 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f887406c2b0 msgr2=0x7f887406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:16.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.102+0000 7f888dd78640 1 --2- 172.21.15.123:0/1738717636 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f887406c2b0 0x7f887406e770 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f88880b9b70 tx=0x7f887c009040 comp rx=0 tx=0).stop 2024-09-15T23:19:16.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.102+0000 7f888dd78640 1 -- 172.21.15.123:0/1738717636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88700039b0 msgr2=0x7f88881f7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:16.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.102+0000 7f888dd78640 1 --2- 172.21.15.123:0/1738717636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88700039b0 0x7f88881f7740 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f887800c360 tx=0x7f88880cfbc0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.102+0000 7f888dd78640 1 -- 172.21.15.123:0/1738717636 shutdown_connections 2024-09-15T23:19:16.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.102+0000 7f888dd78640 1 --2- 172.21.15.123:0/1738717636 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f88880b4640 0x7f88880b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.102+0000 7f888dd78640 1 --2- 172.21.15.123:0/1738717636 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f88880cde20 0x7f88880abb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.102+0000 7f888dd78640 1 --2- 172.21.15.123:0/1738717636 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f887406c2b0 0x7f887406e770 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.102+0000 7f888dd78640 1 --2- 172.21.15.123:0/1738717636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f88700039b0 0x7f88881f7740 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.102+0000 7f888dd78640 1 -- 172.21.15.123:0/1738717636 >> 172.21.15.123:0/1738717636 conn(0x7f88880d11c0 msgr2=0x7f88880b8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:16.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.102+0000 7f888dd78640 1 -- 172.21.15.123:0/1738717636 shutdown_connections 2024-09-15T23:19:16.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.102+0000 7f888dd78640 1 -- 172.21.15.123:0/1738717636 wait complete. 2024-09-15T23:19:16.113 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-15T23:19:16.113 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.8:0 scrub status 2024-09-15T23:19:16.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.212+0000 7fb854c2c640 1 Processor -- start 2024-09-15T23:19:16.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.212+0000 7fb854c2c640 1 -- start start 2024-09-15T23:19:16.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.213+0000 7fb854c2c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb85015b7c0 0x7fb8500b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.213+0000 7fb854c2c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb8500cead0 0x7fb850071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.213+0000 7fb854c2c640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8500cf2e0 con 0x7fb8500ccf30 2024-09-15T23:19:16.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.213+0000 7fb854c2c640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fb850070fe0 con 0x7fb85015b7c0 2024-09-15T23:19:16.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.213+0000 7fb854c2c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fb8500712c0 con 0x7fb8500cead0 2024-09-15T23:19:16.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.213+0000 7fb84dd9b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb85015b7c0 0x7fb8500b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.213+0000 7fb84dd9b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb85015b7c0 0x7fb8500b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60948/0 (socket says 172.21.15.123:60948) 2024-09-15T23:19:16.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.213+0000 7fb84dd9b640 1 -- 172.21.15.123:0/2041325155 learned_addr learned my addr 172.21.15.123:0/2041325155 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:16.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.213+0000 7fb84e59c640 1 --1- 172.21.15.123:0/2041325155 >> v1:172.21.15.123:6789/0 conn(0x7fb8500ccf30 0x7fb8500cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51840/0 (socket says 172.21.15.123:51840) 2024-09-15T23:19:16.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.213+0000 7fb84ed9d640 1 --2- 172.21.15.123:0/2041325155 >> v2:172.21.15.188:3300/0 conn(0x7fb8500cead0 0x7fb850071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.213+0000 7fb84dd9b640 1 -- 172.21.15.123:0/2041325155 >> v2:172.21.15.188:3300/0 conn(0x7fb8500cead0 msgr2=0x7fb850071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:16.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.213+0000 7fb84dd9b640 1 --2- 172.21.15.123:0/2041325155 >> v2:172.21.15.188:3300/0 conn(0x7fb8500cead0 0x7fb850071ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.213+0000 7fb84dd9b640 1 -- 172.21.15.123:0/2041325155 >> v1:172.21.15.123:6789/0 conn(0x7fb8500ccf30 legacy=0x7fb8500cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:16.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.213+0000 7fb84dd9b640 1 -- 172.21.15.123:0/2041325155 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8500715a0 con 0x7fb85015b7c0 2024-09-15T23:19:16.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.213+0000 7fb84ed9d640 1 --2- 172.21.15.123:0/2041325155 >> v2:172.21.15.188:3300/0 conn(0x7fb8500cead0 0x7fb850071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:19:16.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.214+0000 7fb84dd9b640 1 --2- 172.21.15.123:0/2041325155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb85015b7c0 0x7fb8500b2c50 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fb85006f170 tx=0x7fb84402c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cccc0f919efd3d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:16.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.214+0000 7fb84d59a640 1 -- 172.21.15.123:0/2041325155 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb844033640 con 0x7fb85015b7c0 2024-09-15T23:19:16.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.214+0000 7fb84d59a640 1 -- 172.21.15.123:0/2041325155 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb844038070 con 0x7fb85015b7c0 2024-09-15T23:19:16.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.214+0000 7fb84d59a640 1 -- 172.21.15.123:0/2041325155 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb844033a00 con 0x7fb85015b7c0 2024-09-15T23:19:16.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.215+0000 7fb854c2c640 1 -- 172.21.15.123:0/2041325155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb85015b7c0 msgr2=0x7fb8500b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:16.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.215+0000 7fb854c2c640 1 --2- 172.21.15.123:0/2041325155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb85015b7c0 0x7fb8500b2c50 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fb85006f170 tx=0x7fb84402c8b0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.215+0000 7fb854c2c640 1 -- 172.21.15.123:0/2041325155 shutdown_connections 2024-09-15T23:19:16.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.215+0000 7fb854c2c640 1 --2- 172.21.15.123:0/2041325155 >> v2:172.21.15.188:3300/0 conn(0x7fb8500cead0 0x7fb850071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.215+0000 7fb854c2c640 1 --2- 172.21.15.123:0/2041325155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb85015b7c0 0x7fb8500b2c50 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.215+0000 7fb854c2c640 1 -- 172.21.15.123:0/2041325155 >> 172.21.15.123:0/2041325155 conn(0x7fb85006d0f0 msgr2=0x7fb85006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:16.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.215+0000 7fb854c2c640 1 -- 172.21.15.123:0/2041325155 shutdown_connections 2024-09-15T23:19:16.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.215+0000 7fb854c2c640 1 -- 172.21.15.123:0/2041325155 wait complete. 2024-09-15T23:19:16.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.216+0000 7fb854c2c640 1 Processor -- start 2024-09-15T23:19:16.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.216+0000 7fb854c2c640 1 -- start start 2024-09-15T23:19:16.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.217+0000 7fb854c2c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb8500ccf30 0x7fb850156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.217+0000 7fb854c2c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb8500cead0 0x7fb8501459e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.217+0000 7fb854c2c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb85015b7c0 0x7fb850145f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.217+0000 7fb854c2c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb8500cf080 con 0x7fb85015b7c0 2024-09-15T23:19:16.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.217+0000 7fb854c2c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb8500cef00 con 0x7fb8500ccf30 2024-09-15T23:19:16.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.217+0000 7fb854c2c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb850072000 con 0x7fb8500cead0 2024-09-15T23:19:16.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.217+0000 7fb84ed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb85015b7c0 0x7fb850145f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.217+0000 7fb84ed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb85015b7c0 0x7fb850145f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60954/0 (socket says 172.21.15.123:60954) 2024-09-15T23:19:16.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.217+0000 7fb84ed9d640 1 -- 172.21.15.123:0/2441565653 learned_addr learned my addr 172.21.15.123:0/2441565653 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:16.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.217+0000 7fb84dd9b640 1 --2- 172.21.15.123:0/2441565653 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb8500cead0 0x7fb8501459e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.217+0000 7fb84e59c640 1 --2- 172.21.15.123:0/2441565653 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb8500ccf30 0x7fb850156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.217+0000 7fb84ed9d640 1 -- 172.21.15.123:0/2441565653 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb8500cead0 msgr2=0x7fb8501459e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:16.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.217+0000 7fb84ed9d640 1 --2- 172.21.15.123:0/2441565653 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb8500cead0 0x7fb8501459e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.217+0000 7fb84ed9d640 1 -- 172.21.15.123:0/2441565653 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb8500ccf30 msgr2=0x7fb850156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:16.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.217+0000 7fb84ed9d640 1 --2- 172.21.15.123:0/2441565653 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb8500ccf30 0x7fb850156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.217+0000 7fb84ed9d640 1 -- 172.21.15.123:0/2441565653 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb85015ea70 con 0x7fb85015b7c0 2024-09-15T23:19:16.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.217+0000 7fb84ed9d640 1 --2- 172.21.15.123:0/2441565653 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb85015b7c0 0x7fb850145f20 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fb84800cf20 tx=0x7fb84800a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:16.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.218+0000 7fb83effd640 1 -- 172.21.15.123:0/2441565653 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84801a070 con 0x7fb85015b7c0 2024-09-15T23:19:16.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.218+0000 7fb83effd640 1 -- 172.21.15.123:0/2441565653 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb84800d840 con 0x7fb85015b7c0 2024-09-15T23:19:16.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.218+0000 7fb854c2c640 1 -- 172.21.15.123:0/2441565653 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8501576b0 con 0x7fb85015b7c0 2024-09-15T23:19:16.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.218+0000 7fb83effd640 1 -- 172.21.15.123:0/2441565653 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84800dc30 con 0x7fb85015b7c0 2024-09-15T23:19:16.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.218+0000 7fb854c2c640 1 -- 172.21.15.123:0/2441565653 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb850143940 con 0x7fb85015b7c0 2024-09-15T23:19:16.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.219+0000 7fb83effd640 1 -- 172.21.15.123:0/2441565653 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb84801d070 con 0x7fb85015b7c0 2024-09-15T23:19:16.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.219+0000 7fb83effd640 1 --2- 172.21.15.123:0/2441565653 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb83006c2b0 0x7fb83006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.220+0000 7fb83effd640 1 -- 172.21.15.123:0/2441565653 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7fb84808bca0 con 0x7fb85015b7c0 2024-09-15T23:19:16.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.220+0000 7fb84e59c640 1 --2- 172.21.15.123:0/2441565653 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb83006c2b0 0x7fb83006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.220+0000 7fb84e59c640 1 --2- 172.21.15.123:0/2441565653 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb83006c2b0 0x7fb83006e770 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb840007fd0 tx=0x7fb840007e80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:16.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.221+0000 7fb8579bf740 1 Processor -- start 2024-09-15T23:19:16.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.221+0000 7fb8579bf740 1 -- start start 2024-09-15T23:19:16.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.221+0000 7fb8579bf740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56171ec0b780 0x56171ec0bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.221+0000 7fb8579bf740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56171ec26140 0x56171ec278f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.221+0000 7fb8579bf740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56171ebdf0e0 0x56171ec27e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.221+0000 7fb8579bf740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56171eb446f0 con 0x56171ebdf0e0 2024-09-15T23:19:16.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.221+0000 7fb8579bf740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56171eaec330 con 0x56171ec0b780 2024-09-15T23:19:16.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.221+0000 7fb8579bf740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x56171eb406b0 con 0x56171ec26140 2024-09-15T23:19:16.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.222+0000 7fb84ed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56171ebdf0e0 0x56171ec27e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.222+0000 7fb84e59c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56171ec0b780 0x56171ec0bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.222+0000 7fb84dd9b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56171ec26140 0x56171ec278f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.222+0000 7fb84ed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56171ebdf0e0 0x56171ec27e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60964/0 (socket says 172.21.15.123:60964) 2024-09-15T23:19:16.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.222+0000 7fb84e59c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56171ec0b780 0x56171ec0bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:51578/0 (socket says 172.21.15.123:51578) 2024-09-15T23:19:16.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.222+0000 7fb84ed9d640 1 -- 172.21.15.123:0/2622706254 learned_addr learned my addr 172.21.15.123:0/2622706254 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:16.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.222+0000 7fb84dd9b640 1 -- 172.21.15.123:0/2622706254 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56171ec0b780 msgr2=0x56171ec0bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:16.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.222+0000 7fb84dd9b640 1 --2- 172.21.15.123:0/2622706254 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56171ec0b780 0x56171ec0bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.222+0000 7fb84dd9b640 1 -- 172.21.15.123:0/2622706254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56171ebdf0e0 msgr2=0x56171ec27e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:16.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.222+0000 7fb84dd9b640 1 --2- 172.21.15.123:0/2622706254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56171ebdf0e0 0x56171ec27e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.222+0000 7fb84dd9b640 1 -- 172.21.15.123:0/2622706254 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56171eb120d0 con 0x56171ec26140 2024-09-15T23:19:16.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.222+0000 7fb84e59c640 1 --2- 172.21.15.123:0/2622706254 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56171ec0b780 0x56171ec0bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:19:16.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.222+0000 7fb84ed9d640 1 --2- 172.21.15.123:0/2622706254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56171ebdf0e0 0x56171ec27e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:19:16.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.222+0000 7fb84dd9b640 1 --2- 172.21.15.123:0/2622706254 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56171ec26140 0x56171ec278f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb844034000 tx=0x7fb844032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c4b9d76df6fc813 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:16.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.222+0000 7fb82ffff640 1 -- 172.21.15.123:0/2622706254 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb844042070 con 0x56171ec26140 2024-09-15T23:19:16.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.222+0000 7fb82ffff640 1 -- 172.21.15.123:0/2622706254 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb844038040 con 0x56171ec26140 2024-09-15T23:19:16.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.222+0000 7fb82ffff640 1 -- 172.21.15.123:0/2622706254 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb844033c70 con 0x56171ec26140 2024-09-15T23:19:16.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.223+0000 7fb8579bf740 1 -- 172.21.15.123:0/2622706254 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56171ec26140 msgr2=0x56171ec278f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:16.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.223+0000 7fb8579bf740 1 --2- 172.21.15.123:0/2622706254 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56171ec26140 0x56171ec278f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb844034000 tx=0x7fb844032000 comp rx=0 tx=0).stop 2024-09-15T23:19:16.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.223+0000 7fb8579bf740 1 -- 172.21.15.123:0/2622706254 shutdown_connections 2024-09-15T23:19:16.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.223+0000 7fb8579bf740 1 --2- 172.21.15.123:0/2622706254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56171ebdf0e0 0x56171ec27e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.223+0000 7fb8579bf740 1 --2- 172.21.15.123:0/2622706254 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56171ec26140 0x56171ec278f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.223+0000 7fb8579bf740 1 --2- 172.21.15.123:0/2622706254 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56171ec0b780 0x56171ec0bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.223+0000 7fb8579bf740 1 -- 172.21.15.123:0/2622706254 >> 172.21.15.123:0/2622706254 conn(0x56171ebde370 msgr2=0x56171ec26590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:16.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.223+0000 7fb8579bf740 1 -- 172.21.15.123:0/2622706254 shutdown_connections 2024-09-15T23:19:16.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.223+0000 7fb8579bf740 1 -- 172.21.15.123:0/2622706254 wait complete. 2024-09-15T23:19:16.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.224+0000 7fb8579bf740 1 -- start start 2024-09-15T23:19:16.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.224+0000 7fb8579bf740 1 Processor -- start 2024-09-15T23:19:16.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.225+0000 7fb8579bf740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56171ec0b780 0x56171ec21490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.225+0000 7fb8579bf740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56171ec26140 0x56171ec0cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.225+0000 7fb8579bf740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56171ec0d070 0x56171ebfbf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.225+0000 7fb8579bf740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56171ec0c540 con 0x56171ec0d070 2024-09-15T23:19:16.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.225+0000 7fb8579bf740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56171eacd4f0 con 0x56171ec0b780 2024-09-15T23:19:16.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.225+0000 7fb8579bf740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x56171ec26dd0 con 0x56171ec26140 2024-09-15T23:19:16.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.225+0000 7fb8579bf740 10 client.0 _ll_register_callbacks cb 0x56171eaeeb50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:19:16.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.225+0000 7fb84ed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56171ec0d070 0x56171ebfbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.225+0000 7fb84ed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56171ec0d070 0x56171ebfbf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60978/0 (socket says 172.21.15.123:60978) 2024-09-15T23:19:16.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.225+0000 7fb84ed9d640 1 -- 172.21.15.123:0/1064487096 learned_addr learned my addr 172.21.15.123:0/1064487096 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:16.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.225+0000 7fb84e59c640 1 --2- 172.21.15.123:0/1064487096 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56171ec0b780 0x56171ec21490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.225+0000 7fb84dd9b640 1 --2- 172.21.15.123:0/1064487096 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56171ec26140 0x56171ec0cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.225+0000 7fb84ed9d640 1 -- 172.21.15.123:0/1064487096 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56171ec26140 msgr2=0x56171ec0cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:16.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.225+0000 7fb84ed9d640 1 --2- 172.21.15.123:0/1064487096 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56171ec26140 0x56171ec0cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.225+0000 7fb84ed9d640 1 -- 172.21.15.123:0/1064487096 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56171ec0b780 msgr2=0x56171ec21490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:16.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.225+0000 7fb84ed9d640 1 --2- 172.21.15.123:0/1064487096 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56171ec0b780 0x56171ec21490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.225+0000 7fb84ed9d640 1 -- 172.21.15.123:0/1064487096 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56171e9217d0 con 0x56171ec0d070 2024-09-15T23:19:16.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.225+0000 7fb84dd9b640 1 --2- 172.21.15.123:0/1064487096 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56171ec26140 0x56171ec0cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:19:16.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.225+0000 7fb84ed9d640 1 --2- 172.21.15.123:0/1064487096 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56171ec0d070 0x56171ebfbf10 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fb848059a40 tx=0x7fb848059e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d5882c5a6823386 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:16.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.225+0000 7fb82d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:19:16.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.225+0000 7fb82d7fa640 1 -- 172.21.15.123:0/1064487096 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8480623e0 con 0x56171ec0d070 2024-09-15T23:19:16.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.225+0000 7fb82d7fa640 1 -- 172.21.15.123:0/1064487096 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7fb848062580 con 0x56171ec0d070 2024-09-15T23:19:16.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.225+0000 7fb8579bf740 1 -- 172.21.15.123:0/1064487096 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb844038040 con 0x56171ec0d070 2024-09-15T23:19:16.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.225+0000 7fb82d7fa640 1 -- 172.21.15.123:0/1064487096 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fb848083b30 con 0x56171ec0d070 2024-09-15T23:19:16.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.225+0000 7fb8579bf740 10 client.8247 fetch_fsmap learned FSMap version 80 2024-09-15T23:19:16.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.225+0000 7fb8579bf740 1 -- 172.21.15.123:0/1064487096 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=2+}) -- 0x56171e8573f0 con 0x56171ec0d070 2024-09-15T23:19:16.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.226+0000 7fb82d7fa640 1 -- 172.21.15.123:0/1064487096 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb844038040 con 0x56171ec0d070 2024-09-15T23:19:16.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.226+0000 7fb82d7fa640 1 -- 172.21.15.123:0/1064487096 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 80) ==== 3502+0+0 (secure 0 0 0) 0x7fb848059190 con 0x56171ec0d070 2024-09-15T23:19:16.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.226+0000 7fb8579bf740 10 client.8247 fetch_fsmap finished waiting for FSMap version 80 2024-09-15T23:19:16.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.226+0000 7fb8579bf740 10 client.8247 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-09-15T23:19:16.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.226+0000 7fb8579bf740 20 client.8247 populate_metadata read hostname 'smithi123' 2024-09-15T23:19:16.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.226+0000 7fb8579bf740 1 --2- 172.21.15.123:0/1064487096 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x56171ec0ed00 0x56171ec0f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.226+0000 7fb8579bf740 4 client.8247 mds_command: new command op to 8034 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:19:16.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.226+0000 7fb8579bf740 1 -- 172.21.15.123:0/1064487096 --> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56171eb51e20 con 0x56171ec0ed00 2024-09-15T23:19:16.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.226+0000 7fb84e59c640 1 --2- 172.21.15.123:0/1064487096 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x56171ec0ed00 0x56171ec0f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.226+0000 7fb82d7fa640 10 client.8247 ms_handle_connect on v2:172.21.15.188:6835/3551744094 2024-09-15T23:19:16.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.226+0000 7fb84e59c640 1 --2- 172.21.15.123:0/1064487096 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x56171ec0ed00 0x56171ec0f110 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53d5c8ba2184905b server_cookie=292c976ab85ff1d1 in_seq=0 out_seq=0 2024-09-15T23:19:16.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.227+0000 7fb82d7fa640 1 -- 172.21.15.123:0/1064487096 <== mds.0 v2:172.21.15.188:6835/3551744094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56171eb51e20 con 0x56171ec0ed00 2024-09-15T23:19:16.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.227+0000 7fb82d7fa640 10 client.8247 handle_command_reply: tid=0 2024-09-15T23:19:16.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.227+0000 7fb8579bf740 1 client.8247 shutdown 2024-09-15T23:19:16.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.227+0000 7fb8579bf740 1 -- 172.21.15.123:0/1064487096 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56171ec0d070 msgr2=0x56171ebfbf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:16.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.227+0000 7fb8579bf740 1 --2- 172.21.15.123:0/1064487096 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56171ec0d070 0x56171ebfbf10 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fb848059a40 tx=0x7fb848059e80 comp rx=0 tx=0).stop 2024-09-15T23:19:16.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.227+0000 7fb8579bf740 1 -- 172.21.15.123:0/1064487096 shutdown_connections 2024-09-15T23:19:16.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.227+0000 7fb8579bf740 1 --2- 172.21.15.123:0/1064487096 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x56171ec0ed00 0x56171ec0f110 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.227+0000 7fb8579bf740 1 --2- 172.21.15.123:0/1064487096 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56171ec0d070 0x56171ebfbf10 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.227+0000 7fb8579bf740 1 --2- 172.21.15.123:0/1064487096 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56171ec26140 0x56171ec0cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.227+0000 7fb82d7fa640 0 client.8247 ms_handle_reset on v2:172.21.15.188:6835/3551744094 2024-09-15T23:19:16.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.227+0000 7fb8579bf740 1 --2- 172.21.15.123:0/1064487096 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56171ec0b780 0x56171ec21490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.227+0000 7fb8579bf740 1 -- 172.21.15.123:0/1064487096 >> 172.21.15.123:0/1064487096 conn(0x56171ebdf0e0 msgr2=0x56171ebdb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:16.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.227+0000 7fb8579bf740 1 -- 172.21.15.123:0/1064487096 shutdown_connections 2024-09-15T23:19:16.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.227+0000 7fb8579bf740 1 -- 172.21.15.123:0/1064487096 wait complete. 2024-09-15T23:19:16.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.228+0000 7fb8579bf740 20 client.8247 trim_cache size 0 max 16384 2024-09-15T23:19:16.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.245+0000 7fb8579bf740 1 Processor -- start 2024-09-15T23:19:16.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.245+0000 7fb8579bf740 1 -- start start 2024-09-15T23:19:16.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.245+0000 7fb8579bf740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56171ec0b780 0x56171ec07ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.245+0000 7fb8579bf740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56171ec0d070 0x56171ec21c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.245+0000 7fb8579bf740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56171ec26140 0x56171ec22140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.245+0000 7fb8579bf740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56171ec0d7c0 con 0x56171ec26140 2024-09-15T23:19:16.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.245+0000 7fb8579bf740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb8501fc710 con 0x56171ec0b780 2024-09-15T23:19:16.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.245+0000 7fb8579bf740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb8501fb770 con 0x56171ec0d070 2024-09-15T23:19:16.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.245+0000 7fb84ed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56171ec26140 0x56171ec22140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.245+0000 7fb84ed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56171ec26140 0x56171ec22140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60988/0 (socket says 172.21.15.123:60988) 2024-09-15T23:19:16.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.245+0000 7fb84ed9d640 1 -- 172.21.15.123:0/789218828 learned_addr learned my addr 172.21.15.123:0/789218828 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:16.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.246+0000 7fb84dd9b640 1 --2- 172.21.15.123:0/789218828 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56171ec0d070 0x56171ec21c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.246+0000 7fb84e59c640 1 --2- 172.21.15.123:0/789218828 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56171ec0b780 0x56171ec07ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.246+0000 7fb84ed9d640 1 -- 172.21.15.123:0/789218828 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56171ec0d070 msgr2=0x56171ec21c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:16.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.246+0000 7fb84ed9d640 1 --2- 172.21.15.123:0/789218828 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56171ec0d070 0x56171ec21c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.246+0000 7fb84ed9d640 1 -- 172.21.15.123:0/789218828 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56171ec0b780 msgr2=0x56171ec07ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:16.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.246+0000 7fb84ed9d640 1 --2- 172.21.15.123:0/789218828 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56171ec0b780 0x56171ec07ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.246+0000 7fb84ed9d640 1 -- 172.21.15.123:0/789218828 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56171ec0bed0 con 0x56171ec26140 2024-09-15T23:19:16.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.246+0000 7fb84ed9d640 1 --2- 172.21.15.123:0/789218828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56171ec26140 0x56171ec22140 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fb848062340 tx=0x7fb848017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=906223ae74a2fb96 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:16.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.246+0000 7fb82f7fe640 1 -- 172.21.15.123:0/789218828 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8480596a0 con 0x56171ec26140 2024-09-15T23:19:16.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.246+0000 7fb82f7fe640 1 -- 172.21.15.123:0/789218828 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb848059190 con 0x56171ec26140 2024-09-15T23:19:16.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.246+0000 7fb82f7fe640 1 -- 172.21.15.123:0/789218828 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb848055fe0 con 0x56171ec26140 2024-09-15T23:19:16.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.246+0000 7fb8579bf740 1 -- 172.21.15.123:0/789218828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56171ec26140 msgr2=0x56171ec22140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:16.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.246+0000 7fb8579bf740 1 --2- 172.21.15.123:0/789218828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56171ec26140 0x56171ec22140 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fb848062340 tx=0x7fb848017000 comp rx=0 tx=0).stop 2024-09-15T23:19:16.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.246+0000 7fb8579bf740 1 -- 172.21.15.123:0/789218828 shutdown_connections 2024-09-15T23:19:16.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.246+0000 7fb8579bf740 1 --2- 172.21.15.123:0/789218828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56171ec26140 0x56171ec22140 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.246+0000 7fb8579bf740 1 --2- 172.21.15.123:0/789218828 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56171ec0d070 0x56171ec21c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.246+0000 7fb8579bf740 1 --2- 172.21.15.123:0/789218828 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56171ec0b780 0x56171ec07ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.246+0000 7fb8579bf740 1 -- 172.21.15.123:0/789218828 >> 172.21.15.123:0/789218828 conn(0x56171ebdf0e0 msgr2=0x56171ec28440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:16.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.246+0000 7fb8579bf740 1 -- 172.21.15.123:0/789218828 shutdown_connections 2024-09-15T23:19:16.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.246+0000 7fb8579bf740 1 -- 172.21.15.123:0/789218828 wait complete. 2024-09-15T23:19:16.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.247+0000 7fb8579bf740 1 -- start start 2024-09-15T23:19:16.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.247+0000 7fb8579bf740 1 Processor -- start 2024-09-15T23:19:16.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.248+0000 7fb8579bf740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56171ec0b780 0x56171eca8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.248+0000 7fb8579bf740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56171ec0d070 0x56171ebdc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.248+0000 7fb8579bf740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56171ec26140 0x56171ebdc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.248+0000 7fb8579bf740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb8501fb120 con 0x56171ec26140 2024-09-15T23:19:16.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.248+0000 7fb8579bf740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb850156660 con 0x56171ec0b780 2024-09-15T23:19:16.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.248+0000 7fb8579bf740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x56171ec0d7c0 con 0x56171ec0d070 2024-09-15T23:19:16.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.248+0000 7fb8579bf740 10 client.0 _ll_register_callbacks cb 0x7fb84808a1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:19:16.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.248+0000 7fb84ed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56171ec26140 0x56171ebdc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.248+0000 7fb84ed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56171ec26140 0x56171ebdc5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60998/0 (socket says 172.21.15.123:60998) 2024-09-15T23:19:16.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.248+0000 7fb84ed9d640 1 -- 172.21.15.123:0/2796272544 learned_addr learned my addr 172.21.15.123:0/2796272544 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:16.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.248+0000 7fb84dd9b640 1 --2- 172.21.15.123:0/2796272544 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56171ec0d070 0x56171ebdc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.248+0000 7fb84e59c640 1 --2- 172.21.15.123:0/2796272544 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56171ec0b780 0x56171eca8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.248+0000 7fb84ed9d640 1 -- 172.21.15.123:0/2796272544 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56171ec0d070 msgr2=0x56171ebdc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:16.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.248+0000 7fb84ed9d640 1 --2- 172.21.15.123:0/2796272544 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56171ec0d070 0x56171ebdc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.248+0000 7fb84ed9d640 1 -- 172.21.15.123:0/2796272544 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56171ec0b780 msgr2=0x56171eca8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:16.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.248+0000 7fb84ed9d640 1 --2- 172.21.15.123:0/2796272544 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56171ec0b780 0x56171eca8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.248+0000 7fb84ed9d640 1 -- 172.21.15.123:0/2796272544 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56171e8170f0 con 0x56171ec26140 2024-09-15T23:19:16.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.248+0000 7fb84ed9d640 1 --2- 172.21.15.123:0/2796272544 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56171ec26140 0x56171ebdc5c0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fb8480070b0 tx=0x7fb84808a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cdaaa3d1c54c8a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:16.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.248+0000 7fb82d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:19:16.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.249+0000 7fb82d7fa640 1 -- 172.21.15.123:0/2796272544 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb848055fe0 con 0x56171ec26140 2024-09-15T23:19:16.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.249+0000 7fb82d7fa640 1 -- 172.21.15.123:0/2796272544 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7fb848060450 con 0x56171ec26140 2024-09-15T23:19:16.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.249+0000 7fb8579bf740 1 -- 172.21.15.123:0/2796272544 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb848059190 con 0x56171ec26140 2024-09-15T23:19:16.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.249+0000 7fb82d7fa640 1 -- 172.21.15.123:0/2796272544 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fb8480596a0 con 0x56171ec26140 2024-09-15T23:19:16.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.249+0000 7fb8579bf740 10 client.8253 fetch_fsmap learned FSMap version 80 2024-09-15T23:19:16.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.249+0000 7fb8579bf740 1 -- 172.21.15.123:0/2796272544 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=2+}) -- 0x56171ebfb740 con 0x56171ec26140 2024-09-15T23:19:16.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.249+0000 7fb82d7fa640 1 -- 172.21.15.123:0/2796272544 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb848059190 con 0x56171ec26140 2024-09-15T23:19:16.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.249+0000 7fb82d7fa640 1 -- 172.21.15.123:0/2796272544 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 80) ==== 3502+0+0 (secure 0 0 0) 0x7fb848055a90 con 0x56171ec26140 2024-09-15T23:19:16.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.249+0000 7fb8579bf740 10 client.8253 fetch_fsmap finished waiting for FSMap version 80 2024-09-15T23:19:16.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.249+0000 7fb8579bf740 10 client.8253 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-09-15T23:19:16.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.249+0000 7fb8579bf740 20 client.8253 populate_metadata read hostname 'smithi123' 2024-09-15T23:19:16.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.249+0000 7fb8579bf740 1 --2- 172.21.15.123:0/2796272544 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x56171ec3e3e0 0x56171ec21c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:16.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.249+0000 7fb8579bf740 4 client.8253 mds_command: new command op to 8034 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:19:16.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.249+0000 7fb8579bf740 1 -- 172.21.15.123:0/2796272544 --> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56171eb4c170 con 0x56171ec3e3e0 2024-09-15T23:19:16.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.249+0000 7fb84e59c640 1 --2- 172.21.15.123:0/2796272544 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x56171ec3e3e0 0x56171ec21c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:16.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.249+0000 7fb82d7fa640 10 client.8253 ms_handle_connect on v2:172.21.15.188:6835/3551744094 2024-09-15T23:19:16.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.249+0000 7fb84e59c640 1 --2- 172.21.15.123:0/2796272544 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x56171ec3e3e0 0x56171ec21c00 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3416c642b643c26 server_cookie=c97d9b0404a53a53 in_seq=0 out_seq=0 2024-09-15T23:19:16.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.250+0000 7fb82d7fa640 1 -- 172.21.15.123:0/2796272544 <== mds.0 v2:172.21.15.188:6835/3551744094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+276 (crc 0 0 0) 0x56171eb4c170 con 0x56171ec3e3e0 2024-09-15T23:19:16.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.250+0000 7fb82d7fa640 10 client.8253 handle_command_reply: tid=0 2024-09-15T23:19:16.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.250+0000 7fb8579bf740 1 client.8253 shutdown 2024-09-15T23:19:16.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.250+0000 7fb8579bf740 1 -- 172.21.15.123:0/2796272544 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56171ec26140 msgr2=0x56171ebdc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:16.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.250+0000 7fb8579bf740 1 --2- 172.21.15.123:0/2796272544 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56171ec26140 0x56171ebdc5c0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fb8480070b0 tx=0x7fb84808a0a0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.250+0000 7fb8579bf740 1 -- 172.21.15.123:0/2796272544 shutdown_connections 2024-09-15T23:19:16.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.250+0000 7fb8579bf740 1 --2- 172.21.15.123:0/2796272544 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x56171ec3e3e0 0x56171ec21c00 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.250+0000 7fb8579bf740 1 --2- 172.21.15.123:0/2796272544 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56171ec26140 0x56171ebdc5c0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.250+0000 7fb8579bf740 1 --2- 172.21.15.123:0/2796272544 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56171ec0d070 0x56171ebdc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.250+0000 7fb82d7fa640 0 client.8253 ms_handle_reset on v2:172.21.15.188:6835/3551744094 2024-09-15T23:19:16.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.250+0000 7fb8579bf740 1 --2- 172.21.15.123:0/2796272544 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56171ec0b780 0x56171eca8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.250+0000 7fb8579bf740 1 -- 172.21.15.123:0/2796272544 >> 172.21.15.123:0/2796272544 conn(0x56171ebdf0e0 msgr2=0x56171ec07cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:16.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.250+0000 7fb8579bf740 1 -- 172.21.15.123:0/2796272544 shutdown_connections 2024-09-15T23:19:16.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.250+0000 7fb8579bf740 1 -- 172.21.15.123:0/2796272544 wait complete. 2024-09-15T23:19:16.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.250+0000 7fb8579bf740 20 client.8253 trim_cache size 0 max 16384 2024-09-15T23:19:16.257 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:19:16.258 INFO:teuthology.orchestra.run.smithi123.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-15T23:19:16.258 INFO:teuthology.orchestra.run.smithi123.stdout: "scrubs": { 2024-09-15T23:19:16.258 INFO:teuthology.orchestra.run.smithi123.stdout: "1fbb7dd9-1561-43ed-bf6d-d3b5f8fc6ea5": { 2024-09-15T23:19:16.258 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/scrub_control_test_path", 2024-09-15T23:19:16.258 INFO:teuthology.orchestra.run.smithi123.stdout: "tag": "1fbb7dd9-1561-43ed-bf6d-d3b5f8fc6ea5", 2024-09-15T23:19:16.258 INFO:teuthology.orchestra.run.smithi123.stdout: "options": "recursive" 2024-09-15T23:19:16.258 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:19:16.258 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:19:16.258 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:19:16.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.250+0000 7fb854c2c640 1 -- 172.21.15.123:0/2441565653 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb83006c2b0 msgr2=0x7fb83006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:16.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.250+0000 7fb854c2c640 1 --2- 172.21.15.123:0/2441565653 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb83006c2b0 0x7fb83006e770 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb840007fd0 tx=0x7fb840007e80 comp rx=0 tx=0).stop 2024-09-15T23:19:16.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.250+0000 7fb854c2c640 1 -- 172.21.15.123:0/2441565653 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb85015b7c0 msgr2=0x7fb850145f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:16.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.250+0000 7fb854c2c640 1 --2- 172.21.15.123:0/2441565653 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb85015b7c0 0x7fb850145f20 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fb84800cf20 tx=0x7fb84800a7d0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.251+0000 7fb854c2c640 1 -- 172.21.15.123:0/2441565653 shutdown_connections 2024-09-15T23:19:16.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.251+0000 7fb854c2c640 1 --2- 172.21.15.123:0/2441565653 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb83006c2b0 0x7fb83006e770 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.251+0000 7fb854c2c640 1 --2- 172.21.15.123:0/2441565653 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb85015b7c0 0x7fb850145f20 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.251+0000 7fb854c2c640 1 --2- 172.21.15.123:0/2441565653 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb8500cead0 0x7fb8501459e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.251+0000 7fb854c2c640 1 --2- 172.21.15.123:0/2441565653 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb8500ccf30 0x7fb850156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:16.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.251+0000 7fb854c2c640 1 -- 172.21.15.123:0/2441565653 >> 172.21.15.123:0/2441565653 conn(0x7fb85006d0f0 msgr2=0x7fb8500ce340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:16.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.251+0000 7fb854c2c640 1 -- 172.21.15.123:0/2441565653 shutdown_connections 2024-09-15T23:19:16.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:16.251+0000 7fb854c2c640 1 -- 172.21.15.123:0/2441565653 wait complete. 2024-09-15T23:19:21.263 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-15T23:19:21.263 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.8:0 scrub status 2024-09-15T23:19:21.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.375+0000 7f44e21bd640 1 Processor -- start 2024-09-15T23:19:21.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.375+0000 7f44e21bd640 1 -- start start 2024-09-15T23:19:21.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.376+0000 7f44e21bd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f44dc15b7c0 0x7f44dc0b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:21.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.376+0000 7f44e21bd640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44dc0cf2e0 con 0x7f44dc0ccf30 2024-09-15T23:19:21.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.376+0000 7f44e21bd640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44dc070fe0 con 0x7f44dc0cead0 2024-09-15T23:19:21.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.376+0000 7f44e21bd640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f44dc0712c0 con 0x7f44dc15b7c0 2024-09-15T23:19:21.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.376+0000 7f44db7fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f44dc0ccf30 0x7f44dc0cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51844/0 (socket says 172.21.15.123:51844) 2024-09-15T23:19:21.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.376+0000 7f44db7fe640 1 -- 172.21.15.123:0/2997789450 learned_addr learned my addr 172.21.15.123:0/2997789450 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:19:21.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.376+0000 7f44da7fc640 1 -- 172.21.15.123:0/2997789450 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2943207990 0 0) 0x7f44dc0cf2e0 con 0x7f44dc0ccf30 2024-09-15T23:19:21.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.376+0000 7f44da7fc640 1 -- 172.21.15.123:0/2997789450 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44c8003520 con 0x7f44dc0ccf30 2024-09-15T23:19:21.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.376+0000 7f44daffd640 1 --2- 172.21.15.123:0/2997789450 >> v2:172.21.15.188:3300/0 conn(0x7f44dc15b7c0 0x7f44dc0b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:21.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.376+0000 7f44da7fc640 1 -- 172.21.15.123:0/2997789450 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3708872680 0 0) 0x7f44c8003520 con 0x7f44dc0ccf30 2024-09-15T23:19:21.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.376+0000 7f44da7fc640 1 -- 172.21.15.123:0/2997789450 >> v2:172.21.15.188:3300/0 conn(0x7f44dc15b7c0 msgr2=0x7f44dc0b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:21.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.376+0000 7f44da7fc640 1 --2- 172.21.15.123:0/2997789450 >> v2:172.21.15.188:3300/0 conn(0x7f44dc15b7c0 0x7f44dc0b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.376+0000 7f44da7fc640 1 -- 172.21.15.123:0/2997789450 >> v1:172.21.15.188:6789/0 conn(0x7f44dc0cead0 legacy=0x7f44dc071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:21.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.376+0000 7f44da7fc640 1 -- 172.21.15.123:0/2997789450 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44dc0715a0 con 0x7f44dc0ccf30 2024-09-15T23:19:21.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.376+0000 7f44da7fc640 1 -- 172.21.15.123:0/2997789450 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f44cc001670 con 0x7f44dc0ccf30 2024-09-15T23:19:21.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.376+0000 7f44da7fc640 1 -- 172.21.15.123:0/2997789450 >> v1:172.21.15.123:6789/0 conn(0x7f44dc0ccf30 legacy=0x7f44dc0cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:21.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.376+0000 7f44da7fc640 1 --2- 172.21.15.123:0/2997789450 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44c80039b0 0x7f44c8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:21.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.376+0000 7f44da7fc640 1 --2- 172.21.15.123:0/2997789450 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44c8004800 0x7f44c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:21.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.376+0000 7f44da7fc640 1 --2- 172.21.15.123:0/2997789450 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44c80052e0 0x7f44c800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:21.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.376+0000 7f44da7fc640 1 -- 172.21.15.123:0/2997789450 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f44dc0712c0 con 0x7f44c8004800 2024-09-15T23:19:21.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.376+0000 7f44da7fc640 1 -- 172.21.15.123:0/2997789450 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f44c800c1b0 con 0x7f44c80052e0 2024-09-15T23:19:21.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.376+0000 7f44da7fc640 1 -- 172.21.15.123:0/2997789450 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f44c800c3b0 con 0x7f44c80039b0 2024-09-15T23:19:21.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.376+0000 7f44daffd640 1 --2- 172.21.15.123:0/2997789450 >> v2:172.21.15.188:3300/0 conn(0x7f44dc15b7c0 0x7f44dc0b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:19:21.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.377+0000 7f44daffd640 1 --2- 172.21.15.123:0/2997789450 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44c8004800 0x7f44c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:21.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.377+0000 7f44db7fe640 1 --2- 172.21.15.123:0/2997789450 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44c80039b0 0x7f44c8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:21.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.377+0000 7f44dbfff640 1 --2- 172.21.15.123:0/2997789450 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44c80052e0 0x7f44c800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:21.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.377+0000 7f44daffd640 1 -- 172.21.15.123:0/2997789450 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44c80039b0 msgr2=0x7f44c8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:21.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.377+0000 7f44daffd640 1 --2- 172.21.15.123:0/2997789450 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44c80039b0 0x7f44c8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.377+0000 7f44daffd640 1 -- 172.21.15.123:0/2997789450 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44c80052e0 msgr2=0x7f44c800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:21.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.377+0000 7f44daffd640 1 --2- 172.21.15.123:0/2997789450 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44c80052e0 0x7f44c800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.377+0000 7f44daffd640 1 -- 172.21.15.123:0/2997789450 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c8003520 con 0x7f44c8004800 2024-09-15T23:19:21.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.377+0000 7f44dbfff640 1 -- 172.21.15.123:0/2997789450 reap_dead start 2024-09-15T23:19:21.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.378+0000 7f44daffd640 1 --2- 172.21.15.123:0/2997789450 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44c8004800 0x7f44c8004c80 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f44c4006fd0 tx=0x7f44c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f654d5fca16262 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:21.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.378+0000 7f44da7fc640 1 -- 172.21.15.123:0/2997789450 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c4037070 con 0x7f44c8004800 2024-09-15T23:19:21.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.378+0000 7f44da7fc640 1 -- 172.21.15.123:0/2997789450 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c402ac70 con 0x7f44c8004800 2024-09-15T23:19:21.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.378+0000 7f44da7fc640 1 -- 172.21.15.123:0/2997789450 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c400f040 con 0x7f44c8004800 2024-09-15T23:19:21.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.378+0000 7f44e21bd640 1 -- 172.21.15.123:0/2997789450 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44c8004800 msgr2=0x7f44c8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:21.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.378+0000 7f44e21bd640 1 --2- 172.21.15.123:0/2997789450 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44c8004800 0x7f44c8004c80 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f44c4006fd0 tx=0x7f44c8005830 comp rx=0 tx=0).stop 2024-09-15T23:19:21.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.378+0000 7f44e21bd640 1 -- 172.21.15.123:0/2997789450 shutdown_connections 2024-09-15T23:19:21.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.378+0000 7f44e21bd640 1 --2- 172.21.15.123:0/2997789450 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44c8004800 0x7f44c8004c80 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.378+0000 7f44e21bd640 1 -- 172.21.15.123:0/2997789450 >> 172.21.15.123:0/2997789450 conn(0x7f44dc06d0f0 msgr2=0x7f44dc06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:21.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.378+0000 7f44e21bd640 1 -- 172.21.15.123:0/2997789450 shutdown_connections 2024-09-15T23:19:21.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.378+0000 7f44e21bd640 1 -- 172.21.15.123:0/2997789450 wait complete. 2024-09-15T23:19:21.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.379+0000 7f44e21bd640 1 Processor -- start 2024-09-15T23:19:21.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.380+0000 7f44e21bd640 1 -- start start 2024-09-15T23:19:21.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.380+0000 7f44e21bd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44c8004800 0x7f44dc15a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:21.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.380+0000 7f44e21bd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44dc159910 0x7f44dc156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:21.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.380+0000 7f44e21bd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44dc145e10 0x7f44dc146290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:21.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.380+0000 7f44e21bd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f44dc0cf080 con 0x7f44c8004800 2024-09-15T23:19:21.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.380+0000 7f44e21bd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f44dc0cef00 con 0x7f44dc145e10 2024-09-15T23:19:21.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.380+0000 7f44e21bd640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f44dc0b2c50 con 0x7f44dc159910 2024-09-15T23:19:21.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.381+0000 7f44db7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44c8004800 0x7f44dc15a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:21.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.381+0000 7f44db7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44c8004800 0x7f44dc15a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32786/0 (socket says 172.21.15.123:32786) 2024-09-15T23:19:21.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.381+0000 7f44db7fe640 1 -- 172.21.15.123:0/2090157626 learned_addr learned my addr 172.21.15.123:0/2090157626 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:21.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.381+0000 7f44daffd640 1 --2- 172.21.15.123:0/2090157626 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44dc159910 0x7f44dc156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:21.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.381+0000 7f44dbfff640 1 --2- 172.21.15.123:0/2090157626 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44dc145e10 0x7f44dc146290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:21.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.381+0000 7f44db7fe640 1 -- 172.21.15.123:0/2090157626 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44dc159910 msgr2=0x7f44dc156930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:21.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.381+0000 7f44db7fe640 1 --2- 172.21.15.123:0/2090157626 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44dc159910 0x7f44dc156930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.381+0000 7f44db7fe640 1 -- 172.21.15.123:0/2090157626 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44dc145e10 msgr2=0x7f44dc146290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:21.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.381+0000 7f44db7fe640 1 --2- 172.21.15.123:0/2090157626 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44dc145e10 0x7f44dc146290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.381+0000 7f44db7fe640 1 -- 172.21.15.123:0/2090157626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44dc14f8c0 con 0x7f44c8004800 2024-09-15T23:19:21.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.381+0000 7f44db7fe640 1 --2- 172.21.15.123:0/2090157626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44c8004800 0x7f44dc15a080 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f44cc0072c0 tx=0x7f44cc0076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:21.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.381+0000 7f44d3fff640 1 -- 172.21.15.123:0/2090157626 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc00f8e0 con 0x7f44c8004800 2024-09-15T23:19:21.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.381+0000 7f44d3fff640 1 -- 172.21.15.123:0/2090157626 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44cc018070 con 0x7f44c8004800 2024-09-15T23:19:21.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.381+0000 7f44e21bd640 1 -- 172.21.15.123:0/2090157626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44dc14eb00 con 0x7f44c8004800 2024-09-15T23:19:21.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.381+0000 7f44d3fff640 1 -- 172.21.15.123:0/2090157626 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc00fce0 con 0x7f44c8004800 2024-09-15T23:19:21.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.381+0000 7f44e21bd640 1 -- 172.21.15.123:0/2090157626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44dc14f0c0 con 0x7f44c8004800 2024-09-15T23:19:21.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.383+0000 7f44d3fff640 1 -- 172.21.15.123:0/2090157626 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f44cc01d460 con 0x7f44c8004800 2024-09-15T23:19:21.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.383+0000 7f44d3fff640 1 --2- 172.21.15.123:0/2090157626 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f44bc06c2b0 0x7f44bc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:21.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.383+0000 7f44d3fff640 1 -- 172.21.15.123:0/2090157626 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f44cc08b3a0 con 0x7f44c8004800 2024-09-15T23:19:21.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.384+0000 7f44daffd640 1 --2- 172.21.15.123:0/2090157626 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f44bc06c2b0 0x7f44bc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:21.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.384+0000 7f44daffd640 1 --2- 172.21.15.123:0/2090157626 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f44bc06c2b0 0x7f44bc06e770 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f44c4034000 tx=0x7f44c402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:21.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.384+0000 7f44e5031740 1 Processor -- start 2024-09-15T23:19:21.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.384+0000 7f44e5031740 1 -- start start 2024-09-15T23:19:21.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.385+0000 7f44e5031740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578c3143920 0x5578c31890c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:21.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.385+0000 7f44e5031740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578c31410e0 0x5578c3143d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:21.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.385+0000 7f44e5031740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578c31450b0 0x5578c313e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:21.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.385+0000 7f44e5031740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5578c30a66f0 con 0x5578c3143920 2024-09-15T23:19:21.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.385+0000 7f44e5031740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5578c304e330 con 0x5578c31450b0 2024-09-15T23:19:21.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.385+0000 7f44e5031740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5578c30a26b0 con 0x5578c31410e0 2024-09-15T23:19:21.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.385+0000 7f44db7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578c3143920 0x5578c31890c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:21.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.385+0000 7f44db7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578c3143920 0x5578c31890c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32790/0 (socket says 172.21.15.123:32790) 2024-09-15T23:19:21.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.385+0000 7f44db7fe640 1 -- 172.21.15.123:0/2277632680 learned_addr learned my addr 172.21.15.123:0/2277632680 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:21.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.385+0000 7f44dbfff640 1 --2- 172.21.15.123:0/2277632680 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578c31450b0 0x5578c313e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:21.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.385+0000 7f44daffd640 1 --2- 172.21.15.123:0/2277632680 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578c31410e0 0x5578c3143d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:21.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.386+0000 7f44db7fe640 1 -- 172.21.15.123:0/2277632680 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578c31410e0 msgr2=0x5578c3143d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:21.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.386+0000 7f44db7fe640 1 --2- 172.21.15.123:0/2277632680 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578c31410e0 0x5578c3143d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.386+0000 7f44db7fe640 1 -- 172.21.15.123:0/2277632680 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578c31450b0 msgr2=0x5578c313e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:21.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.386+0000 7f44db7fe640 1 --2- 172.21.15.123:0/2277632680 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578c31450b0 0x5578c313e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.386+0000 7f44db7fe640 1 -- 172.21.15.123:0/2277632680 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578c30740d0 con 0x5578c3143920 2024-09-15T23:19:21.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.386+0000 7f44daffd640 1 --2- 172.21.15.123:0/2277632680 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578c31410e0 0x5578c3143d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:19:21.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.386+0000 7f44db7fe640 1 --2- 172.21.15.123:0/2277632680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578c3143920 0x5578c31890c0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f44cc001610 tx=0x7f44cc00fe80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a4c42d9004aaa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:21.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.386+0000 7f44d17fa640 1 -- 172.21.15.123:0/2277632680 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc0594a0 con 0x5578c3143920 2024-09-15T23:19:21.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.386+0000 7f44d17fa640 1 -- 172.21.15.123:0/2277632680 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44cc05d850 con 0x5578c3143920 2024-09-15T23:19:21.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.386+0000 7f44d17fa640 1 -- 172.21.15.123:0/2277632680 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc062080 con 0x5578c3143920 2024-09-15T23:19:21.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.387+0000 7f44e5031740 1 -- 172.21.15.123:0/2277632680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578c3143920 msgr2=0x5578c31890c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:21.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.387+0000 7f44e5031740 1 --2- 172.21.15.123:0/2277632680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578c3143920 0x5578c31890c0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f44cc001610 tx=0x7f44cc00fe80 comp rx=0 tx=0).stop 2024-09-15T23:19:21.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.387+0000 7f44e5031740 1 -- 172.21.15.123:0/2277632680 shutdown_connections 2024-09-15T23:19:21.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.387+0000 7f44e5031740 1 --2- 172.21.15.123:0/2277632680 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578c31450b0 0x5578c313e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.387+0000 7f44e5031740 1 --2- 172.21.15.123:0/2277632680 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578c31410e0 0x5578c3143d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.387+0000 7f44e5031740 1 --2- 172.21.15.123:0/2277632680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578c3143920 0x5578c31890c0 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.387+0000 7f44e5031740 1 -- 172.21.15.123:0/2277632680 >> 172.21.15.123:0/2277632680 conn(0x5578c3140370 msgr2=0x5578c3188590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:21.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.387+0000 7f44e5031740 1 -- 172.21.15.123:0/2277632680 shutdown_connections 2024-09-15T23:19:21.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.387+0000 7f44e5031740 1 -- 172.21.15.123:0/2277632680 wait complete. 2024-09-15T23:19:21.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.387+0000 7f44e5031740 1 -- start start 2024-09-15T23:19:21.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.387+0000 7f44e5031740 1 Processor -- start 2024-09-15T23:19:21.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.388+0000 7f44e5031740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578c3143920 0x5578c315eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:21.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.388+0000 7f44e5031740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578c31450b0 0x5578c3164300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:21.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.388+0000 7f44e5031740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578c3169930 0x5578c3169db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:21.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.388+0000 7f44e5031740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5578c313f810 con 0x5578c3143920 2024-09-15T23:19:21.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.388+0000 7f44e5031740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5578c302f4f0 con 0x5578c31450b0 2024-09-15T23:19:21.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.388+0000 7f44e5031740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5578c31898f0 con 0x5578c3169930 2024-09-15T23:19:21.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.388+0000 7f44e5031740 10 client.0 _ll_register_callbacks cb 0x5578c3050b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:19:21.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.388+0000 7f44db7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578c3143920 0x5578c315eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:21.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.388+0000 7f44db7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578c3143920 0x5578c315eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32798/0 (socket says 172.21.15.123:32798) 2024-09-15T23:19:21.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.388+0000 7f44db7fe640 1 -- 172.21.15.123:0/3606177333 learned_addr learned my addr 172.21.15.123:0/3606177333 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:21.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.388+0000 7f44daffd640 1 --2- 172.21.15.123:0/3606177333 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578c31450b0 0x5578c3164300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:21.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.388+0000 7f44dbfff640 1 --2- 172.21.15.123:0/3606177333 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578c3169930 0x5578c3169db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:21.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.388+0000 7f44db7fe640 1 -- 172.21.15.123:0/3606177333 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578c3169930 msgr2=0x5578c3169db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:21.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.388+0000 7f44db7fe640 1 --2- 172.21.15.123:0/3606177333 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578c3169930 0x5578c3169db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.388+0000 7f44db7fe640 1 -- 172.21.15.123:0/3606177333 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578c31450b0 msgr2=0x5578c3164300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:21.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.388+0000 7f44db7fe640 1 --2- 172.21.15.123:0/3606177333 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578c31450b0 0x5578c3164300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.388+0000 7f44db7fe640 1 -- 172.21.15.123:0/3606177333 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578c2e837d0 con 0x5578c3143920 2024-09-15T23:19:21.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.389+0000 7f44db7fe640 1 --2- 172.21.15.123:0/3606177333 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578c3143920 0x5578c315eb20 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f44cc055900 tx=0x7f44cc015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7c615691c3a48c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:21.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.389+0000 7f44ba7fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:19:21.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.389+0000 7f44ba7fc640 1 -- 172.21.15.123:0/3606177333 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc055b10 con 0x5578c3143920 2024-09-15T23:19:21.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.389+0000 7f44ba7fc640 1 -- 172.21.15.123:0/3606177333 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f44cc0588f0 con 0x5578c3143920 2024-09-15T23:19:21.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.389+0000 7f44e5031740 1 -- 172.21.15.123:0/3606177333 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44cc05d850 con 0x5578c3143920 2024-09-15T23:19:21.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.389+0000 7f44ba7fc640 1 -- 172.21.15.123:0/3606177333 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f44cc055cb0 con 0x5578c3143920 2024-09-15T23:19:21.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.389+0000 7f44e5031740 10 client.8265 fetch_fsmap learned FSMap version 80 2024-09-15T23:19:21.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.389+0000 7f44e5031740 1 -- 172.21.15.123:0/3606177333 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=2+}) -- 0x5578c2db93f0 con 0x5578c3143920 2024-09-15T23:19:21.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.389+0000 7f44ba7fc640 1 -- 172.21.15.123:0/3606177333 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44cc05d850 con 0x5578c3143920 2024-09-15T23:19:21.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.389+0000 7f44ba7fc640 1 -- 172.21.15.123:0/3606177333 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 80) ==== 3502+0+0 (secure 0 0 0) 0x7f44cc078300 con 0x5578c3143920 2024-09-15T23:19:21.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.389+0000 7f44e5031740 10 client.8265 fetch_fsmap finished waiting for FSMap version 80 2024-09-15T23:19:21.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.389+0000 7f44e5031740 10 client.8265 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-09-15T23:19:21.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.389+0000 7f44e5031740 20 client.8265 populate_metadata read hostname 'smithi123' 2024-09-15T23:19:21.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.389+0000 7f44e5031740 1 --2- 172.21.15.123:0/3606177333 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x5578c31630f0 0x5578c3163500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:21.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.389+0000 7f44e5031740 4 client.8265 mds_command: new command op to 8034 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:19:21.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.389+0000 7f44e5031740 1 -- 172.21.15.123:0/3606177333 --> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5578c30b3e20 con 0x5578c31630f0 2024-09-15T23:19:21.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.389+0000 7f44daffd640 1 --2- 172.21.15.123:0/3606177333 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x5578c31630f0 0x5578c3163500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:21.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.390+0000 7f44daffd640 1 --2- 172.21.15.123:0/3606177333 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x5578c31630f0 0x5578c3163500 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d500d55b7f6ee9ed server_cookie=fb50cc8b7e0a56bf in_seq=0 out_seq=0 2024-09-15T23:19:21.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.390+0000 7f44ba7fc640 10 client.8265 ms_handle_connect on v2:172.21.15.188:6835/3551744094 2024-09-15T23:19:21.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.390+0000 7f44ba7fc640 1 -- 172.21.15.123:0/3606177333 <== mds.0 v2:172.21.15.188:6835/3551744094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5578c30b3e20 con 0x5578c31630f0 2024-09-15T23:19:21.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.390+0000 7f44ba7fc640 10 client.8265 handle_command_reply: tid=0 2024-09-15T23:19:21.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.390+0000 7f44e5031740 1 client.8265 shutdown 2024-09-15T23:19:21.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.391+0000 7f44e5031740 1 -- 172.21.15.123:0/3606177333 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578c3143920 msgr2=0x5578c315eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:21.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.391+0000 7f44e5031740 1 --2- 172.21.15.123:0/3606177333 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578c3143920 0x5578c315eb20 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f44cc055900 tx=0x7f44cc015040 comp rx=0 tx=0).stop 2024-09-15T23:19:21.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.391+0000 7f44e5031740 1 -- 172.21.15.123:0/3606177333 shutdown_connections 2024-09-15T23:19:21.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.391+0000 7f44e5031740 1 --2- 172.21.15.123:0/3606177333 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x5578c31630f0 0x5578c3163500 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.391+0000 7f44e5031740 1 --2- 172.21.15.123:0/3606177333 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578c3169930 0x5578c3169db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.391+0000 7f44ba7fc640 0 client.8265 ms_handle_reset on v2:172.21.15.188:6835/3551744094 2024-09-15T23:19:21.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.391+0000 7f44e5031740 1 --2- 172.21.15.123:0/3606177333 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578c31450b0 0x5578c3164300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.391+0000 7f44e5031740 1 --2- 172.21.15.123:0/3606177333 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578c3143920 0x5578c315eb20 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.391+0000 7f44e5031740 1 -- 172.21.15.123:0/3606177333 >> 172.21.15.123:0/3606177333 conn(0x5578c31410e0 msgr2=0x5578c3186540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:21.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.391+0000 7f44e5031740 1 -- 172.21.15.123:0/3606177333 shutdown_connections 2024-09-15T23:19:21.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.391+0000 7f44e5031740 1 -- 172.21.15.123:0/3606177333 wait complete. 2024-09-15T23:19:21.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.391+0000 7f44e5031740 20 client.8265 trim_cache size 0 max 16384 2024-09-15T23:19:21.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.408+0000 7f44e5031740 1 Processor -- start 2024-09-15T23:19:21.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.408+0000 7f44e5031740 1 -- start start 2024-09-15T23:19:21.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.408+0000 7f44e5031740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578c3143920 0x5578c318bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:21.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.408+0000 7f44e5031740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578c31450b0 0x5578c3169db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:21.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.408+0000 7f44e5031740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578c3169930 0x5578c3188300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:21.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.408+0000 7f44e5031740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f44dc201200 con 0x5578c3143920 2024-09-15T23:19:21.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.408+0000 7f44e5031740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f44dc15e3e0 con 0x5578c3169930 2024-09-15T23:19:21.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.408+0000 7f44e5031740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f44dc14e350 con 0x5578c31450b0 2024-09-15T23:19:21.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.409+0000 7f44db7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578c3143920 0x5578c318bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:21.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.409+0000 7f44db7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578c3143920 0x5578c318bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32806/0 (socket says 172.21.15.123:32806) 2024-09-15T23:19:21.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.409+0000 7f44db7fe640 1 -- 172.21.15.123:0/2325037576 learned_addr learned my addr 172.21.15.123:0/2325037576 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:21.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.409+0000 7f44dbfff640 1 --2- 172.21.15.123:0/2325037576 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578c3169930 0x5578c3188300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:21.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.409+0000 7f44db7fe640 1 -- 172.21.15.123:0/2325037576 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578c31450b0 msgr2=0x5578c3169db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:21.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.409+0000 7f44db7fe640 1 --2- 172.21.15.123:0/2325037576 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578c31450b0 0x5578c3169db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.409+0000 7f44db7fe640 1 -- 172.21.15.123:0/2325037576 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578c3169930 msgr2=0x5578c3188300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:21.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.409+0000 7f44db7fe640 1 --2- 172.21.15.123:0/2325037576 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578c3169930 0x5578c3188300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.409+0000 7f44db7fe640 1 -- 172.21.15.123:0/2325037576 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578c2d790f0 con 0x5578c3143920 2024-09-15T23:19:21.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.409+0000 7f44db7fe640 1 --2- 172.21.15.123:0/2325037576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578c3143920 0x5578c318bee0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f44cc001970 tx=0x7f44cc086000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3552715d99d85785 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:21.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.409+0000 7f44d0ff9640 1 -- 172.21.15.123:0/2325037576 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc07f030 con 0x5578c3143920 2024-09-15T23:19:21.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.409+0000 7f44d0ff9640 1 -- 172.21.15.123:0/2325037576 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44cc058c10 con 0x5578c3143920 2024-09-15T23:19:21.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.409+0000 7f44d0ff9640 1 -- 172.21.15.123:0/2325037576 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc055b10 con 0x5578c3143920 2024-09-15T23:19:21.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.410+0000 7f44e5031740 1 -- 172.21.15.123:0/2325037576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578c3143920 msgr2=0x5578c318bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:21.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.410+0000 7f44e5031740 1 --2- 172.21.15.123:0/2325037576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578c3143920 0x5578c318bee0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f44cc001970 tx=0x7f44cc086000 comp rx=0 tx=0).stop 2024-09-15T23:19:21.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.410+0000 7f44e5031740 1 -- 172.21.15.123:0/2325037576 shutdown_connections 2024-09-15T23:19:21.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.410+0000 7f44e5031740 1 --2- 172.21.15.123:0/2325037576 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578c3169930 0x5578c3188300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.410+0000 7f44e5031740 1 --2- 172.21.15.123:0/2325037576 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578c31450b0 0x5578c3169db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.410+0000 7f44e5031740 1 --2- 172.21.15.123:0/2325037576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578c3143920 0x5578c318bee0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.410+0000 7f44e5031740 1 -- 172.21.15.123:0/2325037576 >> 172.21.15.123:0/2325037576 conn(0x5578c31410e0 msgr2=0x5578c31640a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:21.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.410+0000 7f44e5031740 1 -- 172.21.15.123:0/2325037576 shutdown_connections 2024-09-15T23:19:21.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.410+0000 7f44e5031740 1 -- 172.21.15.123:0/2325037576 wait complete. 2024-09-15T23:19:21.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.410+0000 7f44e5031740 1 -- start start 2024-09-15T23:19:21.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.410+0000 7f44e5031740 1 Processor -- start 2024-09-15T23:19:21.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.411+0000 7f44e5031740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578c3143920 0x5578c32002d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:21.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.411+0000 7f44e5031740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578c31450b0 0x5578c318a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:21.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.411+0000 7f44e5031740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578c3169930 0x5578c31882e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:21.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.411+0000 7f44e5031740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5578c3162690 con 0x5578c3143920 2024-09-15T23:19:21.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.411+0000 7f44e5031740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f44dc15dd90 con 0x5578c31450b0 2024-09-15T23:19:21.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.411+0000 7f44e5031740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5578c316abd0 con 0x5578c3169930 2024-09-15T23:19:21.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.411+0000 7f44e5031740 10 client.0 _ll_register_callbacks cb 0x7f44d4001970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:19:21.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.411+0000 7f44db7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578c3143920 0x5578c32002d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:21.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.411+0000 7f44db7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578c3143920 0x5578c32002d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32816/0 (socket says 172.21.15.123:32816) 2024-09-15T23:19:21.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.411+0000 7f44db7fe640 1 -- 172.21.15.123:0/323334903 learned_addr learned my addr 172.21.15.123:0/323334903 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:21.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.411+0000 7f44dbfff640 1 --2- 172.21.15.123:0/323334903 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578c3169930 0x5578c31882e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:21.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.411+0000 7f44daffd640 1 --2- 172.21.15.123:0/323334903 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578c31450b0 0x5578c318a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:21.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.411+0000 7f44db7fe640 1 -- 172.21.15.123:0/323334903 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578c3169930 msgr2=0x5578c31882e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:21.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.411+0000 7f44db7fe640 1 --2- 172.21.15.123:0/323334903 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578c3169930 0x5578c31882e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.411+0000 7f44db7fe640 1 -- 172.21.15.123:0/323334903 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578c31450b0 msgr2=0x5578c318a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:21.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.411+0000 7f44db7fe640 1 --2- 172.21.15.123:0/323334903 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578c31450b0 0x5578c318a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.411+0000 7f44db7fe640 1 -- 172.21.15.123:0/323334903 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578c32067d0 con 0x5578c3143920 2024-09-15T23:19:21.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.411+0000 7f44dbfff640 1 --2- 172.21.15.123:0/323334903 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578c3169930 0x5578c31882e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:19:21.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.412+0000 7f44db7fe640 1 --2- 172.21.15.123:0/323334903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578c3143920 0x5578c32002d0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f44cc059430 tx=0x7f44cc0015a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d6ee9ab63dc714 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:21.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.412+0000 7f44ba7fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:19:21.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.412+0000 7f44ba7fc640 1 -- 172.21.15.123:0/323334903 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44cc07f030 con 0x5578c3143920 2024-09-15T23:19:21.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.412+0000 7f44ba7fc640 1 -- 172.21.15.123:0/323334903 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f44cc0711c0 con 0x5578c3143920 2024-09-15T23:19:21.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.412+0000 7f44e5031740 1 -- 172.21.15.123:0/323334903 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44cc058c10 con 0x5578c3143920 2024-09-15T23:19:21.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.412+0000 7f44ba7fc640 1 -- 172.21.15.123:0/323334903 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f44cc05d850 con 0x5578c3143920 2024-09-15T23:19:21.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.412+0000 7f44e5031740 10 client.8271 fetch_fsmap learned FSMap version 80 2024-09-15T23:19:21.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.412+0000 7f44e5031740 1 -- 172.21.15.123:0/323334903 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=2+}) -- 0x5578c32067d0 con 0x5578c3143920 2024-09-15T23:19:21.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.412+0000 7f44ba7fc640 1 -- 172.21.15.123:0/323334903 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44cc058c10 con 0x5578c3143920 2024-09-15T23:19:21.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.412+0000 7f44ba7fc640 1 -- 172.21.15.123:0/323334903 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 80) ==== 3502+0+0 (secure 0 0 0) 0x7f44cc0551f0 con 0x5578c3143920 2024-09-15T23:19:21.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.412+0000 7f44e5031740 10 client.8271 fetch_fsmap finished waiting for FSMap version 80 2024-09-15T23:19:21.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.412+0000 7f44e5031740 10 client.8271 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-09-15T23:19:21.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.412+0000 7f44e5031740 20 client.8271 populate_metadata read hostname 'smithi123' 2024-09-15T23:19:21.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.412+0000 7f44e5031740 1 --2- 172.21.15.123:0/323334903 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x5578c318a750 0x5578c3188820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:21.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.412+0000 7f44e5031740 4 client.8271 mds_command: new command op to 8034 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:19:21.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.412+0000 7f44e5031740 1 -- 172.21.15.123:0/323334903 --> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5578c30ae170 con 0x5578c318a750 2024-09-15T23:19:21.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.412+0000 7f44daffd640 1 --2- 172.21.15.123:0/323334903 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x5578c318a750 0x5578c3188820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:21.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.413+0000 7f44daffd640 1 --2- 172.21.15.123:0/323334903 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x5578c318a750 0x5578c3188820 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6de8038afee2e029 server_cookie=6a7b0d373f56ac5d in_seq=0 out_seq=0 2024-09-15T23:19:21.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.413+0000 7f44ba7fc640 10 client.8271 ms_handle_connect on v2:172.21.15.188:6835/3551744094 2024-09-15T23:19:21.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.413+0000 7f44ba7fc640 1 -- 172.21.15.123:0/323334903 <== mds.0 v2:172.21.15.188:6835/3551744094 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5578c30ae170 con 0x5578c318a750 2024-09-15T23:19:21.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.413+0000 7f44ba7fc640 10 client.8271 handle_command_reply: tid=0 2024-09-15T23:19:21.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.413+0000 7f44e5031740 1 client.8271 shutdown 2024-09-15T23:19:21.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.413+0000 7f44e5031740 1 -- 172.21.15.123:0/323334903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578c3143920 msgr2=0x5578c32002d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:21.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.413+0000 7f44e5031740 1 --2- 172.21.15.123:0/323334903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578c3143920 0x5578c32002d0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f44cc059430 tx=0x7f44cc0015a0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.413+0000 7f44e5031740 1 -- 172.21.15.123:0/323334903 shutdown_connections 2024-09-15T23:19:21.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.413+0000 7f44e5031740 1 --2- 172.21.15.123:0/323334903 >> [v2:172.21.15.188:6835/3551744094,v1:172.21.15.188:6837/3551744094] conn(0x5578c318a750 0x5578c3188820 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.413+0000 7f44e5031740 1 --2- 172.21.15.123:0/323334903 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5578c3169930 0x5578c31882e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.413+0000 7f44e5031740 1 --2- 172.21.15.123:0/323334903 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5578c31450b0 0x5578c318a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.413+0000 7f44ba7fc640 0 client.8271 ms_handle_reset on v2:172.21.15.188:6835/3551744094 2024-09-15T23:19:21.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.413+0000 7f44e5031740 1 --2- 172.21.15.123:0/323334903 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5578c3143920 0x5578c32002d0 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.413+0000 7f44e5031740 1 -- 172.21.15.123:0/323334903 >> 172.21.15.123:0/323334903 conn(0x5578c31410e0 msgr2=0x5578c3161570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:21.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.413+0000 7f44e5031740 1 -- 172.21.15.123:0/323334903 shutdown_connections 2024-09-15T23:19:21.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.413+0000 7f44e5031740 1 -- 172.21.15.123:0/323334903 wait complete. 2024-09-15T23:19:21.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.413+0000 7f44e5031740 20 client.8271 trim_cache size 0 max 16384 2024-09-15T23:19:21.422 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:19:21.422 INFO:teuthology.orchestra.run.smithi123.stdout: "status": "no active scrubs running", 2024-09-15T23:19:21.422 INFO:teuthology.orchestra.run.smithi123.stdout: "scrubs": {} 2024-09-15T23:19:21.422 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:19:21.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.414+0000 7f44e21bd640 1 -- 172.21.15.123:0/2090157626 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f44bc06c2b0 msgr2=0x7f44bc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:21.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.414+0000 7f44e21bd640 1 --2- 172.21.15.123:0/2090157626 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f44bc06c2b0 0x7f44bc06e770 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f44c4034000 tx=0x7f44c402e000 comp rx=0 tx=0).stop 2024-09-15T23:19:21.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.414+0000 7f44e21bd640 1 -- 172.21.15.123:0/2090157626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44c8004800 msgr2=0x7f44dc15a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:21.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.414+0000 7f44e21bd640 1 --2- 172.21.15.123:0/2090157626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44c8004800 0x7f44dc15a080 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f44cc0072c0 tx=0x7f44cc0076c0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.414+0000 7f44e21bd640 1 -- 172.21.15.123:0/2090157626 shutdown_connections 2024-09-15T23:19:21.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.414+0000 7f44e21bd640 1 --2- 172.21.15.123:0/2090157626 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f44dc145e10 0x7f44dc146290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.414+0000 7f44e21bd640 1 --2- 172.21.15.123:0/2090157626 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f44dc159910 0x7f44dc156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.414+0000 7f44e21bd640 1 --2- 172.21.15.123:0/2090157626 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f44bc06c2b0 0x7f44bc06e770 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.414+0000 7f44e21bd640 1 --2- 172.21.15.123:0/2090157626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44c8004800 0x7f44dc15a080 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.414+0000 7f44e21bd640 1 -- 172.21.15.123:0/2090157626 >> 172.21.15.123:0/2090157626 conn(0x7f44dc06d0f0 msgr2=0x7f44dc0cd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:21.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.414+0000 7f44e21bd640 1 -- 172.21.15.123:0/2090157626 shutdown_connections 2024-09-15T23:19:21.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.414+0000 7f44e21bd640 1 -- 172.21.15.123:0/2090157626 wait complete. 2024-09-15T23:19:21.425 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T23:19:21.426 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:19:21.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.523+0000 7fba02ca5640 1 Processor -- start 2024-09-15T23:19:21.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.523+0000 7fba02ca5640 1 -- start start 2024-09-15T23:19:21.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.524+0000 7fba02ca5640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb9fc0b02b0 0x7fb9fc06e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:21.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.524+0000 7fba02ca5640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9fc067b50 con 0x7fb9fc15c4b0 2024-09-15T23:19:21.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.524+0000 7fba02ca5640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9fc0ce860 con 0x7fb9fc0b6830 2024-09-15T23:19:21.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.524+0000 7fba02ca5640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fb9fc070130 con 0x7fb9fc0b02b0 2024-09-15T23:19:21.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.524+0000 7fba01242640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb9fc0b02b0 0x7fb9fc06e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:21.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.524+0000 7fba00a41640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb9fc15c4b0 0x7fb9fc0b6120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51850/0 (socket says 172.21.15.123:51850) 2024-09-15T23:19:21.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.524+0000 7fba00a41640 1 -- 172.21.15.123:0/1062367919 learned_addr learned my addr 172.21.15.123:0/1062367919 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:19:21.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.524+0000 7fba01242640 1 -- 172.21.15.123:0/1062367919 >> v1:172.21.15.188:6789/0 conn(0x7fb9fc0b6830 legacy=0x7fb9fc06e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:21.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.524+0000 7fba01242640 1 -- 172.21.15.123:0/1062367919 >> v1:172.21.15.123:6789/0 conn(0x7fb9fc15c4b0 legacy=0x7fb9fc0b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:21.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.524+0000 7fba01242640 1 -- 172.21.15.123:0/1062367919 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9fc06fe50 con 0x7fb9fc0b02b0 2024-09-15T23:19:21.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.524+0000 7fb9fb7fe640 1 -- 172.21.15.123:0/1062367919 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2474855340 0 0) 0x7fb9f0001110 con 0x7fb9fc15c4b0 2024-09-15T23:19:21.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.525+0000 7fba01242640 1 --2- 172.21.15.123:0/1062367919 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9fc0b02b0 0x7fb9fc06e8f0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4009d90 tx=0x7fb9f402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3754780db7da9a1a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:21.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.525+0000 7fb9fb7fe640 1 -- 172.21.15.123:0/1062367919 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4007740 con 0x7fb9fc0b02b0 2024-09-15T23:19:21.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.525+0000 7fb9fb7fe640 1 -- 172.21.15.123:0/1062367919 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9f40078e0 con 0x7fb9fc0b02b0 2024-09-15T23:19:21.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.525+0000 7fb9fb7fe640 1 -- 172.21.15.123:0/1062367919 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4007cb0 con 0x7fb9fc0b02b0 2024-09-15T23:19:21.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.526+0000 7fba02ca5640 1 -- 172.21.15.123:0/1062367919 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9fc0b02b0 msgr2=0x7fb9fc06e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:21.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.526+0000 7fba02ca5640 1 --2- 172.21.15.123:0/1062367919 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9fc0b02b0 0x7fb9fc06e8f0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4009d90 tx=0x7fb9f402a6f0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.526+0000 7fba02ca5640 1 -- 172.21.15.123:0/1062367919 shutdown_connections 2024-09-15T23:19:21.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.526+0000 7fba02ca5640 1 --2- 172.21.15.123:0/1062367919 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9fc0b02b0 0x7fb9fc06e8f0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.526+0000 7fba02ca5640 1 -- 172.21.15.123:0/1062367919 >> 172.21.15.123:0/1062367919 conn(0x7fb9fc0b0a80 msgr2=0x7fb9fc0b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:21.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.526+0000 7fba02ca5640 1 -- 172.21.15.123:0/1062367919 shutdown_connections 2024-09-15T23:19:21.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.526+0000 7fba02ca5640 1 -- 172.21.15.123:0/1062367919 wait complete. 2024-09-15T23:19:21.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.527+0000 7fba02ca5640 1 Processor -- start 2024-09-15T23:19:21.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.527+0000 7fba02ca5640 1 -- start start 2024-09-15T23:19:21.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.528+0000 7fba02ca5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9fc0b02b0 0x7fb9fc13ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:21.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.528+0000 7fba02ca5640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb9fc0b6830 0x7fb9fc1554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:21.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.528+0000 7fba02ca5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9fc15c4b0 0x7fb9fc155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:21.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.528+0000 7fba02ca5640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb9fc06dcc0 con 0x7fb9fc15c4b0 2024-09-15T23:19:21.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.528+0000 7fba02ca5640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb9fc0ce580 con 0x7fb9fc0b02b0 2024-09-15T23:19:21.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.528+0000 7fba02ca5640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb9fc15c890 con 0x7fb9fc0b6830 2024-09-15T23:19:21.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.528+0000 7fba01242640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9fc15c4b0 0x7fb9fc155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:21.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.528+0000 7fba01242640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9fc15c4b0 0x7fb9fc155a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32838/0 (socket says 172.21.15.123:32838) 2024-09-15T23:19:21.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.528+0000 7fba01242640 1 -- 172.21.15.123:0/4134365725 learned_addr learned my addr 172.21.15.123:0/4134365725 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:21.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.528+0000 7fba00a41640 1 --2- 172.21.15.123:0/4134365725 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9fc0b02b0 0x7fb9fc13ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:21.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.528+0000 7fb9fbfff640 1 --2- 172.21.15.123:0/4134365725 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb9fc0b6830 0x7fb9fc1554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:21.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.528+0000 7fba01242640 1 -- 172.21.15.123:0/4134365725 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb9fc0b6830 msgr2=0x7fb9fc1554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:21.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.528+0000 7fba01242640 1 --2- 172.21.15.123:0/4134365725 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb9fc0b6830 0x7fb9fc1554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.528+0000 7fba01242640 1 -- 172.21.15.123:0/4134365725 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9fc0b02b0 msgr2=0x7fb9fc13ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:21.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.528+0000 7fba01242640 1 --2- 172.21.15.123:0/4134365725 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9fc0b02b0 0x7fb9fc13ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.528+0000 7fba01242640 1 -- 172.21.15.123:0/4134365725 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9fc1456b0 con 0x7fb9fc15c4b0 2024-09-15T23:19:21.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.528+0000 7fba01242640 1 --2- 172.21.15.123:0/4134365725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9fc15c4b0 0x7fb9fc155a10 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4009d90 tx=0x7fb9f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:21.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.529+0000 7fb9f97fa640 1 -- 172.21.15.123:0/4134365725 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4040070 con 0x7fb9fc15c4b0 2024-09-15T23:19:21.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.529+0000 7fb9f97fa640 1 -- 172.21.15.123:0/4134365725 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9f4031c90 con 0x7fb9fc15c4b0 2024-09-15T23:19:21.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.529+0000 7fba02ca5640 1 -- 172.21.15.123:0/4134365725 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9fc15ee30 con 0x7fb9fc15c4b0 2024-09-15T23:19:21.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.529+0000 7fb9f97fa640 1 -- 172.21.15.123:0/4134365725 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f403c640 con 0x7fb9fc15c4b0 2024-09-15T23:19:21.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.529+0000 7fba02ca5640 1 -- 172.21.15.123:0/4134365725 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9fc15f3f0 con 0x7fb9fc15c4b0 2024-09-15T23:19:21.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.529+0000 7fba02ca5640 1 -- 172.21.15.123:0/4134365725 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9fc0d08e0 con 0x7fb9fc15c4b0 2024-09-15T23:19:21.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.530+0000 7fb9f97fa640 1 -- 172.21.15.123:0/4134365725 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb9f4039040 con 0x7fb9fc15c4b0 2024-09-15T23:19:21.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.530+0000 7fb9f97fa640 1 --2- 172.21.15.123:0/4134365725 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb9e006c2b0 0x7fb9e006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:21.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.531+0000 7fb9f97fa640 1 -- 172.21.15.123:0/4134365725 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7fb9f40ac900 con 0x7fb9fc15c4b0 2024-09-15T23:19:21.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.531+0000 7fba00a41640 1 --2- 172.21.15.123:0/4134365725 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb9e006c2b0 0x7fb9e006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:21.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.531+0000 7fba00a41640 1 --2- 172.21.15.123:0/4134365725 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb9e006c2b0 0x7fb9e006e770 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0000f60 tx=0x7fb9f0007e40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:21.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.535+0000 7fb9f97fa640 1 -- 172.21.15.123:0/4134365725 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb9f407aae0 con 0x7fb9fc15c4b0 2024-09-15T23:19:21.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.734+0000 7fba02ca5640 1 -- 172.21.15.123:0/4134365725 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb9fc06f870 con 0x7fb9fc15c4b0 2024-09-15T23:19:21.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.734+0000 7fb9f97fa640 1 -- 172.21.15.123:0/4134365725 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) ==== 94+0+5237 (secure 0 0 0) 0x7fb9f407ede0 con 0x7fb9fc15c4b0 2024-09-15T23:19:21.736 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:19:21.736 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":80,"btime":"2024-09-15T23:18:57:403025+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6386,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/1352396114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":1352396114},{"type":"v1","addr":"172.21.15.188:6836","nonce":1352396114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":8022,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2727961795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2727961795},{"type":"v1","addr":"172.21.15.123:6834","nonce":2727961795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":8025,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3879785466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":3879785466},{"type":"v1","addr":"172.21.15.123:6835","nonce":3879785466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:18:54.727897+0000","modified":"2024-09-15T23:18:56.730668+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8034},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8034":{"gid":8034,"name":"d","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6837/3551744094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":3551744094},{"type":"v1","addr":"172.21.15.188:6837","nonce":3551744094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8034,"qdb_cluster":[8034]},"id":8}]} 2024-09-15T23:19:21.736 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 80 2024-09-15T23:19:21.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.736+0000 7fba02ca5640 1 -- 172.21.15.123:0/4134365725 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb9e006c2b0 msgr2=0x7fb9e006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:21.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.736+0000 7fba02ca5640 1 --2- 172.21.15.123:0/4134365725 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb9e006c2b0 0x7fb9e006e770 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0000f60 tx=0x7fb9f0007e40 comp rx=0 tx=0).stop 2024-09-15T23:19:21.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.736+0000 7fba02ca5640 1 -- 172.21.15.123:0/4134365725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9fc15c4b0 msgr2=0x7fb9fc155a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:21.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.736+0000 7fba02ca5640 1 --2- 172.21.15.123:0/4134365725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9fc15c4b0 0x7fb9fc155a10 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4009d90 tx=0x7fb9f4004a40 comp rx=0 tx=0).stop 2024-09-15T23:19:21.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.736+0000 7fba02ca5640 1 -- 172.21.15.123:0/4134365725 shutdown_connections 2024-09-15T23:19:21.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.736+0000 7fba02ca5640 1 --2- 172.21.15.123:0/4134365725 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb9e006c2b0 0x7fb9e006e770 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.736+0000 7fba02ca5640 1 --2- 172.21.15.123:0/4134365725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9fc15c4b0 0x7fb9fc155a10 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.736+0000 7fba02ca5640 1 --2- 172.21.15.123:0/4134365725 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb9fc0b6830 0x7fb9fc1554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.736+0000 7fba02ca5640 1 --2- 172.21.15.123:0/4134365725 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9fc0b02b0 0x7fb9fc13ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.736+0000 7fba02ca5640 1 -- 172.21.15.123:0/4134365725 >> 172.21.15.123:0/4134365725 conn(0x7fb9fc0b0a80 msgr2=0x7fb9fc073160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:21.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.736+0000 7fba02ca5640 1 -- 172.21.15.123:0/4134365725 shutdown_connections 2024-09-15T23:19:21.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.736+0000 7fba02ca5640 1 -- 172.21.15.123:0/4134365725 wait complete. 2024-09-15T23:19:21.748 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-15T23:19:21.748 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:19:21.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.844+0000 7f0b82dcf640 1 Processor -- start 2024-09-15T23:19:21.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.844+0000 7f0b82dcf640 1 -- start start 2024-09-15T23:19:21.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.845+0000 7f0b82dcf640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f0b7c145ed0 0x7f0b7c0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:21.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.845+0000 7f0b82dcf640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0b7c0b5f90 0x7f0b7c0735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:21.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.845+0000 7f0b82dcf640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b7c0b4020 con 0x7f0b7c073180 2024-09-15T23:19:21.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.845+0000 7f0b82dcf640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f0b7c0b63d0 con 0x7f0b7c0b5f90 2024-09-15T23:19:21.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.845+0000 7f0b82dcf640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f0b7c073b00 con 0x7f0b7c145ed0 2024-09-15T23:19:21.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.845+0000 7f0b8136c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0b7c0b5f90 0x7f0b7c0735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:21.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.845+0000 7f0b8136c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0b7c0b5f90 0x7f0b7c0735c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32840/0 (socket says 172.21.15.123:32840) 2024-09-15T23:19:21.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.845+0000 7f0b8136c640 1 -- 172.21.15.123:0/1681030419 learned_addr learned my addr 172.21.15.123:0/1681030419 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:21.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.845+0000 7f0b80b6b640 1 --2- 172.21.15.123:0/1681030419 >> v2:172.21.15.188:3300/0 conn(0x7f0b7c145ed0 0x7f0b7c0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:21.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.845+0000 7f0b8136c640 1 -- 172.21.15.123:0/1681030419 >> v2:172.21.15.188:3300/0 conn(0x7f0b7c145ed0 msgr2=0x7f0b7c0b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:21.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.845+0000 7f0b8136c640 1 --2- 172.21.15.123:0/1681030419 >> v2:172.21.15.188:3300/0 conn(0x7f0b7c145ed0 0x7f0b7c0b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.845+0000 7f0b8136c640 1 -- 172.21.15.123:0/1681030419 >> v1:172.21.15.188:6789/0 conn(0x7f0b7c073180 legacy=0x7f0b7c0b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:21.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.845+0000 7f0b8136c640 1 -- 172.21.15.123:0/1681030419 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b7c0b42c0 con 0x7f0b7c0b5f90 2024-09-15T23:19:21.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.846+0000 7f0b8136c640 1 --2- 172.21.15.123:0/1681030419 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b7c0b5f90 0x7f0b7c0735c0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c069cd0 tx=0x7f0b7402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b3c6f7eec86e75c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:21.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.846+0000 7f0b737fe640 1 -- 172.21.15.123:0/1681030419 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b74037070 con 0x7f0b7c0b5f90 2024-09-15T23:19:21.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.846+0000 7f0b737fe640 1 -- 172.21.15.123:0/1681030419 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b74032440 con 0x7f0b7c0b5f90 2024-09-15T23:19:21.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.846+0000 7f0b737fe640 1 -- 172.21.15.123:0/1681030419 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b74032810 con 0x7f0b7c0b5f90 2024-09-15T23:19:21.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.847+0000 7f0b82dcf640 1 -- 172.21.15.123:0/1681030419 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b7c0b5f90 msgr2=0x7f0b7c0735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:21.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.847+0000 7f0b82dcf640 1 --2- 172.21.15.123:0/1681030419 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b7c0b5f90 0x7f0b7c0735c0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c069cd0 tx=0x7f0b7402a270 comp rx=0 tx=0).stop 2024-09-15T23:19:21.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.847+0000 7f0b82dcf640 1 -- 172.21.15.123:0/1681030419 shutdown_connections 2024-09-15T23:19:21.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.847+0000 7f0b82dcf640 1 --2- 172.21.15.123:0/1681030419 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b7c0b5f90 0x7f0b7c0735c0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.847+0000 7f0b82dcf640 1 --2- 172.21.15.123:0/1681030419 >> v2:172.21.15.188:3300/0 conn(0x7f0b7c145ed0 0x7f0b7c0b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.847+0000 7f0b82dcf640 1 -- 172.21.15.123:0/1681030419 >> 172.21.15.123:0/1681030419 conn(0x7f0b7c0ccec0 msgr2=0x7f0b7c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:21.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.847+0000 7f0b82dcf640 1 -- 172.21.15.123:0/1681030419 shutdown_connections 2024-09-15T23:19:21.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.847+0000 7f0b82dcf640 1 -- 172.21.15.123:0/1681030419 wait complete. 2024-09-15T23:19:21.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.848+0000 7f0b82dcf640 1 Processor -- start 2024-09-15T23:19:21.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.848+0000 7f0b82dcf640 1 -- start start 2024-09-15T23:19:21.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.849+0000 7f0b82dcf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b7c073180 0x7f0b7c15c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:21.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.849+0000 7f0b82dcf640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0b7c0b5f90 0x7f0b7c0c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:21.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.849+0000 7f0b82dcf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b7c145ed0 0x7f0b7c142bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:21.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.849+0000 7f0b82dcf640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7c0b4b60 con 0x7f0b7c145ed0 2024-09-15T23:19:21.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.849+0000 7f0b82dcf640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7c0b4880 con 0x7f0b7c073180 2024-09-15T23:19:21.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.849+0000 7f0b82dcf640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0b7c1462b0 con 0x7f0b7c0b5f90 2024-09-15T23:19:21.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.849+0000 7f0b8136c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b7c145ed0 0x7f0b7c142bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:21.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.849+0000 7f0b8136c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b7c145ed0 0x7f0b7c142bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32852/0 (socket says 172.21.15.123:32852) 2024-09-15T23:19:21.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.849+0000 7f0b8136c640 1 -- 172.21.15.123:0/1792106834 learned_addr learned my addr 172.21.15.123:0/1792106834 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:21.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.849+0000 7f0b80b6b640 1 --2- 172.21.15.123:0/1792106834 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b7c073180 0x7f0b7c15c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:21.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.849+0000 7f0b73fff640 1 --2- 172.21.15.123:0/1792106834 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0b7c0b5f90 0x7f0b7c0c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:21.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.849+0000 7f0b8136c640 1 -- 172.21.15.123:0/1792106834 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0b7c0b5f90 msgr2=0x7f0b7c0c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:21.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.849+0000 7f0b8136c640 1 --2- 172.21.15.123:0/1792106834 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0b7c0b5f90 0x7f0b7c0c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.849+0000 7f0b8136c640 1 -- 172.21.15.123:0/1792106834 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b7c073180 msgr2=0x7f0b7c15c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:21.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.849+0000 7f0b8136c640 1 --2- 172.21.15.123:0/1792106834 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b7c073180 0x7f0b7c15c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:21.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.849+0000 7f0b8136c640 1 -- 172.21.15.123:0/1792106834 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b7c0c71b0 con 0x7f0b7c145ed0 2024-09-15T23:19:21.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.849+0000 7f0b8136c640 1 --2- 172.21.15.123:0/1792106834 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b7c145ed0 0x7f0b7c142bb0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f0b740090b0 tx=0x7f0b740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:21.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.849+0000 7f0b717fa640 1 -- 172.21.15.123:0/1792106834 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b74041020 con 0x7f0b7c145ed0 2024-09-15T23:19:21.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.849+0000 7f0b717fa640 1 -- 172.21.15.123:0/1792106834 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b7403d640 con 0x7f0b7c145ed0 2024-09-15T23:19:21.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.849+0000 7f0b82dcf640 1 -- 172.21.15.123:0/1792106834 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b7c0c7490 con 0x7f0b7c145ed0 2024-09-15T23:19:21.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.849+0000 7f0b717fa640 1 -- 172.21.15.123:0/1792106834 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b74037040 con 0x7f0b7c145ed0 2024-09-15T23:19:21.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.850+0000 7f0b82dcf640 1 -- 172.21.15.123:0/1792106834 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b7c13a260 con 0x7f0b7c145ed0 2024-09-15T23:19:21.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.850+0000 7f0b82dcf640 1 -- 172.21.15.123:0/1792106834 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b7c068cf0 con 0x7f0b7c145ed0 2024-09-15T23:19:21.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.851+0000 7f0b717fa640 1 -- 172.21.15.123:0/1792106834 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0b74044020 con 0x7f0b7c145ed0 2024-09-15T23:19:21.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.851+0000 7f0b717fa640 1 --2- 172.21.15.123:0/1792106834 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0b6806c2b0 0x7f0b6806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:21.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.851+0000 7f0b717fa640 1 -- 172.21.15.123:0/1792106834 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f0b740aba20 con 0x7f0b7c145ed0 2024-09-15T23:19:21.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.851+0000 7f0b80b6b640 1 --2- 172.21.15.123:0/1792106834 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0b6806c2b0 0x7f0b6806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:21.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.852+0000 7f0b80b6b640 1 --2- 172.21.15.123:0/1792106834 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0b6806c2b0 0x7f0b6806e770 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f0b780113e0 tx=0x7f0b7800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:21.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:21.855+0000 7f0b717fa640 1 -- 172.21.15.123:0/1792106834 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0b7404b030 con 0x7f0b7c145ed0 2024-09-15T23:19:22.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.085+0000 7f0b82dcf640 1 -- 172.21.15.123:0/1792106834 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f0b7c141360 con 0x7f0b7c145ed0 2024-09-15T23:19:22.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.085+0000 7f0b717fa640 1 -- 172.21.15.123:0/1792106834 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1069 (secure 0 0 0) 0x7f0b74079b50 con 0x7f0b7c145ed0 2024-09-15T23:19:22.086 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:19:22.087 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":452,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":130,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076562958,"bytes_used":2547417088,"bytes_avail":770546696192,"bytes_total":773094113280,"write_bytes_sec":84048139,"read_op_per_sec":0,"write_op_per_sec":82},"fsmap":{"epoch":80,"btime":"2024-09-15T23:18:57:403025+0000","id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"d","status":"up:active","gid":8034}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2024-09-15T23:18:45.597495+0000","services":{}},"progress_events":{}} 2024-09-15T23:19:22.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.087+0000 7f0b82dcf640 1 -- 172.21.15.123:0/1792106834 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0b6806c2b0 msgr2=0x7f0b6806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:22.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.087+0000 7f0b82dcf640 1 --2- 172.21.15.123:0/1792106834 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0b6806c2b0 0x7f0b6806e770 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f0b780113e0 tx=0x7f0b7800b040 comp rx=0 tx=0).stop 2024-09-15T23:19:22.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.087+0000 7f0b82dcf640 1 -- 172.21.15.123:0/1792106834 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b7c145ed0 msgr2=0x7f0b7c142bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:22.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.087+0000 7f0b82dcf640 1 --2- 172.21.15.123:0/1792106834 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b7c145ed0 0x7f0b7c142bb0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f0b740090b0 tx=0x7f0b740046c0 comp rx=0 tx=0).stop 2024-09-15T23:19:22.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.088+0000 7f0b82dcf640 1 -- 172.21.15.123:0/1792106834 shutdown_connections 2024-09-15T23:19:22.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.088+0000 7f0b82dcf640 1 --2- 172.21.15.123:0/1792106834 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0b6806c2b0 0x7f0b6806e770 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:22.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.088+0000 7f0b82dcf640 1 --2- 172.21.15.123:0/1792106834 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b7c145ed0 0x7f0b7c142bb0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:22.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.088+0000 7f0b82dcf640 1 --2- 172.21.15.123:0/1792106834 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0b7c0b5f90 0x7f0b7c0c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:22.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.088+0000 7f0b82dcf640 1 --2- 172.21.15.123:0/1792106834 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0b7c073180 0x7f0b7c15c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:22.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.088+0000 7f0b82dcf640 1 -- 172.21.15.123:0/1792106834 >> 172.21.15.123:0/1792106834 conn(0x7f0b7c0ccec0 msgr2=0x7f0b7c0cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:22.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.088+0000 7f0b82dcf640 1 -- 172.21.15.123:0/1792106834 shutdown_connections 2024-09-15T23:19:22.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.088+0000 7f0b82dcf640 1 -- 172.21.15.123:0/1792106834 wait complete. 2024-09-15T23:19:22.099 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:19:22.100 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:19:22.150 DEBUG:teuthology.orchestra.run.smithi188:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:19:22.196 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:19:22.196 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:19:22.196 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:19:22.196 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:19:22.213 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:19:22.213 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:19:22.269 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:19:22.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.406+0000 7f43aebc4640 1 Processor -- start 2024-09-15T23:19:22.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.406+0000 7f43aebc4640 1 -- start start 2024-09-15T23:19:22.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.407+0000 7f43aebc4640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f43a806c320 0x7f43a815bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:22.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.407+0000 7f43aebc4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43a813eb20 0x7f43a815c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:22.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.407+0000 7f43aebc4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43a8071180 con 0x7f43a80b2d40 2024-09-15T23:19:22.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.407+0000 7f43aebc4640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f43a8071ab0 con 0x7f43a806c320 2024-09-15T23:19:22.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.407+0000 7f43aebc4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f43a8071460 con 0x7f43a813eb20 2024-09-15T23:19:22.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.407+0000 7f43ac960640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f43a80b2d40 0x7f43a806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51858/0 (socket says 172.21.15.123:51858) 2024-09-15T23:19:22.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.407+0000 7f43ac960640 1 -- 172.21.15.123:0/1404122616 learned_addr learned my addr 172.21.15.123:0/1404122616 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:19:22.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.407+0000 7f43a77fe640 1 -- 172.21.15.123:0/1404122616 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3179853809 0 0) 0x7f43a8071180 con 0x7f43a80b2d40 2024-09-15T23:19:22.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.407+0000 7f43a7fff640 1 --2- 172.21.15.123:0/1404122616 >> v2:172.21.15.188:3300/0 conn(0x7f43a806c320 0x7f43a815bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:22.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.407+0000 7f43a77fe640 1 -- 172.21.15.123:0/1404122616 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4394005730 con 0x7f43a80b2d40 2024-09-15T23:19:22.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.407+0000 7f43ad161640 1 --2- 172.21.15.123:0/1404122616 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43a813eb20 0x7f43a815c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:22.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.408+0000 7f43a77fe640 1 -- 172.21.15.123:0/1404122616 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1898329131 0 0) 0x7f4394005730 con 0x7f43a80b2d40 2024-09-15T23:19:22.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.408+0000 7f43a77fe640 1 -- 172.21.15.123:0/1404122616 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43a813eb20 msgr2=0x7f43a815c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:22.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.408+0000 7f43a77fe640 1 --2- 172.21.15.123:0/1404122616 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43a813eb20 0x7f43a815c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:22.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.408+0000 7f43a77fe640 1 -- 172.21.15.123:0/1404122616 >> v2:172.21.15.188:3300/0 conn(0x7f43a806c320 msgr2=0x7f43a815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:22.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.408+0000 7f43a77fe640 1 --2- 172.21.15.123:0/1404122616 >> v2:172.21.15.188:3300/0 conn(0x7f43a806c320 0x7f43a815bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:22.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.408+0000 7f43a77fe640 1 -- 172.21.15.123:0/1404122616 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43a8071740 con 0x7f43a80b2d40 2024-09-15T23:19:22.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.408+0000 7f43a77fe640 1 -- 172.21.15.123:0/1404122616 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f43a0001670 con 0x7f43a80b2d40 2024-09-15T23:19:22.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.408+0000 7f43a77fe640 1 -- 172.21.15.123:0/1404122616 >> v1:172.21.15.123:6789/0 conn(0x7f43a80b2d40 legacy=0x7f43a806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:22.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.408+0000 7f43a77fe640 1 --2- 172.21.15.123:0/1404122616 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4394005bc0 0x7f4394005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:22.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.408+0000 7f43a77fe640 1 --2- 172.21.15.123:0/1404122616 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43a813eb20 0x7f4394006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:22.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.408+0000 7f43a77fe640 1 --2- 172.21.15.123:0/1404122616 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4394006f50 0x7f43940073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:22.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.408+0000 7f43a77fe640 1 -- 172.21.15.123:0/1404122616 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f43a8071ab0 con 0x7f4394006f50 2024-09-15T23:19:22.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.408+0000 7f43a77fe640 1 -- 172.21.15.123:0/1404122616 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f43a8071460 con 0x7f4394005bc0 2024-09-15T23:19:22.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.408+0000 7f43a77fe640 1 -- 172.21.15.123:0/1404122616 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f439400dbd0 con 0x7f43a813eb20 2024-09-15T23:19:22.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.408+0000 7f43ad161640 1 --2- 172.21.15.123:0/1404122616 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4394006f50 0x7f43940073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:22.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.408+0000 7f43ac960640 1 --2- 172.21.15.123:0/1404122616 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4394005bc0 0x7f4394005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:22.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.408+0000 7f43a7fff640 1 --2- 172.21.15.123:0/1404122616 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43a813eb20 0x7f4394006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:22.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.408+0000 7f43ad161640 1 -- 172.21.15.123:0/1404122616 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43a813eb20 msgr2=0x7f4394006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:22.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.408+0000 7f43ad161640 1 --2- 172.21.15.123:0/1404122616 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43a813eb20 0x7f4394006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:22.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.408+0000 7f43ad161640 1 -- 172.21.15.123:0/1404122616 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4394005bc0 msgr2=0x7f4394005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:22.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.408+0000 7f43ad161640 1 --2- 172.21.15.123:0/1404122616 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4394005bc0 0x7f4394005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:22.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.408+0000 7f43ad161640 1 -- 172.21.15.123:0/1404122616 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4394005730 con 0x7f4394006f50 2024-09-15T23:19:22.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.409+0000 7f43ad161640 1 --2- 172.21.15.123:0/1404122616 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4394006f50 0x7f43940073d0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f4398009af0 tx=0x7f4394007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3684a767a439318 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:22.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.409+0000 7f43a77fe640 1 -- 172.21.15.123:0/1404122616 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4398036070 con 0x7f4394006f50 2024-09-15T23:19:22.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.409+0000 7f43a77fe640 1 -- 172.21.15.123:0/1404122616 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4398031400 con 0x7f4394006f50 2024-09-15T23:19:22.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.409+0000 7f43a77fe640 1 -- 172.21.15.123:0/1404122616 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4398009690 con 0x7f4394006f50 2024-09-15T23:19:22.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.409+0000 7f43aebc4640 1 -- 172.21.15.123:0/1404122616 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4394006f50 msgr2=0x7f43940073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:22.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.409+0000 7f43aebc4640 1 --2- 172.21.15.123:0/1404122616 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4394006f50 0x7f43940073d0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f4398009af0 tx=0x7f4394007a40 comp rx=0 tx=0).stop 2024-09-15T23:19:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.410+0000 7f43ad161640 1 -- 172.21.15.123:0/1404122616 reap_dead start 2024-09-15T23:19:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.410+0000 7f43aebc4640 1 -- 172.21.15.123:0/1404122616 shutdown_connections 2024-09-15T23:19:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.410+0000 7f43aebc4640 1 -- 172.21.15.123:0/1404122616 >> 172.21.15.123:0/1404122616 conn(0x7f43a80ccec0 msgr2=0x7f43a80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.410+0000 7f43aebc4640 1 -- 172.21.15.123:0/1404122616 shutdown_connections 2024-09-15T23:19:22.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.410+0000 7f43aebc4640 1 -- 172.21.15.123:0/1404122616 wait complete. 2024-09-15T23:19:22.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.411+0000 7f43aebc4640 1 Processor -- start 2024-09-15T23:19:22.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.411+0000 7f43aebc4640 1 -- start start 2024-09-15T23:19:22.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.412+0000 7f43aebc4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4394006f50 0x7f43a81416a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:22.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.412+0000 7f43aebc4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43a8158c80 0x7f43a8157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:22.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.412+0000 7f43aebc4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43a8158260 0x7f43a815da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:22.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.412+0000 7f43aebc4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f43a815c5c0 con 0x7f43a8158c80 2024-09-15T23:19:22.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.412+0000 7f43aebc4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f43a815c440 con 0x7f43a8158260 2024-09-15T23:19:22.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.412+0000 7f43aebc4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f43a815c740 con 0x7f4394006f50 2024-09-15T23:19:22.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.412+0000 7f43a7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43a8158c80 0x7f43a8157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:22.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.412+0000 7f43a7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43a8158c80 0x7f43a8157d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32870/0 (socket says 172.21.15.123:32870) 2024-09-15T23:19:22.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.412+0000 7f43a7fff640 1 -- 172.21.15.123:0/852973969 learned_addr learned my addr 172.21.15.123:0/852973969 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:22.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.412+0000 7f43ac960640 1 --2- 172.21.15.123:0/852973969 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4394006f50 0x7f43a81416a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:22.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.412+0000 7f43ad161640 1 --2- 172.21.15.123:0/852973969 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43a8158260 0x7f43a815da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:22.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.412+0000 7f43a7fff640 1 -- 172.21.15.123:0/852973969 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4394006f50 msgr2=0x7f43a81416a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:22.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.412+0000 7f43a7fff640 1 --2- 172.21.15.123:0/852973969 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4394006f50 0x7f43a81416a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:22.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.412+0000 7f43a7fff640 1 -- 172.21.15.123:0/852973969 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43a8158260 msgr2=0x7f43a815da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:22.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.412+0000 7f43a7fff640 1 --2- 172.21.15.123:0/852973969 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43a8158260 0x7f43a815da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:22.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.412+0000 7f43a7fff640 1 -- 172.21.15.123:0/852973969 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43a8157580 con 0x7f43a8158c80 2024-09-15T23:19:22.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.412+0000 7f43ad161640 1 --2- 172.21.15.123:0/852973969 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43a8158260 0x7f43a815da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:19:22.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.412+0000 7f43a7fff640 1 --2- 172.21.15.123:0/852973969 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43a8158c80 0x7f43a8157d20 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f4390011e60 tx=0x7f439000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:22.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.412+0000 7f43a57fa640 1 -- 172.21.15.123:0/852973969 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4390015630 con 0x7f43a8158c80 2024-09-15T23:19:22.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.412+0000 7f43a57fa640 1 -- 172.21.15.123:0/852973969 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43900157d0 con 0x7f43a8158c80 2024-09-15T23:19:22.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.412+0000 7f43a57fa640 1 -- 172.21.15.123:0/852973969 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4390015ba0 con 0x7f43a8158c80 2024-09-15T23:19:22.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.412+0000 7f43aebc4640 1 -- 172.21.15.123:0/852973969 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43a815d320 con 0x7f43a8158c80 2024-09-15T23:19:22.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.412+0000 7f43aebc4640 1 -- 172.21.15.123:0/852973969 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43a815dfa0 con 0x7f43a8158c80 2024-09-15T23:19:22.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.413+0000 7f43aebc4640 1 -- 172.21.15.123:0/852973969 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43a815bcf0 con 0x7f43a8158c80 2024-09-15T23:19:22.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.414+0000 7f43a57fa640 1 -- 172.21.15.123:0/852973969 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f439001d400 con 0x7f43a8158c80 2024-09-15T23:19:22.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.414+0000 7f43a57fa640 1 --2- 172.21.15.123:0/852973969 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f438806c2b0 0x7f438806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:22.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.414+0000 7f43a57fa640 1 -- 172.21.15.123:0/852973969 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f439008c710 con 0x7f43a8158c80 2024-09-15T23:19:22.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.414+0000 7f43ac960640 1 --2- 172.21.15.123:0/852973969 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f438806c2b0 0x7f438806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:22.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.415+0000 7f43ac960640 1 --2- 172.21.15.123:0/852973969 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f438806c2b0 0x7f438806e770 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f43a80b2990 tx=0x7f43a0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:22.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.419+0000 7f43a57fa640 1 -- 172.21.15.123:0/852973969 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f43a8157580 con 0x7f43a8158c80 2024-09-15T23:19:22.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.596+0000 7f43aebc4640 1 -- 172.21.15.123:0/852973969 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f43a8140020 con 0x7f43a8158c80 2024-09-15T23:19:22.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.597+0000 7f43a57fa640 1 -- 172.21.15.123:0/852973969 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v130) ==== 80+0+0 (secure 0 0 0) 0x7f4390019030 con 0x7f43a8158c80 2024-09-15T23:19:22.598 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-15T23:19:22.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.599+0000 7f43aebc4640 1 -- 172.21.15.123:0/852973969 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f438806c2b0 msgr2=0x7f438806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:22.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.599+0000 7f43aebc4640 1 --2- 172.21.15.123:0/852973969 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f438806c2b0 0x7f438806e770 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f43a80b2990 tx=0x7f43a0009040 comp rx=0 tx=0).stop 2024-09-15T23:19:22.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.599+0000 7f43aebc4640 1 -- 172.21.15.123:0/852973969 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43a8158c80 msgr2=0x7f43a8157d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:22.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.599+0000 7f43aebc4640 1 --2- 172.21.15.123:0/852973969 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43a8158c80 0x7f43a8157d20 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f4390011e60 tx=0x7f439000f580 comp rx=0 tx=0).stop 2024-09-15T23:19:22.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.599+0000 7f43aebc4640 1 -- 172.21.15.123:0/852973969 shutdown_connections 2024-09-15T23:19:22.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.599+0000 7f43aebc4640 1 --2- 172.21.15.123:0/852973969 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43a8158260 0x7f43a815da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:22.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.599+0000 7f43aebc4640 1 --2- 172.21.15.123:0/852973969 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f438806c2b0 0x7f438806e770 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:22.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.599+0000 7f43aebc4640 1 --2- 172.21.15.123:0/852973969 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43a8158c80 0x7f43a8157d20 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:22.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.599+0000 7f43aebc4640 1 --2- 172.21.15.123:0/852973969 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4394006f50 0x7f43a81416a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:22.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.599+0000 7f43aebc4640 1 -- 172.21.15.123:0/852973969 >> 172.21.15.123:0/852973969 conn(0x7f43a80ccec0 msgr2=0x7f43a813f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:22.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.599+0000 7f43aebc4640 1 -- 172.21.15.123:0/852973969 shutdown_connections 2024-09-15T23:19:22.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:22.599+0000 7f43aebc4640 1 -- 172.21.15.123:0/852973969 wait complete. 2024-09-15T23:19:22.611 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-15T23:19:22.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:19:22.611 DEBUG:teuthology.orchestra.run.smithi123:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-15T23:19:23.217 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-09-15T23:19:23.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:19:23.217 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T23:19:23.237 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:19:23.237 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:19:23.237 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:19:23.253 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:19:23.253 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:19:23.253 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:19:23.253 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:19:23.293 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:19:23.293 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:19:23.293 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:19:23.293 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:19:23.309 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:19:23.309 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:19:23.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.431+0000 7f84ca72a640 1 Processor -- start 2024-09-15T23:19:23.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.431+0000 7f84ca72a640 1 -- start start 2024-09-15T23:19:23.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.432+0000 7f84ca72a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f84c415e6d0 0x7f84c4071390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:23.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.432+0000 7f84ca72a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f84c406cd20 0x7f84c40b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:23.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.432+0000 7f84ca72a640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84c415eab0 con 0x7f84c4070b80 2024-09-15T23:19:23.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.432+0000 7f84ca72a640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f84c415ed70 con 0x7f84c406cd20 2024-09-15T23:19:23.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.432+0000 7f84ca72a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f84c415f050 con 0x7f84c415e6d0 2024-09-15T23:19:23.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.432+0000 7f84c37fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f84c406cd20 0x7f84c40b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:23.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.432+0000 7f84c37fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f84c406cd20 0x7f84c40b6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32874/0 (socket says 172.21.15.123:32874) 2024-09-15T23:19:23.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.432+0000 7f84c37fe640 1 -- 172.21.15.123:0/1653303552 learned_addr learned my addr 172.21.15.123:0/1653303552 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:23.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.433+0000 7f84c37fe640 1 -- 172.21.15.123:0/1653303552 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f84c415e6d0 msgr2=0x7f84c4071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:23.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.433+0000 7f84c37fe640 1 --2- 172.21.15.123:0/1653303552 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f84c415e6d0 0x7f84c4071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:23.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.433+0000 7f84c37fe640 1 -- 172.21.15.123:0/1653303552 >> v1:172.21.15.188:6789/0 conn(0x7f84c4070b80 legacy=0x7f84c40731a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:23.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.433+0000 7f84c37fe640 1 -- 172.21.15.123:0/1653303552 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c415f330 con 0x7f84c406cd20 2024-09-15T23:19:23.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.433+0000 7f84c37fe640 1 --2- 172.21.15.123:0/1653303552 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84c406cd20 0x7f84c40b6d60 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f84b8009870 tx=0x7f84b802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a43b0989aef61c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:23.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.433+0000 7f84c2ffd640 1 -- 172.21.15.123:0/1653303552 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b8037070 con 0x7f84c406cd20 2024-09-15T23:19:23.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.433+0000 7f84c2ffd640 1 -- 172.21.15.123:0/1653303552 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84b8032440 con 0x7f84c406cd20 2024-09-15T23:19:23.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.433+0000 7f84c2ffd640 1 -- 172.21.15.123:0/1653303552 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b8032810 con 0x7f84c406cd20 2024-09-15T23:19:23.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.434+0000 7f84ca72a640 1 -- 172.21.15.123:0/1653303552 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84c406cd20 msgr2=0x7f84c40b6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:23.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.434+0000 7f84ca72a640 1 --2- 172.21.15.123:0/1653303552 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84c406cd20 0x7f84c40b6d60 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f84b8009870 tx=0x7f84b802a210 comp rx=0 tx=0).stop 2024-09-15T23:19:23.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.434+0000 7f84ca72a640 1 -- 172.21.15.123:0/1653303552 shutdown_connections 2024-09-15T23:19:23.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.434+0000 7f84ca72a640 1 --2- 172.21.15.123:0/1653303552 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84c406cd20 0x7f84c40b6d60 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:23.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.434+0000 7f84ca72a640 1 --2- 172.21.15.123:0/1653303552 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f84c415e6d0 0x7f84c4071390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:23.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.434+0000 7f84ca72a640 1 -- 172.21.15.123:0/1653303552 >> 172.21.15.123:0/1653303552 conn(0x7f84c4067fb0 msgr2=0x7f84c406f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:23.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.434+0000 7f84ca72a640 1 -- 172.21.15.123:0/1653303552 shutdown_connections 2024-09-15T23:19:23.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.434+0000 7f84ca72a640 1 -- 172.21.15.123:0/1653303552 wait complete. 2024-09-15T23:19:23.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.435+0000 7f84ca72a640 1 Processor -- start 2024-09-15T23:19:23.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.435+0000 7f84ca72a640 1 -- start start 2024-09-15T23:19:23.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.436+0000 7f84ca72a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f84c406cd20 0x7f84c4156980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:23.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.436+0000 7f84ca72a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f84c4070b80 0x7f84c414e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:23.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.436+0000 7f84ca72a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84c415e6d0 0x7f84c414e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:23.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.436+0000 7f84ca72a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f84c40718d0 con 0x7f84c415e6d0 2024-09-15T23:19:23.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.436+0000 7f84ca72a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f84c415f8f0 con 0x7f84c406cd20 2024-09-15T23:19:23.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.436+0000 7f84ca72a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f84c4071a50 con 0x7f84c4070b80 2024-09-15T23:19:23.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.436+0000 7f84c8cc7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84c415e6d0 0x7f84c414e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:23.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.436+0000 7f84c8cc7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84c415e6d0 0x7f84c414e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32882/0 (socket says 172.21.15.123:32882) 2024-09-15T23:19:23.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.436+0000 7f84c8cc7640 1 -- 172.21.15.123:0/1205857042 learned_addr learned my addr 172.21.15.123:0/1205857042 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:23.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.436+0000 7f84c37fe640 1 --2- 172.21.15.123:0/1205857042 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f84c4070b80 0x7f84c414e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:23.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.436+0000 7f84c3fff640 1 --2- 172.21.15.123:0/1205857042 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f84c406cd20 0x7f84c4156980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:23.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.437+0000 7f84c8cc7640 1 -- 172.21.15.123:0/1205857042 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f84c4070b80 msgr2=0x7f84c414e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:23.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.437+0000 7f84c8cc7640 1 --2- 172.21.15.123:0/1205857042 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f84c4070b80 0x7f84c414e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:23.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.437+0000 7f84c8cc7640 1 -- 172.21.15.123:0/1205857042 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f84c406cd20 msgr2=0x7f84c4156980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:23.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.437+0000 7f84c8cc7640 1 --2- 172.21.15.123:0/1205857042 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f84c406cd20 0x7f84c4156980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:23.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.437+0000 7f84c8cc7640 1 -- 172.21.15.123:0/1205857042 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c41580b0 con 0x7f84c415e6d0 2024-09-15T23:19:23.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.437+0000 7f84c8cc7640 1 --2- 172.21.15.123:0/1205857042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84c415e6d0 0x7f84c414e8c0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f84bc00c780 tx=0x7f84bc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:23.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.437+0000 7f84c0ff9640 1 -- 172.21.15.123:0/1205857042 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84bc017070 con 0x7f84c415e6d0 2024-09-15T23:19:23.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.437+0000 7f84c0ff9640 1 -- 172.21.15.123:0/1205857042 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84bc003da0 con 0x7f84c415e6d0 2024-09-15T23:19:23.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.437+0000 7f84c0ff9640 1 -- 172.21.15.123:0/1205857042 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84bc0052b0 con 0x7f84c415e6d0 2024-09-15T23:19:23.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.437+0000 7f84ca72a640 1 -- 172.21.15.123:0/1205857042 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84c4158390 con 0x7f84c415e6d0 2024-09-15T23:19:23.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.437+0000 7f84ca72a640 1 -- 172.21.15.123:0/1205857042 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84c4157b30 con 0x7f84c415e6d0 2024-09-15T23:19:23.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.438+0000 7f84ca72a640 1 -- 172.21.15.123:0/1205857042 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84c4071390 con 0x7f84c415e6d0 2024-09-15T23:19:23.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.439+0000 7f84c0ff9640 1 -- 172.21.15.123:0/1205857042 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f84bc005450 con 0x7f84c415e6d0 2024-09-15T23:19:23.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.439+0000 7f84c0ff9640 1 --2- 172.21.15.123:0/1205857042 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f84b006c2b0 0x7f84b006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:23.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.439+0000 7f84c0ff9640 1 -- 172.21.15.123:0/1205857042 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f84bc08a9a0 con 0x7f84c415e6d0 2024-09-15T23:19:23.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.439+0000 7f84c3fff640 1 --2- 172.21.15.123:0/1205857042 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f84b006c2b0 0x7f84b006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:23.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.440+0000 7f84c3fff640 1 --2- 172.21.15.123:0/1205857042 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f84b006c2b0 0x7f84b006e770 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f84b400b810 tx=0x7f84b4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:23.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.443+0000 7f84c0ff9640 1 -- 172.21.15.123:0/1205857042 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f84bc059110 con 0x7f84c415e6d0 2024-09-15T23:19:23.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.645+0000 7f84ca72a640 1 -- 172.21.15.123:0/1205857042 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f84c4161820 con 0x7f84c415e6d0 2024-09-15T23:19:23.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.646+0000 7f84c0ff9640 1 -- 172.21.15.123:0/1205857042 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) ==== 94+0+5237 (secure 0 0 0) 0x7f84bc058a10 con 0x7f84c415e6d0 2024-09-15T23:19:23.647 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:19:23.647 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":80,"btime":"2024-09-15T23:18:57:403025+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6386,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/1352396114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":1352396114},{"type":"v1","addr":"172.21.15.188:6836","nonce":1352396114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":8022,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2727961795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2727961795},{"type":"v1","addr":"172.21.15.123:6834","nonce":2727961795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":8025,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3879785466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":3879785466},{"type":"v1","addr":"172.21.15.123:6835","nonce":3879785466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:18:54.727897+0000","modified":"2024-09-15T23:18:56.730668+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8034},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8034":{"gid":8034,"name":"d","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6837/3551744094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":3551744094},{"type":"v1","addr":"172.21.15.188:6837","nonce":3551744094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8034,"qdb_cluster":[8034]},"id":8}]} 2024-09-15T23:19:23.647 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 80 2024-09-15T23:19:23.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.648+0000 7f84ca72a640 1 -- 172.21.15.123:0/1205857042 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f84b006c2b0 msgr2=0x7f84b006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:23.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.648+0000 7f84ca72a640 1 --2- 172.21.15.123:0/1205857042 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f84b006c2b0 0x7f84b006e770 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f84b400b810 tx=0x7f84b4008040 comp rx=0 tx=0).stop 2024-09-15T23:19:23.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.648+0000 7f84ca72a640 1 -- 172.21.15.123:0/1205857042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84c415e6d0 msgr2=0x7f84c414e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:23.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.648+0000 7f84ca72a640 1 --2- 172.21.15.123:0/1205857042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84c415e6d0 0x7f84c414e8c0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f84bc00c780 tx=0x7f84bc00cc40 comp rx=0 tx=0).stop 2024-09-15T23:19:23.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.648+0000 7f84ca72a640 1 -- 172.21.15.123:0/1205857042 shutdown_connections 2024-09-15T23:19:23.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.648+0000 7f84ca72a640 1 --2- 172.21.15.123:0/1205857042 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f84b006c2b0 0x7f84b006e770 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:23.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.648+0000 7f84ca72a640 1 --2- 172.21.15.123:0/1205857042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84c415e6d0 0x7f84c414e8c0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:23.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.648+0000 7f84ca72a640 1 --2- 172.21.15.123:0/1205857042 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f84c4070b80 0x7f84c414e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:23.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.648+0000 7f84ca72a640 1 --2- 172.21.15.123:0/1205857042 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f84c406cd20 0x7f84c4156980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:23.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.648+0000 7f84ca72a640 1 -- 172.21.15.123:0/1205857042 >> 172.21.15.123:0/1205857042 conn(0x7f84c4067fb0 msgr2=0x7f84c4161fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:23.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.648+0000 7f84ca72a640 1 -- 172.21.15.123:0/1205857042 shutdown_connections 2024-09-15T23:19:23.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.648+0000 7f84ca72a640 1 -- 172.21.15.123:0/1205857042 wait complete. 2024-09-15T23:19:23.661 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:19:23.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.758+0000 7fd7d1df6640 1 Processor -- start 2024-09-15T23:19:23.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.758+0000 7fd7d1df6640 1 -- start start 2024-09-15T23:19:23.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.759+0000 7fd7d1df6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd7cc06c320 0x7fd7cc15bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:23.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.759+0000 7fd7d1df6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd7cc13eb20 0x7fd7cc15c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:23.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.759+0000 7fd7d1df6640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7cc071180 con 0x7fd7cc0b2d40 2024-09-15T23:19:23.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.759+0000 7fd7d1df6640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fd7cc071ab0 con 0x7fd7cc06c320 2024-09-15T23:19:23.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.759+0000 7fd7d1df6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd7cc071460 con 0x7fd7cc13eb20 2024-09-15T23:19:23.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.759+0000 7fd7caffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd7cc06c320 0x7fd7cc15bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:23.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.759+0000 7fd7caffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd7cc06c320 0x7fd7cc15bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32890/0 (socket says 172.21.15.123:32890) 2024-09-15T23:19:23.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.759+0000 7fd7caffd640 1 -- 172.21.15.123:0/2056429177 learned_addr learned my addr 172.21.15.123:0/2056429177 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:23.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.759+0000 7fd7cbfff640 1 --2- 172.21.15.123:0/2056429177 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd7cc13eb20 0x7fd7cc15c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:23.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.759+0000 7fd7caffd640 1 -- 172.21.15.123:0/2056429177 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd7cc13eb20 msgr2=0x7fd7cc15c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:23.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.759+0000 7fd7caffd640 1 --2- 172.21.15.123:0/2056429177 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd7cc13eb20 0x7fd7cc15c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:23.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.759+0000 7fd7caffd640 1 -- 172.21.15.123:0/2056429177 >> v1:172.21.15.188:6789/0 conn(0x7fd7cc0b2d40 legacy=0x7fd7cc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:23.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.759+0000 7fd7caffd640 1 -- 172.21.15.123:0/2056429177 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7cc071740 con 0x7fd7cc06c320 2024-09-15T23:19:23.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.760+0000 7fd7caffd640 1 --2- 172.21.15.123:0/2056429177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7cc06c320 0x7fd7cc15bcf0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009870 tx=0x7fd7c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd7e76611d318d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:23.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.760+0000 7fd7ca7fc640 1 -- 172.21.15.123:0/2056429177 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c0037070 con 0x7fd7cc06c320 2024-09-15T23:19:23.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.760+0000 7fd7ca7fc640 1 -- 172.21.15.123:0/2056429177 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7c0032440 con 0x7fd7cc06c320 2024-09-15T23:19:23.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.760+0000 7fd7ca7fc640 1 -- 172.21.15.123:0/2056429177 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c0032810 con 0x7fd7cc06c320 2024-09-15T23:19:23.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.761+0000 7fd7d1df6640 1 -- 172.21.15.123:0/2056429177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7cc06c320 msgr2=0x7fd7cc15bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:23.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.761+0000 7fd7d1df6640 1 --2- 172.21.15.123:0/2056429177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7cc06c320 0x7fd7cc15bcf0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0009870 tx=0x7fd7c002a270 comp rx=0 tx=0).stop 2024-09-15T23:19:23.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.761+0000 7fd7d1df6640 1 -- 172.21.15.123:0/2056429177 shutdown_connections 2024-09-15T23:19:23.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.761+0000 7fd7d1df6640 1 --2- 172.21.15.123:0/2056429177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7cc06c320 0x7fd7cc15bcf0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:23.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.761+0000 7fd7d1df6640 1 --2- 172.21.15.123:0/2056429177 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd7cc13eb20 0x7fd7cc15c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:23.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.761+0000 7fd7d1df6640 1 -- 172.21.15.123:0/2056429177 >> 172.21.15.123:0/2056429177 conn(0x7fd7cc0ccec0 msgr2=0x7fd7cc0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:23.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.761+0000 7fd7d1df6640 1 -- 172.21.15.123:0/2056429177 shutdown_connections 2024-09-15T23:19:23.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.761+0000 7fd7d1df6640 1 -- 172.21.15.123:0/2056429177 wait complete. 2024-09-15T23:19:23.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.762+0000 7fd7d1df6640 1 Processor -- start 2024-09-15T23:19:23.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.762+0000 7fd7d1df6640 1 -- start start 2024-09-15T23:19:23.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.763+0000 7fd7d1df6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7cc06c320 0x7fd7cc140240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:23.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.763+0000 7fd7d1df6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7cc0b2d40 0x7fd7cc140780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:23.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.763+0000 7fd7d1df6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd7cc13eb20 0x7fd7cc15ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:23.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.763+0000 7fd7d1df6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd7cc0720c0 con 0x7fd7cc06c320 2024-09-15T23:19:23.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.763+0000 7fd7d1df6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd7cc071f40 con 0x7fd7cc0b2d40 2024-09-15T23:19:23.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.763+0000 7fd7d1df6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd7cc072240 con 0x7fd7cc13eb20 2024-09-15T23:19:23.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.763+0000 7fd7cb7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7cc06c320 0x7fd7cc140240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:23.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.763+0000 7fd7cb7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7cc06c320 0x7fd7cc140240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32904/0 (socket says 172.21.15.123:32904) 2024-09-15T23:19:23.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.763+0000 7fd7cb7fe640 1 -- 172.21.15.123:0/1125865940 learned_addr learned my addr 172.21.15.123:0/1125865940 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:23.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.763+0000 7fd7cbfff640 1 --2- 172.21.15.123:0/1125865940 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd7cc13eb20 0x7fd7cc15ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:23.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.763+0000 7fd7caffd640 1 --2- 172.21.15.123:0/1125865940 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7cc0b2d40 0x7fd7cc140780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:23.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.763+0000 7fd7cb7fe640 1 -- 172.21.15.123:0/1125865940 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd7cc13eb20 msgr2=0x7fd7cc15ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:23.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.763+0000 7fd7cb7fe640 1 --2- 172.21.15.123:0/1125865940 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd7cc13eb20 0x7fd7cc15ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:23.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.763+0000 7fd7cb7fe640 1 -- 172.21.15.123:0/1125865940 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7cc0b2d40 msgr2=0x7fd7cc140780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:23.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.763+0000 7fd7cb7fe640 1 --2- 172.21.15.123:0/1125865940 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7cc0b2d40 0x7fd7cc140780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:23.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.763+0000 7fd7cb7fe640 1 -- 172.21.15.123:0/1125865940 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7cc15b9a0 con 0x7fd7cc06c320 2024-09-15T23:19:23.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.763+0000 7fd7cb7fe640 1 --2- 172.21.15.123:0/1125865940 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7cc06c320 0x7fd7cc140240 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc00c430 tx=0x7fd7bc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:23.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.764+0000 7fd7b3fff640 1 -- 172.21.15.123:0/1125865940 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc0052d0 con 0x7fd7cc06c320 2024-09-15T23:19:23.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.764+0000 7fd7b3fff640 1 -- 172.21.15.123:0/1125865940 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7bc005490 con 0x7fd7cc06c320 2024-09-15T23:19:23.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.764+0000 7fd7d1df6640 1 -- 172.21.15.123:0/1125865940 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7cc15bc80 con 0x7fd7cc06c320 2024-09-15T23:19:23.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.764+0000 7fd7b3fff640 1 -- 172.21.15.123:0/1125865940 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc007260 con 0x7fd7cc06c320 2024-09-15T23:19:23.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.764+0000 7fd7d1df6640 1 -- 172.21.15.123:0/1125865940 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7cc15bf60 con 0x7fd7cc06c320 2024-09-15T23:19:23.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.765+0000 7fd7d1df6640 1 -- 172.21.15.123:0/1125865940 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7cc06bc10 con 0x7fd7cc06c320 2024-09-15T23:19:23.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.765+0000 7fd7b3fff640 1 -- 172.21.15.123:0/1125865940 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd7bc007400 con 0x7fd7cc06c320 2024-09-15T23:19:23.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.765+0000 7fd7b3fff640 1 --2- 172.21.15.123:0/1125865940 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd7b806c2b0 0x7fd7b806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:23.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.766+0000 7fd7b3fff640 1 -- 172.21.15.123:0/1125865940 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7fd7bc08a810 con 0x7fd7cc06c320 2024-09-15T23:19:23.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.766+0000 7fd7caffd640 1 --2- 172.21.15.123:0/1125865940 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd7b806c2b0 0x7fd7b806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:23.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.766+0000 7fd7caffd640 1 --2- 172.21.15.123:0/1125865940 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd7b806c2b0 0x7fd7b806e770 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0034000 tx=0x7fd7c002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:23.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.770+0000 7fd7b3fff640 1 -- 172.21.15.123:0/1125865940 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd7bc0589c0 con 0x7fd7cc06c320 2024-09-15T23:19:23.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.969+0000 7fd7d1df6640 1 -- 172.21.15.123:0/1125865940 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7cc06c9c0 con 0x7fd7cc06c320 2024-09-15T23:19:23.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.969+0000 7fd7b3fff640 1 -- 172.21.15.123:0/1125865940 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) ==== 94+0+5237 (secure 0 0 0) 0x7fd7bc05ccc0 con 0x7fd7cc06c320 2024-09-15T23:19:23.972 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:19:23.972 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":80,"btime":"2024-09-15T23:18:57:403025+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6386,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/1352396114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":1352396114},{"type":"v1","addr":"172.21.15.188:6836","nonce":1352396114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":8022,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2727961795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2727961795},{"type":"v1","addr":"172.21.15.123:6834","nonce":2727961795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":8025,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3879785466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":3879785466},{"type":"v1","addr":"172.21.15.123:6835","nonce":3879785466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:18:54.727897+0000","modified":"2024-09-15T23:18:56.730668+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8034},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8034":{"gid":8034,"name":"d","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6837/3551744094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":3551744094},{"type":"v1","addr":"172.21.15.188:6837","nonce":3551744094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8034,"qdb_cluster":[8034]},"id":8}]} 2024-09-15T23:19:23.976 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 80 2024-09-15T23:19:23.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.971+0000 7fd7d1df6640 1 -- 172.21.15.123:0/1125865940 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd7b806c2b0 msgr2=0x7fd7b806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:23.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.971+0000 7fd7d1df6640 1 --2- 172.21.15.123:0/1125865940 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd7b806c2b0 0x7fd7b806e770 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fd7c0034000 tx=0x7fd7c002e000 comp rx=0 tx=0).stop 2024-09-15T23:19:23.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.971+0000 7fd7d1df6640 1 -- 172.21.15.123:0/1125865940 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7cc06c320 msgr2=0x7fd7cc140240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:23.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.971+0000 7fd7d1df6640 1 --2- 172.21.15.123:0/1125865940 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7cc06c320 0x7fd7cc140240 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc00c430 tx=0x7fd7bc00c8f0 comp rx=0 tx=0).stop 2024-09-15T23:19:23.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.971+0000 7fd7d1df6640 1 -- 172.21.15.123:0/1125865940 shutdown_connections 2024-09-15T23:19:23.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.971+0000 7fd7d1df6640 1 --2- 172.21.15.123:0/1125865940 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd7cc13eb20 0x7fd7cc15ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:23.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.971+0000 7fd7d1df6640 1 --2- 172.21.15.123:0/1125865940 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd7cc0b2d40 0x7fd7cc140780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:23.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.971+0000 7fd7d1df6640 1 --2- 172.21.15.123:0/1125865940 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd7b806c2b0 0x7fd7b806e770 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:23.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.971+0000 7fd7d1df6640 1 --2- 172.21.15.123:0/1125865940 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7cc06c320 0x7fd7cc140240 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:23.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.971+0000 7fd7d1df6640 1 -- 172.21.15.123:0/1125865940 >> 172.21.15.123:0/1125865940 conn(0x7fd7cc0ccec0 msgr2=0x7fd7cc072620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:23.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.972+0000 7fd7d1df6640 1 -- 172.21.15.123:0/1125865940 shutdown_connections 2024-09-15T23:19:23.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:23.972+0000 7fd7d1df6640 1 -- 172.21.15.123:0/1125865940 wait complete. 2024-09-15T23:19:23.984 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:19:24.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.081+0000 7f4307c1e640 1 Processor -- start 2024-09-15T23:19:24.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.081+0000 7f4307c1e640 1 -- start start 2024-09-15T23:19:24.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.082+0000 7f4307c1e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f430015ab40 0x7f430006c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:24.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.082+0000 7f4307c1e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f43000720b0 0x7f4300073990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:24.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.082+0000 7f4307c1e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f430015af20 0x7f430015b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:24.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.082+0000 7f4307c1e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f4300072520 con 0x7f43000720b0 2024-09-15T23:19:24.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.082+0000 7f4307c1e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f4300071010 con 0x7f430015ab40 2024-09-15T23:19:24.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.082+0000 7f4307c1e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f43000712f0 con 0x7f430015af20 2024-09-15T23:19:24.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.082+0000 7f43051b9640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f43000720b0 0x7f4300073990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:24.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.082+0000 7f43051b9640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f43000720b0 0x7f4300073990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32910/0 (socket says 172.21.15.123:32910) 2024-09-15T23:19:24.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.082+0000 7f43051b9640 1 -- 172.21.15.123:0/930423313 learned_addr learned my addr 172.21.15.123:0/930423313 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:24.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.082+0000 7f43061bb640 1 --2- 172.21.15.123:0/930423313 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f430015af20 0x7f430015b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:24.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.082+0000 7f43051b9640 1 -- 172.21.15.123:0/930423313 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f430015af20 msgr2=0x7f430015b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:24.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.082+0000 7f43059ba640 1 --2- 172.21.15.123:0/930423313 >> v2:172.21.15.188:3300/0 conn(0x7f430015ab40 0x7f430006c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:24.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.082+0000 7f43051b9640 1 --2- 172.21.15.123:0/930423313 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f430015af20 0x7f430015b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:24.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.082+0000 7f43051b9640 1 -- 172.21.15.123:0/930423313 >> v2:172.21.15.188:3300/0 conn(0x7f430015ab40 msgr2=0x7f430006c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:24.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.082+0000 7f43051b9640 1 --2- 172.21.15.123:0/930423313 >> v2:172.21.15.188:3300/0 conn(0x7f430015ab40 0x7f430006c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:24.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.082+0000 7f43051b9640 1 -- 172.21.15.123:0/930423313 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43000715d0 con 0x7f43000720b0 2024-09-15T23:19:24.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.082+0000 7f43061bb640 1 --2- 172.21.15.123:0/930423313 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f430015af20 0x7f430015b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:19:24.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.082+0000 7f43059ba640 1 --2- 172.21.15.123:0/930423313 >> v2:172.21.15.188:3300/0 conn(0x7f430015ab40 0x7f430006c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:19:24.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.083+0000 7f43051b9640 1 --2- 172.21.15.123:0/930423313 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43000720b0 0x7f4300073990 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f43000d1500 tx=0x7f42f402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4405218b49a71f8c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:24.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.083+0000 7f43049b8640 1 -- 172.21.15.123:0/930423313 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f4037070 con 0x7f43000720b0 2024-09-15T23:19:24.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.083+0000 7f43049b8640 1 -- 172.21.15.123:0/930423313 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f4032440 con 0x7f43000720b0 2024-09-15T23:19:24.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.083+0000 7f43049b8640 1 -- 172.21.15.123:0/930423313 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f4032810 con 0x7f43000720b0 2024-09-15T23:19:24.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.084+0000 7f4307c1e640 1 -- 172.21.15.123:0/930423313 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43000720b0 msgr2=0x7f4300073990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:24.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.084+0000 7f4307c1e640 1 --2- 172.21.15.123:0/930423313 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43000720b0 0x7f4300073990 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f43000d1500 tx=0x7f42f402a140 comp rx=0 tx=0).stop 2024-09-15T23:19:24.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.084+0000 7f4307c1e640 1 -- 172.21.15.123:0/930423313 shutdown_connections 2024-09-15T23:19:24.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.084+0000 7f4307c1e640 1 --2- 172.21.15.123:0/930423313 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f430015af20 0x7f430015b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:24.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.084+0000 7f4307c1e640 1 --2- 172.21.15.123:0/930423313 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43000720b0 0x7f4300073990 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:24.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.084+0000 7f4307c1e640 1 --2- 172.21.15.123:0/930423313 >> v2:172.21.15.188:3300/0 conn(0x7f430015ab40 0x7f430006c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:24.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.084+0000 7f4307c1e640 1 -- 172.21.15.123:0/930423313 >> 172.21.15.123:0/930423313 conn(0x7f43000ccec0 msgr2=0x7f43000cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:24.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.084+0000 7f4307c1e640 1 -- 172.21.15.123:0/930423313 shutdown_connections 2024-09-15T23:19:24.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.084+0000 7f4307c1e640 1 -- 172.21.15.123:0/930423313 wait complete. 2024-09-15T23:19:24.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.085+0000 7f4307c1e640 1 Processor -- start 2024-09-15T23:19:24.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.085+0000 7f4307c1e640 1 -- start start 2024-09-15T23:19:24.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.086+0000 7f4307c1e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43000720b0 0x7f4300150450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:24.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.086+0000 7f4307c1e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f430015ab40 0x7f4300154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:24.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.086+0000 7f4307c1e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f430015af20 0x7f43001573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:24.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.086+0000 7f4307c1e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f430015b8b0 con 0x7f430015af20 2024-09-15T23:19:24.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.086+0000 7f4307c1e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4300073ed0 con 0x7f430015ab40 2024-09-15T23:19:24.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.086+0000 7f4307c1e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f430015ba30 con 0x7f43000720b0 2024-09-15T23:19:24.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.086+0000 7f43061bb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f430015af20 0x7f43001573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:24.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.086+0000 7f43061bb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f430015af20 0x7f43001573e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32914/0 (socket says 172.21.15.123:32914) 2024-09-15T23:19:24.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.086+0000 7f43061bb640 1 -- 172.21.15.123:0/4000881040 learned_addr learned my addr 172.21.15.123:0/4000881040 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:24.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.086+0000 7f43059ba640 1 --2- 172.21.15.123:0/4000881040 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43000720b0 0x7f4300150450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:24.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.086+0000 7f43051b9640 1 --2- 172.21.15.123:0/4000881040 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f430015ab40 0x7f4300154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:24.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.086+0000 7f43061bb640 1 -- 172.21.15.123:0/4000881040 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43000720b0 msgr2=0x7f4300150450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:24.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.086+0000 7f43061bb640 1 --2- 172.21.15.123:0/4000881040 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43000720b0 0x7f4300150450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:24.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.086+0000 7f43061bb640 1 -- 172.21.15.123:0/4000881040 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f430015ab40 msgr2=0x7f4300154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:24.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.086+0000 7f43061bb640 1 --2- 172.21.15.123:0/4000881040 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f430015ab40 0x7f4300154bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:24.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.086+0000 7f43061bb640 1 -- 172.21.15.123:0/4000881040 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4300155520 con 0x7f430015af20 2024-09-15T23:19:24.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.086+0000 7f43061bb640 1 --2- 172.21.15.123:0/4000881040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f430015af20 0x7f43001573e0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f42f800c7c0 tx=0x7f42f800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:24.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.086+0000 7f42fe7fc640 1 -- 172.21.15.123:0/4000881040 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f8015020 con 0x7f430015af20 2024-09-15T23:19:24.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.086+0000 7f42fe7fc640 1 -- 172.21.15.123:0/4000881040 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f8004230 con 0x7f430015af20 2024-09-15T23:19:24.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.086+0000 7f42fe7fc640 1 -- 172.21.15.123:0/4000881040 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f8007620 con 0x7f430015af20 2024-09-15T23:19:24.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.086+0000 7f4307c1e640 1 -- 172.21.15.123:0/4000881040 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4300155800 con 0x7f430015af20 2024-09-15T23:19:24.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.087+0000 7f4307c1e640 1 -- 172.21.15.123:0/4000881040 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4300155dc0 con 0x7f430015af20 2024-09-15T23:19:24.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.088+0000 7f4307c1e640 1 -- 172.21.15.123:0/4000881040 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f430006bd20 con 0x7f430015af20 2024-09-15T23:19:24.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.088+0000 7f42fe7fc640 1 -- 172.21.15.123:0/4000881040 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f42f8018020 con 0x7f430015af20 2024-09-15T23:19:24.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.088+0000 7f42fe7fc640 1 --2- 172.21.15.123:0/4000881040 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f42ec06c2b0 0x7f42ec06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:24.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.089+0000 7f42fe7fc640 1 -- 172.21.15.123:0/4000881040 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f42f808b3f0 con 0x7f430015af20 2024-09-15T23:19:24.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.089+0000 7f43059ba640 1 --2- 172.21.15.123:0/4000881040 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f42ec06c2b0 0x7f42ec06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:24.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.089+0000 7f43059ba640 1 --2- 172.21.15.123:0/4000881040 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f42ec06c2b0 0x7f42ec06e770 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f4300157370 tx=0x7f42f00077c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:24.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.093+0000 7f42fe7fc640 1 -- 172.21.15.123:0/4000881040 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f42f801f020 con 0x7f430015af20 2024-09-15T23:19:24.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.259+0000 7f4307c1e640 1 -- 172.21.15.123:0/4000881040 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f430006c6a0 con 0x7f430015af20 2024-09-15T23:19:24.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.260+0000 7f42fe7fc640 1 -- 172.21.15.123:0/4000881040 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) ==== 74+0+16767 (secure 0 0 0) 0x7f42f80595d0 con 0x7f430015af20 2024-09-15T23:19:24.261 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:19:24.261 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":130,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:18:56.396511+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:18:53.342598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-15T23:18:53.702094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:19:24.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.262+0000 7f4307c1e640 1 -- 172.21.15.123:0/4000881040 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f42ec06c2b0 msgr2=0x7f42ec06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:24.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.262+0000 7f4307c1e640 1 --2- 172.21.15.123:0/4000881040 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f42ec06c2b0 0x7f42ec06e770 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f4300157370 tx=0x7f42f00077c0 comp rx=0 tx=0).stop 2024-09-15T23:19:24.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.262+0000 7f4307c1e640 1 -- 172.21.15.123:0/4000881040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f430015af20 msgr2=0x7f43001573e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:24.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.262+0000 7f4307c1e640 1 --2- 172.21.15.123:0/4000881040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f430015af20 0x7f43001573e0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f42f800c7c0 tx=0x7f42f800cc80 comp rx=0 tx=0).stop 2024-09-15T23:19:24.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.262+0000 7f4307c1e640 1 -- 172.21.15.123:0/4000881040 shutdown_connections 2024-09-15T23:19:24.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.262+0000 7f4307c1e640 1 --2- 172.21.15.123:0/4000881040 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f42ec06c2b0 0x7f42ec06e770 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:24.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.262+0000 7f4307c1e640 1 --2- 172.21.15.123:0/4000881040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f430015af20 0x7f43001573e0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:24.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.262+0000 7f4307c1e640 1 --2- 172.21.15.123:0/4000881040 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f430015ab40 0x7f4300154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:24.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.262+0000 7f4307c1e640 1 --2- 172.21.15.123:0/4000881040 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43000720b0 0x7f4300150450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:24.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.262+0000 7f4307c1e640 1 -- 172.21.15.123:0/4000881040 >> 172.21.15.123:0/4000881040 conn(0x7f43000ccec0 msgr2=0x7f4300158130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:24.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.262+0000 7f4307c1e640 1 -- 172.21.15.123:0/4000881040 shutdown_connections 2024-09-15T23:19:24.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.262+0000 7f4307c1e640 1 -- 172.21.15.123:0/4000881040 wait complete. 2024-09-15T23:19:24.274 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T23:19:24.274 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:19:24.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.372+0000 7f96e7665640 1 Processor -- start 2024-09-15T23:19:24.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.372+0000 7f96e7665640 1 -- start start 2024-09-15T23:19:24.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.373+0000 7f96e7665640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96e00cef60 0x7f96e015eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:24.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.373+0000 7f96e7665640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f96e00b3790 0x7f96e01624e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:24.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.373+0000 7f96e7665640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96e015f060 con 0x7f96e006bc10 2024-09-15T23:19:24.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.373+0000 7f96e7665640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f96e00cd690 con 0x7f96e00b3790 2024-09-15T23:19:24.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.373+0000 7f96e7665640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f96e00d06f0 con 0x7f96e00cef60 2024-09-15T23:19:24.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.373+0000 7f96e4c00640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96e00cef60 0x7f96e015eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:24.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.373+0000 7f96e5401640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f96e006bc10 0x7f96e006bff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:57880/0 (socket says 172.21.15.123:57880) 2024-09-15T23:19:24.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.373+0000 7f96e4c00640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96e00cef60 0x7f96e015eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:56068/0 (socket says 172.21.15.123:56068) 2024-09-15T23:19:24.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.373+0000 7f96e5401640 1 -- 172.21.15.123:0/2044769301 learned_addr learned my addr 172.21.15.123:0/2044769301 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:19:24.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.373+0000 7f96e5c02640 1 --2- 172.21.15.123:0/2044769301 >> v2:172.21.15.188:3300/0 conn(0x7f96e00b3790 0x7f96e01624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:24.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.374+0000 7f96e4c00640 1 -- 172.21.15.123:0/2044769301 >> v2:172.21.15.188:3300/0 conn(0x7f96e00b3790 msgr2=0x7f96e01624e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:24.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.374+0000 7f96e4c00640 1 --2- 172.21.15.123:0/2044769301 >> v2:172.21.15.188:3300/0 conn(0x7f96e00b3790 0x7f96e01624e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:24.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.374+0000 7f96e4c00640 1 -- 172.21.15.123:0/2044769301 >> v1:172.21.15.188:6789/0 conn(0x7f96e006bc10 legacy=0x7f96e006bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:24.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.374+0000 7f96e4c00640 1 -- 172.21.15.123:0/2044769301 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e00b4090 con 0x7f96e00cef60 2024-09-15T23:19:24.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.374+0000 7f96e4c00640 1 --2- 172.21.15.123:0/2044769301 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96e00cef60 0x7f96e015eb20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f96d00097a0 tx=0x7f96d002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5216f47e79c0c2de server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:24.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.374+0000 7f96d7fff640 1 -- 172.21.15.123:0/2044769301 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d0037070 con 0x7f96e00cef60 2024-09-15T23:19:24.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.375+0000 7f96d7fff640 1 -- 172.21.15.123:0/2044769301 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96d0032440 con 0x7f96e00cef60 2024-09-15T23:19:24.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.375+0000 7f96d7fff640 1 -- 172.21.15.123:0/2044769301 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d0032810 con 0x7f96e00cef60 2024-09-15T23:19:24.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.375+0000 7f96e7665640 1 -- 172.21.15.123:0/2044769301 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96e00cef60 msgr2=0x7f96e015eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:24.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.375+0000 7f96e7665640 1 --2- 172.21.15.123:0/2044769301 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96e00cef60 0x7f96e015eb20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f96d00097a0 tx=0x7f96d002a180 comp rx=0 tx=0).stop 2024-09-15T23:19:24.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.375+0000 7f96e7665640 1 -- 172.21.15.123:0/2044769301 shutdown_connections 2024-09-15T23:19:24.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.375+0000 7f96e7665640 1 --2- 172.21.15.123:0/2044769301 >> v2:172.21.15.188:3300/0 conn(0x7f96e00b3790 0x7f96e01624e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:24.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.375+0000 7f96e7665640 1 --2- 172.21.15.123:0/2044769301 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96e00cef60 0x7f96e015eb20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:24.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.375+0000 7f96e7665640 1 -- 172.21.15.123:0/2044769301 >> 172.21.15.123:0/2044769301 conn(0x7f96e006cd20 msgr2=0x7f96e006d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:24.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.375+0000 7f96e7665640 1 -- 172.21.15.123:0/2044769301 shutdown_connections 2024-09-15T23:19:24.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.375+0000 7f96e7665640 1 -- 172.21.15.123:0/2044769301 wait complete. 2024-09-15T23:19:24.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.376+0000 7f96e7665640 1 Processor -- start 2024-09-15T23:19:24.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.377+0000 7f96e7665640 1 -- start start 2024-09-15T23:19:24.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.377+0000 7f96e7665640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96e006bc10 0x7f96e0150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:24.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.377+0000 7f96e7665640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96e00b3790 0x7f96e00b5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:24.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.377+0000 7f96e7665640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f96e00cef60 0x7f96e006e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:24.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.377+0000 7f96e7665640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f96e00d0f10 con 0x7f96e006bc10 2024-09-15T23:19:24.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.377+0000 7f96e7665640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f96e00d0c30 con 0x7f96e00cef60 2024-09-15T23:19:24.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.377+0000 7f96e7665640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f96e00b3c20 con 0x7f96e00b3790 2024-09-15T23:19:24.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.377+0000 7f96e5401640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96e006bc10 0x7f96e0150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:24.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.377+0000 7f96e5401640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96e006bc10 0x7f96e0150240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32916/0 (socket says 172.21.15.123:32916) 2024-09-15T23:19:24.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.377+0000 7f96e5401640 1 -- 172.21.15.123:0/445346501 learned_addr learned my addr 172.21.15.123:0/445346501 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:24.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.377+0000 7f96e5c02640 1 --2- 172.21.15.123:0/445346501 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f96e00cef60 0x7f96e006e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:24.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.377+0000 7f96e4c00640 1 --2- 172.21.15.123:0/445346501 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96e00b3790 0x7f96e00b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:24.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.378+0000 7f96e5401640 1 -- 172.21.15.123:0/445346501 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96e00b3790 msgr2=0x7f96e00b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:24.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.378+0000 7f96e5401640 1 --2- 172.21.15.123:0/445346501 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96e00b3790 0x7f96e00b5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:24.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.378+0000 7f96e5401640 1 -- 172.21.15.123:0/445346501 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f96e00cef60 msgr2=0x7f96e006e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:24.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.378+0000 7f96e5401640 1 --2- 172.21.15.123:0/445346501 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f96e00cef60 0x7f96e006e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:24.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.378+0000 7f96e5401640 1 -- 172.21.15.123:0/445346501 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e00b6070 con 0x7f96e006bc10 2024-09-15T23:19:24.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.378+0000 7f96e5401640 1 --2- 172.21.15.123:0/445346501 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96e006bc10 0x7f96e0150240 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f96dc00c400 tx=0x7f96dc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:24.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.378+0000 7f96d5ffb640 1 -- 172.21.15.123:0/445346501 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96dc017070 con 0x7f96e006bc10 2024-09-15T23:19:24.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.378+0000 7f96d5ffb640 1 -- 172.21.15.123:0/445346501 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96dc005ce0 con 0x7f96e006bc10 2024-09-15T23:19:24.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.378+0000 7f96e7665640 1 -- 172.21.15.123:0/445346501 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96e00b6350 con 0x7f96e006bc10 2024-09-15T23:19:24.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.378+0000 7f96d5ffb640 1 -- 172.21.15.123:0/445346501 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96dc0072f0 con 0x7f96e006bc10 2024-09-15T23:19:24.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.378+0000 7f96e7665640 1 -- 172.21.15.123:0/445346501 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96e00b6910 con 0x7f96e006bc10 2024-09-15T23:19:24.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.379+0000 7f96e7665640 1 -- 172.21.15.123:0/445346501 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96e015eb20 con 0x7f96e006bc10 2024-09-15T23:19:24.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.380+0000 7f96d5ffb640 1 -- 172.21.15.123:0/445346501 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f96dc01a070 con 0x7f96e006bc10 2024-09-15T23:19:24.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.380+0000 7f96d5ffb640 1 --2- 172.21.15.123:0/445346501 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f96c406c2b0 0x7f96c406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:24.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.380+0000 7f96d5ffb640 1 -- 172.21.15.123:0/445346501 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f96dc08a720 con 0x7f96e006bc10 2024-09-15T23:19:24.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.380+0000 7f96e4c00640 1 --2- 172.21.15.123:0/445346501 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f96c406c2b0 0x7f96c406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:24.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.381+0000 7f96e4c00640 1 --2- 172.21.15.123:0/445346501 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f96c406c2b0 0x7f96c406e770 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f96d00097a0 tx=0x7f96d002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:24.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.384+0000 7f96d5ffb640 1 -- 172.21.15.123:0/445346501 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f96dc0588d0 con 0x7f96e006bc10 2024-09-15T23:19:24.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.585+0000 7f96e7665640 1 -- 172.21.15.123:0/445346501 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96e0160f30 con 0x7f96e006bc10 2024-09-15T23:19:24.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.586+0000 7f96d5ffb640 1 -- 172.21.15.123:0/445346501 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) ==== 94+0+5237 (secure 0 0 0) 0x7f96dc05cbd0 con 0x7f96e006bc10 2024-09-15T23:19:24.587 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:19:24.587 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":80,"btime":"2024-09-15T23:18:57:403025+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6386,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/1352396114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":1352396114},{"type":"v1","addr":"172.21.15.188:6836","nonce":1352396114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":8022,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2727961795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2727961795},{"type":"v1","addr":"172.21.15.123:6834","nonce":2727961795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":8025,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3879785466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":3879785466},{"type":"v1","addr":"172.21.15.123:6835","nonce":3879785466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:18:54.727897+0000","modified":"2024-09-15T23:18:56.730668+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8034},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8034":{"gid":8034,"name":"d","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6837/3551744094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":3551744094},{"type":"v1","addr":"172.21.15.188:6837","nonce":3551744094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8034,"qdb_cluster":[8034]},"id":8}]} 2024-09-15T23:19:24.587 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 80 2024-09-15T23:19:24.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.588+0000 7f96e7665640 1 -- 172.21.15.123:0/445346501 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f96c406c2b0 msgr2=0x7f96c406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:24.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.588+0000 7f96e7665640 1 --2- 172.21.15.123:0/445346501 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f96c406c2b0 0x7f96c406e770 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f96d00097a0 tx=0x7f96d002e000 comp rx=0 tx=0).stop 2024-09-15T23:19:24.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.588+0000 7f96e7665640 1 -- 172.21.15.123:0/445346501 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96e006bc10 msgr2=0x7f96e0150240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:24.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.588+0000 7f96e7665640 1 --2- 172.21.15.123:0/445346501 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96e006bc10 0x7f96e0150240 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f96dc00c400 tx=0x7f96dc00c8c0 comp rx=0 tx=0).stop 2024-09-15T23:19:24.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.588+0000 7f96e7665640 1 -- 172.21.15.123:0/445346501 shutdown_connections 2024-09-15T23:19:24.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.588+0000 7f96e7665640 1 --2- 172.21.15.123:0/445346501 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f96e00cef60 0x7f96e006e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:24.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.588+0000 7f96e7665640 1 --2- 172.21.15.123:0/445346501 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f96e00b3790 0x7f96e00b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:24.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.588+0000 7f96e7665640 1 --2- 172.21.15.123:0/445346501 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f96c406c2b0 0x7f96c406e770 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:24.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.588+0000 7f96e7665640 1 --2- 172.21.15.123:0/445346501 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96e006bc10 0x7f96e0150240 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:24.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.588+0000 7f96e7665640 1 -- 172.21.15.123:0/445346501 >> 172.21.15.123:0/445346501 conn(0x7f96e006cd20 msgr2=0x7f96e01611e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:24.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.588+0000 7f96e7665640 1 -- 172.21.15.123:0/445346501 shutdown_connections 2024-09-15T23:19:24.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.588+0000 7f96e7665640 1 -- 172.21.15.123:0/445346501 wait complete. 2024-09-15T23:19:24.600 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:19:24.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.698+0000 7f43a86d0640 1 Processor -- start 2024-09-15T23:19:24.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.698+0000 7f43a86d0640 1 -- start start 2024-09-15T23:19:24.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.699+0000 7f43a86d0640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f43a015ab40 0x7f43a006c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:24.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.699+0000 7f43a86d0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43a00720b0 0x7f43a0073990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:24.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.699+0000 7f43a86d0640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f43a015af20 0x7f43a015b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:24.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.699+0000 7f43a86d0640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f43a0072520 con 0x7f43a015ab40 2024-09-15T23:19:24.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.699+0000 7f43a86d0640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f43a0071010 con 0x7f43a015af20 2024-09-15T23:19:24.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.699+0000 7f43a86d0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f43a00712f0 con 0x7f43a00720b0 2024-09-15T23:19:24.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.699+0000 7f43a646c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f43a015ab40 0x7f43a006c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:24.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.699+0000 7f43a646c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f43a015ab40 0x7f43a006c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32932/0 (socket says 172.21.15.123:32932) 2024-09-15T23:19:24.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.699+0000 7f43a646c640 1 -- 172.21.15.123:0/1865295503 learned_addr learned my addr 172.21.15.123:0/1865295503 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:24.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.699+0000 7f43a646c640 1 -- 172.21.15.123:0/1865295503 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43a00720b0 msgr2=0x7f43a0073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:24.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.699+0000 7f43a5c6b640 1 --2- 172.21.15.123:0/1865295503 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43a00720b0 0x7f43a0073990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:24.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.699+0000 7f43a6c6d640 1 --2- 172.21.15.123:0/1865295503 >> v2:172.21.15.188:3300/0 conn(0x7f43a015af20 0x7f43a015b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:24.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.699+0000 7f43a646c640 1 --2- 172.21.15.123:0/1865295503 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43a00720b0 0x7f43a0073990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:24.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.699+0000 7f43a646c640 1 -- 172.21.15.123:0/1865295503 >> v2:172.21.15.188:3300/0 conn(0x7f43a015af20 msgr2=0x7f43a015b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:24.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.699+0000 7f43a646c640 1 --2- 172.21.15.123:0/1865295503 >> v2:172.21.15.188:3300/0 conn(0x7f43a015af20 0x7f43a015b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:24.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.699+0000 7f43a646c640 1 -- 172.21.15.123:0/1865295503 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43a00715d0 con 0x7f43a015ab40 2024-09-15T23:19:24.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.700+0000 7f43a646c640 1 --2- 172.21.15.123:0/1865295503 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43a015ab40 0x7f43a006c6a0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f43a00b6090 tx=0x7f439c02a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ae773d09746241 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:24.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.700+0000 7f43a546a640 1 -- 172.21.15.123:0/1865295503 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439c037070 con 0x7f43a015ab40 2024-09-15T23:19:24.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.700+0000 7f43a546a640 1 -- 172.21.15.123:0/1865295503 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f439c032440 con 0x7f43a015ab40 2024-09-15T23:19:24.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.700+0000 7f43a546a640 1 -- 172.21.15.123:0/1865295503 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439c032810 con 0x7f43a015ab40 2024-09-15T23:19:24.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.701+0000 7f43a86d0640 1 -- 172.21.15.123:0/1865295503 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43a015ab40 msgr2=0x7f43a006c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:24.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.701+0000 7f43a86d0640 1 --2- 172.21.15.123:0/1865295503 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43a015ab40 0x7f43a006c6a0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f43a00b6090 tx=0x7f439c02a130 comp rx=0 tx=0).stop 2024-09-15T23:19:24.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.701+0000 7f43a86d0640 1 -- 172.21.15.123:0/1865295503 shutdown_connections 2024-09-15T23:19:24.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.701+0000 7f43a86d0640 1 --2- 172.21.15.123:0/1865295503 >> v2:172.21.15.188:3300/0 conn(0x7f43a015af20 0x7f43a015b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:24.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.701+0000 7f43a86d0640 1 --2- 172.21.15.123:0/1865295503 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43a00720b0 0x7f43a0073990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:24.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.701+0000 7f43a86d0640 1 --2- 172.21.15.123:0/1865295503 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43a015ab40 0x7f43a006c6a0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:24.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.701+0000 7f43a86d0640 1 -- 172.21.15.123:0/1865295503 >> 172.21.15.123:0/1865295503 conn(0x7f43a00ccec0 msgr2=0x7f43a00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:24.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.701+0000 7f43a86d0640 1 -- 172.21.15.123:0/1865295503 shutdown_connections 2024-09-15T23:19:24.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.701+0000 7f43a86d0640 1 -- 172.21.15.123:0/1865295503 wait complete. 2024-09-15T23:19:24.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.702+0000 7f43a86d0640 1 Processor -- start 2024-09-15T23:19:24.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.702+0000 7f43a86d0640 1 -- start start 2024-09-15T23:19:24.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.703+0000 7f43a86d0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43a00720b0 0x7f43a014aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:24.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.703+0000 7f43a86d0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43a015ab40 0x7f43a014b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:24.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.703+0000 7f43a86d0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43a015af20 0x7f43a014b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:24.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.703+0000 7f43a86d0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f43a015b8d0 con 0x7f43a00720b0 2024-09-15T23:19:24.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.703+0000 7f43a86d0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f43a0073ed0 con 0x7f43a015af20 2024-09-15T23:19:24.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.703+0000 7f43a86d0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f43a015ba50 con 0x7f43a015ab40 2024-09-15T23:19:24.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.703+0000 7f43a646c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43a00720b0 0x7f43a014aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:24.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.703+0000 7f43a646c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43a00720b0 0x7f43a014aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32942/0 (socket says 172.21.15.123:32942) 2024-09-15T23:19:24.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.703+0000 7f43a646c640 1 -- 172.21.15.123:0/2360393862 learned_addr learned my addr 172.21.15.123:0/2360393862 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:24.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.703+0000 7f43a5c6b640 1 --2- 172.21.15.123:0/2360393862 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43a015ab40 0x7f43a014b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:24.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.703+0000 7f43a6c6d640 1 --2- 172.21.15.123:0/2360393862 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43a015af20 0x7f43a014b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:24.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.703+0000 7f43a646c640 1 -- 172.21.15.123:0/2360393862 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43a015ab40 msgr2=0x7f43a014b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:24.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.703+0000 7f43a646c640 1 --2- 172.21.15.123:0/2360393862 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43a015ab40 0x7f43a014b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:24.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.703+0000 7f43a646c640 1 -- 172.21.15.123:0/2360393862 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43a015af20 msgr2=0x7f43a014b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:24.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.703+0000 7f43a646c640 1 --2- 172.21.15.123:0/2360393862 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43a015af20 0x7f43a014b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:24.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.703+0000 7f43a646c640 1 -- 172.21.15.123:0/2360393862 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43a014c200 con 0x7f43a00720b0 2024-09-15T23:19:24.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.703+0000 7f43a6c6d640 1 --2- 172.21.15.123:0/2360393862 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43a015af20 0x7f43a014b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:19:24.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.703+0000 7f43a5c6b640 1 --2- 172.21.15.123:0/2360393862 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43a015ab40 0x7f43a014b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:19:24.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.703+0000 7f43a646c640 1 --2- 172.21.15.123:0/2360393862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43a00720b0 0x7f43a014aeb0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f439c02a170 tx=0x7f439c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:24.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.703+0000 7f4396ffd640 1 -- 172.21.15.123:0/2360393862 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439c037040 con 0x7f43a00720b0 2024-09-15T23:19:24.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.703+0000 7f4396ffd640 1 -- 172.21.15.123:0/2360393862 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f439c042070 con 0x7f43a00720b0 2024-09-15T23:19:24.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.703+0000 7f43a86d0640 1 -- 172.21.15.123:0/2360393862 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43a014c4e0 con 0x7f43a00720b0 2024-09-15T23:19:24.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.703+0000 7f4396ffd640 1 -- 172.21.15.123:0/2360393862 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439c030bb0 con 0x7f43a00720b0 2024-09-15T23:19:24.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.703+0000 7f43a86d0640 1 -- 172.21.15.123:0/2360393862 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43a0139cf0 con 0x7f43a00720b0 2024-09-15T23:19:24.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.704+0000 7f43a86d0640 1 -- 172.21.15.123:0/2360393862 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43a00cc540 con 0x7f43a00720b0 2024-09-15T23:19:24.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.705+0000 7f4396ffd640 1 -- 172.21.15.123:0/2360393862 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f439c047460 con 0x7f43a00720b0 2024-09-15T23:19:24.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.705+0000 7f4396ffd640 1 --2- 172.21.15.123:0/2360393862 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f438406c2b0 0x7f438406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:24.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.705+0000 7f4396ffd640 1 -- 172.21.15.123:0/2360393862 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f439c0ac110 con 0x7f43a00720b0 2024-09-15T23:19:24.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.706+0000 7f43a5c6b640 1 --2- 172.21.15.123:0/2360393862 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f438406c2b0 0x7f438406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:24.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.706+0000 7f43a5c6b640 1 --2- 172.21.15.123:0/2360393862 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f438406c2b0 0x7f438406e770 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f43a00cffc0 tx=0x7f4390008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:24.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.710+0000 7f4396ffd640 1 -- 172.21.15.123:0/2360393862 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f439c07a880 con 0x7f43a00720b0 2024-09-15T23:19:24.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.908+0000 7f43a86d0640 1 -- 172.21.15.123:0/2360393862 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43a0139aa0 con 0x7f43a00720b0 2024-09-15T23:19:24.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.908+0000 7f4396ffd640 1 -- 172.21.15.123:0/2360393862 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) ==== 94+0+5237 (secure 0 0 0) 0x7f439c07a180 con 0x7f43a00720b0 2024-09-15T23:19:24.909 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:19:24.910 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":80,"btime":"2024-09-15T23:18:57:403025+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6386,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/1352396114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":1352396114},{"type":"v1","addr":"172.21.15.188:6836","nonce":1352396114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":8022,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2727961795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2727961795},{"type":"v1","addr":"172.21.15.123:6834","nonce":2727961795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":8025,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3879785466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":3879785466},{"type":"v1","addr":"172.21.15.123:6835","nonce":3879785466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":80,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:18:54.727897+0000","modified":"2024-09-15T23:18:56.730668+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8034},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8034":{"gid":8034,"name":"d","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6837/3551744094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":3551744094},{"type":"v1","addr":"172.21.15.188:6837","nonce":3551744094}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8034,"qdb_cluster":[8034]},"id":8}]} 2024-09-15T23:19:24.910 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 80 2024-09-15T23:19:24.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.910+0000 7f43a86d0640 1 -- 172.21.15.123:0/2360393862 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f438406c2b0 msgr2=0x7f438406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:24.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.910+0000 7f43a86d0640 1 --2- 172.21.15.123:0/2360393862 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f438406c2b0 0x7f438406e770 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f43a00cffc0 tx=0x7f4390008040 comp rx=0 tx=0).stop 2024-09-15T23:19:24.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.910+0000 7f43a86d0640 1 -- 172.21.15.123:0/2360393862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43a00720b0 msgr2=0x7f43a014aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:24.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.910+0000 7f43a86d0640 1 --2- 172.21.15.123:0/2360393862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43a00720b0 0x7f43a014aeb0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f439c02a170 tx=0x7f439c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:19:24.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.910+0000 7f43a86d0640 1 -- 172.21.15.123:0/2360393862 shutdown_connections 2024-09-15T23:19:24.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.910+0000 7f43a86d0640 1 --2- 172.21.15.123:0/2360393862 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f43a015af20 0x7f43a014b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:24.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.910+0000 7f43a86d0640 1 --2- 172.21.15.123:0/2360393862 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f43a015ab40 0x7f43a014b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:24.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.910+0000 7f43a86d0640 1 --2- 172.21.15.123:0/2360393862 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f438406c2b0 0x7f438406e770 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:24.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.910+0000 7f43a86d0640 1 --2- 172.21.15.123:0/2360393862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43a00720b0 0x7f43a014aeb0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:24.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.910+0000 7f43a86d0640 1 -- 172.21.15.123:0/2360393862 >> 172.21.15.123:0/2360393862 conn(0x7f43a00ccec0 msgr2=0x7f43a00b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:24.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.910+0000 7f43a86d0640 1 -- 172.21.15.123:0/2360393862 shutdown_connections 2024-09-15T23:19:24.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:24.911+0000 7f43a86d0640 1 -- 172.21.15.123:0/2360393862 wait complete. 2024-09-15T23:19:24.922 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:19:25.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.019+0000 7f22d3118640 1 Processor -- start 2024-09-15T23:19:25.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.020+0000 7f22d3118640 1 -- start start 2024-09-15T23:19:25.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.020+0000 7f22d3118640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f22cc0b49d0 0x7f22cc1693e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:25.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.020+0000 7f22d3118640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22cc0d22a0 con 0x7f22cc15e910 2024-09-15T23:19:25.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.020+0000 7f22d3118640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22cc0d2540 con 0x7f22cc0cfd00 2024-09-15T23:19:25.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.020+0000 7f22d3118640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f22cc15ecf0 con 0x7f22cc0b49d0 2024-09-15T23:19:25.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.021+0000 7f22d16b5640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f22cc0b49d0 0x7f22cc1693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:25.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.021+0000 7f22d0eb4640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f22cc15e910 0x7f22cc0731a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51864/0 (socket says 172.21.15.123:51864) 2024-09-15T23:19:25.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.021+0000 7f22d0eb4640 1 -- 172.21.15.123:0/1899328831 learned_addr learned my addr 172.21.15.123:0/1899328831 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:19:25.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.021+0000 7f22d16b5640 1 -- 172.21.15.123:0/1899328831 >> v1:172.21.15.188:6789/0 conn(0x7f22cc0cfd00 legacy=0x7f22cc0b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:25.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.021+0000 7f22d16b5640 1 -- 172.21.15.123:0/1899328831 >> v1:172.21.15.123:6789/0 conn(0x7f22cc15e910 legacy=0x7f22cc0731a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:25.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.021+0000 7f22d16b5640 1 -- 172.21.15.123:0/1899328831 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22cc0d2820 con 0x7f22cc0b49d0 2024-09-15T23:19:25.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.021+0000 7f22cb7fe640 1 -- 172.21.15.123:0/1899328831 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1104630776 0 0) 0x7f22cc0d22a0 con 0x7f22cc15e910 2024-09-15T23:19:25.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.022+0000 7f22d16b5640 1 --2- 172.21.15.123:0/1899328831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22cc0b49d0 0x7f22cc1693e0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f22c40097a0 tx=0x7f22c402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8489d3cdd73bb565 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:25.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.022+0000 7f22cb7fe640 1 -- 172.21.15.123:0/1899328831 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c4037070 con 0x7f22cc0b49d0 2024-09-15T23:19:25.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.022+0000 7f22cb7fe640 1 -- 172.21.15.123:0/1899328831 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22c4032440 con 0x7f22cc0b49d0 2024-09-15T23:19:25.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.022+0000 7f22cb7fe640 1 -- 172.21.15.123:0/1899328831 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c402ae60 con 0x7f22cc0b49d0 2024-09-15T23:19:25.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.022+0000 7f22d3118640 1 -- 172.21.15.123:0/1899328831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22cc0b49d0 msgr2=0x7f22cc1693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:25.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.022+0000 7f22d3118640 1 --2- 172.21.15.123:0/1899328831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22cc0b49d0 0x7f22cc1693e0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f22c40097a0 tx=0x7f22c402a110 comp rx=0 tx=0).stop 2024-09-15T23:19:25.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.022+0000 7f22d3118640 1 -- 172.21.15.123:0/1899328831 shutdown_connections 2024-09-15T23:19:25.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.022+0000 7f22d3118640 1 --2- 172.21.15.123:0/1899328831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22cc0b49d0 0x7f22cc1693e0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:25.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.022+0000 7f22d3118640 1 -- 172.21.15.123:0/1899328831 >> 172.21.15.123:0/1899328831 conn(0x7f22cc067950 msgr2=0x7f22cc067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:25.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.022+0000 7f22d3118640 1 -- 172.21.15.123:0/1899328831 shutdown_connections 2024-09-15T23:19:25.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.022+0000 7f22d3118640 1 -- 172.21.15.123:0/1899328831 wait complete. 2024-09-15T23:19:25.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.023+0000 7f22d3118640 1 Processor -- start 2024-09-15T23:19:25.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.023+0000 7f22d3118640 1 -- start start 2024-09-15T23:19:25.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.024+0000 7f22d3118640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22cc0b49d0 0x7f22cc158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:25.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.024+0000 7f22d3118640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f22cc0cfd00 0x7f22cc0b0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:25.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.024+0000 7f22d3118640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22cc15e910 0x7f22cc1611b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:25.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.024+0000 7f22d3118640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc0d1240 con 0x7f22cc15e910 2024-09-15T23:19:25.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.024+0000 7f22d3118640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f22cc0d2e70 con 0x7f22cc0b49d0 2024-09-15T23:19:25.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.024+0000 7f22d3118640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f22cc0d3300 con 0x7f22cc0cfd00 2024-09-15T23:19:25.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.024+0000 7f22d16b5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22cc15e910 0x7f22cc1611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:25.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.024+0000 7f22d16b5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22cc15e910 0x7f22cc1611b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32968/0 (socket says 172.21.15.123:32968) 2024-09-15T23:19:25.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.024+0000 7f22d16b5640 1 -- 172.21.15.123:0/4274377807 learned_addr learned my addr 172.21.15.123:0/4274377807 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:25.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.024+0000 7f22d0eb4640 1 --2- 172.21.15.123:0/4274377807 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22cc0b49d0 0x7f22cc158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:25.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.024+0000 7f22cbfff640 1 --2- 172.21.15.123:0/4274377807 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f22cc0cfd00 0x7f22cc0b0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:25.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.025+0000 7f22d16b5640 1 -- 172.21.15.123:0/4274377807 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f22cc0cfd00 msgr2=0x7f22cc0b0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:25.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.025+0000 7f22d16b5640 1 --2- 172.21.15.123:0/4274377807 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f22cc0cfd00 0x7f22cc0b0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:25.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.025+0000 7f22d16b5640 1 -- 172.21.15.123:0/4274377807 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22cc0b49d0 msgr2=0x7f22cc158610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:25.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.025+0000 7f22d16b5640 1 --2- 172.21.15.123:0/4274377807 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22cc0b49d0 0x7f22cc158610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:25.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.025+0000 7f22d16b5640 1 -- 172.21.15.123:0/4274377807 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22cc1605a0 con 0x7f22cc15e910 2024-09-15T23:19:25.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.025+0000 7f22cbfff640 1 --2- 172.21.15.123:0/4274377807 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f22cc0cfd00 0x7f22cc0b0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:19:25.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.025+0000 7f22d16b5640 1 --2- 172.21.15.123:0/4274377807 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22cc15e910 0x7f22cc1611b0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f22c4035040 tx=0x7f22c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:25.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.025+0000 7f22c97fa640 1 -- 172.21.15.123:0/4274377807 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c4037050 con 0x7f22cc15e910 2024-09-15T23:19:25.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.025+0000 7f22c97fa640 1 -- 172.21.15.123:0/4274377807 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22c4038040 con 0x7f22cc15e910 2024-09-15T23:19:25.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.025+0000 7f22d3118640 1 -- 172.21.15.123:0/4274377807 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22cc0b56d0 con 0x7f22cc15e910 2024-09-15T23:19:25.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.025+0000 7f22c97fa640 1 -- 172.21.15.123:0/4274377807 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c4004490 con 0x7f22cc15e910 2024-09-15T23:19:25.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.025+0000 7f22d3118640 1 -- 172.21.15.123:0/4274377807 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22cc0b5c90 con 0x7f22cc15e910 2024-09-15T23:19:25.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.026+0000 7f22d3118640 1 -- 172.21.15.123:0/4274377807 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22cc06ff40 con 0x7f22cc15e910 2024-09-15T23:19:25.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.027+0000 7f22c97fa640 1 -- 172.21.15.123:0/4274377807 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f22c4030980 con 0x7f22cc15e910 2024-09-15T23:19:25.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.027+0000 7f22c97fa640 1 --2- 172.21.15.123:0/4274377807 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f22b806c2b0 0x7f22b806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:25.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.027+0000 7f22c97fa640 1 -- 172.21.15.123:0/4274377807 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f22c40abe70 con 0x7f22cc15e910 2024-09-15T23:19:25.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.027+0000 7f22d0eb4640 1 --2- 172.21.15.123:0/4274377807 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f22b806c2b0 0x7f22b806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:25.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.028+0000 7f22d0eb4640 1 --2- 172.21.15.123:0/4274377807 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f22b806c2b0 0x7f22b806e770 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f22bc001560 tx=0x7f22bc0014b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:25.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.031+0000 7f22c97fa640 1 -- 172.21.15.123:0/4274377807 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f22c4032e20 con 0x7f22cc15e910 2024-09-15T23:19:25.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.199+0000 7f22d3118640 1 -- 172.21.15.123:0/4274377807 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f22cc15bb10 con 0x7f22cc15e910 2024-09-15T23:19:25.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.200+0000 7f22c97fa640 1 -- 172.21.15.123:0/4274377807 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) ==== 74+0+16767 (secure 0 0 0) 0x7f22c407a790 con 0x7f22cc15e910 2024-09-15T23:19:25.201 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:19:25.201 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":130,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:18:56.396511+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:18:53.342598+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-15T23:18:53.702094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"130","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:19:25.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.202+0000 7f22d3118640 1 -- 172.21.15.123:0/4274377807 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f22b806c2b0 msgr2=0x7f22b806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:25.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.202+0000 7f22d3118640 1 --2- 172.21.15.123:0/4274377807 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f22b806c2b0 0x7f22b806e770 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f22bc001560 tx=0x7f22bc0014b0 comp rx=0 tx=0).stop 2024-09-15T23:19:25.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.203+0000 7f22d3118640 1 -- 172.21.15.123:0/4274377807 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22cc15e910 msgr2=0x7f22cc1611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:25.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.203+0000 7f22d3118640 1 --2- 172.21.15.123:0/4274377807 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22cc15e910 0x7f22cc1611b0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f22c4035040 tx=0x7f22c40046c0 comp rx=0 tx=0).stop 2024-09-15T23:19:25.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.203+0000 7f22d3118640 1 -- 172.21.15.123:0/4274377807 shutdown_connections 2024-09-15T23:19:25.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.203+0000 7f22d3118640 1 --2- 172.21.15.123:0/4274377807 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f22b806c2b0 0x7f22b806e770 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:25.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.203+0000 7f22d3118640 1 --2- 172.21.15.123:0/4274377807 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22cc15e910 0x7f22cc1611b0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:25.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.203+0000 7f22d3118640 1 --2- 172.21.15.123:0/4274377807 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f22cc0cfd00 0x7f22cc0b0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:25.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.203+0000 7f22d3118640 1 --2- 172.21.15.123:0/4274377807 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22cc0b49d0 0x7f22cc158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:25.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.203+0000 7f22d3118640 1 -- 172.21.15.123:0/4274377807 >> 172.21.15.123:0/4274377807 conn(0x7f22cc067950 msgr2=0x7f22cc15bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:25.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.203+0000 7f22d3118640 1 -- 172.21.15.123:0/4274377807 shutdown_connections 2024-09-15T23:19:25.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.203+0000 7f22d3118640 1 -- 172.21.15.123:0/4274377807 wait complete. 2024-09-15T23:19:25.215 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T23:19:25.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.313+0000 7f698a79f640 1 Processor -- start 2024-09-15T23:19:25.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.313+0000 7f698a79f640 1 -- start start 2024-09-15T23:19:25.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.313+0000 7f698a79f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69840b2d40 0x7f698406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:25.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.313+0000 7f698a79f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f698413eb20 0x7f698406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:25.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.313+0000 7f698a79f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f698415bcf0 0x7f698415c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:25.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.313+0000 7f698a79f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f6984071ab0 con 0x7f698415bcf0 2024-09-15T23:19:25.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.313+0000 7f698a79f640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f6984071180 con 0x7f698413eb20 2024-09-15T23:19:25.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.313+0000 7f698a79f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6984071460 con 0x7f69840b2d40 2024-09-15T23:19:25.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.314+0000 7f6988d3c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f698415bcf0 0x7f698415c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:25.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.314+0000 7f6988d3c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f698415bcf0 0x7f698415c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32974/0 (socket says 172.21.15.123:32974) 2024-09-15T23:19:25.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.314+0000 7f6988d3c640 1 -- 172.21.15.123:0/3832947522 learned_addr learned my addr 172.21.15.123:0/3832947522 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:25.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.314+0000 7f6988d3c640 1 -- 172.21.15.123:0/3832947522 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69840b2d40 msgr2=0x7f698406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:25.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.314+0000 7f6983fff640 1 --2- 172.21.15.123:0/3832947522 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69840b2d40 0x7f698406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:25.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.314+0000 7f69837fe640 1 --2- 172.21.15.123:0/3832947522 >> v2:172.21.15.188:3300/0 conn(0x7f698413eb20 0x7f698406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:25.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.314+0000 7f6988d3c640 1 --2- 172.21.15.123:0/3832947522 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69840b2d40 0x7f698406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:25.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.314+0000 7f6988d3c640 1 -- 172.21.15.123:0/3832947522 >> v2:172.21.15.188:3300/0 conn(0x7f698413eb20 msgr2=0x7f698406c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:25.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.314+0000 7f6988d3c640 1 --2- 172.21.15.123:0/3832947522 >> v2:172.21.15.188:3300/0 conn(0x7f698413eb20 0x7f698406c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:25.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.314+0000 7f6988d3c640 1 -- 172.21.15.123:0/3832947522 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6984071740 con 0x7f698415bcf0 2024-09-15T23:19:25.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.315+0000 7f6988d3c640 1 --2- 172.21.15.123:0/3832947522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f698415bcf0 0x7f698415c1a0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f6984073460 tx=0x7f697c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f9c1d53e624d522 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:25.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.315+0000 7f6982ffd640 1 -- 172.21.15.123:0/3832947522 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f697c036070 con 0x7f698415bcf0 2024-09-15T23:19:25.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.315+0000 7f6982ffd640 1 -- 172.21.15.123:0/3832947522 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f697c031600 con 0x7f698415bcf0 2024-09-15T23:19:25.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.315+0000 7f6982ffd640 1 -- 172.21.15.123:0/3832947522 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f697c0319d0 con 0x7f698415bcf0 2024-09-15T23:19:25.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.315+0000 7f698a79f640 1 -- 172.21.15.123:0/3832947522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f698415bcf0 msgr2=0x7f698415c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:25.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.315+0000 7f698a79f640 1 --2- 172.21.15.123:0/3832947522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f698415bcf0 0x7f698415c1a0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f6984073460 tx=0x7f697c02a6a0 comp rx=0 tx=0).stop 2024-09-15T23:19:25.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.315+0000 7f698a79f640 1 -- 172.21.15.123:0/3832947522 shutdown_connections 2024-09-15T23:19:25.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.315+0000 7f698a79f640 1 --2- 172.21.15.123:0/3832947522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f698415bcf0 0x7f698415c1a0 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:25.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.315+0000 7f698a79f640 1 --2- 172.21.15.123:0/3832947522 >> v2:172.21.15.188:3300/0 conn(0x7f698413eb20 0x7f698406c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:25.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.315+0000 7f698a79f640 1 --2- 172.21.15.123:0/3832947522 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69840b2d40 0x7f698406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:25.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.315+0000 7f698a79f640 1 -- 172.21.15.123:0/3832947522 >> 172.21.15.123:0/3832947522 conn(0x7f69840ccec0 msgr2=0x7f69840cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:25.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.315+0000 7f698a79f640 1 -- 172.21.15.123:0/3832947522 shutdown_connections 2024-09-15T23:19:25.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.315+0000 7f698a79f640 1 -- 172.21.15.123:0/3832947522 wait complete. 2024-09-15T23:19:25.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.316+0000 7f698a79f640 1 Processor -- start 2024-09-15T23:19:25.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.317+0000 7f698a79f640 1 -- start start 2024-09-15T23:19:25.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.317+0000 7f698a79f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69840b2d40 0x7f6984155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:25.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.317+0000 7f698a79f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f698413eb20 0x7f698413e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:25.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.317+0000 7f698a79f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f698415bcf0 0x7f698415e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:25.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.317+0000 7f698a79f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f698415f140 con 0x7f69840b2d40 2024-09-15T23:19:25.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.317+0000 7f698a79f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f698415efc0 con 0x7f698415bcf0 2024-09-15T23:19:25.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.317+0000 7f698a79f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f698415f2c0 con 0x7f698413eb20 2024-09-15T23:19:25.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.317+0000 7f6983fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69840b2d40 0x7f6984155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:25.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.317+0000 7f6983fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69840b2d40 0x7f6984155d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32982/0 (socket says 172.21.15.123:32982) 2024-09-15T23:19:25.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.317+0000 7f6983fff640 1 -- 172.21.15.123:0/2208100582 learned_addr learned my addr 172.21.15.123:0/2208100582 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:25.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.318+0000 7f6988d3c640 1 --2- 172.21.15.123:0/2208100582 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f698415bcf0 0x7f698415e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:25.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.318+0000 7f69837fe640 1 --2- 172.21.15.123:0/2208100582 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f698413eb20 0x7f698413e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:25.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.318+0000 7f6983fff640 1 -- 172.21.15.123:0/2208100582 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f698413eb20 msgr2=0x7f698413e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:25.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.318+0000 7f6983fff640 1 --2- 172.21.15.123:0/2208100582 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f698413eb20 0x7f698413e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:25.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.318+0000 7f6983fff640 1 -- 172.21.15.123:0/2208100582 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f698415bcf0 msgr2=0x7f698415e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:25.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.318+0000 7f6983fff640 1 --2- 172.21.15.123:0/2208100582 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f698415bcf0 0x7f698415e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:25.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.318+0000 7f6983fff640 1 -- 172.21.15.123:0/2208100582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f698415ed60 con 0x7f69840b2d40 2024-09-15T23:19:25.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.318+0000 7f69837fe640 1 --2- 172.21.15.123:0/2208100582 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f698413eb20 0x7f698413e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:19:25.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.318+0000 7f6983fff640 1 --2- 172.21.15.123:0/2208100582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69840b2d40 0x7f6984155d50 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f697400c7f0 tx=0x7f697400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:25.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.318+0000 7f6980ff9640 1 -- 172.21.15.123:0/2208100582 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6974015070 con 0x7f69840b2d40 2024-09-15T23:19:25.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.318+0000 7f6980ff9640 1 -- 172.21.15.123:0/2208100582 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6974004220 con 0x7f69840b2d40 2024-09-15T23:19:25.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.318+0000 7f698a79f640 1 -- 172.21.15.123:0/2208100582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69841f1ca0 con 0x7f69840b2d40 2024-09-15T23:19:25.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.318+0000 7f6980ff9640 1 -- 172.21.15.123:0/2208100582 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6974007620 con 0x7f69840b2d40 2024-09-15T23:19:25.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.318+0000 7f698a79f640 1 -- 172.21.15.123:0/2208100582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69841f2260 con 0x7f69840b2d40 2024-09-15T23:19:25.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.319+0000 7f698a79f640 1 -- 172.21.15.123:0/2208100582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f698415c1a0 con 0x7f69840b2d40 2024-09-15T23:19:25.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.320+0000 7f6980ff9640 1 -- 172.21.15.123:0/2208100582 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f69740079d0 con 0x7f69840b2d40 2024-09-15T23:19:25.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.320+0000 7f6980ff9640 1 --2- 172.21.15.123:0/2208100582 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f697006c2b0 0x7f697006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:25.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.320+0000 7f6980ff9640 1 -- 172.21.15.123:0/2208100582 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5709+0+0 (secure 0 0 0) 0x7f697408b390 con 0x7f69840b2d40 2024-09-15T23:19:25.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.320+0000 7f69837fe640 1 --2- 172.21.15.123:0/2208100582 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f697006c2b0 0x7f697006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:25.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.321+0000 7f69837fe640 1 --2- 172.21.15.123:0/2208100582 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f697006c2b0 0x7f697006e770 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f6978006fd0 tx=0x7f6978008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:25.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.324+0000 7f6980ff9640 1 -- 172.21.15.123:0/2208100582 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6974059420 con 0x7f69840b2d40 2024-09-15T23:19:25.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.523+0000 7f698a79f640 1 -- 172.21.15.123:0/2208100582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6984140ca0 con 0x7f69840b2d40 2024-09-15T23:19:25.524 INFO:tasks.ceph.mon.a.smithi123.stderr:2024-09-15T23:19:25.524+0000 7f8a6ccf0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:19:25.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.525+0000 7f6980ff9640 1 -- 172.21.15.123:0/2208100582 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v81) ==== 161+0+0 (secure 0 0 0) 0x7f697405d720 con 0x7f69840b2d40 2024-09-15T23:19:25.526 INFO:teuthology.orchestra.run.smithi123.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T23:19:25.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.527+0000 7f698a79f640 1 -- 172.21.15.123:0/2208100582 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f697006c2b0 msgr2=0x7f697006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:25.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.527+0000 7f698a79f640 1 --2- 172.21.15.123:0/2208100582 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f697006c2b0 0x7f697006e770 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f6978006fd0 tx=0x7f6978008040 comp rx=0 tx=0).stop 2024-09-15T23:19:25.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.527+0000 7f698a79f640 1 -- 172.21.15.123:0/2208100582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69840b2d40 msgr2=0x7f6984155d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:25.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.527+0000 7f698a79f640 1 --2- 172.21.15.123:0/2208100582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69840b2d40 0x7f6984155d50 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f697400c7f0 tx=0x7f697400ccb0 comp rx=0 tx=0).stop 2024-09-15T23:19:25.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.527+0000 7f698a79f640 1 -- 172.21.15.123:0/2208100582 shutdown_connections 2024-09-15T23:19:25.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.527+0000 7f698a79f640 1 --2- 172.21.15.123:0/2208100582 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f698415bcf0 0x7f698415e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:25.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.527+0000 7f698a79f640 1 --2- 172.21.15.123:0/2208100582 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f698413eb20 0x7f698413e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:25.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.527+0000 7f698a79f640 1 --2- 172.21.15.123:0/2208100582 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f697006c2b0 0x7f697006e770 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:25.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.527+0000 7f698a79f640 1 --2- 172.21.15.123:0/2208100582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69840b2d40 0x7f6984155d50 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:25.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.527+0000 7f698a79f640 1 -- 172.21.15.123:0/2208100582 >> 172.21.15.123:0/2208100582 conn(0x7f69840ccec0 msgr2=0x7f6984071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:25.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.528+0000 7f698a79f640 1 -- 172.21.15.123:0/2208100582 shutdown_connections 2024-09-15T23:19:25.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.528+0000 7f698a79f640 1 -- 172.21.15.123:0/2208100582 wait complete. 2024-09-15T23:19:25.540 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T23:19:25.571 INFO:tasks.ceph.mds.d.smithi188.stdout:starting mds.d at 2024-09-15T23:19:25.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.640+0000 7f9227dcf640 1 Processor -- start 2024-09-15T23:19:25.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.640+0000 7f9227dcf640 1 -- start start 2024-09-15T23:19:25.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.641+0000 7f9227dcf640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9220158920 0x7f9220073ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:25.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.641+0000 7f9227dcf640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f9220070f40 0x7f922006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:25.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.641+0000 7f9227dcf640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9220158d00 con 0x7f922006c150 2024-09-15T23:19:25.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.641+0000 7f9227dcf640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f922015c2d0 con 0x7f9220070f40 2024-09-15T23:19:25.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.641+0000 7f9227dcf640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9220072130 con 0x7f9220158920 2024-09-15T23:19:25.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.641+0000 7f922636c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f922006c150 0x7f922015e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51876/0 (socket says 172.21.15.123:51876) 2024-09-15T23:19:25.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.641+0000 7f922636c640 1 -- 172.21.15.123:0/1791758102 learned_addr learned my addr 172.21.15.123:0/1791758102 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:19:25.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.641+0000 7f9224b69640 1 -- 172.21.15.123:0/1791758102 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 398150759 0 0) 0x7f9218001490 con 0x7f922006c150 2024-09-15T23:19:25.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.641+0000 7f922536a640 1 --2- 172.21.15.123:0/1791758102 >> v2:172.21.15.188:3300/0 conn(0x7f9220070f40 0x7f922006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:25.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.641+0000 7f9225b6b640 1 --2- 172.21.15.123:0/1791758102 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9220158920 0x7f9220073ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:25.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.641+0000 7f9224b69640 1 -- 172.21.15.123:0/1791758102 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f920c003440 con 0x7f922006c150 2024-09-15T23:19:25.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.641+0000 7f9224b69640 1 -- 172.21.15.123:0/1791758102 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1851397666 0 0) 0x7f920c003440 con 0x7f922006c150 2024-09-15T23:19:25.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.641+0000 7f9224b69640 1 -- 172.21.15.123:0/1791758102 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9220158920 msgr2=0x7f9220073ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:25.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.641+0000 7f9224b69640 1 --2- 172.21.15.123:0/1791758102 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9220158920 0x7f9220073ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:25.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.641+0000 7f9224b69640 1 -- 172.21.15.123:0/1791758102 >> v2:172.21.15.188:3300/0 conn(0x7f9220070f40 msgr2=0x7f922006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:25.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.641+0000 7f9224b69640 1 --2- 172.21.15.123:0/1791758102 >> v2:172.21.15.188:3300/0 conn(0x7f9220070f40 0x7f922006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:25.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.641+0000 7f9224b69640 1 -- 172.21.15.123:0/1791758102 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92200ce0f0 con 0x7f922006c150 2024-09-15T23:19:25.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.641+0000 7f9224b69640 1 -- 172.21.15.123:0/1791758102 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f9218001bc0 con 0x7f922006c150 2024-09-15T23:19:25.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.641+0000 7f9224b69640 1 -- 172.21.15.123:0/1791758102 >> v1:172.21.15.123:6789/0 conn(0x7f922006c150 legacy=0x7f922015e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:25.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.641+0000 7f9224b69640 1 --2- 172.21.15.123:0/1791758102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f920c003aa0 0x7f920c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:25.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.641+0000 7f9224b69640 1 --2- 172.21.15.123:0/1791758102 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f920c006640 0x7f920c008a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:25.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.641+0000 7f9224b69640 1 --2- 172.21.15.123:0/1791758102 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9220158920 0x7f920c00b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:25.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.642+0000 7f9224b69640 1 -- 172.21.15.123:0/1791758102 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9220072130 con 0x7f920c003aa0 2024-09-15T23:19:25.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.642+0000 7f9224b69640 1 -- 172.21.15.123:0/1791758102 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f920c00b930 con 0x7f920c006640 2024-09-15T23:19:25.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.642+0000 7f9224b69640 1 -- 172.21.15.123:0/1791758102 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f920c00bb30 con 0x7f9220158920 2024-09-15T23:19:25.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.642+0000 7f9225b6b640 1 --2- 172.21.15.123:0/1791758102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f920c003aa0 0x7f920c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:25.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.642+0000 7f922536a640 1 --2- 172.21.15.123:0/1791758102 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f920c006640 0x7f920c008a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:25.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.642+0000 7f922636c640 1 --2- 172.21.15.123:0/1791758102 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9220158920 0x7f920c00b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:25.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.642+0000 7f9225b6b640 1 -- 172.21.15.123:0/1791758102 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9220158920 msgr2=0x7f920c00b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:25.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.642+0000 7f9225b6b640 1 --2- 172.21.15.123:0/1791758102 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9220158920 0x7f920c00b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:25.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.642+0000 7f9225b6b640 1 -- 172.21.15.123:0/1791758102 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f920c006640 msgr2=0x7f920c008a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:25.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.642+0000 7f9225b6b640 1 --2- 172.21.15.123:0/1791758102 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f920c006640 0x7f920c008a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:25.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.642+0000 7f9225b6b640 1 -- 172.21.15.123:0/1791758102 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f920c003440 con 0x7f920c003aa0 2024-09-15T23:19:25.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.642+0000 7f922636c640 1 --2- 172.21.15.123:0/1791758102 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9220158920 0x7f920c00b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:19:25.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.643+0000 7f9225b6b640 1 --2- 172.21.15.123:0/1791758102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f920c003aa0 0x7f920c003ec0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f921c00bfc0 tx=0x7f920c003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=808a7a6a04adf009 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:25.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.643+0000 7f9224b69640 1 -- 172.21.15.123:0/1791758102 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f921c038070 con 0x7f920c003aa0 2024-09-15T23:19:25.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.643+0000 7f9224b69640 1 -- 172.21.15.123:0/1791758102 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f921c033600 con 0x7f920c003aa0 2024-09-15T23:19:25.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.643+0000 7f9224b69640 1 -- 172.21.15.123:0/1791758102 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f921c00bc10 con 0x7f920c003aa0 2024-09-15T23:19:25.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.643+0000 7f9227dcf640 1 -- 172.21.15.123:0/1791758102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f920c003aa0 msgr2=0x7f920c003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:25.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.643+0000 7f9227dcf640 1 --2- 172.21.15.123:0/1791758102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f920c003aa0 0x7f920c003ec0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f921c00bfc0 tx=0x7f920c003730 comp rx=0 tx=0).stop 2024-09-15T23:19:25.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.643+0000 7f922636c640 1 -- 172.21.15.123:0/1791758102 reap_dead start 2024-09-15T23:19:25.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.643+0000 7f9227dcf640 1 -- 172.21.15.123:0/1791758102 shutdown_connections 2024-09-15T23:19:25.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.643+0000 7f9227dcf640 1 -- 172.21.15.123:0/1791758102 >> 172.21.15.123:0/1791758102 conn(0x7f922006d0f0 msgr2=0x7f922006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:25.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.643+0000 7f9227dcf640 1 -- 172.21.15.123:0/1791758102 shutdown_connections 2024-09-15T23:19:25.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.643+0000 7f9227dcf640 1 -- 172.21.15.123:0/1791758102 wait complete. 2024-09-15T23:19:25.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.644+0000 7f9227dcf640 1 Processor -- start 2024-09-15T23:19:25.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.645+0000 7f9227dcf640 1 -- start start 2024-09-15T23:19:25.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.645+0000 7f9227dcf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f920c003aa0 0x7f9220156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:25.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.645+0000 7f9227dcf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9220154460 0x7f92201f4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:25.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.645+0000 7f9227dcf640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f922015d2f0 0x7f922015d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:25.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.645+0000 7f9227dcf640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9220071dc0 con 0x7f920c003aa0 2024-09-15T23:19:25.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.645+0000 7f9227dcf640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9220071ae0 con 0x7f9220154460 2024-09-15T23:19:25.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.645+0000 7f9227dcf640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f922006cc30 con 0x7f922015d2f0 2024-09-15T23:19:25.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.645+0000 7f9225b6b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f920c003aa0 0x7f9220156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:25.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.645+0000 7f9225b6b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f920c003aa0 0x7f9220156970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32992/0 (socket says 172.21.15.123:32992) 2024-09-15T23:19:25.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.645+0000 7f9225b6b640 1 -- 172.21.15.123:0/861609071 learned_addr learned my addr 172.21.15.123:0/861609071 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:25.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.645+0000 7f922636c640 1 --2- 172.21.15.123:0/861609071 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f922015d2f0 0x7f922015d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:25.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.645+0000 7f922536a640 1 --2- 172.21.15.123:0/861609071 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9220154460 0x7f92201f4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:25.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.646+0000 7f9225b6b640 1 -- 172.21.15.123:0/861609071 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f922015d2f0 msgr2=0x7f922015d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:25.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.646+0000 7f9225b6b640 1 --2- 172.21.15.123:0/861609071 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f922015d2f0 0x7f922015d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:25.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.646+0000 7f9225b6b640 1 -- 172.21.15.123:0/861609071 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9220154460 msgr2=0x7f92201f4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:25.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.646+0000 7f9225b6b640 1 --2- 172.21.15.123:0/861609071 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9220154460 0x7f92201f4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:25.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.646+0000 7f9225b6b640 1 -- 172.21.15.123:0/861609071 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9220157000 con 0x7f920c003aa0 2024-09-15T23:19:25.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.646+0000 7f9225b6b640 1 --2- 172.21.15.123:0/861609071 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f920c003aa0 0x7f9220156970 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f921c009090 tx=0x7f921c00b750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:25.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.646+0000 7f92167fc640 1 -- 172.21.15.123:0/861609071 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f921c038040 con 0x7f920c003aa0 2024-09-15T23:19:25.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.646+0000 7f92167fc640 1 -- 172.21.15.123:0/861609071 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f921c033400 con 0x7f920c003aa0 2024-09-15T23:19:25.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.646+0000 7f9227dcf640 1 -- 172.21.15.123:0/861609071 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92201572e0 con 0x7f920c003aa0 2024-09-15T23:19:25.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.646+0000 7f92167fc640 1 -- 172.21.15.123:0/861609071 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f921c00bc10 con 0x7f920c003aa0 2024-09-15T23:19:25.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.646+0000 7f9227dcf640 1 -- 172.21.15.123:0/861609071 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f922014dd10 con 0x7f920c003aa0 2024-09-15T23:19:25.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.647+0000 7f9227dcf640 1 -- 172.21.15.123:0/861609071 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92200725c0 con 0x7f920c003aa0 2024-09-15T23:19:25.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.647+0000 7f92167fc640 1 -- 172.21.15.123:0/861609071 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f921c045020 con 0x7f920c003aa0 2024-09-15T23:19:25.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.648+0000 7f92167fc640 1 --2- 172.21.15.123:0/861609071 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f920406c2b0 0x7f920406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:25.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.648+0000 7f92167fc640 1 -- 172.21.15.123:0/861609071 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5795+0+0 (secure 0 0 0) 0x7f921c0ab370 con 0x7f920c003aa0 2024-09-15T23:19:25.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.648+0000 7f922536a640 1 --2- 172.21.15.123:0/861609071 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f920406c2b0 0x7f920406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:25.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.649+0000 7f922536a640 1 --2- 172.21.15.123:0/861609071 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f920406c2b0 0x7f920406e770 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f92201f7c20 tx=0x7f9210009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:25.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.652+0000 7f92167fc640 1 -- 172.21.15.123:0/861609071 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f921c04c020 con 0x7f920c003aa0 2024-09-15T23:19:25.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:25.849+0000 7f9227dcf640 1 -- 172.21.15.123:0/861609071 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f92201f4580 con 0x7f920c003aa0 2024-09-15T23:19:26.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.529+0000 7f92167fc640 1 -- 172.21.15.123:0/861609071 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v82) ==== 104+0+0 (secure 0 0 0) 0x7f921c0335d0 con 0x7f920c003aa0 2024-09-15T23:19:26.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.531+0000 7f9227dcf640 1 -- 172.21.15.123:0/861609071 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f920406c2b0 msgr2=0x7f920406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:26.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.531+0000 7f9227dcf640 1 --2- 172.21.15.123:0/861609071 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f920406c2b0 0x7f920406e770 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f92201f7c20 tx=0x7f9210009190 comp rx=0 tx=0).stop 2024-09-15T23:19:26.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.531+0000 7f9227dcf640 1 -- 172.21.15.123:0/861609071 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f920c003aa0 msgr2=0x7f9220156970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:26.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.531+0000 7f9227dcf640 1 --2- 172.21.15.123:0/861609071 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f920c003aa0 0x7f9220156970 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f921c009090 tx=0x7f921c00b750 comp rx=0 tx=0).stop 2024-09-15T23:19:26.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.532+0000 7f9227dcf640 1 -- 172.21.15.123:0/861609071 shutdown_connections 2024-09-15T23:19:26.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.532+0000 7f9227dcf640 1 --2- 172.21.15.123:0/861609071 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f922015d2f0 0x7f922015d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:26.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.532+0000 7f9227dcf640 1 --2- 172.21.15.123:0/861609071 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9220154460 0x7f92201f4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:26.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.532+0000 7f9227dcf640 1 --2- 172.21.15.123:0/861609071 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f920406c2b0 0x7f920406e770 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:26.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.532+0000 7f9227dcf640 1 --2- 172.21.15.123:0/861609071 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f920c003aa0 0x7f9220156970 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:26.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.532+0000 7f9227dcf640 1 -- 172.21.15.123:0/861609071 >> 172.21.15.123:0/861609071 conn(0x7f922006d0f0 msgr2=0x7f9220074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:26.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.532+0000 7f9227dcf640 1 -- 172.21.15.123:0/861609071 shutdown_connections 2024-09-15T23:19:26.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.532+0000 7f9227dcf640 1 -- 172.21.15.123:0/861609071 wait complete. 2024-09-15T23:19:26.545 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T23:19:26.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.649+0000 7f456267b640 1 Processor -- start 2024-09-15T23:19:26.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.649+0000 7f456267b640 1 -- start start 2024-09-15T23:19:26.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.650+0000 7f456267b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f455c0b2370 0x7f455c0cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:26.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.650+0000 7f456267b640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f455c0b0680 con 0x7f455c155b20 2024-09-15T23:19:26.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.650+0000 7f456267b640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f455c0ccf70 con 0x7f455c0cf960 2024-09-15T23:19:26.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.650+0000 7f456267b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f455c0b01e0 con 0x7f455c0b2370 2024-09-15T23:19:26.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.650+0000 7f455bfff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f455c155b20 0x7f455c0b1c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:33742/0 (socket says 172.21.15.123:33742) 2024-09-15T23:19:26.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.650+0000 7f455bfff640 1 -- 172.21.15.123:0/4275293473 learned_addr learned my addr 172.21.15.123:0/4275293473 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:19:26.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.650+0000 7f455affd640 1 -- 172.21.15.123:0/4275293473 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3542386042 0 0) 0x7f455c0b0680 con 0x7f455c155b20 2024-09-15T23:19:26.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.650+0000 7f455affd640 1 -- 172.21.15.123:0/4275293473 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4544003520 con 0x7f455c155b20 2024-09-15T23:19:26.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.650+0000 7f455b7fe640 1 --2- 172.21.15.123:0/4275293473 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f455c0b2370 0x7f455c0cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:26.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.650+0000 7f455affd640 1 -- 172.21.15.123:0/4275293473 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2335351416 0 0) 0x7f4544003520 con 0x7f455c155b20 2024-09-15T23:19:26.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.650+0000 7f455affd640 1 -- 172.21.15.123:0/4275293473 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f455c0b2370 msgr2=0x7f455c0cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:26.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.650+0000 7f455affd640 1 --2- 172.21.15.123:0/4275293473 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f455c0b2370 0x7f455c0cf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:26.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.650+0000 7f455affd640 1 -- 172.21.15.123:0/4275293473 >> v1:172.21.15.188:6789/0 conn(0x7f455c0cf960 legacy=0x7f455c15c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:26.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.650+0000 7f455affd640 1 -- 172.21.15.123:0/4275293473 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f455c0ce940 con 0x7f455c155b20 2024-09-15T23:19:26.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.650+0000 7f455affd640 1 -- 172.21.15.123:0/4275293473 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f454c001670 con 0x7f455c155b20 2024-09-15T23:19:26.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.650+0000 7f455b7fe640 1 --2- 172.21.15.123:0/4275293473 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f455c0b2370 0x7f455c0cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:19:26.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.650+0000 7f455affd640 1 -- 172.21.15.123:0/4275293473 >> v1:172.21.15.123:6789/0 conn(0x7f455c155b20 legacy=0x7f455c0b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:26.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.650+0000 7f455affd640 1 --2- 172.21.15.123:0/4275293473 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f45440039e0 0x7f4544003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:26.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.650+0000 7f455affd640 1 --2- 172.21.15.123:0/4275293473 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f455c0b2370 0x7f4544004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:26.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.651+0000 7f455affd640 1 --2- 172.21.15.123:0/4275293473 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4544004d40 0x7f45440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:26.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.651+0000 7f455affd640 1 -- 172.21.15.123:0/4275293473 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f455c0b01e0 con 0x7f4544004d40 2024-09-15T23:19:26.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.651+0000 7f455affd640 1 -- 172.21.15.123:0/4275293473 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f454400bb00 con 0x7f45440039e0 2024-09-15T23:19:26.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.651+0000 7f455affd640 1 -- 172.21.15.123:0/4275293473 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f454400bd00 con 0x7f455c0b2370 2024-09-15T23:19:26.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.651+0000 7f4560c18640 1 --2- 172.21.15.123:0/4275293473 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4544004d40 0x7f45440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:26.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.651+0000 7f455b7fe640 1 --2- 172.21.15.123:0/4275293473 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f455c0b2370 0x7f4544004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:26.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.651+0000 7f455bfff640 1 --2- 172.21.15.123:0/4275293473 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f45440039e0 0x7f4544003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:26.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.651+0000 7f4560c18640 1 -- 172.21.15.123:0/4275293473 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f455c0b2370 msgr2=0x7f4544004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:26.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.651+0000 7f4560c18640 1 --2- 172.21.15.123:0/4275293473 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f455c0b2370 0x7f4544004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:26.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.651+0000 7f4560c18640 1 -- 172.21.15.123:0/4275293473 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f45440039e0 msgr2=0x7f4544003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:26.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.651+0000 7f4560c18640 1 --2- 172.21.15.123:0/4275293473 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f45440039e0 0x7f4544003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:26.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.651+0000 7f4560c18640 1 -- 172.21.15.123:0/4275293473 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4544003520 con 0x7f4544004d40 2024-09-15T23:19:26.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.652+0000 7f4560c18640 1 --2- 172.21.15.123:0/4275293473 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4544004d40 0x7f45440051c0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f4554001e20 tx=0x7f4544005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13e1c484c6d3337e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:26.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.652+0000 7f455affd640 1 -- 172.21.15.123:0/4275293473 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4554001a70 con 0x7f4544004d40 2024-09-15T23:19:26.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.652+0000 7f455affd640 1 -- 172.21.15.123:0/4275293473 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f455402ae40 con 0x7f4544004d40 2024-09-15T23:19:26.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.652+0000 7f455affd640 1 -- 172.21.15.123:0/4275293473 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4554003bb0 con 0x7f4544004d40 2024-09-15T23:19:26.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.652+0000 7f456267b640 1 -- 172.21.15.123:0/4275293473 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4544004d40 msgr2=0x7f45440051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:26.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.652+0000 7f456267b640 1 --2- 172.21.15.123:0/4275293473 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4544004d40 0x7f45440051c0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f4554001e20 tx=0x7f4544005830 comp rx=0 tx=0).stop 2024-09-15T23:19:26.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.652+0000 7f4560c18640 1 -- 172.21.15.123:0/4275293473 reap_dead start 2024-09-15T23:19:26.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.652+0000 7f456267b640 1 -- 172.21.15.123:0/4275293473 shutdown_connections 2024-09-15T23:19:26.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.652+0000 7f456267b640 1 -- 172.21.15.123:0/4275293473 >> 172.21.15.123:0/4275293473 conn(0x7f455c06c240 msgr2=0x7f455c06d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:26.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.652+0000 7f456267b640 1 -- 172.21.15.123:0/4275293473 shutdown_connections 2024-09-15T23:19:26.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.652+0000 7f456267b640 1 -- 172.21.15.123:0/4275293473 wait complete. 2024-09-15T23:19:26.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.654+0000 7f456267b640 1 Processor -- start 2024-09-15T23:19:26.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.654+0000 7f456267b640 1 -- start start 2024-09-15T23:19:26.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.654+0000 7f456267b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4544004d40 0x7f455c1503d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:26.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.654+0000 7f456267b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f455c15e640 0x7f455c15dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:26.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.654+0000 7f456267b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f455c152050 0x7f455c1524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:26.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.654+0000 7f456267b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f455c0ce610 con 0x7f4544004d40 2024-09-15T23:19:26.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.654+0000 7f456267b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f455c0cef00 con 0x7f455c15e640 2024-09-15T23:19:26.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.654+0000 7f456267b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f455c0cfd80 con 0x7f455c152050 2024-09-15T23:19:26.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.655+0000 7f455bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4544004d40 0x7f455c1503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:26.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.655+0000 7f455bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4544004d40 0x7f455c1503d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41334/0 (socket says 172.21.15.123:41334) 2024-09-15T23:19:26.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.655+0000 7f455bfff640 1 -- 172.21.15.123:0/4032269108 learned_addr learned my addr 172.21.15.123:0/4032269108 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:26.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.655+0000 7f455b7fe640 1 --2- 172.21.15.123:0/4032269108 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f455c15e640 0x7f455c15dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:26.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.655+0000 7f4560c18640 1 --2- 172.21.15.123:0/4032269108 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f455c152050 0x7f455c1524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:26.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.655+0000 7f455bfff640 1 -- 172.21.15.123:0/4032269108 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f455c152050 msgr2=0x7f455c1524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:26.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.655+0000 7f455bfff640 1 --2- 172.21.15.123:0/4032269108 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f455c152050 0x7f455c1524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:26.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.655+0000 7f455bfff640 1 -- 172.21.15.123:0/4032269108 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f455c15e640 msgr2=0x7f455c15dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:26.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.655+0000 7f455bfff640 1 --2- 172.21.15.123:0/4032269108 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f455c15e640 0x7f455c15dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:26.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.655+0000 7f455bfff640 1 -- 172.21.15.123:0/4032269108 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f455c157960 con 0x7f4544004d40 2024-09-15T23:19:26.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.655+0000 7f455b7fe640 1 --2- 172.21.15.123:0/4032269108 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f455c15e640 0x7f455c15dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:19:26.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.655+0000 7f4560c18640 1 --2- 172.21.15.123:0/4032269108 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f455c152050 0x7f455c1524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:19:26.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.655+0000 7f455bfff640 1 --2- 172.21.15.123:0/4032269108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4544004d40 0x7f455c1503d0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f454c007370 tx=0x7f454c007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:26.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.655+0000 7f4558ff9640 1 -- 172.21.15.123:0/4032269108 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454c00f9c0 con 0x7f4544004d40 2024-09-15T23:19:26.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.655+0000 7f4558ff9640 1 -- 172.21.15.123:0/4032269108 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f454c018070 con 0x7f4544004d40 2024-09-15T23:19:26.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.655+0000 7f456267b640 1 -- 172.21.15.123:0/4032269108 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f455c157c40 con 0x7f4544004d40 2024-09-15T23:19:26.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.655+0000 7f4558ff9640 1 -- 172.21.15.123:0/4032269108 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454c00fde0 con 0x7f4544004d40 2024-09-15T23:19:26.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.655+0000 7f456267b640 1 -- 172.21.15.123:0/4032269108 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f455c1584e0 con 0x7f4544004d40 2024-09-15T23:19:26.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.656+0000 7f456267b640 1 -- 172.21.15.123:0/4032269108 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f455c158030 con 0x7f4544004d40 2024-09-15T23:19:26.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.657+0000 7f4558ff9640 1 -- 172.21.15.123:0/4032269108 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f454c01d460 con 0x7f4544004d40 2024-09-15T23:19:26.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.657+0000 7f4558ff9640 1 --2- 172.21.15.123:0/4032269108 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f454806c2b0 0x7f454806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:26.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.657+0000 7f4558ff9640 1 -- 172.21.15.123:0/4032269108 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5795+0+0 (secure 0 0 0) 0x7f454c08b6a0 con 0x7f4544004d40 2024-09-15T23:19:26.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.657+0000 7f455b7fe640 1 --2- 172.21.15.123:0/4032269108 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f454806c2b0 0x7f454806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:26.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.658+0000 7f455b7fe640 1 --2- 172.21.15.123:0/4032269108 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f454806c2b0 0x7f454806e770 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f455c15ea80 tx=0x7f4550008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:26.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.661+0000 7f4558ff9640 1 -- 172.21.15.123:0/4032269108 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f454c059db0 con 0x7f4544004d40 2024-09-15T23:19:26.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:26.827+0000 7f456267b640 1 -- 172.21.15.123:0/4032269108 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f455c0b0930 con 0x7f4544004d40 2024-09-15T23:19:27.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.531+0000 7f4558ff9640 1 -- 172.21.15.123:0/4032269108 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v132) ==== 181+0+0 (secure 0 0 0) 0x7f454c0596b0 con 0x7f4544004d40 2024-09-15T23:19:27.532 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' removed 2024-09-15T23:19:27.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.534+0000 7f456267b640 1 -- 172.21.15.123:0/4032269108 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f454806c2b0 msgr2=0x7f454806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:27.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.534+0000 7f456267b640 1 --2- 172.21.15.123:0/4032269108 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f454806c2b0 0x7f454806e770 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f455c15ea80 tx=0x7f4550008040 comp rx=0 tx=0).stop 2024-09-15T23:19:27.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.534+0000 7f456267b640 1 -- 172.21.15.123:0/4032269108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4544004d40 msgr2=0x7f455c1503d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:27.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.534+0000 7f456267b640 1 --2- 172.21.15.123:0/4032269108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4544004d40 0x7f455c1503d0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f454c007370 tx=0x7f454c007830 comp rx=0 tx=0).stop 2024-09-15T23:19:27.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.534+0000 7f456267b640 1 -- 172.21.15.123:0/4032269108 shutdown_connections 2024-09-15T23:19:27.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.534+0000 7f456267b640 1 --2- 172.21.15.123:0/4032269108 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f455c152050 0x7f455c1524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:27.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.534+0000 7f456267b640 1 --2- 172.21.15.123:0/4032269108 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f455c15e640 0x7f455c15dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:27.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.534+0000 7f456267b640 1 --2- 172.21.15.123:0/4032269108 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f454806c2b0 0x7f454806e770 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:27.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.534+0000 7f456267b640 1 --2- 172.21.15.123:0/4032269108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4544004d40 0x7f455c1503d0 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:27.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.534+0000 7f456267b640 1 -- 172.21.15.123:0/4032269108 >> 172.21.15.123:0/4032269108 conn(0x7f455c06c240 msgr2=0x7f455c0b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:27.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.535+0000 7f456267b640 1 -- 172.21.15.123:0/4032269108 shutdown_connections 2024-09-15T23:19:27.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.535+0000 7f456267b640 1 -- 172.21.15.123:0/4032269108 wait complete. 2024-09-15T23:19:27.550 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T23:19:27.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.655+0000 7fea91398640 1 Processor -- start 2024-09-15T23:19:27.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.655+0000 7fea91398640 1 -- start start 2024-09-15T23:19:27.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.656+0000 7fea91398640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fea8c15ea10 0x7fea8c0d25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:27.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.656+0000 7fea91398640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea8c0d10f0 con 0x7fea8c0b3fe0 2024-09-15T23:19:27.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.656+0000 7fea91398640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea8c0d13d0 con 0x7fea8c0d34b0 2024-09-15T23:19:27.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.656+0000 7fea91398640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fea8c0d1d00 con 0x7fea8c15ea10 2024-09-15T23:19:27.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.656+0000 7fea8affd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fea8c15ea10 0x7fea8c0d25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:27.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.656+0000 7fea83fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fea8c0b3fe0 0x7fea8c0d2da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:33750/0 (socket says 172.21.15.123:33750) 2024-09-15T23:19:27.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.656+0000 7fea83fff640 1 -- 172.21.15.123:0/3766040501 learned_addr learned my addr 172.21.15.123:0/3766040501 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:19:27.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.656+0000 7fea8affd640 1 --2- 172.21.15.123:0/3766040501 >> v2:172.21.15.123:3300/0 conn(0x7fea8c15ea10 0x7fea8c0d25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41348/0 (socket says 172.21.15.123:41348) 2024-09-15T23:19:27.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.656+0000 7fea8affd640 1 -- 172.21.15.123:0/3766040501 >> v1:172.21.15.188:6789/0 conn(0x7fea8c0d34b0 legacy=0x7fea8c0cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:27.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.656+0000 7fea8affd640 1 -- 172.21.15.123:0/3766040501 >> v1:172.21.15.123:6789/0 conn(0x7fea8c0b3fe0 legacy=0x7fea8c0d2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:27.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.656+0000 7fea8a7fc640 1 -- 172.21.15.123:0/3766040501 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2011261095 0 0) 0x7fea8c0d10f0 con 0x7fea8c0b3fe0 2024-09-15T23:19:27.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.656+0000 7fea8affd640 1 -- 172.21.15.123:0/3766040501 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea8c0d16b0 con 0x7fea8c15ea10 2024-09-15T23:19:27.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.657+0000 7fea8affd640 1 --2- 172.21.15.123:0/3766040501 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea8c15ea10 0x7fea8c0d25a0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fea7c0097a0 tx=0x7fea7c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f2be5e3795bf16 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:27.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.657+0000 7fea8a7fc640 1 -- 172.21.15.123:0/3766040501 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7c037070 con 0x7fea8c15ea10 2024-09-15T23:19:27.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.657+0000 7fea8a7fc640 1 -- 172.21.15.123:0/3766040501 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea7c032440 con 0x7fea8c15ea10 2024-09-15T23:19:27.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.657+0000 7fea8a7fc640 1 -- 172.21.15.123:0/3766040501 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7c032810 con 0x7fea8c15ea10 2024-09-15T23:19:27.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.658+0000 7fea91398640 1 -- 172.21.15.123:0/3766040501 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea8c15ea10 msgr2=0x7fea8c0d25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:27.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.658+0000 7fea91398640 1 --2- 172.21.15.123:0/3766040501 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea8c15ea10 0x7fea8c0d25a0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fea7c0097a0 tx=0x7fea7c02a1e0 comp rx=0 tx=0).stop 2024-09-15T23:19:27.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.658+0000 7fea91398640 1 -- 172.21.15.123:0/3766040501 shutdown_connections 2024-09-15T23:19:27.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.658+0000 7fea91398640 1 --2- 172.21.15.123:0/3766040501 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea8c15ea10 0x7fea8c0d25a0 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:27.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.658+0000 7fea91398640 1 -- 172.21.15.123:0/3766040501 >> 172.21.15.123:0/3766040501 conn(0x7fea8c09dd60 msgr2=0x7fea8c0d49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:27.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.658+0000 7fea91398640 1 -- 172.21.15.123:0/3766040501 shutdown_connections 2024-09-15T23:19:27.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.658+0000 7fea91398640 1 -- 172.21.15.123:0/3766040501 wait complete. 2024-09-15T23:19:27.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.659+0000 7fea91398640 1 Processor -- start 2024-09-15T23:19:27.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.659+0000 7fea91398640 1 -- start start 2024-09-15T23:19:27.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.660+0000 7fea91398640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea8c0b3fe0 0x7fea8c1e8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:27.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.660+0000 7fea91398640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fea8c0d34b0 0x7fea8c0ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:27.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.660+0000 7fea91398640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea8c15ea10 0x7fea8c0cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:27.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.660+0000 7fea91398640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fea8c0cfd80 con 0x7fea8c15ea10 2024-09-15T23:19:27.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.660+0000 7fea91398640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fea8c0d2ae0 con 0x7fea8c0b3fe0 2024-09-15T23:19:27.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.660+0000 7fea91398640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fea8c0cff00 con 0x7fea8c0d34b0 2024-09-15T23:19:27.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.660+0000 7fea8b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea8c15ea10 0x7fea8c0cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:27.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.660+0000 7fea8b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea8c15ea10 0x7fea8c0cd4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41358/0 (socket says 172.21.15.123:41358) 2024-09-15T23:19:27.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.660+0000 7fea8b7fe640 1 -- 172.21.15.123:0/2389734366 learned_addr learned my addr 172.21.15.123:0/2389734366 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:27.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.660+0000 7fea8affd640 1 --2- 172.21.15.123:0/2389734366 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea8c0b3fe0 0x7fea8c1e8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:27.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.660+0000 7fea8b7fe640 1 -- 172.21.15.123:0/2389734366 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fea8c0d34b0 msgr2=0x7fea8c0ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:27.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.660+0000 7fea8b7fe640 1 --2- 172.21.15.123:0/2389734366 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fea8c0d34b0 0x7fea8c0ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:27.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.660+0000 7fea8b7fe640 1 -- 172.21.15.123:0/2389734366 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea8c0b3fe0 msgr2=0x7fea8c1e8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:27.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.660+0000 7fea8b7fe640 1 --2- 172.21.15.123:0/2389734366 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea8c0b3fe0 0x7fea8c1e8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:27.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.660+0000 7fea8b7fe640 1 -- 172.21.15.123:0/2389734366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea8c1e89f0 con 0x7fea8c15ea10 2024-09-15T23:19:27.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.660+0000 7fea8b7fe640 1 --2- 172.21.15.123:0/2389734366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea8c15ea10 0x7fea8c0cd4e0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fea8400c780 tx=0x7fea8400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:27.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.660+0000 7fea837fe640 1 -- 172.21.15.123:0/2389734366 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea84004b60 con 0x7fea8c15ea10 2024-09-15T23:19:27.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.661+0000 7fea837fe640 1 -- 172.21.15.123:0/2389734366 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea84004d00 con 0x7fea8c15ea10 2024-09-15T23:19:27.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.661+0000 7fea91398640 1 -- 172.21.15.123:0/2389734366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea8c1e8cd0 con 0x7fea8c15ea10 2024-09-15T23:19:27.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.661+0000 7fea837fe640 1 -- 172.21.15.123:0/2389734366 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8400aa90 con 0x7fea8c15ea10 2024-09-15T23:19:27.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.661+0000 7fea91398640 1 -- 172.21.15.123:0/2389734366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea8c1e9290 con 0x7fea8c15ea10 2024-09-15T23:19:27.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.662+0000 7fea91398640 1 -- 172.21.15.123:0/2389734366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea8c0d25a0 con 0x7fea8c15ea10 2024-09-15T23:19:27.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.662+0000 7fea837fe640 1 -- 172.21.15.123:0/2389734366 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fea8400ac30 con 0x7fea8c15ea10 2024-09-15T23:19:27.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.662+0000 7fea837fe640 1 --2- 172.21.15.123:0/2389734366 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fea6c06c2b0 0x7fea6c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:27.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.663+0000 7fea837fe640 1 -- 172.21.15.123:0/2389734366 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5357+0+0 (secure 0 0 0) 0x7fea8408b4d0 con 0x7fea8c15ea10 2024-09-15T23:19:27.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.663+0000 7fea8affd640 1 --2- 172.21.15.123:0/2389734366 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fea6c06c2b0 0x7fea6c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:27.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.663+0000 7fea8affd640 1 --2- 172.21.15.123:0/2389734366 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fea6c06c2b0 0x7fea6c06e770 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fea7c034000 tx=0x7fea7c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:27.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.667+0000 7fea837fe640 1 -- 172.21.15.123:0/2389734366 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fea84020070 con 0x7fea8c15ea10 2024-09-15T23:19:27.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:27.832+0000 7fea91398640 1 -- 172.21.15.123:0/2389734366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fea8c0d2130 con 0x7fea8c15ea10 2024-09-15T23:19:28.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.535+0000 7fea837fe640 1 -- 172.21.15.123:0/2389734366 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v133) ==== 169+0+0 (secure 0 0 0) 0x7fea84059e30 con 0x7fea8c15ea10 2024-09-15T23:19:28.537 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' removed 2024-09-15T23:19:28.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.538+0000 7fea91398640 1 -- 172.21.15.123:0/2389734366 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fea6c06c2b0 msgr2=0x7fea6c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:28.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.538+0000 7fea91398640 1 --2- 172.21.15.123:0/2389734366 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fea6c06c2b0 0x7fea6c06e770 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fea7c034000 tx=0x7fea7c02e000 comp rx=0 tx=0).stop 2024-09-15T23:19:28.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.538+0000 7fea91398640 1 -- 172.21.15.123:0/2389734366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea8c15ea10 msgr2=0x7fea8c0cd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:28.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.538+0000 7fea91398640 1 --2- 172.21.15.123:0/2389734366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea8c15ea10 0x7fea8c0cd4e0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fea8400c780 tx=0x7fea8400cc40 comp rx=0 tx=0).stop 2024-09-15T23:19:28.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.540+0000 7fea91398640 1 -- 172.21.15.123:0/2389734366 shutdown_connections 2024-09-15T23:19:28.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.540+0000 7fea91398640 1 --2- 172.21.15.123:0/2389734366 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fea6c06c2b0 0x7fea6c06e770 secure :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fea7c034000 tx=0x7fea7c02e000 comp rx=0 tx=0).stop 2024-09-15T23:19:28.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.540+0000 7fea91398640 1 --2- 172.21.15.123:0/2389734366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea8c15ea10 0x7fea8c0cd4e0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:28.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.540+0000 7fea91398640 1 --2- 172.21.15.123:0/2389734366 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fea8c0d34b0 0x7fea8c0ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:28.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.540+0000 7fea91398640 1 --2- 172.21.15.123:0/2389734366 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea8c0b3fe0 0x7fea8c1e8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:28.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.540+0000 7fea91398640 1 -- 172.21.15.123:0/2389734366 >> 172.21.15.123:0/2389734366 conn(0x7fea8c09dd60 msgr2=0x7fea8c0b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:28.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.541+0000 7fea91398640 1 -- 172.21.15.123:0/2389734366 shutdown_connections 2024-09-15T23:19:28.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.541+0000 7fea91398640 1 -- 172.21.15.123:0/2389734366 wait complete. 2024-09-15T23:19:28.566 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T23:19:28.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.675+0000 7fc636786640 1 Processor -- start 2024-09-15T23:19:28.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.675+0000 7fc636786640 1 -- start start 2024-09-15T23:19:28.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.675+0000 7fc636786640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc630155950 0x7fc630073600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:28.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.675+0000 7fc636786640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc630162c80 0x7fc63006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:28.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.676+0000 7fc636786640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc63006c150 0x7fc6300afb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:28.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.676+0000 7fc636786640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc630070370 con 0x7fc63006c150 2024-09-15T23:19:28.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.676+0000 7fc636786640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fc630073cc0 con 0x7fc630155950 2024-09-15T23:19:28.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.676+0000 7fc636786640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc630071aa0 con 0x7fc630162c80 2024-09-15T23:19:28.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.676+0000 7fc634d23640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc63006c150 0x7fc6300afb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:28.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.676+0000 7fc634d23640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc63006c150 0x7fc6300afb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41370/0 (socket says 172.21.15.123:41370) 2024-09-15T23:19:28.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.676+0000 7fc634d23640 1 -- 172.21.15.123:0/360476930 learned_addr learned my addr 172.21.15.123:0/360476930 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:28.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.676+0000 7fc62ffff640 1 --2- 172.21.15.123:0/360476930 >> v2:172.21.15.188:3300/0 conn(0x7fc630155950 0x7fc630073600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:28.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.676+0000 7fc62f7fe640 1 --2- 172.21.15.123:0/360476930 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc630162c80 0x7fc63006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:28.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.676+0000 7fc634d23640 1 -- 172.21.15.123:0/360476930 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc630162c80 msgr2=0x7fc63006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:28.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.676+0000 7fc634d23640 1 --2- 172.21.15.123:0/360476930 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc630162c80 0x7fc63006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:28.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.676+0000 7fc634d23640 1 -- 172.21.15.123:0/360476930 >> v2:172.21.15.188:3300/0 conn(0x7fc630155950 msgr2=0x7fc630073600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:28.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.676+0000 7fc634d23640 1 --2- 172.21.15.123:0/360476930 >> v2:172.21.15.188:3300/0 conn(0x7fc630155950 0x7fc630073600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:28.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.676+0000 7fc634d23640 1 -- 172.21.15.123:0/360476930 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc630071d80 con 0x7fc63006c150 2024-09-15T23:19:28.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.677+0000 7fc634d23640 1 --2- 172.21.15.123:0/360476930 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc63006c150 0x7fc6300afb20 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fc63006d830 tx=0x7fc62802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d2dbaabf5fcfbf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:28.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.677+0000 7fc62effd640 1 -- 172.21.15.123:0/360476930 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc628036070 con 0x7fc63006c150 2024-09-15T23:19:28.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.677+0000 7fc62effd640 1 -- 172.21.15.123:0/360476930 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc628031600 con 0x7fc63006c150 2024-09-15T23:19:28.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.677+0000 7fc62effd640 1 -- 172.21.15.123:0/360476930 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6280319d0 con 0x7fc63006c150 2024-09-15T23:19:28.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.677+0000 7fc636786640 1 -- 172.21.15.123:0/360476930 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc63006c150 msgr2=0x7fc6300afb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:28.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.677+0000 7fc636786640 1 --2- 172.21.15.123:0/360476930 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc63006c150 0x7fc6300afb20 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fc63006d830 tx=0x7fc62802a6a0 comp rx=0 tx=0).stop 2024-09-15T23:19:28.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.677+0000 7fc636786640 1 -- 172.21.15.123:0/360476930 shutdown_connections 2024-09-15T23:19:28.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.677+0000 7fc636786640 1 --2- 172.21.15.123:0/360476930 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc63006c150 0x7fc6300afb20 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:28.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.677+0000 7fc636786640 1 --2- 172.21.15.123:0/360476930 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc630162c80 0x7fc63006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:28.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.677+0000 7fc636786640 1 --2- 172.21.15.123:0/360476930 >> v2:172.21.15.188:3300/0 conn(0x7fc630155950 0x7fc630073600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:28.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.677+0000 7fc636786640 1 -- 172.21.15.123:0/360476930 >> 172.21.15.123:0/360476930 conn(0x7fc63006db30 msgr2=0x7fc63006df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:28.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.678+0000 7fc636786640 1 -- 172.21.15.123:0/360476930 shutdown_connections 2024-09-15T23:19:28.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.678+0000 7fc636786640 1 -- 172.21.15.123:0/360476930 wait complete. 2024-09-15T23:19:28.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.679+0000 7fc636786640 1 Processor -- start 2024-09-15T23:19:28.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.679+0000 7fc636786640 1 -- start start 2024-09-15T23:19:28.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.680+0000 7fc636786640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc63006c150 0x7fc630154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:28.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.680+0000 7fc636786640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc630162c80 0x7fc6301f6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:28.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.680+0000 7fc636786640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6300d05c0 0x7fc6300b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:28.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.680+0000 7fc636786640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc6300721e0 con 0x7fc63006c150 2024-09-15T23:19:28.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.680+0000 7fc636786640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc630072060 con 0x7fc630162c80 2024-09-15T23:19:28.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.680+0000 7fc636786640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc6300b0060 con 0x7fc6300d05c0 2024-09-15T23:19:28.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.680+0000 7fc62ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc63006c150 0x7fc630154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:28.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.680+0000 7fc62ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc63006c150 0x7fc630154ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41372/0 (socket says 172.21.15.123:41372) 2024-09-15T23:19:28.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.680+0000 7fc62ffff640 1 -- 172.21.15.123:0/650461012 learned_addr learned my addr 172.21.15.123:0/650461012 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:28.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.680+0000 7fc634d23640 1 --2- 172.21.15.123:0/650461012 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6300d05c0 0x7fc6300b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:28.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.680+0000 7fc62f7fe640 1 --2- 172.21.15.123:0/650461012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc630162c80 0x7fc6301f6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:28.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.680+0000 7fc62ffff640 1 -- 172.21.15.123:0/650461012 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6300d05c0 msgr2=0x7fc6300b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:28.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.680+0000 7fc62ffff640 1 --2- 172.21.15.123:0/650461012 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6300d05c0 0x7fc6300b1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:28.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.680+0000 7fc62ffff640 1 -- 172.21.15.123:0/650461012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc630162c80 msgr2=0x7fc6301f6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:28.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.680+0000 7fc62ffff640 1 --2- 172.21.15.123:0/650461012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc630162c80 0x7fc6301f6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:28.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.680+0000 7fc62ffff640 1 -- 172.21.15.123:0/650461012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc630154ff0 con 0x7fc63006c150 2024-09-15T23:19:28.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.680+0000 7fc62ffff640 1 --2- 172.21.15.123:0/650461012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc63006c150 0x7fc630154ab0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fc62000e9e0 tx=0x7fc62000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:28.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.680+0000 7fc62cff9640 1 -- 172.21.15.123:0/650461012 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc620017070 con 0x7fc63006c150 2024-09-15T23:19:28.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.680+0000 7fc62cff9640 1 -- 172.21.15.123:0/650461012 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc62000c9d0 con 0x7fc63006c150 2024-09-15T23:19:28.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.680+0000 7fc636786640 1 -- 172.21.15.123:0/650461012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6301f6a40 con 0x7fc63006c150 2024-09-15T23:19:28.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.680+0000 7fc62cff9640 1 -- 172.21.15.123:0/650461012 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc62000cdc0 con 0x7fc63006c150 2024-09-15T23:19:28.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.680+0000 7fc636786640 1 -- 172.21.15.123:0/650461012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6301f7000 con 0x7fc63006c150 2024-09-15T23:19:28.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.681+0000 7fc636786640 1 -- 172.21.15.123:0/650461012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6301f7710 con 0x7fc63006c150 2024-09-15T23:19:28.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.682+0000 7fc62cff9640 1 -- 172.21.15.123:0/650461012 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc62001a070 con 0x7fc63006c150 2024-09-15T23:19:28.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.682+0000 7fc62cff9640 1 --2- 172.21.15.123:0/650461012 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc61c06c2b0 0x7fc61c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:28.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.682+0000 7fc62cff9640 1 -- 172.21.15.123:0/650461012 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 4943+0+0 (secure 0 0 0) 0x7fc62008b400 con 0x7fc63006c150 2024-09-15T23:19:28.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.682+0000 7fc62f7fe640 1 --2- 172.21.15.123:0/650461012 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc61c06c2b0 0x7fc61c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:28.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.683+0000 7fc62f7fe640 1 --2- 172.21.15.123:0/650461012 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc61c06c2b0 0x7fc61c06e770 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fc6300b2a00 tx=0x7fc624009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:28.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.687+0000 7fc62cff9640 1 -- 172.21.15.123:0/650461012 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc620059820 con 0x7fc63006c150 2024-09-15T23:19:28.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.852+0000 7fc636786640 1 -- 172.21.15.123:0/650461012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fc6300b6360 con 0x7fc63006c150 2024-09-15T23:19:28.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.855+0000 7fc62cff9640 1 -- 172.21.15.123:0/650461012 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v37) ==== 104+0+0 (secure 0 0 0) 0x7fc62005db20 con 0x7fc63006c150 2024-09-15T23:19:28.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.857+0000 7fc636786640 1 -- 172.21.15.123:0/650461012 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc61c06c2b0 msgr2=0x7fc61c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:28.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.857+0000 7fc636786640 1 --2- 172.21.15.123:0/650461012 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc61c06c2b0 0x7fc61c06e770 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fc6300b2a00 tx=0x7fc624009190 comp rx=0 tx=0).stop 2024-09-15T23:19:28.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.857+0000 7fc636786640 1 -- 172.21.15.123:0/650461012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc63006c150 msgr2=0x7fc630154ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:28.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.857+0000 7fc636786640 1 --2- 172.21.15.123:0/650461012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc63006c150 0x7fc630154ab0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fc62000e9e0 tx=0x7fc62000eea0 comp rx=0 tx=0).stop 2024-09-15T23:19:28.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.857+0000 7fc636786640 1 -- 172.21.15.123:0/650461012 shutdown_connections 2024-09-15T23:19:28.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.857+0000 7fc636786640 1 --2- 172.21.15.123:0/650461012 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6300d05c0 0x7fc6300b1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:28.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.857+0000 7fc636786640 1 --2- 172.21.15.123:0/650461012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc630162c80 0x7fc6301f6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:28.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.857+0000 7fc636786640 1 --2- 172.21.15.123:0/650461012 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc61c06c2b0 0x7fc61c06e770 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:28.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.857+0000 7fc636786640 1 --2- 172.21.15.123:0/650461012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc63006c150 0x7fc630154ab0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:28.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.857+0000 7fc636786640 1 -- 172.21.15.123:0/650461012 >> 172.21.15.123:0/650461012 conn(0x7fc63006db30 msgr2=0x7fc6300b3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:28.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.858+0000 7fc636786640 1 -- 172.21.15.123:0/650461012 shutdown_connections 2024-09-15T23:19:28.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.858+0000 7fc636786640 1 -- 172.21.15.123:0/650461012 wait complete. 2024-09-15T23:19:28.870 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort' 2024-09-15T23:19:28.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.967+0000 7f7befb11640 1 Processor -- start 2024-09-15T23:19:28.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.967+0000 7f7befb11640 1 -- start start 2024-09-15T23:19:28.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.968+0000 7f7befb11640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7be80b2d40 0x7f7be806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:28.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.968+0000 7f7befb11640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7be813eb20 0x7f7be806c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:28.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.968+0000 7f7befb11640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7be8071180 con 0x7f7be815bcf0 2024-09-15T23:19:28.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.968+0000 7f7befb11640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f7be8071ab0 con 0x7f7be813eb20 2024-09-15T23:19:28.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.968+0000 7f7befb11640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7be8071460 con 0x7f7be80b2d40 2024-09-15T23:19:28.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.968+0000 7f7bed8ad640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7be80b2d40 0x7f7be806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:28.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.968+0000 7f7bed0ac640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7be813eb20 0x7f7be806c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:28.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.968+0000 7f7bed8ad640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7be80b2d40 0x7f7be806bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:42042/0 (socket says 172.21.15.123:42042) 2024-09-15T23:19:28.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.968+0000 7f7bed8ad640 1 -- 172.21.15.123:0/2739655327 learned_addr learned my addr 172.21.15.123:0/2739655327 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:28.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.968+0000 7f7bee0ae640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f7be815bcf0 0x7f7be815c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:49028/0 (socket says 172.21.15.123:49028) 2024-09-15T23:19:28.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.969+0000 7f7bec8ab640 1 -- 172.21.15.123:0/2739655327 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 848701949 0 0) 0x7f7be8071180 con 0x7f7be815bcf0 2024-09-15T23:19:28.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.969+0000 7f7bec8ab640 1 -- 172.21.15.123:0/2739655327 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bd4003520 con 0x7f7be815bcf0 2024-09-15T23:19:28.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.969+0000 7f7bed8ad640 1 -- 172.21.15.123:0/2739655327 >> v2:172.21.15.188:3300/0 conn(0x7f7be813eb20 msgr2=0x7f7be806c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:28.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.969+0000 7f7bed8ad640 1 --2- 172.21.15.123:0/2739655327 >> v2:172.21.15.188:3300/0 conn(0x7f7be813eb20 0x7f7be806c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:28.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.969+0000 7f7bed8ad640 1 -- 172.21.15.123:0/2739655327 >> v1:172.21.15.188:6789/0 conn(0x7f7be815bcf0 legacy=0x7f7be815c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:28.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.969+0000 7f7bed8ad640 1 -- 172.21.15.123:0/2739655327 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be8071740 con 0x7f7be80b2d40 2024-09-15T23:19:28.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.970+0000 7f7bed8ad640 1 --2- 172.21.15.123:0/2739655327 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7be80b2d40 0x7f7be806bc10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7be8071c30 tx=0x7f7be402c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d65e293ba654ca13 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:28.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.970+0000 7f7bec8ab640 1 -- 172.21.15.123:0/2739655327 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be4009600 con 0x7f7be80b2d40 2024-09-15T23:19:28.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.970+0000 7f7bec8ab640 1 -- 172.21.15.123:0/2739655327 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7be4037070 con 0x7f7be80b2d40 2024-09-15T23:19:28.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.970+0000 7f7bec8ab640 1 -- 172.21.15.123:0/2739655327 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be40099a0 con 0x7f7be80b2d40 2024-09-15T23:19:28.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.970+0000 7f7befb11640 1 -- 172.21.15.123:0/2739655327 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7be80b2d40 msgr2=0x7f7be806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:28.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.970+0000 7f7befb11640 1 --2- 172.21.15.123:0/2739655327 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7be80b2d40 0x7f7be806bc10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7be8071c30 tx=0x7f7be402c910 comp rx=0 tx=0).stop 2024-09-15T23:19:28.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.970+0000 7f7befb11640 1 -- 172.21.15.123:0/2739655327 shutdown_connections 2024-09-15T23:19:28.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.970+0000 7f7befb11640 1 --2- 172.21.15.123:0/2739655327 >> v2:172.21.15.188:3300/0 conn(0x7f7be813eb20 0x7f7be806c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:28.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.970+0000 7f7befb11640 1 --2- 172.21.15.123:0/2739655327 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7be80b2d40 0x7f7be806bc10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:28.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.970+0000 7f7befb11640 1 -- 172.21.15.123:0/2739655327 >> 172.21.15.123:0/2739655327 conn(0x7f7be80ccec0 msgr2=0x7f7be80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:28.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.970+0000 7f7befb11640 1 -- 172.21.15.123:0/2739655327 shutdown_connections 2024-09-15T23:19:28.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.970+0000 7f7befb11640 1 -- 172.21.15.123:0/2739655327 wait complete. 2024-09-15T23:19:28.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.971+0000 7f7befb11640 1 Processor -- start 2024-09-15T23:19:28.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.972+0000 7f7befb11640 1 -- start start 2024-09-15T23:19:28.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.972+0000 7f7befb11640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7be80b2d40 0x7f7be812ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:28.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.972+0000 7f7befb11640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7be813eb20 0x7f7be815cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:28.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.972+0000 7f7befb11640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7be815bcf0 0x7f7be813d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:28.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.972+0000 7f7befb11640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7be80722d0 con 0x7f7be813eb20 2024-09-15T23:19:28.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.972+0000 7f7befb11640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7be8072150 con 0x7f7be815bcf0 2024-09-15T23:19:28.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.972+0000 7f7befb11640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7be8072450 con 0x7f7be80b2d40 2024-09-15T23:19:28.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.972+0000 7f7bed0ac640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7be813eb20 0x7f7be815cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:28.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.972+0000 7f7bed0ac640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7be813eb20 0x7f7be815cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41384/0 (socket says 172.21.15.123:41384) 2024-09-15T23:19:28.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.972+0000 7f7bed0ac640 1 -- 172.21.15.123:0/1132888208 learned_addr learned my addr 172.21.15.123:0/1132888208 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:28.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.972+0000 7f7bee0ae640 1 --2- 172.21.15.123:0/1132888208 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7be815bcf0 0x7f7be813d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:28.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.972+0000 7f7bed8ad640 1 --2- 172.21.15.123:0/1132888208 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7be80b2d40 0x7f7be812ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:28.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.973+0000 7f7bed0ac640 1 -- 172.21.15.123:0/1132888208 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7be80b2d40 msgr2=0x7f7be812ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:28.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.973+0000 7f7bed0ac640 1 --2- 172.21.15.123:0/1132888208 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7be80b2d40 0x7f7be812ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:28.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.973+0000 7f7bed0ac640 1 -- 172.21.15.123:0/1132888208 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7be815bcf0 msgr2=0x7f7be813d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:28.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.973+0000 7f7bed0ac640 1 --2- 172.21.15.123:0/1132888208 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7be815bcf0 0x7f7be813d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:28.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.973+0000 7f7bed0ac640 1 -- 172.21.15.123:0/1132888208 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be80b4740 con 0x7f7be813eb20 2024-09-15T23:19:28.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.973+0000 7f7bed0ac640 1 --2- 172.21.15.123:0/1132888208 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7be813eb20 0x7f7be815cd30 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800e980 tx=0x7f7bd800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:28.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.973+0000 7f7bde7fc640 1 -- 172.21.15.123:0/1132888208 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8017070 con 0x7f7be813eb20 2024-09-15T23:19:28.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.973+0000 7f7bde7fc640 1 -- 172.21.15.123:0/1132888208 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bd800ca00 con 0x7f7be813eb20 2024-09-15T23:19:28.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.973+0000 7f7befb11640 1 -- 172.21.15.123:0/1132888208 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7be8131d20 con 0x7f7be813eb20 2024-09-15T23:19:28.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.973+0000 7f7bde7fc640 1 -- 172.21.15.123:0/1132888208 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd800cdd0 con 0x7f7be813eb20 2024-09-15T23:19:28.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.973+0000 7f7befb11640 1 -- 172.21.15.123:0/1132888208 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7be80b4ce0 con 0x7f7be813eb20 2024-09-15T23:19:28.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.974+0000 7f7befb11640 1 -- 172.21.15.123:0/1132888208 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7be8072890 con 0x7f7be813eb20 2024-09-15T23:19:28.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.974+0000 7f7bde7fc640 1 -- 172.21.15.123:0/1132888208 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7bd801a070 con 0x7f7be813eb20 2024-09-15T23:19:28.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.975+0000 7f7bde7fc640 1 --2- 172.21.15.123:0/1132888208 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7bcc06c2e0 0x7f7bcc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:28.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.975+0000 7f7bde7fc640 1 -- 172.21.15.123:0/1132888208 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 4943+0+0 (secure 0 0 0) 0x7f7bd808b030 con 0x7f7be813eb20 2024-09-15T23:19:28.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.975+0000 7f7bed8ad640 1 --2- 172.21.15.123:0/1132888208 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7bcc06c2e0 0x7f7bcc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:28.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.976+0000 7f7bed8ad640 1 --2- 172.21.15.123:0/1132888208 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7bcc06c2e0 0x7f7bcc06e7a0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f7be4036000 tx=0x7f7be400b000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:28.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:28.979+0000 7f7bde7fc640 1 -- 172.21.15.123:0/1132888208 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7bd8059460 con 0x7f7be813eb20 2024-09-15T23:19:29.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.229+0000 7f7befb11640 1 -- 172.21.15.123:0/1132888208 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]} v 0) -- 0x7f7be806c9c0 con 0x7f7be813eb20 2024-09-15T23:19:29.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.536+0000 7f7bde7fc640 1 -- 172.21.15.123:0/1132888208 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]}]=0 v362) ==== 144+0+0 (secure 0 0 0) 0x7f7bd805d760 con 0x7f7be813eb20 2024-09-15T23:19:29.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.538+0000 7f7befb11640 1 -- 172.21.15.123:0/1132888208 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7bcc06c2e0 msgr2=0x7f7bcc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:29.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.538+0000 7f7befb11640 1 --2- 172.21.15.123:0/1132888208 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7bcc06c2e0 0x7f7bcc06e7a0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f7be4036000 tx=0x7f7be400b000 comp rx=0 tx=0).stop 2024-09-15T23:19:29.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.538+0000 7f7befb11640 1 -- 172.21.15.123:0/1132888208 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7be813eb20 msgr2=0x7f7be815cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:29.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.538+0000 7f7befb11640 1 --2- 172.21.15.123:0/1132888208 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7be813eb20 0x7f7be815cd30 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800e980 tx=0x7f7bd800ee40 comp rx=0 tx=0).stop 2024-09-15T23:19:29.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.538+0000 7f7befb11640 1 -- 172.21.15.123:0/1132888208 shutdown_connections 2024-09-15T23:19:29.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.538+0000 7f7befb11640 1 --2- 172.21.15.123:0/1132888208 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7be815bcf0 0x7f7be813d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:29.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.538+0000 7f7befb11640 1 --2- 172.21.15.123:0/1132888208 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7bcc06c2e0 0x7f7bcc06e7a0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:29.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.538+0000 7f7befb11640 1 --2- 172.21.15.123:0/1132888208 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7be813eb20 0x7f7be815cd30 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:29.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.538+0000 7f7befb11640 1 --2- 172.21.15.123:0/1132888208 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7be80b2d40 0x7f7be812ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:29.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.538+0000 7f7befb11640 1 -- 172.21.15.123:0/1132888208 >> 172.21.15.123:0/1132888208 conn(0x7f7be80ccec0 msgr2=0x7f7be8140130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:29.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.538+0000 7f7befb11640 1 -- 172.21.15.123:0/1132888208 shutdown_connections 2024-09-15T23:19:29.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.538+0000 7f7befb11640 1 -- 172.21.15.123:0/1132888208 wait complete. 2024-09-15T23:19:29.552 INFO:tasks.cephfs_test_runner:test_scrub_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-15T23:19:29.552 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-15T23:19:29.552 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:19:29.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.649+0000 7f0cd2fa2640 1 Processor -- start 2024-09-15T23:19:29.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.650+0000 7f0cd2fa2640 1 -- start start 2024-09-15T23:19:29.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.650+0000 7f0cd2fa2640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0ccc0d1c10 0x7f0ccc160070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:29.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.650+0000 7f0cd2fa2640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ccc073430 0x7f0ccc073b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:29.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.650+0000 7f0cd2fa2640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f0ccc06f140 0x7f0ccc06f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:29.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.650+0000 7f0cd2fa2640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f0ccc074050 con 0x7f0ccc0d1c10 2024-09-15T23:19:29.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.650+0000 7f0cd2fa2640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f0ccc0c87d0 con 0x7f0ccc06f140 2024-09-15T23:19:29.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.650+0000 7f0cd2fa2640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0ccc0c8ab0 con 0x7f0ccc073430 2024-09-15T23:19:29.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.651+0000 7f0cd1fa0640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0ccc0d1c10 0x7f0ccc160070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:29.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.651+0000 7f0cd1fa0640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0ccc0d1c10 0x7f0ccc160070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41390/0 (socket says 172.21.15.123:41390) 2024-09-15T23:19:29.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.651+0000 7f0cd1fa0640 1 -- 172.21.15.123:0/4191780350 learned_addr learned my addr 172.21.15.123:0/4191780350 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:29.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.651+0000 7f0cd179f640 1 --2- 172.21.15.123:0/4191780350 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ccc073430 0x7f0ccc073b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:29.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.651+0000 7f0cd27a1640 1 --2- 172.21.15.123:0/4191780350 >> v2:172.21.15.188:3300/0 conn(0x7f0ccc06f140 0x7f0ccc06f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:29.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.651+0000 7f0cd1fa0640 1 -- 172.21.15.123:0/4191780350 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ccc073430 msgr2=0x7f0ccc073b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:29.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.651+0000 7f0cd1fa0640 1 --2- 172.21.15.123:0/4191780350 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ccc073430 0x7f0ccc073b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:29.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.651+0000 7f0cd1fa0640 1 -- 172.21.15.123:0/4191780350 >> v2:172.21.15.188:3300/0 conn(0x7f0ccc06f140 msgr2=0x7f0ccc06f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:29.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.651+0000 7f0cd1fa0640 1 --2- 172.21.15.123:0/4191780350 >> v2:172.21.15.188:3300/0 conn(0x7f0ccc06f140 0x7f0ccc06f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:29.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.651+0000 7f0cd1fa0640 1 -- 172.21.15.123:0/4191780350 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ccc0c8d90 con 0x7f0ccc0d1c10 2024-09-15T23:19:29.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.652+0000 7f0cd1fa0640 1 --2- 172.21.15.123:0/4191780350 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ccc0d1c10 0x7f0ccc160070 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc070470 tx=0x7f0cc402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca1abba999c55b4b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:29.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.652+0000 7f0cd0f9e640 1 -- 172.21.15.123:0/4191780350 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc4037070 con 0x7f0ccc0d1c10 2024-09-15T23:19:29.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.652+0000 7f0cd0f9e640 1 -- 172.21.15.123:0/4191780350 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cc402ae00 con 0x7f0ccc0d1c10 2024-09-15T23:19:29.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.652+0000 7f0cd0f9e640 1 -- 172.21.15.123:0/4191780350 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc4032660 con 0x7f0ccc0d1c10 2024-09-15T23:19:29.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.652+0000 7f0cd2fa2640 1 -- 172.21.15.123:0/4191780350 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ccc0d1c10 msgr2=0x7f0ccc160070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:29.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.652+0000 7f0cd2fa2640 1 --2- 172.21.15.123:0/4191780350 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ccc0d1c10 0x7f0ccc160070 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc070470 tx=0x7f0cc402a0b0 comp rx=0 tx=0).stop 2024-09-15T23:19:29.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.652+0000 7f0cd2fa2640 1 -- 172.21.15.123:0/4191780350 shutdown_connections 2024-09-15T23:19:29.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.652+0000 7f0cd2fa2640 1 --2- 172.21.15.123:0/4191780350 >> v2:172.21.15.188:3300/0 conn(0x7f0ccc06f140 0x7f0ccc06f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:29.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.652+0000 7f0cd2fa2640 1 --2- 172.21.15.123:0/4191780350 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ccc073430 0x7f0ccc073b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:29.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.652+0000 7f0cd2fa2640 1 --2- 172.21.15.123:0/4191780350 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ccc0d1c10 0x7f0ccc160070 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:29.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.652+0000 7f0cd2fa2640 1 -- 172.21.15.123:0/4191780350 >> 172.21.15.123:0/4191780350 conn(0x7f0ccc0d2480 msgr2=0x7f0ccc0d2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:29.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.652+0000 7f0cd2fa2640 1 -- 172.21.15.123:0/4191780350 shutdown_connections 2024-09-15T23:19:29.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.652+0000 7f0cd2fa2640 1 -- 172.21.15.123:0/4191780350 wait complete. 2024-09-15T23:19:29.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.654+0000 7f0cd2fa2640 1 Processor -- start 2024-09-15T23:19:29.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.654+0000 7f0cd2fa2640 1 -- start start 2024-09-15T23:19:29.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.654+0000 7f0cd2fa2640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ccc06f140 0x7f0ccc06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:29.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.654+0000 7f0cd2fa2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ccc073430 0x7f0ccc15f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:29.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.654+0000 7f0cd2fa2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ccc0d1c10 0x7f0ccc15c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:29.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.654+0000 7f0cd2fa2640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0ccc0c8480 con 0x7f0ccc073430 2024-09-15T23:19:29.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.654+0000 7f0cd2fa2640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0ccc0d1ff0 con 0x7f0ccc0d1c10 2024-09-15T23:19:29.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.654+0000 7f0cd2fa2640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0ccc070780 con 0x7f0ccc06f140 2024-09-15T23:19:29.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.654+0000 7f0cd179f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ccc073430 0x7f0ccc15f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:29.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.654+0000 7f0cd179f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ccc073430 0x7f0ccc15f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41398/0 (socket says 172.21.15.123:41398) 2024-09-15T23:19:29.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.654+0000 7f0cd179f640 1 -- 172.21.15.123:0/4053840479 learned_addr learned my addr 172.21.15.123:0/4053840479 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:29.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.655+0000 7f0cd1fa0640 1 --2- 172.21.15.123:0/4053840479 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ccc06f140 0x7f0ccc06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:29.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.655+0000 7f0cd27a1640 1 --2- 172.21.15.123:0/4053840479 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ccc0d1c10 0x7f0ccc15c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:29.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.655+0000 7f0cd179f640 1 -- 172.21.15.123:0/4053840479 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ccc06f140 msgr2=0x7f0ccc06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:29.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.655+0000 7f0cd179f640 1 --2- 172.21.15.123:0/4053840479 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ccc06f140 0x7f0ccc06cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:29.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.655+0000 7f0cd179f640 1 -- 172.21.15.123:0/4053840479 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ccc0d1c10 msgr2=0x7f0ccc15c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:29.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.655+0000 7f0cd179f640 1 --2- 172.21.15.123:0/4053840479 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ccc0d1c10 0x7f0ccc15c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:29.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.655+0000 7f0cd179f640 1 -- 172.21.15.123:0/4053840479 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ccc06d3b0 con 0x7f0ccc073430 2024-09-15T23:19:29.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.655+0000 7f0cd27a1640 1 --2- 172.21.15.123:0/4053840479 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ccc0d1c10 0x7f0ccc15c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:19:29.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.655+0000 7f0cd179f640 1 --2- 172.21.15.123:0/4053840479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ccc073430 0x7f0ccc15f4f0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc00d800 tx=0x7f0cbc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:29.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.655+0000 7f0cc27fc640 1 -- 172.21.15.123:0/4053840479 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc00b6c0 con 0x7f0ccc073430 2024-09-15T23:19:29.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.655+0000 7f0cc27fc640 1 -- 172.21.15.123:0/4053840479 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cbc019070 con 0x7f0ccc073430 2024-09-15T23:19:29.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.655+0000 7f0cc27fc640 1 -- 172.21.15.123:0/4053840479 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc00ba80 con 0x7f0ccc073430 2024-09-15T23:19:29.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.655+0000 7f0cd2fa2640 1 -- 172.21.15.123:0/4053840479 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ccc06d690 con 0x7f0ccc073430 2024-09-15T23:19:29.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.655+0000 7f0cd2fa2640 1 -- 172.21.15.123:0/4053840479 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ccc06dc50 con 0x7f0ccc073430 2024-09-15T23:19:29.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.656+0000 7f0cd2fa2640 1 -- 172.21.15.123:0/4053840479 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ccc0701c0 con 0x7f0ccc073430 2024-09-15T23:19:29.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.657+0000 7f0cc27fc640 1 -- 172.21.15.123:0/4053840479 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0cbc00bc20 con 0x7f0ccc073430 2024-09-15T23:19:29.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.657+0000 7f0cc27fc640 1 --2- 172.21.15.123:0/4053840479 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0cb006c2b0 0x7f0cb006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:29.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.657+0000 7f0cc27fc640 1 -- 172.21.15.123:0/4053840479 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 4943+0+0 (secure 0 0 0) 0x7f0cbc08b560 con 0x7f0ccc073430 2024-09-15T23:19:29.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.657+0000 7f0cd1fa0640 1 --2- 172.21.15.123:0/4053840479 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0cb006c2b0 0x7f0cb006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:29.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.658+0000 7f0cd1fa0640 1 --2- 172.21.15.123:0/4053840479 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0cb006c2b0 0x7f0cb006e770 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0cc4034000 tx=0x7f0cc402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:29.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.661+0000 7f0cc27fc640 1 -- 172.21.15.123:0/4053840479 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0cbc059fd0 con 0x7f0ccc073430 2024-09-15T23:19:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.828+0000 7f0cd2fa2640 1 -- 172.21.15.123:0/4053840479 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ccc0d2e80 con 0x7f0ccc073430 2024-09-15T23:19:29.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.829+0000 7f0cc27fc640 1 -- 172.21.15.123:0/4053840479 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v133) ==== 74+0+13068 (secure 0 0 0) 0x7f0cbc08b030 con 0x7f0ccc073430 2024-09-15T23:19:29.831 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:19:29.831 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":133,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:19:28.532214+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.188:6837/3551744094":"2024-09-16T23:19:25.524618+0000","172.21.15.188:6835/3551744094":"2024-09-16T23:19:25.524618+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:19:29.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.831+0000 7f0cd2fa2640 1 -- 172.21.15.123:0/4053840479 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0cb006c2b0 msgr2=0x7f0cb006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:29.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.831+0000 7f0cd2fa2640 1 --2- 172.21.15.123:0/4053840479 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0cb006c2b0 0x7f0cb006e770 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0cc4034000 tx=0x7f0cc402e000 comp rx=0 tx=0).stop 2024-09-15T23:19:29.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.831+0000 7f0cd2fa2640 1 -- 172.21.15.123:0/4053840479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ccc073430 msgr2=0x7f0ccc15f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:29.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.831+0000 7f0cd2fa2640 1 --2- 172.21.15.123:0/4053840479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ccc073430 0x7f0ccc15f4f0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc00d800 tx=0x7f0cbc00dcc0 comp rx=0 tx=0).stop 2024-09-15T23:19:29.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.831+0000 7f0cd2fa2640 1 -- 172.21.15.123:0/4053840479 shutdown_connections 2024-09-15T23:19:29.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.831+0000 7f0cd2fa2640 1 --2- 172.21.15.123:0/4053840479 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0ccc0d1c10 0x7f0ccc15c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:29.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.831+0000 7f0cd2fa2640 1 --2- 172.21.15.123:0/4053840479 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0cb006c2b0 0x7f0cb006e770 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:29.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.831+0000 7f0cd2fa2640 1 --2- 172.21.15.123:0/4053840479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ccc073430 0x7f0ccc15f4f0 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:29.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.831+0000 7f0cd2fa2640 1 --2- 172.21.15.123:0/4053840479 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0ccc06f140 0x7f0ccc06cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:29.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.831+0000 7f0cd2fa2640 1 -- 172.21.15.123:0/4053840479 >> 172.21.15.123:0/4053840479 conn(0x7f0ccc0d2480 msgr2=0x7f0ccc0b2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:29.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.831+0000 7f0cd2fa2640 1 -- 172.21.15.123:0/4053840479 shutdown_connections 2024-09-15T23:19:29.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.831+0000 7f0cd2fa2640 1 -- 172.21.15.123:0/4053840479 wait complete. 2024-09-15T23:19:29.845 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T23:12:01.531886+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T23:19:29.846 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T23:19:29.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.944+0000 7fec0f53b640 1 Processor -- start 2024-09-15T23:19:29.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.945+0000 7fec0f53b640 1 -- start start 2024-09-15T23:19:29.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.945+0000 7fec0f53b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fec08158c80 0x7fec08162230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:29.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.945+0000 7fec0f53b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fec0806c320 0x7fec080729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:29.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.945+0000 7fec0f53b640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec08144090 con 0x7fec080afb90 2024-09-15T23:19:29.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.945+0000 7fec0f53b640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fec08141a00 con 0x7fec08158c80 2024-09-15T23:19:29.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.945+0000 7fec0f53b640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fec08072f10 con 0x7fec0806c320 2024-09-15T23:19:29.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.946+0000 7fec0d2d7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fec08158c80 0x7fec08162230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:29.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.946+0000 7fec0cad6640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fec080afb90 0x7fec0806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:33756/0 (socket says 172.21.15.123:33756) 2024-09-15T23:19:29.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.946+0000 7fec0d2d7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fec08158c80 0x7fec08162230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41412/0 (socket says 172.21.15.123:41412) 2024-09-15T23:19:29.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.946+0000 7fec0cad6640 1 -- 172.21.15.123:0/3028666965 learned_addr learned my addr 172.21.15.123:0/3028666965 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:19:29.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.946+0000 7fec0dad8640 1 --2- 172.21.15.123:0/3028666965 >> v2:172.21.15.188:3300/0 conn(0x7fec0806c320 0x7fec080729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:29.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.946+0000 7fec0d2d7640 1 -- 172.21.15.123:0/3028666965 >> v2:172.21.15.188:3300/0 conn(0x7fec0806c320 msgr2=0x7fec080729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:29.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.946+0000 7fec0d2d7640 1 --2- 172.21.15.123:0/3028666965 >> v2:172.21.15.188:3300/0 conn(0x7fec0806c320 0x7fec080729d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:29.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.946+0000 7fec0d2d7640 1 -- 172.21.15.123:0/3028666965 >> v1:172.21.15.123:6789/0 conn(0x7fec080afb90 legacy=0x7fec0806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:29.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.946+0000 7febfffff640 1 -- 172.21.15.123:0/3028666965 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 777093821 0 0) 0x7fec08144090 con 0x7fec080afb90 2024-09-15T23:19:29.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.946+0000 7fec0d2d7640 1 -- 172.21.15.123:0/3028666965 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec08144370 con 0x7fec08158c80 2024-09-15T23:19:29.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.947+0000 7fec0d2d7640 1 --2- 172.21.15.123:0/3028666965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec08158c80 0x7fec08162230 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fec0815ec40 tx=0x7fec0402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7988de142b68343 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:29.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.947+0000 7febfffff640 1 -- 172.21.15.123:0/3028666965 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec04037070 con 0x7fec08158c80 2024-09-15T23:19:29.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.947+0000 7febfffff640 1 -- 172.21.15.123:0/3028666965 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec04032440 con 0x7fec08158c80 2024-09-15T23:19:29.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.947+0000 7febfffff640 1 -- 172.21.15.123:0/3028666965 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec04032810 con 0x7fec08158c80 2024-09-15T23:19:29.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.947+0000 7fec0f53b640 1 -- 172.21.15.123:0/3028666965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec08158c80 msgr2=0x7fec08162230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:29.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.947+0000 7fec0f53b640 1 --2- 172.21.15.123:0/3028666965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec08158c80 0x7fec08162230 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fec0815ec40 tx=0x7fec0402a1a0 comp rx=0 tx=0).stop 2024-09-15T23:19:29.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.947+0000 7fec0f53b640 1 -- 172.21.15.123:0/3028666965 shutdown_connections 2024-09-15T23:19:29.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.947+0000 7fec0f53b640 1 --2- 172.21.15.123:0/3028666965 >> v2:172.21.15.188:3300/0 conn(0x7fec0806c320 0x7fec080729d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:29.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.947+0000 7fec0f53b640 1 --2- 172.21.15.123:0/3028666965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec08158c80 0x7fec08162230 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:29.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.947+0000 7fec0f53b640 1 -- 172.21.15.123:0/3028666965 >> 172.21.15.123:0/3028666965 conn(0x7fec0806cd20 msgr2=0x7fec0806d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:29.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.947+0000 7fec0f53b640 1 -- 172.21.15.123:0/3028666965 shutdown_connections 2024-09-15T23:19:29.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.947+0000 7fec0f53b640 1 -- 172.21.15.123:0/3028666965 wait complete. 2024-09-15T23:19:29.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.949+0000 7fec0f53b640 1 Processor -- start 2024-09-15T23:19:29.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.949+0000 7fec0f53b640 1 -- start start 2024-09-15T23:19:29.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.949+0000 7fec0f53b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec0806c320 0x7fec0815a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:29.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.949+0000 7fec0f53b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fec080afb90 0x7fec0815be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:29.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.949+0000 7fec0f53b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fec08158c80 0x7fec080b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:29.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.949+0000 7fec0f53b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fec08144c10 con 0x7fec0806c320 2024-09-15T23:19:29.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.949+0000 7fec0f53b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fec08144930 con 0x7fec080afb90 2024-09-15T23:19:29.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.949+0000 7fec0f53b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fec08159060 con 0x7fec08158c80 2024-09-15T23:19:29.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.949+0000 7fec0d2d7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec0806c320 0x7fec0815a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:29.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.949+0000 7fec0d2d7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec0806c320 0x7fec0815a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41424/0 (socket says 172.21.15.123:41424) 2024-09-15T23:19:29.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.949+0000 7fec0d2d7640 1 -- 172.21.15.123:0/3384860711 learned_addr learned my addr 172.21.15.123:0/3384860711 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:29.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.949+0000 7fec0cad6640 1 --2- 172.21.15.123:0/3384860711 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fec080afb90 0x7fec0815be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:29.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.950+0000 7fec0dad8640 1 --2- 172.21.15.123:0/3384860711 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fec08158c80 0x7fec080b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:29.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.950+0000 7fec0d2d7640 1 -- 172.21.15.123:0/3384860711 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fec08158c80 msgr2=0x7fec080b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:29.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.950+0000 7fec0d2d7640 1 --2- 172.21.15.123:0/3384860711 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fec08158c80 0x7fec080b2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:29.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.950+0000 7fec0d2d7640 1 -- 172.21.15.123:0/3384860711 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fec080afb90 msgr2=0x7fec0815be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:29.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.950+0000 7fec0d2d7640 1 --2- 172.21.15.123:0/3384860711 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fec080afb90 0x7fec0815be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:29.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.950+0000 7fec0d2d7640 1 -- 172.21.15.123:0/3384860711 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec0815adb0 con 0x7fec0806c320 2024-09-15T23:19:29.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.950+0000 7fec0dad8640 1 --2- 172.21.15.123:0/3384860711 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fec08158c80 0x7fec080b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:19:29.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.950+0000 7fec0d2d7640 1 --2- 172.21.15.123:0/3384860711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec0806c320 0x7fec0815a7d0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fec04000c00 tx=0x7fec040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:29.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.950+0000 7febfdffb640 1 -- 172.21.15.123:0/3384860711 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec04037050 con 0x7fec0806c320 2024-09-15T23:19:29.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.950+0000 7febfdffb640 1 -- 172.21.15.123:0/3384860711 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec04038040 con 0x7fec0806c320 2024-09-15T23:19:29.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.950+0000 7fec0f53b640 1 -- 172.21.15.123:0/3384860711 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec0815b090 con 0x7fec0806c320 2024-09-15T23:19:29.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.950+0000 7febfdffb640 1 -- 172.21.15.123:0/3384860711 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec04006e10 con 0x7fec0806c320 2024-09-15T23:19:29.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.950+0000 7fec0f53b640 1 -- 172.21.15.123:0/3384860711 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec0815b650 con 0x7fec0806c320 2024-09-15T23:19:29.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.951+0000 7fec0f53b640 1 -- 172.21.15.123:0/3384860711 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec08143d20 con 0x7fec0806c320 2024-09-15T23:19:29.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.952+0000 7febfdffb640 1 -- 172.21.15.123:0/3384860711 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fec04030980 con 0x7fec0806c320 2024-09-15T23:19:29.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.952+0000 7febfdffb640 1 --2- 172.21.15.123:0/3384860711 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7febec06c2b0 0x7febec06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:29.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.952+0000 7febfdffb640 1 -- 172.21.15.123:0/3384860711 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 4943+0+0 (secure 0 0 0) 0x7fec040abb60 con 0x7fec0806c320 2024-09-15T23:19:29.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.952+0000 7fec0cad6640 1 --2- 172.21.15.123:0/3384860711 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7febec06c2b0 0x7febec06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:29.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.953+0000 7fec0cad6640 1 --2- 172.21.15.123:0/3384860711 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7febec06c2b0 0x7febec06e770 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7febf8007f70 tx=0x7febf8007f00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:29.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:29.956+0000 7febfdffb640 1 -- 172.21.15.123:0/3384860711 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fec0407a660 con 0x7fec0806c320 2024-09-15T23:19:30.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.120+0000 7fec0f53b640 1 -- 172.21.15.123:0/3384860711 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fec08073860 con 0x7fec0806c320 2024-09-15T23:19:30.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.121+0000 7febfdffb640 1 -- 172.21.15.123:0/3384860711 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v133) ==== 93+0+10 (secure 0 0 0) 0x7fec04079f60 con 0x7fec0806c320 2024-09-15T23:19:30.123 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-15T23:19:30.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.123+0000 7fec0f53b640 1 -- 172.21.15.123:0/3384860711 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7febec06c2b0 msgr2=0x7febec06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:30.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.123+0000 7fec0f53b640 1 --2- 172.21.15.123:0/3384860711 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7febec06c2b0 0x7febec06e770 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7febf8007f70 tx=0x7febf8007f00 comp rx=0 tx=0).stop 2024-09-15T23:19:30.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.123+0000 7fec0f53b640 1 -- 172.21.15.123:0/3384860711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec0806c320 msgr2=0x7fec0815a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:30.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.123+0000 7fec0f53b640 1 --2- 172.21.15.123:0/3384860711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec0806c320 0x7fec0815a7d0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fec04000c00 tx=0x7fec040046c0 comp rx=0 tx=0).stop 2024-09-15T23:19:30.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.123+0000 7fec0f53b640 1 -- 172.21.15.123:0/3384860711 shutdown_connections 2024-09-15T23:19:30.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.123+0000 7fec0f53b640 1 --2- 172.21.15.123:0/3384860711 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fec08158c80 0x7fec080b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:30.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.123+0000 7fec0f53b640 1 --2- 172.21.15.123:0/3384860711 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fec080afb90 0x7fec0815be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:30.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.123+0000 7fec0f53b640 1 --2- 172.21.15.123:0/3384860711 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7febec06c2b0 0x7febec06e770 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:30.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.123+0000 7fec0f53b640 1 --2- 172.21.15.123:0/3384860711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec0806c320 0x7fec0815a7d0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:30.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.123+0000 7fec0f53b640 1 -- 172.21.15.123:0/3384860711 >> 172.21.15.123:0/3384860711 conn(0x7fec0806cd20 msgr2=0x7fec08142c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:30.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.123+0000 7fec0f53b640 1 -- 172.21.15.123:0/3384860711 shutdown_connections 2024-09-15T23:19:30.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.123+0000 7fec0f53b640 1 -- 172.21.15.123:0/3384860711 wait complete. 2024-09-15T23:19:30.136 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume' 2024-09-15T23:19:30.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.233+0000 7f6439798640 1 Processor -- start 2024-09-15T23:19:30.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.233+0000 7f6439798640 1 -- start start 2024-09-15T23:19:30.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.234+0000 7f6439798640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f64340b6970 0x7f64340b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:30.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.234+0000 7f6439798640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f64340d23b0 0x7f64340b8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:30.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.234+0000 7f6439798640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64340d0e70 con 0x7f643415ed20 2024-09-15T23:19:30.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.234+0000 7f6439798640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f64340d41c0 con 0x7f64340b6970 2024-09-15T23:19:30.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.234+0000 7f6439798640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f64340d35b0 con 0x7f64340d23b0 2024-09-15T23:19:30.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.234+0000 7f64327fc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f64340b6970 0x7f64340b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:30.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.234+0000 7f64327fc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f64340b6970 0x7f64340b80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41438/0 (socket says 172.21.15.123:41438) 2024-09-15T23:19:30.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.234+0000 7f64327fc640 1 -- 172.21.15.123:0/2804359543 learned_addr learned my addr 172.21.15.123:0/2804359543 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:30.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.234+0000 7f64337fe640 1 --2- 172.21.15.123:0/2804359543 >> v2:172.21.15.188:3300/0 conn(0x7f64340d23b0 0x7f64340b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:30.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.234+0000 7f64327fc640 1 -- 172.21.15.123:0/2804359543 >> v2:172.21.15.188:3300/0 conn(0x7f64340d23b0 msgr2=0x7f64340b8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:30.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.234+0000 7f64327fc640 1 --2- 172.21.15.123:0/2804359543 >> v2:172.21.15.188:3300/0 conn(0x7f64340d23b0 0x7f64340b8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:30.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.234+0000 7f64327fc640 1 -- 172.21.15.123:0/2804359543 >> v1:172.21.15.188:6789/0 conn(0x7f643415ed20 legacy=0x7f64340b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:30.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.234+0000 7f64327fc640 1 -- 172.21.15.123:0/2804359543 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64340d3890 con 0x7f64340b6970 2024-09-15T23:19:30.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.234+0000 7f64337fe640 1 --2- 172.21.15.123:0/2804359543 >> v2:172.21.15.188:3300/0 conn(0x7f64340d23b0 0x7f64340b8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:19:30.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.235+0000 7f64327fc640 1 --2- 172.21.15.123:0/2804359543 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64340b6970 0x7f64340b80d0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f64340d4130 tx=0x7f642802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bcca56c21cf6991 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:30.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.235+0000 7f6431ffb640 1 -- 172.21.15.123:0/2804359543 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6428037070 con 0x7f64340b6970 2024-09-15T23:19:30.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.235+0000 7f6431ffb640 1 -- 172.21.15.123:0/2804359543 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6428032440 con 0x7f64340b6970 2024-09-15T23:19:30.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.235+0000 7f6431ffb640 1 -- 172.21.15.123:0/2804359543 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6428032810 con 0x7f64340b6970 2024-09-15T23:19:30.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.236+0000 7f6439798640 1 -- 172.21.15.123:0/2804359543 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64340b6970 msgr2=0x7f64340b80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:30.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.236+0000 7f6439798640 1 --2- 172.21.15.123:0/2804359543 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64340b6970 0x7f64340b80d0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f64340d4130 tx=0x7f642802a1a0 comp rx=0 tx=0).stop 2024-09-15T23:19:30.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.236+0000 7f6439798640 1 -- 172.21.15.123:0/2804359543 shutdown_connections 2024-09-15T23:19:30.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.236+0000 7f6439798640 1 --2- 172.21.15.123:0/2804359543 >> v2:172.21.15.188:3300/0 conn(0x7f64340d23b0 0x7f64340b8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:30.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.236+0000 7f6439798640 1 --2- 172.21.15.123:0/2804359543 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64340b6970 0x7f64340b80d0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:30.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.236+0000 7f6439798640 1 -- 172.21.15.123:0/2804359543 >> 172.21.15.123:0/2804359543 conn(0x7f64340d1260 msgr2=0x7f64340d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:30.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.236+0000 7f6439798640 1 -- 172.21.15.123:0/2804359543 shutdown_connections 2024-09-15T23:19:30.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.236+0000 7f6439798640 1 -- 172.21.15.123:0/2804359543 wait complete. 2024-09-15T23:19:30.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.237+0000 7f6439798640 1 Processor -- start 2024-09-15T23:19:30.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.237+0000 7f6439798640 1 -- start start 2024-09-15T23:19:30.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.238+0000 7f6439798640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f64340b6970 0x7f6434154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:30.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.238+0000 7f6439798640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64340d23b0 0x7f6434161920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:30.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.238+0000 7f6439798640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f643415ed20 0x7f6434161e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:30.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.238+0000 7f6439798640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f64340d32a0 con 0x7f64340d23b0 2024-09-15T23:19:30.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.238+0000 7f6439798640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f64340d3e50 con 0x7f64340b6970 2024-09-15T23:19:30.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.238+0000 7f6439798640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f643415f100 con 0x7f643415ed20 2024-09-15T23:19:30.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.238+0000 7f64327fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64340d23b0 0x7f6434161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:30.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.238+0000 7f64327fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64340d23b0 0x7f6434161920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41444/0 (socket says 172.21.15.123:41444) 2024-09-15T23:19:30.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.238+0000 7f64327fc640 1 -- 172.21.15.123:0/3758083253 learned_addr learned my addr 172.21.15.123:0/3758083253 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:30.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.238+0000 7f6432ffd640 1 --2- 172.21.15.123:0/3758083253 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f64340b6970 0x7f6434154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:30.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.238+0000 7f64337fe640 1 --2- 172.21.15.123:0/3758083253 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f643415ed20 0x7f6434161e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:30.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.238+0000 7f64327fc640 1 -- 172.21.15.123:0/3758083253 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f643415ed20 msgr2=0x7f6434161e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:30.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.238+0000 7f64327fc640 1 --2- 172.21.15.123:0/3758083253 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f643415ed20 0x7f6434161e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:30.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.238+0000 7f64327fc640 1 -- 172.21.15.123:0/3758083253 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f64340b6970 msgr2=0x7f6434154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:30.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.238+0000 7f64327fc640 1 --2- 172.21.15.123:0/3758083253 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f64340b6970 0x7f6434154600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:30.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.238+0000 7f64327fc640 1 -- 172.21.15.123:0/3758083253 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6434161530 con 0x7f64340d23b0 2024-09-15T23:19:30.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.238+0000 7f64327fc640 1 --2- 172.21.15.123:0/3758083253 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64340d23b0 0x7f6434161920 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f6428000c00 tx=0x7f64280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:30.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.238+0000 7f641b7fe640 1 -- 172.21.15.123:0/3758083253 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6428041020 con 0x7f64340d23b0 2024-09-15T23:19:30.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.238+0000 7f641b7fe640 1 -- 172.21.15.123:0/3758083253 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6428030970 con 0x7f64340d23b0 2024-09-15T23:19:30.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.238+0000 7f6439798640 1 -- 172.21.15.123:0/3758083253 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64341f8300 con 0x7f64340d23b0 2024-09-15T23:19:30.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.238+0000 7f641b7fe640 1 -- 172.21.15.123:0/3758083253 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6428037040 con 0x7f64340d23b0 2024-09-15T23:19:30.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.238+0000 7f6439798640 1 -- 172.21.15.123:0/3758083253 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64341f88c0 con 0x7f64340d23b0 2024-09-15T23:19:30.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.240+0000 7f6439798640 1 -- 172.21.15.123:0/3758083253 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64340b7010 con 0x7f64340d23b0 2024-09-15T23:19:30.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.240+0000 7f641b7fe640 1 -- 172.21.15.123:0/3758083253 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6428044020 con 0x7f64340d23b0 2024-09-15T23:19:30.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.240+0000 7f641b7fe640 1 --2- 172.21.15.123:0/3758083253 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f642006c2b0 0x7f642006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:30.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.240+0000 7f641b7fe640 1 -- 172.21.15.123:0/3758083253 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 4943+0+0 (secure 0 0 0) 0x7f64280abae0 con 0x7f64340d23b0 2024-09-15T23:19:30.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.240+0000 7f6432ffd640 1 --2- 172.21.15.123:0/3758083253 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f642006c2b0 0x7f642006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:30.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.241+0000 7f6432ffd640 1 --2- 172.21.15.123:0/3758083253 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f642006c2b0 0x7f642006e770 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f6424005520 tx=0x7f6424009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:30.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.244+0000 7f641b7fe640 1 -- 172.21.15.123:0/3758083253 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f642804b030 con 0x7f64340d23b0 2024-09-15T23:19:30.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.472+0000 7f6439798640 1 -- 172.21.15.123:0/3758083253 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]} v 0) -- 0x7f64340b3f20 con 0x7f64340d23b0 2024-09-15T23:19:30.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.541+0000 7f641b7fe640 1 -- 172.21.15.123:0/3758083253 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]}]=0 v363) ==== 158+0+0 (secure 0 0 0) 0x7f64340d0e70 con 0x7f64340d23b0 2024-09-15T23:19:30.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.543+0000 7f6439798640 1 -- 172.21.15.123:0/3758083253 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f642006c2b0 msgr2=0x7f642006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:30.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.543+0000 7f6439798640 1 --2- 172.21.15.123:0/3758083253 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f642006c2b0 0x7f642006e770 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f6424005520 tx=0x7f6424009040 comp rx=0 tx=0).stop 2024-09-15T23:19:30.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.543+0000 7f6439798640 1 -- 172.21.15.123:0/3758083253 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64340d23b0 msgr2=0x7f6434161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:30.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.543+0000 7f6439798640 1 --2- 172.21.15.123:0/3758083253 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64340d23b0 0x7f6434161920 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f6428000c00 tx=0x7f64280046c0 comp rx=0 tx=0).stop 2024-09-15T23:19:30.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.543+0000 7f6439798640 1 -- 172.21.15.123:0/3758083253 shutdown_connections 2024-09-15T23:19:30.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.543+0000 7f6439798640 1 --2- 172.21.15.123:0/3758083253 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f643415ed20 0x7f6434161e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:30.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.544+0000 7f6439798640 1 --2- 172.21.15.123:0/3758083253 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f642006c2b0 0x7f642006e770 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:30.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.544+0000 7f6439798640 1 --2- 172.21.15.123:0/3758083253 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64340d23b0 0x7f6434161920 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:30.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.544+0000 7f6439798640 1 --2- 172.21.15.123:0/3758083253 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f64340b6970 0x7f6434154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:30.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.544+0000 7f6439798640 1 -- 172.21.15.123:0/3758083253 >> 172.21.15.123:0/3758083253 conn(0x7f64340d1260 msgr2=0x7f64340cf0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:30.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.544+0000 7f6439798640 1 -- 172.21.15.123:0/3758083253 shutdown_connections 2024-09-15T23:19:30.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.544+0000 7f6439798640 1 -- 172.21.15.123:0/3758083253 wait complete. 2024-09-15T23:19:30.557 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T23:19:30.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.657+0000 7f9a0c62c640 1 Processor -- start 2024-09-15T23:19:30.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.657+0000 7f9a0c62c640 1 -- start start 2024-09-15T23:19:30.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.658+0000 7f9a0c62c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9a040b5fc0 0x7f9a0415d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:30.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.658+0000 7f9a0c62c640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a040b4310 con 0x7f9a040b3e80 2024-09-15T23:19:30.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.658+0000 7f9a0c62c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a040b45f0 con 0x7f9a04153550 2024-09-15T23:19:30.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.658+0000 7f9a0c62c640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f9a040b48d0 con 0x7f9a040b5fc0 2024-09-15T23:19:30.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.658+0000 7f9a0abc9640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9a040b5fc0 0x7f9a0415d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:30.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.658+0000 7f9a0abc9640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9a040b5fc0 0x7f9a0415d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41460/0 (socket says 172.21.15.123:41460) 2024-09-15T23:19:30.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.658+0000 7f9a0abc9640 1 -- 172.21.15.123:0/1995198298 learned_addr learned my addr 172.21.15.123:0/1995198298 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:30.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.658+0000 7f9a0abc9640 1 -- 172.21.15.123:0/1995198298 >> v1:172.21.15.188:6789/0 conn(0x7f9a04153550 legacy=0x7f9a040b58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:30.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.658+0000 7f9a0abc9640 1 -- 172.21.15.123:0/1995198298 >> v1:172.21.15.123:6789/0 conn(0x7f9a040b3e80 legacy=0x7f9a040cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:30.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.658+0000 7f9a0abc9640 1 -- 172.21.15.123:0/1995198298 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a040b4bb0 con 0x7f9a040b5fc0 2024-09-15T23:19:30.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.659+0000 7f9a0abc9640 1 --2- 172.21.15.123:0/1995198298 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a040b5fc0 0x7f9a0415d5a0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f99fc009e50 tx=0x7f99fc02a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4eda411e7a969fb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:30.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.659+0000 7f9a093c6640 1 -- 172.21.15.123:0/1995198298 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc036070 con 0x7f9a040b5fc0 2024-09-15T23:19:30.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.659+0000 7f9a093c6640 1 -- 172.21.15.123:0/1995198298 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99fc031600 con 0x7f9a040b5fc0 2024-09-15T23:19:30.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.659+0000 7f9a093c6640 1 -- 172.21.15.123:0/1995198298 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc0319d0 con 0x7f9a040b5fc0 2024-09-15T23:19:30.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.659+0000 7f9a0c62c640 1 -- 172.21.15.123:0/1995198298 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a040b5fc0 msgr2=0x7f9a0415d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:30.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.659+0000 7f9a0c62c640 1 --2- 172.21.15.123:0/1995198298 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a040b5fc0 0x7f9a0415d5a0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f99fc009e50 tx=0x7f99fc02a760 comp rx=0 tx=0).stop 2024-09-15T23:19:30.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.659+0000 7f9a0c62c640 1 -- 172.21.15.123:0/1995198298 shutdown_connections 2024-09-15T23:19:30.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.659+0000 7f9a0c62c640 1 --2- 172.21.15.123:0/1995198298 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a040b5fc0 0x7f9a0415d5a0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:30.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.659+0000 7f9a0c62c640 1 -- 172.21.15.123:0/1995198298 >> 172.21.15.123:0/1995198298 conn(0x7f9a0406db30 msgr2=0x7f9a0406df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:30.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.659+0000 7f9a0c62c640 1 -- 172.21.15.123:0/1995198298 shutdown_connections 2024-09-15T23:19:30.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.659+0000 7f9a0c62c640 1 -- 172.21.15.123:0/1995198298 wait complete. 2024-09-15T23:19:30.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.661+0000 7f9a0c62c640 1 Processor -- start 2024-09-15T23:19:30.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.661+0000 7f9a0c62c640 1 -- start start 2024-09-15T23:19:30.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.661+0000 7f9a0c62c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a040b5fc0 0x7f9a04151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:30.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.661+0000 7f9a0c62c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9a04153550 0x7f9a0415f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:30.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.661+0000 7f9a0c62c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9a04152530 0x7f9a04158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:30.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.661+0000 7f9a0c62c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9a04070120 con 0x7f9a040b5fc0 2024-09-15T23:19:30.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.661+0000 7f9a0c62c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9a04153930 con 0x7f9a04152530 2024-09-15T23:19:30.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.661+0000 7f9a0c62c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9a040b53b0 con 0x7f9a04153550 2024-09-15T23:19:30.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.661+0000 7f9a0a3c8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a040b5fc0 0x7f9a04151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:30.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.661+0000 7f9a0a3c8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a040b5fc0 0x7f9a04151ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41464/0 (socket says 172.21.15.123:41464) 2024-09-15T23:19:30.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.661+0000 7f9a0a3c8640 1 -- 172.21.15.123:0/1257461837 learned_addr learned my addr 172.21.15.123:0/1257461837 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:30.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.662+0000 7f9a0a3c8640 1 -- 172.21.15.123:0/1257461837 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9a04153550 msgr2=0x7f9a0415f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:30.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.662+0000 7f9a0a3c8640 1 --2- 172.21.15.123:0/1257461837 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9a04153550 0x7f9a0415f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:30.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.662+0000 7f9a0a3c8640 1 -- 172.21.15.123:0/1257461837 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9a04152530 msgr2=0x7f9a04158b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:30.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.662+0000 7f9a0a3c8640 1 --2- 172.21.15.123:0/1257461837 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9a04152530 0x7f9a04158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:30.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.662+0000 7f9a0a3c8640 1 -- 172.21.15.123:0/1257461837 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a041593a0 con 0x7f9a040b5fc0 2024-09-15T23:19:30.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.662+0000 7f9a0a3c8640 1 --2- 172.21.15.123:0/1257461837 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a040b5fc0 0x7f9a04151ed0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f9a0000b410 tx=0x7f9a0000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:30.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.662+0000 7f99faffd640 1 -- 172.21.15.123:0/1257461837 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a00015020 con 0x7f9a040b5fc0 2024-09-15T23:19:30.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.662+0000 7f99faffd640 1 -- 172.21.15.123:0/1257461837 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a00011830 con 0x7f9a040b5fc0 2024-09-15T23:19:30.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.662+0000 7f99faffd640 1 -- 172.21.15.123:0/1257461837 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a00011c20 con 0x7f9a040b5fc0 2024-09-15T23:19:30.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.662+0000 7f9a0c62c640 1 -- 172.21.15.123:0/1257461837 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a04159680 con 0x7f9a040b5fc0 2024-09-15T23:19:30.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.662+0000 7f9a0c62c640 1 -- 172.21.15.123:0/1257461837 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a04159090 con 0x7f9a040b5fc0 2024-09-15T23:19:30.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.663+0000 7f9a0c62c640 1 -- 172.21.15.123:0/1257461837 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a0415d5a0 con 0x7f9a040b5fc0 2024-09-15T23:19:30.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.663+0000 7f99faffd640 1 -- 172.21.15.123:0/1257461837 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9a00018020 con 0x7f9a040b5fc0 2024-09-15T23:19:30.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.664+0000 7f99faffd640 1 --2- 172.21.15.123:0/1257461837 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f99e806c2e0 0x7f99e806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:30.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.664+0000 7f99faffd640 1 -- 172.21.15.123:0/1257461837 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 4943+0+0 (secure 0 0 0) 0x7f9a0008b0d0 con 0x7f9a040b5fc0 2024-09-15T23:19:30.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.664+0000 7f9a09bc7640 1 --2- 172.21.15.123:0/1257461837 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f99e806c2e0 0x7f99e806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:30.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.665+0000 7f9a09bc7640 1 --2- 172.21.15.123:0/1257461837 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f99e806c2e0 0x7f99e806e7a0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f99f4000f60 tx=0x7f99f40079d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:30.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.668+0000 7f99faffd640 1 -- 172.21.15.123:0/1257461837 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9a0001f020 con 0x7f9a040b5fc0 2024-09-15T23:19:30.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.832+0000 7f9a0c62c640 1 -- 172.21.15.123:0/1257461837 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f9a04159850 con 0x7f9a040b5fc0 2024-09-15T23:19:30.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.836+0000 7f99faffd640 1 -- 172.21.15.123:0/1257461837 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v38)=0 v38) ==== 122+0+0 (secure 0 0 0) 0x7f9a000172c0 con 0x7f9a040b5fc0 2024-09-15T23:19:30.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.838+0000 7f9a0c62c640 1 -- 172.21.15.123:0/1257461837 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f99e806c2e0 msgr2=0x7f99e806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:30.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.838+0000 7f9a0c62c640 1 --2- 172.21.15.123:0/1257461837 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f99e806c2e0 0x7f99e806e7a0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f99f4000f60 tx=0x7f99f40079d0 comp rx=0 tx=0).stop 2024-09-15T23:19:30.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.838+0000 7f9a0c62c640 1 -- 172.21.15.123:0/1257461837 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a040b5fc0 msgr2=0x7f9a04151ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:30.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.838+0000 7f9a0c62c640 1 --2- 172.21.15.123:0/1257461837 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a040b5fc0 0x7f9a04151ed0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f9a0000b410 tx=0x7f9a0000b8d0 comp rx=0 tx=0).stop 2024-09-15T23:19:30.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.838+0000 7f9a0c62c640 1 -- 172.21.15.123:0/1257461837 shutdown_connections 2024-09-15T23:19:30.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.838+0000 7f9a0c62c640 1 --2- 172.21.15.123:0/1257461837 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9a04152530 0x7f9a04158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:30.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.838+0000 7f9a0c62c640 1 --2- 172.21.15.123:0/1257461837 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9a04153550 0x7f9a0415f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:30.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.838+0000 7f9a0c62c640 1 --2- 172.21.15.123:0/1257461837 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f99e806c2e0 0x7f99e806e7a0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:30.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.838+0000 7f9a0c62c640 1 --2- 172.21.15.123:0/1257461837 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a040b5fc0 0x7f9a04151ed0 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:30.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.838+0000 7f9a0c62c640 1 -- 172.21.15.123:0/1257461837 >> 172.21.15.123:0/1257461837 conn(0x7f9a0406db30 msgr2=0x7f9a04074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:30.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.838+0000 7f9a0c62c640 1 -- 172.21.15.123:0/1257461837 shutdown_connections 2024-09-15T23:19:30.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:30.838+0000 7f9a0c62c640 1 -- 172.21.15.123:0/1257461837 wait complete. 2024-09-15T23:19:30.851 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:19:30.851 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:19:30.895 DEBUG:teuthology.orchestra.run.smithi188:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:19:30.944 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:19:30.945 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:19:30.945 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:19:30.961 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:19:30.961 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:19:30.961 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:19:30.979 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:19:30.979 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:19:30.979 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:19:31.018 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:19:31.018 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:19:31.018 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:19:31.038 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:19:31.038 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-15T23:19:31.038 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:19:31.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.154+0000 7f81d8566640 1 Processor -- start 2024-09-15T23:19:31.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.154+0000 7f81d8566640 1 -- start start 2024-09-15T23:19:31.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.155+0000 7f81d8566640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f81d0073890 0x7f81d00b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:31.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.155+0000 7f81d8566640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f81d00b5880 0x7f81d00b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:31.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.155+0000 7f81d8566640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81d00b4020 con 0x7f81d0145ed0 2024-09-15T23:19:31.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.155+0000 7f81d8566640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f81d00b42c0 con 0x7f81d00b5880 2024-09-15T23:19:31.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.155+0000 7f81d8566640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f81d00b45a0 con 0x7f81d0073890 2024-09-15T23:19:31.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.156+0000 7f81d6b03640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f81d00b5880 0x7f81d00b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:31.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.156+0000 7f81d6b03640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f81d00b5880 0x7f81d00b5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41480/0 (socket says 172.21.15.123:41480) 2024-09-15T23:19:31.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.156+0000 7f81d6b03640 1 -- 172.21.15.123:0/1444527392 learned_addr learned my addr 172.21.15.123:0/1444527392 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:31.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.156+0000 7f81d5b01640 1 --2- 172.21.15.123:0/1444527392 >> v2:172.21.15.188:3300/0 conn(0x7f81d0073890 0x7f81d00b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:31.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.156+0000 7f81d6b03640 1 -- 172.21.15.123:0/1444527392 >> v2:172.21.15.188:3300/0 conn(0x7f81d0073890 msgr2=0x7f81d00b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:31.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.156+0000 7f81d6b03640 1 --2- 172.21.15.123:0/1444527392 >> v2:172.21.15.188:3300/0 conn(0x7f81d0073890 0x7f81d00b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:31.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.156+0000 7f81d6b03640 1 -- 172.21.15.123:0/1444527392 >> v1:172.21.15.188:6789/0 conn(0x7f81d0145ed0 legacy=0x7f81d0073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:31.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.156+0000 7f81d6b03640 1 -- 172.21.15.123:0/1444527392 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81d00b4880 con 0x7f81d00b5880 2024-09-15T23:19:31.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.157+0000 7f81d6b03640 1 --2- 172.21.15.123:0/1444527392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81d00b5880 0x7f81d00b5ce0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f81d0070080 tx=0x7f81c002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a21043caab66eb76 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:31.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.157+0000 7f81d5300640 1 -- 172.21.15.123:0/1444527392 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c0036070 con 0x7f81d00b5880 2024-09-15T23:19:31.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.157+0000 7f81d5300640 1 -- 172.21.15.123:0/1444527392 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81c0031600 con 0x7f81d00b5880 2024-09-15T23:19:31.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.157+0000 7f81d5300640 1 -- 172.21.15.123:0/1444527392 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c00319d0 con 0x7f81d00b5880 2024-09-15T23:19:31.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.157+0000 7f81d8566640 1 -- 172.21.15.123:0/1444527392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81d00b5880 msgr2=0x7f81d00b5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:31.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.157+0000 7f81d8566640 1 --2- 172.21.15.123:0/1444527392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81d00b5880 0x7f81d00b5ce0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f81d0070080 tx=0x7f81c002a6c0 comp rx=0 tx=0).stop 2024-09-15T23:19:31.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.157+0000 7f81d8566640 1 -- 172.21.15.123:0/1444527392 shutdown_connections 2024-09-15T23:19:31.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.157+0000 7f81d8566640 1 --2- 172.21.15.123:0/1444527392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81d00b5880 0x7f81d00b5ce0 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:31.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.157+0000 7f81d8566640 1 --2- 172.21.15.123:0/1444527392 >> v2:172.21.15.188:3300/0 conn(0x7f81d0073890 0x7f81d00b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:31.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.157+0000 7f81d8566640 1 -- 172.21.15.123:0/1444527392 >> 172.21.15.123:0/1444527392 conn(0x7f81d00ccec0 msgr2=0x7f81d00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:31.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.157+0000 7f81d8566640 1 -- 172.21.15.123:0/1444527392 shutdown_connections 2024-09-15T23:19:31.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.157+0000 7f81d8566640 1 -- 172.21.15.123:0/1444527392 wait complete. 2024-09-15T23:19:31.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.159+0000 7f81d8566640 1 Processor -- start 2024-09-15T23:19:31.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.159+0000 7f81d8566640 1 -- start start 2024-09-15T23:19:31.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.159+0000 7f81d8566640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81d0073890 0x7f81d01f49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:31.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.159+0000 7f81d8566640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81d00b5880 0x7f81d0140780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:31.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.159+0000 7f81d8566640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f81d0145ed0 0x7f81d0071c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:31.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.159+0000 7f81d8566640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f81d00b63a0 con 0x7f81d00b5880 2024-09-15T23:19:31.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.159+0000 7f81d8566640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f81d00b6220 con 0x7f81d0073890 2024-09-15T23:19:31.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.159+0000 7f81d8566640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f81d01462b0 con 0x7f81d0145ed0 2024-09-15T23:19:31.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.159+0000 7f81d5b01640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81d00b5880 0x7f81d0140780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:31.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.159+0000 7f81d5b01640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81d00b5880 0x7f81d0140780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41484/0 (socket says 172.21.15.123:41484) 2024-09-15T23:19:31.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.159+0000 7f81d5b01640 1 -- 172.21.15.123:0/1398576999 learned_addr learned my addr 172.21.15.123:0/1398576999 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:31.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.160+0000 7f81d6302640 1 --2- 172.21.15.123:0/1398576999 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81d0073890 0x7f81d01f49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:31.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.160+0000 7f81d6b03640 1 --2- 172.21.15.123:0/1398576999 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f81d0145ed0 0x7f81d0071c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:31.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.160+0000 7f81d5b01640 1 -- 172.21.15.123:0/1398576999 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f81d0145ed0 msgr2=0x7f81d0071c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:31.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.160+0000 7f81d5b01640 1 --2- 172.21.15.123:0/1398576999 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f81d0145ed0 0x7f81d0071c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:31.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.160+0000 7f81d5b01640 1 -- 172.21.15.123:0/1398576999 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81d0073890 msgr2=0x7f81d01f49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:31.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.160+0000 7f81d5b01640 1 --2- 172.21.15.123:0/1398576999 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81d0073890 0x7f81d01f49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:31.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.160+0000 7f81d5b01640 1 -- 172.21.15.123:0/1398576999 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81d0140cc0 con 0x7f81d00b5880 2024-09-15T23:19:31.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.160+0000 7f81d6b03640 1 --2- 172.21.15.123:0/1398576999 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f81d0145ed0 0x7f81d0071c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:19:31.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.160+0000 7f81d5b01640 1 --2- 172.21.15.123:0/1398576999 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81d00b5880 0x7f81d0140780 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f81c400d800 tx=0x7f81c400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:31.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.160+0000 7f81ceffd640 1 -- 172.21.15.123:0/1398576999 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c400b6c0 con 0x7f81d00b5880 2024-09-15T23:19:31.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.160+0000 7f81ceffd640 1 -- 172.21.15.123:0/1398576999 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81c4019070 con 0x7f81d00b5880 2024-09-15T23:19:31.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.160+0000 7f81d8566640 1 -- 172.21.15.123:0/1398576999 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81d01f8bf0 con 0x7f81d00b5880 2024-09-15T23:19:31.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.160+0000 7f81ceffd640 1 -- 172.21.15.123:0/1398576999 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c400ba80 con 0x7f81d00b5880 2024-09-15T23:19:31.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.160+0000 7f81d8566640 1 -- 172.21.15.123:0/1398576999 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81d01e6480 con 0x7f81d00b5880 2024-09-15T23:19:31.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.161+0000 7f81d8566640 1 -- 172.21.15.123:0/1398576999 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81d006f1d0 con 0x7f81d00b5880 2024-09-15T23:19:31.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.162+0000 7f81ceffd640 1 -- 172.21.15.123:0/1398576999 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f81c400bc20 con 0x7f81d00b5880 2024-09-15T23:19:31.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.162+0000 7f81ceffd640 1 --2- 172.21.15.123:0/1398576999 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f81bc06c2b0 0x7f81bc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:31.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.162+0000 7f81ceffd640 1 -- 172.21.15.123:0/1398576999 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 4943+0+0 (secure 0 0 0) 0x7f81c408b560 con 0x7f81d00b5880 2024-09-15T23:19:31.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.162+0000 7f81d6302640 1 --2- 172.21.15.123:0/1398576999 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f81bc06c2b0 0x7f81bc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:31.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.163+0000 7f81d6302640 1 --2- 172.21.15.123:0/1398576999 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f81bc06c2b0 0x7f81bc06e770 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f81c8006fd0 tx=0x7f81c8009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:31.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.167+0000 7f81ceffd640 1 -- 172.21.15.123:0/1398576999 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f81d006f1d0 con 0x7f81d00b5880 2024-09-15T23:19:31.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.366+0000 7f81d8566640 1 -- 172.21.15.123:0/1398576999 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81d015b600 con 0x7f81d00b5880 2024-09-15T23:19:31.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.366+0000 7f81ceffd640 1 -- 172.21.15.123:0/1398576999 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) ==== 94+0+3923 (secure 0 0 0) 0x7f81d015b600 con 0x7f81d00b5880 2024-09-15T23:19:31.369 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:19:31.369 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":82,"btime":"2024-09-15T23:19:26:526280+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6386,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/1352396114","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":1352396114},{"type":"v1","addr":"172.21.15.188:6836","nonce":1352396114}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":7276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/4219071763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":4219071763},{"type":"v1","addr":"172.21.15.188:6837","nonce":4219071763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":82},{"gid":8022,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2727961795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2727961795},{"type":"v1","addr":"172.21.15.123:6834","nonce":2727961795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":8025,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3879785466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":3879785466},{"type":"v1","addr":"172.21.15.123:6835","nonce":3879785466}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[]} 2024-09-15T23:19:31.369 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 82 2024-09-15T23:19:31.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.368+0000 7f81d8566640 1 -- 172.21.15.123:0/1398576999 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f81bc06c2b0 msgr2=0x7f81bc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:31.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.368+0000 7f81d8566640 1 --2- 172.21.15.123:0/1398576999 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f81bc06c2b0 0x7f81bc06e770 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f81c8006fd0 tx=0x7f81c8009060 comp rx=0 tx=0).stop 2024-09-15T23:19:31.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.368+0000 7f81d8566640 1 -- 172.21.15.123:0/1398576999 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81d00b5880 msgr2=0x7f81d0140780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:31.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.368+0000 7f81d8566640 1 --2- 172.21.15.123:0/1398576999 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81d00b5880 0x7f81d0140780 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f81c400d800 tx=0x7f81c400dcc0 comp rx=0 tx=0).stop 2024-09-15T23:19:31.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.368+0000 7f81d8566640 1 -- 172.21.15.123:0/1398576999 shutdown_connections 2024-09-15T23:19:31.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.368+0000 7f81d8566640 1 --2- 172.21.15.123:0/1398576999 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f81d0145ed0 0x7f81d0071c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:31.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.368+0000 7f81d8566640 1 --2- 172.21.15.123:0/1398576999 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f81bc06c2b0 0x7f81bc06e770 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:31.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.368+0000 7f81d8566640 1 --2- 172.21.15.123:0/1398576999 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81d00b5880 0x7f81d0140780 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:31.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.368+0000 7f81d8566640 1 --2- 172.21.15.123:0/1398576999 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f81d0073890 0x7f81d01f49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:31.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.368+0000 7f81d8566640 1 -- 172.21.15.123:0/1398576999 >> 172.21.15.123:0/1398576999 conn(0x7f81d00ccec0 msgr2=0x7f81d00cea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:31.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.369+0000 7f81d8566640 1 -- 172.21.15.123:0/1398576999 shutdown_connections 2024-09-15T23:19:31.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.369+0000 7f81d8566640 1 -- 172.21.15.123:0/1398576999 wait complete. 2024-09-15T23:19:31.382 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T23:19:31.382 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T23:19:31.382 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T23:19:31.382 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:19:31.383 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T23:19:31.383 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T23:19:31.383 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T23:19:31.383 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:19:31.383 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T23:19:31.383 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T23:19:31.383 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T23:19:31.384 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:19:31.384 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T23:19:31.384 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T23:19:31.384 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T23:19:31.384 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:19:31.391 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T23:19:31.392 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T23:19:31.392 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T23:19:31.392 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T23:19:31.395 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T23:19:31.395 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T23:19:31.396 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T23:19:31.396 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T23:19:31.434 INFO:tasks.ceph.mds.a:Started 2024-09-15T23:19:31.434 DEBUG:teuthology.parallel:result is None 2024-09-15T23:19:31.435 INFO:tasks.ceph.mds.c:Started 2024-09-15T23:19:31.435 DEBUG:teuthology.parallel:result is None 2024-09-15T23:19:31.438 INFO:tasks.ceph.mds.d:Started 2024-09-15T23:19:31.438 DEBUG:teuthology.parallel:result is None 2024-09-15T23:19:31.439 INFO:tasks.ceph.mds.b:Started 2024-09-15T23:19:31.439 DEBUG:teuthology.parallel:result is None 2024-09-15T23:19:31.439 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T23:19:31.508 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-15T23:19:31.509 INFO:tasks.ceph.mds.a.smithi123.stdout:starting mds.a at 2024-09-15T23:19:31.520 INFO:tasks.ceph.mds.d.smithi188.stdout:starting mds.d at 2024-09-15T23:19:31.521 INFO:tasks.ceph.mds.b.smithi188.stdout:starting mds.b at 2024-09-15T23:19:31.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.540+0000 7f2faf0d0640 1 Processor -- start 2024-09-15T23:19:31.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.540+0000 7f2faf0d0640 1 -- start start 2024-09-15T23:19:31.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.541+0000 7f2faf0d0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2fa8158f80 0x7f2fa8071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:31.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.541+0000 7f2faf0d0640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2fa815b9a0 0x7f2fa80b6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:31.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.541+0000 7f2faf0d0640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2fa80b70a0 0x7f2fa815ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:31.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.541+0000 7f2faf0d0640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f2fa80b74d0 con 0x7f2fa80b70a0 2024-09-15T23:19:31.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.541+0000 7f2faf0d0640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f2fa8072930 con 0x7f2fa815b9a0 2024-09-15T23:19:31.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.541+0000 7f2faf0d0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f2fa8072c10 con 0x7f2fa8158f80 2024-09-15T23:19:31.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.541+0000 7f2fad66d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2fa80b70a0 0x7f2fa815ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:31.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.541+0000 7f2fad66d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2fa80b70a0 0x7f2fa815ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41520/0 (socket says 172.21.15.123:41520) 2024-09-15T23:19:31.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.541+0000 7f2fad66d640 1 -- 172.21.15.123:0/2227376250 learned_addr learned my addr 172.21.15.123:0/2227376250 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:31.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.541+0000 7f2fa7fff640 1 --2- 172.21.15.123:0/2227376250 >> v2:172.21.15.188:3300/0 conn(0x7f2fa815b9a0 0x7f2fa80b6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:31.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.541+0000 7f2face6c640 1 --2- 172.21.15.123:0/2227376250 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2fa8158f80 0x7f2fa8071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:31.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.541+0000 7f2fad66d640 1 -- 172.21.15.123:0/2227376250 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2fa8158f80 msgr2=0x7f2fa8071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:31.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.541+0000 7f2fad66d640 1 --2- 172.21.15.123:0/2227376250 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2fa8158f80 0x7f2fa8071fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:31.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.541+0000 7f2fad66d640 1 -- 172.21.15.123:0/2227376250 >> v2:172.21.15.188:3300/0 conn(0x7f2fa815b9a0 msgr2=0x7f2fa80b6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:31.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.541+0000 7f2fad66d640 1 --2- 172.21.15.123:0/2227376250 >> v2:172.21.15.188:3300/0 conn(0x7f2fa815b9a0 0x7f2fa80b6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:31.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.541+0000 7f2fad66d640 1 -- 172.21.15.123:0/2227376250 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa8072ef0 con 0x7f2fa80b70a0 2024-09-15T23:19:31.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.541+0000 7f2fa7fff640 1 --2- 172.21.15.123:0/2227376250 >> v2:172.21.15.188:3300/0 conn(0x7f2fa815b9a0 0x7f2fa80b6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:19:31.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.541+0000 7f2face6c640 1 --2- 172.21.15.123:0/2227376250 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2fa8158f80 0x7f2fa8071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:19:31.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.542+0000 7f2fad66d640 1 --2- 172.21.15.123:0/2227376250 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fa80b70a0 0x7f2fa815ee40 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f2fa80709e0 tx=0x7f2fa002c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47fe72ef045ed688 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:31.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.546+0000 7f2fa77fe640 1 -- 172.21.15.123:0/2227376250 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa000b2e0 con 0x7f2fa80b70a0 2024-09-15T23:19:31.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.546+0000 7f2fa77fe640 1 -- 172.21.15.123:0/2227376250 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fa0009600 con 0x7f2fa80b70a0 2024-09-15T23:19:31.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.546+0000 7f2fa77fe640 1 -- 172.21.15.123:0/2227376250 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa000b480 con 0x7f2fa80b70a0 2024-09-15T23:19:31.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.547+0000 7f2faf0d0640 1 -- 172.21.15.123:0/2227376250 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fa80b70a0 msgr2=0x7f2fa815ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:31.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.547+0000 7f2faf0d0640 1 --2- 172.21.15.123:0/2227376250 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fa80b70a0 0x7f2fa815ee40 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f2fa80709e0 tx=0x7f2fa002c8a0 comp rx=0 tx=0).stop 2024-09-15T23:19:31.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.547+0000 7f2faf0d0640 1 -- 172.21.15.123:0/2227376250 shutdown_connections 2024-09-15T23:19:31.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.547+0000 7f2faf0d0640 1 --2- 172.21.15.123:0/2227376250 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fa80b70a0 0x7f2fa815ee40 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:31.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.547+0000 7f2faf0d0640 1 --2- 172.21.15.123:0/2227376250 >> v2:172.21.15.188:3300/0 conn(0x7f2fa815b9a0 0x7f2fa80b6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:31.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.547+0000 7f2faf0d0640 1 --2- 172.21.15.123:0/2227376250 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2fa8158f80 0x7f2fa8071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:31.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.547+0000 7f2faf0d0640 1 -- 172.21.15.123:0/2227376250 >> 172.21.15.123:0/2227376250 conn(0x7f2fa806cd20 msgr2=0x7f2fa806d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:31.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.547+0000 7f2faf0d0640 1 -- 172.21.15.123:0/2227376250 shutdown_connections 2024-09-15T23:19:31.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.547+0000 7f2faf0d0640 1 -- 172.21.15.123:0/2227376250 wait complete. 2024-09-15T23:19:31.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.548+0000 7f2faf0d0640 1 Processor -- start 2024-09-15T23:19:31.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.549+0000 7f2faf0d0640 1 -- start start 2024-09-15T23:19:31.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.549+0000 7f2faf0d0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2fa80b70a0 0x7f2fa81ee190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:31.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.549+0000 7f2faf0d0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2fa8158f80 0x7f2fa8153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:31.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.549+0000 7f2faf0d0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fa815b9a0 0x7f2fa81f7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:31.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.550+0000 7f2faf0d0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa8072500 con 0x7f2fa815b9a0 2024-09-15T23:19:31.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.550+0000 7f2faf0d0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa80734b0 con 0x7f2fa8158f80 2024-09-15T23:19:31.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.550+0000 7f2faf0d0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f2fa8072680 con 0x7f2fa80b70a0 2024-09-15T23:19:31.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.550+0000 7f2fad66d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fa815b9a0 0x7f2fa81f7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:31.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.550+0000 7f2fad66d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fa815b9a0 0x7f2fa81f7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41530/0 (socket says 172.21.15.123:41530) 2024-09-15T23:19:31.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.550+0000 7f2fad66d640 1 -- 172.21.15.123:0/3118877192 learned_addr learned my addr 172.21.15.123:0/3118877192 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:31.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.550+0000 7f2face6c640 1 --2- 172.21.15.123:0/3118877192 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2fa80b70a0 0x7f2fa81ee190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:31.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.550+0000 7f2fa7fff640 1 --2- 172.21.15.123:0/3118877192 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2fa8158f80 0x7f2fa8153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:31.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.550+0000 7f2fad66d640 1 -- 172.21.15.123:0/3118877192 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2fa80b70a0 msgr2=0x7f2fa81ee190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:31.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.550+0000 7f2fad66d640 1 --2- 172.21.15.123:0/3118877192 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2fa80b70a0 0x7f2fa81ee190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:31.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.550+0000 7f2fad66d640 1 -- 172.21.15.123:0/3118877192 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2fa8158f80 msgr2=0x7f2fa8153810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:31.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.550+0000 7f2fad66d640 1 --2- 172.21.15.123:0/3118877192 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2fa8158f80 0x7f2fa8153810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:31.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.550+0000 7f2fad66d640 1 -- 172.21.15.123:0/3118877192 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa80af5f0 con 0x7f2fa815b9a0 2024-09-15T23:19:31.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.550+0000 7f2fa7fff640 1 --2- 172.21.15.123:0/3118877192 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2fa8158f80 0x7f2fa8153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:19:31.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.550+0000 7f2fad66d640 1 --2- 172.21.15.123:0/3118877192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fa815b9a0 0x7f2fa81f7750 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f2fa000d210 tx=0x7f2fa0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:31.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.551+0000 7f2fa57fa640 1 -- 172.21.15.123:0/3118877192 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa0040020 con 0x7f2fa815b9a0 2024-09-15T23:19:31.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.551+0000 7f2faf0d0640 1 -- 172.21.15.123:0/3118877192 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fa80af8d0 con 0x7f2fa815b9a0 2024-09-15T23:19:31.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.552+0000 7f2fa57fa640 1 -- 172.21.15.123:0/3118877192 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fa0009370 con 0x7f2fa815b9a0 2024-09-15T23:19:31.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.552+0000 7f2fa57fa640 1 -- 172.21.15.123:0/3118877192 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa003c870 con 0x7f2fa815b9a0 2024-09-15T23:19:31.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.552+0000 7f2faf0d0640 1 -- 172.21.15.123:0/3118877192 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fa80afe90 con 0x7f2fa815b9a0 2024-09-15T23:19:31.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.553+0000 7f2faf0d0640 1 -- 172.21.15.123:0/3118877192 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fa80739d0 con 0x7f2fa815b9a0 2024-09-15T23:19:31.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.553+0000 7f2fa57fa640 1 -- 172.21.15.123:0/3118877192 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2fa0043020 con 0x7f2fa815b9a0 2024-09-15T23:19:31.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.554+0000 7f2fa57fa640 1 --2- 172.21.15.123:0/3118877192 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2f8c06c2e0 0x7f2f8c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:31.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.554+0000 7f2fa57fa640 1 -- 172.21.15.123:0/3118877192 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 4943+0+0 (secure 0 0 0) 0x7f2fa00abae0 con 0x7f2fa815b9a0 2024-09-15T23:19:31.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.554+0000 7f2face6c640 1 --2- 172.21.15.123:0/3118877192 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2f8c06c2e0 0x7f2f8c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:31.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.554+0000 7f2face6c640 1 --2- 172.21.15.123:0/3118877192 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2f8c06c2e0 0x7f2f8c06e7a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c006fd0 tx=0x7f2f9c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:31.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.558+0000 7f2fa57fa640 1 -- 172.21.15.123:0/3118877192 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2fa004a070 con 0x7f2fa815b9a0 2024-09-15T23:19:31.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:31.739+0000 7f2faf0d0640 1 -- 172.21.15.123:0/3118877192 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f2fa815bf20 con 0x7f2fa815b9a0 2024-09-15T23:19:32.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.573+0000 7f2fa57fa640 1 -- 172.21.15.123:0/3118877192 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v138) ==== 97+0+0 (secure 0 0 0) 0x7f2fa007a540 con 0x7f2fa815b9a0 2024-09-15T23:19:32.576 INFO:teuthology.orchestra.run.smithi123.stderr: removed all blocklist entries 2024-09-15T23:19:32.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.576+0000 7f2faf0d0640 1 -- 172.21.15.123:0/3118877192 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2f8c06c2e0 msgr2=0x7f2f8c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:32.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.576+0000 7f2faf0d0640 1 --2- 172.21.15.123:0/3118877192 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2f8c06c2e0 0x7f2f8c06e7a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c006fd0 tx=0x7f2f9c008040 comp rx=0 tx=0).stop 2024-09-15T23:19:32.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.576+0000 7f2faf0d0640 1 -- 172.21.15.123:0/3118877192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fa815b9a0 msgr2=0x7f2fa81f7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:32.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.576+0000 7f2faf0d0640 1 --2- 172.21.15.123:0/3118877192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fa815b9a0 0x7f2fa81f7750 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f2fa000d210 tx=0x7f2fa0004a40 comp rx=0 tx=0).stop 2024-09-15T23:19:32.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.576+0000 7f2faf0d0640 1 -- 172.21.15.123:0/3118877192 shutdown_connections 2024-09-15T23:19:32.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.576+0000 7f2faf0d0640 1 --2- 172.21.15.123:0/3118877192 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2f8c06c2e0 0x7f2f8c06e7a0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:32.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.576+0000 7f2faf0d0640 1 --2- 172.21.15.123:0/3118877192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fa815b9a0 0x7f2fa81f7750 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:32.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.576+0000 7f2faf0d0640 1 --2- 172.21.15.123:0/3118877192 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2fa8158f80 0x7f2fa8153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:32.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.576+0000 7f2faf0d0640 1 --2- 172.21.15.123:0/3118877192 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2fa80b70a0 0x7f2fa81ee190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:32.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.576+0000 7f2faf0d0640 1 -- 172.21.15.123:0/3118877192 >> 172.21.15.123:0/3118877192 conn(0x7f2fa806cd20 msgr2=0x7f2fa80b19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:32.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.576+0000 7f2faf0d0640 1 -- 172.21.15.123:0/3118877192 shutdown_connections 2024-09-15T23:19:32.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.576+0000 7f2faf0d0640 1 -- 172.21.15.123:0/3118877192 wait complete. 2024-09-15T23:19:32.590 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T23:19:32.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.687+0000 7f05b2284640 1 Processor -- start 2024-09-15T23:19:32.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.687+0000 7f05b2284640 1 -- start start 2024-09-15T23:19:32.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.688+0000 7f05b2284640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f05ac15ed20 0x7f05ac0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:32.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.688+0000 7f05b2284640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f05ac0d23b0 0x7f05ac0b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:32.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.688+0000 7f05b2284640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05ac0d0e70 con 0x7f05ac0cf2d0 2024-09-15T23:19:32.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.688+0000 7f05b2284640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f05ac0d41c0 con 0x7f05ac15ed20 2024-09-15T23:19:32.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.688+0000 7f05b2284640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f05ac0d35b0 con 0x7f05ac0d23b0 2024-09-15T23:19:32.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.688+0000 7f05abfff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f05ac15ed20 0x7f05ac0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:32.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.688+0000 7f05abfff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f05ac15ed20 0x7f05ac0b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41538/0 (socket says 172.21.15.123:41538) 2024-09-15T23:19:32.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.688+0000 7f05abfff640 1 -- 172.21.15.123:0/2113410251 learned_addr learned my addr 172.21.15.123:0/2113410251 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:32.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.689+0000 7f05ab7fe640 1 --2- 172.21.15.123:0/2113410251 >> v2:172.21.15.188:3300/0 conn(0x7f05ac0d23b0 0x7f05ac0b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:32.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.689+0000 7f05abfff640 1 -- 172.21.15.123:0/2113410251 >> v2:172.21.15.188:3300/0 conn(0x7f05ac0d23b0 msgr2=0x7f05ac0b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:32.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.689+0000 7f05abfff640 1 --2- 172.21.15.123:0/2113410251 >> v2:172.21.15.188:3300/0 conn(0x7f05ac0d23b0 0x7f05ac0b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:32.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.689+0000 7f05abfff640 1 -- 172.21.15.123:0/2113410251 >> v1:172.21.15.188:6789/0 conn(0x7f05ac0cf2d0 legacy=0x7f05ac0cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:32.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.689+0000 7f05abfff640 1 -- 172.21.15.123:0/2113410251 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05ac0d3890 con 0x7f05ac15ed20 2024-09-15T23:19:32.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.689+0000 7f05ab7fe640 1 --2- 172.21.15.123:0/2113410251 >> v2:172.21.15.188:3300/0 conn(0x7f05ac0d23b0 0x7f05ac0b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:19:32.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.689+0000 7f05abfff640 1 --2- 172.21.15.123:0/2113410251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05ac15ed20 0x7f05ac0b6260 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f05ac0d4690 tx=0x7f059c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d258fb9a5691fe9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:32.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.689+0000 7f05aaffd640 1 -- 172.21.15.123:0/2113410251 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c037070 con 0x7f05ac15ed20 2024-09-15T23:19:32.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.690+0000 7f05aaffd640 1 -- 172.21.15.123:0/2113410251 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f059c032440 con 0x7f05ac15ed20 2024-09-15T23:19:32.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.690+0000 7f05aaffd640 1 -- 172.21.15.123:0/2113410251 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c032810 con 0x7f05ac15ed20 2024-09-15T23:19:32.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.690+0000 7f05b2284640 1 -- 172.21.15.123:0/2113410251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05ac15ed20 msgr2=0x7f05ac0b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:32.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.690+0000 7f05b2284640 1 --2- 172.21.15.123:0/2113410251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05ac15ed20 0x7f05ac0b6260 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f05ac0d4690 tx=0x7f059c02a1a0 comp rx=0 tx=0).stop 2024-09-15T23:19:32.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.690+0000 7f05b2284640 1 -- 172.21.15.123:0/2113410251 shutdown_connections 2024-09-15T23:19:32.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.690+0000 7f05b2284640 1 --2- 172.21.15.123:0/2113410251 >> v2:172.21.15.188:3300/0 conn(0x7f05ac0d23b0 0x7f05ac0b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:32.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.690+0000 7f05b2284640 1 --2- 172.21.15.123:0/2113410251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05ac15ed20 0x7f05ac0b6260 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:32.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.690+0000 7f05b2284640 1 -- 172.21.15.123:0/2113410251 >> 172.21.15.123:0/2113410251 conn(0x7f05ac0d1260 msgr2=0x7f05ac0d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:32.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.690+0000 7f05b2284640 1 -- 172.21.15.123:0/2113410251 shutdown_connections 2024-09-15T23:19:32.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.690+0000 7f05b2284640 1 -- 172.21.15.123:0/2113410251 wait complete. 2024-09-15T23:19:32.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.691+0000 7f05b2284640 1 Processor -- start 2024-09-15T23:19:32.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.691+0000 7f05b2284640 1 -- start start 2024-09-15T23:19:32.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.692+0000 7f05b2284640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05ac0cf2d0 0x7f05ac15ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:32.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.692+0000 7f05b2284640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f05ac0d23b0 0x7f05ac15c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:32.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.692+0000 7f05b2284640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05ac15ed20 0x7f05ac1e90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:32.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.692+0000 7f05b2284640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f05ac0d32a0 con 0x7f05ac0cf2d0 2024-09-15T23:19:32.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.692+0000 7f05b2284640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f05ac0d3e50 con 0x7f05ac0d23b0 2024-09-15T23:19:32.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.692+0000 7f05b2284640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f05ac15f100 con 0x7f05ac15ed20 2024-09-15T23:19:32.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.692+0000 7f05abfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05ac0cf2d0 0x7f05ac15ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:32.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.692+0000 7f05abfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05ac0cf2d0 0x7f05ac15ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41544/0 (socket says 172.21.15.123:41544) 2024-09-15T23:19:32.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.692+0000 7f05abfff640 1 -- 172.21.15.123:0/2585483540 learned_addr learned my addr 172.21.15.123:0/2585483540 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:32.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.692+0000 7f05ab7fe640 1 --2- 172.21.15.123:0/2585483540 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f05ac0d23b0 0x7f05ac15c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:32.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.692+0000 7f05b0821640 1 --2- 172.21.15.123:0/2585483540 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05ac15ed20 0x7f05ac1e90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:32.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.693+0000 7f05abfff640 1 -- 172.21.15.123:0/2585483540 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05ac15ed20 msgr2=0x7f05ac1e90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:32.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.693+0000 7f05abfff640 1 --2- 172.21.15.123:0/2585483540 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05ac15ed20 0x7f05ac1e90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:32.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.693+0000 7f05abfff640 1 -- 172.21.15.123:0/2585483540 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f05ac0d23b0 msgr2=0x7f05ac15c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:32.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.693+0000 7f05abfff640 1 --2- 172.21.15.123:0/2585483540 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f05ac0d23b0 0x7f05ac15c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:32.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.693+0000 7f05abfff640 1 -- 172.21.15.123:0/2585483540 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05ac0ca6f0 con 0x7f05ac0cf2d0 2024-09-15T23:19:32.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.693+0000 7f05abfff640 1 --2- 172.21.15.123:0/2585483540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05ac0cf2d0 0x7f05ac15ce50 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f059c000c00 tx=0x7f059c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:32.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.693+0000 7f05a8ff9640 1 -- 172.21.15.123:0/2585483540 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c037040 con 0x7f05ac0cf2d0 2024-09-15T23:19:32.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.693+0000 7f05a8ff9640 1 -- 172.21.15.123:0/2585483540 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f059c042070 con 0x7f05ac0cf2d0 2024-09-15T23:19:32.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.693+0000 7f05a8ff9640 1 -- 172.21.15.123:0/2585483540 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c030bb0 con 0x7f05ac0cf2d0 2024-09-15T23:19:32.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.693+0000 7f05b2284640 1 -- 172.21.15.123:0/2585483540 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05ac0ca9d0 con 0x7f05ac0cf2d0 2024-09-15T23:19:32.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.693+0000 7f05b2284640 1 -- 172.21.15.123:0/2585483540 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05ac0caf90 con 0x7f05ac0cf2d0 2024-09-15T23:19:32.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.694+0000 7f05b2284640 1 -- 172.21.15.123:0/2585483540 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05ac0b7010 con 0x7f05ac0cf2d0 2024-09-15T23:19:32.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.695+0000 7f05a8ff9640 1 -- 172.21.15.123:0/2585483540 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f059c047460 con 0x7f05ac0cf2d0 2024-09-15T23:19:32.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.695+0000 7f05a8ff9640 1 --2- 172.21.15.123:0/2585483540 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f059806c2b0 0x7f059806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:32.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.695+0000 7f05a8ff9640 1 -- 172.21.15.123:0/2585483540 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 4857+0+0 (secure 0 0 0) 0x7f059c0abad0 con 0x7f05ac0cf2d0 2024-09-15T23:19:32.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.695+0000 7f05ab7fe640 1 --2- 172.21.15.123:0/2585483540 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f059806c2b0 0x7f059806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:32.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.696+0000 7f05ab7fe640 1 --2- 172.21.15.123:0/2585483540 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f059806c2b0 0x7f059806e770 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f05ac15e270 tx=0x7f05a0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:32.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.699+0000 7f05a8ff9640 1 -- 172.21.15.123:0/2585483540 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f05ac0d0e70 con 0x7f05ac0cf2d0 2024-09-15T23:19:32.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.926+0000 7f05b2284640 1 -- 172.21.15.123:0/2585483540 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f05ac0b3f20 con 0x7f05ac0cf2d0 2024-09-15T23:19:32.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.926+0000 7f05a8ff9640 1 -- 172.21.15.123:0/2585483540 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) ==== 80+0+5304 (secure 0 0 0) 0x7f059c079fd0 con 0x7f05ac0cf2d0 2024-09-15T23:19:32.929 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:19:32.929 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:19:32.929 INFO:teuthology.orchestra.run.smithi123.stdout: "auth_dump": [ 2024-09-15T23:19:32.929 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:19:32.929 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.a", 2024-09-15T23:19:32.929 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm9ATVDhAAnukyZogTuG4YCbzRXSCkiQ==", 2024-09-15T23:19:32.929 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:19:32.929 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:19:32.929 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:19:32.929 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:19:32.929 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:19:32.929 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:19:32.930 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:19:32.930 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:19:32.930 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.b", 2024-09-15T23:19:32.930 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm4KmaGhAAbf6vcffqiJTOYXK5DCXcZA==", 2024-09-15T23:19:32.930 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:19:32.930 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:19:32.930 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:19:32.930 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:19:32.930 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:19:32.930 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:19:32.930 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:19:32.930 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:19:32.930 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.c", 2024-09-15T23:19:32.930 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmua/VFRAAwbPm2TslrfQkrvHiO8oeLg==", 2024-09-15T23:19:32.931 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:19:32.931 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:19:32.931 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:19:32.931 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:19:32.931 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:19:32.931 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:19:32.931 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:19:32.931 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:19:32.931 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.d", 2024-09-15T23:19:32.931 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmzw3eIRAAaE+5y9USwp+xM3MTAndn7Q==", 2024-09-15T23:19:32.931 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:19:32.931 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:19:32.931 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:19:32.932 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:19:32.932 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:19:32.932 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:19:32.932 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:19:32.932 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:19:32.932 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.0", 2024-09-15T23:19:32.932 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCRaedmFrHGAxAAy/jTkothESNn2DC9xcHDAQ==", 2024-09-15T23:19:32.932 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:19:32.932 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:19:32.932 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:19:32.932 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:19:32.932 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:19:32.932 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:19:32.932 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:19:32.933 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.1", 2024-09-15T23:19:32.933 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCUaedm6vZlIxAAdsnLqFSng6SRpCT6UZKGsw==", 2024-09-15T23:19:32.933 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:19:32.933 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:19:32.933 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:19:32.933 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:19:32.933 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:19:32.933 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:19:32.933 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:19:32.933 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.2", 2024-09-15T23:19:32.933 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCYaedmXgVwFRAA1mOzzRafhKMsU7kTAT6TqA==", 2024-09-15T23:19:32.933 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:19:32.933 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:19:32.933 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:19:32.934 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:19:32.934 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:19:32.934 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:19:32.934 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:19:32.934 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.3", 2024-09-15T23:19:32.934 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCcaedm+APAFhAAb8blNFzswwHriSmCrMuA0A==", 2024-09-15T23:19:32.934 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:19:32.934 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:19:32.934 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:19:32.934 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:19:32.934 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:19:32.934 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:19:32.934 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:19:32.934 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.4", 2024-09-15T23:19:32.935 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCjaedmReUmABAAXpxsK7osxn/ZelVXKiCLOw==", 2024-09-15T23:19:32.935 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:19:32.935 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:19:32.935 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:19:32.935 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:19:32.935 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:19:32.935 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:19:32.935 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:19:32.935 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.5", 2024-09-15T23:19:32.935 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCnaedmtbdmARAAdxguBdtwBmtiaIx/y992GA==", 2024-09-15T23:19:32.935 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:19:32.935 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:19:32.935 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:19:32.935 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:19:32.936 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:19:32.936 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:19:32.936 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:19:32.936 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.6", 2024-09-15T23:19:32.936 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCraedmkR+NAxAAd2GAAH0BgOMonU8iTSn+Fw==", 2024-09-15T23:19:32.936 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:19:32.936 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:19:32.936 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:19:32.936 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:19:32.936 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:19:32.936 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:19:32.936 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:19:32.936 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.7", 2024-09-15T23:19:32.936 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCvaedmAaCwBBAAdpDtCbXchArmy019wiOdSQ==", 2024-09-15T23:19:32.937 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:19:32.937 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:19:32.937 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:19:32.937 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:19:32.937 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:19:32.937 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:19:32.937 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:19:32.937 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.0", 2024-09-15T23:19:32.937 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmzQPqJRAAhUf1dnVYohN4obCfeu8+7g==", 2024-09-15T23:19:32.937 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:19:32.937 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:19:32.937 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow r", 2024-09-15T23:19:32.937 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-15T23:19:32.937 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:19:32.938 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:19:32.938 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:19:32.938 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.1", 2024-09-15T23:19:32.938 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmdKK0LhAAXXmUkxVwMEjRTRXUh9CL/g==", 2024-09-15T23:19:32.938 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:19:32.938 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:19:32.938 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:19:32.938 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:19:32.938 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:19:32.938 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:19:32.938 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:19:32.938 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:19:32.938 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.2", 2024-09-15T23:19:32.938 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmRz55KxAARi7B4WYOY1QqH1CK81z9pA==", 2024-09-15T23:19:32.939 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:19:32.939 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:19:32.939 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:19:32.939 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:19:32.939 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:19:32.939 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:19:32.939 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:19:32.939 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:19:32.939 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.3", 2024-09-15T23:19:32.939 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmbWo8NBAAR1qGX1bs35ojx6lMxftcfg==", 2024-09-15T23:19:32.939 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:19:32.939 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:19:32.939 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:19:32.939 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:19:32.940 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:19:32.940 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:19:32.940 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:19:32.940 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:19:32.940 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.admin", 2024-09-15T23:19:32.940 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCMaedmVUW0LhAAqgPFk1HtxsZXcIStNN43pA==", 2024-09-15T23:19:32.940 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:19:32.940 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:19:32.940 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:19:32.940 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:19:32.940 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:19:32.940 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:19:32.940 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:19:32.940 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:19:32.941 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.x", 2024-09-15T23:19:32.941 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmGPSBCxAAHAhXQERogdAOm0ZPNtlxpw==", 2024-09-15T23:19:32.941 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:19:32.941 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:19:32.941 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-15T23:19:32.941 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:19:32.941 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:19:32.941 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:19:32.941 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:19:32.941 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.y", 2024-09-15T23:19:32.941 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm5Om4BxAA/7ZtMMlbUA3bvMCfaNMQyg==", 2024-09-15T23:19:32.941 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:19:32.941 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:19:32.941 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-15T23:19:32.942 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:19:32.942 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:19:32.942 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:19:32.942 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-15T23:19:32.942 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:19:32.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.928+0000 7f05b2284640 1 -- 172.21.15.123:0/2585483540 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f059806c2b0 msgr2=0x7f059806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:32.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.928+0000 7f05b2284640 1 --2- 172.21.15.123:0/2585483540 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f059806c2b0 0x7f059806e770 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f05ac15e270 tx=0x7f05a0008040 comp rx=0 tx=0).stop 2024-09-15T23:19:32.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.928+0000 7f05b2284640 1 -- 172.21.15.123:0/2585483540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05ac0cf2d0 msgr2=0x7f05ac15ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:32.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.928+0000 7f05b2284640 1 --2- 172.21.15.123:0/2585483540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05ac0cf2d0 0x7f05ac15ce50 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f059c000c00 tx=0x7f059c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:19:32.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.928+0000 7f05b2284640 1 -- 172.21.15.123:0/2585483540 shutdown_connections 2024-09-15T23:19:32.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.928+0000 7f05b2284640 1 --2- 172.21.15.123:0/2585483540 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05ac15ed20 0x7f05ac1e90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:32.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.928+0000 7f05b2284640 1 --2- 172.21.15.123:0/2585483540 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f05ac0d23b0 0x7f05ac15c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:32.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.928+0000 7f05b2284640 1 --2- 172.21.15.123:0/2585483540 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f059806c2b0 0x7f059806e770 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:32.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.928+0000 7f05b2284640 1 --2- 172.21.15.123:0/2585483540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05ac0cf2d0 0x7f05ac15ce50 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:32.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.928+0000 7f05b2284640 1 -- 172.21.15.123:0/2585483540 >> 172.21.15.123:0/2585483540 conn(0x7f05ac0d1260 msgr2=0x7f05ac0b5480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:32.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.928+0000 7f05b2284640 1 -- 172.21.15.123:0/2585483540 shutdown_connections 2024-09-15T23:19:32.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:32.928+0000 7f05b2284640 1 -- 172.21.15.123:0/2585483540 wait complete. 2024-09-15T23:19:32.945 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T23:19:33.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.042+0000 7f0bfa4f1640 1 Processor -- start 2024-09-15T23:19:33.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.042+0000 7f0bfa4f1640 1 -- start start 2024-09-15T23:19:33.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.042+0000 7f0bfa4f1640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f0bf40b6970 0x7f0bf40b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:33.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.042+0000 7f0bfa4f1640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0bf40d23b0 0x7f0bf40b8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:33.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.042+0000 7f0bfa4f1640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bf40d0e70 con 0x7f0bf415ed20 2024-09-15T23:19:33.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.042+0000 7f0bfa4f1640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f0bf40d41c0 con 0x7f0bf40d23b0 2024-09-15T23:19:33.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.042+0000 7f0bfa4f1640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f0bf40d35b0 con 0x7f0bf40b6970 2024-09-15T23:19:33.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.043+0000 7f0bf3fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f0bf415ed20 0x7f0bf40b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:33780/0 (socket says 172.21.15.123:33780) 2024-09-15T23:19:33.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.043+0000 7f0bf3fff640 1 -- 172.21.15.123:0/3961034007 learned_addr learned my addr 172.21.15.123:0/3961034007 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:19:33.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.043+0000 7f0bf8a8e640 1 --2- 172.21.15.123:0/3961034007 >> v2:172.21.15.123:3300/0 conn(0x7f0bf40d23b0 0x7f0bf40b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:33.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.043+0000 7f0bf2ffd640 1 -- 172.21.15.123:0/3961034007 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2105906974 0 0) 0x7f0be4001110 con 0x7f0bf415ed20 2024-09-15T23:19:33.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.043+0000 7f0bf2ffd640 1 -- 172.21.15.123:0/3961034007 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0be0003520 con 0x7f0bf415ed20 2024-09-15T23:19:33.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.043+0000 7f0bf37fe640 1 --2- 172.21.15.123:0/3961034007 >> v2:172.21.15.188:3300/0 conn(0x7f0bf40b6970 0x7f0bf40b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:33.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.043+0000 7f0bf8a8e640 1 -- 172.21.15.123:0/3961034007 >> v2:172.21.15.188:3300/0 conn(0x7f0bf40b6970 msgr2=0x7f0bf40b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:33.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.043+0000 7f0bf8a8e640 1 --2- 172.21.15.123:0/3961034007 >> v2:172.21.15.188:3300/0 conn(0x7f0bf40b6970 0x7f0bf40b80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:33.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.043+0000 7f0bf8a8e640 1 -- 172.21.15.123:0/3961034007 >> v1:172.21.15.123:6789/0 conn(0x7f0bf415ed20 legacy=0x7f0bf40b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:33.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.043+0000 7f0bf8a8e640 1 -- 172.21.15.123:0/3961034007 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bf40d3890 con 0x7f0bf40d23b0 2024-09-15T23:19:33.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.044+0000 7f0bf8a8e640 1 --2- 172.21.15.123:0/3961034007 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0bf40d23b0 0x7f0bf40b8610 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f0bf40d4690 tx=0x7f0bec02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=629ae97b46431bf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:33.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.044+0000 7f0bf2ffd640 1 -- 172.21.15.123:0/3961034007 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bec007740 con 0x7f0bf40d23b0 2024-09-15T23:19:33.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.044+0000 7f0bf2ffd640 1 -- 172.21.15.123:0/3961034007 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bec0078e0 con 0x7f0bf40d23b0 2024-09-15T23:19:33.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.044+0000 7f0bf2ffd640 1 -- 172.21.15.123:0/3961034007 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bec007cb0 con 0x7f0bf40d23b0 2024-09-15T23:19:33.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.044+0000 7f0bfa4f1640 1 -- 172.21.15.123:0/3961034007 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0bf40d23b0 msgr2=0x7f0bf40b8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:33.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.044+0000 7f0bfa4f1640 1 --2- 172.21.15.123:0/3961034007 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0bf40d23b0 0x7f0bf40b8610 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f0bf40d4690 tx=0x7f0bec02a5f0 comp rx=0 tx=0).stop 2024-09-15T23:19:33.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.044+0000 7f0bfa4f1640 1 -- 172.21.15.123:0/3961034007 shutdown_connections 2024-09-15T23:19:33.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.044+0000 7f0bfa4f1640 1 --2- 172.21.15.123:0/3961034007 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0bf40d23b0 0x7f0bf40b8610 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:33.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.044+0000 7f0bfa4f1640 1 --2- 172.21.15.123:0/3961034007 >> v2:172.21.15.188:3300/0 conn(0x7f0bf40b6970 0x7f0bf40b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:33.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.044+0000 7f0bfa4f1640 1 -- 172.21.15.123:0/3961034007 >> 172.21.15.123:0/3961034007 conn(0x7f0bf40d1260 msgr2=0x7f0bf40d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:33.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.044+0000 7f0bfa4f1640 1 -- 172.21.15.123:0/3961034007 shutdown_connections 2024-09-15T23:19:33.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.044+0000 7f0bfa4f1640 1 -- 172.21.15.123:0/3961034007 wait complete. 2024-09-15T23:19:33.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.046+0000 7f0bfa4f1640 1 Processor -- start 2024-09-15T23:19:33.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.046+0000 7f0bfa4f1640 1 -- start start 2024-09-15T23:19:33.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.046+0000 7f0bfa4f1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0bf40b6970 0x7f0bf4154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:33.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.046+0000 7f0bfa4f1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0bf40d23b0 0x7f0bf4156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:33.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.046+0000 7f0bfa4f1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0bf415ed20 0x7f0bf4157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:33.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.046+0000 7f0bfa4f1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf40d32a0 con 0x7f0bf40b6970 2024-09-15T23:19:33.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.046+0000 7f0bfa4f1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf40d3e50 con 0x7f0bf40d23b0 2024-09-15T23:19:33.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.046+0000 7f0bfa4f1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0bf415f100 con 0x7f0bf415ed20 2024-09-15T23:19:33.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.047+0000 7f0bf3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0bf40b6970 0x7f0bf4154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:33.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.047+0000 7f0bf3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0bf40b6970 0x7f0bf4154d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41568/0 (socket says 172.21.15.123:41568) 2024-09-15T23:19:33.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.047+0000 7f0bf3fff640 1 -- 172.21.15.123:0/1611984270 learned_addr learned my addr 172.21.15.123:0/1611984270 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:33.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.047+0000 7f0bf8a8e640 1 --2- 172.21.15.123:0/1611984270 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0bf415ed20 0x7f0bf4157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:33.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.047+0000 7f0bf37fe640 1 --2- 172.21.15.123:0/1611984270 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0bf40d23b0 0x7f0bf4156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:33.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.047+0000 7f0bf3fff640 1 -- 172.21.15.123:0/1611984270 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0bf415ed20 msgr2=0x7f0bf4157440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:33.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.047+0000 7f0bf3fff640 1 --2- 172.21.15.123:0/1611984270 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0bf415ed20 0x7f0bf4157440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:33.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.047+0000 7f0bf3fff640 1 -- 172.21.15.123:0/1611984270 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0bf40d23b0 msgr2=0x7f0bf4156bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:33.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.047+0000 7f0bf3fff640 1 --2- 172.21.15.123:0/1611984270 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0bf40d23b0 0x7f0bf4156bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:33.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.047+0000 7f0bf3fff640 1 -- 172.21.15.123:0/1611984270 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bf41552c0 con 0x7f0bf40b6970 2024-09-15T23:19:33.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.047+0000 7f0bf8a8e640 1 --2- 172.21.15.123:0/1611984270 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0bf415ed20 0x7f0bf4157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:19:33.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.047+0000 7f0bf3fff640 1 --2- 172.21.15.123:0/1611984270 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0bf40b6970 0x7f0bf4154d80 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f0be400c730 tx=0x7f0be400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:33.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.047+0000 7f0bf0ff9640 1 -- 172.21.15.123:0/1611984270 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be4017070 con 0x7f0bf40b6970 2024-09-15T23:19:33.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.047+0000 7f0bf0ff9640 1 -- 172.21.15.123:0/1611984270 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be4005ad0 con 0x7f0bf40b6970 2024-09-15T23:19:33.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.047+0000 7f0bfa4f1640 1 -- 172.21.15.123:0/1611984270 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bf40cbe80 con 0x7f0bf40b6970 2024-09-15T23:19:33.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.047+0000 7f0bf0ff9640 1 -- 172.21.15.123:0/1611984270 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be4007e20 con 0x7f0bf40b6970 2024-09-15T23:19:33.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.047+0000 7f0bfa4f1640 1 -- 172.21.15.123:0/1611984270 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bf40cc6c0 con 0x7f0bf40b6970 2024-09-15T23:19:33.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.048+0000 7f0bfa4f1640 1 -- 172.21.15.123:0/1611984270 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bf40b7010 con 0x7f0bf40b6970 2024-09-15T23:19:33.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.049+0000 7f0bf0ff9640 1 -- 172.21.15.123:0/1611984270 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0be401a070 con 0x7f0bf40b6970 2024-09-15T23:19:33.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.049+0000 7f0bf0ff9640 1 --2- 172.21.15.123:0/1611984270 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0bd406c2b0 0x7f0bd406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:33.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.049+0000 7f0bf0ff9640 1 -- 172.21.15.123:0/1611984270 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 4857+0+0 (secure 0 0 0) 0x7f0be408a510 con 0x7f0bf40b6970 2024-09-15T23:19:33.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.050+0000 7f0bf37fe640 1 --2- 172.21.15.123:0/1611984270 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0bd406c2b0 0x7f0bd406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:33.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.050+0000 7f0bf37fe640 1 --2- 172.21.15.123:0/1611984270 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0bd406c2b0 0x7f0bd406e770 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc006fd0 tx=0x7f0bdc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:33.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.053+0000 7f0bf0ff9640 1 -- 172.21.15.123:0/1611984270 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0bf40cbe80 con 0x7f0bf40b6970 2024-09-15T23:19:33.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.220+0000 7f0bfa4f1640 1 -- 172.21.15.123:0/1611984270 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f0bf40b3f20 con 0x7f0bf40b6970 2024-09-15T23:19:33.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.221+0000 7f0bf0ff9640 1 -- 172.21.15.123:0/1611984270 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v138) ==== 84+0+65 (secure 0 0 0) 0x7f0be408a020 con 0x7f0bf40b6970 2024-09-15T23:19:33.223 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:19:33.223 INFO:teuthology.orchestra.run.smithi123.stdout:[ 2024-09-15T23:19:33.223 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:19:33.223 INFO:teuthology.orchestra.run.smithi123.stdout: "poolnum": 1, 2024-09-15T23:19:33.223 INFO:teuthology.orchestra.run.smithi123.stdout: "poolname": ".mgr" 2024-09-15T23:19:33.223 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:19:33.223 INFO:teuthology.orchestra.run.smithi123.stdout:] 2024-09-15T23:19:33.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.222+0000 7f0bfa4f1640 1 -- 172.21.15.123:0/1611984270 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0bd406c2b0 msgr2=0x7f0bd406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:33.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.223+0000 7f0bfa4f1640 1 --2- 172.21.15.123:0/1611984270 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0bd406c2b0 0x7f0bd406e770 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc006fd0 tx=0x7f0bdc008040 comp rx=0 tx=0).stop 2024-09-15T23:19:33.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.223+0000 7f0bfa4f1640 1 -- 172.21.15.123:0/1611984270 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0bf40b6970 msgr2=0x7f0bf4154d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:33.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.223+0000 7f0bfa4f1640 1 --2- 172.21.15.123:0/1611984270 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0bf40b6970 0x7f0bf4154d80 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f0be400c730 tx=0x7f0be400cbf0 comp rx=0 tx=0).stop 2024-09-15T23:19:33.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.223+0000 7f0bfa4f1640 1 -- 172.21.15.123:0/1611984270 shutdown_connections 2024-09-15T23:19:33.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.223+0000 7f0bfa4f1640 1 --2- 172.21.15.123:0/1611984270 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0bf415ed20 0x7f0bf4157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:33.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.223+0000 7f0bfa4f1640 1 --2- 172.21.15.123:0/1611984270 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0bf40d23b0 0x7f0bf4156bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:33.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.223+0000 7f0bfa4f1640 1 --2- 172.21.15.123:0/1611984270 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0bd406c2b0 0x7f0bd406e770 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:33.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.223+0000 7f0bfa4f1640 1 --2- 172.21.15.123:0/1611984270 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0bf40b6970 0x7f0bf4154d80 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:33.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.223+0000 7f0bfa4f1640 1 -- 172.21.15.123:0/1611984270 >> 172.21.15.123:0/1611984270 conn(0x7f0bf40d1260 msgr2=0x7f0bf40b4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:33.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.223+0000 7f0bfa4f1640 1 -- 172.21.15.123:0/1611984270 shutdown_connections 2024-09-15T23:19:33.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.223+0000 7f0bfa4f1640 1 -- 172.21.15.123:0/1611984270 wait complete. 2024-09-15T23:19:33.236 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T23:19:33.236 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T23:19:33.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.336+0000 7f34c401e640 1 Processor -- start 2024-09-15T23:19:33.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.336+0000 7f34c401e640 1 -- start start 2024-09-15T23:19:33.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.337+0000 7f34c401e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34bc158d60 0x7f34bc06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:33.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.337+0000 7f34c401e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f34bc06fc80 0x7f34bc0b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:33.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.337+0000 7f34c401e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34bc15efb0 con 0x7f34bc06c150 2024-09-15T23:19:33.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.337+0000 7f34c401e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f34bc06c5b0 con 0x7f34bc06fc80 2024-09-15T23:19:33.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.337+0000 7f34c401e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f34bc15f290 con 0x7f34bc158d60 2024-09-15T23:19:33.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.337+0000 7f34c25bb640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f34bc06fc80 0x7f34bc0b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:33.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.337+0000 7f34c25bb640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f34bc06fc80 0x7f34bc0b21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41580/0 (socket says 172.21.15.123:41580) 2024-09-15T23:19:33.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.337+0000 7f34c25bb640 1 -- 172.21.15.123:0/1311979360 learned_addr learned my addr 172.21.15.123:0/1311979360 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:33.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.338+0000 7f34c25bb640 1 -- 172.21.15.123:0/1311979360 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34bc158d60 msgr2=0x7f34bc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:33.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.338+0000 7f34c25bb640 1 --2- 172.21.15.123:0/1311979360 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34bc158d60 0x7f34bc06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:33.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.338+0000 7f34c25bb640 1 -- 172.21.15.123:0/1311979360 >> v1:172.21.15.188:6789/0 conn(0x7f34bc06c150 legacy=0x7f34bc06f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:33.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.338+0000 7f34c25bb640 1 -- 172.21.15.123:0/1311979360 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34bc15f570 con 0x7f34bc06fc80 2024-09-15T23:19:33.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.338+0000 7f34c25bb640 1 --2- 172.21.15.123:0/1311979360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34bc06fc80 0x7f34bc0b21f0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f34b4009e50 tx=0x7f34b402a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=285cfbc3bfb67db6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:33.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.338+0000 7f34c0db8640 1 -- 172.21.15.123:0/1311979360 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b4036070 con 0x7f34bc06fc80 2024-09-15T23:19:33.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.338+0000 7f34c0db8640 1 -- 172.21.15.123:0/1311979360 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b4031600 con 0x7f34bc06fc80 2024-09-15T23:19:33.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.338+0000 7f34c0db8640 1 -- 172.21.15.123:0/1311979360 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b40319d0 con 0x7f34bc06fc80 2024-09-15T23:19:33.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.339+0000 7f34c401e640 1 -- 172.21.15.123:0/1311979360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34bc06fc80 msgr2=0x7f34bc0b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:33.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.339+0000 7f34c401e640 1 --2- 172.21.15.123:0/1311979360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34bc06fc80 0x7f34bc0b21f0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f34b4009e50 tx=0x7f34b402a630 comp rx=0 tx=0).stop 2024-09-15T23:19:33.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.339+0000 7f34c401e640 1 -- 172.21.15.123:0/1311979360 shutdown_connections 2024-09-15T23:19:33.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.339+0000 7f34c401e640 1 --2- 172.21.15.123:0/1311979360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34bc06fc80 0x7f34bc0b21f0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:33.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.339+0000 7f34c401e640 1 --2- 172.21.15.123:0/1311979360 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34bc158d60 0x7f34bc06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:33.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.339+0000 7f34c401e640 1 -- 172.21.15.123:0/1311979360 >> 172.21.15.123:0/1311979360 conn(0x7f34bc067da0 msgr2=0x7f34bc06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:33.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.339+0000 7f34c401e640 1 -- 172.21.15.123:0/1311979360 shutdown_connections 2024-09-15T23:19:33.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.339+0000 7f34c401e640 1 -- 172.21.15.123:0/1311979360 wait complete. 2024-09-15T23:19:33.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.340+0000 7f34c401e640 1 Processor -- start 2024-09-15T23:19:33.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.340+0000 7f34c401e640 1 -- start start 2024-09-15T23:19:33.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.341+0000 7f34c401e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34bc06c150 0x7f34bc1520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:33.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.341+0000 7f34c401e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34bc06fc80 0x7f34bc15ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:33.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.341+0000 7f34c401e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34bc158d60 0x7f34bc06e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:33.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.341+0000 7f34c401e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f34bc1592c0 con 0x7f34bc158d60 2024-09-15T23:19:33.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.341+0000 7f34c401e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f34bc159140 con 0x7f34bc06c150 2024-09-15T23:19:33.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.341+0000 7f34c401e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f34bc0b2730 con 0x7f34bc06fc80 2024-09-15T23:19:33.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.341+0000 7f34c25bb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34bc158d60 0x7f34bc06e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:33.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.341+0000 7f34c25bb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34bc158d60 0x7f34bc06e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41592/0 (socket says 172.21.15.123:41592) 2024-09-15T23:19:33.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.341+0000 7f34c25bb640 1 -- 172.21.15.123:0/3681592162 learned_addr learned my addr 172.21.15.123:0/3681592162 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:33.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.341+0000 7f34c1dba640 1 --2- 172.21.15.123:0/3681592162 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34bc06c150 0x7f34bc1520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:33.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.341+0000 7f34c15b9640 1 --2- 172.21.15.123:0/3681592162 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34bc06fc80 0x7f34bc15ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:33.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.341+0000 7f34c25bb640 1 -- 172.21.15.123:0/3681592162 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34bc06fc80 msgr2=0x7f34bc15ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:33.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.341+0000 7f34c25bb640 1 --2- 172.21.15.123:0/3681592162 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34bc06fc80 0x7f34bc15ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:33.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.341+0000 7f34c25bb640 1 -- 172.21.15.123:0/3681592162 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34bc06c150 msgr2=0x7f34bc1520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:33.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.341+0000 7f34c25bb640 1 --2- 172.21.15.123:0/3681592162 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34bc06c150 0x7f34bc1520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:33.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.341+0000 7f34c25bb640 1 -- 172.21.15.123:0/3681592162 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34bc160990 con 0x7f34bc158d60 2024-09-15T23:19:33.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.342+0000 7f34c25bb640 1 --2- 172.21.15.123:0/3681592162 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34bc158d60 0x7f34bc06e200 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f34b4034040 tx=0x7f34b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:33.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.342+0000 7f34ba7fc640 1 -- 172.21.15.123:0/3681592162 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b4041020 con 0x7f34bc158d60 2024-09-15T23:19:33.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.342+0000 7f34ba7fc640 1 -- 172.21.15.123:0/3681592162 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b4007780 con 0x7f34bc158d60 2024-09-15T23:19:33.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.342+0000 7f34c401e640 1 -- 172.21.15.123:0/3681592162 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34bc160c70 con 0x7f34bc158d60 2024-09-15T23:19:33.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.342+0000 7f34ba7fc640 1 -- 172.21.15.123:0/3681592162 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b4036040 con 0x7f34bc158d60 2024-09-15T23:19:33.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.342+0000 7f34c401e640 1 -- 172.21.15.123:0/3681592162 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34bc1f5570 con 0x7f34bc158d60 2024-09-15T23:19:33.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.343+0000 7f34c401e640 1 -- 172.21.15.123:0/3681592162 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34bc0b4040 con 0x7f34bc158d60 2024-09-15T23:19:33.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.343+0000 7f34ba7fc640 1 -- 172.21.15.123:0/3681592162 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f34b4044020 con 0x7f34bc158d60 2024-09-15T23:19:33.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.344+0000 7f34ba7fc640 1 --2- 172.21.15.123:0/3681592162 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f34a806c2b0 0x7f34a806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:33.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.344+0000 7f34ba7fc640 1 -- 172.21.15.123:0/3681592162 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 4857+0+0 (secure 0 0 0) 0x7f34b40abda0 con 0x7f34bc158d60 2024-09-15T23:19:33.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.344+0000 7f34c1dba640 1 --2- 172.21.15.123:0/3681592162 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f34a806c2b0 0x7f34a806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:33.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.344+0000 7f34c1dba640 1 --2- 172.21.15.123:0/3681592162 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f34a806c2b0 0x7f34a806e770 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f34bc0d0dc0 tx=0x7f34ac009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:33.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.348+0000 7f34ba7fc640 1 -- 172.21.15.123:0/3681592162 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f34bc0b4040 con 0x7f34bc158d60 2024-09-15T23:19:33.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.513+0000 7f34c401e640 1 -- 172.21.15.123:0/3681592162 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f34bc0b21f0 con 0x7f34bc158d60 2024-09-15T23:19:33.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.575+0000 7f34ba7fc640 1 -- 172.21.15.123:0/3681592162 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v139) ==== 138+0+0 (secure 0 0 0) 0x7f34b404b030 con 0x7f34bc158d60 2024-09-15T23:19:33.577 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' created 2024-09-15T23:19:33.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.578+0000 7f34c401e640 1 -- 172.21.15.123:0/3681592162 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f34a806c2b0 msgr2=0x7f34a806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:33.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.578+0000 7f34c401e640 1 --2- 172.21.15.123:0/3681592162 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f34a806c2b0 0x7f34a806e770 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f34bc0d0dc0 tx=0x7f34ac009060 comp rx=0 tx=0).stop 2024-09-15T23:19:33.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.578+0000 7f34c401e640 1 -- 172.21.15.123:0/3681592162 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34bc158d60 msgr2=0x7f34bc06e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:33.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.578+0000 7f34c401e640 1 --2- 172.21.15.123:0/3681592162 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34bc158d60 0x7f34bc06e200 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f34b4034040 tx=0x7f34b4004a40 comp rx=0 tx=0).stop 2024-09-15T23:19:33.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.578+0000 7f34c401e640 1 -- 172.21.15.123:0/3681592162 shutdown_connections 2024-09-15T23:19:33.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.578+0000 7f34c401e640 1 --2- 172.21.15.123:0/3681592162 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f34a806c2b0 0x7f34a806e770 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:33.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.578+0000 7f34c401e640 1 --2- 172.21.15.123:0/3681592162 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34bc158d60 0x7f34bc06e200 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:33.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.578+0000 7f34c401e640 1 --2- 172.21.15.123:0/3681592162 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34bc06fc80 0x7f34bc15ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:33.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.578+0000 7f34c401e640 1 --2- 172.21.15.123:0/3681592162 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34bc06c150 0x7f34bc1520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:33.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.578+0000 7f34c401e640 1 -- 172.21.15.123:0/3681592162 >> 172.21.15.123:0/3681592162 conn(0x7f34bc067da0 msgr2=0x7f34bc0b5350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:33.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.578+0000 7f34c401e640 1 -- 172.21.15.123:0/3681592162 shutdown_connections 2024-09-15T23:19:33.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.579+0000 7f34c401e640 1 -- 172.21.15.123:0/3681592162 wait complete. 2024-09-15T23:19:33.594 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T23:19:33.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.698+0000 7efc1372a640 1 Processor -- start 2024-09-15T23:19:33.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.698+0000 7efc1372a640 1 -- start start 2024-09-15T23:19:33.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.699+0000 7efc1372a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc0c070f40 0x7efc0c158920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:33.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.699+0000 7efc1372a640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7efc0c073ac0 0x7efc0c0ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:33.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.699+0000 7efc1372a640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc0c0ce0f0 con 0x7efc0c06bc10 2024-09-15T23:19:33.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.699+0000 7efc1372a640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7efc0c073f20 con 0x7efc0c073ac0 2024-09-15T23:19:33.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.699+0000 7efc1372a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7efc0c072130 con 0x7efc0c070f40 2024-09-15T23:19:33.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.699+0000 7efc11cc7640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7efc0c06bc10 0x7efc0c15e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:33784/0 (socket says 172.21.15.123:33784) 2024-09-15T23:19:33.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.699+0000 7efc11cc7640 1 -- 172.21.15.123:0/2666081247 learned_addr learned my addr 172.21.15.123:0/2666081247 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:19:33.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.699+0000 7efc114c6640 1 --2- 172.21.15.123:0/2666081247 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc0c070f40 0x7efc0c158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:33.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.699+0000 7efc03fff640 1 -- 172.21.15.123:0/2666081247 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2580475003 0 0) 0x7efc0c0ce0f0 con 0x7efc0c06bc10 2024-09-15T23:19:33.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.699+0000 7efc10cc5640 1 --2- 172.21.15.123:0/2666081247 >> v2:172.21.15.188:3300/0 conn(0x7efc0c073ac0 0x7efc0c0ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:33.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.699+0000 7efc03fff640 1 -- 172.21.15.123:0/2666081247 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efbf8003520 con 0x7efc0c06bc10 2024-09-15T23:19:33.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.699+0000 7efc03fff640 1 -- 172.21.15.123:0/2666081247 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4238840752 0 0) 0x7efbf8003520 con 0x7efc0c06bc10 2024-09-15T23:19:33.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.699+0000 7efc03fff640 1 -- 172.21.15.123:0/2666081247 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc0c070f40 msgr2=0x7efc0c158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:33.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.699+0000 7efc03fff640 1 --2- 172.21.15.123:0/2666081247 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc0c070f40 0x7efc0c158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:33.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.699+0000 7efc03fff640 1 -- 172.21.15.123:0/2666081247 >> v2:172.21.15.188:3300/0 conn(0x7efc0c073ac0 msgr2=0x7efc0c0ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:33.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.699+0000 7efc03fff640 1 --2- 172.21.15.123:0/2666081247 >> v2:172.21.15.188:3300/0 conn(0x7efc0c073ac0 0x7efc0c0ccf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:33.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.699+0000 7efc03fff640 1 -- 172.21.15.123:0/2666081247 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc0c071500 con 0x7efc0c06bc10 2024-09-15T23:19:33.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.700+0000 7efc03fff640 1 -- 172.21.15.123:0/2666081247 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7efc040019f0 con 0x7efc0c06bc10 2024-09-15T23:19:33.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.700+0000 7efc03fff640 1 -- 172.21.15.123:0/2666081247 >> v1:172.21.15.123:6789/0 conn(0x7efc0c06bc10 legacy=0x7efc0c15e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:33.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.700+0000 7efc03fff640 1 --2- 172.21.15.123:0/2666081247 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efbf80039b0 0x7efbf8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:33.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.700+0000 7efc03fff640 1 --2- 172.21.15.123:0/2666081247 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc0c070f40 0x7efbf8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:33.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.700+0000 7efc03fff640 1 --2- 172.21.15.123:0/2666081247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efbf8004d40 0x7efbf80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:33.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.700+0000 7efc03fff640 1 -- 172.21.15.123:0/2666081247 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c073f20 con 0x7efbf8004d40 2024-09-15T23:19:33.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.700+0000 7efc03fff640 1 -- 172.21.15.123:0/2666081247 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c072130 con 0x7efbf80039b0 2024-09-15T23:19:33.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.700+0000 7efc03fff640 1 -- 172.21.15.123:0/2666081247 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7efbf800ba40 con 0x7efc0c070f40 2024-09-15T23:19:33.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.700+0000 7efc11cc7640 1 --2- 172.21.15.123:0/2666081247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efbf8004d40 0x7efbf80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:33.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.700+0000 7efc10cc5640 1 --2- 172.21.15.123:0/2666081247 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc0c070f40 0x7efbf8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:33.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.700+0000 7efc114c6640 1 --2- 172.21.15.123:0/2666081247 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efbf80039b0 0x7efbf8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:33.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.700+0000 7efc11cc7640 1 -- 172.21.15.123:0/2666081247 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc0c070f40 msgr2=0x7efbf8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:33.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.700+0000 7efc11cc7640 1 --2- 172.21.15.123:0/2666081247 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc0c070f40 0x7efbf8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:33.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.700+0000 7efc11cc7640 1 -- 172.21.15.123:0/2666081247 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efbf80039b0 msgr2=0x7efbf8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:33.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.700+0000 7efc11cc7640 1 --2- 172.21.15.123:0/2666081247 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efbf80039b0 0x7efbf8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:33.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.700+0000 7efc11cc7640 1 -- 172.21.15.123:0/2666081247 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbf8003520 con 0x7efbf8004d40 2024-09-15T23:19:33.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.701+0000 7efc11cc7640 1 --2- 172.21.15.123:0/2666081247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efbf8004d40 0x7efbf80051c0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7efc0400a870 tx=0x7efbf8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3661a04fad7cfd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:33.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.701+0000 7efc03fff640 1 -- 172.21.15.123:0/2666081247 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0400a4c0 con 0x7efbf8004d40 2024-09-15T23:19:33.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.701+0000 7efc03fff640 1 -- 172.21.15.123:0/2666081247 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc0402f070 con 0x7efbf8004d40 2024-09-15T23:19:33.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.701+0000 7efc03fff640 1 -- 172.21.15.123:0/2666081247 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0402bcc0 con 0x7efbf8004d40 2024-09-15T23:19:33.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.701+0000 7efc1372a640 1 -- 172.21.15.123:0/2666081247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efbf8004d40 msgr2=0x7efbf80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:33.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.701+0000 7efc1372a640 1 --2- 172.21.15.123:0/2666081247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efbf8004d40 0x7efbf80051c0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7efc0400a870 tx=0x7efbf8005830 comp rx=0 tx=0).stop 2024-09-15T23:19:33.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.701+0000 7efc11cc7640 1 -- 172.21.15.123:0/2666081247 reap_dead start 2024-09-15T23:19:33.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.701+0000 7efc1372a640 1 -- 172.21.15.123:0/2666081247 shutdown_connections 2024-09-15T23:19:33.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.701+0000 7efc1372a640 1 -- 172.21.15.123:0/2666081247 >> 172.21.15.123:0/2666081247 conn(0x7efc0c06d0f0 msgr2=0x7efc0c06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:33.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.702+0000 7efc1372a640 1 -- 172.21.15.123:0/2666081247 shutdown_connections 2024-09-15T23:19:33.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.702+0000 7efc1372a640 1 -- 172.21.15.123:0/2666081247 wait complete. 2024-09-15T23:19:33.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.703+0000 7efc1372a640 1 Processor -- start 2024-09-15T23:19:33.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.703+0000 7efc1372a640 1 -- start start 2024-09-15T23:19:33.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.703+0000 7efc1372a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efbf8004d40 0x7efc0c143180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:33.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.703+0000 7efc1372a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc0c1502a0 0x7efc0c157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:33.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.703+0000 7efc1372a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc0c155cf0 0x7efc0c1561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:33.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.703+0000 7efc1372a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c06cc30 con 0x7efbf8004d40 2024-09-15T23:19:33.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.703+0000 7efc1372a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c071dc0 con 0x7efc0c155cf0 2024-09-15T23:19:33.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.703+0000 7efc1372a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7efc0c0725c0 con 0x7efc0c1502a0 2024-09-15T23:19:33.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.703+0000 7efc114c6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efbf8004d40 0x7efc0c143180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:33.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.703+0000 7efc114c6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efbf8004d40 0x7efc0c143180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41616/0 (socket says 172.21.15.123:41616) 2024-09-15T23:19:33.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.703+0000 7efc114c6640 1 -- 172.21.15.123:0/2895524595 learned_addr learned my addr 172.21.15.123:0/2895524595 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:33.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.704+0000 7efc10cc5640 1 --2- 172.21.15.123:0/2895524595 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc0c1502a0 0x7efc0c157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:33.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.704+0000 7efc11cc7640 1 --2- 172.21.15.123:0/2895524595 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc0c155cf0 0x7efc0c1561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:33.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.704+0000 7efc114c6640 1 -- 172.21.15.123:0/2895524595 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc0c1502a0 msgr2=0x7efc0c157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:33.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.704+0000 7efc114c6640 1 --2- 172.21.15.123:0/2895524595 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc0c1502a0 0x7efc0c157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:33.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.704+0000 7efc114c6640 1 -- 172.21.15.123:0/2895524595 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc0c155cf0 msgr2=0x7efc0c1561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:33.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.704+0000 7efc114c6640 1 --2- 172.21.15.123:0/2895524595 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc0c155cf0 0x7efc0c1561a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:33.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.704+0000 7efc114c6640 1 -- 172.21.15.123:0/2895524595 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc0c1436c0 con 0x7efbf8004d40 2024-09-15T23:19:33.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.704+0000 7efc11cc7640 1 --2- 172.21.15.123:0/2895524595 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc0c155cf0 0x7efc0c1561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:19:33.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.704+0000 7efc114c6640 1 --2- 172.21.15.123:0/2895524595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efbf8004d40 0x7efc0c143180 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7efc080118e0 tx=0x7efc08011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:33.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.704+0000 7efc01ffb640 1 -- 172.21.15.123:0/2895524595 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0800fa30 con 0x7efbf8004d40 2024-09-15T23:19:33.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.704+0000 7efc01ffb640 1 -- 172.21.15.123:0/2895524595 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc0800fbd0 con 0x7efbf8004d40 2024-09-15T23:19:33.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.704+0000 7efc1372a640 1 -- 172.21.15.123:0/2895524595 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc0c154a90 con 0x7efbf8004d40 2024-09-15T23:19:33.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.704+0000 7efc01ffb640 1 -- 172.21.15.123:0/2895524595 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc08014440 con 0x7efbf8004d40 2024-09-15T23:19:33.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.704+0000 7efc1372a640 1 -- 172.21.15.123:0/2895524595 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc0c155050 con 0x7efbf8004d40 2024-09-15T23:19:33.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.705+0000 7efc1372a640 1 -- 172.21.15.123:0/2895524595 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc0c158920 con 0x7efbf8004d40 2024-09-15T23:19:33.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.706+0000 7efc01ffb640 1 -- 172.21.15.123:0/2895524595 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7efc08012040 con 0x7efbf8004d40 2024-09-15T23:19:33.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.706+0000 7efc01ffb640 1 --2- 172.21.15.123:0/2895524595 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efbf006c2b0 0x7efbf006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:33.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.706+0000 7efc01ffb640 1 -- 172.21.15.123:0/2895524595 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5227+0+0 (secure 0 0 0) 0x7efc0808b880 con 0x7efbf8004d40 2024-09-15T23:19:33.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.707+0000 7efc10cc5640 1 --2- 172.21.15.123:0/2895524595 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efbf006c2b0 0x7efbf006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:33.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.707+0000 7efc10cc5640 1 --2- 172.21.15.123:0/2895524595 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efbf006c2b0 0x7efbf006e770 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7efc0c150130 tx=0x7efbfc009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:33.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.711+0000 7efc01ffb640 1 -- 172.21.15.123:0/2895524595 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efc0c1436c0 con 0x7efbf8004d40 2024-09-15T23:19:33.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:33.875+0000 7efc1372a640 1 -- 172.21.15.123:0/2895524595 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7efc0c15d1b0 con 0x7efbf8004d40 2024-09-15T23:19:34.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.577+0000 7efc01ffb640 1 -- 172.21.15.123:0/2895524595 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v140) ==== 170+0+0 (secure 0 0 0) 0x7efc08019030 con 0x7efbf8004d40 2024-09-15T23:19:34.579 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' created 2024-09-15T23:19:34.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.579+0000 7efc1372a640 1 -- 172.21.15.123:0/2895524595 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efbf006c2b0 msgr2=0x7efbf006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:34.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.579+0000 7efc1372a640 1 --2- 172.21.15.123:0/2895524595 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efbf006c2b0 0x7efbf006e770 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7efc0c150130 tx=0x7efbfc009190 comp rx=0 tx=0).stop 2024-09-15T23:19:34.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.579+0000 7efc1372a640 1 -- 172.21.15.123:0/2895524595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efbf8004d40 msgr2=0x7efc0c143180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:34.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.579+0000 7efc1372a640 1 --2- 172.21.15.123:0/2895524595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efbf8004d40 0x7efc0c143180 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7efc080118e0 tx=0x7efc08011ce0 comp rx=0 tx=0).stop 2024-09-15T23:19:34.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.579+0000 7efc1372a640 1 -- 172.21.15.123:0/2895524595 shutdown_connections 2024-09-15T23:19:34.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.579+0000 7efc1372a640 1 --2- 172.21.15.123:0/2895524595 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc0c155cf0 0x7efc0c1561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:34.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.579+0000 7efc1372a640 1 --2- 172.21.15.123:0/2895524595 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc0c1502a0 0x7efc0c157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:34.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.579+0000 7efc1372a640 1 --2- 172.21.15.123:0/2895524595 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efbf006c2b0 0x7efbf006e770 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:34.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.579+0000 7efc1372a640 1 --2- 172.21.15.123:0/2895524595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efbf8004d40 0x7efc0c143180 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:34.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.579+0000 7efc1372a640 1 -- 172.21.15.123:0/2895524595 >> 172.21.15.123:0/2895524595 conn(0x7efc0c06d0f0 msgr2=0x7efc0c160ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:34.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.579+0000 7efc1372a640 1 -- 172.21.15.123:0/2895524595 shutdown_connections 2024-09-15T23:19:34.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.579+0000 7efc1372a640 1 -- 172.21.15.123:0/2895524595 wait complete. 2024-09-15T23:19:34.602 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T23:19:34.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.701+0000 7fbe6fb66640 1 Processor -- start 2024-09-15T23:19:34.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.701+0000 7fbe6fb66640 1 -- start start 2024-09-15T23:19:34.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.702+0000 7fbe6fb66640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbe68158c80 0x7fbe68162230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:34.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.702+0000 7fbe6fb66640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbe680afb90 0x7fbe680729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:34.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.702+0000 7fbe6fb66640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe68144090 con 0x7fbe6806bc10 2024-09-15T23:19:34.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.702+0000 7fbe6fb66640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fbe68141a00 con 0x7fbe68158c80 2024-09-15T23:19:34.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.702+0000 7fbe6fb66640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbe68072f10 con 0x7fbe680afb90 2024-09-15T23:19:34.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.702+0000 7fbe6d902640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbe68158c80 0x7fbe68162230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:34.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.702+0000 7fbe6e103640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fbe6806bc10 0x7fbe6815ef90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:33792/0 (socket says 172.21.15.123:33792) 2024-09-15T23:19:34.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.702+0000 7fbe6e103640 1 -- 172.21.15.123:0/4049509313 learned_addr learned my addr 172.21.15.123:0/4049509313 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:19:34.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.702+0000 7fbe6d101640 1 --2- 172.21.15.123:0/4049509313 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbe680afb90 0x7fbe680729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:34.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.702+0000 7fbe6d902640 1 -- 172.21.15.123:0/4049509313 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbe680afb90 msgr2=0x7fbe680729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:34.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.702+0000 7fbe6d902640 1 --2- 172.21.15.123:0/4049509313 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbe680afb90 0x7fbe680729d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:34.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.702+0000 7fbe6d902640 1 -- 172.21.15.123:0/4049509313 >> v1:172.21.15.123:6789/0 conn(0x7fbe6806bc10 legacy=0x7fbe6815ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:34.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.702+0000 7fbe6c900640 1 -- 172.21.15.123:0/4049509313 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 558664293 0 0) 0x7fbe68144090 con 0x7fbe6806bc10 2024-09-15T23:19:34.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.702+0000 7fbe6d902640 1 -- 172.21.15.123:0/4049509313 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe68144370 con 0x7fbe68158c80 2024-09-15T23:19:34.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.703+0000 7fbe6d101640 1 --2- 172.21.15.123:0/4049509313 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbe680afb90 0x7fbe680729d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:19:34.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.703+0000 7fbe6d902640 1 --2- 172.21.15.123:0/4049509313 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe68158c80 0x7fbe68162230 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fbe640097a0 tx=0x7fbe6402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c3798d7bb5da96 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:34.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.703+0000 7fbe6c900640 1 -- 172.21.15.123:0/4049509313 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe64037070 con 0x7fbe68158c80 2024-09-15T23:19:34.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.703+0000 7fbe6c900640 1 -- 172.21.15.123:0/4049509313 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe64032440 con 0x7fbe68158c80 2024-09-15T23:19:34.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.703+0000 7fbe6c900640 1 -- 172.21.15.123:0/4049509313 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe64032810 con 0x7fbe68158c80 2024-09-15T23:19:34.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.704+0000 7fbe6fb66640 1 -- 172.21.15.123:0/4049509313 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe68158c80 msgr2=0x7fbe68162230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:34.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.704+0000 7fbe6fb66640 1 --2- 172.21.15.123:0/4049509313 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe68158c80 0x7fbe68162230 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fbe640097a0 tx=0x7fbe6402a180 comp rx=0 tx=0).stop 2024-09-15T23:19:34.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.704+0000 7fbe6fb66640 1 -- 172.21.15.123:0/4049509313 shutdown_connections 2024-09-15T23:19:34.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.704+0000 7fbe6fb66640 1 --2- 172.21.15.123:0/4049509313 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbe680afb90 0x7fbe680729d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:34.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.704+0000 7fbe6fb66640 1 --2- 172.21.15.123:0/4049509313 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe68158c80 0x7fbe68162230 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:34.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.704+0000 7fbe6fb66640 1 -- 172.21.15.123:0/4049509313 >> 172.21.15.123:0/4049509313 conn(0x7fbe6806cd20 msgr2=0x7fbe6806d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:34.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.704+0000 7fbe6fb66640 1 -- 172.21.15.123:0/4049509313 shutdown_connections 2024-09-15T23:19:34.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.704+0000 7fbe6fb66640 1 -- 172.21.15.123:0/4049509313 wait complete. 2024-09-15T23:19:34.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.705+0000 7fbe6fb66640 1 Processor -- start 2024-09-15T23:19:34.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.705+0000 7fbe6fb66640 1 -- start start 2024-09-15T23:19:34.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.706+0000 7fbe6fb66640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbe6806bc10 0x7fbe681f7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:34.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.706+0000 7fbe6fb66640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbe680afb90 0x7fbe681f8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:34.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.706+0000 7fbe6fb66640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe68158c80 0x7fbe681423e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:34.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.706+0000 7fbe6fb66640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbe68144c10 con 0x7fbe68158c80 2024-09-15T23:19:34.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.706+0000 7fbe6fb66640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbe68144930 con 0x7fbe6806bc10 2024-09-15T23:19:34.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.706+0000 7fbe6fb66640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbe68159060 con 0x7fbe680afb90 2024-09-15T23:19:34.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.706+0000 7fbe6e103640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe68158c80 0x7fbe681423e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:34.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.706+0000 7fbe6e103640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe68158c80 0x7fbe681423e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41626/0 (socket says 172.21.15.123:41626) 2024-09-15T23:19:34.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.706+0000 7fbe6e103640 1 -- 172.21.15.123:0/1867224400 learned_addr learned my addr 172.21.15.123:0/1867224400 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:34.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.706+0000 7fbe6d902640 1 --2- 172.21.15.123:0/1867224400 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbe6806bc10 0x7fbe681f7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:34.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.706+0000 7fbe6e103640 1 -- 172.21.15.123:0/1867224400 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbe680afb90 msgr2=0x7fbe681f8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:34.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.706+0000 7fbe6e103640 1 --2- 172.21.15.123:0/1867224400 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbe680afb90 0x7fbe681f8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:34.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.706+0000 7fbe6e103640 1 -- 172.21.15.123:0/1867224400 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbe6806bc10 msgr2=0x7fbe681f7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:34.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.706+0000 7fbe6e103640 1 --2- 172.21.15.123:0/1867224400 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbe6806bc10 0x7fbe681f7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:34.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.706+0000 7fbe6e103640 1 -- 172.21.15.123:0/1867224400 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe6815cbf0 con 0x7fbe68158c80 2024-09-15T23:19:34.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.706+0000 7fbe6e103640 1 --2- 172.21.15.123:0/1867224400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe68158c80 0x7fbe681423e0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fbe6000c7a0 tx=0x7fbe6000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:34.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.707+0000 7fbe5e7fc640 1 -- 172.21.15.123:0/1867224400 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe60018070 con 0x7fbe68158c80 2024-09-15T23:19:34.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.707+0000 7fbe5e7fc640 1 -- 172.21.15.123:0/1867224400 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe6000a640 con 0x7fbe68158c80 2024-09-15T23:19:34.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.707+0000 7fbe6fb66640 1 -- 172.21.15.123:0/1867224400 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe6815ced0 con 0x7fbe68158c80 2024-09-15T23:19:34.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.707+0000 7fbe5e7fc640 1 -- 172.21.15.123:0/1867224400 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6000aab0 con 0x7fbe68158c80 2024-09-15T23:19:34.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.707+0000 7fbe6fb66640 1 -- 172.21.15.123:0/1867224400 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe6815d490 con 0x7fbe68158c80 2024-09-15T23:19:34.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.708+0000 7fbe6fb66640 1 -- 172.21.15.123:0/1867224400 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe68073860 con 0x7fbe68158c80 2024-09-15T23:19:34.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.708+0000 7fbe5e7fc640 1 -- 172.21.15.123:0/1867224400 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbe6001b070 con 0x7fbe68158c80 2024-09-15T23:19:34.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.709+0000 7fbe5e7fc640 1 --2- 172.21.15.123:0/1867224400 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbe4c06c2b0 0x7fbe4c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:34.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.709+0000 7fbe5e7fc640 1 -- 172.21.15.123:0/1867224400 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5609+0+0 (secure 0 0 0) 0x7fbe6008aa10 con 0x7fbe68158c80 2024-09-15T23:19:34.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.709+0000 7fbe6d902640 1 --2- 172.21.15.123:0/1867224400 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbe4c06c2b0 0x7fbe4c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:34.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.709+0000 7fbe6d902640 1 --2- 172.21.15.123:0/1867224400 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbe4c06c2b0 0x7fbe4c06e770 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fbe64034000 tx=0x7fbe6402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:34.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.713+0000 7fbe5e7fc640 1 -- 172.21.15.123:0/1867224400 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbe600591e0 con 0x7fbe68158c80 2024-09-15T23:19:34.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:34.914+0000 7fbe6fb66640 1 -- 172.21.15.123:0/1867224400 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fbe6806fee0 con 0x7fbe68158c80 2024-09-15T23:19:35.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.613+0000 7fbe5e7fc640 1 -- 172.21.15.123:0/1867224400 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v84) ==== 174+0+0 (secure 0 0 0) 0x7fbe60058ae0 con 0x7fbe68158c80 2024-09-15T23:19:35.615 INFO:teuthology.orchestra.run.smithi123.stderr:new fs with metadata pool 18 and data pool 19 2024-09-15T23:19:35.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.618+0000 7fbe6fb66640 1 -- 172.21.15.123:0/1867224400 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbe4c06c2b0 msgr2=0x7fbe4c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:35.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.618+0000 7fbe6fb66640 1 --2- 172.21.15.123:0/1867224400 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbe4c06c2b0 0x7fbe4c06e770 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fbe64034000 tx=0x7fbe6402e000 comp rx=0 tx=0).stop 2024-09-15T23:19:35.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.618+0000 7fbe6fb66640 1 -- 172.21.15.123:0/1867224400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe68158c80 msgr2=0x7fbe681423e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:35.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.618+0000 7fbe6fb66640 1 --2- 172.21.15.123:0/1867224400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe68158c80 0x7fbe681423e0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fbe6000c7a0 tx=0x7fbe6000cc60 comp rx=0 tx=0).stop 2024-09-15T23:19:35.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.618+0000 7fbe6fb66640 1 -- 172.21.15.123:0/1867224400 shutdown_connections 2024-09-15T23:19:35.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.618+0000 7fbe6fb66640 1 --2- 172.21.15.123:0/1867224400 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbe4c06c2b0 0x7fbe4c06e770 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:35.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.618+0000 7fbe6fb66640 1 --2- 172.21.15.123:0/1867224400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbe68158c80 0x7fbe681423e0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:35.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.618+0000 7fbe6fb66640 1 --2- 172.21.15.123:0/1867224400 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbe680afb90 0x7fbe681f8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:35.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.618+0000 7fbe6fb66640 1 --2- 172.21.15.123:0/1867224400 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbe6806bc10 0x7fbe681f7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:35.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.618+0000 7fbe6fb66640 1 -- 172.21.15.123:0/1867224400 >> 172.21.15.123:0/1867224400 conn(0x7fbe6806cd20 msgr2=0x7fbe6806c060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:35.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.618+0000 7fbe6fb66640 1 -- 172.21.15.123:0/1867224400 shutdown_connections 2024-09-15T23:19:35.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.618+0000 7fbe6fb66640 1 -- 172.21.15.123:0/1867224400 wait complete. 2024-09-15T23:19:35.645 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:19:35.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.743+0000 7f7b97149640 1 Processor -- start 2024-09-15T23:19:35.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.743+0000 7f7b97149640 1 -- start start 2024-09-15T23:19:35.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.743+0000 7f7b97149640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7b9015ed20 0x7f7b900b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:35.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.743+0000 7f7b97149640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7b900d23b0 0x7f7b900b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:35.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.743+0000 7f7b97149640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b900cf2d0 0x7f7b900cf740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:35.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.743+0000 7f7b97149640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f7b900d0e70 con 0x7f7b9015ed20 2024-09-15T23:19:35.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.743+0000 7f7b97149640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f7b900d41c0 con 0x7f7b900d23b0 2024-09-15T23:19:35.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.743+0000 7f7b97149640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7b900d35b0 con 0x7f7b900cf2d0 2024-09-15T23:19:35.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.744+0000 7f7b94ee5640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7b9015ed20 0x7f7b900b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:35.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.744+0000 7f7b94ee5640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7b9015ed20 0x7f7b900b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41630/0 (socket says 172.21.15.123:41630) 2024-09-15T23:19:35.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.744+0000 7f7b94ee5640 1 -- 172.21.15.123:0/2202025289 learned_addr learned my addr 172.21.15.123:0/2202025289 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:35.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.744+0000 7f7b8ffff640 1 --2- 172.21.15.123:0/2202025289 >> v2:172.21.15.188:3300/0 conn(0x7f7b900d23b0 0x7f7b900b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:35.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.744+0000 7f7b956e6640 1 --2- 172.21.15.123:0/2202025289 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b900cf2d0 0x7f7b900cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:35.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.744+0000 7f7b94ee5640 1 -- 172.21.15.123:0/2202025289 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b900cf2d0 msgr2=0x7f7b900cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:35.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.744+0000 7f7b94ee5640 1 --2- 172.21.15.123:0/2202025289 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b900cf2d0 0x7f7b900cf740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:35.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.744+0000 7f7b94ee5640 1 -- 172.21.15.123:0/2202025289 >> v2:172.21.15.188:3300/0 conn(0x7f7b900d23b0 msgr2=0x7f7b900b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:35.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.744+0000 7f7b94ee5640 1 --2- 172.21.15.123:0/2202025289 >> v2:172.21.15.188:3300/0 conn(0x7f7b900d23b0 0x7f7b900b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:35.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.744+0000 7f7b94ee5640 1 -- 172.21.15.123:0/2202025289 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b900d3890 con 0x7f7b9015ed20 2024-09-15T23:19:35.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.745+0000 7f7b94ee5640 1 --2- 172.21.15.123:0/2202025289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b9015ed20 0x7f7b900b6260 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f7b900d4690 tx=0x7f7b8802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb006f0bc72ca9a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:35.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.745+0000 7f7b8f7fe640 1 -- 172.21.15.123:0/2202025289 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b88037070 con 0x7f7b9015ed20 2024-09-15T23:19:35.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.745+0000 7f7b8f7fe640 1 -- 172.21.15.123:0/2202025289 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b88032440 con 0x7f7b9015ed20 2024-09-15T23:19:35.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.745+0000 7f7b8f7fe640 1 -- 172.21.15.123:0/2202025289 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b88032810 con 0x7f7b9015ed20 2024-09-15T23:19:35.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.745+0000 7f7b97149640 1 -- 172.21.15.123:0/2202025289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b9015ed20 msgr2=0x7f7b900b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:35.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.745+0000 7f7b97149640 1 --2- 172.21.15.123:0/2202025289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b9015ed20 0x7f7b900b6260 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f7b900d4690 tx=0x7f7b8802a140 comp rx=0 tx=0).stop 2024-09-15T23:19:35.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.745+0000 7f7b97149640 1 -- 172.21.15.123:0/2202025289 shutdown_connections 2024-09-15T23:19:35.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.745+0000 7f7b97149640 1 --2- 172.21.15.123:0/2202025289 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b900cf2d0 0x7f7b900cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:35.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.745+0000 7f7b97149640 1 --2- 172.21.15.123:0/2202025289 >> v2:172.21.15.188:3300/0 conn(0x7f7b900d23b0 0x7f7b900b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:35.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.745+0000 7f7b97149640 1 --2- 172.21.15.123:0/2202025289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b9015ed20 0x7f7b900b6260 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:35.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.745+0000 7f7b97149640 1 -- 172.21.15.123:0/2202025289 >> 172.21.15.123:0/2202025289 conn(0x7f7b900d1260 msgr2=0x7f7b900d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:35.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.745+0000 7f7b97149640 1 -- 172.21.15.123:0/2202025289 shutdown_connections 2024-09-15T23:19:35.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.745+0000 7f7b97149640 1 -- 172.21.15.123:0/2202025289 wait complete. 2024-09-15T23:19:35.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.747+0000 7f7b97149640 1 Processor -- start 2024-09-15T23:19:35.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.747+0000 7f7b97149640 1 -- start start 2024-09-15T23:19:35.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.747+0000 7f7b97149640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b900cf2d0 0x7f7b900c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:35.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.747+0000 7f7b97149640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7b900d23b0 0x7f7b901f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:35.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.747+0000 7f7b97149640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b9015ed20 0x7f7b901e9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:35.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.747+0000 7f7b97149640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7b900d32a0 con 0x7f7b9015ed20 2024-09-15T23:19:35.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.747+0000 7f7b97149640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7b900d3e50 con 0x7f7b900d23b0 2024-09-15T23:19:35.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.747+0000 7f7b97149640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7b9015f100 con 0x7f7b900cf2d0 2024-09-15T23:19:35.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.748+0000 7f7b956e6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b9015ed20 0x7f7b901e9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:35.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.748+0000 7f7b956e6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b9015ed20 0x7f7b901e9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41646/0 (socket says 172.21.15.123:41646) 2024-09-15T23:19:35.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.748+0000 7f7b956e6640 1 -- 172.21.15.123:0/4008770145 learned_addr learned my addr 172.21.15.123:0/4008770145 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:35.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.748+0000 7f7b8ffff640 1 --2- 172.21.15.123:0/4008770145 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7b900d23b0 0x7f7b901f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:35.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.748+0000 7f7b94ee5640 1 --2- 172.21.15.123:0/4008770145 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b900cf2d0 0x7f7b900c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:35.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.748+0000 7f7b956e6640 1 -- 172.21.15.123:0/4008770145 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b900cf2d0 msgr2=0x7f7b900c98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:35.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.748+0000 7f7b956e6640 1 --2- 172.21.15.123:0/4008770145 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b900cf2d0 0x7f7b900c98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:35.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.748+0000 7f7b956e6640 1 -- 172.21.15.123:0/4008770145 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7b900d23b0 msgr2=0x7f7b901f51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:35.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.748+0000 7f7b956e6640 1 --2- 172.21.15.123:0/4008770145 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7b900d23b0 0x7f7b901f51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:35.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.748+0000 7f7b956e6640 1 -- 172.21.15.123:0/4008770145 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b901f5720 con 0x7f7b9015ed20 2024-09-15T23:19:35.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.748+0000 7f7b956e6640 1 --2- 172.21.15.123:0/4008770145 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b9015ed20 0x7f7b901e9710 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f7b8000d800 tx=0x7f7b8000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:35.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.748+0000 7f7b8d7fa640 1 -- 172.21.15.123:0/4008770145 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b80018020 con 0x7f7b9015ed20 2024-09-15T23:19:35.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.748+0000 7f7b8d7fa640 1 -- 172.21.15.123:0/4008770145 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b800096c0 con 0x7f7b9015ed20 2024-09-15T23:19:35.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.748+0000 7f7b97149640 1 -- 172.21.15.123:0/4008770145 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b901f59d0 con 0x7f7b9015ed20 2024-09-15T23:19:35.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.748+0000 7f7b8d7fa640 1 -- 172.21.15.123:0/4008770145 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b80009a90 con 0x7f7b9015ed20 2024-09-15T23:19:35.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.748+0000 7f7b97149640 1 -- 172.21.15.123:0/4008770145 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b901f5f90 con 0x7f7b9015ed20 2024-09-15T23:19:35.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.749+0000 7f7b97149640 1 -- 172.21.15.123:0/4008770145 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b900b7010 con 0x7f7b9015ed20 2024-09-15T23:19:35.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.750+0000 7f7b8d7fa640 1 -- 172.21.15.123:0/4008770145 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7b8001b020 con 0x7f7b9015ed20 2024-09-15T23:19:35.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.750+0000 7f7b8d7fa640 1 --2- 172.21.15.123:0/4008770145 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7b7006c2b0 0x7f7b7006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:35.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.750+0000 7f7b8d7fa640 1 -- 172.21.15.123:0/4008770145 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5709+0+0 (secure 0 0 0) 0x7f7b8008b4c0 con 0x7f7b9015ed20 2024-09-15T23:19:35.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.750+0000 7f7b94ee5640 1 --2- 172.21.15.123:0/4008770145 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7b7006c2b0 0x7f7b7006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:35.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.751+0000 7f7b94ee5640 1 --2- 172.21.15.123:0/4008770145 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7b7006c2b0 0x7f7b7006e770 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f7b88034000 tx=0x7f7b8802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:35.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.754+0000 7f7b8d7fa640 1 -- 172.21.15.123:0/4008770145 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7b80022030 con 0x7f7b9015ed20 2024-09-15T23:19:35.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.921+0000 7f7b97149640 1 -- 172.21.15.123:0/4008770145 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7b900b3f20 con 0x7f7b9015ed20 2024-09-15T23:19:35.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.922+0000 7f7b8d7fa640 1 -- 172.21.15.123:0/4008770145 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) ==== 74+0+16724 (secure 0 0 0) 0x7f7b800595e0 con 0x7f7b9015ed20 2024-09-15T23:19:35.924 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:19:35.924 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":141,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:19:34.917058+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:19:33.533001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-15T23:19:33.894858+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:19:35.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.924+0000 7f7b97149640 1 -- 172.21.15.123:0/4008770145 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7b7006c2b0 msgr2=0x7f7b7006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:35.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.924+0000 7f7b97149640 1 --2- 172.21.15.123:0/4008770145 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7b7006c2b0 0x7f7b7006e770 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f7b88034000 tx=0x7f7b8802e000 comp rx=0 tx=0).stop 2024-09-15T23:19:35.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.924+0000 7f7b97149640 1 -- 172.21.15.123:0/4008770145 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b9015ed20 msgr2=0x7f7b901e9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:35.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.924+0000 7f7b97149640 1 --2- 172.21.15.123:0/4008770145 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b9015ed20 0x7f7b901e9710 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f7b8000d800 tx=0x7f7b8000dcc0 comp rx=0 tx=0).stop 2024-09-15T23:19:35.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.924+0000 7f7b97149640 1 -- 172.21.15.123:0/4008770145 shutdown_connections 2024-09-15T23:19:35.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.924+0000 7f7b97149640 1 --2- 172.21.15.123:0/4008770145 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7b7006c2b0 0x7f7b7006e770 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:35.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.924+0000 7f7b97149640 1 --2- 172.21.15.123:0/4008770145 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b9015ed20 0x7f7b901e9710 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:35.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.924+0000 7f7b97149640 1 --2- 172.21.15.123:0/4008770145 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7b900d23b0 0x7f7b901f51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:35.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.924+0000 7f7b97149640 1 --2- 172.21.15.123:0/4008770145 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7b900cf2d0 0x7f7b900c98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:35.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.924+0000 7f7b97149640 1 -- 172.21.15.123:0/4008770145 >> 172.21.15.123:0/4008770145 conn(0x7f7b900d1260 msgr2=0x7f7b900b5510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:35.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.924+0000 7f7b97149640 1 -- 172.21.15.123:0/4008770145 shutdown_connections 2024-09-15T23:19:35.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:35.924+0000 7f7b97149640 1 -- 172.21.15.123:0/4008770145 wait complete. 2024-09-15T23:19:35.937 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:19:36.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.033+0000 7f9c176d7640 1 Processor -- start 2024-09-15T23:19:36.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.033+0000 7f9c176d7640 1 -- start start 2024-09-15T23:19:36.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.034+0000 7f9c176d7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9c1015c4b0 0x7f9c100b6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:36.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.034+0000 7f9c176d7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9c100d08e0 0x7f9c100b6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:36.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.034+0000 7f9c176d7640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c10067b50 con 0x7f9c100b02b0 2024-09-15T23:19:36.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.034+0000 7f9c176d7640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f9c100ce860 con 0x7f9c1015c4b0 2024-09-15T23:19:36.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.034+0000 7f9c176d7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9c10070130 con 0x7f9c100d08e0 2024-09-15T23:19:36.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.034+0000 7f9c15473640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9c1015c4b0 0x7f9c100b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:36.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.034+0000 7f9c14c72640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f9c100b02b0 0x7f9c10160120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:33796/0 (socket says 172.21.15.123:33796) 2024-09-15T23:19:36.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.034+0000 7f9c14c72640 1 -- 172.21.15.123:0/2302866627 learned_addr learned my addr 172.21.15.123:0/2302866627 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:19:36.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.034+0000 7f9c15473640 1 -- 172.21.15.123:0/2302866627 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9c100d08e0 msgr2=0x7f9c100b6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:36.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.034+0000 7f9c15473640 1 --2- 172.21.15.123:0/2302866627 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9c100d08e0 0x7f9c100b6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:36.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.034+0000 7f9c15473640 1 -- 172.21.15.123:0/2302866627 >> v1:172.21.15.123:6789/0 conn(0x7f9c100b02b0 legacy=0x7f9c10160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:36.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.034+0000 7f9c15473640 1 -- 172.21.15.123:0/2302866627 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c1006fe50 con 0x7f9c1015c4b0 2024-09-15T23:19:36.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.034+0000 7f9c07fff640 1 -- 172.21.15.123:0/2302866627 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 593571747 0 0) 0x7f9c00001110 con 0x7f9c100b02b0 2024-09-15T23:19:36.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.035+0000 7f9c15473640 1 --2- 172.21.15.123:0/2302866627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c1015c4b0 0x7f9c100b6120 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0097a0 tx=0x7f9c0c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19fc86cbbbf9b747 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:36.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.035+0000 7f9c07fff640 1 -- 172.21.15.123:0/2302866627 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c037070 con 0x7f9c1015c4b0 2024-09-15T23:19:36.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.035+0000 7f9c07fff640 1 -- 172.21.15.123:0/2302866627 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c0c032440 con 0x7f9c1015c4b0 2024-09-15T23:19:36.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.035+0000 7f9c07fff640 1 -- 172.21.15.123:0/2302866627 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c032810 con 0x7f9c1015c4b0 2024-09-15T23:19:36.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.036+0000 7f9c176d7640 1 -- 172.21.15.123:0/2302866627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c1015c4b0 msgr2=0x7f9c100b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:36.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.036+0000 7f9c176d7640 1 --2- 172.21.15.123:0/2302866627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c1015c4b0 0x7f9c100b6120 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0097a0 tx=0x7f9c0c02a180 comp rx=0 tx=0).stop 2024-09-15T23:19:36.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.036+0000 7f9c176d7640 1 -- 172.21.15.123:0/2302866627 shutdown_connections 2024-09-15T23:19:36.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.036+0000 7f9c176d7640 1 --2- 172.21.15.123:0/2302866627 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9c100d08e0 0x7f9c100b6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:36.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.036+0000 7f9c176d7640 1 --2- 172.21.15.123:0/2302866627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c1015c4b0 0x7f9c100b6120 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:36.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.036+0000 7f9c176d7640 1 -- 172.21.15.123:0/2302866627 >> 172.21.15.123:0/2302866627 conn(0x7f9c100b0a80 msgr2=0x7f9c100b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:36.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.036+0000 7f9c176d7640 1 -- 172.21.15.123:0/2302866627 shutdown_connections 2024-09-15T23:19:36.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.036+0000 7f9c176d7640 1 -- 172.21.15.123:0/2302866627 wait complete. 2024-09-15T23:19:36.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.037+0000 7f9c176d7640 1 Processor -- start 2024-09-15T23:19:36.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.037+0000 7f9c176d7640 1 -- start start 2024-09-15T23:19:36.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.037+0000 7f9c176d7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9c100b02b0 0x7f9c1014e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:36.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.037+0000 7f9c176d7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c100d08e0 0x7f9c101576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:36.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.037+0000 7f9c176d7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9c1015c4b0 0x7f9c1015f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:36.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.037+0000 7f9c176d7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9c1006dcc0 con 0x7f9c100d08e0 2024-09-15T23:19:36.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.038+0000 7f9c176d7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9c100ce580 con 0x7f9c100b02b0 2024-09-15T23:19:36.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.038+0000 7f9c176d7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9c1015c890 con 0x7f9c1015c4b0 2024-09-15T23:19:36.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.038+0000 7f9c14c72640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c100d08e0 0x7f9c101576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:36.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.038+0000 7f9c14c72640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c100d08e0 0x7f9c101576a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41678/0 (socket says 172.21.15.123:41678) 2024-09-15T23:19:36.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.038+0000 7f9c14c72640 1 -- 172.21.15.123:0/762068645 learned_addr learned my addr 172.21.15.123:0/762068645 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:36.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.038+0000 7f9c15473640 1 --2- 172.21.15.123:0/762068645 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9c100b02b0 0x7f9c1014e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:36.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.038+0000 7f9c15c74640 1 --2- 172.21.15.123:0/762068645 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9c1015c4b0 0x7f9c1015f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:36.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.038+0000 7f9c14c72640 1 -- 172.21.15.123:0/762068645 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9c1015c4b0 msgr2=0x7f9c1015f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:36.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.038+0000 7f9c14c72640 1 --2- 172.21.15.123:0/762068645 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9c1015c4b0 0x7f9c1015f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:36.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.038+0000 7f9c14c72640 1 -- 172.21.15.123:0/762068645 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9c100b02b0 msgr2=0x7f9c1014e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:36.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.038+0000 7f9c14c72640 1 --2- 172.21.15.123:0/762068645 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9c100b02b0 0x7f9c1014e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:36.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.038+0000 7f9c14c72640 1 -- 172.21.15.123:0/762068645 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c10157e10 con 0x7f9c100d08e0 2024-09-15T23:19:36.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.038+0000 7f9c15c74640 1 --2- 172.21.15.123:0/762068645 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9c1015c4b0 0x7f9c1015f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:19:36.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.038+0000 7f9c14c72640 1 --2- 172.21.15.123:0/762068645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c100d08e0 0x7f9c101576a0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f9c0000c750 tx=0x7f9c0000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:36.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.038+0000 7f9c05ffb640 1 -- 172.21.15.123:0/762068645 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c00018070 con 0x7f9c100d08e0 2024-09-15T23:19:36.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.038+0000 7f9c05ffb640 1 -- 172.21.15.123:0/762068645 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c000072d0 con 0x7f9c100d08e0 2024-09-15T23:19:36.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.038+0000 7f9c05ffb640 1 -- 172.21.15.123:0/762068645 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c000047e0 con 0x7f9c100d08e0 2024-09-15T23:19:36.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.038+0000 7f9c176d7640 1 -- 172.21.15.123:0/762068645 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c101f6250 con 0x7f9c100d08e0 2024-09-15T23:19:36.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.038+0000 7f9c176d7640 1 -- 172.21.15.123:0/762068645 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c101f6810 con 0x7f9c100d08e0 2024-09-15T23:19:36.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.039+0000 7f9c176d7640 1 -- 172.21.15.123:0/762068645 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c10069400 con 0x7f9c100d08e0 2024-09-15T23:19:36.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.040+0000 7f9c05ffb640 1 -- 172.21.15.123:0/762068645 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9c0001b070 con 0x7f9c100d08e0 2024-09-15T23:19:36.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.040+0000 7f9c05ffb640 1 --2- 172.21.15.123:0/762068645 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9bf406c2b0 0x7f9bf406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:36.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.040+0000 7f9c05ffb640 1 -- 172.21.15.123:0/762068645 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5709+0+0 (secure 0 0 0) 0x7f9c0008a610 con 0x7f9c100d08e0 2024-09-15T23:19:36.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.040+0000 7f9c15473640 1 --2- 172.21.15.123:0/762068645 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9bf406c2b0 0x7f9bf406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:36.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.041+0000 7f9c15473640 1 --2- 172.21.15.123:0/762068645 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9bf406c2b0 0x7f9bf406e770 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c034000 tx=0x7f9c0c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:36.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.044+0000 7f9c05ffb640 1 -- 172.21.15.123:0/762068645 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9c10069400 con 0x7f9c100d08e0 2024-09-15T23:19:36.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.210+0000 7f9c176d7640 1 -- 172.21.15.123:0/762068645 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9c100b6120 con 0x7f9c100d08e0 2024-09-15T23:19:36.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.211+0000 7f9c05ffb640 1 -- 172.21.15.123:0/762068645 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) ==== 74+0+16724 (secure 0 0 0) 0x7f9c10157e10 con 0x7f9c100d08e0 2024-09-15T23:19:36.213 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:19:36.214 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":141,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:19:34.917058+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:19:33.533001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-15T23:19:33.894858+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:19:36.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.213+0000 7f9c176d7640 1 -- 172.21.15.123:0/762068645 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9bf406c2b0 msgr2=0x7f9bf406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:36.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.213+0000 7f9c176d7640 1 --2- 172.21.15.123:0/762068645 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9bf406c2b0 0x7f9bf406e770 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c034000 tx=0x7f9c0c02e000 comp rx=0 tx=0).stop 2024-09-15T23:19:36.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.213+0000 7f9c176d7640 1 -- 172.21.15.123:0/762068645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c100d08e0 msgr2=0x7f9c101576a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:36.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.213+0000 7f9c176d7640 1 --2- 172.21.15.123:0/762068645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c100d08e0 0x7f9c101576a0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f9c0000c750 tx=0x7f9c0000cc10 comp rx=0 tx=0).stop 2024-09-15T23:19:36.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.213+0000 7f9c176d7640 1 -- 172.21.15.123:0/762068645 shutdown_connections 2024-09-15T23:19:36.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.213+0000 7f9c176d7640 1 --2- 172.21.15.123:0/762068645 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9c1015c4b0 0x7f9c1015f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:36.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.213+0000 7f9c176d7640 1 --2- 172.21.15.123:0/762068645 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9bf406c2b0 0x7f9bf406e770 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:36.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.213+0000 7f9c176d7640 1 --2- 172.21.15.123:0/762068645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c100d08e0 0x7f9c101576a0 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:36.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.213+0000 7f9c176d7640 1 --2- 172.21.15.123:0/762068645 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9c100b02b0 0x7f9c1014e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:36.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.213+0000 7f9c176d7640 1 -- 172.21.15.123:0/762068645 >> 172.21.15.123:0/762068645 conn(0x7f9c100b0a80 msgr2=0x7f9c100b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:36.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.213+0000 7f9c176d7640 1 -- 172.21.15.123:0/762068645 shutdown_connections 2024-09-15T23:19:36.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.213+0000 7f9c176d7640 1 -- 172.21.15.123:0/762068645 wait complete. 2024-09-15T23:19:36.226 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T23:19:36.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.326+0000 7fa48a665640 1 Processor -- start 2024-09-15T23:19:36.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.326+0000 7fa48a665640 1 -- start start 2024-09-15T23:19:36.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.326+0000 7fa48a665640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa48406bfd0 0x7fa48406c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:36.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.326+0000 7fa48a665640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4840b3350 0x7fa4841623a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:36.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.326+0000 7fa48a665640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa48406c8f0 con 0x7fa4840b38a0 2024-09-15T23:19:36.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.326+0000 7fa48a665640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fa4840b78a0 con 0x7fa48406bfd0 2024-09-15T23:19:36.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.326+0000 7fa48a665640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa4840cffb0 con 0x7fa4840b3350 2024-09-15T23:19:36.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.327+0000 7fa483fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa48406bfd0 0x7fa48406c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:36.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.327+0000 7fa483fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa48406bfd0 0x7fa48406c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49740/0 (socket says 172.21.15.123:49740) 2024-09-15T23:19:36.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.327+0000 7fa483fff640 1 -- 172.21.15.123:0/967827374 learned_addr learned my addr 172.21.15.123:0/967827374 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:36.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.327+0000 7fa4837fe640 1 --2- 172.21.15.123:0/967827374 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4840b3350 0x7fa4841623a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:36.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.327+0000 7fa483fff640 1 -- 172.21.15.123:0/967827374 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4840b3350 msgr2=0x7fa4841623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:36.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.327+0000 7fa483fff640 1 --2- 172.21.15.123:0/967827374 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4840b3350 0x7fa4841623a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:36.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.327+0000 7fa483fff640 1 -- 172.21.15.123:0/967827374 >> v1:172.21.15.188:6789/0 conn(0x7fa4840b38a0 legacy=0x7fa4841628e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:36.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.327+0000 7fa483fff640 1 -- 172.21.15.123:0/967827374 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4840cf710 con 0x7fa48406bfd0 2024-09-15T23:19:36.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.328+0000 7fa483fff640 1 --2- 172.21.15.123:0/967827374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa48406bfd0 0x7fa48406c3b0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fa4740098a0 tx=0x7fa47402a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6196899c3df04770 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:36.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.328+0000 7fa482ffd640 1 -- 172.21.15.123:0/967827374 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa474037070 con 0x7fa48406bfd0 2024-09-15T23:19:36.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.328+0000 7fa482ffd640 1 -- 172.21.15.123:0/967827374 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa474032440 con 0x7fa48406bfd0 2024-09-15T23:19:36.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.328+0000 7fa482ffd640 1 -- 172.21.15.123:0/967827374 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa474032810 con 0x7fa48406bfd0 2024-09-15T23:19:36.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.328+0000 7fa48a665640 1 -- 172.21.15.123:0/967827374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa48406bfd0 msgr2=0x7fa48406c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:36.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.328+0000 7fa48a665640 1 --2- 172.21.15.123:0/967827374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa48406bfd0 0x7fa48406c3b0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fa4740098a0 tx=0x7fa47402a2e0 comp rx=0 tx=0).stop 2024-09-15T23:19:36.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.328+0000 7fa48a665640 1 -- 172.21.15.123:0/967827374 shutdown_connections 2024-09-15T23:19:36.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.328+0000 7fa48a665640 1 --2- 172.21.15.123:0/967827374 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4840b3350 0x7fa4841623a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:36.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.328+0000 7fa48a665640 1 --2- 172.21.15.123:0/967827374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa48406bfd0 0x7fa48406c3b0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:36.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.328+0000 7fa48a665640 1 -- 172.21.15.123:0/967827374 >> 172.21.15.123:0/967827374 conn(0x7fa4840d11c0 msgr2=0x7fa4840d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:36.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.328+0000 7fa48a665640 1 -- 172.21.15.123:0/967827374 shutdown_connections 2024-09-15T23:19:36.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.328+0000 7fa48a665640 1 -- 172.21.15.123:0/967827374 wait complete. 2024-09-15T23:19:36.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.330+0000 7fa48a665640 1 Processor -- start 2024-09-15T23:19:36.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.330+0000 7fa48a665640 1 -- start start 2024-09-15T23:19:36.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.330+0000 7fa48a665640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa48406bfd0 0x7fa484153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:36.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.330+0000 7fa48a665640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4840b3350 0x7fa4841f4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:36.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.330+0000 7fa48a665640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4840b38a0 0x7fa48415fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:36.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.330+0000 7fa48a665640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa4840d2400 con 0x7fa48406bfd0 2024-09-15T23:19:36.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.330+0000 7fa48a665640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa4840cfcd0 con 0x7fa4840b38a0 2024-09-15T23:19:36.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.330+0000 7fa48a665640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa48406cd50 con 0x7fa4840b3350 2024-09-15T23:19:36.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.331+0000 7fa483fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa48406bfd0 0x7fa484153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:36.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.331+0000 7fa483fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa48406bfd0 0x7fa484153c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49754/0 (socket says 172.21.15.123:49754) 2024-09-15T23:19:36.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.331+0000 7fa483fff640 1 -- 172.21.15.123:0/1011906474 learned_addr learned my addr 172.21.15.123:0/1011906474 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:36.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.331+0000 7fa4837fe640 1 --2- 172.21.15.123:0/1011906474 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4840b3350 0x7fa4841f4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:36.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.331+0000 7fa488c02640 1 --2- 172.21.15.123:0/1011906474 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4840b38a0 0x7fa48415fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:36.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.331+0000 7fa483fff640 1 -- 172.21.15.123:0/1011906474 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4840b3350 msgr2=0x7fa4841f4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:36.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.331+0000 7fa483fff640 1 --2- 172.21.15.123:0/1011906474 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4840b3350 0x7fa4841f4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:36.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.331+0000 7fa483fff640 1 -- 172.21.15.123:0/1011906474 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4840b38a0 msgr2=0x7fa48415fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:36.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.331+0000 7fa483fff640 1 --2- 172.21.15.123:0/1011906474 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4840b38a0 0x7fa48415fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:36.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.331+0000 7fa483fff640 1 -- 172.21.15.123:0/1011906474 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4840cbe20 con 0x7fa48406bfd0 2024-09-15T23:19:36.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.331+0000 7fa483fff640 1 --2- 172.21.15.123:0/1011906474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa48406bfd0 0x7fa484153c40 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fa474000c00 tx=0x7fa4740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:36.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.331+0000 7fa480ff9640 1 -- 172.21.15.123:0/1011906474 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa474037040 con 0x7fa48406bfd0 2024-09-15T23:19:36.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.331+0000 7fa480ff9640 1 -- 172.21.15.123:0/1011906474 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa474004230 con 0x7fa48406bfd0 2024-09-15T23:19:36.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.331+0000 7fa48a665640 1 -- 172.21.15.123:0/1011906474 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4840cc100 con 0x7fa48406bfd0 2024-09-15T23:19:36.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.331+0000 7fa480ff9640 1 -- 172.21.15.123:0/1011906474 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa474003610 con 0x7fa48406bfd0 2024-09-15T23:19:36.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.331+0000 7fa48a665640 1 -- 172.21.15.123:0/1011906474 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa484160650 con 0x7fa48406bfd0 2024-09-15T23:19:36.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.332+0000 7fa48a665640 1 -- 172.21.15.123:0/1011906474 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa48415eae0 con 0x7fa48406bfd0 2024-09-15T23:19:36.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.333+0000 7fa480ff9640 1 -- 172.21.15.123:0/1011906474 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa4740037b0 con 0x7fa48406bfd0 2024-09-15T23:19:36.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.333+0000 7fa480ff9640 1 --2- 172.21.15.123:0/1011906474 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa47006c2b0 0x7fa47006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:36.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.333+0000 7fa480ff9640 1 -- 172.21.15.123:0/1011906474 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5709+0+0 (secure 0 0 0) 0x7fa4740abf30 con 0x7fa48406bfd0 2024-09-15T23:19:36.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.334+0000 7fa4837fe640 1 --2- 172.21.15.123:0/1011906474 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa47006c2b0 0x7fa47006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:36.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.334+0000 7fa4837fe640 1 --2- 172.21.15.123:0/1011906474 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa47006c2b0 0x7fa47006e770 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fa48415b010 tx=0x7fa478008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:36.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.337+0000 7fa480ff9640 1 -- 172.21.15.123:0/1011906474 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa47407a050 con 0x7fa48406bfd0 2024-09-15T23:19:36.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.537+0000 7fa48a665640 1 -- 172.21.15.123:0/1011906474 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa4840ba3d0 con 0x7fa48406bfd0 2024-09-15T23:19:36.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.613+0000 7fa480ff9640 1 -- 172.21.15.123:0/1011906474 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v85) ==== 118+0+0 (secure 0 0 0) 0x7fa47407e350 con 0x7fa48406bfd0 2024-09-15T23:19:36.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.615+0000 7fa48a665640 1 -- 172.21.15.123:0/1011906474 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa47006c2b0 msgr2=0x7fa47006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:36.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.615+0000 7fa48a665640 1 --2- 172.21.15.123:0/1011906474 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa47006c2b0 0x7fa47006e770 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fa48415b010 tx=0x7fa478008040 comp rx=0 tx=0).stop 2024-09-15T23:19:36.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.615+0000 7fa48a665640 1 -- 172.21.15.123:0/1011906474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa48406bfd0 msgr2=0x7fa484153c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:36.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.615+0000 7fa48a665640 1 --2- 172.21.15.123:0/1011906474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa48406bfd0 0x7fa484153c40 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fa474000c00 tx=0x7fa4740046c0 comp rx=0 tx=0).stop 2024-09-15T23:19:36.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.615+0000 7fa48a665640 1 -- 172.21.15.123:0/1011906474 shutdown_connections 2024-09-15T23:19:36.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.615+0000 7fa48a665640 1 --2- 172.21.15.123:0/1011906474 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4840b38a0 0x7fa48415fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:36.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.615+0000 7fa48a665640 1 --2- 172.21.15.123:0/1011906474 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4840b3350 0x7fa4841f4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:36.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.615+0000 7fa48a665640 1 --2- 172.21.15.123:0/1011906474 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa47006c2b0 0x7fa47006e770 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:36.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.615+0000 7fa48a665640 1 --2- 172.21.15.123:0/1011906474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa48406bfd0 0x7fa484153c40 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:36.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.615+0000 7fa48a665640 1 -- 172.21.15.123:0/1011906474 >> 172.21.15.123:0/1011906474 conn(0x7fa4840d11c0 msgr2=0x7fa4840b7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:36.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.615+0000 7fa48a665640 1 -- 172.21.15.123:0/1011906474 shutdown_connections 2024-09-15T23:19:36.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.615+0000 7fa48a665640 1 -- 172.21.15.123:0/1011906474 wait complete. 2024-09-15T23:19:36.628 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T23:19:36.629 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T23:19:36.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.728+0000 7f20af331640 1 Processor -- start 2024-09-15T23:19:36.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.728+0000 7f20af331640 1 -- start start 2024-09-15T23:19:36.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.729+0000 7f20af331640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f20a8073600 0x7f20a8162c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:36.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.729+0000 7f20af331640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20a8073cc0 con 0x7f20a8155950 2024-09-15T23:19:36.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.729+0000 7f20af331640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20a8071aa0 con 0x7f20a80afb20 2024-09-15T23:19:36.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.729+0000 7f20af331640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f20a81631c0 con 0x7f20a8073600 2024-09-15T23:19:36.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.729+0000 7f20ac8cc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f20a8073600 0x7f20a8162c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:36.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.729+0000 7f20ad0cd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f20a8155950 0x7f20a806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60678/0 (socket says 172.21.15.123:60678) 2024-09-15T23:19:36.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.729+0000 7f20ad0cd640 1 -- 172.21.15.123:0/2504913040 learned_addr learned my addr 172.21.15.123:0/2504913040 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:19:36.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.729+0000 7f20ac8cc640 1 -- 172.21.15.123:0/2504913040 >> v1:172.21.15.188:6789/0 conn(0x7f20a80afb20 legacy=0x7f20a815f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:36.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.729+0000 7f20ac8cc640 1 -- 172.21.15.123:0/2504913040 >> v1:172.21.15.123:6789/0 conn(0x7f20a8155950 legacy=0x7f20a806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:36.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.729+0000 7f20ac8cc640 1 -- 172.21.15.123:0/2504913040 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20a8071d80 con 0x7f20a8073600 2024-09-15T23:19:36.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.729+0000 7f209ffff640 1 -- 172.21.15.123:0/2504913040 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3152757751 0 0) 0x7f20a8073cc0 con 0x7f20a8155950 2024-09-15T23:19:36.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.730+0000 7f20ac8cc640 1 --2- 172.21.15.123:0/2504913040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20a8073600 0x7f20a8162c80 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f20980097a0 tx=0x7f209802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7edf96951a159d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:36.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.730+0000 7f209ffff640 1 -- 172.21.15.123:0/2504913040 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2098037070 con 0x7f20a8073600 2024-09-15T23:19:36.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.730+0000 7f209ffff640 1 -- 172.21.15.123:0/2504913040 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2098032440 con 0x7f20a8073600 2024-09-15T23:19:36.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.730+0000 7f209ffff640 1 -- 172.21.15.123:0/2504913040 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2098032810 con 0x7f20a8073600 2024-09-15T23:19:36.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.731+0000 7f20af331640 1 -- 172.21.15.123:0/2504913040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20a8073600 msgr2=0x7f20a8162c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:36.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.731+0000 7f20af331640 1 --2- 172.21.15.123:0/2504913040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20a8073600 0x7f20a8162c80 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f20980097a0 tx=0x7f209802a1e0 comp rx=0 tx=0).stop 2024-09-15T23:19:36.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.731+0000 7f20af331640 1 -- 172.21.15.123:0/2504913040 shutdown_connections 2024-09-15T23:19:36.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.731+0000 7f20af331640 1 --2- 172.21.15.123:0/2504913040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20a8073600 0x7f20a8162c80 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:36.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.731+0000 7f20af331640 1 -- 172.21.15.123:0/2504913040 >> 172.21.15.123:0/2504913040 conn(0x7f20a806db30 msgr2=0x7f20a806df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:36.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.731+0000 7f20af331640 1 -- 172.21.15.123:0/2504913040 shutdown_connections 2024-09-15T23:19:36.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.731+0000 7f20af331640 1 -- 172.21.15.123:0/2504913040 wait complete. 2024-09-15T23:19:36.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.732+0000 7f20af331640 1 Processor -- start 2024-09-15T23:19:36.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.732+0000 7f20af331640 1 -- start start 2024-09-15T23:19:36.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.733+0000 7f20af331640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20a8073600 0x7f20a81549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:36.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.733+0000 7f20af331640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20a80afb20 0x7f20a81580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:36.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.733+0000 7f20af331640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20a81e83b0 0x7f20a81e8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:36.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.733+0000 7f20af331640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f20a8073a60 con 0x7f20a81e83b0 2024-09-15T23:19:36.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.733+0000 7f20af331640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f20a8070370 con 0x7f20a8073600 2024-09-15T23:19:36.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.733+0000 7f20af331640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f20a8072060 con 0x7f20a80afb20 2024-09-15T23:19:36.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.733+0000 7f20ad8ce640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20a81e83b0 0x7f20a81e8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:36.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.733+0000 7f20ad8ce640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20a81e83b0 0x7f20a81e8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49760/0 (socket says 172.21.15.123:49760) 2024-09-15T23:19:36.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.733+0000 7f20ad8ce640 1 -- 172.21.15.123:0/2991281920 learned_addr learned my addr 172.21.15.123:0/2991281920 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:36.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.733+0000 7f20ad0cd640 1 --2- 172.21.15.123:0/2991281920 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20a8073600 0x7f20a81549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:36.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.733+0000 7f20ac8cc640 1 --2- 172.21.15.123:0/2991281920 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20a80afb20 0x7f20a81580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:36.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.733+0000 7f20ad8ce640 1 -- 172.21.15.123:0/2991281920 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20a80afb20 msgr2=0x7f20a81580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:36.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.733+0000 7f20ad8ce640 1 --2- 172.21.15.123:0/2991281920 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20a80afb20 0x7f20a81580b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:36.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.733+0000 7f20ad8ce640 1 -- 172.21.15.123:0/2991281920 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20a8073600 msgr2=0x7f20a81549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:36.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.733+0000 7f20ad8ce640 1 --2- 172.21.15.123:0/2991281920 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20a8073600 0x7f20a81549c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:36.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.733+0000 7f20ad8ce640 1 -- 172.21.15.123:0/2991281920 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20a8147dc0 con 0x7f20a81e83b0 2024-09-15T23:19:36.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.733+0000 7f20ac8cc640 1 --2- 172.21.15.123:0/2991281920 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20a80afb20 0x7f20a81580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:19:36.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.733+0000 7f20ad8ce640 1 --2- 172.21.15.123:0/2991281920 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20a81e83b0 0x7f20a81e8860 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f20a000c780 tx=0x7f20a000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:36.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.733+0000 7f209dffb640 1 -- 172.21.15.123:0/2991281920 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a0004b60 con 0x7f20a81e83b0 2024-09-15T23:19:36.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.733+0000 7f209dffb640 1 -- 172.21.15.123:0/2991281920 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a0004d00 con 0x7f20a81e83b0 2024-09-15T23:19:36.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.733+0000 7f20af331640 1 -- 172.21.15.123:0/2991281920 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20a80cd900 con 0x7f20a81e83b0 2024-09-15T23:19:36.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.733+0000 7f209dffb640 1 -- 172.21.15.123:0/2991281920 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a000aa90 con 0x7f20a81e83b0 2024-09-15T23:19:36.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.733+0000 7f20af331640 1 -- 172.21.15.123:0/2991281920 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20a81578b0 con 0x7f20a81e83b0 2024-09-15T23:19:36.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.734+0000 7f20af331640 1 -- 172.21.15.123:0/2991281920 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20a8162c80 con 0x7f20a81e83b0 2024-09-15T23:19:36.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.735+0000 7f209dffb640 1 -- 172.21.15.123:0/2991281920 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f20a000ac30 con 0x7f20a81e83b0 2024-09-15T23:19:36.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.735+0000 7f209dffb640 1 --2- 172.21.15.123:0/2991281920 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f208c06c2b0 0x7f208c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:36.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.735+0000 7f209dffb640 1 -- 172.21.15.123:0/2991281920 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f20a008b680 con 0x7f20a81e83b0 2024-09-15T23:19:36.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.735+0000 7f20ad0cd640 1 --2- 172.21.15.123:0/2991281920 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f208c06c2b0 0x7f208c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:36.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.736+0000 7f20ad0cd640 1 --2- 172.21.15.123:0/2991281920 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f208c06c2b0 0x7f208c06e770 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f20a4007fd0 tx=0x7f20a4007de0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:36.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.739+0000 7f209dffb640 1 -- 172.21.15.123:0/2991281920 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f20a0020070 con 0x7f20a81e83b0 2024-09-15T23:19:36.844 INFO:tasks.ceph.mds.d.smithi188.stderr:2024-09-15T23:19:36.844+0000 7f353b37f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:19:36.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:36.940+0000 7f20af331640 1 -- 172.21.15.123:0/2991281920 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f20a815e660 con 0x7f20a81e83b0 2024-09-15T23:19:37.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.622+0000 7f209dffb640 1 -- 172.21.15.123:0/2991281920 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v86) ==== 122+0+0 (secure 0 0 0) 0x7f20a0059df0 con 0x7f20a81e83b0 2024-09-15T23:19:37.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.624+0000 7f20af331640 1 -- 172.21.15.123:0/2991281920 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f208c06c2b0 msgr2=0x7f208c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:37.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.624+0000 7f20af331640 1 --2- 172.21.15.123:0/2991281920 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f208c06c2b0 0x7f208c06e770 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f20a4007fd0 tx=0x7f20a4007de0 comp rx=0 tx=0).stop 2024-09-15T23:19:37.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.624+0000 7f20af331640 1 -- 172.21.15.123:0/2991281920 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20a81e83b0 msgr2=0x7f20a81e8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:37.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.624+0000 7f20af331640 1 --2- 172.21.15.123:0/2991281920 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20a81e83b0 0x7f20a81e8860 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f20a000c780 tx=0x7f20a000cc40 comp rx=0 tx=0).stop 2024-09-15T23:19:37.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.625+0000 7f20af331640 1 -- 172.21.15.123:0/2991281920 shutdown_connections 2024-09-15T23:19:37.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.625+0000 7f20af331640 1 --2- 172.21.15.123:0/2991281920 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f208c06c2b0 0x7f208c06e770 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:37.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.625+0000 7f20af331640 1 --2- 172.21.15.123:0/2991281920 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20a81e83b0 0x7f20a81e8860 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:37.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.625+0000 7f20af331640 1 --2- 172.21.15.123:0/2991281920 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20a80afb20 0x7f20a81580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:37.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.625+0000 7f20af331640 1 --2- 172.21.15.123:0/2991281920 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20a8073600 0x7f20a81549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:37.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.625+0000 7f20af331640 1 -- 172.21.15.123:0/2991281920 >> 172.21.15.123:0/2991281920 conn(0x7f20a806db30 msgr2=0x7f20a8161e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:37.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.625+0000 7f20af331640 1 -- 172.21.15.123:0/2991281920 shutdown_connections 2024-09-15T23:19:37.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.625+0000 7f20af331640 1 -- 172.21.15.123:0/2991281920 wait complete. 2024-09-15T23:19:37.639 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T23:19:37.639 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:19:37.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.743+0000 7f2fcb16d640 1 Processor -- start 2024-09-15T23:19:37.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.743+0000 7f2fcb16d640 1 -- start start 2024-09-15T23:19:37.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.744+0000 7f2fcb16d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2fc40b2d40 0x7f2fc406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:37.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.744+0000 7f2fcb16d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2fc413eb20 0x7f2fc406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:37.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.744+0000 7f2fcb16d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2fc415bcf0 0x7f2fc415c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:37.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.744+0000 7f2fcb16d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f2fc4071ab0 con 0x7f2fc415bcf0 2024-09-15T23:19:37.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.744+0000 7f2fcb16d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f2fc4071180 con 0x7f2fc40b2d40 2024-09-15T23:19:37.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.744+0000 7f2fcb16d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f2fc4071460 con 0x7f2fc413eb20 2024-09-15T23:19:37.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.744+0000 7f2fc970a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2fc415bcf0 0x7f2fc415c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:37.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.744+0000 7f2fc970a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2fc415bcf0 0x7f2fc415c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49772/0 (socket says 172.21.15.123:49772) 2024-09-15T23:19:37.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.744+0000 7f2fc970a640 1 -- 172.21.15.123:0/3585686981 learned_addr learned my addr 172.21.15.123:0/3585686981 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:37.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.745+0000 7f2fc8f09640 1 --2- 172.21.15.123:0/3585686981 >> v2:172.21.15.188:3300/0 conn(0x7f2fc40b2d40 0x7f2fc406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:37.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.745+0000 7f2fc3fff640 1 --2- 172.21.15.123:0/3585686981 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2fc413eb20 0x7f2fc406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:37.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.745+0000 7f2fc970a640 1 -- 172.21.15.123:0/3585686981 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2fc413eb20 msgr2=0x7f2fc406c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:37.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.745+0000 7f2fc970a640 1 --2- 172.21.15.123:0/3585686981 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2fc413eb20 0x7f2fc406c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:37.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.745+0000 7f2fc970a640 1 -- 172.21.15.123:0/3585686981 >> v2:172.21.15.188:3300/0 conn(0x7f2fc40b2d40 msgr2=0x7f2fc406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:37.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.745+0000 7f2fc970a640 1 --2- 172.21.15.123:0/3585686981 >> v2:172.21.15.188:3300/0 conn(0x7f2fc40b2d40 0x7f2fc406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:37.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.745+0000 7f2fc970a640 1 -- 172.21.15.123:0/3585686981 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc4071740 con 0x7f2fc415bcf0 2024-09-15T23:19:37.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.745+0000 7f2fc970a640 1 --2- 172.21.15.123:0/3585686981 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fc415bcf0 0x7f2fc415c1a0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4069be0 tx=0x7f2fbc02c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba78da49bed8070 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:37.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.745+0000 7f2fc37fe640 1 -- 172.21.15.123:0/3585686981 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc00b2e0 con 0x7f2fc415bcf0 2024-09-15T23:19:37.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.745+0000 7f2fc37fe640 1 -- 172.21.15.123:0/3585686981 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fbc009600 con 0x7f2fc415bcf0 2024-09-15T23:19:37.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.745+0000 7f2fc37fe640 1 -- 172.21.15.123:0/3585686981 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc00b480 con 0x7f2fc415bcf0 2024-09-15T23:19:37.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.746+0000 7f2fcb16d640 1 -- 172.21.15.123:0/3585686981 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fc415bcf0 msgr2=0x7f2fc415c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:37.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.746+0000 7f2fcb16d640 1 --2- 172.21.15.123:0/3585686981 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fc415bcf0 0x7f2fc415c1a0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4069be0 tx=0x7f2fbc02c8a0 comp rx=0 tx=0).stop 2024-09-15T23:19:37.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.746+0000 7f2fcb16d640 1 -- 172.21.15.123:0/3585686981 shutdown_connections 2024-09-15T23:19:37.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.746+0000 7f2fcb16d640 1 --2- 172.21.15.123:0/3585686981 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fc415bcf0 0x7f2fc415c1a0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:37.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.746+0000 7f2fcb16d640 1 --2- 172.21.15.123:0/3585686981 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2fc413eb20 0x7f2fc406c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:37.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.746+0000 7f2fcb16d640 1 --2- 172.21.15.123:0/3585686981 >> v2:172.21.15.188:3300/0 conn(0x7f2fc40b2d40 0x7f2fc406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:37.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.746+0000 7f2fcb16d640 1 -- 172.21.15.123:0/3585686981 >> 172.21.15.123:0/3585686981 conn(0x7f2fc40ccec0 msgr2=0x7f2fc40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:37.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.746+0000 7f2fcb16d640 1 -- 172.21.15.123:0/3585686981 shutdown_connections 2024-09-15T23:19:37.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.746+0000 7f2fcb16d640 1 -- 172.21.15.123:0/3585686981 wait complete. 2024-09-15T23:19:37.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.747+0000 7f2fcb16d640 1 Processor -- start 2024-09-15T23:19:37.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.747+0000 7f2fcb16d640 1 -- start start 2024-09-15T23:19:37.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.748+0000 7f2fcb16d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2fc40b2d40 0x7f2fc415a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:37.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.748+0000 7f2fcb16d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2fc413eb20 0x7f2fc41f03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:37.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.748+0000 7f2fcb16d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fc415bcf0 0x7f2fc41566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:37.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.748+0000 7f2fcb16d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc415f140 con 0x7f2fc415bcf0 2024-09-15T23:19:37.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.748+0000 7f2fcb16d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc415efc0 con 0x7f2fc40b2d40 2024-09-15T23:19:37.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.748+0000 7f2fcb16d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f2fc415f2c0 con 0x7f2fc413eb20 2024-09-15T23:19:37.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.748+0000 7f2fc970a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fc415bcf0 0x7f2fc41566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:37.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.748+0000 7f2fc970a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fc415bcf0 0x7f2fc41566b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49780/0 (socket says 172.21.15.123:49780) 2024-09-15T23:19:37.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.748+0000 7f2fc970a640 1 -- 172.21.15.123:0/1125707524 learned_addr learned my addr 172.21.15.123:0/1125707524 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:37.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.748+0000 7f2fc8f09640 1 --2- 172.21.15.123:0/1125707524 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2fc40b2d40 0x7f2fc415a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:37.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.748+0000 7f2fc3fff640 1 --2- 172.21.15.123:0/1125707524 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2fc413eb20 0x7f2fc41f03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:37.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.749+0000 7f2fc970a640 1 -- 172.21.15.123:0/1125707524 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2fc413eb20 msgr2=0x7f2fc41f03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:37.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.749+0000 7f2fc970a640 1 --2- 172.21.15.123:0/1125707524 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2fc413eb20 0x7f2fc41f03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:37.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.749+0000 7f2fc970a640 1 -- 172.21.15.123:0/1125707524 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2fc40b2d40 msgr2=0x7f2fc415a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:37.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.749+0000 7f2fc970a640 1 --2- 172.21.15.123:0/1125707524 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2fc40b2d40 0x7f2fc415a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:37.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.749+0000 7f2fc970a640 1 -- 172.21.15.123:0/1125707524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc4155ef0 con 0x7f2fc415bcf0 2024-09-15T23:19:37.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.749+0000 7f2fc970a640 1 --2- 172.21.15.123:0/1125707524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fc415bcf0 0x7f2fc41566b0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc02ce90 tx=0x7f2fbc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:37.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.749+0000 7f2fc17fa640 1 -- 172.21.15.123:0/1125707524 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc043070 con 0x7f2fc415bcf0 2024-09-15T23:19:37.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.749+0000 7f2fc17fa640 1 -- 172.21.15.123:0/1125707524 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fbc034890 con 0x7f2fc415bcf0 2024-09-15T23:19:37.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.749+0000 7f2fcb16d640 1 -- 172.21.15.123:0/1125707524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fc40b52f0 con 0x7f2fc415bcf0 2024-09-15T23:19:37.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.749+0000 7f2fc17fa640 1 -- 172.21.15.123:0/1125707524 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc034c80 con 0x7f2fc415bcf0 2024-09-15T23:19:37.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.749+0000 7f2fcb16d640 1 -- 172.21.15.123:0/1125707524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fc4156190 con 0x7f2fc415bcf0 2024-09-15T23:19:37.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.750+0000 7f2fcb16d640 1 -- 172.21.15.123:0/1125707524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fc4156390 con 0x7f2fc415bcf0 2024-09-15T23:19:37.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.750+0000 7f2fc17fa640 1 -- 172.21.15.123:0/1125707524 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2fbc03b040 con 0x7f2fc415bcf0 2024-09-15T23:19:37.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.751+0000 7f2fc17fa640 1 --2- 172.21.15.123:0/1125707524 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2fa806c2b0 0x7f2fa806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:37.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.751+0000 7f2fc17fa640 1 -- 172.21.15.123:0/1125707524 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f2fbc030020 con 0x7f2fc415bcf0 2024-09-15T23:19:37.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.751+0000 7f2fc8f09640 1 --2- 172.21.15.123:0/1125707524 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2fa806c2b0 0x7f2fa806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:37.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.752+0000 7f2fc8f09640 1 --2- 172.21.15.123:0/1125707524 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2fa806c2b0 0x7f2fa806e770 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800aaf0 tx=0x7f2fb8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:37.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.755+0000 7f2fc17fa640 1 -- 172.21.15.123:0/1125707524 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2fc4156390 con 0x7f2fc415bcf0 2024-09-15T23:19:37.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.950+0000 7f2fcb16d640 1 -- 172.21.15.123:0/1125707524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2fc415c1a0 con 0x7f2fc415bcf0 2024-09-15T23:19:37.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.951+0000 7f2fc17fa640 1 -- 172.21.15.123:0/1125707524 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5237 (secure 0 0 0) 0x7f2fbc04c070 con 0x7f2fc415bcf0 2024-09-15T23:19:37.952 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:19:37.952 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":86,"btime":"2024-09-15T23:19:37:619526+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2082746470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2082746470},{"type":"v1","addr":"172.21.15.123:6834","nonce":2082746470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8421,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2007610603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":2007610603},{"type":"v1","addr":"172.21.15.123:6835","nonce":2007610603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8436,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2929123975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2929123975},{"type":"v1","addr":"172.21.15.188:6836","nonce":2929123975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:19:34.917419+0000","modified":"2024-09-15T23:19:36.941347+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8439":{"gid":8439,"name":"d","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6837/1222656979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1222656979},{"type":"v1","addr":"172.21.15.188:6837","nonce":1222656979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8439,"qdb_cluster":[8439]},"id":9}]} 2024-09-15T23:19:37.953 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 86 2024-09-15T23:19:37.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.953+0000 7f2fcb16d640 1 -- 172.21.15.123:0/1125707524 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2fa806c2b0 msgr2=0x7f2fa806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:37.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.953+0000 7f2fcb16d640 1 --2- 172.21.15.123:0/1125707524 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2fa806c2b0 0x7f2fa806e770 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800aaf0 tx=0x7f2fb8008040 comp rx=0 tx=0).stop 2024-09-15T23:19:37.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.953+0000 7f2fcb16d640 1 -- 172.21.15.123:0/1125707524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fc415bcf0 msgr2=0x7f2fc41566b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:37.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.953+0000 7f2fcb16d640 1 --2- 172.21.15.123:0/1125707524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fc415bcf0 0x7f2fc41566b0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc02ce90 tx=0x7f2fbc004a40 comp rx=0 tx=0).stop 2024-09-15T23:19:37.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.953+0000 7f2fcb16d640 1 -- 172.21.15.123:0/1125707524 shutdown_connections 2024-09-15T23:19:37.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.953+0000 7f2fcb16d640 1 --2- 172.21.15.123:0/1125707524 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2fa806c2b0 0x7f2fa806e770 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:37.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.953+0000 7f2fcb16d640 1 --2- 172.21.15.123:0/1125707524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fc415bcf0 0x7f2fc41566b0 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:37.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.953+0000 7f2fcb16d640 1 --2- 172.21.15.123:0/1125707524 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2fc413eb20 0x7f2fc41f03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:37.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.953+0000 7f2fcb16d640 1 --2- 172.21.15.123:0/1125707524 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2fc40b2d40 0x7f2fc415a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:37.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.953+0000 7f2fcb16d640 1 -- 172.21.15.123:0/1125707524 >> 172.21.15.123:0/1125707524 conn(0x7f2fc40ccec0 msgr2=0x7f2fc4140f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:37.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.953+0000 7f2fcb16d640 1 -- 172.21.15.123:0/1125707524 shutdown_connections 2024-09-15T23:19:37.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:37.953+0000 7f2fcb16d640 1 -- 172.21.15.123:0/1125707524 wait complete. 2024-09-15T23:19:37.965 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:19:38.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.062+0000 7fac8b991640 1 Processor -- start 2024-09-15T23:19:38.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.062+0000 7fac8b991640 1 -- start start 2024-09-15T23:19:38.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.063+0000 7fac8b991640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac8415ab40 0x7fac8406c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:38.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.063+0000 7fac8b991640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fac8415af20 0x7fac8415b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:38.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.063+0000 7fac8b991640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac840724f0 con 0x7fac840720b0 2024-09-15T23:19:38.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.063+0000 7fac8b991640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fac84071010 con 0x7fac8415af20 2024-09-15T23:19:38.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.063+0000 7fac8b991640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fac840712f0 con 0x7fac8415ab40 2024-09-15T23:19:38.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.063+0000 7fac89f2e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fac8415af20 0x7fac8415b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:38.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.063+0000 7fac88f2c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fac840720b0 0x7fac84073990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60684/0 (socket says 172.21.15.123:60684) 2024-09-15T23:19:38.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.063+0000 7fac88f2c640 1 -- 172.21.15.123:0/1958054518 learned_addr learned my addr 172.21.15.123:0/1958054518 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:19:38.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.063+0000 7fac8972d640 1 --2- 172.21.15.123:0/1958054518 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac8415ab40 0x7fac8406c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:38.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.063+0000 7fac89f2e640 1 -- 172.21.15.123:0/1958054518 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac8415ab40 msgr2=0x7fac8406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:38.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.064+0000 7fac89f2e640 1 --2- 172.21.15.123:0/1958054518 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac8415ab40 0x7fac8406c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:38.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.064+0000 7fac89f2e640 1 -- 172.21.15.123:0/1958054518 >> v1:172.21.15.123:6789/0 conn(0x7fac840720b0 legacy=0x7fac84073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:38.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.064+0000 7fac89f2e640 1 -- 172.21.15.123:0/1958054518 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac840715d0 con 0x7fac8415af20 2024-09-15T23:19:38.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.064+0000 7fac89f2e640 1 --2- 172.21.15.123:0/1958054518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac8415af20 0x7fac8415b370 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fac7c00aea0 tx=0x7fac7c02b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a61015d23be4ec6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:38.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.064+0000 7fac7bfff640 1 -- 172.21.15.123:0/1958054518 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c037070 con 0x7fac8415af20 2024-09-15T23:19:38.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.064+0000 7fac7bfff640 1 -- 172.21.15.123:0/1958054518 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac7c008640 con 0x7fac8415af20 2024-09-15T23:19:38.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.064+0000 7fac7bfff640 1 -- 172.21.15.123:0/1958054518 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c008a10 con 0x7fac8415af20 2024-09-15T23:19:38.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.065+0000 7fac8b991640 1 -- 172.21.15.123:0/1958054518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac8415af20 msgr2=0x7fac8415b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:38.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.065+0000 7fac8b991640 1 --2- 172.21.15.123:0/1958054518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac8415af20 0x7fac8415b370 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fac7c00aea0 tx=0x7fac7c02b720 comp rx=0 tx=0).stop 2024-09-15T23:19:38.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.065+0000 7fac8b991640 1 -- 172.21.15.123:0/1958054518 shutdown_connections 2024-09-15T23:19:38.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.065+0000 7fac8b991640 1 --2- 172.21.15.123:0/1958054518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac8415af20 0x7fac8415b370 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:38.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.065+0000 7fac8b991640 1 --2- 172.21.15.123:0/1958054518 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac8415ab40 0x7fac8406c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:38.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.065+0000 7fac8b991640 1 -- 172.21.15.123:0/1958054518 >> 172.21.15.123:0/1958054518 conn(0x7fac840ccec0 msgr2=0x7fac840cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:38.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.065+0000 7fac8b991640 1 -- 172.21.15.123:0/1958054518 shutdown_connections 2024-09-15T23:19:38.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.065+0000 7fac8b991640 1 -- 172.21.15.123:0/1958054518 wait complete. 2024-09-15T23:19:38.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.066+0000 7fac8b991640 1 Processor -- start 2024-09-15T23:19:38.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.066+0000 7fac8b991640 1 -- start start 2024-09-15T23:19:38.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.067+0000 7fac8b991640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac840720b0 0x7fac8414a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:38.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.067+0000 7fac8b991640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac8415ab40 0x7fac84156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:38.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.067+0000 7fac8b991640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac8415af20 0x7fac840c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:38.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.067+0000 7fac8b991640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fac8415ba30 con 0x7fac8415af20 2024-09-15T23:19:38.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.067+0000 7fac8b991640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fac8415b8b0 con 0x7fac8415ab40 2024-09-15T23:19:38.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.067+0000 7fac8b991640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fac8406bc10 con 0x7fac840720b0 2024-09-15T23:19:38.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.067+0000 7fac89f2e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac8415af20 0x7fac840c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:38.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.067+0000 7fac89f2e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac8415af20 0x7fac840c7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49800/0 (socket says 172.21.15.123:49800) 2024-09-15T23:19:38.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.067+0000 7fac89f2e640 1 -- 172.21.15.123:0/2417983483 learned_addr learned my addr 172.21.15.123:0/2417983483 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:38.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.067+0000 7fac8972d640 1 --2- 172.21.15.123:0/2417983483 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac840720b0 0x7fac8414a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:38.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.067+0000 7fac88f2c640 1 --2- 172.21.15.123:0/2417983483 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac8415ab40 0x7fac84156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:38.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.067+0000 7fac89f2e640 1 -- 172.21.15.123:0/2417983483 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac840720b0 msgr2=0x7fac8414a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:38.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.067+0000 7fac89f2e640 1 --2- 172.21.15.123:0/2417983483 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac840720b0 0x7fac8414a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:38.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.067+0000 7fac89f2e640 1 -- 172.21.15.123:0/2417983483 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac8415ab40 msgr2=0x7fac84156dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:38.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.067+0000 7fac89f2e640 1 --2- 172.21.15.123:0/2417983483 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac8415ab40 0x7fac84156dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:38.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.067+0000 7fac89f2e640 1 -- 172.21.15.123:0/2417983483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac840c6380 con 0x7fac8415af20 2024-09-15T23:19:38.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.067+0000 7fac8972d640 1 --2- 172.21.15.123:0/2417983483 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac840720b0 0x7fac8414a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:19:38.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.067+0000 7fac88f2c640 1 --2- 172.21.15.123:0/2417983483 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac8415ab40 0x7fac84156dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:19:38.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.067+0000 7fac89f2e640 1 --2- 172.21.15.123:0/2417983483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac8415af20 0x7fac840c7cb0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fac7c035040 tx=0x7fac7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:38.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.067+0000 7fac79ffb640 1 -- 172.21.15.123:0/2417983483 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c037050 con 0x7fac8415af20 2024-09-15T23:19:38.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.067+0000 7fac79ffb640 1 -- 172.21.15.123:0/2417983483 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac7c043070 con 0x7fac8415af20 2024-09-15T23:19:38.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.067+0000 7fac79ffb640 1 -- 172.21.15.123:0/2417983483 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c00a560 con 0x7fac8415af20 2024-09-15T23:19:38.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.068+0000 7fac8b991640 1 -- 172.21.15.123:0/2417983483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac840c6660 con 0x7fac8415af20 2024-09-15T23:19:38.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.068+0000 7fac8b991640 1 -- 172.21.15.123:0/2417983483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac840c6c20 con 0x7fac8415af20 2024-09-15T23:19:38.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.069+0000 7fac8b991640 1 -- 172.21.15.123:0/2417983483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac8415a070 con 0x7fac8415af20 2024-09-15T23:19:38.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.069+0000 7fac79ffb640 1 -- 172.21.15.123:0/2417983483 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fac7c032c00 con 0x7fac8415af20 2024-09-15T23:19:38.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.070+0000 7fac79ffb640 1 --2- 172.21.15.123:0/2417983483 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fac6806c2e0 0x7fac6806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:38.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.070+0000 7fac79ffb640 1 -- 172.21.15.123:0/2417983483 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fac7c0ac650 con 0x7fac8415af20 2024-09-15T23:19:38.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.070+0000 7fac8972d640 1 --2- 172.21.15.123:0/2417983483 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fac6806c2e0 0x7fac6806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:38.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.070+0000 7fac8972d640 1 --2- 172.21.15.123:0/2417983483 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fac6806c2e0 0x7fac6806e7a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fac80006fd0 tx=0x7fac80008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:38.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.074+0000 7fac79ffb640 1 -- 172.21.15.123:0/2417983483 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fac8415a070 con 0x7fac8415af20 2024-09-15T23:19:38.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.240+0000 7fac8b991640 1 -- 172.21.15.123:0/2417983483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fac8406c070 con 0x7fac8415af20 2024-09-15T23:19:38.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.241+0000 7fac79ffb640 1 -- 172.21.15.123:0/2417983483 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) ==== 74+0+16711 (secure 0 0 0) 0x7fac7c07ae50 con 0x7fac8415af20 2024-09-15T23:19:38.242 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:19:38.242 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":142,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:19:36.602275+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:19:33.533001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-15T23:19:33.894858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:19:38.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.243+0000 7fac8b991640 1 -- 172.21.15.123:0/2417983483 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fac6806c2e0 msgr2=0x7fac6806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:38.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.243+0000 7fac8b991640 1 --2- 172.21.15.123:0/2417983483 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fac6806c2e0 0x7fac6806e7a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fac80006fd0 tx=0x7fac80008040 comp rx=0 tx=0).stop 2024-09-15T23:19:38.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.243+0000 7fac8b991640 1 -- 172.21.15.123:0/2417983483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac8415af20 msgr2=0x7fac840c7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:38.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.243+0000 7fac8b991640 1 --2- 172.21.15.123:0/2417983483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac8415af20 0x7fac840c7cb0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fac7c035040 tx=0x7fac7c004a40 comp rx=0 tx=0).stop 2024-09-15T23:19:38.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.243+0000 7fac8b991640 1 -- 172.21.15.123:0/2417983483 shutdown_connections 2024-09-15T23:19:38.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.243+0000 7fac8b991640 1 --2- 172.21.15.123:0/2417983483 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fac6806c2e0 0x7fac6806e7a0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:38.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.243+0000 7fac8b991640 1 --2- 172.21.15.123:0/2417983483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac8415af20 0x7fac840c7cb0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:38.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.243+0000 7fac8b991640 1 --2- 172.21.15.123:0/2417983483 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fac8415ab40 0x7fac84156dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:38.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.243+0000 7fac8b991640 1 --2- 172.21.15.123:0/2417983483 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fac840720b0 0x7fac8414a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:38.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.243+0000 7fac8b991640 1 -- 172.21.15.123:0/2417983483 >> 172.21.15.123:0/2417983483 conn(0x7fac840ccec0 msgr2=0x7fac84158950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:38.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.243+0000 7fac8b991640 1 -- 172.21.15.123:0/2417983483 shutdown_connections 2024-09-15T23:19:38.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.243+0000 7fac8b991640 1 -- 172.21.15.123:0/2417983483 wait complete. 2024-09-15T23:19:38.257 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T23:19:38.257 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:19:38.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.353+0000 7f71a39f1640 1 Processor -- start 2024-09-15T23:19:38.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.353+0000 7f71a39f1640 1 -- start start 2024-09-15T23:19:38.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.354+0000 7f71a39f1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f719c15d840 0x7f719c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:38.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.354+0000 7f71a39f1640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f719c06c150 0x7f719c06e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:38.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.354+0000 7f71a39f1640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f719c0728d0 con 0x7f719c1461a0 2024-09-15T23:19:38.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.354+0000 7f71a39f1640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f719c15ddc0 con 0x7f719c06c150 2024-09-15T23:19:38.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.354+0000 7f71a39f1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f719c06c5a0 con 0x7f719c15d840 2024-09-15T23:19:38.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.354+0000 7f71a178d640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f719c1461a0 0x7f719c0720c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60698/0 (socket says 172.21.15.123:60698) 2024-09-15T23:19:38.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.354+0000 7f71a178d640 1 -- 172.21.15.123:0/1517964137 learned_addr learned my addr 172.21.15.123:0/1517964137 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:19:38.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.354+0000 7f7193fff640 1 -- 172.21.15.123:0/1517964137 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3723054120 0 0) 0x7f719c0728d0 con 0x7f719c1461a0 2024-09-15T23:19:38.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.354+0000 7f7193fff640 1 -- 172.21.15.123:0/1517964137 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7188003520 con 0x7f719c1461a0 2024-09-15T23:19:38.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.354+0000 7f71a0f8c640 1 --2- 172.21.15.123:0/1517964137 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f719c15d840 0x7f719c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:38.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.354+0000 7f71a1f8e640 1 --2- 172.21.15.123:0/1517964137 >> v2:172.21.15.188:3300/0 conn(0x7f719c06c150 0x7f719c06e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:38.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.354+0000 7f7193fff640 1 -- 172.21.15.123:0/1517964137 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1765839010 0 0) 0x7f7188003520 con 0x7f719c1461a0 2024-09-15T23:19:38.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.354+0000 7f7193fff640 1 -- 172.21.15.123:0/1517964137 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f719c15d840 msgr2=0x7f719c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:38.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.354+0000 7f7193fff640 1 --2- 172.21.15.123:0/1517964137 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f719c15d840 0x7f719c06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:38.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.354+0000 7f7193fff640 1 -- 172.21.15.123:0/1517964137 >> v2:172.21.15.188:3300/0 conn(0x7f719c06c150 msgr2=0x7f719c06e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:38.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.354+0000 7f7193fff640 1 --2- 172.21.15.123:0/1517964137 >> v2:172.21.15.188:3300/0 conn(0x7f719c06c150 0x7f719c06e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:38.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.354+0000 7f7193fff640 1 -- 172.21.15.123:0/1517964137 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f719c072bb0 con 0x7f719c1461a0 2024-09-15T23:19:38.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.354+0000 7f71a1f8e640 1 --2- 172.21.15.123:0/1517964137 >> v2:172.21.15.188:3300/0 conn(0x7f719c06c150 0x7f719c06e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:19:38.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.354+0000 7f7193fff640 1 -- 172.21.15.123:0/1517964137 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f7198001670 con 0x7f719c1461a0 2024-09-15T23:19:38.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.355+0000 7f7193fff640 1 -- 172.21.15.123:0/1517964137 >> v1:172.21.15.123:6789/0 conn(0x7f719c1461a0 legacy=0x7f719c0720c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:38.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.355+0000 7f7193fff640 1 --2- 172.21.15.123:0/1517964137 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f71880039b0 0x7f7188003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:38.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.355+0000 7f7193fff640 1 --2- 172.21.15.123:0/1517964137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7188004800 0x7f7188004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:38.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.355+0000 7f7193fff640 1 --2- 172.21.15.123:0/1517964137 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f719c15d840 0x7f71880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:38.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.355+0000 7f7193fff640 1 -- 172.21.15.123:0/1517964137 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f719c06c5a0 con 0x7f7188004800 2024-09-15T23:19:38.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.355+0000 7f7193fff640 1 -- 172.21.15.123:0/1517964137 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f718800b9c0 con 0x7f71880039b0 2024-09-15T23:19:38.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.355+0000 7f7193fff640 1 -- 172.21.15.123:0/1517964137 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f718800bb70 con 0x7f719c15d840 2024-09-15T23:19:38.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.355+0000 7f71a0f8c640 1 --2- 172.21.15.123:0/1517964137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7188004800 0x7f7188004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:38.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.355+0000 7f71a178d640 1 --2- 172.21.15.123:0/1517964137 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f71880039b0 0x7f7188003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:38.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.355+0000 7f71a1f8e640 1 --2- 172.21.15.123:0/1517964137 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f719c15d840 0x7f71880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:38.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.355+0000 7f71a0f8c640 1 -- 172.21.15.123:0/1517964137 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f719c15d840 msgr2=0x7f71880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:38.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.355+0000 7f71a0f8c640 1 --2- 172.21.15.123:0/1517964137 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f719c15d840 0x7f71880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:38.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.355+0000 7f71a0f8c640 1 -- 172.21.15.123:0/1517964137 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f71880039b0 msgr2=0x7f7188003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:38.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.355+0000 7f71a0f8c640 1 --2- 172.21.15.123:0/1517964137 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f71880039b0 0x7f7188003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:38.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.355+0000 7f71a0f8c640 1 -- 172.21.15.123:0/1517964137 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7188003520 con 0x7f7188004800 2024-09-15T23:19:38.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.355+0000 7f71a178d640 1 --2- 172.21.15.123:0/1517964137 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f71880039b0 0x7f7188003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:19:38.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.355+0000 7f71a1f8e640 1 --2- 172.21.15.123:0/1517964137 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f719c15d840 0x7f71880051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:19:38.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.356+0000 7f71a0f8c640 1 --2- 172.21.15.123:0/1517964137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7188004800 0x7f7188004c80 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f718c009a90 tx=0x7f7188005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4790eaebd81bba94 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:38.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.356+0000 7f7193fff640 1 -- 172.21.15.123:0/1517964137 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718c036070 con 0x7f7188004800 2024-09-15T23:19:38.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.356+0000 7f7193fff640 1 -- 172.21.15.123:0/1517964137 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f718c031400 con 0x7f7188004800 2024-09-15T23:19:38.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.356+0000 7f7193fff640 1 -- 172.21.15.123:0/1517964137 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718c009690 con 0x7f7188004800 2024-09-15T23:19:38.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.356+0000 7f71a39f1640 1 -- 172.21.15.123:0/1517964137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7188004800 msgr2=0x7f7188004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:38.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.356+0000 7f71a39f1640 1 --2- 172.21.15.123:0/1517964137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7188004800 0x7f7188004c80 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f718c009a90 tx=0x7f7188005830 comp rx=0 tx=0).stop 2024-09-15T23:19:38.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.356+0000 7f71a1f8e640 1 -- 172.21.15.123:0/1517964137 reap_dead start 2024-09-15T23:19:38.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.356+0000 7f71a39f1640 1 -- 172.21.15.123:0/1517964137 shutdown_connections 2024-09-15T23:19:38.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.356+0000 7f71a39f1640 1 -- 172.21.15.123:0/1517964137 >> 172.21.15.123:0/1517964137 conn(0x7f719c06cd20 msgr2=0x7f719c06d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:38.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.356+0000 7f71a39f1640 1 -- 172.21.15.123:0/1517964137 shutdown_connections 2024-09-15T23:19:38.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.356+0000 7f71a39f1640 1 -- 172.21.15.123:0/1517964137 wait complete. 2024-09-15T23:19:38.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.358+0000 7f71a39f1640 1 Processor -- start 2024-09-15T23:19:38.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.358+0000 7f71a39f1640 1 -- start start 2024-09-15T23:19:38.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.358+0000 7f71a39f1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7188004800 0x7f719c142520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:38.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.358+0000 7f71a39f1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f719c0c8b30 0x7f719c140c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:38.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.358+0000 7f71a39f1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f719c13e920 0x7f719c15a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:38.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.358+0000 7f71a39f1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f719c073170 con 0x7f7188004800 2024-09-15T23:19:38.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.358+0000 7f71a39f1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f719c146580 con 0x7f719c13e920 2024-09-15T23:19:38.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.358+0000 7f71a39f1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f719c06bc10 con 0x7f719c0c8b30 2024-09-15T23:19:38.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.358+0000 7f71a178d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7188004800 0x7f719c142520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:38.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.358+0000 7f71a178d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7188004800 0x7f719c142520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49832/0 (socket says 172.21.15.123:49832) 2024-09-15T23:19:38.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.358+0000 7f71a178d640 1 -- 172.21.15.123:0/3187533017 learned_addr learned my addr 172.21.15.123:0/3187533017 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:38.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.359+0000 7f71a178d640 1 -- 172.21.15.123:0/3187533017 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f719c0c8b30 msgr2=0x7f719c140c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:38.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.359+0000 7f71a178d640 1 --2- 172.21.15.123:0/3187533017 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f719c0c8b30 0x7f719c140c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:38.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.359+0000 7f71a178d640 1 -- 172.21.15.123:0/3187533017 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f719c13e920 msgr2=0x7f719c15a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:38.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.359+0000 7f71a178d640 1 --2- 172.21.15.123:0/3187533017 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f719c13e920 0x7f719c15a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:38.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.359+0000 7f71a178d640 1 -- 172.21.15.123:0/3187533017 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f719c142a60 con 0x7f7188004800 2024-09-15T23:19:38.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.359+0000 7f71a178d640 1 --2- 172.21.15.123:0/3187533017 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7188004800 0x7f719c142520 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f7198000fb0 tx=0x7f719800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:38.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.359+0000 7f7191ffb640 1 -- 172.21.15.123:0/3187533017 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719800c850 con 0x7f7188004800 2024-09-15T23:19:38.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.359+0000 7f7191ffb640 1 -- 172.21.15.123:0/3187533017 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7198018070 con 0x7f7188004800 2024-09-15T23:19:38.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.359+0000 7f71a39f1640 1 -- 172.21.15.123:0/3187533017 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f719c141480 con 0x7f7188004800 2024-09-15T23:19:38.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.359+0000 7f7191ffb640 1 -- 172.21.15.123:0/3187533017 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719800cc10 con 0x7f7188004800 2024-09-15T23:19:38.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.359+0000 7f71a39f1640 1 -- 172.21.15.123:0/3187533017 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f719c141a40 con 0x7f7188004800 2024-09-15T23:19:38.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.360+0000 7f71a39f1640 1 -- 172.21.15.123:0/3187533017 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f719c0720c0 con 0x7f7188004800 2024-09-15T23:19:38.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.361+0000 7f7191ffb640 1 -- 172.21.15.123:0/3187533017 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f719801d460 con 0x7f7188004800 2024-09-15T23:19:38.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.361+0000 7f7191ffb640 1 --2- 172.21.15.123:0/3187533017 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f718006c2b0 0x7f718006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:38.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.361+0000 7f7191ffb640 1 -- 172.21.15.123:0/3187533017 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f719808b200 con 0x7f7188004800 2024-09-15T23:19:38.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.361+0000 7f71a0f8c640 1 --2- 172.21.15.123:0/3187533017 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f718006c2b0 0x7f718006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:38.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.362+0000 7f71a0f8c640 1 --2- 172.21.15.123:0/3187533017 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f718006c2b0 0x7f718006e770 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f718c033000 tx=0x7f718c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:38.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.365+0000 7f7191ffb640 1 -- 172.21.15.123:0/3187533017 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f71980593b0 con 0x7f7188004800 2024-09-15T23:19:38.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.527+0000 7f71a39f1640 1 -- 172.21.15.123:0/3187533017 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f719c144020 con 0x7f718006c2b0 2024-09-15T23:19:38.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.533+0000 7f7191ffb640 1 -- 172.21.15.123:0/3187533017 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245981 (secure 0 0 0) 0x7f719c144020 con 0x7f718006c2b0 2024-09-15T23:19:38.537 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:19:38.538 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:19:38.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.536+0000 7f71a39f1640 1 -- 172.21.15.123:0/3187533017 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f718006c2b0 msgr2=0x7f718006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:38.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.536+0000 7f71a39f1640 1 --2- 172.21.15.123:0/3187533017 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f718006c2b0 0x7f718006e770 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f718c033000 tx=0x7f718c02e000 comp rx=0 tx=0).stop 2024-09-15T23:19:38.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.536+0000 7f71a39f1640 1 -- 172.21.15.123:0/3187533017 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7188004800 msgr2=0x7f719c142520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:38.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.536+0000 7f71a39f1640 1 --2- 172.21.15.123:0/3187533017 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7188004800 0x7f719c142520 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f7198000fb0 tx=0x7f719800ec80 comp rx=0 tx=0).stop 2024-09-15T23:19:38.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.536+0000 7f71a39f1640 1 -- 172.21.15.123:0/3187533017 shutdown_connections 2024-09-15T23:19:38.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.536+0000 7f71a39f1640 1 --2- 172.21.15.123:0/3187533017 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f719c13e920 0x7f719c15a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:38.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.536+0000 7f71a39f1640 1 --2- 172.21.15.123:0/3187533017 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f719c0c8b30 0x7f719c140c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:38.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.536+0000 7f71a39f1640 1 --2- 172.21.15.123:0/3187533017 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f718006c2b0 0x7f718006e770 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:38.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.536+0000 7f71a39f1640 1 --2- 172.21.15.123:0/3187533017 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7188004800 0x7f719c142520 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:38.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.536+0000 7f71a39f1640 1 -- 172.21.15.123:0/3187533017 >> 172.21.15.123:0/3187533017 conn(0x7f719c06cd20 msgr2=0x7f719c144540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:38.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.536+0000 7f71a39f1640 1 -- 172.21.15.123:0/3187533017 shutdown_connections 2024-09-15T23:19:38.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.537+0000 7f71a39f1640 1 -- 172.21.15.123:0/3187533017 wait complete. 2024-09-15T23:19:38.548 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":363,"stamp":"2024-09-15T23:19:37.609210+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":122,"acting":122,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":393276,"kb_used_data":14652,"kb_used_omap":12,"kb_used_meta":378419,"kb_avail":754581444,"statfs":{"total":773094113280,"available":772691398656,"internally_reserved":0,"allocated":15003648,"data_stored":7264693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":387501616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.031457"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.632688+0000","last_change":"2024-09-15T23:19:35.630018+0000","last_active":"2024-09-15T23:19:35.632688+0000","last_peered":"2024-09-15T23:19:35.632688+0000","last_clean":"2024-09-15T23:19:35.632688+0000","last_became_active":"2024-09-15T23:19:35.628099+0000","last_became_peered":"2024-09-15T23:19:35.628099+0000","last_unstale":"2024-09-15T23:19:35.632688+0000","last_undegraded":"2024-09-15T23:19:35.632688+0000","last_fullsized":"2024-09-15T23:19:35.632688+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:56:00.379260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.630794+0000","last_change":"2024-09-15T23:19:35.628850+0000","last_active":"2024-09-15T23:19:35.630794+0000","last_peered":"2024-09-15T23:19:35.630794+0000","last_clean":"2024-09-15T23:19:35.630794+0000","last_became_active":"2024-09-15T23:19:35.628420+0000","last_became_peered":"2024-09-15T23:19:35.628420+0000","last_unstale":"2024-09-15T23:19:35.630794+0000","last_undegraded":"2024-09-15T23:19:35.630794+0000","last_fullsized":"2024-09-15T23:19:35.630794+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:49.534165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.627713+0000","last_change":"2024-09-15T23:19:35.626458+0000","last_active":"2024-09-15T23:19:35.627713+0000","last_peered":"2024-09-15T23:19:35.627713+0000","last_clean":"2024-09-15T23:19:35.627713+0000","last_became_active":"2024-09-15T23:19:35.626142+0000","last_became_peered":"2024-09-15T23:19:35.626142+0000","last_unstale":"2024-09-15T23:19:35.627713+0000","last_undegraded":"2024-09-15T23:19:35.627713+0000","last_fullsized":"2024-09-15T23:19:35.627713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:12.987698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.631096+0000","last_change":"2024-09-15T23:19:35.629074+0000","last_active":"2024-09-15T23:19:35.631096+0000","last_peered":"2024-09-15T23:19:35.631096+0000","last_clean":"2024-09-15T23:19:35.631096+0000","last_became_active":"2024-09-15T23:19:35.628048+0000","last_became_peered":"2024-09-15T23:19:35.628048+0000","last_unstale":"2024-09-15T23:19:35.631096+0000","last_undegraded":"2024-09-15T23:19:35.631096+0000","last_fullsized":"2024-09-15T23:19:35.631096+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:29:55.927749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.631661+0000","last_change":"2024-09-15T23:19:35.629980+0000","last_active":"2024-09-15T23:19:35.631661+0000","last_peered":"2024-09-15T23:19:35.631661+0000","last_clean":"2024-09-15T23:19:35.631661+0000","last_became_active":"2024-09-15T23:19:35.629187+0000","last_became_peered":"2024-09-15T23:19:35.629187+0000","last_unstale":"2024-09-15T23:19:35.631661+0000","last_undegraded":"2024-09-15T23:19:35.631661+0000","last_fullsized":"2024-09-15T23:19:35.631661+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:33.561412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.633625+0000","last_change":"2024-09-15T23:19:35.631492+0000","last_active":"2024-09-15T23:19:35.633625+0000","last_peered":"2024-09-15T23:19:35.633625+0000","last_clean":"2024-09-15T23:19:35.633625+0000","last_became_active":"2024-09-15T23:19:35.631227+0000","last_became_peered":"2024-09-15T23:19:35.631227+0000","last_unstale":"2024-09-15T23:19:35.633625+0000","last_undegraded":"2024-09-15T23:19:35.633625+0000","last_fullsized":"2024-09-15T23:19:35.633625+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:38:34.100919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.630844+0000","last_change":"2024-09-15T23:19:35.625592+0000","last_active":"2024-09-15T23:19:35.630844+0000","last_peered":"2024-09-15T23:19:35.630844+0000","last_clean":"2024-09-15T23:19:35.630844+0000","last_became_active":"2024-09-15T23:19:35.625301+0000","last_became_peered":"2024-09-15T23:19:35.625301+0000","last_unstale":"2024-09-15T23:19:35.630844+0000","last_undegraded":"2024-09-15T23:19:35.630844+0000","last_fullsized":"2024-09-15T23:19:35.630844+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:42.228647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.624457+0000","last_change":"2024-09-15T23:19:35.622364+0000","last_active":"2024-09-15T23:19:35.624457+0000","last_peered":"2024-09-15T23:19:35.624457+0000","last_clean":"2024-09-15T23:19:35.624457+0000","last_became_active":"2024-09-15T23:19:35.622088+0000","last_became_peered":"2024-09-15T23:19:35.622088+0000","last_unstale":"2024-09-15T23:19:35.624457+0000","last_undegraded":"2024-09-15T23:19:35.624457+0000","last_fullsized":"2024-09-15T23:19:35.624457+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:19:32.637779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.633024+0000","last_change":"2024-09-15T23:19:35.626083+0000","last_active":"2024-09-15T23:19:35.633024+0000","last_peered":"2024-09-15T23:19:35.633024+0000","last_clean":"2024-09-15T23:19:35.633024+0000","last_became_active":"2024-09-15T23:19:35.625794+0000","last_became_peered":"2024-09-15T23:19:35.625794+0000","last_unstale":"2024-09-15T23:19:35.633024+0000","last_undegraded":"2024-09-15T23:19:35.633024+0000","last_fullsized":"2024-09-15T23:19:35.633024+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:34.277310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.621259+0000","last_change":"2024-09-15T23:19:35.616254+0000","last_active":"2024-09-15T23:19:35.621259+0000","last_peered":"2024-09-15T23:19:35.621259+0000","last_clean":"2024-09-15T23:19:35.621259+0000","last_became_active":"2024-09-15T23:19:35.615915+0000","last_became_peered":"2024-09-15T23:19:35.615915+0000","last_unstale":"2024-09-15T23:19:35.621259+0000","last_undegraded":"2024-09-15T23:19:35.621259+0000","last_fullsized":"2024-09-15T23:19:35.621259+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:44.666059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.631130+0000","last_change":"2024-09-15T23:19:35.629558+0000","last_active":"2024-09-15T23:19:35.631130+0000","last_peered":"2024-09-15T23:19:35.631130+0000","last_clean":"2024-09-15T23:19:35.631130+0000","last_became_active":"2024-09-15T23:19:35.629253+0000","last_became_peered":"2024-09-15T23:19:35.629253+0000","last_unstale":"2024-09-15T23:19:35.631130+0000","last_undegraded":"2024-09-15T23:19:35.631130+0000","last_fullsized":"2024-09-15T23:19:35.631130+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:20.453779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.630232+0000","last_change":"2024-09-15T23:19:35.628077+0000","last_active":"2024-09-15T23:19:35.630232+0000","last_peered":"2024-09-15T23:19:35.630232+0000","last_clean":"2024-09-15T23:19:35.630232+0000","last_became_active":"2024-09-15T23:19:35.627761+0000","last_became_peered":"2024-09-15T23:19:35.627761+0000","last_unstale":"2024-09-15T23:19:35.630232+0000","last_undegraded":"2024-09-15T23:19:35.630232+0000","last_fullsized":"2024-09-15T23:19:35.630232+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:56:54.736459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.638083+0000","last_change":"2024-09-15T23:19:35.634903+0000","last_active":"2024-09-15T23:19:35.638083+0000","last_peered":"2024-09-15T23:19:35.638083+0000","last_clean":"2024-09-15T23:19:35.638083+0000","last_became_active":"2024-09-15T23:19:35.634630+0000","last_became_peered":"2024-09-15T23:19:35.634630+0000","last_unstale":"2024-09-15T23:19:35.638083+0000","last_undegraded":"2024-09-15T23:19:35.638083+0000","last_fullsized":"2024-09-15T23:19:35.638083+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:53.869099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.620749+0000","last_change":"2024-09-15T23:19:35.615995+0000","last_active":"2024-09-15T23:19:35.620749+0000","last_peered":"2024-09-15T23:19:35.620749+0000","last_clean":"2024-09-15T23:19:35.620749+0000","last_became_active":"2024-09-15T23:19:35.615631+0000","last_became_peered":"2024-09-15T23:19:35.615631+0000","last_unstale":"2024-09-15T23:19:35.620749+0000","last_undegraded":"2024-09-15T23:19:35.620749+0000","last_fullsized":"2024-09-15T23:19:35.620749+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:25.327208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.634312+0000","last_change":"2024-09-15T23:19:35.632719+0000","last_active":"2024-09-15T23:19:35.634312+0000","last_peered":"2024-09-15T23:19:35.634312+0000","last_clean":"2024-09-15T23:19:35.634312+0000","last_became_active":"2024-09-15T23:19:35.632449+0000","last_became_peered":"2024-09-15T23:19:35.632449+0000","last_unstale":"2024-09-15T23:19:35.634312+0000","last_undegraded":"2024-09-15T23:19:35.634312+0000","last_fullsized":"2024-09-15T23:19:35.634312+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:10:40.600923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.640407+0000","last_change":"2024-09-15T23:19:35.639447+0000","last_active":"2024-09-15T23:19:35.640407+0000","last_peered":"2024-09-15T23:19:35.640407+0000","last_clean":"2024-09-15T23:19:35.640407+0000","last_became_active":"2024-09-15T23:19:35.639003+0000","last_became_peered":"2024-09-15T23:19:35.639003+0000","last_unstale":"2024-09-15T23:19:35.640407+0000","last_undegraded":"2024-09-15T23:19:35.640407+0000","last_fullsized":"2024-09-15T23:19:35.640407+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:33:35.905302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.632922+0000","last_change":"2024-09-15T23:19:35.625964+0000","last_active":"2024-09-15T23:19:35.632922+0000","last_peered":"2024-09-15T23:19:35.632922+0000","last_clean":"2024-09-15T23:19:35.632922+0000","last_became_active":"2024-09-15T23:19:35.625432+0000","last_became_peered":"2024-09-15T23:19:35.625432+0000","last_unstale":"2024-09-15T23:19:35.632922+0000","last_undegraded":"2024-09-15T23:19:35.632922+0000","last_fullsized":"2024-09-15T23:19:35.632922+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:23.656736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.638008+0000","last_change":"2024-09-15T23:19:35.635024+0000","last_active":"2024-09-15T23:19:35.638008+0000","last_peered":"2024-09-15T23:19:35.638008+0000","last_clean":"2024-09-15T23:19:35.638008+0000","last_became_active":"2024-09-15T23:19:35.634125+0000","last_became_peered":"2024-09-15T23:19:35.634125+0000","last_unstale":"2024-09-15T23:19:35.638008+0000","last_undegraded":"2024-09-15T23:19:35.638008+0000","last_fullsized":"2024-09-15T23:19:35.638008+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:31.356089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.630400+0000","last_change":"2024-09-15T23:19:35.627210+0000","last_active":"2024-09-15T23:19:35.630400+0000","last_peered":"2024-09-15T23:19:35.630400+0000","last_clean":"2024-09-15T23:19:35.630400+0000","last_became_active":"2024-09-15T23:19:35.626865+0000","last_became_peered":"2024-09-15T23:19:35.626865+0000","last_unstale":"2024-09-15T23:19:35.630400+0000","last_undegraded":"2024-09-15T23:19:35.630400+0000","last_fullsized":"2024-09-15T23:19:35.630400+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:10:40.600923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.632958+0000","last_change":"2024-09-15T23:19:35.626009+0000","last_active":"2024-09-15T23:19:35.632958+0000","last_peered":"2024-09-15T23:19:35.632958+0000","last_clean":"2024-09-15T23:19:35.632958+0000","last_became_active":"2024-09-15T23:19:35.625557+0000","last_became_peered":"2024-09-15T23:19:35.625557+0000","last_unstale":"2024-09-15T23:19:35.632958+0000","last_undegraded":"2024-09-15T23:19:35.632958+0000","last_fullsized":"2024-09-15T23:19:35.632958+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:09.429395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-15T23:19:33.579066+0000","last_change":"2024-09-15T23:19:33.579066+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.579066+0000","last_undegraded":"2024-09-15T23:19:33.579066+0000","last_fullsized":"2024-09-15T23:19:33.579066+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:33.575362+0000","last_change":"2024-09-15T23:19:33.575362+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.575362+0000","last_undegraded":"2024-09-15T23:19:33.575362+0000","last_fullsized":"2024-09-15T23:19:33.575362+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1d","version":"141'2","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.640962+0000","last_change":"2024-09-15T23:19:34.591811+0000","last_active":"2024-09-15T23:19:35.640962+0000","last_peered":"2024-09-15T23:19:35.640962+0000","last_clean":"2024-09-15T23:19:35.640962+0000","last_became_active":"2024-09-15T23:19:34.590764+0000","last_became_peered":"2024-09-15T23:19:34.590764+0000","last_unstale":"2024-09-15T23:19:35.640962+0000","last_undegraded":"2024-09-15T23:19:35.640962+0000","last_fullsized":"2024-09-15T23:19:35.640962+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:15:04.941661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"141'2","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.641207+0000","last_change":"2024-09-15T23:19:34.599647+0000","last_active":"2024-09-15T23:19:35.641207+0000","last_peered":"2024-09-15T23:19:35.641207+0000","last_clean":"2024-09-15T23:19:35.641207+0000","last_became_active":"2024-09-15T23:19:34.599381+0000","last_became_peered":"2024-09-15T23:19:34.599381+0000","last_unstale":"2024-09-15T23:19:35.641207+0000","last_undegraded":"2024-09-15T23:19:35.641207+0000","last_fullsized":"2024-09-15T23:19:35.641207+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:32.559903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.621376+0000","last_change":"2024-09-15T23:19:35.619214+0000","last_active":"2024-09-15T23:19:35.621376+0000","last_peered":"2024-09-15T23:19:35.621376+0000","last_clean":"2024-09-15T23:19:35.621376+0000","last_became_active":"2024-09-15T23:19:35.618944+0000","last_became_peered":"2024-09-15T23:19:35.618944+0000","last_unstale":"2024-09-15T23:19:35.621376+0000","last_undegraded":"2024-09-15T23:19:35.621376+0000","last_fullsized":"2024-09-15T23:19:35.621376+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:55:50.700598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1b","version":"141'1","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.640220+0000","last_change":"2024-09-15T23:19:34.596580+0000","last_active":"2024-09-15T23:19:35.640220+0000","last_peered":"2024-09-15T23:19:35.640220+0000","last_clean":"2024-09-15T23:19:35.640220+0000","last_became_active":"2024-09-15T23:19:34.596299+0000","last_became_peered":"2024-09-15T23:19:34.596299+0000","last_unstale":"2024-09-15T23:19:35.640220+0000","last_undegraded":"2024-09-15T23:19:35.640220+0000","last_fullsized":"2024-09-15T23:19:35.640220+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:00.747606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1a","version":"141'1","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.640113+0000","last_change":"2024-09-15T23:19:34.596781+0000","last_active":"2024-09-15T23:19:35.640113+0000","last_peered":"2024-09-15T23:19:35.640113+0000","last_clean":"2024-09-15T23:19:35.640113+0000","last_became_active":"2024-09-15T23:19:34.594440+0000","last_became_peered":"2024-09-15T23:19:34.594440+0000","last_unstale":"2024-09-15T23:19:35.640113+0000","last_undegraded":"2024-09-15T23:19:35.640113+0000","last_fullsized":"2024-09-15T23:19:35.640113+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:57.692753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:33.575362+0000","last_change":"2024-09-15T23:19:33.575362+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.575362+0000","last_undegraded":"2024-09-15T23:19:33.575362+0000","last_fullsized":"2024-09-15T23:19:33.575362+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.636651+0000","last_change":"2024-09-15T23:19:35.634002+0000","last_active":"2024-09-15T23:19:35.636651+0000","last_peered":"2024-09-15T23:19:35.636651+0000","last_clean":"2024-09-15T23:19:35.636651+0000","last_became_active":"2024-09-15T23:19:35.633706+0000","last_became_peered":"2024-09-15T23:19:35.633706+0000","last_unstale":"2024-09-15T23:19:35.636651+0000","last_undegraded":"2024-09-15T23:19:35.636651+0000","last_fullsized":"2024-09-15T23:19:35.636651+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:55:04.513205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.624244+0000","last_change":"2024-09-15T23:19:34.596861+0000","last_active":"2024-09-15T23:19:35.624244+0000","last_peered":"2024-09-15T23:19:35.624244+0000","last_clean":"2024-09-15T23:19:35.624244+0000","last_became_active":"2024-09-15T23:19:34.596589+0000","last_became_peered":"2024-09-15T23:19:34.596589+0000","last_unstale":"2024-09-15T23:19:35.624244+0000","last_undegraded":"2024-09-15T23:19:35.624244+0000","last_fullsized":"2024-09-15T23:19:35.624244+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:38:33.099410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.636695+0000","last_change":"2024-09-15T23:19:35.634159+0000","last_active":"2024-09-15T23:19:35.636695+0000","last_peered":"2024-09-15T23:19:35.636695+0000","last_clean":"2024-09-15T23:19:35.636695+0000","last_became_active":"2024-09-15T23:19:35.633883+0000","last_became_peered":"2024-09-15T23:19:35.633883+0000","last_unstale":"2024-09-15T23:19:35.636695+0000","last_undegraded":"2024-09-15T23:19:35.636695+0000","last_fullsized":"2024-09-15T23:19:35.636695+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:05:17.623772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-15T23:19:33.581895+0000","last_change":"2024-09-15T23:19:33.581895+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.581895+0000","last_undegraded":"2024-09-15T23:19:33.581895+0000","last_fullsized":"2024-09-15T23:19:33.581895+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.610739+0000","last_change":"2024-09-15T23:19:34.592974+0000","last_active":"2024-09-15T23:19:35.610739+0000","last_peered":"2024-09-15T23:19:35.610739+0000","last_clean":"2024-09-15T23:19:35.610739+0000","last_became_active":"2024-09-15T23:19:34.592445+0000","last_became_peered":"2024-09-15T23:19:34.592445+0000","last_unstale":"2024-09-15T23:19:35.610739+0000","last_undegraded":"2024-09-15T23:19:35.610739+0000","last_fullsized":"2024-09-15T23:19:35.610739+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:30:05.348767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-15T23:19:33.579190+0000","last_change":"2024-09-15T23:19:33.579190+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.579190+0000","last_undegraded":"2024-09-15T23:19:33.579190+0000","last_fullsized":"2024-09-15T23:19:33.579190+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:33.575362+0000","last_change":"2024-09-15T23:19:33.575362+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.575362+0000","last_undegraded":"2024-09-15T23:19:33.575362+0000","last_fullsized":"2024-09-15T23:19:33.575362+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.633199+0000","last_change":"2024-09-15T23:19:35.628636+0000","last_active":"2024-09-15T23:19:35.633199+0000","last_peered":"2024-09-15T23:19:35.633199+0000","last_clean":"2024-09-15T23:19:35.633199+0000","last_became_active":"2024-09-15T23:19:35.628358+0000","last_became_peered":"2024-09-15T23:19:35.628358+0000","last_unstale":"2024-09-15T23:19:35.633199+0000","last_undegraded":"2024-09-15T23:19:35.633199+0000","last_fullsized":"2024-09-15T23:19:35.633199+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:52:45.020431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.617569+0000","last_change":"2024-09-15T23:19:34.595328+0000","last_active":"2024-09-15T23:19:35.617569+0000","last_peered":"2024-09-15T23:19:35.617569+0000","last_clean":"2024-09-15T23:19:35.617569+0000","last_became_active":"2024-09-15T23:19:34.595049+0000","last_became_peered":"2024-09-15T23:19:34.595049+0000","last_unstale":"2024-09-15T23:19:35.617569+0000","last_undegraded":"2024-09-15T23:19:35.617569+0000","last_fullsized":"2024-09-15T23:19:35.617569+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:32:14.607742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.633051+0000","last_change":"2024-09-15T23:19:35.626673+0000","last_active":"2024-09-15T23:19:35.633051+0000","last_peered":"2024-09-15T23:19:35.633051+0000","last_clean":"2024-09-15T23:19:35.633051+0000","last_became_active":"2024-09-15T23:19:35.626396+0000","last_became_peered":"2024-09-15T23:19:35.626396+0000","last_unstale":"2024-09-15T23:19:35.633051+0000","last_undegraded":"2024-09-15T23:19:35.633051+0000","last_fullsized":"2024-09-15T23:19:35.633051+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:34.865411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.617083+0000","last_change":"2024-09-15T23:19:34.591104+0000","last_active":"2024-09-15T23:19:35.617083+0000","last_peered":"2024-09-15T23:19:35.617083+0000","last_clean":"2024-09-15T23:19:35.617083+0000","last_became_active":"2024-09-15T23:19:34.590768+0000","last_became_peered":"2024-09-15T23:19:34.590768+0000","last_unstale":"2024-09-15T23:19:35.617083+0000","last_undegraded":"2024-09-15T23:19:35.617083+0000","last_fullsized":"2024-09-15T23:19:35.617083+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:32:36.307046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-15T23:19:33.581699+0000","last_change":"2024-09-15T23:19:33.581699+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.581699+0000","last_undegraded":"2024-09-15T23:19:33.581699+0000","last_fullsized":"2024-09-15T23:19:33.581699+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-15T23:19:33.581392+0000","last_change":"2024-09-15T23:19:33.581392+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.581392+0000","last_undegraded":"2024-09-15T23:19:33.581392+0000","last_fullsized":"2024-09-15T23:19:33.581392+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.e","version":"141'2","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.640172+0000","last_change":"2024-09-15T23:19:34.590161+0000","last_active":"2024-09-15T23:19:35.640172+0000","last_peered":"2024-09-15T23:19:35.640172+0000","last_clean":"2024-09-15T23:19:35.640172+0000","last_became_active":"2024-09-15T23:19:34.586613+0000","last_became_peered":"2024-09-15T23:19:34.586613+0000","last_unstale":"2024-09-15T23:19:35.640172+0000","last_undegraded":"2024-09-15T23:19:35.640172+0000","last_fullsized":"2024-09-15T23:19:35.640172+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:15.297166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.634999+0000","last_change":"2024-09-15T23:19:35.632211+0000","last_active":"2024-09-15T23:19:35.634999+0000","last_peered":"2024-09-15T23:19:35.634999+0000","last_clean":"2024-09-15T23:19:35.634999+0000","last_became_active":"2024-09-15T23:19:35.631935+0000","last_became_peered":"2024-09-15T23:19:35.631935+0000","last_unstale":"2024-09-15T23:19:35.634999+0000","last_undegraded":"2024-09-15T23:19:35.634999+0000","last_fullsized":"2024-09-15T23:19:35.634999+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:13:51.251783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:33.575362+0000","last_change":"2024-09-15T23:19:33.575362+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.575362+0000","last_undegraded":"2024-09-15T23:19:33.575362+0000","last_fullsized":"2024-09-15T23:19:33.575362+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.638294+0000","last_change":"2024-09-15T23:19:35.636401+0000","last_active":"2024-09-15T23:19:35.638294+0000","last_peered":"2024-09-15T23:19:35.638294+0000","last_clean":"2024-09-15T23:19:35.638294+0000","last_became_active":"2024-09-15T23:19:35.635214+0000","last_became_peered":"2024-09-15T23:19:35.635214+0000","last_unstale":"2024-09-15T23:19:35.638294+0000","last_undegraded":"2024-09-15T23:19:35.638294+0000","last_fullsized":"2024-09-15T23:19:35.638294+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:37.206929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-15T23:19:33.579118+0000","last_change":"2024-09-15T23:19:33.579118+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.579118+0000","last_undegraded":"2024-09-15T23:19:33.579118+0000","last_fullsized":"2024-09-15T23:19:33.579118+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.636669+0000","last_change":"2024-09-15T23:19:35.632888+0000","last_active":"2024-09-15T23:19:35.636669+0000","last_peered":"2024-09-15T23:19:35.636669+0000","last_clean":"2024-09-15T23:19:35.636669+0000","last_became_active":"2024-09-15T23:19:35.631987+0000","last_became_peered":"2024-09-15T23:19:35.631987+0000","last_unstale":"2024-09-15T23:19:35.636669+0000","last_undegraded":"2024-09-15T23:19:35.636669+0000","last_fullsized":"2024-09-15T23:19:35.636669+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:13.514441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:33.575362+0000","last_change":"2024-09-15T23:19:33.575362+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.575362+0000","last_undegraded":"2024-09-15T23:19:33.575362+0000","last_fullsized":"2024-09-15T23:19:33.575362+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.611014+0000","last_change":"2024-09-15T23:19:34.597396+0000","last_active":"2024-09-15T23:19:35.611014+0000","last_peered":"2024-09-15T23:19:35.611014+0000","last_clean":"2024-09-15T23:19:35.611014+0000","last_became_active":"2024-09-15T23:19:34.595843+0000","last_became_peered":"2024-09-15T23:19:34.595843+0000","last_unstale":"2024-09-15T23:19:35.611014+0000","last_undegraded":"2024-09-15T23:19:35.611014+0000","last_fullsized":"2024-09-15T23:19:35.611014+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:24.495888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.626232+0000","last_change":"2024-09-15T23:19:35.623235+0000","last_active":"2024-09-15T23:19:35.626232+0000","last_peered":"2024-09-15T23:19:35.626232+0000","last_clean":"2024-09-15T23:19:35.626232+0000","last_became_active":"2024-09-15T23:19:35.622976+0000","last_became_peered":"2024-09-15T23:19:35.622976+0000","last_unstale":"2024-09-15T23:19:35.626232+0000","last_undegraded":"2024-09-15T23:19:35.626232+0000","last_fullsized":"2024-09-15T23:19:35.626232+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:15.373058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.618243+0000","last_change":"2024-09-15T23:19:34.597859+0000","last_active":"2024-09-15T23:19:35.618243+0000","last_peered":"2024-09-15T23:19:35.618243+0000","last_clean":"2024-09-15T23:19:35.618243+0000","last_became_active":"2024-09-15T23:19:34.597561+0000","last_became_peered":"2024-09-15T23:19:34.597561+0000","last_unstale":"2024-09-15T23:19:35.618243+0000","last_undegraded":"2024-09-15T23:19:35.618243+0000","last_fullsized":"2024-09-15T23:19:35.618243+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:13:21.067550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.618110+0000","last_change":"2024-09-15T23:19:34.591315+0000","last_active":"2024-09-15T23:19:35.618110+0000","last_peered":"2024-09-15T23:19:35.618110+0000","last_clean":"2024-09-15T23:19:35.618110+0000","last_became_active":"2024-09-15T23:19:34.590567+0000","last_became_peered":"2024-09-15T23:19:34.590567+0000","last_unstale":"2024-09-15T23:19:35.618110+0000","last_undegraded":"2024-09-15T23:19:35.618110+0000","last_fullsized":"2024-09-15T23:19:35.618110+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:45:24.682806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.7","version":"141'2","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.637591+0000","last_change":"2024-09-15T23:19:34.596662+0000","last_active":"2024-09-15T23:19:35.637591+0000","last_peered":"2024-09-15T23:19:35.637591+0000","last_clean":"2024-09-15T23:19:35.637591+0000","last_became_active":"2024-09-15T23:19:34.596339+0000","last_became_peered":"2024-09-15T23:19:34.596339+0000","last_unstale":"2024-09-15T23:19:35.637591+0000","last_undegraded":"2024-09-15T23:19:35.637591+0000","last_fullsized":"2024-09-15T23:19:35.637591+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:10.329268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.634418+0000","last_change":"2024-09-15T23:19:35.632263+0000","last_active":"2024-09-15T23:19:35.634418+0000","last_peered":"2024-09-15T23:19:35.634418+0000","last_clean":"2024-09-15T23:19:35.634418+0000","last_became_active":"2024-09-15T23:19:35.631768+0000","last_became_peered":"2024-09-15T23:19:35.631768+0000","last_unstale":"2024-09-15T23:19:35.634418+0000","last_undegraded":"2024-09-15T23:19:35.634418+0000","last_fullsized":"2024-09-15T23:19:35.634418+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:28:37.693205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-15T23:19:33.579403+0000","last_change":"2024-09-15T23:19:33.579403+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.579403+0000","last_undegraded":"2024-09-15T23:19:33.579403+0000","last_fullsized":"2024-09-15T23:19:33.579403+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.634752+0000","last_change":"2024-09-15T23:19:35.633878+0000","last_active":"2024-09-15T23:19:35.634752+0000","last_peered":"2024-09-15T23:19:35.634752+0000","last_clean":"2024-09-15T23:19:35.634752+0000","last_became_active":"2024-09-15T23:19:35.633565+0000","last_became_peered":"2024-09-15T23:19:35.633565+0000","last_unstale":"2024-09-15T23:19:35.634752+0000","last_undegraded":"2024-09-15T23:19:35.634752+0000","last_fullsized":"2024-09-15T23:19:35.634752+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:31.451649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.610262+0000","last_change":"2024-09-15T23:19:34.595426+0000","last_active":"2024-09-15T23:19:35.610262+0000","last_peered":"2024-09-15T23:19:35.610262+0000","last_clean":"2024-09-15T23:19:35.610262+0000","last_became_active":"2024-09-15T23:19:34.594537+0000","last_became_peered":"2024-09-15T23:19:34.594537+0000","last_unstale":"2024-09-15T23:19:35.610262+0000","last_undegraded":"2024-09-15T23:19:35.610262+0000","last_fullsized":"2024-09-15T23:19:35.610262+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:56.083665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.619266+0000","last_change":"2024-09-15T23:19:34.592540+0000","last_active":"2024-09-15T23:19:35.619266+0000","last_peered":"2024-09-15T23:19:35.619266+0000","last_clean":"2024-09-15T23:19:35.619266+0000","last_became_active":"2024-09-15T23:19:34.592184+0000","last_became_peered":"2024-09-15T23:19:34.592184+0000","last_unstale":"2024-09-15T23:19:35.619266+0000","last_undegraded":"2024-09-15T23:19:35.619266+0000","last_fullsized":"2024-09-15T23:19:35.619266+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:08:30.731469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.623647+0000","last_change":"2024-09-15T23:19:34.598761+0000","last_active":"2024-09-15T23:19:35.623647+0000","last_peered":"2024-09-15T23:19:35.623647+0000","last_clean":"2024-09-15T23:19:35.623647+0000","last_became_active":"2024-09-15T23:19:34.598474+0000","last_became_peered":"2024-09-15T23:19:34.598474+0000","last_unstale":"2024-09-15T23:19:35.623647+0000","last_undegraded":"2024-09-15T23:19:35.623647+0000","last_fullsized":"2024-09-15T23:19:35.623647+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:11.986189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-15T23:19:33.581363+0000","last_change":"2024-09-15T23:19:33.581363+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.581363+0000","last_undegraded":"2024-09-15T23:19:33.581363+0000","last_fullsized":"2024-09-15T23:19:33.581363+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.621350+0000","last_change":"2024-09-15T23:19:35.616698+0000","last_active":"2024-09-15T23:19:35.621350+0000","last_peered":"2024-09-15T23:19:35.621350+0000","last_clean":"2024-09-15T23:19:35.621350+0000","last_became_active":"2024-09-15T23:19:35.615861+0000","last_became_peered":"2024-09-15T23:19:35.615861+0000","last_unstale":"2024-09-15T23:19:35.621350+0000","last_undegraded":"2024-09-15T23:19:35.621350+0000","last_fullsized":"2024-09-15T23:19:35.621350+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:57:09.438860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.620995+0000","last_change":"2024-09-15T23:19:34.591465+0000","last_active":"2024-09-15T23:19:35.620995+0000","last_peered":"2024-09-15T23:19:35.620995+0000","last_clean":"2024-09-15T23:19:35.620995+0000","last_became_active":"2024-09-15T23:19:34.590999+0000","last_became_peered":"2024-09-15T23:19:34.590999+0000","last_unstale":"2024-09-15T23:19:35.620995+0000","last_undegraded":"2024-09-15T23:19:35.620995+0000","last_fullsized":"2024-09-15T23:19:35.620995+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:00.747606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.633135+0000","last_change":"2024-09-15T23:19:35.626540+0000","last_active":"2024-09-15T23:19:35.633135+0000","last_peered":"2024-09-15T23:19:35.633135+0000","last_clean":"2024-09-15T23:19:35.633135+0000","last_became_active":"2024-09-15T23:19:35.625997+0000","last_became_peered":"2024-09-15T23:19:35.625997+0000","last_unstale":"2024-09-15T23:19:35.633135+0000","last_undegraded":"2024-09-15T23:19:35.633135+0000","last_fullsized":"2024-09-15T23:19:35.633135+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:30.170171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.618105+0000","last_change":"2024-09-15T23:19:34.594881+0000","last_active":"2024-09-15T23:19:35.618105+0000","last_peered":"2024-09-15T23:19:35.618105+0000","last_clean":"2024-09-15T23:19:35.618105+0000","last_became_active":"2024-09-15T23:19:34.594542+0000","last_became_peered":"2024-09-15T23:19:34.594542+0000","last_unstale":"2024-09-15T23:19:35.618105+0000","last_undegraded":"2024-09-15T23:19:35.618105+0000","last_fullsized":"2024-09-15T23:19:35.618105+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:16:16.310640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-15T23:19:33.582021+0000","last_change":"2024-09-15T23:19:33.582021+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.582021+0000","last_undegraded":"2024-09-15T23:19:33.582021+0000","last_fullsized":"2024-09-15T23:19:33.582021+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":385,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-15T23:19:32.576723+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:19:32.576723+0000","last_peered":"2024-09-15T23:19:32.576723+0000","last_clean":"2024-09-15T23:19:32.576723+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:19:32.576723+0000","last_undegraded":"2024-09-15T23:19:32.576723+0000","last_fullsized":"2024-09-15T23:19:32.576723+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":66,"acting":66,"num_store_stats":4},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":54,"acting":54,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476832,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50904,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320936,"statfs":{"total":96636764160,"available":96584638464,"internally_reserved":0,"allocated":1708032,"data_stored":751605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476829,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50912,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320928,"statfs":{"total":96636764160,"available":96584630272,"internally_reserved":0,"allocated":1708032,"data_stored":751605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476831,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47324,"kb_used_data":2248,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324516,"statfs":{"total":96636764160,"available":96588304384,"internally_reserved":0,"allocated":2301952,"data_stored":1341973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476831,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41168,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330672,"statfs":{"total":96636764160,"available":96594608128,"internally_reserved":0,"allocated":1695744,"data_stored":746478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542238,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45380,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326460,"statfs":{"total":96636764160,"available":96590295040,"internally_reserved":0,"allocated":1748992,"data_stored":770506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":44693962},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542238,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50940,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320900,"statfs":{"total":96636764160,"available":96584601600,"internally_reserved":0,"allocated":1744896,"data_stored":770472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542237,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55700,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316140,"statfs":{"total":96636764160,"available":96579727360,"internally_reserved":0,"allocated":2351104,"data_stored":1361582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542239,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50948,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320892,"statfs":{"total":96636764160,"available":96584593408,"internally_reserved":0,"allocated":1744896,"data_stored":770472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:19:38.553 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:19:38.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.686+0000 7f6ecdfb9640 1 Processor -- start 2024-09-15T23:19:38.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.686+0000 7f6ecdfb9640 1 -- start start 2024-09-15T23:19:38.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.687+0000 7f6ecdfb9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ec806bc10 0x7f6ec806bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:38.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.687+0000 7f6ecdfb9640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6ec80b3790 0x7f6ec81624e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:38.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.687+0000 7f6ecdfb9640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ec806c530 con 0x7f6ec80cef60 2024-09-15T23:19:38.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.687+0000 7f6ecdfb9640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f6ec80cd690 con 0x7f6ec80b3790 2024-09-15T23:19:38.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.687+0000 7f6ecdfb9640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6ec80d06f0 con 0x7f6ec806bc10 2024-09-15T23:19:38.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.687+0000 7f6ec7fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6ec80b3790 0x7f6ec81624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:38.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.687+0000 7f6ec7fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6ec80b3790 0x7f6ec81624e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49836/0 (socket says 172.21.15.123:49836) 2024-09-15T23:19:38.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.687+0000 7f6ec7fff640 1 -- 172.21.15.123:0/1595371780 learned_addr learned my addr 172.21.15.123:0/1595371780 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:38.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.687+0000 7f6ec7fff640 1 -- 172.21.15.123:0/1595371780 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ec806bc10 msgr2=0x7f6ec806bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:38.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.687+0000 7f6ec7fff640 1 --2- 172.21.15.123:0/1595371780 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ec806bc10 0x7f6ec806bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:38.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.687+0000 7f6ec7fff640 1 -- 172.21.15.123:0/1595371780 >> v1:172.21.15.188:6789/0 conn(0x7f6ec80cef60 legacy=0x7f6ec815eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:38.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.687+0000 7f6ec7fff640 1 -- 172.21.15.123:0/1595371780 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec80b4090 con 0x7f6ec80b3790 2024-09-15T23:19:38.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.688+0000 7f6ec7fff640 1 --2- 172.21.15.123:0/1595371780 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ec80b3790 0x7f6ec81624e0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0009e80 tx=0x7f6ec002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e07a1d6f6061d31 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:38.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.688+0000 7f6ec67fc640 1 -- 172.21.15.123:0/1595371780 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0036070 con 0x7f6ec80b3790 2024-09-15T23:19:38.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.688+0000 7f6ec67fc640 1 -- 172.21.15.123:0/1595371780 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ec0031600 con 0x7f6ec80b3790 2024-09-15T23:19:38.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.688+0000 7f6ec67fc640 1 -- 172.21.15.123:0/1595371780 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec00319d0 con 0x7f6ec80b3790 2024-09-15T23:19:38.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.689+0000 7f6ecdfb9640 1 -- 172.21.15.123:0/1595371780 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ec80b3790 msgr2=0x7f6ec81624e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:38.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.689+0000 7f6ecdfb9640 1 --2- 172.21.15.123:0/1595371780 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ec80b3790 0x7f6ec81624e0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0009e80 tx=0x7f6ec002a6f0 comp rx=0 tx=0).stop 2024-09-15T23:19:38.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.689+0000 7f6ecdfb9640 1 -- 172.21.15.123:0/1595371780 shutdown_connections 2024-09-15T23:19:38.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.689+0000 7f6ecdfb9640 1 --2- 172.21.15.123:0/1595371780 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ec80b3790 0x7f6ec81624e0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:38.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.689+0000 7f6ecdfb9640 1 --2- 172.21.15.123:0/1595371780 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ec806bc10 0x7f6ec806bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:38.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.689+0000 7f6ecdfb9640 1 -- 172.21.15.123:0/1595371780 >> 172.21.15.123:0/1595371780 conn(0x7f6ec806cd20 msgr2=0x7f6ec806d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:38.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.689+0000 7f6ecdfb9640 1 -- 172.21.15.123:0/1595371780 shutdown_connections 2024-09-15T23:19:38.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.689+0000 7f6ecdfb9640 1 -- 172.21.15.123:0/1595371780 wait complete. 2024-09-15T23:19:38.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.690+0000 7f6ecdfb9640 1 Processor -- start 2024-09-15T23:19:38.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.690+0000 7f6ecdfb9640 1 -- start start 2024-09-15T23:19:38.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.691+0000 7f6ecdfb9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ec806bc10 0x7f6ec8157260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:38.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.691+0000 7f6ecdfb9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ec80b3790 0x7f6ec80b2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:38.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.691+0000 7f6ecdfb9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ec80cef60 0x7f6ec814bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:38.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.691+0000 7f6ecdfb9640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec80d0f10 con 0x7f6ec806bc10 2024-09-15T23:19:38.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.691+0000 7f6ecdfb9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec80d0c30 con 0x7f6ec80cef60 2024-09-15T23:19:38.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.691+0000 7f6ecdfb9640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6ec80b3c40 con 0x7f6ec80b3790 2024-09-15T23:19:38.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.691+0000 7f6ec77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ec806bc10 0x7f6ec8157260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:38.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.691+0000 7f6ec77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ec806bc10 0x7f6ec8157260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49846/0 (socket says 172.21.15.123:49846) 2024-09-15T23:19:38.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.691+0000 7f6ec77fe640 1 -- 172.21.15.123:0/722742113 learned_addr learned my addr 172.21.15.123:0/722742113 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:38.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.691+0000 7f6ec77fe640 1 -- 172.21.15.123:0/722742113 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ec80b3790 msgr2=0x7f6ec80b2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:38.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.691+0000 7f6ec77fe640 1 --2- 172.21.15.123:0/722742113 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ec80b3790 0x7f6ec80b2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:38.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.691+0000 7f6ec77fe640 1 -- 172.21.15.123:0/722742113 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ec80cef60 msgr2=0x7f6ec814bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:38.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.691+0000 7f6ec77fe640 1 --2- 172.21.15.123:0/722742113 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ec80cef60 0x7f6ec814bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:38.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.691+0000 7f6ec77fe640 1 -- 172.21.15.123:0/722742113 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec80b4d10 con 0x7f6ec806bc10 2024-09-15T23:19:38.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.691+0000 7f6ec77fe640 1 --2- 172.21.15.123:0/722742113 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ec806bc10 0x7f6ec8157260 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc00b4a0 tx=0x7f6ebc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:38.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.692+0000 7f6eaffff640 1 -- 172.21.15.123:0/722742113 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc014070 con 0x7f6ec806bc10 2024-09-15T23:19:38.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.692+0000 7f6eaffff640 1 -- 172.21.15.123:0/722742113 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ebc010610 con 0x7f6ec806bc10 2024-09-15T23:19:38.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.692+0000 7f6ecdfb9640 1 -- 172.21.15.123:0/722742113 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ec8157840 con 0x7f6ec806bc10 2024-09-15T23:19:38.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.692+0000 7f6eaffff640 1 -- 172.21.15.123:0/722742113 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc010a00 con 0x7f6ec806bc10 2024-09-15T23:19:38.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.692+0000 7f6ecdfb9640 1 -- 172.21.15.123:0/722742113 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ec80b5150 con 0x7f6ec806bc10 2024-09-15T23:19:38.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.693+0000 7f6ecdfb9640 1 -- 172.21.15.123:0/722742113 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ec806bff0 con 0x7f6ec806bc10 2024-09-15T23:19:38.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.693+0000 7f6eaffff640 1 -- 172.21.15.123:0/722742113 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6ebc017070 con 0x7f6ec806bc10 2024-09-15T23:19:38.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.694+0000 7f6eaffff640 1 --2- 172.21.15.123:0/722742113 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6eb406c2b0 0x7f6eb406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:38.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.694+0000 7f6eaffff640 1 -- 172.21.15.123:0/722742113 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f6ebc08aeb0 con 0x7f6ec806bc10 2024-09-15T23:19:38.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.694+0000 7f6ec6ffd640 1 --2- 172.21.15.123:0/722742113 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6eb406c2b0 0x7f6eb406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:38.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.694+0000 7f6ec6ffd640 1 --2- 172.21.15.123:0/722742113 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6eb406c2b0 0x7f6eb406e770 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f6ec815e880 tx=0x7f6eb8006ba0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:38.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.698+0000 7f6eaffff640 1 -- 172.21.15.123:0/722742113 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6ec80b4d10 con 0x7f6ec806bc10 2024-09-15T23:19:38.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.860+0000 7f6ecdfb9640 1 -- 172.21.15.123:0/722742113 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6ec80691f0 con 0x7f6eb406c2b0 2024-09-15T23:19:38.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.866+0000 7f6eaffff640 1 -- 172.21.15.123:0/722742113 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245981 (secure 0 0 0) 0x7f6ec80691f0 con 0x7f6eb406c2b0 2024-09-15T23:19:38.870 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:19:38.872 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:19:38.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.869+0000 7f6ecdfb9640 1 -- 172.21.15.123:0/722742113 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6eb406c2b0 msgr2=0x7f6eb406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:38.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.869+0000 7f6ecdfb9640 1 --2- 172.21.15.123:0/722742113 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6eb406c2b0 0x7f6eb406e770 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f6ec815e880 tx=0x7f6eb8006ba0 comp rx=0 tx=0).stop 2024-09-15T23:19:38.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.869+0000 7f6ecdfb9640 1 -- 172.21.15.123:0/722742113 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ec806bc10 msgr2=0x7f6ec8157260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:38.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.869+0000 7f6ecdfb9640 1 --2- 172.21.15.123:0/722742113 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ec806bc10 0x7f6ec8157260 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc00b4a0 tx=0x7f6ebc00b960 comp rx=0 tx=0).stop 2024-09-15T23:19:38.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.869+0000 7f6ecdfb9640 1 -- 172.21.15.123:0/722742113 shutdown_connections 2024-09-15T23:19:38.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.869+0000 7f6ecdfb9640 1 --2- 172.21.15.123:0/722742113 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ec80cef60 0x7f6ec814bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:38.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.869+0000 7f6ecdfb9640 1 --2- 172.21.15.123:0/722742113 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ec80b3790 0x7f6ec80b2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:38.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.869+0000 7f6ecdfb9640 1 --2- 172.21.15.123:0/722742113 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6eb406c2b0 0x7f6eb406e770 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:38.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.869+0000 7f6ecdfb9640 1 --2- 172.21.15.123:0/722742113 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ec806bc10 0x7f6ec8157260 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:38.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.869+0000 7f6ecdfb9640 1 -- 172.21.15.123:0/722742113 >> 172.21.15.123:0/722742113 conn(0x7f6ec806cd20 msgr2=0x7f6ec806d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:38.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.869+0000 7f6ecdfb9640 1 -- 172.21.15.123:0/722742113 shutdown_connections 2024-09-15T23:19:38.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:38.869+0000 7f6ecdfb9640 1 -- 172.21.15.123:0/722742113 wait complete. 2024-09-15T23:19:38.881 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":363,"stamp":"2024-09-15T23:19:37.609210+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":122,"acting":122,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":393276,"kb_used_data":14652,"kb_used_omap":12,"kb_used_meta":378419,"kb_avail":754581444,"statfs":{"total":773094113280,"available":772691398656,"internally_reserved":0,"allocated":15003648,"data_stored":7264693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":387501616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.031457"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.632688+0000","last_change":"2024-09-15T23:19:35.630018+0000","last_active":"2024-09-15T23:19:35.632688+0000","last_peered":"2024-09-15T23:19:35.632688+0000","last_clean":"2024-09-15T23:19:35.632688+0000","last_became_active":"2024-09-15T23:19:35.628099+0000","last_became_peered":"2024-09-15T23:19:35.628099+0000","last_unstale":"2024-09-15T23:19:35.632688+0000","last_undegraded":"2024-09-15T23:19:35.632688+0000","last_fullsized":"2024-09-15T23:19:35.632688+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:56:00.379260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.630794+0000","last_change":"2024-09-15T23:19:35.628850+0000","last_active":"2024-09-15T23:19:35.630794+0000","last_peered":"2024-09-15T23:19:35.630794+0000","last_clean":"2024-09-15T23:19:35.630794+0000","last_became_active":"2024-09-15T23:19:35.628420+0000","last_became_peered":"2024-09-15T23:19:35.628420+0000","last_unstale":"2024-09-15T23:19:35.630794+0000","last_undegraded":"2024-09-15T23:19:35.630794+0000","last_fullsized":"2024-09-15T23:19:35.630794+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:49.534165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.627713+0000","last_change":"2024-09-15T23:19:35.626458+0000","last_active":"2024-09-15T23:19:35.627713+0000","last_peered":"2024-09-15T23:19:35.627713+0000","last_clean":"2024-09-15T23:19:35.627713+0000","last_became_active":"2024-09-15T23:19:35.626142+0000","last_became_peered":"2024-09-15T23:19:35.626142+0000","last_unstale":"2024-09-15T23:19:35.627713+0000","last_undegraded":"2024-09-15T23:19:35.627713+0000","last_fullsized":"2024-09-15T23:19:35.627713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:12.987698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.631096+0000","last_change":"2024-09-15T23:19:35.629074+0000","last_active":"2024-09-15T23:19:35.631096+0000","last_peered":"2024-09-15T23:19:35.631096+0000","last_clean":"2024-09-15T23:19:35.631096+0000","last_became_active":"2024-09-15T23:19:35.628048+0000","last_became_peered":"2024-09-15T23:19:35.628048+0000","last_unstale":"2024-09-15T23:19:35.631096+0000","last_undegraded":"2024-09-15T23:19:35.631096+0000","last_fullsized":"2024-09-15T23:19:35.631096+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:29:55.927749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.631661+0000","last_change":"2024-09-15T23:19:35.629980+0000","last_active":"2024-09-15T23:19:35.631661+0000","last_peered":"2024-09-15T23:19:35.631661+0000","last_clean":"2024-09-15T23:19:35.631661+0000","last_became_active":"2024-09-15T23:19:35.629187+0000","last_became_peered":"2024-09-15T23:19:35.629187+0000","last_unstale":"2024-09-15T23:19:35.631661+0000","last_undegraded":"2024-09-15T23:19:35.631661+0000","last_fullsized":"2024-09-15T23:19:35.631661+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:33.561412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.633625+0000","last_change":"2024-09-15T23:19:35.631492+0000","last_active":"2024-09-15T23:19:35.633625+0000","last_peered":"2024-09-15T23:19:35.633625+0000","last_clean":"2024-09-15T23:19:35.633625+0000","last_became_active":"2024-09-15T23:19:35.631227+0000","last_became_peered":"2024-09-15T23:19:35.631227+0000","last_unstale":"2024-09-15T23:19:35.633625+0000","last_undegraded":"2024-09-15T23:19:35.633625+0000","last_fullsized":"2024-09-15T23:19:35.633625+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:38:34.100919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.630844+0000","last_change":"2024-09-15T23:19:35.625592+0000","last_active":"2024-09-15T23:19:35.630844+0000","last_peered":"2024-09-15T23:19:35.630844+0000","last_clean":"2024-09-15T23:19:35.630844+0000","last_became_active":"2024-09-15T23:19:35.625301+0000","last_became_peered":"2024-09-15T23:19:35.625301+0000","last_unstale":"2024-09-15T23:19:35.630844+0000","last_undegraded":"2024-09-15T23:19:35.630844+0000","last_fullsized":"2024-09-15T23:19:35.630844+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:42.228647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.624457+0000","last_change":"2024-09-15T23:19:35.622364+0000","last_active":"2024-09-15T23:19:35.624457+0000","last_peered":"2024-09-15T23:19:35.624457+0000","last_clean":"2024-09-15T23:19:35.624457+0000","last_became_active":"2024-09-15T23:19:35.622088+0000","last_became_peered":"2024-09-15T23:19:35.622088+0000","last_unstale":"2024-09-15T23:19:35.624457+0000","last_undegraded":"2024-09-15T23:19:35.624457+0000","last_fullsized":"2024-09-15T23:19:35.624457+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:19:32.637779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.633024+0000","last_change":"2024-09-15T23:19:35.626083+0000","last_active":"2024-09-15T23:19:35.633024+0000","last_peered":"2024-09-15T23:19:35.633024+0000","last_clean":"2024-09-15T23:19:35.633024+0000","last_became_active":"2024-09-15T23:19:35.625794+0000","last_became_peered":"2024-09-15T23:19:35.625794+0000","last_unstale":"2024-09-15T23:19:35.633024+0000","last_undegraded":"2024-09-15T23:19:35.633024+0000","last_fullsized":"2024-09-15T23:19:35.633024+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:34.277310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.621259+0000","last_change":"2024-09-15T23:19:35.616254+0000","last_active":"2024-09-15T23:19:35.621259+0000","last_peered":"2024-09-15T23:19:35.621259+0000","last_clean":"2024-09-15T23:19:35.621259+0000","last_became_active":"2024-09-15T23:19:35.615915+0000","last_became_peered":"2024-09-15T23:19:35.615915+0000","last_unstale":"2024-09-15T23:19:35.621259+0000","last_undegraded":"2024-09-15T23:19:35.621259+0000","last_fullsized":"2024-09-15T23:19:35.621259+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:44.666059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.631130+0000","last_change":"2024-09-15T23:19:35.629558+0000","last_active":"2024-09-15T23:19:35.631130+0000","last_peered":"2024-09-15T23:19:35.631130+0000","last_clean":"2024-09-15T23:19:35.631130+0000","last_became_active":"2024-09-15T23:19:35.629253+0000","last_became_peered":"2024-09-15T23:19:35.629253+0000","last_unstale":"2024-09-15T23:19:35.631130+0000","last_undegraded":"2024-09-15T23:19:35.631130+0000","last_fullsized":"2024-09-15T23:19:35.631130+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:20.453779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.630232+0000","last_change":"2024-09-15T23:19:35.628077+0000","last_active":"2024-09-15T23:19:35.630232+0000","last_peered":"2024-09-15T23:19:35.630232+0000","last_clean":"2024-09-15T23:19:35.630232+0000","last_became_active":"2024-09-15T23:19:35.627761+0000","last_became_peered":"2024-09-15T23:19:35.627761+0000","last_unstale":"2024-09-15T23:19:35.630232+0000","last_undegraded":"2024-09-15T23:19:35.630232+0000","last_fullsized":"2024-09-15T23:19:35.630232+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:56:54.736459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.638083+0000","last_change":"2024-09-15T23:19:35.634903+0000","last_active":"2024-09-15T23:19:35.638083+0000","last_peered":"2024-09-15T23:19:35.638083+0000","last_clean":"2024-09-15T23:19:35.638083+0000","last_became_active":"2024-09-15T23:19:35.634630+0000","last_became_peered":"2024-09-15T23:19:35.634630+0000","last_unstale":"2024-09-15T23:19:35.638083+0000","last_undegraded":"2024-09-15T23:19:35.638083+0000","last_fullsized":"2024-09-15T23:19:35.638083+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:53.869099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.620749+0000","last_change":"2024-09-15T23:19:35.615995+0000","last_active":"2024-09-15T23:19:35.620749+0000","last_peered":"2024-09-15T23:19:35.620749+0000","last_clean":"2024-09-15T23:19:35.620749+0000","last_became_active":"2024-09-15T23:19:35.615631+0000","last_became_peered":"2024-09-15T23:19:35.615631+0000","last_unstale":"2024-09-15T23:19:35.620749+0000","last_undegraded":"2024-09-15T23:19:35.620749+0000","last_fullsized":"2024-09-15T23:19:35.620749+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:25.327208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.634312+0000","last_change":"2024-09-15T23:19:35.632719+0000","last_active":"2024-09-15T23:19:35.634312+0000","last_peered":"2024-09-15T23:19:35.634312+0000","last_clean":"2024-09-15T23:19:35.634312+0000","last_became_active":"2024-09-15T23:19:35.632449+0000","last_became_peered":"2024-09-15T23:19:35.632449+0000","last_unstale":"2024-09-15T23:19:35.634312+0000","last_undegraded":"2024-09-15T23:19:35.634312+0000","last_fullsized":"2024-09-15T23:19:35.634312+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:10:40.600923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.640407+0000","last_change":"2024-09-15T23:19:35.639447+0000","last_active":"2024-09-15T23:19:35.640407+0000","last_peered":"2024-09-15T23:19:35.640407+0000","last_clean":"2024-09-15T23:19:35.640407+0000","last_became_active":"2024-09-15T23:19:35.639003+0000","last_became_peered":"2024-09-15T23:19:35.639003+0000","last_unstale":"2024-09-15T23:19:35.640407+0000","last_undegraded":"2024-09-15T23:19:35.640407+0000","last_fullsized":"2024-09-15T23:19:35.640407+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:33:35.905302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.632922+0000","last_change":"2024-09-15T23:19:35.625964+0000","last_active":"2024-09-15T23:19:35.632922+0000","last_peered":"2024-09-15T23:19:35.632922+0000","last_clean":"2024-09-15T23:19:35.632922+0000","last_became_active":"2024-09-15T23:19:35.625432+0000","last_became_peered":"2024-09-15T23:19:35.625432+0000","last_unstale":"2024-09-15T23:19:35.632922+0000","last_undegraded":"2024-09-15T23:19:35.632922+0000","last_fullsized":"2024-09-15T23:19:35.632922+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:23.656736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.638008+0000","last_change":"2024-09-15T23:19:35.635024+0000","last_active":"2024-09-15T23:19:35.638008+0000","last_peered":"2024-09-15T23:19:35.638008+0000","last_clean":"2024-09-15T23:19:35.638008+0000","last_became_active":"2024-09-15T23:19:35.634125+0000","last_became_peered":"2024-09-15T23:19:35.634125+0000","last_unstale":"2024-09-15T23:19:35.638008+0000","last_undegraded":"2024-09-15T23:19:35.638008+0000","last_fullsized":"2024-09-15T23:19:35.638008+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:31.356089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.630400+0000","last_change":"2024-09-15T23:19:35.627210+0000","last_active":"2024-09-15T23:19:35.630400+0000","last_peered":"2024-09-15T23:19:35.630400+0000","last_clean":"2024-09-15T23:19:35.630400+0000","last_became_active":"2024-09-15T23:19:35.626865+0000","last_became_peered":"2024-09-15T23:19:35.626865+0000","last_unstale":"2024-09-15T23:19:35.630400+0000","last_undegraded":"2024-09-15T23:19:35.630400+0000","last_fullsized":"2024-09-15T23:19:35.630400+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:10:40.600923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.632958+0000","last_change":"2024-09-15T23:19:35.626009+0000","last_active":"2024-09-15T23:19:35.632958+0000","last_peered":"2024-09-15T23:19:35.632958+0000","last_clean":"2024-09-15T23:19:35.632958+0000","last_became_active":"2024-09-15T23:19:35.625557+0000","last_became_peered":"2024-09-15T23:19:35.625557+0000","last_unstale":"2024-09-15T23:19:35.632958+0000","last_undegraded":"2024-09-15T23:19:35.632958+0000","last_fullsized":"2024-09-15T23:19:35.632958+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:09.429395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-15T23:19:33.579066+0000","last_change":"2024-09-15T23:19:33.579066+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.579066+0000","last_undegraded":"2024-09-15T23:19:33.579066+0000","last_fullsized":"2024-09-15T23:19:33.579066+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:33.575362+0000","last_change":"2024-09-15T23:19:33.575362+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.575362+0000","last_undegraded":"2024-09-15T23:19:33.575362+0000","last_fullsized":"2024-09-15T23:19:33.575362+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1d","version":"141'2","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.640962+0000","last_change":"2024-09-15T23:19:34.591811+0000","last_active":"2024-09-15T23:19:35.640962+0000","last_peered":"2024-09-15T23:19:35.640962+0000","last_clean":"2024-09-15T23:19:35.640962+0000","last_became_active":"2024-09-15T23:19:34.590764+0000","last_became_peered":"2024-09-15T23:19:34.590764+0000","last_unstale":"2024-09-15T23:19:35.640962+0000","last_undegraded":"2024-09-15T23:19:35.640962+0000","last_fullsized":"2024-09-15T23:19:35.640962+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:15:04.941661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"141'2","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.641207+0000","last_change":"2024-09-15T23:19:34.599647+0000","last_active":"2024-09-15T23:19:35.641207+0000","last_peered":"2024-09-15T23:19:35.641207+0000","last_clean":"2024-09-15T23:19:35.641207+0000","last_became_active":"2024-09-15T23:19:34.599381+0000","last_became_peered":"2024-09-15T23:19:34.599381+0000","last_unstale":"2024-09-15T23:19:35.641207+0000","last_undegraded":"2024-09-15T23:19:35.641207+0000","last_fullsized":"2024-09-15T23:19:35.641207+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:32.559903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.621376+0000","last_change":"2024-09-15T23:19:35.619214+0000","last_active":"2024-09-15T23:19:35.621376+0000","last_peered":"2024-09-15T23:19:35.621376+0000","last_clean":"2024-09-15T23:19:35.621376+0000","last_became_active":"2024-09-15T23:19:35.618944+0000","last_became_peered":"2024-09-15T23:19:35.618944+0000","last_unstale":"2024-09-15T23:19:35.621376+0000","last_undegraded":"2024-09-15T23:19:35.621376+0000","last_fullsized":"2024-09-15T23:19:35.621376+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:55:50.700598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1b","version":"141'1","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.640220+0000","last_change":"2024-09-15T23:19:34.596580+0000","last_active":"2024-09-15T23:19:35.640220+0000","last_peered":"2024-09-15T23:19:35.640220+0000","last_clean":"2024-09-15T23:19:35.640220+0000","last_became_active":"2024-09-15T23:19:34.596299+0000","last_became_peered":"2024-09-15T23:19:34.596299+0000","last_unstale":"2024-09-15T23:19:35.640220+0000","last_undegraded":"2024-09-15T23:19:35.640220+0000","last_fullsized":"2024-09-15T23:19:35.640220+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:00.747606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1a","version":"141'1","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.640113+0000","last_change":"2024-09-15T23:19:34.596781+0000","last_active":"2024-09-15T23:19:35.640113+0000","last_peered":"2024-09-15T23:19:35.640113+0000","last_clean":"2024-09-15T23:19:35.640113+0000","last_became_active":"2024-09-15T23:19:34.594440+0000","last_became_peered":"2024-09-15T23:19:34.594440+0000","last_unstale":"2024-09-15T23:19:35.640113+0000","last_undegraded":"2024-09-15T23:19:35.640113+0000","last_fullsized":"2024-09-15T23:19:35.640113+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:57.692753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:33.575362+0000","last_change":"2024-09-15T23:19:33.575362+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.575362+0000","last_undegraded":"2024-09-15T23:19:33.575362+0000","last_fullsized":"2024-09-15T23:19:33.575362+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.636651+0000","last_change":"2024-09-15T23:19:35.634002+0000","last_active":"2024-09-15T23:19:35.636651+0000","last_peered":"2024-09-15T23:19:35.636651+0000","last_clean":"2024-09-15T23:19:35.636651+0000","last_became_active":"2024-09-15T23:19:35.633706+0000","last_became_peered":"2024-09-15T23:19:35.633706+0000","last_unstale":"2024-09-15T23:19:35.636651+0000","last_undegraded":"2024-09-15T23:19:35.636651+0000","last_fullsized":"2024-09-15T23:19:35.636651+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:55:04.513205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.624244+0000","last_change":"2024-09-15T23:19:34.596861+0000","last_active":"2024-09-15T23:19:35.624244+0000","last_peered":"2024-09-15T23:19:35.624244+0000","last_clean":"2024-09-15T23:19:35.624244+0000","last_became_active":"2024-09-15T23:19:34.596589+0000","last_became_peered":"2024-09-15T23:19:34.596589+0000","last_unstale":"2024-09-15T23:19:35.624244+0000","last_undegraded":"2024-09-15T23:19:35.624244+0000","last_fullsized":"2024-09-15T23:19:35.624244+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:38:33.099410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.636695+0000","last_change":"2024-09-15T23:19:35.634159+0000","last_active":"2024-09-15T23:19:35.636695+0000","last_peered":"2024-09-15T23:19:35.636695+0000","last_clean":"2024-09-15T23:19:35.636695+0000","last_became_active":"2024-09-15T23:19:35.633883+0000","last_became_peered":"2024-09-15T23:19:35.633883+0000","last_unstale":"2024-09-15T23:19:35.636695+0000","last_undegraded":"2024-09-15T23:19:35.636695+0000","last_fullsized":"2024-09-15T23:19:35.636695+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:05:17.623772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-15T23:19:33.581895+0000","last_change":"2024-09-15T23:19:33.581895+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.581895+0000","last_undegraded":"2024-09-15T23:19:33.581895+0000","last_fullsized":"2024-09-15T23:19:33.581895+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.610739+0000","last_change":"2024-09-15T23:19:34.592974+0000","last_active":"2024-09-15T23:19:35.610739+0000","last_peered":"2024-09-15T23:19:35.610739+0000","last_clean":"2024-09-15T23:19:35.610739+0000","last_became_active":"2024-09-15T23:19:34.592445+0000","last_became_peered":"2024-09-15T23:19:34.592445+0000","last_unstale":"2024-09-15T23:19:35.610739+0000","last_undegraded":"2024-09-15T23:19:35.610739+0000","last_fullsized":"2024-09-15T23:19:35.610739+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:30:05.348767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-15T23:19:33.579190+0000","last_change":"2024-09-15T23:19:33.579190+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.579190+0000","last_undegraded":"2024-09-15T23:19:33.579190+0000","last_fullsized":"2024-09-15T23:19:33.579190+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:33.575362+0000","last_change":"2024-09-15T23:19:33.575362+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.575362+0000","last_undegraded":"2024-09-15T23:19:33.575362+0000","last_fullsized":"2024-09-15T23:19:33.575362+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.633199+0000","last_change":"2024-09-15T23:19:35.628636+0000","last_active":"2024-09-15T23:19:35.633199+0000","last_peered":"2024-09-15T23:19:35.633199+0000","last_clean":"2024-09-15T23:19:35.633199+0000","last_became_active":"2024-09-15T23:19:35.628358+0000","last_became_peered":"2024-09-15T23:19:35.628358+0000","last_unstale":"2024-09-15T23:19:35.633199+0000","last_undegraded":"2024-09-15T23:19:35.633199+0000","last_fullsized":"2024-09-15T23:19:35.633199+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:52:45.020431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.617569+0000","last_change":"2024-09-15T23:19:34.595328+0000","last_active":"2024-09-15T23:19:35.617569+0000","last_peered":"2024-09-15T23:19:35.617569+0000","last_clean":"2024-09-15T23:19:35.617569+0000","last_became_active":"2024-09-15T23:19:34.595049+0000","last_became_peered":"2024-09-15T23:19:34.595049+0000","last_unstale":"2024-09-15T23:19:35.617569+0000","last_undegraded":"2024-09-15T23:19:35.617569+0000","last_fullsized":"2024-09-15T23:19:35.617569+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:32:14.607742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.633051+0000","last_change":"2024-09-15T23:19:35.626673+0000","last_active":"2024-09-15T23:19:35.633051+0000","last_peered":"2024-09-15T23:19:35.633051+0000","last_clean":"2024-09-15T23:19:35.633051+0000","last_became_active":"2024-09-15T23:19:35.626396+0000","last_became_peered":"2024-09-15T23:19:35.626396+0000","last_unstale":"2024-09-15T23:19:35.633051+0000","last_undegraded":"2024-09-15T23:19:35.633051+0000","last_fullsized":"2024-09-15T23:19:35.633051+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:34.865411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.617083+0000","last_change":"2024-09-15T23:19:34.591104+0000","last_active":"2024-09-15T23:19:35.617083+0000","last_peered":"2024-09-15T23:19:35.617083+0000","last_clean":"2024-09-15T23:19:35.617083+0000","last_became_active":"2024-09-15T23:19:34.590768+0000","last_became_peered":"2024-09-15T23:19:34.590768+0000","last_unstale":"2024-09-15T23:19:35.617083+0000","last_undegraded":"2024-09-15T23:19:35.617083+0000","last_fullsized":"2024-09-15T23:19:35.617083+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:32:36.307046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-15T23:19:33.581699+0000","last_change":"2024-09-15T23:19:33.581699+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.581699+0000","last_undegraded":"2024-09-15T23:19:33.581699+0000","last_fullsized":"2024-09-15T23:19:33.581699+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-15T23:19:33.581392+0000","last_change":"2024-09-15T23:19:33.581392+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.581392+0000","last_undegraded":"2024-09-15T23:19:33.581392+0000","last_fullsized":"2024-09-15T23:19:33.581392+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.e","version":"141'2","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.640172+0000","last_change":"2024-09-15T23:19:34.590161+0000","last_active":"2024-09-15T23:19:35.640172+0000","last_peered":"2024-09-15T23:19:35.640172+0000","last_clean":"2024-09-15T23:19:35.640172+0000","last_became_active":"2024-09-15T23:19:34.586613+0000","last_became_peered":"2024-09-15T23:19:34.586613+0000","last_unstale":"2024-09-15T23:19:35.640172+0000","last_undegraded":"2024-09-15T23:19:35.640172+0000","last_fullsized":"2024-09-15T23:19:35.640172+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:15.297166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.634999+0000","last_change":"2024-09-15T23:19:35.632211+0000","last_active":"2024-09-15T23:19:35.634999+0000","last_peered":"2024-09-15T23:19:35.634999+0000","last_clean":"2024-09-15T23:19:35.634999+0000","last_became_active":"2024-09-15T23:19:35.631935+0000","last_became_peered":"2024-09-15T23:19:35.631935+0000","last_unstale":"2024-09-15T23:19:35.634999+0000","last_undegraded":"2024-09-15T23:19:35.634999+0000","last_fullsized":"2024-09-15T23:19:35.634999+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:13:51.251783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:33.575362+0000","last_change":"2024-09-15T23:19:33.575362+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.575362+0000","last_undegraded":"2024-09-15T23:19:33.575362+0000","last_fullsized":"2024-09-15T23:19:33.575362+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.638294+0000","last_change":"2024-09-15T23:19:35.636401+0000","last_active":"2024-09-15T23:19:35.638294+0000","last_peered":"2024-09-15T23:19:35.638294+0000","last_clean":"2024-09-15T23:19:35.638294+0000","last_became_active":"2024-09-15T23:19:35.635214+0000","last_became_peered":"2024-09-15T23:19:35.635214+0000","last_unstale":"2024-09-15T23:19:35.638294+0000","last_undegraded":"2024-09-15T23:19:35.638294+0000","last_fullsized":"2024-09-15T23:19:35.638294+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:37.206929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-15T23:19:33.579118+0000","last_change":"2024-09-15T23:19:33.579118+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.579118+0000","last_undegraded":"2024-09-15T23:19:33.579118+0000","last_fullsized":"2024-09-15T23:19:33.579118+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.636669+0000","last_change":"2024-09-15T23:19:35.632888+0000","last_active":"2024-09-15T23:19:35.636669+0000","last_peered":"2024-09-15T23:19:35.636669+0000","last_clean":"2024-09-15T23:19:35.636669+0000","last_became_active":"2024-09-15T23:19:35.631987+0000","last_became_peered":"2024-09-15T23:19:35.631987+0000","last_unstale":"2024-09-15T23:19:35.636669+0000","last_undegraded":"2024-09-15T23:19:35.636669+0000","last_fullsized":"2024-09-15T23:19:35.636669+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:13.514441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:33.575362+0000","last_change":"2024-09-15T23:19:33.575362+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.575362+0000","last_undegraded":"2024-09-15T23:19:33.575362+0000","last_fullsized":"2024-09-15T23:19:33.575362+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.611014+0000","last_change":"2024-09-15T23:19:34.597396+0000","last_active":"2024-09-15T23:19:35.611014+0000","last_peered":"2024-09-15T23:19:35.611014+0000","last_clean":"2024-09-15T23:19:35.611014+0000","last_became_active":"2024-09-15T23:19:34.595843+0000","last_became_peered":"2024-09-15T23:19:34.595843+0000","last_unstale":"2024-09-15T23:19:35.611014+0000","last_undegraded":"2024-09-15T23:19:35.611014+0000","last_fullsized":"2024-09-15T23:19:35.611014+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:24.495888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.626232+0000","last_change":"2024-09-15T23:19:35.623235+0000","last_active":"2024-09-15T23:19:35.626232+0000","last_peered":"2024-09-15T23:19:35.626232+0000","last_clean":"2024-09-15T23:19:35.626232+0000","last_became_active":"2024-09-15T23:19:35.622976+0000","last_became_peered":"2024-09-15T23:19:35.622976+0000","last_unstale":"2024-09-15T23:19:35.626232+0000","last_undegraded":"2024-09-15T23:19:35.626232+0000","last_fullsized":"2024-09-15T23:19:35.626232+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:15.373058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.618243+0000","last_change":"2024-09-15T23:19:34.597859+0000","last_active":"2024-09-15T23:19:35.618243+0000","last_peered":"2024-09-15T23:19:35.618243+0000","last_clean":"2024-09-15T23:19:35.618243+0000","last_became_active":"2024-09-15T23:19:34.597561+0000","last_became_peered":"2024-09-15T23:19:34.597561+0000","last_unstale":"2024-09-15T23:19:35.618243+0000","last_undegraded":"2024-09-15T23:19:35.618243+0000","last_fullsized":"2024-09-15T23:19:35.618243+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:13:21.067550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.618110+0000","last_change":"2024-09-15T23:19:34.591315+0000","last_active":"2024-09-15T23:19:35.618110+0000","last_peered":"2024-09-15T23:19:35.618110+0000","last_clean":"2024-09-15T23:19:35.618110+0000","last_became_active":"2024-09-15T23:19:34.590567+0000","last_became_peered":"2024-09-15T23:19:34.590567+0000","last_unstale":"2024-09-15T23:19:35.618110+0000","last_undegraded":"2024-09-15T23:19:35.618110+0000","last_fullsized":"2024-09-15T23:19:35.618110+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:45:24.682806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.7","version":"141'2","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.637591+0000","last_change":"2024-09-15T23:19:34.596662+0000","last_active":"2024-09-15T23:19:35.637591+0000","last_peered":"2024-09-15T23:19:35.637591+0000","last_clean":"2024-09-15T23:19:35.637591+0000","last_became_active":"2024-09-15T23:19:34.596339+0000","last_became_peered":"2024-09-15T23:19:34.596339+0000","last_unstale":"2024-09-15T23:19:35.637591+0000","last_undegraded":"2024-09-15T23:19:35.637591+0000","last_fullsized":"2024-09-15T23:19:35.637591+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:10.329268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.634418+0000","last_change":"2024-09-15T23:19:35.632263+0000","last_active":"2024-09-15T23:19:35.634418+0000","last_peered":"2024-09-15T23:19:35.634418+0000","last_clean":"2024-09-15T23:19:35.634418+0000","last_became_active":"2024-09-15T23:19:35.631768+0000","last_became_peered":"2024-09-15T23:19:35.631768+0000","last_unstale":"2024-09-15T23:19:35.634418+0000","last_undegraded":"2024-09-15T23:19:35.634418+0000","last_fullsized":"2024-09-15T23:19:35.634418+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:28:37.693205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-15T23:19:33.579403+0000","last_change":"2024-09-15T23:19:33.579403+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.579403+0000","last_undegraded":"2024-09-15T23:19:33.579403+0000","last_fullsized":"2024-09-15T23:19:33.579403+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.634752+0000","last_change":"2024-09-15T23:19:35.633878+0000","last_active":"2024-09-15T23:19:35.634752+0000","last_peered":"2024-09-15T23:19:35.634752+0000","last_clean":"2024-09-15T23:19:35.634752+0000","last_became_active":"2024-09-15T23:19:35.633565+0000","last_became_peered":"2024-09-15T23:19:35.633565+0000","last_unstale":"2024-09-15T23:19:35.634752+0000","last_undegraded":"2024-09-15T23:19:35.634752+0000","last_fullsized":"2024-09-15T23:19:35.634752+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:31.451649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.610262+0000","last_change":"2024-09-15T23:19:34.595426+0000","last_active":"2024-09-15T23:19:35.610262+0000","last_peered":"2024-09-15T23:19:35.610262+0000","last_clean":"2024-09-15T23:19:35.610262+0000","last_became_active":"2024-09-15T23:19:34.594537+0000","last_became_peered":"2024-09-15T23:19:34.594537+0000","last_unstale":"2024-09-15T23:19:35.610262+0000","last_undegraded":"2024-09-15T23:19:35.610262+0000","last_fullsized":"2024-09-15T23:19:35.610262+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:56.083665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.619266+0000","last_change":"2024-09-15T23:19:34.592540+0000","last_active":"2024-09-15T23:19:35.619266+0000","last_peered":"2024-09-15T23:19:35.619266+0000","last_clean":"2024-09-15T23:19:35.619266+0000","last_became_active":"2024-09-15T23:19:34.592184+0000","last_became_peered":"2024-09-15T23:19:34.592184+0000","last_unstale":"2024-09-15T23:19:35.619266+0000","last_undegraded":"2024-09-15T23:19:35.619266+0000","last_fullsized":"2024-09-15T23:19:35.619266+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:08:30.731469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.623647+0000","last_change":"2024-09-15T23:19:34.598761+0000","last_active":"2024-09-15T23:19:35.623647+0000","last_peered":"2024-09-15T23:19:35.623647+0000","last_clean":"2024-09-15T23:19:35.623647+0000","last_became_active":"2024-09-15T23:19:34.598474+0000","last_became_peered":"2024-09-15T23:19:34.598474+0000","last_unstale":"2024-09-15T23:19:35.623647+0000","last_undegraded":"2024-09-15T23:19:35.623647+0000","last_fullsized":"2024-09-15T23:19:35.623647+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:11.986189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-15T23:19:33.581363+0000","last_change":"2024-09-15T23:19:33.581363+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.581363+0000","last_undegraded":"2024-09-15T23:19:33.581363+0000","last_fullsized":"2024-09-15T23:19:33.581363+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.621350+0000","last_change":"2024-09-15T23:19:35.616698+0000","last_active":"2024-09-15T23:19:35.621350+0000","last_peered":"2024-09-15T23:19:35.621350+0000","last_clean":"2024-09-15T23:19:35.621350+0000","last_became_active":"2024-09-15T23:19:35.615861+0000","last_became_peered":"2024-09-15T23:19:35.615861+0000","last_unstale":"2024-09-15T23:19:35.621350+0000","last_undegraded":"2024-09-15T23:19:35.621350+0000","last_fullsized":"2024-09-15T23:19:35.621350+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:57:09.438860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.620995+0000","last_change":"2024-09-15T23:19:34.591465+0000","last_active":"2024-09-15T23:19:35.620995+0000","last_peered":"2024-09-15T23:19:35.620995+0000","last_clean":"2024-09-15T23:19:35.620995+0000","last_became_active":"2024-09-15T23:19:34.590999+0000","last_became_peered":"2024-09-15T23:19:34.590999+0000","last_unstale":"2024-09-15T23:19:35.620995+0000","last_undegraded":"2024-09-15T23:19:35.620995+0000","last_fullsized":"2024-09-15T23:19:35.620995+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:00.747606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.633135+0000","last_change":"2024-09-15T23:19:35.626540+0000","last_active":"2024-09-15T23:19:35.633135+0000","last_peered":"2024-09-15T23:19:35.633135+0000","last_clean":"2024-09-15T23:19:35.633135+0000","last_became_active":"2024-09-15T23:19:35.625997+0000","last_became_peered":"2024-09-15T23:19:35.625997+0000","last_unstale":"2024-09-15T23:19:35.633135+0000","last_undegraded":"2024-09-15T23:19:35.633135+0000","last_fullsized":"2024-09-15T23:19:35.633135+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:30.170171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.618105+0000","last_change":"2024-09-15T23:19:34.594881+0000","last_active":"2024-09-15T23:19:35.618105+0000","last_peered":"2024-09-15T23:19:35.618105+0000","last_clean":"2024-09-15T23:19:35.618105+0000","last_became_active":"2024-09-15T23:19:34.594542+0000","last_became_peered":"2024-09-15T23:19:34.594542+0000","last_unstale":"2024-09-15T23:19:35.618105+0000","last_undegraded":"2024-09-15T23:19:35.618105+0000","last_fullsized":"2024-09-15T23:19:35.618105+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:16:16.310640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-15T23:19:33.582021+0000","last_change":"2024-09-15T23:19:33.582021+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.582021+0000","last_undegraded":"2024-09-15T23:19:33.582021+0000","last_fullsized":"2024-09-15T23:19:33.582021+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":385,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-15T23:19:32.576723+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:19:32.576723+0000","last_peered":"2024-09-15T23:19:32.576723+0000","last_clean":"2024-09-15T23:19:32.576723+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:19:32.576723+0000","last_undegraded":"2024-09-15T23:19:32.576723+0000","last_fullsized":"2024-09-15T23:19:32.576723+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":66,"acting":66,"num_store_stats":4},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":54,"acting":54,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476832,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50904,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320936,"statfs":{"total":96636764160,"available":96584638464,"internally_reserved":0,"allocated":1708032,"data_stored":751605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476829,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50912,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320928,"statfs":{"total":96636764160,"available":96584630272,"internally_reserved":0,"allocated":1708032,"data_stored":751605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476831,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47324,"kb_used_data":2248,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324516,"statfs":{"total":96636764160,"available":96588304384,"internally_reserved":0,"allocated":2301952,"data_stored":1341973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476831,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41168,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330672,"statfs":{"total":96636764160,"available":96594608128,"internally_reserved":0,"allocated":1695744,"data_stored":746478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542238,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45380,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326460,"statfs":{"total":96636764160,"available":96590295040,"internally_reserved":0,"allocated":1748992,"data_stored":770506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":44693962},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542238,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50940,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320900,"statfs":{"total":96636764160,"available":96584601600,"internally_reserved":0,"allocated":1744896,"data_stored":770472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542237,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55700,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316140,"statfs":{"total":96636764160,"available":96579727360,"internally_reserved":0,"allocated":2351104,"data_stored":1361582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542239,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50948,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320892,"statfs":{"total":96636764160,"available":96584593408,"internally_reserved":0,"allocated":1744896,"data_stored":770472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:19:38.885 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:19:39.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.018+0000 7f640188d640 1 Processor -- start 2024-09-15T23:19:39.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.019+0000 7f640188d640 1 -- start start 2024-09-15T23:19:39.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.019+0000 7f640188d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f63fc15ed20 0x7f63fc0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:39.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.019+0000 7f640188d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f63fc0d23b0 0x7f63fc0b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:39.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.019+0000 7f640188d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63fc0d0e70 con 0x7f63fc0cf2d0 2024-09-15T23:19:39.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.019+0000 7f640188d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f63fc0d41c0 con 0x7f63fc0d23b0 2024-09-15T23:19:39.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.019+0000 7f640188d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f63fc0d35b0 con 0x7f63fc15ed20 2024-09-15T23:19:39.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.019+0000 7f63fa7fc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f63fc0d23b0 0x7f63fc0b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:39.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.019+0000 7f63fb7fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f63fc0cf2d0 0x7f63fc0cf700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60710/0 (socket says 172.21.15.123:60710) 2024-09-15T23:19:39.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.019+0000 7f63fb7fe640 1 -- 172.21.15.123:0/2499452469 learned_addr learned my addr 172.21.15.123:0/2499452469 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:19:39.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.020+0000 7f63faffd640 1 --2- 172.21.15.123:0/2499452469 >> v2:172.21.15.188:3300/0 conn(0x7f63fc15ed20 0x7f63fc0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:39.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.020+0000 7f63fa7fc640 1 -- 172.21.15.123:0/2499452469 >> v2:172.21.15.188:3300/0 conn(0x7f63fc15ed20 msgr2=0x7f63fc0b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:39.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.020+0000 7f63fa7fc640 1 --2- 172.21.15.123:0/2499452469 >> v2:172.21.15.188:3300/0 conn(0x7f63fc15ed20 0x7f63fc0b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:39.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.020+0000 7f63fa7fc640 1 -- 172.21.15.123:0/2499452469 >> v1:172.21.15.123:6789/0 conn(0x7f63fc0cf2d0 legacy=0x7f63fc0cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:39.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.020+0000 7f63fa7fc640 1 -- 172.21.15.123:0/2499452469 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63fc0d3890 con 0x7f63fc0d23b0 2024-09-15T23:19:39.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.020+0000 7f63faffd640 1 --2- 172.21.15.123:0/2499452469 >> v2:172.21.15.188:3300/0 conn(0x7f63fc15ed20 0x7f63fc0b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:19:39.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.020+0000 7f63fa7fc640 1 --2- 172.21.15.123:0/2499452469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63fc0d23b0 0x7f63fc0b67a0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f63fc0d47b0 tx=0x7f63f002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa043f4751b8834 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:39.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.021+0000 7f63f9ffb640 1 -- 172.21.15.123:0/2499452469 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f0037070 con 0x7f63fc0d23b0 2024-09-15T23:19:39.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.021+0000 7f63f9ffb640 1 -- 172.21.15.123:0/2499452469 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63f0032440 con 0x7f63fc0d23b0 2024-09-15T23:19:39.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.021+0000 7f63f9ffb640 1 -- 172.21.15.123:0/2499452469 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f002ae60 con 0x7f63fc0d23b0 2024-09-15T23:19:39.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.021+0000 7f640188d640 1 -- 172.21.15.123:0/2499452469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63fc0d23b0 msgr2=0x7f63fc0b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:39.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.021+0000 7f640188d640 1 --2- 172.21.15.123:0/2499452469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63fc0d23b0 0x7f63fc0b67a0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f63fc0d47b0 tx=0x7f63f002a110 comp rx=0 tx=0).stop 2024-09-15T23:19:39.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.021+0000 7f640188d640 1 -- 172.21.15.123:0/2499452469 shutdown_connections 2024-09-15T23:19:39.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.021+0000 7f640188d640 1 --2- 172.21.15.123:0/2499452469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63fc0d23b0 0x7f63fc0b67a0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:39.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.021+0000 7f640188d640 1 --2- 172.21.15.123:0/2499452469 >> v2:172.21.15.188:3300/0 conn(0x7f63fc15ed20 0x7f63fc0b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:39.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.021+0000 7f640188d640 1 -- 172.21.15.123:0/2499452469 >> 172.21.15.123:0/2499452469 conn(0x7f63fc0d1260 msgr2=0x7f63fc0d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:39.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.021+0000 7f640188d640 1 -- 172.21.15.123:0/2499452469 shutdown_connections 2024-09-15T23:19:39.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.021+0000 7f640188d640 1 -- 172.21.15.123:0/2499452469 wait complete. 2024-09-15T23:19:39.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.022+0000 7f640188d640 1 Processor -- start 2024-09-15T23:19:39.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.022+0000 7f640188d640 1 -- start start 2024-09-15T23:19:39.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.023+0000 7f640188d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f63fc0cf2d0 0x7f63fc0cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:39.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.023+0000 7f640188d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63fc0d23b0 0x7f63fc152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:39.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.023+0000 7f640188d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f63fc15ed20 0x7f63fc1619f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:39.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.023+0000 7f640188d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc0d32a0 con 0x7f63fc0d23b0 2024-09-15T23:19:39.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.023+0000 7f640188d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f63fc0d3e50 con 0x7f63fc0cf2d0 2024-09-15T23:19:39.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.023+0000 7f640188d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f63fc15f100 con 0x7f63fc15ed20 2024-09-15T23:19:39.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.023+0000 7f63fa7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63fc0d23b0 0x7f63fc152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:39.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.023+0000 7f63fa7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63fc0d23b0 0x7f63fc152370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49862/0 (socket says 172.21.15.123:49862) 2024-09-15T23:19:39.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.023+0000 7f63fa7fc640 1 -- 172.21.15.123:0/1341067369 learned_addr learned my addr 172.21.15.123:0/1341067369 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:39.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.023+0000 7f63fa7fc640 1 -- 172.21.15.123:0/1341067369 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f63fc15ed20 msgr2=0x7f63fc1619f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:39.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.024+0000 7f63fa7fc640 1 --2- 172.21.15.123:0/1341067369 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f63fc15ed20 0x7f63fc1619f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:39.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.024+0000 7f63fa7fc640 1 -- 172.21.15.123:0/1341067369 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f63fc0cf2d0 msgr2=0x7f63fc0cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:39.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.024+0000 7f63fa7fc640 1 --2- 172.21.15.123:0/1341067369 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f63fc0cf2d0 0x7f63fc0cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:39.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.024+0000 7f63fa7fc640 1 -- 172.21.15.123:0/1341067369 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63fc160950 con 0x7f63fc0d23b0 2024-09-15T23:19:39.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.024+0000 7f63fa7fc640 1 --2- 172.21.15.123:0/1341067369 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63fc0d23b0 0x7f63fc152370 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f63f0000c00 tx=0x7f63f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:39.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.024+0000 7f63e3fff640 1 -- 172.21.15.123:0/1341067369 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f0037040 con 0x7f63fc0d23b0 2024-09-15T23:19:39.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.024+0000 7f63e3fff640 1 -- 172.21.15.123:0/1341067369 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63f0042070 con 0x7f63fc0d23b0 2024-09-15T23:19:39.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.024+0000 7f63e3fff640 1 -- 172.21.15.123:0/1341067369 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f0030a50 con 0x7f63fc0d23b0 2024-09-15T23:19:39.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.024+0000 7f640188d640 1 -- 172.21.15.123:0/1341067369 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63fc160c30 con 0x7f63fc0d23b0 2024-09-15T23:19:39.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.024+0000 7f640188d640 1 -- 172.21.15.123:0/1341067369 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63fc1611f0 con 0x7f63fc0d23b0 2024-09-15T23:19:39.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.025+0000 7f640188d640 1 -- 172.21.15.123:0/1341067369 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63fc0b7010 con 0x7f63fc0d23b0 2024-09-15T23:19:39.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.025+0000 7f63e3fff640 1 -- 172.21.15.123:0/1341067369 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f63f0030bf0 con 0x7f63fc0d23b0 2024-09-15T23:19:39.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.026+0000 7f63e3fff640 1 --2- 172.21.15.123:0/1341067369 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f63e806c2b0 0x7f63e806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:39.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.026+0000 7f63e3fff640 1 -- 172.21.15.123:0/1341067369 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f63f00abe20 con 0x7f63fc0d23b0 2024-09-15T23:19:39.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.026+0000 7f63faffd640 1 --2- 172.21.15.123:0/1341067369 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f63e806c2b0 0x7f63e806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:39.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.027+0000 7f63faffd640 1 --2- 172.21.15.123:0/1341067369 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f63e806c2b0 0x7f63e806e770 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f63ec008ea0 tx=0x7f63ec0083d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:39.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.030+0000 7f63e3fff640 1 -- 172.21.15.123:0/1341067369 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f63f0045360 con 0x7f63fc0d23b0 2024-09-15T23:19:39.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.189+0000 7f640188d640 1 -- 172.21.15.123:0/1341067369 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f63fc0b3f20 con 0x7f63e806c2b0 2024-09-15T23:19:39.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.196+0000 7f63e3fff640 1 -- 172.21.15.123:0/1341067369 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245981 (secure 0 0 0) 0x7f63fc0b3f20 con 0x7f63e806c2b0 2024-09-15T23:19:39.199 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:19:39.200 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:19:39.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.198+0000 7f640188d640 1 -- 172.21.15.123:0/1341067369 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f63e806c2b0 msgr2=0x7f63e806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:39.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.198+0000 7f640188d640 1 --2- 172.21.15.123:0/1341067369 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f63e806c2b0 0x7f63e806e770 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f63ec008ea0 tx=0x7f63ec0083d0 comp rx=0 tx=0).stop 2024-09-15T23:19:39.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.198+0000 7f640188d640 1 -- 172.21.15.123:0/1341067369 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63fc0d23b0 msgr2=0x7f63fc152370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:39.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.198+0000 7f640188d640 1 --2- 172.21.15.123:0/1341067369 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63fc0d23b0 0x7f63fc152370 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f63f0000c00 tx=0x7f63f00046c0 comp rx=0 tx=0).stop 2024-09-15T23:19:39.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.199+0000 7f640188d640 1 -- 172.21.15.123:0/1341067369 shutdown_connections 2024-09-15T23:19:39.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.199+0000 7f640188d640 1 --2- 172.21.15.123:0/1341067369 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f63fc15ed20 0x7f63fc1619f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:39.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.199+0000 7f640188d640 1 --2- 172.21.15.123:0/1341067369 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f63e806c2b0 0x7f63e806e770 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:39.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.199+0000 7f640188d640 1 --2- 172.21.15.123:0/1341067369 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63fc0d23b0 0x7f63fc152370 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:39.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.199+0000 7f640188d640 1 --2- 172.21.15.123:0/1341067369 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f63fc0cf2d0 0x7f63fc0cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:39.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.199+0000 7f640188d640 1 -- 172.21.15.123:0/1341067369 >> 172.21.15.123:0/1341067369 conn(0x7f63fc0d1260 msgr2=0x7f63fc0b58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:39.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.199+0000 7f640188d640 1 -- 172.21.15.123:0/1341067369 shutdown_connections 2024-09-15T23:19:39.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.199+0000 7f640188d640 1 -- 172.21.15.123:0/1341067369 wait complete. 2024-09-15T23:19:39.211 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":363,"stamp":"2024-09-15T23:19:37.609210+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":122,"acting":122,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":393276,"kb_used_data":14652,"kb_used_omap":12,"kb_used_meta":378419,"kb_avail":754581444,"statfs":{"total":773094113280,"available":772691398656,"internally_reserved":0,"allocated":15003648,"data_stored":7264693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":387501616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.031457"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.632688+0000","last_change":"2024-09-15T23:19:35.630018+0000","last_active":"2024-09-15T23:19:35.632688+0000","last_peered":"2024-09-15T23:19:35.632688+0000","last_clean":"2024-09-15T23:19:35.632688+0000","last_became_active":"2024-09-15T23:19:35.628099+0000","last_became_peered":"2024-09-15T23:19:35.628099+0000","last_unstale":"2024-09-15T23:19:35.632688+0000","last_undegraded":"2024-09-15T23:19:35.632688+0000","last_fullsized":"2024-09-15T23:19:35.632688+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:56:00.379260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.630794+0000","last_change":"2024-09-15T23:19:35.628850+0000","last_active":"2024-09-15T23:19:35.630794+0000","last_peered":"2024-09-15T23:19:35.630794+0000","last_clean":"2024-09-15T23:19:35.630794+0000","last_became_active":"2024-09-15T23:19:35.628420+0000","last_became_peered":"2024-09-15T23:19:35.628420+0000","last_unstale":"2024-09-15T23:19:35.630794+0000","last_undegraded":"2024-09-15T23:19:35.630794+0000","last_fullsized":"2024-09-15T23:19:35.630794+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:49.534165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.627713+0000","last_change":"2024-09-15T23:19:35.626458+0000","last_active":"2024-09-15T23:19:35.627713+0000","last_peered":"2024-09-15T23:19:35.627713+0000","last_clean":"2024-09-15T23:19:35.627713+0000","last_became_active":"2024-09-15T23:19:35.626142+0000","last_became_peered":"2024-09-15T23:19:35.626142+0000","last_unstale":"2024-09-15T23:19:35.627713+0000","last_undegraded":"2024-09-15T23:19:35.627713+0000","last_fullsized":"2024-09-15T23:19:35.627713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:12.987698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.631096+0000","last_change":"2024-09-15T23:19:35.629074+0000","last_active":"2024-09-15T23:19:35.631096+0000","last_peered":"2024-09-15T23:19:35.631096+0000","last_clean":"2024-09-15T23:19:35.631096+0000","last_became_active":"2024-09-15T23:19:35.628048+0000","last_became_peered":"2024-09-15T23:19:35.628048+0000","last_unstale":"2024-09-15T23:19:35.631096+0000","last_undegraded":"2024-09-15T23:19:35.631096+0000","last_fullsized":"2024-09-15T23:19:35.631096+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:29:55.927749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.631661+0000","last_change":"2024-09-15T23:19:35.629980+0000","last_active":"2024-09-15T23:19:35.631661+0000","last_peered":"2024-09-15T23:19:35.631661+0000","last_clean":"2024-09-15T23:19:35.631661+0000","last_became_active":"2024-09-15T23:19:35.629187+0000","last_became_peered":"2024-09-15T23:19:35.629187+0000","last_unstale":"2024-09-15T23:19:35.631661+0000","last_undegraded":"2024-09-15T23:19:35.631661+0000","last_fullsized":"2024-09-15T23:19:35.631661+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:33.561412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.633625+0000","last_change":"2024-09-15T23:19:35.631492+0000","last_active":"2024-09-15T23:19:35.633625+0000","last_peered":"2024-09-15T23:19:35.633625+0000","last_clean":"2024-09-15T23:19:35.633625+0000","last_became_active":"2024-09-15T23:19:35.631227+0000","last_became_peered":"2024-09-15T23:19:35.631227+0000","last_unstale":"2024-09-15T23:19:35.633625+0000","last_undegraded":"2024-09-15T23:19:35.633625+0000","last_fullsized":"2024-09-15T23:19:35.633625+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:38:34.100919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.630844+0000","last_change":"2024-09-15T23:19:35.625592+0000","last_active":"2024-09-15T23:19:35.630844+0000","last_peered":"2024-09-15T23:19:35.630844+0000","last_clean":"2024-09-15T23:19:35.630844+0000","last_became_active":"2024-09-15T23:19:35.625301+0000","last_became_peered":"2024-09-15T23:19:35.625301+0000","last_unstale":"2024-09-15T23:19:35.630844+0000","last_undegraded":"2024-09-15T23:19:35.630844+0000","last_fullsized":"2024-09-15T23:19:35.630844+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:42.228647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.624457+0000","last_change":"2024-09-15T23:19:35.622364+0000","last_active":"2024-09-15T23:19:35.624457+0000","last_peered":"2024-09-15T23:19:35.624457+0000","last_clean":"2024-09-15T23:19:35.624457+0000","last_became_active":"2024-09-15T23:19:35.622088+0000","last_became_peered":"2024-09-15T23:19:35.622088+0000","last_unstale":"2024-09-15T23:19:35.624457+0000","last_undegraded":"2024-09-15T23:19:35.624457+0000","last_fullsized":"2024-09-15T23:19:35.624457+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:19:32.637779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.633024+0000","last_change":"2024-09-15T23:19:35.626083+0000","last_active":"2024-09-15T23:19:35.633024+0000","last_peered":"2024-09-15T23:19:35.633024+0000","last_clean":"2024-09-15T23:19:35.633024+0000","last_became_active":"2024-09-15T23:19:35.625794+0000","last_became_peered":"2024-09-15T23:19:35.625794+0000","last_unstale":"2024-09-15T23:19:35.633024+0000","last_undegraded":"2024-09-15T23:19:35.633024+0000","last_fullsized":"2024-09-15T23:19:35.633024+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:34.277310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.621259+0000","last_change":"2024-09-15T23:19:35.616254+0000","last_active":"2024-09-15T23:19:35.621259+0000","last_peered":"2024-09-15T23:19:35.621259+0000","last_clean":"2024-09-15T23:19:35.621259+0000","last_became_active":"2024-09-15T23:19:35.615915+0000","last_became_peered":"2024-09-15T23:19:35.615915+0000","last_unstale":"2024-09-15T23:19:35.621259+0000","last_undegraded":"2024-09-15T23:19:35.621259+0000","last_fullsized":"2024-09-15T23:19:35.621259+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:44.666059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.631130+0000","last_change":"2024-09-15T23:19:35.629558+0000","last_active":"2024-09-15T23:19:35.631130+0000","last_peered":"2024-09-15T23:19:35.631130+0000","last_clean":"2024-09-15T23:19:35.631130+0000","last_became_active":"2024-09-15T23:19:35.629253+0000","last_became_peered":"2024-09-15T23:19:35.629253+0000","last_unstale":"2024-09-15T23:19:35.631130+0000","last_undegraded":"2024-09-15T23:19:35.631130+0000","last_fullsized":"2024-09-15T23:19:35.631130+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:20.453779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.630232+0000","last_change":"2024-09-15T23:19:35.628077+0000","last_active":"2024-09-15T23:19:35.630232+0000","last_peered":"2024-09-15T23:19:35.630232+0000","last_clean":"2024-09-15T23:19:35.630232+0000","last_became_active":"2024-09-15T23:19:35.627761+0000","last_became_peered":"2024-09-15T23:19:35.627761+0000","last_unstale":"2024-09-15T23:19:35.630232+0000","last_undegraded":"2024-09-15T23:19:35.630232+0000","last_fullsized":"2024-09-15T23:19:35.630232+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:56:54.736459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.638083+0000","last_change":"2024-09-15T23:19:35.634903+0000","last_active":"2024-09-15T23:19:35.638083+0000","last_peered":"2024-09-15T23:19:35.638083+0000","last_clean":"2024-09-15T23:19:35.638083+0000","last_became_active":"2024-09-15T23:19:35.634630+0000","last_became_peered":"2024-09-15T23:19:35.634630+0000","last_unstale":"2024-09-15T23:19:35.638083+0000","last_undegraded":"2024-09-15T23:19:35.638083+0000","last_fullsized":"2024-09-15T23:19:35.638083+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:53.869099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.620749+0000","last_change":"2024-09-15T23:19:35.615995+0000","last_active":"2024-09-15T23:19:35.620749+0000","last_peered":"2024-09-15T23:19:35.620749+0000","last_clean":"2024-09-15T23:19:35.620749+0000","last_became_active":"2024-09-15T23:19:35.615631+0000","last_became_peered":"2024-09-15T23:19:35.615631+0000","last_unstale":"2024-09-15T23:19:35.620749+0000","last_undegraded":"2024-09-15T23:19:35.620749+0000","last_fullsized":"2024-09-15T23:19:35.620749+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:25.327208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.634312+0000","last_change":"2024-09-15T23:19:35.632719+0000","last_active":"2024-09-15T23:19:35.634312+0000","last_peered":"2024-09-15T23:19:35.634312+0000","last_clean":"2024-09-15T23:19:35.634312+0000","last_became_active":"2024-09-15T23:19:35.632449+0000","last_became_peered":"2024-09-15T23:19:35.632449+0000","last_unstale":"2024-09-15T23:19:35.634312+0000","last_undegraded":"2024-09-15T23:19:35.634312+0000","last_fullsized":"2024-09-15T23:19:35.634312+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:10:40.600923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.640407+0000","last_change":"2024-09-15T23:19:35.639447+0000","last_active":"2024-09-15T23:19:35.640407+0000","last_peered":"2024-09-15T23:19:35.640407+0000","last_clean":"2024-09-15T23:19:35.640407+0000","last_became_active":"2024-09-15T23:19:35.639003+0000","last_became_peered":"2024-09-15T23:19:35.639003+0000","last_unstale":"2024-09-15T23:19:35.640407+0000","last_undegraded":"2024-09-15T23:19:35.640407+0000","last_fullsized":"2024-09-15T23:19:35.640407+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:33:35.905302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.632922+0000","last_change":"2024-09-15T23:19:35.625964+0000","last_active":"2024-09-15T23:19:35.632922+0000","last_peered":"2024-09-15T23:19:35.632922+0000","last_clean":"2024-09-15T23:19:35.632922+0000","last_became_active":"2024-09-15T23:19:35.625432+0000","last_became_peered":"2024-09-15T23:19:35.625432+0000","last_unstale":"2024-09-15T23:19:35.632922+0000","last_undegraded":"2024-09-15T23:19:35.632922+0000","last_fullsized":"2024-09-15T23:19:35.632922+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:23.656736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.638008+0000","last_change":"2024-09-15T23:19:35.635024+0000","last_active":"2024-09-15T23:19:35.638008+0000","last_peered":"2024-09-15T23:19:35.638008+0000","last_clean":"2024-09-15T23:19:35.638008+0000","last_became_active":"2024-09-15T23:19:35.634125+0000","last_became_peered":"2024-09-15T23:19:35.634125+0000","last_unstale":"2024-09-15T23:19:35.638008+0000","last_undegraded":"2024-09-15T23:19:35.638008+0000","last_fullsized":"2024-09-15T23:19:35.638008+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:31.356089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.630400+0000","last_change":"2024-09-15T23:19:35.627210+0000","last_active":"2024-09-15T23:19:35.630400+0000","last_peered":"2024-09-15T23:19:35.630400+0000","last_clean":"2024-09-15T23:19:35.630400+0000","last_became_active":"2024-09-15T23:19:35.626865+0000","last_became_peered":"2024-09-15T23:19:35.626865+0000","last_unstale":"2024-09-15T23:19:35.630400+0000","last_undegraded":"2024-09-15T23:19:35.630400+0000","last_fullsized":"2024-09-15T23:19:35.630400+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:10:40.600923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.632958+0000","last_change":"2024-09-15T23:19:35.626009+0000","last_active":"2024-09-15T23:19:35.632958+0000","last_peered":"2024-09-15T23:19:35.632958+0000","last_clean":"2024-09-15T23:19:35.632958+0000","last_became_active":"2024-09-15T23:19:35.625557+0000","last_became_peered":"2024-09-15T23:19:35.625557+0000","last_unstale":"2024-09-15T23:19:35.632958+0000","last_undegraded":"2024-09-15T23:19:35.632958+0000","last_fullsized":"2024-09-15T23:19:35.632958+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:09.429395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-15T23:19:33.579066+0000","last_change":"2024-09-15T23:19:33.579066+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.579066+0000","last_undegraded":"2024-09-15T23:19:33.579066+0000","last_fullsized":"2024-09-15T23:19:33.579066+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:33.575362+0000","last_change":"2024-09-15T23:19:33.575362+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.575362+0000","last_undegraded":"2024-09-15T23:19:33.575362+0000","last_fullsized":"2024-09-15T23:19:33.575362+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1d","version":"141'2","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.640962+0000","last_change":"2024-09-15T23:19:34.591811+0000","last_active":"2024-09-15T23:19:35.640962+0000","last_peered":"2024-09-15T23:19:35.640962+0000","last_clean":"2024-09-15T23:19:35.640962+0000","last_became_active":"2024-09-15T23:19:34.590764+0000","last_became_peered":"2024-09-15T23:19:34.590764+0000","last_unstale":"2024-09-15T23:19:35.640962+0000","last_undegraded":"2024-09-15T23:19:35.640962+0000","last_fullsized":"2024-09-15T23:19:35.640962+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:15:04.941661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"141'2","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.641207+0000","last_change":"2024-09-15T23:19:34.599647+0000","last_active":"2024-09-15T23:19:35.641207+0000","last_peered":"2024-09-15T23:19:35.641207+0000","last_clean":"2024-09-15T23:19:35.641207+0000","last_became_active":"2024-09-15T23:19:34.599381+0000","last_became_peered":"2024-09-15T23:19:34.599381+0000","last_unstale":"2024-09-15T23:19:35.641207+0000","last_undegraded":"2024-09-15T23:19:35.641207+0000","last_fullsized":"2024-09-15T23:19:35.641207+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:32.559903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.621376+0000","last_change":"2024-09-15T23:19:35.619214+0000","last_active":"2024-09-15T23:19:35.621376+0000","last_peered":"2024-09-15T23:19:35.621376+0000","last_clean":"2024-09-15T23:19:35.621376+0000","last_became_active":"2024-09-15T23:19:35.618944+0000","last_became_peered":"2024-09-15T23:19:35.618944+0000","last_unstale":"2024-09-15T23:19:35.621376+0000","last_undegraded":"2024-09-15T23:19:35.621376+0000","last_fullsized":"2024-09-15T23:19:35.621376+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:55:50.700598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1b","version":"141'1","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.640220+0000","last_change":"2024-09-15T23:19:34.596580+0000","last_active":"2024-09-15T23:19:35.640220+0000","last_peered":"2024-09-15T23:19:35.640220+0000","last_clean":"2024-09-15T23:19:35.640220+0000","last_became_active":"2024-09-15T23:19:34.596299+0000","last_became_peered":"2024-09-15T23:19:34.596299+0000","last_unstale":"2024-09-15T23:19:35.640220+0000","last_undegraded":"2024-09-15T23:19:35.640220+0000","last_fullsized":"2024-09-15T23:19:35.640220+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:00.747606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1a","version":"141'1","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.640113+0000","last_change":"2024-09-15T23:19:34.596781+0000","last_active":"2024-09-15T23:19:35.640113+0000","last_peered":"2024-09-15T23:19:35.640113+0000","last_clean":"2024-09-15T23:19:35.640113+0000","last_became_active":"2024-09-15T23:19:34.594440+0000","last_became_peered":"2024-09-15T23:19:34.594440+0000","last_unstale":"2024-09-15T23:19:35.640113+0000","last_undegraded":"2024-09-15T23:19:35.640113+0000","last_fullsized":"2024-09-15T23:19:35.640113+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:57.692753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:33.575362+0000","last_change":"2024-09-15T23:19:33.575362+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.575362+0000","last_undegraded":"2024-09-15T23:19:33.575362+0000","last_fullsized":"2024-09-15T23:19:33.575362+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.636651+0000","last_change":"2024-09-15T23:19:35.634002+0000","last_active":"2024-09-15T23:19:35.636651+0000","last_peered":"2024-09-15T23:19:35.636651+0000","last_clean":"2024-09-15T23:19:35.636651+0000","last_became_active":"2024-09-15T23:19:35.633706+0000","last_became_peered":"2024-09-15T23:19:35.633706+0000","last_unstale":"2024-09-15T23:19:35.636651+0000","last_undegraded":"2024-09-15T23:19:35.636651+0000","last_fullsized":"2024-09-15T23:19:35.636651+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:55:04.513205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.624244+0000","last_change":"2024-09-15T23:19:34.596861+0000","last_active":"2024-09-15T23:19:35.624244+0000","last_peered":"2024-09-15T23:19:35.624244+0000","last_clean":"2024-09-15T23:19:35.624244+0000","last_became_active":"2024-09-15T23:19:34.596589+0000","last_became_peered":"2024-09-15T23:19:34.596589+0000","last_unstale":"2024-09-15T23:19:35.624244+0000","last_undegraded":"2024-09-15T23:19:35.624244+0000","last_fullsized":"2024-09-15T23:19:35.624244+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:38:33.099410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.636695+0000","last_change":"2024-09-15T23:19:35.634159+0000","last_active":"2024-09-15T23:19:35.636695+0000","last_peered":"2024-09-15T23:19:35.636695+0000","last_clean":"2024-09-15T23:19:35.636695+0000","last_became_active":"2024-09-15T23:19:35.633883+0000","last_became_peered":"2024-09-15T23:19:35.633883+0000","last_unstale":"2024-09-15T23:19:35.636695+0000","last_undegraded":"2024-09-15T23:19:35.636695+0000","last_fullsized":"2024-09-15T23:19:35.636695+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:05:17.623772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-15T23:19:33.581895+0000","last_change":"2024-09-15T23:19:33.581895+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.581895+0000","last_undegraded":"2024-09-15T23:19:33.581895+0000","last_fullsized":"2024-09-15T23:19:33.581895+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.610739+0000","last_change":"2024-09-15T23:19:34.592974+0000","last_active":"2024-09-15T23:19:35.610739+0000","last_peered":"2024-09-15T23:19:35.610739+0000","last_clean":"2024-09-15T23:19:35.610739+0000","last_became_active":"2024-09-15T23:19:34.592445+0000","last_became_peered":"2024-09-15T23:19:34.592445+0000","last_unstale":"2024-09-15T23:19:35.610739+0000","last_undegraded":"2024-09-15T23:19:35.610739+0000","last_fullsized":"2024-09-15T23:19:35.610739+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:30:05.348767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-15T23:19:33.579190+0000","last_change":"2024-09-15T23:19:33.579190+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.579190+0000","last_undegraded":"2024-09-15T23:19:33.579190+0000","last_fullsized":"2024-09-15T23:19:33.579190+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:33.575362+0000","last_change":"2024-09-15T23:19:33.575362+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.575362+0000","last_undegraded":"2024-09-15T23:19:33.575362+0000","last_fullsized":"2024-09-15T23:19:33.575362+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.633199+0000","last_change":"2024-09-15T23:19:35.628636+0000","last_active":"2024-09-15T23:19:35.633199+0000","last_peered":"2024-09-15T23:19:35.633199+0000","last_clean":"2024-09-15T23:19:35.633199+0000","last_became_active":"2024-09-15T23:19:35.628358+0000","last_became_peered":"2024-09-15T23:19:35.628358+0000","last_unstale":"2024-09-15T23:19:35.633199+0000","last_undegraded":"2024-09-15T23:19:35.633199+0000","last_fullsized":"2024-09-15T23:19:35.633199+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:52:45.020431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.617569+0000","last_change":"2024-09-15T23:19:34.595328+0000","last_active":"2024-09-15T23:19:35.617569+0000","last_peered":"2024-09-15T23:19:35.617569+0000","last_clean":"2024-09-15T23:19:35.617569+0000","last_became_active":"2024-09-15T23:19:34.595049+0000","last_became_peered":"2024-09-15T23:19:34.595049+0000","last_unstale":"2024-09-15T23:19:35.617569+0000","last_undegraded":"2024-09-15T23:19:35.617569+0000","last_fullsized":"2024-09-15T23:19:35.617569+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:32:14.607742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.633051+0000","last_change":"2024-09-15T23:19:35.626673+0000","last_active":"2024-09-15T23:19:35.633051+0000","last_peered":"2024-09-15T23:19:35.633051+0000","last_clean":"2024-09-15T23:19:35.633051+0000","last_became_active":"2024-09-15T23:19:35.626396+0000","last_became_peered":"2024-09-15T23:19:35.626396+0000","last_unstale":"2024-09-15T23:19:35.633051+0000","last_undegraded":"2024-09-15T23:19:35.633051+0000","last_fullsized":"2024-09-15T23:19:35.633051+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:34.865411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.617083+0000","last_change":"2024-09-15T23:19:34.591104+0000","last_active":"2024-09-15T23:19:35.617083+0000","last_peered":"2024-09-15T23:19:35.617083+0000","last_clean":"2024-09-15T23:19:35.617083+0000","last_became_active":"2024-09-15T23:19:34.590768+0000","last_became_peered":"2024-09-15T23:19:34.590768+0000","last_unstale":"2024-09-15T23:19:35.617083+0000","last_undegraded":"2024-09-15T23:19:35.617083+0000","last_fullsized":"2024-09-15T23:19:35.617083+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:32:36.307046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-15T23:19:33.581699+0000","last_change":"2024-09-15T23:19:33.581699+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.581699+0000","last_undegraded":"2024-09-15T23:19:33.581699+0000","last_fullsized":"2024-09-15T23:19:33.581699+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-15T23:19:33.581392+0000","last_change":"2024-09-15T23:19:33.581392+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.581392+0000","last_undegraded":"2024-09-15T23:19:33.581392+0000","last_fullsized":"2024-09-15T23:19:33.581392+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.e","version":"141'2","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.640172+0000","last_change":"2024-09-15T23:19:34.590161+0000","last_active":"2024-09-15T23:19:35.640172+0000","last_peered":"2024-09-15T23:19:35.640172+0000","last_clean":"2024-09-15T23:19:35.640172+0000","last_became_active":"2024-09-15T23:19:34.586613+0000","last_became_peered":"2024-09-15T23:19:34.586613+0000","last_unstale":"2024-09-15T23:19:35.640172+0000","last_undegraded":"2024-09-15T23:19:35.640172+0000","last_fullsized":"2024-09-15T23:19:35.640172+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:15.297166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.634999+0000","last_change":"2024-09-15T23:19:35.632211+0000","last_active":"2024-09-15T23:19:35.634999+0000","last_peered":"2024-09-15T23:19:35.634999+0000","last_clean":"2024-09-15T23:19:35.634999+0000","last_became_active":"2024-09-15T23:19:35.631935+0000","last_became_peered":"2024-09-15T23:19:35.631935+0000","last_unstale":"2024-09-15T23:19:35.634999+0000","last_undegraded":"2024-09-15T23:19:35.634999+0000","last_fullsized":"2024-09-15T23:19:35.634999+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:13:51.251783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:33.575362+0000","last_change":"2024-09-15T23:19:33.575362+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.575362+0000","last_undegraded":"2024-09-15T23:19:33.575362+0000","last_fullsized":"2024-09-15T23:19:33.575362+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.638294+0000","last_change":"2024-09-15T23:19:35.636401+0000","last_active":"2024-09-15T23:19:35.638294+0000","last_peered":"2024-09-15T23:19:35.638294+0000","last_clean":"2024-09-15T23:19:35.638294+0000","last_became_active":"2024-09-15T23:19:35.635214+0000","last_became_peered":"2024-09-15T23:19:35.635214+0000","last_unstale":"2024-09-15T23:19:35.638294+0000","last_undegraded":"2024-09-15T23:19:35.638294+0000","last_fullsized":"2024-09-15T23:19:35.638294+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:37.206929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-15T23:19:33.579118+0000","last_change":"2024-09-15T23:19:33.579118+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.579118+0000","last_undegraded":"2024-09-15T23:19:33.579118+0000","last_fullsized":"2024-09-15T23:19:33.579118+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.636669+0000","last_change":"2024-09-15T23:19:35.632888+0000","last_active":"2024-09-15T23:19:35.636669+0000","last_peered":"2024-09-15T23:19:35.636669+0000","last_clean":"2024-09-15T23:19:35.636669+0000","last_became_active":"2024-09-15T23:19:35.631987+0000","last_became_peered":"2024-09-15T23:19:35.631987+0000","last_unstale":"2024-09-15T23:19:35.636669+0000","last_undegraded":"2024-09-15T23:19:35.636669+0000","last_fullsized":"2024-09-15T23:19:35.636669+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:13.514441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:33.575362+0000","last_change":"2024-09-15T23:19:33.575362+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.575362+0000","last_undegraded":"2024-09-15T23:19:33.575362+0000","last_fullsized":"2024-09-15T23:19:33.575362+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.611014+0000","last_change":"2024-09-15T23:19:34.597396+0000","last_active":"2024-09-15T23:19:35.611014+0000","last_peered":"2024-09-15T23:19:35.611014+0000","last_clean":"2024-09-15T23:19:35.611014+0000","last_became_active":"2024-09-15T23:19:34.595843+0000","last_became_peered":"2024-09-15T23:19:34.595843+0000","last_unstale":"2024-09-15T23:19:35.611014+0000","last_undegraded":"2024-09-15T23:19:35.611014+0000","last_fullsized":"2024-09-15T23:19:35.611014+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:24.495888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.626232+0000","last_change":"2024-09-15T23:19:35.623235+0000","last_active":"2024-09-15T23:19:35.626232+0000","last_peered":"2024-09-15T23:19:35.626232+0000","last_clean":"2024-09-15T23:19:35.626232+0000","last_became_active":"2024-09-15T23:19:35.622976+0000","last_became_peered":"2024-09-15T23:19:35.622976+0000","last_unstale":"2024-09-15T23:19:35.626232+0000","last_undegraded":"2024-09-15T23:19:35.626232+0000","last_fullsized":"2024-09-15T23:19:35.626232+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:15.373058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.618243+0000","last_change":"2024-09-15T23:19:34.597859+0000","last_active":"2024-09-15T23:19:35.618243+0000","last_peered":"2024-09-15T23:19:35.618243+0000","last_clean":"2024-09-15T23:19:35.618243+0000","last_became_active":"2024-09-15T23:19:34.597561+0000","last_became_peered":"2024-09-15T23:19:34.597561+0000","last_unstale":"2024-09-15T23:19:35.618243+0000","last_undegraded":"2024-09-15T23:19:35.618243+0000","last_fullsized":"2024-09-15T23:19:35.618243+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:13:21.067550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.618110+0000","last_change":"2024-09-15T23:19:34.591315+0000","last_active":"2024-09-15T23:19:35.618110+0000","last_peered":"2024-09-15T23:19:35.618110+0000","last_clean":"2024-09-15T23:19:35.618110+0000","last_became_active":"2024-09-15T23:19:34.590567+0000","last_became_peered":"2024-09-15T23:19:34.590567+0000","last_unstale":"2024-09-15T23:19:35.618110+0000","last_undegraded":"2024-09-15T23:19:35.618110+0000","last_fullsized":"2024-09-15T23:19:35.618110+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:45:24.682806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.7","version":"141'2","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.637591+0000","last_change":"2024-09-15T23:19:34.596662+0000","last_active":"2024-09-15T23:19:35.637591+0000","last_peered":"2024-09-15T23:19:35.637591+0000","last_clean":"2024-09-15T23:19:35.637591+0000","last_became_active":"2024-09-15T23:19:34.596339+0000","last_became_peered":"2024-09-15T23:19:34.596339+0000","last_unstale":"2024-09-15T23:19:35.637591+0000","last_undegraded":"2024-09-15T23:19:35.637591+0000","last_fullsized":"2024-09-15T23:19:35.637591+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:10.329268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.634418+0000","last_change":"2024-09-15T23:19:35.632263+0000","last_active":"2024-09-15T23:19:35.634418+0000","last_peered":"2024-09-15T23:19:35.634418+0000","last_clean":"2024-09-15T23:19:35.634418+0000","last_became_active":"2024-09-15T23:19:35.631768+0000","last_became_peered":"2024-09-15T23:19:35.631768+0000","last_unstale":"2024-09-15T23:19:35.634418+0000","last_undegraded":"2024-09-15T23:19:35.634418+0000","last_fullsized":"2024-09-15T23:19:35.634418+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:28:37.693205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-15T23:19:33.579403+0000","last_change":"2024-09-15T23:19:33.579403+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.579403+0000","last_undegraded":"2024-09-15T23:19:33.579403+0000","last_fullsized":"2024-09-15T23:19:33.579403+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.634752+0000","last_change":"2024-09-15T23:19:35.633878+0000","last_active":"2024-09-15T23:19:35.634752+0000","last_peered":"2024-09-15T23:19:35.634752+0000","last_clean":"2024-09-15T23:19:35.634752+0000","last_became_active":"2024-09-15T23:19:35.633565+0000","last_became_peered":"2024-09-15T23:19:35.633565+0000","last_unstale":"2024-09-15T23:19:35.634752+0000","last_undegraded":"2024-09-15T23:19:35.634752+0000","last_fullsized":"2024-09-15T23:19:35.634752+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:31.451649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.610262+0000","last_change":"2024-09-15T23:19:34.595426+0000","last_active":"2024-09-15T23:19:35.610262+0000","last_peered":"2024-09-15T23:19:35.610262+0000","last_clean":"2024-09-15T23:19:35.610262+0000","last_became_active":"2024-09-15T23:19:34.594537+0000","last_became_peered":"2024-09-15T23:19:34.594537+0000","last_unstale":"2024-09-15T23:19:35.610262+0000","last_undegraded":"2024-09-15T23:19:35.610262+0000","last_fullsized":"2024-09-15T23:19:35.610262+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:56.083665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.619266+0000","last_change":"2024-09-15T23:19:34.592540+0000","last_active":"2024-09-15T23:19:35.619266+0000","last_peered":"2024-09-15T23:19:35.619266+0000","last_clean":"2024-09-15T23:19:35.619266+0000","last_became_active":"2024-09-15T23:19:34.592184+0000","last_became_peered":"2024-09-15T23:19:34.592184+0000","last_unstale":"2024-09-15T23:19:35.619266+0000","last_undegraded":"2024-09-15T23:19:35.619266+0000","last_fullsized":"2024-09-15T23:19:35.619266+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:08:30.731469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.623647+0000","last_change":"2024-09-15T23:19:34.598761+0000","last_active":"2024-09-15T23:19:35.623647+0000","last_peered":"2024-09-15T23:19:35.623647+0000","last_clean":"2024-09-15T23:19:35.623647+0000","last_became_active":"2024-09-15T23:19:34.598474+0000","last_became_peered":"2024-09-15T23:19:34.598474+0000","last_unstale":"2024-09-15T23:19:35.623647+0000","last_undegraded":"2024-09-15T23:19:35.623647+0000","last_fullsized":"2024-09-15T23:19:35.623647+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:11.986189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-15T23:19:33.581363+0000","last_change":"2024-09-15T23:19:33.581363+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.581363+0000","last_undegraded":"2024-09-15T23:19:33.581363+0000","last_fullsized":"2024-09-15T23:19:33.581363+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.621350+0000","last_change":"2024-09-15T23:19:35.616698+0000","last_active":"2024-09-15T23:19:35.621350+0000","last_peered":"2024-09-15T23:19:35.621350+0000","last_clean":"2024-09-15T23:19:35.621350+0000","last_became_active":"2024-09-15T23:19:35.615861+0000","last_became_peered":"2024-09-15T23:19:35.615861+0000","last_unstale":"2024-09-15T23:19:35.621350+0000","last_undegraded":"2024-09-15T23:19:35.621350+0000","last_fullsized":"2024-09-15T23:19:35.621350+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:57:09.438860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.620995+0000","last_change":"2024-09-15T23:19:34.591465+0000","last_active":"2024-09-15T23:19:35.620995+0000","last_peered":"2024-09-15T23:19:35.620995+0000","last_clean":"2024-09-15T23:19:35.620995+0000","last_became_active":"2024-09-15T23:19:34.590999+0000","last_became_peered":"2024-09-15T23:19:34.590999+0000","last_unstale":"2024-09-15T23:19:35.620995+0000","last_undegraded":"2024-09-15T23:19:35.620995+0000","last_fullsized":"2024-09-15T23:19:35.620995+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:00.747606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.633135+0000","last_change":"2024-09-15T23:19:35.626540+0000","last_active":"2024-09-15T23:19:35.633135+0000","last_peered":"2024-09-15T23:19:35.633135+0000","last_clean":"2024-09-15T23:19:35.633135+0000","last_became_active":"2024-09-15T23:19:35.625997+0000","last_became_peered":"2024-09-15T23:19:35.625997+0000","last_unstale":"2024-09-15T23:19:35.633135+0000","last_undegraded":"2024-09-15T23:19:35.633135+0000","last_fullsized":"2024-09-15T23:19:35.633135+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:30.170171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.618105+0000","last_change":"2024-09-15T23:19:34.594881+0000","last_active":"2024-09-15T23:19:35.618105+0000","last_peered":"2024-09-15T23:19:35.618105+0000","last_clean":"2024-09-15T23:19:35.618105+0000","last_became_active":"2024-09-15T23:19:34.594542+0000","last_became_peered":"2024-09-15T23:19:34.594542+0000","last_unstale":"2024-09-15T23:19:35.618105+0000","last_undegraded":"2024-09-15T23:19:35.618105+0000","last_fullsized":"2024-09-15T23:19:35.618105+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:16:16.310640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:19:34.576871+0000","last_change":"2024-09-15T23:19:34.576871+0000","last_active":"2024-09-15T23:19:34.576871+0000","last_peered":"2024-09-15T23:19:34.576871+0000","last_clean":"2024-09-15T23:19:34.576871+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:34.576871+0000","last_undegraded":"2024-09-15T23:19:34.576871+0000","last_fullsized":"2024-09-15T23:19:34.576871+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":1,"reported_epoch":139,"state":"creating+peering","last_fresh":"2024-09-15T23:19:33.582021+0000","last_change":"2024-09-15T23:19:33.582021+0000","last_active":"2024-09-15T23:19:33.575362+0000","last_peered":"2024-09-15T23:19:33.575362+0000","last_clean":"2024-09-15T23:19:33.575362+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:19:33.582021+0000","last_undegraded":"2024-09-15T23:19:33.582021+0000","last_fullsized":"2024-09-15T23:19:33.582021+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":385,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-15T23:19:32.576723+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:19:32.576723+0000","last_peered":"2024-09-15T23:19:32.576723+0000","last_clean":"2024-09-15T23:19:32.576723+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:19:32.576723+0000","last_undegraded":"2024-09-15T23:19:32.576723+0000","last_fullsized":"2024-09-15T23:19:32.576723+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":66,"acting":66,"num_store_stats":4},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":54,"acting":54,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476832,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50904,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320936,"statfs":{"total":96636764160,"available":96584638464,"internally_reserved":0,"allocated":1708032,"data_stored":751605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476829,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50912,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320928,"statfs":{"total":96636764160,"available":96584630272,"internally_reserved":0,"allocated":1708032,"data_stored":751605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476831,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47324,"kb_used_data":2248,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324516,"statfs":{"total":96636764160,"available":96588304384,"internally_reserved":0,"allocated":2301952,"data_stored":1341973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476831,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41168,"kb_used_data":1656,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330672,"statfs":{"total":96636764160,"available":96594608128,"internally_reserved":0,"allocated":1695744,"data_stored":746478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542238,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45380,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326460,"statfs":{"total":96636764160,"available":96590295040,"internally_reserved":0,"allocated":1748992,"data_stored":770506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":44693962},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542238,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50940,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320900,"statfs":{"total":96636764160,"available":96584601600,"internally_reserved":0,"allocated":1744896,"data_stored":770472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542237,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55700,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316140,"statfs":{"total":96636764160,"available":96579727360,"internally_reserved":0,"allocated":2351104,"data_stored":1361582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542239,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50948,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320892,"statfs":{"total":96636764160,"available":96584593408,"internally_reserved":0,"allocated":1744896,"data_stored":770472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:19:39.215 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3d is not active+clean 2024-09-15T23:19:39.215 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:19:34.576871+0000', 'last_change': '2024-09-15T23:19:34.576871+0000', 'last_active': '2024-09-15T23:19:34.576871+0000', 'last_peered': '2024-09-15T23:19:34.576871+0000', 'last_clean': '2024-09-15T23:19:34.576871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:34.576871+0000', 'last_undegraded': '2024-09-15T23:19:34.576871+0000', 'last_fullsized': '2024-09-15T23:19:34.576871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:19:39.215 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3b is not active+clean 2024-09-15T23:19:39.215 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:19:34.576871+0000', 'last_change': '2024-09-15T23:19:34.576871+0000', 'last_active': '2024-09-15T23:19:34.576871+0000', 'last_peered': '2024-09-15T23:19:34.576871+0000', 'last_clean': '2024-09-15T23:19:34.576871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:34.576871+0000', 'last_undegraded': '2024-09-15T23:19:34.576871+0000', 'last_fullsized': '2024-09-15T23:19:34.576871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:19:39.215 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3a is not active+clean 2024-09-15T23:19:39.215 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:19:34.576871+0000', 'last_change': '2024-09-15T23:19:34.576871+0000', 'last_active': '2024-09-15T23:19:34.576871+0000', 'last_peered': '2024-09-15T23:19:34.576871+0000', 'last_clean': '2024-09-15T23:19:34.576871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:34.576871+0000', 'last_undegraded': '2024-09-15T23:19:34.576871+0000', 'last_fullsized': '2024-09-15T23:19:34.576871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:19:39.215 INFO:tasks.ceph.ceph_manager.ceph:PG 19.39 is not active+clean 2024-09-15T23:19:39.215 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:19:34.576871+0000', 'last_change': '2024-09-15T23:19:34.576871+0000', 'last_active': '2024-09-15T23:19:34.576871+0000', 'last_peered': '2024-09-15T23:19:34.576871+0000', 'last_clean': '2024-09-15T23:19:34.576871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:34.576871+0000', 'last_undegraded': '2024-09-15T23:19:34.576871+0000', 'last_fullsized': '2024-09-15T23:19:34.576871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:19:39.215 INFO:tasks.ceph.ceph_manager.ceph:PG 19.38 is not active+clean 2024-09-15T23:19:39.215 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:19:34.576871+0000', 'last_change': '2024-09-15T23:19:34.576871+0000', 'last_active': '2024-09-15T23:19:34.576871+0000', 'last_peered': '2024-09-15T23:19:34.576871+0000', 'last_clean': '2024-09-15T23:19:34.576871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:34.576871+0000', 'last_undegraded': '2024-09-15T23:19:34.576871+0000', 'last_fullsized': '2024-09-15T23:19:34.576871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:19:39.216 INFO:tasks.ceph.ceph_manager.ceph:PG 19.37 is not active+clean 2024-09-15T23:19:39.216 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:19:34.576871+0000', 'last_change': '2024-09-15T23:19:34.576871+0000', 'last_active': '2024-09-15T23:19:34.576871+0000', 'last_peered': '2024-09-15T23:19:34.576871+0000', 'last_clean': '2024-09-15T23:19:34.576871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:34.576871+0000', 'last_undegraded': '2024-09-15T23:19:34.576871+0000', 'last_fullsized': '2024-09-15T23:19:34.576871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:19:39.216 INFO:tasks.ceph.ceph_manager.ceph:PG 19.34 is not active+clean 2024-09-15T23:19:39.216 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:19:34.576871+0000', 'last_change': '2024-09-15T23:19:34.576871+0000', 'last_active': '2024-09-15T23:19:34.576871+0000', 'last_peered': '2024-09-15T23:19:34.576871+0000', 'last_clean': '2024-09-15T23:19:34.576871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:34.576871+0000', 'last_undegraded': '2024-09-15T23:19:34.576871+0000', 'last_fullsized': '2024-09-15T23:19:34.576871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:19:39.216 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2f is not active+clean 2024-09-15T23:19:39.216 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:19:34.576871+0000', 'last_change': '2024-09-15T23:19:34.576871+0000', 'last_active': '2024-09-15T23:19:34.576871+0000', 'last_peered': '2024-09-15T23:19:34.576871+0000', 'last_clean': '2024-09-15T23:19:34.576871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:34.576871+0000', 'last_undegraded': '2024-09-15T23:19:34.576871+0000', 'last_fullsized': '2024-09-15T23:19:34.576871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:19:39.216 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2b is not active+clean 2024-09-15T23:19:39.216 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:19:34.576871+0000', 'last_change': '2024-09-15T23:19:34.576871+0000', 'last_active': '2024-09-15T23:19:34.576871+0000', 'last_peered': '2024-09-15T23:19:34.576871+0000', 'last_clean': '2024-09-15T23:19:34.576871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:34.576871+0000', 'last_undegraded': '2024-09-15T23:19:34.576871+0000', 'last_fullsized': '2024-09-15T23:19:34.576871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:19:39.216 INFO:tasks.ceph.ceph_manager.ceph:PG 19.29 is not active+clean 2024-09-15T23:19:39.216 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:19:34.576871+0000', 'last_change': '2024-09-15T23:19:34.576871+0000', 'last_active': '2024-09-15T23:19:34.576871+0000', 'last_peered': '2024-09-15T23:19:34.576871+0000', 'last_clean': '2024-09-15T23:19:34.576871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:34.576871+0000', 'last_undegraded': '2024-09-15T23:19:34.576871+0000', 'last_fullsized': '2024-09-15T23:19:34.576871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:19:39.217 INFO:tasks.ceph.ceph_manager.ceph:PG 19.24 is not active+clean 2024-09-15T23:19:39.217 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:19:34.576871+0000', 'last_change': '2024-09-15T23:19:34.576871+0000', 'last_active': '2024-09-15T23:19:34.576871+0000', 'last_peered': '2024-09-15T23:19:34.576871+0000', 'last_clean': '2024-09-15T23:19:34.576871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:34.576871+0000', 'last_undegraded': '2024-09-15T23:19:34.576871+0000', 'last_fullsized': '2024-09-15T23:19:34.576871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:19:39.217 INFO:tasks.ceph.ceph_manager.ceph:PG 19.21 is not active+clean 2024-09-15T23:19:39.217 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:19:34.576871+0000', 'last_change': '2024-09-15T23:19:34.576871+0000', 'last_active': '2024-09-15T23:19:34.576871+0000', 'last_peered': '2024-09-15T23:19:34.576871+0000', 'last_clean': '2024-09-15T23:19:34.576871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:34.576871+0000', 'last_undegraded': '2024-09-15T23:19:34.576871+0000', 'last_fullsized': '2024-09-15T23:19:34.576871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:19:39.217 INFO:tasks.ceph.ceph_manager.ceph:PG 19.20 is not active+clean 2024-09-15T23:19:39.217 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:19:34.576871+0000', 'last_change': '2024-09-15T23:19:34.576871+0000', 'last_active': '2024-09-15T23:19:34.576871+0000', 'last_peered': '2024-09-15T23:19:34.576871+0000', 'last_clean': '2024-09-15T23:19:34.576871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:34.576871+0000', 'last_undegraded': '2024-09-15T23:19:34.576871+0000', 'last_fullsized': '2024-09-15T23:19:34.576871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:19:39.217 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1f is not active+clean 2024-09-15T23:19:39.217 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 139, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:19:33.579066+0000', 'last_change': '2024-09-15T23:19:33.579066+0000', 'last_active': '2024-09-15T23:19:33.575362+0000', 'last_peered': '2024-09-15T23:19:33.575362+0000', 'last_clean': '2024-09-15T23:19:33.575362+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:33.579066+0000', 'last_undegraded': '2024-09-15T23:19:33.579066+0000', 'last_fullsized': '2024-09-15T23:19:33.579066+0000', 'mapping_epoch': 139, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 139, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:19:39.217 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1f is not active+clean 2024-09-15T23:19:39.217 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:19:34.576871+0000', 'last_change': '2024-09-15T23:19:34.576871+0000', 'last_active': '2024-09-15T23:19:34.576871+0000', 'last_peered': '2024-09-15T23:19:34.576871+0000', 'last_clean': '2024-09-15T23:19:34.576871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:34.576871+0000', 'last_undegraded': '2024-09-15T23:19:34.576871+0000', 'last_fullsized': '2024-09-15T23:19:34.576871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:19:39.217 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1e is not active+clean 2024-09-15T23:19:39.217 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:19:33.575362+0000', 'last_change': '2024-09-15T23:19:33.575362+0000', 'last_active': '2024-09-15T23:19:33.575362+0000', 'last_peered': '2024-09-15T23:19:33.575362+0000', 'last_clean': '2024-09-15T23:19:33.575362+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:33.575362+0000', 'last_undegraded': '2024-09-15T23:19:33.575362+0000', 'last_fullsized': '2024-09-15T23:19:33.575362+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:19:39.218 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1c is not active+clean 2024-09-15T23:19:39.218 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:19:34.576871+0000', 'last_change': '2024-09-15T23:19:34.576871+0000', 'last_active': '2024-09-15T23:19:34.576871+0000', 'last_peered': '2024-09-15T23:19:34.576871+0000', 'last_clean': '2024-09-15T23:19:34.576871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:34.576871+0000', 'last_undegraded': '2024-09-15T23:19:34.576871+0000', 'last_fullsized': '2024-09-15T23:19:34.576871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:19:39.218 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1d is not active+clean 2024-09-15T23:19:39.218 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:19:34.576871+0000', 'last_change': '2024-09-15T23:19:34.576871+0000', 'last_active': '2024-09-15T23:19:34.576871+0000', 'last_peered': '2024-09-15T23:19:34.576871+0000', 'last_clean': '2024-09-15T23:19:34.576871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:34.576871+0000', 'last_undegraded': '2024-09-15T23:19:34.576871+0000', 'last_fullsized': '2024-09-15T23:19:34.576871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:19:39.218 INFO:tasks.ceph.ceph_manager.ceph:PG 19.1b is not active+clean 2024-09-15T23:19:39.218 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:19:34.576871+0000', 'last_change': '2024-09-15T23:19:34.576871+0000', 'last_active': '2024-09-15T23:19:34.576871+0000', 'last_peered': '2024-09-15T23:19:34.576871+0000', 'last_clean': '2024-09-15T23:19:34.576871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:34.576871+0000', 'last_undegraded': '2024-09-15T23:19:34.576871+0000', 'last_fullsized': '2024-09-15T23:19:34.576871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:19:39.218 INFO:tasks.ceph.ceph_manager.ceph:PG 19.18 is not active+clean 2024-09-15T23:19:39.218 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:19:34.576871+0000', 'last_change': '2024-09-15T23:19:34.576871+0000', 'last_active': '2024-09-15T23:19:34.576871+0000', 'last_peered': '2024-09-15T23:19:34.576871+0000', 'last_clean': '2024-09-15T23:19:34.576871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:34.576871+0000', 'last_undegraded': '2024-09-15T23:19:34.576871+0000', 'last_fullsized': '2024-09-15T23:19:34.576871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:19:39.218 INFO:tasks.ceph.ceph_manager.ceph:PG 18.19 is not active+clean 2024-09-15T23:19:39.218 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:19:33.575362+0000', 'last_change': '2024-09-15T23:19:33.575362+0000', 'last_active': '2024-09-15T23:19:33.575362+0000', 'last_peered': '2024-09-15T23:19:33.575362+0000', 'last_clean': '2024-09-15T23:19:33.575362+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:33.575362+0000', 'last_undegraded': '2024-09-15T23:19:33.575362+0000', 'last_fullsized': '2024-09-15T23:19:33.575362+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:19:39.219 INFO:tasks.ceph.ceph_manager.ceph:PG 18.17 is not active+clean 2024-09-15T23:19:39.219 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 139, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:19:33.581895+0000', 'last_change': '2024-09-15T23:19:33.581895+0000', 'last_active': '2024-09-15T23:19:33.575362+0000', 'last_peered': '2024-09-15T23:19:33.575362+0000', 'last_clean': '2024-09-15T23:19:33.575362+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:33.581895+0000', 'last_undegraded': '2024-09-15T23:19:33.581895+0000', 'last_fullsized': '2024-09-15T23:19:33.581895+0000', 'mapping_epoch': 139, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 139, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:19:39.219 INFO:tasks.ceph.ceph_manager.ceph:PG 19.17 is not active+clean 2024-09-15T23:19:39.219 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:19:34.576871+0000', 'last_change': '2024-09-15T23:19:34.576871+0000', 'last_active': '2024-09-15T23:19:34.576871+0000', 'last_peered': '2024-09-15T23:19:34.576871+0000', 'last_clean': '2024-09-15T23:19:34.576871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:34.576871+0000', 'last_undegraded': '2024-09-15T23:19:34.576871+0000', 'last_fullsized': '2024-09-15T23:19:34.576871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:19:39.219 INFO:tasks.ceph.ceph_manager.ceph:PG 19.14 is not active+clean 2024-09-15T23:19:39.219 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:19:34.576871+0000', 'last_change': '2024-09-15T23:19:34.576871+0000', 'last_active': '2024-09-15T23:19:34.576871+0000', 'last_peered': '2024-09-15T23:19:34.576871+0000', 'last_clean': '2024-09-15T23:19:34.576871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:34.576871+0000', 'last_undegraded': '2024-09-15T23:19:34.576871+0000', 'last_fullsized': '2024-09-15T23:19:34.576871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:19:39.219 INFO:tasks.ceph.ceph_manager.ceph:PG 18.15 is not active+clean 2024-09-15T23:19:39.219 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 139, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:19:33.579190+0000', 'last_change': '2024-09-15T23:19:33.579190+0000', 'last_active': '2024-09-15T23:19:33.575362+0000', 'last_peered': '2024-09-15T23:19:33.575362+0000', 'last_clean': '2024-09-15T23:19:33.575362+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:33.579190+0000', 'last_undegraded': '2024-09-15T23:19:33.579190+0000', 'last_fullsized': '2024-09-15T23:19:33.579190+0000', 'mapping_epoch': 139, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 139, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:19:39.219 INFO:tasks.ceph.ceph_manager.ceph:PG 19.15 is not active+clean 2024-09-15T23:19:39.219 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:19:34.576871+0000', 'last_change': '2024-09-15T23:19:34.576871+0000', 'last_active': '2024-09-15T23:19:34.576871+0000', 'last_peered': '2024-09-15T23:19:34.576871+0000', 'last_clean': '2024-09-15T23:19:34.576871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:34.576871+0000', 'last_undegraded': '2024-09-15T23:19:34.576871+0000', 'last_fullsized': '2024-09-15T23:19:34.576871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:19:39.219 INFO:tasks.ceph.ceph_manager.ceph:PG 18.14 is not active+clean 2024-09-15T23:19:39.220 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:19:33.575362+0000', 'last_change': '2024-09-15T23:19:33.575362+0000', 'last_active': '2024-09-15T23:19:33.575362+0000', 'last_peered': '2024-09-15T23:19:33.575362+0000', 'last_clean': '2024-09-15T23:19:33.575362+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:33.575362+0000', 'last_undegraded': '2024-09-15T23:19:33.575362+0000', 'last_fullsized': '2024-09-15T23:19:33.575362+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:19:39.220 INFO:tasks.ceph.ceph_manager.ceph:PG 19.11 is not active+clean 2024-09-15T23:19:39.220 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:19:34.576871+0000', 'last_change': '2024-09-15T23:19:34.576871+0000', 'last_active': '2024-09-15T23:19:34.576871+0000', 'last_peered': '2024-09-15T23:19:34.576871+0000', 'last_clean': '2024-09-15T23:19:34.576871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:34.576871+0000', 'last_undegraded': '2024-09-15T23:19:34.576871+0000', 'last_fullsized': '2024-09-15T23:19:34.576871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:19:39.220 INFO:tasks.ceph.ceph_manager.ceph:PG 18.10 is not active+clean 2024-09-15T23:19:39.220 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 139, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:19:33.581699+0000', 'last_change': '2024-09-15T23:19:33.581699+0000', 'last_active': '2024-09-15T23:19:33.575362+0000', 'last_peered': '2024-09-15T23:19:33.575362+0000', 'last_clean': '2024-09-15T23:19:33.575362+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:33.581699+0000', 'last_undegraded': '2024-09-15T23:19:33.581699+0000', 'last_fullsized': '2024-09-15T23:19:33.581699+0000', 'mapping_epoch': 139, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 139, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:19:39.220 INFO:tasks.ceph.ceph_manager.ceph:PG 19.e is not active+clean 2024-09-15T23:19:39.220 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:19:34.576871+0000', 'last_change': '2024-09-15T23:19:34.576871+0000', 'last_active': '2024-09-15T23:19:34.576871+0000', 'last_peered': '2024-09-15T23:19:34.576871+0000', 'last_clean': '2024-09-15T23:19:34.576871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:34.576871+0000', 'last_undegraded': '2024-09-15T23:19:34.576871+0000', 'last_fullsized': '2024-09-15T23:19:34.576871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:19:39.220 INFO:tasks.ceph.ceph_manager.ceph:PG 18.f is not active+clean 2024-09-15T23:19:39.220 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 139, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:19:33.581392+0000', 'last_change': '2024-09-15T23:19:33.581392+0000', 'last_active': '2024-09-15T23:19:33.575362+0000', 'last_peered': '2024-09-15T23:19:33.575362+0000', 'last_clean': '2024-09-15T23:19:33.575362+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:33.581392+0000', 'last_undegraded': '2024-09-15T23:19:33.581392+0000', 'last_fullsized': '2024-09-15T23:19:33.581392+0000', 'mapping_epoch': 139, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 139, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:19:39.221 INFO:tasks.ceph.ceph_manager.ceph:PG 19.f is not active+clean 2024-09-15T23:19:39.221 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:19:34.576871+0000', 'last_change': '2024-09-15T23:19:34.576871+0000', 'last_active': '2024-09-15T23:19:34.576871+0000', 'last_peered': '2024-09-15T23:19:34.576871+0000', 'last_clean': '2024-09-15T23:19:34.576871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:34.576871+0000', 'last_undegraded': '2024-09-15T23:19:34.576871+0000', 'last_fullsized': '2024-09-15T23:19:34.576871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:19:39.221 INFO:tasks.ceph.ceph_manager.ceph:PG 18.d is not active+clean 2024-09-15T23:19:39.221 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:19:33.575362+0000', 'last_change': '2024-09-15T23:19:33.575362+0000', 'last_active': '2024-09-15T23:19:33.575362+0000', 'last_peered': '2024-09-15T23:19:33.575362+0000', 'last_clean': '2024-09-15T23:19:33.575362+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:33.575362+0000', 'last_undegraded': '2024-09-15T23:19:33.575362+0000', 'last_fullsized': '2024-09-15T23:19:33.575362+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:19:39.221 INFO:tasks.ceph.ceph_manager.ceph:PG 18.c is not active+clean 2024-09-15T23:19:39.221 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 139, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:19:33.579118+0000', 'last_change': '2024-09-15T23:19:33.579118+0000', 'last_active': '2024-09-15T23:19:33.575362+0000', 'last_peered': '2024-09-15T23:19:33.575362+0000', 'last_clean': '2024-09-15T23:19:33.575362+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:33.579118+0000', 'last_undegraded': '2024-09-15T23:19:33.579118+0000', 'last_fullsized': '2024-09-15T23:19:33.579118+0000', 'mapping_epoch': 139, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 139, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:19:39.221 INFO:tasks.ceph.ceph_manager.ceph:PG 18.b is not active+clean 2024-09-15T23:19:39.221 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:19:33.575362+0000', 'last_change': '2024-09-15T23:19:33.575362+0000', 'last_active': '2024-09-15T23:19:33.575362+0000', 'last_peered': '2024-09-15T23:19:33.575362+0000', 'last_clean': '2024-09-15T23:19:33.575362+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:33.575362+0000', 'last_undegraded': '2024-09-15T23:19:33.575362+0000', 'last_fullsized': '2024-09-15T23:19:33.575362+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:19:39.221 INFO:tasks.ceph.ceph_manager.ceph:PG 19.b is not active+clean 2024-09-15T23:19:39.221 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:19:34.576871+0000', 'last_change': '2024-09-15T23:19:34.576871+0000', 'last_active': '2024-09-15T23:19:34.576871+0000', 'last_peered': '2024-09-15T23:19:34.576871+0000', 'last_clean': '2024-09-15T23:19:34.576871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:34.576871+0000', 'last_undegraded': '2024-09-15T23:19:34.576871+0000', 'last_fullsized': '2024-09-15T23:19:34.576871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:19:39.222 INFO:tasks.ceph.ceph_manager.ceph:PG 19.9 is not active+clean 2024-09-15T23:19:39.222 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:19:34.576871+0000', 'last_change': '2024-09-15T23:19:34.576871+0000', 'last_active': '2024-09-15T23:19:34.576871+0000', 'last_peered': '2024-09-15T23:19:34.576871+0000', 'last_clean': '2024-09-15T23:19:34.576871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:34.576871+0000', 'last_undegraded': '2024-09-15T23:19:34.576871+0000', 'last_fullsized': '2024-09-15T23:19:34.576871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:19:39.222 INFO:tasks.ceph.ceph_manager.ceph:PG 19.6 is not active+clean 2024-09-15T23:19:39.222 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:19:34.576871+0000', 'last_change': '2024-09-15T23:19:34.576871+0000', 'last_active': '2024-09-15T23:19:34.576871+0000', 'last_peered': '2024-09-15T23:19:34.576871+0000', 'last_clean': '2024-09-15T23:19:34.576871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:34.576871+0000', 'last_undegraded': '2024-09-15T23:19:34.576871+0000', 'last_fullsized': '2024-09-15T23:19:34.576871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:19:39.222 INFO:tasks.ceph.ceph_manager.ceph:PG 18.6 is not active+clean 2024-09-15T23:19:39.222 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 139, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:19:33.579403+0000', 'last_change': '2024-09-15T23:19:33.579403+0000', 'last_active': '2024-09-15T23:19:33.575362+0000', 'last_peered': '2024-09-15T23:19:33.575362+0000', 'last_clean': '2024-09-15T23:19:33.575362+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:33.579403+0000', 'last_undegraded': '2024-09-15T23:19:33.579403+0000', 'last_fullsized': '2024-09-15T23:19:33.579403+0000', 'mapping_epoch': 139, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 139, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:19:39.222 INFO:tasks.ceph.ceph_manager.ceph:PG 19.5 is not active+clean 2024-09-15T23:19:39.222 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:19:34.576871+0000', 'last_change': '2024-09-15T23:19:34.576871+0000', 'last_active': '2024-09-15T23:19:34.576871+0000', 'last_peered': '2024-09-15T23:19:34.576871+0000', 'last_clean': '2024-09-15T23:19:34.576871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:34.576871+0000', 'last_undegraded': '2024-09-15T23:19:34.576871+0000', 'last_fullsized': '2024-09-15T23:19:34.576871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:19:39.222 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2 is not active+clean 2024-09-15T23:19:39.222 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:19:34.576871+0000', 'last_change': '2024-09-15T23:19:34.576871+0000', 'last_active': '2024-09-15T23:19:34.576871+0000', 'last_peered': '2024-09-15T23:19:34.576871+0000', 'last_clean': '2024-09-15T23:19:34.576871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:34.576871+0000', 'last_undegraded': '2024-09-15T23:19:34.576871+0000', 'last_fullsized': '2024-09-15T23:19:34.576871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:19:39.222 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3 is not active+clean 2024-09-15T23:19:39.222 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:19:34.576871+0000', 'last_change': '2024-09-15T23:19:34.576871+0000', 'last_active': '2024-09-15T23:19:34.576871+0000', 'last_peered': '2024-09-15T23:19:34.576871+0000', 'last_clean': '2024-09-15T23:19:34.576871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:34.576871+0000', 'last_undegraded': '2024-09-15T23:19:34.576871+0000', 'last_fullsized': '2024-09-15T23:19:34.576871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:19:39.223 INFO:tasks.ceph.ceph_manager.ceph:PG 18.2 is not active+clean 2024-09-15T23:19:39.223 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 139, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:19:33.581363+0000', 'last_change': '2024-09-15T23:19:33.581363+0000', 'last_active': '2024-09-15T23:19:33.575362+0000', 'last_peered': '2024-09-15T23:19:33.575362+0000', 'last_clean': '2024-09-15T23:19:33.575362+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:33.581363+0000', 'last_undegraded': '2024-09-15T23:19:33.581363+0000', 'last_fullsized': '2024-09-15T23:19:33.581363+0000', 'mapping_epoch': 139, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 139, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:19:39.223 INFO:tasks.ceph.ceph_manager.ceph:PG 19.12 is not active+clean 2024-09-15T23:19:39.223 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:19:34.576871+0000', 'last_change': '2024-09-15T23:19:34.576871+0000', 'last_active': '2024-09-15T23:19:34.576871+0000', 'last_peered': '2024-09-15T23:19:34.576871+0000', 'last_clean': '2024-09-15T23:19:34.576871+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:34.576871+0000', 'last_undegraded': '2024-09-15T23:19:34.576871+0000', 'last_fullsized': '2024-09-15T23:19:34.576871+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:34.576871+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:19:39.223 INFO:tasks.ceph.ceph_manager.ceph:PG 18.13 is not active+clean 2024-09-15T23:19:39.223 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 139, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:19:33.582021+0000', 'last_change': '2024-09-15T23:19:33.582021+0000', 'last_active': '2024-09-15T23:19:33.575362+0000', 'last_peered': '2024-09-15T23:19:33.575362+0000', 'last_clean': '2024-09-15T23:19:33.575362+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:19:33.582021+0000', 'last_undegraded': '2024-09-15T23:19:33.582021+0000', 'last_fullsized': '2024-09-15T23:19:33.582021+0000', 'mapping_epoch': 139, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 139, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'last_clean_scrub_stamp': '2024-09-15T23:19:33.575362+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:19:39.224 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:19:39.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.347+0000 7f406037f640 1 Processor -- start 2024-09-15T23:19:39.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.348+0000 7f406037f640 1 -- start start 2024-09-15T23:19:39.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.348+0000 7f406037f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f40580b2d40 0x7f405806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:39.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.348+0000 7f406037f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f405813eb20 0x7f405806c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:39.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.348+0000 7f406037f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f405815bcf0 0x7f405815c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:39.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.349+0000 7f406037f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f4058071ab0 con 0x7f405815bcf0 2024-09-15T23:19:39.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.349+0000 7f406037f640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f4058071180 con 0x7f40580b2d40 2024-09-15T23:19:39.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.349+0000 7f406037f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4058071460 con 0x7f405813eb20 2024-09-15T23:19:39.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.349+0000 7f405e91c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f405815bcf0 0x7f405815c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:39.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.349+0000 7f405e91c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f405815bcf0 0x7f405815c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49874/0 (socket says 172.21.15.123:49874) 2024-09-15T23:19:39.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.349+0000 7f405e91c640 1 -- 172.21.15.123:0/819843700 learned_addr learned my addr 172.21.15.123:0/819843700 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:39.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.349+0000 7f405e91c640 1 -- 172.21.15.123:0/819843700 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f405813eb20 msgr2=0x7f405806c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:39.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.349+0000 7f405e91c640 1 --2- 172.21.15.123:0/819843700 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f405813eb20 0x7f405806c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:39.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.349+0000 7f405e91c640 1 -- 172.21.15.123:0/819843700 >> v2:172.21.15.188:3300/0 conn(0x7f40580b2d40 msgr2=0x7f405806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:39.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.349+0000 7f405e91c640 1 --2- 172.21.15.123:0/819843700 >> v2:172.21.15.188:3300/0 conn(0x7f40580b2d40 0x7f405806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:39.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.349+0000 7f405e91c640 1 -- 172.21.15.123:0/819843700 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4058071740 con 0x7f405815bcf0 2024-09-15T23:19:39.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.350+0000 7f405e91c640 1 --2- 172.21.15.123:0/819843700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f405815bcf0 0x7f405815c1a0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f4058069be0 tx=0x7f405002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a6cca114ee2f5b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:39.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.350+0000 7f405d119640 1 -- 172.21.15.123:0/819843700 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4050036070 con 0x7f405815bcf0 2024-09-15T23:19:39.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.350+0000 7f405d119640 1 -- 172.21.15.123:0/819843700 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4050031600 con 0x7f405815bcf0 2024-09-15T23:19:39.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.350+0000 7f405d119640 1 -- 172.21.15.123:0/819843700 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40500319d0 con 0x7f405815bcf0 2024-09-15T23:19:39.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.350+0000 7f406037f640 1 -- 172.21.15.123:0/819843700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f405815bcf0 msgr2=0x7f405815c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:39.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.350+0000 7f406037f640 1 --2- 172.21.15.123:0/819843700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f405815bcf0 0x7f405815c1a0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f4058069be0 tx=0x7f405002a6a0 comp rx=0 tx=0).stop 2024-09-15T23:19:39.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.350+0000 7f406037f640 1 -- 172.21.15.123:0/819843700 shutdown_connections 2024-09-15T23:19:39.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.350+0000 7f406037f640 1 --2- 172.21.15.123:0/819843700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f405815bcf0 0x7f405815c1a0 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:39.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.350+0000 7f406037f640 1 --2- 172.21.15.123:0/819843700 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f405813eb20 0x7f405806c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:39.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.350+0000 7f406037f640 1 --2- 172.21.15.123:0/819843700 >> v2:172.21.15.188:3300/0 conn(0x7f40580b2d40 0x7f405806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:39.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.350+0000 7f406037f640 1 -- 172.21.15.123:0/819843700 >> 172.21.15.123:0/819843700 conn(0x7f40580ccec0 msgr2=0x7f40580cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:39.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.350+0000 7f406037f640 1 -- 172.21.15.123:0/819843700 shutdown_connections 2024-09-15T23:19:39.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.350+0000 7f406037f640 1 -- 172.21.15.123:0/819843700 wait complete. 2024-09-15T23:19:39.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.352+0000 7f406037f640 1 Processor -- start 2024-09-15T23:19:39.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.352+0000 7f406037f640 1 -- start start 2024-09-15T23:19:39.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.352+0000 7f406037f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f40580b2d40 0x7f405813dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:39.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.352+0000 7f406037f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f405813eb20 0x7f4058141b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:39.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.352+0000 7f406037f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f405815bcf0 0x7f40580cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:39.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.352+0000 7f406037f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f405815f140 con 0x7f405813eb20 2024-09-15T23:19:39.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.352+0000 7f406037f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f405815efc0 con 0x7f405815bcf0 2024-09-15T23:19:39.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.352+0000 7f406037f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f405815f2c0 con 0x7f40580b2d40 2024-09-15T23:19:39.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.352+0000 7f405d91a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f405813eb20 0x7f4058141b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:39.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.352+0000 7f405d91a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f405813eb20 0x7f4058141b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49880/0 (socket says 172.21.15.123:49880) 2024-09-15T23:19:39.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.352+0000 7f405d91a640 1 -- 172.21.15.123:0/2765143465 learned_addr learned my addr 172.21.15.123:0/2765143465 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:39.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.353+0000 7f405d91a640 1 -- 172.21.15.123:0/2765143465 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f40580b2d40 msgr2=0x7f405813dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:39.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.353+0000 7f405d91a640 1 --2- 172.21.15.123:0/2765143465 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f40580b2d40 0x7f405813dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:39.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.353+0000 7f405d91a640 1 -- 172.21.15.123:0/2765143465 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f405815bcf0 msgr2=0x7f40580cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:39.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.353+0000 7f405d91a640 1 --2- 172.21.15.123:0/2765143465 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f405815bcf0 0x7f40580cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:39.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.353+0000 7f405d91a640 1 -- 172.21.15.123:0/2765143465 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40581f88b0 con 0x7f405813eb20 2024-09-15T23:19:39.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.353+0000 7f405d91a640 1 --2- 172.21.15.123:0/2765143465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f405813eb20 0x7f4058141b30 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f405400b480 tx=0x7f405400b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:39.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.353+0000 7f404affd640 1 -- 172.21.15.123:0/2765143465 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4054014070 con 0x7f405813eb20 2024-09-15T23:19:39.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.353+0000 7f404affd640 1 -- 172.21.15.123:0/2765143465 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4054010870 con 0x7f405813eb20 2024-09-15T23:19:39.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.353+0000 7f404affd640 1 -- 172.21.15.123:0/2765143465 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4054010c60 con 0x7f405813eb20 2024-09-15T23:19:39.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.353+0000 7f406037f640 1 -- 172.21.15.123:0/2765143465 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f405813e100 con 0x7f405813eb20 2024-09-15T23:19:39.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.353+0000 7f406037f640 1 -- 172.21.15.123:0/2765143465 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40580cb4f0 con 0x7f405813eb20 2024-09-15T23:19:39.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.354+0000 7f406037f640 1 -- 172.21.15.123:0/2765143465 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40580cbb00 con 0x7f405813eb20 2024-09-15T23:19:39.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.354+0000 7f404affd640 1 -- 172.21.15.123:0/2765143465 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4054017070 con 0x7f405813eb20 2024-09-15T23:19:39.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.355+0000 7f404affd640 1 --2- 172.21.15.123:0/2765143465 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f403c06c2b0 0x7f403c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:39.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.355+0000 7f404affd640 1 -- 172.21.15.123:0/2765143465 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f405408b1d0 con 0x7f405813eb20 2024-09-15T23:19:39.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.355+0000 7f405e11b640 1 --2- 172.21.15.123:0/2765143465 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f403c06c2b0 0x7f403c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:39.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.356+0000 7f405e11b640 1 --2- 172.21.15.123:0/2765143465 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f403c06c2b0 0x7f403c06e770 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f404c009710 tx=0x7f404c006c90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:39.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.359+0000 7f404affd640 1 -- 172.21.15.123:0/2765143465 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f40540599d0 con 0x7f405813eb20 2024-09-15T23:19:39.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.589+0000 7f406037f640 1 -- 172.21.15.123:0/2765143465 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f405815c1a0 con 0x7f405813eb20 2024-09-15T23:19:39.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.589+0000 7f404affd640 1 -- 172.21.15.123:0/2765143465 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1634 (secure 0 0 0) 0x7f40540592d0 con 0x7f405813eb20 2024-09-15T23:19:39.591 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:19:39.591 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":470,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":142,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":52},{"state_name":"unknown","count":36},{"state_name":"creating+peering","count":9}],"num_pgs":97,"num_pools":3,"num_objects":6,"data_bytes":590368,"bytes_used":402714624,"bytes_avail":772691398656,"bytes_total":773094113280,"unknown_pgs_ratio":0.37113401293754578,"inactive_pgs_ratio":0.092783503234386444,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":86,"btime":"2024-09-15T23:19:37:619526+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"d","status":"up:active","gid":8439}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-09-15T23:19:25.606748+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T23:19:39.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.591+0000 7f406037f640 1 -- 172.21.15.123:0/2765143465 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f403c06c2b0 msgr2=0x7f403c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:39.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.591+0000 7f406037f640 1 --2- 172.21.15.123:0/2765143465 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f403c06c2b0 0x7f403c06e770 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f404c009710 tx=0x7f404c006c90 comp rx=0 tx=0).stop 2024-09-15T23:19:39.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.591+0000 7f406037f640 1 -- 172.21.15.123:0/2765143465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f405813eb20 msgr2=0x7f4058141b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:39.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.591+0000 7f406037f640 1 --2- 172.21.15.123:0/2765143465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f405813eb20 0x7f4058141b30 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f405400b480 tx=0x7f405400b940 comp rx=0 tx=0).stop 2024-09-15T23:19:39.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.591+0000 7f406037f640 1 -- 172.21.15.123:0/2765143465 shutdown_connections 2024-09-15T23:19:39.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.591+0000 7f406037f640 1 --2- 172.21.15.123:0/2765143465 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f405815bcf0 0x7f40580cbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:39.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.591+0000 7f406037f640 1 --2- 172.21.15.123:0/2765143465 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f403c06c2b0 0x7f403c06e770 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:39.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.591+0000 7f406037f640 1 --2- 172.21.15.123:0/2765143465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f405813eb20 0x7f4058141b30 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:39.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.591+0000 7f406037f640 1 --2- 172.21.15.123:0/2765143465 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f40580b2d40 0x7f405813dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:39.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.591+0000 7f406037f640 1 -- 172.21.15.123:0/2765143465 >> 172.21.15.123:0/2765143465 conn(0x7f40580ccec0 msgr2=0x7f40580cd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:39.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.591+0000 7f406037f640 1 -- 172.21.15.123:0/2765143465 shutdown_connections 2024-09-15T23:19:39.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.591+0000 7f406037f640 1 -- 172.21.15.123:0/2765143465 wait complete. 2024-09-15T23:19:39.603 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-15T23:19:39.603 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:19:39.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.700+0000 7f0645366640 1 Processor -- start 2024-09-15T23:19:39.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.700+0000 7f0645366640 1 -- start start 2024-09-15T23:19:39.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.701+0000 7f0645366640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f0640148090 0x7f06400ae870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:39.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.701+0000 7f0645366640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f06400731e0 0x7f064006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:39.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.701+0000 7f0645366640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06400b07c0 con 0x7f064006c150 2024-09-15T23:19:39.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.701+0000 7f0645366640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f06400b52c0 con 0x7f06400731e0 2024-09-15T23:19:39.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.701+0000 7f0645366640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f064006c5a0 con 0x7f0640148090 2024-09-15T23:19:39.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.701+0000 7f063e7fc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f06400731e0 0x7f064006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:39.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.701+0000 7f063e7fc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f06400731e0 0x7f064006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49888/0 (socket says 172.21.15.123:49888) 2024-09-15T23:19:39.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.701+0000 7f063e7fc640 1 -- 172.21.15.123:0/563558490 learned_addr learned my addr 172.21.15.123:0/563558490 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:39.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.702+0000 7f063effd640 1 --2- 172.21.15.123:0/563558490 >> v2:172.21.15.188:3300/0 conn(0x7f0640148090 0x7f06400ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:39.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.702+0000 7f063e7fc640 1 -- 172.21.15.123:0/563558490 >> v2:172.21.15.188:3300/0 conn(0x7f0640148090 msgr2=0x7f06400ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:39.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.702+0000 7f063e7fc640 1 --2- 172.21.15.123:0/563558490 >> v2:172.21.15.188:3300/0 conn(0x7f0640148090 0x7f06400ae870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:39.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.702+0000 7f063e7fc640 1 -- 172.21.15.123:0/563558490 >> v1:172.21.15.188:6789/0 conn(0x7f064006c150 legacy=0x7f0640071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:39.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.702+0000 7f063e7fc640 1 -- 172.21.15.123:0/563558490 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06400af7a0 con 0x7f06400731e0 2024-09-15T23:19:39.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.702+0000 7f063e7fc640 1 --2- 172.21.15.123:0/563558490 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06400731e0 0x7f064006bc10 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f0640070870 tx=0x7f062802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83846af9c706eb11 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:39.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.703+0000 7f063dffb640 1 -- 172.21.15.123:0/563558490 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0628037070 con 0x7f06400731e0 2024-09-15T23:19:39.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.703+0000 7f063dffb640 1 -- 172.21.15.123:0/563558490 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0628032440 con 0x7f06400731e0 2024-09-15T23:19:39.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.703+0000 7f063dffb640 1 -- 172.21.15.123:0/563558490 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0628032810 con 0x7f06400731e0 2024-09-15T23:19:39.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.703+0000 7f0645366640 1 -- 172.21.15.123:0/563558490 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06400731e0 msgr2=0x7f064006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:39.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.703+0000 7f0645366640 1 --2- 172.21.15.123:0/563558490 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06400731e0 0x7f064006bc10 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f0640070870 tx=0x7f062802a270 comp rx=0 tx=0).stop 2024-09-15T23:19:39.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.703+0000 7f0645366640 1 -- 172.21.15.123:0/563558490 shutdown_connections 2024-09-15T23:19:39.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.703+0000 7f0645366640 1 --2- 172.21.15.123:0/563558490 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06400731e0 0x7f064006bc10 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:39.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.703+0000 7f0645366640 1 --2- 172.21.15.123:0/563558490 >> v2:172.21.15.188:3300/0 conn(0x7f0640148090 0x7f06400ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:39.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.703+0000 7f0645366640 1 -- 172.21.15.123:0/563558490 >> 172.21.15.123:0/563558490 conn(0x7f064006cd20 msgr2=0x7f064006d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:39.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.703+0000 7f0645366640 1 -- 172.21.15.123:0/563558490 shutdown_connections 2024-09-15T23:19:39.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.703+0000 7f0645366640 1 -- 172.21.15.123:0/563558490 wait complete. 2024-09-15T23:19:39.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.704+0000 7f0645366640 1 Processor -- start 2024-09-15T23:19:39.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.704+0000 7f0645366640 1 -- start start 2024-09-15T23:19:39.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.705+0000 7f0645366640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f064006c150 0x7f06401409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:39.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.705+0000 7f0645366640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f06400731e0 0x7f064013ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:39.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.705+0000 7f0645366640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0640148090 0x7f0640142eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:39.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.705+0000 7f0645366640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f06400b5580 con 0x7f0640148090 2024-09-15T23:19:39.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.705+0000 7f0645366640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0640148470 con 0x7f06400731e0 2024-09-15T23:19:39.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.705+0000 7f0645366640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f06400af1e0 con 0x7f064006c150 2024-09-15T23:19:39.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.705+0000 7f063f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0640148090 0x7f0640142eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:39.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.705+0000 7f063f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0640148090 0x7f0640142eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49896/0 (socket says 172.21.15.123:49896) 2024-09-15T23:19:39.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.705+0000 7f063f7fe640 1 -- 172.21.15.123:0/1313719935 learned_addr learned my addr 172.21.15.123:0/1313719935 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:39.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.706+0000 7f063f7fe640 1 -- 172.21.15.123:0/1313719935 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f064006c150 msgr2=0x7f06401409d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:39.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.706+0000 7f063e7fc640 1 --2- 172.21.15.123:0/1313719935 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f06400731e0 0x7f064013ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:39.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.706+0000 7f063f7fe640 1 --2- 172.21.15.123:0/1313719935 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f064006c150 0x7f06401409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:39.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.706+0000 7f063f7fe640 1 -- 172.21.15.123:0/1313719935 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f06400731e0 msgr2=0x7f064013ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:39.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.706+0000 7f063f7fe640 1 --2- 172.21.15.123:0/1313719935 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f06400731e0 0x7f064013ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:39.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.706+0000 7f063f7fe640 1 -- 172.21.15.123:0/1313719935 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0640141e50 con 0x7f0640148090 2024-09-15T23:19:39.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.706+0000 7f063f7fe640 1 --2- 172.21.15.123:0/1313719935 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0640148090 0x7f0640142eb0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f063800c390 tx=0x7f063800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:39.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.706+0000 7f06377fe640 1 -- 172.21.15.123:0/1313719935 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0638017070 con 0x7f0640148090 2024-09-15T23:19:39.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.706+0000 7f06377fe640 1 -- 172.21.15.123:0/1313719935 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06380052d0 con 0x7f0640148090 2024-09-15T23:19:39.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.706+0000 7f06377fe640 1 -- 172.21.15.123:0/1313719935 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0638003810 con 0x7f0640148090 2024-09-15T23:19:39.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.706+0000 7f0645366640 1 -- 172.21.15.123:0/1313719935 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06401420f0 con 0x7f0640148090 2024-09-15T23:19:39.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.706+0000 7f0645366640 1 -- 172.21.15.123:0/1313719935 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06401426b0 con 0x7f0640148090 2024-09-15T23:19:39.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.707+0000 7f0645366640 1 -- 172.21.15.123:0/1313719935 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06400b2c90 con 0x7f0640148090 2024-09-15T23:19:39.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.707+0000 7f06377fe640 1 -- 172.21.15.123:0/1313719935 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f063801a070 con 0x7f0640148090 2024-09-15T23:19:39.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.708+0000 7f06377fe640 1 --2- 172.21.15.123:0/1313719935 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f062006c2b0 0x7f062006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:39.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.708+0000 7f06377fe640 1 -- 172.21.15.123:0/1313719935 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f063808a6a0 con 0x7f0640148090 2024-09-15T23:19:39.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.708+0000 7f063effd640 1 --2- 172.21.15.123:0/1313719935 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f062006c2b0 0x7f062006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:39.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.709+0000 7f063effd640 1 --2- 172.21.15.123:0/1313719935 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f062006c2b0 0x7f062006e770 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f06300070b0 tx=0x7f0630007040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:39.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.712+0000 7f06377fe640 1 -- 172.21.15.123:0/1313719935 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f06400b2c90 con 0x7f0640148090 2024-09-15T23:19:39.805 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:19:39.807 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:19:39.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.877+0000 7f0645366640 1 -- 172.21.15.123:0/1313719935 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f06400b6100 con 0x7f062006c2b0 2024-09-15T23:19:39.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.883+0000 7f06377fe640 1 -- 172.21.15.123:0/1313719935 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252448 (secure 0 0 0) 0x7f06400b6100 con 0x7f062006c2b0 2024-09-15T23:19:39.885 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:19:39.889 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:19:39.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.887+0000 7f0645366640 1 -- 172.21.15.123:0/1313719935 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f062006c2b0 msgr2=0x7f062006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:39.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.887+0000 7f0645366640 1 --2- 172.21.15.123:0/1313719935 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f062006c2b0 0x7f062006e770 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f06300070b0 tx=0x7f0630007040 comp rx=0 tx=0).stop 2024-09-15T23:19:39.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.887+0000 7f0645366640 1 -- 172.21.15.123:0/1313719935 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0640148090 msgr2=0x7f0640142eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:39.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.887+0000 7f0645366640 1 --2- 172.21.15.123:0/1313719935 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0640148090 0x7f0640142eb0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f063800c390 tx=0x7f063800c850 comp rx=0 tx=0).stop 2024-09-15T23:19:39.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.887+0000 7f0645366640 1 -- 172.21.15.123:0/1313719935 shutdown_connections 2024-09-15T23:19:39.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.887+0000 7f0645366640 1 --2- 172.21.15.123:0/1313719935 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f062006c2b0 0x7f062006e770 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:39.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.887+0000 7f0645366640 1 --2- 172.21.15.123:0/1313719935 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0640148090 0x7f0640142eb0 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:39.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.887+0000 7f0645366640 1 --2- 172.21.15.123:0/1313719935 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f06400731e0 0x7f064013ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:39.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.887+0000 7f0645366640 1 --2- 172.21.15.123:0/1313719935 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f064006c150 0x7f06401409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:39.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.887+0000 7f0645366640 1 -- 172.21.15.123:0/1313719935 >> 172.21.15.123:0/1313719935 conn(0x7f064006cd20 msgr2=0x7f06400b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:39.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.887+0000 7f0645366640 1 -- 172.21.15.123:0/1313719935 shutdown_connections 2024-09-15T23:19:39.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:39.887+0000 7f0645366640 1 -- 172.21.15.123:0/1313719935 wait complete. 2024-09-15T23:19:39.898 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":364,"stamp":"2024-09-15T23:19:39.609643+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":393524,"kb_used_data":14904,"kb_used_omap":12,"kb_used_meta":378419,"kb_avail":754581196,"statfs":{"total":773094113280,"available":772691144704,"internally_reserved":0,"allocated":15261696,"data_stored":7374532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":387501616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001236"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.632688+0000","last_change":"2024-09-15T23:19:35.630018+0000","last_active":"2024-09-15T23:19:35.632688+0000","last_peered":"2024-09-15T23:19:35.632688+0000","last_clean":"2024-09-15T23:19:35.632688+0000","last_became_active":"2024-09-15T23:19:35.628099+0000","last_became_peered":"2024-09-15T23:19:35.628099+0000","last_unstale":"2024-09-15T23:19:35.632688+0000","last_undegraded":"2024-09-15T23:19:35.632688+0000","last_fullsized":"2024-09-15T23:19:35.632688+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:56:00.379260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.630794+0000","last_change":"2024-09-15T23:19:35.628850+0000","last_active":"2024-09-15T23:19:35.630794+0000","last_peered":"2024-09-15T23:19:35.630794+0000","last_clean":"2024-09-15T23:19:35.630794+0000","last_became_active":"2024-09-15T23:19:35.628420+0000","last_became_peered":"2024-09-15T23:19:35.628420+0000","last_unstale":"2024-09-15T23:19:35.630794+0000","last_undegraded":"2024-09-15T23:19:35.630794+0000","last_fullsized":"2024-09-15T23:19:35.630794+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:49.534165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.706881+0000","last_change":"2024-09-15T23:19:35.615570+0000","last_active":"2024-09-15T23:19:37.706881+0000","last_peered":"2024-09-15T23:19:37.706881+0000","last_clean":"2024-09-15T23:19:37.706881+0000","last_became_active":"2024-09-15T23:19:35.615221+0000","last_became_peered":"2024-09-15T23:19:35.615221+0000","last_unstale":"2024-09-15T23:19:37.706881+0000","last_undegraded":"2024-09-15T23:19:37.706881+0000","last_fullsized":"2024-09-15T23:19:37.706881+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:23.896721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.627713+0000","last_change":"2024-09-15T23:19:35.626458+0000","last_active":"2024-09-15T23:19:35.627713+0000","last_peered":"2024-09-15T23:19:35.627713+0000","last_clean":"2024-09-15T23:19:35.627713+0000","last_became_active":"2024-09-15T23:19:35.626142+0000","last_became_peered":"2024-09-15T23:19:35.626142+0000","last_unstale":"2024-09-15T23:19:35.627713+0000","last_undegraded":"2024-09-15T23:19:35.627713+0000","last_fullsized":"2024-09-15T23:19:35.627713+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:12.987698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.631000+0000","last_change":"2024-09-15T23:19:35.618318+0000","last_active":"2024-09-15T23:19:36.631000+0000","last_peered":"2024-09-15T23:19:36.631000+0000","last_clean":"2024-09-15T23:19:36.631000+0000","last_became_active":"2024-09-15T23:19:35.618051+0000","last_became_peered":"2024-09-15T23:19:35.618051+0000","last_unstale":"2024-09-15T23:19:36.631000+0000","last_undegraded":"2024-09-15T23:19:36.631000+0000","last_fullsized":"2024-09-15T23:19:36.631000+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:19:00.741563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.632898+0000","last_change":"2024-09-15T23:19:35.628369+0000","last_active":"2024-09-15T23:19:36.632898+0000","last_peered":"2024-09-15T23:19:36.632898+0000","last_clean":"2024-09-15T23:19:36.632898+0000","last_became_active":"2024-09-15T23:19:35.628103+0000","last_became_peered":"2024-09-15T23:19:35.628103+0000","last_unstale":"2024-09-15T23:19:36.632898+0000","last_undegraded":"2024-09-15T23:19:36.632898+0000","last_fullsized":"2024-09-15T23:19:36.632898+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:08:31.732979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.631039+0000","last_change":"2024-09-15T23:19:35.619484+0000","last_active":"2024-09-15T23:19:36.631039+0000","last_peered":"2024-09-15T23:19:36.631039+0000","last_clean":"2024-09-15T23:19:36.631039+0000","last_became_active":"2024-09-15T23:19:35.619144+0000","last_became_peered":"2024-09-15T23:19:35.619144+0000","last_unstale":"2024-09-15T23:19:36.631039+0000","last_undegraded":"2024-09-15T23:19:36.631039+0000","last_fullsized":"2024-09-15T23:19:36.631039+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:43:35.449575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.630894+0000","last_change":"2024-09-15T23:19:35.632466+0000","last_active":"2024-09-15T23:19:36.630894+0000","last_peered":"2024-09-15T23:19:36.630894+0000","last_clean":"2024-09-15T23:19:36.630894+0000","last_became_active":"2024-09-15T23:19:35.632177+0000","last_became_peered":"2024-09-15T23:19:35.632177+0000","last_unstale":"2024-09-15T23:19:36.630894+0000","last_undegraded":"2024-09-15T23:19:36.630894+0000","last_fullsized":"2024-09-15T23:19:36.630894+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:55:19.532616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.706924+0000","last_change":"2024-09-15T23:19:35.614309+0000","last_active":"2024-09-15T23:19:37.706924+0000","last_peered":"2024-09-15T23:19:37.706924+0000","last_clean":"2024-09-15T23:19:37.706924+0000","last_became_active":"2024-09-15T23:19:35.614063+0000","last_became_peered":"2024-09-15T23:19:35.614063+0000","last_unstale":"2024-09-15T23:19:37.706924+0000","last_undegraded":"2024-09-15T23:19:37.706924+0000","last_fullsized":"2024-09-15T23:19:37.706924+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:49.709600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.631096+0000","last_change":"2024-09-15T23:19:35.629074+0000","last_active":"2024-09-15T23:19:35.631096+0000","last_peered":"2024-09-15T23:19:35.631096+0000","last_clean":"2024-09-15T23:19:35.631096+0000","last_became_active":"2024-09-15T23:19:35.628048+0000","last_became_peered":"2024-09-15T23:19:35.628048+0000","last_unstale":"2024-09-15T23:19:35.631096+0000","last_undegraded":"2024-09-15T23:19:35.631096+0000","last_fullsized":"2024-09-15T23:19:35.631096+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:29:55.927749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.631661+0000","last_change":"2024-09-15T23:19:35.629980+0000","last_active":"2024-09-15T23:19:35.631661+0000","last_peered":"2024-09-15T23:19:35.631661+0000","last_clean":"2024-09-15T23:19:35.631661+0000","last_became_active":"2024-09-15T23:19:35.629187+0000","last_became_peered":"2024-09-15T23:19:35.629187+0000","last_unstale":"2024-09-15T23:19:35.631661+0000","last_undegraded":"2024-09-15T23:19:35.631661+0000","last_fullsized":"2024-09-15T23:19:35.631661+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:33.561412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.633043+0000","last_change":"2024-09-15T23:19:35.610006+0000","last_active":"2024-09-15T23:19:36.633043+0000","last_peered":"2024-09-15T23:19:36.633043+0000","last_clean":"2024-09-15T23:19:36.633043+0000","last_became_active":"2024-09-15T23:19:35.609734+0000","last_became_peered":"2024-09-15T23:19:35.609734+0000","last_unstale":"2024-09-15T23:19:36.633043+0000","last_undegraded":"2024-09-15T23:19:36.633043+0000","last_fullsized":"2024-09-15T23:19:36.633043+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:09.429395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.633625+0000","last_change":"2024-09-15T23:19:35.631492+0000","last_active":"2024-09-15T23:19:35.633625+0000","last_peered":"2024-09-15T23:19:35.633625+0000","last_clean":"2024-09-15T23:19:35.633625+0000","last_became_active":"2024-09-15T23:19:35.631227+0000","last_became_peered":"2024-09-15T23:19:35.631227+0000","last_unstale":"2024-09-15T23:19:35.633625+0000","last_undegraded":"2024-09-15T23:19:35.633625+0000","last_fullsized":"2024-09-15T23:19:35.633625+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:38:34.100919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.630844+0000","last_change":"2024-09-15T23:19:35.625592+0000","last_active":"2024-09-15T23:19:35.630844+0000","last_peered":"2024-09-15T23:19:35.630844+0000","last_clean":"2024-09-15T23:19:35.630844+0000","last_became_active":"2024-09-15T23:19:35.625301+0000","last_became_peered":"2024-09-15T23:19:35.625301+0000","last_unstale":"2024-09-15T23:19:35.630844+0000","last_undegraded":"2024-09-15T23:19:35.630844+0000","last_fullsized":"2024-09-15T23:19:35.630844+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:42.228647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.624457+0000","last_change":"2024-09-15T23:19:35.622364+0000","last_active":"2024-09-15T23:19:35.624457+0000","last_peered":"2024-09-15T23:19:35.624457+0000","last_clean":"2024-09-15T23:19:35.624457+0000","last_became_active":"2024-09-15T23:19:35.622088+0000","last_became_peered":"2024-09-15T23:19:35.622088+0000","last_unstale":"2024-09-15T23:19:35.624457+0000","last_undegraded":"2024-09-15T23:19:35.624457+0000","last_fullsized":"2024-09-15T23:19:35.624457+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:19:32.637779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.633024+0000","last_change":"2024-09-15T23:19:35.626083+0000","last_active":"2024-09-15T23:19:35.633024+0000","last_peered":"2024-09-15T23:19:35.633024+0000","last_clean":"2024-09-15T23:19:35.633024+0000","last_became_active":"2024-09-15T23:19:35.625794+0000","last_became_peered":"2024-09-15T23:19:35.625794+0000","last_unstale":"2024-09-15T23:19:35.633024+0000","last_undegraded":"2024-09-15T23:19:35.633024+0000","last_fullsized":"2024-09-15T23:19:35.633024+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:34.277310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.707029+0000","last_change":"2024-09-15T23:19:35.628990+0000","last_active":"2024-09-15T23:19:37.707029+0000","last_peered":"2024-09-15T23:19:37.707029+0000","last_clean":"2024-09-15T23:19:37.707029+0000","last_became_active":"2024-09-15T23:19:35.628646+0000","last_became_peered":"2024-09-15T23:19:35.628646+0000","last_unstale":"2024-09-15T23:19:37.707029+0000","last_undegraded":"2024-09-15T23:19:37.707029+0000","last_fullsized":"2024-09-15T23:19:37.707029+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:06:03.662589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.621259+0000","last_change":"2024-09-15T23:19:35.616254+0000","last_active":"2024-09-15T23:19:35.621259+0000","last_peered":"2024-09-15T23:19:35.621259+0000","last_clean":"2024-09-15T23:19:35.621259+0000","last_became_active":"2024-09-15T23:19:35.615915+0000","last_became_peered":"2024-09-15T23:19:35.615915+0000","last_unstale":"2024-09-15T23:19:35.621259+0000","last_undegraded":"2024-09-15T23:19:35.621259+0000","last_fullsized":"2024-09-15T23:19:35.621259+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:44.666059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.631130+0000","last_change":"2024-09-15T23:19:35.629558+0000","last_active":"2024-09-15T23:19:35.631130+0000","last_peered":"2024-09-15T23:19:35.631130+0000","last_clean":"2024-09-15T23:19:35.631130+0000","last_became_active":"2024-09-15T23:19:35.629253+0000","last_became_peered":"2024-09-15T23:19:35.629253+0000","last_unstale":"2024-09-15T23:19:35.631130+0000","last_undegraded":"2024-09-15T23:19:35.631130+0000","last_fullsized":"2024-09-15T23:19:35.631130+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:20.453779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.630232+0000","last_change":"2024-09-15T23:19:35.628077+0000","last_active":"2024-09-15T23:19:35.630232+0000","last_peered":"2024-09-15T23:19:35.630232+0000","last_clean":"2024-09-15T23:19:35.630232+0000","last_became_active":"2024-09-15T23:19:35.627761+0000","last_became_peered":"2024-09-15T23:19:35.627761+0000","last_unstale":"2024-09-15T23:19:35.630232+0000","last_undegraded":"2024-09-15T23:19:35.630232+0000","last_fullsized":"2024-09-15T23:19:35.630232+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:56:54.736459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.632984+0000","last_change":"2024-09-15T23:19:35.618758+0000","last_active":"2024-09-15T23:19:36.632984+0000","last_peered":"2024-09-15T23:19:36.632984+0000","last_clean":"2024-09-15T23:19:36.632984+0000","last_became_active":"2024-09-15T23:19:35.618500+0000","last_became_peered":"2024-09-15T23:19:35.618500+0000","last_unstale":"2024-09-15T23:19:36.632984+0000","last_undegraded":"2024-09-15T23:19:36.632984+0000","last_fullsized":"2024-09-15T23:19:36.632984+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:42.228647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.638083+0000","last_change":"2024-09-15T23:19:35.634903+0000","last_active":"2024-09-15T23:19:35.638083+0000","last_peered":"2024-09-15T23:19:35.638083+0000","last_clean":"2024-09-15T23:19:35.638083+0000","last_became_active":"2024-09-15T23:19:35.634630+0000","last_became_peered":"2024-09-15T23:19:35.634630+0000","last_unstale":"2024-09-15T23:19:35.638083+0000","last_undegraded":"2024-09-15T23:19:35.638083+0000","last_fullsized":"2024-09-15T23:19:35.638083+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:53.869099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.607937+0000","last_change":"2024-09-15T23:19:35.619635+0000","last_active":"2024-09-15T23:19:36.607937+0000","last_peered":"2024-09-15T23:19:36.607937+0000","last_clean":"2024-09-15T23:19:36.607937+0000","last_became_active":"2024-09-15T23:19:35.619376+0000","last_became_peered":"2024-09-15T23:19:35.619376+0000","last_unstale":"2024-09-15T23:19:36.607937+0000","last_undegraded":"2024-09-15T23:19:36.607937+0000","last_fullsized":"2024-09-15T23:19:36.607937+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:58.694262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.620749+0000","last_change":"2024-09-15T23:19:35.615995+0000","last_active":"2024-09-15T23:19:35.620749+0000","last_peered":"2024-09-15T23:19:35.620749+0000","last_clean":"2024-09-15T23:19:35.620749+0000","last_became_active":"2024-09-15T23:19:35.615631+0000","last_became_peered":"2024-09-15T23:19:35.615631+0000","last_unstale":"2024-09-15T23:19:35.620749+0000","last_undegraded":"2024-09-15T23:19:35.620749+0000","last_fullsized":"2024-09-15T23:19:35.620749+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:25.327208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.634312+0000","last_change":"2024-09-15T23:19:35.632719+0000","last_active":"2024-09-15T23:19:35.634312+0000","last_peered":"2024-09-15T23:19:35.634312+0000","last_clean":"2024-09-15T23:19:35.634312+0000","last_became_active":"2024-09-15T23:19:35.632449+0000","last_became_peered":"2024-09-15T23:19:35.632449+0000","last_unstale":"2024-09-15T23:19:35.634312+0000","last_undegraded":"2024-09-15T23:19:35.634312+0000","last_fullsized":"2024-09-15T23:19:35.634312+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:10:40.600923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.640407+0000","last_change":"2024-09-15T23:19:35.639447+0000","last_active":"2024-09-15T23:19:35.640407+0000","last_peered":"2024-09-15T23:19:35.640407+0000","last_clean":"2024-09-15T23:19:35.640407+0000","last_became_active":"2024-09-15T23:19:35.639003+0000","last_became_peered":"2024-09-15T23:19:35.639003+0000","last_unstale":"2024-09-15T23:19:35.640407+0000","last_undegraded":"2024-09-15T23:19:35.640407+0000","last_fullsized":"2024-09-15T23:19:35.640407+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:33:35.905302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.632922+0000","last_change":"2024-09-15T23:19:35.625964+0000","last_active":"2024-09-15T23:19:35.632922+0000","last_peered":"2024-09-15T23:19:35.632922+0000","last_clean":"2024-09-15T23:19:35.632922+0000","last_became_active":"2024-09-15T23:19:35.625432+0000","last_became_peered":"2024-09-15T23:19:35.625432+0000","last_unstale":"2024-09-15T23:19:35.632922+0000","last_undegraded":"2024-09-15T23:19:35.632922+0000","last_fullsized":"2024-09-15T23:19:35.632922+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:23.656736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.608013+0000","last_change":"2024-09-15T23:19:35.626550+0000","last_active":"2024-09-15T23:19:36.608013+0000","last_peered":"2024-09-15T23:19:36.608013+0000","last_clean":"2024-09-15T23:19:36.608013+0000","last_became_active":"2024-09-15T23:19:35.626223+0000","last_became_peered":"2024-09-15T23:19:35.626223+0000","last_unstale":"2024-09-15T23:19:36.608013+0000","last_undegraded":"2024-09-15T23:19:36.608013+0000","last_fullsized":"2024-09-15T23:19:36.608013+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:25.327208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.638008+0000","last_change":"2024-09-15T23:19:35.635024+0000","last_active":"2024-09-15T23:19:35.638008+0000","last_peered":"2024-09-15T23:19:35.638008+0000","last_clean":"2024-09-15T23:19:35.638008+0000","last_became_active":"2024-09-15T23:19:35.634125+0000","last_became_peered":"2024-09-15T23:19:35.634125+0000","last_unstale":"2024-09-15T23:19:35.638008+0000","last_undegraded":"2024-09-15T23:19:35.638008+0000","last_fullsized":"2024-09-15T23:19:35.638008+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:20:31.356089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.630400+0000","last_change":"2024-09-15T23:19:35.627210+0000","last_active":"2024-09-15T23:19:35.630400+0000","last_peered":"2024-09-15T23:19:35.630400+0000","last_clean":"2024-09-15T23:19:35.630400+0000","last_became_active":"2024-09-15T23:19:35.626865+0000","last_became_peered":"2024-09-15T23:19:35.626865+0000","last_unstale":"2024-09-15T23:19:35.630400+0000","last_undegraded":"2024-09-15T23:19:35.630400+0000","last_fullsized":"2024-09-15T23:19:35.630400+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:10:40.600923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.608006+0000","last_change":"2024-09-15T23:19:35.612665+0000","last_active":"2024-09-15T23:19:36.608006+0000","last_peered":"2024-09-15T23:19:36.608006+0000","last_clean":"2024-09-15T23:19:36.608006+0000","last_became_active":"2024-09-15T23:19:35.612378+0000","last_became_peered":"2024-09-15T23:19:35.612378+0000","last_unstale":"2024-09-15T23:19:36.608006+0000","last_undegraded":"2024-09-15T23:19:36.608006+0000","last_fullsized":"2024-09-15T23:19:36.608006+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:25.497397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.706699+0000","last_change":"2024-09-15T23:19:35.628263+0000","last_active":"2024-09-15T23:19:37.706699+0000","last_peered":"2024-09-15T23:19:37.706699+0000","last_clean":"2024-09-15T23:19:37.706699+0000","last_became_active":"2024-09-15T23:19:35.628003+0000","last_became_peered":"2024-09-15T23:19:35.628003+0000","last_unstale":"2024-09-15T23:19:37.706699+0000","last_undegraded":"2024-09-15T23:19:37.706699+0000","last_fullsized":"2024-09-15T23:19:37.706699+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:33.405346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.632958+0000","last_change":"2024-09-15T23:19:35.626009+0000","last_active":"2024-09-15T23:19:35.632958+0000","last_peered":"2024-09-15T23:19:35.632958+0000","last_clean":"2024-09-15T23:19:35.632958+0000","last_became_active":"2024-09-15T23:19:35.625557+0000","last_became_peered":"2024-09-15T23:19:35.625557+0000","last_unstale":"2024-09-15T23:19:35.632958+0000","last_undegraded":"2024-09-15T23:19:35.632958+0000","last_fullsized":"2024-09-15T23:19:35.632958+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:09.429395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1f","version":"141'4","reported_seq":18,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.631257+0000","last_change":"2024-09-15T23:19:34.596627+0000","last_active":"2024-09-15T23:19:36.631257+0000","last_peered":"2024-09-15T23:19:36.631257+0000","last_clean":"2024-09-15T23:19:36.631257+0000","last_became_active":"2024-09-15T23:19:34.595982+0000","last_became_peered":"2024-09-15T23:19:34.595982+0000","last_unstale":"2024-09-15T23:19:36.631257+0000","last_undegraded":"2024-09-15T23:19:36.631257+0000","last_fullsized":"2024-09-15T23:19:36.631257+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:50.862136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.706917+0000","last_change":"2024-09-15T23:19:35.629327+0000","last_active":"2024-09-15T23:19:37.706917+0000","last_peered":"2024-09-15T23:19:37.706917+0000","last_clean":"2024-09-15T23:19:37.706917+0000","last_became_active":"2024-09-15T23:19:35.628984+0000","last_became_peered":"2024-09-15T23:19:35.628984+0000","last_unstale":"2024-09-15T23:19:37.706917+0000","last_undegraded":"2024-09-15T23:19:37.706917+0000","last_fullsized":"2024-09-15T23:19:37.706917+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:48.683758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1e","version":"141'1","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.706921+0000","last_change":"2024-09-15T23:19:34.594991+0000","last_active":"2024-09-15T23:19:37.706921+0000","last_peered":"2024-09-15T23:19:37.706921+0000","last_clean":"2024-09-15T23:19:37.706921+0000","last_became_active":"2024-09-15T23:19:34.594713+0000","last_became_peered":"2024-09-15T23:19:34.594713+0000","last_unstale":"2024-09-15T23:19:37.706921+0000","last_undegraded":"2024-09-15T23:19:37.706921+0000","last_fullsized":"2024-09-15T23:19:37.706921+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:05.421984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.706757+0000","last_change":"2024-09-15T23:19:35.616170+0000","last_active":"2024-09-15T23:19:37.706757+0000","last_peered":"2024-09-15T23:19:37.706757+0000","last_clean":"2024-09-15T23:19:37.706757+0000","last_became_active":"2024-09-15T23:19:35.615935+0000","last_became_peered":"2024-09-15T23:19:35.615935+0000","last_unstale":"2024-09-15T23:19:37.706757+0000","last_undegraded":"2024-09-15T23:19:37.706757+0000","last_fullsized":"2024-09-15T23:19:37.706757+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:57:39.829586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1d","version":"141'2","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.640962+0000","last_change":"2024-09-15T23:19:34.591811+0000","last_active":"2024-09-15T23:19:35.640962+0000","last_peered":"2024-09-15T23:19:35.640962+0000","last_clean":"2024-09-15T23:19:35.640962+0000","last_became_active":"2024-09-15T23:19:34.590764+0000","last_became_peered":"2024-09-15T23:19:34.590764+0000","last_unstale":"2024-09-15T23:19:35.640962+0000","last_undegraded":"2024-09-15T23:19:35.640962+0000","last_fullsized":"2024-09-15T23:19:35.640962+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:15:04.941661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.633258+0000","last_change":"2024-09-15T23:19:35.626587+0000","last_active":"2024-09-15T23:19:36.633258+0000","last_peered":"2024-09-15T23:19:36.633258+0000","last_clean":"2024-09-15T23:19:36.633258+0000","last_became_active":"2024-09-15T23:19:35.626234+0000","last_became_peered":"2024-09-15T23:19:35.626234+0000","last_unstale":"2024-09-15T23:19:36.633258+0000","last_undegraded":"2024-09-15T23:19:36.633258+0000","last_fullsized":"2024-09-15T23:19:36.633258+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:34.277310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1c","version":"141'2","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.641207+0000","last_change":"2024-09-15T23:19:34.599647+0000","last_active":"2024-09-15T23:19:35.641207+0000","last_peered":"2024-09-15T23:19:35.641207+0000","last_clean":"2024-09-15T23:19:35.641207+0000","last_became_active":"2024-09-15T23:19:34.599381+0000","last_became_peered":"2024-09-15T23:19:34.599381+0000","last_unstale":"2024-09-15T23:19:35.641207+0000","last_undegraded":"2024-09-15T23:19:35.641207+0000","last_fullsized":"2024-09-15T23:19:35.641207+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:32.559903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.621376+0000","last_change":"2024-09-15T23:19:35.619214+0000","last_active":"2024-09-15T23:19:35.621376+0000","last_peered":"2024-09-15T23:19:35.621376+0000","last_clean":"2024-09-15T23:19:35.621376+0000","last_became_active":"2024-09-15T23:19:35.618944+0000","last_became_peered":"2024-09-15T23:19:35.618944+0000","last_unstale":"2024-09-15T23:19:35.621376+0000","last_undegraded":"2024-09-15T23:19:35.621376+0000","last_fullsized":"2024-09-15T23:19:35.621376+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:55:50.700598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1b","version":"141'1","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.640220+0000","last_change":"2024-09-15T23:19:34.596580+0000","last_active":"2024-09-15T23:19:35.640220+0000","last_peered":"2024-09-15T23:19:35.640220+0000","last_clean":"2024-09-15T23:19:35.640220+0000","last_became_active":"2024-09-15T23:19:34.596299+0000","last_became_peered":"2024-09-15T23:19:34.596299+0000","last_unstale":"2024-09-15T23:19:35.640220+0000","last_undegraded":"2024-09-15T23:19:35.640220+0000","last_fullsized":"2024-09-15T23:19:35.640220+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:00.747606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.632987+0000","last_change":"2024-09-15T23:19:35.631523+0000","last_active":"2024-09-15T23:19:36.632987+0000","last_peered":"2024-09-15T23:19:36.632987+0000","last_clean":"2024-09-15T23:19:36.632987+0000","last_became_active":"2024-09-15T23:19:35.631206+0000","last_became_peered":"2024-09-15T23:19:35.631206+0000","last_unstale":"2024-09-15T23:19:36.632987+0000","last_undegraded":"2024-09-15T23:19:36.632987+0000","last_fullsized":"2024-09-15T23:19:36.632987+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:23.656736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"141'1","reported_seq":13,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.640113+0000","last_change":"2024-09-15T23:19:34.596781+0000","last_active":"2024-09-15T23:19:35.640113+0000","last_peered":"2024-09-15T23:19:35.640113+0000","last_clean":"2024-09-15T23:19:35.640113+0000","last_became_active":"2024-09-15T23:19:34.594440+0000","last_became_peered":"2024-09-15T23:19:34.594440+0000","last_unstale":"2024-09-15T23:19:35.640113+0000","last_undegraded":"2024-09-15T23:19:35.640113+0000","last_fullsized":"2024-09-15T23:19:35.640113+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:57.692753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.632811+0000","last_change":"2024-09-15T23:19:35.612299+0000","last_active":"2024-09-15T23:19:36.632811+0000","last_peered":"2024-09-15T23:19:36.632811+0000","last_clean":"2024-09-15T23:19:36.632811+0000","last_became_active":"2024-09-15T23:19:35.609861+0000","last_became_peered":"2024-09-15T23:19:35.609861+0000","last_unstale":"2024-09-15T23:19:36.632811+0000","last_undegraded":"2024-09-15T23:19:36.632811+0000","last_fullsized":"2024-09-15T23:19:36.632811+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:32:15.609252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.706610+0000","last_change":"2024-09-15T23:19:34.594035+0000","last_active":"2024-09-15T23:19:37.706610+0000","last_peered":"2024-09-15T23:19:37.706610+0000","last_clean":"2024-09-15T23:19:37.706610+0000","last_became_active":"2024-09-15T23:19:34.593752+0000","last_became_peered":"2024-09-15T23:19:34.593752+0000","last_unstale":"2024-09-15T23:19:37.706610+0000","last_undegraded":"2024-09-15T23:19:37.706610+0000","last_fullsized":"2024-09-15T23:19:37.706610+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:19:10.504998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.636651+0000","last_change":"2024-09-15T23:19:35.634002+0000","last_active":"2024-09-15T23:19:35.636651+0000","last_peered":"2024-09-15T23:19:35.636651+0000","last_clean":"2024-09-15T23:19:35.636651+0000","last_became_active":"2024-09-15T23:19:35.633706+0000","last_became_peered":"2024-09-15T23:19:35.633706+0000","last_unstale":"2024-09-15T23:19:35.636651+0000","last_undegraded":"2024-09-15T23:19:35.636651+0000","last_fullsized":"2024-09-15T23:19:35.636651+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:55:04.513205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.624244+0000","last_change":"2024-09-15T23:19:34.596861+0000","last_active":"2024-09-15T23:19:35.624244+0000","last_peered":"2024-09-15T23:19:35.624244+0000","last_clean":"2024-09-15T23:19:35.624244+0000","last_became_active":"2024-09-15T23:19:34.596589+0000","last_became_peered":"2024-09-15T23:19:34.596589+0000","last_unstale":"2024-09-15T23:19:35.624244+0000","last_undegraded":"2024-09-15T23:19:35.624244+0000","last_fullsized":"2024-09-15T23:19:35.624244+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:38:33.099410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.636695+0000","last_change":"2024-09-15T23:19:35.634159+0000","last_active":"2024-09-15T23:19:35.636695+0000","last_peered":"2024-09-15T23:19:35.636695+0000","last_clean":"2024-09-15T23:19:35.636695+0000","last_became_active":"2024-09-15T23:19:35.633883+0000","last_became_peered":"2024-09-15T23:19:35.633883+0000","last_unstale":"2024-09-15T23:19:35.636695+0000","last_undegraded":"2024-09-15T23:19:35.636695+0000","last_fullsized":"2024-09-15T23:19:35.636695+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:05:17.623772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.633190+0000","last_change":"2024-09-15T23:19:34.592476+0000","last_active":"2024-09-15T23:19:36.633190+0000","last_peered":"2024-09-15T23:19:36.633190+0000","last_clean":"2024-09-15T23:19:36.633190+0000","last_became_active":"2024-09-15T23:19:34.592187+0000","last_became_peered":"2024-09-15T23:19:34.592187+0000","last_unstale":"2024-09-15T23:19:36.633190+0000","last_undegraded":"2024-09-15T23:19:36.633190+0000","last_fullsized":"2024-09-15T23:19:36.633190+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:13:22.034976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.631205+0000","last_change":"2024-09-15T23:19:35.623362+0000","last_active":"2024-09-15T23:19:36.631205+0000","last_peered":"2024-09-15T23:19:36.631205+0000","last_clean":"2024-09-15T23:19:36.631205+0000","last_became_active":"2024-09-15T23:19:35.623044+0000","last_became_peered":"2024-09-15T23:19:35.623044+0000","last_unstale":"2024-09-15T23:19:36.631205+0000","last_undegraded":"2024-09-15T23:19:36.631205+0000","last_fullsized":"2024-09-15T23:19:36.631205+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:24.858935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.610739+0000","last_change":"2024-09-15T23:19:34.592974+0000","last_active":"2024-09-15T23:19:35.610739+0000","last_peered":"2024-09-15T23:19:35.610739+0000","last_clean":"2024-09-15T23:19:35.610739+0000","last_became_active":"2024-09-15T23:19:34.592445+0000","last_became_peered":"2024-09-15T23:19:34.592445+0000","last_unstale":"2024-09-15T23:19:35.610739+0000","last_undegraded":"2024-09-15T23:19:35.610739+0000","last_fullsized":"2024-09-15T23:19:35.610739+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:30:05.348767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.633279+0000","last_change":"2024-09-15T23:19:35.613109+0000","last_active":"2024-09-15T23:19:36.633279+0000","last_peered":"2024-09-15T23:19:36.633279+0000","last_clean":"2024-09-15T23:19:36.633279+0000","last_became_active":"2024-09-15T23:19:35.612819+0000","last_became_peered":"2024-09-15T23:19:35.612819+0000","last_unstale":"2024-09-15T23:19:36.633279+0000","last_undegraded":"2024-09-15T23:19:36.633279+0000","last_fullsized":"2024-09-15T23:19:36.633279+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:34.865411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.15","version":"141'3","reported_seq":17,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.631146+0000","last_change":"2024-09-15T23:19:34.595183+0000","last_active":"2024-09-15T23:19:36.631146+0000","last_peered":"2024-09-15T23:19:36.631146+0000","last_clean":"2024-09-15T23:19:36.631146+0000","last_became_active":"2024-09-15T23:19:34.594925+0000","last_became_peered":"2024-09-15T23:19:34.594925+0000","last_unstale":"2024-09-15T23:19:36.631146+0000","last_undegraded":"2024-09-15T23:19:36.631146+0000","last_fullsized":"2024-09-15T23:19:36.631146+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:21:17.322177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.608097+0000","last_change":"2024-09-15T23:19:35.611666+0000","last_active":"2024-09-15T23:19:36.608097+0000","last_peered":"2024-09-15T23:19:36.608097+0000","last_clean":"2024-09-15T23:19:36.608097+0000","last_became_active":"2024-09-15T23:19:35.611416+0000","last_became_peered":"2024-09-15T23:19:35.611416+0000","last_unstale":"2024-09-15T23:19:36.608097+0000","last_undegraded":"2024-09-15T23:19:36.608097+0000","last_fullsized":"2024-09-15T23:19:36.608097+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:44.666059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.14","version":"141'6","reported_seq":20,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.608068+0000","last_change":"2024-09-15T23:19:34.587541+0000","last_active":"2024-09-15T23:19:36.608068+0000","last_peered":"2024-09-15T23:19:36.608068+0000","last_clean":"2024-09-15T23:19:36.608068+0000","last_became_active":"2024-09-15T23:19:34.587292+0000","last_became_peered":"2024-09-15T23:19:34.587292+0000","last_unstale":"2024-09-15T23:19:36.608068+0000","last_undegraded":"2024-09-15T23:19:36.608068+0000","last_fullsized":"2024-09-15T23:19:36.608068+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:36.506408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.633199+0000","last_change":"2024-09-15T23:19:35.628636+0000","last_active":"2024-09-15T23:19:35.633199+0000","last_peered":"2024-09-15T23:19:35.633199+0000","last_clean":"2024-09-15T23:19:35.633199+0000","last_became_active":"2024-09-15T23:19:35.628358+0000","last_became_peered":"2024-09-15T23:19:35.628358+0000","last_unstale":"2024-09-15T23:19:35.633199+0000","last_undegraded":"2024-09-15T23:19:35.633199+0000","last_fullsized":"2024-09-15T23:19:35.633199+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:52:45.020431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.617569+0000","last_change":"2024-09-15T23:19:34.595328+0000","last_active":"2024-09-15T23:19:35.617569+0000","last_peered":"2024-09-15T23:19:35.617569+0000","last_clean":"2024-09-15T23:19:35.617569+0000","last_became_active":"2024-09-15T23:19:34.595049+0000","last_became_peered":"2024-09-15T23:19:34.595049+0000","last_unstale":"2024-09-15T23:19:35.617569+0000","last_undegraded":"2024-09-15T23:19:35.617569+0000","last_fullsized":"2024-09-15T23:19:35.617569+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:32:14.607742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.633051+0000","last_change":"2024-09-15T23:19:35.626673+0000","last_active":"2024-09-15T23:19:35.633051+0000","last_peered":"2024-09-15T23:19:35.633051+0000","last_clean":"2024-09-15T23:19:35.633051+0000","last_became_active":"2024-09-15T23:19:35.626396+0000","last_became_peered":"2024-09-15T23:19:35.626396+0000","last_unstale":"2024-09-15T23:19:35.633051+0000","last_undegraded":"2024-09-15T23:19:35.633051+0000","last_fullsized":"2024-09-15T23:19:35.633051+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:34.865411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.617083+0000","last_change":"2024-09-15T23:19:34.591104+0000","last_active":"2024-09-15T23:19:35.617083+0000","last_peered":"2024-09-15T23:19:35.617083+0000","last_clean":"2024-09-15T23:19:35.617083+0000","last_became_active":"2024-09-15T23:19:34.590768+0000","last_became_peered":"2024-09-15T23:19:34.590768+0000","last_unstale":"2024-09-15T23:19:35.617083+0000","last_undegraded":"2024-09-15T23:19:35.617083+0000","last_fullsized":"2024-09-15T23:19:35.617083+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:32:36.307046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.632844+0000","last_change":"2024-09-15T23:19:35.610315+0000","last_active":"2024-09-15T23:19:36.632844+0000","last_peered":"2024-09-15T23:19:36.632844+0000","last_clean":"2024-09-15T23:19:36.632844+0000","last_became_active":"2024-09-15T23:19:35.610066+0000","last_became_peered":"2024-09-15T23:19:35.610066+0000","last_unstale":"2024-09-15T23:19:36.632844+0000","last_undegraded":"2024-09-15T23:19:36.632844+0000","last_fullsized":"2024-09-15T23:19:36.632844+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:16:17.312149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.10","version":"141'8","reported_seq":22,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.632755+0000","last_change":"2024-09-15T23:19:34.596238+0000","last_active":"2024-09-15T23:19:36.632755+0000","last_peered":"2024-09-15T23:19:36.632755+0000","last_clean":"2024-09-15T23:19:36.632755+0000","last_became_active":"2024-09-15T23:19:34.596003+0000","last_became_peered":"2024-09-15T23:19:34.596003+0000","last_unstale":"2024-09-15T23:19:36.632755+0000","last_undegraded":"2024-09-15T23:19:36.632755+0000","last_fullsized":"2024-09-15T23:19:36.632755+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:35:03.904979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.631167+0000","last_change":"2024-09-15T23:19:35.627429+0000","last_active":"2024-09-15T23:19:36.631167+0000","last_peered":"2024-09-15T23:19:36.631167+0000","last_clean":"2024-09-15T23:19:36.631167+0000","last_became_active":"2024-09-15T23:19:35.626804+0000","last_became_peered":"2024-09-15T23:19:35.626804+0000","last_unstale":"2024-09-15T23:19:36.631167+0000","last_undegraded":"2024-09-15T23:19:36.631167+0000","last_fullsized":"2024-09-15T23:19:36.631167+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:27:56.286543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.f","version":"141'1","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.633238+0000","last_change":"2024-09-15T23:19:34.588416+0000","last_active":"2024-09-15T23:19:36.633238+0000","last_peered":"2024-09-15T23:19:36.633238+0000","last_clean":"2024-09-15T23:19:36.633238+0000","last_became_active":"2024-09-15T23:19:34.588163+0000","last_became_peered":"2024-09-15T23:19:34.588163+0000","last_unstale":"2024-09-15T23:19:36.633238+0000","last_undegraded":"2024-09-15T23:19:36.633238+0000","last_fullsized":"2024-09-15T23:19:36.633238+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:50.862136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.631244+0000","last_change":"2024-09-15T23:19:35.627431+0000","last_active":"2024-09-15T23:19:36.631244+0000","last_peered":"2024-09-15T23:19:36.631244+0000","last_clean":"2024-09-15T23:19:36.631244+0000","last_became_active":"2024-09-15T23:19:35.627154+0000","last_became_peered":"2024-09-15T23:19:35.627154+0000","last_unstale":"2024-09-15T23:19:36.631244+0000","last_undegraded":"2024-09-15T23:19:36.631244+0000","last_fullsized":"2024-09-15T23:19:36.631244+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:07.222960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"141'2","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.640172+0000","last_change":"2024-09-15T23:19:34.590161+0000","last_active":"2024-09-15T23:19:35.640172+0000","last_peered":"2024-09-15T23:19:35.640172+0000","last_clean":"2024-09-15T23:19:35.640172+0000","last_became_active":"2024-09-15T23:19:34.586613+0000","last_became_peered":"2024-09-15T23:19:34.586613+0000","last_unstale":"2024-09-15T23:19:35.640172+0000","last_undegraded":"2024-09-15T23:19:35.640172+0000","last_fullsized":"2024-09-15T23:19:35.640172+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:15.297166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.634999+0000","last_change":"2024-09-15T23:19:35.632211+0000","last_active":"2024-09-15T23:19:35.634999+0000","last_peered":"2024-09-15T23:19:35.634999+0000","last_clean":"2024-09-15T23:19:35.634999+0000","last_became_active":"2024-09-15T23:19:35.631935+0000","last_became_peered":"2024-09-15T23:19:35.631935+0000","last_unstale":"2024-09-15T23:19:35.634999+0000","last_undegraded":"2024-09-15T23:19:35.634999+0000","last_fullsized":"2024-09-15T23:19:35.634999+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:13:51.251783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.d","version":"141'1","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.706972+0000","last_change":"2024-09-15T23:19:34.596622+0000","last_active":"2024-09-15T23:19:37.706972+0000","last_peered":"2024-09-15T23:19:37.706972+0000","last_clean":"2024-09-15T23:19:37.706972+0000","last_became_active":"2024-09-15T23:19:34.596380+0000","last_became_peered":"2024-09-15T23:19:34.596380+0000","last_unstale":"2024-09-15T23:19:37.706972+0000","last_undegraded":"2024-09-15T23:19:37.706972+0000","last_fullsized":"2024-09-15T23:19:37.706972+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:04:53.277586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.638294+0000","last_change":"2024-09-15T23:19:35.636401+0000","last_active":"2024-09-15T23:19:35.638294+0000","last_peered":"2024-09-15T23:19:35.638294+0000","last_clean":"2024-09-15T23:19:35.638294+0000","last_became_active":"2024-09-15T23:19:35.635214+0000","last_became_peered":"2024-09-15T23:19:35.635214+0000","last_unstale":"2024-09-15T23:19:35.638294+0000","last_undegraded":"2024-09-15T23:19:35.638294+0000","last_fullsized":"2024-09-15T23:19:35.638294+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:37.206929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.631015+0000","last_change":"2024-09-15T23:19:34.594835+0000","last_active":"2024-09-15T23:19:36.631015+0000","last_peered":"2024-09-15T23:19:36.631015+0000","last_clean":"2024-09-15T23:19:36.631015+0000","last_became_active":"2024-09-15T23:19:34.594581+0000","last_became_peered":"2024-09-15T23:19:34.594581+0000","last_unstale":"2024-09-15T23:19:36.631015+0000","last_undegraded":"2024-09-15T23:19:36.631015+0000","last_fullsized":"2024-09-15T23:19:36.631015+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:35:03.904979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.636669+0000","last_change":"2024-09-15T23:19:35.632888+0000","last_active":"2024-09-15T23:19:35.636669+0000","last_peered":"2024-09-15T23:19:35.636669+0000","last_clean":"2024-09-15T23:19:35.636669+0000","last_became_active":"2024-09-15T23:19:35.631987+0000","last_became_peered":"2024-09-15T23:19:35.631987+0000","last_unstale":"2024-09-15T23:19:35.636669+0000","last_undegraded":"2024-09-15T23:19:35.636669+0000","last_fullsized":"2024-09-15T23:19:35.636669+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:15:13.514441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.b","version":"141'2","reported_seq":16,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.706744+0000","last_change":"2024-09-15T23:19:34.597050+0000","last_active":"2024-09-15T23:19:37.706744+0000","last_peered":"2024-09-15T23:19:37.706744+0000","last_clean":"2024-09-15T23:19:37.706744+0000","last_became_active":"2024-09-15T23:19:34.596136+0000","last_became_peered":"2024-09-15T23:19:34.596136+0000","last_unstale":"2024-09-15T23:19:37.706744+0000","last_undegraded":"2024-09-15T23:19:37.706744+0000","last_fullsized":"2024-09-15T23:19:37.706744+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:47:11.343828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.607970+0000","last_change":"2024-09-15T23:19:35.614820+0000","last_active":"2024-09-15T23:19:36.607970+0000","last_peered":"2024-09-15T23:19:36.607970+0000","last_clean":"2024-09-15T23:19:36.607970+0000","last_became_active":"2024-09-15T23:19:35.614503+0000","last_became_peered":"2024-09-15T23:19:35.614503+0000","last_unstale":"2024-09-15T23:19:36.607970+0000","last_undegraded":"2024-09-15T23:19:36.607970+0000","last_fullsized":"2024-09-15T23:19:36.607970+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:30:06.350277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.611014+0000","last_change":"2024-09-15T23:19:34.597396+0000","last_active":"2024-09-15T23:19:35.611014+0000","last_peered":"2024-09-15T23:19:35.611014+0000","last_clean":"2024-09-15T23:19:35.611014+0000","last_became_active":"2024-09-15T23:19:34.595843+0000","last_became_peered":"2024-09-15T23:19:34.595843+0000","last_unstale":"2024-09-15T23:19:35.611014+0000","last_undegraded":"2024-09-15T23:19:35.611014+0000","last_fullsized":"2024-09-15T23:19:35.611014+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:24.495888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.626232+0000","last_change":"2024-09-15T23:19:35.623235+0000","last_active":"2024-09-15T23:19:35.626232+0000","last_peered":"2024-09-15T23:19:35.626232+0000","last_clean":"2024-09-15T23:19:35.626232+0000","last_became_active":"2024-09-15T23:19:35.622976+0000","last_became_peered":"2024-09-15T23:19:35.622976+0000","last_unstale":"2024-09-15T23:19:35.626232+0000","last_undegraded":"2024-09-15T23:19:35.626232+0000","last_fullsized":"2024-09-15T23:19:35.626232+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:15.373058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.618243+0000","last_change":"2024-09-15T23:19:34.597859+0000","last_active":"2024-09-15T23:19:35.618243+0000","last_peered":"2024-09-15T23:19:35.618243+0000","last_clean":"2024-09-15T23:19:35.618243+0000","last_became_active":"2024-09-15T23:19:34.597561+0000","last_became_peered":"2024-09-15T23:19:34.597561+0000","last_unstale":"2024-09-15T23:19:35.618243+0000","last_undegraded":"2024-09-15T23:19:35.618243+0000","last_fullsized":"2024-09-15T23:19:35.618243+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:13:21.067550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.632898+0000","last_change":"2024-09-15T23:19:35.612610+0000","last_active":"2024-09-15T23:19:36.632898+0000","last_peered":"2024-09-15T23:19:36.632898+0000","last_clean":"2024-09-15T23:19:36.632898+0000","last_became_active":"2024-09-15T23:19:35.612305+0000","last_became_peered":"2024-09-15T23:19:35.612305+0000","last_unstale":"2024-09-15T23:19:36.632898+0000","last_undegraded":"2024-09-15T23:19:36.632898+0000","last_fullsized":"2024-09-15T23:19:36.632898+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:13:22.069059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.618110+0000","last_change":"2024-09-15T23:19:34.591315+0000","last_active":"2024-09-15T23:19:35.618110+0000","last_peered":"2024-09-15T23:19:35.618110+0000","last_clean":"2024-09-15T23:19:35.618110+0000","last_became_active":"2024-09-15T23:19:34.590567+0000","last_became_peered":"2024-09-15T23:19:34.590567+0000","last_unstale":"2024-09-15T23:19:35.618110+0000","last_undegraded":"2024-09-15T23:19:35.618110+0000","last_fullsized":"2024-09-15T23:19:35.618110+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:45:24.682806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.608117+0000","last_change":"2024-09-15T23:19:35.609751+0000","last_active":"2024-09-15T23:19:36.608117+0000","last_peered":"2024-09-15T23:19:36.608117+0000","last_clean":"2024-09-15T23:19:36.608117+0000","last_became_active":"2024-09-15T23:19:35.609480+0000","last_became_peered":"2024-09-15T23:19:35.609480+0000","last_unstale":"2024-09-15T23:19:36.608117+0000","last_undegraded":"2024-09-15T23:19:36.608117+0000","last_fullsized":"2024-09-15T23:19:36.608117+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:57:09.438860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.7","version":"141'2","reported_seq":14,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.637591+0000","last_change":"2024-09-15T23:19:34.596662+0000","last_active":"2024-09-15T23:19:35.637591+0000","last_peered":"2024-09-15T23:19:35.637591+0000","last_clean":"2024-09-15T23:19:35.637591+0000","last_became_active":"2024-09-15T23:19:34.596339+0000","last_became_peered":"2024-09-15T23:19:34.596339+0000","last_unstale":"2024-09-15T23:19:35.637591+0000","last_undegraded":"2024-09-15T23:19:35.637591+0000","last_fullsized":"2024-09-15T23:19:35.637591+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:10.329268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.634418+0000","last_change":"2024-09-15T23:19:35.632263+0000","last_active":"2024-09-15T23:19:35.634418+0000","last_peered":"2024-09-15T23:19:35.634418+0000","last_clean":"2024-09-15T23:19:35.634418+0000","last_became_active":"2024-09-15T23:19:35.631768+0000","last_became_peered":"2024-09-15T23:19:35.631768+0000","last_unstale":"2024-09-15T23:19:35.634418+0000","last_undegraded":"2024-09-15T23:19:35.634418+0000","last_fullsized":"2024-09-15T23:19:35.634418+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:28:37.693205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.6","version":"142'1","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.631148+0000","last_change":"2024-09-15T23:19:34.595339+0000","last_active":"2024-09-15T23:19:36.631148+0000","last_peered":"2024-09-15T23:19:36.631148+0000","last_clean":"2024-09-15T23:19:36.631148+0000","last_became_active":"2024-09-15T23:19:34.594966+0000","last_became_peered":"2024-09-15T23:19:34.594966+0000","last_unstale":"2024-09-15T23:19:36.631148+0000","last_undegraded":"2024-09-15T23:19:36.631148+0000","last_fullsized":"2024-09-15T23:19:36.631148+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:13:22.034976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.634752+0000","last_change":"2024-09-15T23:19:35.633878+0000","last_active":"2024-09-15T23:19:35.634752+0000","last_peered":"2024-09-15T23:19:35.634752+0000","last_clean":"2024-09-15T23:19:35.634752+0000","last_became_active":"2024-09-15T23:19:35.633565+0000","last_became_peered":"2024-09-15T23:19:35.633565+0000","last_unstale":"2024-09-15T23:19:35.634752+0000","last_undegraded":"2024-09-15T23:19:35.634752+0000","last_fullsized":"2024-09-15T23:19:35.634752+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:31.451649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.610262+0000","last_change":"2024-09-15T23:19:34.595426+0000","last_active":"2024-09-15T23:19:35.610262+0000","last_peered":"2024-09-15T23:19:35.610262+0000","last_clean":"2024-09-15T23:19:35.610262+0000","last_became_active":"2024-09-15T23:19:34.594537+0000","last_became_peered":"2024-09-15T23:19:34.594537+0000","last_unstale":"2024-09-15T23:19:35.610262+0000","last_undegraded":"2024-09-15T23:19:35.610262+0000","last_fullsized":"2024-09-15T23:19:35.610262+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:56.083665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.707002+0000","last_change":"2024-09-15T23:19:35.613053+0000","last_active":"2024-09-15T23:19:37.707002+0000","last_peered":"2024-09-15T23:19:37.707002+0000","last_clean":"2024-09-15T23:19:37.707002+0000","last_became_active":"2024-09-15T23:19:35.612781+0000","last_became_peered":"2024-09-15T23:19:35.612781+0000","last_unstale":"2024-09-15T23:19:37.707002+0000","last_undegraded":"2024-09-15T23:19:37.707002+0000","last_fullsized":"2024-09-15T23:19:37.707002+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:01.754948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.619266+0000","last_change":"2024-09-15T23:19:34.592540+0000","last_active":"2024-09-15T23:19:35.619266+0000","last_peered":"2024-09-15T23:19:35.619266+0000","last_clean":"2024-09-15T23:19:35.619266+0000","last_became_active":"2024-09-15T23:19:34.592184+0000","last_became_peered":"2024-09-15T23:19:34.592184+0000","last_unstale":"2024-09-15T23:19:35.619266+0000","last_undegraded":"2024-09-15T23:19:35.619266+0000","last_fullsized":"2024-09-15T23:19:35.619266+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:08:30.731469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.632949+0000","last_change":"2024-09-15T23:19:35.618215+0000","last_active":"2024-09-15T23:19:36.632949+0000","last_peered":"2024-09-15T23:19:36.632949+0000","last_clean":"2024-09-15T23:19:36.632949+0000","last_became_active":"2024-09-15T23:19:35.617934+0000","last_became_peered":"2024-09-15T23:19:35.617934+0000","last_unstale":"2024-09-15T23:19:36.632949+0000","last_undegraded":"2024-09-15T23:19:36.632949+0000","last_fullsized":"2024-09-15T23:19:36.632949+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:15.373058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.623647+0000","last_change":"2024-09-15T23:19:34.598761+0000","last_active":"2024-09-15T23:19:35.623647+0000","last_peered":"2024-09-15T23:19:35.623647+0000","last_clean":"2024-09-15T23:19:35.623647+0000","last_became_active":"2024-09-15T23:19:34.598474+0000","last_became_peered":"2024-09-15T23:19:34.598474+0000","last_unstale":"2024-09-15T23:19:35.623647+0000","last_undegraded":"2024-09-15T23:19:35.623647+0000","last_fullsized":"2024-09-15T23:19:35.623647+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:11.986189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.633305+0000","last_change":"2024-09-15T23:19:35.626752+0000","last_active":"2024-09-15T23:19:36.633305+0000","last_peered":"2024-09-15T23:19:36.633305+0000","last_clean":"2024-09-15T23:19:36.633305+0000","last_became_active":"2024-09-15T23:19:35.626133+0000","last_became_peered":"2024-09-15T23:19:35.626133+0000","last_unstale":"2024-09-15T23:19:36.633305+0000","last_undegraded":"2024-09-15T23:19:36.633305+0000","last_fullsized":"2024-09-15T23:19:36.633305+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:30.170171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.632968+0000","last_change":"2024-09-15T23:19:34.590950+0000","last_active":"2024-09-15T23:19:36.632968+0000","last_peered":"2024-09-15T23:19:36.632968+0000","last_clean":"2024-09-15T23:19:36.632968+0000","last_became_active":"2024-09-15T23:19:34.590703+0000","last_became_peered":"2024-09-15T23:19:34.590703+0000","last_unstale":"2024-09-15T23:19:36.632968+0000","last_undegraded":"2024-09-15T23:19:36.632968+0000","last_fullsized":"2024-09-15T23:19:36.632968+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:21:17.322177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.621350+0000","last_change":"2024-09-15T23:19:35.616698+0000","last_active":"2024-09-15T23:19:35.621350+0000","last_peered":"2024-09-15T23:19:35.621350+0000","last_clean":"2024-09-15T23:19:35.621350+0000","last_became_active":"2024-09-15T23:19:35.615861+0000","last_became_peered":"2024-09-15T23:19:35.615861+0000","last_unstale":"2024-09-15T23:19:35.621350+0000","last_undegraded":"2024-09-15T23:19:35.621350+0000","last_fullsized":"2024-09-15T23:19:35.621350+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:57:09.438860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.620995+0000","last_change":"2024-09-15T23:19:34.591465+0000","last_active":"2024-09-15T23:19:35.620995+0000","last_peered":"2024-09-15T23:19:35.620995+0000","last_clean":"2024-09-15T23:19:35.620995+0000","last_became_active":"2024-09-15T23:19:34.590999+0000","last_became_peered":"2024-09-15T23:19:34.590999+0000","last_unstale":"2024-09-15T23:19:35.620995+0000","last_undegraded":"2024-09-15T23:19:35.620995+0000","last_fullsized":"2024-09-15T23:19:35.620995+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:00.747606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.633135+0000","last_change":"2024-09-15T23:19:35.626540+0000","last_active":"2024-09-15T23:19:35.633135+0000","last_peered":"2024-09-15T23:19:35.633135+0000","last_clean":"2024-09-15T23:19:35.633135+0000","last_became_active":"2024-09-15T23:19:35.625997+0000","last_became_peered":"2024-09-15T23:19:35.625997+0000","last_unstale":"2024-09-15T23:19:35.633135+0000","last_undegraded":"2024-09-15T23:19:35.633135+0000","last_fullsized":"2024-09-15T23:19:35.633135+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:30.170171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":141,"state":"active+clean","last_fresh":"2024-09-15T23:19:35.618105+0000","last_change":"2024-09-15T23:19:34.594881+0000","last_active":"2024-09-15T23:19:35.618105+0000","last_peered":"2024-09-15T23:19:35.618105+0000","last_clean":"2024-09-15T23:19:35.618105+0000","last_became_active":"2024-09-15T23:19:34.594542+0000","last_became_peered":"2024-09-15T23:19:34.594542+0000","last_unstale":"2024-09-15T23:19:35.618105+0000","last_undegraded":"2024-09-15T23:19:35.618105+0000","last_fullsized":"2024-09-15T23:19:35.618105+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:16:16.310640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.706699+0000","last_change":"2024-09-15T23:19:35.629292+0000","last_active":"2024-09-15T23:19:37.706699+0000","last_peered":"2024-09-15T23:19:37.706699+0000","last_clean":"2024-09-15T23:19:37.706699+0000","last_became_active":"2024-09-15T23:19:35.629014+0000","last_became_peered":"2024-09-15T23:19:35.629014+0000","last_unstale":"2024-09-15T23:19:37.706699+0000","last_undegraded":"2024-09-15T23:19:37.706699+0000","last_fullsized":"2024-09-15T23:19:37.706699+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:20.890998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.13","version":"141'2","reported_seq":16,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.633332+0000","last_change":"2024-09-15T23:19:34.594919+0000","last_active":"2024-09-15T23:19:36.633332+0000","last_peered":"2024-09-15T23:19:36.633332+0000","last_clean":"2024-09-15T23:19:36.633332+0000","last_became_active":"2024-09-15T23:19:34.594639+0000","last_became_peered":"2024-09-15T23:19:34.594639+0000","last_unstale":"2024-09-15T23:19:36.633332+0000","last_undegraded":"2024-09-15T23:19:36.633332+0000","last_fullsized":"2024-09-15T23:19:36.633332+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:20:42.218476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":393,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.607733+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:19:36.607733+0000","last_peered":"2024-09-15T23:19:36.607733+0000","last_clean":"2024-09-15T23:19:36.607733+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:19:36.607733+0000","last_undegraded":"2024-09-15T23:19:36.607733+0000","last_fullsized":"2024-09-15T23:19:36.607733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476833,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50956,"kb_used_data":1720,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320884,"statfs":{"total":96636764160,"available":96584585216,"internally_reserved":0,"allocated":1761280,"data_stored":776842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476830,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50960,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320880,"statfs":{"total":96636764160,"available":96584581120,"internally_reserved":0,"allocated":1765376,"data_stored":777444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476832,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47392,"kb_used_data":2312,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324448,"statfs":{"total":96636764160,"available":96588234752,"internally_reserved":0,"allocated":2367488,"data_stored":1368774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476832,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41248,"kb_used_data":1736,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330592,"statfs":{"total":96636764160,"available":96594526208,"internally_reserved":0,"allocated":1777664,"data_stored":778440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542238,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45380,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326460,"statfs":{"total":96636764160,"available":96590295040,"internally_reserved":0,"allocated":1748992,"data_stored":770506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":44693962},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542238,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50940,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320900,"statfs":{"total":96636764160,"available":96584601600,"internally_reserved":0,"allocated":1744896,"data_stored":770472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542237,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55700,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316140,"statfs":{"total":96636764160,"available":96579727360,"internally_reserved":0,"allocated":2351104,"data_stored":1361582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542239,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50948,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320892,"statfs":{"total":96636764160,"available":96584593408,"internally_reserved":0,"allocated":1744896,"data_stored":770472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:19:42.905 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:19:43.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.013+0000 7fce1f1d6640 1 Processor -- start 2024-09-15T23:19:43.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.013+0000 7fce1f1d6640 1 -- start start 2024-09-15T23:19:43.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.014+0000 7fce1f1d6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fce1815e6d0 0x7fce18071390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:43.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.014+0000 7fce1f1d6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fce18070b80 0x7fce181622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:43.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.014+0000 7fce1f1d6640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce1815eab0 con 0x7fce1806cd20 2024-09-15T23:19:43.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.014+0000 7fce1f1d6640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fce1815ed70 con 0x7fce18070b80 2024-09-15T23:19:43.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.014+0000 7fce1f1d6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fce1815f050 con 0x7fce1815e6d0 2024-09-15T23:19:43.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.015+0000 7fce1d773640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fce18070b80 0x7fce181622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:43.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.015+0000 7fce17fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fce1806cd20 0x7fce180b6d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60722/0 (socket says 172.21.15.123:60722) 2024-09-15T23:19:43.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.015+0000 7fce17fff640 1 -- 172.21.15.123:0/2768275117 learned_addr learned my addr 172.21.15.123:0/2768275117 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:19:43.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.015+0000 7fce1cf72640 1 --2- 172.21.15.123:0/2768275117 >> v2:172.21.15.188:3300/0 conn(0x7fce1815e6d0 0x7fce18071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:43.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.015+0000 7fce1d773640 1 -- 172.21.15.123:0/2768275117 >> v2:172.21.15.188:3300/0 conn(0x7fce1815e6d0 msgr2=0x7fce18071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:43.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.015+0000 7fce1d773640 1 --2- 172.21.15.123:0/2768275117 >> v2:172.21.15.188:3300/0 conn(0x7fce1815e6d0 0x7fce18071390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:43.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.015+0000 7fce1d773640 1 -- 172.21.15.123:0/2768275117 >> v1:172.21.15.123:6789/0 conn(0x7fce1806cd20 legacy=0x7fce180b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:43.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.015+0000 7fce1d773640 1 -- 172.21.15.123:0/2768275117 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce1815f330 con 0x7fce18070b80 2024-09-15T23:19:43.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.016+0000 7fce1d773640 1 --2- 172.21.15.123:0/2768275117 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce18070b80 0x7fce181622a0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fce1806fb10 tx=0x7fce1002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a6f0aeb76b21487 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:43.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.016+0000 7fce177fe640 1 -- 172.21.15.123:0/2768275117 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce10037070 con 0x7fce18070b80 2024-09-15T23:19:43.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.016+0000 7fce177fe640 1 -- 172.21.15.123:0/2768275117 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce10032440 con 0x7fce18070b80 2024-09-15T23:19:43.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.016+0000 7fce177fe640 1 -- 172.21.15.123:0/2768275117 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce10032810 con 0x7fce18070b80 2024-09-15T23:19:43.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.016+0000 7fce1f1d6640 1 -- 172.21.15.123:0/2768275117 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce18070b80 msgr2=0x7fce181622a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:43.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.016+0000 7fce1f1d6640 1 --2- 172.21.15.123:0/2768275117 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce18070b80 0x7fce181622a0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fce1806fb10 tx=0x7fce1002a1a0 comp rx=0 tx=0).stop 2024-09-15T23:19:43.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.016+0000 7fce1f1d6640 1 -- 172.21.15.123:0/2768275117 shutdown_connections 2024-09-15T23:19:43.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.016+0000 7fce1f1d6640 1 --2- 172.21.15.123:0/2768275117 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce18070b80 0x7fce181622a0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:43.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.016+0000 7fce1f1d6640 1 --2- 172.21.15.123:0/2768275117 >> v2:172.21.15.188:3300/0 conn(0x7fce1815e6d0 0x7fce18071390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:43.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.016+0000 7fce1f1d6640 1 -- 172.21.15.123:0/2768275117 >> 172.21.15.123:0/2768275117 conn(0x7fce18067fb0 msgr2=0x7fce1806f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:43.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.016+0000 7fce1f1d6640 1 -- 172.21.15.123:0/2768275117 shutdown_connections 2024-09-15T23:19:43.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.016+0000 7fce1f1d6640 1 -- 172.21.15.123:0/2768275117 wait complete. 2024-09-15T23:19:43.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.017+0000 7fce1f1d6640 1 Processor -- start 2024-09-15T23:19:43.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.018+0000 7fce1f1d6640 1 -- start start 2024-09-15T23:19:43.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.018+0000 7fce1f1d6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce1806cd20 0x7fce18149930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:43.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.018+0000 7fce1f1d6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fce18070b80 0x7fce181f7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:43.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.018+0000 7fce1f1d6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fce1815e6d0 0x7fce181f8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:43.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.018+0000 7fce1f1d6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fce180718d0 con 0x7fce1806cd20 2024-09-15T23:19:43.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.018+0000 7fce1f1d6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fce1815f8f0 con 0x7fce18070b80 2024-09-15T23:19:43.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.018+0000 7fce1f1d6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fce18071a50 con 0x7fce1815e6d0 2024-09-15T23:19:43.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.019+0000 7fce1cf72640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce1806cd20 0x7fce18149930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:43.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.019+0000 7fce1cf72640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce1806cd20 0x7fce18149930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49914/0 (socket says 172.21.15.123:49914) 2024-09-15T23:19:43.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.019+0000 7fce1cf72640 1 -- 172.21.15.123:0/416757130 learned_addr learned my addr 172.21.15.123:0/416757130 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:43.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.019+0000 7fce1d773640 1 --2- 172.21.15.123:0/416757130 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fce1815e6d0 0x7fce181f8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:43.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.019+0000 7fce1cf72640 1 -- 172.21.15.123:0/416757130 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fce1815e6d0 msgr2=0x7fce181f8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:43.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.019+0000 7fce1cf72640 1 --2- 172.21.15.123:0/416757130 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fce1815e6d0 0x7fce181f8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:43.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.019+0000 7fce1cf72640 1 -- 172.21.15.123:0/416757130 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fce18070b80 msgr2=0x7fce181f7d30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T23:19:43.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.019+0000 7fce1cf72640 1 --2- 172.21.15.123:0/416757130 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fce18070b80 0x7fce181f7d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:43.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.019+0000 7fce1cf72640 1 -- 172.21.15.123:0/416757130 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce1815b280 con 0x7fce1806cd20 2024-09-15T23:19:43.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.019+0000 7fce1cf72640 1 --2- 172.21.15.123:0/416757130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce1806cd20 0x7fce18149930 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fce0800d5f0 tx=0x7fce0800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:43.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.019+0000 7fce157fa640 1 -- 172.21.15.123:0/416757130 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce080125f0 con 0x7fce1806cd20 2024-09-15T23:19:43.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.019+0000 7fce157fa640 1 -- 172.21.15.123:0/416757130 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce08019070 con 0x7fce1806cd20 2024-09-15T23:19:43.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.019+0000 7fce157fa640 1 -- 172.21.15.123:0/416757130 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce080129d0 con 0x7fce1806cd20 2024-09-15T23:19:43.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.019+0000 7fce1f1d6640 1 -- 172.21.15.123:0/416757130 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce181e8b90 con 0x7fce1806cd20 2024-09-15T23:19:43.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.019+0000 7fce1f1d6640 1 -- 172.21.15.123:0/416757130 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce181e9150 con 0x7fce1806cd20 2024-09-15T23:19:43.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.020+0000 7fce1f1d6640 1 -- 172.21.15.123:0/416757130 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce18071390 con 0x7fce1806cd20 2024-09-15T23:19:43.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.021+0000 7fce157fa640 1 -- 172.21.15.123:0/416757130 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fce08012b70 con 0x7fce1806cd20 2024-09-15T23:19:43.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.021+0000 7fce157fa640 1 --2- 172.21.15.123:0/416757130 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fce0406c2b0 0x7fce0406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:43.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.021+0000 7fce157fa640 1 -- 172.21.15.123:0/416757130 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fce0808b750 con 0x7fce1806cd20 2024-09-15T23:19:43.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.021+0000 7fce17fff640 1 --2- 172.21.15.123:0/416757130 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fce0406c2b0 0x7fce0406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:43.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.022+0000 7fce17fff640 1 --2- 172.21.15.123:0/416757130 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fce0406c2b0 0x7fce0406e770 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fce0c0012e0 tx=0x7fce0c0015b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:43.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.026+0000 7fce157fa640 1 -- 172.21.15.123:0/416757130 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fce08059f50 con 0x7fce1806cd20 2024-09-15T23:19:43.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.187+0000 7fce1f1d6640 1 -- 172.21.15.123:0/416757130 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fce1806d4f0 con 0x7fce0406c2b0 2024-09-15T23:19:43.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.194+0000 7fce157fa640 1 -- 172.21.15.123:0/416757130 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252443 (secure 0 0 0) 0x7fce1806d4f0 con 0x7fce0406c2b0 2024-09-15T23:19:43.199 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:19:43.200 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:19:43.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.197+0000 7fce1f1d6640 1 -- 172.21.15.123:0/416757130 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fce0406c2b0 msgr2=0x7fce0406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:43.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.197+0000 7fce1f1d6640 1 --2- 172.21.15.123:0/416757130 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fce0406c2b0 0x7fce0406e770 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fce0c0012e0 tx=0x7fce0c0015b0 comp rx=0 tx=0).stop 2024-09-15T23:19:43.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.197+0000 7fce1f1d6640 1 -- 172.21.15.123:0/416757130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce1806cd20 msgr2=0x7fce18149930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:43.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.197+0000 7fce1f1d6640 1 --2- 172.21.15.123:0/416757130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce1806cd20 0x7fce18149930 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fce0800d5f0 tx=0x7fce0800dab0 comp rx=0 tx=0).stop 2024-09-15T23:19:43.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.197+0000 7fce1f1d6640 1 -- 172.21.15.123:0/416757130 shutdown_connections 2024-09-15T23:19:43.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.197+0000 7fce1f1d6640 1 --2- 172.21.15.123:0/416757130 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fce1815e6d0 0x7fce181f8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:43.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.197+0000 7fce1f1d6640 1 --2- 172.21.15.123:0/416757130 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fce18070b80 0x7fce181f7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:43.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.197+0000 7fce1f1d6640 1 --2- 172.21.15.123:0/416757130 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fce0406c2b0 0x7fce0406e770 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:43.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.197+0000 7fce1f1d6640 1 --2- 172.21.15.123:0/416757130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fce1806cd20 0x7fce18149930 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:43.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.197+0000 7fce1f1d6640 1 -- 172.21.15.123:0/416757130 >> 172.21.15.123:0/416757130 conn(0x7fce18067fb0 msgr2=0x7fce180b6d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:43.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.197+0000 7fce1f1d6640 1 -- 172.21.15.123:0/416757130 shutdown_connections 2024-09-15T23:19:43.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.197+0000 7fce1f1d6640 1 -- 172.21.15.123:0/416757130 wait complete. 2024-09-15T23:19:43.209 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":365,"stamp":"2024-09-15T23:19:41.610308+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":393560,"kb_used_data":14952,"kb_used_omap":12,"kb_used_meta":378419,"kb_avail":754581160,"statfs":{"total":773094113280,"available":772691107840,"internally_reserved":0,"allocated":15310848,"data_stored":7399732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":387501616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.030463"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.142859+0000","last_change":"2024-09-15T23:19:35.630018+0000","last_active":"2024-09-15T23:19:37.142859+0000","last_peered":"2024-09-15T23:19:37.142859+0000","last_clean":"2024-09-15T23:19:37.142859+0000","last_became_active":"2024-09-15T23:19:35.628099+0000","last_became_peered":"2024-09-15T23:19:35.628099+0000","last_unstale":"2024-09-15T23:19:37.142859+0000","last_undegraded":"2024-09-15T23:19:37.142859+0000","last_fullsized":"2024-09-15T23:19:37.142859+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:38:31.463074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.142830+0000","last_change":"2024-09-15T23:19:35.628850+0000","last_active":"2024-09-15T23:19:37.142830+0000","last_peered":"2024-09-15T23:19:37.142830+0000","last_clean":"2024-09-15T23:19:37.142830+0000","last_became_active":"2024-09-15T23:19:35.628420+0000","last_became_peered":"2024-09-15T23:19:35.628420+0000","last_unstale":"2024-09-15T23:19:37.142830+0000","last_undegraded":"2024-09-15T23:19:37.142830+0000","last_fullsized":"2024-09-15T23:19:37.142830+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:49.149176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.706881+0000","last_change":"2024-09-15T23:19:35.615570+0000","last_active":"2024-09-15T23:19:37.706881+0000","last_peered":"2024-09-15T23:19:37.706881+0000","last_clean":"2024-09-15T23:19:37.706881+0000","last_became_active":"2024-09-15T23:19:35.615221+0000","last_became_peered":"2024-09-15T23:19:35.615221+0000","last_unstale":"2024-09-15T23:19:37.706881+0000","last_undegraded":"2024-09-15T23:19:37.706881+0000","last_fullsized":"2024-09-15T23:19:37.706881+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:23.896721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.607591+0000","last_change":"2024-09-15T23:19:35.626458+0000","last_active":"2024-09-15T23:19:36.607591+0000","last_peered":"2024-09-15T23:19:36.607591+0000","last_clean":"2024-09-15T23:19:36.607591+0000","last_became_active":"2024-09-15T23:19:35.626142+0000","last_became_peered":"2024-09-15T23:19:35.626142+0000","last_unstale":"2024-09-15T23:19:36.607591+0000","last_undegraded":"2024-09-15T23:19:36.607591+0000","last_fullsized":"2024-09-15T23:19:36.607591+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:29:55.927749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.631000+0000","last_change":"2024-09-15T23:19:35.618318+0000","last_active":"2024-09-15T23:19:36.631000+0000","last_peered":"2024-09-15T23:19:36.631000+0000","last_clean":"2024-09-15T23:19:36.631000+0000","last_became_active":"2024-09-15T23:19:35.618051+0000","last_became_peered":"2024-09-15T23:19:35.618051+0000","last_unstale":"2024-09-15T23:19:36.631000+0000","last_undegraded":"2024-09-15T23:19:36.631000+0000","last_fullsized":"2024-09-15T23:19:36.631000+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:19:00.741563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.632898+0000","last_change":"2024-09-15T23:19:35.628369+0000","last_active":"2024-09-15T23:19:36.632898+0000","last_peered":"2024-09-15T23:19:36.632898+0000","last_clean":"2024-09-15T23:19:36.632898+0000","last_became_active":"2024-09-15T23:19:35.628103+0000","last_became_peered":"2024-09-15T23:19:35.628103+0000","last_unstale":"2024-09-15T23:19:36.632898+0000","last_undegraded":"2024-09-15T23:19:36.632898+0000","last_fullsized":"2024-09-15T23:19:36.632898+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:08:31.732979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.631039+0000","last_change":"2024-09-15T23:19:35.619484+0000","last_active":"2024-09-15T23:19:36.631039+0000","last_peered":"2024-09-15T23:19:36.631039+0000","last_clean":"2024-09-15T23:19:36.631039+0000","last_became_active":"2024-09-15T23:19:35.619144+0000","last_became_peered":"2024-09-15T23:19:35.619144+0000","last_unstale":"2024-09-15T23:19:36.631039+0000","last_undegraded":"2024-09-15T23:19:36.631039+0000","last_fullsized":"2024-09-15T23:19:36.631039+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:43:35.449575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.630894+0000","last_change":"2024-09-15T23:19:35.632466+0000","last_active":"2024-09-15T23:19:36.630894+0000","last_peered":"2024-09-15T23:19:36.630894+0000","last_clean":"2024-09-15T23:19:36.630894+0000","last_became_active":"2024-09-15T23:19:35.632177+0000","last_became_peered":"2024-09-15T23:19:35.632177+0000","last_unstale":"2024-09-15T23:19:36.630894+0000","last_undegraded":"2024-09-15T23:19:36.630894+0000","last_fullsized":"2024-09-15T23:19:36.630894+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:55:19.532616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.706924+0000","last_change":"2024-09-15T23:19:35.614309+0000","last_active":"2024-09-15T23:19:37.706924+0000","last_peered":"2024-09-15T23:19:37.706924+0000","last_clean":"2024-09-15T23:19:37.706924+0000","last_became_active":"2024-09-15T23:19:35.614063+0000","last_became_peered":"2024-09-15T23:19:35.614063+0000","last_unstale":"2024-09-15T23:19:37.706924+0000","last_undegraded":"2024-09-15T23:19:37.706924+0000","last_fullsized":"2024-09-15T23:19:37.706924+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:49.709600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.142800+0000","last_change":"2024-09-15T23:19:35.629074+0000","last_active":"2024-09-15T23:19:37.142800+0000","last_peered":"2024-09-15T23:19:37.142800+0000","last_clean":"2024-09-15T23:19:37.142800+0000","last_became_active":"2024-09-15T23:19:35.628048+0000","last_became_peered":"2024-09-15T23:19:35.628048+0000","last_unstale":"2024-09-15T23:19:37.142800+0000","last_undegraded":"2024-09-15T23:19:37.142800+0000","last_fullsized":"2024-09-15T23:19:37.142800+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:15:50.327252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.608359+0000","last_change":"2024-09-15T23:19:35.629980+0000","last_active":"2024-09-15T23:19:36.608359+0000","last_peered":"2024-09-15T23:19:36.608359+0000","last_clean":"2024-09-15T23:19:36.608359+0000","last_became_active":"2024-09-15T23:19:35.629187+0000","last_became_peered":"2024-09-15T23:19:35.629187+0000","last_unstale":"2024-09-15T23:19:36.608359+0000","last_undegraded":"2024-09-15T23:19:36.608359+0000","last_fullsized":"2024-09-15T23:19:36.608359+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:20.453779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.633043+0000","last_change":"2024-09-15T23:19:35.610006+0000","last_active":"2024-09-15T23:19:36.633043+0000","last_peered":"2024-09-15T23:19:36.633043+0000","last_clean":"2024-09-15T23:19:36.633043+0000","last_became_active":"2024-09-15T23:19:35.609734+0000","last_became_peered":"2024-09-15T23:19:35.609734+0000","last_unstale":"2024-09-15T23:19:36.633043+0000","last_undegraded":"2024-09-15T23:19:36.633043+0000","last_fullsized":"2024-09-15T23:19:36.633043+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:57:09.429395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.607471+0000","last_change":"2024-09-15T23:19:35.631492+0000","last_active":"2024-09-15T23:19:36.607471+0000","last_peered":"2024-09-15T23:19:36.607471+0000","last_clean":"2024-09-15T23:19:36.607471+0000","last_became_active":"2024-09-15T23:19:35.631227+0000","last_became_peered":"2024-09-15T23:19:35.631227+0000","last_unstale":"2024-09-15T23:19:36.607471+0000","last_undegraded":"2024-09-15T23:19:36.607471+0000","last_fullsized":"2024-09-15T23:19:36.607471+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:49.534165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:38.171729+0000","last_change":"2024-09-15T23:19:35.625592+0000","last_active":"2024-09-15T23:19:38.171729+0000","last_peered":"2024-09-15T23:19:38.171729+0000","last_clean":"2024-09-15T23:19:38.171729+0000","last_became_active":"2024-09-15T23:19:35.625301+0000","last_became_peered":"2024-09-15T23:19:35.625301+0000","last_unstale":"2024-09-15T23:19:38.171729+0000","last_undegraded":"2024-09-15T23:19:38.171729+0000","last_fullsized":"2024-09-15T23:19:38.171729+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:07:28.328478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.608008+0000","last_change":"2024-09-15T23:19:35.622364+0000","last_active":"2024-09-15T23:19:36.608008+0000","last_peered":"2024-09-15T23:19:36.608008+0000","last_clean":"2024-09-15T23:19:36.608008+0000","last_became_active":"2024-09-15T23:19:35.622088+0000","last_became_peered":"2024-09-15T23:19:35.622088+0000","last_unstale":"2024-09-15T23:19:36.608008+0000","last_undegraded":"2024-09-15T23:19:36.608008+0000","last_fullsized":"2024-09-15T23:19:36.608008+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:43:45.785566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:38.171610+0000","last_change":"2024-09-15T23:19:35.626083+0000","last_active":"2024-09-15T23:19:38.171610+0000","last_peered":"2024-09-15T23:19:38.171610+0000","last_clean":"2024-09-15T23:19:38.171610+0000","last_became_active":"2024-09-15T23:19:35.625794+0000","last_became_peered":"2024-09-15T23:19:35.625794+0000","last_unstale":"2024-09-15T23:19:38.171610+0000","last_undegraded":"2024-09-15T23:19:38.171610+0000","last_fullsized":"2024-09-15T23:19:38.171610+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:08:15.350048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.707029+0000","last_change":"2024-09-15T23:19:35.628990+0000","last_active":"2024-09-15T23:19:37.707029+0000","last_peered":"2024-09-15T23:19:37.707029+0000","last_clean":"2024-09-15T23:19:37.707029+0000","last_became_active":"2024-09-15T23:19:35.628646+0000","last_became_peered":"2024-09-15T23:19:35.628646+0000","last_unstale":"2024-09-15T23:19:37.707029+0000","last_undegraded":"2024-09-15T23:19:37.707029+0000","last_fullsized":"2024-09-15T23:19:37.707029+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:06:03.662589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.608310+0000","last_change":"2024-09-15T23:19:35.616254+0000","last_active":"2024-09-15T23:19:36.608310+0000","last_peered":"2024-09-15T23:19:36.608310+0000","last_clean":"2024-09-15T23:19:36.608310+0000","last_became_active":"2024-09-15T23:19:35.615915+0000","last_became_peered":"2024-09-15T23:19:35.615915+0000","last_unstale":"2024-09-15T23:19:36.608310+0000","last_undegraded":"2024-09-15T23:19:36.608310+0000","last_fullsized":"2024-09-15T23:19:36.608310+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:31.163109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.142669+0000","last_change":"2024-09-15T23:19:35.629558+0000","last_active":"2024-09-15T23:19:37.142669+0000","last_peered":"2024-09-15T23:19:37.142669+0000","last_clean":"2024-09-15T23:19:37.142669+0000","last_became_active":"2024-09-15T23:19:35.629253+0000","last_became_peered":"2024-09-15T23:19:35.629253+0000","last_unstale":"2024-09-15T23:19:37.142669+0000","last_undegraded":"2024-09-15T23:19:37.142669+0000","last_fullsized":"2024-09-15T23:19:37.142669+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:58.041712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.608057+0000","last_change":"2024-09-15T23:19:35.628077+0000","last_active":"2024-09-15T23:19:36.608057+0000","last_peered":"2024-09-15T23:19:36.608057+0000","last_clean":"2024-09-15T23:19:36.608057+0000","last_became_active":"2024-09-15T23:19:35.627761+0000","last_became_peered":"2024-09-15T23:19:35.627761+0000","last_unstale":"2024-09-15T23:19:36.608057+0000","last_undegraded":"2024-09-15T23:19:36.608057+0000","last_fullsized":"2024-09-15T23:19:36.608057+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:55.317667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.632984+0000","last_change":"2024-09-15T23:19:35.618758+0000","last_active":"2024-09-15T23:19:36.632984+0000","last_peered":"2024-09-15T23:19:36.632984+0000","last_clean":"2024-09-15T23:19:36.632984+0000","last_became_active":"2024-09-15T23:19:35.618500+0000","last_became_peered":"2024-09-15T23:19:35.618500+0000","last_unstale":"2024-09-15T23:19:36.632984+0000","last_undegraded":"2024-09-15T23:19:36.632984+0000","last_fullsized":"2024-09-15T23:19:36.632984+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:42.228647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.142574+0000","last_change":"2024-09-15T23:19:35.634903+0000","last_active":"2024-09-15T23:19:37.142574+0000","last_peered":"2024-09-15T23:19:37.142574+0000","last_clean":"2024-09-15T23:19:37.142574+0000","last_became_active":"2024-09-15T23:19:35.634630+0000","last_became_peered":"2024-09-15T23:19:35.634630+0000","last_unstale":"2024-09-15T23:19:37.142574+0000","last_undegraded":"2024-09-15T23:19:37.142574+0000","last_fullsized":"2024-09-15T23:19:37.142574+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:19:45.548777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.607937+0000","last_change":"2024-09-15T23:19:35.619635+0000","last_active":"2024-09-15T23:19:36.607937+0000","last_peered":"2024-09-15T23:19:36.607937+0000","last_clean":"2024-09-15T23:19:36.607937+0000","last_became_active":"2024-09-15T23:19:35.619376+0000","last_became_peered":"2024-09-15T23:19:35.619376+0000","last_unstale":"2024-09-15T23:19:36.607937+0000","last_undegraded":"2024-09-15T23:19:36.607937+0000","last_fullsized":"2024-09-15T23:19:36.607937+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:58.694262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.607829+0000","last_change":"2024-09-15T23:19:35.615995+0000","last_active":"2024-09-15T23:19:36.607829+0000","last_peered":"2024-09-15T23:19:36.607829+0000","last_clean":"2024-09-15T23:19:36.607829+0000","last_became_active":"2024-09-15T23:19:35.615631+0000","last_became_peered":"2024-09-15T23:19:35.615631+0000","last_unstale":"2024-09-15T23:19:36.607829+0000","last_undegraded":"2024-09-15T23:19:36.607829+0000","last_fullsized":"2024-09-15T23:19:36.607829+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:14:26.625554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.608494+0000","last_change":"2024-09-15T23:19:35.632719+0000","last_active":"2024-09-15T23:19:36.608494+0000","last_peered":"2024-09-15T23:19:36.608494+0000","last_clean":"2024-09-15T23:19:36.608494+0000","last_became_active":"2024-09-15T23:19:35.632449+0000","last_became_peered":"2024-09-15T23:19:35.632449+0000","last_unstale":"2024-09-15T23:19:36.608494+0000","last_undegraded":"2024-09-15T23:19:36.608494+0000","last_fullsized":"2024-09-15T23:19:36.608494+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:56:00.379260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.143003+0000","last_change":"2024-09-15T23:19:35.639447+0000","last_active":"2024-09-15T23:19:37.143003+0000","last_peered":"2024-09-15T23:19:37.143003+0000","last_clean":"2024-09-15T23:19:37.143003+0000","last_became_active":"2024-09-15T23:19:35.639003+0000","last_became_peered":"2024-09-15T23:19:35.639003+0000","last_unstale":"2024-09-15T23:19:37.143003+0000","last_undegraded":"2024-09-15T23:19:37.143003+0000","last_fullsized":"2024-09-15T23:19:37.143003+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:16.321400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:38.171996+0000","last_change":"2024-09-15T23:19:35.625964+0000","last_active":"2024-09-15T23:19:38.171996+0000","last_peered":"2024-09-15T23:19:38.171996+0000","last_clean":"2024-09-15T23:19:38.171996+0000","last_became_active":"2024-09-15T23:19:35.625432+0000","last_became_peered":"2024-09-15T23:19:35.625432+0000","last_unstale":"2024-09-15T23:19:38.171996+0000","last_undegraded":"2024-09-15T23:19:38.171996+0000","last_fullsized":"2024-09-15T23:19:38.171996+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:02.167994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.608013+0000","last_change":"2024-09-15T23:19:35.626550+0000","last_active":"2024-09-15T23:19:36.608013+0000","last_peered":"2024-09-15T23:19:36.608013+0000","last_clean":"2024-09-15T23:19:36.608013+0000","last_became_active":"2024-09-15T23:19:35.626223+0000","last_became_peered":"2024-09-15T23:19:35.626223+0000","last_unstale":"2024-09-15T23:19:36.608013+0000","last_undegraded":"2024-09-15T23:19:36.608013+0000","last_fullsized":"2024-09-15T23:19:36.608013+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:25.327208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.142517+0000","last_change":"2024-09-15T23:19:35.635024+0000","last_active":"2024-09-15T23:19:37.142517+0000","last_peered":"2024-09-15T23:19:37.142517+0000","last_clean":"2024-09-15T23:19:37.142517+0000","last_became_active":"2024-09-15T23:19:35.634125+0000","last_became_peered":"2024-09-15T23:19:35.634125+0000","last_unstale":"2024-09-15T23:19:37.142517+0000","last_undegraded":"2024-09-15T23:19:37.142517+0000","last_fullsized":"2024-09-15T23:19:37.142517+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:59:37.581929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.142499+0000","last_change":"2024-09-15T23:19:35.627210+0000","last_active":"2024-09-15T23:19:37.142499+0000","last_peered":"2024-09-15T23:19:37.142499+0000","last_clean":"2024-09-15T23:19:37.142499+0000","last_became_active":"2024-09-15T23:19:35.626865+0000","last_became_peered":"2024-09-15T23:19:35.626865+0000","last_unstale":"2024-09-15T23:19:37.142499+0000","last_undegraded":"2024-09-15T23:19:37.142499+0000","last_fullsized":"2024-09-15T23:19:37.142499+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:53.597182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.608006+0000","last_change":"2024-09-15T23:19:35.612665+0000","last_active":"2024-09-15T23:19:36.608006+0000","last_peered":"2024-09-15T23:19:36.608006+0000","last_clean":"2024-09-15T23:19:36.608006+0000","last_became_active":"2024-09-15T23:19:35.612378+0000","last_became_peered":"2024-09-15T23:19:35.612378+0000","last_unstale":"2024-09-15T23:19:36.608006+0000","last_undegraded":"2024-09-15T23:19:36.608006+0000","last_fullsized":"2024-09-15T23:19:36.608006+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:25.497397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.706699+0000","last_change":"2024-09-15T23:19:35.628263+0000","last_active":"2024-09-15T23:19:37.706699+0000","last_peered":"2024-09-15T23:19:37.706699+0000","last_clean":"2024-09-15T23:19:37.706699+0000","last_became_active":"2024-09-15T23:19:35.628003+0000","last_became_peered":"2024-09-15T23:19:35.628003+0000","last_unstale":"2024-09-15T23:19:37.706699+0000","last_undegraded":"2024-09-15T23:19:37.706699+0000","last_fullsized":"2024-09-15T23:19:37.706699+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:53:33.405346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:38.172009+0000","last_change":"2024-09-15T23:19:35.626009+0000","last_active":"2024-09-15T23:19:38.172009+0000","last_peered":"2024-09-15T23:19:38.172009+0000","last_clean":"2024-09-15T23:19:38.172009+0000","last_became_active":"2024-09-15T23:19:35.625557+0000","last_became_peered":"2024-09-15T23:19:35.625557+0000","last_unstale":"2024-09-15T23:19:38.172009+0000","last_undegraded":"2024-09-15T23:19:38.172009+0000","last_fullsized":"2024-09-15T23:19:38.172009+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:47:35.415721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1f","version":"141'4","reported_seq":18,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.631257+0000","last_change":"2024-09-15T23:19:34.596627+0000","last_active":"2024-09-15T23:19:36.631257+0000","last_peered":"2024-09-15T23:19:36.631257+0000","last_clean":"2024-09-15T23:19:36.631257+0000","last_became_active":"2024-09-15T23:19:34.595982+0000","last_became_peered":"2024-09-15T23:19:34.595982+0000","last_unstale":"2024-09-15T23:19:36.631257+0000","last_undegraded":"2024-09-15T23:19:36.631257+0000","last_fullsized":"2024-09-15T23:19:36.631257+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:50.862136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.706917+0000","last_change":"2024-09-15T23:19:35.629327+0000","last_active":"2024-09-15T23:19:37.706917+0000","last_peered":"2024-09-15T23:19:37.706917+0000","last_clean":"2024-09-15T23:19:37.706917+0000","last_became_active":"2024-09-15T23:19:35.628984+0000","last_became_peered":"2024-09-15T23:19:35.628984+0000","last_unstale":"2024-09-15T23:19:37.706917+0000","last_undegraded":"2024-09-15T23:19:37.706917+0000","last_fullsized":"2024-09-15T23:19:37.706917+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:48.683758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1e","version":"141'1","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.706921+0000","last_change":"2024-09-15T23:19:34.594991+0000","last_active":"2024-09-15T23:19:37.706921+0000","last_peered":"2024-09-15T23:19:37.706921+0000","last_clean":"2024-09-15T23:19:37.706921+0000","last_became_active":"2024-09-15T23:19:34.594713+0000","last_became_peered":"2024-09-15T23:19:34.594713+0000","last_unstale":"2024-09-15T23:19:37.706921+0000","last_undegraded":"2024-09-15T23:19:37.706921+0000","last_fullsized":"2024-09-15T23:19:37.706921+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:24:05.421984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.706757+0000","last_change":"2024-09-15T23:19:35.616170+0000","last_active":"2024-09-15T23:19:37.706757+0000","last_peered":"2024-09-15T23:19:37.706757+0000","last_clean":"2024-09-15T23:19:37.706757+0000","last_became_active":"2024-09-15T23:19:35.615935+0000","last_became_peered":"2024-09-15T23:19:35.615935+0000","last_unstale":"2024-09-15T23:19:37.706757+0000","last_undegraded":"2024-09-15T23:19:37.706757+0000","last_fullsized":"2024-09-15T23:19:37.706757+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:57:39.829586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1d","version":"141'2","reported_seq":16,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.607508+0000","last_change":"2024-09-15T23:19:34.591811+0000","last_active":"2024-09-15T23:19:36.607508+0000","last_peered":"2024-09-15T23:19:36.607508+0000","last_clean":"2024-09-15T23:19:36.607508+0000","last_became_active":"2024-09-15T23:19:34.590764+0000","last_became_peered":"2024-09-15T23:19:34.590764+0000","last_unstale":"2024-09-15T23:19:36.607508+0000","last_undegraded":"2024-09-15T23:19:36.607508+0000","last_fullsized":"2024-09-15T23:19:36.607508+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:15:04.941661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.633258+0000","last_change":"2024-09-15T23:19:35.626587+0000","last_active":"2024-09-15T23:19:36.633258+0000","last_peered":"2024-09-15T23:19:36.633258+0000","last_clean":"2024-09-15T23:19:36.633258+0000","last_became_active":"2024-09-15T23:19:35.626234+0000","last_became_peered":"2024-09-15T23:19:35.626234+0000","last_unstale":"2024-09-15T23:19:36.633258+0000","last_undegraded":"2024-09-15T23:19:36.633258+0000","last_fullsized":"2024-09-15T23:19:36.633258+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:45:34.277310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1c","version":"141'2","reported_seq":16,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.142681+0000","last_change":"2024-09-15T23:19:34.599647+0000","last_active":"2024-09-15T23:19:37.142681+0000","last_peered":"2024-09-15T23:19:37.142681+0000","last_clean":"2024-09-15T23:19:37.142681+0000","last_became_active":"2024-09-15T23:19:34.599381+0000","last_became_peered":"2024-09-15T23:19:34.599381+0000","last_unstale":"2024-09-15T23:19:37.142681+0000","last_undegraded":"2024-09-15T23:19:37.142681+0000","last_fullsized":"2024-09-15T23:19:37.142681+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:32.559903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.608129+0000","last_change":"2024-09-15T23:19:35.619214+0000","last_active":"2024-09-15T23:19:36.608129+0000","last_peered":"2024-09-15T23:19:36.608129+0000","last_clean":"2024-09-15T23:19:36.608129+0000","last_became_active":"2024-09-15T23:19:35.618944+0000","last_became_peered":"2024-09-15T23:19:35.618944+0000","last_unstale":"2024-09-15T23:19:36.608129+0000","last_undegraded":"2024-09-15T23:19:36.608129+0000","last_fullsized":"2024-09-15T23:19:36.608129+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:45.319991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1b","version":"141'1","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.142427+0000","last_change":"2024-09-15T23:19:34.596580+0000","last_active":"2024-09-15T23:19:37.142427+0000","last_peered":"2024-09-15T23:19:37.142427+0000","last_clean":"2024-09-15T23:19:37.142427+0000","last_became_active":"2024-09-15T23:19:34.596299+0000","last_became_peered":"2024-09-15T23:19:34.596299+0000","last_unstale":"2024-09-15T23:19:37.142427+0000","last_undegraded":"2024-09-15T23:19:37.142427+0000","last_fullsized":"2024-09-15T23:19:37.142427+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:00.747606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.632987+0000","last_change":"2024-09-15T23:19:35.631523+0000","last_active":"2024-09-15T23:19:36.632987+0000","last_peered":"2024-09-15T23:19:36.632987+0000","last_clean":"2024-09-15T23:19:36.632987+0000","last_became_active":"2024-09-15T23:19:35.631206+0000","last_became_peered":"2024-09-15T23:19:35.631206+0000","last_unstale":"2024-09-15T23:19:36.632987+0000","last_undegraded":"2024-09-15T23:19:36.632987+0000","last_fullsized":"2024-09-15T23:19:36.632987+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:23.656736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"141'1","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.608119+0000","last_change":"2024-09-15T23:19:34.596781+0000","last_active":"2024-09-15T23:19:36.608119+0000","last_peered":"2024-09-15T23:19:36.608119+0000","last_clean":"2024-09-15T23:19:36.608119+0000","last_became_active":"2024-09-15T23:19:34.594440+0000","last_became_peered":"2024-09-15T23:19:34.594440+0000","last_unstale":"2024-09-15T23:19:36.608119+0000","last_undegraded":"2024-09-15T23:19:36.608119+0000","last_fullsized":"2024-09-15T23:19:36.608119+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:57.692753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.632811+0000","last_change":"2024-09-15T23:19:35.612299+0000","last_active":"2024-09-15T23:19:36.632811+0000","last_peered":"2024-09-15T23:19:36.632811+0000","last_clean":"2024-09-15T23:19:36.632811+0000","last_became_active":"2024-09-15T23:19:35.609861+0000","last_became_peered":"2024-09-15T23:19:35.609861+0000","last_unstale":"2024-09-15T23:19:36.632811+0000","last_undegraded":"2024-09-15T23:19:36.632811+0000","last_fullsized":"2024-09-15T23:19:36.632811+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:32:15.609252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.706610+0000","last_change":"2024-09-15T23:19:34.594035+0000","last_active":"2024-09-15T23:19:37.706610+0000","last_peered":"2024-09-15T23:19:37.706610+0000","last_clean":"2024-09-15T23:19:37.706610+0000","last_became_active":"2024-09-15T23:19:34.593752+0000","last_became_peered":"2024-09-15T23:19:34.593752+0000","last_unstale":"2024-09-15T23:19:37.706610+0000","last_undegraded":"2024-09-15T23:19:37.706610+0000","last_fullsized":"2024-09-15T23:19:37.706610+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:19:10.504998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.142384+0000","last_change":"2024-09-15T23:19:35.634002+0000","last_active":"2024-09-15T23:19:37.142384+0000","last_peered":"2024-09-15T23:19:37.142384+0000","last_clean":"2024-09-15T23:19:37.142384+0000","last_became_active":"2024-09-15T23:19:35.633706+0000","last_became_peered":"2024-09-15T23:19:35.633706+0000","last_unstale":"2024-09-15T23:19:37.142384+0000","last_undegraded":"2024-09-15T23:19:37.142384+0000","last_fullsized":"2024-09-15T23:19:37.142384+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:09:57.888826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.142353+0000","last_change":"2024-09-15T23:19:34.596861+0000","last_active":"2024-09-15T23:19:37.142353+0000","last_peered":"2024-09-15T23:19:37.142353+0000","last_clean":"2024-09-15T23:19:37.142353+0000","last_became_active":"2024-09-15T23:19:34.596589+0000","last_became_peered":"2024-09-15T23:19:34.596589+0000","last_unstale":"2024-09-15T23:19:37.142353+0000","last_undegraded":"2024-09-15T23:19:37.142353+0000","last_fullsized":"2024-09-15T23:19:37.142353+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:38:33.099410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.143003+0000","last_change":"2024-09-15T23:19:35.634159+0000","last_active":"2024-09-15T23:19:37.143003+0000","last_peered":"2024-09-15T23:19:37.143003+0000","last_clean":"2024-09-15T23:19:37.143003+0000","last_became_active":"2024-09-15T23:19:35.633883+0000","last_became_peered":"2024-09-15T23:19:35.633883+0000","last_unstale":"2024-09-15T23:19:37.143003+0000","last_undegraded":"2024-09-15T23:19:37.143003+0000","last_fullsized":"2024-09-15T23:19:37.143003+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:06:09.873881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.633190+0000","last_change":"2024-09-15T23:19:34.592476+0000","last_active":"2024-09-15T23:19:36.633190+0000","last_peered":"2024-09-15T23:19:36.633190+0000","last_clean":"2024-09-15T23:19:36.633190+0000","last_became_active":"2024-09-15T23:19:34.592187+0000","last_became_peered":"2024-09-15T23:19:34.592187+0000","last_unstale":"2024-09-15T23:19:36.633190+0000","last_undegraded":"2024-09-15T23:19:36.633190+0000","last_fullsized":"2024-09-15T23:19:36.633190+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:13:22.034976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.631205+0000","last_change":"2024-09-15T23:19:35.623362+0000","last_active":"2024-09-15T23:19:36.631205+0000","last_peered":"2024-09-15T23:19:36.631205+0000","last_clean":"2024-09-15T23:19:36.631205+0000","last_became_active":"2024-09-15T23:19:35.623044+0000","last_became_peered":"2024-09-15T23:19:35.623044+0000","last_unstale":"2024-09-15T23:19:36.631205+0000","last_undegraded":"2024-09-15T23:19:36.631205+0000","last_fullsized":"2024-09-15T23:19:36.631205+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:07:24.858935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.608424+0000","last_change":"2024-09-15T23:19:34.592974+0000","last_active":"2024-09-15T23:19:36.608424+0000","last_peered":"2024-09-15T23:19:36.608424+0000","last_clean":"2024-09-15T23:19:36.608424+0000","last_became_active":"2024-09-15T23:19:34.592445+0000","last_became_peered":"2024-09-15T23:19:34.592445+0000","last_unstale":"2024-09-15T23:19:36.608424+0000","last_undegraded":"2024-09-15T23:19:36.608424+0000","last_fullsized":"2024-09-15T23:19:36.608424+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:30:05.348767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.633279+0000","last_change":"2024-09-15T23:19:35.613109+0000","last_active":"2024-09-15T23:19:36.633279+0000","last_peered":"2024-09-15T23:19:36.633279+0000","last_clean":"2024-09-15T23:19:36.633279+0000","last_became_active":"2024-09-15T23:19:35.612819+0000","last_became_peered":"2024-09-15T23:19:35.612819+0000","last_unstale":"2024-09-15T23:19:36.633279+0000","last_undegraded":"2024-09-15T23:19:36.633279+0000","last_fullsized":"2024-09-15T23:19:36.633279+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:34.865411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.15","version":"141'3","reported_seq":17,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.631146+0000","last_change":"2024-09-15T23:19:34.595183+0000","last_active":"2024-09-15T23:19:36.631146+0000","last_peered":"2024-09-15T23:19:36.631146+0000","last_clean":"2024-09-15T23:19:36.631146+0000","last_became_active":"2024-09-15T23:19:34.594925+0000","last_became_peered":"2024-09-15T23:19:34.594925+0000","last_unstale":"2024-09-15T23:19:36.631146+0000","last_undegraded":"2024-09-15T23:19:36.631146+0000","last_fullsized":"2024-09-15T23:19:36.631146+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:21:17.322177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.608097+0000","last_change":"2024-09-15T23:19:35.611666+0000","last_active":"2024-09-15T23:19:36.608097+0000","last_peered":"2024-09-15T23:19:36.608097+0000","last_clean":"2024-09-15T23:19:36.608097+0000","last_became_active":"2024-09-15T23:19:35.611416+0000","last_became_peered":"2024-09-15T23:19:35.611416+0000","last_unstale":"2024-09-15T23:19:36.608097+0000","last_undegraded":"2024-09-15T23:19:36.608097+0000","last_fullsized":"2024-09-15T23:19:36.608097+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:44.666059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.14","version":"141'6","reported_seq":20,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.608068+0000","last_change":"2024-09-15T23:19:34.587541+0000","last_active":"2024-09-15T23:19:36.608068+0000","last_peered":"2024-09-15T23:19:36.608068+0000","last_clean":"2024-09-15T23:19:36.608068+0000","last_became_active":"2024-09-15T23:19:34.587292+0000","last_became_peered":"2024-09-15T23:19:34.587292+0000","last_unstale":"2024-09-15T23:19:36.608068+0000","last_undegraded":"2024-09-15T23:19:36.608068+0000","last_fullsized":"2024-09-15T23:19:36.608068+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:24:36.506408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:38.171905+0000","last_change":"2024-09-15T23:19:35.628636+0000","last_active":"2024-09-15T23:19:38.171905+0000","last_peered":"2024-09-15T23:19:38.171905+0000","last_clean":"2024-09-15T23:19:38.171905+0000","last_became_active":"2024-09-15T23:19:35.628358+0000","last_became_peered":"2024-09-15T23:19:35.628358+0000","last_unstale":"2024-09-15T23:19:38.171905+0000","last_undegraded":"2024-09-15T23:19:38.171905+0000","last_fullsized":"2024-09-15T23:19:38.171905+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:27:21.784008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:38.171984+0000","last_change":"2024-09-15T23:19:34.595328+0000","last_active":"2024-09-15T23:19:38.171984+0000","last_peered":"2024-09-15T23:19:38.171984+0000","last_clean":"2024-09-15T23:19:38.171984+0000","last_became_active":"2024-09-15T23:19:34.595049+0000","last_became_peered":"2024-09-15T23:19:34.595049+0000","last_unstale":"2024-09-15T23:19:38.171984+0000","last_undegraded":"2024-09-15T23:19:38.171984+0000","last_fullsized":"2024-09-15T23:19:38.171984+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:32:14.607742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:38.171605+0000","last_change":"2024-09-15T23:19:35.626673+0000","last_active":"2024-09-15T23:19:38.171605+0000","last_peered":"2024-09-15T23:19:38.171605+0000","last_clean":"2024-09-15T23:19:38.171605+0000","last_became_active":"2024-09-15T23:19:35.626396+0000","last_became_peered":"2024-09-15T23:19:35.626396+0000","last_unstale":"2024-09-15T23:19:38.171605+0000","last_undegraded":"2024-09-15T23:19:38.171605+0000","last_fullsized":"2024-09-15T23:19:38.171605+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:41:23.841559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.607347+0000","last_change":"2024-09-15T23:19:34.591104+0000","last_active":"2024-09-15T23:19:36.607347+0000","last_peered":"2024-09-15T23:19:36.607347+0000","last_clean":"2024-09-15T23:19:36.607347+0000","last_became_active":"2024-09-15T23:19:34.590768+0000","last_became_peered":"2024-09-15T23:19:34.590768+0000","last_unstale":"2024-09-15T23:19:36.607347+0000","last_undegraded":"2024-09-15T23:19:36.607347+0000","last_fullsized":"2024-09-15T23:19:36.607347+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:32:36.307046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.632844+0000","last_change":"2024-09-15T23:19:35.610315+0000","last_active":"2024-09-15T23:19:36.632844+0000","last_peered":"2024-09-15T23:19:36.632844+0000","last_clean":"2024-09-15T23:19:36.632844+0000","last_became_active":"2024-09-15T23:19:35.610066+0000","last_became_peered":"2024-09-15T23:19:35.610066+0000","last_unstale":"2024-09-15T23:19:36.632844+0000","last_undegraded":"2024-09-15T23:19:36.632844+0000","last_fullsized":"2024-09-15T23:19:36.632844+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:16:17.312149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.10","version":"141'8","reported_seq":22,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.632755+0000","last_change":"2024-09-15T23:19:34.596238+0000","last_active":"2024-09-15T23:19:36.632755+0000","last_peered":"2024-09-15T23:19:36.632755+0000","last_clean":"2024-09-15T23:19:36.632755+0000","last_became_active":"2024-09-15T23:19:34.596003+0000","last_became_peered":"2024-09-15T23:19:34.596003+0000","last_unstale":"2024-09-15T23:19:36.632755+0000","last_undegraded":"2024-09-15T23:19:36.632755+0000","last_fullsized":"2024-09-15T23:19:36.632755+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:35:03.904979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.631167+0000","last_change":"2024-09-15T23:19:35.627429+0000","last_active":"2024-09-15T23:19:36.631167+0000","last_peered":"2024-09-15T23:19:36.631167+0000","last_clean":"2024-09-15T23:19:36.631167+0000","last_became_active":"2024-09-15T23:19:35.626804+0000","last_became_peered":"2024-09-15T23:19:35.626804+0000","last_unstale":"2024-09-15T23:19:36.631167+0000","last_undegraded":"2024-09-15T23:19:36.631167+0000","last_fullsized":"2024-09-15T23:19:36.631167+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:27:56.286543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.f","version":"141'1","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.633238+0000","last_change":"2024-09-15T23:19:34.588416+0000","last_active":"2024-09-15T23:19:36.633238+0000","last_peered":"2024-09-15T23:19:36.633238+0000","last_clean":"2024-09-15T23:19:36.633238+0000","last_became_active":"2024-09-15T23:19:34.588163+0000","last_became_peered":"2024-09-15T23:19:34.588163+0000","last_unstale":"2024-09-15T23:19:36.633238+0000","last_undegraded":"2024-09-15T23:19:36.633238+0000","last_fullsized":"2024-09-15T23:19:36.633238+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:50.862136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.631244+0000","last_change":"2024-09-15T23:19:35.627431+0000","last_active":"2024-09-15T23:19:36.631244+0000","last_peered":"2024-09-15T23:19:36.631244+0000","last_clean":"2024-09-15T23:19:36.631244+0000","last_became_active":"2024-09-15T23:19:35.627154+0000","last_became_peered":"2024-09-15T23:19:35.627154+0000","last_unstale":"2024-09-15T23:19:36.631244+0000","last_undegraded":"2024-09-15T23:19:36.631244+0000","last_fullsized":"2024-09-15T23:19:36.631244+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:07.222960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"141'2","reported_seq":16,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.607563+0000","last_change":"2024-09-15T23:19:34.590161+0000","last_active":"2024-09-15T23:19:36.607563+0000","last_peered":"2024-09-15T23:19:36.607563+0000","last_clean":"2024-09-15T23:19:36.607563+0000","last_became_active":"2024-09-15T23:19:34.586613+0000","last_became_peered":"2024-09-15T23:19:34.586613+0000","last_unstale":"2024-09-15T23:19:36.607563+0000","last_undegraded":"2024-09-15T23:19:36.607563+0000","last_fullsized":"2024-09-15T23:19:36.607563+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:15.297166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.142671+0000","last_change":"2024-09-15T23:19:35.632211+0000","last_active":"2024-09-15T23:19:37.142671+0000","last_peered":"2024-09-15T23:19:37.142671+0000","last_clean":"2024-09-15T23:19:37.142671+0000","last_became_active":"2024-09-15T23:19:35.631935+0000","last_became_peered":"2024-09-15T23:19:35.631935+0000","last_unstale":"2024-09-15T23:19:37.142671+0000","last_undegraded":"2024-09-15T23:19:37.142671+0000","last_fullsized":"2024-09-15T23:19:37.142671+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:02:47.595567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.d","version":"141'1","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.706972+0000","last_change":"2024-09-15T23:19:34.596622+0000","last_active":"2024-09-15T23:19:37.706972+0000","last_peered":"2024-09-15T23:19:37.706972+0000","last_clean":"2024-09-15T23:19:37.706972+0000","last_became_active":"2024-09-15T23:19:34.596380+0000","last_became_peered":"2024-09-15T23:19:34.596380+0000","last_unstale":"2024-09-15T23:19:37.706972+0000","last_undegraded":"2024-09-15T23:19:37.706972+0000","last_fullsized":"2024-09-15T23:19:37.706972+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:04:53.277586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.142647+0000","last_change":"2024-09-15T23:19:35.636401+0000","last_active":"2024-09-15T23:19:37.142647+0000","last_peered":"2024-09-15T23:19:37.142647+0000","last_clean":"2024-09-15T23:19:37.142647+0000","last_became_active":"2024-09-15T23:19:35.635214+0000","last_became_peered":"2024-09-15T23:19:35.635214+0000","last_unstale":"2024-09-15T23:19:37.142647+0000","last_undegraded":"2024-09-15T23:19:37.142647+0000","last_fullsized":"2024-09-15T23:19:37.142647+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:05:57.828006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.631015+0000","last_change":"2024-09-15T23:19:34.594835+0000","last_active":"2024-09-15T23:19:36.631015+0000","last_peered":"2024-09-15T23:19:36.631015+0000","last_clean":"2024-09-15T23:19:36.631015+0000","last_became_active":"2024-09-15T23:19:34.594581+0000","last_became_peered":"2024-09-15T23:19:34.594581+0000","last_unstale":"2024-09-15T23:19:36.631015+0000","last_undegraded":"2024-09-15T23:19:36.631015+0000","last_fullsized":"2024-09-15T23:19:36.631015+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:35:03.904979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.142789+0000","last_change":"2024-09-15T23:19:35.632888+0000","last_active":"2024-09-15T23:19:37.142789+0000","last_peered":"2024-09-15T23:19:37.142789+0000","last_clean":"2024-09-15T23:19:37.142789+0000","last_became_active":"2024-09-15T23:19:35.631987+0000","last_became_peered":"2024-09-15T23:19:35.631987+0000","last_unstale":"2024-09-15T23:19:37.142789+0000","last_undegraded":"2024-09-15T23:19:37.142789+0000","last_fullsized":"2024-09-15T23:19:37.142789+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:49.741289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.b","version":"141'2","reported_seq":16,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.706744+0000","last_change":"2024-09-15T23:19:34.597050+0000","last_active":"2024-09-15T23:19:37.706744+0000","last_peered":"2024-09-15T23:19:37.706744+0000","last_clean":"2024-09-15T23:19:37.706744+0000","last_became_active":"2024-09-15T23:19:34.596136+0000","last_became_peered":"2024-09-15T23:19:34.596136+0000","last_unstale":"2024-09-15T23:19:37.706744+0000","last_undegraded":"2024-09-15T23:19:37.706744+0000","last_fullsized":"2024-09-15T23:19:37.706744+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:47:11.343828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.607970+0000","last_change":"2024-09-15T23:19:35.614820+0000","last_active":"2024-09-15T23:19:36.607970+0000","last_peered":"2024-09-15T23:19:36.607970+0000","last_clean":"2024-09-15T23:19:36.607970+0000","last_became_active":"2024-09-15T23:19:35.614503+0000","last_became_peered":"2024-09-15T23:19:35.614503+0000","last_unstale":"2024-09-15T23:19:36.607970+0000","last_undegraded":"2024-09-15T23:19:36.607970+0000","last_fullsized":"2024-09-15T23:19:36.607970+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:30:06.350277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.608237+0000","last_change":"2024-09-15T23:19:34.597396+0000","last_active":"2024-09-15T23:19:36.608237+0000","last_peered":"2024-09-15T23:19:36.608237+0000","last_clean":"2024-09-15T23:19:36.608237+0000","last_became_active":"2024-09-15T23:19:34.595843+0000","last_became_peered":"2024-09-15T23:19:34.595843+0000","last_unstale":"2024-09-15T23:19:36.608237+0000","last_undegraded":"2024-09-15T23:19:36.608237+0000","last_fullsized":"2024-09-15T23:19:36.608237+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:24.495888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:38.171817+0000","last_change":"2024-09-15T23:19:35.623235+0000","last_active":"2024-09-15T23:19:38.171817+0000","last_peered":"2024-09-15T23:19:38.171817+0000","last_clean":"2024-09-15T23:19:38.171817+0000","last_became_active":"2024-09-15T23:19:35.622976+0000","last_became_peered":"2024-09-15T23:19:35.622976+0000","last_unstale":"2024-09-15T23:19:38.171817+0000","last_undegraded":"2024-09-15T23:19:38.171817+0000","last_fullsized":"2024-09-15T23:19:38.171817+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:32.636802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:38.171626+0000","last_change":"2024-09-15T23:19:34.597859+0000","last_active":"2024-09-15T23:19:38.171626+0000","last_peered":"2024-09-15T23:19:38.171626+0000","last_clean":"2024-09-15T23:19:38.171626+0000","last_became_active":"2024-09-15T23:19:34.597561+0000","last_became_peered":"2024-09-15T23:19:34.597561+0000","last_unstale":"2024-09-15T23:19:38.171626+0000","last_undegraded":"2024-09-15T23:19:38.171626+0000","last_fullsized":"2024-09-15T23:19:38.171626+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:13:21.067550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.632898+0000","last_change":"2024-09-15T23:19:35.612610+0000","last_active":"2024-09-15T23:19:36.632898+0000","last_peered":"2024-09-15T23:19:36.632898+0000","last_clean":"2024-09-15T23:19:36.632898+0000","last_became_active":"2024-09-15T23:19:35.612305+0000","last_became_peered":"2024-09-15T23:19:35.612305+0000","last_unstale":"2024-09-15T23:19:36.632898+0000","last_undegraded":"2024-09-15T23:19:36.632898+0000","last_fullsized":"2024-09-15T23:19:36.632898+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:13:22.069059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.607078+0000","last_change":"2024-09-15T23:19:34.591315+0000","last_active":"2024-09-15T23:19:36.607078+0000","last_peered":"2024-09-15T23:19:36.607078+0000","last_clean":"2024-09-15T23:19:36.607078+0000","last_became_active":"2024-09-15T23:19:34.590567+0000","last_became_peered":"2024-09-15T23:19:34.590567+0000","last_unstale":"2024-09-15T23:19:36.607078+0000","last_undegraded":"2024-09-15T23:19:36.607078+0000","last_fullsized":"2024-09-15T23:19:36.607078+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:45:24.682806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.608117+0000","last_change":"2024-09-15T23:19:35.609751+0000","last_active":"2024-09-15T23:19:36.608117+0000","last_peered":"2024-09-15T23:19:36.608117+0000","last_clean":"2024-09-15T23:19:36.608117+0000","last_became_active":"2024-09-15T23:19:35.609480+0000","last_became_peered":"2024-09-15T23:19:35.609480+0000","last_unstale":"2024-09-15T23:19:36.608117+0000","last_undegraded":"2024-09-15T23:19:36.608117+0000","last_fullsized":"2024-09-15T23:19:36.608117+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:57:09.438860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.7","version":"141'2","reported_seq":16,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.608643+0000","last_change":"2024-09-15T23:19:34.596662+0000","last_active":"2024-09-15T23:19:36.608643+0000","last_peered":"2024-09-15T23:19:36.608643+0000","last_clean":"2024-09-15T23:19:36.608643+0000","last_became_active":"2024-09-15T23:19:34.596339+0000","last_became_peered":"2024-09-15T23:19:34.596339+0000","last_unstale":"2024-09-15T23:19:36.608643+0000","last_undegraded":"2024-09-15T23:19:36.608643+0000","last_fullsized":"2024-09-15T23:19:36.608643+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:10.329268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.142869+0000","last_change":"2024-09-15T23:19:35.632263+0000","last_active":"2024-09-15T23:19:37.142869+0000","last_peered":"2024-09-15T23:19:37.142869+0000","last_clean":"2024-09-15T23:19:37.142869+0000","last_became_active":"2024-09-15T23:19:35.631768+0000","last_became_peered":"2024-09-15T23:19:35.631768+0000","last_unstale":"2024-09-15T23:19:37.142869+0000","last_undegraded":"2024-09-15T23:19:37.142869+0000","last_fullsized":"2024-09-15T23:19:37.142869+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:11:21.693532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.6","version":"142'1","reported_seq":15,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.631148+0000","last_change":"2024-09-15T23:19:34.595339+0000","last_active":"2024-09-15T23:19:36.631148+0000","last_peered":"2024-09-15T23:19:36.631148+0000","last_clean":"2024-09-15T23:19:36.631148+0000","last_became_active":"2024-09-15T23:19:34.594966+0000","last_became_peered":"2024-09-15T23:19:34.594966+0000","last_unstale":"2024-09-15T23:19:36.631148+0000","last_undegraded":"2024-09-15T23:19:36.631148+0000","last_fullsized":"2024-09-15T23:19:36.631148+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:13:22.034976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:38.172093+0000","last_change":"2024-09-15T23:19:35.633878+0000","last_active":"2024-09-15T23:19:38.172093+0000","last_peered":"2024-09-15T23:19:38.172093+0000","last_clean":"2024-09-15T23:19:38.172093+0000","last_became_active":"2024-09-15T23:19:35.633565+0000","last_became_peered":"2024-09-15T23:19:35.633565+0000","last_unstale":"2024-09-15T23:19:38.172093+0000","last_undegraded":"2024-09-15T23:19:38.172093+0000","last_fullsized":"2024-09-15T23:19:38.172093+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:00.741814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.608439+0000","last_change":"2024-09-15T23:19:34.595426+0000","last_active":"2024-09-15T23:19:36.608439+0000","last_peered":"2024-09-15T23:19:36.608439+0000","last_clean":"2024-09-15T23:19:36.608439+0000","last_became_active":"2024-09-15T23:19:34.594537+0000","last_became_peered":"2024-09-15T23:19:34.594537+0000","last_unstale":"2024-09-15T23:19:36.608439+0000","last_undegraded":"2024-09-15T23:19:36.608439+0000","last_fullsized":"2024-09-15T23:19:36.608439+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:56.083665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.707002+0000","last_change":"2024-09-15T23:19:35.613053+0000","last_active":"2024-09-15T23:19:37.707002+0000","last_peered":"2024-09-15T23:19:37.707002+0000","last_clean":"2024-09-15T23:19:37.707002+0000","last_became_active":"2024-09-15T23:19:35.612781+0000","last_became_peered":"2024-09-15T23:19:35.612781+0000","last_unstale":"2024-09-15T23:19:37.707002+0000","last_undegraded":"2024-09-15T23:19:37.707002+0000","last_fullsized":"2024-09-15T23:19:37.707002+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:01.754948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:38.172008+0000","last_change":"2024-09-15T23:19:34.592540+0000","last_active":"2024-09-15T23:19:38.172008+0000","last_peered":"2024-09-15T23:19:38.172008+0000","last_clean":"2024-09-15T23:19:38.172008+0000","last_became_active":"2024-09-15T23:19:34.592184+0000","last_became_peered":"2024-09-15T23:19:34.592184+0000","last_unstale":"2024-09-15T23:19:38.172008+0000","last_undegraded":"2024-09-15T23:19:38.172008+0000","last_fullsized":"2024-09-15T23:19:38.172008+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:08:30.731469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.632949+0000","last_change":"2024-09-15T23:19:35.618215+0000","last_active":"2024-09-15T23:19:36.632949+0000","last_peered":"2024-09-15T23:19:36.632949+0000","last_clean":"2024-09-15T23:19:36.632949+0000","last_became_active":"2024-09-15T23:19:35.617934+0000","last_became_peered":"2024-09-15T23:19:35.617934+0000","last_unstale":"2024-09-15T23:19:36.632949+0000","last_undegraded":"2024-09-15T23:19:36.632949+0000","last_fullsized":"2024-09-15T23:19:36.632949+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:15.373058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.142561+0000","last_change":"2024-09-15T23:19:34.598761+0000","last_active":"2024-09-15T23:19:37.142561+0000","last_peered":"2024-09-15T23:19:37.142561+0000","last_clean":"2024-09-15T23:19:37.142561+0000","last_became_active":"2024-09-15T23:19:34.598474+0000","last_became_peered":"2024-09-15T23:19:34.598474+0000","last_unstale":"2024-09-15T23:19:37.142561+0000","last_undegraded":"2024-09-15T23:19:37.142561+0000","last_fullsized":"2024-09-15T23:19:37.142561+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:11.986189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.633305+0000","last_change":"2024-09-15T23:19:35.626752+0000","last_active":"2024-09-15T23:19:36.633305+0000","last_peered":"2024-09-15T23:19:36.633305+0000","last_clean":"2024-09-15T23:19:36.633305+0000","last_became_active":"2024-09-15T23:19:35.626133+0000","last_became_peered":"2024-09-15T23:19:35.626133+0000","last_unstale":"2024-09-15T23:19:36.633305+0000","last_undegraded":"2024-09-15T23:19:36.633305+0000","last_fullsized":"2024-09-15T23:19:36.633305+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:30.170171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.632968+0000","last_change":"2024-09-15T23:19:34.590950+0000","last_active":"2024-09-15T23:19:36.632968+0000","last_peered":"2024-09-15T23:19:36.632968+0000","last_clean":"2024-09-15T23:19:36.632968+0000","last_became_active":"2024-09-15T23:19:34.590703+0000","last_became_peered":"2024-09-15T23:19:34.590703+0000","last_unstale":"2024-09-15T23:19:36.632968+0000","last_undegraded":"2024-09-15T23:19:36.632968+0000","last_fullsized":"2024-09-15T23:19:36.632968+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:21:17.322177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.607776+0000","last_change":"2024-09-15T23:19:35.616698+0000","last_active":"2024-09-15T23:19:36.607776+0000","last_peered":"2024-09-15T23:19:36.607776+0000","last_clean":"2024-09-15T23:19:36.607776+0000","last_became_active":"2024-09-15T23:19:35.615861+0000","last_became_peered":"2024-09-15T23:19:35.615861+0000","last_unstale":"2024-09-15T23:19:36.607776+0000","last_undegraded":"2024-09-15T23:19:36.607776+0000","last_fullsized":"2024-09-15T23:19:36.607776+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:00:28.633228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.607433+0000","last_change":"2024-09-15T23:19:34.591465+0000","last_active":"2024-09-15T23:19:36.607433+0000","last_peered":"2024-09-15T23:19:36.607433+0000","last_clean":"2024-09-15T23:19:36.607433+0000","last_became_active":"2024-09-15T23:19:34.590999+0000","last_became_peered":"2024-09-15T23:19:34.590999+0000","last_unstale":"2024-09-15T23:19:36.607433+0000","last_undegraded":"2024-09-15T23:19:36.607433+0000","last_fullsized":"2024-09-15T23:19:36.607433+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:00.747606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:38.171679+0000","last_change":"2024-09-15T23:19:35.626540+0000","last_active":"2024-09-15T23:19:38.171679+0000","last_peered":"2024-09-15T23:19:38.171679+0000","last_clean":"2024-09-15T23:19:38.171679+0000","last_became_active":"2024-09-15T23:19:35.625997+0000","last_became_peered":"2024-09-15T23:19:35.625997+0000","last_unstale":"2024-09-15T23:19:38.171679+0000","last_undegraded":"2024-09-15T23:19:38.171679+0000","last_fullsized":"2024-09-15T23:19:38.171679+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:40:15.198465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":14,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:38.171956+0000","last_change":"2024-09-15T23:19:34.594881+0000","last_active":"2024-09-15T23:19:38.171956+0000","last_peered":"2024-09-15T23:19:38.171956+0000","last_clean":"2024-09-15T23:19:38.171956+0000","last_became_active":"2024-09-15T23:19:34.594542+0000","last_became_peered":"2024-09-15T23:19:34.594542+0000","last_unstale":"2024-09-15T23:19:38.171956+0000","last_undegraded":"2024-09-15T23:19:38.171956+0000","last_fullsized":"2024-09-15T23:19:38.171956+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:16:16.310640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":12,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:37.706699+0000","last_change":"2024-09-15T23:19:35.629292+0000","last_active":"2024-09-15T23:19:37.706699+0000","last_peered":"2024-09-15T23:19:37.706699+0000","last_clean":"2024-09-15T23:19:37.706699+0000","last_became_active":"2024-09-15T23:19:35.629014+0000","last_became_peered":"2024-09-15T23:19:35.629014+0000","last_unstale":"2024-09-15T23:19:37.706699+0000","last_undegraded":"2024-09-15T23:19:37.706699+0000","last_fullsized":"2024-09-15T23:19:37.706699+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:34.576871+0000","last_clean_scrub_stamp":"2024-09-15T23:19:34.576871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:26:20.890998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.13","version":"141'2","reported_seq":16,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.633332+0000","last_change":"2024-09-15T23:19:34.594919+0000","last_active":"2024-09-15T23:19:36.633332+0000","last_peered":"2024-09-15T23:19:36.633332+0000","last_clean":"2024-09-15T23:19:36.633332+0000","last_became_active":"2024-09-15T23:19:34.594639+0000","last_became_peered":"2024-09-15T23:19:34.594639+0000","last_unstale":"2024-09-15T23:19:36.633332+0000","last_undegraded":"2024-09-15T23:19:36.633332+0000","last_fullsized":"2024-09-15T23:19:36.633332+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":139,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:19:33.575362+0000","last_clean_scrub_stamp":"2024-09-15T23:19:33.575362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:20:42.218476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":393,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-15T23:19:36.607733+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:19:36.607733+0000","last_peered":"2024-09-15T23:19:36.607733+0000","last_clean":"2024-09-15T23:19:36.607733+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:19:36.607733+0000","last_undegraded":"2024-09-15T23:19:36.607733+0000","last_fullsized":"2024-09-15T23:19:36.607733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476833,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50956,"kb_used_data":1720,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320884,"statfs":{"total":96636764160,"available":96584585216,"internally_reserved":0,"allocated":1761280,"data_stored":776842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476830,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50960,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320880,"statfs":{"total":96636764160,"available":96584581120,"internally_reserved":0,"allocated":1765376,"data_stored":777444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476832,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47392,"kb_used_data":2312,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324448,"statfs":{"total":96636764160,"available":96588234752,"internally_reserved":0,"allocated":2367488,"data_stored":1368774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476832,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41248,"kb_used_data":1736,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330592,"statfs":{"total":96636764160,"available":96594526208,"internally_reserved":0,"allocated":1777664,"data_stored":778440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542239,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45396,"kb_used_data":1720,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94326444,"statfs":{"total":96636764160,"available":96590278656,"internally_reserved":0,"allocated":1761280,"data_stored":776806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":44693962},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542239,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50952,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320888,"statfs":{"total":96636764160,"available":96584589312,"internally_reserved":0,"allocated":1757184,"data_stored":776772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542238,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55704,"kb_used_data":2308,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316136,"statfs":{"total":96636764160,"available":96579723264,"internally_reserved":0,"allocated":2363392,"data_stored":1367882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542240,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50952,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320888,"statfs":{"total":96636764160,"available":96584589312,"internally_reserved":0,"allocated":1757184,"data_stored":776772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:19:43.213 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T23:19:43.214 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T23:19:43.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.354+0000 7fd420e4c640 1 Processor -- start 2024-09-15T23:19:43.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.354+0000 7fd420e4c640 1 -- start start 2024-09-15T23:19:43.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.355+0000 7fd420e4c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd41c0b7320 0x7fd41c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:43.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.355+0000 7fd420e4c640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd41c0b5a80 con 0x7fd41c06c150 2024-09-15T23:19:43.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.355+0000 7fd420e4c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd41c0b6ab0 con 0x7fd41c15c690 2024-09-15T23:19:43.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.355+0000 7fd420e4c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fd41c0b6620 con 0x7fd41c0b7320 2024-09-15T23:19:43.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.355+0000 7fd41ad9d640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd41c06c150 0x7fd41c15ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60728/0 (socket says 172.21.15.123:60728) 2024-09-15T23:19:43.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.355+0000 7fd41ad9d640 1 -- 172.21.15.123:0/3065735917 learned_addr learned my addr 172.21.15.123:0/3065735917 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:19:43.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.355+0000 7fd419d9b640 1 --2- 172.21.15.123:0/3065735917 >> v2:172.21.15.188:3300/0 conn(0x7fd41c0b7320 0x7fd41c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:43.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.356+0000 7fd41959a640 1 -- 172.21.15.123:0/3065735917 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3062785859 0 0) 0x7fd41c0b5a80 con 0x7fd41c06c150 2024-09-15T23:19:43.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.356+0000 7fd41959a640 1 -- 172.21.15.123:0/3065735917 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd404003520 con 0x7fd41c06c150 2024-09-15T23:19:43.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.356+0000 7fd41959a640 1 -- 172.21.15.123:0/3065735917 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1848657916 0 0) 0x7fd404003520 con 0x7fd41c06c150 2024-09-15T23:19:43.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.356+0000 7fd419d9b640 1 -- 172.21.15.123:0/3065735917 >> v1:172.21.15.188:6789/0 conn(0x7fd41c15c690 legacy=0x7fd41c0ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:43.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.356+0000 7fd419d9b640 1 -- 172.21.15.123:0/3065735917 >> v1:172.21.15.123:6789/0 conn(0x7fd41c06c150 legacy=0x7fd41c15ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:43.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.356+0000 7fd419d9b640 1 -- 172.21.15.123:0/3065735917 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd41c0b5cf0 con 0x7fd41c0b7320 2024-09-15T23:19:43.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.357+0000 7fd419d9b640 1 --2- 172.21.15.123:0/3065735917 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd41c0b7320 0x7fd41c06bc10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd4100097a0 tx=0x7fd41002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=893775540b143e93 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:43.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.357+0000 7fd41959a640 1 -- 172.21.15.123:0/3065735917 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd410037070 con 0x7fd41c0b7320 2024-09-15T23:19:43.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.357+0000 7fd41959a640 1 -- 172.21.15.123:0/3065735917 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd41002ac50 con 0x7fd41c0b7320 2024-09-15T23:19:43.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.357+0000 7fd41959a640 1 -- 172.21.15.123:0/3065735917 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4140019f0 con 0x7fd41c0b7320 2024-09-15T23:19:43.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.357+0000 7fd420e4c640 1 -- 172.21.15.123:0/3065735917 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd41c0b7320 msgr2=0x7fd41c06bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:43.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.357+0000 7fd420e4c640 1 --2- 172.21.15.123:0/3065735917 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd41c0b7320 0x7fd41c06bc10 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd4100097a0 tx=0x7fd41002a1c0 comp rx=0 tx=0).stop 2024-09-15T23:19:43.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.357+0000 7fd420e4c640 1 -- 172.21.15.123:0/3065735917 shutdown_connections 2024-09-15T23:19:43.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.357+0000 7fd420e4c640 1 --2- 172.21.15.123:0/3065735917 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd41c0b7320 0x7fd41c06bc10 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:43.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.357+0000 7fd420e4c640 1 -- 172.21.15.123:0/3065735917 >> 172.21.15.123:0/3065735917 conn(0x7fd41c06cd20 msgr2=0x7fd41c06d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:43.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.357+0000 7fd420e4c640 1 -- 172.21.15.123:0/3065735917 shutdown_connections 2024-09-15T23:19:43.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.357+0000 7fd420e4c640 1 -- 172.21.15.123:0/3065735917 wait complete. 2024-09-15T23:19:43.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.359+0000 7fd420e4c640 1 Processor -- start 2024-09-15T23:19:43.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.359+0000 7fd420e4c640 1 -- start start 2024-09-15T23:19:43.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.359+0000 7fd420e4c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd41c06c150 0x7fd41c0ab510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:43.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.359+0000 7fd420e4c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd41c0b7320 0x7fd41c0ce340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:43.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.359+0000 7fd420e4c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd41c15c690 0x7fd41c0ce880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:43.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.359+0000 7fd420e4c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c0b62b0 con 0x7fd41c0b7320 2024-09-15T23:19:43.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.359+0000 7fd420e4c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c0cf1b0 con 0x7fd41c15c690 2024-09-15T23:19:43.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.359+0000 7fd420e4c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd41c15d180 con 0x7fd41c06c150 2024-09-15T23:19:43.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.360+0000 7fd419d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd41c0b7320 0x7fd41c0ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:43.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.360+0000 7fd419d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd41c0b7320 0x7fd41c0ce340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49920/0 (socket says 172.21.15.123:49920) 2024-09-15T23:19:43.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.360+0000 7fd419d9b640 1 -- 172.21.15.123:0/611663628 learned_addr learned my addr 172.21.15.123:0/611663628 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:43.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.360+0000 7fd41ad9d640 1 --2- 172.21.15.123:0/611663628 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd41c15c690 0x7fd41c0ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:43.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.360+0000 7fd41a59c640 1 --2- 172.21.15.123:0/611663628 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd41c06c150 0x7fd41c0ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:43.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.360+0000 7fd419d9b640 1 -- 172.21.15.123:0/611663628 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd41c06c150 msgr2=0x7fd41c0ab510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:43.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.360+0000 7fd419d9b640 1 --2- 172.21.15.123:0/611663628 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd41c06c150 0x7fd41c0ab510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:43.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.360+0000 7fd419d9b640 1 -- 172.21.15.123:0/611663628 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd41c15c690 msgr2=0x7fd41c0ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:43.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.360+0000 7fd419d9b640 1 --2- 172.21.15.123:0/611663628 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd41c15c690 0x7fd41c0ce880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:43.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.360+0000 7fd419d9b640 1 -- 172.21.15.123:0/611663628 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd41c154eb0 con 0x7fd41c0b7320 2024-09-15T23:19:43.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.360+0000 7fd419d9b640 1 --2- 172.21.15.123:0/611663628 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd41c0b7320 0x7fd41c0ce340 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fd410035040 tx=0x7fd4100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:43.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.360+0000 7fd40affd640 1 -- 172.21.15.123:0/611663628 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd410037050 con 0x7fd41c0b7320 2024-09-15T23:19:43.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.360+0000 7fd40affd640 1 -- 172.21.15.123:0/611663628 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd410043070 con 0x7fd41c0b7320 2024-09-15T23:19:43.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.360+0000 7fd420e4c640 1 -- 172.21.15.123:0/611663628 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd41c155190 con 0x7fd41c0b7320 2024-09-15T23:19:43.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.360+0000 7fd40affd640 1 -- 172.21.15.123:0/611663628 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd410006e10 con 0x7fd41c0b7320 2024-09-15T23:19:43.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.360+0000 7fd420e4c640 1 -- 172.21.15.123:0/611663628 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd41c155750 con 0x7fd41c0b7320 2024-09-15T23:19:43.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.361+0000 7fd420e4c640 1 -- 172.21.15.123:0/611663628 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd41c06bc10 con 0x7fd41c0b7320 2024-09-15T23:19:43.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.362+0000 7fd40affd640 1 -- 172.21.15.123:0/611663628 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd41003c810 con 0x7fd41c0b7320 2024-09-15T23:19:43.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.362+0000 7fd40affd640 1 --2- 172.21.15.123:0/611663628 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd3fc06c2b0 0x7fd3fc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:43.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.362+0000 7fd40affd640 1 -- 172.21.15.123:0/611663628 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fd4100abc70 con 0x7fd41c0b7320 2024-09-15T23:19:43.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.363+0000 7fd41a59c640 1 --2- 172.21.15.123:0/611663628 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd3fc06c2b0 0x7fd3fc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:43.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.365+0000 7fd41a59c640 1 --2- 172.21.15.123:0/611663628 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd3fc06c2b0 0x7fd3fc06e770 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd40c000f60 tx=0x7fd40c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:43.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.366+0000 7fd40affd640 1 -- 172.21.15.123:0/611663628 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd410079eb0 con 0x7fd41c0b7320 2024-09-15T23:19:43.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.594+0000 7fd420e4c640 1 -- 172.21.15.123:0/611663628 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fd41c1e2e60 con 0x7fd41c0b7320 2024-09-15T23:19:43.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.596+0000 7fd40affd640 1 -- 172.21.15.123:0/611663628 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) ==== 190+0+147 (secure 0 0 0) 0x7fd41007e1b0 con 0x7fd41c0b7320 2024-09-15T23:19:43.597 INFO:teuthology.orchestra.run.smithi123.stdout:[client.0] 2024-09-15T23:19:43.597 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCNaedmzQPqJRAAhUf1dnVYohN4obCfeu8+7g== 2024-09-15T23:19:43.597 INFO:teuthology.orchestra.run.smithi123.stdout: caps mds = "allow" 2024-09-15T23:19:43.597 INFO:teuthology.orchestra.run.smithi123.stdout: caps mon = "allow r" 2024-09-15T23:19:43.597 INFO:teuthology.orchestra.run.smithi123.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T23:19:43.598 INFO:teuthology.orchestra.run.smithi123.stderr:updated caps for client.0 2024-09-15T23:19:43.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.598+0000 7fd420e4c640 1 -- 172.21.15.123:0/611663628 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd3fc06c2b0 msgr2=0x7fd3fc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:43.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.598+0000 7fd420e4c640 1 --2- 172.21.15.123:0/611663628 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd3fc06c2b0 0x7fd3fc06e770 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd40c000f60 tx=0x7fd40c009040 comp rx=0 tx=0).stop 2024-09-15T23:19:43.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.598+0000 7fd420e4c640 1 -- 172.21.15.123:0/611663628 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd41c0b7320 msgr2=0x7fd41c0ce340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:43.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.598+0000 7fd420e4c640 1 --2- 172.21.15.123:0/611663628 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd41c0b7320 0x7fd41c0ce340 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fd410035040 tx=0x7fd4100046c0 comp rx=0 tx=0).stop 2024-09-15T23:19:43.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.598+0000 7fd420e4c640 1 -- 172.21.15.123:0/611663628 shutdown_connections 2024-09-15T23:19:43.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.598+0000 7fd420e4c640 1 --2- 172.21.15.123:0/611663628 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd41c15c690 0x7fd41c0ce880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:43.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.598+0000 7fd420e4c640 1 --2- 172.21.15.123:0/611663628 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd3fc06c2b0 0x7fd3fc06e770 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:43.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.598+0000 7fd420e4c640 1 --2- 172.21.15.123:0/611663628 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd41c0b7320 0x7fd41c0ce340 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:43.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.598+0000 7fd420e4c640 1 --2- 172.21.15.123:0/611663628 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd41c06c150 0x7fd41c0ab510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:43.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.598+0000 7fd420e4c640 1 -- 172.21.15.123:0/611663628 >> 172.21.15.123:0/611663628 conn(0x7fd41c06cd20 msgr2=0x7fd41c159cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:43.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.598+0000 7fd420e4c640 1 -- 172.21.15.123:0/611663628 shutdown_connections 2024-09-15T23:19:43.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.598+0000 7fd420e4c640 1 -- 172.21.15.123:0/611663628 wait complete. 2024-09-15T23:19:43.610 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:19:43.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.710+0000 7f632ac5a640 1 Processor -- start 2024-09-15T23:19:43.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.710+0000 7f632ac5a640 1 -- start start 2024-09-15T23:19:43.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.710+0000 7f632ac5a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f63240b6970 0x7f63240b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:43.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.710+0000 7f632ac5a640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f63240d23b0 0x7f63240b8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:43.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.710+0000 7f632ac5a640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63240d0e70 con 0x7f632415ed20 2024-09-15T23:19:43.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.710+0000 7f632ac5a640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f63240d41c0 con 0x7f63240b6970 2024-09-15T23:19:43.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.710+0000 7f632ac5a640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f63240d35b0 con 0x7f63240d23b0 2024-09-15T23:19:43.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.711+0000 7f6323fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f63240b6970 0x7f63240b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:43.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.711+0000 7f63289f6640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f632415ed20 0x7f63240b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60738/0 (socket says 172.21.15.123:60738) 2024-09-15T23:19:43.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.711+0000 7f63289f6640 1 -- 172.21.15.123:0/372029924 learned_addr learned my addr 172.21.15.123:0/372029924 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:19:43.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.711+0000 7f6323fff640 1 -- 172.21.15.123:0/372029924 >> v2:172.21.15.188:3300/0 conn(0x7f63240d23b0 msgr2=0x7f63240b8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:43.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.711+0000 7f6323fff640 1 --2- 172.21.15.123:0/372029924 >> v2:172.21.15.188:3300/0 conn(0x7f63240d23b0 0x7f63240b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:43.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.711+0000 7f6323fff640 1 -- 172.21.15.123:0/372029924 >> v1:172.21.15.123:6789/0 conn(0x7f632415ed20 legacy=0x7f63240b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:43.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.711+0000 7f6323fff640 1 -- 172.21.15.123:0/372029924 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63240d3890 con 0x7f63240b6970 2024-09-15T23:19:43.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.711+0000 7f63237fe640 1 -- 172.21.15.123:0/372029924 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 132133663 0 0) 0x7f630c001110 con 0x7f632415ed20 2024-09-15T23:19:43.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.712+0000 7f6323fff640 1 --2- 172.21.15.123:0/372029924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63240b6970 0x7f63240b80d0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f63240d4130 tx=0x7f631402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee9138b7462d9d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:43.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.712+0000 7f63237fe640 1 -- 172.21.15.123:0/372029924 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6314037070 con 0x7f63240b6970 2024-09-15T23:19:43.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.712+0000 7f63237fe640 1 -- 172.21.15.123:0/372029924 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6314032440 con 0x7f63240b6970 2024-09-15T23:19:43.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.712+0000 7f63237fe640 1 -- 172.21.15.123:0/372029924 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631402ae60 con 0x7f63240b6970 2024-09-15T23:19:43.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.712+0000 7f632ac5a640 1 -- 172.21.15.123:0/372029924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63240b6970 msgr2=0x7f63240b80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:43.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.712+0000 7f632ac5a640 1 --2- 172.21.15.123:0/372029924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63240b6970 0x7f63240b80d0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f63240d4130 tx=0x7f631402a110 comp rx=0 tx=0).stop 2024-09-15T23:19:43.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.712+0000 7f632ac5a640 1 -- 172.21.15.123:0/372029924 shutdown_connections 2024-09-15T23:19:43.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.712+0000 7f632ac5a640 1 --2- 172.21.15.123:0/372029924 >> v2:172.21.15.188:3300/0 conn(0x7f63240d23b0 0x7f63240b8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:43.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.712+0000 7f632ac5a640 1 --2- 172.21.15.123:0/372029924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63240b6970 0x7f63240b80d0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:43.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.712+0000 7f632ac5a640 1 -- 172.21.15.123:0/372029924 >> 172.21.15.123:0/372029924 conn(0x7f63240d1260 msgr2=0x7f63240d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:43.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.712+0000 7f632ac5a640 1 -- 172.21.15.123:0/372029924 shutdown_connections 2024-09-15T23:19:43.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.712+0000 7f632ac5a640 1 -- 172.21.15.123:0/372029924 wait complete. 2024-09-15T23:19:43.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.713+0000 7f632ac5a640 1 Processor -- start 2024-09-15T23:19:43.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.714+0000 7f632ac5a640 1 -- start start 2024-09-15T23:19:43.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.714+0000 7f632ac5a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63240b6970 0x7f63241586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:43.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.714+0000 7f632ac5a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f63240d23b0 0x7f632415d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:43.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.714+0000 7f632ac5a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f632415ed20 0x7f632415db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:43.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.714+0000 7f632ac5a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f63240d32a0 con 0x7f63240b6970 2024-09-15T23:19:43.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.714+0000 7f632ac5a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f63240d3e50 con 0x7f63240d23b0 2024-09-15T23:19:43.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.714+0000 7f632ac5a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f632415f100 con 0x7f632415ed20 2024-09-15T23:19:43.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.714+0000 7f63289f6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63240b6970 0x7f63241586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:43.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.714+0000 7f63289f6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63240b6970 0x7f63241586f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49944/0 (socket says 172.21.15.123:49944) 2024-09-15T23:19:43.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.714+0000 7f63289f6640 1 -- 172.21.15.123:0/1672041083 learned_addr learned my addr 172.21.15.123:0/1672041083 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:43.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.715+0000 7f63289f6640 1 -- 172.21.15.123:0/1672041083 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f632415ed20 msgr2=0x7f632415db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:43.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.715+0000 7f63289f6640 1 --2- 172.21.15.123:0/1672041083 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f632415ed20 0x7f632415db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:43.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.715+0000 7f63289f6640 1 -- 172.21.15.123:0/1672041083 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f63240d23b0 msgr2=0x7f632415d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:43.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.715+0000 7f63289f6640 1 --2- 172.21.15.123:0/1672041083 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f63240d23b0 0x7f632415d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:43.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.715+0000 7f63289f6640 1 -- 172.21.15.123:0/1672041083 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63240cdbc0 con 0x7f63240b6970 2024-09-15T23:19:43.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.715+0000 7f63289f6640 1 --2- 172.21.15.123:0/1672041083 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63240b6970 0x7f63241586f0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f630c00c7b0 tx=0x7f630c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:43.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.715+0000 7f63217fa640 1 -- 172.21.15.123:0/1672041083 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630c018070 con 0x7f63240b6970 2024-09-15T23:19:43.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.715+0000 7f63217fa640 1 -- 172.21.15.123:0/1672041083 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f630c0072d0 con 0x7f63240b6970 2024-09-15T23:19:43.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.715+0000 7f632ac5a640 1 -- 172.21.15.123:0/1672041083 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63240cdea0 con 0x7f63240b6970 2024-09-15T23:19:43.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.715+0000 7f63217fa640 1 -- 172.21.15.123:0/1672041083 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f630c0047e0 con 0x7f63240b6970 2024-09-15T23:19:43.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.715+0000 7f632ac5a640 1 -- 172.21.15.123:0/1672041083 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63240ce460 con 0x7f63240b6970 2024-09-15T23:19:43.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.716+0000 7f632ac5a640 1 -- 172.21.15.123:0/1672041083 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63240cee10 con 0x7f63240b6970 2024-09-15T23:19:43.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.717+0000 7f63217fa640 1 -- 172.21.15.123:0/1672041083 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f630c01b070 con 0x7f63240b6970 2024-09-15T23:19:43.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.717+0000 7f63217fa640 1 --2- 172.21.15.123:0/1672041083 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f630406c2b0 0x7f630406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:43.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.717+0000 7f63217fa640 1 -- 172.21.15.123:0/1672041083 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f630c08a7f0 con 0x7f63240b6970 2024-09-15T23:19:43.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.717+0000 7f6323fff640 1 --2- 172.21.15.123:0/1672041083 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f630406c2b0 0x7f630406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:43.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.718+0000 7f6323fff640 1 --2- 172.21.15.123:0/1672041083 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f630406c2b0 0x7f630406e770 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f6314034000 tx=0x7f631402c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:43.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.722+0000 7f63217fa640 1 -- 172.21.15.123:0/1672041083 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f63240cee10 con 0x7f63240b6970 2024-09-15T23:19:43.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.920+0000 7f632ac5a640 1 -- 172.21.15.123:0/1672041083 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f63240d1f60 con 0x7f63240b6970 2024-09-15T23:19:43.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.920+0000 7f63217fa640 1 -- 172.21.15.123:0/1672041083 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5237 (secure 0 0 0) 0x7f63240d1f60 con 0x7f63240b6970 2024-09-15T23:19:43.922 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:19:43.922 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":86,"btime":"2024-09-15T23:19:37:619526+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2082746470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2082746470},{"type":"v1","addr":"172.21.15.123:6834","nonce":2082746470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8421,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2007610603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":2007610603},{"type":"v1","addr":"172.21.15.123:6835","nonce":2007610603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8436,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2929123975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2929123975},{"type":"v1","addr":"172.21.15.188:6836","nonce":2929123975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:19:34.917419+0000","modified":"2024-09-15T23:19:36.941347+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8439":{"gid":8439,"name":"d","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6837/1222656979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1222656979},{"type":"v1","addr":"172.21.15.188:6837","nonce":1222656979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8439,"qdb_cluster":[8439]},"id":9}]} 2024-09-15T23:19:43.922 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 86 2024-09-15T23:19:43.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.922+0000 7f632ac5a640 1 -- 172.21.15.123:0/1672041083 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f630406c2b0 msgr2=0x7f630406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:43.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.922+0000 7f632ac5a640 1 --2- 172.21.15.123:0/1672041083 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f630406c2b0 0x7f630406e770 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f6314034000 tx=0x7f631402c000 comp rx=0 tx=0).stop 2024-09-15T23:19:43.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.922+0000 7f632ac5a640 1 -- 172.21.15.123:0/1672041083 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63240b6970 msgr2=0x7f63241586f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:43.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.922+0000 7f632ac5a640 1 --2- 172.21.15.123:0/1672041083 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63240b6970 0x7f63241586f0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f630c00c7b0 tx=0x7f630c00cc70 comp rx=0 tx=0).stop 2024-09-15T23:19:43.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.922+0000 7f632ac5a640 1 -- 172.21.15.123:0/1672041083 shutdown_connections 2024-09-15T23:19:43.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.922+0000 7f632ac5a640 1 --2- 172.21.15.123:0/1672041083 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f632415ed20 0x7f632415db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:43.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.922+0000 7f632ac5a640 1 --2- 172.21.15.123:0/1672041083 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f63240d23b0 0x7f632415d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:43.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.922+0000 7f632ac5a640 1 --2- 172.21.15.123:0/1672041083 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f630406c2b0 0x7f630406e770 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:43.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.922+0000 7f632ac5a640 1 --2- 172.21.15.123:0/1672041083 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63240b6970 0x7f63241586f0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:43.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.922+0000 7f632ac5a640 1 -- 172.21.15.123:0/1672041083 >> 172.21.15.123:0/1672041083 conn(0x7f63240d1260 msgr2=0x7f63240b4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:43.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.923+0000 7f632ac5a640 1 -- 172.21.15.123:0/1672041083 shutdown_connections 2024-09-15T23:19:43.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:43.923+0000 7f632ac5a640 1 -- 172.21.15.123:0/1672041083 wait complete. 2024-09-15T23:19:44.337 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 86, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:19:34.917419+0000', 'modified': '2024-09-15T23:19:36.941347+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8439}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8439': {'gid': 8439, 'name': 'd', 'rank': 0, 'incarnation': 84, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.188:6837/1222656979', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6835', 'nonce': 1222656979}, {'type': 'v1', 'addr': '172.21.15.188:6837', 'nonce': 1222656979}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8439, 'qdb_cluster': [8439]} 2024-09-15T23:19:44.338 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:19:44.338 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-15T23:19:44.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.437+0000 7f7a816ba640 1 Processor -- start 2024-09-15T23:19:44.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.437+0000 7f7a816ba640 1 -- start start 2024-09-15T23:19:44.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.438+0000 7f7a816ba640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7a7c15ed20 0x7f7a7c0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:44.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.438+0000 7f7a816ba640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a7c0b90e0 0x7f7a7c0b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:44.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.438+0000 7f7a816ba640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a7c0d0e70 con 0x7f7a7c0d23b0 2024-09-15T23:19:44.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.438+0000 7f7a816ba640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f7a7c0d41c0 con 0x7f7a7c15ed20 2024-09-15T23:19:44.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.438+0000 7f7a816ba640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7a7c0d35b0 con 0x7f7a7c0b90e0 2024-09-15T23:19:44.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.438+0000 7f7a727fc640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7a7c0d23b0 0x7f7a7c0cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60752/0 (socket says 172.21.15.123:60752) 2024-09-15T23:19:44.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.438+0000 7f7a727fc640 1 -- 172.21.15.123:0/2816491616 learned_addr learned my addr 172.21.15.123:0/2816491616 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:19:44.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.438+0000 7f7a7a7fc640 1 -- 172.21.15.123:0/2816491616 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 536458901 0 0) 0x7f7a64001110 con 0x7f7a7c0d23b0 2024-09-15T23:19:44.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.438+0000 7f7a7a7fc640 1 -- 172.21.15.123:0/2816491616 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a68003520 con 0x7f7a7c0d23b0 2024-09-15T23:19:44.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.438+0000 7f7a7affd640 1 --2- 172.21.15.123:0/2816491616 >> v2:172.21.15.188:3300/0 conn(0x7f7a7c15ed20 0x7f7a7c0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:44.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.438+0000 7f7a7b7fe640 1 --2- 172.21.15.123:0/2816491616 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a7c0b90e0 0x7f7a7c0b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:44.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.438+0000 7f7a7a7fc640 1 -- 172.21.15.123:0/2816491616 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 581638543 0 0) 0x7f7a68003520 con 0x7f7a7c0d23b0 2024-09-15T23:19:44.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.438+0000 7f7a7a7fc640 1 -- 172.21.15.123:0/2816491616 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a7c0b90e0 msgr2=0x7f7a7c0b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:44.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.438+0000 7f7a7a7fc640 1 --2- 172.21.15.123:0/2816491616 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a7c0b90e0 0x7f7a7c0b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.438+0000 7f7a7a7fc640 1 -- 172.21.15.123:0/2816491616 >> v2:172.21.15.188:3300/0 conn(0x7f7a7c15ed20 msgr2=0x7f7a7c0b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:44.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.438+0000 7f7a7a7fc640 1 --2- 172.21.15.123:0/2816491616 >> v2:172.21.15.188:3300/0 conn(0x7f7a7c15ed20 0x7f7a7c0b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.438+0000 7f7a7a7fc640 1 -- 172.21.15.123:0/2816491616 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a7c0d3890 con 0x7f7a7c0d23b0 2024-09-15T23:19:44.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.438+0000 7f7a7a7fc640 1 -- 172.21.15.123:0/2816491616 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f7a64001840 con 0x7f7a7c0d23b0 2024-09-15T23:19:44.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.438+0000 7f7a7a7fc640 1 -- 172.21.15.123:0/2816491616 >> v1:172.21.15.123:6789/0 conn(0x7f7a7c0d23b0 legacy=0x7f7a7c0cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:44.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.438+0000 7f7a7a7fc640 1 --2- 172.21.15.123:0/2816491616 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a680039b0 0x7f7a68003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:44.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.438+0000 7f7a7a7fc640 1 --2- 172.21.15.123:0/2816491616 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a7c0b90e0 0x7f7a68004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:44.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.438+0000 7f7a7a7fc640 1 --2- 172.21.15.123:0/2816491616 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a68004d40 0x7f7a680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:44.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.438+0000 7f7a7a7fc640 1 -- 172.21.15.123:0/2816491616 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7c0d41c0 con 0x7f7a68004d40 2024-09-15T23:19:44.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.438+0000 7f7a7a7fc640 1 -- 172.21.15.123:0/2816491616 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7c0d35b0 con 0x7f7a680039b0 2024-09-15T23:19:44.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.438+0000 7f7a7a7fc640 1 -- 172.21.15.123:0/2816491616 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7a6800b9c0 con 0x7f7a7c0b90e0 2024-09-15T23:19:44.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.438+0000 7f7a7b7fe640 1 --2- 172.21.15.123:0/2816491616 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a68004d40 0x7f7a680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:44.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.439+0000 7f7a7affd640 1 --2- 172.21.15.123:0/2816491616 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a680039b0 0x7f7a68003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:44.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.439+0000 7f7a727fc640 1 --2- 172.21.15.123:0/2816491616 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a7c0b90e0 0x7f7a68004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:44.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.439+0000 7f7a7b7fe640 1 -- 172.21.15.123:0/2816491616 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a7c0b90e0 msgr2=0x7f7a68004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:44.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.439+0000 7f7a7b7fe640 1 --2- 172.21.15.123:0/2816491616 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a7c0b90e0 0x7f7a68004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.439+0000 7f7a7b7fe640 1 -- 172.21.15.123:0/2816491616 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a680039b0 msgr2=0x7f7a68003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:44.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.439+0000 7f7a7b7fe640 1 --2- 172.21.15.123:0/2816491616 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a680039b0 0x7f7a68003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.439+0000 7f7a7b7fe640 1 -- 172.21.15.123:0/2816491616 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a68003520 con 0x7f7a68004d40 2024-09-15T23:19:44.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.439+0000 7f7a7b7fe640 1 --2- 172.21.15.123:0/2816491616 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a68004d40 0x7f7a680051c0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f7a74009fc0 tx=0x7f7a68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd1bb4f5d79f0047 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:44.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.440+0000 7f7a7a7fc640 1 -- 172.21.15.123:0/2816491616 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a74009c10 con 0x7f7a68004d40 2024-09-15T23:19:44.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.440+0000 7f7a7a7fc640 1 -- 172.21.15.123:0/2816491616 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a74036070 con 0x7f7a68004d40 2024-09-15T23:19:44.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.440+0000 7f7a7a7fc640 1 -- 172.21.15.123:0/2816491616 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a74031880 con 0x7f7a68004d40 2024-09-15T23:19:44.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.440+0000 7f7a816ba640 1 -- 172.21.15.123:0/2816491616 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a68004d40 msgr2=0x7f7a680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:44.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.440+0000 7f7a816ba640 1 --2- 172.21.15.123:0/2816491616 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a68004d40 0x7f7a680051c0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f7a74009fc0 tx=0x7f7a68005830 comp rx=0 tx=0).stop 2024-09-15T23:19:44.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.440+0000 7f7a7b7fe640 1 -- 172.21.15.123:0/2816491616 reap_dead start 2024-09-15T23:19:44.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.440+0000 7f7a816ba640 1 -- 172.21.15.123:0/2816491616 shutdown_connections 2024-09-15T23:19:44.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.440+0000 7f7a816ba640 1 -- 172.21.15.123:0/2816491616 >> 172.21.15.123:0/2816491616 conn(0x7f7a7c0d1260 msgr2=0x7f7a7c0d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:44.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.440+0000 7f7a816ba640 1 -- 172.21.15.123:0/2816491616 shutdown_connections 2024-09-15T23:19:44.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.440+0000 7f7a816ba640 1 -- 172.21.15.123:0/2816491616 wait complete. 2024-09-15T23:19:44.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.441+0000 7f7a816ba640 1 Processor -- start 2024-09-15T23:19:44.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.441+0000 7f7a816ba640 1 -- start start 2024-09-15T23:19:44.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.442+0000 7f7a816ba640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a68004d40 0x7f7a7c0b5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:44.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.442+0000 7f7a816ba640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a7c0ca370 0x7f7a7c0ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:44.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.442+0000 7f7a816ba640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a7c0c81b0 0x7f7a7c0c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:44.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.442+0000 7f7a816ba640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7c0d32a0 con 0x7f7a7c0c81b0 2024-09-15T23:19:44.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.442+0000 7f7a816ba640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7c0d3e50 con 0x7f7a7c0ca370 2024-09-15T23:19:44.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.442+0000 7f7a816ba640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7a7c15f100 con 0x7f7a68004d40 2024-09-15T23:19:44.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.442+0000 7f7a7b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a7c0c81b0 0x7f7a7c0c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:44.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.442+0000 7f7a7b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a7c0c81b0 0x7f7a7c0c8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49954/0 (socket says 172.21.15.123:49954) 2024-09-15T23:19:44.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.442+0000 7f7a7b7fe640 1 -- 172.21.15.123:0/931273181 learned_addr learned my addr 172.21.15.123:0/931273181 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:44.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.442+0000 7f7a727fc640 1 --2- 172.21.15.123:0/931273181 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a7c0ca370 0x7f7a7c0ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:44.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.442+0000 7f7a7affd640 1 --2- 172.21.15.123:0/931273181 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a68004d40 0x7f7a7c0b5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:44.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.443+0000 7f7a7b7fe640 1 -- 172.21.15.123:0/931273181 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a68004d40 msgr2=0x7f7a7c0b5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:44.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.443+0000 7f7a7b7fe640 1 --2- 172.21.15.123:0/931273181 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a68004d40 0x7f7a7c0b5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.443+0000 7f7a7b7fe640 1 -- 172.21.15.123:0/931273181 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a7c0ca370 msgr2=0x7f7a7c0ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:44.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.443+0000 7f7a7b7fe640 1 --2- 172.21.15.123:0/931273181 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a7c0ca370 0x7f7a7c0ca7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.443+0000 7f7a7b7fe640 1 -- 172.21.15.123:0/931273181 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a7c0cbac0 con 0x7f7a7c0c81b0 2024-09-15T23:19:44.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.443+0000 7f7a7affd640 1 --2- 172.21.15.123:0/931273181 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a68004d40 0x7f7a7c0b5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:19:44.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.443+0000 7f7a7b7fe640 1 --2- 172.21.15.123:0/931273181 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a7c0c81b0 0x7f7a7c0c8630 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f7a7400e230 tx=0x7f7a74009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:44.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.443+0000 7f7a73fff640 1 -- 172.21.15.123:0/931273181 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a74009c10 con 0x7f7a7c0c81b0 2024-09-15T23:19:44.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.443+0000 7f7a73fff640 1 -- 172.21.15.123:0/931273181 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a74031dd0 con 0x7f7a7c0c81b0 2024-09-15T23:19:44.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.443+0000 7f7a816ba640 1 -- 172.21.15.123:0/931273181 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a7c0cbda0 con 0x7f7a7c0c81b0 2024-09-15T23:19:44.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.443+0000 7f7a73fff640 1 -- 172.21.15.123:0/931273181 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a74003bd0 con 0x7f7a7c0c81b0 2024-09-15T23:19:44.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.443+0000 7f7a816ba640 1 -- 172.21.15.123:0/931273181 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a7c0cc360 con 0x7f7a7c0c81b0 2024-09-15T23:19:44.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.444+0000 7f7a73fff640 1 -- 172.21.15.123:0/931273181 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7a74005d10 con 0x7f7a7c0c81b0 2024-09-15T23:19:44.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.445+0000 7f7a73fff640 1 --2- 172.21.15.123:0/931273181 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7a5c06c2b0 0x7f7a5c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:44.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.445+0000 7f7a73fff640 1 -- 172.21.15.123:0/931273181 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f7a740acab0 con 0x7f7a7c0c81b0 2024-09-15T23:19:44.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.445+0000 7f7a7affd640 1 --2- 172.21.15.123:0/931273181 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7a5c06c2b0 0x7f7a5c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:44.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.446+0000 7f7a7affd640 1 --2- 172.21.15.123:0/931273181 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7a5c06c2b0 0x7f7a5c06e770 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c009bc0 tx=0x7f7a6c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:44.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.446+0000 7f7a84458740 1 Processor -- start 2024-09-15T23:19:44.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.446+0000 7f7a84458740 1 -- start start 2024-09-15T23:19:44.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.447+0000 7f7a84458740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c16dbca2c0 0x55c16dc0fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:44.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.447+0000 7f7a84458740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c16dbc7a80 0x55c16dbca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:44.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.447+0000 7f7a84458740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c16dbcba50 0x55c16dbc48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:44.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.447+0000 7f7a84458740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55c16db2c520 con 0x55c16dbc7a80 2024-09-15T23:19:44.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.447+0000 7f7a84458740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55c16dad43e0 con 0x55c16dbcba50 2024-09-15T23:19:44.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.447+0000 7f7a84458740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55c16db284e0 con 0x55c16dbca2c0 2024-09-15T23:19:44.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.447+0000 7f7a727fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c16dbc7a80 0x55c16dbca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:44.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.447+0000 7f7a727fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c16dbc7a80 0x55c16dbca6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49962/0 (socket says 172.21.15.123:49962) 2024-09-15T23:19:44.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.447+0000 7f7a727fc640 1 -- 172.21.15.123:0/3226144586 learned_addr learned my addr 172.21.15.123:0/3226144586 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:44.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.447+0000 7f7a7affd640 1 --2- 172.21.15.123:0/3226144586 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c16dbca2c0 0x55c16dc0fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:44.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.447+0000 7f7a7b7fe640 1 --2- 172.21.15.123:0/3226144586 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c16dbcba50 0x55c16dbc48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:44.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.447+0000 7f7a727fc640 1 -- 172.21.15.123:0/3226144586 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c16dbca2c0 msgr2=0x55c16dc0fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:44.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.447+0000 7f7a727fc640 1 --2- 172.21.15.123:0/3226144586 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c16dbca2c0 0x55c16dc0fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.447+0000 7f7a727fc640 1 -- 172.21.15.123:0/3226144586 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c16dbcba50 msgr2=0x55c16dbc48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:44.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.447+0000 7f7a727fc640 1 --2- 172.21.15.123:0/3226144586 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c16dbcba50 0x55c16dbc48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.447+0000 7f7a727fc640 1 -- 172.21.15.123:0/3226144586 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c16daef2f0 con 0x55c16dbc7a80 2024-09-15T23:19:44.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.447+0000 7f7a727fc640 1 --2- 172.21.15.123:0/3226144586 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c16dbc7a80 0x55c16dbca6a0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f7a64001930 tx=0x7f7a64004c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4470aa5b6ff7038 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:44.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.447+0000 7f7a70ff9640 1 -- 172.21.15.123:0/3226144586 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a64015440 con 0x55c16dbc7a80 2024-09-15T23:19:44.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.447+0000 7f7a70ff9640 1 -- 172.21.15.123:0/3226144586 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a6401a070 con 0x55c16dbc7a80 2024-09-15T23:19:44.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.447+0000 7f7a70ff9640 1 -- 172.21.15.123:0/3226144586 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a64015820 con 0x55c16dbc7a80 2024-09-15T23:19:44.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.448+0000 7f7a84458740 1 -- 172.21.15.123:0/3226144586 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c16dbc7a80 msgr2=0x55c16dbca6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:44.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.448+0000 7f7a84458740 1 --2- 172.21.15.123:0/3226144586 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c16dbc7a80 0x55c16dbca6a0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f7a64001930 tx=0x7f7a64004c70 comp rx=0 tx=0).stop 2024-09-15T23:19:44.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.448+0000 7f7a84458740 1 -- 172.21.15.123:0/3226144586 shutdown_connections 2024-09-15T23:19:44.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.448+0000 7f7a84458740 1 --2- 172.21.15.123:0/3226144586 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c16dbcba50 0x55c16dbc48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.448+0000 7f7a84458740 1 --2- 172.21.15.123:0/3226144586 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c16dbc7a80 0x55c16dbca6a0 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.448+0000 7f7a84458740 1 --2- 172.21.15.123:0/3226144586 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c16dbca2c0 0x55c16dc0fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.448+0000 7f7a84458740 1 -- 172.21.15.123:0/3226144586 >> 172.21.15.123:0/3226144586 conn(0x55c16dbc6a80 msgr2=0x55c16dc0ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:44.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.448+0000 7f7a84458740 1 -- 172.21.15.123:0/3226144586 shutdown_connections 2024-09-15T23:19:44.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.448+0000 7f7a84458740 1 -- 172.21.15.123:0/3226144586 wait complete. 2024-09-15T23:19:44.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.449+0000 7f7a84458740 1 -- start start 2024-09-15T23:19:44.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.449+0000 7f7a84458740 1 Processor -- start 2024-09-15T23:19:44.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.450+0000 7f7a84458740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c16dbca2c0 0x55c16dbea170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:44.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.450+0000 7f7a84458740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c16dbcba50 0x55c16dbeb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:44.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.450+0000 7f7a84458740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c16dc0c640 0x55c16dc0da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:44.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.450+0000 7f7a84458740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55c16dbc5f20 con 0x55c16dc0c640 2024-09-15T23:19:44.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.450+0000 7f7a84458740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55c16dab5450 con 0x55c16dbca2c0 2024-09-15T23:19:44.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.450+0000 7f7a84458740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55c16dc10290 con 0x55c16dbcba50 2024-09-15T23:19:44.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.450+0000 7f7a84458740 10 client.0 _ll_register_callbacks cb 0x55c16d83eac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:19:44.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.450+0000 7f7a7b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c16dc0c640 0x55c16dc0da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:44.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.450+0000 7f7a7b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c16dc0c640 0x55c16dc0da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49972/0 (socket says 172.21.15.123:49972) 2024-09-15T23:19:44.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.450+0000 7f7a7b7fe640 1 -- 172.21.15.123:0/2186594156 learned_addr learned my addr 172.21.15.123:0/2186594156 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:44.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.450+0000 7f7a727fc640 1 --2- 172.21.15.123:0/2186594156 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c16dbcba50 0x55c16dbeb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:44.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.450+0000 7f7a7affd640 1 --2- 172.21.15.123:0/2186594156 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c16dbca2c0 0x55c16dbea170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:44.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.450+0000 7f7a7b7fe640 1 -- 172.21.15.123:0/2186594156 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c16dbcba50 msgr2=0x55c16dbeb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:44.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.450+0000 7f7a7b7fe640 1 --2- 172.21.15.123:0/2186594156 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c16dbcba50 0x55c16dbeb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.450+0000 7f7a7b7fe640 1 -- 172.21.15.123:0/2186594156 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c16dbca2c0 msgr2=0x55c16dbea170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:44.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.450+0000 7f7a7b7fe640 1 --2- 172.21.15.123:0/2186594156 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c16dbca2c0 0x55c16dbea170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.450+0000 7f7a7b7fe640 1 -- 172.21.15.123:0/2186594156 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c16d83f2d0 con 0x55c16dc0c640 2024-09-15T23:19:44.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.450+0000 7f7a7affd640 1 --2- 172.21.15.123:0/2186594156 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c16dbca2c0 0x55c16dbea170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:19:44.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.450+0000 7f7a7b7fe640 1 --2- 172.21.15.123:0/2186594156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c16dc0c640 0x55c16dc0da20 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f7a740aaf80 tx=0x7f7a7407ab20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64ee981944ce7200 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:44.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.450+0000 7f7a59ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:19:44.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.450+0000 7f7a59ffb640 1 -- 172.21.15.123:0/2186594156 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7407ce60 con 0x55c16dc0c640 2024-09-15T23:19:44.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.450+0000 7f7a59ffb640 1 -- 172.21.15.123:0/2186594156 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f7a7407ad80 con 0x55c16dc0c640 2024-09-15T23:19:44.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.450+0000 7f7a84458740 1 -- 172.21.15.123:0/2186594156 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a6401a070 con 0x55c16dc0c640 2024-09-15T23:19:44.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.450+0000 7f7a59ffb640 1 -- 172.21.15.123:0/2186594156 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f7a74098050 con 0x55c16dc0c640 2024-09-15T23:19:44.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.450+0000 7f7a84458740 10 client.8595 fetch_fsmap learned FSMap version 86 2024-09-15T23:19:44.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.450+0000 7f7a84458740 1 -- 172.21.15.123:0/2186594156 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) -- 0x55c16d9096b0 con 0x55c16dc0c640 2024-09-15T23:19:44.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.450+0000 7f7a59ffb640 1 -- 172.21.15.123:0/2186594156 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a6401a070 con 0x55c16dc0c640 2024-09-15T23:19:44.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.451+0000 7f7a59ffb640 1 -- 172.21.15.123:0/2186594156 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 86) ==== 3502+0+0 (secure 0 0 0) 0x7f7a7404d070 con 0x55c16dc0c640 2024-09-15T23:19:44.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.451+0000 7f7a84458740 10 client.8595 fetch_fsmap finished waiting for FSMap version 86 2024-09-15T23:19:44.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.451+0000 7f7a84458740 10 client.8595 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-15T23:19:44.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.451+0000 7f7a84458740 20 client.8595 populate_metadata read hostname 'smithi123' 2024-09-15T23:19:44.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.451+0000 7f7a84458740 1 --2- 172.21.15.123:0/2186594156 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x55c16dbde260 0x55c16dbde640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:44.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.451+0000 7f7a84458740 4 client.8595 mds_command: new command op to 8439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:19:44.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.451+0000 7f7a84458740 1 -- 172.21.15.123:0/2186594156 --> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c16db39c50 con 0x55c16dbde260 2024-09-15T23:19:44.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.451+0000 7f7a7affd640 1 --2- 172.21.15.123:0/2186594156 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x55c16dbde260 0x55c16dbde640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:44.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.451+0000 7f7a59ffb640 10 client.8595 ms_handle_connect on v2:172.21.15.188:6835/1222656979 2024-09-15T23:19:44.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.451+0000 7f7a7affd640 1 --2- 172.21.15.123:0/2186594156 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x55c16dbde260 0x55c16dbde640 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7944165d65221429 server_cookie=d3241be182b7dcc0 in_seq=0 out_seq=0 2024-09-15T23:19:44.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.452+0000 7f7a59ffb640 1 -- 172.21.15.123:0/2186594156 <== mds.0 v2:172.21.15.188:6835/1222656979 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c16db39c50 con 0x55c16dbde260 2024-09-15T23:19:44.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.452+0000 7f7a59ffb640 10 client.8595 handle_command_reply: tid=0 2024-09-15T23:19:44.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.452+0000 7f7a84458740 1 client.8595 shutdown 2024-09-15T23:19:44.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.452+0000 7f7a84458740 1 -- 172.21.15.123:0/2186594156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c16dc0c640 msgr2=0x55c16dc0da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:44.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.452+0000 7f7a84458740 1 --2- 172.21.15.123:0/2186594156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c16dc0c640 0x55c16dc0da20 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f7a740aaf80 tx=0x7f7a7407ab20 comp rx=0 tx=0).stop 2024-09-15T23:19:44.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.452+0000 7f7a84458740 1 -- 172.21.15.123:0/2186594156 shutdown_connections 2024-09-15T23:19:44.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.452+0000 7f7a84458740 1 --2- 172.21.15.123:0/2186594156 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x55c16dbde260 0x55c16dbde640 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.452+0000 7f7a84458740 1 --2- 172.21.15.123:0/2186594156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c16dc0c640 0x55c16dc0da20 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.452+0000 7f7a59ffb640 0 client.8595 ms_handle_reset on v2:172.21.15.188:6835/1222656979 2024-09-15T23:19:44.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.452+0000 7f7a84458740 1 --2- 172.21.15.123:0/2186594156 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c16dbcba50 0x55c16dbeb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.452+0000 7f7a84458740 1 --2- 172.21.15.123:0/2186594156 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c16dbca2c0 0x55c16dbea170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.452+0000 7f7a84458740 1 -- 172.21.15.123:0/2186594156 >> 172.21.15.123:0/2186594156 conn(0x55c16dbc7a80 msgr2=0x55c16dc12160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:44.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.452+0000 7f7a84458740 1 -- 172.21.15.123:0/2186594156 shutdown_connections 2024-09-15T23:19:44.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.452+0000 7f7a84458740 1 -- 172.21.15.123:0/2186594156 wait complete. 2024-09-15T23:19:44.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.452+0000 7f7a84458740 20 client.8595 trim_cache size 0 max 16384 2024-09-15T23:19:44.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.470+0000 7f7a84458740 1 Processor -- start 2024-09-15T23:19:44.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.470+0000 7f7a84458740 1 -- start start 2024-09-15T23:19:44.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.470+0000 7f7a84458740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c16dbca2c0 0x55c16dbe9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:44.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.471+0000 7f7a84458740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c16dbcba50 0x55c16dbeafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:44.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.471+0000 7f7a84458740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c16dbde260 0x55c16dbe88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:44.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.471+0000 7f7a84458740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7c200570 con 0x55c16dbca2c0 2024-09-15T23:19:44.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.471+0000 7f7a84458740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7c1ff900 con 0x55c16dbcba50 2024-09-15T23:19:44.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.471+0000 7f7a84458740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7a7c1fff20 con 0x55c16dbde260 2024-09-15T23:19:44.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.471+0000 7f7a7affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c16dbca2c0 0x55c16dbe9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:44.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.471+0000 7f7a7affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c16dbca2c0 0x55c16dbe9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49984/0 (socket says 172.21.15.123:49984) 2024-09-15T23:19:44.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.471+0000 7f7a7affd640 1 -- 172.21.15.123:0/2669206443 learned_addr learned my addr 172.21.15.123:0/2669206443 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:44.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.471+0000 7f7a727fc640 1 --2- 172.21.15.123:0/2669206443 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c16dbcba50 0x55c16dbeafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:44.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.471+0000 7f7a7b7fe640 1 --2- 172.21.15.123:0/2669206443 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c16dbde260 0x55c16dbe88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:44.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.471+0000 7f7a7affd640 1 -- 172.21.15.123:0/2669206443 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c16dbde260 msgr2=0x55c16dbe88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:44.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.471+0000 7f7a7affd640 1 --2- 172.21.15.123:0/2669206443 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c16dbde260 0x55c16dbe88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.471+0000 7f7a7affd640 1 -- 172.21.15.123:0/2669206443 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c16dbcba50 msgr2=0x55c16dbeafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:44.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.471+0000 7f7a7affd640 1 --2- 172.21.15.123:0/2669206443 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c16dbcba50 0x55c16dbeafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.471+0000 7f7a7affd640 1 -- 172.21.15.123:0/2669206443 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c16dbcabb0 con 0x55c16dbca2c0 2024-09-15T23:19:44.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.471+0000 7f7a727fc640 1 --2- 172.21.15.123:0/2669206443 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c16dbcba50 0x55c16dbeafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:19:44.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.471+0000 7f7a7affd640 1 --2- 172.21.15.123:0/2669206443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c16dbca2c0 0x55c16dbe9f30 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c0255f0 tx=0x7f7a6c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=190c9e5ab2aeb2a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:44.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.471+0000 7f7a5bfff640 1 -- 172.21.15.123:0/2669206443 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c0164f0 con 0x55c16dbca2c0 2024-09-15T23:19:44.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.471+0000 7f7a5bfff640 1 -- 172.21.15.123:0/2669206443 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a6c016690 con 0x55c16dbca2c0 2024-09-15T23:19:44.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.471+0000 7f7a5bfff640 1 -- 172.21.15.123:0/2669206443 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c016a40 con 0x55c16dbca2c0 2024-09-15T23:19:44.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.472+0000 7f7a84458740 1 -- 172.21.15.123:0/2669206443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c16dbca2c0 msgr2=0x55c16dbe9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:44.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.472+0000 7f7a84458740 1 --2- 172.21.15.123:0/2669206443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c16dbca2c0 0x55c16dbe9f30 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c0255f0 tx=0x7f7a6c017000 comp rx=0 tx=0).stop 2024-09-15T23:19:44.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.472+0000 7f7a84458740 1 -- 172.21.15.123:0/2669206443 shutdown_connections 2024-09-15T23:19:44.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.472+0000 7f7a84458740 1 --2- 172.21.15.123:0/2669206443 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c16dbde260 0x55c16dbe88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.472+0000 7f7a84458740 1 --2- 172.21.15.123:0/2669206443 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c16dbcba50 0x55c16dbeafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.472+0000 7f7a84458740 1 --2- 172.21.15.123:0/2669206443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c16dbca2c0 0x55c16dbe9f30 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.472+0000 7f7a84458740 1 -- 172.21.15.123:0/2669206443 >> 172.21.15.123:0/2669206443 conn(0x55c16dbc7a80 msgr2=0x55c16dc2a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:44.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.472+0000 7f7a84458740 1 -- 172.21.15.123:0/2669206443 shutdown_connections 2024-09-15T23:19:44.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.472+0000 7f7a84458740 1 -- 172.21.15.123:0/2669206443 wait complete. 2024-09-15T23:19:44.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.472+0000 7f7a84458740 1 -- start start 2024-09-15T23:19:44.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.472+0000 7f7a84458740 1 Processor -- start 2024-09-15T23:19:44.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.473+0000 7f7a84458740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c16dbca2c0 0x55c16dc8d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:44.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.473+0000 7f7a84458740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c16dbcba50 0x55c16dc0ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:44.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.473+0000 7f7a84458740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c16dbde260 0x55c16dc0ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:44.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.473+0000 7f7a84458740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55c16dbc5f20 con 0x55c16dbde260 2024-09-15T23:19:44.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.473+0000 7f7a84458740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55c16dab5450 con 0x55c16dbcba50 2024-09-15T23:19:44.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.473+0000 7f7a84458740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55c16dbf3980 con 0x55c16dbca2c0 2024-09-15T23:19:44.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.473+0000 7f7a84458740 10 client.0 _ll_register_callbacks cb 0x7f7a7407a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:19:44.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.473+0000 7f7a7b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c16dbde260 0x55c16dc0ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:44.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.473+0000 7f7a7b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c16dbde260 0x55c16dc0ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49992/0 (socket says 172.21.15.123:49992) 2024-09-15T23:19:44.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.473+0000 7f7a7b7fe640 1 -- 172.21.15.123:0/560775427 learned_addr learned my addr 172.21.15.123:0/560775427 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:44.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.473+0000 7f7a7affd640 1 --2- 172.21.15.123:0/560775427 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c16dbca2c0 0x55c16dc8d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:44.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.473+0000 7f7a727fc640 1 --2- 172.21.15.123:0/560775427 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c16dbcba50 0x55c16dc0ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:44.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.473+0000 7f7a7b7fe640 1 -- 172.21.15.123:0/560775427 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c16dbca2c0 msgr2=0x55c16dc8d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:44.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.473+0000 7f7a7b7fe640 1 --2- 172.21.15.123:0/560775427 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c16dbca2c0 0x55c16dc8d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.473+0000 7f7a7b7fe640 1 -- 172.21.15.123:0/560775427 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c16dbcba50 msgr2=0x55c16dc0ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:44.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.473+0000 7f7a7b7fe640 1 --2- 172.21.15.123:0/560775427 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c16dbcba50 0x55c16dc0ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.473+0000 7f7a7b7fe640 1 -- 172.21.15.123:0/560775427 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c16dbf0240 con 0x55c16dbde260 2024-09-15T23:19:44.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.473+0000 7f7a727fc640 1 --2- 172.21.15.123:0/560775427 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c16dbcba50 0x55c16dc0ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:19:44.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.474+0000 7f7a7b7fe640 1 --2- 172.21.15.123:0/560775427 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c16dbde260 0x55c16dc0ef70 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f7a74031fd0 tx=0x7f7a740aaeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a324bb44f49a963 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:44.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.474+0000 7f7a59ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:19:44.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.474+0000 7f7a59ffb640 1 -- 172.21.15.123:0/560775427 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7407a480 con 0x55c16dbde260 2024-09-15T23:19:44.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.474+0000 7f7a59ffb640 1 -- 172.21.15.123:0/560775427 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f7a74077190 con 0x55c16dbde260 2024-09-15T23:19:44.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.474+0000 7f7a84458740 1 -- 172.21.15.123:0/560775427 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a6c016690 con 0x55c16dbde260 2024-09-15T23:19:44.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.474+0000 7f7a59ffb640 1 -- 172.21.15.123:0/560775427 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f7a7409f050 con 0x55c16dbde260 2024-09-15T23:19:44.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.474+0000 7f7a84458740 10 client.8601 fetch_fsmap learned FSMap version 86 2024-09-15T23:19:44.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.474+0000 7f7a84458740 1 -- 172.21.15.123:0/560775427 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) -- 0x55c16dc0bc00 con 0x55c16dbde260 2024-09-15T23:19:44.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.474+0000 7f7a59ffb640 1 -- 172.21.15.123:0/560775427 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a6c016690 con 0x55c16dbde260 2024-09-15T23:19:44.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.474+0000 7f7a59ffb640 1 -- 172.21.15.123:0/560775427 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 86) ==== 3502+0+0 (secure 0 0 0) 0x7f7a7404d070 con 0x55c16dbde260 2024-09-15T23:19:44.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.474+0000 7f7a84458740 10 client.8601 fetch_fsmap finished waiting for FSMap version 86 2024-09-15T23:19:44.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.474+0000 7f7a84458740 10 client.8601 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-15T23:19:44.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.474+0000 7f7a84458740 20 client.8601 populate_metadata read hostname 'smithi123' 2024-09-15T23:19:44.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.474+0000 7f7a84458740 1 --2- 172.21.15.123:0/560775427 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x55c16dc0c640 0x55c16dbc41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:44.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.474+0000 7f7a84458740 4 client.8601 mds_command: new command op to 8439 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:19:44.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.474+0000 7f7a84458740 1 -- 172.21.15.123:0/560775427 --> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] -- command(tid 0: {"prefix": "status"}) -- 0x55c16dbea590 con 0x55c16dc0c640 2024-09-15T23:19:44.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.474+0000 7f7a7affd640 1 --2- 172.21.15.123:0/560775427 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x55c16dc0c640 0x55c16dbc41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:44.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.475+0000 7f7a59ffb640 10 client.8601 ms_handle_connect on v2:172.21.15.188:6835/1222656979 2024-09-15T23:19:44.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.475+0000 7f7a7affd640 1 --2- 172.21.15.123:0/560775427 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x55c16dc0c640 0x55c16dbc41a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce56bc81878c2613 server_cookie=3daa140d5b6d76f4 in_seq=0 out_seq=0 2024-09-15T23:19:44.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.475+0000 7f7a59ffb640 1 -- 172.21.15.123:0/560775427 <== mds.0 v2:172.21.15.188:6835/1222656979 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55c16dbea590 con 0x55c16dc0c640 2024-09-15T23:19:44.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.475+0000 7f7a59ffb640 10 client.8601 handle_command_reply: tid=0 2024-09-15T23:19:44.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.475+0000 7f7a84458740 1 client.8601 shutdown 2024-09-15T23:19:44.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.475+0000 7f7a84458740 1 -- 172.21.15.123:0/560775427 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c16dbde260 msgr2=0x55c16dc0ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:44.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.475+0000 7f7a84458740 1 --2- 172.21.15.123:0/560775427 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c16dbde260 0x55c16dc0ef70 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f7a74031fd0 tx=0x7f7a740aaeb0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.475+0000 7f7a84458740 1 -- 172.21.15.123:0/560775427 shutdown_connections 2024-09-15T23:19:44.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.475+0000 7f7a84458740 1 --2- 172.21.15.123:0/560775427 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x55c16dc0c640 0x55c16dbc41a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.475+0000 7f7a84458740 1 --2- 172.21.15.123:0/560775427 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c16dbde260 0x55c16dc0ef70 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.475+0000 7f7a84458740 1 --2- 172.21.15.123:0/560775427 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c16dbcba50 0x55c16dc0ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.475+0000 7f7a59ffb640 0 client.8601 ms_handle_reset on v2:172.21.15.188:6835/1222656979 2024-09-15T23:19:44.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.475+0000 7f7a84458740 1 --2- 172.21.15.123:0/560775427 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c16dbca2c0 0x55c16dc8d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.475+0000 7f7a84458740 1 -- 172.21.15.123:0/560775427 >> 172.21.15.123:0/560775427 conn(0x55c16dbc7a80 msgr2=0x55c16dc2a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:44.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.475+0000 7f7a84458740 1 -- 172.21.15.123:0/560775427 shutdown_connections 2024-09-15T23:19:44.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.475+0000 7f7a84458740 1 -- 172.21.15.123:0/560775427 wait complete. 2024-09-15T23:19:44.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.475+0000 7f7a84458740 20 client.8601 trim_cache size 0 max 16384 2024-09-15T23:19:44.483 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:19:44.483 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "cb968ac4-8d3a-4b17-a673-6177aeaea589", 2024-09-15T23:19:44.483 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2024-09-15T23:19:44.483 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 8439, 2024-09-15T23:19:44.483 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-09-15T23:19:44.483 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-09-15T23:19:44.483 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-09-15T23:19:44.484 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 8.8613239690000007, 2024-09-15T23:19:44.484 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 86, 2024-09-15T23:19:44.484 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 142, 2024-09-15T23:19:44.484 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 142, 2024-09-15T23:19:44.484 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 12.953976822 2024-09-15T23:19:44.484 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:19:44.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.476+0000 7f7a816ba640 1 -- 172.21.15.123:0/931273181 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7a5c06c2b0 msgr2=0x7f7a5c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:44.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.476+0000 7f7a816ba640 1 --2- 172.21.15.123:0/931273181 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7a5c06c2b0 0x7f7a5c06e770 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c009bc0 tx=0x7f7a6c008040 comp rx=0 tx=0).stop 2024-09-15T23:19:44.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.476+0000 7f7a816ba640 1 -- 172.21.15.123:0/931273181 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a7c0c81b0 msgr2=0x7f7a7c0c8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:44.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.476+0000 7f7a816ba640 1 --2- 172.21.15.123:0/931273181 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a7c0c81b0 0x7f7a7c0c8630 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f7a7400e230 tx=0x7f7a74009750 comp rx=0 tx=0).stop 2024-09-15T23:19:44.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.476+0000 7f7a816ba640 1 -- 172.21.15.123:0/931273181 shutdown_connections 2024-09-15T23:19:44.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.476+0000 7f7a816ba640 1 --2- 172.21.15.123:0/931273181 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7a5c06c2b0 0x7f7a5c06e770 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.476+0000 7f7a816ba640 1 --2- 172.21.15.123:0/931273181 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a7c0c81b0 0x7f7a7c0c8630 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.476+0000 7f7a816ba640 1 --2- 172.21.15.123:0/931273181 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7a7c0ca370 0x7f7a7c0ca7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.476+0000 7f7a816ba640 1 --2- 172.21.15.123:0/931273181 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7a68004d40 0x7f7a7c0b5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.476+0000 7f7a816ba640 1 -- 172.21.15.123:0/931273181 >> 172.21.15.123:0/931273181 conn(0x7f7a7c0d1260 msgr2=0x7f7a7c15df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:44.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.476+0000 7f7a816ba640 1 -- 172.21.15.123:0/931273181 shutdown_connections 2024-09-15T23:19:44.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.476+0000 7f7a816ba640 1 -- 172.21.15.123:0/931273181 wait complete. 2024-09-15T23:19:44.487 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:19:44.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.584+0000 7fcafe4e4640 1 Processor -- start 2024-09-15T23:19:44.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.584+0000 7fcafe4e4640 1 -- start start 2024-09-15T23:19:44.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.585+0000 7fcafe4e4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcaf8073990 0x7fcaf8169560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:44.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.585+0000 7fcafe4e4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaf81632f0 con 0x7fcaf8073330 2024-09-15T23:19:44.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.585+0000 7fcafe4e4640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaf806cb00 con 0x7fcaf815e740 2024-09-15T23:19:44.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.585+0000 7fcafe4e4640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fcaf806d430 con 0x7fcaf8073990 2024-09-15T23:19:44.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.585+0000 7fcafca81640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcaf8073990 0x7fcaf8169560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:44.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.585+0000 7fcaf77fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fcaf8073330 0x7fcaf8162b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60768/0 (socket says 172.21.15.123:60768) 2024-09-15T23:19:44.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.585+0000 7fcaf77fe640 1 -- 172.21.15.123:0/1736949094 learned_addr learned my addr 172.21.15.123:0/1736949094 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:19:44.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.586+0000 7fcaf6ffd640 1 -- 172.21.15.123:0/1736949094 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4170469005 0 0) 0x7fcaf81632f0 con 0x7fcaf8073330 2024-09-15T23:19:44.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.586+0000 7fcaf6ffd640 1 -- 172.21.15.123:0/1736949094 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcae0003520 con 0x7fcaf8073330 2024-09-15T23:19:44.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.586+0000 7fcafca81640 1 -- 172.21.15.123:0/1736949094 >> v1:172.21.15.188:6789/0 conn(0x7fcaf815e740 legacy=0x7fcaf8162400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:44.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.586+0000 7fcafca81640 1 -- 172.21.15.123:0/1736949094 >> v1:172.21.15.123:6789/0 conn(0x7fcaf8073330 legacy=0x7fcaf8162b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:44.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.586+0000 7fcafca81640 1 -- 172.21.15.123:0/1736949094 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf806cde0 con 0x7fcaf8073990 2024-09-15T23:19:44.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.586+0000 7fcafca81640 1 --2- 172.21.15.123:0/1736949094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcaf8073990 0x7fcaf8169560 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0009d90 tx=0x7fcaf002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27b07d9fc94d9a9d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:44.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.587+0000 7fcaf6ffd640 1 -- 172.21.15.123:0/1736949094 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0007740 con 0x7fcaf8073990 2024-09-15T23:19:44.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.587+0000 7fcaf6ffd640 1 -- 172.21.15.123:0/1736949094 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaf00078e0 con 0x7fcaf8073990 2024-09-15T23:19:44.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.587+0000 7fcaf6ffd640 1 -- 172.21.15.123:0/1736949094 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0007cb0 con 0x7fcaf8073990 2024-09-15T23:19:44.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.587+0000 7fcafe4e4640 1 -- 172.21.15.123:0/1736949094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcaf8073990 msgr2=0x7fcaf8169560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:44.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.587+0000 7fcafe4e4640 1 --2- 172.21.15.123:0/1736949094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcaf8073990 0x7fcaf8169560 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0009d90 tx=0x7fcaf002a6f0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.587+0000 7fcafe4e4640 1 -- 172.21.15.123:0/1736949094 shutdown_connections 2024-09-15T23:19:44.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.587+0000 7fcafe4e4640 1 --2- 172.21.15.123:0/1736949094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcaf8073990 0x7fcaf8169560 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.587+0000 7fcafe4e4640 1 -- 172.21.15.123:0/1736949094 >> 172.21.15.123:0/1736949094 conn(0x7fcaf806f400 msgr2=0x7fcaf806f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:44.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.587+0000 7fcafe4e4640 1 -- 172.21.15.123:0/1736949094 shutdown_connections 2024-09-15T23:19:44.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.587+0000 7fcafe4e4640 1 -- 172.21.15.123:0/1736949094 wait complete. 2024-09-15T23:19:44.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.588+0000 7fcafe4e4640 1 Processor -- start 2024-09-15T23:19:44.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.589+0000 7fcafe4e4640 1 -- start start 2024-09-15T23:19:44.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.589+0000 7fcafe4e4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcaf8073330 0x7fcaf815ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:44.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.589+0000 7fcafe4e4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcaf8073990 0x7fcaf81f4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:44.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.589+0000 7fcafe4e4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcaf815e740 0x7fcaf80b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:44.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.589+0000 7fcafe4e4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf80aea00 con 0x7fcaf815e740 2024-09-15T23:19:44.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.589+0000 7fcafe4e4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf80ae880 con 0x7fcaf8073990 2024-09-15T23:19:44.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.589+0000 7fcafe4e4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fcaf815eb20 con 0x7fcaf8073330 2024-09-15T23:19:44.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.589+0000 7fcafca81640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcaf815e740 0x7fcaf80b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:44.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.589+0000 7fcafca81640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcaf815e740 0x7fcaf80b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49996/0 (socket says 172.21.15.123:49996) 2024-09-15T23:19:44.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.589+0000 7fcafca81640 1 -- 172.21.15.123:0/2737202249 learned_addr learned my addr 172.21.15.123:0/2737202249 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:44.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.590+0000 7fcaf77fe640 1 --2- 172.21.15.123:0/2737202249 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcaf8073990 0x7fcaf81f4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:44.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.590+0000 7fcaf7fff640 1 --2- 172.21.15.123:0/2737202249 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcaf8073330 0x7fcaf815ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:44.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.590+0000 7fcafca81640 1 -- 172.21.15.123:0/2737202249 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcaf8073330 msgr2=0x7fcaf815ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:44.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.590+0000 7fcafca81640 1 --2- 172.21.15.123:0/2737202249 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcaf8073330 0x7fcaf815ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.590+0000 7fcafca81640 1 -- 172.21.15.123:0/2737202249 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcaf8073990 msgr2=0x7fcaf81f4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:44.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.590+0000 7fcafca81640 1 --2- 172.21.15.123:0/2737202249 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcaf8073990 0x7fcaf81f4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.590+0000 7fcafca81640 1 -- 172.21.15.123:0/2737202249 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf80b66f0 con 0x7fcaf815e740 2024-09-15T23:19:44.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.590+0000 7fcaf7fff640 1 --2- 172.21.15.123:0/2737202249 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcaf8073330 0x7fcaf815ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:19:44.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.590+0000 7fcafca81640 1 --2- 172.21.15.123:0/2737202249 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcaf815e740 0x7fcaf80b46a0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0009eb0 tx=0x7fcaf0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:44.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.590+0000 7fcaf4ff9640 1 -- 172.21.15.123:0/2737202249 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0040070 con 0x7fcaf815e740 2024-09-15T23:19:44.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.590+0000 7fcaf4ff9640 1 -- 172.21.15.123:0/2737202249 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaf0031bc0 con 0x7fcaf815e740 2024-09-15T23:19:44.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.590+0000 7fcaf4ff9640 1 -- 172.21.15.123:0/2737202249 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0009450 con 0x7fcaf815e740 2024-09-15T23:19:44.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.590+0000 7fcafe4e4640 1 -- 172.21.15.123:0/2737202249 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaf81f4d00 con 0x7fcaf815e740 2024-09-15T23:19:44.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.590+0000 7fcafe4e4640 1 -- 172.21.15.123:0/2737202249 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaf80b69b0 con 0x7fcaf815e740 2024-09-15T23:19:44.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.591+0000 7fcafe4e4640 1 -- 172.21.15.123:0/2737202249 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaf8068f10 con 0x7fcaf815e740 2024-09-15T23:19:44.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.592+0000 7fcaf4ff9640 1 -- 172.21.15.123:0/2737202249 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcaf0039040 con 0x7fcaf815e740 2024-09-15T23:19:44.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.592+0000 7fcaf4ff9640 1 --2- 172.21.15.123:0/2737202249 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcae406c2b0 0x7fcae406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:44.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.592+0000 7fcaf4ff9640 1 -- 172.21.15.123:0/2737202249 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fcaf00acb70 con 0x7fcaf815e740 2024-09-15T23:19:44.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.592+0000 7fcaf7fff640 1 --2- 172.21.15.123:0/2737202249 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcae406c2b0 0x7fcae406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:44.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.593+0000 7fcaf7fff640 1 --2- 172.21.15.123:0/2737202249 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcae406c2b0 0x7fcae406e770 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fcae8001660 tx=0x7fcae8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:44.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.596+0000 7fcaf4ff9640 1 -- 172.21.15.123:0/2737202249 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcaf8068f10 con 0x7fcaf815e740 2024-09-15T23:19:44.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.797+0000 7fcafe4e4640 1 -- 172.21.15.123:0/2737202249 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fcaf8162400 con 0x7fcaf815e740 2024-09-15T23:19:44.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.798+0000 7fcaf4ff9640 1 -- 172.21.15.123:0/2737202249 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v86) ==== 53+0+73 (secure 0 0 0) 0x7fcaf0081070 con 0x7fcaf815e740 2024-09-15T23:19:44.799 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:19:44.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.800+0000 7fcafe4e4640 1 -- 172.21.15.123:0/2737202249 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcae406c2b0 msgr2=0x7fcae406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:44.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.800+0000 7fcafe4e4640 1 --2- 172.21.15.123:0/2737202249 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcae406c2b0 0x7fcae406e770 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fcae8001660 tx=0x7fcae8009040 comp rx=0 tx=0).stop 2024-09-15T23:19:44.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.800+0000 7fcafe4e4640 1 -- 172.21.15.123:0/2737202249 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcaf815e740 msgr2=0x7fcaf80b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:44.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.800+0000 7fcafe4e4640 1 --2- 172.21.15.123:0/2737202249 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcaf815e740 0x7fcaf80b46a0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0009eb0 tx=0x7fcaf0004a40 comp rx=0 tx=0).stop 2024-09-15T23:19:44.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.800+0000 7fcafe4e4640 1 -- 172.21.15.123:0/2737202249 shutdown_connections 2024-09-15T23:19:44.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.800+0000 7fcafe4e4640 1 --2- 172.21.15.123:0/2737202249 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcae406c2b0 0x7fcae406e770 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.800+0000 7fcafe4e4640 1 --2- 172.21.15.123:0/2737202249 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcaf815e740 0x7fcaf80b46a0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.800+0000 7fcafe4e4640 1 --2- 172.21.15.123:0/2737202249 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcaf8073990 0x7fcaf81f4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.800+0000 7fcafe4e4640 1 --2- 172.21.15.123:0/2737202249 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcaf8073330 0x7fcaf815ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:44.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.800+0000 7fcafe4e4640 1 -- 172.21.15.123:0/2737202249 >> 172.21.15.123:0/2737202249 conn(0x7fcaf806f400 msgr2=0x7fcaf80ce220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:44.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.800+0000 7fcafe4e4640 1 -- 172.21.15.123:0/2737202249 shutdown_connections 2024-09-15T23:19:44.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:44.800+0000 7fcafe4e4640 1 -- 172.21.15.123:0/2737202249 wait complete. 2024-09-15T23:19:44.812 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T23:19:44.812 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:19:44.812 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-09-15T23:19:44.812 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T23:19:44.812 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T23:19:44.812 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T23:19:44.812 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T23:19:44.812 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:19:44.813 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:19:44.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:19:44.813 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-09-15T23:19:44.829 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:19:44.829 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:19:44.829 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:19:44.829 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:19:44.829 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-09-15T23:19:44.829 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:19:44.829 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:19:44.829 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-09-15T23:19:44.829 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f0 2024-09-15T23:19:44.829 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:19:44.830 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:19:44.830 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f1 2024-09-15T23:19:44.830 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:19:44.830 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:19:44.830 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:19:44.830 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:19:44.830 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T23:19:44.830 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42355sec preferred_lft 42355sec 2024-09-15T23:19:44.830 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link noprefixroute 2024-09-15T23:19:44.830 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:19:44.830 INFO:teuthology.orchestra.run.smithi123.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:19:44.830 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 46:55:5a:e0:32:4d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:19:44.831 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:19:44.831 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:19:44.831 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::1c6f:d5ff:fe19:ff05/64 scope link 2024-09-15T23:19:44.831 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:19:44.831 INFO:teuthology.orchestra.run.smithi123.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:19:44.831 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 46:55:5a:e0:32:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:19:44.831 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::4455:5aff:fee0:324d/64 scope link 2024-09-15T23:19:44.831 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:19:44.831 INFO:teuthology.orchestra.run.smithi123.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:19:44.831 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether be:c1:f3:63:cb:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:19:44.831 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::bcc1:f3ff:fe63:cb24/64 scope link 2024-09-15T23:19:44.831 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:19:44.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:19:44.832 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:19:44.893 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-09-15T23:19:44.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:19:44.895 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-09-15T23:19:44.951 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-09-15T23:19:44.951 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:19:44.951 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:19:44.951 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:19:44.951 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:19:44.952 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:19:44.952 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:44.952 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:19:44.952 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:19:44.952 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:19:44.952 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:45.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:19:45.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:45.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:19:45.077 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-09-15T23:19:45.092 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T23:19:45.093 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:19:45.093 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:19:45.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:19:45.093 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2024-09-15T23:19:45.157 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:19:45.158 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T23:19:45.213 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:19:45.213 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:19:45.213 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:19:45.269 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T23:19:45.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:19:45.269 DEBUG:teuthology.orchestra.run.smithi123:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:19:45.353 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:19:45.353 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:19:45.353 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:19:45.361 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:19:45.362 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:19:45.362 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:19:45.362 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.188:3300,172.21.15.188:3301" 2024-09-15T23:19:45.362 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T23:19:45.372 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:19:45.372 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:19:45.372 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:19:45.372 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.188:3300,172.21.15.188:3301" 2024-09-15T23:19:45.372 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T23:19:45.372 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:6789,172.21.15.188:6789,172.21.15.188:6790" 2024-09-15T23:19:45.372 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.123:6789,172.21.15.188:6789,172.21.15.188:6790:/ 2024-09-15T23:19:45.373 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=cb968ac4-8d3a-4b17-a673-6177aeaea589" will pass to kernel 2024-09-15T23:19:45.377 INFO:teuthology.orchestra.run.smithi123.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-15T23:19:45.377 INFO:teuthology.orchestra.run.smithi123.stdout: You just mounted a file system that supports labels which does not 2024-09-15T23:19:45.377 INFO:teuthology.orchestra.run.smithi123.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T23:19:45.377 INFO:teuthology.orchestra.run.smithi123.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T23:19:45.377 INFO:teuthology.orchestra.run.smithi123.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T23:19:45.378 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T23:19:45.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:19:45.378 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:19:45.403 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T23:19:45.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:45.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:45.505 INFO:teuthology.orchestra.run.smithi123.stdout:client7426 2024-09-15T23:19:45.505 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:19:45.505 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:19:45.521 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2024-09-15T23:19:45.522 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_control_test_path 2024-09-15T23:19:45.522 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:45.522 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:45.522 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.0 2024-09-15T23:19:45.522 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:45.523 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:45.523 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:45.523 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:45.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:45.632 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:45.632 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:45.632 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00915406 s, 115 MB/s 2024-09-15T23:19:45.642 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:45.642 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:45.643 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00861527 s, 122 MB/s 2024-09-15T23:19:45.652 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:45.652 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:45.652 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726174 s, 144 MB/s 2024-09-15T23:19:45.661 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:45.661 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:45.661 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734861 s, 143 MB/s 2024-09-15T23:19:45.670 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:45.670 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:45.670 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713281 s, 147 MB/s 2024-09-15T23:19:45.680 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:45.680 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:45.680 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00804794 s, 130 MB/s 2024-09-15T23:19:45.689 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:45.689 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:45.689 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754246 s, 139 MB/s 2024-09-15T23:19:45.698 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:45.698 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:45.698 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076266 s, 137 MB/s 2024-09-15T23:19:45.708 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:45.708 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:45.708 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779295 s, 135 MB/s 2024-09-15T23:19:45.717 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:45.717 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:45.717 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732498 s, 143 MB/s 2024-09-15T23:19:45.725 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:45.725 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:45.726 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672413 s, 156 MB/s 2024-09-15T23:19:45.735 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:45.735 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:45.735 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00800388 s, 131 MB/s 2024-09-15T23:19:45.744 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:45.744 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:45.744 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711376 s, 147 MB/s 2024-09-15T23:19:45.753 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:45.753 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:45.753 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674421 s, 155 MB/s 2024-09-15T23:19:45.762 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:45.762 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:45.762 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758147 s, 138 MB/s 2024-09-15T23:19:45.770 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:45.770 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:45.770 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645476 s, 162 MB/s 2024-09-15T23:19:45.780 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:45.780 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:45.780 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00804927 s, 130 MB/s 2024-09-15T23:19:45.789 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:45.789 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:45.789 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724164 s, 145 MB/s 2024-09-15T23:19:45.800 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:45.800 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:45.800 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00877434 s, 120 MB/s 2024-09-15T23:19:45.808 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:45.808 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:45.808 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658293 s, 159 MB/s 2024-09-15T23:19:45.817 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:45.817 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:45.817 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706284 s, 148 MB/s 2024-09-15T23:19:45.826 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:45.826 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:45.826 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731155 s, 143 MB/s 2024-09-15T23:19:45.836 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:45.836 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:45.836 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00879881 s, 119 MB/s 2024-09-15T23:19:45.844 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:45.844 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:45.844 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643519 s, 163 MB/s 2024-09-15T23:19:45.852 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:45.852 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:45.853 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616098 s, 170 MB/s 2024-09-15T23:19:45.861 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:45.861 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:45.861 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662424 s, 158 MB/s 2024-09-15T23:19:45.870 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:45.870 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:45.870 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729268 s, 144 MB/s 2024-09-15T23:19:45.878 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:45.878 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:45.878 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612056 s, 171 MB/s 2024-09-15T23:19:45.886 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:45.886 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:45.887 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702017 s, 149 MB/s 2024-09-15T23:19:45.894 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:45.894 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:45.894 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649782 s, 161 MB/s 2024-09-15T23:19:45.902 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:45.903 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:45.903 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653492 s, 160 MB/s 2024-09-15T23:19:45.911 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:45.911 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:45.911 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675009 s, 155 MB/s 2024-09-15T23:19:45.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:45.918 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:45.918 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:45.918 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.1 2024-09-15T23:19:45.918 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:45.918 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:45.918 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:45.918 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:45.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:45.976 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:45.976 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:45.976 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598494 s, 175 MB/s 2024-09-15T23:19:45.985 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:45.985 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:45.986 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727695 s, 144 MB/s 2024-09-15T23:19:45.993 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:45.994 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:45.994 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646974 s, 162 MB/s 2024-09-15T23:19:46.002 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.002 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.002 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726554 s, 144 MB/s 2024-09-15T23:19:46.012 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.012 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.012 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747489 s, 140 MB/s 2024-09-15T23:19:46.021 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.021 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.021 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746862 s, 140 MB/s 2024-09-15T23:19:46.030 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.030 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.030 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072702 s, 144 MB/s 2024-09-15T23:19:46.039 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.039 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.039 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709033 s, 148 MB/s 2024-09-15T23:19:46.048 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.048 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.048 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735354 s, 143 MB/s 2024-09-15T23:19:46.056 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.056 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.056 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642078 s, 163 MB/s 2024-09-15T23:19:46.064 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.064 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.064 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619081 s, 169 MB/s 2024-09-15T23:19:46.072 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.072 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.072 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592861 s, 177 MB/s 2024-09-15T23:19:46.080 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.080 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.080 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655068 s, 160 MB/s 2024-09-15T23:19:46.089 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.089 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.089 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729824 s, 144 MB/s 2024-09-15T23:19:46.097 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.097 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.097 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602681 s, 174 MB/s 2024-09-15T23:19:46.106 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.106 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.106 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749425 s, 140 MB/s 2024-09-15T23:19:46.115 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.115 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.116 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00784628 s, 134 MB/s 2024-09-15T23:19:46.123 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.123 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.123 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581652 s, 180 MB/s 2024-09-15T23:19:46.132 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.132 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.132 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734495 s, 143 MB/s 2024-09-15T23:19:46.143 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.143 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.143 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00884019 s, 119 MB/s 2024-09-15T23:19:46.152 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.152 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.152 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073957 s, 142 MB/s 2024-09-15T23:19:46.161 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.162 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.162 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776734 s, 135 MB/s 2024-09-15T23:19:46.169 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.169 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.169 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568567 s, 184 MB/s 2024-09-15T23:19:46.177 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.178 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.178 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654459 s, 160 MB/s 2024-09-15T23:19:46.186 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.186 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.186 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659925 s, 159 MB/s 2024-09-15T23:19:46.194 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.195 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.195 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686731 s, 153 MB/s 2024-09-15T23:19:46.203 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.203 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.203 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636524 s, 165 MB/s 2024-09-15T23:19:46.212 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.212 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.212 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747321 s, 140 MB/s 2024-09-15T23:19:46.221 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.221 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.221 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717972 s, 146 MB/s 2024-09-15T23:19:46.229 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.229 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.229 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667698 s, 157 MB/s 2024-09-15T23:19:46.238 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.238 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.239 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075548 s, 139 MB/s 2024-09-15T23:19:46.247 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.247 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.247 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721872 s, 145 MB/s 2024-09-15T23:19:46.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:46.254 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:46.254 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:46.254 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.2 2024-09-15T23:19:46.254 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:46.254 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:46.254 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:46.254 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:46.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:46.313 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.313 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.313 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679279 s, 154 MB/s 2024-09-15T23:19:46.321 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.321 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.321 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645956 s, 162 MB/s 2024-09-15T23:19:46.331 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.332 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.332 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00835573 s, 125 MB/s 2024-09-15T23:19:46.340 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.340 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.340 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720206 s, 146 MB/s 2024-09-15T23:19:46.350 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.350 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.351 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00832206 s, 126 MB/s 2024-09-15T23:19:46.359 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.360 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.360 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749981 s, 140 MB/s 2024-09-15T23:19:46.369 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.369 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.369 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00769345 s, 136 MB/s 2024-09-15T23:19:46.378 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.379 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.379 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0079603 s, 132 MB/s 2024-09-15T23:19:46.387 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.387 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.387 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660862 s, 159 MB/s 2024-09-15T23:19:46.395 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.395 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.395 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645853 s, 162 MB/s 2024-09-15T23:19:46.404 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.404 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.404 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071769 s, 146 MB/s 2024-09-15T23:19:46.413 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.413 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.413 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007371 s, 142 MB/s 2024-09-15T23:19:46.422 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.422 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.422 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728472 s, 144 MB/s 2024-09-15T23:19:46.430 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.430 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.430 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673732 s, 156 MB/s 2024-09-15T23:19:46.439 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.439 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.439 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684641 s, 153 MB/s 2024-09-15T23:19:46.446 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.447 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.447 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619425 s, 169 MB/s 2024-09-15T23:19:46.455 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.456 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.456 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071427 s, 147 MB/s 2024-09-15T23:19:46.463 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.463 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.463 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579282 s, 181 MB/s 2024-09-15T23:19:46.470 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.471 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.471 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587278 s, 179 MB/s 2024-09-15T23:19:46.478 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.478 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.478 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571576 s, 183 MB/s 2024-09-15T23:19:46.487 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.487 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.487 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753293 s, 139 MB/s 2024-09-15T23:19:46.496 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.496 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.496 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714256 s, 147 MB/s 2024-09-15T23:19:46.506 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.507 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.507 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752675 s, 139 MB/s 2024-09-15T23:19:46.514 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.514 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.514 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717873 s, 146 MB/s 2024-09-15T23:19:46.523 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.524 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.524 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731113 s, 143 MB/s 2024-09-15T23:19:46.532 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.532 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.533 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748443 s, 140 MB/s 2024-09-15T23:19:46.541 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.541 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.542 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070973 s, 148 MB/s 2024-09-15T23:19:46.549 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.550 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.550 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647951 s, 162 MB/s 2024-09-15T23:19:46.558 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.558 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.558 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066217 s, 158 MB/s 2024-09-15T23:19:46.568 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.568 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.568 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00801963 s, 131 MB/s 2024-09-15T23:19:46.575 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.576 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.576 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577284 s, 182 MB/s 2024-09-15T23:19:46.585 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.585 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.585 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00797131 s, 132 MB/s 2024-09-15T23:19:46.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:46.592 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:46.592 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:46.592 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.3 2024-09-15T23:19:46.592 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:46.592 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:46.592 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:46.592 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:46.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:46.651 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.651 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.651 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064606 s, 162 MB/s 2024-09-15T23:19:46.660 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.660 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.660 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699579 s, 150 MB/s 2024-09-15T23:19:46.669 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.669 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.669 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755974 s, 139 MB/s 2024-09-15T23:19:46.677 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.677 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.677 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600139 s, 175 MB/s 2024-09-15T23:19:46.685 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.685 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.686 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626899 s, 167 MB/s 2024-09-15T23:19:46.694 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.694 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.694 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068375 s, 153 MB/s 2024-09-15T23:19:46.703 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.704 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.704 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00802746 s, 131 MB/s 2024-09-15T23:19:46.711 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.712 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.712 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064969 s, 161 MB/s 2024-09-15T23:19:46.721 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.721 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.721 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746897 s, 140 MB/s 2024-09-15T23:19:46.729 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.729 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.729 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651714 s, 161 MB/s 2024-09-15T23:19:46.738 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.738 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.738 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729881 s, 144 MB/s 2024-09-15T23:19:46.747 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.747 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.747 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723356 s, 145 MB/s 2024-09-15T23:19:46.756 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.756 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.756 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065378 s, 160 MB/s 2024-09-15T23:19:46.764 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.764 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.765 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725884 s, 144 MB/s 2024-09-15T23:19:46.773 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.773 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.773 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667966 s, 157 MB/s 2024-09-15T23:19:46.781 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.781 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.781 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630302 s, 166 MB/s 2024-09-15T23:19:46.788 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.788 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.788 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580491 s, 181 MB/s 2024-09-15T23:19:46.797 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.797 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.797 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690432 s, 152 MB/s 2024-09-15T23:19:46.807 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.807 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.807 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00820345 s, 128 MB/s 2024-09-15T23:19:46.815 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.816 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.816 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720346 s, 146 MB/s 2024-09-15T23:19:46.823 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.823 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.824 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614758 s, 171 MB/s 2024-09-15T23:19:46.832 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.832 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.832 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658565 s, 159 MB/s 2024-09-15T23:19:46.840 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.841 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.841 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718273 s, 146 MB/s 2024-09-15T23:19:46.849 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.849 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.849 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653865 s, 160 MB/s 2024-09-15T23:19:46.858 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.859 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.859 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771378 s, 136 MB/s 2024-09-15T23:19:46.867 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.867 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.867 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713066 s, 147 MB/s 2024-09-15T23:19:46.876 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.876 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.876 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720997 s, 145 MB/s 2024-09-15T23:19:46.885 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.885 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.885 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694182 s, 151 MB/s 2024-09-15T23:19:46.893 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.893 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.893 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671189 s, 156 MB/s 2024-09-15T23:19:46.902 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.902 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.902 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695403 s, 151 MB/s 2024-09-15T23:19:46.910 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.910 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.910 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676004 s, 155 MB/s 2024-09-15T23:19:46.919 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.919 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.919 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734286 s, 143 MB/s 2024-09-15T23:19:46.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:46.926 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:46.926 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:46.926 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.4 2024-09-15T23:19:46.926 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:46.926 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:46.926 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:46.926 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:46.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:46.984 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.984 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.984 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653769 s, 160 MB/s 2024-09-15T23:19:46.992 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:46.992 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:46.992 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601983 s, 174 MB/s 2024-09-15T23:19:47.001 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.001 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.001 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745024 s, 141 MB/s 2024-09-15T23:19:47.010 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.010 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.010 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682173 s, 154 MB/s 2024-09-15T23:19:47.017 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.018 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.018 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586038 s, 179 MB/s 2024-09-15T23:19:47.026 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.026 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.026 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642655 s, 163 MB/s 2024-09-15T23:19:47.035 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.035 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.035 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00782777 s, 134 MB/s 2024-09-15T23:19:47.045 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.045 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.045 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762562 s, 138 MB/s 2024-09-15T23:19:47.053 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.053 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.053 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690782 s, 152 MB/s 2024-09-15T23:19:47.063 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.063 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.063 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00836763 s, 125 MB/s 2024-09-15T23:19:47.072 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.072 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.072 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716145 s, 146 MB/s 2024-09-15T23:19:47.081 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.081 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.081 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709801 s, 148 MB/s 2024-09-15T23:19:47.093 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.094 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.094 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663442 s, 158 MB/s 2024-09-15T23:19:47.098 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.098 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.099 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722727 s, 145 MB/s 2024-09-15T23:19:47.106 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.106 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.106 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625021 s, 168 MB/s 2024-09-15T23:19:47.115 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.115 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.115 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680436 s, 154 MB/s 2024-09-15T23:19:47.124 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.124 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.124 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671006 s, 156 MB/s 2024-09-15T23:19:47.132 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.132 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.132 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649873 s, 161 MB/s 2024-09-15T23:19:47.140 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.141 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.141 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714759 s, 147 MB/s 2024-09-15T23:19:47.149 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.149 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.149 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710657 s, 148 MB/s 2024-09-15T23:19:47.159 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.159 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.159 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725165 s, 145 MB/s 2024-09-15T23:19:47.168 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.168 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.168 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00796572 s, 132 MB/s 2024-09-15T23:19:47.177 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.177 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.177 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744594 s, 141 MB/s 2024-09-15T23:19:47.188 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.188 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.188 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00875661 s, 120 MB/s 2024-09-15T23:19:47.197 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.197 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.197 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713645 s, 147 MB/s 2024-09-15T23:19:47.204 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.204 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.204 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566756 s, 185 MB/s 2024-09-15T23:19:47.213 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.213 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.213 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711661 s, 147 MB/s 2024-09-15T23:19:47.223 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.223 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.223 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00819757 s, 128 MB/s 2024-09-15T23:19:47.233 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.233 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.233 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733989 s, 143 MB/s 2024-09-15T23:19:47.241 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.241 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.241 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661637 s, 158 MB/s 2024-09-15T23:19:47.248 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.248 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.248 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572853 s, 183 MB/s 2024-09-15T23:19:47.256 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.256 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.256 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636459 s, 165 MB/s 2024-09-15T23:19:47.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:47.263 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:47.263 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:47.263 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.5 2024-09-15T23:19:47.263 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:47.263 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:47.263 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:47.264 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:47.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:47.322 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.322 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.322 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641571 s, 163 MB/s 2024-09-15T23:19:47.331 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.331 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.332 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00773197 s, 136 MB/s 2024-09-15T23:19:47.339 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.339 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.339 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582107 s, 180 MB/s 2024-09-15T23:19:47.349 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.349 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.349 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00834378 s, 126 MB/s 2024-09-15T23:19:47.360 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.360 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.360 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718297 s, 146 MB/s 2024-09-15T23:19:47.367 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.367 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.367 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729245 s, 144 MB/s 2024-09-15T23:19:47.375 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.375 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.375 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647278 s, 162 MB/s 2024-09-15T23:19:47.384 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.384 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.384 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647502 s, 162 MB/s 2024-09-15T23:19:47.391 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.392 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.392 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643655 s, 163 MB/s 2024-09-15T23:19:47.401 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.401 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.401 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00799994 s, 131 MB/s 2024-09-15T23:19:47.410 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.410 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.410 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670605 s, 156 MB/s 2024-09-15T23:19:47.417 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.417 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.417 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592312 s, 177 MB/s 2024-09-15T23:19:47.425 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.425 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.425 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581959 s, 180 MB/s 2024-09-15T23:19:47.435 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.435 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.435 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762952 s, 137 MB/s 2024-09-15T23:19:47.443 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.443 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.443 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697603 s, 150 MB/s 2024-09-15T23:19:47.452 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.452 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.452 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695078 s, 151 MB/s 2024-09-15T23:19:47.459 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.460 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.460 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601803 s, 174 MB/s 2024-09-15T23:19:47.468 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.468 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.468 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675454 s, 155 MB/s 2024-09-15T23:19:47.476 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.477 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.477 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666041 s, 157 MB/s 2024-09-15T23:19:47.485 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.485 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.485 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066987 s, 157 MB/s 2024-09-15T23:19:47.494 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.494 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.494 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746092 s, 141 MB/s 2024-09-15T23:19:47.502 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.502 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.502 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588479 s, 178 MB/s 2024-09-15T23:19:47.510 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.510 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.510 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657769 s, 159 MB/s 2024-09-15T23:19:47.520 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.520 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.520 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746665 s, 140 MB/s 2024-09-15T23:19:47.527 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.527 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.527 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580288 s, 181 MB/s 2024-09-15T23:19:47.535 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.535 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.535 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649625 s, 161 MB/s 2024-09-15T23:19:47.543 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.543 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.543 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581298 s, 180 MB/s 2024-09-15T23:19:47.551 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.551 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.551 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064199 s, 163 MB/s 2024-09-15T23:19:47.559 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.559 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.559 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592877 s, 177 MB/s 2024-09-15T23:19:47.567 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.567 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.567 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663824 s, 158 MB/s 2024-09-15T23:19:47.576 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.576 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.576 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714691 s, 147 MB/s 2024-09-15T23:19:47.584 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.584 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.584 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587274 s, 179 MB/s 2024-09-15T23:19:47.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:47.590 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:47.591 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:47.591 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.6 2024-09-15T23:19:47.591 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:47.591 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:47.591 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:47.591 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:47.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:47.651 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.651 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.652 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00851193 s, 123 MB/s 2024-09-15T23:19:47.661 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.661 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.661 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738571 s, 142 MB/s 2024-09-15T23:19:47.668 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.669 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.669 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571009 s, 184 MB/s 2024-09-15T23:19:47.677 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.677 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.677 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647215 s, 162 MB/s 2024-09-15T23:19:47.685 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.685 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.685 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645007 s, 163 MB/s 2024-09-15T23:19:47.694 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.694 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.694 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726188 s, 144 MB/s 2024-09-15T23:19:47.703 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.703 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.703 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739667 s, 142 MB/s 2024-09-15T23:19:47.712 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.712 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.712 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726684 s, 144 MB/s 2024-09-15T23:19:47.721 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.721 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.721 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701098 s, 150 MB/s 2024-09-15T23:19:47.730 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.730 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.730 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728346 s, 144 MB/s 2024-09-15T23:19:47.738 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.739 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.739 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644624 s, 163 MB/s 2024-09-15T23:19:47.747 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.747 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.747 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720652 s, 146 MB/s 2024-09-15T23:19:47.755 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.755 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.756 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063761 s, 164 MB/s 2024-09-15T23:19:47.763 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.763 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.763 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608318 s, 172 MB/s 2024-09-15T23:19:47.772 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.772 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.772 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068008 s, 154 MB/s 2024-09-15T23:19:47.781 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.781 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.781 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073601 s, 142 MB/s 2024-09-15T23:19:47.789 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.789 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.789 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645262 s, 163 MB/s 2024-09-15T23:19:47.797 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.797 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.797 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659291 s, 159 MB/s 2024-09-15T23:19:47.805 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.806 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.806 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650072 s, 161 MB/s 2024-09-15T23:19:47.813 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.813 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.813 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615632 s, 170 MB/s 2024-09-15T23:19:47.821 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.821 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.821 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600209 s, 175 MB/s 2024-09-15T23:19:47.829 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.829 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.829 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571974 s, 183 MB/s 2024-09-15T23:19:47.837 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.837 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.838 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708005 s, 148 MB/s 2024-09-15T23:19:47.845 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.845 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.846 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640604 s, 164 MB/s 2024-09-15T23:19:47.853 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.853 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.853 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576841 s, 182 MB/s 2024-09-15T23:19:47.862 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.863 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.863 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743055 s, 141 MB/s 2024-09-15T23:19:47.870 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.870 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.871 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578841 s, 181 MB/s 2024-09-15T23:19:47.878 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.879 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.879 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651073 s, 161 MB/s 2024-09-15T23:19:47.886 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.886 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.886 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00557047 s, 188 MB/s 2024-09-15T23:19:47.894 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.894 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.894 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646307 s, 162 MB/s 2024-09-15T23:19:47.902 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.902 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.902 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647327 s, 162 MB/s 2024-09-15T23:19:47.911 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.911 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.911 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733423 s, 143 MB/s 2024-09-15T23:19:47.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:47.918 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:47.918 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:47.918 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.7 2024-09-15T23:19:47.918 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:47.918 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:47.918 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:47.918 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:47.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:47.976 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.976 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.976 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569339 s, 184 MB/s 2024-09-15T23:19:47.985 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.985 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.985 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741516 s, 141 MB/s 2024-09-15T23:19:47.993 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:47.993 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:47.993 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585261 s, 179 MB/s 2024-09-15T23:19:48.001 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.001 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.001 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066165 s, 158 MB/s 2024-09-15T23:19:48.011 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.011 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.011 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744087 s, 141 MB/s 2024-09-15T23:19:48.019 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.019 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.019 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666931 s, 157 MB/s 2024-09-15T23:19:48.027 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.027 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.027 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648463 s, 162 MB/s 2024-09-15T23:19:48.035 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.035 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.035 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639327 s, 164 MB/s 2024-09-15T23:19:48.044 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.045 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.045 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735604 s, 143 MB/s 2024-09-15T23:19:48.054 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.054 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.055 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00796936 s, 132 MB/s 2024-09-15T23:19:48.062 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.063 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.063 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602447 s, 174 MB/s 2024-09-15T23:19:48.071 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.071 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.071 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652494 s, 161 MB/s 2024-09-15T23:19:48.080 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.080 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.080 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710988 s, 147 MB/s 2024-09-15T23:19:48.088 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.088 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.088 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650565 s, 161 MB/s 2024-09-15T23:19:48.097 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.097 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.097 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696982 s, 150 MB/s 2024-09-15T23:19:48.108 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.109 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.109 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010096 s, 104 MB/s 2024-09-15T23:19:48.117 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.117 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.117 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636929 s, 165 MB/s 2024-09-15T23:19:48.126 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.126 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.126 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747275 s, 140 MB/s 2024-09-15T23:19:48.135 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.135 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.135 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687388 s, 153 MB/s 2024-09-15T23:19:48.143 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.143 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.143 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666246 s, 157 MB/s 2024-09-15T23:19:48.151 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.151 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.151 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668662 s, 157 MB/s 2024-09-15T23:19:48.161 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.161 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.161 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768891 s, 136 MB/s 2024-09-15T23:19:48.170 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.170 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.170 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730427 s, 144 MB/s 2024-09-15T23:19:48.178 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.179 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.179 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652523 s, 161 MB/s 2024-09-15T23:19:48.187 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.188 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.188 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729657 s, 144 MB/s 2024-09-15T23:19:48.195 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.195 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.195 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577812 s, 181 MB/s 2024-09-15T23:19:48.205 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.205 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.205 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00798074 s, 131 MB/s 2024-09-15T23:19:48.214 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.214 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.214 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739149 s, 142 MB/s 2024-09-15T23:19:48.222 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.222 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.222 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645539 s, 162 MB/s 2024-09-15T23:19:48.230 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.230 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.231 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699481 s, 150 MB/s 2024-09-15T23:19:48.240 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.240 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.240 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759883 s, 138 MB/s 2024-09-15T23:19:48.248 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.248 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.248 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661137 s, 159 MB/s 2024-09-15T23:19:48.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:48.255 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:48.255 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:48.255 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.8 2024-09-15T23:19:48.255 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:48.255 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:48.256 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:48.256 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:48.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:48.314 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.314 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.314 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656185 s, 160 MB/s 2024-09-15T23:19:48.323 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.323 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.323 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661441 s, 159 MB/s 2024-09-15T23:19:48.331 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.331 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.331 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638872 s, 164 MB/s 2024-09-15T23:19:48.339 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.339 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.340 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710625 s, 148 MB/s 2024-09-15T23:19:48.347 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.347 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.347 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589217 s, 178 MB/s 2024-09-15T23:19:48.356 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.356 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.356 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697983 s, 150 MB/s 2024-09-15T23:19:48.365 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.365 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.365 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730079 s, 144 MB/s 2024-09-15T23:19:48.373 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.373 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.373 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579699 s, 181 MB/s 2024-09-15T23:19:48.381 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.381 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.381 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639327 s, 164 MB/s 2024-09-15T23:19:48.389 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.389 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.389 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063521 s, 165 MB/s 2024-09-15T23:19:48.396 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.397 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.397 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580225 s, 181 MB/s 2024-09-15T23:19:48.406 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.406 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.406 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771464 s, 136 MB/s 2024-09-15T23:19:48.414 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.414 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.414 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584318 s, 179 MB/s 2024-09-15T23:19:48.421 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.421 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.421 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578991 s, 181 MB/s 2024-09-15T23:19:48.429 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.429 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.429 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574298 s, 183 MB/s 2024-09-15T23:19:48.437 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.437 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.437 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629005 s, 167 MB/s 2024-09-15T23:19:48.453 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.453 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.453 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141326 s, 74.2 MB/s 2024-09-15T23:19:48.461 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.461 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.461 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637029 s, 165 MB/s 2024-09-15T23:19:48.470 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.470 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.470 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722736 s, 145 MB/s 2024-09-15T23:19:48.478 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.478 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.478 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711368 s, 147 MB/s 2024-09-15T23:19:48.486 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.487 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.487 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628663 s, 167 MB/s 2024-09-15T23:19:48.497 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.497 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.497 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00860783 s, 122 MB/s 2024-09-15T23:19:48.504 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.504 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.504 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585461 s, 179 MB/s 2024-09-15T23:19:48.512 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.512 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.513 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653157 s, 161 MB/s 2024-09-15T23:19:48.520 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.520 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.520 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574004 s, 183 MB/s 2024-09-15T23:19:48.528 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.528 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.528 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639227 s, 164 MB/s 2024-09-15T23:19:48.537 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.537 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.537 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719025 s, 146 MB/s 2024-09-15T23:19:48.546 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.547 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.547 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759772 s, 138 MB/s 2024-09-15T23:19:48.554 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.555 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.555 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628452 s, 167 MB/s 2024-09-15T23:19:48.563 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.563 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.563 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629586 s, 167 MB/s 2024-09-15T23:19:48.570 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.571 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.571 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617465 s, 170 MB/s 2024-09-15T23:19:48.578 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.578 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.578 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596591 s, 176 MB/s 2024-09-15T23:19:48.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:48.585 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:48.585 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:48.585 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.9 2024-09-15T23:19:48.585 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:48.585 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:48.585 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:48.585 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:48.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:48.645 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.645 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.645 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715291 s, 147 MB/s 2024-09-15T23:19:48.654 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.654 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.655 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756617 s, 139 MB/s 2024-09-15T23:19:48.663 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.663 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.663 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678461 s, 155 MB/s 2024-09-15T23:19:48.673 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.673 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.673 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00773068 s, 136 MB/s 2024-09-15T23:19:48.681 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.681 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.681 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641548 s, 163 MB/s 2024-09-15T23:19:48.688 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.689 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.689 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595559 s, 176 MB/s 2024-09-15T23:19:48.698 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.698 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.698 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767889 s, 137 MB/s 2024-09-15T23:19:48.707 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.707 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.707 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709434 s, 148 MB/s 2024-09-15T23:19:48.716 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.716 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.716 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704434 s, 149 MB/s 2024-09-15T23:19:48.725 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.726 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.726 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00783706 s, 134 MB/s 2024-09-15T23:19:48.734 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.734 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.734 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649661 s, 161 MB/s 2024-09-15T23:19:48.743 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.743 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.743 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722522 s, 145 MB/s 2024-09-15T23:19:48.750 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.750 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.750 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00548946 s, 191 MB/s 2024-09-15T23:19:48.758 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.759 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.759 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065851 s, 159 MB/s 2024-09-15T23:19:48.766 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.767 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.767 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628764 s, 167 MB/s 2024-09-15T23:19:48.775 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.775 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.776 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701153 s, 150 MB/s 2024-09-15T23:19:48.784 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.785 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.785 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675964 s, 155 MB/s 2024-09-15T23:19:48.793 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.793 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.793 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075501 s, 139 MB/s 2024-09-15T23:19:48.801 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.801 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.801 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643406 s, 163 MB/s 2024-09-15T23:19:48.808 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.808 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.809 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589782 s, 178 MB/s 2024-09-15T23:19:48.817 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.817 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.817 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716973 s, 146 MB/s 2024-09-15T23:19:48.825 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.825 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.825 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635698 s, 165 MB/s 2024-09-15T23:19:48.832 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.833 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.833 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00562643 s, 186 MB/s 2024-09-15T23:19:48.841 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.841 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.841 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662927 s, 158 MB/s 2024-09-15T23:19:48.849 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.849 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.850 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662293 s, 158 MB/s 2024-09-15T23:19:48.857 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.857 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.857 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581404 s, 180 MB/s 2024-09-15T23:19:48.865 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.866 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.866 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072224 s, 145 MB/s 2024-09-15T23:19:48.873 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.873 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.874 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062535 s, 168 MB/s 2024-09-15T23:19:48.881 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.882 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.882 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658353 s, 159 MB/s 2024-09-15T23:19:48.890 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.891 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.891 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709468 s, 148 MB/s 2024-09-15T23:19:48.899 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.899 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.899 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719838 s, 146 MB/s 2024-09-15T23:19:48.907 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.908 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.908 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664258 s, 158 MB/s 2024-09-15T23:19:48.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:48.915 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:48.915 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:48.915 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.10 2024-09-15T23:19:48.915 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:48.915 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:48.915 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:48.915 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:48.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:48.973 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.973 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.973 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585174 s, 179 MB/s 2024-09-15T23:19:48.983 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.983 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.983 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00786702 s, 133 MB/s 2024-09-15T23:19:48.992 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:48.992 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:48.992 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730088 s, 144 MB/s 2024-09-15T23:19:49.000 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.000 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.001 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669422 s, 157 MB/s 2024-09-15T23:19:49.008 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.008 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.008 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641138 s, 164 MB/s 2024-09-15T23:19:49.017 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.017 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.017 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680666 s, 154 MB/s 2024-09-15T23:19:49.027 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.027 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.027 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00801326 s, 131 MB/s 2024-09-15T23:19:49.035 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.035 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.035 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670813 s, 156 MB/s 2024-09-15T23:19:49.043 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.043 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.043 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060732 s, 173 MB/s 2024-09-15T23:19:49.053 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.053 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.053 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767783 s, 137 MB/s 2024-09-15T23:19:49.062 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.062 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.062 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00789765 s, 133 MB/s 2024-09-15T23:19:49.071 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.071 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.071 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729974 s, 144 MB/s 2024-09-15T23:19:49.080 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.080 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.080 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723588 s, 145 MB/s 2024-09-15T23:19:49.088 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.088 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.088 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590338 s, 178 MB/s 2024-09-15T23:19:49.097 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.097 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.097 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075849 s, 138 MB/s 2024-09-15T23:19:49.105 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.105 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.105 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601299 s, 174 MB/s 2024-09-15T23:19:49.115 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.115 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.116 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00792794 s, 132 MB/s 2024-09-15T23:19:49.125 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.125 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.125 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776263 s, 135 MB/s 2024-09-15T23:19:49.133 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.133 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.133 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648941 s, 162 MB/s 2024-09-15T23:19:49.140 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.140 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.140 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576273 s, 182 MB/s 2024-09-15T23:19:49.148 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.149 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.149 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638148 s, 164 MB/s 2024-09-15T23:19:49.156 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.156 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.156 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00556098 s, 189 MB/s 2024-09-15T23:19:49.165 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.165 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.165 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736281 s, 142 MB/s 2024-09-15T23:19:49.173 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.173 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.173 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599511 s, 175 MB/s 2024-09-15T23:19:49.181 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.181 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.181 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651944 s, 161 MB/s 2024-09-15T23:19:49.190 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.190 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.191 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738309 s, 142 MB/s 2024-09-15T23:19:49.202 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.202 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.202 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00965873 s, 109 MB/s 2024-09-15T23:19:49.210 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.211 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.211 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720192 s, 146 MB/s 2024-09-15T23:19:49.220 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.220 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.220 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071846 s, 146 MB/s 2024-09-15T23:19:49.228 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.229 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.229 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709992 s, 148 MB/s 2024-09-15T23:19:49.237 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.237 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.237 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684706 s, 153 MB/s 2024-09-15T23:19:49.246 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.246 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.246 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733828 s, 143 MB/s 2024-09-15T23:19:49.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:49.253 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:49.253 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:49.253 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.11 2024-09-15T23:19:49.253 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:49.253 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:49.253 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:49.253 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:49.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:49.313 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.313 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.313 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743666 s, 141 MB/s 2024-09-15T23:19:49.321 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.321 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.321 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641936 s, 163 MB/s 2024-09-15T23:19:49.330 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.331 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.331 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728462 s, 144 MB/s 2024-09-15T23:19:49.339 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.339 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.339 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711575 s, 147 MB/s 2024-09-15T23:19:49.348 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.348 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.348 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673901 s, 156 MB/s 2024-09-15T23:19:49.357 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.358 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.358 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00821251 s, 128 MB/s 2024-09-15T23:19:49.367 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.367 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.367 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760547 s, 138 MB/s 2024-09-15T23:19:49.377 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.377 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.377 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00793712 s, 132 MB/s 2024-09-15T23:19:49.385 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.386 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.386 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655577 s, 160 MB/s 2024-09-15T23:19:49.394 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.394 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.394 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679567 s, 154 MB/s 2024-09-15T23:19:49.403 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.403 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.403 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768631 s, 136 MB/s 2024-09-15T23:19:49.411 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.411 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.411 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625939 s, 168 MB/s 2024-09-15T23:19:49.419 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.419 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.419 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589609 s, 178 MB/s 2024-09-15T23:19:49.426 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.427 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.427 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605397 s, 173 MB/s 2024-09-15T23:19:49.436 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.436 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.436 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758285 s, 138 MB/s 2024-09-15T23:19:49.445 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.445 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.445 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670733 s, 156 MB/s 2024-09-15T23:19:49.453 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.453 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.453 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651079 s, 161 MB/s 2024-09-15T23:19:49.462 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.462 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.462 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663893 s, 158 MB/s 2024-09-15T23:19:49.470 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.470 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.471 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718214 s, 146 MB/s 2024-09-15T23:19:49.479 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.479 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.480 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715387 s, 147 MB/s 2024-09-15T23:19:49.488 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.488 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.488 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650224 s, 161 MB/s 2024-09-15T23:19:49.497 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.497 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.497 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762316 s, 138 MB/s 2024-09-15T23:19:49.506 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.507 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.507 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752436 s, 139 MB/s 2024-09-15T23:19:49.515 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.515 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.515 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688275 s, 152 MB/s 2024-09-15T23:19:49.523 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.523 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.524 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643502 s, 163 MB/s 2024-09-15T23:19:49.532 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.532 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.532 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714791 s, 147 MB/s 2024-09-15T23:19:49.541 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.541 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.541 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714673 s, 147 MB/s 2024-09-15T23:19:49.548 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.549 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.549 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595016 s, 176 MB/s 2024-09-15T23:19:49.558 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.558 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.558 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760303 s, 138 MB/s 2024-09-15T23:19:49.566 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.566 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.566 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640187 s, 164 MB/s 2024-09-15T23:19:49.576 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.629 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.629 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00805757 s, 130 MB/s 2024-09-15T23:19:49.630 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.630 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.630 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708361 s, 148 MB/s 2024-09-15T23:19:49.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:49.631 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:49.631 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:49.631 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.12 2024-09-15T23:19:49.631 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:49.631 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:49.631 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:49.632 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:49.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:49.691 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.691 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.691 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645727 s, 162 MB/s 2024-09-15T23:19:49.700 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.700 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.700 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720912 s, 145 MB/s 2024-09-15T23:19:49.709 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.709 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.709 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710288 s, 148 MB/s 2024-09-15T23:19:49.718 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.718 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.718 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735229 s, 143 MB/s 2024-09-15T23:19:49.726 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.726 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.726 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613676 s, 171 MB/s 2024-09-15T23:19:49.734 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.734 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.734 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620975 s, 169 MB/s 2024-09-15T23:19:49.742 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.743 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.743 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676411 s, 155 MB/s 2024-09-15T23:19:49.753 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.753 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.753 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622237 s, 169 MB/s 2024-09-15T23:19:49.758 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.759 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.759 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645737 s, 162 MB/s 2024-09-15T23:19:49.766 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.766 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.766 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613335 s, 171 MB/s 2024-09-15T23:19:49.774 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.774 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.774 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598272 s, 175 MB/s 2024-09-15T23:19:49.781 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.781 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.781 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00549459 s, 191 MB/s 2024-09-15T23:19:49.789 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.789 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.790 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646461 s, 162 MB/s 2024-09-15T23:19:49.798 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.798 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.798 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063709 s, 165 MB/s 2024-09-15T23:19:49.807 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.807 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.807 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722293 s, 145 MB/s 2024-09-15T23:19:49.815 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.816 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.816 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704793 s, 149 MB/s 2024-09-15T23:19:49.824 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.824 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.824 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678187 s, 155 MB/s 2024-09-15T23:19:49.833 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.833 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.833 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715805 s, 146 MB/s 2024-09-15T23:19:49.841 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.841 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.841 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636598 s, 165 MB/s 2024-09-15T23:19:49.849 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.849 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.849 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063851 s, 164 MB/s 2024-09-15T23:19:49.858 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.858 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.858 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717789 s, 146 MB/s 2024-09-15T23:19:49.867 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.867 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.867 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751584 s, 140 MB/s 2024-09-15T23:19:49.875 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.875 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.875 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586072 s, 179 MB/s 2024-09-15T23:19:49.883 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.883 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.883 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622297 s, 169 MB/s 2024-09-15T23:19:49.890 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.891 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.891 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593923 s, 177 MB/s 2024-09-15T23:19:49.899 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.899 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.899 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618278 s, 170 MB/s 2024-09-15T23:19:49.908 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.908 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.908 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739842 s, 142 MB/s 2024-09-15T23:19:49.917 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.917 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.917 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725386 s, 145 MB/s 2024-09-15T23:19:49.925 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.925 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.925 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629807 s, 166 MB/s 2024-09-15T23:19:49.932 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.932 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.933 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00559486 s, 187 MB/s 2024-09-15T23:19:49.942 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.942 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.942 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075405 s, 139 MB/s 2024-09-15T23:19:49.950 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:49.950 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:49.951 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709188 s, 148 MB/s 2024-09-15T23:19:49.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:49.957 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:49.957 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:49.957 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.13 2024-09-15T23:19:49.957 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:49.957 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:49.957 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:49.958 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:50.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:50.015 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.016 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.016 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650288 s, 161 MB/s 2024-09-15T23:19:50.024 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.024 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.024 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663603 s, 158 MB/s 2024-09-15T23:19:50.032 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.032 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.032 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667455 s, 157 MB/s 2024-09-15T23:19:50.040 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.040 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.040 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599423 s, 175 MB/s 2024-09-15T23:19:50.048 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.048 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.048 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572615 s, 183 MB/s 2024-09-15T23:19:50.057 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.057 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.057 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735912 s, 142 MB/s 2024-09-15T23:19:50.066 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.066 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.066 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704734 s, 149 MB/s 2024-09-15T23:19:50.075 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.075 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.075 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762664 s, 137 MB/s 2024-09-15T23:19:50.084 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.084 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.084 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662087 s, 158 MB/s 2024-09-15T23:19:50.093 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.093 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.093 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732244 s, 143 MB/s 2024-09-15T23:19:50.101 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.101 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.101 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631933 s, 166 MB/s 2024-09-15T23:19:50.109 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.110 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.110 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728317 s, 144 MB/s 2024-09-15T23:19:50.119 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.119 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.119 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767394 s, 137 MB/s 2024-09-15T23:19:50.127 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.127 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.128 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670988 s, 156 MB/s 2024-09-15T23:19:50.135 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.136 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.136 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640285 s, 164 MB/s 2024-09-15T23:19:50.143 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.143 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.143 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563623 s, 186 MB/s 2024-09-15T23:19:50.151 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.152 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.152 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675143 s, 155 MB/s 2024-09-15T23:19:50.161 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.161 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.161 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722576 s, 145 MB/s 2024-09-15T23:19:50.170 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.170 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.170 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00781478 s, 134 MB/s 2024-09-15T23:19:50.178 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.178 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.178 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618304 s, 170 MB/s 2024-09-15T23:19:50.188 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.188 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.188 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729615 s, 144 MB/s 2024-09-15T23:19:50.195 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.195 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.195 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064905 s, 162 MB/s 2024-09-15T23:19:50.204 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.204 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.204 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725692 s, 144 MB/s 2024-09-15T23:19:50.213 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.213 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.213 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660222 s, 159 MB/s 2024-09-15T23:19:50.221 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.221 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.221 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685404 s, 153 MB/s 2024-09-15T23:19:50.230 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.230 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.230 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703575 s, 149 MB/s 2024-09-15T23:19:50.239 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.239 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.239 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721536 s, 145 MB/s 2024-09-15T23:19:50.247 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.247 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.247 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062969 s, 167 MB/s 2024-09-15T23:19:50.255 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.255 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.255 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611363 s, 172 MB/s 2024-09-15T23:19:50.264 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.264 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.264 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721342 s, 145 MB/s 2024-09-15T23:19:50.272 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.272 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.272 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057519 s, 182 MB/s 2024-09-15T23:19:50.280 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.280 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.280 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668139 s, 157 MB/s 2024-09-15T23:19:50.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:50.287 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:50.287 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:50.287 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.14 2024-09-15T23:19:50.287 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:50.287 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:50.287 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:50.287 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:50.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:50.346 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.347 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.347 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731145 s, 143 MB/s 2024-09-15T23:19:50.355 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.355 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.356 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748036 s, 140 MB/s 2024-09-15T23:19:50.363 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.363 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.363 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614839 s, 171 MB/s 2024-09-15T23:19:50.372 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.372 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.372 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633176 s, 166 MB/s 2024-09-15T23:19:50.380 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.380 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.380 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668745 s, 157 MB/s 2024-09-15T23:19:50.388 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.388 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.388 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653858 s, 160 MB/s 2024-09-15T23:19:50.397 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.397 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.397 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733613 s, 143 MB/s 2024-09-15T23:19:50.406 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.406 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.406 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674055 s, 156 MB/s 2024-09-15T23:19:50.415 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.415 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.415 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071784 s, 146 MB/s 2024-09-15T23:19:50.423 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.423 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.423 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628316 s, 167 MB/s 2024-09-15T23:19:50.431 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.431 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.431 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667565 s, 157 MB/s 2024-09-15T23:19:50.440 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.440 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.440 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711803 s, 147 MB/s 2024-09-15T23:19:50.448 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.448 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.448 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631589 s, 166 MB/s 2024-09-15T23:19:50.455 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.456 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.456 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589233 s, 178 MB/s 2024-09-15T23:19:50.463 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.463 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.463 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577806 s, 181 MB/s 2024-09-15T23:19:50.472 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.472 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.472 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661164 s, 159 MB/s 2024-09-15T23:19:50.481 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.481 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.481 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709053 s, 148 MB/s 2024-09-15T23:19:50.490 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.490 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.490 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749011 s, 140 MB/s 2024-09-15T23:19:50.498 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.498 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.498 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653009 s, 161 MB/s 2024-09-15T23:19:50.506 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.506 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.506 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614118 s, 171 MB/s 2024-09-15T23:19:50.514 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.514 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.514 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601561 s, 174 MB/s 2024-09-15T23:19:50.521 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.521 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.522 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058432 s, 179 MB/s 2024-09-15T23:19:50.529 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.529 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.529 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00561327 s, 187 MB/s 2024-09-15T23:19:50.537 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.537 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.537 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607693 s, 173 MB/s 2024-09-15T23:19:50.546 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.546 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.546 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677966 s, 155 MB/s 2024-09-15T23:19:50.554 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.554 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.554 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067936 s, 154 MB/s 2024-09-15T23:19:50.564 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.564 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.564 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739424 s, 142 MB/s 2024-09-15T23:19:50.572 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.573 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.573 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073997 s, 142 MB/s 2024-09-15T23:19:50.581 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.581 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.581 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674331 s, 155 MB/s 2024-09-15T23:19:50.589 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.590 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.590 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065767 s, 159 MB/s 2024-09-15T23:19:50.598 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.598 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.598 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698655 s, 150 MB/s 2024-09-15T23:19:50.606 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.606 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.606 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641942 s, 163 MB/s 2024-09-15T23:19:50.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:50.613 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:50.613 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:50.613 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.15 2024-09-15T23:19:50.613 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:50.613 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:50.613 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:50.613 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:50.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:50.673 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.673 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.673 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738107 s, 142 MB/s 2024-09-15T23:19:50.682 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.682 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.682 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720259 s, 146 MB/s 2024-09-15T23:19:50.691 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.691 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.691 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068391 s, 153 MB/s 2024-09-15T23:19:50.699 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.699 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.699 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660802 s, 159 MB/s 2024-09-15T23:19:50.707 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.707 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.707 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591566 s, 177 MB/s 2024-09-15T23:19:50.716 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.716 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.716 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072073 s, 145 MB/s 2024-09-15T23:19:50.724 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.724 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.724 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628866 s, 167 MB/s 2024-09-15T23:19:50.734 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.734 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.734 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00797127 s, 132 MB/s 2024-09-15T23:19:50.744 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.744 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.744 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00817511 s, 128 MB/s 2024-09-15T23:19:50.751 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.751 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.751 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597328 s, 176 MB/s 2024-09-15T23:19:50.760 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.760 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.761 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729649 s, 144 MB/s 2024-09-15T23:19:50.768 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.768 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.768 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601161 s, 174 MB/s 2024-09-15T23:19:50.777 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.777 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.777 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707996 s, 148 MB/s 2024-09-15T23:19:50.786 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.786 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.786 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728346 s, 144 MB/s 2024-09-15T23:19:50.795 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.795 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.795 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702516 s, 149 MB/s 2024-09-15T23:19:50.802 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.802 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.802 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568477 s, 184 MB/s 2024-09-15T23:19:50.810 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.810 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.810 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633918 s, 165 MB/s 2024-09-15T23:19:50.818 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.819 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.819 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062586 s, 168 MB/s 2024-09-15T23:19:50.826 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.826 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.826 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586458 s, 179 MB/s 2024-09-15T23:19:50.834 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.834 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.834 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650403 s, 161 MB/s 2024-09-15T23:19:50.842 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.842 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.842 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578174 s, 181 MB/s 2024-09-15T23:19:50.849 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.849 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.849 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00553125 s, 190 MB/s 2024-09-15T23:19:50.858 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.858 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.858 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746113 s, 141 MB/s 2024-09-15T23:19:50.866 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.866 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.866 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588783 s, 178 MB/s 2024-09-15T23:19:50.874 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.874 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.874 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662713 s, 158 MB/s 2024-09-15T23:19:50.882 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.883 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.883 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670788 s, 156 MB/s 2024-09-15T23:19:50.890 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.891 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.891 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641568 s, 163 MB/s 2024-09-15T23:19:50.899 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.899 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.899 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717795 s, 146 MB/s 2024-09-15T23:19:50.907 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.907 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.908 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632382 s, 166 MB/s 2024-09-15T23:19:50.916 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.916 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.916 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071577 s, 146 MB/s 2024-09-15T23:19:50.924 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.924 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.925 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637587 s, 164 MB/s 2024-09-15T23:19:50.932 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.932 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.932 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570861 s, 184 MB/s 2024-09-15T23:19:50.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:50.938 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:50.938 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:50.939 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.16 2024-09-15T23:19:50.939 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:50.939 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:50.939 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:50.939 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:50.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:50.996 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:50.996 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:50.996 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600135 s, 175 MB/s 2024-09-15T23:19:51.005 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.006 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.006 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740715 s, 142 MB/s 2024-09-15T23:19:51.014 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.014 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.015 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712314 s, 147 MB/s 2024-09-15T23:19:51.022 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.022 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.022 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573442 s, 183 MB/s 2024-09-15T23:19:51.030 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.030 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.030 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666223 s, 157 MB/s 2024-09-15T23:19:51.038 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.039 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.039 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654325 s, 160 MB/s 2024-09-15T23:19:51.046 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.047 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.047 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604038 s, 174 MB/s 2024-09-15T23:19:51.054 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.055 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.055 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598293 s, 175 MB/s 2024-09-15T23:19:51.064 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.064 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.064 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729776 s, 144 MB/s 2024-09-15T23:19:51.071 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.072 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.072 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648044 s, 162 MB/s 2024-09-15T23:19:51.080 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.080 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.080 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663688 s, 158 MB/s 2024-09-15T23:19:51.091 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.091 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.091 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00887131 s, 118 MB/s 2024-09-15T23:19:51.099 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.099 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.099 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620361 s, 169 MB/s 2024-09-15T23:19:51.107 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.107 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.107 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620465 s, 169 MB/s 2024-09-15T23:19:51.114 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.115 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.115 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594633 s, 176 MB/s 2024-09-15T23:19:51.123 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.123 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.123 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664236 s, 158 MB/s 2024-09-15T23:19:51.131 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.131 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.131 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642344 s, 163 MB/s 2024-09-15T23:19:51.141 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.141 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.141 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0078796 s, 133 MB/s 2024-09-15T23:19:51.149 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.149 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.149 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653848 s, 160 MB/s 2024-09-15T23:19:51.158 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.158 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.158 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741126 s, 141 MB/s 2024-09-15T23:19:51.167 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.167 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.167 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071148 s, 147 MB/s 2024-09-15T23:19:51.175 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.175 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.175 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063546 s, 165 MB/s 2024-09-15T23:19:51.184 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.184 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.184 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708389 s, 148 MB/s 2024-09-15T23:19:51.192 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.192 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.192 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649194 s, 162 MB/s 2024-09-15T23:19:51.200 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.200 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.200 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679123 s, 154 MB/s 2024-09-15T23:19:51.208 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.208 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.208 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589822 s, 178 MB/s 2024-09-15T23:19:51.215 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.216 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.216 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563934 s, 186 MB/s 2024-09-15T23:19:51.224 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.224 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.224 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696881 s, 150 MB/s 2024-09-15T23:19:51.232 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.232 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.232 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605104 s, 173 MB/s 2024-09-15T23:19:51.241 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.241 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.241 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740871 s, 142 MB/s 2024-09-15T23:19:51.248 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.248 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.249 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0054978 s, 191 MB/s 2024-09-15T23:19:51.256 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.256 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.256 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572737 s, 183 MB/s 2024-09-15T23:19:51.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:51.263 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:51.263 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:51.263 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.17 2024-09-15T23:19:51.263 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:51.263 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:51.263 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:51.263 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:51.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:51.321 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.321 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.321 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594885 s, 176 MB/s 2024-09-15T23:19:51.328 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.328 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.328 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00552104 s, 190 MB/s 2024-09-15T23:19:51.337 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.337 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.337 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640628 s, 164 MB/s 2024-09-15T23:19:51.345 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.345 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.345 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695771 s, 151 MB/s 2024-09-15T23:19:51.354 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.354 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.354 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672869 s, 156 MB/s 2024-09-15T23:19:51.363 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.363 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.363 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762091 s, 138 MB/s 2024-09-15T23:19:51.371 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.371 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.371 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634696 s, 165 MB/s 2024-09-15T23:19:51.379 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.379 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.379 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637353 s, 165 MB/s 2024-09-15T23:19:51.388 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.388 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.388 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692516 s, 151 MB/s 2024-09-15T23:19:51.397 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.397 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.397 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683868 s, 153 MB/s 2024-09-15T23:19:51.406 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.406 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.406 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696156 s, 151 MB/s 2024-09-15T23:19:51.414 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.414 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.414 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642685 s, 163 MB/s 2024-09-15T23:19:51.421 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.421 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.422 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592425 s, 177 MB/s 2024-09-15T23:19:51.431 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.431 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.431 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741294 s, 141 MB/s 2024-09-15T23:19:51.439 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.439 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.439 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632084 s, 166 MB/s 2024-09-15T23:19:51.447 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.447 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.447 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580234 s, 181 MB/s 2024-09-15T23:19:51.454 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.454 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.454 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565706 s, 185 MB/s 2024-09-15T23:19:51.463 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.463 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.463 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728641 s, 144 MB/s 2024-09-15T23:19:51.471 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.471 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.471 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632882 s, 166 MB/s 2024-09-15T23:19:51.480 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.481 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.481 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00773251 s, 136 MB/s 2024-09-15T23:19:51.490 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.490 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.490 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737122 s, 142 MB/s 2024-09-15T23:19:51.498 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.498 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.498 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631494 s, 166 MB/s 2024-09-15T23:19:51.507 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.507 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.507 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721287 s, 145 MB/s 2024-09-15T23:19:51.516 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.516 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.516 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651357 s, 161 MB/s 2024-09-15T23:19:51.525 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.525 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.525 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741331 s, 141 MB/s 2024-09-15T23:19:51.535 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.535 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.535 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750814 s, 140 MB/s 2024-09-15T23:19:51.544 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.544 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.544 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642119 s, 163 MB/s 2024-09-15T23:19:51.554 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.554 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.554 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00820013 s, 128 MB/s 2024-09-15T23:19:51.562 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.562 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.562 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596213 s, 176 MB/s 2024-09-15T23:19:51.571 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.571 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.571 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630383 s, 166 MB/s 2024-09-15T23:19:51.580 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.580 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.580 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745404 s, 141 MB/s 2024-09-15T23:19:51.588 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.588 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.588 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625093 s, 168 MB/s 2024-09-15T23:19:51.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:51.598 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:51.598 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:51.598 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.18 2024-09-15T23:19:51.598 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:51.598 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:51.599 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:51.599 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:51.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:51.680 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.680 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.680 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676868 s, 155 MB/s 2024-09-15T23:19:51.689 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.689 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.689 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00797463 s, 131 MB/s 2024-09-15T23:19:51.698 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.698 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.698 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646546 s, 162 MB/s 2024-09-15T23:19:51.707 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.707 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.707 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779185 s, 135 MB/s 2024-09-15T23:19:51.716 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.716 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.716 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711341 s, 147 MB/s 2024-09-15T23:19:51.723 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.723 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.723 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619136 s, 169 MB/s 2024-09-15T23:19:51.732 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.732 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.733 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069751 s, 150 MB/s 2024-09-15T23:19:51.741 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.741 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.741 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709189 s, 148 MB/s 2024-09-15T23:19:51.749 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.750 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.750 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662191 s, 158 MB/s 2024-09-15T23:19:51.757 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.757 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.758 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630032 s, 166 MB/s 2024-09-15T23:19:51.765 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.765 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.765 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581279 s, 180 MB/s 2024-09-15T23:19:51.773 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.773 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.773 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063912 s, 164 MB/s 2024-09-15T23:19:51.782 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.782 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.782 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661566 s, 158 MB/s 2024-09-15T23:19:51.790 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.790 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.790 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648164 s, 162 MB/s 2024-09-15T23:19:51.798 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.799 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.799 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705796 s, 149 MB/s 2024-09-15T23:19:51.806 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.807 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.807 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623128 s, 168 MB/s 2024-09-15T23:19:51.815 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.815 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.815 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713855 s, 147 MB/s 2024-09-15T23:19:51.824 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.824 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.824 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651395 s, 161 MB/s 2024-09-15T23:19:51.832 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.832 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.832 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620378 s, 169 MB/s 2024-09-15T23:19:51.841 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.841 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.841 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683417 s, 153 MB/s 2024-09-15T23:19:51.850 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.850 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.850 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726459 s, 144 MB/s 2024-09-15T23:19:51.857 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.857 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.857 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595699 s, 176 MB/s 2024-09-15T23:19:51.865 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.866 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.866 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064742 s, 162 MB/s 2024-09-15T23:19:51.874 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.874 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.874 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065192 s, 161 MB/s 2024-09-15T23:19:51.881 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.881 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.881 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00562965 s, 186 MB/s 2024-09-15T23:19:51.890 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.890 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.890 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703872 s, 149 MB/s 2024-09-15T23:19:51.899 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.899 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.899 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748539 s, 140 MB/s 2024-09-15T23:19:51.907 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.907 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.908 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668106 s, 157 MB/s 2024-09-15T23:19:51.916 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.916 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.916 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691066 s, 152 MB/s 2024-09-15T23:19:51.925 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.925 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.925 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724073 s, 145 MB/s 2024-09-15T23:19:51.934 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.934 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.935 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733701 s, 143 MB/s 2024-09-15T23:19:51.943 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:51.943 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:51.943 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628954 s, 167 MB/s 2024-09-15T23:19:51.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:51.949 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:51.949 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:51.949 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.19 2024-09-15T23:19:51.950 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:51.950 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:51.950 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:51.950 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:51.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:52.008 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.008 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.008 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587822 s, 178 MB/s 2024-09-15T23:19:52.015 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.015 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.015 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571309 s, 184 MB/s 2024-09-15T23:19:52.024 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.024 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.024 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719588 s, 146 MB/s 2024-09-15T23:19:52.032 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.032 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.033 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639441 s, 164 MB/s 2024-09-15T23:19:52.041 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.041 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.041 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666303 s, 157 MB/s 2024-09-15T23:19:52.049 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.049 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.049 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627718 s, 167 MB/s 2024-09-15T23:19:52.057 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.057 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.057 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647417 s, 162 MB/s 2024-09-15T23:19:52.065 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.065 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.065 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665358 s, 158 MB/s 2024-09-15T23:19:52.073 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.073 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.073 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638048 s, 164 MB/s 2024-09-15T23:19:52.082 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.082 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.082 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725725 s, 144 MB/s 2024-09-15T23:19:52.090 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.090 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.090 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619664 s, 169 MB/s 2024-09-15T23:19:52.099 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.100 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.100 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706468 s, 148 MB/s 2024-09-15T23:19:52.108 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.108 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.108 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673316 s, 156 MB/s 2024-09-15T23:19:52.115 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.115 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.115 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00551393 s, 190 MB/s 2024-09-15T23:19:52.123 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.123 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.123 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643522 s, 163 MB/s 2024-09-15T23:19:52.131 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.131 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.131 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581445 s, 180 MB/s 2024-09-15T23:19:52.140 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.140 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.140 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771677 s, 136 MB/s 2024-09-15T23:19:52.148 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.149 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.149 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669263 s, 157 MB/s 2024-09-15T23:19:52.157 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.158 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.158 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725089 s, 145 MB/s 2024-09-15T23:19:52.166 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.167 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.167 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766935 s, 137 MB/s 2024-09-15T23:19:52.174 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.174 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.174 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568714 s, 184 MB/s 2024-09-15T23:19:52.183 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.183 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.183 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739616 s, 142 MB/s 2024-09-15T23:19:52.191 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.191 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.191 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596675 s, 176 MB/s 2024-09-15T23:19:52.200 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.200 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.200 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723984 s, 145 MB/s 2024-09-15T23:19:52.208 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.208 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.208 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584344 s, 179 MB/s 2024-09-15T23:19:52.217 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.217 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.217 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665701 s, 158 MB/s 2024-09-15T23:19:52.225 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.225 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.225 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705424 s, 149 MB/s 2024-09-15T23:19:52.233 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.233 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.234 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675487 s, 155 MB/s 2024-09-15T23:19:52.241 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.241 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.241 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621976 s, 169 MB/s 2024-09-15T23:19:52.249 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.249 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.249 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607752 s, 173 MB/s 2024-09-15T23:19:52.257 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.257 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.257 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626598 s, 167 MB/s 2024-09-15T23:19:52.265 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.266 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.266 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067001 s, 157 MB/s 2024-09-15T23:19:52.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:52.273 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:52.273 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:52.273 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.20 2024-09-15T23:19:52.273 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:52.273 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:52.273 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:52.273 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:52.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:52.335 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.335 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.335 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100712 s, 104 MB/s 2024-09-15T23:19:52.343 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.343 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.343 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593058 s, 177 MB/s 2024-09-15T23:19:52.352 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.352 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.352 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739883 s, 142 MB/s 2024-09-15T23:19:52.361 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.361 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.361 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711904 s, 147 MB/s 2024-09-15T23:19:52.371 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.371 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.371 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00775697 s, 135 MB/s 2024-09-15T23:19:52.379 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.379 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.379 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064309 s, 163 MB/s 2024-09-15T23:19:52.387 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.387 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.388 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661423 s, 159 MB/s 2024-09-15T23:19:52.395 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.395 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.395 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627252 s, 167 MB/s 2024-09-15T23:19:52.406 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.406 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.406 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00891119 s, 118 MB/s 2024-09-15T23:19:52.414 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.414 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.414 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575136 s, 182 MB/s 2024-09-15T23:19:52.423 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.423 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.423 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767907 s, 137 MB/s 2024-09-15T23:19:52.431 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.431 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.431 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659471 s, 159 MB/s 2024-09-15T23:19:52.439 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.439 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.439 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573561 s, 183 MB/s 2024-09-15T23:19:52.448 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.448 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.448 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738399 s, 142 MB/s 2024-09-15T23:19:52.458 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.458 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.458 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00830877 s, 126 MB/s 2024-09-15T23:19:52.467 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.467 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.468 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755458 s, 139 MB/s 2024-09-15T23:19:52.477 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.477 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.477 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761195 s, 138 MB/s 2024-09-15T23:19:52.485 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.486 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.486 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694073 s, 151 MB/s 2024-09-15T23:19:52.492 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.493 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.493 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00556735 s, 188 MB/s 2024-09-15T23:19:52.501 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.501 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.501 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564943 s, 186 MB/s 2024-09-15T23:19:52.508 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.509 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.509 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655453 s, 160 MB/s 2024-09-15T23:19:52.517 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.517 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.518 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073965 s, 142 MB/s 2024-09-15T23:19:52.526 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.526 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.526 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646545 s, 162 MB/s 2024-09-15T23:19:52.535 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.535 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.535 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709716 s, 148 MB/s 2024-09-15T23:19:52.544 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.544 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.545 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00825576 s, 127 MB/s 2024-09-15T23:19:52.554 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.554 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.554 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759329 s, 138 MB/s 2024-09-15T23:19:52.562 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.562 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.562 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059916 s, 175 MB/s 2024-09-15T23:19:52.571 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.571 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.571 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744947 s, 141 MB/s 2024-09-15T23:19:52.579 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.579 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.579 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059225 s, 177 MB/s 2024-09-15T23:19:52.587 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.587 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.587 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658156 s, 159 MB/s 2024-09-15T23:19:52.596 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.596 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.596 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726733 s, 144 MB/s 2024-09-15T23:19:52.605 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.605 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.605 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756608 s, 139 MB/s 2024-09-15T23:19:52.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:52.612 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:52.612 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:52.612 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.21 2024-09-15T23:19:52.612 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:52.612 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:52.612 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:52.612 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:52.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:52.672 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.672 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.672 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579341 s, 181 MB/s 2024-09-15T23:19:52.681 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.681 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.682 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732954 s, 143 MB/s 2024-09-15T23:19:52.689 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.689 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.689 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058762 s, 178 MB/s 2024-09-15T23:19:52.697 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.697 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.697 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661565 s, 158 MB/s 2024-09-15T23:19:52.705 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.706 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.706 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655735 s, 160 MB/s 2024-09-15T23:19:52.713 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.713 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.713 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.005671 s, 185 MB/s 2024-09-15T23:19:52.721 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.721 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.722 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652541 s, 161 MB/s 2024-09-15T23:19:52.730 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.730 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.731 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736371 s, 142 MB/s 2024-09-15T23:19:52.739 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.739 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.739 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691752 s, 152 MB/s 2024-09-15T23:19:52.747 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.747 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.747 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625776 s, 168 MB/s 2024-09-15T23:19:52.754 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.754 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.755 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00554408 s, 189 MB/s 2024-09-15T23:19:52.763 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.764 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.764 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707906 s, 148 MB/s 2024-09-15T23:19:52.772 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.772 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.772 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720898 s, 145 MB/s 2024-09-15T23:19:52.781 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.781 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.781 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702535 s, 149 MB/s 2024-09-15T23:19:52.790 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.791 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.791 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777975 s, 135 MB/s 2024-09-15T23:19:52.798 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.798 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.798 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587218 s, 179 MB/s 2024-09-15T23:19:52.807 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.808 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.808 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751139 s, 140 MB/s 2024-09-15T23:19:52.817 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.817 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.817 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753709 s, 139 MB/s 2024-09-15T23:19:52.829 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.829 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.829 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007744 s, 135 MB/s 2024-09-15T23:19:52.835 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.835 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.835 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734424 s, 143 MB/s 2024-09-15T23:19:52.843 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.844 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.844 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654174 s, 160 MB/s 2024-09-15T23:19:52.852 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.852 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.852 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669559 s, 157 MB/s 2024-09-15T23:19:52.861 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.861 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.861 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00775099 s, 135 MB/s 2024-09-15T23:19:52.870 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.870 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.870 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674551 s, 155 MB/s 2024-09-15T23:19:52.877 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.877 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.878 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596578 s, 176 MB/s 2024-09-15T23:19:52.885 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.886 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.886 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635212 s, 165 MB/s 2024-09-15T23:19:52.894 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.894 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.894 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067042 s, 156 MB/s 2024-09-15T23:19:52.901 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.902 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.902 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580939 s, 180 MB/s 2024-09-15T23:19:52.909 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.909 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.910 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581906 s, 180 MB/s 2024-09-15T23:19:52.918 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.918 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.918 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663959 s, 158 MB/s 2024-09-15T23:19:52.927 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.927 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.927 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760504 s, 138 MB/s 2024-09-15T23:19:52.935 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:52.936 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:52.936 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656961 s, 160 MB/s 2024-09-15T23:19:52.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:52.942 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:52.942 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:52.942 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.22 2024-09-15T23:19:52.942 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:52.942 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:52.942 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:52.943 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:52.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:53.001 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.001 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.001 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062632 s, 167 MB/s 2024-09-15T23:19:53.009 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.009 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.009 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062739 s, 167 MB/s 2024-09-15T23:19:53.017 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.017 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.017 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665489 s, 158 MB/s 2024-09-15T23:19:53.025 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.025 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.025 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627486 s, 167 MB/s 2024-09-15T23:19:53.033 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.033 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.033 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606711 s, 173 MB/s 2024-09-15T23:19:53.041 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.041 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.041 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687888 s, 152 MB/s 2024-09-15T23:19:53.049 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.049 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.049 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636303 s, 165 MB/s 2024-09-15T23:19:53.056 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.057 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.057 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581874 s, 180 MB/s 2024-09-15T23:19:53.065 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.065 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.065 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069241 s, 151 MB/s 2024-09-15T23:19:53.073 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.073 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.073 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618667 s, 169 MB/s 2024-09-15T23:19:53.082 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.082 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.082 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686667 s, 153 MB/s 2024-09-15T23:19:53.090 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.090 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.090 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656296 s, 160 MB/s 2024-09-15T23:19:53.098 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.099 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.099 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066184 s, 158 MB/s 2024-09-15T23:19:53.106 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.107 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.107 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637403 s, 165 MB/s 2024-09-15T23:19:53.115 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.115 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.115 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632168 s, 166 MB/s 2024-09-15T23:19:53.124 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.124 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.124 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752665 s, 139 MB/s 2024-09-15T23:19:53.133 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.133 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.133 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721146 s, 145 MB/s 2024-09-15T23:19:53.142 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.142 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.142 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723338 s, 145 MB/s 2024-09-15T23:19:53.151 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.151 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.151 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726407 s, 144 MB/s 2024-09-15T23:19:53.159 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.160 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.160 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652735 s, 161 MB/s 2024-09-15T23:19:53.168 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.168 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.168 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660443 s, 159 MB/s 2024-09-15T23:19:53.177 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.177 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.177 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750071 s, 140 MB/s 2024-09-15T23:19:53.186 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.186 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.186 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728245 s, 144 MB/s 2024-09-15T23:19:53.195 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.195 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.195 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720949 s, 145 MB/s 2024-09-15T23:19:53.204 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.204 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.204 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730596 s, 144 MB/s 2024-09-15T23:19:53.212 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.212 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.213 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637693 s, 164 MB/s 2024-09-15T23:19:53.220 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.221 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.221 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664013 s, 158 MB/s 2024-09-15T23:19:53.231 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.231 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.231 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00874683 s, 120 MB/s 2024-09-15T23:19:53.240 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.240 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.240 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723687 s, 145 MB/s 2024-09-15T23:19:53.248 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.248 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.248 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00554672 s, 189 MB/s 2024-09-15T23:19:53.257 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.257 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.257 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755891 s, 139 MB/s 2024-09-15T23:19:53.265 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.265 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.265 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629941 s, 166 MB/s 2024-09-15T23:19:53.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:53.272 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:53.272 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:53.272 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.23 2024-09-15T23:19:53.272 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:53.272 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:53.272 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:53.272 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:53.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:53.332 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.332 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.332 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068614 s, 153 MB/s 2024-09-15T23:19:53.339 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.339 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.339 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592208 s, 177 MB/s 2024-09-15T23:19:53.347 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.347 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.347 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579283 s, 181 MB/s 2024-09-15T23:19:53.355 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.355 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.355 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065595 s, 160 MB/s 2024-09-15T23:19:53.364 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.364 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.364 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730141 s, 144 MB/s 2024-09-15T23:19:53.373 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.373 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.373 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669917 s, 157 MB/s 2024-09-15T23:19:53.381 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.381 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.381 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658119 s, 159 MB/s 2024-09-15T23:19:53.389 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.389 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.389 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676976 s, 155 MB/s 2024-09-15T23:19:53.398 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.398 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.398 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667934 s, 157 MB/s 2024-09-15T23:19:53.408 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.408 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.408 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591955 s, 177 MB/s 2024-09-15T23:19:53.414 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.414 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.414 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646125 s, 162 MB/s 2024-09-15T23:19:53.421 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.422 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.422 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625984 s, 168 MB/s 2024-09-15T23:19:53.430 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.430 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.430 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657856 s, 159 MB/s 2024-09-15T23:19:53.437 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.437 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.437 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584249 s, 179 MB/s 2024-09-15T23:19:53.445 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.445 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.445 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569263 s, 184 MB/s 2024-09-15T23:19:53.454 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.454 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.454 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779071 s, 135 MB/s 2024-09-15T23:19:53.463 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.463 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.463 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672868 s, 156 MB/s 2024-09-15T23:19:53.471 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.471 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.471 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674501 s, 155 MB/s 2024-09-15T23:19:53.480 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.480 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.480 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663774 s, 158 MB/s 2024-09-15T23:19:53.489 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.489 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.489 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732104 s, 143 MB/s 2024-09-15T23:19:53.498 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.498 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.498 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724735 s, 145 MB/s 2024-09-15T23:19:53.506 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.506 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.506 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657703 s, 159 MB/s 2024-09-15T23:19:53.514 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.514 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.515 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651209 s, 161 MB/s 2024-09-15T23:19:53.522 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.522 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.522 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636729 s, 165 MB/s 2024-09-15T23:19:53.531 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.531 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.531 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681452 s, 154 MB/s 2024-09-15T23:19:53.539 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.539 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.539 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660821 s, 159 MB/s 2024-09-15T23:19:53.546 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.547 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.547 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576231 s, 182 MB/s 2024-09-15T23:19:53.554 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.554 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.554 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588613 s, 178 MB/s 2024-09-15T23:19:53.562 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.562 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.562 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580779 s, 181 MB/s 2024-09-15T23:19:53.570 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.570 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.570 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679318 s, 154 MB/s 2024-09-15T23:19:53.579 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.579 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.579 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679319 s, 154 MB/s 2024-09-15T23:19:53.586 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.586 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.586 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596402 s, 176 MB/s 2024-09-15T23:19:53.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:53.593 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:53.593 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:53.593 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.24 2024-09-15T23:19:53.593 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:53.593 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:53.593 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:53.593 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:53.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:53.652 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.652 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.652 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647407 s, 162 MB/s 2024-09-15T23:19:53.662 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.662 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.662 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00851887 s, 123 MB/s 2024-09-15T23:19:53.671 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.671 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.671 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686553 s, 153 MB/s 2024-09-15T23:19:53.679 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.679 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.679 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648373 s, 162 MB/s 2024-09-15T23:19:53.687 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.687 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.687 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063177 s, 166 MB/s 2024-09-15T23:19:53.696 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.696 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.696 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668492 s, 157 MB/s 2024-09-15T23:19:53.704 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.704 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.704 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664864 s, 158 MB/s 2024-09-15T23:19:53.713 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.714 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.714 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00808217 s, 130 MB/s 2024-09-15T23:19:53.722 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.723 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.723 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708265 s, 148 MB/s 2024-09-15T23:19:53.732 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.732 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.732 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732387 s, 143 MB/s 2024-09-15T23:19:53.740 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.740 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.740 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643034 s, 163 MB/s 2024-09-15T23:19:53.748 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.748 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.748 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627763 s, 167 MB/s 2024-09-15T23:19:53.759 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.759 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.759 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0088976 s, 118 MB/s 2024-09-15T23:19:53.768 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.768 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.768 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748357 s, 140 MB/s 2024-09-15T23:19:53.776 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.776 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.777 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666567 s, 157 MB/s 2024-09-15T23:19:53.785 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.785 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.785 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663385 s, 158 MB/s 2024-09-15T23:19:53.793 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.793 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.793 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643866 s, 163 MB/s 2024-09-15T23:19:53.801 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.801 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.801 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635357 s, 165 MB/s 2024-09-15T23:19:53.809 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.809 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.809 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646589 s, 162 MB/s 2024-09-15T23:19:53.817 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.817 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.817 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619557 s, 169 MB/s 2024-09-15T23:19:53.827 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.827 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.827 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076473 s, 137 MB/s 2024-09-15T23:19:53.835 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.835 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.835 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648265 s, 162 MB/s 2024-09-15T23:19:53.844 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.844 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.844 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007299 s, 144 MB/s 2024-09-15T23:19:53.852 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.852 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.853 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700003 s, 150 MB/s 2024-09-15T23:19:53.860 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.860 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.861 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00612669 s, 171 MB/s 2024-09-15T23:19:53.869 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.869 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.869 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638226 s, 164 MB/s 2024-09-15T23:19:53.878 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.879 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.879 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00810741 s, 129 MB/s 2024-09-15T23:19:53.887 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.887 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.887 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608908 s, 172 MB/s 2024-09-15T23:19:53.895 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.895 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.895 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639475 s, 164 MB/s 2024-09-15T23:19:53.904 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.905 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.905 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767629 s, 137 MB/s 2024-09-15T23:19:53.913 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.914 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.914 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720453 s, 146 MB/s 2024-09-15T23:19:53.922 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.922 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.922 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711334 s, 147 MB/s 2024-09-15T23:19:53.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:53.929 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:53.929 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:53.929 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.25 2024-09-15T23:19:53.929 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:53.929 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:53.929 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:53.929 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:53.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:53 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:53.988 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.988 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.989 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728707 s, 144 MB/s 2024-09-15T23:19:53.996 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:53.996 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:53.996 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605982 s, 173 MB/s 2024-09-15T23:19:54.005 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.006 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.006 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00760217 s, 138 MB/s 2024-09-15T23:19:54.015 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.015 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.015 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075101 s, 140 MB/s 2024-09-15T23:19:54.023 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.023 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.023 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643826 s, 163 MB/s 2024-09-15T23:19:54.031 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.031 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.031 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643207 s, 163 MB/s 2024-09-15T23:19:54.039 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.039 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.040 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677371 s, 155 MB/s 2024-09-15T23:19:54.048 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.048 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.048 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714479 s, 147 MB/s 2024-09-15T23:19:54.058 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.058 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.058 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758768 s, 138 MB/s 2024-09-15T23:19:54.066 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.066 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.066 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636423 s, 165 MB/s 2024-09-15T23:19:54.074 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.074 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.074 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651854 s, 161 MB/s 2024-09-15T23:19:54.082 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.082 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.082 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655143 s, 160 MB/s 2024-09-15T23:19:54.090 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.090 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.091 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637671 s, 164 MB/s 2024-09-15T23:19:54.099 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.099 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.099 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714017 s, 147 MB/s 2024-09-15T23:19:54.111 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.111 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.111 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00982617 s, 107 MB/s 2024-09-15T23:19:54.119 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.119 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.119 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063638 s, 165 MB/s 2024-09-15T23:19:54.128 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.128 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.129 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735524 s, 143 MB/s 2024-09-15T23:19:54.137 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.137 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.137 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723299 s, 145 MB/s 2024-09-15T23:19:54.146 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.146 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.146 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671313 s, 156 MB/s 2024-09-15T23:19:54.155 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.155 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.155 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747681 s, 140 MB/s 2024-09-15T23:19:54.164 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.164 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.164 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710375 s, 148 MB/s 2024-09-15T23:19:54.172 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.172 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.172 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644216 s, 163 MB/s 2024-09-15T23:19:54.180 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.180 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.180 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645576 s, 162 MB/s 2024-09-15T23:19:54.188 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.188 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.188 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606276 s, 173 MB/s 2024-09-15T23:19:54.196 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.196 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.196 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629182 s, 167 MB/s 2024-09-15T23:19:54.206 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.206 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.206 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00780361 s, 134 MB/s 2024-09-15T23:19:54.213 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.213 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.213 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566702 s, 185 MB/s 2024-09-15T23:19:54.221 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.221 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.221 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653995 s, 160 MB/s 2024-09-15T23:19:54.228 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.228 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.229 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578846 s, 181 MB/s 2024-09-15T23:19:54.237 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.237 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.237 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688023 s, 152 MB/s 2024-09-15T23:19:54.244 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.245 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.245 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575127 s, 182 MB/s 2024-09-15T23:19:54.252 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.252 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.252 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0056937 s, 184 MB/s 2024-09-15T23:19:54.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:54.259 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:54.259 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:54.259 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.26 2024-09-15T23:19:54.259 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:54.259 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:54.259 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:54.259 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:54.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:54.318 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.318 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.318 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648361 s, 162 MB/s 2024-09-15T23:19:54.327 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.327 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.327 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754824 s, 139 MB/s 2024-09-15T23:19:54.335 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.336 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.336 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670082 s, 156 MB/s 2024-09-15T23:19:54.344 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.344 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.344 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660461 s, 159 MB/s 2024-09-15T23:19:54.351 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.352 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.352 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057152 s, 183 MB/s 2024-09-15T23:19:54.359 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.359 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.359 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576098 s, 182 MB/s 2024-09-15T23:19:54.368 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.368 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.368 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664688 s, 158 MB/s 2024-09-15T23:19:54.375 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.375 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.375 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566622 s, 185 MB/s 2024-09-15T23:19:54.382 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.382 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.382 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566191 s, 185 MB/s 2024-09-15T23:19:54.391 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.391 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.391 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751549 s, 140 MB/s 2024-09-15T23:19:54.399 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.399 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.399 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061358 s, 171 MB/s 2024-09-15T23:19:54.407 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.408 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.408 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656366 s, 160 MB/s 2024-09-15T23:19:54.415 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.415 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.415 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566638 s, 185 MB/s 2024-09-15T23:19:54.422 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.422 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.422 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0056803 s, 185 MB/s 2024-09-15T23:19:54.431 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.432 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.432 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746265 s, 141 MB/s 2024-09-15T23:19:54.439 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.439 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.439 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580356 s, 181 MB/s 2024-09-15T23:19:54.447 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.447 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.447 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631358 s, 166 MB/s 2024-09-15T23:19:54.455 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.455 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.455 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629803 s, 166 MB/s 2024-09-15T23:19:54.463 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.463 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.463 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601497 s, 174 MB/s 2024-09-15T23:19:54.470 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.471 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.471 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592125 s, 177 MB/s 2024-09-15T23:19:54.479 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.479 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.479 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671985 s, 156 MB/s 2024-09-15T23:19:54.487 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.487 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.487 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641881 s, 163 MB/s 2024-09-15T23:19:54.496 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.496 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.496 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722716 s, 145 MB/s 2024-09-15T23:19:54.505 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.505 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.505 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705427 s, 149 MB/s 2024-09-15T23:19:54.513 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.513 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.513 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598979 s, 175 MB/s 2024-09-15T23:19:54.521 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.521 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.521 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640625 s, 164 MB/s 2024-09-15T23:19:54.529 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.529 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.529 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667282 s, 157 MB/s 2024-09-15T23:19:54.540 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.540 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.540 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00852911 s, 123 MB/s 2024-09-15T23:19:54.548 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.548 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.548 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676116 s, 155 MB/s 2024-09-15T23:19:54.556 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.557 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.557 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675888 s, 155 MB/s 2024-09-15T23:19:54.566 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.566 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.566 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772862 s, 136 MB/s 2024-09-15T23:19:54.574 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.574 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.574 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605391 s, 173 MB/s 2024-09-15T23:19:54.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:54.580 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:54.581 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:54.581 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.27 2024-09-15T23:19:54.581 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:54.581 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:54.581 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:54.581 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:54.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:54.639 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.640 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.640 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659438 s, 159 MB/s 2024-09-15T23:19:54.647 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.647 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.647 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585304 s, 179 MB/s 2024-09-15T23:19:54.655 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.655 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.655 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656503 s, 160 MB/s 2024-09-15T23:19:54.663 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.663 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.663 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658069 s, 159 MB/s 2024-09-15T23:19:54.671 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.671 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.671 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575558 s, 182 MB/s 2024-09-15T23:19:54.680 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.680 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.680 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732722 s, 143 MB/s 2024-09-15T23:19:54.689 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.689 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.689 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747291 s, 140 MB/s 2024-09-15T23:19:54.698 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.698 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.698 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750691 s, 140 MB/s 2024-09-15T23:19:54.706 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.706 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.707 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655139 s, 160 MB/s 2024-09-15T23:19:54.714 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.714 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.714 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00567374 s, 185 MB/s 2024-09-15T23:19:54.723 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.723 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.723 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740973 s, 142 MB/s 2024-09-15T23:19:54.732 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.732 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.732 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718861 s, 146 MB/s 2024-09-15T23:19:54.741 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.741 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.741 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072039 s, 146 MB/s 2024-09-15T23:19:54.751 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.751 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.751 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738783 s, 142 MB/s 2024-09-15T23:19:54.759 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.759 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.759 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648074 s, 162 MB/s 2024-09-15T23:19:54.768 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.768 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.768 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733993 s, 143 MB/s 2024-09-15T23:19:54.776 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.777 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.777 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690421 s, 152 MB/s 2024-09-15T23:19:54.784 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.784 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.784 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592811 s, 177 MB/s 2024-09-15T23:19:54.792 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.792 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.792 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583712 s, 180 MB/s 2024-09-15T23:19:54.800 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.800 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.800 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671109 s, 156 MB/s 2024-09-15T23:19:54.809 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.809 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.809 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727119 s, 144 MB/s 2024-09-15T23:19:54.817 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.817 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.817 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654308 s, 160 MB/s 2024-09-15T23:19:54.825 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.826 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.826 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651966 s, 161 MB/s 2024-09-15T23:19:54.833 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.834 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.834 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646488 s, 162 MB/s 2024-09-15T23:19:54.842 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.842 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.842 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683535 s, 153 MB/s 2024-09-15T23:19:54.851 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.851 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.851 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725222 s, 145 MB/s 2024-09-15T23:19:54.861 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.861 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.861 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00799874 s, 131 MB/s 2024-09-15T23:19:54.870 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.870 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.870 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762078 s, 138 MB/s 2024-09-15T23:19:54.880 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.880 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.880 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753113 s, 139 MB/s 2024-09-15T23:19:54.888 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.888 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.888 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059576 s, 176 MB/s 2024-09-15T23:19:54.896 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.896 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.896 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636439 s, 165 MB/s 2024-09-15T23:19:54.904 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.904 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.904 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057097 s, 184 MB/s 2024-09-15T23:19:54.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:54.911 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:54.911 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:54.911 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.28 2024-09-15T23:19:54.911 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:54.911 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:54.911 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:54.911 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:54.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:54.971 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.971 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.971 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734094 s, 143 MB/s 2024-09-15T23:19:54.980 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.980 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.980 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702504 s, 149 MB/s 2024-09-15T23:19:54.988 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.988 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.988 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598546 s, 175 MB/s 2024-09-15T23:19:54.997 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:54.997 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:54.997 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702904 s, 149 MB/s 2024-09-15T23:19:55.006 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.006 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.006 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643704 s, 163 MB/s 2024-09-15T23:19:55.014 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.014 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.014 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635356 s, 165 MB/s 2024-09-15T23:19:55.024 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.024 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.024 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754708 s, 139 MB/s 2024-09-15T23:19:55.033 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.033 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.033 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726288 s, 144 MB/s 2024-09-15T23:19:55.043 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.043 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.043 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759044 s, 138 MB/s 2024-09-15T23:19:55.051 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.051 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.051 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634824 s, 165 MB/s 2024-09-15T23:19:55.060 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.060 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.060 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672468 s, 156 MB/s 2024-09-15T23:19:55.070 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.070 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.070 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00775538 s, 135 MB/s 2024-09-15T23:19:55.079 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.079 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.079 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665728 s, 158 MB/s 2024-09-15T23:19:55.087 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.087 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.088 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712843 s, 147 MB/s 2024-09-15T23:19:55.096 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.096 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.097 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701029 s, 150 MB/s 2024-09-15T23:19:55.104 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.104 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.104 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585479 s, 179 MB/s 2024-09-15T23:19:55.112 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.113 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.113 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629725 s, 167 MB/s 2024-09-15T23:19:55.122 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.122 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.122 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767125 s, 137 MB/s 2024-09-15T23:19:55.131 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.131 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.131 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675206 s, 155 MB/s 2024-09-15T23:19:55.140 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.140 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.140 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676398 s, 155 MB/s 2024-09-15T23:19:55.148 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.149 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.149 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658131 s, 159 MB/s 2024-09-15T23:19:55.156 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.156 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.156 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00554282 s, 189 MB/s 2024-09-15T23:19:55.164 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.164 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.164 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576124 s, 182 MB/s 2024-09-15T23:19:55.172 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.172 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.172 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580002 s, 181 MB/s 2024-09-15T23:19:55.180 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.180 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.180 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576753 s, 182 MB/s 2024-09-15T23:19:55.189 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.189 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.189 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662744 s, 158 MB/s 2024-09-15T23:19:55.197 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.197 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.197 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643588 s, 163 MB/s 2024-09-15T23:19:55.206 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.206 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.206 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655017 s, 160 MB/s 2024-09-15T23:19:55.213 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.214 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.214 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578488 s, 181 MB/s 2024-09-15T23:19:55.222 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.222 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.222 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654208 s, 160 MB/s 2024-09-15T23:19:55.231 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.231 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.231 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670298 s, 156 MB/s 2024-09-15T23:19:55.240 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.240 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.241 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719903 s, 146 MB/s 2024-09-15T23:19:55.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:55.247 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:55.247 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:55.247 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.29 2024-09-15T23:19:55.247 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:55.247 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:55.247 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:55.248 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:55.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:55.307 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.307 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.307 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694946 s, 151 MB/s 2024-09-15T23:19:55.317 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.317 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.317 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759826 s, 138 MB/s 2024-09-15T23:19:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.326 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.326 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064993 s, 161 MB/s 2024-09-15T23:19:55.334 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.334 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.334 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063404 s, 165 MB/s 2024-09-15T23:19:55.343 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.343 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.343 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669378 s, 157 MB/s 2024-09-15T23:19:55.351 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.352 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.352 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070269 s, 149 MB/s 2024-09-15T23:19:55.360 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.360 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.360 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065296 s, 161 MB/s 2024-09-15T23:19:55.369 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.369 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.369 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652503 s, 161 MB/s 2024-09-15T23:19:55.378 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.378 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.378 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729865 s, 144 MB/s 2024-09-15T23:19:55.387 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.387 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.387 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669593 s, 157 MB/s 2024-09-15T23:19:55.396 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.397 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.397 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075584 s, 139 MB/s 2024-09-15T23:19:55.405 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.406 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.406 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696244 s, 151 MB/s 2024-09-15T23:19:55.414 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.414 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.415 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681139 s, 154 MB/s 2024-09-15T23:19:55.423 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.423 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.423 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630242 s, 166 MB/s 2024-09-15T23:19:55.432 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.432 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.432 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688546 s, 152 MB/s 2024-09-15T23:19:55.440 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.440 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.440 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569778 s, 184 MB/s 2024-09-15T23:19:55.448 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.448 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.449 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650071 s, 161 MB/s 2024-09-15T23:19:55.457 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.457 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.457 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649975 s, 161 MB/s 2024-09-15T23:19:55.466 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.466 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.466 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735816 s, 143 MB/s 2024-09-15T23:19:55.474 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.474 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.474 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585978 s, 179 MB/s 2024-09-15T23:19:55.485 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.485 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.485 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00846724 s, 124 MB/s 2024-09-15T23:19:55.493 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.493 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.493 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648113 s, 162 MB/s 2024-09-15T23:19:55.501 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.502 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.502 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636951 s, 165 MB/s 2024-09-15T23:19:55.509 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.509 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.509 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580836 s, 181 MB/s 2024-09-15T23:19:55.519 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.519 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.519 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767917 s, 137 MB/s 2024-09-15T23:19:55.527 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.528 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.528 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639511 s, 164 MB/s 2024-09-15T23:19:55.537 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.537 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.537 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074413 s, 141 MB/s 2024-09-15T23:19:55.545 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.545 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.545 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634236 s, 165 MB/s 2024-09-15T23:19:55.554 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.554 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.554 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639571 s, 164 MB/s 2024-09-15T23:19:55.561 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.562 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.562 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578287 s, 181 MB/s 2024-09-15T23:19:55.570 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.570 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.571 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675996 s, 155 MB/s 2024-09-15T23:19:55.579 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.579 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.579 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065362 s, 160 MB/s 2024-09-15T23:19:55.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:55.585 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:55.586 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:55.586 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.30 2024-09-15T23:19:55.586 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:55.586 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:55.586 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:55.586 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:55.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:55.646 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.646 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.646 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762565 s, 138 MB/s 2024-09-15T23:19:55.654 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.654 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.656 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594754 s, 176 MB/s 2024-09-15T23:19:55.663 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.663 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.663 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658655 s, 159 MB/s 2024-09-15T23:19:55.671 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.671 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.671 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606497 s, 173 MB/s 2024-09-15T23:19:55.680 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.680 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.680 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659664 s, 159 MB/s 2024-09-15T23:19:55.688 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.689 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.689 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672199 s, 156 MB/s 2024-09-15T23:19:55.698 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.698 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.698 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716001 s, 146 MB/s 2024-09-15T23:19:55.706 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.706 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.706 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631331 s, 166 MB/s 2024-09-15T23:19:55.715 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.715 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.715 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723558 s, 145 MB/s 2024-09-15T23:19:55.723 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.723 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.724 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626604 s, 167 MB/s 2024-09-15T23:19:55.732 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.732 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.732 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063393 s, 165 MB/s 2024-09-15T23:19:55.740 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.740 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.740 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648369 s, 162 MB/s 2024-09-15T23:19:55.749 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.750 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.750 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722466 s, 145 MB/s 2024-09-15T23:19:55.758 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.758 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.758 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063415 s, 165 MB/s 2024-09-15T23:19:55.766 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.766 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.766 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577537 s, 182 MB/s 2024-09-15T23:19:55.775 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.775 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.776 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00780418 s, 134 MB/s 2024-09-15T23:19:55.784 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.784 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.784 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645904 s, 162 MB/s 2024-09-15T23:19:55.793 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.793 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.793 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656725 s, 160 MB/s 2024-09-15T23:19:55.802 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.802 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.802 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762594 s, 138 MB/s 2024-09-15T23:19:55.811 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.811 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.811 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683739 s, 153 MB/s 2024-09-15T23:19:55.821 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.821 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.821 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00774666 s, 135 MB/s 2024-09-15T23:19:55.830 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.830 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.830 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686457 s, 153 MB/s 2024-09-15T23:19:55.838 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.838 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.838 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597887 s, 175 MB/s 2024-09-15T23:19:55.847 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.847 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.847 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746052 s, 141 MB/s 2024-09-15T23:19:55.855 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.855 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.855 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574 s, 183 MB/s 2024-09-15T23:19:55.863 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.864 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.864 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691124 s, 152 MB/s 2024-09-15T23:19:55.871 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.871 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.871 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059749 s, 175 MB/s 2024-09-15T23:19:55.880 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.880 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.880 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669982 s, 157 MB/s 2024-09-15T23:19:55.889 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.889 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.889 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754932 s, 139 MB/s 2024-09-15T23:19:55.898 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.899 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.899 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00773499 s, 136 MB/s 2024-09-15T23:19:55.907 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.907 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.907 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071608 s, 146 MB/s 2024-09-15T23:19:55.916 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.916 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.916 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649711 s, 161 MB/s 2024-09-15T23:19:55.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:55.922 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:19:55.922 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:19:55.922 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.31 2024-09-15T23:19:55.923 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:19:55.923 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:19:55.923 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:19:55.923 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:19:55.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:19:55.982 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.982 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.982 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712306 s, 147 MB/s 2024-09-15T23:19:55.990 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.990 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.990 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716187 s, 146 MB/s 2024-09-15T23:19:55.998 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:55.998 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:55.998 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638404 s, 164 MB/s 2024-09-15T23:19:56.007 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:56.007 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:56.007 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664492 s, 158 MB/s 2024-09-15T23:19:56.014 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:56.014 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:56.014 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573272 s, 183 MB/s 2024-09-15T23:19:56.022 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:56.022 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:56.022 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660132 s, 159 MB/s 2024-09-15T23:19:56.032 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:56.032 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:56.032 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00773553 s, 136 MB/s 2024-09-15T23:19:56.041 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:56.041 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:56.041 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685721 s, 153 MB/s 2024-09-15T23:19:56.048 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:56.049 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:56.049 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586855 s, 179 MB/s 2024-09-15T23:19:56.057 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:56.057 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:56.058 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007291 s, 144 MB/s 2024-09-15T23:19:56.067 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:56.067 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:56.067 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00774844 s, 135 MB/s 2024-09-15T23:19:56.075 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:56.075 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:56.075 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590589 s, 178 MB/s 2024-09-15T23:19:56.083 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:56.083 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:56.083 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708603 s, 148 MB/s 2024-09-15T23:19:56.092 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:56.092 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:56.093 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728508 s, 144 MB/s 2024-09-15T23:19:56.101 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:56.101 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:56.101 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725195 s, 145 MB/s 2024-09-15T23:19:56.111 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:56.111 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:56.111 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00821141 s, 128 MB/s 2024-09-15T23:19:56.119 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:56.120 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:56.120 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655094 s, 160 MB/s 2024-09-15T23:19:56.127 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:56.127 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:56.127 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593885 s, 177 MB/s 2024-09-15T23:19:56.136 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:56.136 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:56.136 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683136 s, 153 MB/s 2024-09-15T23:19:56.143 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:56.143 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:56.143 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564455 s, 186 MB/s 2024-09-15T23:19:56.153 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:56.153 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:56.154 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0081595 s, 129 MB/s 2024-09-15T23:19:56.162 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:56.162 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:56.162 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687182 s, 153 MB/s 2024-09-15T23:19:56.170 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:56.170 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:56.170 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640723 s, 164 MB/s 2024-09-15T23:19:56.178 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:56.178 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:56.178 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645128 s, 163 MB/s 2024-09-15T23:19:56.187 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:56.187 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:56.187 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075115 s, 140 MB/s 2024-09-15T23:19:56.195 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:56.196 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:56.196 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650053 s, 161 MB/s 2024-09-15T23:19:56.203 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:56.203 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:56.204 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629481 s, 167 MB/s 2024-09-15T23:19:56.211 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:56.211 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:56.211 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578467 s, 181 MB/s 2024-09-15T23:19:56.219 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:56.219 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:56.219 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650798 s, 161 MB/s 2024-09-15T23:19:56.228 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:56.228 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:56.228 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672343 s, 156 MB/s 2024-09-15T23:19:56.237 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:56.237 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:56.237 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740286 s, 142 MB/s 2024-09-15T23:19:56.247 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:19:56.247 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:19:56.248 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0079475 s, 132 MB/s 2024-09-15T23:19:56.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:19:56.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:19:56.254 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub start /scrub_control_test_path recursive 2024-09-15T23:19:56.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.356+0000 7f3798386640 1 Processor -- start 2024-09-15T23:19:56.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.356+0000 7f3798386640 1 -- start start 2024-09-15T23:19:56.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.357+0000 7f3798386640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3790155b20 0x7f37900b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.357+0000 7f3798386640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f37900cfb30 0x7f379015c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.357+0000 7f3798386640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37900b0680 con 0x7f37900b21a0 2024-09-15T23:19:56.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.357+0000 7f3798386640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f37900b2600 con 0x7f37900cfb30 2024-09-15T23:19:56.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.357+0000 7f3798386640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f37900b01e0 con 0x7f3790155b20 2024-09-15T23:19:56.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.357+0000 7f3796923640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f37900cfb30 0x7f379015c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.357+0000 7f3795921640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f37900b21a0 0x7f37900cf420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:50820/0 (socket says 172.21.15.123:50820) 2024-09-15T23:19:56.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.357+0000 7f3795921640 1 -- 172.21.15.123:0/2381576073 learned_addr learned my addr 172.21.15.123:0/2381576073 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:19:56.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.357+0000 7f3796122640 1 --2- 172.21.15.123:0/2381576073 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3790155b20 0x7f37900b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.357+0000 7f3796923640 1 -- 172.21.15.123:0/2381576073 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3790155b20 msgr2=0x7f37900b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:56.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.357+0000 7f3796923640 1 --2- 172.21.15.123:0/2381576073 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3790155b20 0x7f37900b1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.357+0000 7f3796923640 1 -- 172.21.15.123:0/2381576073 >> v1:172.21.15.123:6789/0 conn(0x7f37900b21a0 legacy=0x7f37900cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:56.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.357+0000 7f3795120640 1 -- 172.21.15.123:0/2381576073 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 373490545 0 0) 0x7f37900b0680 con 0x7f37900b21a0 2024-09-15T23:19:56.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.357+0000 7f3796923640 1 -- 172.21.15.123:0/2381576073 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37900ccf70 con 0x7f37900cfb30 2024-09-15T23:19:56.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.357+0000 7f3796122640 1 --2- 172.21.15.123:0/2381576073 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3790155b20 0x7f37900b1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:19:56.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.358+0000 7f3796923640 1 --2- 172.21.15.123:0/2381576073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37900cfb30 0x7f379015c3b0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f378c009d90 tx=0x7f378c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc7af1c16543fd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:56.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.358+0000 7f3795120640 1 -- 172.21.15.123:0/2381576073 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f378c007740 con 0x7f37900cfb30 2024-09-15T23:19:56.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.358+0000 7f3795120640 1 -- 172.21.15.123:0/2381576073 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f378c0078e0 con 0x7f37900cfb30 2024-09-15T23:19:56.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.358+0000 7f3795120640 1 -- 172.21.15.123:0/2381576073 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f378c007cb0 con 0x7f37900cfb30 2024-09-15T23:19:56.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.359+0000 7f3798386640 1 -- 172.21.15.123:0/2381576073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37900cfb30 msgr2=0x7f379015c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:56.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.359+0000 7f3798386640 1 --2- 172.21.15.123:0/2381576073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37900cfb30 0x7f379015c3b0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f378c009d90 tx=0x7f378c02a660 comp rx=0 tx=0).stop 2024-09-15T23:19:56.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.359+0000 7f3798386640 1 -- 172.21.15.123:0/2381576073 shutdown_connections 2024-09-15T23:19:56.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.359+0000 7f3798386640 1 --2- 172.21.15.123:0/2381576073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37900cfb30 0x7f379015c3b0 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.359+0000 7f3798386640 1 --2- 172.21.15.123:0/2381576073 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3790155b20 0x7f37900b1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.359+0000 7f3798386640 1 -- 172.21.15.123:0/2381576073 >> 172.21.15.123:0/2381576073 conn(0x7f379006c240 msgr2=0x7f379006d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:56.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.359+0000 7f3798386640 1 -- 172.21.15.123:0/2381576073 shutdown_connections 2024-09-15T23:19:56.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.359+0000 7f3798386640 1 -- 172.21.15.123:0/2381576073 wait complete. 2024-09-15T23:19:56.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.360+0000 7f3798386640 1 Processor -- start 2024-09-15T23:19:56.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.360+0000 7f3798386640 1 -- start start 2024-09-15T23:19:56.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.361+0000 7f3798386640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37900b21a0 0x7f379015b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.361+0000 7f3798386640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f37900cfb30 0x7f3790156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.361+0000 7f3798386640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3790155b20 0x7f3790141e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.361+0000 7f3798386640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f37900cef00 con 0x7f37900b21a0 2024-09-15T23:19:56.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.361+0000 7f3798386640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f37900cec20 con 0x7f37900cfb30 2024-09-15T23:19:56.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.361+0000 7f3798386640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f37900ce610 con 0x7f3790155b20 2024-09-15T23:19:56.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.361+0000 7f3796122640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37900b21a0 0x7f379015b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.361+0000 7f3796122640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37900b21a0 0x7f379015b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57006/0 (socket says 172.21.15.123:57006) 2024-09-15T23:19:56.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.361+0000 7f3796122640 1 -- 172.21.15.123:0/987705751 learned_addr learned my addr 172.21.15.123:0/987705751 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:56.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.361+0000 7f3796122640 1 -- 172.21.15.123:0/987705751 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3790155b20 msgr2=0x7f3790141e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:56.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.361+0000 7f3796122640 1 --2- 172.21.15.123:0/987705751 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3790155b20 0x7f3790141e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.361+0000 7f3796122640 1 -- 172.21.15.123:0/987705751 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f37900cfb30 msgr2=0x7f3790156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:56.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.361+0000 7f3795921640 1 --2- 172.21.15.123:0/987705751 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f37900cfb30 0x7f3790156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.361+0000 7f3796122640 1 --2- 172.21.15.123:0/987705751 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f37900cfb30 0x7f3790156170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.361+0000 7f3796122640 1 -- 172.21.15.123:0/987705751 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f379015bc30 con 0x7f37900b21a0 2024-09-15T23:19:56.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.361+0000 7f3796122640 1 --2- 172.21.15.123:0/987705751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37900b21a0 0x7f379015b5a0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f378800d7d0 tx=0x7f378800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:56.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.361+0000 7f3786ffd640 1 -- 172.21.15.123:0/987705751 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3788004030 con 0x7f37900b21a0 2024-09-15T23:19:56.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.361+0000 7f3786ffd640 1 -- 172.21.15.123:0/987705751 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37880041d0 con 0x7f37900b21a0 2024-09-15T23:19:56.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.361+0000 7f3786ffd640 1 -- 172.21.15.123:0/987705751 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f378800b6c0 con 0x7f37900b21a0 2024-09-15T23:19:56.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.361+0000 7f3798386640 1 -- 172.21.15.123:0/987705751 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f379015bf10 con 0x7f37900b21a0 2024-09-15T23:19:56.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.362+0000 7f3798386640 1 -- 172.21.15.123:0/987705751 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f379015c4d0 con 0x7f37900b21a0 2024-09-15T23:19:56.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.363+0000 7f3786ffd640 1 -- 172.21.15.123:0/987705751 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f378800b860 con 0x7f37900b21a0 2024-09-15T23:19:56.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.363+0000 7f3786ffd640 1 --2- 172.21.15.123:0/987705751 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f377406c2b0 0x7f377406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.364+0000 7f3786ffd640 1 -- 172.21.15.123:0/987705751 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f378808b740 con 0x7f37900b21a0 2024-09-15T23:19:56.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.364+0000 7f3795921640 1 --2- 172.21.15.123:0/987705751 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f377406c2b0 0x7f377406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.364+0000 7f3795921640 1 --2- 172.21.15.123:0/987705751 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f377406c2b0 0x7f377406e770 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f3780007fd0 tx=0x7f3780009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:56.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.365+0000 7f379b1f8740 1 Processor -- start 2024-09-15T23:19:56.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.365+0000 7f379b1f8740 1 -- start start 2024-09-15T23:19:56.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.365+0000 7f379b1f8740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5628786dba70 0x5628786dbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.365+0000 7f379b1f8740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5628786c21f0 0x5628786c0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.365+0000 7f379b1f8740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56287870c420 0x56287870c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.365+0000 7f379b1f8740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x562878629bc0 con 0x5628786c21f0 2024-09-15T23:19:56.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.365+0000 7f379b1f8740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5628785d1970 con 0x5628786dba70 2024-09-15T23:19:56.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.365+0000 7f379b1f8740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x562878625b80 con 0x56287870c420 2024-09-15T23:19:56.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.366+0000 7f3795921640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5628786c21f0 0x5628786c0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.366+0000 7f3795921640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5628786c21f0 0x5628786c0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57016/0 (socket says 172.21.15.123:57016) 2024-09-15T23:19:56.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.366+0000 7f3796122640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5628786dba70 0x5628786dbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.366+0000 7f3795921640 1 -- 172.21.15.123:0/2541226561 learned_addr learned my addr 172.21.15.123:0/2541226561 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:56.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.366+0000 7f3796923640 1 --2- 172.21.15.123:0/2541226561 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56287870c420 0x56287870c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.366+0000 7f3795921640 1 -- 172.21.15.123:0/2541226561 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56287870c420 msgr2=0x56287870c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:56.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.366+0000 7f3795921640 1 --2- 172.21.15.123:0/2541226561 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56287870c420 0x56287870c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.366+0000 7f3795921640 1 -- 172.21.15.123:0/2541226561 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5628786dba70 msgr2=0x5628786dbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:56.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.366+0000 7f3795921640 1 --2- 172.21.15.123:0/2541226561 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5628786dba70 0x5628786dbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.366+0000 7f3795921640 1 -- 172.21.15.123:0/2541226561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562878408ba0 con 0x5628786c21f0 2024-09-15T23:19:56.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.366+0000 7f3795921640 1 --2- 172.21.15.123:0/2541226561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5628786c21f0 0x5628786c0a50 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f3780007490 tx=0x7f3780010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f57f613725b7ab7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:56.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.366+0000 7f3773fff640 1 -- 172.21.15.123:0/2541226561 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f378000dc70 con 0x5628786c21f0 2024-09-15T23:19:56.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.366+0000 7f3773fff640 1 -- 172.21.15.123:0/2541226561 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f378000de10 con 0x5628786c21f0 2024-09-15T23:19:56.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.366+0000 7f3773fff640 1 -- 172.21.15.123:0/2541226561 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3780020690 con 0x5628786c21f0 2024-09-15T23:19:56.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.367+0000 7f379b1f8740 1 -- 172.21.15.123:0/2541226561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5628786c21f0 msgr2=0x5628786c0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:56.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.367+0000 7f379b1f8740 1 --2- 172.21.15.123:0/2541226561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5628786c21f0 0x5628786c0a50 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f3780007490 tx=0x7f3780010000 comp rx=0 tx=0).stop 2024-09-15T23:19:56.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.367+0000 7f379b1f8740 1 -- 172.21.15.123:0/2541226561 shutdown_connections 2024-09-15T23:19:56.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.367+0000 7f379b1f8740 1 --2- 172.21.15.123:0/2541226561 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56287870c420 0x56287870c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.367+0000 7f379b1f8740 1 --2- 172.21.15.123:0/2541226561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5628786c21f0 0x5628786c0a50 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.367+0000 7f379b1f8740 1 --2- 172.21.15.123:0/2541226561 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5628786dba70 0x5628786dbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.367+0000 7f379b1f8740 1 -- 172.21.15.123:0/2541226561 >> 172.21.15.123:0/2541226561 conn(0x5628786c2c20 msgr2=0x56287870afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:56.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.367+0000 7f379b1f8740 1 -- 172.21.15.123:0/2541226561 shutdown_connections 2024-09-15T23:19:56.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.367+0000 7f379b1f8740 1 -- 172.21.15.123:0/2541226561 wait complete. 2024-09-15T23:19:56.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.368+0000 7f379b1f8740 1 -- start start 2024-09-15T23:19:56.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.368+0000 7f379b1f8740 1 Processor -- start 2024-09-15T23:19:56.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.369+0000 7f379b1f8740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5628786dba70 0x5628786dade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.369+0000 7f379b1f8740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56287870c420 0x56287871c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.369+0000 7f379b1f8740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56287871e160 0x56287871c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.369+0000 7f379b1f8740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5628786c1150 con 0x56287870c420 2024-09-15T23:19:56.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.369+0000 7f379b1f8740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5628785e4d70 con 0x5628786dba70 2024-09-15T23:19:56.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.369+0000 7f379b1f8740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5628786c1430 con 0x56287871e160 2024-09-15T23:19:56.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.369+0000 7f379b1f8740 10 client.0 _ll_register_callbacks cb 0x56287833bf80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:19:56.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.369+0000 7f3795921640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56287870c420 0x56287871c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.369+0000 7f3795921640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56287870c420 0x56287871c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57032/0 (socket says 172.21.15.123:57032) 2024-09-15T23:19:56.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.369+0000 7f3795921640 1 -- 172.21.15.123:0/275232875 learned_addr learned my addr 172.21.15.123:0/275232875 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:56.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.369+0000 7f3796122640 1 --2- 172.21.15.123:0/275232875 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5628786dba70 0x5628786dade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.369+0000 7f3796923640 1 --2- 172.21.15.123:0/275232875 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56287871e160 0x56287871c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.369+0000 7f3795921640 1 -- 172.21.15.123:0/275232875 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56287871e160 msgr2=0x56287871c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:56.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.369+0000 7f3795921640 1 --2- 172.21.15.123:0/275232875 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56287871e160 0x56287871c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.369+0000 7f3795921640 1 -- 172.21.15.123:0/275232875 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5628786dba70 msgr2=0x5628786dade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:56.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.369+0000 7f3795921640 1 --2- 172.21.15.123:0/275232875 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5628786dba70 0x5628786dade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.369+0000 7f3795921640 1 -- 172.21.15.123:0/275232875 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628782fc490 con 0x56287870c420 2024-09-15T23:19:56.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.369+0000 7f3795921640 1 --2- 172.21.15.123:0/275232875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56287870c420 0x56287871c320 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f3780000c00 tx=0x7f3780012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc34c2e807007104 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:56.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.369+0000 7f37717fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:19:56.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.369+0000 7f37717fa640 1 -- 172.21.15.123:0/275232875 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3780007640 con 0x56287870c420 2024-09-15T23:19:56.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.369+0000 7f37717fa640 1 -- 172.21.15.123:0/275232875 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f3780020660 con 0x56287870c420 2024-09-15T23:19:56.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.369+0000 7f379b1f8740 1 -- 172.21.15.123:0/275232875 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f378000de10 con 0x56287870c420 2024-09-15T23:19:56.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.369+0000 7f37717fa640 1 -- 172.21.15.123:0/275232875 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f3780034050 con 0x56287870c420 2024-09-15T23:19:56.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.369+0000 7f379b1f8740 10 client.8625 fetch_fsmap learned FSMap version 86 2024-09-15T23:19:56.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.369+0000 7f379b1f8740 1 -- 172.21.15.123:0/275232875 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) -- 0x562878469330 con 0x56287870c420 2024-09-15T23:19:56.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.370+0000 7f37717fa640 1 -- 172.21.15.123:0/275232875 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f378000de10 con 0x56287870c420 2024-09-15T23:19:56.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.370+0000 7f37717fa640 1 -- 172.21.15.123:0/275232875 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 86) ==== 3502+0+0 (secure 0 0 0) 0x7f3780037020 con 0x56287870c420 2024-09-15T23:19:56.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.370+0000 7f379b1f8740 10 client.8625 fetch_fsmap finished waiting for FSMap version 86 2024-09-15T23:19:56.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.370+0000 7f379b1f8740 10 client.8625 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.d 2024-09-15T23:19:56.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.370+0000 7f379b1f8740 20 client.8625 populate_metadata read hostname 'smithi123' 2024-09-15T23:19:56.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.370+0000 7f379b1f8740 1 --2- 172.21.15.123:0/275232875 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x5628786c04f0 0x5628786e2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.370+0000 7f379b1f8740 4 client.8625 mds_command: new command op to 8439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:19:56.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.370+0000 7f379b1f8740 1 -- 172.21.15.123:0/275232875 --> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628785aec80 con 0x5628786c04f0 2024-09-15T23:19:56.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.370+0000 7f3796122640 1 --2- 172.21.15.123:0/275232875 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x5628786c04f0 0x5628786e2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.370+0000 7f3796122640 1 --2- 172.21.15.123:0/275232875 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x5628786c04f0 0x5628786e2e20 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d8d93ba1d869a62 server_cookie=7173cd470d866824 in_seq=0 out_seq=0 2024-09-15T23:19:56.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.370+0000 7f37717fa640 10 client.8625 ms_handle_connect on v2:172.21.15.188:6835/1222656979 2024-09-15T23:19:56.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.371+0000 7f37717fa640 1 -- 172.21.15.123:0/275232875 <== mds.0 v2:172.21.15.188:6835/1222656979 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5628785aec80 con 0x5628786c04f0 2024-09-15T23:19:56.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.371+0000 7f37717fa640 10 client.8625 handle_command_reply: tid=0 2024-09-15T23:19:56.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.371+0000 7f379b1f8740 1 client.8625 shutdown 2024-09-15T23:19:56.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.371+0000 7f379b1f8740 1 -- 172.21.15.123:0/275232875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56287870c420 msgr2=0x56287871c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:56.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.371+0000 7f379b1f8740 1 --2- 172.21.15.123:0/275232875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56287870c420 0x56287871c320 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f3780000c00 tx=0x7f3780012000 comp rx=0 tx=0).stop 2024-09-15T23:19:56.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.371+0000 7f379b1f8740 1 -- 172.21.15.123:0/275232875 shutdown_connections 2024-09-15T23:19:56.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.371+0000 7f379b1f8740 1 --2- 172.21.15.123:0/275232875 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x5628786c04f0 0x5628786e2e20 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.371+0000 7f379b1f8740 1 --2- 172.21.15.123:0/275232875 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56287871e160 0x56287871c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.371+0000 7f379b1f8740 1 --2- 172.21.15.123:0/275232875 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56287870c420 0x56287871c320 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.371+0000 7f37717fa640 0 client.8625 ms_handle_reset on v2:172.21.15.188:6835/1222656979 2024-09-15T23:19:56.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.371+0000 7f379b1f8740 1 --2- 172.21.15.123:0/275232875 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5628786dba70 0x5628786dade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.371+0000 7f379b1f8740 1 -- 172.21.15.123:0/275232875 >> 172.21.15.123:0/275232875 conn(0x5628786c21f0 msgr2=0x562878709240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:56.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.371+0000 7f379b1f8740 1 -- 172.21.15.123:0/275232875 shutdown_connections 2024-09-15T23:19:56.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.371+0000 7f379b1f8740 1 -- 172.21.15.123:0/275232875 wait complete. 2024-09-15T23:19:56.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.371+0000 7f379b1f8740 20 client.8625 trim_cache size 0 max 16384 2024-09-15T23:19:56.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.388+0000 7f379b1f8740 1 Processor -- start 2024-09-15T23:19:56.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.389+0000 7f379b1f8740 1 -- start start 2024-09-15T23:19:56.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.389+0000 7f379b1f8740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5628786dba70 0x5628786f1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.389+0000 7f379b1f8740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56287870c420 0x562878701200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.389+0000 7f379b1f8740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56287871e160 0x562878701740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.389+0000 7f379b1f8740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f37901fc5f0 con 0x5628786dba70 2024-09-15T23:19:56.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.389+0000 7f379b1f8740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f37901fb5f0 con 0x56287871e160 2024-09-15T23:19:56.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.389+0000 7f379b1f8740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f37901fa950 con 0x56287870c420 2024-09-15T23:19:56.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.389+0000 7f3796122640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5628786dba70 0x5628786f1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.389+0000 7f3796122640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5628786dba70 0x5628786f1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57042/0 (socket says 172.21.15.123:57042) 2024-09-15T23:19:56.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.389+0000 7f3796122640 1 -- 172.21.15.123:0/891235137 learned_addr learned my addr 172.21.15.123:0/891235137 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:56.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.390+0000 7f3796122640 1 -- 172.21.15.123:0/891235137 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56287870c420 msgr2=0x562878701200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:56.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.390+0000 7f3796122640 1 --2- 172.21.15.123:0/891235137 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56287870c420 0x562878701200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.390+0000 7f3796122640 1 -- 172.21.15.123:0/891235137 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56287871e160 msgr2=0x562878701740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:56.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.390+0000 7f3796122640 1 --2- 172.21.15.123:0/891235137 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56287871e160 0x562878701740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.390+0000 7f3796122640 1 -- 172.21.15.123:0/891235137 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628782d5550 con 0x5628786dba70 2024-09-15T23:19:56.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.390+0000 7f3796122640 1 --2- 172.21.15.123:0/891235137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5628786dba70 0x5628786f1520 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f3788059740 tx=0x7f3788055b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d1c671c9331bb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:56.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.390+0000 7f37737fe640 1 -- 172.21.15.123:0/891235137 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37880597b0 con 0x5628786dba70 2024-09-15T23:19:56.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.390+0000 7f37737fe640 1 -- 172.21.15.123:0/891235137 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f378805db60 con 0x5628786dba70 2024-09-15T23:19:56.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.390+0000 7f37737fe640 1 -- 172.21.15.123:0/891235137 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3788062390 con 0x5628786dba70 2024-09-15T23:19:56.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.390+0000 7f379b1f8740 1 -- 172.21.15.123:0/891235137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5628786dba70 msgr2=0x5628786f1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:56.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.390+0000 7f379b1f8740 1 --2- 172.21.15.123:0/891235137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5628786dba70 0x5628786f1520 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f3788059740 tx=0x7f3788055b80 comp rx=0 tx=0).stop 2024-09-15T23:19:56.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.390+0000 7f379b1f8740 1 -- 172.21.15.123:0/891235137 shutdown_connections 2024-09-15T23:19:56.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.390+0000 7f379b1f8740 1 --2- 172.21.15.123:0/891235137 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56287871e160 0x562878701740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.390+0000 7f379b1f8740 1 --2- 172.21.15.123:0/891235137 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56287870c420 0x562878701200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.390+0000 7f379b1f8740 1 --2- 172.21.15.123:0/891235137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5628786dba70 0x5628786f1520 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.390+0000 7f379b1f8740 1 -- 172.21.15.123:0/891235137 >> 172.21.15.123:0/891235137 conn(0x5628786c21f0 msgr2=0x562878709ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:56.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.390+0000 7f379b1f8740 1 -- 172.21.15.123:0/891235137 shutdown_connections 2024-09-15T23:19:56.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.390+0000 7f379b1f8740 1 -- 172.21.15.123:0/891235137 wait complete. 2024-09-15T23:19:56.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.391+0000 7f379b1f8740 1 -- start start 2024-09-15T23:19:56.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.391+0000 7f379b1f8740 1 Processor -- start 2024-09-15T23:19:56.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.392+0000 7f379b1f8740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5628786dba70 0x5628786d5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.392+0000 7f379b1f8740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56287870c420 0x56287870cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.392+0000 7f379b1f8740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56287871e160 0x56287870d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.392+0000 7f379b1f8740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5628786db0a0 con 0x5628786dba70 2024-09-15T23:19:56.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.392+0000 7f379b1f8740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f37901fafa0 con 0x56287870c420 2024-09-15T23:19:56.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.392+0000 7f379b1f8740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5628785aec80 con 0x56287871e160 2024-09-15T23:19:56.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.392+0000 7f379b1f8740 10 client.0 _ll_register_callbacks cb 0x7f3788055a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:19:56.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.392+0000 7f3796122640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5628786dba70 0x5628786d5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.392+0000 7f3796122640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5628786dba70 0x5628786d5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57050/0 (socket says 172.21.15.123:57050) 2024-09-15T23:19:56.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.392+0000 7f3796122640 1 -- 172.21.15.123:0/2932184566 learned_addr learned my addr 172.21.15.123:0/2932184566 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:56.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.392+0000 7f3796122640 1 -- 172.21.15.123:0/2932184566 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56287871e160 msgr2=0x56287870d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:56.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.392+0000 7f3796122640 1 --2- 172.21.15.123:0/2932184566 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56287871e160 0x56287870d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.392+0000 7f3796122640 1 -- 172.21.15.123:0/2932184566 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56287870c420 msgr2=0x56287870cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:56.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.392+0000 7f3796122640 1 --2- 172.21.15.123:0/2932184566 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56287870c420 0x56287870cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.392+0000 7f3796122640 1 -- 172.21.15.123:0/2932184566 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56287872f1c0 con 0x5628786dba70 2024-09-15T23:19:56.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.392+0000 7f3796122640 1 --2- 172.21.15.123:0/2932184566 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5628786dba70 0x5628786d5420 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f378800b4b0 tx=0x7f378805c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd7908d2348a421 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:56.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.392+0000 7f37717fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:19:56.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.392+0000 7f37717fa640 1 -- 172.21.15.123:0/2932184566 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37880597b0 con 0x5628786dba70 2024-09-15T23:19:56.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.393+0000 7f37717fa640 1 -- 172.21.15.123:0/2932184566 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f3788055e20 con 0x5628786dba70 2024-09-15T23:19:56.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.393+0000 7f379b1f8740 1 -- 172.21.15.123:0/2932184566 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f378805db60 con 0x5628786dba70 2024-09-15T23:19:56.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.393+0000 7f37717fa640 1 -- 172.21.15.123:0/2932184566 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f3788078b50 con 0x5628786dba70 2024-09-15T23:19:56.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.393+0000 7f379b1f8740 10 client.8631 fetch_fsmap learned FSMap version 86 2024-09-15T23:19:56.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.393+0000 7f379b1f8740 1 -- 172.21.15.123:0/2932184566 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) -- 0x5628786d5960 con 0x5628786dba70 2024-09-15T23:19:56.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.393+0000 7f37717fa640 1 -- 172.21.15.123:0/2932184566 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f378805db60 con 0x5628786dba70 2024-09-15T23:19:56.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.393+0000 7f37717fa640 1 -- 172.21.15.123:0/2932184566 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 86) ==== 3502+0+0 (secure 0 0 0) 0x7f3788013070 con 0x5628786dba70 2024-09-15T23:19:56.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.393+0000 7f379b1f8740 10 client.8631 fetch_fsmap finished waiting for FSMap version 86 2024-09-15T23:19:56.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.393+0000 7f379b1f8740 10 client.8631 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.d 2024-09-15T23:19:56.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.393+0000 7f379b1f8740 20 client.8631 populate_metadata read hostname 'smithi123' 2024-09-15T23:19:56.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.393+0000 7f379b1f8740 1 --2- 172.21.15.123:0/2932184566 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x56287870e4c0 0x562878706b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.393+0000 7f379b1f8740 4 client.8631 mds_command: new command op to 8439 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-15T23:19:56.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.393+0000 7f379b1f8740 1 -- 172.21.15.123:0/2932184566 --> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x5628786372f0 con 0x56287870e4c0 2024-09-15T23:19:56.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.393+0000 7f3795921640 1 --2- 172.21.15.123:0/2932184566 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x56287870e4c0 0x562878706b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.394+0000 7f37717fa640 10 client.8631 ms_handle_connect on v2:172.21.15.188:6835/1222656979 2024-09-15T23:19:56.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.394+0000 7f3795921640 1 --2- 172.21.15.123:0/2932184566 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x56287870e4c0 0x562878706b90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d681044c069695b server_cookie=5e5a8c059bd4f31e in_seq=0 out_seq=0 2024-09-15T23:19:56.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.396+0000 7f37717fa640 1 -- 172.21.15.123:0/2932184566 <== mds.0 v2:172.21.15.188:6835/1222656979 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5628786372f0 con 0x56287870e4c0 2024-09-15T23:19:56.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.396+0000 7f37717fa640 10 client.8631 handle_command_reply: tid=0 2024-09-15T23:19:56.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.396+0000 7f379b1f8740 1 client.8631 shutdown 2024-09-15T23:19:56.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.396+0000 7f379b1f8740 1 -- 172.21.15.123:0/2932184566 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5628786dba70 msgr2=0x5628786d5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:56.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.396+0000 7f379b1f8740 1 --2- 172.21.15.123:0/2932184566 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5628786dba70 0x5628786d5420 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f378800b4b0 tx=0x7f378805c040 comp rx=0 tx=0).stop 2024-09-15T23:19:56.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.396+0000 7f379b1f8740 1 -- 172.21.15.123:0/2932184566 shutdown_connections 2024-09-15T23:19:56.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.396+0000 7f379b1f8740 1 --2- 172.21.15.123:0/2932184566 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x56287870e4c0 0x562878706b90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.396+0000 7f379b1f8740 1 --2- 172.21.15.123:0/2932184566 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56287871e160 0x56287870d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.396+0000 7f379b1f8740 1 --2- 172.21.15.123:0/2932184566 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56287870c420 0x56287870cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.396+0000 7f379b1f8740 1 --2- 172.21.15.123:0/2932184566 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5628786dba70 0x5628786d5420 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.396+0000 7f37717fa640 0 client.8631 ms_handle_reset on v2:172.21.15.188:6835/1222656979 2024-09-15T23:19:56.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.396+0000 7f379b1f8740 1 -- 172.21.15.123:0/2932184566 >> 172.21.15.123:0/2932184566 conn(0x5628786c21f0 msgr2=0x562878704400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:56.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.396+0000 7f379b1f8740 1 -- 172.21.15.123:0/2932184566 shutdown_connections 2024-09-15T23:19:56.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.396+0000 7f379b1f8740 1 -- 172.21.15.123:0/2932184566 wait complete. 2024-09-15T23:19:56.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.396+0000 7f379b1f8740 20 client.8631 trim_cache size 0 max 16384 2024-09-15T23:19:56.402 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:19:56.402 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0, 2024-09-15T23:19:56.402 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_tag": "76955c7c-51bf-4a2f-a82c-448b47ca56cd", 2024-09-15T23:19:56.403 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": "asynchronous" 2024-09-15T23:19:56.403 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:19:56.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.397+0000 7f3798386640 1 -- 172.21.15.123:0/987705751 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f377406c2b0 msgr2=0x7f377406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:56.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.397+0000 7f3798386640 1 --2- 172.21.15.123:0/987705751 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f377406c2b0 0x7f377406e770 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f3780007fd0 tx=0x7f3780009040 comp rx=0 tx=0).stop 2024-09-15T23:19:56.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.397+0000 7f3798386640 1 -- 172.21.15.123:0/987705751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37900b21a0 msgr2=0x7f379015b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:56.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.397+0000 7f3798386640 1 --2- 172.21.15.123:0/987705751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37900b21a0 0x7f379015b5a0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f378800d7d0 tx=0x7f378800dc90 comp rx=0 tx=0).stop 2024-09-15T23:19:56.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.397+0000 7f3798386640 1 -- 172.21.15.123:0/987705751 shutdown_connections 2024-09-15T23:19:56.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.397+0000 7f3798386640 1 --2- 172.21.15.123:0/987705751 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3790155b20 0x7f3790141e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.397+0000 7f3798386640 1 --2- 172.21.15.123:0/987705751 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f37900cfb30 0x7f3790156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.397+0000 7f3798386640 1 --2- 172.21.15.123:0/987705751 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f377406c2b0 0x7f377406e770 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.397+0000 7f3798386640 1 --2- 172.21.15.123:0/987705751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37900b21a0 0x7f379015b5a0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.397+0000 7f3798386640 1 -- 172.21.15.123:0/987705751 >> 172.21.15.123:0/987705751 conn(0x7f379006c240 msgr2=0x7f37900b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:56.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.397+0000 7f3798386640 1 -- 172.21.15.123:0/987705751 shutdown_connections 2024-09-15T23:19:56.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.397+0000 7f3798386640 1 -- 172.21.15.123:0/987705751 wait complete. 2024-09-15T23:19:56.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:19:56.409 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub pause 2024-09-15T23:19:56.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.513+0000 7f02595d6640 1 Processor -- start 2024-09-15T23:19:56.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.514+0000 7f02595d6640 1 -- start start 2024-09-15T23:19:56.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.514+0000 7f02595d6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0254155950 0x7f0254073600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.514+0000 7f02595d6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f0254162c80 0x7f025406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.514+0000 7f02595d6640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0254073cc0 con 0x7f025406c150 2024-09-15T23:19:56.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.514+0000 7f02595d6640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f0254070370 con 0x7f0254155950 2024-09-15T23:19:56.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.514+0000 7f02595d6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f0254071aa0 con 0x7f0254162c80 2024-09-15T23:19:56.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.514+0000 7f0252ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0254155950 0x7f0254073600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.514+0000 7f02537fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f025406c150 0x7f02540afb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:50828/0 (socket says 172.21.15.123:50828) 2024-09-15T23:19:56.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.514+0000 7f02537fe640 1 -- 172.21.15.123:0/4271002483 learned_addr learned my addr 172.21.15.123:0/4271002483 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:19:56.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.515+0000 7f02527fc640 1 --2- 172.21.15.123:0/4271002483 >> v2:172.21.15.188:3300/0 conn(0x7f0254162c80 0x7f025406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.515+0000 7f0252ffd640 1 -- 172.21.15.123:0/4271002483 >> v2:172.21.15.188:3300/0 conn(0x7f0254162c80 msgr2=0x7f025406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:56.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.515+0000 7f0252ffd640 1 --2- 172.21.15.123:0/4271002483 >> v2:172.21.15.188:3300/0 conn(0x7f0254162c80 0x7f025406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.515+0000 7f0252ffd640 1 -- 172.21.15.123:0/4271002483 >> v1:172.21.15.123:6789/0 conn(0x7f025406c150 legacy=0x7f02540afb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:56.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.515+0000 7f0252ffd640 1 -- 172.21.15.123:0/4271002483 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0254071d80 con 0x7f0254155950 2024-09-15T23:19:56.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.515+0000 7f0251ffb640 1 -- 172.21.15.123:0/4271002483 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2495192885 0 0) 0x7f0254073cc0 con 0x7f025406c150 2024-09-15T23:19:56.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.515+0000 7f02527fc640 1 --2- 172.21.15.123:0/4271002483 >> v2:172.21.15.188:3300/0 conn(0x7f0254162c80 0x7f025406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:19:56.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.515+0000 7f0252ffd640 1 --2- 172.21.15.123:0/4271002483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0254155950 0x7f0254073600 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f025406d720 tx=0x7f024402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba5a82aaaf0a12c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:56.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.516+0000 7f0251ffb640 1 -- 172.21.15.123:0/4271002483 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0244037070 con 0x7f0254155950 2024-09-15T23:19:56.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.516+0000 7f0251ffb640 1 -- 172.21.15.123:0/4271002483 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0244032440 con 0x7f0254155950 2024-09-15T23:19:56.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.516+0000 7f0251ffb640 1 -- 172.21.15.123:0/4271002483 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0244032810 con 0x7f0254155950 2024-09-15T23:19:56.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.516+0000 7f02595d6640 1 -- 172.21.15.123:0/4271002483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0254155950 msgr2=0x7f0254073600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:56.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.516+0000 7f02595d6640 1 --2- 172.21.15.123:0/4271002483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0254155950 0x7f0254073600 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f025406d720 tx=0x7f024402a1a0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.516+0000 7f02595d6640 1 -- 172.21.15.123:0/4271002483 shutdown_connections 2024-09-15T23:19:56.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.516+0000 7f02595d6640 1 --2- 172.21.15.123:0/4271002483 >> v2:172.21.15.188:3300/0 conn(0x7f0254162c80 0x7f025406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.516+0000 7f02595d6640 1 --2- 172.21.15.123:0/4271002483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0254155950 0x7f0254073600 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.516+0000 7f02595d6640 1 -- 172.21.15.123:0/4271002483 >> 172.21.15.123:0/4271002483 conn(0x7f025406db30 msgr2=0x7f025406df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:56.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.516+0000 7f02595d6640 1 -- 172.21.15.123:0/4271002483 shutdown_connections 2024-09-15T23:19:56.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.516+0000 7f02595d6640 1 -- 172.21.15.123:0/4271002483 wait complete. 2024-09-15T23:19:56.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.517+0000 7f02595d6640 1 Processor -- start 2024-09-15T23:19:56.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.518+0000 7f02595d6640 1 -- start start 2024-09-15T23:19:56.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.518+0000 7f02595d6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f025406c150 0x7f02541f8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.518+0000 7f02595d6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0254162c80 0x7f02541f3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.518+0000 7f02595d6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0254148320 0x7f0254157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.518+0000 7f02595d6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f02540721e0 con 0x7f0254162c80 2024-09-15T23:19:56.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.518+0000 7f02595d6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0254072060 con 0x7f0254148320 2024-09-15T23:19:56.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.518+0000 7f02595d6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f02540b0230 con 0x7f025406c150 2024-09-15T23:19:56.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.518+0000 7f02527fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0254162c80 0x7f02541f3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.518+0000 7f02527fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0254162c80 0x7f02541f3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57066/0 (socket says 172.21.15.123:57066) 2024-09-15T23:19:56.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.518+0000 7f02527fc640 1 -- 172.21.15.123:0/2519678587 learned_addr learned my addr 172.21.15.123:0/2519678587 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:56.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.519+0000 7f02537fe640 1 --2- 172.21.15.123:0/2519678587 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0254148320 0x7f0254157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.519+0000 7f0252ffd640 1 --2- 172.21.15.123:0/2519678587 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f025406c150 0x7f02541f8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.519+0000 7f02527fc640 1 -- 172.21.15.123:0/2519678587 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f025406c150 msgr2=0x7f02541f8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:56.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.519+0000 7f02527fc640 1 --2- 172.21.15.123:0/2519678587 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f025406c150 0x7f02541f8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.519+0000 7f02527fc640 1 -- 172.21.15.123:0/2519678587 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0254148320 msgr2=0x7f0254157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:56.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.519+0000 7f02527fc640 1 --2- 172.21.15.123:0/2519678587 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0254148320 0x7f0254157de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.519+0000 7f02527fc640 1 -- 172.21.15.123:0/2519678587 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0254158850 con 0x7f0254162c80 2024-09-15T23:19:56.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.519+0000 7f0252ffd640 1 --2- 172.21.15.123:0/2519678587 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f025406c150 0x7f02541f8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:19:56.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.519+0000 7f02527fc640 1 --2- 172.21.15.123:0/2519678587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0254162c80 0x7f02541f3e10 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f024800c7f0 tx=0x7f024800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:56.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.519+0000 7f023b7fe640 1 -- 172.21.15.123:0/2519678587 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0248015070 con 0x7f0254162c80 2024-09-15T23:19:56.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.519+0000 7f023b7fe640 1 -- 172.21.15.123:0/2519678587 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0248007820 con 0x7f0254162c80 2024-09-15T23:19:56.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.519+0000 7f023b7fe640 1 -- 172.21.15.123:0/2519678587 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0248007bd0 con 0x7f0254162c80 2024-09-15T23:19:56.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.519+0000 7f02595d6640 1 -- 172.21.15.123:0/2519678587 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0254158b30 con 0x7f0254162c80 2024-09-15T23:19:56.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.519+0000 7f02595d6640 1 -- 172.21.15.123:0/2519678587 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02541f4350 con 0x7f0254162c80 2024-09-15T23:19:56.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.520+0000 7f023b7fe640 1 -- 172.21.15.123:0/2519678587 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0248018070 con 0x7f0254162c80 2024-09-15T23:19:56.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.521+0000 7f023b7fe640 1 --2- 172.21.15.123:0/2519678587 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f024006c2b0 0x7f024006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.521+0000 7f023b7fe640 1 -- 172.21.15.123:0/2519678587 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f024808b510 con 0x7f0254162c80 2024-09-15T23:19:56.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.521+0000 7f0252ffd640 1 --2- 172.21.15.123:0/2519678587 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f024006c2b0 0x7f024006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.522+0000 7f0252ffd640 1 --2- 172.21.15.123:0/2519678587 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f024006c2b0 0x7f024006e770 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f0244034000 tx=0x7f024402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:56.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.522+0000 7f025c44a740 1 Processor -- start 2024-09-15T23:19:56.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.522+0000 7f025c44a740 1 -- start start 2024-09-15T23:19:56.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.523+0000 7f025c44a740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc9d5145e0 0x55dc9d5149c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.523+0000 7f025c44a740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dc9d511da0 0x55dc9d513930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.523+0000 7f025c44a740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dc9d512200 0x55dc9d4f4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.523+0000 7f025c44a740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55dc9d4308d0 con 0x55dc9d512200 2024-09-15T23:19:56.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.523+0000 7f025c44a740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55dc9d3d8620 con 0x55dc9d5145e0 2024-09-15T23:19:56.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.523+0000 7f025c44a740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55dc9d42c890 con 0x55dc9d511da0 2024-09-15T23:19:56.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.523+0000 7f02537fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dc9d512200 0x55dc9d4f4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.523+0000 7f02537fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dc9d512200 0x55dc9d4f4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57070/0 (socket says 172.21.15.123:57070) 2024-09-15T23:19:56.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.523+0000 7f02537fe640 1 -- 172.21.15.123:0/2223560126 learned_addr learned my addr 172.21.15.123:0/2223560126 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:56.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.523+0000 7f02527fc640 1 --2- 172.21.15.123:0/2223560126 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dc9d511da0 0x55dc9d513930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.523+0000 7f0252ffd640 1 --2- 172.21.15.123:0/2223560126 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc9d5145e0 0x55dc9d5149c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.523+0000 7f02537fe640 1 -- 172.21.15.123:0/2223560126 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dc9d511da0 msgr2=0x55dc9d513930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:56.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.523+0000 7f02537fe640 1 --2- 172.21.15.123:0/2223560126 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dc9d511da0 0x55dc9d513930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.523+0000 7f02537fe640 1 -- 172.21.15.123:0/2223560126 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc9d5145e0 msgr2=0x55dc9d5149c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:56.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.523+0000 7f02537fe640 1 --2- 172.21.15.123:0/2223560126 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc9d5145e0 0x55dc9d5149c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.523+0000 7f02537fe640 1 -- 172.21.15.123:0/2223560126 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc9d20d7d0 con 0x55dc9d512200 2024-09-15T23:19:56.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.523+0000 7f02537fe640 1 --2- 172.21.15.123:0/2223560126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dc9d512200 0x55dc9d4f4560 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f024c001d60 tx=0x7f024c00d150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5cc0c98f771bd7d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:56.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.523+0000 7f02397fa640 1 -- 172.21.15.123:0/2223560126 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024c00d980 con 0x55dc9d512200 2024-09-15T23:19:56.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.523+0000 7f02397fa640 1 -- 172.21.15.123:0/2223560126 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f024c00db20 con 0x55dc9d512200 2024-09-15T23:19:56.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.523+0000 7f02397fa640 1 -- 172.21.15.123:0/2223560126 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024c0070d0 con 0x55dc9d512200 2024-09-15T23:19:56.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.524+0000 7f025c44a740 1 -- 172.21.15.123:0/2223560126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dc9d512200 msgr2=0x55dc9d4f4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:56.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.524+0000 7f025c44a740 1 --2- 172.21.15.123:0/2223560126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dc9d512200 0x55dc9d4f4560 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f024c001d60 tx=0x7f024c00d150 comp rx=0 tx=0).stop 2024-09-15T23:19:56.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.524+0000 7f025c44a740 1 -- 172.21.15.123:0/2223560126 shutdown_connections 2024-09-15T23:19:56.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.524+0000 7f025c44a740 1 --2- 172.21.15.123:0/2223560126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dc9d512200 0x55dc9d4f4560 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.524+0000 7f025c44a740 1 --2- 172.21.15.123:0/2223560126 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dc9d511da0 0x55dc9d513930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.524+0000 7f025c44a740 1 --2- 172.21.15.123:0/2223560126 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc9d5145e0 0x55dc9d5149c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.524+0000 7f025c44a740 1 -- 172.21.15.123:0/2223560126 >> 172.21.15.123:0/2223560126 conn(0x55dc9d4ca240 msgr2=0x55dc9d512650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:56.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.524+0000 7f025c44a740 1 -- 172.21.15.123:0/2223560126 shutdown_connections 2024-09-15T23:19:56.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.524+0000 7f025c44a740 1 -- 172.21.15.123:0/2223560126 wait complete. 2024-09-15T23:19:56.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.525+0000 7f025c44a740 1 -- start start 2024-09-15T23:19:56.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.525+0000 7f025c44a740 1 Processor -- start 2024-09-15T23:19:56.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.526+0000 7f025c44a740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc9d512200 0x55dc9d50a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.526+0000 7f025c44a740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dc9d5145e0 0x55dc9d4f2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.526+0000 7f025c44a740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dc9d4f7e00 0x55dc9d50d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.526+0000 7f025c44a740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55dc9d510d00 con 0x55dc9d4f7e00 2024-09-15T23:19:56.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.526+0000 7f025c44a740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55dc9d3b9750 con 0x55dc9d512200 2024-09-15T23:19:56.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.526+0000 7f025c44a740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55dc9d510fe0 con 0x55dc9d5145e0 2024-09-15T23:19:56.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.526+0000 7f025c44a740 10 client.0 _ll_register_callbacks cb 0x55dc9d3dd780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:19:56.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.526+0000 7f02537fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dc9d4f7e00 0x55dc9d50d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.526+0000 7f02537fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dc9d4f7e00 0x55dc9d50d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57080/0 (socket says 172.21.15.123:57080) 2024-09-15T23:19:56.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.526+0000 7f02537fe640 1 -- 172.21.15.123:0/294251272 learned_addr learned my addr 172.21.15.123:0/294251272 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:56.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.526+0000 7f02527fc640 1 --2- 172.21.15.123:0/294251272 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dc9d5145e0 0x55dc9d4f2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.526+0000 7f0252ffd640 1 --2- 172.21.15.123:0/294251272 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc9d512200 0x55dc9d50a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.526+0000 7f02527fc640 1 -- 172.21.15.123:0/294251272 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc9d512200 msgr2=0x55dc9d50a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:56.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.526+0000 7f02527fc640 1 --2- 172.21.15.123:0/294251272 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc9d512200 0x55dc9d50a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.526+0000 7f02527fc640 1 -- 172.21.15.123:0/294251272 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dc9d4f7e00 msgr2=0x55dc9d50d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:56.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.526+0000 7f02527fc640 1 --2- 172.21.15.123:0/294251272 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dc9d4f7e00 0x55dc9d50d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.526+0000 7f02527fc640 1 -- 172.21.15.123:0/294251272 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55dc9d1030f0 con 0x55dc9d5145e0 2024-09-15T23:19:56.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.526+0000 7f02537fe640 1 --2- 172.21.15.123:0/294251272 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dc9d4f7e00 0x55dc9d50d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:19:56.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.527+0000 7f02527fc640 1 --2- 172.21.15.123:0/294251272 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dc9d5145e0 0x55dc9d4f2790 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0248089b20 tx=0x7f0248059790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4509f2b60c40b39 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:56.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.527+0000 7f0231ffb640 10 client.0 ms_handle_connect on v2:172.21.15.188:3301/0 2024-09-15T23:19:56.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.527+0000 7f0231ffb640 1 -- 172.21.15.123:0/294251272 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024801f040 con 0x55dc9d5145e0 2024-09-15T23:19:56.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.527+0000 7f0231ffb640 1 -- 172.21.15.123:0/294251272 <== mon.2 v2:172.21.15.188:3301/0 2 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f024805eb50 con 0x55dc9d5145e0 2024-09-15T23:19:56.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.527+0000 7f025c44a740 1 -- 172.21.15.123:0/294251272 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f024c00db20 con 0x55dc9d5145e0 2024-09-15T23:19:56.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.527+0000 7f0231ffb640 1 -- 172.21.15.123:0/294251272 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f0248089e60 con 0x55dc9d5145e0 2024-09-15T23:19:56.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.527+0000 7f025c44a740 10 client.6686 fetch_fsmap learned FSMap version 86 2024-09-15T23:19:56.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.527+0000 7f025c44a740 1 -- 172.21.15.123:0/294251272 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) -- 0x55dc9d26df60 con 0x55dc9d5145e0 2024-09-15T23:19:56.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.527+0000 7f0231ffb640 1 -- 172.21.15.123:0/294251272 <== mon.2 v2:172.21.15.188:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f024c00db20 con 0x55dc9d5145e0 2024-09-15T23:19:56.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.527+0000 7f0231ffb640 1 -- 172.21.15.123:0/294251272 <== mon.2 v2:172.21.15.188:3301/0 5 ==== fsmap(e 86) ==== 3502+0+0 (secure 0 0 0) 0x7f0248058a60 con 0x55dc9d5145e0 2024-09-15T23:19:56.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.527+0000 7f025c44a740 10 client.6686 fetch_fsmap finished waiting for FSMap version 86 2024-09-15T23:19:56.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.527+0000 7f025c44a740 10 client.6686 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.d 2024-09-15T23:19:56.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.527+0000 7f025c44a740 20 client.6686 populate_metadata read hostname 'smithi123' 2024-09-15T23:19:56.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.527+0000 7f025c44a740 1 --2- 172.21.15.123:0/294251272 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x55dc9d4c7fb0 0x55dc9d4c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.527+0000 7f025c44a740 4 client.6686 mds_command: new command op to 8439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:19:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.527+0000 7f025c44a740 1 -- 172.21.15.123:0/294251272 --> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc9d43e000 con 0x55dc9d4c7fb0 2024-09-15T23:19:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.528+0000 7f0252ffd640 1 --2- 172.21.15.123:0/294251272 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x55dc9d4c7fb0 0x55dc9d4c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.528+0000 7f0231ffb640 10 client.6686 ms_handle_connect on v2:172.21.15.188:6835/1222656979 2024-09-15T23:19:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.528+0000 7f0252ffd640 1 --2- 172.21.15.123:0/294251272 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x55dc9d4c7fb0 0x55dc9d4c83c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=911d3aace77bdd67 server_cookie=85600eea356861fe in_seq=0 out_seq=0 2024-09-15T23:19:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.529+0000 7f0231ffb640 1 -- 172.21.15.123:0/294251272 <== mds.0 v2:172.21.15.188:6835/1222656979 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dc9d43e000 con 0x55dc9d4c7fb0 2024-09-15T23:19:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.529+0000 7f0231ffb640 10 client.6686 handle_command_reply: tid=0 2024-09-15T23:19:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.529+0000 7f025c44a740 1 client.6686 shutdown 2024-09-15T23:19:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.529+0000 7f025c44a740 1 -- 172.21.15.123:0/294251272 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dc9d5145e0 msgr2=0x55dc9d4f2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.529+0000 7f025c44a740 1 --2- 172.21.15.123:0/294251272 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dc9d5145e0 0x55dc9d4f2790 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0248089b20 tx=0x7f0248059790 comp rx=0 tx=0).stop 2024-09-15T23:19:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.529+0000 7f025c44a740 1 -- 172.21.15.123:0/294251272 shutdown_connections 2024-09-15T23:19:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.529+0000 7f025c44a740 1 --2- 172.21.15.123:0/294251272 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x55dc9d4c7fb0 0x55dc9d4c83c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.529+0000 7f025c44a740 1 --2- 172.21.15.123:0/294251272 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dc9d4f7e00 0x55dc9d50d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.529+0000 7f025c44a740 1 --2- 172.21.15.123:0/294251272 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dc9d5145e0 0x55dc9d4f2790 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.529+0000 7f025c44a740 1 --2- 172.21.15.123:0/294251272 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc9d512200 0x55dc9d50a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.529+0000 7f0231ffb640 0 client.6686 ms_handle_reset on v2:172.21.15.188:6835/1222656979 2024-09-15T23:19:56.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.529+0000 7f025c44a740 1 -- 172.21.15.123:0/294251272 >> 172.21.15.123:0/294251272 conn(0x55dc9d511da0 msgr2=0x55dc9d4f4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:56.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.529+0000 7f025c44a740 1 -- 172.21.15.123:0/294251272 shutdown_connections 2024-09-15T23:19:56.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.529+0000 7f025c44a740 1 -- 172.21.15.123:0/294251272 wait complete. 2024-09-15T23:19:56.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.529+0000 7f025c44a740 20 client.6686 trim_cache size 0 max 16384 2024-09-15T23:19:56.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.546+0000 7f025c44a740 1 Processor -- start 2024-09-15T23:19:56.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.546+0000 7f025c44a740 1 -- start start 2024-09-15T23:19:56.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.547+0000 7f025c44a740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dc9d4f7e00 0x55dc9d536010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.547+0000 7f025c44a740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc9d512200 0x55dc9d4f2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.547+0000 7f025c44a740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dc9d5145e0 0x55dc9d4f3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.547+0000 7f025c44a740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0254160ee0 con 0x55dc9d5145e0 2024-09-15T23:19:56.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.547+0000 7f025c44a740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f025415dfc0 con 0x55dc9d512200 2024-09-15T23:19:56.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.547+0000 7f025c44a740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f025415d320 con 0x55dc9d4f7e00 2024-09-15T23:19:56.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.547+0000 7f02537fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dc9d5145e0 0x55dc9d4f3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.547+0000 7f0252ffd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dc9d4f7e00 0x55dc9d536010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.547+0000 7f02537fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dc9d5145e0 0x55dc9d4f3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57088/0 (socket says 172.21.15.123:57088) 2024-09-15T23:19:56.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.547+0000 7f02537fe640 1 -- 172.21.15.123:0/3023295672 learned_addr learned my addr 172.21.15.123:0/3023295672 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:56.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.547+0000 7f02527fc640 1 --2- 172.21.15.123:0/3023295672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc9d512200 0x55dc9d4f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.547+0000 7f02537fe640 1 -- 172.21.15.123:0/3023295672 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dc9d4f7e00 msgr2=0x55dc9d536010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:56.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.547+0000 7f02537fe640 1 --2- 172.21.15.123:0/3023295672 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dc9d4f7e00 0x55dc9d536010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.547+0000 7f02537fe640 1 -- 172.21.15.123:0/3023295672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc9d512200 msgr2=0x55dc9d4f2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:56.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.547+0000 7f02537fe640 1 --2- 172.21.15.123:0/3023295672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc9d512200 0x55dc9d4f2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.547+0000 7f02537fe640 1 -- 172.21.15.123:0/3023295672 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc9d0dc1b0 con 0x55dc9d5145e0 2024-09-15T23:19:56.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.548+0000 7f02537fe640 1 --2- 172.21.15.123:0/3023295672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dc9d5145e0 0x55dc9d4f3360 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f024c001c80 tx=0x7f024c006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23081b08c62dd130 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:56.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.548+0000 7f0238ff9640 1 -- 172.21.15.123:0/3023295672 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024c001660 con 0x55dc9d5145e0 2024-09-15T23:19:56.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.548+0000 7f0238ff9640 1 -- 172.21.15.123:0/3023295672 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f024c025020 con 0x55dc9d5145e0 2024-09-15T23:19:56.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.548+0000 7f0238ff9640 1 -- 172.21.15.123:0/3023295672 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024c00d980 con 0x55dc9d5145e0 2024-09-15T23:19:56.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.548+0000 7f025c44a740 1 -- 172.21.15.123:0/3023295672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dc9d5145e0 msgr2=0x55dc9d4f3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:56.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.548+0000 7f025c44a740 1 --2- 172.21.15.123:0/3023295672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dc9d5145e0 0x55dc9d4f3360 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f024c001c80 tx=0x7f024c006000 comp rx=0 tx=0).stop 2024-09-15T23:19:56.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.548+0000 7f025c44a740 1 -- 172.21.15.123:0/3023295672 shutdown_connections 2024-09-15T23:19:56.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.548+0000 7f025c44a740 1 --2- 172.21.15.123:0/3023295672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dc9d5145e0 0x55dc9d4f3360 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.548+0000 7f025c44a740 1 --2- 172.21.15.123:0/3023295672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc9d512200 0x55dc9d4f2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.548+0000 7f025c44a740 1 --2- 172.21.15.123:0/3023295672 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dc9d4f7e00 0x55dc9d536010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.548+0000 7f025c44a740 1 -- 172.21.15.123:0/3023295672 >> 172.21.15.123:0/3023295672 conn(0x55dc9d511da0 msgr2=0x55dc9d4e9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:56.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.548+0000 7f025c44a740 1 -- 172.21.15.123:0/3023295672 shutdown_connections 2024-09-15T23:19:56.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.548+0000 7f025c44a740 1 -- 172.21.15.123:0/3023295672 wait complete. 2024-09-15T23:19:56.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.549+0000 7f025c44a740 1 -- start start 2024-09-15T23:19:56.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.549+0000 7f025c44a740 1 Processor -- start 2024-09-15T23:19:56.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.550+0000 7f025c44a740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dc9d4f7e00 0x55dc9d535530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.550+0000 7f025c44a740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dc9d512200 0x55dc9d5089a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.550+0000 7f025c44a740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc9d5145e0 0x55dc9d5125e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.550+0000 7f025c44a740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f025415d970 con 0x55dc9d4f7e00 2024-09-15T23:19:56.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.550+0000 7f025c44a740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55dc9d515280 con 0x55dc9d5145e0 2024-09-15T23:19:56.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.550+0000 7f025c44a740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55dc9d513500 con 0x55dc9d512200 2024-09-15T23:19:56.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.550+0000 7f025c44a740 10 client.0 _ll_register_callbacks cb 0x7f0248059e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:19:56.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.550+0000 7f0252ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dc9d4f7e00 0x55dc9d535530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.550+0000 7f0252ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dc9d4f7e00 0x55dc9d535530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57102/0 (socket says 172.21.15.123:57102) 2024-09-15T23:19:56.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.550+0000 7f0252ffd640 1 -- 172.21.15.123:0/2143896636 learned_addr learned my addr 172.21.15.123:0/2143896636 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:56.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.550+0000 7f02537fe640 1 --2- 172.21.15.123:0/2143896636 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc9d5145e0 0x55dc9d5125e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.550+0000 7f02527fc640 1 --2- 172.21.15.123:0/2143896636 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dc9d512200 0x55dc9d5089a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.550+0000 7f0252ffd640 1 -- 172.21.15.123:0/2143896636 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dc9d512200 msgr2=0x55dc9d5089a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:56.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.550+0000 7f0252ffd640 1 --2- 172.21.15.123:0/2143896636 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dc9d512200 0x55dc9d5089a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.550+0000 7f0252ffd640 1 -- 172.21.15.123:0/2143896636 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc9d5145e0 msgr2=0x55dc9d5125e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:56.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.550+0000 7f0252ffd640 1 --2- 172.21.15.123:0/2143896636 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc9d5145e0 0x55dc9d5125e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.550+0000 7f0252ffd640 1 -- 172.21.15.123:0/2143896636 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc9d4f3bf0 con 0x55dc9d4f7e00 2024-09-15T23:19:56.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.550+0000 7f0252ffd640 1 --2- 172.21.15.123:0/2143896636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dc9d4f7e00 0x55dc9d535530 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f024402a1e0 tx=0x7f024402c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb899a2b1faea73a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:56.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.550+0000 7f0231ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:19:56.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.550+0000 7f0231ffb640 1 -- 172.21.15.123:0/2143896636 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0244058060 con 0x55dc9d4f7e00 2024-09-15T23:19:56.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.551+0000 7f0231ffb640 1 -- 172.21.15.123:0/2143896636 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f0244003810 con 0x55dc9d4f7e00 2024-09-15T23:19:56.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.551+0000 7f025c44a740 1 -- 172.21.15.123:0/2143896636 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f024c025020 con 0x55dc9d4f7e00 2024-09-15T23:19:56.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.551+0000 7f0231ffb640 1 -- 172.21.15.123:0/2143896636 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f024405e050 con 0x55dc9d4f7e00 2024-09-15T23:19:56.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.551+0000 7f025c44a740 10 client.8652 fetch_fsmap learned FSMap version 86 2024-09-15T23:19:56.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.551+0000 7f025c44a740 1 -- 172.21.15.123:0/2143896636 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) -- 0x55dc9d4f36d0 con 0x55dc9d4f7e00 2024-09-15T23:19:56.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.551+0000 7f0231ffb640 1 -- 172.21.15.123:0/2143896636 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f024c025020 con 0x55dc9d4f7e00 2024-09-15T23:19:56.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.551+0000 7f0231ffb640 1 -- 172.21.15.123:0/2143896636 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 86) ==== 3502+0+0 (secure 0 0 0) 0x7f0244061020 con 0x55dc9d4f7e00 2024-09-15T23:19:56.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.551+0000 7f025c44a740 10 client.8652 fetch_fsmap finished waiting for FSMap version 86 2024-09-15T23:19:56.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.551+0000 7f025c44a740 10 client.8652 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.d 2024-09-15T23:19:56.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.551+0000 7f025c44a740 20 client.8652 populate_metadata read hostname 'smithi123' 2024-09-15T23:19:56.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.551+0000 7f025c44a740 1 --2- 172.21.15.123:0/2143896636 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x55dc9d512b20 0x55dc9d58f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.551+0000 7f025c44a740 4 client.8652 mds_command: new command op to 8439 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-15T23:19:56.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.551+0000 7f025c44a740 1 -- 172.21.15.123:0/2143896636 --> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x55dc9d438350 con 0x55dc9d512b20 2024-09-15T23:19:56.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.551+0000 7f02527fc640 1 --2- 172.21.15.123:0/2143896636 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x55dc9d512b20 0x55dc9d58f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.552+0000 7f0231ffb640 10 client.8652 ms_handle_connect on v2:172.21.15.188:6835/1222656979 2024-09-15T23:19:56.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.551+0000 7f02527fc640 1 --2- 172.21.15.123:0/2143896636 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x55dc9d512b20 0x55dc9d58f620 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47e6a0834ccebf37 server_cookie=f33e20a81aaf3434 in_seq=0 out_seq=0 2024-09-15T23:19:56.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.652+0000 7f0231ffb640 1 -- 172.21.15.123:0/2143896636 <== mds.0 v2:172.21.15.188:6835/1222656979 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dc9d438350 con 0x55dc9d512b20 2024-09-15T23:19:56.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.652+0000 7f0231ffb640 10 client.8652 handle_command_reply: tid=0 2024-09-15T23:19:56.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.653+0000 7f025c44a740 1 client.8652 shutdown 2024-09-15T23:19:56.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.653+0000 7f025c44a740 1 -- 172.21.15.123:0/2143896636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dc9d4f7e00 msgr2=0x55dc9d535530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:56.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.653+0000 7f025c44a740 1 --2- 172.21.15.123:0/2143896636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dc9d4f7e00 0x55dc9d535530 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f024402a1e0 tx=0x7f024402c070 comp rx=0 tx=0).stop 2024-09-15T23:19:56.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.653+0000 7f025c44a740 1 -- 172.21.15.123:0/2143896636 shutdown_connections 2024-09-15T23:19:56.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.653+0000 7f025c44a740 1 --2- 172.21.15.123:0/2143896636 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x55dc9d512b20 0x55dc9d58f620 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.653+0000 7f025c44a740 1 --2- 172.21.15.123:0/2143896636 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55dc9d5145e0 0x55dc9d5125e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.653+0000 7f025c44a740 1 --2- 172.21.15.123:0/2143896636 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55dc9d512200 0x55dc9d5089a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.653+0000 7f0231ffb640 0 client.8652 ms_handle_reset on v2:172.21.15.188:6835/1222656979 2024-09-15T23:19:56.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.653+0000 7f025c44a740 1 --2- 172.21.15.123:0/2143896636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55dc9d4f7e00 0x55dc9d535530 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.653+0000 7f025c44a740 1 -- 172.21.15.123:0/2143896636 >> 172.21.15.123:0/2143896636 conn(0x55dc9d511da0 msgr2=0x55dc9d513750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:56.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.653+0000 7f025c44a740 1 -- 172.21.15.123:0/2143896636 shutdown_connections 2024-09-15T23:19:56.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.653+0000 7f025c44a740 1 -- 172.21.15.123:0/2143896636 wait complete. 2024-09-15T23:19:56.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.653+0000 7f025c44a740 20 client.8652 trim_cache size 0 max 16384 2024-09-15T23:19:56.656 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:19:56.656 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "", 2024-09-15T23:19:56.656 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0 2024-09-15T23:19:56.656 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:19:56.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.653+0000 7f02595d6640 1 -- 172.21.15.123:0/2519678587 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f024006c2b0 msgr2=0x7f024006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:56.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.653+0000 7f02595d6640 1 --2- 172.21.15.123:0/2519678587 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f024006c2b0 0x7f024006e770 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f0244034000 tx=0x7f024402e000 comp rx=0 tx=0).stop 2024-09-15T23:19:56.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.653+0000 7f02595d6640 1 -- 172.21.15.123:0/2519678587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0254162c80 msgr2=0x7f02541f3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:56.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.653+0000 7f02595d6640 1 --2- 172.21.15.123:0/2519678587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0254162c80 0x7f02541f3e10 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f024800c7f0 tx=0x7f024800ccb0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.653+0000 7f02595d6640 1 -- 172.21.15.123:0/2519678587 shutdown_connections 2024-09-15T23:19:56.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.653+0000 7f02595d6640 1 --2- 172.21.15.123:0/2519678587 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0254148320 0x7f0254157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.653+0000 7f02595d6640 1 --2- 172.21.15.123:0/2519678587 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f024006c2b0 0x7f024006e770 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.653+0000 7f02595d6640 1 --2- 172.21.15.123:0/2519678587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0254162c80 0x7f02541f3e10 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.653+0000 7f02595d6640 1 --2- 172.21.15.123:0/2519678587 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f025406c150 0x7f02541f8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.654+0000 7f02595d6640 1 -- 172.21.15.123:0/2519678587 >> 172.21.15.123:0/2519678587 conn(0x7f025406db30 msgr2=0x7f02540ae870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:56.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.654+0000 7f02595d6640 1 -- 172.21.15.123:0/2519678587 shutdown_connections 2024-09-15T23:19:56.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.654+0000 7f02595d6640 1 -- 172.21.15.123:0/2519678587 wait complete. 2024-09-15T23:19:56.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:19:56.665 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub status 2024-09-15T23:19:56.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.764+0000 7fcddc5b9640 1 Processor -- start 2024-09-15T23:19:56.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.764+0000 7fcddc5b9640 1 -- start start 2024-09-15T23:19:56.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.765+0000 7fcddc5b9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcdd406bfd0 0x7fcdd406c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.765+0000 7fcddc5b9640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fcdd40d3930 0x7fcdd4162ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.765+0000 7fcddc5b9640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdd406c8f0 con 0x7fcdd40b3350 2024-09-15T23:19:56.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.765+0000 7fcddc5b9640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fcdd40b78a0 con 0x7fcdd40d3930 2024-09-15T23:19:56.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.765+0000 7fcddc5b9640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fcdd40cffb0 con 0x7fcdd406bfd0 2024-09-15T23:19:56.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.766+0000 7fcdd9b54640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fcdd40b3350 0x7fcdd41623a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:50836/0 (socket says 172.21.15.123:50836) 2024-09-15T23:19:56.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.766+0000 7fcdd9b54640 1 -- 172.21.15.123:0/4013365333 learned_addr learned my addr 172.21.15.123:0/4013365333 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:19:56.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.766+0000 7fcdda355640 1 --2- 172.21.15.123:0/4013365333 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcdd406bfd0 0x7fcdd406c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.766+0000 7fcddab56640 1 --2- 172.21.15.123:0/4013365333 >> v2:172.21.15.188:3300/0 conn(0x7fcdd40d3930 0x7fcdd4162ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.766+0000 7fcdd9353640 1 -- 172.21.15.123:0/4013365333 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3574438769 0 0) 0x7fcdd406c8f0 con 0x7fcdd40b3350 2024-09-15T23:19:56.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.766+0000 7fcdd9353640 1 -- 172.21.15.123:0/4013365333 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdc0003520 con 0x7fcdd40b3350 2024-09-15T23:19:56.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.766+0000 7fcddab56640 1 -- 172.21.15.123:0/4013365333 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcdd406bfd0 msgr2=0x7fcdd406c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:56.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.766+0000 7fcddab56640 1 --2- 172.21.15.123:0/4013365333 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcdd406bfd0 0x7fcdd406c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.766+0000 7fcddab56640 1 -- 172.21.15.123:0/4013365333 >> v1:172.21.15.123:6789/0 conn(0x7fcdd40b3350 legacy=0x7fcdd41623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:56.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.766+0000 7fcddab56640 1 -- 172.21.15.123:0/4013365333 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd40cf710 con 0x7fcdd40d3930 2024-09-15T23:19:56.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.766+0000 7fcdda355640 1 --2- 172.21.15.123:0/4013365333 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcdd406bfd0 0x7fcdd406c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:19:56.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.767+0000 7fcddab56640 1 --2- 172.21.15.123:0/4013365333 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcdd40d3930 0x7fcdd4162ab0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc009dc0 tx=0x7fcdcc02a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99ec89f088f85a73 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:56.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.767+0000 7fcdd9353640 1 -- 172.21.15.123:0/4013365333 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc02ae60 con 0x7fcdd40d3930 2024-09-15T23:19:56.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.767+0000 7fcdd9353640 1 -- 172.21.15.123:0/4013365333 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdcc007740 con 0x7fcdd40d3930 2024-09-15T23:19:56.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.767+0000 7fcdd9353640 1 -- 172.21.15.123:0/4013365333 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc007af0 con 0x7fcdd40d3930 2024-09-15T23:19:56.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.767+0000 7fcddc5b9640 1 -- 172.21.15.123:0/4013365333 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcdd40d3930 msgr2=0x7fcdd4162ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:56.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.767+0000 7fcddc5b9640 1 --2- 172.21.15.123:0/4013365333 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcdd40d3930 0x7fcdd4162ab0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc009dc0 tx=0x7fcdcc02a680 comp rx=0 tx=0).stop 2024-09-15T23:19:56.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.768+0000 7fcddc5b9640 1 -- 172.21.15.123:0/4013365333 shutdown_connections 2024-09-15T23:19:56.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.768+0000 7fcddc5b9640 1 --2- 172.21.15.123:0/4013365333 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcdd40d3930 0x7fcdd4162ab0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.768+0000 7fcddc5b9640 1 --2- 172.21.15.123:0/4013365333 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcdd406bfd0 0x7fcdd406c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.768+0000 7fcddc5b9640 1 -- 172.21.15.123:0/4013365333 >> 172.21.15.123:0/4013365333 conn(0x7fcdd40d11c0 msgr2=0x7fcdd40d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:56.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.768+0000 7fcddc5b9640 1 -- 172.21.15.123:0/4013365333 shutdown_connections 2024-09-15T23:19:56.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.768+0000 7fcddc5b9640 1 -- 172.21.15.123:0/4013365333 wait complete. 2024-09-15T23:19:56.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.769+0000 7fcddc5b9640 1 Processor -- start 2024-09-15T23:19:56.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.769+0000 7fcddc5b9640 1 -- start start 2024-09-15T23:19:56.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.769+0000 7fcddc5b9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcdd406bfd0 0x7fcdd41f49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.769+0000 7fcddc5b9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcdd40b3350 0x7fcdd415dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.769+0000 7fcddc5b9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcdd40d3930 0x7fcdd40abe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.769+0000 7fcddc5b9640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd40d2400 con 0x7fcdd40b3350 2024-09-15T23:19:56.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.769+0000 7fcddc5b9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd40cfcd0 con 0x7fcdd40d3930 2024-09-15T23:19:56.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.769+0000 7fcddc5b9640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fcdd406cd50 con 0x7fcdd406bfd0 2024-09-15T23:19:56.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.770+0000 7fcdd9b54640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcdd40b3350 0x7fcdd415dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.770+0000 7fcdd9b54640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcdd40b3350 0x7fcdd415dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57114/0 (socket says 172.21.15.123:57114) 2024-09-15T23:19:56.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.770+0000 7fcdd9b54640 1 -- 172.21.15.123:0/940934280 learned_addr learned my addr 172.21.15.123:0/940934280 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:56.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.770+0000 7fcdda355640 1 --2- 172.21.15.123:0/940934280 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcdd406bfd0 0x7fcdd41f49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.770+0000 7fcddab56640 1 --2- 172.21.15.123:0/940934280 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcdd40d3930 0x7fcdd40abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.770+0000 7fcdd9b54640 1 -- 172.21.15.123:0/940934280 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcdd406bfd0 msgr2=0x7fcdd41f49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:56.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.770+0000 7fcdd9b54640 1 --2- 172.21.15.123:0/940934280 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcdd406bfd0 0x7fcdd41f49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.770+0000 7fcdd9b54640 1 -- 172.21.15.123:0/940934280 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcdd40d3930 msgr2=0x7fcdd40abe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:56.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.770+0000 7fcdd9b54640 1 --2- 172.21.15.123:0/940934280 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcdd40d3930 0x7fcdd40abe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.770+0000 7fcdd9b54640 1 -- 172.21.15.123:0/940934280 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd41f5e50 con 0x7fcdd40b3350 2024-09-15T23:19:56.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.770+0000 7fcdd9b54640 1 --2- 172.21.15.123:0/940934280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcdd40b3350 0x7fcdd415dab0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fcdc400c460 tx=0x7fcdc400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:56.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.770+0000 7fcdcaffd640 1 -- 172.21.15.123:0/940934280 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4017070 con 0x7fcdd40b3350 2024-09-15T23:19:56.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.770+0000 7fcdcaffd640 1 -- 172.21.15.123:0/940934280 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc4005ce0 con 0x7fcdd40b3350 2024-09-15T23:19:56.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.770+0000 7fcddc5b9640 1 -- 172.21.15.123:0/940934280 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdd41f6130 con 0x7fcdd40b3350 2024-09-15T23:19:56.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.770+0000 7fcddc5b9640 1 -- 172.21.15.123:0/940934280 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdd41f66f0 con 0x7fcdd40b3350 2024-09-15T23:19:56.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.770+0000 7fcdcaffd640 1 -- 172.21.15.123:0/940934280 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4007290 con 0x7fcdd40b3350 2024-09-15T23:19:56.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.772+0000 7fcdcaffd640 1 -- 172.21.15.123:0/940934280 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcdc401a070 con 0x7fcdd40b3350 2024-09-15T23:19:56.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.772+0000 7fcdcaffd640 1 --2- 172.21.15.123:0/940934280 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcdb806c2b0 0x7fcdb806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.773+0000 7fcdcaffd640 1 -- 172.21.15.123:0/940934280 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fcdc408a5f0 con 0x7fcdd40b3350 2024-09-15T23:19:56.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.773+0000 7fcdda355640 1 --2- 172.21.15.123:0/940934280 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcdb806c2b0 0x7fcdb806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.773+0000 7fcdda355640 1 --2- 172.21.15.123:0/940934280 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcdb806c2b0 0x7fcdb806e770 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fcdd40ba270 tx=0x7fcdd0009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:56.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.773+0000 7fcddf426740 1 Processor -- start 2024-09-15T23:19:56.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.774+0000 7fcddf426740 1 -- start start 2024-09-15T23:19:56.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.774+0000 7fcddf426740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5620d5e74920 0x5620d5eba0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.774+0000 7fcddf426740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5620d5e720e0 0x5620d5e74d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.774+0000 7fcddf426740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5620d5e760b0 0x5620d5e6f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.774+0000 7fcddf426740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5620d5dd76f0 con 0x5620d5e760b0 2024-09-15T23:19:56.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.774+0000 7fcddf426740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5620d5d7f330 con 0x5620d5e720e0 2024-09-15T23:19:56.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.774+0000 7fcddf426740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5620d5dd36b0 con 0x5620d5e74920 2024-09-15T23:19:56.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.774+0000 7fcddab56640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5620d5e760b0 0x5620d5e6f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.774+0000 7fcddab56640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5620d5e760b0 0x5620d5e6f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57120/0 (socket says 172.21.15.123:57120) 2024-09-15T23:19:56.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.774+0000 7fcddab56640 1 -- 172.21.15.123:0/2198996178 learned_addr learned my addr 172.21.15.123:0/2198996178 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:56.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.774+0000 7fcdd9b54640 1 --2- 172.21.15.123:0/2198996178 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5620d5e720e0 0x5620d5e74d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.775+0000 7fcdda355640 1 --2- 172.21.15.123:0/2198996178 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5620d5e74920 0x5620d5eba0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.775+0000 7fcddab56640 1 -- 172.21.15.123:0/2198996178 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5620d5e74920 msgr2=0x5620d5eba0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:56.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.775+0000 7fcddab56640 1 --2- 172.21.15.123:0/2198996178 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5620d5e74920 0x5620d5eba0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.775+0000 7fcddab56640 1 -- 172.21.15.123:0/2198996178 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5620d5e720e0 msgr2=0x5620d5e74d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:56.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.775+0000 7fcddab56640 1 --2- 172.21.15.123:0/2198996178 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5620d5e720e0 0x5620d5e74d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.775+0000 7fcddab56640 1 -- 172.21.15.123:0/2198996178 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620d5da50d0 con 0x5620d5e760b0 2024-09-15T23:19:56.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.775+0000 7fcddab56640 1 --2- 172.21.15.123:0/2198996178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5620d5e760b0 0x5620d5e6f1a0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc009eb0 tx=0x7fcdcc02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4967436d8f5bd80b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:56.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.775+0000 7fcdb7fff640 1 -- 172.21.15.123:0/2198996178 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc003990 con 0x5620d5e760b0 2024-09-15T23:19:56.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.775+0000 7fcdb7fff640 1 -- 172.21.15.123:0/2198996178 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdcc003b30 con 0x5620d5e760b0 2024-09-15T23:19:56.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.775+0000 7fcdb7fff640 1 -- 172.21.15.123:0/2198996178 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc004040 con 0x5620d5e760b0 2024-09-15T23:19:56.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.776+0000 7fcddf426740 1 -- 172.21.15.123:0/2198996178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5620d5e760b0 msgr2=0x5620d5e6f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:56.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.776+0000 7fcddf426740 1 --2- 172.21.15.123:0/2198996178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5620d5e760b0 0x5620d5e6f1a0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc009eb0 tx=0x7fcdcc02e000 comp rx=0 tx=0).stop 2024-09-15T23:19:56.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.776+0000 7fcddf426740 1 -- 172.21.15.123:0/2198996178 shutdown_connections 2024-09-15T23:19:56.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.776+0000 7fcddf426740 1 --2- 172.21.15.123:0/2198996178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5620d5e760b0 0x5620d5e6f1a0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.776+0000 7fcddf426740 1 --2- 172.21.15.123:0/2198996178 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5620d5e720e0 0x5620d5e74d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.776+0000 7fcddf426740 1 --2- 172.21.15.123:0/2198996178 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5620d5e74920 0x5620d5eba0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.776+0000 7fcddf426740 1 -- 172.21.15.123:0/2198996178 >> 172.21.15.123:0/2198996178 conn(0x5620d5e71370 msgr2=0x5620d5eb9590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:56.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.776+0000 7fcddf426740 1 -- 172.21.15.123:0/2198996178 shutdown_connections 2024-09-15T23:19:56.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.776+0000 7fcddf426740 1 -- 172.21.15.123:0/2198996178 wait complete. 2024-09-15T23:19:56.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.776+0000 7fcddf426740 1 -- start start 2024-09-15T23:19:56.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.777+0000 7fcddf426740 1 Processor -- start 2024-09-15T23:19:56.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.777+0000 7fcddf426740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5620d5e74920 0x5620d5e94a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.777+0000 7fcddf426740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5620d5e760b0 0x5620d5eca720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.777+0000 7fcddf426740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5620d5ec9580 0x5620d5e9e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.777+0000 7fcddf426740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5620d5e70810 con 0x5620d5e74920 2024-09-15T23:19:56.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.777+0000 7fcddf426740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5620d5d604f0 con 0x5620d5e760b0 2024-09-15T23:19:56.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.777+0000 7fcddf426740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5620d5eba8f0 con 0x5620d5ec9580 2024-09-15T23:19:56.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.777+0000 7fcddf426740 10 client.0 _ll_register_callbacks cb 0x5620d5d81b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:19:56.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.778+0000 7fcdda355640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5620d5e74920 0x5620d5e94a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.778+0000 7fcdda355640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5620d5e74920 0x5620d5e94a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57126/0 (socket says 172.21.15.123:57126) 2024-09-15T23:19:56.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.778+0000 7fcdda355640 1 -- 172.21.15.123:0/2651448704 learned_addr learned my addr 172.21.15.123:0/2651448704 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:56.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.778+0000 7fcdd9b54640 1 --2- 172.21.15.123:0/2651448704 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5620d5e760b0 0x5620d5eca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.778+0000 7fcddab56640 1 --2- 172.21.15.123:0/2651448704 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5620d5ec9580 0x5620d5e9e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.778+0000 7fcdda355640 1 -- 172.21.15.123:0/2651448704 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5620d5ec9580 msgr2=0x5620d5e9e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:56.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.778+0000 7fcdda355640 1 --2- 172.21.15.123:0/2651448704 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5620d5ec9580 0x5620d5e9e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.778+0000 7fcdda355640 1 -- 172.21.15.123:0/2651448704 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5620d5e760b0 msgr2=0x5620d5eca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:56.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.778+0000 7fcdda355640 1 --2- 172.21.15.123:0/2651448704 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5620d5e760b0 0x5620d5eca720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.778+0000 7fcdda355640 1 -- 172.21.15.123:0/2651448704 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620d5bb47d0 con 0x5620d5e74920 2024-09-15T23:19:56.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.778+0000 7fcdda355640 1 --2- 172.21.15.123:0/2651448704 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5620d5e74920 0x5620d5e94a40 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0003640 tx=0x7fcdd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63bdc906f2bc5f94 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:56.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.778+0000 7fcdb57fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:19:56.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.778+0000 7fcdb57fa640 1 -- 172.21.15.123:0/2651448704 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd0027070 con 0x5620d5e74920 2024-09-15T23:19:56.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.778+0000 7fcdb57fa640 1 -- 172.21.15.123:0/2651448704 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fcdd0023480 con 0x5620d5e74920 2024-09-15T23:19:56.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.778+0000 7fcddf426740 1 -- 172.21.15.123:0/2651448704 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcdcc003b30 con 0x5620d5e74920 2024-09-15T23:19:56.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.778+0000 7fcdb57fa640 1 -- 172.21.15.123:0/2651448704 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fcdd0023680 con 0x5620d5e74920 2024-09-15T23:19:56.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.778+0000 7fcddf426740 10 client.8664 fetch_fsmap learned FSMap version 86 2024-09-15T23:19:56.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.778+0000 7fcddf426740 1 -- 172.21.15.123:0/2651448704 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) -- 0x5620d5aea3f0 con 0x5620d5e74920 2024-09-15T23:19:56.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.778+0000 7fcdb57fa640 1 -- 172.21.15.123:0/2651448704 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdcc003b30 con 0x5620d5e74920 2024-09-15T23:19:56.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.779+0000 7fcdb57fa640 1 -- 172.21.15.123:0/2651448704 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 86) ==== 3502+0+0 (secure 0 0 0) 0x7fcdd0035080 con 0x5620d5e74920 2024-09-15T23:19:56.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.779+0000 7fcddf426740 10 client.8664 fetch_fsmap finished waiting for FSMap version 86 2024-09-15T23:19:56.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.779+0000 7fcddf426740 10 client.8664 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.d 2024-09-15T23:19:56.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.779+0000 7fcddf426740 20 client.8664 populate_metadata read hostname 'smithi123' 2024-09-15T23:19:56.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.779+0000 7fcddf426740 1 --2- 172.21.15.123:0/2651448704 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x5620d5e73220 0x5620d5e73640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.779+0000 7fcddf426740 4 client.8664 mds_command: new command op to 8439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:19:56.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.779+0000 7fcddf426740 1 -- 172.21.15.123:0/2651448704 --> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5620d5de4e20 con 0x5620d5e73220 2024-09-15T23:19:56.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.779+0000 7fcdd9b54640 1 --2- 172.21.15.123:0/2651448704 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x5620d5e73220 0x5620d5e73640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.779+0000 7fcdb57fa640 10 client.8664 ms_handle_connect on v2:172.21.15.188:6835/1222656979 2024-09-15T23:19:56.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.779+0000 7fcdd9b54640 1 --2- 172.21.15.123:0/2651448704 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x5620d5e73220 0x5620d5e73640 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34727e71bfcd9c0d server_cookie=917068db1028c108 in_seq=0 out_seq=0 2024-09-15T23:19:56.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.780+0000 7fcdb57fa640 1 -- 172.21.15.123:0/2651448704 <== mds.0 v2:172.21.15.188:6835/1222656979 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5620d5de4e20 con 0x5620d5e73220 2024-09-15T23:19:56.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.780+0000 7fcdb57fa640 10 client.8664 handle_command_reply: tid=0 2024-09-15T23:19:56.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.780+0000 7fcddf426740 1 client.8664 shutdown 2024-09-15T23:19:56.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.780+0000 7fcddf426740 1 -- 172.21.15.123:0/2651448704 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5620d5e74920 msgr2=0x5620d5e94a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:56.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.780+0000 7fcddf426740 1 --2- 172.21.15.123:0/2651448704 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5620d5e74920 0x5620d5e94a40 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0003640 tx=0x7fcdd00046c0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.780+0000 7fcddf426740 1 -- 172.21.15.123:0/2651448704 shutdown_connections 2024-09-15T23:19:56.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.780+0000 7fcddf426740 1 --2- 172.21.15.123:0/2651448704 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x5620d5e73220 0x5620d5e73640 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.780+0000 7fcddf426740 1 --2- 172.21.15.123:0/2651448704 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5620d5ec9580 0x5620d5e9e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.780+0000 7fcddf426740 1 --2- 172.21.15.123:0/2651448704 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5620d5e760b0 0x5620d5eca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.780+0000 7fcdb57fa640 0 client.8664 ms_handle_reset on v2:172.21.15.188:6835/1222656979 2024-09-15T23:19:56.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.780+0000 7fcddf426740 1 --2- 172.21.15.123:0/2651448704 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5620d5e74920 0x5620d5e94a40 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.780+0000 7fcddf426740 1 -- 172.21.15.123:0/2651448704 >> 172.21.15.123:0/2651448704 conn(0x5620d5e720e0 msgr2=0x5620d5ebcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:56.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.780+0000 7fcddf426740 1 -- 172.21.15.123:0/2651448704 shutdown_connections 2024-09-15T23:19:56.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.780+0000 7fcddf426740 1 -- 172.21.15.123:0/2651448704 wait complete. 2024-09-15T23:19:56.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.780+0000 7fcddf426740 20 client.8664 trim_cache size 0 max 16384 2024-09-15T23:19:56.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.797+0000 7fcddf426740 1 Processor -- start 2024-09-15T23:19:56.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.797+0000 7fcddf426740 1 -- start start 2024-09-15T23:19:56.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.798+0000 7fcddf426740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5620d5e74920 0x5620d5eddbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.798+0000 7fcddf426740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5620d5e760b0 0x5620d5e9ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.798+0000 7fcddf426740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5620d5ec9580 0x5620d5e9d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.798+0000 7fcddf426740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5620d5e95510 con 0x5620d5ec9580 2024-09-15T23:19:56.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.798+0000 7fcddf426740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd42009d0 con 0x5620d5e74920 2024-09-15T23:19:56.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.798+0000 7fcddf426740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fcdd41ffa60 con 0x5620d5e760b0 2024-09-15T23:19:56.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.798+0000 7fcddab56640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5620d5ec9580 0x5620d5e9d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.798+0000 7fcddab56640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5620d5ec9580 0x5620d5e9d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57130/0 (socket says 172.21.15.123:57130) 2024-09-15T23:19:56.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.798+0000 7fcddab56640 1 -- 172.21.15.123:0/3727798308 learned_addr learned my addr 172.21.15.123:0/3727798308 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:56.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.798+0000 7fcdda355640 1 --2- 172.21.15.123:0/3727798308 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5620d5e74920 0x5620d5eddbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.798+0000 7fcdd9b54640 1 --2- 172.21.15.123:0/3727798308 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5620d5e760b0 0x5620d5e9ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.798+0000 7fcddab56640 1 -- 172.21.15.123:0/3727798308 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5620d5e760b0 msgr2=0x5620d5e9ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:56.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.798+0000 7fcddab56640 1 --2- 172.21.15.123:0/3727798308 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5620d5e760b0 0x5620d5e9ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.798+0000 7fcddab56640 1 -- 172.21.15.123:0/3727798308 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5620d5e74920 msgr2=0x5620d5eddbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:56.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.798+0000 7fcddab56640 1 --2- 172.21.15.123:0/3727798308 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5620d5e74920 0x5620d5eddbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.798+0000 7fcddab56640 1 -- 172.21.15.123:0/3727798308 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620d5aaa0f0 con 0x5620d5ec9580 2024-09-15T23:19:56.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.798+0000 7fcdd9b54640 1 --2- 172.21.15.123:0/3727798308 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5620d5e760b0 0x5620d5e9ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:19:56.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.799+0000 7fcddab56640 1 --2- 172.21.15.123:0/3727798308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5620d5ec9580 0x5620d5e9d230 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc007110 tx=0x7fcdcc030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d51b751ba6e05788 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:56.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.799+0000 7fcdb77fe640 1 -- 172.21.15.123:0/3727798308 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc003b90 con 0x5620d5ec9580 2024-09-15T23:19:56.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.799+0000 7fcdb77fe640 1 -- 172.21.15.123:0/3727798308 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdcc003d30 con 0x5620d5ec9580 2024-09-15T23:19:56.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.799+0000 7fcdb77fe640 1 -- 172.21.15.123:0/3727798308 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc004250 con 0x5620d5ec9580 2024-09-15T23:19:56.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.799+0000 7fcddf426740 1 -- 172.21.15.123:0/3727798308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5620d5ec9580 msgr2=0x5620d5e9d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:56.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.799+0000 7fcddf426740 1 --2- 172.21.15.123:0/3727798308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5620d5ec9580 0x5620d5e9d230 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc007110 tx=0x7fcdcc030000 comp rx=0 tx=0).stop 2024-09-15T23:19:56.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.799+0000 7fcddf426740 1 -- 172.21.15.123:0/3727798308 shutdown_connections 2024-09-15T23:19:56.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.799+0000 7fcddf426740 1 --2- 172.21.15.123:0/3727798308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5620d5ec9580 0x5620d5e9d230 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.799+0000 7fcddf426740 1 --2- 172.21.15.123:0/3727798308 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5620d5e760b0 0x5620d5e9ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.799+0000 7fcddf426740 1 --2- 172.21.15.123:0/3727798308 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5620d5e74920 0x5620d5eddbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.799+0000 7fcddf426740 1 -- 172.21.15.123:0/3727798308 >> 172.21.15.123:0/3727798308 conn(0x5620d5e720e0 msgr2=0x5620d5eb94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:56.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.799+0000 7fcddf426740 1 -- 172.21.15.123:0/3727798308 shutdown_connections 2024-09-15T23:19:56.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.799+0000 7fcddf426740 1 -- 172.21.15.123:0/3727798308 wait complete. 2024-09-15T23:19:56.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.800+0000 7fcddf426740 1 -- start start 2024-09-15T23:19:56.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.800+0000 7fcddf426740 1 Processor -- start 2024-09-15T23:19:56.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.801+0000 7fcddf426740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5620d5e74920 0x5620d5f3d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.801+0000 7fcddf426740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5620d5e760b0 0x5620d5e92880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.801+0000 7fcddf426740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5620d5ec9580 0x5620d5e92dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.801+0000 7fcddf426740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd41ff4a0 con 0x5620d5e760b0 2024-09-15T23:19:56.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.801+0000 7fcddf426740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd41f7c40 con 0x5620d5ec9580 2024-09-15T23:19:56.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.801+0000 7fcddf426740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5620d5e94b50 con 0x5620d5e74920 2024-09-15T23:19:56.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.801+0000 7fcddf426740 10 client.0 _ll_register_callbacks cb 0x7fcdd0004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:19:56.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.801+0000 7fcdd9b54640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5620d5e760b0 0x5620d5e92880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.801+0000 7fcdd9b54640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5620d5e760b0 0x5620d5e92880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57144/0 (socket says 172.21.15.123:57144) 2024-09-15T23:19:56.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.801+0000 7fcdd9b54640 1 -- 172.21.15.123:0/1083952155 learned_addr learned my addr 172.21.15.123:0/1083952155 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:56.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.801+0000 7fcdda355640 1 --2- 172.21.15.123:0/1083952155 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5620d5e74920 0x5620d5f3d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.801+0000 7fcddab56640 1 --2- 172.21.15.123:0/1083952155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5620d5ec9580 0x5620d5e92dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.801+0000 7fcdd9b54640 1 -- 172.21.15.123:0/1083952155 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5620d5e74920 msgr2=0x5620d5f3d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:56.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.801+0000 7fcdd9b54640 1 --2- 172.21.15.123:0/1083952155 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5620d5e74920 0x5620d5f3d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.801+0000 7fcdd9b54640 1 -- 172.21.15.123:0/1083952155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5620d5ec9580 msgr2=0x5620d5e92dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:56.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.801+0000 7fcdd9b54640 1 --2- 172.21.15.123:0/1083952155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5620d5ec9580 0x5620d5e92dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.801+0000 7fcdd9b54640 1 -- 172.21.15.123:0/1083952155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620d5eca980 con 0x5620d5e760b0 2024-09-15T23:19:56.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.801+0000 7fcdd9b54640 1 --2- 172.21.15.123:0/1083952155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5620d5e760b0 0x5620d5e92880 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4058730 tx=0x7fcdc4088a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f28546f64dda71a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:56.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.801+0000 7fcdb57fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:19:56.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.801+0000 7fcdb57fa640 1 -- 172.21.15.123:0/1083952155 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4058c00 con 0x5620d5e760b0 2024-09-15T23:19:56.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.801+0000 7fcdb57fa640 1 -- 172.21.15.123:0/1083952155 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fcdc4060e40 con 0x5620d5e760b0 2024-09-15T23:19:56.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.801+0000 7fcddf426740 1 -- 172.21.15.123:0/1083952155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcdcc003d30 con 0x5620d5e760b0 2024-09-15T23:19:56.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.801+0000 7fcdb57fa640 1 -- 172.21.15.123:0/1083952155 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fcdc4061040 con 0x5620d5e760b0 2024-09-15T23:19:56.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.801+0000 7fcddf426740 10 client.8670 fetch_fsmap learned FSMap version 86 2024-09-15T23:19:56.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.801+0000 7fcddf426740 1 -- 172.21.15.123:0/1083952155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) -- 0x5620d5eca6a0 con 0x5620d5e760b0 2024-09-15T23:19:56.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.802+0000 7fcdb57fa640 1 -- 172.21.15.123:0/1083952155 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdcc003d30 con 0x5620d5e760b0 2024-09-15T23:19:56.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.802+0000 7fcdb57fa640 1 -- 172.21.15.123:0/1083952155 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 86) ==== 3502+0+0 (secure 0 0 0) 0x7fcdc406cb80 con 0x5620d5e760b0 2024-09-15T23:19:56.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.802+0000 7fcddf426740 10 client.8670 fetch_fsmap finished waiting for FSMap version 86 2024-09-15T23:19:56.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.802+0000 7fcddf426740 10 client.8670 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.d 2024-09-15T23:19:56.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.802+0000 7fcddf426740 20 client.8670 populate_metadata read hostname 'smithi123' 2024-09-15T23:19:56.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.802+0000 7fcddf426740 1 --2- 172.21.15.123:0/1083952155 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x5620d5ebd3d0 0x5620d5f40490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.802+0000 7fcddf426740 4 client.8670 mds_command: new command op to 8439 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:19:56.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.802+0000 7fcddf426740 1 -- 172.21.15.123:0/1083952155 --> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5620d5ddf170 con 0x5620d5ebd3d0 2024-09-15T23:19:56.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.802+0000 7fcdda355640 1 --2- 172.21.15.123:0/1083952155 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x5620d5ebd3d0 0x5620d5f40490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.802+0000 7fcdda355640 1 --2- 172.21.15.123:0/1083952155 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x5620d5ebd3d0 0x5620d5f40490 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f8701c5b2ef373a server_cookie=23b0e45cd5fe0025 in_seq=0 out_seq=0 2024-09-15T23:19:56.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.802+0000 7fcdb57fa640 10 client.8670 ms_handle_connect on v2:172.21.15.188:6835/1222656979 2024-09-15T23:19:56.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.802+0000 7fcdb57fa640 1 -- 172.21.15.123:0/1083952155 <== mds.0 v2:172.21.15.188:6835/1222656979 1 ==== command_reply(tid 0: 0 ) ==== 8+0+69 (crc 0 0 0) 0x5620d5ddf170 con 0x5620d5ebd3d0 2024-09-15T23:19:56.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.802+0000 7fcdb57fa640 10 client.8670 handle_command_reply: tid=0 2024-09-15T23:19:56.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.802+0000 7fcddf426740 1 client.8670 shutdown 2024-09-15T23:19:56.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.802+0000 7fcddf426740 1 -- 172.21.15.123:0/1083952155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5620d5e760b0 msgr2=0x5620d5e92880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:56.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.803+0000 7fcddf426740 1 --2- 172.21.15.123:0/1083952155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5620d5e760b0 0x5620d5e92880 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4058730 tx=0x7fcdc4088a80 comp rx=0 tx=0).stop 2024-09-15T23:19:56.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.803+0000 7fcddf426740 1 -- 172.21.15.123:0/1083952155 shutdown_connections 2024-09-15T23:19:56.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.803+0000 7fcddf426740 1 --2- 172.21.15.123:0/1083952155 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x5620d5ebd3d0 0x5620d5f40490 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.803+0000 7fcddf426740 1 --2- 172.21.15.123:0/1083952155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5620d5ec9580 0x5620d5e92dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.803+0000 7fcddf426740 1 --2- 172.21.15.123:0/1083952155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5620d5e760b0 0x5620d5e92880 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.803+0000 7fcdb57fa640 0 client.8670 ms_handle_reset on v2:172.21.15.188:6835/1222656979 2024-09-15T23:19:56.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.803+0000 7fcddf426740 1 --2- 172.21.15.123:0/1083952155 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5620d5e74920 0x5620d5f3d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.803+0000 7fcddf426740 1 -- 172.21.15.123:0/1083952155 >> 172.21.15.123:0/1083952155 conn(0x5620d5e720e0 msgr2=0x5620d5e9ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:56.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.803+0000 7fcddf426740 1 -- 172.21.15.123:0/1083952155 shutdown_connections 2024-09-15T23:19:56.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.803+0000 7fcddf426740 1 -- 172.21.15.123:0/1083952155 wait complete. 2024-09-15T23:19:56.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.803+0000 7fcddf426740 20 client.8670 trim_cache size 0 max 16384 2024-09-15T23:19:56.813 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:19:56.813 INFO:teuthology.orchestra.run.smithi123.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-15T23:19:56.813 INFO:teuthology.orchestra.run.smithi123.stdout: "scrubs": {} 2024-09-15T23:19:56.813 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:19:56.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.803+0000 7fcddc5b9640 1 -- 172.21.15.123:0/940934280 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcdb806c2b0 msgr2=0x7fcdb806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:56.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.803+0000 7fcddc5b9640 1 --2- 172.21.15.123:0/940934280 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcdb806c2b0 0x7fcdb806e770 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fcdd40ba270 tx=0x7fcdd0009190 comp rx=0 tx=0).stop 2024-09-15T23:19:56.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.803+0000 7fcddc5b9640 1 -- 172.21.15.123:0/940934280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcdd40b3350 msgr2=0x7fcdd415dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:56.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.803+0000 7fcddc5b9640 1 --2- 172.21.15.123:0/940934280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcdd40b3350 0x7fcdd415dab0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fcdc400c460 tx=0x7fcdc400c920 comp rx=0 tx=0).stop 2024-09-15T23:19:56.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.803+0000 7fcddc5b9640 1 -- 172.21.15.123:0/940934280 shutdown_connections 2024-09-15T23:19:56.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.803+0000 7fcddc5b9640 1 --2- 172.21.15.123:0/940934280 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcdd40d3930 0x7fcdd40abe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.803+0000 7fcddc5b9640 1 --2- 172.21.15.123:0/940934280 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcdb806c2b0 0x7fcdb806e770 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.803+0000 7fcddc5b9640 1 --2- 172.21.15.123:0/940934280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcdd40b3350 0x7fcdd415dab0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.803+0000 7fcddc5b9640 1 --2- 172.21.15.123:0/940934280 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcdd406bfd0 0x7fcdd41f49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.803+0000 7fcddc5b9640 1 -- 172.21.15.123:0/940934280 >> 172.21.15.123:0/940934280 conn(0x7fcdd40d11c0 msgr2=0x7fcdd40b4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:56.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.803+0000 7fcddc5b9640 1 -- 172.21.15.123:0/940934280 shutdown_connections 2024-09-15T23:19:56.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.803+0000 7fcddc5b9640 1 -- 172.21.15.123:0/940934280 wait complete. 2024-09-15T23:19:56.818 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:19:56.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.915+0000 7f5a522d0640 1 Processor -- start 2024-09-15T23:19:56.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.915+0000 7f5a522d0640 1 -- start start 2024-09-15T23:19:56.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.916+0000 7f5a522d0640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f5a4c15c610 0x7f5a4c06f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.916+0000 7f5a522d0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a4c06eaf0 0x7f5a4c06f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.916+0000 7f5a522d0640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a4c072e50 con 0x7f5a4c06dea0 2024-09-15T23:19:56.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.916+0000 7f5a522d0640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f5a4c06e3d0 con 0x7f5a4c15c610 2024-09-15T23:19:56.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.916+0000 7f5a522d0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5a4c06e6b0 con 0x7f5a4c06eaf0 2024-09-15T23:19:56.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.917+0000 7f5a5086d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a4c06eaf0 0x7f5a4c06f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.917+0000 7f5a4bfff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f5a4c15c610 0x7f5a4c06f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.917+0000 7f5a4b7fe640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f5a4c06dea0 0x7f5a4c160220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:35986/0 (socket says 172.21.15.123:35986) 2024-09-15T23:19:56.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.917+0000 7f5a4b7fe640 1 -- 172.21.15.123:0/848507621 learned_addr learned my addr 172.21.15.123:0/848507621 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:19:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.917+0000 7f5a5086d640 1 -- 172.21.15.123:0/848507621 >> v2:172.21.15.188:3300/0 conn(0x7f5a4c15c610 msgr2=0x7f5a4c06f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.917+0000 7f5a5086d640 1 --2- 172.21.15.123:0/848507621 >> v2:172.21.15.188:3300/0 conn(0x7f5a4c15c610 0x7f5a4c06f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.917+0000 7f5a5086d640 1 -- 172.21.15.123:0/848507621 >> v1:172.21.15.188:6789/0 conn(0x7f5a4c06dea0 legacy=0x7f5a4c160220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.917+0000 7f5a4affd640 1 -- 172.21.15.123:0/848507621 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1015917817 0 0) 0x7f5a4c072e50 con 0x7f5a4c06dea0 2024-09-15T23:19:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.917+0000 7f5a5086d640 1 -- 172.21.15.123:0/848507621 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a4c071640 con 0x7f5a4c06eaf0 2024-09-15T23:19:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.917+0000 7f5a4bfff640 1 --2- 172.21.15.123:0/848507621 >> v2:172.21.15.188:3300/0 conn(0x7f5a4c15c610 0x7f5a4c06f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:19:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.918+0000 7f5a5086d640 1 --2- 172.21.15.123:0/848507621 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a4c06eaf0 0x7f5a4c06f730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5a44009d90 tx=0x7f5a4402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdaa95059d94fc12 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.918+0000 7f5a4affd640 1 -- 172.21.15.123:0/848507621 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a44031600 con 0x7f5a4c06eaf0 2024-09-15T23:19:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.918+0000 7f5a4affd640 1 -- 172.21.15.123:0/848507621 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a440317a0 con 0x7f5a4c06eaf0 2024-09-15T23:19:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.918+0000 7f5a4affd640 1 -- 172.21.15.123:0/848507621 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a44031b70 con 0x7f5a4c06eaf0 2024-09-15T23:19:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.919+0000 7f5a522d0640 1 -- 172.21.15.123:0/848507621 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a4c06eaf0 msgr2=0x7f5a4c06f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.919+0000 7f5a522d0640 1 --2- 172.21.15.123:0/848507621 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a4c06eaf0 0x7f5a4c06f730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5a44009d90 tx=0x7f5a4402a5d0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.919+0000 7f5a522d0640 1 -- 172.21.15.123:0/848507621 shutdown_connections 2024-09-15T23:19:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.919+0000 7f5a522d0640 1 --2- 172.21.15.123:0/848507621 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a4c06eaf0 0x7f5a4c06f730 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.919+0000 7f5a522d0640 1 --2- 172.21.15.123:0/848507621 >> v2:172.21.15.188:3300/0 conn(0x7f5a4c15c610 0x7f5a4c06f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.919+0000 7f5a522d0640 1 -- 172.21.15.123:0/848507621 >> 172.21.15.123:0/848507621 conn(0x7f5a4c06c240 msgr2=0x7f5a4c0b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.919+0000 7f5a522d0640 1 -- 172.21.15.123:0/848507621 shutdown_connections 2024-09-15T23:19:56.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.919+0000 7f5a522d0640 1 -- 172.21.15.123:0/848507621 wait complete. 2024-09-15T23:19:56.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.920+0000 7f5a522d0640 1 Processor -- start 2024-09-15T23:19:56.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.920+0000 7f5a522d0640 1 -- start start 2024-09-15T23:19:56.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.921+0000 7f5a522d0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5a4c06dea0 0x7f5a4c15e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.921+0000 7f5a522d0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a4c06eaf0 0x7f5a4c156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.921+0000 7f5a522d0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a4c15c610 0x7f5a4c142180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.921+0000 7f5a522d0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4c0b2ef0 con 0x7f5a4c15c610 2024-09-15T23:19:56.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.921+0000 7f5a522d0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4c0b2d70 con 0x7f5a4c06dea0 2024-09-15T23:19:56.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.921+0000 7f5a522d0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5a4c0ce710 con 0x7f5a4c06eaf0 2024-09-15T23:19:56.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.921+0000 7f5a5086d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a4c15c610 0x7f5a4c142180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.921+0000 7f5a5086d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a4c15c610 0x7f5a4c142180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57152/0 (socket says 172.21.15.123:57152) 2024-09-15T23:19:56.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.921+0000 7f5a5086d640 1 -- 172.21.15.123:0/1181541742 learned_addr learned my addr 172.21.15.123:0/1181541742 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:56.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.921+0000 7f5a4b7fe640 1 --2- 172.21.15.123:0/1181541742 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a4c06eaf0 0x7f5a4c156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.921+0000 7f5a4bfff640 1 --2- 172.21.15.123:0/1181541742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5a4c06dea0 0x7f5a4c15e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.922+0000 7f5a5086d640 1 -- 172.21.15.123:0/1181541742 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a4c06eaf0 msgr2=0x7f5a4c156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:56.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.922+0000 7f5a5086d640 1 --2- 172.21.15.123:0/1181541742 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a4c06eaf0 0x7f5a4c156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.922+0000 7f5a5086d640 1 -- 172.21.15.123:0/1181541742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5a4c06dea0 msgr2=0x7f5a4c15e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:56.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.922+0000 7f5a5086d640 1 --2- 172.21.15.123:0/1181541742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5a4c06dea0 0x7f5a4c15e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:56.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.922+0000 7f5a5086d640 1 -- 172.21.15.123:0/1181541742 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a4c15e900 con 0x7f5a4c15c610 2024-09-15T23:19:56.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.922+0000 7f5a4b7fe640 1 --2- 172.21.15.123:0/1181541742 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a4c06eaf0 0x7f5a4c156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:19:56.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.922+0000 7f5a4bfff640 1 --2- 172.21.15.123:0/1181541742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5a4c06dea0 0x7f5a4c15e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:19:56.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.922+0000 7f5a5086d640 1 --2- 172.21.15.123:0/1181541742 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a4c15c610 0x7f5a4c142180 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f5a44009eb0 tx=0x7f5a44004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:56.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.922+0000 7f5a48ff9640 1 -- 172.21.15.123:0/1181541742 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a44040070 con 0x7f5a4c15c610 2024-09-15T23:19:56.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.922+0000 7f5a48ff9640 1 -- 172.21.15.123:0/1181541742 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a44030be0 con 0x7f5a4c15c610 2024-09-15T23:19:56.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.922+0000 7f5a522d0640 1 -- 172.21.15.123:0/1181541742 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a4c15ec40 con 0x7f5a4c15c610 2024-09-15T23:19:56.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.922+0000 7f5a48ff9640 1 -- 172.21.15.123:0/1181541742 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a44009450 con 0x7f5a4c15c610 2024-09-15T23:19:56.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.922+0000 7f5a522d0640 1 -- 172.21.15.123:0/1181541742 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a4c15f480 con 0x7f5a4c15c610 2024-09-15T23:19:56.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.923+0000 7f5a522d0640 1 -- 172.21.15.123:0/1181541742 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a4c15f680 con 0x7f5a4c15c610 2024-09-15T23:19:56.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.923+0000 7f5a48ff9640 1 -- 172.21.15.123:0/1181541742 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5a44039040 con 0x7f5a4c15c610 2024-09-15T23:19:56.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.924+0000 7f5a48ff9640 1 --2- 172.21.15.123:0/1181541742 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5a3806c2b0 0x7f5a3806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:56.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.924+0000 7f5a48ff9640 1 -- 172.21.15.123:0/1181541742 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f5a440abfd0 con 0x7f5a4c15c610 2024-09-15T23:19:56.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.924+0000 7f5a4bfff640 1 --2- 172.21.15.123:0/1181541742 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5a3806c2b0 0x7f5a3806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:56.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.925+0000 7f5a4bfff640 1 --2- 172.21.15.123:0/1181541742 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5a3806c2b0 0x7f5a3806e770 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c009560 tx=0x7f5a3c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:56.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:56.928+0000 7f5a48ff9640 1 -- 172.21.15.123:0/1181541742 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5a4c15ec40 con 0x7f5a4c15c610 2024-09-15T23:19:57.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.127+0000 7f5a522d0640 1 -- 172.21.15.123:0/1181541742 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a4c06f1f0 con 0x7f5a4c15c610 2024-09-15T23:19:57.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.127+0000 7f5a48ff9640 1 -- 172.21.15.123:0/1181541742 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5237 (secure 0 0 0) 0x7f5a4407a0f0 con 0x7f5a4c15c610 2024-09-15T23:19:57.128 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:19:57.129 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":86,"btime":"2024-09-15T23:19:37:619526+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2082746470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2082746470},{"type":"v1","addr":"172.21.15.123:6834","nonce":2082746470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8421,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2007610603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":2007610603},{"type":"v1","addr":"172.21.15.123:6835","nonce":2007610603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8436,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2929123975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2929123975},{"type":"v1","addr":"172.21.15.188:6836","nonce":2929123975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:19:34.917419+0000","modified":"2024-09-15T23:19:36.941347+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8439":{"gid":8439,"name":"d","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6837/1222656979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1222656979},{"type":"v1","addr":"172.21.15.188:6837","nonce":1222656979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8439,"qdb_cluster":[8439]},"id":9}]} 2024-09-15T23:19:57.129 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 86 2024-09-15T23:19:57.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.129+0000 7f5a522d0640 1 -- 172.21.15.123:0/1181541742 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5a3806c2b0 msgr2=0x7f5a3806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:57.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.129+0000 7f5a522d0640 1 --2- 172.21.15.123:0/1181541742 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5a3806c2b0 0x7f5a3806e770 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c009560 tx=0x7f5a3c009190 comp rx=0 tx=0).stop 2024-09-15T23:19:57.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.129+0000 7f5a522d0640 1 -- 172.21.15.123:0/1181541742 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a4c15c610 msgr2=0x7f5a4c142180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:57.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.129+0000 7f5a522d0640 1 --2- 172.21.15.123:0/1181541742 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a4c15c610 0x7f5a4c142180 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f5a44009eb0 tx=0x7f5a44004a40 comp rx=0 tx=0).stop 2024-09-15T23:19:57.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.129+0000 7f5a522d0640 1 -- 172.21.15.123:0/1181541742 shutdown_connections 2024-09-15T23:19:57.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.129+0000 7f5a522d0640 1 --2- 172.21.15.123:0/1181541742 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5a3806c2b0 0x7f5a3806e770 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:57.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.129+0000 7f5a522d0640 1 --2- 172.21.15.123:0/1181541742 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a4c15c610 0x7f5a4c142180 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:57.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.129+0000 7f5a522d0640 1 --2- 172.21.15.123:0/1181541742 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a4c06eaf0 0x7f5a4c156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:57.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.129+0000 7f5a522d0640 1 --2- 172.21.15.123:0/1181541742 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5a4c06dea0 0x7f5a4c15e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:57.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.129+0000 7f5a522d0640 1 -- 172.21.15.123:0/1181541742 >> 172.21.15.123:0/1181541742 conn(0x7f5a4c06c240 msgr2=0x7f5a4c0b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:57.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.130+0000 7f5a522d0640 1 -- 172.21.15.123:0/1181541742 shutdown_connections 2024-09-15T23:19:57.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.130+0000 7f5a522d0640 1 -- 172.21.15.123:0/1181541742 wait complete. 2024-09-15T23:19:57.141 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-15T23:19:57.141 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:19:57.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.238+0000 7fd65e52a640 1 Processor -- start 2024-09-15T23:19:57.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.238+0000 7fd65e52a640 1 -- start start 2024-09-15T23:19:57.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.239+0000 7fd65e52a640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd65806bc10 0x7fd65806bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:57.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.239+0000 7fd65e52a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd6580cef60 0x7fd65815eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:57.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.239+0000 7fd65e52a640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd65806c530 con 0x7fd6580b3790 2024-09-15T23:19:57.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.239+0000 7fd65e52a640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fd6580cd690 con 0x7fd6580cef60 2024-09-15T23:19:57.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.239+0000 7fd65e52a640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fd6580d06f0 con 0x7fd65806bc10 2024-09-15T23:19:57.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.239+0000 7fd6577fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd6580cef60 0x7fd65815eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:57.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.239+0000 7fd6577fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd6580cef60 0x7fd65815eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57160/0 (socket says 172.21.15.123:57160) 2024-09-15T23:19:57.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.239+0000 7fd6577fe640 1 -- 172.21.15.123:0/1166612597 learned_addr learned my addr 172.21.15.123:0/1166612597 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:57.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.239+0000 7fd657fff640 1 --2- 172.21.15.123:0/1166612597 >> v2:172.21.15.188:3300/0 conn(0x7fd65806bc10 0x7fd65806bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:57.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.239+0000 7fd6577fe640 1 -- 172.21.15.123:0/1166612597 >> v2:172.21.15.188:3300/0 conn(0x7fd65806bc10 msgr2=0x7fd65806bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:57.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.239+0000 7fd6577fe640 1 --2- 172.21.15.123:0/1166612597 >> v2:172.21.15.188:3300/0 conn(0x7fd65806bc10 0x7fd65806bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:57.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.239+0000 7fd6577fe640 1 -- 172.21.15.123:0/1166612597 >> v1:172.21.15.188:6789/0 conn(0x7fd6580b3790 legacy=0x7fd6580b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:57.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.239+0000 7fd6577fe640 1 -- 172.21.15.123:0/1166612597 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd65815f060 con 0x7fd6580cef60 2024-09-15T23:19:57.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.240+0000 7fd6577fe640 1 --2- 172.21.15.123:0/1166612597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6580cef60 0x7fd65815eb20 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fd65806cc70 tx=0x7fd64c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=622470c904412204 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:57.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.240+0000 7fd656ffd640 1 -- 172.21.15.123:0/1166612597 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd64c037070 con 0x7fd6580cef60 2024-09-15T23:19:57.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.240+0000 7fd656ffd640 1 -- 172.21.15.123:0/1166612597 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd64c032440 con 0x7fd6580cef60 2024-09-15T23:19:57.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.240+0000 7fd656ffd640 1 -- 172.21.15.123:0/1166612597 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd64c032810 con 0x7fd6580cef60 2024-09-15T23:19:57.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.241+0000 7fd65e52a640 1 -- 172.21.15.123:0/1166612597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6580cef60 msgr2=0x7fd65815eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:57.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.241+0000 7fd65e52a640 1 --2- 172.21.15.123:0/1166612597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6580cef60 0x7fd65815eb20 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fd65806cc70 tx=0x7fd64c02a2a0 comp rx=0 tx=0).stop 2024-09-15T23:19:57.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.241+0000 7fd65e52a640 1 -- 172.21.15.123:0/1166612597 shutdown_connections 2024-09-15T23:19:57.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.241+0000 7fd65e52a640 1 --2- 172.21.15.123:0/1166612597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6580cef60 0x7fd65815eb20 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:57.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.241+0000 7fd65e52a640 1 --2- 172.21.15.123:0/1166612597 >> v2:172.21.15.188:3300/0 conn(0x7fd65806bc10 0x7fd65806bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:57.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.241+0000 7fd65e52a640 1 -- 172.21.15.123:0/1166612597 >> 172.21.15.123:0/1166612597 conn(0x7fd65806cd20 msgr2=0x7fd65806d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:57.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.241+0000 7fd65e52a640 1 -- 172.21.15.123:0/1166612597 shutdown_connections 2024-09-15T23:19:57.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.241+0000 7fd65e52a640 1 -- 172.21.15.123:0/1166612597 wait complete. 2024-09-15T23:19:57.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.242+0000 7fd65e52a640 1 Processor -- start 2024-09-15T23:19:57.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.242+0000 7fd65e52a640 1 -- start start 2024-09-15T23:19:57.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.243+0000 7fd65e52a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd65806bc10 0x7fd6581f55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:57.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.243+0000 7fd65e52a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6580b3790 0x7fd6581f4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:57.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.243+0000 7fd65e52a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6580cef60 0x7fd6580aa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:57.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.243+0000 7fd65e52a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd6580d0c30 con 0x7fd6580b3790 2024-09-15T23:19:57.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.243+0000 7fd65e52a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd6580d0950 con 0x7fd6580cef60 2024-09-15T23:19:57.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.243+0000 7fd65e52a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd6580d0f10 con 0x7fd65806bc10 2024-09-15T23:19:57.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.243+0000 7fd6577fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6580b3790 0x7fd6581f4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:57.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.243+0000 7fd6577fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6580b3790 0x7fd6581f4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57176/0 (socket says 172.21.15.123:57176) 2024-09-15T23:19:57.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.243+0000 7fd6577fe640 1 -- 172.21.15.123:0/3838032765 learned_addr learned my addr 172.21.15.123:0/3838032765 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:57.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.243+0000 7fd657fff640 1 --2- 172.21.15.123:0/3838032765 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd65806bc10 0x7fd6581f55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:57.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.243+0000 7fd65cac7640 1 --2- 172.21.15.123:0/3838032765 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6580cef60 0x7fd6580aa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:57.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.243+0000 7fd6577fe640 1 -- 172.21.15.123:0/3838032765 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd65806bc10 msgr2=0x7fd6581f55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:57.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.243+0000 7fd6577fe640 1 --2- 172.21.15.123:0/3838032765 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd65806bc10 0x7fd6581f55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:57.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.243+0000 7fd6577fe640 1 -- 172.21.15.123:0/3838032765 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6580cef60 msgr2=0x7fd6580aa5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:57.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.243+0000 7fd6577fe640 1 --2- 172.21.15.123:0/3838032765 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6580cef60 0x7fd6580aa5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:57.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.243+0000 7fd6577fe640 1 -- 172.21.15.123:0/3838032765 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6581f53a0 con 0x7fd6580b3790 2024-09-15T23:19:57.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.244+0000 7fd6577fe640 1 --2- 172.21.15.123:0/3838032765 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6580b3790 0x7fd6581f4e60 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fd64c02a2e0 tx=0x7fd64c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:57.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.244+0000 7fd654ff9640 1 -- 172.21.15.123:0/3838032765 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd64c041030 con 0x7fd6580b3790 2024-09-15T23:19:57.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.244+0000 7fd654ff9640 1 -- 172.21.15.123:0/3838032765 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd64c030440 con 0x7fd6580b3790 2024-09-15T23:19:57.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.244+0000 7fd654ff9640 1 -- 172.21.15.123:0/3838032765 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd64c037040 con 0x7fd6580b3790 2024-09-15T23:19:57.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.244+0000 7fd65e52a640 1 -- 172.21.15.123:0/3838032765 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6581f5bd0 con 0x7fd6580b3790 2024-09-15T23:19:57.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.244+0000 7fd65e52a640 1 -- 172.21.15.123:0/3838032765 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6581f6190 con 0x7fd6580b3790 2024-09-15T23:19:57.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.245+0000 7fd65e52a640 1 -- 172.21.15.123:0/3838032765 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6580b3bc0 con 0x7fd6580b3790 2024-09-15T23:19:57.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.245+0000 7fd654ff9640 1 -- 172.21.15.123:0/3838032765 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd64c044070 con 0x7fd6580b3790 2024-09-15T23:19:57.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.246+0000 7fd654ff9640 1 --2- 172.21.15.123:0/3838032765 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd64406c2b0 0x7fd64406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:57.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.246+0000 7fd654ff9640 1 -- 172.21.15.123:0/3838032765 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fd64c0ab6e0 con 0x7fd6580b3790 2024-09-15T23:19:57.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.246+0000 7fd657fff640 1 --2- 172.21.15.123:0/3838032765 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd64406c2b0 0x7fd64406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:57.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.247+0000 7fd657fff640 1 --2- 172.21.15.123:0/3838032765 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd64406c2b0 0x7fd64406e770 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fd648009b40 tx=0x7fd648009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:57.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.250+0000 7fd654ff9640 1 -- 172.21.15.123:0/3838032765 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd64c04b070 con 0x7fd6580b3790 2024-09-15T23:19:57.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.480+0000 7fd65e52a640 1 -- 172.21.15.123:0/3838032765 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fd658072f20 con 0x7fd6580b3790 2024-09-15T23:19:57.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.480+0000 7fd654ff9640 1 -- 172.21.15.123:0/3838032765 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1486 (secure 0 0 0) 0x7fd64c079800 con 0x7fd6580b3790 2024-09-15T23:19:57.482 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:19:57.482 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":488,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":142,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":698,"data_bytes":708589930,"bytes_used":1710686208,"bytes_avail":771383427072,"bytes_total":773094113280,"write_bytes_sec":58993521,"read_op_per_sec":0,"write_op_per_sec":58},"fsmap":{"epoch":86,"btime":"2024-09-15T23:19:37:619526+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"d","status":"up:active","gid":8439}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-09-15T23:19:25.606748+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T23:19:57.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.482+0000 7fd65e52a640 1 -- 172.21.15.123:0/3838032765 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd64406c2b0 msgr2=0x7fd64406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:57.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.482+0000 7fd65e52a640 1 --2- 172.21.15.123:0/3838032765 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd64406c2b0 0x7fd64406e770 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fd648009b40 tx=0x7fd648009190 comp rx=0 tx=0).stop 2024-09-15T23:19:57.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.482+0000 7fd65e52a640 1 -- 172.21.15.123:0/3838032765 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6580b3790 msgr2=0x7fd6581f4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:57.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.482+0000 7fd65e52a640 1 --2- 172.21.15.123:0/3838032765 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6580b3790 0x7fd6581f4e60 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fd64c02a2e0 tx=0x7fd64c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:19:57.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.482+0000 7fd65e52a640 1 -- 172.21.15.123:0/3838032765 shutdown_connections 2024-09-15T23:19:57.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.482+0000 7fd65e52a640 1 --2- 172.21.15.123:0/3838032765 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6580cef60 0x7fd6580aa5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:57.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.482+0000 7fd65e52a640 1 --2- 172.21.15.123:0/3838032765 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd64406c2b0 0x7fd64406e770 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:57.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.482+0000 7fd65e52a640 1 --2- 172.21.15.123:0/3838032765 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6580b3790 0x7fd6581f4e60 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:57.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.482+0000 7fd65e52a640 1 --2- 172.21.15.123:0/3838032765 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd65806bc10 0x7fd6581f55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:57.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.482+0000 7fd65e52a640 1 -- 172.21.15.123:0/3838032765 >> 172.21.15.123:0/3838032765 conn(0x7fd65806cd20 msgr2=0x7fd658160230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:57.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.483+0000 7fd65e52a640 1 -- 172.21.15.123:0/3838032765 shutdown_connections 2024-09-15T23:19:57.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:57.483+0000 7fd65e52a640 1 -- 172.21.15.123:0/3838032765 wait complete. 2024-09-15T23:19:57.494 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-15T23:19:58.495 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:19:58.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.605+0000 7f53c63c0640 1 Processor -- start 2024-09-15T23:19:58.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.605+0000 7f53c63c0640 1 -- start start 2024-09-15T23:19:58.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.606+0000 7f53c63c0640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f53c00cef60 0x7f53c015eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:58.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.606+0000 7f53c63c0640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f53c00b3790 0x7f53c01624e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:58.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.606+0000 7f53c63c0640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53c015f060 con 0x7f53c006bc10 2024-09-15T23:19:58.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.606+0000 7f53c63c0640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f53c00cd690 con 0x7f53c00b3790 2024-09-15T23:19:58.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.606+0000 7f53c63c0640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f53c00d06f0 con 0x7f53c00cef60 2024-09-15T23:19:58.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.606+0000 7f53c495d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f53c00b3790 0x7f53c01624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:58.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.606+0000 7f53c495d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f53c00b3790 0x7f53c01624e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57188/0 (socket says 172.21.15.123:57188) 2024-09-15T23:19:58.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.606+0000 7f53c495d640 1 -- 172.21.15.123:0/1638125359 learned_addr learned my addr 172.21.15.123:0/1638125359 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:58.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.606+0000 7f53bf7fe640 1 --2- 172.21.15.123:0/1638125359 >> v2:172.21.15.188:3300/0 conn(0x7f53c00cef60 0x7f53c015eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:58.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.606+0000 7f53c495d640 1 -- 172.21.15.123:0/1638125359 >> v2:172.21.15.188:3300/0 conn(0x7f53c00cef60 msgr2=0x7f53c015eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:58.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.606+0000 7f53c495d640 1 --2- 172.21.15.123:0/1638125359 >> v2:172.21.15.188:3300/0 conn(0x7f53c00cef60 0x7f53c015eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:58.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.607+0000 7f53c495d640 1 -- 172.21.15.123:0/1638125359 >> v1:172.21.15.188:6789/0 conn(0x7f53c006bc10 legacy=0x7f53c006bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:58.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.607+0000 7f53c495d640 1 -- 172.21.15.123:0/1638125359 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c00b4090 con 0x7f53c00b3790 2024-09-15T23:19:58.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.607+0000 7f53c495d640 1 --2- 172.21.15.123:0/1638125359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53c00b3790 0x7f53c01624e0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f53b8009e80 tx=0x7f53b802a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28dd0abcec96c20 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:58.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.607+0000 7f53beffd640 1 -- 172.21.15.123:0/1638125359 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b8036070 con 0x7f53c00b3790 2024-09-15T23:19:58.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.607+0000 7f53beffd640 1 -- 172.21.15.123:0/1638125359 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53b8031600 con 0x7f53c00b3790 2024-09-15T23:19:58.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.607+0000 7f53beffd640 1 -- 172.21.15.123:0/1638125359 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b80319d0 con 0x7f53c00b3790 2024-09-15T23:19:58.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.608+0000 7f53c63c0640 1 -- 172.21.15.123:0/1638125359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53c00b3790 msgr2=0x7f53c01624e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:58.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.608+0000 7f53c63c0640 1 --2- 172.21.15.123:0/1638125359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53c00b3790 0x7f53c01624e0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f53b8009e80 tx=0x7f53b802a750 comp rx=0 tx=0).stop 2024-09-15T23:19:58.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.608+0000 7f53c63c0640 1 -- 172.21.15.123:0/1638125359 shutdown_connections 2024-09-15T23:19:58.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.608+0000 7f53c63c0640 1 --2- 172.21.15.123:0/1638125359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53c00b3790 0x7f53c01624e0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:58.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.608+0000 7f53c63c0640 1 --2- 172.21.15.123:0/1638125359 >> v2:172.21.15.188:3300/0 conn(0x7f53c00cef60 0x7f53c015eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:58.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.608+0000 7f53c63c0640 1 -- 172.21.15.123:0/1638125359 >> 172.21.15.123:0/1638125359 conn(0x7f53c006cd20 msgr2=0x7f53c006d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:58.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.608+0000 7f53c63c0640 1 -- 172.21.15.123:0/1638125359 shutdown_connections 2024-09-15T23:19:58.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.608+0000 7f53c63c0640 1 -- 172.21.15.123:0/1638125359 wait complete. 2024-09-15T23:19:58.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.609+0000 7f53c63c0640 1 Processor -- start 2024-09-15T23:19:58.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.609+0000 7f53c63c0640 1 -- start start 2024-09-15T23:19:58.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.610+0000 7f53c63c0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53c006bc10 0x7f53c015a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:58.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.610+0000 7f53c63c0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53c00b3790 0x7f53c01f55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:58.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.610+0000 7f53c63c0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f53c00cef60 0x7f53c00b4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:58.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.610+0000 7f53c63c0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f53c00d0f10 con 0x7f53c006bc10 2024-09-15T23:19:58.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.610+0000 7f53c63c0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f53c00d0c30 con 0x7f53c00b3790 2024-09-15T23:19:58.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.610+0000 7f53c63c0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f53c00b3be0 con 0x7f53c00cef60 2024-09-15T23:19:58.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.610+0000 7f53bffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53c006bc10 0x7f53c015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:58.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.610+0000 7f53bffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53c006bc10 0x7f53c015a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57196/0 (socket says 172.21.15.123:57196) 2024-09-15T23:19:58.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.610+0000 7f53bffff640 1 -- 172.21.15.123:0/272722383 learned_addr learned my addr 172.21.15.123:0/272722383 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:58.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.610+0000 7f53bf7fe640 1 --2- 172.21.15.123:0/272722383 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53c00b3790 0x7f53c01f55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:58.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.610+0000 7f53c495d640 1 --2- 172.21.15.123:0/272722383 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f53c00cef60 0x7f53c00b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:58.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.611+0000 7f53bffff640 1 -- 172.21.15.123:0/272722383 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f53c00cef60 msgr2=0x7f53c00b4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:58.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.611+0000 7f53bffff640 1 --2- 172.21.15.123:0/272722383 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f53c00cef60 0x7f53c00b4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:58.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.611+0000 7f53bffff640 1 -- 172.21.15.123:0/272722383 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53c00b3790 msgr2=0x7f53c01f55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:58.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.611+0000 7f53bffff640 1 --2- 172.21.15.123:0/272722383 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53c00b3790 0x7f53c01f55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:58.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.611+0000 7f53bffff640 1 -- 172.21.15.123:0/272722383 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c01f5d60 con 0x7f53c006bc10 2024-09-15T23:19:58.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.611+0000 7f53bffff640 1 --2- 172.21.15.123:0/272722383 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53c006bc10 0x7f53c015a930 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f53b000c430 tx=0x7f53b000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:58.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.611+0000 7f53bcff9640 1 -- 172.21.15.123:0/272722383 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b0011790 con 0x7f53c006bc10 2024-09-15T23:19:58.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.611+0000 7f53bcff9640 1 -- 172.21.15.123:0/272722383 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53b0017070 con 0x7f53c006bc10 2024-09-15T23:19:58.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.611+0000 7f53c63c0640 1 -- 172.21.15.123:0/272722383 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53c01f6040 con 0x7f53c006bc10 2024-09-15T23:19:58.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.611+0000 7f53bcff9640 1 -- 172.21.15.123:0/272722383 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b0011bb0 con 0x7f53c006bc10 2024-09-15T23:19:58.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.611+0000 7f53c63c0640 1 -- 172.21.15.123:0/272722383 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53c01f6600 con 0x7f53c006bc10 2024-09-15T23:19:58.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.612+0000 7f53c63c0640 1 -- 172.21.15.123:0/272722383 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53c015eb20 con 0x7f53c006bc10 2024-09-15T23:19:58.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.612+0000 7f53bcff9640 1 -- 172.21.15.123:0/272722383 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f53b001c460 con 0x7f53c006bc10 2024-09-15T23:19:58.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.613+0000 7f53bcff9640 1 --2- 172.21.15.123:0/272722383 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f53ac06c2b0 0x7f53ac06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:58.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.613+0000 7f53bcff9640 1 -- 172.21.15.123:0/272722383 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f53b008b1d0 con 0x7f53c006bc10 2024-09-15T23:19:58.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.613+0000 7f53bf7fe640 1 --2- 172.21.15.123:0/272722383 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f53ac06c2b0 0x7f53ac06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:58.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.614+0000 7f53bf7fe640 1 --2- 172.21.15.123:0/272722383 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f53ac06c2b0 0x7f53ac06e770 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f53c006c1d0 tx=0x7f53b4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:58.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.617+0000 7f53bcff9640 1 -- 172.21.15.123:0/272722383 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f53b00592f0 con 0x7f53c006bc10 2024-09-15T23:19:58.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.818+0000 7f53c63c0640 1 -- 172.21.15.123:0/272722383 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f53c0072f20 con 0x7f53c006bc10 2024-09-15T23:19:58.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.818+0000 7f53bcff9640 1 -- 172.21.15.123:0/272722383 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5237 (secure 0 0 0) 0x7f53b005d5f0 con 0x7f53c006bc10 2024-09-15T23:19:58.819 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:19:58.819 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":86,"btime":"2024-09-15T23:19:37:619526+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2082746470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2082746470},{"type":"v1","addr":"172.21.15.123:6834","nonce":2082746470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8421,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2007610603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":2007610603},{"type":"v1","addr":"172.21.15.123:6835","nonce":2007610603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8436,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2929123975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2929123975},{"type":"v1","addr":"172.21.15.188:6836","nonce":2929123975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:19:34.917419+0000","modified":"2024-09-15T23:19:36.941347+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8439":{"gid":8439,"name":"d","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6837/1222656979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1222656979},{"type":"v1","addr":"172.21.15.188:6837","nonce":1222656979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8439,"qdb_cluster":[8439]},"id":9}]} 2024-09-15T23:19:58.820 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 86 2024-09-15T23:19:58.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.820+0000 7f53c63c0640 1 -- 172.21.15.123:0/272722383 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f53ac06c2b0 msgr2=0x7f53ac06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:58.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.820+0000 7f53c63c0640 1 --2- 172.21.15.123:0/272722383 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f53ac06c2b0 0x7f53ac06e770 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f53c006c1d0 tx=0x7f53b4008040 comp rx=0 tx=0).stop 2024-09-15T23:19:58.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.820+0000 7f53c63c0640 1 -- 172.21.15.123:0/272722383 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53c006bc10 msgr2=0x7f53c015a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:58.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.820+0000 7f53c63c0640 1 --2- 172.21.15.123:0/272722383 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53c006bc10 0x7f53c015a930 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f53b000c430 tx=0x7f53b000c8f0 comp rx=0 tx=0).stop 2024-09-15T23:19:58.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.820+0000 7f53c63c0640 1 -- 172.21.15.123:0/272722383 shutdown_connections 2024-09-15T23:19:58.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.820+0000 7f53c63c0640 1 --2- 172.21.15.123:0/272722383 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f53c00cef60 0x7f53c00b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:58.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.820+0000 7f53c63c0640 1 --2- 172.21.15.123:0/272722383 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f53c00b3790 0x7f53c01f55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:58.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.820+0000 7f53c63c0640 1 --2- 172.21.15.123:0/272722383 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f53ac06c2b0 0x7f53ac06e770 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:58.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.820+0000 7f53c63c0640 1 --2- 172.21.15.123:0/272722383 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53c006bc10 0x7f53c015a930 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:58.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.820+0000 7f53c63c0640 1 -- 172.21.15.123:0/272722383 >> 172.21.15.123:0/272722383 conn(0x7f53c006cd20 msgr2=0x7f53c015d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:58.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.820+0000 7f53c63c0640 1 -- 172.21.15.123:0/272722383 shutdown_connections 2024-09-15T23:19:58.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.820+0000 7f53c63c0640 1 -- 172.21.15.123:0/272722383 wait complete. 2024-09-15T23:19:58.832 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-15T23:19:58.832 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:19:58.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.928+0000 7f1be039f640 1 Processor -- start 2024-09-15T23:19:58.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.928+0000 7f1be039f640 1 -- start start 2024-09-15T23:19:58.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.929+0000 7f1be039f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1bd80b2d40 0x7f1bd806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:58.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.929+0000 7f1be039f640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bd8071180 con 0x7f1bd806c150 2024-09-15T23:19:58.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.929+0000 7f1be039f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bd8071460 con 0x7f1bd813eb20 2024-09-15T23:19:58.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.929+0000 7f1be039f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f1bd8071ab0 con 0x7f1bd80b2d40 2024-09-15T23:19:58.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.929+0000 7f1bde13b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1bd80b2d40 0x7f1bd806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:58.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.929+0000 7f1bde93c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1bd806c150 0x7f1bd8071f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:50840/0 (socket says 172.21.15.123:50840) 2024-09-15T23:19:58.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.929+0000 7f1bde93c640 1 -- 172.21.15.123:0/18606660 learned_addr learned my addr 172.21.15.123:0/18606660 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:19:58.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.929+0000 7f1bde13b640 1 -- 172.21.15.123:0/18606660 >> v1:172.21.15.188:6789/0 conn(0x7f1bd813eb20 legacy=0x7f1bd815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:19:58.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.929+0000 7f1bde13b640 1 -- 172.21.15.123:0/18606660 >> v1:172.21.15.123:6789/0 conn(0x7f1bd806c150 legacy=0x7f1bd8071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:58.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.929+0000 7f1bde13b640 1 -- 172.21.15.123:0/18606660 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd8071740 con 0x7f1bd80b2d40 2024-09-15T23:19:58.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.929+0000 7f1bdd139640 1 -- 172.21.15.123:0/18606660 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 996298707 0 0) 0x7f1bd8071180 con 0x7f1bd806c150 2024-09-15T23:19:58.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.930+0000 7f1bde13b640 1 --2- 172.21.15.123:0/18606660 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bd80b2d40 0x7f1bd806bc10 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f1bd40097a0 tx=0x7f1bd402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfdf3016ec2321c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:58.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.930+0000 7f1bdd139640 1 -- 172.21.15.123:0/18606660 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd4037070 con 0x7f1bd80b2d40 2024-09-15T23:19:58.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.930+0000 7f1bdd139640 1 -- 172.21.15.123:0/18606660 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bd4032440 con 0x7f1bd80b2d40 2024-09-15T23:19:58.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.930+0000 7f1bdd139640 1 -- 172.21.15.123:0/18606660 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd4032810 con 0x7f1bd80b2d40 2024-09-15T23:19:58.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.931+0000 7f1be039f640 1 -- 172.21.15.123:0/18606660 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bd80b2d40 msgr2=0x7f1bd806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:58.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.931+0000 7f1be039f640 1 --2- 172.21.15.123:0/18606660 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bd80b2d40 0x7f1bd806bc10 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f1bd40097a0 tx=0x7f1bd402a1e0 comp rx=0 tx=0).stop 2024-09-15T23:19:58.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.931+0000 7f1be039f640 1 -- 172.21.15.123:0/18606660 shutdown_connections 2024-09-15T23:19:58.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.931+0000 7f1be039f640 1 --2- 172.21.15.123:0/18606660 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bd80b2d40 0x7f1bd806bc10 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:58.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.931+0000 7f1be039f640 1 -- 172.21.15.123:0/18606660 >> 172.21.15.123:0/18606660 conn(0x7f1bd80ccec0 msgr2=0x7f1bd80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:58.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.931+0000 7f1be039f640 1 -- 172.21.15.123:0/18606660 shutdown_connections 2024-09-15T23:19:58.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.931+0000 7f1be039f640 1 -- 172.21.15.123:0/18606660 wait complete. 2024-09-15T23:19:58.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.932+0000 7f1be039f640 1 Processor -- start 2024-09-15T23:19:58.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.932+0000 7f1be039f640 1 -- start start 2024-09-15T23:19:58.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.933+0000 7f1be039f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1bd806c150 0x7f1bd8155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:58.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.933+0000 7f1be039f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bd80b2d40 0x7f1bd815d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:58.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.933+0000 7f1be039f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1bd813eb20 0x7f1bd815efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:58.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.933+0000 7f1be039f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd815c7d0 con 0x7f1bd80b2d40 2024-09-15T23:19:58.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.933+0000 7f1be039f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd815c650 con 0x7f1bd806c150 2024-09-15T23:19:58.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.933+0000 7f1be039f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1bd8072650 con 0x7f1bd813eb20 2024-09-15T23:19:58.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.933+0000 7f1bdd93a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bd80b2d40 0x7f1bd815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:58.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.933+0000 7f1bdd93a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bd80b2d40 0x7f1bd815d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57216/0 (socket says 172.21.15.123:57216) 2024-09-15T23:19:58.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.933+0000 7f1bdd93a640 1 -- 172.21.15.123:0/2978401314 learned_addr learned my addr 172.21.15.123:0/2978401314 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:19:58.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.933+0000 7f1bde93c640 1 --2- 172.21.15.123:0/2978401314 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1bd813eb20 0x7f1bd815efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:58.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.933+0000 7f1bde13b640 1 --2- 172.21.15.123:0/2978401314 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1bd806c150 0x7f1bd8155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:58.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.933+0000 7f1bdd93a640 1 -- 172.21.15.123:0/2978401314 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1bd813eb20 msgr2=0x7f1bd815efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:58.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.933+0000 7f1bdd93a640 1 --2- 172.21.15.123:0/2978401314 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1bd813eb20 0x7f1bd815efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:58.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.933+0000 7f1bdd93a640 1 -- 172.21.15.123:0/2978401314 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1bd806c150 msgr2=0x7f1bd8155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:58.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.933+0000 7f1bdd93a640 1 --2- 172.21.15.123:0/2978401314 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1bd806c150 0x7f1bd8155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:58.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.933+0000 7f1bdd93a640 1 -- 172.21.15.123:0/2978401314 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd815df40 con 0x7f1bd80b2d40 2024-09-15T23:19:58.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.933+0000 7f1bde13b640 1 --2- 172.21.15.123:0/2978401314 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1bd806c150 0x7f1bd8155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:19:58.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.933+0000 7f1bdd93a640 1 --2- 172.21.15.123:0/2978401314 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bd80b2d40 0x7f1bd815d560 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800b3c0 tx=0x7f1bc800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:58.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.934+0000 7f1bceffd640 1 -- 172.21.15.123:0/2978401314 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8015020 con 0x7f1bd80b2d40 2024-09-15T23:19:58.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.934+0000 7f1bceffd640 1 -- 172.21.15.123:0/2978401314 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bc8011830 con 0x7f1bd80b2d40 2024-09-15T23:19:58.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.934+0000 7f1be039f640 1 -- 172.21.15.123:0/2978401314 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bd815e220 con 0x7f1bd80b2d40 2024-09-15T23:19:58.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.934+0000 7f1bceffd640 1 -- 172.21.15.123:0/2978401314 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8011c60 con 0x7f1bd80b2d40 2024-09-15T23:19:58.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.934+0000 7f1be039f640 1 -- 172.21.15.123:0/2978401314 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bd815e7e0 con 0x7f1bd80b2d40 2024-09-15T23:19:58.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.935+0000 7f1be039f640 1 -- 172.21.15.123:0/2978401314 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bd806bc10 con 0x7f1bd80b2d40 2024-09-15T23:19:58.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.935+0000 7f1bceffd640 1 -- 172.21.15.123:0/2978401314 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1bc8018020 con 0x7f1bd80b2d40 2024-09-15T23:19:58.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.935+0000 7f1bceffd640 1 --2- 172.21.15.123:0/2978401314 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1bbc06c2b0 0x7f1bbc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:19:58.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.936+0000 7f1bceffd640 1 -- 172.21.15.123:0/2978401314 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f1bc808aca0 con 0x7f1bd80b2d40 2024-09-15T23:19:58.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.936+0000 7f1bde13b640 1 --2- 172.21.15.123:0/2978401314 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1bbc06c2b0 0x7f1bbc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:19:58.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.936+0000 7f1bde13b640 1 --2- 172.21.15.123:0/2978401314 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1bbc06c2b0 0x7f1bbc06e770 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4034000 tx=0x7f1bd402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:19:58.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:58.940+0000 7f1bceffd640 1 -- 172.21.15.123:0/2978401314 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1bc801f070 con 0x7f1bd80b2d40 2024-09-15T23:19:59.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:59.167+0000 7f1be039f640 1 -- 172.21.15.123:0/2978401314 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f1bd806c9c0 con 0x7f1bd80b2d40 2024-09-15T23:19:59.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:59.167+0000 7f1bceffd640 1 -- 172.21.15.123:0/2978401314 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1486 (secure 0 0 0) 0x7f1bc80594a0 con 0x7f1bd80b2d40 2024-09-15T23:19:59.168 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:19:59.168 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":489,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":142,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":906,"data_bytes":926693738,"bytes_used":2198274048,"bytes_avail":770895839232,"bytes_total":773094113280,"write_bytes_sec":77165172,"read_op_per_sec":0,"write_op_per_sec":75},"fsmap":{"epoch":86,"btime":"2024-09-15T23:19:37:619526+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"d","status":"up:active","gid":8439}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-09-15T23:19:25.606748+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T23:19:59.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:59.169+0000 7f1be039f640 1 -- 172.21.15.123:0/2978401314 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1bbc06c2b0 msgr2=0x7f1bbc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:59.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:59.169+0000 7f1be039f640 1 --2- 172.21.15.123:0/2978401314 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1bbc06c2b0 0x7f1bbc06e770 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4034000 tx=0x7f1bd402e000 comp rx=0 tx=0).stop 2024-09-15T23:19:59.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:59.169+0000 7f1be039f640 1 -- 172.21.15.123:0/2978401314 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bd80b2d40 msgr2=0x7f1bd815d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:19:59.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:59.169+0000 7f1be039f640 1 --2- 172.21.15.123:0/2978401314 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bd80b2d40 0x7f1bd815d560 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800b3c0 tx=0x7f1bc800b880 comp rx=0 tx=0).stop 2024-09-15T23:19:59.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:59.169+0000 7f1be039f640 1 -- 172.21.15.123:0/2978401314 shutdown_connections 2024-09-15T23:19:59.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:59.169+0000 7f1be039f640 1 --2- 172.21.15.123:0/2978401314 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1bd813eb20 0x7f1bd815efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:59.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:59.169+0000 7f1be039f640 1 --2- 172.21.15.123:0/2978401314 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1bbc06c2b0 0x7f1bbc06e770 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:59.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:59.169+0000 7f1be039f640 1 --2- 172.21.15.123:0/2978401314 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bd80b2d40 0x7f1bd815d560 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:59.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:59.169+0000 7f1be039f640 1 --2- 172.21.15.123:0/2978401314 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1bd806c150 0x7f1bd8155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:19:59.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:59.169+0000 7f1be039f640 1 -- 172.21.15.123:0/2978401314 >> 172.21.15.123:0/2978401314 conn(0x7f1bd80ccec0 msgr2=0x7f1bd8159e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:19:59.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:59.169+0000 7f1be039f640 1 -- 172.21.15.123:0/2978401314 shutdown_connections 2024-09-15T23:19:59.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:19:59.169+0000 7f1be039f640 1 -- 172.21.15.123:0/2978401314 wait complete. 2024-09-15T23:19:59.180 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-15T23:20:00.182 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:20:00.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.294+0000 7f79ba053640 1 Processor -- start 2024-09-15T23:20:00.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.294+0000 7f79ba053640 1 -- start start 2024-09-15T23:20:00.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.295+0000 7f79ba053640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f79b41461a0 0x7f79b415d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:00.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.295+0000 7f79ba053640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f79b40720c0 0x7f79b406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:00.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.295+0000 7f79ba053640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79b40728d0 con 0x7f79b406c150 2024-09-15T23:20:00.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.295+0000 7f79ba053640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f79b415ddc0 con 0x7f79b41461a0 2024-09-15T23:20:00.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.295+0000 7f79ba053640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f79b406c5a0 con 0x7f79b40720c0 2024-09-15T23:20:00.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.295+0000 7f79b3fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f79b406c150 0x7f79b40b67a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:50844/0 (socket says 172.21.15.123:50844) 2024-09-15T23:20:00.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.295+0000 7f79b3fff640 1 -- 172.21.15.123:0/3838353509 learned_addr learned my addr 172.21.15.123:0/3838353509 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:00.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.295+0000 7f79b37fe640 1 --2- 172.21.15.123:0/3838353509 >> v2:172.21.15.188:3300/0 conn(0x7f79b41461a0 0x7f79b415d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:00.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.295+0000 7f79b27fc640 1 -- 172.21.15.123:0/3838353509 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3495254868 0 0) 0x7f79b40728d0 con 0x7f79b406c150 2024-09-15T23:20:00.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.295+0000 7f79b27fc640 1 -- 172.21.15.123:0/3838353509 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f799c003520 con 0x7f79b406c150 2024-09-15T23:20:00.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.295+0000 7f79b2ffd640 1 --2- 172.21.15.123:0/3838353509 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f79b40720c0 0x7f79b406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:00.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.296+0000 7f79b27fc640 1 -- 172.21.15.123:0/3838353509 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1771227630 0 0) 0x7f799c003520 con 0x7f79b406c150 2024-09-15T23:20:00.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.296+0000 7f79b27fc640 1 -- 172.21.15.123:0/3838353509 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f79b40720c0 msgr2=0x7f79b406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:00.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.296+0000 7f79b27fc640 1 --2- 172.21.15.123:0/3838353509 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f79b40720c0 0x7f79b406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:00.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.296+0000 7f79b27fc640 1 -- 172.21.15.123:0/3838353509 >> v2:172.21.15.188:3300/0 conn(0x7f79b41461a0 msgr2=0x7f79b415d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:00.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.296+0000 7f79b27fc640 1 --2- 172.21.15.123:0/3838353509 >> v2:172.21.15.188:3300/0 conn(0x7f79b41461a0 0x7f79b415d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:00.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.296+0000 7f79b27fc640 1 -- 172.21.15.123:0/3838353509 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79b4072bb0 con 0x7f79b406c150 2024-09-15T23:20:00.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.296+0000 7f79b27fc640 1 -- 172.21.15.123:0/3838353509 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f79ac001670 con 0x7f79b406c150 2024-09-15T23:20:00.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.296+0000 7f79b27fc640 1 -- 172.21.15.123:0/3838353509 >> v1:172.21.15.123:6789/0 conn(0x7f79b406c150 legacy=0x7f79b40b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:00.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.296+0000 7f79b27fc640 1 --2- 172.21.15.123:0/3838353509 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f79b40720c0 0x7f799c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:00.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.296+0000 7f79b27fc640 1 --2- 172.21.15.123:0/3838353509 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f799c003f30 0x7f799c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:00.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.296+0000 7f79b27fc640 1 --2- 172.21.15.123:0/3838353509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f799c004d40 0x7f799c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:00.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.296+0000 7f79b27fc640 1 -- 172.21.15.123:0/3838353509 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f79b406c5a0 con 0x7f799c004d40 2024-09-15T23:20:00.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.296+0000 7f79b27fc640 1 -- 172.21.15.123:0/3838353509 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f799c00b9c0 con 0x7f799c003f30 2024-09-15T23:20:00.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.296+0000 7f79b27fc640 1 -- 172.21.15.123:0/3838353509 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f799c00bb40 con 0x7f79b40720c0 2024-09-15T23:20:00.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.296+0000 7f79b37fe640 1 --2- 172.21.15.123:0/3838353509 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f79b40720c0 0x7f799c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:00.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.296+0000 7f79b3fff640 1 --2- 172.21.15.123:0/3838353509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f799c004d40 0x7f799c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:00.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.296+0000 7f79b2ffd640 1 --2- 172.21.15.123:0/3838353509 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f799c003f30 0x7f799c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:00.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.296+0000 7f79b3fff640 1 -- 172.21.15.123:0/3838353509 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f79b40720c0 msgr2=0x7f799c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:00.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.296+0000 7f79b3fff640 1 --2- 172.21.15.123:0/3838353509 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f79b40720c0 0x7f799c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:00.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.296+0000 7f79b3fff640 1 -- 172.21.15.123:0/3838353509 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f799c003f30 msgr2=0x7f799c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:00.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.296+0000 7f79b3fff640 1 --2- 172.21.15.123:0/3838353509 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f799c003f30 0x7f799c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:00.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.296+0000 7f79b3fff640 1 -- 172.21.15.123:0/3838353509 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f799c003520 con 0x7f799c004d40 2024-09-15T23:20:00.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.296+0000 7f79b37fe640 1 --2- 172.21.15.123:0/3838353509 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f79b40720c0 0x7f799c0039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:20:00.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.296+0000 7f79b2ffd640 1 --2- 172.21.15.123:0/3838353509 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f799c003f30 0x7f799c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:20:00.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.297+0000 7f79b3fff640 1 --2- 172.21.15.123:0/3838353509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f799c004d40 0x7f799c0051c0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f79ac007fd0 tx=0x7f799c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebfc2b2e4100c97e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:00.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.297+0000 7f79b27fc640 1 -- 172.21.15.123:0/3838353509 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ac007d50 con 0x7f799c004d40 2024-09-15T23:20:00.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.297+0000 7f79b27fc640 1 -- 172.21.15.123:0/3838353509 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79ac005ad0 con 0x7f799c004d40 2024-09-15T23:20:00.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.297+0000 7f79b27fc640 1 -- 172.21.15.123:0/3838353509 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ac007070 con 0x7f799c004d40 2024-09-15T23:20:00.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.298+0000 7f79ba053640 1 -- 172.21.15.123:0/3838353509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f799c004d40 msgr2=0x7f799c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:00.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.298+0000 7f79ba053640 1 --2- 172.21.15.123:0/3838353509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f799c004d40 0x7f799c0051c0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f79ac007fd0 tx=0x7f799c005830 comp rx=0 tx=0).stop 2024-09-15T23:20:00.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.298+0000 7f79b3fff640 1 -- 172.21.15.123:0/3838353509 reap_dead start 2024-09-15T23:20:00.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.298+0000 7f79ba053640 1 -- 172.21.15.123:0/3838353509 shutdown_connections 2024-09-15T23:20:00.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.298+0000 7f79ba053640 1 -- 172.21.15.123:0/3838353509 >> 172.21.15.123:0/3838353509 conn(0x7f79b406cd20 msgr2=0x7f79b406d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:00.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.298+0000 7f79ba053640 1 -- 172.21.15.123:0/3838353509 shutdown_connections 2024-09-15T23:20:00.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.298+0000 7f79ba053640 1 -- 172.21.15.123:0/3838353509 wait complete. 2024-09-15T23:20:00.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.299+0000 7f79ba053640 1 Processor -- start 2024-09-15T23:20:00.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.299+0000 7f79ba053640 1 -- start start 2024-09-15T23:20:00.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.300+0000 7f79ba053640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f799c004d40 0x7f79b40cf000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:00.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.300+0000 7f79ba053640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79b40ce1c0 0x7f79b40cca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:00.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.300+0000 7f79ba053640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f79b413cf60 0x7f79b40ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:00.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.300+0000 7f79ba053640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f79b4073170 con 0x7f79b40ce1c0 2024-09-15T23:20:00.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.300+0000 7f79ba053640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f79b4146580 con 0x7f79b413cf60 2024-09-15T23:20:00.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.300+0000 7f79ba053640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f79b4072500 con 0x7f799c004d40 2024-09-15T23:20:00.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.300+0000 7f79b2ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79b40ce1c0 0x7f79b40cca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:00.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.300+0000 7f79b2ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79b40ce1c0 0x7f79b40cca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57238/0 (socket says 172.21.15.123:57238) 2024-09-15T23:20:00.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.300+0000 7f79b2ffd640 1 -- 172.21.15.123:0/1239407554 learned_addr learned my addr 172.21.15.123:0/1239407554 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:00.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.300+0000 7f79b3fff640 1 --2- 172.21.15.123:0/1239407554 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f79b413cf60 0x7f79b40ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:00.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.300+0000 7f79b37fe640 1 --2- 172.21.15.123:0/1239407554 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f799c004d40 0x7f79b40cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:00.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.300+0000 7f79b2ffd640 1 -- 172.21.15.123:0/1239407554 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f799c004d40 msgr2=0x7f79b40cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:00.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.300+0000 7f79b2ffd640 1 --2- 172.21.15.123:0/1239407554 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f799c004d40 0x7f79b40cf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:00.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.300+0000 7f79b2ffd640 1 -- 172.21.15.123:0/1239407554 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f79b413cf60 msgr2=0x7f79b40ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:00.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.300+0000 7f79b2ffd640 1 --2- 172.21.15.123:0/1239407554 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f79b413cf60 0x7f79b40ccfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:00.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.300+0000 7f79b2ffd640 1 -- 172.21.15.123:0/1239407554 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79b40cf980 con 0x7f79b40ce1c0 2024-09-15T23:20:00.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.301+0000 7f79b2ffd640 1 --2- 172.21.15.123:0/1239407554 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79b40ce1c0 0x7f79b40cca60 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f79a8011a50 tx=0x7f79a8011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:00.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.303+0000 7f799bfff640 1 -- 172.21.15.123:0/1239407554 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a800fad0 con 0x7f79b40ce1c0 2024-09-15T23:20:00.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.303+0000 7f799bfff640 1 -- 172.21.15.123:0/1239407554 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79a800fc70 con 0x7f79b40ce1c0 2024-09-15T23:20:00.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.303+0000 7f799bfff640 1 -- 172.21.15.123:0/1239407554 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a8014440 con 0x7f79b40ce1c0 2024-09-15T23:20:00.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.303+0000 7f79ba053640 1 -- 172.21.15.123:0/1239407554 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79b4157e30 con 0x7f79b40ce1c0 2024-09-15T23:20:00.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.303+0000 7f79ba053640 1 -- 172.21.15.123:0/1239407554 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79b41583f0 con 0x7f79b40ce1c0 2024-09-15T23:20:00.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.304+0000 7f79ba053640 1 -- 172.21.15.123:0/1239407554 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79b415d840 con 0x7f79b40ce1c0 2024-09-15T23:20:00.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.305+0000 7f799bfff640 1 -- 172.21.15.123:0/1239407554 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f79a8012040 con 0x7f79b40ce1c0 2024-09-15T23:20:00.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.305+0000 7f799bfff640 1 --2- 172.21.15.123:0/1239407554 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f79a006c2e0 0x7f79a006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:00.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.305+0000 7f799bfff640 1 -- 172.21.15.123:0/1239407554 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f79a808ba20 con 0x7f79b40ce1c0 2024-09-15T23:20:00.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.305+0000 7f79b37fe640 1 --2- 172.21.15.123:0/1239407554 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f79a006c2e0 0x7f79a006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:00.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.306+0000 7f79b37fe640 1 --2- 172.21.15.123:0/1239407554 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f79a006c2e0 0x7f79a006e7a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f79a4009fd0 tx=0x7f79a400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:00.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.311+0000 7f799bfff640 1 -- 172.21.15.123:0/1239407554 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f79a8019030 con 0x7f79b40ce1c0 2024-09-15T23:20:00.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.509+0000 7f79ba053640 1 -- 172.21.15.123:0/1239407554 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79b406d2a0 con 0x7f79b40ce1c0 2024-09-15T23:20:00.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.510+0000 7f799bfff640 1 -- 172.21.15.123:0/1239407554 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5237 (secure 0 0 0) 0x7f79a805a190 con 0x7f79b40ce1c0 2024-09-15T23:20:00.511 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:00.511 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":86,"btime":"2024-09-15T23:19:37:619526+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2082746470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2082746470},{"type":"v1","addr":"172.21.15.123:6834","nonce":2082746470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8421,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2007610603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":2007610603},{"type":"v1","addr":"172.21.15.123:6835","nonce":2007610603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8436,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2929123975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2929123975},{"type":"v1","addr":"172.21.15.188:6836","nonce":2929123975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:19:34.917419+0000","modified":"2024-09-15T23:19:36.941347+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8439":{"gid":8439,"name":"d","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6837/1222656979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1222656979},{"type":"v1","addr":"172.21.15.188:6837","nonce":1222656979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8439,"qdb_cluster":[8439]},"id":9}]} 2024-09-15T23:20:00.512 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 86 2024-09-15T23:20:00.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.512+0000 7f79ba053640 1 -- 172.21.15.123:0/1239407554 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f79a006c2e0 msgr2=0x7f79a006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:00.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.512+0000 7f79ba053640 1 --2- 172.21.15.123:0/1239407554 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f79a006c2e0 0x7f79a006e7a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f79a4009fd0 tx=0x7f79a400b040 comp rx=0 tx=0).stop 2024-09-15T23:20:00.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.512+0000 7f79ba053640 1 -- 172.21.15.123:0/1239407554 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79b40ce1c0 msgr2=0x7f79b40cca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:00.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.512+0000 7f79ba053640 1 --2- 172.21.15.123:0/1239407554 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79b40ce1c0 0x7f79b40cca60 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f79a8011a50 tx=0x7f79a8011e50 comp rx=0 tx=0).stop 2024-09-15T23:20:00.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.512+0000 7f79ba053640 1 -- 172.21.15.123:0/1239407554 shutdown_connections 2024-09-15T23:20:00.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.512+0000 7f79ba053640 1 --2- 172.21.15.123:0/1239407554 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f79b413cf60 0x7f79b40ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:00.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.512+0000 7f79ba053640 1 --2- 172.21.15.123:0/1239407554 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f79a006c2e0 0x7f79a006e7a0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:00.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.512+0000 7f79ba053640 1 --2- 172.21.15.123:0/1239407554 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f79b40ce1c0 0x7f79b40cca60 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:00.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.512+0000 7f79ba053640 1 --2- 172.21.15.123:0/1239407554 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f799c004d40 0x7f79b40cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:00.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.512+0000 7f79ba053640 1 -- 172.21.15.123:0/1239407554 >> 172.21.15.123:0/1239407554 conn(0x7f79b406cd20 msgr2=0x7f79b415cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:00.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.512+0000 7f79ba053640 1 -- 172.21.15.123:0/1239407554 shutdown_connections 2024-09-15T23:20:00.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.512+0000 7f79ba053640 1 -- 172.21.15.123:0/1239407554 wait complete. 2024-09-15T23:20:00.523 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-15T23:20:00.524 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:20:00.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.620+0000 7f6bbdc27640 1 Processor -- start 2024-09-15T23:20:00.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.620+0000 7f6bbdc27640 1 -- start start 2024-09-15T23:20:00.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.620+0000 7f6bbdc27640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6bb806c320 0x7f6bb815bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:00.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.620+0000 7f6bbdc27640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f6bb813eb20 0x7f6bb815c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:00.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.620+0000 7f6bbdc27640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bb8071180 con 0x7f6bb80b2d40 2024-09-15T23:20:00.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.620+0000 7f6bbdc27640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f6bb8071ab0 con 0x7f6bb813eb20 2024-09-15T23:20:00.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.620+0000 7f6bbdc27640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6bb8071460 con 0x7f6bb806c320 2024-09-15T23:20:00.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.621+0000 7f6bb6ffd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6bb806c320 0x7f6bb815bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:00.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.621+0000 7f6bb7fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f6bb813eb20 0x7f6bb815c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:00.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.621+0000 7f6bb77fe640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f6bb80b2d40 0x7f6bb806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:36010/0 (socket says 172.21.15.123:36010) 2024-09-15T23:20:00.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.621+0000 7f6bb77fe640 1 -- 172.21.15.123:0/2133008653 learned_addr learned my addr 172.21.15.123:0/2133008653 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:00.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.621+0000 7f6bb6ffd640 1 -- 172.21.15.123:0/2133008653 >> v2:172.21.15.188:3300/0 conn(0x7f6bb813eb20 msgr2=0x7f6bb815c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:00.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.621+0000 7f6bb6ffd640 1 --2- 172.21.15.123:0/2133008653 >> v2:172.21.15.188:3300/0 conn(0x7f6bb813eb20 0x7f6bb815c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:00.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.621+0000 7f6bb6ffd640 1 -- 172.21.15.123:0/2133008653 >> v1:172.21.15.188:6789/0 conn(0x7f6bb80b2d40 legacy=0x7f6bb806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:00.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.621+0000 7f6bb6ffd640 1 -- 172.21.15.123:0/2133008653 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb8071740 con 0x7f6bb806c320 2024-09-15T23:20:00.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.622+0000 7f6bb6ffd640 1 --2- 172.21.15.123:0/2133008653 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6bb806c320 0x7f6bb815bcf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00097a0 tx=0x7f6ba002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6d853cf0d6ef62c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:00.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.622+0000 7f6bb67fc640 1 -- 172.21.15.123:0/2133008653 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0037070 con 0x7f6bb806c320 2024-09-15T23:20:00.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.622+0000 7f6bb67fc640 1 -- 172.21.15.123:0/2133008653 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ba0032440 con 0x7f6bb806c320 2024-09-15T23:20:00.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.622+0000 7f6bb67fc640 1 -- 172.21.15.123:0/2133008653 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0032810 con 0x7f6bb806c320 2024-09-15T23:20:00.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.622+0000 7f6bbdc27640 1 -- 172.21.15.123:0/2133008653 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6bb806c320 msgr2=0x7f6bb815bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:00.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.622+0000 7f6bbdc27640 1 --2- 172.21.15.123:0/2133008653 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6bb806c320 0x7f6bb815bcf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00097a0 tx=0x7f6ba002a180 comp rx=0 tx=0).stop 2024-09-15T23:20:00.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.623+0000 7f6bbdc27640 1 -- 172.21.15.123:0/2133008653 shutdown_connections 2024-09-15T23:20:00.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.623+0000 7f6bbdc27640 1 --2- 172.21.15.123:0/2133008653 >> v2:172.21.15.188:3300/0 conn(0x7f6bb813eb20 0x7f6bb815c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:00.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.623+0000 7f6bbdc27640 1 --2- 172.21.15.123:0/2133008653 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6bb806c320 0x7f6bb815bcf0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:00.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.623+0000 7f6bbdc27640 1 -- 172.21.15.123:0/2133008653 >> 172.21.15.123:0/2133008653 conn(0x7f6bb80ccec0 msgr2=0x7f6bb80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:00.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.623+0000 7f6bbdc27640 1 -- 172.21.15.123:0/2133008653 shutdown_connections 2024-09-15T23:20:00.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.623+0000 7f6bbdc27640 1 -- 172.21.15.123:0/2133008653 wait complete. 2024-09-15T23:20:00.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.624+0000 7f6bbdc27640 1 Processor -- start 2024-09-15T23:20:00.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.624+0000 7f6bbdc27640 1 -- start start 2024-09-15T23:20:00.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.625+0000 7f6bbdc27640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6bb806c320 0x7f6bb813e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:00.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.625+0000 7f6bbdc27640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6bb80b2d40 0x7f6bb815ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:00.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.625+0000 7f6bbdc27640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bb813eb20 0x7f6bb81570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:00.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.625+0000 7f6bbdc27640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb80720c0 con 0x7f6bb813eb20 2024-09-15T23:20:00.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.625+0000 7f6bbdc27640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb8071f40 con 0x7f6bb806c320 2024-09-15T23:20:00.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.625+0000 7f6bbdc27640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6bb8072240 con 0x7f6bb80b2d40 2024-09-15T23:20:00.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.625+0000 7f6bb7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bb813eb20 0x7f6bb81570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:00.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.625+0000 7f6bb77fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6bb806c320 0x7f6bb813e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:00.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.625+0000 7f6bb77fe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6bb806c320 0x7f6bb813e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:56496/0 (socket says 172.21.15.123:56496) 2024-09-15T23:20:00.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.625+0000 7f6bb7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bb813eb20 0x7f6bb81570c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57242/0 (socket says 172.21.15.123:57242) 2024-09-15T23:20:00.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.625+0000 7f6bb77fe640 1 -- 172.21.15.123:0/4259852037 learned_addr learned my addr 172.21.15.123:0/4259852037 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:00.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.625+0000 7f6bb6ffd640 1 --2- 172.21.15.123:0/4259852037 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6bb80b2d40 0x7f6bb815ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:00.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.625+0000 7f6bb7fff640 1 -- 172.21.15.123:0/4259852037 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6bb80b2d40 msgr2=0x7f6bb815ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:00.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.625+0000 7f6bb7fff640 1 --2- 172.21.15.123:0/4259852037 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6bb80b2d40 0x7f6bb815ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:00.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.625+0000 7f6bb7fff640 1 -- 172.21.15.123:0/4259852037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6bb806c320 msgr2=0x7f6bb813e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:00.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.625+0000 7f6bb7fff640 1 --2- 172.21.15.123:0/4259852037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6bb806c320 0x7f6bb813e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:00.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.625+0000 7f6bb7fff640 1 -- 172.21.15.123:0/4259852037 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb815c470 con 0x7f6bb813eb20 2024-09-15T23:20:00.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.625+0000 7f6bb7fff640 1 --2- 172.21.15.123:0/4259852037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bb813eb20 0x7f6bb81570c0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f6bb000e7c0 tx=0x7f6bb000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:00.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.625+0000 7f6baffff640 1 -- 172.21.15.123:0/4259852037 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0017070 con 0x7f6bb813eb20 2024-09-15T23:20:00.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.625+0000 7f6baffff640 1 -- 172.21.15.123:0/4259852037 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bb000c730 con 0x7f6bb813eb20 2024-09-15T23:20:00.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.625+0000 7f6baffff640 1 -- 172.21.15.123:0/4259852037 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb000cb60 con 0x7f6bb813eb20 2024-09-15T23:20:00.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.626+0000 7f6bbdc27640 1 -- 172.21.15.123:0/4259852037 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bb815e760 con 0x7f6bb813eb20 2024-09-15T23:20:00.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.626+0000 7f6bbdc27640 1 -- 172.21.15.123:0/4259852037 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bb815ed20 con 0x7f6bb813eb20 2024-09-15T23:20:00.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.626+0000 7f6bbdc27640 1 -- 172.21.15.123:0/4259852037 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bb806bc10 con 0x7f6bb813eb20 2024-09-15T23:20:00.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.627+0000 7f6baffff640 1 -- 172.21.15.123:0/4259852037 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6bb001a070 con 0x7f6bb813eb20 2024-09-15T23:20:00.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.627+0000 7f6baffff640 1 --2- 172.21.15.123:0/4259852037 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6b9806c2b0 0x7f6b9806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:00.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.627+0000 7f6baffff640 1 -- 172.21.15.123:0/4259852037 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f6bb008b230 con 0x7f6bb813eb20 2024-09-15T23:20:00.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.628+0000 7f6bb77fe640 1 --2- 172.21.15.123:0/4259852037 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6b9806c2b0 0x7f6b9806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:00.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.628+0000 7f6bb77fe640 1 --2- 172.21.15.123:0/4259852037 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6b9806c2b0 0x7f6b9806e770 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8004d60 tx=0x7f6ba8001ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:00.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.632+0000 7f6baffff640 1 -- 172.21.15.123:0/4259852037 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6bb00592d0 con 0x7f6bb813eb20 2024-09-15T23:20:00.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.858+0000 7f6bbdc27640 1 -- 172.21.15.123:0/4259852037 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f6bb806c9c0 con 0x7f6bb813eb20 2024-09-15T23:20:00.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.859+0000 7f6baffff640 1 -- 172.21.15.123:0/4259852037 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1488 (secure 0 0 0) 0x7f6bb005d5d0 con 0x7f6bb813eb20 2024-09-15T23:20:00.860 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:00.860 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":491,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":142,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076562384,"bytes_used":2517934080,"bytes_avail":770576179200,"bytes_total":773094113280,"write_bytes_sec":84413929,"read_op_per_sec":0,"write_op_per_sec":83},"fsmap":{"epoch":86,"btime":"2024-09-15T23:19:37:619526+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"d","status":"up:active","gid":8439}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-09-15T23:19:25.606748+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T23:20:00.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.860+0000 7f6bbdc27640 1 -- 172.21.15.123:0/4259852037 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6b9806c2b0 msgr2=0x7f6b9806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:00.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.860+0000 7f6bbdc27640 1 --2- 172.21.15.123:0/4259852037 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6b9806c2b0 0x7f6b9806e770 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8004d60 tx=0x7f6ba8001ac0 comp rx=0 tx=0).stop 2024-09-15T23:20:00.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.860+0000 7f6bbdc27640 1 -- 172.21.15.123:0/4259852037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bb813eb20 msgr2=0x7f6bb81570c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:00.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.860+0000 7f6bbdc27640 1 --2- 172.21.15.123:0/4259852037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bb813eb20 0x7f6bb81570c0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f6bb000e7c0 tx=0x7f6bb000ec80 comp rx=0 tx=0).stop 2024-09-15T23:20:00.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.860+0000 7f6bbdc27640 1 -- 172.21.15.123:0/4259852037 shutdown_connections 2024-09-15T23:20:00.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.860+0000 7f6bbdc27640 1 --2- 172.21.15.123:0/4259852037 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6b9806c2b0 0x7f6b9806e770 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:00.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.860+0000 7f6bbdc27640 1 --2- 172.21.15.123:0/4259852037 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6bb813eb20 0x7f6bb81570c0 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:00.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.860+0000 7f6bbdc27640 1 --2- 172.21.15.123:0/4259852037 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6bb80b2d40 0x7f6bb815ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:00.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.860+0000 7f6bbdc27640 1 --2- 172.21.15.123:0/4259852037 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6bb806c320 0x7f6bb813e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:00.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.861+0000 7f6bbdc27640 1 -- 172.21.15.123:0/4259852037 >> 172.21.15.123:0/4259852037 conn(0x7f6bb80ccec0 msgr2=0x7f6bb80cc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:00.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.861+0000 7f6bbdc27640 1 -- 172.21.15.123:0/4259852037 shutdown_connections 2024-09-15T23:20:00.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:00.861+0000 7f6bbdc27640 1 -- 172.21.15.123:0/4259852037 wait complete. 2024-09-15T23:20:00.872 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-15T23:20:01.873 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:20:01.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.981+0000 7fed89c7b640 1 Processor -- start 2024-09-15T23:20:01.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.981+0000 7fed89c7b640 1 -- start start 2024-09-15T23:20:01.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.982+0000 7fed89c7b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fed8415c4f0 0x7fed8415d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:01.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.982+0000 7fed89c7b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed840d2630 0x7fed840d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:01.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.982+0000 7fed89c7b640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed84073400 con 0x7fed840d0200 2024-09-15T23:20:01.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.982+0000 7fed89c7b640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fed840d0bb0 con 0x7fed8415c4f0 2024-09-15T23:20:01.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.982+0000 7fed89c7b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fed840736e0 con 0x7fed840d2630 2024-09-15T23:20:01.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.982+0000 7fed837fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fed8415c4f0 0x7fed8415d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:01.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.982+0000 7fed837fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fed8415c4f0 0x7fed8415d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57254/0 (socket says 172.21.15.123:57254) 2024-09-15T23:20:01.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.982+0000 7fed837fe640 1 -- 172.21.15.123:0/288370527 learned_addr learned my addr 172.21.15.123:0/288370527 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:01.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.982+0000 7fed83fff640 1 --2- 172.21.15.123:0/288370527 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed840d2630 0x7fed840d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:01.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.982+0000 7fed837fe640 1 -- 172.21.15.123:0/288370527 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed840d2630 msgr2=0x7fed840d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:01.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.982+0000 7fed837fe640 1 --2- 172.21.15.123:0/288370527 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed840d2630 0x7fed840d0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:01.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.982+0000 7fed837fe640 1 -- 172.21.15.123:0/288370527 >> v1:172.21.15.188:6789/0 conn(0x7fed840d0200 legacy=0x7fed84160100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:01.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.982+0000 7fed837fe640 1 -- 172.21.15.123:0/288370527 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed840739c0 con 0x7fed8415c4f0 2024-09-15T23:20:01.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.983+0000 7fed837fe640 1 --2- 172.21.15.123:0/288370527 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed8415c4f0 0x7fed8415d4b0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fed74009870 tx=0x7fed7402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f4e132d20634c6c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:01.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.983+0000 7fed827fc640 1 -- 172.21.15.123:0/288370527 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed74037070 con 0x7fed8415c4f0 2024-09-15T23:20:01.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.983+0000 7fed827fc640 1 -- 172.21.15.123:0/288370527 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed74032440 con 0x7fed8415c4f0 2024-09-15T23:20:01.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.983+0000 7fed827fc640 1 -- 172.21.15.123:0/288370527 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed74032810 con 0x7fed8415c4f0 2024-09-15T23:20:01.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.983+0000 7fed89c7b640 1 -- 172.21.15.123:0/288370527 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed8415c4f0 msgr2=0x7fed8415d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:01.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.983+0000 7fed89c7b640 1 --2- 172.21.15.123:0/288370527 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed8415c4f0 0x7fed8415d4b0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fed74009870 tx=0x7fed7402a270 comp rx=0 tx=0).stop 2024-09-15T23:20:01.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.984+0000 7fed89c7b640 1 -- 172.21.15.123:0/288370527 shutdown_connections 2024-09-15T23:20:01.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.984+0000 7fed89c7b640 1 --2- 172.21.15.123:0/288370527 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed840d2630 0x7fed840d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:01.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.984+0000 7fed89c7b640 1 --2- 172.21.15.123:0/288370527 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed8415c4f0 0x7fed8415d4b0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:01.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.984+0000 7fed89c7b640 1 -- 172.21.15.123:0/288370527 >> 172.21.15.123:0/288370527 conn(0x7fed8406f400 msgr2=0x7fed8406f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:01.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.984+0000 7fed89c7b640 1 -- 172.21.15.123:0/288370527 shutdown_connections 2024-09-15T23:20:01.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.984+0000 7fed89c7b640 1 -- 172.21.15.123:0/288370527 wait complete. 2024-09-15T23:20:01.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.985+0000 7fed89c7b640 1 Processor -- start 2024-09-15T23:20:01.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.985+0000 7fed89c7b640 1 -- start start 2024-09-15T23:20:01.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.986+0000 7fed89c7b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed840d0200 0x7fed840b4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:01.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.986+0000 7fed89c7b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed840d2630 0x7fed8414c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:01.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.986+0000 7fed89c7b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed8415c4f0 0x7fed8414caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:01.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.986+0000 7fed89c7b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fed840d0fa0 con 0x7fed840d0200 2024-09-15T23:20:01.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.986+0000 7fed89c7b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fed84073f80 con 0x7fed840d2630 2024-09-15T23:20:01.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.986+0000 7fed89c7b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fed8415c8d0 con 0x7fed8415c4f0 2024-09-15T23:20:01.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.986+0000 7fed837fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed840d0200 0x7fed840b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:01.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.986+0000 7fed837fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed840d0200 0x7fed840b4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57266/0 (socket says 172.21.15.123:57266) 2024-09-15T23:20:01.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.986+0000 7fed837fe640 1 -- 172.21.15.123:0/975335293 learned_addr learned my addr 172.21.15.123:0/975335293 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:01.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.986+0000 7fed83fff640 1 --2- 172.21.15.123:0/975335293 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed8415c4f0 0x7fed8414caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:01.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.986+0000 7fed82ffd640 1 --2- 172.21.15.123:0/975335293 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed840d2630 0x7fed8414c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:01.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.986+0000 7fed837fe640 1 -- 172.21.15.123:0/975335293 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed8415c4f0 msgr2=0x7fed8414caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:01.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.986+0000 7fed837fe640 1 --2- 172.21.15.123:0/975335293 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed8415c4f0 0x7fed8414caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:01.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.986+0000 7fed837fe640 1 -- 172.21.15.123:0/975335293 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed840d2630 msgr2=0x7fed8414c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:01.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.986+0000 7fed837fe640 1 --2- 172.21.15.123:0/975335293 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed840d2630 0x7fed8414c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:01.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.986+0000 7fed837fe640 1 -- 172.21.15.123:0/975335293 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed84158870 con 0x7fed840d0200 2024-09-15T23:20:01.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.986+0000 7fed83fff640 1 --2- 172.21.15.123:0/975335293 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed8415c4f0 0x7fed8414caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:01.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.986+0000 7fed82ffd640 1 --2- 172.21.15.123:0/975335293 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed840d2630 0x7fed8414c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:01.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.986+0000 7fed837fe640 1 --2- 172.21.15.123:0/975335293 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed840d0200 0x7fed840b4920 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fed7402a2b0 tx=0x7fed740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:01.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.986+0000 7fed6bfff640 1 -- 172.21.15.123:0/975335293 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed74041020 con 0x7fed840d0200 2024-09-15T23:20:01.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.987+0000 7fed6bfff640 1 -- 172.21.15.123:0/975335293 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed740306c0 con 0x7fed840d0200 2024-09-15T23:20:01.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.987+0000 7fed89c7b640 1 -- 172.21.15.123:0/975335293 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed84158b50 con 0x7fed840d0200 2024-09-15T23:20:01.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.987+0000 7fed6bfff640 1 -- 172.21.15.123:0/975335293 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed74037040 con 0x7fed840d0200 2024-09-15T23:20:01.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.987+0000 7fed89c7b640 1 -- 172.21.15.123:0/975335293 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed84159110 con 0x7fed840d0200 2024-09-15T23:20:01.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.988+0000 7fed89c7b640 1 -- 172.21.15.123:0/975335293 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed84159600 con 0x7fed840d0200 2024-09-15T23:20:01.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.988+0000 7fed6bfff640 1 -- 172.21.15.123:0/975335293 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fed74044020 con 0x7fed840d0200 2024-09-15T23:20:01.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.988+0000 7fed6bfff640 1 --2- 172.21.15.123:0/975335293 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fed7006c2b0 0x7fed7006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:01.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.988+0000 7fed6bfff640 1 -- 172.21.15.123:0/975335293 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fed740abba0 con 0x7fed840d0200 2024-09-15T23:20:01.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.989+0000 7fed82ffd640 1 --2- 172.21.15.123:0/975335293 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fed7006c2b0 0x7fed7006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:01.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.989+0000 7fed82ffd640 1 --2- 172.21.15.123:0/975335293 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fed7006c2b0 0x7fed7006e770 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fed841f5670 tx=0x7fed78009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:01.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:01.993+0000 7fed6bfff640 1 -- 172.21.15.123:0/975335293 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fed7404b030 con 0x7fed840d0200 2024-09-15T23:20:02.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.192+0000 7fed89c7b640 1 -- 172.21.15.123:0/975335293 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fed84073080 con 0x7fed840d0200 2024-09-15T23:20:02.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.193+0000 7fed6bfff640 1 -- 172.21.15.123:0/975335293 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5237 (secure 0 0 0) 0x7fed7407a3a0 con 0x7fed840d0200 2024-09-15T23:20:02.194 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:02.194 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":86,"btime":"2024-09-15T23:19:37:619526+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2082746470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2082746470},{"type":"v1","addr":"172.21.15.123:6834","nonce":2082746470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8421,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2007610603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":2007610603},{"type":"v1","addr":"172.21.15.123:6835","nonce":2007610603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8436,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2929123975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2929123975},{"type":"v1","addr":"172.21.15.188:6836","nonce":2929123975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:19:34.917419+0000","modified":"2024-09-15T23:19:36.941347+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8439":{"gid":8439,"name":"d","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6837/1222656979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1222656979},{"type":"v1","addr":"172.21.15.188:6837","nonce":1222656979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8439,"qdb_cluster":[8439]},"id":9}]} 2024-09-15T23:20:02.194 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 86 2024-09-15T23:20:02.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.194+0000 7fed89c7b640 1 -- 172.21.15.123:0/975335293 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fed7006c2b0 msgr2=0x7fed7006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:02.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.194+0000 7fed89c7b640 1 --2- 172.21.15.123:0/975335293 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fed7006c2b0 0x7fed7006e770 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fed841f5670 tx=0x7fed78009040 comp rx=0 tx=0).stop 2024-09-15T23:20:02.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.194+0000 7fed89c7b640 1 -- 172.21.15.123:0/975335293 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed840d0200 msgr2=0x7fed840b4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:02.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.194+0000 7fed89c7b640 1 --2- 172.21.15.123:0/975335293 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed840d0200 0x7fed840b4920 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fed7402a2b0 tx=0x7fed740046c0 comp rx=0 tx=0).stop 2024-09-15T23:20:02.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.194+0000 7fed89c7b640 1 -- 172.21.15.123:0/975335293 shutdown_connections 2024-09-15T23:20:02.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.194+0000 7fed89c7b640 1 --2- 172.21.15.123:0/975335293 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fed8415c4f0 0x7fed8414caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:02.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.194+0000 7fed89c7b640 1 --2- 172.21.15.123:0/975335293 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fed840d2630 0x7fed8414c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:02.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.194+0000 7fed89c7b640 1 --2- 172.21.15.123:0/975335293 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fed7006c2b0 0x7fed7006e770 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:02.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.194+0000 7fed89c7b640 1 --2- 172.21.15.123:0/975335293 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed840d0200 0x7fed840b4920 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:02.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.194+0000 7fed89c7b640 1 -- 172.21.15.123:0/975335293 >> 172.21.15.123:0/975335293 conn(0x7fed8406f400 msgr2=0x7fed840b6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:02.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.195+0000 7fed89c7b640 1 -- 172.21.15.123:0/975335293 shutdown_connections 2024-09-15T23:20:02.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.195+0000 7fed89c7b640 1 -- 172.21.15.123:0/975335293 wait complete. 2024-09-15T23:20:02.207 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-15T23:20:02.207 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:20:02.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.303+0000 7fc0475c4640 1 Processor -- start 2024-09-15T23:20:02.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.304+0000 7fc0475c4640 1 -- start start 2024-09-15T23:20:02.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.304+0000 7fc0475c4640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc04006c6a0 0x7fc0400720b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:02.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.304+0000 7fc0475c4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc04015af20 0x7fc04015b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:02.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.304+0000 7fc0475c4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc040071010 con 0x7fc04015ab40 2024-09-15T23:20:02.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.304+0000 7fc0475c4640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc04006cb10 con 0x7fc04015af20 2024-09-15T23:20:02.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.304+0000 7fc0475c4640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fc0400712f0 con 0x7fc04006c6a0 2024-09-15T23:20:02.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.305+0000 7fc045b61640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc04015af20 0x7fc04015b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:02.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.305+0000 7fc045360640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc04015ab40 0x7fc040073990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:50852/0 (socket says 172.21.15.123:50852) 2024-09-15T23:20:02.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.305+0000 7fc045b61640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc04015af20 0x7fc04015b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57282/0 (socket says 172.21.15.123:57282) 2024-09-15T23:20:02.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.305+0000 7fc045360640 1 -- 172.21.15.123:0/2433400505 learned_addr learned my addr 172.21.15.123:0/2433400505 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:02.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.305+0000 7fc044b5f640 1 --2- 172.21.15.123:0/2433400505 >> v2:172.21.15.188:3300/0 conn(0x7fc04006c6a0 0x7fc0400720b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:02.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.305+0000 7fc045b61640 1 -- 172.21.15.123:0/2433400505 >> v2:172.21.15.188:3300/0 conn(0x7fc04006c6a0 msgr2=0x7fc0400720b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:02.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.305+0000 7fc045b61640 1 --2- 172.21.15.123:0/2433400505 >> v2:172.21.15.188:3300/0 conn(0x7fc04006c6a0 0x7fc0400720b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:02.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.305+0000 7fc045b61640 1 -- 172.21.15.123:0/2433400505 >> v1:172.21.15.123:6789/0 conn(0x7fc04015ab40 legacy=0x7fc040073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:02.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.305+0000 7fc037fff640 1 -- 172.21.15.123:0/2433400505 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2317683289 0 0) 0x7fc040071010 con 0x7fc04015ab40 2024-09-15T23:20:02.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.305+0000 7fc045b61640 1 -- 172.21.15.123:0/2433400505 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0400715d0 con 0x7fc04015af20 2024-09-15T23:20:02.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.306+0000 7fc045b61640 1 --2- 172.21.15.123:0/2433400505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc04015af20 0x7fc04015b370 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fc0400cded0 tx=0x7fc03802c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4567eaf83d48217a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:02.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.306+0000 7fc037fff640 1 -- 172.21.15.123:0/2433400505 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc038009540 con 0x7fc04015af20 2024-09-15T23:20:02.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.306+0000 7fc037fff640 1 -- 172.21.15.123:0/2433400505 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0380096e0 con 0x7fc04015af20 2024-09-15T23:20:02.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.306+0000 7fc037fff640 1 -- 172.21.15.123:0/2433400505 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc038009ab0 con 0x7fc04015af20 2024-09-15T23:20:02.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.306+0000 7fc0475c4640 1 -- 172.21.15.123:0/2433400505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc04015af20 msgr2=0x7fc04015b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:02.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.306+0000 7fc0475c4640 1 --2- 172.21.15.123:0/2433400505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc04015af20 0x7fc04015b370 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fc0400cded0 tx=0x7fc03802c7f0 comp rx=0 tx=0).stop 2024-09-15T23:20:02.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.306+0000 7fc0475c4640 1 -- 172.21.15.123:0/2433400505 shutdown_connections 2024-09-15T23:20:02.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.306+0000 7fc0475c4640 1 --2- 172.21.15.123:0/2433400505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc04015af20 0x7fc04015b370 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:02.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.306+0000 7fc0475c4640 1 --2- 172.21.15.123:0/2433400505 >> v2:172.21.15.188:3300/0 conn(0x7fc04006c6a0 0x7fc0400720b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:02.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.306+0000 7fc0475c4640 1 -- 172.21.15.123:0/2433400505 >> 172.21.15.123:0/2433400505 conn(0x7fc0400ccec0 msgr2=0x7fc0400cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:02.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.306+0000 7fc0475c4640 1 -- 172.21.15.123:0/2433400505 shutdown_connections 2024-09-15T23:20:02.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.306+0000 7fc0475c4640 1 -- 172.21.15.123:0/2433400505 wait complete. 2024-09-15T23:20:02.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.307+0000 7fc0475c4640 1 Processor -- start 2024-09-15T23:20:02.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.308+0000 7fc0475c4640 1 -- start start 2024-09-15T23:20:02.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.308+0000 7fc0475c4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc04006c6a0 0x7fc0400cbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:02.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.308+0000 7fc0475c4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc04015ab40 0x7fc0400c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:02.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.308+0000 7fc0475c4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc04015af20 0x7fc0400c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:02.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.308+0000 7fc0475c4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc04015ba30 con 0x7fc04015ab40 2024-09-15T23:20:02.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.308+0000 7fc0475c4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc04015b8b0 con 0x7fc04015af20 2024-09-15T23:20:02.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.308+0000 7fc0475c4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc04006bc10 con 0x7fc04006c6a0 2024-09-15T23:20:02.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.308+0000 7fc044b5f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc04015ab40 0x7fc0400c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:02.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.308+0000 7fc044b5f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc04015ab40 0x7fc0400c9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57290/0 (socket says 172.21.15.123:57290) 2024-09-15T23:20:02.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.308+0000 7fc044b5f640 1 -- 172.21.15.123:0/2215359286 learned_addr learned my addr 172.21.15.123:0/2215359286 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:02.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.308+0000 7fc045360640 1 --2- 172.21.15.123:0/2215359286 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc04006c6a0 0x7fc0400cbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:02.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.308+0000 7fc045b61640 1 --2- 172.21.15.123:0/2215359286 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc04015af20 0x7fc0400c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:02.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.309+0000 7fc044b5f640 1 -- 172.21.15.123:0/2215359286 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc04006c6a0 msgr2=0x7fc0400cbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:02.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.309+0000 7fc044b5f640 1 --2- 172.21.15.123:0/2215359286 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc04006c6a0 0x7fc0400cbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:02.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.309+0000 7fc044b5f640 1 -- 172.21.15.123:0/2215359286 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc04015af20 msgr2=0x7fc0400c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:02.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.309+0000 7fc044b5f640 1 --2- 172.21.15.123:0/2215359286 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc04015af20 0x7fc0400c65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:02.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.309+0000 7fc044b5f640 1 -- 172.21.15.123:0/2215359286 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0400c5510 con 0x7fc04015ab40 2024-09-15T23:20:02.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.309+0000 7fc045b61640 1 --2- 172.21.15.123:0/2215359286 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc04015af20 0x7fc0400c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:02.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.309+0000 7fc044b5f640 1 --2- 172.21.15.123:0/2215359286 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc04015ab40 0x7fc0400c9ea0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fc03000d800 tx=0x7fc03000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:02.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.309+0000 7fc035ffb640 1 -- 172.21.15.123:0/2215359286 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc03000b6c0 con 0x7fc04015ab40 2024-09-15T23:20:02.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.309+0000 7fc035ffb640 1 -- 172.21.15.123:0/2215359286 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc030019070 con 0x7fc04015ab40 2024-09-15T23:20:02.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.309+0000 7fc035ffb640 1 -- 172.21.15.123:0/2215359286 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc03000ba80 con 0x7fc04015ab40 2024-09-15T23:20:02.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.309+0000 7fc0475c4640 1 -- 172.21.15.123:0/2215359286 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0400c57f0 con 0x7fc04015ab40 2024-09-15T23:20:02.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.309+0000 7fc0475c4640 1 -- 172.21.15.123:0/2215359286 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0400c5db0 con 0x7fc04015ab40 2024-09-15T23:20:02.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.310+0000 7fc0475c4640 1 -- 172.21.15.123:0/2215359286 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc04006bfd0 con 0x7fc04015ab40 2024-09-15T23:20:02.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.311+0000 7fc035ffb640 1 -- 172.21.15.123:0/2215359286 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc03000bc20 con 0x7fc04015ab40 2024-09-15T23:20:02.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.311+0000 7fc035ffb640 1 --2- 172.21.15.123:0/2215359286 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc02406c2b0 0x7fc02406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:02.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.311+0000 7fc045360640 1 --2- 172.21.15.123:0/2215359286 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc02406c2b0 0x7fc02406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:02.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.312+0000 7fc045360640 1 --2- 172.21.15.123:0/2215359286 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc02406c2b0 0x7fc02406e770 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc03c000f60 tx=0x7fc03c007d50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:02.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.312+0000 7fc035ffb640 1 -- 172.21.15.123:0/2215359286 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fc030057980 con 0x7fc04015ab40 2024-09-15T23:20:02.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.317+0000 7fc035ffb640 1 -- 172.21.15.123:0/2215359286 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc030059fe0 con 0x7fc04015ab40 2024-09-15T23:20:02.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.547+0000 7fc0475c4640 1 -- 172.21.15.123:0/2215359286 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fc040154700 con 0x7fc04015ab40 2024-09-15T23:20:02.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.548+0000 7fc035ffb640 1 -- 172.21.15.123:0/2215359286 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1488 (secure 0 0 0) 0x7fc03005ee20 con 0x7fc04015ab40 2024-09-15T23:20:02.549 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:02.550 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":493,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":142,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076562384,"bytes_used":2537857024,"bytes_avail":770556256256,"bytes_total":773094113280,"write_bytes_sec":73388196,"read_op_per_sec":0,"write_op_per_sec":72},"fsmap":{"epoch":86,"btime":"2024-09-15T23:19:37:619526+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"d","status":"up:active","gid":8439}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-09-15T23:19:25.606748+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T23:20:02.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.550+0000 7fc0475c4640 1 -- 172.21.15.123:0/2215359286 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc02406c2b0 msgr2=0x7fc02406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:02.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.550+0000 7fc0475c4640 1 --2- 172.21.15.123:0/2215359286 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc02406c2b0 0x7fc02406e770 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc03c000f60 tx=0x7fc03c007d50 comp rx=0 tx=0).stop 2024-09-15T23:20:02.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.550+0000 7fc0475c4640 1 -- 172.21.15.123:0/2215359286 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc04015ab40 msgr2=0x7fc0400c9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:02.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.550+0000 7fc0475c4640 1 --2- 172.21.15.123:0/2215359286 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc04015ab40 0x7fc0400c9ea0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fc03000d800 tx=0x7fc03000dcc0 comp rx=0 tx=0).stop 2024-09-15T23:20:02.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.550+0000 7fc0475c4640 1 -- 172.21.15.123:0/2215359286 shutdown_connections 2024-09-15T23:20:02.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.550+0000 7fc0475c4640 1 --2- 172.21.15.123:0/2215359286 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc04015af20 0x7fc0400c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:02.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.550+0000 7fc0475c4640 1 --2- 172.21.15.123:0/2215359286 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc02406c2b0 0x7fc02406e770 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:02.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.550+0000 7fc0475c4640 1 --2- 172.21.15.123:0/2215359286 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc04015ab40 0x7fc0400c9ea0 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:02.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.550+0000 7fc0475c4640 1 --2- 172.21.15.123:0/2215359286 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc04006c6a0 0x7fc0400cbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:02.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.550+0000 7fc0475c4640 1 -- 172.21.15.123:0/2215359286 >> 172.21.15.123:0/2215359286 conn(0x7fc0400ccec0 msgr2=0x7fc040071fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:02.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.550+0000 7fc0475c4640 1 -- 172.21.15.123:0/2215359286 shutdown_connections 2024-09-15T23:20:02.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:02.550+0000 7fc0475c4640 1 -- 172.21.15.123:0/2215359286 wait complete. 2024-09-15T23:20:02.562 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-15T23:20:03.563 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:20:03.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.673+0000 7f51cbe8d640 1 Processor -- start 2024-09-15T23:20:03.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.673+0000 7f51cbe8d640 1 -- start start 2024-09-15T23:20:03.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.674+0000 7f51cbe8d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f51c40b2d40 0x7f51c406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:03.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.674+0000 7f51cbe8d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51c4071180 con 0x7f51c413eb20 2024-09-15T23:20:03.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.674+0000 7f51cbe8d640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51c4071460 con 0x7f51c406c150 2024-09-15T23:20:03.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.674+0000 7f51cbe8d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f51c4071ab0 con 0x7f51c40b2d40 2024-09-15T23:20:03.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.674+0000 7f51c9428640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f51c413eb20 0x7f51c415bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:50866/0 (socket says 172.21.15.123:50866) 2024-09-15T23:20:03.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.675+0000 7f51c9428640 1 -- 172.21.15.123:0/303609584 learned_addr learned my addr 172.21.15.123:0/303609584 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:03.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.675+0000 7f51c9c29640 1 --2- 172.21.15.123:0/303609584 >> v2:172.21.15.188:3300/0 conn(0x7f51c40b2d40 0x7f51c406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:03.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.675+0000 7f51c8c27640 1 -- 172.21.15.123:0/303609584 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3262335673 0 0) 0x7f51c4071180 con 0x7f51c413eb20 2024-09-15T23:20:03.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.675+0000 7f51c8c27640 1 -- 172.21.15.123:0/303609584 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51ac003520 con 0x7f51c413eb20 2024-09-15T23:20:03.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.675+0000 7f51c8c27640 1 -- 172.21.15.123:0/303609584 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1382495789 0 0) 0x7f51ac003520 con 0x7f51c413eb20 2024-09-15T23:20:03.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.675+0000 7f51c8c27640 1 -- 172.21.15.123:0/303609584 >> v2:172.21.15.188:3300/0 conn(0x7f51c40b2d40 msgr2=0x7f51c406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:03.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.675+0000 7f51c8c27640 1 --2- 172.21.15.123:0/303609584 >> v2:172.21.15.188:3300/0 conn(0x7f51c40b2d40 0x7f51c406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:03.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.675+0000 7f51c8c27640 1 -- 172.21.15.123:0/303609584 >> v1:172.21.15.188:6789/0 conn(0x7f51c406c150 legacy=0x7f51c4071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:03.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.675+0000 7f51c8c27640 1 -- 172.21.15.123:0/303609584 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51c4071740 con 0x7f51c413eb20 2024-09-15T23:20:03.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.675+0000 7f51c8c27640 1 -- 172.21.15.123:0/303609584 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f51b80019f0 con 0x7f51c413eb20 2024-09-15T23:20:03.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.675+0000 7f51c8c27640 1 -- 172.21.15.123:0/303609584 >> v1:172.21.15.123:6789/0 conn(0x7f51c413eb20 legacy=0x7f51c415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:03.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.675+0000 7f51c8c27640 1 --2- 172.21.15.123:0/303609584 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51ac0039b0 0x7f51ac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:03.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.675+0000 7f51c8c27640 1 --2- 172.21.15.123:0/303609584 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f51ac0043b0 0x7f51ac004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:03.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.675+0000 7f51c8c27640 1 --2- 172.21.15.123:0/303609584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51ac005080 0x7f51ac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:03.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.675+0000 7f51c8c27640 1 -- 172.21.15.123:0/303609584 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f51c4071ab0 con 0x7f51ac005080 2024-09-15T23:20:03.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.675+0000 7f51c8c27640 1 -- 172.21.15.123:0/303609584 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f51ac00bfe0 con 0x7f51ac0039b0 2024-09-15T23:20:03.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.675+0000 7f51c8c27640 1 -- 172.21.15.123:0/303609584 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f51ac00c1e0 con 0x7f51ac0043b0 2024-09-15T23:20:03.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.675+0000 7f51c9c29640 1 --2- 172.21.15.123:0/303609584 >> v2:172.21.15.188:3300/0 conn(0x7f51c40b2d40 0x7f51c406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:20:03.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.675+0000 7f51ca42a640 1 --2- 172.21.15.123:0/303609584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51ac005080 0x7f51ac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:03.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.675+0000 7f51c9428640 1 --2- 172.21.15.123:0/303609584 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f51ac0043b0 0x7f51ac004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:03.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.675+0000 7f51c9c29640 1 --2- 172.21.15.123:0/303609584 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51ac0039b0 0x7f51ac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:03.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.676+0000 7f51ca42a640 1 -- 172.21.15.123:0/303609584 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f51ac0043b0 msgr2=0x7f51ac004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:03.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.676+0000 7f51ca42a640 1 --2- 172.21.15.123:0/303609584 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f51ac0043b0 0x7f51ac004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:03.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.676+0000 7f51ca42a640 1 -- 172.21.15.123:0/303609584 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51ac0039b0 msgr2=0x7f51ac003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:03.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.676+0000 7f51ca42a640 1 --2- 172.21.15.123:0/303609584 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51ac0039b0 0x7f51ac003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:03.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.676+0000 7f51ca42a640 1 -- 172.21.15.123:0/303609584 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51ac003520 con 0x7f51ac005080 2024-09-15T23:20:03.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.676+0000 7f51ca42a640 1 -- 172.21.15.123:0/303609584 reap_dead start 2024-09-15T23:20:03.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.676+0000 7f51ca42a640 1 --2- 172.21.15.123:0/303609584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51ac005080 0x7f51ac00b9c0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f51bc001860 tx=0x7f51ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12c3dc7ca671c663 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:03.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.676+0000 7f51c8c27640 1 -- 172.21.15.123:0/303609584 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51bc001430 con 0x7f51ac005080 2024-09-15T23:20:03.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.676+0000 7f51c8c27640 1 -- 172.21.15.123:0/303609584 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51bc005330 con 0x7f51ac005080 2024-09-15T23:20:03.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.676+0000 7f51c8c27640 1 -- 172.21.15.123:0/303609584 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51bc02ac10 con 0x7f51ac005080 2024-09-15T23:20:03.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.677+0000 7f51cbe8d640 1 -- 172.21.15.123:0/303609584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51ac005080 msgr2=0x7f51ac00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:03.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.677+0000 7f51cbe8d640 1 --2- 172.21.15.123:0/303609584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51ac005080 0x7f51ac00b9c0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f51bc001860 tx=0x7f51ac005830 comp rx=0 tx=0).stop 2024-09-15T23:20:03.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.677+0000 7f51cbe8d640 1 -- 172.21.15.123:0/303609584 shutdown_connections 2024-09-15T23:20:03.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.677+0000 7f51cbe8d640 1 --2- 172.21.15.123:0/303609584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51ac005080 0x7f51ac00b9c0 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:03.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.677+0000 7f51cbe8d640 1 -- 172.21.15.123:0/303609584 >> 172.21.15.123:0/303609584 conn(0x7f51c40ccec0 msgr2=0x7f51c40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:03.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.677+0000 7f51cbe8d640 1 -- 172.21.15.123:0/303609584 shutdown_connections 2024-09-15T23:20:03.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.677+0000 7f51cbe8d640 1 -- 172.21.15.123:0/303609584 wait complete. 2024-09-15T23:20:03.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.678+0000 7f51cbe8d640 1 Processor -- start 2024-09-15T23:20:03.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.678+0000 7f51cbe8d640 1 -- start start 2024-09-15T23:20:03.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.679+0000 7f51cbe8d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51ac005080 0x7f51c41f86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:03.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.679+0000 7f51cbe8d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f51c41f5730 0x7f51c41ee530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:03.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.679+0000 7f51cbe8d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51c4143a00 0x7f51c4143e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:03.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.679+0000 7f51cbe8d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f51c406bfa0 con 0x7f51ac005080 2024-09-15T23:20:03.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.679+0000 7f51cbe8d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f51c406be20 con 0x7f51c4143a00 2024-09-15T23:20:03.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.679+0000 7f51cbe8d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f51c415bcf0 con 0x7f51c41f5730 2024-09-15T23:20:03.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.679+0000 7f51c9c29640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51ac005080 0x7f51c41f86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:03.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.679+0000 7f51c9c29640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51ac005080 0x7f51c41f86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57308/0 (socket says 172.21.15.123:57308) 2024-09-15T23:20:03.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.679+0000 7f51c9c29640 1 -- 172.21.15.123:0/2064473735 learned_addr learned my addr 172.21.15.123:0/2064473735 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:03.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.679+0000 7f51c9428640 1 --2- 172.21.15.123:0/2064473735 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f51c41f5730 0x7f51c41ee530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:03.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.679+0000 7f51ca42a640 1 --2- 172.21.15.123:0/2064473735 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51c4143a00 0x7f51c4143e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:03.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.679+0000 7f51c9c29640 1 -- 172.21.15.123:0/2064473735 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f51c41f5730 msgr2=0x7f51c41ee530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:03.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.679+0000 7f51c9c29640 1 --2- 172.21.15.123:0/2064473735 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f51c41f5730 0x7f51c41ee530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:03.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.679+0000 7f51c9c29640 1 -- 172.21.15.123:0/2064473735 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51c4143a00 msgr2=0x7f51c4143e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:03.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.679+0000 7f51c9c29640 1 --2- 172.21.15.123:0/2064473735 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51c4143a00 0x7f51c4143e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:03.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.679+0000 7f51c9c29640 1 -- 172.21.15.123:0/2064473735 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51c415db20 con 0x7f51ac005080 2024-09-15T23:20:03.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.679+0000 7f51c9428640 1 --2- 172.21.15.123:0/2064473735 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f51c41f5730 0x7f51c41ee530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:03.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.679+0000 7f51ca42a640 1 --2- 172.21.15.123:0/2064473735 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51c4143a00 0x7f51c4143e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:20:03.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.680+0000 7f51c9c29640 1 --2- 172.21.15.123:0/2064473735 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51ac005080 0x7f51c41f86d0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f51b40116f0 tx=0x7f51b4011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:03.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.680+0000 7f51c27fc640 1 -- 172.21.15.123:0/2064473735 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b400f9c0 con 0x7f51ac005080 2024-09-15T23:20:03.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.680+0000 7f51c27fc640 1 -- 172.21.15.123:0/2064473735 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51b400fb60 con 0x7f51ac005080 2024-09-15T23:20:03.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.680+0000 7f51cbe8d640 1 -- 172.21.15.123:0/2064473735 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51c41f4b20 con 0x7f51ac005080 2024-09-15T23:20:03.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.680+0000 7f51c27fc640 1 -- 172.21.15.123:0/2064473735 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b4015460 con 0x7f51ac005080 2024-09-15T23:20:03.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.680+0000 7f51cbe8d640 1 -- 172.21.15.123:0/2064473735 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51c41f50e0 con 0x7f51ac005080 2024-09-15T23:20:03.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.681+0000 7f51cbe8d640 1 -- 172.21.15.123:0/2064473735 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51c4076320 con 0x7f51ac005080 2024-09-15T23:20:03.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.681+0000 7f51c27fc640 1 -- 172.21.15.123:0/2064473735 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f51b4015600 con 0x7f51ac005080 2024-09-15T23:20:03.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.682+0000 7f51c27fc640 1 --2- 172.21.15.123:0/2064473735 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f51b006c2b0 0x7f51b006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:03.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.682+0000 7f51c27fc640 1 -- 172.21.15.123:0/2064473735 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f51b408bf50 con 0x7f51ac005080 2024-09-15T23:20:03.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.682+0000 7f51c9428640 1 --2- 172.21.15.123:0/2064473735 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f51b006c2b0 0x7f51b006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:03.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.683+0000 7f51c9428640 1 --2- 172.21.15.123:0/2064473735 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f51b006c2b0 0x7f51b006e770 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f51c413efb0 tx=0x7f51b8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:03.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.686+0000 7f51c27fc640 1 -- 172.21.15.123:0/2064473735 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f51c4076320 con 0x7f51ac005080 2024-09-15T23:20:03.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.885+0000 7f51cbe8d640 1 -- 172.21.15.123:0/2064473735 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51c415c080 con 0x7f51ac005080 2024-09-15T23:20:03.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.885+0000 7f51c27fc640 1 -- 172.21.15.123:0/2064473735 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5237 (secure 0 0 0) 0x7f51c415db20 con 0x7f51ac005080 2024-09-15T23:20:03.886 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:03.887 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":86,"btime":"2024-09-15T23:19:37:619526+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2082746470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2082746470},{"type":"v1","addr":"172.21.15.123:6834","nonce":2082746470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8421,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2007610603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":2007610603},{"type":"v1","addr":"172.21.15.123:6835","nonce":2007610603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8436,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2929123975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2929123975},{"type":"v1","addr":"172.21.15.188:6836","nonce":2929123975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:19:34.917419+0000","modified":"2024-09-15T23:19:36.941347+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8439":{"gid":8439,"name":"d","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6837/1222656979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1222656979},{"type":"v1","addr":"172.21.15.188:6837","nonce":1222656979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8439,"qdb_cluster":[8439]},"id":9}]} 2024-09-15T23:20:03.887 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 86 2024-09-15T23:20:03.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.887+0000 7f51cbe8d640 1 -- 172.21.15.123:0/2064473735 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f51b006c2b0 msgr2=0x7f51b006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:03.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.887+0000 7f51cbe8d640 1 --2- 172.21.15.123:0/2064473735 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f51b006c2b0 0x7f51b006e770 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f51c413efb0 tx=0x7f51b8009040 comp rx=0 tx=0).stop 2024-09-15T23:20:03.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.887+0000 7f51cbe8d640 1 -- 172.21.15.123:0/2064473735 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51ac005080 msgr2=0x7f51c41f86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:03.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.887+0000 7f51cbe8d640 1 --2- 172.21.15.123:0/2064473735 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51ac005080 0x7f51c41f86d0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f51b40116f0 tx=0x7f51b4011bb0 comp rx=0 tx=0).stop 2024-09-15T23:20:03.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.887+0000 7f51cbe8d640 1 -- 172.21.15.123:0/2064473735 shutdown_connections 2024-09-15T23:20:03.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.887+0000 7f51cbe8d640 1 --2- 172.21.15.123:0/2064473735 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f51c4143a00 0x7f51c4143e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:03.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.887+0000 7f51cbe8d640 1 --2- 172.21.15.123:0/2064473735 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f51c41f5730 0x7f51c41ee530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:03.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.887+0000 7f51cbe8d640 1 --2- 172.21.15.123:0/2064473735 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f51b006c2b0 0x7f51b006e770 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:03.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.887+0000 7f51cbe8d640 1 --2- 172.21.15.123:0/2064473735 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51ac005080 0x7f51c41f86d0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:03.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.887+0000 7f51cbe8d640 1 -- 172.21.15.123:0/2064473735 >> 172.21.15.123:0/2064473735 conn(0x7f51c40ccec0 msgr2=0x7f51c40cdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:03.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.887+0000 7f51cbe8d640 1 -- 172.21.15.123:0/2064473735 shutdown_connections 2024-09-15T23:20:03.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.887+0000 7f51cbe8d640 1 -- 172.21.15.123:0/2064473735 wait complete. 2024-09-15T23:20:03.899 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-15T23:20:03.899 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:20:03.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.995+0000 7f383b71a640 1 Processor -- start 2024-09-15T23:20:03.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.995+0000 7f383b71a640 1 -- start start 2024-09-15T23:20:03.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.996+0000 7f383b71a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3834145ed0 0x7f38340b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:03.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.996+0000 7f383b71a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f38340b5f90 0x7f38340735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:03.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.996+0000 7f383b71a640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38340b4020 con 0x7f3834073180 2024-09-15T23:20:03.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.996+0000 7f383b71a640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f3834073b00 con 0x7f38340b5f90 2024-09-15T23:20:03.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.996+0000 7f383b71a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f38340b42c0 con 0x7f3834145ed0 2024-09-15T23:20:03.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.996+0000 7f3839cb7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f38340b5f90 0x7f38340735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:03.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.996+0000 7f3839cb7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f38340b5f90 0x7f38340735c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57314/0 (socket says 172.21.15.123:57314) 2024-09-15T23:20:04.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.996+0000 7f3838cb5640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f3834073180 0x7f38340b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:50880/0 (socket says 172.21.15.123:50880) 2024-09-15T23:20:04.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.996+0000 7f3839cb7640 1 -- 172.21.15.123:0/1223796428 learned_addr learned my addr 172.21.15.123:0/1223796428 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:04.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.996+0000 7f38394b6640 1 --2- 172.21.15.123:0/1223796428 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3834145ed0 0x7f38340b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:04.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.996+0000 7f3839cb7640 1 -- 172.21.15.123:0/1223796428 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3834145ed0 msgr2=0x7f38340b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:04.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.996+0000 7f3839cb7640 1 --2- 172.21.15.123:0/1223796428 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3834145ed0 0x7f38340b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:04.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.996+0000 7f3839cb7640 1 -- 172.21.15.123:0/1223796428 >> v1:172.21.15.123:6789/0 conn(0x7f3834073180 legacy=0x7f38340b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:04.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.996+0000 7f3839cb7640 1 -- 172.21.15.123:0/1223796428 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38340b45a0 con 0x7f38340b5f90 2024-09-15T23:20:04.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.996+0000 7f382bfff640 1 -- 172.21.15.123:0/1223796428 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 430445008 0 0) 0x7f38340b4020 con 0x7f3834073180 2024-09-15T23:20:04.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.996+0000 7f38394b6640 1 --2- 172.21.15.123:0/1223796428 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3834145ed0 0x7f38340b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:20:04.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.997+0000 7f3839cb7640 1 --2- 172.21.15.123:0/1223796428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38340b5f90 0x7f38340735c0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f382c009e50 tx=0x7f382c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da83e0c126256d11 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:04.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.997+0000 7f382bfff640 1 -- 172.21.15.123:0/1223796428 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382c036070 con 0x7f38340b5f90 2024-09-15T23:20:04.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.997+0000 7f382bfff640 1 -- 172.21.15.123:0/1223796428 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f382c031600 con 0x7f38340b5f90 2024-09-15T23:20:04.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.997+0000 7f382bfff640 1 -- 172.21.15.123:0/1223796428 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382c0319d0 con 0x7f38340b5f90 2024-09-15T23:20:04.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.998+0000 7f383b71a640 1 -- 172.21.15.123:0/1223796428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38340b5f90 msgr2=0x7f38340735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:04.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.998+0000 7f383b71a640 1 --2- 172.21.15.123:0/1223796428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38340b5f90 0x7f38340735c0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f382c009e50 tx=0x7f382c02a710 comp rx=0 tx=0).stop 2024-09-15T23:20:04.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.998+0000 7f383b71a640 1 -- 172.21.15.123:0/1223796428 shutdown_connections 2024-09-15T23:20:04.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.998+0000 7f383b71a640 1 --2- 172.21.15.123:0/1223796428 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f38340b5f90 0x7f38340735c0 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:04.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.998+0000 7f383b71a640 1 --2- 172.21.15.123:0/1223796428 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3834145ed0 0x7f38340b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:04.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.998+0000 7f383b71a640 1 -- 172.21.15.123:0/1223796428 >> 172.21.15.123:0/1223796428 conn(0x7f38340ccec0 msgr2=0x7f38340cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:04.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.998+0000 7f383b71a640 1 -- 172.21.15.123:0/1223796428 shutdown_connections 2024-09-15T23:20:04.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.998+0000 7f383b71a640 1 -- 172.21.15.123:0/1223796428 wait complete. 2024-09-15T23:20:04.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.999+0000 7f383b71a640 1 Processor -- start 2024-09-15T23:20:04.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:03.999+0000 7f383b71a640 1 -- start start 2024-09-15T23:20:04.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.000+0000 7f383b71a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3834073180 0x7f383413e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:04.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.000+0000 7f383b71a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f38340b5f90 0x7f383413ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:04.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.000+0000 7f383b71a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3834145ed0 0x7f383413c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:04.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.000+0000 7f383b71a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f38341462b0 con 0x7f3834145ed0 2024-09-15T23:20:04.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.000+0000 7f383b71a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f38340b4b60 con 0x7f3834073180 2024-09-15T23:20:04.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.000+0000 7f383b71a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f3834146430 con 0x7f38340b5f90 2024-09-15T23:20:04.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.000+0000 7f3839cb7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3834145ed0 0x7f383413c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:04.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.000+0000 7f3839cb7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3834145ed0 0x7f383413c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57322/0 (socket says 172.21.15.123:57322) 2024-09-15T23:20:04.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.000+0000 7f3839cb7640 1 -- 172.21.15.123:0/1078131662 learned_addr learned my addr 172.21.15.123:0/1078131662 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:04.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.000+0000 7f3838cb5640 1 --2- 172.21.15.123:0/1078131662 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f38340b5f90 0x7f383413ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:04.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.000+0000 7f38394b6640 1 --2- 172.21.15.123:0/1078131662 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3834073180 0x7f383413e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:04.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.000+0000 7f3839cb7640 1 -- 172.21.15.123:0/1078131662 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f38340b5f90 msgr2=0x7f383413ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:04.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.000+0000 7f3839cb7640 1 --2- 172.21.15.123:0/1078131662 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f38340b5f90 0x7f383413ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:04.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.000+0000 7f3839cb7640 1 -- 172.21.15.123:0/1078131662 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3834073180 msgr2=0x7f383413e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:04.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.000+0000 7f3839cb7640 1 --2- 172.21.15.123:0/1078131662 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3834073180 0x7f383413e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:04.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.000+0000 7f3839cb7640 1 -- 172.21.15.123:0/1078131662 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3834142550 con 0x7f3834145ed0 2024-09-15T23:20:04.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.000+0000 7f3838cb5640 1 --2- 172.21.15.123:0/1078131662 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f38340b5f90 0x7f383413ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:04.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.000+0000 7f3839cb7640 1 --2- 172.21.15.123:0/1078131662 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3834145ed0 0x7f383413c620 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f382c009e50 tx=0x7f382c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:04.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.001+0000 7f3829ffb640 1 -- 172.21.15.123:0/1078131662 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382c036050 con 0x7f3834145ed0 2024-09-15T23:20:04.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.001+0000 7f3829ffb640 1 -- 172.21.15.123:0/1078131662 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f382c042070 con 0x7f3834145ed0 2024-09-15T23:20:04.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.001+0000 7f383b71a640 1 -- 172.21.15.123:0/1078131662 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3834142830 con 0x7f3834145ed0 2024-09-15T23:20:04.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.001+0000 7f3829ffb640 1 -- 172.21.15.123:0/1078131662 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382c009510 con 0x7f3834145ed0 2024-09-15T23:20:04.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.001+0000 7f383b71a640 1 -- 172.21.15.123:0/1078131662 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3834153ba0 con 0x7f3834145ed0 2024-09-15T23:20:04.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.002+0000 7f383b71a640 1 -- 172.21.15.123:0/1078131662 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3834142c20 con 0x7f3834145ed0 2024-09-15T23:20:04.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.002+0000 7f3829ffb640 1 -- 172.21.15.123:0/1078131662 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f382c007bd0 con 0x7f3834145ed0 2024-09-15T23:20:04.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.003+0000 7f3829ffb640 1 --2- 172.21.15.123:0/1078131662 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f381806c2b0 0x7f381806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:04.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.003+0000 7f3829ffb640 1 -- 172.21.15.123:0/1078131662 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f382c0ac3e0 con 0x7f3834145ed0 2024-09-15T23:20:04.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.003+0000 7f38394b6640 1 --2- 172.21.15.123:0/1078131662 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f381806c2b0 0x7f381806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:04.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.003+0000 7f38394b6640 1 --2- 172.21.15.123:0/1078131662 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f381806c2b0 0x7f381806e770 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3834143eb0 tx=0x7f3830008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:04.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.007+0000 7f3829ffb640 1 -- 172.21.15.123:0/1078131662 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3834142c20 con 0x7f3834145ed0 2024-09-15T23:20:04.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.234+0000 7f383b71a640 1 -- 172.21.15.123:0/1078131662 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f38340735c0 con 0x7f3834145ed0 2024-09-15T23:20:04.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.234+0000 7f3829ffb640 1 -- 172.21.15.123:0/1078131662 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1488 (secure 0 0 0) 0x7f382c07ab50 con 0x7f3834145ed0 2024-09-15T23:20:04.235 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:04.235 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":494,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":142,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076562384,"bytes_used":2537857024,"bytes_avail":770556256256,"bytes_total":773094113280,"write_bytes_sec":73388196,"read_op_per_sec":0,"write_op_per_sec":72},"fsmap":{"epoch":86,"btime":"2024-09-15T23:19:37:619526+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"d","status":"up:active","gid":8439}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2024-09-15T23:19:25.606748+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T23:20:04.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.236+0000 7f383b71a640 1 -- 172.21.15.123:0/1078131662 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f381806c2b0 msgr2=0x7f381806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:04.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.236+0000 7f383b71a640 1 --2- 172.21.15.123:0/1078131662 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f381806c2b0 0x7f381806e770 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3834143eb0 tx=0x7f3830008040 comp rx=0 tx=0).stop 2024-09-15T23:20:04.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.236+0000 7f383b71a640 1 -- 172.21.15.123:0/1078131662 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3834145ed0 msgr2=0x7f383413c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:04.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.236+0000 7f383b71a640 1 --2- 172.21.15.123:0/1078131662 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3834145ed0 0x7f383413c620 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f382c009e50 tx=0x7f382c004a40 comp rx=0 tx=0).stop 2024-09-15T23:20:04.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.236+0000 7f383b71a640 1 -- 172.21.15.123:0/1078131662 shutdown_connections 2024-09-15T23:20:04.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.236+0000 7f383b71a640 1 --2- 172.21.15.123:0/1078131662 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f381806c2b0 0x7f381806e770 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:04.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.236+0000 7f383b71a640 1 --2- 172.21.15.123:0/1078131662 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3834145ed0 0x7f383413c620 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:04.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.236+0000 7f383b71a640 1 --2- 172.21.15.123:0/1078131662 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f38340b5f90 0x7f383413ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:04.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.236+0000 7f383b71a640 1 --2- 172.21.15.123:0/1078131662 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3834073180 0x7f383413e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:04.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.236+0000 7f383b71a640 1 -- 172.21.15.123:0/1078131662 >> 172.21.15.123:0/1078131662 conn(0x7f38340ccec0 msgr2=0x7f3834159290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:04.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.236+0000 7f383b71a640 1 -- 172.21.15.123:0/1078131662 shutdown_connections 2024-09-15T23:20:04.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:04.236+0000 7f383b71a640 1 -- 172.21.15.123:0/1078131662 wait complete. 2024-09-15T23:20:04.248 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-15T23:20:05.249 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:20:05.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.357+0000 7f8470a65640 1 Processor -- start 2024-09-15T23:20:05.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.357+0000 7f8470a65640 1 -- start start 2024-09-15T23:20:05.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.358+0000 7f8470a65640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f846c15ed20 0x7f846c0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:05.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.358+0000 7f8470a65640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f846c0d23b0 0x7f846c0b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:05.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.358+0000 7f8470a65640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f846c0d0e70 con 0x7f846c0cf2d0 2024-09-15T23:20:05.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.358+0000 7f8470a65640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f846c0d41c0 con 0x7f846c0d23b0 2024-09-15T23:20:05.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.358+0000 7f8470a65640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f846c0d35b0 con 0x7f846c15ed20 2024-09-15T23:20:05.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.358+0000 7f8469d9b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f846c0d23b0 0x7f846c0b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:05.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.358+0000 7f846ad9d640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f846c0cf2d0 0x7f846c0cf700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:50892/0 (socket says 172.21.15.123:50892) 2024-09-15T23:20:05.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.358+0000 7f846ad9d640 1 -- 172.21.15.123:0/1832340525 learned_addr learned my addr 172.21.15.123:0/1832340525 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:05.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.359+0000 7f8469d9b640 1 -- 172.21.15.123:0/1832340525 >> v2:172.21.15.188:3300/0 conn(0x7f846c15ed20 msgr2=0x7f846c0b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:05.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.359+0000 7f8469d9b640 1 --2- 172.21.15.123:0/1832340525 >> v2:172.21.15.188:3300/0 conn(0x7f846c15ed20 0x7f846c0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:05.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.359+0000 7f8469d9b640 1 -- 172.21.15.123:0/1832340525 >> v1:172.21.15.123:6789/0 conn(0x7f846c0cf2d0 legacy=0x7f846c0cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:05.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.359+0000 7f8469d9b640 1 -- 172.21.15.123:0/1832340525 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f846c0d3890 con 0x7f846c0d23b0 2024-09-15T23:20:05.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.359+0000 7f8469d9b640 1 --2- 172.21.15.123:0/1832340525 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f846c0d23b0 0x7f846c0b67a0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f846c0d47b0 tx=0x7f845402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e644bd59bccceb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:05.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.360+0000 7f846959a640 1 -- 172.21.15.123:0/1832340525 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8454037070 con 0x7f846c0d23b0 2024-09-15T23:20:05.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.360+0000 7f846959a640 1 -- 172.21.15.123:0/1832340525 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8454032440 con 0x7f846c0d23b0 2024-09-15T23:20:05.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.360+0000 7f846959a640 1 -- 172.21.15.123:0/1832340525 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f845402ae60 con 0x7f846c0d23b0 2024-09-15T23:20:05.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.360+0000 7f8470a65640 1 -- 172.21.15.123:0/1832340525 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f846c0d23b0 msgr2=0x7f846c0b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:05.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.360+0000 7f8470a65640 1 --2- 172.21.15.123:0/1832340525 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f846c0d23b0 0x7f846c0b67a0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f846c0d47b0 tx=0x7f845402a110 comp rx=0 tx=0).stop 2024-09-15T23:20:05.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.360+0000 7f8470a65640 1 -- 172.21.15.123:0/1832340525 shutdown_connections 2024-09-15T23:20:05.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.360+0000 7f8470a65640 1 --2- 172.21.15.123:0/1832340525 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f846c0d23b0 0x7f846c0b67a0 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:05.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.360+0000 7f8470a65640 1 --2- 172.21.15.123:0/1832340525 >> v2:172.21.15.188:3300/0 conn(0x7f846c15ed20 0x7f846c0b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:05.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.360+0000 7f8470a65640 1 -- 172.21.15.123:0/1832340525 >> 172.21.15.123:0/1832340525 conn(0x7f846c0d1260 msgr2=0x7f846c0d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:05.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.360+0000 7f8470a65640 1 -- 172.21.15.123:0/1832340525 shutdown_connections 2024-09-15T23:20:05.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.360+0000 7f8470a65640 1 -- 172.21.15.123:0/1832340525 wait complete. 2024-09-15T23:20:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.362+0000 7f8470a65640 1 Processor -- start 2024-09-15T23:20:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.362+0000 7f8470a65640 1 -- start start 2024-09-15T23:20:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.362+0000 7f8470a65640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f846c0cf2d0 0x7f846c0c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.362+0000 7f8470a65640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f846c0d23b0 0x7f846c1f4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.362+0000 7f8470a65640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f846c15ed20 0x7f846c0cad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.362+0000 7f8470a65640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f846c0d32a0 con 0x7f846c15ed20 2024-09-15T23:20:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.362+0000 7f8470a65640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f846c0d3e50 con 0x7f846c0cf2d0 2024-09-15T23:20:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.362+0000 7f8470a65640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f846c15f100 con 0x7f846c0d23b0 2024-09-15T23:20:05.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.363+0000 7f846ad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f846c15ed20 0x7f846c0cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.363+0000 7f846ad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f846c15ed20 0x7f846c0cad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57338/0 (socket says 172.21.15.123:57338) 2024-09-15T23:20:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.363+0000 7f846ad9d640 1 -- 172.21.15.123:0/397642734 learned_addr learned my addr 172.21.15.123:0/397642734 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.363+0000 7f846a59c640 1 --2- 172.21.15.123:0/397642734 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f846c0cf2d0 0x7f846c0c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.363+0000 7f8469d9b640 1 --2- 172.21.15.123:0/397642734 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f846c0d23b0 0x7f846c1f4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.363+0000 7f846ad9d640 1 -- 172.21.15.123:0/397642734 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f846c0d23b0 msgr2=0x7f846c1f4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.363+0000 7f846ad9d640 1 --2- 172.21.15.123:0/397642734 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f846c0d23b0 0x7f846c1f4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.363+0000 7f846ad9d640 1 -- 172.21.15.123:0/397642734 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f846c0cf2d0 msgr2=0x7f846c0c9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.363+0000 7f846ad9d640 1 --2- 172.21.15.123:0/397642734 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f846c0cf2d0 0x7f846c0c9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.363+0000 7f846ad9d640 1 -- 172.21.15.123:0/397642734 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f846c0ccd90 con 0x7f846c15ed20 2024-09-15T23:20:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.363+0000 7f846a59c640 1 --2- 172.21.15.123:0/397642734 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f846c0cf2d0 0x7f846c0c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.363+0000 7f846ad9d640 1 --2- 172.21.15.123:0/397642734 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f846c15ed20 0x7f846c0cad50 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f846400c370 tx=0x7f846400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.363+0000 7f8462ffd640 1 -- 172.21.15.123:0/397642734 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8464017070 con 0x7f846c15ed20 2024-09-15T23:20:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.363+0000 7f8462ffd640 1 -- 172.21.15.123:0/397642734 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8464005ce0 con 0x7f846c15ed20 2024-09-15T23:20:05.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.363+0000 7f8462ffd640 1 -- 172.21.15.123:0/397642734 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84640072d0 con 0x7f846c15ed20 2024-09-15T23:20:05.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.363+0000 7f8470a65640 1 -- 172.21.15.123:0/397642734 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f846c0cd070 con 0x7f846c15ed20 2024-09-15T23:20:05.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.363+0000 7f8470a65640 1 -- 172.21.15.123:0/397642734 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f846c0cd630 con 0x7f846c15ed20 2024-09-15T23:20:05.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.364+0000 7f8470a65640 1 -- 172.21.15.123:0/397642734 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f846c0b7010 con 0x7f846c15ed20 2024-09-15T23:20:05.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.365+0000 7f8462ffd640 1 -- 172.21.15.123:0/397642734 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f846401a070 con 0x7f846c15ed20 2024-09-15T23:20:05.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.365+0000 7f8462ffd640 1 --2- 172.21.15.123:0/397642734 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f844c06c2b0 0x7f844c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:05.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.365+0000 7f8462ffd640 1 -- 172.21.15.123:0/397642734 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f846408a600 con 0x7f846c15ed20 2024-09-15T23:20:05.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.365+0000 7f846a59c640 1 --2- 172.21.15.123:0/397642734 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f844c06c2b0 0x7f844c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:05.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.366+0000 7f846a59c640 1 --2- 172.21.15.123:0/397642734 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f844c06c2b0 0x7f844c06e770 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f846c0c87b0 tx=0x7f845c009570 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:05.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.370+0000 7f8462ffd640 1 -- 172.21.15.123:0/397642734 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f846c0d0e70 con 0x7f846c15ed20 2024-09-15T23:20:05.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.567+0000 7f8470a65640 1 -- 172.21.15.123:0/397642734 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f846c0d0a90 con 0x7f846c15ed20 2024-09-15T23:20:05.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.568+0000 7f8462ffd640 1 -- 172.21.15.123:0/397642734 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5237 (secure 0 0 0) 0x7f84640587b0 con 0x7f846c15ed20 2024-09-15T23:20:05.569 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:05.569 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":86,"btime":"2024-09-15T23:19:37:619526+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2082746470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2082746470},{"type":"v1","addr":"172.21.15.123:6834","nonce":2082746470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8421,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2007610603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":2007610603},{"type":"v1","addr":"172.21.15.123:6835","nonce":2007610603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8436,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2929123975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2929123975},{"type":"v1","addr":"172.21.15.188:6836","nonce":2929123975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:19:34.917419+0000","modified":"2024-09-15T23:19:36.941347+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8439":{"gid":8439,"name":"d","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6837/1222656979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1222656979},{"type":"v1","addr":"172.21.15.188:6837","nonce":1222656979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8439,"qdb_cluster":[8439]},"id":9}]} 2024-09-15T23:20:05.570 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 86 2024-09-15T23:20:05.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.570+0000 7f8470a65640 1 -- 172.21.15.123:0/397642734 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f844c06c2b0 msgr2=0x7f844c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:05.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.570+0000 7f8470a65640 1 --2- 172.21.15.123:0/397642734 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f844c06c2b0 0x7f844c06e770 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f846c0c87b0 tx=0x7f845c009570 comp rx=0 tx=0).stop 2024-09-15T23:20:05.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.570+0000 7f8470a65640 1 -- 172.21.15.123:0/397642734 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f846c15ed20 msgr2=0x7f846c0cad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:05.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.570+0000 7f8470a65640 1 --2- 172.21.15.123:0/397642734 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f846c15ed20 0x7f846c0cad50 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f846400c370 tx=0x7f846400c830 comp rx=0 tx=0).stop 2024-09-15T23:20:05.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.570+0000 7f8470a65640 1 -- 172.21.15.123:0/397642734 shutdown_connections 2024-09-15T23:20:05.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.570+0000 7f8470a65640 1 --2- 172.21.15.123:0/397642734 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f844c06c2b0 0x7f844c06e770 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:05.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.570+0000 7f8470a65640 1 --2- 172.21.15.123:0/397642734 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f846c15ed20 0x7f846c0cad50 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:05.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.570+0000 7f8470a65640 1 --2- 172.21.15.123:0/397642734 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f846c0d23b0 0x7f846c1f4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:05.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.570+0000 7f8470a65640 1 --2- 172.21.15.123:0/397642734 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f846c0cf2d0 0x7f846c0c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:05.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.570+0000 7f8470a65640 1 -- 172.21.15.123:0/397642734 >> 172.21.15.123:0/397642734 conn(0x7f846c0d1260 msgr2=0x7f846c1e8740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:05.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.570+0000 7f8470a65640 1 -- 172.21.15.123:0/397642734 shutdown_connections 2024-09-15T23:20:05.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.570+0000 7f8470a65640 1 -- 172.21.15.123:0/397642734 wait complete. 2024-09-15T23:20:05.582 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-15T23:20:05.582 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:20:05.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.678+0000 7fcce24ac640 1 Processor -- start 2024-09-15T23:20:05.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.678+0000 7fcce24ac640 1 -- start start 2024-09-15T23:20:05.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.679+0000 7fcce24ac640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fccdc06c320 0x7fccdc15bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:05.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.679+0000 7fcce24ac640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccdc071180 con 0x7fccdc0b2d40 2024-09-15T23:20:05.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.679+0000 7fcce24ac640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccdc071460 con 0x7fccdc13eb20 2024-09-15T23:20:05.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.679+0000 7fcce24ac640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fccdc071ab0 con 0x7fccdc06c320 2024-09-15T23:20:05.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.679+0000 7fccdbfff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fccdc0b2d40 0x7fccdc06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:50904/0 (socket says 172.21.15.123:50904) 2024-09-15T23:20:05.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.679+0000 7fccdbfff640 1 -- 172.21.15.123:0/830224811 learned_addr learned my addr 172.21.15.123:0/830224811 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:05.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.679+0000 7fccdaffd640 1 -- 172.21.15.123:0/830224811 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 365176870 0 0) 0x7fccdc071180 con 0x7fccdc0b2d40 2024-09-15T23:20:05.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.679+0000 7fccdb7fe640 1 --2- 172.21.15.123:0/830224811 >> v2:172.21.15.188:3300/0 conn(0x7fccdc06c320 0x7fccdc15bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:05.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.679+0000 7fccdaffd640 1 -- 172.21.15.123:0/830224811 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fccc4003520 con 0x7fccdc0b2d40 2024-09-15T23:20:05.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.679+0000 7fccdaffd640 1 -- 172.21.15.123:0/830224811 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4037586808 0 0) 0x7fccc4003520 con 0x7fccdc0b2d40 2024-09-15T23:20:05.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.679+0000 7fccdaffd640 1 -- 172.21.15.123:0/830224811 >> v2:172.21.15.188:3300/0 conn(0x7fccdc06c320 msgr2=0x7fccdc15bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:05.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.679+0000 7fccdaffd640 1 --2- 172.21.15.123:0/830224811 >> v2:172.21.15.188:3300/0 conn(0x7fccdc06c320 0x7fccdc15bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:05.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.679+0000 7fccdaffd640 1 -- 172.21.15.123:0/830224811 >> v1:172.21.15.188:6789/0 conn(0x7fccdc13eb20 legacy=0x7fccdc15c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:05.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.679+0000 7fccdaffd640 1 -- 172.21.15.123:0/830224811 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccdc071740 con 0x7fccdc0b2d40 2024-09-15T23:20:05.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.679+0000 7fccdaffd640 1 -- 172.21.15.123:0/830224811 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fcccc001670 con 0x7fccdc0b2d40 2024-09-15T23:20:05.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.679+0000 7fccdaffd640 1 -- 172.21.15.123:0/830224811 >> v1:172.21.15.123:6789/0 conn(0x7fccdc0b2d40 legacy=0x7fccdc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:05.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.679+0000 7fccdaffd640 1 --2- 172.21.15.123:0/830224811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fccc40039b0 0x7fccc4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:05.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.679+0000 7fccdaffd640 1 --2- 172.21.15.123:0/830224811 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fccc4004800 0x7fccc4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:05.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.680+0000 7fccdaffd640 1 --2- 172.21.15.123:0/830224811 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fccc40051c0 0x7fccc400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:05.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.680+0000 7fccdaffd640 1 -- 172.21.15.123:0/830224811 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fccdc071ab0 con 0x7fccc40039b0 2024-09-15T23:20:05.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.680+0000 7fccdaffd640 1 -- 172.21.15.123:0/830224811 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fccc400c060 con 0x7fccc40051c0 2024-09-15T23:20:05.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.680+0000 7fccdaffd640 1 -- 172.21.15.123:0/830224811 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fccc400c260 con 0x7fccc4004800 2024-09-15T23:20:05.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.680+0000 7fccdbfff640 1 --2- 172.21.15.123:0/830224811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fccc40039b0 0x7fccc4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:05.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.680+0000 7fcce0a49640 1 --2- 172.21.15.123:0/830224811 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fccc40051c0 0x7fccc400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:05.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.680+0000 7fccdb7fe640 1 --2- 172.21.15.123:0/830224811 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fccc4004800 0x7fccc4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:05.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.680+0000 7fccdbfff640 1 -- 172.21.15.123:0/830224811 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fccc4004800 msgr2=0x7fccc4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:05.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.680+0000 7fccdbfff640 1 --2- 172.21.15.123:0/830224811 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fccc4004800 0x7fccc4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:05.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.680+0000 7fccdbfff640 1 -- 172.21.15.123:0/830224811 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fccc40051c0 msgr2=0x7fccc400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:05.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.680+0000 7fccdbfff640 1 --2- 172.21.15.123:0/830224811 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fccc40051c0 0x7fccc400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:05.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.680+0000 7fccdbfff640 1 -- 172.21.15.123:0/830224811 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccc4003520 con 0x7fccc40039b0 2024-09-15T23:20:05.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.680+0000 7fcce0a49640 1 -- 172.21.15.123:0/830224811 reap_dead start 2024-09-15T23:20:05.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.681+0000 7fccdbfff640 1 --2- 172.21.15.123:0/830224811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fccc40039b0 0x7fccc4003dd0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00c240 tx=0x7fccc4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab6daff6aeec8a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:05.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.681+0000 7fccdaffd640 1 -- 172.21.15.123:0/830224811 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc007cf0 con 0x7fccc40039b0 2024-09-15T23:20:05.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.681+0000 7fccdaffd640 1 -- 172.21.15.123:0/830224811 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcccc0058d0 con 0x7fccc40039b0 2024-09-15T23:20:05.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.681+0000 7fccdaffd640 1 -- 172.21.15.123:0/830224811 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc005ca0 con 0x7fccc40039b0 2024-09-15T23:20:05.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.681+0000 7fcce24ac640 1 -- 172.21.15.123:0/830224811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fccc40039b0 msgr2=0x7fccc4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:05.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.681+0000 7fcce24ac640 1 --2- 172.21.15.123:0/830224811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fccc40039b0 0x7fccc4003dd0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00c240 tx=0x7fccc4005830 comp rx=0 tx=0).stop 2024-09-15T23:20:05.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.681+0000 7fcce24ac640 1 -- 172.21.15.123:0/830224811 shutdown_connections 2024-09-15T23:20:05.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.681+0000 7fcce24ac640 1 --2- 172.21.15.123:0/830224811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fccc40039b0 0x7fccc4003dd0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:05.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.681+0000 7fcce24ac640 1 -- 172.21.15.123:0/830224811 >> 172.21.15.123:0/830224811 conn(0x7fccdc0ccec0 msgr2=0x7fccdc0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:05.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.681+0000 7fcce24ac640 1 -- 172.21.15.123:0/830224811 shutdown_connections 2024-09-15T23:20:05.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.681+0000 7fcce24ac640 1 -- 172.21.15.123:0/830224811 wait complete. 2024-09-15T23:20:05.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.682+0000 7fcce24ac640 1 Processor -- start 2024-09-15T23:20:05.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.683+0000 7fcce24ac640 1 -- start start 2024-09-15T23:20:05.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.683+0000 7fcce24ac640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fccc40039b0 0x7fccdc0cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:05.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.683+0000 7fcce24ac640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fccdc0c9820 0x7fccdc0cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:05.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.683+0000 7fcce24ac640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fccdc0c9c80 0x7fccdc0cb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:05.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.683+0000 7fcce24ac640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fccdc06bfa0 con 0x7fccdc0c9820 2024-09-15T23:20:05.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.683+0000 7fcce24ac640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fccdc06be20 con 0x7fccc40039b0 2024-09-15T23:20:05.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.683+0000 7fcce24ac640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fccdc06c120 con 0x7fccdc0c9c80 2024-09-15T23:20:05.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.683+0000 7fccdb7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fccdc0c9820 0x7fccdc0cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:05.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.683+0000 7fccdb7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fccdc0c9820 0x7fccdc0cb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57368/0 (socket says 172.21.15.123:57368) 2024-09-15T23:20:05.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.683+0000 7fccdb7fe640 1 -- 172.21.15.123:0/593421968 learned_addr learned my addr 172.21.15.123:0/593421968 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:05.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.684+0000 7fcce0a49640 1 --2- 172.21.15.123:0/593421968 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fccdc0c9c80 0x7fccdc0cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:05.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.684+0000 7fccdbfff640 1 --2- 172.21.15.123:0/593421968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fccc40039b0 0x7fccdc0cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:05.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.684+0000 7fccdb7fe640 1 -- 172.21.15.123:0/593421968 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fccdc0c9c80 msgr2=0x7fccdc0cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:05.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.684+0000 7fccdb7fe640 1 --2- 172.21.15.123:0/593421968 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fccdc0c9c80 0x7fccdc0cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:05.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.684+0000 7fccdb7fe640 1 -- 172.21.15.123:0/593421968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fccc40039b0 msgr2=0x7fccdc0cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:05.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.684+0000 7fccdb7fe640 1 --2- 172.21.15.123:0/593421968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fccc40039b0 0x7fccdc0cc5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:05.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.684+0000 7fccdb7fe640 1 -- 172.21.15.123:0/593421968 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccdc1401d0 con 0x7fccdc0c9820 2024-09-15T23:20:05.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.684+0000 7fccdb7fe640 1 --2- 172.21.15.123:0/593421968 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fccdc0c9820 0x7fccdc0cb3e0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fccd0011aa0 tx=0x7fccd0011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:05.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.684+0000 7fccd8ff9640 1 -- 172.21.15.123:0/593421968 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd000fb20 con 0x7fccdc0c9820 2024-09-15T23:20:05.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.684+0000 7fccd8ff9640 1 -- 172.21.15.123:0/593421968 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccd000fcc0 con 0x7fccdc0c9820 2024-09-15T23:20:05.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.684+0000 7fcce24ac640 1 -- 172.21.15.123:0/593421968 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccdc1404b0 con 0x7fccdc0c9820 2024-09-15T23:20:05.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.684+0000 7fccd8ff9640 1 -- 172.21.15.123:0/593421968 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd0014660 con 0x7fccdc0c9820 2024-09-15T23:20:05.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.684+0000 7fcce24ac640 1 -- 172.21.15.123:0/593421968 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccdc140a70 con 0x7fccdc0c9820 2024-09-15T23:20:05.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.685+0000 7fcce24ac640 1 -- 172.21.15.123:0/593421968 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccdc0d1550 con 0x7fccdc0c9820 2024-09-15T23:20:05.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.686+0000 7fccd8ff9640 1 -- 172.21.15.123:0/593421968 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fccd0012040 con 0x7fccdc0c9820 2024-09-15T23:20:05.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.686+0000 7fccd8ff9640 1 --2- 172.21.15.123:0/593421968 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fccc806c2b0 0x7fccc806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:05.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.686+0000 7fccd8ff9640 1 -- 172.21.15.123:0/593421968 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fccd008bab0 con 0x7fccdc0c9820 2024-09-15T23:20:05.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.686+0000 7fccdbfff640 1 --2- 172.21.15.123:0/593421968 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fccc806c2b0 0x7fccc806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:05.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.687+0000 7fccdbfff640 1 --2- 172.21.15.123:0/593421968 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fccc806c2b0 0x7fccc806e770 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fcccc033000 tx=0x7fcccc009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:05.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.690+0000 7fccd8ff9640 1 -- 172.21.15.123:0/593421968 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fccdc0d1550 con 0x7fccdc0c9820 2024-09-15T23:20:05.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.922+0000 7fcce24ac640 1 -- 172.21.15.123:0/593421968 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fccdc15bcf0 con 0x7fccdc0c9820 2024-09-15T23:20:05.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.922+0000 7fccd8ff9640 1 -- 172.21.15.123:0/593421968 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1640 (secure 0 0 0) 0x7fccd0019030 con 0x7fccdc0c9820 2024-09-15T23:20:05.923 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:05.923 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":496,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":142,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076566731,"bytes_used":2537865216,"bytes_avail":770556248064,"bytes_total":773094113280,"write_bytes_sec":51460617,"read_op_per_sec":0,"write_op_per_sec":51},"fsmap":{"epoch":86,"btime":"2024-09-15T23:19:37:619526+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"d","status":"up:active","gid":8439}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-09-15T23:20:03.615835+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}}}}}},"progress_events":{}} 2024-09-15T23:20:05.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.924+0000 7fcce24ac640 1 -- 172.21.15.123:0/593421968 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fccc806c2b0 msgr2=0x7fccc806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:05.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.924+0000 7fcce24ac640 1 --2- 172.21.15.123:0/593421968 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fccc806c2b0 0x7fccc806e770 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fcccc033000 tx=0x7fcccc009030 comp rx=0 tx=0).stop 2024-09-15T23:20:05.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.924+0000 7fcce24ac640 1 -- 172.21.15.123:0/593421968 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fccdc0c9820 msgr2=0x7fccdc0cb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:05.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.924+0000 7fcce24ac640 1 --2- 172.21.15.123:0/593421968 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fccdc0c9820 0x7fccdc0cb3e0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fccd0011aa0 tx=0x7fccd0011f60 comp rx=0 tx=0).stop 2024-09-15T23:20:05.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.924+0000 7fcce24ac640 1 -- 172.21.15.123:0/593421968 shutdown_connections 2024-09-15T23:20:05.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.924+0000 7fcce24ac640 1 --2- 172.21.15.123:0/593421968 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fccdc0c9c80 0x7fccdc0cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:05.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.924+0000 7fcce24ac640 1 --2- 172.21.15.123:0/593421968 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fccc806c2b0 0x7fccc806e770 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:05.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.924+0000 7fcce24ac640 1 --2- 172.21.15.123:0/593421968 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fccdc0c9820 0x7fccdc0cb3e0 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:05.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.924+0000 7fcce24ac640 1 --2- 172.21.15.123:0/593421968 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fccc40039b0 0x7fccdc0cc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:05.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.924+0000 7fcce24ac640 1 -- 172.21.15.123:0/593421968 >> 172.21.15.123:0/593421968 conn(0x7fccdc0ccec0 msgr2=0x7fccdc1595c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:05.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.924+0000 7fcce24ac640 1 -- 172.21.15.123:0/593421968 shutdown_connections 2024-09-15T23:20:05.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:05.924+0000 7fcce24ac640 1 -- 172.21.15.123:0/593421968 wait complete. 2024-09-15T23:20:05.936 INFO:tasks.ceph.ceph_manager.ceph:{'d': 'paused'} 2024-09-15T23:20:05.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:20:05.936 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub resume 2024-09-15T23:20:06.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.035+0000 7fd4e77d8640 1 Processor -- start 2024-09-15T23:20:06.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.036+0000 7fd4e77d8640 1 -- start start 2024-09-15T23:20:06.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.036+0000 7fd4e77d8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd4e00ccf30 0x7fd4e00b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.036+0000 7fd4e77d8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd4e015b7c0 0x7fd4e00cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.036+0000 7fd4e77d8640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4e00cd850 con 0x7fd4e00cead0 2024-09-15T23:20:06.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.036+0000 7fd4e77d8640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fd4e00cf2e0 con 0x7fd4e00ccf30 2024-09-15T23:20:06.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.036+0000 7fd4e77d8640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fd4e0070fe0 con 0x7fd4e015b7c0 2024-09-15T23:20:06.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.037+0000 7fd4e5574640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd4e00ccf30 0x7fd4e00b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.037+0000 7fd4e5574640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd4e00ccf30 0x7fd4e00b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57370/0 (socket says 172.21.15.123:57370) 2024-09-15T23:20:06.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.037+0000 7fd4e5574640 1 -- 172.21.15.123:0/2861210639 learned_addr learned my addr 172.21.15.123:0/2861210639 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:06.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.037+0000 7fd4e4d73640 1 --2- 172.21.15.123:0/2861210639 >> v2:172.21.15.188:3300/0 conn(0x7fd4e015b7c0 0x7fd4e00cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.037+0000 7fd4e5574640 1 -- 172.21.15.123:0/2861210639 >> v2:172.21.15.188:3300/0 conn(0x7fd4e015b7c0 msgr2=0x7fd4e00cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:06.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.037+0000 7fd4e5574640 1 --2- 172.21.15.123:0/2861210639 >> v2:172.21.15.188:3300/0 conn(0x7fd4e015b7c0 0x7fd4e00cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.037+0000 7fd4e5574640 1 -- 172.21.15.123:0/2861210639 >> v1:172.21.15.188:6789/0 conn(0x7fd4e00cead0 legacy=0x7fd4e015f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:06.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.037+0000 7fd4e5574640 1 -- 172.21.15.123:0/2861210639 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e00712c0 con 0x7fd4e00ccf30 2024-09-15T23:20:06.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.037+0000 7fd4e4d73640 1 --2- 172.21.15.123:0/2861210639 >> v2:172.21.15.188:3300/0 conn(0x7fd4e015b7c0 0x7fd4e00cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:06.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.038+0000 7fd4e5574640 1 --2- 172.21.15.123:0/2861210639 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4e00ccf30 0x7fd4e00b2c50 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fd4e01601f0 tx=0x7fd4d402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8434dd68c496ccdc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:06.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.038+0000 7fd4d3fff640 1 -- 172.21.15.123:0/2861210639 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d4037070 con 0x7fd4e00ccf30 2024-09-15T23:20:06.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.038+0000 7fd4d3fff640 1 -- 172.21.15.123:0/2861210639 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4d4032440 con 0x7fd4e00ccf30 2024-09-15T23:20:06.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.038+0000 7fd4d3fff640 1 -- 172.21.15.123:0/2861210639 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d4032810 con 0x7fd4e00ccf30 2024-09-15T23:20:06.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.038+0000 7fd4e77d8640 1 -- 172.21.15.123:0/2861210639 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4e00ccf30 msgr2=0x7fd4e00b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:06.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.038+0000 7fd4e77d8640 1 --2- 172.21.15.123:0/2861210639 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4e00ccf30 0x7fd4e00b2c50 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fd4e01601f0 tx=0x7fd4d402a1e0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.038+0000 7fd4e77d8640 1 -- 172.21.15.123:0/2861210639 shutdown_connections 2024-09-15T23:20:06.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.038+0000 7fd4e77d8640 1 --2- 172.21.15.123:0/2861210639 >> v2:172.21.15.188:3300/0 conn(0x7fd4e015b7c0 0x7fd4e00cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.038+0000 7fd4e77d8640 1 --2- 172.21.15.123:0/2861210639 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4e00ccf30 0x7fd4e00b2c50 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.038+0000 7fd4e77d8640 1 -- 172.21.15.123:0/2861210639 >> 172.21.15.123:0/2861210639 conn(0x7fd4e006d0f0 msgr2=0x7fd4e006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:06.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.038+0000 7fd4e77d8640 1 -- 172.21.15.123:0/2861210639 shutdown_connections 2024-09-15T23:20:06.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.038+0000 7fd4e77d8640 1 -- 172.21.15.123:0/2861210639 wait complete. 2024-09-15T23:20:06.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.040+0000 7fd4e77d8640 1 Processor -- start 2024-09-15T23:20:06.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.040+0000 7fd4e77d8640 1 -- start start 2024-09-15T23:20:06.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.040+0000 7fd4e77d8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4e00ccf30 0x7fd4e01510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.040+0000 7fd4e77d8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4e00cead0 0x7fd4e00b5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.040+0000 7fd4e77d8640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4e015b7c0 0x7fd4e014d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.040+0000 7fd4e77d8640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e00ceee0 con 0x7fd4e00ccf30 2024-09-15T23:20:06.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.040+0000 7fd4e77d8640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e00cf5c0 con 0x7fd4e00cead0 2024-09-15T23:20:06.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.040+0000 7fd4e77d8640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd4e00cf060 con 0x7fd4e015b7c0 2024-09-15T23:20:06.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.040+0000 7fd4e5574640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4e00ccf30 0x7fd4e01510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.040+0000 7fd4e5574640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4e00ccf30 0x7fd4e01510f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57378/0 (socket says 172.21.15.123:57378) 2024-09-15T23:20:06.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.040+0000 7fd4e5574640 1 -- 172.21.15.123:0/463469856 learned_addr learned my addr 172.21.15.123:0/463469856 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:06.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.040+0000 7fd4e4d73640 1 --2- 172.21.15.123:0/463469856 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4e00cead0 0x7fd4e00b5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.041+0000 7fd4e5d75640 1 --2- 172.21.15.123:0/463469856 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4e015b7c0 0x7fd4e014d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.041+0000 7fd4e5574640 1 -- 172.21.15.123:0/463469856 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4e015b7c0 msgr2=0x7fd4e014d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:06.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.041+0000 7fd4e5574640 1 --2- 172.21.15.123:0/463469856 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4e015b7c0 0x7fd4e014d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.041+0000 7fd4e5574640 1 -- 172.21.15.123:0/463469856 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4e00cead0 msgr2=0x7fd4e00b5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:06.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.041+0000 7fd4e5574640 1 --2- 172.21.15.123:0/463469856 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4e00cead0 0x7fd4e00b5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.041+0000 7fd4e5574640 1 -- 172.21.15.123:0/463469856 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e0150650 con 0x7fd4e00ccf30 2024-09-15T23:20:06.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.041+0000 7fd4e4d73640 1 --2- 172.21.15.123:0/463469856 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4e00cead0 0x7fd4e00b5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:06.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.041+0000 7fd4e5574640 1 --2- 172.21.15.123:0/463469856 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4e00ccf30 0x7fd4e01510f0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fd4d402a220 tx=0x7fd4d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:06.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.041+0000 7fd4d1ffb640 1 -- 172.21.15.123:0/463469856 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d4041020 con 0x7fd4e00ccf30 2024-09-15T23:20:06.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.041+0000 7fd4d1ffb640 1 -- 172.21.15.123:0/463469856 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4d40306c0 con 0x7fd4e00ccf30 2024-09-15T23:20:06.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.041+0000 7fd4e77d8640 1 -- 172.21.15.123:0/463469856 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4e0166400 con 0x7fd4e00ccf30 2024-09-15T23:20:06.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.041+0000 7fd4d1ffb640 1 -- 172.21.15.123:0/463469856 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d4037040 con 0x7fd4e00ccf30 2024-09-15T23:20:06.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.041+0000 7fd4e77d8640 1 -- 172.21.15.123:0/463469856 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4e01508f0 con 0x7fd4e00ccf30 2024-09-15T23:20:06.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.043+0000 7fd4d1ffb640 1 -- 172.21.15.123:0/463469856 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd4d4044020 con 0x7fd4e00ccf30 2024-09-15T23:20:06.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.043+0000 7fd4d1ffb640 1 --2- 172.21.15.123:0/463469856 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd4c406c2b0 0x7fd4c406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.043+0000 7fd4d1ffb640 1 -- 172.21.15.123:0/463469856 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fd4d40abc80 con 0x7fd4e00ccf30 2024-09-15T23:20:06.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.043+0000 7fd4e4d73640 1 --2- 172.21.15.123:0/463469856 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd4c406c2b0 0x7fd4c406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.044+0000 7fd4e4d73640 1 --2- 172.21.15.123:0/463469856 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd4c406c2b0 0x7fd4c406e770 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc006fd0 tx=0x7fd4dc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:06.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.044+0000 7fd4ea649740 1 Processor -- start 2024-09-15T23:20:06.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.044+0000 7fd4ea649740 1 -- start start 2024-09-15T23:20:06.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.045+0000 7fd4ea649740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55872bf9f920 0x55872bfe50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.045+0000 7fd4ea649740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872bf9d0e0 0x55872bf9fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.045+0000 7fd4ea649740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55872bfa10b0 0x55872bf9a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.045+0000 7fd4ea649740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55872bf026f0 con 0x55872bf9f920 2024-09-15T23:20:06.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.045+0000 7fd4ea649740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55872beaa330 con 0x55872bf9d0e0 2024-09-15T23:20:06.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.045+0000 7fd4ea649740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55872befe6b0 con 0x55872bfa10b0 2024-09-15T23:20:06.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.045+0000 7fd4e5574640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55872bf9f920 0x55872bfe50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.045+0000 7fd4e5574640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55872bf9f920 0x55872bfe50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57392/0 (socket says 172.21.15.123:57392) 2024-09-15T23:20:06.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.045+0000 7fd4e5574640 1 -- 172.21.15.123:0/3973588755 learned_addr learned my addr 172.21.15.123:0/3973588755 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:06.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.045+0000 7fd4e4d73640 1 --2- 172.21.15.123:0/3973588755 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872bf9d0e0 0x55872bf9fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.045+0000 7fd4e5d75640 1 --2- 172.21.15.123:0/3973588755 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55872bfa10b0 0x55872bf9a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.045+0000 7fd4e5574640 1 -- 172.21.15.123:0/3973588755 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55872bfa10b0 msgr2=0x55872bf9a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:06.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.045+0000 7fd4e5574640 1 --2- 172.21.15.123:0/3973588755 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55872bfa10b0 0x55872bf9a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.045+0000 7fd4e5574640 1 -- 172.21.15.123:0/3973588755 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872bf9d0e0 msgr2=0x55872bf9fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:06.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.045+0000 7fd4e5574640 1 --2- 172.21.15.123:0/3973588755 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872bf9d0e0 0x55872bf9fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.045+0000 7fd4e5574640 1 -- 172.21.15.123:0/3973588755 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55872bed00d0 con 0x55872bf9f920 2024-09-15T23:20:06.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.045+0000 7fd4e5574640 1 --2- 172.21.15.123:0/3973588755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55872bf9f920 0x55872bfe50c0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fd4d40aa150 tx=0x7fd4d4079710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88d72b91298022d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:06.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.045+0000 7fd4caffd640 1 -- 172.21.15.123:0/3973588755 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d4079cf0 con 0x55872bf9f920 2024-09-15T23:20:06.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.045+0000 7fd4caffd640 1 -- 172.21.15.123:0/3973588755 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4d408f030 con 0x55872bf9f920 2024-09-15T23:20:06.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.045+0000 7fd4caffd640 1 -- 172.21.15.123:0/3973588755 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d407e0a0 con 0x55872bf9f920 2024-09-15T23:20:06.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.046+0000 7fd4ea649740 1 -- 172.21.15.123:0/3973588755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55872bf9f920 msgr2=0x55872bfe50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:06.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.046+0000 7fd4ea649740 1 --2- 172.21.15.123:0/3973588755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55872bf9f920 0x55872bfe50c0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fd4d40aa150 tx=0x7fd4d4079710 comp rx=0 tx=0).stop 2024-09-15T23:20:06.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.046+0000 7fd4ea649740 1 -- 172.21.15.123:0/3973588755 shutdown_connections 2024-09-15T23:20:06.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.046+0000 7fd4ea649740 1 --2- 172.21.15.123:0/3973588755 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55872bfa10b0 0x55872bf9a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.046+0000 7fd4ea649740 1 --2- 172.21.15.123:0/3973588755 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872bf9d0e0 0x55872bf9fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.046+0000 7fd4ea649740 1 --2- 172.21.15.123:0/3973588755 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55872bf9f920 0x55872bfe50c0 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.046+0000 7fd4ea649740 1 -- 172.21.15.123:0/3973588755 >> 172.21.15.123:0/3973588755 conn(0x55872bf9c370 msgr2=0x55872bfe4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:06.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.046+0000 7fd4ea649740 1 -- 172.21.15.123:0/3973588755 shutdown_connections 2024-09-15T23:20:06.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.046+0000 7fd4ea649740 1 -- 172.21.15.123:0/3973588755 wait complete. 2024-09-15T23:20:06.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.047+0000 7fd4ea649740 1 -- start start 2024-09-15T23:20:06.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.047+0000 7fd4ea649740 1 Processor -- start 2024-09-15T23:20:06.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.048+0000 7fd4ea649740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55872bf9f920 0x55872bfc8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.048+0000 7fd4ea649740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55872bfa10b0 0x55872bfbe360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.048+0000 7fd4ea649740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872bfc5910 0x55872bfc5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.048+0000 7fd4ea649740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55872bf026f0 con 0x55872bfa10b0 2024-09-15T23:20:06.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.048+0000 7fd4ea649740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55872be8b4f0 con 0x55872bfc5910 2024-09-15T23:20:06.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.048+0000 7fd4ea649740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55872bf9b810 con 0x55872bf9f920 2024-09-15T23:20:06.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.048+0000 7fd4ea649740 10 client.0 _ll_register_callbacks cb 0x55872beacb50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:20:06.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.048+0000 7fd4e4d73640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55872bfa10b0 0x55872bfbe360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.048+0000 7fd4e4d73640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55872bfa10b0 0x55872bfbe360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57404/0 (socket says 172.21.15.123:57404) 2024-09-15T23:20:06.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.048+0000 7fd4e4d73640 1 -- 172.21.15.123:0/388001776 learned_addr learned my addr 172.21.15.123:0/388001776 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:06.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.048+0000 7fd4e5574640 1 --2- 172.21.15.123:0/388001776 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55872bf9f920 0x55872bfc8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.048+0000 7fd4e5d75640 1 --2- 172.21.15.123:0/388001776 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872bfc5910 0x55872bfc5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.048+0000 7fd4e4d73640 1 -- 172.21.15.123:0/388001776 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55872bf9f920 msgr2=0x55872bfc8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:06.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.048+0000 7fd4e4d73640 1 --2- 172.21.15.123:0/388001776 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55872bf9f920 0x55872bfc8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.048+0000 7fd4e4d73640 1 -- 172.21.15.123:0/388001776 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872bfc5910 msgr2=0x55872bfc5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:06.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.048+0000 7fd4e4d73640 1 --2- 172.21.15.123:0/388001776 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872bfc5910 0x55872bfc5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.048+0000 7fd4e4d73640 1 -- 172.21.15.123:0/388001776 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55872bcdf7d0 con 0x55872bfa10b0 2024-09-15T23:20:06.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.048+0000 7fd4e4d73640 1 --2- 172.21.15.123:0/388001776 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55872bfa10b0 0x55872bfbe360 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc014490 tx=0x7fd4dc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb5691eff3b7d352 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:06.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.048+0000 7fd4bffff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:20:06.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.048+0000 7fd4bffff640 1 -- 172.21.15.123:0/388001776 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc025020 con 0x55872bfa10b0 2024-09-15T23:20:06.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.048+0000 7fd4bffff640 1 -- 172.21.15.123:0/388001776 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fd4dc021830 con 0x55872bfa10b0 2024-09-15T23:20:06.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.048+0000 7fd4ea649740 1 -- 172.21.15.123:0/388001776 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4d408f030 con 0x55872bfa10b0 2024-09-15T23:20:06.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.049+0000 7fd4bffff640 1 -- 172.21.15.123:0/388001776 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fd4dc02f050 con 0x55872bfa10b0 2024-09-15T23:20:06.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.049+0000 7fd4ea649740 10 client.8760 fetch_fsmap learned FSMap version 86 2024-09-15T23:20:06.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.049+0000 7fd4ea649740 1 -- 172.21.15.123:0/388001776 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) -- 0x55872bc153f0 con 0x55872bfa10b0 2024-09-15T23:20:06.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.049+0000 7fd4bffff640 1 -- 172.21.15.123:0/388001776 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4d408f030 con 0x55872bfa10b0 2024-09-15T23:20:06.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.049+0000 7fd4bffff640 1 -- 172.21.15.123:0/388001776 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 86) ==== 3502+0+0 (secure 0 0 0) 0x7fd4dc032020 con 0x55872bfa10b0 2024-09-15T23:20:06.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.049+0000 7fd4ea649740 10 client.8760 fetch_fsmap finished waiting for FSMap version 86 2024-09-15T23:20:06.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.049+0000 7fd4ea649740 10 client.8760 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.d 2024-09-15T23:20:06.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.049+0000 7fd4ea649740 20 client.8760 populate_metadata read hostname 'smithi123' 2024-09-15T23:20:06.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.049+0000 7fd4ea649740 1 --2- 172.21.15.123:0/388001776 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x55872bfbf0d0 0x55872bfbf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.049+0000 7fd4ea649740 4 client.8760 mds_command: new command op to 8439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:20:06.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.049+0000 7fd4ea649740 1 -- 172.21.15.123:0/388001776 --> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55872bf0fe20 con 0x55872bfbf0d0 2024-09-15T23:20:06.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.049+0000 7fd4e5574640 1 --2- 172.21.15.123:0/388001776 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x55872bfbf0d0 0x55872bfbf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.050+0000 7fd4bffff640 10 client.8760 ms_handle_connect on v2:172.21.15.188:6835/1222656979 2024-09-15T23:20:06.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.050+0000 7fd4e5574640 1 --2- 172.21.15.123:0/388001776 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x55872bfbf0d0 0x55872bfbf4e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84a7e682c37fbcd6 server_cookie=c42ec79a25acda3d in_seq=0 out_seq=0 2024-09-15T23:20:06.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.050+0000 7fd4bffff640 1 -- 172.21.15.123:0/388001776 <== mds.0 v2:172.21.15.188:6835/1222656979 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55872bf0fe20 con 0x55872bfbf0d0 2024-09-15T23:20:06.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.050+0000 7fd4bffff640 10 client.8760 handle_command_reply: tid=0 2024-09-15T23:20:06.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.050+0000 7fd4ea649740 1 client.8760 shutdown 2024-09-15T23:20:06.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.050+0000 7fd4ea649740 1 -- 172.21.15.123:0/388001776 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55872bfa10b0 msgr2=0x55872bfbe360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:06.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.050+0000 7fd4ea649740 1 --2- 172.21.15.123:0/388001776 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55872bfa10b0 0x55872bfbe360 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc014490 tx=0x7fd4dc004730 comp rx=0 tx=0).stop 2024-09-15T23:20:06.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.050+0000 7fd4ea649740 1 -- 172.21.15.123:0/388001776 shutdown_connections 2024-09-15T23:20:06.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.050+0000 7fd4ea649740 1 --2- 172.21.15.123:0/388001776 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x55872bfbf0d0 0x55872bfbf4e0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.050+0000 7fd4ea649740 1 --2- 172.21.15.123:0/388001776 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872bfc5910 0x55872bfc5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.050+0000 7fd4ea649740 1 --2- 172.21.15.123:0/388001776 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55872bfa10b0 0x55872bfbe360 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.050+0000 7fd4ea649740 1 --2- 172.21.15.123:0/388001776 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55872bf9f920 0x55872bfc8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.050+0000 7fd4bffff640 0 client.8760 ms_handle_reset on v2:172.21.15.188:6835/1222656979 2024-09-15T23:20:06.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.050+0000 7fd4ea649740 1 -- 172.21.15.123:0/388001776 >> 172.21.15.123:0/388001776 conn(0x55872bf9d0e0 msgr2=0x55872bfe2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:06.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.051+0000 7fd4ea649740 1 -- 172.21.15.123:0/388001776 shutdown_connections 2024-09-15T23:20:06.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.051+0000 7fd4ea649740 1 -- 172.21.15.123:0/388001776 wait complete. 2024-09-15T23:20:06.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.051+0000 7fd4ea649740 20 client.8760 trim_cache size 0 max 16384 2024-09-15T23:20:06.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.067+0000 7fd4ea649740 1 Processor -- start 2024-09-15T23:20:06.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.067+0000 7fd4ea649740 1 -- start start 2024-09-15T23:20:06.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.068+0000 7fd4ea649740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55872bf9f920 0x55872bfe09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.068+0000 7fd4ea649740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55872bfa10b0 0x55872bfe0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.068+0000 7fd4ea649740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872bfc5910 0x55872bfe1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.068+0000 7fd4ea649740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e01feb70 con 0x55872bfa10b0 2024-09-15T23:20:06.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.068+0000 7fd4ea649740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e01f6730 con 0x55872bfc5910 2024-09-15T23:20:06.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.068+0000 7fd4ea649740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd4e014e020 con 0x55872bf9f920 2024-09-15T23:20:06.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.068+0000 7fd4e4d73640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55872bfa10b0 0x55872bfe0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.068+0000 7fd4e4d73640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55872bfa10b0 0x55872bfe0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57420/0 (socket says 172.21.15.123:57420) 2024-09-15T23:20:06.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.068+0000 7fd4e4d73640 1 -- 172.21.15.123:0/2552710592 learned_addr learned my addr 172.21.15.123:0/2552710592 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:06.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.068+0000 7fd4e5d75640 1 --2- 172.21.15.123:0/2552710592 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872bfc5910 0x55872bfe1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.068+0000 7fd4e5574640 1 --2- 172.21.15.123:0/2552710592 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55872bf9f920 0x55872bfe09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.068+0000 7fd4e4d73640 1 -- 172.21.15.123:0/2552710592 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55872bf9f920 msgr2=0x55872bfe09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:06.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.068+0000 7fd4e4d73640 1 --2- 172.21.15.123:0/2552710592 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55872bf9f920 0x55872bfe09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.068+0000 7fd4e4d73640 1 -- 172.21.15.123:0/2552710592 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872bfc5910 msgr2=0x55872bfe1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:06.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.068+0000 7fd4e4d73640 1 --2- 172.21.15.123:0/2552710592 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872bfc5910 0x55872bfe1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.068+0000 7fd4e4d73640 1 -- 172.21.15.123:0/2552710592 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55872bfa0070 con 0x55872bfa10b0 2024-09-15T23:20:06.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.068+0000 7fd4e4d73640 1 --2- 172.21.15.123:0/2552710592 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55872bfa10b0 0x55872bfe0f30 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc0040d0 tx=0x7fd4dc020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be0447e29e08c0b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:06.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.069+0000 7fd4ca7fc640 1 -- 172.21.15.123:0/2552710592 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc038070 con 0x55872bfa10b0 2024-09-15T23:20:06.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.069+0000 7fd4ca7fc640 1 -- 172.21.15.123:0/2552710592 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4dc01c040 con 0x55872bfa10b0 2024-09-15T23:20:06.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.069+0000 7fd4ca7fc640 1 -- 172.21.15.123:0/2552710592 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc025070 con 0x55872bfa10b0 2024-09-15T23:20:06.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.069+0000 7fd4ea649740 1 -- 172.21.15.123:0/2552710592 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55872bfa10b0 msgr2=0x55872bfe0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:06.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.069+0000 7fd4ea649740 1 --2- 172.21.15.123:0/2552710592 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55872bfa10b0 0x55872bfe0f30 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc0040d0 tx=0x7fd4dc020000 comp rx=0 tx=0).stop 2024-09-15T23:20:06.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.069+0000 7fd4ea649740 1 -- 172.21.15.123:0/2552710592 shutdown_connections 2024-09-15T23:20:06.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.069+0000 7fd4ea649740 1 --2- 172.21.15.123:0/2552710592 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872bfc5910 0x55872bfe1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.069+0000 7fd4ea649740 1 --2- 172.21.15.123:0/2552710592 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55872bfa10b0 0x55872bfe0f30 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.069+0000 7fd4ea649740 1 --2- 172.21.15.123:0/2552710592 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55872bf9f920 0x55872bfe09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.069+0000 7fd4ea649740 1 -- 172.21.15.123:0/2552710592 >> 172.21.15.123:0/2552710592 conn(0x55872bf9d0e0 msgr2=0x55872bfe45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:06.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.069+0000 7fd4ea649740 1 -- 172.21.15.123:0/2552710592 shutdown_connections 2024-09-15T23:20:06.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.069+0000 7fd4ea649740 1 -- 172.21.15.123:0/2552710592 wait complete. 2024-09-15T23:20:06.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.070+0000 7fd4ea649740 1 -- start start 2024-09-15T23:20:06.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.070+0000 7fd4ea649740 1 Processor -- start 2024-09-15T23:20:06.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.071+0000 7fd4ea649740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872bf9f920 0x55872bfe1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.071+0000 7fd4ea649740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55872bfa10b0 0x55872bfc4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.071+0000 7fd4ea649740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55872bfc5910 0x55872bff2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.071+0000 7fd4ea649740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e015d960 con 0x55872bfc5910 2024-09-15T23:20:06.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.071+0000 7fd4ea649740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55872bf957e0 con 0x55872bf9f920 2024-09-15T23:20:06.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.071+0000 7fd4ea649740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55872bff38c0 con 0x55872bfa10b0 2024-09-15T23:20:06.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.071+0000 7fd4ea649740 10 client.0 _ll_register_callbacks cb 0x7fd4dc004180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:20:06.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.071+0000 7fd4e5d75640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55872bfc5910 0x55872bff2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.071+0000 7fd4e5d75640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55872bfc5910 0x55872bff2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57424/0 (socket says 172.21.15.123:57424) 2024-09-15T23:20:06.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.071+0000 7fd4e5d75640 1 -- 172.21.15.123:0/2302141218 learned_addr learned my addr 172.21.15.123:0/2302141218 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:06.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.071+0000 7fd4e5574640 1 --2- 172.21.15.123:0/2302141218 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872bf9f920 0x55872bfe1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.071+0000 7fd4e4d73640 1 --2- 172.21.15.123:0/2302141218 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55872bfa10b0 0x55872bfc4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.071+0000 7fd4e5d75640 1 -- 172.21.15.123:0/2302141218 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55872bfa10b0 msgr2=0x55872bfc4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:06.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.071+0000 7fd4e5d75640 1 --2- 172.21.15.123:0/2302141218 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55872bfa10b0 0x55872bfc4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.071+0000 7fd4e5d75640 1 -- 172.21.15.123:0/2302141218 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872bf9f920 msgr2=0x55872bfe1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:06.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.071+0000 7fd4e5d75640 1 --2- 172.21.15.123:0/2302141218 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872bf9f920 0x55872bfe1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.071+0000 7fd4e5d75640 1 -- 172.21.15.123:0/2302141218 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55872bbd50f0 con 0x55872bfc5910 2024-09-15T23:20:06.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.071+0000 7fd4e5d75640 1 --2- 172.21.15.123:0/2302141218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55872bfc5910 0x55872bff2cb0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fd4d80012e0 tx=0x7fd4d80157e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d2164c3e26ac3e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:06.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.071+0000 7fd4bffff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:20:06.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.071+0000 7fd4bffff640 1 -- 172.21.15.123:0/2302141218 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d801b070 con 0x55872bfc5910 2024-09-15T23:20:06.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.071+0000 7fd4bffff640 1 -- 172.21.15.123:0/2302141218 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fd4d8006d60 con 0x55872bfc5910 2024-09-15T23:20:06.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.071+0000 7fd4ea649740 1 -- 172.21.15.123:0/2302141218 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4dc01c040 con 0x55872bfc5910 2024-09-15T23:20:06.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.072+0000 7fd4bffff640 1 -- 172.21.15.123:0/2302141218 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fd4d8026050 con 0x55872bfc5910 2024-09-15T23:20:06.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.072+0000 7fd4ea649740 10 client.8766 fetch_fsmap learned FSMap version 86 2024-09-15T23:20:06.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.072+0000 7fd4ea649740 1 -- 172.21.15.123:0/2302141218 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) -- 0x55872bff31f0 con 0x55872bfc5910 2024-09-15T23:20:06.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.072+0000 7fd4bffff640 1 -- 172.21.15.123:0/2302141218 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4dc01c040 con 0x55872bfc5910 2024-09-15T23:20:06.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.072+0000 7fd4bffff640 1 -- 172.21.15.123:0/2302141218 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 86) ==== 3502+0+0 (secure 0 0 0) 0x7fd4d8029020 con 0x55872bfc5910 2024-09-15T23:20:06.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.072+0000 7fd4ea649740 10 client.8766 fetch_fsmap finished waiting for FSMap version 86 2024-09-15T23:20:06.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.072+0000 7fd4ea649740 10 client.8766 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.d 2024-09-15T23:20:06.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.072+0000 7fd4ea649740 20 client.8766 populate_metadata read hostname 'smithi123' 2024-09-15T23:20:06.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.072+0000 7fd4ea649740 1 --2- 172.21.15.123:0/2302141218 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x55872c008220 0x55872c008630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.072+0000 7fd4ea649740 4 client.8766 mds_command: new command op to 8439 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-09-15T23:20:06.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.072+0000 7fd4ea649740 1 -- 172.21.15.123:0/2302141218 --> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] -- command(tid 0: {"prefix": "scrub resume"}) -- 0x55872bf0a170 con 0x55872c008220 2024-09-15T23:20:06.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.072+0000 7fd4e5574640 1 --2- 172.21.15.123:0/2302141218 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x55872c008220 0x55872c008630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.072+0000 7fd4e5574640 1 --2- 172.21.15.123:0/2302141218 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x55872c008220 0x55872c008630 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89aa09b54e20c612 server_cookie=e0aba345462d3989 in_seq=0 out_seq=0 2024-09-15T23:20:06.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.072+0000 7fd4bffff640 10 client.8766 ms_handle_connect on v2:172.21.15.188:6835/1222656979 2024-09-15T23:20:06.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.073+0000 7fd4bffff640 1 -- 172.21.15.123:0/2302141218 <== mds.0 v2:172.21.15.188:6835/1222656979 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55872bf0a170 con 0x55872c008220 2024-09-15T23:20:06.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.073+0000 7fd4bffff640 10 client.8766 handle_command_reply: tid=0 2024-09-15T23:20:06.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.073+0000 7fd4ea649740 1 client.8766 shutdown 2024-09-15T23:20:06.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.073+0000 7fd4ea649740 1 -- 172.21.15.123:0/2302141218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55872bfc5910 msgr2=0x55872bff2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:06.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.073+0000 7fd4ea649740 1 --2- 172.21.15.123:0/2302141218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55872bfc5910 0x55872bff2cb0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fd4d80012e0 tx=0x7fd4d80157e0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.073+0000 7fd4ea649740 1 -- 172.21.15.123:0/2302141218 shutdown_connections 2024-09-15T23:20:06.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.073+0000 7fd4ea649740 1 --2- 172.21.15.123:0/2302141218 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x55872c008220 0x55872c008630 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.073+0000 7fd4ea649740 1 --2- 172.21.15.123:0/2302141218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55872bfc5910 0x55872bff2cb0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.073+0000 7fd4ea649740 1 --2- 172.21.15.123:0/2302141218 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55872bfa10b0 0x55872bfc4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.073+0000 7fd4bffff640 0 client.8766 ms_handle_reset on v2:172.21.15.188:6835/1222656979 2024-09-15T23:20:06.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.073+0000 7fd4ea649740 1 --2- 172.21.15.123:0/2302141218 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55872bf9f920 0x55872bfe1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.073+0000 7fd4ea649740 1 -- 172.21.15.123:0/2302141218 >> 172.21.15.123:0/2302141218 conn(0x55872bf9d0e0 msgr2=0x55872bf9a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:06.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.073+0000 7fd4ea649740 1 -- 172.21.15.123:0/2302141218 shutdown_connections 2024-09-15T23:20:06.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.073+0000 7fd4ea649740 1 -- 172.21.15.123:0/2302141218 wait complete. 2024-09-15T23:20:06.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.073+0000 7fd4ea649740 20 client.8766 trim_cache size 0 max 16384 2024-09-15T23:20:06.082 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:20:06.082 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0 2024-09-15T23:20:06.082 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:20:06.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.073+0000 7fd4e77d8640 1 -- 172.21.15.123:0/463469856 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd4c406c2b0 msgr2=0x7fd4c406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:06.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.073+0000 7fd4e77d8640 1 --2- 172.21.15.123:0/463469856 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd4c406c2b0 0x7fd4c406e770 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc006fd0 tx=0x7fd4dc008040 comp rx=0 tx=0).stop 2024-09-15T23:20:06.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.073+0000 7fd4e77d8640 1 -- 172.21.15.123:0/463469856 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4e00ccf30 msgr2=0x7fd4e01510f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:06.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.073+0000 7fd4e77d8640 1 --2- 172.21.15.123:0/463469856 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4e00ccf30 0x7fd4e01510f0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fd4d402a220 tx=0x7fd4d40046c0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.073+0000 7fd4e77d8640 1 -- 172.21.15.123:0/463469856 shutdown_connections 2024-09-15T23:20:06.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.073+0000 7fd4e77d8640 1 --2- 172.21.15.123:0/463469856 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4e015b7c0 0x7fd4e014d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.073+0000 7fd4e77d8640 1 --2- 172.21.15.123:0/463469856 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4e00cead0 0x7fd4e00b5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.074+0000 7fd4e77d8640 1 --2- 172.21.15.123:0/463469856 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd4c406c2b0 0x7fd4c406e770 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.074+0000 7fd4e77d8640 1 --2- 172.21.15.123:0/463469856 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4e00ccf30 0x7fd4e01510f0 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.074+0000 7fd4e77d8640 1 -- 172.21.15.123:0/463469856 >> 172.21.15.123:0/463469856 conn(0x7fd4e006d0f0 msgr2=0x7fd4e014c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:06.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.074+0000 7fd4e77d8640 1 -- 172.21.15.123:0/463469856 shutdown_connections 2024-09-15T23:20:06.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.074+0000 7fd4e77d8640 1 -- 172.21.15.123:0/463469856 wait complete. 2024-09-15T23:20:06.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:20:06.085 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.9:0 scrub status 2024-09-15T23:20:06.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.184+0000 7fa9f7477640 1 Processor -- start 2024-09-15T23:20:06.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.184+0000 7fa9f7477640 1 -- start start 2024-09-15T23:20:06.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.185+0000 7fa9f7477640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa9f00cd2a0 0x7fa9f015c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.185+0000 7fa9f7477640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f00714b0 con 0x7fa9f00732e0 2024-09-15T23:20:06.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.185+0000 7fa9f7477640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f00cd880 con 0x7fa9f00cce30 2024-09-15T23:20:06.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.185+0000 7fa9f7477640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f00cdb60 con 0x7fa9f00cd2a0 2024-09-15T23:20:06.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.185+0000 7fa9f5213640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa9f00732e0 0x7fa9f00736c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:50918/0 (socket says 172.21.15.123:50918) 2024-09-15T23:20:06.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.185+0000 7fa9f5213640 1 -- 172.21.15.123:0/1935293046 learned_addr learned my addr 172.21.15.123:0/1935293046 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:06.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.185+0000 7fa9f5a14640 1 --2- 172.21.15.123:0/1935293046 >> v2:172.21.15.188:3300/0 conn(0x7fa9f00cd2a0 0x7fa9f015c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.185+0000 7fa9e7fff640 1 -- 172.21.15.123:0/1935293046 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 900924778 0 0) 0x7fa9f00714b0 con 0x7fa9f00732e0 2024-09-15T23:20:06.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.185+0000 7fa9e7fff640 1 -- 172.21.15.123:0/1935293046 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9dc003520 con 0x7fa9f00732e0 2024-09-15T23:20:06.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.185+0000 7fa9e7fff640 1 -- 172.21.15.123:0/1935293046 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1749284714 0 0) 0x7fa9dc003520 con 0x7fa9f00732e0 2024-09-15T23:20:06.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.185+0000 7fa9e7fff640 1 -- 172.21.15.123:0/1935293046 >> v2:172.21.15.188:3300/0 conn(0x7fa9f00cd2a0 msgr2=0x7fa9f015c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:06.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.185+0000 7fa9e7fff640 1 --2- 172.21.15.123:0/1935293046 >> v2:172.21.15.188:3300/0 conn(0x7fa9f00cd2a0 0x7fa9f015c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.185+0000 7fa9e7fff640 1 -- 172.21.15.123:0/1935293046 >> v1:172.21.15.188:6789/0 conn(0x7fa9f00cce30 legacy=0x7fa9f0071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:06.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.185+0000 7fa9e7fff640 1 -- 172.21.15.123:0/1935293046 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9f00cde40 con 0x7fa9f00732e0 2024-09-15T23:20:06.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.185+0000 7fa9e7fff640 1 -- 172.21.15.123:0/1935293046 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fa9ec001670 con 0x7fa9f00732e0 2024-09-15T23:20:06.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.185+0000 7fa9e7fff640 1 -- 172.21.15.123:0/1935293046 >> v1:172.21.15.123:6789/0 conn(0x7fa9f00732e0 legacy=0x7fa9f00736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:06.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.186+0000 7fa9e7fff640 1 --2- 172.21.15.123:0/1935293046 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa9dc0039b0 0x7fa9dc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.186+0000 7fa9e7fff640 1 --2- 172.21.15.123:0/1935293046 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa9dc004800 0x7fa9dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.186+0000 7fa9e7fff640 1 --2- 172.21.15.123:0/1935293046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9dc0051c0 0x7fa9dc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.186+0000 7fa9e7fff640 1 -- 172.21.15.123:0/1935293046 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f00cdb60 con 0x7fa9dc0051c0 2024-09-15T23:20:06.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.186+0000 7fa9e7fff640 1 -- 172.21.15.123:0/1935293046 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc00c160 con 0x7fa9dc0039b0 2024-09-15T23:20:06.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.186+0000 7fa9e7fff640 1 -- 172.21.15.123:0/1935293046 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa9dc00c360 con 0x7fa9dc004800 2024-09-15T23:20:06.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.186+0000 7fa9f5a14640 1 --2- 172.21.15.123:0/1935293046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9dc0051c0 0x7fa9dc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.186+0000 7fa9f5213640 1 --2- 172.21.15.123:0/1935293046 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa9dc0039b0 0x7fa9dc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.186+0000 7fa9f4a12640 1 --2- 172.21.15.123:0/1935293046 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa9dc004800 0x7fa9dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.186+0000 7fa9f5a14640 1 -- 172.21.15.123:0/1935293046 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa9dc004800 msgr2=0x7fa9dc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:06.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.186+0000 7fa9f5a14640 1 --2- 172.21.15.123:0/1935293046 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa9dc004800 0x7fa9dc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.186+0000 7fa9f5a14640 1 -- 172.21.15.123:0/1935293046 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa9dc0039b0 msgr2=0x7fa9dc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:06.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.186+0000 7fa9f5a14640 1 --2- 172.21.15.123:0/1935293046 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa9dc0039b0 0x7fa9dc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.186+0000 7fa9f5a14640 1 -- 172.21.15.123:0/1935293046 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9dc003520 con 0x7fa9dc0051c0 2024-09-15T23:20:06.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.187+0000 7fa9f5a14640 1 -- 172.21.15.123:0/1935293046 reap_dead start 2024-09-15T23:20:06.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.187+0000 7fa9f5a14640 1 --2- 172.21.15.123:0/1935293046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9dc0051c0 0x7fa9dc00b9c0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8009fc0 tx=0x7fa9dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a814695907ead9e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:06.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.187+0000 7fa9e7fff640 1 -- 172.21.15.123:0/1935293046 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e8035020 con 0x7fa9dc0051c0 2024-09-15T23:20:06.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.187+0000 7fa9e7fff640 1 -- 172.21.15.123:0/1935293046 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9e8003b90 con 0x7fa9dc0051c0 2024-09-15T23:20:06.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.187+0000 7fa9e7fff640 1 -- 172.21.15.123:0/1935293046 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e8009c10 con 0x7fa9dc0051c0 2024-09-15T23:20:06.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.187+0000 7fa9f7477640 1 -- 172.21.15.123:0/1935293046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9dc0051c0 msgr2=0x7fa9dc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:06.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.187+0000 7fa9f7477640 1 --2- 172.21.15.123:0/1935293046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9dc0051c0 0x7fa9dc00b9c0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8009fc0 tx=0x7fa9dc005830 comp rx=0 tx=0).stop 2024-09-15T23:20:06.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.187+0000 7fa9f7477640 1 -- 172.21.15.123:0/1935293046 shutdown_connections 2024-09-15T23:20:06.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.187+0000 7fa9f7477640 1 --2- 172.21.15.123:0/1935293046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9dc0051c0 0x7fa9dc00b9c0 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.187+0000 7fa9f7477640 1 -- 172.21.15.123:0/1935293046 >> 172.21.15.123:0/1935293046 conn(0x7fa9f006d0f0 msgr2=0x7fa9f006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:06.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.187+0000 7fa9f7477640 1 -- 172.21.15.123:0/1935293046 shutdown_connections 2024-09-15T23:20:06.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.187+0000 7fa9f7477640 1 -- 172.21.15.123:0/1935293046 wait complete. 2024-09-15T23:20:06.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.188+0000 7fa9f7477640 1 Processor -- start 2024-09-15T23:20:06.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.189+0000 7fa9f7477640 1 -- start start 2024-09-15T23:20:06.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.189+0000 7fa9f7477640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa9dc0051c0 0x7fa9f014ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.189+0000 7fa9f7477640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa9f0159b50 0x7fa9f0157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.189+0000 7fa9f7477640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9f014b410 0x7fa9f0157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.189+0000 7fa9f7477640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f0073840 con 0x7fa9f014b410 2024-09-15T23:20:06.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.189+0000 7fa9f7477640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f00736c0 con 0x7fa9f0159b50 2024-09-15T23:20:06.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.189+0000 7fa9f7477640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa9f00739c0 con 0x7fa9dc0051c0 2024-09-15T23:20:06.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.189+0000 7fa9f5a14640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9f014b410 0x7fa9f0157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.189+0000 7fa9f5a14640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9f014b410 0x7fa9f0157d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57436/0 (socket says 172.21.15.123:57436) 2024-09-15T23:20:06.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.189+0000 7fa9f5a14640 1 -- 172.21.15.123:0/543267662 learned_addr learned my addr 172.21.15.123:0/543267662 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:06.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.189+0000 7fa9f4a12640 1 --2- 172.21.15.123:0/543267662 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa9f0159b50 0x7fa9f0157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.189+0000 7fa9f5213640 1 --2- 172.21.15.123:0/543267662 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa9dc0051c0 0x7fa9f014ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.190+0000 7fa9f5a14640 1 -- 172.21.15.123:0/543267662 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa9dc0051c0 msgr2=0x7fa9f014ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:06.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.190+0000 7fa9f5a14640 1 --2- 172.21.15.123:0/543267662 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa9dc0051c0 0x7fa9f014ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.190+0000 7fa9f5a14640 1 -- 172.21.15.123:0/543267662 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa9f0159b50 msgr2=0x7fa9f0157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:06.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.190+0000 7fa9f5a14640 1 --2- 172.21.15.123:0/543267662 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa9f0159b50 0x7fa9f0157810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.190+0000 7fa9f5a14640 1 -- 172.21.15.123:0/543267662 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9f00cb930 con 0x7fa9f014b410 2024-09-15T23:20:06.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.190+0000 7fa9f5213640 1 --2- 172.21.15.123:0/543267662 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa9dc0051c0 0x7fa9f014ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:06.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.190+0000 7fa9f4a12640 1 --2- 172.21.15.123:0/543267662 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa9f0159b50 0x7fa9f0157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:06.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.190+0000 7fa9f5a14640 1 --2- 172.21.15.123:0/543267662 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9f014b410 0x7fa9f0157d50 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fa9e800e230 tx=0x7fa9e8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:06.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.190+0000 7fa9e5ffb640 1 -- 172.21.15.123:0/543267662 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e803f030 con 0x7fa9f014b410 2024-09-15T23:20:06.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.190+0000 7fa9e5ffb640 1 -- 172.21.15.123:0/543267662 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9e8003990 con 0x7fa9f014b410 2024-09-15T23:20:06.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.190+0000 7fa9e5ffb640 1 -- 172.21.15.123:0/543267662 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e8035070 con 0x7fa9f014b410 2024-09-15T23:20:06.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.190+0000 7fa9f7477640 1 -- 172.21.15.123:0/543267662 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9f0156eb0 con 0x7fa9f014b410 2024-09-15T23:20:06.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.190+0000 7fa9f7477640 1 -- 172.21.15.123:0/543267662 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9f00cf7b0 con 0x7fa9f014b410 2024-09-15T23:20:06.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.192+0000 7fa9e5ffb640 1 -- 172.21.15.123:0/543267662 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa9e8042030 con 0x7fa9f014b410 2024-09-15T23:20:06.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.192+0000 7fa9e5ffb640 1 --2- 172.21.15.123:0/543267662 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa9d406c2b0 0x7fa9d406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.192+0000 7fa9e5ffb640 1 -- 172.21.15.123:0/543267662 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fa9e80abbf0 con 0x7fa9f014b410 2024-09-15T23:20:06.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.192+0000 7fa9f5213640 1 --2- 172.21.15.123:0/543267662 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa9d406c2b0 0x7fa9d406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.193+0000 7fa9f5213640 1 --2- 172.21.15.123:0/543267662 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa9d406c2b0 0x7fa9d406e770 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec001eb0 tx=0x7fa9ec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:06.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.193+0000 7fa9fa20b740 1 Processor -- start 2024-09-15T23:20:06.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.193+0000 7fa9fa20b740 1 -- start start 2024-09-15T23:20:06.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.194+0000 7fa9fa20b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b3ee561920 0x55b3ee5a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.194+0000 7fa9fa20b740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b3ee55f0e0 0x55b3ee561d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.194+0000 7fa9fa20b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3ee5630b0 0x55b3ee55c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.194+0000 7fa9fa20b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55b3ee4c46f0 con 0x55b3ee561920 2024-09-15T23:20:06.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.194+0000 7fa9fa20b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b3ee46c330 con 0x55b3ee5630b0 2024-09-15T23:20:06.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.194+0000 7fa9fa20b740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55b3ee4c06b0 con 0x55b3ee55f0e0 2024-09-15T23:20:06.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.194+0000 7fa9f5213640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b3ee561920 0x55b3ee5a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.194+0000 7fa9f5213640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b3ee561920 0x55b3ee5a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42768/0 (socket says 172.21.15.123:42768) 2024-09-15T23:20:06.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.194+0000 7fa9f5213640 1 -- 172.21.15.123:0/212308224 learned_addr learned my addr 172.21.15.123:0/212308224 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:06.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.194+0000 7fa9f5a14640 1 --2- 172.21.15.123:0/212308224 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3ee5630b0 0x55b3ee55c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.194+0000 7fa9f4a12640 1 --2- 172.21.15.123:0/212308224 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b3ee55f0e0 0x55b3ee561d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.194+0000 7fa9f5213640 1 -- 172.21.15.123:0/212308224 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b3ee55f0e0 msgr2=0x55b3ee561d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:06.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.194+0000 7fa9f5213640 1 --2- 172.21.15.123:0/212308224 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b3ee55f0e0 0x55b3ee561d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.194+0000 7fa9f5213640 1 -- 172.21.15.123:0/212308224 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3ee5630b0 msgr2=0x55b3ee55c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:06.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.194+0000 7fa9f5213640 1 --2- 172.21.15.123:0/212308224 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3ee5630b0 0x55b3ee55c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.194+0000 7fa9f5213640 1 -- 172.21.15.123:0/212308224 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3ee4920d0 con 0x55b3ee561920 2024-09-15T23:20:06.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.194+0000 7fa9f5a14640 1 --2- 172.21.15.123:0/212308224 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3ee5630b0 0x55b3ee55c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:06.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.194+0000 7fa9f5213640 1 --2- 172.21.15.123:0/212308224 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b3ee561920 0x55b3ee5a70c0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec000fe0 tx=0x7fa9ec014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=928166b590f8f2c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:06.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.194+0000 7fa9d2ffd640 1 -- 172.21.15.123:0/212308224 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec015e40 con 0x55b3ee561920 2024-09-15T23:20:06.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.195+0000 7fa9d2ffd640 1 -- 172.21.15.123:0/212308224 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9ec026070 con 0x55b3ee561920 2024-09-15T23:20:06.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.195+0000 7fa9d2ffd640 1 -- 172.21.15.123:0/212308224 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec021650 con 0x55b3ee561920 2024-09-15T23:20:06.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.195+0000 7fa9fa20b740 1 -- 172.21.15.123:0/212308224 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b3ee561920 msgr2=0x55b3ee5a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:06.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.195+0000 7fa9fa20b740 1 --2- 172.21.15.123:0/212308224 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b3ee561920 0x55b3ee5a70c0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec000fe0 tx=0x7fa9ec014000 comp rx=0 tx=0).stop 2024-09-15T23:20:06.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.195+0000 7fa9fa20b740 1 -- 172.21.15.123:0/212308224 shutdown_connections 2024-09-15T23:20:06.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.195+0000 7fa9fa20b740 1 --2- 172.21.15.123:0/212308224 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3ee5630b0 0x55b3ee55c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.195+0000 7fa9fa20b740 1 --2- 172.21.15.123:0/212308224 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b3ee55f0e0 0x55b3ee561d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.195+0000 7fa9fa20b740 1 --2- 172.21.15.123:0/212308224 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b3ee561920 0x55b3ee5a70c0 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.195+0000 7fa9fa20b740 1 -- 172.21.15.123:0/212308224 >> 172.21.15.123:0/212308224 conn(0x55b3ee55e370 msgr2=0x55b3ee5a6590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:06.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.195+0000 7fa9fa20b740 1 -- 172.21.15.123:0/212308224 shutdown_connections 2024-09-15T23:20:06.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.195+0000 7fa9fa20b740 1 -- 172.21.15.123:0/212308224 wait complete. 2024-09-15T23:20:06.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.196+0000 7fa9fa20b740 1 -- start start 2024-09-15T23:20:06.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.196+0000 7fa9fa20b740 1 Processor -- start 2024-09-15T23:20:06.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.197+0000 7fa9fa20b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b3ee561920 0x55b3ee55b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.197+0000 7fa9fa20b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3ee5630b0 0x55b3ee580d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.197+0000 7fa9fa20b740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b3ee5812c0 0x55b3ee570000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.197+0000 7fa9fa20b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55b3ee55d810 con 0x55b3ee561920 2024-09-15T23:20:06.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.197+0000 7fa9fa20b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b3ee44d4f0 con 0x55b3ee5630b0 2024-09-15T23:20:06.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.197+0000 7fa9fa20b740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55b3ee5a78f0 con 0x55b3ee5812c0 2024-09-15T23:20:06.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.197+0000 7fa9fa20b740 10 client.0 _ll_register_callbacks cb 0x55b3ee46eb50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:20:06.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.197+0000 7fa9f5213640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b3ee561920 0x55b3ee55b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.197+0000 7fa9f5213640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b3ee561920 0x55b3ee55b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42776/0 (socket says 172.21.15.123:42776) 2024-09-15T23:20:06.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.197+0000 7fa9f5213640 1 -- 172.21.15.123:0/3053079181 learned_addr learned my addr 172.21.15.123:0/3053079181 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:06.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.197+0000 7fa9f4a12640 1 --2- 172.21.15.123:0/3053079181 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3ee5630b0 0x55b3ee580d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.197+0000 7fa9f5a14640 1 --2- 172.21.15.123:0/3053079181 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b3ee5812c0 0x55b3ee570000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.197+0000 7fa9f5213640 1 -- 172.21.15.123:0/3053079181 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b3ee5812c0 msgr2=0x55b3ee570000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:06.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.197+0000 7fa9f5213640 1 --2- 172.21.15.123:0/3053079181 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b3ee5812c0 0x55b3ee570000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.197+0000 7fa9f5213640 1 -- 172.21.15.123:0/3053079181 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3ee5630b0 msgr2=0x55b3ee580d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:06.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.197+0000 7fa9f5213640 1 --2- 172.21.15.123:0/3053079181 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3ee5630b0 0x55b3ee580d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.197+0000 7fa9f5213640 1 -- 172.21.15.123:0/3053079181 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3ee2a17d0 con 0x55b3ee561920 2024-09-15T23:20:06.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.197+0000 7fa9f5a14640 1 --2- 172.21.15.123:0/3053079181 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b3ee5812c0 0x55b3ee570000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:06.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.197+0000 7fa9f5213640 1 --2- 172.21.15.123:0/3053079181 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b3ee561920 0x55b3ee55b100 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec007430 tx=0x7fa9ec001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f28483f1ea3252 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:06.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.197+0000 7fa9cbfff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:20:06.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.197+0000 7fa9cbfff640 1 -- 172.21.15.123:0/3053079181 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec035640 con 0x55b3ee561920 2024-09-15T23:20:06.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.197+0000 7fa9cbfff640 1 -- 172.21.15.123:0/3053079181 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fa9ec0357e0 con 0x55b3ee561920 2024-09-15T23:20:06.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.197+0000 7fa9fa20b740 1 -- 172.21.15.123:0/3053079181 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9ec026070 con 0x55b3ee561920 2024-09-15T23:20:06.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.198+0000 7fa9cbfff640 1 -- 172.21.15.123:0/3053079181 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fa9ec03d050 con 0x55b3ee561920 2024-09-15T23:20:06.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.198+0000 7fa9fa20b740 10 client.8778 fetch_fsmap learned FSMap version 86 2024-09-15T23:20:06.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.198+0000 7fa9fa20b740 1 -- 172.21.15.123:0/3053079181 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) -- 0x55b3ee1d73f0 con 0x55b3ee561920 2024-09-15T23:20:06.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.198+0000 7fa9cbfff640 1 -- 172.21.15.123:0/3053079181 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9ec026070 con 0x55b3ee561920 2024-09-15T23:20:06.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.198+0000 7fa9cbfff640 1 -- 172.21.15.123:0/3053079181 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 86) ==== 3502+0+0 (secure 0 0 0) 0x7fa9ec040020 con 0x55b3ee561920 2024-09-15T23:20:06.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.198+0000 7fa9fa20b740 10 client.8778 fetch_fsmap finished waiting for FSMap version 86 2024-09-15T23:20:06.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.198+0000 7fa9fa20b740 10 client.8778 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.d 2024-09-15T23:20:06.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.198+0000 7fa9fa20b740 20 client.8778 populate_metadata read hostname 'smithi123' 2024-09-15T23:20:06.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.198+0000 7fa9fa20b740 1 --2- 172.21.15.123:0/3053079181 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x55b3ee572890 0x55b3ee5c4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.198+0000 7fa9fa20b740 4 client.8778 mds_command: new command op to 8439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:20:06.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.198+0000 7fa9fa20b740 1 -- 172.21.15.123:0/3053079181 --> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b3ee4d1e20 con 0x55b3ee572890 2024-09-15T23:20:06.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.198+0000 7fa9f4a12640 1 --2- 172.21.15.123:0/3053079181 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x55b3ee572890 0x55b3ee5c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.198+0000 7fa9f4a12640 1 --2- 172.21.15.123:0/3053079181 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x55b3ee572890 0x55b3ee5c4670 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb83802a7e9c9fe9 server_cookie=d738175fea304f00 in_seq=0 out_seq=0 2024-09-15T23:20:06.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.198+0000 7fa9cbfff640 10 client.8778 ms_handle_connect on v2:172.21.15.188:6835/1222656979 2024-09-15T23:20:06.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.199+0000 7fa9cbfff640 1 -- 172.21.15.123:0/3053079181 <== mds.0 v2:172.21.15.188:6835/1222656979 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b3ee4d1e20 con 0x55b3ee572890 2024-09-15T23:20:06.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.199+0000 7fa9cbfff640 10 client.8778 handle_command_reply: tid=0 2024-09-15T23:20:06.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.199+0000 7fa9fa20b740 1 client.8778 shutdown 2024-09-15T23:20:06.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.199+0000 7fa9fa20b740 1 -- 172.21.15.123:0/3053079181 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b3ee561920 msgr2=0x55b3ee55b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:06.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.199+0000 7fa9fa20b740 1 --2- 172.21.15.123:0/3053079181 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b3ee561920 0x55b3ee55b100 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec007430 tx=0x7fa9ec001a40 comp rx=0 tx=0).stop 2024-09-15T23:20:06.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.199+0000 7fa9fa20b740 1 -- 172.21.15.123:0/3053079181 shutdown_connections 2024-09-15T23:20:06.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.199+0000 7fa9fa20b740 1 --2- 172.21.15.123:0/3053079181 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x55b3ee572890 0x55b3ee5c4670 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.199+0000 7fa9fa20b740 1 --2- 172.21.15.123:0/3053079181 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b3ee5812c0 0x55b3ee570000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.199+0000 7fa9fa20b740 1 --2- 172.21.15.123:0/3053079181 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3ee5630b0 0x55b3ee580d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.199+0000 7fa9fa20b740 1 --2- 172.21.15.123:0/3053079181 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b3ee561920 0x55b3ee55b100 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.199+0000 7fa9cbfff640 0 client.8778 ms_handle_reset on v2:172.21.15.188:6835/1222656979 2024-09-15T23:20:06.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.199+0000 7fa9fa20b740 1 -- 172.21.15.123:0/3053079181 >> 172.21.15.123:0/3053079181 conn(0x55b3ee55f0e0 msgr2=0x55b3ee5a4540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:06.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.199+0000 7fa9fa20b740 1 -- 172.21.15.123:0/3053079181 shutdown_connections 2024-09-15T23:20:06.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.199+0000 7fa9fa20b740 1 -- 172.21.15.123:0/3053079181 wait complete. 2024-09-15T23:20:06.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.200+0000 7fa9fa20b740 20 client.8778 trim_cache size 0 max 16384 2024-09-15T23:20:06.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.217+0000 7fa9fa20b740 1 Processor -- start 2024-09-15T23:20:06.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.217+0000 7fa9fa20b740 1 -- start start 2024-09-15T23:20:06.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.217+0000 7fa9fa20b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b3ee561920 0x55b3ee5afff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.217+0000 7fa9fa20b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3ee5630b0 0x55b3ee5a5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.217+0000 7fa9fa20b740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b3ee5812c0 0x55b3ee5b9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.217+0000 7fa9fa20b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55b3ee582250 con 0x55b3ee561920 2024-09-15T23:20:06.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.217+0000 7fa9fa20b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f02013b0 con 0x55b3ee5630b0 2024-09-15T23:20:06.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.217+0000 7fa9fa20b740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa9f02003f0 con 0x55b3ee5812c0 2024-09-15T23:20:06.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.217+0000 7fa9f5213640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b3ee561920 0x55b3ee5afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.217+0000 7fa9f5213640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b3ee561920 0x55b3ee5afff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42788/0 (socket says 172.21.15.123:42788) 2024-09-15T23:20:06.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.217+0000 7fa9f5213640 1 -- 172.21.15.123:0/1869319251 learned_addr learned my addr 172.21.15.123:0/1869319251 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:06.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.218+0000 7fa9f5213640 1 -- 172.21.15.123:0/1869319251 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b3ee5812c0 msgr2=0x55b3ee5b9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:06.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.218+0000 7fa9f5213640 1 --2- 172.21.15.123:0/1869319251 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b3ee5812c0 0x55b3ee5b9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.218+0000 7fa9f5213640 1 -- 172.21.15.123:0/1869319251 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3ee5630b0 msgr2=0x55b3ee5a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:06.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.218+0000 7fa9f5213640 1 --2- 172.21.15.123:0/1869319251 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3ee5630b0 0x55b3ee5a5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.218+0000 7fa9f5213640 1 -- 172.21.15.123:0/1869319251 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3ee1970f0 con 0x55b3ee561920 2024-09-15T23:20:06.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.218+0000 7fa9f5213640 1 --2- 172.21.15.123:0/1869319251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b3ee561920 0x55b3ee5afff0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec007e10 tx=0x7fa9ec02e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8839965e5899e872 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:06.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.218+0000 7fa9d27fc640 1 -- 172.21.15.123:0/1869319251 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec035640 con 0x55b3ee561920 2024-09-15T23:20:06.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.218+0000 7fa9d27fc640 1 -- 172.21.15.123:0/1869319251 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9ec026070 con 0x55b3ee561920 2024-09-15T23:20:06.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.218+0000 7fa9d27fc640 1 -- 172.21.15.123:0/1869319251 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec035a40 con 0x55b3ee561920 2024-09-15T23:20:06.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.218+0000 7fa9fa20b740 1 -- 172.21.15.123:0/1869319251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b3ee561920 msgr2=0x55b3ee5afff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:06.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.218+0000 7fa9fa20b740 1 --2- 172.21.15.123:0/1869319251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b3ee561920 0x55b3ee5afff0 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec007e10 tx=0x7fa9ec02e040 comp rx=0 tx=0).stop 2024-09-15T23:20:06.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.219+0000 7fa9fa20b740 1 -- 172.21.15.123:0/1869319251 shutdown_connections 2024-09-15T23:20:06.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.219+0000 7fa9fa20b740 1 --2- 172.21.15.123:0/1869319251 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b3ee5812c0 0x55b3ee5b9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.219+0000 7fa9fa20b740 1 --2- 172.21.15.123:0/1869319251 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3ee5630b0 0x55b3ee5a5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.219+0000 7fa9fa20b740 1 --2- 172.21.15.123:0/1869319251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b3ee561920 0x55b3ee5afff0 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.219+0000 7fa9fa20b740 1 -- 172.21.15.123:0/1869319251 >> 172.21.15.123:0/1869319251 conn(0x55b3ee55f0e0 msgr2=0x55b3ee5ca2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:06.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.219+0000 7fa9fa20b740 1 -- 172.21.15.123:0/1869319251 shutdown_connections 2024-09-15T23:20:06.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.219+0000 7fa9fa20b740 1 -- 172.21.15.123:0/1869319251 wait complete. 2024-09-15T23:20:06.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.219+0000 7fa9fa20b740 1 -- start start 2024-09-15T23:20:06.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.219+0000 7fa9fa20b740 1 Processor -- start 2024-09-15T23:20:06.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.220+0000 7fa9fa20b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3ee561920 0x55b3ee624860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.220+0000 7fa9fa20b740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b3ee5630b0 0x55b3ee5ab910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.220+0000 7fa9fa20b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b3ee5812c0 0x55b3ee5abe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.220+0000 7fa9fa20b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f01ffe70 con 0x55b3ee5812c0 2024-09-15T23:20:06.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.220+0000 7fa9fa20b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f01f83f0 con 0x55b3ee561920 2024-09-15T23:20:06.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.220+0000 7fa9fa20b740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55b3ee55c840 con 0x55b3ee5630b0 2024-09-15T23:20:06.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.220+0000 7fa9fa20b740 10 client.0 _ll_register_callbacks cb 0x7fa9ec007ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:20:06.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.220+0000 7fa9f5a14640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b3ee5812c0 0x55b3ee5abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.220+0000 7fa9f5a14640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b3ee5812c0 0x55b3ee5abe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42794/0 (socket says 172.21.15.123:42794) 2024-09-15T23:20:06.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.220+0000 7fa9f5a14640 1 -- 172.21.15.123:0/1295261977 learned_addr learned my addr 172.21.15.123:0/1295261977 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:06.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.220+0000 7fa9f5a14640 1 -- 172.21.15.123:0/1295261977 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b3ee5630b0 msgr2=0x55b3ee5ab910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:06.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.220+0000 7fa9f5a14640 1 --2- 172.21.15.123:0/1295261977 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b3ee5630b0 0x55b3ee5ab910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.220+0000 7fa9f5a14640 1 -- 172.21.15.123:0/1295261977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3ee561920 msgr2=0x55b3ee624860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:06.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.220+0000 7fa9f5213640 1 --2- 172.21.15.123:0/1295261977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3ee561920 0x55b3ee624860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.220+0000 7fa9f5a14640 1 --2- 172.21.15.123:0/1295261977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3ee561920 0x55b3ee624860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.220+0000 7fa9f5a14640 1 -- 172.21.15.123:0/1295261977 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3ee624da0 con 0x55b3ee5812c0 2024-09-15T23:20:06.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.221+0000 7fa9f5a14640 1 --2- 172.21.15.123:0/1295261977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b3ee5812c0 0x55b3ee5abe50 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8009f90 tx=0x7fa9e8079780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b14afbd91e8f9ac6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:06.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.221+0000 7fa9cbfff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:20:06.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.221+0000 7fa9cbfff640 1 -- 172.21.15.123:0/1295261977 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e80a7070 con 0x55b3ee5812c0 2024-09-15T23:20:06.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.221+0000 7fa9cbfff640 1 -- 172.21.15.123:0/1295261977 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fa9e8076360 con 0x55b3ee5812c0 2024-09-15T23:20:06.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.221+0000 7fa9fa20b740 1 -- 172.21.15.123:0/1295261977 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9ec026070 con 0x55b3ee5812c0 2024-09-15T23:20:06.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.221+0000 7fa9cbfff640 1 -- 172.21.15.123:0/1295261977 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fa9e8049040 con 0x55b3ee5812c0 2024-09-15T23:20:06.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.221+0000 7fa9fa20b740 10 client.8784 fetch_fsmap learned FSMap version 86 2024-09-15T23:20:06.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.221+0000 7fa9fa20b740 1 -- 172.21.15.123:0/1295261977 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) -- 0x55b3ee5b0610 con 0x55b3ee5812c0 2024-09-15T23:20:06.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.221+0000 7fa9cbfff640 1 -- 172.21.15.123:0/1295261977 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9ec026070 con 0x55b3ee5812c0 2024-09-15T23:20:06.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.221+0000 7fa9cbfff640 1 -- 172.21.15.123:0/1295261977 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 86) ==== 3502+0+0 (secure 0 0 0) 0x7fa9e8079140 con 0x55b3ee5812c0 2024-09-15T23:20:06.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.221+0000 7fa9fa20b740 10 client.8784 fetch_fsmap finished waiting for FSMap version 86 2024-09-15T23:20:06.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.221+0000 7fa9fa20b740 10 client.8784 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.d 2024-09-15T23:20:06.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.221+0000 7fa9fa20b740 20 client.8784 populate_metadata read hostname 'smithi123' 2024-09-15T23:20:06.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.221+0000 7fa9fa20b740 1 --2- 172.21.15.123:0/1295261977 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x55b3ee5a9aa0 0x55b3ee5a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.221+0000 7fa9fa20b740 4 client.8784 mds_command: new command op to 8439 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:20:06.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.221+0000 7fa9fa20b740 1 -- 172.21.15.123:0/1295261977 --> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b3ee4cc170 con 0x55b3ee5a9aa0 2024-09-15T23:20:06.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.221+0000 7fa9f5213640 1 --2- 172.21.15.123:0/1295261977 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x55b3ee5a9aa0 0x55b3ee5a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.222+0000 7fa9cbfff640 10 client.8784 ms_handle_connect on v2:172.21.15.188:6835/1222656979 2024-09-15T23:20:06.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.222+0000 7fa9f5213640 1 --2- 172.21.15.123:0/1295261977 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x55b3ee5a9aa0 0x55b3ee5a9eb0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e07b25b1e7e67234 server_cookie=1a1596fb168071f6 in_seq=0 out_seq=0 2024-09-15T23:20:06.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.222+0000 7fa9cbfff640 1 -- 172.21.15.123:0/1295261977 <== mds.0 v2:172.21.15.188:6835/1222656979 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b3ee4cc170 con 0x55b3ee5a9aa0 2024-09-15T23:20:06.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.222+0000 7fa9cbfff640 10 client.8784 handle_command_reply: tid=0 2024-09-15T23:20:06.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.222+0000 7fa9fa20b740 1 client.8784 shutdown 2024-09-15T23:20:06.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.222+0000 7fa9fa20b740 1 -- 172.21.15.123:0/1295261977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b3ee5812c0 msgr2=0x55b3ee5abe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:06.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.222+0000 7fa9fa20b740 1 --2- 172.21.15.123:0/1295261977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b3ee5812c0 0x55b3ee5abe50 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8009f90 tx=0x7fa9e8079780 comp rx=0 tx=0).stop 2024-09-15T23:20:06.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.222+0000 7fa9fa20b740 1 -- 172.21.15.123:0/1295261977 shutdown_connections 2024-09-15T23:20:06.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.222+0000 7fa9fa20b740 1 --2- 172.21.15.123:0/1295261977 >> [v2:172.21.15.188:6835/1222656979,v1:172.21.15.188:6837/1222656979] conn(0x55b3ee5a9aa0 0x55b3ee5a9eb0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.222+0000 7fa9fa20b740 1 --2- 172.21.15.123:0/1295261977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b3ee5812c0 0x55b3ee5abe50 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.222+0000 7fa9cbfff640 0 client.8784 ms_handle_reset on v2:172.21.15.188:6835/1222656979 2024-09-15T23:20:06.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.222+0000 7fa9fa20b740 1 --2- 172.21.15.123:0/1295261977 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b3ee5630b0 0x55b3ee5ab910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.222+0000 7fa9fa20b740 1 --2- 172.21.15.123:0/1295261977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b3ee561920 0x55b3ee624860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.222+0000 7fa9fa20b740 1 -- 172.21.15.123:0/1295261977 >> 172.21.15.123:0/1295261977 conn(0x55b3ee55f0e0 msgr2=0x55b3ee580600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:06.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.222+0000 7fa9fa20b740 1 -- 172.21.15.123:0/1295261977 shutdown_connections 2024-09-15T23:20:06.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.222+0000 7fa9fa20b740 1 -- 172.21.15.123:0/1295261977 wait complete. 2024-09-15T23:20:06.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.222+0000 7fa9fa20b740 20 client.8784 trim_cache size 0 max 16384 2024-09-15T23:20:06.236 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:20:06.236 INFO:teuthology.orchestra.run.smithi123.stdout: "status": "no active scrubs running", 2024-09-15T23:20:06.236 INFO:teuthology.orchestra.run.smithi123.stdout: "scrubs": {} 2024-09-15T23:20:06.237 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:20:06.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.223+0000 7fa9f7477640 1 -- 172.21.15.123:0/543267662 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa9d406c2b0 msgr2=0x7fa9d406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:06.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.223+0000 7fa9f7477640 1 --2- 172.21.15.123:0/543267662 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa9d406c2b0 0x7fa9d406e770 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec001eb0 tx=0x7fa9ec009040 comp rx=0 tx=0).stop 2024-09-15T23:20:06.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.223+0000 7fa9f7477640 1 -- 172.21.15.123:0/543267662 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9f014b410 msgr2=0x7fa9f0157d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:06.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.223+0000 7fa9f7477640 1 --2- 172.21.15.123:0/543267662 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9f014b410 0x7fa9f0157d50 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fa9e800e230 tx=0x7fa9e8009750 comp rx=0 tx=0).stop 2024-09-15T23:20:06.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.223+0000 7fa9f7477640 1 -- 172.21.15.123:0/543267662 shutdown_connections 2024-09-15T23:20:06.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.223+0000 7fa9f7477640 1 --2- 172.21.15.123:0/543267662 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa9d406c2b0 0x7fa9d406e770 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.223+0000 7fa9f7477640 1 --2- 172.21.15.123:0/543267662 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa9f014b410 0x7fa9f0157d50 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.223+0000 7fa9f7477640 1 --2- 172.21.15.123:0/543267662 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa9f0159b50 0x7fa9f0157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.223+0000 7fa9f7477640 1 --2- 172.21.15.123:0/543267662 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa9dc0051c0 0x7fa9f014ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.223+0000 7fa9f7477640 1 -- 172.21.15.123:0/543267662 >> 172.21.15.123:0/543267662 conn(0x7fa9f006d0f0 msgr2=0x7fa9f015e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:06.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.223+0000 7fa9f7477640 1 -- 172.21.15.123:0/543267662 shutdown_connections 2024-09-15T23:20:06.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.223+0000 7fa9f7477640 1 -- 172.21.15.123:0/543267662 wait complete. 2024-09-15T23:20:06.239 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:20:06.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.337+0000 7f4d376c9640 1 Processor -- start 2024-09-15T23:20:06.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.337+0000 7f4d376c9640 1 -- start start 2024-09-15T23:20:06.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.338+0000 7f4d376c9640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4d30145ed0 0x7f4d300b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.338+0000 7f4d376c9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4d30073180 0x7f4d300735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.338+0000 7f4d376c9640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d300b4020 con 0x7f4d300b5880 2024-09-15T23:20:06.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.338+0000 7f4d376c9640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f4d30073b00 con 0x7f4d30145ed0 2024-09-15T23:20:06.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.338+0000 7f4d376c9640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4d300b42c0 con 0x7f4d30073180 2024-09-15T23:20:06.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.338+0000 7f4d35465640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4d30145ed0 0x7f4d300b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.338+0000 7f4d35c66640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f4d300b5880 0x7f4d300b5d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:37986/0 (socket says 172.21.15.123:37986) 2024-09-15T23:20:06.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.338+0000 7f4d35c66640 1 -- 172.21.15.123:0/2196073844 learned_addr learned my addr 172.21.15.123:0/2196073844 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:06.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.338+0000 7f4d34c64640 1 --2- 172.21.15.123:0/2196073844 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4d30073180 0x7f4d300735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.338+0000 7f4d35465640 1 -- 172.21.15.123:0/2196073844 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4d30073180 msgr2=0x7f4d300735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:06.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.339+0000 7f4d35465640 1 --2- 172.21.15.123:0/2196073844 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4d30073180 0x7f4d300735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.339+0000 7f4d35465640 1 -- 172.21.15.123:0/2196073844 >> v1:172.21.15.123:6789/0 conn(0x7f4d300b5880 legacy=0x7f4d300b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:06.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.339+0000 7f4d35465640 1 -- 172.21.15.123:0/2196073844 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d300b45a0 con 0x7f4d30145ed0 2024-09-15T23:20:06.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.339+0000 7f4d27fff640 1 -- 172.21.15.123:0/2196073844 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1325528892 0 0) 0x7f4d300b4020 con 0x7f4d300b5880 2024-09-15T23:20:06.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.339+0000 7f4d34c64640 1 --2- 172.21.15.123:0/2196073844 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4d30073180 0x7f4d300735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:20:06.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.339+0000 7f4d35465640 1 --2- 172.21.15.123:0/2196073844 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d30145ed0 0x7f4d300b5080 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c0097a0 tx=0x7f4d2c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea83a53e27a0409c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:06.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.339+0000 7f4d27fff640 1 -- 172.21.15.123:0/2196073844 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c037070 con 0x7f4d30145ed0 2024-09-15T23:20:06.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.339+0000 7f4d27fff640 1 -- 172.21.15.123:0/2196073844 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d2c032440 con 0x7f4d30145ed0 2024-09-15T23:20:06.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.339+0000 7f4d27fff640 1 -- 172.21.15.123:0/2196073844 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c032810 con 0x7f4d30145ed0 2024-09-15T23:20:06.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.340+0000 7f4d376c9640 1 -- 172.21.15.123:0/2196073844 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d30145ed0 msgr2=0x7f4d300b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:06.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.340+0000 7f4d376c9640 1 --2- 172.21.15.123:0/2196073844 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d30145ed0 0x7f4d300b5080 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c0097a0 tx=0x7f4d2c02a180 comp rx=0 tx=0).stop 2024-09-15T23:20:06.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.340+0000 7f4d376c9640 1 -- 172.21.15.123:0/2196073844 shutdown_connections 2024-09-15T23:20:06.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.340+0000 7f4d376c9640 1 --2- 172.21.15.123:0/2196073844 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4d30073180 0x7f4d300735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.340+0000 7f4d376c9640 1 --2- 172.21.15.123:0/2196073844 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d30145ed0 0x7f4d300b5080 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.340+0000 7f4d376c9640 1 -- 172.21.15.123:0/2196073844 >> 172.21.15.123:0/2196073844 conn(0x7f4d300ccec0 msgr2=0x7f4d300cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:06.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.340+0000 7f4d376c9640 1 -- 172.21.15.123:0/2196073844 shutdown_connections 2024-09-15T23:20:06.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.340+0000 7f4d376c9640 1 -- 172.21.15.123:0/2196073844 wait complete. 2024-09-15T23:20:06.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.341+0000 7f4d376c9640 1 Processor -- start 2024-09-15T23:20:06.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.341+0000 7f4d376c9640 1 -- start start 2024-09-15T23:20:06.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.342+0000 7f4d376c9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4d30073180 0x7f4d300c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.342+0000 7f4d376c9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4d300b5880 0x7f4d301f2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.342+0000 7f4d376c9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d30145ed0 0x7f4d3013e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.342+0000 7f4d376c9640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4d301462b0 con 0x7f4d30145ed0 2024-09-15T23:20:06.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.342+0000 7f4d376c9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4d300b4b60 con 0x7f4d300b5880 2024-09-15T23:20:06.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.342+0000 7f4d376c9640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4d30146430 con 0x7f4d30073180 2024-09-15T23:20:06.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.342+0000 7f4d35c66640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d30145ed0 0x7f4d3013e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.342+0000 7f4d35c66640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d30145ed0 0x7f4d3013e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42808/0 (socket says 172.21.15.123:42808) 2024-09-15T23:20:06.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.342+0000 7f4d35c66640 1 -- 172.21.15.123:0/2561709997 learned_addr learned my addr 172.21.15.123:0/2561709997 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:06.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.342+0000 7f4d35465640 1 --2- 172.21.15.123:0/2561709997 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4d30073180 0x7f4d300c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.342+0000 7f4d34c64640 1 --2- 172.21.15.123:0/2561709997 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4d300b5880 0x7f4d301f2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.342+0000 7f4d35c66640 1 -- 172.21.15.123:0/2561709997 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4d30073180 msgr2=0x7f4d300c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:06.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.342+0000 7f4d35c66640 1 --2- 172.21.15.123:0/2561709997 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4d30073180 0x7f4d300c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.342+0000 7f4d35c66640 1 -- 172.21.15.123:0/2561709997 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4d300b5880 msgr2=0x7f4d301f2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:06.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.342+0000 7f4d35c66640 1 --2- 172.21.15.123:0/2561709997 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4d300b5880 0x7f4d301f2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.342+0000 7f4d35c66640 1 -- 172.21.15.123:0/2561709997 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d300c7940 con 0x7f4d30145ed0 2024-09-15T23:20:06.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.342+0000 7f4d35465640 1 --2- 172.21.15.123:0/2561709997 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4d30073180 0x7f4d300c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:06.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.342+0000 7f4d34c64640 1 --2- 172.21.15.123:0/2561709997 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4d300b5880 0x7f4d301f2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:06.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.342+0000 7f4d35c66640 1 --2- 172.21.15.123:0/2561709997 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d30145ed0 0x7f4d3013e370 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f4d2800c7d0 tx=0x7f4d2800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:06.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.343+0000 7f4d25ffb640 1 -- 172.21.15.123:0/2561709997 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d28018070 con 0x7f4d30145ed0 2024-09-15T23:20:06.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.343+0000 7f4d25ffb640 1 -- 172.21.15.123:0/2561709997 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d2800a640 con 0x7f4d30145ed0 2024-09-15T23:20:06.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.343+0000 7f4d25ffb640 1 -- 172.21.15.123:0/2561709997 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2800aa70 con 0x7f4d30145ed0 2024-09-15T23:20:06.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.343+0000 7f4d376c9640 1 -- 172.21.15.123:0/2561709997 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d300c7be0 con 0x7f4d30145ed0 2024-09-15T23:20:06.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.343+0000 7f4d376c9640 1 -- 172.21.15.123:0/2561709997 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d300c8480 con 0x7f4d30145ed0 2024-09-15T23:20:06.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.344+0000 7f4d376c9640 1 -- 172.21.15.123:0/2561709997 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d300735c0 con 0x7f4d30145ed0 2024-09-15T23:20:06.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.344+0000 7f4d25ffb640 1 -- 172.21.15.123:0/2561709997 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4d2801b070 con 0x7f4d30145ed0 2024-09-15T23:20:06.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.344+0000 7f4d25ffb640 1 --2- 172.21.15.123:0/2561709997 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4d1406c2b0 0x7f4d1406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.345+0000 7f4d25ffb640 1 -- 172.21.15.123:0/2561709997 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f4d2808aa40 con 0x7f4d30145ed0 2024-09-15T23:20:06.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.345+0000 7f4d35465640 1 --2- 172.21.15.123:0/2561709997 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4d1406c2b0 0x7f4d1406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.345+0000 7f4d35465640 1 --2- 172.21.15.123:0/2561709997 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4d1406c2b0 0x7f4d1406e770 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c034000 tx=0x7f4d2c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:06.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.349+0000 7f4d25ffb640 1 -- 172.21.15.123:0/2561709997 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4d280591b0 con 0x7f4d30145ed0 2024-09-15T23:20:06.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.548+0000 7f4d376c9640 1 -- 172.21.15.123:0/2561709997 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d3015c8e0 con 0x7f4d30145ed0 2024-09-15T23:20:06.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.549+0000 7f4d25ffb640 1 -- 172.21.15.123:0/2561709997 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5237 (secure 0 0 0) 0x7f4d28058ab0 con 0x7f4d30145ed0 2024-09-15T23:20:06.550 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:06.550 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":86,"btime":"2024-09-15T23:19:37:619526+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2082746470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2082746470},{"type":"v1","addr":"172.21.15.123:6834","nonce":2082746470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8421,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2007610603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":2007610603},{"type":"v1","addr":"172.21.15.123:6835","nonce":2007610603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8436,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2929123975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2929123975},{"type":"v1","addr":"172.21.15.188:6836","nonce":2929123975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:19:34.917419+0000","modified":"2024-09-15T23:19:36.941347+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8439":{"gid":8439,"name":"d","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6837/1222656979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1222656979},{"type":"v1","addr":"172.21.15.188:6837","nonce":1222656979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8439,"qdb_cluster":[8439]},"id":9}]} 2024-09-15T23:20:06.550 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 86 2024-09-15T23:20:06.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.551+0000 7f4d376c9640 1 -- 172.21.15.123:0/2561709997 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4d1406c2b0 msgr2=0x7f4d1406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:06.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.551+0000 7f4d376c9640 1 --2- 172.21.15.123:0/2561709997 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4d1406c2b0 0x7f4d1406e770 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c034000 tx=0x7f4d2c02e000 comp rx=0 tx=0).stop 2024-09-15T23:20:06.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.551+0000 7f4d376c9640 1 -- 172.21.15.123:0/2561709997 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d30145ed0 msgr2=0x7f4d3013e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:06.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.551+0000 7f4d376c9640 1 --2- 172.21.15.123:0/2561709997 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d30145ed0 0x7f4d3013e370 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f4d2800c7d0 tx=0x7f4d2800cc90 comp rx=0 tx=0).stop 2024-09-15T23:20:06.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.551+0000 7f4d376c9640 1 -- 172.21.15.123:0/2561709997 shutdown_connections 2024-09-15T23:20:06.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.551+0000 7f4d376c9640 1 --2- 172.21.15.123:0/2561709997 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4d1406c2b0 0x7f4d1406e770 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.551+0000 7f4d376c9640 1 --2- 172.21.15.123:0/2561709997 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4d30145ed0 0x7f4d3013e370 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.551+0000 7f4d376c9640 1 --2- 172.21.15.123:0/2561709997 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4d300b5880 0x7f4d301f2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.551+0000 7f4d376c9640 1 --2- 172.21.15.123:0/2561709997 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4d30073180 0x7f4d300c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.551+0000 7f4d376c9640 1 -- 172.21.15.123:0/2561709997 >> 172.21.15.123:0/2561709997 conn(0x7f4d300ccec0 msgr2=0x7f4d30144c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:06.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.551+0000 7f4d376c9640 1 -- 172.21.15.123:0/2561709997 shutdown_connections 2024-09-15T23:20:06.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.551+0000 7f4d376c9640 1 -- 172.21.15.123:0/2561709997 wait complete. 2024-09-15T23:20:06.563 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-15T23:20:06.563 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:20:06.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.661+0000 7fc4c9386640 1 Processor -- start 2024-09-15T23:20:06.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.661+0000 7fc4c9386640 1 -- start start 2024-09-15T23:20:06.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.662+0000 7fc4c9386640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc4c415e790 0x7fc4c4073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.662+0000 7fc4c9386640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc4c4162c60 0x7fc4c40b5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.662+0000 7fc4c9386640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4c40b5970 0x7fc4c406f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.662+0000 7fc4c9386640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc4c415eb70 con 0x7fc4c415e790 2024-09-15T23:20:06.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.662+0000 7fc4c9386640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fc4c41631c0 con 0x7fc4c4162c60 2024-09-15T23:20:06.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.662+0000 7fc4c9386640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc4c40ae9a0 con 0x7fc4c40b5970 2024-09-15T23:20:06.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.662+0000 7fc4c2ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc4c415e790 0x7fc4c4073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.662+0000 7fc4c2ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc4c415e790 0x7fc4c4073a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42820/0 (socket says 172.21.15.123:42820) 2024-09-15T23:20:06.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.662+0000 7fc4c2ffd640 1 -- 172.21.15.123:0/4177943665 learned_addr learned my addr 172.21.15.123:0/4177943665 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:06.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.662+0000 7fc4c27fc640 1 --2- 172.21.15.123:0/4177943665 >> v2:172.21.15.188:3300/0 conn(0x7fc4c4162c60 0x7fc4c40b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.662+0000 7fc4c37fe640 1 --2- 172.21.15.123:0/4177943665 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4c40b5970 0x7fc4c406f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.662+0000 7fc4c2ffd640 1 -- 172.21.15.123:0/4177943665 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4c40b5970 msgr2=0x7fc4c406f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:06.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.662+0000 7fc4c2ffd640 1 --2- 172.21.15.123:0/4177943665 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4c40b5970 0x7fc4c406f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.662+0000 7fc4c2ffd640 1 -- 172.21.15.123:0/4177943665 >> v2:172.21.15.188:3300/0 conn(0x7fc4c4162c60 msgr2=0x7fc4c40b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:06.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.662+0000 7fc4c2ffd640 1 --2- 172.21.15.123:0/4177943665 >> v2:172.21.15.188:3300/0 conn(0x7fc4c4162c60 0x7fc4c40b5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.662+0000 7fc4c2ffd640 1 -- 172.21.15.123:0/4177943665 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4c40aec40 con 0x7fc4c415e790 2024-09-15T23:20:06.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.663+0000 7fc4c2ffd640 1 --2- 172.21.15.123:0/4177943665 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4c415e790 0x7fc4c4073a40 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fc4c40b5130 tx=0x7fc4b402a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3cc41cd9eba873b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:06.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.663+0000 7fc4c1ffb640 1 -- 172.21.15.123:0/4177943665 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4036070 con 0x7fc4c415e790 2024-09-15T23:20:06.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.663+0000 7fc4c1ffb640 1 -- 172.21.15.123:0/4177943665 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4b4031600 con 0x7fc4c415e790 2024-09-15T23:20:06.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.663+0000 7fc4c1ffb640 1 -- 172.21.15.123:0/4177943665 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b40319d0 con 0x7fc4c415e790 2024-09-15T23:20:06.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.664+0000 7fc4c9386640 1 -- 172.21.15.123:0/4177943665 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4c415e790 msgr2=0x7fc4c4073a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:06.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.664+0000 7fc4c9386640 1 --2- 172.21.15.123:0/4177943665 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4c415e790 0x7fc4c4073a40 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fc4c40b5130 tx=0x7fc4b402a570 comp rx=0 tx=0).stop 2024-09-15T23:20:06.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.664+0000 7fc4c9386640 1 -- 172.21.15.123:0/4177943665 shutdown_connections 2024-09-15T23:20:06.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.664+0000 7fc4c9386640 1 --2- 172.21.15.123:0/4177943665 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4c40b5970 0x7fc4c406f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.664+0000 7fc4c9386640 1 --2- 172.21.15.123:0/4177943665 >> v2:172.21.15.188:3300/0 conn(0x7fc4c4162c60 0x7fc4c40b5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.664+0000 7fc4c9386640 1 --2- 172.21.15.123:0/4177943665 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4c415e790 0x7fc4c4073a40 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.664+0000 7fc4c9386640 1 -- 172.21.15.123:0/4177943665 >> 172.21.15.123:0/4177943665 conn(0x7fc4c40b0a80 msgr2=0x7fc4c40b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:06.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.664+0000 7fc4c9386640 1 -- 172.21.15.123:0/4177943665 shutdown_connections 2024-09-15T23:20:06.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.664+0000 7fc4c9386640 1 -- 172.21.15.123:0/4177943665 wait complete. 2024-09-15T23:20:06.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.665+0000 7fc4c9386640 1 Processor -- start 2024-09-15T23:20:06.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.665+0000 7fc4c9386640 1 -- start start 2024-09-15T23:20:06.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.666+0000 7fc4c9386640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4c40b5970 0x7fc4c40c65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.666+0000 7fc4c9386640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4c415e790 0x7fc4c40c7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.666+0000 7fc4c9386640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4c4162c60 0x7fc4c4154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.666+0000 7fc4c9386640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c406f430 con 0x7fc4c40b5970 2024-09-15T23:20:06.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.666+0000 7fc4c9386640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c40af200 con 0x7fc4c4162c60 2024-09-15T23:20:06.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.666+0000 7fc4c9386640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc4c406fc70 con 0x7fc4c415e790 2024-09-15T23:20:06.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.666+0000 7fc4c2ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4c40b5970 0x7fc4c40c65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.666+0000 7fc4c2ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4c40b5970 0x7fc4c40c65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42836/0 (socket says 172.21.15.123:42836) 2024-09-15T23:20:06.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.666+0000 7fc4c2ffd640 1 -- 172.21.15.123:0/2324869408 learned_addr learned my addr 172.21.15.123:0/2324869408 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:06.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.666+0000 7fc4c37fe640 1 --2- 172.21.15.123:0/2324869408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4c4162c60 0x7fc4c4154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.666+0000 7fc4c27fc640 1 --2- 172.21.15.123:0/2324869408 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4c415e790 0x7fc4c40c7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.666+0000 7fc4c2ffd640 1 -- 172.21.15.123:0/2324869408 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4c415e790 msgr2=0x7fc4c40c7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:06.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.666+0000 7fc4c2ffd640 1 --2- 172.21.15.123:0/2324869408 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4c415e790 0x7fc4c40c7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.666+0000 7fc4c2ffd640 1 -- 172.21.15.123:0/2324869408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4c4162c60 msgr2=0x7fc4c4154760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:06.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.666+0000 7fc4c2ffd640 1 --2- 172.21.15.123:0/2324869408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4c4162c60 0x7fc4c4154760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.666+0000 7fc4c2ffd640 1 -- 172.21.15.123:0/2324869408 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4c4154ca0 con 0x7fc4c40b5970 2024-09-15T23:20:06.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.666+0000 7fc4c2ffd640 1 --2- 172.21.15.123:0/2324869408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4c40b5970 0x7fc4c40c65c0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4034040 tx=0x7fc4b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:06.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.667+0000 7fc4bb7fe640 1 -- 172.21.15.123:0/2324869408 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4036050 con 0x7fc4c40b5970 2024-09-15T23:20:06.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.667+0000 7fc4bb7fe640 1 -- 172.21.15.123:0/2324869408 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4b4042070 con 0x7fc4c40b5970 2024-09-15T23:20:06.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.667+0000 7fc4c9386640 1 -- 172.21.15.123:0/2324869408 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4c41609d0 con 0x7fc4c40b5970 2024-09-15T23:20:06.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.667+0000 7fc4bb7fe640 1 -- 172.21.15.123:0/2324869408 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4007c30 con 0x7fc4c40b5970 2024-09-15T23:20:06.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.667+0000 7fc4c9386640 1 -- 172.21.15.123:0/2324869408 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4c4160f90 con 0x7fc4c40b5970 2024-09-15T23:20:06.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.668+0000 7fc4c9386640 1 -- 172.21.15.123:0/2324869408 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4c4070030 con 0x7fc4c40b5970 2024-09-15T23:20:06.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.668+0000 7fc4bb7fe640 1 -- 172.21.15.123:0/2324869408 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc4b4047460 con 0x7fc4c40b5970 2024-09-15T23:20:06.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.669+0000 7fc4bb7fe640 1 --2- 172.21.15.123:0/2324869408 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc4a406c2b0 0x7fc4a406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:06.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.669+0000 7fc4bb7fe640 1 -- 172.21.15.123:0/2324869408 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fc4b40ac350 con 0x7fc4c40b5970 2024-09-15T23:20:06.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.669+0000 7fc4c27fc640 1 --2- 172.21.15.123:0/2324869408 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc4a406c2b0 0x7fc4a406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:06.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.669+0000 7fc4c27fc640 1 --2- 172.21.15.123:0/2324869408 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc4a406c2b0 0x7fc4a406e770 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac006fd0 tx=0x7fc4ac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:06.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.673+0000 7fc4bb7fe640 1 -- 172.21.15.123:0/2324869408 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc4c4154ca0 con 0x7fc4c40b5970 2024-09-15T23:20:06.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.901+0000 7fc4c9386640 1 -- 172.21.15.123:0/2324869408 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fc4c40d0190 con 0x7fc4c40b5970 2024-09-15T23:20:06.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.901+0000 7fc4bb7fe640 1 -- 172.21.15.123:0/2324869408 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1640 (secure 0 0 0) 0x7fc4b407ab50 con 0x7fc4c40b5970 2024-09-15T23:20:06.902 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:06.902 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":497,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":142,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076566731,"bytes_used":2537865216,"bytes_avail":770556248064,"bytes_total":773094113280,"write_bytes_sec":30662034,"read_op_per_sec":0,"write_op_per_sec":30},"fsmap":{"epoch":86,"btime":"2024-09-15T23:19:37:619526+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"d","status":"up:active","gid":8439}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-09-15T23:20:03.615835+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}}}}}},"progress_events":{}} 2024-09-15T23:20:06.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.903+0000 7fc4c9386640 1 -- 172.21.15.123:0/2324869408 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc4a406c2b0 msgr2=0x7fc4a406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:06.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.903+0000 7fc4c9386640 1 --2- 172.21.15.123:0/2324869408 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc4a406c2b0 0x7fc4a406e770 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac006fd0 tx=0x7fc4ac008040 comp rx=0 tx=0).stop 2024-09-15T23:20:06.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.903+0000 7fc4c9386640 1 -- 172.21.15.123:0/2324869408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4c40b5970 msgr2=0x7fc4c40c65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:06.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.903+0000 7fc4c9386640 1 --2- 172.21.15.123:0/2324869408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4c40b5970 0x7fc4c40c65c0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4034040 tx=0x7fc4b4004a40 comp rx=0 tx=0).stop 2024-09-15T23:20:06.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.903+0000 7fc4c9386640 1 -- 172.21.15.123:0/2324869408 shutdown_connections 2024-09-15T23:20:06.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.903+0000 7fc4c9386640 1 --2- 172.21.15.123:0/2324869408 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4c4162c60 0x7fc4c4154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.903+0000 7fc4c9386640 1 --2- 172.21.15.123:0/2324869408 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4c415e790 0x7fc4c40c7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.903+0000 7fc4c9386640 1 --2- 172.21.15.123:0/2324869408 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc4a406c2b0 0x7fc4a406e770 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.903+0000 7fc4c9386640 1 --2- 172.21.15.123:0/2324869408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4c40b5970 0x7fc4c40c65c0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:06.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.903+0000 7fc4c9386640 1 -- 172.21.15.123:0/2324869408 >> 172.21.15.123:0/2324869408 conn(0x7fc4c40b0a80 msgr2=0x7fc4c40b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:06.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.903+0000 7fc4c9386640 1 -- 172.21.15.123:0/2324869408 shutdown_connections 2024-09-15T23:20:06.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:06.903+0000 7fc4c9386640 1 -- 172.21.15.123:0/2324869408 wait complete. 2024-09-15T23:20:06.915 INFO:tasks.ceph.ceph_manager.ceph:{'d': 'paused'} 2024-09-15T23:20:07.916 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:20:08.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.024+0000 7fc4f444c640 1 Processor -- start 2024-09-15T23:20:08.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.024+0000 7fc4f444c640 1 -- start start 2024-09-15T23:20:08.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.025+0000 7fc4f444c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4ec0b2d40 0x7fc4ec06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:08.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.025+0000 7fc4f444c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc4ec13eb20 0x7fc4ec06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:08.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.025+0000 7fc4f444c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc4ec15bcf0 0x7fc4ec15c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:08.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.025+0000 7fc4f444c640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc4ec071ab0 con 0x7fc4ec15bcf0 2024-09-15T23:20:08.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.025+0000 7fc4f444c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fc4ec071180 con 0x7fc4ec13eb20 2024-09-15T23:20:08.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.025+0000 7fc4f444c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc4ec071460 con 0x7fc4ec0b2d40 2024-09-15T23:20:08.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.025+0000 7fc4f29e9640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc4ec15bcf0 0x7fc4ec15c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:08.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.025+0000 7fc4f29e9640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc4ec15bcf0 0x7fc4ec15c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42844/0 (socket says 172.21.15.123:42844) 2024-09-15T23:20:08.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.025+0000 7fc4f29e9640 1 -- 172.21.15.123:0/131716887 learned_addr learned my addr 172.21.15.123:0/131716887 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:08.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.025+0000 7fc4f21e8640 1 --2- 172.21.15.123:0/131716887 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4ec0b2d40 0x7fc4ec06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:08.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.025+0000 7fc4f19e7640 1 --2- 172.21.15.123:0/131716887 >> v2:172.21.15.188:3300/0 conn(0x7fc4ec13eb20 0x7fc4ec06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:08.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.026+0000 7fc4f29e9640 1 -- 172.21.15.123:0/131716887 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4ec0b2d40 msgr2=0x7fc4ec06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:08.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.026+0000 7fc4f29e9640 1 --2- 172.21.15.123:0/131716887 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4ec0b2d40 0x7fc4ec06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:08.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.026+0000 7fc4f29e9640 1 -- 172.21.15.123:0/131716887 >> v2:172.21.15.188:3300/0 conn(0x7fc4ec13eb20 msgr2=0x7fc4ec06c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:08.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.026+0000 7fc4f29e9640 1 --2- 172.21.15.123:0/131716887 >> v2:172.21.15.188:3300/0 conn(0x7fc4ec13eb20 0x7fc4ec06c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:08.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.026+0000 7fc4f29e9640 1 -- 172.21.15.123:0/131716887 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4ec071740 con 0x7fc4ec15bcf0 2024-09-15T23:20:08.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.026+0000 7fc4f19e7640 1 --2- 172.21.15.123:0/131716887 >> v2:172.21.15.188:3300/0 conn(0x7fc4ec13eb20 0x7fc4ec06c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:08.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.026+0000 7fc4f29e9640 1 --2- 172.21.15.123:0/131716887 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4ec15bcf0 0x7fc4ec15c1a0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec073460 tx=0x7fc4e402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f65b0ca1cdf2915 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:08.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.027+0000 7fc4f11e6640 1 -- 172.21.15.123:0/131716887 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e4036070 con 0x7fc4ec15bcf0 2024-09-15T23:20:08.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.027+0000 7fc4f11e6640 1 -- 172.21.15.123:0/131716887 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4e4031600 con 0x7fc4ec15bcf0 2024-09-15T23:20:08.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.027+0000 7fc4f11e6640 1 -- 172.21.15.123:0/131716887 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e40319d0 con 0x7fc4ec15bcf0 2024-09-15T23:20:08.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.027+0000 7fc4f444c640 1 -- 172.21.15.123:0/131716887 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4ec15bcf0 msgr2=0x7fc4ec15c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:08.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.027+0000 7fc4f444c640 1 --2- 172.21.15.123:0/131716887 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4ec15bcf0 0x7fc4ec15c1a0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec073460 tx=0x7fc4e402a6a0 comp rx=0 tx=0).stop 2024-09-15T23:20:08.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.027+0000 7fc4f444c640 1 -- 172.21.15.123:0/131716887 shutdown_connections 2024-09-15T23:20:08.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.027+0000 7fc4f444c640 1 --2- 172.21.15.123:0/131716887 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4ec15bcf0 0x7fc4ec15c1a0 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:08.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.027+0000 7fc4f444c640 1 --2- 172.21.15.123:0/131716887 >> v2:172.21.15.188:3300/0 conn(0x7fc4ec13eb20 0x7fc4ec06c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:08.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.027+0000 7fc4f444c640 1 --2- 172.21.15.123:0/131716887 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4ec0b2d40 0x7fc4ec06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:08.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.027+0000 7fc4f444c640 1 -- 172.21.15.123:0/131716887 >> 172.21.15.123:0/131716887 conn(0x7fc4ec0ccec0 msgr2=0x7fc4ec0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:08.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.027+0000 7fc4f444c640 1 -- 172.21.15.123:0/131716887 shutdown_connections 2024-09-15T23:20:08.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.027+0000 7fc4f444c640 1 -- 172.21.15.123:0/131716887 wait complete. 2024-09-15T23:20:08.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.028+0000 7fc4f444c640 1 Processor -- start 2024-09-15T23:20:08.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.029+0000 7fc4f444c640 1 -- start start 2024-09-15T23:20:08.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.029+0000 7fc4f444c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4ec0b2d40 0x7fc4ec13d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:08.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.029+0000 7fc4f444c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4ec13eb20 0x7fc4ec072490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:08.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.029+0000 7fc4f444c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4ec15bcf0 0x7fc4ec0729d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:08.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.029+0000 7fc4f444c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ec15f140 con 0x7fc4ec13eb20 2024-09-15T23:20:08.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.029+0000 7fc4f444c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc4ec15efc0 con 0x7fc4ec0b2d40 2024-09-15T23:20:08.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.029+0000 7fc4f444c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc4ec15f2c0 con 0x7fc4ec15bcf0 2024-09-15T23:20:08.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.029+0000 7fc4f19e7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4ec13eb20 0x7fc4ec072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:08.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.029+0000 7fc4f19e7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4ec13eb20 0x7fc4ec072490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42848/0 (socket says 172.21.15.123:42848) 2024-09-15T23:20:08.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.029+0000 7fc4f19e7640 1 -- 172.21.15.123:0/2853900843 learned_addr learned my addr 172.21.15.123:0/2853900843 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:08.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.030+0000 7fc4f21e8640 1 --2- 172.21.15.123:0/2853900843 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4ec0b2d40 0x7fc4ec13d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:08.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.030+0000 7fc4f29e9640 1 --2- 172.21.15.123:0/2853900843 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4ec15bcf0 0x7fc4ec0729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:08.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.030+0000 7fc4f19e7640 1 -- 172.21.15.123:0/2853900843 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4ec15bcf0 msgr2=0x7fc4ec0729d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:08.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.030+0000 7fc4f19e7640 1 --2- 172.21.15.123:0/2853900843 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4ec15bcf0 0x7fc4ec0729d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:08.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.030+0000 7fc4f19e7640 1 -- 172.21.15.123:0/2853900843 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4ec0b2d40 msgr2=0x7fc4ec13d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:08.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.030+0000 7fc4f19e7640 1 --2- 172.21.15.123:0/2853900843 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4ec0b2d40 0x7fc4ec13d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:08.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.030+0000 7fc4f19e7640 1 -- 172.21.15.123:0/2853900843 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4ec1f5ef0 con 0x7fc4ec13eb20 2024-09-15T23:20:08.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.030+0000 7fc4f29e9640 1 --2- 172.21.15.123:0/2853900843 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4ec15bcf0 0x7fc4ec0729d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:08.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.030+0000 7fc4f19e7640 1 --2- 172.21.15.123:0/2853900843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4ec13eb20 0x7fc4ec072490 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc00e7e0 tx=0x7fc4dc00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:08.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.030+0000 7fc4e2ffd640 1 -- 172.21.15.123:0/2853900843 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc017070 con 0x7fc4ec13eb20 2024-09-15T23:20:08.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.030+0000 7fc4e2ffd640 1 -- 172.21.15.123:0/2853900843 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4dc00c6d0 con 0x7fc4ec13eb20 2024-09-15T23:20:08.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.030+0000 7fc4f444c640 1 -- 172.21.15.123:0/2853900843 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4ec1f61d0 con 0x7fc4ec13eb20 2024-09-15T23:20:08.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.030+0000 7fc4e2ffd640 1 -- 172.21.15.123:0/2853900843 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc00f040 con 0x7fc4ec13eb20 2024-09-15T23:20:08.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.030+0000 7fc4f444c640 1 -- 172.21.15.123:0/2853900843 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4ec1f6790 con 0x7fc4ec13eb20 2024-09-15T23:20:08.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.031+0000 7fc4f444c640 1 -- 172.21.15.123:0/2853900843 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4ec15c1a0 con 0x7fc4ec13eb20 2024-09-15T23:20:08.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.032+0000 7fc4e2ffd640 1 -- 172.21.15.123:0/2853900843 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc4dc01a070 con 0x7fc4ec13eb20 2024-09-15T23:20:08.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.032+0000 7fc4e2ffd640 1 --2- 172.21.15.123:0/2853900843 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc4d006c2b0 0x7fc4d006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:08.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.032+0000 7fc4e2ffd640 1 -- 172.21.15.123:0/2853900843 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fc4dc08b260 con 0x7fc4ec13eb20 2024-09-15T23:20:08.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.032+0000 7fc4f21e8640 1 --2- 172.21.15.123:0/2853900843 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc4d006c2b0 0x7fc4d006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:08.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.033+0000 7fc4f21e8640 1 --2- 172.21.15.123:0/2853900843 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc4d006c2b0 0x7fc4d006e770 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8006fd0 tx=0x7fc4e8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:08.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.036+0000 7fc4e2ffd640 1 -- 172.21.15.123:0/2853900843 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc4dc059410 con 0x7fc4ec13eb20 2024-09-15T23:20:08.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.236+0000 7fc4f444c640 1 -- 172.21.15.123:0/2853900843 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4ec157660 con 0x7fc4ec13eb20 2024-09-15T23:20:08.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.236+0000 7fc4e2ffd640 1 -- 172.21.15.123:0/2853900843 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5237 (secure 0 0 0) 0x7fc4dc05d710 con 0x7fc4ec13eb20 2024-09-15T23:20:08.237 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:08.237 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":86,"btime":"2024-09-15T23:19:37:619526+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2082746470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2082746470},{"type":"v1","addr":"172.21.15.123:6834","nonce":2082746470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8421,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2007610603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":2007610603},{"type":"v1","addr":"172.21.15.123:6835","nonce":2007610603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8436,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2929123975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2929123975},{"type":"v1","addr":"172.21.15.188:6836","nonce":2929123975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:19:34.917419+0000","modified":"2024-09-15T23:19:36.941347+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8439":{"gid":8439,"name":"d","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6837/1222656979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1222656979},{"type":"v1","addr":"172.21.15.188:6837","nonce":1222656979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8439,"qdb_cluster":[8439]},"id":9}]} 2024-09-15T23:20:08.238 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 86 2024-09-15T23:20:08.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.238+0000 7fc4f444c640 1 -- 172.21.15.123:0/2853900843 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc4d006c2b0 msgr2=0x7fc4d006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:08.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.238+0000 7fc4f444c640 1 --2- 172.21.15.123:0/2853900843 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc4d006c2b0 0x7fc4d006e770 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc4e8006fd0 tx=0x7fc4e8008040 comp rx=0 tx=0).stop 2024-09-15T23:20:08.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.238+0000 7fc4f444c640 1 -- 172.21.15.123:0/2853900843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4ec13eb20 msgr2=0x7fc4ec072490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:08.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.238+0000 7fc4f444c640 1 --2- 172.21.15.123:0/2853900843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4ec13eb20 0x7fc4ec072490 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc00e7e0 tx=0x7fc4dc00eca0 comp rx=0 tx=0).stop 2024-09-15T23:20:08.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.238+0000 7fc4f444c640 1 -- 172.21.15.123:0/2853900843 shutdown_connections 2024-09-15T23:20:08.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.238+0000 7fc4f444c640 1 --2- 172.21.15.123:0/2853900843 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4ec15bcf0 0x7fc4ec0729d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:08.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.238+0000 7fc4f444c640 1 --2- 172.21.15.123:0/2853900843 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc4d006c2b0 0x7fc4d006e770 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:08.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.238+0000 7fc4f444c640 1 --2- 172.21.15.123:0/2853900843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4ec13eb20 0x7fc4ec072490 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:08.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.238+0000 7fc4f444c640 1 --2- 172.21.15.123:0/2853900843 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4ec0b2d40 0x7fc4ec13d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:08.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.238+0000 7fc4f444c640 1 -- 172.21.15.123:0/2853900843 >> 172.21.15.123:0/2853900843 conn(0x7fc4ec0ccec0 msgr2=0x7fc4ec159be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:08.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.238+0000 7fc4f444c640 1 -- 172.21.15.123:0/2853900843 shutdown_connections 2024-09-15T23:20:08.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.238+0000 7fc4f444c640 1 -- 172.21.15.123:0/2853900843 wait complete. 2024-09-15T23:20:08.250 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-15T23:20:08.250 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:20:08.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.347+0000 7f24dee1e640 1 Processor -- start 2024-09-15T23:20:08.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.347+0000 7f24dee1e640 1 -- start start 2024-09-15T23:20:08.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.348+0000 7f24dee1e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f24d81461a0 0x7f24d815d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:08.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.348+0000 7f24dee1e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24d806c320 0x7f24d806e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:08.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.348+0000 7f24dee1e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24d80728d0 con 0x7f24d80720c0 2024-09-15T23:20:08.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.348+0000 7f24dee1e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f24d815ddc0 con 0x7f24d81461a0 2024-09-15T23:20:08.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.348+0000 7f24dee1e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f24d8146580 con 0x7f24d806c320 2024-09-15T23:20:08.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.348+0000 7f24d7fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f24d80720c0 0x7f24d806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:37998/0 (socket says 172.21.15.123:37998) 2024-09-15T23:20:08.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.348+0000 7f24d7fff640 1 -- 172.21.15.123:0/2094034680 learned_addr learned my addr 172.21.15.123:0/2094034680 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:08.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.348+0000 7f24dcbba640 1 --2- 172.21.15.123:0/2094034680 >> v2:172.21.15.188:3300/0 conn(0x7f24d81461a0 0x7f24d815d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:08.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.348+0000 7f24dd3bb640 1 --2- 172.21.15.123:0/2094034680 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24d806c320 0x7f24d806e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:08.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.348+0000 7f24d77fe640 1 -- 172.21.15.123:0/2094034680 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1946921492 0 0) 0x7f24d80728d0 con 0x7f24d80720c0 2024-09-15T23:20:08.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.348+0000 7f24d77fe640 1 -- 172.21.15.123:0/2094034680 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24c4003520 con 0x7f24d80720c0 2024-09-15T23:20:08.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.349+0000 7f24d77fe640 1 -- 172.21.15.123:0/2094034680 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2234670214 0 0) 0x7f24c4003520 con 0x7f24d80720c0 2024-09-15T23:20:08.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.349+0000 7f24d77fe640 1 -- 172.21.15.123:0/2094034680 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24d806c320 msgr2=0x7f24d806e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:08.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.349+0000 7f24d77fe640 1 --2- 172.21.15.123:0/2094034680 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24d806c320 0x7f24d806e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:08.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.349+0000 7f24d77fe640 1 -- 172.21.15.123:0/2094034680 >> v2:172.21.15.188:3300/0 conn(0x7f24d81461a0 msgr2=0x7f24d815d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:08.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.349+0000 7f24d77fe640 1 --2- 172.21.15.123:0/2094034680 >> v2:172.21.15.188:3300/0 conn(0x7f24d81461a0 0x7f24d815d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:08.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.349+0000 7f24d77fe640 1 -- 172.21.15.123:0/2094034680 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d8072bb0 con 0x7f24d80720c0 2024-09-15T23:20:08.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.349+0000 7f24d77fe640 1 -- 172.21.15.123:0/2094034680 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f24c80019f0 con 0x7f24d80720c0 2024-09-15T23:20:08.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.349+0000 7f24d77fe640 1 -- 172.21.15.123:0/2094034680 >> v1:172.21.15.123:6789/0 conn(0x7f24d80720c0 legacy=0x7f24d806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:08.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.349+0000 7f24d77fe640 1 --2- 172.21.15.123:0/2094034680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24c40039b0 0x7f24c4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:08.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.349+0000 7f24d77fe640 1 --2- 172.21.15.123:0/2094034680 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f24c4004800 0x7f24c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:08.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.349+0000 7f24d77fe640 1 --2- 172.21.15.123:0/2094034680 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24d806c320 0x7f24c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:08.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.349+0000 7f24d77fe640 1 -- 172.21.15.123:0/2094034680 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f24d8146580 con 0x7f24c40039b0 2024-09-15T23:20:08.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.349+0000 7f24d77fe640 1 -- 172.21.15.123:0/2094034680 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f24c400b9c0 con 0x7f24c4004800 2024-09-15T23:20:08.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.349+0000 7f24d77fe640 1 -- 172.21.15.123:0/2094034680 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f24c400bb40 con 0x7f24d806c320 2024-09-15T23:20:08.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.349+0000 7f24dcbba640 1 --2- 172.21.15.123:0/2094034680 >> v2:172.21.15.188:3300/0 conn(0x7f24d81461a0 0x7f24d815d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:20:08.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.349+0000 7f24dcbba640 1 --2- 172.21.15.123:0/2094034680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24c40039b0 0x7f24c4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:08.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.349+0000 7f24d7fff640 1 --2- 172.21.15.123:0/2094034680 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f24c4004800 0x7f24c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:08.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.349+0000 7f24dd3bb640 1 --2- 172.21.15.123:0/2094034680 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24d806c320 0x7f24c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:08.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.349+0000 7f24dcbba640 1 -- 172.21.15.123:0/2094034680 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24d806c320 msgr2=0x7f24c40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:08.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.349+0000 7f24dcbba640 1 --2- 172.21.15.123:0/2094034680 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24d806c320 0x7f24c40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:08.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.349+0000 7f24dcbba640 1 -- 172.21.15.123:0/2094034680 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f24c4004800 msgr2=0x7f24c4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:08.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.349+0000 7f24dcbba640 1 --2- 172.21.15.123:0/2094034680 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f24c4004800 0x7f24c4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:08.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.349+0000 7f24dcbba640 1 -- 172.21.15.123:0/2094034680 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24c4003520 con 0x7f24c40039b0 2024-09-15T23:20:08.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.350+0000 7f24dcbba640 1 --2- 172.21.15.123:0/2094034680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24c40039b0 0x7f24c4003dd0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f24d0009c70 tx=0x7f24c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32f76a2bd6d9ec4c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:08.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.350+0000 7f24d77fe640 1 -- 172.21.15.123:0/2094034680 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d0009840 con 0x7f24c40039b0 2024-09-15T23:20:08.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.350+0000 7f24d77fe640 1 -- 172.21.15.123:0/2094034680 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24d0004020 con 0x7f24c40039b0 2024-09-15T23:20:08.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.350+0000 7f24d77fe640 1 -- 172.21.15.123:0/2094034680 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d00043d0 con 0x7f24c40039b0 2024-09-15T23:20:08.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.350+0000 7f24dee1e640 1 -- 172.21.15.123:0/2094034680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24c40039b0 msgr2=0x7f24c4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:08.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.350+0000 7f24dee1e640 1 --2- 172.21.15.123:0/2094034680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24c40039b0 0x7f24c4003dd0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f24d0009c70 tx=0x7f24c4005830 comp rx=0 tx=0).stop 2024-09-15T23:20:08.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.350+0000 7f24dd3bb640 1 -- 172.21.15.123:0/2094034680 reap_dead start 2024-09-15T23:20:08.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.351+0000 7f24dee1e640 1 -- 172.21.15.123:0/2094034680 shutdown_connections 2024-09-15T23:20:08.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.351+0000 7f24dee1e640 1 -- 172.21.15.123:0/2094034680 >> 172.21.15.123:0/2094034680 conn(0x7f24d806cd20 msgr2=0x7f24d806d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:08.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.351+0000 7f24dee1e640 1 -- 172.21.15.123:0/2094034680 shutdown_connections 2024-09-15T23:20:08.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.351+0000 7f24dee1e640 1 -- 172.21.15.123:0/2094034680 wait complete. 2024-09-15T23:20:08.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.352+0000 7f24dee1e640 1 Processor -- start 2024-09-15T23:20:08.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.352+0000 7f24dee1e640 1 -- start start 2024-09-15T23:20:08.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.353+0000 7f24dee1e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24c40039b0 0x7f24d81440d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:08.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.353+0000 7f24dee1e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f24d81f8000 0x7f24d813ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:08.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.353+0000 7f24dee1e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24d80b5d50 0x7f24d815f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:08.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.353+0000 7f24dee1e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f24d8072530 con 0x7f24c40039b0 2024-09-15T23:20:08.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.353+0000 7f24dee1e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f24d8073170 con 0x7f24d81f8000 2024-09-15T23:20:08.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.353+0000 7f24dee1e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f24d80726b0 con 0x7f24d80b5d50 2024-09-15T23:20:08.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.353+0000 7f24dcbba640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24c40039b0 0x7f24d81440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:08.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.353+0000 7f24dcbba640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24c40039b0 0x7f24d81440d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42868/0 (socket says 172.21.15.123:42868) 2024-09-15T23:20:08.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.353+0000 7f24dcbba640 1 -- 172.21.15.123:0/3297120484 learned_addr learned my addr 172.21.15.123:0/3297120484 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:08.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.353+0000 7f24d7fff640 1 --2- 172.21.15.123:0/3297120484 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f24d81f8000 0x7f24d813ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:08.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.353+0000 7f24dd3bb640 1 --2- 172.21.15.123:0/3297120484 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24d80b5d50 0x7f24d815f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:08.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.353+0000 7f24dcbba640 1 -- 172.21.15.123:0/3297120484 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24d80b5d50 msgr2=0x7f24d815f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:08.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.353+0000 7f24dcbba640 1 --2- 172.21.15.123:0/3297120484 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24d80b5d50 0x7f24d815f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:08.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.353+0000 7f24dcbba640 1 -- 172.21.15.123:0/3297120484 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f24d81f8000 msgr2=0x7f24d813ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:08.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.353+0000 7f24dcbba640 1 --2- 172.21.15.123:0/3297120484 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f24d81f8000 0x7f24d813ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:08.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.353+0000 7f24dcbba640 1 -- 172.21.15.123:0/3297120484 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d81f8480 con 0x7f24c40039b0 2024-09-15T23:20:08.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.353+0000 7f24dcbba640 1 --2- 172.21.15.123:0/3297120484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24c40039b0 0x7f24d81440d0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f24d0033040 tx=0x7f24d0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:08.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.353+0000 7f24d57fa640 1 -- 172.21.15.123:0/3297120484 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d0040070 con 0x7f24c40039b0 2024-09-15T23:20:08.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.353+0000 7f24d57fa640 1 -- 172.21.15.123:0/3297120484 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24d0003820 con 0x7f24c40039b0 2024-09-15T23:20:08.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.353+0000 7f24d57fa640 1 -- 172.21.15.123:0/3297120484 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d0006e10 con 0x7f24c40039b0 2024-09-15T23:20:08.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.353+0000 7f24dee1e640 1 -- 172.21.15.123:0/3297120484 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24d8144760 con 0x7f24c40039b0 2024-09-15T23:20:08.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.353+0000 7f24dee1e640 1 -- 172.21.15.123:0/3297120484 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24d80cfcd0 con 0x7f24c40039b0 2024-09-15T23:20:08.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.354+0000 7f24dee1e640 1 -- 172.21.15.123:0/3297120484 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24d815d840 con 0x7f24c40039b0 2024-09-15T23:20:08.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.355+0000 7f24d57fa640 1 -- 172.21.15.123:0/3297120484 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f24d0043070 con 0x7f24c40039b0 2024-09-15T23:20:08.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.355+0000 7f24d57fa640 1 --2- 172.21.15.123:0/3297120484 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f24b806c2b0 0x7f24b806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:08.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.355+0000 7f24d57fa640 1 -- 172.21.15.123:0/3297120484 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f24d00ab900 con 0x7f24c40039b0 2024-09-15T23:20:08.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.356+0000 7f24d7fff640 1 --2- 172.21.15.123:0/3297120484 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f24b806c2b0 0x7f24b806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:08.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.356+0000 7f24d7fff640 1 --2- 172.21.15.123:0/3297120484 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f24b806c2b0 0x7f24b806e770 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f24d80cd6d0 tx=0x7f24c8006040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:08.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.359+0000 7f24d57fa640 1 -- 172.21.15.123:0/3297120484 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f24d00098e0 con 0x7f24c40039b0 2024-09-15T23:20:08.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.588+0000 7f24dee1e640 1 -- 172.21.15.123:0/3297120484 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f24d815f080 con 0x7f24c40039b0 2024-09-15T23:20:08.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.589+0000 7f24d57fa640 1 -- 172.21.15.123:0/3297120484 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1640 (secure 0 0 0) 0x7f24d0079bd0 con 0x7f24c40039b0 2024-09-15T23:20:08.590 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:08.590 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":499,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":142,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076566731,"bytes_used":2537865216,"bytes_avail":770556248064,"bytes_total":773094113280,"write_bytes_sec":30662172,"read_op_per_sec":0,"write_op_per_sec":30},"fsmap":{"epoch":86,"btime":"2024-09-15T23:19:37:619526+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"d","status":"up:active","gid":8439}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-09-15T23:20:03.615835+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}}}}}},"progress_events":{}} 2024-09-15T23:20:08.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.591+0000 7f24dee1e640 1 -- 172.21.15.123:0/3297120484 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f24b806c2b0 msgr2=0x7f24b806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:08.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.591+0000 7f24dee1e640 1 --2- 172.21.15.123:0/3297120484 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f24b806c2b0 0x7f24b806e770 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f24d80cd6d0 tx=0x7f24c8006040 comp rx=0 tx=0).stop 2024-09-15T23:20:08.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.591+0000 7f24dee1e640 1 -- 172.21.15.123:0/3297120484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24c40039b0 msgr2=0x7f24d81440d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:08.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.591+0000 7f24dee1e640 1 --2- 172.21.15.123:0/3297120484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24c40039b0 0x7f24d81440d0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f24d0033040 tx=0x7f24d0004730 comp rx=0 tx=0).stop 2024-09-15T23:20:08.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.591+0000 7f24dee1e640 1 -- 172.21.15.123:0/3297120484 shutdown_connections 2024-09-15T23:20:08.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.591+0000 7f24dee1e640 1 --2- 172.21.15.123:0/3297120484 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24d80b5d50 0x7f24d815f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:08.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.591+0000 7f24dee1e640 1 --2- 172.21.15.123:0/3297120484 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f24d81f8000 0x7f24d813ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:08.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.591+0000 7f24dee1e640 1 --2- 172.21.15.123:0/3297120484 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f24b806c2b0 0x7f24b806e770 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:08.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.591+0000 7f24dee1e640 1 --2- 172.21.15.123:0/3297120484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24c40039b0 0x7f24d81440d0 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:08.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.591+0000 7f24dee1e640 1 -- 172.21.15.123:0/3297120484 >> 172.21.15.123:0/3297120484 conn(0x7f24d806cd20 msgr2=0x7f24d815b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:08.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.591+0000 7f24dee1e640 1 -- 172.21.15.123:0/3297120484 shutdown_connections 2024-09-15T23:20:08.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:08.591+0000 7f24dee1e640 1 -- 172.21.15.123:0/3297120484 wait complete. 2024-09-15T23:20:08.603 INFO:tasks.ceph.ceph_manager.ceph:{'d': 'paused'} 2024-09-15T23:20:09.604 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:20:09.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.712+0000 7f3d98ef1640 1 Processor -- start 2024-09-15T23:20:09.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.712+0000 7f3d98ef1640 1 -- start start 2024-09-15T23:20:09.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.713+0000 7f3d98ef1640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3d940b2d40 0x7f3d9406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:09.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.713+0000 7f3d98ef1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3d9406c150 0x7f3d9415c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:09.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.713+0000 7f3d98ef1640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d94071180 con 0x7f3d9413eb20 2024-09-15T23:20:09.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.713+0000 7f3d98ef1640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f3d94071ab0 con 0x7f3d940b2d40 2024-09-15T23:20:09.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.713+0000 7f3d98ef1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f3d94071460 con 0x7f3d9406c150 2024-09-15T23:20:09.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.713+0000 7f3d9259c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3d940b2d40 0x7f3d9406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:09.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.713+0000 7f3d9259c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3d940b2d40 0x7f3d9406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42870/0 (socket says 172.21.15.123:42870) 2024-09-15T23:20:09.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.713+0000 7f3d9259c640 1 -- 172.21.15.123:0/1369615671 learned_addr learned my addr 172.21.15.123:0/1369615671 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:09.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.713+0000 7f3d92d9d640 1 --2- 172.21.15.123:0/1369615671 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3d9406c150 0x7f3d9415c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:09.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.713+0000 7f3d9259c640 1 -- 172.21.15.123:0/1369615671 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3d9406c150 msgr2=0x7f3d9415c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:09.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.713+0000 7f3d9259c640 1 --2- 172.21.15.123:0/1369615671 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3d9406c150 0x7f3d9415c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:09.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.713+0000 7f3d9259c640 1 -- 172.21.15.123:0/1369615671 >> v1:172.21.15.188:6789/0 conn(0x7f3d9413eb20 legacy=0x7f3d9415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:09.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.713+0000 7f3d9259c640 1 -- 172.21.15.123:0/1369615671 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d94071740 con 0x7f3d940b2d40 2024-09-15T23:20:09.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.713+0000 7f3d92d9d640 1 --2- 172.21.15.123:0/1369615671 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3d9406c150 0x7f3d9415c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:20:09.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.714+0000 7f3d9259c640 1 --2- 172.21.15.123:0/1369615671 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d940b2d40 0x7f3d9406bc10 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f3d84009870 tx=0x7f3d8402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f07eef5279a953 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:09.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.714+0000 7f3d9159a640 1 -- 172.21.15.123:0/1369615671 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d84037070 con 0x7f3d940b2d40 2024-09-15T23:20:09.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.714+0000 7f3d9159a640 1 -- 172.21.15.123:0/1369615671 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d84032440 con 0x7f3d940b2d40 2024-09-15T23:20:09.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.714+0000 7f3d9159a640 1 -- 172.21.15.123:0/1369615671 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d84032810 con 0x7f3d940b2d40 2024-09-15T23:20:09.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.715+0000 7f3d98ef1640 1 -- 172.21.15.123:0/1369615671 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d940b2d40 msgr2=0x7f3d9406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:09.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.715+0000 7f3d98ef1640 1 --2- 172.21.15.123:0/1369615671 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d940b2d40 0x7f3d9406bc10 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f3d84009870 tx=0x7f3d8402a210 comp rx=0 tx=0).stop 2024-09-15T23:20:09.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.715+0000 7f3d98ef1640 1 -- 172.21.15.123:0/1369615671 shutdown_connections 2024-09-15T23:20:09.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.715+0000 7f3d98ef1640 1 --2- 172.21.15.123:0/1369615671 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3d9406c150 0x7f3d9415c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:09.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.715+0000 7f3d98ef1640 1 --2- 172.21.15.123:0/1369615671 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d940b2d40 0x7f3d9406bc10 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:09.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.715+0000 7f3d98ef1640 1 -- 172.21.15.123:0/1369615671 >> 172.21.15.123:0/1369615671 conn(0x7f3d940ccec0 msgr2=0x7f3d940cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:09.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.715+0000 7f3d98ef1640 1 -- 172.21.15.123:0/1369615671 shutdown_connections 2024-09-15T23:20:09.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.715+0000 7f3d98ef1640 1 -- 172.21.15.123:0/1369615671 wait complete. 2024-09-15T23:20:09.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.716+0000 7f3d98ef1640 1 Processor -- start 2024-09-15T23:20:09.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.716+0000 7f3d98ef1640 1 -- start start 2024-09-15T23:20:09.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.717+0000 7f3d98ef1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3d9406c150 0x7f3d9415f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:09.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.717+0000 7f3d98ef1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d940b2d40 0x7f3d941f5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:09.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.717+0000 7f3d98ef1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3d9413eb20 0x7f3d940b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:09.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.717+0000 7f3d98ef1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3d940722d0 con 0x7f3d940b2d40 2024-09-15T23:20:09.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.717+0000 7f3d98ef1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3d94072150 con 0x7f3d9413eb20 2024-09-15T23:20:09.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.717+0000 7f3d98ef1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f3d94072450 con 0x7f3d9406c150 2024-09-15T23:20:09.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.717+0000 7f3d91d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d940b2d40 0x7f3d941f5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:09.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.717+0000 7f3d91d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d940b2d40 0x7f3d941f5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42882/0 (socket says 172.21.15.123:42882) 2024-09-15T23:20:09.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.717+0000 7f3d91d9b640 1 -- 172.21.15.123:0/3942113608 learned_addr learned my addr 172.21.15.123:0/3942113608 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:09.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.717+0000 7f3d92d9d640 1 --2- 172.21.15.123:0/3942113608 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3d9413eb20 0x7f3d940b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:09.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.718+0000 7f3d9259c640 1 --2- 172.21.15.123:0/3942113608 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3d9406c150 0x7f3d9415f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:09.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.718+0000 7f3d91d9b640 1 -- 172.21.15.123:0/3942113608 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3d9406c150 msgr2=0x7f3d9415f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:09.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.718+0000 7f3d91d9b640 1 --2- 172.21.15.123:0/3942113608 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3d9406c150 0x7f3d9415f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:09.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.718+0000 7f3d91d9b640 1 -- 172.21.15.123:0/3942113608 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3d9413eb20 msgr2=0x7f3d940b3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:09.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.718+0000 7f3d91d9b640 1 --2- 172.21.15.123:0/3942113608 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3d9413eb20 0x7f3d940b3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:09.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.718+0000 7f3d91d9b640 1 -- 172.21.15.123:0/3942113608 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d940c7140 con 0x7f3d940b2d40 2024-09-15T23:20:09.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.718+0000 7f3d91d9b640 1 --2- 172.21.15.123:0/3942113608 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d940b2d40 0x7f3d941f5c10 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f3d8800b3c0 tx=0x7f3d8800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:09.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.718+0000 7f3d82ffd640 1 -- 172.21.15.123:0/3942113608 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d88011830 con 0x7f3d940b2d40 2024-09-15T23:20:09.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.718+0000 7f3d82ffd640 1 -- 172.21.15.123:0/3942113608 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d88016070 con 0x7f3d940b2d40 2024-09-15T23:20:09.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.718+0000 7f3d98ef1640 1 -- 172.21.15.123:0/3942113608 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d940c7420 con 0x7f3d940b2d40 2024-09-15T23:20:09.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.718+0000 7f3d82ffd640 1 -- 172.21.15.123:0/3942113608 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d88011c50 con 0x7f3d940b2d40 2024-09-15T23:20:09.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.718+0000 7f3d98ef1640 1 -- 172.21.15.123:0/3942113608 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d940c79e0 con 0x7f3d940b2d40 2024-09-15T23:20:09.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.719+0000 7f3d98ef1640 1 -- 172.21.15.123:0/3942113608 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d94140280 con 0x7f3d940b2d40 2024-09-15T23:20:09.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.719+0000 7f3d82ffd640 1 -- 172.21.15.123:0/3942113608 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3d8801b460 con 0x7f3d940b2d40 2024-09-15T23:20:09.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.720+0000 7f3d82ffd640 1 --2- 172.21.15.123:0/3942113608 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3d7406c2b0 0x7f3d7406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:09.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.720+0000 7f3d82ffd640 1 -- 172.21.15.123:0/3942113608 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f3d8808ae30 con 0x7f3d940b2d40 2024-09-15T23:20:09.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.720+0000 7f3d9259c640 1 --2- 172.21.15.123:0/3942113608 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3d7406c2b0 0x7f3d7406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:09.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.721+0000 7f3d9259c640 1 --2- 172.21.15.123:0/3942113608 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3d7406c2b0 0x7f3d7406e770 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3d84034000 tx=0x7f3d8402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:09.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.725+0000 7f3d82ffd640 1 -- 172.21.15.123:0/3942113608 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3d94140280 con 0x7f3d940b2d40 2024-09-15T23:20:09.887 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:20:09.890 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:20:09.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.924+0000 7f3d98ef1640 1 -- 172.21.15.123:0/3942113608 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d9406bc10 con 0x7f3d940b2d40 2024-09-15T23:20:09.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.925+0000 7f3d82ffd640 1 -- 172.21.15.123:0/3942113608 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5237 (secure 0 0 0) 0x7f3d88020020 con 0x7f3d940b2d40 2024-09-15T23:20:09.926 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:09.926 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":86,"btime":"2024-09-15T23:19:37:619526+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2082746470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2082746470},{"type":"v1","addr":"172.21.15.123:6834","nonce":2082746470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8421,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2007610603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":2007610603},{"type":"v1","addr":"172.21.15.123:6835","nonce":2007610603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8436,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2929123975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2929123975},{"type":"v1","addr":"172.21.15.188:6836","nonce":2929123975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:19:34.917419+0000","modified":"2024-09-15T23:19:36.941347+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8439":{"gid":8439,"name":"d","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6837/1222656979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1222656979},{"type":"v1","addr":"172.21.15.188:6837","nonce":1222656979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8439,"qdb_cluster":[8439]},"id":9}]} 2024-09-15T23:20:09.926 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 86 2024-09-15T23:20:09.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.927+0000 7f3d98ef1640 1 -- 172.21.15.123:0/3942113608 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3d7406c2b0 msgr2=0x7f3d7406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:09.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.927+0000 7f3d98ef1640 1 --2- 172.21.15.123:0/3942113608 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3d7406c2b0 0x7f3d7406e770 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3d84034000 tx=0x7f3d8402e000 comp rx=0 tx=0).stop 2024-09-15T23:20:09.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.927+0000 7f3d98ef1640 1 -- 172.21.15.123:0/3942113608 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d940b2d40 msgr2=0x7f3d941f5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:09.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.927+0000 7f3d98ef1640 1 --2- 172.21.15.123:0/3942113608 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d940b2d40 0x7f3d941f5c10 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f3d8800b3c0 tx=0x7f3d8800b880 comp rx=0 tx=0).stop 2024-09-15T23:20:09.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.927+0000 7f3d98ef1640 1 -- 172.21.15.123:0/3942113608 shutdown_connections 2024-09-15T23:20:09.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.927+0000 7f3d98ef1640 1 --2- 172.21.15.123:0/3942113608 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3d9413eb20 0x7f3d940b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:09.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.927+0000 7f3d98ef1640 1 --2- 172.21.15.123:0/3942113608 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3d7406c2b0 0x7f3d7406e770 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:09.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.927+0000 7f3d98ef1640 1 --2- 172.21.15.123:0/3942113608 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d940b2d40 0x7f3d941f5c10 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:09.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.927+0000 7f3d98ef1640 1 --2- 172.21.15.123:0/3942113608 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3d9406c150 0x7f3d9415f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:09.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.927+0000 7f3d98ef1640 1 -- 172.21.15.123:0/3942113608 >> 172.21.15.123:0/3942113608 conn(0x7f3d940ccec0 msgr2=0x7f3d94157d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:09.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.927+0000 7f3d98ef1640 1 -- 172.21.15.123:0/3942113608 shutdown_connections 2024-09-15T23:20:09.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:09.927+0000 7f3d98ef1640 1 -- 172.21.15.123:0/3942113608 wait complete. 2024-09-15T23:20:09.939 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-15T23:20:09.939 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:20:10.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.077+0000 7f824083c640 1 Processor -- start 2024-09-15T23:20:10.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.077+0000 7f824083c640 1 -- start start 2024-09-15T23:20:10.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.078+0000 7f824083c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f823c0d0670 0x7f823c0d1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:10.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.078+0000 7f824083c640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f823c073400 con 0x7f823c0d0200 2024-09-15T23:20:10.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.078+0000 7f824083c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f823c0736e0 con 0x7f823c15c4f0 2024-09-15T23:20:10.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.078+0000 7f824083c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f823c0739c0 con 0x7f823c0d0670 2024-09-15T23:20:10.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.078+0000 7f8239d9b640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f823c0d0200 0x7f823c0d1620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38010/0 (socket says 172.21.15.123:38010) 2024-09-15T23:20:10.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.078+0000 7f8239d9b640 1 -- 172.21.15.123:0/175213587 learned_addr learned my addr 172.21.15.123:0/175213587 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:10.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.078+0000 7f823ad9d640 1 --2- 172.21.15.123:0/175213587 >> v2:172.21.15.188:3300/0 conn(0x7f823c0d0670 0x7f823c0d1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:10.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.078+0000 7f823959a640 1 -- 172.21.15.123:0/175213587 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2034740132 0 0) 0x7f823c073400 con 0x7f823c0d0200 2024-09-15T23:20:10.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.078+0000 7f823959a640 1 -- 172.21.15.123:0/175213587 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8224003520 con 0x7f823c0d0200 2024-09-15T23:20:10.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.078+0000 7f823959a640 1 -- 172.21.15.123:0/175213587 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3928335639 0 0) 0x7f8224003520 con 0x7f823c0d0200 2024-09-15T23:20:10.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.078+0000 7f823959a640 1 -- 172.21.15.123:0/175213587 >> v2:172.21.15.188:3300/0 conn(0x7f823c0d0670 msgr2=0x7f823c0d1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:10.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.078+0000 7f823959a640 1 --2- 172.21.15.123:0/175213587 >> v2:172.21.15.188:3300/0 conn(0x7f823c0d0670 0x7f823c0d1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:10.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.078+0000 7f823959a640 1 -- 172.21.15.123:0/175213587 >> v1:172.21.15.188:6789/0 conn(0x7f823c15c4f0 legacy=0x7f823c15d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:10.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.078+0000 7f823959a640 1 -- 172.21.15.123:0/175213587 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f823c073ca0 con 0x7f823c0d0200 2024-09-15T23:20:10.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.078+0000 7f823959a640 1 -- 172.21.15.123:0/175213587 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f8230001670 con 0x7f823c0d0200 2024-09-15T23:20:10.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.078+0000 7f823959a640 1 -- 172.21.15.123:0/175213587 >> v1:172.21.15.123:6789/0 conn(0x7f823c0d0200 legacy=0x7f823c0d1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:10.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.078+0000 7f823959a640 1 --2- 172.21.15.123:0/175213587 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82240039b0 0x7f8224003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:10.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.078+0000 7f823959a640 1 --2- 172.21.15.123:0/175213587 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8224004800 0x7f8224004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:10.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.078+0000 7f823959a640 1 --2- 172.21.15.123:0/175213587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82240051c0 0x7f822400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:10.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.078+0000 7f823959a640 1 -- 172.21.15.123:0/175213587 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f823c0739c0 con 0x7f82240051c0 2024-09-15T23:20:10.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.078+0000 7f823959a640 1 -- 172.21.15.123:0/175213587 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f822400c060 con 0x7f82240039b0 2024-09-15T23:20:10.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.078+0000 7f823959a640 1 -- 172.21.15.123:0/175213587 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f822400c260 con 0x7f8224004800 2024-09-15T23:20:10.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.078+0000 7f823ad9d640 1 --2- 172.21.15.123:0/175213587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82240051c0 0x7f822400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:10.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.079+0000 7f823a59c640 1 --2- 172.21.15.123:0/175213587 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82240039b0 0x7f8224003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:10.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.079+0000 7f8239d9b640 1 --2- 172.21.15.123:0/175213587 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8224004800 0x7f8224004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:10.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.079+0000 7f823ad9d640 1 -- 172.21.15.123:0/175213587 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8224004800 msgr2=0x7f8224004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:10.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.079+0000 7f823ad9d640 1 --2- 172.21.15.123:0/175213587 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8224004800 0x7f8224004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:10.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.079+0000 7f823ad9d640 1 -- 172.21.15.123:0/175213587 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82240039b0 msgr2=0x7f8224003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:10.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.079+0000 7f823ad9d640 1 --2- 172.21.15.123:0/175213587 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82240039b0 0x7f8224003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:10.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.079+0000 7f823ad9d640 1 -- 172.21.15.123:0/175213587 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8224003520 con 0x7f82240051c0 2024-09-15T23:20:10.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.079+0000 7f823ad9d640 1 -- 172.21.15.123:0/175213587 reap_dead start 2024-09-15T23:20:10.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.079+0000 7f823ad9d640 1 --2- 172.21.15.123:0/175213587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82240051c0 0x7f822400b9c0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f8234009fc0 tx=0x7f8224005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85bef915e2ac5572 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:10.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.080+0000 7f823959a640 1 -- 172.21.15.123:0/175213587 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8234035020 con 0x7f82240051c0 2024-09-15T23:20:10.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.080+0000 7f823959a640 1 -- 172.21.15.123:0/175213587 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8234003bd0 con 0x7f82240051c0 2024-09-15T23:20:10.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.080+0000 7f823959a640 1 -- 172.21.15.123:0/175213587 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8234009c10 con 0x7f82240051c0 2024-09-15T23:20:10.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.080+0000 7f824083c640 1 -- 172.21.15.123:0/175213587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82240051c0 msgr2=0x7f822400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:10.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.080+0000 7f824083c640 1 --2- 172.21.15.123:0/175213587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82240051c0 0x7f822400b9c0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f8234009fc0 tx=0x7f8224005830 comp rx=0 tx=0).stop 2024-09-15T23:20:10.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.080+0000 7f824083c640 1 -- 172.21.15.123:0/175213587 shutdown_connections 2024-09-15T23:20:10.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.080+0000 7f824083c640 1 --2- 172.21.15.123:0/175213587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82240051c0 0x7f822400b9c0 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:10.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.080+0000 7f824083c640 1 -- 172.21.15.123:0/175213587 >> 172.21.15.123:0/175213587 conn(0x7f823c06f400 msgr2=0x7f823c06f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:10.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.080+0000 7f824083c640 1 -- 172.21.15.123:0/175213587 shutdown_connections 2024-09-15T23:20:10.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.080+0000 7f824083c640 1 -- 172.21.15.123:0/175213587 wait complete. 2024-09-15T23:20:10.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.082+0000 7f824083c640 1 Processor -- start 2024-09-15T23:20:10.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.082+0000 7f824083c640 1 -- start start 2024-09-15T23:20:10.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.082+0000 7f824083c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82240051c0 0x7f823c0cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:10.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.082+0000 7f824083c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f823c06e620 0x7f823c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:10.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.082+0000 7f824083c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f823c0b06e0 0x7f823c15e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:10.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.082+0000 7f824083c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f823c0d0ac0 con 0x7f823c0b06e0 2024-09-15T23:20:10.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.082+0000 7f824083c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f823c0d0fa0 con 0x7f82240051c0 2024-09-15T23:20:10.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.082+0000 7f824083c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f823c15c8d0 con 0x7f823c06e620 2024-09-15T23:20:10.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.082+0000 7f823ad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f823c0b06e0 0x7f823c15e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:10.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.082+0000 7f823ad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f823c0b06e0 0x7f823c15e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42904/0 (socket says 172.21.15.123:42904) 2024-09-15T23:20:10.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.082+0000 7f823ad9d640 1 -- 172.21.15.123:0/648602918 learned_addr learned my addr 172.21.15.123:0/648602918 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:10.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.083+0000 7f8239d9b640 1 --2- 172.21.15.123:0/648602918 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f823c06e620 0x7f823c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:10.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.083+0000 7f823a59c640 1 --2- 172.21.15.123:0/648602918 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82240051c0 0x7f823c0cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:10.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.083+0000 7f823ad9d640 1 -- 172.21.15.123:0/648602918 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f823c06e620 msgr2=0x7f823c06d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:10.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.083+0000 7f823ad9d640 1 --2- 172.21.15.123:0/648602918 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f823c06e620 0x7f823c06d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:10.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.083+0000 7f823ad9d640 1 -- 172.21.15.123:0/648602918 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82240051c0 msgr2=0x7f823c0cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:10.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.083+0000 7f823ad9d640 1 --2- 172.21.15.123:0/648602918 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82240051c0 0x7f823c0cbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:10.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.083+0000 7f823ad9d640 1 -- 172.21.15.123:0/648602918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f823c06cea0 con 0x7f823c0b06e0 2024-09-15T23:20:10.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.083+0000 7f823a59c640 1 --2- 172.21.15.123:0/648602918 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82240051c0 0x7f823c0cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:20:10.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.083+0000 7f823ad9d640 1 --2- 172.21.15.123:0/648602918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f823c0b06e0 0x7f823c15e2d0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f823402af10 tx=0x7f8234009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:10.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.083+0000 7f822affd640 1 -- 172.21.15.123:0/648602918 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8234035030 con 0x7f823c0b06e0 2024-09-15T23:20:10.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.083+0000 7f822affd640 1 -- 172.21.15.123:0/648602918 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8234043070 con 0x7f823c0b06e0 2024-09-15T23:20:10.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.083+0000 7f824083c640 1 -- 172.21.15.123:0/648602918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f823c0cc150 con 0x7f823c0b06e0 2024-09-15T23:20:10.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.083+0000 7f822affd640 1 -- 172.21.15.123:0/648602918 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823402d070 con 0x7f823c0b06e0 2024-09-15T23:20:10.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.083+0000 7f824083c640 1 -- 172.21.15.123:0/648602918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f823c06dbc0 con 0x7f823c0b06e0 2024-09-15T23:20:10.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.084+0000 7f824083c640 1 -- 172.21.15.123:0/648602918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f823c073080 con 0x7f823c0b06e0 2024-09-15T23:20:10.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.084+0000 7f822affd640 1 -- 172.21.15.123:0/648602918 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8234005d10 con 0x7f823c0b06e0 2024-09-15T23:20:10.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.085+0000 7f822affd640 1 --2- 172.21.15.123:0/648602918 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f821c06c2b0 0x7f821c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:10.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.085+0000 7f822affd640 1 -- 172.21.15.123:0/648602918 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f82340abd80 con 0x7f823c0b06e0 2024-09-15T23:20:10.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.085+0000 7f823a59c640 1 --2- 172.21.15.123:0/648602918 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f821c06c2b0 0x7f821c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:10.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.086+0000 7f823a59c640 1 --2- 172.21.15.123:0/648602918 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f821c06c2b0 0x7f821c06e770 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f822c005580 tx=0x7f822c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:10.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.089+0000 7f822affd640 1 -- 172.21.15.123:0/648602918 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f823404c020 con 0x7f823c0b06e0 2024-09-15T23:20:10.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.316+0000 7f824083c640 1 -- 172.21.15.123:0/648602918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f823c0aff10 con 0x7f823c0b06e0 2024-09-15T23:20:10.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.317+0000 7f822affd640 1 -- 172.21.15.123:0/648602918 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1640 (secure 0 0 0) 0x7f823407a580 con 0x7f823c0b06e0 2024-09-15T23:20:10.318 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:10.318 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":500,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":142,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076566731,"bytes_used":2537865216,"bytes_avail":770556248064,"bytes_total":773094113280,"write_bytes_sec":30662172,"read_op_per_sec":0,"write_op_per_sec":30},"fsmap":{"epoch":86,"btime":"2024-09-15T23:19:37:619526+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"d","status":"up:active","gid":8439}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-09-15T23:20:03.615835+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}}}}}},"progress_events":{}} 2024-09-15T23:20:10.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.319+0000 7f824083c640 1 -- 172.21.15.123:0/648602918 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f821c06c2b0 msgr2=0x7f821c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:10.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.319+0000 7f824083c640 1 --2- 172.21.15.123:0/648602918 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f821c06c2b0 0x7f821c06e770 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f822c005580 tx=0x7f822c009040 comp rx=0 tx=0).stop 2024-09-15T23:20:10.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.319+0000 7f824083c640 1 -- 172.21.15.123:0/648602918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f823c0b06e0 msgr2=0x7f823c15e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:10.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.319+0000 7f824083c640 1 --2- 172.21.15.123:0/648602918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f823c0b06e0 0x7f823c15e2d0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f823402af10 tx=0x7f8234009750 comp rx=0 tx=0).stop 2024-09-15T23:20:10.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.319+0000 7f824083c640 1 -- 172.21.15.123:0/648602918 shutdown_connections 2024-09-15T23:20:10.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.319+0000 7f824083c640 1 --2- 172.21.15.123:0/648602918 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f821c06c2b0 0x7f821c06e770 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:10.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.319+0000 7f824083c640 1 --2- 172.21.15.123:0/648602918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f823c0b06e0 0x7f823c15e2d0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:10.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.319+0000 7f824083c640 1 --2- 172.21.15.123:0/648602918 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f823c06e620 0x7f823c06d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:10.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.319+0000 7f824083c640 1 --2- 172.21.15.123:0/648602918 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82240051c0 0x7f823c0cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:10.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.319+0000 7f824083c640 1 -- 172.21.15.123:0/648602918 >> 172.21.15.123:0/648602918 conn(0x7f823c06f400 msgr2=0x7f823c0b6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:10.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.319+0000 7f824083c640 1 -- 172.21.15.123:0/648602918 shutdown_connections 2024-09-15T23:20:10.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:10.319+0000 7f824083c640 1 -- 172.21.15.123:0/648602918 wait complete. 2024-09-15T23:20:10.331 INFO:tasks.ceph.ceph_manager.ceph:{'d': 'paused'} 2024-09-15T23:20:11.332 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:20:11.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.431+0000 7f9170c94640 1 Processor -- start 2024-09-15T23:20:11.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.431+0000 7f9170c94640 1 -- start start 2024-09-15T23:20:11.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.432+0000 7f9170c94640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f916c0b2d40 0x7f916c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:11.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.432+0000 7f9170c94640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f916c13eb20 0x7f916c06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:11.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.432+0000 7f9170c94640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f916c15bcf0 0x7f916c15c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:11.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.432+0000 7f9170c94640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f916c071ab0 con 0x7f916c15bcf0 2024-09-15T23:20:11.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.432+0000 7f9170c94640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f916c071180 con 0x7f916c13eb20 2024-09-15T23:20:11.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.432+0000 7f9170c94640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f916c071460 con 0x7f916c0b2d40 2024-09-15T23:20:11.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.432+0000 7f916ad9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f916c15bcf0 0x7f916c15c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:11.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.432+0000 7f916ad9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f916c15bcf0 0x7f916c15c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42906/0 (socket says 172.21.15.123:42906) 2024-09-15T23:20:11.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.432+0000 7f916ad9d640 1 -- 172.21.15.123:0/1721084818 learned_addr learned my addr 172.21.15.123:0/1721084818 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:11.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.432+0000 7f9169d9b640 1 --2- 172.21.15.123:0/1721084818 >> v2:172.21.15.188:3300/0 conn(0x7f916c13eb20 0x7f916c06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:11.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.432+0000 7f916a59c640 1 --2- 172.21.15.123:0/1721084818 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f916c0b2d40 0x7f916c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:11.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.433+0000 7f916ad9d640 1 -- 172.21.15.123:0/1721084818 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f916c0b2d40 msgr2=0x7f916c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:11.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.433+0000 7f916ad9d640 1 --2- 172.21.15.123:0/1721084818 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f916c0b2d40 0x7f916c06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:11.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.433+0000 7f916ad9d640 1 -- 172.21.15.123:0/1721084818 >> v2:172.21.15.188:3300/0 conn(0x7f916c13eb20 msgr2=0x7f916c06c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:11.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.433+0000 7f916ad9d640 1 --2- 172.21.15.123:0/1721084818 >> v2:172.21.15.188:3300/0 conn(0x7f916c13eb20 0x7f916c06c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:11.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.433+0000 7f916ad9d640 1 -- 172.21.15.123:0/1721084818 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f916c071740 con 0x7f916c15bcf0 2024-09-15T23:20:11.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.433+0000 7f916ad9d640 1 --2- 172.21.15.123:0/1721084818 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f916c15bcf0 0x7f916c15c1a0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f916c073460 tx=0x7f916402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e1f26dea60cf64 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:11.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.433+0000 7f916959a640 1 -- 172.21.15.123:0/1721084818 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9164036070 con 0x7f916c15bcf0 2024-09-15T23:20:11.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.433+0000 7f916959a640 1 -- 172.21.15.123:0/1721084818 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9164031600 con 0x7f916c15bcf0 2024-09-15T23:20:11.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.433+0000 7f916959a640 1 -- 172.21.15.123:0/1721084818 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91640319d0 con 0x7f916c15bcf0 2024-09-15T23:20:11.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.434+0000 7f9170c94640 1 -- 172.21.15.123:0/1721084818 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f916c15bcf0 msgr2=0x7f916c15c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:11.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.434+0000 7f9170c94640 1 --2- 172.21.15.123:0/1721084818 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f916c15bcf0 0x7f916c15c1a0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f916c073460 tx=0x7f916402a6a0 comp rx=0 tx=0).stop 2024-09-15T23:20:11.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.434+0000 7f9170c94640 1 -- 172.21.15.123:0/1721084818 shutdown_connections 2024-09-15T23:20:11.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.434+0000 7f9170c94640 1 --2- 172.21.15.123:0/1721084818 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f916c15bcf0 0x7f916c15c1a0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:11.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.434+0000 7f9170c94640 1 --2- 172.21.15.123:0/1721084818 >> v2:172.21.15.188:3300/0 conn(0x7f916c13eb20 0x7f916c06c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:11.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.434+0000 7f9170c94640 1 --2- 172.21.15.123:0/1721084818 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f916c0b2d40 0x7f916c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:11.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.434+0000 7f9170c94640 1 -- 172.21.15.123:0/1721084818 >> 172.21.15.123:0/1721084818 conn(0x7f916c0ccec0 msgr2=0x7f916c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:11.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.434+0000 7f9170c94640 1 -- 172.21.15.123:0/1721084818 shutdown_connections 2024-09-15T23:20:11.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.434+0000 7f9170c94640 1 -- 172.21.15.123:0/1721084818 wait complete. 2024-09-15T23:20:11.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.435+0000 7f9170c94640 1 Processor -- start 2024-09-15T23:20:11.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.436+0000 7f9170c94640 1 -- start start 2024-09-15T23:20:11.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.436+0000 7f9170c94640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f916c0b2d40 0x7f916c156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:11.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.436+0000 7f9170c94640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f916c13eb20 0x7f916c0b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:11.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.436+0000 7f9170c94640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f916c15bcf0 0x7f916c0b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:11.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.436+0000 7f9170c94640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f916c15f140 con 0x7f916c0b2d40 2024-09-15T23:20:11.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.436+0000 7f9170c94640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f916c15efc0 con 0x7f916c13eb20 2024-09-15T23:20:11.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.436+0000 7f9170c94640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f916c15f2c0 con 0x7f916c15bcf0 2024-09-15T23:20:11.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.436+0000 7f916a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f916c0b2d40 0x7f916c156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:11.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.436+0000 7f916a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f916c0b2d40 0x7f916c156d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42910/0 (socket says 172.21.15.123:42910) 2024-09-15T23:20:11.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.436+0000 7f916a59c640 1 -- 172.21.15.123:0/2380518683 learned_addr learned my addr 172.21.15.123:0/2380518683 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:11.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.436+0000 7f9169d9b640 1 --2- 172.21.15.123:0/2380518683 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f916c13eb20 0x7f916c0b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:11.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.436+0000 7f916ad9d640 1 --2- 172.21.15.123:0/2380518683 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f916c15bcf0 0x7f916c0b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:11.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.437+0000 7f916a59c640 1 -- 172.21.15.123:0/2380518683 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f916c15bcf0 msgr2=0x7f916c0b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:11.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.437+0000 7f916a59c640 1 --2- 172.21.15.123:0/2380518683 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f916c15bcf0 0x7f916c0b3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:11.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.437+0000 7f916a59c640 1 -- 172.21.15.123:0/2380518683 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f916c13eb20 msgr2=0x7f916c0b3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:11.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.437+0000 7f916a59c640 1 --2- 172.21.15.123:0/2380518683 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f916c13eb20 0x7f916c0b3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:11.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.437+0000 7f916a59c640 1 -- 172.21.15.123:0/2380518683 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f916c157a70 con 0x7f916c0b2d40 2024-09-15T23:20:11.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.437+0000 7f916a59c640 1 --2- 172.21.15.123:0/2380518683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f916c0b2d40 0x7f916c156d90 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f915c00d800 tx=0x7f915c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:11.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.437+0000 7f9162ffd640 1 -- 172.21.15.123:0/2380518683 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915c018020 con 0x7f916c0b2d40 2024-09-15T23:20:11.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.437+0000 7f9162ffd640 1 -- 172.21.15.123:0/2380518683 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f915c0096a0 con 0x7f916c0b2d40 2024-09-15T23:20:11.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.437+0000 7f9170c94640 1 -- 172.21.15.123:0/2380518683 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f916c157d50 con 0x7f916c0b2d40 2024-09-15T23:20:11.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.437+0000 7f9162ffd640 1 -- 172.21.15.123:0/2380518683 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915c009a70 con 0x7f916c0b2d40 2024-09-15T23:20:11.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.437+0000 7f9170c94640 1 -- 172.21.15.123:0/2380518683 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f916c158310 con 0x7f916c0b2d40 2024-09-15T23:20:11.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.438+0000 7f9170c94640 1 -- 172.21.15.123:0/2380518683 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f916c15c1a0 con 0x7f916c0b2d40 2024-09-15T23:20:11.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.439+0000 7f9162ffd640 1 -- 172.21.15.123:0/2380518683 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f915c01b020 con 0x7f916c0b2d40 2024-09-15T23:20:11.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.439+0000 7f9162ffd640 1 --2- 172.21.15.123:0/2380518683 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f914c06c2b0 0x7f914c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:11.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.439+0000 7f9162ffd640 1 -- 172.21.15.123:0/2380518683 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f915c08b510 con 0x7f916c0b2d40 2024-09-15T23:20:11.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.439+0000 7f9169d9b640 1 --2- 172.21.15.123:0/2380518683 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f914c06c2b0 0x7f914c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:11.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.440+0000 7f9169d9b640 1 --2- 172.21.15.123:0/2380518683 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f914c06c2b0 0x7f914c06e770 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f916c073210 tx=0x7f9154008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:11.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.443+0000 7f9162ffd640 1 -- 172.21.15.123:0/2380518683 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f915c022030 con 0x7f916c0b2d40 2024-09-15T23:20:11.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.647+0000 7f9170c94640 1 -- 172.21.15.123:0/2380518683 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f916c1407d0 con 0x7f916c0b2d40 2024-09-15T23:20:11.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.648+0000 7f9162ffd640 1 -- 172.21.15.123:0/2380518683 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5237 (secure 0 0 0) 0x7f915c059630 con 0x7f916c0b2d40 2024-09-15T23:20:11.650 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:11.650 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":86,"btime":"2024-09-15T23:19:37:619526+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2082746470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2082746470},{"type":"v1","addr":"172.21.15.123:6834","nonce":2082746470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8421,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2007610603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":2007610603},{"type":"v1","addr":"172.21.15.123:6835","nonce":2007610603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8436,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2929123975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2929123975},{"type":"v1","addr":"172.21.15.188:6836","nonce":2929123975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:19:34.917419+0000","modified":"2024-09-15T23:19:36.941347+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8439":{"gid":8439,"name":"d","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6837/1222656979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1222656979},{"type":"v1","addr":"172.21.15.188:6837","nonce":1222656979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8439,"qdb_cluster":[8439]},"id":9}]} 2024-09-15T23:20:11.650 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 86 2024-09-15T23:20:11.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.650+0000 7f9170c94640 1 -- 172.21.15.123:0/2380518683 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f914c06c2b0 msgr2=0x7f914c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:11.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.650+0000 7f9170c94640 1 --2- 172.21.15.123:0/2380518683 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f914c06c2b0 0x7f914c06e770 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f916c073210 tx=0x7f9154008040 comp rx=0 tx=0).stop 2024-09-15T23:20:11.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.650+0000 7f9170c94640 1 -- 172.21.15.123:0/2380518683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f916c0b2d40 msgr2=0x7f916c156d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:11.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.650+0000 7f9170c94640 1 --2- 172.21.15.123:0/2380518683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f916c0b2d40 0x7f916c156d90 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f915c00d800 tx=0x7f915c00dcc0 comp rx=0 tx=0).stop 2024-09-15T23:20:11.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.650+0000 7f9170c94640 1 -- 172.21.15.123:0/2380518683 shutdown_connections 2024-09-15T23:20:11.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.650+0000 7f9170c94640 1 --2- 172.21.15.123:0/2380518683 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f916c15bcf0 0x7f916c0b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:11.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.650+0000 7f9170c94640 1 --2- 172.21.15.123:0/2380518683 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f916c13eb20 0x7f916c0b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:11.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.650+0000 7f9170c94640 1 --2- 172.21.15.123:0/2380518683 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f914c06c2b0 0x7f914c06e770 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:11.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.650+0000 7f9170c94640 1 --2- 172.21.15.123:0/2380518683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f916c0b2d40 0x7f916c156d90 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:11.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.650+0000 7f9170c94640 1 -- 172.21.15.123:0/2380518683 >> 172.21.15.123:0/2380518683 conn(0x7f916c0ccec0 msgr2=0x7f916c15d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:11.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.650+0000 7f9170c94640 1 -- 172.21.15.123:0/2380518683 shutdown_connections 2024-09-15T23:20:11.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.650+0000 7f9170c94640 1 -- 172.21.15.123:0/2380518683 wait complete. 2024-09-15T23:20:11.663 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-15T23:20:11.663 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:20:11.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.757+0000 7fde7dcf8640 1 Processor -- start 2024-09-15T23:20:11.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.757+0000 7fde7dcf8640 1 -- start start 2024-09-15T23:20:11.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.758+0000 7fde7dcf8640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde7806c320 0x7fde7815bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:11.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.758+0000 7fde7dcf8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fde7813eb20 0x7fde7815c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:11.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.758+0000 7fde7dcf8640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde78071180 con 0x7fde780b2d40 2024-09-15T23:20:11.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.758+0000 7fde7dcf8640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fde78071ab0 con 0x7fde7813eb20 2024-09-15T23:20:11.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.758+0000 7fde7dcf8640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fde78071460 con 0x7fde7806c320 2024-09-15T23:20:11.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.758+0000 7fde77fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fde7813eb20 0x7fde7815c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:11.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.758+0000 7fde77fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fde7813eb20 0x7fde7815c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42916/0 (socket says 172.21.15.123:42916) 2024-09-15T23:20:11.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.758+0000 7fde77fff640 1 -- 172.21.15.123:0/242289498 learned_addr learned my addr 172.21.15.123:0/242289498 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:11.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.759+0000 7fde77fff640 1 -- 172.21.15.123:0/242289498 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde7806c320 msgr2=0x7fde7815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:11.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.759+0000 7fde76ffd640 1 --2- 172.21.15.123:0/242289498 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde7806c320 0x7fde7815bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:11.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.759+0000 7fde77fff640 1 --2- 172.21.15.123:0/242289498 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde7806c320 0x7fde7815bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:11.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.759+0000 7fde77fff640 1 -- 172.21.15.123:0/242289498 >> v1:172.21.15.188:6789/0 conn(0x7fde780b2d40 legacy=0x7fde7806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:11.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.759+0000 7fde77fff640 1 -- 172.21.15.123:0/242289498 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde78071740 con 0x7fde7813eb20 2024-09-15T23:20:11.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.759+0000 7fde77fff640 1 --2- 172.21.15.123:0/242289498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde7813eb20 0x7fde7815c230 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fde70009e50 tx=0x7fde7002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c9bb78dd41908d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:11.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.760+0000 7fde767fc640 1 -- 172.21.15.123:0/242289498 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde70036070 con 0x7fde7813eb20 2024-09-15T23:20:11.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.760+0000 7fde767fc640 1 -- 172.21.15.123:0/242289498 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde70031600 con 0x7fde7813eb20 2024-09-15T23:20:11.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.760+0000 7fde767fc640 1 -- 172.21.15.123:0/242289498 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde700319d0 con 0x7fde7813eb20 2024-09-15T23:20:11.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.760+0000 7fde7dcf8640 1 -- 172.21.15.123:0/242289498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde7813eb20 msgr2=0x7fde7815c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:11.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.760+0000 7fde7dcf8640 1 --2- 172.21.15.123:0/242289498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde7813eb20 0x7fde7815c230 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fde70009e50 tx=0x7fde7002a6c0 comp rx=0 tx=0).stop 2024-09-15T23:20:11.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.760+0000 7fde7dcf8640 1 -- 172.21.15.123:0/242289498 shutdown_connections 2024-09-15T23:20:11.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.760+0000 7fde7dcf8640 1 --2- 172.21.15.123:0/242289498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde7813eb20 0x7fde7815c230 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:11.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.760+0000 7fde7dcf8640 1 --2- 172.21.15.123:0/242289498 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde7806c320 0x7fde7815bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:11.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.760+0000 7fde7dcf8640 1 -- 172.21.15.123:0/242289498 >> 172.21.15.123:0/242289498 conn(0x7fde780ccec0 msgr2=0x7fde780cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:11.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.760+0000 7fde7dcf8640 1 -- 172.21.15.123:0/242289498 shutdown_connections 2024-09-15T23:20:11.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.760+0000 7fde7dcf8640 1 -- 172.21.15.123:0/242289498 wait complete. 2024-09-15T23:20:11.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.761+0000 7fde7dcf8640 1 Processor -- start 2024-09-15T23:20:11.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.762+0000 7fde7dcf8640 1 -- start start 2024-09-15T23:20:11.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.762+0000 7fde7dcf8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde7806c320 0x7fde780b5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:11.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.762+0000 7fde7dcf8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde780b2d40 0x7fde781550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:11.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.762+0000 7fde7dcf8640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde7813eb20 0x7fde781f2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:11.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.762+0000 7fde7dcf8640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fde780720c0 con 0x7fde780b2d40 2024-09-15T23:20:11.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.762+0000 7fde7dcf8640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fde78071f40 con 0x7fde7806c320 2024-09-15T23:20:11.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.762+0000 7fde7dcf8640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fde78072240 con 0x7fde7813eb20 2024-09-15T23:20:11.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.762+0000 7fde76ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde780b2d40 0x7fde781550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:11.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.762+0000 7fde76ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde780b2d40 0x7fde781550e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42926/0 (socket says 172.21.15.123:42926) 2024-09-15T23:20:11.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.762+0000 7fde76ffd640 1 -- 172.21.15.123:0/1480802119 learned_addr learned my addr 172.21.15.123:0/1480802119 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:11.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.762+0000 7fde777fe640 1 --2- 172.21.15.123:0/1480802119 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde7806c320 0x7fde780b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:11.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.763+0000 7fde77fff640 1 --2- 172.21.15.123:0/1480802119 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde7813eb20 0x7fde781f2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:11.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.763+0000 7fde76ffd640 1 -- 172.21.15.123:0/1480802119 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde7813eb20 msgr2=0x7fde781f2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:11.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.763+0000 7fde76ffd640 1 --2- 172.21.15.123:0/1480802119 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde7813eb20 0x7fde781f2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:11.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.763+0000 7fde76ffd640 1 -- 172.21.15.123:0/1480802119 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde7806c320 msgr2=0x7fde780b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:11.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.763+0000 7fde76ffd640 1 --2- 172.21.15.123:0/1480802119 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde7806c320 0x7fde780b5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:11.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.763+0000 7fde76ffd640 1 -- 172.21.15.123:0/1480802119 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde7813d770 con 0x7fde780b2d40 2024-09-15T23:20:11.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.763+0000 7fde76ffd640 1 --2- 172.21.15.123:0/1480802119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde780b2d40 0x7fde781550e0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fde6c00c7c0 tx=0x7fde6c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:11.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.763+0000 7fde5ffff640 1 -- 172.21.15.123:0/1480802119 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde6c015070 con 0x7fde780b2d40 2024-09-15T23:20:11.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.763+0000 7fde5ffff640 1 -- 172.21.15.123:0/1480802119 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde6c007820 con 0x7fde780b2d40 2024-09-15T23:20:11.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.763+0000 7fde7dcf8640 1 -- 172.21.15.123:0/1480802119 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde78155620 con 0x7fde780b2d40 2024-09-15T23:20:11.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.763+0000 7fde5ffff640 1 -- 172.21.15.123:0/1480802119 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde6c007bf0 con 0x7fde780b2d40 2024-09-15T23:20:11.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.763+0000 7fde7dcf8640 1 -- 172.21.15.123:0/1480802119 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde780b5c60 con 0x7fde780b2d40 2024-09-15T23:20:11.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.764+0000 7fde7dcf8640 1 -- 172.21.15.123:0/1480802119 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde781595f0 con 0x7fde780b2d40 2024-09-15T23:20:11.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.764+0000 7fde5ffff640 1 -- 172.21.15.123:0/1480802119 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fde6c018070 con 0x7fde780b2d40 2024-09-15T23:20:11.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.765+0000 7fde5ffff640 1 --2- 172.21.15.123:0/1480802119 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fde6406c2b0 0x7fde6406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:11.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.765+0000 7fde5ffff640 1 -- 172.21.15.123:0/1480802119 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fde6c08b2e0 con 0x7fde780b2d40 2024-09-15T23:20:11.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.765+0000 7fde777fe640 1 --2- 172.21.15.123:0/1480802119 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fde6406c2b0 0x7fde6406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:11.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.766+0000 7fde777fe640 1 --2- 172.21.15.123:0/1480802119 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fde6406c2b0 0x7fde6406e770 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fde68004f60 tx=0x7fde68007e30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:11.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.769+0000 7fde5ffff640 1 -- 172.21.15.123:0/1480802119 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fde781595f0 con 0x7fde780b2d40 2024-09-15T23:20:12.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.998+0000 7fde7dcf8640 1 -- 172.21.15.123:0/1480802119 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fde7806c9c0 con 0x7fde780b2d40 2024-09-15T23:20:12.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:11.999+0000 7fde5ffff640 1 -- 172.21.15.123:0/1480802119 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1640 (secure 0 0 0) 0x7fde78155620 con 0x7fde780b2d40 2024-09-15T23:20:12.001 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:12.001 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":502,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":142,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076566731,"bytes_used":2537865216,"bytes_avail":770556248064,"bytes_total":773094113280,"write_bytes_sec":12490976,"read_op_per_sec":0,"write_op_per_sec":12},"fsmap":{"epoch":86,"btime":"2024-09-15T23:19:37:619526+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"d","status":"up:active","gid":8439}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-09-15T23:20:03.615835+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}}}}}},"progress_events":{}} 2024-09-15T23:20:12.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:12.001+0000 7fde7dcf8640 1 -- 172.21.15.123:0/1480802119 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fde6406c2b0 msgr2=0x7fde6406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:12.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:12.001+0000 7fde7dcf8640 1 --2- 172.21.15.123:0/1480802119 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fde6406c2b0 0x7fde6406e770 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fde68004f60 tx=0x7fde68007e30 comp rx=0 tx=0).stop 2024-09-15T23:20:12.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:12.001+0000 7fde7dcf8640 1 -- 172.21.15.123:0/1480802119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde780b2d40 msgr2=0x7fde781550e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:12.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:12.001+0000 7fde7dcf8640 1 --2- 172.21.15.123:0/1480802119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde780b2d40 0x7fde781550e0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fde6c00c7c0 tx=0x7fde6c00cc80 comp rx=0 tx=0).stop 2024-09-15T23:20:12.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:12.001+0000 7fde7dcf8640 1 -- 172.21.15.123:0/1480802119 shutdown_connections 2024-09-15T23:20:12.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:12.001+0000 7fde7dcf8640 1 --2- 172.21.15.123:0/1480802119 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fde7813eb20 0x7fde781f2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:12.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:12.001+0000 7fde7dcf8640 1 --2- 172.21.15.123:0/1480802119 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fde6406c2b0 0x7fde6406e770 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:12.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:12.001+0000 7fde7dcf8640 1 --2- 172.21.15.123:0/1480802119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde780b2d40 0x7fde781550e0 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:12.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:12.001+0000 7fde7dcf8640 1 --2- 172.21.15.123:0/1480802119 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fde7806c320 0x7fde780b5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:12.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:12.001+0000 7fde7dcf8640 1 -- 172.21.15.123:0/1480802119 >> 172.21.15.123:0/1480802119 conn(0x7fde780ccec0 msgr2=0x7fde7813ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:12.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:12.001+0000 7fde7dcf8640 1 -- 172.21.15.123:0/1480802119 shutdown_connections 2024-09-15T23:20:12.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:12.001+0000 7fde7dcf8640 1 -- 172.21.15.123:0/1480802119 wait complete. 2024-09-15T23:20:12.013 INFO:tasks.ceph.ceph_manager.ceph:{'d': 'paused'} 2024-09-15T23:20:13.015 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:20:13.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.122+0000 7efd1c7cf640 1 Processor -- start 2024-09-15T23:20:13.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.122+0000 7efd1c7cf640 1 -- start start 2024-09-15T23:20:13.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.123+0000 7efd1c7cf640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efd140b2d40 0x7efd1406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:13.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.123+0000 7efd1c7cf640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7efd1406c150 0x7efd1415c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:13.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.123+0000 7efd1c7cf640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd14071180 con 0x7efd1413eb20 2024-09-15T23:20:13.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.123+0000 7efd1c7cf640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7efd14071ab0 con 0x7efd140b2d40 2024-09-15T23:20:13.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.123+0000 7efd1c7cf640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7efd14071460 con 0x7efd1406c150 2024-09-15T23:20:13.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.123+0000 7efd1a56b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efd140b2d40 0x7efd1406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:13.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.123+0000 7efd19d6a640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7efd1413eb20 0x7efd1415bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38018/0 (socket says 172.21.15.123:38018) 2024-09-15T23:20:13.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.123+0000 7efd19d6a640 1 -- 172.21.15.123:0/2603793657 learned_addr learned my addr 172.21.15.123:0/2603793657 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:13.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.123+0000 7efd19569640 1 -- 172.21.15.123:0/2603793657 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1114698351 0 0) 0x7efd14071180 con 0x7efd1413eb20 2024-09-15T23:20:13.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.123+0000 7efd19569640 1 -- 172.21.15.123:0/2603793657 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd00003520 con 0x7efd1413eb20 2024-09-15T23:20:13.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.123+0000 7efd1ad6c640 1 --2- 172.21.15.123:0/2603793657 >> v2:172.21.15.188:3300/0 conn(0x7efd1406c150 0x7efd1415c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:13.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.123+0000 7efd1a56b640 1 -- 172.21.15.123:0/2603793657 >> v2:172.21.15.188:3300/0 conn(0x7efd1406c150 msgr2=0x7efd1415c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:13.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.123+0000 7efd1a56b640 1 --2- 172.21.15.123:0/2603793657 >> v2:172.21.15.188:3300/0 conn(0x7efd1406c150 0x7efd1415c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:13.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.123+0000 7efd1a56b640 1 -- 172.21.15.123:0/2603793657 >> v1:172.21.15.123:6789/0 conn(0x7efd1413eb20 legacy=0x7efd1415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:13.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.123+0000 7efd1a56b640 1 -- 172.21.15.123:0/2603793657 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd14071740 con 0x7efd140b2d40 2024-09-15T23:20:13.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.124+0000 7efd1ad6c640 1 --2- 172.21.15.123:0/2603793657 >> v2:172.21.15.188:3300/0 conn(0x7efd1406c150 0x7efd1415c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:20:13.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.124+0000 7efd1a56b640 1 --2- 172.21.15.123:0/2603793657 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd140b2d40 0x7efd1406bc10 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7efd14070d30 tx=0x7efd1002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e81b1ceb77a69ecb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:13.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.124+0000 7efd19569640 1 -- 172.21.15.123:0/2603793657 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd10037070 con 0x7efd140b2d40 2024-09-15T23:20:13.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.124+0000 7efd19569640 1 -- 172.21.15.123:0/2603793657 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd10032440 con 0x7efd140b2d40 2024-09-15T23:20:13.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.124+0000 7efd19569640 1 -- 172.21.15.123:0/2603793657 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd10032810 con 0x7efd140b2d40 2024-09-15T23:20:13.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.125+0000 7efd1c7cf640 1 -- 172.21.15.123:0/2603793657 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd140b2d40 msgr2=0x7efd1406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:13.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.125+0000 7efd1c7cf640 1 --2- 172.21.15.123:0/2603793657 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd140b2d40 0x7efd1406bc10 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7efd14070d30 tx=0x7efd1002a1a0 comp rx=0 tx=0).stop 2024-09-15T23:20:13.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.125+0000 7efd1c7cf640 1 -- 172.21.15.123:0/2603793657 shutdown_connections 2024-09-15T23:20:13.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.125+0000 7efd1c7cf640 1 --2- 172.21.15.123:0/2603793657 >> v2:172.21.15.188:3300/0 conn(0x7efd1406c150 0x7efd1415c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:13.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.125+0000 7efd1c7cf640 1 --2- 172.21.15.123:0/2603793657 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd140b2d40 0x7efd1406bc10 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:13.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.125+0000 7efd1c7cf640 1 -- 172.21.15.123:0/2603793657 >> 172.21.15.123:0/2603793657 conn(0x7efd140ccec0 msgr2=0x7efd140cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:13.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.125+0000 7efd1c7cf640 1 -- 172.21.15.123:0/2603793657 shutdown_connections 2024-09-15T23:20:13.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.125+0000 7efd1c7cf640 1 -- 172.21.15.123:0/2603793657 wait complete. 2024-09-15T23:20:13.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.126+0000 7efd1c7cf640 1 Processor -- start 2024-09-15T23:20:13.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.126+0000 7efd1c7cf640 1 -- start start 2024-09-15T23:20:13.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.127+0000 7efd1c7cf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd1406c150 0x7efd14153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:13.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.127+0000 7efd1c7cf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efd140b2d40 0x7efd1415f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:13.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.127+0000 7efd1c7cf640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd1413eb20 0x7efd14137e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:13.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.127+0000 7efd1c7cf640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efd140722d0 con 0x7efd1406c150 2024-09-15T23:20:13.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.127+0000 7efd1c7cf640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7efd14072150 con 0x7efd140b2d40 2024-09-15T23:20:13.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.127+0000 7efd1c7cf640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7efd14072450 con 0x7efd1413eb20 2024-09-15T23:20:13.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.127+0000 7efd1a56b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd1406c150 0x7efd14153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:13.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.127+0000 7efd1a56b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd1406c150 0x7efd14153e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42950/0 (socket says 172.21.15.123:42950) 2024-09-15T23:20:13.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.127+0000 7efd1a56b640 1 -- 172.21.15.123:0/1750650780 learned_addr learned my addr 172.21.15.123:0/1750650780 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:13.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.127+0000 7efd19d6a640 1 --2- 172.21.15.123:0/1750650780 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efd140b2d40 0x7efd1415f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:13.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.127+0000 7efd1ad6c640 1 --2- 172.21.15.123:0/1750650780 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd1413eb20 0x7efd14137e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:13.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.127+0000 7efd1a56b640 1 -- 172.21.15.123:0/1750650780 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd1413eb20 msgr2=0x7efd14137e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:13.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.127+0000 7efd1a56b640 1 --2- 172.21.15.123:0/1750650780 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd1413eb20 0x7efd14137e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:13.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.127+0000 7efd1a56b640 1 -- 172.21.15.123:0/1750650780 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efd140b2d40 msgr2=0x7efd1415f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:13.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.127+0000 7efd1a56b640 1 --2- 172.21.15.123:0/1750650780 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efd140b2d40 0x7efd1415f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:13.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.127+0000 7efd1a56b640 1 -- 172.21.15.123:0/1750650780 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd140b4590 con 0x7efd1406c150 2024-09-15T23:20:13.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.127+0000 7efd19d6a640 1 --2- 172.21.15.123:0/1750650780 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efd140b2d40 0x7efd1415f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:20:13.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.128+0000 7efd1a56b640 1 --2- 172.21.15.123:0/1750650780 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd1406c150 0x7efd14153e10 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7efd10000c00 tx=0x7efd100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:13.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.128+0000 7efd0affd640 1 -- 172.21.15.123:0/1750650780 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd10037040 con 0x7efd1406c150 2024-09-15T23:20:13.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.128+0000 7efd0affd640 1 -- 172.21.15.123:0/1750650780 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd10042070 con 0x7efd1406c150 2024-09-15T23:20:13.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.128+0000 7efd1c7cf640 1 -- 172.21.15.123:0/1750650780 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd140b4870 con 0x7efd1406c150 2024-09-15T23:20:13.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.128+0000 7efd0affd640 1 -- 172.21.15.123:0/1750650780 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd10030960 con 0x7efd1406c150 2024-09-15T23:20:13.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.128+0000 7efd1c7cf640 1 -- 172.21.15.123:0/1750650780 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd140b4e30 con 0x7efd1406c150 2024-09-15T23:20:13.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.129+0000 7efd1c7cf640 1 -- 172.21.15.123:0/1750650780 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd1406bc10 con 0x7efd1406c150 2024-09-15T23:20:13.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.129+0000 7efd0affd640 1 -- 172.21.15.123:0/1750650780 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7efd10030b00 con 0x7efd1406c150 2024-09-15T23:20:13.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.130+0000 7efd0affd640 1 --2- 172.21.15.123:0/1750650780 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efcf806c2b0 0x7efcf806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:13.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.130+0000 7efd0affd640 1 -- 172.21.15.123:0/1750650780 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7efd100abd50 con 0x7efd1406c150 2024-09-15T23:20:13.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.130+0000 7efd19d6a640 1 --2- 172.21.15.123:0/1750650780 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efcf806c2b0 0x7efcf806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:13.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.131+0000 7efd19d6a640 1 --2- 172.21.15.123:0/1750650780 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efcf806c2b0 0x7efcf806e770 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7efd1415ea30 tx=0x7efd04009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:13.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.134+0000 7efd0affd640 1 -- 172.21.15.123:0/1750650780 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efd100af030 con 0x7efd1406c150 2024-09-15T23:20:13.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.331+0000 7efd1c7cf640 1 -- 172.21.15.123:0/1750650780 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efd14076180 con 0x7efd1406c150 2024-09-15T23:20:13.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.332+0000 7efd0affd640 1 -- 172.21.15.123:0/1750650780 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5237 (secure 0 0 0) 0x7efd10045360 con 0x7efd1406c150 2024-09-15T23:20:13.334 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:13.334 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":86,"btime":"2024-09-15T23:19:37:619526+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2082746470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2082746470},{"type":"v1","addr":"172.21.15.123:6834","nonce":2082746470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8421,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2007610603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":2007610603},{"type":"v1","addr":"172.21.15.123:6835","nonce":2007610603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8436,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2929123975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2929123975},{"type":"v1","addr":"172.21.15.188:6836","nonce":2929123975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:19:34.917419+0000","modified":"2024-09-15T23:19:36.941347+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8439":{"gid":8439,"name":"d","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6837/1222656979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1222656979},{"type":"v1","addr":"172.21.15.188:6837","nonce":1222656979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8439,"qdb_cluster":[8439]},"id":9}]} 2024-09-15T23:20:13.335 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 86 2024-09-15T23:20:13.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.334+0000 7efd1c7cf640 1 -- 172.21.15.123:0/1750650780 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efcf806c2b0 msgr2=0x7efcf806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:13.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.334+0000 7efd1c7cf640 1 --2- 172.21.15.123:0/1750650780 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efcf806c2b0 0x7efcf806e770 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7efd1415ea30 tx=0x7efd04009040 comp rx=0 tx=0).stop 2024-09-15T23:20:13.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.334+0000 7efd1c7cf640 1 -- 172.21.15.123:0/1750650780 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd1406c150 msgr2=0x7efd14153e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:13.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.334+0000 7efd1c7cf640 1 --2- 172.21.15.123:0/1750650780 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd1406c150 0x7efd14153e10 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7efd10000c00 tx=0x7efd100046c0 comp rx=0 tx=0).stop 2024-09-15T23:20:13.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.334+0000 7efd1c7cf640 1 -- 172.21.15.123:0/1750650780 shutdown_connections 2024-09-15T23:20:13.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.334+0000 7efd1c7cf640 1 --2- 172.21.15.123:0/1750650780 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efd1413eb20 0x7efd14137e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:13.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.334+0000 7efd1c7cf640 1 --2- 172.21.15.123:0/1750650780 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efd140b2d40 0x7efd1415f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:13.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.334+0000 7efd1c7cf640 1 --2- 172.21.15.123:0/1750650780 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efcf806c2b0 0x7efcf806e770 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:13.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.334+0000 7efd1c7cf640 1 --2- 172.21.15.123:0/1750650780 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd1406c150 0x7efd14153e10 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:13.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.334+0000 7efd1c7cf640 1 -- 172.21.15.123:0/1750650780 >> 172.21.15.123:0/1750650780 conn(0x7efd140ccec0 msgr2=0x7efd141562b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:13.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.334+0000 7efd1c7cf640 1 -- 172.21.15.123:0/1750650780 shutdown_connections 2024-09-15T23:20:13.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.334+0000 7efd1c7cf640 1 -- 172.21.15.123:0/1750650780 wait complete. 2024-09-15T23:20:13.347 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-15T23:20:13.347 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:20:13.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.441+0000 7f6efcf52640 1 Processor -- start 2024-09-15T23:20:13.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.441+0000 7f6efcf52640 1 -- start start 2024-09-15T23:20:13.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.442+0000 7f6efcf52640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6ef80b2d40 0x7f6ef806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:13.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.442+0000 7f6efcf52640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ef813eb20 0x7f6ef806c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:13.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.442+0000 7f6efcf52640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ef8071180 con 0x7f6ef815bcf0 2024-09-15T23:20:13.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.442+0000 7f6efcf52640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f6ef8071ab0 con 0x7f6ef80b2d40 2024-09-15T23:20:13.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.442+0000 7f6efcf52640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6ef8071460 con 0x7f6ef813eb20 2024-09-15T23:20:13.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.442+0000 7f6ef659c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6ef80b2d40 0x7f6ef806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:13.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.442+0000 7f6ef6d9d640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6ef815bcf0 0x7f6ef815c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38024/0 (socket says 172.21.15.123:38024) 2024-09-15T23:20:13.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.442+0000 7f6ef6d9d640 1 -- 172.21.15.123:0/974186873 learned_addr learned my addr 172.21.15.123:0/974186873 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:13.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.443+0000 7f6ef5d9b640 1 --2- 172.21.15.123:0/974186873 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ef813eb20 0x7f6ef806c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:13.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.443+0000 7f6ef659c640 1 -- 172.21.15.123:0/974186873 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ef813eb20 msgr2=0x7f6ef806c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:13.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.443+0000 7f6ef659c640 1 --2- 172.21.15.123:0/974186873 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ef813eb20 0x7f6ef806c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:13.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.443+0000 7f6ef659c640 1 -- 172.21.15.123:0/974186873 >> v1:172.21.15.123:6789/0 conn(0x7f6ef815bcf0 legacy=0x7f6ef815c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:13.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.443+0000 7f6ef559a640 1 -- 172.21.15.123:0/974186873 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2947170649 0 0) 0x7f6ef8071180 con 0x7f6ef815bcf0 2024-09-15T23:20:13.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.443+0000 7f6ef659c640 1 -- 172.21.15.123:0/974186873 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef8071740 con 0x7f6ef80b2d40 2024-09-15T23:20:13.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.443+0000 7f6ef5d9b640 1 --2- 172.21.15.123:0/974186873 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ef813eb20 0x7f6ef806c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:20:13.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.443+0000 7f6ef659c640 1 --2- 172.21.15.123:0/974186873 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ef80b2d40 0x7f6ef806bc10 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8071c30 tx=0x7f6ee802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51f88c5ee1ae8b24 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:13.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.444+0000 7f6ef559a640 1 -- 172.21.15.123:0/974186873 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8037070 con 0x7f6ef80b2d40 2024-09-15T23:20:13.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.444+0000 7f6ef559a640 1 -- 172.21.15.123:0/974186873 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ee8032440 con 0x7f6ef80b2d40 2024-09-15T23:20:13.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.444+0000 7f6ef559a640 1 -- 172.21.15.123:0/974186873 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8032810 con 0x7f6ef80b2d40 2024-09-15T23:20:13.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.444+0000 7f6efcf52640 1 -- 172.21.15.123:0/974186873 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ef80b2d40 msgr2=0x7f6ef806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:13.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.444+0000 7f6efcf52640 1 --2- 172.21.15.123:0/974186873 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ef80b2d40 0x7f6ef806bc10 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8071c30 tx=0x7f6ee802a180 comp rx=0 tx=0).stop 2024-09-15T23:20:13.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.444+0000 7f6efcf52640 1 -- 172.21.15.123:0/974186873 shutdown_connections 2024-09-15T23:20:13.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.444+0000 7f6efcf52640 1 --2- 172.21.15.123:0/974186873 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ef813eb20 0x7f6ef806c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:13.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.444+0000 7f6efcf52640 1 --2- 172.21.15.123:0/974186873 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ef80b2d40 0x7f6ef806bc10 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:13.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.444+0000 7f6efcf52640 1 -- 172.21.15.123:0/974186873 >> 172.21.15.123:0/974186873 conn(0x7f6ef80ccec0 msgr2=0x7f6ef80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:13.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.444+0000 7f6efcf52640 1 -- 172.21.15.123:0/974186873 shutdown_connections 2024-09-15T23:20:13.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.444+0000 7f6efcf52640 1 -- 172.21.15.123:0/974186873 wait complete. 2024-09-15T23:20:13.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.445+0000 7f6efcf52640 1 Processor -- start 2024-09-15T23:20:13.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.446+0000 7f6efcf52640 1 -- start start 2024-09-15T23:20:13.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.446+0000 7f6efcf52640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ef80b2d40 0x7f6ef80cc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:13.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.446+0000 7f6efcf52640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ef813eb20 0x7f6ef8155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:13.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.446+0000 7f6efcf52640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ef815bcf0 0x7f6ef813cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:13.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.446+0000 7f6efcf52640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef80722d0 con 0x7f6ef813eb20 2024-09-15T23:20:13.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.446+0000 7f6efcf52640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef8072150 con 0x7f6ef80b2d40 2024-09-15T23:20:13.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.446+0000 7f6efcf52640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6ef8072450 con 0x7f6ef815bcf0 2024-09-15T23:20:13.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.446+0000 7f6ef5d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ef813eb20 0x7f6ef8155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:13.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.446+0000 7f6ef5d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ef813eb20 0x7f6ef8155d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42964/0 (socket says 172.21.15.123:42964) 2024-09-15T23:20:13.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.447+0000 7f6ef5d9b640 1 -- 172.21.15.123:0/586929420 learned_addr learned my addr 172.21.15.123:0/586929420 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:13.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.447+0000 7f6ef6d9d640 1 --2- 172.21.15.123:0/586929420 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ef815bcf0 0x7f6ef813cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:13.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.447+0000 7f6ef659c640 1 --2- 172.21.15.123:0/586929420 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ef80b2d40 0x7f6ef80cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:13.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.447+0000 7f6ef5d9b640 1 -- 172.21.15.123:0/586929420 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ef815bcf0 msgr2=0x7f6ef813cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:13.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.447+0000 7f6ef5d9b640 1 --2- 172.21.15.123:0/586929420 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ef815bcf0 0x7f6ef813cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:13.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.447+0000 7f6ef5d9b640 1 -- 172.21.15.123:0/586929420 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ef80b2d40 msgr2=0x7f6ef80cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:13.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.447+0000 7f6ef5d9b640 1 --2- 172.21.15.123:0/586929420 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ef80b2d40 0x7f6ef80cc360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:13.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.447+0000 7f6ef5d9b640 1 -- 172.21.15.123:0/586929420 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef81f7d80 con 0x7f6ef813eb20 2024-09-15T23:20:13.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.447+0000 7f6ef6d9d640 1 --2- 172.21.15.123:0/586929420 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ef815bcf0 0x7f6ef813cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:20:13.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.447+0000 7f6ef5d9b640 1 --2- 172.21.15.123:0/586929420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ef813eb20 0x7f6ef8155d50 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f6eec00c7f0 tx=0x7f6eec00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:13.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.447+0000 7f6ee6ffd640 1 -- 172.21.15.123:0/586929420 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec004230 con 0x7f6ef813eb20 2024-09-15T23:20:13.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.447+0000 7f6ee6ffd640 1 -- 172.21.15.123:0/586929420 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eec0043d0 con 0x7f6ef813eb20 2024-09-15T23:20:13.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.447+0000 7f6efcf52640 1 -- 172.21.15.123:0/586929420 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ef81f8060 con 0x7f6ef813eb20 2024-09-15T23:20:13.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.447+0000 7f6ee6ffd640 1 -- 172.21.15.123:0/586929420 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec007a70 con 0x7f6ef813eb20 2024-09-15T23:20:13.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.447+0000 7f6efcf52640 1 -- 172.21.15.123:0/586929420 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ef81f8620 con 0x7f6ef813eb20 2024-09-15T23:20:13.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.448+0000 7f6efcf52640 1 -- 172.21.15.123:0/586929420 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ef81f8a00 con 0x7f6ef813eb20 2024-09-15T23:20:13.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.449+0000 7f6ee6ffd640 1 -- 172.21.15.123:0/586929420 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6eec007c10 con 0x7f6ef813eb20 2024-09-15T23:20:13.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.449+0000 7f6ee6ffd640 1 --2- 172.21.15.123:0/586929420 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6ed806c2b0 0x7f6ed806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:13.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.449+0000 7f6ee6ffd640 1 -- 172.21.15.123:0/586929420 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f6eec08b4a0 con 0x7f6ef813eb20 2024-09-15T23:20:13.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.449+0000 7f6ef659c640 1 --2- 172.21.15.123:0/586929420 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6ed806c2b0 0x7f6ed806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:13.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.450+0000 7f6ef659c640 1 --2- 172.21.15.123:0/586929420 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6ed806c2b0 0x7f6ed806e770 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8034000 tx=0x7f6ee802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:13.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.453+0000 7f6ee6ffd640 1 -- 172.21.15.123:0/586929420 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6ef81f8a00 con 0x7f6ef813eb20 2024-09-15T23:20:13.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.686+0000 7f6efcf52640 1 -- 172.21.15.123:0/586929420 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f6ef80728e0 con 0x7f6ef813eb20 2024-09-15T23:20:13.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.686+0000 7f6ee6ffd640 1 -- 172.21.15.123:0/586929420 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1634 (secure 0 0 0) 0x7f6eec015020 con 0x7f6ef813eb20 2024-09-15T23:20:13.689 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:13.689 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":504,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":142,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076566731,"bytes_used":2537865216,"bytes_avail":770556248064,"bytes_total":773094113280,"write_bytes_sec":511,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":86,"btime":"2024-09-15T23:19:37:619526+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"d","status":"up:active","gid":8439}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-09-15T23:20:03.615835+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}}}}}},"progress_events":{}} 2024-09-15T23:20:13.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.688+0000 7f6efcf52640 1 -- 172.21.15.123:0/586929420 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6ed806c2b0 msgr2=0x7f6ed806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:13.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.688+0000 7f6efcf52640 1 --2- 172.21.15.123:0/586929420 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6ed806c2b0 0x7f6ed806e770 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8034000 tx=0x7f6ee802e000 comp rx=0 tx=0).stop 2024-09-15T23:20:13.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.688+0000 7f6efcf52640 1 -- 172.21.15.123:0/586929420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ef813eb20 msgr2=0x7f6ef8155d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:13.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.688+0000 7f6efcf52640 1 --2- 172.21.15.123:0/586929420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ef813eb20 0x7f6ef8155d50 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f6eec00c7f0 tx=0x7f6eec00ccb0 comp rx=0 tx=0).stop 2024-09-15T23:20:13.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.688+0000 7f6efcf52640 1 -- 172.21.15.123:0/586929420 shutdown_connections 2024-09-15T23:20:13.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.688+0000 7f6efcf52640 1 --2- 172.21.15.123:0/586929420 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ef815bcf0 0x7f6ef813cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:13.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.688+0000 7f6efcf52640 1 --2- 172.21.15.123:0/586929420 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6ed806c2b0 0x7f6ed806e770 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:13.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.688+0000 7f6efcf52640 1 --2- 172.21.15.123:0/586929420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ef813eb20 0x7f6ef8155d50 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:13.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.688+0000 7f6efcf52640 1 --2- 172.21.15.123:0/586929420 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ef80b2d40 0x7f6ef80cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:13.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.688+0000 7f6efcf52640 1 -- 172.21.15.123:0/586929420 >> 172.21.15.123:0/586929420 conn(0x7f6ef80ccec0 msgr2=0x7f6ef80b5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:13.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.689+0000 7f6efcf52640 1 -- 172.21.15.123:0/586929420 shutdown_connections 2024-09-15T23:20:13.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:13.689+0000 7f6efcf52640 1 -- 172.21.15.123:0/586929420 wait complete. 2024-09-15T23:20:13.701 INFO:tasks.ceph.ceph_manager.ceph:{'d': 'paused'} 2024-09-15T23:20:14.702 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:20:14.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.809+0000 7f598499f640 1 Processor -- start 2024-09-15T23:20:14.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.809+0000 7f598499f640 1 -- start start 2024-09-15T23:20:14.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.810+0000 7f598499f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f598015c4b0 0x7f59800b6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:14.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.810+0000 7f598499f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f59800b02b0 0x7f59800b6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:14.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.810+0000 7f598499f640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5980067b50 con 0x7f59800d08e0 2024-09-15T23:20:14.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.810+0000 7f598499f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f59800ce860 con 0x7f59800b02b0 2024-09-15T23:20:14.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.810+0000 7f598499f640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f5980070130 con 0x7f598015c4b0 2024-09-15T23:20:14.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.810+0000 7f597dd9b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f59800b02b0 0x7f59800b6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:14.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.810+0000 7f597ed9d640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f59800d08e0 0x7f5980160120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38028/0 (socket says 172.21.15.123:38028) 2024-09-15T23:20:14.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.810+0000 7f597ed9d640 1 -- 172.21.15.123:0/1755737060 learned_addr learned my addr 172.21.15.123:0/1755737060 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:14.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.810+0000 7f597e59c640 1 --2- 172.21.15.123:0/1755737060 >> v2:172.21.15.188:3300/0 conn(0x7f598015c4b0 0x7f59800b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:14.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.810+0000 7f597dd9b640 1 -- 172.21.15.123:0/1755737060 >> v2:172.21.15.188:3300/0 conn(0x7f598015c4b0 msgr2=0x7f59800b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:14.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.810+0000 7f597dd9b640 1 --2- 172.21.15.123:0/1755737060 >> v2:172.21.15.188:3300/0 conn(0x7f598015c4b0 0x7f59800b6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:14.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.810+0000 7f597dd9b640 1 -- 172.21.15.123:0/1755737060 >> v1:172.21.15.123:6789/0 conn(0x7f59800d08e0 legacy=0x7f5980160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:14.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.810+0000 7f597dd9b640 1 -- 172.21.15.123:0/1755737060 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f598006fe50 con 0x7f59800b02b0 2024-09-15T23:20:14.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.810+0000 7f597d59a640 1 -- 172.21.15.123:0/1755737060 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1974021304 0 0) 0x7f5978001490 con 0x7f59800d08e0 2024-09-15T23:20:14.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.811+0000 7f597dd9b640 1 --2- 172.21.15.123:0/1755737060 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59800b02b0 0x7f59800b6660 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f5980069d90 tx=0x7f597402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59c12d00cbdfe7f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:14.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.811+0000 7f597d59a640 1 -- 172.21.15.123:0/1755737060 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5974037070 con 0x7f59800b02b0 2024-09-15T23:20:14.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.811+0000 7f597d59a640 1 -- 172.21.15.123:0/1755737060 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5974032440 con 0x7f59800b02b0 2024-09-15T23:20:14.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.811+0000 7f597d59a640 1 -- 172.21.15.123:0/1755737060 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5974032810 con 0x7f59800b02b0 2024-09-15T23:20:14.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.812+0000 7f598499f640 1 -- 172.21.15.123:0/1755737060 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59800b02b0 msgr2=0x7f59800b6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:14.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.812+0000 7f598499f640 1 --2- 172.21.15.123:0/1755737060 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59800b02b0 0x7f59800b6660 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f5980069d90 tx=0x7f597402a1a0 comp rx=0 tx=0).stop 2024-09-15T23:20:14.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.812+0000 7f598499f640 1 -- 172.21.15.123:0/1755737060 shutdown_connections 2024-09-15T23:20:14.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.812+0000 7f598499f640 1 --2- 172.21.15.123:0/1755737060 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59800b02b0 0x7f59800b6660 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:14.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.812+0000 7f598499f640 1 --2- 172.21.15.123:0/1755737060 >> v2:172.21.15.188:3300/0 conn(0x7f598015c4b0 0x7f59800b6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:14.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.812+0000 7f598499f640 1 -- 172.21.15.123:0/1755737060 >> 172.21.15.123:0/1755737060 conn(0x7f59800b0a80 msgr2=0x7f59800b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:14.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.812+0000 7f598499f640 1 -- 172.21.15.123:0/1755737060 shutdown_connections 2024-09-15T23:20:14.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.812+0000 7f598499f640 1 -- 172.21.15.123:0/1755737060 wait complete. 2024-09-15T23:20:14.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.813+0000 7f598499f640 1 Processor -- start 2024-09-15T23:20:14.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.813+0000 7f598499f640 1 -- start start 2024-09-15T23:20:14.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.814+0000 7f598499f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59800b02b0 0x7f59800b4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:14.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.814+0000 7f598499f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f59800d08e0 0x7f5980149050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:14.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.814+0000 7f598499f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f598015c4b0 0x7f59800ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:14.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.814+0000 7f598499f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f598006dcc0 con 0x7f59800b02b0 2024-09-15T23:20:14.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.814+0000 7f598499f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f59800ce580 con 0x7f59800d08e0 2024-09-15T23:20:14.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.814+0000 7f598499f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f598015c890 con 0x7f598015c4b0 2024-09-15T23:20:14.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.814+0000 7f597e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59800b02b0 0x7f59800b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:14.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.814+0000 7f597e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59800b02b0 0x7f59800b4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42990/0 (socket says 172.21.15.123:42990) 2024-09-15T23:20:14.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.814+0000 7f597e59c640 1 -- 172.21.15.123:0/3386539951 learned_addr learned my addr 172.21.15.123:0/3386539951 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:14.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.814+0000 7f597dd9b640 1 --2- 172.21.15.123:0/3386539951 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f59800d08e0 0x7f5980149050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:14.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.814+0000 7f597ed9d640 1 --2- 172.21.15.123:0/3386539951 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f598015c4b0 0x7f59800ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:14.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.814+0000 7f597e59c640 1 -- 172.21.15.123:0/3386539951 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f598015c4b0 msgr2=0x7f59800ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:14.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.814+0000 7f597e59c640 1 --2- 172.21.15.123:0/3386539951 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f598015c4b0 0x7f59800ae870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:14.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.814+0000 7f597e59c640 1 -- 172.21.15.123:0/3386539951 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f59800d08e0 msgr2=0x7f5980149050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:14.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.814+0000 7f597e59c640 1 --2- 172.21.15.123:0/3386539951 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f59800d08e0 0x7f5980149050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:14.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.814+0000 7f597e59c640 1 -- 172.21.15.123:0/3386539951 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59801517c0 con 0x7f59800b02b0 2024-09-15T23:20:14.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.814+0000 7f597ed9d640 1 --2- 172.21.15.123:0/3386539951 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f598015c4b0 0x7f59800ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:20:14.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.815+0000 7f597e59c640 1 --2- 172.21.15.123:0/3386539951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59800b02b0 0x7f59800b4920 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f597000d5f0 tx=0x7f597000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:14.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.815+0000 7f596effd640 1 -- 172.21.15.123:0/3386539951 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59700125f0 con 0x7f59800b02b0 2024-09-15T23:20:14.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.815+0000 7f596effd640 1 -- 172.21.15.123:0/3386539951 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5970019070 con 0x7f59800b02b0 2024-09-15T23:20:14.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.815+0000 7f598499f640 1 -- 172.21.15.123:0/3386539951 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5980149590 con 0x7f59800b02b0 2024-09-15T23:20:14.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.815+0000 7f596effd640 1 -- 172.21.15.123:0/3386539951 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59700129d0 con 0x7f59800b02b0 2024-09-15T23:20:14.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.815+0000 7f598499f640 1 -- 172.21.15.123:0/3386539951 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59800b5350 con 0x7f59800b02b0 2024-09-15T23:20:14.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.816+0000 7f598499f640 1 -- 172.21.15.123:0/3386539951 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f598006e820 con 0x7f59800b02b0 2024-09-15T23:20:14.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.816+0000 7f596effd640 1 -- 172.21.15.123:0/3386539951 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5970012b70 con 0x7f59800b02b0 2024-09-15T23:20:14.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.817+0000 7f596effd640 1 --2- 172.21.15.123:0/3386539951 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f596006c2b0 0x7f596006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:14.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.817+0000 7f596effd640 1 -- 172.21.15.123:0/3386539951 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f597008b7b0 con 0x7f59800b02b0 2024-09-15T23:20:14.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.817+0000 7f597dd9b640 1 --2- 172.21.15.123:0/3386539951 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f596006c2b0 0x7f596006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:14.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.817+0000 7f597dd9b640 1 --2- 172.21.15.123:0/3386539951 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f596006c2b0 0x7f596006e770 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f5974034000 tx=0x7f597402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:14.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:14.821+0000 7f596effd640 1 -- 172.21.15.123:0/3386539951 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5970059fb0 con 0x7f59800b02b0 2024-09-15T23:20:15.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.017+0000 7f598499f640 1 -- 172.21.15.123:0/3386539951 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f598006e540 con 0x7f59800b02b0 2024-09-15T23:20:15.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.018+0000 7f596effd640 1 -- 172.21.15.123:0/3386539951 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5237 (secure 0 0 0) 0x7f59700598b0 con 0x7f59800b02b0 2024-09-15T23:20:15.020 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:15.020 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":86,"btime":"2024-09-15T23:19:37:619526+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2082746470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2082746470},{"type":"v1","addr":"172.21.15.123:6834","nonce":2082746470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8421,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2007610603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":2007610603},{"type":"v1","addr":"172.21.15.123:6835","nonce":2007610603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8436,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2929123975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2929123975},{"type":"v1","addr":"172.21.15.188:6836","nonce":2929123975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:19:34.917419+0000","modified":"2024-09-15T23:19:36.941347+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8439":{"gid":8439,"name":"d","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6837/1222656979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1222656979},{"type":"v1","addr":"172.21.15.188:6837","nonce":1222656979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8439,"qdb_cluster":[8439]},"id":9}]} 2024-09-15T23:20:15.021 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 86 2024-09-15T23:20:15.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.020+0000 7f598499f640 1 -- 172.21.15.123:0/3386539951 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f596006c2b0 msgr2=0x7f596006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:15.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.020+0000 7f598499f640 1 --2- 172.21.15.123:0/3386539951 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f596006c2b0 0x7f596006e770 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f5974034000 tx=0x7f597402e000 comp rx=0 tx=0).stop 2024-09-15T23:20:15.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.020+0000 7f598499f640 1 -- 172.21.15.123:0/3386539951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59800b02b0 msgr2=0x7f59800b4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:15.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.020+0000 7f598499f640 1 --2- 172.21.15.123:0/3386539951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59800b02b0 0x7f59800b4920 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f597000d5f0 tx=0x7f597000dab0 comp rx=0 tx=0).stop 2024-09-15T23:20:15.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.020+0000 7f598499f640 1 -- 172.21.15.123:0/3386539951 shutdown_connections 2024-09-15T23:20:15.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.020+0000 7f598499f640 1 --2- 172.21.15.123:0/3386539951 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f598015c4b0 0x7f59800ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:15.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.020+0000 7f598499f640 1 --2- 172.21.15.123:0/3386539951 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f59800d08e0 0x7f5980149050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:15.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.020+0000 7f598499f640 1 --2- 172.21.15.123:0/3386539951 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f596006c2b0 0x7f596006e770 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:15.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.020+0000 7f598499f640 1 --2- 172.21.15.123:0/3386539951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59800b02b0 0x7f59800b4920 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:15.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.020+0000 7f598499f640 1 -- 172.21.15.123:0/3386539951 >> 172.21.15.123:0/3386539951 conn(0x7f59800b0a80 msgr2=0x7f59800b1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:15.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.020+0000 7f598499f640 1 -- 172.21.15.123:0/3386539951 shutdown_connections 2024-09-15T23:20:15.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.020+0000 7f598499f640 1 -- 172.21.15.123:0/3386539951 wait complete. 2024-09-15T23:20:15.033 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2024-09-15T23:20:15.033 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:20:15.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.128+0000 7f9fdfea6640 1 Processor -- start 2024-09-15T23:20:15.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.128+0000 7f9fdfea6640 1 -- start start 2024-09-15T23:20:15.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.129+0000 7f9fdfea6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9fd8073890 0x7f9fd80b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:15.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.129+0000 7f9fdfea6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9fd80b5880 0x7f9fd80b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:15.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.129+0000 7f9fdfea6640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fd80b4020 con 0x7f9fd8145ed0 2024-09-15T23:20:15.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.129+0000 7f9fdfea6640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f9fd80b42c0 con 0x7f9fd8073890 2024-09-15T23:20:15.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.129+0000 7f9fdfea6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9fd80b45a0 con 0x7f9fd80b5880 2024-09-15T23:20:15.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.129+0000 7f9fdd441640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9fd8073890 0x7f9fd80b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:15.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.129+0000 7f9fdd441640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9fd8073890 0x7f9fd80b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42998/0 (socket says 172.21.15.123:42998) 2024-09-15T23:20:15.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.129+0000 7f9fdd441640 1 -- 172.21.15.123:0/3329048237 learned_addr learned my addr 172.21.15.123:0/3329048237 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:15.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.129+0000 7f9fde443640 1 --2- 172.21.15.123:0/3329048237 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9fd80b5880 0x7f9fd80b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:15.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.129+0000 7f9fdd441640 1 -- 172.21.15.123:0/3329048237 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9fd80b5880 msgr2=0x7f9fd80b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:15.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.129+0000 7f9fdd441640 1 --2- 172.21.15.123:0/3329048237 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9fd80b5880 0x7f9fd80b5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:15.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.129+0000 7f9fdd441640 1 -- 172.21.15.123:0/3329048237 >> v1:172.21.15.188:6789/0 conn(0x7f9fd8145ed0 legacy=0x7f9fd8073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:15.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.129+0000 7f9fdd441640 1 -- 172.21.15.123:0/3329048237 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd80b4880 con 0x7f9fd8073890 2024-09-15T23:20:15.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.130+0000 7f9fdd441640 1 --2- 172.21.15.123:0/3329048237 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fd8073890 0x7f9fd80b5080 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc009870 tx=0x7f9fcc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e28e394e44733512 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:15.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.130+0000 7f9fdcc40640 1 -- 172.21.15.123:0/3329048237 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc037070 con 0x7f9fd8073890 2024-09-15T23:20:15.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.130+0000 7f9fdcc40640 1 -- 172.21.15.123:0/3329048237 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fcc032440 con 0x7f9fd8073890 2024-09-15T23:20:15.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.130+0000 7f9fdcc40640 1 -- 172.21.15.123:0/3329048237 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc032810 con 0x7f9fd8073890 2024-09-15T23:20:15.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.131+0000 7f9fdfea6640 1 -- 172.21.15.123:0/3329048237 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fd8073890 msgr2=0x7f9fd80b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:15.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.131+0000 7f9fdfea6640 1 --2- 172.21.15.123:0/3329048237 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fd8073890 0x7f9fd80b5080 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc009870 tx=0x7f9fcc02a270 comp rx=0 tx=0).stop 2024-09-15T23:20:15.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.131+0000 7f9fdfea6640 1 -- 172.21.15.123:0/3329048237 shutdown_connections 2024-09-15T23:20:15.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.131+0000 7f9fdfea6640 1 --2- 172.21.15.123:0/3329048237 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fd8073890 0x7f9fd80b5080 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:15.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.131+0000 7f9fdfea6640 1 --2- 172.21.15.123:0/3329048237 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9fd80b5880 0x7f9fd80b5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:15.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.131+0000 7f9fdfea6640 1 -- 172.21.15.123:0/3329048237 >> 172.21.15.123:0/3329048237 conn(0x7f9fd80ccec0 msgr2=0x7f9fd80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:15.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.131+0000 7f9fdfea6640 1 -- 172.21.15.123:0/3329048237 shutdown_connections 2024-09-15T23:20:15.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.131+0000 7f9fdfea6640 1 -- 172.21.15.123:0/3329048237 wait complete. 2024-09-15T23:20:15.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.132+0000 7f9fdfea6640 1 Processor -- start 2024-09-15T23:20:15.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.132+0000 7f9fdfea6640 1 -- start start 2024-09-15T23:20:15.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.133+0000 7f9fdfea6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9fd8073890 0x7f9fd81400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:15.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.133+0000 7f9fdfea6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9fd80b5880 0x7f9fd81576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:15.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.133+0000 7f9fdfea6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fd8145ed0 0x7f9fd8141db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:15.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.133+0000 7f9fdfea6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd80b6270 con 0x7f9fd8145ed0 2024-09-15T23:20:15.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.133+0000 7f9fdfea6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd81462b0 con 0x7f9fd80b5880 2024-09-15T23:20:15.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.133+0000 7f9fdfea6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9fd813f010 con 0x7f9fd8073890 2024-09-15T23:20:15.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.133+0000 7f9fde443640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fd8145ed0 0x7f9fd8141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:15.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.133+0000 7f9fde443640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fd8145ed0 0x7f9fd8141db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43006/0 (socket says 172.21.15.123:43006) 2024-09-15T23:20:15.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.133+0000 7f9fde443640 1 -- 172.21.15.123:0/450932249 learned_addr learned my addr 172.21.15.123:0/450932249 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:15.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.133+0000 7f9fddc42640 1 --2- 172.21.15.123:0/450932249 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9fd8073890 0x7f9fd81400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:15.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.133+0000 7f9fdd441640 1 --2- 172.21.15.123:0/450932249 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9fd80b5880 0x7f9fd81576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:15.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.133+0000 7f9fde443640 1 -- 172.21.15.123:0/450932249 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9fd8073890 msgr2=0x7f9fd81400b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:15.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.133+0000 7f9fde443640 1 --2- 172.21.15.123:0/450932249 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9fd8073890 0x7f9fd81400b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:15.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.133+0000 7f9fde443640 1 -- 172.21.15.123:0/450932249 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9fd80b5880 msgr2=0x7f9fd81576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:15.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.133+0000 7f9fde443640 1 --2- 172.21.15.123:0/450932249 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9fd80b5880 0x7f9fd81576a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:15.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.133+0000 7f9fde443640 1 -- 172.21.15.123:0/450932249 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd813f2f0 con 0x7f9fd8145ed0 2024-09-15T23:20:15.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.134+0000 7f9fde443640 1 --2- 172.21.15.123:0/450932249 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fd8145ed0 0x7f9fd8141db0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f9fd000e960 tx=0x7f9fd000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:15.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.134+0000 7f9fd67fc640 1 -- 172.21.15.123:0/450932249 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0017070 con 0x7f9fd8145ed0 2024-09-15T23:20:15.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.134+0000 7f9fd67fc640 1 -- 172.21.15.123:0/450932249 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fd000c980 con 0x7f9fd8145ed0 2024-09-15T23:20:15.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.134+0000 7f9fdfea6640 1 -- 172.21.15.123:0/450932249 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fd813f5d0 con 0x7f9fd8145ed0 2024-09-15T23:20:15.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.134+0000 7f9fd67fc640 1 -- 172.21.15.123:0/450932249 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fd000cd70 con 0x7f9fd8145ed0 2024-09-15T23:20:15.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.134+0000 7f9fdfea6640 1 -- 172.21.15.123:0/450932249 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fd813d220 con 0x7f9fd8145ed0 2024-09-15T23:20:15.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.135+0000 7f9fdfea6640 1 -- 172.21.15.123:0/450932249 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fd813f9c0 con 0x7f9fd8145ed0 2024-09-15T23:20:15.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.135+0000 7f9fd67fc640 1 -- 172.21.15.123:0/450932249 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9fd001a070 con 0x7f9fd8145ed0 2024-09-15T23:20:15.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.136+0000 7f9fd67fc640 1 --2- 172.21.15.123:0/450932249 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9fc406c2b0 0x7f9fc406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:15.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.136+0000 7f9fd67fc640 1 -- 172.21.15.123:0/450932249 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f9fd008b710 con 0x7f9fd8145ed0 2024-09-15T23:20:15.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.136+0000 7f9fddc42640 1 --2- 172.21.15.123:0/450932249 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9fc406c2b0 0x7f9fc406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:15.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.136+0000 7f9fddc42640 1 --2- 172.21.15.123:0/450932249 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9fc406c2b0 0x7f9fc406e770 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f9fc80012e0 tx=0x7f9fc8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:15.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.140+0000 7f9fd67fc640 1 -- 172.21.15.123:0/450932249 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9fd0059830 con 0x7f9fd8145ed0 2024-09-15T23:20:15.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.367+0000 7f9fdfea6640 1 -- 172.21.15.123:0/450932249 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f9fd813f7a0 con 0x7f9fd8145ed0 2024-09-15T23:20:15.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.368+0000 7f9fd67fc640 1 -- 172.21.15.123:0/450932249 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1611 (secure 0 0 0) 0x7f9fd005db30 con 0x7f9fd8145ed0 2024-09-15T23:20:15.370 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:15.370 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":505,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":142,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076566731,"bytes_used":2537865216,"bytes_avail":770556248064,"bytes_total":773094113280,"write_bytes_sec":511,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":86,"btime":"2024-09-15T23:19:37:619526+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"d","status":"up:active","gid":8439}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-09-15T23:20:13.618142+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T23:20:15.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.370+0000 7f9fdfea6640 1 -- 172.21.15.123:0/450932249 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9fc406c2b0 msgr2=0x7f9fc406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:15.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.370+0000 7f9fdfea6640 1 --2- 172.21.15.123:0/450932249 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9fc406c2b0 0x7f9fc406e770 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f9fc80012e0 tx=0x7f9fc8009040 comp rx=0 tx=0).stop 2024-09-15T23:20:15.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.370+0000 7f9fdfea6640 1 -- 172.21.15.123:0/450932249 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fd8145ed0 msgr2=0x7f9fd8141db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:15.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.370+0000 7f9fdfea6640 1 --2- 172.21.15.123:0/450932249 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fd8145ed0 0x7f9fd8141db0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f9fd000e960 tx=0x7f9fd000ee20 comp rx=0 tx=0).stop 2024-09-15T23:20:15.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.370+0000 7f9fdfea6640 1 -- 172.21.15.123:0/450932249 shutdown_connections 2024-09-15T23:20:15.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.370+0000 7f9fdfea6640 1 --2- 172.21.15.123:0/450932249 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9fc406c2b0 0x7f9fc406e770 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:15.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.370+0000 7f9fdfea6640 1 --2- 172.21.15.123:0/450932249 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fd8145ed0 0x7f9fd8141db0 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:15.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.370+0000 7f9fdfea6640 1 --2- 172.21.15.123:0/450932249 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9fd80b5880 0x7f9fd81576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:15.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.370+0000 7f9fdfea6640 1 --2- 172.21.15.123:0/450932249 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9fd8073890 0x7f9fd81400b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:15.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.370+0000 7f9fdfea6640 1 -- 172.21.15.123:0/450932249 >> 172.21.15.123:0/450932249 conn(0x7f9fd80ccec0 msgr2=0x7f9fd8073180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:15.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.370+0000 7f9fdfea6640 1 -- 172.21.15.123:0/450932249 shutdown_connections 2024-09-15T23:20:15.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.370+0000 7f9fdfea6640 1 -- 172.21.15.123:0/450932249 wait complete. 2024-09-15T23:20:15.382 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-15T23:20:15.383 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:20:15.383 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:20:15.423 DEBUG:teuthology.orchestra.run.smithi188:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:20:15.468 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:20:15.469 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:20:15.469 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:20:15.469 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:20:15.485 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:20:15.485 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:20:15.541 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:20:15.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.681+0000 7f9305a2e640 1 Processor -- start 2024-09-15T23:20:15.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.681+0000 7f9305a2e640 1 -- start start 2024-09-15T23:20:15.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.682+0000 7f9305a2e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f930015e6d0 0x7f9300071390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:15.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.682+0000 7f9305a2e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f930006cd20 0x7f93000b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:15.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.682+0000 7f9305a2e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9300070b80 0x7f93000b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:15.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.682+0000 7f9305a2e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f93000b77e0 con 0x7f930006cd20 2024-09-15T23:20:15.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.682+0000 7f9305a2e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f930015eab0 con 0x7f930015e6d0 2024-09-15T23:20:15.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.682+0000 7f9305a2e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f930015ed70 con 0x7f9300070b80 2024-09-15T23:20:15.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.682+0000 7f92fe7fc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f930006cd20 0x7f93000b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:15.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.682+0000 7f92fe7fc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f930006cd20 0x7f93000b6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43020/0 (socket says 172.21.15.123:43020) 2024-09-15T23:20:15.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.682+0000 7f92fe7fc640 1 -- 172.21.15.123:0/2227905570 learned_addr learned my addr 172.21.15.123:0/2227905570 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:15.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.682+0000 7f92feffd640 1 --2- 172.21.15.123:0/2227905570 >> v2:172.21.15.188:3300/0 conn(0x7f930015e6d0 0x7f9300071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:15.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.682+0000 7f92ff7fe640 1 --2- 172.21.15.123:0/2227905570 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9300070b80 0x7f93000b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:15.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.682+0000 7f92fe7fc640 1 -- 172.21.15.123:0/2227905570 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9300070b80 msgr2=0x7f93000b72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:15.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.682+0000 7f92fe7fc640 1 --2- 172.21.15.123:0/2227905570 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9300070b80 0x7f93000b72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:15.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.682+0000 7f92fe7fc640 1 -- 172.21.15.123:0/2227905570 >> v2:172.21.15.188:3300/0 conn(0x7f930015e6d0 msgr2=0x7f9300071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:15.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.682+0000 7f92fe7fc640 1 --2- 172.21.15.123:0/2227905570 >> v2:172.21.15.188:3300/0 conn(0x7f930015e6d0 0x7f9300071390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:15.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.682+0000 7f92fe7fc640 1 -- 172.21.15.123:0/2227905570 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f930015f050 con 0x7f930006cd20 2024-09-15T23:20:15.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.683+0000 7f92fe7fc640 1 --2- 172.21.15.123:0/2227905570 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f930006cd20 0x7f93000b6d60 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f930006fb10 tx=0x7f92f402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57b0321082911d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:15.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.683+0000 7f92fdffb640 1 -- 172.21.15.123:0/2227905570 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f4037070 con 0x7f930006cd20 2024-09-15T23:20:15.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.683+0000 7f92fdffb640 1 -- 172.21.15.123:0/2227905570 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92f4032440 con 0x7f930006cd20 2024-09-15T23:20:15.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.683+0000 7f92fdffb640 1 -- 172.21.15.123:0/2227905570 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f4032810 con 0x7f930006cd20 2024-09-15T23:20:15.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.684+0000 7f9305a2e640 1 -- 172.21.15.123:0/2227905570 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f930006cd20 msgr2=0x7f93000b6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:15.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.684+0000 7f9305a2e640 1 --2- 172.21.15.123:0/2227905570 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f930006cd20 0x7f93000b6d60 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f930006fb10 tx=0x7f92f402a1e0 comp rx=0 tx=0).stop 2024-09-15T23:20:15.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.684+0000 7f9305a2e640 1 -- 172.21.15.123:0/2227905570 shutdown_connections 2024-09-15T23:20:15.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.684+0000 7f9305a2e640 1 --2- 172.21.15.123:0/2227905570 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9300070b80 0x7f93000b72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:15.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.684+0000 7f9305a2e640 1 --2- 172.21.15.123:0/2227905570 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f930006cd20 0x7f93000b6d60 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:15.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.684+0000 7f9305a2e640 1 --2- 172.21.15.123:0/2227905570 >> v2:172.21.15.188:3300/0 conn(0x7f930015e6d0 0x7f9300071390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:15.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.684+0000 7f9305a2e640 1 -- 172.21.15.123:0/2227905570 >> 172.21.15.123:0/2227905570 conn(0x7f9300067fb0 msgr2=0x7f930006f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:15.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.684+0000 7f9305a2e640 1 -- 172.21.15.123:0/2227905570 shutdown_connections 2024-09-15T23:20:15.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.684+0000 7f9305a2e640 1 -- 172.21.15.123:0/2227905570 wait complete. 2024-09-15T23:20:15.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.685+0000 7f9305a2e640 1 Processor -- start 2024-09-15T23:20:15.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.685+0000 7f9305a2e640 1 -- start start 2024-09-15T23:20:15.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.686+0000 7f9305a2e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f930006cd20 0x7f930014a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:15.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.686+0000 7f9305a2e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9300070b80 0x7f930014f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:15.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.686+0000 7f9305a2e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f930015e6d0 0x7f930014fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:15.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.686+0000 7f9305a2e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f930015f8f0 con 0x7f930006cd20 2024-09-15T23:20:15.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.686+0000 7f9305a2e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f930015f610 con 0x7f9300070b80 2024-09-15T23:20:15.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.686+0000 7f9305a2e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f93000718d0 con 0x7f930015e6d0 2024-09-15T23:20:15.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.686+0000 7f92feffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f930006cd20 0x7f930014a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:15.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.686+0000 7f92feffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f930006cd20 0x7f930014a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43030/0 (socket says 172.21.15.123:43030) 2024-09-15T23:20:15.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.686+0000 7f92feffd640 1 -- 172.21.15.123:0/31597068 learned_addr learned my addr 172.21.15.123:0/31597068 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:15.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.686+0000 7f92fe7fc640 1 --2- 172.21.15.123:0/31597068 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9300070b80 0x7f930014f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:15.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.686+0000 7f92ff7fe640 1 --2- 172.21.15.123:0/31597068 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f930015e6d0 0x7f930014fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:15.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.686+0000 7f92feffd640 1 -- 172.21.15.123:0/31597068 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f930015e6d0 msgr2=0x7f930014fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:15.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.686+0000 7f92feffd640 1 --2- 172.21.15.123:0/31597068 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f930015e6d0 0x7f930014fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:15.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.686+0000 7f92feffd640 1 -- 172.21.15.123:0/31597068 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9300070b80 msgr2=0x7f930014f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:15.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.686+0000 7f92feffd640 1 --2- 172.21.15.123:0/31597068 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9300070b80 0x7f930014f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:15.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.686+0000 7f92feffd640 1 -- 172.21.15.123:0/31597068 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f930014c780 con 0x7f930006cd20 2024-09-15T23:20:15.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.686+0000 7f92feffd640 1 --2- 172.21.15.123:0/31597068 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f930006cd20 0x7f930014a1b0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f92f000efc0 tx=0x7f92f000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:15.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.686+0000 7f92e7fff640 1 -- 172.21.15.123:0/31597068 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f0018020 con 0x7f930006cd20 2024-09-15T23:20:15.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.686+0000 7f92e7fff640 1 -- 172.21.15.123:0/31597068 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92f0014480 con 0x7f930006cd20 2024-09-15T23:20:15.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.686+0000 7f9305a2e640 1 -- 172.21.15.123:0/31597068 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f930014a6f0 con 0x7f930006cd20 2024-09-15T23:20:15.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.686+0000 7f92e7fff640 1 -- 172.21.15.123:0/31597068 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f0014850 con 0x7f930006cd20 2024-09-15T23:20:15.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.686+0000 7f9305a2e640 1 -- 172.21.15.123:0/31597068 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f930014bee0 con 0x7f930006cd20 2024-09-15T23:20:15.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.687+0000 7f9305a2e640 1 -- 172.21.15.123:0/31597068 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93000b7270 con 0x7f930006cd20 2024-09-15T23:20:15.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.688+0000 7f92e7fff640 1 -- 172.21.15.123:0/31597068 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f92f0005d10 con 0x7f930006cd20 2024-09-15T23:20:15.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.689+0000 7f92e7fff640 1 --2- 172.21.15.123:0/31597068 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f92ec06c2b0 0x7f92ec06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:15.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.689+0000 7f92e7fff640 1 -- 172.21.15.123:0/31597068 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f92f008be90 con 0x7f930006cd20 2024-09-15T23:20:15.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.689+0000 7f92fe7fc640 1 --2- 172.21.15.123:0/31597068 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f92ec06c2b0 0x7f92ec06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:15.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.689+0000 7f92fe7fc640 1 --2- 172.21.15.123:0/31597068 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f92ec06c2b0 0x7f92ec06e770 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f92f4034000 tx=0x7f92f402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:15.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.693+0000 7f92e7fff640 1 -- 172.21.15.123:0/31597068 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f93000b7270 con 0x7f930006cd20 2024-09-15T23:20:15.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.870+0000 7f9305a2e640 1 -- 172.21.15.123:0/31597068 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9300071390 con 0x7f930006cd20 2024-09-15T23:20:15.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.870+0000 7f92e7fff640 1 -- 172.21.15.123:0/31597068 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v142) ==== 80+0+0 (secure 0 0 0) 0x7f92f0022070 con 0x7f930006cd20 2024-09-15T23:20:15.872 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-15T23:20:15.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.872+0000 7f9305a2e640 1 -- 172.21.15.123:0/31597068 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f92ec06c2b0 msgr2=0x7f92ec06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:15.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.872+0000 7f9305a2e640 1 --2- 172.21.15.123:0/31597068 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f92ec06c2b0 0x7f92ec06e770 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f92f4034000 tx=0x7f92f402e000 comp rx=0 tx=0).stop 2024-09-15T23:20:15.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.872+0000 7f9305a2e640 1 -- 172.21.15.123:0/31597068 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f930006cd20 msgr2=0x7f930014a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:15.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.872+0000 7f9305a2e640 1 --2- 172.21.15.123:0/31597068 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f930006cd20 0x7f930014a1b0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f92f000efc0 tx=0x7f92f000c490 comp rx=0 tx=0).stop 2024-09-15T23:20:15.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.872+0000 7f9305a2e640 1 -- 172.21.15.123:0/31597068 shutdown_connections 2024-09-15T23:20:15.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.872+0000 7f9305a2e640 1 --2- 172.21.15.123:0/31597068 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f930015e6d0 0x7f930014fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:15.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.872+0000 7f9305a2e640 1 --2- 172.21.15.123:0/31597068 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9300070b80 0x7f930014f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:15.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.872+0000 7f9305a2e640 1 --2- 172.21.15.123:0/31597068 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f92ec06c2b0 0x7f92ec06e770 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:15.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.872+0000 7f9305a2e640 1 --2- 172.21.15.123:0/31597068 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f930006cd20 0x7f930014a1b0 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:15.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.872+0000 7f9305a2e640 1 -- 172.21.15.123:0/31597068 >> 172.21.15.123:0/31597068 conn(0x7f9300067fb0 msgr2=0x7f930015fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:15.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.872+0000 7f9305a2e640 1 -- 172.21.15.123:0/31597068 shutdown_connections 2024-09-15T23:20:15.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:15.872+0000 7f9305a2e640 1 -- 172.21.15.123:0/31597068 wait complete. 2024-09-15T23:20:15.885 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-15T23:20:15.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:20:15.885 DEBUG:teuthology.orchestra.run.smithi123:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-15T23:20:16.562 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-09-15T23:20:16.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:20:16.562 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T23:20:16.580 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:20:16.581 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:20:16.581 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:20:16.597 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:20:16.597 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:20:16.597 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:20:16.597 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:20:16.636 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:20:16.637 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:20:16.637 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:20:16.637 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:20:16.653 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:20:16.653 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:20:16.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.774+0000 7f0fc365e640 1 Processor -- start 2024-09-15T23:20:16.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.774+0000 7f0fc365e640 1 -- start start 2024-09-15T23:20:16.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.775+0000 7f0fc365e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0fbc15ab40 0x7f0fbc06c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:16.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.775+0000 7f0fc365e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f0fbc0720b0 0x7f0fbc073990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:16.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.775+0000 7f0fc365e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fbc0724f0 con 0x7f0fbc15af20 2024-09-15T23:20:16.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.775+0000 7f0fc365e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f0fbc071010 con 0x7f0fbc0720b0 2024-09-15T23:20:16.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.775+0000 7f0fc365e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0fbc0712f0 con 0x7f0fbc15ab40 2024-09-15T23:20:16.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.775+0000 7f0fc1bfb640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f0fbc15af20 0x7f0fbc15b370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59558/0 (socket says 172.21.15.123:59558) 2024-09-15T23:20:16.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.775+0000 7f0fc1bfb640 1 -- 172.21.15.123:0/1631825836 learned_addr learned my addr 172.21.15.123:0/1631825836 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:16.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.775+0000 7f0fb3fff640 1 -- 172.21.15.123:0/1631825836 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1267209107 0 0) 0x7f0fbc0724f0 con 0x7f0fbc15af20 2024-09-15T23:20:16.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.775+0000 7f0fb3fff640 1 -- 172.21.15.123:0/1631825836 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fa8003520 con 0x7f0fbc15af20 2024-09-15T23:20:16.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.775+0000 7f0fc0bf9640 1 --2- 172.21.15.123:0/1631825836 >> v2:172.21.15.188:3300/0 conn(0x7f0fbc0720b0 0x7f0fbc073990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:16.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.775+0000 7f0fc13fa640 1 --2- 172.21.15.123:0/1631825836 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0fbc15ab40 0x7f0fbc06c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:16.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.775+0000 7f0fb3fff640 1 -- 172.21.15.123:0/1631825836 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 829991491 0 0) 0x7f0fa8003520 con 0x7f0fbc15af20 2024-09-15T23:20:16.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.775+0000 7f0fb3fff640 1 -- 172.21.15.123:0/1631825836 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0fbc15ab40 msgr2=0x7f0fbc06c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:16.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.775+0000 7f0fb3fff640 1 --2- 172.21.15.123:0/1631825836 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0fbc15ab40 0x7f0fbc06c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:16.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.775+0000 7f0fb3fff640 1 -- 172.21.15.123:0/1631825836 >> v2:172.21.15.188:3300/0 conn(0x7f0fbc0720b0 msgr2=0x7f0fbc073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:16.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.775+0000 7f0fb3fff640 1 --2- 172.21.15.123:0/1631825836 >> v2:172.21.15.188:3300/0 conn(0x7f0fbc0720b0 0x7f0fbc073990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:16.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.775+0000 7f0fb3fff640 1 -- 172.21.15.123:0/1631825836 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fbc0715d0 con 0x7f0fbc15af20 2024-09-15T23:20:16.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.775+0000 7f0fb3fff640 1 -- 172.21.15.123:0/1631825836 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f0fb40019f0 con 0x7f0fbc15af20 2024-09-15T23:20:16.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.775+0000 7f0fb3fff640 1 -- 172.21.15.123:0/1631825836 >> v1:172.21.15.123:6789/0 conn(0x7f0fbc15af20 legacy=0x7f0fbc15b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:16.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.775+0000 7f0fb3fff640 1 --2- 172.21.15.123:0/1631825836 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0fa80039b0 0x7f0fa8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:16.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.775+0000 7f0fb3fff640 1 --2- 172.21.15.123:0/1631825836 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0fa8004800 0x7f0fa8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:16.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.776+0000 7f0fb3fff640 1 --2- 172.21.15.123:0/1631825836 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0fbc15ab40 0x7f0fa80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:16.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.776+0000 7f0fb3fff640 1 -- 172.21.15.123:0/1631825836 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc071010 con 0x7f0fa80039b0 2024-09-15T23:20:16.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.776+0000 7f0fb3fff640 1 -- 172.21.15.123:0/1631825836 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc0712f0 con 0x7f0fa8004800 2024-09-15T23:20:16.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.776+0000 7f0fb3fff640 1 -- 172.21.15.123:0/1631825836 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0fa800ba70 con 0x7f0fbc15ab40 2024-09-15T23:20:16.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.776+0000 7f0fc13fa640 1 --2- 172.21.15.123:0/1631825836 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0fa80039b0 0x7f0fa8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:16.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.776+0000 7f0fc0bf9640 1 --2- 172.21.15.123:0/1631825836 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0fa8004800 0x7f0fa8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:16.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.776+0000 7f0fc1bfb640 1 --2- 172.21.15.123:0/1631825836 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0fbc15ab40 0x7f0fa80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:16.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.776+0000 7f0fc13fa640 1 -- 172.21.15.123:0/1631825836 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0fbc15ab40 msgr2=0x7f0fa80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:16.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.776+0000 7f0fc13fa640 1 --2- 172.21.15.123:0/1631825836 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0fbc15ab40 0x7f0fa80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:16.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.776+0000 7f0fc13fa640 1 -- 172.21.15.123:0/1631825836 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0fa8004800 msgr2=0x7f0fa8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:16.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.776+0000 7f0fc13fa640 1 --2- 172.21.15.123:0/1631825836 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0fa8004800 0x7f0fa8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:16.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.776+0000 7f0fc13fa640 1 -- 172.21.15.123:0/1631825836 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa8003520 con 0x7f0fa80039b0 2024-09-15T23:20:16.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.776+0000 7f0fc0bf9640 1 --2- 172.21.15.123:0/1631825836 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0fa8004800 0x7f0fa8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:20:16.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.777+0000 7f0fc13fa640 1 --2- 172.21.15.123:0/1631825836 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0fa80039b0 0x7f0fa8003dd0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f0fb800ba00 tx=0x7f0fa8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb563e21a8bcddb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:16.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.777+0000 7f0fb3fff640 1 -- 172.21.15.123:0/1631825836 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb8030070 con 0x7f0fa80039b0 2024-09-15T23:20:16.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.777+0000 7f0fb3fff640 1 -- 172.21.15.123:0/1631825836 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fb802acc0 con 0x7f0fa80039b0 2024-09-15T23:20:16.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.777+0000 7f0fb3fff640 1 -- 172.21.15.123:0/1631825836 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb800b600 con 0x7f0fa80039b0 2024-09-15T23:20:16.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.777+0000 7f0fc365e640 1 -- 172.21.15.123:0/1631825836 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0fa80039b0 msgr2=0x7f0fa8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:16.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.777+0000 7f0fc365e640 1 --2- 172.21.15.123:0/1631825836 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0fa80039b0 0x7f0fa8003dd0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f0fb800ba00 tx=0x7f0fa8005830 comp rx=0 tx=0).stop 2024-09-15T23:20:16.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.777+0000 7f0fc1bfb640 1 -- 172.21.15.123:0/1631825836 reap_dead start 2024-09-15T23:20:16.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.777+0000 7f0fc365e640 1 -- 172.21.15.123:0/1631825836 shutdown_connections 2024-09-15T23:20:16.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.777+0000 7f0fc365e640 1 -- 172.21.15.123:0/1631825836 >> 172.21.15.123:0/1631825836 conn(0x7f0fbc0ccec0 msgr2=0x7f0fbc0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:16.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.777+0000 7f0fc365e640 1 -- 172.21.15.123:0/1631825836 shutdown_connections 2024-09-15T23:20:16.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.777+0000 7f0fc365e640 1 -- 172.21.15.123:0/1631825836 wait complete. 2024-09-15T23:20:16.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.779+0000 7f0fc365e640 1 Processor -- start 2024-09-15T23:20:16.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.779+0000 7f0fc365e640 1 -- start start 2024-09-15T23:20:16.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.779+0000 7f0fc365e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0fa80039b0 0x7f0fbc14d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:16.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.779+0000 7f0fc365e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0fbc14e0c0 0x7f0fbc156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:16.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.779+0000 7f0fc365e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0fbc158790 0x7f0fbc158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:16.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.779+0000 7f0fc365e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc073ed0 con 0x7f0fbc158790 2024-09-15T23:20:16.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.779+0000 7f0fc365e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc15ba80 con 0x7f0fbc14e0c0 2024-09-15T23:20:16.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.779+0000 7f0fc365e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0fbc06c6a0 con 0x7f0fa80039b0 2024-09-15T23:20:16.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.779+0000 7f0fc1bfb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0fbc158790 0x7f0fbc158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:16.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.779+0000 7f0fc1bfb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0fbc158790 0x7f0fbc158c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60506/0 (socket says 172.21.15.123:60506) 2024-09-15T23:20:16.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.779+0000 7f0fc1bfb640 1 -- 172.21.15.123:0/3559560299 learned_addr learned my addr 172.21.15.123:0/3559560299 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:16.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.780+0000 7f0fc1bfb640 1 -- 172.21.15.123:0/3559560299 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0fa80039b0 msgr2=0x7f0fbc14d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:16.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.780+0000 7f0fc1bfb640 1 --2- 172.21.15.123:0/3559560299 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0fa80039b0 0x7f0fbc14d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:16.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.780+0000 7f0fc0bf9640 1 --2- 172.21.15.123:0/3559560299 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0fbc14e0c0 0x7f0fbc156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:16.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.780+0000 7f0fc1bfb640 1 -- 172.21.15.123:0/3559560299 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0fbc14e0c0 msgr2=0x7f0fbc156260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:16.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.780+0000 7f0fc1bfb640 1 --2- 172.21.15.123:0/3559560299 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0fbc14e0c0 0x7f0fbc156260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:16.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.780+0000 7f0fc1bfb640 1 -- 172.21.15.123:0/3559560299 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fbc156c70 con 0x7f0fbc158790 2024-09-15T23:20:16.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.780+0000 7f0fc0bf9640 1 --2- 172.21.15.123:0/3559560299 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0fbc14e0c0 0x7f0fbc156260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:20:16.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.780+0000 7f0fc1bfb640 1 --2- 172.21.15.123:0/3559560299 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0fbc158790 0x7f0fbc158c40 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc15b300 tx=0x7f0fb4007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:16.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.780+0000 7f0fb1ffb640 1 -- 172.21.15.123:0/3559560299 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fac009690 con 0x7f0fbc158790 2024-09-15T23:20:16.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.780+0000 7f0fb1ffb640 1 -- 172.21.15.123:0/3559560299 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fb4019070 con 0x7f0fbc158790 2024-09-15T23:20:16.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.780+0000 7f0fc365e640 1 -- 172.21.15.123:0/3559560299 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fbc156f50 con 0x7f0fbc158790 2024-09-15T23:20:16.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.780+0000 7f0fb1ffb640 1 -- 172.21.15.123:0/3559560299 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb400ada0 con 0x7f0fbc158790 2024-09-15T23:20:16.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.780+0000 7f0fc365e640 1 -- 172.21.15.123:0/3559560299 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fbc0b5090 con 0x7f0fbc158790 2024-09-15T23:20:16.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.781+0000 7f0fc365e640 1 -- 172.21.15.123:0/3559560299 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fbc0b5290 con 0x7f0fbc158790 2024-09-15T23:20:16.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.782+0000 7f0fb1ffb640 1 -- 172.21.15.123:0/3559560299 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0fb401e460 con 0x7f0fbc158790 2024-09-15T23:20:16.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.782+0000 7f0fb1ffb640 1 --2- 172.21.15.123:0/3559560299 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0fa006c2b0 0x7f0fa006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:16.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.782+0000 7f0fb1ffb640 1 -- 172.21.15.123:0/3559560299 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f0fb408b8d0 con 0x7f0fbc158790 2024-09-15T23:20:16.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.782+0000 7f0fc13fa640 1 --2- 172.21.15.123:0/3559560299 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0fa006c2b0 0x7f0fa006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:16.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.783+0000 7f0fc13fa640 1 --2- 172.21.15.123:0/3559560299 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0fa006c2b0 0x7f0fa006e770 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0fa80057e0 tx=0x7f0fb802c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:16.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.787+0000 7f0fb1ffb640 1 -- 172.21.15.123:0/3559560299 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0fbc0b5290 con 0x7f0fbc158790 2024-09-15T23:20:16.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.985+0000 7f0fc365e640 1 -- 172.21.15.123:0/3559560299 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0fbc073990 con 0x7f0fbc158790 2024-09-15T23:20:16.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.986+0000 7f0fb1ffb640 1 -- 172.21.15.123:0/3559560299 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5237 (secure 0 0 0) 0x7f0fb405a040 con 0x7f0fbc158790 2024-09-15T23:20:16.989 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:16.989 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":86,"btime":"2024-09-15T23:19:37:619526+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2082746470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2082746470},{"type":"v1","addr":"172.21.15.123:6834","nonce":2082746470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8421,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2007610603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":2007610603},{"type":"v1","addr":"172.21.15.123:6835","nonce":2007610603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8436,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2929123975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2929123975},{"type":"v1","addr":"172.21.15.188:6836","nonce":2929123975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:19:34.917419+0000","modified":"2024-09-15T23:19:36.941347+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8439":{"gid":8439,"name":"d","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6837/1222656979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1222656979},{"type":"v1","addr":"172.21.15.188:6837","nonce":1222656979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8439,"qdb_cluster":[8439]},"id":9}]} 2024-09-15T23:20:16.991 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 86 2024-09-15T23:20:16.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.988+0000 7f0fc365e640 1 -- 172.21.15.123:0/3559560299 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0fa006c2b0 msgr2=0x7f0fa006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:16.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.988+0000 7f0fc365e640 1 --2- 172.21.15.123:0/3559560299 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0fa006c2b0 0x7f0fa006e770 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0fa80057e0 tx=0x7f0fb802c000 comp rx=0 tx=0).stop 2024-09-15T23:20:16.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.988+0000 7f0fc365e640 1 -- 172.21.15.123:0/3559560299 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0fbc158790 msgr2=0x7f0fbc158c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:16.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.988+0000 7f0fc365e640 1 --2- 172.21.15.123:0/3559560299 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0fbc158790 0x7f0fbc158c40 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc15b300 tx=0x7f0fb4007a90 comp rx=0 tx=0).stop 2024-09-15T23:20:16.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.988+0000 7f0fc365e640 1 -- 172.21.15.123:0/3559560299 shutdown_connections 2024-09-15T23:20:16.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.988+0000 7f0fc365e640 1 --2- 172.21.15.123:0/3559560299 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0fa006c2b0 0x7f0fa006e770 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:16.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.988+0000 7f0fc365e640 1 --2- 172.21.15.123:0/3559560299 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0fbc158790 0x7f0fbc158c40 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:16.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.988+0000 7f0fc365e640 1 --2- 172.21.15.123:0/3559560299 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0fbc14e0c0 0x7f0fbc156260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:16.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.988+0000 7f0fc365e640 1 --2- 172.21.15.123:0/3559560299 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0fa80039b0 0x7f0fbc14d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:16.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.988+0000 7f0fc365e640 1 -- 172.21.15.123:0/3559560299 >> 172.21.15.123:0/3559560299 conn(0x7f0fbc0ccec0 msgr2=0x7f0fbc0c5c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:16.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.988+0000 7f0fc365e640 1 -- 172.21.15.123:0/3559560299 shutdown_connections 2024-09-15T23:20:16.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:16.988+0000 7f0fc365e640 1 -- 172.21.15.123:0/3559560299 wait complete. 2024-09-15T23:20:17.005 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:20:17.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.101+0000 7fe798e9b640 1 Processor -- start 2024-09-15T23:20:17.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.102+0000 7fe798e9b640 1 -- start start 2024-09-15T23:20:17.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.102+0000 7fe798e9b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe7940b2d40 0x7fe79406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:17.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.102+0000 7fe798e9b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe79413eb20 0x7fe79406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:17.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.102+0000 7fe798e9b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe79415bcf0 0x7fe79415c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:17.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.102+0000 7fe798e9b640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe794071ab0 con 0x7fe79415bcf0 2024-09-15T23:20:17.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.102+0000 7fe798e9b640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fe794071180 con 0x7fe7940b2d40 2024-09-15T23:20:17.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.102+0000 7fe798e9b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe794071460 con 0x7fe79413eb20 2024-09-15T23:20:17.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.103+0000 7fe792d9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe79415bcf0 0x7fe79415c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:17.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.103+0000 7fe792d9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe79415bcf0 0x7fe79415c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60516/0 (socket says 172.21.15.123:60516) 2024-09-15T23:20:17.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.103+0000 7fe792d9d640 1 -- 172.21.15.123:0/3843836838 learned_addr learned my addr 172.21.15.123:0/3843836838 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:17.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.103+0000 7fe791d9b640 1 --2- 172.21.15.123:0/3843836838 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe79413eb20 0x7fe79406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:17.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.103+0000 7fe79259c640 1 --2- 172.21.15.123:0/3843836838 >> v2:172.21.15.188:3300/0 conn(0x7fe7940b2d40 0x7fe79406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:17.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.103+0000 7fe792d9d640 1 -- 172.21.15.123:0/3843836838 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe79413eb20 msgr2=0x7fe79406c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:17.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.103+0000 7fe792d9d640 1 --2- 172.21.15.123:0/3843836838 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe79413eb20 0x7fe79406c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:17.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.103+0000 7fe792d9d640 1 -- 172.21.15.123:0/3843836838 >> v2:172.21.15.188:3300/0 conn(0x7fe7940b2d40 msgr2=0x7fe79406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:17.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.103+0000 7fe792d9d640 1 --2- 172.21.15.123:0/3843836838 >> v2:172.21.15.188:3300/0 conn(0x7fe7940b2d40 0x7fe79406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:17.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.103+0000 7fe792d9d640 1 -- 172.21.15.123:0/3843836838 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe794071740 con 0x7fe79415bcf0 2024-09-15T23:20:17.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.103+0000 7fe79259c640 1 --2- 172.21.15.123:0/3843836838 >> v2:172.21.15.188:3300/0 conn(0x7fe7940b2d40 0x7fe79406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:17.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.104+0000 7fe792d9d640 1 --2- 172.21.15.123:0/3843836838 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe79415bcf0 0x7fe79415c1a0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fe794069be0 tx=0x7fe78c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fda1ad970c9c3c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:17.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.104+0000 7fe79159a640 1 -- 172.21.15.123:0/3843836838 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78c036070 con 0x7fe79415bcf0 2024-09-15T23:20:17.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.104+0000 7fe79159a640 1 -- 172.21.15.123:0/3843836838 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe78c031600 con 0x7fe79415bcf0 2024-09-15T23:20:17.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.104+0000 7fe79159a640 1 -- 172.21.15.123:0/3843836838 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78c0319d0 con 0x7fe79415bcf0 2024-09-15T23:20:17.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.104+0000 7fe798e9b640 1 -- 172.21.15.123:0/3843836838 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe79415bcf0 msgr2=0x7fe79415c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:17.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.104+0000 7fe798e9b640 1 --2- 172.21.15.123:0/3843836838 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe79415bcf0 0x7fe79415c1a0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fe794069be0 tx=0x7fe78c02a6a0 comp rx=0 tx=0).stop 2024-09-15T23:20:17.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.104+0000 7fe798e9b640 1 -- 172.21.15.123:0/3843836838 shutdown_connections 2024-09-15T23:20:17.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.104+0000 7fe798e9b640 1 --2- 172.21.15.123:0/3843836838 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe79415bcf0 0x7fe79415c1a0 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:17.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.104+0000 7fe798e9b640 1 --2- 172.21.15.123:0/3843836838 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe79413eb20 0x7fe79406c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:17.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.104+0000 7fe798e9b640 1 --2- 172.21.15.123:0/3843836838 >> v2:172.21.15.188:3300/0 conn(0x7fe7940b2d40 0x7fe79406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:17.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.104+0000 7fe798e9b640 1 -- 172.21.15.123:0/3843836838 >> 172.21.15.123:0/3843836838 conn(0x7fe7940ccec0 msgr2=0x7fe7940cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:17.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.104+0000 7fe798e9b640 1 -- 172.21.15.123:0/3843836838 shutdown_connections 2024-09-15T23:20:17.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.104+0000 7fe798e9b640 1 -- 172.21.15.123:0/3843836838 wait complete. 2024-09-15T23:20:17.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.106+0000 7fe798e9b640 1 Processor -- start 2024-09-15T23:20:17.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.106+0000 7fe798e9b640 1 -- start start 2024-09-15T23:20:17.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.106+0000 7fe798e9b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe7940b2d40 0x7fe79413d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:17.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.106+0000 7fe798e9b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe79413eb20 0x7fe794129ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:17.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.106+0000 7fe798e9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe79415bcf0 0x7fe79412a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:17.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.106+0000 7fe798e9b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe79415f140 con 0x7fe79415bcf0 2024-09-15T23:20:17.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.106+0000 7fe798e9b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe79415efc0 con 0x7fe79413eb20 2024-09-15T23:20:17.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.107+0000 7fe798e9b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe79415f2c0 con 0x7fe7940b2d40 2024-09-15T23:20:17.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.107+0000 7fe792d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe79415bcf0 0x7fe79412a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:17.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.107+0000 7fe792d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe79415bcf0 0x7fe79412a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60526/0 (socket says 172.21.15.123:60526) 2024-09-15T23:20:17.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.107+0000 7fe792d9d640 1 -- 172.21.15.123:0/2584512951 learned_addr learned my addr 172.21.15.123:0/2584512951 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:17.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.107+0000 7fe79259c640 1 --2- 172.21.15.123:0/2584512951 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe7940b2d40 0x7fe79413d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:17.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.107+0000 7fe791d9b640 1 --2- 172.21.15.123:0/2584512951 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe79413eb20 0x7fe794129ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:17.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.107+0000 7fe792d9d640 1 -- 172.21.15.123:0/2584512951 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe7940b2d40 msgr2=0x7fe79413d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:17.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.107+0000 7fe792d9d640 1 --2- 172.21.15.123:0/2584512951 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe7940b2d40 0x7fe79413d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:17.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.107+0000 7fe792d9d640 1 -- 172.21.15.123:0/2584512951 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe79413eb20 msgr2=0x7fe794129ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:17.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.107+0000 7fe792d9d640 1 --2- 172.21.15.123:0/2584512951 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe79413eb20 0x7fe794129ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:17.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.107+0000 7fe792d9d640 1 -- 172.21.15.123:0/2584512951 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe79412aa70 con 0x7fe79415bcf0 2024-09-15T23:20:17.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.107+0000 7fe792d9d640 1 --2- 172.21.15.123:0/2584512951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe79415bcf0 0x7fe79412a430 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fe78c009f40 tx=0x7fe78c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:17.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.107+0000 7fe78affd640 1 -- 172.21.15.123:0/2584512951 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78c036050 con 0x7fe79415bcf0 2024-09-15T23:20:17.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.107+0000 7fe78affd640 1 -- 172.21.15.123:0/2584512951 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe78c042070 con 0x7fe79415bcf0 2024-09-15T23:20:17.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.107+0000 7fe78affd640 1 -- 172.21.15.123:0/2584512951 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78c009510 con 0x7fe79415bcf0 2024-09-15T23:20:17.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.107+0000 7fe798e9b640 1 -- 172.21.15.123:0/2584512951 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe79412ad50 con 0x7fe79415bcf0 2024-09-15T23:20:17.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.107+0000 7fe798e9b640 1 -- 172.21.15.123:0/2584512951 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe79412b310 con 0x7fe79415bcf0 2024-09-15T23:20:17.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.108+0000 7fe798e9b640 1 -- 172.21.15.123:0/2584512951 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe79406c9c0 con 0x7fe79415bcf0 2024-09-15T23:20:17.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.109+0000 7fe78affd640 1 -- 172.21.15.123:0/2584512951 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe78c007bf0 con 0x7fe79415bcf0 2024-09-15T23:20:17.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.109+0000 7fe78affd640 1 --2- 172.21.15.123:0/2584512951 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe77406c2b0 0x7fe77406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:17.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.109+0000 7fe78affd640 1 -- 172.21.15.123:0/2584512951 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fe78c0ac120 con 0x7fe79415bcf0 2024-09-15T23:20:17.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.109+0000 7fe79259c640 1 --2- 172.21.15.123:0/2584512951 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe77406c2b0 0x7fe77406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:17.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.110+0000 7fe79259c640 1 --2- 172.21.15.123:0/2584512951 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe77406c2b0 0x7fe77406e770 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fe7940b6730 tx=0x7fe77c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:17.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.113+0000 7fe78affd640 1 -- 172.21.15.123:0/2584512951 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe78c07a240 con 0x7fe79415bcf0 2024-09-15T23:20:17.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.312+0000 7fe798e9b640 1 -- 172.21.15.123:0/2584512951 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7940b3570 con 0x7fe79415bcf0 2024-09-15T23:20:17.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.313+0000 7fe78affd640 1 -- 172.21.15.123:0/2584512951 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5237 (secure 0 0 0) 0x7fe78c07e540 con 0x7fe79415bcf0 2024-09-15T23:20:17.315 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:17.315 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":86,"btime":"2024-09-15T23:19:37:619526+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2082746470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2082746470},{"type":"v1","addr":"172.21.15.123:6834","nonce":2082746470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8421,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2007610603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":2007610603},{"type":"v1","addr":"172.21.15.123:6835","nonce":2007610603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8436,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2929123975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2929123975},{"type":"v1","addr":"172.21.15.188:6836","nonce":2929123975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:19:34.917419+0000","modified":"2024-09-15T23:19:36.941347+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8439":{"gid":8439,"name":"d","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6837/1222656979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1222656979},{"type":"v1","addr":"172.21.15.188:6837","nonce":1222656979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8439,"qdb_cluster":[8439]},"id":9}]} 2024-09-15T23:20:17.315 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 86 2024-09-15T23:20:17.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.315+0000 7fe798e9b640 1 -- 172.21.15.123:0/2584512951 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe77406c2b0 msgr2=0x7fe77406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:17.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.315+0000 7fe798e9b640 1 --2- 172.21.15.123:0/2584512951 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe77406c2b0 0x7fe77406e770 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fe7940b6730 tx=0x7fe77c008040 comp rx=0 tx=0).stop 2024-09-15T23:20:17.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.315+0000 7fe798e9b640 1 -- 172.21.15.123:0/2584512951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe79415bcf0 msgr2=0x7fe79412a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:17.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.315+0000 7fe798e9b640 1 --2- 172.21.15.123:0/2584512951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe79415bcf0 0x7fe79412a430 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fe78c009f40 tx=0x7fe78c004a40 comp rx=0 tx=0).stop 2024-09-15T23:20:17.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.315+0000 7fe798e9b640 1 -- 172.21.15.123:0/2584512951 shutdown_connections 2024-09-15T23:20:17.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.315+0000 7fe798e9b640 1 --2- 172.21.15.123:0/2584512951 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe77406c2b0 0x7fe77406e770 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:17.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.315+0000 7fe798e9b640 1 --2- 172.21.15.123:0/2584512951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe79415bcf0 0x7fe79412a430 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:17.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.315+0000 7fe798e9b640 1 --2- 172.21.15.123:0/2584512951 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe79413eb20 0x7fe794129ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:17.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.315+0000 7fe798e9b640 1 --2- 172.21.15.123:0/2584512951 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe7940b2d40 0x7fe79413d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:17.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.315+0000 7fe798e9b640 1 -- 172.21.15.123:0/2584512951 >> 172.21.15.123:0/2584512951 conn(0x7fe7940ccec0 msgr2=0x7fe79415b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:17.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.315+0000 7fe798e9b640 1 -- 172.21.15.123:0/2584512951 shutdown_connections 2024-09-15T23:20:17.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.315+0000 7fe798e9b640 1 -- 172.21.15.123:0/2584512951 wait complete. 2024-09-15T23:20:17.328 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:20:17.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.425+0000 7fe5cbc3c640 1 Processor -- start 2024-09-15T23:20:17.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.425+0000 7fe5cbc3c640 1 -- start start 2024-09-15T23:20:17.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.426+0000 7fe5cbc3c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe5c4073890 0x7fe5c40b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:17.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.426+0000 7fe5cbc3c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe5c40b5880 0x7fe5c40b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:17.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.426+0000 7fe5cbc3c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5c40b4020 con 0x7fe5c4145ed0 2024-09-15T23:20:17.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.426+0000 7fe5cbc3c640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe5c40b42c0 con 0x7fe5c40b5880 2024-09-15T23:20:17.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.426+0000 7fe5cbc3c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fe5c40b45a0 con 0x7fe5c4073890 2024-09-15T23:20:17.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.426+0000 7fe5ca1d9640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe5c40b5880 0x7fe5c40b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:17.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.426+0000 7fe5ca1d9640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe5c40b5880 0x7fe5c40b5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60540/0 (socket says 172.21.15.123:60540) 2024-09-15T23:20:17.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.426+0000 7fe5ca1d9640 1 -- 172.21.15.123:0/3153374764 learned_addr learned my addr 172.21.15.123:0/3153374764 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:17.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.426+0000 7fe5c91d7640 1 --2- 172.21.15.123:0/3153374764 >> v2:172.21.15.188:3300/0 conn(0x7fe5c4073890 0x7fe5c40b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:17.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.426+0000 7fe5ca1d9640 1 -- 172.21.15.123:0/3153374764 >> v2:172.21.15.188:3300/0 conn(0x7fe5c4073890 msgr2=0x7fe5c40b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:17.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.426+0000 7fe5ca1d9640 1 --2- 172.21.15.123:0/3153374764 >> v2:172.21.15.188:3300/0 conn(0x7fe5c4073890 0x7fe5c40b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:17.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.426+0000 7fe5ca1d9640 1 -- 172.21.15.123:0/3153374764 >> v1:172.21.15.188:6789/0 conn(0x7fe5c4145ed0 legacy=0x7fe5c4073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:17.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.426+0000 7fe5ca1d9640 1 -- 172.21.15.123:0/3153374764 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c40b4880 con 0x7fe5c40b5880 2024-09-15T23:20:17.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.427+0000 7fe5ca1d9640 1 --2- 172.21.15.123:0/3153374764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5c40b5880 0x7fe5c40b5ce0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fe5c40d1490 tx=0x7fe5bc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deee525ee50de19f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:17.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.427+0000 7fe5c89d6640 1 -- 172.21.15.123:0/3153374764 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc037070 con 0x7fe5c40b5880 2024-09-15T23:20:17.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.427+0000 7fe5c89d6640 1 -- 172.21.15.123:0/3153374764 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5bc032440 con 0x7fe5c40b5880 2024-09-15T23:20:17.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.427+0000 7fe5c89d6640 1 -- 172.21.15.123:0/3153374764 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc032810 con 0x7fe5c40b5880 2024-09-15T23:20:17.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.427+0000 7fe5cbc3c640 1 -- 172.21.15.123:0/3153374764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5c40b5880 msgr2=0x7fe5c40b5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:17.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.427+0000 7fe5cbc3c640 1 --2- 172.21.15.123:0/3153374764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5c40b5880 0x7fe5c40b5ce0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fe5c40d1490 tx=0x7fe5bc02a270 comp rx=0 tx=0).stop 2024-09-15T23:20:17.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.428+0000 7fe5cbc3c640 1 -- 172.21.15.123:0/3153374764 shutdown_connections 2024-09-15T23:20:17.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.428+0000 7fe5cbc3c640 1 --2- 172.21.15.123:0/3153374764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5c40b5880 0x7fe5c40b5ce0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:17.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.428+0000 7fe5cbc3c640 1 --2- 172.21.15.123:0/3153374764 >> v2:172.21.15.188:3300/0 conn(0x7fe5c4073890 0x7fe5c40b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:17.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.428+0000 7fe5cbc3c640 1 -- 172.21.15.123:0/3153374764 >> 172.21.15.123:0/3153374764 conn(0x7fe5c40ccec0 msgr2=0x7fe5c40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:17.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.428+0000 7fe5cbc3c640 1 -- 172.21.15.123:0/3153374764 shutdown_connections 2024-09-15T23:20:17.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.428+0000 7fe5cbc3c640 1 -- 172.21.15.123:0/3153374764 wait complete. 2024-09-15T23:20:17.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.429+0000 7fe5cbc3c640 1 Processor -- start 2024-09-15T23:20:17.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.429+0000 7fe5cbc3c640 1 -- start start 2024-09-15T23:20:17.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.430+0000 7fe5cbc3c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5c4073890 0x7fe5c4141ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:17.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.430+0000 7fe5cbc3c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5c40b5880 0x7fe5c4156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:17.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.430+0000 7fe5cbc3c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe5c4145ed0 0x7fe5c4153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:17.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.430+0000 7fe5cbc3c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c40b63a0 con 0x7fe5c40b5880 2024-09-15T23:20:17.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.430+0000 7fe5cbc3c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c40b6220 con 0x7fe5c4073890 2024-09-15T23:20:17.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.430+0000 7fe5cbc3c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe5c41462b0 con 0x7fe5c4145ed0 2024-09-15T23:20:17.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.430+0000 7fe5c91d7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5c40b5880 0x7fe5c4156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:17.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.430+0000 7fe5c91d7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5c40b5880 0x7fe5c4156e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60544/0 (socket says 172.21.15.123:60544) 2024-09-15T23:20:17.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.430+0000 7fe5c91d7640 1 -- 172.21.15.123:0/2715857307 learned_addr learned my addr 172.21.15.123:0/2715857307 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:17.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.430+0000 7fe5c99d8640 1 --2- 172.21.15.123:0/2715857307 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5c4073890 0x7fe5c4141ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:17.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.430+0000 7fe5ca1d9640 1 --2- 172.21.15.123:0/2715857307 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe5c4145ed0 0x7fe5c4153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:17.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.430+0000 7fe5c91d7640 1 -- 172.21.15.123:0/2715857307 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe5c4145ed0 msgr2=0x7fe5c4153e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:17.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.430+0000 7fe5c91d7640 1 --2- 172.21.15.123:0/2715857307 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe5c4145ed0 0x7fe5c4153e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:17.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.430+0000 7fe5c91d7640 1 -- 172.21.15.123:0/2715857307 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5c4073890 msgr2=0x7fe5c4141ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:17.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.430+0000 7fe5c91d7640 1 --2- 172.21.15.123:0/2715857307 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5c4073890 0x7fe5c4141ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:17.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.430+0000 7fe5c91d7640 1 -- 172.21.15.123:0/2715857307 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c41434c0 con 0x7fe5c40b5880 2024-09-15T23:20:17.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.430+0000 7fe5c91d7640 1 --2- 172.21.15.123:0/2715857307 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5c40b5880 0x7fe5c4156e60 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fe5b400e9b0 tx=0x7fe5b400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:17.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.430+0000 7fe5ba7fc640 1 -- 172.21.15.123:0/2715857307 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b4017070 con 0x7fe5c40b5880 2024-09-15T23:20:17.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.430+0000 7fe5ba7fc640 1 -- 172.21.15.123:0/2715857307 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5b400c9a0 con 0x7fe5c40b5880 2024-09-15T23:20:17.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.430+0000 7fe5cbc3c640 1 -- 172.21.15.123:0/2715857307 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5c4142480 con 0x7fe5c40b5880 2024-09-15T23:20:17.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.430+0000 7fe5ba7fc640 1 -- 172.21.15.123:0/2715857307 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5b400cd90 con 0x7fe5c40b5880 2024-09-15T23:20:17.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.430+0000 7fe5cbc3c640 1 -- 172.21.15.123:0/2715857307 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5c4142cc0 con 0x7fe5c40b5880 2024-09-15T23:20:17.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.431+0000 7fe5cbc3c640 1 -- 172.21.15.123:0/2715857307 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5c40b5080 con 0x7fe5c40b5880 2024-09-15T23:20:17.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.432+0000 7fe5ba7fc640 1 -- 172.21.15.123:0/2715857307 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe5b401a070 con 0x7fe5c40b5880 2024-09-15T23:20:17.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.432+0000 7fe5ba7fc640 1 --2- 172.21.15.123:0/2715857307 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe5a806c2b0 0x7fe5a806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:17.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.432+0000 7fe5ba7fc640 1 -- 172.21.15.123:0/2715857307 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7fe5b408b3b0 con 0x7fe5c40b5880 2024-09-15T23:20:17.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.433+0000 7fe5c99d8640 1 --2- 172.21.15.123:0/2715857307 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe5a806c2b0 0x7fe5a806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:17.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.433+0000 7fe5c99d8640 1 --2- 172.21.15.123:0/2715857307 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe5a806c2b0 0x7fe5a806e770 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fe5c00012e0 tx=0x7fe5c0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:17.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.436+0000 7fe5ba7fc640 1 -- 172.21.15.123:0/2715857307 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe5c4142480 con 0x7fe5c40b5880 2024-09-15T23:20:17.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.602+0000 7fe5cbc3c640 1 -- 172.21.15.123:0/2715857307 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe5c40b3aa0 con 0x7fe5c40b5880 2024-09-15T23:20:17.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.603+0000 7fe5ba7fc640 1 -- 172.21.15.123:0/2715857307 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) ==== 74+0+16711 (secure 0 0 0) 0x7fe5b40594d0 con 0x7fe5c40b5880 2024-09-15T23:20:17.606 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:17.606 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":142,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:19:36.602275+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:19:33.533001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-15T23:19:33.894858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:20:17.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.605+0000 7fe5cbc3c640 1 -- 172.21.15.123:0/2715857307 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe5a806c2b0 msgr2=0x7fe5a806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:17.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.605+0000 7fe5cbc3c640 1 --2- 172.21.15.123:0/2715857307 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe5a806c2b0 0x7fe5a806e770 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fe5c00012e0 tx=0x7fe5c0009040 comp rx=0 tx=0).stop 2024-09-15T23:20:17.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.605+0000 7fe5cbc3c640 1 -- 172.21.15.123:0/2715857307 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5c40b5880 msgr2=0x7fe5c4156e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:17.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.605+0000 7fe5cbc3c640 1 --2- 172.21.15.123:0/2715857307 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5c40b5880 0x7fe5c4156e60 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fe5b400e9b0 tx=0x7fe5b400ee70 comp rx=0 tx=0).stop 2024-09-15T23:20:17.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.606+0000 7fe5cbc3c640 1 -- 172.21.15.123:0/2715857307 shutdown_connections 2024-09-15T23:20:17.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.606+0000 7fe5cbc3c640 1 --2- 172.21.15.123:0/2715857307 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe5c4145ed0 0x7fe5c4153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:17.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.606+0000 7fe5cbc3c640 1 --2- 172.21.15.123:0/2715857307 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe5a806c2b0 0x7fe5a806e770 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:17.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.606+0000 7fe5cbc3c640 1 --2- 172.21.15.123:0/2715857307 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5c40b5880 0x7fe5c4156e60 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:17.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.606+0000 7fe5cbc3c640 1 --2- 172.21.15.123:0/2715857307 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe5c4073890 0x7fe5c4141ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:17.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.606+0000 7fe5cbc3c640 1 -- 172.21.15.123:0/2715857307 >> 172.21.15.123:0/2715857307 conn(0x7fe5c40ccec0 msgr2=0x7fe5c4140f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:17.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.606+0000 7fe5cbc3c640 1 -- 172.21.15.123:0/2715857307 shutdown_connections 2024-09-15T23:20:17.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.606+0000 7fe5cbc3c640 1 -- 172.21.15.123:0/2715857307 wait complete. 2024-09-15T23:20:17.619 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T23:20:17.619 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:20:17.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.714+0000 7feafbb4b640 1 Processor -- start 2024-09-15T23:20:17.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.714+0000 7feafbb4b640 1 -- start start 2024-09-15T23:20:17.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.715+0000 7feafbb4b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feaf415ed20 0x7feaf40b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:17.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.715+0000 7feafbb4b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7feaf40b90e0 0x7feaf40b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:17.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.715+0000 7feafbb4b640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feaf40d0e70 con 0x7feaf40d23b0 2024-09-15T23:20:17.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.715+0000 7feafbb4b640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7feaf40d41c0 con 0x7feaf40b90e0 2024-09-15T23:20:17.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.715+0000 7feafbb4b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7feaf40d35b0 con 0x7feaf415ed20 2024-09-15T23:20:17.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.715+0000 7feafa0e8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7feaf40b90e0 0x7feaf40b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:17.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.715+0000 7feafa0e8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7feaf40b90e0 0x7feaf40b67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60550/0 (socket says 172.21.15.123:60550) 2024-09-15T23:20:17.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.715+0000 7feaf90e6640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7feaf40d23b0 0x7feaf40cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59570/0 (socket says 172.21.15.123:59570) 2024-09-15T23:20:17.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.715+0000 7feafa0e8640 1 -- 172.21.15.123:0/171926463 learned_addr learned my addr 172.21.15.123:0/171926463 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:17.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.716+0000 7feaf98e7640 1 --2- 172.21.15.123:0/171926463 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feaf415ed20 0x7feaf40b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:17.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.716+0000 7feafa0e8640 1 -- 172.21.15.123:0/171926463 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feaf415ed20 msgr2=0x7feaf40b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:17.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.716+0000 7feafa0e8640 1 --2- 172.21.15.123:0/171926463 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feaf415ed20 0x7feaf40b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:17.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.716+0000 7feafa0e8640 1 -- 172.21.15.123:0/171926463 >> v1:172.21.15.123:6789/0 conn(0x7feaf40d23b0 legacy=0x7feaf40cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:17.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.716+0000 7feafa0e8640 1 -- 172.21.15.123:0/171926463 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf40d3890 con 0x7feaf40b90e0 2024-09-15T23:20:17.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.716+0000 7feafa0e8640 1 --2- 172.21.15.123:0/171926463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaf40b90e0 0x7feaf40b67a0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7feae4009870 tx=0x7feae402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3385e3ad683650cd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:17.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.717+0000 7feaf88e5640 1 -- 172.21.15.123:0/171926463 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae4037070 con 0x7feaf40b90e0 2024-09-15T23:20:17.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.717+0000 7feaf88e5640 1 -- 172.21.15.123:0/171926463 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feae4032440 con 0x7feaf40b90e0 2024-09-15T23:20:17.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.717+0000 7feaf88e5640 1 -- 172.21.15.123:0/171926463 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae4032810 con 0x7feaf40b90e0 2024-09-15T23:20:17.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.717+0000 7feafbb4b640 1 -- 172.21.15.123:0/171926463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaf40b90e0 msgr2=0x7feaf40b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:17.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.717+0000 7feafbb4b640 1 --2- 172.21.15.123:0/171926463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaf40b90e0 0x7feaf40b67a0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7feae4009870 tx=0x7feae402a270 comp rx=0 tx=0).stop 2024-09-15T23:20:17.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.717+0000 7feafbb4b640 1 -- 172.21.15.123:0/171926463 shutdown_connections 2024-09-15T23:20:17.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.717+0000 7feafbb4b640 1 --2- 172.21.15.123:0/171926463 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaf40b90e0 0x7feaf40b67a0 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:17.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.717+0000 7feafbb4b640 1 --2- 172.21.15.123:0/171926463 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feaf415ed20 0x7feaf40b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:17.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.717+0000 7feafbb4b640 1 -- 172.21.15.123:0/171926463 >> 172.21.15.123:0/171926463 conn(0x7feaf40d1260 msgr2=0x7feaf40d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:17.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.717+0000 7feafbb4b640 1 -- 172.21.15.123:0/171926463 shutdown_connections 2024-09-15T23:20:17.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.717+0000 7feafbb4b640 1 -- 172.21.15.123:0/171926463 wait complete. 2024-09-15T23:20:17.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.718+0000 7feafbb4b640 1 Processor -- start 2024-09-15T23:20:17.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.718+0000 7feafbb4b640 1 -- start start 2024-09-15T23:20:17.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.719+0000 7feafbb4b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaf40b90e0 0x7feaf40ac470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:17.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.719+0000 7feafbb4b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feaf40d23b0 0x7feaf40ce530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:17.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.719+0000 7feafbb4b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feaf415ed20 0x7feaf4160af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:17.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.719+0000 7feafbb4b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7feaf40d32a0 con 0x7feaf40b90e0 2024-09-15T23:20:17.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.719+0000 7feafbb4b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7feaf40d3e50 con 0x7feaf415ed20 2024-09-15T23:20:17.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.719+0000 7feafbb4b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7feaf415f100 con 0x7feaf40d23b0 2024-09-15T23:20:17.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.719+0000 7feaf98e7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaf40b90e0 0x7feaf40ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:17.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.719+0000 7feaf98e7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaf40b90e0 0x7feaf40ac470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60554/0 (socket says 172.21.15.123:60554) 2024-09-15T23:20:17.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.719+0000 7feaf98e7640 1 -- 172.21.15.123:0/3583118474 learned_addr learned my addr 172.21.15.123:0/3583118474 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:17.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.719+0000 7feafa0e8640 1 --2- 172.21.15.123:0/3583118474 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feaf415ed20 0x7feaf4160af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:17.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.719+0000 7feaf90e6640 1 --2- 172.21.15.123:0/3583118474 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feaf40d23b0 0x7feaf40ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:17.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.720+0000 7feaf98e7640 1 -- 172.21.15.123:0/3583118474 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feaf40d23b0 msgr2=0x7feaf40ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:17.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.720+0000 7feaf98e7640 1 --2- 172.21.15.123:0/3583118474 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feaf40d23b0 0x7feaf40ce530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:17.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.720+0000 7feaf98e7640 1 -- 172.21.15.123:0/3583118474 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feaf415ed20 msgr2=0x7feaf4160af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:17.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.720+0000 7feaf98e7640 1 --2- 172.21.15.123:0/3583118474 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feaf415ed20 0x7feaf4160af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:17.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.720+0000 7feaf98e7640 1 -- 172.21.15.123:0/3583118474 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf40cd490 con 0x7feaf40b90e0 2024-09-15T23:20:17.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.720+0000 7feafa0e8640 1 --2- 172.21.15.123:0/3583118474 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feaf415ed20 0x7feaf4160af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:17.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.720+0000 7feaf98e7640 1 --2- 172.21.15.123:0/3583118474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaf40b90e0 0x7feaf40ac470 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7feaec009db0 tx=0x7feaec00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:17.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.720+0000 7feaf27fc640 1 -- 172.21.15.123:0/3583118474 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaec018020 con 0x7feaf40b90e0 2024-09-15T23:20:17.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.720+0000 7feaf27fc640 1 -- 172.21.15.123:0/3583118474 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaec014480 con 0x7feaf40b90e0 2024-09-15T23:20:17.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.720+0000 7feafbb4b640 1 -- 172.21.15.123:0/3583118474 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaf40cd770 con 0x7feaf40b90e0 2024-09-15T23:20:17.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.720+0000 7feaf27fc640 1 -- 172.21.15.123:0/3583118474 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaec014850 con 0x7feaf40b90e0 2024-09-15T23:20:17.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.720+0000 7feafbb4b640 1 -- 172.21.15.123:0/3583118474 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaf40cdd30 con 0x7feaf40b90e0 2024-09-15T23:20:17.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.721+0000 7feafbb4b640 1 -- 172.21.15.123:0/3583118474 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaf40b7010 con 0x7feaf40b90e0 2024-09-15T23:20:17.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.721+0000 7feaf27fc640 1 -- 172.21.15.123:0/3583118474 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7feaec005d10 con 0x7feaf40b90e0 2024-09-15T23:20:17.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.722+0000 7feaf27fc640 1 --2- 172.21.15.123:0/3583118474 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7feae006c2b0 0x7feae006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:17.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.722+0000 7feaf27fc640 1 -- 172.21.15.123:0/3583118474 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7feaec08bf80 con 0x7feaf40b90e0 2024-09-15T23:20:17.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.722+0000 7feaf90e6640 1 --2- 172.21.15.123:0/3583118474 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7feae006c2b0 0x7feae006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:17.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.722+0000 7feaf90e6640 1 --2- 172.21.15.123:0/3583118474 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7feae006c2b0 0x7feae006e770 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7feaf40b3ae0 tx=0x7feae8007cc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:17.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.726+0000 7feaf27fc640 1 -- 172.21.15.123:0/3583118474 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feaec022070 con 0x7feaf40b90e0 2024-09-15T23:20:17.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.925+0000 7feafbb4b640 1 -- 172.21.15.123:0/3583118474 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feaf40b3f20 con 0x7feaf40b90e0 2024-09-15T23:20:17.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.926+0000 7feaf27fc640 1 -- 172.21.15.123:0/3583118474 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5237 (secure 0 0 0) 0x7feaec010040 con 0x7feaf40b90e0 2024-09-15T23:20:17.928 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:17.929 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":86,"btime":"2024-09-15T23:19:37:619526+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2082746470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2082746470},{"type":"v1","addr":"172.21.15.123:6834","nonce":2082746470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8421,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2007610603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":2007610603},{"type":"v1","addr":"172.21.15.123:6835","nonce":2007610603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8436,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2929123975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2929123975},{"type":"v1","addr":"172.21.15.188:6836","nonce":2929123975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:19:34.917419+0000","modified":"2024-09-15T23:19:36.941347+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8439":{"gid":8439,"name":"d","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6837/1222656979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1222656979},{"type":"v1","addr":"172.21.15.188:6837","nonce":1222656979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8439,"qdb_cluster":[8439]},"id":9}]} 2024-09-15T23:20:17.929 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 86 2024-09-15T23:20:17.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.929+0000 7feafbb4b640 1 -- 172.21.15.123:0/3583118474 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7feae006c2b0 msgr2=0x7feae006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:17.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.929+0000 7feafbb4b640 1 --2- 172.21.15.123:0/3583118474 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7feae006c2b0 0x7feae006e770 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7feaf40b3ae0 tx=0x7feae8007cc0 comp rx=0 tx=0).stop 2024-09-15T23:20:17.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.929+0000 7feafbb4b640 1 -- 172.21.15.123:0/3583118474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaf40b90e0 msgr2=0x7feaf40ac470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:17.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.929+0000 7feafbb4b640 1 --2- 172.21.15.123:0/3583118474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaf40b90e0 0x7feaf40ac470 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7feaec009db0 tx=0x7feaec00c490 comp rx=0 tx=0).stop 2024-09-15T23:20:17.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.929+0000 7feafbb4b640 1 -- 172.21.15.123:0/3583118474 shutdown_connections 2024-09-15T23:20:17.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.929+0000 7feafbb4b640 1 --2- 172.21.15.123:0/3583118474 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feaf415ed20 0x7feaf4160af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:17.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.929+0000 7feafbb4b640 1 --2- 172.21.15.123:0/3583118474 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feaf40d23b0 0x7feaf40ce530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:17.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.929+0000 7feafbb4b640 1 --2- 172.21.15.123:0/3583118474 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7feae006c2b0 0x7feae006e770 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:17.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.929+0000 7feafbb4b640 1 --2- 172.21.15.123:0/3583118474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feaf40b90e0 0x7feaf40ac470 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:17.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.929+0000 7feafbb4b640 1 -- 172.21.15.123:0/3583118474 >> 172.21.15.123:0/3583118474 conn(0x7feaf40d1260 msgr2=0x7feaf40b94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:17.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.929+0000 7feafbb4b640 1 -- 172.21.15.123:0/3583118474 shutdown_connections 2024-09-15T23:20:17.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:17.929+0000 7feafbb4b640 1 -- 172.21.15.123:0/3583118474 wait complete. 2024-09-15T23:20:17.941 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:20:18.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.037+0000 7f37cefb7640 1 Processor -- start 2024-09-15T23:20:18.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.037+0000 7f37cefb7640 1 -- start start 2024-09-15T23:20:18.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.037+0000 7f37cefb7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37c815ab40 0x7f37c806c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:18.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.037+0000 7f37cefb7640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f37c815af20 0x7f37c815b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:18.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.037+0000 7f37cefb7640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37c80724f0 con 0x7f37c80720b0 2024-09-15T23:20:18.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.037+0000 7f37cefb7640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f37c8071010 con 0x7f37c815af20 2024-09-15T23:20:18.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.037+0000 7f37cefb7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f37c80712f0 con 0x7f37c815ab40 2024-09-15T23:20:18.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.038+0000 7f37ccd53640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37c815ab40 0x7f37c806c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:18.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.038+0000 7f37cd554640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f37c815af20 0x7f37c815b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:18.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.038+0000 7f37ccd53640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37c815ab40 0x7f37c806c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:59660/0 (socket says 172.21.15.123:59660) 2024-09-15T23:20:18.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.038+0000 7f37ccd53640 1 -- 172.21.15.123:0/3661909961 learned_addr learned my addr 172.21.15.123:0/3661909961 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:18.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.038+0000 7f37c7fff640 1 --1- 172.21.15.123:0/3661909961 >> v1:172.21.15.188:6789/0 conn(0x7f37c80720b0 0x7f37c8073990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:43216/0 (socket says 172.21.15.123:43216) 2024-09-15T23:20:18.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.038+0000 7f37ccd53640 1 -- 172.21.15.123:0/3661909961 >> v2:172.21.15.188:3300/0 conn(0x7f37c815af20 msgr2=0x7f37c815b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:18.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.038+0000 7f37ccd53640 1 --2- 172.21.15.123:0/3661909961 >> v2:172.21.15.188:3300/0 conn(0x7f37c815af20 0x7f37c815b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:18.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.038+0000 7f37ccd53640 1 -- 172.21.15.123:0/3661909961 >> v1:172.21.15.188:6789/0 conn(0x7f37c80720b0 legacy=0x7f37c8073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:18.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.038+0000 7f37ccd53640 1 -- 172.21.15.123:0/3661909961 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37c80715d0 con 0x7f37c815ab40 2024-09-15T23:20:18.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.038+0000 7f37cd554640 1 --2- 172.21.15.123:0/3661909961 >> v2:172.21.15.188:3300/0 conn(0x7f37c815af20 0x7f37c815b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:20:18.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.039+0000 7f37ccd53640 1 --2- 172.21.15.123:0/3661909961 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37c815ab40 0x7f37c806c6a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f37bc009870 tx=0x7f37bc02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47515c493fbf57da server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:18.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.039+0000 7f37c77fe640 1 -- 172.21.15.123:0/3661909961 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37bc037070 con 0x7f37c815ab40 2024-09-15T23:20:18.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.039+0000 7f37c77fe640 1 -- 172.21.15.123:0/3661909961 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37bc032440 con 0x7f37c815ab40 2024-09-15T23:20:18.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.039+0000 7f37c77fe640 1 -- 172.21.15.123:0/3661909961 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37bc032810 con 0x7f37c815ab40 2024-09-15T23:20:18.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.039+0000 7f37cefb7640 1 -- 172.21.15.123:0/3661909961 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37c815ab40 msgr2=0x7f37c806c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:18.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.039+0000 7f37cefb7640 1 --2- 172.21.15.123:0/3661909961 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37c815ab40 0x7f37c806c6a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f37bc009870 tx=0x7f37bc02a1c0 comp rx=0 tx=0).stop 2024-09-15T23:20:18.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.040+0000 7f37cefb7640 1 -- 172.21.15.123:0/3661909961 shutdown_connections 2024-09-15T23:20:18.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.040+0000 7f37cefb7640 1 --2- 172.21.15.123:0/3661909961 >> v2:172.21.15.188:3300/0 conn(0x7f37c815af20 0x7f37c815b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:18.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.040+0000 7f37cefb7640 1 --2- 172.21.15.123:0/3661909961 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37c815ab40 0x7f37c806c6a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:18.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.040+0000 7f37cefb7640 1 -- 172.21.15.123:0/3661909961 >> 172.21.15.123:0/3661909961 conn(0x7f37c80ccec0 msgr2=0x7f37c80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:18.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.040+0000 7f37cefb7640 1 -- 172.21.15.123:0/3661909961 shutdown_connections 2024-09-15T23:20:18.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.040+0000 7f37cefb7640 1 -- 172.21.15.123:0/3661909961 wait complete. 2024-09-15T23:20:18.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.041+0000 7f37cefb7640 1 Processor -- start 2024-09-15T23:20:18.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.041+0000 7f37cefb7640 1 -- start start 2024-09-15T23:20:18.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.042+0000 7f37cefb7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37c80720b0 0x7f37c8152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:18.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.042+0000 7f37cefb7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f37c815ab40 0x7f37c814c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:18.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.042+0000 7f37cefb7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37c815af20 0x7f37c80c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:18.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.042+0000 7f37cefb7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f37c815ba30 con 0x7f37c815af20 2024-09-15T23:20:18.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.042+0000 7f37cefb7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f37c815b8b0 con 0x7f37c815ab40 2024-09-15T23:20:18.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.042+0000 7f37cefb7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f37c806bc10 con 0x7f37c80720b0 2024-09-15T23:20:18.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.042+0000 7f37cd554640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37c815af20 0x7f37c80c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:18.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.042+0000 7f37cd554640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37c815af20 0x7f37c80c5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60566/0 (socket says 172.21.15.123:60566) 2024-09-15T23:20:18.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.042+0000 7f37cd554640 1 -- 172.21.15.123:0/1425479445 learned_addr learned my addr 172.21.15.123:0/1425479445 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:18.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.042+0000 7f37ccd53640 1 --2- 172.21.15.123:0/1425479445 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37c80720b0 0x7f37c8152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:18.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.042+0000 7f37c7fff640 1 --2- 172.21.15.123:0/1425479445 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f37c815ab40 0x7f37c814c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:18.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.042+0000 7f37cd554640 1 -- 172.21.15.123:0/1425479445 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37c80720b0 msgr2=0x7f37c8152900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:18.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.042+0000 7f37cd554640 1 --2- 172.21.15.123:0/1425479445 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37c80720b0 0x7f37c8152900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:18.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.042+0000 7f37cd554640 1 -- 172.21.15.123:0/1425479445 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f37c815ab40 msgr2=0x7f37c814c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:18.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.042+0000 7f37cd554640 1 --2- 172.21.15.123:0/1425479445 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f37c815ab40 0x7f37c814c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:18.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.042+0000 7f37cd554640 1 -- 172.21.15.123:0/1425479445 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37c80c5710 con 0x7f37c815af20 2024-09-15T23:20:18.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.042+0000 7f37cd554640 1 --2- 172.21.15.123:0/1425479445 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37c815af20 0x7f37c80c5e40 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f37c000efc0 tx=0x7f37c000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:18.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.042+0000 7f37c57fa640 1 -- 172.21.15.123:0/1425479445 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c0018030 con 0x7f37c815af20 2024-09-15T23:20:18.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.042+0000 7f37c57fa640 1 -- 172.21.15.123:0/1425479445 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c000cdf0 con 0x7f37c815af20 2024-09-15T23:20:18.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.042+0000 7f37c57fa640 1 -- 172.21.15.123:0/1425479445 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c0003bb0 con 0x7f37c815af20 2024-09-15T23:20:18.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.042+0000 7f37cefb7640 1 -- 172.21.15.123:0/1425479445 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37c80c59f0 con 0x7f37c815af20 2024-09-15T23:20:18.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.042+0000 7f37cefb7640 1 -- 172.21.15.123:0/1425479445 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37c8152100 con 0x7f37c815af20 2024-09-15T23:20:18.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.044+0000 7f37cefb7640 1 -- 172.21.15.123:0/1425479445 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37c806bff0 con 0x7f37c815af20 2024-09-15T23:20:18.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.044+0000 7f37c57fa640 1 -- 172.21.15.123:0/1425479445 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f37c001b070 con 0x7f37c815af20 2024-09-15T23:20:18.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.044+0000 7f37c57fa640 1 --2- 172.21.15.123:0/1425479445 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f37ac06c2e0 0x7f37ac06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:18.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.045+0000 7f37c57fa640 1 -- 172.21.15.123:0/1425479445 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f37c008bcc0 con 0x7f37c815af20 2024-09-15T23:20:18.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.045+0000 7f37ccd53640 1 --2- 172.21.15.123:0/1425479445 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f37ac06c2e0 0x7f37ac06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:18.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.045+0000 7f37ccd53640 1 --2- 172.21.15.123:0/1425479445 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f37ac06c2e0 0x7f37ac06e7a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f37bc034000 tx=0x7f37bc02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:18.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.049+0000 7f37c57fa640 1 -- 172.21.15.123:0/1425479445 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f37c0010040 con 0x7f37c815af20 2024-09-15T23:20:18.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.248+0000 7f37cefb7640 1 -- 172.21.15.123:0/1425479445 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f37c80b3880 con 0x7f37c815af20 2024-09-15T23:20:18.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.249+0000 7f37c57fa640 1 -- 172.21.15.123:0/1425479445 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) ==== 94+0+5237 (secure 0 0 0) 0x7f37c0059de0 con 0x7f37c815af20 2024-09-15T23:20:18.251 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:18.251 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":86,"btime":"2024-09-15T23:19:37:619526+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2082746470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2082746470},{"type":"v1","addr":"172.21.15.123:6834","nonce":2082746470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8421,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2007610603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":2007610603},{"type":"v1","addr":"172.21.15.123:6835","nonce":2007610603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8436,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2929123975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2929123975},{"type":"v1","addr":"172.21.15.188:6836","nonce":2929123975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:19:34.917419+0000","modified":"2024-09-15T23:19:36.941347+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8439":{"gid":8439,"name":"d","rank":0,"incarnation":84,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6837/1222656979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1222656979},{"type":"v1","addr":"172.21.15.188:6837","nonce":1222656979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8439,"qdb_cluster":[8439]},"id":9}]} 2024-09-15T23:20:18.251 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 86 2024-09-15T23:20:18.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.251+0000 7f37cefb7640 1 -- 172.21.15.123:0/1425479445 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f37ac06c2e0 msgr2=0x7f37ac06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:18.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.251+0000 7f37cefb7640 1 --2- 172.21.15.123:0/1425479445 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f37ac06c2e0 0x7f37ac06e7a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f37bc034000 tx=0x7f37bc02e000 comp rx=0 tx=0).stop 2024-09-15T23:20:18.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.251+0000 7f37cefb7640 1 -- 172.21.15.123:0/1425479445 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37c815af20 msgr2=0x7f37c80c5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:18.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.251+0000 7f37cefb7640 1 --2- 172.21.15.123:0/1425479445 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37c815af20 0x7f37c80c5e40 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f37c000efc0 tx=0x7f37c000c490 comp rx=0 tx=0).stop 2024-09-15T23:20:18.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.251+0000 7f37cefb7640 1 -- 172.21.15.123:0/1425479445 shutdown_connections 2024-09-15T23:20:18.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.251+0000 7f37cefb7640 1 --2- 172.21.15.123:0/1425479445 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f37ac06c2e0 0x7f37ac06e7a0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:18.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.251+0000 7f37cefb7640 1 --2- 172.21.15.123:0/1425479445 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37c815af20 0x7f37c80c5e40 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:18.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.251+0000 7f37cefb7640 1 --2- 172.21.15.123:0/1425479445 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f37c815ab40 0x7f37c814c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:18.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.251+0000 7f37cefb7640 1 --2- 172.21.15.123:0/1425479445 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37c80720b0 0x7f37c8152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:18.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.251+0000 7f37cefb7640 1 -- 172.21.15.123:0/1425479445 >> 172.21.15.123:0/1425479445 conn(0x7f37c80ccec0 msgr2=0x7f37c80cdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:18.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.251+0000 7f37cefb7640 1 -- 172.21.15.123:0/1425479445 shutdown_connections 2024-09-15T23:20:18.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.251+0000 7f37cefb7640 1 -- 172.21.15.123:0/1425479445 wait complete. 2024-09-15T23:20:18.264 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:20:18.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.360+0000 7f5298fbe640 1 Processor -- start 2024-09-15T23:20:18.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.360+0000 7f5298fbe640 1 -- start start 2024-09-15T23:20:18.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.361+0000 7f5298fbe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f529415ab40 0x7f529406c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:18.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.361+0000 7f5298fbe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f529415af20 0x7f529415b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:18.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.361+0000 7f5298fbe640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5294072520 con 0x7f52940720b0 2024-09-15T23:20:18.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.361+0000 7f5298fbe640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f5294071010 con 0x7f529415ab40 2024-09-15T23:20:18.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.361+0000 7f5298fbe640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f52940712f0 con 0x7f529415af20 2024-09-15T23:20:18.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.361+0000 7f529259c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f529415ab40 0x7f529406c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:18.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.361+0000 7f5291d9b640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f52940720b0 0x7f5294073990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59580/0 (socket says 172.21.15.123:59580) 2024-09-15T23:20:18.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.361+0000 7f5291d9b640 1 -- 172.21.15.123:0/1011800018 learned_addr learned my addr 172.21.15.123:0/1011800018 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:18.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.361+0000 7f529259c640 1 -- 172.21.15.123:0/1011800018 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f529415af20 msgr2=0x7f529415b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:18.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.361+0000 7f529259c640 1 --2- 172.21.15.123:0/1011800018 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f529415af20 0x7f529415b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:18.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.361+0000 7f529259c640 1 -- 172.21.15.123:0/1011800018 >> v1:172.21.15.123:6789/0 conn(0x7f52940720b0 legacy=0x7f5294073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:18.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.361+0000 7f529159a640 1 -- 172.21.15.123:0/1011800018 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2802973888 0 0) 0x7f5294072520 con 0x7f52940720b0 2024-09-15T23:20:18.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.361+0000 7f529259c640 1 -- 172.21.15.123:0/1011800018 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52940715d0 con 0x7f529415ab40 2024-09-15T23:20:18.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.362+0000 7f529259c640 1 --2- 172.21.15.123:0/1011800018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f529415ab40 0x7f529406c6a0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f528c009d90 tx=0x7f528c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1fa40f22195f36a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:18.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.362+0000 7f529159a640 1 -- 172.21.15.123:0/1011800018 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528c031600 con 0x7f529415ab40 2024-09-15T23:20:18.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.362+0000 7f529159a640 1 -- 172.21.15.123:0/1011800018 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f528c0317a0 con 0x7f529415ab40 2024-09-15T23:20:18.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.362+0000 7f529159a640 1 -- 172.21.15.123:0/1011800018 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528c031b70 con 0x7f529415ab40 2024-09-15T23:20:18.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.363+0000 7f5298fbe640 1 -- 172.21.15.123:0/1011800018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f529415ab40 msgr2=0x7f529406c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:18.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.363+0000 7f5298fbe640 1 --2- 172.21.15.123:0/1011800018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f529415ab40 0x7f529406c6a0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f528c009d90 tx=0x7f528c02a5d0 comp rx=0 tx=0).stop 2024-09-15T23:20:18.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.363+0000 7f5298fbe640 1 -- 172.21.15.123:0/1011800018 shutdown_connections 2024-09-15T23:20:18.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.363+0000 7f5298fbe640 1 --2- 172.21.15.123:0/1011800018 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f529415af20 0x7f529415b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:18.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.363+0000 7f5298fbe640 1 --2- 172.21.15.123:0/1011800018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f529415ab40 0x7f529406c6a0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:18.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.363+0000 7f5298fbe640 1 -- 172.21.15.123:0/1011800018 >> 172.21.15.123:0/1011800018 conn(0x7f52940ccec0 msgr2=0x7f52940cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:18.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.363+0000 7f5298fbe640 1 -- 172.21.15.123:0/1011800018 shutdown_connections 2024-09-15T23:20:18.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.363+0000 7f5298fbe640 1 -- 172.21.15.123:0/1011800018 wait complete. 2024-09-15T23:20:18.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.364+0000 7f5298fbe640 1 Processor -- start 2024-09-15T23:20:18.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.364+0000 7f5298fbe640 1 -- start start 2024-09-15T23:20:18.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.365+0000 7f5298fbe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52940720b0 0x7f52941564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:18.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.365+0000 7f5298fbe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f529415ab40 0x7f52940c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:18.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.365+0000 7f5298fbe640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f529415af20 0x7f52940ab130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:18.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.365+0000 7f5298fbe640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f529415ba30 con 0x7f52940720b0 2024-09-15T23:20:18.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.365+0000 7f5298fbe640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f529415b8b0 con 0x7f529415af20 2024-09-15T23:20:18.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.365+0000 7f5298fbe640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f529406bc10 con 0x7f529415ab40 2024-09-15T23:20:18.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.365+0000 7f529259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52940720b0 0x7f52941564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:18.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.365+0000 7f529259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52940720b0 0x7f52941564b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60574/0 (socket says 172.21.15.123:60574) 2024-09-15T23:20:18.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.365+0000 7f529259c640 1 -- 172.21.15.123:0/2237199504 learned_addr learned my addr 172.21.15.123:0/2237199504 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:18.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.365+0000 7f5291d9b640 1 --2- 172.21.15.123:0/2237199504 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f529415ab40 0x7f52940c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:18.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.365+0000 7f5292d9d640 1 --2- 172.21.15.123:0/2237199504 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f529415af20 0x7f52940ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:18.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.366+0000 7f529259c640 1 -- 172.21.15.123:0/2237199504 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f529415ab40 msgr2=0x7f52940c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:18.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.366+0000 7f529259c640 1 --2- 172.21.15.123:0/2237199504 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f529415ab40 0x7f52940c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:18.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.366+0000 7f529259c640 1 -- 172.21.15.123:0/2237199504 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f529415af20 msgr2=0x7f52940ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:18.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.366+0000 7f529259c640 1 --2- 172.21.15.123:0/2237199504 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f529415af20 0x7f52940ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:18.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.366+0000 7f529259c640 1 -- 172.21.15.123:0/2237199504 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52940c8cd0 con 0x7f52940720b0 2024-09-15T23:20:18.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.366+0000 7f529259c640 1 --2- 172.21.15.123:0/2237199504 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52940720b0 0x7f52941564b0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f528c009d90 tx=0x7f528c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:18.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.366+0000 7f528affd640 1 -- 172.21.15.123:0/2237199504 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528c040070 con 0x7f52940720b0 2024-09-15T23:20:18.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.366+0000 7f528affd640 1 -- 172.21.15.123:0/2237199504 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f528c030be0 con 0x7f52940720b0 2024-09-15T23:20:18.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.366+0000 7f5298fbe640 1 -- 172.21.15.123:0/2237199504 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52940c8fb0 con 0x7f52940720b0 2024-09-15T23:20:18.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.366+0000 7f528affd640 1 -- 172.21.15.123:0/2237199504 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528c03c420 con 0x7f52940720b0 2024-09-15T23:20:18.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.366+0000 7f5298fbe640 1 -- 172.21.15.123:0/2237199504 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52940c9570 con 0x7f52940720b0 2024-09-15T23:20:18.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.367+0000 7f5298fbe640 1 -- 172.21.15.123:0/2237199504 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f529406bf90 con 0x7f52940720b0 2024-09-15T23:20:18.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.367+0000 7f528affd640 1 -- 172.21.15.123:0/2237199504 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f528c039040 con 0x7f52940720b0 2024-09-15T23:20:18.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.368+0000 7f528affd640 1 --2- 172.21.15.123:0/2237199504 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f527406c2b0 0x7f527406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:18.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.368+0000 7f528affd640 1 -- 172.21.15.123:0/2237199504 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f528c0ac7e0 con 0x7f52940720b0 2024-09-15T23:20:18.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.368+0000 7f5291d9b640 1 --2- 172.21.15.123:0/2237199504 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f527406c2b0 0x7f527406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:18.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.369+0000 7f5291d9b640 1 --2- 172.21.15.123:0/2237199504 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f527406c2b0 0x7f527406e770 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f52940ca110 tx=0x7f527c007d50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:18.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.373+0000 7f528affd640 1 -- 172.21.15.123:0/2237199504 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f528c07a9c0 con 0x7f52940720b0 2024-09-15T23:20:18.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.539+0000 7f5298fbe640 1 -- 172.21.15.123:0/2237199504 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f52940c5880 con 0x7f52940720b0 2024-09-15T23:20:18.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.540+0000 7f528affd640 1 -- 172.21.15.123:0/2237199504 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) ==== 74+0+16711 (secure 0 0 0) 0x7f528c07ecc0 con 0x7f52940720b0 2024-09-15T23:20:18.542 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:18.542 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":142,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:19:36.602275+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:19:33.533001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-15T23:19:33.894858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:20:18.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.542+0000 7f5298fbe640 1 -- 172.21.15.123:0/2237199504 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f527406c2b0 msgr2=0x7f527406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:18.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.542+0000 7f5298fbe640 1 --2- 172.21.15.123:0/2237199504 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f527406c2b0 0x7f527406e770 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f52940ca110 tx=0x7f527c007d50 comp rx=0 tx=0).stop 2024-09-15T23:20:18.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.542+0000 7f5298fbe640 1 -- 172.21.15.123:0/2237199504 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52940720b0 msgr2=0x7f52941564b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:18.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.542+0000 7f5298fbe640 1 --2- 172.21.15.123:0/2237199504 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52940720b0 0x7f52941564b0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f528c009d90 tx=0x7f528c004a40 comp rx=0 tx=0).stop 2024-09-15T23:20:18.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.542+0000 7f5298fbe640 1 -- 172.21.15.123:0/2237199504 shutdown_connections 2024-09-15T23:20:18.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.542+0000 7f5298fbe640 1 --2- 172.21.15.123:0/2237199504 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f529415af20 0x7f52940ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:18.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.542+0000 7f5298fbe640 1 --2- 172.21.15.123:0/2237199504 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f529415ab40 0x7f52940c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:18.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.542+0000 7f5298fbe640 1 --2- 172.21.15.123:0/2237199504 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f527406c2b0 0x7f527406e770 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:18.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.542+0000 7f5298fbe640 1 --2- 172.21.15.123:0/2237199504 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52940720b0 0x7f52941564b0 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:18.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.542+0000 7f5298fbe640 1 -- 172.21.15.123:0/2237199504 >> 172.21.15.123:0/2237199504 conn(0x7f52940ccec0 msgr2=0x7f52940cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:18.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.542+0000 7f5298fbe640 1 -- 172.21.15.123:0/2237199504 shutdown_connections 2024-09-15T23:20:18.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.542+0000 7f5298fbe640 1 -- 172.21.15.123:0/2237199504 wait complete. 2024-09-15T23:20:18.555 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T23:20:18.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.653+0000 7f3733f4b640 1 Processor -- start 2024-09-15T23:20:18.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.653+0000 7f3733f4b640 1 -- start start 2024-09-15T23:20:18.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.654+0000 7f3733f4b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f372c06bc10 0x7f372c06bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:18.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.654+0000 7f3733f4b640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f372c06c530 con 0x7f372c0cef60 2024-09-15T23:20:18.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.654+0000 7f3733f4b640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f372c0b4090 con 0x7f372c0b3790 2024-09-15T23:20:18.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.654+0000 7f3733f4b640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f372c0cd690 con 0x7f372c06bc10 2024-09-15T23:20:18.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.654+0000 7f37314e6640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f372c0cef60 0x7f372c15eb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59590/0 (socket says 172.21.15.123:59590) 2024-09-15T23:20:18.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.654+0000 7f37314e6640 1 -- 172.21.15.123:0/3319880223 learned_addr learned my addr 172.21.15.123:0/3319880223 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:18.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.654+0000 7f3731ce7640 1 --2- 172.21.15.123:0/3319880223 >> v2:172.21.15.188:3300/0 conn(0x7f372c06bc10 0x7f372c06bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:18.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.654+0000 7f3730ce5640 1 -- 172.21.15.123:0/3319880223 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 23513553 0 0) 0x7f372c06c530 con 0x7f372c0cef60 2024-09-15T23:20:18.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.654+0000 7f3730ce5640 1 -- 172.21.15.123:0/3319880223 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3718003520 con 0x7f372c0cef60 2024-09-15T23:20:18.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.654+0000 7f3730ce5640 1 -- 172.21.15.123:0/3319880223 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2844957358 0 0) 0x7f3718003520 con 0x7f372c0cef60 2024-09-15T23:20:18.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.654+0000 7f3730ce5640 1 -- 172.21.15.123:0/3319880223 >> v2:172.21.15.188:3300/0 conn(0x7f372c06bc10 msgr2=0x7f372c06bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:18.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.654+0000 7f3730ce5640 1 --2- 172.21.15.123:0/3319880223 >> v2:172.21.15.188:3300/0 conn(0x7f372c06bc10 0x7f372c06bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:18.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.654+0000 7f3730ce5640 1 -- 172.21.15.123:0/3319880223 >> v1:172.21.15.188:6789/0 conn(0x7f372c0b3790 legacy=0x7f372c1624e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:18.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.654+0000 7f3730ce5640 1 -- 172.21.15.123:0/3319880223 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f372c0d0950 con 0x7f372c0cef60 2024-09-15T23:20:18.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.654+0000 7f3730ce5640 1 -- 172.21.15.123:0/3319880223 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f371c001670 con 0x7f372c0cef60 2024-09-15T23:20:18.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.654+0000 7f3730ce5640 1 -- 172.21.15.123:0/3319880223 >> v1:172.21.15.123:6789/0 conn(0x7f372c0cef60 legacy=0x7f372c15eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:18.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.654+0000 7f3730ce5640 1 --2- 172.21.15.123:0/3319880223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37180039b0 0x7f3718003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:18.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.654+0000 7f3730ce5640 1 --2- 172.21.15.123:0/3319880223 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3718004800 0x7f3718004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:18.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.654+0000 7f3730ce5640 1 --2- 172.21.15.123:0/3319880223 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37180051c0 0x7f371800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:18.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.654+0000 7f3730ce5640 1 -- 172.21.15.123:0/3319880223 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f372c0cd690 con 0x7f37180039b0 2024-09-15T23:20:18.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.654+0000 7f3730ce5640 1 -- 172.21.15.123:0/3319880223 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f371800c060 con 0x7f3718004800 2024-09-15T23:20:18.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.654+0000 7f3730ce5640 1 -- 172.21.15.123:0/3319880223 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f371800c260 con 0x7f37180051c0 2024-09-15T23:20:18.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.655+0000 7f3731ce7640 1 --2- 172.21.15.123:0/3319880223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37180039b0 0x7f3718003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:18.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.655+0000 7f37314e6640 1 --2- 172.21.15.123:0/3319880223 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3718004800 0x7f3718004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:18.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.655+0000 7f37324e8640 1 --2- 172.21.15.123:0/3319880223 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37180051c0 0x7f371800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:18.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.655+0000 7f3731ce7640 1 -- 172.21.15.123:0/3319880223 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37180051c0 msgr2=0x7f371800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:18.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.655+0000 7f3731ce7640 1 --2- 172.21.15.123:0/3319880223 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37180051c0 0x7f371800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:18.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.655+0000 7f3731ce7640 1 -- 172.21.15.123:0/3319880223 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3718004800 msgr2=0x7f3718004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:18.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.655+0000 7f3731ce7640 1 --2- 172.21.15.123:0/3319880223 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3718004800 0x7f3718004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:18.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.655+0000 7f3731ce7640 1 -- 172.21.15.123:0/3319880223 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3718003520 con 0x7f37180039b0 2024-09-15T23:20:18.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.655+0000 7f37324e8640 1 --2- 172.21.15.123:0/3319880223 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37180051c0 0x7f371800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:20:18.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.655+0000 7f37314e6640 1 --2- 172.21.15.123:0/3319880223 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3718004800 0x7f3718004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:18.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.655+0000 7f37324e8640 1 -- 172.21.15.123:0/3319880223 reap_dead start 2024-09-15T23:20:18.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.655+0000 7f3731ce7640 1 --2- 172.21.15.123:0/3319880223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37180039b0 0x7f3718003dd0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f3728009ac0 tx=0x7f3718005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b91ec93043ff633 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:18.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.656+0000 7f3730ce5640 1 -- 172.21.15.123:0/3319880223 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3728036070 con 0x7f37180039b0 2024-09-15T23:20:18.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.656+0000 7f3730ce5640 1 -- 172.21.15.123:0/3319880223 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3728031400 con 0x7f37180039b0 2024-09-15T23:20:18.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.656+0000 7f3730ce5640 1 -- 172.21.15.123:0/3319880223 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3728009690 con 0x7f37180039b0 2024-09-15T23:20:18.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.656+0000 7f3733f4b640 1 -- 172.21.15.123:0/3319880223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37180039b0 msgr2=0x7f3718003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:18.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.656+0000 7f3733f4b640 1 --2- 172.21.15.123:0/3319880223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37180039b0 0x7f3718003dd0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f3728009ac0 tx=0x7f3718005830 comp rx=0 tx=0).stop 2024-09-15T23:20:18.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.656+0000 7f3733f4b640 1 -- 172.21.15.123:0/3319880223 shutdown_connections 2024-09-15T23:20:18.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.656+0000 7f3733f4b640 1 --2- 172.21.15.123:0/3319880223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37180039b0 0x7f3718003dd0 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:18.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.656+0000 7f3733f4b640 1 -- 172.21.15.123:0/3319880223 >> 172.21.15.123:0/3319880223 conn(0x7f372c06cd20 msgr2=0x7f372c06d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:18.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.656+0000 7f3733f4b640 1 -- 172.21.15.123:0/3319880223 shutdown_connections 2024-09-15T23:20:18.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.656+0000 7f3733f4b640 1 -- 172.21.15.123:0/3319880223 wait complete. 2024-09-15T23:20:18.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.657+0000 7f3733f4b640 1 Processor -- start 2024-09-15T23:20:18.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.657+0000 7f3733f4b640 1 -- start start 2024-09-15T23:20:18.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.658+0000 7f3733f4b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37180039b0 0x7f372c14e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:18.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.658+0000 7f3733f4b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f372c1530a0 0x7f372c0b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:18.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.658+0000 7f3733f4b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f372c14d9d0 0x7f372c06e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:18.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.658+0000 7f3733f4b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f372c0d0f10 con 0x7f37180039b0 2024-09-15T23:20:18.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.658+0000 7f3733f4b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f372c0d06f0 con 0x7f372c14d9d0 2024-09-15T23:20:18.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.658+0000 7f3733f4b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f372c0b3bc0 con 0x7f372c1530a0 2024-09-15T23:20:18.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.658+0000 7f3731ce7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37180039b0 0x7f372c14e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:18.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.658+0000 7f3731ce7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37180039b0 0x7f372c14e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60588/0 (socket says 172.21.15.123:60588) 2024-09-15T23:20:18.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.658+0000 7f3731ce7640 1 -- 172.21.15.123:0/1082312836 learned_addr learned my addr 172.21.15.123:0/1082312836 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:18.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.659+0000 7f3731ce7640 1 -- 172.21.15.123:0/1082312836 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f372c1530a0 msgr2=0x7f372c0b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:18.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.659+0000 7f3731ce7640 1 --2- 172.21.15.123:0/1082312836 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f372c1530a0 0x7f372c0b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:18.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.659+0000 7f3731ce7640 1 -- 172.21.15.123:0/1082312836 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f372c14d9d0 msgr2=0x7f372c06e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:18.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.659+0000 7f3731ce7640 1 --2- 172.21.15.123:0/1082312836 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f372c14d9d0 0x7f372c06e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:18.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.659+0000 7f3731ce7640 1 -- 172.21.15.123:0/1082312836 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f372c150890 con 0x7f37180039b0 2024-09-15T23:20:18.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.659+0000 7f3731ce7640 1 --2- 172.21.15.123:0/1082312836 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37180039b0 0x7f372c14e1a0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f3728034040 tx=0x7f3728004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:18.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.659+0000 7f37227fc640 1 -- 172.21.15.123:0/1082312836 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372803f020 con 0x7f37180039b0 2024-09-15T23:20:18.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.659+0000 7f37227fc640 1 -- 172.21.15.123:0/1082312836 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3728037040 con 0x7f37180039b0 2024-09-15T23:20:18.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.659+0000 7f37227fc640 1 -- 172.21.15.123:0/1082312836 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3728036070 con 0x7f37180039b0 2024-09-15T23:20:18.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.659+0000 7f3733f4b640 1 -- 172.21.15.123:0/1082312836 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f372c0b5d00 con 0x7f37180039b0 2024-09-15T23:20:18.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.659+0000 7f3733f4b640 1 -- 172.21.15.123:0/1082312836 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f372c0b6280 con 0x7f37180039b0 2024-09-15T23:20:18.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.660+0000 7f3733f4b640 1 -- 172.21.15.123:0/1082312836 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f372c06bff0 con 0x7f37180039b0 2024-09-15T23:20:18.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.660+0000 7f37227fc640 1 -- 172.21.15.123:0/1082312836 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3728042020 con 0x7f37180039b0 2024-09-15T23:20:18.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.661+0000 7f37227fc640 1 --2- 172.21.15.123:0/1082312836 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f371006c2e0 0x7f371006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:18.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.661+0000 7f37227fc640 1 -- 172.21.15.123:0/1082312836 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5709+0+0 (secure 0 0 0) 0x7f37280ab380 con 0x7f37180039b0 2024-09-15T23:20:18.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.661+0000 7f37314e6640 1 --2- 172.21.15.123:0/1082312836 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f371006c2e0 0x7f371006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:18.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.662+0000 7f37314e6640 1 --2- 172.21.15.123:0/1082312836 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f371006c2e0 0x7f371006e7a0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f371c000f60 tx=0x7f371c001b60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:18.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.666+0000 7f37227fc640 1 -- 172.21.15.123:0/1082312836 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3728049030 con 0x7f37180039b0 2024-09-15T23:20:18.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.863+0000 7f3733f4b640 1 -- 172.21.15.123:0/1082312836 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f372c072f20 con 0x7f37180039b0 2024-09-15T23:20:18.870 INFO:tasks.ceph.mon.a.smithi123.stderr:2024-09-15T23:20:18.863+0000 7f8a6ccf0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:20:18.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.865+0000 7f37227fc640 1 -- 172.21.15.123:0/1082312836 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v87) ==== 161+0+0 (secure 0 0 0) 0x7f3728079c40 con 0x7f37180039b0 2024-09-15T23:20:18.871 INFO:teuthology.orchestra.run.smithi123.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T23:20:18.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.867+0000 7f3733f4b640 1 -- 172.21.15.123:0/1082312836 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f371006c2e0 msgr2=0x7f371006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:18.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.867+0000 7f3733f4b640 1 --2- 172.21.15.123:0/1082312836 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f371006c2e0 0x7f371006e7a0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f371c000f60 tx=0x7f371c001b60 comp rx=0 tx=0).stop 2024-09-15T23:20:18.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.867+0000 7f3733f4b640 1 -- 172.21.15.123:0/1082312836 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37180039b0 msgr2=0x7f372c14e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:18.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.867+0000 7f3733f4b640 1 --2- 172.21.15.123:0/1082312836 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37180039b0 0x7f372c14e1a0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f3728034040 tx=0x7f3728004730 comp rx=0 tx=0).stop 2024-09-15T23:20:18.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.867+0000 7f3733f4b640 1 -- 172.21.15.123:0/1082312836 shutdown_connections 2024-09-15T23:20:18.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.867+0000 7f3733f4b640 1 --2- 172.21.15.123:0/1082312836 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f372c14d9d0 0x7f372c06e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:18.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.867+0000 7f3733f4b640 1 --2- 172.21.15.123:0/1082312836 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f372c1530a0 0x7f372c0b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:18.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.867+0000 7f3733f4b640 1 --2- 172.21.15.123:0/1082312836 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f371006c2e0 0x7f371006e7a0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:18.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.867+0000 7f3733f4b640 1 --2- 172.21.15.123:0/1082312836 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37180039b0 0x7f372c14e1a0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:18.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.867+0000 7f3733f4b640 1 -- 172.21.15.123:0/1082312836 >> 172.21.15.123:0/1082312836 conn(0x7f372c06cd20 msgr2=0x7f372c0d1280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:18.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.867+0000 7f3733f4b640 1 -- 172.21.15.123:0/1082312836 shutdown_connections 2024-09-15T23:20:18.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.867+0000 7f3733f4b640 1 -- 172.21.15.123:0/1082312836 wait complete. 2024-09-15T23:20:18.881 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T23:20:18.911 INFO:tasks.ceph.mds.d.smithi188.stdout:starting mds.d at 2024-09-15T23:20:18.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.981+0000 7f30bd533640 1 Processor -- start 2024-09-15T23:20:18.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.981+0000 7f30bd533640 1 -- start start 2024-09-15T23:20:18.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.982+0000 7f30bd533640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30b806bfd0 0x7f30b806c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:18.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.982+0000 7f30bd533640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30b81631c0 con 0x7f30b80d3930 2024-09-15T23:20:18.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.982+0000 7f30bd533640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30b806c8f0 con 0x7f30b80b3350 2024-09-15T23:20:18.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.982+0000 7f30bd533640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f30b80b78a0 con 0x7f30b806bfd0 2024-09-15T23:20:18.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.982+0000 7f30b77fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f30b80d3930 0x7f30b8162ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59598/0 (socket says 172.21.15.123:59598) 2024-09-15T23:20:18.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.982+0000 7f30b77fe640 1 -- 172.21.15.123:0/2057782258 learned_addr learned my addr 172.21.15.123:0/2057782258 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:18.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.982+0000 7f30b5ffb640 1 -- 172.21.15.123:0/2057782258 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3543812352 0 0) 0x7f30b81631c0 con 0x7f30b80d3930 2024-09-15T23:20:18.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.982+0000 7f30b6ffd640 1 --2- 172.21.15.123:0/2057782258 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30b806bfd0 0x7f30b806c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:18.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.982+0000 7f30b5ffb640 1 -- 172.21.15.123:0/2057782258 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30a0003520 con 0x7f30b80d3930 2024-09-15T23:20:18.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.983+0000 7f30b5ffb640 1 -- 172.21.15.123:0/2057782258 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 835312271 0 0) 0x7f30a0003520 con 0x7f30b80d3930 2024-09-15T23:20:18.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.983+0000 7f30b5ffb640 1 -- 172.21.15.123:0/2057782258 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30b806bfd0 msgr2=0x7f30b806c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:18.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.983+0000 7f30b5ffb640 1 --2- 172.21.15.123:0/2057782258 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30b806bfd0 0x7f30b806c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:18.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.983+0000 7f30b5ffb640 1 -- 172.21.15.123:0/2057782258 >> v1:172.21.15.188:6789/0 conn(0x7f30b80b3350 legacy=0x7f30b81623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:18.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.983+0000 7f30b5ffb640 1 -- 172.21.15.123:0/2057782258 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b80cf710 con 0x7f30b80d3930 2024-09-15T23:20:18.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.983+0000 7f30b5ffb640 1 -- 172.21.15.123:0/2057782258 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f30b00019f0 con 0x7f30b80d3930 2024-09-15T23:20:18.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.983+0000 7f30b5ffb640 1 -- 172.21.15.123:0/2057782258 >> v1:172.21.15.123:6789/0 conn(0x7f30b80d3930 legacy=0x7f30b8162ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:18.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.983+0000 7f30b5ffb640 1 --2- 172.21.15.123:0/2057782258 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30b806bfd0 0x7f30a00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:18.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.983+0000 7f30b5ffb640 1 --2- 172.21.15.123:0/2057782258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30a0003f20 0x7f30a0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:18.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.983+0000 7f30b5ffb640 1 --2- 172.21.15.123:0/2057782258 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30a0004d40 0x7f30a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:18.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.983+0000 7f30b5ffb640 1 -- 172.21.15.123:0/2057782258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f30a000b9f0 con 0x7f30a0003f20 2024-09-15T23:20:18.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.983+0000 7f30b5ffb640 1 -- 172.21.15.123:0/2057782258 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f30a000bba0 con 0x7f30a0004d40 2024-09-15T23:20:18.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.983+0000 7f30b5ffb640 1 -- 172.21.15.123:0/2057782258 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f30a000bda0 con 0x7f30b806bfd0 2024-09-15T23:20:18.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.983+0000 7f30b67fc640 1 --2- 172.21.15.123:0/2057782258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30a0003f20 0x7f30a0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:18.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.983+0000 7f30b6ffd640 1 --2- 172.21.15.123:0/2057782258 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30b806bfd0 0x7f30a00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:18.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.983+0000 7f30b77fe640 1 --2- 172.21.15.123:0/2057782258 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30a0004d40 0x7f30a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:18.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.983+0000 7f30b67fc640 1 -- 172.21.15.123:0/2057782258 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30b806bfd0 msgr2=0x7f30a00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:18.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.983+0000 7f30b67fc640 1 --2- 172.21.15.123:0/2057782258 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30b806bfd0 0x7f30a00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:18.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.983+0000 7f30b67fc640 1 -- 172.21.15.123:0/2057782258 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30a0004d40 msgr2=0x7f30a00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:18.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.983+0000 7f30b67fc640 1 --2- 172.21.15.123:0/2057782258 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30a0004d40 0x7f30a00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:18.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.983+0000 7f30b67fc640 1 -- 172.21.15.123:0/2057782258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a0003520 con 0x7f30a0003f20 2024-09-15T23:20:18.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.984+0000 7f30b67fc640 1 --2- 172.21.15.123:0/2057782258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30a0003f20 0x7f30a0004800 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f30b80d1110 tx=0x7f30a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e5e5c65909c9f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:18.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.984+0000 7f30b5ffb640 1 -- 172.21.15.123:0/2057782258 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac037070 con 0x7f30a0003f20 2024-09-15T23:20:18.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.984+0000 7f30b5ffb640 1 -- 172.21.15.123:0/2057782258 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30ac02aaa0 con 0x7f30a0003f20 2024-09-15T23:20:18.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.984+0000 7f30b5ffb640 1 -- 172.21.15.123:0/2057782258 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac001450 con 0x7f30a0003f20 2024-09-15T23:20:18.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.984+0000 7f30bd533640 1 -- 172.21.15.123:0/2057782258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30a0003f20 msgr2=0x7f30a0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:18.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.984+0000 7f30bd533640 1 --2- 172.21.15.123:0/2057782258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30a0003f20 0x7f30a0004800 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f30b80d1110 tx=0x7f30a0005830 comp rx=0 tx=0).stop 2024-09-15T23:20:18.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.984+0000 7f30b77fe640 1 -- 172.21.15.123:0/2057782258 reap_dead start 2024-09-15T23:20:18.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.984+0000 7f30bd533640 1 -- 172.21.15.123:0/2057782258 shutdown_connections 2024-09-15T23:20:18.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.985+0000 7f30bd533640 1 -- 172.21.15.123:0/2057782258 >> 172.21.15.123:0/2057782258 conn(0x7f30b80d11c0 msgr2=0x7f30b80d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:18.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.985+0000 7f30bd533640 1 -- 172.21.15.123:0/2057782258 shutdown_connections 2024-09-15T23:20:18.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.985+0000 7f30bd533640 1 -- 172.21.15.123:0/2057782258 wait complete. 2024-09-15T23:20:18.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.986+0000 7f30bd533640 1 Processor -- start 2024-09-15T23:20:18.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.986+0000 7f30bd533640 1 -- start start 2024-09-15T23:20:18.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.987+0000 7f30bd533640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30a0003f20 0x7f30b814cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:18.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.987+0000 7f30bd533640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30b80cd9b0 0x7f30b815a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:18.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.987+0000 7f30bd533640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30b8157b80 0x7f30b8158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:18.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.987+0000 7f30bd533640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f30b80cfcd0 con 0x7f30b8157b80 2024-09-15T23:20:18.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.987+0000 7f30bd533640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f30b80cffb0 con 0x7f30b80cd9b0 2024-09-15T23:20:18.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.987+0000 7f30bd533640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f30b80d2400 con 0x7f30a0003f20 2024-09-15T23:20:18.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.987+0000 7f30b77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30b8157b80 0x7f30b8158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:18.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.987+0000 7f30b77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30b8157b80 0x7f30b8158030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60614/0 (socket says 172.21.15.123:60614) 2024-09-15T23:20:18.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.987+0000 7f30b77fe640 1 -- 172.21.15.123:0/1614165647 learned_addr learned my addr 172.21.15.123:0/1614165647 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:18.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.987+0000 7f30b6ffd640 1 --2- 172.21.15.123:0/1614165647 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30a0003f20 0x7f30b814cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:18.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.987+0000 7f30b67fc640 1 --2- 172.21.15.123:0/1614165647 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30b80cd9b0 0x7f30b815a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:18.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.987+0000 7f30b77fe640 1 -- 172.21.15.123:0/1614165647 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30a0003f20 msgr2=0x7f30b814cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:18.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.987+0000 7f30b77fe640 1 --2- 172.21.15.123:0/1614165647 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30a0003f20 0x7f30b814cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:18.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.987+0000 7f30b77fe640 1 -- 172.21.15.123:0/1614165647 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30b80cd9b0 msgr2=0x7f30b815a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:18.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.987+0000 7f30b77fe640 1 --2- 172.21.15.123:0/1614165647 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30b80cd9b0 0x7f30b815a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:18.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.987+0000 7f30b77fe640 1 -- 172.21.15.123:0/1614165647 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b80cdf00 con 0x7f30b8157b80 2024-09-15T23:20:18.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.987+0000 7f30b77fe640 1 --2- 172.21.15.123:0/1614165647 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30b8157b80 0x7f30b8158030 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f30b0000f80 tx=0x7f30b0007b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:18.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.987+0000 7f309f7fe640 1 -- 172.21.15.123:0/1614165647 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b0017020 con 0x7f30b8157b80 2024-09-15T23:20:18.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.987+0000 7f309f7fe640 1 -- 172.21.15.123:0/1614165647 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30b000ab60 con 0x7f30b8157b80 2024-09-15T23:20:18.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.987+0000 7f309f7fe640 1 -- 172.21.15.123:0/1614165647 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b00133f0 con 0x7f30b8157b80 2024-09-15T23:20:18.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.987+0000 7f30bd533640 1 -- 172.21.15.123:0/1614165647 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30b80ce1e0 con 0x7f30b8157b80 2024-09-15T23:20:18.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.987+0000 7f30bd533640 1 -- 172.21.15.123:0/1614165647 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30b80ce7a0 con 0x7f30b8157b80 2024-09-15T23:20:18.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.988+0000 7f30bd533640 1 -- 172.21.15.123:0/1614165647 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30b80ceb80 con 0x7f30b8157b80 2024-09-15T23:20:18.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.989+0000 7f309f7fe640 1 -- 172.21.15.123:0/1614165647 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f30b001a020 con 0x7f30b8157b80 2024-09-15T23:20:18.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.989+0000 7f309f7fe640 1 --2- 172.21.15.123:0/1614165647 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f30a406c2e0 0x7f30a406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:18.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.989+0000 7f309f7fe640 1 -- 172.21.15.123:0/1614165647 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5795+0+0 (secure 0 0 0) 0x7f30b008baf0 con 0x7f30b8157b80 2024-09-15T23:20:19.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.990+0000 7f30b6ffd640 1 --2- 172.21.15.123:0/1614165647 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f30a406c2e0 0x7f30a406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:19.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.990+0000 7f30b6ffd640 1 --2- 172.21.15.123:0/1614165647 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f30a406c2e0 0x7f30a406e7a0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f30b80ba3a0 tx=0x7f30a8009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:19.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:18.994+0000 7f309f7fe640 1 -- 172.21.15.123:0/1614165647 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f30b80ceb80 con 0x7f30b8157b80 2024-09-15T23:20:19.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.194+0000 7f30bd533640 1 -- 172.21.15.123:0/1614165647 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f30b80d0cf0 con 0x7f30b8157b80 2024-09-15T23:20:19.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.867+0000 7f309f7fe640 1 -- 172.21.15.123:0/1614165647 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v88) ==== 104+0+0 (secure 0 0 0) 0x7f30b0021020 con 0x7f30b8157b80 2024-09-15T23:20:19.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.870+0000 7f30bd533640 1 -- 172.21.15.123:0/1614165647 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f30a406c2e0 msgr2=0x7f30a406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:19.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.870+0000 7f30bd533640 1 --2- 172.21.15.123:0/1614165647 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f30a406c2e0 0x7f30a406e7a0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f30b80ba3a0 tx=0x7f30a8009190 comp rx=0 tx=0).stop 2024-09-15T23:20:19.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.870+0000 7f30bd533640 1 -- 172.21.15.123:0/1614165647 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30b8157b80 msgr2=0x7f30b8158030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:19.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.870+0000 7f30bd533640 1 --2- 172.21.15.123:0/1614165647 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30b8157b80 0x7f30b8158030 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f30b0000f80 tx=0x7f30b0007b10 comp rx=0 tx=0).stop 2024-09-15T23:20:19.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.870+0000 7f30bd533640 1 -- 172.21.15.123:0/1614165647 shutdown_connections 2024-09-15T23:20:19.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.870+0000 7f30bd533640 1 --2- 172.21.15.123:0/1614165647 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f30a406c2e0 0x7f30a406e7a0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:19.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.870+0000 7f30bd533640 1 --2- 172.21.15.123:0/1614165647 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30b8157b80 0x7f30b8158030 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:19.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.870+0000 7f30bd533640 1 --2- 172.21.15.123:0/1614165647 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f30b80cd9b0 0x7f30b815a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:19.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.870+0000 7f30bd533640 1 --2- 172.21.15.123:0/1614165647 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f30a0003f20 0x7f30b814cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:19.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.870+0000 7f30bd533640 1 -- 172.21.15.123:0/1614165647 >> 172.21.15.123:0/1614165647 conn(0x7f30b80d11c0 msgr2=0x7f30b80b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:19.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.870+0000 7f30bd533640 1 -- 172.21.15.123:0/1614165647 shutdown_connections 2024-09-15T23:20:19.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.870+0000 7f30bd533640 1 -- 172.21.15.123:0/1614165647 wait complete. 2024-09-15T23:20:19.883 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T23:20:19.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.986+0000 7f8d2fa47640 1 Processor -- start 2024-09-15T23:20:19.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.986+0000 7f8d2fa47640 1 -- start start 2024-09-15T23:20:19.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.987+0000 7f8d2fa47640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8d28155b20 0x7f8d280b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:19.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.987+0000 7f8d2fa47640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d280b0680 con 0x7f8d280cfb30 2024-09-15T23:20:19.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.987+0000 7f8d2fa47640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d280ccf70 con 0x7f8d280b21a0 2024-09-15T23:20:19.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.987+0000 7f8d2fa47640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f8d280b01e0 con 0x7f8d28155b20 2024-09-15T23:20:19.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.987+0000 7f8d2d7e3640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8d28155b20 0x7f8d280b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:19.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.987+0000 7f8d2dfe4640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8d280cfb30 0x7f8d2815c3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59608/0 (socket says 172.21.15.123:59608) 2024-09-15T23:20:19.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.987+0000 7f8d2dfe4640 1 -- 172.21.15.123:0/1528886669 learned_addr learned my addr 172.21.15.123:0/1528886669 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:19.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.987+0000 7f8d2d7e3640 1 -- 172.21.15.123:0/1528886669 >> v1:172.21.15.188:6789/0 conn(0x7f8d280b21a0 legacy=0x7f8d280cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:19.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.987+0000 7f8d2d7e3640 1 -- 172.21.15.123:0/1528886669 >> v1:172.21.15.123:6789/0 conn(0x7f8d280cfb30 legacy=0x7f8d2815c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:19.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.987+0000 7f8d2d7e3640 1 -- 172.21.15.123:0/1528886669 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d280ce940 con 0x7f8d28155b20 2024-09-15T23:20:19.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.988+0000 7f8d2d7e3640 1 --2- 172.21.15.123:0/1528886669 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d28155b20 0x7f8d280b1c60 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f8d24009d90 tx=0x7f8d2402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3ffeeefbf434b53 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:19.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.988+0000 7f8d1ffff640 1 -- 172.21.15.123:0/1528886669 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d24007740 con 0x7f8d28155b20 2024-09-15T23:20:19.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.988+0000 7f8d1ffff640 1 -- 172.21.15.123:0/1528886669 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d240078e0 con 0x7f8d28155b20 2024-09-15T23:20:19.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.988+0000 7f8d1ffff640 1 -- 172.21.15.123:0/1528886669 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d24007cb0 con 0x7f8d28155b20 2024-09-15T23:20:19.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.989+0000 7f8d2fa47640 1 -- 172.21.15.123:0/1528886669 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d28155b20 msgr2=0x7f8d280b1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:19.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.989+0000 7f8d2fa47640 1 --2- 172.21.15.123:0/1528886669 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d28155b20 0x7f8d280b1c60 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f8d24009d90 tx=0x7f8d2402a6f0 comp rx=0 tx=0).stop 2024-09-15T23:20:19.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.989+0000 7f8d2fa47640 1 -- 172.21.15.123:0/1528886669 shutdown_connections 2024-09-15T23:20:19.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.989+0000 7f8d2fa47640 1 --2- 172.21.15.123:0/1528886669 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d28155b20 0x7f8d280b1c60 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:19.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.989+0000 7f8d2fa47640 1 -- 172.21.15.123:0/1528886669 >> 172.21.15.123:0/1528886669 conn(0x7f8d2806c240 msgr2=0x7f8d2806d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:19.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.989+0000 7f8d2fa47640 1 -- 172.21.15.123:0/1528886669 shutdown_connections 2024-09-15T23:20:19.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.989+0000 7f8d2fa47640 1 -- 172.21.15.123:0/1528886669 wait complete. 2024-09-15T23:20:19.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.990+0000 7f8d2fa47640 1 Processor -- start 2024-09-15T23:20:19.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.990+0000 7f8d2fa47640 1 -- start start 2024-09-15T23:20:19.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.991+0000 7f8d2fa47640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d280b21a0 0x7f8d281507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:19.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.991+0000 7f8d2fa47640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8d280cfb30 0x7f8d2814a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:19.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.991+0000 7f8d2fa47640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8d28155b20 0x7f8d2814ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:19.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.991+0000 7f8d2fa47640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8d280ce610 con 0x7f8d280b21a0 2024-09-15T23:20:19.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.991+0000 7f8d2fa47640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8d280cef00 con 0x7f8d280cfb30 2024-09-15T23:20:19.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.991+0000 7f8d2fa47640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8d280ccb20 con 0x7f8d28155b20 2024-09-15T23:20:19.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.991+0000 7f8d2d7e3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d280b21a0 0x7f8d281507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:19.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.991+0000 7f8d2d7e3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d280b21a0 0x7f8d281507f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60626/0 (socket says 172.21.15.123:60626) 2024-09-15T23:20:19.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.991+0000 7f8d2d7e3640 1 -- 172.21.15.123:0/1638143812 learned_addr learned my addr 172.21.15.123:0/1638143812 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:19.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.991+0000 7f8d2d7e3640 1 -- 172.21.15.123:0/1638143812 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8d28155b20 msgr2=0x7f8d2814ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:19.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.991+0000 7f8d2d7e3640 1 --2- 172.21.15.123:0/1638143812 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8d28155b20 0x7f8d2814ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:19.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.991+0000 7f8d2d7e3640 1 -- 172.21.15.123:0/1638143812 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8d280cfb30 msgr2=0x7f8d2814a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:19.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.991+0000 7f8d2d7e3640 1 --2- 172.21.15.123:0/1638143812 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8d280cfb30 0x7f8d2814a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:19.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.991+0000 7f8d2d7e3640 1 -- 172.21.15.123:0/1638143812 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d28158f20 con 0x7f8d280b21a0 2024-09-15T23:20:19.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.991+0000 7f8d2d7e3640 1 --2- 172.21.15.123:0/1638143812 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d280b21a0 0x7f8d281507f0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f8d24009d90 tx=0x7f8d24004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:19.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.991+0000 7f8d1dffb640 1 -- 172.21.15.123:0/1638143812 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2403f070 con 0x7f8d280b21a0 2024-09-15T23:20:19.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.991+0000 7f8d1dffb640 1 -- 172.21.15.123:0/1638143812 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d24031c40 con 0x7f8d280b21a0 2024-09-15T23:20:19.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.991+0000 7f8d2fa47640 1 -- 172.21.15.123:0/1638143812 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d281512b0 con 0x7f8d280b21a0 2024-09-15T23:20:19.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.991+0000 7f8d1dffb640 1 -- 172.21.15.123:0/1638143812 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d24044460 con 0x7f8d280b21a0 2024-09-15T23:20:19.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.991+0000 7f8d2fa47640 1 -- 172.21.15.123:0/1638143812 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d28151870 con 0x7f8d280b21a0 2024-09-15T23:20:19.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.992+0000 7f8d2fa47640 1 -- 172.21.15.123:0/1638143812 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d280b1c60 con 0x7f8d280b21a0 2024-09-15T23:20:19.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.993+0000 7f8d1dffb640 1 -- 172.21.15.123:0/1638143812 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8d2403b410 con 0x7f8d280b21a0 2024-09-15T23:20:19.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.993+0000 7f8d1dffb640 1 --2- 172.21.15.123:0/1638143812 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8d0c06c2b0 0x7f8d0c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:19.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.993+0000 7f8d1dffb640 1 -- 172.21.15.123:0/1638143812 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5795+0+0 (secure 0 0 0) 0x7f8d240ace00 con 0x7f8d280b21a0 2024-09-15T23:20:19.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.994+0000 7f8d2cfe2640 1 --2- 172.21.15.123:0/1638143812 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8d0c06c2b0 0x7f8d0c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:19.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.994+0000 7f8d2cfe2640 1 --2- 172.21.15.123:0/1638143812 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8d0c06c2b0 0x7f8d0c06e770 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f8d18000f60 tx=0x7f8d180079d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:19.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:19.998+0000 7f8d1dffb640 1 -- 172.21.15.123:0/1638143812 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8d2407b510 con 0x7f8d280b21a0 2024-09-15T23:20:20.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:20.165+0000 7f8d2fa47640 1 -- 172.21.15.123:0/1638143812 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8d28151fe0 con 0x7f8d280b21a0 2024-09-15T23:20:20.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:20.868+0000 7f8d1dffb640 1 -- 172.21.15.123:0/1638143812 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v144) ==== 181+0+0 (secure 0 0 0) 0x7f8d2407ae10 con 0x7f8d280b21a0 2024-09-15T23:20:20.869 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' removed 2024-09-15T23:20:20.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:20.876+0000 7f8d2fa47640 1 -- 172.21.15.123:0/1638143812 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8d0c06c2b0 msgr2=0x7f8d0c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:20.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:20.876+0000 7f8d2fa47640 1 --2- 172.21.15.123:0/1638143812 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8d0c06c2b0 0x7f8d0c06e770 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f8d18000f60 tx=0x7f8d180079d0 comp rx=0 tx=0).stop 2024-09-15T23:20:20.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:20.876+0000 7f8d2fa47640 1 -- 172.21.15.123:0/1638143812 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d280b21a0 msgr2=0x7f8d281507f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:20.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:20.876+0000 7f8d2fa47640 1 --2- 172.21.15.123:0/1638143812 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d280b21a0 0x7f8d281507f0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f8d24009d90 tx=0x7f8d24004a40 comp rx=0 tx=0).stop 2024-09-15T23:20:20.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:20.877+0000 7f8d2fa47640 1 -- 172.21.15.123:0/1638143812 shutdown_connections 2024-09-15T23:20:20.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:20.877+0000 7f8d2fa47640 1 --2- 172.21.15.123:0/1638143812 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8d28155b20 0x7f8d2814ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:20.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:20.877+0000 7f8d2fa47640 1 --2- 172.21.15.123:0/1638143812 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8d280cfb30 0x7f8d2814a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:20.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:20.877+0000 7f8d2fa47640 1 --2- 172.21.15.123:0/1638143812 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8d0c06c2b0 0x7f8d0c06e770 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:20.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:20.877+0000 7f8d2fa47640 1 --2- 172.21.15.123:0/1638143812 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d280b21a0 0x7f8d281507f0 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:20.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:20.877+0000 7f8d2fa47640 1 -- 172.21.15.123:0/1638143812 >> 172.21.15.123:0/1638143812 conn(0x7f8d2806c240 msgr2=0x7f8d280b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:20.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:20.878+0000 7f8d2fa47640 1 -- 172.21.15.123:0/1638143812 shutdown_connections 2024-09-15T23:20:20.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:20.878+0000 7f8d2fa47640 1 -- 172.21.15.123:0/1638143812 wait complete. 2024-09-15T23:20:20.893 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T23:20:21.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:20.999+0000 7ff4dee1e640 1 Processor -- start 2024-09-15T23:20:21.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:20.999+0000 7ff4dee1e640 1 -- start start 2024-09-15T23:20:21.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:20.999+0000 7ff4dee1e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff4d80ce760 0x7ff4d806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:21.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:20.999+0000 7ff4dee1e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff4d806e600 0x7ff4d8174ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:21.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:20.999+0000 7ff4dee1e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4d816ec50 con 0x7ff4d816e870 2024-09-15T23:20:21.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:20.999+0000 7ff4dee1e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7ff4d806ea30 con 0x7ff4d806e600 2024-09-15T23:20:21.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:20.999+0000 7ff4dee1e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7ff4d80b3a00 con 0x7ff4d80ce760 2024-09-15T23:20:21.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.000+0000 7ff4dd3bb640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff4d806e600 0x7ff4d8174ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:21.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.000+0000 7ff4dcbba640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff4d816e870 0x7ff4d80b20c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59616/0 (socket says 172.21.15.123:59616) 2024-09-15T23:20:21.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.000+0000 7ff4dcbba640 1 -- 172.21.15.123:0/2796783268 learned_addr learned my addr 172.21.15.123:0/2796783268 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:21.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.000+0000 7ff4d77fe640 1 -- 172.21.15.123:0/2796783268 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3290674533 0 0) 0x7ff4d816ec50 con 0x7ff4d816e870 2024-09-15T23:20:21.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.000+0000 7ff4d7fff640 1 --2- 172.21.15.123:0/2796783268 >> v2:172.21.15.188:3300/0 conn(0x7ff4d80ce760 0x7ff4d806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:21.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.059+0000 7ff4d77fe640 1 -- 172.21.15.123:0/2796783268 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4c8003500 con 0x7ff4d816e870 2024-09-15T23:20:21.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.059+0000 7ff4dd3bb640 1 -- 172.21.15.123:0/2796783268 >> v2:172.21.15.188:3300/0 conn(0x7ff4d80ce760 msgr2=0x7ff4d806e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:21.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.059+0000 7ff4dd3bb640 1 --2- 172.21.15.123:0/2796783268 >> v2:172.21.15.188:3300/0 conn(0x7ff4d80ce760 0x7ff4d806e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:21.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.059+0000 7ff4dd3bb640 1 -- 172.21.15.123:0/2796783268 >> v1:172.21.15.123:6789/0 conn(0x7ff4d816e870 legacy=0x7ff4d80b20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:21.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.059+0000 7ff4dd3bb640 1 -- 172.21.15.123:0/2796783268 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4d80b3ce0 con 0x7ff4d806e600 2024-09-15T23:20:21.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.060+0000 7ff4dd3bb640 1 --2- 172.21.15.123:0/2796783268 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4d806e600 0x7ff4d8174ef0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7ff4d000be30 tx=0x7ff4d000a400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d41beb0f9ab08a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:21.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.060+0000 7ff4d77fe640 1 -- 172.21.15.123:0/2796783268 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d0038070 con 0x7ff4d806e600 2024-09-15T23:20:21.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.060+0000 7ff4d77fe640 1 -- 172.21.15.123:0/2796783268 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4d0030480 con 0x7ff4d806e600 2024-09-15T23:20:21.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.060+0000 7ff4d77fe640 1 -- 172.21.15.123:0/2796783268 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d0030850 con 0x7ff4d806e600 2024-09-15T23:20:21.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.061+0000 7ff4dee1e640 1 -- 172.21.15.123:0/2796783268 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4d806e600 msgr2=0x7ff4d8174ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:21.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.061+0000 7ff4dee1e640 1 --2- 172.21.15.123:0/2796783268 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4d806e600 0x7ff4d8174ef0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7ff4d000be30 tx=0x7ff4d000a400 comp rx=0 tx=0).stop 2024-09-15T23:20:21.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.061+0000 7ff4dee1e640 1 -- 172.21.15.123:0/2796783268 shutdown_connections 2024-09-15T23:20:21.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.061+0000 7ff4dee1e640 1 --2- 172.21.15.123:0/2796783268 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4d806e600 0x7ff4d8174ef0 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:21.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.061+0000 7ff4dee1e640 1 --2- 172.21.15.123:0/2796783268 >> v2:172.21.15.188:3300/0 conn(0x7ff4d80ce760 0x7ff4d806e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:21.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.061+0000 7ff4dee1e640 1 -- 172.21.15.123:0/2796783268 >> 172.21.15.123:0/2796783268 conn(0x7ff4d806c030 msgr2=0x7ff4d806c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:21.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.061+0000 7ff4dee1e640 1 -- 172.21.15.123:0/2796783268 shutdown_connections 2024-09-15T23:20:21.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.061+0000 7ff4dee1e640 1 -- 172.21.15.123:0/2796783268 wait complete. 2024-09-15T23:20:21.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.062+0000 7ff4dee1e640 1 Processor -- start 2024-09-15T23:20:21.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.062+0000 7ff4dee1e640 1 -- start start 2024-09-15T23:20:21.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.063+0000 7ff4dee1e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff4d806e600 0x7ff4d8161d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:21.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.063+0000 7ff4dee1e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff4d80ce760 0x7ff4d80ae6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:21.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.063+0000 7ff4dee1e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4d816e870 0x7ff4d816ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:21.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.063+0000 7ff4dee1e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d80b4580 con 0x7ff4d816e870 2024-09-15T23:20:21.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.063+0000 7ff4dee1e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff4d80b42a0 con 0x7ff4d806e600 2024-09-15T23:20:21.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.063+0000 7ff4dee1e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ff4d80b35e0 con 0x7ff4d80ce760 2024-09-15T23:20:21.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.063+0000 7ff4dd3bb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4d816e870 0x7ff4d816ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:21.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.063+0000 7ff4dd3bb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4d816e870 0x7ff4d816ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60648/0 (socket says 172.21.15.123:60648) 2024-09-15T23:20:21.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.063+0000 7ff4dd3bb640 1 -- 172.21.15.123:0/3162167286 learned_addr learned my addr 172.21.15.123:0/3162167286 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:21.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.064+0000 7ff4dd3bb640 1 -- 172.21.15.123:0/3162167286 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff4d80ce760 msgr2=0x7ff4d80ae6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:21.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.064+0000 7ff4dd3bb640 1 --2- 172.21.15.123:0/3162167286 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff4d80ce760 0x7ff4d80ae6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:21.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.064+0000 7ff4dd3bb640 1 -- 172.21.15.123:0/3162167286 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff4d806e600 msgr2=0x7ff4d8161d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:21.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.064+0000 7ff4dd3bb640 1 --2- 172.21.15.123:0/3162167286 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff4d806e600 0x7ff4d8161d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:21.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.064+0000 7ff4dd3bb640 1 -- 172.21.15.123:0/3162167286 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4d80ad640 con 0x7ff4d816e870 2024-09-15T23:20:21.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.064+0000 7ff4dd3bb640 1 --2- 172.21.15.123:0/3162167286 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4d816e870 0x7ff4d816ae50 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7ff4d000be30 tx=0x7ff4d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:21.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.064+0000 7ff4d57fa640 1 -- 172.21.15.123:0/3162167286 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d0042020 con 0x7ff4d816e870 2024-09-15T23:20:21.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.064+0000 7ff4d57fa640 1 -- 172.21.15.123:0/3162167286 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4d003d670 con 0x7ff4d816e870 2024-09-15T23:20:21.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.064+0000 7ff4dee1e640 1 -- 172.21.15.123:0/3162167286 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4d80ad920 con 0x7ff4d816e870 2024-09-15T23:20:21.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.064+0000 7ff4d57fa640 1 -- 172.21.15.123:0/3162167286 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d0038040 con 0x7ff4d816e870 2024-09-15T23:20:21.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.064+0000 7ff4dee1e640 1 -- 172.21.15.123:0/3162167286 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4d80adee0 con 0x7ff4d816e870 2024-09-15T23:20:21.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.065+0000 7ff4dee1e640 1 -- 172.21.15.123:0/3162167286 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4d806e0c0 con 0x7ff4d816e870 2024-09-15T23:20:21.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.066+0000 7ff4d57fa640 1 -- 172.21.15.123:0/3162167286 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff4d0045020 con 0x7ff4d816e870 2024-09-15T23:20:21.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.066+0000 7ff4d57fa640 1 --2- 172.21.15.123:0/3162167286 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff4bc06c2b0 0x7ff4bc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:21.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.066+0000 7ff4d57fa640 1 -- 172.21.15.123:0/3162167286 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5357+0+0 (secure 0 0 0) 0x7ff4d00abd40 con 0x7ff4d816e870 2024-09-15T23:20:21.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.066+0000 7ff4dcbba640 1 --2- 172.21.15.123:0/3162167286 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff4bc06c2b0 0x7ff4bc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:21.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.067+0000 7ff4dcbba640 1 --2- 172.21.15.123:0/3162167286 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff4bc06c2b0 0x7ff4bc06e770 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc000f60 tx=0x7ff4cc0078f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:21.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.070+0000 7ff4d57fa640 1 -- 172.21.15.123:0/3162167286 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff4d004c030 con 0x7ff4d816e870 2024-09-15T23:20:21.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.236+0000 7ff4dee1e640 1 -- 172.21.15.123:0/3162167286 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff4d8072790 con 0x7ff4d816e870 2024-09-15T23:20:21.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.872+0000 7ff4d57fa640 1 -- 172.21.15.123:0/3162167286 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v145) ==== 169+0+0 (secure 0 0 0) 0x7ff4d007a6a0 con 0x7ff4d816e870 2024-09-15T23:20:21.873 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' removed 2024-09-15T23:20:21.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.877+0000 7ff4dee1e640 1 -- 172.21.15.123:0/3162167286 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff4bc06c2b0 msgr2=0x7ff4bc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:21.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.877+0000 7ff4dee1e640 1 --2- 172.21.15.123:0/3162167286 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff4bc06c2b0 0x7ff4bc06e770 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc000f60 tx=0x7ff4cc0078f0 comp rx=0 tx=0).stop 2024-09-15T23:20:21.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.877+0000 7ff4dee1e640 1 -- 172.21.15.123:0/3162167286 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4d816e870 msgr2=0x7ff4d816ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:21.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.877+0000 7ff4dee1e640 1 --2- 172.21.15.123:0/3162167286 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4d816e870 0x7ff4d816ae50 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7ff4d000be30 tx=0x7ff4d0004a40 comp rx=0 tx=0).stop 2024-09-15T23:20:21.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.878+0000 7ff4dee1e640 1 -- 172.21.15.123:0/3162167286 shutdown_connections 2024-09-15T23:20:21.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.878+0000 7ff4dee1e640 1 --2- 172.21.15.123:0/3162167286 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff4bc06c2b0 0x7ff4bc06e770 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:21.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.878+0000 7ff4dee1e640 1 --2- 172.21.15.123:0/3162167286 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4d816e870 0x7ff4d816ae50 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:21.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.878+0000 7ff4dee1e640 1 --2- 172.21.15.123:0/3162167286 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff4d80ce760 0x7ff4d80ae6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:21.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.878+0000 7ff4dee1e640 1 --2- 172.21.15.123:0/3162167286 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff4d806e600 0x7ff4d8161d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:21.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.878+0000 7ff4dee1e640 1 -- 172.21.15.123:0/3162167286 >> 172.21.15.123:0/3162167286 conn(0x7ff4d806c030 msgr2=0x7ff4d80cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:21.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.881+0000 7ff4dee1e640 1 -- 172.21.15.123:0/3162167286 shutdown_connections 2024-09-15T23:20:21.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:21.882+0000 7ff4dee1e640 1 -- 172.21.15.123:0/3162167286 wait complete. 2024-09-15T23:20:21.905 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T23:20:22.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.005+0000 7f2e5c59f640 1 Processor -- start 2024-09-15T23:20:22.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.005+0000 7f2e5c59f640 1 -- start start 2024-09-15T23:20:22.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.006+0000 7f2e5c59f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e54073600 0x7f2e54162c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:22.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.006+0000 7f2e5c59f640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e54073cc0 con 0x7f2e540afb20 2024-09-15T23:20:22.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.006+0000 7f2e5c59f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e54071aa0 con 0x7f2e54155950 2024-09-15T23:20:22.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.006+0000 7f2e5c59f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f2e541631c0 con 0x7f2e54073600 2024-09-15T23:20:22.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.006+0000 7f2e5ab3c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f2e540afb20 0x7f2e5415f2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59620/0 (socket says 172.21.15.123:59620) 2024-09-15T23:20:22.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.006+0000 7f2e5ab3c640 1 -- 172.21.15.123:0/112914622 learned_addr learned my addr 172.21.15.123:0/112914622 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:22.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.006+0000 7f2e59b3a640 1 --2- 172.21.15.123:0/112914622 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e54073600 0x7f2e54162c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:22.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.006+0000 7f2e59339640 1 -- 172.21.15.123:0/112914622 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 153832898 0 0) 0x7f2e54073cc0 con 0x7f2e540afb20 2024-09-15T23:20:22.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.006+0000 7f2e59339640 1 -- 172.21.15.123:0/112914622 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e40003520 con 0x7f2e540afb20 2024-09-15T23:20:22.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.006+0000 7f2e59339640 1 -- 172.21.15.123:0/112914622 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2831431038 0 0) 0x7f2e54071aa0 con 0x7f2e54155950 2024-09-15T23:20:22.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.006+0000 7f2e59339640 1 -- 172.21.15.123:0/112914622 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e54073cc0 con 0x7f2e54155950 2024-09-15T23:20:22.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.006+0000 7f2e59339640 1 -- 172.21.15.123:0/112914622 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3186898018 0 0) 0x7f2e40003520 con 0x7f2e540afb20 2024-09-15T23:20:22.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.006+0000 7f2e59339640 1 -- 172.21.15.123:0/112914622 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e54073600 msgr2=0x7f2e54162c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:22.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.006+0000 7f2e59339640 1 --2- 172.21.15.123:0/112914622 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e54073600 0x7f2e54162c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:22.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.006+0000 7f2e59339640 1 -- 172.21.15.123:0/112914622 >> v1:172.21.15.188:6789/0 conn(0x7f2e54155950 legacy=0x7f2e5406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:22.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.007+0000 7f2e59339640 1 -- 172.21.15.123:0/112914622 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e54071d80 con 0x7f2e540afb20 2024-09-15T23:20:22.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.007+0000 7f2e59339640 1 -- 172.21.15.123:0/112914622 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f2e4c001670 con 0x7f2e540afb20 2024-09-15T23:20:22.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.007+0000 7f2e59339640 1 -- 172.21.15.123:0/112914622 >> v1:172.21.15.123:6789/0 conn(0x7f2e540afb20 legacy=0x7f2e5415f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:22.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.007+0000 7f2e59339640 1 --2- 172.21.15.123:0/112914622 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e40003b70 0x7f2e40003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:22.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.007+0000 7f2e59339640 1 --2- 172.21.15.123:0/112914622 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e54073600 0x7f2e40004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:22.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.007+0000 7f2e59339640 1 --2- 172.21.15.123:0/112914622 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e40004d40 0x7f2e400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:22.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.007+0000 7f2e59339640 1 -- 172.21.15.123:0/112914622 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2e541631c0 con 0x7f2e40003b70 2024-09-15T23:20:22.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.007+0000 7f2e59339640 1 -- 172.21.15.123:0/112914622 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2e4000baa0 con 0x7f2e40004d40 2024-09-15T23:20:22.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.007+0000 7f2e59339640 1 -- 172.21.15.123:0/112914622 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f2e4000bca0 con 0x7f2e54073600 2024-09-15T23:20:22.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.007+0000 7f2e5a33b640 1 --2- 172.21.15.123:0/112914622 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e40003b70 0x7f2e40003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:22.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.007+0000 7f2e59b3a640 1 --2- 172.21.15.123:0/112914622 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e54073600 0x7f2e40004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:22.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.007+0000 7f2e5ab3c640 1 --2- 172.21.15.123:0/112914622 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e40004d40 0x7f2e400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:22.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.007+0000 7f2e5a33b640 1 -- 172.21.15.123:0/112914622 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e54073600 msgr2=0x7f2e40004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:22.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.007+0000 7f2e5a33b640 1 --2- 172.21.15.123:0/112914622 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e54073600 0x7f2e40004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:22.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.007+0000 7f2e5a33b640 1 -- 172.21.15.123:0/112914622 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e40004d40 msgr2=0x7f2e400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:22.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.007+0000 7f2e5a33b640 1 --2- 172.21.15.123:0/112914622 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e40004d40 0x7f2e400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:22.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.007+0000 7f2e5a33b640 1 -- 172.21.15.123:0/112914622 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e40003520 con 0x7f2e40003b70 2024-09-15T23:20:22.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.008+0000 7f2e5a33b640 1 --2- 172.21.15.123:0/112914622 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e40003b70 0x7f2e40003f70 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f2e50001fd0 tx=0x7f2e40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a09107eaa15c26 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:22.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.008+0000 7f2e59339640 1 -- 172.21.15.123:0/112914622 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e50001bf0 con 0x7f2e40003b70 2024-09-15T23:20:22.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.008+0000 7f2e59339640 1 -- 172.21.15.123:0/112914622 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e50003b70 con 0x7f2e40003b70 2024-09-15T23:20:22.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.008+0000 7f2e59339640 1 -- 172.21.15.123:0/112914622 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e500050d0 con 0x7f2e40003b70 2024-09-15T23:20:22.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.008+0000 7f2e5c59f640 1 -- 172.21.15.123:0/112914622 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e40003b70 msgr2=0x7f2e40003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:22.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.008+0000 7f2e5c59f640 1 --2- 172.21.15.123:0/112914622 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e40003b70 0x7f2e40003f70 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f2e50001fd0 tx=0x7f2e40005830 comp rx=0 tx=0).stop 2024-09-15T23:20:22.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.008+0000 7f2e5ab3c640 1 -- 172.21.15.123:0/112914622 reap_dead start 2024-09-15T23:20:22.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.008+0000 7f2e5c59f640 1 -- 172.21.15.123:0/112914622 shutdown_connections 2024-09-15T23:20:22.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.008+0000 7f2e5c59f640 1 -- 172.21.15.123:0/112914622 >> 172.21.15.123:0/112914622 conn(0x7f2e5406db30 msgr2=0x7f2e5406df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:22.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.008+0000 7f2e5c59f640 1 -- 172.21.15.123:0/112914622 shutdown_connections 2024-09-15T23:20:22.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.008+0000 7f2e5c59f640 1 -- 172.21.15.123:0/112914622 wait complete. 2024-09-15T23:20:22.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.010+0000 7f2e5c59f640 1 Processor -- start 2024-09-15T23:20:22.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.010+0000 7f2e5c59f640 1 -- start start 2024-09-15T23:20:22.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.010+0000 7f2e5c59f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e40003b70 0x7f2e540cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:22.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.010+0000 7f2e5c59f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e540ce870 0x7f2e540c6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:22.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.010+0000 7f2e5c59f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e541450d0 0x7f2e540cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:22.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.010+0000 7f2e5c59f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2e54073a60 con 0x7f2e40003b70 2024-09-15T23:20:22.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.010+0000 7f2e5c59f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2e54070370 con 0x7f2e541450d0 2024-09-15T23:20:22.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.010+0000 7f2e5c59f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f2e54072060 con 0x7f2e540ce870 2024-09-15T23:20:22.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.010+0000 7f2e5a33b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e40003b70 0x7f2e540cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:22.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.010+0000 7f2e5a33b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e40003b70 0x7f2e540cc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60658/0 (socket says 172.21.15.123:60658) 2024-09-15T23:20:22.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.010+0000 7f2e5a33b640 1 -- 172.21.15.123:0/4215305415 learned_addr learned my addr 172.21.15.123:0/4215305415 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:22.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.011+0000 7f2e59b3a640 1 --2- 172.21.15.123:0/4215305415 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e540ce870 0x7f2e540c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:22.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.011+0000 7f2e5ab3c640 1 --2- 172.21.15.123:0/4215305415 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e541450d0 0x7f2e540cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:22.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.011+0000 7f2e5a33b640 1 -- 172.21.15.123:0/4215305415 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e540ce870 msgr2=0x7f2e540c6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:22.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.011+0000 7f2e5a33b640 1 --2- 172.21.15.123:0/4215305415 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e540ce870 0x7f2e540c6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:22.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.011+0000 7f2e5a33b640 1 -- 172.21.15.123:0/4215305415 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e541450d0 msgr2=0x7f2e540cfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:22.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.011+0000 7f2e5a33b640 1 --2- 172.21.15.123:0/4215305415 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e541450d0 0x7f2e540cfed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:22.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.011+0000 7f2e5a33b640 1 -- 172.21.15.123:0/4215305415 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e540cee30 con 0x7f2e40003b70 2024-09-15T23:20:22.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.011+0000 7f2e5ab3c640 1 --2- 172.21.15.123:0/4215305415 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e541450d0 0x7f2e540cfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:22.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.011+0000 7f2e59b3a640 1 --2- 172.21.15.123:0/4215305415 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e540ce870 0x7f2e540c6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:22.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.011+0000 7f2e5a33b640 1 --2- 172.21.15.123:0/4215305415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e40003b70 0x7f2e540cc3f0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f2e50005040 tx=0x7f2e50001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:22.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.011+0000 7f2e4affd640 1 -- 172.21.15.123:0/4215305415 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e50040070 con 0x7f2e40003b70 2024-09-15T23:20:22.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.011+0000 7f2e4affd640 1 -- 172.21.15.123:0/4215305415 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e50003970 con 0x7f2e40003b70 2024-09-15T23:20:22.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.011+0000 7f2e5c59f640 1 -- 172.21.15.123:0/4215305415 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e540cf110 con 0x7f2e40003b70 2024-09-15T23:20:22.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.011+0000 7f2e4affd640 1 -- 172.21.15.123:0/4215305415 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e50001bf0 con 0x7f2e40003b70 2024-09-15T23:20:22.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.011+0000 7f2e5c59f640 1 -- 172.21.15.123:0/4215305415 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e540cf6d0 con 0x7f2e40003b70 2024-09-15T23:20:22.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.012+0000 7f2e5c59f640 1 -- 172.21.15.123:0/4215305415 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e54162c80 con 0x7f2e40003b70 2024-09-15T23:20:22.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.012+0000 7f2e4affd640 1 -- 172.21.15.123:0/4215305415 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2e50043070 con 0x7f2e40003b70 2024-09-15T23:20:22.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.013+0000 7f2e4affd640 1 --2- 172.21.15.123:0/4215305415 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2e3806c2e0 0x7f2e3806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:22.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.013+0000 7f2e4affd640 1 -- 172.21.15.123:0/4215305415 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 4943+0+0 (secure 0 0 0) 0x7f2e500abd30 con 0x7f2e40003b70 2024-09-15T23:20:22.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.013+0000 7f2e59b3a640 1 --2- 172.21.15.123:0/4215305415 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2e3806c2e0 0x7f2e3806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:22.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.014+0000 7f2e59b3a640 1 --2- 172.21.15.123:0/4215305415 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2e3806c2e0 0x7f2e3806e7a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f2e54160eb0 tx=0x7f2e44008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:22.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.017+0000 7f2e4affd640 1 -- 172.21.15.123:0/4215305415 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2e5007a830 con 0x7f2e40003b70 2024-09-15T23:20:22.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.181+0000 7f2e5c59f640 1 -- 172.21.15.123:0/4215305415 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f2e540d0bc0 con 0x7f2e40003b70 2024-09-15T23:20:22.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.185+0000 7f2e4affd640 1 -- 172.21.15.123:0/4215305415 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v39) ==== 104+0+0 (secure 0 0 0) 0x7f2e5007a130 con 0x7f2e40003b70 2024-09-15T23:20:22.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.187+0000 7f2e5c59f640 1 -- 172.21.15.123:0/4215305415 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2e3806c2e0 msgr2=0x7f2e3806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:22.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.187+0000 7f2e5c59f640 1 --2- 172.21.15.123:0/4215305415 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2e3806c2e0 0x7f2e3806e7a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f2e54160eb0 tx=0x7f2e44008040 comp rx=0 tx=0).stop 2024-09-15T23:20:22.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.187+0000 7f2e5c59f640 1 -- 172.21.15.123:0/4215305415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e40003b70 msgr2=0x7f2e540cc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:22.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.187+0000 7f2e5c59f640 1 --2- 172.21.15.123:0/4215305415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e40003b70 0x7f2e540cc3f0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f2e50005040 tx=0x7f2e50001650 comp rx=0 tx=0).stop 2024-09-15T23:20:22.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.187+0000 7f2e5c59f640 1 -- 172.21.15.123:0/4215305415 shutdown_connections 2024-09-15T23:20:22.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.187+0000 7f2e5c59f640 1 --2- 172.21.15.123:0/4215305415 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e541450d0 0x7f2e540cfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:22.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.187+0000 7f2e5c59f640 1 --2- 172.21.15.123:0/4215305415 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e540ce870 0x7f2e540c6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:22.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.187+0000 7f2e5c59f640 1 --2- 172.21.15.123:0/4215305415 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2e3806c2e0 0x7f2e3806e7a0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:22.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.187+0000 7f2e5c59f640 1 --2- 172.21.15.123:0/4215305415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e40003b70 0x7f2e540cc3f0 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:22.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.187+0000 7f2e5c59f640 1 -- 172.21.15.123:0/4215305415 >> 172.21.15.123:0/4215305415 conn(0x7f2e5406db30 msgr2=0x7f2e540b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:22.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.187+0000 7f2e5c59f640 1 -- 172.21.15.123:0/4215305415 shutdown_connections 2024-09-15T23:20:22.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.187+0000 7f2e5c59f640 1 -- 172.21.15.123:0/4215305415 wait complete. 2024-09-15T23:20:22.199 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume' 2024-09-15T23:20:22.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.296+0000 7f87d4677640 1 Processor -- start 2024-09-15T23:20:22.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.296+0000 7f87d4677640 1 -- start start 2024-09-15T23:20:22.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.297+0000 7f87d4677640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f87cc15c4b0 0x7f87cc0b6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:22.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.297+0000 7f87d4677640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87cc0b02b0 0x7f87cc0b6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:22.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.297+0000 7f87d4677640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87cc067b50 con 0x7f87cc0d08e0 2024-09-15T23:20:22.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.297+0000 7f87d4677640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f87cc0ce860 con 0x7f87cc15c4b0 2024-09-15T23:20:22.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.297+0000 7f87d4677640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f87cc070130 con 0x7f87cc0b02b0 2024-09-15T23:20:22.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.297+0000 7f87d2c14640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f87cc0d08e0 0x7f87cc160120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59628/0 (socket says 172.21.15.123:59628) 2024-09-15T23:20:22.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.297+0000 7f87d2c14640 1 -- 172.21.15.123:0/418866432 learned_addr learned my addr 172.21.15.123:0/418866432 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:22.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.297+0000 7f87d1c12640 1 --2- 172.21.15.123:0/418866432 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87cc0b02b0 0x7f87cc0b6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:22.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.297+0000 7f87d2413640 1 --2- 172.21.15.123:0/418866432 >> v2:172.21.15.188:3300/0 conn(0x7f87cc15c4b0 0x7f87cc0b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:22.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.297+0000 7f87d1411640 1 -- 172.21.15.123:0/418866432 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3383393603 0 0) 0x7f87c4001490 con 0x7f87cc0d08e0 2024-09-15T23:20:22.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.297+0000 7f87d1411640 1 -- 172.21.15.123:0/418866432 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87b8003520 con 0x7f87cc0d08e0 2024-09-15T23:20:22.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.297+0000 7f87d1411640 1 -- 172.21.15.123:0/418866432 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3837178455 0 0) 0x7f87b8003520 con 0x7f87cc0d08e0 2024-09-15T23:20:22.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.297+0000 7f87d1411640 1 -- 172.21.15.123:0/418866432 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87cc0b02b0 msgr2=0x7f87cc0b6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:22.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.297+0000 7f87d1411640 1 --2- 172.21.15.123:0/418866432 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87cc0b02b0 0x7f87cc0b6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:22.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.297+0000 7f87d1411640 1 -- 172.21.15.123:0/418866432 >> v2:172.21.15.188:3300/0 conn(0x7f87cc15c4b0 msgr2=0x7f87cc0b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:22.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.297+0000 7f87d1411640 1 --2- 172.21.15.123:0/418866432 >> v2:172.21.15.188:3300/0 conn(0x7f87cc15c4b0 0x7f87cc0b6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:22.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.297+0000 7f87d1411640 1 -- 172.21.15.123:0/418866432 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87cc06fe50 con 0x7f87cc0d08e0 2024-09-15T23:20:22.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.297+0000 7f87d1411640 1 -- 172.21.15.123:0/418866432 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f87c4001bc0 con 0x7f87cc0d08e0 2024-09-15T23:20:22.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.297+0000 7f87d1411640 1 -- 172.21.15.123:0/418866432 >> v1:172.21.15.123:6789/0 conn(0x7f87cc0d08e0 legacy=0x7f87cc160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:22.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.297+0000 7f87d1411640 1 --2- 172.21.15.123:0/418866432 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b80039b0 0x7f87b8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:22.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.297+0000 7f87d1411640 1 --2- 172.21.15.123:0/418866432 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87b8004800 0x7f87b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:22.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.297+0000 7f87d1411640 1 --2- 172.21.15.123:0/418866432 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87cc0b02b0 0x7f87b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:22.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.298+0000 7f87d1411640 1 -- 172.21.15.123:0/418866432 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f87cc0ce860 con 0x7f87b80039b0 2024-09-15T23:20:22.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.298+0000 7f87d1411640 1 -- 172.21.15.123:0/418866432 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f87cc070130 con 0x7f87b8004800 2024-09-15T23:20:22.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.298+0000 7f87d1411640 1 -- 172.21.15.123:0/418866432 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f87b800b9c0 con 0x7f87cc0b02b0 2024-09-15T23:20:22.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.298+0000 7f87d2413640 1 --2- 172.21.15.123:0/418866432 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b80039b0 0x7f87b8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:22.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.298+0000 7f87d1c12640 1 --2- 172.21.15.123:0/418866432 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87b8004800 0x7f87b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:22.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.298+0000 7f87d2c14640 1 --2- 172.21.15.123:0/418866432 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87cc0b02b0 0x7f87b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:22.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.298+0000 7f87d2413640 1 -- 172.21.15.123:0/418866432 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87cc0b02b0 msgr2=0x7f87b80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:22.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.298+0000 7f87d2413640 1 --2- 172.21.15.123:0/418866432 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87cc0b02b0 0x7f87b80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:22.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.298+0000 7f87d2413640 1 -- 172.21.15.123:0/418866432 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87b8004800 msgr2=0x7f87b8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:22.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.298+0000 7f87d2413640 1 --2- 172.21.15.123:0/418866432 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87b8004800 0x7f87b8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:22.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.298+0000 7f87d2413640 1 -- 172.21.15.123:0/418866432 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b8003520 con 0x7f87b80039b0 2024-09-15T23:20:22.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.298+0000 7f87d1c12640 1 --2- 172.21.15.123:0/418866432 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87b8004800 0x7f87b8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:22.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.299+0000 7f87d2413640 1 --2- 172.21.15.123:0/418866432 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b80039b0 0x7f87b8003dd0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f87c8009ac0 tx=0x7f87b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e7213bd0d4ba38 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:22.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.299+0000 7f87d1411640 1 -- 172.21.15.123:0/418866432 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c8036070 con 0x7f87b80039b0 2024-09-15T23:20:22.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.299+0000 7f87d1411640 1 -- 172.21.15.123:0/418866432 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87c8031400 con 0x7f87b80039b0 2024-09-15T23:20:22.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.299+0000 7f87d1411640 1 -- 172.21.15.123:0/418866432 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c8009690 con 0x7f87b80039b0 2024-09-15T23:20:22.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.299+0000 7f87d4677640 1 -- 172.21.15.123:0/418866432 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b80039b0 msgr2=0x7f87b8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:22.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.299+0000 7f87d4677640 1 --2- 172.21.15.123:0/418866432 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b80039b0 0x7f87b8003dd0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f87c8009ac0 tx=0x7f87b8005830 comp rx=0 tx=0).stop 2024-09-15T23:20:22.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.299+0000 7f87d2c14640 1 -- 172.21.15.123:0/418866432 reap_dead start 2024-09-15T23:20:22.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.299+0000 7f87d4677640 1 -- 172.21.15.123:0/418866432 shutdown_connections 2024-09-15T23:20:22.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.299+0000 7f87d4677640 1 -- 172.21.15.123:0/418866432 >> 172.21.15.123:0/418866432 conn(0x7f87cc0b0a80 msgr2=0x7f87cc0b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:22.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.299+0000 7f87d4677640 1 -- 172.21.15.123:0/418866432 shutdown_connections 2024-09-15T23:20:22.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.299+0000 7f87d4677640 1 -- 172.21.15.123:0/418866432 wait complete. 2024-09-15T23:20:22.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.300+0000 7f87d4677640 1 Processor -- start 2024-09-15T23:20:22.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.301+0000 7f87d4677640 1 -- start start 2024-09-15T23:20:22.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.301+0000 7f87d4677640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b80039b0 0x7f87cc145650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:22.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.301+0000 7f87d4677640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87cc0b5740 0x7f87cc0b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:22.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.301+0000 7f87d4677640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87cc0ae870 0x7f87cc0aecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:22.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.301+0000 7f87d4677640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f87cc06dcc0 con 0x7f87b80039b0 2024-09-15T23:20:22.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.301+0000 7f87d4677640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f87cc0ce580 con 0x7f87cc0b5740 2024-09-15T23:20:22.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.301+0000 7f87d4677640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f87cc15c890 con 0x7f87cc0ae870 2024-09-15T23:20:22.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.301+0000 7f87d2413640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b80039b0 0x7f87cc145650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:22.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.301+0000 7f87d2413640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b80039b0 0x7f87cc145650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60670/0 (socket says 172.21.15.123:60670) 2024-09-15T23:20:22.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.301+0000 7f87d2413640 1 -- 172.21.15.123:0/778658058 learned_addr learned my addr 172.21.15.123:0/778658058 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:22.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.301+0000 7f87d1c12640 1 --2- 172.21.15.123:0/778658058 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87cc0b5740 0x7f87cc0b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:22.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.301+0000 7f87d2c14640 1 --2- 172.21.15.123:0/778658058 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87cc0ae870 0x7f87cc0aecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:22.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.302+0000 7f87d2413640 1 -- 172.21.15.123:0/778658058 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87cc0ae870 msgr2=0x7f87cc0aecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:22.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.302+0000 7f87d2413640 1 --2- 172.21.15.123:0/778658058 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87cc0ae870 0x7f87cc0aecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:22.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.302+0000 7f87d2413640 1 -- 172.21.15.123:0/778658058 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87cc0b5740 msgr2=0x7f87cc0b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:22.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.302+0000 7f87d2413640 1 --2- 172.21.15.123:0/778658058 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87cc0b5740 0x7f87cc0b5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:22.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.302+0000 7f87d2413640 1 -- 172.21.15.123:0/778658058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87cc145b90 con 0x7f87b80039b0 2024-09-15T23:20:22.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.302+0000 7f87d2413640 1 --2- 172.21.15.123:0/778658058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b80039b0 0x7f87cc145650 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f87c8009be0 tx=0x7f87c8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:22.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.302+0000 7f87c2ffd640 1 -- 172.21.15.123:0/778658058 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c8040020 con 0x7f87b80039b0 2024-09-15T23:20:22.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.302+0000 7f87c2ffd640 1 -- 172.21.15.123:0/778658058 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87c8003b40 con 0x7f87b80039b0 2024-09-15T23:20:22.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.302+0000 7f87c2ffd640 1 -- 172.21.15.123:0/778658058 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87c8036040 con 0x7f87b80039b0 2024-09-15T23:20:22.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.302+0000 7f87d4677640 1 -- 172.21.15.123:0/778658058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87cc0b42d0 con 0x7f87b80039b0 2024-09-15T23:20:22.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.302+0000 7f87d4677640 1 -- 172.21.15.123:0/778658058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87cc0b4890 con 0x7f87b80039b0 2024-09-15T23:20:22.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.303+0000 7f87d4677640 1 -- 172.21.15.123:0/778658058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87cc0b6120 con 0x7f87b80039b0 2024-09-15T23:20:22.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.303+0000 7f87c2ffd640 1 -- 172.21.15.123:0/778658058 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f87c8043020 con 0x7f87b80039b0 2024-09-15T23:20:22.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.304+0000 7f87c2ffd640 1 --2- 172.21.15.123:0/778658058 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f87b006c2b0 0x7f87b006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:22.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.304+0000 7f87c2ffd640 1 -- 172.21.15.123:0/778658058 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 4943+0+0 (secure 0 0 0) 0x7f87c80ab530 con 0x7f87b80039b0 2024-09-15T23:20:22.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.304+0000 7f87d1c12640 1 --2- 172.21.15.123:0/778658058 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f87b006c2b0 0x7f87b006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:22.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.304+0000 7f87d1c12640 1 --2- 172.21.15.123:0/778658058 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f87b006c2b0 0x7f87b006e770 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f87cc1e6270 tx=0x7f87bc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:22.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.308+0000 7f87c2ffd640 1 -- 172.21.15.123:0/778658058 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f87c804a030 con 0x7f87b80039b0 2024-09-15T23:20:22.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.539+0000 7f87d4677640 1 -- 172.21.15.123:0/778658058 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]} v 0) -- 0x7f87cc068df0 con 0x7f87b80039b0 2024-09-15T23:20:22.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.873+0000 7f87c2ffd640 1 -- 172.21.15.123:0/778658058 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]}]=0 v408) ==== 155+0+0 (secure 0 0 0) 0x7f87c80044e0 con 0x7f87b80039b0 2024-09-15T23:20:22.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.876+0000 7f87d4677640 1 -- 172.21.15.123:0/778658058 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f87b006c2b0 msgr2=0x7f87b006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:22.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.876+0000 7f87d4677640 1 --2- 172.21.15.123:0/778658058 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f87b006c2b0 0x7f87b006e770 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f87cc1e6270 tx=0x7f87bc008040 comp rx=0 tx=0).stop 2024-09-15T23:20:22.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.876+0000 7f87d4677640 1 -- 172.21.15.123:0/778658058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b80039b0 msgr2=0x7f87cc145650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:22.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.876+0000 7f87d4677640 1 --2- 172.21.15.123:0/778658058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b80039b0 0x7f87cc145650 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f87c8009be0 tx=0x7f87c8004730 comp rx=0 tx=0).stop 2024-09-15T23:20:22.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.876+0000 7f87d4677640 1 -- 172.21.15.123:0/778658058 shutdown_connections 2024-09-15T23:20:22.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.876+0000 7f87d4677640 1 --2- 172.21.15.123:0/778658058 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87cc0ae870 0x7f87cc0aecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:22.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.876+0000 7f87d4677640 1 --2- 172.21.15.123:0/778658058 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f87cc0b5740 0x7f87cc0b5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:22.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.876+0000 7f87d4677640 1 --2- 172.21.15.123:0/778658058 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f87b006c2b0 0x7f87b006e770 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:22.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.876+0000 7f87d4677640 1 --2- 172.21.15.123:0/778658058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87b80039b0 0x7f87cc145650 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:22.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.876+0000 7f87d4677640 1 -- 172.21.15.123:0/778658058 >> 172.21.15.123:0/778658058 conn(0x7f87cc0b0a80 msgr2=0x7f87cc06e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:22.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.876+0000 7f87d4677640 1 -- 172.21.15.123:0/778658058 shutdown_connections 2024-09-15T23:20:22.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.876+0000 7f87d4677640 1 -- 172.21.15.123:0/778658058 wait complete. 2024-09-15T23:20:22.888 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-15T23:20:22.888 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume_with_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-15T23:20:22.889 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:20:22.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.987+0000 7f257710a640 1 Processor -- start 2024-09-15T23:20:22.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.987+0000 7f257710a640 1 -- start start 2024-09-15T23:20:22.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.988+0000 7f257710a640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2570073890 0x7f25700b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:22.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.988+0000 7f257710a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f25700b5880 0x7f25700b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:22.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.988+0000 7f257710a640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25700b4020 con 0x7f2570145ed0 2024-09-15T23:20:22.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.988+0000 7f257710a640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f25700b42c0 con 0x7f2570073890 2024-09-15T23:20:22.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.988+0000 7f257710a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f25700b45a0 con 0x7f25700b5880 2024-09-15T23:20:22.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.988+0000 7f2574ea6640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f2570145ed0 0x7f2570073180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59640/0 (socket says 172.21.15.123:59640) 2024-09-15T23:20:22.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.988+0000 7f2574ea6640 1 -- 172.21.15.123:0/3999058083 learned_addr learned my addr 172.21.15.123:0/3999058083 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:22.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.988+0000 7f2567fff640 1 --2- 172.21.15.123:0/3999058083 >> v2:172.21.15.188:3300/0 conn(0x7f2570073890 0x7f25700b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:22.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.988+0000 7f25756a7640 1 --2- 172.21.15.123:0/3999058083 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f25700b5880 0x7f25700b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:22.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.988+0000 7f25677fe640 1 -- 172.21.15.123:0/3999058083 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 776098655 0 0) 0x7f25700b4020 con 0x7f2570145ed0 2024-09-15T23:20:22.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.988+0000 7f25677fe640 1 -- 172.21.15.123:0/3999058083 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2558003520 con 0x7f2570145ed0 2024-09-15T23:20:22.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.988+0000 7f25677fe640 1 -- 172.21.15.123:0/3999058083 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1714387050 0 0) 0x7f2558003520 con 0x7f2570145ed0 2024-09-15T23:20:22.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.988+0000 7f25677fe640 1 -- 172.21.15.123:0/3999058083 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f25700b5880 msgr2=0x7f25700b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:22.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.988+0000 7f25677fe640 1 --2- 172.21.15.123:0/3999058083 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f25700b5880 0x7f25700b5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:22.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.988+0000 7f25677fe640 1 -- 172.21.15.123:0/3999058083 >> v2:172.21.15.188:3300/0 conn(0x7f2570073890 msgr2=0x7f25700b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:22.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.988+0000 7f25677fe640 1 --2- 172.21.15.123:0/3999058083 >> v2:172.21.15.188:3300/0 conn(0x7f2570073890 0x7f25700b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:22.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.988+0000 7f25677fe640 1 -- 172.21.15.123:0/3999058083 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25700b4880 con 0x7f2570145ed0 2024-09-15T23:20:22.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.988+0000 7f25677fe640 1 -- 172.21.15.123:0/3999058083 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f256c001a10 con 0x7f2570145ed0 2024-09-15T23:20:22.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.988+0000 7f25677fe640 1 -- 172.21.15.123:0/3999058083 >> v1:172.21.15.123:6789/0 conn(0x7f2570145ed0 legacy=0x7f2570073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:22.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.988+0000 7f25677fe640 1 --2- 172.21.15.123:0/3999058083 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25580039b0 0x7f2558003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:22.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.988+0000 7f25677fe640 1 --2- 172.21.15.123:0/3999058083 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2558004800 0x7f2558004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:22.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.988+0000 7f25677fe640 1 --2- 172.21.15.123:0/3999058083 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f25700b5880 0x7f25580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:22.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.988+0000 7f25677fe640 1 -- 172.21.15.123:0/3999058083 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f25700b42c0 con 0x7f25580039b0 2024-09-15T23:20:22.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.988+0000 7f25677fe640 1 -- 172.21.15.123:0/3999058083 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f25700b45a0 con 0x7f2558004800 2024-09-15T23:20:22.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.988+0000 7f25677fe640 1 -- 172.21.15.123:0/3999058083 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f255800b9c0 con 0x7f25700b5880 2024-09-15T23:20:22.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.989+0000 7f2574ea6640 1 --2- 172.21.15.123:0/3999058083 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25580039b0 0x7f2558003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:22.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.989+0000 7f25756a7640 1 --2- 172.21.15.123:0/3999058083 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f25700b5880 0x7f25580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:22.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.989+0000 7f2567fff640 1 --2- 172.21.15.123:0/3999058083 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2558004800 0x7f2558004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:22.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.989+0000 7f2574ea6640 1 -- 172.21.15.123:0/3999058083 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f25700b5880 msgr2=0x7f25580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:22.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.989+0000 7f2574ea6640 1 --2- 172.21.15.123:0/3999058083 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f25700b5880 0x7f25580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:22.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.989+0000 7f2574ea6640 1 -- 172.21.15.123:0/3999058083 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2558004800 msgr2=0x7f2558004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:22.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.989+0000 7f2574ea6640 1 --2- 172.21.15.123:0/3999058083 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2558004800 0x7f2558004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:22.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.989+0000 7f2574ea6640 1 -- 172.21.15.123:0/3999058083 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2558003520 con 0x7f25580039b0 2024-09-15T23:20:22.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.989+0000 7f25756a7640 1 --2- 172.21.15.123:0/3999058083 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f25700b5880 0x7f25580051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:22.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.989+0000 7f2567fff640 1 --2- 172.21.15.123:0/3999058083 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2558004800 0x7f2558004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:22.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.989+0000 7f2574ea6640 1 --2- 172.21.15.123:0/3999058083 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25580039b0 0x7f2558003dd0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f256c00a880 tx=0x7f2558005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=374ad71d47b7030b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:22.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.990+0000 7f25677fe640 1 -- 172.21.15.123:0/3999058083 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256c00a4d0 con 0x7f25580039b0 2024-09-15T23:20:22.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.990+0000 7f25677fe640 1 -- 172.21.15.123:0/3999058083 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f256c02f070 con 0x7f25580039b0 2024-09-15T23:20:22.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.990+0000 7f25677fe640 1 -- 172.21.15.123:0/3999058083 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256c02bcc0 con 0x7f25580039b0 2024-09-15T23:20:22.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.990+0000 7f257710a640 1 -- 172.21.15.123:0/3999058083 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25580039b0 msgr2=0x7f2558003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:22.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.990+0000 7f257710a640 1 --2- 172.21.15.123:0/3999058083 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25580039b0 0x7f2558003dd0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f256c00a880 tx=0x7f2558005830 comp rx=0 tx=0).stop 2024-09-15T23:20:22.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.990+0000 7f25756a7640 1 -- 172.21.15.123:0/3999058083 reap_dead start 2024-09-15T23:20:22.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.990+0000 7f257710a640 1 -- 172.21.15.123:0/3999058083 shutdown_connections 2024-09-15T23:20:22.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.990+0000 7f257710a640 1 -- 172.21.15.123:0/3999058083 >> 172.21.15.123:0/3999058083 conn(0x7f25700ccec0 msgr2=0x7f25700cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:22.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.990+0000 7f257710a640 1 -- 172.21.15.123:0/3999058083 shutdown_connections 2024-09-15T23:20:22.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.990+0000 7f257710a640 1 -- 172.21.15.123:0/3999058083 wait complete. 2024-09-15T23:20:22.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.991+0000 7f257710a640 1 Processor -- start 2024-09-15T23:20:22.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.991+0000 7f257710a640 1 -- start start 2024-09-15T23:20:22.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.992+0000 7f257710a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25580039b0 0x7f2570157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:22.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.992+0000 7f257710a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f257013cc40 0x7f25701404e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:22.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.992+0000 7f257710a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f257013f6e0 0x7f257015bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:22.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.992+0000 7f257710a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2570146430 con 0x7f25580039b0 2024-09-15T23:20:22.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.992+0000 7f257710a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f25701462b0 con 0x7f257013cc40 2024-09-15T23:20:22.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.992+0000 7f257710a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f25700b5d30 con 0x7f257013f6e0 2024-09-15T23:20:22.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.992+0000 7f2574ea6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25580039b0 0x7f2570157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:22.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.992+0000 7f2574ea6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25580039b0 0x7f2570157cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60686/0 (socket says 172.21.15.123:60686) 2024-09-15T23:20:22.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.992+0000 7f2574ea6640 1 -- 172.21.15.123:0/2608340231 learned_addr learned my addr 172.21.15.123:0/2608340231 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:22.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.993+0000 7f2574ea6640 1 -- 172.21.15.123:0/2608340231 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f257013f6e0 msgr2=0x7f257015bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:22.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.993+0000 7f2574ea6640 1 --2- 172.21.15.123:0/2608340231 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f257013f6e0 0x7f257015bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:22.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.993+0000 7f2574ea6640 1 -- 172.21.15.123:0/2608340231 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f257013cc40 msgr2=0x7f25701404e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:22.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.993+0000 7f2574ea6640 1 --2- 172.21.15.123:0/2608340231 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f257013cc40 0x7f25701404e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:22.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.993+0000 7f2574ea6640 1 -- 172.21.15.123:0/2608340231 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2570141e40 con 0x7f25580039b0 2024-09-15T23:20:22.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.993+0000 7f2574ea6640 1 --2- 172.21.15.123:0/2608340231 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25580039b0 0x7f2570157cc0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f256c00a0d0 tx=0x7f25700c6260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:22.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.993+0000 7f25657fa640 1 -- 172.21.15.123:0/2608340231 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256c038030 con 0x7f25580039b0 2024-09-15T23:20:22.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.993+0000 7f25657fa640 1 -- 172.21.15.123:0/2608340231 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f256c001a20 con 0x7f25580039b0 2024-09-15T23:20:22.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.993+0000 7f257710a640 1 -- 172.21.15.123:0/2608340231 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f257013eb00 con 0x7f25580039b0 2024-09-15T23:20:22.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.993+0000 7f25657fa640 1 -- 172.21.15.123:0/2608340231 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256c004b60 con 0x7f25580039b0 2024-09-15T23:20:22.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.993+0000 7f257710a640 1 -- 172.21.15.123:0/2608340231 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25701423c0 con 0x7f25580039b0 2024-09-15T23:20:22.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.994+0000 7f257710a640 1 -- 172.21.15.123:0/2608340231 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25700ce8e0 con 0x7f25580039b0 2024-09-15T23:20:22.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.994+0000 7f25657fa640 1 -- 172.21.15.123:0/2608340231 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f256c03e030 con 0x7f25580039b0 2024-09-15T23:20:22.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.995+0000 7f25657fa640 1 --2- 172.21.15.123:0/2608340231 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f255c06c2e0 0x7f255c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:22.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.995+0000 7f25657fa640 1 -- 172.21.15.123:0/2608340231 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 4943+0+0 (secure 0 0 0) 0x7f256c0aa9d0 con 0x7f25580039b0 2024-09-15T23:20:22.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.995+0000 7f2567fff640 1 --2- 172.21.15.123:0/2608340231 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f255c06c2e0 0x7f255c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:22.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.996+0000 7f2567fff640 1 --2- 172.21.15.123:0/2608340231 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f255c06c2e0 0x7f255c06e7a0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f25700cda80 tx=0x7f2560008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:23.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:22.999+0000 7f25657fa640 1 -- 172.21.15.123:0/2608340231 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f25700ce8e0 con 0x7f25580039b0 2024-09-15T23:20:23.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.177+0000 7f257710a640 1 -- 172.21.15.123:0/2608340231 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f25700b29e0 con 0x7f25580039b0 2024-09-15T23:20:23.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.178+0000 7f25657fa640 1 -- 172.21.15.123:0/2608340231 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) ==== 74+0+13068 (secure 0 0 0) 0x7f25700b29e0 con 0x7f25580039b0 2024-09-15T23:20:23.179 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:23.179 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":145,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:20:21.869414+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":140,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.188:6837/1222656979":"2024-09-16T23:20:18.865342+0000","172.21.15.188:6835/1222656979":"2024-09-16T23:20:18.865342+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:20:23.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.179+0000 7f257710a640 1 -- 172.21.15.123:0/2608340231 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f255c06c2e0 msgr2=0x7f255c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:23.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.179+0000 7f257710a640 1 --2- 172.21.15.123:0/2608340231 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f255c06c2e0 0x7f255c06e7a0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f25700cda80 tx=0x7f2560008040 comp rx=0 tx=0).stop 2024-09-15T23:20:23.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.179+0000 7f257710a640 1 -- 172.21.15.123:0/2608340231 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25580039b0 msgr2=0x7f2570157cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:23.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.179+0000 7f257710a640 1 --2- 172.21.15.123:0/2608340231 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25580039b0 0x7f2570157cc0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f256c00a0d0 tx=0x7f25700c6260 comp rx=0 tx=0).stop 2024-09-15T23:20:23.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.180+0000 7f257710a640 1 -- 172.21.15.123:0/2608340231 shutdown_connections 2024-09-15T23:20:23.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.180+0000 7f257710a640 1 --2- 172.21.15.123:0/2608340231 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f257013f6e0 0x7f257015bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:23.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.180+0000 7f257710a640 1 --2- 172.21.15.123:0/2608340231 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f257013cc40 0x7f25701404e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:23.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.180+0000 7f257710a640 1 --2- 172.21.15.123:0/2608340231 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f255c06c2e0 0x7f255c06e7a0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:23.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.180+0000 7f257710a640 1 --2- 172.21.15.123:0/2608340231 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25580039b0 0x7f2570157cc0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:23.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.180+0000 7f257710a640 1 -- 172.21.15.123:0/2608340231 >> 172.21.15.123:0/2608340231 conn(0x7f25700ccec0 msgr2=0x7f25701441a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:23.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.180+0000 7f257710a640 1 -- 172.21.15.123:0/2608340231 shutdown_connections 2024-09-15T23:20:23.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.180+0000 7f257710a640 1 -- 172.21.15.123:0/2608340231 wait complete. 2024-09-15T23:20:23.192 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T23:12:01.531886+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T23:20:23.192 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T23:20:23.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.293+0000 7f1b54253640 1 Processor -- start 2024-09-15T23:20:23.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.293+0000 7f1b54253640 1 -- start start 2024-09-15T23:20:23.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.294+0000 7f1b54253640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1b4c15b0f0 0x7f1b4c15f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:23.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.294+0000 7f1b54253640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1b4c15b4d0 0x7f1b4c06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:23.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.294+0000 7f1b54253640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b4c0d08a0 con 0x7f1b4c06d260 2024-09-15T23:20:23.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.294+0000 7f1b54253640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f1b4c06d6b0 con 0x7f1b4c15b4d0 2024-09-15T23:20:23.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.294+0000 7f1b54253640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f1b4c0d0b80 con 0x7f1b4c15b0f0 2024-09-15T23:20:23.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.294+0000 7f1b517ee640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1b4c15b4d0 0x7f1b4c06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:23.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.294+0000 7f1b517ee640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1b4c15b4d0 0x7f1b4c06cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60694/0 (socket says 172.21.15.123:60694) 2024-09-15T23:20:23.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.294+0000 7f1b517ee640 1 -- 172.21.15.123:0/3128188393 learned_addr learned my addr 172.21.15.123:0/3128188393 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:23.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.294+0000 7f1b517ee640 1 -- 172.21.15.123:0/3128188393 >> v2:172.21.15.188:3300/0 conn(0x7f1b4c15b0f0 msgr2=0x7f1b4c15f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:23.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.294+0000 7f1b51fef640 1 --2- 172.21.15.123:0/3128188393 >> v2:172.21.15.188:3300/0 conn(0x7f1b4c15b0f0 0x7f1b4c15f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:23.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.294+0000 7f1b517ee640 1 --2- 172.21.15.123:0/3128188393 >> v2:172.21.15.188:3300/0 conn(0x7f1b4c15b0f0 0x7f1b4c15f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:23.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.294+0000 7f1b517ee640 1 -- 172.21.15.123:0/3128188393 >> v1:172.21.15.188:6789/0 conn(0x7f1b4c06d260 legacy=0x7f1b4c0b4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:23.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.294+0000 7f1b517ee640 1 -- 172.21.15.123:0/3128188393 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b4c071aa0 con 0x7f1b4c15b4d0 2024-09-15T23:20:23.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.295+0000 7f1b517ee640 1 --2- 172.21.15.123:0/3128188393 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b4c15b4d0 0x7f1b4c06cd20 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c06d8b0 tx=0x7f1b3c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11183a6bd6e67a68 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:23.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.295+0000 7f1b50fed640 1 -- 172.21.15.123:0/3128188393 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c037070 con 0x7f1b4c15b4d0 2024-09-15T23:20:23.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.295+0000 7f1b50fed640 1 -- 172.21.15.123:0/3128188393 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b3c032440 con 0x7f1b4c15b4d0 2024-09-15T23:20:23.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.295+0000 7f1b50fed640 1 -- 172.21.15.123:0/3128188393 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c032810 con 0x7f1b4c15b4d0 2024-09-15T23:20:23.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.296+0000 7f1b54253640 1 -- 172.21.15.123:0/3128188393 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b4c15b4d0 msgr2=0x7f1b4c06cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:23.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.296+0000 7f1b54253640 1 --2- 172.21.15.123:0/3128188393 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b4c15b4d0 0x7f1b4c06cd20 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c06d8b0 tx=0x7f1b3c02a230 comp rx=0 tx=0).stop 2024-09-15T23:20:23.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.296+0000 7f1b54253640 1 -- 172.21.15.123:0/3128188393 shutdown_connections 2024-09-15T23:20:23.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.296+0000 7f1b54253640 1 --2- 172.21.15.123:0/3128188393 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b4c15b4d0 0x7f1b4c06cd20 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:23.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.296+0000 7f1b54253640 1 --2- 172.21.15.123:0/3128188393 >> v2:172.21.15.188:3300/0 conn(0x7f1b4c15b0f0 0x7f1b4c15f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:23.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.296+0000 7f1b54253640 1 -- 172.21.15.123:0/3128188393 >> 172.21.15.123:0/3128188393 conn(0x7f1b4c06db30 msgr2=0x7f1b4c06df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:23.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.296+0000 7f1b54253640 1 -- 172.21.15.123:0/3128188393 shutdown_connections 2024-09-15T23:20:23.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.296+0000 7f1b54253640 1 -- 172.21.15.123:0/3128188393 wait complete. 2024-09-15T23:20:23.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.297+0000 7f1b54253640 1 Processor -- start 2024-09-15T23:20:23.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.297+0000 7f1b54253640 1 -- start start 2024-09-15T23:20:23.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.298+0000 7f1b54253640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b4c06d260 0x7f1b4c0cece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:23.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.298+0000 7f1b54253640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b4c15b0f0 0x7f1b4c0cf220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:23.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.298+0000 7f1b54253640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b4c15b4d0 0x7f1b4c0ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:23.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.298+0000 7f1b54253640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4c0b0750 con 0x7f1b4c06d260 2024-09-15T23:20:23.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.298+0000 7f1b54253640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4c072060 con 0x7f1b4c15b4d0 2024-09-15T23:20:23.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.298+0000 7f1b54253640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1b4c0d04c0 con 0x7f1b4c15b0f0 2024-09-15T23:20:23.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.298+0000 7f1b51fef640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b4c06d260 0x7f1b4c0cece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:23.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.298+0000 7f1b51fef640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b4c06d260 0x7f1b4c0cece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60710/0 (socket says 172.21.15.123:60710) 2024-09-15T23:20:23.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.298+0000 7f1b51fef640 1 -- 172.21.15.123:0/527096414 learned_addr learned my addr 172.21.15.123:0/527096414 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:23.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.298+0000 7f1b51fef640 1 -- 172.21.15.123:0/527096414 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b4c15b0f0 msgr2=0x7f1b4c0cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:23.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.298+0000 7f1b51fef640 1 --2- 172.21.15.123:0/527096414 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b4c15b0f0 0x7f1b4c0cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:23.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.298+0000 7f1b51fef640 1 -- 172.21.15.123:0/527096414 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b4c15b4d0 msgr2=0x7f1b4c0ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:23.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.298+0000 7f1b51fef640 1 --2- 172.21.15.123:0/527096414 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b4c15b4d0 0x7f1b4c0ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:23.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.298+0000 7f1b51fef640 1 -- 172.21.15.123:0/527096414 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b4c14e220 con 0x7f1b4c06d260 2024-09-15T23:20:23.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.298+0000 7f1b51fef640 1 --2- 172.21.15.123:0/527096414 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b4c06d260 0x7f1b4c0cece0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f1b4800c7f0 tx=0x7f1b4800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:23.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.299+0000 7f1b427fc640 1 -- 172.21.15.123:0/527096414 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b48015070 con 0x7f1b4c06d260 2024-09-15T23:20:23.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.299+0000 7f1b427fc640 1 -- 172.21.15.123:0/527096414 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b48004220 con 0x7f1b4c06d260 2024-09-15T23:20:23.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.299+0000 7f1b54253640 1 -- 172.21.15.123:0/527096414 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b4c1e5230 con 0x7f1b4c06d260 2024-09-15T23:20:23.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.299+0000 7f1b427fc640 1 -- 172.21.15.123:0/527096414 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b48007620 con 0x7f1b4c06d260 2024-09-15T23:20:23.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.299+0000 7f1b54253640 1 -- 172.21.15.123:0/527096414 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b4c1589c0 con 0x7f1b4c06d260 2024-09-15T23:20:23.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.299+0000 7f1b54253640 1 -- 172.21.15.123:0/527096414 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b4c15f970 con 0x7f1b4c06d260 2024-09-15T23:20:23.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.300+0000 7f1b427fc640 1 -- 172.21.15.123:0/527096414 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1b480079d0 con 0x7f1b4c06d260 2024-09-15T23:20:23.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.300+0000 7f1b427fc640 1 --2- 172.21.15.123:0/527096414 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1b3006c2b0 0x7f1b3006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:23.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.301+0000 7f1b427fc640 1 -- 172.21.15.123:0/527096414 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 4943+0+0 (secure 0 0 0) 0x7f1b4808b470 con 0x7f1b4c06d260 2024-09-15T23:20:23.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.301+0000 7f1b517ee640 1 --2- 172.21.15.123:0/527096414 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1b3006c2b0 0x7f1b3006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:23.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.301+0000 7f1b517ee640 1 --2- 172.21.15.123:0/527096414 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1b3006c2b0 0x7f1b3006e770 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c034000 tx=0x7f1b3c02c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:23.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.305+0000 7f1b427fc640 1 -- 172.21.15.123:0/527096414 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1b48059f70 con 0x7f1b4c06d260 2024-09-15T23:20:23.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.482+0000 7f1b54253640 1 -- 172.21.15.123:0/527096414 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1b4c0759a0 con 0x7f1b4c06d260 2024-09-15T23:20:23.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.483+0000 7f1b427fc640 1 -- 172.21.15.123:0/527096414 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v145) ==== 93+0+10 (secure 0 0 0) 0x7f1b48059870 con 0x7f1b4c06d260 2024-09-15T23:20:23.484 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-15T23:20:23.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.484+0000 7f1b54253640 1 -- 172.21.15.123:0/527096414 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1b3006c2b0 msgr2=0x7f1b3006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:23.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.484+0000 7f1b54253640 1 --2- 172.21.15.123:0/527096414 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1b3006c2b0 0x7f1b3006e770 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c034000 tx=0x7f1b3c02c000 comp rx=0 tx=0).stop 2024-09-15T23:20:23.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.484+0000 7f1b54253640 1 -- 172.21.15.123:0/527096414 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b4c06d260 msgr2=0x7f1b4c0cece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:23.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.484+0000 7f1b54253640 1 --2- 172.21.15.123:0/527096414 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b4c06d260 0x7f1b4c0cece0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f1b4800c7f0 tx=0x7f1b4800ccb0 comp rx=0 tx=0).stop 2024-09-15T23:20:23.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.484+0000 7f1b54253640 1 -- 172.21.15.123:0/527096414 shutdown_connections 2024-09-15T23:20:23.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.484+0000 7f1b54253640 1 --2- 172.21.15.123:0/527096414 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b4c15b4d0 0x7f1b4c0ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:23.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.484+0000 7f1b54253640 1 --2- 172.21.15.123:0/527096414 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b4c15b0f0 0x7f1b4c0cf220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:23.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.484+0000 7f1b54253640 1 --2- 172.21.15.123:0/527096414 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1b3006c2b0 0x7f1b3006e770 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:23.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.484+0000 7f1b54253640 1 --2- 172.21.15.123:0/527096414 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b4c06d260 0x7f1b4c0cece0 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:23.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.485+0000 7f1b54253640 1 -- 172.21.15.123:0/527096414 >> 172.21.15.123:0/527096414 conn(0x7f1b4c06db30 msgr2=0x7f1b4c0b0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:23.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.485+0000 7f1b54253640 1 -- 172.21.15.123:0/527096414 shutdown_connections 2024-09-15T23:20:23.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.485+0000 7f1b54253640 1 -- 172.21.15.123:0/527096414 wait complete. 2024-09-15T23:20:23.497 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort' 2024-09-15T23:20:23.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.598+0000 7f2491b9f640 1 Processor -- start 2024-09-15T23:20:23.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.598+0000 7f2491b9f640 1 -- start start 2024-09-15T23:20:23.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.599+0000 7f2491b9f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f248c15e6d0 0x7f248c071390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:23.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.599+0000 7f2491b9f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f248c070b80 0x7f248c1622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:23.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.599+0000 7f2491b9f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f248c15eab0 con 0x7f248c06cd20 2024-09-15T23:20:23.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.599+0000 7f2491b9f640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f248c15ed70 con 0x7f248c15e6d0 2024-09-15T23:20:23.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.599+0000 7f2491b9f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f248c15f050 con 0x7f248c070b80 2024-09-15T23:20:23.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.599+0000 7f248bfff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f248c070b80 0x7f248c1622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:23.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.599+0000 7f248b7fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f248c15e6d0 0x7f248c071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:23.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.599+0000 7f248affd640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f248c06cd20 0x7f248c0b6d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:43258/0 (socket says 172.21.15.123:43258) 2024-09-15T23:20:23.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.599+0000 7f248affd640 1 -- 172.21.15.123:0/145722285 learned_addr learned my addr 172.21.15.123:0/145722285 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:23.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.599+0000 7f248a7fc640 1 -- 172.21.15.123:0/145722285 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2854425945 0 0) 0x7f248c15eab0 con 0x7f248c06cd20 2024-09-15T23:20:23.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.600+0000 7f248a7fc640 1 -- 172.21.15.123:0/145722285 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2474003520 con 0x7f248c06cd20 2024-09-15T23:20:23.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.600+0000 7f248bfff640 1 -- 172.21.15.123:0/145722285 >> v2:172.21.15.188:3300/0 conn(0x7f248c15e6d0 msgr2=0x7f248c071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:23.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.600+0000 7f248bfff640 1 --2- 172.21.15.123:0/145722285 >> v2:172.21.15.188:3300/0 conn(0x7f248c15e6d0 0x7f248c071390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:23.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.600+0000 7f248bfff640 1 -- 172.21.15.123:0/145722285 >> v1:172.21.15.188:6789/0 conn(0x7f248c06cd20 legacy=0x7f248c0b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:23.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.600+0000 7f248bfff640 1 -- 172.21.15.123:0/145722285 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f248c15f330 con 0x7f248c070b80 2024-09-15T23:20:23.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.600+0000 7f248b7fe640 1 --2- 172.21.15.123:0/145722285 >> v2:172.21.15.188:3300/0 conn(0x7f248c15e6d0 0x7f248c071390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:20:23.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.600+0000 7f248bfff640 1 --2- 172.21.15.123:0/145722285 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f248c070b80 0x7f248c1622a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f24840097a0 tx=0x7f248402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34e4c5725b2b6427 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:23.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.600+0000 7f248a7fc640 1 -- 172.21.15.123:0/145722285 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2484037070 con 0x7f248c070b80 2024-09-15T23:20:23.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.601+0000 7f248a7fc640 1 -- 172.21.15.123:0/145722285 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2484032440 con 0x7f248c070b80 2024-09-15T23:20:23.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.601+0000 7f248a7fc640 1 -- 172.21.15.123:0/145722285 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24840327f0 con 0x7f248c070b80 2024-09-15T23:20:23.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.601+0000 7f2491b9f640 1 -- 172.21.15.123:0/145722285 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f248c070b80 msgr2=0x7f248c1622a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:23.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.601+0000 7f2491b9f640 1 --2- 172.21.15.123:0/145722285 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f248c070b80 0x7f248c1622a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f24840097a0 tx=0x7f248402a180 comp rx=0 tx=0).stop 2024-09-15T23:20:23.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.601+0000 7f2491b9f640 1 -- 172.21.15.123:0/145722285 shutdown_connections 2024-09-15T23:20:23.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.601+0000 7f2491b9f640 1 --2- 172.21.15.123:0/145722285 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f248c070b80 0x7f248c1622a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:23.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.601+0000 7f2491b9f640 1 --2- 172.21.15.123:0/145722285 >> v2:172.21.15.188:3300/0 conn(0x7f248c15e6d0 0x7f248c071390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:23.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.601+0000 7f2491b9f640 1 -- 172.21.15.123:0/145722285 >> 172.21.15.123:0/145722285 conn(0x7f248c067fb0 msgr2=0x7f248c06f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:23.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.601+0000 7f2491b9f640 1 -- 172.21.15.123:0/145722285 shutdown_connections 2024-09-15T23:20:23.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.601+0000 7f2491b9f640 1 -- 172.21.15.123:0/145722285 wait complete. 2024-09-15T23:20:23.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.602+0000 7f2491b9f640 1 Processor -- start 2024-09-15T23:20:23.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.603+0000 7f2491b9f640 1 -- start start 2024-09-15T23:20:23.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.603+0000 7f2491b9f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f248c06cd20 0x7f248c15d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:23.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.603+0000 7f2491b9f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f248c070b80 0x7f248c1f3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:23.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.603+0000 7f2491b9f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f248c15e6d0 0x7f248c0b29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:23.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.603+0000 7f2491b9f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f248c0718d0 con 0x7f248c15e6d0 2024-09-15T23:20:23.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.603+0000 7f2491b9f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f248c15f8f0 con 0x7f248c070b80 2024-09-15T23:20:23.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.603+0000 7f2491b9f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f248c071a50 con 0x7f248c06cd20 2024-09-15T23:20:23.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.603+0000 7f248bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f248c15e6d0 0x7f248c0b29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:23.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.603+0000 7f248bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f248c15e6d0 0x7f248c0b29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60718/0 (socket says 172.21.15.123:60718) 2024-09-15T23:20:23.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.603+0000 7f248bfff640 1 -- 172.21.15.123:0/2905150535 learned_addr learned my addr 172.21.15.123:0/2905150535 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:23.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.604+0000 7f248b7fe640 1 --2- 172.21.15.123:0/2905150535 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f248c06cd20 0x7f248c15d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:23.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.604+0000 7f248affd640 1 --2- 172.21.15.123:0/2905150535 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f248c070b80 0x7f248c1f3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:23.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.604+0000 7f248bfff640 1 -- 172.21.15.123:0/2905150535 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f248c06cd20 msgr2=0x7f248c15d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:23.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.604+0000 7f248bfff640 1 --2- 172.21.15.123:0/2905150535 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f248c06cd20 0x7f248c15d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:23.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.604+0000 7f248bfff640 1 -- 172.21.15.123:0/2905150535 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f248c070b80 msgr2=0x7f248c1f3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:23.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.604+0000 7f248bfff640 1 --2- 172.21.15.123:0/2905150535 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f248c070b80 0x7f248c1f3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:23.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.604+0000 7f248bfff640 1 -- 172.21.15.123:0/2905150535 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f248c1f48c0 con 0x7f248c15e6d0 2024-09-15T23:20:23.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.604+0000 7f248bfff640 1 --2- 172.21.15.123:0/2905150535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f248c15e6d0 0x7f248c0b29b0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f2484035040 tx=0x7f24840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:23.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.604+0000 7f2473fff640 1 -- 172.21.15.123:0/2905150535 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2484037040 con 0x7f248c15e6d0 2024-09-15T23:20:23.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.604+0000 7f2473fff640 1 -- 172.21.15.123:0/2905150535 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2484042070 con 0x7f248c15e6d0 2024-09-15T23:20:23.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.604+0000 7f2491b9f640 1 -- 172.21.15.123:0/2905150535 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f248c1f4ba0 con 0x7f248c15e6d0 2024-09-15T23:20:23.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.604+0000 7f2473fff640 1 -- 172.21.15.123:0/2905150535 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24840044e0 con 0x7f248c15e6d0 2024-09-15T23:20:23.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.604+0000 7f2491b9f640 1 -- 172.21.15.123:0/2905150535 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f248c0b2490 con 0x7f248c15e6d0 2024-09-15T23:20:23.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.605+0000 7f2491b9f640 1 -- 172.21.15.123:0/2905150535 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f248c071390 con 0x7f248c15e6d0 2024-09-15T23:20:23.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.606+0000 7f2473fff640 1 -- 172.21.15.123:0/2905150535 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2484032830 con 0x7f248c15e6d0 2024-09-15T23:20:23.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.606+0000 7f2473fff640 1 --2- 172.21.15.123:0/2905150535 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f247806c2b0 0x7f247806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:23.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.606+0000 7f2473fff640 1 -- 172.21.15.123:0/2905150535 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 4943+0+0 (secure 0 0 0) 0x7f24840ab8f0 con 0x7f248c15e6d0 2024-09-15T23:20:23.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.606+0000 7f248b7fe640 1 --2- 172.21.15.123:0/2905150535 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f247806c2b0 0x7f247806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:23.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.607+0000 7f248b7fe640 1 --2- 172.21.15.123:0/2905150535 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f247806c2b0 0x7f247806e770 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f247c007440 tx=0x7f247c00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:23.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.610+0000 7f2473fff640 1 -- 172.21.15.123:0/2905150535 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f248407a3f0 con 0x7f248c15e6d0 2024-09-15T23:20:23.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.841+0000 7f2491b9f640 1 -- 172.21.15.123:0/2905150535 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]} v 0) -- 0x7f248c1622e0 con 0x7f248c15e6d0 2024-09-15T23:20:23.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.878+0000 7f2473fff640 1 -- 172.21.15.123:0/2905150535 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]}]=0 v409) ==== 169+0+0 (secure 0 0 0) 0x7f2484079cf0 con 0x7f248c15e6d0 2024-09-15T23:20:23.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.881+0000 7f2491b9f640 1 -- 172.21.15.123:0/2905150535 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f247806c2b0 msgr2=0x7f247806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:23.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.881+0000 7f2491b9f640 1 --2- 172.21.15.123:0/2905150535 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f247806c2b0 0x7f247806e770 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f247c007440 tx=0x7f247c00b040 comp rx=0 tx=0).stop 2024-09-15T23:20:23.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.881+0000 7f2491b9f640 1 -- 172.21.15.123:0/2905150535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f248c15e6d0 msgr2=0x7f248c0b29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:23.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.881+0000 7f2491b9f640 1 --2- 172.21.15.123:0/2905150535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f248c15e6d0 0x7f248c0b29b0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f2484035040 tx=0x7f24840046c0 comp rx=0 tx=0).stop 2024-09-15T23:20:23.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.881+0000 7f2491b9f640 1 -- 172.21.15.123:0/2905150535 shutdown_connections 2024-09-15T23:20:23.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.881+0000 7f2491b9f640 1 --2- 172.21.15.123:0/2905150535 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f247806c2b0 0x7f247806e770 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:23.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.881+0000 7f2491b9f640 1 --2- 172.21.15.123:0/2905150535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f248c15e6d0 0x7f248c0b29b0 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:23.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.881+0000 7f2491b9f640 1 --2- 172.21.15.123:0/2905150535 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f248c070b80 0x7f248c1f3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:23.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.881+0000 7f2491b9f640 1 --2- 172.21.15.123:0/2905150535 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f248c06cd20 0x7f248c15d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:23.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.881+0000 7f2491b9f640 1 -- 172.21.15.123:0/2905150535 >> 172.21.15.123:0/2905150535 conn(0x7f248c067fb0 msgr2=0x7f248c162ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:23.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.881+0000 7f2491b9f640 1 -- 172.21.15.123:0/2905150535 shutdown_connections 2024-09-15T23:20:23.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.881+0000 7f2491b9f640 1 -- 172.21.15.123:0/2905150535 wait complete. 2024-09-15T23:20:23.893 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T23:20:23.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.993+0000 7f73b2f54640 1 Processor -- start 2024-09-15T23:20:23.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.993+0000 7f73b2f54640 1 -- start start 2024-09-15T23:20:23.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.994+0000 7f73b2f54640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f73ac0ccf30 0x7f73ac0b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:23.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.994+0000 7f73b2f54640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f73ac0cead0 0x7f73ac071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:23.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.994+0000 7f73b2f54640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73ac0cf2e0 con 0x7f73ac15b7c0 2024-09-15T23:20:23.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.994+0000 7f73b2f54640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f73ac070fe0 con 0x7f73ac0ccf30 2024-09-15T23:20:23.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.994+0000 7f73b2f54640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f73ac0712c0 con 0x7f73ac0cead0 2024-09-15T23:20:23.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.994+0000 7f73b0cf0640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f73ac0ccf30 0x7f73ac0b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:23.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.994+0000 7f73a3fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f73ac15b7c0 0x7f73ac0cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59648/0 (socket says 172.21.15.123:59648) 2024-09-15T23:20:23.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.994+0000 7f73a3fff640 1 -- 172.21.15.123:0/443635820 learned_addr learned my addr 172.21.15.123:0/443635820 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:23.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.994+0000 7f73b14f1640 1 --2- 172.21.15.123:0/443635820 >> v2:172.21.15.188:3300/0 conn(0x7f73ac0cead0 0x7f73ac071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:23.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.994+0000 7f73b0cf0640 1 -- 172.21.15.123:0/443635820 >> v2:172.21.15.188:3300/0 conn(0x7f73ac0cead0 msgr2=0x7f73ac071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:23.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.994+0000 7f73b0cf0640 1 --2- 172.21.15.123:0/443635820 >> v2:172.21.15.188:3300/0 conn(0x7f73ac0cead0 0x7f73ac071ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:23.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.994+0000 7f73b0cf0640 1 -- 172.21.15.123:0/443635820 >> v1:172.21.15.123:6789/0 conn(0x7f73ac15b7c0 legacy=0x7f73ac0cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:23.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.994+0000 7f73b0cf0640 1 -- 172.21.15.123:0/443635820 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73ac0715a0 con 0x7f73ac0ccf30 2024-09-15T23:20:23.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.994+0000 7f73a37fe640 1 -- 172.21.15.123:0/443635820 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4020276992 0 0) 0x7f73ac0cf2e0 con 0x7f73ac15b7c0 2024-09-15T23:20:23.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.995+0000 7f73b0cf0640 1 --2- 172.21.15.123:0/443635820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73ac0ccf30 0x7f73ac0b2c50 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f73ac06f170 tx=0x7f73a802c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7571bce6268c0d32 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:23.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.995+0000 7f73a37fe640 1 -- 172.21.15.123:0/443635820 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a8031710 con 0x7f73ac0ccf30 2024-09-15T23:20:23.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.995+0000 7f73a37fe640 1 -- 172.21.15.123:0/443635820 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73a80318b0 con 0x7f73ac0ccf30 2024-09-15T23:20:23.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.995+0000 7f73a37fe640 1 -- 172.21.15.123:0/443635820 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a8031c80 con 0x7f73ac0ccf30 2024-09-15T23:20:24.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.996+0000 7f73b2f54640 1 -- 172.21.15.123:0/443635820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73ac0ccf30 msgr2=0x7f73ac0b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:24.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.996+0000 7f73b2f54640 1 --2- 172.21.15.123:0/443635820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73ac0ccf30 0x7f73ac0b2c50 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f73ac06f170 tx=0x7f73a802c7e0 comp rx=0 tx=0).stop 2024-09-15T23:20:24.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.996+0000 7f73b2f54640 1 -- 172.21.15.123:0/443635820 shutdown_connections 2024-09-15T23:20:24.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.996+0000 7f73b2f54640 1 --2- 172.21.15.123:0/443635820 >> v2:172.21.15.188:3300/0 conn(0x7f73ac0cead0 0x7f73ac071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:24.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.996+0000 7f73b2f54640 1 --2- 172.21.15.123:0/443635820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73ac0ccf30 0x7f73ac0b2c50 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:24.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.996+0000 7f73b2f54640 1 -- 172.21.15.123:0/443635820 >> 172.21.15.123:0/443635820 conn(0x7f73ac06d0f0 msgr2=0x7f73ac06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:24.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.996+0000 7f73b2f54640 1 -- 172.21.15.123:0/443635820 shutdown_connections 2024-09-15T23:20:24.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.996+0000 7f73b2f54640 1 -- 172.21.15.123:0/443635820 wait complete. 2024-09-15T23:20:24.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.997+0000 7f73b2f54640 1 Processor -- start 2024-09-15T23:20:24.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.997+0000 7f73b2f54640 1 -- start start 2024-09-15T23:20:24.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.998+0000 7f73b2f54640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f73ac0ccf30 0x7f73ac14e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:24.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.998+0000 7f73b2f54640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f73ac0cead0 0x7f73ac0cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:24.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.998+0000 7f73b2f54640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73ac15b7c0 0x7f73ac06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:24.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.998+0000 7f73b2f54640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f73ac0cf080 con 0x7f73ac15b7c0 2024-09-15T23:20:24.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.998+0000 7f73b2f54640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f73ac0cef00 con 0x7f73ac0cead0 2024-09-15T23:20:24.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.998+0000 7f73b2f54640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f73ac072000 con 0x7f73ac0ccf30 2024-09-15T23:20:24.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.998+0000 7f73b14f1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73ac15b7c0 0x7f73ac06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:24.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.998+0000 7f73b14f1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73ac15b7c0 0x7f73ac06bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60724/0 (socket says 172.21.15.123:60724) 2024-09-15T23:20:24.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.998+0000 7f73b14f1640 1 -- 172.21.15.123:0/3095687443 learned_addr learned my addr 172.21.15.123:0/3095687443 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:24.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.998+0000 7f73b0cf0640 1 --2- 172.21.15.123:0/3095687443 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f73ac0ccf30 0x7f73ac14e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:24.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.998+0000 7f73a3fff640 1 --2- 172.21.15.123:0/3095687443 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f73ac0cead0 0x7f73ac0cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:24.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.998+0000 7f73b14f1640 1 -- 172.21.15.123:0/3095687443 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f73ac0ccf30 msgr2=0x7f73ac14e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:24.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.998+0000 7f73b14f1640 1 --2- 172.21.15.123:0/3095687443 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f73ac0ccf30 0x7f73ac14e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:24.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.998+0000 7f73b14f1640 1 -- 172.21.15.123:0/3095687443 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f73ac0cead0 msgr2=0x7f73ac0cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:24.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.998+0000 7f73b14f1640 1 --2- 172.21.15.123:0/3095687443 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f73ac0cead0 0x7f73ac0cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:24.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.998+0000 7f73b14f1640 1 -- 172.21.15.123:0/3095687443 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73ac14e990 con 0x7f73ac15b7c0 2024-09-15T23:20:24.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.998+0000 7f73b14f1640 1 --2- 172.21.15.123:0/3095687443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73ac15b7c0 0x7f73ac06bc10 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f73a4007e70 tx=0x7f73a400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:24.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.998+0000 7f73a17fa640 1 -- 172.21.15.123:0/3095687443 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a4014620 con 0x7f73ac15b7c0 2024-09-15T23:20:24.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.998+0000 7f73a17fa640 1 -- 172.21.15.123:0/3095687443 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73a4019070 con 0x7f73ac15b7c0 2024-09-15T23:20:24.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.998+0000 7f73b2f54640 1 -- 172.21.15.123:0/3095687443 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73ac0c9a50 con 0x7f73ac15b7c0 2024-09-15T23:20:24.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.998+0000 7f73a17fa640 1 -- 172.21.15.123:0/3095687443 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73a4014a20 con 0x7f73ac15b7c0 2024-09-15T23:20:24.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.999+0000 7f73b2f54640 1 -- 172.21.15.123:0/3095687443 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73ac0ca010 con 0x7f73ac15b7c0 2024-09-15T23:20:24.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:23.999+0000 7f73b2f54640 1 -- 172.21.15.123:0/3095687443 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73ac0b2c50 con 0x7f73ac15b7c0 2024-09-15T23:20:24.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.000+0000 7f73a17fa640 1 -- 172.21.15.123:0/3095687443 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f73a4014bc0 con 0x7f73ac15b7c0 2024-09-15T23:20:24.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.000+0000 7f73a17fa640 1 --2- 172.21.15.123:0/3095687443 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f739806c2b0 0x7f739806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:24.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.000+0000 7f73a17fa640 1 -- 172.21.15.123:0/3095687443 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 4943+0+0 (secure 0 0 0) 0x7f73a408b9f0 con 0x7f73ac15b7c0 2024-09-15T23:20:24.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.001+0000 7f73b0cf0640 1 --2- 172.21.15.123:0/3095687443 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f739806c2b0 0x7f739806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:24.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.001+0000 7f73b0cf0640 1 --2- 172.21.15.123:0/3095687443 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f739806c2b0 0x7f739806e770 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f73a8036000 tx=0x7f73a8031000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:24.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.005+0000 7f73a17fa640 1 -- 172.21.15.123:0/3095687443 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f73a405a4f0 con 0x7f73ac15b7c0 2024-09-15T23:20:24.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.169+0000 7f73b2f54640 1 -- 172.21.15.123:0/3095687443 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f73ac0cc960 con 0x7f73ac15b7c0 2024-09-15T23:20:24.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.173+0000 7f73a17fa640 1 -- 172.21.15.123:0/3095687443 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v40)=0 v40) ==== 122+0+0 (secure 0 0 0) 0x7f73a4059df0 con 0x7f73ac15b7c0 2024-09-15T23:20:24.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.175+0000 7f73b2f54640 1 -- 172.21.15.123:0/3095687443 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f739806c2b0 msgr2=0x7f739806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:24.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.175+0000 7f73b2f54640 1 --2- 172.21.15.123:0/3095687443 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f739806c2b0 0x7f739806e770 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f73a8036000 tx=0x7f73a8031000 comp rx=0 tx=0).stop 2024-09-15T23:20:24.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.175+0000 7f73b2f54640 1 -- 172.21.15.123:0/3095687443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73ac15b7c0 msgr2=0x7f73ac06bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:24.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.175+0000 7f73b2f54640 1 --2- 172.21.15.123:0/3095687443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73ac15b7c0 0x7f73ac06bc10 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f73a4007e70 tx=0x7f73a400e4b0 comp rx=0 tx=0).stop 2024-09-15T23:20:24.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.175+0000 7f73b2f54640 1 -- 172.21.15.123:0/3095687443 shutdown_connections 2024-09-15T23:20:24.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.175+0000 7f73b2f54640 1 --2- 172.21.15.123:0/3095687443 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f739806c2b0 0x7f739806e770 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:24.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.175+0000 7f73b2f54640 1 --2- 172.21.15.123:0/3095687443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73ac15b7c0 0x7f73ac06bc10 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:24.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.175+0000 7f73b2f54640 1 --2- 172.21.15.123:0/3095687443 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f73ac0cead0 0x7f73ac0cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:24.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.175+0000 7f73b2f54640 1 --2- 172.21.15.123:0/3095687443 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f73ac0ccf30 0x7f73ac14e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:24.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.175+0000 7f73b2f54640 1 -- 172.21.15.123:0/3095687443 >> 172.21.15.123:0/3095687443 conn(0x7f73ac06d0f0 msgr2=0x7f73ac0cd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:24.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.175+0000 7f73b2f54640 1 -- 172.21.15.123:0/3095687443 shutdown_connections 2024-09-15T23:20:24.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.175+0000 7f73b2f54640 1 -- 172.21.15.123:0/3095687443 wait complete. 2024-09-15T23:20:24.187 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:20:24.187 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:20:24.222 DEBUG:teuthology.orchestra.run.smithi188:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:20:24.263 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:20:24.263 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:20:24.264 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:20:24.279 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:20:24.279 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:20:24.279 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:20:24.322 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:20:24.322 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:20:24.323 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:20:24.338 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:20:24.338 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:20:24.338 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:20:24.381 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:20:24.381 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-15T23:20:24.381 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:20:24.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.479+0000 7f7fa445e640 1 Processor -- start 2024-09-15T23:20:24.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.479+0000 7f7fa445e640 1 -- start start 2024-09-15T23:20:24.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.480+0000 7f7fa445e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7f9c15ab40 0x7f7f9c06c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:24.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.480+0000 7f7fa445e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f9c15af20 0x7f7f9c15b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:24.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.480+0000 7f7fa445e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f9c072520 con 0x7f7f9c0720b0 2024-09-15T23:20:24.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.480+0000 7f7fa445e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f7f9c071010 con 0x7f7f9c15ab40 2024-09-15T23:20:24.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.480+0000 7f7fa445e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7f9c0712f0 con 0x7f7f9c15af20 2024-09-15T23:20:24.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.480+0000 7f7fa21fa640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7f9c15ab40 0x7f7f9c06c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:24.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.480+0000 7f7fa21fa640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7f9c15ab40 0x7f7f9c06c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60732/0 (socket says 172.21.15.123:60732) 2024-09-15T23:20:24.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.480+0000 7f7fa21fa640 1 -- 172.21.15.123:0/762742588 learned_addr learned my addr 172.21.15.123:0/762742588 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:24.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.480+0000 7f7fa21fa640 1 -- 172.21.15.123:0/762742588 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f9c15af20 msgr2=0x7f7f9c15b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:24.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.480+0000 7f7fa29fb640 1 --2- 172.21.15.123:0/762742588 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f9c15af20 0x7f7f9c15b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:24.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.480+0000 7f7fa21fa640 1 --2- 172.21.15.123:0/762742588 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f9c15af20 0x7f7f9c15b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:24.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.480+0000 7f7fa21fa640 1 -- 172.21.15.123:0/762742588 >> v1:172.21.15.188:6789/0 conn(0x7f7f9c0720b0 legacy=0x7f7f9c073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:24.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.480+0000 7f7fa21fa640 1 -- 172.21.15.123:0/762742588 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f9c0715d0 con 0x7f7f9c15ab40 2024-09-15T23:20:24.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.481+0000 7f7fa21fa640 1 --2- 172.21.15.123:0/762742588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f9c15ab40 0x7f7f9c06c6a0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f7f9800d150 tx=0x7f7f9802c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bec77419362a3f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:24.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.481+0000 7f7fa11f8640 1 -- 172.21.15.123:0/762742588 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f98039070 con 0x7f7f9c15ab40 2024-09-15T23:20:24.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.481+0000 7f7fa11f8640 1 -- 172.21.15.123:0/762742588 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f98009600 con 0x7f7f9c15ab40 2024-09-15T23:20:24.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.481+0000 7f7fa11f8640 1 -- 172.21.15.123:0/762742588 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f980099d0 con 0x7f7f9c15ab40 2024-09-15T23:20:24.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.482+0000 7f7fa445e640 1 -- 172.21.15.123:0/762742588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f9c15ab40 msgr2=0x7f7f9c06c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:24.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.482+0000 7f7fa445e640 1 --2- 172.21.15.123:0/762742588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f9c15ab40 0x7f7f9c06c6a0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f7f9800d150 tx=0x7f7f9802c840 comp rx=0 tx=0).stop 2024-09-15T23:20:24.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.482+0000 7f7fa445e640 1 -- 172.21.15.123:0/762742588 shutdown_connections 2024-09-15T23:20:24.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.482+0000 7f7fa445e640 1 --2- 172.21.15.123:0/762742588 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f9c15af20 0x7f7f9c15b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:24.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.482+0000 7f7fa445e640 1 --2- 172.21.15.123:0/762742588 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f9c15ab40 0x7f7f9c06c6a0 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:24.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.482+0000 7f7fa445e640 1 -- 172.21.15.123:0/762742588 >> 172.21.15.123:0/762742588 conn(0x7f7f9c0ccec0 msgr2=0x7f7f9c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:24.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.482+0000 7f7fa445e640 1 -- 172.21.15.123:0/762742588 shutdown_connections 2024-09-15T23:20:24.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.482+0000 7f7fa445e640 1 -- 172.21.15.123:0/762742588 wait complete. 2024-09-15T23:20:24.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.483+0000 7f7fa445e640 1 Processor -- start 2024-09-15T23:20:24.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.483+0000 7f7fa445e640 1 -- start start 2024-09-15T23:20:24.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.484+0000 7f7fa445e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f9c0720b0 0x7f7f9c159020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:24.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.484+0000 7f7fa445e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f9c15ab40 0x7f7f9c0aaac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:24.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.484+0000 7f7fa445e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f9c15af20 0x7f7f9c0ad470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:24.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.484+0000 7f7fa445e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c15ba30 con 0x7f7f9c15af20 2024-09-15T23:20:24.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.484+0000 7f7fa445e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c15b8b0 con 0x7f7f9c15ab40 2024-09-15T23:20:24.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.484+0000 7f7fa445e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7f9c06bc10 con 0x7f7f9c0720b0 2024-09-15T23:20:24.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.484+0000 7f7fa29fb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f9c15af20 0x7f7f9c0ad470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:24.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.484+0000 7f7fa29fb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f9c15af20 0x7f7f9c0ad470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60740/0 (socket says 172.21.15.123:60740) 2024-09-15T23:20:24.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.484+0000 7f7fa29fb640 1 -- 172.21.15.123:0/862344110 learned_addr learned my addr 172.21.15.123:0/862344110 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:24.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.484+0000 7f7fa21fa640 1 --2- 172.21.15.123:0/862344110 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f9c0720b0 0x7f7f9c159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:24.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.484+0000 7f7fa19f9640 1 --2- 172.21.15.123:0/862344110 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f9c15ab40 0x7f7f9c0aaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:24.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.484+0000 7f7fa29fb640 1 -- 172.21.15.123:0/862344110 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f9c0720b0 msgr2=0x7f7f9c159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:24.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.484+0000 7f7fa29fb640 1 --2- 172.21.15.123:0/862344110 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f9c0720b0 0x7f7f9c159020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:24.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.484+0000 7f7fa29fb640 1 -- 172.21.15.123:0/862344110 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f9c15ab40 msgr2=0x7f7f9c0aaac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:24.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.484+0000 7f7fa29fb640 1 --2- 172.21.15.123:0/862344110 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f9c15ab40 0x7f7f9c0aaac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:24.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.484+0000 7f7fa29fb640 1 -- 172.21.15.123:0/862344110 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f9c0ac4d0 con 0x7f7f9c15af20 2024-09-15T23:20:24.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.484+0000 7f7fa29fb640 1 --2- 172.21.15.123:0/862344110 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f9c15af20 0x7f7f9c0ad470 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f7f9400c550 tx=0x7f7f9400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:24.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.484+0000 7f7f92ffd640 1 -- 172.21.15.123:0/862344110 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f94015070 con 0x7f7f9c15af20 2024-09-15T23:20:24.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.484+0000 7f7f92ffd640 1 -- 172.21.15.123:0/862344110 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f94004220 con 0x7f7f9c15af20 2024-09-15T23:20:24.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.484+0000 7f7fa445e640 1 -- 172.21.15.123:0/862344110 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f9c0ab430 con 0x7f7f9c15af20 2024-09-15T23:20:24.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.484+0000 7f7f92ffd640 1 -- 172.21.15.123:0/862344110 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f94003610 con 0x7f7f9c15af20 2024-09-15T23:20:24.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.484+0000 7f7fa445e640 1 -- 172.21.15.123:0/862344110 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f9c0ab9f0 con 0x7f7f9c15af20 2024-09-15T23:20:24.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.485+0000 7f7fa445e640 1 -- 172.21.15.123:0/862344110 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f9c06bfe0 con 0x7f7f9c15af20 2024-09-15T23:20:24.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.486+0000 7f7f92ffd640 1 -- 172.21.15.123:0/862344110 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7f940037b0 con 0x7f7f9c15af20 2024-09-15T23:20:24.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.486+0000 7f7f92ffd640 1 --2- 172.21.15.123:0/862344110 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7f8006c2b0 0x7f7f8006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:24.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.486+0000 7f7f92ffd640 1 -- 172.21.15.123:0/862344110 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 4943+0+0 (secure 0 0 0) 0x7f7f9408ae90 con 0x7f7f9c15af20 2024-09-15T23:20:24.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.486+0000 7f7fa21fa640 1 --2- 172.21.15.123:0/862344110 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7f8006c2b0 0x7f7f8006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:24.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.487+0000 7f7fa21fa640 1 --2- 172.21.15.123:0/862344110 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7f8006c2b0 0x7f7f8006e770 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f7f98036000 tx=0x7f7f9800b000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:24.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.490+0000 7f7f92ffd640 1 -- 172.21.15.123:0/862344110 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7f94059900 con 0x7f7f9c15af20 2024-09-15T23:20:24.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.690+0000 7f7fa445e640 1 -- 172.21.15.123:0/862344110 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f9c0686b0 con 0x7f7f9c15af20 2024-09-15T23:20:24.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.690+0000 7f7f92ffd640 1 -- 172.21.15.123:0/862344110 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) ==== 94+0+3923 (secure 0 0 0) 0x7f7f94059200 con 0x7f7f9c15af20 2024-09-15T23:20:24.692 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:24.692 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":88,"btime":"2024-09-15T23:20:19:866864+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6854,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/1928324132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1928324132},{"type":"v1","addr":"172.21.15.188:6837","nonce":1928324132}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88},{"gid":8418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2082746470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2082746470},{"type":"v1","addr":"172.21.15.123:6834","nonce":2082746470}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8421,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2007610603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":2007610603},{"type":"v1","addr":"172.21.15.123:6835","nonce":2007610603}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83},{"gid":8436,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2929123975","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2929123975},{"type":"v1","addr":"172.21.15.188:6836","nonce":2929123975}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[]} 2024-09-15T23:20:24.692 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 88 2024-09-15T23:20:24.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.692+0000 7f7fa445e640 1 -- 172.21.15.123:0/862344110 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7f8006c2b0 msgr2=0x7f7f8006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:24.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.692+0000 7f7fa445e640 1 --2- 172.21.15.123:0/862344110 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7f8006c2b0 0x7f7f8006e770 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f7f98036000 tx=0x7f7f9800b000 comp rx=0 tx=0).stop 2024-09-15T23:20:24.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.692+0000 7f7fa445e640 1 -- 172.21.15.123:0/862344110 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f9c15af20 msgr2=0x7f7f9c0ad470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:24.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.692+0000 7f7fa445e640 1 --2- 172.21.15.123:0/862344110 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f9c15af20 0x7f7f9c0ad470 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f7f9400c550 tx=0x7f7f9400ca10 comp rx=0 tx=0).stop 2024-09-15T23:20:24.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.693+0000 7f7fa445e640 1 -- 172.21.15.123:0/862344110 shutdown_connections 2024-09-15T23:20:24.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.693+0000 7f7fa445e640 1 --2- 172.21.15.123:0/862344110 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7f8006c2b0 0x7f7f8006e770 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:24.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.693+0000 7f7fa445e640 1 --2- 172.21.15.123:0/862344110 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f9c15af20 0x7f7f9c0ad470 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:24.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.693+0000 7f7fa445e640 1 --2- 172.21.15.123:0/862344110 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f9c15ab40 0x7f7f9c0aaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:24.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.693+0000 7f7fa445e640 1 --2- 172.21.15.123:0/862344110 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f9c0720b0 0x7f7f9c159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:24.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.693+0000 7f7fa445e640 1 -- 172.21.15.123:0/862344110 >> 172.21.15.123:0/862344110 conn(0x7f7f9c0ccec0 msgr2=0x7f7f9c0b4730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:24.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.693+0000 7f7fa445e640 1 -- 172.21.15.123:0/862344110 shutdown_connections 2024-09-15T23:20:24.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.693+0000 7f7fa445e640 1 -- 172.21.15.123:0/862344110 wait complete. 2024-09-15T23:20:24.705 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T23:20:24.705 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T23:20:24.705 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T23:20:24.706 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:20:24.706 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T23:20:24.706 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T23:20:24.706 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T23:20:24.706 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:20:24.706 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T23:20:24.706 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T23:20:24.707 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T23:20:24.707 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:20:24.707 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T23:20:24.707 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T23:20:24.707 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T23:20:24.707 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:20:24.715 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T23:20:24.715 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T23:20:24.716 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T23:20:24.716 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T23:20:24.722 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T23:20:24.722 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T23:20:24.723 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T23:20:24.723 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T23:20:24.758 INFO:tasks.ceph.mds.a:Started 2024-09-15T23:20:24.759 DEBUG:teuthology.parallel:result is None 2024-09-15T23:20:24.759 INFO:tasks.ceph.mds.c:Started 2024-09-15T23:20:24.760 DEBUG:teuthology.parallel:result is None 2024-09-15T23:20:24.765 INFO:tasks.ceph.mds.b:Started 2024-09-15T23:20:24.766 DEBUG:teuthology.parallel:result is None 2024-09-15T23:20:24.766 INFO:tasks.ceph.mds.d:Started 2024-09-15T23:20:24.766 DEBUG:teuthology.parallel:result is None 2024-09-15T23:20:24.767 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T23:20:24.833 INFO:tasks.ceph.mds.a.smithi123.stdout:starting mds.a at 2024-09-15T23:20:24.833 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-15T23:20:24.849 INFO:tasks.ceph.mds.b.smithi188.stdout:starting mds.b at 2024-09-15T23:20:24.849 INFO:tasks.ceph.mds.d.smithi188.stdout:starting mds.d at 2024-09-15T23:20:24.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.869+0000 7f9797d2c640 1 Processor -- start 2024-09-15T23:20:24.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.869+0000 7f9797d2c640 1 -- start start 2024-09-15T23:20:24.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.870+0000 7f9797d2c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f979015ed20 0x7f97900b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:24.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.870+0000 7f9797d2c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f97900d23b0 0x7f97900b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:24.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.870+0000 7f9797d2c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97900d0e70 con 0x7f97900cf2d0 2024-09-15T23:20:24.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.870+0000 7f9797d2c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f97900d41c0 con 0x7f979015ed20 2024-09-15T23:20:24.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.870+0000 7f9797d2c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f97900d35b0 con 0x7f97900d23b0 2024-09-15T23:20:24.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.870+0000 7f9795ac8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f979015ed20 0x7f97900b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:24.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.870+0000 7f97952c7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f97900d23b0 0x7f97900b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:24.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.870+0000 7f9795ac8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f979015ed20 0x7f97900b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:39042/0 (socket says 172.21.15.123:39042) 2024-09-15T23:20:24.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.870+0000 7f97962c9640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f97900cf2d0 0x7f97900cf760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:43284/0 (socket says 172.21.15.123:43284) 2024-09-15T23:20:24.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.870+0000 7f9795ac8640 1 -- 172.21.15.123:0/425171726 learned_addr learned my addr 172.21.15.123:0/425171726 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:24.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.871+0000 7f9795ac8640 1 -- 172.21.15.123:0/425171726 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f97900d23b0 msgr2=0x7f97900b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:24.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.871+0000 7f9795ac8640 1 --2- 172.21.15.123:0/425171726 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f97900d23b0 0x7f97900b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:24.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.871+0000 7f9795ac8640 1 -- 172.21.15.123:0/425171726 >> v1:172.21.15.188:6789/0 conn(0x7f97900cf2d0 legacy=0x7f97900cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:24.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.871+0000 7f9795ac8640 1 -- 172.21.15.123:0/425171726 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97900d3890 con 0x7f979015ed20 2024-09-15T23:20:24.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.871+0000 7f9794ac6640 1 -- 172.21.15.123:0/425171726 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 531996832 0 0) 0x7f9788001490 con 0x7f97900cf2d0 2024-09-15T23:20:24.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.871+0000 7f9795ac8640 1 --2- 172.21.15.123:0/425171726 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f979015ed20 0x7f97900b6260 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9784009870 tx=0x7f978402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1d50497c8ef8d7b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:24.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.871+0000 7f9794ac6640 1 -- 172.21.15.123:0/425171726 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9784037070 con 0x7f979015ed20 2024-09-15T23:20:24.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.871+0000 7f9794ac6640 1 -- 172.21.15.123:0/425171726 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9784032440 con 0x7f979015ed20 2024-09-15T23:20:24.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.872+0000 7f9794ac6640 1 -- 172.21.15.123:0/425171726 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9784032810 con 0x7f979015ed20 2024-09-15T23:20:24.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.872+0000 7f9797d2c640 1 -- 172.21.15.123:0/425171726 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f979015ed20 msgr2=0x7f97900b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:24.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.872+0000 7f9797d2c640 1 --2- 172.21.15.123:0/425171726 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f979015ed20 0x7f97900b6260 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9784009870 tx=0x7f978402a270 comp rx=0 tx=0).stop 2024-09-15T23:20:24.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.872+0000 7f9797d2c640 1 -- 172.21.15.123:0/425171726 shutdown_connections 2024-09-15T23:20:24.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.872+0000 7f9797d2c640 1 --2- 172.21.15.123:0/425171726 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f97900d23b0 0x7f97900b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:24.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.872+0000 7f9797d2c640 1 --2- 172.21.15.123:0/425171726 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f979015ed20 0x7f97900b6260 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:24.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.872+0000 7f9797d2c640 1 -- 172.21.15.123:0/425171726 >> 172.21.15.123:0/425171726 conn(0x7f97900d1260 msgr2=0x7f97900d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:24.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.872+0000 7f9797d2c640 1 -- 172.21.15.123:0/425171726 shutdown_connections 2024-09-15T23:20:24.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.872+0000 7f9797d2c640 1 -- 172.21.15.123:0/425171726 wait complete. 2024-09-15T23:20:24.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.873+0000 7f9797d2c640 1 Processor -- start 2024-09-15T23:20:24.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.873+0000 7f9797d2c640 1 -- start start 2024-09-15T23:20:24.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.874+0000 7f9797d2c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97900cf2d0 0x7f97900ca650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:24.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.874+0000 7f9797d2c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f97900d23b0 0x7f97901556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:24.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.874+0000 7f9797d2c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f979015ed20 0x7f9790155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:24.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.874+0000 7f9797d2c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f97900d32a0 con 0x7f97900cf2d0 2024-09-15T23:20:24.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.874+0000 7f9797d2c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f97900d3e50 con 0x7f979015ed20 2024-09-15T23:20:24.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.874+0000 7f9797d2c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f979015f100 con 0x7f97900d23b0 2024-09-15T23:20:24.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.874+0000 7f9795ac8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97900cf2d0 0x7f97900ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:24.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.874+0000 7f9795ac8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97900cf2d0 0x7f97900ca650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60796/0 (socket says 172.21.15.123:60796) 2024-09-15T23:20:24.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.874+0000 7f9795ac8640 1 -- 172.21.15.123:0/2699049929 learned_addr learned my addr 172.21.15.123:0/2699049929 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:24.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.874+0000 7f97962c9640 1 --2- 172.21.15.123:0/2699049929 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f979015ed20 0x7f9790155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:24.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.874+0000 7f97952c7640 1 --2- 172.21.15.123:0/2699049929 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f97900d23b0 0x7f97901556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:24.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.874+0000 7f9795ac8640 1 -- 172.21.15.123:0/2699049929 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f97900d23b0 msgr2=0x7f97901556c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:24.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.874+0000 7f9795ac8640 1 --2- 172.21.15.123:0/2699049929 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f97900d23b0 0x7f97901556c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:24.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.874+0000 7f9795ac8640 1 -- 172.21.15.123:0/2699049929 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f979015ed20 msgr2=0x7f9790155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:24.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.874+0000 7f9795ac8640 1 --2- 172.21.15.123:0/2699049929 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f979015ed20 0x7f9790155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:24.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.874+0000 7f9795ac8640 1 -- 172.21.15.123:0/2699049929 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97901574b0 con 0x7f97900cf2d0 2024-09-15T23:20:24.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.875+0000 7f9795ac8640 1 --2- 172.21.15.123:0/2699049929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97900cf2d0 0x7f97900ca650 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f9784035040 tx=0x7f97840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:24.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.875+0000 7f97827fc640 1 -- 172.21.15.123:0/2699049929 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9784037040 con 0x7f97900cf2d0 2024-09-15T23:20:24.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.875+0000 7f97827fc640 1 -- 172.21.15.123:0/2699049929 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9784004030 con 0x7f97900cf2d0 2024-09-15T23:20:24.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.875+0000 7f9797d2c640 1 -- 172.21.15.123:0/2699049929 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9790156140 con 0x7f97900cf2d0 2024-09-15T23:20:24.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.875+0000 7f97827fc640 1 -- 172.21.15.123:0/2699049929 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9784004420 con 0x7f97900cf2d0 2024-09-15T23:20:24.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.875+0000 7f9797d2c640 1 -- 172.21.15.123:0/2699049929 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97901569d0 con 0x7f97900cf2d0 2024-09-15T23:20:24.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.876+0000 7f9797d2c640 1 -- 172.21.15.123:0/2699049929 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97900b7010 con 0x7f97900cf2d0 2024-09-15T23:20:24.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.876+0000 7f97827fc640 1 -- 172.21.15.123:0/2699049929 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f978403a070 con 0x7f97900cf2d0 2024-09-15T23:20:24.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.877+0000 7f97827fc640 1 --2- 172.21.15.123:0/2699049929 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f977406c2b0 0x7f977406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:24.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.877+0000 7f97827fc640 1 -- 172.21.15.123:0/2699049929 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 4943+0+0 (secure 0 0 0) 0x7f97840ab660 con 0x7f97900cf2d0 2024-09-15T23:20:24.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.879+0000 7f97952c7640 1 --2- 172.21.15.123:0/2699049929 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f977406c2b0 0x7f977406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:24.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.881+0000 7f97827fc640 1 -- 172.21.15.123:0/2699049929 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9784041020 con 0x7f97900cf2d0 2024-09-15T23:20:24.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:24.882+0000 7f97952c7640 1 --2- 172.21.15.123:0/2699049929 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f977406c2b0 0x7f977406e770 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f97900cb300 tx=0x7f978c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:25.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:25.059+0000 7f9797d2c640 1 -- 172.21.15.123:0/2699049929 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f97900b3f20 con 0x7f97900cf2d0 2024-09-15T23:20:25.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:25.909+0000 7f97827fc640 1 -- 172.21.15.123:0/2699049929 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v150) ==== 97+0+0 (secure 0 0 0) 0x7f9784079a80 con 0x7f97900cf2d0 2024-09-15T23:20:25.910 INFO:teuthology.orchestra.run.smithi123.stderr: removed all blocklist entries 2024-09-15T23:20:25.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:25.911+0000 7f9797d2c640 1 -- 172.21.15.123:0/2699049929 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f977406c2b0 msgr2=0x7f977406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:25.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:25.911+0000 7f9797d2c640 1 --2- 172.21.15.123:0/2699049929 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f977406c2b0 0x7f977406e770 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f97900cb300 tx=0x7f978c009190 comp rx=0 tx=0).stop 2024-09-15T23:20:25.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:25.911+0000 7f9797d2c640 1 -- 172.21.15.123:0/2699049929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97900cf2d0 msgr2=0x7f97900ca650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:25.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:25.911+0000 7f9797d2c640 1 --2- 172.21.15.123:0/2699049929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97900cf2d0 0x7f97900ca650 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f9784035040 tx=0x7f97840046c0 comp rx=0 tx=0).stop 2024-09-15T23:20:25.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:25.912+0000 7f9797d2c640 1 -- 172.21.15.123:0/2699049929 shutdown_connections 2024-09-15T23:20:25.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:25.912+0000 7f9797d2c640 1 --2- 172.21.15.123:0/2699049929 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f979015ed20 0x7f9790155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:25.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:25.912+0000 7f9797d2c640 1 --2- 172.21.15.123:0/2699049929 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f97900d23b0 0x7f97901556c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:25.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:25.912+0000 7f9797d2c640 1 --2- 172.21.15.123:0/2699049929 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f977406c2b0 0x7f977406e770 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:25.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:25.912+0000 7f9797d2c640 1 --2- 172.21.15.123:0/2699049929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97900cf2d0 0x7f97900ca650 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:25.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:25.912+0000 7f9797d2c640 1 -- 172.21.15.123:0/2699049929 >> 172.21.15.123:0/2699049929 conn(0x7f97900d1260 msgr2=0x7f97900d4740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:25.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:25.912+0000 7f9797d2c640 1 -- 172.21.15.123:0/2699049929 shutdown_connections 2024-09-15T23:20:25.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:25.912+0000 7f9797d2c640 1 -- 172.21.15.123:0/2699049929 wait complete. 2024-09-15T23:20:25.925 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T23:20:26.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.023+0000 7f70fc5c4640 1 Processor -- start 2024-09-15T23:20:26.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.024+0000 7f70fc5c4640 1 -- start start 2024-09-15T23:20:26.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.024+0000 7f70fc5c4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f70f40b6970 0x7f70f40b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:26.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.024+0000 7f70fc5c4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f70f40d23b0 0x7f70f40b8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:26.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.024+0000 7f70fc5c4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70f40d0e70 con 0x7f70f415ed20 2024-09-15T23:20:26.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.024+0000 7f70fc5c4640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f70f40d41c0 con 0x7f70f40b6970 2024-09-15T23:20:26.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.024+0000 7f70fc5c4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f70f40d35b0 con 0x7f70f40d23b0 2024-09-15T23:20:26.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.025+0000 7f70f9b5f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f70f40b6970 0x7f70f40b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:26.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.025+0000 7f70f9b5f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f70f40b6970 0x7f70f40b80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60812/0 (socket says 172.21.15.123:60812) 2024-09-15T23:20:26.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.025+0000 7f70fa360640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f70f415ed20 0x7f70f40b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59662/0 (socket says 172.21.15.123:59662) 2024-09-15T23:20:26.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.025+0000 7f70f9b5f640 1 -- 172.21.15.123:0/1772343373 learned_addr learned my addr 172.21.15.123:0/1772343373 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:26.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.025+0000 7f70f9b5f640 1 -- 172.21.15.123:0/1772343373 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f70f40d23b0 msgr2=0x7f70f40b8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:26.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.025+0000 7f70f9b5f640 1 --2- 172.21.15.123:0/1772343373 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f70f40d23b0 0x7f70f40b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:26.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.025+0000 7f70f9b5f640 1 -- 172.21.15.123:0/1772343373 >> v1:172.21.15.123:6789/0 conn(0x7f70f415ed20 legacy=0x7f70f40b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:26.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.025+0000 7f70f9b5f640 1 -- 172.21.15.123:0/1772343373 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70f40d3890 con 0x7f70f40b6970 2024-09-15T23:20:26.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.025+0000 7f70f935e640 1 -- 172.21.15.123:0/1772343373 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 828981297 0 0) 0x7f70ec001110 con 0x7f70f415ed20 2024-09-15T23:20:26.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.026+0000 7f70f9b5f640 1 --2- 172.21.15.123:0/1772343373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f40b6970 0x7f70f40b80d0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f70e8009870 tx=0x7f70e802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e3a974518595fc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:26.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.026+0000 7f70f935e640 1 -- 172.21.15.123:0/1772343373 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e8037070 con 0x7f70f40b6970 2024-09-15T23:20:26.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.026+0000 7f70f935e640 1 -- 172.21.15.123:0/1772343373 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e8032440 con 0x7f70f40b6970 2024-09-15T23:20:26.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.026+0000 7f70f935e640 1 -- 172.21.15.123:0/1772343373 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e8032810 con 0x7f70f40b6970 2024-09-15T23:20:26.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.026+0000 7f70fc5c4640 1 -- 172.21.15.123:0/1772343373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f40b6970 msgr2=0x7f70f40b80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:26.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.026+0000 7f70fc5c4640 1 --2- 172.21.15.123:0/1772343373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f40b6970 0x7f70f40b80d0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f70e8009870 tx=0x7f70e802a1c0 comp rx=0 tx=0).stop 2024-09-15T23:20:26.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.026+0000 7f70fc5c4640 1 -- 172.21.15.123:0/1772343373 shutdown_connections 2024-09-15T23:20:26.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.026+0000 7f70fc5c4640 1 --2- 172.21.15.123:0/1772343373 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f70f40d23b0 0x7f70f40b8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:26.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.026+0000 7f70fc5c4640 1 --2- 172.21.15.123:0/1772343373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f40b6970 0x7f70f40b80d0 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:26.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.026+0000 7f70fc5c4640 1 -- 172.21.15.123:0/1772343373 >> 172.21.15.123:0/1772343373 conn(0x7f70f40d1260 msgr2=0x7f70f40d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:26.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.026+0000 7f70fc5c4640 1 -- 172.21.15.123:0/1772343373 shutdown_connections 2024-09-15T23:20:26.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.026+0000 7f70fc5c4640 1 -- 172.21.15.123:0/1772343373 wait complete. 2024-09-15T23:20:26.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.028+0000 7f70fc5c4640 1 Processor -- start 2024-09-15T23:20:26.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.028+0000 7f70fc5c4640 1 -- start start 2024-09-15T23:20:26.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.028+0000 7f70fc5c4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f40b6970 0x7f70f415bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:26.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.028+0000 7f70fc5c4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f70f40d23b0 0x7f70f40cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:26.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.028+0000 7f70fc5c4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f70f415ed20 0x7f70f41f8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:26.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.028+0000 7f70fc5c4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f70f40d32a0 con 0x7f70f40b6970 2024-09-15T23:20:26.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.028+0000 7f70fc5c4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f70f40d3e50 con 0x7f70f40d23b0 2024-09-15T23:20:26.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.028+0000 7f70fc5c4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f70f415f100 con 0x7f70f415ed20 2024-09-15T23:20:26.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.028+0000 7f70fa360640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f40b6970 0x7f70f415bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:26.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.028+0000 7f70fa360640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f40b6970 0x7f70f415bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60818/0 (socket says 172.21.15.123:60818) 2024-09-15T23:20:26.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.028+0000 7f70fa360640 1 -- 172.21.15.123:0/2376533607 learned_addr learned my addr 172.21.15.123:0/2376533607 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:26.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.029+0000 7f70fa360640 1 -- 172.21.15.123:0/2376533607 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f70f415ed20 msgr2=0x7f70f41f8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:26.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.029+0000 7f70fab61640 1 --2- 172.21.15.123:0/2376533607 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f70f415ed20 0x7f70f41f8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:26.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.029+0000 7f70fa360640 1 --2- 172.21.15.123:0/2376533607 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f70f415ed20 0x7f70f41f8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:26.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.029+0000 7f70fa360640 1 -- 172.21.15.123:0/2376533607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f70f40d23b0 msgr2=0x7f70f40cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:26.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.029+0000 7f70fa360640 1 --2- 172.21.15.123:0/2376533607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f70f40d23b0 0x7f70f40cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:26.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.029+0000 7f70fa360640 1 -- 172.21.15.123:0/2376533607 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70f4155890 con 0x7f70f40b6970 2024-09-15T23:20:26.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.029+0000 7f70fa360640 1 --2- 172.21.15.123:0/2376533607 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f40b6970 0x7f70f415bd00 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00c780 tx=0x7f70ec00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:26.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.029+0000 7f70f2ffd640 1 -- 172.21.15.123:0/2376533607 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ec018070 con 0x7f70f40b6970 2024-09-15T23:20:26.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.029+0000 7f70f2ffd640 1 -- 172.21.15.123:0/2376533607 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70ec0072d0 con 0x7f70f40b6970 2024-09-15T23:20:26.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.029+0000 7f70fc5c4640 1 -- 172.21.15.123:0/2376533607 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70f41f8cd0 con 0x7f70f40b6970 2024-09-15T23:20:26.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.029+0000 7f70f2ffd640 1 -- 172.21.15.123:0/2376533607 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ec0047e0 con 0x7f70f40b6970 2024-09-15T23:20:26.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.029+0000 7f70fc5c4640 1 -- 172.21.15.123:0/2376533607 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70f41f89c0 con 0x7f70f40b6970 2024-09-15T23:20:26.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.030+0000 7f70fc5c4640 1 -- 172.21.15.123:0/2376533607 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70f40b7010 con 0x7f70f40b6970 2024-09-15T23:20:26.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.031+0000 7f70f2ffd640 1 -- 172.21.15.123:0/2376533607 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f70ec01b070 con 0x7f70f40b6970 2024-09-15T23:20:26.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.031+0000 7f70f2ffd640 1 --2- 172.21.15.123:0/2376533607 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f70e006c2b0 0x7f70e006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:26.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.031+0000 7f70f2ffd640 1 -- 172.21.15.123:0/2376533607 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 4857+0+0 (secure 0 0 0) 0x7f70ec08a480 con 0x7f70f40b6970 2024-09-15T23:20:26.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.031+0000 7f70f9b5f640 1 --2- 172.21.15.123:0/2376533607 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f70e006c2b0 0x7f70e006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:26.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.032+0000 7f70f9b5f640 1 --2- 172.21.15.123:0/2376533607 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f70e006c2b0 0x7f70e006e770 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f70e8034000 tx=0x7f70e802c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:26.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.035+0000 7f70f2ffd640 1 -- 172.21.15.123:0/2376533607 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f70f40d0e70 con 0x7f70f40b6970 2024-09-15T23:20:26.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.265+0000 7f70fc5c4640 1 -- 172.21.15.123:0/2376533607 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f70f4155c40 con 0x7f70f40b6970 2024-09-15T23:20:26.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.265+0000 7f70f2ffd640 1 -- 172.21.15.123:0/2376533607 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) ==== 80+0+5304 (secure 0 0 0) 0x7f70ec058f40 con 0x7f70f40b6970 2024-09-15T23:20:26.267 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:26.268 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:20:26.268 INFO:teuthology.orchestra.run.smithi123.stdout: "auth_dump": [ 2024-09-15T23:20:26.268 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:20:26.268 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.a", 2024-09-15T23:20:26.268 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm9ATVDhAAnukyZogTuG4YCbzRXSCkiQ==", 2024-09-15T23:20:26.269 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:20:26.269 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:20:26.269 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:20:26.270 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:20:26.270 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:20:26.270 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:20:26.270 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:20:26.270 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:20:26.270 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.b", 2024-09-15T23:20:26.270 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm4KmaGhAAbf6vcffqiJTOYXK5DCXcZA==", 2024-09-15T23:20:26.270 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:20:26.270 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:20:26.270 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:20:26.271 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:20:26.271 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:20:26.271 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:20:26.271 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:20:26.271 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:20:26.271 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.c", 2024-09-15T23:20:26.271 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmua/VFRAAwbPm2TslrfQkrvHiO8oeLg==", 2024-09-15T23:20:26.271 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:20:26.271 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:20:26.271 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:20:26.271 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:20:26.271 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:20:26.271 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:20:26.272 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:20:26.272 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:20:26.272 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.d", 2024-09-15T23:20:26.272 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmzw3eIRAAaE+5y9USwp+xM3MTAndn7Q==", 2024-09-15T23:20:26.272 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:20:26.272 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:20:26.272 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:20:26.272 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:20:26.272 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:20:26.272 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:20:26.272 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:20:26.272 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:20:26.272 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.0", 2024-09-15T23:20:26.273 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCRaedmFrHGAxAAy/jTkothESNn2DC9xcHDAQ==", 2024-09-15T23:20:26.273 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:20:26.273 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:20:26.273 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:20:26.273 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:20:26.273 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:20:26.273 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:20:26.273 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:20:26.273 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.1", 2024-09-15T23:20:26.273 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCUaedm6vZlIxAAdsnLqFSng6SRpCT6UZKGsw==", 2024-09-15T23:20:26.273 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:20:26.273 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:20:26.273 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:20:26.273 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:20:26.274 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:20:26.274 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:20:26.274 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:20:26.274 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.2", 2024-09-15T23:20:26.274 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCYaedmXgVwFRAA1mOzzRafhKMsU7kTAT6TqA==", 2024-09-15T23:20:26.274 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:20:26.274 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:20:26.274 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:20:26.274 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:20:26.274 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:20:26.274 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:20:26.274 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:20:26.274 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.3", 2024-09-15T23:20:26.275 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCcaedm+APAFhAAb8blNFzswwHriSmCrMuA0A==", 2024-09-15T23:20:26.275 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:20:26.275 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:20:26.275 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:20:26.275 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:20:26.275 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:20:26.275 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:20:26.275 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:20:26.275 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.4", 2024-09-15T23:20:26.275 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCjaedmReUmABAAXpxsK7osxn/ZelVXKiCLOw==", 2024-09-15T23:20:26.275 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:20:26.275 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:20:26.275 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:20:26.275 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:20:26.276 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:20:26.276 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:20:26.276 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:20:26.276 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.5", 2024-09-15T23:20:26.276 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCnaedmtbdmARAAdxguBdtwBmtiaIx/y992GA==", 2024-09-15T23:20:26.276 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:20:26.276 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:20:26.276 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:20:26.276 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:20:26.276 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:20:26.276 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:20:26.276 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:20:26.276 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.6", 2024-09-15T23:20:26.276 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCraedmkR+NAxAAd2GAAH0BgOMonU8iTSn+Fw==", 2024-09-15T23:20:26.277 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:20:26.277 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:20:26.277 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:20:26.277 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:20:26.277 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:20:26.277 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:20:26.277 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:20:26.277 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.7", 2024-09-15T23:20:26.277 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCvaedmAaCwBBAAdpDtCbXchArmy019wiOdSQ==", 2024-09-15T23:20:26.277 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:20:26.277 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:20:26.277 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:20:26.277 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:20:26.278 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:20:26.278 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:20:26.278 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:20:26.278 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.0", 2024-09-15T23:20:26.278 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmzQPqJRAAhUf1dnVYohN4obCfeu8+7g==", 2024-09-15T23:20:26.278 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:20:26.278 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:20:26.278 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow r", 2024-09-15T23:20:26.278 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-15T23:20:26.278 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:20:26.278 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:20:26.278 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:20:26.278 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.1", 2024-09-15T23:20:26.278 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmdKK0LhAAXXmUkxVwMEjRTRXUh9CL/g==", 2024-09-15T23:20:26.279 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:20:26.279 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:20:26.279 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:20:26.279 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:20:26.279 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:20:26.279 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:20:26.279 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:20:26.279 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:20:26.279 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.2", 2024-09-15T23:20:26.279 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmRz55KxAARi7B4WYOY1QqH1CK81z9pA==", 2024-09-15T23:20:26.279 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:20:26.279 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:20:26.279 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:20:26.280 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:20:26.280 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:20:26.280 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:20:26.280 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:20:26.280 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:20:26.280 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.3", 2024-09-15T23:20:26.280 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmbWo8NBAAR1qGX1bs35ojx6lMxftcfg==", 2024-09-15T23:20:26.280 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:20:26.280 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:20:26.280 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:20:26.280 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:20:26.280 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:20:26.280 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:20:26.281 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:20:26.281 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:20:26.281 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.admin", 2024-09-15T23:20:26.281 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCMaedmVUW0LhAAqgPFk1HtxsZXcIStNN43pA==", 2024-09-15T23:20:26.281 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:20:26.281 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:20:26.281 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:20:26.281 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:20:26.281 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:20:26.281 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:20:26.281 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:20:26.281 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:20:26.281 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.x", 2024-09-15T23:20:26.281 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmGPSBCxAAHAhXQERogdAOm0ZPNtlxpw==", 2024-09-15T23:20:26.282 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:20:26.282 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:20:26.282 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-15T23:20:26.282 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:20:26.282 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:20:26.282 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:20:26.282 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:20:26.282 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.y", 2024-09-15T23:20:26.282 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm5Om4BxAA/7ZtMMlbUA3bvMCfaNMQyg==", 2024-09-15T23:20:26.282 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:20:26.282 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:20:26.282 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-15T23:20:26.282 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:20:26.283 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:20:26.283 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:20:26.283 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-15T23:20:26.283 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:20:26.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.267+0000 7f70fc5c4640 1 -- 172.21.15.123:0/2376533607 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f70e006c2b0 msgr2=0x7f70e006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:26.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.267+0000 7f70fc5c4640 1 --2- 172.21.15.123:0/2376533607 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f70e006c2b0 0x7f70e006e770 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f70e8034000 tx=0x7f70e802c000 comp rx=0 tx=0).stop 2024-09-15T23:20:26.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.267+0000 7f70fc5c4640 1 -- 172.21.15.123:0/2376533607 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f40b6970 msgr2=0x7f70f415bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:26.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.267+0000 7f70fc5c4640 1 --2- 172.21.15.123:0/2376533607 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f40b6970 0x7f70f415bd00 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00c780 tx=0x7f70ec00cc40 comp rx=0 tx=0).stop 2024-09-15T23:20:26.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.267+0000 7f70fc5c4640 1 -- 172.21.15.123:0/2376533607 shutdown_connections 2024-09-15T23:20:26.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.267+0000 7f70fc5c4640 1 --2- 172.21.15.123:0/2376533607 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f70f415ed20 0x7f70f41f8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:26.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.267+0000 7f70fc5c4640 1 --2- 172.21.15.123:0/2376533607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f70f40d23b0 0x7f70f40cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:26.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.267+0000 7f70fc5c4640 1 --2- 172.21.15.123:0/2376533607 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f70e006c2b0 0x7f70e006e770 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:26.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.267+0000 7f70fc5c4640 1 --2- 172.21.15.123:0/2376533607 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70f40b6970 0x7f70f415bd00 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:26.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.267+0000 7f70fc5c4640 1 -- 172.21.15.123:0/2376533607 >> 172.21.15.123:0/2376533607 conn(0x7f70f40d1260 msgr2=0x7f70f41612f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:26.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.268+0000 7f70fc5c4640 1 -- 172.21.15.123:0/2376533607 shutdown_connections 2024-09-15T23:20:26.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.268+0000 7f70fc5c4640 1 -- 172.21.15.123:0/2376533607 wait complete. 2024-09-15T23:20:26.286 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T23:20:26.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.383+0000 7fa504ba1640 1 Processor -- start 2024-09-15T23:20:26.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.383+0000 7fa504ba1640 1 -- start start 2024-09-15T23:20:26.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.384+0000 7fa504ba1640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa50015ed20 0x7fa5000b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:26.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.384+0000 7fa504ba1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa5000b90e0 0x7fa5000b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:26.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.384+0000 7fa504ba1640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5000d0e70 con 0x7fa5000d23b0 2024-09-15T23:20:26.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.384+0000 7fa504ba1640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fa5000d41c0 con 0x7fa50015ed20 2024-09-15T23:20:26.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.384+0000 7fa504ba1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa5000d35b0 con 0x7fa5000b90e0 2024-09-15T23:20:26.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.384+0000 7fa4f5d9b640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa5000d23b0 0x7fa5000cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:48942/0 (socket says 172.21.15.123:48942) 2024-09-15T23:20:26.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.384+0000 7fa4f5d9b640 1 -- 172.21.15.123:0/4079089639 learned_addr learned my addr 172.21.15.123:0/4079089639 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:26.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.384+0000 7fa4fed9d640 1 --2- 172.21.15.123:0/4079089639 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa5000b90e0 0x7fa5000b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:26.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.384+0000 7fa4fe59c640 1 --2- 172.21.15.123:0/4079089639 >> v2:172.21.15.188:3300/0 conn(0x7fa50015ed20 0x7fa5000b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:26.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.385+0000 7fa4fdd9b640 1 -- 172.21.15.123:0/4079089639 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2122073018 0 0) 0x7fa4e8001110 con 0x7fa5000d23b0 2024-09-15T23:20:26.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.385+0000 7fa4fdd9b640 1 -- 172.21.15.123:0/4079089639 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4ec003520 con 0x7fa5000d23b0 2024-09-15T23:20:26.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.385+0000 7fa4fdd9b640 1 -- 172.21.15.123:0/4079089639 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1873528752 0 0) 0x7fa4ec003520 con 0x7fa5000d23b0 2024-09-15T23:20:26.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.385+0000 7fa4fdd9b640 1 -- 172.21.15.123:0/4079089639 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa5000b90e0 msgr2=0x7fa5000b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:26.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.385+0000 7fa4fdd9b640 1 --2- 172.21.15.123:0/4079089639 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa5000b90e0 0x7fa5000b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:26.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.385+0000 7fa4fdd9b640 1 -- 172.21.15.123:0/4079089639 >> v2:172.21.15.188:3300/0 conn(0x7fa50015ed20 msgr2=0x7fa5000b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:26.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.385+0000 7fa4fdd9b640 1 --2- 172.21.15.123:0/4079089639 >> v2:172.21.15.188:3300/0 conn(0x7fa50015ed20 0x7fa5000b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:26.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.385+0000 7fa4fdd9b640 1 -- 172.21.15.123:0/4079089639 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5000d3890 con 0x7fa5000d23b0 2024-09-15T23:20:26.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.385+0000 7fa4fdd9b640 1 -- 172.21.15.123:0/4079089639 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fa4e8001840 con 0x7fa5000d23b0 2024-09-15T23:20:26.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.385+0000 7fa4fdd9b640 1 -- 172.21.15.123:0/4079089639 >> v1:172.21.15.123:6789/0 conn(0x7fa5000d23b0 legacy=0x7fa5000cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:26.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.385+0000 7fa4fdd9b640 1 --2- 172.21.15.123:0/4079089639 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa5000b90e0 0x7fa4ec0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:26.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.385+0000 7fa4fdd9b640 1 --2- 172.21.15.123:0/4079089639 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4ec003f30 0x7fa4ec004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:26.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.385+0000 7fa4fdd9b640 1 --2- 172.21.15.123:0/4079089639 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4ec004d40 0x7fa4ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:26.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.385+0000 7fa4fdd9b640 1 -- 172.21.15.123:0/4079089639 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa5000d41c0 con 0x7fa4ec003f30 2024-09-15T23:20:26.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.385+0000 7fa4fdd9b640 1 -- 172.21.15.123:0/4079089639 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa5000d35b0 con 0x7fa4ec004d40 2024-09-15T23:20:26.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.385+0000 7fa4fdd9b640 1 -- 172.21.15.123:0/4079089639 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa4ec00ba10 con 0x7fa5000b90e0 2024-09-15T23:20:26.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.385+0000 7fa4f5d9b640 1 --2- 172.21.15.123:0/4079089639 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4ec003f30 0x7fa4ec004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:26.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.385+0000 7fa4fe59c640 1 --2- 172.21.15.123:0/4079089639 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa5000b90e0 0x7fa4ec0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:26.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.385+0000 7fa4fed9d640 1 --2- 172.21.15.123:0/4079089639 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4ec004d40 0x7fa4ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:26.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.385+0000 7fa4f5d9b640 1 -- 172.21.15.123:0/4079089639 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa5000b90e0 msgr2=0x7fa4ec0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:26.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.385+0000 7fa4f5d9b640 1 --2- 172.21.15.123:0/4079089639 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa5000b90e0 0x7fa4ec0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:26.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.385+0000 7fa4f5d9b640 1 -- 172.21.15.123:0/4079089639 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4ec004d40 msgr2=0x7fa4ec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:26.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.385+0000 7fa4f5d9b640 1 --2- 172.21.15.123:0/4079089639 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa4ec004d40 0x7fa4ec0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:26.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.385+0000 7fa4f5d9b640 1 -- 172.21.15.123:0/4079089639 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4ec003520 con 0x7fa4ec003f30 2024-09-15T23:20:26.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.386+0000 7fa4f5d9b640 1 --2- 172.21.15.123:0/4079089639 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4ec003f30 0x7fa4ec004800 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fa4e800c410 tx=0x7fa4ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4bef60c171e9dc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:26.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.386+0000 7fa4fdd9b640 1 -- 172.21.15.123:0/4079089639 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8032020 con 0x7fa4ec003f30 2024-09-15T23:20:26.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.386+0000 7fa4fdd9b640 1 -- 172.21.15.123:0/4079089639 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4e8005ad0 con 0x7fa4ec003f30 2024-09-15T23:20:26.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.386+0000 7fa4fdd9b640 1 -- 172.21.15.123:0/4079089639 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e800c0e0 con 0x7fa4ec003f30 2024-09-15T23:20:26.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.387+0000 7fa504ba1640 1 -- 172.21.15.123:0/4079089639 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4ec003f30 msgr2=0x7fa4ec004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:26.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.387+0000 7fa504ba1640 1 --2- 172.21.15.123:0/4079089639 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4ec003f30 0x7fa4ec004800 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fa4e800c410 tx=0x7fa4ec005830 comp rx=0 tx=0).stop 2024-09-15T23:20:26.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.387+0000 7fa4fed9d640 1 -- 172.21.15.123:0/4079089639 reap_dead start 2024-09-15T23:20:26.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.387+0000 7fa504ba1640 1 -- 172.21.15.123:0/4079089639 shutdown_connections 2024-09-15T23:20:26.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.387+0000 7fa504ba1640 1 -- 172.21.15.123:0/4079089639 >> 172.21.15.123:0/4079089639 conn(0x7fa5000d1260 msgr2=0x7fa5000d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:26.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.387+0000 7fa504ba1640 1 -- 172.21.15.123:0/4079089639 shutdown_connections 2024-09-15T23:20:26.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.387+0000 7fa504ba1640 1 -- 172.21.15.123:0/4079089639 wait complete. 2024-09-15T23:20:26.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.388+0000 7fa504ba1640 1 Processor -- start 2024-09-15T23:20:26.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.388+0000 7fa504ba1640 1 -- start start 2024-09-15T23:20:26.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.389+0000 7fa504ba1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4ec003f30 0x7fa5000ce190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:26.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.389+0000 7fa504ba1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5000cabd0 0x7fa5001556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:26.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.389+0000 7fa504ba1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa500154c10 0x7fa5000b4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:26.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.389+0000 7fa504ba1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa5000d32a0 con 0x7fa5000cabd0 2024-09-15T23:20:26.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.389+0000 7fa504ba1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa5000d3e50 con 0x7fa500154c10 2024-09-15T23:20:26.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.389+0000 7fa504ba1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa50015f100 con 0x7fa4ec003f30 2024-09-15T23:20:26.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.389+0000 7fa4f5d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5000cabd0 0x7fa5001556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:26.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.389+0000 7fa4f5d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5000cabd0 0x7fa5001556c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41022/0 (socket says 172.21.15.123:41022) 2024-09-15T23:20:26.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.389+0000 7fa4f5d9b640 1 -- 172.21.15.123:0/3018040971 learned_addr learned my addr 172.21.15.123:0/3018040971 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:26.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.389+0000 7fa4fe59c640 1 --2- 172.21.15.123:0/3018040971 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4ec003f30 0x7fa5000ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:26.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.389+0000 7fa4fed9d640 1 --2- 172.21.15.123:0/3018040971 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa500154c10 0x7fa5000b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:26.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.389+0000 7fa4f5d9b640 1 -- 172.21.15.123:0/3018040971 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4ec003f30 msgr2=0x7fa5000ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:26.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.389+0000 7fa4f5d9b640 1 --2- 172.21.15.123:0/3018040971 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4ec003f30 0x7fa5000ce190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:26.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.389+0000 7fa4f5d9b640 1 -- 172.21.15.123:0/3018040971 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa500154c10 msgr2=0x7fa5000b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:26.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.389+0000 7fa4f5d9b640 1 --2- 172.21.15.123:0/3018040971 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa500154c10 0x7fa5000b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:26.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.389+0000 7fa4f5d9b640 1 -- 172.21.15.123:0/3018040971 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa500160520 con 0x7fa5000cabd0 2024-09-15T23:20:26.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.390+0000 7fa4f5d9b640 1 --2- 172.21.15.123:0/3018040971 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5000cabd0 0x7fa5001556c0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8031040 tx=0x7fa4e8001c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:26.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.390+0000 7fa4f77fe640 1 -- 172.21.15.123:0/3018040971 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8007270 con 0x7fa5000cabd0 2024-09-15T23:20:26.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.390+0000 7fa4f77fe640 1 -- 172.21.15.123:0/3018040971 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4e8007410 con 0x7fa5000cabd0 2024-09-15T23:20:26.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.390+0000 7fa4f77fe640 1 -- 172.21.15.123:0/3018040971 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e80077e0 con 0x7fa5000cabd0 2024-09-15T23:20:26.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.390+0000 7fa504ba1640 1 -- 172.21.15.123:0/3018040971 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa500160800 con 0x7fa5000cabd0 2024-09-15T23:20:26.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.390+0000 7fa504ba1640 1 -- 172.21.15.123:0/3018040971 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa500160dc0 con 0x7fa5000cabd0 2024-09-15T23:20:26.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.391+0000 7fa504ba1640 1 -- 172.21.15.123:0/3018040971 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5000b7010 con 0x7fa5000cabd0 2024-09-15T23:20:26.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.391+0000 7fa4f77fe640 1 -- 172.21.15.123:0/3018040971 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa4e8035020 con 0x7fa5000cabd0 2024-09-15T23:20:26.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.392+0000 7fa4f77fe640 1 --2- 172.21.15.123:0/3018040971 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa4e006c2b0 0x7fa4e006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:26.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.392+0000 7fa4f77fe640 1 -- 172.21.15.123:0/3018040971 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 4857+0+0 (secure 0 0 0) 0x7fa4e80abab0 con 0x7fa5000cabd0 2024-09-15T23:20:26.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.392+0000 7fa4fe59c640 1 --2- 172.21.15.123:0/3018040971 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa4e006c2b0 0x7fa4e006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:26.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.392+0000 7fa4fe59c640 1 --2- 172.21.15.123:0/3018040971 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa4e006c2b0 0x7fa4e006e770 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fa500160450 tx=0x7fa4f0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:26.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.396+0000 7fa4f77fe640 1 -- 172.21.15.123:0/3018040971 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa5000d0e70 con 0x7fa5000cabd0 2024-09-15T23:20:26.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.565+0000 7fa504ba1640 1 -- 172.21.15.123:0/3018040971 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fa5001623a0 con 0x7fa5000cabd0 2024-09-15T23:20:26.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.565+0000 7fa4f77fe640 1 -- 172.21.15.123:0/3018040971 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v150) ==== 84+0+65 (secure 0 0 0) 0x7fa4e8005aa0 con 0x7fa5000cabd0 2024-09-15T23:20:26.566 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:26.566 INFO:teuthology.orchestra.run.smithi123.stdout:[ 2024-09-15T23:20:26.566 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:20:26.566 INFO:teuthology.orchestra.run.smithi123.stdout: "poolnum": 1, 2024-09-15T23:20:26.566 INFO:teuthology.orchestra.run.smithi123.stdout: "poolname": ".mgr" 2024-09-15T23:20:26.567 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:20:26.567 INFO:teuthology.orchestra.run.smithi123.stdout:] 2024-09-15T23:20:26.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.567+0000 7fa504ba1640 1 -- 172.21.15.123:0/3018040971 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa4e006c2b0 msgr2=0x7fa4e006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:26.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.567+0000 7fa504ba1640 1 --2- 172.21.15.123:0/3018040971 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa4e006c2b0 0x7fa4e006e770 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fa500160450 tx=0x7fa4f0008040 comp rx=0 tx=0).stop 2024-09-15T23:20:26.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.567+0000 7fa504ba1640 1 -- 172.21.15.123:0/3018040971 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5000cabd0 msgr2=0x7fa5001556c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:26.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.567+0000 7fa504ba1640 1 --2- 172.21.15.123:0/3018040971 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5000cabd0 0x7fa5001556c0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8031040 tx=0x7fa4e8001c10 comp rx=0 tx=0).stop 2024-09-15T23:20:26.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.567+0000 7fa504ba1640 1 -- 172.21.15.123:0/3018040971 shutdown_connections 2024-09-15T23:20:26.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.567+0000 7fa504ba1640 1 --2- 172.21.15.123:0/3018040971 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa500154c10 0x7fa5000b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:26.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.567+0000 7fa504ba1640 1 --2- 172.21.15.123:0/3018040971 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa4e006c2b0 0x7fa4e006e770 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:26.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.567+0000 7fa504ba1640 1 --2- 172.21.15.123:0/3018040971 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5000cabd0 0x7fa5001556c0 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:26.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.567+0000 7fa504ba1640 1 --2- 172.21.15.123:0/3018040971 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa4ec003f30 0x7fa5000ce190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:26.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.567+0000 7fa504ba1640 1 -- 172.21.15.123:0/3018040971 >> 172.21.15.123:0/3018040971 conn(0x7fa5000d1260 msgr2=0x7fa5000b5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:26.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.567+0000 7fa504ba1640 1 -- 172.21.15.123:0/3018040971 shutdown_connections 2024-09-15T23:20:26.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.567+0000 7fa504ba1640 1 -- 172.21.15.123:0/3018040971 wait complete. 2024-09-15T23:20:26.579 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T23:20:26.580 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T23:20:26.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.682+0000 7ff38805e640 1 Processor -- start 2024-09-15T23:20:26.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.682+0000 7ff38805e640 1 -- start start 2024-09-15T23:20:26.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.683+0000 7ff38805e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff3801555b0 0x7ff38015f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:26.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.683+0000 7ff38805e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3800aee10 con 0x7ff3800ae870 2024-09-15T23:20:26.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.683+0000 7ff38805e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3800af0f0 con 0x7ff380073030 2024-09-15T23:20:26.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.683+0000 7ff38805e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7ff3800af3d0 con 0x7ff3801555b0 2024-09-15T23:20:26.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.683+0000 7ff3855f9640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff3800ae870 0x7ff380072920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:48956/0 (socket says 172.21.15.123:48956) 2024-09-15T23:20:26.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.683+0000 7ff3855f9640 1 -- 172.21.15.123:0/884556630 learned_addr learned my addr 172.21.15.123:0/884556630 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:26.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.683+0000 7ff385dfa640 1 --2- 172.21.15.123:0/884556630 >> v2:172.21.15.188:3300/0 conn(0x7ff3801555b0 0x7ff38015f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:26.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.683+0000 7ff384df8640 1 -- 172.21.15.123:0/884556630 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3910829755 0 0) 0x7ff3800aee10 con 0x7ff3800ae870 2024-09-15T23:20:26.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.683+0000 7ff384df8640 1 -- 172.21.15.123:0/884556630 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff36c003520 con 0x7ff3800ae870 2024-09-15T23:20:26.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.683+0000 7ff385dfa640 1 -- 172.21.15.123:0/884556630 >> v1:172.21.15.188:6789/0 conn(0x7ff380073030 legacy=0x7ff3800b4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:26.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.683+0000 7ff384df8640 1 -- 172.21.15.123:0/884556630 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1742588968 0 0) 0x7ff3800af0f0 con 0x7ff380073030 2024-09-15T23:20:26.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.683+0000 7ff385dfa640 1 -- 172.21.15.123:0/884556630 >> v1:172.21.15.123:6789/0 conn(0x7ff3800ae870 legacy=0x7ff380072920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:26.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.683+0000 7ff385dfa640 1 -- 172.21.15.123:0/884556630 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3800af6b0 con 0x7ff3801555b0 2024-09-15T23:20:26.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.684+0000 7ff385dfa640 1 --2- 172.21.15.123:0/884556630 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff3801555b0 0x7ff38015f6a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff37c0097a0 tx=0x7ff37c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a67e2bec30f52e30 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:26.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.684+0000 7ff384df8640 1 -- 172.21.15.123:0/884556630 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff37c037070 con 0x7ff3801555b0 2024-09-15T23:20:26.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.684+0000 7ff384df8640 1 -- 172.21.15.123:0/884556630 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff37c032440 con 0x7ff3801555b0 2024-09-15T23:20:26.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.684+0000 7ff384df8640 1 -- 172.21.15.123:0/884556630 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff37c0327f0 con 0x7ff3801555b0 2024-09-15T23:20:26.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.685+0000 7ff38805e640 1 -- 172.21.15.123:0/884556630 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff3801555b0 msgr2=0x7ff38015f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:26.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.685+0000 7ff38805e640 1 --2- 172.21.15.123:0/884556630 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff3801555b0 0x7ff38015f6a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff37c0097a0 tx=0x7ff37c02a230 comp rx=0 tx=0).stop 2024-09-15T23:20:26.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.685+0000 7ff38805e640 1 -- 172.21.15.123:0/884556630 shutdown_connections 2024-09-15T23:20:26.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.685+0000 7ff38805e640 1 --2- 172.21.15.123:0/884556630 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff3801555b0 0x7ff38015f6a0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:26.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.685+0000 7ff38805e640 1 -- 172.21.15.123:0/884556630 >> 172.21.15.123:0/884556630 conn(0x7ff38006c030 msgr2=0x7ff38006c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:26.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.685+0000 7ff38805e640 1 -- 172.21.15.123:0/884556630 shutdown_connections 2024-09-15T23:20:26.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.685+0000 7ff38805e640 1 -- 172.21.15.123:0/884556630 wait complete. 2024-09-15T23:20:26.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.686+0000 7ff38805e640 1 Processor -- start 2024-09-15T23:20:26.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.686+0000 7ff38805e640 1 -- start start 2024-09-15T23:20:26.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.687+0000 7ff38805e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff380073030 0x7ff3801501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:26.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.687+0000 7ff38805e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff3800ae870 0x7ff380150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:26.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.687+0000 7ff38805e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff3801555b0 0x7ff380157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:26.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.687+0000 7ff38805e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff380155b10 con 0x7ff380073030 2024-09-15T23:20:26.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.687+0000 7ff38805e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff380155990 con 0x7ff3801555b0 2024-09-15T23:20:26.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.687+0000 7ff38805e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ff38006f770 con 0x7ff3800ae870 2024-09-15T23:20:26.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.687+0000 7ff385dfa640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff380073030 0x7ff3801501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:26.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.687+0000 7ff385dfa640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff380073030 0x7ff3801501a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41030/0 (socket says 172.21.15.123:41030) 2024-09-15T23:20:26.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.687+0000 7ff385dfa640 1 -- 172.21.15.123:0/3768678461 learned_addr learned my addr 172.21.15.123:0/3768678461 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:26.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.687+0000 7ff385dfa640 1 -- 172.21.15.123:0/3768678461 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff3800ae870 msgr2=0x7ff380150710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:26.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.687+0000 7ff385dfa640 1 --2- 172.21.15.123:0/3768678461 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff3800ae870 0x7ff380150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:26.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.687+0000 7ff385dfa640 1 -- 172.21.15.123:0/3768678461 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff3801555b0 msgr2=0x7ff380157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:26.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.687+0000 7ff385dfa640 1 --2- 172.21.15.123:0/3768678461 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff3801555b0 0x7ff380157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:26.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.687+0000 7ff385dfa640 1 -- 172.21.15.123:0/3768678461 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3800cf310 con 0x7ff380073030 2024-09-15T23:20:26.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.687+0000 7ff385dfa640 1 --2- 172.21.15.123:0/3768678461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff380073030 0x7ff3801501a0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7ff37c02a270 tx=0x7ff37c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:26.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.688+0000 7ff3767fc640 1 -- 172.21.15.123:0/3768678461 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff37c037040 con 0x7ff380073030 2024-09-15T23:20:26.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.688+0000 7ff3767fc640 1 -- 172.21.15.123:0/3768678461 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff37c042070 con 0x7ff380073030 2024-09-15T23:20:26.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.688+0000 7ff38805e640 1 -- 172.21.15.123:0/3768678461 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3800d0660 con 0x7ff380073030 2024-09-15T23:20:26.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.688+0000 7ff3767fc640 1 -- 172.21.15.123:0/3768678461 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff37c030900 con 0x7ff380073030 2024-09-15T23:20:26.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.688+0000 7ff38805e640 1 -- 172.21.15.123:0/3768678461 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff380150c50 con 0x7ff380073030 2024-09-15T23:20:26.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.689+0000 7ff38805e640 1 -- 172.21.15.123:0/3768678461 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3800cf130 con 0x7ff380073030 2024-09-15T23:20:26.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.689+0000 7ff3767fc640 1 -- 172.21.15.123:0/3768678461 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff37c030aa0 con 0x7ff380073030 2024-09-15T23:20:26.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.689+0000 7ff3767fc640 1 --2- 172.21.15.123:0/3768678461 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff36406c2b0 0x7ff36406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:26.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.689+0000 7ff3767fc640 1 -- 172.21.15.123:0/3768678461 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 4857+0+0 (secure 0 0 0) 0x7ff37c0abab0 con 0x7ff380073030 2024-09-15T23:20:26.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.690+0000 7ff3855f9640 1 --2- 172.21.15.123:0/3768678461 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff36406c2b0 0x7ff36406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:26.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.690+0000 7ff3855f9640 1 --2- 172.21.15.123:0/3768678461 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff36406c2b0 0x7ff36406e770 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ff370000f60 tx=0x7ff3700078f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:26.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.694+0000 7ff3767fc640 1 -- 172.21.15.123:0/3768678461 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff3800cf130 con 0x7ff380073030 2024-09-15T23:20:26.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:26.859+0000 7ff38805e640 1 -- 172.21.15.123:0/3768678461 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff38015f6a0 con 0x7ff380073030 2024-09-15T23:20:27.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.177+0000 7ff3767fc640 1 -- 172.21.15.123:0/3768678461 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v151) ==== 138+0+0 (secure 0 0 0) 0x7ff37c045360 con 0x7ff380073030 2024-09-15T23:20:27.178 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' created 2024-09-15T23:20:27.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.180+0000 7ff38805e640 1 -- 172.21.15.123:0/3768678461 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff36406c2b0 msgr2=0x7ff36406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:27.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.180+0000 7ff38805e640 1 --2- 172.21.15.123:0/3768678461 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff36406c2b0 0x7ff36406e770 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ff370000f60 tx=0x7ff3700078f0 comp rx=0 tx=0).stop 2024-09-15T23:20:27.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.180+0000 7ff38805e640 1 -- 172.21.15.123:0/3768678461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff380073030 msgr2=0x7ff3801501a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:27.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.180+0000 7ff38805e640 1 --2- 172.21.15.123:0/3768678461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff380073030 0x7ff3801501a0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7ff37c02a270 tx=0x7ff37c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:20:27.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.180+0000 7ff38805e640 1 -- 172.21.15.123:0/3768678461 shutdown_connections 2024-09-15T23:20:27.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.180+0000 7ff38805e640 1 --2- 172.21.15.123:0/3768678461 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff3801555b0 0x7ff380157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:27.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.181+0000 7ff38805e640 1 --2- 172.21.15.123:0/3768678461 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff3800ae870 0x7ff380150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:27.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.181+0000 7ff38805e640 1 --2- 172.21.15.123:0/3768678461 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff36406c2b0 0x7ff36406e770 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:27.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.181+0000 7ff38805e640 1 --2- 172.21.15.123:0/3768678461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff380073030 0x7ff3801501a0 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:27.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.181+0000 7ff38805e640 1 -- 172.21.15.123:0/3768678461 >> 172.21.15.123:0/3768678461 conn(0x7ff38006c030 msgr2=0x7ff380153f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:27.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.181+0000 7ff38805e640 1 -- 172.21.15.123:0/3768678461 shutdown_connections 2024-09-15T23:20:27.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.181+0000 7ff38805e640 1 -- 172.21.15.123:0/3768678461 wait complete. 2024-09-15T23:20:27.196 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T23:20:27.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.301+0000 7f840bbb7640 1 Processor -- start 2024-09-15T23:20:27.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.301+0000 7f840bbb7640 1 -- start start 2024-09-15T23:20:27.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.302+0000 7f840bbb7640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f8404153550 0x7f840415d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:27.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.302+0000 7f840bbb7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f84040b3e80 0x7f84040b58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:27.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.302+0000 7f840bbb7640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84040b4310 con 0x7f84040b53b0 2024-09-15T23:20:27.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.302+0000 7f840bbb7640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f84040b45f0 con 0x7f84040b3e80 2024-09-15T23:20:27.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.302+0000 7f840bbb7640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f84040b48d0 con 0x7f8404153550 2024-09-15T23:20:27.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.302+0000 7f8409152640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f84040b3e80 0x7f84040b58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:27.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.302+0000 7f8409152640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f84040b3e80 0x7f84040b58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41036/0 (socket says 172.21.15.123:41036) 2024-09-15T23:20:27.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.302+0000 7f8409152640 1 -- 172.21.15.123:0/1276889489 learned_addr learned my addr 172.21.15.123:0/1276889489 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:27.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.302+0000 7f8409953640 1 --2- 172.21.15.123:0/1276889489 >> v2:172.21.15.188:3300/0 conn(0x7f8404153550 0x7f840415d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:27.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.302+0000 7f8409152640 1 -- 172.21.15.123:0/1276889489 >> v2:172.21.15.188:3300/0 conn(0x7f8404153550 msgr2=0x7f840415d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:27.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.302+0000 7f8409152640 1 --2- 172.21.15.123:0/1276889489 >> v2:172.21.15.188:3300/0 conn(0x7f8404153550 0x7f840415d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:27.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.302+0000 7f8409152640 1 -- 172.21.15.123:0/1276889489 >> v1:172.21.15.188:6789/0 conn(0x7f84040b53b0 legacy=0x7f84040cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:27.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.302+0000 7f8409152640 1 -- 172.21.15.123:0/1276889489 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84040b4bb0 con 0x7f84040b3e80 2024-09-15T23:20:27.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.303+0000 7f8409152640 1 --2- 172.21.15.123:0/1276889489 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84040b3e80 0x7f84040b58b0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f84040719b0 tx=0x7f83f402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd28fff948dff38 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:27.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.303+0000 7f8408951640 1 -- 172.21.15.123:0/1276889489 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f4037070 con 0x7f84040b3e80 2024-09-15T23:20:27.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.303+0000 7f8408951640 1 -- 172.21.15.123:0/1276889489 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83f4032440 con 0x7f84040b3e80 2024-09-15T23:20:27.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.303+0000 7f8408951640 1 -- 172.21.15.123:0/1276889489 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f4032810 con 0x7f84040b3e80 2024-09-15T23:20:27.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.304+0000 7f840bbb7640 1 -- 172.21.15.123:0/1276889489 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84040b3e80 msgr2=0x7f84040b58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:27.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.304+0000 7f840bbb7640 1 --2- 172.21.15.123:0/1276889489 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84040b3e80 0x7f84040b58b0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f84040719b0 tx=0x7f83f402a210 comp rx=0 tx=0).stop 2024-09-15T23:20:27.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.304+0000 7f840bbb7640 1 -- 172.21.15.123:0/1276889489 shutdown_connections 2024-09-15T23:20:27.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.304+0000 7f840bbb7640 1 --2- 172.21.15.123:0/1276889489 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84040b3e80 0x7f84040b58b0 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:27.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.304+0000 7f840bbb7640 1 --2- 172.21.15.123:0/1276889489 >> v2:172.21.15.188:3300/0 conn(0x7f8404153550 0x7f840415d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:27.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.304+0000 7f840bbb7640 1 -- 172.21.15.123:0/1276889489 >> 172.21.15.123:0/1276889489 conn(0x7f840406db30 msgr2=0x7f840406df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:27.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.304+0000 7f840bbb7640 1 -- 172.21.15.123:0/1276889489 shutdown_connections 2024-09-15T23:20:27.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.304+0000 7f840bbb7640 1 -- 172.21.15.123:0/1276889489 wait complete. 2024-09-15T23:20:27.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.305+0000 7f840bbb7640 1 Processor -- start 2024-09-15T23:20:27.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.305+0000 7f840bbb7640 1 -- start start 2024-09-15T23:20:27.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.306+0000 7f840bbb7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84040b53b0 0x7f8404157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:27.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.306+0000 7f840bbb7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8404153550 0x7f84041459c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:27.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.306+0000 7f840bbb7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8404156be0 0x7f840415d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:27.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.306+0000 7f840bbb7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8404070120 con 0x7f84040b53b0 2024-09-15T23:20:27.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.306+0000 7f840bbb7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8404153930 con 0x7f8404153550 2024-09-15T23:20:27.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.306+0000 7f840bbb7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f84040b5df0 con 0x7f8404156be0 2024-09-15T23:20:27.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.306+0000 7f8409953640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84040b53b0 0x7f8404157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:27.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.306+0000 7f8409953640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84040b53b0 0x7f8404157150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41038/0 (socket says 172.21.15.123:41038) 2024-09-15T23:20:27.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.306+0000 7f8409953640 1 -- 172.21.15.123:0/2597734530 learned_addr learned my addr 172.21.15.123:0/2597734530 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:27.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.306+0000 7f840a154640 1 --2- 172.21.15.123:0/2597734530 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8404156be0 0x7f840415d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:27.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.306+0000 7f8409152640 1 --2- 172.21.15.123:0/2597734530 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8404153550 0x7f84041459c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:27.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.306+0000 7f8409953640 1 -- 172.21.15.123:0/2597734530 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8404156be0 msgr2=0x7f840415d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:27.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.306+0000 7f8409953640 1 --2- 172.21.15.123:0/2597734530 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8404156be0 0x7f840415d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:27.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.306+0000 7f8409953640 1 -- 172.21.15.123:0/2597734530 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8404153550 msgr2=0x7f84041459c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:27.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.306+0000 7f8409953640 1 --2- 172.21.15.123:0/2597734530 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8404153550 0x7f84041459c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:27.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.306+0000 7f8409953640 1 -- 172.21.15.123:0/2597734530 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8404155b40 con 0x7f84040b53b0 2024-09-15T23:20:27.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.306+0000 7f840a154640 1 --2- 172.21.15.123:0/2597734530 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8404156be0 0x7f840415d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:27.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.306+0000 7f8409152640 1 --2- 172.21.15.123:0/2597734530 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8404153550 0x7f84041459c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:27.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.306+0000 7f8409953640 1 --2- 172.21.15.123:0/2597734530 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84040b53b0 0x7f8404157150 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f840000c820 tx=0x7f840000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:27.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.306+0000 7f83fa7fc640 1 -- 172.21.15.123:0/2597734530 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8400015070 con 0x7f84040b53b0 2024-09-15T23:20:27.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.306+0000 7f83fa7fc640 1 -- 172.21.15.123:0/2597734530 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8400004020 con 0x7f84040b53b0 2024-09-15T23:20:27.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.306+0000 7f840bbb7640 1 -- 172.21.15.123:0/2597734530 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8404155e20 con 0x7f84040b53b0 2024-09-15T23:20:27.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.306+0000 7f83fa7fc640 1 -- 172.21.15.123:0/2597734530 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84000043f0 con 0x7f84040b53b0 2024-09-15T23:20:27.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.306+0000 7f840bbb7640 1 -- 172.21.15.123:0/2597734530 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84041563e0 con 0x7f84040b53b0 2024-09-15T23:20:27.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.307+0000 7f840bbb7640 1 -- 172.21.15.123:0/2597734530 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84040b6120 con 0x7f84040b53b0 2024-09-15T23:20:27.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.308+0000 7f83fa7fc640 1 -- 172.21.15.123:0/2597734530 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f84000077d0 con 0x7f84040b53b0 2024-09-15T23:20:27.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.308+0000 7f83fa7fc640 1 --2- 172.21.15.123:0/2597734530 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f83e806c2b0 0x7f83e806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:27.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.308+0000 7f83fa7fc640 1 -- 172.21.15.123:0/2597734530 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5227+0+0 (secure 0 0 0) 0x7f840008aff0 con 0x7f84040b53b0 2024-09-15T23:20:27.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.309+0000 7f8409152640 1 --2- 172.21.15.123:0/2597734530 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f83e806c2b0 0x7f83e806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:27.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.309+0000 7f8409152640 1 --2- 172.21.15.123:0/2597734530 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f83e806c2b0 0x7f83e806e770 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f83f4034000 tx=0x7f83f402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:27.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.313+0000 7f83fa7fc640 1 -- 172.21.15.123:0/2597734530 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8400059940 con 0x7f84040b53b0 2024-09-15T23:20:27.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:27.477+0000 7f840bbb7640 1 -- 172.21.15.123:0/2597734530 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f840415f4c0 con 0x7f84040b53b0 2024-09-15T23:20:28.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.183+0000 7f83fa7fc640 1 -- 172.21.15.123:0/2597734530 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v152) ==== 170+0+0 (secure 0 0 0) 0x7f8400059240 con 0x7f84040b53b0 2024-09-15T23:20:28.184 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' created 2024-09-15T23:20:28.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.188+0000 7f840bbb7640 1 -- 172.21.15.123:0/2597734530 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f83e806c2b0 msgr2=0x7f83e806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:28.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.188+0000 7f840bbb7640 1 --2- 172.21.15.123:0/2597734530 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f83e806c2b0 0x7f83e806e770 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f83f4034000 tx=0x7f83f402e000 comp rx=0 tx=0).stop 2024-09-15T23:20:28.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.188+0000 7f840bbb7640 1 -- 172.21.15.123:0/2597734530 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84040b53b0 msgr2=0x7f8404157150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:28.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.188+0000 7f840bbb7640 1 --2- 172.21.15.123:0/2597734530 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84040b53b0 0x7f8404157150 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f840000c820 tx=0x7f840000cce0 comp rx=0 tx=0).stop 2024-09-15T23:20:28.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.189+0000 7f840bbb7640 1 -- 172.21.15.123:0/2597734530 shutdown_connections 2024-09-15T23:20:28.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.189+0000 7f840bbb7640 1 --2- 172.21.15.123:0/2597734530 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8404156be0 0x7f840415d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:28.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.189+0000 7f840bbb7640 1 --2- 172.21.15.123:0/2597734530 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8404153550 0x7f84041459c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:28.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.189+0000 7f840bbb7640 1 --2- 172.21.15.123:0/2597734530 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f83e806c2b0 0x7f83e806e770 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:28.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.189+0000 7f840bbb7640 1 --2- 172.21.15.123:0/2597734530 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84040b53b0 0x7f8404157150 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:28.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.189+0000 7f840bbb7640 1 -- 172.21.15.123:0/2597734530 >> 172.21.15.123:0/2597734530 conn(0x7f840406db30 msgr2=0x7f840415fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:28.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.190+0000 7f840bbb7640 1 -- 172.21.15.123:0/2597734530 shutdown_connections 2024-09-15T23:20:28.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.190+0000 7f840bbb7640 1 -- 172.21.15.123:0/2597734530 wait complete. 2024-09-15T23:20:28.214 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T23:20:28.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.320+0000 7f3961cd7640 1 Processor -- start 2024-09-15T23:20:28.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.320+0000 7f3961cd7640 1 -- start start 2024-09-15T23:20:28.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.320+0000 7f3961cd7640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f395c06bfd0 0x7f395c06c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:28.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.321+0000 7f3961cd7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f395c0d3930 0x7f395c162ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:28.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.321+0000 7f3961cd7640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f395c06c8f0 con 0x7f395c0b3350 2024-09-15T23:20:28.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.321+0000 7f3961cd7640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f395c0b78a0 con 0x7f395c06bfd0 2024-09-15T23:20:28.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.321+0000 7f3961cd7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f395c0cffb0 con 0x7f395c0d3930 2024-09-15T23:20:28.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.321+0000 7f395bfff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f395c0d3930 0x7f395c162ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:28.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.321+0000 7f395b7fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f395c06bfd0 0x7f395c06c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:28.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.321+0000 7f395bfff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f395c0d3930 0x7f395c162ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:51194/0 (socket says 172.21.15.123:51194) 2024-09-15T23:20:28.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.321+0000 7f395b7fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f395c06bfd0 0x7f395c06c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:39746/0 (socket says 172.21.15.123:39746) 2024-09-15T23:20:28.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.321+0000 7f395bfff640 1 -- 172.21.15.123:0/881200051 learned_addr learned my addr 172.21.15.123:0/881200051 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:28.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.321+0000 7f395bfff640 1 -- 172.21.15.123:0/881200051 >> v2:172.21.15.188:3300/0 conn(0x7f395c06bfd0 msgr2=0x7f395c06c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:28.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.321+0000 7f395bfff640 1 --2- 172.21.15.123:0/881200051 >> v2:172.21.15.188:3300/0 conn(0x7f395c06bfd0 0x7f395c06c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:28.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.321+0000 7f395bfff640 1 -- 172.21.15.123:0/881200051 >> v1:172.21.15.188:6789/0 conn(0x7f395c0b3350 legacy=0x7f395c1623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:28.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.321+0000 7f395bfff640 1 -- 172.21.15.123:0/881200051 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f395c0cf710 con 0x7f395c0d3930 2024-09-15T23:20:28.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.321+0000 7f395b7fe640 1 --2- 172.21.15.123:0/881200051 >> v2:172.21.15.188:3300/0 conn(0x7f395c06bfd0 0x7f395c06c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:20:28.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.322+0000 7f395bfff640 1 --2- 172.21.15.123:0/881200051 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f395c0d3930 0x7f395c162ab0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3954009e50 tx=0x7f395402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34fd08854c8180be server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:28.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.322+0000 7f395a7fc640 1 -- 172.21.15.123:0/881200051 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3954036070 con 0x7f395c0d3930 2024-09-15T23:20:28.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.322+0000 7f395a7fc640 1 -- 172.21.15.123:0/881200051 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3954031600 con 0x7f395c0d3930 2024-09-15T23:20:28.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.322+0000 7f395a7fc640 1 -- 172.21.15.123:0/881200051 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39540319d0 con 0x7f395c0d3930 2024-09-15T23:20:28.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.323+0000 7f3961cd7640 1 -- 172.21.15.123:0/881200051 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f395c0d3930 msgr2=0x7f395c162ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:28.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.323+0000 7f3961cd7640 1 --2- 172.21.15.123:0/881200051 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f395c0d3930 0x7f395c162ab0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3954009e50 tx=0x7f395402a710 comp rx=0 tx=0).stop 2024-09-15T23:20:28.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.323+0000 7f3961cd7640 1 -- 172.21.15.123:0/881200051 shutdown_connections 2024-09-15T23:20:28.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.323+0000 7f3961cd7640 1 --2- 172.21.15.123:0/881200051 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f395c0d3930 0x7f395c162ab0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:28.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.323+0000 7f3961cd7640 1 --2- 172.21.15.123:0/881200051 >> v2:172.21.15.188:3300/0 conn(0x7f395c06bfd0 0x7f395c06c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:28.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.323+0000 7f3961cd7640 1 -- 172.21.15.123:0/881200051 >> 172.21.15.123:0/881200051 conn(0x7f395c0d11c0 msgr2=0x7f395c0d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:28.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.323+0000 7f3961cd7640 1 -- 172.21.15.123:0/881200051 shutdown_connections 2024-09-15T23:20:28.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.323+0000 7f3961cd7640 1 -- 172.21.15.123:0/881200051 wait complete. 2024-09-15T23:20:28.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.324+0000 7f3961cd7640 1 Processor -- start 2024-09-15T23:20:28.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.324+0000 7f3961cd7640 1 -- start start 2024-09-15T23:20:28.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.325+0000 7f3961cd7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f395c06bfd0 0x7f395c147430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:28.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.325+0000 7f3961cd7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f395c0b3350 0x7f395c157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:28.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.325+0000 7f3961cd7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f395c0d3930 0x7f395c0cab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:28.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.325+0000 7f3961cd7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f395c0d2400 con 0x7f395c0b3350 2024-09-15T23:20:28.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.325+0000 7f3961cd7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f395c0cfcd0 con 0x7f395c0d3930 2024-09-15T23:20:28.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.325+0000 7f3961cd7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f395c06cd50 con 0x7f395c06bfd0 2024-09-15T23:20:28.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.325+0000 7f395affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f395c0b3350 0x7f395c157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:28.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.325+0000 7f395affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f395c0b3350 0x7f395c157130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41040/0 (socket says 172.21.15.123:41040) 2024-09-15T23:20:28.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.325+0000 7f395affd640 1 -- 172.21.15.123:0/1928615323 learned_addr learned my addr 172.21.15.123:0/1928615323 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:28.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.325+0000 7f395b7fe640 1 --2- 172.21.15.123:0/1928615323 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f395c06bfd0 0x7f395c147430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:28.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.325+0000 7f395bfff640 1 --2- 172.21.15.123:0/1928615323 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f395c0d3930 0x7f395c0cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:28.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.325+0000 7f395affd640 1 -- 172.21.15.123:0/1928615323 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f395c06bfd0 msgr2=0x7f395c147430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:28.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.325+0000 7f395affd640 1 --2- 172.21.15.123:0/1928615323 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f395c06bfd0 0x7f395c147430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:28.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.325+0000 7f395affd640 1 -- 172.21.15.123:0/1928615323 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f395c0d3930 msgr2=0x7f395c0cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:28.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.325+0000 7f395affd640 1 --2- 172.21.15.123:0/1928615323 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f395c0d3930 0x7f395c0cab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:28.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.325+0000 7f395affd640 1 -- 172.21.15.123:0/1928615323 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f395c14a270 con 0x7f395c0b3350 2024-09-15T23:20:28.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.325+0000 7f395bfff640 1 --2- 172.21.15.123:0/1928615323 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f395c0d3930 0x7f395c0cab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:20:28.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.325+0000 7f395affd640 1 --2- 172.21.15.123:0/1928615323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f395c0b3350 0x7f395c157130 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f395000c430 tx=0x7f395000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:28.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.325+0000 7f3943fff640 1 -- 172.21.15.123:0/1928615323 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39500052d0 con 0x7f395c0b3350 2024-09-15T23:20:28.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.326+0000 7f3943fff640 1 -- 172.21.15.123:0/1928615323 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3950005490 con 0x7f395c0b3350 2024-09-15T23:20:28.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.326+0000 7f3943fff640 1 -- 172.21.15.123:0/1928615323 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3950007260 con 0x7f395c0b3350 2024-09-15T23:20:28.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.326+0000 7f3961cd7640 1 -- 172.21.15.123:0/1928615323 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f395c15ff90 con 0x7f395c0b3350 2024-09-15T23:20:28.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.326+0000 7f3961cd7640 1 -- 172.21.15.123:0/1928615323 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f395c160550 con 0x7f395c0b3350 2024-09-15T23:20:28.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.326+0000 7f3961cd7640 1 -- 172.21.15.123:0/1928615323 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f395c15eae0 con 0x7f395c0b3350 2024-09-15T23:20:28.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.327+0000 7f3943fff640 1 -- 172.21.15.123:0/1928615323 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3950007400 con 0x7f395c0b3350 2024-09-15T23:20:28.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.327+0000 7f3943fff640 1 --2- 172.21.15.123:0/1928615323 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f394806c2b0 0x7f394806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:28.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.327+0000 7f3943fff640 1 -- 172.21.15.123:0/1928615323 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5609+0+0 (secure 0 0 0) 0x7f395008a8f0 con 0x7f395c0b3350 2024-09-15T23:20:28.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.328+0000 7f395b7fe640 1 --2- 172.21.15.123:0/1928615323 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f394806c2b0 0x7f394806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:28.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.328+0000 7f395b7fe640 1 --2- 172.21.15.123:0/1928615323 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f394806c2b0 0x7f394806e770 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f394c009560 tx=0x7f394c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:28.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.332+0000 7f3943fff640 1 -- 172.21.15.123:0/1928615323 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f39500590c0 con 0x7f395c0b3350 2024-09-15T23:20:28.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:28.531+0000 7f3961cd7640 1 -- 172.21.15.123:0/1928615323 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f395c0ba3d0 con 0x7f395c0b3350 2024-09-15T23:20:29.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.185+0000 7f3943fff640 1 -- 172.21.15.123:0/1928615323 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v90) ==== 174+0+0 (secure 0 0 0) 0x7f39500589c0 con 0x7f395c0b3350 2024-09-15T23:20:29.186 INFO:teuthology.orchestra.run.smithi123.stderr:new fs with metadata pool 20 and data pool 21 2024-09-15T23:20:29.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.198+0000 7f3961cd7640 1 -- 172.21.15.123:0/1928615323 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f394806c2b0 msgr2=0x7f394806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:29.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.198+0000 7f3961cd7640 1 --2- 172.21.15.123:0/1928615323 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f394806c2b0 0x7f394806e770 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f394c009560 tx=0x7f394c008040 comp rx=0 tx=0).stop 2024-09-15T23:20:29.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.198+0000 7f3961cd7640 1 -- 172.21.15.123:0/1928615323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f395c0b3350 msgr2=0x7f395c157130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:29.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.198+0000 7f3961cd7640 1 --2- 172.21.15.123:0/1928615323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f395c0b3350 0x7f395c157130 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f395000c430 tx=0x7f395000c8f0 comp rx=0 tx=0).stop 2024-09-15T23:20:29.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.198+0000 7f3961cd7640 1 -- 172.21.15.123:0/1928615323 shutdown_connections 2024-09-15T23:20:29.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.198+0000 7f3961cd7640 1 --2- 172.21.15.123:0/1928615323 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f395c0d3930 0x7f395c0cab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:29.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.198+0000 7f3961cd7640 1 --2- 172.21.15.123:0/1928615323 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f394806c2b0 0x7f394806e770 secure :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f394c009560 tx=0x7f394c008040 comp rx=0 tx=0).stop 2024-09-15T23:20:29.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.198+0000 7f3961cd7640 1 --2- 172.21.15.123:0/1928615323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f395c0b3350 0x7f395c157130 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:29.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.199+0000 7f3961cd7640 1 --2- 172.21.15.123:0/1928615323 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f395c06bfd0 0x7f395c147430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:29.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.199+0000 7f3961cd7640 1 -- 172.21.15.123:0/1928615323 >> 172.21.15.123:0/1928615323 conn(0x7f395c0d11c0 msgr2=0x7f395c0b7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:29.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.204+0000 7f3961cd7640 1 -- 172.21.15.123:0/1928615323 shutdown_connections 2024-09-15T23:20:29.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.205+0000 7f3961cd7640 1 -- 172.21.15.123:0/1928615323 wait complete. 2024-09-15T23:20:29.222 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:20:29.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.320+0000 7fc24d3d6640 1 Processor -- start 2024-09-15T23:20:29.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.320+0000 7fc24d3d6640 1 -- start start 2024-09-15T23:20:29.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.321+0000 7fc24d3d6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2480d0200 0x7fc2480d0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:29.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.321+0000 7fc24d3d6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc2480d1620 0x7fc2480d1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:29.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.321+0000 7fc24d3d6640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc248073400 con 0x7fc24815c4f0 2024-09-15T23:20:29.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.321+0000 7fc24d3d6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fc2480d0b80 con 0x7fc2480d1620 2024-09-15T23:20:29.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.321+0000 7fc24d3d6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc2480736e0 con 0x7fc2480d0200 2024-09-15T23:20:29.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.321+0000 7fc2477fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc2480d1620 0x7fc2480d1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:29.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.321+0000 7fc2467fc640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2480d0200 0x7fc2480d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:29.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.321+0000 7fc2477fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc2480d1620 0x7fc2480d1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:39758/0 (socket says 172.21.15.123:39758) 2024-09-15T23:20:29.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.321+0000 7fc2477fe640 1 -- 172.21.15.123:0/2406405293 learned_addr learned my addr 172.21.15.123:0/2406405293 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:29.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.321+0000 7fc246ffd640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fc24815c4f0 0x7fc24815d4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:41692/0 (socket says 172.21.15.123:41692) 2024-09-15T23:20:29.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.322+0000 7fc2467fc640 1 -- 172.21.15.123:0/2406405293 >> v2:172.21.15.188:3300/0 conn(0x7fc2480d1620 msgr2=0x7fc2480d1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:29.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.322+0000 7fc2467fc640 1 --2- 172.21.15.123:0/2406405293 >> v2:172.21.15.188:3300/0 conn(0x7fc2480d1620 0x7fc2480d1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:29.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.322+0000 7fc2467fc640 1 -- 172.21.15.123:0/2406405293 >> v1:172.21.15.188:6789/0 conn(0x7fc24815c4f0 legacy=0x7fc24815d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:29.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.322+0000 7fc2467fc640 1 -- 172.21.15.123:0/2406405293 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2480739c0 con 0x7fc2480d0200 2024-09-15T23:20:29.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.322+0000 7fc245ffb640 1 -- 172.21.15.123:0/2406405293 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3012879050 0 0) 0x7fc248073400 con 0x7fc24815c4f0 2024-09-15T23:20:29.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.322+0000 7fc2477fe640 1 --2- 172.21.15.123:0/2406405293 >> v2:172.21.15.188:3300/0 conn(0x7fc2480d1620 0x7fc2480d1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:20:29.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.322+0000 7fc2467fc640 1 --2- 172.21.15.123:0/2406405293 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2480d0200 0x7fc2480d0640 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc23c0097a0 tx=0x7fc23c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3dd38c9b2048e14 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:29.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.323+0000 7fc245ffb640 1 -- 172.21.15.123:0/2406405293 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23c037070 con 0x7fc2480d0200 2024-09-15T23:20:29.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.323+0000 7fc245ffb640 1 -- 172.21.15.123:0/2406405293 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc23c032440 con 0x7fc2480d0200 2024-09-15T23:20:29.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.323+0000 7fc245ffb640 1 -- 172.21.15.123:0/2406405293 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23c032810 con 0x7fc2480d0200 2024-09-15T23:20:29.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.323+0000 7fc24d3d6640 1 -- 172.21.15.123:0/2406405293 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2480d0200 msgr2=0x7fc2480d0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:29.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.323+0000 7fc24d3d6640 1 --2- 172.21.15.123:0/2406405293 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2480d0200 0x7fc2480d0640 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc23c0097a0 tx=0x7fc23c02a180 comp rx=0 tx=0).stop 2024-09-15T23:20:29.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.323+0000 7fc24d3d6640 1 -- 172.21.15.123:0/2406405293 shutdown_connections 2024-09-15T23:20:29.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.323+0000 7fc24d3d6640 1 --2- 172.21.15.123:0/2406405293 >> v2:172.21.15.188:3300/0 conn(0x7fc2480d1620 0x7fc2480d1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:29.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.323+0000 7fc24d3d6640 1 --2- 172.21.15.123:0/2406405293 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2480d0200 0x7fc2480d0640 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:29.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.323+0000 7fc24d3d6640 1 -- 172.21.15.123:0/2406405293 >> 172.21.15.123:0/2406405293 conn(0x7fc24806f400 msgr2=0x7fc24806f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:29.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.323+0000 7fc24d3d6640 1 -- 172.21.15.123:0/2406405293 shutdown_connections 2024-09-15T23:20:29.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.323+0000 7fc24d3d6640 1 -- 172.21.15.123:0/2406405293 wait complete. 2024-09-15T23:20:29.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.324+0000 7fc24d3d6640 1 Processor -- start 2024-09-15T23:20:29.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.325+0000 7fc24d3d6640 1 -- start start 2024-09-15T23:20:29.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.325+0000 7fc24d3d6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2480d0200 0x7fc2480af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:29.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.325+0000 7fc24d3d6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2480d1620 0x7fc248157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:29.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.325+0000 7fc24d3d6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc24815c4f0 0x7fc2480affd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:29.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.325+0000 7fc24d3d6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc2480d0fa0 con 0x7fc2480d1620 2024-09-15T23:20:29.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.325+0000 7fc24d3d6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc248073f80 con 0x7fc24815c4f0 2024-09-15T23:20:29.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.325+0000 7fc24d3d6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc24815c8d0 con 0x7fc2480d0200 2024-09-15T23:20:29.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.325+0000 7fc2467fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2480d1620 0x7fc248157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:29.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.325+0000 7fc2467fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2480d1620 0x7fc248157c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41044/0 (socket says 172.21.15.123:41044) 2024-09-15T23:20:29.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.325+0000 7fc2467fc640 1 -- 172.21.15.123:0/3563562681 learned_addr learned my addr 172.21.15.123:0/3563562681 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:29.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.326+0000 7fc2477fe640 1 --2- 172.21.15.123:0/3563562681 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc24815c4f0 0x7fc2480affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:29.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.326+0000 7fc246ffd640 1 --2- 172.21.15.123:0/3563562681 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2480d0200 0x7fc2480af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:29.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.326+0000 7fc2467fc640 1 -- 172.21.15.123:0/3563562681 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2480d0200 msgr2=0x7fc2480af6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:29.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.326+0000 7fc2467fc640 1 --2- 172.21.15.123:0/3563562681 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2480d0200 0x7fc2480af6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:29.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.326+0000 7fc2467fc640 1 -- 172.21.15.123:0/3563562681 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc24815c4f0 msgr2=0x7fc2480affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:29.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.326+0000 7fc2467fc640 1 --2- 172.21.15.123:0/3563562681 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc24815c4f0 0x7fc2480affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:29.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.326+0000 7fc2467fc640 1 -- 172.21.15.123:0/3563562681 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2480b0510 con 0x7fc2480d1620 2024-09-15T23:20:29.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.326+0000 7fc2467fc640 1 --2- 172.21.15.123:0/3563562681 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2480d1620 0x7fc248157c20 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7fc23c0097a0 tx=0x7fc23c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:29.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.326+0000 7fc22f7fe640 1 -- 172.21.15.123:0/3563562681 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23c037050 con 0x7fc2480d1620 2024-09-15T23:20:29.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.326+0000 7fc22f7fe640 1 -- 172.21.15.123:0/3563562681 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc23c038040 con 0x7fc2480d1620 2024-09-15T23:20:29.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.326+0000 7fc24d3d6640 1 -- 172.21.15.123:0/3563562681 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2480b07b0 con 0x7fc2480d1620 2024-09-15T23:20:29.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.326+0000 7fc22f7fe640 1 -- 172.21.15.123:0/3563562681 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23c004490 con 0x7fc2480d1620 2024-09-15T23:20:29.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.326+0000 7fc24d3d6640 1 -- 172.21.15.123:0/3563562681 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc24806d130 con 0x7fc2480d1620 2024-09-15T23:20:29.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.327+0000 7fc24d3d6640 1 -- 172.21.15.123:0/3563562681 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc248073080 con 0x7fc2480d1620 2024-09-15T23:20:29.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.328+0000 7fc22f7fe640 1 -- 172.21.15.123:0/3563562681 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc23c03c6d0 con 0x7fc2480d1620 2024-09-15T23:20:29.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.328+0000 7fc22f7fe640 1 --2- 172.21.15.123:0/3563562681 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc23406c2e0 0x7fc23406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:29.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.328+0000 7fc22f7fe640 1 -- 172.21.15.123:0/3563562681 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7fc23c0abc70 con 0x7fc2480d1620 2024-09-15T23:20:29.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.328+0000 7fc246ffd640 1 --2- 172.21.15.123:0/3563562681 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc23406c2e0 0x7fc23406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:29.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.329+0000 7fc246ffd640 1 --2- 172.21.15.123:0/3563562681 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc23406c2e0 0x7fc23406e7a0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc238000f60 tx=0x7fc238007d50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:29.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.332+0000 7fc22f7fe640 1 -- 172.21.15.123:0/3563562681 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc23c079da0 con 0x7fc2480d1620 2024-09-15T23:20:29.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.500+0000 7fc24d3d6640 1 -- 172.21.15.123:0/3563562681 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc2480cfad0 con 0x7fc2480d1620 2024-09-15T23:20:29.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.502+0000 7fc22f7fe640 1 -- 172.21.15.123:0/3563562681 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) ==== 74+0+16776 (secure 0 0 0) 0x7fc23c07e0a0 con 0x7fc2480d1620 2024-09-15T23:20:29.503 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:29.503 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":153,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:20:28.532326+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:20:26.877919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-15T23:20:27.496332+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:20:29.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.504+0000 7fc24d3d6640 1 -- 172.21.15.123:0/3563562681 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc23406c2e0 msgr2=0x7fc23406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:29.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.504+0000 7fc24d3d6640 1 --2- 172.21.15.123:0/3563562681 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc23406c2e0 0x7fc23406e7a0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc238000f60 tx=0x7fc238007d50 comp rx=0 tx=0).stop 2024-09-15T23:20:29.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.504+0000 7fc24d3d6640 1 -- 172.21.15.123:0/3563562681 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2480d1620 msgr2=0x7fc248157c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:29.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.504+0000 7fc24d3d6640 1 --2- 172.21.15.123:0/3563562681 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2480d1620 0x7fc248157c20 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7fc23c0097a0 tx=0x7fc23c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:20:29.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.504+0000 7fc24d3d6640 1 -- 172.21.15.123:0/3563562681 shutdown_connections 2024-09-15T23:20:29.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.504+0000 7fc24d3d6640 1 --2- 172.21.15.123:0/3563562681 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc24815c4f0 0x7fc2480affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:29.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.504+0000 7fc24d3d6640 1 --2- 172.21.15.123:0/3563562681 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc23406c2e0 0x7fc23406e7a0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:29.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.504+0000 7fc24d3d6640 1 --2- 172.21.15.123:0/3563562681 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2480d1620 0x7fc248157c20 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:29.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.504+0000 7fc24d3d6640 1 --2- 172.21.15.123:0/3563562681 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc2480d0200 0x7fc2480af6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:29.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.504+0000 7fc24d3d6640 1 -- 172.21.15.123:0/3563562681 >> 172.21.15.123:0/3563562681 conn(0x7fc24806f400 msgr2=0x7fc2480d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:29.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.504+0000 7fc24d3d6640 1 -- 172.21.15.123:0/3563562681 shutdown_connections 2024-09-15T23:20:29.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.504+0000 7fc24d3d6640 1 -- 172.21.15.123:0/3563562681 wait complete. 2024-09-15T23:20:29.516 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:20:29.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.613+0000 7f6063d86640 1 Processor -- start 2024-09-15T23:20:29.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.613+0000 7f6063d86640 1 -- start start 2024-09-15T23:20:29.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.614+0000 7f6063d86640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f605c145ed0 0x7f605c0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:29.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.614+0000 7f6063d86640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f605c0b4020 con 0x7f605c0b5f90 2024-09-15T23:20:29.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.614+0000 7f6063d86640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f605c0b42c0 con 0x7f605c073180 2024-09-15T23:20:29.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.614+0000 7f6063d86640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f605c0b45a0 con 0x7f605c145ed0 2024-09-15T23:20:29.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.614+0000 7f6062323640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f605c0b5f90 0x7f605c15cdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:48972/0 (socket says 172.21.15.123:48972) 2024-09-15T23:20:29.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.614+0000 7f6062323640 1 -- 172.21.15.123:0/876366521 learned_addr learned my addr 172.21.15.123:0/876366521 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:29.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.614+0000 7f6060b20640 1 -- 172.21.15.123:0/876366521 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1304152647 0 0) 0x7f605c0b4020 con 0x7f605c0b5f90 2024-09-15T23:20:29.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.614+0000 7f6060b20640 1 -- 172.21.15.123:0/876366521 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6048003520 con 0x7f605c0b5f90 2024-09-15T23:20:29.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.615+0000 7f6061b22640 1 --2- 172.21.15.123:0/876366521 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f605c145ed0 0x7f605c0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:29.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.615+0000 7f6060b20640 1 -- 172.21.15.123:0/876366521 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2546056345 0 0) 0x7f6048003520 con 0x7f605c0b5f90 2024-09-15T23:20:29.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.615+0000 7f6060b20640 1 -- 172.21.15.123:0/876366521 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f605c145ed0 msgr2=0x7f605c0b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:29.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.615+0000 7f6060b20640 1 --2- 172.21.15.123:0/876366521 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f605c145ed0 0x7f605c0b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:29.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.615+0000 7f6060b20640 1 -- 172.21.15.123:0/876366521 >> v1:172.21.15.188:6789/0 conn(0x7f605c073180 legacy=0x7f605c0b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:29.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.615+0000 7f6060b20640 1 -- 172.21.15.123:0/876366521 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f605c0b4880 con 0x7f605c0b5f90 2024-09-15T23:20:29.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.615+0000 7f6060b20640 1 -- 172.21.15.123:0/876366521 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f60540019f0 con 0x7f605c0b5f90 2024-09-15T23:20:29.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.615+0000 7f6060b20640 1 -- 172.21.15.123:0/876366521 >> v1:172.21.15.123:6789/0 conn(0x7f605c0b5f90 legacy=0x7f605c15cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:29.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.615+0000 7f6060b20640 1 --2- 172.21.15.123:0/876366521 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f60480039e0 0x7f6048003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:29.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.615+0000 7f6060b20640 1 --2- 172.21.15.123:0/876366521 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f605c145ed0 0x7f6048004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:29.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.615+0000 7f6060b20640 1 --2- 172.21.15.123:0/876366521 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6048004d40 0x7f60480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:29.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.615+0000 7f6060b20640 1 -- 172.21.15.123:0/876366521 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f605c0b45a0 con 0x7f6048004d40 2024-09-15T23:20:29.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.615+0000 7f6060b20640 1 -- 172.21.15.123:0/876366521 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f604800bb50 con 0x7f60480039e0 2024-09-15T23:20:29.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.615+0000 7f6060b20640 1 -- 172.21.15.123:0/876366521 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f604800bd20 con 0x7f605c145ed0 2024-09-15T23:20:29.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.615+0000 7f6062323640 1 --2- 172.21.15.123:0/876366521 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6048004d40 0x7f60480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:29.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.615+0000 7f6061321640 1 --2- 172.21.15.123:0/876366521 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f605c145ed0 0x7f6048004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:29.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.615+0000 7f6061b22640 1 --2- 172.21.15.123:0/876366521 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f60480039e0 0x7f6048003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:29.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.615+0000 7f6062323640 1 -- 172.21.15.123:0/876366521 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f605c145ed0 msgr2=0x7f6048004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:29.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.615+0000 7f6062323640 1 --2- 172.21.15.123:0/876366521 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f605c145ed0 0x7f6048004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:29.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.615+0000 7f6062323640 1 -- 172.21.15.123:0/876366521 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f60480039e0 msgr2=0x7f6048003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:29.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.615+0000 7f6062323640 1 --2- 172.21.15.123:0/876366521 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f60480039e0 0x7f6048003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:29.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.615+0000 7f6062323640 1 -- 172.21.15.123:0/876366521 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6048003520 con 0x7f6048004d40 2024-09-15T23:20:29.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.615+0000 7f6061b22640 1 --2- 172.21.15.123:0/876366521 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f60480039e0 0x7f6048003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:29.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.616+0000 7f6062323640 1 --2- 172.21.15.123:0/876366521 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6048004d40 0x7f60480051c0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f605400a870 tx=0x7f6048005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a11868f60ec9ff6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:29.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.616+0000 7f6060b20640 1 -- 172.21.15.123:0/876366521 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605400a460 con 0x7f6048004d40 2024-09-15T23:20:29.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.616+0000 7f6060b20640 1 -- 172.21.15.123:0/876366521 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f605402f070 con 0x7f6048004d40 2024-09-15T23:20:29.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.616+0000 7f6060b20640 1 -- 172.21.15.123:0/876366521 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605402bca0 con 0x7f6048004d40 2024-09-15T23:20:29.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.616+0000 7f6063d86640 1 -- 172.21.15.123:0/876366521 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6048004d40 msgr2=0x7f60480051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:29.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.616+0000 7f6063d86640 1 --2- 172.21.15.123:0/876366521 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6048004d40 0x7f60480051c0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f605400a870 tx=0x7f6048005830 comp rx=0 tx=0).stop 2024-09-15T23:20:29.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.616+0000 7f6062323640 1 -- 172.21.15.123:0/876366521 reap_dead start 2024-09-15T23:20:29.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.617+0000 7f6063d86640 1 -- 172.21.15.123:0/876366521 shutdown_connections 2024-09-15T23:20:29.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.617+0000 7f6063d86640 1 -- 172.21.15.123:0/876366521 >> 172.21.15.123:0/876366521 conn(0x7f605c0ccec0 msgr2=0x7f605c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:29.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.617+0000 7f6063d86640 1 -- 172.21.15.123:0/876366521 shutdown_connections 2024-09-15T23:20:29.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.617+0000 7f6063d86640 1 -- 172.21.15.123:0/876366521 wait complete. 2024-09-15T23:20:29.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.618+0000 7f6063d86640 1 Processor -- start 2024-09-15T23:20:29.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.618+0000 7f6063d86640 1 -- start start 2024-09-15T23:20:29.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.618+0000 7f6063d86640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6048004d40 0x7f605c1517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:29.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.618+0000 7f6063d86640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f605c1532a0 0x7f605c1520b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:29.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.619+0000 7f6063d86640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f605c0b1b70 0x7f605c0b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:29.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.619+0000 7f6063d86640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f605c146430 con 0x7f6048004d40 2024-09-15T23:20:29.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.619+0000 7f6063d86640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f605c1462b0 con 0x7f605c1532a0 2024-09-15T23:20:29.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.619+0000 7f6063d86640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f605c0b5080 con 0x7f605c0b1b70 2024-09-15T23:20:29.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.619+0000 7f6061b22640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6048004d40 0x7f605c1517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:29.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.619+0000 7f6061b22640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6048004d40 0x7f605c1517f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41050/0 (socket says 172.21.15.123:41050) 2024-09-15T23:20:29.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.619+0000 7f6061b22640 1 -- 172.21.15.123:0/321020479 learned_addr learned my addr 172.21.15.123:0/321020479 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:29.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.619+0000 7f6061321640 1 --2- 172.21.15.123:0/321020479 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f605c1532a0 0x7f605c1520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:29.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.619+0000 7f6062323640 1 --2- 172.21.15.123:0/321020479 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f605c0b1b70 0x7f605c0b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:29.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.619+0000 7f6061b22640 1 -- 172.21.15.123:0/321020479 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f605c0b1b70 msgr2=0x7f605c0b1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:29.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.619+0000 7f6061b22640 1 --2- 172.21.15.123:0/321020479 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f605c0b1b70 0x7f605c0b1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:29.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.619+0000 7f6061b22640 1 -- 172.21.15.123:0/321020479 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f605c1532a0 msgr2=0x7f605c1520b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:29.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.619+0000 7f6061b22640 1 --2- 172.21.15.123:0/321020479 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f605c1532a0 0x7f605c1520b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:29.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.619+0000 7f6061b22640 1 -- 172.21.15.123:0/321020479 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f605c153a80 con 0x7f6048004d40 2024-09-15T23:20:29.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.619+0000 7f6062323640 1 --2- 172.21.15.123:0/321020479 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f605c0b1b70 0x7f605c0b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:29.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.619+0000 7f6061b22640 1 --2- 172.21.15.123:0/321020479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6048004d40 0x7f605c1517f0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f6058006f00 tx=0x7f605800f970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:29.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.619+0000 7f60527fc640 1 -- 172.21.15.123:0/321020479 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6058018020 con 0x7f6048004d40 2024-09-15T23:20:29.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.619+0000 7f60527fc640 1 -- 172.21.15.123:0/321020479 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6058014870 con 0x7f6048004d40 2024-09-15T23:20:29.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.619+0000 7f6063d86640 1 -- 172.21.15.123:0/321020479 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f605c153d60 con 0x7f6048004d40 2024-09-15T23:20:29.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.619+0000 7f60527fc640 1 -- 172.21.15.123:0/321020479 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6058014c20 con 0x7f6048004d40 2024-09-15T23:20:29.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.619+0000 7f6063d86640 1 -- 172.21.15.123:0/321020479 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f605c154320 con 0x7f6048004d40 2024-09-15T23:20:29.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.620+0000 7f6063d86640 1 -- 172.21.15.123:0/321020479 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f605c0735c0 con 0x7f6048004d40 2024-09-15T23:20:29.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.621+0000 7f60527fc640 1 -- 172.21.15.123:0/321020479 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f605801b020 con 0x7f6048004d40 2024-09-15T23:20:29.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.621+0000 7f60527fc640 1 --2- 172.21.15.123:0/321020479 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f604006c2e0 0x7f604006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:29.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.621+0000 7f60527fc640 1 -- 172.21.15.123:0/321020479 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7f605808b810 con 0x7f6048004d40 2024-09-15T23:20:29.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.621+0000 7f6061321640 1 --2- 172.21.15.123:0/321020479 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f604006c2e0 0x7f604006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:29.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.622+0000 7f6061321640 1 --2- 172.21.15.123:0/321020479 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f604006c2e0 0x7f604006e7a0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f605c0cb6c0 tx=0x7f604c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:29.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.625+0000 7f60527fc640 1 -- 172.21.15.123:0/321020479 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6058022020 con 0x7f6048004d40 2024-09-15T23:20:29.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.792+0000 7f6063d86640 1 -- 172.21.15.123:0/321020479 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f605c0cd600 con 0x7f6048004d40 2024-09-15T23:20:29.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.793+0000 7f60527fc640 1 -- 172.21.15.123:0/321020479 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) ==== 74+0+16776 (secure 0 0 0) 0x7f6058059f80 con 0x7f6048004d40 2024-09-15T23:20:29.794 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:29.794 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":153,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:20:28.532326+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:20:26.877919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-15T23:20:27.496332+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:20:29.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.795+0000 7f6063d86640 1 -- 172.21.15.123:0/321020479 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f604006c2e0 msgr2=0x7f604006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:29.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.795+0000 7f6063d86640 1 --2- 172.21.15.123:0/321020479 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f604006c2e0 0x7f604006e7a0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f605c0cb6c0 tx=0x7f604c009040 comp rx=0 tx=0).stop 2024-09-15T23:20:29.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.795+0000 7f6063d86640 1 -- 172.21.15.123:0/321020479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6048004d40 msgr2=0x7f605c1517f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:29.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.795+0000 7f6063d86640 1 --2- 172.21.15.123:0/321020479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6048004d40 0x7f605c1517f0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f6058006f00 tx=0x7f605800f970 comp rx=0 tx=0).stop 2024-09-15T23:20:29.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.795+0000 7f6063d86640 1 -- 172.21.15.123:0/321020479 shutdown_connections 2024-09-15T23:20:29.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.795+0000 7f6063d86640 1 --2- 172.21.15.123:0/321020479 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f605c0b1b70 0x7f605c0b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:29.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.795+0000 7f6063d86640 1 --2- 172.21.15.123:0/321020479 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f605c1532a0 0x7f605c1520b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:29.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.795+0000 7f6063d86640 1 --2- 172.21.15.123:0/321020479 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f604006c2e0 0x7f604006e7a0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:29.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.795+0000 7f6063d86640 1 --2- 172.21.15.123:0/321020479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6048004d40 0x7f605c1517f0 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:29.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.795+0000 7f6063d86640 1 -- 172.21.15.123:0/321020479 >> 172.21.15.123:0/321020479 conn(0x7f605c0ccec0 msgr2=0x7f605c0b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:29.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.795+0000 7f6063d86640 1 -- 172.21.15.123:0/321020479 shutdown_connections 2024-09-15T23:20:29.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.795+0000 7f6063d86640 1 -- 172.21.15.123:0/321020479 wait complete. 2024-09-15T23:20:29.808 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T23:20:29.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.909+0000 7f95cd45e640 1 Processor -- start 2024-09-15T23:20:29.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.909+0000 7f95cd45e640 1 -- start start 2024-09-15T23:20:29.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.910+0000 7f95cd45e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f95c815e990 0x7f95c815ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:29.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.910+0000 7f95cd45e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95c815f2b0 con 0x7f95c80b5520 2024-09-15T23:20:29.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.910+0000 7f95cd45e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95c815f550 con 0x7f95c8162a00 2024-09-15T23:20:29.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.910+0000 7f95cd45e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f95c815f830 con 0x7f95c815e990 2024-09-15T23:20:29.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.910+0000 7f95c6ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f95c815e990 0x7f95c815ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:29.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.910+0000 7f95c6ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f95c815e990 0x7f95c815ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41058/0 (socket says 172.21.15.123:41058) 2024-09-15T23:20:29.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.910+0000 7f95c6ffd640 1 -- 172.21.15.123:0/134470590 learned_addr learned my addr 172.21.15.123:0/134470590 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:29.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.910+0000 7f95c67fc640 1 --1- 172.21.15.123:0/134470590 >> v1:172.21.15.123:6789/0 conn(0x7f95c80b5520 0x7f95c806cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:48980/0 (socket says 172.21.15.123:48980) 2024-09-15T23:20:29.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.910+0000 7f95c6ffd640 1 -- 172.21.15.123:0/134470590 >> v1:172.21.15.188:6789/0 conn(0x7f95c8162a00 legacy=0x7f95c80b6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:29.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.910+0000 7f95c6ffd640 1 -- 172.21.15.123:0/134470590 >> v1:172.21.15.123:6789/0 conn(0x7f95c80b5520 legacy=0x7f95c806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:29.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.910+0000 7f95c5ffb640 1 -- 172.21.15.123:0/134470590 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3840900573 0 0) 0x7f95c815f2b0 con 0x7f95c80b5520 2024-09-15T23:20:29.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.910+0000 7f95c6ffd640 1 -- 172.21.15.123:0/134470590 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95c815fb10 con 0x7f95c815e990 2024-09-15T23:20:29.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.911+0000 7f95c6ffd640 1 --2- 172.21.15.123:0/134470590 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95c815e990 0x7f95c815ed70 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f95b8009870 tx=0x7f95b802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2441831581048d34 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:29.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.911+0000 7f95c5ffb640 1 -- 172.21.15.123:0/134470590 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b8037070 con 0x7f95c815e990 2024-09-15T23:20:29.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.911+0000 7f95c5ffb640 1 -- 172.21.15.123:0/134470590 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95b8032440 con 0x7f95c815e990 2024-09-15T23:20:29.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.911+0000 7f95c5ffb640 1 -- 172.21.15.123:0/134470590 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b8032810 con 0x7f95c815e990 2024-09-15T23:20:29.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.912+0000 7f95cd45e640 1 -- 172.21.15.123:0/134470590 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95c815e990 msgr2=0x7f95c815ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:29.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.912+0000 7f95cd45e640 1 --2- 172.21.15.123:0/134470590 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95c815e990 0x7f95c815ed70 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f95b8009870 tx=0x7f95b802a2a0 comp rx=0 tx=0).stop 2024-09-15T23:20:29.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.912+0000 7f95cd45e640 1 -- 172.21.15.123:0/134470590 shutdown_connections 2024-09-15T23:20:29.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.912+0000 7f95cd45e640 1 --2- 172.21.15.123:0/134470590 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95c815e990 0x7f95c815ed70 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:29.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.912+0000 7f95cd45e640 1 -- 172.21.15.123:0/134470590 >> 172.21.15.123:0/134470590 conn(0x7f95c80d25d0 msgr2=0x7f95c80d29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:29.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.912+0000 7f95cd45e640 1 -- 172.21.15.123:0/134470590 shutdown_connections 2024-09-15T23:20:29.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.912+0000 7f95cd45e640 1 -- 172.21.15.123:0/134470590 wait complete. 2024-09-15T23:20:29.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.913+0000 7f95cd45e640 1 Processor -- start 2024-09-15T23:20:29.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.913+0000 7f95cd45e640 1 -- start start 2024-09-15T23:20:29.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.914+0000 7f95cd45e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95c80b5520 0x7f95c8159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:29.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.914+0000 7f95cd45e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95c815e990 0x7f95c8146bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:29.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.914+0000 7f95cd45e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f95c8162a00 0x7f95c8149e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:29.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.914+0000 7f95cd45e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f95c806d430 con 0x7f95c80b5520 2024-09-15T23:20:29.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.914+0000 7f95cd45e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f95c80b7700 con 0x7f95c815e990 2024-09-15T23:20:29.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.914+0000 7f95cd45e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f95c815baf0 con 0x7f95c8162a00 2024-09-15T23:20:29.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.914+0000 7f95c6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95c80b5520 0x7f95c8159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:29.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.914+0000 7f95c6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95c80b5520 0x7f95c8159cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41062/0 (socket says 172.21.15.123:41062) 2024-09-15T23:20:29.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.914+0000 7f95c6ffd640 1 -- 172.21.15.123:0/4233754510 learned_addr learned my addr 172.21.15.123:0/4233754510 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:29.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.914+0000 7f95c6ffd640 1 -- 172.21.15.123:0/4233754510 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f95c8162a00 msgr2=0x7f95c8149e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:29.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.914+0000 7f95c6ffd640 1 --2- 172.21.15.123:0/4233754510 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f95c8162a00 0x7f95c8149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:29.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.914+0000 7f95c6ffd640 1 -- 172.21.15.123:0/4233754510 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95c815e990 msgr2=0x7f95c8146bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:29.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.914+0000 7f95c6ffd640 1 --2- 172.21.15.123:0/4233754510 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95c815e990 0x7f95c8146bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:29.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.914+0000 7f95c6ffd640 1 -- 172.21.15.123:0/4233754510 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95c815a650 con 0x7f95c80b5520 2024-09-15T23:20:29.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.915+0000 7f95c6ffd640 1 --2- 172.21.15.123:0/4233754510 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95c80b5520 0x7f95c8159cb0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f95b8000c00 tx=0x7f95b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:29.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.915+0000 7f95af7fe640 1 -- 172.21.15.123:0/4233754510 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b8041070 con 0x7f95c80b5520 2024-09-15T23:20:29.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.915+0000 7f95af7fe640 1 -- 172.21.15.123:0/4233754510 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95b803c870 con 0x7f95c80b5520 2024-09-15T23:20:29.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.915+0000 7f95cd45e640 1 -- 172.21.15.123:0/4233754510 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95c815a370 con 0x7f95c80b5520 2024-09-15T23:20:29.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.915+0000 7f95af7fe640 1 -- 172.21.15.123:0/4233754510 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b8037040 con 0x7f95c80b5520 2024-09-15T23:20:29.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.915+0000 7f95cd45e640 1 -- 172.21.15.123:0/4233754510 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95c81476e0 con 0x7f95c80b5520 2024-09-15T23:20:29.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.916+0000 7f95cd45e640 1 -- 172.21.15.123:0/4233754510 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95c8162e70 con 0x7f95c80b5520 2024-09-15T23:20:29.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.916+0000 7f95af7fe640 1 -- 172.21.15.123:0/4233754510 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f95b8044070 con 0x7f95c80b5520 2024-09-15T23:20:29.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.917+0000 7f95af7fe640 1 --2- 172.21.15.123:0/4233754510 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f95b406c2b0 0x7f95b406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:29.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.917+0000 7f95af7fe640 1 -- 172.21.15.123:0/4233754510 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7f95b80ac140 con 0x7f95c80b5520 2024-09-15T23:20:29.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.917+0000 7f95c67fc640 1 --2- 172.21.15.123:0/4233754510 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f95b406c2b0 0x7f95b406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:29.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.918+0000 7f95c67fc640 1 --2- 172.21.15.123:0/4233754510 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f95b406c2b0 0x7f95b406e770 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f95bc007fd0 tx=0x7f95bc007920 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:29.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:29.921+0000 7f95af7fe640 1 -- 172.21.15.123:0/4233754510 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f95b807a9d0 con 0x7f95c80b5520 2024-09-15T23:20:30.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.123+0000 7f95cd45e640 1 -- 172.21.15.123:0/4233754510 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f95c80b2ff0 con 0x7f95c80b5520 2024-09-15T23:20:30.181 INFO:tasks.ceph.mds.c.smithi123.stderr:2024-09-15T23:20:30.180+0000 7f864ae01640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:20:30.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.300+0000 7f95af7fe640 1 -- 172.21.15.123:0/4233754510 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v92) ==== 118+0+0 (secure 0 0 0) 0x7f95b807a2d0 con 0x7f95c80b5520 2024-09-15T23:20:30.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.302+0000 7f95cd45e640 1 -- 172.21.15.123:0/4233754510 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f95b406c2b0 msgr2=0x7f95b406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:30.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.302+0000 7f95cd45e640 1 --2- 172.21.15.123:0/4233754510 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f95b406c2b0 0x7f95b406e770 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f95bc007fd0 tx=0x7f95bc007920 comp rx=0 tx=0).stop 2024-09-15T23:20:30.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.302+0000 7f95cd45e640 1 -- 172.21.15.123:0/4233754510 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95c80b5520 msgr2=0x7f95c8159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:30.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.302+0000 7f95cd45e640 1 --2- 172.21.15.123:0/4233754510 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95c80b5520 0x7f95c8159cb0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f95b8000c00 tx=0x7f95b80046c0 comp rx=0 tx=0).stop 2024-09-15T23:20:30.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.302+0000 7f95cd45e640 1 -- 172.21.15.123:0/4233754510 shutdown_connections 2024-09-15T23:20:30.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.302+0000 7f95cd45e640 1 --2- 172.21.15.123:0/4233754510 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f95c8162a00 0x7f95c8149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:30.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.302+0000 7f95cd45e640 1 --2- 172.21.15.123:0/4233754510 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95c815e990 0x7f95c8146bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:30.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.302+0000 7f95cd45e640 1 --2- 172.21.15.123:0/4233754510 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f95b406c2b0 0x7f95b406e770 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:30.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.302+0000 7f95cd45e640 1 --2- 172.21.15.123:0/4233754510 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95c80b5520 0x7f95c8159cb0 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:30.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.302+0000 7f95cd45e640 1 -- 172.21.15.123:0/4233754510 >> 172.21.15.123:0/4233754510 conn(0x7f95c80d25d0 msgr2=0x7f95c815fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:30.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.302+0000 7f95cd45e640 1 -- 172.21.15.123:0/4233754510 shutdown_connections 2024-09-15T23:20:30.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.302+0000 7f95cd45e640 1 -- 172.21.15.123:0/4233754510 wait complete. 2024-09-15T23:20:30.314 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T23:20:30.315 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T23:20:30.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.416+0000 7f0847b0a640 1 Processor -- start 2024-09-15T23:20:30.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.416+0000 7f0847b0a640 1 -- start start 2024-09-15T23:20:30.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.417+0000 7f0847b0a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f084015e990 0x7f084015ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:30.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.417+0000 7f0847b0a640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f08400b5520 0x7f084006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:30.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.417+0000 7f0847b0a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f084006d260 0x7f0840162a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:30.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.417+0000 7f0847b0a640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f084015f2b0 con 0x7f084006d260 2024-09-15T23:20:30.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.417+0000 7f0847b0a640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f084015f550 con 0x7f08400b5520 2024-09-15T23:20:30.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.417+0000 7f0847b0a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f084015f830 con 0x7f084015e990 2024-09-15T23:20:30.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.417+0000 7f08460a7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f084006d260 0x7f0840162a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:30.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.417+0000 7f08460a7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f084006d260 0x7f0840162a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41076/0 (socket says 172.21.15.123:41076) 2024-09-15T23:20:30.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.417+0000 7f08460a7640 1 -- 172.21.15.123:0/758803247 learned_addr learned my addr 172.21.15.123:0/758803247 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:30.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.417+0000 7f08460a7640 1 -- 172.21.15.123:0/758803247 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f084015e990 msgr2=0x7f084015ed70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:20:30.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.417+0000 7f08460a7640 1 --2- 172.21.15.123:0/758803247 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f084015e990 0x7f084015ed70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:30.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.417+0000 7f08460a7640 1 -- 172.21.15.123:0/758803247 >> v2:172.21.15.188:3300/0 conn(0x7f08400b5520 msgr2=0x7f084006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:30.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.417+0000 7f08460a7640 1 --2- 172.21.15.123:0/758803247 >> v2:172.21.15.188:3300/0 conn(0x7f08400b5520 0x7f084006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:30.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.417+0000 7f08460a7640 1 -- 172.21.15.123:0/758803247 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f084015fb10 con 0x7f084006d260 2024-09-15T23:20:30.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.418+0000 7f08460a7640 1 --2- 172.21.15.123:0/758803247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f084006d260 0x7f0840162a00 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f08400b51b0 tx=0x7f083802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e295bba61e51ea8a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:30.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.418+0000 7f08448a4640 1 -- 172.21.15.123:0/758803247 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0838036070 con 0x7f084006d260 2024-09-15T23:20:30.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.418+0000 7f08448a4640 1 -- 172.21.15.123:0/758803247 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0838031600 con 0x7f084006d260 2024-09-15T23:20:30.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.418+0000 7f08448a4640 1 -- 172.21.15.123:0/758803247 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08380319d0 con 0x7f084006d260 2024-09-15T23:20:30.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.418+0000 7f0847b0a640 1 -- 172.21.15.123:0/758803247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f084006d260 msgr2=0x7f0840162a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:30.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.418+0000 7f0847b0a640 1 --2- 172.21.15.123:0/758803247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f084006d260 0x7f0840162a00 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f08400b51b0 tx=0x7f083802a6c0 comp rx=0 tx=0).stop 2024-09-15T23:20:30.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.418+0000 7f0847b0a640 1 -- 172.21.15.123:0/758803247 shutdown_connections 2024-09-15T23:20:30.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.418+0000 7f0847b0a640 1 --2- 172.21.15.123:0/758803247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f084006d260 0x7f0840162a00 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:30.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.418+0000 7f0847b0a640 1 --2- 172.21.15.123:0/758803247 >> v2:172.21.15.188:3300/0 conn(0x7f08400b5520 0x7f084006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:30.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.418+0000 7f0847b0a640 1 --2- 172.21.15.123:0/758803247 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f084015e990 0x7f084015ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:30.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.418+0000 7f0847b0a640 1 -- 172.21.15.123:0/758803247 >> 172.21.15.123:0/758803247 conn(0x7f08400d25d0 msgr2=0x7f08400d29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:30.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.419+0000 7f0847b0a640 1 -- 172.21.15.123:0/758803247 shutdown_connections 2024-09-15T23:20:30.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.419+0000 7f0847b0a640 1 -- 172.21.15.123:0/758803247 wait complete. 2024-09-15T23:20:30.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.420+0000 7f0847b0a640 1 Processor -- start 2024-09-15T23:20:30.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.420+0000 7f0847b0a640 1 -- start start 2024-09-15T23:20:30.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.420+0000 7f0847b0a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f084006d260 0x7f084014d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:30.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.420+0000 7f0847b0a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08400b5520 0x7f084015bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:30.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.420+0000 7f0847b0a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f084015e990 0x7f084015db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:30.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.420+0000 7f0847b0a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f08401630c0 con 0x7f08400b5520 2024-09-15T23:20:30.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.420+0000 7f0847b0a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0840162f40 con 0x7f084015e990 2024-09-15T23:20:30.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.420+0000 7f0847b0a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0840163240 con 0x7f084006d260 2024-09-15T23:20:30.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.421+0000 7f08450a5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08400b5520 0x7f084015bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:30.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.421+0000 7f08450a5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08400b5520 0x7f084015bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41084/0 (socket says 172.21.15.123:41084) 2024-09-15T23:20:30.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.421+0000 7f08450a5640 1 -- 172.21.15.123:0/378960123 learned_addr learned my addr 172.21.15.123:0/378960123 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:30.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.421+0000 7f08458a6640 1 --2- 172.21.15.123:0/378960123 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f084006d260 0x7f084014d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:30.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.421+0000 7f08450a5640 1 -- 172.21.15.123:0/378960123 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f084006d260 msgr2=0x7f084014d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:30.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.421+0000 7f08450a5640 1 --2- 172.21.15.123:0/378960123 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f084006d260 0x7f084014d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:30.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.421+0000 7f08450a5640 1 -- 172.21.15.123:0/378960123 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f084015e990 msgr2=0x7f084015db10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T23:20:30.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.421+0000 7f08450a5640 1 --2- 172.21.15.123:0/378960123 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f084015e990 0x7f084015db10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:30.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.421+0000 7f08450a5640 1 -- 172.21.15.123:0/378960123 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08401f5350 con 0x7f08400b5520 2024-09-15T23:20:30.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.421+0000 7f08458a6640 1 --2- 172.21.15.123:0/378960123 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f084006d260 0x7f084014d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:20:30.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.421+0000 7f08450a5640 1 --2- 172.21.15.123:0/378960123 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08400b5520 0x7f084015bf80 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f083000b450 tx=0x7f083000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:30.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.421+0000 7f08367fc640 1 -- 172.21.15.123:0/378960123 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0830015020 con 0x7f08400b5520 2024-09-15T23:20:30.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.421+0000 7f08367fc640 1 -- 172.21.15.123:0/378960123 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0830011830 con 0x7f08400b5520 2024-09-15T23:20:30.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.421+0000 7f0847b0a640 1 -- 172.21.15.123:0/378960123 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f084015c4c0 con 0x7f08400b5520 2024-09-15T23:20:30.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.421+0000 7f08367fc640 1 -- 172.21.15.123:0/378960123 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0830011c20 con 0x7f08400b5520 2024-09-15T23:20:30.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.421+0000 7f0847b0a640 1 -- 172.21.15.123:0/378960123 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08401f4a20 con 0x7f08400b5520 2024-09-15T23:20:30.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.422+0000 7f0847b0a640 1 -- 172.21.15.123:0/378960123 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f084006cd20 con 0x7f08400b5520 2024-09-15T23:20:30.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.423+0000 7f08367fc640 1 -- 172.21.15.123:0/378960123 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0830018020 con 0x7f08400b5520 2024-09-15T23:20:30.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.423+0000 7f08367fc640 1 --2- 172.21.15.123:0/378960123 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f082406c2b0 0x7f082406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:30.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.423+0000 7f08367fc640 1 -- 172.21.15.123:0/378960123 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f083008b3b0 con 0x7f08400b5520 2024-09-15T23:20:30.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.425+0000 7f08458a6640 1 --2- 172.21.15.123:0/378960123 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f082406c2b0 0x7f082406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:30.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.427+0000 7f08458a6640 1 --2- 172.21.15.123:0/378960123 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f082406c2b0 0x7f082406e770 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f08400d36f0 tx=0x7f083c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:30.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.428+0000 7f08367fc640 1 -- 172.21.15.123:0/378960123 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f083001f020 con 0x7f08400b5520 2024-09-15T23:20:30.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:30.629+0000 7f0847b0a640 1 -- 172.21.15.123:0/378960123 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f08400b1ac0 con 0x7f08400b5520 2024-09-15T23:20:31.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.303+0000 7f08367fc640 1 -- 172.21.15.123:0/378960123 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v93) ==== 122+0+0 (secure 0 0 0) 0x7f08300172c0 con 0x7f08400b5520 2024-09-15T23:20:31.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.306+0000 7f0847b0a640 1 -- 172.21.15.123:0/378960123 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f082406c2b0 msgr2=0x7f082406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:31.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.306+0000 7f0847b0a640 1 --2- 172.21.15.123:0/378960123 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f082406c2b0 0x7f082406e770 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f08400d36f0 tx=0x7f083c008040 comp rx=0 tx=0).stop 2024-09-15T23:20:31.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.306+0000 7f0847b0a640 1 -- 172.21.15.123:0/378960123 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08400b5520 msgr2=0x7f084015bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:31.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.306+0000 7f0847b0a640 1 --2- 172.21.15.123:0/378960123 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08400b5520 0x7f084015bf80 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f083000b450 tx=0x7f083000b910 comp rx=0 tx=0).stop 2024-09-15T23:20:31.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.306+0000 7f0847b0a640 1 -- 172.21.15.123:0/378960123 shutdown_connections 2024-09-15T23:20:31.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.306+0000 7f0847b0a640 1 --2- 172.21.15.123:0/378960123 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f084015e990 0x7f084015db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:31.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.306+0000 7f0847b0a640 1 --2- 172.21.15.123:0/378960123 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f082406c2b0 0x7f082406e770 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:31.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.306+0000 7f0847b0a640 1 --2- 172.21.15.123:0/378960123 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08400b5520 0x7f084015bf80 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:31.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.306+0000 7f0847b0a640 1 --2- 172.21.15.123:0/378960123 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f084006d260 0x7f084014d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:31.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.306+0000 7f0847b0a640 1 -- 172.21.15.123:0/378960123 >> 172.21.15.123:0/378960123 conn(0x7f08400d25d0 msgr2=0x7f0840160b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:31.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.306+0000 7f0847b0a640 1 -- 172.21.15.123:0/378960123 shutdown_connections 2024-09-15T23:20:31.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.306+0000 7f0847b0a640 1 -- 172.21.15.123:0/378960123 wait complete. 2024-09-15T23:20:31.320 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T23:20:31.320 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:20:31.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.421+0000 7f1ebda27640 1 Processor -- start 2024-09-15T23:20:31.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.421+0000 7f1ebda27640 1 -- start start 2024-09-15T23:20:31.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.422+0000 7f1ebda27640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1eb80b6970 0x7f1eb80b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:31.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.422+0000 7f1ebda27640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1eb80d23b0 0x7f1eb80b8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:31.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.422+0000 7f1ebda27640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1eb80d0e70 con 0x7f1eb815ed20 2024-09-15T23:20:31.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.422+0000 7f1ebda27640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f1eb80d41c0 con 0x7f1eb80d23b0 2024-09-15T23:20:31.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.422+0000 7f1ebda27640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1eb80d35b0 con 0x7f1eb80b6970 2024-09-15T23:20:31.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.422+0000 7f1eb77fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1eb80d23b0 0x7f1eb80b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:31.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.422+0000 7f1eb6ffd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1eb815ed20 0x7f1eb80b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:48982/0 (socket says 172.21.15.123:48982) 2024-09-15T23:20:31.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.422+0000 7f1eb77fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1eb80d23b0 0x7f1eb80b8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41100/0 (socket says 172.21.15.123:41100) 2024-09-15T23:20:31.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.422+0000 7f1eb6ffd640 1 -- 172.21.15.123:0/2141021371 learned_addr learned my addr 172.21.15.123:0/2141021371 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:31.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.422+0000 7f1eb77fe640 1 -- 172.21.15.123:0/2141021371 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1eb80b6970 msgr2=0x7f1eb80b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:31.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.422+0000 7f1eb77fe640 1 --2- 172.21.15.123:0/2141021371 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1eb80b6970 0x7f1eb80b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:31.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.422+0000 7f1eb77fe640 1 -- 172.21.15.123:0/2141021371 >> v1:172.21.15.123:6789/0 conn(0x7f1eb815ed20 legacy=0x7f1eb80b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:31.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.422+0000 7f1eb5ffb640 1 -- 172.21.15.123:0/2141021371 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 625404875 0 0) 0x7f1ea8001110 con 0x7f1eb815ed20 2024-09-15T23:20:31.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.422+0000 7f1eb77fe640 1 -- 172.21.15.123:0/2141021371 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eb80d3890 con 0x7f1eb80d23b0 2024-09-15T23:20:31.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.423+0000 7f1eb77fe640 1 --2- 172.21.15.123:0/2141021371 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1eb80d23b0 0x7f1eb80b8610 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0009d90 tx=0x7f1eb002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bda639186146da4e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:31.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.423+0000 7f1eb5ffb640 1 -- 172.21.15.123:0/2141021371 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb0031600 con 0x7f1eb80d23b0 2024-09-15T23:20:31.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.423+0000 7f1eb5ffb640 1 -- 172.21.15.123:0/2141021371 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1eb00317a0 con 0x7f1eb80d23b0 2024-09-15T23:20:31.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.423+0000 7f1eb5ffb640 1 -- 172.21.15.123:0/2141021371 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb0031b70 con 0x7f1eb80d23b0 2024-09-15T23:20:31.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.424+0000 7f1ebda27640 1 -- 172.21.15.123:0/2141021371 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1eb80d23b0 msgr2=0x7f1eb80b8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:31.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.424+0000 7f1ebda27640 1 --2- 172.21.15.123:0/2141021371 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1eb80d23b0 0x7f1eb80b8610 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0009d90 tx=0x7f1eb002a5d0 comp rx=0 tx=0).stop 2024-09-15T23:20:31.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.424+0000 7f1ebda27640 1 -- 172.21.15.123:0/2141021371 shutdown_connections 2024-09-15T23:20:31.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.424+0000 7f1ebda27640 1 --2- 172.21.15.123:0/2141021371 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1eb80d23b0 0x7f1eb80b8610 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:31.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.424+0000 7f1ebda27640 1 --2- 172.21.15.123:0/2141021371 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1eb80b6970 0x7f1eb80b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:31.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.424+0000 7f1ebda27640 1 -- 172.21.15.123:0/2141021371 >> 172.21.15.123:0/2141021371 conn(0x7f1eb80d1260 msgr2=0x7f1eb80d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:31.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.424+0000 7f1ebda27640 1 -- 172.21.15.123:0/2141021371 shutdown_connections 2024-09-15T23:20:31.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.424+0000 7f1ebda27640 1 -- 172.21.15.123:0/2141021371 wait complete. 2024-09-15T23:20:31.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.425+0000 7f1ebda27640 1 Processor -- start 2024-09-15T23:20:31.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.425+0000 7f1ebda27640 1 -- start start 2024-09-15T23:20:31.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.426+0000 7f1ebda27640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1eb80b6970 0x7f1eb8154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:31.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.426+0000 7f1ebda27640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1eb80d23b0 0x7f1eb80ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:31.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.426+0000 7f1ebda27640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1eb815ed20 0x7f1eb80c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:31.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.426+0000 7f1ebda27640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb80d32a0 con 0x7f1eb80d23b0 2024-09-15T23:20:31.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.426+0000 7f1ebda27640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb80d3e50 con 0x7f1eb80b6970 2024-09-15T23:20:31.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.426+0000 7f1ebda27640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1eb815f100 con 0x7f1eb815ed20 2024-09-15T23:20:31.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.426+0000 7f1eb67fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1eb80d23b0 0x7f1eb80ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:31.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.426+0000 7f1eb67fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1eb80d23b0 0x7f1eb80ce1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41102/0 (socket says 172.21.15.123:41102) 2024-09-15T23:20:31.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.426+0000 7f1eb67fc640 1 -- 172.21.15.123:0/2850301012 learned_addr learned my addr 172.21.15.123:0/2850301012 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:31.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.426+0000 7f1eb67fc640 1 -- 172.21.15.123:0/2850301012 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1eb815ed20 msgr2=0x7f1eb80c92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:31.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.426+0000 7f1eb67fc640 1 --2- 172.21.15.123:0/2850301012 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1eb815ed20 0x7f1eb80c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:31.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.426+0000 7f1eb67fc640 1 -- 172.21.15.123:0/2850301012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1eb80b6970 msgr2=0x7f1eb8154230 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T23:20:31.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.426+0000 7f1eb67fc640 1 --2- 172.21.15.123:0/2850301012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1eb80b6970 0x7f1eb8154230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:31.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.426+0000 7f1eb67fc640 1 -- 172.21.15.123:0/2850301012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eb80cd100 con 0x7f1eb80d23b0 2024-09-15T23:20:31.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.426+0000 7f1eb67fc640 1 --2- 172.21.15.123:0/2850301012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1eb80d23b0 0x7f1eb80ce1a0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00b480 tx=0x7f1eac00b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:31.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.427+0000 7f1e9ffff640 1 -- 172.21.15.123:0/2850301012 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eac014070 con 0x7f1eb80d23b0 2024-09-15T23:20:31.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.427+0000 7f1e9ffff640 1 -- 172.21.15.123:0/2850301012 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1eac010870 con 0x7f1eb80d23b0 2024-09-15T23:20:31.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.427+0000 7f1e9ffff640 1 -- 172.21.15.123:0/2850301012 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eac010c60 con 0x7f1eb80d23b0 2024-09-15T23:20:31.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.427+0000 7f1ebda27640 1 -- 172.21.15.123:0/2850301012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1eb80cd3e0 con 0x7f1eb80d23b0 2024-09-15T23:20:31.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.427+0000 7f1ebda27640 1 -- 172.21.15.123:0/2850301012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1eb80cd9a0 con 0x7f1eb80d23b0 2024-09-15T23:20:31.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.428+0000 7f1ebda27640 1 -- 172.21.15.123:0/2850301012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1eb80b7010 con 0x7f1eb80d23b0 2024-09-15T23:20:31.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.428+0000 7f1e9ffff640 1 -- 172.21.15.123:0/2850301012 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1eac017070 con 0x7f1eb80d23b0 2024-09-15T23:20:31.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.428+0000 7f1e9ffff640 1 --2- 172.21.15.123:0/2850301012 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1ea406c2b0 0x7f1ea406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:31.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.429+0000 7f1e9ffff640 1 -- 172.21.15.123:0/2850301012 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f1eac08b2d0 con 0x7f1eb80d23b0 2024-09-15T23:20:31.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.429+0000 7f1eb6ffd640 1 --2- 172.21.15.123:0/2850301012 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1ea406c2b0 0x7f1ea406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:31.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.429+0000 7f1eb6ffd640 1 --2- 172.21.15.123:0/2850301012 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1ea406c2b0 0x7f1ea406e770 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8007fd0 tx=0x7f1ea8007960 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:31.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.433+0000 7f1e9ffff640 1 -- 172.21.15.123:0/2850301012 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1eac059ad0 con 0x7f1eb80d23b0 2024-09-15T23:20:31.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.631+0000 7f1ebda27640 1 -- 172.21.15.123:0/2850301012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1eb80b3f20 con 0x7f1eb80d23b0 2024-09-15T23:20:31.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.632+0000 7f1e9ffff640 1 -- 172.21.15.123:0/2850301012 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5236 (secure 0 0 0) 0x7f1eac0593d0 con 0x7f1eb80d23b0 2024-09-15T23:20:31.633 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:31.633 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":93,"btime":"2024-09-15T23:20:31:301251+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7735,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/3725440007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3725440007},{"type":"v1","addr":"172.21.15.188:6836","nonce":3725440007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7738,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2908220643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2908220643},{"type":"v1","addr":"172.21.15.188:6837","nonce":2908220643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":9003,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2302544827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2302544827},{"type":"v1","addr":"172.21.15.123:6834","nonce":2302544827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:20:28.532639+0000","modified":"2024-09-15T23:20:30.630141+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9006":{"gid":9006,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/627322542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":627322542},{"type":"v1","addr":"172.21.15.123:6835","nonce":627322542}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9006,"qdb_cluster":[9006]},"id":10}]} 2024-09-15T23:20:31.634 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 93 2024-09-15T23:20:31.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.634+0000 7f1ebda27640 1 -- 172.21.15.123:0/2850301012 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1ea406c2b0 msgr2=0x7f1ea406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:31.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.634+0000 7f1ebda27640 1 --2- 172.21.15.123:0/2850301012 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1ea406c2b0 0x7f1ea406e770 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8007fd0 tx=0x7f1ea8007960 comp rx=0 tx=0).stop 2024-09-15T23:20:31.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.634+0000 7f1ebda27640 1 -- 172.21.15.123:0/2850301012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1eb80d23b0 msgr2=0x7f1eb80ce1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:31.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.634+0000 7f1ebda27640 1 --2- 172.21.15.123:0/2850301012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1eb80d23b0 0x7f1eb80ce1a0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00b480 tx=0x7f1eac00b940 comp rx=0 tx=0).stop 2024-09-15T23:20:31.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.634+0000 7f1ebda27640 1 -- 172.21.15.123:0/2850301012 shutdown_connections 2024-09-15T23:20:31.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.634+0000 7f1ebda27640 1 --2- 172.21.15.123:0/2850301012 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1eb815ed20 0x7f1eb80c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:31.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.634+0000 7f1ebda27640 1 --2- 172.21.15.123:0/2850301012 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1ea406c2b0 0x7f1ea406e770 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:31.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.634+0000 7f1ebda27640 1 --2- 172.21.15.123:0/2850301012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1eb80d23b0 0x7f1eb80ce1a0 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:31.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.634+0000 7f1ebda27640 1 --2- 172.21.15.123:0/2850301012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1eb80b6970 0x7f1eb8154230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:31.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.634+0000 7f1ebda27640 1 -- 172.21.15.123:0/2850301012 >> 172.21.15.123:0/2850301012 conn(0x7f1eb80d1260 msgr2=0x7f1eb80b9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:31.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.634+0000 7f1ebda27640 1 -- 172.21.15.123:0/2850301012 shutdown_connections 2024-09-15T23:20:31.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.634+0000 7f1ebda27640 1 -- 172.21.15.123:0/2850301012 wait complete. 2024-09-15T23:20:31.646 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:20:31.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.743+0000 7f8a2dd6d640 1 Processor -- start 2024-09-15T23:20:31.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.743+0000 7f8a2dd6d640 1 -- start start 2024-09-15T23:20:31.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.744+0000 7f8a2dd6d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f8a280b2d40 0x7f8a2806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:31.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.744+0000 7f8a2dd6d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8a2806c150 0x7f8a2815c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:31.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.744+0000 7f8a2dd6d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a28071180 con 0x7f8a2813eb20 2024-09-15T23:20:31.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.744+0000 7f8a2dd6d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f8a28071ab0 con 0x7f8a2806c150 2024-09-15T23:20:31.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.744+0000 7f8a2dd6d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f8a28071460 con 0x7f8a280b2d40 2024-09-15T23:20:31.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.744+0000 7f8a27fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8a2806c150 0x7f8a2815c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:31.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.744+0000 7f8a27fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8a2806c150 0x7f8a2815c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41106/0 (socket says 172.21.15.123:41106) 2024-09-15T23:20:31.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.744+0000 7f8a26ffd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8a2813eb20 0x7f8a2815bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:48996/0 (socket says 172.21.15.123:48996) 2024-09-15T23:20:31.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.744+0000 7f8a27fff640 1 -- 172.21.15.123:0/4122185606 learned_addr learned my addr 172.21.15.123:0/4122185606 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:31.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.744+0000 7f8a277fe640 1 --2- 172.21.15.123:0/4122185606 >> v2:172.21.15.188:3300/0 conn(0x7f8a280b2d40 0x7f8a2806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:31.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.745+0000 7f8a27fff640 1 -- 172.21.15.123:0/4122185606 >> v2:172.21.15.188:3300/0 conn(0x7f8a280b2d40 msgr2=0x7f8a2806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:31.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.745+0000 7f8a27fff640 1 --2- 172.21.15.123:0/4122185606 >> v2:172.21.15.188:3300/0 conn(0x7f8a280b2d40 0x7f8a2806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:31.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.745+0000 7f8a27fff640 1 -- 172.21.15.123:0/4122185606 >> v1:172.21.15.123:6789/0 conn(0x7f8a2813eb20 legacy=0x7f8a2815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:31.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.745+0000 7f8a267fc640 1 -- 172.21.15.123:0/4122185606 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2976514473 0 0) 0x7f8a28071180 con 0x7f8a2813eb20 2024-09-15T23:20:31.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.745+0000 7f8a27fff640 1 -- 172.21.15.123:0/4122185606 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a28071740 con 0x7f8a2806c150 2024-09-15T23:20:31.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.745+0000 7f8a277fe640 1 --2- 172.21.15.123:0/4122185606 >> v2:172.21.15.188:3300/0 conn(0x7f8a280b2d40 0x7f8a2806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:20:31.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.745+0000 7f8a27fff640 1 --2- 172.21.15.123:0/4122185606 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a2806c150 0x7f8a2815c400 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f8a28069be0 tx=0x7f8a2002c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b00317d276185c15 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:31.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.745+0000 7f8a267fc640 1 -- 172.21.15.123:0/4122185606 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2000b2e0 con 0x7f8a2806c150 2024-09-15T23:20:31.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.745+0000 7f8a267fc640 1 -- 172.21.15.123:0/4122185606 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a20037070 con 0x7f8a2806c150 2024-09-15T23:20:31.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.745+0000 7f8a267fc640 1 -- 172.21.15.123:0/4122185606 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2000b480 con 0x7f8a2806c150 2024-09-15T23:20:31.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.746+0000 7f8a2dd6d640 1 -- 172.21.15.123:0/4122185606 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a2806c150 msgr2=0x7f8a2815c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:31.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.746+0000 7f8a2dd6d640 1 --2- 172.21.15.123:0/4122185606 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a2806c150 0x7f8a2815c400 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f8a28069be0 tx=0x7f8a2002c940 comp rx=0 tx=0).stop 2024-09-15T23:20:31.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.746+0000 7f8a2dd6d640 1 -- 172.21.15.123:0/4122185606 shutdown_connections 2024-09-15T23:20:31.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.746+0000 7f8a2dd6d640 1 --2- 172.21.15.123:0/4122185606 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a2806c150 0x7f8a2815c400 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:31.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.746+0000 7f8a2dd6d640 1 --2- 172.21.15.123:0/4122185606 >> v2:172.21.15.188:3300/0 conn(0x7f8a280b2d40 0x7f8a2806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:31.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.746+0000 7f8a2dd6d640 1 -- 172.21.15.123:0/4122185606 >> 172.21.15.123:0/4122185606 conn(0x7f8a280ccec0 msgr2=0x7f8a280cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:31.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.746+0000 7f8a2dd6d640 1 -- 172.21.15.123:0/4122185606 shutdown_connections 2024-09-15T23:20:31.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.746+0000 7f8a2dd6d640 1 -- 172.21.15.123:0/4122185606 wait complete. 2024-09-15T23:20:31.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.747+0000 7f8a2dd6d640 1 Processor -- start 2024-09-15T23:20:31.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.747+0000 7f8a2dd6d640 1 -- start start 2024-09-15T23:20:31.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.748+0000 7f8a2dd6d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8a2806c150 0x7f8a2813dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:31.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.748+0000 7f8a2dd6d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a280b2d40 0x7f8a281f0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:31.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.748+0000 7f8a2dd6d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a2813eb20 0x7f8a281f08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:31.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.748+0000 7f8a2dd6d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8a280722d0 con 0x7f8a280b2d40 2024-09-15T23:20:31.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.748+0000 7f8a2dd6d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8a28072150 con 0x7f8a2813eb20 2024-09-15T23:20:31.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.748+0000 7f8a2dd6d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8a28072450 con 0x7f8a2806c150 2024-09-15T23:20:31.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.748+0000 7f8a26ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a280b2d40 0x7f8a281f0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:31.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.748+0000 7f8a26ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a280b2d40 0x7f8a281f0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41116/0 (socket says 172.21.15.123:41116) 2024-09-15T23:20:31.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.748+0000 7f8a26ffd640 1 -- 172.21.15.123:0/1460548815 learned_addr learned my addr 172.21.15.123:0/1460548815 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:31.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.748+0000 7f8a277fe640 1 --2- 172.21.15.123:0/1460548815 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8a2806c150 0x7f8a2813dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:31.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.748+0000 7f8a27fff640 1 --2- 172.21.15.123:0/1460548815 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a2813eb20 0x7f8a281f08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:31.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.748+0000 7f8a26ffd640 1 -- 172.21.15.123:0/1460548815 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8a2806c150 msgr2=0x7f8a2813dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:31.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.748+0000 7f8a26ffd640 1 --2- 172.21.15.123:0/1460548815 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8a2806c150 0x7f8a2813dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:31.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.748+0000 7f8a26ffd640 1 -- 172.21.15.123:0/1460548815 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a2813eb20 msgr2=0x7f8a281f08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:31.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.748+0000 7f8a26ffd640 1 --2- 172.21.15.123:0/1460548815 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a2813eb20 0x7f8a281f08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:31.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.748+0000 7f8a26ffd640 1 -- 172.21.15.123:0/1460548815 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a2815a6e0 con 0x7f8a280b2d40 2024-09-15T23:20:31.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.748+0000 7f8a277fe640 1 --2- 172.21.15.123:0/1460548815 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8a2806c150 0x7f8a2813dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:20:31.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.749+0000 7f8a26ffd640 1 --2- 172.21.15.123:0/1460548815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a280b2d40 0x7f8a281f0360 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00c3c0 tx=0x7f8a1c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:31.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.749+0000 7f8a0ffff640 1 -- 172.21.15.123:0/1460548815 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c0074e0 con 0x7f8a280b2d40 2024-09-15T23:20:31.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.749+0000 7f8a0ffff640 1 -- 172.21.15.123:0/1460548815 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a1c0047e0 con 0x7f8a280b2d40 2024-09-15T23:20:31.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.749+0000 7f8a0ffff640 1 -- 172.21.15.123:0/1460548815 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c004bd0 con 0x7f8a280b2d40 2024-09-15T23:20:31.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.749+0000 7f8a2dd6d640 1 -- 172.21.15.123:0/1460548815 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a2815a980 con 0x7f8a280b2d40 2024-09-15T23:20:31.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.749+0000 7f8a2dd6d640 1 -- 172.21.15.123:0/1460548815 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a2815af40 con 0x7f8a280b2d40 2024-09-15T23:20:31.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.750+0000 7f8a2dd6d640 1 -- 172.21.15.123:0/1460548815 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a2806bc10 con 0x7f8a280b2d40 2024-09-15T23:20:31.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.750+0000 7f8a0ffff640 1 -- 172.21.15.123:0/1460548815 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8a1c011070 con 0x7f8a280b2d40 2024-09-15T23:20:31.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.750+0000 7f8a0ffff640 1 --2- 172.21.15.123:0/1460548815 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8a1406c2b0 0x7f8a1406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:31.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.751+0000 7f8a0ffff640 1 -- 172.21.15.123:0/1460548815 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f8a1c08b030 con 0x7f8a280b2d40 2024-09-15T23:20:31.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.751+0000 7f8a277fe640 1 --2- 172.21.15.123:0/1460548815 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8a1406c2b0 0x7f8a1406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:31.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.751+0000 7f8a277fe640 1 --2- 172.21.15.123:0/1460548815 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8a1406c2b0 0x7f8a1406e770 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f8a18006fd0 tx=0x7f8a18008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:31.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.755+0000 7f8a0ffff640 1 -- 172.21.15.123:0/1460548815 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8a1c00e280 con 0x7f8a280b2d40 2024-09-15T23:20:31.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.920+0000 7f8a2dd6d640 1 -- 172.21.15.123:0/1460548815 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8a28140530 con 0x7f8a280b2d40 2024-09-15T23:20:31.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.921+0000 7f8a0ffff640 1 -- 172.21.15.123:0/1460548815 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) ==== 74+0+16763 (secure 0 0 0) 0x7f8a1c0597a0 con 0x7f8a280b2d40 2024-09-15T23:20:31.922 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:31.923 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":154,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:20:30.193262+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:20:26.877919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-15T23:20:27.496332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:20:31.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.923+0000 7f8a2dd6d640 1 -- 172.21.15.123:0/1460548815 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8a1406c2b0 msgr2=0x7f8a1406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:31.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.923+0000 7f8a2dd6d640 1 --2- 172.21.15.123:0/1460548815 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8a1406c2b0 0x7f8a1406e770 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f8a18006fd0 tx=0x7f8a18008040 comp rx=0 tx=0).stop 2024-09-15T23:20:31.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.923+0000 7f8a2dd6d640 1 -- 172.21.15.123:0/1460548815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a280b2d40 msgr2=0x7f8a281f0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:31.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.923+0000 7f8a2dd6d640 1 --2- 172.21.15.123:0/1460548815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a280b2d40 0x7f8a281f0360 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c00c3c0 tx=0x7f8a1c00c880 comp rx=0 tx=0).stop 2024-09-15T23:20:31.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.923+0000 7f8a2dd6d640 1 -- 172.21.15.123:0/1460548815 shutdown_connections 2024-09-15T23:20:31.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.923+0000 7f8a2dd6d640 1 --2- 172.21.15.123:0/1460548815 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a2813eb20 0x7f8a281f08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:31.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.923+0000 7f8a2dd6d640 1 --2- 172.21.15.123:0/1460548815 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8a1406c2b0 0x7f8a1406e770 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:31.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.923+0000 7f8a2dd6d640 1 --2- 172.21.15.123:0/1460548815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a280b2d40 0x7f8a281f0360 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:31.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.923+0000 7f8a2dd6d640 1 --2- 172.21.15.123:0/1460548815 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8a2806c150 0x7f8a2813dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:31.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.923+0000 7f8a2dd6d640 1 -- 172.21.15.123:0/1460548815 >> 172.21.15.123:0/1460548815 conn(0x7f8a280ccec0 msgr2=0x7f8a28156190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:31.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.923+0000 7f8a2dd6d640 1 -- 172.21.15.123:0/1460548815 shutdown_connections 2024-09-15T23:20:31.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:31.923+0000 7f8a2dd6d640 1 -- 172.21.15.123:0/1460548815 wait complete. 2024-09-15T23:20:31.936 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T23:20:31.936 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:20:32.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.033+0000 7fa668045640 1 Processor -- start 2024-09-15T23:20:32.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.034+0000 7fa668045640 1 -- start start 2024-09-15T23:20:32.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.034+0000 7fa668045640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa6600b6970 0x7fa6600b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:32.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.034+0000 7fa668045640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa6600d23b0 0x7fa6600b8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:32.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.034+0000 7fa668045640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6600d0e70 con 0x7fa66015ed20 2024-09-15T23:20:32.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.034+0000 7fa668045640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fa6600d41c0 con 0x7fa6600d23b0 2024-09-15T23:20:32.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.034+0000 7fa668045640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa6600d35b0 con 0x7fa6600b6970 2024-09-15T23:20:32.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.035+0000 7fa6655e0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa6600b6970 0x7fa6600b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:32.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.035+0000 7fa6665e2640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa6600d23b0 0x7fa6600b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:32.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.035+0000 7fa6655e0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa6600b6970 0x7fa6600b80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:51316/0 (socket says 172.21.15.123:51316) 2024-09-15T23:20:32.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.035+0000 7fa6655e0640 1 -- 172.21.15.123:0/140755179 learned_addr learned my addr 172.21.15.123:0/140755179 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:32.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.035+0000 7fa6655e0640 1 -- 172.21.15.123:0/140755179 >> v2:172.21.15.188:3300/0 conn(0x7fa6600d23b0 msgr2=0x7fa6600b8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:32.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.035+0000 7fa6655e0640 1 --2- 172.21.15.123:0/140755179 >> v2:172.21.15.188:3300/0 conn(0x7fa6600d23b0 0x7fa6600b8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:32.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.035+0000 7fa6655e0640 1 -- 172.21.15.123:0/140755179 >> v1:172.21.15.188:6789/0 conn(0x7fa66015ed20 legacy=0x7fa6600b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:32.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.035+0000 7fa664ddf640 1 -- 172.21.15.123:0/140755179 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2207875950 0 0) 0x7fa650001490 con 0x7fa66015ed20 2024-09-15T23:20:32.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.035+0000 7fa6655e0640 1 -- 172.21.15.123:0/140755179 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6600d3890 con 0x7fa6600b6970 2024-09-15T23:20:32.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.036+0000 7fa6655e0640 1 --2- 172.21.15.123:0/140755179 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa6600b6970 0x7fa6600b80d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa654009870 tx=0x7fa65402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1887bf638e2d9813 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:32.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.036+0000 7fa664ddf640 1 -- 172.21.15.123:0/140755179 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa654037070 con 0x7fa6600b6970 2024-09-15T23:20:32.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.036+0000 7fa664ddf640 1 -- 172.21.15.123:0/140755179 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa654032440 con 0x7fa6600b6970 2024-09-15T23:20:32.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.036+0000 7fa664ddf640 1 -- 172.21.15.123:0/140755179 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa654032810 con 0x7fa6600b6970 2024-09-15T23:20:32.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.036+0000 7fa668045640 1 -- 172.21.15.123:0/140755179 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa6600b6970 msgr2=0x7fa6600b80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:32.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.036+0000 7fa668045640 1 --2- 172.21.15.123:0/140755179 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa6600b6970 0x7fa6600b80d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa654009870 tx=0x7fa65402a1c0 comp rx=0 tx=0).stop 2024-09-15T23:20:32.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.036+0000 7fa668045640 1 -- 172.21.15.123:0/140755179 shutdown_connections 2024-09-15T23:20:32.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.036+0000 7fa668045640 1 --2- 172.21.15.123:0/140755179 >> v2:172.21.15.188:3300/0 conn(0x7fa6600d23b0 0x7fa6600b8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:32.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.036+0000 7fa668045640 1 --2- 172.21.15.123:0/140755179 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa6600b6970 0x7fa6600b80d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:32.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.036+0000 7fa668045640 1 -- 172.21.15.123:0/140755179 >> 172.21.15.123:0/140755179 conn(0x7fa6600d1260 msgr2=0x7fa6600d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:32.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.036+0000 7fa668045640 1 -- 172.21.15.123:0/140755179 shutdown_connections 2024-09-15T23:20:32.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.036+0000 7fa668045640 1 -- 172.21.15.123:0/140755179 wait complete. 2024-09-15T23:20:32.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.038+0000 7fa668045640 1 Processor -- start 2024-09-15T23:20:32.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.038+0000 7fa668045640 1 -- start start 2024-09-15T23:20:32.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.038+0000 7fa668045640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6600b6970 0x7fa6600abe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:32.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.038+0000 7fa668045640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa6600d23b0 0x7fa6600ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:32.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.038+0000 7fa668045640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa66015ed20 0x7fa6601f7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:32.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.038+0000 7fa668045640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa6600d32a0 con 0x7fa6600b6970 2024-09-15T23:20:32.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.038+0000 7fa668045640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa6600d3e50 con 0x7fa6600d23b0 2024-09-15T23:20:32.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.038+0000 7fa668045640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa66015f100 con 0x7fa66015ed20 2024-09-15T23:20:32.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.038+0000 7fa665de1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6600b6970 0x7fa6600abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:32.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.039+0000 7fa665de1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6600b6970 0x7fa6600abe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41122/0 (socket says 172.21.15.123:41122) 2024-09-15T23:20:32.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.039+0000 7fa665de1640 1 -- 172.21.15.123:0/4010863660 learned_addr learned my addr 172.21.15.123:0/4010863660 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:32.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.039+0000 7fa6665e2640 1 --2- 172.21.15.123:0/4010863660 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa66015ed20 0x7fa6601f7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:32.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.039+0000 7fa6655e0640 1 --2- 172.21.15.123:0/4010863660 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa6600d23b0 0x7fa6600ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:32.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.039+0000 7fa665de1640 1 -- 172.21.15.123:0/4010863660 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa66015ed20 msgr2=0x7fa6601f7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:32.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.039+0000 7fa665de1640 1 --2- 172.21.15.123:0/4010863660 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa66015ed20 0x7fa6601f7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:32.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.039+0000 7fa665de1640 1 -- 172.21.15.123:0/4010863660 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa6600d23b0 msgr2=0x7fa6600ae6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:32.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.039+0000 7fa665de1640 1 --2- 172.21.15.123:0/4010863660 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa6600d23b0 0x7fa6600ae6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:32.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.039+0000 7fa665de1640 1 -- 172.21.15.123:0/4010863660 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6600ac4c0 con 0x7fa6600b6970 2024-09-15T23:20:32.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.039+0000 7fa6655e0640 1 --2- 172.21.15.123:0/4010863660 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa6600d23b0 0x7fa6600ae6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:32.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.039+0000 7fa665de1640 1 --2- 172.21.15.123:0/4010863660 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6600b6970 0x7fa6600abe00 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7fa65000c820 tx=0x7fa65000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:32.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.039+0000 7fa65e7fc640 1 -- 172.21.15.123:0/4010863660 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa650017070 con 0x7fa6600b6970 2024-09-15T23:20:32.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.039+0000 7fa65e7fc640 1 -- 172.21.15.123:0/4010863660 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa650003da0 con 0x7fa6600b6970 2024-09-15T23:20:32.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.039+0000 7fa668045640 1 -- 172.21.15.123:0/4010863660 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6600ac7a0 con 0x7fa6600b6970 2024-09-15T23:20:32.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.039+0000 7fa65e7fc640 1 -- 172.21.15.123:0/4010863660 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa650005290 con 0x7fa6600b6970 2024-09-15T23:20:32.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.039+0000 7fa668045640 1 -- 172.21.15.123:0/4010863660 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6600acd60 con 0x7fa6600b6970 2024-09-15T23:20:32.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.040+0000 7fa668045640 1 -- 172.21.15.123:0/4010863660 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6600b7010 con 0x7fa6600b6970 2024-09-15T23:20:32.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.041+0000 7fa65e7fc640 1 -- 172.21.15.123:0/4010863660 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa65001a070 con 0x7fa6600b6970 2024-09-15T23:20:32.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.041+0000 7fa65e7fc640 1 --2- 172.21.15.123:0/4010863660 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa64c06c2b0 0x7fa64c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:32.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.041+0000 7fa65e7fc640 1 -- 172.21.15.123:0/4010863660 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7fa65008aaf0 con 0x7fa6600b6970 2024-09-15T23:20:32.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.041+0000 7fa6655e0640 1 --2- 172.21.15.123:0/4010863660 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa64c06c2b0 0x7fa64c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:32.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.042+0000 7fa6655e0640 1 --2- 172.21.15.123:0/4010863660 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa64c06c2b0 0x7fa64c06e770 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fa654034000 tx=0x7fa65402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:32.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.045+0000 7fa65e7fc640 1 -- 172.21.15.123:0/4010863660 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa6600d0e70 con 0x7fa6600b6970 2024-09-15T23:20:32.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.208+0000 7fa668045640 1 -- 172.21.15.123:0/4010863660 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa6600b3f20 con 0x7fa64c06c2b0 2024-09-15T23:20:32.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.214+0000 7fa65e7fc640 1 -- 172.21.15.123:0/4010863660 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249711 (secure 0 0 0) 0x7fa6600b3f20 con 0x7fa64c06c2b0 2024-09-15T23:20:32.218 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:32.220 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:20:32.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.217+0000 7fa668045640 1 -- 172.21.15.123:0/4010863660 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa64c06c2b0 msgr2=0x7fa64c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:32.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.217+0000 7fa668045640 1 --2- 172.21.15.123:0/4010863660 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa64c06c2b0 0x7fa64c06e770 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fa654034000 tx=0x7fa65402e000 comp rx=0 tx=0).stop 2024-09-15T23:20:32.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.217+0000 7fa668045640 1 -- 172.21.15.123:0/4010863660 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6600b6970 msgr2=0x7fa6600abe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:32.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.217+0000 7fa668045640 1 --2- 172.21.15.123:0/4010863660 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6600b6970 0x7fa6600abe00 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7fa65000c820 tx=0x7fa65000cce0 comp rx=0 tx=0).stop 2024-09-15T23:20:32.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.217+0000 7fa668045640 1 -- 172.21.15.123:0/4010863660 shutdown_connections 2024-09-15T23:20:32.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.217+0000 7fa668045640 1 --2- 172.21.15.123:0/4010863660 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa66015ed20 0x7fa6601f7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:32.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.217+0000 7fa668045640 1 --2- 172.21.15.123:0/4010863660 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa6600d23b0 0x7fa6600ae6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:32.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.217+0000 7fa668045640 1 --2- 172.21.15.123:0/4010863660 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa64c06c2b0 0x7fa64c06e770 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:32.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.217+0000 7fa668045640 1 --2- 172.21.15.123:0/4010863660 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa6600b6970 0x7fa6600abe00 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:32.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.217+0000 7fa668045640 1 -- 172.21.15.123:0/4010863660 >> 172.21.15.123:0/4010863660 conn(0x7fa6600d1260 msgr2=0x7fa6600b9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:32.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.217+0000 7fa668045640 1 -- 172.21.15.123:0/4010863660 shutdown_connections 2024-09-15T23:20:32.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.217+0000 7fa668045640 1 -- 172.21.15.123:0/4010863660 wait complete. 2024-09-15T23:20:32.229 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":402,"stamp":"2024-09-15T23:20:31.622079+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592050,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":183,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":378016,"kb_used_data":16028,"kb_used_omap":12,"kb_used_meta":361779,"kb_avail":754596704,"statfs":{"total":773094113280,"available":772707024896,"internally_reserved":0,"allocated":16412672,"data_stored":7882204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":370462256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1682,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.440330"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.514159+0000","last_change":"2024-09-15T23:20:29.210825+0000","last_active":"2024-09-15T23:20:30.514159+0000","last_peered":"2024-09-15T23:20:30.514159+0000","last_clean":"2024-09-15T23:20:30.514159+0000","last_became_active":"2024-09-15T23:20:29.209560+0000","last_became_peered":"2024-09-15T23:20:29.209560+0000","last_unstale":"2024-09-15T23:20:30.514159+0000","last_undegraded":"2024-09-15T23:20:30.514159+0000","last_fullsized":"2024-09-15T23:20:30.514159+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:01.209675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197440+0000","last_change":"2024-09-15T23:20:29.213201+0000","last_active":"2024-09-15T23:20:30.197440+0000","last_peered":"2024-09-15T23:20:30.197440+0000","last_clean":"2024-09-15T23:20:30.197440+0000","last_became_active":"2024-09-15T23:20:29.212739+0000","last_became_peered":"2024-09-15T23:20:29.212739+0000","last_unstale":"2024-09-15T23:20:30.197440+0000","last_undegraded":"2024-09-15T23:20:30.197440+0000","last_fullsized":"2024-09-15T23:20:30.197440+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:47:20.508671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.192718+0000","last_change":"2024-09-15T23:20:28.192718+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.192718+0000","last_undegraded":"2024-09-15T23:20:28.192718+0000","last_fullsized":"2024-09-15T23:20:28.192718+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.187613+0000","last_change":"2024-09-15T23:20:28.187613+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.187613+0000","last_undegraded":"2024-09-15T23:20:28.187613+0000","last_fullsized":"2024-09-15T23:20:28.187613+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.193283+0000","last_change":"2024-09-15T23:20:28.193283+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.193283+0000","last_undegraded":"2024-09-15T23:20:28.193283+0000","last_fullsized":"2024-09-15T23:20:28.193283+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513482+0000","last_change":"2024-09-15T23:20:29.204397+0000","last_active":"2024-09-15T23:20:30.513482+0000","last_peered":"2024-09-15T23:20:30.513482+0000","last_clean":"2024-09-15T23:20:30.513482+0000","last_became_active":"2024-09-15T23:20:29.204136+0000","last_became_peered":"2024-09-15T23:20:29.204136+0000","last_unstale":"2024-09-15T23:20:30.513482+0000","last_undegraded":"2024-09-15T23:20:30.513482+0000","last_fullsized":"2024-09-15T23:20:30.513482+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:59.246406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.477898+0000","last_change":"2024-09-15T23:20:29.201027+0000","last_active":"2024-09-15T23:20:30.477898+0000","last_peered":"2024-09-15T23:20:30.477898+0000","last_clean":"2024-09-15T23:20:30.477898+0000","last_became_active":"2024-09-15T23:20:29.200749+0000","last_became_peered":"2024-09-15T23:20:29.200749+0000","last_unstale":"2024-09-15T23:20:30.477898+0000","last_undegraded":"2024-09-15T23:20:30.477898+0000","last_fullsized":"2024-09-15T23:20:30.477898+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:19:41.540281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513824+0000","last_change":"2024-09-15T23:20:29.204750+0000","last_active":"2024-09-15T23:20:30.513824+0000","last_peered":"2024-09-15T23:20:30.513824+0000","last_clean":"2024-09-15T23:20:30.513824+0000","last_became_active":"2024-09-15T23:20:29.204302+0000","last_became_peered":"2024-09-15T23:20:29.204302+0000","last_unstale":"2024-09-15T23:20:30.513824+0000","last_undegraded":"2024-09-15T23:20:30.513824+0000","last_fullsized":"2024-09-15T23:20:30.513824+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:39:22.123870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513438+0000","last_change":"2024-09-15T23:20:29.208508+0000","last_active":"2024-09-15T23:20:30.513438+0000","last_peered":"2024-09-15T23:20:30.513438+0000","last_clean":"2024-09-15T23:20:30.513438+0000","last_became_active":"2024-09-15T23:20:29.208205+0000","last_became_peered":"2024-09-15T23:20:29.208205+0000","last_unstale":"2024-09-15T23:20:30.513438+0000","last_undegraded":"2024-09-15T23:20:30.513438+0000","last_fullsized":"2024-09-15T23:20:30.513438+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:12.809369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.194528+0000","last_change":"2024-09-15T23:20:28.194528+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.194528+0000","last_undegraded":"2024-09-15T23:20:28.194528+0000","last_fullsized":"2024-09-15T23:20:28.194528+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513577+0000","last_change":"2024-09-15T23:20:29.201060+0000","last_active":"2024-09-15T23:20:30.513577+0000","last_peered":"2024-09-15T23:20:30.513577+0000","last_clean":"2024-09-15T23:20:30.513577+0000","last_became_active":"2024-09-15T23:20:29.200789+0000","last_became_peered":"2024-09-15T23:20:29.200789+0000","last_unstale":"2024-09-15T23:20:30.513577+0000","last_undegraded":"2024-09-15T23:20:30.513577+0000","last_fullsized":"2024-09-15T23:20:30.513577+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:48.987519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.191371+0000","last_change":"2024-09-15T23:20:28.191371+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.191371+0000","last_undegraded":"2024-09-15T23:20:28.191371+0000","last_fullsized":"2024-09-15T23:20:28.191371+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.192883+0000","last_change":"2024-09-15T23:20:28.192883+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.192883+0000","last_undegraded":"2024-09-15T23:20:28.192883+0000","last_fullsized":"2024-09-15T23:20:28.192883+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.192133+0000","last_change":"2024-09-15T23:20:28.192133+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.192133+0000","last_undegraded":"2024-09-15T23:20:28.192133+0000","last_fullsized":"2024-09-15T23:20:28.192133+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.192587+0000","last_change":"2024-09-15T23:20:28.192587+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.192587+0000","last_undegraded":"2024-09-15T23:20:28.192587+0000","last_fullsized":"2024-09-15T23:20:28.192587+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.477851+0000","last_change":"2024-09-15T23:20:29.204046+0000","last_active":"2024-09-15T23:20:30.477851+0000","last_peered":"2024-09-15T23:20:30.477851+0000","last_clean":"2024-09-15T23:20:30.477851+0000","last_became_active":"2024-09-15T23:20:29.203700+0000","last_became_peered":"2024-09-15T23:20:29.203700+0000","last_unstale":"2024-09-15T23:20:30.477851+0000","last_undegraded":"2024-09-15T23:20:30.477851+0000","last_fullsized":"2024-09-15T23:20:30.477851+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:39:17.409757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.192631+0000","last_change":"2024-09-15T23:20:28.192631+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.192631+0000","last_undegraded":"2024-09-15T23:20:28.192631+0000","last_fullsized":"2024-09-15T23:20:28.192631+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.194250+0000","last_change":"2024-09-15T23:20:28.194250+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.194250+0000","last_undegraded":"2024-09-15T23:20:28.194250+0000","last_fullsized":"2024-09-15T23:20:28.194250+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513910+0000","last_change":"2024-09-15T23:20:29.205307+0000","last_active":"2024-09-15T23:20:30.513910+0000","last_peered":"2024-09-15T23:20:30.513910+0000","last_clean":"2024-09-15T23:20:30.513910+0000","last_became_active":"2024-09-15T23:20:29.202606+0000","last_became_peered":"2024-09-15T23:20:29.202606+0000","last_unstale":"2024-09-15T23:20:30.513910+0000","last_undegraded":"2024-09-15T23:20:30.513910+0000","last_fullsized":"2024-09-15T23:20:30.513910+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:55.411259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513840+0000","last_change":"2024-09-15T23:20:29.206689+0000","last_active":"2024-09-15T23:20:30.513840+0000","last_peered":"2024-09-15T23:20:30.513840+0000","last_clean":"2024-09-15T23:20:30.513840+0000","last_became_active":"2024-09-15T23:20:29.206438+0000","last_became_peered":"2024-09-15T23:20:29.206438+0000","last_unstale":"2024-09-15T23:20:30.513840+0000","last_undegraded":"2024-09-15T23:20:30.513840+0000","last_fullsized":"2024-09-15T23:20:30.513840+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:32.736263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.194524+0000","last_change":"2024-09-15T23:20:28.194524+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.194524+0000","last_undegraded":"2024-09-15T23:20:28.194524+0000","last_fullsized":"2024-09-15T23:20:28.194524+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.191712+0000","last_change":"2024-09-15T23:20:28.191712+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.191712+0000","last_undegraded":"2024-09-15T23:20:28.191712+0000","last_fullsized":"2024-09-15T23:20:28.191712+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.189185+0000","last_change":"2024-09-15T23:20:28.189185+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.189185+0000","last_undegraded":"2024-09-15T23:20:28.189185+0000","last_fullsized":"2024-09-15T23:20:28.189185+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.191495+0000","last_change":"2024-09-15T23:20:28.191495+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.191495+0000","last_undegraded":"2024-09-15T23:20:28.191495+0000","last_fullsized":"2024-09-15T23:20:28.191495+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197183+0000","last_change":"2024-09-15T23:20:29.203623+0000","last_active":"2024-09-15T23:20:30.197183+0000","last_peered":"2024-09-15T23:20:30.197183+0000","last_clean":"2024-09-15T23:20:30.197183+0000","last_became_active":"2024-09-15T23:20:29.203345+0000","last_became_peered":"2024-09-15T23:20:29.203345+0000","last_unstale":"2024-09-15T23:20:30.197183+0000","last_undegraded":"2024-09-15T23:20:30.197183+0000","last_fullsized":"2024-09-15T23:20:30.197183+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:54.343998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.514075+0000","last_change":"2024-09-15T23:20:29.210780+0000","last_active":"2024-09-15T23:20:30.514075+0000","last_peered":"2024-09-15T23:20:30.514075+0000","last_clean":"2024-09-15T23:20:30.514075+0000","last_became_active":"2024-09-15T23:20:29.210430+0000","last_became_peered":"2024-09-15T23:20:29.210430+0000","last_unstale":"2024-09-15T23:20:30.514075+0000","last_undegraded":"2024-09-15T23:20:30.514075+0000","last_fullsized":"2024-09-15T23:20:30.514075+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:03.050568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197008+0000","last_change":"2024-09-15T23:20:29.206551+0000","last_active":"2024-09-15T23:20:30.197008+0000","last_peered":"2024-09-15T23:20:30.197008+0000","last_clean":"2024-09-15T23:20:30.197008+0000","last_became_active":"2024-09-15T23:20:29.206047+0000","last_became_peered":"2024-09-15T23:20:29.206047+0000","last_unstale":"2024-09-15T23:20:30.197008+0000","last_undegraded":"2024-09-15T23:20:30.197008+0000","last_fullsized":"2024-09-15T23:20:30.197008+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:29.017905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197338+0000","last_change":"2024-09-15T23:20:29.213045+0000","last_active":"2024-09-15T23:20:30.197338+0000","last_peered":"2024-09-15T23:20:30.197338+0000","last_clean":"2024-09-15T23:20:30.197338+0000","last_became_active":"2024-09-15T23:20:29.212610+0000","last_became_peered":"2024-09-15T23:20:29.212610+0000","last_unstale":"2024-09-15T23:20:30.197338+0000","last_undegraded":"2024-09-15T23:20:30.197338+0000","last_fullsized":"2024-09-15T23:20:30.197338+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:16:34.134579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513344+0000","last_change":"2024-09-15T23:20:29.203828+0000","last_active":"2024-09-15T23:20:30.513344+0000","last_peered":"2024-09-15T23:20:30.513344+0000","last_clean":"2024-09-15T23:20:30.513344+0000","last_became_active":"2024-09-15T23:20:29.203540+0000","last_became_peered":"2024-09-15T23:20:29.203540+0000","last_unstale":"2024-09-15T23:20:30.513344+0000","last_undegraded":"2024-09-15T23:20:30.513344+0000","last_fullsized":"2024-09-15T23:20:30.513344+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:05.538292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.191210+0000","last_change":"2024-09-15T23:20:28.191210+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.191210+0000","last_undegraded":"2024-09-15T23:20:28.191210+0000","last_fullsized":"2024-09-15T23:20:28.191210+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.196949+0000","last_change":"2024-09-15T23:20:29.206312+0000","last_active":"2024-09-15T23:20:30.196949+0000","last_peered":"2024-09-15T23:20:30.196949+0000","last_clean":"2024-09-15T23:20:30.196949+0000","last_became_active":"2024-09-15T23:20:29.205751+0000","last_became_peered":"2024-09-15T23:20:29.205751+0000","last_unstale":"2024-09-15T23:20:30.196949+0000","last_undegraded":"2024-09-15T23:20:30.196949+0000","last_fullsized":"2024-09-15T23:20:30.196949+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:15.386192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.196748+0000","last_change":"2024-09-15T23:20:29.204281+0000","last_active":"2024-09-15T23:20:30.196748+0000","last_peered":"2024-09-15T23:20:30.196748+0000","last_clean":"2024-09-15T23:20:30.196748+0000","last_became_active":"2024-09-15T23:20:29.203688+0000","last_became_peered":"2024-09-15T23:20:29.203688+0000","last_unstale":"2024-09-15T23:20:30.196748+0000","last_undegraded":"2024-09-15T23:20:30.196748+0000","last_fullsized":"2024-09-15T23:20:30.196748+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:08.800648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.193376+0000","last_change":"2024-09-15T23:20:28.193376+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.193376+0000","last_undegraded":"2024-09-15T23:20:28.193376+0000","last_fullsized":"2024-09-15T23:20:28.193376+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.205767+0000","last_change":"2024-09-15T23:20:28.204655+0000","last_active":"2024-09-15T23:20:28.205767+0000","last_peered":"2024-09-15T23:20:28.205767+0000","last_clean":"2024-09-15T23:20:28.205767+0000","last_became_active":"2024-09-15T23:20:28.204276+0000","last_became_peered":"2024-09-15T23:20:28.204276+0000","last_unstale":"2024-09-15T23:20:28.205767+0000","last_undegraded":"2024-09-15T23:20:28.205767+0000","last_fullsized":"2024-09-15T23:20:28.205767+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:50.519564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478220+0000","last_change":"2024-09-15T23:20:29.211788+0000","last_active":"2024-09-15T23:20:30.478220+0000","last_peered":"2024-09-15T23:20:30.478220+0000","last_clean":"2024-09-15T23:20:30.478220+0000","last_became_active":"2024-09-15T23:20:29.211520+0000","last_became_peered":"2024-09-15T23:20:29.211520+0000","last_unstale":"2024-09-15T23:20:30.478220+0000","last_undegraded":"2024-09-15T23:20:30.478220+0000","last_fullsized":"2024-09-15T23:20:30.478220+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:11:54.598151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.1e","version":"153'1","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513593+0000","last_change":"2024-09-15T23:20:28.205670+0000","last_active":"2024-09-15T23:20:30.513593+0000","last_peered":"2024-09-15T23:20:30.513593+0000","last_clean":"2024-09-15T23:20:30.513593+0000","last_became_active":"2024-09-15T23:20:28.205375+0000","last_became_peered":"2024-09-15T23:20:28.205375+0000","last_unstale":"2024-09-15T23:20:30.513593+0000","last_undegraded":"2024-09-15T23:20:30.513593+0000","last_fullsized":"2024-09-15T23:20:30.513593+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:14.841698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513576+0000","last_change":"2024-09-15T23:20:29.199351+0000","last_active":"2024-09-15T23:20:30.513576+0000","last_peered":"2024-09-15T23:20:30.513576+0000","last_clean":"2024-09-15T23:20:30.513576+0000","last_became_active":"2024-09-15T23:20:29.199075+0000","last_became_peered":"2024-09-15T23:20:29.199075+0000","last_unstale":"2024-09-15T23:20:30.513576+0000","last_undegraded":"2024-09-15T23:20:30.513576+0000","last_fullsized":"2024-09-15T23:20:30.513576+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:35:52.283626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.206520+0000","last_change":"2024-09-15T23:20:28.205664+0000","last_active":"2024-09-15T23:20:28.206520+0000","last_peered":"2024-09-15T23:20:28.206520+0000","last_clean":"2024-09-15T23:20:28.206520+0000","last_became_active":"2024-09-15T23:20:28.205359+0000","last_became_peered":"2024-09-15T23:20:28.205359+0000","last_unstale":"2024-09-15T23:20:28.206520+0000","last_undegraded":"2024-09-15T23:20:28.206520+0000","last_fullsized":"2024-09-15T23:20:28.206520+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:10:47.716692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.188069+0000","last_change":"2024-09-15T23:20:28.188069+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.188069+0000","last_undegraded":"2024-09-15T23:20:28.188069+0000","last_fullsized":"2024-09-15T23:20:28.188069+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.202989+0000","last_change":"2024-09-15T23:20:28.198556+0000","last_active":"2024-09-15T23:20:28.202989+0000","last_peered":"2024-09-15T23:20:28.202989+0000","last_clean":"2024-09-15T23:20:28.202989+0000","last_became_active":"2024-09-15T23:20:28.198271+0000","last_became_peered":"2024-09-15T23:20:28.198271+0000","last_unstale":"2024-09-15T23:20:28.202989+0000","last_undegraded":"2024-09-15T23:20:28.202989+0000","last_fullsized":"2024-09-15T23:20:28.202989+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:41:22.811101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.196853+0000","last_change":"2024-09-15T23:20:29.210214+0000","last_active":"2024-09-15T23:20:30.196853+0000","last_peered":"2024-09-15T23:20:30.196853+0000","last_clean":"2024-09-15T23:20:30.196853+0000","last_became_active":"2024-09-15T23:20:29.209939+0000","last_became_peered":"2024-09-15T23:20:29.209939+0000","last_unstale":"2024-09-15T23:20:30.196853+0000","last_undegraded":"2024-09-15T23:20:30.196853+0000","last_fullsized":"2024-09-15T23:20:30.196853+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:26.238986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"153'1","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513467+0000","last_change":"2024-09-15T23:20:28.200879+0000","last_active":"2024-09-15T23:20:30.513467+0000","last_peered":"2024-09-15T23:20:30.513467+0000","last_clean":"2024-09-15T23:20:30.513467+0000","last_became_active":"2024-09-15T23:20:28.200596+0000","last_became_peered":"2024-09-15T23:20:28.200596+0000","last_unstale":"2024-09-15T23:20:30.513467+0000","last_undegraded":"2024-09-15T23:20:30.513467+0000","last_fullsized":"2024-09-15T23:20:30.513467+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:35.867315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.188506+0000","last_change":"2024-09-15T23:20:28.188506+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.188506+0000","last_undegraded":"2024-09-15T23:20:28.188506+0000","last_fullsized":"2024-09-15T23:20:28.188506+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.206090+0000","last_change":"2024-09-15T23:20:28.205621+0000","last_active":"2024-09-15T23:20:28.206090+0000","last_peered":"2024-09-15T23:20:28.206090+0000","last_clean":"2024-09-15T23:20:28.206090+0000","last_became_active":"2024-09-15T23:20:28.205331+0000","last_became_peered":"2024-09-15T23:20:28.205331+0000","last_unstale":"2024-09-15T23:20:28.206090+0000","last_undegraded":"2024-09-15T23:20:28.206090+0000","last_fullsized":"2024-09-15T23:20:28.206090+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:15.636385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.196932+0000","last_change":"2024-09-15T23:20:29.204023+0000","last_active":"2024-09-15T23:20:30.196932+0000","last_peered":"2024-09-15T23:20:30.196932+0000","last_clean":"2024-09-15T23:20:30.196932+0000","last_became_active":"2024-09-15T23:20:29.203330+0000","last_became_peered":"2024-09-15T23:20:29.203330+0000","last_unstale":"2024-09-15T23:20:30.196932+0000","last_undegraded":"2024-09-15T23:20:30.196932+0000","last_fullsized":"2024-09-15T23:20:30.196932+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:17.443743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513228+0000","last_change":"2024-09-15T23:20:28.198319+0000","last_active":"2024-09-15T23:20:30.513228+0000","last_peered":"2024-09-15T23:20:30.513228+0000","last_clean":"2024-09-15T23:20:30.513228+0000","last_became_active":"2024-09-15T23:20:28.198037+0000","last_became_peered":"2024-09-15T23:20:28.198037+0000","last_unstale":"2024-09-15T23:20:30.513228+0000","last_undegraded":"2024-09-15T23:20:30.513228+0000","last_fullsized":"2024-09-15T23:20:30.513228+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:59.671879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.188220+0000","last_change":"2024-09-15T23:20:28.188220+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.188220+0000","last_undegraded":"2024-09-15T23:20:28.188220+0000","last_fullsized":"2024-09-15T23:20:28.188220+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.203696+0000","last_change":"2024-09-15T23:20:28.202458+0000","last_active":"2024-09-15T23:20:28.203696+0000","last_peered":"2024-09-15T23:20:28.203696+0000","last_clean":"2024-09-15T23:20:28.203696+0000","last_became_active":"2024-09-15T23:20:28.201758+0000","last_became_peered":"2024-09-15T23:20:28.201758+0000","last_unstale":"2024-09-15T23:20:28.203696+0000","last_undegraded":"2024-09-15T23:20:28.203696+0000","last_fullsized":"2024-09-15T23:20:28.203696+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:56.514873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.188793+0000","last_change":"2024-09-15T23:20:28.188793+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.188793+0000","last_undegraded":"2024-09-15T23:20:28.188793+0000","last_fullsized":"2024-09-15T23:20:28.188793+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513715+0000","last_change":"2024-09-15T23:20:28.201994+0000","last_active":"2024-09-15T23:20:30.513715+0000","last_peered":"2024-09-15T23:20:30.513715+0000","last_clean":"2024-09-15T23:20:30.513715+0000","last_became_active":"2024-09-15T23:20:28.201732+0000","last_became_peered":"2024-09-15T23:20:28.201732+0000","last_unstale":"2024-09-15T23:20:30.513715+0000","last_undegraded":"2024-09-15T23:20:30.513715+0000","last_fullsized":"2024-09-15T23:20:30.513715+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:20:04.106407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.190214+0000","last_change":"2024-09-15T23:20:28.190214+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.190214+0000","last_undegraded":"2024-09-15T23:20:28.190214+0000","last_fullsized":"2024-09-15T23:20:28.190214+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.204610+0000","last_change":"2024-09-15T23:20:28.203405+0000","last_active":"2024-09-15T23:20:28.204610+0000","last_peered":"2024-09-15T23:20:28.204610+0000","last_clean":"2024-09-15T23:20:28.204610+0000","last_became_active":"2024-09-15T23:20:28.203089+0000","last_became_peered":"2024-09-15T23:20:28.203089+0000","last_unstale":"2024-09-15T23:20:28.204610+0000","last_undegraded":"2024-09-15T23:20:28.204610+0000","last_fullsized":"2024-09-15T23:20:28.204610+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:10.923587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478179+0000","last_change":"2024-09-15T23:20:29.203940+0000","last_active":"2024-09-15T23:20:30.478179+0000","last_peered":"2024-09-15T23:20:30.478179+0000","last_clean":"2024-09-15T23:20:30.478179+0000","last_became_active":"2024-09-15T23:20:29.203654+0000","last_became_peered":"2024-09-15T23:20:29.203654+0000","last_unstale":"2024-09-15T23:20:30.478179+0000","last_undegraded":"2024-09-15T23:20:30.478179+0000","last_fullsized":"2024-09-15T23:20:30.478179+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:44.170339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.14","version":"153'6","reported_seq":20,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478124+0000","last_change":"2024-09-15T23:20:28.198498+0000","last_active":"2024-09-15T23:20:30.478124+0000","last_peered":"2024-09-15T23:20:30.478124+0000","last_clean":"2024-09-15T23:20:30.478124+0000","last_became_active":"2024-09-15T23:20:28.198171+0000","last_became_peered":"2024-09-15T23:20:28.198171+0000","last_unstale":"2024-09-15T23:20:30.478124+0000","last_undegraded":"2024-09-15T23:20:30.478124+0000","last_fullsized":"2024-09-15T23:20:30.478124+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:40:08.921301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.187686+0000","last_change":"2024-09-15T23:20:28.187686+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.187686+0000","last_undegraded":"2024-09-15T23:20:28.187686+0000","last_fullsized":"2024-09-15T23:20:28.187686+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.203650+0000","last_change":"2024-09-15T23:20:28.201858+0000","last_active":"2024-09-15T23:20:28.203650+0000","last_peered":"2024-09-15T23:20:28.203650+0000","last_clean":"2024-09-15T23:20:28.203650+0000","last_became_active":"2024-09-15T23:20:28.201575+0000","last_became_peered":"2024-09-15T23:20:28.201575+0000","last_unstale":"2024-09-15T23:20:28.203650+0000","last_undegraded":"2024-09-15T23:20:28.203650+0000","last_fullsized":"2024-09-15T23:20:28.203650+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:26.414992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513779+0000","last_change":"2024-09-15T23:20:29.203263+0000","last_active":"2024-09-15T23:20:30.513779+0000","last_peered":"2024-09-15T23:20:30.513779+0000","last_clean":"2024-09-15T23:20:30.513779+0000","last_became_active":"2024-09-15T23:20:29.202940+0000","last_became_peered":"2024-09-15T23:20:29.202940+0000","last_unstale":"2024-09-15T23:20:30.513779+0000","last_undegraded":"2024-09-15T23:20:30.513779+0000","last_fullsized":"2024-09-15T23:20:30.513779+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:52:28.550373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.203071+0000","last_change":"2024-09-15T23:20:28.200080+0000","last_active":"2024-09-15T23:20:28.203071+0000","last_peered":"2024-09-15T23:20:28.203071+0000","last_clean":"2024-09-15T23:20:28.203071+0000","last_became_active":"2024-09-15T23:20:28.199794+0000","last_became_peered":"2024-09-15T23:20:28.199794+0000","last_unstale":"2024-09-15T23:20:28.203071+0000","last_undegraded":"2024-09-15T23:20:28.203071+0000","last_fullsized":"2024-09-15T23:20:28.203071+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:34.681060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.188239+0000","last_change":"2024-09-15T23:20:28.188239+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.188239+0000","last_undegraded":"2024-09-15T23:20:28.188239+0000","last_fullsized":"2024-09-15T23:20:28.188239+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197059+0000","last_change":"2024-09-15T23:20:28.198797+0000","last_active":"2024-09-15T23:20:30.197059+0000","last_peered":"2024-09-15T23:20:30.197059+0000","last_clean":"2024-09-15T23:20:30.197059+0000","last_became_active":"2024-09-15T23:20:28.198191+0000","last_became_peered":"2024-09-15T23:20:28.198191+0000","last_unstale":"2024-09-15T23:20:30.197059+0000","last_undegraded":"2024-09-15T23:20:30.197059+0000","last_fullsized":"2024-09-15T23:20:30.197059+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:07.972958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.187705+0000","last_change":"2024-09-15T23:20:28.187705+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.187705+0000","last_undegraded":"2024-09-15T23:20:28.187705+0000","last_fullsized":"2024-09-15T23:20:28.187705+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.10","version":"153'8","reported_seq":22,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513958+0000","last_change":"2024-09-15T23:20:28.200011+0000","last_active":"2024-09-15T23:20:30.513958+0000","last_peered":"2024-09-15T23:20:30.513958+0000","last_clean":"2024-09-15T23:20:30.513958+0000","last_became_active":"2024-09-15T23:20:28.199751+0000","last_became_peered":"2024-09-15T23:20:28.199751+0000","last_unstale":"2024-09-15T23:20:30.513958+0000","last_undegraded":"2024-09-15T23:20:30.513958+0000","last_fullsized":"2024-09-15T23:20:30.513958+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:47:17.451917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.192616+0000","last_change":"2024-09-15T23:20:28.192616+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.192616+0000","last_undegraded":"2024-09-15T23:20:28.192616+0000","last_fullsized":"2024-09-15T23:20:28.192616+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.201043+0000","last_change":"2024-09-15T23:20:28.200278+0000","last_active":"2024-09-15T23:20:28.201043+0000","last_peered":"2024-09-15T23:20:28.201043+0000","last_clean":"2024-09-15T23:20:28.201043+0000","last_became_active":"2024-09-15T23:20:28.200010+0000","last_became_peered":"2024-09-15T23:20:28.200010+0000","last_unstale":"2024-09-15T23:20:28.201043+0000","last_undegraded":"2024-09-15T23:20:28.201043+0000","last_fullsized":"2024-09-15T23:20:28.201043+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:25.236703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197368+0000","last_change":"2024-09-15T23:20:29.202536+0000","last_active":"2024-09-15T23:20:30.197368+0000","last_peered":"2024-09-15T23:20:30.197368+0000","last_clean":"2024-09-15T23:20:30.197368+0000","last_became_active":"2024-09-15T23:20:29.202017+0000","last_became_peered":"2024-09-15T23:20:29.202017+0000","last_unstale":"2024-09-15T23:20:30.197368+0000","last_undegraded":"2024-09-15T23:20:30.197368+0000","last_fullsized":"2024-09-15T23:20:30.197368+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:13.973671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.e","version":"153'2","reported_seq":16,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.514068+0000","last_change":"2024-09-15T23:20:28.203185+0000","last_active":"2024-09-15T23:20:30.514068+0000","last_peered":"2024-09-15T23:20:30.514068+0000","last_clean":"2024-09-15T23:20:30.514068+0000","last_became_active":"2024-09-15T23:20:28.202696+0000","last_became_peered":"2024-09-15T23:20:28.202696+0000","last_unstale":"2024-09-15T23:20:30.514068+0000","last_undegraded":"2024-09-15T23:20:30.514068+0000","last_fullsized":"2024-09-15T23:20:30.514068+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:40.388412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.192160+0000","last_change":"2024-09-15T23:20:28.192160+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.192160+0000","last_undegraded":"2024-09-15T23:20:28.192160+0000","last_fullsized":"2024-09-15T23:20:28.192160+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.d","version":"153'1","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478240+0000","last_change":"2024-09-15T23:20:28.201741+0000","last_active":"2024-09-15T23:20:30.478240+0000","last_peered":"2024-09-15T23:20:30.478240+0000","last_clean":"2024-09-15T23:20:30.478240+0000","last_became_active":"2024-09-15T23:20:28.201472+0000","last_became_peered":"2024-09-15T23:20:28.201472+0000","last_unstale":"2024-09-15T23:20:30.478240+0000","last_undegraded":"2024-09-15T23:20:30.478240+0000","last_fullsized":"2024-09-15T23:20:30.478240+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:37:13.277973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513650+0000","last_change":"2024-09-15T23:20:29.197136+0000","last_active":"2024-09-15T23:20:30.513650+0000","last_peered":"2024-09-15T23:20:30.513650+0000","last_clean":"2024-09-15T23:20:30.513650+0000","last_became_active":"2024-09-15T23:20:29.196233+0000","last_became_peered":"2024-09-15T23:20:29.196233+0000","last_unstale":"2024-09-15T23:20:30.513650+0000","last_undegraded":"2024-09-15T23:20:30.513650+0000","last_fullsized":"2024-09-15T23:20:30.513650+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:19.380894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197385+0000","last_change":"2024-09-15T23:20:28.199993+0000","last_active":"2024-09-15T23:20:30.197385+0000","last_peered":"2024-09-15T23:20:30.197385+0000","last_clean":"2024-09-15T23:20:30.197385+0000","last_became_active":"2024-09-15T23:20:28.199722+0000","last_became_peered":"2024-09-15T23:20:28.199722+0000","last_unstale":"2024-09-15T23:20:30.197385+0000","last_undegraded":"2024-09-15T23:20:30.197385+0000","last_fullsized":"2024-09-15T23:20:30.197385+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:14.668959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.190400+0000","last_change":"2024-09-15T23:20:28.190400+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.190400+0000","last_undegraded":"2024-09-15T23:20:28.190400+0000","last_fullsized":"2024-09-15T23:20:28.190400+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.b","version":"153'2","reported_seq":16,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513462+0000","last_change":"2024-09-15T23:20:28.205673+0000","last_active":"2024-09-15T23:20:30.513462+0000","last_peered":"2024-09-15T23:20:30.513462+0000","last_clean":"2024-09-15T23:20:30.513462+0000","last_became_active":"2024-09-15T23:20:28.205339+0000","last_became_peered":"2024-09-15T23:20:28.205339+0000","last_unstale":"2024-09-15T23:20:30.513462+0000","last_undegraded":"2024-09-15T23:20:30.513462+0000","last_fullsized":"2024-09-15T23:20:30.513462+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:35:31.432270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.196960+0000","last_change":"2024-09-15T23:20:29.202170+0000","last_active":"2024-09-15T23:20:30.196960+0000","last_peered":"2024-09-15T23:20:30.196960+0000","last_clean":"2024-09-15T23:20:30.196960+0000","last_became_active":"2024-09-15T23:20:29.201829+0000","last_became_peered":"2024-09-15T23:20:29.201829+0000","last_unstale":"2024-09-15T23:20:30.196960+0000","last_undegraded":"2024-09-15T23:20:30.196960+0000","last_fullsized":"2024-09-15T23:20:30.196960+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:55.770178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.200742+0000","last_change":"2024-09-15T23:20:28.199768+0000","last_active":"2024-09-15T23:20:28.200742+0000","last_peered":"2024-09-15T23:20:28.200742+0000","last_clean":"2024-09-15T23:20:28.200742+0000","last_became_active":"2024-09-15T23:20:28.199473+0000","last_became_peered":"2024-09-15T23:20:28.199473+0000","last_unstale":"2024-09-15T23:20:28.200742+0000","last_undegraded":"2024-09-15T23:20:28.200742+0000","last_fullsized":"2024-09-15T23:20:28.200742+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:20.928378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.190182+0000","last_change":"2024-09-15T23:20:28.190182+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.190182+0000","last_undegraded":"2024-09-15T23:20:28.190182+0000","last_fullsized":"2024-09-15T23:20:28.190182+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.202141+0000","last_change":"2024-09-15T23:20:28.201036+0000","last_active":"2024-09-15T23:20:28.202141+0000","last_peered":"2024-09-15T23:20:28.202141+0000","last_clean":"2024-09-15T23:20:28.202141+0000","last_became_active":"2024-09-15T23:20:28.200548+0000","last_became_peered":"2024-09-15T23:20:28.200548+0000","last_unstale":"2024-09-15T23:20:28.202141+0000","last_undegraded":"2024-09-15T23:20:28.202141+0000","last_fullsized":"2024-09-15T23:20:28.202141+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:16.441460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.196771+0000","last_change":"2024-09-15T23:20:29.211822+0000","last_active":"2024-09-15T23:20:30.196771+0000","last_peered":"2024-09-15T23:20:30.196771+0000","last_clean":"2024-09-15T23:20:30.196771+0000","last_became_active":"2024-09-15T23:20:29.211561+0000","last_became_peered":"2024-09-15T23:20:29.211561+0000","last_unstale":"2024-09-15T23:20:30.196771+0000","last_undegraded":"2024-09-15T23:20:30.196771+0000","last_fullsized":"2024-09-15T23:20:30.196771+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:21.930661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.200766+0000","last_change":"2024-09-15T23:20:28.196801+0000","last_active":"2024-09-15T23:20:28.200766+0000","last_peered":"2024-09-15T23:20:28.200766+0000","last_clean":"2024-09-15T23:20:28.200766+0000","last_became_active":"2024-09-15T23:20:28.195532+0000","last_became_peered":"2024-09-15T23:20:28.195532+0000","last_unstale":"2024-09-15T23:20:28.200766+0000","last_undegraded":"2024-09-15T23:20:28.200766+0000","last_fullsized":"2024-09-15T23:20:28.200766+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:07.798365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.187873+0000","last_change":"2024-09-15T23:20:28.187873+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.187873+0000","last_undegraded":"2024-09-15T23:20:28.187873+0000","last_fullsized":"2024-09-15T23:20:28.187873+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.200762+0000","last_change":"2024-09-15T23:20:28.197581+0000","last_active":"2024-09-15T23:20:28.200762+0000","last_peered":"2024-09-15T23:20:28.200762+0000","last_clean":"2024-09-15T23:20:28.200762+0000","last_became_active":"2024-09-15T23:20:28.197295+0000","last_became_peered":"2024-09-15T23:20:28.197295+0000","last_unstale":"2024-09-15T23:20:28.200762+0000","last_undegraded":"2024-09-15T23:20:28.200762+0000","last_fullsized":"2024-09-15T23:20:28.200762+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:09:07.949948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.189180+0000","last_change":"2024-09-15T23:20:28.189180+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.189180+0000","last_undegraded":"2024-09-15T23:20:28.189180+0000","last_fullsized":"2024-09-15T23:20:28.189180+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.6","version":"153'1","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197269+0000","last_change":"2024-09-15T23:20:28.201563+0000","last_active":"2024-09-15T23:20:30.197269+0000","last_peered":"2024-09-15T23:20:30.197269+0000","last_clean":"2024-09-15T23:20:30.197269+0000","last_became_active":"2024-09-15T23:20:28.201200+0000","last_became_peered":"2024-09-15T23:20:28.201200+0000","last_unstale":"2024-09-15T23:20:30.197269+0000","last_undegraded":"2024-09-15T23:20:30.197269+0000","last_fullsized":"2024-09-15T23:20:30.197269+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:33:08.209152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513913+0000","last_change":"2024-09-15T23:20:29.206055+0000","last_active":"2024-09-15T23:20:30.513913+0000","last_peered":"2024-09-15T23:20:30.513913+0000","last_clean":"2024-09-15T23:20:30.513913+0000","last_became_active":"2024-09-15T23:20:29.205752+0000","last_became_peered":"2024-09-15T23:20:29.205752+0000","last_unstale":"2024-09-15T23:20:30.513913+0000","last_undegraded":"2024-09-15T23:20:30.513913+0000","last_fullsized":"2024-09-15T23:20:30.513913+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:41.418218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478260+0000","last_change":"2024-09-15T23:20:28.198508+0000","last_active":"2024-09-15T23:20:30.478260+0000","last_peered":"2024-09-15T23:20:30.478260+0000","last_clean":"2024-09-15T23:20:30.478260+0000","last_became_active":"2024-09-15T23:20:28.198223+0000","last_became_peered":"2024-09-15T23:20:28.198223+0000","last_unstale":"2024-09-15T23:20:30.478260+0000","last_undegraded":"2024-09-15T23:20:30.478260+0000","last_fullsized":"2024-09-15T23:20:30.478260+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:08.445349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513338+0000","last_change":"2024-09-15T23:20:29.210818+0000","last_active":"2024-09-15T23:20:30.513338+0000","last_peered":"2024-09-15T23:20:30.513338+0000","last_clean":"2024-09-15T23:20:30.513338+0000","last_became_active":"2024-09-15T23:20:29.210535+0000","last_became_peered":"2024-09-15T23:20:29.210535+0000","last_unstale":"2024-09-15T23:20:30.513338+0000","last_undegraded":"2024-09-15T23:20:30.513338+0000","last_fullsized":"2024-09-15T23:20:30.513338+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:19.504434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478169+0000","last_change":"2024-09-15T23:20:28.198348+0000","last_active":"2024-09-15T23:20:30.478169+0000","last_peered":"2024-09-15T23:20:30.478169+0000","last_clean":"2024-09-15T23:20:30.478169+0000","last_became_active":"2024-09-15T23:20:28.198008+0000","last_became_peered":"2024-09-15T23:20:28.198008+0000","last_unstale":"2024-09-15T23:20:30.478169+0000","last_undegraded":"2024-09-15T23:20:30.478169+0000","last_fullsized":"2024-09-15T23:20:30.478169+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:02.473781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478031+0000","last_change":"2024-09-15T23:20:29.198415+0000","last_active":"2024-09-15T23:20:30.478031+0000","last_peered":"2024-09-15T23:20:30.478031+0000","last_clean":"2024-09-15T23:20:30.478031+0000","last_became_active":"2024-09-15T23:20:29.197633+0000","last_became_peered":"2024-09-15T23:20:29.197633+0000","last_unstale":"2024-09-15T23:20:30.478031+0000","last_undegraded":"2024-09-15T23:20:30.478031+0000","last_fullsized":"2024-09-15T23:20:30.478031+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:57:53.269720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.196904+0000","last_change":"2024-09-15T23:20:28.200763+0000","last_active":"2024-09-15T23:20:30.196904+0000","last_peered":"2024-09-15T23:20:30.196904+0000","last_clean":"2024-09-15T23:20:30.196904+0000","last_became_active":"2024-09-15T23:20:28.200468+0000","last_became_peered":"2024-09-15T23:20:28.200468+0000","last_unstale":"2024-09-15T23:20:30.196904+0000","last_undegraded":"2024-09-15T23:20:30.196904+0000","last_fullsized":"2024-09-15T23:20:30.196904+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:17:09.912049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.188057+0000","last_change":"2024-09-15T23:20:28.188057+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.188057+0000","last_undegraded":"2024-09-15T23:20:28.188057+0000","last_fullsized":"2024-09-15T23:20:28.188057+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.203773+0000","last_change":"2024-09-15T23:20:28.202777+0000","last_active":"2024-09-15T23:20:28.203773+0000","last_peered":"2024-09-15T23:20:28.203773+0000","last_clean":"2024-09-15T23:20:28.203773+0000","last_became_active":"2024-09-15T23:20:28.200455+0000","last_became_peered":"2024-09-15T23:20:28.200455+0000","last_unstale":"2024-09-15T23:20:28.203773+0000","last_undegraded":"2024-09-15T23:20:28.203773+0000","last_fullsized":"2024-09-15T23:20:28.203773+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:35:43.619546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.187770+0000","last_change":"2024-09-15T23:20:28.187770+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.187770+0000","last_undegraded":"2024-09-15T23:20:28.187770+0000","last_fullsized":"2024-09-15T23:20:28.187770+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.195144+0000","last_change":"2024-09-15T23:20:28.194389+0000","last_active":"2024-09-15T23:20:28.195144+0000","last_peered":"2024-09-15T23:20:28.195144+0000","last_clean":"2024-09-15T23:20:28.195144+0000","last_became_active":"2024-09-15T23:20:28.194128+0000","last_became_peered":"2024-09-15T23:20:28.194128+0000","last_unstale":"2024-09-15T23:20:28.195144+0000","last_undegraded":"2024-09-15T23:20:28.195144+0000","last_fullsized":"2024-09-15T23:20:28.195144+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:47:19.506387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.192137+0000","last_change":"2024-09-15T23:20:28.192137+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.192137+0000","last_undegraded":"2024-09-15T23:20:28.192137+0000","last_fullsized":"2024-09-15T23:20:28.192137+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513085+0000","last_change":"2024-09-15T23:20:28.205782+0000","last_active":"2024-09-15T23:20:30.513085+0000","last_peered":"2024-09-15T23:20:30.513085+0000","last_clean":"2024-09-15T23:20:30.513085+0000","last_became_active":"2024-09-15T23:20:28.205426+0000","last_became_peered":"2024-09-15T23:20:28.205426+0000","last_unstale":"2024-09-15T23:20:30.513085+0000","last_undegraded":"2024-09-15T23:20:30.513085+0000","last_fullsized":"2024-09-15T23:20:30.513085+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:05:46.878996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478039+0000","last_change":"2024-09-15T23:20:29.199433+0000","last_active":"2024-09-15T23:20:30.478039+0000","last_peered":"2024-09-15T23:20:30.478039+0000","last_clean":"2024-09-15T23:20:30.478039+0000","last_became_active":"2024-09-15T23:20:29.198927+0000","last_became_peered":"2024-09-15T23:20:29.198927+0000","last_unstale":"2024-09-15T23:20:30.478039+0000","last_undegraded":"2024-09-15T23:20:30.478039+0000","last_fullsized":"2024-09-15T23:20:30.478039+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:40:14.188975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.197934+0000","last_change":"2024-09-15T23:20:28.197023+0000","last_active":"2024-09-15T23:20:28.197934+0000","last_peered":"2024-09-15T23:20:28.197934+0000","last_clean":"2024-09-15T23:20:28.197934+0000","last_became_active":"2024-09-15T23:20:28.196602+0000","last_became_peered":"2024-09-15T23:20:28.196602+0000","last_unstale":"2024-09-15T23:20:28.197934+0000","last_undegraded":"2024-09-15T23:20:28.197934+0000","last_fullsized":"2024-09-15T23:20:28.197934+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:34.004979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":412,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.195204+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:20:28.195204+0000","last_peered":"2024-09-15T23:20:28.195204+0000","last_clean":"2024-09-15T23:20:28.195204+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:20:28.195204+0000","last_undegraded":"2024-09-15T23:20:28.195204+0000","last_fullsized":"2024-09-15T23:20:28.195204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":1682,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":4022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51084,"kb_used_data":1844,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320756,"statfs":{"total":96636764160,"available":96584454144,"internally_reserved":0,"allocated":1888256,"data_stored":832212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476840,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51068,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320772,"statfs":{"total":96636764160,"available":96584470528,"internally_reserved":0,"allocated":1875968,"data_stored":825937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476842,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47504,"kb_used_data":2424,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324336,"statfs":{"total":96636764160,"available":96588120064,"internally_reserved":0,"allocated":2482176,"data_stored":1422580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476842,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41344,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330496,"statfs":{"total":96636764160,"available":96594427904,"internally_reserved":0,"allocated":1875968,"data_stored":825937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542249,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28900,"kb_used_data":1868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342940,"statfs":{"total":96636764160,"available":96607170560,"internally_reserved":0,"allocated":1912832,"data_stored":845287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542249,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51108,"kb_used_data":1868,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320732,"statfs":{"total":96636764160,"available":96584429568,"internally_reserved":0,"allocated":1912832,"data_stored":845287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542248,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55876,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315964,"statfs":{"total":96636764160,"available":96579547136,"internally_reserved":0,"allocated":2531328,"data_stored":1437461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542250,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51132,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320708,"statfs":{"total":96636764160,"available":96584404992,"internally_reserved":0,"allocated":1933312,"data_stored":847503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:20:32.234 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:20:32.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.367+0000 7f8ddc566640 1 Processor -- start 2024-09-15T23:20:32.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.367+0000 7f8ddc566640 1 -- start start 2024-09-15T23:20:32.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.368+0000 7f8ddc566640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8dd413eb20 0x7f8dd415c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:32.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.368+0000 7f8ddc566640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dd4071180 con 0x7f8dd40b2d40 2024-09-15T23:20:32.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.368+0000 7f8ddc566640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dd4071460 con 0x7f8dd406c320 2024-09-15T23:20:32.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.368+0000 7f8ddc566640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8dd4071ab0 con 0x7f8dd413eb20 2024-09-15T23:20:32.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.368+0000 7f8dda302640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8dd40b2d40 0x7f8dd406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49000/0 (socket says 172.21.15.123:49000) 2024-09-15T23:20:32.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.368+0000 7f8dda302640 1 -- 172.21.15.123:0/260875572 learned_addr learned my addr 172.21.15.123:0/260875572 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:32.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.369+0000 7f8ddab03640 1 --2- 172.21.15.123:0/260875572 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8dd413eb20 0x7f8dd415c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:32.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.369+0000 7f8dd9300640 1 -- 172.21.15.123:0/260875572 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2906882453 0 0) 0x7f8dd4071180 con 0x7f8dd40b2d40 2024-09-15T23:20:32.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.369+0000 7f8dd9300640 1 -- 172.21.15.123:0/260875572 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8dc0003520 con 0x7f8dd40b2d40 2024-09-15T23:20:32.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.369+0000 7f8dd9300640 1 -- 172.21.15.123:0/260875572 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3095341547 0 0) 0x7f8dc0003520 con 0x7f8dd40b2d40 2024-09-15T23:20:32.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.369+0000 7f8dd9300640 1 -- 172.21.15.123:0/260875572 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8dd413eb20 msgr2=0x7f8dd415c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:32.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.369+0000 7f8dd9300640 1 --2- 172.21.15.123:0/260875572 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8dd413eb20 0x7f8dd415c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:32.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.369+0000 7f8dd9300640 1 -- 172.21.15.123:0/260875572 >> v1:172.21.15.188:6789/0 conn(0x7f8dd406c320 legacy=0x7f8dd415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:32.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.369+0000 7f8dd9300640 1 -- 172.21.15.123:0/260875572 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dd4071740 con 0x7f8dd40b2d40 2024-09-15T23:20:32.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.369+0000 7f8dd9300640 1 -- 172.21.15.123:0/260875572 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f8dd0001670 con 0x7f8dd40b2d40 2024-09-15T23:20:32.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.369+0000 7f8dd9300640 1 -- 172.21.15.123:0/260875572 >> v1:172.21.15.123:6789/0 conn(0x7f8dd40b2d40 legacy=0x7f8dd406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:32.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.369+0000 7f8dd9300640 1 --2- 172.21.15.123:0/260875572 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8dd413eb20 0x7f8dc00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:32.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.369+0000 7f8dd9300640 1 --2- 172.21.15.123:0/260875572 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8dc0003f60 0x7f8dc0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:32.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.369+0000 7f8dd9300640 1 --2- 172.21.15.123:0/260875572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dc0004d40 0x7f8dc00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:32.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.369+0000 7f8dd9300640 1 -- 172.21.15.123:0/260875572 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8dd4071ab0 con 0x7f8dc0004d40 2024-09-15T23:20:32.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.369+0000 7f8dd9300640 1 -- 172.21.15.123:0/260875572 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc000baa0 con 0x7f8dc0003f60 2024-09-15T23:20:32.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.369+0000 7f8dd9300640 1 -- 172.21.15.123:0/260875572 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8dc000bca0 con 0x7f8dd413eb20 2024-09-15T23:20:32.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.369+0000 7f8ddab03640 1 --2- 172.21.15.123:0/260875572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dc0004d40 0x7f8dc00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:32.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.369+0000 7f8dda302640 1 --2- 172.21.15.123:0/260875572 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8dd413eb20 0x7f8dc00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:32.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.369+0000 7f8dd9b01640 1 --2- 172.21.15.123:0/260875572 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8dc0003f60 0x7f8dc0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:32.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.369+0000 7f8ddab03640 1 -- 172.21.15.123:0/260875572 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8dd413eb20 msgr2=0x7f8dc00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:32.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.369+0000 7f8ddab03640 1 --2- 172.21.15.123:0/260875572 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8dd413eb20 0x7f8dc00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:32.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.369+0000 7f8ddab03640 1 -- 172.21.15.123:0/260875572 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8dc0003f60 msgr2=0x7f8dc0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:32.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.369+0000 7f8ddab03640 1 --2- 172.21.15.123:0/260875572 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8dc0003f60 0x7f8dc0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:32.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.369+0000 7f8ddab03640 1 -- 172.21.15.123:0/260875572 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc0003520 con 0x7f8dc0004d40 2024-09-15T23:20:32.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.369+0000 7f8dd9b01640 1 --2- 172.21.15.123:0/260875572 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8dc0003f60 0x7f8dc0004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:32.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.370+0000 7f8ddab03640 1 --2- 172.21.15.123:0/260875572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dc0004d40 0x7f8dc00051c0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc009fc0 tx=0x7f8dc0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7729d0e8d83913c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:32.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.370+0000 7f8dd9300640 1 -- 172.21.15.123:0/260875572 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc009c10 con 0x7f8dc0004d40 2024-09-15T23:20:32.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.370+0000 7f8dd9300640 1 -- 172.21.15.123:0/260875572 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dcc036070 con 0x7f8dc0004d40 2024-09-15T23:20:32.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.370+0000 7f8dd9300640 1 -- 172.21.15.123:0/260875572 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc031880 con 0x7f8dc0004d40 2024-09-15T23:20:32.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.371+0000 7f8ddc566640 1 -- 172.21.15.123:0/260875572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dc0004d40 msgr2=0x7f8dc00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:32.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.371+0000 7f8ddc566640 1 --2- 172.21.15.123:0/260875572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dc0004d40 0x7f8dc00051c0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc009fc0 tx=0x7f8dc0005830 comp rx=0 tx=0).stop 2024-09-15T23:20:32.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.371+0000 7f8ddab03640 1 -- 172.21.15.123:0/260875572 reap_dead start 2024-09-15T23:20:32.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.371+0000 7f8ddc566640 1 -- 172.21.15.123:0/260875572 shutdown_connections 2024-09-15T23:20:32.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.371+0000 7f8ddc566640 1 -- 172.21.15.123:0/260875572 >> 172.21.15.123:0/260875572 conn(0x7f8dd40ccec0 msgr2=0x7f8dd40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:32.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.371+0000 7f8ddc566640 1 -- 172.21.15.123:0/260875572 shutdown_connections 2024-09-15T23:20:32.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.371+0000 7f8ddc566640 1 -- 172.21.15.123:0/260875572 wait complete. 2024-09-15T23:20:32.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.372+0000 7f8ddc566640 1 Processor -- start 2024-09-15T23:20:32.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.372+0000 7f8ddc566640 1 -- start start 2024-09-15T23:20:32.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.373+0000 7f8ddc566640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dc0004d40 0x7f8dd40cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:32.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.373+0000 7f8ddc566640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8dd4156090 0x7f8dd4143d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:32.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.373+0000 7f8ddc566640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8dd40cc780 0x7f8dd4144240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:32.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.373+0000 7f8ddc566640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8dd415c790 con 0x7f8dc0004d40 2024-09-15T23:20:32.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.373+0000 7f8ddc566640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8dd415c610 con 0x7f8dd4156090 2024-09-15T23:20:32.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.373+0000 7f8ddc566640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8dd4164340 con 0x7f8dd40cc780 2024-09-15T23:20:32.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.373+0000 7f8dda302640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dc0004d40 0x7f8dd40cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:32.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.373+0000 7f8dda302640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dc0004d40 0x7f8dd40cf7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41152/0 (socket says 172.21.15.123:41152) 2024-09-15T23:20:32.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.373+0000 7f8dda302640 1 -- 172.21.15.123:0/2362750977 learned_addr learned my addr 172.21.15.123:0/2362750977 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:32.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.373+0000 7f8dd9b01640 1 --2- 172.21.15.123:0/2362750977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8dd4156090 0x7f8dd4143d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:32.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.373+0000 7f8ddab03640 1 --2- 172.21.15.123:0/2362750977 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8dd40cc780 0x7f8dd4144240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:32.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.373+0000 7f8dda302640 1 -- 172.21.15.123:0/2362750977 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8dd40cc780 msgr2=0x7f8dd4144240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:32.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.373+0000 7f8dda302640 1 --2- 172.21.15.123:0/2362750977 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8dd40cc780 0x7f8dd4144240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:32.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.373+0000 7f8dda302640 1 -- 172.21.15.123:0/2362750977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8dd4156090 msgr2=0x7f8dd4143d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:32.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.373+0000 7f8dda302640 1 --2- 172.21.15.123:0/2362750977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8dd4156090 0x7f8dd4143d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:32.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.373+0000 7f8dda302640 1 -- 172.21.15.123:0/2362750977 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dd40cf190 con 0x7f8dc0004d40 2024-09-15T23:20:32.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.373+0000 7f8dd9b01640 1 --2- 172.21.15.123:0/2362750977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8dd4156090 0x7f8dd4143d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:32.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.373+0000 7f8dda302640 1 --2- 172.21.15.123:0/2362750977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dc0004d40 0x7f8dd40cf7f0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0007310 tx=0x7f8dd00077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:32.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.373+0000 7f8dcaffd640 1 -- 172.21.15.123:0/2362750977 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd000fa00 con 0x7f8dc0004d40 2024-09-15T23:20:32.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.373+0000 7f8dcaffd640 1 -- 172.21.15.123:0/2362750977 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dd0018070 con 0x7f8dc0004d40 2024-09-15T23:20:32.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.374+0000 7f8ddc566640 1 -- 172.21.15.123:0/2362750977 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dd40cf450 con 0x7f8dc0004d40 2024-09-15T23:20:32.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.374+0000 7f8dcaffd640 1 -- 172.21.15.123:0/2362750977 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd000fdc0 con 0x7f8dc0004d40 2024-09-15T23:20:32.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.374+0000 7f8ddc566640 1 -- 172.21.15.123:0/2362750977 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dd40cadd0 con 0x7f8dc0004d40 2024-09-15T23:20:32.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.374+0000 7f8ddc566640 1 -- 172.21.15.123:0/2362750977 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dd40cd2a0 con 0x7f8dc0004d40 2024-09-15T23:20:32.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.375+0000 7f8dcaffd640 1 -- 172.21.15.123:0/2362750977 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8dd001d460 con 0x7f8dc0004d40 2024-09-15T23:20:32.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.375+0000 7f8dcaffd640 1 --2- 172.21.15.123:0/2362750977 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8db806c2b0 0x7f8db806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:32.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.375+0000 7f8dcaffd640 1 -- 172.21.15.123:0/2362750977 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f8dd008b530 con 0x7f8dc0004d40 2024-09-15T23:20:32.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.376+0000 7f8dd9b01640 1 --2- 172.21.15.123:0/2362750977 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8db806c2b0 0x7f8db806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:32.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.376+0000 7f8dd9b01640 1 --2- 172.21.15.123:0/2362750977 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8db806c2b0 0x7f8db806e770 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f8dc4007fd0 tx=0x7f8dc4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:32.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.380+0000 7f8dcaffd640 1 -- 172.21.15.123:0/2362750977 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8dd40cd2a0 con 0x7f8dc0004d40 2024-09-15T23:20:32.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.541+0000 7f8ddc566640 1 -- 172.21.15.123:0/2362750977 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8dd40cfd30 con 0x7f8db806c2b0 2024-09-15T23:20:32.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.548+0000 7f8dcaffd640 1 -- 172.21.15.123:0/2362750977 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249711 (secure 0 0 0) 0x7f8dc4001490 con 0x7f8db806c2b0 2024-09-15T23:20:32.551 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:32.553 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:20:32.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.551+0000 7f8ddc566640 1 -- 172.21.15.123:0/2362750977 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8db806c2b0 msgr2=0x7f8db806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:32.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.551+0000 7f8ddc566640 1 --2- 172.21.15.123:0/2362750977 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8db806c2b0 0x7f8db806e770 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f8dc4007fd0 tx=0x7f8dc4009040 comp rx=0 tx=0).stop 2024-09-15T23:20:32.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.551+0000 7f8ddc566640 1 -- 172.21.15.123:0/2362750977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dc0004d40 msgr2=0x7f8dd40cf7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:32.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.551+0000 7f8ddc566640 1 --2- 172.21.15.123:0/2362750977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dc0004d40 0x7f8dd40cf7f0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0007310 tx=0x7f8dd00077d0 comp rx=0 tx=0).stop 2024-09-15T23:20:32.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.551+0000 7f8ddc566640 1 -- 172.21.15.123:0/2362750977 shutdown_connections 2024-09-15T23:20:32.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.551+0000 7f8ddc566640 1 --2- 172.21.15.123:0/2362750977 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8dd40cc780 0x7f8dd4144240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:32.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.551+0000 7f8ddc566640 1 --2- 172.21.15.123:0/2362750977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8dd4156090 0x7f8dd4143d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:32.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.551+0000 7f8ddc566640 1 --2- 172.21.15.123:0/2362750977 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8db806c2b0 0x7f8db806e770 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:32.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.551+0000 7f8ddc566640 1 --2- 172.21.15.123:0/2362750977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dc0004d40 0x7f8dd40cf7f0 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:32.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.551+0000 7f8ddc566640 1 -- 172.21.15.123:0/2362750977 >> 172.21.15.123:0/2362750977 conn(0x7f8dd40ccec0 msgr2=0x7f8dd40b5cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:32.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.551+0000 7f8ddc566640 1 -- 172.21.15.123:0/2362750977 shutdown_connections 2024-09-15T23:20:32.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.551+0000 7f8ddc566640 1 -- 172.21.15.123:0/2362750977 wait complete. 2024-09-15T23:20:32.562 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":402,"stamp":"2024-09-15T23:20:31.622079+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592050,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":183,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":378016,"kb_used_data":16028,"kb_used_omap":12,"kb_used_meta":361779,"kb_avail":754596704,"statfs":{"total":773094113280,"available":772707024896,"internally_reserved":0,"allocated":16412672,"data_stored":7882204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":370462256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1682,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.440330"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.514159+0000","last_change":"2024-09-15T23:20:29.210825+0000","last_active":"2024-09-15T23:20:30.514159+0000","last_peered":"2024-09-15T23:20:30.514159+0000","last_clean":"2024-09-15T23:20:30.514159+0000","last_became_active":"2024-09-15T23:20:29.209560+0000","last_became_peered":"2024-09-15T23:20:29.209560+0000","last_unstale":"2024-09-15T23:20:30.514159+0000","last_undegraded":"2024-09-15T23:20:30.514159+0000","last_fullsized":"2024-09-15T23:20:30.514159+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:01.209675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197440+0000","last_change":"2024-09-15T23:20:29.213201+0000","last_active":"2024-09-15T23:20:30.197440+0000","last_peered":"2024-09-15T23:20:30.197440+0000","last_clean":"2024-09-15T23:20:30.197440+0000","last_became_active":"2024-09-15T23:20:29.212739+0000","last_became_peered":"2024-09-15T23:20:29.212739+0000","last_unstale":"2024-09-15T23:20:30.197440+0000","last_undegraded":"2024-09-15T23:20:30.197440+0000","last_fullsized":"2024-09-15T23:20:30.197440+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:47:20.508671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.192718+0000","last_change":"2024-09-15T23:20:28.192718+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.192718+0000","last_undegraded":"2024-09-15T23:20:28.192718+0000","last_fullsized":"2024-09-15T23:20:28.192718+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.187613+0000","last_change":"2024-09-15T23:20:28.187613+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.187613+0000","last_undegraded":"2024-09-15T23:20:28.187613+0000","last_fullsized":"2024-09-15T23:20:28.187613+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.193283+0000","last_change":"2024-09-15T23:20:28.193283+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.193283+0000","last_undegraded":"2024-09-15T23:20:28.193283+0000","last_fullsized":"2024-09-15T23:20:28.193283+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513482+0000","last_change":"2024-09-15T23:20:29.204397+0000","last_active":"2024-09-15T23:20:30.513482+0000","last_peered":"2024-09-15T23:20:30.513482+0000","last_clean":"2024-09-15T23:20:30.513482+0000","last_became_active":"2024-09-15T23:20:29.204136+0000","last_became_peered":"2024-09-15T23:20:29.204136+0000","last_unstale":"2024-09-15T23:20:30.513482+0000","last_undegraded":"2024-09-15T23:20:30.513482+0000","last_fullsized":"2024-09-15T23:20:30.513482+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:59.246406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.477898+0000","last_change":"2024-09-15T23:20:29.201027+0000","last_active":"2024-09-15T23:20:30.477898+0000","last_peered":"2024-09-15T23:20:30.477898+0000","last_clean":"2024-09-15T23:20:30.477898+0000","last_became_active":"2024-09-15T23:20:29.200749+0000","last_became_peered":"2024-09-15T23:20:29.200749+0000","last_unstale":"2024-09-15T23:20:30.477898+0000","last_undegraded":"2024-09-15T23:20:30.477898+0000","last_fullsized":"2024-09-15T23:20:30.477898+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:19:41.540281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513824+0000","last_change":"2024-09-15T23:20:29.204750+0000","last_active":"2024-09-15T23:20:30.513824+0000","last_peered":"2024-09-15T23:20:30.513824+0000","last_clean":"2024-09-15T23:20:30.513824+0000","last_became_active":"2024-09-15T23:20:29.204302+0000","last_became_peered":"2024-09-15T23:20:29.204302+0000","last_unstale":"2024-09-15T23:20:30.513824+0000","last_undegraded":"2024-09-15T23:20:30.513824+0000","last_fullsized":"2024-09-15T23:20:30.513824+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:39:22.123870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513438+0000","last_change":"2024-09-15T23:20:29.208508+0000","last_active":"2024-09-15T23:20:30.513438+0000","last_peered":"2024-09-15T23:20:30.513438+0000","last_clean":"2024-09-15T23:20:30.513438+0000","last_became_active":"2024-09-15T23:20:29.208205+0000","last_became_peered":"2024-09-15T23:20:29.208205+0000","last_unstale":"2024-09-15T23:20:30.513438+0000","last_undegraded":"2024-09-15T23:20:30.513438+0000","last_fullsized":"2024-09-15T23:20:30.513438+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:12.809369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.194528+0000","last_change":"2024-09-15T23:20:28.194528+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.194528+0000","last_undegraded":"2024-09-15T23:20:28.194528+0000","last_fullsized":"2024-09-15T23:20:28.194528+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513577+0000","last_change":"2024-09-15T23:20:29.201060+0000","last_active":"2024-09-15T23:20:30.513577+0000","last_peered":"2024-09-15T23:20:30.513577+0000","last_clean":"2024-09-15T23:20:30.513577+0000","last_became_active":"2024-09-15T23:20:29.200789+0000","last_became_peered":"2024-09-15T23:20:29.200789+0000","last_unstale":"2024-09-15T23:20:30.513577+0000","last_undegraded":"2024-09-15T23:20:30.513577+0000","last_fullsized":"2024-09-15T23:20:30.513577+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:48.987519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.191371+0000","last_change":"2024-09-15T23:20:28.191371+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.191371+0000","last_undegraded":"2024-09-15T23:20:28.191371+0000","last_fullsized":"2024-09-15T23:20:28.191371+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.192883+0000","last_change":"2024-09-15T23:20:28.192883+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.192883+0000","last_undegraded":"2024-09-15T23:20:28.192883+0000","last_fullsized":"2024-09-15T23:20:28.192883+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.192133+0000","last_change":"2024-09-15T23:20:28.192133+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.192133+0000","last_undegraded":"2024-09-15T23:20:28.192133+0000","last_fullsized":"2024-09-15T23:20:28.192133+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.192587+0000","last_change":"2024-09-15T23:20:28.192587+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.192587+0000","last_undegraded":"2024-09-15T23:20:28.192587+0000","last_fullsized":"2024-09-15T23:20:28.192587+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.477851+0000","last_change":"2024-09-15T23:20:29.204046+0000","last_active":"2024-09-15T23:20:30.477851+0000","last_peered":"2024-09-15T23:20:30.477851+0000","last_clean":"2024-09-15T23:20:30.477851+0000","last_became_active":"2024-09-15T23:20:29.203700+0000","last_became_peered":"2024-09-15T23:20:29.203700+0000","last_unstale":"2024-09-15T23:20:30.477851+0000","last_undegraded":"2024-09-15T23:20:30.477851+0000","last_fullsized":"2024-09-15T23:20:30.477851+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:39:17.409757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.192631+0000","last_change":"2024-09-15T23:20:28.192631+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.192631+0000","last_undegraded":"2024-09-15T23:20:28.192631+0000","last_fullsized":"2024-09-15T23:20:28.192631+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.194250+0000","last_change":"2024-09-15T23:20:28.194250+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.194250+0000","last_undegraded":"2024-09-15T23:20:28.194250+0000","last_fullsized":"2024-09-15T23:20:28.194250+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513910+0000","last_change":"2024-09-15T23:20:29.205307+0000","last_active":"2024-09-15T23:20:30.513910+0000","last_peered":"2024-09-15T23:20:30.513910+0000","last_clean":"2024-09-15T23:20:30.513910+0000","last_became_active":"2024-09-15T23:20:29.202606+0000","last_became_peered":"2024-09-15T23:20:29.202606+0000","last_unstale":"2024-09-15T23:20:30.513910+0000","last_undegraded":"2024-09-15T23:20:30.513910+0000","last_fullsized":"2024-09-15T23:20:30.513910+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:55.411259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513840+0000","last_change":"2024-09-15T23:20:29.206689+0000","last_active":"2024-09-15T23:20:30.513840+0000","last_peered":"2024-09-15T23:20:30.513840+0000","last_clean":"2024-09-15T23:20:30.513840+0000","last_became_active":"2024-09-15T23:20:29.206438+0000","last_became_peered":"2024-09-15T23:20:29.206438+0000","last_unstale":"2024-09-15T23:20:30.513840+0000","last_undegraded":"2024-09-15T23:20:30.513840+0000","last_fullsized":"2024-09-15T23:20:30.513840+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:32.736263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.194524+0000","last_change":"2024-09-15T23:20:28.194524+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.194524+0000","last_undegraded":"2024-09-15T23:20:28.194524+0000","last_fullsized":"2024-09-15T23:20:28.194524+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.191712+0000","last_change":"2024-09-15T23:20:28.191712+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.191712+0000","last_undegraded":"2024-09-15T23:20:28.191712+0000","last_fullsized":"2024-09-15T23:20:28.191712+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.189185+0000","last_change":"2024-09-15T23:20:28.189185+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.189185+0000","last_undegraded":"2024-09-15T23:20:28.189185+0000","last_fullsized":"2024-09-15T23:20:28.189185+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.191495+0000","last_change":"2024-09-15T23:20:28.191495+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.191495+0000","last_undegraded":"2024-09-15T23:20:28.191495+0000","last_fullsized":"2024-09-15T23:20:28.191495+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197183+0000","last_change":"2024-09-15T23:20:29.203623+0000","last_active":"2024-09-15T23:20:30.197183+0000","last_peered":"2024-09-15T23:20:30.197183+0000","last_clean":"2024-09-15T23:20:30.197183+0000","last_became_active":"2024-09-15T23:20:29.203345+0000","last_became_peered":"2024-09-15T23:20:29.203345+0000","last_unstale":"2024-09-15T23:20:30.197183+0000","last_undegraded":"2024-09-15T23:20:30.197183+0000","last_fullsized":"2024-09-15T23:20:30.197183+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:54.343998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.514075+0000","last_change":"2024-09-15T23:20:29.210780+0000","last_active":"2024-09-15T23:20:30.514075+0000","last_peered":"2024-09-15T23:20:30.514075+0000","last_clean":"2024-09-15T23:20:30.514075+0000","last_became_active":"2024-09-15T23:20:29.210430+0000","last_became_peered":"2024-09-15T23:20:29.210430+0000","last_unstale":"2024-09-15T23:20:30.514075+0000","last_undegraded":"2024-09-15T23:20:30.514075+0000","last_fullsized":"2024-09-15T23:20:30.514075+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:03.050568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197008+0000","last_change":"2024-09-15T23:20:29.206551+0000","last_active":"2024-09-15T23:20:30.197008+0000","last_peered":"2024-09-15T23:20:30.197008+0000","last_clean":"2024-09-15T23:20:30.197008+0000","last_became_active":"2024-09-15T23:20:29.206047+0000","last_became_peered":"2024-09-15T23:20:29.206047+0000","last_unstale":"2024-09-15T23:20:30.197008+0000","last_undegraded":"2024-09-15T23:20:30.197008+0000","last_fullsized":"2024-09-15T23:20:30.197008+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:29.017905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197338+0000","last_change":"2024-09-15T23:20:29.213045+0000","last_active":"2024-09-15T23:20:30.197338+0000","last_peered":"2024-09-15T23:20:30.197338+0000","last_clean":"2024-09-15T23:20:30.197338+0000","last_became_active":"2024-09-15T23:20:29.212610+0000","last_became_peered":"2024-09-15T23:20:29.212610+0000","last_unstale":"2024-09-15T23:20:30.197338+0000","last_undegraded":"2024-09-15T23:20:30.197338+0000","last_fullsized":"2024-09-15T23:20:30.197338+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:16:34.134579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513344+0000","last_change":"2024-09-15T23:20:29.203828+0000","last_active":"2024-09-15T23:20:30.513344+0000","last_peered":"2024-09-15T23:20:30.513344+0000","last_clean":"2024-09-15T23:20:30.513344+0000","last_became_active":"2024-09-15T23:20:29.203540+0000","last_became_peered":"2024-09-15T23:20:29.203540+0000","last_unstale":"2024-09-15T23:20:30.513344+0000","last_undegraded":"2024-09-15T23:20:30.513344+0000","last_fullsized":"2024-09-15T23:20:30.513344+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:05.538292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.191210+0000","last_change":"2024-09-15T23:20:28.191210+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.191210+0000","last_undegraded":"2024-09-15T23:20:28.191210+0000","last_fullsized":"2024-09-15T23:20:28.191210+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.196949+0000","last_change":"2024-09-15T23:20:29.206312+0000","last_active":"2024-09-15T23:20:30.196949+0000","last_peered":"2024-09-15T23:20:30.196949+0000","last_clean":"2024-09-15T23:20:30.196949+0000","last_became_active":"2024-09-15T23:20:29.205751+0000","last_became_peered":"2024-09-15T23:20:29.205751+0000","last_unstale":"2024-09-15T23:20:30.196949+0000","last_undegraded":"2024-09-15T23:20:30.196949+0000","last_fullsized":"2024-09-15T23:20:30.196949+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:15.386192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.196748+0000","last_change":"2024-09-15T23:20:29.204281+0000","last_active":"2024-09-15T23:20:30.196748+0000","last_peered":"2024-09-15T23:20:30.196748+0000","last_clean":"2024-09-15T23:20:30.196748+0000","last_became_active":"2024-09-15T23:20:29.203688+0000","last_became_peered":"2024-09-15T23:20:29.203688+0000","last_unstale":"2024-09-15T23:20:30.196748+0000","last_undegraded":"2024-09-15T23:20:30.196748+0000","last_fullsized":"2024-09-15T23:20:30.196748+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:08.800648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.193376+0000","last_change":"2024-09-15T23:20:28.193376+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.193376+0000","last_undegraded":"2024-09-15T23:20:28.193376+0000","last_fullsized":"2024-09-15T23:20:28.193376+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.205767+0000","last_change":"2024-09-15T23:20:28.204655+0000","last_active":"2024-09-15T23:20:28.205767+0000","last_peered":"2024-09-15T23:20:28.205767+0000","last_clean":"2024-09-15T23:20:28.205767+0000","last_became_active":"2024-09-15T23:20:28.204276+0000","last_became_peered":"2024-09-15T23:20:28.204276+0000","last_unstale":"2024-09-15T23:20:28.205767+0000","last_undegraded":"2024-09-15T23:20:28.205767+0000","last_fullsized":"2024-09-15T23:20:28.205767+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:50.519564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478220+0000","last_change":"2024-09-15T23:20:29.211788+0000","last_active":"2024-09-15T23:20:30.478220+0000","last_peered":"2024-09-15T23:20:30.478220+0000","last_clean":"2024-09-15T23:20:30.478220+0000","last_became_active":"2024-09-15T23:20:29.211520+0000","last_became_peered":"2024-09-15T23:20:29.211520+0000","last_unstale":"2024-09-15T23:20:30.478220+0000","last_undegraded":"2024-09-15T23:20:30.478220+0000","last_fullsized":"2024-09-15T23:20:30.478220+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:11:54.598151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.1e","version":"153'1","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513593+0000","last_change":"2024-09-15T23:20:28.205670+0000","last_active":"2024-09-15T23:20:30.513593+0000","last_peered":"2024-09-15T23:20:30.513593+0000","last_clean":"2024-09-15T23:20:30.513593+0000","last_became_active":"2024-09-15T23:20:28.205375+0000","last_became_peered":"2024-09-15T23:20:28.205375+0000","last_unstale":"2024-09-15T23:20:30.513593+0000","last_undegraded":"2024-09-15T23:20:30.513593+0000","last_fullsized":"2024-09-15T23:20:30.513593+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:14.841698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513576+0000","last_change":"2024-09-15T23:20:29.199351+0000","last_active":"2024-09-15T23:20:30.513576+0000","last_peered":"2024-09-15T23:20:30.513576+0000","last_clean":"2024-09-15T23:20:30.513576+0000","last_became_active":"2024-09-15T23:20:29.199075+0000","last_became_peered":"2024-09-15T23:20:29.199075+0000","last_unstale":"2024-09-15T23:20:30.513576+0000","last_undegraded":"2024-09-15T23:20:30.513576+0000","last_fullsized":"2024-09-15T23:20:30.513576+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:35:52.283626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.206520+0000","last_change":"2024-09-15T23:20:28.205664+0000","last_active":"2024-09-15T23:20:28.206520+0000","last_peered":"2024-09-15T23:20:28.206520+0000","last_clean":"2024-09-15T23:20:28.206520+0000","last_became_active":"2024-09-15T23:20:28.205359+0000","last_became_peered":"2024-09-15T23:20:28.205359+0000","last_unstale":"2024-09-15T23:20:28.206520+0000","last_undegraded":"2024-09-15T23:20:28.206520+0000","last_fullsized":"2024-09-15T23:20:28.206520+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:10:47.716692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.188069+0000","last_change":"2024-09-15T23:20:28.188069+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.188069+0000","last_undegraded":"2024-09-15T23:20:28.188069+0000","last_fullsized":"2024-09-15T23:20:28.188069+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.202989+0000","last_change":"2024-09-15T23:20:28.198556+0000","last_active":"2024-09-15T23:20:28.202989+0000","last_peered":"2024-09-15T23:20:28.202989+0000","last_clean":"2024-09-15T23:20:28.202989+0000","last_became_active":"2024-09-15T23:20:28.198271+0000","last_became_peered":"2024-09-15T23:20:28.198271+0000","last_unstale":"2024-09-15T23:20:28.202989+0000","last_undegraded":"2024-09-15T23:20:28.202989+0000","last_fullsized":"2024-09-15T23:20:28.202989+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:41:22.811101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.196853+0000","last_change":"2024-09-15T23:20:29.210214+0000","last_active":"2024-09-15T23:20:30.196853+0000","last_peered":"2024-09-15T23:20:30.196853+0000","last_clean":"2024-09-15T23:20:30.196853+0000","last_became_active":"2024-09-15T23:20:29.209939+0000","last_became_peered":"2024-09-15T23:20:29.209939+0000","last_unstale":"2024-09-15T23:20:30.196853+0000","last_undegraded":"2024-09-15T23:20:30.196853+0000","last_fullsized":"2024-09-15T23:20:30.196853+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:26.238986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"153'1","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513467+0000","last_change":"2024-09-15T23:20:28.200879+0000","last_active":"2024-09-15T23:20:30.513467+0000","last_peered":"2024-09-15T23:20:30.513467+0000","last_clean":"2024-09-15T23:20:30.513467+0000","last_became_active":"2024-09-15T23:20:28.200596+0000","last_became_peered":"2024-09-15T23:20:28.200596+0000","last_unstale":"2024-09-15T23:20:30.513467+0000","last_undegraded":"2024-09-15T23:20:30.513467+0000","last_fullsized":"2024-09-15T23:20:30.513467+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:35.867315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.188506+0000","last_change":"2024-09-15T23:20:28.188506+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.188506+0000","last_undegraded":"2024-09-15T23:20:28.188506+0000","last_fullsized":"2024-09-15T23:20:28.188506+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.206090+0000","last_change":"2024-09-15T23:20:28.205621+0000","last_active":"2024-09-15T23:20:28.206090+0000","last_peered":"2024-09-15T23:20:28.206090+0000","last_clean":"2024-09-15T23:20:28.206090+0000","last_became_active":"2024-09-15T23:20:28.205331+0000","last_became_peered":"2024-09-15T23:20:28.205331+0000","last_unstale":"2024-09-15T23:20:28.206090+0000","last_undegraded":"2024-09-15T23:20:28.206090+0000","last_fullsized":"2024-09-15T23:20:28.206090+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:15.636385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.196932+0000","last_change":"2024-09-15T23:20:29.204023+0000","last_active":"2024-09-15T23:20:30.196932+0000","last_peered":"2024-09-15T23:20:30.196932+0000","last_clean":"2024-09-15T23:20:30.196932+0000","last_became_active":"2024-09-15T23:20:29.203330+0000","last_became_peered":"2024-09-15T23:20:29.203330+0000","last_unstale":"2024-09-15T23:20:30.196932+0000","last_undegraded":"2024-09-15T23:20:30.196932+0000","last_fullsized":"2024-09-15T23:20:30.196932+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:17.443743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513228+0000","last_change":"2024-09-15T23:20:28.198319+0000","last_active":"2024-09-15T23:20:30.513228+0000","last_peered":"2024-09-15T23:20:30.513228+0000","last_clean":"2024-09-15T23:20:30.513228+0000","last_became_active":"2024-09-15T23:20:28.198037+0000","last_became_peered":"2024-09-15T23:20:28.198037+0000","last_unstale":"2024-09-15T23:20:30.513228+0000","last_undegraded":"2024-09-15T23:20:30.513228+0000","last_fullsized":"2024-09-15T23:20:30.513228+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:59.671879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.188220+0000","last_change":"2024-09-15T23:20:28.188220+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.188220+0000","last_undegraded":"2024-09-15T23:20:28.188220+0000","last_fullsized":"2024-09-15T23:20:28.188220+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.203696+0000","last_change":"2024-09-15T23:20:28.202458+0000","last_active":"2024-09-15T23:20:28.203696+0000","last_peered":"2024-09-15T23:20:28.203696+0000","last_clean":"2024-09-15T23:20:28.203696+0000","last_became_active":"2024-09-15T23:20:28.201758+0000","last_became_peered":"2024-09-15T23:20:28.201758+0000","last_unstale":"2024-09-15T23:20:28.203696+0000","last_undegraded":"2024-09-15T23:20:28.203696+0000","last_fullsized":"2024-09-15T23:20:28.203696+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:56.514873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.188793+0000","last_change":"2024-09-15T23:20:28.188793+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.188793+0000","last_undegraded":"2024-09-15T23:20:28.188793+0000","last_fullsized":"2024-09-15T23:20:28.188793+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513715+0000","last_change":"2024-09-15T23:20:28.201994+0000","last_active":"2024-09-15T23:20:30.513715+0000","last_peered":"2024-09-15T23:20:30.513715+0000","last_clean":"2024-09-15T23:20:30.513715+0000","last_became_active":"2024-09-15T23:20:28.201732+0000","last_became_peered":"2024-09-15T23:20:28.201732+0000","last_unstale":"2024-09-15T23:20:30.513715+0000","last_undegraded":"2024-09-15T23:20:30.513715+0000","last_fullsized":"2024-09-15T23:20:30.513715+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:20:04.106407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.190214+0000","last_change":"2024-09-15T23:20:28.190214+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.190214+0000","last_undegraded":"2024-09-15T23:20:28.190214+0000","last_fullsized":"2024-09-15T23:20:28.190214+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.204610+0000","last_change":"2024-09-15T23:20:28.203405+0000","last_active":"2024-09-15T23:20:28.204610+0000","last_peered":"2024-09-15T23:20:28.204610+0000","last_clean":"2024-09-15T23:20:28.204610+0000","last_became_active":"2024-09-15T23:20:28.203089+0000","last_became_peered":"2024-09-15T23:20:28.203089+0000","last_unstale":"2024-09-15T23:20:28.204610+0000","last_undegraded":"2024-09-15T23:20:28.204610+0000","last_fullsized":"2024-09-15T23:20:28.204610+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:10.923587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478179+0000","last_change":"2024-09-15T23:20:29.203940+0000","last_active":"2024-09-15T23:20:30.478179+0000","last_peered":"2024-09-15T23:20:30.478179+0000","last_clean":"2024-09-15T23:20:30.478179+0000","last_became_active":"2024-09-15T23:20:29.203654+0000","last_became_peered":"2024-09-15T23:20:29.203654+0000","last_unstale":"2024-09-15T23:20:30.478179+0000","last_undegraded":"2024-09-15T23:20:30.478179+0000","last_fullsized":"2024-09-15T23:20:30.478179+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:44.170339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.14","version":"153'6","reported_seq":20,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478124+0000","last_change":"2024-09-15T23:20:28.198498+0000","last_active":"2024-09-15T23:20:30.478124+0000","last_peered":"2024-09-15T23:20:30.478124+0000","last_clean":"2024-09-15T23:20:30.478124+0000","last_became_active":"2024-09-15T23:20:28.198171+0000","last_became_peered":"2024-09-15T23:20:28.198171+0000","last_unstale":"2024-09-15T23:20:30.478124+0000","last_undegraded":"2024-09-15T23:20:30.478124+0000","last_fullsized":"2024-09-15T23:20:30.478124+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:40:08.921301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.187686+0000","last_change":"2024-09-15T23:20:28.187686+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.187686+0000","last_undegraded":"2024-09-15T23:20:28.187686+0000","last_fullsized":"2024-09-15T23:20:28.187686+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.203650+0000","last_change":"2024-09-15T23:20:28.201858+0000","last_active":"2024-09-15T23:20:28.203650+0000","last_peered":"2024-09-15T23:20:28.203650+0000","last_clean":"2024-09-15T23:20:28.203650+0000","last_became_active":"2024-09-15T23:20:28.201575+0000","last_became_peered":"2024-09-15T23:20:28.201575+0000","last_unstale":"2024-09-15T23:20:28.203650+0000","last_undegraded":"2024-09-15T23:20:28.203650+0000","last_fullsized":"2024-09-15T23:20:28.203650+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:26.414992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513779+0000","last_change":"2024-09-15T23:20:29.203263+0000","last_active":"2024-09-15T23:20:30.513779+0000","last_peered":"2024-09-15T23:20:30.513779+0000","last_clean":"2024-09-15T23:20:30.513779+0000","last_became_active":"2024-09-15T23:20:29.202940+0000","last_became_peered":"2024-09-15T23:20:29.202940+0000","last_unstale":"2024-09-15T23:20:30.513779+0000","last_undegraded":"2024-09-15T23:20:30.513779+0000","last_fullsized":"2024-09-15T23:20:30.513779+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:52:28.550373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.203071+0000","last_change":"2024-09-15T23:20:28.200080+0000","last_active":"2024-09-15T23:20:28.203071+0000","last_peered":"2024-09-15T23:20:28.203071+0000","last_clean":"2024-09-15T23:20:28.203071+0000","last_became_active":"2024-09-15T23:20:28.199794+0000","last_became_peered":"2024-09-15T23:20:28.199794+0000","last_unstale":"2024-09-15T23:20:28.203071+0000","last_undegraded":"2024-09-15T23:20:28.203071+0000","last_fullsized":"2024-09-15T23:20:28.203071+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:34.681060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.188239+0000","last_change":"2024-09-15T23:20:28.188239+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.188239+0000","last_undegraded":"2024-09-15T23:20:28.188239+0000","last_fullsized":"2024-09-15T23:20:28.188239+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197059+0000","last_change":"2024-09-15T23:20:28.198797+0000","last_active":"2024-09-15T23:20:30.197059+0000","last_peered":"2024-09-15T23:20:30.197059+0000","last_clean":"2024-09-15T23:20:30.197059+0000","last_became_active":"2024-09-15T23:20:28.198191+0000","last_became_peered":"2024-09-15T23:20:28.198191+0000","last_unstale":"2024-09-15T23:20:30.197059+0000","last_undegraded":"2024-09-15T23:20:30.197059+0000","last_fullsized":"2024-09-15T23:20:30.197059+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:07.972958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.187705+0000","last_change":"2024-09-15T23:20:28.187705+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.187705+0000","last_undegraded":"2024-09-15T23:20:28.187705+0000","last_fullsized":"2024-09-15T23:20:28.187705+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.10","version":"153'8","reported_seq":22,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513958+0000","last_change":"2024-09-15T23:20:28.200011+0000","last_active":"2024-09-15T23:20:30.513958+0000","last_peered":"2024-09-15T23:20:30.513958+0000","last_clean":"2024-09-15T23:20:30.513958+0000","last_became_active":"2024-09-15T23:20:28.199751+0000","last_became_peered":"2024-09-15T23:20:28.199751+0000","last_unstale":"2024-09-15T23:20:30.513958+0000","last_undegraded":"2024-09-15T23:20:30.513958+0000","last_fullsized":"2024-09-15T23:20:30.513958+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:47:17.451917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.192616+0000","last_change":"2024-09-15T23:20:28.192616+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.192616+0000","last_undegraded":"2024-09-15T23:20:28.192616+0000","last_fullsized":"2024-09-15T23:20:28.192616+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.201043+0000","last_change":"2024-09-15T23:20:28.200278+0000","last_active":"2024-09-15T23:20:28.201043+0000","last_peered":"2024-09-15T23:20:28.201043+0000","last_clean":"2024-09-15T23:20:28.201043+0000","last_became_active":"2024-09-15T23:20:28.200010+0000","last_became_peered":"2024-09-15T23:20:28.200010+0000","last_unstale":"2024-09-15T23:20:28.201043+0000","last_undegraded":"2024-09-15T23:20:28.201043+0000","last_fullsized":"2024-09-15T23:20:28.201043+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:25.236703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197368+0000","last_change":"2024-09-15T23:20:29.202536+0000","last_active":"2024-09-15T23:20:30.197368+0000","last_peered":"2024-09-15T23:20:30.197368+0000","last_clean":"2024-09-15T23:20:30.197368+0000","last_became_active":"2024-09-15T23:20:29.202017+0000","last_became_peered":"2024-09-15T23:20:29.202017+0000","last_unstale":"2024-09-15T23:20:30.197368+0000","last_undegraded":"2024-09-15T23:20:30.197368+0000","last_fullsized":"2024-09-15T23:20:30.197368+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:13.973671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.e","version":"153'2","reported_seq":16,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.514068+0000","last_change":"2024-09-15T23:20:28.203185+0000","last_active":"2024-09-15T23:20:30.514068+0000","last_peered":"2024-09-15T23:20:30.514068+0000","last_clean":"2024-09-15T23:20:30.514068+0000","last_became_active":"2024-09-15T23:20:28.202696+0000","last_became_peered":"2024-09-15T23:20:28.202696+0000","last_unstale":"2024-09-15T23:20:30.514068+0000","last_undegraded":"2024-09-15T23:20:30.514068+0000","last_fullsized":"2024-09-15T23:20:30.514068+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:40.388412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.192160+0000","last_change":"2024-09-15T23:20:28.192160+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.192160+0000","last_undegraded":"2024-09-15T23:20:28.192160+0000","last_fullsized":"2024-09-15T23:20:28.192160+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.d","version":"153'1","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478240+0000","last_change":"2024-09-15T23:20:28.201741+0000","last_active":"2024-09-15T23:20:30.478240+0000","last_peered":"2024-09-15T23:20:30.478240+0000","last_clean":"2024-09-15T23:20:30.478240+0000","last_became_active":"2024-09-15T23:20:28.201472+0000","last_became_peered":"2024-09-15T23:20:28.201472+0000","last_unstale":"2024-09-15T23:20:30.478240+0000","last_undegraded":"2024-09-15T23:20:30.478240+0000","last_fullsized":"2024-09-15T23:20:30.478240+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:37:13.277973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513650+0000","last_change":"2024-09-15T23:20:29.197136+0000","last_active":"2024-09-15T23:20:30.513650+0000","last_peered":"2024-09-15T23:20:30.513650+0000","last_clean":"2024-09-15T23:20:30.513650+0000","last_became_active":"2024-09-15T23:20:29.196233+0000","last_became_peered":"2024-09-15T23:20:29.196233+0000","last_unstale":"2024-09-15T23:20:30.513650+0000","last_undegraded":"2024-09-15T23:20:30.513650+0000","last_fullsized":"2024-09-15T23:20:30.513650+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:19.380894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197385+0000","last_change":"2024-09-15T23:20:28.199993+0000","last_active":"2024-09-15T23:20:30.197385+0000","last_peered":"2024-09-15T23:20:30.197385+0000","last_clean":"2024-09-15T23:20:30.197385+0000","last_became_active":"2024-09-15T23:20:28.199722+0000","last_became_peered":"2024-09-15T23:20:28.199722+0000","last_unstale":"2024-09-15T23:20:30.197385+0000","last_undegraded":"2024-09-15T23:20:30.197385+0000","last_fullsized":"2024-09-15T23:20:30.197385+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:14.668959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.190400+0000","last_change":"2024-09-15T23:20:28.190400+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.190400+0000","last_undegraded":"2024-09-15T23:20:28.190400+0000","last_fullsized":"2024-09-15T23:20:28.190400+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.b","version":"153'2","reported_seq":16,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513462+0000","last_change":"2024-09-15T23:20:28.205673+0000","last_active":"2024-09-15T23:20:30.513462+0000","last_peered":"2024-09-15T23:20:30.513462+0000","last_clean":"2024-09-15T23:20:30.513462+0000","last_became_active":"2024-09-15T23:20:28.205339+0000","last_became_peered":"2024-09-15T23:20:28.205339+0000","last_unstale":"2024-09-15T23:20:30.513462+0000","last_undegraded":"2024-09-15T23:20:30.513462+0000","last_fullsized":"2024-09-15T23:20:30.513462+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:35:31.432270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.196960+0000","last_change":"2024-09-15T23:20:29.202170+0000","last_active":"2024-09-15T23:20:30.196960+0000","last_peered":"2024-09-15T23:20:30.196960+0000","last_clean":"2024-09-15T23:20:30.196960+0000","last_became_active":"2024-09-15T23:20:29.201829+0000","last_became_peered":"2024-09-15T23:20:29.201829+0000","last_unstale":"2024-09-15T23:20:30.196960+0000","last_undegraded":"2024-09-15T23:20:30.196960+0000","last_fullsized":"2024-09-15T23:20:30.196960+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:55.770178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.200742+0000","last_change":"2024-09-15T23:20:28.199768+0000","last_active":"2024-09-15T23:20:28.200742+0000","last_peered":"2024-09-15T23:20:28.200742+0000","last_clean":"2024-09-15T23:20:28.200742+0000","last_became_active":"2024-09-15T23:20:28.199473+0000","last_became_peered":"2024-09-15T23:20:28.199473+0000","last_unstale":"2024-09-15T23:20:28.200742+0000","last_undegraded":"2024-09-15T23:20:28.200742+0000","last_fullsized":"2024-09-15T23:20:28.200742+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:20.928378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.190182+0000","last_change":"2024-09-15T23:20:28.190182+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.190182+0000","last_undegraded":"2024-09-15T23:20:28.190182+0000","last_fullsized":"2024-09-15T23:20:28.190182+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.202141+0000","last_change":"2024-09-15T23:20:28.201036+0000","last_active":"2024-09-15T23:20:28.202141+0000","last_peered":"2024-09-15T23:20:28.202141+0000","last_clean":"2024-09-15T23:20:28.202141+0000","last_became_active":"2024-09-15T23:20:28.200548+0000","last_became_peered":"2024-09-15T23:20:28.200548+0000","last_unstale":"2024-09-15T23:20:28.202141+0000","last_undegraded":"2024-09-15T23:20:28.202141+0000","last_fullsized":"2024-09-15T23:20:28.202141+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:16.441460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.196771+0000","last_change":"2024-09-15T23:20:29.211822+0000","last_active":"2024-09-15T23:20:30.196771+0000","last_peered":"2024-09-15T23:20:30.196771+0000","last_clean":"2024-09-15T23:20:30.196771+0000","last_became_active":"2024-09-15T23:20:29.211561+0000","last_became_peered":"2024-09-15T23:20:29.211561+0000","last_unstale":"2024-09-15T23:20:30.196771+0000","last_undegraded":"2024-09-15T23:20:30.196771+0000","last_fullsized":"2024-09-15T23:20:30.196771+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:21.930661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.200766+0000","last_change":"2024-09-15T23:20:28.196801+0000","last_active":"2024-09-15T23:20:28.200766+0000","last_peered":"2024-09-15T23:20:28.200766+0000","last_clean":"2024-09-15T23:20:28.200766+0000","last_became_active":"2024-09-15T23:20:28.195532+0000","last_became_peered":"2024-09-15T23:20:28.195532+0000","last_unstale":"2024-09-15T23:20:28.200766+0000","last_undegraded":"2024-09-15T23:20:28.200766+0000","last_fullsized":"2024-09-15T23:20:28.200766+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:07.798365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.187873+0000","last_change":"2024-09-15T23:20:28.187873+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.187873+0000","last_undegraded":"2024-09-15T23:20:28.187873+0000","last_fullsized":"2024-09-15T23:20:28.187873+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.200762+0000","last_change":"2024-09-15T23:20:28.197581+0000","last_active":"2024-09-15T23:20:28.200762+0000","last_peered":"2024-09-15T23:20:28.200762+0000","last_clean":"2024-09-15T23:20:28.200762+0000","last_became_active":"2024-09-15T23:20:28.197295+0000","last_became_peered":"2024-09-15T23:20:28.197295+0000","last_unstale":"2024-09-15T23:20:28.200762+0000","last_undegraded":"2024-09-15T23:20:28.200762+0000","last_fullsized":"2024-09-15T23:20:28.200762+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:09:07.949948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.189180+0000","last_change":"2024-09-15T23:20:28.189180+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.189180+0000","last_undegraded":"2024-09-15T23:20:28.189180+0000","last_fullsized":"2024-09-15T23:20:28.189180+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.6","version":"153'1","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197269+0000","last_change":"2024-09-15T23:20:28.201563+0000","last_active":"2024-09-15T23:20:30.197269+0000","last_peered":"2024-09-15T23:20:30.197269+0000","last_clean":"2024-09-15T23:20:30.197269+0000","last_became_active":"2024-09-15T23:20:28.201200+0000","last_became_peered":"2024-09-15T23:20:28.201200+0000","last_unstale":"2024-09-15T23:20:30.197269+0000","last_undegraded":"2024-09-15T23:20:30.197269+0000","last_fullsized":"2024-09-15T23:20:30.197269+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:33:08.209152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513913+0000","last_change":"2024-09-15T23:20:29.206055+0000","last_active":"2024-09-15T23:20:30.513913+0000","last_peered":"2024-09-15T23:20:30.513913+0000","last_clean":"2024-09-15T23:20:30.513913+0000","last_became_active":"2024-09-15T23:20:29.205752+0000","last_became_peered":"2024-09-15T23:20:29.205752+0000","last_unstale":"2024-09-15T23:20:30.513913+0000","last_undegraded":"2024-09-15T23:20:30.513913+0000","last_fullsized":"2024-09-15T23:20:30.513913+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:41.418218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478260+0000","last_change":"2024-09-15T23:20:28.198508+0000","last_active":"2024-09-15T23:20:30.478260+0000","last_peered":"2024-09-15T23:20:30.478260+0000","last_clean":"2024-09-15T23:20:30.478260+0000","last_became_active":"2024-09-15T23:20:28.198223+0000","last_became_peered":"2024-09-15T23:20:28.198223+0000","last_unstale":"2024-09-15T23:20:30.478260+0000","last_undegraded":"2024-09-15T23:20:30.478260+0000","last_fullsized":"2024-09-15T23:20:30.478260+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:08.445349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513338+0000","last_change":"2024-09-15T23:20:29.210818+0000","last_active":"2024-09-15T23:20:30.513338+0000","last_peered":"2024-09-15T23:20:30.513338+0000","last_clean":"2024-09-15T23:20:30.513338+0000","last_became_active":"2024-09-15T23:20:29.210535+0000","last_became_peered":"2024-09-15T23:20:29.210535+0000","last_unstale":"2024-09-15T23:20:30.513338+0000","last_undegraded":"2024-09-15T23:20:30.513338+0000","last_fullsized":"2024-09-15T23:20:30.513338+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:19.504434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478169+0000","last_change":"2024-09-15T23:20:28.198348+0000","last_active":"2024-09-15T23:20:30.478169+0000","last_peered":"2024-09-15T23:20:30.478169+0000","last_clean":"2024-09-15T23:20:30.478169+0000","last_became_active":"2024-09-15T23:20:28.198008+0000","last_became_peered":"2024-09-15T23:20:28.198008+0000","last_unstale":"2024-09-15T23:20:30.478169+0000","last_undegraded":"2024-09-15T23:20:30.478169+0000","last_fullsized":"2024-09-15T23:20:30.478169+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:02.473781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478031+0000","last_change":"2024-09-15T23:20:29.198415+0000","last_active":"2024-09-15T23:20:30.478031+0000","last_peered":"2024-09-15T23:20:30.478031+0000","last_clean":"2024-09-15T23:20:30.478031+0000","last_became_active":"2024-09-15T23:20:29.197633+0000","last_became_peered":"2024-09-15T23:20:29.197633+0000","last_unstale":"2024-09-15T23:20:30.478031+0000","last_undegraded":"2024-09-15T23:20:30.478031+0000","last_fullsized":"2024-09-15T23:20:30.478031+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:57:53.269720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.196904+0000","last_change":"2024-09-15T23:20:28.200763+0000","last_active":"2024-09-15T23:20:30.196904+0000","last_peered":"2024-09-15T23:20:30.196904+0000","last_clean":"2024-09-15T23:20:30.196904+0000","last_became_active":"2024-09-15T23:20:28.200468+0000","last_became_peered":"2024-09-15T23:20:28.200468+0000","last_unstale":"2024-09-15T23:20:30.196904+0000","last_undegraded":"2024-09-15T23:20:30.196904+0000","last_fullsized":"2024-09-15T23:20:30.196904+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:17:09.912049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.188057+0000","last_change":"2024-09-15T23:20:28.188057+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.188057+0000","last_undegraded":"2024-09-15T23:20:28.188057+0000","last_fullsized":"2024-09-15T23:20:28.188057+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.203773+0000","last_change":"2024-09-15T23:20:28.202777+0000","last_active":"2024-09-15T23:20:28.203773+0000","last_peered":"2024-09-15T23:20:28.203773+0000","last_clean":"2024-09-15T23:20:28.203773+0000","last_became_active":"2024-09-15T23:20:28.200455+0000","last_became_peered":"2024-09-15T23:20:28.200455+0000","last_unstale":"2024-09-15T23:20:28.203773+0000","last_undegraded":"2024-09-15T23:20:28.203773+0000","last_fullsized":"2024-09-15T23:20:28.203773+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:35:43.619546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.187770+0000","last_change":"2024-09-15T23:20:28.187770+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.187770+0000","last_undegraded":"2024-09-15T23:20:28.187770+0000","last_fullsized":"2024-09-15T23:20:28.187770+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.195144+0000","last_change":"2024-09-15T23:20:28.194389+0000","last_active":"2024-09-15T23:20:28.195144+0000","last_peered":"2024-09-15T23:20:28.195144+0000","last_clean":"2024-09-15T23:20:28.195144+0000","last_became_active":"2024-09-15T23:20:28.194128+0000","last_became_peered":"2024-09-15T23:20:28.194128+0000","last_unstale":"2024-09-15T23:20:28.195144+0000","last_undegraded":"2024-09-15T23:20:28.195144+0000","last_fullsized":"2024-09-15T23:20:28.195144+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:47:19.506387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.192137+0000","last_change":"2024-09-15T23:20:28.192137+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.192137+0000","last_undegraded":"2024-09-15T23:20:28.192137+0000","last_fullsized":"2024-09-15T23:20:28.192137+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513085+0000","last_change":"2024-09-15T23:20:28.205782+0000","last_active":"2024-09-15T23:20:30.513085+0000","last_peered":"2024-09-15T23:20:30.513085+0000","last_clean":"2024-09-15T23:20:30.513085+0000","last_became_active":"2024-09-15T23:20:28.205426+0000","last_became_peered":"2024-09-15T23:20:28.205426+0000","last_unstale":"2024-09-15T23:20:30.513085+0000","last_undegraded":"2024-09-15T23:20:30.513085+0000","last_fullsized":"2024-09-15T23:20:30.513085+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:05:46.878996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478039+0000","last_change":"2024-09-15T23:20:29.199433+0000","last_active":"2024-09-15T23:20:30.478039+0000","last_peered":"2024-09-15T23:20:30.478039+0000","last_clean":"2024-09-15T23:20:30.478039+0000","last_became_active":"2024-09-15T23:20:29.198927+0000","last_became_peered":"2024-09-15T23:20:29.198927+0000","last_unstale":"2024-09-15T23:20:30.478039+0000","last_undegraded":"2024-09-15T23:20:30.478039+0000","last_fullsized":"2024-09-15T23:20:30.478039+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:40:14.188975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.197934+0000","last_change":"2024-09-15T23:20:28.197023+0000","last_active":"2024-09-15T23:20:28.197934+0000","last_peered":"2024-09-15T23:20:28.197934+0000","last_clean":"2024-09-15T23:20:28.197934+0000","last_became_active":"2024-09-15T23:20:28.196602+0000","last_became_peered":"2024-09-15T23:20:28.196602+0000","last_unstale":"2024-09-15T23:20:28.197934+0000","last_undegraded":"2024-09-15T23:20:28.197934+0000","last_fullsized":"2024-09-15T23:20:28.197934+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:34.004979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":412,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.195204+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:20:28.195204+0000","last_peered":"2024-09-15T23:20:28.195204+0000","last_clean":"2024-09-15T23:20:28.195204+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:20:28.195204+0000","last_undegraded":"2024-09-15T23:20:28.195204+0000","last_fullsized":"2024-09-15T23:20:28.195204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":1682,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":4022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51084,"kb_used_data":1844,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320756,"statfs":{"total":96636764160,"available":96584454144,"internally_reserved":0,"allocated":1888256,"data_stored":832212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476840,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51068,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320772,"statfs":{"total":96636764160,"available":96584470528,"internally_reserved":0,"allocated":1875968,"data_stored":825937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476842,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47504,"kb_used_data":2424,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324336,"statfs":{"total":96636764160,"available":96588120064,"internally_reserved":0,"allocated":2482176,"data_stored":1422580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476842,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41344,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330496,"statfs":{"total":96636764160,"available":96594427904,"internally_reserved":0,"allocated":1875968,"data_stored":825937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542249,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28900,"kb_used_data":1868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342940,"statfs":{"total":96636764160,"available":96607170560,"internally_reserved":0,"allocated":1912832,"data_stored":845287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542249,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51108,"kb_used_data":1868,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320732,"statfs":{"total":96636764160,"available":96584429568,"internally_reserved":0,"allocated":1912832,"data_stored":845287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542248,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55876,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315964,"statfs":{"total":96636764160,"available":96579547136,"internally_reserved":0,"allocated":2531328,"data_stored":1437461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542250,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51132,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320708,"statfs":{"total":96636764160,"available":96584404992,"internally_reserved":0,"allocated":1933312,"data_stored":847503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:20:32.566 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:20:32.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.701+0000 7fb3ec227640 1 Processor -- start 2024-09-15T23:20:32.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.701+0000 7fb3ec227640 1 -- start start 2024-09-15T23:20:32.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.702+0000 7fb3ec227640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb3e40b2d40 0x7fb3e406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:32.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.702+0000 7fb3ec227640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb3e406c150 0x7fb3e415c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:32.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.702+0000 7fb3ec227640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3e4071180 con 0x7fb3e413eb20 2024-09-15T23:20:32.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.702+0000 7fb3ec227640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fb3e4071ab0 con 0x7fb3e406c150 2024-09-15T23:20:32.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.702+0000 7fb3ec227640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fb3e4071460 con 0x7fb3e40b2d40 2024-09-15T23:20:32.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.702+0000 7fb3ea7c4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb3e406c150 0x7fb3e415c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:32.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.702+0000 7fb3e97c2640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb3e413eb20 0x7fb3e415bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49004/0 (socket says 172.21.15.123:49004) 2024-09-15T23:20:32.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.702+0000 7fb3e97c2640 1 -- 172.21.15.123:0/3126931359 learned_addr learned my addr 172.21.15.123:0/3126931359 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:32.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.702+0000 7fb3ea7c4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb3e406c150 0x7fb3e415c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41160/0 (socket says 172.21.15.123:41160) 2024-09-15T23:20:32.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.702+0000 7fb3e9fc3640 1 --2- 172.21.15.123:0/3126931359 >> v2:172.21.15.188:3300/0 conn(0x7fb3e40b2d40 0x7fb3e406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:32.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.702+0000 7fb3ea7c4640 1 -- 172.21.15.123:0/3126931359 >> v2:172.21.15.188:3300/0 conn(0x7fb3e40b2d40 msgr2=0x7fb3e406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:32.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.702+0000 7fb3ea7c4640 1 --2- 172.21.15.123:0/3126931359 >> v2:172.21.15.188:3300/0 conn(0x7fb3e40b2d40 0x7fb3e406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:32.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.702+0000 7fb3ea7c4640 1 -- 172.21.15.123:0/3126931359 >> v1:172.21.15.123:6789/0 conn(0x7fb3e413eb20 legacy=0x7fb3e415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:32.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.702+0000 7fb3ea7c4640 1 -- 172.21.15.123:0/3126931359 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3e4071740 con 0x7fb3e406c150 2024-09-15T23:20:32.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.702+0000 7fb3e8fc1640 1 -- 172.21.15.123:0/3126931359 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 418999177 0 0) 0x7fb3e4071180 con 0x7fb3e413eb20 2024-09-15T23:20:32.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.702+0000 7fb3e9fc3640 1 --2- 172.21.15.123:0/3126931359 >> v2:172.21.15.188:3300/0 conn(0x7fb3e40b2d40 0x7fb3e406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:20:32.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.703+0000 7fb3ea7c4640 1 --2- 172.21.15.123:0/3126931359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3e406c150 0x7fb3e415c400 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4069be0 tx=0x7fb3dc02c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a25270451b553be server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:32.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.703+0000 7fb3e8fc1640 1 -- 172.21.15.123:0/3126931359 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc039070 con 0x7fb3e406c150 2024-09-15T23:20:32.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.703+0000 7fb3e8fc1640 1 -- 172.21.15.123:0/3126931359 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3dc009540 con 0x7fb3e406c150 2024-09-15T23:20:32.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.703+0000 7fb3e8fc1640 1 -- 172.21.15.123:0/3126931359 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc009910 con 0x7fb3e406c150 2024-09-15T23:20:32.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.704+0000 7fb3ec227640 1 -- 172.21.15.123:0/3126931359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3e406c150 msgr2=0x7fb3e415c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:32.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.704+0000 7fb3ec227640 1 --2- 172.21.15.123:0/3126931359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3e406c150 0x7fb3e415c400 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4069be0 tx=0x7fb3dc02c890 comp rx=0 tx=0).stop 2024-09-15T23:20:32.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.704+0000 7fb3ec227640 1 -- 172.21.15.123:0/3126931359 shutdown_connections 2024-09-15T23:20:32.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.704+0000 7fb3ec227640 1 --2- 172.21.15.123:0/3126931359 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3e406c150 0x7fb3e415c400 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:32.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.704+0000 7fb3ec227640 1 --2- 172.21.15.123:0/3126931359 >> v2:172.21.15.188:3300/0 conn(0x7fb3e40b2d40 0x7fb3e406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:32.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.704+0000 7fb3ec227640 1 -- 172.21.15.123:0/3126931359 >> 172.21.15.123:0/3126931359 conn(0x7fb3e40ccec0 msgr2=0x7fb3e40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:32.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.704+0000 7fb3ec227640 1 -- 172.21.15.123:0/3126931359 shutdown_connections 2024-09-15T23:20:32.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.704+0000 7fb3ec227640 1 -- 172.21.15.123:0/3126931359 wait complete. 2024-09-15T23:20:32.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.705+0000 7fb3ec227640 1 Processor -- start 2024-09-15T23:20:32.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.705+0000 7fb3ec227640 1 -- start start 2024-09-15T23:20:32.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.706+0000 7fb3ec227640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb3e406c150 0x7fb3e413dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:32.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.706+0000 7fb3ec227640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3e40b2d40 0x7fb3e41f0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:32.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.706+0000 7fb3ec227640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb3e413eb20 0x7fb3e41f08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:32.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.706+0000 7fb3ec227640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e40722d0 con 0x7fb3e40b2d40 2024-09-15T23:20:32.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.706+0000 7fb3ec227640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e4072150 con 0x7fb3e406c150 2024-09-15T23:20:32.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.706+0000 7fb3ec227640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb3e4072450 con 0x7fb3e413eb20 2024-09-15T23:20:32.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.706+0000 7fb3e97c2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3e40b2d40 0x7fb3e41f0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:32.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.706+0000 7fb3e97c2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3e40b2d40 0x7fb3e41f0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41170/0 (socket says 172.21.15.123:41170) 2024-09-15T23:20:32.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.706+0000 7fb3e97c2640 1 -- 172.21.15.123:0/4244559034 learned_addr learned my addr 172.21.15.123:0/4244559034 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:32.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.706+0000 7fb3e9fc3640 1 --2- 172.21.15.123:0/4244559034 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb3e406c150 0x7fb3e413dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:32.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.706+0000 7fb3ea7c4640 1 --2- 172.21.15.123:0/4244559034 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb3e413eb20 0x7fb3e41f08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:32.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.706+0000 7fb3e97c2640 1 -- 172.21.15.123:0/4244559034 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb3e413eb20 msgr2=0x7fb3e41f08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:32.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.706+0000 7fb3e97c2640 1 --2- 172.21.15.123:0/4244559034 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb3e413eb20 0x7fb3e41f08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:32.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.706+0000 7fb3e97c2640 1 -- 172.21.15.123:0/4244559034 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb3e406c150 msgr2=0x7fb3e413dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:32.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.706+0000 7fb3e97c2640 1 --2- 172.21.15.123:0/4244559034 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb3e406c150 0x7fb3e413dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:32.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.706+0000 7fb3e97c2640 1 -- 172.21.15.123:0/4244559034 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3e415a6e0 con 0x7fb3e40b2d40 2024-09-15T23:20:32.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.706+0000 7fb3e9fc3640 1 --2- 172.21.15.123:0/4244559034 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb3e406c150 0x7fb3e413dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:32.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.706+0000 7fb3e97c2640 1 --2- 172.21.15.123:0/4244559034 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3e40b2d40 0x7fb3e41f0360 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fb3d400c410 tx=0x7fb3d400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:32.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.706+0000 7fb3da7fc640 1 -- 172.21.15.123:0/4244559034 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d40074e0 con 0x7fb3e40b2d40 2024-09-15T23:20:32.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.706+0000 7fb3da7fc640 1 -- 172.21.15.123:0/4244559034 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3d40047e0 con 0x7fb3e40b2d40 2024-09-15T23:20:32.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.706+0000 7fb3ec227640 1 -- 172.21.15.123:0/4244559034 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3e415a980 con 0x7fb3e40b2d40 2024-09-15T23:20:32.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.706+0000 7fb3da7fc640 1 -- 172.21.15.123:0/4244559034 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3d4004bd0 con 0x7fb3e40b2d40 2024-09-15T23:20:32.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.706+0000 7fb3ec227640 1 -- 172.21.15.123:0/4244559034 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3e415af40 con 0x7fb3e40b2d40 2024-09-15T23:20:32.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.707+0000 7fb3ec227640 1 -- 172.21.15.123:0/4244559034 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3e406bc10 con 0x7fb3e40b2d40 2024-09-15T23:20:32.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.708+0000 7fb3da7fc640 1 -- 172.21.15.123:0/4244559034 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb3d4011070 con 0x7fb3e40b2d40 2024-09-15T23:20:32.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.708+0000 7fb3da7fc640 1 --2- 172.21.15.123:0/4244559034 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb3c806c2b0 0x7fb3c806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:32.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.709+0000 7fb3da7fc640 1 -- 172.21.15.123:0/4244559034 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7fb3d408b060 con 0x7fb3e40b2d40 2024-09-15T23:20:32.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.709+0000 7fb3e9fc3640 1 --2- 172.21.15.123:0/4244559034 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb3c806c2b0 0x7fb3c806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:32.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.709+0000 7fb3e9fc3640 1 --2- 172.21.15.123:0/4244559034 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb3c806c2b0 0x7fb3c806e770 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fb3e000aa30 tx=0x7fb3e0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:32.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.713+0000 7fb3da7fc640 1 -- 172.21.15.123:0/4244559034 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb3d400e280 con 0x7fb3e40b2d40 2024-09-15T23:20:32.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.876+0000 7fb3ec227640 1 -- 172.21.15.123:0/4244559034 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb3e4140530 con 0x7fb3c806c2b0 2024-09-15T23:20:32.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.882+0000 7fb3da7fc640 1 -- 172.21.15.123:0/4244559034 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249711 (secure 0 0 0) 0x7fb3e4140530 con 0x7fb3c806c2b0 2024-09-15T23:20:32.886 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:32.887 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:20:32.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.885+0000 7fb3ec227640 1 -- 172.21.15.123:0/4244559034 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb3c806c2b0 msgr2=0x7fb3c806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:32.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.885+0000 7fb3ec227640 1 --2- 172.21.15.123:0/4244559034 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb3c806c2b0 0x7fb3c806e770 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fb3e000aa30 tx=0x7fb3e0008040 comp rx=0 tx=0).stop 2024-09-15T23:20:32.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.885+0000 7fb3ec227640 1 -- 172.21.15.123:0/4244559034 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3e40b2d40 msgr2=0x7fb3e41f0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:32.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.885+0000 7fb3ec227640 1 --2- 172.21.15.123:0/4244559034 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3e40b2d40 0x7fb3e41f0360 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fb3d400c410 tx=0x7fb3d400c8d0 comp rx=0 tx=0).stop 2024-09-15T23:20:32.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.885+0000 7fb3ec227640 1 -- 172.21.15.123:0/4244559034 shutdown_connections 2024-09-15T23:20:32.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.885+0000 7fb3ec227640 1 --2- 172.21.15.123:0/4244559034 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb3e413eb20 0x7fb3e41f08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:32.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.885+0000 7fb3ec227640 1 --2- 172.21.15.123:0/4244559034 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb3c806c2b0 0x7fb3c806e770 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:32.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.885+0000 7fb3ec227640 1 --2- 172.21.15.123:0/4244559034 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3e40b2d40 0x7fb3e41f0360 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:32.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.885+0000 7fb3ec227640 1 --2- 172.21.15.123:0/4244559034 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb3e406c150 0x7fb3e413dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:32.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.885+0000 7fb3ec227640 1 -- 172.21.15.123:0/4244559034 >> 172.21.15.123:0/4244559034 conn(0x7fb3e40ccec0 msgr2=0x7fb3e4156190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:32.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.885+0000 7fb3ec227640 1 -- 172.21.15.123:0/4244559034 shutdown_connections 2024-09-15T23:20:32.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:32.885+0000 7fb3ec227640 1 -- 172.21.15.123:0/4244559034 wait complete. 2024-09-15T23:20:32.897 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":402,"stamp":"2024-09-15T23:20:31.622079+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592050,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":183,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":378016,"kb_used_data":16028,"kb_used_omap":12,"kb_used_meta":361779,"kb_avail":754596704,"statfs":{"total":773094113280,"available":772707024896,"internally_reserved":0,"allocated":16412672,"data_stored":7882204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":370462256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1682,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.440330"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.514159+0000","last_change":"2024-09-15T23:20:29.210825+0000","last_active":"2024-09-15T23:20:30.514159+0000","last_peered":"2024-09-15T23:20:30.514159+0000","last_clean":"2024-09-15T23:20:30.514159+0000","last_became_active":"2024-09-15T23:20:29.209560+0000","last_became_peered":"2024-09-15T23:20:29.209560+0000","last_unstale":"2024-09-15T23:20:30.514159+0000","last_undegraded":"2024-09-15T23:20:30.514159+0000","last_fullsized":"2024-09-15T23:20:30.514159+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:01.209675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197440+0000","last_change":"2024-09-15T23:20:29.213201+0000","last_active":"2024-09-15T23:20:30.197440+0000","last_peered":"2024-09-15T23:20:30.197440+0000","last_clean":"2024-09-15T23:20:30.197440+0000","last_became_active":"2024-09-15T23:20:29.212739+0000","last_became_peered":"2024-09-15T23:20:29.212739+0000","last_unstale":"2024-09-15T23:20:30.197440+0000","last_undegraded":"2024-09-15T23:20:30.197440+0000","last_fullsized":"2024-09-15T23:20:30.197440+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:47:20.508671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.192718+0000","last_change":"2024-09-15T23:20:28.192718+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.192718+0000","last_undegraded":"2024-09-15T23:20:28.192718+0000","last_fullsized":"2024-09-15T23:20:28.192718+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.187613+0000","last_change":"2024-09-15T23:20:28.187613+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.187613+0000","last_undegraded":"2024-09-15T23:20:28.187613+0000","last_fullsized":"2024-09-15T23:20:28.187613+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.193283+0000","last_change":"2024-09-15T23:20:28.193283+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.193283+0000","last_undegraded":"2024-09-15T23:20:28.193283+0000","last_fullsized":"2024-09-15T23:20:28.193283+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513482+0000","last_change":"2024-09-15T23:20:29.204397+0000","last_active":"2024-09-15T23:20:30.513482+0000","last_peered":"2024-09-15T23:20:30.513482+0000","last_clean":"2024-09-15T23:20:30.513482+0000","last_became_active":"2024-09-15T23:20:29.204136+0000","last_became_peered":"2024-09-15T23:20:29.204136+0000","last_unstale":"2024-09-15T23:20:30.513482+0000","last_undegraded":"2024-09-15T23:20:30.513482+0000","last_fullsized":"2024-09-15T23:20:30.513482+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:59.246406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.477898+0000","last_change":"2024-09-15T23:20:29.201027+0000","last_active":"2024-09-15T23:20:30.477898+0000","last_peered":"2024-09-15T23:20:30.477898+0000","last_clean":"2024-09-15T23:20:30.477898+0000","last_became_active":"2024-09-15T23:20:29.200749+0000","last_became_peered":"2024-09-15T23:20:29.200749+0000","last_unstale":"2024-09-15T23:20:30.477898+0000","last_undegraded":"2024-09-15T23:20:30.477898+0000","last_fullsized":"2024-09-15T23:20:30.477898+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:19:41.540281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513824+0000","last_change":"2024-09-15T23:20:29.204750+0000","last_active":"2024-09-15T23:20:30.513824+0000","last_peered":"2024-09-15T23:20:30.513824+0000","last_clean":"2024-09-15T23:20:30.513824+0000","last_became_active":"2024-09-15T23:20:29.204302+0000","last_became_peered":"2024-09-15T23:20:29.204302+0000","last_unstale":"2024-09-15T23:20:30.513824+0000","last_undegraded":"2024-09-15T23:20:30.513824+0000","last_fullsized":"2024-09-15T23:20:30.513824+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:39:22.123870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513438+0000","last_change":"2024-09-15T23:20:29.208508+0000","last_active":"2024-09-15T23:20:30.513438+0000","last_peered":"2024-09-15T23:20:30.513438+0000","last_clean":"2024-09-15T23:20:30.513438+0000","last_became_active":"2024-09-15T23:20:29.208205+0000","last_became_peered":"2024-09-15T23:20:29.208205+0000","last_unstale":"2024-09-15T23:20:30.513438+0000","last_undegraded":"2024-09-15T23:20:30.513438+0000","last_fullsized":"2024-09-15T23:20:30.513438+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:12.809369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.194528+0000","last_change":"2024-09-15T23:20:28.194528+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.194528+0000","last_undegraded":"2024-09-15T23:20:28.194528+0000","last_fullsized":"2024-09-15T23:20:28.194528+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513577+0000","last_change":"2024-09-15T23:20:29.201060+0000","last_active":"2024-09-15T23:20:30.513577+0000","last_peered":"2024-09-15T23:20:30.513577+0000","last_clean":"2024-09-15T23:20:30.513577+0000","last_became_active":"2024-09-15T23:20:29.200789+0000","last_became_peered":"2024-09-15T23:20:29.200789+0000","last_unstale":"2024-09-15T23:20:30.513577+0000","last_undegraded":"2024-09-15T23:20:30.513577+0000","last_fullsized":"2024-09-15T23:20:30.513577+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:48.987519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.191371+0000","last_change":"2024-09-15T23:20:28.191371+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.191371+0000","last_undegraded":"2024-09-15T23:20:28.191371+0000","last_fullsized":"2024-09-15T23:20:28.191371+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.192883+0000","last_change":"2024-09-15T23:20:28.192883+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.192883+0000","last_undegraded":"2024-09-15T23:20:28.192883+0000","last_fullsized":"2024-09-15T23:20:28.192883+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.192133+0000","last_change":"2024-09-15T23:20:28.192133+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.192133+0000","last_undegraded":"2024-09-15T23:20:28.192133+0000","last_fullsized":"2024-09-15T23:20:28.192133+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.192587+0000","last_change":"2024-09-15T23:20:28.192587+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.192587+0000","last_undegraded":"2024-09-15T23:20:28.192587+0000","last_fullsized":"2024-09-15T23:20:28.192587+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.477851+0000","last_change":"2024-09-15T23:20:29.204046+0000","last_active":"2024-09-15T23:20:30.477851+0000","last_peered":"2024-09-15T23:20:30.477851+0000","last_clean":"2024-09-15T23:20:30.477851+0000","last_became_active":"2024-09-15T23:20:29.203700+0000","last_became_peered":"2024-09-15T23:20:29.203700+0000","last_unstale":"2024-09-15T23:20:30.477851+0000","last_undegraded":"2024-09-15T23:20:30.477851+0000","last_fullsized":"2024-09-15T23:20:30.477851+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:39:17.409757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.192631+0000","last_change":"2024-09-15T23:20:28.192631+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.192631+0000","last_undegraded":"2024-09-15T23:20:28.192631+0000","last_fullsized":"2024-09-15T23:20:28.192631+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.194250+0000","last_change":"2024-09-15T23:20:28.194250+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.194250+0000","last_undegraded":"2024-09-15T23:20:28.194250+0000","last_fullsized":"2024-09-15T23:20:28.194250+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513910+0000","last_change":"2024-09-15T23:20:29.205307+0000","last_active":"2024-09-15T23:20:30.513910+0000","last_peered":"2024-09-15T23:20:30.513910+0000","last_clean":"2024-09-15T23:20:30.513910+0000","last_became_active":"2024-09-15T23:20:29.202606+0000","last_became_peered":"2024-09-15T23:20:29.202606+0000","last_unstale":"2024-09-15T23:20:30.513910+0000","last_undegraded":"2024-09-15T23:20:30.513910+0000","last_fullsized":"2024-09-15T23:20:30.513910+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:55.411259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513840+0000","last_change":"2024-09-15T23:20:29.206689+0000","last_active":"2024-09-15T23:20:30.513840+0000","last_peered":"2024-09-15T23:20:30.513840+0000","last_clean":"2024-09-15T23:20:30.513840+0000","last_became_active":"2024-09-15T23:20:29.206438+0000","last_became_peered":"2024-09-15T23:20:29.206438+0000","last_unstale":"2024-09-15T23:20:30.513840+0000","last_undegraded":"2024-09-15T23:20:30.513840+0000","last_fullsized":"2024-09-15T23:20:30.513840+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:32.736263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.194524+0000","last_change":"2024-09-15T23:20:28.194524+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.194524+0000","last_undegraded":"2024-09-15T23:20:28.194524+0000","last_fullsized":"2024-09-15T23:20:28.194524+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.191712+0000","last_change":"2024-09-15T23:20:28.191712+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.191712+0000","last_undegraded":"2024-09-15T23:20:28.191712+0000","last_fullsized":"2024-09-15T23:20:28.191712+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.189185+0000","last_change":"2024-09-15T23:20:28.189185+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.189185+0000","last_undegraded":"2024-09-15T23:20:28.189185+0000","last_fullsized":"2024-09-15T23:20:28.189185+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.191495+0000","last_change":"2024-09-15T23:20:28.191495+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.191495+0000","last_undegraded":"2024-09-15T23:20:28.191495+0000","last_fullsized":"2024-09-15T23:20:28.191495+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197183+0000","last_change":"2024-09-15T23:20:29.203623+0000","last_active":"2024-09-15T23:20:30.197183+0000","last_peered":"2024-09-15T23:20:30.197183+0000","last_clean":"2024-09-15T23:20:30.197183+0000","last_became_active":"2024-09-15T23:20:29.203345+0000","last_became_peered":"2024-09-15T23:20:29.203345+0000","last_unstale":"2024-09-15T23:20:30.197183+0000","last_undegraded":"2024-09-15T23:20:30.197183+0000","last_fullsized":"2024-09-15T23:20:30.197183+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:54.343998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.514075+0000","last_change":"2024-09-15T23:20:29.210780+0000","last_active":"2024-09-15T23:20:30.514075+0000","last_peered":"2024-09-15T23:20:30.514075+0000","last_clean":"2024-09-15T23:20:30.514075+0000","last_became_active":"2024-09-15T23:20:29.210430+0000","last_became_peered":"2024-09-15T23:20:29.210430+0000","last_unstale":"2024-09-15T23:20:30.514075+0000","last_undegraded":"2024-09-15T23:20:30.514075+0000","last_fullsized":"2024-09-15T23:20:30.514075+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:03.050568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197008+0000","last_change":"2024-09-15T23:20:29.206551+0000","last_active":"2024-09-15T23:20:30.197008+0000","last_peered":"2024-09-15T23:20:30.197008+0000","last_clean":"2024-09-15T23:20:30.197008+0000","last_became_active":"2024-09-15T23:20:29.206047+0000","last_became_peered":"2024-09-15T23:20:29.206047+0000","last_unstale":"2024-09-15T23:20:30.197008+0000","last_undegraded":"2024-09-15T23:20:30.197008+0000","last_fullsized":"2024-09-15T23:20:30.197008+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:29.017905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197338+0000","last_change":"2024-09-15T23:20:29.213045+0000","last_active":"2024-09-15T23:20:30.197338+0000","last_peered":"2024-09-15T23:20:30.197338+0000","last_clean":"2024-09-15T23:20:30.197338+0000","last_became_active":"2024-09-15T23:20:29.212610+0000","last_became_peered":"2024-09-15T23:20:29.212610+0000","last_unstale":"2024-09-15T23:20:30.197338+0000","last_undegraded":"2024-09-15T23:20:30.197338+0000","last_fullsized":"2024-09-15T23:20:30.197338+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:16:34.134579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513344+0000","last_change":"2024-09-15T23:20:29.203828+0000","last_active":"2024-09-15T23:20:30.513344+0000","last_peered":"2024-09-15T23:20:30.513344+0000","last_clean":"2024-09-15T23:20:30.513344+0000","last_became_active":"2024-09-15T23:20:29.203540+0000","last_became_peered":"2024-09-15T23:20:29.203540+0000","last_unstale":"2024-09-15T23:20:30.513344+0000","last_undegraded":"2024-09-15T23:20:30.513344+0000","last_fullsized":"2024-09-15T23:20:30.513344+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:05.538292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.191210+0000","last_change":"2024-09-15T23:20:28.191210+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.191210+0000","last_undegraded":"2024-09-15T23:20:28.191210+0000","last_fullsized":"2024-09-15T23:20:28.191210+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.196949+0000","last_change":"2024-09-15T23:20:29.206312+0000","last_active":"2024-09-15T23:20:30.196949+0000","last_peered":"2024-09-15T23:20:30.196949+0000","last_clean":"2024-09-15T23:20:30.196949+0000","last_became_active":"2024-09-15T23:20:29.205751+0000","last_became_peered":"2024-09-15T23:20:29.205751+0000","last_unstale":"2024-09-15T23:20:30.196949+0000","last_undegraded":"2024-09-15T23:20:30.196949+0000","last_fullsized":"2024-09-15T23:20:30.196949+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:15.386192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.196748+0000","last_change":"2024-09-15T23:20:29.204281+0000","last_active":"2024-09-15T23:20:30.196748+0000","last_peered":"2024-09-15T23:20:30.196748+0000","last_clean":"2024-09-15T23:20:30.196748+0000","last_became_active":"2024-09-15T23:20:29.203688+0000","last_became_peered":"2024-09-15T23:20:29.203688+0000","last_unstale":"2024-09-15T23:20:30.196748+0000","last_undegraded":"2024-09-15T23:20:30.196748+0000","last_fullsized":"2024-09-15T23:20:30.196748+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:08.800648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.193376+0000","last_change":"2024-09-15T23:20:28.193376+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.193376+0000","last_undegraded":"2024-09-15T23:20:28.193376+0000","last_fullsized":"2024-09-15T23:20:28.193376+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.205767+0000","last_change":"2024-09-15T23:20:28.204655+0000","last_active":"2024-09-15T23:20:28.205767+0000","last_peered":"2024-09-15T23:20:28.205767+0000","last_clean":"2024-09-15T23:20:28.205767+0000","last_became_active":"2024-09-15T23:20:28.204276+0000","last_became_peered":"2024-09-15T23:20:28.204276+0000","last_unstale":"2024-09-15T23:20:28.205767+0000","last_undegraded":"2024-09-15T23:20:28.205767+0000","last_fullsized":"2024-09-15T23:20:28.205767+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:50.519564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478220+0000","last_change":"2024-09-15T23:20:29.211788+0000","last_active":"2024-09-15T23:20:30.478220+0000","last_peered":"2024-09-15T23:20:30.478220+0000","last_clean":"2024-09-15T23:20:30.478220+0000","last_became_active":"2024-09-15T23:20:29.211520+0000","last_became_peered":"2024-09-15T23:20:29.211520+0000","last_unstale":"2024-09-15T23:20:30.478220+0000","last_undegraded":"2024-09-15T23:20:30.478220+0000","last_fullsized":"2024-09-15T23:20:30.478220+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:11:54.598151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.1e","version":"153'1","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513593+0000","last_change":"2024-09-15T23:20:28.205670+0000","last_active":"2024-09-15T23:20:30.513593+0000","last_peered":"2024-09-15T23:20:30.513593+0000","last_clean":"2024-09-15T23:20:30.513593+0000","last_became_active":"2024-09-15T23:20:28.205375+0000","last_became_peered":"2024-09-15T23:20:28.205375+0000","last_unstale":"2024-09-15T23:20:30.513593+0000","last_undegraded":"2024-09-15T23:20:30.513593+0000","last_fullsized":"2024-09-15T23:20:30.513593+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:14.841698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513576+0000","last_change":"2024-09-15T23:20:29.199351+0000","last_active":"2024-09-15T23:20:30.513576+0000","last_peered":"2024-09-15T23:20:30.513576+0000","last_clean":"2024-09-15T23:20:30.513576+0000","last_became_active":"2024-09-15T23:20:29.199075+0000","last_became_peered":"2024-09-15T23:20:29.199075+0000","last_unstale":"2024-09-15T23:20:30.513576+0000","last_undegraded":"2024-09-15T23:20:30.513576+0000","last_fullsized":"2024-09-15T23:20:30.513576+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:35:52.283626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.206520+0000","last_change":"2024-09-15T23:20:28.205664+0000","last_active":"2024-09-15T23:20:28.206520+0000","last_peered":"2024-09-15T23:20:28.206520+0000","last_clean":"2024-09-15T23:20:28.206520+0000","last_became_active":"2024-09-15T23:20:28.205359+0000","last_became_peered":"2024-09-15T23:20:28.205359+0000","last_unstale":"2024-09-15T23:20:28.206520+0000","last_undegraded":"2024-09-15T23:20:28.206520+0000","last_fullsized":"2024-09-15T23:20:28.206520+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:10:47.716692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.188069+0000","last_change":"2024-09-15T23:20:28.188069+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.188069+0000","last_undegraded":"2024-09-15T23:20:28.188069+0000","last_fullsized":"2024-09-15T23:20:28.188069+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.202989+0000","last_change":"2024-09-15T23:20:28.198556+0000","last_active":"2024-09-15T23:20:28.202989+0000","last_peered":"2024-09-15T23:20:28.202989+0000","last_clean":"2024-09-15T23:20:28.202989+0000","last_became_active":"2024-09-15T23:20:28.198271+0000","last_became_peered":"2024-09-15T23:20:28.198271+0000","last_unstale":"2024-09-15T23:20:28.202989+0000","last_undegraded":"2024-09-15T23:20:28.202989+0000","last_fullsized":"2024-09-15T23:20:28.202989+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:41:22.811101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.196853+0000","last_change":"2024-09-15T23:20:29.210214+0000","last_active":"2024-09-15T23:20:30.196853+0000","last_peered":"2024-09-15T23:20:30.196853+0000","last_clean":"2024-09-15T23:20:30.196853+0000","last_became_active":"2024-09-15T23:20:29.209939+0000","last_became_peered":"2024-09-15T23:20:29.209939+0000","last_unstale":"2024-09-15T23:20:30.196853+0000","last_undegraded":"2024-09-15T23:20:30.196853+0000","last_fullsized":"2024-09-15T23:20:30.196853+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:26.238986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"153'1","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513467+0000","last_change":"2024-09-15T23:20:28.200879+0000","last_active":"2024-09-15T23:20:30.513467+0000","last_peered":"2024-09-15T23:20:30.513467+0000","last_clean":"2024-09-15T23:20:30.513467+0000","last_became_active":"2024-09-15T23:20:28.200596+0000","last_became_peered":"2024-09-15T23:20:28.200596+0000","last_unstale":"2024-09-15T23:20:30.513467+0000","last_undegraded":"2024-09-15T23:20:30.513467+0000","last_fullsized":"2024-09-15T23:20:30.513467+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:35.867315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.188506+0000","last_change":"2024-09-15T23:20:28.188506+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.188506+0000","last_undegraded":"2024-09-15T23:20:28.188506+0000","last_fullsized":"2024-09-15T23:20:28.188506+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.206090+0000","last_change":"2024-09-15T23:20:28.205621+0000","last_active":"2024-09-15T23:20:28.206090+0000","last_peered":"2024-09-15T23:20:28.206090+0000","last_clean":"2024-09-15T23:20:28.206090+0000","last_became_active":"2024-09-15T23:20:28.205331+0000","last_became_peered":"2024-09-15T23:20:28.205331+0000","last_unstale":"2024-09-15T23:20:28.206090+0000","last_undegraded":"2024-09-15T23:20:28.206090+0000","last_fullsized":"2024-09-15T23:20:28.206090+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:15.636385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.196932+0000","last_change":"2024-09-15T23:20:29.204023+0000","last_active":"2024-09-15T23:20:30.196932+0000","last_peered":"2024-09-15T23:20:30.196932+0000","last_clean":"2024-09-15T23:20:30.196932+0000","last_became_active":"2024-09-15T23:20:29.203330+0000","last_became_peered":"2024-09-15T23:20:29.203330+0000","last_unstale":"2024-09-15T23:20:30.196932+0000","last_undegraded":"2024-09-15T23:20:30.196932+0000","last_fullsized":"2024-09-15T23:20:30.196932+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:17.443743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513228+0000","last_change":"2024-09-15T23:20:28.198319+0000","last_active":"2024-09-15T23:20:30.513228+0000","last_peered":"2024-09-15T23:20:30.513228+0000","last_clean":"2024-09-15T23:20:30.513228+0000","last_became_active":"2024-09-15T23:20:28.198037+0000","last_became_peered":"2024-09-15T23:20:28.198037+0000","last_unstale":"2024-09-15T23:20:30.513228+0000","last_undegraded":"2024-09-15T23:20:30.513228+0000","last_fullsized":"2024-09-15T23:20:30.513228+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:59.671879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.188220+0000","last_change":"2024-09-15T23:20:28.188220+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.188220+0000","last_undegraded":"2024-09-15T23:20:28.188220+0000","last_fullsized":"2024-09-15T23:20:28.188220+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.203696+0000","last_change":"2024-09-15T23:20:28.202458+0000","last_active":"2024-09-15T23:20:28.203696+0000","last_peered":"2024-09-15T23:20:28.203696+0000","last_clean":"2024-09-15T23:20:28.203696+0000","last_became_active":"2024-09-15T23:20:28.201758+0000","last_became_peered":"2024-09-15T23:20:28.201758+0000","last_unstale":"2024-09-15T23:20:28.203696+0000","last_undegraded":"2024-09-15T23:20:28.203696+0000","last_fullsized":"2024-09-15T23:20:28.203696+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:56.514873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.188793+0000","last_change":"2024-09-15T23:20:28.188793+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.188793+0000","last_undegraded":"2024-09-15T23:20:28.188793+0000","last_fullsized":"2024-09-15T23:20:28.188793+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513715+0000","last_change":"2024-09-15T23:20:28.201994+0000","last_active":"2024-09-15T23:20:30.513715+0000","last_peered":"2024-09-15T23:20:30.513715+0000","last_clean":"2024-09-15T23:20:30.513715+0000","last_became_active":"2024-09-15T23:20:28.201732+0000","last_became_peered":"2024-09-15T23:20:28.201732+0000","last_unstale":"2024-09-15T23:20:30.513715+0000","last_undegraded":"2024-09-15T23:20:30.513715+0000","last_fullsized":"2024-09-15T23:20:30.513715+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:20:04.106407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.190214+0000","last_change":"2024-09-15T23:20:28.190214+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.190214+0000","last_undegraded":"2024-09-15T23:20:28.190214+0000","last_fullsized":"2024-09-15T23:20:28.190214+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.204610+0000","last_change":"2024-09-15T23:20:28.203405+0000","last_active":"2024-09-15T23:20:28.204610+0000","last_peered":"2024-09-15T23:20:28.204610+0000","last_clean":"2024-09-15T23:20:28.204610+0000","last_became_active":"2024-09-15T23:20:28.203089+0000","last_became_peered":"2024-09-15T23:20:28.203089+0000","last_unstale":"2024-09-15T23:20:28.204610+0000","last_undegraded":"2024-09-15T23:20:28.204610+0000","last_fullsized":"2024-09-15T23:20:28.204610+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:10.923587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478179+0000","last_change":"2024-09-15T23:20:29.203940+0000","last_active":"2024-09-15T23:20:30.478179+0000","last_peered":"2024-09-15T23:20:30.478179+0000","last_clean":"2024-09-15T23:20:30.478179+0000","last_became_active":"2024-09-15T23:20:29.203654+0000","last_became_peered":"2024-09-15T23:20:29.203654+0000","last_unstale":"2024-09-15T23:20:30.478179+0000","last_undegraded":"2024-09-15T23:20:30.478179+0000","last_fullsized":"2024-09-15T23:20:30.478179+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:44.170339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.14","version":"153'6","reported_seq":20,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478124+0000","last_change":"2024-09-15T23:20:28.198498+0000","last_active":"2024-09-15T23:20:30.478124+0000","last_peered":"2024-09-15T23:20:30.478124+0000","last_clean":"2024-09-15T23:20:30.478124+0000","last_became_active":"2024-09-15T23:20:28.198171+0000","last_became_peered":"2024-09-15T23:20:28.198171+0000","last_unstale":"2024-09-15T23:20:30.478124+0000","last_undegraded":"2024-09-15T23:20:30.478124+0000","last_fullsized":"2024-09-15T23:20:30.478124+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:40:08.921301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.187686+0000","last_change":"2024-09-15T23:20:28.187686+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.187686+0000","last_undegraded":"2024-09-15T23:20:28.187686+0000","last_fullsized":"2024-09-15T23:20:28.187686+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.203650+0000","last_change":"2024-09-15T23:20:28.201858+0000","last_active":"2024-09-15T23:20:28.203650+0000","last_peered":"2024-09-15T23:20:28.203650+0000","last_clean":"2024-09-15T23:20:28.203650+0000","last_became_active":"2024-09-15T23:20:28.201575+0000","last_became_peered":"2024-09-15T23:20:28.201575+0000","last_unstale":"2024-09-15T23:20:28.203650+0000","last_undegraded":"2024-09-15T23:20:28.203650+0000","last_fullsized":"2024-09-15T23:20:28.203650+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:26.414992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513779+0000","last_change":"2024-09-15T23:20:29.203263+0000","last_active":"2024-09-15T23:20:30.513779+0000","last_peered":"2024-09-15T23:20:30.513779+0000","last_clean":"2024-09-15T23:20:30.513779+0000","last_became_active":"2024-09-15T23:20:29.202940+0000","last_became_peered":"2024-09-15T23:20:29.202940+0000","last_unstale":"2024-09-15T23:20:30.513779+0000","last_undegraded":"2024-09-15T23:20:30.513779+0000","last_fullsized":"2024-09-15T23:20:30.513779+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:52:28.550373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.203071+0000","last_change":"2024-09-15T23:20:28.200080+0000","last_active":"2024-09-15T23:20:28.203071+0000","last_peered":"2024-09-15T23:20:28.203071+0000","last_clean":"2024-09-15T23:20:28.203071+0000","last_became_active":"2024-09-15T23:20:28.199794+0000","last_became_peered":"2024-09-15T23:20:28.199794+0000","last_unstale":"2024-09-15T23:20:28.203071+0000","last_undegraded":"2024-09-15T23:20:28.203071+0000","last_fullsized":"2024-09-15T23:20:28.203071+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:34.681060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.188239+0000","last_change":"2024-09-15T23:20:28.188239+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.188239+0000","last_undegraded":"2024-09-15T23:20:28.188239+0000","last_fullsized":"2024-09-15T23:20:28.188239+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197059+0000","last_change":"2024-09-15T23:20:28.198797+0000","last_active":"2024-09-15T23:20:30.197059+0000","last_peered":"2024-09-15T23:20:30.197059+0000","last_clean":"2024-09-15T23:20:30.197059+0000","last_became_active":"2024-09-15T23:20:28.198191+0000","last_became_peered":"2024-09-15T23:20:28.198191+0000","last_unstale":"2024-09-15T23:20:30.197059+0000","last_undegraded":"2024-09-15T23:20:30.197059+0000","last_fullsized":"2024-09-15T23:20:30.197059+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:07.972958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.187705+0000","last_change":"2024-09-15T23:20:28.187705+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.187705+0000","last_undegraded":"2024-09-15T23:20:28.187705+0000","last_fullsized":"2024-09-15T23:20:28.187705+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.10","version":"153'8","reported_seq":22,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513958+0000","last_change":"2024-09-15T23:20:28.200011+0000","last_active":"2024-09-15T23:20:30.513958+0000","last_peered":"2024-09-15T23:20:30.513958+0000","last_clean":"2024-09-15T23:20:30.513958+0000","last_became_active":"2024-09-15T23:20:28.199751+0000","last_became_peered":"2024-09-15T23:20:28.199751+0000","last_unstale":"2024-09-15T23:20:30.513958+0000","last_undegraded":"2024-09-15T23:20:30.513958+0000","last_fullsized":"2024-09-15T23:20:30.513958+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:47:17.451917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.192616+0000","last_change":"2024-09-15T23:20:28.192616+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.192616+0000","last_undegraded":"2024-09-15T23:20:28.192616+0000","last_fullsized":"2024-09-15T23:20:28.192616+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.201043+0000","last_change":"2024-09-15T23:20:28.200278+0000","last_active":"2024-09-15T23:20:28.201043+0000","last_peered":"2024-09-15T23:20:28.201043+0000","last_clean":"2024-09-15T23:20:28.201043+0000","last_became_active":"2024-09-15T23:20:28.200010+0000","last_became_peered":"2024-09-15T23:20:28.200010+0000","last_unstale":"2024-09-15T23:20:28.201043+0000","last_undegraded":"2024-09-15T23:20:28.201043+0000","last_fullsized":"2024-09-15T23:20:28.201043+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:25.236703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197368+0000","last_change":"2024-09-15T23:20:29.202536+0000","last_active":"2024-09-15T23:20:30.197368+0000","last_peered":"2024-09-15T23:20:30.197368+0000","last_clean":"2024-09-15T23:20:30.197368+0000","last_became_active":"2024-09-15T23:20:29.202017+0000","last_became_peered":"2024-09-15T23:20:29.202017+0000","last_unstale":"2024-09-15T23:20:30.197368+0000","last_undegraded":"2024-09-15T23:20:30.197368+0000","last_fullsized":"2024-09-15T23:20:30.197368+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:13.973671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.e","version":"153'2","reported_seq":16,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.514068+0000","last_change":"2024-09-15T23:20:28.203185+0000","last_active":"2024-09-15T23:20:30.514068+0000","last_peered":"2024-09-15T23:20:30.514068+0000","last_clean":"2024-09-15T23:20:30.514068+0000","last_became_active":"2024-09-15T23:20:28.202696+0000","last_became_peered":"2024-09-15T23:20:28.202696+0000","last_unstale":"2024-09-15T23:20:30.514068+0000","last_undegraded":"2024-09-15T23:20:30.514068+0000","last_fullsized":"2024-09-15T23:20:30.514068+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:40.388412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.192160+0000","last_change":"2024-09-15T23:20:28.192160+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.192160+0000","last_undegraded":"2024-09-15T23:20:28.192160+0000","last_fullsized":"2024-09-15T23:20:28.192160+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.d","version":"153'1","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478240+0000","last_change":"2024-09-15T23:20:28.201741+0000","last_active":"2024-09-15T23:20:30.478240+0000","last_peered":"2024-09-15T23:20:30.478240+0000","last_clean":"2024-09-15T23:20:30.478240+0000","last_became_active":"2024-09-15T23:20:28.201472+0000","last_became_peered":"2024-09-15T23:20:28.201472+0000","last_unstale":"2024-09-15T23:20:30.478240+0000","last_undegraded":"2024-09-15T23:20:30.478240+0000","last_fullsized":"2024-09-15T23:20:30.478240+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:37:13.277973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513650+0000","last_change":"2024-09-15T23:20:29.197136+0000","last_active":"2024-09-15T23:20:30.513650+0000","last_peered":"2024-09-15T23:20:30.513650+0000","last_clean":"2024-09-15T23:20:30.513650+0000","last_became_active":"2024-09-15T23:20:29.196233+0000","last_became_peered":"2024-09-15T23:20:29.196233+0000","last_unstale":"2024-09-15T23:20:30.513650+0000","last_undegraded":"2024-09-15T23:20:30.513650+0000","last_fullsized":"2024-09-15T23:20:30.513650+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:19.380894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197385+0000","last_change":"2024-09-15T23:20:28.199993+0000","last_active":"2024-09-15T23:20:30.197385+0000","last_peered":"2024-09-15T23:20:30.197385+0000","last_clean":"2024-09-15T23:20:30.197385+0000","last_became_active":"2024-09-15T23:20:28.199722+0000","last_became_peered":"2024-09-15T23:20:28.199722+0000","last_unstale":"2024-09-15T23:20:30.197385+0000","last_undegraded":"2024-09-15T23:20:30.197385+0000","last_fullsized":"2024-09-15T23:20:30.197385+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:14.668959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.190400+0000","last_change":"2024-09-15T23:20:28.190400+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.190400+0000","last_undegraded":"2024-09-15T23:20:28.190400+0000","last_fullsized":"2024-09-15T23:20:28.190400+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.b","version":"153'2","reported_seq":16,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513462+0000","last_change":"2024-09-15T23:20:28.205673+0000","last_active":"2024-09-15T23:20:30.513462+0000","last_peered":"2024-09-15T23:20:30.513462+0000","last_clean":"2024-09-15T23:20:30.513462+0000","last_became_active":"2024-09-15T23:20:28.205339+0000","last_became_peered":"2024-09-15T23:20:28.205339+0000","last_unstale":"2024-09-15T23:20:30.513462+0000","last_undegraded":"2024-09-15T23:20:30.513462+0000","last_fullsized":"2024-09-15T23:20:30.513462+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:35:31.432270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.196960+0000","last_change":"2024-09-15T23:20:29.202170+0000","last_active":"2024-09-15T23:20:30.196960+0000","last_peered":"2024-09-15T23:20:30.196960+0000","last_clean":"2024-09-15T23:20:30.196960+0000","last_became_active":"2024-09-15T23:20:29.201829+0000","last_became_peered":"2024-09-15T23:20:29.201829+0000","last_unstale":"2024-09-15T23:20:30.196960+0000","last_undegraded":"2024-09-15T23:20:30.196960+0000","last_fullsized":"2024-09-15T23:20:30.196960+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:55.770178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.200742+0000","last_change":"2024-09-15T23:20:28.199768+0000","last_active":"2024-09-15T23:20:28.200742+0000","last_peered":"2024-09-15T23:20:28.200742+0000","last_clean":"2024-09-15T23:20:28.200742+0000","last_became_active":"2024-09-15T23:20:28.199473+0000","last_became_peered":"2024-09-15T23:20:28.199473+0000","last_unstale":"2024-09-15T23:20:28.200742+0000","last_undegraded":"2024-09-15T23:20:28.200742+0000","last_fullsized":"2024-09-15T23:20:28.200742+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:20.928378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.190182+0000","last_change":"2024-09-15T23:20:28.190182+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.190182+0000","last_undegraded":"2024-09-15T23:20:28.190182+0000","last_fullsized":"2024-09-15T23:20:28.190182+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.202141+0000","last_change":"2024-09-15T23:20:28.201036+0000","last_active":"2024-09-15T23:20:28.202141+0000","last_peered":"2024-09-15T23:20:28.202141+0000","last_clean":"2024-09-15T23:20:28.202141+0000","last_became_active":"2024-09-15T23:20:28.200548+0000","last_became_peered":"2024-09-15T23:20:28.200548+0000","last_unstale":"2024-09-15T23:20:28.202141+0000","last_undegraded":"2024-09-15T23:20:28.202141+0000","last_fullsized":"2024-09-15T23:20:28.202141+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:16.441460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.196771+0000","last_change":"2024-09-15T23:20:29.211822+0000","last_active":"2024-09-15T23:20:30.196771+0000","last_peered":"2024-09-15T23:20:30.196771+0000","last_clean":"2024-09-15T23:20:30.196771+0000","last_became_active":"2024-09-15T23:20:29.211561+0000","last_became_peered":"2024-09-15T23:20:29.211561+0000","last_unstale":"2024-09-15T23:20:30.196771+0000","last_undegraded":"2024-09-15T23:20:30.196771+0000","last_fullsized":"2024-09-15T23:20:30.196771+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:21.930661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.200766+0000","last_change":"2024-09-15T23:20:28.196801+0000","last_active":"2024-09-15T23:20:28.200766+0000","last_peered":"2024-09-15T23:20:28.200766+0000","last_clean":"2024-09-15T23:20:28.200766+0000","last_became_active":"2024-09-15T23:20:28.195532+0000","last_became_peered":"2024-09-15T23:20:28.195532+0000","last_unstale":"2024-09-15T23:20:28.200766+0000","last_undegraded":"2024-09-15T23:20:28.200766+0000","last_fullsized":"2024-09-15T23:20:28.200766+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:07.798365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.187873+0000","last_change":"2024-09-15T23:20:28.187873+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.187873+0000","last_undegraded":"2024-09-15T23:20:28.187873+0000","last_fullsized":"2024-09-15T23:20:28.187873+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.200762+0000","last_change":"2024-09-15T23:20:28.197581+0000","last_active":"2024-09-15T23:20:28.200762+0000","last_peered":"2024-09-15T23:20:28.200762+0000","last_clean":"2024-09-15T23:20:28.200762+0000","last_became_active":"2024-09-15T23:20:28.197295+0000","last_became_peered":"2024-09-15T23:20:28.197295+0000","last_unstale":"2024-09-15T23:20:28.200762+0000","last_undegraded":"2024-09-15T23:20:28.200762+0000","last_fullsized":"2024-09-15T23:20:28.200762+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:09:07.949948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.189180+0000","last_change":"2024-09-15T23:20:28.189180+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.189180+0000","last_undegraded":"2024-09-15T23:20:28.189180+0000","last_fullsized":"2024-09-15T23:20:28.189180+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.6","version":"153'1","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197269+0000","last_change":"2024-09-15T23:20:28.201563+0000","last_active":"2024-09-15T23:20:30.197269+0000","last_peered":"2024-09-15T23:20:30.197269+0000","last_clean":"2024-09-15T23:20:30.197269+0000","last_became_active":"2024-09-15T23:20:28.201200+0000","last_became_peered":"2024-09-15T23:20:28.201200+0000","last_unstale":"2024-09-15T23:20:30.197269+0000","last_undegraded":"2024-09-15T23:20:30.197269+0000","last_fullsized":"2024-09-15T23:20:30.197269+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:33:08.209152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513913+0000","last_change":"2024-09-15T23:20:29.206055+0000","last_active":"2024-09-15T23:20:30.513913+0000","last_peered":"2024-09-15T23:20:30.513913+0000","last_clean":"2024-09-15T23:20:30.513913+0000","last_became_active":"2024-09-15T23:20:29.205752+0000","last_became_peered":"2024-09-15T23:20:29.205752+0000","last_unstale":"2024-09-15T23:20:30.513913+0000","last_undegraded":"2024-09-15T23:20:30.513913+0000","last_fullsized":"2024-09-15T23:20:30.513913+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:41.418218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478260+0000","last_change":"2024-09-15T23:20:28.198508+0000","last_active":"2024-09-15T23:20:30.478260+0000","last_peered":"2024-09-15T23:20:30.478260+0000","last_clean":"2024-09-15T23:20:30.478260+0000","last_became_active":"2024-09-15T23:20:28.198223+0000","last_became_peered":"2024-09-15T23:20:28.198223+0000","last_unstale":"2024-09-15T23:20:30.478260+0000","last_undegraded":"2024-09-15T23:20:30.478260+0000","last_fullsized":"2024-09-15T23:20:30.478260+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:08.445349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513338+0000","last_change":"2024-09-15T23:20:29.210818+0000","last_active":"2024-09-15T23:20:30.513338+0000","last_peered":"2024-09-15T23:20:30.513338+0000","last_clean":"2024-09-15T23:20:30.513338+0000","last_became_active":"2024-09-15T23:20:29.210535+0000","last_became_peered":"2024-09-15T23:20:29.210535+0000","last_unstale":"2024-09-15T23:20:30.513338+0000","last_undegraded":"2024-09-15T23:20:30.513338+0000","last_fullsized":"2024-09-15T23:20:30.513338+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:19.504434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478169+0000","last_change":"2024-09-15T23:20:28.198348+0000","last_active":"2024-09-15T23:20:30.478169+0000","last_peered":"2024-09-15T23:20:30.478169+0000","last_clean":"2024-09-15T23:20:30.478169+0000","last_became_active":"2024-09-15T23:20:28.198008+0000","last_became_peered":"2024-09-15T23:20:28.198008+0000","last_unstale":"2024-09-15T23:20:30.478169+0000","last_undegraded":"2024-09-15T23:20:30.478169+0000","last_fullsized":"2024-09-15T23:20:30.478169+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:02.473781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478031+0000","last_change":"2024-09-15T23:20:29.198415+0000","last_active":"2024-09-15T23:20:30.478031+0000","last_peered":"2024-09-15T23:20:30.478031+0000","last_clean":"2024-09-15T23:20:30.478031+0000","last_became_active":"2024-09-15T23:20:29.197633+0000","last_became_peered":"2024-09-15T23:20:29.197633+0000","last_unstale":"2024-09-15T23:20:30.478031+0000","last_undegraded":"2024-09-15T23:20:30.478031+0000","last_fullsized":"2024-09-15T23:20:30.478031+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:57:53.269720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.196904+0000","last_change":"2024-09-15T23:20:28.200763+0000","last_active":"2024-09-15T23:20:30.196904+0000","last_peered":"2024-09-15T23:20:30.196904+0000","last_clean":"2024-09-15T23:20:30.196904+0000","last_became_active":"2024-09-15T23:20:28.200468+0000","last_became_peered":"2024-09-15T23:20:28.200468+0000","last_unstale":"2024-09-15T23:20:30.196904+0000","last_undegraded":"2024-09-15T23:20:30.196904+0000","last_fullsized":"2024-09-15T23:20:30.196904+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:17:09.912049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.188057+0000","last_change":"2024-09-15T23:20:28.188057+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.188057+0000","last_undegraded":"2024-09-15T23:20:28.188057+0000","last_fullsized":"2024-09-15T23:20:28.188057+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.203773+0000","last_change":"2024-09-15T23:20:28.202777+0000","last_active":"2024-09-15T23:20:28.203773+0000","last_peered":"2024-09-15T23:20:28.203773+0000","last_clean":"2024-09-15T23:20:28.203773+0000","last_became_active":"2024-09-15T23:20:28.200455+0000","last_became_peered":"2024-09-15T23:20:28.200455+0000","last_unstale":"2024-09-15T23:20:28.203773+0000","last_undegraded":"2024-09-15T23:20:28.203773+0000","last_fullsized":"2024-09-15T23:20:28.203773+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:35:43.619546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.187770+0000","last_change":"2024-09-15T23:20:28.187770+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.187770+0000","last_undegraded":"2024-09-15T23:20:28.187770+0000","last_fullsized":"2024-09-15T23:20:28.187770+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.195144+0000","last_change":"2024-09-15T23:20:28.194389+0000","last_active":"2024-09-15T23:20:28.195144+0000","last_peered":"2024-09-15T23:20:28.195144+0000","last_clean":"2024-09-15T23:20:28.195144+0000","last_became_active":"2024-09-15T23:20:28.194128+0000","last_became_peered":"2024-09-15T23:20:28.194128+0000","last_unstale":"2024-09-15T23:20:28.195144+0000","last_undegraded":"2024-09-15T23:20:28.195144+0000","last_fullsized":"2024-09-15T23:20:28.195144+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:47:19.506387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.192137+0000","last_change":"2024-09-15T23:20:28.192137+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.192137+0000","last_undegraded":"2024-09-15T23:20:28.192137+0000","last_fullsized":"2024-09-15T23:20:28.192137+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513085+0000","last_change":"2024-09-15T23:20:28.205782+0000","last_active":"2024-09-15T23:20:30.513085+0000","last_peered":"2024-09-15T23:20:30.513085+0000","last_clean":"2024-09-15T23:20:30.513085+0000","last_became_active":"2024-09-15T23:20:28.205426+0000","last_became_peered":"2024-09-15T23:20:28.205426+0000","last_unstale":"2024-09-15T23:20:30.513085+0000","last_undegraded":"2024-09-15T23:20:30.513085+0000","last_fullsized":"2024-09-15T23:20:30.513085+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:05:46.878996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478039+0000","last_change":"2024-09-15T23:20:29.199433+0000","last_active":"2024-09-15T23:20:30.478039+0000","last_peered":"2024-09-15T23:20:30.478039+0000","last_clean":"2024-09-15T23:20:30.478039+0000","last_became_active":"2024-09-15T23:20:29.198927+0000","last_became_peered":"2024-09-15T23:20:29.198927+0000","last_unstale":"2024-09-15T23:20:30.478039+0000","last_undegraded":"2024-09-15T23:20:30.478039+0000","last_fullsized":"2024-09-15T23:20:30.478039+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:40:14.188975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.197934+0000","last_change":"2024-09-15T23:20:28.197023+0000","last_active":"2024-09-15T23:20:28.197934+0000","last_peered":"2024-09-15T23:20:28.197934+0000","last_clean":"2024-09-15T23:20:28.197934+0000","last_became_active":"2024-09-15T23:20:28.196602+0000","last_became_peered":"2024-09-15T23:20:28.196602+0000","last_unstale":"2024-09-15T23:20:28.197934+0000","last_undegraded":"2024-09-15T23:20:28.197934+0000","last_fullsized":"2024-09-15T23:20:28.197934+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:34.004979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":412,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.195204+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:20:28.195204+0000","last_peered":"2024-09-15T23:20:28.195204+0000","last_clean":"2024-09-15T23:20:28.195204+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:20:28.195204+0000","last_undegraded":"2024-09-15T23:20:28.195204+0000","last_fullsized":"2024-09-15T23:20:28.195204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":1682,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":4022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51084,"kb_used_data":1844,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320756,"statfs":{"total":96636764160,"available":96584454144,"internally_reserved":0,"allocated":1888256,"data_stored":832212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476840,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51068,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320772,"statfs":{"total":96636764160,"available":96584470528,"internally_reserved":0,"allocated":1875968,"data_stored":825937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476842,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47504,"kb_used_data":2424,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324336,"statfs":{"total":96636764160,"available":96588120064,"internally_reserved":0,"allocated":2482176,"data_stored":1422580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476842,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41344,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330496,"statfs":{"total":96636764160,"available":96594427904,"internally_reserved":0,"allocated":1875968,"data_stored":825937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542249,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28900,"kb_used_data":1868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342940,"statfs":{"total":96636764160,"available":96607170560,"internally_reserved":0,"allocated":1912832,"data_stored":845287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542249,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51108,"kb_used_data":1868,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320732,"statfs":{"total":96636764160,"available":96584429568,"internally_reserved":0,"allocated":1912832,"data_stored":845287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542248,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55876,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315964,"statfs":{"total":96636764160,"available":96579547136,"internally_reserved":0,"allocated":2531328,"data_stored":1437461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542250,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51132,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320708,"statfs":{"total":96636764160,"available":96584404992,"internally_reserved":0,"allocated":1933312,"data_stored":847503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:20:32.901 INFO:tasks.ceph.ceph_manager.ceph:PG 21.3d is not active+clean 2024-09-15T23:20:32.901 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 152, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:20:28.192718+0000', 'last_change': '2024-09-15T23:20:28.192718+0000', 'last_active': '2024-09-15T23:20:28.179054+0000', 'last_peered': '2024-09-15T23:20:28.179054+0000', 'last_clean': '2024-09-15T23:20:28.179054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:20:28.192718+0000', 'last_undegraded': '2024-09-15T23:20:28.192718+0000', 'last_fullsized': '2024-09-15T23:20:28.192718+0000', 'mapping_epoch': 152, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 152, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_clean_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:20:32.901 INFO:tasks.ceph.ceph_manager.ceph:PG 21.3c is not active+clean 2024-09-15T23:20:32.902 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 152, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:20:28.187613+0000', 'last_change': '2024-09-15T23:20:28.187613+0000', 'last_active': '2024-09-15T23:20:28.179054+0000', 'last_peered': '2024-09-15T23:20:28.179054+0000', 'last_clean': '2024-09-15T23:20:28.179054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:20:28.187613+0000', 'last_undegraded': '2024-09-15T23:20:28.187613+0000', 'last_fullsized': '2024-09-15T23:20:28.187613+0000', 'mapping_epoch': 152, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 152, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_clean_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:20:32.902 INFO:tasks.ceph.ceph_manager.ceph:PG 21.3b is not active+clean 2024-09-15T23:20:32.902 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 152, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:20:28.193283+0000', 'last_change': '2024-09-15T23:20:28.193283+0000', 'last_active': '2024-09-15T23:20:28.179054+0000', 'last_peered': '2024-09-15T23:20:28.179054+0000', 'last_clean': '2024-09-15T23:20:28.179054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:20:28.193283+0000', 'last_undegraded': '2024-09-15T23:20:28.193283+0000', 'last_fullsized': '2024-09-15T23:20:28.193283+0000', 'mapping_epoch': 152, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 152, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_clean_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:20:32.902 INFO:tasks.ceph.ceph_manager.ceph:PG 21.36 is not active+clean 2024-09-15T23:20:32.902 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 152, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:20:28.194528+0000', 'last_change': '2024-09-15T23:20:28.194528+0000', 'last_active': '2024-09-15T23:20:28.179054+0000', 'last_peered': '2024-09-15T23:20:28.179054+0000', 'last_clean': '2024-09-15T23:20:28.179054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:20:28.194528+0000', 'last_undegraded': '2024-09-15T23:20:28.194528+0000', 'last_fullsized': '2024-09-15T23:20:28.194528+0000', 'mapping_epoch': 152, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 152, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_clean_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:20:32.902 INFO:tasks.ceph.ceph_manager.ceph:PG 21.34 is not active+clean 2024-09-15T23:20:32.902 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 152, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:20:28.191371+0000', 'last_change': '2024-09-15T23:20:28.191371+0000', 'last_active': '2024-09-15T23:20:28.179054+0000', 'last_peered': '2024-09-15T23:20:28.179054+0000', 'last_clean': '2024-09-15T23:20:28.179054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:20:28.191371+0000', 'last_undegraded': '2024-09-15T23:20:28.191371+0000', 'last_fullsized': '2024-09-15T23:20:28.191371+0000', 'mapping_epoch': 152, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 152, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_clean_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:20:32.902 INFO:tasks.ceph.ceph_manager.ceph:PG 21.33 is not active+clean 2024-09-15T23:20:32.902 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 152, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:20:28.192883+0000', 'last_change': '2024-09-15T23:20:28.192883+0000', 'last_active': '2024-09-15T23:20:28.179054+0000', 'last_peered': '2024-09-15T23:20:28.179054+0000', 'last_clean': '2024-09-15T23:20:28.179054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:20:28.192883+0000', 'last_undegraded': '2024-09-15T23:20:28.192883+0000', 'last_fullsized': '2024-09-15T23:20:28.192883+0000', 'mapping_epoch': 152, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 152, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_clean_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:20:32.902 INFO:tasks.ceph.ceph_manager.ceph:PG 21.32 is not active+clean 2024-09-15T23:20:32.902 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 152, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:20:28.192133+0000', 'last_change': '2024-09-15T23:20:28.192133+0000', 'last_active': '2024-09-15T23:20:28.179054+0000', 'last_peered': '2024-09-15T23:20:28.179054+0000', 'last_clean': '2024-09-15T23:20:28.179054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:20:28.192133+0000', 'last_undegraded': '2024-09-15T23:20:28.192133+0000', 'last_fullsized': '2024-09-15T23:20:28.192133+0000', 'mapping_epoch': 152, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 152, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_clean_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:20:32.903 INFO:tasks.ceph.ceph_manager.ceph:PG 21.31 is not active+clean 2024-09-15T23:20:32.903 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 152, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:20:28.192587+0000', 'last_change': '2024-09-15T23:20:28.192587+0000', 'last_active': '2024-09-15T23:20:28.179054+0000', 'last_peered': '2024-09-15T23:20:28.179054+0000', 'last_clean': '2024-09-15T23:20:28.179054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:20:28.192587+0000', 'last_undegraded': '2024-09-15T23:20:28.192587+0000', 'last_fullsized': '2024-09-15T23:20:28.192587+0000', 'mapping_epoch': 152, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 152, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_clean_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:20:32.903 INFO:tasks.ceph.ceph_manager.ceph:PG 21.2f is not active+clean 2024-09-15T23:20:32.903 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 152, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:20:28.192631+0000', 'last_change': '2024-09-15T23:20:28.192631+0000', 'last_active': '2024-09-15T23:20:28.179054+0000', 'last_peered': '2024-09-15T23:20:28.179054+0000', 'last_clean': '2024-09-15T23:20:28.179054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:20:28.192631+0000', 'last_undegraded': '2024-09-15T23:20:28.192631+0000', 'last_fullsized': '2024-09-15T23:20:28.192631+0000', 'mapping_epoch': 152, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 152, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_clean_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:20:32.903 INFO:tasks.ceph.ceph_manager.ceph:PG 21.2e is not active+clean 2024-09-15T23:20:32.903 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 152, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:20:28.194250+0000', 'last_change': '2024-09-15T23:20:28.194250+0000', 'last_active': '2024-09-15T23:20:28.179054+0000', 'last_peered': '2024-09-15T23:20:28.179054+0000', 'last_clean': '2024-09-15T23:20:28.179054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:20:28.194250+0000', 'last_undegraded': '2024-09-15T23:20:28.194250+0000', 'last_fullsized': '2024-09-15T23:20:28.194250+0000', 'mapping_epoch': 152, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 152, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_clean_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:20:32.903 INFO:tasks.ceph.ceph_manager.ceph:PG 21.2b is not active+clean 2024-09-15T23:20:32.903 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 152, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:20:28.194524+0000', 'last_change': '2024-09-15T23:20:28.194524+0000', 'last_active': '2024-09-15T23:20:28.179054+0000', 'last_peered': '2024-09-15T23:20:28.179054+0000', 'last_clean': '2024-09-15T23:20:28.179054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:20:28.194524+0000', 'last_undegraded': '2024-09-15T23:20:28.194524+0000', 'last_fullsized': '2024-09-15T23:20:28.194524+0000', 'mapping_epoch': 152, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 152, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_clean_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:20:32.903 INFO:tasks.ceph.ceph_manager.ceph:PG 21.2a is not active+clean 2024-09-15T23:20:32.903 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 152, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:20:28.191712+0000', 'last_change': '2024-09-15T23:20:28.191712+0000', 'last_active': '2024-09-15T23:20:28.179054+0000', 'last_peered': '2024-09-15T23:20:28.179054+0000', 'last_clean': '2024-09-15T23:20:28.179054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:20:28.191712+0000', 'last_undegraded': '2024-09-15T23:20:28.191712+0000', 'last_fullsized': '2024-09-15T23:20:28.191712+0000', 'mapping_epoch': 152, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 152, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_clean_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:20:32.903 INFO:tasks.ceph.ceph_manager.ceph:PG 21.29 is not active+clean 2024-09-15T23:20:32.904 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 152, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:20:28.189185+0000', 'last_change': '2024-09-15T23:20:28.189185+0000', 'last_active': '2024-09-15T23:20:28.179054+0000', 'last_peered': '2024-09-15T23:20:28.179054+0000', 'last_clean': '2024-09-15T23:20:28.179054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:20:28.189185+0000', 'last_undegraded': '2024-09-15T23:20:28.189185+0000', 'last_fullsized': '2024-09-15T23:20:28.189185+0000', 'mapping_epoch': 152, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 152, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_clean_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:20:32.904 INFO:tasks.ceph.ceph_manager.ceph:PG 21.28 is not active+clean 2024-09-15T23:20:32.904 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 152, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:20:28.191495+0000', 'last_change': '2024-09-15T23:20:28.191495+0000', 'last_active': '2024-09-15T23:20:28.179054+0000', 'last_peered': '2024-09-15T23:20:28.179054+0000', 'last_clean': '2024-09-15T23:20:28.179054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:20:28.191495+0000', 'last_undegraded': '2024-09-15T23:20:28.191495+0000', 'last_fullsized': '2024-09-15T23:20:28.191495+0000', 'mapping_epoch': 152, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 152, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_clean_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:20:32.904 INFO:tasks.ceph.ceph_manager.ceph:PG 21.22 is not active+clean 2024-09-15T23:20:32.904 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 152, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:20:28.191210+0000', 'last_change': '2024-09-15T23:20:28.191210+0000', 'last_active': '2024-09-15T23:20:28.179054+0000', 'last_peered': '2024-09-15T23:20:28.179054+0000', 'last_clean': '2024-09-15T23:20:28.179054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:20:28.191210+0000', 'last_undegraded': '2024-09-15T23:20:28.191210+0000', 'last_fullsized': '2024-09-15T23:20:28.191210+0000', 'mapping_epoch': 152, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 152, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_clean_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:20:32.904 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1e is not active+clean 2024-09-15T23:20:32.904 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 152, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:20:28.193376+0000', 'last_change': '2024-09-15T23:20:28.193376+0000', 'last_active': '2024-09-15T23:20:28.179054+0000', 'last_peered': '2024-09-15T23:20:28.179054+0000', 'last_clean': '2024-09-15T23:20:28.179054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:20:28.193376+0000', 'last_undegraded': '2024-09-15T23:20:28.193376+0000', 'last_fullsized': '2024-09-15T23:20:28.193376+0000', 'mapping_epoch': 152, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 152, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_clean_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:20:32.904 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1d is not active+clean 2024-09-15T23:20:32.904 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 152, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:20:28.188069+0000', 'last_change': '2024-09-15T23:20:28.188069+0000', 'last_active': '2024-09-15T23:20:28.179054+0000', 'last_peered': '2024-09-15T23:20:28.179054+0000', 'last_clean': '2024-09-15T23:20:28.179054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:20:28.188069+0000', 'last_undegraded': '2024-09-15T23:20:28.188069+0000', 'last_fullsized': '2024-09-15T23:20:28.188069+0000', 'mapping_epoch': 152, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 152, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_clean_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:20:32.904 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1b is not active+clean 2024-09-15T23:20:32.905 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 152, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:20:28.188506+0000', 'last_change': '2024-09-15T23:20:28.188506+0000', 'last_active': '2024-09-15T23:20:28.179054+0000', 'last_peered': '2024-09-15T23:20:28.179054+0000', 'last_clean': '2024-09-15T23:20:28.179054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:20:28.188506+0000', 'last_undegraded': '2024-09-15T23:20:28.188506+0000', 'last_fullsized': '2024-09-15T23:20:28.188506+0000', 'mapping_epoch': 152, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 152, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_clean_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:20:32.905 INFO:tasks.ceph.ceph_manager.ceph:PG 21.19 is not active+clean 2024-09-15T23:20:32.905 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 152, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:20:28.188220+0000', 'last_change': '2024-09-15T23:20:28.188220+0000', 'last_active': '2024-09-15T23:20:28.179054+0000', 'last_peered': '2024-09-15T23:20:28.179054+0000', 'last_clean': '2024-09-15T23:20:28.179054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:20:28.188220+0000', 'last_undegraded': '2024-09-15T23:20:28.188220+0000', 'last_fullsized': '2024-09-15T23:20:28.188220+0000', 'mapping_epoch': 152, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 152, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_clean_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:20:32.905 INFO:tasks.ceph.ceph_manager.ceph:PG 21.16 is not active+clean 2024-09-15T23:20:32.905 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 152, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:20:28.188793+0000', 'last_change': '2024-09-15T23:20:28.188793+0000', 'last_active': '2024-09-15T23:20:28.179054+0000', 'last_peered': '2024-09-15T23:20:28.179054+0000', 'last_clean': '2024-09-15T23:20:28.179054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:20:28.188793+0000', 'last_undegraded': '2024-09-15T23:20:28.188793+0000', 'last_fullsized': '2024-09-15T23:20:28.188793+0000', 'mapping_epoch': 152, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 152, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_clean_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:20:32.905 INFO:tasks.ceph.ceph_manager.ceph:PG 21.17 is not active+clean 2024-09-15T23:20:32.905 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 152, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:20:28.190214+0000', 'last_change': '2024-09-15T23:20:28.190214+0000', 'last_active': '2024-09-15T23:20:28.179054+0000', 'last_peered': '2024-09-15T23:20:28.179054+0000', 'last_clean': '2024-09-15T23:20:28.179054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:20:28.190214+0000', 'last_undegraded': '2024-09-15T23:20:28.190214+0000', 'last_fullsized': '2024-09-15T23:20:28.190214+0000', 'mapping_epoch': 152, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 152, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_clean_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:20:32.905 INFO:tasks.ceph.ceph_manager.ceph:PG 21.12 is not active+clean 2024-09-15T23:20:32.905 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 152, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:20:28.187686+0000', 'last_change': '2024-09-15T23:20:28.187686+0000', 'last_active': '2024-09-15T23:20:28.179054+0000', 'last_peered': '2024-09-15T23:20:28.179054+0000', 'last_clean': '2024-09-15T23:20:28.179054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:20:28.187686+0000', 'last_undegraded': '2024-09-15T23:20:28.187686+0000', 'last_fullsized': '2024-09-15T23:20:28.187686+0000', 'mapping_epoch': 152, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 152, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_clean_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:20:32.905 INFO:tasks.ceph.ceph_manager.ceph:PG 21.10 is not active+clean 2024-09-15T23:20:32.905 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 152, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:20:28.188239+0000', 'last_change': '2024-09-15T23:20:28.188239+0000', 'last_active': '2024-09-15T23:20:28.179054+0000', 'last_peered': '2024-09-15T23:20:28.179054+0000', 'last_clean': '2024-09-15T23:20:28.179054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:20:28.188239+0000', 'last_undegraded': '2024-09-15T23:20:28.188239+0000', 'last_fullsized': '2024-09-15T23:20:28.188239+0000', 'mapping_epoch': 152, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 152, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_clean_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:20:32.906 INFO:tasks.ceph.ceph_manager.ceph:PG 21.11 is not active+clean 2024-09-15T23:20:32.906 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 152, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:20:28.187705+0000', 'last_change': '2024-09-15T23:20:28.187705+0000', 'last_active': '2024-09-15T23:20:28.179054+0000', 'last_peered': '2024-09-15T23:20:28.179054+0000', 'last_clean': '2024-09-15T23:20:28.179054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:20:28.187705+0000', 'last_undegraded': '2024-09-15T23:20:28.187705+0000', 'last_fullsized': '2024-09-15T23:20:28.187705+0000', 'mapping_epoch': 152, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 152, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_clean_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:20:32.906 INFO:tasks.ceph.ceph_manager.ceph:PG 21.e is not active+clean 2024-09-15T23:20:32.906 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 152, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:20:28.192616+0000', 'last_change': '2024-09-15T23:20:28.192616+0000', 'last_active': '2024-09-15T23:20:28.179054+0000', 'last_peered': '2024-09-15T23:20:28.179054+0000', 'last_clean': '2024-09-15T23:20:28.179054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:20:28.192616+0000', 'last_undegraded': '2024-09-15T23:20:28.192616+0000', 'last_fullsized': '2024-09-15T23:20:28.192616+0000', 'mapping_epoch': 152, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 152, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_clean_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:20:32.906 INFO:tasks.ceph.ceph_manager.ceph:PG 21.c is not active+clean 2024-09-15T23:20:32.906 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 152, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:20:28.192160+0000', 'last_change': '2024-09-15T23:20:28.192160+0000', 'last_active': '2024-09-15T23:20:28.179054+0000', 'last_peered': '2024-09-15T23:20:28.179054+0000', 'last_clean': '2024-09-15T23:20:28.179054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:20:28.192160+0000', 'last_undegraded': '2024-09-15T23:20:28.192160+0000', 'last_fullsized': '2024-09-15T23:20:28.192160+0000', 'mapping_epoch': 152, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 152, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_clean_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:20:32.906 INFO:tasks.ceph.ceph_manager.ceph:PG 21.a is not active+clean 2024-09-15T23:20:32.906 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 152, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:20:28.190400+0000', 'last_change': '2024-09-15T23:20:28.190400+0000', 'last_active': '2024-09-15T23:20:28.179054+0000', 'last_peered': '2024-09-15T23:20:28.179054+0000', 'last_clean': '2024-09-15T23:20:28.179054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:20:28.190400+0000', 'last_undegraded': '2024-09-15T23:20:28.190400+0000', 'last_fullsized': '2024-09-15T23:20:28.190400+0000', 'mapping_epoch': 152, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 152, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_clean_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:20:32.906 INFO:tasks.ceph.ceph_manager.ceph:PG 21.8 is not active+clean 2024-09-15T23:20:32.906 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 152, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:20:28.190182+0000', 'last_change': '2024-09-15T23:20:28.190182+0000', 'last_active': '2024-09-15T23:20:28.179054+0000', 'last_peered': '2024-09-15T23:20:28.179054+0000', 'last_clean': '2024-09-15T23:20:28.179054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:20:28.190182+0000', 'last_undegraded': '2024-09-15T23:20:28.190182+0000', 'last_fullsized': '2024-09-15T23:20:28.190182+0000', 'mapping_epoch': 152, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 152, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_clean_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:20:32.906 INFO:tasks.ceph.ceph_manager.ceph:PG 21.6 is not active+clean 2024-09-15T23:20:32.906 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 152, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:20:28.187873+0000', 'last_change': '2024-09-15T23:20:28.187873+0000', 'last_active': '2024-09-15T23:20:28.179054+0000', 'last_peered': '2024-09-15T23:20:28.179054+0000', 'last_clean': '2024-09-15T23:20:28.179054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:20:28.187873+0000', 'last_undegraded': '2024-09-15T23:20:28.187873+0000', 'last_fullsized': '2024-09-15T23:20:28.187873+0000', 'mapping_epoch': 152, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 152, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_clean_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:20:32.907 INFO:tasks.ceph.ceph_manager.ceph:PG 21.7 is not active+clean 2024-09-15T23:20:32.907 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 152, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:20:28.189180+0000', 'last_change': '2024-09-15T23:20:28.189180+0000', 'last_active': '2024-09-15T23:20:28.179054+0000', 'last_peered': '2024-09-15T23:20:28.179054+0000', 'last_clean': '2024-09-15T23:20:28.179054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:20:28.189180+0000', 'last_undegraded': '2024-09-15T23:20:28.189180+0000', 'last_fullsized': '2024-09-15T23:20:28.189180+0000', 'mapping_epoch': 152, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 152, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_clean_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:20:32.907 INFO:tasks.ceph.ceph_manager.ceph:PG 21.3 is not active+clean 2024-09-15T23:20:32.907 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 152, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:20:28.188057+0000', 'last_change': '2024-09-15T23:20:28.188057+0000', 'last_active': '2024-09-15T23:20:28.179054+0000', 'last_peered': '2024-09-15T23:20:28.179054+0000', 'last_clean': '2024-09-15T23:20:28.179054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:20:28.188057+0000', 'last_undegraded': '2024-09-15T23:20:28.188057+0000', 'last_fullsized': '2024-09-15T23:20:28.188057+0000', 'mapping_epoch': 152, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 152, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_clean_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:20:32.907 INFO:tasks.ceph.ceph_manager.ceph:PG 21.0 is not active+clean 2024-09-15T23:20:32.907 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 152, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:20:28.187770+0000', 'last_change': '2024-09-15T23:20:28.187770+0000', 'last_active': '2024-09-15T23:20:28.179054+0000', 'last_peered': '2024-09-15T23:20:28.179054+0000', 'last_clean': '2024-09-15T23:20:28.179054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:20:28.187770+0000', 'last_undegraded': '2024-09-15T23:20:28.187770+0000', 'last_fullsized': '2024-09-15T23:20:28.187770+0000', 'mapping_epoch': 152, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 152, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_clean_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:20:32.907 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1 is not active+clean 2024-09-15T23:20:32.907 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 152, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:20:28.192137+0000', 'last_change': '2024-09-15T23:20:28.192137+0000', 'last_active': '2024-09-15T23:20:28.179054+0000', 'last_peered': '2024-09-15T23:20:28.179054+0000', 'last_clean': '2024-09-15T23:20:28.179054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:20:28.192137+0000', 'last_undegraded': '2024-09-15T23:20:28.192137+0000', 'last_fullsized': '2024-09-15T23:20:28.192137+0000', 'mapping_epoch': 152, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 152, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'last_clean_scrub_stamp': '2024-09-15T23:20:28.179054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:20:32.908 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:20:33.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.034+0000 7f641e87b640 1 Processor -- start 2024-09-15T23:20:33.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.034+0000 7f641e87b640 1 -- start start 2024-09-15T23:20:33.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.035+0000 7f641e87b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f641815e790 0x7f6418073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:33.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.035+0000 7f641e87b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f641806f730 0x7f641806fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:33.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.035+0000 7f641e87b640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64181631c0 con 0x7f6418162c60 2024-09-15T23:20:33.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.035+0000 7f641e87b640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f641815eb70 con 0x7f641815e790 2024-09-15T23:20:33.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.035+0000 7f641e87b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f64180700c0 con 0x7f641806f730 2024-09-15T23:20:33.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.035+0000 7f6417fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f641815e790 0x7f6418073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:33.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.035+0000 7f6417fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f641815e790 0x7f6418073a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41180/0 (socket says 172.21.15.123:41180) 2024-09-15T23:20:33.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.035+0000 7f6417fff640 1 -- 172.21.15.123:0/3953451174 learned_addr learned my addr 172.21.15.123:0/3953451174 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:33.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.035+0000 7f641ce18640 1 --2- 172.21.15.123:0/3953451174 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f641806f730 0x7f641806fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:33.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.035+0000 7f6417fff640 1 -- 172.21.15.123:0/3953451174 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f641806f730 msgr2=0x7f641806fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:33.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.035+0000 7f6417fff640 1 --2- 172.21.15.123:0/3953451174 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f641806f730 0x7f641806fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:33.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.035+0000 7f6417fff640 1 -- 172.21.15.123:0/3953451174 >> v1:172.21.15.188:6789/0 conn(0x7f6418162c60 legacy=0x7f64180b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:33.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.035+0000 7f6417fff640 1 -- 172.21.15.123:0/3953451174 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64180ae9a0 con 0x7f641815e790 2024-09-15T23:20:33.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.036+0000 7f6417fff640 1 --2- 172.21.15.123:0/3953451174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f641815e790 0x7f6418073a40 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f6408009870 tx=0x7f640802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e17adced0c94dcee server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:33.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.036+0000 7f6416ffd640 1 -- 172.21.15.123:0/3953451174 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6408037070 con 0x7f641815e790 2024-09-15T23:20:33.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.036+0000 7f6416ffd640 1 -- 172.21.15.123:0/3953451174 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f640802ae10 con 0x7f641815e790 2024-09-15T23:20:33.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.036+0000 7f6416ffd640 1 -- 172.21.15.123:0/3953451174 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6408032660 con 0x7f641815e790 2024-09-15T23:20:33.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.036+0000 7f641e87b640 1 -- 172.21.15.123:0/3953451174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f641815e790 msgr2=0x7f6418073a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:33.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.036+0000 7f641e87b640 1 --2- 172.21.15.123:0/3953451174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f641815e790 0x7f6418073a40 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f6408009870 tx=0x7f640802a100 comp rx=0 tx=0).stop 2024-09-15T23:20:33.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.036+0000 7f641e87b640 1 -- 172.21.15.123:0/3953451174 shutdown_connections 2024-09-15T23:20:33.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.036+0000 7f641e87b640 1 --2- 172.21.15.123:0/3953451174 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f641806f730 0x7f641806fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:33.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.036+0000 7f641e87b640 1 --2- 172.21.15.123:0/3953451174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f641815e790 0x7f6418073a40 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:33.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.036+0000 7f641e87b640 1 -- 172.21.15.123:0/3953451174 >> 172.21.15.123:0/3953451174 conn(0x7f64180b0a80 msgr2=0x7f64180b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:33.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.037+0000 7f641e87b640 1 -- 172.21.15.123:0/3953451174 shutdown_connections 2024-09-15T23:20:33.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.037+0000 7f641e87b640 1 -- 172.21.15.123:0/3953451174 wait complete. 2024-09-15T23:20:33.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.038+0000 7f641e87b640 1 Processor -- start 2024-09-15T23:20:33.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.038+0000 7f641e87b640 1 -- start start 2024-09-15T23:20:33.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.038+0000 7f641e87b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f641806f730 0x7f6418149950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:33.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.039+0000 7f641e87b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f641815e790 0x7f6418155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:33.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.039+0000 7f641e87b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6418162c60 0x7f6418160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:33.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.039+0000 7f641e87b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f64180af200 con 0x7f641815e790 2024-09-15T23:20:33.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.039+0000 7f641e87b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f64180aef20 con 0x7f6418162c60 2024-09-15T23:20:33.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.039+0000 7f641e87b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f64180b5b40 con 0x7f641806f730 2024-09-15T23:20:33.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.039+0000 7f64177fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f641815e790 0x7f6418155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:33.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.039+0000 7f64177fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f641815e790 0x7f6418155280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41196/0 (socket says 172.21.15.123:41196) 2024-09-15T23:20:33.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.039+0000 7f64177fe640 1 -- 172.21.15.123:0/1195180195 learned_addr learned my addr 172.21.15.123:0/1195180195 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:33.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.039+0000 7f6417fff640 1 --2- 172.21.15.123:0/1195180195 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f641806f730 0x7f6418149950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:33.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.039+0000 7f641ce18640 1 --2- 172.21.15.123:0/1195180195 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6418162c60 0x7f6418160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:33.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.039+0000 7f64177fe640 1 -- 172.21.15.123:0/1195180195 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f641806f730 msgr2=0x7f6418149950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:33.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.039+0000 7f64177fe640 1 --2- 172.21.15.123:0/1195180195 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f641806f730 0x7f6418149950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:33.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.039+0000 7f64177fe640 1 -- 172.21.15.123:0/1195180195 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6418162c60 msgr2=0x7f6418160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:33.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.039+0000 7f64177fe640 1 --2- 172.21.15.123:0/1195180195 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6418162c60 0x7f6418160ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:33.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.039+0000 7f64177fe640 1 -- 172.21.15.123:0/1195180195 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6418149e90 con 0x7f641815e790 2024-09-15T23:20:33.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.039+0000 7f64177fe640 1 --2- 172.21.15.123:0/1195180195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f641815e790 0x7f6418155280 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f640c00c460 tx=0x7f640c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:33.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.039+0000 7f6414ff9640 1 -- 172.21.15.123:0/1195180195 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640c016020 con 0x7f641815e790 2024-09-15T23:20:33.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.039+0000 7f6414ff9640 1 -- 172.21.15.123:0/1195180195 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f640c012870 con 0x7f641815e790 2024-09-15T23:20:33.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.039+0000 7f641e87b640 1 -- 172.21.15.123:0/1195180195 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6418157de0 con 0x7f641815e790 2024-09-15T23:20:33.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.039+0000 7f6414ff9640 1 -- 172.21.15.123:0/1195180195 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640c012c60 con 0x7f641815e790 2024-09-15T23:20:33.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.039+0000 7f641e87b640 1 -- 172.21.15.123:0/1195180195 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64181583a0 con 0x7f641815e790 2024-09-15T23:20:33.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.041+0000 7f641e87b640 1 -- 172.21.15.123:0/1195180195 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f641806f430 con 0x7f641815e790 2024-09-15T23:20:33.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.041+0000 7f6414ff9640 1 -- 172.21.15.123:0/1195180195 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f640c019020 con 0x7f641815e790 2024-09-15T23:20:33.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.041+0000 7f6414ff9640 1 --2- 172.21.15.123:0/1195180195 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f640406c2b0 0x7f640406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:33.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.041+0000 7f6414ff9640 1 -- 172.21.15.123:0/1195180195 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f640c08ad90 con 0x7f641815e790 2024-09-15T23:20:33.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.042+0000 7f6417fff640 1 --2- 172.21.15.123:0/1195180195 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f640406c2b0 0x7f640406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:33.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.042+0000 7f6417fff640 1 --2- 172.21.15.123:0/1195180195 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f640406c2b0 0x7f640406e770 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f6408034000 tx=0x7f640802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:33.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.046+0000 7f6414ff9640 1 -- 172.21.15.123:0/1195180195 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f640c020070 con 0x7f641815e790 2024-09-15T23:20:33.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.273+0000 7f641e87b640 1 -- 172.21.15.123:0/1195180195 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f64180b17a0 con 0x7f641815e790 2024-09-15T23:20:33.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.274+0000 7f6414ff9640 1 -- 172.21.15.123:0/1195180195 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1563 (secure 0 0 0) 0x7f640c058eb0 con 0x7f641815e790 2024-09-15T23:20:33.275 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:33.275 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":523,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":154,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":64},{"state_name":"creating+peering","count":33}],"num_pgs":97,"num_pools":3,"num_objects":14,"data_bytes":592050,"bytes_used":387088384,"bytes_avail":772707024896,"bytes_total":773094113280,"inactive_pgs_ratio":0.34020617604255676,"write_bytes_sec":922,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":93,"btime":"2024-09-15T23:20:31:301251+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":9006}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-09-15T23:20:19.619603+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T23:20:33.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.276+0000 7f641e87b640 1 -- 172.21.15.123:0/1195180195 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f640406c2b0 msgr2=0x7f640406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:33.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.276+0000 7f641e87b640 1 --2- 172.21.15.123:0/1195180195 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f640406c2b0 0x7f640406e770 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f6408034000 tx=0x7f640802e000 comp rx=0 tx=0).stop 2024-09-15T23:20:33.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.276+0000 7f641e87b640 1 -- 172.21.15.123:0/1195180195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f641815e790 msgr2=0x7f6418155280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:33.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.276+0000 7f641e87b640 1 --2- 172.21.15.123:0/1195180195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f641815e790 0x7f6418155280 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f640c00c460 tx=0x7f640c00c920 comp rx=0 tx=0).stop 2024-09-15T23:20:33.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.276+0000 7f641e87b640 1 -- 172.21.15.123:0/1195180195 shutdown_connections 2024-09-15T23:20:33.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.276+0000 7f641e87b640 1 --2- 172.21.15.123:0/1195180195 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6418162c60 0x7f6418160ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:33.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.276+0000 7f641e87b640 1 --2- 172.21.15.123:0/1195180195 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f640406c2b0 0x7f640406e770 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:33.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.276+0000 7f641e87b640 1 --2- 172.21.15.123:0/1195180195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f641815e790 0x7f6418155280 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:33.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.276+0000 7f641e87b640 1 --2- 172.21.15.123:0/1195180195 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f641806f730 0x7f6418149950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:33.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.276+0000 7f641e87b640 1 -- 172.21.15.123:0/1195180195 >> 172.21.15.123:0/1195180195 conn(0x7f64180b0a80 msgr2=0x7f64180717a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:33.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.276+0000 7f641e87b640 1 -- 172.21.15.123:0/1195180195 shutdown_connections 2024-09-15T23:20:33.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.276+0000 7f641e87b640 1 -- 172.21.15.123:0/1195180195 wait complete. 2024-09-15T23:20:33.288 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-15T23:20:33.288 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:20:33.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.385+0000 7f1a72ee6640 1 Processor -- start 2024-09-15T23:20:33.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.385+0000 7f1a72ee6640 1 -- start start 2024-09-15T23:20:33.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.386+0000 7f1a72ee6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a6c0b6830 0x7f1a6c06e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:33.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.386+0000 7f1a72ee6640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a6c067b50 con 0x7f1a6c0b02b0 2024-09-15T23:20:33.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.386+0000 7f1a72ee6640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a6c0ce860 con 0x7f1a6c15c4b0 2024-09-15T23:20:33.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.386+0000 7f1a72ee6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1a6c070130 con 0x7f1a6c0b6830 2024-09-15T23:20:33.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.386+0000 7f1a71483640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1a6c0b02b0 0x7f1a6c06e720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49008/0 (socket says 172.21.15.123:49008) 2024-09-15T23:20:33.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.386+0000 7f1a71483640 1 -- 172.21.15.123:0/1998336998 learned_addr learned my addr 172.21.15.123:0/1998336998 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:33.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.387+0000 7f1a6b7fe640 1 -- 172.21.15.123:0/1998336998 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2750956020 0 0) 0x7f1a64001110 con 0x7f1a6c0b02b0 2024-09-15T23:20:33.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.387+0000 7f1a6b7fe640 1 -- 172.21.15.123:0/1998336998 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a54003520 con 0x7f1a6c0b02b0 2024-09-15T23:20:33.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.387+0000 7f1a6bfff640 1 --2- 172.21.15.123:0/1998336998 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a6c0b6830 0x7f1a6c06e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:33.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.387+0000 7f1a6b7fe640 1 -- 172.21.15.123:0/1998336998 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2272200566 0 0) 0x7f1a54003520 con 0x7f1a6c0b02b0 2024-09-15T23:20:33.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.387+0000 7f1a6b7fe640 1 -- 172.21.15.123:0/1998336998 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a6c0b6830 msgr2=0x7f1a6c06e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:33.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.387+0000 7f1a6b7fe640 1 --2- 172.21.15.123:0/1998336998 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a6c0b6830 0x7f1a6c06e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:33.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.387+0000 7f1a6b7fe640 1 -- 172.21.15.123:0/1998336998 >> v1:172.21.15.188:6789/0 conn(0x7f1a6c15c4b0 legacy=0x7f1a6c0b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:33.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.387+0000 7f1a6b7fe640 1 -- 172.21.15.123:0/1998336998 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a6c06fe50 con 0x7f1a6c0b02b0 2024-09-15T23:20:33.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.387+0000 7f1a6b7fe640 1 -- 172.21.15.123:0/1998336998 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f1a64001840 con 0x7f1a6c0b02b0 2024-09-15T23:20:33.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.387+0000 7f1a6b7fe640 1 -- 172.21.15.123:0/1998336998 >> v1:172.21.15.123:6789/0 conn(0x7f1a6c0b02b0 legacy=0x7f1a6c06e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:33.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.387+0000 7f1a6b7fe640 1 --2- 172.21.15.123:0/1998336998 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a540039e0 0x7f1a54003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:33.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.387+0000 7f1a6b7fe640 1 --2- 172.21.15.123:0/1998336998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a54004800 0x7f1a54004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:33.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.387+0000 7f1a6b7fe640 1 --2- 172.21.15.123:0/1998336998 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a6c0b6830 0x7f1a540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:33.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.387+0000 7f1a6b7fe640 1 -- 172.21.15.123:0/1998336998 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6c070130 con 0x7f1a54004800 2024-09-15T23:20:33.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.387+0000 7f1a6b7fe640 1 -- 172.21.15.123:0/1998336998 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5400baa0 con 0x7f1a540039e0 2024-09-15T23:20:33.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.387+0000 7f1a6b7fe640 1 -- 172.21.15.123:0/1998336998 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1a5400bca0 con 0x7f1a6c0b6830 2024-09-15T23:20:33.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.387+0000 7f1a6bfff640 1 --2- 172.21.15.123:0/1998336998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a54004800 0x7f1a54004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:33.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.387+0000 7f1a70c82640 1 --2- 172.21.15.123:0/1998336998 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a540039e0 0x7f1a54003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:33.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.387+0000 7f1a71483640 1 --2- 172.21.15.123:0/1998336998 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a6c0b6830 0x7f1a540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:33.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.387+0000 7f1a6bfff640 1 -- 172.21.15.123:0/1998336998 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a6c0b6830 msgr2=0x7f1a540051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:33.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.387+0000 7f1a6bfff640 1 --2- 172.21.15.123:0/1998336998 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a6c0b6830 0x7f1a540051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:33.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.387+0000 7f1a6bfff640 1 -- 172.21.15.123:0/1998336998 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a540039e0 msgr2=0x7f1a54003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:33.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.387+0000 7f1a6bfff640 1 --2- 172.21.15.123:0/1998336998 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a540039e0 0x7f1a54003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:33.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.387+0000 7f1a6bfff640 1 -- 172.21.15.123:0/1998336998 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a54003520 con 0x7f1a54004800 2024-09-15T23:20:33.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.388+0000 7f1a6bfff640 1 --2- 172.21.15.123:0/1998336998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a54004800 0x7f1a54004c80 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c0b70d0 tx=0x7f1a54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1705873c7bfb0bb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:33.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.388+0000 7f1a6b7fe640 1 -- 172.21.15.123:0/1998336998 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a60037070 con 0x7f1a54004800 2024-09-15T23:20:33.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.388+0000 7f1a6b7fe640 1 -- 172.21.15.123:0/1998336998 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a60032640 con 0x7f1a54004800 2024-09-15T23:20:33.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.388+0000 7f1a6b7fe640 1 -- 172.21.15.123:0/1998336998 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a60009c10 con 0x7f1a54004800 2024-09-15T23:20:33.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.389+0000 7f1a72ee6640 1 -- 172.21.15.123:0/1998336998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a54004800 msgr2=0x7f1a54004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:33.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.389+0000 7f1a72ee6640 1 --2- 172.21.15.123:0/1998336998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a54004800 0x7f1a54004c80 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c0b70d0 tx=0x7f1a54005830 comp rx=0 tx=0).stop 2024-09-15T23:20:33.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.389+0000 7f1a71483640 1 -- 172.21.15.123:0/1998336998 reap_dead start 2024-09-15T23:20:33.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.389+0000 7f1a72ee6640 1 -- 172.21.15.123:0/1998336998 shutdown_connections 2024-09-15T23:20:33.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.389+0000 7f1a72ee6640 1 -- 172.21.15.123:0/1998336998 >> 172.21.15.123:0/1998336998 conn(0x7f1a6c0b0a80 msgr2=0x7f1a6c0b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:33.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.389+0000 7f1a72ee6640 1 -- 172.21.15.123:0/1998336998 shutdown_connections 2024-09-15T23:20:33.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.389+0000 7f1a72ee6640 1 -- 172.21.15.123:0/1998336998 wait complete. 2024-09-15T23:20:33.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.390+0000 7f1a72ee6640 1 Processor -- start 2024-09-15T23:20:33.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.390+0000 7f1a72ee6640 1 -- start start 2024-09-15T23:20:33.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.391+0000 7f1a72ee6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a54004800 0x7f1a6c15b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:33.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.391+0000 7f1a72ee6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a6c150ba0 0x7f1a6c15f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:33.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.391+0000 7f1a72ee6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a6c14d9e0 0x7f1a6c14de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:33.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.391+0000 7f1a72ee6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6c06dcc0 con 0x7f1a6c14d9e0 2024-09-15T23:20:33.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.391+0000 7f1a72ee6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6c0ce580 con 0x7f1a6c150ba0 2024-09-15T23:20:33.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.391+0000 7f1a72ee6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1a6c15c890 con 0x7f1a54004800 2024-09-15T23:20:33.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.391+0000 7f1a71483640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a6c14d9e0 0x7f1a6c14de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:33.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.391+0000 7f1a71483640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a6c14d9e0 0x7f1a6c14de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41222/0 (socket says 172.21.15.123:41222) 2024-09-15T23:20:33.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.391+0000 7f1a71483640 1 -- 172.21.15.123:0/3686874723 learned_addr learned my addr 172.21.15.123:0/3686874723 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:33.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.391+0000 7f1a6bfff640 1 --2- 172.21.15.123:0/3686874723 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a6c150ba0 0x7f1a6c15f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:33.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.391+0000 7f1a70c82640 1 --2- 172.21.15.123:0/3686874723 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a54004800 0x7f1a6c15b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:33.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.391+0000 7f1a71483640 1 -- 172.21.15.123:0/3686874723 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a54004800 msgr2=0x7f1a6c15b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:33.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.391+0000 7f1a71483640 1 --2- 172.21.15.123:0/3686874723 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a54004800 0x7f1a6c15b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:33.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.391+0000 7f1a71483640 1 -- 172.21.15.123:0/3686874723 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a6c150ba0 msgr2=0x7f1a6c15f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:33.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.391+0000 7f1a71483640 1 --2- 172.21.15.123:0/3686874723 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a6c150ba0 0x7f1a6c15f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:33.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.391+0000 7f1a71483640 1 -- 172.21.15.123:0/3686874723 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a6c151380 con 0x7f1a6c14d9e0 2024-09-15T23:20:33.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.392+0000 7f1a71483640 1 --2- 172.21.15.123:0/3686874723 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a6c14d9e0 0x7f1a6c14de60 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c069d00 tx=0x7f1a64007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:33.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.392+0000 7f1a697fa640 1 -- 172.21.15.123:0/3686874723 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a64007e10 con 0x7f1a6c14d9e0 2024-09-15T23:20:33.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.392+0000 7f1a697fa640 1 -- 172.21.15.123:0/3686874723 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a64018070 con 0x7f1a6c14d9e0 2024-09-15T23:20:33.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.392+0000 7f1a72ee6640 1 -- 172.21.15.123:0/3686874723 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a6c151660 con 0x7f1a6c14d9e0 2024-09-15T23:20:33.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.392+0000 7f1a697fa640 1 -- 172.21.15.123:0/3686874723 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6400faf0 con 0x7f1a6c14d9e0 2024-09-15T23:20:33.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.392+0000 7f1a72ee6640 1 -- 172.21.15.123:0/3686874723 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a6c151c20 con 0x7f1a6c14d9e0 2024-09-15T23:20:33.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.393+0000 7f1a72ee6640 1 -- 172.21.15.123:0/3686874723 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a6c0d08e0 con 0x7f1a6c14d9e0 2024-09-15T23:20:33.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.393+0000 7f1a697fa640 1 -- 172.21.15.123:0/3686874723 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1a6400fc90 con 0x7f1a6c14d9e0 2024-09-15T23:20:33.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.394+0000 7f1a697fa640 1 --2- 172.21.15.123:0/3686874723 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1a5806c2b0 0x7f1a5806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:33.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.394+0000 7f1a697fa640 1 -- 172.21.15.123:0/3686874723 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f1a6408b2b0 con 0x7f1a6c14d9e0 2024-09-15T23:20:33.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.394+0000 7f1a70c82640 1 --2- 172.21.15.123:0/3686874723 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1a5806c2b0 0x7f1a5806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:33.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.394+0000 7f1a70c82640 1 --2- 172.21.15.123:0/3686874723 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1a5806c2b0 0x7f1a5806e770 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c0b24f0 tx=0x7f1a5c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:33.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.398+0000 7f1a697fa640 1 -- 172.21.15.123:0/3686874723 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1a6c067b50 con 0x7f1a6c14d9e0 2024-09-15T23:20:33.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.562+0000 7f1a72ee6640 1 -- 172.21.15.123:0/3686874723 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1a6c0b20b0 con 0x7f1a5806c2b0 2024-09-15T23:20:33.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.569+0000 7f1a697fa640 1 -- 172.21.15.123:0/3686874723 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249711 (secure 0 0 0) 0x7f1a6c0b20b0 con 0x7f1a5806c2b0 2024-09-15T23:20:33.572 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:33.574 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:20:33.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.571+0000 7f1a72ee6640 1 -- 172.21.15.123:0/3686874723 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1a5806c2b0 msgr2=0x7f1a5806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:33.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.571+0000 7f1a72ee6640 1 --2- 172.21.15.123:0/3686874723 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1a5806c2b0 0x7f1a5806e770 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c0b24f0 tx=0x7f1a5c009040 comp rx=0 tx=0).stop 2024-09-15T23:20:33.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.571+0000 7f1a72ee6640 1 -- 172.21.15.123:0/3686874723 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a6c14d9e0 msgr2=0x7f1a6c14de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:33.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.571+0000 7f1a72ee6640 1 --2- 172.21.15.123:0/3686874723 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a6c14d9e0 0x7f1a6c14de60 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c069d00 tx=0x7f1a64007720 comp rx=0 tx=0).stop 2024-09-15T23:20:33.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.571+0000 7f1a72ee6640 1 -- 172.21.15.123:0/3686874723 shutdown_connections 2024-09-15T23:20:33.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.571+0000 7f1a72ee6640 1 --2- 172.21.15.123:0/3686874723 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1a5806c2b0 0x7f1a5806e770 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:33.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.571+0000 7f1a72ee6640 1 --2- 172.21.15.123:0/3686874723 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a6c14d9e0 0x7f1a6c14de60 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:33.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.571+0000 7f1a72ee6640 1 --2- 172.21.15.123:0/3686874723 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a6c150ba0 0x7f1a6c15f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:33.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.571+0000 7f1a72ee6640 1 --2- 172.21.15.123:0/3686874723 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a54004800 0x7f1a6c15b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:33.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.572+0000 7f1a72ee6640 1 -- 172.21.15.123:0/3686874723 >> 172.21.15.123:0/3686874723 conn(0x7f1a6c0b0a80 msgr2=0x7f1a6c157510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:33.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.572+0000 7f1a72ee6640 1 -- 172.21.15.123:0/3686874723 shutdown_connections 2024-09-15T23:20:33.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:33.572+0000 7f1a72ee6640 1 -- 172.21.15.123:0/3686874723 wait complete. 2024-09-15T23:20:33.583 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":402,"stamp":"2024-09-15T23:20:31.622079+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592050,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":183,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":81,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":378016,"kb_used_data":16028,"kb_used_omap":12,"kb_used_meta":361779,"kb_avail":754596704,"statfs":{"total":773094113280,"available":772707024896,"internally_reserved":0,"allocated":16412672,"data_stored":7882204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":370462256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1682,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.440330"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.514159+0000","last_change":"2024-09-15T23:20:29.210825+0000","last_active":"2024-09-15T23:20:30.514159+0000","last_peered":"2024-09-15T23:20:30.514159+0000","last_clean":"2024-09-15T23:20:30.514159+0000","last_became_active":"2024-09-15T23:20:29.209560+0000","last_became_peered":"2024-09-15T23:20:29.209560+0000","last_unstale":"2024-09-15T23:20:30.514159+0000","last_undegraded":"2024-09-15T23:20:30.514159+0000","last_fullsized":"2024-09-15T23:20:30.514159+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:01.209675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197440+0000","last_change":"2024-09-15T23:20:29.213201+0000","last_active":"2024-09-15T23:20:30.197440+0000","last_peered":"2024-09-15T23:20:30.197440+0000","last_clean":"2024-09-15T23:20:30.197440+0000","last_became_active":"2024-09-15T23:20:29.212739+0000","last_became_peered":"2024-09-15T23:20:29.212739+0000","last_unstale":"2024-09-15T23:20:30.197440+0000","last_undegraded":"2024-09-15T23:20:30.197440+0000","last_fullsized":"2024-09-15T23:20:30.197440+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:47:20.508671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.192718+0000","last_change":"2024-09-15T23:20:28.192718+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.192718+0000","last_undegraded":"2024-09-15T23:20:28.192718+0000","last_fullsized":"2024-09-15T23:20:28.192718+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.187613+0000","last_change":"2024-09-15T23:20:28.187613+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.187613+0000","last_undegraded":"2024-09-15T23:20:28.187613+0000","last_fullsized":"2024-09-15T23:20:28.187613+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.193283+0000","last_change":"2024-09-15T23:20:28.193283+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.193283+0000","last_undegraded":"2024-09-15T23:20:28.193283+0000","last_fullsized":"2024-09-15T23:20:28.193283+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513482+0000","last_change":"2024-09-15T23:20:29.204397+0000","last_active":"2024-09-15T23:20:30.513482+0000","last_peered":"2024-09-15T23:20:30.513482+0000","last_clean":"2024-09-15T23:20:30.513482+0000","last_became_active":"2024-09-15T23:20:29.204136+0000","last_became_peered":"2024-09-15T23:20:29.204136+0000","last_unstale":"2024-09-15T23:20:30.513482+0000","last_undegraded":"2024-09-15T23:20:30.513482+0000","last_fullsized":"2024-09-15T23:20:30.513482+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:59.246406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.477898+0000","last_change":"2024-09-15T23:20:29.201027+0000","last_active":"2024-09-15T23:20:30.477898+0000","last_peered":"2024-09-15T23:20:30.477898+0000","last_clean":"2024-09-15T23:20:30.477898+0000","last_became_active":"2024-09-15T23:20:29.200749+0000","last_became_peered":"2024-09-15T23:20:29.200749+0000","last_unstale":"2024-09-15T23:20:30.477898+0000","last_undegraded":"2024-09-15T23:20:30.477898+0000","last_fullsized":"2024-09-15T23:20:30.477898+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:19:41.540281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513824+0000","last_change":"2024-09-15T23:20:29.204750+0000","last_active":"2024-09-15T23:20:30.513824+0000","last_peered":"2024-09-15T23:20:30.513824+0000","last_clean":"2024-09-15T23:20:30.513824+0000","last_became_active":"2024-09-15T23:20:29.204302+0000","last_became_peered":"2024-09-15T23:20:29.204302+0000","last_unstale":"2024-09-15T23:20:30.513824+0000","last_undegraded":"2024-09-15T23:20:30.513824+0000","last_fullsized":"2024-09-15T23:20:30.513824+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:39:22.123870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513438+0000","last_change":"2024-09-15T23:20:29.208508+0000","last_active":"2024-09-15T23:20:30.513438+0000","last_peered":"2024-09-15T23:20:30.513438+0000","last_clean":"2024-09-15T23:20:30.513438+0000","last_became_active":"2024-09-15T23:20:29.208205+0000","last_became_peered":"2024-09-15T23:20:29.208205+0000","last_unstale":"2024-09-15T23:20:30.513438+0000","last_undegraded":"2024-09-15T23:20:30.513438+0000","last_fullsized":"2024-09-15T23:20:30.513438+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:12.809369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.194528+0000","last_change":"2024-09-15T23:20:28.194528+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.194528+0000","last_undegraded":"2024-09-15T23:20:28.194528+0000","last_fullsized":"2024-09-15T23:20:28.194528+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513577+0000","last_change":"2024-09-15T23:20:29.201060+0000","last_active":"2024-09-15T23:20:30.513577+0000","last_peered":"2024-09-15T23:20:30.513577+0000","last_clean":"2024-09-15T23:20:30.513577+0000","last_became_active":"2024-09-15T23:20:29.200789+0000","last_became_peered":"2024-09-15T23:20:29.200789+0000","last_unstale":"2024-09-15T23:20:30.513577+0000","last_undegraded":"2024-09-15T23:20:30.513577+0000","last_fullsized":"2024-09-15T23:20:30.513577+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:48.987519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.191371+0000","last_change":"2024-09-15T23:20:28.191371+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.191371+0000","last_undegraded":"2024-09-15T23:20:28.191371+0000","last_fullsized":"2024-09-15T23:20:28.191371+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.192883+0000","last_change":"2024-09-15T23:20:28.192883+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.192883+0000","last_undegraded":"2024-09-15T23:20:28.192883+0000","last_fullsized":"2024-09-15T23:20:28.192883+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.192133+0000","last_change":"2024-09-15T23:20:28.192133+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.192133+0000","last_undegraded":"2024-09-15T23:20:28.192133+0000","last_fullsized":"2024-09-15T23:20:28.192133+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.192587+0000","last_change":"2024-09-15T23:20:28.192587+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.192587+0000","last_undegraded":"2024-09-15T23:20:28.192587+0000","last_fullsized":"2024-09-15T23:20:28.192587+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.477851+0000","last_change":"2024-09-15T23:20:29.204046+0000","last_active":"2024-09-15T23:20:30.477851+0000","last_peered":"2024-09-15T23:20:30.477851+0000","last_clean":"2024-09-15T23:20:30.477851+0000","last_became_active":"2024-09-15T23:20:29.203700+0000","last_became_peered":"2024-09-15T23:20:29.203700+0000","last_unstale":"2024-09-15T23:20:30.477851+0000","last_undegraded":"2024-09-15T23:20:30.477851+0000","last_fullsized":"2024-09-15T23:20:30.477851+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:39:17.409757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.192631+0000","last_change":"2024-09-15T23:20:28.192631+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.192631+0000","last_undegraded":"2024-09-15T23:20:28.192631+0000","last_fullsized":"2024-09-15T23:20:28.192631+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.194250+0000","last_change":"2024-09-15T23:20:28.194250+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.194250+0000","last_undegraded":"2024-09-15T23:20:28.194250+0000","last_fullsized":"2024-09-15T23:20:28.194250+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513910+0000","last_change":"2024-09-15T23:20:29.205307+0000","last_active":"2024-09-15T23:20:30.513910+0000","last_peered":"2024-09-15T23:20:30.513910+0000","last_clean":"2024-09-15T23:20:30.513910+0000","last_became_active":"2024-09-15T23:20:29.202606+0000","last_became_peered":"2024-09-15T23:20:29.202606+0000","last_unstale":"2024-09-15T23:20:30.513910+0000","last_undegraded":"2024-09-15T23:20:30.513910+0000","last_fullsized":"2024-09-15T23:20:30.513910+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:55.411259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513840+0000","last_change":"2024-09-15T23:20:29.206689+0000","last_active":"2024-09-15T23:20:30.513840+0000","last_peered":"2024-09-15T23:20:30.513840+0000","last_clean":"2024-09-15T23:20:30.513840+0000","last_became_active":"2024-09-15T23:20:29.206438+0000","last_became_peered":"2024-09-15T23:20:29.206438+0000","last_unstale":"2024-09-15T23:20:30.513840+0000","last_undegraded":"2024-09-15T23:20:30.513840+0000","last_fullsized":"2024-09-15T23:20:30.513840+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:32.736263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.194524+0000","last_change":"2024-09-15T23:20:28.194524+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.194524+0000","last_undegraded":"2024-09-15T23:20:28.194524+0000","last_fullsized":"2024-09-15T23:20:28.194524+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.191712+0000","last_change":"2024-09-15T23:20:28.191712+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.191712+0000","last_undegraded":"2024-09-15T23:20:28.191712+0000","last_fullsized":"2024-09-15T23:20:28.191712+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.189185+0000","last_change":"2024-09-15T23:20:28.189185+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.189185+0000","last_undegraded":"2024-09-15T23:20:28.189185+0000","last_fullsized":"2024-09-15T23:20:28.189185+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.191495+0000","last_change":"2024-09-15T23:20:28.191495+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.191495+0000","last_undegraded":"2024-09-15T23:20:28.191495+0000","last_fullsized":"2024-09-15T23:20:28.191495+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197183+0000","last_change":"2024-09-15T23:20:29.203623+0000","last_active":"2024-09-15T23:20:30.197183+0000","last_peered":"2024-09-15T23:20:30.197183+0000","last_clean":"2024-09-15T23:20:30.197183+0000","last_became_active":"2024-09-15T23:20:29.203345+0000","last_became_peered":"2024-09-15T23:20:29.203345+0000","last_unstale":"2024-09-15T23:20:30.197183+0000","last_undegraded":"2024-09-15T23:20:30.197183+0000","last_fullsized":"2024-09-15T23:20:30.197183+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:54.343998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.514075+0000","last_change":"2024-09-15T23:20:29.210780+0000","last_active":"2024-09-15T23:20:30.514075+0000","last_peered":"2024-09-15T23:20:30.514075+0000","last_clean":"2024-09-15T23:20:30.514075+0000","last_became_active":"2024-09-15T23:20:29.210430+0000","last_became_peered":"2024-09-15T23:20:29.210430+0000","last_unstale":"2024-09-15T23:20:30.514075+0000","last_undegraded":"2024-09-15T23:20:30.514075+0000","last_fullsized":"2024-09-15T23:20:30.514075+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:03.050568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197008+0000","last_change":"2024-09-15T23:20:29.206551+0000","last_active":"2024-09-15T23:20:30.197008+0000","last_peered":"2024-09-15T23:20:30.197008+0000","last_clean":"2024-09-15T23:20:30.197008+0000","last_became_active":"2024-09-15T23:20:29.206047+0000","last_became_peered":"2024-09-15T23:20:29.206047+0000","last_unstale":"2024-09-15T23:20:30.197008+0000","last_undegraded":"2024-09-15T23:20:30.197008+0000","last_fullsized":"2024-09-15T23:20:30.197008+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:29.017905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197338+0000","last_change":"2024-09-15T23:20:29.213045+0000","last_active":"2024-09-15T23:20:30.197338+0000","last_peered":"2024-09-15T23:20:30.197338+0000","last_clean":"2024-09-15T23:20:30.197338+0000","last_became_active":"2024-09-15T23:20:29.212610+0000","last_became_peered":"2024-09-15T23:20:29.212610+0000","last_unstale":"2024-09-15T23:20:30.197338+0000","last_undegraded":"2024-09-15T23:20:30.197338+0000","last_fullsized":"2024-09-15T23:20:30.197338+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:16:34.134579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513344+0000","last_change":"2024-09-15T23:20:29.203828+0000","last_active":"2024-09-15T23:20:30.513344+0000","last_peered":"2024-09-15T23:20:30.513344+0000","last_clean":"2024-09-15T23:20:30.513344+0000","last_became_active":"2024-09-15T23:20:29.203540+0000","last_became_peered":"2024-09-15T23:20:29.203540+0000","last_unstale":"2024-09-15T23:20:30.513344+0000","last_undegraded":"2024-09-15T23:20:30.513344+0000","last_fullsized":"2024-09-15T23:20:30.513344+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:05.538292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.191210+0000","last_change":"2024-09-15T23:20:28.191210+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.191210+0000","last_undegraded":"2024-09-15T23:20:28.191210+0000","last_fullsized":"2024-09-15T23:20:28.191210+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.196949+0000","last_change":"2024-09-15T23:20:29.206312+0000","last_active":"2024-09-15T23:20:30.196949+0000","last_peered":"2024-09-15T23:20:30.196949+0000","last_clean":"2024-09-15T23:20:30.196949+0000","last_became_active":"2024-09-15T23:20:29.205751+0000","last_became_peered":"2024-09-15T23:20:29.205751+0000","last_unstale":"2024-09-15T23:20:30.196949+0000","last_undegraded":"2024-09-15T23:20:30.196949+0000","last_fullsized":"2024-09-15T23:20:30.196949+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:15.386192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.196748+0000","last_change":"2024-09-15T23:20:29.204281+0000","last_active":"2024-09-15T23:20:30.196748+0000","last_peered":"2024-09-15T23:20:30.196748+0000","last_clean":"2024-09-15T23:20:30.196748+0000","last_became_active":"2024-09-15T23:20:29.203688+0000","last_became_peered":"2024-09-15T23:20:29.203688+0000","last_unstale":"2024-09-15T23:20:30.196748+0000","last_undegraded":"2024-09-15T23:20:30.196748+0000","last_fullsized":"2024-09-15T23:20:30.196748+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:08.800648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.193376+0000","last_change":"2024-09-15T23:20:28.193376+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.193376+0000","last_undegraded":"2024-09-15T23:20:28.193376+0000","last_fullsized":"2024-09-15T23:20:28.193376+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.205767+0000","last_change":"2024-09-15T23:20:28.204655+0000","last_active":"2024-09-15T23:20:28.205767+0000","last_peered":"2024-09-15T23:20:28.205767+0000","last_clean":"2024-09-15T23:20:28.205767+0000","last_became_active":"2024-09-15T23:20:28.204276+0000","last_became_peered":"2024-09-15T23:20:28.204276+0000","last_unstale":"2024-09-15T23:20:28.205767+0000","last_undegraded":"2024-09-15T23:20:28.205767+0000","last_fullsized":"2024-09-15T23:20:28.205767+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:50.519564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478220+0000","last_change":"2024-09-15T23:20:29.211788+0000","last_active":"2024-09-15T23:20:30.478220+0000","last_peered":"2024-09-15T23:20:30.478220+0000","last_clean":"2024-09-15T23:20:30.478220+0000","last_became_active":"2024-09-15T23:20:29.211520+0000","last_became_peered":"2024-09-15T23:20:29.211520+0000","last_unstale":"2024-09-15T23:20:30.478220+0000","last_undegraded":"2024-09-15T23:20:30.478220+0000","last_fullsized":"2024-09-15T23:20:30.478220+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:11:54.598151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.1e","version":"153'1","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513593+0000","last_change":"2024-09-15T23:20:28.205670+0000","last_active":"2024-09-15T23:20:30.513593+0000","last_peered":"2024-09-15T23:20:30.513593+0000","last_clean":"2024-09-15T23:20:30.513593+0000","last_became_active":"2024-09-15T23:20:28.205375+0000","last_became_peered":"2024-09-15T23:20:28.205375+0000","last_unstale":"2024-09-15T23:20:30.513593+0000","last_undegraded":"2024-09-15T23:20:30.513593+0000","last_fullsized":"2024-09-15T23:20:30.513593+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:14.841698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513576+0000","last_change":"2024-09-15T23:20:29.199351+0000","last_active":"2024-09-15T23:20:30.513576+0000","last_peered":"2024-09-15T23:20:30.513576+0000","last_clean":"2024-09-15T23:20:30.513576+0000","last_became_active":"2024-09-15T23:20:29.199075+0000","last_became_peered":"2024-09-15T23:20:29.199075+0000","last_unstale":"2024-09-15T23:20:30.513576+0000","last_undegraded":"2024-09-15T23:20:30.513576+0000","last_fullsized":"2024-09-15T23:20:30.513576+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:35:52.283626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.206520+0000","last_change":"2024-09-15T23:20:28.205664+0000","last_active":"2024-09-15T23:20:28.206520+0000","last_peered":"2024-09-15T23:20:28.206520+0000","last_clean":"2024-09-15T23:20:28.206520+0000","last_became_active":"2024-09-15T23:20:28.205359+0000","last_became_peered":"2024-09-15T23:20:28.205359+0000","last_unstale":"2024-09-15T23:20:28.206520+0000","last_undegraded":"2024-09-15T23:20:28.206520+0000","last_fullsized":"2024-09-15T23:20:28.206520+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:10:47.716692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.188069+0000","last_change":"2024-09-15T23:20:28.188069+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.188069+0000","last_undegraded":"2024-09-15T23:20:28.188069+0000","last_fullsized":"2024-09-15T23:20:28.188069+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.202989+0000","last_change":"2024-09-15T23:20:28.198556+0000","last_active":"2024-09-15T23:20:28.202989+0000","last_peered":"2024-09-15T23:20:28.202989+0000","last_clean":"2024-09-15T23:20:28.202989+0000","last_became_active":"2024-09-15T23:20:28.198271+0000","last_became_peered":"2024-09-15T23:20:28.198271+0000","last_unstale":"2024-09-15T23:20:28.202989+0000","last_undegraded":"2024-09-15T23:20:28.202989+0000","last_fullsized":"2024-09-15T23:20:28.202989+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:41:22.811101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.196853+0000","last_change":"2024-09-15T23:20:29.210214+0000","last_active":"2024-09-15T23:20:30.196853+0000","last_peered":"2024-09-15T23:20:30.196853+0000","last_clean":"2024-09-15T23:20:30.196853+0000","last_became_active":"2024-09-15T23:20:29.209939+0000","last_became_peered":"2024-09-15T23:20:29.209939+0000","last_unstale":"2024-09-15T23:20:30.196853+0000","last_undegraded":"2024-09-15T23:20:30.196853+0000","last_fullsized":"2024-09-15T23:20:30.196853+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:26.238986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"153'1","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513467+0000","last_change":"2024-09-15T23:20:28.200879+0000","last_active":"2024-09-15T23:20:30.513467+0000","last_peered":"2024-09-15T23:20:30.513467+0000","last_clean":"2024-09-15T23:20:30.513467+0000","last_became_active":"2024-09-15T23:20:28.200596+0000","last_became_peered":"2024-09-15T23:20:28.200596+0000","last_unstale":"2024-09-15T23:20:30.513467+0000","last_undegraded":"2024-09-15T23:20:30.513467+0000","last_fullsized":"2024-09-15T23:20:30.513467+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:35.867315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.188506+0000","last_change":"2024-09-15T23:20:28.188506+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.188506+0000","last_undegraded":"2024-09-15T23:20:28.188506+0000","last_fullsized":"2024-09-15T23:20:28.188506+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.206090+0000","last_change":"2024-09-15T23:20:28.205621+0000","last_active":"2024-09-15T23:20:28.206090+0000","last_peered":"2024-09-15T23:20:28.206090+0000","last_clean":"2024-09-15T23:20:28.206090+0000","last_became_active":"2024-09-15T23:20:28.205331+0000","last_became_peered":"2024-09-15T23:20:28.205331+0000","last_unstale":"2024-09-15T23:20:28.206090+0000","last_undegraded":"2024-09-15T23:20:28.206090+0000","last_fullsized":"2024-09-15T23:20:28.206090+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:15.636385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.196932+0000","last_change":"2024-09-15T23:20:29.204023+0000","last_active":"2024-09-15T23:20:30.196932+0000","last_peered":"2024-09-15T23:20:30.196932+0000","last_clean":"2024-09-15T23:20:30.196932+0000","last_became_active":"2024-09-15T23:20:29.203330+0000","last_became_peered":"2024-09-15T23:20:29.203330+0000","last_unstale":"2024-09-15T23:20:30.196932+0000","last_undegraded":"2024-09-15T23:20:30.196932+0000","last_fullsized":"2024-09-15T23:20:30.196932+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:17.443743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513228+0000","last_change":"2024-09-15T23:20:28.198319+0000","last_active":"2024-09-15T23:20:30.513228+0000","last_peered":"2024-09-15T23:20:30.513228+0000","last_clean":"2024-09-15T23:20:30.513228+0000","last_became_active":"2024-09-15T23:20:28.198037+0000","last_became_peered":"2024-09-15T23:20:28.198037+0000","last_unstale":"2024-09-15T23:20:30.513228+0000","last_undegraded":"2024-09-15T23:20:30.513228+0000","last_fullsized":"2024-09-15T23:20:30.513228+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:59.671879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.188220+0000","last_change":"2024-09-15T23:20:28.188220+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.188220+0000","last_undegraded":"2024-09-15T23:20:28.188220+0000","last_fullsized":"2024-09-15T23:20:28.188220+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.203696+0000","last_change":"2024-09-15T23:20:28.202458+0000","last_active":"2024-09-15T23:20:28.203696+0000","last_peered":"2024-09-15T23:20:28.203696+0000","last_clean":"2024-09-15T23:20:28.203696+0000","last_became_active":"2024-09-15T23:20:28.201758+0000","last_became_peered":"2024-09-15T23:20:28.201758+0000","last_unstale":"2024-09-15T23:20:28.203696+0000","last_undegraded":"2024-09-15T23:20:28.203696+0000","last_fullsized":"2024-09-15T23:20:28.203696+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:56.514873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.188793+0000","last_change":"2024-09-15T23:20:28.188793+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.188793+0000","last_undegraded":"2024-09-15T23:20:28.188793+0000","last_fullsized":"2024-09-15T23:20:28.188793+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513715+0000","last_change":"2024-09-15T23:20:28.201994+0000","last_active":"2024-09-15T23:20:30.513715+0000","last_peered":"2024-09-15T23:20:30.513715+0000","last_clean":"2024-09-15T23:20:30.513715+0000","last_became_active":"2024-09-15T23:20:28.201732+0000","last_became_peered":"2024-09-15T23:20:28.201732+0000","last_unstale":"2024-09-15T23:20:30.513715+0000","last_undegraded":"2024-09-15T23:20:30.513715+0000","last_fullsized":"2024-09-15T23:20:30.513715+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:20:04.106407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.190214+0000","last_change":"2024-09-15T23:20:28.190214+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.190214+0000","last_undegraded":"2024-09-15T23:20:28.190214+0000","last_fullsized":"2024-09-15T23:20:28.190214+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.204610+0000","last_change":"2024-09-15T23:20:28.203405+0000","last_active":"2024-09-15T23:20:28.204610+0000","last_peered":"2024-09-15T23:20:28.204610+0000","last_clean":"2024-09-15T23:20:28.204610+0000","last_became_active":"2024-09-15T23:20:28.203089+0000","last_became_peered":"2024-09-15T23:20:28.203089+0000","last_unstale":"2024-09-15T23:20:28.204610+0000","last_undegraded":"2024-09-15T23:20:28.204610+0000","last_fullsized":"2024-09-15T23:20:28.204610+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:22:10.923587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478179+0000","last_change":"2024-09-15T23:20:29.203940+0000","last_active":"2024-09-15T23:20:30.478179+0000","last_peered":"2024-09-15T23:20:30.478179+0000","last_clean":"2024-09-15T23:20:30.478179+0000","last_became_active":"2024-09-15T23:20:29.203654+0000","last_became_peered":"2024-09-15T23:20:29.203654+0000","last_unstale":"2024-09-15T23:20:30.478179+0000","last_undegraded":"2024-09-15T23:20:30.478179+0000","last_fullsized":"2024-09-15T23:20:30.478179+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:44.170339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.14","version":"153'6","reported_seq":20,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478124+0000","last_change":"2024-09-15T23:20:28.198498+0000","last_active":"2024-09-15T23:20:30.478124+0000","last_peered":"2024-09-15T23:20:30.478124+0000","last_clean":"2024-09-15T23:20:30.478124+0000","last_became_active":"2024-09-15T23:20:28.198171+0000","last_became_peered":"2024-09-15T23:20:28.198171+0000","last_unstale":"2024-09-15T23:20:30.478124+0000","last_undegraded":"2024-09-15T23:20:30.478124+0000","last_fullsized":"2024-09-15T23:20:30.478124+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:40:08.921301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.187686+0000","last_change":"2024-09-15T23:20:28.187686+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.187686+0000","last_undegraded":"2024-09-15T23:20:28.187686+0000","last_fullsized":"2024-09-15T23:20:28.187686+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.203650+0000","last_change":"2024-09-15T23:20:28.201858+0000","last_active":"2024-09-15T23:20:28.203650+0000","last_peered":"2024-09-15T23:20:28.203650+0000","last_clean":"2024-09-15T23:20:28.203650+0000","last_became_active":"2024-09-15T23:20:28.201575+0000","last_became_peered":"2024-09-15T23:20:28.201575+0000","last_unstale":"2024-09-15T23:20:28.203650+0000","last_undegraded":"2024-09-15T23:20:28.203650+0000","last_fullsized":"2024-09-15T23:20:28.203650+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:26.414992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513779+0000","last_change":"2024-09-15T23:20:29.203263+0000","last_active":"2024-09-15T23:20:30.513779+0000","last_peered":"2024-09-15T23:20:30.513779+0000","last_clean":"2024-09-15T23:20:30.513779+0000","last_became_active":"2024-09-15T23:20:29.202940+0000","last_became_peered":"2024-09-15T23:20:29.202940+0000","last_unstale":"2024-09-15T23:20:30.513779+0000","last_undegraded":"2024-09-15T23:20:30.513779+0000","last_fullsized":"2024-09-15T23:20:30.513779+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:52:28.550373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.203071+0000","last_change":"2024-09-15T23:20:28.200080+0000","last_active":"2024-09-15T23:20:28.203071+0000","last_peered":"2024-09-15T23:20:28.203071+0000","last_clean":"2024-09-15T23:20:28.203071+0000","last_became_active":"2024-09-15T23:20:28.199794+0000","last_became_peered":"2024-09-15T23:20:28.199794+0000","last_unstale":"2024-09-15T23:20:28.203071+0000","last_undegraded":"2024-09-15T23:20:28.203071+0000","last_fullsized":"2024-09-15T23:20:28.203071+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:34.681060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.188239+0000","last_change":"2024-09-15T23:20:28.188239+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.188239+0000","last_undegraded":"2024-09-15T23:20:28.188239+0000","last_fullsized":"2024-09-15T23:20:28.188239+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197059+0000","last_change":"2024-09-15T23:20:28.198797+0000","last_active":"2024-09-15T23:20:30.197059+0000","last_peered":"2024-09-15T23:20:30.197059+0000","last_clean":"2024-09-15T23:20:30.197059+0000","last_became_active":"2024-09-15T23:20:28.198191+0000","last_became_peered":"2024-09-15T23:20:28.198191+0000","last_unstale":"2024-09-15T23:20:30.197059+0000","last_undegraded":"2024-09-15T23:20:30.197059+0000","last_fullsized":"2024-09-15T23:20:30.197059+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:07.972958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.187705+0000","last_change":"2024-09-15T23:20:28.187705+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.187705+0000","last_undegraded":"2024-09-15T23:20:28.187705+0000","last_fullsized":"2024-09-15T23:20:28.187705+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.10","version":"153'8","reported_seq":22,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513958+0000","last_change":"2024-09-15T23:20:28.200011+0000","last_active":"2024-09-15T23:20:30.513958+0000","last_peered":"2024-09-15T23:20:30.513958+0000","last_clean":"2024-09-15T23:20:30.513958+0000","last_became_active":"2024-09-15T23:20:28.199751+0000","last_became_peered":"2024-09-15T23:20:28.199751+0000","last_unstale":"2024-09-15T23:20:30.513958+0000","last_undegraded":"2024-09-15T23:20:30.513958+0000","last_fullsized":"2024-09-15T23:20:30.513958+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:47:17.451917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.192616+0000","last_change":"2024-09-15T23:20:28.192616+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.192616+0000","last_undegraded":"2024-09-15T23:20:28.192616+0000","last_fullsized":"2024-09-15T23:20:28.192616+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.201043+0000","last_change":"2024-09-15T23:20:28.200278+0000","last_active":"2024-09-15T23:20:28.201043+0000","last_peered":"2024-09-15T23:20:28.201043+0000","last_clean":"2024-09-15T23:20:28.201043+0000","last_became_active":"2024-09-15T23:20:28.200010+0000","last_became_peered":"2024-09-15T23:20:28.200010+0000","last_unstale":"2024-09-15T23:20:28.201043+0000","last_undegraded":"2024-09-15T23:20:28.201043+0000","last_fullsized":"2024-09-15T23:20:28.201043+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:25.236703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197368+0000","last_change":"2024-09-15T23:20:29.202536+0000","last_active":"2024-09-15T23:20:30.197368+0000","last_peered":"2024-09-15T23:20:30.197368+0000","last_clean":"2024-09-15T23:20:30.197368+0000","last_became_active":"2024-09-15T23:20:29.202017+0000","last_became_peered":"2024-09-15T23:20:29.202017+0000","last_unstale":"2024-09-15T23:20:30.197368+0000","last_undegraded":"2024-09-15T23:20:30.197368+0000","last_fullsized":"2024-09-15T23:20:30.197368+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:13.973671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.e","version":"153'2","reported_seq":16,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.514068+0000","last_change":"2024-09-15T23:20:28.203185+0000","last_active":"2024-09-15T23:20:30.514068+0000","last_peered":"2024-09-15T23:20:30.514068+0000","last_clean":"2024-09-15T23:20:30.514068+0000","last_became_active":"2024-09-15T23:20:28.202696+0000","last_became_peered":"2024-09-15T23:20:28.202696+0000","last_unstale":"2024-09-15T23:20:30.514068+0000","last_undegraded":"2024-09-15T23:20:30.514068+0000","last_fullsized":"2024-09-15T23:20:30.514068+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:40.388412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.192160+0000","last_change":"2024-09-15T23:20:28.192160+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.192160+0000","last_undegraded":"2024-09-15T23:20:28.192160+0000","last_fullsized":"2024-09-15T23:20:28.192160+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.d","version":"153'1","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478240+0000","last_change":"2024-09-15T23:20:28.201741+0000","last_active":"2024-09-15T23:20:30.478240+0000","last_peered":"2024-09-15T23:20:30.478240+0000","last_clean":"2024-09-15T23:20:30.478240+0000","last_became_active":"2024-09-15T23:20:28.201472+0000","last_became_peered":"2024-09-15T23:20:28.201472+0000","last_unstale":"2024-09-15T23:20:30.478240+0000","last_undegraded":"2024-09-15T23:20:30.478240+0000","last_fullsized":"2024-09-15T23:20:30.478240+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:37:13.277973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513650+0000","last_change":"2024-09-15T23:20:29.197136+0000","last_active":"2024-09-15T23:20:30.513650+0000","last_peered":"2024-09-15T23:20:30.513650+0000","last_clean":"2024-09-15T23:20:30.513650+0000","last_became_active":"2024-09-15T23:20:29.196233+0000","last_became_peered":"2024-09-15T23:20:29.196233+0000","last_unstale":"2024-09-15T23:20:30.513650+0000","last_undegraded":"2024-09-15T23:20:30.513650+0000","last_fullsized":"2024-09-15T23:20:30.513650+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:19.380894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197385+0000","last_change":"2024-09-15T23:20:28.199993+0000","last_active":"2024-09-15T23:20:30.197385+0000","last_peered":"2024-09-15T23:20:30.197385+0000","last_clean":"2024-09-15T23:20:30.197385+0000","last_became_active":"2024-09-15T23:20:28.199722+0000","last_became_peered":"2024-09-15T23:20:28.199722+0000","last_unstale":"2024-09-15T23:20:30.197385+0000","last_undegraded":"2024-09-15T23:20:30.197385+0000","last_fullsized":"2024-09-15T23:20:30.197385+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:14.668959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.190400+0000","last_change":"2024-09-15T23:20:28.190400+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.190400+0000","last_undegraded":"2024-09-15T23:20:28.190400+0000","last_fullsized":"2024-09-15T23:20:28.190400+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.b","version":"153'2","reported_seq":16,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513462+0000","last_change":"2024-09-15T23:20:28.205673+0000","last_active":"2024-09-15T23:20:30.513462+0000","last_peered":"2024-09-15T23:20:30.513462+0000","last_clean":"2024-09-15T23:20:30.513462+0000","last_became_active":"2024-09-15T23:20:28.205339+0000","last_became_peered":"2024-09-15T23:20:28.205339+0000","last_unstale":"2024-09-15T23:20:30.513462+0000","last_undegraded":"2024-09-15T23:20:30.513462+0000","last_fullsized":"2024-09-15T23:20:30.513462+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:35:31.432270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.196960+0000","last_change":"2024-09-15T23:20:29.202170+0000","last_active":"2024-09-15T23:20:30.196960+0000","last_peered":"2024-09-15T23:20:30.196960+0000","last_clean":"2024-09-15T23:20:30.196960+0000","last_became_active":"2024-09-15T23:20:29.201829+0000","last_became_peered":"2024-09-15T23:20:29.201829+0000","last_unstale":"2024-09-15T23:20:30.196960+0000","last_undegraded":"2024-09-15T23:20:30.196960+0000","last_fullsized":"2024-09-15T23:20:30.196960+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:55.770178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.200742+0000","last_change":"2024-09-15T23:20:28.199768+0000","last_active":"2024-09-15T23:20:28.200742+0000","last_peered":"2024-09-15T23:20:28.200742+0000","last_clean":"2024-09-15T23:20:28.200742+0000","last_became_active":"2024-09-15T23:20:28.199473+0000","last_became_peered":"2024-09-15T23:20:28.199473+0000","last_unstale":"2024-09-15T23:20:28.200742+0000","last_undegraded":"2024-09-15T23:20:28.200742+0000","last_fullsized":"2024-09-15T23:20:28.200742+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:20.928378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.190182+0000","last_change":"2024-09-15T23:20:28.190182+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.190182+0000","last_undegraded":"2024-09-15T23:20:28.190182+0000","last_fullsized":"2024-09-15T23:20:28.190182+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.202141+0000","last_change":"2024-09-15T23:20:28.201036+0000","last_active":"2024-09-15T23:20:28.202141+0000","last_peered":"2024-09-15T23:20:28.202141+0000","last_clean":"2024-09-15T23:20:28.202141+0000","last_became_active":"2024-09-15T23:20:28.200548+0000","last_became_peered":"2024-09-15T23:20:28.200548+0000","last_unstale":"2024-09-15T23:20:28.202141+0000","last_undegraded":"2024-09-15T23:20:28.202141+0000","last_fullsized":"2024-09-15T23:20:28.202141+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:16.441460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.196771+0000","last_change":"2024-09-15T23:20:29.211822+0000","last_active":"2024-09-15T23:20:30.196771+0000","last_peered":"2024-09-15T23:20:30.196771+0000","last_clean":"2024-09-15T23:20:30.196771+0000","last_became_active":"2024-09-15T23:20:29.211561+0000","last_became_peered":"2024-09-15T23:20:29.211561+0000","last_unstale":"2024-09-15T23:20:30.196771+0000","last_undegraded":"2024-09-15T23:20:30.196771+0000","last_fullsized":"2024-09-15T23:20:30.196771+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:21.930661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.200766+0000","last_change":"2024-09-15T23:20:28.196801+0000","last_active":"2024-09-15T23:20:28.200766+0000","last_peered":"2024-09-15T23:20:28.200766+0000","last_clean":"2024-09-15T23:20:28.200766+0000","last_became_active":"2024-09-15T23:20:28.195532+0000","last_became_peered":"2024-09-15T23:20:28.195532+0000","last_unstale":"2024-09-15T23:20:28.200766+0000","last_undegraded":"2024-09-15T23:20:28.200766+0000","last_fullsized":"2024-09-15T23:20:28.200766+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:07.798365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.187873+0000","last_change":"2024-09-15T23:20:28.187873+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.187873+0000","last_undegraded":"2024-09-15T23:20:28.187873+0000","last_fullsized":"2024-09-15T23:20:28.187873+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.200762+0000","last_change":"2024-09-15T23:20:28.197581+0000","last_active":"2024-09-15T23:20:28.200762+0000","last_peered":"2024-09-15T23:20:28.200762+0000","last_clean":"2024-09-15T23:20:28.200762+0000","last_became_active":"2024-09-15T23:20:28.197295+0000","last_became_peered":"2024-09-15T23:20:28.197295+0000","last_unstale":"2024-09-15T23:20:28.200762+0000","last_undegraded":"2024-09-15T23:20:28.200762+0000","last_fullsized":"2024-09-15T23:20:28.200762+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:09:07.949948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.189180+0000","last_change":"2024-09-15T23:20:28.189180+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.189180+0000","last_undegraded":"2024-09-15T23:20:28.189180+0000","last_fullsized":"2024-09-15T23:20:28.189180+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.6","version":"153'1","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197269+0000","last_change":"2024-09-15T23:20:28.201563+0000","last_active":"2024-09-15T23:20:30.197269+0000","last_peered":"2024-09-15T23:20:30.197269+0000","last_clean":"2024-09-15T23:20:30.197269+0000","last_became_active":"2024-09-15T23:20:28.201200+0000","last_became_peered":"2024-09-15T23:20:28.201200+0000","last_unstale":"2024-09-15T23:20:30.197269+0000","last_undegraded":"2024-09-15T23:20:30.197269+0000","last_fullsized":"2024-09-15T23:20:30.197269+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:33:08.209152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513913+0000","last_change":"2024-09-15T23:20:29.206055+0000","last_active":"2024-09-15T23:20:30.513913+0000","last_peered":"2024-09-15T23:20:30.513913+0000","last_clean":"2024-09-15T23:20:30.513913+0000","last_became_active":"2024-09-15T23:20:29.205752+0000","last_became_peered":"2024-09-15T23:20:29.205752+0000","last_unstale":"2024-09-15T23:20:30.513913+0000","last_undegraded":"2024-09-15T23:20:30.513913+0000","last_fullsized":"2024-09-15T23:20:30.513913+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:41.418218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478260+0000","last_change":"2024-09-15T23:20:28.198508+0000","last_active":"2024-09-15T23:20:30.478260+0000","last_peered":"2024-09-15T23:20:30.478260+0000","last_clean":"2024-09-15T23:20:30.478260+0000","last_became_active":"2024-09-15T23:20:28.198223+0000","last_became_peered":"2024-09-15T23:20:28.198223+0000","last_unstale":"2024-09-15T23:20:30.478260+0000","last_undegraded":"2024-09-15T23:20:30.478260+0000","last_fullsized":"2024-09-15T23:20:30.478260+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:08.445349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513338+0000","last_change":"2024-09-15T23:20:29.210818+0000","last_active":"2024-09-15T23:20:30.513338+0000","last_peered":"2024-09-15T23:20:30.513338+0000","last_clean":"2024-09-15T23:20:30.513338+0000","last_became_active":"2024-09-15T23:20:29.210535+0000","last_became_peered":"2024-09-15T23:20:29.210535+0000","last_unstale":"2024-09-15T23:20:30.513338+0000","last_undegraded":"2024-09-15T23:20:30.513338+0000","last_fullsized":"2024-09-15T23:20:30.513338+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:19.504434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478169+0000","last_change":"2024-09-15T23:20:28.198348+0000","last_active":"2024-09-15T23:20:30.478169+0000","last_peered":"2024-09-15T23:20:30.478169+0000","last_clean":"2024-09-15T23:20:30.478169+0000","last_became_active":"2024-09-15T23:20:28.198008+0000","last_became_peered":"2024-09-15T23:20:28.198008+0000","last_unstale":"2024-09-15T23:20:30.478169+0000","last_undegraded":"2024-09-15T23:20:30.478169+0000","last_fullsized":"2024-09-15T23:20:30.478169+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:02.473781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478031+0000","last_change":"2024-09-15T23:20:29.198415+0000","last_active":"2024-09-15T23:20:30.478031+0000","last_peered":"2024-09-15T23:20:30.478031+0000","last_clean":"2024-09-15T23:20:30.478031+0000","last_became_active":"2024-09-15T23:20:29.197633+0000","last_became_peered":"2024-09-15T23:20:29.197633+0000","last_unstale":"2024-09-15T23:20:30.478031+0000","last_undegraded":"2024-09-15T23:20:30.478031+0000","last_fullsized":"2024-09-15T23:20:30.478031+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:57:53.269720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.196904+0000","last_change":"2024-09-15T23:20:28.200763+0000","last_active":"2024-09-15T23:20:30.196904+0000","last_peered":"2024-09-15T23:20:30.196904+0000","last_clean":"2024-09-15T23:20:30.196904+0000","last_became_active":"2024-09-15T23:20:28.200468+0000","last_became_peered":"2024-09-15T23:20:28.200468+0000","last_unstale":"2024-09-15T23:20:30.196904+0000","last_undegraded":"2024-09-15T23:20:30.196904+0000","last_fullsized":"2024-09-15T23:20:30.196904+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:17:09.912049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.188057+0000","last_change":"2024-09-15T23:20:28.188057+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.188057+0000","last_undegraded":"2024-09-15T23:20:28.188057+0000","last_fullsized":"2024-09-15T23:20:28.188057+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.203773+0000","last_change":"2024-09-15T23:20:28.202777+0000","last_active":"2024-09-15T23:20:28.203773+0000","last_peered":"2024-09-15T23:20:28.203773+0000","last_clean":"2024-09-15T23:20:28.203773+0000","last_became_active":"2024-09-15T23:20:28.200455+0000","last_became_peered":"2024-09-15T23:20:28.200455+0000","last_unstale":"2024-09-15T23:20:28.203773+0000","last_undegraded":"2024-09-15T23:20:28.203773+0000","last_fullsized":"2024-09-15T23:20:28.203773+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:35:43.619546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.187770+0000","last_change":"2024-09-15T23:20:28.187770+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.187770+0000","last_undegraded":"2024-09-15T23:20:28.187770+0000","last_fullsized":"2024-09-15T23:20:28.187770+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.195144+0000","last_change":"2024-09-15T23:20:28.194389+0000","last_active":"2024-09-15T23:20:28.195144+0000","last_peered":"2024-09-15T23:20:28.195144+0000","last_clean":"2024-09-15T23:20:28.195144+0000","last_became_active":"2024-09-15T23:20:28.194128+0000","last_became_peered":"2024-09-15T23:20:28.194128+0000","last_unstale":"2024-09-15T23:20:28.195144+0000","last_undegraded":"2024-09-15T23:20:28.195144+0000","last_fullsized":"2024-09-15T23:20:28.195144+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:47:19.506387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":1,"reported_epoch":152,"state":"creating+peering","last_fresh":"2024-09-15T23:20:28.192137+0000","last_change":"2024-09-15T23:20:28.192137+0000","last_active":"2024-09-15T23:20:28.179054+0000","last_peered":"2024-09-15T23:20:28.179054+0000","last_clean":"2024-09-15T23:20:28.179054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:20:28.192137+0000","last_undegraded":"2024-09-15T23:20:28.192137+0000","last_fullsized":"2024-09-15T23:20:28.192137+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513085+0000","last_change":"2024-09-15T23:20:28.205782+0000","last_active":"2024-09-15T23:20:30.513085+0000","last_peered":"2024-09-15T23:20:30.513085+0000","last_clean":"2024-09-15T23:20:30.513085+0000","last_became_active":"2024-09-15T23:20:28.205426+0000","last_became_peered":"2024-09-15T23:20:28.205426+0000","last_unstale":"2024-09-15T23:20:30.513085+0000","last_undegraded":"2024-09-15T23:20:30.513085+0000","last_fullsized":"2024-09-15T23:20:30.513085+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:05:46.878996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478039+0000","last_change":"2024-09-15T23:20:29.199433+0000","last_active":"2024-09-15T23:20:30.478039+0000","last_peered":"2024-09-15T23:20:30.478039+0000","last_clean":"2024-09-15T23:20:30.478039+0000","last_became_active":"2024-09-15T23:20:29.198927+0000","last_became_peered":"2024-09-15T23:20:29.198927+0000","last_unstale":"2024-09-15T23:20:30.478039+0000","last_undegraded":"2024-09-15T23:20:30.478039+0000","last_fullsized":"2024-09-15T23:20:30.478039+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:40:14.188975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.197934+0000","last_change":"2024-09-15T23:20:28.197023+0000","last_active":"2024-09-15T23:20:28.197934+0000","last_peered":"2024-09-15T23:20:28.197934+0000","last_clean":"2024-09-15T23:20:28.197934+0000","last_became_active":"2024-09-15T23:20:28.196602+0000","last_became_peered":"2024-09-15T23:20:28.196602+0000","last_unstale":"2024-09-15T23:20:28.197934+0000","last_undegraded":"2024-09-15T23:20:28.197934+0000","last_fullsized":"2024-09-15T23:20:28.197934+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:40:34.004979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":412,"reported_epoch":152,"state":"active+clean","last_fresh":"2024-09-15T23:20:28.195204+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:20:28.195204+0000","last_peered":"2024-09-15T23:20:28.195204+0000","last_clean":"2024-09-15T23:20:28.195204+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:20:28.195204+0000","last_undegraded":"2024-09-15T23:20:28.195204+0000","last_fullsized":"2024-09-15T23:20:28.195204+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":1682,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":4022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51084,"kb_used_data":1844,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320756,"statfs":{"total":96636764160,"available":96584454144,"internally_reserved":0,"allocated":1888256,"data_stored":832212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476840,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51068,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320772,"statfs":{"total":96636764160,"available":96584470528,"internally_reserved":0,"allocated":1875968,"data_stored":825937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476842,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47504,"kb_used_data":2424,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324336,"statfs":{"total":96636764160,"available":96588120064,"internally_reserved":0,"allocated":2482176,"data_stored":1422580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476842,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41344,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330496,"statfs":{"total":96636764160,"available":96594427904,"internally_reserved":0,"allocated":1875968,"data_stored":825937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542249,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28900,"kb_used_data":1868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342940,"statfs":{"total":96636764160,"available":96607170560,"internally_reserved":0,"allocated":1912832,"data_stored":845287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542249,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51108,"kb_used_data":1868,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320732,"statfs":{"total":96636764160,"available":96584429568,"internally_reserved":0,"allocated":1912832,"data_stored":845287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542248,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55876,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315964,"statfs":{"total":96636764160,"available":96579547136,"internally_reserved":0,"allocated":2531328,"data_stored":1437461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542250,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51132,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320708,"statfs":{"total":96636764160,"available":96584404992,"internally_reserved":0,"allocated":1933312,"data_stored":847503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:20:36.588 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:20:36.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.704+0000 7f371c331640 1 Processor -- start 2024-09-15T23:20:36.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.704+0000 7f371c331640 1 -- start start 2024-09-15T23:20:36.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.705+0000 7f371c331640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f371415ed20 0x7f37140b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:36.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.705+0000 7f371c331640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37140b90e0 0x7f37140b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:36.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.705+0000 7f371c331640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37140d0e70 con 0x7f37140d23b0 2024-09-15T23:20:36.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.705+0000 7f371c331640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f37140d41c0 con 0x7f371415ed20 2024-09-15T23:20:36.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.705+0000 7f371c331640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f37140d35b0 con 0x7f37140b90e0 2024-09-15T23:20:36.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.705+0000 7f371a0cd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f371415ed20 0x7f37140b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:36.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.705+0000 7f371a0cd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f371415ed20 0x7f37140b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39292/0 (socket says 172.21.15.123:39292) 2024-09-15T23:20:36.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.705+0000 7f371a0cd640 1 -- 172.21.15.123:0/1622677009 learned_addr learned my addr 172.21.15.123:0/1622677009 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:36.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.705+0000 7f371a8ce640 1 --2- 172.21.15.123:0/1622677009 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37140b90e0 0x7f37140b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:36.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.705+0000 7f371a0cd640 1 -- 172.21.15.123:0/1622677009 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37140b90e0 msgr2=0x7f37140b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:36.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.705+0000 7f371a0cd640 1 --2- 172.21.15.123:0/1622677009 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37140b90e0 0x7f37140b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:36.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.705+0000 7f371a0cd640 1 -- 172.21.15.123:0/1622677009 >> v1:172.21.15.123:6789/0 conn(0x7f37140d23b0 legacy=0x7f37140cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:36.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.705+0000 7f371a0cd640 1 -- 172.21.15.123:0/1622677009 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37140d3890 con 0x7f371415ed20 2024-09-15T23:20:36.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.705+0000 7f37190cb640 1 -- 172.21.15.123:0/1622677009 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 272674981 0 0) 0x7f3710001110 con 0x7f37140d23b0 2024-09-15T23:20:36.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.706+0000 7f371a0cd640 1 --2- 172.21.15.123:0/1622677009 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f371415ed20 0x7f37140b6260 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f3708009870 tx=0x7f370802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce01eb0087d29372 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:36.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.706+0000 7f37190cb640 1 -- 172.21.15.123:0/1622677009 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3708037070 con 0x7f371415ed20 2024-09-15T23:20:36.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.706+0000 7f37190cb640 1 -- 172.21.15.123:0/1622677009 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3708032440 con 0x7f371415ed20 2024-09-15T23:20:36.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.706+0000 7f37190cb640 1 -- 172.21.15.123:0/1622677009 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3708032810 con 0x7f371415ed20 2024-09-15T23:20:36.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.707+0000 7f371c331640 1 -- 172.21.15.123:0/1622677009 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f371415ed20 msgr2=0x7f37140b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:36.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.707+0000 7f371c331640 1 --2- 172.21.15.123:0/1622677009 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f371415ed20 0x7f37140b6260 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f3708009870 tx=0x7f370802a1c0 comp rx=0 tx=0).stop 2024-09-15T23:20:36.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.707+0000 7f371c331640 1 -- 172.21.15.123:0/1622677009 shutdown_connections 2024-09-15T23:20:36.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.707+0000 7f371c331640 1 --2- 172.21.15.123:0/1622677009 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37140b90e0 0x7f37140b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:36.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.707+0000 7f371c331640 1 --2- 172.21.15.123:0/1622677009 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f371415ed20 0x7f37140b6260 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:36.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.707+0000 7f371c331640 1 -- 172.21.15.123:0/1622677009 >> 172.21.15.123:0/1622677009 conn(0x7f37140d1260 msgr2=0x7f37140d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:36.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.707+0000 7f371c331640 1 -- 172.21.15.123:0/1622677009 shutdown_connections 2024-09-15T23:20:36.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.707+0000 7f371c331640 1 -- 172.21.15.123:0/1622677009 wait complete. 2024-09-15T23:20:36.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.708+0000 7f371c331640 1 Processor -- start 2024-09-15T23:20:36.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.708+0000 7f371c331640 1 -- start start 2024-09-15T23:20:36.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.709+0000 7f371c331640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37140b90e0 0x7f37140cd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:36.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.709+0000 7f371c331640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37140d23b0 0x7f371415c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:36.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.709+0000 7f371c331640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f371415ed20 0x7f37141e8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:36.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.709+0000 7f371c331640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f37140d32a0 con 0x7f37140d23b0 2024-09-15T23:20:36.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.709+0000 7f371c331640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f37140d3e50 con 0x7f371415ed20 2024-09-15T23:20:36.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.709+0000 7f371c331640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f371415f100 con 0x7f37140b90e0 2024-09-15T23:20:36.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.709+0000 7f37198cc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37140d23b0 0x7f371415c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:36.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.709+0000 7f37198cc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37140d23b0 0x7f371415c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39296/0 (socket says 172.21.15.123:39296) 2024-09-15T23:20:36.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.709+0000 7f37198cc640 1 -- 172.21.15.123:0/1391278670 learned_addr learned my addr 172.21.15.123:0/1391278670 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:36.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.709+0000 7f371a0cd640 1 --2- 172.21.15.123:0/1391278670 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37140b90e0 0x7f37140cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:36.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.709+0000 7f371a8ce640 1 --2- 172.21.15.123:0/1391278670 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f371415ed20 0x7f37141e8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:36.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.709+0000 7f37198cc640 1 -- 172.21.15.123:0/1391278670 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37140b90e0 msgr2=0x7f37140cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:36.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.709+0000 7f37198cc640 1 --2- 172.21.15.123:0/1391278670 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37140b90e0 0x7f37140cd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:36.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.709+0000 7f37198cc640 1 -- 172.21.15.123:0/1391278670 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f371415ed20 msgr2=0x7f37141e8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:36.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.709+0000 7f37198cc640 1 --2- 172.21.15.123:0/1391278670 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f371415ed20 0x7f37141e8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:36.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.710+0000 7f37198cc640 1 -- 172.21.15.123:0/1391278670 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f371415db80 con 0x7f37140d23b0 2024-09-15T23:20:36.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.710+0000 7f371a0cd640 1 --2- 172.21.15.123:0/1391278670 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37140b90e0 0x7f37140cd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:20:36.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.710+0000 7f371a8ce640 1 --2- 172.21.15.123:0/1391278670 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f371415ed20 0x7f37141e8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:20:36.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.710+0000 7f37198cc640 1 --2- 172.21.15.123:0/1391278670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37140d23b0 0x7f371415c410 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f371000c750 tx=0x7f371000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:36.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.710+0000 7f3706ffd640 1 -- 172.21.15.123:0/1391278670 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3710017070 con 0x7f37140d23b0 2024-09-15T23:20:36.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.710+0000 7f3706ffd640 1 -- 172.21.15.123:0/1391278670 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37100052b0 con 0x7f37140d23b0 2024-09-15T23:20:36.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.710+0000 7f371c331640 1 -- 172.21.15.123:0/1391278670 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f371415de60 con 0x7f37140d23b0 2024-09-15T23:20:36.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.710+0000 7f3706ffd640 1 -- 172.21.15.123:0/1391278670 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371000a880 con 0x7f37140d23b0 2024-09-15T23:20:36.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.710+0000 7f371c331640 1 -- 172.21.15.123:0/1391278670 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f371415f6f0 con 0x7f37140d23b0 2024-09-15T23:20:36.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.711+0000 7f371c331640 1 -- 172.21.15.123:0/1391278670 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f371415f8f0 con 0x7f37140d23b0 2024-09-15T23:20:36.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.711+0000 7f3706ffd640 1 -- 172.21.15.123:0/1391278670 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f371001a070 con 0x7f37140d23b0 2024-09-15T23:20:36.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.712+0000 7f3706ffd640 1 --2- 172.21.15.123:0/1391278670 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f36f806c2b0 0x7f36f806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:36.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.712+0000 7f3706ffd640 1 -- 172.21.15.123:0/1391278670 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f371008a6c0 con 0x7f37140d23b0 2024-09-15T23:20:36.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.712+0000 7f371a0cd640 1 --2- 172.21.15.123:0/1391278670 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f36f806c2b0 0x7f36f806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:36.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.713+0000 7f371a0cd640 1 --2- 172.21.15.123:0/1391278670 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f36f806c2b0 0x7f36f806e770 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f3708034000 tx=0x7f370802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:36.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.717+0000 7f3706ffd640 1 -- 172.21.15.123:0/1391278670 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f371415f8f0 con 0x7f37140d23b0 2024-09-15T23:20:36.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.878+0000 7f371c331640 1 -- 172.21.15.123:0/1391278670 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f37140b7010 con 0x7f36f806c2b0 2024-09-15T23:20:36.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.885+0000 7f3706ffd640 1 -- 172.21.15.123:0/1391278670 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252481 (secure 0 0 0) 0x7f37140b7010 con 0x7f36f806c2b0 2024-09-15T23:20:36.889 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:36.890 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:20:36.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.888+0000 7f371c331640 1 -- 172.21.15.123:0/1391278670 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f36f806c2b0 msgr2=0x7f36f806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:36.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.888+0000 7f371c331640 1 --2- 172.21.15.123:0/1391278670 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f36f806c2b0 0x7f36f806e770 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f3708034000 tx=0x7f370802e000 comp rx=0 tx=0).stop 2024-09-15T23:20:36.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.888+0000 7f371c331640 1 -- 172.21.15.123:0/1391278670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37140d23b0 msgr2=0x7f371415c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:36.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.888+0000 7f371c331640 1 --2- 172.21.15.123:0/1391278670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37140d23b0 0x7f371415c410 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f371000c750 tx=0x7f371000cc10 comp rx=0 tx=0).stop 2024-09-15T23:20:36.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.888+0000 7f371c331640 1 -- 172.21.15.123:0/1391278670 shutdown_connections 2024-09-15T23:20:36.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.888+0000 7f371c331640 1 --2- 172.21.15.123:0/1391278670 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f371415ed20 0x7f37141e8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:36.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.888+0000 7f371c331640 1 --2- 172.21.15.123:0/1391278670 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f36f806c2b0 0x7f36f806e770 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:36.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.888+0000 7f371c331640 1 --2- 172.21.15.123:0/1391278670 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37140d23b0 0x7f371415c410 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:36.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.888+0000 7f371c331640 1 --2- 172.21.15.123:0/1391278670 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37140b90e0 0x7f37140cd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:36.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.888+0000 7f371c331640 1 -- 172.21.15.123:0/1391278670 >> 172.21.15.123:0/1391278670 conn(0x7f37140d1260 msgr2=0x7f37140b4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:36.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.888+0000 7f371c331640 1 -- 172.21.15.123:0/1391278670 shutdown_connections 2024-09-15T23:20:36.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:36.888+0000 7f371c331640 1 -- 172.21.15.123:0/1391278670 wait complete. 2024-09-15T23:20:36.901 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":404,"stamp":"2024-09-15T23:20:35.623074+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":382312,"kb_used_data":16168,"kb_used_omap":12,"kb_used_meta":365939,"kb_avail":754592408,"statfs":{"total":773094113280,"available":772702625792,"internally_reserved":0,"allocated":16556032,"data_stored":7947852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":374722096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.437090"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.514159+0000","last_change":"2024-09-15T23:20:29.210825+0000","last_active":"2024-09-15T23:20:30.514159+0000","last_peered":"2024-09-15T23:20:30.514159+0000","last_clean":"2024-09-15T23:20:30.514159+0000","last_became_active":"2024-09-15T23:20:29.209560+0000","last_became_peered":"2024-09-15T23:20:29.209560+0000","last_unstale":"2024-09-15T23:20:30.514159+0000","last_undegraded":"2024-09-15T23:20:30.514159+0000","last_fullsized":"2024-09-15T23:20:30.514159+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:01.209675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197440+0000","last_change":"2024-09-15T23:20:29.213201+0000","last_active":"2024-09-15T23:20:30.197440+0000","last_peered":"2024-09-15T23:20:30.197440+0000","last_clean":"2024-09-15T23:20:30.197440+0000","last_became_active":"2024-09-15T23:20:29.212739+0000","last_became_peered":"2024-09-15T23:20:29.212739+0000","last_unstale":"2024-09-15T23:20:30.197440+0000","last_undegraded":"2024-09-15T23:20:30.197440+0000","last_fullsized":"2024-09-15T23:20:30.197440+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:47:20.508671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.198043+0000","last_change":"2024-09-15T23:20:29.197407+0000","last_active":"2024-09-15T23:20:30.198043+0000","last_peered":"2024-09-15T23:20:30.198043+0000","last_clean":"2024-09-15T23:20:30.198043+0000","last_became_active":"2024-09-15T23:20:29.197164+0000","last_became_peered":"2024-09-15T23:20:29.197164+0000","last_unstale":"2024-09-15T23:20:30.198043+0000","last_undegraded":"2024-09-15T23:20:30.198043+0000","last_fullsized":"2024-09-15T23:20:30.198043+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:57:25.951841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.477553+0000","last_change":"2024-09-15T23:20:29.200507+0000","last_active":"2024-09-15T23:20:30.477553+0000","last_peered":"2024-09-15T23:20:30.477553+0000","last_clean":"2024-09-15T23:20:30.477553+0000","last_became_active":"2024-09-15T23:20:29.200235+0000","last_became_peered":"2024-09-15T23:20:29.200235+0000","last_unstale":"2024-09-15T23:20:30.477553+0000","last_undegraded":"2024-09-15T23:20:30.477553+0000","last_fullsized":"2024-09-15T23:20:30.477553+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:15.843982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.198858+0000","last_change":"2024-09-15T23:20:29.209826+0000","last_active":"2024-09-15T23:20:30.198858+0000","last_peered":"2024-09-15T23:20:30.198858+0000","last_clean":"2024-09-15T23:20:30.198858+0000","last_became_active":"2024-09-15T23:20:29.209566+0000","last_became_peered":"2024-09-15T23:20:29.209566+0000","last_unstale":"2024-09-15T23:20:30.198858+0000","last_undegraded":"2024-09-15T23:20:30.198858+0000","last_fullsized":"2024-09-15T23:20:30.198858+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:36:40.809233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513482+0000","last_change":"2024-09-15T23:20:29.204397+0000","last_active":"2024-09-15T23:20:30.513482+0000","last_peered":"2024-09-15T23:20:30.513482+0000","last_clean":"2024-09-15T23:20:30.513482+0000","last_became_active":"2024-09-15T23:20:29.204136+0000","last_became_peered":"2024-09-15T23:20:29.204136+0000","last_unstale":"2024-09-15T23:20:30.513482+0000","last_undegraded":"2024-09-15T23:20:30.513482+0000","last_fullsized":"2024-09-15T23:20:30.513482+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:59.246406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.477898+0000","last_change":"2024-09-15T23:20:29.201027+0000","last_active":"2024-09-15T23:20:30.477898+0000","last_peered":"2024-09-15T23:20:30.477898+0000","last_clean":"2024-09-15T23:20:30.477898+0000","last_became_active":"2024-09-15T23:20:29.200749+0000","last_became_peered":"2024-09-15T23:20:29.200749+0000","last_unstale":"2024-09-15T23:20:30.477898+0000","last_undegraded":"2024-09-15T23:20:30.477898+0000","last_fullsized":"2024-09-15T23:20:30.477898+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:19:41.540281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513824+0000","last_change":"2024-09-15T23:20:29.204750+0000","last_active":"2024-09-15T23:20:30.513824+0000","last_peered":"2024-09-15T23:20:30.513824+0000","last_clean":"2024-09-15T23:20:30.513824+0000","last_became_active":"2024-09-15T23:20:29.204302+0000","last_became_peered":"2024-09-15T23:20:29.204302+0000","last_unstale":"2024-09-15T23:20:30.513824+0000","last_undegraded":"2024-09-15T23:20:30.513824+0000","last_fullsized":"2024-09-15T23:20:30.513824+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:39:22.123870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513438+0000","last_change":"2024-09-15T23:20:29.208508+0000","last_active":"2024-09-15T23:20:30.513438+0000","last_peered":"2024-09-15T23:20:30.513438+0000","last_clean":"2024-09-15T23:20:30.513438+0000","last_became_active":"2024-09-15T23:20:29.208205+0000","last_became_peered":"2024-09-15T23:20:29.208205+0000","last_unstale":"2024-09-15T23:20:30.513438+0000","last_undegraded":"2024-09-15T23:20:30.513438+0000","last_fullsized":"2024-09-15T23:20:30.513438+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:12.809369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.198106+0000","last_change":"2024-09-15T23:20:29.199483+0000","last_active":"2024-09-15T23:20:30.198106+0000","last_peered":"2024-09-15T23:20:30.198106+0000","last_clean":"2024-09-15T23:20:30.198106+0000","last_became_active":"2024-09-15T23:20:29.199231+0000","last_became_peered":"2024-09-15T23:20:29.199231+0000","last_unstale":"2024-09-15T23:20:30.198106+0000","last_undegraded":"2024-09-15T23:20:30.198106+0000","last_fullsized":"2024-09-15T23:20:30.198106+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:03:46.204746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513577+0000","last_change":"2024-09-15T23:20:29.201060+0000","last_active":"2024-09-15T23:20:30.513577+0000","last_peered":"2024-09-15T23:20:30.513577+0000","last_clean":"2024-09-15T23:20:30.513577+0000","last_became_active":"2024-09-15T23:20:29.200789+0000","last_became_peered":"2024-09-15T23:20:29.200789+0000","last_unstale":"2024-09-15T23:20:30.513577+0000","last_undegraded":"2024-09-15T23:20:30.513577+0000","last_fullsized":"2024-09-15T23:20:30.513577+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:14:48.987519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.369546+0000","last_change":"2024-09-15T23:20:29.203336+0000","last_active":"2024-09-15T23:20:30.369546+0000","last_peered":"2024-09-15T23:20:30.369546+0000","last_clean":"2024-09-15T23:20:30.369546+0000","last_became_active":"2024-09-15T23:20:29.203057+0000","last_became_peered":"2024-09-15T23:20:29.203057+0000","last_unstale":"2024-09-15T23:20:30.369546+0000","last_undegraded":"2024-09-15T23:20:30.369546+0000","last_fullsized":"2024-09-15T23:20:30.369546+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:01.630582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.198880+0000","last_change":"2024-09-15T23:20:29.206057+0000","last_active":"2024-09-15T23:20:30.198880+0000","last_peered":"2024-09-15T23:20:30.198880+0000","last_clean":"2024-09-15T23:20:30.198880+0000","last_became_active":"2024-09-15T23:20:29.205673+0000","last_became_peered":"2024-09-15T23:20:29.205673+0000","last_unstale":"2024-09-15T23:20:30.198880+0000","last_undegraded":"2024-09-15T23:20:30.198880+0000","last_fullsized":"2024-09-15T23:20:30.198880+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:33:09.211435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.369378+0000","last_change":"2024-09-15T23:20:29.199087+0000","last_active":"2024-09-15T23:20:30.369378+0000","last_peered":"2024-09-15T23:20:30.369378+0000","last_clean":"2024-09-15T23:20:30.369378+0000","last_became_active":"2024-09-15T23:20:29.198880+0000","last_became_peered":"2024-09-15T23:20:29.198880+0000","last_unstale":"2024-09-15T23:20:30.369378+0000","last_undegraded":"2024-09-15T23:20:30.369378+0000","last_fullsized":"2024-09-15T23:20:30.369378+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:39:43.157906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.198724+0000","last_change":"2024-09-15T23:20:29.211741+0000","last_active":"2024-09-15T23:20:30.198724+0000","last_peered":"2024-09-15T23:20:30.198724+0000","last_clean":"2024-09-15T23:20:30.198724+0000","last_became_active":"2024-09-15T23:20:29.211508+0000","last_became_peered":"2024-09-15T23:20:29.211508+0000","last_unstale":"2024-09-15T23:20:30.198724+0000","last_undegraded":"2024-09-15T23:20:30.198724+0000","last_fullsized":"2024-09-15T23:20:30.198724+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:18.461119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.477851+0000","last_change":"2024-09-15T23:20:29.204046+0000","last_active":"2024-09-15T23:20:30.477851+0000","last_peered":"2024-09-15T23:20:30.477851+0000","last_clean":"2024-09-15T23:20:30.477851+0000","last_became_active":"2024-09-15T23:20:29.203700+0000","last_became_peered":"2024-09-15T23:20:29.203700+0000","last_unstale":"2024-09-15T23:20:30.477851+0000","last_undegraded":"2024-09-15T23:20:30.477851+0000","last_fullsized":"2024-09-15T23:20:30.477851+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:39:17.409757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.198067+0000","last_change":"2024-09-15T23:20:29.201720+0000","last_active":"2024-09-15T23:20:30.198067+0000","last_peered":"2024-09-15T23:20:30.198067+0000","last_clean":"2024-09-15T23:20:30.198067+0000","last_became_active":"2024-09-15T23:20:29.201473+0000","last_became_peered":"2024-09-15T23:20:29.201473+0000","last_unstale":"2024-09-15T23:20:30.198067+0000","last_undegraded":"2024-09-15T23:20:30.198067+0000","last_fullsized":"2024-09-15T23:20:30.198067+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:55:07.115266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.198802+0000","last_change":"2024-09-15T23:20:29.208420+0000","last_active":"2024-09-15T23:20:30.198802+0000","last_peered":"2024-09-15T23:20:30.198802+0000","last_clean":"2024-09-15T23:20:30.198802+0000","last_became_active":"2024-09-15T23:20:29.208170+0000","last_became_peered":"2024-09-15T23:20:29.208170+0000","last_unstale":"2024-09-15T23:20:30.198802+0000","last_undegraded":"2024-09-15T23:20:30.198802+0000","last_fullsized":"2024-09-15T23:20:30.198802+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:55:00.825144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513910+0000","last_change":"2024-09-15T23:20:29.205307+0000","last_active":"2024-09-15T23:20:30.513910+0000","last_peered":"2024-09-15T23:20:30.513910+0000","last_clean":"2024-09-15T23:20:30.513910+0000","last_became_active":"2024-09-15T23:20:29.202606+0000","last_became_peered":"2024-09-15T23:20:29.202606+0000","last_unstale":"2024-09-15T23:20:30.513910+0000","last_undegraded":"2024-09-15T23:20:30.513910+0000","last_fullsized":"2024-09-15T23:20:30.513910+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:13:55.411259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513840+0000","last_change":"2024-09-15T23:20:29.206689+0000","last_active":"2024-09-15T23:20:30.513840+0000","last_peered":"2024-09-15T23:20:30.513840+0000","last_clean":"2024-09-15T23:20:30.513840+0000","last_became_active":"2024-09-15T23:20:29.206438+0000","last_became_peered":"2024-09-15T23:20:29.206438+0000","last_unstale":"2024-09-15T23:20:30.513840+0000","last_undegraded":"2024-09-15T23:20:30.513840+0000","last_fullsized":"2024-09-15T23:20:30.513840+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:32.736263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197919+0000","last_change":"2024-09-15T23:20:29.201966+0000","last_active":"2024-09-15T23:20:30.197919+0000","last_peered":"2024-09-15T23:20:30.197919+0000","last_clean":"2024-09-15T23:20:30.197919+0000","last_became_active":"2024-09-15T23:20:29.201326+0000","last_became_peered":"2024-09-15T23:20:29.201326+0000","last_unstale":"2024-09-15T23:20:30.197919+0000","last_undegraded":"2024-09-15T23:20:30.197919+0000","last_fullsized":"2024-09-15T23:20:30.197919+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:20:34.336553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.369568+0000","last_change":"2024-09-15T23:20:29.198616+0000","last_active":"2024-09-15T23:20:30.369568+0000","last_peered":"2024-09-15T23:20:30.369568+0000","last_clean":"2024-09-15T23:20:30.369568+0000","last_became_active":"2024-09-15T23:20:29.198375+0000","last_became_peered":"2024-09-15T23:20:29.198375+0000","last_unstale":"2024-09-15T23:20:30.369568+0000","last_undegraded":"2024-09-15T23:20:30.369568+0000","last_fullsized":"2024-09-15T23:20:30.369568+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:06.922555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.477232+0000","last_change":"2024-09-15T23:20:29.202429+0000","last_active":"2024-09-15T23:20:30.477232+0000","last_peered":"2024-09-15T23:20:30.477232+0000","last_clean":"2024-09-15T23:20:30.477232+0000","last_became_active":"2024-09-15T23:20:29.202161+0000","last_became_peered":"2024-09-15T23:20:29.202161+0000","last_unstale":"2024-09-15T23:20:30.477232+0000","last_undegraded":"2024-09-15T23:20:30.477232+0000","last_fullsized":"2024-09-15T23:20:30.477232+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:38.347629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.198571+0000","last_change":"2024-09-15T23:20:29.206671+0000","last_active":"2024-09-15T23:20:30.198571+0000","last_peered":"2024-09-15T23:20:30.198571+0000","last_clean":"2024-09-15T23:20:30.198571+0000","last_became_active":"2024-09-15T23:20:29.206412+0000","last_became_peered":"2024-09-15T23:20:29.206412+0000","last_unstale":"2024-09-15T23:20:30.198571+0000","last_undegraded":"2024-09-15T23:20:30.198571+0000","last_fullsized":"2024-09-15T23:20:30.198571+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:49.888727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197183+0000","last_change":"2024-09-15T23:20:29.203623+0000","last_active":"2024-09-15T23:20:30.197183+0000","last_peered":"2024-09-15T23:20:30.197183+0000","last_clean":"2024-09-15T23:20:30.197183+0000","last_became_active":"2024-09-15T23:20:29.203345+0000","last_became_peered":"2024-09-15T23:20:29.203345+0000","last_unstale":"2024-09-15T23:20:30.197183+0000","last_undegraded":"2024-09-15T23:20:30.197183+0000","last_fullsized":"2024-09-15T23:20:30.197183+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:54.343998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.514075+0000","last_change":"2024-09-15T23:20:29.210780+0000","last_active":"2024-09-15T23:20:30.514075+0000","last_peered":"2024-09-15T23:20:30.514075+0000","last_clean":"2024-09-15T23:20:30.514075+0000","last_became_active":"2024-09-15T23:20:29.210430+0000","last_became_peered":"2024-09-15T23:20:29.210430+0000","last_unstale":"2024-09-15T23:20:30.514075+0000","last_undegraded":"2024-09-15T23:20:30.514075+0000","last_fullsized":"2024-09-15T23:20:30.514075+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:03.050568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197008+0000","last_change":"2024-09-15T23:20:29.206551+0000","last_active":"2024-09-15T23:20:30.197008+0000","last_peered":"2024-09-15T23:20:30.197008+0000","last_clean":"2024-09-15T23:20:30.197008+0000","last_became_active":"2024-09-15T23:20:29.206047+0000","last_became_peered":"2024-09-15T23:20:29.206047+0000","last_unstale":"2024-09-15T23:20:30.197008+0000","last_undegraded":"2024-09-15T23:20:30.197008+0000","last_fullsized":"2024-09-15T23:20:30.197008+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:29.017905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197338+0000","last_change":"2024-09-15T23:20:29.213045+0000","last_active":"2024-09-15T23:20:30.197338+0000","last_peered":"2024-09-15T23:20:30.197338+0000","last_clean":"2024-09-15T23:20:30.197338+0000","last_became_active":"2024-09-15T23:20:29.212610+0000","last_became_peered":"2024-09-15T23:20:29.212610+0000","last_unstale":"2024-09-15T23:20:30.197338+0000","last_undegraded":"2024-09-15T23:20:30.197338+0000","last_fullsized":"2024-09-15T23:20:30.197338+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:16:34.134579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513344+0000","last_change":"2024-09-15T23:20:29.203828+0000","last_active":"2024-09-15T23:20:30.513344+0000","last_peered":"2024-09-15T23:20:30.513344+0000","last_clean":"2024-09-15T23:20:30.513344+0000","last_became_active":"2024-09-15T23:20:29.203540+0000","last_became_peered":"2024-09-15T23:20:29.203540+0000","last_unstale":"2024-09-15T23:20:30.513344+0000","last_undegraded":"2024-09-15T23:20:30.513344+0000","last_fullsized":"2024-09-15T23:20:30.513344+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:05.538292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.369556+0000","last_change":"2024-09-15T23:20:29.201738+0000","last_active":"2024-09-15T23:20:30.369556+0000","last_peered":"2024-09-15T23:20:30.369556+0000","last_clean":"2024-09-15T23:20:30.369556+0000","last_became_active":"2024-09-15T23:20:29.201344+0000","last_became_peered":"2024-09-15T23:20:29.201344+0000","last_unstale":"2024-09-15T23:20:30.369556+0000","last_undegraded":"2024-09-15T23:20:30.369556+0000","last_fullsized":"2024-09-15T23:20:30.369556+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:12:53.601466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.196949+0000","last_change":"2024-09-15T23:20:29.206312+0000","last_active":"2024-09-15T23:20:30.196949+0000","last_peered":"2024-09-15T23:20:30.196949+0000","last_clean":"2024-09-15T23:20:30.196949+0000","last_became_active":"2024-09-15T23:20:29.205751+0000","last_became_peered":"2024-09-15T23:20:29.205751+0000","last_unstale":"2024-09-15T23:20:30.196949+0000","last_undegraded":"2024-09-15T23:20:30.196949+0000","last_fullsized":"2024-09-15T23:20:30.196949+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:15.386192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.196748+0000","last_change":"2024-09-15T23:20:29.204281+0000","last_active":"2024-09-15T23:20:30.196748+0000","last_peered":"2024-09-15T23:20:30.196748+0000","last_clean":"2024-09-15T23:20:30.196748+0000","last_became_active":"2024-09-15T23:20:29.203688+0000","last_became_peered":"2024-09-15T23:20:29.203688+0000","last_unstale":"2024-09-15T23:20:30.196748+0000","last_undegraded":"2024-09-15T23:20:30.196748+0000","last_fullsized":"2024-09-15T23:20:30.196748+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:41:08.800648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.198941+0000","last_change":"2024-09-15T23:20:29.210808+0000","last_active":"2024-09-15T23:20:30.198941+0000","last_peered":"2024-09-15T23:20:30.198941+0000","last_clean":"2024-09-15T23:20:30.198941+0000","last_became_active":"2024-09-15T23:20:29.210545+0000","last_became_peered":"2024-09-15T23:20:29.210545+0000","last_unstale":"2024-09-15T23:20:30.198941+0000","last_undegraded":"2024-09-15T23:20:30.198941+0000","last_fullsized":"2024-09-15T23:20:30.198941+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:15.671243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"153'4","reported_seq":18,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.198124+0000","last_change":"2024-09-15T23:20:28.204655+0000","last_active":"2024-09-15T23:20:30.198124+0000","last_peered":"2024-09-15T23:20:30.198124+0000","last_clean":"2024-09-15T23:20:30.198124+0000","last_became_active":"2024-09-15T23:20:28.204276+0000","last_became_peered":"2024-09-15T23:20:28.204276+0000","last_unstale":"2024-09-15T23:20:30.198124+0000","last_undegraded":"2024-09-15T23:20:30.198124+0000","last_fullsized":"2024-09-15T23:20:30.198124+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:38:26.153542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478220+0000","last_change":"2024-09-15T23:20:29.211788+0000","last_active":"2024-09-15T23:20:30.478220+0000","last_peered":"2024-09-15T23:20:30.478220+0000","last_clean":"2024-09-15T23:20:30.478220+0000","last_became_active":"2024-09-15T23:20:29.211520+0000","last_became_peered":"2024-09-15T23:20:29.211520+0000","last_unstale":"2024-09-15T23:20:30.478220+0000","last_undegraded":"2024-09-15T23:20:30.478220+0000","last_fullsized":"2024-09-15T23:20:30.478220+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:11:54.598151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.1e","version":"153'1","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513593+0000","last_change":"2024-09-15T23:20:28.205670+0000","last_active":"2024-09-15T23:20:30.513593+0000","last_peered":"2024-09-15T23:20:30.513593+0000","last_clean":"2024-09-15T23:20:30.513593+0000","last_became_active":"2024-09-15T23:20:28.205375+0000","last_became_peered":"2024-09-15T23:20:28.205375+0000","last_unstale":"2024-09-15T23:20:30.513593+0000","last_undegraded":"2024-09-15T23:20:30.513593+0000","last_fullsized":"2024-09-15T23:20:30.513593+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:14.841698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513576+0000","last_change":"2024-09-15T23:20:29.199351+0000","last_active":"2024-09-15T23:20:30.513576+0000","last_peered":"2024-09-15T23:20:30.513576+0000","last_clean":"2024-09-15T23:20:30.513576+0000","last_became_active":"2024-09-15T23:20:29.199075+0000","last_became_peered":"2024-09-15T23:20:29.199075+0000","last_unstale":"2024-09-15T23:20:30.513576+0000","last_undegraded":"2024-09-15T23:20:30.513576+0000","last_fullsized":"2024-09-15T23:20:30.513576+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:35:52.283626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.1d","version":"153'2","reported_seq":16,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.198127+0000","last_change":"2024-09-15T23:20:28.205664+0000","last_active":"2024-09-15T23:20:30.198127+0000","last_peered":"2024-09-15T23:20:30.198127+0000","last_clean":"2024-09-15T23:20:30.198127+0000","last_became_active":"2024-09-15T23:20:28.205359+0000","last_became_peered":"2024-09-15T23:20:28.205359+0000","last_unstale":"2024-09-15T23:20:30.198127+0000","last_undegraded":"2024-09-15T23:20:30.198127+0000","last_fullsized":"2024-09-15T23:20:30.198127+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:57:28.072092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.477648+0000","last_change":"2024-09-15T23:20:29.200514+0000","last_active":"2024-09-15T23:20:30.477648+0000","last_peered":"2024-09-15T23:20:30.477648+0000","last_clean":"2024-09-15T23:20:30.477648+0000","last_became_active":"2024-09-15T23:20:29.200226+0000","last_became_peered":"2024-09-15T23:20:29.200226+0000","last_unstale":"2024-09-15T23:20:30.477648+0000","last_undegraded":"2024-09-15T23:20:30.477648+0000","last_fullsized":"2024-09-15T23:20:30.477648+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:20:05.108691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1c","version":"153'2","reported_seq":16,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197872+0000","last_change":"2024-09-15T23:20:28.198556+0000","last_active":"2024-09-15T23:20:30.197872+0000","last_peered":"2024-09-15T23:20:30.197872+0000","last_clean":"2024-09-15T23:20:30.197872+0000","last_became_active":"2024-09-15T23:20:28.198271+0000","last_became_peered":"2024-09-15T23:20:28.198271+0000","last_unstale":"2024-09-15T23:20:30.197872+0000","last_undegraded":"2024-09-15T23:20:30.197872+0000","last_fullsized":"2024-09-15T23:20:30.197872+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:12:00.652034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.196853+0000","last_change":"2024-09-15T23:20:29.210214+0000","last_active":"2024-09-15T23:20:30.196853+0000","last_peered":"2024-09-15T23:20:30.196853+0000","last_clean":"2024-09-15T23:20:30.196853+0000","last_became_active":"2024-09-15T23:20:29.209939+0000","last_became_peered":"2024-09-15T23:20:29.209939+0000","last_unstale":"2024-09-15T23:20:30.196853+0000","last_undegraded":"2024-09-15T23:20:30.196853+0000","last_fullsized":"2024-09-15T23:20:30.196853+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:26.238986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"153'1","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513467+0000","last_change":"2024-09-15T23:20:28.200879+0000","last_active":"2024-09-15T23:20:30.513467+0000","last_peered":"2024-09-15T23:20:30.513467+0000","last_clean":"2024-09-15T23:20:30.513467+0000","last_became_active":"2024-09-15T23:20:28.200596+0000","last_became_peered":"2024-09-15T23:20:28.200596+0000","last_unstale":"2024-09-15T23:20:30.513467+0000","last_undegraded":"2024-09-15T23:20:30.513467+0000","last_fullsized":"2024-09-15T23:20:30.513467+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:35.867315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.477588+0000","last_change":"2024-09-15T23:20:29.198420+0000","last_active":"2024-09-15T23:20:30.477588+0000","last_peered":"2024-09-15T23:20:30.477588+0000","last_clean":"2024-09-15T23:20:30.477588+0000","last_became_active":"2024-09-15T23:20:29.198165+0000","last_became_peered":"2024-09-15T23:20:29.198165+0000","last_unstale":"2024-09-15T23:20:30.477588+0000","last_undegraded":"2024-09-15T23:20:30.477588+0000","last_fullsized":"2024-09-15T23:20:30.477588+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:00.674162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1a","version":"153'1","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.198663+0000","last_change":"2024-09-15T23:20:28.205621+0000","last_active":"2024-09-15T23:20:30.198663+0000","last_peered":"2024-09-15T23:20:30.198663+0000","last_clean":"2024-09-15T23:20:30.198663+0000","last_became_active":"2024-09-15T23:20:28.205331+0000","last_became_peered":"2024-09-15T23:20:28.205331+0000","last_unstale":"2024-09-15T23:20:30.198663+0000","last_undegraded":"2024-09-15T23:20:30.198663+0000","last_fullsized":"2024-09-15T23:20:30.198663+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:05:44.463546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.196932+0000","last_change":"2024-09-15T23:20:29.204023+0000","last_active":"2024-09-15T23:20:30.196932+0000","last_peered":"2024-09-15T23:20:30.196932+0000","last_clean":"2024-09-15T23:20:30.196932+0000","last_became_active":"2024-09-15T23:20:29.203330+0000","last_became_peered":"2024-09-15T23:20:29.203330+0000","last_unstale":"2024-09-15T23:20:30.196932+0000","last_undegraded":"2024-09-15T23:20:30.196932+0000","last_fullsized":"2024-09-15T23:20:30.196932+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:42:17.443743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513228+0000","last_change":"2024-09-15T23:20:28.198319+0000","last_active":"2024-09-15T23:20:30.513228+0000","last_peered":"2024-09-15T23:20:30.513228+0000","last_clean":"2024-09-15T23:20:30.513228+0000","last_became_active":"2024-09-15T23:20:28.198037+0000","last_became_peered":"2024-09-15T23:20:28.198037+0000","last_unstale":"2024-09-15T23:20:30.513228+0000","last_undegraded":"2024-09-15T23:20:30.513228+0000","last_fullsized":"2024-09-15T23:20:30.513228+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:57:59.671879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.477385+0000","last_change":"2024-09-15T23:20:29.199912+0000","last_active":"2024-09-15T23:20:30.477385+0000","last_peered":"2024-09-15T23:20:30.477385+0000","last_clean":"2024-09-15T23:20:30.477385+0000","last_became_active":"2024-09-15T23:20:29.199603+0000","last_became_peered":"2024-09-15T23:20:29.199603+0000","last_unstale":"2024-09-15T23:20:30.477385+0000","last_undegraded":"2024-09-15T23:20:30.477385+0000","last_fullsized":"2024-09-15T23:20:30.477385+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:01:34.374643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197685+0000","last_change":"2024-09-15T23:20:28.202458+0000","last_active":"2024-09-15T23:20:30.197685+0000","last_peered":"2024-09-15T23:20:30.197685+0000","last_clean":"2024-09-15T23:20:30.197685+0000","last_became_active":"2024-09-15T23:20:28.201758+0000","last_became_peered":"2024-09-15T23:20:28.201758+0000","last_unstale":"2024-09-15T23:20:30.197685+0000","last_undegraded":"2024-09-15T23:20:30.197685+0000","last_fullsized":"2024-09-15T23:20:30.197685+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:36.833691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.477720+0000","last_change":"2024-09-15T23:20:29.202089+0000","last_active":"2024-09-15T23:20:30.477720+0000","last_peered":"2024-09-15T23:20:30.477720+0000","last_clean":"2024-09-15T23:20:30.477720+0000","last_became_active":"2024-09-15T23:20:29.200888+0000","last_became_peered":"2024-09-15T23:20:29.200888+0000","last_unstale":"2024-09-15T23:20:30.477720+0000","last_undegraded":"2024-09-15T23:20:30.477720+0000","last_fullsized":"2024-09-15T23:20:30.477720+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:05:47.881279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513715+0000","last_change":"2024-09-15T23:20:28.201994+0000","last_active":"2024-09-15T23:20:30.513715+0000","last_peered":"2024-09-15T23:20:30.513715+0000","last_clean":"2024-09-15T23:20:30.513715+0000","last_became_active":"2024-09-15T23:20:28.201732+0000","last_became_peered":"2024-09-15T23:20:28.201732+0000","last_unstale":"2024-09-15T23:20:30.513715+0000","last_undegraded":"2024-09-15T23:20:30.513715+0000","last_fullsized":"2024-09-15T23:20:30.513715+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:20:04.106407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.369559+0000","last_change":"2024-09-15T23:20:29.196533+0000","last_active":"2024-09-15T23:20:30.369559+0000","last_peered":"2024-09-15T23:20:30.369559+0000","last_clean":"2024-09-15T23:20:30.369559+0000","last_became_active":"2024-09-15T23:20:29.196254+0000","last_became_peered":"2024-09-15T23:20:29.196254+0000","last_unstale":"2024-09-15T23:20:30.369559+0000","last_undegraded":"2024-09-15T23:20:30.369559+0000","last_fullsized":"2024-09-15T23:20:30.369559+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:37:35.222388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.199015+0000","last_change":"2024-09-15T23:20:28.203405+0000","last_active":"2024-09-15T23:20:30.199015+0000","last_peered":"2024-09-15T23:20:30.199015+0000","last_clean":"2024-09-15T23:20:30.199015+0000","last_became_active":"2024-09-15T23:20:28.203089+0000","last_became_peered":"2024-09-15T23:20:28.203089+0000","last_unstale":"2024-09-15T23:20:30.199015+0000","last_undegraded":"2024-09-15T23:20:30.199015+0000","last_fullsized":"2024-09-15T23:20:30.199015+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:35.819886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478179+0000","last_change":"2024-09-15T23:20:29.203940+0000","last_active":"2024-09-15T23:20:30.478179+0000","last_peered":"2024-09-15T23:20:30.478179+0000","last_clean":"2024-09-15T23:20:30.478179+0000","last_became_active":"2024-09-15T23:20:29.203654+0000","last_became_peered":"2024-09-15T23:20:29.203654+0000","last_unstale":"2024-09-15T23:20:30.478179+0000","last_undegraded":"2024-09-15T23:20:30.478179+0000","last_fullsized":"2024-09-15T23:20:30.478179+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:56:44.170339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.14","version":"153'6","reported_seq":20,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478124+0000","last_change":"2024-09-15T23:20:28.198498+0000","last_active":"2024-09-15T23:20:30.478124+0000","last_peered":"2024-09-15T23:20:30.478124+0000","last_clean":"2024-09-15T23:20:30.478124+0000","last_became_active":"2024-09-15T23:20:28.198171+0000","last_became_peered":"2024-09-15T23:20:28.198171+0000","last_unstale":"2024-09-15T23:20:30.478124+0000","last_undegraded":"2024-09-15T23:20:30.478124+0000","last_fullsized":"2024-09-15T23:20:30.478124+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:40:08.921301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.477368+0000","last_change":"2024-09-15T23:20:29.204998+0000","last_active":"2024-09-15T23:20:30.477368+0000","last_peered":"2024-09-15T23:20:30.477368+0000","last_clean":"2024-09-15T23:20:30.477368+0000","last_became_active":"2024-09-15T23:20:29.204741+0000","last_became_peered":"2024-09-15T23:20:29.204741+0000","last_unstale":"2024-09-15T23:20:30.477368+0000","last_undegraded":"2024-09-15T23:20:30.477368+0000","last_fullsized":"2024-09-15T23:20:30.477368+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:37:35.222388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.13","version":"153'2","reported_seq":16,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197941+0000","last_change":"2024-09-15T23:20:28.201858+0000","last_active":"2024-09-15T23:20:30.197941+0000","last_peered":"2024-09-15T23:20:30.197941+0000","last_clean":"2024-09-15T23:20:30.197941+0000","last_became_active":"2024-09-15T23:20:28.201575+0000","last_became_peered":"2024-09-15T23:20:28.201575+0000","last_unstale":"2024-09-15T23:20:30.197941+0000","last_undegraded":"2024-09-15T23:20:30.197941+0000","last_fullsized":"2024-09-15T23:20:30.197941+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:44:46.545147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513779+0000","last_change":"2024-09-15T23:20:29.203263+0000","last_active":"2024-09-15T23:20:30.513779+0000","last_peered":"2024-09-15T23:20:30.513779+0000","last_clean":"2024-09-15T23:20:30.513779+0000","last_became_active":"2024-09-15T23:20:29.202940+0000","last_became_peered":"2024-09-15T23:20:29.202940+0000","last_unstale":"2024-09-15T23:20:30.513779+0000","last_undegraded":"2024-09-15T23:20:30.513779+0000","last_fullsized":"2024-09-15T23:20:30.513779+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:52:28.550373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.369650+0000","last_change":"2024-09-15T23:20:28.200080+0000","last_active":"2024-09-15T23:20:30.369650+0000","last_peered":"2024-09-15T23:20:30.369650+0000","last_clean":"2024-09-15T23:20:30.369650+0000","last_became_active":"2024-09-15T23:20:28.199794+0000","last_became_peered":"2024-09-15T23:20:28.199794+0000","last_unstale":"2024-09-15T23:20:30.369650+0000","last_undegraded":"2024-09-15T23:20:30.369650+0000","last_fullsized":"2024-09-15T23:20:30.369650+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:15:06.651049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.477240+0000","last_change":"2024-09-15T23:20:29.202016+0000","last_active":"2024-09-15T23:20:30.477240+0000","last_peered":"2024-09-15T23:20:30.477240+0000","last_clean":"2024-09-15T23:20:30.477240+0000","last_became_active":"2024-09-15T23:20:29.200816+0000","last_became_peered":"2024-09-15T23:20:29.200816+0000","last_unstale":"2024-09-15T23:20:30.477240+0000","last_undegraded":"2024-09-15T23:20:30.477240+0000","last_fullsized":"2024-09-15T23:20:30.477240+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:01.630582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197059+0000","last_change":"2024-09-15T23:20:28.198797+0000","last_active":"2024-09-15T23:20:30.197059+0000","last_peered":"2024-09-15T23:20:30.197059+0000","last_clean":"2024-09-15T23:20:30.197059+0000","last_became_active":"2024-09-15T23:20:28.198191+0000","last_became_peered":"2024-09-15T23:20:28.198191+0000","last_unstale":"2024-09-15T23:20:30.197059+0000","last_undegraded":"2024-09-15T23:20:30.197059+0000","last_fullsized":"2024-09-15T23:20:30.197059+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:17:07.972958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.477380+0000","last_change":"2024-09-15T23:20:29.209184+0000","last_active":"2024-09-15T23:20:30.477380+0000","last_peered":"2024-09-15T23:20:30.477380+0000","last_clean":"2024-09-15T23:20:30.477380+0000","last_became_active":"2024-09-15T23:20:29.208871+0000","last_became_peered":"2024-09-15T23:20:29.208871+0000","last_unstale":"2024-09-15T23:20:30.477380+0000","last_undegraded":"2024-09-15T23:20:30.477380+0000","last_fullsized":"2024-09-15T23:20:30.477380+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:10:06.922555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.10","version":"153'8","reported_seq":22,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513958+0000","last_change":"2024-09-15T23:20:28.200011+0000","last_active":"2024-09-15T23:20:30.513958+0000","last_peered":"2024-09-15T23:20:30.513958+0000","last_clean":"2024-09-15T23:20:30.513958+0000","last_became_active":"2024-09-15T23:20:28.199751+0000","last_became_peered":"2024-09-15T23:20:28.199751+0000","last_unstale":"2024-09-15T23:20:30.513958+0000","last_undegraded":"2024-09-15T23:20:30.513958+0000","last_fullsized":"2024-09-15T23:20:30.513958+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:47:17.451917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.199040+0000","last_change":"2024-09-15T23:20:29.207275+0000","last_active":"2024-09-15T23:20:30.199040+0000","last_peered":"2024-09-15T23:20:30.199040+0000","last_clean":"2024-09-15T23:20:30.199040+0000","last_became_active":"2024-09-15T23:20:29.206958+0000","last_became_peered":"2024-09-15T23:20:29.206958+0000","last_unstale":"2024-09-15T23:20:30.199040+0000","last_undegraded":"2024-09-15T23:20:30.199040+0000","last_fullsized":"2024-09-15T23:20:30.199040+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:25.335162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.f","version":"153'1","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.477735+0000","last_change":"2024-09-15T23:20:28.200278+0000","last_active":"2024-09-15T23:20:30.477735+0000","last_peered":"2024-09-15T23:20:30.477735+0000","last_clean":"2024-09-15T23:20:30.477735+0000","last_became_active":"2024-09-15T23:20:28.200010+0000","last_became_peered":"2024-09-15T23:20:28.200010+0000","last_unstale":"2024-09-15T23:20:30.477735+0000","last_undegraded":"2024-09-15T23:20:30.477735+0000","last_fullsized":"2024-09-15T23:20:30.477735+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:28.015621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197368+0000","last_change":"2024-09-15T23:20:29.202536+0000","last_active":"2024-09-15T23:20:30.197368+0000","last_peered":"2024-09-15T23:20:30.197368+0000","last_clean":"2024-09-15T23:20:30.197368+0000","last_became_active":"2024-09-15T23:20:29.202017+0000","last_became_peered":"2024-09-15T23:20:29.202017+0000","last_unstale":"2024-09-15T23:20:30.197368+0000","last_undegraded":"2024-09-15T23:20:30.197368+0000","last_fullsized":"2024-09-15T23:20:30.197368+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:13.973671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.e","version":"153'2","reported_seq":16,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.514068+0000","last_change":"2024-09-15T23:20:28.203185+0000","last_active":"2024-09-15T23:20:30.514068+0000","last_peered":"2024-09-15T23:20:30.514068+0000","last_clean":"2024-09-15T23:20:30.514068+0000","last_became_active":"2024-09-15T23:20:28.202696+0000","last_became_peered":"2024-09-15T23:20:28.202696+0000","last_unstale":"2024-09-15T23:20:30.514068+0000","last_undegraded":"2024-09-15T23:20:30.514068+0000","last_fullsized":"2024-09-15T23:20:30.514068+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:50:40.388412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.198894+0000","last_change":"2024-09-15T23:20:29.206430+0000","last_active":"2024-09-15T23:20:30.198894+0000","last_peered":"2024-09-15T23:20:30.198894+0000","last_clean":"2024-09-15T23:20:30.198894+0000","last_became_active":"2024-09-15T23:20:29.206152+0000","last_became_peered":"2024-09-15T23:20:29.206152+0000","last_unstale":"2024-09-15T23:20:30.198894+0000","last_undegraded":"2024-09-15T23:20:30.198894+0000","last_fullsized":"2024-09-15T23:20:30.198894+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:17:10.914333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.d","version":"153'1","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478240+0000","last_change":"2024-09-15T23:20:28.201741+0000","last_active":"2024-09-15T23:20:30.478240+0000","last_peered":"2024-09-15T23:20:30.478240+0000","last_clean":"2024-09-15T23:20:30.478240+0000","last_became_active":"2024-09-15T23:20:28.201472+0000","last_became_peered":"2024-09-15T23:20:28.201472+0000","last_unstale":"2024-09-15T23:20:30.478240+0000","last_undegraded":"2024-09-15T23:20:30.478240+0000","last_fullsized":"2024-09-15T23:20:30.478240+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:37:13.277973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513650+0000","last_change":"2024-09-15T23:20:29.197136+0000","last_active":"2024-09-15T23:20:30.513650+0000","last_peered":"2024-09-15T23:20:30.513650+0000","last_clean":"2024-09-15T23:20:30.513650+0000","last_became_active":"2024-09-15T23:20:29.196233+0000","last_became_peered":"2024-09-15T23:20:29.196233+0000","last_unstale":"2024-09-15T23:20:30.513650+0000","last_undegraded":"2024-09-15T23:20:30.513650+0000","last_fullsized":"2024-09-15T23:20:30.513650+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:32:19.380894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197385+0000","last_change":"2024-09-15T23:20:28.199993+0000","last_active":"2024-09-15T23:20:30.197385+0000","last_peered":"2024-09-15T23:20:30.197385+0000","last_clean":"2024-09-15T23:20:30.197385+0000","last_became_active":"2024-09-15T23:20:28.199722+0000","last_became_peered":"2024-09-15T23:20:28.199722+0000","last_unstale":"2024-09-15T23:20:30.197385+0000","last_undegraded":"2024-09-15T23:20:30.197385+0000","last_fullsized":"2024-09-15T23:20:30.197385+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:14.668959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.369661+0000","last_change":"2024-09-15T23:20:29.212054+0000","last_active":"2024-09-15T23:20:30.369661+0000","last_peered":"2024-09-15T23:20:30.369661+0000","last_clean":"2024-09-15T23:20:30.369661+0000","last_became_active":"2024-09-15T23:20:29.211481+0000","last_became_peered":"2024-09-15T23:20:29.211481+0000","last_unstale":"2024-09-15T23:20:30.369661+0000","last_undegraded":"2024-09-15T23:20:30.369661+0000","last_fullsized":"2024-09-15T23:20:30.369661+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:01:34.374643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.b","version":"153'2","reported_seq":16,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513462+0000","last_change":"2024-09-15T23:20:28.205673+0000","last_active":"2024-09-15T23:20:30.513462+0000","last_peered":"2024-09-15T23:20:30.513462+0000","last_clean":"2024-09-15T23:20:30.513462+0000","last_became_active":"2024-09-15T23:20:28.205339+0000","last_became_peered":"2024-09-15T23:20:28.205339+0000","last_unstale":"2024-09-15T23:20:30.513462+0000","last_undegraded":"2024-09-15T23:20:30.513462+0000","last_fullsized":"2024-09-15T23:20:30.513462+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:35:31.432270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.196960+0000","last_change":"2024-09-15T23:20:29.202170+0000","last_active":"2024-09-15T23:20:30.196960+0000","last_peered":"2024-09-15T23:20:30.196960+0000","last_clean":"2024-09-15T23:20:30.196960+0000","last_became_active":"2024-09-15T23:20:29.201829+0000","last_became_peered":"2024-09-15T23:20:29.201829+0000","last_unstale":"2024-09-15T23:20:30.196960+0000","last_undegraded":"2024-09-15T23:20:30.196960+0000","last_fullsized":"2024-09-15T23:20:30.196960+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:55.770178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.477310+0000","last_change":"2024-09-15T23:20:28.199768+0000","last_active":"2024-09-15T23:20:30.477310+0000","last_peered":"2024-09-15T23:20:30.477310+0000","last_clean":"2024-09-15T23:20:30.477310+0000","last_became_active":"2024-09-15T23:20:28.199473+0000","last_became_peered":"2024-09-15T23:20:28.199473+0000","last_unstale":"2024-09-15T23:20:30.477310+0000","last_undegraded":"2024-09-15T23:20:30.477310+0000","last_fullsized":"2024-09-15T23:20:30.477310+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:09:54.767895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.369457+0000","last_change":"2024-09-15T23:20:29.201167+0000","last_active":"2024-09-15T23:20:30.369457+0000","last_peered":"2024-09-15T23:20:30.369457+0000","last_clean":"2024-09-15T23:20:30.369457+0000","last_became_active":"2024-09-15T23:20:29.200906+0000","last_became_peered":"2024-09-15T23:20:29.200906+0000","last_unstale":"2024-09-15T23:20:30.369457+0000","last_undegraded":"2024-09-15T23:20:30.369457+0000","last_fullsized":"2024-09-15T23:20:30.369457+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:38.347629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.477473+0000","last_change":"2024-09-15T23:20:28.201036+0000","last_active":"2024-09-15T23:20:30.477473+0000","last_peered":"2024-09-15T23:20:30.477473+0000","last_clean":"2024-09-15T23:20:30.477473+0000","last_became_active":"2024-09-15T23:20:28.200548+0000","last_became_peered":"2024-09-15T23:20:28.200548+0000","last_unstale":"2024-09-15T23:20:30.477473+0000","last_undegraded":"2024-09-15T23:20:30.477473+0000","last_fullsized":"2024-09-15T23:20:30.477473+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:16:33.132295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.196771+0000","last_change":"2024-09-15T23:20:29.211822+0000","last_active":"2024-09-15T23:20:30.196771+0000","last_peered":"2024-09-15T23:20:30.196771+0000","last_clean":"2024-09-15T23:20:30.196771+0000","last_became_active":"2024-09-15T23:20:29.211561+0000","last_became_peered":"2024-09-15T23:20:29.211561+0000","last_unstale":"2024-09-15T23:20:30.196771+0000","last_undegraded":"2024-09-15T23:20:30.196771+0000","last_fullsized":"2024-09-15T23:20:30.196771+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:08:21.930661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.477331+0000","last_change":"2024-09-15T23:20:28.196801+0000","last_active":"2024-09-15T23:20:30.477331+0000","last_peered":"2024-09-15T23:20:30.477331+0000","last_clean":"2024-09-15T23:20:30.477331+0000","last_became_active":"2024-09-15T23:20:28.195532+0000","last_became_peered":"2024-09-15T23:20:28.195532+0000","last_unstale":"2024-09-15T23:20:30.477331+0000","last_undegraded":"2024-09-15T23:20:30.477331+0000","last_fullsized":"2024-09-15T23:20:30.477331+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:14.383908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.477761+0000","last_change":"2024-09-15T23:20:29.199612+0000","last_active":"2024-09-15T23:20:30.477761+0000","last_peered":"2024-09-15T23:20:30.477761+0000","last_clean":"2024-09-15T23:20:30.477761+0000","last_became_active":"2024-09-15T23:20:29.198811+0000","last_became_peered":"2024-09-15T23:20:29.198811+0000","last_unstale":"2024-09-15T23:20:30.477761+0000","last_undegraded":"2024-09-15T23:20:30.477761+0000","last_fullsized":"2024-09-15T23:20:30.477761+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:25:00.025677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.7","version":"153'2","reported_seq":16,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.477861+0000","last_change":"2024-09-15T23:20:28.197581+0000","last_active":"2024-09-15T23:20:30.477861+0000","last_peered":"2024-09-15T23:20:30.477861+0000","last_clean":"2024-09-15T23:20:30.477861+0000","last_became_active":"2024-09-15T23:20:28.197295+0000","last_became_peered":"2024-09-15T23:20:28.197295+0000","last_unstale":"2024-09-15T23:20:30.477861+0000","last_undegraded":"2024-09-15T23:20:30.477861+0000","last_fullsized":"2024-09-15T23:20:30.477861+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:47:53.341715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.477772+0000","last_change":"2024-09-15T23:20:29.205275+0000","last_active":"2024-09-15T23:20:30.477772+0000","last_peered":"2024-09-15T23:20:30.477772+0000","last_clean":"2024-09-15T23:20:30.477772+0000","last_became_active":"2024-09-15T23:20:29.202327+0000","last_became_peered":"2024-09-15T23:20:29.202327+0000","last_unstale":"2024-09-15T23:20:30.477772+0000","last_undegraded":"2024-09-15T23:20:30.477772+0000","last_fullsized":"2024-09-15T23:20:30.477772+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:05.947521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.6","version":"153'1","reported_seq":15,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197269+0000","last_change":"2024-09-15T23:20:28.201563+0000","last_active":"2024-09-15T23:20:30.197269+0000","last_peered":"2024-09-15T23:20:30.197269+0000","last_clean":"2024-09-15T23:20:30.197269+0000","last_became_active":"2024-09-15T23:20:28.201200+0000","last_became_peered":"2024-09-15T23:20:28.201200+0000","last_unstale":"2024-09-15T23:20:30.197269+0000","last_undegraded":"2024-09-15T23:20:30.197269+0000","last_fullsized":"2024-09-15T23:20:30.197269+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:33:08.209152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513913+0000","last_change":"2024-09-15T23:20:29.206055+0000","last_active":"2024-09-15T23:20:30.513913+0000","last_peered":"2024-09-15T23:20:30.513913+0000","last_clean":"2024-09-15T23:20:30.513913+0000","last_became_active":"2024-09-15T23:20:29.205752+0000","last_became_peered":"2024-09-15T23:20:29.205752+0000","last_unstale":"2024-09-15T23:20:30.513913+0000","last_undegraded":"2024-09-15T23:20:30.513913+0000","last_fullsized":"2024-09-15T23:20:30.513913+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:41.418218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478260+0000","last_change":"2024-09-15T23:20:28.198508+0000","last_active":"2024-09-15T23:20:30.478260+0000","last_peered":"2024-09-15T23:20:30.478260+0000","last_clean":"2024-09-15T23:20:30.478260+0000","last_became_active":"2024-09-15T23:20:28.198223+0000","last_became_peered":"2024-09-15T23:20:28.198223+0000","last_unstale":"2024-09-15T23:20:30.478260+0000","last_undegraded":"2024-09-15T23:20:30.478260+0000","last_fullsized":"2024-09-15T23:20:30.478260+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:08.445349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513338+0000","last_change":"2024-09-15T23:20:29.210818+0000","last_active":"2024-09-15T23:20:30.513338+0000","last_peered":"2024-09-15T23:20:30.513338+0000","last_clean":"2024-09-15T23:20:30.513338+0000","last_became_active":"2024-09-15T23:20:29.210535+0000","last_became_peered":"2024-09-15T23:20:29.210535+0000","last_unstale":"2024-09-15T23:20:30.513338+0000","last_undegraded":"2024-09-15T23:20:30.513338+0000","last_fullsized":"2024-09-15T23:20:30.513338+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:50:19.504434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478169+0000","last_change":"2024-09-15T23:20:28.198348+0000","last_active":"2024-09-15T23:20:30.478169+0000","last_peered":"2024-09-15T23:20:30.478169+0000","last_clean":"2024-09-15T23:20:30.478169+0000","last_became_active":"2024-09-15T23:20:28.198008+0000","last_became_peered":"2024-09-15T23:20:28.198008+0000","last_unstale":"2024-09-15T23:20:30.478169+0000","last_undegraded":"2024-09-15T23:20:30.478169+0000","last_fullsized":"2024-09-15T23:20:30.478169+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:02.473781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478031+0000","last_change":"2024-09-15T23:20:29.198415+0000","last_active":"2024-09-15T23:20:30.478031+0000","last_peered":"2024-09-15T23:20:30.478031+0000","last_clean":"2024-09-15T23:20:30.478031+0000","last_became_active":"2024-09-15T23:20:29.197633+0000","last_became_peered":"2024-09-15T23:20:29.197633+0000","last_unstale":"2024-09-15T23:20:30.478031+0000","last_undegraded":"2024-09-15T23:20:30.478031+0000","last_fullsized":"2024-09-15T23:20:30.478031+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:57:53.269720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.196904+0000","last_change":"2024-09-15T23:20:28.200763+0000","last_active":"2024-09-15T23:20:30.196904+0000","last_peered":"2024-09-15T23:20:30.196904+0000","last_clean":"2024-09-15T23:20:30.196904+0000","last_became_active":"2024-09-15T23:20:28.200468+0000","last_became_peered":"2024-09-15T23:20:28.200468+0000","last_unstale":"2024-09-15T23:20:30.196904+0000","last_undegraded":"2024-09-15T23:20:30.196904+0000","last_fullsized":"2024-09-15T23:20:30.196904+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:17:09.912049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.477588+0000","last_change":"2024-09-15T23:20:29.204666+0000","last_active":"2024-09-15T23:20:30.477588+0000","last_peered":"2024-09-15T23:20:30.477588+0000","last_clean":"2024-09-15T23:20:30.477588+0000","last_became_active":"2024-09-15T23:20:29.204417+0000","last_became_peered":"2024-09-15T23:20:29.204417+0000","last_unstale":"2024-09-15T23:20:30.477588+0000","last_undegraded":"2024-09-15T23:20:30.477588+0000","last_fullsized":"2024-09-15T23:20:30.477588+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:35:32.434554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.198033+0000","last_change":"2024-09-15T23:20:28.202777+0000","last_active":"2024-09-15T23:20:30.198033+0000","last_peered":"2024-09-15T23:20:30.198033+0000","last_clean":"2024-09-15T23:20:30.198033+0000","last_became_active":"2024-09-15T23:20:28.200455+0000","last_became_peered":"2024-09-15T23:20:28.200455+0000","last_unstale":"2024-09-15T23:20:30.198033+0000","last_undegraded":"2024-09-15T23:20:30.198033+0000","last_fullsized":"2024-09-15T23:20:30.198033+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:35:33.324787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.477264+0000","last_change":"2024-09-15T23:20:29.198191+0000","last_active":"2024-09-15T23:20:30.477264+0000","last_peered":"2024-09-15T23:20:30.477264+0000","last_clean":"2024-09-15T23:20:30.477264+0000","last_became_active":"2024-09-15T23:20:29.197897+0000","last_became_peered":"2024-09-15T23:20:29.197897+0000","last_unstale":"2024-09-15T23:20:30.477264+0000","last_undegraded":"2024-09-15T23:20:30.477264+0000","last_fullsized":"2024-09-15T23:20:30.477264+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:12:53.601466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.369248+0000","last_change":"2024-09-15T23:20:28.194389+0000","last_active":"2024-09-15T23:20:30.369248+0000","last_peered":"2024-09-15T23:20:30.369248+0000","last_clean":"2024-09-15T23:20:30.369248+0000","last_became_active":"2024-09-15T23:20:28.194128+0000","last_became_peered":"2024-09-15T23:20:28.194128+0000","last_unstale":"2024-09-15T23:20:30.369248+0000","last_undegraded":"2024-09-15T23:20:30.369248+0000","last_fullsized":"2024-09-15T23:20:30.369248+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:35:09.788471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.197731+0000","last_change":"2024-09-15T23:20:29.196180+0000","last_active":"2024-09-15T23:20:30.197731+0000","last_peered":"2024-09-15T23:20:30.197731+0000","last_clean":"2024-09-15T23:20:30.197731+0000","last_became_active":"2024-09-15T23:20:29.195938+0000","last_became_peered":"2024-09-15T23:20:29.195938+0000","last_unstale":"2024-09-15T23:20:30.197731+0000","last_undegraded":"2024-09-15T23:20:30.197731+0000","last_fullsized":"2024-09-15T23:20:30.197731+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:47.105701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":14,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.513085+0000","last_change":"2024-09-15T23:20:28.205782+0000","last_active":"2024-09-15T23:20:30.513085+0000","last_peered":"2024-09-15T23:20:30.513085+0000","last_clean":"2024-09-15T23:20:30.513085+0000","last_became_active":"2024-09-15T23:20:28.205426+0000","last_became_peered":"2024-09-15T23:20:28.205426+0000","last_unstale":"2024-09-15T23:20:30.513085+0000","last_undegraded":"2024-09-15T23:20:30.513085+0000","last_fullsized":"2024-09-15T23:20:30.513085+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:05:46.878996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":12,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.478039+0000","last_change":"2024-09-15T23:20:29.199433+0000","last_active":"2024-09-15T23:20:30.478039+0000","last_peered":"2024-09-15T23:20:30.478039+0000","last_clean":"2024-09-15T23:20:30.478039+0000","last_became_active":"2024-09-15T23:20:29.198927+0000","last_became_peered":"2024-09-15T23:20:29.198927+0000","last_unstale":"2024-09-15T23:20:30.478039+0000","last_undegraded":"2024-09-15T23:20:30.478039+0000","last_fullsized":"2024-09-15T23:20:30.478039+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:28.179054+0000","last_clean_scrub_stamp":"2024-09-15T23:20:28.179054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:40:14.188975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.15","version":"153'3","reported_seq":17,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.369520+0000","last_change":"2024-09-15T23:20:28.197023+0000","last_active":"2024-09-15T23:20:30.369520+0000","last_peered":"2024-09-15T23:20:30.369520+0000","last_clean":"2024-09-15T23:20:30.369520+0000","last_became_active":"2024-09-15T23:20:28.196602+0000","last_became_peered":"2024-09-15T23:20:28.196602+0000","last_unstale":"2024-09-15T23:20:30.369520+0000","last_undegraded":"2024-09-15T23:20:30.369520+0000","last_fullsized":"2024-09-15T23:20:30.369520+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:20:27.176771+0000","last_clean_scrub_stamp":"2024-09-15T23:20:27.176771+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:48:47.311239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":416,"reported_epoch":154,"state":"active+clean","last_fresh":"2024-09-15T23:20:30.198561+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:20:30.198561+0000","last_peered":"2024-09-15T23:20:30.198561+0000","last_clean":"2024-09-15T23:20:30.198561+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:20:30.198561+0000","last_undegraded":"2024-09-15T23:20:30.198561+0000","last_fullsized":"2024-09-15T23:20:30.198561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476844,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55272,"kb_used_data":1876,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316568,"statfs":{"total":96636764160,"available":96580165632,"internally_reserved":0,"allocated":1921024,"data_stored":845903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476841,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51108,"kb_used_data":1872,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320732,"statfs":{"total":96636764160,"available":96584429568,"internally_reserved":0,"allocated":1916928,"data_stored":845309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476843,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47532,"kb_used_data":2452,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324308,"statfs":{"total":96636764160,"available":96588091392,"internally_reserved":0,"allocated":2510848,"data_stored":1435725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476843,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41384,"kb_used_data":1872,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330456,"statfs":{"total":96636764160,"available":96594386944,"internally_reserved":0,"allocated":1916928,"data_stored":845377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542249,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28900,"kb_used_data":1868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342940,"statfs":{"total":96636764160,"available":96607170560,"internally_reserved":0,"allocated":1912832,"data_stored":845287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542249,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51108,"kb_used_data":1868,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320732,"statfs":{"total":96636764160,"available":96584429568,"internally_reserved":0,"allocated":1912832,"data_stored":845287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542248,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55876,"kb_used_data":2472,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315964,"statfs":{"total":96636764160,"available":96579547136,"internally_reserved":0,"allocated":2531328,"data_stored":1437461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542250,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51132,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320708,"statfs":{"total":96636764160,"available":96584404992,"internally_reserved":0,"allocated":1933312,"data_stored":847503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:20:36.905 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T23:20:36.905 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T23:20:37.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.046+0000 7f751e103640 1 Processor -- start 2024-09-15T23:20:37.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.046+0000 7f751e103640 1 -- start start 2024-09-15T23:20:37.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.047+0000 7f751e103640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f75180ccf30 0x7f75180b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:37.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.047+0000 7f751e103640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f751815b7c0 0x7f75180cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:37.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.047+0000 7f751e103640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f75180cead0 0x7f751815f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:37.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.047+0000 7f751e103640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f75180cd850 con 0x7f75180ccf30 2024-09-15T23:20:37.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.047+0000 7f751e103640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f75180cf2e0 con 0x7f75180cead0 2024-09-15T23:20:37.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.047+0000 7f751e103640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7518070fe0 con 0x7f751815b7c0 2024-09-15T23:20:37.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.047+0000 7f75177fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f75180ccf30 0x7f75180b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:37.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.047+0000 7f75177fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f75180ccf30 0x7f75180b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39306/0 (socket says 172.21.15.123:39306) 2024-09-15T23:20:37.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.047+0000 7f75177fe640 1 -- 172.21.15.123:0/2780895935 learned_addr learned my addr 172.21.15.123:0/2780895935 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:37.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.047+0000 7f7517fff640 1 --2- 172.21.15.123:0/2780895935 >> v2:172.21.15.188:3300/0 conn(0x7f75180cead0 0x7f751815f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:37.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.047+0000 7f7516ffd640 1 --2- 172.21.15.123:0/2780895935 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f751815b7c0 0x7f75180cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:37.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.047+0000 7f75177fe640 1 -- 172.21.15.123:0/2780895935 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f751815b7c0 msgr2=0x7f75180cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:37.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.047+0000 7f75177fe640 1 --2- 172.21.15.123:0/2780895935 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f751815b7c0 0x7f75180cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:37.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.047+0000 7f75177fe640 1 -- 172.21.15.123:0/2780895935 >> v2:172.21.15.188:3300/0 conn(0x7f75180cead0 msgr2=0x7f751815f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:37.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.047+0000 7f75177fe640 1 --2- 172.21.15.123:0/2780895935 >> v2:172.21.15.188:3300/0 conn(0x7f75180cead0 0x7f751815f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:37.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.047+0000 7f75177fe640 1 -- 172.21.15.123:0/2780895935 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75180712c0 con 0x7f75180ccf30 2024-09-15T23:20:37.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.048+0000 7f75177fe640 1 --2- 172.21.15.123:0/2780895935 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75180ccf30 0x7f75180b2c50 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f751806dc70 tx=0x7f750802c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d50792d574571d38 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:37.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.048+0000 7f75167fc640 1 -- 172.21.15.123:0/2780895935 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7508032700 con 0x7f75180ccf30 2024-09-15T23:20:37.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.048+0000 7f75167fc640 1 -- 172.21.15.123:0/2780895935 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75080328a0 con 0x7f75180ccf30 2024-09-15T23:20:37.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.048+0000 7f75167fc640 1 -- 172.21.15.123:0/2780895935 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7508032c70 con 0x7f75180ccf30 2024-09-15T23:20:37.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.048+0000 7f751e103640 1 -- 172.21.15.123:0/2780895935 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75180ccf30 msgr2=0x7f75180b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:37.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.048+0000 7f751e103640 1 --2- 172.21.15.123:0/2780895935 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75180ccf30 0x7f75180b2c50 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f751806dc70 tx=0x7f750802c800 comp rx=0 tx=0).stop 2024-09-15T23:20:37.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.048+0000 7f751e103640 1 -- 172.21.15.123:0/2780895935 shutdown_connections 2024-09-15T23:20:37.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.048+0000 7f751e103640 1 --2- 172.21.15.123:0/2780895935 >> v2:172.21.15.188:3300/0 conn(0x7f75180cead0 0x7f751815f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:37.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.048+0000 7f751e103640 1 --2- 172.21.15.123:0/2780895935 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f751815b7c0 0x7f75180cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:37.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.048+0000 7f751e103640 1 --2- 172.21.15.123:0/2780895935 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75180ccf30 0x7f75180b2c50 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:37.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.048+0000 7f751e103640 1 -- 172.21.15.123:0/2780895935 >> 172.21.15.123:0/2780895935 conn(0x7f751806d0f0 msgr2=0x7f751806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:37.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.048+0000 7f751e103640 1 -- 172.21.15.123:0/2780895935 shutdown_connections 2024-09-15T23:20:37.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.048+0000 7f751e103640 1 -- 172.21.15.123:0/2780895935 wait complete. 2024-09-15T23:20:37.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.050+0000 7f751e103640 1 Processor -- start 2024-09-15T23:20:37.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.050+0000 7f751e103640 1 -- start start 2024-09-15T23:20:37.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.050+0000 7f751e103640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75180ccf30 0x7f7518158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:37.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.051+0000 7f751e103640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75180cead0 0x7f7518145d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:37.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.051+0000 7f751e103640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f751815b7c0 0x7f7518159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:37.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.051+0000 7f751e103640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f75180cef20 con 0x7f751815b7c0 2024-09-15T23:20:37.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.051+0000 7f751e103640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f75180cf5c0 con 0x7f75180ccf30 2024-09-15T23:20:37.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.051+0000 7f751e103640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f75180cf0a0 con 0x7f75180cead0 2024-09-15T23:20:37.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.051+0000 7f7517fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f751815b7c0 0x7f7518159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:37.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.051+0000 7f7517fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f751815b7c0 0x7f7518159730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39314/0 (socket says 172.21.15.123:39314) 2024-09-15T23:20:37.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.051+0000 7f7517fff640 1 -- 172.21.15.123:0/1336708383 learned_addr learned my addr 172.21.15.123:0/1336708383 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:37.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.051+0000 7f7516ffd640 1 --2- 172.21.15.123:0/1336708383 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75180cead0 0x7f7518145d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:37.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.051+0000 7f75177fe640 1 --2- 172.21.15.123:0/1336708383 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75180ccf30 0x7f7518158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:37.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.051+0000 7f7517fff640 1 -- 172.21.15.123:0/1336708383 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75180cead0 msgr2=0x7f7518145d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:37.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.051+0000 7f7517fff640 1 --2- 172.21.15.123:0/1336708383 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75180cead0 0x7f7518145d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:37.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.051+0000 7f7517fff640 1 -- 172.21.15.123:0/1336708383 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75180ccf30 msgr2=0x7f7518158e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:37.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.051+0000 7f7517fff640 1 --2- 172.21.15.123:0/1336708383 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75180ccf30 0x7f7518158e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:37.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.051+0000 7f7517fff640 1 -- 172.21.15.123:0/1336708383 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7518157db0 con 0x7f751815b7c0 2024-09-15T23:20:37.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.051+0000 7f7517fff640 1 --2- 172.21.15.123:0/1336708383 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f751815b7c0 0x7f7518159730 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f7510007e60 tx=0x7f751000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:37.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.051+0000 7f74fffff640 1 -- 172.21.15.123:0/1336708383 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7510014620 con 0x7f751815b7c0 2024-09-15T23:20:37.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.051+0000 7f74fffff640 1 -- 172.21.15.123:0/1336708383 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7510019070 con 0x7f751815b7c0 2024-09-15T23:20:37.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.051+0000 7f751e103640 1 -- 172.21.15.123:0/1336708383 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7518158090 con 0x7f751815b7c0 2024-09-15T23:20:37.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.051+0000 7f74fffff640 1 -- 172.21.15.123:0/1336708383 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7510014a20 con 0x7f751815b7c0 2024-09-15T23:20:37.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.051+0000 7f751e103640 1 -- 172.21.15.123:0/1336708383 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7518158650 con 0x7f751815b7c0 2024-09-15T23:20:37.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.052+0000 7f751e103640 1 -- 172.21.15.123:0/1336708383 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f751815d5f0 con 0x7f751815b7c0 2024-09-15T23:20:37.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.053+0000 7f74fffff640 1 -- 172.21.15.123:0/1336708383 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7510014bc0 con 0x7f751815b7c0 2024-09-15T23:20:37.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.053+0000 7f74fffff640 1 --2- 172.21.15.123:0/1336708383 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f750406c2b0 0x7f750406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:37.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.053+0000 7f74fffff640 1 -- 172.21.15.123:0/1336708383 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f751008bbe0 con 0x7f751815b7c0 2024-09-15T23:20:37.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.053+0000 7f75177fe640 1 --2- 172.21.15.123:0/1336708383 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f750406c2b0 0x7f750406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:37.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.054+0000 7f75177fe640 1 --2- 172.21.15.123:0/1336708383 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f750406c2b0 0x7f750406e770 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f7508037000 tx=0x7f7508032000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:37.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.057+0000 7f74fffff640 1 -- 172.21.15.123:0/1336708383 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7510059d00 con 0x7f751815b7c0 2024-09-15T23:20:37.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.290+0000 7f751e103640 1 -- 172.21.15.123:0/1336708383 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f75180b2c50 con 0x7f751815b7c0 2024-09-15T23:20:37.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.293+0000 7f74fffff640 1 -- 172.21.15.123:0/1336708383 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) ==== 190+0+147 (secure 0 0 0) 0x7f751005e000 con 0x7f751815b7c0 2024-09-15T23:20:37.297 INFO:teuthology.orchestra.run.smithi123.stdout:[client.0] 2024-09-15T23:20:37.297 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCNaedmzQPqJRAAhUf1dnVYohN4obCfeu8+7g== 2024-09-15T23:20:37.297 INFO:teuthology.orchestra.run.smithi123.stdout: caps mds = "allow" 2024-09-15T23:20:37.297 INFO:teuthology.orchestra.run.smithi123.stdout: caps mon = "allow r" 2024-09-15T23:20:37.297 INFO:teuthology.orchestra.run.smithi123.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T23:20:37.298 INFO:teuthology.orchestra.run.smithi123.stderr:updated caps for client.0 2024-09-15T23:20:37.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.295+0000 7f751e103640 1 -- 172.21.15.123:0/1336708383 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f750406c2b0 msgr2=0x7f750406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:37.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.295+0000 7f751e103640 1 --2- 172.21.15.123:0/1336708383 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f750406c2b0 0x7f750406e770 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f7508037000 tx=0x7f7508032000 comp rx=0 tx=0).stop 2024-09-15T23:20:37.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.295+0000 7f751e103640 1 -- 172.21.15.123:0/1336708383 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f751815b7c0 msgr2=0x7f7518159730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:37.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.295+0000 7f751e103640 1 --2- 172.21.15.123:0/1336708383 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f751815b7c0 0x7f7518159730 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f7510007e60 tx=0x7f751000e4b0 comp rx=0 tx=0).stop 2024-09-15T23:20:37.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.295+0000 7f751e103640 1 -- 172.21.15.123:0/1336708383 shutdown_connections 2024-09-15T23:20:37.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.295+0000 7f751e103640 1 --2- 172.21.15.123:0/1336708383 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f750406c2b0 0x7f750406e770 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:37.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.295+0000 7f751e103640 1 --2- 172.21.15.123:0/1336708383 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f751815b7c0 0x7f7518159730 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:37.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.295+0000 7f751e103640 1 --2- 172.21.15.123:0/1336708383 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75180cead0 0x7f7518145d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:37.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.295+0000 7f751e103640 1 --2- 172.21.15.123:0/1336708383 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75180ccf30 0x7f7518158e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:37.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.295+0000 7f751e103640 1 -- 172.21.15.123:0/1336708383 >> 172.21.15.123:0/1336708383 conn(0x7f751806d0f0 msgr2=0x7f75180b5210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:37.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.295+0000 7f751e103640 1 -- 172.21.15.123:0/1336708383 shutdown_connections 2024-09-15T23:20:37.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.295+0000 7f751e103640 1 -- 172.21.15.123:0/1336708383 wait complete. 2024-09-15T23:20:37.307 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:20:37.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.404+0000 7fd5511d6640 1 Processor -- start 2024-09-15T23:20:37.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.404+0000 7fd5511d6640 1 -- start start 2024-09-15T23:20:37.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.405+0000 7fd5511d6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd54c0b2d40 0x7fd54c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:37.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.405+0000 7fd5511d6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd54c06c150 0x7fd54c15c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:37.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.405+0000 7fd5511d6640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd54c071180 con 0x7fd54c13eb20 2024-09-15T23:20:37.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.405+0000 7fd5511d6640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fd54c071ab0 con 0x7fd54c0b2d40 2024-09-15T23:20:37.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.405+0000 7fd5511d6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fd54c071460 con 0x7fd54c06c150 2024-09-15T23:20:37.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.405+0000 7fd54ad9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd54c0b2d40 0x7fd54c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:37.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.405+0000 7fd54ad9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd54c0b2d40 0x7fd54c06bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39326/0 (socket says 172.21.15.123:39326) 2024-09-15T23:20:37.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.405+0000 7fd54a59c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd54c13eb20 0x7fd54c15bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:34524/0 (socket says 172.21.15.123:34524) 2024-09-15T23:20:37.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.405+0000 7fd54ad9d640 1 -- 172.21.15.123:0/1420534065 learned_addr learned my addr 172.21.15.123:0/1420534065 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:37.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.405+0000 7fd54ad9d640 1 -- 172.21.15.123:0/1420534065 >> v2:172.21.15.188:3300/0 conn(0x7fd54c06c150 msgr2=0x7fd54c15c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:37.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.405+0000 7fd54ad9d640 1 --2- 172.21.15.123:0/1420534065 >> v2:172.21.15.188:3300/0 conn(0x7fd54c06c150 0x7fd54c15c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:37.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.405+0000 7fd54ad9d640 1 -- 172.21.15.123:0/1420534065 >> v1:172.21.15.123:6789/0 conn(0x7fd54c13eb20 legacy=0x7fd54c15bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:37.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.405+0000 7fd54ad9d640 1 -- 172.21.15.123:0/1420534065 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd54c071740 con 0x7fd54c0b2d40 2024-09-15T23:20:37.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.405+0000 7fd549d9b640 1 -- 172.21.15.123:0/1420534065 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2097346750 0 0) 0x7fd54c071180 con 0x7fd54c13eb20 2024-09-15T23:20:37.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.406+0000 7fd54ad9d640 1 --2- 172.21.15.123:0/1420534065 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd54c0b2d40 0x7fd54c06bc10 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7fd54c070d30 tx=0x7fd53c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3db6842c3c9320c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:37.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.406+0000 7fd549d9b640 1 -- 172.21.15.123:0/1420534065 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53c036070 con 0x7fd54c0b2d40 2024-09-15T23:20:37.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.406+0000 7fd549d9b640 1 -- 172.21.15.123:0/1420534065 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd53c031600 con 0x7fd54c0b2d40 2024-09-15T23:20:37.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.406+0000 7fd549d9b640 1 -- 172.21.15.123:0/1420534065 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53c0319d0 con 0x7fd54c0b2d40 2024-09-15T23:20:37.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.407+0000 7fd5511d6640 1 -- 172.21.15.123:0/1420534065 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd54c0b2d40 msgr2=0x7fd54c06bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:37.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.407+0000 7fd5511d6640 1 --2- 172.21.15.123:0/1420534065 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd54c0b2d40 0x7fd54c06bc10 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7fd54c070d30 tx=0x7fd53c02a730 comp rx=0 tx=0).stop 2024-09-15T23:20:37.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.407+0000 7fd5511d6640 1 -- 172.21.15.123:0/1420534065 shutdown_connections 2024-09-15T23:20:37.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.407+0000 7fd5511d6640 1 --2- 172.21.15.123:0/1420534065 >> v2:172.21.15.188:3300/0 conn(0x7fd54c06c150 0x7fd54c15c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:37.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.407+0000 7fd5511d6640 1 --2- 172.21.15.123:0/1420534065 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd54c0b2d40 0x7fd54c06bc10 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:37.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.407+0000 7fd5511d6640 1 -- 172.21.15.123:0/1420534065 >> 172.21.15.123:0/1420534065 conn(0x7fd54c0ccec0 msgr2=0x7fd54c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:37.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.407+0000 7fd5511d6640 1 -- 172.21.15.123:0/1420534065 shutdown_connections 2024-09-15T23:20:37.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.407+0000 7fd5511d6640 1 -- 172.21.15.123:0/1420534065 wait complete. 2024-09-15T23:20:37.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.408+0000 7fd5511d6640 1 Processor -- start 2024-09-15T23:20:37.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.408+0000 7fd5511d6640 1 -- start start 2024-09-15T23:20:37.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.409+0000 7fd5511d6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd54c06c150 0x7fd54c143020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:37.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.409+0000 7fd5511d6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd54c0b2d40 0x7fd54c13dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:37.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.409+0000 7fd5511d6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd54c13eb20 0x7fd54c15cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:37.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.409+0000 7fd5511d6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd54c0722d0 con 0x7fd54c0b2d40 2024-09-15T23:20:37.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.409+0000 7fd5511d6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd54c072150 con 0x7fd54c13eb20 2024-09-15T23:20:37.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.409+0000 7fd5511d6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd54c072450 con 0x7fd54c06c150 2024-09-15T23:20:37.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.409+0000 7fd54a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd54c0b2d40 0x7fd54c13dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:37.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.409+0000 7fd54a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd54c0b2d40 0x7fd54c13dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39330/0 (socket says 172.21.15.123:39330) 2024-09-15T23:20:37.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.409+0000 7fd54a59c640 1 -- 172.21.15.123:0/3449995425 learned_addr learned my addr 172.21.15.123:0/3449995425 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:37.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.409+0000 7fd54b59e640 1 --2- 172.21.15.123:0/3449995425 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd54c13eb20 0x7fd54c15cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:37.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.409+0000 7fd54ad9d640 1 --2- 172.21.15.123:0/3449995425 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd54c06c150 0x7fd54c143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:37.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.409+0000 7fd54a59c640 1 -- 172.21.15.123:0/3449995425 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd54c06c150 msgr2=0x7fd54c143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:37.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.409+0000 7fd54a59c640 1 --2- 172.21.15.123:0/3449995425 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd54c06c150 0x7fd54c143020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:37.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.409+0000 7fd54a59c640 1 -- 172.21.15.123:0/3449995425 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd54c13eb20 msgr2=0x7fd54c15cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:37.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.409+0000 7fd54a59c640 1 --2- 172.21.15.123:0/3449995425 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd54c13eb20 0x7fd54c15cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:37.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.409+0000 7fd54a59c640 1 -- 172.21.15.123:0/3449995425 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd54c15d9f0 con 0x7fd54c0b2d40 2024-09-15T23:20:37.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.410+0000 7fd54a59c640 1 --2- 172.21.15.123:0/3449995425 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd54c0b2d40 0x7fd54c13dee0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7fd54000c3f0 tx=0x7fd54000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:37.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.410+0000 7fd5337fe640 1 -- 172.21.15.123:0/3449995425 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5400074e0 con 0x7fd54c0b2d40 2024-09-15T23:20:37.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.410+0000 7fd5337fe640 1 -- 172.21.15.123:0/3449995425 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5400047e0 con 0x7fd54c0b2d40 2024-09-15T23:20:37.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.410+0000 7fd5337fe640 1 -- 172.21.15.123:0/3449995425 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd540004bd0 con 0x7fd54c0b2d40 2024-09-15T23:20:37.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.410+0000 7fd5511d6640 1 -- 172.21.15.123:0/3449995425 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd54c15dcd0 con 0x7fd54c0b2d40 2024-09-15T23:20:37.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.410+0000 7fd5511d6640 1 -- 172.21.15.123:0/3449995425 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd54c142820 con 0x7fd54c0b2d40 2024-09-15T23:20:37.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.411+0000 7fd5511d6640 1 -- 172.21.15.123:0/3449995425 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd54c06bc10 con 0x7fd54c0b2d40 2024-09-15T23:20:37.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.412+0000 7fd5337fe640 1 -- 172.21.15.123:0/3449995425 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd540011070 con 0x7fd54c0b2d40 2024-09-15T23:20:37.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.412+0000 7fd5337fe640 1 --2- 172.21.15.123:0/3449995425 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd53806c2b0 0x7fd53806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:37.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.412+0000 7fd5337fe640 1 -- 172.21.15.123:0/3449995425 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7fd54008b030 con 0x7fd54c0b2d40 2024-09-15T23:20:37.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.412+0000 7fd54ad9d640 1 --2- 172.21.15.123:0/3449995425 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd53806c2b0 0x7fd53806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:37.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.413+0000 7fd54ad9d640 1 --2- 172.21.15.123:0/3449995425 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd53806c2b0 0x7fd53806e770 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fd53c033000 tx=0x7fd53c009000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:37.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.416+0000 7fd5337fe640 1 -- 172.21.15.123:0/3449995425 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd54001a2b0 con 0x7fd54c0b2d40 2024-09-15T23:20:37.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.614+0000 7fd5511d6640 1 -- 172.21.15.123:0/3449995425 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd54c06c9c0 con 0x7fd54c0b2d40 2024-09-15T23:20:37.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.615+0000 7fd5337fe640 1 -- 172.21.15.123:0/3449995425 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5236 (secure 0 0 0) 0x7fd5400597a0 con 0x7fd54c0b2d40 2024-09-15T23:20:37.616 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:37.616 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":93,"btime":"2024-09-15T23:20:31:301251+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7735,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/3725440007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3725440007},{"type":"v1","addr":"172.21.15.188:6836","nonce":3725440007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7738,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2908220643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2908220643},{"type":"v1","addr":"172.21.15.188:6837","nonce":2908220643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":9003,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2302544827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2302544827},{"type":"v1","addr":"172.21.15.123:6834","nonce":2302544827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:20:28.532639+0000","modified":"2024-09-15T23:20:30.630141+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9006":{"gid":9006,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/627322542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":627322542},{"type":"v1","addr":"172.21.15.123:6835","nonce":627322542}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9006,"qdb_cluster":[9006]},"id":10}]} 2024-09-15T23:20:37.616 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 93 2024-09-15T23:20:37.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.616+0000 7fd5511d6640 1 -- 172.21.15.123:0/3449995425 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd53806c2b0 msgr2=0x7fd53806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:37.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.616+0000 7fd5511d6640 1 --2- 172.21.15.123:0/3449995425 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd53806c2b0 0x7fd53806e770 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fd53c033000 tx=0x7fd53c009000 comp rx=0 tx=0).stop 2024-09-15T23:20:37.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.616+0000 7fd5511d6640 1 -- 172.21.15.123:0/3449995425 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd54c0b2d40 msgr2=0x7fd54c13dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:37.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.616+0000 7fd5511d6640 1 --2- 172.21.15.123:0/3449995425 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd54c0b2d40 0x7fd54c13dee0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7fd54000c3f0 tx=0x7fd54000c8b0 comp rx=0 tx=0).stop 2024-09-15T23:20:37.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.617+0000 7fd5511d6640 1 -- 172.21.15.123:0/3449995425 shutdown_connections 2024-09-15T23:20:37.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.617+0000 7fd5511d6640 1 --2- 172.21.15.123:0/3449995425 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd54c13eb20 0x7fd54c15cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:37.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.617+0000 7fd5511d6640 1 --2- 172.21.15.123:0/3449995425 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd53806c2b0 0x7fd53806e770 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:37.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.617+0000 7fd5511d6640 1 --2- 172.21.15.123:0/3449995425 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd54c0b2d40 0x7fd54c13dee0 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:37.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.617+0000 7fd5511d6640 1 --2- 172.21.15.123:0/3449995425 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd54c06c150 0x7fd54c143020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:37.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.617+0000 7fd5511d6640 1 -- 172.21.15.123:0/3449995425 >> 172.21.15.123:0/3449995425 conn(0x7fd54c0ccec0 msgr2=0x7fd54c157450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:37.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.617+0000 7fd5511d6640 1 -- 172.21.15.123:0/3449995425 shutdown_connections 2024-09-15T23:20:37.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:37.617+0000 7fd5511d6640 1 -- 172.21.15.123:0/3449995425 wait complete. 2024-09-15T23:20:38.032 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 93, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:20:28.532639+0000', 'modified': '2024-09-15T23:20:30.630141+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9006}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9006': {'gid': 9006, 'name': 'c', 'rank': 0, 'incarnation': 90, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.123:6835/627322542', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6833', 'nonce': 627322542}, {'type': 'v1', 'addr': '172.21.15.123:6835', 'nonce': 627322542}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9006, 'qdb_cluster': [9006]} 2024-09-15T23:20:38.033 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:20:38.033 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-15T23:20:38.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.139+0000 7f8487b91640 1 Processor -- start 2024-09-15T23:20:38.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.139+0000 7f8487b91640 1 -- start start 2024-09-15T23:20:38.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.140+0000 7f8487b91640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f848015ab40 0x7f848006c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:38.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.140+0000 7f8487b91640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f84800720b0 0x7f8480073990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:38.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.140+0000 7f8487b91640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8480072520 con 0x7f848015af20 2024-09-15T23:20:38.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.140+0000 7f8487b91640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f8480071010 con 0x7f848015ab40 2024-09-15T23:20:38.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.140+0000 7f8487b91640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f84800712f0 con 0x7f84800720b0 2024-09-15T23:20:38.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.140+0000 7f848592d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f848015ab40 0x7f848006c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:38.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.140+0000 7f848592d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f848015ab40 0x7f848006c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39338/0 (socket says 172.21.15.123:39338) 2024-09-15T23:20:38.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.140+0000 7f848592d640 1 -- 172.21.15.123:0/3958467345 learned_addr learned my addr 172.21.15.123:0/3958467345 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:38.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.140+0000 7f848512c640 1 --2- 172.21.15.123:0/3958467345 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f84800720b0 0x7f8480073990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:38.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.140+0000 7f848592d640 1 -- 172.21.15.123:0/3958467345 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f84800720b0 msgr2=0x7f8480073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:38.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.140+0000 7f848592d640 1 --2- 172.21.15.123:0/3958467345 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f84800720b0 0x7f8480073990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.140+0000 7f848592d640 1 -- 172.21.15.123:0/3958467345 >> v1:172.21.15.188:6789/0 conn(0x7f848015af20 legacy=0x7f848015b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:38.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.140+0000 7f848592d640 1 -- 172.21.15.123:0/3958467345 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84800715d0 con 0x7f848015ab40 2024-09-15T23:20:38.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.141+0000 7f848592d640 1 --2- 172.21.15.123:0/3958467345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f848015ab40 0x7f848006c6a0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f847c009870 tx=0x7f847c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3a7dd5dd4d0e33d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:38.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.141+0000 7f848492b640 1 -- 172.21.15.123:0/3958467345 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f847c037070 con 0x7f848015ab40 2024-09-15T23:20:38.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.141+0000 7f848492b640 1 -- 172.21.15.123:0/3958467345 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f847c032440 con 0x7f848015ab40 2024-09-15T23:20:38.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.141+0000 7f848492b640 1 -- 172.21.15.123:0/3958467345 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f847c032810 con 0x7f848015ab40 2024-09-15T23:20:38.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.142+0000 7f8487b91640 1 -- 172.21.15.123:0/3958467345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f848015ab40 msgr2=0x7f848006c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:38.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.142+0000 7f8487b91640 1 --2- 172.21.15.123:0/3958467345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f848015ab40 0x7f848006c6a0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f847c009870 tx=0x7f847c02a1c0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.142+0000 7f8487b91640 1 -- 172.21.15.123:0/3958467345 shutdown_connections 2024-09-15T23:20:38.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.142+0000 7f8487b91640 1 --2- 172.21.15.123:0/3958467345 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f84800720b0 0x7f8480073990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.142+0000 7f8487b91640 1 --2- 172.21.15.123:0/3958467345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f848015ab40 0x7f848006c6a0 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.142+0000 7f8487b91640 1 -- 172.21.15.123:0/3958467345 >> 172.21.15.123:0/3958467345 conn(0x7f84800ccec0 msgr2=0x7f84800cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:38.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.142+0000 7f8487b91640 1 -- 172.21.15.123:0/3958467345 shutdown_connections 2024-09-15T23:20:38.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.142+0000 7f8487b91640 1 -- 172.21.15.123:0/3958467345 wait complete. 2024-09-15T23:20:38.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.143+0000 7f8487b91640 1 Processor -- start 2024-09-15T23:20:38.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.143+0000 7f8487b91640 1 -- start start 2024-09-15T23:20:38.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.144+0000 7f8487b91640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84800720b0 0x7f84801e2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:38.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.144+0000 7f8487b91640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f848015ab40 0x7f84800cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:38.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.144+0000 7f8487b91640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f848015af20 0x7f84801e4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:38.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.144+0000 7f8487b91640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8480073ed0 con 0x7f84800720b0 2024-09-15T23:20:38.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.144+0000 7f8487b91640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f848015baa0 con 0x7f848015ab40 2024-09-15T23:20:38.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.144+0000 7f8487b91640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f848015c1d0 con 0x7f848015af20 2024-09-15T23:20:38.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.144+0000 7f848592d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84800720b0 0x7f84801e2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:38.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.144+0000 7f848592d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84800720b0 0x7f84801e2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39340/0 (socket says 172.21.15.123:39340) 2024-09-15T23:20:38.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.144+0000 7f848592d640 1 -- 172.21.15.123:0/1277369366 learned_addr learned my addr 172.21.15.123:0/1277369366 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:38.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.144+0000 7f848512c640 1 --2- 172.21.15.123:0/1277369366 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f848015ab40 0x7f84800cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:38.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.144+0000 7f848612e640 1 --2- 172.21.15.123:0/1277369366 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f848015af20 0x7f84801e4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:38.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.144+0000 7f848592d640 1 -- 172.21.15.123:0/1277369366 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f848015af20 msgr2=0x7f84801e4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:38.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.144+0000 7f848592d640 1 --2- 172.21.15.123:0/1277369366 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f848015af20 0x7f84801e4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.144+0000 7f848592d640 1 -- 172.21.15.123:0/1277369366 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f848015ab40 msgr2=0x7f84800cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:38.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.144+0000 7f848592d640 1 --2- 172.21.15.123:0/1277369366 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f848015ab40 0x7f84800cbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.144+0000 7f848592d640 1 -- 172.21.15.123:0/1277369366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84801e1ad0 con 0x7f84800720b0 2024-09-15T23:20:38.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.144+0000 7f848512c640 1 --2- 172.21.15.123:0/1277369366 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f848015ab40 0x7f84800cbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:38.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.144+0000 7f848592d640 1 --2- 172.21.15.123:0/1277369366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84800720b0 0x7f84801e2b70 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f847c000c00 tx=0x7f847c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:38.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.145+0000 7f84767fc640 1 -- 172.21.15.123:0/1277369366 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f847c041020 con 0x7f84800720b0 2024-09-15T23:20:38.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.145+0000 7f84767fc640 1 -- 172.21.15.123:0/1277369366 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f847c0306c0 con 0x7f84800720b0 2024-09-15T23:20:38.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.145+0000 7f8487b91640 1 -- 172.21.15.123:0/1277369366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84801e1db0 con 0x7f84800720b0 2024-09-15T23:20:38.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.145+0000 7f84767fc640 1 -- 172.21.15.123:0/1277369366 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f847c037040 con 0x7f84800720b0 2024-09-15T23:20:38.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.145+0000 7f8487b91640 1 -- 172.21.15.123:0/1277369366 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84801e2370 con 0x7f84800720b0 2024-09-15T23:20:38.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.146+0000 7f84767fc640 1 -- 172.21.15.123:0/1277369366 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f847c044020 con 0x7f84800720b0 2024-09-15T23:20:38.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.146+0000 7f84767fc640 1 --2- 172.21.15.123:0/1277369366 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f846406c2b0 0x7f846406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:38.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.147+0000 7f84767fc640 1 -- 172.21.15.123:0/1277369366 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f847c0abcb0 con 0x7f84800720b0 2024-09-15T23:20:38.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.147+0000 7f848512c640 1 --2- 172.21.15.123:0/1277369366 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f846406c2b0 0x7f846406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:38.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.147+0000 7f848512c640 1 --2- 172.21.15.123:0/1277369366 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f846406c2b0 0x7f846406e770 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f84801e4020 tx=0x7f8470008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:38.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.148+0000 7f848aa09740 1 Processor -- start 2024-09-15T23:20:38.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.148+0000 7f848aa09740 1 -- start start 2024-09-15T23:20:38.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.148+0000 7f848aa09740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b01cca82c0 0x55b01cceda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:38.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.148+0000 7f848aa09740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b01cca5a80 0x55b01cca86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:38.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.148+0000 7f848aa09740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b01cca9a50 0x55b01cca28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:38.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.148+0000 7f848aa09740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55b01cc0a520 con 0x55b01cca5a80 2024-09-15T23:20:38.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.148+0000 7f848aa09740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b01cbb23e0 con 0x55b01cca9a50 2024-09-15T23:20:38.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.148+0000 7f848aa09740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55b01cc064e0 con 0x55b01cca82c0 2024-09-15T23:20:38.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.148+0000 7f848512c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b01cca5a80 0x55b01cca86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:38.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.149+0000 7f848512c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b01cca5a80 0x55b01cca86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39342/0 (socket says 172.21.15.123:39342) 2024-09-15T23:20:38.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.149+0000 7f848512c640 1 -- 172.21.15.123:0/587498066 learned_addr learned my addr 172.21.15.123:0/587498066 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:38.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.149+0000 7f848592d640 1 --2- 172.21.15.123:0/587498066 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b01cca82c0 0x55b01cceda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:38.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.149+0000 7f848612e640 1 --2- 172.21.15.123:0/587498066 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b01cca9a50 0x55b01cca28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:38.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.149+0000 7f848512c640 1 -- 172.21.15.123:0/587498066 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b01cca82c0 msgr2=0x55b01cceda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:38.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.149+0000 7f848512c640 1 --2- 172.21.15.123:0/587498066 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b01cca82c0 0x55b01cceda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.149+0000 7f848512c640 1 -- 172.21.15.123:0/587498066 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b01cca9a50 msgr2=0x55b01cca28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:38.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.149+0000 7f848512c640 1 --2- 172.21.15.123:0/587498066 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b01cca9a50 0x55b01cca28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.149+0000 7f848512c640 1 -- 172.21.15.123:0/587498066 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b01cbcd2f0 con 0x55b01cca5a80 2024-09-15T23:20:38.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.149+0000 7f848512c640 1 --2- 172.21.15.123:0/587498066 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b01cca5a80 0x55b01cca86a0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f847000fab0 tx=0x7f8470012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abf686865c1c73f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:38.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.149+0000 7f84637fe640 1 -- 172.21.15.123:0/587498066 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f847001b050 con 0x55b01cca5a80 2024-09-15T23:20:38.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.149+0000 7f84637fe640 1 -- 172.21.15.123:0/587498066 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8470025070 con 0x55b01cca5a80 2024-09-15T23:20:38.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.149+0000 7f84637fe640 1 -- 172.21.15.123:0/587498066 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8470020440 con 0x55b01cca5a80 2024-09-15T23:20:38.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.150+0000 7f848aa09740 1 -- 172.21.15.123:0/587498066 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b01cca5a80 msgr2=0x55b01cca86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:38.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.150+0000 7f848aa09740 1 --2- 172.21.15.123:0/587498066 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b01cca5a80 0x55b01cca86a0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f847000fab0 tx=0x7f8470012000 comp rx=0 tx=0).stop 2024-09-15T23:20:38.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.150+0000 7f848aa09740 1 -- 172.21.15.123:0/587498066 shutdown_connections 2024-09-15T23:20:38.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.150+0000 7f848aa09740 1 --2- 172.21.15.123:0/587498066 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b01cca9a50 0x55b01cca28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.150+0000 7f848aa09740 1 --2- 172.21.15.123:0/587498066 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b01cca5a80 0x55b01cca86a0 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.150+0000 7f848aa09740 1 --2- 172.21.15.123:0/587498066 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b01cca82c0 0x55b01cceda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.150+0000 7f848aa09740 1 -- 172.21.15.123:0/587498066 >> 172.21.15.123:0/587498066 conn(0x55b01cca4a80 msgr2=0x55b01ccecf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:38.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.150+0000 7f848aa09740 1 -- 172.21.15.123:0/587498066 shutdown_connections 2024-09-15T23:20:38.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.150+0000 7f848aa09740 1 -- 172.21.15.123:0/587498066 wait complete. 2024-09-15T23:20:38.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.150+0000 7f848aa09740 1 -- start start 2024-09-15T23:20:38.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.150+0000 7f848aa09740 1 Processor -- start 2024-09-15T23:20:38.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.151+0000 7f848aa09740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b01cca82c0 0x55b01ccea750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:38.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.151+0000 7f848aa09740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b01cca9a50 0x55b01ccc85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:38.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.151+0000 7f848aa09740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b01ccd0770 0x55b01cccabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:38.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.151+0000 7f848aa09740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55b01cca3f20 con 0x55b01ccd0770 2024-09-15T23:20:38.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.151+0000 7f848aa09740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b01cb93450 con 0x55b01cca9a50 2024-09-15T23:20:38.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.151+0000 7f848aa09740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55b01ccee290 con 0x55b01cca82c0 2024-09-15T23:20:38.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.151+0000 7f848aa09740 10 client.0 _ll_register_callbacks cb 0x55b01c91cac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:20:38.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.151+0000 7f848612e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b01ccd0770 0x55b01cccabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:38.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.151+0000 7f848612e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b01ccd0770 0x55b01cccabb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39346/0 (socket says 172.21.15.123:39346) 2024-09-15T23:20:38.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.151+0000 7f848612e640 1 -- 172.21.15.123:0/3611719985 learned_addr learned my addr 172.21.15.123:0/3611719985 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:38.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.152+0000 7f848592d640 1 --2- 172.21.15.123:0/3611719985 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b01cca82c0 0x55b01ccea750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:38.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.152+0000 7f848512c640 1 --2- 172.21.15.123:0/3611719985 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b01cca9a50 0x55b01ccc85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:38.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.152+0000 7f848612e640 1 -- 172.21.15.123:0/3611719985 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b01cca82c0 msgr2=0x55b01ccea750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:38.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.152+0000 7f848612e640 1 --2- 172.21.15.123:0/3611719985 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b01cca82c0 0x55b01ccea750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.152+0000 7f848612e640 1 -- 172.21.15.123:0/3611719985 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b01cca9a50 msgr2=0x55b01ccc85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:38.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.152+0000 7f848612e640 1 --2- 172.21.15.123:0/3611719985 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b01cca9a50 0x55b01ccc85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.152+0000 7f848612e640 1 -- 172.21.15.123:0/3611719985 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b01c91d2d0 con 0x55b01ccd0770 2024-09-15T23:20:38.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.152+0000 7f848512c640 1 --2- 172.21.15.123:0/3611719985 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b01cca9a50 0x55b01ccc85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:20:38.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.152+0000 7f848612e640 1 --2- 172.21.15.123:0/3611719985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b01ccd0770 0x55b01cccabb0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f8478011510 tx=0x7f84780119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80a0c16ef175c4ec server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:38.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.152+0000 7f8460ff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:20:38.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.152+0000 7f8460ff9640 1 -- 172.21.15.123:0/3611719985 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8478003b80 con 0x55b01ccd0770 2024-09-15T23:20:38.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.152+0000 7f8460ff9640 1 -- 172.21.15.123:0/3611719985 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f8478010040 con 0x55b01ccd0770 2024-09-15T23:20:38.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.152+0000 7f848aa09740 1 -- 172.21.15.123:0/3611719985 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8470025070 con 0x55b01ccd0770 2024-09-15T23:20:38.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.152+0000 7f8460ff9640 1 -- 172.21.15.123:0/3611719985 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f8478003d20 con 0x55b01ccd0770 2024-09-15T23:20:38.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.152+0000 7f848aa09740 10 client.9162 fetch_fsmap learned FSMap version 93 2024-09-15T23:20:38.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.152+0000 7f848aa09740 1 -- 172.21.15.123:0/3611719985 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) -- 0x55b01c9e76b0 con 0x55b01ccd0770 2024-09-15T23:20:38.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.152+0000 7f8460ff9640 1 -- 172.21.15.123:0/3611719985 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8470025070 con 0x55b01ccd0770 2024-09-15T23:20:38.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.152+0000 7f8460ff9640 1 -- 172.21.15.123:0/3611719985 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 93) ==== 3502+0+0 (secure 0 0 0) 0x7f8478006b50 con 0x55b01ccd0770 2024-09-15T23:20:38.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.152+0000 7f848aa09740 10 client.9162 fetch_fsmap finished waiting for FSMap version 93 2024-09-15T23:20:38.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.152+0000 7f848aa09740 10 client.9162 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T23:20:38.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.152+0000 7f848aa09740 20 client.9162 populate_metadata read hostname 'smithi123' 2024-09-15T23:20:38.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.152+0000 7f848aa09740 1 --2- 172.21.15.123:0/3611719985 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55b01cca1d70 0x55b01ccd1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:38.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.153+0000 7f848aa09740 4 client.9162 mds_command: new command op to 9006 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:20:38.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.153+0000 7f848aa09740 1 -- 172.21.15.123:0/3611719985 --> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b01cc17c50 con 0x55b01cca1d70 2024-09-15T23:20:38.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.153+0000 7f848592d640 1 --2- 172.21.15.123:0/3611719985 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55b01cca1d70 0x55b01ccd1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:38.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.153+0000 7f8460ff9640 10 client.9162 ms_handle_connect on v2:172.21.15.123:6833/627322542 2024-09-15T23:20:38.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.153+0000 7f848592d640 1 --2- 172.21.15.123:0/3611719985 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55b01cca1d70 0x55b01ccd1d10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8a68ef87b5344c server_cookie=5388c6e3235102e6 in_seq=0 out_seq=0 2024-09-15T23:20:38.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.154+0000 7f8460ff9640 1 -- 172.21.15.123:0/3611719985 <== mds.0 v2:172.21.15.123:6833/627322542 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b01cc17c50 con 0x55b01cca1d70 2024-09-15T23:20:38.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.154+0000 7f8460ff9640 10 client.9162 handle_command_reply: tid=0 2024-09-15T23:20:38.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.154+0000 7f848aa09740 1 client.9162 shutdown 2024-09-15T23:20:38.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.154+0000 7f848aa09740 1 -- 172.21.15.123:0/3611719985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b01ccd0770 msgr2=0x55b01cccabb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:38.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.154+0000 7f848aa09740 1 --2- 172.21.15.123:0/3611719985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b01ccd0770 0x55b01cccabb0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f8478011510 tx=0x7f84780119d0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.154+0000 7f848aa09740 1 -- 172.21.15.123:0/3611719985 shutdown_connections 2024-09-15T23:20:38.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.154+0000 7f848aa09740 1 --2- 172.21.15.123:0/3611719985 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55b01cca1d70 0x55b01ccd1d10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.154+0000 7f848aa09740 1 --2- 172.21.15.123:0/3611719985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b01ccd0770 0x55b01cccabb0 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.154+0000 7f848aa09740 1 --2- 172.21.15.123:0/3611719985 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b01cca9a50 0x55b01ccc85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.154+0000 7f8460ff9640 0 client.9162 ms_handle_reset on v2:172.21.15.123:6833/627322542 2024-09-15T23:20:38.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.154+0000 7f848aa09740 1 --2- 172.21.15.123:0/3611719985 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b01cca82c0 0x55b01ccea750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.154+0000 7f848aa09740 1 -- 172.21.15.123:0/3611719985 >> 172.21.15.123:0/3611719985 conn(0x55b01cca5a80 msgr2=0x55b01cca6020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:38.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.154+0000 7f848aa09740 1 -- 172.21.15.123:0/3611719985 shutdown_connections 2024-09-15T23:20:38.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.154+0000 7f848aa09740 1 -- 172.21.15.123:0/3611719985 wait complete. 2024-09-15T23:20:38.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.154+0000 7f848aa09740 20 client.9162 trim_cache size 0 max 16384 2024-09-15T23:20:38.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.172+0000 7f848aa09740 1 Processor -- start 2024-09-15T23:20:38.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.172+0000 7f848aa09740 1 -- start start 2024-09-15T23:20:38.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.172+0000 7f848aa09740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b01cca82c0 0x55b01cca2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:38.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.172+0000 7f848aa09740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b01cca9a50 0x55b01ccd1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:38.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.172+0000 7f848aa09740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b01ccd0770 0x55b01cd10780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:38.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.172+0000 7f848aa09740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f84801fdc60 con 0x55b01cca9a50 2024-09-15T23:20:38.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.172+0000 7f848aa09740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f84801f6250 con 0x55b01cca82c0 2024-09-15T23:20:38.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.172+0000 7f848aa09740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f84800c87d0 con 0x55b01ccd0770 2024-09-15T23:20:38.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.173+0000 7f848512c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b01cca9a50 0x55b01ccd1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:38.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.173+0000 7f848512c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b01cca9a50 0x55b01ccd1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39348/0 (socket says 172.21.15.123:39348) 2024-09-15T23:20:38.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.173+0000 7f848512c640 1 -- 172.21.15.123:0/881614283 learned_addr learned my addr 172.21.15.123:0/881614283 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:38.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.173+0000 7f848592d640 1 --2- 172.21.15.123:0/881614283 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b01cca82c0 0x55b01cca2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:38.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.173+0000 7f848612e640 1 --2- 172.21.15.123:0/881614283 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b01ccd0770 0x55b01cd10780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:38.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.173+0000 7f848512c640 1 -- 172.21.15.123:0/881614283 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b01ccd0770 msgr2=0x55b01cd10780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:38.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.173+0000 7f848512c640 1 --2- 172.21.15.123:0/881614283 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b01ccd0770 0x55b01cd10780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.173+0000 7f848512c640 1 -- 172.21.15.123:0/881614283 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b01cca82c0 msgr2=0x55b01cca2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:38.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.173+0000 7f848512c640 1 --2- 172.21.15.123:0/881614283 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b01cca82c0 0x55b01cca2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.173+0000 7f848512c640 1 -- 172.21.15.123:0/881614283 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b01cccaf20 con 0x55b01cca9a50 2024-09-15T23:20:38.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.173+0000 7f848592d640 1 --2- 172.21.15.123:0/881614283 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b01cca82c0 0x55b01cca2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:20:38.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.173+0000 7f848612e640 1 --2- 172.21.15.123:0/881614283 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b01ccd0770 0x55b01cd10780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:20:38.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.173+0000 7f848512c640 1 --2- 172.21.15.123:0/881614283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b01cca9a50 0x55b01ccd1ed0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f8470022040 tx=0x7f8470014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59cb2739e9cd6778 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:38.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.173+0000 7f8462ffd640 1 -- 172.21.15.123:0/881614283 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8470014d60 con 0x55b01cca9a50 2024-09-15T23:20:38.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.173+0000 7f8462ffd640 1 -- 172.21.15.123:0/881614283 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8470025040 con 0x55b01cca9a50 2024-09-15T23:20:38.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.173+0000 7f8462ffd640 1 -- 172.21.15.123:0/881614283 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8470034640 con 0x55b01cca9a50 2024-09-15T23:20:38.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.174+0000 7f848aa09740 1 -- 172.21.15.123:0/881614283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b01cca9a50 msgr2=0x55b01ccd1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:38.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.174+0000 7f848aa09740 1 --2- 172.21.15.123:0/881614283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b01cca9a50 0x55b01ccd1ed0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f8470022040 tx=0x7f8470014000 comp rx=0 tx=0).stop 2024-09-15T23:20:38.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.174+0000 7f848aa09740 1 -- 172.21.15.123:0/881614283 shutdown_connections 2024-09-15T23:20:38.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.174+0000 7f848aa09740 1 --2- 172.21.15.123:0/881614283 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b01ccd0770 0x55b01cd10780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.174+0000 7f848aa09740 1 --2- 172.21.15.123:0/881614283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b01cca9a50 0x55b01ccd1ed0 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.174+0000 7f848aa09740 1 --2- 172.21.15.123:0/881614283 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b01cca82c0 0x55b01cca2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.174+0000 7f848aa09740 1 -- 172.21.15.123:0/881614283 >> 172.21.15.123:0/881614283 conn(0x55b01cca5a80 msgr2=0x55b01cccfca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:38.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.174+0000 7f848aa09740 1 -- 172.21.15.123:0/881614283 shutdown_connections 2024-09-15T23:20:38.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.174+0000 7f848aa09740 1 -- 172.21.15.123:0/881614283 wait complete. 2024-09-15T23:20:38.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.174+0000 7f848aa09740 1 -- start start 2024-09-15T23:20:38.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.174+0000 7f848aa09740 1 Processor -- start 2024-09-15T23:20:38.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.175+0000 7f848aa09740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b01cca82c0 0x55b01cd6ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:38.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.175+0000 7f848aa09740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b01cca9a50 0x55b01cd53fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:38.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.175+0000 7f848aa09740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b01ccd0770 0x55b01cca6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:38.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.175+0000 7f848aa09740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55b01cca1bf0 con 0x55b01ccd0770 2024-09-15T23:20:38.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.175+0000 7f848aa09740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b01ccc94e0 con 0x55b01cca9a50 2024-09-15T23:20:38.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.175+0000 7f848aa09740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55b01cca2240 con 0x55b01cca82c0 2024-09-15T23:20:38.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.175+0000 7f848aa09740 10 client.0 _ll_register_callbacks cb 0x7f8478001820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:20:38.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.175+0000 7f848612e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b01ccd0770 0x55b01cca6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:38.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.175+0000 7f848612e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b01ccd0770 0x55b01cca6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39364/0 (socket says 172.21.15.123:39364) 2024-09-15T23:20:38.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.175+0000 7f848612e640 1 -- 172.21.15.123:0/3965860198 learned_addr learned my addr 172.21.15.123:0/3965860198 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:38.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.175+0000 7f848592d640 1 --2- 172.21.15.123:0/3965860198 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b01cca82c0 0x55b01cd6ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:38.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.175+0000 7f848512c640 1 --2- 172.21.15.123:0/3965860198 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b01cca9a50 0x55b01cd53fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:38.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.176+0000 7f848612e640 1 -- 172.21.15.123:0/3965860198 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b01cca82c0 msgr2=0x55b01cd6ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:38.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.176+0000 7f848612e640 1 --2- 172.21.15.123:0/3965860198 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b01cca82c0 0x55b01cd6ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.176+0000 7f848612e640 1 -- 172.21.15.123:0/3965860198 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b01cca9a50 msgr2=0x55b01cd53fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:38.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.176+0000 7f848612e640 1 --2- 172.21.15.123:0/3965860198 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b01cca9a50 0x55b01cd53fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.176+0000 7f848612e640 1 -- 172.21.15.123:0/3965860198 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b01cd54510 con 0x55b01ccd0770 2024-09-15T23:20:38.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.176+0000 7f848592d640 1 --2- 172.21.15.123:0/3965860198 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b01cca82c0 0x55b01cd6ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:38.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.176+0000 7f848512c640 1 --2- 172.21.15.123:0/3965860198 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b01cca9a50 0x55b01cd53fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:38.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.176+0000 7f848612e640 1 --2- 172.21.15.123:0/3965860198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b01ccd0770 0x55b01cca6710 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f8478001460 tx=0x7f8478001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f2842c15bce1b1c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:38.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.176+0000 7f8460ff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:20:38.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.176+0000 7f8460ff9640 1 -- 172.21.15.123:0/3965860198 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8478005360 con 0x55b01ccd0770 2024-09-15T23:20:38.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.176+0000 7f8460ff9640 1 -- 172.21.15.123:0/3965860198 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f8478005500 con 0x55b01ccd0770 2024-09-15T23:20:38.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.176+0000 7f848aa09740 1 -- 172.21.15.123:0/3965860198 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8470025040 con 0x55b01ccd0770 2024-09-15T23:20:38.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.176+0000 7f8460ff9640 1 -- 172.21.15.123:0/3965860198 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f8478005700 con 0x55b01ccd0770 2024-09-15T23:20:38.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.176+0000 7f848aa09740 10 client.9168 fetch_fsmap learned FSMap version 93 2024-09-15T23:20:38.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.176+0000 7f848aa09740 1 -- 172.21.15.123:0/3965860198 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) -- 0x55b01cd6e900 con 0x55b01ccd0770 2024-09-15T23:20:38.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.176+0000 7f8460ff9640 1 -- 172.21.15.123:0/3965860198 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8470025040 con 0x55b01ccd0770 2024-09-15T23:20:38.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.176+0000 7f8460ff9640 1 -- 172.21.15.123:0/3965860198 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 93) ==== 3502+0+0 (secure 0 0 0) 0x7f8478015470 con 0x55b01ccd0770 2024-09-15T23:20:38.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.176+0000 7f848aa09740 10 client.9168 fetch_fsmap finished waiting for FSMap version 93 2024-09-15T23:20:38.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.176+0000 7f848aa09740 10 client.9168 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T23:20:38.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.176+0000 7f848aa09740 20 client.9168 populate_metadata read hostname 'smithi123' 2024-09-15T23:20:38.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.176+0000 7f848aa09740 1 --2- 172.21.15.123:0/3965860198 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55b01ccce050 0x55b01ccfb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:38.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.176+0000 7f848aa09740 4 client.9168 mds_command: new command op to 9006 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:20:38.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.176+0000 7f848aa09740 1 -- 172.21.15.123:0/3965860198 --> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] -- command(tid 0: {"prefix": "status"}) -- 0x55b01cc11fa0 con 0x55b01ccce050 2024-09-15T23:20:38.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.176+0000 7f848592d640 1 --2- 172.21.15.123:0/3965860198 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55b01ccce050 0x55b01ccfb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:38.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.177+0000 7f8460ff9640 10 client.9168 ms_handle_connect on v2:172.21.15.123:6833/627322542 2024-09-15T23:20:38.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.177+0000 7f848592d640 1 --2- 172.21.15.123:0/3965860198 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55b01ccce050 0x55b01ccfb5c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2060dfa7ee74016d server_cookie=3f8cf11f7e256ee in_seq=0 out_seq=0 2024-09-15T23:20:38.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.177+0000 7f8460ff9640 1 -- 172.21.15.123:0/3965860198 <== mds.0 v2:172.21.15.123:6833/627322542 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55b01cc11fa0 con 0x55b01ccce050 2024-09-15T23:20:38.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.177+0000 7f8460ff9640 10 client.9168 handle_command_reply: tid=0 2024-09-15T23:20:38.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.177+0000 7f848aa09740 1 client.9168 shutdown 2024-09-15T23:20:38.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.177+0000 7f848aa09740 1 -- 172.21.15.123:0/3965860198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b01ccd0770 msgr2=0x55b01cca6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:38.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.177+0000 7f848aa09740 1 --2- 172.21.15.123:0/3965860198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b01ccd0770 0x55b01cca6710 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f8478001460 tx=0x7f8478001250 comp rx=0 tx=0).stop 2024-09-15T23:20:38.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.177+0000 7f848aa09740 1 -- 172.21.15.123:0/3965860198 shutdown_connections 2024-09-15T23:20:38.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.177+0000 7f848aa09740 1 --2- 172.21.15.123:0/3965860198 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55b01ccce050 0x55b01ccfb5c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.177+0000 7f848aa09740 1 --2- 172.21.15.123:0/3965860198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b01ccd0770 0x55b01cca6710 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.177+0000 7f848aa09740 1 --2- 172.21.15.123:0/3965860198 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b01cca9a50 0x55b01cd53fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.177+0000 7f8460ff9640 0 client.9168 ms_handle_reset on v2:172.21.15.123:6833/627322542 2024-09-15T23:20:38.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.177+0000 7f848aa09740 1 --2- 172.21.15.123:0/3965860198 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b01cca82c0 0x55b01cd6ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.177+0000 7f848aa09740 1 -- 172.21.15.123:0/3965860198 >> 172.21.15.123:0/3965860198 conn(0x55b01cca5a80 msgr2=0x55b01cccfca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:38.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.177+0000 7f848aa09740 1 -- 172.21.15.123:0/3965860198 shutdown_connections 2024-09-15T23:20:38.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.177+0000 7f848aa09740 1 -- 172.21.15.123:0/3965860198 wait complete. 2024-09-15T23:20:38.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.177+0000 7f848aa09740 20 client.9168 trim_cache size 0 max 16384 2024-09-15T23:20:38.194 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:20:38.195 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "cb968ac4-8d3a-4b17-a673-6177aeaea589", 2024-09-15T23:20:38.195 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2024-09-15T23:20:38.195 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 9006, 2024-09-15T23:20:38.195 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-09-15T23:20:38.195 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-09-15T23:20:38.196 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-09-15T23:20:38.196 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 8.9918620960000002, 2024-09-15T23:20:38.196 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 93, 2024-09-15T23:20:38.196 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 154, 2024-09-15T23:20:38.196 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 154, 2024-09-15T23:20:38.196 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 13.343242869999999 2024-09-15T23:20:38.196 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:20:38.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.178+0000 7f8487b91640 1 -- 172.21.15.123:0/1277369366 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f846406c2b0 msgr2=0x7f846406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:38.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.178+0000 7f8487b91640 1 --2- 172.21.15.123:0/1277369366 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f846406c2b0 0x7f846406e770 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f84801e4020 tx=0x7f8470008040 comp rx=0 tx=0).stop 2024-09-15T23:20:38.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.178+0000 7f8487b91640 1 -- 172.21.15.123:0/1277369366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84800720b0 msgr2=0x7f84801e2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:38.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.178+0000 7f8487b91640 1 --2- 172.21.15.123:0/1277369366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84800720b0 0x7f84801e2b70 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f847c000c00 tx=0x7f847c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.178+0000 7f8487b91640 1 -- 172.21.15.123:0/1277369366 shutdown_connections 2024-09-15T23:20:38.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.178+0000 7f8487b91640 1 --2- 172.21.15.123:0/1277369366 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f848015af20 0x7f84801e4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.178+0000 7f8487b91640 1 --2- 172.21.15.123:0/1277369366 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f848015ab40 0x7f84800cbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.178+0000 7f8487b91640 1 --2- 172.21.15.123:0/1277369366 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f846406c2b0 0x7f846406e770 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.178+0000 7f8487b91640 1 --2- 172.21.15.123:0/1277369366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84800720b0 0x7f84801e2b70 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.178+0000 7f8487b91640 1 -- 172.21.15.123:0/1277369366 >> 172.21.15.123:0/1277369366 conn(0x7f84800ccec0 msgr2=0x7f84800c5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:38.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.178+0000 7f8487b91640 1 -- 172.21.15.123:0/1277369366 shutdown_connections 2024-09-15T23:20:38.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.178+0000 7f8487b91640 1 -- 172.21.15.123:0/1277369366 wait complete. 2024-09-15T23:20:38.202 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:20:38.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.300+0000 7f15219b7640 1 Processor -- start 2024-09-15T23:20:38.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.300+0000 7f15219b7640 1 -- start start 2024-09-15T23:20:38.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.301+0000 7f15219b7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f151c15ed20 0x7f151c0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:38.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.301+0000 7f15219b7640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f151c0d0e70 con 0x7f151c0d23b0 2024-09-15T23:20:38.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.301+0000 7f15219b7640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f151c0d00f0 con 0x7f151c0b90e0 2024-09-15T23:20:38.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.301+0000 7f15219b7640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f151c0d41c0 con 0x7f151c15ed20 2024-09-15T23:20:38.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.301+0000 7f151affd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f151c15ed20 0x7f151c0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:38.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.301+0000 7f15127fc640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f151c0d23b0 0x7f151c0cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:34536/0 (socket says 172.21.15.123:34536) 2024-09-15T23:20:38.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.301+0000 7f15127fc640 1 -- 172.21.15.123:0/2835352125 learned_addr learned my addr 172.21.15.123:0/2835352125 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:38.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.301+0000 7f151affd640 1 -- 172.21.15.123:0/2835352125 >> v1:172.21.15.188:6789/0 conn(0x7f151c0b90e0 legacy=0x7f151c0cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:38.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.301+0000 7f151affd640 1 -- 172.21.15.123:0/2835352125 >> v1:172.21.15.123:6789/0 conn(0x7f151c0d23b0 legacy=0x7f151c0cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:38.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.301+0000 7f151affd640 1 -- 172.21.15.123:0/2835352125 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f151c0d35b0 con 0x7f151c15ed20 2024-09-15T23:20:38.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.301+0000 7f151a7fc640 1 -- 172.21.15.123:0/2835352125 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 890206312 0 0) 0x7f1504001110 con 0x7f151c0d23b0 2024-09-15T23:20:38.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.302+0000 7f151affd640 1 --2- 172.21.15.123:0/2835352125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f151c15ed20 0x7f151c0b6260 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f150c0097a0 tx=0x7f150c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5cb674d02aafa83 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:38.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.302+0000 7f151a7fc640 1 -- 172.21.15.123:0/2835352125 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c037070 con 0x7f151c15ed20 2024-09-15T23:20:38.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.302+0000 7f151a7fc640 1 -- 172.21.15.123:0/2835352125 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f150c032440 con 0x7f151c15ed20 2024-09-15T23:20:38.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.302+0000 7f151a7fc640 1 -- 172.21.15.123:0/2835352125 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c032810 con 0x7f151c15ed20 2024-09-15T23:20:38.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.302+0000 7f15219b7640 1 -- 172.21.15.123:0/2835352125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f151c15ed20 msgr2=0x7f151c0b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:38.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.303+0000 7f15219b7640 1 --2- 172.21.15.123:0/2835352125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f151c15ed20 0x7f151c0b6260 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f150c0097a0 tx=0x7f150c02a1a0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.303+0000 7f15219b7640 1 -- 172.21.15.123:0/2835352125 shutdown_connections 2024-09-15T23:20:38.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.303+0000 7f15219b7640 1 --2- 172.21.15.123:0/2835352125 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f151c15ed20 0x7f151c0b6260 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.303+0000 7f15219b7640 1 -- 172.21.15.123:0/2835352125 >> 172.21.15.123:0/2835352125 conn(0x7f151c0d1260 msgr2=0x7f151c0d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:38.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.303+0000 7f15219b7640 1 -- 172.21.15.123:0/2835352125 shutdown_connections 2024-09-15T23:20:38.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.303+0000 7f15219b7640 1 -- 172.21.15.123:0/2835352125 wait complete. 2024-09-15T23:20:38.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.304+0000 7f15219b7640 1 Processor -- start 2024-09-15T23:20:38.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.304+0000 7f15219b7640 1 -- start start 2024-09-15T23:20:38.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.305+0000 7f15219b7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f151c0b90e0 0x7f151c0c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:38.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.305+0000 7f15219b7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f151c0d23b0 0x7f151c157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:38.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.305+0000 7f15219b7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f151c15ed20 0x7f151c0ce600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:38.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.305+0000 7f15219b7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f151c0d3e50 con 0x7f151c15ed20 2024-09-15T23:20:38.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.305+0000 7f15219b7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f151c0d3b70 con 0x7f151c0d23b0 2024-09-15T23:20:38.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.305+0000 7f15219b7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f151c0d32a0 con 0x7f151c0b90e0 2024-09-15T23:20:38.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.305+0000 7f151b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f151c15ed20 0x7f151c0ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:38.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.305+0000 7f151b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f151c15ed20 0x7f151c0ce600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39370/0 (socket says 172.21.15.123:39370) 2024-09-15T23:20:38.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.305+0000 7f151b7fe640 1 -- 172.21.15.123:0/3463713525 learned_addr learned my addr 172.21.15.123:0/3463713525 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:38.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.305+0000 7f151affd640 1 --2- 172.21.15.123:0/3463713525 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f151c0b90e0 0x7f151c0c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:38.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.305+0000 7f15127fc640 1 --2- 172.21.15.123:0/3463713525 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f151c0d23b0 0x7f151c157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:38.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.305+0000 7f151b7fe640 1 -- 172.21.15.123:0/3463713525 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f151c0b90e0 msgr2=0x7f151c0c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:38.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.305+0000 7f151b7fe640 1 --2- 172.21.15.123:0/3463713525 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f151c0b90e0 0x7f151c0c9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.305+0000 7f151b7fe640 1 -- 172.21.15.123:0/3463713525 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f151c0d23b0 msgr2=0x7f151c157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:38.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.305+0000 7f151b7fe640 1 --2- 172.21.15.123:0/3463713525 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f151c0d23b0 0x7f151c157db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.305+0000 7f151b7fe640 1 -- 172.21.15.123:0/3463713525 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f151c15bda0 con 0x7f151c15ed20 2024-09-15T23:20:38.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.305+0000 7f151b7fe640 1 --2- 172.21.15.123:0/3463713525 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f151c15ed20 0x7f151c0ce600 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f151400c7a0 tx=0x7f151400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:38.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.305+0000 7f1518ff9640 1 -- 172.21.15.123:0/3463713525 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1514003b70 con 0x7f151c15ed20 2024-09-15T23:20:38.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.305+0000 7f1518ff9640 1 -- 172.21.15.123:0/3463713525 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1514003d30 con 0x7f151c15ed20 2024-09-15T23:20:38.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.305+0000 7f1518ff9640 1 -- 172.21.15.123:0/3463713525 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f151400aa90 con 0x7f151c15ed20 2024-09-15T23:20:38.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.305+0000 7f15219b7640 1 -- 172.21.15.123:0/3463713525 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f151c0b3480 con 0x7f151c15ed20 2024-09-15T23:20:38.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.306+0000 7f15219b7640 1 -- 172.21.15.123:0/3463713525 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f151c1582f0 con 0x7f151c15ed20 2024-09-15T23:20:38.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.306+0000 7f15219b7640 1 -- 172.21.15.123:0/3463713525 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f151c0d21a0 con 0x7f151c15ed20 2024-09-15T23:20:38.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.307+0000 7f1518ff9640 1 -- 172.21.15.123:0/3463713525 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f151400ac30 con 0x7f151c15ed20 2024-09-15T23:20:38.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.307+0000 7f1518ff9640 1 --2- 172.21.15.123:0/3463713525 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f14fc06c2e0 0x7f14fc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:38.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.308+0000 7f1518ff9640 1 -- 172.21.15.123:0/3463713525 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f151408b330 con 0x7f151c15ed20 2024-09-15T23:20:38.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.308+0000 7f151affd640 1 --2- 172.21.15.123:0/3463713525 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f14fc06c2e0 0x7f14fc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:38.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.308+0000 7f151affd640 1 --2- 172.21.15.123:0/3463713525 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f14fc06c2e0 0x7f14fc06e7a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f150c034000 tx=0x7f150c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:38.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.312+0000 7f1518ff9640 1 -- 172.21.15.123:0/3463713525 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1514059aa0 con 0x7f151c15ed20 2024-09-15T23:20:38.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.512+0000 7f15219b7640 1 -- 172.21.15.123:0/3463713525 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f151c15bf70 con 0x7f151c15ed20 2024-09-15T23:20:38.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.512+0000 7f1518ff9640 1 -- 172.21.15.123:0/3463713525 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v93) ==== 53+0+73 (secure 0 0 0) 0x7f15140593a0 con 0x7f151c15ed20 2024-09-15T23:20:38.513 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:20:38.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.514+0000 7f15219b7640 1 -- 172.21.15.123:0/3463713525 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f14fc06c2e0 msgr2=0x7f14fc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:38.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.514+0000 7f15219b7640 1 --2- 172.21.15.123:0/3463713525 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f14fc06c2e0 0x7f14fc06e7a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f150c034000 tx=0x7f150c02e000 comp rx=0 tx=0).stop 2024-09-15T23:20:38.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.514+0000 7f15219b7640 1 -- 172.21.15.123:0/3463713525 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f151c15ed20 msgr2=0x7f151c0ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:38.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.514+0000 7f15219b7640 1 --2- 172.21.15.123:0/3463713525 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f151c15ed20 0x7f151c0ce600 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f151400c7a0 tx=0x7f151400cc60 comp rx=0 tx=0).stop 2024-09-15T23:20:38.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.514+0000 7f15219b7640 1 -- 172.21.15.123:0/3463713525 shutdown_connections 2024-09-15T23:20:38.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.514+0000 7f15219b7640 1 --2- 172.21.15.123:0/3463713525 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f14fc06c2e0 0x7f14fc06e7a0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.514+0000 7f15219b7640 1 --2- 172.21.15.123:0/3463713525 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f151c15ed20 0x7f151c0ce600 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.514+0000 7f15219b7640 1 --2- 172.21.15.123:0/3463713525 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f151c0d23b0 0x7f151c157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.514+0000 7f15219b7640 1 --2- 172.21.15.123:0/3463713525 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f151c0b90e0 0x7f151c0c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:38.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.514+0000 7f15219b7640 1 -- 172.21.15.123:0/3463713525 >> 172.21.15.123:0/3463713525 conn(0x7f151c0d1260 msgr2=0x7f151c0b4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:38.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.514+0000 7f15219b7640 1 -- 172.21.15.123:0/3463713525 shutdown_connections 2024-09-15T23:20:38.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38.514+0000 7f15219b7640 1 -- 172.21.15.123:0/3463713525 wait complete. 2024-09-15T23:20:38.526 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T23:20:38.526 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:20:38.527 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-09-15T23:20:38.527 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T23:20:38.527 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T23:20:38.527 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T23:20:38.527 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T23:20:38.527 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:20:38.528 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:20:38.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:20:38.528 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-09-15T23:20:38.544 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:20:38.544 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:20:38.544 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:20:38.545 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:20:38.545 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-09-15T23:20:38.545 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:20:38.545 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:20:38.545 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-09-15T23:20:38.545 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f0 2024-09-15T23:20:38.545 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:20:38.545 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:20:38.545 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f1 2024-09-15T23:20:38.545 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:20:38.545 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:20:38.545 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:20:38.546 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:20:38.546 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T23:20:38.546 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42302sec preferred_lft 42302sec 2024-09-15T23:20:38.546 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link noprefixroute 2024-09-15T23:20:38.546 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:20:38.546 INFO:teuthology.orchestra.run.smithi123.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:20:38.546 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 46:55:5a:e0:32:4d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:20:38.546 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:20:38.546 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:20:38.546 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::1c6f:d5ff:fe19:ff05/64 scope link 2024-09-15T23:20:38.546 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:20:38.546 INFO:teuthology.orchestra.run.smithi123.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:20:38.546 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 46:55:5a:e0:32:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:20:38.546 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::4455:5aff:fee0:324d/64 scope link 2024-09-15T23:20:38.547 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:20:38.547 INFO:teuthology.orchestra.run.smithi123.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:20:38.547 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether be:c1:f3:63:cb:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:20:38.547 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::bcc1:f3ff:fe63:cb24/64 scope link 2024-09-15T23:20:38.547 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:20:38.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:20:38.547 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:20:38.608 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-09-15T23:20:38.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:20:38.610 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-09-15T23:20:38.666 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-09-15T23:20:38.666 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:20:38.666 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:20:38.667 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:20:38.667 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:20:38.667 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:20:38.667 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:20:38.667 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:20:38.667 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:20:38.667 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:20:38.667 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:20:38.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:20:38.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:20:38.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:20:38.792 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-09-15T23:20:38.807 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T23:20:38.808 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:20:38.808 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:20:38.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:20:38.808 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2024-09-15T23:20:38.873 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:20:38.873 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T23:20:38.928 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:20:38.928 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:20:38.929 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:20:38.984 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T23:20:38.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:20:38.984 DEBUG:teuthology.orchestra.run.smithi123:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:20:39.068 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:20:39.068 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:20:39.068 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:20:39.077 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:20:39.077 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:20:39.077 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:20:39.077 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.188:3300,172.21.15.188:3301" 2024-09-15T23:20:39.077 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T23:20:39.082 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:20:39.082 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:20:39.082 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:20:39.082 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.188:3300,172.21.15.188:3301" 2024-09-15T23:20:39.082 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T23:20:39.082 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:6789,172.21.15.188:6789,172.21.15.188:6790" 2024-09-15T23:20:39.082 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.123:6789,172.21.15.188:6789,172.21.15.188:6790:/ 2024-09-15T23:20:39.082 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=cb968ac4-8d3a-4b17-a673-6177aeaea589" will pass to kernel 2024-09-15T23:20:39.082 INFO:teuthology.orchestra.run.smithi123.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-15T23:20:39.083 INFO:teuthology.orchestra.run.smithi123.stdout: You just mounted a file system that supports labels which does not 2024-09-15T23:20:39.083 INFO:teuthology.orchestra.run.smithi123.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T23:20:39.083 INFO:teuthology.orchestra.run.smithi123.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T23:20:39.083 INFO:teuthology.orchestra.run.smithi123.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T23:20:39.084 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T23:20:39.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:20:39.084 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:20:39.150 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T23:20:39.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:20:39.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:20:39.250 INFO:teuthology.orchestra.run.smithi123.stdout:client9180 2024-09-15T23:20:39.250 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:20:39.250 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:20:39.267 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:20:39.267 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:20:39.267 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.0 2024-09-15T23:20:39.267 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:20:39.267 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:20:39.267 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:20:39.267 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:20:39.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:20:39.374 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.374 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.374 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.008576 s, 122 MB/s 2024-09-15T23:20:39.382 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.382 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.382 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663465 s, 158 MB/s 2024-09-15T23:20:39.391 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.391 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.391 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731939 s, 143 MB/s 2024-09-15T23:20:39.399 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.399 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.399 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626417 s, 167 MB/s 2024-09-15T23:20:39.409 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.409 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.409 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00855723 s, 123 MB/s 2024-09-15T23:20:39.418 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.418 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.419 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776982 s, 135 MB/s 2024-09-15T23:20:39.427 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.427 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.427 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650956 s, 161 MB/s 2024-09-15T23:20:39.435 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.435 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.435 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653482 s, 160 MB/s 2024-09-15T23:20:39.443 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.443 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.443 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631402 s, 166 MB/s 2024-09-15T23:20:39.452 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.452 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.452 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00787195 s, 133 MB/s 2024-09-15T23:20:39.461 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.461 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.461 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680574 s, 154 MB/s 2024-09-15T23:20:39.468 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.468 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.468 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596452 s, 176 MB/s 2024-09-15T23:20:39.476 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.476 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.476 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579598 s, 181 MB/s 2024-09-15T23:20:39.483 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.484 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.484 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582823 s, 180 MB/s 2024-09-15T23:20:39.493 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.493 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.493 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751388 s, 140 MB/s 2024-09-15T23:20:39.502 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.502 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.502 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073386 s, 143 MB/s 2024-09-15T23:20:39.510 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.510 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.510 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686619 s, 153 MB/s 2024-09-15T23:20:39.518 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.518 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.518 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572207 s, 183 MB/s 2024-09-15T23:20:39.527 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.528 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.528 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00811688 s, 129 MB/s 2024-09-15T23:20:39.536 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.536 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.536 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719839 s, 146 MB/s 2024-09-15T23:20:39.546 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.546 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.546 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00810149 s, 129 MB/s 2024-09-15T23:20:39.555 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.555 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.555 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00782765 s, 134 MB/s 2024-09-15T23:20:39.562 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.562 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.562 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00555434 s, 189 MB/s 2024-09-15T23:20:39.571 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.572 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.572 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075343 s, 139 MB/s 2024-09-15T23:20:39.580 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.581 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.581 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752089 s, 139 MB/s 2024-09-15T23:20:39.590 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.590 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.590 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756774 s, 139 MB/s 2024-09-15T23:20:39.598 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.598 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.598 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678379 s, 155 MB/s 2024-09-15T23:20:39.607 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.607 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.607 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755 s, 139 MB/s 2024-09-15T23:20:39.616 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.616 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.616 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757478 s, 138 MB/s 2024-09-15T23:20:39.625 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.625 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.625 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678926 s, 154 MB/s 2024-09-15T23:20:39.634 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.634 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.634 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761825 s, 138 MB/s 2024-09-15T23:20:39.642 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.642 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.642 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00607233 s, 173 MB/s 2024-09-15T23:20:39.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:20:39.648 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:20:39.648 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:20:39.649 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.1 2024-09-15T23:20:39.649 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:20:39.649 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:20:39.649 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:20:39.649 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:20:39.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:20:39.710 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.710 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.710 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00916936 s, 114 MB/s 2024-09-15T23:20:39.719 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.719 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.719 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713236 s, 147 MB/s 2024-09-15T23:20:39.727 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.727 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.727 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695399 s, 151 MB/s 2024-09-15T23:20:39.736 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.736 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.736 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712366 s, 147 MB/s 2024-09-15T23:20:39.745 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.745 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.745 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707545 s, 148 MB/s 2024-09-15T23:20:39.753 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.753 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.753 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727514 s, 144 MB/s 2024-09-15T23:20:39.763 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.763 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.764 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0083562 s, 125 MB/s 2024-09-15T23:20:39.771 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.772 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.772 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689524 s, 152 MB/s 2024-09-15T23:20:39.781 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.781 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.781 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575562 s, 182 MB/s 2024-09-15T23:20:39.790 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.790 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.790 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00906476 s, 116 MB/s 2024-09-15T23:20:39.799 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.799 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.799 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00773784 s, 136 MB/s 2024-09-15T23:20:39.808 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.808 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.808 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074662 s, 140 MB/s 2024-09-15T23:20:39.817 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.817 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.818 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768128 s, 137 MB/s 2024-09-15T23:20:39.827 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.827 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.827 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00810514 s, 129 MB/s 2024-09-15T23:20:39.836 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.836 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.836 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073879 s, 142 MB/s 2024-09-15T23:20:39.848 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.848 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.848 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010317 s, 102 MB/s 2024-09-15T23:20:39.857 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.857 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.857 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692661 s, 151 MB/s 2024-09-15T23:20:39.864 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.864 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.864 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00557307 s, 188 MB/s 2024-09-15T23:20:39.872 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.872 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.872 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655965 s, 160 MB/s 2024-09-15T23:20:39.879 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.879 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.879 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.005626 s, 186 MB/s 2024-09-15T23:20:39.887 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.887 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.887 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571216 s, 184 MB/s 2024-09-15T23:20:39.895 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.895 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.895 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599114 s, 175 MB/s 2024-09-15T23:20:39.902 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.902 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.902 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571208 s, 184 MB/s 2024-09-15T23:20:39.912 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.912 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.912 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00778353 s, 135 MB/s 2024-09-15T23:20:39.920 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.920 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.920 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630694 s, 166 MB/s 2024-09-15T23:20:39.928 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.929 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.929 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071479 s, 147 MB/s 2024-09-15T23:20:39.937 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.937 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.937 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650449 s, 161 MB/s 2024-09-15T23:20:39.946 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.946 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.946 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739392 s, 142 MB/s 2024-09-15T23:20:39.953 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.953 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.953 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581957 s, 180 MB/s 2024-09-15T23:20:39.961 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.962 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.962 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065751 s, 159 MB/s 2024-09-15T23:20:39.970 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.970 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.970 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065846 s, 159 MB/s 2024-09-15T23:20:39.977 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:39.977 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:39.977 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0056489 s, 186 MB/s 2024-09-15T23:20:39.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:20:39.984 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:20:39.984 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:20:39.984 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.2 2024-09-15T23:20:39.984 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:20:39.984 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:20:39.984 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:20:39.984 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:20:40.019 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:20:40.029 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:20:40.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:20:40.042 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.042 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.043 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684806 s, 153 MB/s 2024-09-15T23:20:40.051 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.051 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.052 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754252 s, 139 MB/s 2024-09-15T23:20:40.061 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.061 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.061 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732846 s, 143 MB/s 2024-09-15T23:20:40.069 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.069 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.069 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692347 s, 151 MB/s 2024-09-15T23:20:40.078 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.078 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.079 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074467 s, 141 MB/s 2024-09-15T23:20:40.087 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.087 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.087 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662929 s, 158 MB/s 2024-09-15T23:20:40.094 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.094 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.094 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571251 s, 184 MB/s 2024-09-15T23:20:40.102 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.102 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.102 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653801 s, 160 MB/s 2024-09-15T23:20:40.110 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.111 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.111 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066568 s, 158 MB/s 2024-09-15T23:20:40.119 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.119 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.119 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744849 s, 141 MB/s 2024-09-15T23:20:40.128 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.128 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.128 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672574 s, 156 MB/s 2024-09-15T23:20:40.136 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.136 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.136 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065873 s, 159 MB/s 2024-09-15T23:20:40.144 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.144 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.144 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662096 s, 158 MB/s 2024-09-15T23:20:40.152 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.152 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.152 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632584 s, 166 MB/s 2024-09-15T23:20:40.160 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.161 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.161 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627058 s, 167 MB/s 2024-09-15T23:20:40.168 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.168 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.169 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661274 s, 159 MB/s 2024-09-15T23:20:40.176 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.176 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.176 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605365 s, 173 MB/s 2024-09-15T23:20:40.184 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.184 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.184 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058036 s, 181 MB/s 2024-09-15T23:20:40.191 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.192 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.192 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625198 s, 168 MB/s 2024-09-15T23:20:40.199 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.199 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.199 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564574 s, 186 MB/s 2024-09-15T23:20:40.208 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.208 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.208 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006511 s, 161 MB/s 2024-09-15T23:20:40.216 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.216 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.217 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757265 s, 138 MB/s 2024-09-15T23:20:40.224 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.224 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.224 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00556144 s, 189 MB/s 2024-09-15T23:20:40.232 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.232 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.232 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667527 s, 157 MB/s 2024-09-15T23:20:40.240 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.241 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.241 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066089 s, 159 MB/s 2024-09-15T23:20:40.248 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.248 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.249 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671287 s, 156 MB/s 2024-09-15T23:20:40.262 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.262 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.262 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120595 s, 87.0 MB/s 2024-09-15T23:20:40.269 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.270 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.270 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579884 s, 181 MB/s 2024-09-15T23:20:40.278 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.278 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.278 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709961 s, 148 MB/s 2024-09-15T23:20:40.286 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.286 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.286 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601061 s, 174 MB/s 2024-09-15T23:20:40.294 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.294 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.295 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667022 s, 157 MB/s 2024-09-15T23:20:40.302 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.302 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.302 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575831 s, 182 MB/s 2024-09-15T23:20:40.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:20:40.308 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:20:40.309 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:20:40.309 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.3 2024-09-15T23:20:40.309 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:20:40.309 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:20:40.309 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:20:40.309 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:20:40.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:20:40.408 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.408 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.408 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741033 s, 142 MB/s 2024-09-15T23:20:40.417 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.417 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.417 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732426 s, 143 MB/s 2024-09-15T23:20:40.425 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.425 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.425 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655585 s, 160 MB/s 2024-09-15T23:20:40.433 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.433 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.433 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670134 s, 156 MB/s 2024-09-15T23:20:40.442 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.442 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.442 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715067 s, 147 MB/s 2024-09-15T23:20:40.451 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.451 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.451 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733543 s, 143 MB/s 2024-09-15T23:20:40.458 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.458 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.459 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594412 s, 176 MB/s 2024-09-15T23:20:40.467 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.467 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.468 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735454 s, 143 MB/s 2024-09-15T23:20:40.475 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.475 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.475 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630871 s, 166 MB/s 2024-09-15T23:20:40.483 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.483 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.483 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574174 s, 183 MB/s 2024-09-15T23:20:40.490 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.490 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.490 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576731 s, 182 MB/s 2024-09-15T23:20:40.497 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.498 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.498 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00559851 s, 187 MB/s 2024-09-15T23:20:40.506 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.506 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.506 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708902 s, 148 MB/s 2024-09-15T23:20:40.513 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.514 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.514 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00562009 s, 187 MB/s 2024-09-15T23:20:40.522 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.522 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.522 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697605 s, 150 MB/s 2024-09-15T23:20:40.531 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.531 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.532 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077708 s, 135 MB/s 2024-09-15T23:20:40.540 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.540 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.540 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648473 s, 162 MB/s 2024-09-15T23:20:40.547 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.547 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.548 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587679 s, 178 MB/s 2024-09-15T23:20:40.555 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.555 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.555 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064914 s, 162 MB/s 2024-09-15T23:20:40.565 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.565 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.565 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721911 s, 145 MB/s 2024-09-15T23:20:40.574 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.574 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.574 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076107 s, 138 MB/s 2024-09-15T23:20:40.582 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.582 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.582 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668192 s, 157 MB/s 2024-09-15T23:20:40.589 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.589 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.589 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00557205 s, 188 MB/s 2024-09-15T23:20:40.598 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.598 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.598 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698174 s, 150 MB/s 2024-09-15T23:20:40.607 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.607 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.607 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077844 s, 135 MB/s 2024-09-15T23:20:40.617 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.617 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.617 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00859179 s, 122 MB/s 2024-09-15T23:20:40.625 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.626 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.626 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670436 s, 156 MB/s 2024-09-15T23:20:40.633 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.633 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.633 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589067 s, 178 MB/s 2024-09-15T23:20:40.643 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.644 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.644 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00869851 s, 121 MB/s 2024-09-15T23:20:40.652 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.652 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.652 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662343 s, 158 MB/s 2024-09-15T23:20:40.662 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.662 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.662 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0084583 s, 124 MB/s 2024-09-15T23:20:40.670 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.670 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.670 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667723 s, 157 MB/s 2024-09-15T23:20:40.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:20:40.677 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:20:40.677 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:20:40.677 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.4 2024-09-15T23:20:40.677 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:20:40.677 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:20:40.677 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:20:40.677 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:20:40.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:20:40.735 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.736 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.736 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657184 s, 160 MB/s 2024-09-15T23:20:40.743 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.743 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.743 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602251 s, 174 MB/s 2024-09-15T23:20:40.752 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.752 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.752 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715407 s, 147 MB/s 2024-09-15T23:20:40.761 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.761 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.761 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732633 s, 143 MB/s 2024-09-15T23:20:40.770 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.846 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.846 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755543 s, 139 MB/s 2024-09-15T23:20:40.848 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.848 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.848 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588388 s, 178 MB/s 2024-09-15T23:20:40.848 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.848 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.848 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582978 s, 180 MB/s 2024-09-15T23:20:40.848 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.848 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.848 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662509 s, 158 MB/s 2024-09-15T23:20:40.848 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.849 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.849 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075781 s, 138 MB/s 2024-09-15T23:20:40.849 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.849 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.849 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069663 s, 151 MB/s 2024-09-15T23:20:40.849 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.849 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.849 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763524 s, 137 MB/s 2024-09-15T23:20:40.849 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.849 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.849 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071747 s, 146 MB/s 2024-09-15T23:20:40.849 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.849 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.849 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069251 s, 151 MB/s 2024-09-15T23:20:40.850 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.850 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.850 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640964 s, 164 MB/s 2024-09-15T23:20:40.855 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.855 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.855 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679792 s, 154 MB/s 2024-09-15T23:20:40.864 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.864 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.864 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732388 s, 143 MB/s 2024-09-15T23:20:40.872 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.872 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.872 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654398 s, 160 MB/s 2024-09-15T23:20:40.881 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.881 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.881 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650819 s, 161 MB/s 2024-09-15T23:20:40.888 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.888 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.888 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625149 s, 168 MB/s 2024-09-15T23:20:40.897 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.897 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.897 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661719 s, 158 MB/s 2024-09-15T23:20:40.905 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.905 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.905 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628305 s, 167 MB/s 2024-09-15T23:20:40.913 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.913 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.913 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641432 s, 163 MB/s 2024-09-15T23:20:40.920 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.920 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.920 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587471 s, 178 MB/s 2024-09-15T23:20:40.929 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.929 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.929 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688179 s, 152 MB/s 2024-09-15T23:20:40.937 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.937 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.937 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676 s, 155 MB/s 2024-09-15T23:20:40.947 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.947 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.947 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075098 s, 140 MB/s 2024-09-15T23:20:40.955 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.955 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.955 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729677 s, 144 MB/s 2024-09-15T23:20:40.965 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.965 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.965 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00828519 s, 127 MB/s 2024-09-15T23:20:40.975 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.975 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.975 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717573 s, 146 MB/s 2024-09-15T23:20:40.983 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.983 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.983 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007072 s, 148 MB/s 2024-09-15T23:20:40.990 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:40.991 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:40.991 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620101 s, 169 MB/s 2024-09-15T23:20:41.000 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.000 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.001 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00795209 s, 132 MB/s 2024-09-15T23:20:41.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:20:41.006 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:20:41.006 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:20:41.006 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.5 2024-09-15T23:20:41.007 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:20:41.007 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:20:41.007 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:20:41.007 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:20:41.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:20:41.065 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.065 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.065 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587824 s, 178 MB/s 2024-09-15T23:20:41.072 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.073 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.073 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573146 s, 183 MB/s 2024-09-15T23:20:41.080 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.080 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.080 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581292 s, 180 MB/s 2024-09-15T23:20:41.089 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.089 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.089 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686353 s, 153 MB/s 2024-09-15T23:20:41.096 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.096 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.096 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569722 s, 184 MB/s 2024-09-15T23:20:41.105 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.105 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.105 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711487 s, 147 MB/s 2024-09-15T23:20:41.112 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.112 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.112 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563939 s, 186 MB/s 2024-09-15T23:20:41.121 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.122 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.122 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074925 s, 140 MB/s 2024-09-15T23:20:41.129 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.129 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.129 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571816 s, 183 MB/s 2024-09-15T23:20:41.137 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.137 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.137 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660218 s, 159 MB/s 2024-09-15T23:20:41.144 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.145 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.145 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589482 s, 178 MB/s 2024-09-15T23:20:41.154 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.154 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.155 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0081604 s, 128 MB/s 2024-09-15T23:20:41.162 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.162 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.163 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633285 s, 166 MB/s 2024-09-15T23:20:41.171 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.171 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.171 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652239 s, 161 MB/s 2024-09-15T23:20:41.179 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.179 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.179 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697643 s, 150 MB/s 2024-09-15T23:20:41.188 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.188 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.188 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695366 s, 151 MB/s 2024-09-15T23:20:41.197 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.197 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.197 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00800042 s, 131 MB/s 2024-09-15T23:20:41.205 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.205 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.205 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649987 s, 161 MB/s 2024-09-15T23:20:41.215 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.215 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.215 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00782073 s, 134 MB/s 2024-09-15T23:20:41.224 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.225 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.225 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707277 s, 148 MB/s 2024-09-15T23:20:41.232 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.233 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.233 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637814 s, 164 MB/s 2024-09-15T23:20:41.240 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.241 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.241 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727353 s, 144 MB/s 2024-09-15T23:20:41.249 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.249 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.249 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657993 s, 159 MB/s 2024-09-15T23:20:41.257 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.257 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.257 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065555 s, 160 MB/s 2024-09-15T23:20:41.264 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.265 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.265 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588732 s, 178 MB/s 2024-09-15T23:20:41.272 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.272 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.272 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575743 s, 182 MB/s 2024-09-15T23:20:41.279 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.279 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.279 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571031 s, 184 MB/s 2024-09-15T23:20:41.289 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.289 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.289 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00790064 s, 133 MB/s 2024-09-15T23:20:41.298 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.298 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.298 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715782 s, 146 MB/s 2024-09-15T23:20:41.305 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.305 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.305 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563938 s, 186 MB/s 2024-09-15T23:20:41.314 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.314 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.315 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705082 s, 149 MB/s 2024-09-15T23:20:41.321 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.321 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.321 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00556319 s, 188 MB/s 2024-09-15T23:20:41.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:20:41.328 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:20:41.328 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:20:41.328 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.6 2024-09-15T23:20:41.328 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:20:41.328 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:20:41.328 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:20:41.328 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:20:41.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:20:41.388 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.388 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.388 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743461 s, 141 MB/s 2024-09-15T23:20:41.394 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.394 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.394 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589222 s, 178 MB/s 2024-09-15T23:20:41.402 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.402 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.402 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058693 s, 179 MB/s 2024-09-15T23:20:41.409 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.409 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.410 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059095 s, 177 MB/s 2024-09-15T23:20:41.418 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.418 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.419 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745354 s, 141 MB/s 2024-09-15T23:20:41.427 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.427 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.427 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658805 s, 159 MB/s 2024-09-15T23:20:41.436 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.436 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.436 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071075 s, 148 MB/s 2024-09-15T23:20:41.443 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.443 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.444 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640392 s, 164 MB/s 2024-09-15T23:20:41.451 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.451 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.451 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587879 s, 178 MB/s 2024-09-15T23:20:41.460 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.460 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.460 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737779 s, 142 MB/s 2024-09-15T23:20:41.469 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.469 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.470 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0079044 s, 133 MB/s 2024-09-15T23:20:41.479 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.479 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.479 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00794569 s, 132 MB/s 2024-09-15T23:20:41.489 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.489 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.489 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00836998 s, 125 MB/s 2024-09-15T23:20:41.499 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.500 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.500 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00878134 s, 119 MB/s 2024-09-15T23:20:41.509 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.509 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.509 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00797475 s, 131 MB/s 2024-09-15T23:20:41.516 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.516 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.516 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057894 s, 181 MB/s 2024-09-15T23:20:41.524 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.524 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.524 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586798 s, 179 MB/s 2024-09-15T23:20:41.531 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.531 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.531 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0056499 s, 186 MB/s 2024-09-15T23:20:41.542 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.542 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.542 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937137 s, 112 MB/s 2024-09-15T23:20:41.551 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.551 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.551 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733873 s, 143 MB/s 2024-09-15T23:20:41.558 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.559 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.559 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00554506 s, 189 MB/s 2024-09-15T23:20:41.567 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.567 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.567 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705286 s, 149 MB/s 2024-09-15T23:20:41.575 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.575 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.575 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577599 s, 182 MB/s 2024-09-15T23:20:41.585 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.586 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.586 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00888249 s, 118 MB/s 2024-09-15T23:20:41.593 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.593 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.593 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603474 s, 174 MB/s 2024-09-15T23:20:41.602 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.602 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.602 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707042 s, 148 MB/s 2024-09-15T23:20:41.611 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.611 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.611 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729754 s, 144 MB/s 2024-09-15T23:20:41.618 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.618 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.618 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585147 s, 179 MB/s 2024-09-15T23:20:41.628 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.628 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.628 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00788712 s, 133 MB/s 2024-09-15T23:20:41.636 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.637 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.637 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688178 s, 152 MB/s 2024-09-15T23:20:41.644 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.645 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.645 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645108 s, 163 MB/s 2024-09-15T23:20:41.652 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.653 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.653 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640662 s, 164 MB/s 2024-09-15T23:20:41.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:20:41.659 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:20:41.659 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:20:41.659 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.7 2024-09-15T23:20:41.659 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:20:41.660 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:20:41.660 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:20:41.660 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:20:41.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:20:41.719 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.719 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.719 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00773489 s, 136 MB/s 2024-09-15T23:20:41.728 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.728 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.728 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755691 s, 139 MB/s 2024-09-15T23:20:41.735 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.735 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.735 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570903 s, 184 MB/s 2024-09-15T23:20:41.744 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.744 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.744 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698102 s, 150 MB/s 2024-09-15T23:20:41.752 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.752 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.752 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663151 s, 158 MB/s 2024-09-15T23:20:41.759 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.759 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.759 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00561484 s, 187 MB/s 2024-09-15T23:20:41.767 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.767 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.767 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583469 s, 180 MB/s 2024-09-15T23:20:41.774 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.774 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.774 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583359 s, 180 MB/s 2024-09-15T23:20:41.783 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.785 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.785 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739109 s, 142 MB/s 2024-09-15T23:20:41.792 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.792 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.792 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614609 s, 171 MB/s 2024-09-15T23:20:41.799 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.799 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.799 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639653 s, 164 MB/s 2024-09-15T23:20:41.807 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.807 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.808 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594706 s, 176 MB/s 2024-09-15T23:20:41.815 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.815 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.815 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600636 s, 175 MB/s 2024-09-15T23:20:41.822 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.823 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.823 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591879 s, 177 MB/s 2024-09-15T23:20:41.831 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.831 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.831 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733818 s, 143 MB/s 2024-09-15T23:20:41.839 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.839 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.839 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576722 s, 182 MB/s 2024-09-15T23:20:41.847 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.847 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.847 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641115 s, 164 MB/s 2024-09-15T23:20:41.856 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.856 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.856 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724347 s, 145 MB/s 2024-09-15T23:20:41.865 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.865 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.865 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733277 s, 143 MB/s 2024-09-15T23:20:41.873 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.873 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.873 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660896 s, 159 MB/s 2024-09-15T23:20:41.880 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.880 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.880 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579436 s, 181 MB/s 2024-09-15T23:20:41.888 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.889 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.889 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623132 s, 168 MB/s 2024-09-15T23:20:41.897 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.897 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.897 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066789 s, 157 MB/s 2024-09-15T23:20:41.905 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.905 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.905 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711802 s, 147 MB/s 2024-09-15T23:20:41.913 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.914 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.914 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663469 s, 158 MB/s 2024-09-15T23:20:41.922 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.923 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.923 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727032 s, 144 MB/s 2024-09-15T23:20:41.930 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.930 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.930 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586081 s, 179 MB/s 2024-09-15T23:20:41.939 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.940 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.940 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00795367 s, 132 MB/s 2024-09-15T23:20:41.948 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.948 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.948 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643393 s, 163 MB/s 2024-09-15T23:20:41.955 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.955 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.955 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592168 s, 177 MB/s 2024-09-15T23:20:41.964 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.965 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.965 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721667 s, 145 MB/s 2024-09-15T23:20:41.973 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:41.973 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:41.973 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705725 s, 149 MB/s 2024-09-15T23:20:41.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:20:41.980 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:20:41.980 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:20:41.980 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.8 2024-09-15T23:20:41.980 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:20:41.980 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:20:41.980 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:20:41.980 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:20:42.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:20:42.039 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.039 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.039 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751762 s, 139 MB/s 2024-09-15T23:20:42.048 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.048 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.048 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730315 s, 144 MB/s 2024-09-15T23:20:42.056 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.056 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.056 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635948 s, 165 MB/s 2024-09-15T23:20:42.064 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.064 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.064 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006569 s, 160 MB/s 2024-09-15T23:20:42.072 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.072 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.072 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593641 s, 177 MB/s 2024-09-15T23:20:42.083 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.083 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.083 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00923064 s, 114 MB/s 2024-09-15T23:20:42.090 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.090 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.090 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613403 s, 171 MB/s 2024-09-15T23:20:42.101 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.101 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.101 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937096 s, 112 MB/s 2024-09-15T23:20:42.120 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.121 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.121 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174577 s, 60.1 MB/s 2024-09-15T23:20:42.131 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.131 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.131 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00860568 s, 122 MB/s 2024-09-15T23:20:42.139 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.139 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.139 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690433 s, 152 MB/s 2024-09-15T23:20:42.146 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.147 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.147 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574708 s, 182 MB/s 2024-09-15T23:20:42.156 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.156 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.156 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075904 s, 138 MB/s 2024-09-15T23:20:42.163 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.163 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.163 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582939 s, 180 MB/s 2024-09-15T23:20:42.172 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.172 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.172 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678423 s, 155 MB/s 2024-09-15T23:20:42.179 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.179 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.180 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618174 s, 170 MB/s 2024-09-15T23:20:42.188 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.188 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.188 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667507 s, 157 MB/s 2024-09-15T23:20:42.197 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.197 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.197 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00774031 s, 135 MB/s 2024-09-15T23:20:42.205 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.205 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.205 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653328 s, 160 MB/s 2024-09-15T23:20:42.213 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.213 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.213 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595373 s, 176 MB/s 2024-09-15T23:20:42.220 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.220 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.220 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00561988 s, 187 MB/s 2024-09-15T23:20:42.227 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.227 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.228 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00557751 s, 188 MB/s 2024-09-15T23:20:42.235 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.235 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.235 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577182 s, 182 MB/s 2024-09-15T23:20:42.244 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.244 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.244 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007272 s, 144 MB/s 2024-09-15T23:20:42.251 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.251 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.251 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00552828 s, 190 MB/s 2024-09-15T23:20:42.260 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.260 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.260 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721235 s, 145 MB/s 2024-09-15T23:20:42.267 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.267 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.268 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568066 s, 185 MB/s 2024-09-15T23:20:42.276 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.276 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.276 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068785 s, 152 MB/s 2024-09-15T23:20:42.283 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.283 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.283 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585047 s, 179 MB/s 2024-09-15T23:20:42.292 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.292 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.293 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741952 s, 141 MB/s 2024-09-15T23:20:42.300 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.300 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.300 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597579 s, 175 MB/s 2024-09-15T23:20:42.307 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.308 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.308 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576465 s, 182 MB/s 2024-09-15T23:20:42.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:20:42.314 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:20:42.314 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:20:42.314 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.9 2024-09-15T23:20:42.314 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:20:42.314 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:20:42.314 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:20:42.314 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:20:42.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:20:42.373 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.373 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.373 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590596 s, 178 MB/s 2024-09-15T23:20:42.381 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.381 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.382 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743098 s, 141 MB/s 2024-09-15T23:20:42.391 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.391 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.391 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007518 s, 139 MB/s 2024-09-15T23:20:42.398 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.398 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.399 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579842 s, 181 MB/s 2024-09-15T23:20:42.406 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.406 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.406 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591611 s, 177 MB/s 2024-09-15T23:20:42.417 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.417 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.417 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681348 s, 154 MB/s 2024-09-15T23:20:42.424 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.424 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.424 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00780556 s, 134 MB/s 2024-09-15T23:20:42.432 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.432 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.432 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657562 s, 159 MB/s 2024-09-15T23:20:42.439 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.439 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.440 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566875 s, 185 MB/s 2024-09-15T23:20:42.448 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.448 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.448 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691485 s, 152 MB/s 2024-09-15T23:20:42.457 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.457 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.457 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723027 s, 145 MB/s 2024-09-15T23:20:42.464 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.465 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.465 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639103 s, 164 MB/s 2024-09-15T23:20:42.472 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.473 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.473 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631691 s, 166 MB/s 2024-09-15T23:20:42.482 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.482 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.482 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00797474 s, 131 MB/s 2024-09-15T23:20:42.492 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.492 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.492 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00794387 s, 132 MB/s 2024-09-15T23:20:42.503 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.503 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.503 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009687 s, 108 MB/s 2024-09-15T23:20:42.514 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.514 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.515 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00972181 s, 108 MB/s 2024-09-15T23:20:42.525 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.525 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.525 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0092045 s, 114 MB/s 2024-09-15T23:20:42.533 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.533 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.533 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632987 s, 166 MB/s 2024-09-15T23:20:42.542 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.542 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.542 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070366 s, 149 MB/s 2024-09-15T23:20:42.550 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.550 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.550 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654225 s, 160 MB/s 2024-09-15T23:20:42.560 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.560 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.560 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00847706 s, 124 MB/s 2024-09-15T23:20:42.569 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.569 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.569 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752213 s, 139 MB/s 2024-09-15T23:20:42.578 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.578 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.578 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724536 s, 145 MB/s 2024-09-15T23:20:42.588 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.588 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.588 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00799157 s, 131 MB/s 2024-09-15T23:20:42.595 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.595 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.595 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577448 s, 182 MB/s 2024-09-15T23:20:42.604 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.604 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.604 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720677 s, 145 MB/s 2024-09-15T23:20:42.614 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.614 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.614 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00854113 s, 123 MB/s 2024-09-15T23:20:42.624 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.625 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.625 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728657 s, 144 MB/s 2024-09-15T23:20:42.631 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.631 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.631 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686889 s, 153 MB/s 2024-09-15T23:20:42.638 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.639 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.639 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572663 s, 183 MB/s 2024-09-15T23:20:42.646 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.646 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.646 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569208 s, 184 MB/s 2024-09-15T23:20:42.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:20:42.653 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:20:42.653 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:20:42.653 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.10 2024-09-15T23:20:42.653 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:20:42.653 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:20:42.653 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:20:42.653 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:20:42.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:20:42.712 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.712 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.712 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073079 s, 143 MB/s 2024-09-15T23:20:42.721 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.721 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.721 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758128 s, 138 MB/s 2024-09-15T23:20:42.729 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.729 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.729 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644233 s, 163 MB/s 2024-09-15T23:20:42.736 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.736 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.737 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595227 s, 176 MB/s 2024-09-15T23:20:42.744 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.744 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.744 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590661 s, 178 MB/s 2024-09-15T23:20:42.752 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.753 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.753 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679406 s, 154 MB/s 2024-09-15T23:20:42.760 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.760 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.760 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577866 s, 181 MB/s 2024-09-15T23:20:42.768 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.768 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.768 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647721 s, 162 MB/s 2024-09-15T23:20:42.776 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.776 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.776 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647839 s, 162 MB/s 2024-09-15T23:20:42.785 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.785 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.785 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691698 s, 152 MB/s 2024-09-15T23:20:42.793 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.793 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.794 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723164 s, 145 MB/s 2024-09-15T23:20:42.801 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.802 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.802 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644337 s, 163 MB/s 2024-09-15T23:20:42.810 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.810 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.810 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655289 s, 160 MB/s 2024-09-15T23:20:42.817 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.817 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.817 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575233 s, 182 MB/s 2024-09-15T23:20:42.829 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.829 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.829 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672213 s, 156 MB/s 2024-09-15T23:20:42.833 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.833 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.833 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584621 s, 179 MB/s 2024-09-15T23:20:42.842 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.842 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.842 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726307 s, 144 MB/s 2024-09-15T23:20:42.850 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.850 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.850 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654349 s, 160 MB/s 2024-09-15T23:20:42.859 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.859 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.859 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720259 s, 146 MB/s 2024-09-15T23:20:42.868 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.868 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.868 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733601 s, 143 MB/s 2024-09-15T23:20:42.876 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.876 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.876 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063198 s, 166 MB/s 2024-09-15T23:20:42.884 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.885 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.885 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683187 s, 153 MB/s 2024-09-15T23:20:42.892 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.892 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.892 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599364 s, 175 MB/s 2024-09-15T23:20:42.904 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.904 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.905 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104367 s, 100 MB/s 2024-09-15T23:20:42.914 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.914 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.914 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00780747 s, 134 MB/s 2024-09-15T23:20:42.923 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.923 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.923 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725302 s, 145 MB/s 2024-09-15T23:20:42.932 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.932 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.932 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0079062 s, 133 MB/s 2024-09-15T23:20:42.943 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.943 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.943 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00885482 s, 118 MB/s 2024-09-15T23:20:42.952 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.953 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.953 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00792176 s, 132 MB/s 2024-09-15T23:20:42.961 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.961 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.961 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718261 s, 146 MB/s 2024-09-15T23:20:42.970 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.970 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.970 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734655 s, 143 MB/s 2024-09-15T23:20:42.977 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:42.978 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:42.978 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594151 s, 176 MB/s 2024-09-15T23:20:42.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:20:42.984 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:20:42.984 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:20:42.984 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.11 2024-09-15T23:20:42.984 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:20:42.984 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:20:42.985 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:20:42.985 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:20:43.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:20:43.044 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.044 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.044 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744864 s, 141 MB/s 2024-09-15T23:20:43.051 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.051 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.051 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0056714 s, 185 MB/s 2024-09-15T23:20:43.058 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.059 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.059 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589867 s, 178 MB/s 2024-09-15T23:20:43.066 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.066 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.066 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593063 s, 177 MB/s 2024-09-15T23:20:43.074 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.074 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.074 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00554486 s, 189 MB/s 2024-09-15T23:20:43.082 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.082 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.082 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657045 s, 160 MB/s 2024-09-15T23:20:43.090 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669236 s, 157 MB/s 2024-09-15T23:20:43.098 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.098 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.098 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648498 s, 162 MB/s 2024-09-15T23:20:43.106 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.106 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.106 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591938 s, 177 MB/s 2024-09-15T23:20:43.115 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.115 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.115 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667115 s, 157 MB/s 2024-09-15T23:20:43.123 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.123 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.123 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658299 s, 159 MB/s 2024-09-15T23:20:43.131 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.131 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.131 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694026 s, 151 MB/s 2024-09-15T23:20:43.140 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.140 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.141 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738502 s, 142 MB/s 2024-09-15T23:20:43.150 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.150 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.150 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00789057 s, 133 MB/s 2024-09-15T23:20:43.158 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.158 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.158 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688647 s, 152 MB/s 2024-09-15T23:20:43.166 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.166 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.166 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593523 s, 177 MB/s 2024-09-15T23:20:43.174 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.175 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.175 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696327 s, 151 MB/s 2024-09-15T23:20:43.183 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.183 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.183 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657945 s, 159 MB/s 2024-09-15T23:20:43.191 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.191 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.191 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639168 s, 164 MB/s 2024-09-15T23:20:43.199 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.199 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.199 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644025 s, 163 MB/s 2024-09-15T23:20:43.207 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.207 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.207 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657697 s, 159 MB/s 2024-09-15T23:20:43.215 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.215 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.215 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635673 s, 165 MB/s 2024-09-15T23:20:43.223 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.223 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.223 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627504 s, 167 MB/s 2024-09-15T23:20:43.231 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.231 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.231 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006286 s, 167 MB/s 2024-09-15T23:20:43.238 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.238 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.239 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580727 s, 181 MB/s 2024-09-15T23:20:43.246 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.247 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.247 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631706 s, 166 MB/s 2024-09-15T23:20:43.255 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.255 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.255 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695225 s, 151 MB/s 2024-09-15T23:20:43.263 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.263 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.263 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063396 s, 165 MB/s 2024-09-15T23:20:43.273 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.273 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.274 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00843325 s, 124 MB/s 2024-09-15T23:20:43.281 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.281 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.281 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602047 s, 174 MB/s 2024-09-15T23:20:43.288 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.288 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.288 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00543757 s, 193 MB/s 2024-09-15T23:20:43.295 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.296 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.296 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580446 s, 181 MB/s 2024-09-15T23:20:43.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:20:43.302 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:20:43.302 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:20:43.302 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.12 2024-09-15T23:20:43.302 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:20:43.302 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:20:43.302 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:20:43.302 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:20:43.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:20:43.362 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.363 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.363 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766387 s, 137 MB/s 2024-09-15T23:20:43.370 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.370 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.370 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565246 s, 186 MB/s 2024-09-15T23:20:43.377 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.377 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.377 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00556611 s, 188 MB/s 2024-09-15T23:20:43.386 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.386 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.386 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776514 s, 135 MB/s 2024-09-15T23:20:43.393 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.393 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.393 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00551183 s, 190 MB/s 2024-09-15T23:20:43.401 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.401 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.401 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587207 s, 179 MB/s 2024-09-15T23:20:43.410 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.410 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.411 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00792151 s, 132 MB/s 2024-09-15T23:20:43.418 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.418 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.418 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590514 s, 178 MB/s 2024-09-15T23:20:43.426 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.426 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.426 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646722 s, 162 MB/s 2024-09-15T23:20:43.434 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.434 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.434 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593346 s, 177 MB/s 2024-09-15T23:20:43.444 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.445 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.445 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00870239 s, 120 MB/s 2024-09-15T23:20:43.455 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.455 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.456 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100183 s, 105 MB/s 2024-09-15T23:20:43.463 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.463 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.463 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577437 s, 182 MB/s 2024-09-15T23:20:43.472 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.472 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.472 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754727 s, 139 MB/s 2024-09-15T23:20:43.480 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.480 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.480 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633598 s, 165 MB/s 2024-09-15T23:20:43.490 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.490 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.490 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00800003 s, 131 MB/s 2024-09-15T23:20:43.502 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.502 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.502 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104539 s, 100 MB/s 2024-09-15T23:20:43.510 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.510 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.510 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662573 s, 158 MB/s 2024-09-15T23:20:43.520 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.520 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.520 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0083531 s, 126 MB/s 2024-09-15T23:20:43.528 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.528 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.528 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634211 s, 165 MB/s 2024-09-15T23:20:43.535 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.535 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.536 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566494 s, 185 MB/s 2024-09-15T23:20:43.543 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.543 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.543 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057365 s, 183 MB/s 2024-09-15T23:20:43.552 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.552 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.552 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744628 s, 141 MB/s 2024-09-15T23:20:43.559 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.559 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.559 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057078 s, 184 MB/s 2024-09-15T23:20:43.566 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.567 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.567 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00544505 s, 193 MB/s 2024-09-15T23:20:43.574 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.574 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.574 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00567034 s, 185 MB/s 2024-09-15T23:20:43.582 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.582 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.582 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667023 s, 157 MB/s 2024-09-15T23:20:43.590 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.590 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.590 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591459 s, 177 MB/s 2024-09-15T23:20:43.597 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.597 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.597 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0056504 s, 186 MB/s 2024-09-15T23:20:43.605 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.605 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.605 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630745 s, 166 MB/s 2024-09-15T23:20:43.613 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.613 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.613 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632029 s, 166 MB/s 2024-09-15T23:20:43.620 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.621 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.621 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057446 s, 183 MB/s 2024-09-15T23:20:43.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:20:43.627 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:20:43.628 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:20:43.628 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.13 2024-09-15T23:20:43.628 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:20:43.628 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:20:43.628 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:20:43.628 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:20:43.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:20:43.686 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.686 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.686 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642004 s, 163 MB/s 2024-09-15T23:20:43.695 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.695 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.695 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741194 s, 141 MB/s 2024-09-15T23:20:43.704 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.704 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.704 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733409 s, 143 MB/s 2024-09-15T23:20:43.711 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.711 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.711 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00567212 s, 185 MB/s 2024-09-15T23:20:43.719 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.720 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.720 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654439 s, 160 MB/s 2024-09-15T23:20:43.727 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.727 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.727 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624991 s, 168 MB/s 2024-09-15T23:20:43.735 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.735 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.735 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639064 s, 164 MB/s 2024-09-15T23:20:43.744 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.744 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.744 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715833 s, 146 MB/s 2024-09-15T23:20:43.753 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.753 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.753 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748515 s, 140 MB/s 2024-09-15T23:20:43.761 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.761 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.761 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695216 s, 151 MB/s 2024-09-15T23:20:43.770 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.770 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.770 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665491 s, 158 MB/s 2024-09-15T23:20:43.777 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.777 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.777 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565381 s, 185 MB/s 2024-09-15T23:20:43.785 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.785 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.785 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644251 s, 163 MB/s 2024-09-15T23:20:43.792 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.792 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.792 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00556502 s, 188 MB/s 2024-09-15T23:20:43.799 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.799 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.800 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565195 s, 186 MB/s 2024-09-15T23:20:43.808 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.809 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.809 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725608 s, 145 MB/s 2024-09-15T23:20:43.816 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.816 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.817 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637503 s, 164 MB/s 2024-09-15T23:20:43.825 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.825 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.825 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726652 s, 144 MB/s 2024-09-15T23:20:43.833 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.833 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.833 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564721 s, 186 MB/s 2024-09-15T23:20:43.841 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.841 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.841 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665062 s, 158 MB/s 2024-09-15T23:20:43.849 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.849 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.849 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642716 s, 163 MB/s 2024-09-15T23:20:43.858 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.858 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.858 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071037 s, 148 MB/s 2024-09-15T23:20:43.866 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.866 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.866 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064024 s, 164 MB/s 2024-09-15T23:20:43.875 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.875 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.875 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708541 s, 148 MB/s 2024-09-15T23:20:43.883 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.883 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.883 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613501 s, 171 MB/s 2024-09-15T23:20:43.891 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.891 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.891 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658923 s, 159 MB/s 2024-09-15T23:20:43.900 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.901 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.901 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762317 s, 138 MB/s 2024-09-15T23:20:43.909 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.909 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.909 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663103 s, 158 MB/s 2024-09-15T23:20:43.916 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.916 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.917 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629835 s, 166 MB/s 2024-09-15T23:20:43.925 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.926 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.926 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743789 s, 141 MB/s 2024-09-15T23:20:43.935 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.935 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.935 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746277 s, 141 MB/s 2024-09-15T23:20:43.942 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:43.942 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:43.943 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062682 s, 167 MB/s 2024-09-15T23:20:43.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:20:43.949 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:20:43.949 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:20:43.949 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.14 2024-09-15T23:20:43.949 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:20:43.949 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:20:43.949 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:20:43.950 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:20:43.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:20:44.007 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.007 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.007 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648078 s, 162 MB/s 2024-09-15T23:20:44.016 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.016 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.016 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733558 s, 143 MB/s 2024-09-15T23:20:44.024 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.024 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.024 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593798 s, 177 MB/s 2024-09-15T23:20:44.031 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.031 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.031 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568782 s, 184 MB/s 2024-09-15T23:20:44.040 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.040 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.040 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070965 s, 148 MB/s 2024-09-15T23:20:44.049 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.049 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.049 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728513 s, 144 MB/s 2024-09-15T23:20:44.057 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.057 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.057 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636543 s, 165 MB/s 2024-09-15T23:20:44.069 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.069 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.069 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683739 s, 153 MB/s 2024-09-15T23:20:44.073 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.073 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.073 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582699 s, 180 MB/s 2024-09-15T23:20:44.081 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.081 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.081 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635617 s, 165 MB/s 2024-09-15T23:20:44.090 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.090 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.090 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729592 s, 144 MB/s 2024-09-15T23:20:44.098 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.098 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.098 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679543 s, 154 MB/s 2024-09-15T23:20:44.106 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.106 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.107 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658153 s, 159 MB/s 2024-09-15T23:20:44.114 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.114 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.114 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587511 s, 178 MB/s 2024-09-15T23:20:44.121 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.121 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.121 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057513 s, 182 MB/s 2024-09-15T23:20:44.129 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.129 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.129 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574008 s, 183 MB/s 2024-09-15T23:20:44.136 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.136 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.136 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577243 s, 182 MB/s 2024-09-15T23:20:44.145 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.145 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.145 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661349 s, 159 MB/s 2024-09-15T23:20:44.153 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.153 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.153 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638708 s, 164 MB/s 2024-09-15T23:20:44.161 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.161 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.161 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061686 s, 170 MB/s 2024-09-15T23:20:44.169 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.169 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.169 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577697 s, 182 MB/s 2024-09-15T23:20:44.177 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.178 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.178 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718724 s, 146 MB/s 2024-09-15T23:20:44.186 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.187 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.187 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704591 s, 149 MB/s 2024-09-15T23:20:44.195 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.195 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.195 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655414 s, 160 MB/s 2024-09-15T23:20:44.203 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.203 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.203 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662088 s, 158 MB/s 2024-09-15T23:20:44.211 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.212 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.212 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070168 s, 149 MB/s 2024-09-15T23:20:44.219 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.220 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.220 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619893 s, 169 MB/s 2024-09-15T23:20:44.227 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.227 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.228 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639777 s, 164 MB/s 2024-09-15T23:20:44.236 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.236 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.237 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727963 s, 144 MB/s 2024-09-15T23:20:44.245 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.245 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.245 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722892 s, 145 MB/s 2024-09-15T23:20:44.254 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.254 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.254 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725789 s, 144 MB/s 2024-09-15T23:20:44.261 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.261 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.261 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582651 s, 180 MB/s 2024-09-15T23:20:44.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:20:44.268 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:20:44.268 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:20:44.268 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.15 2024-09-15T23:20:44.268 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:20:44.268 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:20:44.268 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:20:44.268 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:20:44.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:20:44.329 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.330 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.330 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583137 s, 180 MB/s 2024-09-15T23:20:44.337 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.338 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.338 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659434 s, 159 MB/s 2024-09-15T23:20:44.345 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.345 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.345 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602319 s, 174 MB/s 2024-09-15T23:20:44.354 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.354 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.354 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730235 s, 144 MB/s 2024-09-15T23:20:44.364 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.364 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.364 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771883 s, 136 MB/s 2024-09-15T23:20:44.372 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.372 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.372 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651949 s, 161 MB/s 2024-09-15T23:20:44.380 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.381 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.381 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708715 s, 148 MB/s 2024-09-15T23:20:44.389 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.389 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.389 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713353 s, 147 MB/s 2024-09-15T23:20:44.397 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.397 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.398 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649165 s, 162 MB/s 2024-09-15T23:20:44.405 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.405 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.405 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574699 s, 182 MB/s 2024-09-15T23:20:44.412 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.412 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.412 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574819 s, 182 MB/s 2024-09-15T23:20:44.420 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.420 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.420 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626635 s, 167 MB/s 2024-09-15T23:20:44.428 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.428 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.429 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650632 s, 161 MB/s 2024-09-15T23:20:44.435 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.436 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.436 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.005949 s, 176 MB/s 2024-09-15T23:20:44.445 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.445 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.445 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736204 s, 142 MB/s 2024-09-15T23:20:44.452 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.452 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.453 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626502 s, 167 MB/s 2024-09-15T23:20:44.461 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.461 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.462 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756706 s, 139 MB/s 2024-09-15T23:20:44.470 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.470 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.470 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704151 s, 149 MB/s 2024-09-15T23:20:44.479 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.479 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.479 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699005 s, 150 MB/s 2024-09-15T23:20:44.486 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.487 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.487 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640963 s, 164 MB/s 2024-09-15T23:20:44.494 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.494 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.494 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565987 s, 185 MB/s 2024-09-15T23:20:44.503 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.503 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.503 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725218 s, 145 MB/s 2024-09-15T23:20:44.510 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.510 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.510 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569842 s, 184 MB/s 2024-09-15T23:20:44.519 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.519 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.519 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728005 s, 144 MB/s 2024-09-15T23:20:44.527 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.527 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.528 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006673 s, 157 MB/s 2024-09-15T23:20:44.535 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.536 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.536 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652097 s, 161 MB/s 2024-09-15T23:20:44.544 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.545 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.545 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710044 s, 148 MB/s 2024-09-15T23:20:44.552 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.552 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.553 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641636 s, 163 MB/s 2024-09-15T23:20:44.560 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.560 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.561 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637888 s, 164 MB/s 2024-09-15T23:20:44.568 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.568 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.568 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599262 s, 175 MB/s 2024-09-15T23:20:44.577 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.578 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.578 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00804624 s, 130 MB/s 2024-09-15T23:20:44.586 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.586 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.586 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651765 s, 161 MB/s 2024-09-15T23:20:44.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:20:44.592 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:20:44.592 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:20:44.593 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.16 2024-09-15T23:20:44.593 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:20:44.593 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:20:44.593 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:20:44.593 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:20:44.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:20:44.650 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.650 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.650 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621439 s, 169 MB/s 2024-09-15T23:20:44.657 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.658 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.658 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0055293 s, 190 MB/s 2024-09-15T23:20:44.665 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.665 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.665 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585294 s, 179 MB/s 2024-09-15T23:20:44.673 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.674 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.674 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643141 s, 163 MB/s 2024-09-15T23:20:44.682 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.683 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.683 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725306 s, 145 MB/s 2024-09-15T23:20:44.690 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.690 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.690 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576067 s, 182 MB/s 2024-09-15T23:20:44.697 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.698 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.698 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627175 s, 167 MB/s 2024-09-15T23:20:44.705 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.706 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.706 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616496 s, 170 MB/s 2024-09-15T23:20:44.714 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.714 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.714 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672436 s, 156 MB/s 2024-09-15T23:20:44.723 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.723 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.723 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072653 s, 144 MB/s 2024-09-15T23:20:44.731 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.731 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.731 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679149 s, 154 MB/s 2024-09-15T23:20:44.739 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.739 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.739 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583817 s, 180 MB/s 2024-09-15T23:20:44.746 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.746 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.746 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058119 s, 180 MB/s 2024-09-15T23:20:44.754 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.754 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.755 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641872 s, 163 MB/s 2024-09-15T23:20:44.763 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.764 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.764 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739415 s, 142 MB/s 2024-09-15T23:20:44.771 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.771 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.771 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626373 s, 167 MB/s 2024-09-15T23:20:44.780 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.780 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.780 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722885 s, 145 MB/s 2024-09-15T23:20:44.789 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.789 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.789 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615856 s, 170 MB/s 2024-09-15T23:20:44.796 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.796 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.796 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582261 s, 180 MB/s 2024-09-15T23:20:44.803 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.803 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.803 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563499 s, 186 MB/s 2024-09-15T23:20:44.812 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.812 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.812 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653885 s, 160 MB/s 2024-09-15T23:20:44.820 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.820 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.821 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740789 s, 142 MB/s 2024-09-15T23:20:44.827 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.827 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.827 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572635 s, 183 MB/s 2024-09-15T23:20:44.835 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.835 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.836 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658078 s, 159 MB/s 2024-09-15T23:20:44.845 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.845 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.845 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0077896 s, 135 MB/s 2024-09-15T23:20:44.853 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.853 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.853 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620348 s, 169 MB/s 2024-09-15T23:20:44.861 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.861 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.861 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621594 s, 169 MB/s 2024-09-15T23:20:44.869 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.869 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.869 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064205 s, 163 MB/s 2024-09-15T23:20:44.877 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.877 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.878 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647919 s, 162 MB/s 2024-09-15T23:20:44.887 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.887 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.887 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00782336 s, 134 MB/s 2024-09-15T23:20:44.897 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.897 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.897 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00836151 s, 125 MB/s 2024-09-15T23:20:44.905 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.905 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.906 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625123 s, 168 MB/s 2024-09-15T23:20:44.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:20:44.912 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:20:44.912 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:20:44.912 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.17 2024-09-15T23:20:44.912 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:20:44.912 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:20:44.912 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:20:44.913 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:20:44.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:20:44.997 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:44.997 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:44.997 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713044 s, 147 MB/s 2024-09-15T23:20:45.006 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.006 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.006 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727057 s, 144 MB/s 2024-09-15T23:20:45.013 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.014 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.014 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598217 s, 175 MB/s 2024-09-15T23:20:45.022 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.023 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.023 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731071 s, 143 MB/s 2024-09-15T23:20:45.031 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.031 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.031 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703063 s, 149 MB/s 2024-09-15T23:20:45.039 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.040 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.040 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672258 s, 156 MB/s 2024-09-15T23:20:45.048 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.048 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.048 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708653 s, 148 MB/s 2024-09-15T23:20:45.057 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.057 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.058 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736132 s, 142 MB/s 2024-09-15T23:20:45.066 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.066 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.066 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711932 s, 147 MB/s 2024-09-15T23:20:45.074 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.074 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.074 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066805 s, 157 MB/s 2024-09-15T23:20:45.083 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.083 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.083 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682824 s, 154 MB/s 2024-09-15T23:20:45.092 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.092 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.092 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742317 s, 141 MB/s 2024-09-15T23:20:45.100 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.100 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.100 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625537 s, 168 MB/s 2024-09-15T23:20:45.108 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.108 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.108 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654839 s, 160 MB/s 2024-09-15T23:20:45.116 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.116 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.116 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622607 s, 168 MB/s 2024-09-15T23:20:45.123 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.123 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.123 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00549413 s, 191 MB/s 2024-09-15T23:20:45.132 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.132 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.132 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729378 s, 144 MB/s 2024-09-15T23:20:45.140 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.140 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.140 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661374 s, 159 MB/s 2024-09-15T23:20:45.148 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.148 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.148 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636237 s, 165 MB/s 2024-09-15T23:20:45.156 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.156 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.156 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689208 s, 152 MB/s 2024-09-15T23:20:45.165 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.165 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.165 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719653 s, 146 MB/s 2024-09-15T23:20:45.173 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.173 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.173 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671167 s, 156 MB/s 2024-09-15T23:20:45.181 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.181 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.181 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596042 s, 176 MB/s 2024-09-15T23:20:45.190 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.190 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.190 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745001 s, 141 MB/s 2024-09-15T23:20:45.198 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.198 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.198 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645081 s, 163 MB/s 2024-09-15T23:20:45.207 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.207 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.207 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699992 s, 150 MB/s 2024-09-15T23:20:45.216 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.216 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.216 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728817 s, 144 MB/s 2024-09-15T23:20:45.224 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.224 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.224 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628828 s, 167 MB/s 2024-09-15T23:20:45.231 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.231 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.231 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597587 s, 175 MB/s 2024-09-15T23:20:45.239 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.239 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.239 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606111 s, 173 MB/s 2024-09-15T23:20:45.247 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.247 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.247 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633919 s, 165 MB/s 2024-09-15T23:20:45.254 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.254 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.254 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578366 s, 181 MB/s 2024-09-15T23:20:45.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:20:45.261 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:20:45.261 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:20:45.261 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.18 2024-09-15T23:20:45.261 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:20:45.261 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:20:45.261 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:20:45.261 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:20:45.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:20:45.319 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.319 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.319 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675077 s, 155 MB/s 2024-09-15T23:20:45.327 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.327 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.327 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624103 s, 168 MB/s 2024-09-15T23:20:45.335 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.335 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.335 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060498 s, 173 MB/s 2024-09-15T23:20:45.343 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.343 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.343 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670498 s, 156 MB/s 2024-09-15T23:20:45.352 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.352 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.352 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721036 s, 145 MB/s 2024-09-15T23:20:45.359 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.359 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.359 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00548664 s, 191 MB/s 2024-09-15T23:20:45.366 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.367 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.367 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00555993 s, 189 MB/s 2024-09-15T23:20:45.374 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.374 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.374 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590069 s, 178 MB/s 2024-09-15T23:20:45.383 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.383 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.383 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709266 s, 148 MB/s 2024-09-15T23:20:45.392 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.392 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.392 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766495 s, 137 MB/s 2024-09-15T23:20:45.400 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.400 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.400 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066771 s, 157 MB/s 2024-09-15T23:20:45.409 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.409 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.409 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721455 s, 145 MB/s 2024-09-15T23:20:45.418 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.418 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.418 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717728 s, 146 MB/s 2024-09-15T23:20:45.426 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.426 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.426 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627589 s, 167 MB/s 2024-09-15T23:20:45.433 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.433 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.433 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581764 s, 180 MB/s 2024-09-15T23:20:45.442 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.442 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.442 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071763 s, 146 MB/s 2024-09-15T23:20:45.449 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.449 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.450 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583688 s, 180 MB/s 2024-09-15T23:20:45.457 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.457 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.457 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569289 s, 184 MB/s 2024-09-15T23:20:45.466 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.466 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.466 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765206 s, 137 MB/s 2024-09-15T23:20:45.476 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.476 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.476 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00805635 s, 130 MB/s 2024-09-15T23:20:45.483 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.483 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.483 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582116 s, 180 MB/s 2024-09-15T23:20:45.494 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.494 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.494 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757528 s, 138 MB/s 2024-09-15T23:20:45.500 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.500 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.500 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583665 s, 180 MB/s 2024-09-15T23:20:45.508 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.509 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.509 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687064 s, 153 MB/s 2024-09-15T23:20:45.516 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.516 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.516 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574164 s, 183 MB/s 2024-09-15T23:20:45.524 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.524 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.524 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641453 s, 163 MB/s 2024-09-15T23:20:45.532 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.532 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.532 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698086 s, 150 MB/s 2024-09-15T23:20:45.540 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.541 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.541 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645023 s, 163 MB/s 2024-09-15T23:20:45.549 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.549 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.549 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724319 s, 145 MB/s 2024-09-15T23:20:45.556 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.557 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.557 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057639 s, 182 MB/s 2024-09-15T23:20:45.564 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.564 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.564 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564515 s, 186 MB/s 2024-09-15T23:20:45.572 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.572 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.573 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673254 s, 156 MB/s 2024-09-15T23:20:45.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:20:45.579 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:20:45.579 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:20:45.579 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.19 2024-09-15T23:20:45.579 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:20:45.579 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:20:45.579 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:20:45.579 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:20:45.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:20:45.637 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.638 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.638 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576813 s, 182 MB/s 2024-09-15T23:20:45.647 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.647 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.647 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00840636 s, 125 MB/s 2024-09-15T23:20:45.658 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.658 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.658 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927348 s, 113 MB/s 2024-09-15T23:20:45.668 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.668 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.668 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00796871 s, 132 MB/s 2024-09-15T23:20:45.684 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.684 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.684 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140561 s, 74.6 MB/s 2024-09-15T23:20:45.692 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.692 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.693 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756136 s, 139 MB/s 2024-09-15T23:20:45.710 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.710 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.710 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111311 s, 94.2 MB/s 2024-09-15T23:20:45.716 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.716 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.716 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927985 s, 113 MB/s 2024-09-15T23:20:45.727 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.727 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.727 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095617 s, 110 MB/s 2024-09-15T23:20:45.737 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.737 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.737 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00781027 s, 134 MB/s 2024-09-15T23:20:45.744 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.744 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.744 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578372 s, 181 MB/s 2024-09-15T23:20:45.754 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.755 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.755 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00846952 s, 124 MB/s 2024-09-15T23:20:45.764 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.764 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.764 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00799404 s, 131 MB/s 2024-09-15T23:20:45.773 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.773 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.773 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072648 s, 144 MB/s 2024-09-15T23:20:45.780 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.780 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.780 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569193 s, 184 MB/s 2024-09-15T23:20:45.788 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.788 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.788 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578071 s, 181 MB/s 2024-09-15T23:20:45.800 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.800 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.800 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106253 s, 98.7 MB/s 2024-09-15T23:20:45.809 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.809 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.809 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756426 s, 139 MB/s 2024-09-15T23:20:45.817 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.817 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.817 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573777 s, 183 MB/s 2024-09-15T23:20:45.828 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.829 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.829 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649972 s, 161 MB/s 2024-09-15T23:20:45.834 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.834 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.834 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00797905 s, 131 MB/s 2024-09-15T23:20:45.842 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.842 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.842 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565412 s, 185 MB/s 2024-09-15T23:20:45.850 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.850 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.850 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653761 s, 160 MB/s 2024-09-15T23:20:45.858 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.858 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.858 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660447 s, 159 MB/s 2024-09-15T23:20:45.868 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.868 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.868 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00800272 s, 131 MB/s 2024-09-15T23:20:45.877 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.877 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.877 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737003 s, 142 MB/s 2024-09-15T23:20:45.885 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.885 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.885 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646455 s, 162 MB/s 2024-09-15T23:20:45.894 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.894 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.894 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724037 s, 145 MB/s 2024-09-15T23:20:45.902 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.902 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.902 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063348 s, 166 MB/s 2024-09-15T23:20:45.910 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.910 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.910 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631694 s, 166 MB/s 2024-09-15T23:20:45.918 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.918 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.918 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641302 s, 164 MB/s 2024-09-15T23:20:45.927 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.927 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.927 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074574 s, 141 MB/s 2024-09-15T23:20:45.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:20:45.933 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:20:45.934 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:20:45.934 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.20 2024-09-15T23:20:45.934 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:20:45.934 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:20:45.934 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:20:45.934 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:20:45.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:20:45.991 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:45.991 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:45.991 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057809 s, 181 MB/s 2024-09-15T23:20:46.000 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.000 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.001 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727797 s, 144 MB/s 2024-09-15T23:20:46.007 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.007 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.007 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00557649 s, 188 MB/s 2024-09-15T23:20:46.015 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.015 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.015 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658781 s, 159 MB/s 2024-09-15T23:20:46.022 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.022 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.023 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00559728 s, 187 MB/s 2024-09-15T23:20:46.031 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.031 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.031 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635413 s, 165 MB/s 2024-09-15T23:20:46.039 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.040 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.040 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735957 s, 142 MB/s 2024-09-15T23:20:46.048 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.048 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.048 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661344 s, 159 MB/s 2024-09-15T23:20:46.056 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.056 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.056 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665163 s, 158 MB/s 2024-09-15T23:20:46.064 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.064 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.064 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598186 s, 175 MB/s 2024-09-15T23:20:46.073 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.073 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.074 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00790244 s, 133 MB/s 2024-09-15T23:20:46.084 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.084 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.084 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00910525 s, 115 MB/s 2024-09-15T23:20:46.091 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.092 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.092 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565927 s, 185 MB/s 2024-09-15T23:20:46.099 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.099 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.099 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00559276 s, 187 MB/s 2024-09-15T23:20:46.107 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.107 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.107 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660022 s, 159 MB/s 2024-09-15T23:20:46.116 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.116 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.116 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727749 s, 144 MB/s 2024-09-15T23:20:46.124 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.124 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.124 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604158 s, 174 MB/s 2024-09-15T23:20:46.133 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.133 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.133 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742983 s, 141 MB/s 2024-09-15T23:20:46.143 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.143 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.143 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00841173 s, 125 MB/s 2024-09-15T23:20:46.152 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.152 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.152 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741393 s, 141 MB/s 2024-09-15T23:20:46.160 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.160 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.160 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629026 s, 167 MB/s 2024-09-15T23:20:46.168 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.168 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.168 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007044 s, 149 MB/s 2024-09-15T23:20:46.177 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.177 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.177 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711178 s, 147 MB/s 2024-09-15T23:20:46.185 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.185 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.186 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655259 s, 160 MB/s 2024-09-15T23:20:46.195 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.195 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.195 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00804624 s, 130 MB/s 2024-09-15T23:20:46.203 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.203 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.203 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684494 s, 153 MB/s 2024-09-15T23:20:46.213 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.213 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.213 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00842433 s, 124 MB/s 2024-09-15T23:20:46.220 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.221 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.221 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582494 s, 180 MB/s 2024-09-15T23:20:46.228 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.228 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.228 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00552983 s, 190 MB/s 2024-09-15T23:20:46.235 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.235 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.235 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584563 s, 179 MB/s 2024-09-15T23:20:46.243 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.243 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.243 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631427 s, 166 MB/s 2024-09-15T23:20:46.251 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.251 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.251 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586055 s, 179 MB/s 2024-09-15T23:20:46.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:20:46.257 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:20:46.257 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:20:46.258 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.21 2024-09-15T23:20:46.258 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:20:46.258 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:20:46.258 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:20:46.258 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:20:46.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:20:46.315 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.315 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.315 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568946 s, 184 MB/s 2024-09-15T23:20:46.324 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.324 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.324 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628912 s, 167 MB/s 2024-09-15T23:20:46.332 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.332 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.332 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714598 s, 147 MB/s 2024-09-15T23:20:46.341 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.342 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.342 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00782933 s, 134 MB/s 2024-09-15T23:20:46.349 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.349 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.349 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569863 s, 184 MB/s 2024-09-15T23:20:46.357 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.357 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.357 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637479 s, 164 MB/s 2024-09-15T23:20:46.365 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.365 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.365 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672409 s, 156 MB/s 2024-09-15T23:20:46.373 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.373 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.373 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063046 s, 166 MB/s 2024-09-15T23:20:46.380 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.380 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.381 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585648 s, 179 MB/s 2024-09-15T23:20:46.388 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.388 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.388 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00561087 s, 187 MB/s 2024-09-15T23:20:46.397 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.397 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.397 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075857 s, 138 MB/s 2024-09-15T23:20:46.404 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.405 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.405 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563614 s, 186 MB/s 2024-09-15T23:20:46.412 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.412 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.412 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00567902 s, 185 MB/s 2024-09-15T23:20:46.419 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.420 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.420 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621467 s, 169 MB/s 2024-09-15T23:20:46.427 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.428 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.428 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651717 s, 161 MB/s 2024-09-15T23:20:46.436 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.437 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.437 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730968 s, 143 MB/s 2024-09-15T23:20:46.445 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.445 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.445 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634214 s, 165 MB/s 2024-09-15T23:20:46.453 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.453 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.453 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652269 s, 161 MB/s 2024-09-15T23:20:46.460 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.460 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.460 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563249 s, 186 MB/s 2024-09-15T23:20:46.468 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.469 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.469 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067717 s, 155 MB/s 2024-09-15T23:20:46.476 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.476 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.476 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.005863 s, 179 MB/s 2024-09-15T23:20:46.485 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.485 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.485 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735979 s, 142 MB/s 2024-09-15T23:20:46.493 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.493 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.493 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630234 s, 166 MB/s 2024-09-15T23:20:46.501 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.501 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.501 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654277 s, 160 MB/s 2024-09-15T23:20:46.509 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.509 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.509 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597172 s, 176 MB/s 2024-09-15T23:20:46.517 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.517 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.517 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637245 s, 165 MB/s 2024-09-15T23:20:46.526 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.527 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.527 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00812626 s, 129 MB/s 2024-09-15T23:20:46.535 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.535 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.535 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687681 s, 152 MB/s 2024-09-15T23:20:46.542 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.542 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.543 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579635 s, 181 MB/s 2024-09-15T23:20:46.550 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.551 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.551 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624103 s, 168 MB/s 2024-09-15T23:20:46.559 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.559 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.559 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709376 s, 148 MB/s 2024-09-15T23:20:46.567 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.567 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.567 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598803 s, 175 MB/s 2024-09-15T23:20:46.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:20:46.573 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:20:46.574 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:20:46.574 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.22 2024-09-15T23:20:46.574 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:20:46.574 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:20:46.574 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:20:46.574 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:20:46.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:20:46.633 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.633 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.633 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00789647 s, 133 MB/s 2024-09-15T23:20:46.641 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.641 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.641 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670597 s, 156 MB/s 2024-09-15T23:20:46.649 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.649 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.649 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.005887 s, 178 MB/s 2024-09-15T23:20:46.657 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.657 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.657 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695761 s, 151 MB/s 2024-09-15T23:20:46.664 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.665 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.665 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00567536 s, 185 MB/s 2024-09-15T23:20:46.674 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.674 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.674 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736254 s, 142 MB/s 2024-09-15T23:20:46.681 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.682 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.682 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629867 s, 166 MB/s 2024-09-15T23:20:46.689 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.689 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.689 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579213 s, 181 MB/s 2024-09-15T23:20:46.697 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.697 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.697 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591107 s, 177 MB/s 2024-09-15T23:20:46.706 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.706 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.706 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764965 s, 137 MB/s 2024-09-15T23:20:46.715 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.715 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.715 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673932 s, 156 MB/s 2024-09-15T23:20:46.724 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.724 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.724 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761005 s, 138 MB/s 2024-09-15T23:20:46.732 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.732 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.732 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660304 s, 159 MB/s 2024-09-15T23:20:46.740 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.740 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.741 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663513 s, 158 MB/s 2024-09-15T23:20:46.748 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.748 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.748 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059192 s, 177 MB/s 2024-09-15T23:20:46.756 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.757 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.757 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067744 s, 155 MB/s 2024-09-15T23:20:46.764 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.764 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.764 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577124 s, 182 MB/s 2024-09-15T23:20:46.771 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.771 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.771 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573856 s, 183 MB/s 2024-09-15T23:20:46.780 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.780 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.780 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675133 s, 155 MB/s 2024-09-15T23:20:46.787 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.788 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.788 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647432 s, 162 MB/s 2024-09-15T23:20:46.797 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.797 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.797 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735413 s, 143 MB/s 2024-09-15T23:20:46.805 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.805 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.805 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671697 s, 156 MB/s 2024-09-15T23:20:46.813 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.813 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.813 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063 s, 166 MB/s 2024-09-15T23:20:46.820 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.820 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.820 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00559243 s, 187 MB/s 2024-09-15T23:20:46.828 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.828 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.828 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066409 s, 158 MB/s 2024-09-15T23:20:46.836 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.836 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.836 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657329 s, 160 MB/s 2024-09-15T23:20:46.845 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.845 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.845 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741134 s, 141 MB/s 2024-09-15T23:20:46.853 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.853 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.853 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059714 s, 176 MB/s 2024-09-15T23:20:46.861 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.861 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.862 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675473 s, 155 MB/s 2024-09-15T23:20:46.870 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.870 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.870 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725625 s, 145 MB/s 2024-09-15T23:20:46.879 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.879 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.879 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691755 s, 152 MB/s 2024-09-15T23:20:46.887 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.887 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.887 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635403 s, 165 MB/s 2024-09-15T23:20:46.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:20:46.894 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:20:46.894 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:20:46.894 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.23 2024-09-15T23:20:46.894 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:20:46.894 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:20:46.894 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:20:46.894 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:20:46.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:20:46.952 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.952 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.952 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590337 s, 178 MB/s 2024-09-15T23:20:46.960 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.960 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.960 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682375 s, 154 MB/s 2024-09-15T23:20:46.968 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.969 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.969 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671846 s, 156 MB/s 2024-09-15T23:20:46.977 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.977 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.977 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729588 s, 144 MB/s 2024-09-15T23:20:46.986 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.986 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.986 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682592 s, 154 MB/s 2024-09-15T23:20:46.993 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:46.993 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:46.993 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594155 s, 176 MB/s 2024-09-15T23:20:47.001 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.001 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.002 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666211 s, 157 MB/s 2024-09-15T23:20:47.009 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.009 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.009 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585702 s, 179 MB/s 2024-09-15T23:20:47.017 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.017 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.017 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066828 s, 157 MB/s 2024-09-15T23:20:47.026 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.026 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.026 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709083 s, 148 MB/s 2024-09-15T23:20:47.034 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.034 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.034 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656574 s, 160 MB/s 2024-09-15T23:20:47.042 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.042 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.042 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575274 s, 182 MB/s 2024-09-15T23:20:47.049 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.049 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.049 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565503 s, 185 MB/s 2024-09-15T23:20:47.057 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.057 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.058 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065441 s, 160 MB/s 2024-09-15T23:20:47.064 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.065 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.065 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573705 s, 183 MB/s 2024-09-15T23:20:47.073 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.074 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.074 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730737 s, 143 MB/s 2024-09-15T23:20:47.081 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.081 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.081 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00561239 s, 187 MB/s 2024-09-15T23:20:47.089 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.089 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.089 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062836 s, 167 MB/s 2024-09-15T23:20:47.097 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.097 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.097 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621396 s, 169 MB/s 2024-09-15T23:20:47.104 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.104 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.104 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616249 s, 170 MB/s 2024-09-15T23:20:47.113 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.113 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.113 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643691 s, 163 MB/s 2024-09-15T23:20:47.121 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.121 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.121 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697062 s, 150 MB/s 2024-09-15T23:20:47.128 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.129 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.129 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583149 s, 180 MB/s 2024-09-15T23:20:47.136 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.136 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.136 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565419 s, 185 MB/s 2024-09-15T23:20:47.144 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.144 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.144 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649751 s, 161 MB/s 2024-09-15T23:20:47.152 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.152 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.152 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619833 s, 169 MB/s 2024-09-15T23:20:47.161 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.161 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.161 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763967 s, 137 MB/s 2024-09-15T23:20:47.168 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.169 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.169 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572127 s, 183 MB/s 2024-09-15T23:20:47.176 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.176 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.177 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597938 s, 175 MB/s 2024-09-15T23:20:47.186 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.186 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.186 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00773124 s, 136 MB/s 2024-09-15T23:20:47.193 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.193 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.193 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570867 s, 184 MB/s 2024-09-15T23:20:47.202 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.202 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.202 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729918 s, 144 MB/s 2024-09-15T23:20:47.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:20:47.209 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:20:47.209 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:20:47.209 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.24 2024-09-15T23:20:47.209 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:20:47.209 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:20:47.209 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:20:47.209 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:20:47.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:20:47.266 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.266 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.266 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600611 s, 175 MB/s 2024-09-15T23:20:47.274 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.274 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.274 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598365 s, 175 MB/s 2024-09-15T23:20:47.282 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.282 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.282 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065523 s, 160 MB/s 2024-09-15T23:20:47.291 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.291 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.291 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722334 s, 145 MB/s 2024-09-15T23:20:47.298 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.298 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.298 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593232 s, 177 MB/s 2024-09-15T23:20:47.307 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.307 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.307 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662376 s, 158 MB/s 2024-09-15T23:20:47.314 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.314 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.314 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563352 s, 186 MB/s 2024-09-15T23:20:47.321 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.321 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.322 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575044 s, 182 MB/s 2024-09-15T23:20:47.330 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.330 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.331 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067299 s, 156 MB/s 2024-09-15T23:20:47.337 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.337 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.337 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565076 s, 186 MB/s 2024-09-15T23:20:47.348 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.349 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.349 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00969645 s, 108 MB/s 2024-09-15T23:20:47.358 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.358 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.358 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756572 s, 139 MB/s 2024-09-15T23:20:47.365 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.365 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.365 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.005591 s, 188 MB/s 2024-09-15T23:20:47.373 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.373 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.373 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640387 s, 164 MB/s 2024-09-15T23:20:47.381 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.381 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.381 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654226 s, 160 MB/s 2024-09-15T23:20:47.389 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.389 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.389 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640886 s, 164 MB/s 2024-09-15T23:20:47.396 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.397 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.397 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059042 s, 178 MB/s 2024-09-15T23:20:47.404 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.404 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.405 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627347 s, 167 MB/s 2024-09-15T23:20:47.413 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.413 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.413 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721182 s, 145 MB/s 2024-09-15T23:20:47.421 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.421 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.421 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570321 s, 184 MB/s 2024-09-15T23:20:47.429 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.429 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.429 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647686 s, 162 MB/s 2024-09-15T23:20:47.437 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.437 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.437 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067047 s, 156 MB/s 2024-09-15T23:20:47.445 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.445 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.445 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596216 s, 176 MB/s 2024-09-15T23:20:47.454 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.454 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.454 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739947 s, 142 MB/s 2024-09-15T23:20:47.463 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.463 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.463 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771874 s, 136 MB/s 2024-09-15T23:20:47.472 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.472 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.472 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731869 s, 143 MB/s 2024-09-15T23:20:47.481 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.482 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.482 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767433 s, 137 MB/s 2024-09-15T23:20:47.489 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.489 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.489 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586354 s, 179 MB/s 2024-09-15T23:20:47.496 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.496 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.496 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566055 s, 185 MB/s 2024-09-15T23:20:47.504 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.504 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.505 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644351 s, 163 MB/s 2024-09-15T23:20:47.513 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.513 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.513 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670966 s, 156 MB/s 2024-09-15T23:20:47.522 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.522 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.522 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752048 s, 139 MB/s 2024-09-15T23:20:47.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:20:47.529 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:20:47.529 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:20:47.529 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.25 2024-09-15T23:20:47.529 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:20:47.529 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:20:47.529 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:20:47.529 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:20:47.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:20:47.587 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.587 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.588 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647622 s, 162 MB/s 2024-09-15T23:20:47.595 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.595 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.595 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651027 s, 161 MB/s 2024-09-15T23:20:47.603 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.603 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.603 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656867 s, 160 MB/s 2024-09-15T23:20:47.610 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.611 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.611 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591863 s, 177 MB/s 2024-09-15T23:20:47.620 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.620 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.620 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734773 s, 143 MB/s 2024-09-15T23:20:47.629 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.629 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.629 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737412 s, 142 MB/s 2024-09-15T23:20:47.636 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.636 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.636 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587634 s, 178 MB/s 2024-09-15T23:20:47.644 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.644 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.644 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643138 s, 163 MB/s 2024-09-15T23:20:47.653 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.653 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.653 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064321 s, 163 MB/s 2024-09-15T23:20:47.660 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.660 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.660 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594549 s, 176 MB/s 2024-09-15T23:20:47.668 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.668 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.668 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625272 s, 168 MB/s 2024-09-15T23:20:47.677 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.678 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.678 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776633 s, 135 MB/s 2024-09-15T23:20:47.685 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.685 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.685 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577182 s, 182 MB/s 2024-09-15T23:20:47.693 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.693 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.693 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676007 s, 155 MB/s 2024-09-15T23:20:47.703 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.703 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.703 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756314 s, 139 MB/s 2024-09-15T23:20:47.711 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.711 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.711 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639621 s, 164 MB/s 2024-09-15T23:20:47.718 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.718 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.718 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00561318 s, 187 MB/s 2024-09-15T23:20:47.726 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.726 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.726 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658665 s, 159 MB/s 2024-09-15T23:20:47.734 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.734 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.734 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583797 s, 180 MB/s 2024-09-15T23:20:47.742 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.742 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.742 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066865 s, 157 MB/s 2024-09-15T23:20:47.749 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.749 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.749 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569309 s, 184 MB/s 2024-09-15T23:20:47.758 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.758 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.758 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744278 s, 141 MB/s 2024-09-15T23:20:47.767 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.767 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.767 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712873 s, 147 MB/s 2024-09-15T23:20:47.776 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.776 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.776 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731538 s, 143 MB/s 2024-09-15T23:20:47.785 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.785 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.785 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718168 s, 146 MB/s 2024-09-15T23:20:47.793 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.793 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.793 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628194 s, 167 MB/s 2024-09-15T23:20:47.802 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.802 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.802 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747875 s, 140 MB/s 2024-09-15T23:20:47.811 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.811 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.811 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716793 s, 146 MB/s 2024-09-15T23:20:47.819 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.819 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.819 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691701 s, 152 MB/s 2024-09-15T23:20:47.828 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.828 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.828 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007527 s, 139 MB/s 2024-09-15T23:20:47.838 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.838 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.838 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00799153 s, 131 MB/s 2024-09-15T23:20:47.845 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.845 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.845 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00562667 s, 186 MB/s 2024-09-15T23:20:47.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:20:47.852 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:20:47.852 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:20:47.852 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.26 2024-09-15T23:20:47.852 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:20:47.852 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:20:47.853 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:20:47.853 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:20:47.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:20:47.913 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.913 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.913 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00855023 s, 123 MB/s 2024-09-15T23:20:47.921 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.922 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.922 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696094 s, 151 MB/s 2024-09-15T23:20:47.930 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.930 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.931 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726521 s, 144 MB/s 2024-09-15T23:20:47.939 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.939 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.939 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689186 s, 152 MB/s 2024-09-15T23:20:47.946 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.946 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.946 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588689 s, 178 MB/s 2024-09-15T23:20:47.955 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.956 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.956 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744662 s, 141 MB/s 2024-09-15T23:20:47.967 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.967 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.967 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00973724 s, 108 MB/s 2024-09-15T23:20:47.974 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.974 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.974 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00557228 s, 188 MB/s 2024-09-15T23:20:47.983 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.983 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.983 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730906 s, 143 MB/s 2024-09-15T23:20:47.990 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:47.991 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:47.991 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568764 s, 184 MB/s 2024-09-15T23:20:47.999 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.000 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.000 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712985 s, 147 MB/s 2024-09-15T23:20:48.008 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.008 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.008 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714818 s, 147 MB/s 2024-09-15T23:20:48.016 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.017 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.017 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682281 s, 154 MB/s 2024-09-15T23:20:48.024 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.024 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.025 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621573 s, 169 MB/s 2024-09-15T23:20:48.032 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.032 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.033 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628816 s, 167 MB/s 2024-09-15T23:20:48.040 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.040 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.040 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634442 s, 165 MB/s 2024-09-15T23:20:48.049 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.049 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.049 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726226 s, 144 MB/s 2024-09-15T23:20:48.058 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.058 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.058 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710482 s, 148 MB/s 2024-09-15T23:20:48.067 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.067 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.067 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749784 s, 140 MB/s 2024-09-15T23:20:48.076 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.076 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.076 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721827 s, 145 MB/s 2024-09-15T23:20:48.085 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.085 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.085 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706816 s, 148 MB/s 2024-09-15T23:20:48.092 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.092 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.092 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573407 s, 183 MB/s 2024-09-15T23:20:48.100 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.101 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.101 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666173 s, 157 MB/s 2024-09-15T23:20:48.109 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.109 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.110 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575856 s, 182 MB/s 2024-09-15T23:20:48.117 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.117 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.117 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731011 s, 143 MB/s 2024-09-15T23:20:48.126 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.126 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.126 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716789 s, 146 MB/s 2024-09-15T23:20:48.133 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.133 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.133 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578378 s, 181 MB/s 2024-09-15T23:20:48.142 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.142 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.142 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682666 s, 154 MB/s 2024-09-15T23:20:48.151 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.151 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.151 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727214 s, 144 MB/s 2024-09-15T23:20:48.159 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.159 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.159 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679458 s, 154 MB/s 2024-09-15T23:20:48.168 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.168 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.168 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647316 s, 162 MB/s 2024-09-15T23:20:48.174 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.174 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.174 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00555785 s, 189 MB/s 2024-09-15T23:20:48.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:20:48.181 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:20:48.181 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:20:48.181 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.27 2024-09-15T23:20:48.181 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:20:48.181 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:20:48.181 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:20:48.181 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:20:48.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:20:48.239 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.239 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.239 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681102 s, 154 MB/s 2024-09-15T23:20:48.247 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.247 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.247 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603833 s, 174 MB/s 2024-09-15T23:20:48.254 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.254 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.254 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563187 s, 186 MB/s 2024-09-15T23:20:48.262 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.262 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.263 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065383 s, 160 MB/s 2024-09-15T23:20:48.270 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.270 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.271 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621629 s, 169 MB/s 2024-09-15T23:20:48.279 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.279 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.279 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722569 s, 145 MB/s 2024-09-15T23:20:48.287 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.287 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.287 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637956 s, 164 MB/s 2024-09-15T23:20:48.295 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.296 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.296 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067132 s, 156 MB/s 2024-09-15T23:20:48.304 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.304 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.304 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712472 s, 147 MB/s 2024-09-15T23:20:48.313 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.313 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.313 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725978 s, 144 MB/s 2024-09-15T23:20:48.321 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.321 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.321 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602529 s, 174 MB/s 2024-09-15T23:20:48.329 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.329 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.329 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065609 s, 160 MB/s 2024-09-15T23:20:48.336 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.336 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.337 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0056648 s, 185 MB/s 2024-09-15T23:20:48.345 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.345 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.345 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695301 s, 151 MB/s 2024-09-15T23:20:48.354 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.354 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.354 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713215 s, 147 MB/s 2024-09-15T23:20:48.361 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.361 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.361 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0055147 s, 190 MB/s 2024-09-15T23:20:48.372 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.372 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.372 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674858 s, 155 MB/s 2024-09-15T23:20:48.377 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.377 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.377 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568697 s, 184 MB/s 2024-09-15T23:20:48.385 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.385 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.386 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698969 s, 150 MB/s 2024-09-15T23:20:48.393 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.393 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.393 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00550871 s, 190 MB/s 2024-09-15T23:20:48.402 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.402 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.402 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767647 s, 137 MB/s 2024-09-15T23:20:48.410 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.410 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.410 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629607 s, 167 MB/s 2024-09-15T23:20:48.418 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.418 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.418 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063024 s, 166 MB/s 2024-09-15T23:20:48.427 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.427 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.427 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735776 s, 143 MB/s 2024-09-15T23:20:48.435 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.436 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.436 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714977 s, 147 MB/s 2024-09-15T23:20:48.443 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.443 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.444 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632526 s, 166 MB/s 2024-09-15T23:20:48.453 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.453 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.453 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738576 s, 142 MB/s 2024-09-15T23:20:48.461 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.461 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.462 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737183 s, 142 MB/s 2024-09-15T23:20:48.469 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.469 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.469 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568907 s, 184 MB/s 2024-09-15T23:20:48.476 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.476 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.476 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569499 s, 184 MB/s 2024-09-15T23:20:48.485 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.485 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.485 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673642 s, 156 MB/s 2024-09-15T23:20:48.492 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.493 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.493 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628604 s, 167 MB/s 2024-09-15T23:20:48.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:20:48.499 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:20:48.499 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:20:48.499 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.28 2024-09-15T23:20:48.499 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:20:48.500 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:20:48.500 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:20:48.500 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:20:48.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:20:48.557 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.557 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.558 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685218 s, 153 MB/s 2024-09-15T23:20:48.565 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.565 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.565 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603205 s, 174 MB/s 2024-09-15T23:20:48.574 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.574 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.574 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731823 s, 143 MB/s 2024-09-15T23:20:48.583 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.584 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.584 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571998 s, 183 MB/s 2024-09-15T23:20:48.589 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.589 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.589 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577333 s, 182 MB/s 2024-09-15T23:20:48.597 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.597 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.598 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655022 s, 160 MB/s 2024-09-15T23:20:48.605 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.606 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.606 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660186 s, 159 MB/s 2024-09-15T23:20:48.613 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.613 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.613 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582493 s, 180 MB/s 2024-09-15T23:20:48.621 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.621 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.621 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066577 s, 157 MB/s 2024-09-15T23:20:48.629 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.629 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.629 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652764 s, 161 MB/s 2024-09-15T23:20:48.637 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.638 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.638 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659985 s, 159 MB/s 2024-09-15T23:20:48.646 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.646 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.646 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685197 s, 153 MB/s 2024-09-15T23:20:48.654 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.654 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.655 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676486 s, 155 MB/s 2024-09-15T23:20:48.661 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.662 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.662 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570433 s, 184 MB/s 2024-09-15T23:20:48.670 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.670 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.670 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638291 s, 164 MB/s 2024-09-15T23:20:48.679 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.679 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.679 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767279 s, 137 MB/s 2024-09-15T23:20:48.687 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.687 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.687 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632777 s, 166 MB/s 2024-09-15T23:20:48.694 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.694 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.694 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00559287 s, 187 MB/s 2024-09-15T23:20:48.702 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.702 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.702 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648971 s, 162 MB/s 2024-09-15T23:20:48.711 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.711 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.711 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733771 s, 143 MB/s 2024-09-15T23:20:48.720 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.720 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.721 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734266 s, 143 MB/s 2024-09-15T23:20:48.729 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.729 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.729 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709852 s, 148 MB/s 2024-09-15T23:20:48.737 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.737 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.737 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636982 s, 165 MB/s 2024-09-15T23:20:48.745 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.745 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.745 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636162 s, 165 MB/s 2024-09-15T23:20:48.754 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.754 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.754 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066872 s, 157 MB/s 2024-09-15T23:20:48.761 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.761 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.761 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588133 s, 178 MB/s 2024-09-15T23:20:48.769 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.769 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.769 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642205 s, 163 MB/s 2024-09-15T23:20:48.780 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.780 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.780 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00826663 s, 127 MB/s 2024-09-15T23:20:48.787 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.787 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.787 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572257 s, 183 MB/s 2024-09-15T23:20:48.797 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.797 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.797 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00864683 s, 121 MB/s 2024-09-15T23:20:48.806 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.806 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.806 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755541 s, 139 MB/s 2024-09-15T23:20:48.820 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.820 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.820 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121592 s, 86.2 MB/s 2024-09-15T23:20:48.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:20:48.826 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:20:48.827 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:20:48.827 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.29 2024-09-15T23:20:48.827 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:20:48.827 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:20:48.827 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:20:48.827 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:20:48.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:20:48.889 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.889 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.889 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107187 s, 97.8 MB/s 2024-09-15T23:20:48.897 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.897 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.897 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598118 s, 175 MB/s 2024-09-15T23:20:48.907 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.907 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.907 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00818957 s, 128 MB/s 2024-09-15T23:20:48.914 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.914 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.914 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575351 s, 182 MB/s 2024-09-15T23:20:48.924 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.924 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.924 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00780563 s, 134 MB/s 2024-09-15T23:20:48.933 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.933 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.933 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00797181 s, 132 MB/s 2024-09-15T23:20:48.943 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.943 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.943 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00804031 s, 130 MB/s 2024-09-15T23:20:48.951 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.951 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.951 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637755 s, 164 MB/s 2024-09-15T23:20:48.958 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.958 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.958 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00558389 s, 188 MB/s 2024-09-15T23:20:48.966 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.967 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.967 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670726 s, 156 MB/s 2024-09-15T23:20:48.974 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.974 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.974 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585322 s, 179 MB/s 2024-09-15T23:20:48.983 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.983 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.983 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713278 s, 147 MB/s 2024-09-15T23:20:48.993 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:48.993 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:48.993 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0078579 s, 133 MB/s 2024-09-15T23:20:49.001 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.002 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.002 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729758 s, 144 MB/s 2024-09-15T23:20:49.010 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.010 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.010 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643439 s, 163 MB/s 2024-09-15T23:20:49.018 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.019 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.019 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724663 s, 145 MB/s 2024-09-15T23:20:49.028 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.028 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.028 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735734 s, 143 MB/s 2024-09-15T23:20:49.036 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.036 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.037 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704763 s, 149 MB/s 2024-09-15T23:20:49.044 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.044 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.044 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588412 s, 178 MB/s 2024-09-15T23:20:49.052 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.052 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.052 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665274 s, 158 MB/s 2024-09-15T23:20:49.060 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.060 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.060 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594203 s, 176 MB/s 2024-09-15T23:20:49.069 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.069 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.069 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710969 s, 147 MB/s 2024-09-15T23:20:49.076 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.076 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.076 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585631 s, 179 MB/s 2024-09-15T23:20:49.085 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.085 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.085 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745311 s, 141 MB/s 2024-09-15T23:20:49.093 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.093 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.093 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00557449 s, 188 MB/s 2024-09-15T23:20:49.100 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.100 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.101 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596337 s, 176 MB/s 2024-09-15T23:20:49.109 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.110 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.110 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746219 s, 141 MB/s 2024-09-15T23:20:49.117 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.117 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.117 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0055878 s, 188 MB/s 2024-09-15T23:20:49.125 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.125 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.125 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652774 s, 161 MB/s 2024-09-15T23:20:49.133 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.134 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.134 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572413 s, 183 MB/s 2024-09-15T23:20:49.141 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.141 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.141 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657984 s, 159 MB/s 2024-09-15T23:20:49.150 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.150 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.150 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750075 s, 140 MB/s 2024-09-15T23:20:49.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:20:49.156 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:20:49.157 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:20:49.157 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.30 2024-09-15T23:20:49.157 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:20:49.157 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:20:49.157 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:20:49.157 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:20:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:20:49.216 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.216 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.216 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713842 s, 147 MB/s 2024-09-15T23:20:49.225 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.225 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.225 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00774318 s, 135 MB/s 2024-09-15T23:20:49.234 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.234 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.234 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744647 s, 141 MB/s 2024-09-15T23:20:49.243 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.243 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.244 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765019 s, 137 MB/s 2024-09-15T23:20:49.251 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.251 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.252 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631011 s, 166 MB/s 2024-09-15T23:20:49.260 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.260 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.260 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724816 s, 145 MB/s 2024-09-15T23:20:49.269 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.269 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.269 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731333 s, 143 MB/s 2024-09-15T23:20:49.277 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.277 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.277 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659212 s, 159 MB/s 2024-09-15T23:20:49.285 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.285 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.285 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00561359 s, 187 MB/s 2024-09-15T23:20:49.292 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.292 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.292 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585496 s, 179 MB/s 2024-09-15T23:20:49.301 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.301 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.301 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698269 s, 150 MB/s 2024-09-15T23:20:49.310 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.310 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.310 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767118 s, 137 MB/s 2024-09-15T23:20:49.319 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.319 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.319 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674226 s, 156 MB/s 2024-09-15T23:20:49.327 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.327 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.328 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725199 s, 145 MB/s 2024-09-15T23:20:49.335 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.335 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.336 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635917 s, 165 MB/s 2024-09-15T23:20:49.343 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.343 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.343 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619822 s, 169 MB/s 2024-09-15T23:20:49.351 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.351 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.351 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668264 s, 157 MB/s 2024-09-15T23:20:49.360 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.360 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.360 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680393 s, 154 MB/s 2024-09-15T23:20:49.368 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.368 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.368 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065742 s, 159 MB/s 2024-09-15T23:20:49.377 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.377 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.377 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075043 s, 140 MB/s 2024-09-15T23:20:49.385 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.385 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.385 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636894 s, 165 MB/s 2024-09-15T23:20:49.393 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.393 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.393 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645276 s, 163 MB/s 2024-09-15T23:20:49.400 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.400 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.400 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00555624 s, 189 MB/s 2024-09-15T23:20:49.408 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.408 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.409 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069687 s, 150 MB/s 2024-09-15T23:20:49.416 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.416 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.416 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565655 s, 185 MB/s 2024-09-15T23:20:49.425 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.425 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.425 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739118 s, 142 MB/s 2024-09-15T23:20:49.434 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.434 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.434 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739978 s, 142 MB/s 2024-09-15T23:20:49.442 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.442 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.442 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638044 s, 164 MB/s 2024-09-15T23:20:49.450 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.450 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.450 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639239 s, 164 MB/s 2024-09-15T23:20:49.458 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.459 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.459 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071483 s, 147 MB/s 2024-09-15T23:20:49.467 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.467 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.468 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721353 s, 145 MB/s 2024-09-15T23:20:49.476 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.476 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.476 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709901 s, 148 MB/s 2024-09-15T23:20:49.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:20:49.483 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:20:49.483 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:20:49.483 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.31 2024-09-15T23:20:49.483 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:20:49.483 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:20:49.483 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:20:49.483 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:20:49.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:20:49.541 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.541 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.542 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646173 s, 162 MB/s 2024-09-15T23:20:49.549 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.549 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.549 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606556 s, 173 MB/s 2024-09-15T23:20:49.557 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.558 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.558 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663017 s, 158 MB/s 2024-09-15T23:20:49.566 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.566 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.566 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652363 s, 161 MB/s 2024-09-15T23:20:49.574 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.574 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.574 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711528 s, 147 MB/s 2024-09-15T23:20:49.583 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.583 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.583 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724805 s, 145 MB/s 2024-09-15T23:20:49.591 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.592 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.592 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676213 s, 155 MB/s 2024-09-15T23:20:49.599 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.599 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.599 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620841 s, 169 MB/s 2024-09-15T23:20:49.608 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.608 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.608 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585853 s, 179 MB/s 2024-09-15T23:20:49.615 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.615 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.615 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678164 s, 155 MB/s 2024-09-15T23:20:49.623 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.623 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.623 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586576 s, 179 MB/s 2024-09-15T23:20:49.632 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.632 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.632 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0078343 s, 134 MB/s 2024-09-15T23:20:49.640 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.640 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.640 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058619 s, 179 MB/s 2024-09-15T23:20:49.648 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.648 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.648 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654784 s, 160 MB/s 2024-09-15T23:20:49.656 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.656 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.657 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658269 s, 159 MB/s 2024-09-15T23:20:49.664 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.664 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.664 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619407 s, 169 MB/s 2024-09-15T23:20:49.671 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.671 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.672 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595078 s, 176 MB/s 2024-09-15T23:20:49.680 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.680 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.681 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731328 s, 143 MB/s 2024-09-15T23:20:49.689 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.689 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.689 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728809 s, 144 MB/s 2024-09-15T23:20:49.697 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.698 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.698 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662153 s, 158 MB/s 2024-09-15T23:20:49.705 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.706 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.706 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659706 s, 159 MB/s 2024-09-15T23:20:49.719 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.719 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.719 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112031 s, 93.6 MB/s 2024-09-15T23:20:49.727 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.727 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.727 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638897 s, 164 MB/s 2024-09-15T23:20:49.736 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.736 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.736 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741442 s, 141 MB/s 2024-09-15T23:20:49.743 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.743 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.743 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578261 s, 181 MB/s 2024-09-15T23:20:49.752 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.752 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.752 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707811 s, 148 MB/s 2024-09-15T23:20:49.761 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.761 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.761 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740691 s, 142 MB/s 2024-09-15T23:20:49.768 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.769 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.769 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572137 s, 183 MB/s 2024-09-15T23:20:49.776 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.776 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.777 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596594 s, 176 MB/s 2024-09-15T23:20:49.784 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.784 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.784 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065155 s, 161 MB/s 2024-09-15T23:20:49.792 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.792 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.792 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585679 s, 179 MB/s 2024-09-15T23:20:49.799 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:20:49.799 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:20:49.799 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564112 s, 186 MB/s 2024-09-15T23:20:49.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:20:49.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:20:49.805 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub start /scrub_control_test_path recursive 2024-09-15T23:20:49.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.924+0000 7f0da3cdd640 1 Processor -- start 2024-09-15T23:20:49.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.925+0000 7f0da3cdd640 1 -- start start 2024-09-15T23:20:49.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.925+0000 7f0da3cdd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0d9c15ea90 0x7f0d9c0d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:49.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.925+0000 7f0da3cdd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d9c0d40b0 0x7f0d9c0d0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:49.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.925+0000 7f0da3cdd640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d9c0cf060 con 0x7f0d9c0d1510 2024-09-15T23:20:49.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.925+0000 7f0da3cdd640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f0d9c0d34c0 con 0x7f0d9c15ea90 2024-09-15T23:20:49.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.925+0000 7f0da3cdd640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0d9c0d1960 con 0x7f0d9c0d40b0 2024-09-15T23:20:49.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.926+0000 7f0da1a79640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0d9c15ea90 0x7f0d9c0d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:49.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.926+0000 7f0da1a79640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0d9c15ea90 0x7f0d9c0d2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36084/0 (socket says 172.21.15.123:36084) 2024-09-15T23:20:49.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.926+0000 7f0da1a79640 1 -- 172.21.15.123:0/2429624194 learned_addr learned my addr 172.21.15.123:0/2429624194 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:49.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.926+0000 7f0da1278640 1 --2- 172.21.15.123:0/2429624194 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d9c0d40b0 0x7f0d9c0d0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:49.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.926+0000 7f0da1a79640 1 -- 172.21.15.123:0/2429624194 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d9c0d40b0 msgr2=0x7f0d9c0d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:49.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.926+0000 7f0da1a79640 1 --2- 172.21.15.123:0/2429624194 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d9c0d40b0 0x7f0d9c0d0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:49.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.926+0000 7f0da1a79640 1 -- 172.21.15.123:0/2429624194 >> v1:172.21.15.188:6789/0 conn(0x7f0d9c0d1510 legacy=0x7f0d9c0b6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:49.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.926+0000 7f0da1a79640 1 -- 172.21.15.123:0/2429624194 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d9c0cf340 con 0x7f0d9c15ea90 2024-09-15T23:20:49.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.926+0000 7f0da1278640 1 --2- 172.21.15.123:0/2429624194 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d9c0d40b0 0x7f0d9c0d0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:49.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.927+0000 7f0da1a79640 1 --2- 172.21.15.123:0/2429624194 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d9c15ea90 0x7f0d9c0d2f80 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f0d98009870 tx=0x7f0d9802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a9a2c9fd56785a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:49.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.927+0000 7f0da0a77640 1 -- 172.21.15.123:0/2429624194 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d98037070 con 0x7f0d9c15ea90 2024-09-15T23:20:49.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.927+0000 7f0da0a77640 1 -- 172.21.15.123:0/2429624194 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d98032440 con 0x7f0d9c15ea90 2024-09-15T23:20:49.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.927+0000 7f0da0a77640 1 -- 172.21.15.123:0/2429624194 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d98032810 con 0x7f0d9c15ea90 2024-09-15T23:20:49.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.928+0000 7f0da3cdd640 1 -- 172.21.15.123:0/2429624194 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d9c15ea90 msgr2=0x7f0d9c0d2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:49.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.928+0000 7f0da3cdd640 1 --2- 172.21.15.123:0/2429624194 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d9c15ea90 0x7f0d9c0d2f80 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f0d98009870 tx=0x7f0d9802a270 comp rx=0 tx=0).stop 2024-09-15T23:20:49.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.928+0000 7f0da3cdd640 1 -- 172.21.15.123:0/2429624194 shutdown_connections 2024-09-15T23:20:49.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.928+0000 7f0da3cdd640 1 --2- 172.21.15.123:0/2429624194 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d9c0d40b0 0x7f0d9c0d0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:49.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.928+0000 7f0da3cdd640 1 --2- 172.21.15.123:0/2429624194 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d9c15ea90 0x7f0d9c0d2f80 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:49.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.928+0000 7f0da3cdd640 1 -- 172.21.15.123:0/2429624194 >> 172.21.15.123:0/2429624194 conn(0x7f0d9c06c0e0 msgr2=0x7f0d9c06c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:49.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.928+0000 7f0da3cdd640 1 -- 172.21.15.123:0/2429624194 shutdown_connections 2024-09-15T23:20:49.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.928+0000 7f0da3cdd640 1 -- 172.21.15.123:0/2429624194 wait complete. 2024-09-15T23:20:49.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.930+0000 7f0da3cdd640 1 Processor -- start 2024-09-15T23:20:49.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.930+0000 7f0da3cdd640 1 -- start start 2024-09-15T23:20:49.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.931+0000 7f0da3cdd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d9c0d1510 0x7f0d9c156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:49.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.931+0000 7f0da3cdd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0d9c0d40b0 0x7f0d9c15b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:49.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.931+0000 7f0da3cdd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d9c15ea90 0x7f0d9c154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:49.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.931+0000 7f0da3cdd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c0cfbe0 con 0x7f0d9c15ea90 2024-09-15T23:20:49.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.931+0000 7f0da3cdd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c0cf900 con 0x7f0d9c0d40b0 2024-09-15T23:20:49.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.931+0000 7f0da3cdd640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0d9c15ee70 con 0x7f0d9c0d1510 2024-09-15T23:20:49.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.931+0000 7f0da227a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d9c15ea90 0x7f0d9c154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:49.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.931+0000 7f0da227a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d9c15ea90 0x7f0d9c154550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36090/0 (socket says 172.21.15.123:36090) 2024-09-15T23:20:49.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.931+0000 7f0da227a640 1 -- 172.21.15.123:0/878336441 learned_addr learned my addr 172.21.15.123:0/878336441 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:49.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.931+0000 7f0da1278640 1 --2- 172.21.15.123:0/878336441 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0d9c0d40b0 0x7f0d9c15b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:49.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.931+0000 7f0da1a79640 1 --2- 172.21.15.123:0/878336441 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d9c0d1510 0x7f0d9c156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:49.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.931+0000 7f0da227a640 1 -- 172.21.15.123:0/878336441 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d9c0d1510 msgr2=0x7f0d9c156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:49.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.931+0000 7f0da227a640 1 --2- 172.21.15.123:0/878336441 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d9c0d1510 0x7f0d9c156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:49.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.931+0000 7f0da227a640 1 -- 172.21.15.123:0/878336441 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0d9c0d40b0 msgr2=0x7f0d9c15b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:49.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.931+0000 7f0da227a640 1 --2- 172.21.15.123:0/878336441 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0d9c0d40b0 0x7f0d9c15b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:49.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.931+0000 7f0da227a640 1 -- 172.21.15.123:0/878336441 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d9c1f4cd0 con 0x7f0d9c15ea90 2024-09-15T23:20:49.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.931+0000 7f0da227a640 1 --2- 172.21.15.123:0/878336441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d9c15ea90 0x7f0d9c154550 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f0d9400c7d0 tx=0x7f0d9400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:49.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.932+0000 7f0d927fc640 1 -- 172.21.15.123:0/878336441 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d94003b70 con 0x7f0d9c15ea90 2024-09-15T23:20:49.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.932+0000 7f0d927fc640 1 -- 172.21.15.123:0/878336441 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d94003d30 con 0x7f0d9c15ea90 2024-09-15T23:20:49.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.932+0000 7f0d927fc640 1 -- 172.21.15.123:0/878336441 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d9400aa90 con 0x7f0d9c15ea90 2024-09-15T23:20:49.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.932+0000 7f0da3cdd640 1 -- 172.21.15.123:0/878336441 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d9c1f4fb0 con 0x7f0d9c15ea90 2024-09-15T23:20:49.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.932+0000 7f0da3cdd640 1 -- 172.21.15.123:0/878336441 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d9c1f5570 con 0x7f0d9c15ea90 2024-09-15T23:20:49.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.933+0000 7f0d927fc640 1 -- 172.21.15.123:0/878336441 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0d9400ac30 con 0x7f0d9c15ea90 2024-09-15T23:20:49.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.934+0000 7f0d927fc640 1 --2- 172.21.15.123:0/878336441 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0d8006c2b0 0x7f0d8006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:49.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.934+0000 7f0d927fc640 1 -- 172.21.15.123:0/878336441 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f0d9408b190 con 0x7f0d9c15ea90 2024-09-15T23:20:49.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.934+0000 7f0da1a79640 1 --2- 172.21.15.123:0/878336441 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0d8006c2b0 0x7f0d8006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:49.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.935+0000 7f0da1a79640 1 --2- 172.21.15.123:0/878336441 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0d8006c2b0 0x7f0d8006e770 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f0d98034000 tx=0x7f0d9802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:49.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.936+0000 7f0da6a7b740 1 Processor -- start 2024-09-15T23:20:49.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.936+0000 7f0da6a7b740 1 -- start start 2024-09-15T23:20:49.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.937+0000 7f0da6a7b740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5650acfbba70 0x5650acfbbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:49.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.937+0000 7f0da6a7b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650acfa21f0 0x5650acfa0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:49.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.937+0000 7f0da6a7b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650acfec420 0x5650acfec970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:49.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.937+0000 7f0da6a7b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5650acf09bc0 con 0x5650acfec420 2024-09-15T23:20:49.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.937+0000 7f0da6a7b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5650aceb1970 con 0x5650acfa21f0 2024-09-15T23:20:49.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.937+0000 7f0da6a7b740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5650acf05b80 con 0x5650acfbba70 2024-09-15T23:20:49.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.937+0000 7f0da227a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650acfec420 0x5650acfec970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:49.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.937+0000 7f0da227a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650acfec420 0x5650acfec970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36092/0 (socket says 172.21.15.123:36092) 2024-09-15T23:20:49.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.937+0000 7f0da227a640 1 -- 172.21.15.123:0/936080859 learned_addr learned my addr 172.21.15.123:0/936080859 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:49.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.937+0000 7f0da1a79640 1 --2- 172.21.15.123:0/936080859 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5650acfbba70 0x5650acfbbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:49.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.937+0000 7f0da1278640 1 --2- 172.21.15.123:0/936080859 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650acfa21f0 0x5650acfa0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:49.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.937+0000 7f0da227a640 1 -- 172.21.15.123:0/936080859 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5650acfbba70 msgr2=0x5650acfbbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:49.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.937+0000 7f0da227a640 1 --2- 172.21.15.123:0/936080859 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5650acfbba70 0x5650acfbbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:49.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.937+0000 7f0da227a640 1 -- 172.21.15.123:0/936080859 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650acfa21f0 msgr2=0x5650acfa0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:49.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.937+0000 7f0da227a640 1 --2- 172.21.15.123:0/936080859 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650acfa21f0 0x5650acfa0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:49.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.937+0000 7f0da227a640 1 -- 172.21.15.123:0/936080859 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650acce8ba0 con 0x5650acfec420 2024-09-15T23:20:49.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.938+0000 7f0da227a640 1 --2- 172.21.15.123:0/936080859 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650acfec420 0x5650acfec970 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f0d940896c0 tx=0x7f0d94011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0e3291adfb67c08 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:49.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.938+0000 7f0d7f7fe640 1 -- 172.21.15.123:0/936080859 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d9405d640 con 0x5650acfec420 2024-09-15T23:20:49.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.938+0000 7f0d7f7fe640 1 -- 172.21.15.123:0/936080859 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d94061e70 con 0x5650acfec420 2024-09-15T23:20:49.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.938+0000 7f0d7f7fe640 1 -- 172.21.15.123:0/936080859 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d94071180 con 0x5650acfec420 2024-09-15T23:20:49.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.939+0000 7f0da6a7b740 1 -- 172.21.15.123:0/936080859 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650acfec420 msgr2=0x5650acfec970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:49.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.939+0000 7f0da6a7b740 1 --2- 172.21.15.123:0/936080859 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650acfec420 0x5650acfec970 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f0d940896c0 tx=0x7f0d94011000 comp rx=0 tx=0).stop 2024-09-15T23:20:49.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.939+0000 7f0da6a7b740 1 -- 172.21.15.123:0/936080859 shutdown_connections 2024-09-15T23:20:49.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.939+0000 7f0da6a7b740 1 --2- 172.21.15.123:0/936080859 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650acfec420 0x5650acfec970 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:49.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.939+0000 7f0da6a7b740 1 --2- 172.21.15.123:0/936080859 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650acfa21f0 0x5650acfa0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:49.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.939+0000 7f0da6a7b740 1 --2- 172.21.15.123:0/936080859 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5650acfbba70 0x5650acfbbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:49.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.939+0000 7f0da6a7b740 1 -- 172.21.15.123:0/936080859 >> 172.21.15.123:0/936080859 conn(0x5650acfa2c20 msgr2=0x5650acfeafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:49.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.939+0000 7f0da6a7b740 1 -- 172.21.15.123:0/936080859 shutdown_connections 2024-09-15T23:20:49.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.939+0000 7f0da6a7b740 1 -- 172.21.15.123:0/936080859 wait complete. 2024-09-15T23:20:49.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.939+0000 7f0da6a7b740 1 -- start start 2024-09-15T23:20:49.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.940+0000 7f0da6a7b740 1 Processor -- start 2024-09-15T23:20:49.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.941+0000 7f0da6a7b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650acfbba70 0x5650acffb280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:49.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.941+0000 7f0da6a7b740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5650acfec420 0x5650acfe0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:49.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.941+0000 7f0da6a7b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650acfe43c0 0x5650acfe3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:49.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.941+0000 7f0da6a7b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5650acfa1150 con 0x5650acfe43c0 2024-09-15T23:20:49.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.941+0000 7f0da6a7b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5650acec4d70 con 0x5650acfbba70 2024-09-15T23:20:49.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.941+0000 7f0da6a7b740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5650acfa1430 con 0x5650acfec420 2024-09-15T23:20:49.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.941+0000 7f0da6a7b740 10 client.0 _ll_register_callbacks cb 0x5650acc1bf80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:20:49.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.941+0000 7f0da227a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650acfe43c0 0x5650acfe3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:49.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.941+0000 7f0da1278640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5650acfec420 0x5650acfe0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:49.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.941+0000 7f0da1a79640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650acfbba70 0x5650acffb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:49.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.941+0000 7f0da227a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650acfe43c0 0x5650acfe3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36094/0 (socket says 172.21.15.123:36094) 2024-09-15T23:20:49.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.941+0000 7f0da227a640 1 -- 172.21.15.123:0/2764395271 learned_addr learned my addr 172.21.15.123:0/2764395271 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:49.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.941+0000 7f0da227a640 1 -- 172.21.15.123:0/2764395271 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5650acfec420 msgr2=0x5650acfe0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:49.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.941+0000 7f0da227a640 1 --2- 172.21.15.123:0/2764395271 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5650acfec420 0x5650acfe0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:49.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.941+0000 7f0da227a640 1 -- 172.21.15.123:0/2764395271 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650acfbba70 msgr2=0x5650acffb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:49.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.941+0000 7f0da227a640 1 --2- 172.21.15.123:0/2764395271 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650acfbba70 0x5650acffb280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:49.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.941+0000 7f0da227a640 1 -- 172.21.15.123:0/2764395271 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650acbdc490 con 0x5650acfe43c0 2024-09-15T23:20:49.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.942+0000 7f0da227a640 1 --2- 172.21.15.123:0/2764395271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650acfe43c0 0x5650acfe3800 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f0d940897a0 tx=0x7f0d94001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=966f1b92d73c9758 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:49.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.942+0000 7f0d7cff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:20:49.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.942+0000 7f0d7cff9640 1 -- 172.21.15.123:0/2764395271 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d94071180 con 0x5650acfe43c0 2024-09-15T23:20:49.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.942+0000 7f0d7cff9640 1 -- 172.21.15.123:0/2764395271 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f0d940559b0 con 0x5650acfe43c0 2024-09-15T23:20:49.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.942+0000 7f0da6a7b740 1 -- 172.21.15.123:0/2764395271 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d94061e70 con 0x5650acfe43c0 2024-09-15T23:20:49.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.942+0000 7f0d7cff9640 1 -- 172.21.15.123:0/2764395271 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f0d9405d1b0 con 0x5650acfe43c0 2024-09-15T23:20:49.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.942+0000 7f0da6a7b740 10 client.9192 fetch_fsmap learned FSMap version 93 2024-09-15T23:20:49.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.942+0000 7f0da6a7b740 1 -- 172.21.15.123:0/2764395271 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) -- 0x5650acd49330 con 0x5650acfe43c0 2024-09-15T23:20:49.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.942+0000 7f0d7cff9640 1 -- 172.21.15.123:0/2764395271 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d94061e70 con 0x5650acfe43c0 2024-09-15T23:20:49.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.942+0000 7f0d7cff9640 1 -- 172.21.15.123:0/2764395271 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 93) ==== 3502+0+0 (secure 0 0 0) 0x7f0d940891e0 con 0x5650acfe43c0 2024-09-15T23:20:49.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.942+0000 7f0da6a7b740 10 client.9192 fetch_fsmap finished waiting for FSMap version 93 2024-09-15T23:20:49.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.942+0000 7f0da6a7b740 10 client.9192 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-15T23:20:49.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.942+0000 7f0da6a7b740 20 client.9192 populate_metadata read hostname 'smithi123' 2024-09-15T23:20:49.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.942+0000 7f0da6a7b740 1 --2- 172.21.15.123:0/2764395271 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x5650acfa3f30 0x5650acfa4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:49.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.942+0000 7f0da6a7b740 4 client.9192 mds_command: new command op to 9006 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:20:49.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.942+0000 7f0da6a7b740 1 -- 172.21.15.123:0/2764395271 --> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5650ace8ec80 con 0x5650acfa3f30 2024-09-15T23:20:49.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.942+0000 7f0da1a79640 1 --2- 172.21.15.123:0/2764395271 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x5650acfa3f30 0x5650acfa4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:49.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.943+0000 7f0d7cff9640 10 client.9192 ms_handle_connect on v2:172.21.15.123:6833/627322542 2024-09-15T23:20:49.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.943+0000 7f0da1a79640 1 --2- 172.21.15.123:0/2764395271 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x5650acfa3f30 0x5650acfa4340 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe8955325a4f4f53 server_cookie=79513ac1a28e06c4 in_seq=0 out_seq=0 2024-09-15T23:20:49.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.944+0000 7f0d7cff9640 1 -- 172.21.15.123:0/2764395271 <== mds.0 v2:172.21.15.123:6833/627322542 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5650ace8ec80 con 0x5650acfa3f30 2024-09-15T23:20:49.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.944+0000 7f0d7cff9640 10 client.9192 handle_command_reply: tid=0 2024-09-15T23:20:49.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.944+0000 7f0da6a7b740 1 client.9192 shutdown 2024-09-15T23:20:49.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.944+0000 7f0da6a7b740 1 -- 172.21.15.123:0/2764395271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650acfe43c0 msgr2=0x5650acfe3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:49.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.944+0000 7f0da6a7b740 1 --2- 172.21.15.123:0/2764395271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650acfe43c0 0x5650acfe3800 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f0d940897a0 tx=0x7f0d94001250 comp rx=0 tx=0).stop 2024-09-15T23:20:49.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.944+0000 7f0da6a7b740 1 -- 172.21.15.123:0/2764395271 shutdown_connections 2024-09-15T23:20:49.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.944+0000 7f0da6a7b740 1 --2- 172.21.15.123:0/2764395271 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x5650acfa3f30 0x5650acfa4340 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:49.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.944+0000 7f0da6a7b740 1 --2- 172.21.15.123:0/2764395271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650acfe43c0 0x5650acfe3800 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:49.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.944+0000 7f0d7cff9640 0 client.9192 ms_handle_reset on v2:172.21.15.123:6833/627322542 2024-09-15T23:20:49.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.944+0000 7f0da6a7b740 1 --2- 172.21.15.123:0/2764395271 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5650acfec420 0x5650acfe0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:49.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.944+0000 7f0da6a7b740 1 --2- 172.21.15.123:0/2764395271 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650acfbba70 0x5650acffb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:49.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.944+0000 7f0da6a7b740 1 -- 172.21.15.123:0/2764395271 >> 172.21.15.123:0/2764395271 conn(0x5650acfa21f0 msgr2=0x5650acfeacd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:49.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.944+0000 7f0da6a7b740 1 -- 172.21.15.123:0/2764395271 shutdown_connections 2024-09-15T23:20:49.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.944+0000 7f0da6a7b740 1 -- 172.21.15.123:0/2764395271 wait complete. 2024-09-15T23:20:49.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.944+0000 7f0da6a7b740 20 client.9192 trim_cache size 0 max 16384 2024-09-15T23:20:49.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.968+0000 7f0da6a7b740 1 Processor -- start 2024-09-15T23:20:49.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.969+0000 7f0da6a7b740 1 -- start start 2024-09-15T23:20:49.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.969+0000 7f0da6a7b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650acfa3f30 0x5650acfeac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:49.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.969+0000 7f0da6a7b740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5650acfbba70 0x5650acfeb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:49.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.969+0000 7f0da6a7b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650acfe43c0 0x5650acffb280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:49.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.969+0000 7f0da6a7b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c200c70 con 0x5650acfa3f30 2024-09-15T23:20:49.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.969+0000 7f0da6a7b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c1ffc70 con 0x5650acfe43c0 2024-09-15T23:20:49.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.969+0000 7f0da6a7b740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0d9c1f8eb0 con 0x5650acfbba70 2024-09-15T23:20:49.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.969+0000 7f0da1a79640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650acfa3f30 0x5650acfeac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:49.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.969+0000 7f0da1a79640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650acfa3f30 0x5650acfeac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36104/0 (socket says 172.21.15.123:36104) 2024-09-15T23:20:49.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.969+0000 7f0da1a79640 1 -- 172.21.15.123:0/277334496 learned_addr learned my addr 172.21.15.123:0/277334496 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:49.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.970+0000 7f0da1278640 1 --2- 172.21.15.123:0/277334496 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5650acfbba70 0x5650acfeb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:49.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.970+0000 7f0da227a640 1 --2- 172.21.15.123:0/277334496 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650acfe43c0 0x5650acffb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:49.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.970+0000 7f0da1a79640 1 -- 172.21.15.123:0/277334496 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5650acfbba70 msgr2=0x5650acfeb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:49.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.970+0000 7f0da1a79640 1 --2- 172.21.15.123:0/277334496 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5650acfbba70 0x5650acfeb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:49.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.970+0000 7f0da1a79640 1 -- 172.21.15.123:0/277334496 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650acfe43c0 msgr2=0x5650acffb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:49.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.970+0000 7f0da1a79640 1 --2- 172.21.15.123:0/277334496 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650acfe43c0 0x5650acffb280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:49.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.970+0000 7f0da1a79640 1 -- 172.21.15.123:0/277334496 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650acbb5550 con 0x5650acfa3f30 2024-09-15T23:20:49.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.970+0000 7f0da1a79640 1 --2- 172.21.15.123:0/277334496 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650acfa3f30 0x5650acfeac30 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f0d98009870 tx=0x7f0d9802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e7efdf5acd29cd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:49.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.970+0000 7f0d7effd640 1 -- 172.21.15.123:0/277334496 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d98037040 con 0x5650acfa3f30 2024-09-15T23:20:49.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.970+0000 7f0d7effd640 1 -- 172.21.15.123:0/277334496 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d98058070 con 0x5650acfa3f30 2024-09-15T23:20:49.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.970+0000 7f0d7effd640 1 -- 172.21.15.123:0/277334496 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d980522f0 con 0x5650acfa3f30 2024-09-15T23:20:49.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.971+0000 7f0da6a7b740 1 -- 172.21.15.123:0/277334496 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650acfa3f30 msgr2=0x5650acfeac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:49.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.971+0000 7f0da6a7b740 1 --2- 172.21.15.123:0/277334496 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650acfa3f30 0x5650acfeac30 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f0d98009870 tx=0x7f0d9802c000 comp rx=0 tx=0).stop 2024-09-15T23:20:49.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.971+0000 7f0da6a7b740 1 -- 172.21.15.123:0/277334496 shutdown_connections 2024-09-15T23:20:49.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.971+0000 7f0da6a7b740 1 --2- 172.21.15.123:0/277334496 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650acfe43c0 0x5650acffb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:49.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.971+0000 7f0da6a7b740 1 --2- 172.21.15.123:0/277334496 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5650acfbba70 0x5650acfeb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:49.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.971+0000 7f0da6a7b740 1 --2- 172.21.15.123:0/277334496 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650acfa3f30 0x5650acfeac30 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:49.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.971+0000 7f0da6a7b740 1 -- 172.21.15.123:0/277334496 >> 172.21.15.123:0/277334496 conn(0x5650acfa21f0 msgr2=0x5650acf9f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:49.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.971+0000 7f0da6a7b740 1 -- 172.21.15.123:0/277334496 shutdown_connections 2024-09-15T23:20:49.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.971+0000 7f0da6a7b740 1 -- 172.21.15.123:0/277334496 wait complete. 2024-09-15T23:20:49.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.971+0000 7f0da6a7b740 1 -- start start 2024-09-15T23:20:49.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.971+0000 7f0da6a7b740 1 Processor -- start 2024-09-15T23:20:49.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.972+0000 7f0da6a7b740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5650acfa3f30 0x5650ad068660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:49.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.972+0000 7f0da6a7b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650acfbba70 0x5650acfcfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:49.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.972+0000 7f0da6a7b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650acfe43c0 0x5650acfd0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:49.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.972+0000 7f0da6a7b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5650acfa0e10 con 0x5650acfbba70 2024-09-15T23:20:49.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.972+0000 7f0da6a7b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0d9c1ff620 con 0x5650acfe43c0 2024-09-15T23:20:49.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.972+0000 7f0da6a7b740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5650acffb320 con 0x5650acfa3f30 2024-09-15T23:20:49.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.972+0000 7f0da6a7b740 10 client.0 _ll_register_callbacks cb 0x7f0d8c009600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:20:49.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.972+0000 7f0da1278640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650acfbba70 0x5650acfcfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:49.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.972+0000 7f0da1278640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650acfbba70 0x5650acfcfef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36106/0 (socket says 172.21.15.123:36106) 2024-09-15T23:20:49.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.972+0000 7f0da1278640 1 -- 172.21.15.123:0/3936914568 learned_addr learned my addr 172.21.15.123:0/3936914568 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:49.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.973+0000 7f0da1a79640 1 --2- 172.21.15.123:0/3936914568 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5650acfa3f30 0x5650ad068660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:49.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.973+0000 7f0da227a640 1 --2- 172.21.15.123:0/3936914568 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650acfe43c0 0x5650acfd0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:49.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.973+0000 7f0da1278640 1 -- 172.21.15.123:0/3936914568 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5650acfa3f30 msgr2=0x5650ad068660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:49.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.973+0000 7f0da1278640 1 --2- 172.21.15.123:0/3936914568 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5650acfa3f30 0x5650ad068660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:49.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.973+0000 7f0da1278640 1 -- 172.21.15.123:0/3936914568 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650acfe43c0 msgr2=0x5650acfd0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:49.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.973+0000 7f0da1278640 1 --2- 172.21.15.123:0/3936914568 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650acfe43c0 0x5650acfd0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:49.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.973+0000 7f0da1278640 1 -- 172.21.15.123:0/3936914568 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650acfeef50 con 0x5650acfbba70 2024-09-15T23:20:49.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.973+0000 7f0da1278640 1 --2- 172.21.15.123:0/3936914568 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650acfbba70 0x5650acfcfef0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c006fd0 tx=0x7f0d8c018b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8977e66017c19bb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:49.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.973+0000 7f0d7cff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:20:49.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.973+0000 7f0d7cff9640 1 -- 172.21.15.123:0/3936914568 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c025060 con 0x5650acfbba70 2024-09-15T23:20:49.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.973+0000 7f0d7cff9640 1 -- 172.21.15.123:0/3936914568 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f0d8c016da0 con 0x5650acfbba70 2024-09-15T23:20:49.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.973+0000 7f0da6a7b740 1 -- 172.21.15.123:0/3936914568 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d98058070 con 0x5650acfbba70 2024-09-15T23:20:49.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.973+0000 7f0d7cff9640 1 -- 172.21.15.123:0/3936914568 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f0d8c02b050 con 0x5650acfbba70 2024-09-15T23:20:49.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.973+0000 7f0da6a7b740 10 client.9198 fetch_fsmap learned FSMap version 93 2024-09-15T23:20:49.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.973+0000 7f0da6a7b740 1 -- 172.21.15.123:0/3936914568 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) -- 0x5650acfea200 con 0x5650acfbba70 2024-09-15T23:20:49.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.973+0000 7f0d7cff9640 1 -- 172.21.15.123:0/3936914568 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d98058070 con 0x5650acfbba70 2024-09-15T23:20:49.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.974+0000 7f0d7cff9640 1 -- 172.21.15.123:0/3936914568 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 93) ==== 3502+0+0 (secure 0 0 0) 0x7f0d8c02e020 con 0x5650acfbba70 2024-09-15T23:20:49.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.974+0000 7f0da6a7b740 10 client.9198 fetch_fsmap finished waiting for FSMap version 93 2024-09-15T23:20:49.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.974+0000 7f0da6a7b740 10 client.9198 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-15T23:20:49.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.974+0000 7f0da6a7b740 20 client.9198 populate_metadata read hostname 'smithi123' 2024-09-15T23:20:49.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.974+0000 7f0da6a7b740 1 --2- 172.21.15.123:0/3936914568 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x5650acfec420 0x5650ad069130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:49.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.974+0000 7f0da6a7b740 4 client.9198 mds_command: new command op to 9006 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-15T23:20:49.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.974+0000 7f0da6a7b740 1 -- 172.21.15.123:0/3936914568 --> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x5650acf172f0 con 0x5650acfec420 2024-09-15T23:20:49.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.974+0000 7f0da1a79640 1 --2- 172.21.15.123:0/3936914568 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x5650acfec420 0x5650ad069130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:49.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.974+0000 7f0d7cff9640 10 client.9198 ms_handle_connect on v2:172.21.15.123:6833/627322542 2024-09-15T23:20:49.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.974+0000 7f0da1a79640 1 --2- 172.21.15.123:0/3936914568 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x5650acfec420 0x5650ad069130 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ee8488a6c45918b server_cookie=77795896216a2027 in_seq=0 out_seq=0 2024-09-15T23:20:49.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.976+0000 7f0d7cff9640 1 -- 172.21.15.123:0/3936914568 <== mds.0 v2:172.21.15.123:6833/627322542 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5650acf172f0 con 0x5650acfec420 2024-09-15T23:20:49.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.976+0000 7f0d7cff9640 10 client.9198 handle_command_reply: tid=0 2024-09-15T23:20:49.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.977+0000 7f0da6a7b740 1 client.9198 shutdown 2024-09-15T23:20:49.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.977+0000 7f0da6a7b740 1 -- 172.21.15.123:0/3936914568 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650acfbba70 msgr2=0x5650acfcfef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:49.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.977+0000 7f0da6a7b740 1 --2- 172.21.15.123:0/3936914568 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650acfbba70 0x5650acfcfef0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c006fd0 tx=0x7f0d8c018b10 comp rx=0 tx=0).stop 2024-09-15T23:20:49.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.977+0000 7f0da6a7b740 1 -- 172.21.15.123:0/3936914568 shutdown_connections 2024-09-15T23:20:49.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.977+0000 7f0da6a7b740 1 --2- 172.21.15.123:0/3936914568 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x5650acfec420 0x5650ad069130 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:49.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.977+0000 7f0da6a7b740 1 --2- 172.21.15.123:0/3936914568 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5650acfe43c0 0x5650acfd0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:49.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.977+0000 7f0da6a7b740 1 --2- 172.21.15.123:0/3936914568 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5650acfbba70 0x5650acfcfef0 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:49.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.977+0000 7f0da6a7b740 1 --2- 172.21.15.123:0/3936914568 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5650acfa3f30 0x5650ad068660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:49.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.977+0000 7f0d7cff9640 0 client.9198 ms_handle_reset on v2:172.21.15.123:6833/627322542 2024-09-15T23:20:49.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.977+0000 7f0da6a7b740 1 -- 172.21.15.123:0/3936914568 >> 172.21.15.123:0/3936914568 conn(0x5650acfa21f0 msgr2=0x5650acfa5230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:49.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.977+0000 7f0da6a7b740 1 -- 172.21.15.123:0/3936914568 shutdown_connections 2024-09-15T23:20:49.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.977+0000 7f0da6a7b740 1 -- 172.21.15.123:0/3936914568 wait complete. 2024-09-15T23:20:49.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.977+0000 7f0da6a7b740 20 client.9198 trim_cache size 0 max 16384 2024-09-15T23:20:49.983 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:20:49.983 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0, 2024-09-15T23:20:49.983 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_tag": "e728e835-cd76-455b-8ca5-3f256e088be1", 2024-09-15T23:20:49.983 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": "asynchronous" 2024-09-15T23:20:49.983 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:20:49.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.978+0000 7f0da3cdd640 1 -- 172.21.15.123:0/878336441 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0d8006c2b0 msgr2=0x7f0d8006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:49.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.978+0000 7f0da3cdd640 1 --2- 172.21.15.123:0/878336441 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0d8006c2b0 0x7f0d8006e770 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f0d98034000 tx=0x7f0d9802e000 comp rx=0 tx=0).stop 2024-09-15T23:20:49.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.978+0000 7f0da3cdd640 1 -- 172.21.15.123:0/878336441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d9c15ea90 msgr2=0x7f0d9c154550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:49.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.978+0000 7f0da3cdd640 1 --2- 172.21.15.123:0/878336441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d9c15ea90 0x7f0d9c154550 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f0d9400c7d0 tx=0x7f0d9400cc90 comp rx=0 tx=0).stop 2024-09-15T23:20:49.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.978+0000 7f0da3cdd640 1 -- 172.21.15.123:0/878336441 shutdown_connections 2024-09-15T23:20:49.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.978+0000 7f0da3cdd640 1 --2- 172.21.15.123:0/878336441 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0d8006c2b0 0x7f0d8006e770 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:49.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.978+0000 7f0da3cdd640 1 --2- 172.21.15.123:0/878336441 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d9c15ea90 0x7f0d9c154550 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:49.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.978+0000 7f0da3cdd640 1 --2- 172.21.15.123:0/878336441 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0d9c0d40b0 0x7f0d9c15b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:49.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.978+0000 7f0da3cdd640 1 --2- 172.21.15.123:0/878336441 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0d9c0d1510 0x7f0d9c156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:49.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.978+0000 7f0da3cdd640 1 -- 172.21.15.123:0/878336441 >> 172.21.15.123:0/878336441 conn(0x7f0d9c06c0e0 msgr2=0x7f0d9c06c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:49.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.978+0000 7f0da3cdd640 1 -- 172.21.15.123:0/878336441 shutdown_connections 2024-09-15T23:20:49.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:49.978+0000 7f0da3cdd640 1 -- 172.21.15.123:0/878336441 wait complete. 2024-09-15T23:20:49.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:20:49.993 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub pause 2024-09-15T23:20:50.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.121+0000 7fd9d1437640 1 Processor -- start 2024-09-15T23:20:50.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.121+0000 7fd9d1437640 1 -- start start 2024-09-15T23:20:50.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.122+0000 7fd9d1437640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd9cc15c7e0 0x7fd9cc06ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.122+0000 7fd9d1437640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd9cc0732d0 0x7fd9cc073720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.122+0000 7fd9d1437640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9cc06f240 con 0x7fd9cc06bc10 2024-09-15T23:20:50.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.122+0000 7fd9d1437640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fd9cc074220 con 0x7fd9cc15c7e0 2024-09-15T23:20:50.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.122+0000 7fd9d1437640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd9cc073f40 con 0x7fd9cc0732d0 2024-09-15T23:20:50.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.123+0000 7fd9cb7fe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd9cc0732d0 0x7fd9cc073720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.123+0000 7fd9caffd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd9cc15c7e0 0x7fd9cc06ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.123+0000 7fd9cb7fe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd9cc0732d0 0x7fd9cc073720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:44534/0 (socket says 172.21.15.123:44534) 2024-09-15T23:20:50.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.123+0000 7fd9caffd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd9cc15c7e0 0x7fd9cc06ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:49960/0 (socket says 172.21.15.123:49960) 2024-09-15T23:20:50.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.123+0000 7fd9cb7fe640 1 -- 172.21.15.123:0/1149720847 learned_addr learned my addr 172.21.15.123:0/1149720847 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:50.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.123+0000 7fd9caffd640 1 -- 172.21.15.123:0/1149720847 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd9cc0732d0 msgr2=0x7fd9cc073720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:50.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.123+0000 7fd9caffd640 1 --2- 172.21.15.123:0/1149720847 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd9cc0732d0 0x7fd9cc073720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.123+0000 7fd9caffd640 1 -- 172.21.15.123:0/1149720847 >> v1:172.21.15.188:6789/0 conn(0x7fd9cc06bc10 legacy=0x7fd9cc06c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:50.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.123+0000 7fd9caffd640 1 -- 172.21.15.123:0/1149720847 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9cc06e220 con 0x7fd9cc15c7e0 2024-09-15T23:20:50.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.123+0000 7fd9cb7fe640 1 --2- 172.21.15.123:0/1149720847 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd9cc0732d0 0x7fd9cc073720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:20:50.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.124+0000 7fd9caffd640 1 --2- 172.21.15.123:0/1149720847 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9cc15c7e0 0x7fd9cc06ed00 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd9b40097a0 tx=0x7fd9b402a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1fde1495daf861b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:50.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.124+0000 7fd9c9ffb640 1 -- 172.21.15.123:0/1149720847 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b4037070 con 0x7fd9cc15c7e0 2024-09-15T23:20:50.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.124+0000 7fd9c9ffb640 1 -- 172.21.15.123:0/1149720847 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9b402ad10 con 0x7fd9cc15c7e0 2024-09-15T23:20:50.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.124+0000 7fd9c9ffb640 1 -- 172.21.15.123:0/1149720847 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b4032660 con 0x7fd9cc15c7e0 2024-09-15T23:20:50.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.124+0000 7fd9d1437640 1 -- 172.21.15.123:0/1149720847 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9cc15c7e0 msgr2=0x7fd9cc06ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:50.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.124+0000 7fd9d1437640 1 --2- 172.21.15.123:0/1149720847 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9cc15c7e0 0x7fd9cc06ed00 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd9b40097a0 tx=0x7fd9b402a080 comp rx=0 tx=0).stop 2024-09-15T23:20:50.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.124+0000 7fd9d1437640 1 -- 172.21.15.123:0/1149720847 shutdown_connections 2024-09-15T23:20:50.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.124+0000 7fd9d1437640 1 --2- 172.21.15.123:0/1149720847 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd9cc0732d0 0x7fd9cc073720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.124+0000 7fd9d1437640 1 --2- 172.21.15.123:0/1149720847 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9cc15c7e0 0x7fd9cc06ed00 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.124+0000 7fd9d1437640 1 -- 172.21.15.123:0/1149720847 >> 172.21.15.123:0/1149720847 conn(0x7fd9cc0d1530 msgr2=0x7fd9cc0d1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:50.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.124+0000 7fd9d1437640 1 -- 172.21.15.123:0/1149720847 shutdown_connections 2024-09-15T23:20:50.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.124+0000 7fd9d1437640 1 -- 172.21.15.123:0/1149720847 wait complete. 2024-09-15T23:20:50.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.126+0000 7fd9d1437640 1 Processor -- start 2024-09-15T23:20:50.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.126+0000 7fd9d1437640 1 -- start start 2024-09-15T23:20:50.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.126+0000 7fd9d1437640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9cc06bc10 0x7fd9cc0cc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.126+0000 7fd9d1437640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd9cc0732d0 0x7fd9cc15b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.126+0000 7fd9d1437640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9cc15c7e0 0x7fd9cc0cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.126+0000 7fd9d1437640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd9cc073c60 con 0x7fd9cc15c7e0 2024-09-15T23:20:50.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.126+0000 7fd9d1437640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd9cc06e7e0 con 0x7fd9cc06bc10 2024-09-15T23:20:50.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.126+0000 7fd9d1437640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd9cc0d22e0 con 0x7fd9cc0732d0 2024-09-15T23:20:50.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.127+0000 7fd9caffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9cc06bc10 0x7fd9cc0cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.127+0000 7fd9ca7fc640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd9cc0732d0 0x7fd9cc15b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.127+0000 7fd9cb7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9cc15c7e0 0x7fd9cc0cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.127+0000 7fd9caffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9cc06bc10 0x7fd9cc0cc150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:49962/0 (socket says 172.21.15.123:49962) 2024-09-15T23:20:50.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.127+0000 7fd9ca7fc640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd9cc0732d0 0x7fd9cc15b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:44538/0 (socket says 172.21.15.123:44538) 2024-09-15T23:20:50.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.127+0000 7fd9caffd640 1 -- 172.21.15.123:0/3217251701 learned_addr learned my addr 172.21.15.123:0/3217251701 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:50.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.127+0000 7fd9cb7fe640 1 -- 172.21.15.123:0/3217251701 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd9cc0732d0 msgr2=0x7fd9cc15b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:50.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.127+0000 7fd9cb7fe640 1 --2- 172.21.15.123:0/3217251701 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd9cc0732d0 0x7fd9cc15b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.127+0000 7fd9cb7fe640 1 -- 172.21.15.123:0/3217251701 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9cc06bc10 msgr2=0x7fd9cc0cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:50.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.127+0000 7fd9cb7fe640 1 --2- 172.21.15.123:0/3217251701 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9cc06bc10 0x7fd9cc0cc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.127+0000 7fd9cb7fe640 1 -- 172.21.15.123:0/3217251701 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9cc1e53a0 con 0x7fd9cc15c7e0 2024-09-15T23:20:50.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.127+0000 7fd9ca7fc640 1 --2- 172.21.15.123:0/3217251701 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd9cc0732d0 0x7fd9cc15b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:20:50.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.127+0000 7fd9caffd640 1 --2- 172.21.15.123:0/3217251701 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9cc06bc10 0x7fd9cc0cc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:20:50.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.127+0000 7fd9cb7fe640 1 --2- 172.21.15.123:0/3217251701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9cc15c7e0 0x7fd9cc0cb0d0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4009e50 tx=0x7fd9c400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:50.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.127+0000 7fd9c37fe640 1 -- 172.21.15.123:0/3217251701 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c400cb80 con 0x7fd9cc15c7e0 2024-09-15T23:20:50.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.127+0000 7fd9c37fe640 1 -- 172.21.15.123:0/3217251701 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9c400cd40 con 0x7fd9cc15c7e0 2024-09-15T23:20:50.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.127+0000 7fd9d1437640 1 -- 172.21.15.123:0/3217251701 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9cc0ca310 con 0x7fd9cc15c7e0 2024-09-15T23:20:50.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.127+0000 7fd9c37fe640 1 -- 172.21.15.123:0/3217251701 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c4003bd0 con 0x7fd9cc15c7e0 2024-09-15T23:20:50.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.127+0000 7fd9d1437640 1 -- 172.21.15.123:0/3217251701 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9cc0ca8d0 con 0x7fd9cc15c7e0 2024-09-15T23:20:50.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.129+0000 7fd9c37fe640 1 -- 172.21.15.123:0/3217251701 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd9c4005d10 con 0x7fd9cc15c7e0 2024-09-15T23:20:50.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.129+0000 7fd9c37fe640 1 --2- 172.21.15.123:0/3217251701 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd9ac06c2b0 0x7fd9ac06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.129+0000 7fd9c37fe640 1 -- 172.21.15.123:0/3217251701 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7fd9c408b4e0 con 0x7fd9cc15c7e0 2024-09-15T23:20:50.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.130+0000 7fd9caffd640 1 --2- 172.21.15.123:0/3217251701 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd9ac06c2b0 0x7fd9ac06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.130+0000 7fd9caffd640 1 --2- 172.21.15.123:0/3217251701 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd9ac06c2b0 0x7fd9ac06e770 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd9b402a0c0 tx=0x7fd9b402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:50.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.130+0000 7fd9d41cf740 1 Processor -- start 2024-09-15T23:20:50.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.130+0000 7fd9d41cf740 1 -- start start 2024-09-15T23:20:50.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.131+0000 7fd9d41cf740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bd4b8135e0 0x55bd4b8139c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.131+0000 7fd9d41cf740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bd4b810da0 0x55bd4b812930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.131+0000 7fd9d41cf740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bd4b811200 0x55bd4b7f3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.131+0000 7fd9d41cf740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55bd4b72f8d0 con 0x55bd4b8135e0 2024-09-15T23:20:50.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.131+0000 7fd9d41cf740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55bd4b6d7620 con 0x55bd4b810da0 2024-09-15T23:20:50.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.131+0000 7fd9d41cf740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55bd4b72b890 con 0x55bd4b811200 2024-09-15T23:20:50.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.131+0000 7fd9caffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bd4b8135e0 0x55bd4b8139c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.131+0000 7fd9caffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bd4b8135e0 0x55bd4b8139c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36120/0 (socket says 172.21.15.123:36120) 2024-09-15T23:20:50.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.131+0000 7fd9caffd640 1 -- 172.21.15.123:0/1192967612 learned_addr learned my addr 172.21.15.123:0/1192967612 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:50.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.131+0000 7fd9ca7fc640 1 --2- 172.21.15.123:0/1192967612 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bd4b810da0 0x55bd4b812930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.131+0000 7fd9cb7fe640 1 --2- 172.21.15.123:0/1192967612 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bd4b811200 0x55bd4b7f3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.131+0000 7fd9caffd640 1 -- 172.21.15.123:0/1192967612 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bd4b811200 msgr2=0x55bd4b7f3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:50.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.131+0000 7fd9caffd640 1 --2- 172.21.15.123:0/1192967612 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bd4b811200 0x55bd4b7f3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.131+0000 7fd9caffd640 1 -- 172.21.15.123:0/1192967612 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bd4b810da0 msgr2=0x55bd4b812930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:50.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.131+0000 7fd9caffd640 1 --2- 172.21.15.123:0/1192967612 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bd4b810da0 0x55bd4b812930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.131+0000 7fd9caffd640 1 -- 172.21.15.123:0/1192967612 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd4b50c7d0 con 0x55bd4b8135e0 2024-09-15T23:20:50.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.131+0000 7fd9cb7fe640 1 --2- 172.21.15.123:0/1192967612 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bd4b811200 0x55bd4b7f3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:20:50.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.131+0000 7fd9ca7fc640 1 --2- 172.21.15.123:0/1192967612 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bd4b810da0 0x55bd4b812930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:20:50.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.132+0000 7fd9caffd640 1 --2- 172.21.15.123:0/1192967612 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bd4b8135e0 0x55bd4b8139c0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4009890 tx=0x7fd9b402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9362e75736fb0885 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:50.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.132+0000 7fd9c0ff9640 1 -- 172.21.15.123:0/1192967612 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b404e070 con 0x55bd4b8135e0 2024-09-15T23:20:50.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.132+0000 7fd9c0ff9640 1 -- 172.21.15.123:0/1192967612 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9b4033b80 con 0x55bd4b8135e0 2024-09-15T23:20:50.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.132+0000 7fd9c0ff9640 1 -- 172.21.15.123:0/1192967612 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b4037040 con 0x55bd4b8135e0 2024-09-15T23:20:50.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.132+0000 7fd9d41cf740 1 -- 172.21.15.123:0/1192967612 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bd4b8135e0 msgr2=0x55bd4b8139c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:50.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.132+0000 7fd9d41cf740 1 --2- 172.21.15.123:0/1192967612 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bd4b8135e0 0x55bd4b8139c0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4009890 tx=0x7fd9b402c000 comp rx=0 tx=0).stop 2024-09-15T23:20:50.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.132+0000 7fd9d41cf740 1 -- 172.21.15.123:0/1192967612 shutdown_connections 2024-09-15T23:20:50.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.132+0000 7fd9d41cf740 1 --2- 172.21.15.123:0/1192967612 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bd4b811200 0x55bd4b7f3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.132+0000 7fd9d41cf740 1 --2- 172.21.15.123:0/1192967612 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bd4b810da0 0x55bd4b812930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.132+0000 7fd9d41cf740 1 --2- 172.21.15.123:0/1192967612 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bd4b8135e0 0x55bd4b8139c0 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.132+0000 7fd9d41cf740 1 -- 172.21.15.123:0/1192967612 >> 172.21.15.123:0/1192967612 conn(0x55bd4b7c9240 msgr2=0x55bd4b811650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:50.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.133+0000 7fd9d41cf740 1 -- 172.21.15.123:0/1192967612 shutdown_connections 2024-09-15T23:20:50.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.133+0000 7fd9d41cf740 1 -- 172.21.15.123:0/1192967612 wait complete. 2024-09-15T23:20:50.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.133+0000 7fd9d41cf740 1 -- start start 2024-09-15T23:20:50.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.133+0000 7fd9d41cf740 1 Processor -- start 2024-09-15T23:20:50.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.134+0000 7fd9d41cf740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bd4b811200 0x55bd4b822320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.134+0000 7fd9d41cf740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bd4b8135e0 0x55bd4b7f13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.134+0000 7fd9d41cf740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bd4b822940 0x55bd4b7f1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.134+0000 7fd9d41cf740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55bd4b80fd00 con 0x55bd4b822940 2024-09-15T23:20:50.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.134+0000 7fd9d41cf740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55bd4b6b8750 con 0x55bd4b811200 2024-09-15T23:20:50.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.134+0000 7fd9d41cf740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55bd4b80ffe0 con 0x55bd4b8135e0 2024-09-15T23:20:50.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.134+0000 7fd9d41cf740 10 client.0 _ll_register_callbacks cb 0x55bd4b6dc780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:20:50.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.134+0000 7fd9cb7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bd4b822940 0x55bd4b7f1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.134+0000 7fd9cb7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bd4b822940 0x55bd4b7f1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36132/0 (socket says 172.21.15.123:36132) 2024-09-15T23:20:50.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.134+0000 7fd9cb7fe640 1 -- 172.21.15.123:0/2743294762 learned_addr learned my addr 172.21.15.123:0/2743294762 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:50.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.134+0000 7fd9caffd640 1 --2- 172.21.15.123:0/2743294762 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bd4b811200 0x55bd4b822320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.134+0000 7fd9ca7fc640 1 --2- 172.21.15.123:0/2743294762 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bd4b8135e0 0x55bd4b7f13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.134+0000 7fd9cb7fe640 1 -- 172.21.15.123:0/2743294762 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bd4b8135e0 msgr2=0x55bd4b7f13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:50.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.134+0000 7fd9cb7fe640 1 --2- 172.21.15.123:0/2743294762 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bd4b8135e0 0x55bd4b7f13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.134+0000 7fd9cb7fe640 1 -- 172.21.15.123:0/2743294762 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bd4b811200 msgr2=0x55bd4b822320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:50.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.134+0000 7fd9cb7fe640 1 --2- 172.21.15.123:0/2743294762 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bd4b811200 0x55bd4b822320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.134+0000 7fd9cb7fe640 1 -- 172.21.15.123:0/2743294762 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd4b4020f0 con 0x55bd4b822940 2024-09-15T23:20:50.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.134+0000 7fd9cb7fe640 1 --2- 172.21.15.123:0/2743294762 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bd4b822940 0x55bd4b7f1e30 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4089a10 tx=0x7fd9c4059290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad8fdc51c9562347 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:50.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.134+0000 7fd9a9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:20:50.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.135+0000 7fd9a9ffb640 1 -- 172.21.15.123:0/2743294762 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c408b270 con 0x55bd4b822940 2024-09-15T23:20:50.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.135+0000 7fd9a9ffb640 1 -- 172.21.15.123:0/2743294762 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7fd9c4058ae0 con 0x55bd4b822940 2024-09-15T23:20:50.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.135+0000 7fd9d41cf740 1 -- 172.21.15.123:0/2743294762 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9b4033b80 con 0x55bd4b822940 2024-09-15T23:20:50.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.135+0000 7fd9a9ffb640 1 -- 172.21.15.123:0/2743294762 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7fd9c40621c0 con 0x55bd4b822940 2024-09-15T23:20:50.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.135+0000 7fd9d41cf740 10 client.9207 fetch_fsmap learned FSMap version 93 2024-09-15T23:20:50.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.135+0000 7fd9d41cf740 1 -- 172.21.15.123:0/2743294762 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) -- 0x55bd4b56cf60 con 0x55bd4b822940 2024-09-15T23:20:50.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.135+0000 7fd9a9ffb640 1 -- 172.21.15.123:0/2743294762 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9b4033b80 con 0x55bd4b822940 2024-09-15T23:20:50.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.135+0000 7fd9a9ffb640 1 -- 172.21.15.123:0/2743294762 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 93) ==== 3502+0+0 (secure 0 0 0) 0x7fd9c405eb20 con 0x55bd4b822940 2024-09-15T23:20:50.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.135+0000 7fd9d41cf740 10 client.9207 fetch_fsmap finished waiting for FSMap version 93 2024-09-15T23:20:50.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.135+0000 7fd9d41cf740 10 client.9207 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-15T23:20:50.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.135+0000 7fd9d41cf740 20 client.9207 populate_metadata read hostname 'smithi123' 2024-09-15T23:20:50.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.135+0000 7fd9d41cf740 1 --2- 172.21.15.123:0/2743294762 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55bd4b824150 0x55bd4b824560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.135+0000 7fd9d41cf740 4 client.9207 mds_command: new command op to 9006 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:20:50.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.135+0000 7fd9d41cf740 1 -- 172.21.15.123:0/2743294762 --> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bd4b73d000 con 0x55bd4b824150 2024-09-15T23:20:50.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.135+0000 7fd9caffd640 1 --2- 172.21.15.123:0/2743294762 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55bd4b824150 0x55bd4b824560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.135+0000 7fd9a9ffb640 10 client.9207 ms_handle_connect on v2:172.21.15.123:6833/627322542 2024-09-15T23:20:50.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.135+0000 7fd9caffd640 1 --2- 172.21.15.123:0/2743294762 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55bd4b824150 0x55bd4b824560 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5eafc43ed03c5eef server_cookie=acac8284b0aa461c in_seq=0 out_seq=0 2024-09-15T23:20:50.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.136+0000 7fd9a9ffb640 1 -- 172.21.15.123:0/2743294762 <== mds.0 v2:172.21.15.123:6833/627322542 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bd4b73d000 con 0x55bd4b824150 2024-09-15T23:20:50.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.136+0000 7fd9a9ffb640 10 client.9207 handle_command_reply: tid=0 2024-09-15T23:20:50.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.136+0000 7fd9d41cf740 1 client.9207 shutdown 2024-09-15T23:20:50.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.136+0000 7fd9d41cf740 1 -- 172.21.15.123:0/2743294762 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bd4b822940 msgr2=0x55bd4b7f1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:50.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.136+0000 7fd9d41cf740 1 --2- 172.21.15.123:0/2743294762 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bd4b822940 0x55bd4b7f1e30 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4089a10 tx=0x7fd9c4059290 comp rx=0 tx=0).stop 2024-09-15T23:20:50.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.136+0000 7fd9d41cf740 1 -- 172.21.15.123:0/2743294762 shutdown_connections 2024-09-15T23:20:50.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.136+0000 7fd9d41cf740 1 --2- 172.21.15.123:0/2743294762 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55bd4b824150 0x55bd4b824560 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.136+0000 7fd9d41cf740 1 --2- 172.21.15.123:0/2743294762 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bd4b822940 0x55bd4b7f1e30 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.136+0000 7fd9d41cf740 1 --2- 172.21.15.123:0/2743294762 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bd4b8135e0 0x55bd4b7f13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.136+0000 7fd9a9ffb640 0 client.9207 ms_handle_reset on v2:172.21.15.123:6833/627322542 2024-09-15T23:20:50.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.136+0000 7fd9d41cf740 1 --2- 172.21.15.123:0/2743294762 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bd4b811200 0x55bd4b822320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.136+0000 7fd9d41cf740 1 -- 172.21.15.123:0/2743294762 >> 172.21.15.123:0/2743294762 conn(0x55bd4b810da0 msgr2=0x55bd4b811620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:50.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.136+0000 7fd9d41cf740 1 -- 172.21.15.123:0/2743294762 shutdown_connections 2024-09-15T23:20:50.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.136+0000 7fd9d41cf740 1 -- 172.21.15.123:0/2743294762 wait complete. 2024-09-15T23:20:50.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.136+0000 7fd9d41cf740 20 client.9207 trim_cache size 0 max 16384 2024-09-15T23:20:50.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.153+0000 7fd9d41cf740 1 Processor -- start 2024-09-15T23:20:50.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.153+0000 7fd9d41cf740 1 -- start start 2024-09-15T23:20:50.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.154+0000 7fd9d41cf740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bd4b811200 0x55bd4b7f0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.154+0000 7fd9d41cf740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bd4b8135e0 0x55bd4b7c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.154+0000 7fd9d41cf740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bd4b822940 0x55bd4b8356a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.154+0000 7fd9d41cf740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd9cc1fe9b0 con 0x55bd4b8135e0 2024-09-15T23:20:50.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.154+0000 7fd9d41cf740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd9cc0c9440 con 0x55bd4b822940 2024-09-15T23:20:50.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.154+0000 7fd9d41cf740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd9cc0c87a0 con 0x55bd4b811200 2024-09-15T23:20:50.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.154+0000 7fd9ca7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bd4b8135e0 0x55bd4b7c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.154+0000 7fd9ca7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bd4b8135e0 0x55bd4b7c69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36148/0 (socket says 172.21.15.123:36148) 2024-09-15T23:20:50.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.154+0000 7fd9ca7fc640 1 -- 172.21.15.123:0/965708642 learned_addr learned my addr 172.21.15.123:0/965708642 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:50.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.154+0000 7fd9caffd640 1 --2- 172.21.15.123:0/965708642 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bd4b811200 0x55bd4b7f0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.154+0000 7fd9cb7fe640 1 --2- 172.21.15.123:0/965708642 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bd4b822940 0x55bd4b8356a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.154+0000 7fd9ca7fc640 1 -- 172.21.15.123:0/965708642 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bd4b811200 msgr2=0x55bd4b7f0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:50.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.154+0000 7fd9ca7fc640 1 --2- 172.21.15.123:0/965708642 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bd4b811200 0x55bd4b7f0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.154+0000 7fd9ca7fc640 1 -- 172.21.15.123:0/965708642 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bd4b822940 msgr2=0x55bd4b8356a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:50.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.154+0000 7fd9ca7fc640 1 --2- 172.21.15.123:0/965708642 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bd4b822940 0x55bd4b8356a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.154+0000 7fd9ca7fc640 1 -- 172.21.15.123:0/965708642 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd4b3db1b0 con 0x55bd4b8135e0 2024-09-15T23:20:50.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.154+0000 7fd9caffd640 1 --2- 172.21.15.123:0/965708642 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bd4b811200 0x55bd4b7f0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:50.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.154+0000 7fd9cb7fe640 1 --2- 172.21.15.123:0/965708642 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bd4b822940 0x55bd4b8356a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:50.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.154+0000 7fd9ca7fc640 1 --2- 172.21.15.123:0/965708642 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bd4b8135e0 0x55bd4b7c69a0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc005050 tx=0x7fd9bc007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c55211220880b4b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:50.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.154+0000 7fd9abfff640 1 -- 172.21.15.123:0/965708642 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc003cd0 con 0x55bd4b8135e0 2024-09-15T23:20:50.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.154+0000 7fd9abfff640 1 -- 172.21.15.123:0/965708642 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9bc003e70 con 0x55bd4b8135e0 2024-09-15T23:20:50.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.154+0000 7fd9abfff640 1 -- 172.21.15.123:0/965708642 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc004220 con 0x55bd4b8135e0 2024-09-15T23:20:50.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.155+0000 7fd9d41cf740 1 -- 172.21.15.123:0/965708642 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bd4b8135e0 msgr2=0x55bd4b7c69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:50.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.155+0000 7fd9d41cf740 1 --2- 172.21.15.123:0/965708642 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bd4b8135e0 0x55bd4b7c69a0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc005050 tx=0x7fd9bc007e30 comp rx=0 tx=0).stop 2024-09-15T23:20:50.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.155+0000 7fd9d41cf740 1 -- 172.21.15.123:0/965708642 shutdown_connections 2024-09-15T23:20:50.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.155+0000 7fd9d41cf740 1 --2- 172.21.15.123:0/965708642 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bd4b822940 0x55bd4b8356a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.155+0000 7fd9d41cf740 1 --2- 172.21.15.123:0/965708642 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bd4b8135e0 0x55bd4b7c69a0 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.155+0000 7fd9d41cf740 1 --2- 172.21.15.123:0/965708642 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bd4b811200 0x55bd4b7f0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.155+0000 7fd9d41cf740 1 -- 172.21.15.123:0/965708642 >> 172.21.15.123:0/965708642 conn(0x55bd4b810da0 msgr2=0x55bd4b7c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:50.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.155+0000 7fd9d41cf740 1 -- 172.21.15.123:0/965708642 shutdown_connections 2024-09-15T23:20:50.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.155+0000 7fd9d41cf740 1 -- 172.21.15.123:0/965708642 wait complete. 2024-09-15T23:20:50.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.155+0000 7fd9d41cf740 1 -- start start 2024-09-15T23:20:50.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.155+0000 7fd9d41cf740 1 Processor -- start 2024-09-15T23:20:50.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.156+0000 7fd9d41cf740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bd4b811200 0x55bd4b807670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.156+0000 7fd9d41cf740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bd4b8135e0 0x55bd4b885a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.156+0000 7fd9d41cf740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bd4b822940 0x55bd4b7c7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.156+0000 7fd9d41cf740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55bd4b80e990 con 0x55bd4b8135e0 2024-09-15T23:20:50.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.156+0000 7fd9d41cf740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd9cc0c8df0 con 0x55bd4b822940 2024-09-15T23:20:50.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.156+0000 7fd9d41cf740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55bd4b7ca110 con 0x55bd4b811200 2024-09-15T23:20:50.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.156+0000 7fd9d41cf740 10 client.0 _ll_register_callbacks cb 0x7fd9c4059460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:20:50.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.156+0000 7fd9ca7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bd4b8135e0 0x55bd4b885a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.156+0000 7fd9ca7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bd4b8135e0 0x55bd4b885a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36158/0 (socket says 172.21.15.123:36158) 2024-09-15T23:20:50.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.156+0000 7fd9ca7fc640 1 -- 172.21.15.123:0/2830645508 learned_addr learned my addr 172.21.15.123:0/2830645508 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:50.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.156+0000 7fd9cb7fe640 1 --2- 172.21.15.123:0/2830645508 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bd4b822940 0x55bd4b7c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.156+0000 7fd9caffd640 1 --2- 172.21.15.123:0/2830645508 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bd4b811200 0x55bd4b807670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.157+0000 7fd9ca7fc640 1 -- 172.21.15.123:0/2830645508 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bd4b811200 msgr2=0x55bd4b807670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:50.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.157+0000 7fd9ca7fc640 1 --2- 172.21.15.123:0/2830645508 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bd4b811200 0x55bd4b807670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.157+0000 7fd9ca7fc640 1 -- 172.21.15.123:0/2830645508 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bd4b822940 msgr2=0x55bd4b7c7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:50.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.157+0000 7fd9ca7fc640 1 --2- 172.21.15.123:0/2830645508 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bd4b822940 0x55bd4b7c7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.157+0000 7fd9ca7fc640 1 -- 172.21.15.123:0/2830645508 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd4b806c80 con 0x55bd4b8135e0 2024-09-15T23:20:50.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.157+0000 7fd9ca7fc640 1 --2- 172.21.15.123:0/2830645508 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bd4b8135e0 0x55bd4b885a90 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc018040 tx=0x7fd9bc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21de9b7233e4eafe server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:50.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.157+0000 7fd9a9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:20:50.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.157+0000 7fd9a9ffb640 1 -- 172.21.15.123:0/2830645508 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc0069b0 con 0x55bd4b8135e0 2024-09-15T23:20:50.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.157+0000 7fd9a9ffb640 1 -- 172.21.15.123:0/2830645508 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7fd9bc006b50 con 0x55bd4b8135e0 2024-09-15T23:20:50.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.157+0000 7fd9d41cf740 1 -- 172.21.15.123:0/2830645508 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9bc003e70 con 0x55bd4b8135e0 2024-09-15T23:20:50.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.157+0000 7fd9a9ffb640 1 -- 172.21.15.123:0/2830645508 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7fd9bc006d50 con 0x55bd4b8135e0 2024-09-15T23:20:50.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.157+0000 7fd9d41cf740 10 client.9213 fetch_fsmap learned FSMap version 93 2024-09-15T23:20:50.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.157+0000 7fd9d41cf740 1 -- 172.21.15.123:0/2830645508 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) -- 0x55bd4b885fd0 con 0x55bd4b8135e0 2024-09-15T23:20:50.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.157+0000 7fd9a9ffb640 1 -- 172.21.15.123:0/2830645508 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9bc003e70 con 0x55bd4b8135e0 2024-09-15T23:20:50.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.157+0000 7fd9a9ffb640 1 -- 172.21.15.123:0/2830645508 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 93) ==== 3502+0+0 (secure 0 0 0) 0x7fd9bc02b470 con 0x55bd4b8135e0 2024-09-15T23:20:50.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.157+0000 7fd9d41cf740 10 client.9213 fetch_fsmap finished waiting for FSMap version 93 2024-09-15T23:20:50.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.157+0000 7fd9d41cf740 10 client.9213 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-15T23:20:50.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.157+0000 7fd9d41cf740 20 client.9213 populate_metadata read hostname 'smithi123' 2024-09-15T23:20:50.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.157+0000 7fd9d41cf740 1 --2- 172.21.15.123:0/2830645508 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55bd4b821cb0 0x55bd4b7c7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.157+0000 7fd9d41cf740 4 client.9213 mds_command: new command op to 9006 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-15T23:20:50.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.157+0000 7fd9d41cf740 1 -- 172.21.15.123:0/2830645508 --> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x55bd4b737350 con 0x55bd4b821cb0 2024-09-15T23:20:50.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.157+0000 7fd9caffd640 1 --2- 172.21.15.123:0/2830645508 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55bd4b821cb0 0x55bd4b7c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.158+0000 7fd9caffd640 1 --2- 172.21.15.123:0/2830645508 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55bd4b821cb0 0x55bd4b7c7860 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30b231c942fd35ff server_cookie=87fb0566c2555a27 in_seq=0 out_seq=0 2024-09-15T23:20:50.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.158+0000 7fd9a9ffb640 10 client.9213 ms_handle_connect on v2:172.21.15.123:6833/627322542 2024-09-15T23:20:50.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.158+0000 7fd9a9ffb640 1 -- 172.21.15.123:0/2830645508 <== mds.0 v2:172.21.15.123:6833/627322542 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bd4b737350 con 0x55bd4b821cb0 2024-09-15T23:20:50.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.158+0000 7fd9a9ffb640 10 client.9213 handle_command_reply: tid=0 2024-09-15T23:20:50.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.158+0000 7fd9d41cf740 1 client.9213 shutdown 2024-09-15T23:20:50.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.158+0000 7fd9d41cf740 1 -- 172.21.15.123:0/2830645508 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bd4b8135e0 msgr2=0x55bd4b885a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:50.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.158+0000 7fd9d41cf740 1 --2- 172.21.15.123:0/2830645508 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bd4b8135e0 0x55bd4b885a90 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc018040 tx=0x7fd9bc000bc0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.158+0000 7fd9d41cf740 1 -- 172.21.15.123:0/2830645508 shutdown_connections 2024-09-15T23:20:50.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.158+0000 7fd9d41cf740 1 --2- 172.21.15.123:0/2830645508 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55bd4b821cb0 0x55bd4b7c7860 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.158+0000 7fd9d41cf740 1 --2- 172.21.15.123:0/2830645508 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55bd4b822940 0x55bd4b7c7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.158+0000 7fd9a9ffb640 0 client.9213 ms_handle_reset on v2:172.21.15.123:6833/627322542 2024-09-15T23:20:50.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.158+0000 7fd9d41cf740 1 --2- 172.21.15.123:0/2830645508 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55bd4b8135e0 0x55bd4b885a90 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.158+0000 7fd9d41cf740 1 --2- 172.21.15.123:0/2830645508 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55bd4b811200 0x55bd4b807670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.158+0000 7fd9d41cf740 1 -- 172.21.15.123:0/2830645508 >> 172.21.15.123:0/2830645508 conn(0x55bd4b810da0 msgr2=0x55bd4b812750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:50.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.158+0000 7fd9d41cf740 1 -- 172.21.15.123:0/2830645508 shutdown_connections 2024-09-15T23:20:50.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.158+0000 7fd9d41cf740 1 -- 172.21.15.123:0/2830645508 wait complete. 2024-09-15T23:20:50.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.158+0000 7fd9d41cf740 20 client.9213 trim_cache size 0 max 16384 2024-09-15T23:20:50.167 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:20:50.167 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "", 2024-09-15T23:20:50.167 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0 2024-09-15T23:20:50.167 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:20:50.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.159+0000 7fd9d1437640 1 -- 172.21.15.123:0/3217251701 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd9ac06c2b0 msgr2=0x7fd9ac06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:50.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.159+0000 7fd9d1437640 1 --2- 172.21.15.123:0/3217251701 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd9ac06c2b0 0x7fd9ac06e770 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd9b402a0c0 tx=0x7fd9b402e000 comp rx=0 tx=0).stop 2024-09-15T23:20:50.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.159+0000 7fd9d1437640 1 -- 172.21.15.123:0/3217251701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9cc15c7e0 msgr2=0x7fd9cc0cb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:50.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.159+0000 7fd9d1437640 1 --2- 172.21.15.123:0/3217251701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9cc15c7e0 0x7fd9cc0cb0d0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4009e50 tx=0x7fd9c400c490 comp rx=0 tx=0).stop 2024-09-15T23:20:50.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.159+0000 7fd9d1437640 1 -- 172.21.15.123:0/3217251701 shutdown_connections 2024-09-15T23:20:50.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.159+0000 7fd9d1437640 1 --2- 172.21.15.123:0/3217251701 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd9ac06c2b0 0x7fd9ac06e770 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.159+0000 7fd9d1437640 1 --2- 172.21.15.123:0/3217251701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9cc15c7e0 0x7fd9cc0cb0d0 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.159+0000 7fd9d1437640 1 --2- 172.21.15.123:0/3217251701 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd9cc0732d0 0x7fd9cc15b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.159+0000 7fd9d1437640 1 --2- 172.21.15.123:0/3217251701 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd9cc06bc10 0x7fd9cc0cc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.159+0000 7fd9d1437640 1 -- 172.21.15.123:0/3217251701 >> 172.21.15.123:0/3217251701 conn(0x7fd9cc0d1530 msgr2=0x7fd9cc0b6a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:50.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.159+0000 7fd9d1437640 1 -- 172.21.15.123:0/3217251701 shutdown_connections 2024-09-15T23:20:50.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.159+0000 7fd9d1437640 1 -- 172.21.15.123:0/3217251701 wait complete. 2024-09-15T23:20:50.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:20:50.170 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub status 2024-09-15T23:20:50.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.269+0000 7f7e48eba640 1 Processor -- start 2024-09-15T23:20:50.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.269+0000 7f7e48eba640 1 -- start start 2024-09-15T23:20:50.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.270+0000 7f7e48eba640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7e440b3350 0x7f7e440d2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.270+0000 7f7e48eba640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7e440b38a0 0x7f7e440d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.270+0000 7f7e48eba640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e440cf710 con 0x7f7e4406bfd0 2024-09-15T23:20:50.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.270+0000 7f7e48eba640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f7e440b78a0 con 0x7f7e440b38a0 2024-09-15T23:20:50.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.270+0000 7f7e48eba640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f7e440cffb0 con 0x7f7e440b3350 2024-09-15T23:20:50.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.270+0000 7f7e42d9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7e440b38a0 0x7f7e440d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.271+0000 7f7e42d9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7e440b38a0 0x7f7e440d2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36160/0 (socket says 172.21.15.123:36160) 2024-09-15T23:20:50.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.271+0000 7f7e42d9d640 1 -- 172.21.15.123:0/1183883054 learned_addr learned my addr 172.21.15.123:0/1183883054 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:50.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.271+0000 7f7e41d9b640 1 --2- 172.21.15.123:0/1183883054 >> v2:172.21.15.188:3300/0 conn(0x7f7e440b3350 0x7f7e440d2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.271+0000 7f7e42d9d640 1 -- 172.21.15.123:0/1183883054 >> v2:172.21.15.188:3300/0 conn(0x7f7e440b3350 msgr2=0x7f7e440d2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:50.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.271+0000 7f7e42d9d640 1 --2- 172.21.15.123:0/1183883054 >> v2:172.21.15.188:3300/0 conn(0x7f7e440b3350 0x7f7e440d2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.271+0000 7f7e42d9d640 1 -- 172.21.15.123:0/1183883054 >> v1:172.21.15.188:6789/0 conn(0x7f7e4406bfd0 legacy=0x7f7e4406c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:50.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.271+0000 7f7e42d9d640 1 -- 172.21.15.123:0/1183883054 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e440cf9f0 con 0x7f7e440b38a0 2024-09-15T23:20:50.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.272+0000 7f7e42d9d640 1 --2- 172.21.15.123:0/1183883054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e440b38a0 0x7f7e440d2e60 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f7e440d05e0 tx=0x7f7e3c02a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d78ac63c552d21 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:50.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.272+0000 7f7e4159a640 1 -- 172.21.15.123:0/1183883054 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c037070 con 0x7f7e440b38a0 2024-09-15T23:20:50.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.272+0000 7f7e4159a640 1 -- 172.21.15.123:0/1183883054 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e3c032640 con 0x7f7e440b38a0 2024-09-15T23:20:50.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.272+0000 7f7e4159a640 1 -- 172.21.15.123:0/1183883054 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c032a10 con 0x7f7e440b38a0 2024-09-15T23:20:50.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.272+0000 7f7e48eba640 1 -- 172.21.15.123:0/1183883054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e440b38a0 msgr2=0x7f7e440d2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:50.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.272+0000 7f7e48eba640 1 --2- 172.21.15.123:0/1183883054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e440b38a0 0x7f7e440d2e60 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f7e440d05e0 tx=0x7f7e3c02a330 comp rx=0 tx=0).stop 2024-09-15T23:20:50.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.272+0000 7f7e48eba640 1 -- 172.21.15.123:0/1183883054 shutdown_connections 2024-09-15T23:20:50.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.272+0000 7f7e48eba640 1 --2- 172.21.15.123:0/1183883054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e440b38a0 0x7f7e440d2e60 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.272+0000 7f7e48eba640 1 --2- 172.21.15.123:0/1183883054 >> v2:172.21.15.188:3300/0 conn(0x7f7e440b3350 0x7f7e440d2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.272+0000 7f7e48eba640 1 -- 172.21.15.123:0/1183883054 >> 172.21.15.123:0/1183883054 conn(0x7f7e440d11c0 msgr2=0x7f7e440d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:50.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.272+0000 7f7e48eba640 1 -- 172.21.15.123:0/1183883054 shutdown_connections 2024-09-15T23:20:50.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.272+0000 7f7e48eba640 1 -- 172.21.15.123:0/1183883054 wait complete. 2024-09-15T23:20:50.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.274+0000 7f7e48eba640 1 Processor -- start 2024-09-15T23:20:50.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.274+0000 7f7e48eba640 1 -- start start 2024-09-15T23:20:50.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.274+0000 7f7e48eba640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7e4406bfd0 0x7f7e44153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.274+0000 7f7e48eba640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7e440b3350 0x7f7e440ca280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.274+0000 7f7e48eba640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e440b38a0 0x7f7e44159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.274+0000 7f7e48eba640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7e4406cd50 con 0x7f7e440b38a0 2024-09-15T23:20:50.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.274+0000 7f7e48eba640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7e440d2400 con 0x7f7e440b3350 2024-09-15T23:20:50.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.274+0000 7f7e48eba640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7e4415eae0 con 0x7f7e4406bfd0 2024-09-15T23:20:50.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.275+0000 7f7e42d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e440b38a0 0x7f7e44159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.275+0000 7f7e42d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e440b38a0 0x7f7e44159eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36166/0 (socket says 172.21.15.123:36166) 2024-09-15T23:20:50.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.275+0000 7f7e42d9d640 1 -- 172.21.15.123:0/316219929 learned_addr learned my addr 172.21.15.123:0/316219929 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:50.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.275+0000 7f7e41d9b640 1 --2- 172.21.15.123:0/316219929 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7e440b3350 0x7f7e440ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.275+0000 7f7e4259c640 1 --2- 172.21.15.123:0/316219929 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7e4406bfd0 0x7f7e44153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.275+0000 7f7e42d9d640 1 -- 172.21.15.123:0/316219929 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7e4406bfd0 msgr2=0x7f7e44153550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:50.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.275+0000 7f7e42d9d640 1 --2- 172.21.15.123:0/316219929 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7e4406bfd0 0x7f7e44153550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.275+0000 7f7e42d9d640 1 -- 172.21.15.123:0/316219929 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7e440b3350 msgr2=0x7f7e440ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:50.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.275+0000 7f7e42d9d640 1 --2- 172.21.15.123:0/316219929 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7e440b3350 0x7f7e440ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.275+0000 7f7e42d9d640 1 -- 172.21.15.123:0/316219929 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e44153a90 con 0x7f7e440b38a0 2024-09-15T23:20:50.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.275+0000 7f7e42d9d640 1 --2- 172.21.15.123:0/316219929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e440b38a0 0x7f7e44159eb0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c02a370 tx=0x7f7e3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:50.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.275+0000 7f7e3affd640 1 -- 172.21.15.123:0/316219929 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c041070 con 0x7f7e440b38a0 2024-09-15T23:20:50.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.275+0000 7f7e3affd640 1 -- 172.21.15.123:0/316219929 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e3c03c870 con 0x7f7e440b38a0 2024-09-15T23:20:50.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.275+0000 7f7e3affd640 1 -- 172.21.15.123:0/316219929 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c037040 con 0x7f7e440b38a0 2024-09-15T23:20:50.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.275+0000 7f7e48eba640 1 -- 172.21.15.123:0/316219929 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e440cabd0 con 0x7f7e440b38a0 2024-09-15T23:20:50.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.275+0000 7f7e48eba640 1 -- 172.21.15.123:0/316219929 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e440cb190 con 0x7f7e440b38a0 2024-09-15T23:20:50.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.277+0000 7f7e3affd640 1 -- 172.21.15.123:0/316219929 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7e3c044070 con 0x7f7e440b38a0 2024-09-15T23:20:50.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.278+0000 7f7e3affd640 1 --2- 172.21.15.123:0/316219929 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7e2406c2e0 0x7f7e2406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.278+0000 7f7e3affd640 1 -- 172.21.15.123:0/316219929 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f7e3c0abcd0 con 0x7f7e440b38a0 2024-09-15T23:20:50.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.278+0000 7f7e4259c640 1 --2- 172.21.15.123:0/316219929 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7e2406c2e0 0x7f7e2406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.278+0000 7f7e4259c640 1 --2- 172.21.15.123:0/316219929 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7e2406c2e0 0x7f7e2406e7a0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f7e34001f10 tx=0x7f7e34009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:50.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.278+0000 7f7e4bc58740 1 Processor -- start 2024-09-15T23:20:50.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.279+0000 7f7e4bc58740 1 -- start start 2024-09-15T23:20:50.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.279+0000 7f7e4bc58740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5631880ac920 0x5631880f20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.279+0000 7f7e4bc58740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631880aa0e0 0x5631880acd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.279+0000 7f7e4bc58740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5631880ae0b0 0x5631880a71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.279+0000 7f7e4bc58740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56318800f6f0 con 0x5631880ae0b0 2024-09-15T23:20:50.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.279+0000 7f7e4bc58740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x563187fb7330 con 0x5631880aa0e0 2024-09-15T23:20:50.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.279+0000 7f7e4bc58740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x56318800b6b0 con 0x5631880ac920 2024-09-15T23:20:50.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.279+0000 7f7e42d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5631880ae0b0 0x5631880a71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.279+0000 7f7e42d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5631880ae0b0 0x5631880a71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36176/0 (socket says 172.21.15.123:36176) 2024-09-15T23:20:50.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.279+0000 7f7e42d9d640 1 -- 172.21.15.123:0/1654568966 learned_addr learned my addr 172.21.15.123:0/1654568966 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:50.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.279+0000 7f7e4259c640 1 --2- 172.21.15.123:0/1654568966 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5631880ac920 0x5631880f20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.279+0000 7f7e41d9b640 1 --2- 172.21.15.123:0/1654568966 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631880aa0e0 0x5631880acd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.280+0000 7f7e42d9d640 1 -- 172.21.15.123:0/1654568966 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5631880ac920 msgr2=0x5631880f20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:50.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.280+0000 7f7e42d9d640 1 --2- 172.21.15.123:0/1654568966 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5631880ac920 0x5631880f20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.280+0000 7f7e42d9d640 1 -- 172.21.15.123:0/1654568966 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631880aa0e0 msgr2=0x5631880acd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:50.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.280+0000 7f7e42d9d640 1 --2- 172.21.15.123:0/1654568966 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631880aa0e0 0x5631880acd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.280+0000 7f7e42d9d640 1 -- 172.21.15.123:0/1654568966 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563187fdd0d0 con 0x5631880ae0b0 2024-09-15T23:20:50.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.280+0000 7f7e42d9d640 1 --2- 172.21.15.123:0/1654568966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5631880ae0b0 0x5631880a71a0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c079930 tx=0x7f7e3c079a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3230ad11eaa2f3fc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:50.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.280+0000 7f7e23fff640 1 -- 172.21.15.123:0/1654568966 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c04b040 con 0x5631880ae0b0 2024-09-15T23:20:50.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.280+0000 7f7e23fff640 1 -- 172.21.15.123:0/1654568966 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e3c07e0f0 con 0x5631880ae0b0 2024-09-15T23:20:50.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.280+0000 7f7e23fff640 1 -- 172.21.15.123:0/1654568966 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c082920 con 0x5631880ae0b0 2024-09-15T23:20:50.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.280+0000 7f7e4bc58740 1 -- 172.21.15.123:0/1654568966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5631880ae0b0 msgr2=0x5631880a71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:50.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.280+0000 7f7e4bc58740 1 --2- 172.21.15.123:0/1654568966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5631880ae0b0 0x5631880a71a0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c079930 tx=0x7f7e3c079a20 comp rx=0 tx=0).stop 2024-09-15T23:20:50.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.281+0000 7f7e4bc58740 1 -- 172.21.15.123:0/1654568966 shutdown_connections 2024-09-15T23:20:50.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.281+0000 7f7e4bc58740 1 --2- 172.21.15.123:0/1654568966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5631880ae0b0 0x5631880a71a0 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.281+0000 7f7e4bc58740 1 --2- 172.21.15.123:0/1654568966 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631880aa0e0 0x5631880acd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.281+0000 7f7e4bc58740 1 --2- 172.21.15.123:0/1654568966 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5631880ac920 0x5631880f20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.281+0000 7f7e4bc58740 1 -- 172.21.15.123:0/1654568966 >> 172.21.15.123:0/1654568966 conn(0x5631880a9370 msgr2=0x5631880f1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:50.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.281+0000 7f7e4bc58740 1 -- 172.21.15.123:0/1654568966 shutdown_connections 2024-09-15T23:20:50.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.281+0000 7f7e4bc58740 1 -- 172.21.15.123:0/1654568966 wait complete. 2024-09-15T23:20:50.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.281+0000 7f7e4bc58740 1 -- start start 2024-09-15T23:20:50.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.281+0000 7f7e4bc58740 1 Processor -- start 2024-09-15T23:20:50.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.282+0000 7f7e4bc58740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5631880ac920 0x5631880d1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.282+0000 7f7e4bc58740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5631880ae0b0 0x5631880d5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.282+0000 7f7e4bc58740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631880da280 0x5631880da700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.282+0000 7f7e4bc58740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5631880a8810 con 0x5631880ae0b0 2024-09-15T23:20:50.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.282+0000 7f7e4bc58740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x563187f984f0 con 0x5631880da280 2024-09-15T23:20:50.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.282+0000 7f7e4bc58740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5631880f28f0 con 0x5631880ac920 2024-09-15T23:20:50.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.282+0000 7f7e4bc58740 10 client.0 _ll_register_callbacks cb 0x563187fb9b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:20:50.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.282+0000 7f7e41d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5631880ae0b0 0x5631880d5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.282+0000 7f7e41d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5631880ae0b0 0x5631880d5510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36182/0 (socket says 172.21.15.123:36182) 2024-09-15T23:20:50.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.282+0000 7f7e41d9b640 1 -- 172.21.15.123:0/2441951620 learned_addr learned my addr 172.21.15.123:0/2441951620 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:50.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.282+0000 7f7e42d9d640 1 --2- 172.21.15.123:0/2441951620 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631880da280 0x5631880da700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.282+0000 7f7e4259c640 1 --2- 172.21.15.123:0/2441951620 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5631880ac920 0x5631880d1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.283+0000 7f7e41d9b640 1 -- 172.21.15.123:0/2441951620 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5631880ac920 msgr2=0x5631880d1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:50.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.283+0000 7f7e41d9b640 1 --2- 172.21.15.123:0/2441951620 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5631880ac920 0x5631880d1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.283+0000 7f7e41d9b640 1 -- 172.21.15.123:0/2441951620 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631880da280 msgr2=0x5631880da700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:50.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.283+0000 7f7e41d9b640 1 --2- 172.21.15.123:0/2441951620 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631880da280 0x5631880da700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.283+0000 7f7e41d9b640 1 -- 172.21.15.123:0/2441951620 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563187dec7d0 con 0x5631880ae0b0 2024-09-15T23:20:50.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.283+0000 7f7e42d9d640 1 --2- 172.21.15.123:0/2441951620 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631880da280 0x5631880da700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:20:50.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.283+0000 7f7e41d9b640 1 --2- 172.21.15.123:0/2441951620 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5631880ae0b0 0x5631880d5510 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c0149d0 tx=0x7f7e2c014dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5211f83c6b3a11c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:50.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.283+0000 7f7e217fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:20:50.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.283+0000 7f7e217fa640 1 -- 172.21.15.123:0/2441951620 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c022060 con 0x5631880ae0b0 2024-09-15T23:20:50.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.283+0000 7f7e217fa640 1 -- 172.21.15.123:0/2441951620 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f7e2c012ac0 con 0x5631880ae0b0 2024-09-15T23:20:50.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.283+0000 7f7e4bc58740 1 -- 172.21.15.123:0/2441951620 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e3c07e0f0 con 0x5631880ae0b0 2024-09-15T23:20:50.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.283+0000 7f7e217fa640 1 -- 172.21.15.123:0/2441951620 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f7e2c028050 con 0x5631880ae0b0 2024-09-15T23:20:50.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.283+0000 7f7e4bc58740 10 client.9225 fetch_fsmap learned FSMap version 93 2024-09-15T23:20:50.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.283+0000 7f7e4bc58740 1 -- 172.21.15.123:0/2441951620 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) -- 0x563187d223f0 con 0x5631880ae0b0 2024-09-15T23:20:50.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.283+0000 7f7e217fa640 1 -- 172.21.15.123:0/2441951620 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e3c07e0f0 con 0x5631880ae0b0 2024-09-15T23:20:50.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.283+0000 7f7e217fa640 1 -- 172.21.15.123:0/2441951620 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 93) ==== 3502+0+0 (secure 0 0 0) 0x7f7e2c02b020 con 0x5631880ae0b0 2024-09-15T23:20:50.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.283+0000 7f7e4bc58740 10 client.9225 fetch_fsmap finished waiting for FSMap version 93 2024-09-15T23:20:50.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.283+0000 7f7e4bc58740 10 client.9225 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-15T23:20:50.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.283+0000 7f7e4bc58740 20 client.9225 populate_metadata read hostname 'smithi123' 2024-09-15T23:20:50.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.283+0000 7f7e4bc58740 1 --2- 172.21.15.123:0/2441951620 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x5631880d8e00 0x5631880d9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.283+0000 7f7e4bc58740 4 client.9225 mds_command: new command op to 9006 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:20:50.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.283+0000 7f7e4bc58740 1 -- 172.21.15.123:0/2441951620 --> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56318801ce20 con 0x5631880d8e00 2024-09-15T23:20:50.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.284+0000 7f7e4259c640 1 --2- 172.21.15.123:0/2441951620 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x5631880d8e00 0x5631880d9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.284+0000 7f7e4259c640 1 --2- 172.21.15.123:0/2441951620 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x5631880d8e00 0x5631880d9210 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa45379e237aa984 server_cookie=b0f033668fbf11d0 in_seq=0 out_seq=0 2024-09-15T23:20:50.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.284+0000 7f7e217fa640 10 client.9225 ms_handle_connect on v2:172.21.15.123:6833/627322542 2024-09-15T23:20:50.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.284+0000 7f7e217fa640 1 -- 172.21.15.123:0/2441951620 <== mds.0 v2:172.21.15.123:6833/627322542 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56318801ce20 con 0x5631880d8e00 2024-09-15T23:20:50.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.284+0000 7f7e217fa640 10 client.9225 handle_command_reply: tid=0 2024-09-15T23:20:50.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.284+0000 7f7e4bc58740 1 client.9225 shutdown 2024-09-15T23:20:50.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.284+0000 7f7e4bc58740 1 -- 172.21.15.123:0/2441951620 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5631880ae0b0 msgr2=0x5631880d5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:50.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.284+0000 7f7e4bc58740 1 --2- 172.21.15.123:0/2441951620 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5631880ae0b0 0x5631880d5510 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c0149d0 tx=0x7f7e2c014dd0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.285+0000 7f7e4bc58740 1 -- 172.21.15.123:0/2441951620 shutdown_connections 2024-09-15T23:20:50.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.285+0000 7f7e4bc58740 1 --2- 172.21.15.123:0/2441951620 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x5631880d8e00 0x5631880d9210 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.285+0000 7f7e4bc58740 1 --2- 172.21.15.123:0/2441951620 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631880da280 0x5631880da700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.285+0000 7f7e4bc58740 1 --2- 172.21.15.123:0/2441951620 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5631880ae0b0 0x5631880d5510 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.285+0000 7f7e217fa640 0 client.9225 ms_handle_reset on v2:172.21.15.123:6833/627322542 2024-09-15T23:20:50.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.285+0000 7f7e4bc58740 1 --2- 172.21.15.123:0/2441951620 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5631880ac920 0x5631880d1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.285+0000 7f7e4bc58740 1 -- 172.21.15.123:0/2441951620 >> 172.21.15.123:0/2441951620 conn(0x5631880aa0e0 msgr2=0x5631880ef610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:50.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.285+0000 7f7e4bc58740 1 -- 172.21.15.123:0/2441951620 shutdown_connections 2024-09-15T23:20:50.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.285+0000 7f7e4bc58740 1 -- 172.21.15.123:0/2441951620 wait complete. 2024-09-15T23:20:50.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.285+0000 7f7e4bc58740 20 client.9225 trim_cache size 0 max 16384 2024-09-15T23:20:50.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.302+0000 7f7e4bc58740 1 Processor -- start 2024-09-15T23:20:50.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.302+0000 7f7e4bc58740 1 -- start start 2024-09-15T23:20:50.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.302+0000 7f7e4bc58740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5631880ac920 0x563188115690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.302+0000 7f7e4bc58740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631880ae0b0 0x5631880efc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.302+0000 7f7e4bc58740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5631880da280 0x5631880f05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.302+0000 7f7e4bc58740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7e44200be0 con 0x5631880ac920 2024-09-15T23:20:50.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.302+0000 7f7e4bc58740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7e441ffc70 con 0x5631880ae0b0 2024-09-15T23:20:50.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.302+0000 7f7e4bc58740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7e441f8ea0 con 0x5631880da280 2024-09-15T23:20:50.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.302+0000 7f7e4259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5631880ac920 0x563188115690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.302+0000 7f7e4259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5631880ac920 0x563188115690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36184/0 (socket says 172.21.15.123:36184) 2024-09-15T23:20:50.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.303+0000 7f7e4259c640 1 -- 172.21.15.123:0/2321754979 learned_addr learned my addr 172.21.15.123:0/2321754979 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:50.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.303+0000 7f7e42d9d640 1 --2- 172.21.15.123:0/2321754979 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5631880da280 0x5631880f05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.303+0000 7f7e41d9b640 1 --2- 172.21.15.123:0/2321754979 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631880ae0b0 0x5631880efc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.303+0000 7f7e4259c640 1 -- 172.21.15.123:0/2321754979 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5631880da280 msgr2=0x5631880f05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:50.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.303+0000 7f7e4259c640 1 --2- 172.21.15.123:0/2321754979 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5631880da280 0x5631880f05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.303+0000 7f7e4259c640 1 -- 172.21.15.123:0/2321754979 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631880ae0b0 msgr2=0x5631880efc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:50.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.303+0000 7f7e4259c640 1 --2- 172.21.15.123:0/2321754979 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631880ae0b0 0x5631880efc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.303+0000 7f7e4259c640 1 -- 172.21.15.123:0/2321754979 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631880d9580 con 0x5631880ac920 2024-09-15T23:20:50.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.303+0000 7f7e4259c640 1 --2- 172.21.15.123:0/2321754979 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5631880ac920 0x563188115690 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f7e3400fe70 tx=0x7f7e34012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dedaba4a58a2195 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:50.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.303+0000 7f7e237fe640 1 -- 172.21.15.123:0/2321754979 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3402f070 con 0x5631880ac920 2024-09-15T23:20:50.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.303+0000 7f7e237fe640 1 -- 172.21.15.123:0/2321754979 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e34007940 con 0x5631880ac920 2024-09-15T23:20:50.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.303+0000 7f7e237fe640 1 -- 172.21.15.123:0/2321754979 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e34026070 con 0x5631880ac920 2024-09-15T23:20:50.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.303+0000 7f7e4bc58740 1 -- 172.21.15.123:0/2321754979 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5631880ac920 msgr2=0x563188115690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:50.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.303+0000 7f7e4bc58740 1 --2- 172.21.15.123:0/2321754979 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5631880ac920 0x563188115690 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f7e3400fe70 tx=0x7f7e34012000 comp rx=0 tx=0).stop 2024-09-15T23:20:50.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.304+0000 7f7e4bc58740 1 -- 172.21.15.123:0/2321754979 shutdown_connections 2024-09-15T23:20:50.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.304+0000 7f7e4bc58740 1 --2- 172.21.15.123:0/2321754979 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5631880da280 0x5631880f05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.304+0000 7f7e4bc58740 1 --2- 172.21.15.123:0/2321754979 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631880ae0b0 0x5631880efc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.304+0000 7f7e4bc58740 1 --2- 172.21.15.123:0/2321754979 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5631880ac920 0x563188115690 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.304+0000 7f7e4bc58740 1 -- 172.21.15.123:0/2321754979 >> 172.21.15.123:0/2321754979 conn(0x5631880aa0e0 msgr2=0x5631880f33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:50.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.304+0000 7f7e4bc58740 1 -- 172.21.15.123:0/2321754979 shutdown_connections 2024-09-15T23:20:50.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.304+0000 7f7e4bc58740 1 -- 172.21.15.123:0/2321754979 wait complete. 2024-09-15T23:20:50.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.304+0000 7f7e4bc58740 1 -- start start 2024-09-15T23:20:50.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.304+0000 7f7e4bc58740 1 Processor -- start 2024-09-15T23:20:50.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.305+0000 7f7e4bc58740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5631880ac920 0x5631880d6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.305+0000 7f7e4bc58740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631880ae0b0 0x563188173910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.305+0000 7f7e4bc58740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5631880da280 0x5631881558f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.305+0000 7f7e4bc58740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5631880dbf50 con 0x5631880da280 2024-09-15T23:20:50.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.305+0000 7f7e4bc58740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7e441ff6a0 con 0x5631880ae0b0 2024-09-15T23:20:50.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.305+0000 7f7e4bc58740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5631880d5510 con 0x5631880ac920 2024-09-15T23:20:50.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.305+0000 7f7e4bc58740 10 client.0 _ll_register_callbacks cb 0x7f7e2c0098a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:20:50.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.305+0000 7f7e42d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5631880da280 0x5631881558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.305+0000 7f7e42d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5631880da280 0x5631881558f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36194/0 (socket says 172.21.15.123:36194) 2024-09-15T23:20:50.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.305+0000 7f7e42d9d640 1 -- 172.21.15.123:0/974972536 learned_addr learned my addr 172.21.15.123:0/974972536 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:50.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.305+0000 7f7e4259c640 1 --2- 172.21.15.123:0/974972536 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5631880ac920 0x5631880d6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.305+0000 7f7e41d9b640 1 --2- 172.21.15.123:0/974972536 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631880ae0b0 0x563188173910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.305+0000 7f7e42d9d640 1 -- 172.21.15.123:0/974972536 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5631880ac920 msgr2=0x5631880d6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:50.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.305+0000 7f7e42d9d640 1 --2- 172.21.15.123:0/974972536 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5631880ac920 0x5631880d6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.305+0000 7f7e42d9d640 1 -- 172.21.15.123:0/974972536 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631880ae0b0 msgr2=0x563188173910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:50.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.305+0000 7f7e42d9d640 1 --2- 172.21.15.123:0/974972536 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631880ae0b0 0x563188173910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.305+0000 7f7e42d9d640 1 -- 172.21.15.123:0/974972536 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563187ce20f0 con 0x5631880da280 2024-09-15T23:20:50.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.306+0000 7f7e42d9d640 1 --2- 172.21.15.123:0/974972536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5631880da280 0x5631881558f0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c0aa250 tx=0x7f7e3c008000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fa4d83000487694 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:50.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.306+0000 7f7e217fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:20:50.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.306+0000 7f7e217fa640 1 -- 172.21.15.123:0/974972536 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c097060 con 0x5631880da280 2024-09-15T23:20:50.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.306+0000 7f7e217fa640 1 -- 172.21.15.123:0/974972536 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f7e3c03cc60 con 0x5631880da280 2024-09-15T23:20:50.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.306+0000 7f7e4bc58740 1 -- 172.21.15.123:0/974972536 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e34007940 con 0x5631880da280 2024-09-15T23:20:50.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.306+0000 7f7e217fa640 1 -- 172.21.15.123:0/974972536 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f7e3c04b040 con 0x5631880da280 2024-09-15T23:20:50.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.306+0000 7f7e4bc58740 10 client.9231 fetch_fsmap learned FSMap version 93 2024-09-15T23:20:50.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.306+0000 7f7e4bc58740 1 -- 172.21.15.123:0/974972536 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) -- 0x563188173450 con 0x5631880da280 2024-09-15T23:20:50.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.306+0000 7f7e217fa640 1 -- 172.21.15.123:0/974972536 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e34007940 con 0x5631880da280 2024-09-15T23:20:50.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.306+0000 7f7e217fa640 1 -- 172.21.15.123:0/974972536 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 93) ==== 3502+0+0 (secure 0 0 0) 0x7f7e3c082490 con 0x5631880da280 2024-09-15T23:20:50.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.306+0000 7f7e4bc58740 10 client.9231 fetch_fsmap finished waiting for FSMap version 93 2024-09-15T23:20:50.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.306+0000 7f7e4bc58740 10 client.9231 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-15T23:20:50.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.306+0000 7f7e4bc58740 20 client.9231 populate_metadata read hostname 'smithi123' 2024-09-15T23:20:50.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.306+0000 7f7e4bc58740 1 --2- 172.21.15.123:0/974972536 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x5631880d9850 0x5631880f1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.306+0000 7f7e4bc58740 4 client.9231 mds_command: new command op to 9006 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:20:50.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.306+0000 7f7e4bc58740 1 -- 172.21.15.123:0/974972536 --> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563188017170 con 0x5631880d9850 2024-09-15T23:20:50.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.306+0000 7f7e4259c640 1 --2- 172.21.15.123:0/974972536 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x5631880d9850 0x5631880f1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.306+0000 7f7e217fa640 10 client.9231 ms_handle_connect on v2:172.21.15.123:6833/627322542 2024-09-15T23:20:50.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.307+0000 7f7e4259c640 1 --2- 172.21.15.123:0/974972536 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x5631880d9850 0x5631880f1140 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cb0ca4cc2a24d87 server_cookie=4e62128257d37839 in_seq=0 out_seq=0 2024-09-15T23:20:50.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.307+0000 7f7e217fa640 1 -- 172.21.15.123:0/974972536 <== mds.0 v2:172.21.15.123:6833/627322542 1 ==== command_reply(tid 0: 0 ) ==== 8+0+276 (crc 0 0 0) 0x563188017170 con 0x5631880d9850 2024-09-15T23:20:50.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.307+0000 7f7e217fa640 10 client.9231 handle_command_reply: tid=0 2024-09-15T23:20:50.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.307+0000 7f7e4bc58740 1 client.9231 shutdown 2024-09-15T23:20:50.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.307+0000 7f7e4bc58740 1 -- 172.21.15.123:0/974972536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5631880da280 msgr2=0x5631881558f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:50.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.307+0000 7f7e4bc58740 1 --2- 172.21.15.123:0/974972536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5631880da280 0x5631881558f0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c0aa250 tx=0x7f7e3c008000 comp rx=0 tx=0).stop 2024-09-15T23:20:50.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.307+0000 7f7e4bc58740 1 -- 172.21.15.123:0/974972536 shutdown_connections 2024-09-15T23:20:50.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.307+0000 7f7e4bc58740 1 --2- 172.21.15.123:0/974972536 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x5631880d9850 0x5631880f1140 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.307+0000 7f7e4bc58740 1 --2- 172.21.15.123:0/974972536 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5631880da280 0x5631881558f0 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.307+0000 7f7e4bc58740 1 --2- 172.21.15.123:0/974972536 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5631880ae0b0 0x563188173910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.307+0000 7f7e217fa640 0 client.9231 ms_handle_reset on v2:172.21.15.123:6833/627322542 2024-09-15T23:20:50.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.307+0000 7f7e4bc58740 1 --2- 172.21.15.123:0/974972536 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5631880ac920 0x5631880d6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.307+0000 7f7e4bc58740 1 -- 172.21.15.123:0/974972536 >> 172.21.15.123:0/974972536 conn(0x5631880aa0e0 msgr2=0x5631880db6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:50.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.307+0000 7f7e4bc58740 1 -- 172.21.15.123:0/974972536 shutdown_connections 2024-09-15T23:20:50.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.307+0000 7f7e4bc58740 1 -- 172.21.15.123:0/974972536 wait complete. 2024-09-15T23:20:50.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.307+0000 7f7e4bc58740 20 client.9231 trim_cache size 0 max 16384 2024-09-15T23:20:50.319 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:20:50.319 INFO:teuthology.orchestra.run.smithi123.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-15T23:20:50.319 INFO:teuthology.orchestra.run.smithi123.stdout: "scrubs": { 2024-09-15T23:20:50.319 INFO:teuthology.orchestra.run.smithi123.stdout: "e728e835-cd76-455b-8ca5-3f256e088be1": { 2024-09-15T23:20:50.319 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/scrub_control_test_path", 2024-09-15T23:20:50.319 INFO:teuthology.orchestra.run.smithi123.stdout: "tag": "e728e835-cd76-455b-8ca5-3f256e088be1", 2024-09-15T23:20:50.319 INFO:teuthology.orchestra.run.smithi123.stdout: "options": "recursive" 2024-09-15T23:20:50.319 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:20:50.319 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:20:50.320 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:20:50.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.308+0000 7f7e48eba640 1 -- 172.21.15.123:0/316219929 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7e2406c2e0 msgr2=0x7f7e2406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:50.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.308+0000 7f7e48eba640 1 --2- 172.21.15.123:0/316219929 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7e2406c2e0 0x7f7e2406e7a0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f7e34001f10 tx=0x7f7e34009040 comp rx=0 tx=0).stop 2024-09-15T23:20:50.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.308+0000 7f7e48eba640 1 -- 172.21.15.123:0/316219929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e440b38a0 msgr2=0x7f7e44159eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:50.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.308+0000 7f7e48eba640 1 --2- 172.21.15.123:0/316219929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e440b38a0 0x7f7e44159eb0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c02a370 tx=0x7f7e3c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.308+0000 7f7e48eba640 1 -- 172.21.15.123:0/316219929 shutdown_connections 2024-09-15T23:20:50.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.308+0000 7f7e48eba640 1 --2- 172.21.15.123:0/316219929 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7e2406c2e0 0x7f7e2406e7a0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.308+0000 7f7e48eba640 1 --2- 172.21.15.123:0/316219929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e440b38a0 0x7f7e44159eb0 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.308+0000 7f7e48eba640 1 --2- 172.21.15.123:0/316219929 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7e440b3350 0x7f7e440ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.308+0000 7f7e48eba640 1 --2- 172.21.15.123:0/316219929 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7e4406bfd0 0x7f7e44153550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.308+0000 7f7e48eba640 1 -- 172.21.15.123:0/316219929 >> 172.21.15.123:0/316219929 conn(0x7f7e440d11c0 msgr2=0x7f7e44162b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:50.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.308+0000 7f7e48eba640 1 -- 172.21.15.123:0/316219929 shutdown_connections 2024-09-15T23:20:50.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.308+0000 7f7e48eba640 1 -- 172.21.15.123:0/316219929 wait complete. 2024-09-15T23:20:50.324 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:20:50.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.422+0000 7f216b7ef640 1 Processor -- start 2024-09-15T23:20:50.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.422+0000 7f216b7ef640 1 -- start start 2024-09-15T23:20:50.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.423+0000 7f216b7ef640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f216415ab40 0x7f216406c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.423+0000 7f216b7ef640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f216415af20 0x7f216415b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.423+0000 7f216b7ef640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2164072520 con 0x7f21640720b0 2024-09-15T23:20:50.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.423+0000 7f216b7ef640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f2164071010 con 0x7f216415af20 2024-09-15T23:20:50.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.423+0000 7f216b7ef640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f21640712f0 con 0x7f216415ab40 2024-09-15T23:20:50.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.423+0000 7f2169d8c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f216415af20 0x7f216415b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.423+0000 7f2168d8a640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f21640720b0 0x7f2164073990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:56204/0 (socket says 172.21.15.123:56204) 2024-09-15T23:20:50.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.423+0000 7f2168d8a640 1 -- 172.21.15.123:0/3392216562 learned_addr learned my addr 172.21.15.123:0/3392216562 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:50.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.423+0000 7f2169d8c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f216415af20 0x7f216415b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36198/0 (socket says 172.21.15.123:36198) 2024-09-15T23:20:50.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.423+0000 7f216958b640 1 --2- 172.21.15.123:0/3392216562 >> v2:172.21.15.188:3300/0 conn(0x7f216415ab40 0x7f216406c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.423+0000 7f2169d8c640 1 -- 172.21.15.123:0/3392216562 >> v2:172.21.15.188:3300/0 conn(0x7f216415ab40 msgr2=0x7f216406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:50.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.423+0000 7f2169d8c640 1 --2- 172.21.15.123:0/3392216562 >> v2:172.21.15.188:3300/0 conn(0x7f216415ab40 0x7f216406c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.423+0000 7f2169d8c640 1 -- 172.21.15.123:0/3392216562 >> v1:172.21.15.188:6789/0 conn(0x7f21640720b0 legacy=0x7f2164073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:50.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.423+0000 7f2169d8c640 1 -- 172.21.15.123:0/3392216562 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21640715d0 con 0x7f216415af20 2024-09-15T23:20:50.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.424+0000 7f2169d8c640 1 --2- 172.21.15.123:0/3392216562 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f216415af20 0x7f216415b370 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f21640d1500 tx=0x7f215c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1409febae83da943 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:50.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.424+0000 7f215bfff640 1 -- 172.21.15.123:0/3392216562 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215c007740 con 0x7f216415af20 2024-09-15T23:20:50.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.424+0000 7f215bfff640 1 -- 172.21.15.123:0/3392216562 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f215c0078e0 con 0x7f216415af20 2024-09-15T23:20:50.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.424+0000 7f215bfff640 1 -- 172.21.15.123:0/3392216562 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215c007cb0 con 0x7f216415af20 2024-09-15T23:20:50.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.424+0000 7f216b7ef640 1 -- 172.21.15.123:0/3392216562 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f216415af20 msgr2=0x7f216415b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:50.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.424+0000 7f216b7ef640 1 --2- 172.21.15.123:0/3392216562 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f216415af20 0x7f216415b370 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f21640d1500 tx=0x7f215c02a5f0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.425+0000 7f216b7ef640 1 -- 172.21.15.123:0/3392216562 shutdown_connections 2024-09-15T23:20:50.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.425+0000 7f216b7ef640 1 --2- 172.21.15.123:0/3392216562 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f216415af20 0x7f216415b370 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.425+0000 7f216b7ef640 1 --2- 172.21.15.123:0/3392216562 >> v2:172.21.15.188:3300/0 conn(0x7f216415ab40 0x7f216406c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.425+0000 7f216b7ef640 1 -- 172.21.15.123:0/3392216562 >> 172.21.15.123:0/3392216562 conn(0x7f21640ccec0 msgr2=0x7f21640cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:50.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.425+0000 7f216b7ef640 1 -- 172.21.15.123:0/3392216562 shutdown_connections 2024-09-15T23:20:50.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.425+0000 7f216b7ef640 1 -- 172.21.15.123:0/3392216562 wait complete. 2024-09-15T23:20:50.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.426+0000 7f216b7ef640 1 Processor -- start 2024-09-15T23:20:50.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.426+0000 7f216b7ef640 1 -- start start 2024-09-15T23:20:50.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.426+0000 7f216b7ef640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21640720b0 0x7f2164151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.426+0000 7f216b7ef640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f216415ab40 0x7f21641457a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.426+0000 7f216b7ef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f216415af20 0x7f21640ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.426+0000 7f216b7ef640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f216415ba30 con 0x7f21640720b0 2024-09-15T23:20:50.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.426+0000 7f216b7ef640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f216415b8b0 con 0x7f216415af20 2024-09-15T23:20:50.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.426+0000 7f216b7ef640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f216406bc10 con 0x7f216415ab40 2024-09-15T23:20:50.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.427+0000 7f216958b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21640720b0 0x7f2164151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.427+0000 7f216958b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21640720b0 0x7f2164151dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36212/0 (socket says 172.21.15.123:36212) 2024-09-15T23:20:50.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.427+0000 7f216958b640 1 -- 172.21.15.123:0/4238444160 learned_addr learned my addr 172.21.15.123:0/4238444160 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:50.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.427+0000 7f2169d8c640 1 --2- 172.21.15.123:0/4238444160 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f216415af20 0x7f21640ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.427+0000 7f2168d8a640 1 --2- 172.21.15.123:0/4238444160 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f216415ab40 0x7f21641457a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.427+0000 7f216958b640 1 -- 172.21.15.123:0/4238444160 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f216415ab40 msgr2=0x7f21641457a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:50.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.427+0000 7f216958b640 1 --2- 172.21.15.123:0/4238444160 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f216415ab40 0x7f21641457a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.427+0000 7f216958b640 1 -- 172.21.15.123:0/4238444160 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f216415af20 msgr2=0x7f21640ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:50.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.427+0000 7f216958b640 1 --2- 172.21.15.123:0/4238444160 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f216415af20 0x7f21640ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.427+0000 7f216958b640 1 -- 172.21.15.123:0/4238444160 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2164152310 con 0x7f21640720b0 2024-09-15T23:20:50.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.427+0000 7f216958b640 1 --2- 172.21.15.123:0/4238444160 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21640720b0 0x7f2164151dd0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f216000e9e0 tx=0x7f216000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:50.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.427+0000 7f2159ffb640 1 -- 172.21.15.123:0/4238444160 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2160017070 con 0x7f21640720b0 2024-09-15T23:20:50.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.427+0000 7f2159ffb640 1 -- 172.21.15.123:0/4238444160 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f216000c9d0 con 0x7f21640720b0 2024-09-15T23:20:50.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.427+0000 7f216b7ef640 1 -- 172.21.15.123:0/4238444160 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21640cf580 con 0x7f21640720b0 2024-09-15T23:20:50.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.427+0000 7f2159ffb640 1 -- 172.21.15.123:0/4238444160 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216000cdc0 con 0x7f21640720b0 2024-09-15T23:20:50.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.427+0000 7f216b7ef640 1 -- 172.21.15.123:0/4238444160 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21641515d0 con 0x7f21640720b0 2024-09-15T23:20:50.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.428+0000 7f216b7ef640 1 -- 172.21.15.123:0/4238444160 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f216406bfd0 con 0x7f21640720b0 2024-09-15T23:20:50.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.429+0000 7f2159ffb640 1 -- 172.21.15.123:0/4238444160 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f216001a070 con 0x7f21640720b0 2024-09-15T23:20:50.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.429+0000 7f2159ffb640 1 --2- 172.21.15.123:0/4238444160 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f214806c2b0 0x7f214806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.429+0000 7f2159ffb640 1 -- 172.21.15.123:0/4238444160 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f216008b450 con 0x7f21640720b0 2024-09-15T23:20:50.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.430+0000 7f2168d8a640 1 --2- 172.21.15.123:0/4238444160 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f214806c2b0 0x7f214806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.430+0000 7f2168d8a640 1 --2- 172.21.15.123:0/4238444160 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f214806c2b0 0x7f214806e770 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f21640cc7c0 tx=0x7f2154007e80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:50.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.434+0000 7f2159ffb640 1 -- 172.21.15.123:0/4238444160 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f21600594e0 con 0x7f21640720b0 2024-09-15T23:20:50.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.633+0000 7f216b7ef640 1 -- 172.21.15.123:0/4238444160 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f21640686b0 con 0x7f21640720b0 2024-09-15T23:20:50.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.634+0000 7f2159ffb640 1 -- 172.21.15.123:0/4238444160 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5236 (secure 0 0 0) 0x7f216005d7e0 con 0x7f21640720b0 2024-09-15T23:20:50.636 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:50.636 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":93,"btime":"2024-09-15T23:20:31:301251+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7735,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/3725440007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3725440007},{"type":"v1","addr":"172.21.15.188:6836","nonce":3725440007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7738,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2908220643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2908220643},{"type":"v1","addr":"172.21.15.188:6837","nonce":2908220643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":9003,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2302544827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2302544827},{"type":"v1","addr":"172.21.15.123:6834","nonce":2302544827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:20:28.532639+0000","modified":"2024-09-15T23:20:30.630141+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9006":{"gid":9006,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/627322542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":627322542},{"type":"v1","addr":"172.21.15.123:6835","nonce":627322542}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9006,"qdb_cluster":[9006]},"id":10}]} 2024-09-15T23:20:50.637 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 93 2024-09-15T23:20:50.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.636+0000 7f216b7ef640 1 -- 172.21.15.123:0/4238444160 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f214806c2b0 msgr2=0x7f214806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:50.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.636+0000 7f216b7ef640 1 --2- 172.21.15.123:0/4238444160 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f214806c2b0 0x7f214806e770 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f21640cc7c0 tx=0x7f2154007e80 comp rx=0 tx=0).stop 2024-09-15T23:20:50.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.636+0000 7f216b7ef640 1 -- 172.21.15.123:0/4238444160 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21640720b0 msgr2=0x7f2164151dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:50.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.636+0000 7f216b7ef640 1 --2- 172.21.15.123:0/4238444160 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21640720b0 0x7f2164151dd0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f216000e9e0 tx=0x7f216000eea0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.636+0000 7f216b7ef640 1 -- 172.21.15.123:0/4238444160 shutdown_connections 2024-09-15T23:20:50.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.636+0000 7f216b7ef640 1 --2- 172.21.15.123:0/4238444160 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f216415af20 0x7f21640ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.636+0000 7f216b7ef640 1 --2- 172.21.15.123:0/4238444160 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f216415ab40 0x7f21641457a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.636+0000 7f216b7ef640 1 --2- 172.21.15.123:0/4238444160 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f214806c2b0 0x7f214806e770 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.636+0000 7f216b7ef640 1 --2- 172.21.15.123:0/4238444160 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21640720b0 0x7f2164151dd0 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.636+0000 7f216b7ef640 1 -- 172.21.15.123:0/4238444160 >> 172.21.15.123:0/4238444160 conn(0x7f21640ccec0 msgr2=0x7f2164073950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:50.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.636+0000 7f216b7ef640 1 -- 172.21.15.123:0/4238444160 shutdown_connections 2024-09-15T23:20:50.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.636+0000 7f216b7ef640 1 -- 172.21.15.123:0/4238444160 wait complete. 2024-09-15T23:20:50.647 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-15T23:20:50.647 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:20:50.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.743+0000 7fc4c0277640 1 Processor -- start 2024-09-15T23:20:50.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.743+0000 7fc4c0277640 1 -- start start 2024-09-15T23:20:50.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.744+0000 7fc4c0277640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc4b815eab0 0x7fc4b815ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.744+0000 7fc4c0277640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4b8162490 0x7fc4b80d2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.744+0000 7fc4c0277640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4b815f570 con 0x7fc4b80b66b0 2024-09-15T23:20:50.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.744+0000 7fc4c0277640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fc4b815f850 con 0x7fc4b815eab0 2024-09-15T23:20:50.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.744+0000 7fc4c0277640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc4b815fb30 con 0x7fc4b8162490 2024-09-15T23:20:50.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.744+0000 7fc4be814640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc4b80b66b0 0x7fc4b80d35e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:37636/0 (socket says 172.21.15.123:37636) 2024-09-15T23:20:50.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.744+0000 7fc4be814640 1 -- 172.21.15.123:0/525393011 learned_addr learned my addr 172.21.15.123:0/525393011 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:50.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.745+0000 7fc4bd812640 1 --2- 172.21.15.123:0/525393011 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4b8162490 0x7fc4b80d2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.745+0000 7fc4be013640 1 --2- 172.21.15.123:0/525393011 >> v2:172.21.15.188:3300/0 conn(0x7fc4b815eab0 0x7fc4b815ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.745+0000 7fc4bd011640 1 -- 172.21.15.123:0/525393011 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3440061592 0 0) 0x7fc4b815f570 con 0x7fc4b80b66b0 2024-09-15T23:20:50.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.745+0000 7fc4bd011640 1 -- 172.21.15.123:0/525393011 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4a4003520 con 0x7fc4b80b66b0 2024-09-15T23:20:50.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.745+0000 7fc4bd812640 1 -- 172.21.15.123:0/525393011 >> v2:172.21.15.188:3300/0 conn(0x7fc4b815eab0 msgr2=0x7fc4b815ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:50.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.745+0000 7fc4bd812640 1 --2- 172.21.15.123:0/525393011 >> v2:172.21.15.188:3300/0 conn(0x7fc4b815eab0 0x7fc4b815ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.745+0000 7fc4bd011640 1 -- 172.21.15.123:0/525393011 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3667523205 0 0) 0x7fc4a4003520 con 0x7fc4b80b66b0 2024-09-15T23:20:50.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.745+0000 7fc4bd812640 1 -- 172.21.15.123:0/525393011 >> v1:172.21.15.123:6789/0 conn(0x7fc4b80b66b0 legacy=0x7fc4b80d35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:50.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.745+0000 7fc4bd812640 1 -- 172.21.15.123:0/525393011 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b815fe10 con 0x7fc4b8162490 2024-09-15T23:20:50.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.745+0000 7fc4be013640 1 --2- 172.21.15.123:0/525393011 >> v2:172.21.15.188:3300/0 conn(0x7fc4b815eab0 0x7fc4b815ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:20:50.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.746+0000 7fc4bd812640 1 --2- 172.21.15.123:0/525393011 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4b8162490 0x7fc4b80d2c30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc4a80097a0 tx=0x7fc4a802a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ef3c2a22f11d910 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:50.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.746+0000 7fc4bd011640 1 -- 172.21.15.123:0/525393011 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8037070 con 0x7fc4b8162490 2024-09-15T23:20:50.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.746+0000 7fc4bd011640 1 -- 172.21.15.123:0/525393011 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4a802aba0 con 0x7fc4b8162490 2024-09-15T23:20:50.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.746+0000 7fc4bd011640 1 -- 172.21.15.123:0/525393011 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b00019f0 con 0x7fc4b8162490 2024-09-15T23:20:50.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.746+0000 7fc4c0277640 1 -- 172.21.15.123:0/525393011 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4b8162490 msgr2=0x7fc4b80d2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:50.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.746+0000 7fc4c0277640 1 --2- 172.21.15.123:0/525393011 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4b8162490 0x7fc4b80d2c30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc4a80097a0 tx=0x7fc4a802a110 comp rx=0 tx=0).stop 2024-09-15T23:20:50.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.746+0000 7fc4c0277640 1 -- 172.21.15.123:0/525393011 shutdown_connections 2024-09-15T23:20:50.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.746+0000 7fc4c0277640 1 --2- 172.21.15.123:0/525393011 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4b8162490 0x7fc4b80d2c30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.746+0000 7fc4c0277640 1 --2- 172.21.15.123:0/525393011 >> v2:172.21.15.188:3300/0 conn(0x7fc4b815eab0 0x7fc4b815ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.746+0000 7fc4c0277640 1 -- 172.21.15.123:0/525393011 >> 172.21.15.123:0/525393011 conn(0x7fc4b80d16d0 msgr2=0x7fc4b80d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:50.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.746+0000 7fc4c0277640 1 -- 172.21.15.123:0/525393011 shutdown_connections 2024-09-15T23:20:50.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.746+0000 7fc4c0277640 1 -- 172.21.15.123:0/525393011 wait complete. 2024-09-15T23:20:50.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.748+0000 7fc4c0277640 1 Processor -- start 2024-09-15T23:20:50.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.748+0000 7fc4c0277640 1 -- start start 2024-09-15T23:20:50.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.748+0000 7fc4c0277640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4b80b66b0 0x7fc4b815a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.748+0000 7fc4c0277640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4b815eab0 0x7fc4b81f4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.748+0000 7fc4c0277640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4b8162490 0x7fc4b80cb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.748+0000 7fc4c0277640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b80d4460 con 0x7fc4b8162490 2024-09-15T23:20:50.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.748+0000 7fc4c0277640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b80d3170 con 0x7fc4b815eab0 2024-09-15T23:20:50.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.748+0000 7fc4c0277640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc4b80d45e0 con 0x7fc4b80b66b0 2024-09-15T23:20:50.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.748+0000 7fc4be814640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4b8162490 0x7fc4b80cb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.748+0000 7fc4be814640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4b8162490 0x7fc4b80cb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36224/0 (socket says 172.21.15.123:36224) 2024-09-15T23:20:50.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.748+0000 7fc4be814640 1 -- 172.21.15.123:0/2362569927 learned_addr learned my addr 172.21.15.123:0/2362569927 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:50.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.749+0000 7fc4be013640 1 --2- 172.21.15.123:0/2362569927 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4b80b66b0 0x7fc4b815a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.749+0000 7fc4bd812640 1 --2- 172.21.15.123:0/2362569927 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4b815eab0 0x7fc4b81f4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.749+0000 7fc4be814640 1 -- 172.21.15.123:0/2362569927 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4b80b66b0 msgr2=0x7fc4b815a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:50.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.749+0000 7fc4be814640 1 --2- 172.21.15.123:0/2362569927 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4b80b66b0 0x7fc4b815a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.749+0000 7fc4be814640 1 -- 172.21.15.123:0/2362569927 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4b815eab0 msgr2=0x7fc4b81f4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:50.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.749+0000 7fc4be814640 1 --2- 172.21.15.123:0/2362569927 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4b815eab0 0x7fc4b81f4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.749+0000 7fc4be814640 1 -- 172.21.15.123:0/2362569927 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b814b3c0 con 0x7fc4b8162490 2024-09-15T23:20:50.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.749+0000 7fc4be814640 1 --2- 172.21.15.123:0/2362569927 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4b8162490 0x7fc4b80cb900 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fc4b000cc00 tx=0x7fc4b000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:50.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.749+0000 7fc4aeffd640 1 -- 172.21.15.123:0/2362569927 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0017070 con 0x7fc4b8162490 2024-09-15T23:20:50.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.749+0000 7fc4aeffd640 1 -- 172.21.15.123:0/2362569927 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4b000ce10 con 0x7fc4b8162490 2024-09-15T23:20:50.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.749+0000 7fc4aeffd640 1 -- 172.21.15.123:0/2362569927 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0012600 con 0x7fc4b8162490 2024-09-15T23:20:50.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.749+0000 7fc4c0277640 1 -- 172.21.15.123:0/2362569927 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4b814b6a0 con 0x7fc4b8162490 2024-09-15T23:20:50.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.749+0000 7fc4c0277640 1 -- 172.21.15.123:0/2362569927 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4b814bc60 con 0x7fc4b8162490 2024-09-15T23:20:50.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.750+0000 7fc4c0277640 1 -- 172.21.15.123:0/2362569927 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4b80d2500 con 0x7fc4b8162490 2024-09-15T23:20:50.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.750+0000 7fc4aeffd640 1 -- 172.21.15.123:0/2362569927 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc4b001a070 con 0x7fc4b8162490 2024-09-15T23:20:50.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.751+0000 7fc4aeffd640 1 --2- 172.21.15.123:0/2362569927 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc49c06c2b0 0x7fc49c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:50.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.751+0000 7fc4aeffd640 1 -- 172.21.15.123:0/2362569927 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7fc4b008b240 con 0x7fc4b8162490 2024-09-15T23:20:50.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.751+0000 7fc4be013640 1 --2- 172.21.15.123:0/2362569927 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc49c06c2b0 0x7fc49c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:50.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.751+0000 7fc4be013640 1 --2- 172.21.15.123:0/2362569927 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc49c06c2b0 0x7fc49c06e770 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4009a30 tx=0x7fc4b4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:50.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.755+0000 7fc4aeffd640 1 -- 172.21.15.123:0/2362569927 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc4b0059360 con 0x7fc4b8162490 2024-09-15T23:20:50.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.982+0000 7fc4c0277640 1 -- 172.21.15.123:0/2362569927 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fc4b806da60 con 0x7fc4b8162490 2024-09-15T23:20:50.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.982+0000 7fc4aeffd640 1 -- 172.21.15.123:0/2362569927 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1488 (secure 0 0 0) 0x7fc4b005d660 con 0x7fc4b8162490 2024-09-15T23:20:50.984 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:50.984 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":541,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":154,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":831,"data_bytes":847981363,"bytes_used":2024529920,"bytes_avail":771069583360,"bytes_total":773094113280,"write_bytes_sec":70606583,"read_op_per_sec":0,"write_op_per_sec":69},"fsmap":{"epoch":93,"btime":"2024-09-15T23:20:31:301251+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":9006}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-09-15T23:20:19.619603+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T23:20:50.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.984+0000 7fc4c0277640 1 -- 172.21.15.123:0/2362569927 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc49c06c2b0 msgr2=0x7fc49c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:50.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.984+0000 7fc4c0277640 1 --2- 172.21.15.123:0/2362569927 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc49c06c2b0 0x7fc49c06e770 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4009a30 tx=0x7fc4b4008040 comp rx=0 tx=0).stop 2024-09-15T23:20:50.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.984+0000 7fc4c0277640 1 -- 172.21.15.123:0/2362569927 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4b8162490 msgr2=0x7fc4b80cb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:50.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.984+0000 7fc4c0277640 1 --2- 172.21.15.123:0/2362569927 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4b8162490 0x7fc4b80cb900 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fc4b000cc00 tx=0x7fc4b000a430 comp rx=0 tx=0).stop 2024-09-15T23:20:50.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.984+0000 7fc4c0277640 1 -- 172.21.15.123:0/2362569927 shutdown_connections 2024-09-15T23:20:50.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.984+0000 7fc4c0277640 1 --2- 172.21.15.123:0/2362569927 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc49c06c2b0 0x7fc49c06e770 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.984+0000 7fc4c0277640 1 --2- 172.21.15.123:0/2362569927 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4b8162490 0x7fc4b80cb900 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.984+0000 7fc4c0277640 1 --2- 172.21.15.123:0/2362569927 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4b815eab0 0x7fc4b81f4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.984+0000 7fc4c0277640 1 --2- 172.21.15.123:0/2362569927 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4b80b66b0 0x7fc4b815a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:50.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.984+0000 7fc4c0277640 1 -- 172.21.15.123:0/2362569927 >> 172.21.15.123:0/2362569927 conn(0x7fc4b80d16d0 msgr2=0x7fc4b80b4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:50.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.984+0000 7fc4c0277640 1 -- 172.21.15.123:0/2362569927 shutdown_connections 2024-09-15T23:20:50.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:50.984+0000 7fc4c0277640 1 -- 172.21.15.123:0/2362569927 wait complete. 2024-09-15T23:20:50.996 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-15T23:20:51.997 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:20:52.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.106+0000 7f398f3bd640 1 Processor -- start 2024-09-15T23:20:52.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.107+0000 7f398f3bd640 1 -- start start 2024-09-15T23:20:52.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.108+0000 7f398f3bd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f398815ed20 0x7f39880b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:52.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.108+0000 7f398f3bd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f39880b90e0 0x7f39880b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:52.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.108+0000 7f398f3bd640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39880d0e70 con 0x7f39880d23b0 2024-09-15T23:20:52.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.108+0000 7f398f3bd640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f39880d41c0 con 0x7f39880b90e0 2024-09-15T23:20:52.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.108+0000 7f398f3bd640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f39880d35b0 con 0x7f398815ed20 2024-09-15T23:20:52.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.108+0000 7f398c958640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f39880d23b0 0x7f39880cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:37644/0 (socket says 172.21.15.123:37644) 2024-09-15T23:20:52.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.108+0000 7f398c958640 1 -- 172.21.15.123:0/2455727584 learned_addr learned my addr 172.21.15.123:0/2455727584 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:52.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.108+0000 7f398d95a640 1 --2- 172.21.15.123:0/2455727584 >> v2:172.21.15.188:3300/0 conn(0x7f39880b90e0 0x7f39880b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:52.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.108+0000 7f398d159640 1 --2- 172.21.15.123:0/2455727584 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f398815ed20 0x7f39880b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:52.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.108+0000 7f397bfff640 1 -- 172.21.15.123:0/2455727584 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1847595067 0 0) 0x7f397c001110 con 0x7f39880d23b0 2024-09-15T23:20:52.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.108+0000 7f397bfff640 1 -- 172.21.15.123:0/2455727584 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3974003520 con 0x7f39880d23b0 2024-09-15T23:20:52.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.108+0000 7f397bfff640 1 -- 172.21.15.123:0/2455727584 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 808068990 0 0) 0x7f3974003520 con 0x7f39880d23b0 2024-09-15T23:20:52.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.108+0000 7f397bfff640 1 -- 172.21.15.123:0/2455727584 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f398815ed20 msgr2=0x7f39880b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:52.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.108+0000 7f397bfff640 1 --2- 172.21.15.123:0/2455727584 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f398815ed20 0x7f39880b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:52.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.108+0000 7f397bfff640 1 -- 172.21.15.123:0/2455727584 >> v2:172.21.15.188:3300/0 conn(0x7f39880b90e0 msgr2=0x7f39880b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:52.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.108+0000 7f397bfff640 1 --2- 172.21.15.123:0/2455727584 >> v2:172.21.15.188:3300/0 conn(0x7f39880b90e0 0x7f39880b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:52.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.108+0000 7f397bfff640 1 -- 172.21.15.123:0/2455727584 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39880d3890 con 0x7f39880d23b0 2024-09-15T23:20:52.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.108+0000 7f397bfff640 1 -- 172.21.15.123:0/2455727584 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f397c001840 con 0x7f39880d23b0 2024-09-15T23:20:52.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.108+0000 7f397bfff640 1 -- 172.21.15.123:0/2455727584 >> v1:172.21.15.123:6789/0 conn(0x7f39880d23b0 legacy=0x7f39880cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:52.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.108+0000 7f397bfff640 1 --2- 172.21.15.123:0/2455727584 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39740039b0 0x7f3974003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:52.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.108+0000 7f397bfff640 1 --2- 172.21.15.123:0/2455727584 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f398815ed20 0x7f3974004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:52.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.108+0000 7f397bfff640 1 --2- 172.21.15.123:0/2455727584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3974004d40 0x7f39740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:52.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.108+0000 7f397bfff640 1 -- 172.21.15.123:0/2455727584 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f39880d41c0 con 0x7f3974004d40 2024-09-15T23:20:52.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.108+0000 7f397bfff640 1 -- 172.21.15.123:0/2455727584 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f39880d35b0 con 0x7f39740039b0 2024-09-15T23:20:52.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.108+0000 7f397bfff640 1 -- 172.21.15.123:0/2455727584 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f397400b9c0 con 0x7f398815ed20 2024-09-15T23:20:52.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.109+0000 7f398d95a640 1 --2- 172.21.15.123:0/2455727584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3974004d40 0x7f39740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:52.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.109+0000 7f398c958640 1 --2- 172.21.15.123:0/2455727584 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f398815ed20 0x7f3974004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:52.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.109+0000 7f398d159640 1 --2- 172.21.15.123:0/2455727584 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39740039b0 0x7f3974003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:52.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.109+0000 7f398d95a640 1 -- 172.21.15.123:0/2455727584 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f398815ed20 msgr2=0x7f3974004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:52.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.109+0000 7f398d95a640 1 --2- 172.21.15.123:0/2455727584 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f398815ed20 0x7f3974004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:52.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.109+0000 7f398d95a640 1 -- 172.21.15.123:0/2455727584 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39740039b0 msgr2=0x7f3974003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:52.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.109+0000 7f398d95a640 1 --2- 172.21.15.123:0/2455727584 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39740039b0 0x7f3974003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:52.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.109+0000 7f398d95a640 1 -- 172.21.15.123:0/2455727584 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3974003520 con 0x7f3974004d40 2024-09-15T23:20:52.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.110+0000 7f398d95a640 1 --2- 172.21.15.123:0/2455727584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3974004d40 0x7f39740051c0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f3980009f90 tx=0x7f3974005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=844b3d083dfd0f8e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:52.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.110+0000 7f397bfff640 1 -- 172.21.15.123:0/2455727584 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3980009c10 con 0x7f3974004d40 2024-09-15T23:20:52.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.110+0000 7f397bfff640 1 -- 172.21.15.123:0/2455727584 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3980036070 con 0x7f3974004d40 2024-09-15T23:20:52.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.110+0000 7f397bfff640 1 -- 172.21.15.123:0/2455727584 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3980031840 con 0x7f3974004d40 2024-09-15T23:20:52.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.110+0000 7f398f3bd640 1 -- 172.21.15.123:0/2455727584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3974004d40 msgr2=0x7f39740051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:52.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.110+0000 7f398f3bd640 1 --2- 172.21.15.123:0/2455727584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3974004d40 0x7f39740051c0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f3980009f90 tx=0x7f3974005830 comp rx=0 tx=0).stop 2024-09-15T23:20:52.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.110+0000 7f398d95a640 1 -- 172.21.15.123:0/2455727584 reap_dead start 2024-09-15T23:20:52.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.110+0000 7f398f3bd640 1 -- 172.21.15.123:0/2455727584 shutdown_connections 2024-09-15T23:20:52.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.110+0000 7f398f3bd640 1 -- 172.21.15.123:0/2455727584 >> 172.21.15.123:0/2455727584 conn(0x7f39880d1260 msgr2=0x7f39880d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:52.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.110+0000 7f398f3bd640 1 -- 172.21.15.123:0/2455727584 shutdown_connections 2024-09-15T23:20:52.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.110+0000 7f398f3bd640 1 -- 172.21.15.123:0/2455727584 wait complete. 2024-09-15T23:20:52.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.112+0000 7f398f3bd640 1 Processor -- start 2024-09-15T23:20:52.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.112+0000 7f398f3bd640 1 -- start start 2024-09-15T23:20:52.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.112+0000 7f398f3bd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3974004d40 0x7f39880c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:52.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.112+0000 7f398f3bd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f398815cbf0 0x7f39880c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:52.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.112+0000 7f398f3bd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39880c8b70 0x7f39880c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:52.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.112+0000 7f398f3bd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f39880d32a0 con 0x7f3974004d40 2024-09-15T23:20:52.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.112+0000 7f398f3bd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f39880d3e50 con 0x7f39880c8b70 2024-09-15T23:20:52.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.112+0000 7f398f3bd640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f398815f100 con 0x7f398815cbf0 2024-09-15T23:20:52.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.112+0000 7f398d159640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3974004d40 0x7f39880c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:52.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.112+0000 7f398d159640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3974004d40 0x7f39880c9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36240/0 (socket says 172.21.15.123:36240) 2024-09-15T23:20:52.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.112+0000 7f398d159640 1 -- 172.21.15.123:0/1713517131 learned_addr learned my addr 172.21.15.123:0/1713517131 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:52.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.113+0000 7f398d95a640 1 --2- 172.21.15.123:0/1713517131 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39880c8b70 0x7f39880c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:52.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.113+0000 7f398c958640 1 --2- 172.21.15.123:0/1713517131 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f398815cbf0 0x7f39880c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:52.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.113+0000 7f398d159640 1 -- 172.21.15.123:0/1713517131 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f398815cbf0 msgr2=0x7f39880c8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:52.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.113+0000 7f398d159640 1 --2- 172.21.15.123:0/1713517131 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f398815cbf0 0x7f39880c8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:52.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.113+0000 7f398d159640 1 -- 172.21.15.123:0/1713517131 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39880c8b70 msgr2=0x7f39880c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:52.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.113+0000 7f398d159640 1 --2- 172.21.15.123:0/1713517131 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39880c8b70 0x7f39880c8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:52.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.113+0000 7f398d159640 1 -- 172.21.15.123:0/1713517131 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39881e85f0 con 0x7f3974004d40 2024-09-15T23:20:52.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.113+0000 7f398d95a640 1 --2- 172.21.15.123:0/1713517131 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39880c8b70 0x7f39880c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:20:52.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.113+0000 7f398d159640 1 --2- 172.21.15.123:0/1713517131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3974004d40 0x7f39880c9b00 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f39840118e0 tx=0x7f3984011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:52.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.113+0000 7f3979ffb640 1 -- 172.21.15.123:0/1713517131 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398400faf0 con 0x7f3974004d40 2024-09-15T23:20:52.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.113+0000 7f3979ffb640 1 -- 172.21.15.123:0/1713517131 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f398400fc90 con 0x7f3974004d40 2024-09-15T23:20:52.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.113+0000 7f398f3bd640 1 -- 172.21.15.123:0/1713517131 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39880ce370 con 0x7f3974004d40 2024-09-15T23:20:52.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.113+0000 7f3979ffb640 1 -- 172.21.15.123:0/1713517131 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3984014440 con 0x7f3974004d40 2024-09-15T23:20:52.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.113+0000 7f398f3bd640 1 -- 172.21.15.123:0/1713517131 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f398814ac30 con 0x7f3974004d40 2024-09-15T23:20:52.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.114+0000 7f398f3bd640 1 -- 172.21.15.123:0/1713517131 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39880ceb10 con 0x7f3974004d40 2024-09-15T23:20:52.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.115+0000 7f3979ffb640 1 -- 172.21.15.123:0/1713517131 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3984012040 con 0x7f3974004d40 2024-09-15T23:20:52.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.115+0000 7f3979ffb640 1 --2- 172.21.15.123:0/1713517131 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f396c06c2b0 0x7f396c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:52.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.115+0000 7f3979ffb640 1 -- 172.21.15.123:0/1713517131 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f398408bad0 con 0x7f3974004d40 2024-09-15T23:20:52.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.115+0000 7f398c958640 1 --2- 172.21.15.123:0/1713517131 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f396c06c2b0 0x7f396c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:52.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.116+0000 7f398c958640 1 --2- 172.21.15.123:0/1713517131 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f396c06c2b0 0x7f396c06e770 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f397c0012f0 tx=0x7f397c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:52.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.120+0000 7f3979ffb640 1 -- 172.21.15.123:0/1713517131 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f39880ceb10 con 0x7f3974004d40 2024-09-15T23:20:52.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.321+0000 7f398f3bd640 1 -- 172.21.15.123:0/1713517131 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f39880b7010 con 0x7f3974004d40 2024-09-15T23:20:52.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.322+0000 7f3979ffb640 1 -- 172.21.15.123:0/1713517131 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5236 (secure 0 0 0) 0x7f3984019030 con 0x7f3974004d40 2024-09-15T23:20:52.323 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:52.323 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":93,"btime":"2024-09-15T23:20:31:301251+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7735,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/3725440007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3725440007},{"type":"v1","addr":"172.21.15.188:6836","nonce":3725440007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7738,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2908220643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2908220643},{"type":"v1","addr":"172.21.15.188:6837","nonce":2908220643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":9003,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2302544827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2302544827},{"type":"v1","addr":"172.21.15.123:6834","nonce":2302544827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:20:28.532639+0000","modified":"2024-09-15T23:20:30.630141+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9006":{"gid":9006,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/627322542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":627322542},{"type":"v1","addr":"172.21.15.123:6835","nonce":627322542}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9006,"qdb_cluster":[9006]},"id":10}]} 2024-09-15T23:20:52.323 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 93 2024-09-15T23:20:52.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.324+0000 7f398f3bd640 1 -- 172.21.15.123:0/1713517131 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f396c06c2b0 msgr2=0x7f396c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:52.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.324+0000 7f398f3bd640 1 --2- 172.21.15.123:0/1713517131 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f396c06c2b0 0x7f396c06e770 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f397c0012f0 tx=0x7f397c009040 comp rx=0 tx=0).stop 2024-09-15T23:20:52.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.324+0000 7f398f3bd640 1 -- 172.21.15.123:0/1713517131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3974004d40 msgr2=0x7f39880c9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:52.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.324+0000 7f398f3bd640 1 --2- 172.21.15.123:0/1713517131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3974004d40 0x7f39880c9b00 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f39840118e0 tx=0x7f3984011da0 comp rx=0 tx=0).stop 2024-09-15T23:20:52.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.324+0000 7f398f3bd640 1 -- 172.21.15.123:0/1713517131 shutdown_connections 2024-09-15T23:20:52.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.324+0000 7f398f3bd640 1 --2- 172.21.15.123:0/1713517131 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f39880c8b70 0x7f39880c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:52.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.324+0000 7f398f3bd640 1 --2- 172.21.15.123:0/1713517131 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f398815cbf0 0x7f39880c8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:52.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.324+0000 7f398f3bd640 1 --2- 172.21.15.123:0/1713517131 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f396c06c2b0 0x7f396c06e770 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:52.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.324+0000 7f398f3bd640 1 --2- 172.21.15.123:0/1713517131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3974004d40 0x7f39880c9b00 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:52.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.324+0000 7f398f3bd640 1 -- 172.21.15.123:0/1713517131 >> 172.21.15.123:0/1713517131 conn(0x7f39880d1260 msgr2=0x7f39880b5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:52.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.324+0000 7f398f3bd640 1 -- 172.21.15.123:0/1713517131 shutdown_connections 2024-09-15T23:20:52.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.324+0000 7f398f3bd640 1 -- 172.21.15.123:0/1713517131 wait complete. 2024-09-15T23:20:52.335 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-15T23:20:52.335 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:20:52.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.432+0000 7f69f94d2640 1 Processor -- start 2024-09-15T23:20:52.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.432+0000 7f69f94d2640 1 -- start start 2024-09-15T23:20:52.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.433+0000 7f69f94d2640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69f40d23b0 0x7f69f40b87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:52.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.433+0000 7f69f94d2640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69f40d0e70 con 0x7f69f415ed20 2024-09-15T23:20:52.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.433+0000 7f69f94d2640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69f40d41c0 con 0x7f69f40b6970 2024-09-15T23:20:52.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.433+0000 7f69f94d2640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f69f40d35b0 con 0x7f69f40d23b0 2024-09-15T23:20:52.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.433+0000 7f69f2ffd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f69f415ed20 0x7f69f40b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:37658/0 (socket says 172.21.15.123:37658) 2024-09-15T23:20:52.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.433+0000 7f69f2ffd640 1 -- 172.21.15.123:0/1254973998 learned_addr learned my addr 172.21.15.123:0/1254973998 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:52.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.433+0000 7f69f27fc640 1 -- 172.21.15.123:0/1254973998 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1916978356 0 0) 0x7f69e4001110 con 0x7f69f415ed20 2024-09-15T23:20:52.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.433+0000 7f69f27fc640 1 -- 172.21.15.123:0/1254973998 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69e0003520 con 0x7f69f415ed20 2024-09-15T23:20:52.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.433+0000 7f69f37fe640 1 --2- 172.21.15.123:0/1254973998 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69f40d23b0 0x7f69f40b87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:52.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.433+0000 7f69f27fc640 1 -- 172.21.15.123:0/1254973998 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2854146080 0 0) 0x7f69e0003520 con 0x7f69f415ed20 2024-09-15T23:20:52.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.433+0000 7f69f27fc640 1 -- 172.21.15.123:0/1254973998 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69f40d23b0 msgr2=0x7f69f40b87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:52.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.433+0000 7f69f27fc640 1 --2- 172.21.15.123:0/1254973998 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69f40d23b0 0x7f69f40b87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:52.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.433+0000 7f69f27fc640 1 -- 172.21.15.123:0/1254973998 >> v1:172.21.15.188:6789/0 conn(0x7f69f40b6970 legacy=0x7f69f40b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:52.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.433+0000 7f69f27fc640 1 -- 172.21.15.123:0/1254973998 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f40d3890 con 0x7f69f415ed20 2024-09-15T23:20:52.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.433+0000 7f69f27fc640 1 -- 172.21.15.123:0/1254973998 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f69e4001840 con 0x7f69f415ed20 2024-09-15T23:20:52.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.433+0000 7f69f27fc640 1 -- 172.21.15.123:0/1254973998 >> v1:172.21.15.123:6789/0 conn(0x7f69f415ed20 legacy=0x7f69f40b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:52.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.433+0000 7f69f27fc640 1 --2- 172.21.15.123:0/1254973998 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69f40d23b0 0x7f69e00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:52.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.433+0000 7f69f27fc640 1 --2- 172.21.15.123:0/1254973998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69e0003f60 0x7f69e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:52.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.433+0000 7f69f27fc640 1 --2- 172.21.15.123:0/1254973998 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69e0004d40 0x7f69e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:52.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.433+0000 7f69f27fc640 1 -- 172.21.15.123:0/1254973998 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f69f40d35b0 con 0x7f69e0003f60 2024-09-15T23:20:52.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.433+0000 7f69f27fc640 1 -- 172.21.15.123:0/1254973998 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f69e000bb50 con 0x7f69e0004d40 2024-09-15T23:20:52.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.433+0000 7f69f27fc640 1 -- 172.21.15.123:0/1254973998 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f69e000bd50 con 0x7f69f40d23b0 2024-09-15T23:20:52.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.434+0000 7f69ebfff640 1 --2- 172.21.15.123:0/1254973998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69e0003f60 0x7f69e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:52.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.434+0000 7f69f2ffd640 1 --2- 172.21.15.123:0/1254973998 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69f40d23b0 0x7f69e00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:52.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.434+0000 7f69f37fe640 1 --2- 172.21.15.123:0/1254973998 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69e0004d40 0x7f69e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:52.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.434+0000 7f69ebfff640 1 -- 172.21.15.123:0/1254973998 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69f40d23b0 msgr2=0x7f69e00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:52.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.434+0000 7f69ebfff640 1 --2- 172.21.15.123:0/1254973998 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69f40d23b0 0x7f69e00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:52.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.434+0000 7f69ebfff640 1 -- 172.21.15.123:0/1254973998 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69e0004d40 msgr2=0x7f69e00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:52.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.434+0000 7f69ebfff640 1 --2- 172.21.15.123:0/1254973998 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69e0004d40 0x7f69e00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:52.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.434+0000 7f69ebfff640 1 -- 172.21.15.123:0/1254973998 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e0003520 con 0x7f69e0003f60 2024-09-15T23:20:52.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.435+0000 7f69ebfff640 1 --2- 172.21.15.123:0/1254973998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69e0003f60 0x7f69e0004800 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f69dc001750 tx=0x7f69e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7b08b23f03f749c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:52.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.435+0000 7f69f27fc640 1 -- 172.21.15.123:0/1254973998 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc001370 con 0x7f69e0003f60 2024-09-15T23:20:52.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.435+0000 7f69f27fc640 1 -- 172.21.15.123:0/1254973998 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69dc0052d0 con 0x7f69e0003f60 2024-09-15T23:20:52.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.435+0000 7f69f27fc640 1 -- 172.21.15.123:0/1254973998 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc02abe0 con 0x7f69e0003f60 2024-09-15T23:20:52.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.435+0000 7f69f94d2640 1 -- 172.21.15.123:0/1254973998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69e0003f60 msgr2=0x7f69e0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:52.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.435+0000 7f69f94d2640 1 --2- 172.21.15.123:0/1254973998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69e0003f60 0x7f69e0004800 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f69dc001750 tx=0x7f69e0005830 comp rx=0 tx=0).stop 2024-09-15T23:20:52.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.435+0000 7f69f37fe640 1 -- 172.21.15.123:0/1254973998 reap_dead start 2024-09-15T23:20:52.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.435+0000 7f69f94d2640 1 -- 172.21.15.123:0/1254973998 shutdown_connections 2024-09-15T23:20:52.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.435+0000 7f69f94d2640 1 -- 172.21.15.123:0/1254973998 >> 172.21.15.123:0/1254973998 conn(0x7f69f40d1260 msgr2=0x7f69f40d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:52.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.435+0000 7f69f94d2640 1 -- 172.21.15.123:0/1254973998 shutdown_connections 2024-09-15T23:20:52.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.435+0000 7f69f94d2640 1 -- 172.21.15.123:0/1254973998 wait complete. 2024-09-15T23:20:52.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.436+0000 7f69f94d2640 1 Processor -- start 2024-09-15T23:20:52.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.437+0000 7f69f94d2640 1 -- start start 2024-09-15T23:20:52.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.437+0000 7f69f94d2640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69e0003f60 0x7f69f40cd120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:52.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.437+0000 7f69f94d2640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69f41f51b0 0x7f69f40ab250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:52.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.437+0000 7f69f94d2640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69f415e0c0 0x7f69f41e9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:52.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.437+0000 7f69f94d2640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f69f40d32a0 con 0x7f69f415e0c0 2024-09-15T23:20:52.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.437+0000 7f69f94d2640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f69f40d3e50 con 0x7f69e0003f60 2024-09-15T23:20:52.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.437+0000 7f69f94d2640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f69f415f100 con 0x7f69f41f51b0 2024-09-15T23:20:52.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.437+0000 7f69f37fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69f415e0c0 0x7f69f41e9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:52.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.437+0000 7f69f37fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69f415e0c0 0x7f69f41e9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36272/0 (socket says 172.21.15.123:36272) 2024-09-15T23:20:52.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.437+0000 7f69f37fe640 1 -- 172.21.15.123:0/1030413893 learned_addr learned my addr 172.21.15.123:0/1030413893 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:52.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.437+0000 7f69f2ffd640 1 --2- 172.21.15.123:0/1030413893 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69e0003f60 0x7f69f40cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:52.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.437+0000 7f69ebfff640 1 --2- 172.21.15.123:0/1030413893 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69f41f51b0 0x7f69f40ab250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:52.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.438+0000 7f69f37fe640 1 -- 172.21.15.123:0/1030413893 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69f41f51b0 msgr2=0x7f69f40ab250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:52.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.438+0000 7f69f37fe640 1 --2- 172.21.15.123:0/1030413893 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69f41f51b0 0x7f69f40ab250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:52.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.438+0000 7f69f37fe640 1 -- 172.21.15.123:0/1030413893 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69e0003f60 msgr2=0x7f69f40cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:52.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.438+0000 7f69f37fe640 1 --2- 172.21.15.123:0/1030413893 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69e0003f60 0x7f69f40cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:52.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.438+0000 7f69f37fe640 1 -- 172.21.15.123:0/1030413893 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f41f5700 con 0x7f69f415e0c0 2024-09-15T23:20:52.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.438+0000 7f69f37fe640 1 --2- 172.21.15.123:0/1030413893 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69f415e0c0 0x7f69f41e9510 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f69f408d9c0 tx=0x7f69ec00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:52.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.438+0000 7f69eb7fe640 1 -- 172.21.15.123:0/1030413893 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec00fd80 con 0x7f69f415e0c0 2024-09-15T23:20:52.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.438+0000 7f69eb7fe640 1 -- 172.21.15.123:0/1030413893 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69ec01d070 con 0x7f69f415e0c0 2024-09-15T23:20:52.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.438+0000 7f69eb7fe640 1 -- 172.21.15.123:0/1030413893 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec015670 con 0x7f69f415e0c0 2024-09-15T23:20:52.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.438+0000 7f69f94d2640 1 -- 172.21.15.123:0/1030413893 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69f41f59e0 con 0x7f69f415e0c0 2024-09-15T23:20:52.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.438+0000 7f69f94d2640 1 -- 172.21.15.123:0/1030413893 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69f41f5fa0 con 0x7f69f415e0c0 2024-09-15T23:20:52.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.439+0000 7f69f94d2640 1 -- 172.21.15.123:0/1030413893 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69f40b7010 con 0x7f69f415e0c0 2024-09-15T23:20:52.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.439+0000 7f69eb7fe640 1 -- 172.21.15.123:0/1030413893 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f69ec015810 con 0x7f69f415e0c0 2024-09-15T23:20:52.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.440+0000 7f69eb7fe640 1 --2- 172.21.15.123:0/1030413893 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f69d406c2e0 0x7f69d406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:52.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.440+0000 7f69eb7fe640 1 -- 172.21.15.123:0/1030413893 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f69ec08bcf0 con 0x7f69f415e0c0 2024-09-15T23:20:52.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.440+0000 7f69f2ffd640 1 --2- 172.21.15.123:0/1030413893 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f69d406c2e0 0x7f69d406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:52.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.440+0000 7f69f2ffd640 1 --2- 172.21.15.123:0/1030413893 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f69d406c2e0 0x7f69d406e7a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f69e4000fb0 tx=0x7f69e4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:52.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.444+0000 7f69eb7fe640 1 -- 172.21.15.123:0/1030413893 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f69ec090070 con 0x7f69f415e0c0 2024-09-15T23:20:52.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.672+0000 7f69f94d2640 1 -- 172.21.15.123:0/1030413893 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f69f41f6170 con 0x7f69f415e0c0 2024-09-15T23:20:52.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.673+0000 7f69eb7fe640 1 -- 172.21.15.123:0/1030413893 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1489 (secure 0 0 0) 0x7f69f41f6170 con 0x7f69f415e0c0 2024-09-15T23:20:52.674 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:52.674 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":543,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":154,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":992,"data_bytes":1017842128,"bytes_used":2361106432,"bytes_avail":770733006848,"bytes_total":773094113280,"write_bytes_sec":84762718,"read_op_per_sec":0,"write_op_per_sec":83},"fsmap":{"epoch":93,"btime":"2024-09-15T23:20:31:301251+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":9006}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-09-15T23:20:19.619603+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T23:20:52.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.674+0000 7f69f94d2640 1 -- 172.21.15.123:0/1030413893 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f69d406c2e0 msgr2=0x7f69d406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:52.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.674+0000 7f69f94d2640 1 --2- 172.21.15.123:0/1030413893 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f69d406c2e0 0x7f69d406e7a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f69e4000fb0 tx=0x7f69e4009040 comp rx=0 tx=0).stop 2024-09-15T23:20:52.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.674+0000 7f69f94d2640 1 -- 172.21.15.123:0/1030413893 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69f415e0c0 msgr2=0x7f69f41e9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:52.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.674+0000 7f69f94d2640 1 --2- 172.21.15.123:0/1030413893 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69f415e0c0 0x7f69f41e9510 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f69f408d9c0 tx=0x7f69ec00f580 comp rx=0 tx=0).stop 2024-09-15T23:20:52.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.674+0000 7f69f94d2640 1 -- 172.21.15.123:0/1030413893 shutdown_connections 2024-09-15T23:20:52.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.675+0000 7f69f94d2640 1 --2- 172.21.15.123:0/1030413893 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f69d406c2e0 0x7f69d406e7a0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:52.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.675+0000 7f69f94d2640 1 --2- 172.21.15.123:0/1030413893 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69f415e0c0 0x7f69f41e9510 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:52.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.675+0000 7f69f94d2640 1 --2- 172.21.15.123:0/1030413893 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f69f41f51b0 0x7f69f40ab250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:52.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.675+0000 7f69f94d2640 1 --2- 172.21.15.123:0/1030413893 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f69e0003f60 0x7f69f40cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:52.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.675+0000 7f69f94d2640 1 -- 172.21.15.123:0/1030413893 >> 172.21.15.123:0/1030413893 conn(0x7f69f40d1260 msgr2=0x7f69f40b5360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:52.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.675+0000 7f69f94d2640 1 -- 172.21.15.123:0/1030413893 shutdown_connections 2024-09-15T23:20:52.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:52.675+0000 7f69f94d2640 1 -- 172.21.15.123:0/1030413893 wait complete. 2024-09-15T23:20:52.686 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-15T23:20:53.687 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:20:53.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.794+0000 7f931f59e640 1 Processor -- start 2024-09-15T23:20:53.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.794+0000 7f931f59e640 1 -- start start 2024-09-15T23:20:53.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.795+0000 7f931f59e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f93200b6710 0x7f93200d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:53.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.795+0000 7f931f59e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f93200cf450 0x7f93200b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:53.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.795+0000 7f931f59e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93200d3990 con 0x7f932015e440 2024-09-15T23:20:53.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.795+0000 7f931f59e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f93200d3c70 con 0x7f93200b6710 2024-09-15T23:20:53.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.795+0000 7f931f59e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f93200d3f50 con 0x7f93200cf450 2024-09-15T23:20:53.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.796+0000 7f931ed9d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f93200cf450 0x7f93200b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:53.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.796+0000 7f931dd9b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f93200b6710 0x7f93200d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:53.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.796+0000 7f931e59c640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f932015e440 0x7f93200b6000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:56232/0 (socket says 172.21.15.123:56232) 2024-09-15T23:20:53.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.796+0000 7f931e59c640 1 -- 172.21.15.123:0/2249469874 learned_addr learned my addr 172.21.15.123:0/2249469874 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:53.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.796+0000 7f931ed9d640 1 -- 172.21.15.123:0/2249469874 >> v2:172.21.15.188:3300/0 conn(0x7f93200b6710 msgr2=0x7f93200d3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:53.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.796+0000 7f931ed9d640 1 --2- 172.21.15.123:0/2249469874 >> v2:172.21.15.188:3300/0 conn(0x7f93200b6710 0x7f93200d3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:53.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.796+0000 7f931ed9d640 1 -- 172.21.15.123:0/2249469874 >> v1:172.21.15.188:6789/0 conn(0x7f932015e440 legacy=0x7f93200b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:53.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.796+0000 7f931d59a640 1 -- 172.21.15.123:0/2249469874 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1047414155 0 0) 0x7f93200d3990 con 0x7f932015e440 2024-09-15T23:20:53.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.796+0000 7f931ed9d640 1 -- 172.21.15.123:0/2249469874 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93200d4230 con 0x7f93200cf450 2024-09-15T23:20:53.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.796+0000 7f931dd9b640 1 --2- 172.21.15.123:0/2249469874 >> v2:172.21.15.188:3300/0 conn(0x7f93200b6710 0x7f93200d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:20:53.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.797+0000 7f931ed9d640 1 --2- 172.21.15.123:0/2249469874 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f93200cf450 0x7f93200b7b60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9318009d90 tx=0x7f931802a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ec54167757d91b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:53.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.797+0000 7f931d59a640 1 -- 172.21.15.123:0/2249469874 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9318007740 con 0x7f93200cf450 2024-09-15T23:20:53.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.797+0000 7f931d59a640 1 -- 172.21.15.123:0/2249469874 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93180078e0 con 0x7f93200cf450 2024-09-15T23:20:53.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.797+0000 7f931d59a640 1 -- 172.21.15.123:0/2249469874 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9318007cb0 con 0x7f93200cf450 2024-09-15T23:20:53.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.798+0000 7f931f59e640 1 -- 172.21.15.123:0/2249469874 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f93200cf450 msgr2=0x7f93200b7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:53.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.798+0000 7f931f59e640 1 --2- 172.21.15.123:0/2249469874 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f93200cf450 0x7f93200b7b60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9318009d90 tx=0x7f931802a6f0 comp rx=0 tx=0).stop 2024-09-15T23:20:53.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.798+0000 7f931f59e640 1 -- 172.21.15.123:0/2249469874 shutdown_connections 2024-09-15T23:20:53.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.798+0000 7f931f59e640 1 --2- 172.21.15.123:0/2249469874 >> v2:172.21.15.188:3300/0 conn(0x7f93200b6710 0x7f93200d3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:53.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.798+0000 7f931f59e640 1 --2- 172.21.15.123:0/2249469874 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f93200cf450 0x7f93200b7b60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:53.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.798+0000 7f931f59e640 1 -- 172.21.15.123:0/2249469874 >> 172.21.15.123:0/2249469874 conn(0x7f9320067f80 msgr2=0x7f93200d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:53.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.798+0000 7f931f59e640 1 -- 172.21.15.123:0/2249469874 shutdown_connections 2024-09-15T23:20:53.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.798+0000 7f931f59e640 1 -- 172.21.15.123:0/2249469874 wait complete. 2024-09-15T23:20:53.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.799+0000 7f931f59e640 1 Processor -- start 2024-09-15T23:20:53.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.799+0000 7f931f59e640 1 -- start start 2024-09-15T23:20:53.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.800+0000 7f931f59e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f93200b6710 0x7f93201e9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:53.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.800+0000 7f931f59e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93200cf450 0x7f932014c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:53.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.800+0000 7f931f59e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f932015e440 0x7f932014cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:53.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.800+0000 7f931f59e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f93200b76c0 con 0x7f93200cf450 2024-09-15T23:20:53.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.800+0000 7f931f59e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f93200b7540 con 0x7f932015e440 2024-09-15T23:20:53.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.800+0000 7f931f59e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f93200b80a0 con 0x7f93200b6710 2024-09-15T23:20:53.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.800+0000 7f931dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93200cf450 0x7f932014c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:53.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.800+0000 7f931dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93200cf450 0x7f932014c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36274/0 (socket says 172.21.15.123:36274) 2024-09-15T23:20:53.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.800+0000 7f931dd9b640 1 -- 172.21.15.123:0/812089990 learned_addr learned my addr 172.21.15.123:0/812089990 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:53.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.800+0000 7f931ed9d640 1 --2- 172.21.15.123:0/812089990 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f932015e440 0x7f932014cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:53.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.800+0000 7f931e59c640 1 --2- 172.21.15.123:0/812089990 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f93200b6710 0x7f93201e9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:53.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.801+0000 7f931dd9b640 1 -- 172.21.15.123:0/812089990 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f93200b6710 msgr2=0x7f93201e9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:53.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.801+0000 7f931dd9b640 1 --2- 172.21.15.123:0/812089990 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f93200b6710 0x7f93201e9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:53.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.801+0000 7f931dd9b640 1 -- 172.21.15.123:0/812089990 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f932015e440 msgr2=0x7f932014cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:53.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.801+0000 7f931dd9b640 1 --2- 172.21.15.123:0/812089990 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f932015e440 0x7f932014cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:53.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.801+0000 7f931dd9b640 1 -- 172.21.15.123:0/812089990 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93201e3740 con 0x7f93200cf450 2024-09-15T23:20:53.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.801+0000 7f931ed9d640 1 --2- 172.21.15.123:0/812089990 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f932015e440 0x7f932014cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:20:53.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.801+0000 7f931dd9b640 1 --2- 172.21.15.123:0/812089990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93200cf450 0x7f932014c590 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f931400ebe0 tx=0x7f931400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:53.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.801+0000 7f930effd640 1 -- 172.21.15.123:0/812089990 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9314017070 con 0x7f93200cf450 2024-09-15T23:20:53.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.801+0000 7f930effd640 1 -- 172.21.15.123:0/812089990 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f931400cc30 con 0x7f93200cf450 2024-09-15T23:20:53.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.801+0000 7f931f59e640 1 -- 172.21.15.123:0/812089990 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93200cee20 con 0x7f93200cf450 2024-09-15T23:20:53.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.801+0000 7f930effd640 1 -- 172.21.15.123:0/812089990 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9314013470 con 0x7f93200cf450 2024-09-15T23:20:53.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.801+0000 7f931f59e640 1 -- 172.21.15.123:0/812089990 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93201e3ce0 con 0x7f93200cf450 2024-09-15T23:20:53.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.802+0000 7f931f59e640 1 -- 172.21.15.123:0/812089990 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93200b7b60 con 0x7f93200cf450 2024-09-15T23:20:53.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.802+0000 7f930effd640 1 -- 172.21.15.123:0/812089990 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f931401a070 con 0x7f93200cf450 2024-09-15T23:20:53.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.803+0000 7f930effd640 1 --2- 172.21.15.123:0/812089990 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f930006c2b0 0x7f930006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:53.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.803+0000 7f930effd640 1 -- 172.21.15.123:0/812089990 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f931408b4a0 con 0x7f93200cf450 2024-09-15T23:20:53.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.803+0000 7f931e59c640 1 --2- 172.21.15.123:0/812089990 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f930006c2b0 0x7f930006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:53.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.804+0000 7f931e59c640 1 --2- 172.21.15.123:0/812089990 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f930006c2b0 0x7f930006e770 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f9310000f60 tx=0x7f9310009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:53.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:53.807+0000 7f930effd640 1 -- 172.21.15.123:0/812089990 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9314059b00 con 0x7f93200cf450 2024-09-15T23:20:54.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.005+0000 7f931f59e640 1 -- 172.21.15.123:0/812089990 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9320069b20 con 0x7f93200cf450 2024-09-15T23:20:54.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.006+0000 7f930effd640 1 -- 172.21.15.123:0/812089990 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5236 (secure 0 0 0) 0x7f9314059400 con 0x7f93200cf450 2024-09-15T23:20:54.008 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:54.008 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":93,"btime":"2024-09-15T23:20:31:301251+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7735,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/3725440007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3725440007},{"type":"v1","addr":"172.21.15.188:6836","nonce":3725440007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7738,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2908220643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2908220643},{"type":"v1","addr":"172.21.15.188:6837","nonce":2908220643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":9003,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2302544827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2302544827},{"type":"v1","addr":"172.21.15.123:6834","nonce":2302544827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:20:28.532639+0000","modified":"2024-09-15T23:20:30.630141+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9006":{"gid":9006,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/627322542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":627322542},{"type":"v1","addr":"172.21.15.123:6835","nonce":627322542}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9006,"qdb_cluster":[9006]},"id":10}]} 2024-09-15T23:20:54.008 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 93 2024-09-15T23:20:54.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.008+0000 7f931f59e640 1 -- 172.21.15.123:0/812089990 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f930006c2b0 msgr2=0x7f930006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:54.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.008+0000 7f931f59e640 1 --2- 172.21.15.123:0/812089990 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f930006c2b0 0x7f930006e770 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f9310000f60 tx=0x7f9310009040 comp rx=0 tx=0).stop 2024-09-15T23:20:54.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.008+0000 7f931f59e640 1 -- 172.21.15.123:0/812089990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93200cf450 msgr2=0x7f932014c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:54.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.008+0000 7f931f59e640 1 --2- 172.21.15.123:0/812089990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93200cf450 0x7f932014c590 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f931400ebe0 tx=0x7f931400c520 comp rx=0 tx=0).stop 2024-09-15T23:20:54.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.008+0000 7f931f59e640 1 -- 172.21.15.123:0/812089990 shutdown_connections 2024-09-15T23:20:54.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.008+0000 7f931f59e640 1 --2- 172.21.15.123:0/812089990 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f932015e440 0x7f932014cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:54.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.008+0000 7f931f59e640 1 --2- 172.21.15.123:0/812089990 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f930006c2b0 0x7f930006e770 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:54.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.008+0000 7f931f59e640 1 --2- 172.21.15.123:0/812089990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93200cf450 0x7f932014c590 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:54.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.008+0000 7f931f59e640 1 --2- 172.21.15.123:0/812089990 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f93200b6710 0x7f93201e9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:54.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.008+0000 7f931f59e640 1 -- 172.21.15.123:0/812089990 >> 172.21.15.123:0/812089990 conn(0x7f9320067f80 msgr2=0x7f93200b9820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:54.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.008+0000 7f931f59e640 1 -- 172.21.15.123:0/812089990 shutdown_connections 2024-09-15T23:20:54.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.008+0000 7f931f59e640 1 -- 172.21.15.123:0/812089990 wait complete. 2024-09-15T23:20:54.020 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-15T23:20:54.021 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:20:54.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.114+0000 7fbf6145e640 1 Processor -- start 2024-09-15T23:20:54.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.114+0000 7fbf6145e640 1 -- start start 2024-09-15T23:20:54.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.115+0000 7fbf6145e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf5c15e790 0x7fbf5c073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:54.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.115+0000 7fbf6145e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbf5c162c60 0x7fbf5c0b5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:54.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.115+0000 7fbf6145e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf5c1631c0 con 0x7fbf5c0b5970 2024-09-15T23:20:54.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.115+0000 7fbf6145e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fbf5c15eb70 con 0x7fbf5c162c60 2024-09-15T23:20:54.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.115+0000 7fbf6145e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbf5c0ae9a0 con 0x7fbf5c15e790 2024-09-15T23:20:54.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.115+0000 7fbf527fc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbf5c162c60 0x7fbf5c0b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:54.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.115+0000 7fbf5b7fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fbf5c0b5970 0x7fbf5c06f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:37668/0 (socket says 172.21.15.123:37668) 2024-09-15T23:20:54.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.115+0000 7fbf5b7fe640 1 -- 172.21.15.123:0/2107273672 learned_addr learned my addr 172.21.15.123:0/2107273672 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:54.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.115+0000 7fbf527fc640 1 -- 172.21.15.123:0/2107273672 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf5c15e790 msgr2=0x7fbf5c073a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:54.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.115+0000 7fbf527fc640 1 --2- 172.21.15.123:0/2107273672 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf5c15e790 0x7fbf5c073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:54.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.115+0000 7fbf527fc640 1 -- 172.21.15.123:0/2107273672 >> v1:172.21.15.123:6789/0 conn(0x7fbf5c0b5970 legacy=0x7fbf5c06f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:54.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.115+0000 7fbf527fc640 1 -- 172.21.15.123:0/2107273672 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf5c0aec40 con 0x7fbf5c162c60 2024-09-15T23:20:54.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.115+0000 7fbf5a7fc640 1 -- 172.21.15.123:0/2107273672 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3517682397 0 0) 0x7fbf5c1631c0 con 0x7fbf5c0b5970 2024-09-15T23:20:54.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.116+0000 7fbf527fc640 1 --2- 172.21.15.123:0/2107273672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf5c162c60 0x7fbf5c0b5430 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fbf440097a0 tx=0x7fbf4402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be822de5af45b48 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:54.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.116+0000 7fbf5a7fc640 1 -- 172.21.15.123:0/2107273672 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf44037070 con 0x7fbf5c162c60 2024-09-15T23:20:54.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.116+0000 7fbf5a7fc640 1 -- 172.21.15.123:0/2107273672 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf4402ae50 con 0x7fbf5c162c60 2024-09-15T23:20:54.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.116+0000 7fbf5a7fc640 1 -- 172.21.15.123:0/2107273672 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf44032660 con 0x7fbf5c162c60 2024-09-15T23:20:54.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.117+0000 7fbf6145e640 1 -- 172.21.15.123:0/2107273672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf5c162c60 msgr2=0x7fbf5c0b5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:54.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.117+0000 7fbf6145e640 1 --2- 172.21.15.123:0/2107273672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf5c162c60 0x7fbf5c0b5430 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fbf440097a0 tx=0x7fbf4402a100 comp rx=0 tx=0).stop 2024-09-15T23:20:54.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.117+0000 7fbf6145e640 1 -- 172.21.15.123:0/2107273672 shutdown_connections 2024-09-15T23:20:54.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.117+0000 7fbf6145e640 1 --2- 172.21.15.123:0/2107273672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf5c162c60 0x7fbf5c0b5430 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:54.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.117+0000 7fbf6145e640 1 --2- 172.21.15.123:0/2107273672 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf5c15e790 0x7fbf5c073a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:54.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.117+0000 7fbf6145e640 1 -- 172.21.15.123:0/2107273672 >> 172.21.15.123:0/2107273672 conn(0x7fbf5c0b0a80 msgr2=0x7fbf5c0b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:54.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.117+0000 7fbf6145e640 1 -- 172.21.15.123:0/2107273672 shutdown_connections 2024-09-15T23:20:54.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.117+0000 7fbf6145e640 1 -- 172.21.15.123:0/2107273672 wait complete. 2024-09-15T23:20:54.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.118+0000 7fbf6145e640 1 Processor -- start 2024-09-15T23:20:54.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.118+0000 7fbf6145e640 1 -- start start 2024-09-15T23:20:54.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.119+0000 7fbf6145e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf5c0b5970 0x7fbf5c1f4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:54.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.119+0000 7fbf6145e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf5c15e790 0x7fbf5c154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:54.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.119+0000 7fbf6145e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf5c162c60 0x7fbf5c0cf560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:54.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.119+0000 7fbf6145e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5c06f430 con 0x7fbf5c15e790 2024-09-15T23:20:54.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.119+0000 7fbf6145e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbf5c0af200 con 0x7fbf5c0b5970 2024-09-15T23:20:54.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.119+0000 7fbf6145e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbf5c06fe40 con 0x7fbf5c162c60 2024-09-15T23:20:54.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.119+0000 7fbf527fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf5c15e790 0x7fbf5c154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:54.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.119+0000 7fbf527fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf5c15e790 0x7fbf5c154910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36278/0 (socket says 172.21.15.123:36278) 2024-09-15T23:20:54.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.119+0000 7fbf527fc640 1 -- 172.21.15.123:0/3426167382 learned_addr learned my addr 172.21.15.123:0/3426167382 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:54.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.119+0000 7fbf5b7fe640 1 --2- 172.21.15.123:0/3426167382 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf5c162c60 0x7fbf5c0cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:54.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.119+0000 7fbf5affd640 1 --2- 172.21.15.123:0/3426167382 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf5c0b5970 0x7fbf5c1f4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:54.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.119+0000 7fbf527fc640 1 -- 172.21.15.123:0/3426167382 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf5c162c60 msgr2=0x7fbf5c0cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:54.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.119+0000 7fbf527fc640 1 --2- 172.21.15.123:0/3426167382 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf5c162c60 0x7fbf5c0cf560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:54.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.119+0000 7fbf527fc640 1 -- 172.21.15.123:0/3426167382 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf5c0b5970 msgr2=0x7fbf5c1f4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:54.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.119+0000 7fbf527fc640 1 --2- 172.21.15.123:0/3426167382 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf5c0b5970 0x7fbf5c1f4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:54.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.119+0000 7fbf527fc640 1 -- 172.21.15.123:0/3426167382 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf5c0cdc60 con 0x7fbf5c15e790 2024-09-15T23:20:54.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.119+0000 7fbf5affd640 1 --2- 172.21.15.123:0/3426167382 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf5c0b5970 0x7fbf5c1f4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:54.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.119+0000 7fbf527fc640 1 --2- 172.21.15.123:0/3426167382 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf5c15e790 0x7fbf5c154910 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7fbf44035040 tx=0x7fbf440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:54.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.119+0000 7fbf53fff640 1 -- 172.21.15.123:0/3426167382 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf44042070 con 0x7fbf5c15e790 2024-09-15T23:20:54.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.119+0000 7fbf53fff640 1 -- 172.21.15.123:0/3426167382 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf4403d650 con 0x7fbf5c15e790 2024-09-15T23:20:54.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.119+0000 7fbf53fff640 1 -- 172.21.15.123:0/3426167382 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf44037040 con 0x7fbf5c15e790 2024-09-15T23:20:54.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.119+0000 7fbf6145e640 1 -- 172.21.15.123:0/3426167382 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf5c0cdf40 con 0x7fbf5c15e790 2024-09-15T23:20:54.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.119+0000 7fbf6145e640 1 -- 172.21.15.123:0/3426167382 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf5c0ce500 con 0x7fbf5c15e790 2024-09-15T23:20:54.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.120+0000 7fbf6145e640 1 -- 172.21.15.123:0/3426167382 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf5c073a40 con 0x7fbf5c15e790 2024-09-15T23:20:54.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.121+0000 7fbf53fff640 1 -- 172.21.15.123:0/3426167382 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbf44045070 con 0x7fbf5c15e790 2024-09-15T23:20:54.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.122+0000 7fbf53fff640 1 --2- 172.21.15.123:0/3426167382 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbf3c06c2b0 0x7fbf3c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:54.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.122+0000 7fbf53fff640 1 -- 172.21.15.123:0/3426167382 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7fbf440abb40 con 0x7fbf5c15e790 2024-09-15T23:20:54.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.122+0000 7fbf5affd640 1 --2- 172.21.15.123:0/3426167382 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbf3c06c2b0 0x7fbf3c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:54.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.122+0000 7fbf5affd640 1 --2- 172.21.15.123:0/3426167382 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbf3c06c2b0 0x7fbf3c06e770 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c15d440 tx=0x7fbf4c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:54.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.126+0000 7fbf53fff640 1 -- 172.21.15.123:0/3426167382 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbf4407a3d0 con 0x7fbf5c15e790 2024-09-15T23:20:54.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.355+0000 7fbf6145e640 1 -- 172.21.15.123:0/3426167382 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fbf5c06e9b0 con 0x7fbf5c15e790 2024-09-15T23:20:54.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.357+0000 7fbf53fff640 1 -- 172.21.15.123:0/3426167382 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1490 (secure 0 0 0) 0x7fbf44079cd0 con 0x7fbf5c15e790 2024-09-15T23:20:54.359 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:54.360 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":544,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":154,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076562384,"bytes_used":2556141568,"bytes_avail":770537971712,"bytes_total":773094113280,"write_bytes_sec":81257391,"read_op_per_sec":0,"write_op_per_sec":79},"fsmap":{"epoch":93,"btime":"2024-09-15T23:20:31:301251+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":9006}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-09-15T23:20:19.619603+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T23:20:54.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.359+0000 7fbf6145e640 1 -- 172.21.15.123:0/3426167382 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbf3c06c2b0 msgr2=0x7fbf3c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:54.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.359+0000 7fbf6145e640 1 --2- 172.21.15.123:0/3426167382 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbf3c06c2b0 0x7fbf3c06e770 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c15d440 tx=0x7fbf4c008040 comp rx=0 tx=0).stop 2024-09-15T23:20:54.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.359+0000 7fbf6145e640 1 -- 172.21.15.123:0/3426167382 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf5c15e790 msgr2=0x7fbf5c154910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:54.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.359+0000 7fbf6145e640 1 --2- 172.21.15.123:0/3426167382 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf5c15e790 0x7fbf5c154910 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7fbf44035040 tx=0x7fbf440046c0 comp rx=0 tx=0).stop 2024-09-15T23:20:54.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.360+0000 7fbf6145e640 1 -- 172.21.15.123:0/3426167382 shutdown_connections 2024-09-15T23:20:54.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.360+0000 7fbf6145e640 1 --2- 172.21.15.123:0/3426167382 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf5c162c60 0x7fbf5c0cf560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:54.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.360+0000 7fbf6145e640 1 --2- 172.21.15.123:0/3426167382 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbf3c06c2b0 0x7fbf3c06e770 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:54.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.360+0000 7fbf6145e640 1 --2- 172.21.15.123:0/3426167382 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf5c15e790 0x7fbf5c154910 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:54.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.360+0000 7fbf6145e640 1 --2- 172.21.15.123:0/3426167382 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf5c0b5970 0x7fbf5c1f4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:54.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.360+0000 7fbf6145e640 1 -- 172.21.15.123:0/3426167382 >> 172.21.15.123:0/3426167382 conn(0x7fbf5c0b0a80 msgr2=0x7fbf5c06dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:54.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.360+0000 7fbf6145e640 1 -- 172.21.15.123:0/3426167382 shutdown_connections 2024-09-15T23:20:54.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:54.360+0000 7fbf6145e640 1 -- 172.21.15.123:0/3426167382 wait complete. 2024-09-15T23:20:54.373 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-15T23:20:55.375 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:20:55.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.477+0000 7fd0f2328640 1 Processor -- start 2024-09-15T23:20:55.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.477+0000 7fd0f2328640 1 -- start start 2024-09-15T23:20:55.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.478+0000 7fd0f2328640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd0ec0b49a0 0x7fd0ec071430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:55.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.478+0000 7fd0f2328640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0ec06efb0 0x7fd0ec071970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:55.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.478+0000 7fd0f2328640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0ec072fb0 con 0x7fd0ec1482b0 2024-09-15T23:20:55.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.478+0000 7fd0f2328640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fd0ec073290 con 0x7fd0ec0b49a0 2024-09-15T23:20:55.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.478+0000 7fd0f2328640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd0ec073570 con 0x7fd0ec06efb0 2024-09-15T23:20:55.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.478+0000 7fd0eb7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd0ec0b49a0 0x7fd0ec071430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:55.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.478+0000 7fd0eb7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd0ec0b49a0 0x7fd0ec071430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36288/0 (socket says 172.21.15.123:36288) 2024-09-15T23:20:55.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.478+0000 7fd0eb7fe640 1 -- 172.21.15.123:0/2618183012 learned_addr learned my addr 172.21.15.123:0/2618183012 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:55.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.478+0000 7fd0eb7fe640 1 -- 172.21.15.123:0/2618183012 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0ec06efb0 msgr2=0x7fd0ec071970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:55.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.478+0000 7fd0f08c5640 1 --2- 172.21.15.123:0/2618183012 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0ec06efb0 0x7fd0ec071970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:55.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.478+0000 7fd0eb7fe640 1 --2- 172.21.15.123:0/2618183012 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0ec06efb0 0x7fd0ec071970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:55.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.478+0000 7fd0eb7fe640 1 -- 172.21.15.123:0/2618183012 >> v1:172.21.15.188:6789/0 conn(0x7fd0ec1482b0 legacy=0x7fd0ec0b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:55.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.478+0000 7fd0eb7fe640 1 -- 172.21.15.123:0/2618183012 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0ec06da80 con 0x7fd0ec0b49a0 2024-09-15T23:20:55.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.478+0000 7fd0f08c5640 1 --2- 172.21.15.123:0/2618183012 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0ec06efb0 0x7fd0ec071970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:20:55.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.479+0000 7fd0eb7fe640 1 --2- 172.21.15.123:0/2618183012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd0ec0b49a0 0x7fd0ec071430 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec0b3410 tx=0x7fd0e002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3791610ef4b177a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:55.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.479+0000 7fd0eaffd640 1 -- 172.21.15.123:0/2618183012 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0037070 con 0x7fd0ec0b49a0 2024-09-15T23:20:55.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.479+0000 7fd0eaffd640 1 -- 172.21.15.123:0/2618183012 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0e002ae50 con 0x7fd0ec0b49a0 2024-09-15T23:20:55.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.479+0000 7fd0eaffd640 1 -- 172.21.15.123:0/2618183012 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0032660 con 0x7fd0ec0b49a0 2024-09-15T23:20:55.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.480+0000 7fd0f2328640 1 -- 172.21.15.123:0/2618183012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd0ec0b49a0 msgr2=0x7fd0ec071430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:55.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.480+0000 7fd0f2328640 1 --2- 172.21.15.123:0/2618183012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd0ec0b49a0 0x7fd0ec071430 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec0b3410 tx=0x7fd0e002a140 comp rx=0 tx=0).stop 2024-09-15T23:20:55.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.480+0000 7fd0f2328640 1 -- 172.21.15.123:0/2618183012 shutdown_connections 2024-09-15T23:20:55.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.480+0000 7fd0f2328640 1 --2- 172.21.15.123:0/2618183012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd0ec0b49a0 0x7fd0ec071430 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:55.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.480+0000 7fd0f2328640 1 --2- 172.21.15.123:0/2618183012 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0ec06efb0 0x7fd0ec071970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:55.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.480+0000 7fd0f2328640 1 -- 172.21.15.123:0/2618183012 >> 172.21.15.123:0/2618183012 conn(0x7fd0ec06c240 msgr2=0x7fd0ec0b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:55.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.480+0000 7fd0f2328640 1 -- 172.21.15.123:0/2618183012 shutdown_connections 2024-09-15T23:20:55.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.480+0000 7fd0f2328640 1 -- 172.21.15.123:0/2618183012 wait complete. 2024-09-15T23:20:55.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.481+0000 7fd0f2328640 1 Processor -- start 2024-09-15T23:20:55.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.481+0000 7fd0f2328640 1 -- start start 2024-09-15T23:20:55.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.482+0000 7fd0f2328640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0ec06efb0 0x7fd0ec141360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:55.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.482+0000 7fd0f2328640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd0ec0b49a0 0x7fd0ec0c5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:55.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.482+0000 7fd0f2328640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0ec1482b0 0x7fd0ec143de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:55.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.482+0000 7fd0f2328640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd0ec06d6a0 con 0x7fd0ec0b49a0 2024-09-15T23:20:55.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.482+0000 7fd0f2328640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd0ec148690 con 0x7fd0ec06efb0 2024-09-15T23:20:55.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.482+0000 7fd0f2328640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd0ec06d820 con 0x7fd0ec1482b0 2024-09-15T23:20:55.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.482+0000 7fd0eb7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd0ec0b49a0 0x7fd0ec0c5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:55.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.482+0000 7fd0eb7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd0ec0b49a0 0x7fd0ec0c5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36290/0 (socket says 172.21.15.123:36290) 2024-09-15T23:20:55.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.482+0000 7fd0eb7fe640 1 -- 172.21.15.123:0/1652162327 learned_addr learned my addr 172.21.15.123:0/1652162327 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:55.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.482+0000 7fd0eb7fe640 1 -- 172.21.15.123:0/1652162327 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0ec1482b0 msgr2=0x7fd0ec143de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:55.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.482+0000 7fd0f08c5640 1 --2- 172.21.15.123:0/1652162327 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0ec1482b0 0x7fd0ec143de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:55.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.482+0000 7fd0ebfff640 1 --2- 172.21.15.123:0/1652162327 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0ec06efb0 0x7fd0ec141360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:55.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.482+0000 7fd0eb7fe640 1 --2- 172.21.15.123:0/1652162327 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0ec1482b0 0x7fd0ec143de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:55.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.482+0000 7fd0eb7fe640 1 -- 172.21.15.123:0/1652162327 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0ec06efb0 msgr2=0x7fd0ec141360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:55.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.482+0000 7fd0eb7fe640 1 --2- 172.21.15.123:0/1652162327 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0ec06efb0 0x7fd0ec141360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:55.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.482+0000 7fd0eb7fe640 1 -- 172.21.15.123:0/1652162327 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0ec152710 con 0x7fd0ec0b49a0 2024-09-15T23:20:55.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.483+0000 7fd0eb7fe640 1 --2- 172.21.15.123:0/1652162327 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd0ec0b49a0 0x7fd0ec0c5780 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0000c00 tx=0x7fd0e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:55.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.483+0000 7fd0e8ff9640 1 -- 172.21.15.123:0/1652162327 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0042070 con 0x7fd0ec0b49a0 2024-09-15T23:20:55.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.483+0000 7fd0e8ff9640 1 -- 172.21.15.123:0/1652162327 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0e003e670 con 0x7fd0ec0b49a0 2024-09-15T23:20:55.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.483+0000 7fd0f2328640 1 -- 172.21.15.123:0/1652162327 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0ec1529f0 con 0x7fd0ec0b49a0 2024-09-15T23:20:55.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.483+0000 7fd0e8ff9640 1 -- 172.21.15.123:0/1652162327 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0037040 con 0x7fd0ec0b49a0 2024-09-15T23:20:55.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.483+0000 7fd0f2328640 1 -- 172.21.15.123:0/1652162327 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0ec1418a0 con 0x7fd0ec0b49a0 2024-09-15T23:20:55.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.484+0000 7fd0f2328640 1 -- 172.21.15.123:0/1652162327 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0ec0b4290 con 0x7fd0ec0b49a0 2024-09-15T23:20:55.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.484+0000 7fd0e8ff9640 1 -- 172.21.15.123:0/1652162327 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd0e0045070 con 0x7fd0ec0b49a0 2024-09-15T23:20:55.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.485+0000 7fd0e8ff9640 1 --2- 172.21.15.123:0/1652162327 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd0d806c2b0 0x7fd0d806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:55.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.485+0000 7fd0e8ff9640 1 -- 172.21.15.123:0/1652162327 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 5767+0+0 (secure 0 0 0) 0x7fd0e00abd60 con 0x7fd0ec0b49a0 2024-09-15T23:20:55.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.485+0000 7fd0ebfff640 1 --2- 172.21.15.123:0/1652162327 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd0d806c2b0 0x7fd0d806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:55.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.486+0000 7fd0ebfff640 1 --2- 172.21.15.123:0/1652162327 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd0d806c2b0 0x7fd0d806e770 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc00a750 tx=0x7fd0dc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:55.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.489+0000 7fd0e8ff9640 1 -- 172.21.15.123:0/1652162327 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd0e007a490 con 0x7fd0ec0b49a0 2024-09-15T23:20:55.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.690+0000 7fd0f2328640 1 -- 172.21.15.123:0/1652162327 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd0ec0b2a40 con 0x7fd0ec0b49a0 2024-09-15T23:20:55.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.691+0000 7fd0e8ff9640 1 -- 172.21.15.123:0/1652162327 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5236 (secure 0 0 0) 0x7fd0e0079d90 con 0x7fd0ec0b49a0 2024-09-15T23:20:55.693 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:55.693 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":93,"btime":"2024-09-15T23:20:31:301251+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7735,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/3725440007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3725440007},{"type":"v1","addr":"172.21.15.188:6836","nonce":3725440007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7738,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2908220643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2908220643},{"type":"v1","addr":"172.21.15.188:6837","nonce":2908220643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":9003,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2302544827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2302544827},{"type":"v1","addr":"172.21.15.123:6834","nonce":2302544827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:20:28.532639+0000","modified":"2024-09-15T23:20:30.630141+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9006":{"gid":9006,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/627322542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":627322542},{"type":"v1","addr":"172.21.15.123:6835","nonce":627322542}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9006,"qdb_cluster":[9006]},"id":10}]} 2024-09-15T23:20:55.693 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 93 2024-09-15T23:20:55.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.693+0000 7fd0f2328640 1 -- 172.21.15.123:0/1652162327 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd0d806c2b0 msgr2=0x7fd0d806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:55.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.693+0000 7fd0f2328640 1 --2- 172.21.15.123:0/1652162327 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd0d806c2b0 0x7fd0d806e770 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc00a750 tx=0x7fd0dc008040 comp rx=0 tx=0).stop 2024-09-15T23:20:55.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.693+0000 7fd0f2328640 1 -- 172.21.15.123:0/1652162327 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd0ec0b49a0 msgr2=0x7fd0ec0c5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:55.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.693+0000 7fd0f2328640 1 --2- 172.21.15.123:0/1652162327 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd0ec0b49a0 0x7fd0ec0c5780 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0000c00 tx=0x7fd0e00046c0 comp rx=0 tx=0).stop 2024-09-15T23:20:55.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.693+0000 7fd0f2328640 1 -- 172.21.15.123:0/1652162327 shutdown_connections 2024-09-15T23:20:55.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.693+0000 7fd0f2328640 1 --2- 172.21.15.123:0/1652162327 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd0ec1482b0 0x7fd0ec143de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:55.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.693+0000 7fd0f2328640 1 --2- 172.21.15.123:0/1652162327 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd0d806c2b0 0x7fd0d806e770 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:55.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.693+0000 7fd0f2328640 1 --2- 172.21.15.123:0/1652162327 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd0ec0b49a0 0x7fd0ec0c5780 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:55.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.693+0000 7fd0f2328640 1 --2- 172.21.15.123:0/1652162327 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd0ec06efb0 0x7fd0ec141360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:55.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.693+0000 7fd0f2328640 1 -- 172.21.15.123:0/1652162327 >> 172.21.15.123:0/1652162327 conn(0x7fd0ec06c240 msgr2=0x7fd0ec161550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:55.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.693+0000 7fd0f2328640 1 -- 172.21.15.123:0/1652162327 shutdown_connections 2024-09-15T23:20:55.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.693+0000 7fd0f2328640 1 -- 172.21.15.123:0/1652162327 wait complete. 2024-09-15T23:20:55.706 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-15T23:20:55.706 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:20:55.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.801+0000 7f3cb1918640 1 Processor -- start 2024-09-15T23:20:55.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.801+0000 7f3cb1918640 1 -- start start 2024-09-15T23:20:55.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.802+0000 7f3cb1918640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3cac0b42c0 0x7f3cac160040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:55.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.802+0000 7f3cb1918640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3cac0d0230 0x7f3cac0b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:55.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.802+0000 7f3cb1918640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cac0cdbc0 con 0x7f3cac15d150 2024-09-15T23:20:55.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.802+0000 7f3cb1918640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f3cac0d0690 con 0x7f3cac0b42c0 2024-09-15T23:20:55.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.802+0000 7f3cb1918640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f3cac0b4be0 con 0x7f3cac0d0230 2024-09-15T23:20:55.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.802+0000 7f3caaffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3cac0b42c0 0x7f3cac160040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:55.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.802+0000 7f3caaffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3cac0b42c0 0x7f3cac160040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36304/0 (socket says 172.21.15.123:36304) 2024-09-15T23:20:55.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.802+0000 7f3caaffd640 1 -- 172.21.15.123:0/2478292327 learned_addr learned my addr 172.21.15.123:0/2478292327 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:55.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.803+0000 7f3caa7fc640 1 --2- 172.21.15.123:0/2478292327 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3cac0d0230 0x7f3cac0b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:55.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.803+0000 7f3caaffd640 1 -- 172.21.15.123:0/2478292327 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3cac0d0230 msgr2=0x7f3cac0b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:55.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.803+0000 7f3caaffd640 1 --2- 172.21.15.123:0/2478292327 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3cac0d0230 0x7f3cac0b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:55.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.803+0000 7f3caaffd640 1 -- 172.21.15.123:0/2478292327 >> v1:172.21.15.188:6789/0 conn(0x7f3cac15d150 legacy=0x7f3cac0ce360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:55.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.803+0000 7f3caaffd640 1 -- 172.21.15.123:0/2478292327 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cac1606d0 con 0x7f3cac0b42c0 2024-09-15T23:20:55.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.803+0000 7f3caaffd640 1 --2- 172.21.15.123:0/2478292327 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3cac0b42c0 0x7f3cac160040 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4009870 tx=0x7f3ca402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab6bc5793336bd00 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:55.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.804+0000 7f3ca9ffb640 1 -- 172.21.15.123:0/2478292327 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4037070 con 0x7f3cac0b42c0 2024-09-15T23:20:55.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.804+0000 7f3ca9ffb640 1 -- 172.21.15.123:0/2478292327 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ca4032440 con 0x7f3cac0b42c0 2024-09-15T23:20:55.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.804+0000 7f3ca9ffb640 1 -- 172.21.15.123:0/2478292327 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4032810 con 0x7f3cac0b42c0 2024-09-15T23:20:55.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.804+0000 7f3cb1918640 1 -- 172.21.15.123:0/2478292327 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3cac0b42c0 msgr2=0x7f3cac160040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:55.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.804+0000 7f3cb1918640 1 --2- 172.21.15.123:0/2478292327 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3cac0b42c0 0x7f3cac160040 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4009870 tx=0x7f3ca402a270 comp rx=0 tx=0).stop 2024-09-15T23:20:55.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.804+0000 7f3cb1918640 1 -- 172.21.15.123:0/2478292327 shutdown_connections 2024-09-15T23:20:55.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.804+0000 7f3cb1918640 1 --2- 172.21.15.123:0/2478292327 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3cac0d0230 0x7f3cac0b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:55.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.804+0000 7f3cb1918640 1 --2- 172.21.15.123:0/2478292327 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3cac0b42c0 0x7f3cac160040 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:55.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.804+0000 7f3cb1918640 1 -- 172.21.15.123:0/2478292327 >> 172.21.15.123:0/2478292327 conn(0x7f3cac067950 msgr2=0x7f3cac067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:55.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.804+0000 7f3cb1918640 1 -- 172.21.15.123:0/2478292327 shutdown_connections 2024-09-15T23:20:55.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.804+0000 7f3cb1918640 1 -- 172.21.15.123:0/2478292327 wait complete. 2024-09-15T23:20:55.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.805+0000 7f3cb1918640 1 Processor -- start 2024-09-15T23:20:55.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.806+0000 7f3cb1918640 1 -- start start 2024-09-15T23:20:55.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.806+0000 7f3cb1918640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3cac0b42c0 0x7f3cac147270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:55.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.806+0000 7f3cb1918640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3cac0d0230 0x7f3cac0b7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:55.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.806+0000 7f3cb1918640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3cac15d150 0x7f3cac0b6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:55.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.806+0000 7f3cb1918640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3cac0cde40 con 0x7f3cac0d0230 2024-09-15T23:20:55.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.806+0000 7f3cb1918640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3cac160c90 con 0x7f3cac0b42c0 2024-09-15T23:20:55.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.806+0000 7f3cb1918640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f3cac15d5e0 con 0x7f3cac15d150 2024-09-15T23:20:55.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.806+0000 7f3caa7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3cac0d0230 0x7f3cac0b7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:55.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.806+0000 7f3caa7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3cac0d0230 0x7f3cac0b7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36316/0 (socket says 172.21.15.123:36316) 2024-09-15T23:20:55.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.806+0000 7f3caa7fc640 1 -- 172.21.15.123:0/1460848147 learned_addr learned my addr 172.21.15.123:0/1460848147 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:55.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.806+0000 7f3caaffd640 1 --2- 172.21.15.123:0/1460848147 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3cac0b42c0 0x7f3cac147270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:55.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.806+0000 7f3cab7fe640 1 --2- 172.21.15.123:0/1460848147 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3cac15d150 0x7f3cac0b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:55.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.807+0000 7f3caa7fc640 1 -- 172.21.15.123:0/1460848147 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3cac15d150 msgr2=0x7f3cac0b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:55.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.807+0000 7f3caa7fc640 1 --2- 172.21.15.123:0/1460848147 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3cac15d150 0x7f3cac0b6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:55.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.807+0000 7f3caa7fc640 1 -- 172.21.15.123:0/1460848147 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3cac0b42c0 msgr2=0x7f3cac147270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:55.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.807+0000 7f3caa7fc640 1 --2- 172.21.15.123:0/1460848147 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3cac0b42c0 0x7f3cac147270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:55.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.807+0000 7f3caa7fc640 1 -- 172.21.15.123:0/1460848147 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cac0b6a20 con 0x7f3cac0d0230 2024-09-15T23:20:55.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.807+0000 7f3cab7fe640 1 --2- 172.21.15.123:0/1460848147 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3cac15d150 0x7f3cac0b6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:55.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.807+0000 7f3caa7fc640 1 --2- 172.21.15.123:0/1460848147 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3cac0d0230 0x7f3cac0b7ac0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0007ef0 tx=0x7f3ca000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:55.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.807+0000 7f3c93fff640 1 -- 172.21.15.123:0/1460848147 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca0014620 con 0x7f3cac0d0230 2024-09-15T23:20:55.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.807+0000 7f3c93fff640 1 -- 172.21.15.123:0/1460848147 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ca0019070 con 0x7f3cac0d0230 2024-09-15T23:20:55.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.807+0000 7f3cb1918640 1 -- 172.21.15.123:0/1460848147 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cac0b6d00 con 0x7f3cac0d0230 2024-09-15T23:20:55.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.807+0000 7f3c93fff640 1 -- 172.21.15.123:0/1460848147 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca0014a00 con 0x7f3cac0d0230 2024-09-15T23:20:55.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.807+0000 7f3cb1918640 1 -- 172.21.15.123:0/1460848147 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cac0b72c0 con 0x7f3cac0d0230 2024-09-15T23:20:55.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.808+0000 7f3cb1918640 1 -- 172.21.15.123:0/1460848147 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cac0b46a0 con 0x7f3cac0d0230 2024-09-15T23:20:55.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.808+0000 7f3c93fff640 1 -- 172.21.15.123:0/1460848147 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3ca0014ba0 con 0x7f3cac0d0230 2024-09-15T23:20:55.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.809+0000 7f3c93fff640 1 --2- 172.21.15.123:0/1460848147 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3c9806c2b0 0x7f3c9806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:55.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.809+0000 7f3c93fff640 1 -- 172.21.15.123:0/1460848147 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 5767+0+0 (secure 0 0 0) 0x7f3ca008bd90 con 0x7f3cac0d0230 2024-09-15T23:20:55.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.809+0000 7f3caaffd640 1 --2- 172.21.15.123:0/1460848147 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3c9806c2b0 0x7f3c9806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:55.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.810+0000 7f3caaffd640 1 --2- 172.21.15.123:0/1460848147 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3c9806c2b0 0x7f3c9806e770 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4034000 tx=0x7f3ca402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:55.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:55.813+0000 7f3c93fff640 1 -- 172.21.15.123:0/1460848147 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3ca005a430 con 0x7f3cac0d0230 2024-09-15T23:20:56.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:56.043+0000 7f3cb1918640 1 -- 172.21.15.123:0/1460848147 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f3cac0cf520 con 0x7f3cac0d0230 2024-09-15T23:20:56.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:56.043+0000 7f3c93fff640 1 -- 172.21.15.123:0/1460848147 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1490 (secure 0 0 0) 0x7f3ca0059d30 con 0x7f3cac0d0230 2024-09-15T23:20:56.046 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:56.046 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":546,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":155,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076562384,"bytes_used":2556141568,"bytes_avail":770537971712,"bytes_total":773094113280,"write_bytes_sec":81257391,"read_op_per_sec":0,"write_op_per_sec":79},"fsmap":{"epoch":93,"btime":"2024-09-15T23:20:31:301251+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":9006}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-09-15T23:20:19.619603+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T23:20:56.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:56.045+0000 7f3cb1918640 1 -- 172.21.15.123:0/1460848147 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3c9806c2b0 msgr2=0x7f3c9806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:56.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:56.045+0000 7f3cb1918640 1 --2- 172.21.15.123:0/1460848147 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3c9806c2b0 0x7f3c9806e770 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4034000 tx=0x7f3ca402e000 comp rx=0 tx=0).stop 2024-09-15T23:20:56.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:56.045+0000 7f3cb1918640 1 -- 172.21.15.123:0/1460848147 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3cac0d0230 msgr2=0x7f3cac0b7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:56.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:56.045+0000 7f3cb1918640 1 --2- 172.21.15.123:0/1460848147 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3cac0d0230 0x7f3cac0b7ac0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0007ef0 tx=0x7f3ca000e4b0 comp rx=0 tx=0).stop 2024-09-15T23:20:56.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:56.045+0000 7f3cb1918640 1 -- 172.21.15.123:0/1460848147 shutdown_connections 2024-09-15T23:20:56.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:56.045+0000 7f3cb1918640 1 --2- 172.21.15.123:0/1460848147 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3cac15d150 0x7f3cac0b6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:56.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:56.045+0000 7f3cb1918640 1 --2- 172.21.15.123:0/1460848147 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3c9806c2b0 0x7f3c9806e770 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:56.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:56.045+0000 7f3cb1918640 1 --2- 172.21.15.123:0/1460848147 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3cac0d0230 0x7f3cac0b7ac0 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:56.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:56.045+0000 7f3cb1918640 1 --2- 172.21.15.123:0/1460848147 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3cac0b42c0 0x7f3cac147270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:56.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:56.045+0000 7f3cb1918640 1 -- 172.21.15.123:0/1460848147 >> 172.21.15.123:0/1460848147 conn(0x7f3cac067950 msgr2=0x7f3cac1567a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:56.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:56.046+0000 7f3cb1918640 1 -- 172.21.15.123:0/1460848147 shutdown_connections 2024-09-15T23:20:56.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:56.046+0000 7f3cb1918640 1 -- 172.21.15.123:0/1460848147 wait complete. 2024-09-15T23:20:56.058 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-15T23:20:57.059 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:20:57.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.170+0000 7f6a234b7640 1 Processor -- start 2024-09-15T23:20:57.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.170+0000 7f6a234b7640 1 -- start start 2024-09-15T23:20:57.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.171+0000 7f6a234b7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6a1c073890 0x7f6a1c0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:57.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.171+0000 7f6a234b7640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a1c0b4020 con 0x7f6a1c145ed0 2024-09-15T23:20:57.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.171+0000 7f6a234b7640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a1c0b42c0 con 0x7f6a1c0b5880 2024-09-15T23:20:57.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.171+0000 7f6a234b7640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f6a1c0b63f0 con 0x7f6a1c073890 2024-09-15T23:20:57.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.171+0000 7f6a20a52640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6a1c073890 0x7f6a1c0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:57.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.171+0000 7f6a21253640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6a1c145ed0 0x7f6a1c073180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60082/0 (socket says 172.21.15.123:60082) 2024-09-15T23:20:57.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.171+0000 7f6a20a52640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6a1c073890 0x7f6a1c0b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42430/0 (socket says 172.21.15.123:42430) 2024-09-15T23:20:57.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.171+0000 7f6a21253640 1 -- 172.21.15.123:0/661320374 learned_addr learned my addr 172.21.15.123:0/661320374 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:57.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.172+0000 7f6a20a52640 1 -- 172.21.15.123:0/661320374 >> v1:172.21.15.188:6789/0 conn(0x7f6a1c0b5880 legacy=0x7f6a1c0b5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:57.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.172+0000 7f6a20a52640 1 -- 172.21.15.123:0/661320374 >> v1:172.21.15.123:6789/0 conn(0x7f6a1c145ed0 legacy=0x7f6a1c073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:57.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.172+0000 7f6a20a52640 1 -- 172.21.15.123:0/661320374 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a1c0b45a0 con 0x7f6a1c073890 2024-09-15T23:20:57.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.172+0000 7f6a20a52640 1 --2- 172.21.15.123:0/661320374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a1c073890 0x7f6a1c0b5080 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c0097a0 tx=0x7f6a0c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec3724a7ffb654ff server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:57.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.173+0000 7f6a13fff640 1 -- 172.21.15.123:0/661320374 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c037070 con 0x7f6a1c073890 2024-09-15T23:20:57.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.173+0000 7f6a13fff640 1 -- 172.21.15.123:0/661320374 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a0c032440 con 0x7f6a1c073890 2024-09-15T23:20:57.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.173+0000 7f6a13fff640 1 -- 172.21.15.123:0/661320374 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c032810 con 0x7f6a1c073890 2024-09-15T23:20:57.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.173+0000 7f6a234b7640 1 -- 172.21.15.123:0/661320374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a1c073890 msgr2=0x7f6a1c0b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:57.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.173+0000 7f6a234b7640 1 --2- 172.21.15.123:0/661320374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a1c073890 0x7f6a1c0b5080 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c0097a0 tx=0x7f6a0c02a1e0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.173+0000 7f6a234b7640 1 -- 172.21.15.123:0/661320374 shutdown_connections 2024-09-15T23:20:57.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.173+0000 7f6a234b7640 1 --2- 172.21.15.123:0/661320374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a1c073890 0x7f6a1c0b5080 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.173+0000 7f6a234b7640 1 -- 172.21.15.123:0/661320374 >> 172.21.15.123:0/661320374 conn(0x7f6a1c0ccec0 msgr2=0x7f6a1c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:57.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.173+0000 7f6a234b7640 1 -- 172.21.15.123:0/661320374 shutdown_connections 2024-09-15T23:20:57.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.173+0000 7f6a234b7640 1 -- 172.21.15.123:0/661320374 wait complete. 2024-09-15T23:20:57.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.174+0000 7f6a234b7640 1 Processor -- start 2024-09-15T23:20:57.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.175+0000 7f6a234b7640 1 -- start start 2024-09-15T23:20:57.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.175+0000 7f6a234b7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a1c073890 0x7f6a1c0cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:57.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.175+0000 7f6a234b7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a1c0b5880 0x7f6a1c1eaf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:57.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.175+0000 7f6a234b7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a1c145ed0 0x7f6a1c1f7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:57.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.175+0000 7f6a234b7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1c1462b0 con 0x7f6a1c073890 2024-09-15T23:20:57.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.175+0000 7f6a234b7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1c0b4b60 con 0x7f6a1c145ed0 2024-09-15T23:20:57.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.175+0000 7f6a234b7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6a1c146430 con 0x7f6a1c0b5880 2024-09-15T23:20:57.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.175+0000 7f6a21253640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a1c073890 0x7f6a1c0cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:57.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.175+0000 7f6a21253640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a1c073890 0x7f6a1c0cbc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42442/0 (socket says 172.21.15.123:42442) 2024-09-15T23:20:57.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.175+0000 7f6a21253640 1 -- 172.21.15.123:0/3510766540 learned_addr learned my addr 172.21.15.123:0/3510766540 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:57.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.176+0000 7f6a21a54640 1 --2- 172.21.15.123:0/3510766540 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a1c145ed0 0x7f6a1c1f7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:57.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.176+0000 7f6a20a52640 1 --2- 172.21.15.123:0/3510766540 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a1c0b5880 0x7f6a1c1eaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:57.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.176+0000 7f6a21253640 1 -- 172.21.15.123:0/3510766540 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a1c0b5880 msgr2=0x7f6a1c1eaf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:57.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.176+0000 7f6a21253640 1 --2- 172.21.15.123:0/3510766540 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a1c0b5880 0x7f6a1c1eaf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.176+0000 7f6a21253640 1 -- 172.21.15.123:0/3510766540 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a1c145ed0 msgr2=0x7f6a1c1f7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:57.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.176+0000 7f6a21253640 1 --2- 172.21.15.123:0/3510766540 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a1c145ed0 0x7f6a1c1f7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.176+0000 7f6a21253640 1 -- 172.21.15.123:0/3510766540 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a1c0caba0 con 0x7f6a1c073890 2024-09-15T23:20:57.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.176+0000 7f6a21a54640 1 --2- 172.21.15.123:0/3510766540 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a1c145ed0 0x7f6a1c1f7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:57.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.176+0000 7f6a21253640 1 --2- 172.21.15.123:0/3510766540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a1c073890 0x7f6a1c0cbc40 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f6a1800c3c0 tx=0x7f6a1800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:57.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.176+0000 7f6a11ffb640 1 -- 172.21.15.123:0/3510766540 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a18017070 con 0x7f6a1c073890 2024-09-15T23:20:57.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.176+0000 7f6a11ffb640 1 -- 172.21.15.123:0/3510766540 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a18005ce0 con 0x7f6a1c073890 2024-09-15T23:20:57.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.176+0000 7f6a11ffb640 1 -- 172.21.15.123:0/3510766540 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a18007310 con 0x7f6a1c073890 2024-09-15T23:20:57.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.176+0000 7f6a234b7640 1 -- 172.21.15.123:0/3510766540 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a1c0cae80 con 0x7f6a1c073890 2024-09-15T23:20:57.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.177+0000 7f6a234b7640 1 -- 172.21.15.123:0/3510766540 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a1c0cb440 con 0x7f6a1c073890 2024-09-15T23:20:57.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.178+0000 7f6a234b7640 1 -- 172.21.15.123:0/3510766540 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a1c0b5080 con 0x7f6a1c073890 2024-09-15T23:20:57.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.178+0000 7f6a11ffb640 1 -- 172.21.15.123:0/3510766540 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6a1801a070 con 0x7f6a1c073890 2024-09-15T23:20:57.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.178+0000 7f6a11ffb640 1 --2- 172.21.15.123:0/3510766540 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6a0006c2b0 0x7f6a0006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:57.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.178+0000 7f6a11ffb640 1 -- 172.21.15.123:0/3510766540 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(155..155 src has 1..155) ==== 5767+0+0 (secure 0 0 0) 0x7f6a1808a7c0 con 0x7f6a1c073890 2024-09-15T23:20:57.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.179+0000 7f6a20a52640 1 --2- 172.21.15.123:0/3510766540 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6a0006c2b0 0x7f6a0006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:57.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.179+0000 7f6a20a52640 1 --2- 172.21.15.123:0/3510766540 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6a0006c2b0 0x7f6a0006e770 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c034000 tx=0x7f6a0c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:57.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.183+0000 7f6a11ffb640 1 -- 172.21.15.123:0/3510766540 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6a18058f80 con 0x7f6a1c073890 2024-09-15T23:20:57.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.385+0000 7f6a234b7640 1 -- 172.21.15.123:0/3510766540 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a1c142b60 con 0x7f6a1c073890 2024-09-15T23:20:57.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.386+0000 7f6a11ffb640 1 -- 172.21.15.123:0/3510766540 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5236 (secure 0 0 0) 0x7f6a18058880 con 0x7f6a1c073890 2024-09-15T23:20:57.389 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:57.389 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":93,"btime":"2024-09-15T23:20:31:301251+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7735,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/3725440007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3725440007},{"type":"v1","addr":"172.21.15.188:6836","nonce":3725440007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7738,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2908220643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2908220643},{"type":"v1","addr":"172.21.15.188:6837","nonce":2908220643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":9003,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2302544827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2302544827},{"type":"v1","addr":"172.21.15.123:6834","nonce":2302544827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:20:28.532639+0000","modified":"2024-09-15T23:20:30.630141+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9006":{"gid":9006,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/627322542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":627322542},{"type":"v1","addr":"172.21.15.123:6835","nonce":627322542}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9006,"qdb_cluster":[9006]},"id":10}]} 2024-09-15T23:20:57.389 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 93 2024-09-15T23:20:57.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.389+0000 7f6a234b7640 1 -- 172.21.15.123:0/3510766540 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6a0006c2b0 msgr2=0x7f6a0006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:57.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.389+0000 7f6a234b7640 1 --2- 172.21.15.123:0/3510766540 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6a0006c2b0 0x7f6a0006e770 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c034000 tx=0x7f6a0c02e000 comp rx=0 tx=0).stop 2024-09-15T23:20:57.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.389+0000 7f6a234b7640 1 -- 172.21.15.123:0/3510766540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a1c073890 msgr2=0x7f6a1c0cbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:57.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.389+0000 7f6a234b7640 1 --2- 172.21.15.123:0/3510766540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a1c073890 0x7f6a1c0cbc40 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f6a1800c3c0 tx=0x7f6a1800c880 comp rx=0 tx=0).stop 2024-09-15T23:20:57.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.389+0000 7f6a234b7640 1 -- 172.21.15.123:0/3510766540 shutdown_connections 2024-09-15T23:20:57.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.389+0000 7f6a234b7640 1 --2- 172.21.15.123:0/3510766540 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a1c145ed0 0x7f6a1c1f7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.389+0000 7f6a234b7640 1 --2- 172.21.15.123:0/3510766540 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a1c0b5880 0x7f6a1c1eaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.389+0000 7f6a234b7640 1 --2- 172.21.15.123:0/3510766540 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6a0006c2b0 0x7f6a0006e770 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.389+0000 7f6a234b7640 1 --2- 172.21.15.123:0/3510766540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a1c073890 0x7f6a1c0cbc40 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.389+0000 7f6a234b7640 1 -- 172.21.15.123:0/3510766540 >> 172.21.15.123:0/3510766540 conn(0x7f6a1c0ccec0 msgr2=0x7f6a1c0ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:57.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.389+0000 7f6a234b7640 1 -- 172.21.15.123:0/3510766540 shutdown_connections 2024-09-15T23:20:57.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.389+0000 7f6a234b7640 1 -- 172.21.15.123:0/3510766540 wait complete. 2024-09-15T23:20:57.404 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-15T23:20:57.404 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:20:57.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.505+0000 7f06005e4640 1 Processor -- start 2024-09-15T23:20:57.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.505+0000 7f06005e4640 1 -- start start 2024-09-15T23:20:57.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.506+0000 7f06005e4640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f05f815eb60 0x7f05f815ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:57.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.506+0000 7f06005e4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f05f80b66a0 0x7f05f80b6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:57.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.506+0000 7f06005e4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05f80b7030 con 0x7f05f81624b0 2024-09-15T23:20:57.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.506+0000 7f06005e4640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f05f815f590 con 0x7f05f80b66a0 2024-09-15T23:20:57.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.506+0000 7f06005e4640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f05f815f870 con 0x7f05f815eb60 2024-09-15T23:20:57.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.506+0000 7f05feb81640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f05f80b66a0 0x7f05f80b6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:57.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.506+0000 7f05feb81640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f05f80b66a0 0x7f05f80b6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42452/0 (socket says 172.21.15.123:42452) 2024-09-15T23:20:57.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.506+0000 7f05feb81640 1 -- 172.21.15.123:0/1037753180 learned_addr learned my addr 172.21.15.123:0/1037753180 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:57.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.506+0000 7f05fdb7f640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f05f81624b0 0x7f05f80d2c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60090/0 (socket says 172.21.15.123:60090) 2024-09-15T23:20:57.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.506+0000 7f05fe380640 1 --2- 172.21.15.123:0/1037753180 >> v2:172.21.15.188:3300/0 conn(0x7f05f815eb60 0x7f05f815ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:57.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.507+0000 7f05feb81640 1 -- 172.21.15.123:0/1037753180 >> v2:172.21.15.188:3300/0 conn(0x7f05f815eb60 msgr2=0x7f05f815ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:57.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.507+0000 7f05feb81640 1 --2- 172.21.15.123:0/1037753180 >> v2:172.21.15.188:3300/0 conn(0x7f05f815eb60 0x7f05f815ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.507+0000 7f05feb81640 1 -- 172.21.15.123:0/1037753180 >> v1:172.21.15.123:6789/0 conn(0x7f05f81624b0 legacy=0x7f05f80d2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:57.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.507+0000 7f05feb81640 1 -- 172.21.15.123:0/1037753180 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f815fb50 con 0x7f05f80b66a0 2024-09-15T23:20:57.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.507+0000 7f05feb81640 1 --2- 172.21.15.123:0/1037753180 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05f80b66a0 0x7f05f80b6af0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f05f80cb8d0 tx=0x7f05f002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e0a2d450428a84 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:57.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.507+0000 7f05fd37e640 1 -- 172.21.15.123:0/1037753180 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f0036070 con 0x7f05f80b66a0 2024-09-15T23:20:57.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.508+0000 7f05fd37e640 1 -- 172.21.15.123:0/1037753180 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05f0031600 con 0x7f05f80b66a0 2024-09-15T23:20:57.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.508+0000 7f05fd37e640 1 -- 172.21.15.123:0/1037753180 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f00319d0 con 0x7f05f80b66a0 2024-09-15T23:20:57.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.508+0000 7f06005e4640 1 -- 172.21.15.123:0/1037753180 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05f80b66a0 msgr2=0x7f05f80b6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:57.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.508+0000 7f06005e4640 1 --2- 172.21.15.123:0/1037753180 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05f80b66a0 0x7f05f80b6af0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f05f80cb8d0 tx=0x7f05f002a610 comp rx=0 tx=0).stop 2024-09-15T23:20:57.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.508+0000 7f06005e4640 1 -- 172.21.15.123:0/1037753180 shutdown_connections 2024-09-15T23:20:57.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.508+0000 7f06005e4640 1 --2- 172.21.15.123:0/1037753180 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05f80b66a0 0x7f05f80b6af0 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.508+0000 7f06005e4640 1 --2- 172.21.15.123:0/1037753180 >> v2:172.21.15.188:3300/0 conn(0x7f05f815eb60 0x7f05f815ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.508+0000 7f06005e4640 1 -- 172.21.15.123:0/1037753180 >> 172.21.15.123:0/1037753180 conn(0x7f05f80d16f0 msgr2=0x7f05f80d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:57.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.508+0000 7f06005e4640 1 -- 172.21.15.123:0/1037753180 shutdown_connections 2024-09-15T23:20:57.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.508+0000 7f06005e4640 1 -- 172.21.15.123:0/1037753180 wait complete. 2024-09-15T23:20:57.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.509+0000 7f06005e4640 1 Processor -- start 2024-09-15T23:20:57.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.509+0000 7f06005e4640 1 -- start start 2024-09-15T23:20:57.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.510+0000 7f06005e4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05f80b66a0 0x7f05f80ce110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:57.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.510+0000 7f06005e4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05f815eb60 0x7f05f80caf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:57.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.510+0000 7f06005e4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f05f81624b0 0x7f05f8152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:57.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.510+0000 7f06005e4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f05f80d4480 con 0x7f05f815eb60 2024-09-15T23:20:57.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.510+0000 7f06005e4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f05f80cef40 con 0x7f05f81624b0 2024-09-15T23:20:57.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.510+0000 7f06005e4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f05f80d4600 con 0x7f05f80b66a0 2024-09-15T23:20:57.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.510+0000 7f05fdb7f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05f815eb60 0x7f05f80caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:57.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.510+0000 7f05fdb7f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05f815eb60 0x7f05f80caf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42466/0 (socket says 172.21.15.123:42466) 2024-09-15T23:20:57.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.510+0000 7f05fdb7f640 1 -- 172.21.15.123:0/1629422771 learned_addr learned my addr 172.21.15.123:0/1629422771 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:57.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.510+0000 7f05fe380640 1 --2- 172.21.15.123:0/1629422771 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05f80b66a0 0x7f05f80ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:57.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.510+0000 7f05feb81640 1 --2- 172.21.15.123:0/1629422771 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f05f81624b0 0x7f05f8152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:57.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.511+0000 7f05fdb7f640 1 -- 172.21.15.123:0/1629422771 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05f80b66a0 msgr2=0x7f05f80ce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:57.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.511+0000 7f05fdb7f640 1 --2- 172.21.15.123:0/1629422771 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05f80b66a0 0x7f05f80ce110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.511+0000 7f05fdb7f640 1 -- 172.21.15.123:0/1629422771 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f05f81624b0 msgr2=0x7f05f8152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:57.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.511+0000 7f05fdb7f640 1 --2- 172.21.15.123:0/1629422771 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f05f81624b0 0x7f05f8152b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.511+0000 7f05fdb7f640 1 -- 172.21.15.123:0/1629422771 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f80cbaa0 con 0x7f05f815eb60 2024-09-15T23:20:57.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.511+0000 7f05fdb7f640 1 --2- 172.21.15.123:0/1629422771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05f815eb60 0x7f05f80caf90 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f05e800c400 tx=0x7f05e800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:57.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.511+0000 7f05eeffd640 1 -- 172.21.15.123:0/1629422771 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e80074e0 con 0x7f05f815eb60 2024-09-15T23:20:57.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.511+0000 7f05eeffd640 1 -- 172.21.15.123:0/1629422771 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05e8007680 con 0x7f05f815eb60 2024-09-15T23:20:57.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.511+0000 7f06005e4640 1 -- 172.21.15.123:0/1629422771 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05f8153050 con 0x7f05f815eb60 2024-09-15T23:20:57.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.511+0000 7f05eeffd640 1 -- 172.21.15.123:0/1629422771 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e8004a00 con 0x7f05f815eb60 2024-09-15T23:20:57.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.511+0000 7f06005e4640 1 -- 172.21.15.123:0/1629422771 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05f80cc040 con 0x7f05f815eb60 2024-09-15T23:20:57.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.512+0000 7f06005e4640 1 -- 172.21.15.123:0/1629422771 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05f80b6af0 con 0x7f05f815eb60 2024-09-15T23:20:57.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.513+0000 7f05eeffd640 1 -- 172.21.15.123:0/1629422771 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f05e801a020 con 0x7f05f815eb60 2024-09-15T23:20:57.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.513+0000 7f05eeffd640 1 --2- 172.21.15.123:0/1629422771 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f05dc06c2e0 0x7f05dc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:57.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.513+0000 7f05eeffd640 1 -- 172.21.15.123:0/1629422771 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5767+0+0 (secure 0 0 0) 0x7f05e808ab10 con 0x7f05f815eb60 2024-09-15T23:20:57.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.513+0000 7f05fe380640 1 --2- 172.21.15.123:0/1629422771 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f05dc06c2e0 0x7f05dc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:57.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.514+0000 7f05fe380640 1 --2- 172.21.15.123:0/1629422771 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f05dc06c2e0 0x7f05dc06e7a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f05f4009aa0 tx=0x7f05f4009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:57.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.517+0000 7f05eeffd640 1 -- 172.21.15.123:0/1629422771 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f05e8058bf0 con 0x7f05f815eb60 2024-09-15T23:20:57.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.750+0000 7f06005e4640 1 -- 172.21.15.123:0/1629422771 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f05f80d2520 con 0x7f05f815eb60 2024-09-15T23:20:57.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.750+0000 7f05eeffd640 1 -- 172.21.15.123:0/1629422771 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1675 (secure 0 0 0) 0x7f05e805cef0 con 0x7f05f815eb60 2024-09-15T23:20:57.752 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:57.752 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":548,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":156,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076562384,"bytes_used":2556141568,"bytes_avail":770537971712,"bytes_total":773094113280,"write_bytes_sec":73082454,"read_op_per_sec":0,"write_op_per_sec":72},"fsmap":{"epoch":93,"btime":"2024-09-15T23:20:31:301251+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":9006}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":25,"modified":"2024-09-15T23:20:55.627988+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T23:20:57.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.752+0000 7f06005e4640 1 -- 172.21.15.123:0/1629422771 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f05dc06c2e0 msgr2=0x7f05dc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:57.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.752+0000 7f06005e4640 1 --2- 172.21.15.123:0/1629422771 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f05dc06c2e0 0x7f05dc06e7a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f05f4009aa0 tx=0x7f05f4009190 comp rx=0 tx=0).stop 2024-09-15T23:20:57.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.752+0000 7f06005e4640 1 -- 172.21.15.123:0/1629422771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05f815eb60 msgr2=0x7f05f80caf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:57.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.752+0000 7f06005e4640 1 --2- 172.21.15.123:0/1629422771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05f815eb60 0x7f05f80caf90 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f05e800c400 tx=0x7f05e800c8c0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.752+0000 7f06005e4640 1 -- 172.21.15.123:0/1629422771 shutdown_connections 2024-09-15T23:20:57.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.752+0000 7f06005e4640 1 --2- 172.21.15.123:0/1629422771 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f05f81624b0 0x7f05f8152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.752+0000 7f06005e4640 1 --2- 172.21.15.123:0/1629422771 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f05dc06c2e0 0x7f05dc06e7a0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.752+0000 7f06005e4640 1 --2- 172.21.15.123:0/1629422771 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05f815eb60 0x7f05f80caf90 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.752+0000 7f06005e4640 1 --2- 172.21.15.123:0/1629422771 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05f80b66a0 0x7f05f80ce110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.752+0000 7f06005e4640 1 -- 172.21.15.123:0/1629422771 >> 172.21.15.123:0/1629422771 conn(0x7f05f80d16f0 msgr2=0x7f05f806e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:57.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.752+0000 7f06005e4640 1 -- 172.21.15.123:0/1629422771 shutdown_connections 2024-09-15T23:20:57.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.752+0000 7f06005e4640 1 -- 172.21.15.123:0/1629422771 wait complete. 2024-09-15T23:20:57.765 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'paused paths [/scrub_control_test_path]'} 2024-09-15T23:20:57.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:20:57.766 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub abort 2024-09-15T23:20:57.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.863+0000 7fe08a677640 1 Processor -- start 2024-09-15T23:20:57.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.863+0000 7fe08a677640 1 -- start start 2024-09-15T23:20:57.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.864+0000 7fe08a677640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0840732e0 0x7fe0840736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:57.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.864+0000 7fe08a677640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe0840cd270 0x7fe08415c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:57.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.864+0000 7fe08a677640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0840714b0 con 0x7fe0840cce30 2024-09-15T23:20:57.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.864+0000 7fe08a677640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe084073c00 con 0x7fe0840cd270 2024-09-15T23:20:57.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.864+0000 7fe08a677640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe0840cd880 con 0x7fe0840732e0 2024-09-15T23:20:57.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.864+0000 7fe088c14640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe0840cd270 0x7fe08415c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:57.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.864+0000 7fe088c14640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe0840cd270 0x7fe08415c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42472/0 (socket says 172.21.15.123:42472) 2024-09-15T23:20:57.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.864+0000 7fe088c14640 1 -- 172.21.15.123:0/101448300 learned_addr learned my addr 172.21.15.123:0/101448300 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:57.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.864+0000 7fe083fff640 1 --2- 172.21.15.123:0/101448300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0840732e0 0x7fe0840736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:57.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.864+0000 7fe088c14640 1 -- 172.21.15.123:0/101448300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0840732e0 msgr2=0x7fe0840736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:57.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.864+0000 7fe088c14640 1 --2- 172.21.15.123:0/101448300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0840732e0 0x7fe0840736c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.864+0000 7fe088c14640 1 -- 172.21.15.123:0/101448300 >> v1:172.21.15.188:6789/0 conn(0x7fe0840cce30 legacy=0x7fe084071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:57.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.864+0000 7fe088c14640 1 -- 172.21.15.123:0/101448300 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0840cdb60 con 0x7fe0840cd270 2024-09-15T23:20:57.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.864+0000 7fe083fff640 1 --2- 172.21.15.123:0/101448300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0840732e0 0x7fe0840736c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:20:57.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.865+0000 7fe088c14640 1 --2- 172.21.15.123:0/101448300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0840cd270 0x7fe08415c8d0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009e50 tx=0x7fe07c02a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25fa5a501695b561 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:57.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.865+0000 7fe082ffd640 1 -- 172.21.15.123:0/101448300 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c036070 con 0x7fe0840cd270 2024-09-15T23:20:57.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.865+0000 7fe082ffd640 1 -- 172.21.15.123:0/101448300 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe07c031600 con 0x7fe0840cd270 2024-09-15T23:20:57.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.865+0000 7fe082ffd640 1 -- 172.21.15.123:0/101448300 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c0319d0 con 0x7fe0840cd270 2024-09-15T23:20:57.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.866+0000 7fe08a677640 1 -- 172.21.15.123:0/101448300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0840cd270 msgr2=0x7fe08415c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:57.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.866+0000 7fe08a677640 1 --2- 172.21.15.123:0/101448300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0840cd270 0x7fe08415c8d0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009e50 tx=0x7fe07c02a630 comp rx=0 tx=0).stop 2024-09-15T23:20:57.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.866+0000 7fe08a677640 1 -- 172.21.15.123:0/101448300 shutdown_connections 2024-09-15T23:20:57.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.866+0000 7fe08a677640 1 --2- 172.21.15.123:0/101448300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0840cd270 0x7fe08415c8d0 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.866+0000 7fe08a677640 1 --2- 172.21.15.123:0/101448300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0840732e0 0x7fe0840736c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.866+0000 7fe08a677640 1 -- 172.21.15.123:0/101448300 >> 172.21.15.123:0/101448300 conn(0x7fe08406d0f0 msgr2=0x7fe08406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:57.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.866+0000 7fe08a677640 1 -- 172.21.15.123:0/101448300 shutdown_connections 2024-09-15T23:20:57.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.866+0000 7fe08a677640 1 -- 172.21.15.123:0/101448300 wait complete. 2024-09-15T23:20:57.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.867+0000 7fe08a677640 1 Processor -- start 2024-09-15T23:20:57.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.867+0000 7fe08a677640 1 -- start start 2024-09-15T23:20:57.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.868+0000 7fe08a677640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0840732e0 0x7fe0841f48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:57.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.868+0000 7fe08a677640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0840cce30 0x7fe0841f8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:57.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.868+0000 7fe08a677640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0840cd270 0x7fe0840ab110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:57.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.868+0000 7fe08a677640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe08406bf70 con 0x7fe0840cce30 2024-09-15T23:20:57.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.868+0000 7fe08a677640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe08406bdf0 con 0x7fe0840732e0 2024-09-15T23:20:57.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.868+0000 7fe08a677640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe084072380 con 0x7fe0840cd270 2024-09-15T23:20:57.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.868+0000 7fe0837fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0840cce30 0x7fe0841f8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:57.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.868+0000 7fe0837fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0840cce30 0x7fe0841f8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42478/0 (socket says 172.21.15.123:42478) 2024-09-15T23:20:57.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.868+0000 7fe0837fe640 1 -- 172.21.15.123:0/1876914587 learned_addr learned my addr 172.21.15.123:0/1876914587 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:57.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.868+0000 7fe088c14640 1 --2- 172.21.15.123:0/1876914587 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0840cd270 0x7fe0840ab110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:57.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.868+0000 7fe083fff640 1 --2- 172.21.15.123:0/1876914587 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0840732e0 0x7fe0841f48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:57.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.868+0000 7fe0837fe640 1 -- 172.21.15.123:0/1876914587 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0840cd270 msgr2=0x7fe0840ab110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:57.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.868+0000 7fe0837fe640 1 --2- 172.21.15.123:0/1876914587 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0840cd270 0x7fe0840ab110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.868+0000 7fe0837fe640 1 -- 172.21.15.123:0/1876914587 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0840732e0 msgr2=0x7fe0841f48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:57.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.868+0000 7fe0837fe640 1 --2- 172.21.15.123:0/1876914587 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0840732e0 0x7fe0841f48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.868+0000 7fe0837fe640 1 -- 172.21.15.123:0/1876914587 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0840abe90 con 0x7fe0840cce30 2024-09-15T23:20:57.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.868+0000 7fe088c14640 1 --2- 172.21.15.123:0/1876914587 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0840cd270 0x7fe0840ab110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:57.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.868+0000 7fe0837fe640 1 --2- 172.21.15.123:0/1876914587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0840cce30 0x7fe0841f8090 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7fe07800b3c0 tx=0x7fe07800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:57.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.869+0000 7fe080ff9640 1 -- 172.21.15.123:0/1876914587 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe078011830 con 0x7fe0840cce30 2024-09-15T23:20:57.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.869+0000 7fe080ff9640 1 -- 172.21.15.123:0/1876914587 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe078016070 con 0x7fe0840cce30 2024-09-15T23:20:57.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.869+0000 7fe08a677640 1 -- 172.21.15.123:0/1876914587 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0840abbb0 con 0x7fe0840cce30 2024-09-15T23:20:57.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.869+0000 7fe080ff9640 1 -- 172.21.15.123:0/1876914587 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe078011c50 con 0x7fe0840cce30 2024-09-15T23:20:57.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.869+0000 7fe08a677640 1 -- 172.21.15.123:0/1876914587 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0840ce750 con 0x7fe0840cce30 2024-09-15T23:20:57.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.870+0000 7fe080ff9640 1 -- 172.21.15.123:0/1876914587 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe07801b460 con 0x7fe0840cce30 2024-09-15T23:20:57.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.871+0000 7fe080ff9640 1 --2- 172.21.15.123:0/1876914587 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe07006c2b0 0x7fe07006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:57.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.871+0000 7fe080ff9640 1 -- 172.21.15.123:0/1876914587 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5767+0+0 (secure 0 0 0) 0x7fe07808aeb0 con 0x7fe0840cce30 2024-09-15T23:20:57.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.871+0000 7fe083fff640 1 --2- 172.21.15.123:0/1876914587 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe07006c2b0 0x7fe07006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:57.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.871+0000 7fe083fff640 1 --2- 172.21.15.123:0/1876914587 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe07006c2b0 0x7fe07006e770 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fe07400a950 tx=0x7fe074008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:57.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.871+0000 7fe08d409740 1 Processor -- start 2024-09-15T23:20:57.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.872+0000 7fe08d409740 1 -- start start 2024-09-15T23:20:57.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.872+0000 7fe08d409740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b85d7805e0 0x55b85d7809c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:57.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.872+0000 7fe08d409740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b85d77dda0 0x55b85d77f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:57.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.872+0000 7fe08d409740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b85d77e200 0x55b85d760560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:57.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.872+0000 7fe08d409740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55b85d69c8d0 con 0x55b85d77dda0 2024-09-15T23:20:57.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.872+0000 7fe08d409740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b85d644620 con 0x55b85d7805e0 2024-09-15T23:20:57.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.872+0000 7fe08d409740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55b85d698890 con 0x55b85d77e200 2024-09-15T23:20:57.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.872+0000 7fe0837fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b85d77dda0 0x55b85d77f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:57.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.872+0000 7fe0837fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b85d77dda0 0x55b85d77f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42488/0 (socket says 172.21.15.123:42488) 2024-09-15T23:20:57.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.872+0000 7fe0837fe640 1 -- 172.21.15.123:0/3197245415 learned_addr learned my addr 172.21.15.123:0/3197245415 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:57.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.872+0000 7fe083fff640 1 --2- 172.21.15.123:0/3197245415 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b85d7805e0 0x55b85d7809c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:57.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.872+0000 7fe088c14640 1 --2- 172.21.15.123:0/3197245415 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b85d77e200 0x55b85d760560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:57.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.873+0000 7fe0837fe640 1 -- 172.21.15.123:0/3197245415 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b85d77e200 msgr2=0x55b85d760560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:57.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.873+0000 7fe0837fe640 1 --2- 172.21.15.123:0/3197245415 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b85d77e200 0x55b85d760560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.873+0000 7fe0837fe640 1 -- 172.21.15.123:0/3197245415 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b85d7805e0 msgr2=0x55b85d7809c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:57.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.873+0000 7fe0837fe640 1 --2- 172.21.15.123:0/3197245415 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b85d7805e0 0x55b85d7809c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.873+0000 7fe0837fe640 1 -- 172.21.15.123:0/3197245415 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b85d4797d0 con 0x55b85d77dda0 2024-09-15T23:20:57.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.873+0000 7fe0837fe640 1 --2- 172.21.15.123:0/3197245415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b85d77dda0 0x55b85d77f930 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7fe078061580 tx=0x7fe078059010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3be389b53f3e6fb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:57.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.873+0000 7fe069ffb640 1 -- 172.21.15.123:0/3197245415 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe078056f70 con 0x55b85d77dda0 2024-09-15T23:20:57.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.873+0000 7fe069ffb640 1 -- 172.21.15.123:0/3197245415 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0780571d0 con 0x55b85d77dda0 2024-09-15T23:20:57.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.873+0000 7fe069ffb640 1 -- 172.21.15.123:0/3197245415 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe078061620 con 0x55b85d77dda0 2024-09-15T23:20:57.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.873+0000 7fe08d409740 1 -- 172.21.15.123:0/3197245415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b85d77dda0 msgr2=0x55b85d77f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:57.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.873+0000 7fe08d409740 1 --2- 172.21.15.123:0/3197245415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b85d77dda0 0x55b85d77f930 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7fe078061580 tx=0x7fe078059010 comp rx=0 tx=0).stop 2024-09-15T23:20:57.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.873+0000 7fe08d409740 1 -- 172.21.15.123:0/3197245415 shutdown_connections 2024-09-15T23:20:57.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.873+0000 7fe08d409740 1 --2- 172.21.15.123:0/3197245415 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b85d77e200 0x55b85d760560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.873+0000 7fe08d409740 1 --2- 172.21.15.123:0/3197245415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b85d77dda0 0x55b85d77f930 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.873+0000 7fe08d409740 1 --2- 172.21.15.123:0/3197245415 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b85d7805e0 0x55b85d7809c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.873+0000 7fe08d409740 1 -- 172.21.15.123:0/3197245415 >> 172.21.15.123:0/3197245415 conn(0x55b85d736240 msgr2=0x55b85d77e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:57.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.873+0000 7fe08d409740 1 -- 172.21.15.123:0/3197245415 shutdown_connections 2024-09-15T23:20:57.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.873+0000 7fe08d409740 1 -- 172.21.15.123:0/3197245415 wait complete. 2024-09-15T23:20:57.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.874+0000 7fe08d409740 1 -- start start 2024-09-15T23:20:57.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.874+0000 7fe08d409740 1 Processor -- start 2024-09-15T23:20:57.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.875+0000 7fe08d409740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b85d77e200 0x55b85d75a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:57.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.875+0000 7fe08d409740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b85d7805e0 0x55b85d78e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:57.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.875+0000 7fe08d409740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b85d762420 0x55b85d762ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:57.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.875+0000 7fe08d409740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55b85d77cd00 con 0x55b85d77e200 2024-09-15T23:20:57.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.875+0000 7fe08d409740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b85d625750 con 0x55b85d7805e0 2024-09-15T23:20:57.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.875+0000 7fe08d409740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55b85d77cfe0 con 0x55b85d762420 2024-09-15T23:20:57.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.875+0000 7fe08d409740 10 client.0 _ll_register_callbacks cb 0x55b85d649780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:20:57.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.875+0000 7fe083fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b85d77e200 0x55b85d75a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:57.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.875+0000 7fe083fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b85d77e200 0x55b85d75a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42494/0 (socket says 172.21.15.123:42494) 2024-09-15T23:20:57.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.875+0000 7fe083fff640 1 -- 172.21.15.123:0/1965476758 learned_addr learned my addr 172.21.15.123:0/1965476758 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:57.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.875+0000 7fe088c14640 1 --2- 172.21.15.123:0/1965476758 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b85d762420 0x55b85d762ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:57.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.875+0000 7fe0837fe640 1 --2- 172.21.15.123:0/1965476758 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b85d7805e0 0x55b85d78e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:57.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.875+0000 7fe083fff640 1 -- 172.21.15.123:0/1965476758 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b85d762420 msgr2=0x55b85d762ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:57.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.875+0000 7fe083fff640 1 --2- 172.21.15.123:0/1965476758 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b85d762420 0x55b85d762ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.875+0000 7fe083fff640 1 -- 172.21.15.123:0/1965476758 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b85d7805e0 msgr2=0x55b85d78e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:57.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.875+0000 7fe083fff640 1 --2- 172.21.15.123:0/1965476758 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b85d7805e0 0x55b85d78e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.875+0000 7fe083fff640 1 -- 172.21.15.123:0/1965476758 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b85d36f0f0 con 0x55b85d77e200 2024-09-15T23:20:57.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.876+0000 7fe083fff640 1 --2- 172.21.15.123:0/1965476758 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b85d77e200 0x55b85d75a800 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7fe074013800 tx=0x7fe0740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a53dea8e72ef6f61 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:57.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.876+0000 7fe062ffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:20:57.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.876+0000 7fe062ffd640 1 -- 172.21.15.123:0/1965476758 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe074024070 con 0x55b85d77e200 2024-09-15T23:20:57.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.876+0000 7fe062ffd640 1 -- 172.21.15.123:0/1965476758 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(156..156 src has 1..156) ==== 5767+0+0 (secure 0 0 0) 0x7fe074014b90 con 0x55b85d77e200 2024-09-15T23:20:57.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.876+0000 7fe08d409740 1 -- 172.21.15.123:0/1965476758 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0780571d0 con 0x55b85d77e200 2024-09-15T23:20:57.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.876+0000 7fe062ffd640 1 -- 172.21.15.123:0/1965476758 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7fe07402f050 con 0x55b85d77e200 2024-09-15T23:20:57.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.876+0000 7fe08d409740 10 client.9309 fetch_fsmap learned FSMap version 93 2024-09-15T23:20:57.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.876+0000 7fe08d409740 1 -- 172.21.15.123:0/1965476758 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) -- 0x55b85d4d9f60 con 0x55b85d77e200 2024-09-15T23:20:57.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.876+0000 7fe062ffd640 1 -- 172.21.15.123:0/1965476758 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0780571d0 con 0x55b85d77e200 2024-09-15T23:20:57.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.876+0000 7fe062ffd640 1 -- 172.21.15.123:0/1965476758 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 93) ==== 3502+0+0 (secure 0 0 0) 0x7fe074032020 con 0x55b85d77e200 2024-09-15T23:20:57.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.876+0000 7fe08d409740 10 client.9309 fetch_fsmap finished waiting for FSMap version 93 2024-09-15T23:20:57.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.876+0000 7fe08d409740 10 client.9309 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-15T23:20:57.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.876+0000 7fe08d409740 20 client.9309 populate_metadata read hostname 'smithi123' 2024-09-15T23:20:57.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.876+0000 7fe08d409740 1 --2- 172.21.15.123:0/1965476758 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55b85d763420 0x55b85d734320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:57.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.876+0000 7fe08d409740 4 client.9309 mds_command: new command op to 9006 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:20:57.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.876+0000 7fe08d409740 1 -- 172.21.15.123:0/1965476758 --> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b85d6aa000 con 0x55b85d763420 2024-09-15T23:20:57.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.876+0000 7fe0837fe640 1 --2- 172.21.15.123:0/1965476758 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55b85d763420 0x55b85d734320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:57.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.877+0000 7fe062ffd640 10 client.9309 ms_handle_connect on v2:172.21.15.123:6833/627322542 2024-09-15T23:20:57.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.877+0000 7fe0837fe640 1 --2- 172.21.15.123:0/1965476758 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55b85d763420 0x55b85d734320 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97fb8d73281b6554 server_cookie=7d84403ff51d1b7e in_seq=0 out_seq=0 2024-09-15T23:20:57.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.877+0000 7fe062ffd640 1 -- 172.21.15.123:0/1965476758 <== mds.0 v2:172.21.15.123:6833/627322542 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b85d6aa000 con 0x55b85d763420 2024-09-15T23:20:57.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.877+0000 7fe062ffd640 10 client.9309 handle_command_reply: tid=0 2024-09-15T23:20:57.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.877+0000 7fe08d409740 1 client.9309 shutdown 2024-09-15T23:20:57.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.877+0000 7fe08d409740 1 -- 172.21.15.123:0/1965476758 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b85d77e200 msgr2=0x55b85d75a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:57.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.877+0000 7fe08d409740 1 --2- 172.21.15.123:0/1965476758 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b85d77e200 0x55b85d75a800 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7fe074013800 tx=0x7fe0740046c0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.877+0000 7fe08d409740 1 -- 172.21.15.123:0/1965476758 shutdown_connections 2024-09-15T23:20:57.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.877+0000 7fe08d409740 1 --2- 172.21.15.123:0/1965476758 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55b85d763420 0x55b85d734320 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.877+0000 7fe08d409740 1 --2- 172.21.15.123:0/1965476758 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b85d762420 0x55b85d762ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.877+0000 7fe08d409740 1 --2- 172.21.15.123:0/1965476758 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b85d7805e0 0x55b85d78e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.877+0000 7fe062ffd640 0 client.9309 ms_handle_reset on v2:172.21.15.123:6833/627322542 2024-09-15T23:20:57.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.877+0000 7fe08d409740 1 --2- 172.21.15.123:0/1965476758 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b85d77e200 0x55b85d75a800 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.877+0000 7fe08d409740 1 -- 172.21.15.123:0/1965476758 >> 172.21.15.123:0/1965476758 conn(0x55b85d77dda0 msgr2=0x55b85d760b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:57.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.878+0000 7fe08d409740 1 -- 172.21.15.123:0/1965476758 shutdown_connections 2024-09-15T23:20:57.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.878+0000 7fe08d409740 1 -- 172.21.15.123:0/1965476758 wait complete. 2024-09-15T23:20:57.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.878+0000 7fe08d409740 20 client.9309 trim_cache size 0 max 16384 2024-09-15T23:20:57.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.894+0000 7fe08d409740 1 Processor -- start 2024-09-15T23:20:57.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.894+0000 7fe08d409740 1 -- start start 2024-09-15T23:20:57.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.895+0000 7fe08d409740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b85d762420 0x55b85d7639a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:57.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.895+0000 7fe08d409740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b85d77e200 0x55b85d763ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:57.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.895+0000 7fe08d409740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b85d7805e0 0x55b85d797100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:57.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.895+0000 7fe08d409740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe084200fb0 con 0x55b85d762420 2024-09-15T23:20:57.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.895+0000 7fe08d409740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe0840cee60 con 0x55b85d7805e0 2024-09-15T23:20:57.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.895+0000 7fe08d409740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe0840cf4b0 con 0x55b85d77e200 2024-09-15T23:20:57.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.895+0000 7fe083fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b85d762420 0x55b85d7639a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:57.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.895+0000 7fe083fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b85d762420 0x55b85d7639a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42498/0 (socket says 172.21.15.123:42498) 2024-09-15T23:20:57.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.895+0000 7fe083fff640 1 -- 172.21.15.123:0/1468408115 learned_addr learned my addr 172.21.15.123:0/1468408115 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:57.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.895+0000 7fe088c14640 1 --2- 172.21.15.123:0/1468408115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b85d7805e0 0x55b85d797100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:57.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.895+0000 7fe0837fe640 1 --2- 172.21.15.123:0/1468408115 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b85d77e200 0x55b85d763ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:57.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.895+0000 7fe083fff640 1 -- 172.21.15.123:0/1468408115 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b85d77e200 msgr2=0x55b85d763ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:57.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.895+0000 7fe083fff640 1 --2- 172.21.15.123:0/1468408115 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b85d77e200 0x55b85d763ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.895+0000 7fe083fff640 1 -- 172.21.15.123:0/1468408115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b85d7805e0 msgr2=0x55b85d797100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:57.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.895+0000 7fe083fff640 1 --2- 172.21.15.123:0/1468408115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b85d7805e0 0x55b85d797100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.895+0000 7fe083fff640 1 -- 172.21.15.123:0/1468408115 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b85d3481b0 con 0x55b85d762420 2024-09-15T23:20:57.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.895+0000 7fe088c14640 1 --2- 172.21.15.123:0/1468408115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b85d7805e0 0x55b85d797100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:57.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.895+0000 7fe083fff640 1 --2- 172.21.15.123:0/1468408115 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b85d762420 0x55b85d7639a0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fe074000c00 tx=0x7fe074021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bbd68173105e477 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:57.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.896+0000 7fe0697fa640 1 -- 172.21.15.123:0/1468408115 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe074037020 con 0x55b85d762420 2024-09-15T23:20:57.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.896+0000 7fe0697fa640 1 -- 172.21.15.123:0/1468408115 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe07401b040 con 0x55b85d762420 2024-09-15T23:20:57.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.896+0000 7fe0697fa640 1 -- 172.21.15.123:0/1468408115 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe074024040 con 0x55b85d762420 2024-09-15T23:20:57.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.896+0000 7fe08d409740 1 -- 172.21.15.123:0/1468408115 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b85d762420 msgr2=0x55b85d7639a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:57.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.896+0000 7fe08d409740 1 --2- 172.21.15.123:0/1468408115 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b85d762420 0x55b85d7639a0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fe074000c00 tx=0x7fe074021000 comp rx=0 tx=0).stop 2024-09-15T23:20:57.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.896+0000 7fe08d409740 1 -- 172.21.15.123:0/1468408115 shutdown_connections 2024-09-15T23:20:57.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.896+0000 7fe08d409740 1 --2- 172.21.15.123:0/1468408115 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b85d7805e0 0x55b85d797100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.896+0000 7fe08d409740 1 --2- 172.21.15.123:0/1468408115 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b85d77e200 0x55b85d763ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.896+0000 7fe08d409740 1 --2- 172.21.15.123:0/1468408115 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b85d762420 0x55b85d7639a0 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.896+0000 7fe08d409740 1 -- 172.21.15.123:0/1468408115 >> 172.21.15.123:0/1468408115 conn(0x55b85d77dda0 msgr2=0x55b85d77e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:57.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.896+0000 7fe08d409740 1 -- 172.21.15.123:0/1468408115 shutdown_connections 2024-09-15T23:20:57.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.896+0000 7fe08d409740 1 -- 172.21.15.123:0/1468408115 wait complete. 2024-09-15T23:20:57.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.897+0000 7fe08d409740 1 -- start start 2024-09-15T23:20:57.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.897+0000 7fe08d409740 1 Processor -- start 2024-09-15T23:20:57.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.898+0000 7fe08d409740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b85d762420 0x55b85d7602b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:57.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.898+0000 7fe08d409740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b85d77e200 0x55b85d75f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:57.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.898+0000 7fe08d409740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b85d7805e0 0x55b85d7fb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:57.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.898+0000 7fe08d409740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55b85d735200 con 0x55b85d7805e0 2024-09-15T23:20:57.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.898+0000 7fe08d409740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b85d760d30 con 0x55b85d762420 2024-09-15T23:20:57.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.898+0000 7fe08d409740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55b85d75f250 con 0x55b85d77e200 2024-09-15T23:20:57.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.898+0000 7fe08d409740 10 client.0 _ll_register_callbacks cb 0x7fe074013450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:20:57.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.898+0000 7fe088c14640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b85d7805e0 0x55b85d7fb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:57.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.898+0000 7fe088c14640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b85d7805e0 0x55b85d7fb5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42500/0 (socket says 172.21.15.123:42500) 2024-09-15T23:20:57.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.898+0000 7fe088c14640 1 -- 172.21.15.123:0/2727093559 learned_addr learned my addr 172.21.15.123:0/2727093559 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:57.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.898+0000 7fe083fff640 1 --2- 172.21.15.123:0/2727093559 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b85d762420 0x55b85d7602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:57.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.898+0000 7fe0837fe640 1 --2- 172.21.15.123:0/2727093559 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b85d77e200 0x55b85d75f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:57.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.898+0000 7fe088c14640 1 -- 172.21.15.123:0/2727093559 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b85d77e200 msgr2=0x55b85d75f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:57.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.898+0000 7fe088c14640 1 --2- 172.21.15.123:0/2727093559 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b85d77e200 0x55b85d75f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.898+0000 7fe088c14640 1 -- 172.21.15.123:0/2727093559 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b85d762420 msgr2=0x55b85d7602b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:57.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.898+0000 7fe088c14640 1 --2- 172.21.15.123:0/2727093559 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b85d762420 0x55b85d7602b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.898+0000 7fe088c14640 1 -- 172.21.15.123:0/2727093559 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b85d7645a0 con 0x55b85d7805e0 2024-09-15T23:20:57.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.898+0000 7fe088c14640 1 --2- 172.21.15.123:0/2727093559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b85d7805e0 0x55b85d7fb5e0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009e50 tx=0x7fe07c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e40ebe3377a5d6b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:57.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.898+0000 7fe062ffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:20:57.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.898+0000 7fe062ffd640 1 -- 172.21.15.123:0/2727093559 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c04c060 con 0x55b85d7805e0 2024-09-15T23:20:57.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.898+0000 7fe062ffd640 1 -- 172.21.15.123:0/2727093559 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(156..156 src has 1..156) ==== 5767+0+0 (secure 0 0 0) 0x7fe07c047440 con 0x55b85d7805e0 2024-09-15T23:20:57.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.898+0000 7fe08d409740 1 -- 172.21.15.123:0/2727093559 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe07401b040 con 0x55b85d7805e0 2024-09-15T23:20:57.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.899+0000 7fe062ffd640 1 -- 172.21.15.123:0/2727093559 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7fe07c052050 con 0x55b85d7805e0 2024-09-15T23:20:57.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.899+0000 7fe08d409740 10 client.9315 fetch_fsmap learned FSMap version 93 2024-09-15T23:20:57.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.899+0000 7fe08d409740 1 -- 172.21.15.123:0/2727093559 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) -- 0x55b85d735530 con 0x55b85d7805e0 2024-09-15T23:20:57.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.899+0000 7fe062ffd640 1 -- 172.21.15.123:0/2727093559 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe07401b040 con 0x55b85d7805e0 2024-09-15T23:20:57.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.899+0000 7fe062ffd640 1 -- 172.21.15.123:0/2727093559 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 93) ==== 3502+0+0 (secure 0 0 0) 0x7fe07c055020 con 0x55b85d7805e0 2024-09-15T23:20:57.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.899+0000 7fe08d409740 10 client.9315 fetch_fsmap finished waiting for FSMap version 93 2024-09-15T23:20:57.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.899+0000 7fe08d409740 10 client.9315 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-15T23:20:57.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.899+0000 7fe08d409740 20 client.9315 populate_metadata read hostname 'smithi123' 2024-09-15T23:20:57.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.899+0000 7fe08d409740 1 --2- 172.21.15.123:0/2727093559 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55b85d7fbb20 0x55b85d739770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:57.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.899+0000 7fe08d409740 4 client.9315 mds_command: new command op to 9006 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-09-15T23:20:57.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.899+0000 7fe08d409740 1 -- 172.21.15.123:0/2727093559 --> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] -- command(tid 0: {"prefix": "scrub abort"}) -- 0x55b85d6a4350 con 0x55b85d7fbb20 2024-09-15T23:20:57.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.899+0000 7fe083fff640 1 --2- 172.21.15.123:0/2727093559 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55b85d7fbb20 0x55b85d739770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:57.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.899+0000 7fe062ffd640 10 client.9315 ms_handle_connect on v2:172.21.15.123:6833/627322542 2024-09-15T23:20:57.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.899+0000 7fe083fff640 1 --2- 172.21.15.123:0/2727093559 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55b85d7fbb20 0x55b85d739770 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a538773da76e6c8 server_cookie=7ea7f31f8df7716a in_seq=0 out_seq=0 2024-09-15T23:20:57.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.900+0000 7fe062ffd640 1 -- 172.21.15.123:0/2727093559 <== mds.0 v2:172.21.15.123:6833/627322542 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b85d6a4350 con 0x55b85d7fbb20 2024-09-15T23:20:57.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.900+0000 7fe062ffd640 10 client.9315 handle_command_reply: tid=0 2024-09-15T23:20:57.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.900+0000 7fe08d409740 1 client.9315 shutdown 2024-09-15T23:20:57.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.900+0000 7fe08d409740 1 -- 172.21.15.123:0/2727093559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b85d7805e0 msgr2=0x55b85d7fb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:57.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.900+0000 7fe08d409740 1 --2- 172.21.15.123:0/2727093559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b85d7805e0 0x55b85d7fb5e0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009e50 tx=0x7fe07c02c000 comp rx=0 tx=0).stop 2024-09-15T23:20:57.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.900+0000 7fe08d409740 1 -- 172.21.15.123:0/2727093559 shutdown_connections 2024-09-15T23:20:57.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.900+0000 7fe08d409740 1 --2- 172.21.15.123:0/2727093559 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55b85d7fbb20 0x55b85d739770 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.900+0000 7fe08d409740 1 --2- 172.21.15.123:0/2727093559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b85d7805e0 0x55b85d7fb5e0 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.900+0000 7fe08d409740 1 --2- 172.21.15.123:0/2727093559 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b85d77e200 0x55b85d75f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.900+0000 7fe062ffd640 0 client.9315 ms_handle_reset on v2:172.21.15.123:6833/627322542 2024-09-15T23:20:57.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.900+0000 7fe08d409740 1 --2- 172.21.15.123:0/2727093559 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b85d762420 0x55b85d7602b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.900+0000 7fe08d409740 1 -- 172.21.15.123:0/2727093559 >> 172.21.15.123:0/2727093559 conn(0x55b85d77dda0 msgr2=0x55b85d77e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:57.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.900+0000 7fe08d409740 1 -- 172.21.15.123:0/2727093559 shutdown_connections 2024-09-15T23:20:57.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.900+0000 7fe08d409740 1 -- 172.21.15.123:0/2727093559 wait complete. 2024-09-15T23:20:57.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.900+0000 7fe08d409740 20 client.9315 trim_cache size 0 max 16384 2024-09-15T23:20:57.924 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:20:57.924 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "", 2024-09-15T23:20:57.925 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0 2024-09-15T23:20:57.925 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:20:57.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.900+0000 7fe08a677640 1 -- 172.21.15.123:0/1876914587 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe07006c2b0 msgr2=0x7fe07006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:57.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.900+0000 7fe08a677640 1 --2- 172.21.15.123:0/1876914587 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe07006c2b0 0x7fe07006e770 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fe07400a950 tx=0x7fe074008040 comp rx=0 tx=0).stop 2024-09-15T23:20:57.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.900+0000 7fe08a677640 1 -- 172.21.15.123:0/1876914587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0840cce30 msgr2=0x7fe0841f8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:57.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.900+0000 7fe08a677640 1 --2- 172.21.15.123:0/1876914587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0840cce30 0x7fe0841f8090 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7fe07800b3c0 tx=0x7fe07800b880 comp rx=0 tx=0).stop 2024-09-15T23:20:57.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.900+0000 7fe08a677640 1 -- 172.21.15.123:0/1876914587 shutdown_connections 2024-09-15T23:20:57.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.900+0000 7fe08a677640 1 --2- 172.21.15.123:0/1876914587 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0840cd270 0x7fe0840ab110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.900+0000 7fe08a677640 1 --2- 172.21.15.123:0/1876914587 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe07006c2b0 0x7fe07006e770 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.900+0000 7fe08a677640 1 --2- 172.21.15.123:0/1876914587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0840cce30 0x7fe0841f8090 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.900+0000 7fe08a677640 1 --2- 172.21.15.123:0/1876914587 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe0840732e0 0x7fe0841f48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:57.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.900+0000 7fe08a677640 1 -- 172.21.15.123:0/1876914587 >> 172.21.15.123:0/1876914587 conn(0x7fe08406d0f0 msgr2=0x7fe08415cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:57.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.901+0000 7fe08a677640 1 -- 172.21.15.123:0/1876914587 shutdown_connections 2024-09-15T23:20:57.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:57.901+0000 7fe08a677640 1 -- 172.21.15.123:0/1876914587 wait complete. 2024-09-15T23:20:57.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:20:57.929 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub status 2024-09-15T23:20:58.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.027+0000 7f75ae4f1640 1 Processor -- start 2024-09-15T23:20:58.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.027+0000 7f75ae4f1640 1 -- start start 2024-09-15T23:20:58.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.028+0000 7f75ae4f1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75a80732e0 0x7f75a80736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.028+0000 7f75ae4f1640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f75a80cd270 0x7f75a815c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.028+0000 7f75ae4f1640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75a80714b0 con 0x7f75a80cce30 2024-09-15T23:20:58.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.028+0000 7f75ae4f1640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f75a8073c00 con 0x7f75a80cd270 2024-09-15T23:20:58.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.028+0000 7f75ae4f1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f75a80cd880 con 0x7f75a80732e0 2024-09-15T23:20:58.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.028+0000 7f75aca8e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f75a80cd270 0x7f75a815c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.028+0000 7f75aca8e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f75a80cd270 0x7f75a815c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42516/0 (socket says 172.21.15.123:42516) 2024-09-15T23:20:58.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.028+0000 7f75aca8e640 1 -- 172.21.15.123:0/3384402831 learned_addr learned my addr 172.21.15.123:0/3384402831 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:58.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.028+0000 7f75a7fff640 1 --2- 172.21.15.123:0/3384402831 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75a80732e0 0x7f75a80736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.028+0000 7f75aca8e640 1 -- 172.21.15.123:0/3384402831 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75a80732e0 msgr2=0x7f75a80736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:58.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.028+0000 7f75aca8e640 1 --2- 172.21.15.123:0/3384402831 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75a80732e0 0x7f75a80736c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.028+0000 7f75aca8e640 1 -- 172.21.15.123:0/3384402831 >> v1:172.21.15.188:6789/0 conn(0x7f75a80cce30 legacy=0x7f75a8071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:58.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.028+0000 7f75aca8e640 1 -- 172.21.15.123:0/3384402831 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a80cdb60 con 0x7f75a80cd270 2024-09-15T23:20:58.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.029+0000 7f75aca8e640 1 --2- 172.21.15.123:0/3384402831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75a80cd270 0x7f75a815c8d0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f75a0009e50 tx=0x7f75a002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2503b33198b075 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:58.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.029+0000 7f75a6ffd640 1 -- 172.21.15.123:0/3384402831 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a0036070 con 0x7f75a80cd270 2024-09-15T23:20:58.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.029+0000 7f75a6ffd640 1 -- 172.21.15.123:0/3384402831 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75a0031600 con 0x7f75a80cd270 2024-09-15T23:20:58.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.029+0000 7f75a6ffd640 1 -- 172.21.15.123:0/3384402831 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a00319d0 con 0x7f75a80cd270 2024-09-15T23:20:58.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.030+0000 7f75ae4f1640 1 -- 172.21.15.123:0/3384402831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75a80cd270 msgr2=0x7f75a815c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:58.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.030+0000 7f75ae4f1640 1 --2- 172.21.15.123:0/3384402831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75a80cd270 0x7f75a815c8d0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f75a0009e50 tx=0x7f75a002a680 comp rx=0 tx=0).stop 2024-09-15T23:20:58.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.030+0000 7f75ae4f1640 1 -- 172.21.15.123:0/3384402831 shutdown_connections 2024-09-15T23:20:58.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.030+0000 7f75ae4f1640 1 --2- 172.21.15.123:0/3384402831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75a80cd270 0x7f75a815c8d0 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.030+0000 7f75ae4f1640 1 --2- 172.21.15.123:0/3384402831 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75a80732e0 0x7f75a80736c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.030+0000 7f75ae4f1640 1 -- 172.21.15.123:0/3384402831 >> 172.21.15.123:0/3384402831 conn(0x7f75a806d0f0 msgr2=0x7f75a806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:58.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.030+0000 7f75ae4f1640 1 -- 172.21.15.123:0/3384402831 shutdown_connections 2024-09-15T23:20:58.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.030+0000 7f75ae4f1640 1 -- 172.21.15.123:0/3384402831 wait complete. 2024-09-15T23:20:58.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.031+0000 7f75ae4f1640 1 Processor -- start 2024-09-15T23:20:58.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.031+0000 7f75ae4f1640 1 -- start start 2024-09-15T23:20:58.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.032+0000 7f75ae4f1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75a80732e0 0x7f75a81521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.032+0000 7f75ae4f1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75a80cce30 0x7f75a8155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.032+0000 7f75ae4f1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75a80cd270 0x7f75a8155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.032+0000 7f75ae4f1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f75a806bf70 con 0x7f75a80cd270 2024-09-15T23:20:58.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.032+0000 7f75ae4f1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f75a806bdf0 con 0x7f75a80732e0 2024-09-15T23:20:58.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.032+0000 7f75ae4f1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f75a8072380 con 0x7f75a80cce30 2024-09-15T23:20:58.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.032+0000 7f75aca8e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75a80cd270 0x7f75a8155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.032+0000 7f75aca8e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75a80cd270 0x7f75a8155780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42520/0 (socket says 172.21.15.123:42520) 2024-09-15T23:20:58.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.032+0000 7f75aca8e640 1 -- 172.21.15.123:0/2650257358 learned_addr learned my addr 172.21.15.123:0/2650257358 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:58.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.032+0000 7f75a7fff640 1 --2- 172.21.15.123:0/2650257358 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75a80732e0 0x7f75a81521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.032+0000 7f75a77fe640 1 --2- 172.21.15.123:0/2650257358 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75a80cce30 0x7f75a8155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.032+0000 7f75aca8e640 1 -- 172.21.15.123:0/2650257358 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75a80cce30 msgr2=0x7f75a8155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:58.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.032+0000 7f75aca8e640 1 --2- 172.21.15.123:0/2650257358 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75a80cce30 0x7f75a8155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.032+0000 7f75aca8e640 1 -- 172.21.15.123:0/2650257358 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75a80732e0 msgr2=0x7f75a81521e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:58.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.032+0000 7f75aca8e640 1 --2- 172.21.15.123:0/2650257358 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75a80732e0 0x7f75a81521e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.032+0000 7f75aca8e640 1 -- 172.21.15.123:0/2650257358 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a8159770 con 0x7f75a80cd270 2024-09-15T23:20:58.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.033+0000 7f75aca8e640 1 --2- 172.21.15.123:0/2650257358 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75a80cd270 0x7f75a8155780 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f75a0009e50 tx=0x7f75a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:58.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.033+0000 7f75a4ff9640 1 -- 172.21.15.123:0/2650257358 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a0036050 con 0x7f75a80cd270 2024-09-15T23:20:58.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.033+0000 7f75a4ff9640 1 -- 172.21.15.123:0/2650257358 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75a0042070 con 0x7f75a80cd270 2024-09-15T23:20:58.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.033+0000 7f75ae4f1640 1 -- 172.21.15.123:0/2650257358 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75a81e5a00 con 0x7f75a80cd270 2024-09-15T23:20:58.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.033+0000 7f75a4ff9640 1 -- 172.21.15.123:0/2650257358 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a0009510 con 0x7f75a80cd270 2024-09-15T23:20:58.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.033+0000 7f75ae4f1640 1 -- 172.21.15.123:0/2650257358 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75a81e64a0 con 0x7f75a80cd270 2024-09-15T23:20:58.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.034+0000 7f75a4ff9640 1 -- 172.21.15.123:0/2650257358 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f75a0007bf0 con 0x7f75a80cd270 2024-09-15T23:20:58.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.035+0000 7f75a4ff9640 1 --2- 172.21.15.123:0/2650257358 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f759406c2b0 0x7f759406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.035+0000 7f75a4ff9640 1 -- 172.21.15.123:0/2650257358 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5767+0+0 (secure 0 0 0) 0x7f75a00ac140 con 0x7f75a80cd270 2024-09-15T23:20:58.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.035+0000 7f75a7fff640 1 --2- 172.21.15.123:0/2650257358 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f759406c2b0 0x7f759406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.035+0000 7f75a7fff640 1 --2- 172.21.15.123:0/2650257358 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f759406c2b0 0x7f759406e770 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f75a8155d90 tx=0x7f7598009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:58.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.036+0000 7f75b1293740 1 Processor -- start 2024-09-15T23:20:58.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.036+0000 7f75b1293740 1 -- start start 2024-09-15T23:20:58.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.036+0000 7f75b1293740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b424bf8780 0x55b424bf8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.036+0000 7f75b1293740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b424c13140 0x55b424c148f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.036+0000 7f75b1293740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b424bcc0e0 0x55b424c14e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.036+0000 7f75b1293740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55b424b316f0 con 0x55b424bf8780 2024-09-15T23:20:58.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.036+0000 7f75b1293740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b424ad9330 con 0x55b424bcc0e0 2024-09-15T23:20:58.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.036+0000 7f75b1293740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55b424b2d6b0 con 0x55b424c13140 2024-09-15T23:20:58.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.036+0000 7f75a7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b424bf8780 0x55b424bf8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.036+0000 7f75a7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b424bf8780 0x55b424bf8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42524/0 (socket says 172.21.15.123:42524) 2024-09-15T23:20:58.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.036+0000 7f75a7fff640 1 -- 172.21.15.123:0/1300156116 learned_addr learned my addr 172.21.15.123:0/1300156116 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:58.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.036+0000 7f75aca8e640 1 --2- 172.21.15.123:0/1300156116 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b424bcc0e0 0x55b424c14e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.036+0000 7f75a77fe640 1 --2- 172.21.15.123:0/1300156116 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b424c13140 0x55b424c148f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.037+0000 7f75a7fff640 1 -- 172.21.15.123:0/1300156116 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b424c13140 msgr2=0x55b424c148f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:58.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.037+0000 7f75a7fff640 1 --2- 172.21.15.123:0/1300156116 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b424c13140 0x55b424c148f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.037+0000 7f75a7fff640 1 -- 172.21.15.123:0/1300156116 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b424bcc0e0 msgr2=0x55b424c14e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:58.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.037+0000 7f75a7fff640 1 --2- 172.21.15.123:0/1300156116 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b424bcc0e0 0x55b424c14e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.037+0000 7f75a7fff640 1 -- 172.21.15.123:0/1300156116 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b424aff0d0 con 0x55b424bf8780 2024-09-15T23:20:58.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.037+0000 7f75a7fff640 1 --2- 172.21.15.123:0/1300156116 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b424bf8780 0x55b424bf8b60 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f75980095c0 tx=0x7f7598014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92641aa78a95cc9f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:58.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.037+0000 7f758dffb640 1 -- 172.21.15.123:0/1300156116 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7598025070 con 0x55b424bf8780 2024-09-15T23:20:58.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.037+0000 7f758dffb640 1 -- 172.21.15.123:0/1300156116 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f759801b070 con 0x55b424bf8780 2024-09-15T23:20:58.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.037+0000 7f758dffb640 1 -- 172.21.15.123:0/1300156116 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7598014df0 con 0x55b424bf8780 2024-09-15T23:20:58.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.038+0000 7f75b1293740 1 -- 172.21.15.123:0/1300156116 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b424bf8780 msgr2=0x55b424bf8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:58.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.038+0000 7f75b1293740 1 --2- 172.21.15.123:0/1300156116 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b424bf8780 0x55b424bf8b60 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f75980095c0 tx=0x7f7598014000 comp rx=0 tx=0).stop 2024-09-15T23:20:58.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.038+0000 7f75b1293740 1 -- 172.21.15.123:0/1300156116 shutdown_connections 2024-09-15T23:20:58.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.038+0000 7f75b1293740 1 --2- 172.21.15.123:0/1300156116 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b424bcc0e0 0x55b424c14e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.038+0000 7f75b1293740 1 --2- 172.21.15.123:0/1300156116 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b424c13140 0x55b424c148f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.038+0000 7f75b1293740 1 --2- 172.21.15.123:0/1300156116 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b424bf8780 0x55b424bf8b60 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.038+0000 7f75b1293740 1 -- 172.21.15.123:0/1300156116 >> 172.21.15.123:0/1300156116 conn(0x55b424bcb370 msgr2=0x55b424c13590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:58.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.038+0000 7f75b1293740 1 -- 172.21.15.123:0/1300156116 shutdown_connections 2024-09-15T23:20:58.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.038+0000 7f75b1293740 1 -- 172.21.15.123:0/1300156116 wait complete. 2024-09-15T23:20:58.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.038+0000 7f75b1293740 1 -- start start 2024-09-15T23:20:58.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.038+0000 7f75b1293740 1 Processor -- start 2024-09-15T23:20:58.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.039+0000 7f75b1293740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b424bf8780 0x55b424bfc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.039+0000 7f75b1293740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b424c13140 0x55b424be33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.039+0000 7f75b1293740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b424bf5310 0x55b424be3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.039+0000 7f75b1293740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55b424bf9540 con 0x55b424c13140 2024-09-15T23:20:58.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.039+0000 7f75b1293740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55b424aba4f0 con 0x55b424bf5310 2024-09-15T23:20:58.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.039+0000 7f75b1293740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55b424c13dd0 con 0x55b424bf8780 2024-09-15T23:20:58.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.039+0000 7f75b1293740 10 client.0 _ll_register_callbacks cb 0x55b424adbb50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:20:58.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.039+0000 7f75a77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b424c13140 0x55b424be33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.039+0000 7f75a77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b424c13140 0x55b424be33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42536/0 (socket says 172.21.15.123:42536) 2024-09-15T23:20:58.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.039+0000 7f75a77fe640 1 -- 172.21.15.123:0/2482483333 learned_addr learned my addr 172.21.15.123:0/2482483333 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:58.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.039+0000 7f75a7fff640 1 --2- 172.21.15.123:0/2482483333 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b424bf8780 0x55b424bfc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.039+0000 7f75aca8e640 1 --2- 172.21.15.123:0/2482483333 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b424bf5310 0x55b424be3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.040+0000 7f75a77fe640 1 -- 172.21.15.123:0/2482483333 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b424bf8780 msgr2=0x55b424bfc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:58.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.040+0000 7f75a77fe640 1 --2- 172.21.15.123:0/2482483333 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b424bf8780 0x55b424bfc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.040+0000 7f75a77fe640 1 -- 172.21.15.123:0/2482483333 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b424bf5310 msgr2=0x55b424be3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:58.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.040+0000 7f75a77fe640 1 --2- 172.21.15.123:0/2482483333 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b424bf5310 0x55b424be3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.040+0000 7f75a77fe640 1 -- 172.21.15.123:0/2482483333 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b42490e7d0 con 0x55b424c13140 2024-09-15T23:20:58.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.040+0000 7f75a77fe640 1 --2- 172.21.15.123:0/2482483333 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b424c13140 0x55b424be33f0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f759c001da0 tx=0x7f759c012690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188e0730c6bc8201 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:58.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.040+0000 7f7586ffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:20:58.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.040+0000 7f7586ffd640 1 -- 172.21.15.123:0/2482483333 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f759c005320 con 0x55b424c13140 2024-09-15T23:20:58.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.040+0000 7f7586ffd640 1 -- 172.21.15.123:0/2482483333 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(156..156 src has 1..156) ==== 5767+0+0 (secure 0 0 0) 0x7f759c007030 con 0x55b424c13140 2024-09-15T23:20:58.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.040+0000 7f75b1293740 1 -- 172.21.15.123:0/2482483333 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f759801b070 con 0x55b424c13140 2024-09-15T23:20:58.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.040+0000 7f7586ffd640 1 -- 172.21.15.123:0/2482483333 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f759c007230 con 0x55b424c13140 2024-09-15T23:20:58.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.040+0000 7f75b1293740 10 client.9327 fetch_fsmap learned FSMap version 93 2024-09-15T23:20:58.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.040+0000 7f75b1293740 1 -- 172.21.15.123:0/2482483333 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) -- 0x55b4248443f0 con 0x55b424c13140 2024-09-15T23:20:58.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.040+0000 7f7586ffd640 1 -- 172.21.15.123:0/2482483333 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f759801b070 con 0x55b424c13140 2024-09-15T23:20:58.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.040+0000 7f7586ffd640 1 -- 172.21.15.123:0/2482483333 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 93) ==== 3502+0+0 (secure 0 0 0) 0x7f759c0073d0 con 0x55b424c13140 2024-09-15T23:20:58.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.040+0000 7f75b1293740 10 client.9327 fetch_fsmap finished waiting for FSMap version 93 2024-09-15T23:20:58.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.040+0000 7f75b1293740 10 client.9327 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-15T23:20:58.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.040+0000 7f75b1293740 20 client.9327 populate_metadata read hostname 'smithi123' 2024-09-15T23:20:58.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.040+0000 7f75b1293740 1 --2- 172.21.15.123:0/2482483333 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55b424bccaa0 0x55b424bcce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.040+0000 7f75b1293740 4 client.9327 mds_command: new command op to 9006 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:20:58.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.040+0000 7f75b1293740 1 -- 172.21.15.123:0/2482483333 --> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b424b3ee20 con 0x55b424bccaa0 2024-09-15T23:20:58.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.040+0000 7f75a7fff640 1 --2- 172.21.15.123:0/2482483333 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55b424bccaa0 0x55b424bcce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.041+0000 7f7586ffd640 10 client.9327 ms_handle_connect on v2:172.21.15.123:6833/627322542 2024-09-15T23:20:58.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.041+0000 7f75a7fff640 1 --2- 172.21.15.123:0/2482483333 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55b424bccaa0 0x55b424bcce80 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=749aad175b4acf25 server_cookie=11157bbe6e8893be in_seq=0 out_seq=0 2024-09-15T23:20:58.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.041+0000 7f7586ffd640 1 -- 172.21.15.123:0/2482483333 <== mds.0 v2:172.21.15.123:6833/627322542 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b424b3ee20 con 0x55b424bccaa0 2024-09-15T23:20:58.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.041+0000 7f7586ffd640 10 client.9327 handle_command_reply: tid=0 2024-09-15T23:20:58.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.041+0000 7f75b1293740 1 client.9327 shutdown 2024-09-15T23:20:58.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.041+0000 7f75b1293740 1 -- 172.21.15.123:0/2482483333 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b424c13140 msgr2=0x55b424be33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:58.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.041+0000 7f75b1293740 1 --2- 172.21.15.123:0/2482483333 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b424c13140 0x55b424be33f0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f759c001da0 tx=0x7f759c012690 comp rx=0 tx=0).stop 2024-09-15T23:20:58.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.041+0000 7f75b1293740 1 -- 172.21.15.123:0/2482483333 shutdown_connections 2024-09-15T23:20:58.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.041+0000 7f75b1293740 1 --2- 172.21.15.123:0/2482483333 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55b424bccaa0 0x55b424bcce80 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.041+0000 7f75b1293740 1 --2- 172.21.15.123:0/2482483333 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b424bf5310 0x55b424be3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.042+0000 7f7586ffd640 0 client.9327 ms_handle_reset on v2:172.21.15.123:6833/627322542 2024-09-15T23:20:58.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.041+0000 7f75b1293740 1 --2- 172.21.15.123:0/2482483333 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b424c13140 0x55b424be33f0 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.042+0000 7f75b1293740 1 --2- 172.21.15.123:0/2482483333 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b424bf8780 0x55b424bfc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.042+0000 7f75b1293740 1 -- 172.21.15.123:0/2482483333 >> 172.21.15.123:0/2482483333 conn(0x55b424bcc0e0 msgr2=0x55b424c151b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:58.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.042+0000 7f75b1293740 1 -- 172.21.15.123:0/2482483333 shutdown_connections 2024-09-15T23:20:58.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.042+0000 7f75b1293740 1 -- 172.21.15.123:0/2482483333 wait complete. 2024-09-15T23:20:58.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.042+0000 7f75b1293740 20 client.9327 trim_cache size 0 max 16384 2024-09-15T23:20:58.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.059+0000 7f75b1293740 1 Processor -- start 2024-09-15T23:20:58.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.059+0000 7f75b1293740 1 -- start start 2024-09-15T23:20:58.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.059+0000 7f75b1293740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b424bccaa0 0x55b424c1cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.059+0000 7f75b1293740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b424bf5310 0x55b424c12b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.059+0000 7f75b1293740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b424bf8780 0x55b424bfc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.059+0000 7f75b1293740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f75a80cffd0 con 0x55b424bccaa0 2024-09-15T23:20:58.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.059+0000 7f75b1293740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f75a80cf070 con 0x55b424bf5310 2024-09-15T23:20:58.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.059+0000 7f75b1293740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f75a80ce3d0 con 0x55b424bf8780 2024-09-15T23:20:58.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.059+0000 7f75a7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b424bccaa0 0x55b424c1cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.059+0000 7f75a7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b424bccaa0 0x55b424c1cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42540/0 (socket says 172.21.15.123:42540) 2024-09-15T23:20:58.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.059+0000 7f75a7fff640 1 -- 172.21.15.123:0/352303974 learned_addr learned my addr 172.21.15.123:0/352303974 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:58.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.060+0000 7f75a77fe640 1 --2- 172.21.15.123:0/352303974 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b424bf5310 0x55b424c12b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.060+0000 7f75aca8e640 1 --2- 172.21.15.123:0/352303974 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b424bf8780 0x55b424bfc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.060+0000 7f75a7fff640 1 -- 172.21.15.123:0/352303974 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b424bf8780 msgr2=0x55b424bfc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:58.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.060+0000 7f75a7fff640 1 --2- 172.21.15.123:0/352303974 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b424bf8780 0x55b424bfc740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.060+0000 7f75a7fff640 1 -- 172.21.15.123:0/352303974 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b424bf5310 msgr2=0x55b424c12b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:58.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.060+0000 7f75a7fff640 1 --2- 172.21.15.123:0/352303974 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b424bf5310 0x55b424c12b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.060+0000 7f75a7fff640 1 -- 172.21.15.123:0/352303974 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4248040f0 con 0x55b424bccaa0 2024-09-15T23:20:58.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.060+0000 7f75a77fe640 1 --2- 172.21.15.123:0/352303974 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b424bf5310 0x55b424c12b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:58.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.060+0000 7f75a7fff640 1 --2- 172.21.15.123:0/352303974 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b424bccaa0 0x55b424c1cdb0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x55b424bf6110 tx=0x7f7598016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f83be7766c21f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:58.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.060+0000 7f758d7fa640 1 -- 172.21.15.123:0/352303974 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7598025040 con 0x55b424bccaa0 2024-09-15T23:20:58.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.060+0000 7f758d7fa640 1 -- 172.21.15.123:0/352303974 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f759801b040 con 0x55b424bccaa0 2024-09-15T23:20:58.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.060+0000 7f758d7fa640 1 -- 172.21.15.123:0/352303974 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7598004480 con 0x55b424bccaa0 2024-09-15T23:20:58.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.061+0000 7f75b1293740 1 -- 172.21.15.123:0/352303974 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b424bccaa0 msgr2=0x55b424c1cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:58.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.061+0000 7f75b1293740 1 --2- 172.21.15.123:0/352303974 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b424bccaa0 0x55b424c1cdb0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x55b424bf6110 tx=0x7f7598016000 comp rx=0 tx=0).stop 2024-09-15T23:20:58.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.061+0000 7f75b1293740 1 -- 172.21.15.123:0/352303974 shutdown_connections 2024-09-15T23:20:58.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.061+0000 7f75b1293740 1 --2- 172.21.15.123:0/352303974 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b424bf8780 0x55b424bfc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.061+0000 7f75b1293740 1 --2- 172.21.15.123:0/352303974 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b424bf5310 0x55b424c12b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.061+0000 7f75b1293740 1 --2- 172.21.15.123:0/352303974 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b424bccaa0 0x55b424c1cdb0 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.061+0000 7f75b1293740 1 -- 172.21.15.123:0/352303974 >> 172.21.15.123:0/352303974 conn(0x55b424bcc0e0 msgr2=0x55b424c18860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:58.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.061+0000 7f75b1293740 1 -- 172.21.15.123:0/352303974 shutdown_connections 2024-09-15T23:20:58.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.061+0000 7f75b1293740 1 -- 172.21.15.123:0/352303974 wait complete. 2024-09-15T23:20:58.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.061+0000 7f75b1293740 1 -- start start 2024-09-15T23:20:58.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.061+0000 7f75b1293740 1 Processor -- start 2024-09-15T23:20:58.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.062+0000 7f75b1293740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b424bccaa0 0x55b424c95980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.062+0000 7f75b1293740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b424bf5310 0x55b424bc9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.062+0000 7f75b1293740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b424bf8780 0x55b424c3adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.062+0000 7f75b1293740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55b424c1e0b0 con 0x55b424bccaa0 2024-09-15T23:20:58.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.062+0000 7f75b1293740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f75a80cea20 con 0x55b424bf8780 2024-09-15T23:20:58.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.062+0000 7f75b1293740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55b424bcaa00 con 0x55b424bf5310 2024-09-15T23:20:58.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.062+0000 7f75b1293740 10 client.0 _ll_register_callbacks cb 0x7f759c001060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:20:58.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.062+0000 7f75a7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b424bccaa0 0x55b424c95980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.062+0000 7f75a7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b424bccaa0 0x55b424c95980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42542/0 (socket says 172.21.15.123:42542) 2024-09-15T23:20:58.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.062+0000 7f75a7fff640 1 -- 172.21.15.123:0/2638843777 learned_addr learned my addr 172.21.15.123:0/2638843777 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:58.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.062+0000 7f75aca8e640 1 --2- 172.21.15.123:0/2638843777 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b424bf8780 0x55b424c3adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.062+0000 7f75a77fe640 1 --2- 172.21.15.123:0/2638843777 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b424bf5310 0x55b424bc9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.062+0000 7f75a7fff640 1 -- 172.21.15.123:0/2638843777 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b424bf5310 msgr2=0x55b424bc9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:58.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.062+0000 7f75a7fff640 1 --2- 172.21.15.123:0/2638843777 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b424bf5310 0x55b424bc9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.062+0000 7f75a7fff640 1 -- 172.21.15.123:0/2638843777 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b424bf8780 msgr2=0x55b424c3adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:58.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.062+0000 7f75a7fff640 1 --2- 172.21.15.123:0/2638843777 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b424bf8780 0x55b424c3adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.062+0000 7f75a7fff640 1 -- 172.21.15.123:0/2638843777 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b424c14a40 con 0x55b424bccaa0 2024-09-15T23:20:58.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.062+0000 7f75a77fe640 1 --2- 172.21.15.123:0/2638843777 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b424bf5310 0x55b424bc9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:58.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.063+0000 7f75a7fff640 1 --2- 172.21.15.123:0/2638843777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b424bccaa0 0x55b424c95980 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f7598011db0 tx=0x7f7598019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a20f25ee9ca114 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:58.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.063+0000 7f7586ffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:20:58.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.063+0000 7f7586ffd640 1 -- 172.21.15.123:0/2638843777 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7598041070 con 0x55b424bccaa0 2024-09-15T23:20:58.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.063+0000 7f7586ffd640 1 -- 172.21.15.123:0/2638843777 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(156..156 src has 1..156) ==== 5767+0+0 (secure 0 0 0) 0x7f7598004460 con 0x55b424bccaa0 2024-09-15T23:20:58.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.063+0000 7f75b1293740 1 -- 172.21.15.123:0/2638843777 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f759801b040 con 0x55b424bccaa0 2024-09-15T23:20:58.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.063+0000 7f7586ffd640 1 -- 172.21.15.123:0/2638843777 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f759804c050 con 0x55b424bccaa0 2024-09-15T23:20:58.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.063+0000 7f75b1293740 10 client.9333 fetch_fsmap learned FSMap version 93 2024-09-15T23:20:58.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.063+0000 7f75b1293740 1 -- 172.21.15.123:0/2638843777 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) -- 0x55b424bc9070 con 0x55b424bccaa0 2024-09-15T23:20:58.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.063+0000 7f7586ffd640 1 -- 172.21.15.123:0/2638843777 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f759801b040 con 0x55b424bccaa0 2024-09-15T23:20:58.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.063+0000 7f7586ffd640 1 -- 172.21.15.123:0/2638843777 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 93) ==== 3502+0+0 (secure 0 0 0) 0x7f759804f020 con 0x55b424bccaa0 2024-09-15T23:20:58.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.063+0000 7f75b1293740 10 client.9333 fetch_fsmap finished waiting for FSMap version 93 2024-09-15T23:20:58.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.063+0000 7f75b1293740 10 client.9333 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-15T23:20:58.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.063+0000 7f75b1293740 20 client.9333 populate_metadata read hostname 'smithi123' 2024-09-15T23:20:58.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.063+0000 7f75b1293740 1 --2- 172.21.15.123:0/2638843777 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55b424c13140 0x55b424c14e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.063+0000 7f75b1293740 4 client.9333 mds_command: new command op to 9006 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:20:58.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.063+0000 7f75b1293740 1 -- 172.21.15.123:0/2638843777 --> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b424b39170 con 0x55b424c13140 2024-09-15T23:20:58.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.063+0000 7f75a77fe640 1 --2- 172.21.15.123:0/2638843777 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55b424c13140 0x55b424c14e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.064+0000 7f7586ffd640 10 client.9333 ms_handle_connect on v2:172.21.15.123:6833/627322542 2024-09-15T23:20:58.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.064+0000 7f75a77fe640 1 --2- 172.21.15.123:0/2638843777 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55b424c13140 0x55b424c14e70 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4299c8aff25bae2 server_cookie=4ccbd97c8338e8dc in_seq=0 out_seq=0 2024-09-15T23:20:58.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.064+0000 7f7586ffd640 1 -- 172.21.15.123:0/2638843777 <== mds.0 v2:172.21.15.123:6833/627322542 1 ==== command_reply(tid 0: 0 ) ==== 8+0+69 (crc 0 0 0) 0x55b424b39170 con 0x55b424c13140 2024-09-15T23:20:58.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.064+0000 7f7586ffd640 10 client.9333 handle_command_reply: tid=0 2024-09-15T23:20:58.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.064+0000 7f75b1293740 1 client.9333 shutdown 2024-09-15T23:20:58.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.064+0000 7f75b1293740 1 -- 172.21.15.123:0/2638843777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b424bccaa0 msgr2=0x55b424c95980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:58.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.064+0000 7f75b1293740 1 --2- 172.21.15.123:0/2638843777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b424bccaa0 0x55b424c95980 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f7598011db0 tx=0x7f7598019000 comp rx=0 tx=0).stop 2024-09-15T23:20:58.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.064+0000 7f75b1293740 1 -- 172.21.15.123:0/2638843777 shutdown_connections 2024-09-15T23:20:58.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.064+0000 7f75b1293740 1 --2- 172.21.15.123:0/2638843777 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55b424c13140 0x55b424c14e70 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.064+0000 7f75b1293740 1 --2- 172.21.15.123:0/2638843777 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55b424bf8780 0x55b424c3adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.064+0000 7f75b1293740 1 --2- 172.21.15.123:0/2638843777 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55b424bf5310 0x55b424bc9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.064+0000 7f7586ffd640 0 client.9333 ms_handle_reset on v2:172.21.15.123:6833/627322542 2024-09-15T23:20:58.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.064+0000 7f75b1293740 1 --2- 172.21.15.123:0/2638843777 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55b424bccaa0 0x55b424c95980 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.064+0000 7f75b1293740 1 -- 172.21.15.123:0/2638843777 >> 172.21.15.123:0/2638843777 conn(0x55b424bcc0e0 msgr2=0x55b424c164e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:58.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.064+0000 7f75b1293740 1 -- 172.21.15.123:0/2638843777 shutdown_connections 2024-09-15T23:20:58.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.064+0000 7f75b1293740 1 -- 172.21.15.123:0/2638843777 wait complete. 2024-09-15T23:20:58.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.064+0000 7f75b1293740 20 client.9333 trim_cache size 0 max 16384 2024-09-15T23:20:58.074 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:20:58.074 INFO:teuthology.orchestra.run.smithi123.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-15T23:20:58.074 INFO:teuthology.orchestra.run.smithi123.stdout: "scrubs": {} 2024-09-15T23:20:58.074 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:20:58.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.065+0000 7f75ae4f1640 1 -- 172.21.15.123:0/2650257358 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f759406c2b0 msgr2=0x7f759406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:58.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.065+0000 7f75ae4f1640 1 --2- 172.21.15.123:0/2650257358 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f759406c2b0 0x7f759406e770 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f75a8155d90 tx=0x7f7598009190 comp rx=0 tx=0).stop 2024-09-15T23:20:58.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.065+0000 7f75ae4f1640 1 -- 172.21.15.123:0/2650257358 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75a80cd270 msgr2=0x7f75a8155780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:58.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.065+0000 7f75ae4f1640 1 --2- 172.21.15.123:0/2650257358 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75a80cd270 0x7f75a8155780 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f75a0009e50 tx=0x7f75a0004a40 comp rx=0 tx=0).stop 2024-09-15T23:20:58.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.065+0000 7f75ae4f1640 1 -- 172.21.15.123:0/2650257358 shutdown_connections 2024-09-15T23:20:58.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.065+0000 7f75ae4f1640 1 --2- 172.21.15.123:0/2650257358 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f759406c2b0 0x7f759406e770 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.065+0000 7f75ae4f1640 1 --2- 172.21.15.123:0/2650257358 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75a80cd270 0x7f75a8155780 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.065+0000 7f75ae4f1640 1 --2- 172.21.15.123:0/2650257358 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f75a80cce30 0x7f75a8155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.065+0000 7f75ae4f1640 1 --2- 172.21.15.123:0/2650257358 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75a80732e0 0x7f75a81521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.065+0000 7f75ae4f1640 1 -- 172.21.15.123:0/2650257358 >> 172.21.15.123:0/2650257358 conn(0x7f75a806d0f0 msgr2=0x7f75a8072970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:58.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.065+0000 7f75ae4f1640 1 -- 172.21.15.123:0/2650257358 shutdown_connections 2024-09-15T23:20:58.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.065+0000 7f75ae4f1640 1 -- 172.21.15.123:0/2650257358 wait complete. 2024-09-15T23:20:58.077 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:20:58.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.173+0000 7f761f36f640 1 Processor -- start 2024-09-15T23:20:58.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.173+0000 7f761f36f640 1 -- start start 2024-09-15T23:20:58.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.174+0000 7f761f36f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f761806c320 0x7f761815bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.174+0000 7f761f36f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f761813eb20 0x7f761815c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.174+0000 7f761f36f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7618071180 con 0x7f76180b2d40 2024-09-15T23:20:58.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.174+0000 7f761f36f640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f7618071ab0 con 0x7f761806c320 2024-09-15T23:20:58.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.174+0000 7f761f36f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7618071460 con 0x7f761813eb20 2024-09-15T23:20:58.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.174+0000 7f761d90c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f761813eb20 0x7f761815c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.174+0000 7f761d90c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f761813eb20 0x7f761815c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:36934/0 (socket says 172.21.15.123:36934) 2024-09-15T23:20:58.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.174+0000 7f761d90c640 1 -- 172.21.15.123:0/3392271675 learned_addr learned my addr 172.21.15.123:0/3392271675 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:58.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.174+0000 7f761c90a640 1 --2- 172.21.15.123:0/3392271675 >> v2:172.21.15.188:3300/0 conn(0x7f761806c320 0x7f761815bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.174+0000 7f761d90c640 1 -- 172.21.15.123:0/3392271675 >> v2:172.21.15.188:3300/0 conn(0x7f761806c320 msgr2=0x7f761815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:58.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.174+0000 7f761d90c640 1 --2- 172.21.15.123:0/3392271675 >> v2:172.21.15.188:3300/0 conn(0x7f761806c320 0x7f761815bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.174+0000 7f761d90c640 1 -- 172.21.15.123:0/3392271675 >> v1:172.21.15.188:6789/0 conn(0x7f76180b2d40 legacy=0x7f761806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:58.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.174+0000 7f761d90c640 1 -- 172.21.15.123:0/3392271675 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7618071740 con 0x7f761813eb20 2024-09-15T23:20:58.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.175+0000 7f761d90c640 1 --2- 172.21.15.123:0/3392271675 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f761813eb20 0x7f761815c230 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7610009e50 tx=0x7f761002a6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11212f23eeb75fa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:58.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.175+0000 7f760ffff640 1 -- 172.21.15.123:0/3392271675 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7610036070 con 0x7f761813eb20 2024-09-15T23:20:58.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.175+0000 7f760ffff640 1 -- 172.21.15.123:0/3392271675 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7610031600 con 0x7f761813eb20 2024-09-15T23:20:58.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.175+0000 7f760ffff640 1 -- 172.21.15.123:0/3392271675 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76100319d0 con 0x7f761813eb20 2024-09-15T23:20:58.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.176+0000 7f761f36f640 1 -- 172.21.15.123:0/3392271675 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f761813eb20 msgr2=0x7f761815c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:58.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.176+0000 7f761f36f640 1 --2- 172.21.15.123:0/3392271675 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f761813eb20 0x7f761815c230 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7610009e50 tx=0x7f761002a6c0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.176+0000 7f761f36f640 1 -- 172.21.15.123:0/3392271675 shutdown_connections 2024-09-15T23:20:58.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.176+0000 7f761f36f640 1 --2- 172.21.15.123:0/3392271675 >> v2:172.21.15.188:3300/0 conn(0x7f761806c320 0x7f761815bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.176+0000 7f761f36f640 1 --2- 172.21.15.123:0/3392271675 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f761813eb20 0x7f761815c230 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.176+0000 7f761f36f640 1 -- 172.21.15.123:0/3392271675 >> 172.21.15.123:0/3392271675 conn(0x7f76180ccec0 msgr2=0x7f76180cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:58.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.176+0000 7f761f36f640 1 -- 172.21.15.123:0/3392271675 shutdown_connections 2024-09-15T23:20:58.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.176+0000 7f761f36f640 1 -- 172.21.15.123:0/3392271675 wait complete. 2024-09-15T23:20:58.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.177+0000 7f761f36f640 1 Processor -- start 2024-09-15T23:20:58.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.177+0000 7f761f36f640 1 -- start start 2024-09-15T23:20:58.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.178+0000 7f761f36f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f761806c320 0x7f76180c5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.178+0000 7f761f36f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f76180b2d40 0x7f761813d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.178+0000 7f761f36f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f761813eb20 0x7f761815eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.178+0000 7f761f36f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f76180720c0 con 0x7f761813eb20 2024-09-15T23:20:58.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.178+0000 7f761f36f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7618071f40 con 0x7f761806c320 2024-09-15T23:20:58.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.178+0000 7f761f36f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7618072240 con 0x7f76180b2d40 2024-09-15T23:20:58.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.178+0000 7f761d90c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f761813eb20 0x7f761815eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.178+0000 7f761d90c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f761813eb20 0x7f761815eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42548/0 (socket says 172.21.15.123:42548) 2024-09-15T23:20:58.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.178+0000 7f761d90c640 1 -- 172.21.15.123:0/3542921741 learned_addr learned my addr 172.21.15.123:0/3542921741 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:58.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.178+0000 7f761d10b640 1 --2- 172.21.15.123:0/3542921741 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f761806c320 0x7f76180c5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.178+0000 7f761c90a640 1 --2- 172.21.15.123:0/3542921741 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f76180b2d40 0x7f761813d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.178+0000 7f761d90c640 1 -- 172.21.15.123:0/3542921741 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f76180b2d40 msgr2=0x7f761813d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:58.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.178+0000 7f761d90c640 1 --2- 172.21.15.123:0/3542921741 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f76180b2d40 0x7f761813d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.178+0000 7f761d90c640 1 -- 172.21.15.123:0/3542921741 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f761806c320 msgr2=0x7f76180c5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:58.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.178+0000 7f761d90c640 1 --2- 172.21.15.123:0/3542921741 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f761806c320 0x7f76180c5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.178+0000 7f761d90c640 1 -- 172.21.15.123:0/3542921741 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f761815dd80 con 0x7f761813eb20 2024-09-15T23:20:58.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.178+0000 7f761d90c640 1 --2- 172.21.15.123:0/3542921741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f761813eb20 0x7f761815eb40 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f7610009e50 tx=0x7f7610004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:58.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.178+0000 7f760dffb640 1 -- 172.21.15.123:0/3542921741 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7610041020 con 0x7f761813eb20 2024-09-15T23:20:58.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.178+0000 7f760dffb640 1 -- 172.21.15.123:0/3542921741 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7610007780 con 0x7f761813eb20 2024-09-15T23:20:58.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.178+0000 7f761f36f640 1 -- 172.21.15.123:0/3542921741 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f761815e060 con 0x7f761813eb20 2024-09-15T23:20:58.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.179+0000 7f760dffb640 1 -- 172.21.15.123:0/3542921741 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7610036040 con 0x7f761813eb20 2024-09-15T23:20:58.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.179+0000 7f761f36f640 1 -- 172.21.15.123:0/3542921741 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f761815f310 con 0x7f761813eb20 2024-09-15T23:20:58.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.180+0000 7f761f36f640 1 -- 172.21.15.123:0/3542921741 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f761815fb40 con 0x7f761813eb20 2024-09-15T23:20:58.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.180+0000 7f760dffb640 1 -- 172.21.15.123:0/3542921741 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7610044020 con 0x7f761813eb20 2024-09-15T23:20:58.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.181+0000 7f760dffb640 1 --2- 172.21.15.123:0/3542921741 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f75fc06c2b0 0x7f75fc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.181+0000 7f760dffb640 1 -- 172.21.15.123:0/3542921741 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5767+0+0 (secure 0 0 0) 0x7f76100ac010 con 0x7f761813eb20 2024-09-15T23:20:58.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.181+0000 7f761d10b640 1 --2- 172.21.15.123:0/3542921741 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f75fc06c2b0 0x7f75fc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.182+0000 7f761d10b640 1 --2- 172.21.15.123:0/3542921741 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f75fc06c2b0 0x7f75fc06e770 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f761815c090 tx=0x7f7614007e30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:58.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.185+0000 7f760dffb640 1 -- 172.21.15.123:0/3542921741 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f761004b030 con 0x7f761813eb20 2024-09-15T23:20:58.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.385+0000 7f761f36f640 1 -- 172.21.15.123:0/3542921741 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f761806c9c0 con 0x7f761813eb20 2024-09-15T23:20:58.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.389+0000 7f760dffb640 1 -- 172.21.15.123:0/3542921741 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5236 (secure 0 0 0) 0x7f761007a0f0 con 0x7f761813eb20 2024-09-15T23:20:58.391 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:58.391 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":93,"btime":"2024-09-15T23:20:31:301251+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7735,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/3725440007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3725440007},{"type":"v1","addr":"172.21.15.188:6836","nonce":3725440007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7738,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2908220643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2908220643},{"type":"v1","addr":"172.21.15.188:6837","nonce":2908220643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":9003,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2302544827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2302544827},{"type":"v1","addr":"172.21.15.123:6834","nonce":2302544827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:20:28.532639+0000","modified":"2024-09-15T23:20:30.630141+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9006":{"gid":9006,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/627322542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":627322542},{"type":"v1","addr":"172.21.15.123:6835","nonce":627322542}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9006,"qdb_cluster":[9006]},"id":10}]} 2024-09-15T23:20:58.391 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 93 2024-09-15T23:20:58.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.391+0000 7f761f36f640 1 -- 172.21.15.123:0/3542921741 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f75fc06c2b0 msgr2=0x7f75fc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:58.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.391+0000 7f761f36f640 1 --2- 172.21.15.123:0/3542921741 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f75fc06c2b0 0x7f75fc06e770 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f761815c090 tx=0x7f7614007e30 comp rx=0 tx=0).stop 2024-09-15T23:20:58.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.391+0000 7f761f36f640 1 -- 172.21.15.123:0/3542921741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f761813eb20 msgr2=0x7f761815eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:58.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.391+0000 7f761f36f640 1 --2- 172.21.15.123:0/3542921741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f761813eb20 0x7f761815eb40 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f7610009e50 tx=0x7f7610004a40 comp rx=0 tx=0).stop 2024-09-15T23:20:58.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.391+0000 7f761f36f640 1 -- 172.21.15.123:0/3542921741 shutdown_connections 2024-09-15T23:20:58.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.391+0000 7f761f36f640 1 --2- 172.21.15.123:0/3542921741 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f75fc06c2b0 0x7f75fc06e770 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.391+0000 7f761f36f640 1 --2- 172.21.15.123:0/3542921741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f761813eb20 0x7f761815eb40 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.391+0000 7f761f36f640 1 --2- 172.21.15.123:0/3542921741 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f76180b2d40 0x7f761813d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.391+0000 7f761f36f640 1 --2- 172.21.15.123:0/3542921741 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f761806c320 0x7f76180c5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.391+0000 7f761f36f640 1 -- 172.21.15.123:0/3542921741 >> 172.21.15.123:0/3542921741 conn(0x7f76180ccec0 msgr2=0x7f761813ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:58.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.391+0000 7f761f36f640 1 -- 172.21.15.123:0/3542921741 shutdown_connections 2024-09-15T23:20:58.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.391+0000 7f761f36f640 1 -- 172.21.15.123:0/3542921741 wait complete. 2024-09-15T23:20:58.404 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-15T23:20:58.404 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:20:58.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.498+0000 7fd2c102c640 1 Processor -- start 2024-09-15T23:20:58.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.498+0000 7fd2c102c640 1 -- start start 2024-09-15T23:20:58.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.499+0000 7fd2c102c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd2bc0b2d40 0x7fd2bc06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.499+0000 7fd2c102c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd2bc13eb20 0x7fd2bc06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.499+0000 7fd2c102c640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2bc071180 con 0x7fd2bc15bcf0 2024-09-15T23:20:58.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.499+0000 7fd2c102c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fd2bc071ab0 con 0x7fd2bc13eb20 2024-09-15T23:20:58.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.499+0000 7fd2c102c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd2bc071460 con 0x7fd2bc0b2d40 2024-09-15T23:20:58.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.499+0000 7fd2bb59e640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd2bc15bcf0 0x7fd2bc15c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60094/0 (socket says 172.21.15.123:60094) 2024-09-15T23:20:58.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.499+0000 7fd2bb59e640 1 -- 172.21.15.123:0/1655144045 learned_addr learned my addr 172.21.15.123:0/1655144045 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:58.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.500+0000 7fd2bad9d640 1 --2- 172.21.15.123:0/1655144045 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd2bc0b2d40 0x7fd2bc06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.500+0000 7fd2b9d9b640 1 -- 172.21.15.123:0/1655144045 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1253124048 0 0) 0x7fd2bc071180 con 0x7fd2bc15bcf0 2024-09-15T23:20:58.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.500+0000 7fd2b9d9b640 1 -- 172.21.15.123:0/1655144045 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2a8003520 con 0x7fd2bc15bcf0 2024-09-15T23:20:58.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.500+0000 7fd2b9d9b640 1 -- 172.21.15.123:0/1655144045 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 12153693 0 0) 0x7fd2a8003520 con 0x7fd2bc15bcf0 2024-09-15T23:20:58.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.500+0000 7fd2b9d9b640 1 -- 172.21.15.123:0/1655144045 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd2bc0b2d40 msgr2=0x7fd2bc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:58.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.500+0000 7fd2b9d9b640 1 --2- 172.21.15.123:0/1655144045 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd2bc0b2d40 0x7fd2bc06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.500+0000 7fd2b9d9b640 1 -- 172.21.15.123:0/1655144045 >> v2:172.21.15.188:3300/0 conn(0x7fd2bc13eb20 msgr2=0x7fd2bc06c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:58.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.500+0000 7fd2b9d9b640 1 --2- 172.21.15.123:0/1655144045 >> v2:172.21.15.188:3300/0 conn(0x7fd2bc13eb20 0x7fd2bc06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.500+0000 7fd2b9d9b640 1 -- 172.21.15.123:0/1655144045 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2bc071740 con 0x7fd2bc15bcf0 2024-09-15T23:20:58.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.500+0000 7fd2b9d9b640 1 -- 172.21.15.123:0/1655144045 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fd2b40019f0 con 0x7fd2bc15bcf0 2024-09-15T23:20:58.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.500+0000 7fd2b9d9b640 1 -- 172.21.15.123:0/1655144045 >> v1:172.21.15.123:6789/0 conn(0x7fd2bc15bcf0 legacy=0x7fd2bc15c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:58.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.500+0000 7fd2b9d9b640 1 --2- 172.21.15.123:0/1655144045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2a80039b0 0x7fd2a8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.500+0000 7fd2b9d9b640 1 --2- 172.21.15.123:0/1655144045 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd2bc0b2d40 0x7fd2a8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.500+0000 7fd2b9d9b640 1 --2- 172.21.15.123:0/1655144045 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd2a8004d40 0x7fd2a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.500+0000 7fd2b9d9b640 1 -- 172.21.15.123:0/1655144045 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd2bc071ab0 con 0x7fd2a80039b0 2024-09-15T23:20:58.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.500+0000 7fd2b9d9b640 1 -- 172.21.15.123:0/1655144045 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd2bc071460 con 0x7fd2a8004d40 2024-09-15T23:20:58.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.500+0000 7fd2b9d9b640 1 -- 172.21.15.123:0/1655144045 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd2a800baf0 con 0x7fd2bc0b2d40 2024-09-15T23:20:58.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.500+0000 7fd2bad9d640 1 --2- 172.21.15.123:0/1655144045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2a80039b0 0x7fd2a8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.500+0000 7fd2bb59e640 1 --2- 172.21.15.123:0/1655144045 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd2a8004d40 0x7fd2a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.500+0000 7fd2ba59c640 1 --2- 172.21.15.123:0/1655144045 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd2bc0b2d40 0x7fd2a8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.500+0000 7fd2bad9d640 1 -- 172.21.15.123:0/1655144045 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd2bc0b2d40 msgr2=0x7fd2a8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:58.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.500+0000 7fd2bad9d640 1 --2- 172.21.15.123:0/1655144045 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd2bc0b2d40 0x7fd2a8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.500+0000 7fd2bad9d640 1 -- 172.21.15.123:0/1655144045 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd2a8004d40 msgr2=0x7fd2a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:58.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.500+0000 7fd2bad9d640 1 --2- 172.21.15.123:0/1655144045 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd2a8004d40 0x7fd2a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.500+0000 7fd2bad9d640 1 -- 172.21.15.123:0/1655144045 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2a8003520 con 0x7fd2a80039b0 2024-09-15T23:20:58.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.500+0000 7fd2bb59e640 1 --2- 172.21.15.123:0/1655144045 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd2a8004d40 0x7fd2a80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:20:58.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.501+0000 7fd2bad9d640 1 --2- 172.21.15.123:0/1655144045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2a80039b0 0x7fd2a8003df0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4009ac0 tx=0x7fd2a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b0752202f24ccaf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:58.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.501+0000 7fd2b9d9b640 1 -- 172.21.15.123:0/1655144045 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4036070 con 0x7fd2a80039b0 2024-09-15T23:20:58.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.501+0000 7fd2b9d9b640 1 -- 172.21.15.123:0/1655144045 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a4031400 con 0x7fd2a80039b0 2024-09-15T23:20:58.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.501+0000 7fd2b9d9b640 1 -- 172.21.15.123:0/1655144045 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4009690 con 0x7fd2a80039b0 2024-09-15T23:20:58.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.502+0000 7fd2c102c640 1 -- 172.21.15.123:0/1655144045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2a80039b0 msgr2=0x7fd2a8003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:58.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.502+0000 7fd2c102c640 1 --2- 172.21.15.123:0/1655144045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2a80039b0 0x7fd2a8003df0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4009ac0 tx=0x7fd2a8005830 comp rx=0 tx=0).stop 2024-09-15T23:20:58.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.502+0000 7fd2bb59e640 1 -- 172.21.15.123:0/1655144045 reap_dead start 2024-09-15T23:20:58.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.502+0000 7fd2c102c640 1 -- 172.21.15.123:0/1655144045 shutdown_connections 2024-09-15T23:20:58.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.502+0000 7fd2c102c640 1 -- 172.21.15.123:0/1655144045 >> 172.21.15.123:0/1655144045 conn(0x7fd2bc0ccec0 msgr2=0x7fd2bc0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:58.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.502+0000 7fd2c102c640 1 -- 172.21.15.123:0/1655144045 shutdown_connections 2024-09-15T23:20:58.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.502+0000 7fd2c102c640 1 -- 172.21.15.123:0/1655144045 wait complete. 2024-09-15T23:20:58.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.503+0000 7fd2c102c640 1 Processor -- start 2024-09-15T23:20:58.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.503+0000 7fd2c102c640 1 -- start start 2024-09-15T23:20:58.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.504+0000 7fd2c102c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2a80039b0 0x7fd2bc1379e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.504+0000 7fd2c102c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd2bc154fd0 0x7fd2bc0cf080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.504+0000 7fd2c102c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd2bc0cf5c0 0x7fd2bc1586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.504+0000 7fd2c102c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd2bc06bfa0 con 0x7fd2a80039b0 2024-09-15T23:20:58.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.504+0000 7fd2c102c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd2bc06be20 con 0x7fd2bc154fd0 2024-09-15T23:20:58.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.504+0000 7fd2c102c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd2bc071f40 con 0x7fd2bc0cf5c0 2024-09-15T23:20:58.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.504+0000 7fd2bad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2a80039b0 0x7fd2bc1379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.504+0000 7fd2bad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2a80039b0 0x7fd2bc1379e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42558/0 (socket says 172.21.15.123:42558) 2024-09-15T23:20:58.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.504+0000 7fd2bad9d640 1 -- 172.21.15.123:0/1767252483 learned_addr learned my addr 172.21.15.123:0/1767252483 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:58.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.504+0000 7fd2bad9d640 1 -- 172.21.15.123:0/1767252483 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd2bc0cf5c0 msgr2=0x7fd2bc1586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:58.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.504+0000 7fd2bad9d640 1 --2- 172.21.15.123:0/1767252483 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd2bc0cf5c0 0x7fd2bc1586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.504+0000 7fd2bad9d640 1 -- 172.21.15.123:0/1767252483 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd2bc154fd0 msgr2=0x7fd2bc0cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:58.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.504+0000 7fd2bad9d640 1 --2- 172.21.15.123:0/1767252483 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd2bc154fd0 0x7fd2bc0cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.504+0000 7fd2bad9d640 1 -- 172.21.15.123:0/1767252483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2bc155450 con 0x7fd2a80039b0 2024-09-15T23:20:58.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.505+0000 7fd2bad9d640 1 --2- 172.21.15.123:0/1767252483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2a80039b0 0x7fd2bc1379e0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4034040 tx=0x7fd2a4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:58.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.505+0000 7fd2b37fe640 1 -- 172.21.15.123:0/1767252483 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4040020 con 0x7fd2a80039b0 2024-09-15T23:20:58.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.505+0000 7fd2b37fe640 1 -- 172.21.15.123:0/1767252483 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2a4003bc0 con 0x7fd2a80039b0 2024-09-15T23:20:58.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.505+0000 7fd2c102c640 1 -- 172.21.15.123:0/1767252483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2bc142990 con 0x7fd2a80039b0 2024-09-15T23:20:58.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.505+0000 7fd2b37fe640 1 -- 172.21.15.123:0/1767252483 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a4036040 con 0x7fd2a80039b0 2024-09-15T23:20:58.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.505+0000 7fd2c102c640 1 -- 172.21.15.123:0/1767252483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2bc142f50 con 0x7fd2a80039b0 2024-09-15T23:20:58.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.506+0000 7fd2c102c640 1 -- 172.21.15.123:0/1767252483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2bc0cf9e0 con 0x7fd2a80039b0 2024-09-15T23:20:58.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.506+0000 7fd2b37fe640 1 -- 172.21.15.123:0/1767252483 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd2a4043020 con 0x7fd2a80039b0 2024-09-15T23:20:58.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.507+0000 7fd2b37fe640 1 --2- 172.21.15.123:0/1767252483 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd29c06c2e0 0x7fd29c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.507+0000 7fd2b37fe640 1 -- 172.21.15.123:0/1767252483 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5767+0+0 (secure 0 0 0) 0x7fd2a40ab570 con 0x7fd2a80039b0 2024-09-15T23:20:58.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.507+0000 7fd2ba59c640 1 --2- 172.21.15.123:0/1767252483 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd29c06c2e0 0x7fd29c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.507+0000 7fd2ba59c640 1 --2- 172.21.15.123:0/1767252483 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd29c06c2e0 0x7fd29c06e7a0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac006dd0 tx=0x7fd2ac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:58.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.511+0000 7fd2b37fe640 1 -- 172.21.15.123:0/1767252483 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd2a404a070 con 0x7fd2a80039b0 2024-09-15T23:20:58.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.739+0000 7fd2c102c640 1 -- 172.21.15.123:0/1767252483 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fd2bc06c150 con 0x7fd2a80039b0 2024-09-15T23:20:58.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.739+0000 7fd2b37fe640 1 -- 172.21.15.123:0/1767252483 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1675 (secure 0 0 0) 0x7fd2a4098080 con 0x7fd2a80039b0 2024-09-15T23:20:58.742 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:58.742 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":549,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":156,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076566731,"bytes_used":2556182528,"bytes_avail":770537930752,"bytes_total":773094113280,"write_bytes_sec":28572201,"read_op_per_sec":0,"write_op_per_sec":28},"fsmap":{"epoch":93,"btime":"2024-09-15T23:20:31:301251+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":9006}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":25,"modified":"2024-09-15T23:20:55.627988+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T23:20:58.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.741+0000 7fd2c102c640 1 -- 172.21.15.123:0/1767252483 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd29c06c2e0 msgr2=0x7fd29c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:58.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.741+0000 7fd2c102c640 1 --2- 172.21.15.123:0/1767252483 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd29c06c2e0 0x7fd29c06e7a0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac006dd0 tx=0x7fd2ac008040 comp rx=0 tx=0).stop 2024-09-15T23:20:58.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.741+0000 7fd2c102c640 1 -- 172.21.15.123:0/1767252483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2a80039b0 msgr2=0x7fd2bc1379e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:58.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.741+0000 7fd2c102c640 1 --2- 172.21.15.123:0/1767252483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2a80039b0 0x7fd2bc1379e0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4034040 tx=0x7fd2a4004730 comp rx=0 tx=0).stop 2024-09-15T23:20:58.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.742+0000 7fd2c102c640 1 -- 172.21.15.123:0/1767252483 shutdown_connections 2024-09-15T23:20:58.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.742+0000 7fd2c102c640 1 --2- 172.21.15.123:0/1767252483 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd2bc0cf5c0 0x7fd2bc1586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.742+0000 7fd2c102c640 1 --2- 172.21.15.123:0/1767252483 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd2bc154fd0 0x7fd2bc0cf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.742+0000 7fd2c102c640 1 --2- 172.21.15.123:0/1767252483 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd29c06c2e0 0x7fd29c06e7a0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.742+0000 7fd2c102c640 1 --2- 172.21.15.123:0/1767252483 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2a80039b0 0x7fd2bc1379e0 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.742+0000 7fd2c102c640 1 -- 172.21.15.123:0/1767252483 >> 172.21.15.123:0/1767252483 conn(0x7fd2bc0ccec0 msgr2=0x7fd2bc0cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:58.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.742+0000 7fd2c102c640 1 -- 172.21.15.123:0/1767252483 shutdown_connections 2024-09-15T23:20:58.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.742+0000 7fd2c102c640 1 -- 172.21.15.123:0/1767252483 wait complete. 2024-09-15T23:20:58.755 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'paused paths [/scrub_control_test_path]'} 2024-09-15T23:20:58.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:20:58.755 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.10:0 scrub resume 2024-09-15T23:20:58.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.853+0000 7fc71e511640 1 Processor -- start 2024-09-15T23:20:58.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.854+0000 7fc71e511640 1 -- start start 2024-09-15T23:20:58.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.854+0000 7fc71e511640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc7180b3350 0x7fc7180d2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.854+0000 7fc71e511640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc7180b38a0 0x7fc7180d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.854+0000 7fc71e511640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7180cf710 con 0x7fc71806bfd0 2024-09-15T23:20:58.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.854+0000 7fc71e511640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fc7180b78a0 con 0x7fc7180b38a0 2024-09-15T23:20:58.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.854+0000 7fc71e511640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc7180cffb0 con 0x7fc7180b3350 2024-09-15T23:20:58.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.854+0000 7fc717fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc71806bfd0 0x7fc71806c3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60100/0 (socket says 172.21.15.123:60100) 2024-09-15T23:20:58.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.855+0000 7fc717fff640 1 -- 172.21.15.123:0/115647906 learned_addr learned my addr 172.21.15.123:0/115647906 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:58.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.855+0000 7fc71caae640 1 --2- 172.21.15.123:0/115647906 >> v2:172.21.15.188:3300/0 conn(0x7fc7180b38a0 0x7fc7180d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.855+0000 7fc716ffd640 1 -- 172.21.15.123:0/115647906 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3192553313 0 0) 0x7fc7180cf710 con 0x7fc71806bfd0 2024-09-15T23:20:58.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.855+0000 7fc7177fe640 1 --2- 172.21.15.123:0/115647906 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc7180b3350 0x7fc7180d2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.855+0000 7fc716ffd640 1 -- 172.21.15.123:0/115647906 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc700003520 con 0x7fc71806bfd0 2024-09-15T23:20:58.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.855+0000 7fc716ffd640 1 -- 172.21.15.123:0/115647906 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2142512871 0 0) 0x7fc700003520 con 0x7fc71806bfd0 2024-09-15T23:20:58.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.855+0000 7fc716ffd640 1 -- 172.21.15.123:0/115647906 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc7180b3350 msgr2=0x7fc7180d2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:58.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.855+0000 7fc716ffd640 1 --2- 172.21.15.123:0/115647906 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc7180b3350 0x7fc7180d2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.855+0000 7fc716ffd640 1 -- 172.21.15.123:0/115647906 >> v2:172.21.15.188:3300/0 conn(0x7fc7180b38a0 msgr2=0x7fc7180d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:58.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.855+0000 7fc716ffd640 1 --2- 172.21.15.123:0/115647906 >> v2:172.21.15.188:3300/0 conn(0x7fc7180b38a0 0x7fc7180d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.855+0000 7fc716ffd640 1 -- 172.21.15.123:0/115647906 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7180cf9f0 con 0x7fc71806bfd0 2024-09-15T23:20:58.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.855+0000 7fc716ffd640 1 -- 172.21.15.123:0/115647906 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fc708001670 con 0x7fc71806bfd0 2024-09-15T23:20:58.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.855+0000 7fc716ffd640 1 -- 172.21.15.123:0/115647906 >> v1:172.21.15.123:6789/0 conn(0x7fc71806bfd0 legacy=0x7fc71806c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:58.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.855+0000 7fc716ffd640 1 --2- 172.21.15.123:0/115647906 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc7000039e0 0x7fc700003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.855+0000 7fc716ffd640 1 --2- 172.21.15.123:0/115647906 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc7180b3350 0x7fc700004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.855+0000 7fc716ffd640 1 --2- 172.21.15.123:0/115647906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc700004d40 0x7fc7000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.855+0000 7fc716ffd640 1 -- 172.21.15.123:0/115647906 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc7180cffb0 con 0x7fc700004d40 2024-09-15T23:20:58.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.855+0000 7fc716ffd640 1 -- 172.21.15.123:0/115647906 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc70000bb00 con 0x7fc7000039e0 2024-09-15T23:20:58.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.855+0000 7fc716ffd640 1 -- 172.21.15.123:0/115647906 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc70000bcb0 con 0x7fc7180b3350 2024-09-15T23:20:58.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.855+0000 7fc71caae640 1 --2- 172.21.15.123:0/115647906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc700004d40 0x7fc7000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.855+0000 7fc717fff640 1 --2- 172.21.15.123:0/115647906 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc7000039e0 0x7fc700003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.855+0000 7fc7177fe640 1 --2- 172.21.15.123:0/115647906 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc7180b3350 0x7fc700004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.856+0000 7fc71caae640 1 -- 172.21.15.123:0/115647906 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc7180b3350 msgr2=0x7fc700004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:58.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.856+0000 7fc71caae640 1 --2- 172.21.15.123:0/115647906 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc7180b3350 0x7fc700004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.856+0000 7fc71caae640 1 -- 172.21.15.123:0/115647906 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc7000039e0 msgr2=0x7fc700003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:58.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.856+0000 7fc71caae640 1 --2- 172.21.15.123:0/115647906 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc7000039e0 0x7fc700003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.856+0000 7fc71caae640 1 -- 172.21.15.123:0/115647906 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc700003520 con 0x7fc700004d40 2024-09-15T23:20:58.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.856+0000 7fc71caae640 1 --2- 172.21.15.123:0/115647906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc700004d40 0x7fc7000051c0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7fc710007360 tx=0x7fc700005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8ffc053b95c13c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:58.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.856+0000 7fc716ffd640 1 -- 172.21.15.123:0/115647906 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc710009bc0 con 0x7fc700004d40 2024-09-15T23:20:58.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.856+0000 7fc716ffd640 1 -- 172.21.15.123:0/115647906 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc71002e650 con 0x7fc700004d40 2024-09-15T23:20:58.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.856+0000 7fc716ffd640 1 -- 172.21.15.123:0/115647906 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc71002ea40 con 0x7fc700004d40 2024-09-15T23:20:58.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.857+0000 7fc71e511640 1 -- 172.21.15.123:0/115647906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc700004d40 msgr2=0x7fc7000051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:58.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.857+0000 7fc71e511640 1 --2- 172.21.15.123:0/115647906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc700004d40 0x7fc7000051c0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7fc710007360 tx=0x7fc700005830 comp rx=0 tx=0).stop 2024-09-15T23:20:58.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.857+0000 7fc71caae640 1 -- 172.21.15.123:0/115647906 reap_dead start 2024-09-15T23:20:58.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.857+0000 7fc71e511640 1 -- 172.21.15.123:0/115647906 shutdown_connections 2024-09-15T23:20:58.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.857+0000 7fc71e511640 1 -- 172.21.15.123:0/115647906 >> 172.21.15.123:0/115647906 conn(0x7fc7180d11c0 msgr2=0x7fc7180d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:58.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.857+0000 7fc71e511640 1 -- 172.21.15.123:0/115647906 shutdown_connections 2024-09-15T23:20:58.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.857+0000 7fc71e511640 1 -- 172.21.15.123:0/115647906 wait complete. 2024-09-15T23:20:58.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.858+0000 7fc71e511640 1 Processor -- start 2024-09-15T23:20:58.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.858+0000 7fc71e511640 1 -- start start 2024-09-15T23:20:58.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.859+0000 7fc71e511640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc700004d40 0x7fc71815b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.859+0000 7fc71e511640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc7181f4910 0x7fc7181f4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.859+0000 7fc71e511640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc7180ccf60 0x7fc7180cab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.859+0000 7fc71e511640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc71806cd50 con 0x7fc700004d40 2024-09-15T23:20:58.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.859+0000 7fc71e511640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc7180d2400 con 0x7fc7181f4910 2024-09-15T23:20:58.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.859+0000 7fc71e511640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc71815eae0 con 0x7fc7180ccf60 2024-09-15T23:20:58.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.859+0000 7fc717fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc700004d40 0x7fc71815b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.859+0000 7fc717fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc700004d40 0x7fc71815b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42572/0 (socket says 172.21.15.123:42572) 2024-09-15T23:20:58.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.859+0000 7fc717fff640 1 -- 172.21.15.123:0/3261395432 learned_addr learned my addr 172.21.15.123:0/3261395432 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:58.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.859+0000 7fc717fff640 1 -- 172.21.15.123:0/3261395432 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc7180ccf60 msgr2=0x7fc7180cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:58.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.859+0000 7fc717fff640 1 --2- 172.21.15.123:0/3261395432 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc7180ccf60 0x7fc7180cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.859+0000 7fc717fff640 1 -- 172.21.15.123:0/3261395432 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc7181f4910 msgr2=0x7fc7181f4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:58.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.859+0000 7fc717fff640 1 --2- 172.21.15.123:0/3261395432 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc7181f4910 0x7fc7181f4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.859+0000 7fc717fff640 1 -- 172.21.15.123:0/3261395432 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc718160230 con 0x7fc700004d40 2024-09-15T23:20:58.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.860+0000 7fc717fff640 1 --2- 172.21.15.123:0/3261395432 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc700004d40 0x7fc71815b5e0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fc708007340 tx=0x7fc708007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:58.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.860+0000 7fc714ff9640 1 -- 172.21.15.123:0/3261395432 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70801a070 con 0x7fc700004d40 2024-09-15T23:20:58.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.860+0000 7fc714ff9640 1 -- 172.21.15.123:0/3261395432 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc70800f860 con 0x7fc700004d40 2024-09-15T23:20:58.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.860+0000 7fc71e511640 1 -- 172.21.15.123:0/3261395432 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7180cd9b0 con 0x7fc700004d40 2024-09-15T23:20:58.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.860+0000 7fc714ff9640 1 -- 172.21.15.123:0/3261395432 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70800fc50 con 0x7fc700004d40 2024-09-15T23:20:58.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.860+0000 7fc71e511640 1 -- 172.21.15.123:0/3261395432 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc718160a90 con 0x7fc700004d40 2024-09-15T23:20:58.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.861+0000 7fc714ff9640 1 -- 172.21.15.123:0/3261395432 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc70801d070 con 0x7fc700004d40 2024-09-15T23:20:58.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.862+0000 7fc714ff9640 1 --2- 172.21.15.123:0/3261395432 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc70406c2e0 0x7fc70406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.862+0000 7fc714ff9640 1 -- 172.21.15.123:0/3261395432 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5767+0+0 (secure 0 0 0) 0x7fc70808ad00 con 0x7fc700004d40 2024-09-15T23:20:58.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.862+0000 7fc7177fe640 1 --2- 172.21.15.123:0/3261395432 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc70406c2e0 0x7fc70406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.862+0000 7fc7177fe640 1 --2- 172.21.15.123:0/3261395432 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc70406c2e0 0x7fc70406e7a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fc7180ce420 tx=0x7fc70c00b2e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:58.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.863+0000 7fc7212a6740 1 Processor -- start 2024-09-15T23:20:58.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.863+0000 7fc7212a6740 1 -- start start 2024-09-15T23:20:58.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.863+0000 7fc7212a6740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55fe0eb15920 0x55fe0eb5b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.863+0000 7fc7212a6740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fe0eb130e0 0x55fe0eb15d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.863+0000 7fc7212a6740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fe0eb170b0 0x55fe0eb101a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.863+0000 7fc7212a6740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55fe0ea786f0 con 0x55fe0eb130e0 2024-09-15T23:20:58.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.863+0000 7fc7212a6740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55fe0ea20330 con 0x55fe0eb170b0 2024-09-15T23:20:58.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.863+0000 7fc7212a6740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55fe0ea746b0 con 0x55fe0eb15920 2024-09-15T23:20:58.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.863+0000 7fc7177fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fe0eb130e0 0x55fe0eb15d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.864+0000 7fc7177fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fe0eb130e0 0x55fe0eb15d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42588/0 (socket says 172.21.15.123:42588) 2024-09-15T23:20:58.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.864+0000 7fc7177fe640 1 -- 172.21.15.123:0/3215851465 learned_addr learned my addr 172.21.15.123:0/3215851465 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:58.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.864+0000 7fc717fff640 1 --2- 172.21.15.123:0/3215851465 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55fe0eb15920 0x55fe0eb5b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.864+0000 7fc7177fe640 1 -- 172.21.15.123:0/3215851465 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55fe0eb15920 msgr2=0x55fe0eb5b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:58.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.864+0000 7fc71caae640 1 --2- 172.21.15.123:0/3215851465 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fe0eb170b0 0x55fe0eb101a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.864+0000 7fc7177fe640 1 --2- 172.21.15.123:0/3215851465 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55fe0eb15920 0x55fe0eb5b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.864+0000 7fc7177fe640 1 -- 172.21.15.123:0/3215851465 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fe0eb170b0 msgr2=0x55fe0eb101a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:58.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.864+0000 7fc7177fe640 1 --2- 172.21.15.123:0/3215851465 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fe0eb170b0 0x55fe0eb101a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.864+0000 7fc7177fe640 1 -- 172.21.15.123:0/3215851465 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe0ea460d0 con 0x55fe0eb130e0 2024-09-15T23:20:58.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.864+0000 7fc717fff640 1 --2- 172.21.15.123:0/3215851465 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55fe0eb15920 0x55fe0eb5b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:20:58.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.864+0000 7fc7177fe640 1 --2- 172.21.15.123:0/3215851465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fe0eb130e0 0x55fe0eb15d00 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7fc70c00fa20 tx=0x7fc70c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec9259cf464e9ac server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:58.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.864+0000 7fc6fdffb640 1 -- 172.21.15.123:0/3215851465 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c01b050 con 0x55fe0eb130e0 2024-09-15T23:20:58.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.864+0000 7fc6fdffb640 1 -- 172.21.15.123:0/3215851465 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc70c025070 con 0x55fe0eb130e0 2024-09-15T23:20:58.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.864+0000 7fc6fdffb640 1 -- 172.21.15.123:0/3215851465 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c014de0 con 0x55fe0eb130e0 2024-09-15T23:20:58.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.865+0000 7fc7212a6740 1 -- 172.21.15.123:0/3215851465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fe0eb130e0 msgr2=0x55fe0eb15d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:58.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.865+0000 7fc7212a6740 1 --2- 172.21.15.123:0/3215851465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fe0eb130e0 0x55fe0eb15d00 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7fc70c00fa20 tx=0x7fc70c012000 comp rx=0 tx=0).stop 2024-09-15T23:20:58.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.865+0000 7fc7212a6740 1 -- 172.21.15.123:0/3215851465 shutdown_connections 2024-09-15T23:20:58.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.865+0000 7fc7212a6740 1 --2- 172.21.15.123:0/3215851465 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fe0eb170b0 0x55fe0eb101a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.865+0000 7fc7212a6740 1 --2- 172.21.15.123:0/3215851465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fe0eb130e0 0x55fe0eb15d00 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.865+0000 7fc7212a6740 1 --2- 172.21.15.123:0/3215851465 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55fe0eb15920 0x55fe0eb5b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.865+0000 7fc7212a6740 1 -- 172.21.15.123:0/3215851465 >> 172.21.15.123:0/3215851465 conn(0x55fe0eb12370 msgr2=0x55fe0eb5a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:58.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.865+0000 7fc7212a6740 1 -- 172.21.15.123:0/3215851465 shutdown_connections 2024-09-15T23:20:58.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.865+0000 7fc7212a6740 1 -- 172.21.15.123:0/3215851465 wait complete. 2024-09-15T23:20:58.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.865+0000 7fc7212a6740 1 -- start start 2024-09-15T23:20:58.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.865+0000 7fc7212a6740 1 Processor -- start 2024-09-15T23:20:58.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.866+0000 7fc7212a6740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55fe0eb15920 0x55fe0eb36af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.866+0000 7fc7212a6740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fe0eb170b0 0x55fe0eb3ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.866+0000 7fc7212a6740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fe0eb38e30 0x55fe0eb392b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.866+0000 7fc7212a6740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55fe0eb11810 con 0x55fe0eb38e30 2024-09-15T23:20:58.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.866+0000 7fc7212a6740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55fe0ea014f0 con 0x55fe0eb170b0 2024-09-15T23:20:58.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.866+0000 7fc7212a6740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55fe0eb5b8f0 con 0x55fe0eb15920 2024-09-15T23:20:58.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.866+0000 7fc7212a6740 10 client.0 _ll_register_callbacks cb 0x55fe0ea22b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:20:58.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.866+0000 7fc71caae640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fe0eb38e30 0x55fe0eb392b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.866+0000 7fc71caae640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fe0eb38e30 0x55fe0eb392b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42594/0 (socket says 172.21.15.123:42594) 2024-09-15T23:20:58.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.866+0000 7fc71caae640 1 -- 172.21.15.123:0/639632391 learned_addr learned my addr 172.21.15.123:0/639632391 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:58.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.866+0000 7fc717fff640 1 --2- 172.21.15.123:0/639632391 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55fe0eb15920 0x55fe0eb36af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.866+0000 7fc7177fe640 1 --2- 172.21.15.123:0/639632391 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fe0eb170b0 0x55fe0eb3ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.867+0000 7fc71caae640 1 -- 172.21.15.123:0/639632391 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55fe0eb15920 msgr2=0x55fe0eb36af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:58.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.867+0000 7fc71caae640 1 --2- 172.21.15.123:0/639632391 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55fe0eb15920 0x55fe0eb36af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.867+0000 7fc71caae640 1 -- 172.21.15.123:0/639632391 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fe0eb170b0 msgr2=0x55fe0eb3ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:58.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.867+0000 7fc71caae640 1 --2- 172.21.15.123:0/639632391 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fe0eb170b0 0x55fe0eb3ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.867+0000 7fc71caae640 1 -- 172.21.15.123:0/639632391 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe0e8557d0 con 0x55fe0eb38e30 2024-09-15T23:20:58.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.867+0000 7fc71caae640 1 --2- 172.21.15.123:0/639632391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fe0eb38e30 0x55fe0eb392b0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fc71002b0b0 tx=0x7fc710004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b47bd6238b98e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:58.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.867+0000 7fc6f6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:20:58.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.867+0000 7fc6f6ffd640 1 -- 172.21.15.123:0/639632391 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc71002ec60 con 0x55fe0eb38e30 2024-09-15T23:20:58.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.867+0000 7fc6f6ffd640 1 -- 172.21.15.123:0/639632391 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(156..156 src has 1..156) ==== 5767+0+0 (secure 0 0 0) 0x7fc71002ee00 con 0x55fe0eb38e30 2024-09-15T23:20:58.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.867+0000 7fc7212a6740 1 -- 172.21.15.123:0/639632391 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc70c025070 con 0x55fe0eb38e30 2024-09-15T23:20:58.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.867+0000 7fc6f6ffd640 1 -- 172.21.15.123:0/639632391 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7fc71004a050 con 0x55fe0eb38e30 2024-09-15T23:20:58.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.867+0000 7fc7212a6740 10 client.9354 fetch_fsmap learned FSMap version 93 2024-09-15T23:20:58.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.867+0000 7fc7212a6740 1 -- 172.21.15.123:0/639632391 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) -- 0x55fe0e78b3f0 con 0x55fe0eb38e30 2024-09-15T23:20:58.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.867+0000 7fc6f6ffd640 1 -- 172.21.15.123:0/639632391 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc70c025070 con 0x55fe0eb38e30 2024-09-15T23:20:58.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.867+0000 7fc6f6ffd640 1 -- 172.21.15.123:0/639632391 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 93) ==== 3502+0+0 (secure 0 0 0) 0x7fc71004d020 con 0x55fe0eb38e30 2024-09-15T23:20:58.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.867+0000 7fc7212a6740 10 client.9354 fetch_fsmap finished waiting for FSMap version 93 2024-09-15T23:20:58.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.867+0000 7fc7212a6740 10 client.9354 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-15T23:20:58.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.867+0000 7fc7212a6740 20 client.9354 populate_metadata read hostname 'smithi123' 2024-09-15T23:20:58.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.867+0000 7fc7212a6740 1 --2- 172.21.15.123:0/639632391 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55fe0eb376d0 0x55fe0eb37ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.867+0000 7fc7212a6740 4 client.9354 mds_command: new command op to 9006 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:20:58.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.867+0000 7fc7212a6740 1 -- 172.21.15.123:0/639632391 --> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe0ea85e20 con 0x55fe0eb376d0 2024-09-15T23:20:58.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.868+0000 7fc717fff640 1 --2- 172.21.15.123:0/639632391 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55fe0eb376d0 0x55fe0eb37ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.868+0000 7fc6f6ffd640 10 client.9354 ms_handle_connect on v2:172.21.15.123:6833/627322542 2024-09-15T23:20:58.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.868+0000 7fc717fff640 1 --2- 172.21.15.123:0/639632391 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55fe0eb376d0 0x55fe0eb37ab0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=832626066e7e61cd server_cookie=58b91195597ff752 in_seq=0 out_seq=0 2024-09-15T23:20:58.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.868+0000 7fc6f6ffd640 1 -- 172.21.15.123:0/639632391 <== mds.0 v2:172.21.15.123:6833/627322542 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fe0ea85e20 con 0x55fe0eb376d0 2024-09-15T23:20:58.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.868+0000 7fc6f6ffd640 10 client.9354 handle_command_reply: tid=0 2024-09-15T23:20:58.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.868+0000 7fc7212a6740 1 client.9354 shutdown 2024-09-15T23:20:58.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.869+0000 7fc7212a6740 1 -- 172.21.15.123:0/639632391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fe0eb38e30 msgr2=0x55fe0eb392b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:58.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.869+0000 7fc7212a6740 1 --2- 172.21.15.123:0/639632391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fe0eb38e30 0x55fe0eb392b0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fc71002b0b0 tx=0x7fc710004ab0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.869+0000 7fc7212a6740 1 -- 172.21.15.123:0/639632391 shutdown_connections 2024-09-15T23:20:58.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.869+0000 7fc7212a6740 1 --2- 172.21.15.123:0/639632391 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55fe0eb376d0 0x55fe0eb37ab0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.869+0000 7fc7212a6740 1 --2- 172.21.15.123:0/639632391 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fe0eb38e30 0x55fe0eb392b0 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.869+0000 7fc7212a6740 1 --2- 172.21.15.123:0/639632391 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fe0eb170b0 0x55fe0eb3ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.869+0000 7fc7212a6740 1 --2- 172.21.15.123:0/639632391 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55fe0eb15920 0x55fe0eb36af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.869+0000 7fc6f6ffd640 0 client.9354 ms_handle_reset on v2:172.21.15.123:6833/627322542 2024-09-15T23:20:58.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.869+0000 7fc7212a6740 1 -- 172.21.15.123:0/639632391 >> 172.21.15.123:0/639632391 conn(0x55fe0eb130e0 msgr2=0x55fe0eb58610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:58.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.869+0000 7fc7212a6740 1 -- 172.21.15.123:0/639632391 shutdown_connections 2024-09-15T23:20:58.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.869+0000 7fc7212a6740 1 -- 172.21.15.123:0/639632391 wait complete. 2024-09-15T23:20:58.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.869+0000 7fc7212a6740 20 client.9354 trim_cache size 0 max 16384 2024-09-15T23:20:58.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.886+0000 7fc7212a6740 1 Processor -- start 2024-09-15T23:20:58.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.886+0000 7fc7212a6740 1 -- start start 2024-09-15T23:20:58.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.886+0000 7fc7212a6740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55fe0eb15920 0x55fe0eb58610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.886+0000 7fc7212a6740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fe0eb170b0 0x55fe0eb58b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.886+0000 7fc7212a6740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fe0eb38e30 0x55fe0eb100d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.886+0000 7fc7212a6740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc7182013e0 con 0x55fe0eb170b0 2024-09-15T23:20:58.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.886+0000 7fc7212a6740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc718200460 con 0x55fe0eb38e30 2024-09-15T23:20:58.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.886+0000 7fc7212a6740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc71815fc30 con 0x55fe0eb15920 2024-09-15T23:20:58.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.887+0000 7fc7177fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fe0eb170b0 0x55fe0eb58b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.887+0000 7fc7177fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fe0eb170b0 0x55fe0eb58b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42604/0 (socket says 172.21.15.123:42604) 2024-09-15T23:20:58.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.887+0000 7fc7177fe640 1 -- 172.21.15.123:0/2956491916 learned_addr learned my addr 172.21.15.123:0/2956491916 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:58.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.887+0000 7fc7177fe640 1 -- 172.21.15.123:0/2956491916 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55fe0eb15920 msgr2=0x55fe0eb58610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:58.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.887+0000 7fc7177fe640 1 --2- 172.21.15.123:0/2956491916 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55fe0eb15920 0x55fe0eb58610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.887+0000 7fc7177fe640 1 -- 172.21.15.123:0/2956491916 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fe0eb38e30 msgr2=0x55fe0eb100d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:58.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.887+0000 7fc7177fe640 1 --2- 172.21.15.123:0/2956491916 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fe0eb38e30 0x55fe0eb100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.887+0000 7fc7177fe640 1 -- 172.21.15.123:0/2956491916 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe0e74b0f0 con 0x55fe0eb170b0 2024-09-15T23:20:58.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.887+0000 7fc7177fe640 1 --2- 172.21.15.123:0/2956491916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fe0eb170b0 0x55fe0eb58b50 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fc70c00f9f0 tx=0x7fc70c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a09039e43759416 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:58.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.887+0000 7fc6fd7fa640 1 -- 172.21.15.123:0/2956491916 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c035480 con 0x55fe0eb170b0 2024-09-15T23:20:58.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.887+0000 7fc6fd7fa640 1 -- 172.21.15.123:0/2956491916 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc70c025040 con 0x55fe0eb170b0 2024-09-15T23:20:58.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.887+0000 7fc6fd7fa640 1 -- 172.21.15.123:0/2956491916 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c035840 con 0x55fe0eb170b0 2024-09-15T23:20:58.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.888+0000 7fc7212a6740 1 -- 172.21.15.123:0/2956491916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fe0eb170b0 msgr2=0x55fe0eb58b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:58.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.888+0000 7fc7212a6740 1 --2- 172.21.15.123:0/2956491916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fe0eb170b0 0x55fe0eb58b50 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fc70c00f9f0 tx=0x7fc70c014000 comp rx=0 tx=0).stop 2024-09-15T23:20:58.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.888+0000 7fc7212a6740 1 -- 172.21.15.123:0/2956491916 shutdown_connections 2024-09-15T23:20:58.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.888+0000 7fc7212a6740 1 --2- 172.21.15.123:0/2956491916 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fe0eb38e30 0x55fe0eb100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.888+0000 7fc7212a6740 1 --2- 172.21.15.123:0/2956491916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fe0eb170b0 0x55fe0eb58b50 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.888+0000 7fc7212a6740 1 --2- 172.21.15.123:0/2956491916 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55fe0eb15920 0x55fe0eb58610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.888+0000 7fc7212a6740 1 -- 172.21.15.123:0/2956491916 >> 172.21.15.123:0/2956491916 conn(0x55fe0eb130e0 msgr2=0x55fe0eb36af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:58.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.888+0000 7fc7212a6740 1 -- 172.21.15.123:0/2956491916 shutdown_connections 2024-09-15T23:20:58.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.888+0000 7fc7212a6740 1 -- 172.21.15.123:0/2956491916 wait complete. 2024-09-15T23:20:58.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.888+0000 7fc7212a6740 1 -- start start 2024-09-15T23:20:58.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.889+0000 7fc7212a6740 1 Processor -- start 2024-09-15T23:20:58.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.889+0000 7fc7212a6740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55fe0eb15920 0x55fe0eb3c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.889+0000 7fc7212a6740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fe0eb170b0 0x55fe0ebd82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.889+0000 7fc7212a6740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fe0eb38e30 0x55fe0eb5a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.889+0000 7fc7212a6740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55fe0ea3b180 con 0x55fe0eb170b0 2024-09-15T23:20:58.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.889+0000 7fc7212a6740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc7181618e0 con 0x55fe0eb38e30 2024-09-15T23:20:58.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.889+0000 7fc7212a6740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55fe0eb0c1a0 con 0x55fe0eb15920 2024-09-15T23:20:58.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.889+0000 7fc7212a6740 10 client.0 _ll_register_callbacks cb 0x7fc7000036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:20:58.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.889+0000 7fc7177fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fe0eb170b0 0x55fe0ebd82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.889+0000 7fc7177fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fe0eb170b0 0x55fe0ebd82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42616/0 (socket says 172.21.15.123:42616) 2024-09-15T23:20:58.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.889+0000 7fc7177fe640 1 -- 172.21.15.123:0/3102110073 learned_addr learned my addr 172.21.15.123:0/3102110073 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:58.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.890+0000 7fc7177fe640 1 -- 172.21.15.123:0/3102110073 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55fe0eb15920 msgr2=0x55fe0eb3c930 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:20:58.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.890+0000 7fc7177fe640 1 --2- 172.21.15.123:0/3102110073 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55fe0eb15920 0x55fe0eb3c930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.890+0000 7fc7177fe640 1 -- 172.21.15.123:0/3102110073 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fe0eb38e30 msgr2=0x55fe0eb5a5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:20:58.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.890+0000 7fc7177fe640 1 --2- 172.21.15.123:0/3102110073 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fe0eb38e30 0x55fe0eb5a5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.890+0000 7fc7177fe640 1 -- 172.21.15.123:0/3102110073 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe0eb5e610 con 0x55fe0eb170b0 2024-09-15T23:20:58.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.890+0000 7fc7177fe640 1 --2- 172.21.15.123:0/3102110073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fe0eb170b0 0x55fe0ebd82d0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x55fe0eb5b610 tx=0x7fc70c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=470e73456f2b3213 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:58.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.890+0000 7fc6f6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:20:58.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.890+0000 7fc6f6ffd640 1 -- 172.21.15.123:0/3102110073 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c01b040 con 0x55fe0eb170b0 2024-09-15T23:20:58.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.890+0000 7fc6f6ffd640 1 -- 172.21.15.123:0/3102110073 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(156..156 src has 1..156) ==== 5767+0+0 (secure 0 0 0) 0x7fc70c035cd0 con 0x55fe0eb170b0 2024-09-15T23:20:58.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.890+0000 7fc7212a6740 1 -- 172.21.15.123:0/3102110073 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc70c025040 con 0x55fe0eb170b0 2024-09-15T23:20:58.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.890+0000 7fc6f6ffd640 1 -- 172.21.15.123:0/3102110073 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7fc70c047050 con 0x55fe0eb170b0 2024-09-15T23:20:58.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.890+0000 7fc7212a6740 10 client.9360 fetch_fsmap learned FSMap version 93 2024-09-15T23:20:58.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.890+0000 7fc7212a6740 1 -- 172.21.15.123:0/3102110073 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) -- 0x55fe0ebd8870 con 0x55fe0eb170b0 2024-09-15T23:20:58.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.890+0000 7fc6f6ffd640 1 -- 172.21.15.123:0/3102110073 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc70c025040 con 0x55fe0eb170b0 2024-09-15T23:20:58.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.890+0000 7fc6f6ffd640 1 -- 172.21.15.123:0/3102110073 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 93) ==== 3502+0+0 (secure 0 0 0) 0x7fc70c04a020 con 0x55fe0eb170b0 2024-09-15T23:20:58.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.890+0000 7fc7212a6740 10 client.9360 fetch_fsmap finished waiting for FSMap version 93 2024-09-15T23:20:58.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.890+0000 7fc7212a6740 10 client.9360 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-15T23:20:58.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.890+0000 7fc7212a6740 20 client.9360 populate_metadata read hostname 'smithi123' 2024-09-15T23:20:58.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.890+0000 7fc7212a6740 1 --2- 172.21.15.123:0/3102110073 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55fe0eb39e20 0x55fe0eb570e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:58.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.890+0000 7fc7212a6740 4 client.9360 mds_command: new command op to 9006 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-09-15T23:20:58.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.890+0000 7fc7212a6740 1 -- 172.21.15.123:0/3102110073 --> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] -- command(tid 0: {"prefix": "scrub resume"}) -- 0x55fe0ea80170 con 0x55fe0eb39e20 2024-09-15T23:20:58.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.891+0000 7fc717fff640 1 --2- 172.21.15.123:0/3102110073 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55fe0eb39e20 0x55fe0eb570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:58.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.891+0000 7fc6f6ffd640 10 client.9360 ms_handle_connect on v2:172.21.15.123:6833/627322542 2024-09-15T23:20:58.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.891+0000 7fc717fff640 1 --2- 172.21.15.123:0/3102110073 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55fe0eb39e20 0x55fe0eb570e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70c7ee35e8b2398a server_cookie=f30850fc81dc69ea in_seq=0 out_seq=0 2024-09-15T23:20:58.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.891+0000 7fc6f6ffd640 1 -- 172.21.15.123:0/3102110073 <== mds.0 v2:172.21.15.123:6833/627322542 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55fe0ea80170 con 0x55fe0eb39e20 2024-09-15T23:20:58.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.891+0000 7fc6f6ffd640 10 client.9360 handle_command_reply: tid=0 2024-09-15T23:20:58.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.891+0000 7fc7212a6740 1 client.9360 shutdown 2024-09-15T23:20:58.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.891+0000 7fc7212a6740 1 -- 172.21.15.123:0/3102110073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fe0eb170b0 msgr2=0x55fe0ebd82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:58.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.891+0000 7fc7212a6740 1 --2- 172.21.15.123:0/3102110073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fe0eb170b0 0x55fe0ebd82d0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x55fe0eb5b610 tx=0x7fc70c008040 comp rx=0 tx=0).stop 2024-09-15T23:20:58.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.891+0000 7fc7212a6740 1 -- 172.21.15.123:0/3102110073 shutdown_connections 2024-09-15T23:20:58.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.891+0000 7fc7212a6740 1 --2- 172.21.15.123:0/3102110073 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55fe0eb39e20 0x55fe0eb570e0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.891+0000 7fc7212a6740 1 --2- 172.21.15.123:0/3102110073 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55fe0eb38e30 0x55fe0eb5a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.891+0000 7fc7212a6740 1 --2- 172.21.15.123:0/3102110073 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fe0eb170b0 0x55fe0ebd82d0 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.891+0000 7fc6f6ffd640 0 client.9360 ms_handle_reset on v2:172.21.15.123:6833/627322542 2024-09-15T23:20:58.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.891+0000 7fc7212a6740 1 --2- 172.21.15.123:0/3102110073 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55fe0eb15920 0x55fe0eb3c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.891+0000 7fc7212a6740 1 -- 172.21.15.123:0/3102110073 >> 172.21.15.123:0/3102110073 conn(0x55fe0eb130e0 msgr2=0x55fe0eb69f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:58.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.892+0000 7fc7212a6740 1 -- 172.21.15.123:0/3102110073 shutdown_connections 2024-09-15T23:20:58.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.892+0000 7fc7212a6740 1 -- 172.21.15.123:0/3102110073 wait complete. 2024-09-15T23:20:58.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.892+0000 7fc7212a6740 20 client.9360 trim_cache size 0 max 16384 2024-09-15T23:20:58.912 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:20:58.912 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0 2024-09-15T23:20:58.912 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:20:58.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.892+0000 7fc71e511640 1 -- 172.21.15.123:0/3261395432 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc70406c2e0 msgr2=0x7fc70406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:58.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.892+0000 7fc71e511640 1 --2- 172.21.15.123:0/3261395432 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc70406c2e0 0x7fc70406e7a0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fc7180ce420 tx=0x7fc70c00b2e0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.892+0000 7fc71e511640 1 -- 172.21.15.123:0/3261395432 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc700004d40 msgr2=0x7fc71815b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:58.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.892+0000 7fc71e511640 1 --2- 172.21.15.123:0/3261395432 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc700004d40 0x7fc71815b5e0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fc708007340 tx=0x7fc708007800 comp rx=0 tx=0).stop 2024-09-15T23:20:58.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.892+0000 7fc71e511640 1 -- 172.21.15.123:0/3261395432 shutdown_connections 2024-09-15T23:20:58.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.892+0000 7fc71e511640 1 --2- 172.21.15.123:0/3261395432 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc7180ccf60 0x7fc7180cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.892+0000 7fc71e511640 1 --2- 172.21.15.123:0/3261395432 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc7181f4910 0x7fc7181f4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.892+0000 7fc71e511640 1 --2- 172.21.15.123:0/3261395432 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc70406c2e0 0x7fc70406e7a0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.892+0000 7fc71e511640 1 --2- 172.21.15.123:0/3261395432 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc700004d40 0x7fc71815b5e0 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:58.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.892+0000 7fc71e511640 1 -- 172.21.15.123:0/3261395432 >> 172.21.15.123:0/3261395432 conn(0x7fc7180d11c0 msgr2=0x7fc718162330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:58.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.892+0000 7fc71e511640 1 -- 172.21.15.123:0/3261395432 shutdown_connections 2024-09-15T23:20:58.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:58.892+0000 7fc71e511640 1 -- 172.21.15.123:0/3261395432 wait complete. 2024-09-15T23:20:58.915 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-15T23:20:58.915 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.10:0 scrub status 2024-09-15T23:20:59.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.014+0000 7f451d35b640 1 Processor -- start 2024-09-15T23:20:59.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.014+0000 7f451d35b640 1 -- start start 2024-09-15T23:20:59.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.015+0000 7f451d35b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f451806bfd0 0x7f451806c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:59.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.015+0000 7f451d35b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f45180b3350 0x7f45181623a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:59.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.015+0000 7f451d35b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f45180b38a0 0x7f45181628e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:59.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.015+0000 7f451d35b640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f45180b78a0 con 0x7f45180b38a0 2024-09-15T23:20:59.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.015+0000 7f451d35b640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f45180cffb0 con 0x7f45180b3350 2024-09-15T23:20:59.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.015+0000 7f451d35b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f451806c8f0 con 0x7f451806bfd0 2024-09-15T23:20:59.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.015+0000 7f45177fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f45180b38a0 0x7f45181628e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:59.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.015+0000 7f45177fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f45180b38a0 0x7f45181628e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42632/0 (socket says 172.21.15.123:42632) 2024-09-15T23:20:59.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.015+0000 7f45177fe640 1 -- 172.21.15.123:0/223014946 learned_addr learned my addr 172.21.15.123:0/223014946 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:59.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.015+0000 7f45177fe640 1 -- 172.21.15.123:0/223014946 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f451806bfd0 msgr2=0x7f451806c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:59.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.015+0000 7f45177fe640 1 --2- 172.21.15.123:0/223014946 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f451806bfd0 0x7f451806c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.015+0000 7f45177fe640 1 -- 172.21.15.123:0/223014946 >> v2:172.21.15.188:3300/0 conn(0x7f45180b3350 msgr2=0x7f45181623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:59.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.015+0000 7f45177fe640 1 --2- 172.21.15.123:0/223014946 >> v2:172.21.15.188:3300/0 conn(0x7f45180b3350 0x7f45181623a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.015+0000 7f45177fe640 1 -- 172.21.15.123:0/223014946 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45180cf710 con 0x7f45180b38a0 2024-09-15T23:20:59.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.016+0000 7f45177fe640 1 --2- 172.21.15.123:0/223014946 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45180b38a0 0x7f45181628e0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f45180688f0 tx=0x7f451002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52a5afafacccf29a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:59.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.016+0000 7f45167fc640 1 -- 172.21.15.123:0/223014946 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4510036070 con 0x7f45180b38a0 2024-09-15T23:20:59.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.016+0000 7f45167fc640 1 -- 172.21.15.123:0/223014946 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4510031600 con 0x7f45180b38a0 2024-09-15T23:20:59.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.016+0000 7f45167fc640 1 -- 172.21.15.123:0/223014946 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45100319d0 con 0x7f45180b38a0 2024-09-15T23:20:59.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.016+0000 7f451d35b640 1 -- 172.21.15.123:0/223014946 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45180b38a0 msgr2=0x7f45181628e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:59.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.016+0000 7f451d35b640 1 --2- 172.21.15.123:0/223014946 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45180b38a0 0x7f45181628e0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f45180688f0 tx=0x7f451002a6f0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.017+0000 7f451d35b640 1 -- 172.21.15.123:0/223014946 shutdown_connections 2024-09-15T23:20:59.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.017+0000 7f451d35b640 1 --2- 172.21.15.123:0/223014946 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45180b38a0 0x7f45181628e0 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.017+0000 7f451d35b640 1 --2- 172.21.15.123:0/223014946 >> v2:172.21.15.188:3300/0 conn(0x7f45180b3350 0x7f45181623a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.017+0000 7f451d35b640 1 --2- 172.21.15.123:0/223014946 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f451806bfd0 0x7f451806c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.017+0000 7f451d35b640 1 -- 172.21.15.123:0/223014946 >> 172.21.15.123:0/223014946 conn(0x7f45180d11c0 msgr2=0x7f45180d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:59.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.017+0000 7f451d35b640 1 -- 172.21.15.123:0/223014946 shutdown_connections 2024-09-15T23:20:59.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.017+0000 7f451d35b640 1 -- 172.21.15.123:0/223014946 wait complete. 2024-09-15T23:20:59.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.018+0000 7f451d35b640 1 Processor -- start 2024-09-15T23:20:59.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.018+0000 7f451d35b640 1 -- start start 2024-09-15T23:20:59.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.019+0000 7f451d35b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f451806bfd0 0x7f45180cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:59.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.019+0000 7f451d35b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45180b3350 0x7f4518157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:59.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.019+0000 7f451d35b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f45180b38a0 0x7f4518158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:59.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.019+0000 7f451d35b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f45180d2400 con 0x7f45180b3350 2024-09-15T23:20:59.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.019+0000 7f451d35b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f45180cfcd0 con 0x7f45180b38a0 2024-09-15T23:20:59.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.019+0000 7f451d35b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f451806cd50 con 0x7f451806bfd0 2024-09-15T23:20:59.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.019+0000 7f450e7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45180b3350 0x7f4518157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:59.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.019+0000 7f450e7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45180b3350 0x7f4518157b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42638/0 (socket says 172.21.15.123:42638) 2024-09-15T23:20:59.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.019+0000 7f450e7fc640 1 -- 172.21.15.123:0/1321620061 learned_addr learned my addr 172.21.15.123:0/1321620061 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:59.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.019+0000 7f45177fe640 1 --2- 172.21.15.123:0/1321620061 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f45180b38a0 0x7f4518158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:59.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.019+0000 7f4516ffd640 1 --2- 172.21.15.123:0/1321620061 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f451806bfd0 0x7f45180cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:59.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.019+0000 7f450e7fc640 1 -- 172.21.15.123:0/1321620061 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f451806bfd0 msgr2=0x7f45180cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:59.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.019+0000 7f450e7fc640 1 --2- 172.21.15.123:0/1321620061 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f451806bfd0 0x7f45180cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.019+0000 7f450e7fc640 1 -- 172.21.15.123:0/1321620061 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f45180b38a0 msgr2=0x7f4518158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:59.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.019+0000 7f450e7fc640 1 --2- 172.21.15.123:0/1321620061 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f45180b38a0 0x7f4518158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.019+0000 7f450e7fc640 1 -- 172.21.15.123:0/1321620061 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f451815f840 con 0x7f45180b3350 2024-09-15T23:20:59.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.019+0000 7f450e7fc640 1 --2- 172.21.15.123:0/1321620061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45180b3350 0x7f4518157b00 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f450000b430 tx=0x7f450000b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:59.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.019+0000 7f450ffff640 1 -- 172.21.15.123:0/1321620061 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4500015020 con 0x7f45180b3350 2024-09-15T23:20:59.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.019+0000 7f450ffff640 1 -- 172.21.15.123:0/1321620061 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4500011830 con 0x7f45180b3350 2024-09-15T23:20:59.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.019+0000 7f451d35b640 1 -- 172.21.15.123:0/1321620061 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4518161b20 con 0x7f45180b3350 2024-09-15T23:20:59.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.019+0000 7f450ffff640 1 -- 172.21.15.123:0/1321620061 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4500011c00 con 0x7f45180b3350 2024-09-15T23:20:59.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.019+0000 7f451d35b640 1 -- 172.21.15.123:0/1321620061 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f451815fd90 con 0x7f45180b3350 2024-09-15T23:20:59.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.021+0000 7f450ffff640 1 -- 172.21.15.123:0/1321620061 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4500018020 con 0x7f45180b3350 2024-09-15T23:20:59.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.021+0000 7f450ffff640 1 --2- 172.21.15.123:0/1321620061 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f44f806c2b0 0x7f44f806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:59.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.021+0000 7f450ffff640 1 -- 172.21.15.123:0/1321620061 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5767+0+0 (secure 0 0 0) 0x7f450008b240 con 0x7f45180b3350 2024-09-15T23:20:59.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.022+0000 7f4516ffd640 1 --2- 172.21.15.123:0/1321620061 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f44f806c2b0 0x7f44f806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:59.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.022+0000 7f4516ffd640 1 --2- 172.21.15.123:0/1321620061 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f44f806c2b0 0x7f44f806e770 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f4508009990 tx=0x7f4508009110 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:59.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.022+0000 7f45201cf740 1 Processor -- start 2024-09-15T23:20:59.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.022+0000 7f45201cf740 1 -- start start 2024-09-15T23:20:59.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.023+0000 7f45201cf740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d666bdb920 0x55d666c210c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:59.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.023+0000 7f45201cf740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d666bd90e0 0x55d666bdbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:59.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.023+0000 7f45201cf740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d666bdd0b0 0x55d666bd61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:59.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.023+0000 7f45201cf740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d666b3e6f0 con 0x55d666bdd0b0 2024-09-15T23:20:59.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.023+0000 7f45201cf740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55d666ae6330 con 0x55d666bd90e0 2024-09-15T23:20:59.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.023+0000 7f45201cf740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55d666b3a6b0 con 0x55d666bdb920 2024-09-15T23:20:59.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.023+0000 7f45177fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d666bdd0b0 0x55d666bd61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:59.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.023+0000 7f45177fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d666bdd0b0 0x55d666bd61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42646/0 (socket says 172.21.15.123:42646) 2024-09-15T23:20:59.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.023+0000 7f45177fe640 1 -- 172.21.15.123:0/292234277 learned_addr learned my addr 172.21.15.123:0/292234277 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:59.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.023+0000 7f4516ffd640 1 --2- 172.21.15.123:0/292234277 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d666bdb920 0x55d666c210c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:59.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.023+0000 7f450e7fc640 1 --2- 172.21.15.123:0/292234277 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d666bd90e0 0x55d666bdbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:59.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.023+0000 7f45177fe640 1 -- 172.21.15.123:0/292234277 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d666bdb920 msgr2=0x55d666c210c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:59.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.023+0000 7f45177fe640 1 --2- 172.21.15.123:0/292234277 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d666bdb920 0x55d666c210c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.023+0000 7f45177fe640 1 -- 172.21.15.123:0/292234277 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d666bd90e0 msgr2=0x55d666bdbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:59.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.023+0000 7f45177fe640 1 --2- 172.21.15.123:0/292234277 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d666bd90e0 0x55d666bdbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.023+0000 7f45177fe640 1 -- 172.21.15.123:0/292234277 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d666b0c0d0 con 0x55d666bdd0b0 2024-09-15T23:20:59.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.024+0000 7f45177fe640 1 --2- 172.21.15.123:0/292234277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d666bdd0b0 0x55d666bd61a0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f451002ace0 tx=0x7f451002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b3f690c7317795e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:59.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.024+0000 7f450cff9640 1 -- 172.21.15.123:0/292234277 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4510036040 con 0x55d666bdd0b0 2024-09-15T23:20:59.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.024+0000 7f450cff9640 1 -- 172.21.15.123:0/292234277 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f451003d630 con 0x55d666bdd0b0 2024-09-15T23:20:59.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.024+0000 7f450cff9640 1 -- 172.21.15.123:0/292234277 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f451003da00 con 0x55d666bdd0b0 2024-09-15T23:20:59.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.024+0000 7f45201cf740 1 -- 172.21.15.123:0/292234277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d666bdd0b0 msgr2=0x55d666bd61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:59.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.024+0000 7f45201cf740 1 --2- 172.21.15.123:0/292234277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d666bdd0b0 0x55d666bd61a0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f451002ace0 tx=0x7f451002e000 comp rx=0 tx=0).stop 2024-09-15T23:20:59.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.024+0000 7f45201cf740 1 -- 172.21.15.123:0/292234277 shutdown_connections 2024-09-15T23:20:59.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.024+0000 7f45201cf740 1 --2- 172.21.15.123:0/292234277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d666bdd0b0 0x55d666bd61a0 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.024+0000 7f45201cf740 1 --2- 172.21.15.123:0/292234277 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d666bd90e0 0x55d666bdbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.024+0000 7f45201cf740 1 --2- 172.21.15.123:0/292234277 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d666bdb920 0x55d666c210c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.024+0000 7f45201cf740 1 -- 172.21.15.123:0/292234277 >> 172.21.15.123:0/292234277 conn(0x55d666bd8370 msgr2=0x55d666c20590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:59.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.025+0000 7f45201cf740 1 -- 172.21.15.123:0/292234277 shutdown_connections 2024-09-15T23:20:59.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.025+0000 7f45201cf740 1 -- 172.21.15.123:0/292234277 wait complete. 2024-09-15T23:20:59.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.025+0000 7f45201cf740 1 -- start start 2024-09-15T23:20:59.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.025+0000 7f45201cf740 1 Processor -- start 2024-09-15T23:20:59.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.026+0000 7f45201cf740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d666bdb920 0x55d666c04fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:59.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.026+0000 7f45201cf740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d666bdd0b0 0x55d666beffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:59.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.026+0000 7f45201cf740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d666bf04e0 0x55d666c092d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:59.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.026+0000 7f45201cf740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d666bd7810 con 0x55d666bdd0b0 2024-09-15T23:20:59.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.026+0000 7f45201cf740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55d666ac74f0 con 0x55d666bdb920 2024-09-15T23:20:59.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.026+0000 7f45201cf740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55d666c218f0 con 0x55d666bf04e0 2024-09-15T23:20:59.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.026+0000 7f45201cf740 10 client.0 _ll_register_callbacks cb 0x55d666ae8b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:20:59.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.026+0000 7f450e7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d666bdd0b0 0x55d666beffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:59.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.026+0000 7f450e7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d666bdd0b0 0x55d666beffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42660/0 (socket says 172.21.15.123:42660) 2024-09-15T23:20:59.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.026+0000 7f450e7fc640 1 -- 172.21.15.123:0/967533901 learned_addr learned my addr 172.21.15.123:0/967533901 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:59.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.026+0000 7f4516ffd640 1 --2- 172.21.15.123:0/967533901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d666bdb920 0x55d666c04fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:59.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.026+0000 7f450e7fc640 1 -- 172.21.15.123:0/967533901 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d666bf04e0 msgr2=0x55d666c092d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:59.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.026+0000 7f450e7fc640 1 --2- 172.21.15.123:0/967533901 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d666bf04e0 0x55d666c092d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.026+0000 7f450e7fc640 1 -- 172.21.15.123:0/967533901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d666bdb920 msgr2=0x55d666c04fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:59.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.026+0000 7f450e7fc640 1 --2- 172.21.15.123:0/967533901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d666bdb920 0x55d666c04fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.026+0000 7f450e7fc640 1 -- 172.21.15.123:0/967533901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d66691b7d0 con 0x55d666bdd0b0 2024-09-15T23:20:59.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.026+0000 7f450e7fc640 1 --2- 172.21.15.123:0/967533901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d666bdd0b0 0x55d666beffa0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f4500089730 tx=0x7f4500059ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe0c3c9fb2933cfa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:59.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.026+0000 7f44f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:20:59.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.027+0000 7f44f5ffb640 1 -- 172.21.15.123:0/967533901 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4500071020 con 0x55d666bdd0b0 2024-09-15T23:20:59.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.027+0000 7f44f5ffb640 1 -- 172.21.15.123:0/967533901 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(156..156 src has 1..156) ==== 5767+0+0 (secure 0 0 0) 0x7f45000711c0 con 0x55d666bdd0b0 2024-09-15T23:20:59.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.027+0000 7f45201cf740 1 -- 172.21.15.123:0/967533901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f451003d630 con 0x55d666bdd0b0 2024-09-15T23:20:59.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.027+0000 7f44f5ffb640 1 -- 172.21.15.123:0/967533901 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f4500061e50 con 0x55d666bdd0b0 2024-09-15T23:20:59.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.027+0000 7f45201cf740 10 client.9372 fetch_fsmap learned FSMap version 93 2024-09-15T23:20:59.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.027+0000 7f45201cf740 1 -- 172.21.15.123:0/967533901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) -- 0x55d6668513f0 con 0x55d666bdd0b0 2024-09-15T23:20:59.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.027+0000 7f44f5ffb640 1 -- 172.21.15.123:0/967533901 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f451003d630 con 0x55d666bdd0b0 2024-09-15T23:20:59.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.027+0000 7f44f5ffb640 1 -- 172.21.15.123:0/967533901 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 93) ==== 3502+0+0 (secure 0 0 0) 0x7f45000558e0 con 0x55d666bdd0b0 2024-09-15T23:20:59.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.027+0000 7f45201cf740 10 client.9372 fetch_fsmap finished waiting for FSMap version 93 2024-09-15T23:20:59.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.027+0000 7f45201cf740 10 client.9372 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-15T23:20:59.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.027+0000 7f45201cf740 20 client.9372 populate_metadata read hostname 'smithi123' 2024-09-15T23:20:59.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.027+0000 7f45201cf740 1 --2- 172.21.15.123:0/967533901 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55d666c1d5b0 0x55d666c1da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:59.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.027+0000 7f45201cf740 4 client.9372 mds_command: new command op to 9006 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:20:59.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.027+0000 7f45201cf740 1 -- 172.21.15.123:0/967533901 --> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d666b4be20 con 0x55d666c1d5b0 2024-09-15T23:20:59.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.027+0000 7f4516ffd640 1 --2- 172.21.15.123:0/967533901 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55d666c1d5b0 0x55d666c1da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:59.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.027+0000 7f44f5ffb640 10 client.9372 ms_handle_connect on v2:172.21.15.123:6833/627322542 2024-09-15T23:20:59.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.027+0000 7f4516ffd640 1 --2- 172.21.15.123:0/967533901 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55d666c1d5b0 0x55d666c1da00 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b8e7effc22fcf0c server_cookie=b88afd8277e9d9b5 in_seq=0 out_seq=0 2024-09-15T23:20:59.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.028+0000 7f44f5ffb640 1 -- 172.21.15.123:0/967533901 <== mds.0 v2:172.21.15.123:6833/627322542 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d666b4be20 con 0x55d666c1d5b0 2024-09-15T23:20:59.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.028+0000 7f44f5ffb640 10 client.9372 handle_command_reply: tid=0 2024-09-15T23:20:59.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.028+0000 7f45201cf740 1 client.9372 shutdown 2024-09-15T23:20:59.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.028+0000 7f45201cf740 1 -- 172.21.15.123:0/967533901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d666bdd0b0 msgr2=0x55d666beffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:59.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.028+0000 7f45201cf740 1 --2- 172.21.15.123:0/967533901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d666bdd0b0 0x55d666beffa0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f4500089730 tx=0x7f4500059ab0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.028+0000 7f45201cf740 1 -- 172.21.15.123:0/967533901 shutdown_connections 2024-09-15T23:20:59.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.028+0000 7f45201cf740 1 --2- 172.21.15.123:0/967533901 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55d666c1d5b0 0x55d666c1da00 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.028+0000 7f45201cf740 1 --2- 172.21.15.123:0/967533901 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d666bf04e0 0x55d666c092d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.028+0000 7f45201cf740 1 --2- 172.21.15.123:0/967533901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d666bdd0b0 0x55d666beffa0 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.028+0000 7f45201cf740 1 --2- 172.21.15.123:0/967533901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d666bdb920 0x55d666c04fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.028+0000 7f45201cf740 1 -- 172.21.15.123:0/967533901 >> 172.21.15.123:0/967533901 conn(0x55d666bd90e0 msgr2=0x55d666bd9680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:59.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.028+0000 7f44f5ffb640 0 client.9372 ms_handle_reset on v2:172.21.15.123:6833/627322542 2024-09-15T23:20:59.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.028+0000 7f45201cf740 1 -- 172.21.15.123:0/967533901 shutdown_connections 2024-09-15T23:20:59.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.028+0000 7f45201cf740 1 -- 172.21.15.123:0/967533901 wait complete. 2024-09-15T23:20:59.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.028+0000 7f45201cf740 20 client.9372 trim_cache size 0 max 16384 2024-09-15T23:20:59.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.045+0000 7f45201cf740 1 Processor -- start 2024-09-15T23:20:59.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.045+0000 7f45201cf740 1 -- start start 2024-09-15T23:20:59.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.046+0000 7f45201cf740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d666bdb920 0x55d666c1e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:59.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.046+0000 7f45201cf740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d666bdd0b0 0x55d666c1eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:59.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.046+0000 7f45201cf740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d666bf04e0 0x55d666c1f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:59.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.046+0000 7f45201cf740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4518200a80 con 0x55d666bdb920 2024-09-15T23:20:59.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.046+0000 7f45201cf740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f45181ffab0 con 0x55d666bf04e0 2024-09-15T23:20:59.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.046+0000 7f45201cf740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f451815a560 con 0x55d666bdd0b0 2024-09-15T23:20:59.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.046+0000 7f4516ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d666bdb920 0x55d666c1e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:59.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.046+0000 7f4516ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d666bdb920 0x55d666c1e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42668/0 (socket says 172.21.15.123:42668) 2024-09-15T23:20:59.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.046+0000 7f4516ffd640 1 -- 172.21.15.123:0/952772265 learned_addr learned my addr 172.21.15.123:0/952772265 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:59.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.046+0000 7f4516ffd640 1 -- 172.21.15.123:0/952772265 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d666bdd0b0 msgr2=0x55d666c1eb50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:20:59.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.046+0000 7f4516ffd640 1 --2- 172.21.15.123:0/952772265 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d666bdd0b0 0x55d666c1eb50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.046+0000 7f4516ffd640 1 -- 172.21.15.123:0/952772265 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d666bf04e0 msgr2=0x55d666c1f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:59.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.046+0000 7f4516ffd640 1 --2- 172.21.15.123:0/952772265 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d666bf04e0 0x55d666c1f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.046+0000 7f4516ffd640 1 -- 172.21.15.123:0/952772265 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d666c03760 con 0x55d666bdb920 2024-09-15T23:20:59.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.046+0000 7f4516ffd640 1 --2- 172.21.15.123:0/952772265 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d666bdb920 0x55d666c1e610 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x55d666c04980 tx=0x7f4508015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c1c6d530c2b6e41 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:59.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.046+0000 7f44f7fff640 1 -- 172.21.15.123:0/952772265 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450802e070 con 0x55d666bdb920 2024-09-15T23:20:59.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.046+0000 7f44f7fff640 1 -- 172.21.15.123:0/952772265 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f450800e930 con 0x55d666bdb920 2024-09-15T23:20:59.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.046+0000 7f44f7fff640 1 -- 172.21.15.123:0/952772265 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450801b040 con 0x55d666bdb920 2024-09-15T23:20:59.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.047+0000 7f45201cf740 1 -- 172.21.15.123:0/952772265 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d666bdb920 msgr2=0x55d666c1e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:59.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.047+0000 7f45201cf740 1 --2- 172.21.15.123:0/952772265 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d666bdb920 0x55d666c1e610 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x55d666c04980 tx=0x7f4508015000 comp rx=0 tx=0).stop 2024-09-15T23:20:59.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.047+0000 7f45201cf740 1 -- 172.21.15.123:0/952772265 shutdown_connections 2024-09-15T23:20:59.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.047+0000 7f45201cf740 1 --2- 172.21.15.123:0/952772265 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d666bf04e0 0x55d666c1f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.047+0000 7f45201cf740 1 --2- 172.21.15.123:0/952772265 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d666bdd0b0 0x55d666c1eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.047+0000 7f45201cf740 1 --2- 172.21.15.123:0/952772265 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d666bdb920 0x55d666c1e610 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.047+0000 7f45201cf740 1 -- 172.21.15.123:0/952772265 >> 172.21.15.123:0/952772265 conn(0x55d666bd90e0 msgr2=0x55d666bd9680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:59.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.047+0000 7f45201cf740 1 -- 172.21.15.123:0/952772265 shutdown_connections 2024-09-15T23:20:59.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.047+0000 7f45201cf740 1 -- 172.21.15.123:0/952772265 wait complete. 2024-09-15T23:20:59.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.047+0000 7f45201cf740 1 -- start start 2024-09-15T23:20:59.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.047+0000 7f45201cf740 1 Processor -- start 2024-09-15T23:20:59.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.048+0000 7f45201cf740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d666bdb920 0x55d666c01290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:59.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.048+0000 7f45201cf740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d666bdd0b0 0x55d666c017d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:59.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.048+0000 7f45201cf740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d666bf04e0 0x55d666c9ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:59.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.048+0000 7f45201cf740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d666bd7d20 con 0x55d666bdb920 2024-09-15T23:20:59.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.048+0000 7f45201cf740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f45181ff4c0 con 0x55d666bdd0b0 2024-09-15T23:20:59.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.048+0000 7f45201cf740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55d666c305e0 con 0x55d666bf04e0 2024-09-15T23:20:59.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.048+0000 7f45201cf740 10 client.0 _ll_register_callbacks cb 0x7f450008b130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:20:59.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.048+0000 7f4516ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d666bdb920 0x55d666c01290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:59.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.048+0000 7f4516ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d666bdb920 0x55d666c01290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42678/0 (socket says 172.21.15.123:42678) 2024-09-15T23:20:59.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.048+0000 7f4516ffd640 1 -- 172.21.15.123:0/3260333856 learned_addr learned my addr 172.21.15.123:0/3260333856 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:59.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.048+0000 7f4516ffd640 1 -- 172.21.15.123:0/3260333856 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d666bf04e0 msgr2=0x55d666c9ded0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:20:59.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.048+0000 7f4516ffd640 1 --2- 172.21.15.123:0/3260333856 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d666bf04e0 0x55d666c9ded0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.048+0000 7f4516ffd640 1 -- 172.21.15.123:0/3260333856 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d666bdd0b0 msgr2=0x55d666c017d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:20:59.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.048+0000 7f4516ffd640 1 --2- 172.21.15.123:0/3260333856 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d666bdd0b0 0x55d666c017d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.048+0000 7f4516ffd640 1 -- 172.21.15.123:0/3260333856 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6668110f0 con 0x55d666bdb920 2024-09-15T23:20:59.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.049+0000 7f4516ffd640 1 --2- 172.21.15.123:0/3260333856 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d666bdb920 0x55d666c01290 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f450802c040 tx=0x7f45080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a2233c88e64fb1a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:59.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.049+0000 7f44f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:20:59.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.049+0000 7f44f5ffb640 1 -- 172.21.15.123:0/3260333856 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4508037060 con 0x55d666bdb920 2024-09-15T23:20:59.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.049+0000 7f44f5ffb640 1 -- 172.21.15.123:0/3260333856 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(156..156 src has 1..156) ==== 5767+0+0 (secure 0 0 0) 0x7f4508028050 con 0x55d666bdb920 2024-09-15T23:20:59.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.049+0000 7f45201cf740 1 -- 172.21.15.123:0/3260333856 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f450800e930 con 0x55d666bdb920 2024-09-15T23:20:59.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.049+0000 7f44f5ffb640 1 -- 172.21.15.123:0/3260333856 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) ==== 24+0+0 (secure 0 0 0) 0x7f450803d050 con 0x55d666bdb920 2024-09-15T23:20:59.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.049+0000 7f45201cf740 10 client.9378 fetch_fsmap learned FSMap version 93 2024-09-15T23:20:59.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.049+0000 7f45201cf740 1 -- 172.21.15.123:0/3260333856 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) -- 0x55d666c30080 con 0x55d666bdb920 2024-09-15T23:20:59.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.049+0000 7f44f5ffb640 1 -- 172.21.15.123:0/3260333856 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f450800e930 con 0x55d666bdb920 2024-09-15T23:20:59.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.049+0000 7f44f5ffb640 1 -- 172.21.15.123:0/3260333856 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 93) ==== 3502+0+0 (secure 0 0 0) 0x7f4508040020 con 0x55d666bdb920 2024-09-15T23:20:59.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.049+0000 7f45201cf740 10 client.9378 fetch_fsmap finished waiting for FSMap version 93 2024-09-15T23:20:59.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.049+0000 7f45201cf740 10 client.9378 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.c 2024-09-15T23:20:59.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.049+0000 7f45201cf740 20 client.9378 populate_metadata read hostname 'smithi123' 2024-09-15T23:20:59.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.049+0000 7f45201cf740 1 --2- 172.21.15.123:0/3260333856 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55d666c09e30 0x55d666c9e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:59.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.049+0000 7f45201cf740 4 client.9378 mds_command: new command op to 9006 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:20:59.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.049+0000 7f45201cf740 1 -- 172.21.15.123:0/3260333856 --> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d666b46170 con 0x55d666c09e30 2024-09-15T23:20:59.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.049+0000 7f450e7fc640 1 --2- 172.21.15.123:0/3260333856 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55d666c09e30 0x55d666c9e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:59.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.050+0000 7f450e7fc640 1 --2- 172.21.15.123:0/3260333856 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55d666c09e30 0x55d666c9e410 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb62d44f3d38dae2 server_cookie=c6bdd30c15e181d1 in_seq=0 out_seq=0 2024-09-15T23:20:59.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.050+0000 7f44f5ffb640 10 client.9378 ms_handle_connect on v2:172.21.15.123:6833/627322542 2024-09-15T23:20:59.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.050+0000 7f44f5ffb640 1 -- 172.21.15.123:0/3260333856 <== mds.0 v2:172.21.15.123:6833/627322542 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55d666b46170 con 0x55d666c09e30 2024-09-15T23:20:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.050+0000 7f44f5ffb640 10 client.9378 handle_command_reply: tid=0 2024-09-15T23:20:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.050+0000 7f45201cf740 1 client.9378 shutdown 2024-09-15T23:20:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.050+0000 7f45201cf740 1 -- 172.21.15.123:0/3260333856 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d666bdb920 msgr2=0x55d666c01290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.050+0000 7f45201cf740 1 --2- 172.21.15.123:0/3260333856 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d666bdb920 0x55d666c01290 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f450802c040 tx=0x7f45080046c0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.050+0000 7f45201cf740 1 -- 172.21.15.123:0/3260333856 shutdown_connections 2024-09-15T23:20:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.050+0000 7f45201cf740 1 --2- 172.21.15.123:0/3260333856 >> [v2:172.21.15.123:6833/627322542,v1:172.21.15.123:6835/627322542] conn(0x55d666c09e30 0x55d666c9e410 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.050+0000 7f45201cf740 1 --2- 172.21.15.123:0/3260333856 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d666bf04e0 0x55d666c9ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.050+0000 7f45201cf740 1 --2- 172.21.15.123:0/3260333856 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d666bdd0b0 0x55d666c017d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.050+0000 7f44f5ffb640 0 client.9378 ms_handle_reset on v2:172.21.15.123:6833/627322542 2024-09-15T23:20:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.050+0000 7f45201cf740 1 --2- 172.21.15.123:0/3260333856 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d666bdb920 0x55d666c01290 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.050+0000 7f45201cf740 1 -- 172.21.15.123:0/3260333856 >> 172.21.15.123:0/3260333856 conn(0x55d666bd90e0 msgr2=0x55d666bd9680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.050+0000 7f45201cf740 1 -- 172.21.15.123:0/3260333856 shutdown_connections 2024-09-15T23:20:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.050+0000 7f45201cf740 1 -- 172.21.15.123:0/3260333856 wait complete. 2024-09-15T23:20:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.050+0000 7f45201cf740 20 client.9378 trim_cache size 0 max 16384 2024-09-15T23:20:59.066 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:20:59.066 INFO:teuthology.orchestra.run.smithi123.stdout: "status": "no active scrubs running", 2024-09-15T23:20:59.066 INFO:teuthology.orchestra.run.smithi123.stdout: "scrubs": {} 2024-09-15T23:20:59.066 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:20:59.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.050+0000 7f451d35b640 1 -- 172.21.15.123:0/1321620061 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f44f806c2b0 msgr2=0x7f44f806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:59.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.050+0000 7f451d35b640 1 --2- 172.21.15.123:0/1321620061 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f44f806c2b0 0x7f44f806e770 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f4508009990 tx=0x7f4508009110 comp rx=0 tx=0).stop 2024-09-15T23:20:59.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.050+0000 7f451d35b640 1 -- 172.21.15.123:0/1321620061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45180b3350 msgr2=0x7f4518157b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:59.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.050+0000 7f451d35b640 1 --2- 172.21.15.123:0/1321620061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45180b3350 0x7f4518157b00 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f450000b430 tx=0x7f450000b830 comp rx=0 tx=0).stop 2024-09-15T23:20:59.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.051+0000 7f451d35b640 1 -- 172.21.15.123:0/1321620061 shutdown_connections 2024-09-15T23:20:59.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.051+0000 7f451d35b640 1 --2- 172.21.15.123:0/1321620061 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f45180b38a0 0x7f4518158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.051+0000 7f451d35b640 1 --2- 172.21.15.123:0/1321620061 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f44f806c2b0 0x7f44f806e770 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.051+0000 7f451d35b640 1 --2- 172.21.15.123:0/1321620061 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f45180b3350 0x7f4518157b00 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.051+0000 7f451d35b640 1 --2- 172.21.15.123:0/1321620061 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f451806bfd0 0x7f45180cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.051+0000 7f451d35b640 1 -- 172.21.15.123:0/1321620061 >> 172.21.15.123:0/1321620061 conn(0x7f45180d11c0 msgr2=0x7f45180d3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:59.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.051+0000 7f451d35b640 1 -- 172.21.15.123:0/1321620061 shutdown_connections 2024-09-15T23:20:59.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.051+0000 7f451d35b640 1 -- 172.21.15.123:0/1321620061 wait complete. 2024-09-15T23:20:59.068 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T23:20:59.069 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:20:59.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.166+0000 7f9ef0b8d640 1 Processor -- start 2024-09-15T23:20:59.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.166+0000 7f9ef0b8d640 1 -- start start 2024-09-15T23:20:59.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.167+0000 7f9ef0b8d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9eec15ed20 0x7f9eec0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:59.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.167+0000 7f9ef0b8d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9eec0b90e0 0x7f9eec0b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:59.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.167+0000 7f9ef0b8d640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9eec0d0e70 con 0x7f9eec0d23b0 2024-09-15T23:20:59.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.167+0000 7f9ef0b8d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f9eec0d41c0 con 0x7f9eec0b90e0 2024-09-15T23:20:59.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.167+0000 7f9ef0b8d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9eec0d35b0 con 0x7f9eec15ed20 2024-09-15T23:20:59.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.167+0000 7f9eead9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9eec0b90e0 0x7f9eec0b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:59.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.167+0000 7f9eead9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9eec0b90e0 0x7f9eec0b67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42690/0 (socket says 172.21.15.123:42690) 2024-09-15T23:20:59.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.167+0000 7f9eead9d640 1 -- 172.21.15.123:0/4175976620 learned_addr learned my addr 172.21.15.123:0/4175976620 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:59.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.167+0000 7f9eea59c640 1 --2- 172.21.15.123:0/4175976620 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9eec15ed20 0x7f9eec0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:59.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.167+0000 7f9eead9d640 1 -- 172.21.15.123:0/4175976620 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9eec15ed20 msgr2=0x7f9eec0b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:20:59.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.167+0000 7f9eead9d640 1 --2- 172.21.15.123:0/4175976620 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9eec15ed20 0x7f9eec0b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.167+0000 7f9eead9d640 1 -- 172.21.15.123:0/4175976620 >> v1:172.21.15.188:6789/0 conn(0x7f9eec0d23b0 legacy=0x7f9eec0cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:59.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.167+0000 7f9eead9d640 1 -- 172.21.15.123:0/4175976620 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eec0d3890 con 0x7f9eec0b90e0 2024-09-15T23:20:59.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.168+0000 7f9eead9d640 1 --2- 172.21.15.123:0/4175976620 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9eec0b90e0 0x7f9eec0b67a0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4009e50 tx=0x7f9ee402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8cbe4c9a123350 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:59.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.168+0000 7f9ee9d9b640 1 -- 172.21.15.123:0/4175976620 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4036070 con 0x7f9eec0b90e0 2024-09-15T23:20:59.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.168+0000 7f9ee9d9b640 1 -- 172.21.15.123:0/4175976620 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ee4031600 con 0x7f9eec0b90e0 2024-09-15T23:20:59.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.168+0000 7f9ee9d9b640 1 -- 172.21.15.123:0/4175976620 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee40319d0 con 0x7f9eec0b90e0 2024-09-15T23:20:59.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.169+0000 7f9ef0b8d640 1 -- 172.21.15.123:0/4175976620 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9eec0b90e0 msgr2=0x7f9eec0b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:59.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.169+0000 7f9ef0b8d640 1 --2- 172.21.15.123:0/4175976620 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9eec0b90e0 0x7f9eec0b67a0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4009e50 tx=0x7f9ee402a710 comp rx=0 tx=0).stop 2024-09-15T23:20:59.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.169+0000 7f9ef0b8d640 1 -- 172.21.15.123:0/4175976620 shutdown_connections 2024-09-15T23:20:59.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.169+0000 7f9ef0b8d640 1 --2- 172.21.15.123:0/4175976620 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9eec0b90e0 0x7f9eec0b67a0 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.169+0000 7f9ef0b8d640 1 --2- 172.21.15.123:0/4175976620 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9eec15ed20 0x7f9eec0b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.169+0000 7f9ef0b8d640 1 -- 172.21.15.123:0/4175976620 >> 172.21.15.123:0/4175976620 conn(0x7f9eec0d1260 msgr2=0x7f9eec0d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:59.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.169+0000 7f9ef0b8d640 1 -- 172.21.15.123:0/4175976620 shutdown_connections 2024-09-15T23:20:59.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.169+0000 7f9ef0b8d640 1 -- 172.21.15.123:0/4175976620 wait complete. 2024-09-15T23:20:59.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.170+0000 7f9ef0b8d640 1 Processor -- start 2024-09-15T23:20:59.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.171+0000 7f9ef0b8d640 1 -- start start 2024-09-15T23:20:59.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.171+0000 7f9ef0b8d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9eec0b90e0 0x7f9eec155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:59.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.171+0000 7f9ef0b8d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9eec0d23b0 0x7f9eec0ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:59.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.171+0000 7f9ef0b8d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9eec15ed20 0x7f9eec1e9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:59.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.171+0000 7f9ef0b8d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec0d32a0 con 0x7f9eec0b90e0 2024-09-15T23:20:59.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.171+0000 7f9ef0b8d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9eec0d3e50 con 0x7f9eec0d23b0 2024-09-15T23:20:59.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.171+0000 7f9ef0b8d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9eec15f100 con 0x7f9eec15ed20 2024-09-15T23:20:59.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.171+0000 7f9eea59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9eec0b90e0 0x7f9eec155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:59.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.171+0000 7f9eea59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9eec0b90e0 0x7f9eec155940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42704/0 (socket says 172.21.15.123:42704) 2024-09-15T23:20:59.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.171+0000 7f9eea59c640 1 -- 172.21.15.123:0/739465993 learned_addr learned my addr 172.21.15.123:0/739465993 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:59.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.171+0000 7f9ee1d9b640 1 --2- 172.21.15.123:0/739465993 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9eec0d23b0 0x7f9eec0ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:59.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.171+0000 7f9eead9d640 1 --2- 172.21.15.123:0/739465993 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9eec15ed20 0x7f9eec1e9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:59.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.172+0000 7f9eea59c640 1 -- 172.21.15.123:0/739465993 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9eec15ed20 msgr2=0x7f9eec1e9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:59.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.172+0000 7f9eea59c640 1 --2- 172.21.15.123:0/739465993 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9eec15ed20 0x7f9eec1e9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.172+0000 7f9eea59c640 1 -- 172.21.15.123:0/739465993 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9eec0d23b0 msgr2=0x7f9eec0ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:59.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.172+0000 7f9eea59c640 1 --2- 172.21.15.123:0/739465993 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9eec0d23b0 0x7f9eec0ca700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.172+0000 7f9eea59c640 1 -- 172.21.15.123:0/739465993 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eec0cba50 con 0x7f9eec0b90e0 2024-09-15T23:20:59.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.172+0000 7f9eea59c640 1 --2- 172.21.15.123:0/739465993 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9eec0b90e0 0x7f9eec155940 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f9edc00d800 tx=0x7f9edc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:59.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.172+0000 7f9ee37fe640 1 -- 172.21.15.123:0/739465993 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9edc00b6c0 con 0x7f9eec0b90e0 2024-09-15T23:20:59.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.172+0000 7f9ee37fe640 1 -- 172.21.15.123:0/739465993 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9edc019070 con 0x7f9eec0b90e0 2024-09-15T23:20:59.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.172+0000 7f9ef0b8d640 1 -- 172.21.15.123:0/739465993 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9eec0cbd30 con 0x7f9eec0b90e0 2024-09-15T23:20:59.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.172+0000 7f9ee37fe640 1 -- 172.21.15.123:0/739465993 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9edc00ba80 con 0x7f9eec0b90e0 2024-09-15T23:20:59.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.172+0000 7f9ef0b8d640 1 -- 172.21.15.123:0/739465993 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9eec0cc2f0 con 0x7f9eec0b90e0 2024-09-15T23:20:59.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.173+0000 7f9ef0b8d640 1 -- 172.21.15.123:0/739465993 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9eec0b7010 con 0x7f9eec0b90e0 2024-09-15T23:20:59.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.173+0000 7f9ee37fe640 1 -- 172.21.15.123:0/739465993 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9edc00bc20 con 0x7f9eec0b90e0 2024-09-15T23:20:59.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.174+0000 7f9ee37fe640 1 --2- 172.21.15.123:0/739465993 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9ecc06c2b0 0x7f9ecc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:59.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.174+0000 7f9ee37fe640 1 -- 172.21.15.123:0/739465993 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5767+0+0 (secure 0 0 0) 0x7f9edc08b7e0 con 0x7f9eec0b90e0 2024-09-15T23:20:59.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.174+0000 7f9ee1d9b640 1 --2- 172.21.15.123:0/739465993 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9ecc06c2b0 0x7f9ecc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:59.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.175+0000 7f9ee1d9b640 1 --2- 172.21.15.123:0/739465993 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9ecc06c2b0 0x7f9ecc06e770 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f9eec160c40 tx=0x7f9ed4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:59.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.178+0000 7f9ee37fe640 1 -- 172.21.15.123:0/739465993 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9edc0598c0 con 0x7f9eec0b90e0 2024-09-15T23:20:59.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.379+0000 7f9ef0b8d640 1 -- 172.21.15.123:0/739465993 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9eec0b3f20 con 0x7f9eec0b90e0 2024-09-15T23:20:59.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.379+0000 7f9ee37fe640 1 -- 172.21.15.123:0/739465993 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5236 (secure 0 0 0) 0x7f9edc05dbc0 con 0x7f9eec0b90e0 2024-09-15T23:20:59.381 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:59.381 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":93,"btime":"2024-09-15T23:20:31:301251+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7735,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/3725440007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3725440007},{"type":"v1","addr":"172.21.15.188:6836","nonce":3725440007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7738,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2908220643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2908220643},{"type":"v1","addr":"172.21.15.188:6837","nonce":2908220643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":9003,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2302544827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2302544827},{"type":"v1","addr":"172.21.15.123:6834","nonce":2302544827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:20:28.532639+0000","modified":"2024-09-15T23:20:30.630141+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9006":{"gid":9006,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/627322542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":627322542},{"type":"v1","addr":"172.21.15.123:6835","nonce":627322542}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9006,"qdb_cluster":[9006]},"id":10}]} 2024-09-15T23:20:59.382 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 93 2024-09-15T23:20:59.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.381+0000 7f9ef0b8d640 1 -- 172.21.15.123:0/739465993 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9ecc06c2b0 msgr2=0x7f9ecc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:59.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.381+0000 7f9ef0b8d640 1 --2- 172.21.15.123:0/739465993 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9ecc06c2b0 0x7f9ecc06e770 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f9eec160c40 tx=0x7f9ed4009040 comp rx=0 tx=0).stop 2024-09-15T23:20:59.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.381+0000 7f9ef0b8d640 1 -- 172.21.15.123:0/739465993 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9eec0b90e0 msgr2=0x7f9eec155940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:59.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.381+0000 7f9ef0b8d640 1 --2- 172.21.15.123:0/739465993 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9eec0b90e0 0x7f9eec155940 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f9edc00d800 tx=0x7f9edc00dcc0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.381+0000 7f9ef0b8d640 1 -- 172.21.15.123:0/739465993 shutdown_connections 2024-09-15T23:20:59.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.381+0000 7f9ef0b8d640 1 --2- 172.21.15.123:0/739465993 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9eec15ed20 0x7f9eec1e9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.381+0000 7f9ef0b8d640 1 --2- 172.21.15.123:0/739465993 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9eec0d23b0 0x7f9eec0ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.381+0000 7f9ef0b8d640 1 --2- 172.21.15.123:0/739465993 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9ecc06c2b0 0x7f9ecc06e770 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.381+0000 7f9ef0b8d640 1 --2- 172.21.15.123:0/739465993 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9eec0b90e0 0x7f9eec155940 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.381+0000 7f9ef0b8d640 1 -- 172.21.15.123:0/739465993 >> 172.21.15.123:0/739465993 conn(0x7f9eec0d1260 msgr2=0x7f9eec0d1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:59.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.381+0000 7f9ef0b8d640 1 -- 172.21.15.123:0/739465993 shutdown_connections 2024-09-15T23:20:59.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.381+0000 7f9ef0b8d640 1 -- 172.21.15.123:0/739465993 wait complete. 2024-09-15T23:20:59.394 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-15T23:20:59.394 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:20:59.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.488+0000 7f3bcc5c6640 1 Processor -- start 2024-09-15T23:20:59.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.488+0000 7f3bcc5c6640 1 -- start start 2024-09-15T23:20:59.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.489+0000 7f3bcc5c6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3bc406c320 0x7f3bc415bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:59.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.489+0000 7f3bcc5c6640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bc4071180 con 0x7f3bc413eb20 2024-09-15T23:20:59.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.489+0000 7f3bcc5c6640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bc4071460 con 0x7f3bc40b2d40 2024-09-15T23:20:59.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.489+0000 7f3bcc5c6640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f3bc4071ab0 con 0x7f3bc406c320 2024-09-15T23:20:59.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.489+0000 7f3bc9b61640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3bc406c320 0x7f3bc415bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:59.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.489+0000 7f3bcab63640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f3bc413eb20 0x7f3bc415c230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60102/0 (socket says 172.21.15.123:60102) 2024-09-15T23:20:59.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.489+0000 7f3bcab63640 1 -- 172.21.15.123:0/231678062 learned_addr learned my addr 172.21.15.123:0/231678062 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:20:59.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.489+0000 7f3bc9b61640 1 -- 172.21.15.123:0/231678062 >> v1:172.21.15.188:6789/0 conn(0x7f3bc40b2d40 legacy=0x7f3bc406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:59.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.489+0000 7f3bc9b61640 1 -- 172.21.15.123:0/231678062 >> v1:172.21.15.123:6789/0 conn(0x7f3bc413eb20 legacy=0x7f3bc415c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:59.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.489+0000 7f3bc9b61640 1 -- 172.21.15.123:0/231678062 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bc4071740 con 0x7f3bc406c320 2024-09-15T23:20:59.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.490+0000 7f3bc9b61640 1 --2- 172.21.15.123:0/231678062 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bc406c320 0x7f3bc415bcf0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f3bb40097a0 tx=0x7f3bb402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91927be889c22b92 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:59.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.490+0000 7f3bc9360640 1 -- 172.21.15.123:0/231678062 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4037070 con 0x7f3bc406c320 2024-09-15T23:20:59.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.490+0000 7f3bc9360640 1 -- 172.21.15.123:0/231678062 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bb4032440 con 0x7f3bc406c320 2024-09-15T23:20:59.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.490+0000 7f3bc9360640 1 -- 172.21.15.123:0/231678062 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4032810 con 0x7f3bc406c320 2024-09-15T23:20:59.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.491+0000 7f3bcc5c6640 1 -- 172.21.15.123:0/231678062 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bc406c320 msgr2=0x7f3bc415bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:59.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.491+0000 7f3bcc5c6640 1 --2- 172.21.15.123:0/231678062 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bc406c320 0x7f3bc415bcf0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f3bb40097a0 tx=0x7f3bb402a230 comp rx=0 tx=0).stop 2024-09-15T23:20:59.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.491+0000 7f3bcc5c6640 1 -- 172.21.15.123:0/231678062 shutdown_connections 2024-09-15T23:20:59.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.491+0000 7f3bcc5c6640 1 --2- 172.21.15.123:0/231678062 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bc406c320 0x7f3bc415bcf0 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.491+0000 7f3bcc5c6640 1 -- 172.21.15.123:0/231678062 >> 172.21.15.123:0/231678062 conn(0x7f3bc40ccec0 msgr2=0x7f3bc40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:59.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.491+0000 7f3bcc5c6640 1 -- 172.21.15.123:0/231678062 shutdown_connections 2024-09-15T23:20:59.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.491+0000 7f3bcc5c6640 1 -- 172.21.15.123:0/231678062 wait complete. 2024-09-15T23:20:59.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.492+0000 7f3bcc5c6640 1 Processor -- start 2024-09-15T23:20:59.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.492+0000 7f3bcc5c6640 1 -- start start 2024-09-15T23:20:59.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.493+0000 7f3bcc5c6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3bc406c320 0x7f3bc4144900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:59.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.493+0000 7f3bcc5c6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3bc40b2d40 0x7f3bc41538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:59.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.493+0000 7f3bcc5c6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bc413eb20 0x7f3bc4154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:59.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.493+0000 7f3bcc5c6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc41666e0 con 0x7f3bc413eb20 2024-09-15T23:20:59.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.493+0000 7f3bcc5c6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc4166560 con 0x7f3bc406c320 2024-09-15T23:20:59.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.493+0000 7f3bcc5c6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f3bc4166860 con 0x7f3bc40b2d40 2024-09-15T23:20:59.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.493+0000 7f3bcab63640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bc413eb20 0x7f3bc4154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:59.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.493+0000 7f3bcab63640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bc413eb20 0x7f3bc4154950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42714/0 (socket says 172.21.15.123:42714) 2024-09-15T23:20:59.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.493+0000 7f3bcab63640 1 -- 172.21.15.123:0/4090965535 learned_addr learned my addr 172.21.15.123:0/4090965535 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:20:59.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.493+0000 7f3bca362640 1 --2- 172.21.15.123:0/4090965535 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3bc406c320 0x7f3bc4144900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:59.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.493+0000 7f3bc9b61640 1 --2- 172.21.15.123:0/4090965535 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3bc40b2d40 0x7f3bc41538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:59.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.493+0000 7f3bcab63640 1 -- 172.21.15.123:0/4090965535 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3bc40b2d40 msgr2=0x7f3bc41538b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:59.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.493+0000 7f3bcab63640 1 --2- 172.21.15.123:0/4090965535 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3bc40b2d40 0x7f3bc41538b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.493+0000 7f3bcab63640 1 -- 172.21.15.123:0/4090965535 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3bc406c320 msgr2=0x7f3bc4144900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:59.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.493+0000 7f3bcab63640 1 --2- 172.21.15.123:0/4090965535 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3bc406c320 0x7f3bc4144900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.493+0000 7f3bcab63640 1 -- 172.21.15.123:0/4090965535 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bc41550c0 con 0x7f3bc413eb20 2024-09-15T23:20:59.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.493+0000 7f3bcab63640 1 --2- 172.21.15.123:0/4090965535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bc413eb20 0x7f3bc4154950 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc00ca80 tx=0x7f3bbc00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:59.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.493+0000 7f3bbaffd640 1 -- 172.21.15.123:0/4090965535 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc017070 con 0x7f3bc413eb20 2024-09-15T23:20:59.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.493+0000 7f3bbaffd640 1 -- 172.21.15.123:0/4090965535 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bbc00ac30 con 0x7f3bc413eb20 2024-09-15T23:20:59.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.493+0000 7f3bbaffd640 1 -- 172.21.15.123:0/4090965535 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc012600 con 0x7f3bc413eb20 2024-09-15T23:20:59.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.493+0000 7f3bcc5c6640 1 -- 172.21.15.123:0/4090965535 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bc4141d80 con 0x7f3bc413eb20 2024-09-15T23:20:59.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.494+0000 7f3bcc5c6640 1 -- 172.21.15.123:0/4090965535 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bc4142860 con 0x7f3bc413eb20 2024-09-15T23:20:59.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.494+0000 7f3bcc5c6640 1 -- 172.21.15.123:0/4090965535 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bc406bc10 con 0x7f3bc413eb20 2024-09-15T23:20:59.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.495+0000 7f3bbaffd640 1 -- 172.21.15.123:0/4090965535 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3bbc01a070 con 0x7f3bc413eb20 2024-09-15T23:20:59.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.495+0000 7f3bbaffd640 1 --2- 172.21.15.123:0/4090965535 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3ba806c2e0 0x7f3ba806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:20:59.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.496+0000 7f3bbaffd640 1 -- 172.21.15.123:0/4090965535 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5767+0+0 (secure 0 0 0) 0x7f3bbc08afe0 con 0x7f3bc413eb20 2024-09-15T23:20:59.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.496+0000 7f3bca362640 1 --2- 172.21.15.123:0/4090965535 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3ba806c2e0 0x7f3ba806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:20:59.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.496+0000 7f3bca362640 1 --2- 172.21.15.123:0/4090965535 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3ba806c2e0 0x7f3ba806e7a0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0000f60 tx=0x7f3bc0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:20:59.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.500+0000 7f3bbaffd640 1 -- 172.21.15.123:0/4090965535 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3bbc00ae20 con 0x7f3bc413eb20 2024-09-15T23:20:59.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.728+0000 7f3bcc5c6640 1 -- 172.21.15.123:0/4090965535 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f3bc4072d10 con 0x7f3bc413eb20 2024-09-15T23:20:59.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.729+0000 7f3bbaffd640 1 -- 172.21.15.123:0/4090965535 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1675 (secure 0 0 0) 0x7f3bbc059150 con 0x7f3bc413eb20 2024-09-15T23:20:59.731 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:20:59.731 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":550,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":156,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076566731,"bytes_used":2556182528,"bytes_avail":770537930752,"bytes_total":773094113280,"write_bytes_sec":28572201,"read_op_per_sec":0,"write_op_per_sec":28},"fsmap":{"epoch":93,"btime":"2024-09-15T23:20:31:301251+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":9006}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":25,"modified":"2024-09-15T23:20:55.627988+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T23:20:59.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.731+0000 7f3bcc5c6640 1 -- 172.21.15.123:0/4090965535 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3ba806c2e0 msgr2=0x7f3ba806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:59.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.731+0000 7f3bcc5c6640 1 --2- 172.21.15.123:0/4090965535 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3ba806c2e0 0x7f3ba806e7a0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0000f60 tx=0x7f3bc0009040 comp rx=0 tx=0).stop 2024-09-15T23:20:59.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.731+0000 7f3bcc5c6640 1 -- 172.21.15.123:0/4090965535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bc413eb20 msgr2=0x7f3bc4154950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:20:59.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.731+0000 7f3bcc5c6640 1 --2- 172.21.15.123:0/4090965535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bc413eb20 0x7f3bc4154950 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc00ca80 tx=0x7f3bbc00cf40 comp rx=0 tx=0).stop 2024-09-15T23:20:59.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.731+0000 7f3bcc5c6640 1 -- 172.21.15.123:0/4090965535 shutdown_connections 2024-09-15T23:20:59.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.731+0000 7f3bcc5c6640 1 --2- 172.21.15.123:0/4090965535 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3ba806c2e0 0x7f3ba806e7a0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.731+0000 7f3bcc5c6640 1 --2- 172.21.15.123:0/4090965535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bc413eb20 0x7f3bc4154950 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.731+0000 7f3bcc5c6640 1 --2- 172.21.15.123:0/4090965535 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3bc40b2d40 0x7f3bc41538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.731+0000 7f3bcc5c6640 1 --2- 172.21.15.123:0/4090965535 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3bc406c320 0x7f3bc4144900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:20:59.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.731+0000 7f3bcc5c6640 1 -- 172.21.15.123:0/4090965535 >> 172.21.15.123:0/4090965535 conn(0x7f3bc40ccec0 msgr2=0x7f3bc413ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:20:59.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.731+0000 7f3bcc5c6640 1 -- 172.21.15.123:0/4090965535 shutdown_connections 2024-09-15T23:20:59.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:20:59.731+0000 7f3bcc5c6640 1 -- 172.21.15.123:0/4090965535 wait complete. 2024-09-15T23:20:59.743 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'paused paths [/scrub_control_test_path]'} 2024-09-15T23:21:00.744 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:21:00.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.847+0000 7f1c70442640 1 Processor -- start 2024-09-15T23:21:00.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.847+0000 7f1c70442640 1 -- start start 2024-09-15T23:21:00.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.848+0000 7f1c70442640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1c6815ab40 0x7f1c6806c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:00.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.848+0000 7f1c70442640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1c680720b0 0x7f1c68073990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:00.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.848+0000 7f1c70442640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c68072520 con 0x7f1c6815af20 2024-09-15T23:21:00.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.848+0000 7f1c70442640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f1c68071010 con 0x7f1c680720b0 2024-09-15T23:21:00.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.848+0000 7f1c70442640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f1c680712f0 con 0x7f1c6815ab40 2024-09-15T23:21:00.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.848+0000 7f1c6d9dd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1c680720b0 0x7f1c68073990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:00.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.848+0000 7f1c6d9dd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1c680720b0 0x7f1c68073990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42726/0 (socket says 172.21.15.123:42726) 2024-09-15T23:21:00.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.848+0000 7f1c6d9dd640 1 -- 172.21.15.123:0/2351878859 learned_addr learned my addr 172.21.15.123:0/2351878859 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:00.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.848+0000 7f1c6e1de640 1 --2- 172.21.15.123:0/2351878859 >> v2:172.21.15.188:3300/0 conn(0x7f1c6815ab40 0x7f1c6806c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:00.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.848+0000 7f1c6d9dd640 1 -- 172.21.15.123:0/2351878859 >> v2:172.21.15.188:3300/0 conn(0x7f1c6815ab40 msgr2=0x7f1c6806c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:00.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.848+0000 7f1c6d9dd640 1 --2- 172.21.15.123:0/2351878859 >> v2:172.21.15.188:3300/0 conn(0x7f1c6815ab40 0x7f1c6806c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:00.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.848+0000 7f1c6d9dd640 1 -- 172.21.15.123:0/2351878859 >> v1:172.21.15.188:6789/0 conn(0x7f1c6815af20 legacy=0x7f1c6815b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:00.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.848+0000 7f1c6d9dd640 1 -- 172.21.15.123:0/2351878859 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c680715d0 con 0x7f1c680720b0 2024-09-15T23:21:00.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.849+0000 7f1c6d9dd640 1 --2- 172.21.15.123:0/2351878859 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c680720b0 0x7f1c68073990 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f1c680d1500 tx=0x7f1c5802c690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2642dfb247cd69ff server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:00.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.849+0000 7f1c6d1dc640 1 -- 172.21.15.123:0/2351878859 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c5803a070 con 0x7f1c680720b0 2024-09-15T23:21:00.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.849+0000 7f1c6d1dc640 1 -- 172.21.15.123:0/2351878859 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c58032480 con 0x7f1c680720b0 2024-09-15T23:21:00.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.849+0000 7f1c6d1dc640 1 -- 172.21.15.123:0/2351878859 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c58032850 con 0x7f1c680720b0 2024-09-15T23:21:00.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.850+0000 7f1c70442640 1 -- 172.21.15.123:0/2351878859 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c680720b0 msgr2=0x7f1c68073990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:00.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.850+0000 7f1c70442640 1 --2- 172.21.15.123:0/2351878859 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c680720b0 0x7f1c68073990 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f1c680d1500 tx=0x7f1c5802c690 comp rx=0 tx=0).stop 2024-09-15T23:21:00.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.850+0000 7f1c70442640 1 -- 172.21.15.123:0/2351878859 shutdown_connections 2024-09-15T23:21:00.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.850+0000 7f1c70442640 1 --2- 172.21.15.123:0/2351878859 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c680720b0 0x7f1c68073990 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:00.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.850+0000 7f1c70442640 1 --2- 172.21.15.123:0/2351878859 >> v2:172.21.15.188:3300/0 conn(0x7f1c6815ab40 0x7f1c6806c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:00.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.850+0000 7f1c70442640 1 -- 172.21.15.123:0/2351878859 >> 172.21.15.123:0/2351878859 conn(0x7f1c680ccec0 msgr2=0x7f1c680cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:00.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.850+0000 7f1c70442640 1 -- 172.21.15.123:0/2351878859 shutdown_connections 2024-09-15T23:21:00.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.850+0000 7f1c70442640 1 -- 172.21.15.123:0/2351878859 wait complete. 2024-09-15T23:21:00.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.851+0000 7f1c70442640 1 Processor -- start 2024-09-15T23:21:00.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.851+0000 7f1c70442640 1 -- start start 2024-09-15T23:21:00.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.852+0000 7f1c70442640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c680720b0 0x7f1c68153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:00.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.852+0000 7f1c70442640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1c6815ab40 0x7f1c680c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:00.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.852+0000 7f1c70442640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1c6815af20 0x7f1c680c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:00.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.852+0000 7f1c70442640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1c68073ed0 con 0x7f1c680720b0 2024-09-15T23:21:00.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.852+0000 7f1c70442640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6815ba80 con 0x7f1c6815ab40 2024-09-15T23:21:00.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.852+0000 7f1c70442640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1c6806bc10 con 0x7f1c6815af20 2024-09-15T23:21:00.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.852+0000 7f1c6e1de640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c680720b0 0x7f1c68153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:00.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.852+0000 7f1c6e1de640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c680720b0 0x7f1c68153fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42736/0 (socket says 172.21.15.123:42736) 2024-09-15T23:21:00.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.852+0000 7f1c6e1de640 1 -- 172.21.15.123:0/1089142460 learned_addr learned my addr 172.21.15.123:0/1089142460 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:00.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.852+0000 7f1c6d9dd640 1 --2- 172.21.15.123:0/1089142460 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1c6815ab40 0x7f1c680c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:00.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.852+0000 7f1c6e9df640 1 --2- 172.21.15.123:0/1089142460 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1c6815af20 0x7f1c680c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:00.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.852+0000 7f1c6e1de640 1 -- 172.21.15.123:0/1089142460 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1c6815af20 msgr2=0x7f1c680c8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:00.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.852+0000 7f1c6e1de640 1 --2- 172.21.15.123:0/1089142460 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1c6815af20 0x7f1c680c8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:00.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.852+0000 7f1c6e1de640 1 -- 172.21.15.123:0/1089142460 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1c6815ab40 msgr2=0x7f1c680c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:00.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.852+0000 7f1c6e1de640 1 --2- 172.21.15.123:0/1089142460 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1c6815ab40 0x7f1c680c7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:00.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.852+0000 7f1c6e1de640 1 -- 172.21.15.123:0/1089142460 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c681f00b0 con 0x7f1c680720b0 2024-09-15T23:21:00.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.852+0000 7f1c6d9dd640 1 --2- 172.21.15.123:0/1089142460 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1c6815ab40 0x7f1c680c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:21:00.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.853+0000 7f1c6e1de640 1 --2- 172.21.15.123:0/1089142460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c680720b0 0x7f1c68153fd0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f1c6400d800 tx=0x7f1c6400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:00.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.853+0000 7f1c5effd640 1 -- 172.21.15.123:0/1089142460 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c6400b6c0 con 0x7f1c680720b0 2024-09-15T23:21:00.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.853+0000 7f1c5effd640 1 -- 172.21.15.123:0/1089142460 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c64019070 con 0x7f1c680720b0 2024-09-15T23:21:00.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.853+0000 7f1c5effd640 1 -- 172.21.15.123:0/1089142460 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c6400bac0 con 0x7f1c680720b0 2024-09-15T23:21:00.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.853+0000 7f1c70442640 1 -- 172.21.15.123:0/1089142460 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c680c86b0 con 0x7f1c680720b0 2024-09-15T23:21:00.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.853+0000 7f1c70442640 1 -- 172.21.15.123:0/1089142460 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c680c8c70 con 0x7f1c680720b0 2024-09-15T23:21:00.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.854+0000 7f1c70442640 1 -- 172.21.15.123:0/1089142460 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c68073ba0 con 0x7f1c680720b0 2024-09-15T23:21:00.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.854+0000 7f1c5effd640 1 -- 172.21.15.123:0/1089142460 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1c6400bc60 con 0x7f1c680720b0 2024-09-15T23:21:00.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.855+0000 7f1c5effd640 1 --2- 172.21.15.123:0/1089142460 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1c4c06c2b0 0x7f1c4c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:00.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.855+0000 7f1c5effd640 1 -- 172.21.15.123:0/1089142460 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5767+0+0 (secure 0 0 0) 0x7f1c6408b8d0 con 0x7f1c680720b0 2024-09-15T23:21:00.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.855+0000 7f1c6d9dd640 1 --2- 172.21.15.123:0/1089142460 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1c4c06c2b0 0x7f1c4c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:00.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.855+0000 7f1c6d9dd640 1 --2- 172.21.15.123:0/1089142460 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1c4c06c2b0 0x7f1c4c06e770 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f1c58037000 tx=0x7f1c58030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:00.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:00.859+0000 7f1c5effd640 1 -- 172.21.15.123:0/1089142460 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1c6405a090 con 0x7f1c680720b0 2024-09-15T23:21:01.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.060+0000 7f1c70442640 1 -- 172.21.15.123:0/1089142460 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c68154510 con 0x7f1c680720b0 2024-09-15T23:21:01.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.060+0000 7f1c5effd640 1 -- 172.21.15.123:0/1089142460 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5236 (secure 0 0 0) 0x7f1c64059990 con 0x7f1c680720b0 2024-09-15T23:21:01.062 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:01.062 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":93,"btime":"2024-09-15T23:20:31:301251+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7735,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/3725440007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3725440007},{"type":"v1","addr":"172.21.15.188:6836","nonce":3725440007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7738,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2908220643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2908220643},{"type":"v1","addr":"172.21.15.188:6837","nonce":2908220643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":9003,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2302544827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2302544827},{"type":"v1","addr":"172.21.15.123:6834","nonce":2302544827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:20:28.532639+0000","modified":"2024-09-15T23:20:30.630141+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9006":{"gid":9006,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/627322542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":627322542},{"type":"v1","addr":"172.21.15.123:6835","nonce":627322542}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9006,"qdb_cluster":[9006]},"id":10}]} 2024-09-15T23:21:01.062 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 93 2024-09-15T23:21:01.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.062+0000 7f1c70442640 1 -- 172.21.15.123:0/1089142460 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1c4c06c2b0 msgr2=0x7f1c4c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:01.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.062+0000 7f1c70442640 1 --2- 172.21.15.123:0/1089142460 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1c4c06c2b0 0x7f1c4c06e770 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f1c58037000 tx=0x7f1c58030000 comp rx=0 tx=0).stop 2024-09-15T23:21:01.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.062+0000 7f1c70442640 1 -- 172.21.15.123:0/1089142460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c680720b0 msgr2=0x7f1c68153fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:01.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.062+0000 7f1c70442640 1 --2- 172.21.15.123:0/1089142460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c680720b0 0x7f1c68153fd0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f1c6400d800 tx=0x7f1c6400dcc0 comp rx=0 tx=0).stop 2024-09-15T23:21:01.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.063+0000 7f1c70442640 1 -- 172.21.15.123:0/1089142460 shutdown_connections 2024-09-15T23:21:01.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.063+0000 7f1c70442640 1 --2- 172.21.15.123:0/1089142460 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1c6815af20 0x7f1c680c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:01.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.063+0000 7f1c70442640 1 --2- 172.21.15.123:0/1089142460 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1c6815ab40 0x7f1c680c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:01.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.063+0000 7f1c70442640 1 --2- 172.21.15.123:0/1089142460 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1c4c06c2b0 0x7f1c4c06e770 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:01.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.063+0000 7f1c70442640 1 --2- 172.21.15.123:0/1089142460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c680720b0 0x7f1c68153fd0 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:01.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.063+0000 7f1c70442640 1 -- 172.21.15.123:0/1089142460 >> 172.21.15.123:0/1089142460 conn(0x7f1c680ccec0 msgr2=0x7f1c68158b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:01.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.063+0000 7f1c70442640 1 -- 172.21.15.123:0/1089142460 shutdown_connections 2024-09-15T23:21:01.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.063+0000 7f1c70442640 1 -- 172.21.15.123:0/1089142460 wait complete. 2024-09-15T23:21:01.074 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-15T23:21:01.074 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:21:01.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.170+0000 7f737939a640 1 Processor -- start 2024-09-15T23:21:01.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.170+0000 7f737939a640 1 -- start start 2024-09-15T23:21:01.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.171+0000 7f737939a640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f737415ab40 0x7f737406c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:01.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.171+0000 7f737939a640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7374072520 con 0x7f73740720b0 2024-09-15T23:21:01.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.171+0000 7f737939a640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7374071010 con 0x7f737415af20 2024-09-15T23:21:01.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.171+0000 7f737939a640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f73740712f0 con 0x7f737415ab40 2024-09-15T23:21:01.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.171+0000 7f736a7fc640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f73740720b0 0x7f7374073990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60112/0 (socket says 172.21.15.123:60112) 2024-09-15T23:21:01.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.171+0000 7f736a7fc640 1 -- 172.21.15.123:0/1130516067 learned_addr learned my addr 172.21.15.123:0/1130516067 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:21:01.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.171+0000 7f7372ffd640 1 --2- 172.21.15.123:0/1130516067 >> v2:172.21.15.188:3300/0 conn(0x7f737415ab40 0x7f737406c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:01.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.171+0000 7f73727fc640 1 -- 172.21.15.123:0/1130516067 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 624268603 0 0) 0x7f7374072520 con 0x7f73740720b0 2024-09-15T23:21:01.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.171+0000 7f73727fc640 1 -- 172.21.15.123:0/1130516067 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7360003520 con 0x7f73740720b0 2024-09-15T23:21:01.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.172+0000 7f73727fc640 1 -- 172.21.15.123:0/1130516067 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 507980317 0 0) 0x7f7374071010 con 0x7f737415af20 2024-09-15T23:21:01.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.172+0000 7f73727fc640 1 -- 172.21.15.123:0/1130516067 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7374072520 con 0x7f737415af20 2024-09-15T23:21:01.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.172+0000 7f73727fc640 1 -- 172.21.15.123:0/1130516067 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1082084093 0 0) 0x7f7360003520 con 0x7f73740720b0 2024-09-15T23:21:01.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.172+0000 7f73727fc640 1 -- 172.21.15.123:0/1130516067 >> v2:172.21.15.188:3300/0 conn(0x7f737415ab40 msgr2=0x7f737406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:01.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.172+0000 7f73727fc640 1 --2- 172.21.15.123:0/1130516067 >> v2:172.21.15.188:3300/0 conn(0x7f737415ab40 0x7f737406c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:01.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.172+0000 7f73727fc640 1 -- 172.21.15.123:0/1130516067 >> v1:172.21.15.188:6789/0 conn(0x7f737415af20 legacy=0x7f737415b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:01.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.172+0000 7f73727fc640 1 -- 172.21.15.123:0/1130516067 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73740715d0 con 0x7f73740720b0 2024-09-15T23:21:01.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.172+0000 7f73727fc640 1 -- 172.21.15.123:0/1130516067 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f735c001670 con 0x7f73740720b0 2024-09-15T23:21:01.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.172+0000 7f73727fc640 1 -- 172.21.15.123:0/1130516067 >> v1:172.21.15.123:6789/0 conn(0x7f73740720b0 legacy=0x7f7374073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:01.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.172+0000 7f73727fc640 1 --2- 172.21.15.123:0/1130516067 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7360003b40 0x7f7360003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:01.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.172+0000 7f73727fc640 1 --2- 172.21.15.123:0/1130516067 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7360004800 0x7f7360004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:01.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.172+0000 7f73727fc640 1 --2- 172.21.15.123:0/1130516067 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f73600051c0 0x7f736000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:01.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.172+0000 7f73727fc640 1 -- 172.21.15.123:0/1130516067 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f73740712f0 con 0x7f7360003b40 2024-09-15T23:21:01.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.172+0000 7f73727fc640 1 -- 172.21.15.123:0/1130516067 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f736000c0f0 con 0x7f7360004800 2024-09-15T23:21:01.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.172+0000 7f73727fc640 1 -- 172.21.15.123:0/1130516067 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f736000c2f0 con 0x7f73600051c0 2024-09-15T23:21:01.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.172+0000 7f7372ffd640 1 --2- 172.21.15.123:0/1130516067 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7360003b40 0x7f7360003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:01.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.172+0000 7f736a7fc640 1 --2- 172.21.15.123:0/1130516067 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7360004800 0x7f7360004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:01.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.172+0000 7f73737fe640 1 --2- 172.21.15.123:0/1130516067 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f73600051c0 0x7f736000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:01.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.172+0000 7f7372ffd640 1 -- 172.21.15.123:0/1130516067 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f73600051c0 msgr2=0x7f736000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:01.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.172+0000 7f7372ffd640 1 --2- 172.21.15.123:0/1130516067 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f73600051c0 0x7f736000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:01.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.172+0000 7f7372ffd640 1 -- 172.21.15.123:0/1130516067 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7360004800 msgr2=0x7f7360004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:01.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.172+0000 7f7372ffd640 1 --2- 172.21.15.123:0/1130516067 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7360004800 0x7f7360004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:01.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.172+0000 7f7372ffd640 1 -- 172.21.15.123:0/1130516067 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7360003520 con 0x7f7360003b40 2024-09-15T23:21:01.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.172+0000 7f73737fe640 1 -- 172.21.15.123:0/1130516067 reap_dead start 2024-09-15T23:21:01.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.173+0000 7f7372ffd640 1 --2- 172.21.15.123:0/1130516067 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7360003b40 0x7f7360003f40 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f7364009ac0 tx=0x7f7360005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b2781a45101345 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:01.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.173+0000 7f73727fc640 1 -- 172.21.15.123:0/1130516067 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7364036070 con 0x7f7360003b40 2024-09-15T23:21:01.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.173+0000 7f73727fc640 1 -- 172.21.15.123:0/1130516067 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7364031400 con 0x7f7360003b40 2024-09-15T23:21:01.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.173+0000 7f73727fc640 1 -- 172.21.15.123:0/1130516067 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7364009690 con 0x7f7360003b40 2024-09-15T23:21:01.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.173+0000 7f737939a640 1 -- 172.21.15.123:0/1130516067 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7360003b40 msgr2=0x7f7360003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:01.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.173+0000 7f737939a640 1 --2- 172.21.15.123:0/1130516067 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7360003b40 0x7f7360003f40 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f7364009ac0 tx=0x7f7360005830 comp rx=0 tx=0).stop 2024-09-15T23:21:01.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.173+0000 7f737939a640 1 -- 172.21.15.123:0/1130516067 shutdown_connections 2024-09-15T23:21:01.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.173+0000 7f737939a640 1 --2- 172.21.15.123:0/1130516067 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7360003b40 0x7f7360003f40 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:01.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.173+0000 7f737939a640 1 -- 172.21.15.123:0/1130516067 >> 172.21.15.123:0/1130516067 conn(0x7f73740ccec0 msgr2=0x7f73740cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:01.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.173+0000 7f737939a640 1 -- 172.21.15.123:0/1130516067 shutdown_connections 2024-09-15T23:21:01.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.173+0000 7f737939a640 1 -- 172.21.15.123:0/1130516067 wait complete. 2024-09-15T23:21:01.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.175+0000 7f737939a640 1 Processor -- start 2024-09-15T23:21:01.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.175+0000 7f737939a640 1 -- start start 2024-09-15T23:21:01.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.175+0000 7f737939a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7360003b40 0x7f7374154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:01.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.175+0000 7f737939a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7374154d70 0x7f73741551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:01.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.175+0000 7f737939a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7374155730 0x7f73741563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:01.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.175+0000 7f737939a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f737406c820 con 0x7f7360003b40 2024-09-15T23:21:01.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.175+0000 7f737939a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f737406c6a0 con 0x7f7374154d70 2024-09-15T23:21:01.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.175+0000 7f737939a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f737406c9a0 con 0x7f7374155730 2024-09-15T23:21:01.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.175+0000 7f7372ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7360003b40 0x7f7374154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:01.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.176+0000 7f7372ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7360003b40 0x7f7374154170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42748/0 (socket says 172.21.15.123:42748) 2024-09-15T23:21:01.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.176+0000 7f7372ffd640 1 -- 172.21.15.123:0/2784408940 learned_addr learned my addr 172.21.15.123:0/2784408940 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:01.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.176+0000 7f73737fe640 1 --2- 172.21.15.123:0/2784408940 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7374155730 0x7f73741563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:01.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.176+0000 7f736a7fc640 1 --2- 172.21.15.123:0/2784408940 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7374154d70 0x7f73741551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:01.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.176+0000 7f7372ffd640 1 -- 172.21.15.123:0/2784408940 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7374155730 msgr2=0x7f73741563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:01.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.176+0000 7f7372ffd640 1 --2- 172.21.15.123:0/2784408940 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7374155730 0x7f73741563d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:01.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.176+0000 7f7372ffd640 1 -- 172.21.15.123:0/2784408940 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7374154d70 msgr2=0x7f73741551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:01.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.176+0000 7f7372ffd640 1 --2- 172.21.15.123:0/2784408940 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7374154d70 0x7f73741551f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:01.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.176+0000 7f7372ffd640 1 -- 172.21.15.123:0/2784408940 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73741597c0 con 0x7f7360003b40 2024-09-15T23:21:01.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.176+0000 7f7372ffd640 1 --2- 172.21.15.123:0/2784408940 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7360003b40 0x7f7374154170 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f7364034040 tx=0x7f7364004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:01.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.176+0000 7f736bfff640 1 -- 172.21.15.123:0/2784408940 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7364003a40 con 0x7f7360003b40 2024-09-15T23:21:01.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.176+0000 7f736bfff640 1 -- 172.21.15.123:0/2784408940 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7364003be0 con 0x7f7360003b40 2024-09-15T23:21:01.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.176+0000 7f737939a640 1 -- 172.21.15.123:0/2784408940 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7374159a60 con 0x7f7360003b40 2024-09-15T23:21:01.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.176+0000 7f736bfff640 1 -- 172.21.15.123:0/2784408940 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73640315b0 con 0x7f7360003b40 2024-09-15T23:21:01.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.176+0000 7f737939a640 1 -- 172.21.15.123:0/2784408940 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f737415a020 con 0x7f7360003b40 2024-09-15T23:21:01.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.177+0000 7f737939a640 1 -- 172.21.15.123:0/2784408940 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7374073990 con 0x7f7360003b40 2024-09-15T23:21:01.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.178+0000 7f736bfff640 1 -- 172.21.15.123:0/2784408940 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7364031750 con 0x7f7360003b40 2024-09-15T23:21:01.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.178+0000 7f736bfff640 1 --2- 172.21.15.123:0/2784408940 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f735406c2b0 0x7f735406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:01.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.178+0000 7f736bfff640 1 -- 172.21.15.123:0/2784408940 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5767+0+0 (secure 0 0 0) 0x7f73640adb30 con 0x7f7360003b40 2024-09-15T23:21:01.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.178+0000 7f736a7fc640 1 --2- 172.21.15.123:0/2784408940 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f735406c2b0 0x7f735406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:01.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.179+0000 7f736a7fc640 1 --2- 172.21.15.123:0/2784408940 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f735406c2b0 0x7f735406e770 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f7374152d90 tx=0x7f735c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:01.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.182+0000 7f736bfff640 1 -- 172.21.15.123:0/2784408940 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f736407c2f0 con 0x7f7360003b40 2024-09-15T23:21:01.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.414+0000 7f737939a640 1 -- 172.21.15.123:0/2784408940 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f73740cfc90 con 0x7f7360003b40 2024-09-15T23:21:01.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.414+0000 7f736bfff640 1 -- 172.21.15.123:0/2784408940 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1673 (secure 0 0 0) 0x7f736407bbf0 con 0x7f7360003b40 2024-09-15T23:21:01.416 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:01.416 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":551,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":156,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076566731,"bytes_used":2520653824,"bytes_avail":770573459456,"bytes_total":773094113280,"write_bytes_sec":7338960,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":93,"btime":"2024-09-15T23:20:31:301251+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":9006}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":25,"modified":"2024-09-15T23:20:55.627988+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T23:21:01.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.416+0000 7f737939a640 1 -- 172.21.15.123:0/2784408940 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f735406c2b0 msgr2=0x7f735406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:01.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.416+0000 7f737939a640 1 --2- 172.21.15.123:0/2784408940 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f735406c2b0 0x7f735406e770 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f7374152d90 tx=0x7f735c009040 comp rx=0 tx=0).stop 2024-09-15T23:21:01.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.416+0000 7f737939a640 1 -- 172.21.15.123:0/2784408940 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7360003b40 msgr2=0x7f7374154170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:01.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.416+0000 7f737939a640 1 --2- 172.21.15.123:0/2784408940 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7360003b40 0x7f7374154170 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f7364034040 tx=0x7f7364004730 comp rx=0 tx=0).stop 2024-09-15T23:21:01.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.416+0000 7f737939a640 1 -- 172.21.15.123:0/2784408940 shutdown_connections 2024-09-15T23:21:01.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.416+0000 7f737939a640 1 --2- 172.21.15.123:0/2784408940 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7374155730 0x7f73741563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:01.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.416+0000 7f737939a640 1 --2- 172.21.15.123:0/2784408940 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7374154d70 0x7f73741551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:01.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.416+0000 7f737939a640 1 --2- 172.21.15.123:0/2784408940 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f735406c2b0 0x7f735406e770 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:01.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.416+0000 7f737939a640 1 --2- 172.21.15.123:0/2784408940 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7360003b40 0x7f7374154170 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:01.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.416+0000 7f737939a640 1 -- 172.21.15.123:0/2784408940 >> 172.21.15.123:0/2784408940 conn(0x7f73740ccec0 msgr2=0x7f737406bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:01.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.416+0000 7f737939a640 1 -- 172.21.15.123:0/2784408940 shutdown_connections 2024-09-15T23:21:01.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:01.416+0000 7f737939a640 1 -- 172.21.15.123:0/2784408940 wait complete. 2024-09-15T23:21:01.428 INFO:tasks.ceph.ceph_manager.ceph:{'c': 'paused paths [/scrub_control_test_path]'} 2024-09-15T23:21:02.429 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:21:02.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.542+0000 7fb78e5c4640 1 Processor -- start 2024-09-15T23:21:02.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.542+0000 7fb78e5c4640 1 -- start start 2024-09-15T23:21:02.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.543+0000 7fb78e5c4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb78815e6d0 0x7fb788071390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:02.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.543+0000 7fb78e5c4640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb788070b80 0x7fb7881622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:02.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.543+0000 7fb78e5c4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb78815eab0 con 0x7fb78806cd20 2024-09-15T23:21:02.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.543+0000 7fb78e5c4640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fb78815ed70 con 0x7fb78815e6d0 2024-09-15T23:21:02.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.543+0000 7fb78e5c4640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fb78815f050 con 0x7fb788070b80 2024-09-15T23:21:02.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.543+0000 7fb787fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb78815e6d0 0x7fb788071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:02.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.543+0000 7fb7877fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb78806cd20 0x7fb7880b6d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60116/0 (socket says 172.21.15.123:60116) 2024-09-15T23:21:02.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.543+0000 7fb787fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb78815e6d0 0x7fb788071390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42756/0 (socket says 172.21.15.123:42756) 2024-09-15T23:21:02.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.543+0000 7fb7877fe640 1 -- 172.21.15.123:0/2648363109 learned_addr learned my addr 172.21.15.123:0/2648363109 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:21:02.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.544+0000 7fb78cb61640 1 --2- 172.21.15.123:0/2648363109 >> v2:172.21.15.188:3300/0 conn(0x7fb788070b80 0x7fb7881622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:02.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.544+0000 7fb787fff640 1 -- 172.21.15.123:0/2648363109 >> v2:172.21.15.188:3300/0 conn(0x7fb788070b80 msgr2=0x7fb7881622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:02.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.544+0000 7fb787fff640 1 --2- 172.21.15.123:0/2648363109 >> v2:172.21.15.188:3300/0 conn(0x7fb788070b80 0x7fb7881622a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:02.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.544+0000 7fb787fff640 1 -- 172.21.15.123:0/2648363109 >> v1:172.21.15.123:6789/0 conn(0x7fb78806cd20 legacy=0x7fb7880b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:02.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.544+0000 7fb786ffd640 1 -- 172.21.15.123:0/2648363109 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3971529753 0 0) 0x7fb78815eab0 con 0x7fb78806cd20 2024-09-15T23:21:02.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.544+0000 7fb787fff640 1 -- 172.21.15.123:0/2648363109 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb78815f330 con 0x7fb78815e6d0 2024-09-15T23:21:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.544+0000 7fb787fff640 1 --2- 172.21.15.123:0/2648363109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb78815e6d0 0x7fb788071390 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7fb7880710d0 tx=0x7fb77802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b086e218106425 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.545+0000 7fb786ffd640 1 -- 172.21.15.123:0/2648363109 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb778037070 con 0x7fb78815e6d0 2024-09-15T23:21:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.545+0000 7fb786ffd640 1 -- 172.21.15.123:0/2648363109 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb778032440 con 0x7fb78815e6d0 2024-09-15T23:21:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.545+0000 7fb786ffd640 1 -- 172.21.15.123:0/2648363109 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb778032810 con 0x7fb78815e6d0 2024-09-15T23:21:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.545+0000 7fb78e5c4640 1 -- 172.21.15.123:0/2648363109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb78815e6d0 msgr2=0x7fb788071390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.545+0000 7fb78e5c4640 1 --2- 172.21.15.123:0/2648363109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb78815e6d0 0x7fb788071390 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7fb7880710d0 tx=0x7fb77802a1a0 comp rx=0 tx=0).stop 2024-09-15T23:21:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.545+0000 7fb78e5c4640 1 -- 172.21.15.123:0/2648363109 shutdown_connections 2024-09-15T23:21:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.545+0000 7fb78e5c4640 1 --2- 172.21.15.123:0/2648363109 >> v2:172.21.15.188:3300/0 conn(0x7fb788070b80 0x7fb7881622a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.545+0000 7fb78e5c4640 1 --2- 172.21.15.123:0/2648363109 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb78815e6d0 0x7fb788071390 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:02.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.545+0000 7fb78e5c4640 1 -- 172.21.15.123:0/2648363109 >> 172.21.15.123:0/2648363109 conn(0x7fb788067fb0 msgr2=0x7fb78806f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:02.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.545+0000 7fb78e5c4640 1 -- 172.21.15.123:0/2648363109 shutdown_connections 2024-09-15T23:21:02.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.545+0000 7fb78e5c4640 1 -- 172.21.15.123:0/2648363109 wait complete. 2024-09-15T23:21:02.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.547+0000 7fb78e5c4640 1 Processor -- start 2024-09-15T23:21:02.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.547+0000 7fb78e5c4640 1 -- start start 2024-09-15T23:21:02.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.547+0000 7fb78e5c4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb78806cd20 0x7fb7881f4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:02.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.547+0000 7fb78e5c4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb788070b80 0x7fb788143140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:02.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.548+0000 7fb78e5c4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb78815e6d0 0x7fb78814fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:02.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.548+0000 7fb78e5c4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb7880718d0 con 0x7fb78815e6d0 2024-09-15T23:21:02.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.548+0000 7fb78e5c4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb78815f8f0 con 0x7fb78806cd20 2024-09-15T23:21:02.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.548+0000 7fb78e5c4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb788071a50 con 0x7fb788070b80 2024-09-15T23:21:02.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.548+0000 7fb78cb61640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb78815e6d0 0x7fb78814fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:02.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.548+0000 7fb78cb61640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb78815e6d0 0x7fb78814fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42772/0 (socket says 172.21.15.123:42772) 2024-09-15T23:21:02.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.548+0000 7fb78cb61640 1 -- 172.21.15.123:0/3670761846 learned_addr learned my addr 172.21.15.123:0/3670761846 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:02.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.548+0000 7fb787fff640 1 --2- 172.21.15.123:0/3670761846 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb78806cd20 0x7fb7881f4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:02.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.548+0000 7fb7877fe640 1 --2- 172.21.15.123:0/3670761846 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb788070b80 0x7fb788143140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:02.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.548+0000 7fb78cb61640 1 -- 172.21.15.123:0/3670761846 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb788070b80 msgr2=0x7fb788143140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:02.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.548+0000 7fb78cb61640 1 --2- 172.21.15.123:0/3670761846 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb788070b80 0x7fb788143140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:02.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.548+0000 7fb78cb61640 1 -- 172.21.15.123:0/3670761846 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb78806cd20 msgr2=0x7fb7881f4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:02.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.548+0000 7fb78cb61640 1 --2- 172.21.15.123:0/3670761846 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb78806cd20 0x7fb7881f4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:02.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.548+0000 7fb78cb61640 1 -- 172.21.15.123:0/3670761846 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb78815ac50 con 0x7fb78815e6d0 2024-09-15T23:21:02.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.548+0000 7fb78cb61640 1 --2- 172.21.15.123:0/3670761846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb78815e6d0 0x7fb78814fcd0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7fb780007e40 tx=0x7fb78000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:02.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.548+0000 7fb784ff9640 1 -- 172.21.15.123:0/3670761846 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb780014620 con 0x7fb78815e6d0 2024-09-15T23:21:02.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.548+0000 7fb784ff9640 1 -- 172.21.15.123:0/3670761846 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb780019070 con 0x7fb78815e6d0 2024-09-15T23:21:02.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.548+0000 7fb78e5c4640 1 -- 172.21.15.123:0/3670761846 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb78815af30 con 0x7fb78815e6d0 2024-09-15T23:21:02.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.548+0000 7fb784ff9640 1 -- 172.21.15.123:0/3670761846 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb780014a20 con 0x7fb78815e6d0 2024-09-15T23:21:02.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.549+0000 7fb78e5c4640 1 -- 172.21.15.123:0/3670761846 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb78815b4f0 con 0x7fb78815e6d0 2024-09-15T23:21:02.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.550+0000 7fb78e5c4640 1 -- 172.21.15.123:0/3670761846 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb788071390 con 0x7fb78815e6d0 2024-09-15T23:21:02.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.550+0000 7fb784ff9640 1 -- 172.21.15.123:0/3670761846 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb780014bc0 con 0x7fb78815e6d0 2024-09-15T23:21:02.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.551+0000 7fb784ff9640 1 --2- 172.21.15.123:0/3670761846 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb77406c2b0 0x7fb77406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:02.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.551+0000 7fb784ff9640 1 -- 172.21.15.123:0/3670761846 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5767+0+0 (secure 0 0 0) 0x7fb78008bad0 con 0x7fb78815e6d0 2024-09-15T23:21:02.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.551+0000 7fb787fff640 1 --2- 172.21.15.123:0/3670761846 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb77406c2b0 0x7fb77406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:02.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.551+0000 7fb787fff640 1 --2- 172.21.15.123:0/3670761846 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb77406c2b0 0x7fb77406e770 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fb778034000 tx=0x7fb77802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:02.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.555+0000 7fb784ff9640 1 -- 172.21.15.123:0/3670761846 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb780059c40 con 0x7fb78815e6d0 2024-09-15T23:21:02.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.754+0000 7fb78e5c4640 1 -- 172.21.15.123:0/3670761846 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb788160040 con 0x7fb78815e6d0 2024-09-15T23:21:02.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.754+0000 7fb784ff9640 1 -- 172.21.15.123:0/3670761846 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5236 (secure 0 0 0) 0x7fb78005df40 con 0x7fb78815e6d0 2024-09-15T23:21:02.756 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:02.756 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":93,"btime":"2024-09-15T23:20:31:301251+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7735,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/3725440007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3725440007},{"type":"v1","addr":"172.21.15.188:6836","nonce":3725440007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7738,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2908220643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2908220643},{"type":"v1","addr":"172.21.15.188:6837","nonce":2908220643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":9003,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2302544827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2302544827},{"type":"v1","addr":"172.21.15.123:6834","nonce":2302544827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:20:28.532639+0000","modified":"2024-09-15T23:20:30.630141+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9006":{"gid":9006,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/627322542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":627322542},{"type":"v1","addr":"172.21.15.123:6835","nonce":627322542}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9006,"qdb_cluster":[9006]},"id":10}]} 2024-09-15T23:21:02.756 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 93 2024-09-15T23:21:02.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.756+0000 7fb78e5c4640 1 -- 172.21.15.123:0/3670761846 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb77406c2b0 msgr2=0x7fb77406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:02.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.756+0000 7fb78e5c4640 1 --2- 172.21.15.123:0/3670761846 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb77406c2b0 0x7fb77406e770 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fb778034000 tx=0x7fb77802e000 comp rx=0 tx=0).stop 2024-09-15T23:21:02.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.756+0000 7fb78e5c4640 1 -- 172.21.15.123:0/3670761846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb78815e6d0 msgr2=0x7fb78814fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:02.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.756+0000 7fb78e5c4640 1 --2- 172.21.15.123:0/3670761846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb78815e6d0 0x7fb78814fcd0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7fb780007e40 tx=0x7fb78000e4b0 comp rx=0 tx=0).stop 2024-09-15T23:21:02.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.756+0000 7fb78e5c4640 1 -- 172.21.15.123:0/3670761846 shutdown_connections 2024-09-15T23:21:02.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.756+0000 7fb78e5c4640 1 --2- 172.21.15.123:0/3670761846 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb77406c2b0 0x7fb77406e770 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:02.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.756+0000 7fb78e5c4640 1 --2- 172.21.15.123:0/3670761846 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb78815e6d0 0x7fb78814fcd0 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:02.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.756+0000 7fb78e5c4640 1 --2- 172.21.15.123:0/3670761846 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb788070b80 0x7fb788143140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:02.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.756+0000 7fb78e5c4640 1 --2- 172.21.15.123:0/3670761846 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb78806cd20 0x7fb7881f4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:02.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.756+0000 7fb78e5c4640 1 -- 172.21.15.123:0/3670761846 >> 172.21.15.123:0/3670761846 conn(0x7fb788067fb0 msgr2=0x7fb7881627a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:02.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.756+0000 7fb78e5c4640 1 -- 172.21.15.123:0/3670761846 shutdown_connections 2024-09-15T23:21:02.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.756+0000 7fb78e5c4640 1 -- 172.21.15.123:0/3670761846 wait complete. 2024-09-15T23:21:02.768 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-15T23:21:02.768 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:21:02.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.864+0000 7f77631e8640 1 Processor -- start 2024-09-15T23:21:02.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.864+0000 7f77631e8640 1 -- start start 2024-09-15T23:21:02.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.865+0000 7f77631e8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f775c06c320 0x7f775c15bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:02.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.865+0000 7f77631e8640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f775c13eb20 0x7f775c15c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:02.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.865+0000 7f77631e8640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f775c071180 con 0x7f775c0b2d40 2024-09-15T23:21:02.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.865+0000 7f77631e8640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f775c071ab0 con 0x7f775c06c320 2024-09-15T23:21:02.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.865+0000 7f77631e8640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f775c071460 con 0x7f775c13eb20 2024-09-15T23:21:02.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.865+0000 7f7760f84640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f775c0b2d40 0x7f775c06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60128/0 (socket says 172.21.15.123:60128) 2024-09-15T23:21:02.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.865+0000 7f775bfff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f775c06c320 0x7f775c15bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:02.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.865+0000 7f7760f84640 1 -- 172.21.15.123:0/4042324990 learned_addr learned my addr 172.21.15.123:0/4042324990 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:21:02.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.865+0000 7f7761785640 1 --2- 172.21.15.123:0/4042324990 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f775c13eb20 0x7f775c15c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:02.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.865+0000 7f775bfff640 1 -- 172.21.15.123:0/4042324990 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f775c13eb20 msgr2=0x7f775c15c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:02.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.865+0000 7f775bfff640 1 --2- 172.21.15.123:0/4042324990 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f775c13eb20 0x7f775c15c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:02.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.865+0000 7f775bfff640 1 -- 172.21.15.123:0/4042324990 >> v1:172.21.15.123:6789/0 conn(0x7f775c0b2d40 legacy=0x7f775c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:02.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.865+0000 7f775b7fe640 1 -- 172.21.15.123:0/4042324990 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1118287481 0 0) 0x7f775c071180 con 0x7f775c0b2d40 2024-09-15T23:21:02.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.865+0000 7f775bfff640 1 -- 172.21.15.123:0/4042324990 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f775c071740 con 0x7f775c06c320 2024-09-15T23:21:02.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.866+0000 7f775bfff640 1 --2- 172.21.15.123:0/4042324990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f775c06c320 0x7f775c15bcf0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f77500097a0 tx=0x7f775002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89344748e9994e62 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:02.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.866+0000 7f775b7fe640 1 -- 172.21.15.123:0/4042324990 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7750037070 con 0x7f775c06c320 2024-09-15T23:21:02.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.866+0000 7f775b7fe640 1 -- 172.21.15.123:0/4042324990 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7750032440 con 0x7f775c06c320 2024-09-15T23:21:02.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.866+0000 7f775b7fe640 1 -- 172.21.15.123:0/4042324990 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7750032810 con 0x7f775c06c320 2024-09-15T23:21:02.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.867+0000 7f77631e8640 1 -- 172.21.15.123:0/4042324990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f775c06c320 msgr2=0x7f775c15bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:02.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.867+0000 7f77631e8640 1 --2- 172.21.15.123:0/4042324990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f775c06c320 0x7f775c15bcf0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f77500097a0 tx=0x7f775002a180 comp rx=0 tx=0).stop 2024-09-15T23:21:02.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.867+0000 7f77631e8640 1 -- 172.21.15.123:0/4042324990 shutdown_connections 2024-09-15T23:21:02.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.867+0000 7f77631e8640 1 --2- 172.21.15.123:0/4042324990 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f775c13eb20 0x7f775c15c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:02.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.867+0000 7f77631e8640 1 --2- 172.21.15.123:0/4042324990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f775c06c320 0x7f775c15bcf0 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:02.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.867+0000 7f77631e8640 1 -- 172.21.15.123:0/4042324990 >> 172.21.15.123:0/4042324990 conn(0x7f775c0ccec0 msgr2=0x7f775c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:02.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.867+0000 7f77631e8640 1 -- 172.21.15.123:0/4042324990 shutdown_connections 2024-09-15T23:21:02.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.867+0000 7f77631e8640 1 -- 172.21.15.123:0/4042324990 wait complete. 2024-09-15T23:21:02.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.868+0000 7f77631e8640 1 Processor -- start 2024-09-15T23:21:02.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.868+0000 7f77631e8640 1 -- start start 2024-09-15T23:21:02.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.869+0000 7f77631e8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f775c06c320 0x7f775c13d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:02.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.869+0000 7f77631e8640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f775c0b2d40 0x7f775c1f36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:02.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.869+0000 7f77631e8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f775c13eb20 0x7f775c1f3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:02.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.869+0000 7f77631e8640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f775c0720c0 con 0x7f775c13eb20 2024-09-15T23:21:02.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.869+0000 7f77631e8640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f775c071f40 con 0x7f775c06c320 2024-09-15T23:21:02.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.869+0000 7f77631e8640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f775c072240 con 0x7f775c0b2d40 2024-09-15T23:21:02.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.869+0000 7f7761785640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f775c13eb20 0x7f775c1f3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:02.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.869+0000 7f7761785640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f775c13eb20 0x7f775c1f3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42790/0 (socket says 172.21.15.123:42790) 2024-09-15T23:21:02.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.869+0000 7f7761785640 1 -- 172.21.15.123:0/3142977997 learned_addr learned my addr 172.21.15.123:0/3142977997 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:02.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.869+0000 7f7760f84640 1 --2- 172.21.15.123:0/3142977997 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f775c06c320 0x7f775c13d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:02.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.869+0000 7f775bfff640 1 --2- 172.21.15.123:0/3142977997 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f775c0b2d40 0x7f775c1f36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:02.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.869+0000 7f7761785640 1 -- 172.21.15.123:0/3142977997 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f775c0b2d40 msgr2=0x7f775c1f36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:02.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.869+0000 7f7761785640 1 --2- 172.21.15.123:0/3142977997 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f775c0b2d40 0x7f775c1f36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:02.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.869+0000 7f7761785640 1 -- 172.21.15.123:0/3142977997 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f775c06c320 msgr2=0x7f775c13d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:02.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.869+0000 7f7761785640 1 --2- 172.21.15.123:0/3142977997 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f775c06c320 0x7f775c13d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:02.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.869+0000 7f7761785640 1 -- 172.21.15.123:0/3142977997 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f775c15d990 con 0x7f775c13eb20 2024-09-15T23:21:02.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.869+0000 7f7761785640 1 --2- 172.21.15.123:0/3142977997 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f775c13eb20 0x7f775c1f3c20 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f7754007e90 tx=0x7f775400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:02.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.870+0000 7f77597fa640 1 -- 172.21.15.123:0/3142977997 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7754014420 con 0x7f775c13eb20 2024-09-15T23:21:02.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.870+0000 7f77597fa640 1 -- 172.21.15.123:0/3142977997 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7754019070 con 0x7f775c13eb20 2024-09-15T23:21:02.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.870+0000 7f77631e8640 1 -- 172.21.15.123:0/3142977997 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f775c15dc70 con 0x7f775c13eb20 2024-09-15T23:21:02.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.870+0000 7f77597fa640 1 -- 172.21.15.123:0/3142977997 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7754014800 con 0x7f775c13eb20 2024-09-15T23:21:02.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.870+0000 7f77631e8640 1 -- 172.21.15.123:0/3142977997 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f775c15e230 con 0x7f775c13eb20 2024-09-15T23:21:02.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.871+0000 7f77631e8640 1 -- 172.21.15.123:0/3142977997 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f775c06bc10 con 0x7f775c13eb20 2024-09-15T23:21:02.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.871+0000 7f77597fa640 1 -- 172.21.15.123:0/3142977997 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f77540149a0 con 0x7f775c13eb20 2024-09-15T23:21:02.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.872+0000 7f77597fa640 1 --2- 172.21.15.123:0/3142977997 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f774806c2b0 0x7f774806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:02.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.872+0000 7f77597fa640 1 -- 172.21.15.123:0/3142977997 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5767+0+0 (secure 0 0 0) 0x7f775408bae0 con 0x7f775c13eb20 2024-09-15T23:21:02.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.872+0000 7f7760f84640 1 --2- 172.21.15.123:0/3142977997 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f774806c2b0 0x7f774806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:02.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.872+0000 7f7760f84640 1 --2- 172.21.15.123:0/3142977997 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f774806c2b0 0x7f774806e770 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f774c000f60 tx=0x7f774c007d50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:02.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:02.876+0000 7f77597fa640 1 -- 172.21.15.123:0/3142977997 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7754059c50 con 0x7f775c13eb20 2024-09-15T23:21:03.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.104+0000 7f77631e8640 1 -- 172.21.15.123:0/3142977997 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f775c06c9c0 con 0x7f775c13eb20 2024-09-15T23:21:03.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.104+0000 7f77597fa640 1 -- 172.21.15.123:0/3142977997 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1788 (secure 0 0 0) 0x7f775405df50 con 0x7f775c13eb20 2024-09-15T23:21:03.107 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:03.107 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":553,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":156,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076566731,"bytes_used":2556403712,"bytes_avail":770537709568,"bytes_total":773094113280,"recovering_objects_per_sec":4,"recovering_bytes_per_sec":4455352,"recovering_keys_per_sec":0,"num_objects_recovered":34,"num_bytes_recovered":35651584,"num_keys_recovered":0,"write_bytes_sec":767,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":93,"btime":"2024-09-15T23:20:31:301251+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":9006}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-09-15T23:21:01.629595+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T23:21:03.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.106+0000 7f77631e8640 1 -- 172.21.15.123:0/3142977997 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f774806c2b0 msgr2=0x7f774806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:03.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.106+0000 7f77631e8640 1 --2- 172.21.15.123:0/3142977997 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f774806c2b0 0x7f774806e770 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f774c000f60 tx=0x7f774c007d50 comp rx=0 tx=0).stop 2024-09-15T23:21:03.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.106+0000 7f77631e8640 1 -- 172.21.15.123:0/3142977997 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f775c13eb20 msgr2=0x7f775c1f3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:03.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.106+0000 7f77631e8640 1 --2- 172.21.15.123:0/3142977997 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f775c13eb20 0x7f775c1f3c20 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f7754007e90 tx=0x7f775400e4b0 comp rx=0 tx=0).stop 2024-09-15T23:21:03.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.106+0000 7f77631e8640 1 -- 172.21.15.123:0/3142977997 shutdown_connections 2024-09-15T23:21:03.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.107+0000 7f77631e8640 1 --2- 172.21.15.123:0/3142977997 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f774806c2b0 0x7f774806e770 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:03.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.107+0000 7f77631e8640 1 --2- 172.21.15.123:0/3142977997 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f775c13eb20 0x7f775c1f3c20 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:03.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.107+0000 7f77631e8640 1 --2- 172.21.15.123:0/3142977997 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f775c0b2d40 0x7f775c1f36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:03.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.107+0000 7f77631e8640 1 --2- 172.21.15.123:0/3142977997 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f775c06c320 0x7f775c13d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:03.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.107+0000 7f77631e8640 1 -- 172.21.15.123:0/3142977997 >> 172.21.15.123:0/3142977997 conn(0x7f775c0ccec0 msgr2=0x7f775c0cf470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:03.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.107+0000 7f77631e8640 1 -- 172.21.15.123:0/3142977997 shutdown_connections 2024-09-15T23:21:03.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.107+0000 7f77631e8640 1 -- 172.21.15.123:0/3142977997 wait complete. 2024-09-15T23:21:03.119 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-15T23:21:03.119 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:21:03.119 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:21:03.156 DEBUG:teuthology.orchestra.run.smithi188:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:21:03.207 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:21:03.208 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:21:03.208 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:21:03.208 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:21:03.225 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:21:03.225 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:21:03.281 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:21:03.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.420+0000 7f2c48206640 1 Processor -- start 2024-09-15T23:21:03.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.420+0000 7f2c48206640 1 -- start start 2024-09-15T23:21:03.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.421+0000 7f2c48206640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2c4006c6a0 0x7f2c400720b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:03.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.421+0000 7f2c48206640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2c4015af20 0x7f2c4015b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:03.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.421+0000 7f2c48206640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c40071010 con 0x7f2c4015ab40 2024-09-15T23:21:03.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.421+0000 7f2c48206640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f2c4006cb10 con 0x7f2c4006c6a0 2024-09-15T23:21:03.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.421+0000 7f2c48206640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f2c400712f0 con 0x7f2c4015af20 2024-09-15T23:21:03.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.421+0000 7f2c457a1640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2c4006c6a0 0x7f2c400720b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:03.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.421+0000 7f2c457a1640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2c4006c6a0 0x7f2c400720b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42796/0 (socket says 172.21.15.123:42796) 2024-09-15T23:21:03.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.421+0000 7f2c457a1640 1 -- 172.21.15.123:0/956347640 learned_addr learned my addr 172.21.15.123:0/956347640 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:03.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.421+0000 7f2c467a3640 1 --2- 172.21.15.123:0/956347640 >> v2:172.21.15.188:3300/0 conn(0x7f2c4015af20 0x7f2c4015b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:03.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.421+0000 7f2c457a1640 1 -- 172.21.15.123:0/956347640 >> v2:172.21.15.188:3300/0 conn(0x7f2c4015af20 msgr2=0x7f2c4015b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:03.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.421+0000 7f2c457a1640 1 --2- 172.21.15.123:0/956347640 >> v2:172.21.15.188:3300/0 conn(0x7f2c4015af20 0x7f2c4015b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:03.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.421+0000 7f2c457a1640 1 -- 172.21.15.123:0/956347640 >> v1:172.21.15.188:6789/0 conn(0x7f2c4015ab40 legacy=0x7f2c40073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:03.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.421+0000 7f2c457a1640 1 -- 172.21.15.123:0/956347640 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c400715d0 con 0x7f2c4006c6a0 2024-09-15T23:21:03.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.422+0000 7f2c457a1640 1 --2- 172.21.15.123:0/956347640 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c4006c6a0 0x7f2c400720b0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f2c400d03d0 tx=0x7f2c3002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ee6ad5a596d7b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:03.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.422+0000 7f2c44fa0640 1 -- 172.21.15.123:0/956347640 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c30037070 con 0x7f2c4006c6a0 2024-09-15T23:21:03.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.422+0000 7f2c44fa0640 1 -- 172.21.15.123:0/956347640 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c30032440 con 0x7f2c4006c6a0 2024-09-15T23:21:03.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.422+0000 7f2c44fa0640 1 -- 172.21.15.123:0/956347640 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c30032810 con 0x7f2c4006c6a0 2024-09-15T23:21:03.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.423+0000 7f2c48206640 1 -- 172.21.15.123:0/956347640 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c4006c6a0 msgr2=0x7f2c400720b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:03.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.423+0000 7f2c48206640 1 --2- 172.21.15.123:0/956347640 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c4006c6a0 0x7f2c400720b0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f2c400d03d0 tx=0x7f2c3002a1e0 comp rx=0 tx=0).stop 2024-09-15T23:21:03.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.423+0000 7f2c48206640 1 -- 172.21.15.123:0/956347640 shutdown_connections 2024-09-15T23:21:03.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.423+0000 7f2c48206640 1 --2- 172.21.15.123:0/956347640 >> v2:172.21.15.188:3300/0 conn(0x7f2c4015af20 0x7f2c4015b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:03.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.423+0000 7f2c48206640 1 --2- 172.21.15.123:0/956347640 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c4006c6a0 0x7f2c400720b0 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:03.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.423+0000 7f2c48206640 1 -- 172.21.15.123:0/956347640 >> 172.21.15.123:0/956347640 conn(0x7f2c400ccec0 msgr2=0x7f2c400cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:03.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.423+0000 7f2c48206640 1 -- 172.21.15.123:0/956347640 shutdown_connections 2024-09-15T23:21:03.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.423+0000 7f2c48206640 1 -- 172.21.15.123:0/956347640 wait complete. 2024-09-15T23:21:03.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.424+0000 7f2c48206640 1 Processor -- start 2024-09-15T23:21:03.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.424+0000 7f2c48206640 1 -- start start 2024-09-15T23:21:03.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.425+0000 7f2c48206640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2c4006c6a0 0x7f2c401f3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:03.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.425+0000 7f2c48206640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c4015ab40 0x7f2c401509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:03.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.425+0000 7f2c48206640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2c4015af20 0x7f2c40153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:03.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.425+0000 7f2c48206640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4015ba30 con 0x7f2c4015ab40 2024-09-15T23:21:03.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.425+0000 7f2c48206640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4015b8b0 con 0x7f2c4015af20 2024-09-15T23:21:03.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.425+0000 7f2c48206640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f2c4006bc10 con 0x7f2c4006c6a0 2024-09-15T23:21:03.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.425+0000 7f2c457a1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c4015ab40 0x7f2c401509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:03.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.425+0000 7f2c457a1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c4015ab40 0x7f2c401509e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42810/0 (socket says 172.21.15.123:42810) 2024-09-15T23:21:03.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.425+0000 7f2c457a1640 1 -- 172.21.15.123:0/207460730 learned_addr learned my addr 172.21.15.123:0/207460730 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:03.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.425+0000 7f2c45fa2640 1 --2- 172.21.15.123:0/207460730 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2c4006c6a0 0x7f2c401f3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:03.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.425+0000 7f2c467a3640 1 --2- 172.21.15.123:0/207460730 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2c4015af20 0x7f2c40153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:03.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.425+0000 7f2c457a1640 1 -- 172.21.15.123:0/207460730 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2c4006c6a0 msgr2=0x7f2c401f3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:03.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.425+0000 7f2c457a1640 1 --2- 172.21.15.123:0/207460730 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2c4006c6a0 0x7f2c401f3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:03.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.425+0000 7f2c457a1640 1 -- 172.21.15.123:0/207460730 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2c4015af20 msgr2=0x7f2c40153360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:03.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.425+0000 7f2c457a1640 1 --2- 172.21.15.123:0/207460730 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2c4015af20 0x7f2c40153360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:03.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.425+0000 7f2c457a1640 1 -- 172.21.15.123:0/207460730 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c40151430 con 0x7f2c4015ab40 2024-09-15T23:21:03.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.425+0000 7f2c457a1640 1 --2- 172.21.15.123:0/207460730 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c4015ab40 0x7f2c401509e0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f2c3002a220 tx=0x7f2c300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:03.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.425+0000 7f2c367fc640 1 -- 172.21.15.123:0/207460730 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c30041020 con 0x7f2c4015ab40 2024-09-15T23:21:03.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.425+0000 7f2c367fc640 1 -- 172.21.15.123:0/207460730 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c300306c0 con 0x7f2c4015ab40 2024-09-15T23:21:03.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.425+0000 7f2c48206640 1 -- 172.21.15.123:0/207460730 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c40151710 con 0x7f2c4015ab40 2024-09-15T23:21:03.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.425+0000 7f2c367fc640 1 -- 172.21.15.123:0/207460730 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c30037040 con 0x7f2c4015ab40 2024-09-15T23:21:03.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.426+0000 7f2c48206640 1 -- 172.21.15.123:0/207460730 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c40151cd0 con 0x7f2c4015ab40 2024-09-15T23:21:03.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.427+0000 7f2c48206640 1 -- 172.21.15.123:0/207460730 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c4006bfd0 con 0x7f2c4015ab40 2024-09-15T23:21:03.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.427+0000 7f2c367fc640 1 -- 172.21.15.123:0/207460730 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2c30044020 con 0x7f2c4015ab40 2024-09-15T23:21:03.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.427+0000 7f2c367fc640 1 --2- 172.21.15.123:0/207460730 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2c2406c2e0 0x7f2c2406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:03.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.428+0000 7f2c367fc640 1 -- 172.21.15.123:0/207460730 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5767+0+0 (secure 0 0 0) 0x7f2c300aba40 con 0x7f2c4015ab40 2024-09-15T23:21:03.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.428+0000 7f2c45fa2640 1 --2- 172.21.15.123:0/207460730 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2c2406c2e0 0x7f2c2406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:03.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.428+0000 7f2c45fa2640 1 --2- 172.21.15.123:0/207460730 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2c2406c2e0 0x7f2c2406e7a0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f2c401532f0 tx=0x7f2c3c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:03.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.432+0000 7f2c367fc640 1 -- 172.21.15.123:0/207460730 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2c3004b030 con 0x7f2c4015ab40 2024-09-15T23:21:03.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.610+0000 7f2c48206640 1 -- 172.21.15.123:0/207460730 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2c400b3610 con 0x7f2c4015ab40 2024-09-15T23:21:03.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.610+0000 7f2c367fc640 1 -- 172.21.15.123:0/207460730 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v156) ==== 80+0+0 (secure 0 0 0) 0x7f2c300abe20 con 0x7f2c4015ab40 2024-09-15T23:21:03.611 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-15T23:21:03.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.612+0000 7f2c48206640 1 -- 172.21.15.123:0/207460730 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2c2406c2e0 msgr2=0x7f2c2406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:03.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.612+0000 7f2c48206640 1 --2- 172.21.15.123:0/207460730 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2c2406c2e0 0x7f2c2406e7a0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f2c401532f0 tx=0x7f2c3c009040 comp rx=0 tx=0).stop 2024-09-15T23:21:03.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.612+0000 7f2c48206640 1 -- 172.21.15.123:0/207460730 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c4015ab40 msgr2=0x7f2c401509e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:03.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.612+0000 7f2c48206640 1 --2- 172.21.15.123:0/207460730 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c4015ab40 0x7f2c401509e0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f2c3002a220 tx=0x7f2c300046c0 comp rx=0 tx=0).stop 2024-09-15T23:21:03.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.612+0000 7f2c48206640 1 -- 172.21.15.123:0/207460730 shutdown_connections 2024-09-15T23:21:03.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.612+0000 7f2c48206640 1 --2- 172.21.15.123:0/207460730 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2c4015af20 0x7f2c40153360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:03.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.612+0000 7f2c48206640 1 --2- 172.21.15.123:0/207460730 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2c2406c2e0 0x7f2c2406e7a0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:03.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.612+0000 7f2c48206640 1 --2- 172.21.15.123:0/207460730 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c4015ab40 0x7f2c401509e0 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:03.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.612+0000 7f2c48206640 1 --2- 172.21.15.123:0/207460730 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2c4006c6a0 0x7f2c401f3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:03.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.612+0000 7f2c48206640 1 -- 172.21.15.123:0/207460730 >> 172.21.15.123:0/207460730 conn(0x7f2c400ccec0 msgr2=0x7f2c400b51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:03.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.612+0000 7f2c48206640 1 -- 172.21.15.123:0/207460730 shutdown_connections 2024-09-15T23:21:03.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:03.612+0000 7f2c48206640 1 -- 172.21.15.123:0/207460730 wait complete. 2024-09-15T23:21:03.625 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-15T23:21:03.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:21:03.625 DEBUG:teuthology.orchestra.run.smithi123:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-15T23:21:04.229 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-09-15T23:21:04.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:21:04.230 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T23:21:04.250 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:21:04.250 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:21:04.250 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:21:04.268 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:21:04.268 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:21:04.268 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:21:04.269 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:21:04.306 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:21:04.306 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:21:04.306 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:21:04.306 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:21:04.326 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:21:04.326 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:21:04.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.446+0000 7efc1e38d640 1 Processor -- start 2024-09-15T23:21:04.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.446+0000 7efc1e38d640 1 -- start start 2024-09-15T23:21:04.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.447+0000 7efc1e38d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc181482b0 0x7efc180b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:04.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.447+0000 7efc1e38d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7efc180b47d0 0x7efc1806dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:04.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.447+0000 7efc1e38d640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc18072fb0 con 0x7efc1806e4e0 2024-09-15T23:21:04.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.447+0000 7efc1e38d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7efc180b4c30 con 0x7efc180b47d0 2024-09-15T23:21:04.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.447+0000 7efc1e38d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7efc18073290 con 0x7efc181482b0 2024-09-15T23:21:04.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.447+0000 7efc177fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7efc180b47d0 0x7efc1806dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:04.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.447+0000 7efc17fff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc181482b0 0x7efc180b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:04.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.447+0000 7efc177fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7efc180b47d0 0x7efc1806dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:37296/0 (socket says 172.21.15.123:37296) 2024-09-15T23:21:04.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.447+0000 7efc177fe640 1 -- 172.21.15.123:0/1795796871 learned_addr learned my addr 172.21.15.123:0/1795796871 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:04.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.447+0000 7efc177fe640 1 -- 172.21.15.123:0/1795796871 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc181482b0 msgr2=0x7efc180b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:04.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.447+0000 7efc177fe640 1 --2- 172.21.15.123:0/1795796871 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc181482b0 0x7efc180b4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:04.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.447+0000 7efc177fe640 1 -- 172.21.15.123:0/1795796871 >> v1:172.21.15.188:6789/0 conn(0x7efc1806e4e0 legacy=0x7efc1806e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:04.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.447+0000 7efc177fe640 1 -- 172.21.15.123:0/1795796871 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc18073570 con 0x7efc180b47d0 2024-09-15T23:21:04.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.447+0000 7efc17fff640 1 --2- 172.21.15.123:0/1795796871 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc181482b0 0x7efc180b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:21:04.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.448+0000 7efc177fe640 1 --2- 172.21.15.123:0/1795796871 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc180b47d0 0x7efc1806dfa0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7efc0c009870 tx=0x7efc0c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a98029219422331 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:04.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.448+0000 7efc16ffd640 1 -- 172.21.15.123:0/1795796871 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0c037070 con 0x7efc180b47d0 2024-09-15T23:21:04.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.448+0000 7efc16ffd640 1 -- 172.21.15.123:0/1795796871 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc0c032440 con 0x7efc180b47d0 2024-09-15T23:21:04.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.448+0000 7efc16ffd640 1 -- 172.21.15.123:0/1795796871 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0c032810 con 0x7efc180b47d0 2024-09-15T23:21:04.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.449+0000 7efc1e38d640 1 -- 172.21.15.123:0/1795796871 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc180b47d0 msgr2=0x7efc1806dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:04.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.449+0000 7efc1e38d640 1 --2- 172.21.15.123:0/1795796871 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc180b47d0 0x7efc1806dfa0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7efc0c009870 tx=0x7efc0c02a1c0 comp rx=0 tx=0).stop 2024-09-15T23:21:04.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.449+0000 7efc1e38d640 1 -- 172.21.15.123:0/1795796871 shutdown_connections 2024-09-15T23:21:04.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.449+0000 7efc1e38d640 1 --2- 172.21.15.123:0/1795796871 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc180b47d0 0x7efc1806dfa0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:04.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.449+0000 7efc1e38d640 1 --2- 172.21.15.123:0/1795796871 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc181482b0 0x7efc180b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:04.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.449+0000 7efc1e38d640 1 -- 172.21.15.123:0/1795796871 >> 172.21.15.123:0/1795796871 conn(0x7efc1806c240 msgr2=0x7efc180b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:04.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.449+0000 7efc1e38d640 1 -- 172.21.15.123:0/1795796871 shutdown_connections 2024-09-15T23:21:04.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.449+0000 7efc1e38d640 1 -- 172.21.15.123:0/1795796871 wait complete. 2024-09-15T23:21:04.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.450+0000 7efc1e38d640 1 Processor -- start 2024-09-15T23:21:04.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.450+0000 7efc1e38d640 1 -- start start 2024-09-15T23:21:04.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.451+0000 7efc1e38d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc1806e4e0 0x7efc1815e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:04.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.451+0000 7efc1e38d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc180b47d0 0x7efc1813fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:04.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.451+0000 7efc1e38d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc181482b0 0x7efc1813dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:04.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.451+0000 7efc1e38d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efc18148690 con 0x7efc181482b0 2024-09-15T23:21:04.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.451+0000 7efc1e38d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7efc180aeae0 con 0x7efc1806e4e0 2024-09-15T23:21:04.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.451+0000 7efc1e38d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7efc1806d6a0 con 0x7efc180b47d0 2024-09-15T23:21:04.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.451+0000 7efc1c92a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc181482b0 0x7efc1813dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:04.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.451+0000 7efc1c92a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc181482b0 0x7efc1813dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42814/0 (socket says 172.21.15.123:42814) 2024-09-15T23:21:04.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.451+0000 7efc1c92a640 1 -- 172.21.15.123:0/3763968247 learned_addr learned my addr 172.21.15.123:0/3763968247 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:04.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.451+0000 7efc17fff640 1 --2- 172.21.15.123:0/3763968247 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc1806e4e0 0x7efc1815e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:04.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.451+0000 7efc177fe640 1 --2- 172.21.15.123:0/3763968247 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc180b47d0 0x7efc1813fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:04.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.451+0000 7efc1c92a640 1 -- 172.21.15.123:0/3763968247 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc180b47d0 msgr2=0x7efc1813fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:04.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.451+0000 7efc1c92a640 1 --2- 172.21.15.123:0/3763968247 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc180b47d0 0x7efc1813fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:04.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.451+0000 7efc1c92a640 1 -- 172.21.15.123:0/3763968247 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc1806e4e0 msgr2=0x7efc1815e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:04.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.451+0000 7efc1c92a640 1 --2- 172.21.15.123:0/3763968247 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc1806e4e0 0x7efc1815e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:04.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.451+0000 7efc1c92a640 1 -- 172.21.15.123:0/3763968247 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc1813e4d0 con 0x7efc181482b0 2024-09-15T23:21:04.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.451+0000 7efc177fe640 1 --2- 172.21.15.123:0/3763968247 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc180b47d0 0x7efc1813fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:21:04.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.452+0000 7efc1c92a640 1 --2- 172.21.15.123:0/3763968247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc181482b0 0x7efc1813dad0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7efc1000c6b0 tx=0x7efc1000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:04.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.452+0000 7efc14ff9640 1 -- 172.21.15.123:0/3763968247 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc10003b70 con 0x7efc181482b0 2024-09-15T23:21:04.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.452+0000 7efc14ff9640 1 -- 172.21.15.123:0/3763968247 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc10003d30 con 0x7efc181482b0 2024-09-15T23:21:04.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.452+0000 7efc14ff9640 1 -- 172.21.15.123:0/3763968247 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc10005310 con 0x7efc181482b0 2024-09-15T23:21:04.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.452+0000 7efc1e38d640 1 -- 172.21.15.123:0/3763968247 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc18143860 con 0x7efc181482b0 2024-09-15T23:21:04.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.452+0000 7efc1e38d640 1 -- 172.21.15.123:0/3763968247 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc1815e6e0 con 0x7efc181482b0 2024-09-15T23:21:04.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.453+0000 7efc1e38d640 1 -- 172.21.15.123:0/3763968247 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc18143660 con 0x7efc181482b0 2024-09-15T23:21:04.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.453+0000 7efc14ff9640 1 -- 172.21.15.123:0/3763968247 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7efc100054b0 con 0x7efc181482b0 2024-09-15T23:21:04.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.454+0000 7efc14ff9640 1 --2- 172.21.15.123:0/3763968247 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efc0406c2b0 0x7efc0406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:04.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.454+0000 7efc14ff9640 1 -- 172.21.15.123:0/3763968247 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5767+0+0 (secure 0 0 0) 0x7efc1008b1a0 con 0x7efc181482b0 2024-09-15T23:21:04.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.454+0000 7efc17fff640 1 --2- 172.21.15.123:0/3763968247 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efc0406c2b0 0x7efc0406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:04.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.454+0000 7efc17fff640 1 --2- 172.21.15.123:0/3763968247 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efc0406c2b0 0x7efc0406e770 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7efc08009560 tx=0x7efc08009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:04.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.458+0000 7efc14ff9640 1 -- 172.21.15.123:0/3763968247 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efc10059960 con 0x7efc181482b0 2024-09-15T23:21:04.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.657+0000 7efc1e38d640 1 -- 172.21.15.123:0/3763968247 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc1806dfa0 con 0x7efc181482b0 2024-09-15T23:21:04.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.658+0000 7efc14ff9640 1 -- 172.21.15.123:0/3763968247 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5236 (secure 0 0 0) 0x7efc10059260 con 0x7efc181482b0 2024-09-15T23:21:04.659 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:04.659 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":93,"btime":"2024-09-15T23:20:31:301251+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7735,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/3725440007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3725440007},{"type":"v1","addr":"172.21.15.188:6836","nonce":3725440007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7738,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2908220643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2908220643},{"type":"v1","addr":"172.21.15.188:6837","nonce":2908220643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":9003,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2302544827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2302544827},{"type":"v1","addr":"172.21.15.123:6834","nonce":2302544827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:20:28.532639+0000","modified":"2024-09-15T23:20:30.630141+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9006":{"gid":9006,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/627322542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":627322542},{"type":"v1","addr":"172.21.15.123:6835","nonce":627322542}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9006,"qdb_cluster":[9006]},"id":10}]} 2024-09-15T23:21:04.659 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 93 2024-09-15T23:21:04.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.660+0000 7efc1e38d640 1 -- 172.21.15.123:0/3763968247 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efc0406c2b0 msgr2=0x7efc0406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:04.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.660+0000 7efc1e38d640 1 --2- 172.21.15.123:0/3763968247 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efc0406c2b0 0x7efc0406e770 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7efc08009560 tx=0x7efc08009190 comp rx=0 tx=0).stop 2024-09-15T23:21:04.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.660+0000 7efc1e38d640 1 -- 172.21.15.123:0/3763968247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc181482b0 msgr2=0x7efc1813dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:04.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.660+0000 7efc1e38d640 1 --2- 172.21.15.123:0/3763968247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc181482b0 0x7efc1813dad0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7efc1000c6b0 tx=0x7efc1000cb70 comp rx=0 tx=0).stop 2024-09-15T23:21:04.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.660+0000 7efc1e38d640 1 -- 172.21.15.123:0/3763968247 shutdown_connections 2024-09-15T23:21:04.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.660+0000 7efc1e38d640 1 --2- 172.21.15.123:0/3763968247 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efc0406c2b0 0x7efc0406e770 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:04.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.660+0000 7efc1e38d640 1 --2- 172.21.15.123:0/3763968247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc181482b0 0x7efc1813dad0 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:04.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.660+0000 7efc1e38d640 1 --2- 172.21.15.123:0/3763968247 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efc180b47d0 0x7efc1813fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:04.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.660+0000 7efc1e38d640 1 --2- 172.21.15.123:0/3763968247 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efc1806e4e0 0x7efc1815e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:04.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.660+0000 7efc1e38d640 1 -- 172.21.15.123:0/3763968247 >> 172.21.15.123:0/3763968247 conn(0x7efc1806c240 msgr2=0x7efc1806f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:04.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.660+0000 7efc1e38d640 1 -- 172.21.15.123:0/3763968247 shutdown_connections 2024-09-15T23:21:04.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.660+0000 7efc1e38d640 1 -- 172.21.15.123:0/3763968247 wait complete. 2024-09-15T23:21:04.672 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:21:04.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.769+0000 7fdff9723640 1 Processor -- start 2024-09-15T23:21:04.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.769+0000 7fdff9723640 1 -- start start 2024-09-15T23:21:04.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.770+0000 7fdff9723640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdff41461a0 0x7fdff415d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:04.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.770+0000 7fdff9723640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fdff40720c0 0x7fdff406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:04.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.770+0000 7fdff9723640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdff40728d0 con 0x7fdff406c150 2024-09-15T23:21:04.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.770+0000 7fdff9723640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fdff415ddc0 con 0x7fdff40720c0 2024-09-15T23:21:04.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.770+0000 7fdff9723640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fdff406c5a0 con 0x7fdff41461a0 2024-09-15T23:21:04.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.770+0000 7fdff37fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fdff406c150 0x7fdff40b67a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60140/0 (socket says 172.21.15.123:60140) 2024-09-15T23:21:04.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.770+0000 7fdff37fe640 1 -- 172.21.15.123:0/2491892419 learned_addr learned my addr 172.21.15.123:0/2491892419 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:21:04.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.770+0000 7fdff27fc640 1 --2- 172.21.15.123:0/2491892419 >> v2:172.21.15.188:3300/0 conn(0x7fdff40720c0 0x7fdff406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:04.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.770+0000 7fdff2ffd640 1 --2- 172.21.15.123:0/2491892419 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdff41461a0 0x7fdff415d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:04.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.770+0000 7fdff1ffb640 1 -- 172.21.15.123:0/2491892419 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4243522808 0 0) 0x7fdff40728d0 con 0x7fdff406c150 2024-09-15T23:21:04.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.770+0000 7fdff1ffb640 1 -- 172.21.15.123:0/2491892419 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfdc003520 con 0x7fdff406c150 2024-09-15T23:21:04.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.771+0000 7fdff1ffb640 1 -- 172.21.15.123:0/2491892419 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1433264282 0 0) 0x7fdfdc003520 con 0x7fdff406c150 2024-09-15T23:21:04.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.771+0000 7fdff1ffb640 1 -- 172.21.15.123:0/2491892419 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdff41461a0 msgr2=0x7fdff415d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:04.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.771+0000 7fdff1ffb640 1 --2- 172.21.15.123:0/2491892419 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdff41461a0 0x7fdff415d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:04.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.771+0000 7fdff1ffb640 1 -- 172.21.15.123:0/2491892419 >> v2:172.21.15.188:3300/0 conn(0x7fdff40720c0 msgr2=0x7fdff406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:04.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.771+0000 7fdff1ffb640 1 --2- 172.21.15.123:0/2491892419 >> v2:172.21.15.188:3300/0 conn(0x7fdff40720c0 0x7fdff406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:04.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.771+0000 7fdff1ffb640 1 -- 172.21.15.123:0/2491892419 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff4072bb0 con 0x7fdff406c150 2024-09-15T23:21:04.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.771+0000 7fdff1ffb640 1 -- 172.21.15.123:0/2491892419 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fdfec001670 con 0x7fdff406c150 2024-09-15T23:21:04.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.771+0000 7fdff1ffb640 1 -- 172.21.15.123:0/2491892419 >> v1:172.21.15.123:6789/0 conn(0x7fdff406c150 legacy=0x7fdff40b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:04.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.771+0000 7fdff1ffb640 1 --2- 172.21.15.123:0/2491892419 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdfdc0039b0 0x7fdfdc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:04.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.771+0000 7fdff1ffb640 1 --2- 172.21.15.123:0/2491892419 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfdc004800 0x7fdfdc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:04.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.771+0000 7fdff1ffb640 1 --2- 172.21.15.123:0/2491892419 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdff41461a0 0x7fdfdc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:04.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.771+0000 7fdff1ffb640 1 -- 172.21.15.123:0/2491892419 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdff406c5a0 con 0x7fdfdc004800 2024-09-15T23:21:04.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.771+0000 7fdff1ffb640 1 -- 172.21.15.123:0/2491892419 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fdfdc00b9c0 con 0x7fdfdc0039b0 2024-09-15T23:21:04.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.771+0000 7fdff1ffb640 1 -- 172.21.15.123:0/2491892419 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fdfdc00bb40 con 0x7fdff41461a0 2024-09-15T23:21:04.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.771+0000 7fdff27fc640 1 --2- 172.21.15.123:0/2491892419 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfdc004800 0x7fdfdc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:04.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.771+0000 7fdff2ffd640 1 --2- 172.21.15.123:0/2491892419 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdfdc0039b0 0x7fdfdc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:04.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.771+0000 7fdff37fe640 1 --2- 172.21.15.123:0/2491892419 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdff41461a0 0x7fdfdc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:04.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.771+0000 7fdff27fc640 1 -- 172.21.15.123:0/2491892419 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdff41461a0 msgr2=0x7fdfdc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:04.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.771+0000 7fdff27fc640 1 --2- 172.21.15.123:0/2491892419 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdff41461a0 0x7fdfdc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:04.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.771+0000 7fdff27fc640 1 -- 172.21.15.123:0/2491892419 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdfdc0039b0 msgr2=0x7fdfdc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:04.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.771+0000 7fdff27fc640 1 --2- 172.21.15.123:0/2491892419 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdfdc0039b0 0x7fdfdc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:04.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.771+0000 7fdff27fc640 1 -- 172.21.15.123:0/2491892419 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfdc003520 con 0x7fdfdc004800 2024-09-15T23:21:04.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.771+0000 7fdff37fe640 1 --2- 172.21.15.123:0/2491892419 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdff41461a0 0x7fdfdc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:21:04.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.772+0000 7fdff27fc640 1 --2- 172.21.15.123:0/2491892419 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfdc004800 0x7fdfdc004c80 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8009a90 tx=0x7fdfdc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f1dc4549a1a009 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:04.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.772+0000 7fdff1ffb640 1 -- 172.21.15.123:0/2491892419 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8036070 con 0x7fdfdc004800 2024-09-15T23:21:04.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.772+0000 7fdff1ffb640 1 -- 172.21.15.123:0/2491892419 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfe8031400 con 0x7fdfdc004800 2024-09-15T23:21:04.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.772+0000 7fdff1ffb640 1 -- 172.21.15.123:0/2491892419 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8009690 con 0x7fdfdc004800 2024-09-15T23:21:04.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.772+0000 7fdff9723640 1 -- 172.21.15.123:0/2491892419 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfdc004800 msgr2=0x7fdfdc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:04.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.773+0000 7fdff9723640 1 --2- 172.21.15.123:0/2491892419 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfdc004800 0x7fdfdc004c80 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8009a90 tx=0x7fdfdc005830 comp rx=0 tx=0).stop 2024-09-15T23:21:04.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.773+0000 7fdff37fe640 1 -- 172.21.15.123:0/2491892419 reap_dead start 2024-09-15T23:21:04.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.773+0000 7fdff9723640 1 -- 172.21.15.123:0/2491892419 shutdown_connections 2024-09-15T23:21:04.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.773+0000 7fdff9723640 1 -- 172.21.15.123:0/2491892419 >> 172.21.15.123:0/2491892419 conn(0x7fdff406cd20 msgr2=0x7fdff406d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:04.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.773+0000 7fdff9723640 1 -- 172.21.15.123:0/2491892419 shutdown_connections 2024-09-15T23:21:04.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.773+0000 7fdff9723640 1 -- 172.21.15.123:0/2491892419 wait complete. 2024-09-15T23:21:04.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.774+0000 7fdff9723640 1 Processor -- start 2024-09-15T23:21:04.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.774+0000 7fdff9723640 1 -- start start 2024-09-15T23:21:04.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.775+0000 7fdff9723640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdfdc004800 0x7fdff4144560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:04.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.775+0000 7fdff9723640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdff40c79a0 0x7fdff40c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:04.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.775+0000 7fdff9723640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdff4156230 0x7fdff4156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:04.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.775+0000 7fdff9723640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdff4073170 con 0x7fdff4156230 2024-09-15T23:21:04.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.775+0000 7fdff9723640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fdff4146580 con 0x7fdff40c79a0 2024-09-15T23:21:04.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.775+0000 7fdff9723640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fdff4072500 con 0x7fdfdc004800 2024-09-15T23:21:04.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.775+0000 7fdff37fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdff4156230 0x7fdff4156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:04.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.775+0000 7fdff37fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdff4156230 0x7fdff4156670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42840/0 (socket says 172.21.15.123:42840) 2024-09-15T23:21:04.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.775+0000 7fdff37fe640 1 -- 172.21.15.123:0/3340155759 learned_addr learned my addr 172.21.15.123:0/3340155759 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:04.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.775+0000 7fdff27fc640 1 --2- 172.21.15.123:0/3340155759 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdff40c79a0 0x7fdff40c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:04.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.775+0000 7fdff2ffd640 1 --2- 172.21.15.123:0/3340155759 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdfdc004800 0x7fdff4144560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:04.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.775+0000 7fdff37fe640 1 -- 172.21.15.123:0/3340155759 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdfdc004800 msgr2=0x7fdff4144560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:04.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.775+0000 7fdff37fe640 1 --2- 172.21.15.123:0/3340155759 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdfdc004800 0x7fdff4144560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:04.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.775+0000 7fdff37fe640 1 -- 172.21.15.123:0/3340155759 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdff40c79a0 msgr2=0x7fdff40c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:04.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.775+0000 7fdff37fe640 1 --2- 172.21.15.123:0/3340155759 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdff40c79a0 0x7fdff40c7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:04.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.775+0000 7fdff37fe640 1 -- 172.21.15.123:0/3340155759 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff40c83f0 con 0x7fdff4156230 2024-09-15T23:21:04.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.775+0000 7fdff27fc640 1 --2- 172.21.15.123:0/3340155759 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdff40c79a0 0x7fdff40c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:21:04.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.775+0000 7fdff2ffd640 1 --2- 172.21.15.123:0/3340155759 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdfdc004800 0x7fdff4144560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:21:04.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.775+0000 7fdff37fe640 1 --2- 172.21.15.123:0/3340155759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdff4156230 0x7fdff4156670 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7fdff40d0950 tx=0x7fdfec00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:04.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.775+0000 7fdfdb7fe640 1 -- 172.21.15.123:0/3340155759 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfec019070 con 0x7fdff4156230 2024-09-15T23:21:04.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.775+0000 7fdfdb7fe640 1 -- 172.21.15.123:0/3340155759 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfec00c5b0 con 0x7fdff4156230 2024-09-15T23:21:04.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.775+0000 7fdff9723640 1 -- 172.21.15.123:0/3340155759 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdff40c86d0 con 0x7fdff4156230 2024-09-15T23:21:04.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.775+0000 7fdfdb7fe640 1 -- 172.21.15.123:0/3340155759 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfec00c980 con 0x7fdff4156230 2024-09-15T23:21:04.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.775+0000 7fdff9723640 1 -- 172.21.15.123:0/3340155759 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdff40c8c90 con 0x7fdff4156230 2024-09-15T23:21:04.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.776+0000 7fdff9723640 1 -- 172.21.15.123:0/3340155759 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdff4145690 con 0x7fdff4156230 2024-09-15T23:21:04.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.777+0000 7fdfdb7fe640 1 -- 172.21.15.123:0/3340155759 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdfec00cb20 con 0x7fdff4156230 2024-09-15T23:21:04.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.777+0000 7fdfdb7fe640 1 --2- 172.21.15.123:0/3340155759 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdfe006c2e0 0x7fdfe006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:04.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.777+0000 7fdfdb7fe640 1 -- 172.21.15.123:0/3340155759 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5767+0+0 (secure 0 0 0) 0x7fdfec08a600 con 0x7fdff4156230 2024-09-15T23:21:04.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.777+0000 7fdff2ffd640 1 --2- 172.21.15.123:0/3340155759 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdfe006c2e0 0x7fdfe006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:04.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.778+0000 7fdff2ffd640 1 --2- 172.21.15.123:0/3340155759 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdfe006c2e0 0x7fdfe006e7a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4013370 tx=0x7fdfe400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:04.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.782+0000 7fdfdb7fe640 1 -- 172.21.15.123:0/3340155759 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdfec058ca0 con 0x7fdff4156230 2024-09-15T23:21:04.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.981+0000 7fdff9723640 1 -- 172.21.15.123:0/3340155759 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdff406bc10 con 0x7fdff4156230 2024-09-15T23:21:04.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.981+0000 7fdfdb7fe640 1 -- 172.21.15.123:0/3340155759 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5236 (secure 0 0 0) 0x7fdfec0585a0 con 0x7fdff4156230 2024-09-15T23:21:04.983 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:04.983 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":93,"btime":"2024-09-15T23:20:31:301251+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7735,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/3725440007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3725440007},{"type":"v1","addr":"172.21.15.188:6836","nonce":3725440007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7738,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2908220643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2908220643},{"type":"v1","addr":"172.21.15.188:6837","nonce":2908220643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":9003,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2302544827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2302544827},{"type":"v1","addr":"172.21.15.123:6834","nonce":2302544827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:20:28.532639+0000","modified":"2024-09-15T23:20:30.630141+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9006":{"gid":9006,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/627322542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":627322542},{"type":"v1","addr":"172.21.15.123:6835","nonce":627322542}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9006,"qdb_cluster":[9006]},"id":10}]} 2024-09-15T23:21:04.983 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 93 2024-09-15T23:21:04.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.983+0000 7fdff9723640 1 -- 172.21.15.123:0/3340155759 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdfe006c2e0 msgr2=0x7fdfe006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:04.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.983+0000 7fdff9723640 1 --2- 172.21.15.123:0/3340155759 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdfe006c2e0 0x7fdfe006e7a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4013370 tx=0x7fdfe400b040 comp rx=0 tx=0).stop 2024-09-15T23:21:04.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.983+0000 7fdff9723640 1 -- 172.21.15.123:0/3340155759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdff4156230 msgr2=0x7fdff4156670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:04.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.983+0000 7fdff9723640 1 --2- 172.21.15.123:0/3340155759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdff4156230 0x7fdff4156670 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7fdff40d0950 tx=0x7fdfec00eb90 comp rx=0 tx=0).stop 2024-09-15T23:21:04.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.983+0000 7fdff9723640 1 -- 172.21.15.123:0/3340155759 shutdown_connections 2024-09-15T23:21:04.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.983+0000 7fdff9723640 1 --2- 172.21.15.123:0/3340155759 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdfe006c2e0 0x7fdfe006e7a0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:04.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.983+0000 7fdff9723640 1 --2- 172.21.15.123:0/3340155759 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdff4156230 0x7fdff4156670 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:04.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.983+0000 7fdff9723640 1 --2- 172.21.15.123:0/3340155759 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdff40c79a0 0x7fdff40c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:04.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.983+0000 7fdff9723640 1 --2- 172.21.15.123:0/3340155759 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdfdc004800 0x7fdff4144560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:04.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.983+0000 7fdff9723640 1 -- 172.21.15.123:0/3340155759 >> 172.21.15.123:0/3340155759 conn(0x7fdff406cd20 msgr2=0x7fdff4143be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:04.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.983+0000 7fdff9723640 1 -- 172.21.15.123:0/3340155759 shutdown_connections 2024-09-15T23:21:04.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:04.983+0000 7fdff9723640 1 -- 172.21.15.123:0/3340155759 wait complete. 2024-09-15T23:21:04.995 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:21:05.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.092+0000 7fbc09c77640 1 Processor -- start 2024-09-15T23:21:05.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.092+0000 7fbc09c77640 1 -- start start 2024-09-15T23:21:05.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.093+0000 7fbc09c77640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc04073890 0x7fbc040b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:05.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.093+0000 7fbc09c77640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc040b4020 con 0x7fbc04145ed0 2024-09-15T23:21:05.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.093+0000 7fbc09c77640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc040b42c0 con 0x7fbc040b5880 2024-09-15T23:21:05.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.093+0000 7fbc09c77640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbc040b45a0 con 0x7fbc04073890 2024-09-15T23:21:05.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.093+0000 7fbc037fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fbc04145ed0 0x7fbc04073180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60144/0 (socket says 172.21.15.123:60144) 2024-09-15T23:21:05.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.093+0000 7fbc037fe640 1 -- 172.21.15.123:0/411577069 learned_addr learned my addr 172.21.15.123:0/411577069 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:21:05.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.093+0000 7fbc027fc640 1 -- 172.21.15.123:0/411577069 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1793993164 0 0) 0x7fbc040b4020 con 0x7fbc04145ed0 2024-09-15T23:21:05.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.093+0000 7fbc027fc640 1 -- 172.21.15.123:0/411577069 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbec003520 con 0x7fbc04145ed0 2024-09-15T23:21:05.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.093+0000 7fbc02ffd640 1 --2- 172.21.15.123:0/411577069 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc04073890 0x7fbc040b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:05.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.094+0000 7fbc027fc640 1 -- 172.21.15.123:0/411577069 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1412371229 0 0) 0x7fbbec003520 con 0x7fbc04145ed0 2024-09-15T23:21:05.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.094+0000 7fbc027fc640 1 -- 172.21.15.123:0/411577069 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc04073890 msgr2=0x7fbc040b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:05.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.094+0000 7fbc027fc640 1 --2- 172.21.15.123:0/411577069 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc04073890 0x7fbc040b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:05.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.094+0000 7fbc027fc640 1 -- 172.21.15.123:0/411577069 >> v1:172.21.15.188:6789/0 conn(0x7fbc040b5880 legacy=0x7fbc040b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:05.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.094+0000 7fbc027fc640 1 -- 172.21.15.123:0/411577069 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc040b4880 con 0x7fbc04145ed0 2024-09-15T23:21:05.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.094+0000 7fbc027fc640 1 -- 172.21.15.123:0/411577069 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fbbf40019f0 con 0x7fbc04145ed0 2024-09-15T23:21:05.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.094+0000 7fbc027fc640 1 -- 172.21.15.123:0/411577069 >> v1:172.21.15.123:6789/0 conn(0x7fbc04145ed0 legacy=0x7fbc04073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:05.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.094+0000 7fbc027fc640 1 --2- 172.21.15.123:0/411577069 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbec0039e0 0x7fbbec003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:05.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.094+0000 7fbc027fc640 1 --2- 172.21.15.123:0/411577069 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc04073890 0x7fbbec004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:05.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.094+0000 7fbc027fc640 1 --2- 172.21.15.123:0/411577069 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbec004d40 0x7fbbec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:05.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.094+0000 7fbc027fc640 1 -- 172.21.15.123:0/411577069 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbc040b45a0 con 0x7fbbec0039e0 2024-09-15T23:21:05.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.094+0000 7fbc027fc640 1 -- 172.21.15.123:0/411577069 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbbec00ba70 con 0x7fbbec004d40 2024-09-15T23:21:05.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.094+0000 7fbc027fc640 1 -- 172.21.15.123:0/411577069 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbbec00bc70 con 0x7fbc04073890 2024-09-15T23:21:05.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.094+0000 7fbc037fe640 1 --2- 172.21.15.123:0/411577069 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbec0039e0 0x7fbbec003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:05.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.094+0000 7fbc03fff640 1 --2- 172.21.15.123:0/411577069 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbec004d40 0x7fbbec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:05.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.094+0000 7fbc02ffd640 1 --2- 172.21.15.123:0/411577069 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc04073890 0x7fbbec004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:05.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.094+0000 7fbc037fe640 1 -- 172.21.15.123:0/411577069 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc04073890 msgr2=0x7fbbec004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:05.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.094+0000 7fbc037fe640 1 --2- 172.21.15.123:0/411577069 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc04073890 0x7fbbec004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:05.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.094+0000 7fbc037fe640 1 -- 172.21.15.123:0/411577069 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbec004d40 msgr2=0x7fbbec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:05.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.094+0000 7fbc037fe640 1 --2- 172.21.15.123:0/411577069 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbec004d40 0x7fbbec0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:05.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.094+0000 7fbc037fe640 1 -- 172.21.15.123:0/411577069 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbec003520 con 0x7fbbec0039e0 2024-09-15T23:21:05.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.095+0000 7fbc037fe640 1 --2- 172.21.15.123:0/411577069 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbec0039e0 0x7fbbec003e00 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fbbf400a810 tx=0x7fbbec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d51ad244537205f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:05.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.095+0000 7fbc027fc640 1 -- 172.21.15.123:0/411577069 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf400a460 con 0x7fbbec0039e0 2024-09-15T23:21:05.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.095+0000 7fbc027fc640 1 -- 172.21.15.123:0/411577069 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbf402f070 con 0x7fbbec0039e0 2024-09-15T23:21:05.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.095+0000 7fbc027fc640 1 -- 172.21.15.123:0/411577069 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf402bc90 con 0x7fbbec0039e0 2024-09-15T23:21:05.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.095+0000 7fbc09c77640 1 -- 172.21.15.123:0/411577069 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbec0039e0 msgr2=0x7fbbec003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:05.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.095+0000 7fbc09c77640 1 --2- 172.21.15.123:0/411577069 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbec0039e0 0x7fbbec003e00 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fbbf400a810 tx=0x7fbbec005830 comp rx=0 tx=0).stop 2024-09-15T23:21:05.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.095+0000 7fbc03fff640 1 -- 172.21.15.123:0/411577069 reap_dead start 2024-09-15T23:21:05.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.096+0000 7fbc09c77640 1 -- 172.21.15.123:0/411577069 shutdown_connections 2024-09-15T23:21:05.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.096+0000 7fbc09c77640 1 -- 172.21.15.123:0/411577069 >> 172.21.15.123:0/411577069 conn(0x7fbc040ccec0 msgr2=0x7fbc040cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:05.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.096+0000 7fbc09c77640 1 -- 172.21.15.123:0/411577069 shutdown_connections 2024-09-15T23:21:05.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.096+0000 7fbc09c77640 1 -- 172.21.15.123:0/411577069 wait complete. 2024-09-15T23:21:05.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.097+0000 7fbc09c77640 1 Processor -- start 2024-09-15T23:21:05.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.097+0000 7fbc09c77640 1 -- start start 2024-09-15T23:21:05.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.098+0000 7fbc09c77640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbec0039e0 0x7fbc040aa540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:05.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.098+0000 7fbc09c77640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc040c94d0 0x7fbc0415c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:05.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.098+0000 7fbc09c77640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc040acb80 0x7fbc040ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:05.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.098+0000 7fbc09c77640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbc04146430 con 0x7fbbec0039e0 2024-09-15T23:21:05.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.098+0000 7fbc09c77640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbc041462b0 con 0x7fbc040acb80 2024-09-15T23:21:05.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.098+0000 7fbc09c77640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbc040b5080 con 0x7fbc040c94d0 2024-09-15T23:21:05.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.098+0000 7fbc037fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbec0039e0 0x7fbc040aa540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:05.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.098+0000 7fbc037fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbec0039e0 0x7fbc040aa540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42872/0 (socket says 172.21.15.123:42872) 2024-09-15T23:21:05.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.098+0000 7fbc037fe640 1 -- 172.21.15.123:0/3381398621 learned_addr learned my addr 172.21.15.123:0/3381398621 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:05.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.098+0000 7fbc02ffd640 1 --2- 172.21.15.123:0/3381398621 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc040c94d0 0x7fbc0415c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:05.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.098+0000 7fbc03fff640 1 --2- 172.21.15.123:0/3381398621 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc040acb80 0x7fbc040ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:05.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.098+0000 7fbc037fe640 1 -- 172.21.15.123:0/3381398621 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc040c94d0 msgr2=0x7fbc0415c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:05.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.098+0000 7fbc037fe640 1 --2- 172.21.15.123:0/3381398621 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc040c94d0 0x7fbc0415c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:05.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.098+0000 7fbc037fe640 1 -- 172.21.15.123:0/3381398621 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc040acb80 msgr2=0x7fbc040ad000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:05.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.098+0000 7fbc037fe640 1 --2- 172.21.15.123:0/3381398621 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc040acb80 0x7fbc040ad000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:05.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.098+0000 7fbc037fe640 1 -- 172.21.15.123:0/3381398621 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc040c9950 con 0x7fbbec0039e0 2024-09-15T23:21:05.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.098+0000 7fbc037fe640 1 --2- 172.21.15.123:0/3381398621 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbec0039e0 0x7fbc040aa540 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fbbf400a810 tx=0x7fbc040c6400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:05.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.098+0000 7fbbebfff640 1 -- 172.21.15.123:0/3381398621 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4001fb0 con 0x7fbbec0039e0 2024-09-15T23:21:05.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.098+0000 7fbbebfff640 1 -- 172.21.15.123:0/3381398621 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbf4001250 con 0x7fbbec0039e0 2024-09-15T23:21:05.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.098+0000 7fbc09c77640 1 -- 172.21.15.123:0/3381398621 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc040c9be0 con 0x7fbbec0039e0 2024-09-15T23:21:05.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.098+0000 7fbbebfff640 1 -- 172.21.15.123:0/3381398621 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbf40348b0 con 0x7fbbec0039e0 2024-09-15T23:21:05.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.098+0000 7fbc09c77640 1 -- 172.21.15.123:0/3381398621 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc040ca1a0 con 0x7fbbec0039e0 2024-09-15T23:21:05.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.099+0000 7fbc09c77640 1 -- 172.21.15.123:0/3381398621 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc040b5380 con 0x7fbbec0039e0 2024-09-15T23:21:05.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.100+0000 7fbbebfff640 1 -- 172.21.15.123:0/3381398621 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbbf4034a50 con 0x7fbbec0039e0 2024-09-15T23:21:05.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.100+0000 7fbbebfff640 1 --2- 172.21.15.123:0/3381398621 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbbf006c2e0 0x7fbbf006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:05.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.100+0000 7fbbebfff640 1 -- 172.21.15.123:0/3381398621 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5767+0+0 (secure 0 0 0) 0x7fbbf40aba30 con 0x7fbbec0039e0 2024-09-15T23:21:05.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.100+0000 7fbc02ffd640 1 --2- 172.21.15.123:0/3381398621 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbbf006c2e0 0x7fbbf006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:05.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.101+0000 7fbc02ffd640 1 --2- 172.21.15.123:0/3381398621 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbbf006c2e0 0x7fbbf006e7a0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fbc04142b30 tx=0x7fbbf8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:05.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.104+0000 7fbbebfff640 1 -- 172.21.15.123:0/3381398621 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbbf404d020 con 0x7fbbec0039e0 2024-09-15T23:21:05.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.270+0000 7fbc09c77640 1 -- 172.21.15.123:0/3381398621 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbc040b5380 con 0x7fbbec0039e0 2024-09-15T23:21:05.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.271+0000 7fbbebfff640 1 -- 172.21.15.123:0/3381398621 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v156) ==== 74+0+16860 (secure 0 0 0) 0x7fbbf4079ba0 con 0x7fbbec0039e0 2024-09-15T23:21:05.272 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:05.272 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":156,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:20:57.374273+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:20:26.877919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-15T23:20:27.496332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.7","mappings":[{"from":2,"to":5}]},{"pgid":"21.16","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:21:05.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.273+0000 7fbc09c77640 1 -- 172.21.15.123:0/3381398621 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbbf006c2e0 msgr2=0x7fbbf006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:05.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.273+0000 7fbc09c77640 1 --2- 172.21.15.123:0/3381398621 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbbf006c2e0 0x7fbbf006e7a0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fbc04142b30 tx=0x7fbbf8008040 comp rx=0 tx=0).stop 2024-09-15T23:21:05.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.273+0000 7fbc09c77640 1 -- 172.21.15.123:0/3381398621 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbec0039e0 msgr2=0x7fbc040aa540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:05.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.273+0000 7fbc09c77640 1 --2- 172.21.15.123:0/3381398621 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbec0039e0 0x7fbc040aa540 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fbbf400a810 tx=0x7fbc040c6400 comp rx=0 tx=0).stop 2024-09-15T23:21:05.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.273+0000 7fbc09c77640 1 -- 172.21.15.123:0/3381398621 shutdown_connections 2024-09-15T23:21:05.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.273+0000 7fbc09c77640 1 --2- 172.21.15.123:0/3381398621 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc040acb80 0x7fbc040ad000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:05.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.273+0000 7fbc09c77640 1 --2- 172.21.15.123:0/3381398621 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc040c94d0 0x7fbc0415c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:05.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.273+0000 7fbc09c77640 1 --2- 172.21.15.123:0/3381398621 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbbf006c2e0 0x7fbbf006e7a0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:05.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.273+0000 7fbc09c77640 1 --2- 172.21.15.123:0/3381398621 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbec0039e0 0x7fbc040aa540 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:05.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.273+0000 7fbc09c77640 1 -- 172.21.15.123:0/3381398621 >> 172.21.15.123:0/3381398621 conn(0x7fbc040ccec0 msgr2=0x7fbc04073180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:05.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.273+0000 7fbc09c77640 1 -- 172.21.15.123:0/3381398621 shutdown_connections 2024-09-15T23:21:05.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.273+0000 7fbc09c77640 1 -- 172.21.15.123:0/3381398621 wait complete. 2024-09-15T23:21:05.285 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T23:21:05.286 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:21:05.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.383+0000 7fb69bc42640 1 Processor -- start 2024-09-15T23:21:05.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.383+0000 7fb69bc42640 1 -- start start 2024-09-15T23:21:05.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.384+0000 7fb69bc42640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb694073b70 0x7fb6940cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:05.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.384+0000 7fb69bc42640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb694073fc0 con 0x7fb6940716b0 2024-09-15T23:21:05.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.384+0000 7fb69bc42640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6940d1770 con 0x7fb69415c6b0 2024-09-15T23:21:05.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.384+0000 7fb69bc42640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb6940cdec0 con 0x7fb694073b70 2024-09-15T23:21:05.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.384+0000 7fb6991dd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb6940716b0 0x7fb6940ce2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60148/0 (socket says 172.21.15.123:60148) 2024-09-15T23:21:05.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.384+0000 7fb6991dd640 1 -- 172.21.15.123:0/1204186136 learned_addr learned my addr 172.21.15.123:0/1204186136 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:21:05.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.384+0000 7fb69a1df640 1 --2- 172.21.15.123:0/1204186136 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb694073b70 0x7fb6940cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:05.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.384+0000 7fb6989dc640 1 -- 172.21.15.123:0/1204186136 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3935239215 0 0) 0x7fb694073fc0 con 0x7fb6940716b0 2024-09-15T23:21:05.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.384+0000 7fb6989dc640 1 -- 172.21.15.123:0/1204186136 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb680003520 con 0x7fb6940716b0 2024-09-15T23:21:05.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.384+0000 7fb69a1df640 1 -- 172.21.15.123:0/1204186136 >> v1:172.21.15.188:6789/0 conn(0x7fb69415c6b0 legacy=0x7fb694070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:05.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.384+0000 7fb69a1df640 1 -- 172.21.15.123:0/1204186136 >> v1:172.21.15.123:6789/0 conn(0x7fb6940716b0 legacy=0x7fb6940ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:05.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.384+0000 7fb69a1df640 1 -- 172.21.15.123:0/1204186136 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6940d1a50 con 0x7fb694073b70 2024-09-15T23:21:05.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.385+0000 7fb69a1df640 1 --2- 172.21.15.123:0/1204186136 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb694073b70 0x7fb6940cea00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb68c009dc0 tx=0x7fb68c02a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=958b26526ed7b049 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:05.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.385+0000 7fb6989dc640 1 -- 172.21.15.123:0/1204186136 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c007740 con 0x7fb694073b70 2024-09-15T23:21:05.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.385+0000 7fb6989dc640 1 -- 172.21.15.123:0/1204186136 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb68c0078e0 con 0x7fb694073b70 2024-09-15T23:21:05.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.385+0000 7fb6989dc640 1 -- 172.21.15.123:0/1204186136 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c007c90 con 0x7fb694073b70 2024-09-15T23:21:05.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.386+0000 7fb69bc42640 1 -- 172.21.15.123:0/1204186136 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb694073b70 msgr2=0x7fb6940cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:05.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.386+0000 7fb69bc42640 1 --2- 172.21.15.123:0/1204186136 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb694073b70 0x7fb6940cea00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb68c009dc0 tx=0x7fb68c02a6d0 comp rx=0 tx=0).stop 2024-09-15T23:21:05.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.386+0000 7fb69bc42640 1 -- 172.21.15.123:0/1204186136 shutdown_connections 2024-09-15T23:21:05.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.386+0000 7fb69bc42640 1 --2- 172.21.15.123:0/1204186136 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb694073b70 0x7fb6940cea00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:05.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.386+0000 7fb69bc42640 1 -- 172.21.15.123:0/1204186136 >> 172.21.15.123:0/1204186136 conn(0x7fb6940b4300 msgr2=0x7fb6940b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:05.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.386+0000 7fb69bc42640 1 -- 172.21.15.123:0/1204186136 shutdown_connections 2024-09-15T23:21:05.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.386+0000 7fb69bc42640 1 -- 172.21.15.123:0/1204186136 wait complete. 2024-09-15T23:21:05.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.387+0000 7fb69bc42640 1 Processor -- start 2024-09-15T23:21:05.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.387+0000 7fb69bc42640 1 -- start start 2024-09-15T23:21:05.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.388+0000 7fb69bc42640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb6940716b0 0x7fb694156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:05.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.388+0000 7fb69bc42640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb694073b70 0x7fb69415f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:05.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.388+0000 7fb69bc42640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb69415c6b0 0x7fb69414abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:05.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.388+0000 7fb69bc42640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb69415ca90 con 0x7fb694073b70 2024-09-15T23:21:05.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.388+0000 7fb69bc42640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb6940d2010 con 0x7fb6940716b0 2024-09-15T23:21:05.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.388+0000 7fb69bc42640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb6940d22f0 con 0x7fb69415c6b0 2024-09-15T23:21:05.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.388+0000 7fb6991dd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb694073b70 0x7fb69415f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:05.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.388+0000 7fb6991dd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb694073b70 0x7fb69415f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42878/0 (socket says 172.21.15.123:42878) 2024-09-15T23:21:05.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.388+0000 7fb6991dd640 1 -- 172.21.15.123:0/3691564946 learned_addr learned my addr 172.21.15.123:0/3691564946 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:05.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.388+0000 7fb6999de640 1 --2- 172.21.15.123:0/3691564946 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb6940716b0 0x7fb694156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:05.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.388+0000 7fb69a1df640 1 --2- 172.21.15.123:0/3691564946 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb69415c6b0 0x7fb69414abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:05.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.389+0000 7fb6991dd640 1 -- 172.21.15.123:0/3691564946 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb69415c6b0 msgr2=0x7fb69414abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:05.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.389+0000 7fb6991dd640 1 --2- 172.21.15.123:0/3691564946 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb69415c6b0 0x7fb69414abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:05.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.389+0000 7fb6991dd640 1 -- 172.21.15.123:0/3691564946 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb6940716b0 msgr2=0x7fb694156850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:05.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.389+0000 7fb6991dd640 1 --2- 172.21.15.123:0/3691564946 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb6940716b0 0x7fb694156850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:05.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.389+0000 7fb6991dd640 1 -- 172.21.15.123:0/3691564946 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb69415fa20 con 0x7fb694073b70 2024-09-15T23:21:05.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.389+0000 7fb6991dd640 1 --2- 172.21.15.123:0/3691564946 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb694073b70 0x7fb69415f040 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7fb68400c500 tx=0x7fb68400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:05.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.389+0000 7fb68a7fc640 1 -- 172.21.15.123:0/3691564946 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb684017070 con 0x7fb694073b70 2024-09-15T23:21:05.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.389+0000 7fb68a7fc640 1 -- 172.21.15.123:0/3691564946 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb684005ce0 con 0x7fb694073b70 2024-09-15T23:21:05.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.389+0000 7fb68a7fc640 1 -- 172.21.15.123:0/3691564946 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb684007330 con 0x7fb694073b70 2024-09-15T23:21:05.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.389+0000 7fb69bc42640 1 -- 172.21.15.123:0/3691564946 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb69415cdd0 con 0x7fb694073b70 2024-09-15T23:21:05.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.389+0000 7fb69bc42640 1 -- 172.21.15.123:0/3691564946 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb69415d390 con 0x7fb694073b70 2024-09-15T23:21:05.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.390+0000 7fb69bc42640 1 -- 172.21.15.123:0/3691564946 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb69415d590 con 0x7fb694073b70 2024-09-15T23:21:05.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.390+0000 7fb68a7fc640 1 -- 172.21.15.123:0/3691564946 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb68401a070 con 0x7fb694073b70 2024-09-15T23:21:05.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.391+0000 7fb68a7fc640 1 --2- 172.21.15.123:0/3691564946 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb67806c2b0 0x7fb67806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:05.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.391+0000 7fb68a7fc640 1 -- 172.21.15.123:0/3691564946 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5767+0+0 (secure 0 0 0) 0x7fb68408a7a0 con 0x7fb694073b70 2024-09-15T23:21:05.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.391+0000 7fb6999de640 1 --2- 172.21.15.123:0/3691564946 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb67806c2b0 0x7fb67806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:05.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.392+0000 7fb6999de640 1 --2- 172.21.15.123:0/3691564946 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb67806c2b0 0x7fb67806e770 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fb690000f60 tx=0x7fb690009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:05.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.395+0000 7fb68a7fc640 1 -- 172.21.15.123:0/3691564946 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb69415d590 con 0x7fb694073b70 2024-09-15T23:21:05.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.594+0000 7fb69bc42640 1 -- 172.21.15.123:0/3691564946 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb69415fff0 con 0x7fb694073b70 2024-09-15T23:21:05.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.594+0000 7fb68a7fc640 1 -- 172.21.15.123:0/3691564946 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5236 (secure 0 0 0) 0x7fb6840589d0 con 0x7fb694073b70 2024-09-15T23:21:05.597 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:05.597 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":93,"btime":"2024-09-15T23:20:31:301251+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7735,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/3725440007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3725440007},{"type":"v1","addr":"172.21.15.188:6836","nonce":3725440007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7738,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2908220643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2908220643},{"type":"v1","addr":"172.21.15.188:6837","nonce":2908220643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":9003,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2302544827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2302544827},{"type":"v1","addr":"172.21.15.123:6834","nonce":2302544827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:20:28.532639+0000","modified":"2024-09-15T23:20:30.630141+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9006":{"gid":9006,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/627322542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":627322542},{"type":"v1","addr":"172.21.15.123:6835","nonce":627322542}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9006,"qdb_cluster":[9006]},"id":10}]} 2024-09-15T23:21:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 93 2024-09-15T23:21:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.596+0000 7fb69bc42640 1 -- 172.21.15.123:0/3691564946 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb67806c2b0 msgr2=0x7fb67806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.596+0000 7fb69bc42640 1 --2- 172.21.15.123:0/3691564946 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb67806c2b0 0x7fb67806e770 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fb690000f60 tx=0x7fb690009040 comp rx=0 tx=0).stop 2024-09-15T23:21:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.596+0000 7fb69bc42640 1 -- 172.21.15.123:0/3691564946 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb694073b70 msgr2=0x7fb69415f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.596+0000 7fb69bc42640 1 --2- 172.21.15.123:0/3691564946 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb694073b70 0x7fb69415f040 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7fb68400c500 tx=0x7fb68400c9c0 comp rx=0 tx=0).stop 2024-09-15T23:21:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.596+0000 7fb69bc42640 1 -- 172.21.15.123:0/3691564946 shutdown_connections 2024-09-15T23:21:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.596+0000 7fb69bc42640 1 --2- 172.21.15.123:0/3691564946 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb69415c6b0 0x7fb69414abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.596+0000 7fb69bc42640 1 --2- 172.21.15.123:0/3691564946 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb67806c2b0 0x7fb67806e770 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.596+0000 7fb69bc42640 1 --2- 172.21.15.123:0/3691564946 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb694073b70 0x7fb69415f040 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.596+0000 7fb69bc42640 1 --2- 172.21.15.123:0/3691564946 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb6940716b0 0x7fb694156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:05.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.596+0000 7fb69bc42640 1 -- 172.21.15.123:0/3691564946 >> 172.21.15.123:0/3691564946 conn(0x7fb6940b4300 msgr2=0x7fb694070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:05.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.596+0000 7fb69bc42640 1 -- 172.21.15.123:0/3691564946 shutdown_connections 2024-09-15T23:21:05.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.596+0000 7fb69bc42640 1 -- 172.21.15.123:0/3691564946 wait complete. 2024-09-15T23:21:05.608 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:21:05.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.705+0000 7f71d1023640 1 Processor -- start 2024-09-15T23:21:05.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.705+0000 7f71d1023640 1 -- start start 2024-09-15T23:21:05.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.706+0000 7f71d1023640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f71cc145ed0 0x7f71cc0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:05.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.706+0000 7f71d1023640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f71cc073180 0x7f71cc0735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:05.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.706+0000 7f71d1023640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f71cc0b5880 0x7f71cc0b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:05.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.706+0000 7f71d1023640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f71cc073b00 con 0x7f71cc145ed0 2024-09-15T23:21:05.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.706+0000 7f71d1023640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f71cc0b4020 con 0x7f71cc0b5880 2024-09-15T23:21:05.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.706+0000 7f71d1023640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f71cc0b42c0 con 0x7f71cc073180 2024-09-15T23:21:05.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.706+0000 7f71cad9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f71cc145ed0 0x7f71cc0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:05.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.706+0000 7f71cad9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f71cc145ed0 0x7f71cc0b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42884/0 (socket says 172.21.15.123:42884) 2024-09-15T23:21:05.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.706+0000 7f71cad9d640 1 -- 172.21.15.123:0/2808240174 learned_addr learned my addr 172.21.15.123:0/2808240174 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:05.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.706+0000 7f71c259c640 1 --2- 172.21.15.123:0/2808240174 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f71cc073180 0x7f71cc0735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:05.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.706+0000 7f71cad9d640 1 -- 172.21.15.123:0/2808240174 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f71cc073180 msgr2=0x7f71cc0735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:05.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.706+0000 7f71cad9d640 1 --2- 172.21.15.123:0/2808240174 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f71cc073180 0x7f71cc0735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:05.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.706+0000 7f71cad9d640 1 -- 172.21.15.123:0/2808240174 >> v2:172.21.15.188:3300/0 conn(0x7f71cc0b5880 msgr2=0x7f71cc0b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:05.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.706+0000 7f71cad9d640 1 --2- 172.21.15.123:0/2808240174 >> v2:172.21.15.188:3300/0 conn(0x7f71cc0b5880 0x7f71cc0b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:05.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.706+0000 7f71cad9d640 1 -- 172.21.15.123:0/2808240174 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71cc0b45a0 con 0x7f71cc145ed0 2024-09-15T23:21:05.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.707+0000 7f71cad9d640 1 --2- 172.21.15.123:0/2808240174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71cc145ed0 0x7f71cc0b5080 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0b28f0 tx=0x7f71bc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7a8fd41107547f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:05.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.707+0000 7f71ca59c640 1 -- 172.21.15.123:0/2808240174 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71bc037070 con 0x7f71cc145ed0 2024-09-15T23:21:05.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.707+0000 7f71ca59c640 1 -- 172.21.15.123:0/2808240174 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71bc032440 con 0x7f71cc145ed0 2024-09-15T23:21:05.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.707+0000 7f71ca59c640 1 -- 172.21.15.123:0/2808240174 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71bc032810 con 0x7f71cc145ed0 2024-09-15T23:21:05.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.707+0000 7f71d1023640 1 -- 172.21.15.123:0/2808240174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71cc145ed0 msgr2=0x7f71cc0b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:05.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.707+0000 7f71d1023640 1 --2- 172.21.15.123:0/2808240174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71cc145ed0 0x7f71cc0b5080 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0b28f0 tx=0x7f71bc02a1e0 comp rx=0 tx=0).stop 2024-09-15T23:21:05.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.708+0000 7f71d1023640 1 -- 172.21.15.123:0/2808240174 shutdown_connections 2024-09-15T23:21:05.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.708+0000 7f71d1023640 1 --2- 172.21.15.123:0/2808240174 >> v2:172.21.15.188:3300/0 conn(0x7f71cc0b5880 0x7f71cc0b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:05.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.708+0000 7f71d1023640 1 --2- 172.21.15.123:0/2808240174 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f71cc073180 0x7f71cc0735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:05.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.708+0000 7f71d1023640 1 --2- 172.21.15.123:0/2808240174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71cc145ed0 0x7f71cc0b5080 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:05.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.708+0000 7f71d1023640 1 -- 172.21.15.123:0/2808240174 >> 172.21.15.123:0/2808240174 conn(0x7f71cc0ccec0 msgr2=0x7f71cc0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:05.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.708+0000 7f71d1023640 1 -- 172.21.15.123:0/2808240174 shutdown_connections 2024-09-15T23:21:05.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.708+0000 7f71d1023640 1 -- 172.21.15.123:0/2808240174 wait complete. 2024-09-15T23:21:05.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.709+0000 7f71d1023640 1 Processor -- start 2024-09-15T23:21:05.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.709+0000 7f71d1023640 1 -- start start 2024-09-15T23:21:05.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.710+0000 7f71d1023640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f71cc073180 0x7f71cc15ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:05.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.710+0000 7f71d1023640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71cc0b5880 0x7f71cc158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:05.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.710+0000 7f71d1023640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f71cc145ed0 0x7f71cc142050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:05.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.710+0000 7f71d1023640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f71cc0b6250 con 0x7f71cc0b5880 2024-09-15T23:21:05.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.710+0000 7f71d1023640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f71cc0b4b60 con 0x7f71cc145ed0 2024-09-15T23:21:05.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.710+0000 7f71d1023640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f71cc0b63d0 con 0x7f71cc073180 2024-09-15T23:21:05.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.710+0000 7f71c259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71cc0b5880 0x7f71cc158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:05.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.710+0000 7f71c259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71cc0b5880 0x7f71cc158cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42900/0 (socket says 172.21.15.123:42900) 2024-09-15T23:21:05.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.710+0000 7f71c259c640 1 -- 172.21.15.123:0/2501061749 learned_addr learned my addr 172.21.15.123:0/2501061749 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:05.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.710+0000 7f71cad9d640 1 --2- 172.21.15.123:0/2501061749 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f71cc073180 0x7f71cc15ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:05.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.710+0000 7f71cb59e640 1 --2- 172.21.15.123:0/2501061749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f71cc145ed0 0x7f71cc142050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:05.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.710+0000 7f71c259c640 1 -- 172.21.15.123:0/2501061749 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f71cc073180 msgr2=0x7f71cc15ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:05.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.710+0000 7f71c259c640 1 --2- 172.21.15.123:0/2501061749 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f71cc073180 0x7f71cc15ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:05.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.710+0000 7f71c259c640 1 -- 172.21.15.123:0/2501061749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f71cc145ed0 msgr2=0x7f71cc142050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:05.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.710+0000 7f71c259c640 1 --2- 172.21.15.123:0/2501061749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f71cc145ed0 0x7f71cc142050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:05.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.710+0000 7f71c259c640 1 -- 172.21.15.123:0/2501061749 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71cc159a60 con 0x7f71cc0b5880 2024-09-15T23:21:05.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.710+0000 7f71cb59e640 1 --2- 172.21.15.123:0/2501061749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f71cc145ed0 0x7f71cc142050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:21:05.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.710+0000 7f71c259c640 1 --2- 172.21.15.123:0/2501061749 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71cc0b5880 0x7f71cc158cf0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f71b400d800 tx=0x7f71b400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:05.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.711+0000 7f71c3fff640 1 -- 172.21.15.123:0/2501061749 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b400b6c0 con 0x7f71cc0b5880 2024-09-15T23:21:05.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.711+0000 7f71c3fff640 1 -- 172.21.15.123:0/2501061749 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71b4019070 con 0x7f71cc0b5880 2024-09-15T23:21:05.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.711+0000 7f71d1023640 1 -- 172.21.15.123:0/2501061749 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71cc159d40 con 0x7f71cc0b5880 2024-09-15T23:21:05.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.711+0000 7f71c3fff640 1 -- 172.21.15.123:0/2501061749 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b400ba80 con 0x7f71cc0b5880 2024-09-15T23:21:05.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.711+0000 7f71d1023640 1 -- 172.21.15.123:0/2501061749 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71cc15a5e0 con 0x7f71cc0b5880 2024-09-15T23:21:05.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.711+0000 7f71d1023640 1 -- 172.21.15.123:0/2501061749 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71cc159f10 con 0x7f71cc0b5880 2024-09-15T23:21:05.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.712+0000 7f71c3fff640 1 -- 172.21.15.123:0/2501061749 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f71b400bc20 con 0x7f71cc0b5880 2024-09-15T23:21:05.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.712+0000 7f71c3fff640 1 --2- 172.21.15.123:0/2501061749 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f71ac06c2b0 0x7f71ac06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:05.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.712+0000 7f71c3fff640 1 -- 172.21.15.123:0/2501061749 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5767+0+0 (secure 0 0 0) 0x7f71b408b940 con 0x7f71cc0b5880 2024-09-15T23:21:05.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.713+0000 7f71cad9d640 1 --2- 172.21.15.123:0/2501061749 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f71ac06c2b0 0x7f71ac06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:05.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.713+0000 7f71cad9d640 1 --2- 172.21.15.123:0/2501061749 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f71ac06c2b0 0x7f71ac06e770 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f71bc034000 tx=0x7f71bc02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:05.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.717+0000 7f71c3fff640 1 -- 172.21.15.123:0/2501061749 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f71b405a070 con 0x7f71cc0b5880 2024-09-15T23:21:05.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.912+0000 7f71d1023640 1 -- 172.21.15.123:0/2501061749 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f71cc1462b0 con 0x7f71cc0b5880 2024-09-15T23:21:05.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.913+0000 7f71c3fff640 1 -- 172.21.15.123:0/2501061749 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5236 (secure 0 0 0) 0x7f71b4059970 con 0x7f71cc0b5880 2024-09-15T23:21:05.914 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:05.914 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":93,"btime":"2024-09-15T23:20:31:301251+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7735,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/3725440007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3725440007},{"type":"v1","addr":"172.21.15.188:6836","nonce":3725440007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7738,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2908220643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2908220643},{"type":"v1","addr":"172.21.15.188:6837","nonce":2908220643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":9003,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2302544827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2302544827},{"type":"v1","addr":"172.21.15.123:6834","nonce":2302544827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:20:28.532639+0000","modified":"2024-09-15T23:20:30.630141+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9006},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9006":{"gid":9006,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/627322542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":627322542},{"type":"v1","addr":"172.21.15.123:6835","nonce":627322542}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9006,"qdb_cluster":[9006]},"id":10}]} 2024-09-15T23:21:05.914 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 93 2024-09-15T23:21:05.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.915+0000 7f71d1023640 1 -- 172.21.15.123:0/2501061749 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f71ac06c2b0 msgr2=0x7f71ac06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:05.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.915+0000 7f71d1023640 1 --2- 172.21.15.123:0/2501061749 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f71ac06c2b0 0x7f71ac06e770 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f71bc034000 tx=0x7f71bc02e000 comp rx=0 tx=0).stop 2024-09-15T23:21:05.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.915+0000 7f71d1023640 1 -- 172.21.15.123:0/2501061749 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71cc0b5880 msgr2=0x7f71cc158cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:05.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.915+0000 7f71d1023640 1 --2- 172.21.15.123:0/2501061749 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71cc0b5880 0x7f71cc158cf0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f71b400d800 tx=0x7f71b400dcc0 comp rx=0 tx=0).stop 2024-09-15T23:21:05.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.915+0000 7f71d1023640 1 -- 172.21.15.123:0/2501061749 shutdown_connections 2024-09-15T23:21:05.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.915+0000 7f71d1023640 1 --2- 172.21.15.123:0/2501061749 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f71cc145ed0 0x7f71cc142050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:05.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.915+0000 7f71d1023640 1 --2- 172.21.15.123:0/2501061749 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f71ac06c2b0 0x7f71ac06e770 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:05.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.915+0000 7f71d1023640 1 --2- 172.21.15.123:0/2501061749 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71cc0b5880 0x7f71cc158cf0 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:05.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.915+0000 7f71d1023640 1 --2- 172.21.15.123:0/2501061749 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f71cc073180 0x7f71cc15ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:05.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.915+0000 7f71d1023640 1 -- 172.21.15.123:0/2501061749 >> 172.21.15.123:0/2501061749 conn(0x7f71cc0ccec0 msgr2=0x7f71cc0d0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:05.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.915+0000 7f71d1023640 1 -- 172.21.15.123:0/2501061749 shutdown_connections 2024-09-15T23:21:05.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:05.915+0000 7f71d1023640 1 -- 172.21.15.123:0/2501061749 wait complete. 2024-09-15T23:21:05.927 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:21:06.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.023+0000 7f9edbb52640 1 Processor -- start 2024-09-15T23:21:06.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.024+0000 7f9edbb52640 1 -- start start 2024-09-15T23:21:06.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.024+0000 7f9edbb52640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f9ed415ed20 0x7f9ed40b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:06.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.024+0000 7f9edbb52640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9ed40d23b0 0x7f9ed40b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:06.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.024+0000 7f9edbb52640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ed40d0e70 con 0x7f9ed40cf2d0 2024-09-15T23:21:06.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.024+0000 7f9edbb52640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f9ed40d41c0 con 0x7f9ed40d23b0 2024-09-15T23:21:06.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.024+0000 7f9edbb52640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f9ed40d35b0 con 0x7f9ed415ed20 2024-09-15T23:21:06.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.025+0000 7f9ed90ed640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9ed40d23b0 0x7f9ed40b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:06.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.025+0000 7f9eda0ef640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f9ed40cf2d0 0x7f9ed40cf700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60154/0 (socket says 172.21.15.123:60154) 2024-09-15T23:21:06.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.025+0000 7f9ed90ed640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9ed40d23b0 0x7f9ed40b67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42912/0 (socket says 172.21.15.123:42912) 2024-09-15T23:21:06.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.025+0000 7f9eda0ef640 1 -- 172.21.15.123:0/1444230916 learned_addr learned my addr 172.21.15.123:0/1444230916 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:21:06.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.025+0000 7f9ed98ee640 1 --2- 172.21.15.123:0/1444230916 >> v2:172.21.15.188:3300/0 conn(0x7f9ed415ed20 0x7f9ed40b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:06.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.025+0000 7f9ed90ed640 1 -- 172.21.15.123:0/1444230916 >> v2:172.21.15.188:3300/0 conn(0x7f9ed415ed20 msgr2=0x7f9ed40b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:06.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.025+0000 7f9ed90ed640 1 --2- 172.21.15.123:0/1444230916 >> v2:172.21.15.188:3300/0 conn(0x7f9ed415ed20 0x7f9ed40b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:06.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.025+0000 7f9ed90ed640 1 -- 172.21.15.123:0/1444230916 >> v1:172.21.15.123:6789/0 conn(0x7f9ed40cf2d0 legacy=0x7f9ed40cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:06.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.025+0000 7f9ed90ed640 1 -- 172.21.15.123:0/1444230916 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ed40d3890 con 0x7f9ed40d23b0 2024-09-15T23:21:06.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.025+0000 7f9ed88ec640 1 -- 172.21.15.123:0/1444230916 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2849830417 0 0) 0x7f9ecc001490 con 0x7f9ed40cf2d0 2024-09-15T23:21:06.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.026+0000 7f9ed90ed640 1 --2- 172.21.15.123:0/1444230916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ed40d23b0 0x7f9ed40b67a0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f9ed40d47b0 tx=0x7f9ec802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ddfa01a519299ed server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:06.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.026+0000 7f9ed88ec640 1 -- 172.21.15.123:0/1444230916 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec8037070 con 0x7f9ed40d23b0 2024-09-15T23:21:06.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.026+0000 7f9ed88ec640 1 -- 172.21.15.123:0/1444230916 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ec8032440 con 0x7f9ed40d23b0 2024-09-15T23:21:06.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.026+0000 7f9ed88ec640 1 -- 172.21.15.123:0/1444230916 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec802ae60 con 0x7f9ed40d23b0 2024-09-15T23:21:06.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.026+0000 7f9edbb52640 1 -- 172.21.15.123:0/1444230916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ed40d23b0 msgr2=0x7f9ed40b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:06.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.026+0000 7f9edbb52640 1 --2- 172.21.15.123:0/1444230916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ed40d23b0 0x7f9ed40b67a0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f9ed40d47b0 tx=0x7f9ec802a110 comp rx=0 tx=0).stop 2024-09-15T23:21:06.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.026+0000 7f9edbb52640 1 -- 172.21.15.123:0/1444230916 shutdown_connections 2024-09-15T23:21:06.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.026+0000 7f9edbb52640 1 --2- 172.21.15.123:0/1444230916 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ed40d23b0 0x7f9ed40b67a0 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:06.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.026+0000 7f9edbb52640 1 --2- 172.21.15.123:0/1444230916 >> v2:172.21.15.188:3300/0 conn(0x7f9ed415ed20 0x7f9ed40b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:06.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.026+0000 7f9edbb52640 1 -- 172.21.15.123:0/1444230916 >> 172.21.15.123:0/1444230916 conn(0x7f9ed40d1260 msgr2=0x7f9ed40d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:06.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.026+0000 7f9edbb52640 1 -- 172.21.15.123:0/1444230916 shutdown_connections 2024-09-15T23:21:06.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.026+0000 7f9edbb52640 1 -- 172.21.15.123:0/1444230916 wait complete. 2024-09-15T23:21:06.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.027+0000 7f9edbb52640 1 Processor -- start 2024-09-15T23:21:06.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.028+0000 7f9edbb52640 1 -- start start 2024-09-15T23:21:06.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.028+0000 7f9edbb52640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9ed40cf2d0 0x7f9ed415f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:06.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.028+0000 7f9edbb52640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9ed40d23b0 0x7f9ed40ce260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:06.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.028+0000 7f9edbb52640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ed415ed20 0x7f9ed4160f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:06.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.028+0000 7f9edbb52640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed40d32a0 con 0x7f9ed415ed20 2024-09-15T23:21:06.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.028+0000 7f9edbb52640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed40d3e50 con 0x7f9ed40cf2d0 2024-09-15T23:21:06.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.028+0000 7f9edbb52640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9ed415f100 con 0x7f9ed40d23b0 2024-09-15T23:21:06.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.028+0000 7f9eda0ef640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ed415ed20 0x7f9ed4160f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:06.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.028+0000 7f9eda0ef640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ed415ed20 0x7f9ed4160f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42922/0 (socket says 172.21.15.123:42922) 2024-09-15T23:21:06.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.028+0000 7f9eda0ef640 1 -- 172.21.15.123:0/1782800900 learned_addr learned my addr 172.21.15.123:0/1782800900 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:06.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.029+0000 7f9ed98ee640 1 --2- 172.21.15.123:0/1782800900 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9ed40cf2d0 0x7f9ed415f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:06.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.029+0000 7f9ed90ed640 1 --2- 172.21.15.123:0/1782800900 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9ed40d23b0 0x7f9ed40ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:06.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.029+0000 7f9eda0ef640 1 -- 172.21.15.123:0/1782800900 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9ed40d23b0 msgr2=0x7f9ed40ce260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:06.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.029+0000 7f9eda0ef640 1 --2- 172.21.15.123:0/1782800900 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9ed40d23b0 0x7f9ed40ce260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:06.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.029+0000 7f9eda0ef640 1 -- 172.21.15.123:0/1782800900 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9ed40cf2d0 msgr2=0x7f9ed415f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:06.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.029+0000 7f9eda0ef640 1 --2- 172.21.15.123:0/1782800900 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9ed40cf2d0 0x7f9ed415f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:06.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.029+0000 7f9eda0ef640 1 -- 172.21.15.123:0/1782800900 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ed40ce7a0 con 0x7f9ed415ed20 2024-09-15T23:21:06.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.029+0000 7f9ed98ee640 1 --2- 172.21.15.123:0/1782800900 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9ed40cf2d0 0x7f9ed415f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:21:06.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.029+0000 7f9eda0ef640 1 --2- 172.21.15.123:0/1782800900 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ed415ed20 0x7f9ed4160f40 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc00c700 tx=0x7f9ecc00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:06.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.029+0000 7f9ed27fc640 1 -- 172.21.15.123:0/1782800900 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc018070 con 0x7f9ed415ed20 2024-09-15T23:21:06.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.029+0000 7f9ed27fc640 1 -- 172.21.15.123:0/1782800900 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ecc00ce10 con 0x7f9ed415ed20 2024-09-15T23:21:06.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.029+0000 7f9ed27fc640 1 -- 172.21.15.123:0/1782800900 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc00a880 con 0x7f9ed415ed20 2024-09-15T23:21:06.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.029+0000 7f9edbb52640 1 -- 172.21.15.123:0/1782800900 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ed40b9210 con 0x7f9ed415ed20 2024-09-15T23:21:06.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.029+0000 7f9edbb52640 1 -- 172.21.15.123:0/1782800900 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ed40b97d0 con 0x7f9ed415ed20 2024-09-15T23:21:06.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.030+0000 7f9edbb52640 1 -- 172.21.15.123:0/1782800900 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ed40b7010 con 0x7f9ed415ed20 2024-09-15T23:21:06.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.030+0000 7f9ed27fc640 1 -- 172.21.15.123:0/1782800900 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9ecc01b070 con 0x7f9ed415ed20 2024-09-15T23:21:06.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.031+0000 7f9ed27fc640 1 --2- 172.21.15.123:0/1782800900 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9ec006c2b0 0x7f9ec006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:06.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.031+0000 7f9ed27fc640 1 -- 172.21.15.123:0/1782800900 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5767+0+0 (secure 0 0 0) 0x7f9ecc08a980 con 0x7f9ed415ed20 2024-09-15T23:21:06.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.031+0000 7f9ed98ee640 1 --2- 172.21.15.123:0/1782800900 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9ec006c2b0 0x7f9ec006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:06.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.032+0000 7f9ed98ee640 1 --2- 172.21.15.123:0/1782800900 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9ec006c2b0 0x7f9ec006e770 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4009ac0 tx=0x7f9ec4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:06.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.035+0000 7f9ed27fc640 1 -- 172.21.15.123:0/1782800900 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9ed40d0e70 con 0x7f9ed415ed20 2024-09-15T23:21:06.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.200+0000 7f9edbb52640 1 -- 172.21.15.123:0/1782800900 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9ed40d0a90 con 0x7f9ed415ed20 2024-09-15T23:21:06.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.201+0000 7f9ed27fc640 1 -- 172.21.15.123:0/1782800900 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v156) ==== 74+0+16860 (secure 0 0 0) 0x7f9ecc059140 con 0x7f9ed415ed20 2024-09-15T23:21:06.203 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:06.203 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":156,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:20:57.374273+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:20:26.877919+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-15T23:20:27.496332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.7","mappings":[{"from":2,"to":5}]},{"pgid":"21.16","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:21:06.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.204+0000 7f9edbb52640 1 -- 172.21.15.123:0/1782800900 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9ec006c2b0 msgr2=0x7f9ec006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:06.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.204+0000 7f9edbb52640 1 --2- 172.21.15.123:0/1782800900 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9ec006c2b0 0x7f9ec006e770 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4009ac0 tx=0x7f9ec4008040 comp rx=0 tx=0).stop 2024-09-15T23:21:06.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.204+0000 7f9edbb52640 1 -- 172.21.15.123:0/1782800900 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ed415ed20 msgr2=0x7f9ed4160f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:06.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.204+0000 7f9edbb52640 1 --2- 172.21.15.123:0/1782800900 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ed415ed20 0x7f9ed4160f40 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc00c700 tx=0x7f9ecc00cbc0 comp rx=0 tx=0).stop 2024-09-15T23:21:06.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.204+0000 7f9edbb52640 1 -- 172.21.15.123:0/1782800900 shutdown_connections 2024-09-15T23:21:06.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.204+0000 7f9edbb52640 1 --2- 172.21.15.123:0/1782800900 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9ec006c2b0 0x7f9ec006e770 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:06.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.204+0000 7f9edbb52640 1 --2- 172.21.15.123:0/1782800900 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ed415ed20 0x7f9ed4160f40 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:06.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.204+0000 7f9edbb52640 1 --2- 172.21.15.123:0/1782800900 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9ed40d23b0 0x7f9ed40ce260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:06.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.204+0000 7f9edbb52640 1 --2- 172.21.15.123:0/1782800900 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9ed40cf2d0 0x7f9ed415f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:06.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.204+0000 7f9edbb52640 1 -- 172.21.15.123:0/1782800900 >> 172.21.15.123:0/1782800900 conn(0x7f9ed40d1260 msgr2=0x7f9ed40b4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:06.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.204+0000 7f9edbb52640 1 -- 172.21.15.123:0/1782800900 shutdown_connections 2024-09-15T23:21:06.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.204+0000 7f9edbb52640 1 -- 172.21.15.123:0/1782800900 wait complete. 2024-09-15T23:21:06.216 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T23:21:06.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.314+0000 7f5dd459f640 1 Processor -- start 2024-09-15T23:21:06.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.314+0000 7f5dd459f640 1 -- start start 2024-09-15T23:21:06.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.315+0000 7f5dd459f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5dcc15b9a0 0x7f5dcc0b6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:06.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.315+0000 7f5dd459f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5dcc0b70a0 0x7f5dcc0cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:06.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.315+0000 7f5dd459f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dcc072930 con 0x7f5dcc158f80 2024-09-15T23:21:06.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.315+0000 7f5dd459f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f5dcc0b7510 con 0x7f5dcc15b9a0 2024-09-15T23:21:06.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.315+0000 7f5dd459f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5dcc0726d0 con 0x7f5dcc0b70a0 2024-09-15T23:21:06.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.316+0000 7f5dd1b3a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5dcc15b9a0 0x7f5dcc0b6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:06.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.316+0000 7f5dd1b3a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5dcc15b9a0 0x7f5dcc0b6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36114/0 (socket says 172.21.15.123:36114) 2024-09-15T23:21:06.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.316+0000 7f5dd1b3a640 1 -- 172.21.15.123:0/2390187036 learned_addr learned my addr 172.21.15.123:0/2390187036 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:06.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.316+0000 7f5dd2b3c640 1 --2- 172.21.15.123:0/2390187036 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5dcc0b70a0 0x7f5dcc0cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:06.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.316+0000 7f5dd1b3a640 1 -- 172.21.15.123:0/2390187036 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5dcc0b70a0 msgr2=0x7f5dcc0cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:06.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.316+0000 7f5dd1b3a640 1 --2- 172.21.15.123:0/2390187036 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5dcc0b70a0 0x7f5dcc0cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:06.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.316+0000 7f5dd1b3a640 1 -- 172.21.15.123:0/2390187036 >> v1:172.21.15.188:6789/0 conn(0x7f5dcc158f80 legacy=0x7f5dcc071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:06.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.316+0000 7f5dd1b3a640 1 -- 172.21.15.123:0/2390187036 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dcc072c10 con 0x7f5dcc15b9a0 2024-09-15T23:21:06.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.317+0000 7f5dd1b3a640 1 --2- 172.21.15.123:0/2390187036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5dcc15b9a0 0x7f5dcc0b6b60 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f5dc000bb40 tx=0x7f5dc002c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ccccea300f38016 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:06.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.317+0000 7f5dd1339640 1 -- 172.21.15.123:0/2390187036 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0036020 con 0x7f5dcc15b9a0 2024-09-15T23:21:06.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.317+0000 7f5dd1339640 1 -- 172.21.15.123:0/2390187036 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dc0032820 con 0x7f5dcc15b9a0 2024-09-15T23:21:06.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.317+0000 7f5dd1339640 1 -- 172.21.15.123:0/2390187036 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0032bf0 con 0x7f5dcc15b9a0 2024-09-15T23:21:06.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.317+0000 7f5dd459f640 1 -- 172.21.15.123:0/2390187036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5dcc15b9a0 msgr2=0x7f5dcc0b6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:06.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.317+0000 7f5dd459f640 1 --2- 172.21.15.123:0/2390187036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5dcc15b9a0 0x7f5dcc0b6b60 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f5dc000bb40 tx=0x7f5dc002c960 comp rx=0 tx=0).stop 2024-09-15T23:21:06.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.317+0000 7f5dd459f640 1 -- 172.21.15.123:0/2390187036 shutdown_connections 2024-09-15T23:21:06.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.317+0000 7f5dd459f640 1 --2- 172.21.15.123:0/2390187036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5dcc15b9a0 0x7f5dcc0b6b60 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:06.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.317+0000 7f5dd459f640 1 --2- 172.21.15.123:0/2390187036 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5dcc0b70a0 0x7f5dcc0cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:06.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.317+0000 7f5dd459f640 1 -- 172.21.15.123:0/2390187036 >> 172.21.15.123:0/2390187036 conn(0x7f5dcc06cd20 msgr2=0x7f5dcc06d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:06.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.317+0000 7f5dd459f640 1 -- 172.21.15.123:0/2390187036 shutdown_connections 2024-09-15T23:21:06.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.317+0000 7f5dd459f640 1 -- 172.21.15.123:0/2390187036 wait complete. 2024-09-15T23:21:06.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.318+0000 7f5dd459f640 1 Processor -- start 2024-09-15T23:21:06.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.319+0000 7f5dd459f640 1 -- start start 2024-09-15T23:21:06.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.319+0000 7f5dd459f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5dcc0b70a0 0x7f5dcc14ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:06.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.319+0000 7f5dd459f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5dcc158f80 0x7f5dcc0b4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:06.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.319+0000 7f5dd459f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5dcc15b9a0 0x7f5dcc0b5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:06.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.319+0000 7f5dd459f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc0734b0 con 0x7f5dcc0b70a0 2024-09-15T23:21:06.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.319+0000 7f5dd459f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc0731d0 con 0x7f5dcc15b9a0 2024-09-15T23:21:06.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.319+0000 7f5dd459f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5dcc0739d0 con 0x7f5dcc158f80 2024-09-15T23:21:06.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.319+0000 7f5dd233b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5dcc0b70a0 0x7f5dcc14ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:06.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.319+0000 7f5dd233b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5dcc0b70a0 0x7f5dcc14ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36122/0 (socket says 172.21.15.123:36122) 2024-09-15T23:21:06.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.319+0000 7f5dd233b640 1 -- 172.21.15.123:0/1905071973 learned_addr learned my addr 172.21.15.123:0/1905071973 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:06.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.319+0000 7f5dd2b3c640 1 --2- 172.21.15.123:0/1905071973 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5dcc15b9a0 0x7f5dcc0b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:06.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.319+0000 7f5dd1b3a640 1 --2- 172.21.15.123:0/1905071973 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5dcc158f80 0x7f5dcc0b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:06.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.320+0000 7f5dd233b640 1 -- 172.21.15.123:0/1905071973 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5dcc158f80 msgr2=0x7f5dcc0b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:06.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.320+0000 7f5dd233b640 1 --2- 172.21.15.123:0/1905071973 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5dcc158f80 0x7f5dcc0b4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:06.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.320+0000 7f5dd233b640 1 -- 172.21.15.123:0/1905071973 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5dcc15b9a0 msgr2=0x7f5dcc0b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:06.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.320+0000 7f5dd233b640 1 --2- 172.21.15.123:0/1905071973 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5dcc15b9a0 0x7f5dcc0b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:06.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.320+0000 7f5dd233b640 1 -- 172.21.15.123:0/1905071973 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dcc14f180 con 0x7f5dcc0b70a0 2024-09-15T23:21:06.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.320+0000 7f5dd1b3a640 1 --2- 172.21.15.123:0/1905071973 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5dcc158f80 0x7f5dcc0b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:21:06.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.320+0000 7f5dd233b640 1 --2- 172.21.15.123:0/1905071973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5dcc0b70a0 0x7f5dcc14ec40 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc00c7a0 tx=0x7f5dbc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:06.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.320+0000 7f5dcaffd640 1 -- 172.21.15.123:0/1905071973 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc003b90 con 0x7f5dcc0b70a0 2024-09-15T23:21:06.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.320+0000 7f5dcaffd640 1 -- 172.21.15.123:0/1905071973 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dbc003d50 con 0x7f5dcc0b70a0 2024-09-15T23:21:06.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.320+0000 7f5dd459f640 1 -- 172.21.15.123:0/1905071973 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dcc0b50e0 con 0x7f5dcc0b70a0 2024-09-15T23:21:06.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.320+0000 7f5dcaffd640 1 -- 172.21.15.123:0/1905071973 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc00aa90 con 0x7f5dcc0b70a0 2024-09-15T23:21:06.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.320+0000 7f5dd459f640 1 -- 172.21.15.123:0/1905071973 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dcc0b56a0 con 0x7f5dcc0b70a0 2024-09-15T23:21:06.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.321+0000 7f5dd459f640 1 -- 172.21.15.123:0/1905071973 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dcc0b6b60 con 0x7f5dcc0b70a0 2024-09-15T23:21:06.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.321+0000 7f5dcaffd640 1 -- 172.21.15.123:0/1905071973 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5dbc00ac30 con 0x7f5dcc0b70a0 2024-09-15T23:21:06.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.322+0000 7f5dcaffd640 1 --2- 172.21.15.123:0/1905071973 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5db806c2b0 0x7f5db806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:06.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.322+0000 7f5dcaffd640 1 -- 172.21.15.123:0/1905071973 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5767+0+0 (secure 0 0 0) 0x7f5dbc08b310 con 0x7f5dcc0b70a0 2024-09-15T23:21:06.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.322+0000 7f5dd1b3a640 1 --2- 172.21.15.123:0/1905071973 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5db806c2b0 0x7f5db806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:06.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.323+0000 7f5dd1b3a640 1 --2- 172.21.15.123:0/1905071973 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5db806c2b0 0x7f5db806e770 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0037000 tx=0x7f5dc0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:06.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.326+0000 7f5dcaffd640 1 -- 172.21.15.123:0/1905071973 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5dbc059a40 con 0x7f5dcc0b70a0 2024-09-15T23:21:06.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.525+0000 7f5dd459f640 1 -- 172.21.15.123:0/1905071973 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f5dcc150680 con 0x7f5dcc0b70a0 2024-09-15T23:21:06.526 INFO:tasks.ceph.mon.a.smithi123.stderr:2024-09-15T23:21:06.525+0000 7f8a6ccf0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:21:06.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.527+0000 7f5dcaffd640 1 -- 172.21.15.123:0/1905071973 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v94) ==== 161+0+0 (secure 0 0 0) 0x7f5dbc059340 con 0x7f5dcc0b70a0 2024-09-15T23:21:06.528 INFO:teuthology.orchestra.run.smithi123.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T23:21:06.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.529+0000 7f5dd459f640 1 -- 172.21.15.123:0/1905071973 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5db806c2b0 msgr2=0x7f5db806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:06.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.529+0000 7f5dd459f640 1 --2- 172.21.15.123:0/1905071973 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5db806c2b0 0x7f5db806e770 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0037000 tx=0x7f5dc0008040 comp rx=0 tx=0).stop 2024-09-15T23:21:06.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.529+0000 7f5dd459f640 1 -- 172.21.15.123:0/1905071973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5dcc0b70a0 msgr2=0x7f5dcc14ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:06.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.529+0000 7f5dd459f640 1 --2- 172.21.15.123:0/1905071973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5dcc0b70a0 0x7f5dcc14ec40 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc00c7a0 tx=0x7f5dbc00cc60 comp rx=0 tx=0).stop 2024-09-15T23:21:06.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.530+0000 7f5dd459f640 1 -- 172.21.15.123:0/1905071973 shutdown_connections 2024-09-15T23:21:06.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.530+0000 7f5dd459f640 1 --2- 172.21.15.123:0/1905071973 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5dcc15b9a0 0x7f5dcc0b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:06.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.530+0000 7f5dd459f640 1 --2- 172.21.15.123:0/1905071973 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5dcc158f80 0x7f5dcc0b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:06.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.530+0000 7f5dd459f640 1 --2- 172.21.15.123:0/1905071973 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5db806c2b0 0x7f5db806e770 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:06.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.530+0000 7f5dd459f640 1 --2- 172.21.15.123:0/1905071973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5dcc0b70a0 0x7f5dcc14ec40 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:06.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.530+0000 7f5dd459f640 1 -- 172.21.15.123:0/1905071973 >> 172.21.15.123:0/1905071973 conn(0x7f5dcc06cd20 msgr2=0x7f5dcc0b1950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:06.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.530+0000 7f5dd459f640 1 -- 172.21.15.123:0/1905071973 shutdown_connections 2024-09-15T23:21:06.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.530+0000 7f5dd459f640 1 -- 172.21.15.123:0/1905071973 wait complete. 2024-09-15T23:21:06.543 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T23:21:06.569 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-15T23:21:06.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.642+0000 7facccd0a640 1 Processor -- start 2024-09-15T23:21:06.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.642+0000 7facccd0a640 1 -- start start 2024-09-15T23:21:06.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.643+0000 7facccd0a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7facc80b38a0 0x7facc80d3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:06.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.643+0000 7facccd0a640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facc80cf710 con 0x7facc80b3350 2024-09-15T23:21:06.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.643+0000 7facccd0a640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facc80cf9f0 con 0x7facc806bfd0 2024-09-15T23:21:06.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.643+0000 7facccd0a640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7facc80b78a0 con 0x7facc80b38a0 2024-09-15T23:21:06.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.644+0000 7facc6d9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7facc80b38a0 0x7facc80d3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:06.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.644+0000 7facc5d9b640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7facc80b3350 0x7facc80d2920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51078/0 (socket says 172.21.15.123:51078) 2024-09-15T23:21:06.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.644+0000 7facc5d9b640 1 -- 172.21.15.123:0/662660105 learned_addr learned my addr 172.21.15.123:0/662660105 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:21:06.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.644+0000 7facc6d9d640 1 -- 172.21.15.123:0/662660105 >> v1:172.21.15.188:6789/0 conn(0x7facc806bfd0 legacy=0x7facc806c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:06.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.644+0000 7facc559a640 1 -- 172.21.15.123:0/662660105 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3315327333 0 0) 0x7facc80cf710 con 0x7facc80b3350 2024-09-15T23:21:06.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.644+0000 7facc6d9d640 1 -- 172.21.15.123:0/662660105 >> v1:172.21.15.123:6789/0 conn(0x7facc80b3350 legacy=0x7facc80d2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:06.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.644+0000 7facc6d9d640 1 -- 172.21.15.123:0/662660105 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc80cfcd0 con 0x7facc80b38a0 2024-09-15T23:21:06.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.645+0000 7facc6d9d640 1 --2- 172.21.15.123:0/662660105 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facc80b38a0 0x7facc80d3030 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7facc00097a0 tx=0x7facc002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=635530c24e950c36 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:06.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.645+0000 7facc559a640 1 -- 172.21.15.123:0/662660105 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc0037070 con 0x7facc80b38a0 2024-09-15T23:21:06.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.645+0000 7facc559a640 1 -- 172.21.15.123:0/662660105 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facc0032440 con 0x7facc80b38a0 2024-09-15T23:21:06.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.645+0000 7facc559a640 1 -- 172.21.15.123:0/662660105 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc0032810 con 0x7facc80b38a0 2024-09-15T23:21:06.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.645+0000 7facccd0a640 1 -- 172.21.15.123:0/662660105 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facc80b38a0 msgr2=0x7facc80d3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:06.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.645+0000 7facccd0a640 1 --2- 172.21.15.123:0/662660105 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facc80b38a0 0x7facc80d3030 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7facc00097a0 tx=0x7facc002a270 comp rx=0 tx=0).stop 2024-09-15T23:21:06.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.645+0000 7facccd0a640 1 -- 172.21.15.123:0/662660105 shutdown_connections 2024-09-15T23:21:06.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.645+0000 7facccd0a640 1 --2- 172.21.15.123:0/662660105 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facc80b38a0 0x7facc80d3030 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:06.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.645+0000 7facccd0a640 1 -- 172.21.15.123:0/662660105 >> 172.21.15.123:0/662660105 conn(0x7facc80d11c0 msgr2=0x7facc80d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:06.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.645+0000 7facccd0a640 1 -- 172.21.15.123:0/662660105 shutdown_connections 2024-09-15T23:21:06.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.645+0000 7facccd0a640 1 -- 172.21.15.123:0/662660105 wait complete. 2024-09-15T23:21:06.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.647+0000 7facccd0a640 1 Processor -- start 2024-09-15T23:21:06.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.647+0000 7facccd0a640 1 -- start start 2024-09-15T23:21:06.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.648+0000 7facccd0a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7facc806bfd0 0x7facc81e7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:06.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.648+0000 7facccd0a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facc80b3350 0x7facc80cac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:06.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.648+0000 7facccd0a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facc80b38a0 0x7facc8160840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:06.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.648+0000 7facccd0a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7facc806cd50 con 0x7facc80b3350 2024-09-15T23:21:06.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.648+0000 7facccd0a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7facc80cffb0 con 0x7facc80b38a0 2024-09-15T23:21:06.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.648+0000 7facccd0a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7facc815eae0 con 0x7facc806bfd0 2024-09-15T23:21:06.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.648+0000 7facc5d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facc80b3350 0x7facc80cac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:06.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.648+0000 7facc5d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facc80b3350 0x7facc80cac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36150/0 (socket says 172.21.15.123:36150) 2024-09-15T23:21:06.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.648+0000 7facc5d9b640 1 -- 172.21.15.123:0/1739976551 learned_addr learned my addr 172.21.15.123:0/1739976551 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:06.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.648+0000 7facc6d9d640 1 --2- 172.21.15.123:0/1739976551 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facc80b38a0 0x7facc8160840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:06.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.648+0000 7facc659c640 1 --2- 172.21.15.123:0/1739976551 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7facc806bfd0 0x7facc81e7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:06.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.648+0000 7facc5d9b640 1 -- 172.21.15.123:0/1739976551 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7facc806bfd0 msgr2=0x7facc81e7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:06.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.648+0000 7facc5d9b640 1 --2- 172.21.15.123:0/1739976551 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7facc806bfd0 0x7facc81e7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:06.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.648+0000 7facc5d9b640 1 -- 172.21.15.123:0/1739976551 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facc80b38a0 msgr2=0x7facc8160840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:06.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.648+0000 7facc5d9b640 1 --2- 172.21.15.123:0/1739976551 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facc80b38a0 0x7facc8160840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:06.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.648+0000 7facc5d9b640 1 -- 172.21.15.123:0/1739976551 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facc80c88e0 con 0x7facc80b3350 2024-09-15T23:21:06.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.648+0000 7facc659c640 1 --2- 172.21.15.123:0/1739976551 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7facc806bfd0 0x7facc81e7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:21:06.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.648+0000 7facc5d9b640 1 --2- 172.21.15.123:0/1739976551 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facc80b3350 0x7facc80cac80 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7facbc00c4d0 tx=0x7facbc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:06.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.648+0000 7facb6ffd640 1 -- 172.21.15.123:0/1739976551 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facbc018070 con 0x7facc80b3350 2024-09-15T23:21:06.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.648+0000 7facb6ffd640 1 -- 172.21.15.123:0/1739976551 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facbc007500 con 0x7facc80b3350 2024-09-15T23:21:06.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.648+0000 7facb6ffd640 1 -- 172.21.15.123:0/1739976551 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facbc004a20 con 0x7facc80b3350 2024-09-15T23:21:06.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.648+0000 7facccd0a640 1 -- 172.21.15.123:0/1739976551 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facc80c8b60 con 0x7facc80b3350 2024-09-15T23:21:06.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.648+0000 7facccd0a640 1 -- 172.21.15.123:0/1739976551 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facc81e8860 con 0x7facc80b3350 2024-09-15T23:21:06.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.649+0000 7facccd0a640 1 -- 172.21.15.123:0/1739976551 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facc806c3b0 con 0x7facc80b3350 2024-09-15T23:21:06.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.650+0000 7facb6ffd640 1 -- 172.21.15.123:0/1739976551 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7facbc01b070 con 0x7facc80b3350 2024-09-15T23:21:06.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.650+0000 7facb6ffd640 1 --2- 172.21.15.123:0/1739976551 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7faca806c2b0 0x7faca806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:06.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.650+0000 7facb6ffd640 1 -- 172.21.15.123:0/1739976551 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5853+0+0 (secure 0 0 0) 0x7facbc08a760 con 0x7facc80b3350 2024-09-15T23:21:06.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.650+0000 7facc659c640 1 --2- 172.21.15.123:0/1739976551 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7faca806c2b0 0x7faca806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:06.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.651+0000 7facc659c640 1 --2- 172.21.15.123:0/1739976551 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7faca806c2b0 0x7faca806e770 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7facb80045b0 tx=0x7facb8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:06.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.655+0000 7facb6ffd640 1 -- 172.21.15.123:0/1739976551 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7facc80c88e0 con 0x7facc80b3350 2024-09-15T23:21:06.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:06.854+0000 7facccd0a640 1 -- 172.21.15.123:0/1739976551 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7facc80d0cf0 con 0x7facc80b3350 2024-09-15T23:21:07.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.530+0000 7facb6ffd640 1 -- 172.21.15.123:0/1739976551 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v95) ==== 104+0+0 (secure 0 0 0) 0x7facbc0587f0 con 0x7facc80b3350 2024-09-15T23:21:07.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.532+0000 7facccd0a640 1 -- 172.21.15.123:0/1739976551 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7faca806c2b0 msgr2=0x7faca806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:07.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.532+0000 7facccd0a640 1 --2- 172.21.15.123:0/1739976551 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7faca806c2b0 0x7faca806e770 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7facb80045b0 tx=0x7facb8009040 comp rx=0 tx=0).stop 2024-09-15T23:21:07.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.532+0000 7facccd0a640 1 -- 172.21.15.123:0/1739976551 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facc80b3350 msgr2=0x7facc80cac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:07.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.532+0000 7facccd0a640 1 --2- 172.21.15.123:0/1739976551 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facc80b3350 0x7facc80cac80 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7facbc00c4d0 tx=0x7facbc00c990 comp rx=0 tx=0).stop 2024-09-15T23:21:07.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.532+0000 7facccd0a640 1 -- 172.21.15.123:0/1739976551 shutdown_connections 2024-09-15T23:21:07.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.532+0000 7facccd0a640 1 --2- 172.21.15.123:0/1739976551 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facc80b38a0 0x7facc8160840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:07.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.532+0000 7facccd0a640 1 --2- 172.21.15.123:0/1739976551 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7faca806c2b0 0x7faca806e770 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:07.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.532+0000 7facccd0a640 1 --2- 172.21.15.123:0/1739976551 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facc80b3350 0x7facc80cac80 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:07.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.532+0000 7facccd0a640 1 --2- 172.21.15.123:0/1739976551 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7facc806bfd0 0x7facc81e7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:07.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.532+0000 7facccd0a640 1 -- 172.21.15.123:0/1739976551 >> 172.21.15.123:0/1739976551 conn(0x7facc80d11c0 msgr2=0x7facc80b5820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:07.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.532+0000 7facccd0a640 1 -- 172.21.15.123:0/1739976551 shutdown_connections 2024-09-15T23:21:07.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.532+0000 7facccd0a640 1 -- 172.21.15.123:0/1739976551 wait complete. 2024-09-15T23:21:07.546 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T23:21:07.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.688+0000 7f6e2db42640 1 Processor -- start 2024-09-15T23:21:07.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.688+0000 7f6e2db42640 1 -- start start 2024-09-15T23:21:07.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.689+0000 7f6e2db42640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6e2815c520 0x7f6e280b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:07.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.689+0000 7f6e2db42640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e2815c900 con 0x7f6e280b63b0 2024-09-15T23:21:07.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.689+0000 7f6e2db42640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e280b55f0 con 0x7f6e280b7310 2024-09-15T23:21:07.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.689+0000 7f6e2db42640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f6e280b7760 con 0x7f6e2815c520 2024-09-15T23:21:07.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.689+0000 7f6e277fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6e2815c520 0x7f6e280b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:07.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.689+0000 7f6e277fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6e2815c520 0x7f6e280b41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36152/0 (socket says 172.21.15.123:36152) 2024-09-15T23:21:07.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.689+0000 7f6e26ffd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6e280b63b0 0x7f6e280b6c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51082/0 (socket says 172.21.15.123:51082) 2024-09-15T23:21:07.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.689+0000 7f6e277fe640 1 -- 172.21.15.123:0/2521879826 learned_addr learned my addr 172.21.15.123:0/2521879826 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:07.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.689+0000 7f6e277fe640 1 -- 172.21.15.123:0/2521879826 >> v1:172.21.15.188:6789/0 conn(0x7f6e280b7310 legacy=0x7f6e280d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:07.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.689+0000 7f6e277fe640 1 -- 172.21.15.123:0/2521879826 >> v1:172.21.15.123:6789/0 conn(0x7f6e280b63b0 legacy=0x7f6e280b6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:07.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.689+0000 7f6e277fe640 1 -- 172.21.15.123:0/2521879826 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e280b58d0 con 0x7f6e2815c520 2024-09-15T23:21:07.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.689+0000 7f6e267fc640 1 -- 172.21.15.123:0/2521879826 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 164802936 0 0) 0x7f6e2815c900 con 0x7f6e280b63b0 2024-09-15T23:21:07.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.690+0000 7f6e277fe640 1 --2- 172.21.15.123:0/2521879826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e2815c520 0x7f6e280b41e0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f6e18009870 tx=0x7f6e1802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911ab64c1d03f65a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:07.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.690+0000 7f6e267fc640 1 -- 172.21.15.123:0/2521879826 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e18037070 con 0x7f6e2815c520 2024-09-15T23:21:07.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.690+0000 7f6e267fc640 1 -- 172.21.15.123:0/2521879826 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e18032440 con 0x7f6e2815c520 2024-09-15T23:21:07.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.690+0000 7f6e267fc640 1 -- 172.21.15.123:0/2521879826 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e18032810 con 0x7f6e2815c520 2024-09-15T23:21:07.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.691+0000 7f6e2db42640 1 -- 172.21.15.123:0/2521879826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e2815c520 msgr2=0x7f6e280b41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:07.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.691+0000 7f6e2db42640 1 --2- 172.21.15.123:0/2521879826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e2815c520 0x7f6e280b41e0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f6e18009870 tx=0x7f6e1802a270 comp rx=0 tx=0).stop 2024-09-15T23:21:07.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.691+0000 7f6e2db42640 1 -- 172.21.15.123:0/2521879826 shutdown_connections 2024-09-15T23:21:07.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.691+0000 7f6e2db42640 1 --2- 172.21.15.123:0/2521879826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e2815c520 0x7f6e280b41e0 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:07.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.691+0000 7f6e2db42640 1 -- 172.21.15.123:0/2521879826 >> 172.21.15.123:0/2521879826 conn(0x7f6e28067950 msgr2=0x7f6e28067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:07.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.691+0000 7f6e2db42640 1 -- 172.21.15.123:0/2521879826 shutdown_connections 2024-09-15T23:21:07.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.691+0000 7f6e2db42640 1 -- 172.21.15.123:0/2521879826 wait complete. 2024-09-15T23:21:07.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.692+0000 7f6e2db42640 1 Processor -- start 2024-09-15T23:21:07.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.692+0000 7f6e2db42640 1 -- start start 2024-09-15T23:21:07.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.693+0000 7f6e2db42640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6e280b63b0 0x7f6e28144e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:07.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.693+0000 7f6e2db42640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e280b7310 0x7f6e280b1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:07.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.693+0000 7f6e2db42640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e2815c520 0x7f6e28152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:07.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.693+0000 7f6e2db42640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6e280b7980 con 0x7f6e280b7310 2024-09-15T23:21:07.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.693+0000 7f6e2db42640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6e280b5e90 con 0x7f6e2815c520 2024-09-15T23:21:07.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.693+0000 7f6e2db42640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6e280b4720 con 0x7f6e280b63b0 2024-09-15T23:21:07.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.693+0000 7f6e26ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e280b7310 0x7f6e280b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:07.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.693+0000 7f6e26ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e280b7310 0x7f6e280b1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36162/0 (socket says 172.21.15.123:36162) 2024-09-15T23:21:07.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.693+0000 7f6e26ffd640 1 -- 172.21.15.123:0/3555867064 learned_addr learned my addr 172.21.15.123:0/3555867064 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:07.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.693+0000 7f6e27fff640 1 --2- 172.21.15.123:0/3555867064 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e2815c520 0x7f6e28152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:07.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.693+0000 7f6e277fe640 1 --2- 172.21.15.123:0/3555867064 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6e280b63b0 0x7f6e28144e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:07.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.693+0000 7f6e26ffd640 1 -- 172.21.15.123:0/3555867064 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6e280b63b0 msgr2=0x7f6e28144e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:07.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.693+0000 7f6e26ffd640 1 --2- 172.21.15.123:0/3555867064 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6e280b63b0 0x7f6e28144e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:07.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.693+0000 7f6e26ffd640 1 -- 172.21.15.123:0/3555867064 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e2815c520 msgr2=0x7f6e28152e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:07.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.693+0000 7f6e26ffd640 1 --2- 172.21.15.123:0/3555867064 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e2815c520 0x7f6e28152e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:07.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.693+0000 7f6e26ffd640 1 -- 172.21.15.123:0/3555867064 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e28151660 con 0x7f6e280b7310 2024-09-15T23:21:07.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.693+0000 7f6e26ffd640 1 --2- 172.21.15.123:0/3555867064 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e280b7310 0x7f6e280b1640 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c00c4a0 tx=0x7f6e1c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:07.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.693+0000 7f6e0ffff640 1 -- 172.21.15.123:0/3555867064 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c018070 con 0x7f6e280b7310 2024-09-15T23:21:07.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.693+0000 7f6e0ffff640 1 -- 172.21.15.123:0/3555867064 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e1c0074e0 con 0x7f6e280b7310 2024-09-15T23:21:07.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.693+0000 7f6e2db42640 1 -- 172.21.15.123:0/3555867064 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e28151940 con 0x7f6e280b7310 2024-09-15T23:21:07.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.693+0000 7f6e0ffff640 1 -- 172.21.15.123:0/3555867064 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c004a20 con 0x7f6e280b7310 2024-09-15T23:21:07.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.694+0000 7f6e2db42640 1 -- 172.21.15.123:0/3555867064 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e28151f00 con 0x7f6e280b7310 2024-09-15T23:21:07.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.694+0000 7f6e2db42640 1 -- 172.21.15.123:0/3555867064 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e280b4ab0 con 0x7f6e280b7310 2024-09-15T23:21:07.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.695+0000 7f6e0ffff640 1 -- 172.21.15.123:0/3555867064 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6e1c01b070 con 0x7f6e280b7310 2024-09-15T23:21:07.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.695+0000 7f6e0ffff640 1 --2- 172.21.15.123:0/3555867064 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6e1406c2b0 0x7f6e1406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:07.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.695+0000 7f6e0ffff640 1 -- 172.21.15.123:0/3555867064 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5853+0+0 (secure 0 0 0) 0x7f6e1c08a840 con 0x7f6e280b7310 2024-09-15T23:21:07.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.696+0000 7f6e277fe640 1 --2- 172.21.15.123:0/3555867064 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6e1406c2b0 0x7f6e1406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:07.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.696+0000 7f6e277fe640 1 --2- 172.21.15.123:0/3555867064 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6e1406c2b0 0x7f6e1406e770 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f6e18034000 tx=0x7f6e1802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:07.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.700+0000 7f6e0ffff640 1 -- 172.21.15.123:0/3555867064 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6e1c058f20 con 0x7f6e280b7310 2024-09-15T23:21:07.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:07.865+0000 7f6e2db42640 1 -- 172.21.15.123:0/3555867064 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6e280d2fe0 con 0x7f6e280b7310 2024-09-15T23:21:08.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.533+0000 7f6e0ffff640 1 -- 172.21.15.123:0/3555867064 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v158) ==== 181+0+0 (secure 0 0 0) 0x7f6e1c058820 con 0x7f6e280b7310 2024-09-15T23:21:08.534 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' removed 2024-09-15T23:21:08.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.535+0000 7f6e2db42640 1 -- 172.21.15.123:0/3555867064 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6e1406c2b0 msgr2=0x7f6e1406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:08.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.535+0000 7f6e2db42640 1 --2- 172.21.15.123:0/3555867064 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6e1406c2b0 0x7f6e1406e770 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f6e18034000 tx=0x7f6e1802e000 comp rx=0 tx=0).stop 2024-09-15T23:21:08.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.535+0000 7f6e2db42640 1 -- 172.21.15.123:0/3555867064 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e280b7310 msgr2=0x7f6e280b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:08.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.535+0000 7f6e2db42640 1 --2- 172.21.15.123:0/3555867064 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e280b7310 0x7f6e280b1640 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c00c4a0 tx=0x7f6e1c00c960 comp rx=0 tx=0).stop 2024-09-15T23:21:08.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.535+0000 7f6e2db42640 1 -- 172.21.15.123:0/3555867064 shutdown_connections 2024-09-15T23:21:08.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.535+0000 7f6e2db42640 1 --2- 172.21.15.123:0/3555867064 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6e2815c520 0x7f6e28152e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:08.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.535+0000 7f6e2db42640 1 --2- 172.21.15.123:0/3555867064 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6e1406c2b0 0x7f6e1406e770 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:08.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.535+0000 7f6e2db42640 1 --2- 172.21.15.123:0/3555867064 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6e280b7310 0x7f6e280b1640 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:08.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.535+0000 7f6e2db42640 1 --2- 172.21.15.123:0/3555867064 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6e280b63b0 0x7f6e28144e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:08.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.535+0000 7f6e2db42640 1 -- 172.21.15.123:0/3555867064 >> 172.21.15.123:0/3555867064 conn(0x7f6e28067950 msgr2=0x7f6e28067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:08.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.536+0000 7f6e2db42640 1 -- 172.21.15.123:0/3555867064 shutdown_connections 2024-09-15T23:21:08.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.536+0000 7f6e2db42640 1 -- 172.21.15.123:0/3555867064 wait complete. 2024-09-15T23:21:08.550 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T23:21:08.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.655+0000 7f9a1a465640 1 Processor -- start 2024-09-15T23:21:08.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.655+0000 7f9a1a465640 1 -- start start 2024-09-15T23:21:08.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.656+0000 7f9a1a465640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f9a1415ea90 0x7f9a140d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:08.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.656+0000 7f9a1a465640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9a140d40b0 0x7f9a140d0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:08.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.656+0000 7f9a1a465640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a140cf060 con 0x7f9a140d1510 2024-09-15T23:21:08.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.656+0000 7f9a1a465640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f9a140d34c0 con 0x7f9a1415ea90 2024-09-15T23:21:08.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.656+0000 7f9a1a465640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9a140d1960 con 0x7f9a140d40b0 2024-09-15T23:21:08.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.657+0000 7f9a137fe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9a140d40b0 0x7f9a140d0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:08.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.657+0000 7f9a18a02640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f9a140d1510 0x7f9a140b6210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:47876/0 (socket says 172.21.15.123:47876) 2024-09-15T23:21:08.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.657+0000 7f9a18a02640 1 -- 172.21.15.123:0/3377793398 learned_addr learned my addr 172.21.15.123:0/3377793398 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:21:08.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.657+0000 7f9a13fff640 1 --2- 172.21.15.123:0/3377793398 >> v2:172.21.15.188:3300/0 conn(0x7f9a1415ea90 0x7f9a140d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:08.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.657+0000 7f9a12ffd640 1 -- 172.21.15.123:0/3377793398 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1392901915 0 0) 0x7f9a140cf060 con 0x7f9a140d1510 2024-09-15T23:21:08.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.657+0000 7f9a137fe640 1 -- 172.21.15.123:0/3377793398 >> v2:172.21.15.188:3300/0 conn(0x7f9a1415ea90 msgr2=0x7f9a140d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:08.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.657+0000 7f9a137fe640 1 --2- 172.21.15.123:0/3377793398 >> v2:172.21.15.188:3300/0 conn(0x7f9a1415ea90 0x7f9a140d2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:08.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.657+0000 7f9a137fe640 1 -- 172.21.15.123:0/3377793398 >> v1:172.21.15.188:6789/0 conn(0x7f9a140d1510 legacy=0x7f9a140b6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:08.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.657+0000 7f9a137fe640 1 -- 172.21.15.123:0/3377793398 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a140cf340 con 0x7f9a140d40b0 2024-09-15T23:21:08.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.658+0000 7f9a137fe640 1 --2- 172.21.15.123:0/3377793398 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9a140d40b0 0x7f9a140d0fd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9a080097a0 tx=0x7f9a0802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc3fe3473bc86985 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:08.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.658+0000 7f9a12ffd640 1 -- 172.21.15.123:0/3377793398 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a08037070 con 0x7f9a140d40b0 2024-09-15T23:21:08.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.658+0000 7f9a12ffd640 1 -- 172.21.15.123:0/3377793398 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a08032440 con 0x7f9a140d40b0 2024-09-15T23:21:08.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.658+0000 7f9a12ffd640 1 -- 172.21.15.123:0/3377793398 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a08032810 con 0x7f9a140d40b0 2024-09-15T23:21:08.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.659+0000 7f9a1a465640 1 -- 172.21.15.123:0/3377793398 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9a140d40b0 msgr2=0x7f9a140d0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:08.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.659+0000 7f9a1a465640 1 --2- 172.21.15.123:0/3377793398 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9a140d40b0 0x7f9a140d0fd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9a080097a0 tx=0x7f9a0802a180 comp rx=0 tx=0).stop 2024-09-15T23:21:08.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.659+0000 7f9a1a465640 1 -- 172.21.15.123:0/3377793398 shutdown_connections 2024-09-15T23:21:08.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.659+0000 7f9a1a465640 1 --2- 172.21.15.123:0/3377793398 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9a140d40b0 0x7f9a140d0fd0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:08.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.659+0000 7f9a1a465640 1 --2- 172.21.15.123:0/3377793398 >> v2:172.21.15.188:3300/0 conn(0x7f9a1415ea90 0x7f9a140d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:08.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.659+0000 7f9a1a465640 1 -- 172.21.15.123:0/3377793398 >> 172.21.15.123:0/3377793398 conn(0x7f9a1406c0e0 msgr2=0x7f9a1406c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:08.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.659+0000 7f9a1a465640 1 -- 172.21.15.123:0/3377793398 shutdown_connections 2024-09-15T23:21:08.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.659+0000 7f9a1a465640 1 -- 172.21.15.123:0/3377793398 wait complete. 2024-09-15T23:21:08.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.660+0000 7f9a1a465640 1 Processor -- start 2024-09-15T23:21:08.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.660+0000 7f9a1a465640 1 -- start start 2024-09-15T23:21:08.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.661+0000 7f9a1a465640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a140d1510 0x7f9a14161b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:08.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.661+0000 7f9a1a465640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9a140d40b0 0x7f9a14160fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:08.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.661+0000 7f9a1a465640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9a1415ea90 0x7f9a140b62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:08.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.661+0000 7f9a1a465640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9a140cfbe0 con 0x7f9a140d1510 2024-09-15T23:21:08.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.661+0000 7f9a1a465640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9a140cf900 con 0x7f9a1415ea90 2024-09-15T23:21:08.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.661+0000 7f9a1a465640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9a1415ee70 con 0x7f9a140d40b0 2024-09-15T23:21:08.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.661+0000 7f9a13fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a140d1510 0x7f9a14161b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:08.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.661+0000 7f9a13fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a140d1510 0x7f9a14161b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36164/0 (socket says 172.21.15.123:36164) 2024-09-15T23:21:08.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.661+0000 7f9a13fff640 1 -- 172.21.15.123:0/3204877880 learned_addr learned my addr 172.21.15.123:0/3204877880 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:08.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.661+0000 7f9a137fe640 1 --2- 172.21.15.123:0/3204877880 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9a140d40b0 0x7f9a14160fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:08.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.661+0000 7f9a18a02640 1 --2- 172.21.15.123:0/3204877880 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9a1415ea90 0x7f9a140b62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:08.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.661+0000 7f9a13fff640 1 -- 172.21.15.123:0/3204877880 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9a140d40b0 msgr2=0x7f9a14160fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:08.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.661+0000 7f9a13fff640 1 --2- 172.21.15.123:0/3204877880 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9a140d40b0 0x7f9a14160fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:08.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.661+0000 7f9a13fff640 1 -- 172.21.15.123:0/3204877880 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9a1415ea90 msgr2=0x7f9a140b62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:08.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.661+0000 7f9a13fff640 1 --2- 172.21.15.123:0/3204877880 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9a1415ea90 0x7f9a140b62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:08.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.661+0000 7f9a13fff640 1 -- 172.21.15.123:0/3204877880 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a141f5a20 con 0x7f9a140d1510 2024-09-15T23:21:08.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.661+0000 7f9a13fff640 1 --2- 172.21.15.123:0/3204877880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a140d1510 0x7f9a14161b50 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f9a0400e870 tx=0x7f9a0400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:08.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.661+0000 7f9a10ff9640 1 -- 172.21.15.123:0/3204877880 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a04017070 con 0x7f9a140d1510 2024-09-15T23:21:08.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.661+0000 7f9a1a465640 1 -- 172.21.15.123:0/3204877880 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a141604c0 con 0x7f9a140d1510 2024-09-15T23:21:08.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.661+0000 7f9a10ff9640 1 -- 172.21.15.123:0/3204877880 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a0400c940 con 0x7f9a140d1510 2024-09-15T23:21:08.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.662+0000 7f9a10ff9640 1 -- 172.21.15.123:0/3204877880 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0400cd30 con 0x7f9a140d1510 2024-09-15T23:21:08.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.662+0000 7f9a1a465640 1 -- 172.21.15.123:0/3204877880 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a14160a80 con 0x7f9a140d1510 2024-09-15T23:21:08.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.663+0000 7f9a1a465640 1 -- 172.21.15.123:0/3204877880 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a140d0fd0 con 0x7f9a140d1510 2024-09-15T23:21:08.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.663+0000 7f9a10ff9640 1 -- 172.21.15.123:0/3204877880 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9a0401a070 con 0x7f9a140d1510 2024-09-15T23:21:08.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.663+0000 7f9a10ff9640 1 --2- 172.21.15.123:0/3204877880 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9a0006c2b0 0x7f9a0006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:08.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.664+0000 7f9a10ff9640 1 -- 172.21.15.123:0/3204877880 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5415+0+0 (secure 0 0 0) 0x7f9a0408b280 con 0x7f9a140d1510 2024-09-15T23:21:08.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.664+0000 7f9a137fe640 1 --2- 172.21.15.123:0/3204877880 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9a0006c2b0 0x7f9a0006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:08.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.664+0000 7f9a137fe640 1 --2- 172.21.15.123:0/3204877880 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9a0006c2b0 0x7f9a0006e770 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9a08034000 tx=0x7f9a0802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:08.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.668+0000 7f9a10ff9640 1 -- 172.21.15.123:0/3204877880 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9a04059a90 con 0x7f9a140d1510 2024-09-15T23:21:08.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:08.833+0000 7f9a1a465640 1 -- 172.21.15.123:0/3204877880 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9a140b9530 con 0x7f9a140d1510 2024-09-15T23:21:09.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.542+0000 7f9a10ff9640 1 -- 172.21.15.123:0/3204877880 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v159) ==== 169+0+0 (secure 0 0 0) 0x7f9a04059390 con 0x7f9a140d1510 2024-09-15T23:21:09.543 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' removed 2024-09-15T23:21:09.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.548+0000 7f9a1a465640 1 -- 172.21.15.123:0/3204877880 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9a0006c2b0 msgr2=0x7f9a0006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:09.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.548+0000 7f9a1a465640 1 --2- 172.21.15.123:0/3204877880 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9a0006c2b0 0x7f9a0006e770 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9a08034000 tx=0x7f9a0802e000 comp rx=0 tx=0).stop 2024-09-15T23:21:09.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.548+0000 7f9a1a465640 1 -- 172.21.15.123:0/3204877880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a140d1510 msgr2=0x7f9a14161b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:09.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.548+0000 7f9a1a465640 1 --2- 172.21.15.123:0/3204877880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a140d1510 0x7f9a14161b50 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f9a0400e870 tx=0x7f9a0400ed30 comp rx=0 tx=0).stop 2024-09-15T23:21:09.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.548+0000 7f9a1a465640 1 -- 172.21.15.123:0/3204877880 shutdown_connections 2024-09-15T23:21:09.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.548+0000 7f9a1a465640 1 --2- 172.21.15.123:0/3204877880 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9a1415ea90 0x7f9a140b62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:09.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.548+0000 7f9a1a465640 1 --2- 172.21.15.123:0/3204877880 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9a140d40b0 0x7f9a14160fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:09.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.548+0000 7f9a1a465640 1 --2- 172.21.15.123:0/3204877880 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9a0006c2b0 0x7f9a0006e770 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:09.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.548+0000 7f9a1a465640 1 --2- 172.21.15.123:0/3204877880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a140d1510 0x7f9a14161b50 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:09.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.548+0000 7f9a1a465640 1 -- 172.21.15.123:0/3204877880 >> 172.21.15.123:0/3204877880 conn(0x7f9a1406c0e0 msgr2=0x7f9a140c8280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:09.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.548+0000 7f9a1a465640 1 -- 172.21.15.123:0/3204877880 shutdown_connections 2024-09-15T23:21:09.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.549+0000 7f9a1a465640 1 -- 172.21.15.123:0/3204877880 wait complete. 2024-09-15T23:21:09.570 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T23:21:09.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.674+0000 7fbf0e81e640 1 Processor -- start 2024-09-15T23:21:09.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.674+0000 7fbf0e81e640 1 -- start start 2024-09-15T23:21:09.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.675+0000 7fbf0e81e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fbf080ccf30 0x7fbf080b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:09.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.675+0000 7fbf0e81e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbf080cead0 0x7fbf08071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:09.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.675+0000 7fbf0e81e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf080cf2e0 con 0x7fbf0815b7c0 2024-09-15T23:21:09.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.675+0000 7fbf0e81e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fbf08070fe0 con 0x7fbf080cead0 2024-09-15T23:21:09.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.675+0000 7fbf0e81e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fbf080712c0 con 0x7fbf080ccf30 2024-09-15T23:21:09.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.675+0000 7fbf0cdbb640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbf080cead0 0x7fbf08071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:09.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.675+0000 7fbf0cdbb640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbf080cead0 0x7fbf08071ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36168/0 (socket says 172.21.15.123:36168) 2024-09-15T23:21:09.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.675+0000 7fbf0cdbb640 1 -- 172.21.15.123:0/448076380 learned_addr learned my addr 172.21.15.123:0/448076380 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:09.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.675+0000 7fbf07fff640 1 --2- 172.21.15.123:0/448076380 >> v2:172.21.15.188:3300/0 conn(0x7fbf080ccf30 0x7fbf080b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:09.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.675+0000 7fbf0cdbb640 1 -- 172.21.15.123:0/448076380 >> v2:172.21.15.188:3300/0 conn(0x7fbf080ccf30 msgr2=0x7fbf080b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:09.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.675+0000 7fbf0cdbb640 1 --2- 172.21.15.123:0/448076380 >> v2:172.21.15.188:3300/0 conn(0x7fbf080ccf30 0x7fbf080b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:09.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.675+0000 7fbf0cdbb640 1 -- 172.21.15.123:0/448076380 >> v1:172.21.15.188:6789/0 conn(0x7fbf0815b7c0 legacy=0x7fbf080cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:09.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.675+0000 7fbf0cdbb640 1 -- 172.21.15.123:0/448076380 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf080715a0 con 0x7fbf080cead0 2024-09-15T23:21:09.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.676+0000 7fbf0cdbb640 1 --2- 172.21.15.123:0/448076380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf080cead0 0x7fbf08071ac0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7fbf0806f1c0 tx=0x7fbf0002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=711a1df90ee4d13c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:09.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.676+0000 7fbf06ffd640 1 -- 172.21.15.123:0/448076380 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf00036070 con 0x7fbf080cead0 2024-09-15T23:21:09.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.676+0000 7fbf06ffd640 1 -- 172.21.15.123:0/448076380 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf00031600 con 0x7fbf080cead0 2024-09-15T23:21:09.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.676+0000 7fbf06ffd640 1 -- 172.21.15.123:0/448076380 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf000319d0 con 0x7fbf080cead0 2024-09-15T23:21:09.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.676+0000 7fbf0e81e640 1 -- 172.21.15.123:0/448076380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf080cead0 msgr2=0x7fbf08071ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:09.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.676+0000 7fbf0e81e640 1 --2- 172.21.15.123:0/448076380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf080cead0 0x7fbf08071ac0 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7fbf0806f1c0 tx=0x7fbf0002a660 comp rx=0 tx=0).stop 2024-09-15T23:21:09.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.676+0000 7fbf0e81e640 1 -- 172.21.15.123:0/448076380 shutdown_connections 2024-09-15T23:21:09.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.676+0000 7fbf0e81e640 1 --2- 172.21.15.123:0/448076380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf080cead0 0x7fbf08071ac0 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:09.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.676+0000 7fbf0e81e640 1 --2- 172.21.15.123:0/448076380 >> v2:172.21.15.188:3300/0 conn(0x7fbf080ccf30 0x7fbf080b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:09.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.676+0000 7fbf0e81e640 1 -- 172.21.15.123:0/448076380 >> 172.21.15.123:0/448076380 conn(0x7fbf0806d0f0 msgr2=0x7fbf0806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:09.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.676+0000 7fbf0e81e640 1 -- 172.21.15.123:0/448076380 shutdown_connections 2024-09-15T23:21:09.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.676+0000 7fbf0e81e640 1 -- 172.21.15.123:0/448076380 wait complete. 2024-09-15T23:21:09.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.677+0000 7fbf0e81e640 1 Processor -- start 2024-09-15T23:21:09.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.678+0000 7fbf0e81e640 1 -- start start 2024-09-15T23:21:09.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.678+0000 7fbf0e81e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf080ccf30 0x7fbf08164dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:09.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.678+0000 7fbf0e81e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf080cead0 0x7fbf0814a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:09.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.678+0000 7fbf0e81e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf0815b7c0 0x7fbf0814ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:09.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.678+0000 7fbf0e81e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbf080cf080 con 0x7fbf080ccf30 2024-09-15T23:21:09.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.678+0000 7fbf0e81e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbf080cef00 con 0x7fbf080cead0 2024-09-15T23:21:09.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.678+0000 7fbf0e81e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbf08072000 con 0x7fbf0815b7c0 2024-09-15T23:21:09.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.678+0000 7fbf07fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf080ccf30 0x7fbf08164dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:09.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.679+0000 7fbf07fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf080ccf30 0x7fbf08164dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36186/0 (socket says 172.21.15.123:36186) 2024-09-15T23:21:09.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.679+0000 7fbf07fff640 1 -- 172.21.15.123:0/3650416262 learned_addr learned my addr 172.21.15.123:0/3650416262 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:09.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.679+0000 7fbf077fe640 1 --2- 172.21.15.123:0/3650416262 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf080cead0 0x7fbf0814a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:09.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.679+0000 7fbf0cdbb640 1 --2- 172.21.15.123:0/3650416262 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf0815b7c0 0x7fbf0814ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:09.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.679+0000 7fbf07fff640 1 -- 172.21.15.123:0/3650416262 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf0815b7c0 msgr2=0x7fbf0814ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:09.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.679+0000 7fbf07fff640 1 --2- 172.21.15.123:0/3650416262 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf0815b7c0 0x7fbf0814ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:09.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.679+0000 7fbf07fff640 1 -- 172.21.15.123:0/3650416262 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf080cead0 msgr2=0x7fbf0814a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:09.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.679+0000 7fbf07fff640 1 --2- 172.21.15.123:0/3650416262 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf080cead0 0x7fbf0814a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:09.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.679+0000 7fbf07fff640 1 -- 172.21.15.123:0/3650416262 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf081583f0 con 0x7fbf080ccf30 2024-09-15T23:21:09.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.679+0000 7fbf0cdbb640 1 --2- 172.21.15.123:0/3650416262 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf0815b7c0 0x7fbf0814ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:21:09.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.679+0000 7fbf07fff640 1 --2- 172.21.15.123:0/3650416262 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf080ccf30 0x7fbf08164dc0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7fbef800d830 tx=0x7fbef800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:09.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.679+0000 7fbf04ff9640 1 -- 172.21.15.123:0/3650416262 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef800b6c0 con 0x7fbf080ccf30 2024-09-15T23:21:09.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.679+0000 7fbf04ff9640 1 -- 172.21.15.123:0/3650416262 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbef8019070 con 0x7fbf080ccf30 2024-09-15T23:21:09.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.679+0000 7fbf0e81e640 1 -- 172.21.15.123:0/3650416262 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf0814d9b0 con 0x7fbf080ccf30 2024-09-15T23:21:09.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.679+0000 7fbf04ff9640 1 -- 172.21.15.123:0/3650416262 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef800ba80 con 0x7fbf080ccf30 2024-09-15T23:21:09.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.679+0000 7fbf0e81e640 1 -- 172.21.15.123:0/3650416262 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf08149a30 con 0x7fbf080ccf30 2024-09-15T23:21:09.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.680+0000 7fbf0e81e640 1 -- 172.21.15.123:0/3650416262 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf080b2c50 con 0x7fbf080ccf30 2024-09-15T23:21:09.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.681+0000 7fbf04ff9640 1 -- 172.21.15.123:0/3650416262 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbef801e460 con 0x7fbf080ccf30 2024-09-15T23:21:09.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.681+0000 7fbf04ff9640 1 --2- 172.21.15.123:0/3650416262 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbef406c2b0 0x7fbef406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:09.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.681+0000 7fbf04ff9640 1 -- 172.21.15.123:0/3650416262 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 4943+0+0 (secure 0 0 0) 0x7fbef808b740 con 0x7fbf080ccf30 2024-09-15T23:21:09.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.681+0000 7fbf077fe640 1 --2- 172.21.15.123:0/3650416262 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbef406c2b0 0x7fbef406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:09.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.682+0000 7fbf077fe640 1 --2- 172.21.15.123:0/3650416262 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbef406c2b0 0x7fbef406e770 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fbf08165890 tx=0x7fbefc009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:09.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.686+0000 7fbf04ff9640 1 -- 172.21.15.123:0/3650416262 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbef805a1b0 con 0x7fbf080ccf30 2024-09-15T23:21:09.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.852+0000 7fbf0e81e640 1 -- 172.21.15.123:0/3650416262 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fbf080cc960 con 0x7fbf080ccf30 2024-09-15T23:21:09.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.855+0000 7fbf04ff9640 1 -- 172.21.15.123:0/3650416262 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v41) ==== 104+0+0 (secure 0 0 0) 0x7fbef8059ab0 con 0x7fbf080ccf30 2024-09-15T23:21:09.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.858+0000 7fbf0e81e640 1 -- 172.21.15.123:0/3650416262 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbef406c2b0 msgr2=0x7fbef406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:09.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.858+0000 7fbf0e81e640 1 --2- 172.21.15.123:0/3650416262 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbef406c2b0 0x7fbef406e770 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fbf08165890 tx=0x7fbefc009060 comp rx=0 tx=0).stop 2024-09-15T23:21:09.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.858+0000 7fbf0e81e640 1 -- 172.21.15.123:0/3650416262 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf080ccf30 msgr2=0x7fbf08164dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:09.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.858+0000 7fbf0e81e640 1 --2- 172.21.15.123:0/3650416262 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf080ccf30 0x7fbf08164dc0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7fbef800d830 tx=0x7fbef800dcf0 comp rx=0 tx=0).stop 2024-09-15T23:21:09.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.858+0000 7fbf0e81e640 1 -- 172.21.15.123:0/3650416262 shutdown_connections 2024-09-15T23:21:09.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.858+0000 7fbf0e81e640 1 --2- 172.21.15.123:0/3650416262 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf0815b7c0 0x7fbf0814ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:09.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.858+0000 7fbf0e81e640 1 --2- 172.21.15.123:0/3650416262 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf080cead0 0x7fbf0814a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:09.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.858+0000 7fbf0e81e640 1 --2- 172.21.15.123:0/3650416262 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbef406c2b0 0x7fbef406e770 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:09.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.858+0000 7fbf0e81e640 1 --2- 172.21.15.123:0/3650416262 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf080ccf30 0x7fbf08164dc0 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:09.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.858+0000 7fbf0e81e640 1 -- 172.21.15.123:0/3650416262 >> 172.21.15.123:0/3650416262 conn(0x7fbf0806d0f0 msgr2=0x7fbf0814e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:09.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.858+0000 7fbf0e81e640 1 -- 172.21.15.123:0/3650416262 shutdown_connections 2024-09-15T23:21:09.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.858+0000 7fbf0e81e640 1 -- 172.21.15.123:0/3650416262 wait complete. 2024-09-15T23:21:09.869 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort' 2024-09-15T23:21:09.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.966+0000 7ffa214af640 1 Processor -- start 2024-09-15T23:21:09.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.966+0000 7ffa214af640 1 -- start start 2024-09-15T23:21:09.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.967+0000 7ffa214af640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ffa1c15ed20 0x7ffa1c0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:09.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.967+0000 7ffa214af640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa1c0d0e70 con 0x7ffa1c0b90e0 2024-09-15T23:21:09.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.967+0000 7ffa214af640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa1c0d00f0 con 0x7ffa1c0d23b0 2024-09-15T23:21:09.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.967+0000 7ffa214af640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7ffa1c0d41c0 con 0x7ffa1c15ed20 2024-09-15T23:21:09.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.967+0000 7ffa1b7fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ffa1c0b90e0 0x7ffa1c0cf9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51092/0 (socket says 172.21.15.123:51092) 2024-09-15T23:21:09.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.967+0000 7ffa1b7fe640 1 -- 172.21.15.123:0/4213924492 learned_addr learned my addr 172.21.15.123:0/4213924492 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:21:09.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.967+0000 7ffa1affd640 1 --2- 172.21.15.123:0/4213924492 >> v2:172.21.15.188:3300/0 conn(0x7ffa1c15ed20 0x7ffa1c0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:09.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.967+0000 7ffa1a7fc640 1 -- 172.21.15.123:0/4213924492 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2608629657 0 0) 0x7ffa14001490 con 0x7ffa1c0b90e0 2024-09-15T23:21:09.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.967+0000 7ffa1a7fc640 1 -- 172.21.15.123:0/4213924492 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa08003520 con 0x7ffa1c0b90e0 2024-09-15T23:21:09.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.968+0000 7ffa1a7fc640 1 -- 172.21.15.123:0/4213924492 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2204847841 0 0) 0x7ffa08003520 con 0x7ffa1c0b90e0 2024-09-15T23:21:09.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.968+0000 7ffa1a7fc640 1 -- 172.21.15.123:0/4213924492 >> v2:172.21.15.188:3300/0 conn(0x7ffa1c15ed20 msgr2=0x7ffa1c0b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:09.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.968+0000 7ffa1a7fc640 1 --2- 172.21.15.123:0/4213924492 >> v2:172.21.15.188:3300/0 conn(0x7ffa1c15ed20 0x7ffa1c0b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:09.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.968+0000 7ffa1a7fc640 1 -- 172.21.15.123:0/4213924492 >> v1:172.21.15.188:6789/0 conn(0x7ffa1c0d23b0 legacy=0x7ffa1c0cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:09.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.968+0000 7ffa1a7fc640 1 -- 172.21.15.123:0/4213924492 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa1c0d35b0 con 0x7ffa1c0b90e0 2024-09-15T23:21:09.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.968+0000 7ffa1a7fc640 1 -- 172.21.15.123:0/4213924492 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7ffa14001bc0 con 0x7ffa1c0b90e0 2024-09-15T23:21:09.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.968+0000 7ffa1affd640 1 --2- 172.21.15.123:0/4213924492 >> v2:172.21.15.188:3300/0 conn(0x7ffa1c15ed20 0x7ffa1c0b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:21:09.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.968+0000 7ffa1a7fc640 1 -- 172.21.15.123:0/4213924492 >> v1:172.21.15.123:6789/0 conn(0x7ffa1c0b90e0 legacy=0x7ffa1c0cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:09.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.968+0000 7ffa1a7fc640 1 --2- 172.21.15.123:0/4213924492 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa080039b0 0x7ffa08003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:09.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.968+0000 7ffa1a7fc640 1 --2- 172.21.15.123:0/4213924492 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa08004800 0x7ffa08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:09.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.968+0000 7ffa1a7fc640 1 --2- 172.21.15.123:0/4213924492 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa080051c0 0x7ffa0800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:09.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.968+0000 7ffa1a7fc640 1 -- 172.21.15.123:0/4213924492 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1c0d41c0 con 0x7ffa08004800 2024-09-15T23:21:09.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.968+0000 7ffa1a7fc640 1 -- 172.21.15.123:0/4213924492 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0800c160 con 0x7ffa080039b0 2024-09-15T23:21:09.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.968+0000 7ffa1a7fc640 1 -- 172.21.15.123:0/4213924492 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ffa0800c360 con 0x7ffa080051c0 2024-09-15T23:21:09.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.968+0000 7ffa13fff640 1 --2- 172.21.15.123:0/4213924492 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa08004800 0x7ffa08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:09.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.968+0000 7ffa1affd640 1 --2- 172.21.15.123:0/4213924492 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa080039b0 0x7ffa08003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:09.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.968+0000 7ffa1b7fe640 1 --2- 172.21.15.123:0/4213924492 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa080051c0 0x7ffa0800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:09.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.968+0000 7ffa13fff640 1 -- 172.21.15.123:0/4213924492 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa080051c0 msgr2=0x7ffa0800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:09.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.968+0000 7ffa13fff640 1 --2- 172.21.15.123:0/4213924492 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa080051c0 0x7ffa0800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:09.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.968+0000 7ffa13fff640 1 -- 172.21.15.123:0/4213924492 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa080039b0 msgr2=0x7ffa08003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:09.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.968+0000 7ffa13fff640 1 --2- 172.21.15.123:0/4213924492 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa080039b0 0x7ffa08003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:09.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.968+0000 7ffa13fff640 1 -- 172.21.15.123:0/4213924492 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa08003520 con 0x7ffa08004800 2024-09-15T23:21:09.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.968+0000 7ffa1b7fe640 1 -- 172.21.15.123:0/4213924492 reap_dead start 2024-09-15T23:21:09.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.969+0000 7ffa13fff640 1 --2- 172.21.15.123:0/4213924492 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa08004800 0x7ffa08004c80 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7ffa04001750 tx=0x7ffa08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0dc981d619d8193 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:09.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.969+0000 7ffa1a7fc640 1 -- 172.21.15.123:0/4213924492 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa04001370 con 0x7ffa08004800 2024-09-15T23:21:09.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.969+0000 7ffa1a7fc640 1 -- 172.21.15.123:0/4213924492 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa040052d0 con 0x7ffa08004800 2024-09-15T23:21:09.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.969+0000 7ffa1a7fc640 1 -- 172.21.15.123:0/4213924492 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0402abc0 con 0x7ffa08004800 2024-09-15T23:21:09.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.969+0000 7ffa214af640 1 -- 172.21.15.123:0/4213924492 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa08004800 msgr2=0x7ffa08004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:09.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.969+0000 7ffa214af640 1 --2- 172.21.15.123:0/4213924492 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa08004800 0x7ffa08004c80 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7ffa04001750 tx=0x7ffa08005830 comp rx=0 tx=0).stop 2024-09-15T23:21:09.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.970+0000 7ffa214af640 1 -- 172.21.15.123:0/4213924492 shutdown_connections 2024-09-15T23:21:09.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.970+0000 7ffa214af640 1 --2- 172.21.15.123:0/4213924492 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa08004800 0x7ffa08004c80 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:09.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.970+0000 7ffa214af640 1 -- 172.21.15.123:0/4213924492 >> 172.21.15.123:0/4213924492 conn(0x7ffa1c0d1260 msgr2=0x7ffa1c0d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:09.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.970+0000 7ffa214af640 1 -- 172.21.15.123:0/4213924492 shutdown_connections 2024-09-15T23:21:09.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.970+0000 7ffa214af640 1 -- 172.21.15.123:0/4213924492 wait complete. 2024-09-15T23:21:09.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.971+0000 7ffa214af640 1 Processor -- start 2024-09-15T23:21:09.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.971+0000 7ffa214af640 1 -- start start 2024-09-15T23:21:09.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.971+0000 7ffa214af640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa08004800 0x7ffa1c0cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:09.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.971+0000 7ffa214af640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa1c15a5d0 0x7ffa1c0c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:09.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.971+0000 7ffa214af640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa1c0cd260 0x7ffa1c0c9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:09.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.971+0000 7ffa214af640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1c0d3e50 con 0x7ffa1c0cd260 2024-09-15T23:21:09.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.971+0000 7ffa214af640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1c0d3b70 con 0x7ffa08004800 2024-09-15T23:21:09.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.971+0000 7ffa214af640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ffa1c0d32a0 con 0x7ffa1c15a5d0 2024-09-15T23:21:09.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.972+0000 7ffa1b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa1c0cd260 0x7ffa1c0c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:09.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.972+0000 7ffa1b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa1c0cd260 0x7ffa1c0c9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36210/0 (socket says 172.21.15.123:36210) 2024-09-15T23:21:09.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.972+0000 7ffa1b7fe640 1 -- 172.21.15.123:0/2737633679 learned_addr learned my addr 172.21.15.123:0/2737633679 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:09.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.972+0000 7ffa1affd640 1 --2- 172.21.15.123:0/2737633679 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa08004800 0x7ffa1c0cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:09.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.972+0000 7ffa13fff640 1 --2- 172.21.15.123:0/2737633679 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa1c15a5d0 0x7ffa1c0c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:09.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.972+0000 7ffa1b7fe640 1 -- 172.21.15.123:0/2737633679 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa1c15a5d0 msgr2=0x7ffa1c0c8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:09.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.972+0000 7ffa1b7fe640 1 --2- 172.21.15.123:0/2737633679 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa1c15a5d0 0x7ffa1c0c8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:09.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.972+0000 7ffa1b7fe640 1 -- 172.21.15.123:0/2737633679 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa08004800 msgr2=0x7ffa1c0cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:09.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.972+0000 7ffa1b7fe640 1 --2- 172.21.15.123:0/2737633679 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa08004800 0x7ffa1c0cdd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:09.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.972+0000 7ffa1b7fe640 1 -- 172.21.15.123:0/2737633679 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa1c0c88a0 con 0x7ffa1c0cd260 2024-09-15T23:21:09.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.972+0000 7ffa13fff640 1 --2- 172.21.15.123:0/2737633679 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa1c15a5d0 0x7ffa1c0c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:21:09.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.972+0000 7ffa1b7fe640 1 --2- 172.21.15.123:0/2737633679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa1c0cd260 0x7ffa1c0c9030 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c08d9c0 tx=0x7ffa1400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:09.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.972+0000 7ffa137fe640 1 -- 172.21.15.123:0/2737633679 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa1400eb90 con 0x7ffa1c0cd260 2024-09-15T23:21:09.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.972+0000 7ffa137fe640 1 -- 172.21.15.123:0/2737633679 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa14019070 con 0x7ffa1c0cd260 2024-09-15T23:21:09.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.972+0000 7ffa214af640 1 -- 172.21.15.123:0/2737633679 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa1c0ce3c0 con 0x7ffa1c0cd260 2024-09-15T23:21:09.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.972+0000 7ffa137fe640 1 -- 172.21.15.123:0/2737633679 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa14013420 con 0x7ffa1c0cd260 2024-09-15T23:21:09.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.972+0000 7ffa214af640 1 -- 172.21.15.123:0/2737633679 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa1c0cca60 con 0x7ffa1c0cd260 2024-09-15T23:21:09.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.973+0000 7ffa214af640 1 -- 172.21.15.123:0/2737633679 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa1c0ce8e0 con 0x7ffa1c0cd260 2024-09-15T23:21:09.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.974+0000 7ffa137fe640 1 -- 172.21.15.123:0/2737633679 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ffa140135c0 con 0x7ffa1c0cd260 2024-09-15T23:21:09.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.974+0000 7ffa137fe640 1 --2- 172.21.15.123:0/2737633679 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff9fc06c2e0 0x7ff9fc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:09.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.974+0000 7ffa137fe640 1 -- 172.21.15.123:0/2737633679 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 4943+0+0 (secure 0 0 0) 0x7ffa1408b440 con 0x7ffa1c0cd260 2024-09-15T23:21:09.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.974+0000 7ffa1affd640 1 --2- 172.21.15.123:0/2737633679 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff9fc06c2e0 0x7ff9fc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:09.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.975+0000 7ffa1affd640 1 --2- 172.21.15.123:0/2737633679 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff9fc06c2e0 0x7ff9fc06e7a0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c009d40 tx=0x7ffa0c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:09.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:09.978+0000 7ffa137fe640 1 -- 172.21.15.123:0/2737633679 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffa1c0ce8e0 con 0x7ffa1c0cd260 2024-09-15T23:21:10.087 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:21:10.090 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:21:10.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.224+0000 7ffa214af640 1 -- 172.21.15.123:0/2737633679 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]} v 0) -- 0x7ffa1c15b470 con 0x7ffa1c0cd260 2024-09-15T23:21:10.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.546+0000 7ffa137fe640 1 -- 172.21.15.123:0/2737633679 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]}]=0 v448) ==== 166+0+0 (secure 0 0 0) 0x7ffa1c0d0e70 con 0x7ffa1c0cd260 2024-09-15T23:21:10.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.548+0000 7ffa214af640 1 -- 172.21.15.123:0/2737633679 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff9fc06c2e0 msgr2=0x7ff9fc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:10.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.548+0000 7ffa214af640 1 --2- 172.21.15.123:0/2737633679 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff9fc06c2e0 0x7ff9fc06e7a0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c009d40 tx=0x7ffa0c009190 comp rx=0 tx=0).stop 2024-09-15T23:21:10.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.548+0000 7ffa214af640 1 -- 172.21.15.123:0/2737633679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa1c0cd260 msgr2=0x7ffa1c0c9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:10.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.548+0000 7ffa214af640 1 --2- 172.21.15.123:0/2737633679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa1c0cd260 0x7ffa1c0c9030 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c08d9c0 tx=0x7ffa1400e530 comp rx=0 tx=0).stop 2024-09-15T23:21:10.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.548+0000 7ffa214af640 1 -- 172.21.15.123:0/2737633679 shutdown_connections 2024-09-15T23:21:10.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.548+0000 7ffa214af640 1 --2- 172.21.15.123:0/2737633679 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff9fc06c2e0 0x7ff9fc06e7a0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:10.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.548+0000 7ffa214af640 1 --2- 172.21.15.123:0/2737633679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa1c0cd260 0x7ffa1c0c9030 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:10.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.548+0000 7ffa214af640 1 --2- 172.21.15.123:0/2737633679 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffa1c15a5d0 0x7ffa1c0c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:10.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.548+0000 7ffa214af640 1 --2- 172.21.15.123:0/2737633679 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffa08004800 0x7ffa1c0cdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:10.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.548+0000 7ffa214af640 1 -- 172.21.15.123:0/2737633679 >> 172.21.15.123:0/2737633679 conn(0x7ffa1c0d1260 msgr2=0x7ffa1c15bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:10.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.548+0000 7ffa214af640 1 -- 172.21.15.123:0/2737633679 shutdown_connections 2024-09-15T23:21:10.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.548+0000 7ffa214af640 1 -- 172.21.15.123:0/2737633679 wait complete. 2024-09-15T23:21:10.561 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume_with_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-15T23:21:10.561 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_task_status_on_mds_failover (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-15T23:21:10.562 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:21:10.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.659+0000 7f0119511640 1 Processor -- start 2024-09-15T23:21:10.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.659+0000 7f0119511640 1 -- start start 2024-09-15T23:21:10.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.660+0000 7f0119511640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f01140b6970 0x7f01140b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:10.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.660+0000 7f0119511640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f01140d23b0 0x7f01140b8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:10.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.660+0000 7f0119511640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01140d0e70 con 0x7f011415ed20 2024-09-15T23:21:10.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.660+0000 7f0119511640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f01140d41c0 con 0x7f01140d23b0 2024-09-15T23:21:10.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.660+0000 7f0119511640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f01140d35b0 con 0x7f01140b6970 2024-09-15T23:21:10.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.660+0000 7f01137fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f01140d23b0 0x7f01140b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:10.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.660+0000 7f01137fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f01140d23b0 0x7f01140b8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36214/0 (socket says 172.21.15.123:36214) 2024-09-15T23:21:10.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.660+0000 7f01137fe640 1 -- 172.21.15.123:0/2597640595 learned_addr learned my addr 172.21.15.123:0/2597640595 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:10.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.661+0000 7f010a7fc640 1 --2- 172.21.15.123:0/2597640595 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f01140b6970 0x7f01140b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:10.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.661+0000 7f01137fe640 1 -- 172.21.15.123:0/2597640595 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f01140b6970 msgr2=0x7f01140b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:10.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.661+0000 7f01137fe640 1 --2- 172.21.15.123:0/2597640595 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f01140b6970 0x7f01140b80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:10.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.661+0000 7f01137fe640 1 -- 172.21.15.123:0/2597640595 >> v1:172.21.15.188:6789/0 conn(0x7f011415ed20 legacy=0x7f01140b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:10.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.661+0000 7f01137fe640 1 -- 172.21.15.123:0/2597640595 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01140d3890 con 0x7f01140d23b0 2024-09-15T23:21:10.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.661+0000 7f01137fe640 1 --2- 172.21.15.123:0/2597640595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01140d23b0 0x7f01140b8610 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f010c009e50 tx=0x7f010c02a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebe43937f943f64a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:10.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.661+0000 7f01127fc640 1 -- 172.21.15.123:0/2597640595 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010c036070 con 0x7f01140d23b0 2024-09-15T23:21:10.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.661+0000 7f01127fc640 1 -- 172.21.15.123:0/2597640595 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f010c031600 con 0x7f01140d23b0 2024-09-15T23:21:10.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.662+0000 7f01127fc640 1 -- 172.21.15.123:0/2597640595 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010c0319d0 con 0x7f01140d23b0 2024-09-15T23:21:10.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.662+0000 7f0119511640 1 -- 172.21.15.123:0/2597640595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01140d23b0 msgr2=0x7f01140b8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:10.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.662+0000 7f0119511640 1 --2- 172.21.15.123:0/2597640595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01140d23b0 0x7f01140b8610 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f010c009e50 tx=0x7f010c02a630 comp rx=0 tx=0).stop 2024-09-15T23:21:10.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.662+0000 7f0119511640 1 -- 172.21.15.123:0/2597640595 shutdown_connections 2024-09-15T23:21:10.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.662+0000 7f0119511640 1 --2- 172.21.15.123:0/2597640595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01140d23b0 0x7f01140b8610 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:10.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.662+0000 7f0119511640 1 --2- 172.21.15.123:0/2597640595 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f01140b6970 0x7f01140b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:10.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.662+0000 7f0119511640 1 -- 172.21.15.123:0/2597640595 >> 172.21.15.123:0/2597640595 conn(0x7f01140d1260 msgr2=0x7f01140d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:10.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.662+0000 7f0119511640 1 -- 172.21.15.123:0/2597640595 shutdown_connections 2024-09-15T23:21:10.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.662+0000 7f0119511640 1 -- 172.21.15.123:0/2597640595 wait complete. 2024-09-15T23:21:10.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.663+0000 7f0119511640 1 Processor -- start 2024-09-15T23:21:10.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.663+0000 7f0119511640 1 -- start start 2024-09-15T23:21:10.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.664+0000 7f0119511640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f01140b6970 0x7f0114153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:10.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.664+0000 7f0119511640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01140d23b0 0x7f01140cde10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:10.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.664+0000 7f0119511640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f011415ed20 0x7f011415f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:10.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.664+0000 7f0119511640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f01140d32a0 con 0x7f01140d23b0 2024-09-15T23:21:10.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.664+0000 7f0119511640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f01140d3e50 con 0x7f011415ed20 2024-09-15T23:21:10.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.664+0000 7f0119511640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f011415f100 con 0x7f01140b6970 2024-09-15T23:21:10.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.664+0000 7f010a7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01140d23b0 0x7f01140cde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:10.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.664+0000 7f010a7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01140d23b0 0x7f01140cde10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36226/0 (socket says 172.21.15.123:36226) 2024-09-15T23:21:10.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.664+0000 7f010a7fc640 1 -- 172.21.15.123:0/2573202721 learned_addr learned my addr 172.21.15.123:0/2573202721 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:10.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.664+0000 7f01137fe640 1 --2- 172.21.15.123:0/2573202721 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f011415ed20 0x7f011415f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:10.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.664+0000 7f0112ffd640 1 --2- 172.21.15.123:0/2573202721 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f01140b6970 0x7f0114153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:10.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.664+0000 7f010a7fc640 1 -- 172.21.15.123:0/2573202721 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f01140b6970 msgr2=0x7f0114153820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:10.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.664+0000 7f010a7fc640 1 --2- 172.21.15.123:0/2573202721 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f01140b6970 0x7f0114153820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:10.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.664+0000 7f010a7fc640 1 -- 172.21.15.123:0/2573202721 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f011415ed20 msgr2=0x7f011415f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:10.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.664+0000 7f010a7fc640 1 --2- 172.21.15.123:0/2573202721 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f011415ed20 0x7f011415f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:10.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.665+0000 7f010a7fc640 1 -- 172.21.15.123:0/2573202721 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01141601a0 con 0x7f01140d23b0 2024-09-15T23:21:10.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.665+0000 7f01137fe640 1 --2- 172.21.15.123:0/2573202721 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f011415ed20 0x7f011415f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:21:10.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.665+0000 7f0112ffd640 1 --2- 172.21.15.123:0/2573202721 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f01140b6970 0x7f0114153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:21:10.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.665+0000 7f010a7fc640 1 --2- 172.21.15.123:0/2573202721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01140d23b0 0x7f01140cde10 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00c7c0 tx=0x7f00fc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:10.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.665+0000 7f010bfff640 1 -- 172.21.15.123:0/2573202721 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00fc015070 con 0x7f01140d23b0 2024-09-15T23:21:10.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.665+0000 7f010bfff640 1 -- 172.21.15.123:0/2573202721 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00fc007820 con 0x7f01140d23b0 2024-09-15T23:21:10.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.665+0000 7f0119511640 1 -- 172.21.15.123:0/2573202721 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0114154870 con 0x7f01140d23b0 2024-09-15T23:21:10.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.665+0000 7f010bfff640 1 -- 172.21.15.123:0/2573202721 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00fc007bf0 con 0x7f01140d23b0 2024-09-15T23:21:10.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.665+0000 7f0119511640 1 -- 172.21.15.123:0/2573202721 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0114154b10 con 0x7f01140d23b0 2024-09-15T23:21:10.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.666+0000 7f0119511640 1 -- 172.21.15.123:0/2573202721 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01140b7010 con 0x7f01140d23b0 2024-09-15T23:21:10.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.666+0000 7f010bfff640 1 -- 172.21.15.123:0/2573202721 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f00fc018070 con 0x7f01140d23b0 2024-09-15T23:21:10.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.667+0000 7f010bfff640 1 --2- 172.21.15.123:0/2573202721 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f00f406c2b0 0x7f00f406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:10.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.667+0000 7f010bfff640 1 -- 172.21.15.123:0/2573202721 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 4943+0+0 (secure 0 0 0) 0x7f00fc08b120 con 0x7f01140d23b0 2024-09-15T23:21:10.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.667+0000 7f0112ffd640 1 --2- 172.21.15.123:0/2573202721 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f00f406c2b0 0x7f00f406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:10.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.668+0000 7f0112ffd640 1 --2- 172.21.15.123:0/2573202721 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f00f406c2b0 0x7f00f406e770 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f010400a830 tx=0x7f0104008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:10.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.671+0000 7f010bfff640 1 -- 172.21.15.123:0/2573202721 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f00fc059b00 con 0x7f01140d23b0 2024-09-15T23:21:10.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.837+0000 7f0119511640 1 -- 172.21.15.123:0/2573202721 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f01140b3f20 con 0x7f01140d23b0 2024-09-15T23:21:10.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.838+0000 7f010bfff640 1 -- 172.21.15.123:0/2573202721 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) ==== 74+0+13066 (secure 0 0 0) 0x7f00fc059400 con 0x7f01140d23b0 2024-09-15T23:21:10.839 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:10.839 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":159,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:21:09.541882+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6835/627322542":"2024-09-16T23:21:06.526360+0000","172.21.15.123:6833/627322542":"2024-09-16T23:21:06.526360+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:21:10.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.840+0000 7f0119511640 1 -- 172.21.15.123:0/2573202721 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f00f406c2b0 msgr2=0x7f00f406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:10.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.840+0000 7f0119511640 1 --2- 172.21.15.123:0/2573202721 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f00f406c2b0 0x7f00f406e770 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f010400a830 tx=0x7f0104008040 comp rx=0 tx=0).stop 2024-09-15T23:21:10.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.840+0000 7f0119511640 1 -- 172.21.15.123:0/2573202721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01140d23b0 msgr2=0x7f01140cde10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:10.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.840+0000 7f0119511640 1 --2- 172.21.15.123:0/2573202721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01140d23b0 0x7f01140cde10 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00c7c0 tx=0x7f00fc00cc80 comp rx=0 tx=0).stop 2024-09-15T23:21:10.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.840+0000 7f0119511640 1 -- 172.21.15.123:0/2573202721 shutdown_connections 2024-09-15T23:21:10.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.840+0000 7f0119511640 1 --2- 172.21.15.123:0/2573202721 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f011415ed20 0x7f011415f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:10.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.840+0000 7f0119511640 1 --2- 172.21.15.123:0/2573202721 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f00f406c2b0 0x7f00f406e770 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:10.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.840+0000 7f0119511640 1 --2- 172.21.15.123:0/2573202721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01140d23b0 0x7f01140cde10 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:10.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.840+0000 7f0119511640 1 --2- 172.21.15.123:0/2573202721 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f01140b6970 0x7f0114153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:10.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.840+0000 7f0119511640 1 -- 172.21.15.123:0/2573202721 >> 172.21.15.123:0/2573202721 conn(0x7f01140d1260 msgr2=0x7f01140b9950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:10.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.840+0000 7f0119511640 1 -- 172.21.15.123:0/2573202721 shutdown_connections 2024-09-15T23:21:10.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.840+0000 7f0119511640 1 -- 172.21.15.123:0/2573202721 wait complete. 2024-09-15T23:21:10.852 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T23:12:01.531886+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T23:21:10.852 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T23:21:10.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.952+0000 7ff82021e640 1 Processor -- start 2024-09-15T23:21:10.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.952+0000 7ff82021e640 1 -- start start 2024-09-15T23:21:10.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.953+0000 7ff82021e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff8180ccf30 0x7ff8180b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:10.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.953+0000 7ff82021e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff8180cead0 0x7ff818071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:10.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.953+0000 7ff82021e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8180cf2e0 con 0x7ff81815b7c0 2024-09-15T23:21:10.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.953+0000 7ff82021e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7ff818070fe0 con 0x7ff8180cead0 2024-09-15T23:21:10.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.953+0000 7ff82021e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ff8180712c0 con 0x7ff8180ccf30 2024-09-15T23:21:10.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.953+0000 7ff81e7bb640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff8180cead0 0x7ff818071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:10.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.953+0000 7ff81e7bb640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff8180cead0 0x7ff818071ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36236/0 (socket says 172.21.15.123:36236) 2024-09-15T23:21:10.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.953+0000 7ff81e7bb640 1 -- 172.21.15.123:0/2568693041 learned_addr learned my addr 172.21.15.123:0/2568693041 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:10.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.953+0000 7ff81e7bb640 1 -- 172.21.15.123:0/2568693041 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff8180ccf30 msgr2=0x7ff8180b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:10.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.953+0000 7ff81e7bb640 1 --2- 172.21.15.123:0/2568693041 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff8180ccf30 0x7ff8180b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:10.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.953+0000 7ff81e7bb640 1 -- 172.21.15.123:0/2568693041 >> v1:172.21.15.188:6789/0 conn(0x7ff81815b7c0 legacy=0x7ff8180cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:10.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.953+0000 7ff81e7bb640 1 -- 172.21.15.123:0/2568693041 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8180715a0 con 0x7ff8180cead0 2024-09-15T23:21:10.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.954+0000 7ff81e7bb640 1 --2- 172.21.15.123:0/2568693041 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8180cead0 0x7ff818071ac0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7ff810009e50 tx=0x7ff81002a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cce4f4eae3866f97 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:10.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.954+0000 7ff81cfb8640 1 -- 172.21.15.123:0/2568693041 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff810036070 con 0x7ff8180cead0 2024-09-15T23:21:10.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.954+0000 7ff81cfb8640 1 -- 172.21.15.123:0/2568693041 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff810031600 con 0x7ff8180cead0 2024-09-15T23:21:10.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.954+0000 7ff81cfb8640 1 -- 172.21.15.123:0/2568693041 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8100319d0 con 0x7ff8180cead0 2024-09-15T23:21:10.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.955+0000 7ff82021e640 1 -- 172.21.15.123:0/2568693041 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8180cead0 msgr2=0x7ff818071ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:10.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.955+0000 7ff82021e640 1 --2- 172.21.15.123:0/2568693041 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8180cead0 0x7ff818071ac0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7ff810009e50 tx=0x7ff81002a630 comp rx=0 tx=0).stop 2024-09-15T23:21:10.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.955+0000 7ff82021e640 1 -- 172.21.15.123:0/2568693041 shutdown_connections 2024-09-15T23:21:10.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.955+0000 7ff82021e640 1 --2- 172.21.15.123:0/2568693041 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8180cead0 0x7ff818071ac0 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:10.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.955+0000 7ff82021e640 1 --2- 172.21.15.123:0/2568693041 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff8180ccf30 0x7ff8180b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:10.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.955+0000 7ff82021e640 1 -- 172.21.15.123:0/2568693041 >> 172.21.15.123:0/2568693041 conn(0x7ff81806d0f0 msgr2=0x7ff81806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:10.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.955+0000 7ff82021e640 1 -- 172.21.15.123:0/2568693041 shutdown_connections 2024-09-15T23:21:10.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.955+0000 7ff82021e640 1 -- 172.21.15.123:0/2568693041 wait complete. 2024-09-15T23:21:10.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.956+0000 7ff82021e640 1 Processor -- start 2024-09-15T23:21:10.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.956+0000 7ff82021e640 1 -- start start 2024-09-15T23:21:10.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.957+0000 7ff82021e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8180ccf30 0x7ff8181f2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:10.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.957+0000 7ff82021e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff8180cead0 0x7ff818150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:10.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.957+0000 7ff82021e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff81815b7c0 0x7ff8181f3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:10.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.957+0000 7ff82021e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff818072000 con 0x7ff8180ccf30 2024-09-15T23:21:10.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.957+0000 7ff82021e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff8180cef60 con 0x7ff81815b7c0 2024-09-15T23:21:10.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.957+0000 7ff82021e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ff818072180 con 0x7ff8180cead0 2024-09-15T23:21:10.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.957+0000 7ff81dfba640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8180ccf30 0x7ff8181f2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:10.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.957+0000 7ff81dfba640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8180ccf30 0x7ff8181f2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36250/0 (socket says 172.21.15.123:36250) 2024-09-15T23:21:10.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.957+0000 7ff81dfba640 1 -- 172.21.15.123:0/2810823046 learned_addr learned my addr 172.21.15.123:0/2810823046 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:10.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.957+0000 7ff81dfba640 1 -- 172.21.15.123:0/2810823046 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff8180cead0 msgr2=0x7ff818150f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:10.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.957+0000 7ff81dfba640 1 --2- 172.21.15.123:0/2810823046 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff8180cead0 0x7ff818150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:10.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.957+0000 7ff81dfba640 1 -- 172.21.15.123:0/2810823046 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff81815b7c0 msgr2=0x7ff8181f3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:10.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.957+0000 7ff81dfba640 1 --2- 172.21.15.123:0/2810823046 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff81815b7c0 0x7ff8181f3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:10.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.957+0000 7ff81dfba640 1 -- 172.21.15.123:0/2810823046 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8181f2fb0 con 0x7ff8180ccf30 2024-09-15T23:21:10.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.957+0000 7ff81dfba640 1 --2- 172.21.15.123:0/2810823046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8180ccf30 0x7ff8181f2a70 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7ff81400b4a0 tx=0x7ff81400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:10.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.957+0000 7ff80e7fc640 1 -- 172.21.15.123:0/2810823046 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff814014070 con 0x7ff8180ccf30 2024-09-15T23:21:10.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.958+0000 7ff80e7fc640 1 -- 172.21.15.123:0/2810823046 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff814010610 con 0x7ff8180ccf30 2024-09-15T23:21:10.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.958+0000 7ff82021e640 1 -- 172.21.15.123:0/2810823046 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8181f3250 con 0x7ff8180ccf30 2024-09-15T23:21:10.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.958+0000 7ff80e7fc640 1 -- 172.21.15.123:0/2810823046 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff814010a00 con 0x7ff8180ccf30 2024-09-15T23:21:10.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.958+0000 7ff82021e640 1 -- 172.21.15.123:0/2810823046 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8181f3810 con 0x7ff8180ccf30 2024-09-15T23:21:10.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.958+0000 7ff82021e640 1 -- 172.21.15.123:0/2810823046 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8180b2c50 con 0x7ff8180ccf30 2024-09-15T23:21:10.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.959+0000 7ff80e7fc640 1 -- 172.21.15.123:0/2810823046 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff814017070 con 0x7ff8180ccf30 2024-09-15T23:21:10.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.959+0000 7ff80e7fc640 1 --2- 172.21.15.123:0/2810823046 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff7fc06c2b0 0x7ff7fc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:10.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.960+0000 7ff80e7fc640 1 -- 172.21.15.123:0/2810823046 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 4943+0+0 (secure 0 0 0) 0x7ff81408aac0 con 0x7ff8180ccf30 2024-09-15T23:21:10.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.960+0000 7ff81d7b9640 1 --2- 172.21.15.123:0/2810823046 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff7fc06c2b0 0x7ff7fc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:10.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.960+0000 7ff81d7b9640 1 --2- 172.21.15.123:0/2810823046 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff7fc06c2b0 0x7ff7fc06e770 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7ff8181555a0 tx=0x7ff808006ba0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:10.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:10.964+0000 7ff80e7fc640 1 -- 172.21.15.123:0/2810823046 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff8140595c0 con 0x7ff8180ccf30 2024-09-15T23:21:11.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.133+0000 7ff82021e640 1 -- 172.21.15.123:0/2810823046 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff8180cc960 con 0x7ff8180ccf30 2024-09-15T23:21:11.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.133+0000 7ff80e7fc640 1 -- 172.21.15.123:0/2810823046 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v159) ==== 93+0+10 (secure 0 0 0) 0x7ff814058ec0 con 0x7ff8180ccf30 2024-09-15T23:21:11.134 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-15T23:21:11.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.135+0000 7ff82021e640 1 -- 172.21.15.123:0/2810823046 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff7fc06c2b0 msgr2=0x7ff7fc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:11.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.135+0000 7ff82021e640 1 --2- 172.21.15.123:0/2810823046 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff7fc06c2b0 0x7ff7fc06e770 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7ff8181555a0 tx=0x7ff808006ba0 comp rx=0 tx=0).stop 2024-09-15T23:21:11.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.135+0000 7ff82021e640 1 -- 172.21.15.123:0/2810823046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8180ccf30 msgr2=0x7ff8181f2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:11.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.135+0000 7ff82021e640 1 --2- 172.21.15.123:0/2810823046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8180ccf30 0x7ff8181f2a70 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7ff81400b4a0 tx=0x7ff81400b960 comp rx=0 tx=0).stop 2024-09-15T23:21:11.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.135+0000 7ff82021e640 1 -- 172.21.15.123:0/2810823046 shutdown_connections 2024-09-15T23:21:11.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.135+0000 7ff82021e640 1 --2- 172.21.15.123:0/2810823046 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff81815b7c0 0x7ff8181f3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:11.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.135+0000 7ff82021e640 1 --2- 172.21.15.123:0/2810823046 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff8180cead0 0x7ff818150f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:11.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.135+0000 7ff82021e640 1 --2- 172.21.15.123:0/2810823046 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff7fc06c2b0 0x7ff7fc06e770 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:11.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.135+0000 7ff82021e640 1 --2- 172.21.15.123:0/2810823046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8180ccf30 0x7ff8181f2a70 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:11.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.135+0000 7ff82021e640 1 -- 172.21.15.123:0/2810823046 >> 172.21.15.123:0/2810823046 conn(0x7ff81806d0f0 msgr2=0x7ff8180b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:11.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.135+0000 7ff82021e640 1 -- 172.21.15.123:0/2810823046 shutdown_connections 2024-09-15T23:21:11.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.135+0000 7ff82021e640 1 -- 172.21.15.123:0/2810823046 wait complete. 2024-09-15T23:21:11.147 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover' 2024-09-15T23:21:11.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.245+0000 7f898299f640 1 Processor -- start 2024-09-15T23:21:11.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.245+0000 7f898299f640 1 -- start start 2024-09-15T23:21:11.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.245+0000 7f898299f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f897c15ed20 0x7f897c0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:11.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.245+0000 7f898299f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f897c0b90e0 0x7f897c0b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:11.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.245+0000 7f898299f640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f897c0d0e70 con 0x7f897c0d23b0 2024-09-15T23:21:11.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.245+0000 7f898299f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f897c0d41c0 con 0x7f897c0b90e0 2024-09-15T23:21:11.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.245+0000 7f898299f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f897c0d35b0 con 0x7f897c15ed20 2024-09-15T23:21:11.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.246+0000 7f8980f3c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f897c0b90e0 0x7f897c0b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:11.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.246+0000 7f897b7fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f897c0d23b0 0x7f897c0cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51096/0 (socket says 172.21.15.123:51096) 2024-09-15T23:21:11.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.246+0000 7f897b7fe640 1 -- 172.21.15.123:0/472241518 learned_addr learned my addr 172.21.15.123:0/472241518 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:21:11.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.246+0000 7f897bfff640 1 --2- 172.21.15.123:0/472241518 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f897c15ed20 0x7f897c0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:11.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.246+0000 7f8980f3c640 1 -- 172.21.15.123:0/472241518 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f897c15ed20 msgr2=0x7f897c0b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:11.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.246+0000 7f8980f3c640 1 --2- 172.21.15.123:0/472241518 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f897c15ed20 0x7f897c0b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:11.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.246+0000 7f8980f3c640 1 -- 172.21.15.123:0/472241518 >> v1:172.21.15.123:6789/0 conn(0x7f897c0d23b0 legacy=0x7f897c0cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:11.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.246+0000 7f897affd640 1 -- 172.21.15.123:0/472241518 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2293760204 0 0) 0x7f8970001110 con 0x7f897c0d23b0 2024-09-15T23:21:11.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.246+0000 7f8980f3c640 1 -- 172.21.15.123:0/472241518 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f897c0d3890 con 0x7f897c0b90e0 2024-09-15T23:21:11.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.247+0000 7f8980f3c640 1 --2- 172.21.15.123:0/472241518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f897c0b90e0 0x7f897c0b67a0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f8974009d90 tx=0x7f897402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9819d5ba2fd89ef9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:11.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.247+0000 7f897affd640 1 -- 172.21.15.123:0/472241518 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8974007740 con 0x7f897c0b90e0 2024-09-15T23:21:11.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.247+0000 7f897affd640 1 -- 172.21.15.123:0/472241518 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89740078e0 con 0x7f897c0b90e0 2024-09-15T23:21:11.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.247+0000 7f897affd640 1 -- 172.21.15.123:0/472241518 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8974007cb0 con 0x7f897c0b90e0 2024-09-15T23:21:11.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.247+0000 7f898299f640 1 -- 172.21.15.123:0/472241518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f897c0b90e0 msgr2=0x7f897c0b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:11.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.247+0000 7f898299f640 1 --2- 172.21.15.123:0/472241518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f897c0b90e0 0x7f897c0b67a0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f8974009d90 tx=0x7f897402a660 comp rx=0 tx=0).stop 2024-09-15T23:21:11.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.247+0000 7f898299f640 1 -- 172.21.15.123:0/472241518 shutdown_connections 2024-09-15T23:21:11.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.247+0000 7f898299f640 1 --2- 172.21.15.123:0/472241518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f897c0b90e0 0x7f897c0b67a0 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:11.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.247+0000 7f898299f640 1 --2- 172.21.15.123:0/472241518 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f897c15ed20 0x7f897c0b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:11.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.247+0000 7f898299f640 1 -- 172.21.15.123:0/472241518 >> 172.21.15.123:0/472241518 conn(0x7f897c0d1260 msgr2=0x7f897c0d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:11.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.247+0000 7f898299f640 1 -- 172.21.15.123:0/472241518 shutdown_connections 2024-09-15T23:21:11.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.247+0000 7f898299f640 1 -- 172.21.15.123:0/472241518 wait complete. 2024-09-15T23:21:11.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.248+0000 7f898299f640 1 Processor -- start 2024-09-15T23:21:11.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.249+0000 7f898299f640 1 -- start start 2024-09-15T23:21:11.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.249+0000 7f898299f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f897c0b90e0 0x7f897c1608e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:11.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.249+0000 7f898299f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f897c0d23b0 0x7f897c154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:11.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.249+0000 7f898299f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f897c15ed20 0x7f897c0cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:11.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.249+0000 7f898299f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f897c0d32a0 con 0x7f897c15ed20 2024-09-15T23:21:11.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.249+0000 7f898299f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f897c0d3e50 con 0x7f897c0d23b0 2024-09-15T23:21:11.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.249+0000 7f898299f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f897c15f100 con 0x7f897c0b90e0 2024-09-15T23:21:11.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.249+0000 7f8980f3c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f897c15ed20 0x7f897c0cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:11.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.249+0000 7f8980f3c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f897c15ed20 0x7f897c0cb8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36264/0 (socket says 172.21.15.123:36264) 2024-09-15T23:21:11.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.250+0000 7f8980f3c640 1 -- 172.21.15.123:0/2208003498 learned_addr learned my addr 172.21.15.123:0/2208003498 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:11.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.250+0000 7f897bfff640 1 --2- 172.21.15.123:0/2208003498 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f897c0b90e0 0x7f897c1608e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:11.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.250+0000 7f897b7fe640 1 --2- 172.21.15.123:0/2208003498 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f897c0d23b0 0x7f897c154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:11.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.250+0000 7f8980f3c640 1 -- 172.21.15.123:0/2208003498 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f897c0b90e0 msgr2=0x7f897c1608e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:11.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.250+0000 7f8980f3c640 1 --2- 172.21.15.123:0/2208003498 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f897c0b90e0 0x7f897c1608e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:11.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.250+0000 7f8980f3c640 1 -- 172.21.15.123:0/2208003498 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f897c0d23b0 msgr2=0x7f897c154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:11.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.250+0000 7f8980f3c640 1 --2- 172.21.15.123:0/2208003498 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f897c0d23b0 0x7f897c154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:11.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.250+0000 7f8980f3c640 1 -- 172.21.15.123:0/2208003498 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f897c1f5450 con 0x7f897c15ed20 2024-09-15T23:21:11.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.250+0000 7f897bfff640 1 --2- 172.21.15.123:0/2208003498 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f897c0b90e0 0x7f897c1608e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:21:11.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.250+0000 7f8980f3c640 1 --2- 172.21.15.123:0/2208003498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f897c15ed20 0x7f897c0cb8b0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f897402a6a0 tx=0x7f8974004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:11.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.250+0000 7f8978ff9640 1 -- 172.21.15.123:0/2208003498 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8974040070 con 0x7f897c15ed20 2024-09-15T23:21:11.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.250+0000 7f8978ff9640 1 -- 172.21.15.123:0/2208003498 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8974031bc0 con 0x7f897c15ed20 2024-09-15T23:21:11.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.250+0000 7f898299f640 1 -- 172.21.15.123:0/2208003498 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f897c1f5730 con 0x7f897c15ed20 2024-09-15T23:21:11.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.250+0000 7f8978ff9640 1 -- 172.21.15.123:0/2208003498 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8974009450 con 0x7f897c15ed20 2024-09-15T23:21:11.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.250+0000 7f898299f640 1 -- 172.21.15.123:0/2208003498 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f897c1f5cf0 con 0x7f897c15ed20 2024-09-15T23:21:11.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.251+0000 7f898299f640 1 -- 172.21.15.123:0/2208003498 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f897c0b6ad0 con 0x7f897c15ed20 2024-09-15T23:21:11.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.252+0000 7f8978ff9640 1 -- 172.21.15.123:0/2208003498 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8974039040 con 0x7f897c15ed20 2024-09-15T23:21:11.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.252+0000 7f8978ff9640 1 --2- 172.21.15.123:0/2208003498 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f896806c2b0 0x7f896806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:11.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.252+0000 7f8978ff9640 1 -- 172.21.15.123:0/2208003498 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 4943+0+0 (secure 0 0 0) 0x7f89740ac3b0 con 0x7f897c15ed20 2024-09-15T23:21:11.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.252+0000 7f897bfff640 1 --2- 172.21.15.123:0/2208003498 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f896806c2b0 0x7f896806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:11.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.253+0000 7f897bfff640 1 --2- 172.21.15.123:0/2208003498 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f896806c2b0 0x7f896806e770 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f896c006fd0 tx=0x7f896c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:11.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.256+0000 7f8978ff9640 1 -- 172.21.15.123:0/2208003498 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f897c0b6ad0 con 0x7f897c15ed20 2024-09-15T23:21:11.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.485+0000 7f898299f640 1 -- 172.21.15.123:0/2208003498 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]} v 0) -- 0x7f897c0b3f20 con 0x7f897c15ed20 2024-09-15T23:21:11.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.547+0000 7f8978ff9640 1 -- 172.21.15.123:0/2208003498 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]}]=0 v449) ==== 169+0+0 (secure 0 0 0) 0x7f897407ae20 con 0x7f897c15ed20 2024-09-15T23:21:11.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.549+0000 7f898299f640 1 -- 172.21.15.123:0/2208003498 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f896806c2b0 msgr2=0x7f896806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:11.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.549+0000 7f898299f640 1 --2- 172.21.15.123:0/2208003498 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f896806c2b0 0x7f896806e770 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f896c006fd0 tx=0x7f896c008040 comp rx=0 tx=0).stop 2024-09-15T23:21:11.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.549+0000 7f898299f640 1 -- 172.21.15.123:0/2208003498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f897c15ed20 msgr2=0x7f897c0cb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:11.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.549+0000 7f898299f640 1 --2- 172.21.15.123:0/2208003498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f897c15ed20 0x7f897c0cb8b0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f897402a6a0 tx=0x7f8974004a40 comp rx=0 tx=0).stop 2024-09-15T23:21:11.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.549+0000 7f898299f640 1 -- 172.21.15.123:0/2208003498 shutdown_connections 2024-09-15T23:21:11.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.549+0000 7f898299f640 1 --2- 172.21.15.123:0/2208003498 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f896806c2b0 0x7f896806e770 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:11.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.549+0000 7f898299f640 1 --2- 172.21.15.123:0/2208003498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f897c15ed20 0x7f897c0cb8b0 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:11.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.549+0000 7f898299f640 1 --2- 172.21.15.123:0/2208003498 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f897c0d23b0 0x7f897c154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:11.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.549+0000 7f898299f640 1 --2- 172.21.15.123:0/2208003498 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f897c0b90e0 0x7f897c1608e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:11.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.549+0000 7f898299f640 1 -- 172.21.15.123:0/2208003498 >> 172.21.15.123:0/2208003498 conn(0x7f897c0d1260 msgr2=0x7f897c0cf0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:11.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.550+0000 7f898299f640 1 -- 172.21.15.123:0/2208003498 shutdown_connections 2024-09-15T23:21:11.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.550+0000 7f898299f640 1 -- 172.21.15.123:0/2208003498 wait complete. 2024-09-15T23:21:11.562 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T23:21:11.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.662+0000 7fb16ea42640 1 Processor -- start 2024-09-15T23:21:11.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.662+0000 7fb16ea42640 1 -- start start 2024-09-15T23:21:11.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.663+0000 7fb16ea42640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb16815b7c0 0x7fb1680b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:11.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.663+0000 7fb16ea42640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1680cf2e0 con 0x7fb1680ccf30 2024-09-15T23:21:11.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.663+0000 7fb16ea42640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb168070fe0 con 0x7fb1680cead0 2024-09-15T23:21:11.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.663+0000 7fb16ea42640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fb1680712c0 con 0x7fb16815b7c0 2024-09-15T23:21:11.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.663+0000 7fb1677fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb16815b7c0 0x7fb1680b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:11.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.663+0000 7fb167fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb1680ccf30 0x7fb1680cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51106/0 (socket says 172.21.15.123:51106) 2024-09-15T23:21:11.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.663+0000 7fb167fff640 1 -- 172.21.15.123:0/4167386410 learned_addr learned my addr 172.21.15.123:0/4167386410 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:21:11.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.663+0000 7fb1677fe640 1 -- 172.21.15.123:0/4167386410 >> v1:172.21.15.188:6789/0 conn(0x7fb1680cead0 legacy=0x7fb168071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:11.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.663+0000 7fb1677fe640 1 -- 172.21.15.123:0/4167386410 >> v1:172.21.15.123:6789/0 conn(0x7fb1680ccf30 legacy=0x7fb1680cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:11.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.663+0000 7fb1677fe640 1 -- 172.21.15.123:0/4167386410 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1680715a0 con 0x7fb16815b7c0 2024-09-15T23:21:11.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.663+0000 7fb166ffd640 1 -- 172.21.15.123:0/4167386410 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2718294113 0 0) 0x7fb1680cf2e0 con 0x7fb1680ccf30 2024-09-15T23:21:11.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.664+0000 7fb1677fe640 1 --2- 172.21.15.123:0/4167386410 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb16815b7c0 0x7fb1680b2c50 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7fb15c0097a0 tx=0x7fb15c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ece22089b007895d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:11.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.664+0000 7fb166ffd640 1 -- 172.21.15.123:0/4167386410 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c037070 con 0x7fb16815b7c0 2024-09-15T23:21:11.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.664+0000 7fb166ffd640 1 -- 172.21.15.123:0/4167386410 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb15c02ae50 con 0x7fb16815b7c0 2024-09-15T23:21:11.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.664+0000 7fb166ffd640 1 -- 172.21.15.123:0/4167386410 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c032660 con 0x7fb16815b7c0 2024-09-15T23:21:11.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.665+0000 7fb16ea42640 1 -- 172.21.15.123:0/4167386410 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb16815b7c0 msgr2=0x7fb1680b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:11.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.665+0000 7fb16ea42640 1 --2- 172.21.15.123:0/4167386410 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb16815b7c0 0x7fb1680b2c50 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7fb15c0097a0 tx=0x7fb15c02a140 comp rx=0 tx=0).stop 2024-09-15T23:21:11.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.665+0000 7fb16ea42640 1 -- 172.21.15.123:0/4167386410 shutdown_connections 2024-09-15T23:21:11.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.665+0000 7fb16ea42640 1 --2- 172.21.15.123:0/4167386410 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb16815b7c0 0x7fb1680b2c50 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:11.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.665+0000 7fb16ea42640 1 -- 172.21.15.123:0/4167386410 >> 172.21.15.123:0/4167386410 conn(0x7fb16806d0f0 msgr2=0x7fb16806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:11.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.665+0000 7fb16ea42640 1 -- 172.21.15.123:0/4167386410 shutdown_connections 2024-09-15T23:21:11.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.665+0000 7fb16ea42640 1 -- 172.21.15.123:0/4167386410 wait complete. 2024-09-15T23:21:11.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.666+0000 7fb16ea42640 1 Processor -- start 2024-09-15T23:21:11.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.666+0000 7fb16ea42640 1 -- start start 2024-09-15T23:21:11.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.667+0000 7fb16ea42640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1680ccf30 0x7fb168157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:11.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.667+0000 7fb16ea42640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb1680cead0 0x7fb168158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:11.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.667+0000 7fb16ea42640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb16815b7c0 0x7fb16815dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:11.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.667+0000 7fb16ea42640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb1680cf080 con 0x7fb1680ccf30 2024-09-15T23:21:11.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.667+0000 7fb16ea42640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb1680cef00 con 0x7fb1680cead0 2024-09-15T23:21:11.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.667+0000 7fb16ea42640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb1680721d0 con 0x7fb16815b7c0 2024-09-15T23:21:11.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.667+0000 7fb167fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1680ccf30 0x7fb168157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:11.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.667+0000 7fb167fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1680ccf30 0x7fb168157080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36286/0 (socket says 172.21.15.123:36286) 2024-09-15T23:21:11.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.667+0000 7fb167fff640 1 -- 172.21.15.123:0/3765931760 learned_addr learned my addr 172.21.15.123:0/3765931760 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:11.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.667+0000 7fb167fff640 1 -- 172.21.15.123:0/3765931760 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb16815b7c0 msgr2=0x7fb16815dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:11.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.667+0000 7fb167fff640 1 --2- 172.21.15.123:0/3765931760 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb16815b7c0 0x7fb16815dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:11.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.667+0000 7fb167fff640 1 -- 172.21.15.123:0/3765931760 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb1680cead0 msgr2=0x7fb168158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:11.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.667+0000 7fb1677fe640 1 --2- 172.21.15.123:0/3765931760 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb1680cead0 0x7fb168158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:11.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.667+0000 7fb167fff640 1 --2- 172.21.15.123:0/3765931760 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb1680cead0 0x7fb168158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:11.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.667+0000 7fb167fff640 1 -- 172.21.15.123:0/3765931760 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1681f25f0 con 0x7fb1680ccf30 2024-09-15T23:21:11.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.667+0000 7fb1677fe640 1 --2- 172.21.15.123:0/3765931760 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb1680cead0 0x7fb168158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:21:11.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.668+0000 7fb167fff640 1 --2- 172.21.15.123:0/3765931760 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1680ccf30 0x7fb168157080 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7fb15800c4d0 tx=0x7fb15800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:11.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.668+0000 7fb164ff9640 1 -- 172.21.15.123:0/3765931760 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb158018070 con 0x7fb1680ccf30 2024-09-15T23:21:11.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.668+0000 7fb164ff9640 1 -- 172.21.15.123:0/3765931760 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb158007500 con 0x7fb1680ccf30 2024-09-15T23:21:11.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.668+0000 7fb16ea42640 1 -- 172.21.15.123:0/3765931760 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1681f28d0 con 0x7fb1680ccf30 2024-09-15T23:21:11.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.668+0000 7fb164ff9640 1 -- 172.21.15.123:0/3765931760 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb158004a20 con 0x7fb1680ccf30 2024-09-15T23:21:11.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.668+0000 7fb16ea42640 1 -- 172.21.15.123:0/3765931760 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1681f2e90 con 0x7fb1680ccf30 2024-09-15T23:21:11.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.669+0000 7fb16ea42640 1 -- 172.21.15.123:0/3765931760 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1680b2c50 con 0x7fb1680ccf30 2024-09-15T23:21:11.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.669+0000 7fb164ff9640 1 -- 172.21.15.123:0/3765931760 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb15801b070 con 0x7fb1680ccf30 2024-09-15T23:21:11.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.669+0000 7fb164ff9640 1 --2- 172.21.15.123:0/3765931760 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb15406c2b0 0x7fb15406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:11.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.670+0000 7fb164ff9640 1 -- 172.21.15.123:0/3765931760 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 4943+0+0 (secure 0 0 0) 0x7fb15808a420 con 0x7fb1680ccf30 2024-09-15T23:21:11.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.670+0000 7fb1677fe640 1 --2- 172.21.15.123:0/3765931760 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb15406c2b0 0x7fb15406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:11.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.671+0000 7fb1677fe640 1 --2- 172.21.15.123:0/3765931760 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb15406c2b0 0x7fb15406e770 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fb15c034000 tx=0x7fb15c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:11.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.674+0000 7fb164ff9640 1 -- 172.21.15.123:0/3765931760 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb158058f20 con 0x7fb1680ccf30 2024-09-15T23:21:11.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.837+0000 7fb16ea42640 1 -- 172.21.15.123:0/3765931760 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fb1680d0290 con 0x7fb1680ccf30 2024-09-15T23:21:11.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.840+0000 7fb164ff9640 1 -- 172.21.15.123:0/3765931760 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v42)=0 v42) ==== 122+0+0 (secure 0 0 0) 0x7fb158058820 con 0x7fb1680ccf30 2024-09-15T23:21:11.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.842+0000 7fb16ea42640 1 -- 172.21.15.123:0/3765931760 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb15406c2b0 msgr2=0x7fb15406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:11.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.842+0000 7fb16ea42640 1 --2- 172.21.15.123:0/3765931760 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb15406c2b0 0x7fb15406e770 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fb15c034000 tx=0x7fb15c02e000 comp rx=0 tx=0).stop 2024-09-15T23:21:11.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.842+0000 7fb16ea42640 1 -- 172.21.15.123:0/3765931760 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1680ccf30 msgr2=0x7fb168157080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:11.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.842+0000 7fb16ea42640 1 --2- 172.21.15.123:0/3765931760 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1680ccf30 0x7fb168157080 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7fb15800c4d0 tx=0x7fb15800c990 comp rx=0 tx=0).stop 2024-09-15T23:21:11.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.842+0000 7fb16ea42640 1 -- 172.21.15.123:0/3765931760 shutdown_connections 2024-09-15T23:21:11.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.842+0000 7fb16ea42640 1 --2- 172.21.15.123:0/3765931760 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb16815b7c0 0x7fb16815dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:11.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.842+0000 7fb16ea42640 1 --2- 172.21.15.123:0/3765931760 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb1680cead0 0x7fb168158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:11.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.842+0000 7fb16ea42640 1 --2- 172.21.15.123:0/3765931760 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb15406c2b0 0x7fb15406e770 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:11.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.842+0000 7fb16ea42640 1 --2- 172.21.15.123:0/3765931760 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1680ccf30 0x7fb168157080 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:11.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.842+0000 7fb16ea42640 1 -- 172.21.15.123:0/3765931760 >> 172.21.15.123:0/3765931760 conn(0x7fb16806d0f0 msgr2=0x7fb168071ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:11.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.842+0000 7fb16ea42640 1 -- 172.21.15.123:0/3765931760 shutdown_connections 2024-09-15T23:21:11.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:11.842+0000 7fb16ea42640 1 -- 172.21.15.123:0/3765931760 wait complete. 2024-09-15T23:21:11.854 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:21:11.855 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:21:11.890 DEBUG:teuthology.orchestra.run.smithi188:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:21:11.941 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:21:11.941 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:21:11.941 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:21:11.957 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:21:11.957 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:21:11.957 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:21:11.975 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:21:11.975 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:21:11.976 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:21:12.012 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:21:12.012 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:21:12.012 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:21:12.033 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:21:12.033 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-15T23:21:12.034 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:21:12.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.148+0000 7f7ee62ba640 1 Processor -- start 2024-09-15T23:21:12.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.148+0000 7f7ee62ba640 1 -- start start 2024-09-15T23:21:12.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.149+0000 7f7ee62ba640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7ee00b6970 0x7f7ee00b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:12.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.149+0000 7f7ee62ba640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7ee00d23b0 0x7f7ee00b8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:12.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.149+0000 7f7ee62ba640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ee00d0e70 con 0x7f7ee015ed20 2024-09-15T23:21:12.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.149+0000 7f7ee62ba640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f7ee00d41c0 con 0x7f7ee00d23b0 2024-09-15T23:21:12.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.149+0000 7f7ee62ba640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f7ee00d35b0 con 0x7f7ee00b6970 2024-09-15T23:21:12.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.149+0000 7f7ee4857640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7ee00d23b0 0x7f7ee00b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:12.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.150+0000 7f7edffff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7ee015ed20 0x7f7ee00b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51114/0 (socket says 172.21.15.123:51114) 2024-09-15T23:21:12.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.150+0000 7f7edffff640 1 -- 172.21.15.123:0/1996133852 learned_addr learned my addr 172.21.15.123:0/1996133852 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:21:12.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.150+0000 7f7edf7fe640 1 --2- 172.21.15.123:0/1996133852 >> v2:172.21.15.188:3300/0 conn(0x7f7ee00b6970 0x7f7ee00b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:12.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.150+0000 7f7ee4857640 1 -- 172.21.15.123:0/1996133852 >> v2:172.21.15.188:3300/0 conn(0x7f7ee00b6970 msgr2=0x7f7ee00b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:12.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.150+0000 7f7ee4857640 1 --2- 172.21.15.123:0/1996133852 >> v2:172.21.15.188:3300/0 conn(0x7f7ee00b6970 0x7f7ee00b80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:12.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.150+0000 7f7ee4857640 1 -- 172.21.15.123:0/1996133852 >> v1:172.21.15.123:6789/0 conn(0x7f7ee015ed20 legacy=0x7f7ee00b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:12.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.150+0000 7f7edeffd640 1 -- 172.21.15.123:0/1996133852 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1557678269 0 0) 0x7f7ed0001110 con 0x7f7ee015ed20 2024-09-15T23:21:12.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.150+0000 7f7ee4857640 1 -- 172.21.15.123:0/1996133852 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ee00d3890 con 0x7f7ee00d23b0 2024-09-15T23:21:12.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.150+0000 7f7ee4857640 1 --2- 172.21.15.123:0/1996133852 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ee00d23b0 0x7f7ee00b8610 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f7ee00d4690 tx=0x7f7ed802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f7713e9e79dd7c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:12.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.151+0000 7f7edeffd640 1 -- 172.21.15.123:0/1996133852 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed8007740 con 0x7f7ee00d23b0 2024-09-15T23:21:12.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.151+0000 7f7edeffd640 1 -- 172.21.15.123:0/1996133852 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ed80078e0 con 0x7f7ee00d23b0 2024-09-15T23:21:12.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.151+0000 7f7edeffd640 1 -- 172.21.15.123:0/1996133852 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed8007cb0 con 0x7f7ee00d23b0 2024-09-15T23:21:12.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.151+0000 7f7ee62ba640 1 -- 172.21.15.123:0/1996133852 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ee00d23b0 msgr2=0x7f7ee00b8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:12.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.151+0000 7f7ee62ba640 1 --2- 172.21.15.123:0/1996133852 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ee00d23b0 0x7f7ee00b8610 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f7ee00d4690 tx=0x7f7ed802a5f0 comp rx=0 tx=0).stop 2024-09-15T23:21:12.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.151+0000 7f7ee62ba640 1 -- 172.21.15.123:0/1996133852 shutdown_connections 2024-09-15T23:21:12.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.151+0000 7f7ee62ba640 1 --2- 172.21.15.123:0/1996133852 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ee00d23b0 0x7f7ee00b8610 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:12.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.151+0000 7f7ee62ba640 1 --2- 172.21.15.123:0/1996133852 >> v2:172.21.15.188:3300/0 conn(0x7f7ee00b6970 0x7f7ee00b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:12.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.151+0000 7f7ee62ba640 1 -- 172.21.15.123:0/1996133852 >> 172.21.15.123:0/1996133852 conn(0x7f7ee00d1260 msgr2=0x7f7ee00d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:12.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.151+0000 7f7ee62ba640 1 -- 172.21.15.123:0/1996133852 shutdown_connections 2024-09-15T23:21:12.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.151+0000 7f7ee62ba640 1 -- 172.21.15.123:0/1996133852 wait complete. 2024-09-15T23:21:12.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.152+0000 7f7ee62ba640 1 Processor -- start 2024-09-15T23:21:12.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.153+0000 7f7ee62ba640 1 -- start start 2024-09-15T23:21:12.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.153+0000 7f7ee62ba640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ee00b6970 0x7f7ee015cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:12.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.153+0000 7f7ee62ba640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ee00d23b0 0x7f7ee01f4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:12.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.153+0000 7f7ee62ba640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ee015ed20 0x7f7ee00af230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:12.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.153+0000 7f7ee62ba640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee00d32a0 con 0x7f7ee015ed20 2024-09-15T23:21:12.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.153+0000 7f7ee62ba640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee00d3e50 con 0x7f7ee00b6970 2024-09-15T23:21:12.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.153+0000 7f7ee62ba640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7ee015f100 con 0x7f7ee00d23b0 2024-09-15T23:21:12.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.153+0000 7f7ee4857640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ee015ed20 0x7f7ee00af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:12.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.153+0000 7f7ee4857640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ee015ed20 0x7f7ee00af230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36294/0 (socket says 172.21.15.123:36294) 2024-09-15T23:21:12.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.153+0000 7f7ee4857640 1 -- 172.21.15.123:0/1370842835 learned_addr learned my addr 172.21.15.123:0/1370842835 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:12.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.154+0000 7f7edffff640 1 --2- 172.21.15.123:0/1370842835 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ee00b6970 0x7f7ee015cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:12.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.154+0000 7f7ee4857640 1 -- 172.21.15.123:0/1370842835 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ee00d23b0 msgr2=0x7f7ee01f4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:12.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.154+0000 7f7ee4857640 1 --2- 172.21.15.123:0/1370842835 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ee00d23b0 0x7f7ee01f4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:12.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.154+0000 7f7ee4857640 1 -- 172.21.15.123:0/1370842835 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ee00b6970 msgr2=0x7f7ee015cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:12.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.154+0000 7f7ee4857640 1 --2- 172.21.15.123:0/1370842835 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ee00b6970 0x7f7ee015cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:12.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.154+0000 7f7ee4857640 1 -- 172.21.15.123:0/1370842835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ee01f57f0 con 0x7f7ee015ed20 2024-09-15T23:21:12.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.154+0000 7f7ee4857640 1 --2- 172.21.15.123:0/1370842835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ee015ed20 0x7f7ee00af230 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8009e80 tx=0x7f7ed8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:12.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.154+0000 7f7edcff9640 1 -- 172.21.15.123:0/1370842835 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed8040070 con 0x7f7ee015ed20 2024-09-15T23:21:12.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.154+0000 7f7edcff9640 1 -- 172.21.15.123:0/1370842835 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ed8031c40 con 0x7f7ee015ed20 2024-09-15T23:21:12.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.154+0000 7f7ee62ba640 1 -- 172.21.15.123:0/1370842835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ee01f5ad0 con 0x7f7ee015ed20 2024-09-15T23:21:12.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.154+0000 7f7edcff9640 1 -- 172.21.15.123:0/1370842835 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed8003990 con 0x7f7ee015ed20 2024-09-15T23:21:12.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.154+0000 7f7ee62ba640 1 -- 172.21.15.123:0/1370842835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ee01f8550 con 0x7f7ee015ed20 2024-09-15T23:21:12.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.155+0000 7f7ee62ba640 1 -- 172.21.15.123:0/1370842835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ee00d0490 con 0x7f7ee015ed20 2024-09-15T23:21:12.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.156+0000 7f7edcff9640 1 -- 172.21.15.123:0/1370842835 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7ed8039040 con 0x7f7ee015ed20 2024-09-15T23:21:12.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.156+0000 7f7edcff9640 1 --2- 172.21.15.123:0/1370842835 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7ecc06c2b0 0x7f7ecc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:12.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.156+0000 7f7edcff9640 1 -- 172.21.15.123:0/1370842835 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 4943+0+0 (secure 0 0 0) 0x7f7ed80ac190 con 0x7f7ee015ed20 2024-09-15T23:21:12.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.156+0000 7f7edffff640 1 --2- 172.21.15.123:0/1370842835 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7ecc06c2b0 0x7f7ecc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:12.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.157+0000 7f7edffff640 1 --2- 172.21.15.123:0/1370842835 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7ecc06c2b0 0x7f7ecc06e770 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0000f60 tx=0x7f7ed0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:12.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.160+0000 7f7edcff9640 1 -- 172.21.15.123:0/1370842835 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7ee00d0490 con 0x7f7ee015ed20 2024-09-15T23:21:12.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.362+0000 7f7ee62ba640 1 -- 172.21.15.123:0/1370842835 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7ee00d1f60 con 0x7f7ee015ed20 2024-09-15T23:21:12.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.363+0000 7f7edcff9640 1 -- 172.21.15.123:0/1370842835 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+3917 (secure 0 0 0) 0x7f7ee00d1f60 con 0x7f7ee015ed20 2024-09-15T23:21:12.364 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:12.364 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":95,"btime":"2024-09-15T23:21:07:527897+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7735,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/3725440007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3725440007},{"type":"v1","addr":"172.21.15.188:6836","nonce":3725440007}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7738,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/2908220643","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":2908220643},{"type":"v1","addr":"172.21.15.188:6837","nonce":2908220643}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":9003,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/2302544827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2302544827},{"type":"v1","addr":"172.21.15.123:6834","nonce":2302544827}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":9474,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/17278563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":17278563},{"type":"v1","addr":"172.21.15.123:6835","nonce":17278563}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95}],"filesystems":[]} 2024-09-15T23:21:12.364 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 95 2024-09-15T23:21:12.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.365+0000 7f7ee62ba640 1 -- 172.21.15.123:0/1370842835 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7ecc06c2b0 msgr2=0x7f7ecc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:12.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.365+0000 7f7ee62ba640 1 --2- 172.21.15.123:0/1370842835 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7ecc06c2b0 0x7f7ecc06e770 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0000f60 tx=0x7f7ed0009040 comp rx=0 tx=0).stop 2024-09-15T23:21:12.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.365+0000 7f7ee62ba640 1 -- 172.21.15.123:0/1370842835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ee015ed20 msgr2=0x7f7ee00af230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:12.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.365+0000 7f7ee62ba640 1 --2- 172.21.15.123:0/1370842835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ee015ed20 0x7f7ee00af230 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8009e80 tx=0x7f7ed8004a40 comp rx=0 tx=0).stop 2024-09-15T23:21:12.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.365+0000 7f7ee62ba640 1 -- 172.21.15.123:0/1370842835 shutdown_connections 2024-09-15T23:21:12.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.365+0000 7f7ee62ba640 1 --2- 172.21.15.123:0/1370842835 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7ecc06c2b0 0x7f7ecc06e770 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:12.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.365+0000 7f7ee62ba640 1 --2- 172.21.15.123:0/1370842835 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ee015ed20 0x7f7ee00af230 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:12.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.365+0000 7f7ee62ba640 1 --2- 172.21.15.123:0/1370842835 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ee00d23b0 0x7f7ee01f4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:12.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.365+0000 7f7ee62ba640 1 --2- 172.21.15.123:0/1370842835 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ee00b6970 0x7f7ee015cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:12.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.365+0000 7f7ee62ba640 1 -- 172.21.15.123:0/1370842835 >> 172.21.15.123:0/1370842835 conn(0x7f7ee00d1260 msgr2=0x7f7ee0161e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:12.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.365+0000 7f7ee62ba640 1 -- 172.21.15.123:0/1370842835 shutdown_connections 2024-09-15T23:21:12.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:12.365+0000 7f7ee62ba640 1 -- 172.21.15.123:0/1370842835 wait complete. 2024-09-15T23:21:12.377 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T23:21:12.377 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T23:21:12.377 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T23:21:12.378 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:21:12.378 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T23:21:12.378 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T23:21:12.378 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T23:21:12.378 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:21:12.378 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T23:21:12.378 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T23:21:12.379 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T23:21:12.379 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:21:12.379 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T23:21:12.379 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T23:21:12.379 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T23:21:12.379 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:21:12.387 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T23:21:12.388 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T23:21:12.391 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T23:21:12.391 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T23:21:12.391 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T23:21:12.392 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T23:21:12.431 INFO:tasks.ceph.mds.c:Started 2024-09-15T23:21:12.432 DEBUG:teuthology.parallel:result is None 2024-09-15T23:21:12.434 INFO:tasks.ceph.mds.b:Started 2024-09-15T23:21:12.435 DEBUG:teuthology.parallel:result is None 2024-09-15T23:21:12.435 INFO:tasks.ceph.mds.d:Started 2024-09-15T23:21:12.436 DEBUG:teuthology.parallel:result is None 2024-09-15T23:21:12.504 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-15T23:21:12.517 INFO:tasks.ceph.mds.b.smithi188.stdout:starting mds.b at 2024-09-15T23:21:12.517 INFO:tasks.ceph.mds.d.smithi188.stdout:starting mds.d at 2024-09-15T23:21:12.593 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-09-15T23:21:12.593 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-09-15T23:21:12.593 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-09-15T23:21:18.388 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T23:21:18.388 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T23:21:18.391 INFO:tasks.ceph.mds.a:Started 2024-09-15T23:21:18.391 DEBUG:teuthology.parallel:result is None 2024-09-15T23:21:18.391 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T23:21:18.480 INFO:tasks.ceph.mds.a.smithi123.stdout:starting mds.a at 2024-09-15T23:21:18.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.505+0000 7f12b4c47640 1 Processor -- start 2024-09-15T23:21:18.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.505+0000 7f12b4c47640 1 -- start start 2024-09-15T23:21:18.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.506+0000 7f12b4c47640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12b0158f80 0x7f12b0071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:18.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.506+0000 7f12b4c47640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f12b015b9a0 0x7f12b00b6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:18.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.506+0000 7f12b4c47640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12b0072930 con 0x7f12b00b70a0 2024-09-15T23:21:18.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.506+0000 7f12b4c47640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f12b00b74d0 con 0x7f12b015b9a0 2024-09-15T23:21:18.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.506+0000 7f12b4c47640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f12b0072c10 con 0x7f12b0158f80 2024-09-15T23:21:18.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.506+0000 7f12a7fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f12b015b9a0 0x7f12b00b6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:18.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.506+0000 7f12aed9d640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f12b00b70a0 0x7f12b015ee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:57206/0 (socket says 172.21.15.123:57206) 2024-09-15T23:21:18.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.506+0000 7f12aed9d640 1 -- 172.21.15.123:0/2400049833 learned_addr learned my addr 172.21.15.123:0/2400049833 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:21:18.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.506+0000 7f12ae59c640 1 --2- 172.21.15.123:0/2400049833 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12b0158f80 0x7f12b0071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:18.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.506+0000 7f12a7fff640 1 -- 172.21.15.123:0/2400049833 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12b0158f80 msgr2=0x7f12b0071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:18.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.506+0000 7f12a7fff640 1 --2- 172.21.15.123:0/2400049833 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12b0158f80 0x7f12b0071fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:18.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.506+0000 7f12a7fff640 1 -- 172.21.15.123:0/2400049833 >> v1:172.21.15.123:6789/0 conn(0x7f12b00b70a0 legacy=0x7f12b015ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:18.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.506+0000 7f12add9b640 1 -- 172.21.15.123:0/2400049833 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2377917938 0 0) 0x7f12b0072930 con 0x7f12b00b70a0 2024-09-15T23:21:18.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.507+0000 7f12a7fff640 1 -- 172.21.15.123:0/2400049833 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12b0072ef0 con 0x7f12b015b9a0 2024-09-15T23:21:18.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.507+0000 7f12a7fff640 1 --2- 172.21.15.123:0/2400049833 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12b015b9a0 0x7f12b00b6b60 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f12980097a0 tx=0x7f129802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c35c91a6d7678d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:18.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.507+0000 7f12add9b640 1 -- 172.21.15.123:0/2400049833 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1298037070 con 0x7f12b015b9a0 2024-09-15T23:21:18.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.507+0000 7f12add9b640 1 -- 172.21.15.123:0/2400049833 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1298032440 con 0x7f12b015b9a0 2024-09-15T23:21:18.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.507+0000 7f12add9b640 1 -- 172.21.15.123:0/2400049833 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1298032810 con 0x7f12b015b9a0 2024-09-15T23:21:18.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.508+0000 7f12b4c47640 1 -- 172.21.15.123:0/2400049833 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12b015b9a0 msgr2=0x7f12b00b6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:18.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.508+0000 7f12b4c47640 1 --2- 172.21.15.123:0/2400049833 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12b015b9a0 0x7f12b00b6b60 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f12980097a0 tx=0x7f129802a180 comp rx=0 tx=0).stop 2024-09-15T23:21:18.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.508+0000 7f12b4c47640 1 -- 172.21.15.123:0/2400049833 shutdown_connections 2024-09-15T23:21:18.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.508+0000 7f12b4c47640 1 --2- 172.21.15.123:0/2400049833 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12b015b9a0 0x7f12b00b6b60 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:18.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.508+0000 7f12b4c47640 1 --2- 172.21.15.123:0/2400049833 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12b0158f80 0x7f12b0071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:18.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.508+0000 7f12b4c47640 1 -- 172.21.15.123:0/2400049833 >> 172.21.15.123:0/2400049833 conn(0x7f12b006cd20 msgr2=0x7f12b006d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:18.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.508+0000 7f12b4c47640 1 -- 172.21.15.123:0/2400049833 shutdown_connections 2024-09-15T23:21:18.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.508+0000 7f12b4c47640 1 -- 172.21.15.123:0/2400049833 wait complete. 2024-09-15T23:21:18.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.509+0000 7f12b4c47640 1 Processor -- start 2024-09-15T23:21:18.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.510+0000 7f12b4c47640 1 -- start start 2024-09-15T23:21:18.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.510+0000 7f12b4c47640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12b00b70a0 0x7f12b014eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:18.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.510+0000 7f12b4c47640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12b0158f80 0x7f12b01497f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:18.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.510+0000 7f12b4c47640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12b015b9a0 0x7f12b0149d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:18.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.510+0000 7f12b4c47640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f12b00d04e0 con 0x7f12b0158f80 2024-09-15T23:21:18.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.510+0000 7f12b4c47640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f12b00734b0 con 0x7f12b00b70a0 2024-09-15T23:21:18.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.510+0000 7f12b4c47640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f12b0072500 con 0x7f12b015b9a0 2024-09-15T23:21:18.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.510+0000 7f12a7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12b0158f80 0x7f12b01497f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:18.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.510+0000 7f12a7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12b0158f80 0x7f12b01497f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57122/0 (socket says 172.21.15.123:57122) 2024-09-15T23:21:18.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.510+0000 7f12a7fff640 1 -- 172.21.15.123:0/1700908988 learned_addr learned my addr 172.21.15.123:0/1700908988 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:18.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.511+0000 7f12ae59c640 1 --2- 172.21.15.123:0/1700908988 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12b00b70a0 0x7f12b014eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:18.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.511+0000 7f12aed9d640 1 --2- 172.21.15.123:0/1700908988 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12b015b9a0 0x7f12b0149d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:18.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.511+0000 7f12a7fff640 1 -- 172.21.15.123:0/1700908988 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12b015b9a0 msgr2=0x7f12b0149d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:18.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.511+0000 7f12a7fff640 1 --2- 172.21.15.123:0/1700908988 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12b015b9a0 0x7f12b0149d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:18.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.511+0000 7f12a7fff640 1 -- 172.21.15.123:0/1700908988 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12b00b70a0 msgr2=0x7f12b014eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:18.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.511+0000 7f12a7fff640 1 --2- 172.21.15.123:0/1700908988 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12b00b70a0 0x7f12b014eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:18.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.511+0000 7f12a7fff640 1 -- 172.21.15.123:0/1700908988 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12b015f6f0 con 0x7f12b0158f80 2024-09-15T23:21:18.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.511+0000 7f12a7fff640 1 --2- 172.21.15.123:0/1700908988 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12b0158f80 0x7f12b01497f0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f12980097a0 tx=0x7f12980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:18.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.511+0000 7f12a6ffd640 1 -- 172.21.15.123:0/1700908988 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1298037050 con 0x7f12b0158f80 2024-09-15T23:21:18.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.511+0000 7f12a6ffd640 1 -- 172.21.15.123:0/1700908988 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1298038040 con 0x7f12b0158f80 2024-09-15T23:21:18.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.511+0000 7f12b4c47640 1 -- 172.21.15.123:0/1700908988 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12b015f9d0 con 0x7f12b0158f80 2024-09-15T23:21:18.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.511+0000 7f12a6ffd640 1 -- 172.21.15.123:0/1700908988 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1298004470 con 0x7f12b0158f80 2024-09-15T23:21:18.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.511+0000 7f12b4c47640 1 -- 172.21.15.123:0/1700908988 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12b015d150 con 0x7f12b0158f80 2024-09-15T23:21:18.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.512+0000 7f12b4c47640 1 -- 172.21.15.123:0/1700908988 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12b00cebf0 con 0x7f12b0158f80 2024-09-15T23:21:18.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.513+0000 7f12a6ffd640 1 -- 172.21.15.123:0/1700908988 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1298030900 con 0x7f12b0158f80 2024-09-15T23:21:18.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.513+0000 7f12a6ffd640 1 --2- 172.21.15.123:0/1700908988 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f129006c2b0 0x7f129006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:18.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.514+0000 7f12a6ffd640 1 -- 172.21.15.123:0/1700908988 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 4943+0+0 (secure 0 0 0) 0x7f12980aba70 con 0x7f12b0158f80 2024-09-15T23:21:18.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.514+0000 7f12ae59c640 1 --2- 172.21.15.123:0/1700908988 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f129006c2b0 0x7f129006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:18.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.514+0000 7f12ae59c640 1 --2- 172.21.15.123:0/1700908988 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f129006c2b0 0x7f129006e770 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f12a0006fd0 tx=0x7f12a0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:18.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.518+0000 7f12a6ffd640 1 -- 172.21.15.123:0/1700908988 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f12b00cebf0 con 0x7f12b0158f80 2024-09-15T23:21:18.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:18.697+0000 7f12b4c47640 1 -- 172.21.15.123:0/1700908988 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f12b00739d0 con 0x7f12b0158f80 2024-09-15T23:21:19.306 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-09-15T23:21:19.306 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-09-15T23:21:19.307 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-09-15T23:21:19.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.690+0000 7f12a6ffd640 1 -- 172.21.15.123:0/1700908988 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v164) ==== 97+0+0 (secure 0 0 0) 0x7f1298079f20 con 0x7f12b0158f80 2024-09-15T23:21:19.691 INFO:teuthology.orchestra.run.smithi123.stderr: removed all blocklist entries 2024-09-15T23:21:19.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.693+0000 7f12b4c47640 1 -- 172.21.15.123:0/1700908988 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f129006c2b0 msgr2=0x7f129006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:19.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.693+0000 7f12b4c47640 1 --2- 172.21.15.123:0/1700908988 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f129006c2b0 0x7f129006e770 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f12a0006fd0 tx=0x7f12a0008040 comp rx=0 tx=0).stop 2024-09-15T23:21:19.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.693+0000 7f12b4c47640 1 -- 172.21.15.123:0/1700908988 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12b0158f80 msgr2=0x7f12b01497f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:19.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.693+0000 7f12b4c47640 1 --2- 172.21.15.123:0/1700908988 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12b0158f80 0x7f12b01497f0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f12980097a0 tx=0x7f12980046c0 comp rx=0 tx=0).stop 2024-09-15T23:21:19.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.693+0000 7f12b4c47640 1 -- 172.21.15.123:0/1700908988 shutdown_connections 2024-09-15T23:21:19.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.693+0000 7f12b4c47640 1 --2- 172.21.15.123:0/1700908988 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12b015b9a0 0x7f12b0149d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:19.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.693+0000 7f12b4c47640 1 --2- 172.21.15.123:0/1700908988 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f129006c2b0 0x7f129006e770 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:19.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.693+0000 7f12b4c47640 1 --2- 172.21.15.123:0/1700908988 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12b0158f80 0x7f12b01497f0 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:19.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.693+0000 7f12b4c47640 1 --2- 172.21.15.123:0/1700908988 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12b00b70a0 0x7f12b014eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:19.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.693+0000 7f12b4c47640 1 -- 172.21.15.123:0/1700908988 >> 172.21.15.123:0/1700908988 conn(0x7f12b006cd20 msgr2=0x7f12b006f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:19.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.693+0000 7f12b4c47640 1 -- 172.21.15.123:0/1700908988 shutdown_connections 2024-09-15T23:21:19.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.693+0000 7f12b4c47640 1 -- 172.21.15.123:0/1700908988 wait complete. 2024-09-15T23:21:19.708 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T23:21:19.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.814+0000 7f7be359e640 1 Processor -- start 2024-09-15T23:21:19.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.814+0000 7f7be359e640 1 -- start start 2024-09-15T23:21:19.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.815+0000 7f7be359e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7be40b7a30 0x7f7be415e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:19.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.815+0000 7f7be359e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7be40cfb40 con 0x7f7be40cf670 2024-09-15T23:21:19.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.815+0000 7f7be359e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7be40cfe20 con 0x7f7be40b63f0 2024-09-15T23:21:19.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.815+0000 7f7be359e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f7be40d27f0 con 0x7f7be40b7a30 2024-09-15T23:21:19.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.815+0000 7f7be1d9b640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7be40cf670 0x7f7be415df80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:57220/0 (socket says 172.21.15.123:57220) 2024-09-15T23:21:19.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.815+0000 7f7be1d9b640 1 -- 172.21.15.123:0/283344625 learned_addr learned my addr 172.21.15.123:0/283344625 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:21:19.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.815+0000 7f7be2d9d640 1 --2- 172.21.15.123:0/283344625 >> v2:172.21.15.188:3300/0 conn(0x7f7be40b7a30 0x7f7be415e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:19.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.815+0000 7f7be159a640 1 -- 172.21.15.123:0/283344625 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3885495876 0 0) 0x7f7be40cfb40 con 0x7f7be40cf670 2024-09-15T23:21:19.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.815+0000 7f7be159a640 1 -- 172.21.15.123:0/283344625 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bcc003520 con 0x7f7be40cf670 2024-09-15T23:21:19.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.815+0000 7f7be159a640 1 -- 172.21.15.123:0/283344625 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2626213726 0 0) 0x7f7bcc003520 con 0x7f7be40cf670 2024-09-15T23:21:19.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.815+0000 7f7be159a640 1 -- 172.21.15.123:0/283344625 >> v2:172.21.15.188:3300/0 conn(0x7f7be40b7a30 msgr2=0x7f7be415e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:19.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.815+0000 7f7be159a640 1 --2- 172.21.15.123:0/283344625 >> v2:172.21.15.188:3300/0 conn(0x7f7be40b7a30 0x7f7be415e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:19.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.815+0000 7f7be159a640 1 -- 172.21.15.123:0/283344625 >> v1:172.21.15.188:6789/0 conn(0x7f7be40b63f0 legacy=0x7f7be40cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:19.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.815+0000 7f7be159a640 1 -- 172.21.15.123:0/283344625 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be40d2e00 con 0x7f7be40cf670 2024-09-15T23:21:19.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.815+0000 7f7be159a640 1 -- 172.21.15.123:0/283344625 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f7bd80019f0 con 0x7f7be40cf670 2024-09-15T23:21:19.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.815+0000 7f7be159a640 1 -- 172.21.15.123:0/283344625 >> v1:172.21.15.123:6789/0 conn(0x7f7be40cf670 legacy=0x7f7be415df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:19.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.815+0000 7f7be159a640 1 --2- 172.21.15.123:0/283344625 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7bcc0039b0 0x7f7bcc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:19.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.815+0000 7f7be159a640 1 --2- 172.21.15.123:0/283344625 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7bcc004800 0x7f7bcc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:19.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.815+0000 7f7be159a640 1 --2- 172.21.15.123:0/283344625 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7bcc0051c0 0x7f7bcc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:19.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.815+0000 7f7be159a640 1 -- 172.21.15.123:0/283344625 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7bcc00c130 con 0x7f7bcc004800 2024-09-15T23:21:19.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.815+0000 7f7be159a640 1 -- 172.21.15.123:0/283344625 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7bcc00c2e0 con 0x7f7bcc0039b0 2024-09-15T23:21:19.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.815+0000 7f7be159a640 1 -- 172.21.15.123:0/283344625 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7bcc00c4e0 con 0x7f7bcc0051c0 2024-09-15T23:21:19.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.815+0000 7f7be1d9b640 1 --2- 172.21.15.123:0/283344625 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7bcc004800 0x7f7bcc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:19.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.816+0000 7f7be259c640 1 --2- 172.21.15.123:0/283344625 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7bcc0039b0 0x7f7bcc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:19.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.816+0000 7f7be2d9d640 1 --2- 172.21.15.123:0/283344625 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7bcc0051c0 0x7f7bcc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:19.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.816+0000 7f7be1d9b640 1 -- 172.21.15.123:0/283344625 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7bcc0051c0 msgr2=0x7f7bcc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:19.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.816+0000 7f7be1d9b640 1 --2- 172.21.15.123:0/283344625 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7bcc0051c0 0x7f7bcc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:19.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.816+0000 7f7be1d9b640 1 -- 172.21.15.123:0/283344625 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7bcc0039b0 msgr2=0x7f7bcc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:19.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.816+0000 7f7be1d9b640 1 --2- 172.21.15.123:0/283344625 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7bcc0039b0 0x7f7bcc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:19.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.816+0000 7f7be1d9b640 1 -- 172.21.15.123:0/283344625 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bcc003520 con 0x7f7bcc004800 2024-09-15T23:21:19.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.816+0000 7f7be2d9d640 1 -- 172.21.15.123:0/283344625 reap_dead start 2024-09-15T23:21:19.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.816+0000 7f7be1d9b640 1 --2- 172.21.15.123:0/283344625 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7bcc004800 0x7f7bcc004c80 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800a810 tx=0x7f7bcc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d760406e02ce5735 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:19.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.817+0000 7f7be159a640 1 -- 172.21.15.123:0/283344625 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd800a460 con 0x7f7bcc004800 2024-09-15T23:21:19.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.817+0000 7f7be159a640 1 -- 172.21.15.123:0/283344625 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bd802f070 con 0x7f7bcc004800 2024-09-15T23:21:19.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.817+0000 7f7be159a640 1 -- 172.21.15.123:0/283344625 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd802bc20 con 0x7f7bcc004800 2024-09-15T23:21:19.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.817+0000 7f7be359e640 1 -- 172.21.15.123:0/283344625 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7bcc004800 msgr2=0x7f7bcc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:19.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.817+0000 7f7be359e640 1 --2- 172.21.15.123:0/283344625 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7bcc004800 0x7f7bcc004c80 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800a810 tx=0x7f7bcc005830 comp rx=0 tx=0).stop 2024-09-15T23:21:19.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.817+0000 7f7be359e640 1 -- 172.21.15.123:0/283344625 shutdown_connections 2024-09-15T23:21:19.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.817+0000 7f7be359e640 1 --2- 172.21.15.123:0/283344625 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7bcc004800 0x7f7bcc004c80 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:19.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.817+0000 7f7be359e640 1 -- 172.21.15.123:0/283344625 >> 172.21.15.123:0/283344625 conn(0x7f7be40d1360 msgr2=0x7f7be40d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:19.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.817+0000 7f7be359e640 1 -- 172.21.15.123:0/283344625 shutdown_connections 2024-09-15T23:21:19.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.817+0000 7f7be359e640 1 -- 172.21.15.123:0/283344625 wait complete. 2024-09-15T23:21:19.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.819+0000 7f7be359e640 1 Processor -- start 2024-09-15T23:21:19.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.819+0000 7f7be359e640 1 -- start start 2024-09-15T23:21:19.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.819+0000 7f7be359e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7bcc004800 0x7f7be4150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:19.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.819+0000 7f7be359e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7be41f4a70 0x7f7be4152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:19.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.819+0000 7f7be359e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7be4150710 0x7f7be4158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:19.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.819+0000 7f7be359e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7be40b6950 con 0x7f7be41f4a70 2024-09-15T23:21:19.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.819+0000 7f7be359e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7be40b67d0 con 0x7f7be4150710 2024-09-15T23:21:19.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.819+0000 7f7be359e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7be40b6ad0 con 0x7f7bcc004800 2024-09-15T23:21:19.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.819+0000 7f7be1d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7be41f4a70 0x7f7be4152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:19.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.819+0000 7f7be1d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7be41f4a70 0x7f7be4152a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57142/0 (socket says 172.21.15.123:57142) 2024-09-15T23:21:19.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.819+0000 7f7be1d9b640 1 -- 172.21.15.123:0/4053008717 learned_addr learned my addr 172.21.15.123:0/4053008717 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:19.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.820+0000 7f7be2d9d640 1 --2- 172.21.15.123:0/4053008717 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7be4150710 0x7f7be4158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:19.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.820+0000 7f7be259c640 1 --2- 172.21.15.123:0/4053008717 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7bcc004800 0x7f7be4150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:19.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.820+0000 7f7be1d9b640 1 -- 172.21.15.123:0/4053008717 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7bcc004800 msgr2=0x7f7be4150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:19.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.820+0000 7f7be1d9b640 1 --2- 172.21.15.123:0/4053008717 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7bcc004800 0x7f7be4150f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:19.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.820+0000 7f7be1d9b640 1 -- 172.21.15.123:0/4053008717 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7be4150710 msgr2=0x7f7be4158420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:19.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.820+0000 7f7be1d9b640 1 --2- 172.21.15.123:0/4053008717 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7be4150710 0x7f7be4158420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:19.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.820+0000 7f7be1d9b640 1 -- 172.21.15.123:0/4053008717 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be41515f0 con 0x7f7be41f4a70 2024-09-15T23:21:19.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.820+0000 7f7be1d9b640 1 --2- 172.21.15.123:0/4053008717 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7be41f4a70 0x7f7be4152a10 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800a810 tx=0x7f7be40cfff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:19.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.820+0000 7f7bd2ffd640 1 -- 172.21.15.123:0/4053008717 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8044070 con 0x7f7be41f4a70 2024-09-15T23:21:19.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.820+0000 7f7bd2ffd640 1 -- 172.21.15.123:0/4053008717 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bd8001a40 con 0x7f7be41f4a70 2024-09-15T23:21:19.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.820+0000 7f7be359e640 1 -- 172.21.15.123:0/4053008717 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7be41518d0 con 0x7f7be41f4a70 2024-09-15T23:21:19.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.820+0000 7f7bd2ffd640 1 -- 172.21.15.123:0/4053008717 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8001fb0 con 0x7f7be41f4a70 2024-09-15T23:21:19.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.820+0000 7f7be359e640 1 -- 172.21.15.123:0/4053008717 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7be4154ed0 con 0x7f7be41f4a70 2024-09-15T23:21:19.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.821+0000 7f7be359e640 1 -- 172.21.15.123:0/4053008717 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7be40cef60 con 0x7f7be41f4a70 2024-09-15T23:21:19.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.822+0000 7f7bd2ffd640 1 -- 172.21.15.123:0/4053008717 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7bd8047070 con 0x7f7be41f4a70 2024-09-15T23:21:19.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.822+0000 7f7bd2ffd640 1 --2- 172.21.15.123:0/4053008717 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7bc406c2b0 0x7f7bc406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:19.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.822+0000 7f7bd2ffd640 1 -- 172.21.15.123:0/4053008717 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(164..164 src has 1..164) ==== 4857+0+0 (secure 0 0 0) 0x7f7bd80aadf0 con 0x7f7be41f4a70 2024-09-15T23:21:19.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.822+0000 7f7be259c640 1 --2- 172.21.15.123:0/4053008717 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7bc406c2b0 0x7f7bc406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:19.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.823+0000 7f7be259c640 1 --2- 172.21.15.123:0/4053008717 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7bc406c2b0 0x7f7bc406e770 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc000c00 tx=0x7f7bdc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:19.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:19.826+0000 7f7bd2ffd640 1 -- 172.21.15.123:0/4053008717 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7bd80792f0 con 0x7f7be41f4a70 2024-09-15T23:21:20.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.057+0000 7f7be359e640 1 -- 172.21.15.123:0/4053008717 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f7be41f4ed0 con 0x7f7be41f4a70 2024-09-15T23:21:20.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.057+0000 7f7bd2ffd640 1 -- 172.21.15.123:0/4053008717 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) ==== 80+0+5304 (secure 0 0 0) 0x7f7bd807d5f0 con 0x7f7be41f4a70 2024-09-15T23:21:20.058 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:20.058 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:21:20.058 INFO:teuthology.orchestra.run.smithi123.stdout: "auth_dump": [ 2024-09-15T23:21:20.059 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:21:20.059 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.a", 2024-09-15T23:21:20.059 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm9ATVDhAAnukyZogTuG4YCbzRXSCkiQ==", 2024-09-15T23:21:20.059 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:21:20.059 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:21:20.059 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:21:20.059 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:21:20.059 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:21:20.059 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:21:20.059 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:21:20.059 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:21:20.059 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.b", 2024-09-15T23:21:20.059 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm4KmaGhAAbf6vcffqiJTOYXK5DCXcZA==", 2024-09-15T23:21:20.060 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:21:20.060 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:21:20.060 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:21:20.060 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:21:20.060 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:21:20.060 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:21:20.060 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:21:20.060 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:21:20.060 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.c", 2024-09-15T23:21:20.060 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmua/VFRAAwbPm2TslrfQkrvHiO8oeLg==", 2024-09-15T23:21:20.060 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:21:20.060 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:21:20.060 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:21:20.061 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:21:20.061 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:21:20.061 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:21:20.061 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:21:20.061 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:21:20.061 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.d", 2024-09-15T23:21:20.061 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmzw3eIRAAaE+5y9USwp+xM3MTAndn7Q==", 2024-09-15T23:21:20.061 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:21:20.061 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:21:20.061 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:21:20.061 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:21:20.061 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:21:20.061 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:21:20.061 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:21:20.062 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:21:20.062 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.0", 2024-09-15T23:21:20.062 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCRaedmFrHGAxAAy/jTkothESNn2DC9xcHDAQ==", 2024-09-15T23:21:20.062 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:21:20.062 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:21:20.062 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:21:20.062 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:21:20.062 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:21:20.062 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:21:20.062 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:21:20.062 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.1", 2024-09-15T23:21:20.062 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCUaedm6vZlIxAAdsnLqFSng6SRpCT6UZKGsw==", 2024-09-15T23:21:20.063 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:21:20.063 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:21:20.063 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:21:20.063 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:21:20.063 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:21:20.063 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:21:20.063 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:21:20.063 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.2", 2024-09-15T23:21:20.063 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCYaedmXgVwFRAA1mOzzRafhKMsU7kTAT6TqA==", 2024-09-15T23:21:20.063 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:21:20.063 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:21:20.063 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:21:20.063 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:21:20.063 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:21:20.064 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:21:20.064 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:21:20.064 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.3", 2024-09-15T23:21:20.064 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCcaedm+APAFhAAb8blNFzswwHriSmCrMuA0A==", 2024-09-15T23:21:20.064 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:21:20.064 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:21:20.064 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:21:20.064 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:21:20.064 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:21:20.064 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:21:20.064 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:21:20.064 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.4", 2024-09-15T23:21:20.064 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCjaedmReUmABAAXpxsK7osxn/ZelVXKiCLOw==", 2024-09-15T23:21:20.065 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:21:20.065 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:21:20.065 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:21:20.065 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:21:20.065 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:21:20.065 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:21:20.065 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:21:20.065 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.5", 2024-09-15T23:21:20.065 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCnaedmtbdmARAAdxguBdtwBmtiaIx/y992GA==", 2024-09-15T23:21:20.065 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:21:20.065 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:21:20.065 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:21:20.065 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:21:20.065 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:21:20.066 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:21:20.066 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:21:20.066 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.6", 2024-09-15T23:21:20.066 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCraedmkR+NAxAAd2GAAH0BgOMonU8iTSn+Fw==", 2024-09-15T23:21:20.066 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:21:20.066 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:21:20.066 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:21:20.066 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:21:20.066 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:21:20.066 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:21:20.066 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:21:20.066 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.7", 2024-09-15T23:21:20.066 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCvaedmAaCwBBAAdpDtCbXchArmy019wiOdSQ==", 2024-09-15T23:21:20.066 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:21:20.067 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:21:20.067 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:21:20.067 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:21:20.067 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:21:20.067 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:21:20.067 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:21:20.067 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.0", 2024-09-15T23:21:20.067 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmzQPqJRAAhUf1dnVYohN4obCfeu8+7g==", 2024-09-15T23:21:20.067 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:21:20.067 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:21:20.067 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow r", 2024-09-15T23:21:20.067 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-15T23:21:20.067 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:21:20.068 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:21:20.068 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:21:20.068 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.1", 2024-09-15T23:21:20.068 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmdKK0LhAAXXmUkxVwMEjRTRXUh9CL/g==", 2024-09-15T23:21:20.068 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:21:20.068 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:21:20.068 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:21:20.068 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:21:20.068 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:21:20.068 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:21:20.068 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:21:20.068 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:21:20.068 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.2", 2024-09-15T23:21:20.068 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmRz55KxAARi7B4WYOY1QqH1CK81z9pA==", 2024-09-15T23:21:20.069 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:21:20.069 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:21:20.069 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:21:20.069 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:21:20.069 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:21:20.069 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:21:20.069 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:21:20.069 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:21:20.069 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.3", 2024-09-15T23:21:20.069 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmbWo8NBAAR1qGX1bs35ojx6lMxftcfg==", 2024-09-15T23:21:20.069 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:21:20.069 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:21:20.069 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:21:20.069 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:21:20.070 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:21:20.070 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:21:20.070 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:21:20.070 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:21:20.070 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.admin", 2024-09-15T23:21:20.070 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCMaedmVUW0LhAAqgPFk1HtxsZXcIStNN43pA==", 2024-09-15T23:21:20.070 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:21:20.070 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:21:20.070 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:21:20.070 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:21:20.070 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:21:20.070 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:21:20.070 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:21:20.071 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:21:20.071 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.x", 2024-09-15T23:21:20.071 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmGPSBCxAAHAhXQERogdAOm0ZPNtlxpw==", 2024-09-15T23:21:20.071 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:21:20.071 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:21:20.071 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-15T23:21:20.071 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:21:20.071 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:21:20.071 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:21:20.071 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:21:20.071 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.y", 2024-09-15T23:21:20.071 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm5Om4BxAA/7ZtMMlbUA3bvMCfaNMQyg==", 2024-09-15T23:21:20.071 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:21:20.071 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:21:20.072 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-15T23:21:20.072 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:21:20.072 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:21:20.072 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:21:20.072 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-15T23:21:20.072 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:21:20.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.059+0000 7f7be359e640 1 -- 172.21.15.123:0/4053008717 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7bc406c2b0 msgr2=0x7f7bc406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:20.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.059+0000 7f7be359e640 1 --2- 172.21.15.123:0/4053008717 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7bc406c2b0 0x7f7bc406e770 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc000c00 tx=0x7f7bdc009040 comp rx=0 tx=0).stop 2024-09-15T23:21:20.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.059+0000 7f7be359e640 1 -- 172.21.15.123:0/4053008717 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7be41f4a70 msgr2=0x7f7be4152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:20.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.059+0000 7f7be359e640 1 --2- 172.21.15.123:0/4053008717 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7be41f4a70 0x7f7be4152a10 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800a810 tx=0x7f7be40cfff0 comp rx=0 tx=0).stop 2024-09-15T23:21:20.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.059+0000 7f7be359e640 1 -- 172.21.15.123:0/4053008717 shutdown_connections 2024-09-15T23:21:20.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.059+0000 7f7be359e640 1 --2- 172.21.15.123:0/4053008717 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7be4150710 0x7f7be4158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:20.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.059+0000 7f7be359e640 1 --2- 172.21.15.123:0/4053008717 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7bc406c2b0 0x7f7bc406e770 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:20.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.059+0000 7f7be359e640 1 --2- 172.21.15.123:0/4053008717 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7be41f4a70 0x7f7be4152a10 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:20.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.059+0000 7f7be359e640 1 --2- 172.21.15.123:0/4053008717 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7bcc004800 0x7f7be4150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:20.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.059+0000 7f7be359e640 1 -- 172.21.15.123:0/4053008717 >> 172.21.15.123:0/4053008717 conn(0x7f7be40d1360 msgr2=0x7f7be415c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:20.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.059+0000 7f7be359e640 1 -- 172.21.15.123:0/4053008717 shutdown_connections 2024-09-15T23:21:20.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.059+0000 7f7be359e640 1 -- 172.21.15.123:0/4053008717 wait complete. 2024-09-15T23:21:20.075 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T23:21:20.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.173+0000 7f46d9a1e640 1 Processor -- start 2024-09-15T23:21:20.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.173+0000 7f46d9a1e640 1 -- start start 2024-09-15T23:21:20.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.173+0000 7f46d9a1e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f46d415eab0 0x7f46d415ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:20.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.173+0000 7f46d9a1e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46d40b66b0 0x7f46d40b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:20.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.173+0000 7f46d9a1e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46d415f570 con 0x7f46d4162490 2024-09-15T23:21:20.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.173+0000 7f46d9a1e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f46d40b7040 con 0x7f46d415eab0 2024-09-15T23:21:20.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.173+0000 7f46d9a1e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f46d415f850 con 0x7f46d40b66b0 2024-09-15T23:21:20.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.174+0000 7f46d37fe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46d40b66b0 0x7f46d40b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:20.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.174+0000 7f46d37fe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46d40b66b0 0x7f46d40b6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:57168/0 (socket says 172.21.15.123:57168) 2024-09-15T23:21:20.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.174+0000 7f46d37fe640 1 -- 172.21.15.123:0/3367407422 learned_addr learned my addr 172.21.15.123:0/3367407422 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:20.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.174+0000 7f46d2ffd640 1 --2- 172.21.15.123:0/3367407422 >> v2:172.21.15.188:3300/0 conn(0x7f46d415eab0 0x7f46d415ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:20.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.174+0000 7f46d37fe640 1 -- 172.21.15.123:0/3367407422 >> v2:172.21.15.188:3300/0 conn(0x7f46d415eab0 msgr2=0x7f46d415ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:20.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.174+0000 7f46d37fe640 1 --2- 172.21.15.123:0/3367407422 >> v2:172.21.15.188:3300/0 conn(0x7f46d415eab0 0x7f46d415ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:20.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.174+0000 7f46d37fe640 1 -- 172.21.15.123:0/3367407422 >> v1:172.21.15.188:6789/0 conn(0x7f46d4162490 legacy=0x7f46d40d2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:20.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.174+0000 7f46d37fe640 1 -- 172.21.15.123:0/3367407422 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46d415fb30 con 0x7f46d40b66b0 2024-09-15T23:21:20.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.175+0000 7f46d37fe640 1 --2- 172.21.15.123:0/3367407422 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46d40b66b0 0x7f46d40b6b00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f46c4009e50 tx=0x7f46c402a6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad0cf3562646178e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:20.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.175+0000 7f46d1ffb640 1 -- 172.21.15.123:0/3367407422 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c4036070 con 0x7f46d40b66b0 2024-09-15T23:21:20.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.175+0000 7f46d1ffb640 1 -- 172.21.15.123:0/3367407422 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46c4031600 con 0x7f46d40b66b0 2024-09-15T23:21:20.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.175+0000 7f46d1ffb640 1 -- 172.21.15.123:0/3367407422 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c40319d0 con 0x7f46d40b66b0 2024-09-15T23:21:20.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.176+0000 7f46d9a1e640 1 -- 172.21.15.123:0/3367407422 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46d40b66b0 msgr2=0x7f46d40b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:20.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.176+0000 7f46d9a1e640 1 --2- 172.21.15.123:0/3367407422 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46d40b66b0 0x7f46d40b6b00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f46c4009e50 tx=0x7f46c402a6c0 comp rx=0 tx=0).stop 2024-09-15T23:21:20.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.176+0000 7f46d9a1e640 1 -- 172.21.15.123:0/3367407422 shutdown_connections 2024-09-15T23:21:20.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.176+0000 7f46d9a1e640 1 --2- 172.21.15.123:0/3367407422 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46d40b66b0 0x7f46d40b6b00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:20.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.176+0000 7f46d9a1e640 1 --2- 172.21.15.123:0/3367407422 >> v2:172.21.15.188:3300/0 conn(0x7f46d415eab0 0x7f46d415ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:20.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.176+0000 7f46d9a1e640 1 -- 172.21.15.123:0/3367407422 >> 172.21.15.123:0/3367407422 conn(0x7f46d40d16d0 msgr2=0x7f46d40d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:20.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.176+0000 7f46d9a1e640 1 -- 172.21.15.123:0/3367407422 shutdown_connections 2024-09-15T23:21:20.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.176+0000 7f46d9a1e640 1 -- 172.21.15.123:0/3367407422 wait complete. 2024-09-15T23:21:20.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.177+0000 7f46d9a1e640 1 Processor -- start 2024-09-15T23:21:20.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.177+0000 7f46d9a1e640 1 -- start start 2024-09-15T23:21:20.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.178+0000 7f46d9a1e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46d40b66b0 0x7f46d40cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:20.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.178+0000 7f46d9a1e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46d415eab0 0x7f46d414a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:20.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.178+0000 7f46d9a1e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46d4162490 0x7f46d40cca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:20.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.178+0000 7f46d9a1e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f46d40d4460 con 0x7f46d4162490 2024-09-15T23:21:20.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.178+0000 7f46d9a1e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f46d40cef20 con 0x7f46d415eab0 2024-09-15T23:21:20.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.178+0000 7f46d9a1e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f46d40d45e0 con 0x7f46d40b66b0 2024-09-15T23:21:20.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.178+0000 7f46d37fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46d4162490 0x7f46d40cca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:20.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.178+0000 7f46d37fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46d4162490 0x7f46d40cca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57154/0 (socket says 172.21.15.123:57154) 2024-09-15T23:21:20.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.178+0000 7f46d37fe640 1 -- 172.21.15.123:0/3855678592 learned_addr learned my addr 172.21.15.123:0/3855678592 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:20.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.178+0000 7f46d2ffd640 1 --2- 172.21.15.123:0/3855678592 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46d40b66b0 0x7f46d40cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:20.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.178+0000 7f46d27fc640 1 --2- 172.21.15.123:0/3855678592 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46d415eab0 0x7f46d414a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:20.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.178+0000 7f46d37fe640 1 -- 172.21.15.123:0/3855678592 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46d40b66b0 msgr2=0x7f46d40cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:20.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.178+0000 7f46d37fe640 1 --2- 172.21.15.123:0/3855678592 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46d40b66b0 0x7f46d40cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:20.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.178+0000 7f46d37fe640 1 -- 172.21.15.123:0/3855678592 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46d415eab0 msgr2=0x7f46d414a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:20.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.178+0000 7f46d37fe640 1 --2- 172.21.15.123:0/3855678592 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46d415eab0 0x7f46d414a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:20.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.178+0000 7f46d37fe640 1 -- 172.21.15.123:0/3855678592 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46d41e8640 con 0x7f46d4162490 2024-09-15T23:21:20.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.178+0000 7f46d2ffd640 1 --2- 172.21.15.123:0/3855678592 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46d40b66b0 0x7f46d40cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:21:20.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.178+0000 7f46d27fc640 1 --2- 172.21.15.123:0/3855678592 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46d415eab0 0x7f46d414a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:21:20.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.179+0000 7f46d37fe640 1 --2- 172.21.15.123:0/3855678592 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46d4162490 0x7f46d40cca80 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f46c4034040 tx=0x7f46c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:20.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.179+0000 7f46bbfff640 1 -- 172.21.15.123:0/3855678592 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c4036050 con 0x7f46d4162490 2024-09-15T23:21:20.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.179+0000 7f46d9a1e640 1 -- 172.21.15.123:0/3855678592 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46d41e8920 con 0x7f46d4162490 2024-09-15T23:21:20.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.179+0000 7f46bbfff640 1 -- 172.21.15.123:0/3855678592 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46c4042070 con 0x7f46d4162490 2024-09-15T23:21:20.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.179+0000 7f46bbfff640 1 -- 172.21.15.123:0/3855678592 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c4009510 con 0x7f46d4162490 2024-09-15T23:21:20.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.179+0000 7f46d9a1e640 1 -- 172.21.15.123:0/3855678592 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46d40ccfc0 con 0x7f46d4162490 2024-09-15T23:21:20.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.180+0000 7f46d9a1e640 1 -- 172.21.15.123:0/3855678592 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46d40b6b00 con 0x7f46d4162490 2024-09-15T23:21:20.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.180+0000 7f46bbfff640 1 -- 172.21.15.123:0/3855678592 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f46c4007bd0 con 0x7f46d4162490 2024-09-15T23:21:20.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.181+0000 7f46bbfff640 1 --2- 172.21.15.123:0/3855678592 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f46c006c2e0 0x7f46c006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:20.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.181+0000 7f46bbfff640 1 -- 172.21.15.123:0/3855678592 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(164..164 src has 1..164) ==== 4857+0+0 (secure 0 0 0) 0x7f46c40ac020 con 0x7f46d4162490 2024-09-15T23:21:20.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.181+0000 7f46d2ffd640 1 --2- 172.21.15.123:0/3855678592 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f46c006c2e0 0x7f46c006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:20.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.181+0000 7f46d2ffd640 1 --2- 172.21.15.123:0/3855678592 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f46c006c2e0 0x7f46c006e7a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f46cc006fd0 tx=0x7f46cc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:20.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.185+0000 7f46bbfff640 1 -- 172.21.15.123:0/3855678592 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f46c407aa60 con 0x7f46d4162490 2024-09-15T23:21:20.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.351+0000 7f46d9a1e640 1 -- 172.21.15.123:0/3855678592 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f46d40cb690 con 0x7f46d4162490 2024-09-15T23:21:20.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.351+0000 7f46bbfff640 1 -- 172.21.15.123:0/3855678592 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v164) ==== 84+0+65 (secure 0 0 0) 0x7f46c407a360 con 0x7f46d4162490 2024-09-15T23:21:20.353 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:20.353 INFO:teuthology.orchestra.run.smithi123.stdout:[ 2024-09-15T23:21:20.353 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:21:20.353 INFO:teuthology.orchestra.run.smithi123.stdout: "poolnum": 1, 2024-09-15T23:21:20.353 INFO:teuthology.orchestra.run.smithi123.stdout: "poolname": ".mgr" 2024-09-15T23:21:20.353 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:21:20.353 INFO:teuthology.orchestra.run.smithi123.stdout:] 2024-09-15T23:21:20.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.353+0000 7f46d9a1e640 1 -- 172.21.15.123:0/3855678592 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f46c006c2e0 msgr2=0x7f46c006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:20.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.353+0000 7f46d9a1e640 1 --2- 172.21.15.123:0/3855678592 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f46c006c2e0 0x7f46c006e7a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f46cc006fd0 tx=0x7f46cc008040 comp rx=0 tx=0).stop 2024-09-15T23:21:20.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.353+0000 7f46d9a1e640 1 -- 172.21.15.123:0/3855678592 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46d4162490 msgr2=0x7f46d40cca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:20.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.353+0000 7f46d9a1e640 1 --2- 172.21.15.123:0/3855678592 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46d4162490 0x7f46d40cca80 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f46c4034040 tx=0x7f46c4004a40 comp rx=0 tx=0).stop 2024-09-15T23:21:20.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.354+0000 7f46d9a1e640 1 -- 172.21.15.123:0/3855678592 shutdown_connections 2024-09-15T23:21:20.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.354+0000 7f46d9a1e640 1 --2- 172.21.15.123:0/3855678592 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f46c006c2e0 0x7f46c006e7a0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:20.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.354+0000 7f46d9a1e640 1 --2- 172.21.15.123:0/3855678592 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46d4162490 0x7f46d40cca80 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:20.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.354+0000 7f46d9a1e640 1 --2- 172.21.15.123:0/3855678592 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46d415eab0 0x7f46d414a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:20.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.354+0000 7f46d9a1e640 1 --2- 172.21.15.123:0/3855678592 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46d40b66b0 0x7f46d40cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:20.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.354+0000 7f46d9a1e640 1 -- 172.21.15.123:0/3855678592 >> 172.21.15.123:0/3855678592 conn(0x7f46d40d16d0 msgr2=0x7f46d40d1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:20.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.354+0000 7f46d9a1e640 1 -- 172.21.15.123:0/3855678592 shutdown_connections 2024-09-15T23:21:20.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.354+0000 7f46d9a1e640 1 -- 172.21.15.123:0/3855678592 wait complete. 2024-09-15T23:21:20.366 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T23:21:20.366 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T23:21:20.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.467+0000 7f256c12c640 1 Processor -- start 2024-09-15T23:21:20.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.467+0000 7f256c12c640 1 -- start start 2024-09-15T23:21:20.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.468+0000 7f256c12c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f256415c470 0x7f256415edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:20.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.468+0000 7f256c12c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2564073030 0x7f256406ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:20.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.468+0000 7f256c12c640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2564073910 con 0x7f25640b4750 2024-09-15T23:21:20.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.468+0000 7f256c12c640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f256415c850 con 0x7f256415c470 2024-09-15T23:21:20.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.468+0000 7f256c12c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f25640b4bc0 con 0x7f2564073030 2024-09-15T23:21:20.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.468+0000 7f2569ec8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f256415c470 0x7f256415edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:20.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.468+0000 7f2569ec8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f256415c470 0x7f256415edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57166/0 (socket says 172.21.15.123:57166) 2024-09-15T23:21:20.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.468+0000 7f25696c7640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f25640b4750 0x7f2564072920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:57230/0 (socket says 172.21.15.123:57230) 2024-09-15T23:21:20.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.468+0000 7f2569ec8640 1 -- 172.21.15.123:0/675238248 learned_addr learned my addr 172.21.15.123:0/675238248 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:20.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.468+0000 7f256a6c9640 1 --2- 172.21.15.123:0/675238248 >> v2:172.21.15.188:3300/0 conn(0x7f2564073030 0x7f256406ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:20.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.469+0000 7f2569ec8640 1 -- 172.21.15.123:0/675238248 >> v2:172.21.15.188:3300/0 conn(0x7f2564073030 msgr2=0x7f256406ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:20.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.469+0000 7f2569ec8640 1 --2- 172.21.15.123:0/675238248 >> v2:172.21.15.188:3300/0 conn(0x7f2564073030 0x7f256406ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:20.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.469+0000 7f2569ec8640 1 -- 172.21.15.123:0/675238248 >> v1:172.21.15.123:6789/0 conn(0x7f25640b4750 legacy=0x7f2564072920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:20.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.469+0000 7f2568ec6640 1 -- 172.21.15.123:0/675238248 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2247294974 0 0) 0x7f2564073910 con 0x7f25640b4750 2024-09-15T23:21:20.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.469+0000 7f2569ec8640 1 -- 172.21.15.123:0/675238248 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25640b4de0 con 0x7f256415c470 2024-09-15T23:21:20.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.469+0000 7f256a6c9640 1 --2- 172.21.15.123:0/675238248 >> v2:172.21.15.188:3300/0 conn(0x7f2564073030 0x7f256406ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:21:20.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.469+0000 7f2569ec8640 1 --2- 172.21.15.123:0/675238248 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f256415c470 0x7f256415edb0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f25641622e0 tx=0x7f255402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d510d5a13439bcc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:20.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.469+0000 7f2568ec6640 1 -- 172.21.15.123:0/675238248 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2554037070 con 0x7f256415c470 2024-09-15T23:21:20.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.469+0000 7f2568ec6640 1 -- 172.21.15.123:0/675238248 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2554032440 con 0x7f256415c470 2024-09-15T23:21:20.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.469+0000 7f2568ec6640 1 -- 172.21.15.123:0/675238248 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2554032810 con 0x7f256415c470 2024-09-15T23:21:20.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.470+0000 7f256c12c640 1 -- 172.21.15.123:0/675238248 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f256415c470 msgr2=0x7f256415edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:20.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.470+0000 7f256c12c640 1 --2- 172.21.15.123:0/675238248 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f256415c470 0x7f256415edb0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f25641622e0 tx=0x7f255402a270 comp rx=0 tx=0).stop 2024-09-15T23:21:20.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.470+0000 7f256c12c640 1 -- 172.21.15.123:0/675238248 shutdown_connections 2024-09-15T23:21:20.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.470+0000 7f256c12c640 1 --2- 172.21.15.123:0/675238248 >> v2:172.21.15.188:3300/0 conn(0x7f2564073030 0x7f256406ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:20.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.470+0000 7f256c12c640 1 --2- 172.21.15.123:0/675238248 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f256415c470 0x7f256415edb0 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:20.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.470+0000 7f256c12c640 1 -- 172.21.15.123:0/675238248 >> 172.21.15.123:0/675238248 conn(0x7f256406c030 msgr2=0x7f256406c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:20.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.470+0000 7f256c12c640 1 -- 172.21.15.123:0/675238248 shutdown_connections 2024-09-15T23:21:20.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.470+0000 7f256c12c640 1 -- 172.21.15.123:0/675238248 wait complete. 2024-09-15T23:21:20.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.471+0000 7f256c12c640 1 Processor -- start 2024-09-15T23:21:20.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.471+0000 7f256c12c640 1 -- start start 2024-09-15T23:21:20.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.472+0000 7f256c12c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2564073030 0x7f256414e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:20.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.472+0000 7f256c12c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f25640b4750 0x7f25641594e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:20.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.472+0000 7f256c12c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f256415c470 0x7f2564156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:20.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.472+0000 7f256c12c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f25640b5680 con 0x7f256415c470 2024-09-15T23:21:20.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.472+0000 7f256c12c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f25640b53a0 con 0x7f2564073030 2024-09-15T23:21:20.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.472+0000 7f256c12c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f256406e690 con 0x7f25640b4750 2024-09-15T23:21:20.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.472+0000 7f256a6c9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f256415c470 0x7f2564156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:20.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.472+0000 7f256a6c9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f256415c470 0x7f2564156d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57182/0 (socket says 172.21.15.123:57182) 2024-09-15T23:21:20.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.472+0000 7f256a6c9640 1 -- 172.21.15.123:0/392655422 learned_addr learned my addr 172.21.15.123:0/392655422 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:20.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.472+0000 7f256a6c9640 1 -- 172.21.15.123:0/392655422 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f25640b4750 msgr2=0x7f25641594e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T23:21:20.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.472+0000 7f256a6c9640 1 --2- 172.21.15.123:0/392655422 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f25640b4750 0x7f25641594e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:20.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.472+0000 7f256a6c9640 1 -- 172.21.15.123:0/392655422 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2564073030 msgr2=0x7f256414e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:20.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.472+0000 7f256a6c9640 1 --2- 172.21.15.123:0/392655422 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2564073030 0x7f256414e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:20.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.472+0000 7f256a6c9640 1 -- 172.21.15.123:0/392655422 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f256414f3e0 con 0x7f256415c470 2024-09-15T23:21:20.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.472+0000 7f256a6c9640 1 --2- 172.21.15.123:0/392655422 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f256415c470 0x7f2564156d90 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f255c00d800 tx=0x7f255c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:20.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.473+0000 7f25627fc640 1 -- 172.21.15.123:0/392655422 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c004030 con 0x7f256415c470 2024-09-15T23:21:20.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.473+0000 7f25627fc640 1 -- 172.21.15.123:0/392655422 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f255c0041d0 con 0x7f256415c470 2024-09-15T23:21:20.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.473+0000 7f256c12c640 1 -- 172.21.15.123:0/392655422 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f256414f6c0 con 0x7f256415c470 2024-09-15T23:21:20.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.473+0000 7f25627fc640 1 -- 172.21.15.123:0/392655422 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c0096a0 con 0x7f256415c470 2024-09-15T23:21:20.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.473+0000 7f256c12c640 1 -- 172.21.15.123:0/392655422 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f256414fc80 con 0x7f256415c470 2024-09-15T23:21:20.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.474+0000 7f256c12c640 1 -- 172.21.15.123:0/392655422 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f256415edb0 con 0x7f256415c470 2024-09-15T23:21:20.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.474+0000 7f25627fc640 1 -- 172.21.15.123:0/392655422 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f255c009840 con 0x7f256415c470 2024-09-15T23:21:20.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.474+0000 7f25627fc640 1 --2- 172.21.15.123:0/392655422 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f255006c2b0 0x7f255006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:20.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.475+0000 7f25627fc640 1 -- 172.21.15.123:0/392655422 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(164..164 src has 1..164) ==== 4857+0+0 (secure 0 0 0) 0x7f255c08b450 con 0x7f256415c470 2024-09-15T23:21:20.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.476+0000 7f2569ec8640 1 --2- 172.21.15.123:0/392655422 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f255006c2b0 0x7f255006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:20.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.477+0000 7f2569ec8640 1 --2- 172.21.15.123:0/392655422 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f255006c2b0 0x7f255006e770 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f2554034000 tx=0x7f255402c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:20.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.479+0000 7f25627fc640 1 -- 172.21.15.123:0/392655422 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f255c059f10 con 0x7f256415c470 2024-09-15T23:21:20.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.643+0000 7f256c12c640 1 -- 172.21.15.123:0/392655422 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f2564067ed0 con 0x7f256415c470 2024-09-15T23:21:20.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.707+0000 7f25627fc640 1 -- 172.21.15.123:0/392655422 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v165) ==== 138+0+0 (secure 0 0 0) 0x7f255c059810 con 0x7f256415c470 2024-09-15T23:21:20.708 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' created 2024-09-15T23:21:20.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.710+0000 7f256c12c640 1 -- 172.21.15.123:0/392655422 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f255006c2b0 msgr2=0x7f255006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:20.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.710+0000 7f256c12c640 1 --2- 172.21.15.123:0/392655422 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f255006c2b0 0x7f255006e770 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f2554034000 tx=0x7f255402c000 comp rx=0 tx=0).stop 2024-09-15T23:21:20.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.710+0000 7f256c12c640 1 -- 172.21.15.123:0/392655422 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f256415c470 msgr2=0x7f2564156d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:20.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.710+0000 7f256c12c640 1 --2- 172.21.15.123:0/392655422 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f256415c470 0x7f2564156d90 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f255c00d800 tx=0x7f255c00dcc0 comp rx=0 tx=0).stop 2024-09-15T23:21:20.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.710+0000 7f256c12c640 1 -- 172.21.15.123:0/392655422 shutdown_connections 2024-09-15T23:21:20.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.710+0000 7f256c12c640 1 --2- 172.21.15.123:0/392655422 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f255006c2b0 0x7f255006e770 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:20.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.710+0000 7f256c12c640 1 --2- 172.21.15.123:0/392655422 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f256415c470 0x7f2564156d90 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:20.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.710+0000 7f256c12c640 1 --2- 172.21.15.123:0/392655422 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f25640b4750 0x7f25641594e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:20.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.710+0000 7f256c12c640 1 --2- 172.21.15.123:0/392655422 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2564073030 0x7f256414e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:20.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.710+0000 7f256c12c640 1 -- 172.21.15.123:0/392655422 >> 172.21.15.123:0/392655422 conn(0x7f256406c030 msgr2=0x7f256415cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:20.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.710+0000 7f256c12c640 1 -- 172.21.15.123:0/392655422 shutdown_connections 2024-09-15T23:21:20.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.710+0000 7f256c12c640 1 -- 172.21.15.123:0/392655422 wait complete. 2024-09-15T23:21:20.725 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T23:21:20.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.829+0000 7fddafd2c640 1 Processor -- start 2024-09-15T23:21:20.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.829+0000 7fddafd2c640 1 -- start start 2024-09-15T23:21:20.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.830+0000 7fddafd2c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fdda815e990 0x7fdda815ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:20.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.830+0000 7fddafd2c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdda8162a00 0x7fdda8162e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:20.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.830+0000 7fddafd2c640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdda815f2b0 con 0x7fdda80b5520 2024-09-15T23:21:20.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.830+0000 7fddafd2c640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fdda815f550 con 0x7fdda8162a00 2024-09-15T23:21:20.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.830+0000 7fddafd2c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fdda815f830 con 0x7fdda815e990 2024-09-15T23:21:20.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.830+0000 7fddae2c9640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdda8162a00 0x7fdda8162e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:20.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.830+0000 7fddae2c9640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdda8162a00 0x7fdda8162e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57196/0 (socket says 172.21.15.123:57196) 2024-09-15T23:21:20.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.830+0000 7fddad2c7640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fdda80b5520 0x7fdda806cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:57242/0 (socket says 172.21.15.123:57242) 2024-09-15T23:21:20.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.830+0000 7fddae2c9640 1 -- 172.21.15.123:0/2604189104 learned_addr learned my addr 172.21.15.123:0/2604189104 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:20.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.830+0000 7fddae2c9640 1 -- 172.21.15.123:0/2604189104 >> v2:172.21.15.188:3300/0 conn(0x7fdda815e990 msgr2=0x7fdda815ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:20.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.830+0000 7fddae2c9640 1 --2- 172.21.15.123:0/2604189104 >> v2:172.21.15.188:3300/0 conn(0x7fdda815e990 0x7fdda815ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:20.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.830+0000 7fddae2c9640 1 -- 172.21.15.123:0/2604189104 >> v1:172.21.15.123:6789/0 conn(0x7fdda80b5520 legacy=0x7fdda806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:20.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.830+0000 7fddae2c9640 1 -- 172.21.15.123:0/2604189104 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda815fb10 con 0x7fdda8162a00 2024-09-15T23:21:20.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.830+0000 7fddacac6640 1 -- 172.21.15.123:0/2604189104 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1548751739 0 0) 0x7fdda815f2b0 con 0x7fdda80b5520 2024-09-15T23:21:20.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.831+0000 7fddae2c9640 1 --2- 172.21.15.123:0/2604189104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdda8162a00 0x7fdda8162e70 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7fdda8068890 tx=0x7fdda002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92c03538c6cdef8d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:20.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.831+0000 7fddacac6640 1 -- 172.21.15.123:0/2604189104 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda0036070 con 0x7fdda8162a00 2024-09-15T23:21:20.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.831+0000 7fddacac6640 1 -- 172.21.15.123:0/2604189104 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdda0031600 con 0x7fdda8162a00 2024-09-15T23:21:20.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.831+0000 7fddacac6640 1 -- 172.21.15.123:0/2604189104 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda00319d0 con 0x7fdda8162a00 2024-09-15T23:21:20.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.831+0000 7fddafd2c640 1 -- 172.21.15.123:0/2604189104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdda8162a00 msgr2=0x7fdda8162e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:20.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.832+0000 7fddafd2c640 1 --2- 172.21.15.123:0/2604189104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdda8162a00 0x7fdda8162e70 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7fdda8068890 tx=0x7fdda002a730 comp rx=0 tx=0).stop 2024-09-15T23:21:20.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.832+0000 7fddafd2c640 1 -- 172.21.15.123:0/2604189104 shutdown_connections 2024-09-15T23:21:20.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.832+0000 7fddafd2c640 1 --2- 172.21.15.123:0/2604189104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdda8162a00 0x7fdda8162e70 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:20.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.832+0000 7fddafd2c640 1 --2- 172.21.15.123:0/2604189104 >> v2:172.21.15.188:3300/0 conn(0x7fdda815e990 0x7fdda815ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:20.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.832+0000 7fddafd2c640 1 -- 172.21.15.123:0/2604189104 >> 172.21.15.123:0/2604189104 conn(0x7fdda80d25d0 msgr2=0x7fdda80d29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:20.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.832+0000 7fddafd2c640 1 -- 172.21.15.123:0/2604189104 shutdown_connections 2024-09-15T23:21:20.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.832+0000 7fddafd2c640 1 -- 172.21.15.123:0/2604189104 wait complete. 2024-09-15T23:21:20.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.833+0000 7fddafd2c640 1 Processor -- start 2024-09-15T23:21:20.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.833+0000 7fddafd2c640 1 -- start start 2024-09-15T23:21:20.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.833+0000 7fddafd2c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdda80b5520 0x7fdda81476d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:20.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.833+0000 7fddafd2c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdda815e990 0x7fdda8144310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:20.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.833+0000 7fddafd2c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdda8162a00 0x7fdda80ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:20.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.834+0000 7fddafd2c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdda806d430 con 0x7fdda815e990 2024-09-15T23:21:20.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.834+0000 7fddafd2c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fdda80b6ff0 con 0x7fdda8162a00 2024-09-15T23:21:20.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.834+0000 7fddafd2c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fdda8147c10 con 0x7fdda80b5520 2024-09-15T23:21:20.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.834+0000 7fddad2c7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdda815e990 0x7fdda8144310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:20.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.834+0000 7fddad2c7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdda815e990 0x7fdda8144310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57208/0 (socket says 172.21.15.123:57208) 2024-09-15T23:21:20.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.834+0000 7fddad2c7640 1 -- 172.21.15.123:0/968693283 learned_addr learned my addr 172.21.15.123:0/968693283 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:20.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.834+0000 7fddae2c9640 1 --2- 172.21.15.123:0/968693283 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdda8162a00 0x7fdda80ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:20.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.834+0000 7fddadac8640 1 --2- 172.21.15.123:0/968693283 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdda80b5520 0x7fdda81476d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:20.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.834+0000 7fddad2c7640 1 -- 172.21.15.123:0/968693283 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdda80b5520 msgr2=0x7fdda81476d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:20.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.834+0000 7fddad2c7640 1 --2- 172.21.15.123:0/968693283 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdda80b5520 0x7fdda81476d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:20.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.834+0000 7fddad2c7640 1 -- 172.21.15.123:0/968693283 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdda8162a00 msgr2=0x7fdda80ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:20.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.834+0000 7fddad2c7640 1 --2- 172.21.15.123:0/968693283 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdda8162a00 0x7fdda80ce0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:20.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.834+0000 7fddad2c7640 1 -- 172.21.15.123:0/968693283 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda80cd020 con 0x7fdda815e990 2024-09-15T23:21:20.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.834+0000 7fddae2c9640 1 --2- 172.21.15.123:0/968693283 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdda8162a00 0x7fdda80ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:21:20.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.834+0000 7fddad2c7640 1 --2- 172.21.15.123:0/968693283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdda815e990 0x7fdda8144310 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7fdd9800c500 tx=0x7fdd9800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:20.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.834+0000 7fdd9e7fc640 1 -- 172.21.15.123:0/968693283 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd98018070 con 0x7fdda815e990 2024-09-15T23:21:20.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.834+0000 7fdd9e7fc640 1 -- 172.21.15.123:0/968693283 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd98007580 con 0x7fdda815e990 2024-09-15T23:21:20.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.834+0000 7fddafd2c640 1 -- 172.21.15.123:0/968693283 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdda80cd300 con 0x7fdda815e990 2024-09-15T23:21:20.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.834+0000 7fdd9e7fc640 1 -- 172.21.15.123:0/968693283 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd98004a20 con 0x7fdda815e990 2024-09-15T23:21:20.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.834+0000 7fddafd2c640 1 -- 172.21.15.123:0/968693283 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdda80cd8c0 con 0x7fdda815e990 2024-09-15T23:21:20.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.835+0000 7fddafd2c640 1 -- 172.21.15.123:0/968693283 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdda8162e70 con 0x7fdda815e990 2024-09-15T23:21:20.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.836+0000 7fdd9e7fc640 1 -- 172.21.15.123:0/968693283 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdd9801b070 con 0x7fdda815e990 2024-09-15T23:21:20.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.836+0000 7fdd9e7fc640 1 --2- 172.21.15.123:0/968693283 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdd8c06c2b0 0x7fdd8c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:20.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.836+0000 7fdd9e7fc640 1 -- 172.21.15.123:0/968693283 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5227+0+0 (secure 0 0 0) 0x7fdd9808a790 con 0x7fdda815e990 2024-09-15T23:21:20.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.836+0000 7fddadac8640 1 --2- 172.21.15.123:0/968693283 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdd8c06c2b0 0x7fdd8c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:20.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.837+0000 7fddadac8640 1 --2- 172.21.15.123:0/968693283 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdd8c06c2b0 0x7fdd8c06e770 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fdda400a810 tx=0x7fdda4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:20.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:20.840+0000 7fdd9e7fc640 1 -- 172.21.15.123:0/968693283 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdd98059250 con 0x7fdda815e990 2024-09-15T23:21:21.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.005+0000 7fddafd2c640 1 -- 172.21.15.123:0/968693283 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fdda80751d0 con 0x7fdda815e990 2024-09-15T23:21:21.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.715+0000 7fdd9e7fc640 1 -- 172.21.15.123:0/968693283 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v166) ==== 170+0+0 (secure 0 0 0) 0x7fdd98058b50 con 0x7fdda815e990 2024-09-15T23:21:21.716 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' created 2024-09-15T23:21:21.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.718+0000 7fddafd2c640 1 -- 172.21.15.123:0/968693283 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdd8c06c2b0 msgr2=0x7fdd8c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:21.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.718+0000 7fddafd2c640 1 --2- 172.21.15.123:0/968693283 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdd8c06c2b0 0x7fdd8c06e770 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fdda400a810 tx=0x7fdda4008040 comp rx=0 tx=0).stop 2024-09-15T23:21:21.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.718+0000 7fddafd2c640 1 -- 172.21.15.123:0/968693283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdda815e990 msgr2=0x7fdda8144310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:21.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.718+0000 7fddafd2c640 1 --2- 172.21.15.123:0/968693283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdda815e990 0x7fdda8144310 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7fdd9800c500 tx=0x7fdd9800c9c0 comp rx=0 tx=0).stop 2024-09-15T23:21:21.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.718+0000 7fddafd2c640 1 -- 172.21.15.123:0/968693283 shutdown_connections 2024-09-15T23:21:21.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.718+0000 7fddafd2c640 1 --2- 172.21.15.123:0/968693283 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdda8162a00 0x7fdda80ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:21.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.718+0000 7fddafd2c640 1 --2- 172.21.15.123:0/968693283 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdd8c06c2b0 0x7fdd8c06e770 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:21.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.718+0000 7fddafd2c640 1 --2- 172.21.15.123:0/968693283 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdda815e990 0x7fdda8144310 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:21.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.718+0000 7fddafd2c640 1 --2- 172.21.15.123:0/968693283 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdda80b5520 0x7fdda81476d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:21.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.718+0000 7fddafd2c640 1 -- 172.21.15.123:0/968693283 >> 172.21.15.123:0/968693283 conn(0x7fdda80d25d0 msgr2=0x7fdda806e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:21.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.719+0000 7fddafd2c640 1 -- 172.21.15.123:0/968693283 shutdown_connections 2024-09-15T23:21:21.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.719+0000 7fddafd2c640 1 -- 172.21.15.123:0/968693283 wait complete. 2024-09-15T23:21:21.745 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T23:21:21.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.851+0000 7f91c5635640 1 Processor -- start 2024-09-15T23:21:21.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.851+0000 7f91c5635640 1 -- start start 2024-09-15T23:21:21.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.852+0000 7f91c5635640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f91c006c320 0x7f91c0162230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:21.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.852+0000 7f91c5635640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91c0144090 con 0x7f91c00afb90 2024-09-15T23:21:21.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.852+0000 7f91c5635640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91c0144370 con 0x7f91c0158c80 2024-09-15T23:21:21.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.852+0000 7f91c5635640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f91c0141a00 con 0x7f91c006c320 2024-09-15T23:21:21.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.852+0000 7f91be7fc640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f91c00afb90 0x7f91c015ef90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:57252/0 (socket says 172.21.15.123:57252) 2024-09-15T23:21:21.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.852+0000 7f91be7fc640 1 -- 172.21.15.123:0/1342926012 learned_addr learned my addr 172.21.15.123:0/1342926012 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:21:21.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.852+0000 7f91bf7fe640 1 --2- 172.21.15.123:0/1342926012 >> v2:172.21.15.188:3300/0 conn(0x7f91c006c320 0x7f91c0162230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:21.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.852+0000 7f91bdffb640 1 -- 172.21.15.123:0/1342926012 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1678824378 0 0) 0x7f91c0144090 con 0x7f91c00afb90 2024-09-15T23:21:21.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.852+0000 7f91bdffb640 1 -- 172.21.15.123:0/1342926012 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91a8003520 con 0x7f91c00afb90 2024-09-15T23:21:21.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.853+0000 7f91bdffb640 1 -- 172.21.15.123:0/1342926012 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1661136560 0 0) 0x7f91c0144370 con 0x7f91c0158c80 2024-09-15T23:21:21.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.853+0000 7f91bdffb640 1 -- 172.21.15.123:0/1342926012 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91c0144090 con 0x7f91c0158c80 2024-09-15T23:21:21.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.853+0000 7f91bdffb640 1 -- 172.21.15.123:0/1342926012 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1475937182 0 0) 0x7f91a8003520 con 0x7f91c00afb90 2024-09-15T23:21:21.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.853+0000 7f91bdffb640 1 -- 172.21.15.123:0/1342926012 >> v2:172.21.15.188:3300/0 conn(0x7f91c006c320 msgr2=0x7f91c0162230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:21.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.853+0000 7f91bdffb640 1 --2- 172.21.15.123:0/1342926012 >> v2:172.21.15.188:3300/0 conn(0x7f91c006c320 0x7f91c0162230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:21.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.853+0000 7f91bdffb640 1 -- 172.21.15.123:0/1342926012 >> v1:172.21.15.188:6789/0 conn(0x7f91c0158c80 legacy=0x7f91c006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:21.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.853+0000 7f91bdffb640 1 -- 172.21.15.123:0/1342926012 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c0144650 con 0x7f91c00afb90 2024-09-15T23:21:21.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.853+0000 7f91bdffb640 1 -- 172.21.15.123:0/1342926012 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f91b4001670 con 0x7f91c00afb90 2024-09-15T23:21:21.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.853+0000 7f91bdffb640 1 -- 172.21.15.123:0/1342926012 >> v1:172.21.15.123:6789/0 conn(0x7f91c00afb90 legacy=0x7f91c015ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:21.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.853+0000 7f91bdffb640 1 --2- 172.21.15.123:0/1342926012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f91a8003b40 0x7f91a8003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:21.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.853+0000 7f91bdffb640 1 --2- 172.21.15.123:0/1342926012 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f91a8004800 0x7f91a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:21.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.853+0000 7f91bdffb640 1 --2- 172.21.15.123:0/1342926012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91a80051c0 0x7f91a800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:21.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.853+0000 7f91bdffb640 1 -- 172.21.15.123:0/1342926012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f91a800c010 con 0x7f91a80051c0 2024-09-15T23:21:21.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.853+0000 7f91bdffb640 1 -- 172.21.15.123:0/1342926012 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f91a800c1c0 con 0x7f91a8003b40 2024-09-15T23:21:21.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.853+0000 7f91bdffb640 1 -- 172.21.15.123:0/1342926012 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f91a800c3c0 con 0x7f91a8004800 2024-09-15T23:21:21.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.853+0000 7f91bf7fe640 1 --2- 172.21.15.123:0/1342926012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91a80051c0 0x7f91a800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:21.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.853+0000 7f91beffd640 1 --2- 172.21.15.123:0/1342926012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f91a8003b40 0x7f91a8003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:21.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.853+0000 7f91be7fc640 1 --2- 172.21.15.123:0/1342926012 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f91a8004800 0x7f91a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:21.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.853+0000 7f91bf7fe640 1 -- 172.21.15.123:0/1342926012 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f91a8004800 msgr2=0x7f91a8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:21.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.853+0000 7f91bf7fe640 1 --2- 172.21.15.123:0/1342926012 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f91a8004800 0x7f91a8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:21.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.853+0000 7f91bf7fe640 1 -- 172.21.15.123:0/1342926012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f91a8003b40 msgr2=0x7f91a8003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:21.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.853+0000 7f91bf7fe640 1 --2- 172.21.15.123:0/1342926012 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f91a8003b40 0x7f91a8003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:21.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.853+0000 7f91bf7fe640 1 -- 172.21.15.123:0/1342926012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91a8003520 con 0x7f91a80051c0 2024-09-15T23:21:21.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.854+0000 7f91bf7fe640 1 -- 172.21.15.123:0/1342926012 reap_dead start 2024-09-15T23:21:21.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.854+0000 7f91bf7fe640 1 --2- 172.21.15.123:0/1342926012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91a80051c0 0x7f91a800b9c0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009650 tx=0x7f91a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c67275ae6f51abfd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:21.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.854+0000 7f91bdffb640 1 -- 172.21.15.123:0/1342926012 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b8009690 con 0x7f91a80051c0 2024-09-15T23:21:21.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.854+0000 7f91bdffb640 1 -- 172.21.15.123:0/1342926012 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91b8004020 con 0x7f91a80051c0 2024-09-15T23:21:21.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.854+0000 7f91bdffb640 1 -- 172.21.15.123:0/1342926012 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b8004410 con 0x7f91a80051c0 2024-09-15T23:21:21.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.855+0000 7f91c5635640 1 -- 172.21.15.123:0/1342926012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91a80051c0 msgr2=0x7f91a800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:21.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.855+0000 7f91c5635640 1 --2- 172.21.15.123:0/1342926012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91a80051c0 0x7f91a800b9c0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009650 tx=0x7f91a8005830 comp rx=0 tx=0).stop 2024-09-15T23:21:21.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.855+0000 7f91c5635640 1 -- 172.21.15.123:0/1342926012 shutdown_connections 2024-09-15T23:21:21.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.855+0000 7f91c5635640 1 --2- 172.21.15.123:0/1342926012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91a80051c0 0x7f91a800b9c0 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:21.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.855+0000 7f91c5635640 1 -- 172.21.15.123:0/1342926012 >> 172.21.15.123:0/1342926012 conn(0x7f91c006cd20 msgr2=0x7f91c006d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:21.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.855+0000 7f91c5635640 1 -- 172.21.15.123:0/1342926012 shutdown_connections 2024-09-15T23:21:21.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.855+0000 7f91c5635640 1 -- 172.21.15.123:0/1342926012 wait complete. 2024-09-15T23:21:21.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.856+0000 7f91c5635640 1 Processor -- start 2024-09-15T23:21:21.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.856+0000 7f91c5635640 1 -- start start 2024-09-15T23:21:21.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.857+0000 7f91c5635640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91a80051c0 0x7f91c0161a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:21.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.857+0000 7f91c5635640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f91c015e7b0 0x7f91c013aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:21.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.857+0000 7f91c5635640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f91c0138f30 0x7f91c00b1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:21.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.857+0000 7f91c5635640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f91c0159060 con 0x7f91a80051c0 2024-09-15T23:21:21.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.857+0000 7f91c5635640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f91c0144c10 con 0x7f91c0138f30 2024-09-15T23:21:21.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.857+0000 7f91c5635640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f91c0143d20 con 0x7f91c015e7b0 2024-09-15T23:21:21.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.857+0000 7f91beffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91a80051c0 0x7f91c0161a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:21.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.857+0000 7f91beffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91a80051c0 0x7f91c0161a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57230/0 (socket says 172.21.15.123:57230) 2024-09-15T23:21:21.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.857+0000 7f91beffd640 1 -- 172.21.15.123:0/913320154 learned_addr learned my addr 172.21.15.123:0/913320154 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:21.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.857+0000 7f91bf7fe640 1 --2- 172.21.15.123:0/913320154 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f91c0138f30 0x7f91c00b1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:21.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.857+0000 7f91be7fc640 1 --2- 172.21.15.123:0/913320154 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f91c015e7b0 0x7f91c013aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:21.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.857+0000 7f91beffd640 1 -- 172.21.15.123:0/913320154 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f91c015e7b0 msgr2=0x7f91c013aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:21.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.857+0000 7f91beffd640 1 --2- 172.21.15.123:0/913320154 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f91c015e7b0 0x7f91c013aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:21.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.857+0000 7f91beffd640 1 -- 172.21.15.123:0/913320154 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f91c0138f30 msgr2=0x7f91c00b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:21.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.857+0000 7f91beffd640 1 --2- 172.21.15.123:0/913320154 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f91c0138f30 0x7f91c00b1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:21.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.857+0000 7f91beffd640 1 -- 172.21.15.123:0/913320154 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c013afe0 con 0x7f91a80051c0 2024-09-15T23:21:21.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.857+0000 7f91bf7fe640 1 --2- 172.21.15.123:0/913320154 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f91c0138f30 0x7f91c00b1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:21:21.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.857+0000 7f91be7fc640 1 --2- 172.21.15.123:0/913320154 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f91c015e7b0 0x7f91c013aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:21:21.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.857+0000 7f91beffd640 1 --2- 172.21.15.123:0/913320154 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91a80051c0 0x7f91c0161a70 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f91b000fb10 tx=0x7f91b0002170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:21.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.857+0000 7f91a77fe640 1 -- 172.21.15.123:0/913320154 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b001a070 con 0x7f91a80051c0 2024-09-15T23:21:21.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.857+0000 7f91a77fe640 1 -- 172.21.15.123:0/913320154 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91b0006d60 con 0x7f91a80051c0 2024-09-15T23:21:21.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.857+0000 7f91c5635640 1 -- 172.21.15.123:0/913320154 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91c013b280 con 0x7f91a80051c0 2024-09-15T23:21:21.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.857+0000 7f91a77fe640 1 -- 172.21.15.123:0/913320154 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b0003b90 con 0x7f91a80051c0 2024-09-15T23:21:21.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.857+0000 7f91c5635640 1 -- 172.21.15.123:0/913320154 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91c015dfb0 con 0x7f91a80051c0 2024-09-15T23:21:21.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.858+0000 7f91c5635640 1 -- 172.21.15.123:0/913320154 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91c0162230 con 0x7f91a80051c0 2024-09-15T23:21:21.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.859+0000 7f91a77fe640 1 -- 172.21.15.123:0/913320154 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f91b001d070 con 0x7f91a80051c0 2024-09-15T23:21:21.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.860+0000 7f91a77fe640 1 --2- 172.21.15.123:0/913320154 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f91ac06c2e0 0x7f91ac06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:21.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.860+0000 7f91a77fe640 1 -- 172.21.15.123:0/913320154 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5609+0+0 (secure 0 0 0) 0x7f91b008adc0 con 0x7f91a80051c0 2024-09-15T23:21:21.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.860+0000 7f91be7fc640 1 --2- 172.21.15.123:0/913320154 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f91ac06c2e0 0x7f91ac06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:21.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.860+0000 7f91be7fc640 1 --2- 172.21.15.123:0/913320154 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f91ac06c2e0 0x7f91ac06e7a0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f91b40011e0 tx=0x7f91b4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:21.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:21.864+0000 7f91a77fe640 1 -- 172.21.15.123:0/913320154 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f91b0059620 con 0x7f91a80051c0 2024-09-15T23:21:22.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.064+0000 7f91c5635640 1 -- 172.21.15.123:0/913320154 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f91c013edb0 con 0x7f91a80051c0 2024-09-15T23:21:22.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.719+0000 7f91a77fe640 1 -- 172.21.15.123:0/913320154 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v98) ==== 174+0+0 (secure 0 0 0) 0x7f91b0058f20 con 0x7f91a80051c0 2024-09-15T23:21:22.723 INFO:teuthology.orchestra.run.smithi123.stderr:new fs with metadata pool 22 and data pool 23 2024-09-15T23:21:22.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.729+0000 7f91c5635640 1 -- 172.21.15.123:0/913320154 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f91ac06c2e0 msgr2=0x7f91ac06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:22.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.729+0000 7f91c5635640 1 --2- 172.21.15.123:0/913320154 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f91ac06c2e0 0x7f91ac06e7a0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f91b40011e0 tx=0x7f91b4009040 comp rx=0 tx=0).stop 2024-09-15T23:21:22.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.729+0000 7f91c5635640 1 -- 172.21.15.123:0/913320154 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91a80051c0 msgr2=0x7f91c0161a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:22.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.729+0000 7f91c5635640 1 --2- 172.21.15.123:0/913320154 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91a80051c0 0x7f91c0161a70 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f91b000fb10 tx=0x7f91b0002170 comp rx=0 tx=0).stop 2024-09-15T23:21:22.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.730+0000 7f91c5635640 1 -- 172.21.15.123:0/913320154 shutdown_connections 2024-09-15T23:21:22.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.730+0000 7f91c5635640 1 --2- 172.21.15.123:0/913320154 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f91c0138f30 0x7f91c00b1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:22.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.730+0000 7f91c5635640 1 --2- 172.21.15.123:0/913320154 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f91c015e7b0 0x7f91c013aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:22.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.730+0000 7f91c5635640 1 --2- 172.21.15.123:0/913320154 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f91ac06c2e0 0x7f91ac06e7a0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:22.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.730+0000 7f91c5635640 1 --2- 172.21.15.123:0/913320154 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91a80051c0 0x7f91c0161a70 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:22.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.730+0000 7f91c5635640 1 -- 172.21.15.123:0/913320154 >> 172.21.15.123:0/913320154 conn(0x7f91c006cd20 msgr2=0x7f91c00b56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:22.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.731+0000 7f91c5635640 1 -- 172.21.15.123:0/913320154 shutdown_connections 2024-09-15T23:21:22.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.731+0000 7f91c5635640 1 -- 172.21.15.123:0/913320154 wait complete. 2024-09-15T23:21:22.753 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:21:22.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.853+0000 7f5ce1511640 1 Processor -- start 2024-09-15T23:21:22.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.853+0000 7f5ce1511640 1 -- start start 2024-09-15T23:21:22.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.853+0000 7f5ce1511640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5cdc15ed20 0x7f5cdc0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:22.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.853+0000 7f5ce1511640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cdc0d0e70 con 0x7f5cdc0d23b0 2024-09-15T23:21:22.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.853+0000 7f5ce1511640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cdc0d00f0 con 0x7f5cdc0b90e0 2024-09-15T23:21:22.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.853+0000 7f5ce1511640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f5cdc0d41c0 con 0x7f5cdc15ed20 2024-09-15T23:21:22.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.854+0000 7f5cdaffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5cdc15ed20 0x7f5cdc0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:22.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.854+0000 7f5cda7fc640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f5cdc0d23b0 0x7f5cdc0cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:57254/0 (socket says 172.21.15.123:57254) 2024-09-15T23:21:22.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.854+0000 7f5cdaffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5cdc15ed20 0x7f5cdc0b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57236/0 (socket says 172.21.15.123:57236) 2024-09-15T23:21:22.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.854+0000 7f5cda7fc640 1 -- 172.21.15.123:0/2240792081 learned_addr learned my addr 172.21.15.123:0/2240792081 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:21:22.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.854+0000 7f5cdaffd640 1 -- 172.21.15.123:0/2240792081 >> v1:172.21.15.188:6789/0 conn(0x7f5cdc0b90e0 legacy=0x7f5cdc0cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:22.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.854+0000 7f5cdaffd640 1 -- 172.21.15.123:0/2240792081 >> v1:172.21.15.123:6789/0 conn(0x7f5cdc0d23b0 legacy=0x7f5cdc0cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:22.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.854+0000 7f5cdaffd640 1 -- 172.21.15.123:0/2240792081 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cdc0d35b0 con 0x7f5cdc15ed20 2024-09-15T23:21:22.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.854+0000 7f5cd9ffb640 1 -- 172.21.15.123:0/2240792081 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1217775196 0 0) 0x7f5cd0001110 con 0x7f5cdc0d23b0 2024-09-15T23:21:22.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.854+0000 7f5cdaffd640 1 --2- 172.21.15.123:0/2240792081 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cdc15ed20 0x7f5cdc0b6260 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc0097a0 tx=0x7f5ccc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cedfe791603bc940 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:22.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.855+0000 7f5cd9ffb640 1 -- 172.21.15.123:0/2240792081 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc037070 con 0x7f5cdc15ed20 2024-09-15T23:21:22.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.855+0000 7f5cd9ffb640 1 -- 172.21.15.123:0/2240792081 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ccc02ae50 con 0x7f5cdc15ed20 2024-09-15T23:21:22.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.855+0000 7f5cd9ffb640 1 -- 172.21.15.123:0/2240792081 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc032660 con 0x7f5cdc15ed20 2024-09-15T23:21:22.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.855+0000 7f5ce1511640 1 -- 172.21.15.123:0/2240792081 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cdc15ed20 msgr2=0x7f5cdc0b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:22.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.855+0000 7f5ce1511640 1 --2- 172.21.15.123:0/2240792081 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cdc15ed20 0x7f5cdc0b6260 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc0097a0 tx=0x7f5ccc02a140 comp rx=0 tx=0).stop 2024-09-15T23:21:22.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.855+0000 7f5ce1511640 1 -- 172.21.15.123:0/2240792081 shutdown_connections 2024-09-15T23:21:22.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.855+0000 7f5ce1511640 1 --2- 172.21.15.123:0/2240792081 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cdc15ed20 0x7f5cdc0b6260 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:22.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.855+0000 7f5ce1511640 1 -- 172.21.15.123:0/2240792081 >> 172.21.15.123:0/2240792081 conn(0x7f5cdc0d1260 msgr2=0x7f5cdc0d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:22.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.855+0000 7f5ce1511640 1 -- 172.21.15.123:0/2240792081 shutdown_connections 2024-09-15T23:21:22.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.855+0000 7f5ce1511640 1 -- 172.21.15.123:0/2240792081 wait complete. 2024-09-15T23:21:22.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.857+0000 7f5ce1511640 1 Processor -- start 2024-09-15T23:21:22.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.857+0000 7f5ce1511640 1 -- start start 2024-09-15T23:21:22.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.857+0000 7f5ce1511640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5cdc0b90e0 0x7f5cdc15b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:22.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.857+0000 7f5ce1511640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5cdc0d23b0 0x7f5cdc0c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:22.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.857+0000 7f5ce1511640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cdc15ed20 0x7f5cdc0b9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:22.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.857+0000 7f5ce1511640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5cdc0d3e50 con 0x7f5cdc15ed20 2024-09-15T23:21:22.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.857+0000 7f5ce1511640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5cdc0d3b70 con 0x7f5cdc0b90e0 2024-09-15T23:21:22.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.857+0000 7f5ce1511640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5cdc0d32a0 con 0x7f5cdc0d23b0 2024-09-15T23:21:22.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.857+0000 7f5cdb7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cdc15ed20 0x7f5cdc0b9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:22.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.857+0000 7f5cdb7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cdc15ed20 0x7f5cdc0b9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57248/0 (socket says 172.21.15.123:57248) 2024-09-15T23:21:22.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.857+0000 7f5cdb7fe640 1 -- 172.21.15.123:0/2151787563 learned_addr learned my addr 172.21.15.123:0/2151787563 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:22.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.858+0000 7f5cdaffd640 1 --2- 172.21.15.123:0/2151787563 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5cdc0b90e0 0x7f5cdc15b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:22.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.858+0000 7f5cda7fc640 1 --2- 172.21.15.123:0/2151787563 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5cdc0d23b0 0x7f5cdc0c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:22.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.858+0000 7f5cdb7fe640 1 -- 172.21.15.123:0/2151787563 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5cdc0d23b0 msgr2=0x7f5cdc0c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:22.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.858+0000 7f5cdb7fe640 1 --2- 172.21.15.123:0/2151787563 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5cdc0d23b0 0x7f5cdc0c94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:22.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.858+0000 7f5cdb7fe640 1 -- 172.21.15.123:0/2151787563 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5cdc0b90e0 msgr2=0x7f5cdc15b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:22.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.858+0000 7f5cdb7fe640 1 --2- 172.21.15.123:0/2151787563 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5cdc0b90e0 0x7f5cdc15b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:22.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.858+0000 7f5cdb7fe640 1 -- 172.21.15.123:0/2151787563 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cdc0cab70 con 0x7f5cdc15ed20 2024-09-15T23:21:22.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.858+0000 7f5cdaffd640 1 --2- 172.21.15.123:0/2151787563 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5cdc0b90e0 0x7f5cdc15b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:21:22.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.858+0000 7f5cda7fc640 1 --2- 172.21.15.123:0/2151787563 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5cdc0d23b0 0x7f5cdc0c94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:21:22.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.858+0000 7f5cdb7fe640 1 --2- 172.21.15.123:0/2151787563 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cdc15ed20 0x7f5cdc0b9610 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7f5cd400c780 tx=0x7f5cd400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:22.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.858+0000 7f5cc37fe640 1 -- 172.21.15.123:0/2151787563 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd4017070 con 0x7f5cdc15ed20 2024-09-15T23:21:22.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.858+0000 7f5cc37fe640 1 -- 172.21.15.123:0/2151787563 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cd4003da0 con 0x7f5cdc15ed20 2024-09-15T23:21:22.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.858+0000 7f5ce1511640 1 -- 172.21.15.123:0/2151787563 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cdc0c9f60 con 0x7f5cdc15ed20 2024-09-15T23:21:22.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.858+0000 7f5cc37fe640 1 -- 172.21.15.123:0/2151787563 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd40052b0 con 0x7f5cdc15ed20 2024-09-15T23:21:22.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.858+0000 7f5ce1511640 1 -- 172.21.15.123:0/2151787563 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cdc0ca520 con 0x7f5cdc15ed20 2024-09-15T23:21:22.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.859+0000 7f5ce1511640 1 -- 172.21.15.123:0/2151787563 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cdc0d21a0 con 0x7f5cdc15ed20 2024-09-15T23:21:22.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.860+0000 7f5cc37fe640 1 -- 172.21.15.123:0/2151787563 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5cd401a070 con 0x7f5cdc15ed20 2024-09-15T23:21:22.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.860+0000 7f5cc37fe640 1 --2- 172.21.15.123:0/2151787563 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5cc806c2e0 0x7f5cc806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:22.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.860+0000 7f5cc37fe640 1 -- 172.21.15.123:0/2151787563 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f5cd408aa40 con 0x7f5cdc15ed20 2024-09-15T23:21:22.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.860+0000 7f5cdaffd640 1 --2- 172.21.15.123:0/2151787563 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5cc806c2e0 0x7f5cc806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:22.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.861+0000 7f5cdaffd640 1 --2- 172.21.15.123:0/2151787563 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5cc806c2e0 0x7f5cc806e7a0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc034000 tx=0x7f5ccc02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:22.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:22.864+0000 7f5cc37fe640 1 -- 172.21.15.123:0/2151787563 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5cd40591b0 con 0x7f5cdc15ed20 2024-09-15T23:21:23.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.030+0000 7f5ce1511640 1 -- 172.21.15.123:0/2151787563 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5cdc160280 con 0x7f5cdc15ed20 2024-09-15T23:21:23.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.032+0000 7f5cc37fe640 1 -- 172.21.15.123:0/2151787563 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) ==== 74+0+16776 (secure 0 0 0) 0x7f5cd408ae20 con 0x7f5cdc15ed20 2024-09-15T23:21:23.033 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:23.033 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":167,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:21:22.066067+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:21:20.662502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-15T23:21:21.024002+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:21:23.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.034+0000 7f5ce1511640 1 -- 172.21.15.123:0/2151787563 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5cc806c2e0 msgr2=0x7f5cc806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:23.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.034+0000 7f5ce1511640 1 --2- 172.21.15.123:0/2151787563 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5cc806c2e0 0x7f5cc806e7a0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc034000 tx=0x7f5ccc02e000 comp rx=0 tx=0).stop 2024-09-15T23:21:23.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.034+0000 7f5ce1511640 1 -- 172.21.15.123:0/2151787563 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cdc15ed20 msgr2=0x7f5cdc0b9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:23.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.034+0000 7f5ce1511640 1 --2- 172.21.15.123:0/2151787563 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cdc15ed20 0x7f5cdc0b9610 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7f5cd400c780 tx=0x7f5cd400cc40 comp rx=0 tx=0).stop 2024-09-15T23:21:23.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.034+0000 7f5ce1511640 1 -- 172.21.15.123:0/2151787563 shutdown_connections 2024-09-15T23:21:23.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.034+0000 7f5ce1511640 1 --2- 172.21.15.123:0/2151787563 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5cc806c2e0 0x7f5cc806e7a0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:23.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.034+0000 7f5ce1511640 1 --2- 172.21.15.123:0/2151787563 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5cdc15ed20 0x7f5cdc0b9610 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:23.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.034+0000 7f5ce1511640 1 --2- 172.21.15.123:0/2151787563 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5cdc0d23b0 0x7f5cdc0c94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:23.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.034+0000 7f5ce1511640 1 --2- 172.21.15.123:0/2151787563 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5cdc0b90e0 0x7f5cdc15b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:23.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.034+0000 7f5ce1511640 1 -- 172.21.15.123:0/2151787563 >> 172.21.15.123:0/2151787563 conn(0x7f5cdc0d1260 msgr2=0x7f5cdc15db20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:23.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.034+0000 7f5ce1511640 1 -- 172.21.15.123:0/2151787563 shutdown_connections 2024-09-15T23:21:23.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.034+0000 7f5ce1511640 1 -- 172.21.15.123:0/2151787563 wait complete. 2024-09-15T23:21:23.046 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:21:23.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.143+0000 7f043e077640 1 Processor -- start 2024-09-15T23:21:23.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.143+0000 7f043e077640 1 -- start start 2024-09-15T23:21:23.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.144+0000 7f043e077640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f04380b2d40 0x7f043806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:23.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.144+0000 7f043e077640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f043813eb20 0x7f043806c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:23.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.144+0000 7f043e077640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f043815bcf0 0x7f043815c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:23.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.144+0000 7f043e077640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f0438071ab0 con 0x7f04380b2d40 2024-09-15T23:21:23.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.144+0000 7f043e077640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f0438071180 con 0x7f043813eb20 2024-09-15T23:21:23.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.144+0000 7f043e077640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0438071460 con 0x7f043815bcf0 2024-09-15T23:21:23.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.144+0000 7f04377fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f04380b2d40 0x7f043806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:23.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.144+0000 7f04377fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f04380b2d40 0x7f043806bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57258/0 (socket says 172.21.15.123:57258) 2024-09-15T23:21:23.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.144+0000 7f04377fe640 1 -- 172.21.15.123:0/780525291 learned_addr learned my addr 172.21.15.123:0/780525291 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:23.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.144+0000 7f0436ffd640 1 --2- 172.21.15.123:0/780525291 >> v2:172.21.15.188:3300/0 conn(0x7f043813eb20 0x7f043806c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:23.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.144+0000 7f0437fff640 1 --2- 172.21.15.123:0/780525291 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f043815bcf0 0x7f043815c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:23.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.144+0000 7f04377fe640 1 -- 172.21.15.123:0/780525291 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f043815bcf0 msgr2=0x7f043815c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:23.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.144+0000 7f04377fe640 1 --2- 172.21.15.123:0/780525291 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f043815bcf0 0x7f043815c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:23.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.144+0000 7f04377fe640 1 -- 172.21.15.123:0/780525291 >> v2:172.21.15.188:3300/0 conn(0x7f043813eb20 msgr2=0x7f043806c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:23.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.144+0000 7f04377fe640 1 --2- 172.21.15.123:0/780525291 >> v2:172.21.15.188:3300/0 conn(0x7f043813eb20 0x7f043806c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:23.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.144+0000 7f04377fe640 1 -- 172.21.15.123:0/780525291 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0438071740 con 0x7f04380b2d40 2024-09-15T23:21:23.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.144+0000 7f0436ffd640 1 --2- 172.21.15.123:0/780525291 >> v2:172.21.15.188:3300/0 conn(0x7f043813eb20 0x7f043806c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:21:23.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.144+0000 7f0437fff640 1 --2- 172.21.15.123:0/780525291 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f043815bcf0 0x7f043815c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:21:23.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.145+0000 7f04377fe640 1 --2- 172.21.15.123:0/780525291 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04380b2d40 0x7f043806bc10 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f04380d1500 tx=0x7f042802c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7597cfc0ad3391a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:23.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.145+0000 7f04367fc640 1 -- 172.21.15.123:0/780525291 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042800b2e0 con 0x7f04380b2d40 2024-09-15T23:21:23.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.145+0000 7f04367fc640 1 -- 172.21.15.123:0/780525291 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0428009600 con 0x7f04380b2d40 2024-09-15T23:21:23.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.145+0000 7f04367fc640 1 -- 172.21.15.123:0/780525291 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f042800b480 con 0x7f04380b2d40 2024-09-15T23:21:23.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.146+0000 7f043e077640 1 -- 172.21.15.123:0/780525291 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04380b2d40 msgr2=0x7f043806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:23.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.146+0000 7f043e077640 1 --2- 172.21.15.123:0/780525291 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04380b2d40 0x7f043806bc10 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f04380d1500 tx=0x7f042802c8a0 comp rx=0 tx=0).stop 2024-09-15T23:21:23.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.146+0000 7f043e077640 1 -- 172.21.15.123:0/780525291 shutdown_connections 2024-09-15T23:21:23.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.146+0000 7f043e077640 1 --2- 172.21.15.123:0/780525291 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f043815bcf0 0x7f043815c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:23.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.146+0000 7f043e077640 1 --2- 172.21.15.123:0/780525291 >> v2:172.21.15.188:3300/0 conn(0x7f043813eb20 0x7f043806c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:23.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.146+0000 7f043e077640 1 --2- 172.21.15.123:0/780525291 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04380b2d40 0x7f043806bc10 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:23.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.146+0000 7f043e077640 1 -- 172.21.15.123:0/780525291 >> 172.21.15.123:0/780525291 conn(0x7f04380ccec0 msgr2=0x7f04380cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:23.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.146+0000 7f043e077640 1 -- 172.21.15.123:0/780525291 shutdown_connections 2024-09-15T23:21:23.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.146+0000 7f043e077640 1 -- 172.21.15.123:0/780525291 wait complete. 2024-09-15T23:21:23.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.147+0000 7f043e077640 1 Processor -- start 2024-09-15T23:21:23.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.147+0000 7f043e077640 1 -- start start 2024-09-15T23:21:23.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.148+0000 7f043e077640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04380b2d40 0x7f0438157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:23.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.148+0000 7f043e077640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f043813eb20 0x7f043815af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:23.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.148+0000 7f043e077640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f043815bcf0 0x7f043813dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:23.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.148+0000 7f043e077640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f043815f140 con 0x7f04380b2d40 2024-09-15T23:21:23.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.148+0000 7f043e077640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f043815efc0 con 0x7f043815bcf0 2024-09-15T23:21:23.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.148+0000 7f043e077640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f043815f2c0 con 0x7f043813eb20 2024-09-15T23:21:23.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.148+0000 7f04377fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04380b2d40 0x7f0438157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:23.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.148+0000 7f04377fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04380b2d40 0x7f0438157f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57264/0 (socket says 172.21.15.123:57264) 2024-09-15T23:21:23.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.148+0000 7f04377fe640 1 -- 172.21.15.123:0/3550536158 learned_addr learned my addr 172.21.15.123:0/3550536158 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:23.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.148+0000 7f0437fff640 1 --2- 172.21.15.123:0/3550536158 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f043815bcf0 0x7f043813dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:23.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.148+0000 7f0436ffd640 1 --2- 172.21.15.123:0/3550536158 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f043813eb20 0x7f043815af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:23.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.148+0000 7f04377fe640 1 -- 172.21.15.123:0/3550536158 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f043813eb20 msgr2=0x7f043815af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:23.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.148+0000 7f04377fe640 1 --2- 172.21.15.123:0/3550536158 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f043813eb20 0x7f043815af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:23.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.148+0000 7f04377fe640 1 -- 172.21.15.123:0/3550536158 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f043815bcf0 msgr2=0x7f043813dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:23.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.148+0000 7f04377fe640 1 --2- 172.21.15.123:0/3550536158 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f043815bcf0 0x7f043813dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:23.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.148+0000 7f04377fe640 1 -- 172.21.15.123:0/3550536158 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0438158480 con 0x7f04380b2d40 2024-09-15T23:21:23.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.148+0000 7f0437fff640 1 --2- 172.21.15.123:0/3550536158 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f043815bcf0 0x7f043813dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:21:23.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.149+0000 7f04377fe640 1 --2- 172.21.15.123:0/3550536158 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04380b2d40 0x7f0438157f40 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f042800d210 tx=0x7f0428004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:23.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.149+0000 7f041ffff640 1 -- 172.21.15.123:0/3550536158 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0428034910 con 0x7f04380b2d40 2024-09-15T23:21:23.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.149+0000 7f041ffff640 1 -- 172.21.15.123:0/3550536158 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0428034ab0 con 0x7f04380b2d40 2024-09-15T23:21:23.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.149+0000 7f043e077640 1 -- 172.21.15.123:0/3550536158 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04380b3950 con 0x7f04380b2d40 2024-09-15T23:21:23.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.149+0000 7f041ffff640 1 -- 172.21.15.123:0/3550536158 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0428047410 con 0x7f04380b2d40 2024-09-15T23:21:23.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.149+0000 7f043e077640 1 -- 172.21.15.123:0/3550536158 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04380b3f10 con 0x7f04380b2d40 2024-09-15T23:21:23.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.150+0000 7f043e077640 1 -- 172.21.15.123:0/3550536158 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f043815c1a0 con 0x7f04380b2d40 2024-09-15T23:21:23.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.150+0000 7f041ffff640 1 -- 172.21.15.123:0/3550536158 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0428045020 con 0x7f04380b2d40 2024-09-15T23:21:23.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.151+0000 7f041ffff640 1 --2- 172.21.15.123:0/3550536158 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f042406c2e0 0x7f042406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:23.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.151+0000 7f041ffff640 1 -- 172.21.15.123:0/3550536158 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f0428030030 con 0x7f04380b2d40 2024-09-15T23:21:23.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.151+0000 7f0436ffd640 1 --2- 172.21.15.123:0/3550536158 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f042406c2e0 0x7f042406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:23.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.151+0000 7f0436ffd640 1 --2- 172.21.15.123:0/3550536158 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f042406c2e0 0x7f042406e7a0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f04380b4cb0 tx=0x7f042c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:23.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.155+0000 7f041ffff640 1 -- 172.21.15.123:0/3550536158 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f042804c060 con 0x7f04380b2d40 2024-09-15T23:21:23.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.322+0000 7f043e077640 1 -- 172.21.15.123:0/3550536158 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f043806c9c0 con 0x7f04380b2d40 2024-09-15T23:21:23.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.323+0000 7f041ffff640 1 -- 172.21.15.123:0/3550536158 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) ==== 74+0+16776 (secure 0 0 0) 0x7f042807cf60 con 0x7f04380b2d40 2024-09-15T23:21:23.324 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:23.324 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":167,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:21:22.066067+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:21:20.662502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-15T23:21:21.024002+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:21:23.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.325+0000 7f043e077640 1 -- 172.21.15.123:0/3550536158 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f042406c2e0 msgr2=0x7f042406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:23.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.325+0000 7f043e077640 1 --2- 172.21.15.123:0/3550536158 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f042406c2e0 0x7f042406e7a0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f04380b4cb0 tx=0x7f042c008040 comp rx=0 tx=0).stop 2024-09-15T23:21:23.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.325+0000 7f043e077640 1 -- 172.21.15.123:0/3550536158 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04380b2d40 msgr2=0x7f0438157f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:23.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.325+0000 7f043e077640 1 --2- 172.21.15.123:0/3550536158 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04380b2d40 0x7f0438157f40 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f042800d210 tx=0x7f0428004a40 comp rx=0 tx=0).stop 2024-09-15T23:21:23.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.325+0000 7f043e077640 1 -- 172.21.15.123:0/3550536158 shutdown_connections 2024-09-15T23:21:23.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.325+0000 7f043e077640 1 --2- 172.21.15.123:0/3550536158 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f043815bcf0 0x7f043813dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:23.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.325+0000 7f043e077640 1 --2- 172.21.15.123:0/3550536158 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f043813eb20 0x7f043815af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:23.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.325+0000 7f043e077640 1 --2- 172.21.15.123:0/3550536158 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f042406c2e0 0x7f042406e7a0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:23.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.325+0000 7f043e077640 1 --2- 172.21.15.123:0/3550536158 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04380b2d40 0x7f0438157f40 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:23.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.325+0000 7f043e077640 1 -- 172.21.15.123:0/3550536158 >> 172.21.15.123:0/3550536158 conn(0x7f04380ccec0 msgr2=0x7f043815dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:23.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.325+0000 7f043e077640 1 -- 172.21.15.123:0/3550536158 shutdown_connections 2024-09-15T23:21:23.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.325+0000 7f043e077640 1 -- 172.21.15.123:0/3550536158 wait complete. 2024-09-15T23:21:23.337 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T23:21:23.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.438+0000 7f901616d640 1 Processor -- start 2024-09-15T23:21:23.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.438+0000 7f901616d640 1 -- start start 2024-09-15T23:21:23.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.438+0000 7f901616d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f90101607d0 0x7f90100cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:23.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.439+0000 7f901616d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90100cf6f0 0x7f90100b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:23.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.439+0000 7f901616d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90100b38b0 con 0x7f901006f8b0 2024-09-15T23:21:23.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.439+0000 7f901616d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f90100cfee0 con 0x7f90101607d0 2024-09-15T23:21:23.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.439+0000 7f901616d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f90100d01c0 con 0x7f90100cf6f0 2024-09-15T23:21:23.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.439+0000 7f900effd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f90101607d0 0x7f90100cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:23.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.439+0000 7f900effd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f90101607d0 0x7f90100cf1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57274/0 (socket says 172.21.15.123:57274) 2024-09-15T23:21:23.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.439+0000 7f900effd640 1 -- 172.21.15.123:0/2693199355 learned_addr learned my addr 172.21.15.123:0/2693199355 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:23.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.439+0000 7f900f7fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f901006f8b0 0x7f90101600c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:57258/0 (socket says 172.21.15.123:57258) 2024-09-15T23:21:23.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.439+0000 7f900effd640 1 -- 172.21.15.123:0/2693199355 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90100cf6f0 msgr2=0x7f90100b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:23.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.439+0000 7f900effd640 1 --2- 172.21.15.123:0/2693199355 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90100cf6f0 0x7f90100b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:23.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.439+0000 7f900effd640 1 -- 172.21.15.123:0/2693199355 >> v1:172.21.15.123:6789/0 conn(0x7f901006f8b0 legacy=0x7f90101600c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:23.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.439+0000 7f900effd640 1 -- 172.21.15.123:0/2693199355 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90100b3b20 con 0x7f90101607d0 2024-09-15T23:21:23.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.439+0000 7f900e7fc640 1 -- 172.21.15.123:0/2693199355 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2477168077 0 0) 0x7f90100b38b0 con 0x7f901006f8b0 2024-09-15T23:21:23.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.440+0000 7f900effd640 1 --2- 172.21.15.123:0/2693199355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90101607d0 0x7f90100cf1b0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f9004009870 tx=0x7f900402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdc1d124880ff87a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:23.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.440+0000 7f900e7fc640 1 -- 172.21.15.123:0/2693199355 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9004037070 con 0x7f90101607d0 2024-09-15T23:21:23.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.440+0000 7f900e7fc640 1 -- 172.21.15.123:0/2693199355 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9004032440 con 0x7f90101607d0 2024-09-15T23:21:23.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.440+0000 7f900e7fc640 1 -- 172.21.15.123:0/2693199355 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9004032810 con 0x7f90101607d0 2024-09-15T23:21:23.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.440+0000 7f901616d640 1 -- 172.21.15.123:0/2693199355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90101607d0 msgr2=0x7f90100cf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:23.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.440+0000 7f901616d640 1 --2- 172.21.15.123:0/2693199355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90101607d0 0x7f90100cf1b0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f9004009870 tx=0x7f900402a1c0 comp rx=0 tx=0).stop 2024-09-15T23:21:23.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.440+0000 7f901616d640 1 -- 172.21.15.123:0/2693199355 shutdown_connections 2024-09-15T23:21:23.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.440+0000 7f901616d640 1 --2- 172.21.15.123:0/2693199355 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90100cf6f0 0x7f90100b4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:23.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.440+0000 7f901616d640 1 --2- 172.21.15.123:0/2693199355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90101607d0 0x7f90100cf1b0 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:23.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.440+0000 7f901616d640 1 -- 172.21.15.123:0/2693199355 >> 172.21.15.123:0/2693199355 conn(0x7f90100b2510 msgr2=0x7f90100b28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:23.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.440+0000 7f901616d640 1 -- 172.21.15.123:0/2693199355 shutdown_connections 2024-09-15T23:21:23.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.440+0000 7f901616d640 1 -- 172.21.15.123:0/2693199355 wait complete. 2024-09-15T23:21:23.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.442+0000 7f901616d640 1 Processor -- start 2024-09-15T23:21:23.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.442+0000 7f901616d640 1 -- start start 2024-09-15T23:21:23.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.442+0000 7f901616d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f901006f8b0 0x7f901015bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:23.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.442+0000 7f901616d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90100cf6f0 0x7f90100cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:23.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.443+0000 7f901616d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90101607d0 0x7f90100c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:23.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.443+0000 7f901616d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f901006fc90 con 0x7f901006f8b0 2024-09-15T23:21:23.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.443+0000 7f901616d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f90100d04a0 con 0x7f90100cf6f0 2024-09-15T23:21:23.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.443+0000 7f901616d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f90100b4580 con 0x7f90101607d0 2024-09-15T23:21:23.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.443+0000 7f900f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f901006f8b0 0x7f901015bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:23.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.443+0000 7f900f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f901006f8b0 0x7f901015bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57284/0 (socket says 172.21.15.123:57284) 2024-09-15T23:21:23.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.443+0000 7f900f7fe640 1 -- 172.21.15.123:0/932470370 learned_addr learned my addr 172.21.15.123:0/932470370 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:23.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.443+0000 7f900f7fe640 1 -- 172.21.15.123:0/932470370 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90101607d0 msgr2=0x7f90100c5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:23.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.443+0000 7f900effd640 1 --2- 172.21.15.123:0/932470370 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90100cf6f0 0x7f90100cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:23.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.443+0000 7f900ffff640 1 --2- 172.21.15.123:0/932470370 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90101607d0 0x7f90100c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:23.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.443+0000 7f900f7fe640 1 --2- 172.21.15.123:0/932470370 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90101607d0 0x7f90100c5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:23.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.443+0000 7f900f7fe640 1 -- 172.21.15.123:0/932470370 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90100cf6f0 msgr2=0x7f90100cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:23.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.443+0000 7f900f7fe640 1 --2- 172.21.15.123:0/932470370 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90100cf6f0 0x7f90100cc1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:23.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.443+0000 7f900f7fe640 1 -- 172.21.15.123:0/932470370 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90101f2ee0 con 0x7f901006f8b0 2024-09-15T23:21:23.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.443+0000 7f900ffff640 1 --2- 172.21.15.123:0/932470370 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90101607d0 0x7f90100c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:21:23.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.443+0000 7f900effd640 1 --2- 172.21.15.123:0/932470370 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90100cf6f0 0x7f90100cc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:21:23.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.443+0000 7f900f7fe640 1 --2- 172.21.15.123:0/932470370 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f901006f8b0 0x7f901015bbc0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f900000c430 tx=0x7f900000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:23.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.443+0000 7f8ff7fff640 1 -- 172.21.15.123:0/932470370 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90000074e0 con 0x7f901006f8b0 2024-09-15T23:21:23.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.443+0000 7f8ff7fff640 1 -- 172.21.15.123:0/932470370 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90000047e0 con 0x7f901006f8b0 2024-09-15T23:21:23.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.443+0000 7f901616d640 1 -- 172.21.15.123:0/932470370 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9010158f80 con 0x7f901006f8b0 2024-09-15T23:21:23.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.443+0000 7f8ff7fff640 1 -- 172.21.15.123:0/932470370 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9000004bd0 con 0x7f901006f8b0 2024-09-15T23:21:23.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.443+0000 7f901616d640 1 -- 172.21.15.123:0/932470370 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90100cc6f0 con 0x7f901006f8b0 2024-09-15T23:21:23.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.444+0000 7f901616d640 1 -- 172.21.15.123:0/932470370 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9010158d70 con 0x7f901006f8b0 2024-09-15T23:21:23.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.445+0000 7f8ff7fff640 1 -- 172.21.15.123:0/932470370 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9000011070 con 0x7f901006f8b0 2024-09-15T23:21:23.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.445+0000 7f8ff7fff640 1 --2- 172.21.15.123:0/932470370 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8ffc06c2b0 0x7f8ffc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:23.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.445+0000 7f8ff7fff640 1 -- 172.21.15.123:0/932470370 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f900008b0d0 con 0x7f901006f8b0 2024-09-15T23:21:23.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.446+0000 7f900effd640 1 --2- 172.21.15.123:0/932470370 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8ffc06c2b0 0x7f8ffc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:23.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.446+0000 7f900effd640 1 --2- 172.21.15.123:0/932470370 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8ffc06c2b0 0x7f8ffc06e770 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f9004034000 tx=0x7f900402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:23.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.450+0000 7f8ff7fff640 1 -- 172.21.15.123:0/932470370 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9000059840 con 0x7f901006f8b0 2024-09-15T23:21:23.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.650+0000 7f901616d640 1 -- 172.21.15.123:0/932470370 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f901006e380 con 0x7f901006f8b0 2024-09-15T23:21:23.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.727+0000 7f8ff7fff640 1 -- 172.21.15.123:0/932470370 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v99) ==== 118+0+0 (secure 0 0 0) 0x7f9000059140 con 0x7f901006f8b0 2024-09-15T23:21:23.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.729+0000 7f901616d640 1 -- 172.21.15.123:0/932470370 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8ffc06c2b0 msgr2=0x7f8ffc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:23.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.729+0000 7f901616d640 1 --2- 172.21.15.123:0/932470370 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8ffc06c2b0 0x7f8ffc06e770 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f9004034000 tx=0x7f900402e000 comp rx=0 tx=0).stop 2024-09-15T23:21:23.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.729+0000 7f901616d640 1 -- 172.21.15.123:0/932470370 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f901006f8b0 msgr2=0x7f901015bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:23.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.729+0000 7f901616d640 1 --2- 172.21.15.123:0/932470370 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f901006f8b0 0x7f901015bbc0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f900000c430 tx=0x7f900000c8f0 comp rx=0 tx=0).stop 2024-09-15T23:21:23.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.729+0000 7f901616d640 1 -- 172.21.15.123:0/932470370 shutdown_connections 2024-09-15T23:21:23.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.729+0000 7f901616d640 1 --2- 172.21.15.123:0/932470370 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f90101607d0 0x7f90100c5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:23.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.729+0000 7f901616d640 1 --2- 172.21.15.123:0/932470370 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f90100cf6f0 0x7f90100cc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:23.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.729+0000 7f901616d640 1 --2- 172.21.15.123:0/932470370 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8ffc06c2b0 0x7f8ffc06e770 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:23.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.729+0000 7f901616d640 1 --2- 172.21.15.123:0/932470370 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f901006f8b0 0x7f901015bbc0 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:23.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.729+0000 7f901616d640 1 -- 172.21.15.123:0/932470370 >> 172.21.15.123:0/932470370 conn(0x7f90100b2510 msgr2=0x7f90100d0620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:23.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.729+0000 7f901616d640 1 -- 172.21.15.123:0/932470370 shutdown_connections 2024-09-15T23:21:23.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.729+0000 7f901616d640 1 -- 172.21.15.123:0/932470370 wait complete. 2024-09-15T23:21:23.742 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T23:21:23.742 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T23:21:23.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.842+0000 7f54df92a640 1 Processor -- start 2024-09-15T23:21:23.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.842+0000 7f54df92a640 1 -- start start 2024-09-15T23:21:23.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.843+0000 7f54df92a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54d80732e0 0x7f54d80736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:23.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.843+0000 7f54df92a640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f54d80cce30 0x7f54d80cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:23.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.843+0000 7f54df92a640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54d80714b0 con 0x7f54d8071c70 2024-09-15T23:21:23.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.843+0000 7f54df92a640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f54d8073c00 con 0x7f54d80cce30 2024-09-15T23:21:23.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.843+0000 7f54df92a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f54d80cd880 con 0x7f54d80732e0 2024-09-15T23:21:23.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.843+0000 7f54ddec7640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f54d8071c70 0x7f54d815c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:57266/0 (socket says 172.21.15.123:57266) 2024-09-15T23:21:23.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.843+0000 7f54ddec7640 1 -- 172.21.15.123:0/1077574164 learned_addr learned my addr 172.21.15.123:0/1077574164 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:21:23.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.843+0000 7f54dd6c6640 1 --2- 172.21.15.123:0/1077574164 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54d80732e0 0x7f54d80736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:23.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.843+0000 7f54dcec5640 1 --2- 172.21.15.123:0/1077574164 >> v2:172.21.15.188:3300/0 conn(0x7f54d80cce30 0x7f54d80cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:23.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.843+0000 7f54d7fff640 1 -- 172.21.15.123:0/1077574164 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3710442237 0 0) 0x7f54d80714b0 con 0x7f54d8071c70 2024-09-15T23:21:23.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.843+0000 7f54d7fff640 1 -- 172.21.15.123:0/1077574164 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54c0003520 con 0x7f54d8071c70 2024-09-15T23:21:23.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.843+0000 7f54d7fff640 1 -- 172.21.15.123:0/1077574164 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 840939728 0 0) 0x7f54c0003520 con 0x7f54d8071c70 2024-09-15T23:21:23.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.843+0000 7f54d7fff640 1 -- 172.21.15.123:0/1077574164 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54d80732e0 msgr2=0x7f54d80736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:23.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.843+0000 7f54d7fff640 1 --2- 172.21.15.123:0/1077574164 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54d80732e0 0x7f54d80736c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:23.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.843+0000 7f54d7fff640 1 -- 172.21.15.123:0/1077574164 >> v2:172.21.15.188:3300/0 conn(0x7f54d80cce30 msgr2=0x7f54d80cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:23.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.843+0000 7f54d7fff640 1 --2- 172.21.15.123:0/1077574164 >> v2:172.21.15.188:3300/0 conn(0x7f54d80cce30 0x7f54d80cd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:23.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.843+0000 7f54d7fff640 1 -- 172.21.15.123:0/1077574164 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d80cdb60 con 0x7f54d8071c70 2024-09-15T23:21:23.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.843+0000 7f54d7fff640 1 -- 172.21.15.123:0/1077574164 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f54c8001670 con 0x7f54d8071c70 2024-09-15T23:21:23.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.843+0000 7f54d7fff640 1 -- 172.21.15.123:0/1077574164 >> v1:172.21.15.123:6789/0 conn(0x7f54d8071c70 legacy=0x7f54d815c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:23.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.843+0000 7f54d7fff640 1 --2- 172.21.15.123:0/1077574164 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54c00039b0 0x7f54c0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:23.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.843+0000 7f54d7fff640 1 --2- 172.21.15.123:0/1077574164 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f54c0004800 0x7f54c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:23.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.843+0000 7f54d7fff640 1 --2- 172.21.15.123:0/1077574164 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54d80732e0 0x7f54c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:23.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.843+0000 7f54d7fff640 1 -- 172.21.15.123:0/1077574164 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f54d8073c00 con 0x7f54c00039b0 2024-09-15T23:21:23.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.843+0000 7f54d7fff640 1 -- 172.21.15.123:0/1077574164 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f54d80cd880 con 0x7f54c0004800 2024-09-15T23:21:23.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.843+0000 7f54d7fff640 1 -- 172.21.15.123:0/1077574164 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f54c000b9c0 con 0x7f54d80732e0 2024-09-15T23:21:23.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.844+0000 7f54dd6c6640 1 --2- 172.21.15.123:0/1077574164 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54c00039b0 0x7f54c0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:23.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.844+0000 7f54dcec5640 1 --2- 172.21.15.123:0/1077574164 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f54c0004800 0x7f54c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:23.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.844+0000 7f54ddec7640 1 --2- 172.21.15.123:0/1077574164 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54d80732e0 0x7f54c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:23.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.844+0000 7f54dd6c6640 1 -- 172.21.15.123:0/1077574164 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54d80732e0 msgr2=0x7f54c00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:23.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.844+0000 7f54dd6c6640 1 --2- 172.21.15.123:0/1077574164 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54d80732e0 0x7f54c00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:23.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.844+0000 7f54dd6c6640 1 -- 172.21.15.123:0/1077574164 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f54c0004800 msgr2=0x7f54c0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:23.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.844+0000 7f54dd6c6640 1 --2- 172.21.15.123:0/1077574164 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f54c0004800 0x7f54c0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:23.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.844+0000 7f54dd6c6640 1 -- 172.21.15.123:0/1077574164 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54c0003520 con 0x7f54c00039b0 2024-09-15T23:21:23.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.844+0000 7f54dd6c6640 1 --2- 172.21.15.123:0/1077574164 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54c00039b0 0x7f54c0003dd0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f54d000e170 tx=0x7f54c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e97ba770c470b9a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:23.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.845+0000 7f54d7fff640 1 -- 172.21.15.123:0/1077574164 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d0034020 con 0x7f54c00039b0 2024-09-15T23:21:23.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.845+0000 7f54d7fff640 1 -- 172.21.15.123:0/1077574164 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54d00305f0 con 0x7f54c00039b0 2024-09-15T23:21:23.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.845+0000 7f54d7fff640 1 -- 172.21.15.123:0/1077574164 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d0009c10 con 0x7f54c00039b0 2024-09-15T23:21:23.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.845+0000 7f54df92a640 1 -- 172.21.15.123:0/1077574164 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54c00039b0 msgr2=0x7f54c0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:23.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.845+0000 7f54df92a640 1 --2- 172.21.15.123:0/1077574164 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54c00039b0 0x7f54c0003dd0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f54d000e170 tx=0x7f54c0005830 comp rx=0 tx=0).stop 2024-09-15T23:21:23.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.845+0000 7f54ddec7640 1 -- 172.21.15.123:0/1077574164 reap_dead start 2024-09-15T23:21:23.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.845+0000 7f54df92a640 1 -- 172.21.15.123:0/1077574164 shutdown_connections 2024-09-15T23:21:23.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.845+0000 7f54df92a640 1 -- 172.21.15.123:0/1077574164 >> 172.21.15.123:0/1077574164 conn(0x7f54d806d0f0 msgr2=0x7f54d806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:23.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.845+0000 7f54df92a640 1 -- 172.21.15.123:0/1077574164 shutdown_connections 2024-09-15T23:21:23.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.845+0000 7f54df92a640 1 -- 172.21.15.123:0/1077574164 wait complete. 2024-09-15T23:21:23.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.846+0000 7f54df92a640 1 Processor -- start 2024-09-15T23:21:23.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.847+0000 7f54df92a640 1 -- start start 2024-09-15T23:21:23.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.847+0000 7f54df92a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54c00039b0 0x7f54d81462b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:23.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.847+0000 7f54df92a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f54d80c65c0 0x7f54d80c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:23.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.847+0000 7f54df92a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54d80b5690 0x7f54d80b5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:23.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.847+0000 7f54df92a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f54d806bf70 con 0x7f54d80b5690 2024-09-15T23:21:23.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.847+0000 7f54df92a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f54d806bdf0 con 0x7f54d80c65c0 2024-09-15T23:21:23.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.847+0000 7f54df92a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f54d80736c0 con 0x7f54c00039b0 2024-09-15T23:21:23.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.847+0000 7f54ddec7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54d80b5690 0x7f54d80b5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:23.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.847+0000 7f54ddec7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54d80b5690 0x7f54d80b5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57302/0 (socket says 172.21.15.123:57302) 2024-09-15T23:21:23.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.847+0000 7f54ddec7640 1 -- 172.21.15.123:0/3436482722 learned_addr learned my addr 172.21.15.123:0/3436482722 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:23.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.847+0000 7f54dd6c6640 1 --2- 172.21.15.123:0/3436482722 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54c00039b0 0x7f54d81462b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:23.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.847+0000 7f54dcec5640 1 --2- 172.21.15.123:0/3436482722 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f54d80c65c0 0x7f54d80c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:23.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.848+0000 7f54ddec7640 1 -- 172.21.15.123:0/3436482722 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54c00039b0 msgr2=0x7f54d81462b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:23.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.848+0000 7f54ddec7640 1 --2- 172.21.15.123:0/3436482722 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54c00039b0 0x7f54d81462b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:23.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.848+0000 7f54ddec7640 1 -- 172.21.15.123:0/3436482722 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f54d80c65c0 msgr2=0x7f54d80c6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:23.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.848+0000 7f54ddec7640 1 --2- 172.21.15.123:0/3436482722 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f54d80c65c0 0x7f54d80c6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:23.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.848+0000 7f54ddec7640 1 -- 172.21.15.123:0/3436482722 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d81f3790 con 0x7f54d80b5690 2024-09-15T23:21:23.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.848+0000 7f54ddec7640 1 --2- 172.21.15.123:0/3436482722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54d80b5690 0x7f54d80b5b10 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f54d806cdf0 tx=0x7f54c8007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:23.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.848+0000 7f54d5ffb640 1 -- 172.21.15.123:0/3436482722 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c800f620 con 0x7f54d80b5690 2024-09-15T23:21:23.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.848+0000 7f54d5ffb640 1 -- 172.21.15.123:0/3436482722 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54c8018070 con 0x7f54d80b5690 2024-09-15T23:21:23.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.848+0000 7f54d5ffb640 1 -- 172.21.15.123:0/3436482722 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c800fa20 con 0x7f54d80b5690 2024-09-15T23:21:23.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.848+0000 7f54df92a640 1 -- 172.21.15.123:0/3436482722 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54d81f3a70 con 0x7f54d80b5690 2024-09-15T23:21:23.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.848+0000 7f54df92a640 1 -- 172.21.15.123:0/3436482722 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54d81f4030 con 0x7f54d80b5690 2024-09-15T23:21:23.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.849+0000 7f54df92a640 1 -- 172.21.15.123:0/3436482722 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54d80b6050 con 0x7f54d80b5690 2024-09-15T23:21:23.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.849+0000 7f54d5ffb640 1 -- 172.21.15.123:0/3436482722 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f54c800fbc0 con 0x7f54d80b5690 2024-09-15T23:21:23.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.850+0000 7f54d5ffb640 1 --2- 172.21.15.123:0/3436482722 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f54c406c2b0 0x7f54c406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:23.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.850+0000 7f54d5ffb640 1 -- 172.21.15.123:0/3436482722 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7f54c808b120 con 0x7f54d80b5690 2024-09-15T23:21:23.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.850+0000 7f54dd6c6640 1 --2- 172.21.15.123:0/3436482722 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f54c406c2b0 0x7f54c406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:23.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.851+0000 7f54dd6c6640 1 --2- 172.21.15.123:0/3436482722 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f54c406c2b0 0x7f54c406e770 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f54d0035000 tx=0x7f54d002f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:23.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:23.854+0000 7f54d5ffb640 1 -- 172.21.15.123:0/3436482722 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f54c8059240 con 0x7f54d80b5690 2024-09-15T23:21:24.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.055+0000 7f54df92a640 1 -- 172.21.15.123:0/3436482722 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f54d80d1670 con 0x7f54d80b5690 2024-09-15T23:21:24.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.728+0000 7f54d5ffb640 1 -- 172.21.15.123:0/3436482722 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v100) ==== 122+0+0 (secure 0 0 0) 0x7f54d80d1670 con 0x7f54d80b5690 2024-09-15T23:21:24.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.732+0000 7f54df92a640 1 -- 172.21.15.123:0/3436482722 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f54c406c2b0 msgr2=0x7f54c406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:24.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.732+0000 7f54df92a640 1 --2- 172.21.15.123:0/3436482722 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f54c406c2b0 0x7f54c406e770 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f54d0035000 tx=0x7f54d002f000 comp rx=0 tx=0).stop 2024-09-15T23:21:24.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.732+0000 7f54df92a640 1 -- 172.21.15.123:0/3436482722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54d80b5690 msgr2=0x7f54d80b5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:24.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.732+0000 7f54df92a640 1 --2- 172.21.15.123:0/3436482722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54d80b5690 0x7f54d80b5b10 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f54d806cdf0 tx=0x7f54c8007430 comp rx=0 tx=0).stop 2024-09-15T23:21:24.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.732+0000 7f54df92a640 1 -- 172.21.15.123:0/3436482722 shutdown_connections 2024-09-15T23:21:24.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.732+0000 7f54df92a640 1 --2- 172.21.15.123:0/3436482722 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f54c406c2b0 0x7f54c406e770 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:24.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.732+0000 7f54df92a640 1 --2- 172.21.15.123:0/3436482722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54d80b5690 0x7f54d80b5b10 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:24.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.732+0000 7f54df92a640 1 --2- 172.21.15.123:0/3436482722 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f54d80c65c0 0x7f54d80c6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:24.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.732+0000 7f54df92a640 1 --2- 172.21.15.123:0/3436482722 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f54c00039b0 0x7f54d81462b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:24.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.732+0000 7f54df92a640 1 -- 172.21.15.123:0/3436482722 >> 172.21.15.123:0/3436482722 conn(0x7f54d806d0f0 msgr2=0x7f54d806c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:24.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.732+0000 7f54df92a640 1 -- 172.21.15.123:0/3436482722 shutdown_connections 2024-09-15T23:21:24.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.732+0000 7f54df92a640 1 -- 172.21.15.123:0/3436482722 wait complete. 2024-09-15T23:21:24.746 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T23:21:24.746 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:21:24.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.844+0000 7fdc685c6640 1 Processor -- start 2024-09-15T23:21:24.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.844+0000 7fdc685c6640 1 -- start start 2024-09-15T23:21:24.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.845+0000 7fdc685c6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc6015ed20 0x7fdc600b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:24.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.845+0000 7fdc685c6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fdc600d23b0 0x7fdc600b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:24.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.845+0000 7fdc685c6640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc600d0e70 con 0x7fdc600cf2d0 2024-09-15T23:21:24.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.845+0000 7fdc685c6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fdc600d41c0 con 0x7fdc600d23b0 2024-09-15T23:21:24.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.845+0000 7fdc685c6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fdc600d35b0 con 0x7fdc6015ed20 2024-09-15T23:21:24.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.846+0000 7fdc66362640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc6015ed20 0x7fdc600b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:24.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.846+0000 7fdc65b61640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fdc600d23b0 0x7fdc600b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:24.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.846+0000 7fdc66b63640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fdc600cf2d0 0x7fdc600cf760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:60662/0 (socket says 172.21.15.123:60662) 2024-09-15T23:21:24.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.846+0000 7fdc66362640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc6015ed20 0x7fdc600b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:57290/0 (socket says 172.21.15.123:57290) 2024-09-15T23:21:24.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.846+0000 7fdc66b63640 1 -- 172.21.15.123:0/2778679924 learned_addr learned my addr 172.21.15.123:0/2778679924 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:21:24.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.846+0000 7fdc66362640 1 -- 172.21.15.123:0/2778679924 >> v2:172.21.15.188:3300/0 conn(0x7fdc600d23b0 msgr2=0x7fdc600b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:24.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.846+0000 7fdc66362640 1 --2- 172.21.15.123:0/2778679924 >> v2:172.21.15.188:3300/0 conn(0x7fdc600d23b0 0x7fdc600b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:24.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.846+0000 7fdc66362640 1 -- 172.21.15.123:0/2778679924 >> v1:172.21.15.188:6789/0 conn(0x7fdc600cf2d0 legacy=0x7fdc600cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:24.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.846+0000 7fdc66362640 1 -- 172.21.15.123:0/2778679924 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc600d3890 con 0x7fdc6015ed20 2024-09-15T23:21:24.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.846+0000 7fdc65b61640 1 --2- 172.21.15.123:0/2778679924 >> v2:172.21.15.188:3300/0 conn(0x7fdc600d23b0 0x7fdc600b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:21:24.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.847+0000 7fdc66362640 1 --2- 172.21.15.123:0/2778679924 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc6015ed20 0x7fdc600b6260 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdc58009d90 tx=0x7fdc5802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53c262a7aead976e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:24.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.847+0000 7fdc65360640 1 -- 172.21.15.123:0/2778679924 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc58007740 con 0x7fdc6015ed20 2024-09-15T23:21:24.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.847+0000 7fdc65360640 1 -- 172.21.15.123:0/2778679924 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc580078e0 con 0x7fdc6015ed20 2024-09-15T23:21:24.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.847+0000 7fdc65360640 1 -- 172.21.15.123:0/2778679924 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc58007cb0 con 0x7fdc6015ed20 2024-09-15T23:21:24.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.848+0000 7fdc685c6640 1 -- 172.21.15.123:0/2778679924 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc6015ed20 msgr2=0x7fdc600b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:24.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.848+0000 7fdc685c6640 1 --2- 172.21.15.123:0/2778679924 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc6015ed20 0x7fdc600b6260 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdc58009d90 tx=0x7fdc5802a660 comp rx=0 tx=0).stop 2024-09-15T23:21:24.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.848+0000 7fdc685c6640 1 -- 172.21.15.123:0/2778679924 shutdown_connections 2024-09-15T23:21:24.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.848+0000 7fdc685c6640 1 --2- 172.21.15.123:0/2778679924 >> v2:172.21.15.188:3300/0 conn(0x7fdc600d23b0 0x7fdc600b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:24.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.848+0000 7fdc685c6640 1 --2- 172.21.15.123:0/2778679924 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc6015ed20 0x7fdc600b6260 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:24.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.848+0000 7fdc685c6640 1 -- 172.21.15.123:0/2778679924 >> 172.21.15.123:0/2778679924 conn(0x7fdc600d1260 msgr2=0x7fdc600d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:24.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.848+0000 7fdc685c6640 1 -- 172.21.15.123:0/2778679924 shutdown_connections 2024-09-15T23:21:24.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.848+0000 7fdc685c6640 1 -- 172.21.15.123:0/2778679924 wait complete. 2024-09-15T23:21:24.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.849+0000 7fdc685c6640 1 Processor -- start 2024-09-15T23:21:24.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.849+0000 7fdc685c6640 1 -- start start 2024-09-15T23:21:24.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.850+0000 7fdc685c6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc600cf2d0 0x7fdc6014cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:24.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.850+0000 7fdc685c6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc600d23b0 0x7fdc600cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:24.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.850+0000 7fdc685c6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc6015ed20 0x7fdc600b5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:24.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.850+0000 7fdc685c6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdc600d32a0 con 0x7fdc6015ed20 2024-09-15T23:21:24.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.850+0000 7fdc685c6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fdc600d3e50 con 0x7fdc600d23b0 2024-09-15T23:21:24.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.850+0000 7fdc685c6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fdc6015f100 con 0x7fdc600cf2d0 2024-09-15T23:21:24.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.850+0000 7fdc66b63640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc6015ed20 0x7fdc600b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:24.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.850+0000 7fdc66b63640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc6015ed20 0x7fdc600b5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57318/0 (socket says 172.21.15.123:57318) 2024-09-15T23:21:24.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.850+0000 7fdc66b63640 1 -- 172.21.15.123:0/4164468789 learned_addr learned my addr 172.21.15.123:0/4164468789 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:24.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.850+0000 7fdc66362640 1 --2- 172.21.15.123:0/4164468789 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc600cf2d0 0x7fdc6014cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:24.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.850+0000 7fdc65b61640 1 --2- 172.21.15.123:0/4164468789 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc600d23b0 0x7fdc600cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:24.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.850+0000 7fdc66b63640 1 -- 172.21.15.123:0/4164468789 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc600cf2d0 msgr2=0x7fdc6014cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:24.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.850+0000 7fdc66b63640 1 --2- 172.21.15.123:0/4164468789 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc600cf2d0 0x7fdc6014cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:24.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.850+0000 7fdc66b63640 1 -- 172.21.15.123:0/4164468789 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc600d23b0 msgr2=0x7fdc600cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:24.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.850+0000 7fdc66b63640 1 --2- 172.21.15.123:0/4164468789 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc600d23b0 0x7fdc600cc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:24.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.850+0000 7fdc66b63640 1 -- 172.21.15.123:0/4164468789 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc600ccc40 con 0x7fdc6015ed20 2024-09-15T23:21:24.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.850+0000 7fdc66b63640 1 --2- 172.21.15.123:0/4164468789 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc6015ed20 0x7fdc600b5480 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000c3c0 tx=0x7fdc5000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:24.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.850+0000 7fdc5effd640 1 -- 172.21.15.123:0/4164468789 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc50017070 con 0x7fdc6015ed20 2024-09-15T23:21:24.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.850+0000 7fdc5effd640 1 -- 172.21.15.123:0/4164468789 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc50005ce0 con 0x7fdc6015ed20 2024-09-15T23:21:24.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.850+0000 7fdc685c6640 1 -- 172.21.15.123:0/4164468789 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc600ccf20 con 0x7fdc6015ed20 2024-09-15T23:21:24.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.850+0000 7fdc5effd640 1 -- 172.21.15.123:0/4164468789 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc500072f0 con 0x7fdc6015ed20 2024-09-15T23:21:24.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.850+0000 7fdc685c6640 1 -- 172.21.15.123:0/4164468789 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc6014d0d0 con 0x7fdc6015ed20 2024-09-15T23:21:24.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.851+0000 7fdc685c6640 1 -- 172.21.15.123:0/4164468789 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc600b7010 con 0x7fdc6015ed20 2024-09-15T23:21:24.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.852+0000 7fdc5effd640 1 -- 172.21.15.123:0/4164468789 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdc5001a070 con 0x7fdc6015ed20 2024-09-15T23:21:24.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.852+0000 7fdc5effd640 1 --2- 172.21.15.123:0/4164468789 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdc4c06c2e0 0x7fdc4c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:24.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.852+0000 7fdc5effd640 1 -- 172.21.15.123:0/4164468789 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7fdc5008a7d0 con 0x7fdc6015ed20 2024-09-15T23:21:24.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.852+0000 7fdc66362640 1 --2- 172.21.15.123:0/4164468789 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdc4c06c2e0 0x7fdc4c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:24.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.853+0000 7fdc66362640 1 --2- 172.21.15.123:0/4164468789 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdc4c06c2e0 0x7fdc4c06e7a0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fdc58034000 tx=0x7fdc58033040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:24.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:24.856+0000 7fdc5effd640 1 -- 172.21.15.123:0/4164468789 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdc600d0e70 con 0x7fdc6015ed20 2024-09-15T23:21:25.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.060+0000 7fdc685c6640 1 -- 172.21.15.123:0/4164468789 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc600b3f20 con 0x7fdc6015ed20 2024-09-15T23:21:25.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.060+0000 7fdc5effd640 1 -- 172.21.15.123:0/4164468789 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) ==== 95+0+5241 (secure 0 0 0) 0x7fdc50058eb0 con 0x7fdc6015ed20 2024-09-15T23:21:25.061 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:25.061 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":100,"btime":"2024-09-15T23:21:24:727971+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7214,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/1648353391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1648353391},{"type":"v1","addr":"172.21.15.188:6837","nonce":1648353391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8122,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/1714717257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":1714717257},{"type":"v1","addr":"172.21.15.188:6836","nonce":1714717257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":9552,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/3722702026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3722702026},{"type":"v1","addr":"172.21.15.123:6833","nonce":3722702026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:21:22.066391+0000","modified":"2024-09-15T23:21:24.056941+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9564},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9564":{"gid":9564,"name":"a","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/1883512279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1883512279},{"type":"v1","addr":"172.21.15.123:6835","nonce":1883512279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9564,"qdb_cluster":[9564]},"id":11}]} 2024-09-15T23:21:25.062 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 100 2024-09-15T23:21:25.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.062+0000 7fdc685c6640 1 -- 172.21.15.123:0/4164468789 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdc4c06c2e0 msgr2=0x7fdc4c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:25.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.062+0000 7fdc685c6640 1 --2- 172.21.15.123:0/4164468789 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdc4c06c2e0 0x7fdc4c06e7a0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fdc58034000 tx=0x7fdc58033040 comp rx=0 tx=0).stop 2024-09-15T23:21:25.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.062+0000 7fdc685c6640 1 -- 172.21.15.123:0/4164468789 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc6015ed20 msgr2=0x7fdc600b5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:25.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.062+0000 7fdc685c6640 1 --2- 172.21.15.123:0/4164468789 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc6015ed20 0x7fdc600b5480 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000c3c0 tx=0x7fdc5000c880 comp rx=0 tx=0).stop 2024-09-15T23:21:25.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.062+0000 7fdc685c6640 1 -- 172.21.15.123:0/4164468789 shutdown_connections 2024-09-15T23:21:25.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.062+0000 7fdc685c6640 1 --2- 172.21.15.123:0/4164468789 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdc4c06c2e0 0x7fdc4c06e7a0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.062+0000 7fdc685c6640 1 --2- 172.21.15.123:0/4164468789 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc6015ed20 0x7fdc600b5480 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.062+0000 7fdc685c6640 1 --2- 172.21.15.123:0/4164468789 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdc600d23b0 0x7fdc600cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.062+0000 7fdc685c6640 1 --2- 172.21.15.123:0/4164468789 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdc600cf2d0 0x7fdc6014cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.062+0000 7fdc685c6640 1 -- 172.21.15.123:0/4164468789 >> 172.21.15.123:0/4164468789 conn(0x7fdc600d1260 msgr2=0x7fdc600d47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:25.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.062+0000 7fdc685c6640 1 -- 172.21.15.123:0/4164468789 shutdown_connections 2024-09-15T23:21:25.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.062+0000 7fdc685c6640 1 -- 172.21.15.123:0/4164468789 wait complete. 2024-09-15T23:21:25.075 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:21:25.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.172+0000 7fbc39b31640 1 Processor -- start 2024-09-15T23:21:25.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.172+0000 7fbc39b31640 1 -- start start 2024-09-15T23:21:25.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.173+0000 7fbc39b31640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fbc3415c4b0 0x7fbc340b6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:25.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.173+0000 7fbc39b31640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbc340b02b0 0x7fbc340b6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:25.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.173+0000 7fbc39b31640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc340d08e0 0x7fbc34160120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:25.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.173+0000 7fbc39b31640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fbc34067b50 con 0x7fbc340b02b0 2024-09-15T23:21:25.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.173+0000 7fbc39b31640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fbc340ce860 con 0x7fbc3415c4b0 2024-09-15T23:21:25.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.173+0000 7fbc39b31640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbc34070130 con 0x7fbc340d08e0 2024-09-15T23:21:25.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.173+0000 7fbc32ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbc340b02b0 0x7fbc340b6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:25.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.173+0000 7fbc32ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbc340b02b0 0x7fbc340b6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57324/0 (socket says 172.21.15.123:57324) 2024-09-15T23:21:25.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.173+0000 7fbc32ffd640 1 -- 172.21.15.123:0/37824363 learned_addr learned my addr 172.21.15.123:0/37824363 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:25.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.173+0000 7fbc337fe640 1 --2- 172.21.15.123:0/37824363 >> v2:172.21.15.188:3300/0 conn(0x7fbc3415c4b0 0x7fbc340b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:25.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.173+0000 7fbc33fff640 1 --2- 172.21.15.123:0/37824363 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc340d08e0 0x7fbc34160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:25.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.173+0000 7fbc32ffd640 1 -- 172.21.15.123:0/37824363 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc340d08e0 msgr2=0x7fbc34160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:25.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.173+0000 7fbc32ffd640 1 --2- 172.21.15.123:0/37824363 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc340d08e0 0x7fbc34160120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.173+0000 7fbc32ffd640 1 -- 172.21.15.123:0/37824363 >> v2:172.21.15.188:3300/0 conn(0x7fbc3415c4b0 msgr2=0x7fbc340b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:25.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.173+0000 7fbc32ffd640 1 --2- 172.21.15.123:0/37824363 >> v2:172.21.15.188:3300/0 conn(0x7fbc3415c4b0 0x7fbc340b6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.173+0000 7fbc32ffd640 1 -- 172.21.15.123:0/37824363 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc3406fe50 con 0x7fbc340b02b0 2024-09-15T23:21:25.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.174+0000 7fbc32ffd640 1 --2- 172.21.15.123:0/37824363 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc340b02b0 0x7fbc340b6660 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fbc34069d90 tx=0x7fbc2802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59d9f828833a0e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:25.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.174+0000 7fbc327fc640 1 -- 172.21.15.123:0/37824363 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc28037070 con 0x7fbc340b02b0 2024-09-15T23:21:25.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.174+0000 7fbc327fc640 1 -- 172.21.15.123:0/37824363 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc28032440 con 0x7fbc340b02b0 2024-09-15T23:21:25.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.174+0000 7fbc327fc640 1 -- 172.21.15.123:0/37824363 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc28032810 con 0x7fbc340b02b0 2024-09-15T23:21:25.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.175+0000 7fbc39b31640 1 -- 172.21.15.123:0/37824363 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc340b02b0 msgr2=0x7fbc340b6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:25.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.175+0000 7fbc39b31640 1 --2- 172.21.15.123:0/37824363 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc340b02b0 0x7fbc340b6660 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fbc34069d90 tx=0x7fbc2802a1e0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.175+0000 7fbc39b31640 1 -- 172.21.15.123:0/37824363 shutdown_connections 2024-09-15T23:21:25.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.175+0000 7fbc39b31640 1 --2- 172.21.15.123:0/37824363 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc340d08e0 0x7fbc34160120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.175+0000 7fbc39b31640 1 --2- 172.21.15.123:0/37824363 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc340b02b0 0x7fbc340b6660 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.175+0000 7fbc39b31640 1 --2- 172.21.15.123:0/37824363 >> v2:172.21.15.188:3300/0 conn(0x7fbc3415c4b0 0x7fbc340b6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.175+0000 7fbc39b31640 1 -- 172.21.15.123:0/37824363 >> 172.21.15.123:0/37824363 conn(0x7fbc340b0a80 msgr2=0x7fbc340b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:25.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.175+0000 7fbc39b31640 1 -- 172.21.15.123:0/37824363 shutdown_connections 2024-09-15T23:21:25.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.175+0000 7fbc39b31640 1 -- 172.21.15.123:0/37824363 wait complete. 2024-09-15T23:21:25.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.176+0000 7fbc39b31640 1 Processor -- start 2024-09-15T23:21:25.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.176+0000 7fbc39b31640 1 -- start start 2024-09-15T23:21:25.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.177+0000 7fbc39b31640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc340b02b0 0x7fbc34156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:25.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.177+0000 7fbc39b31640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc340d08e0 0x7fbc341466a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:25.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.177+0000 7fbc39b31640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc3415c4b0 0x7fbc3415eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:25.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.177+0000 7fbc39b31640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3406dcc0 con 0x7fbc340b02b0 2024-09-15T23:21:25.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.177+0000 7fbc39b31640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbc340ce580 con 0x7fbc340d08e0 2024-09-15T23:21:25.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.177+0000 7fbc39b31640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbc3415c890 con 0x7fbc3415c4b0 2024-09-15T23:21:25.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.177+0000 7fbc337fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc340b02b0 0x7fbc34156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:25.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.177+0000 7fbc337fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc340b02b0 0x7fbc34156f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57340/0 (socket says 172.21.15.123:57340) 2024-09-15T23:21:25.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.177+0000 7fbc337fe640 1 -- 172.21.15.123:0/1031278023 learned_addr learned my addr 172.21.15.123:0/1031278023 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:25.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.177+0000 7fbc32ffd640 1 --2- 172.21.15.123:0/1031278023 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc340d08e0 0x7fbc341466a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:25.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.177+0000 7fbc33fff640 1 --2- 172.21.15.123:0/1031278023 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc3415c4b0 0x7fbc3415eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:25.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.177+0000 7fbc337fe640 1 -- 172.21.15.123:0/1031278023 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc3415c4b0 msgr2=0x7fbc3415eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:25.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.177+0000 7fbc337fe640 1 --2- 172.21.15.123:0/1031278023 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc3415c4b0 0x7fbc3415eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.177+0000 7fbc337fe640 1 -- 172.21.15.123:0/1031278023 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc340d08e0 msgr2=0x7fbc341466a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:25.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.177+0000 7fbc337fe640 1 --2- 172.21.15.123:0/1031278023 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc340d08e0 0x7fbc341466a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.177+0000 7fbc337fe640 1 -- 172.21.15.123:0/1031278023 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc34157510 con 0x7fbc340b02b0 2024-09-15T23:21:25.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.177+0000 7fbc33fff640 1 --2- 172.21.15.123:0/1031278023 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc3415c4b0 0x7fbc3415eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:21:25.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.178+0000 7fbc337fe640 1 --2- 172.21.15.123:0/1031278023 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc340b02b0 0x7fbc34156f30 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7fbc2400d620 tx=0x7fbc2400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:25.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.178+0000 7fbc1bfff640 1 -- 172.21.15.123:0/1031278023 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2400b620 con 0x7fbc340b02b0 2024-09-15T23:21:25.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.178+0000 7fbc1bfff640 1 -- 172.21.15.123:0/1031278023 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc24019070 con 0x7fbc340b02b0 2024-09-15T23:21:25.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.178+0000 7fbc39b31640 1 -- 172.21.15.123:0/1031278023 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc341577f0 con 0x7fbc340b02b0 2024-09-15T23:21:25.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.178+0000 7fbc1bfff640 1 -- 172.21.15.123:0/1031278023 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2400ba00 con 0x7fbc340b02b0 2024-09-15T23:21:25.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.178+0000 7fbc39b31640 1 -- 172.21.15.123:0/1031278023 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc34157db0 con 0x7fbc340b02b0 2024-09-15T23:21:25.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.179+0000 7fbc39b31640 1 -- 172.21.15.123:0/1031278023 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc340b6120 con 0x7fbc340b02b0 2024-09-15T23:21:25.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.179+0000 7fbc1bfff640 1 -- 172.21.15.123:0/1031278023 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbc2400bba0 con 0x7fbc340b02b0 2024-09-15T23:21:25.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.180+0000 7fbc1bfff640 1 --2- 172.21.15.123:0/1031278023 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbc2006c2b0 0x7fbc2006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:25.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.180+0000 7fbc1bfff640 1 -- 172.21.15.123:0/1031278023 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7fbc2408b820 con 0x7fbc340b02b0 2024-09-15T23:21:25.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.180+0000 7fbc32ffd640 1 --2- 172.21.15.123:0/1031278023 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbc2006c2b0 0x7fbc2006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:25.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.180+0000 7fbc32ffd640 1 --2- 172.21.15.123:0/1031278023 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbc2006c2b0 0x7fbc2006e770 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fbc28034000 tx=0x7fbc2802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:25.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.184+0000 7fbc1bfff640 1 -- 172.21.15.123:0/1031278023 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbc24059f90 con 0x7fbc340b02b0 2024-09-15T23:21:25.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.350+0000 7fbc39b31640 1 -- 172.21.15.123:0/1031278023 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbc34073540 con 0x7fbc340b02b0 2024-09-15T23:21:25.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.352+0000 7fbc1bfff640 1 -- 172.21.15.123:0/1031278023 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) ==== 74+0+16763 (secure 0 0 0) 0x7fbc24059890 con 0x7fbc340b02b0 2024-09-15T23:21:25.353 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:25.353 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":168,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:21:23.719733+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:21:20.662502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-15T23:21:21.024002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:21:25.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.354+0000 7fbc39b31640 1 -- 172.21.15.123:0/1031278023 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbc2006c2b0 msgr2=0x7fbc2006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:25.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.354+0000 7fbc39b31640 1 --2- 172.21.15.123:0/1031278023 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbc2006c2b0 0x7fbc2006e770 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fbc28034000 tx=0x7fbc2802e000 comp rx=0 tx=0).stop 2024-09-15T23:21:25.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.354+0000 7fbc39b31640 1 -- 172.21.15.123:0/1031278023 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc340b02b0 msgr2=0x7fbc34156f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:25.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.354+0000 7fbc39b31640 1 --2- 172.21.15.123:0/1031278023 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc340b02b0 0x7fbc34156f30 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7fbc2400d620 tx=0x7fbc2400dae0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.354+0000 7fbc39b31640 1 -- 172.21.15.123:0/1031278023 shutdown_connections 2024-09-15T23:21:25.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.354+0000 7fbc39b31640 1 --2- 172.21.15.123:0/1031278023 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbc3415c4b0 0x7fbc3415eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.354+0000 7fbc39b31640 1 --2- 172.21.15.123:0/1031278023 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbc340d08e0 0x7fbc341466a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.354+0000 7fbc39b31640 1 --2- 172.21.15.123:0/1031278023 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbc2006c2b0 0x7fbc2006e770 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.354+0000 7fbc39b31640 1 --2- 172.21.15.123:0/1031278023 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbc340b02b0 0x7fbc34156f30 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.354+0000 7fbc39b31640 1 -- 172.21.15.123:0/1031278023 >> 172.21.15.123:0/1031278023 conn(0x7fbc340b0a80 msgr2=0x7fbc340b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:25.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.354+0000 7fbc39b31640 1 -- 172.21.15.123:0/1031278023 shutdown_connections 2024-09-15T23:21:25.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.354+0000 7fbc39b31640 1 -- 172.21.15.123:0/1031278023 wait complete. 2024-09-15T23:21:25.366 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T23:21:25.366 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:21:25.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.464+0000 7f8705f91640 1 Processor -- start 2024-09-15T23:21:25.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.464+0000 7f8705f91640 1 -- start start 2024-09-15T23:21:25.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.465+0000 7f8705f91640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f870015ed20 0x7f87000b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:25.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.465+0000 7f8705f91640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f87000b90e0 0x7f87000b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:25.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.465+0000 7f8705f91640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87000d0e70 con 0x7f87000d23b0 2024-09-15T23:21:25.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.465+0000 7f8705f91640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f87000d41c0 con 0x7f87000b90e0 2024-09-15T23:21:25.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.465+0000 7f8705f91640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f87000d35b0 con 0x7f870015ed20 2024-09-15T23:21:25.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.465+0000 7f86fffff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f87000b90e0 0x7f87000b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:25.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.465+0000 7f86fffff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f87000b90e0 0x7f87000b67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57346/0 (socket says 172.21.15.123:57346) 2024-09-15T23:21:25.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.465+0000 7f86fffff640 1 -- 172.21.15.123:0/3489339304 learned_addr learned my addr 172.21.15.123:0/3489339304 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:25.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.465+0000 7f86fffff640 1 -- 172.21.15.123:0/3489339304 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f870015ed20 msgr2=0x7f87000b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:25.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.465+0000 7f86fffff640 1 --2- 172.21.15.123:0/3489339304 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f870015ed20 0x7f87000b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.465+0000 7f86fffff640 1 -- 172.21.15.123:0/3489339304 >> v1:172.21.15.188:6789/0 conn(0x7f87000d23b0 legacy=0x7f87000cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:25.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.465+0000 7f86fffff640 1 -- 172.21.15.123:0/3489339304 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87000d3890 con 0x7f87000b90e0 2024-09-15T23:21:25.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.466+0000 7f86fffff640 1 --2- 172.21.15.123:0/3489339304 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87000b90e0 0x7f87000b67a0 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f86f8009e50 tx=0x7f86f802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7634d843362b3a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:25.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.466+0000 7f86feffd640 1 -- 172.21.15.123:0/3489339304 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f8036070 con 0x7f87000b90e0 2024-09-15T23:21:25.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.466+0000 7f86feffd640 1 -- 172.21.15.123:0/3489339304 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86f8031600 con 0x7f87000b90e0 2024-09-15T23:21:25.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.466+0000 7f86feffd640 1 -- 172.21.15.123:0/3489339304 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f80319d0 con 0x7f87000b90e0 2024-09-15T23:21:25.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.466+0000 7f8705f91640 1 -- 172.21.15.123:0/3489339304 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87000b90e0 msgr2=0x7f87000b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:25.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.466+0000 7f8705f91640 1 --2- 172.21.15.123:0/3489339304 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87000b90e0 0x7f87000b67a0 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f86f8009e50 tx=0x7f86f802a6c0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.467+0000 7f8705f91640 1 -- 172.21.15.123:0/3489339304 shutdown_connections 2024-09-15T23:21:25.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.467+0000 7f8705f91640 1 --2- 172.21.15.123:0/3489339304 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87000b90e0 0x7f87000b67a0 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.467+0000 7f8705f91640 1 --2- 172.21.15.123:0/3489339304 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f870015ed20 0x7f87000b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.467+0000 7f8705f91640 1 -- 172.21.15.123:0/3489339304 >> 172.21.15.123:0/3489339304 conn(0x7f87000d1260 msgr2=0x7f87000d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:25.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.467+0000 7f8705f91640 1 -- 172.21.15.123:0/3489339304 shutdown_connections 2024-09-15T23:21:25.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.467+0000 7f8705f91640 1 -- 172.21.15.123:0/3489339304 wait complete. 2024-09-15T23:21:25.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.468+0000 7f8705f91640 1 Processor -- start 2024-09-15T23:21:25.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.468+0000 7f8705f91640 1 -- start start 2024-09-15T23:21:25.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.468+0000 7f8705f91640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87000b90e0 0x7f8700161e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:25.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.468+0000 7f8705f91640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87000d23b0 0x7f87000ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:25.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.469+0000 7f8705f91640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f870015ed20 0x7f870014cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:25.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.469+0000 7f8705f91640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f87000d32a0 con 0x7f87000d23b0 2024-09-15T23:21:25.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.469+0000 7f8705f91640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f87000d3e50 con 0x7f870015ed20 2024-09-15T23:21:25.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.469+0000 7f8705f91640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f870015f100 con 0x7f87000b90e0 2024-09-15T23:21:25.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.469+0000 7f86f7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87000d23b0 0x7f87000ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:25.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.469+0000 7f86f7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87000d23b0 0x7f87000ccec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57348/0 (socket says 172.21.15.123:57348) 2024-09-15T23:21:25.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.469+0000 7f86f7fff640 1 -- 172.21.15.123:0/1626666762 learned_addr learned my addr 172.21.15.123:0/1626666762 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:25.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.469+0000 7f86ff7fe640 1 --2- 172.21.15.123:0/1626666762 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87000b90e0 0x7f8700161e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:25.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.469+0000 7f86fffff640 1 --2- 172.21.15.123:0/1626666762 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f870015ed20 0x7f870014cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:25.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.469+0000 7f86f7fff640 1 -- 172.21.15.123:0/1626666762 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87000b90e0 msgr2=0x7f8700161e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:25.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.469+0000 7f86f7fff640 1 --2- 172.21.15.123:0/1626666762 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87000b90e0 0x7f8700161e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.469+0000 7f86f7fff640 1 -- 172.21.15.123:0/1626666762 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f870015ed20 msgr2=0x7f870014cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:25.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.469+0000 7f86f7fff640 1 --2- 172.21.15.123:0/1626666762 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f870015ed20 0x7f870014cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.469+0000 7f86f7fff640 1 -- 172.21.15.123:0/1626666762 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87000cbe20 con 0x7f87000d23b0 2024-09-15T23:21:25.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.469+0000 7f86ff7fe640 1 --2- 172.21.15.123:0/1626666762 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87000b90e0 0x7f8700161e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:21:25.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.469+0000 7f86fffff640 1 --2- 172.21.15.123:0/1626666762 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f870015ed20 0x7f870014cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:21:25.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.469+0000 7f86f7fff640 1 --2- 172.21.15.123:0/1626666762 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87000d23b0 0x7f87000ccec0 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f86e800c430 tx=0x7f86e800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:25.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.469+0000 7f86fcff9640 1 -- 172.21.15.123:0/1626666762 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e8011790 con 0x7f87000d23b0 2024-09-15T23:21:25.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.469+0000 7f86fcff9640 1 -- 172.21.15.123:0/1626666762 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86e8017070 con 0x7f87000d23b0 2024-09-15T23:21:25.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.469+0000 7f8705f91640 1 -- 172.21.15.123:0/1626666762 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87000cc100 con 0x7f87000d23b0 2024-09-15T23:21:25.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.469+0000 7f86fcff9640 1 -- 172.21.15.123:0/1626666762 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e8011b70 con 0x7f87000d23b0 2024-09-15T23:21:25.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.469+0000 7f8705f91640 1 -- 172.21.15.123:0/1626666762 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87000cc6c0 con 0x7f87000d23b0 2024-09-15T23:21:25.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.470+0000 7f8705f91640 1 -- 172.21.15.123:0/1626666762 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87000b7010 con 0x7f87000d23b0 2024-09-15T23:21:25.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.471+0000 7f86fcff9640 1 -- 172.21.15.123:0/1626666762 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f86e8011d10 con 0x7f87000d23b0 2024-09-15T23:21:25.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.471+0000 7f86fcff9640 1 --2- 172.21.15.123:0/1626666762 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f86e006c2b0 0x7f86e006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:25.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.471+0000 7f86fcff9640 1 -- 172.21.15.123:0/1626666762 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7f86e808b2a0 con 0x7f87000d23b0 2024-09-15T23:21:25.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.471+0000 7f86ff7fe640 1 --2- 172.21.15.123:0/1626666762 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f86e006c2b0 0x7f86e006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:25.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.472+0000 7f86ff7fe640 1 --2- 172.21.15.123:0/1626666762 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f86e006c2b0 0x7f86e006e770 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f86f0009890 tx=0x7f86f0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:25.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.475+0000 7f86fcff9640 1 -- 172.21.15.123:0/1626666762 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f86e8059a10 con 0x7f87000d23b0 2024-09-15T23:21:25.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.640+0000 7f8705f91640 1 -- 172.21.15.123:0/1626666762 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f87000d0a90 con 0x7f86e006c2b0 2024-09-15T23:21:25.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.646+0000 7f86fcff9640 1 -- 172.21.15.123:0/1626666762 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246041 (secure 0 0 0) 0x7f87000d0a90 con 0x7f86e006c2b0 2024-09-15T23:21:25.650 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:25.652 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:21:25.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.649+0000 7f8705f91640 1 -- 172.21.15.123:0/1626666762 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f86e006c2b0 msgr2=0x7f86e006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:25.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.649+0000 7f8705f91640 1 --2- 172.21.15.123:0/1626666762 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f86e006c2b0 0x7f86e006e770 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f86f0009890 tx=0x7f86f0008040 comp rx=0 tx=0).stop 2024-09-15T23:21:25.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.649+0000 7f8705f91640 1 -- 172.21.15.123:0/1626666762 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87000d23b0 msgr2=0x7f87000ccec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:25.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.649+0000 7f8705f91640 1 --2- 172.21.15.123:0/1626666762 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87000d23b0 0x7f87000ccec0 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f86e800c430 tx=0x7f86e800c8f0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.649+0000 7f8705f91640 1 -- 172.21.15.123:0/1626666762 shutdown_connections 2024-09-15T23:21:25.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.649+0000 7f8705f91640 1 --2- 172.21.15.123:0/1626666762 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f870015ed20 0x7f870014cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.649+0000 7f8705f91640 1 --2- 172.21.15.123:0/1626666762 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f86e006c2b0 0x7f86e006e770 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.649+0000 7f8705f91640 1 --2- 172.21.15.123:0/1626666762 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87000d23b0 0x7f87000ccec0 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.649+0000 7f8705f91640 1 --2- 172.21.15.123:0/1626666762 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f87000b90e0 0x7f8700161e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.649+0000 7f8705f91640 1 -- 172.21.15.123:0/1626666762 >> 172.21.15.123:0/1626666762 conn(0x7f87000d1260 msgr2=0x7f870015de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:25.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.649+0000 7f8705f91640 1 -- 172.21.15.123:0/1626666762 shutdown_connections 2024-09-15T23:21:25.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.649+0000 7f8705f91640 1 -- 172.21.15.123:0/1626666762 wait complete. 2024-09-15T23:21:25.661 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":443,"stamp":"2024-09-15T23:21:25.634886+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592654,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":186,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":122,"acting":122,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":383456,"kb_used_data":17304,"kb_used_omap":12,"kb_used_meta":365939,"kb_avail":754591264,"statfs":{"total":773094113280,"available":772701454336,"internally_reserved":0,"allocated":17719296,"data_stored":8468089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":374722096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2286,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.921505"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.741607+0000","last_change":"2024-09-15T23:21:22.726816+0000","last_active":"2024-09-15T23:21:22.741607+0000","last_peered":"2024-09-15T23:21:22.741607+0000","last_clean":"2024-09-15T23:21:22.741607+0000","last_became_active":"2024-09-15T23:21:22.726529+0000","last_became_peered":"2024-09-15T23:21:22.726529+0000","last_unstale":"2024-09-15T23:21:22.741607+0000","last_undegraded":"2024-09-15T23:21:22.741607+0000","last_fullsized":"2024-09-15T23:21:22.741607+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:22:20.946782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.741502+0000","last_change":"2024-09-15T23:21:22.725283+0000","last_active":"2024-09-15T23:21:22.741502+0000","last_peered":"2024-09-15T23:21:22.741502+0000","last_clean":"2024-09-15T23:21:22.741502+0000","last_became_active":"2024-09-15T23:21:22.725020+0000","last_became_peered":"2024-09-15T23:21:22.725020+0000","last_unstale":"2024-09-15T23:21:22.741502+0000","last_undegraded":"2024-09-15T23:21:22.741502+0000","last_fullsized":"2024-09-15T23:21:22.741502+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:01:36.316467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.741521+0000","last_change":"2024-09-15T23:21:22.725523+0000","last_active":"2024-09-15T23:21:22.741521+0000","last_peered":"2024-09-15T23:21:22.741521+0000","last_clean":"2024-09-15T23:21:22.741521+0000","last_became_active":"2024-09-15T23:21:22.723213+0000","last_became_peered":"2024-09-15T23:21:22.723213+0000","last_unstale":"2024-09-15T23:21:22.741521+0000","last_undegraded":"2024-09-15T23:21:22.741521+0000","last_fullsized":"2024-09-15T23:21:22.741521+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:19.979292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.729685+0000","last_change":"2024-09-15T23:21:22.728138+0000","last_active":"2024-09-15T23:21:22.729685+0000","last_peered":"2024-09-15T23:21:22.729685+0000","last_clean":"2024-09-15T23:21:22.729685+0000","last_became_active":"2024-09-15T23:21:22.727856+0000","last_became_peered":"2024-09-15T23:21:22.727856+0000","last_unstale":"2024-09-15T23:21:22.729685+0000","last_undegraded":"2024-09-15T23:21:22.729685+0000","last_fullsized":"2024-09-15T23:21:22.729685+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:12:43.918097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.730449+0000","last_change":"2024-09-15T23:21:22.728181+0000","last_active":"2024-09-15T23:21:22.730449+0000","last_peered":"2024-09-15T23:21:22.730449+0000","last_clean":"2024-09-15T23:21:22.730449+0000","last_became_active":"2024-09-15T23:21:22.727863+0000","last_became_peered":"2024-09-15T23:21:22.727863+0000","last_unstale":"2024-09-15T23:21:22.730449+0000","last_undegraded":"2024-09-15T23:21:22.730449+0000","last_fullsized":"2024-09-15T23:21:22.730449+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:50.794279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.725293+0000","last_change":"2024-09-15T23:21:22.720386+0000","last_active":"2024-09-15T23:21:22.725293+0000","last_peered":"2024-09-15T23:21:22.725293+0000","last_clean":"2024-09-15T23:21:22.725293+0000","last_became_active":"2024-09-15T23:21:22.720114+0000","last_became_peered":"2024-09-15T23:21:22.720114+0000","last_unstale":"2024-09-15T23:21:22.725293+0000","last_undegraded":"2024-09-15T23:21:22.725293+0000","last_fullsized":"2024-09-15T23:21:22.725293+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:36.841290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.725869+0000","last_change":"2024-09-15T23:21:22.723261+0000","last_active":"2024-09-15T23:21:22.725869+0000","last_peered":"2024-09-15T23:21:22.725869+0000","last_clean":"2024-09-15T23:21:22.725869+0000","last_became_active":"2024-09-15T23:21:22.722993+0000","last_became_peered":"2024-09-15T23:21:22.722993+0000","last_unstale":"2024-09-15T23:21:22.725869+0000","last_undegraded":"2024-09-15T23:21:22.725869+0000","last_fullsized":"2024-09-15T23:21:22.725869+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:41:48.886638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.736515+0000","last_change":"2024-09-15T23:21:22.734444+0000","last_active":"2024-09-15T23:21:22.736515+0000","last_peered":"2024-09-15T23:21:22.736515+0000","last_clean":"2024-09-15T23:21:22.736515+0000","last_became_active":"2024-09-15T23:21:22.732810+0000","last_became_peered":"2024-09-15T23:21:22.732810+0000","last_unstale":"2024-09-15T23:21:22.736515+0000","last_undegraded":"2024-09-15T23:21:22.736515+0000","last_fullsized":"2024-09-15T23:21:22.736515+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:36.986973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.734171+0000","last_change":"2024-09-15T23:21:22.730945+0000","last_active":"2024-09-15T23:21:22.734171+0000","last_peered":"2024-09-15T23:21:22.734171+0000","last_clean":"2024-09-15T23:21:22.734171+0000","last_became_active":"2024-09-15T23:21:22.730645+0000","last_became_peered":"2024-09-15T23:21:22.730645+0000","last_unstale":"2024-09-15T23:21:22.734171+0000","last_undegraded":"2024-09-15T23:21:22.734171+0000","last_fullsized":"2024-09-15T23:21:22.734171+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:40.008114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.734637+0000","last_change":"2024-09-15T23:21:22.733734+0000","last_active":"2024-09-15T23:21:22.734637+0000","last_peered":"2024-09-15T23:21:22.734637+0000","last_clean":"2024-09-15T23:21:22.734637+0000","last_became_active":"2024-09-15T23:21:22.733441+0000","last_became_peered":"2024-09-15T23:21:22.733441+0000","last_unstale":"2024-09-15T23:21:22.734637+0000","last_undegraded":"2024-09-15T23:21:22.734637+0000","last_fullsized":"2024-09-15T23:21:22.734637+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:12.914045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.731172+0000","last_change":"2024-09-15T23:21:22.729776+0000","last_active":"2024-09-15T23:21:22.731172+0000","last_peered":"2024-09-15T23:21:22.731172+0000","last_clean":"2024-09-15T23:21:22.731172+0000","last_became_active":"2024-09-15T23:21:22.728949+0000","last_became_peered":"2024-09-15T23:21:22.728949+0000","last_unstale":"2024-09-15T23:21:22.731172+0000","last_undegraded":"2024-09-15T23:21:22.731172+0000","last_fullsized":"2024-09-15T23:21:22.731172+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:22.338146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.733707+0000","last_change":"2024-09-15T23:21:22.732516+0000","last_active":"2024-09-15T23:21:22.733707+0000","last_peered":"2024-09-15T23:21:22.733707+0000","last_clean":"2024-09-15T23:21:22.733707+0000","last_became_active":"2024-09-15T23:21:22.732251+0000","last_became_peered":"2024-09-15T23:21:22.732251+0000","last_unstale":"2024-09-15T23:21:22.733707+0000","last_undegraded":"2024-09-15T23:21:22.733707+0000","last_fullsized":"2024-09-15T23:21:22.733707+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:01.081667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.734147+0000","last_change":"2024-09-15T23:21:22.726724+0000","last_active":"2024-09-15T23:21:22.734147+0000","last_peered":"2024-09-15T23:21:22.734147+0000","last_clean":"2024-09-15T23:21:22.734147+0000","last_became_active":"2024-09-15T23:21:22.726437+0000","last_became_peered":"2024-09-15T23:21:22.726437+0000","last_unstale":"2024-09-15T23:21:22.734147+0000","last_undegraded":"2024-09-15T23:21:22.734147+0000","last_fullsized":"2024-09-15T23:21:22.734147+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:20:55.725352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.732514+0000","last_change":"2024-09-15T23:21:22.731809+0000","last_active":"2024-09-15T23:21:22.732514+0000","last_peered":"2024-09-15T23:21:22.732514+0000","last_clean":"2024-09-15T23:21:22.732514+0000","last_became_active":"2024-09-15T23:21:22.731525+0000","last_became_peered":"2024-09-15T23:21:22.731525+0000","last_unstale":"2024-09-15T23:21:22.732514+0000","last_undegraded":"2024-09-15T23:21:22.732514+0000","last_fullsized":"2024-09-15T23:21:22.732514+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:24.714284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.732205+0000","last_change":"2024-09-15T23:21:22.730534+0000","last_active":"2024-09-15T23:21:22.732205+0000","last_peered":"2024-09-15T23:21:22.732205+0000","last_clean":"2024-09-15T23:21:22.732205+0000","last_became_active":"2024-09-15T23:21:22.730254+0000","last_became_peered":"2024-09-15T23:21:22.730254+0000","last_unstale":"2024-09-15T23:21:22.732205+0000","last_undegraded":"2024-09-15T23:21:22.732205+0000","last_fullsized":"2024-09-15T23:21:22.732205+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:43:29.335197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.740501+0000","last_change":"2024-09-15T23:21:22.738611+0000","last_active":"2024-09-15T23:21:22.740501+0000","last_peered":"2024-09-15T23:21:22.740501+0000","last_clean":"2024-09-15T23:21:22.740501+0000","last_became_active":"2024-09-15T23:21:22.738306+0000","last_became_peered":"2024-09-15T23:21:22.738306+0000","last_unstale":"2024-09-15T23:21:22.740501+0000","last_undegraded":"2024-09-15T23:21:22.740501+0000","last_fullsized":"2024-09-15T23:21:22.740501+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:46:31.588595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.732222+0000","last_change":"2024-09-15T23:21:22.730551+0000","last_active":"2024-09-15T23:21:22.732222+0000","last_peered":"2024-09-15T23:21:22.732222+0000","last_clean":"2024-09-15T23:21:22.732222+0000","last_became_active":"2024-09-15T23:21:22.730157+0000","last_became_peered":"2024-09-15T23:21:22.730157+0000","last_unstale":"2024-09-15T23:21:22.732222+0000","last_undegraded":"2024-09-15T23:21:22.732222+0000","last_fullsized":"2024-09-15T23:21:22.732222+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:42.508730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.741558+0000","last_change":"2024-09-15T23:21:22.725781+0000","last_active":"2024-09-15T23:21:22.741558+0000","last_peered":"2024-09-15T23:21:22.741558+0000","last_clean":"2024-09-15T23:21:22.741558+0000","last_became_active":"2024-09-15T23:21:22.724370+0000","last_became_peered":"2024-09-15T23:21:22.724370+0000","last_unstale":"2024-09-15T23:21:22.741558+0000","last_undegraded":"2024-09-15T23:21:22.741558+0000","last_fullsized":"2024-09-15T23:21:22.741558+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:17.342891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.731192+0000","last_change":"2024-09-15T23:21:22.729757+0000","last_active":"2024-09-15T23:21:22.731192+0000","last_peered":"2024-09-15T23:21:22.731192+0000","last_clean":"2024-09-15T23:21:22.731192+0000","last_became_active":"2024-09-15T23:21:22.728468+0000","last_became_peered":"2024-09-15T23:21:22.728468+0000","last_unstale":"2024-09-15T23:21:22.731192+0000","last_undegraded":"2024-09-15T23:21:22.731192+0000","last_fullsized":"2024-09-15T23:21:22.731192+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:47.009845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.721997+0000","last_change":"2024-09-15T23:21:22.719925+0000","last_active":"2024-09-15T23:21:22.721997+0000","last_peered":"2024-09-15T23:21:22.721997+0000","last_clean":"2024-09-15T23:21:22.721997+0000","last_became_active":"2024-09-15T23:21:22.719532+0000","last_became_peered":"2024-09-15T23:21:22.719532+0000","last_unstale":"2024-09-15T23:21:22.721997+0000","last_undegraded":"2024-09-15T23:21:22.721997+0000","last_fullsized":"2024-09-15T23:21:22.721997+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:58.514360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1f","version":"167'4","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.744482+0000","last_change":"2024-09-15T23:21:21.737653+0000","last_active":"2024-09-15T23:21:22.744482+0000","last_peered":"2024-09-15T23:21:22.744482+0000","last_clean":"2024-09-15T23:21:22.744482+0000","last_became_active":"2024-09-15T23:21:21.737345+0000","last_became_peered":"2024-09-15T23:21:21.737345+0000","last_unstale":"2024-09-15T23:21:22.744482+0000","last_undegraded":"2024-09-15T23:21:22.744482+0000","last_fullsized":"2024-09-15T23:21:22.744482+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:56:25.666102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.741922+0000","last_change":"2024-09-15T23:21:22.737797+0000","last_active":"2024-09-15T23:21:22.741922+0000","last_peered":"2024-09-15T23:21:22.741922+0000","last_clean":"2024-09-15T23:21:22.741922+0000","last_became_active":"2024-09-15T23:21:22.737320+0000","last_became_peered":"2024-09-15T23:21:22.737320+0000","last_unstale":"2024-09-15T23:21:22.741922+0000","last_undegraded":"2024-09-15T23:21:22.741922+0000","last_fullsized":"2024-09-15T23:21:22.741922+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:45.051354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1e","version":"167'1","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.734840+0000","last_change":"2024-09-15T23:21:21.729577+0000","last_active":"2024-09-15T23:21:22.734840+0000","last_peered":"2024-09-15T23:21:22.734840+0000","last_clean":"2024-09-15T23:21:22.734840+0000","last_became_active":"2024-09-15T23:21:21.729284+0000","last_became_peered":"2024-09-15T23:21:21.729284+0000","last_unstale":"2024-09-15T23:21:22.734840+0000","last_undegraded":"2024-09-15T23:21:22.734840+0000","last_fullsized":"2024-09-15T23:21:22.734840+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:16:10.026756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.713977+0000","last_change":"2024-09-15T23:21:20.713977+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.713977+0000","last_undegraded":"2024-09-15T23:21:20.713977+0000","last_fullsized":"2024-09-15T23:21:20.713977+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.732818+0000","last_change":"2024-09-15T23:21:22.731852+0000","last_active":"2024-09-15T23:21:22.732818+0000","last_peered":"2024-09-15T23:21:22.732818+0000","last_clean":"2024-09-15T23:21:22.732818+0000","last_became_active":"2024-09-15T23:21:22.731572+0000","last_became_peered":"2024-09-15T23:21:22.731572+0000","last_unstale":"2024-09-15T23:21:22.732818+0000","last_undegraded":"2024-09-15T23:21:22.732818+0000","last_fullsized":"2024-09-15T23:21:22.732818+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:54.053199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.719297+0000","last_change":"2024-09-15T23:21:20.719297+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.719297+0000","last_undegraded":"2024-09-15T23:21:20.719297+0000","last_fullsized":"2024-09-15T23:21:20.719297+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1b","version":"167'1","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.741971+0000","last_change":"2024-09-15T23:21:21.737750+0000","last_active":"2024-09-15T23:21:22.741971+0000","last_peered":"2024-09-15T23:21:22.741971+0000","last_clean":"2024-09-15T23:21:22.741971+0000","last_became_active":"2024-09-15T23:21:21.737470+0000","last_became_peered":"2024-09-15T23:21:21.737470+0000","last_unstale":"2024-09-15T23:21:22.741971+0000","last_undegraded":"2024-09-15T23:21:22.741971+0000","last_fullsized":"2024-09-15T23:21:22.741971+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:21.410602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.716844+0000","last_change":"2024-09-15T23:21:20.716844+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.716844+0000","last_undegraded":"2024-09-15T23:21:20.716844+0000","last_fullsized":"2024-09-15T23:21:20.716844+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.717545+0000","last_change":"2024-09-15T23:21:21.737521+0000","last_active":"2024-09-15T23:21:22.717545+0000","last_peered":"2024-09-15T23:21:22.717545+0000","last_clean":"2024-09-15T23:21:22.717545+0000","last_became_active":"2024-09-15T23:21:21.736819+0000","last_became_peered":"2024-09-15T23:21:21.736819+0000","last_unstale":"2024-09-15T23:21:22.717545+0000","last_undegraded":"2024-09-15T23:21:22.717545+0000","last_fullsized":"2024-09-15T23:21:22.717545+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:40.716470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.717982+0000","last_change":"2024-09-15T23:21:20.717982+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.717982+0000","last_undegraded":"2024-09-15T23:21:20.717982+0000","last_fullsized":"2024-09-15T23:21:20.717982+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.713984+0000","last_change":"2024-09-15T23:21:20.713984+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.713984+0000","last_undegraded":"2024-09-15T23:21:20.713984+0000","last_fullsized":"2024-09-15T23:21:20.713984+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.718425+0000","last_change":"2024-09-15T23:21:20.718425+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.718425+0000","last_undegraded":"2024-09-15T23:21:20.718425+0000","last_fullsized":"2024-09-15T23:21:20.718425+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.739910+0000","last_change":"2024-09-15T23:21:22.722686+0000","last_active":"2024-09-15T23:21:22.739910+0000","last_peered":"2024-09-15T23:21:22.739910+0000","last_clean":"2024-09-15T23:21:22.739910+0000","last_became_active":"2024-09-15T23:21:22.722367+0000","last_became_peered":"2024-09-15T23:21:22.722367+0000","last_unstale":"2024-09-15T23:21:22.739910+0000","last_undegraded":"2024-09-15T23:21:22.739910+0000","last_fullsized":"2024-09-15T23:21:22.739910+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:02:39.146127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.14","version":"167'6","reported_seq":18,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.745850+0000","last_change":"2024-09-15T23:21:21.728632+0000","last_active":"2024-09-15T23:21:22.745850+0000","last_peered":"2024-09-15T23:21:22.745850+0000","last_clean":"2024-09-15T23:21:22.745850+0000","last_became_active":"2024-09-15T23:21:21.728358+0000","last_became_peered":"2024-09-15T23:21:21.728358+0000","last_unstale":"2024-09-15T23:21:22.745850+0000","last_undegraded":"2024-09-15T23:21:22.745850+0000","last_fullsized":"2024-09-15T23:21:22.745850+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:16:00.181183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.716832+0000","last_change":"2024-09-15T23:21:20.716832+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.716832+0000","last_undegraded":"2024-09-15T23:21:20.716832+0000","last_fullsized":"2024-09-15T23:21:20.716832+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.713926+0000","last_change":"2024-09-15T23:21:20.713926+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.713926+0000","last_undegraded":"2024-09-15T23:21:20.713926+0000","last_fullsized":"2024-09-15T23:21:20.713926+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.717947+0000","last_change":"2024-09-15T23:21:20.717947+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.717947+0000","last_undegraded":"2024-09-15T23:21:20.717947+0000","last_fullsized":"2024-09-15T23:21:20.717947+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.732170+0000","last_change":"2024-09-15T23:21:22.730786+0000","last_active":"2024-09-15T23:21:22.732170+0000","last_peered":"2024-09-15T23:21:22.732170+0000","last_clean":"2024-09-15T23:21:22.732170+0000","last_became_active":"2024-09-15T23:21:22.730507+0000","last_became_peered":"2024-09-15T23:21:22.730507+0000","last_unstale":"2024-09-15T23:21:22.732170+0000","last_undegraded":"2024-09-15T23:21:22.732170+0000","last_fullsized":"2024-09-15T23:21:22.732170+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:16.216690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.10","version":"167'8","reported_seq":20,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.743899+0000","last_change":"2024-09-15T23:21:21.725050+0000","last_active":"2024-09-15T23:21:22.743899+0000","last_peered":"2024-09-15T23:21:22.743899+0000","last_clean":"2024-09-15T23:21:22.743899+0000","last_became_active":"2024-09-15T23:21:21.724729+0000","last_became_peered":"2024-09-15T23:21:21.724729+0000","last_unstale":"2024-09-15T23:21:22.743899+0000","last_undegraded":"2024-09-15T23:21:22.743899+0000","last_fullsized":"2024-09-15T23:21:22.743899+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:40.841373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.f","version":"167'1","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.743367+0000","last_change":"2024-09-15T23:21:21.732704+0000","last_active":"2024-09-15T23:21:22.743367+0000","last_peered":"2024-09-15T23:21:22.743367+0000","last_clean":"2024-09-15T23:21:22.743367+0000","last_became_active":"2024-09-15T23:21:21.732406+0000","last_became_peered":"2024-09-15T23:21:21.732406+0000","last_unstale":"2024-09-15T23:21:22.743367+0000","last_undegraded":"2024-09-15T23:21:22.743367+0000","last_fullsized":"2024-09-15T23:21:22.743367+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:28.211194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.e","version":"167'2","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.735925+0000","last_change":"2024-09-15T23:21:21.729354+0000","last_active":"2024-09-15T23:21:22.735925+0000","last_peered":"2024-09-15T23:21:22.735925+0000","last_clean":"2024-09-15T23:21:22.735925+0000","last_became_active":"2024-09-15T23:21:21.729019+0000","last_became_peered":"2024-09-15T23:21:21.729019+0000","last_unstale":"2024-09-15T23:21:22.735925+0000","last_undegraded":"2024-09-15T23:21:22.735925+0000","last_fullsized":"2024-09-15T23:21:22.735925+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:34.813792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.d","version":"167'1","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.739278+0000","last_change":"2024-09-15T23:21:21.733634+0000","last_active":"2024-09-15T23:21:22.739278+0000","last_peered":"2024-09-15T23:21:22.739278+0000","last_clean":"2024-09-15T23:21:22.739278+0000","last_became_active":"2024-09-15T23:21:21.733369+0000","last_became_peered":"2024-09-15T23:21:21.733369+0000","last_unstale":"2024-09-15T23:21:22.739278+0000","last_undegraded":"2024-09-15T23:21:22.739278+0000","last_fullsized":"2024-09-15T23:21:22.739278+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:44.350966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.720906+0000","last_change":"2024-09-15T23:21:21.732863+0000","last_active":"2024-09-15T23:21:22.720906+0000","last_peered":"2024-09-15T23:21:22.720906+0000","last_clean":"2024-09-15T23:21:22.720906+0000","last_became_active":"2024-09-15T23:21:21.731828+0000","last_became_peered":"2024-09-15T23:21:21.731828+0000","last_unstale":"2024-09-15T23:21:22.720906+0000","last_undegraded":"2024-09-15T23:21:22.720906+0000","last_fullsized":"2024-09-15T23:21:22.720906+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:12.222045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.719790+0000","last_change":"2024-09-15T23:21:22.718883+0000","last_active":"2024-09-15T23:21:22.719790+0000","last_peered":"2024-09-15T23:21:22.719790+0000","last_clean":"2024-09-15T23:21:22.719790+0000","last_became_active":"2024-09-15T23:21:22.718466+0000","last_became_peered":"2024-09-15T23:21:22.718466+0000","last_unstale":"2024-09-15T23:21:22.719790+0000","last_undegraded":"2024-09-15T23:21:22.719790+0000","last_fullsized":"2024-09-15T23:21:22.719790+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:49:53.278979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.718048+0000","last_change":"2024-09-15T23:21:20.718048+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.718048+0000","last_undegraded":"2024-09-15T23:21:20.718048+0000","last_fullsized":"2024-09-15T23:21:20.718048+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.721696+0000","last_change":"2024-09-15T23:21:21.728470+0000","last_active":"2024-09-15T23:21:22.721696+0000","last_peered":"2024-09-15T23:21:22.721696+0000","last_clean":"2024-09-15T23:21:22.721696+0000","last_became_active":"2024-09-15T23:21:21.728205+0000","last_became_peered":"2024-09-15T23:21:21.728205+0000","last_unstale":"2024-09-15T23:21:22.721696+0000","last_undegraded":"2024-09-15T23:21:22.721696+0000","last_fullsized":"2024-09-15T23:21:22.721696+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:33:14.843299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.741635+0000","last_change":"2024-09-15T23:21:22.729733+0000","last_active":"2024-09-15T23:21:22.741635+0000","last_peered":"2024-09-15T23:21:22.741635+0000","last_clean":"2024-09-15T23:21:22.741635+0000","last_became_active":"2024-09-15T23:21:22.729412+0000","last_became_peered":"2024-09-15T23:21:22.729412+0000","last_unstale":"2024-09-15T23:21:22.741635+0000","last_undegraded":"2024-09-15T23:21:22.741635+0000","last_fullsized":"2024-09-15T23:21:22.741635+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:59:51.046663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.716832+0000","last_change":"2024-09-15T23:21:20.716832+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.716832+0000","last_undegraded":"2024-09-15T23:21:20.716832+0000","last_fullsized":"2024-09-15T23:21:20.716832+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.720087+0000","last_change":"2024-09-15T23:21:21.731639+0000","last_active":"2024-09-15T23:21:22.720087+0000","last_peered":"2024-09-15T23:21:22.720087+0000","last_clean":"2024-09-15T23:21:22.720087+0000","last_became_active":"2024-09-15T23:21:21.731378+0000","last_became_peered":"2024-09-15T23:21:21.731378+0000","last_unstale":"2024-09-15T23:21:22.720087+0000","last_undegraded":"2024-09-15T23:21:22.720087+0000","last_fullsized":"2024-09-15T23:21:22.720087+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:12.282318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.713993+0000","last_change":"2024-09-15T23:21:20.713993+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.713993+0000","last_undegraded":"2024-09-15T23:21:20.713993+0000","last_fullsized":"2024-09-15T23:21:20.713993+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.720264+0000","last_change":"2024-09-15T23:21:21.737932+0000","last_active":"2024-09-15T23:21:22.720264+0000","last_peered":"2024-09-15T23:21:22.720264+0000","last_clean":"2024-09-15T23:21:22.720264+0000","last_became_active":"2024-09-15T23:21:21.737595+0000","last_became_peered":"2024-09-15T23:21:21.737595+0000","last_unstale":"2024-09-15T23:21:22.720264+0000","last_undegraded":"2024-09-15T23:21:22.720264+0000","last_fullsized":"2024-09-15T23:21:22.720264+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:01:08.141687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.718118+0000","last_change":"2024-09-15T23:21:21.737759+0000","last_active":"2024-09-15T23:21:22.718118+0000","last_peered":"2024-09-15T23:21:22.718118+0000","last_clean":"2024-09-15T23:21:22.718118+0000","last_became_active":"2024-09-15T23:21:21.737161+0000","last_became_peered":"2024-09-15T23:21:21.737161+0000","last_unstale":"2024-09-15T23:21:22.718118+0000","last_undegraded":"2024-09-15T23:21:22.718118+0000","last_fullsized":"2024-09-15T23:21:22.718118+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:17.646086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.718894+0000","last_change":"2024-09-15T23:21:20.718894+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.718894+0000","last_undegraded":"2024-09-15T23:21:20.718894+0000","last_fullsized":"2024-09-15T23:21:20.718894+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.717751+0000","last_change":"2024-09-15T23:21:21.730211+0000","last_active":"2024-09-15T23:21:22.717751+0000","last_peered":"2024-09-15T23:21:22.717751+0000","last_clean":"2024-09-15T23:21:22.717751+0000","last_became_active":"2024-09-15T23:21:21.729919+0000","last_became_peered":"2024-09-15T23:21:21.729919+0000","last_unstale":"2024-09-15T23:21:22.717751+0000","last_undegraded":"2024-09-15T23:21:22.717751+0000","last_fullsized":"2024-09-15T23:21:22.717751+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:03.318606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.741683+0000","last_change":"2024-09-15T23:21:22.736340+0000","last_active":"2024-09-15T23:21:22.741683+0000","last_peered":"2024-09-15T23:21:22.741683+0000","last_clean":"2024-09-15T23:21:22.741683+0000","last_became_active":"2024-09-15T23:21:22.724766+0000","last_became_peered":"2024-09-15T23:21:22.724766+0000","last_unstale":"2024-09-15T23:21:22.741683+0000","last_undegraded":"2024-09-15T23:21:22.741683+0000","last_fullsized":"2024-09-15T23:21:22.741683+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:36:38.151336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.719106+0000","last_change":"2024-09-15T23:21:20.719106+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.719106+0000","last_undegraded":"2024-09-15T23:21:20.719106+0000","last_fullsized":"2024-09-15T23:21:20.719106+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.717686+0000","last_change":"2024-09-15T23:21:21.737328+0000","last_active":"2024-09-15T23:21:22.717686+0000","last_peered":"2024-09-15T23:21:22.717686+0000","last_clean":"2024-09-15T23:21:22.717686+0000","last_became_active":"2024-09-15T23:21:21.736636+0000","last_became_peered":"2024-09-15T23:21:21.736636+0000","last_unstale":"2024-09-15T23:21:22.717686+0000","last_undegraded":"2024-09-15T23:21:22.717686+0000","last_fullsized":"2024-09-15T23:21:22.717686+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:04:32.575098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.739008+0000","last_change":"2024-09-15T23:21:22.722542+0000","last_active":"2024-09-15T23:21:22.739008+0000","last_peered":"2024-09-15T23:21:22.739008+0000","last_clean":"2024-09-15T23:21:22.739008+0000","last_became_active":"2024-09-15T23:21:22.722242+0000","last_became_peered":"2024-09-15T23:21:22.722242+0000","last_unstale":"2024-09-15T23:21:22.739008+0000","last_undegraded":"2024-09-15T23:21:22.739008+0000","last_fullsized":"2024-09-15T23:21:22.739008+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:56.416229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.715556+0000","last_change":"2024-09-15T23:21:21.736127+0000","last_active":"2024-09-15T23:21:22.715556+0000","last_peered":"2024-09-15T23:21:22.715556+0000","last_clean":"2024-09-15T23:21:22.715556+0000","last_became_active":"2024-09-15T23:21:21.735854+0000","last_became_peered":"2024-09-15T23:21:21.735854+0000","last_unstale":"2024-09-15T23:21:22.715556+0000","last_undegraded":"2024-09-15T23:21:22.715556+0000","last_fullsized":"2024-09-15T23:21:22.715556+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:00.080011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.717406+0000","last_change":"2024-09-15T23:21:21.733268+0000","last_active":"2024-09-15T23:21:22.717406+0000","last_peered":"2024-09-15T23:21:22.717406+0000","last_clean":"2024-09-15T23:21:22.717406+0000","last_became_active":"2024-09-15T23:21:21.733003+0000","last_became_peered":"2024-09-15T23:21:21.733003+0000","last_unstale":"2024-09-15T23:21:22.717406+0000","last_undegraded":"2024-09-15T23:21:22.717406+0000","last_fullsized":"2024-09-15T23:21:22.717406+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:27.535113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":440,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.719463+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:21:22.719463+0000","last_peered":"2024-09-15T23:21:22.719463+0000","last_clean":"2024-09-15T23:21:22.719463+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:21:22.719463+0000","last_undegraded":"2024-09-15T23:21:22.719463+0000","last_fullsized":"2024-09-15T23:21:22.719463+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":56,"acting":56,"num_store_stats":4},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2286,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476854,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55448,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316392,"statfs":{"total":96636764160,"available":96579985408,"internally_reserved":0,"allocated":2097152,"data_stored":921286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476851,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55416,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316424,"statfs":{"total":96636764160,"available":96580018176,"internally_reserved":0,"allocated":2068480,"data_stored":912877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51840,"kb_used_data":2600,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320000,"statfs":{"total":96636764160,"available":96583680000,"internally_reserved":0,"allocated":2662400,"data_stored":1503245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476853,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29072,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342768,"statfs":{"total":96636764160,"available":96606994432,"internally_reserved":0,"allocated":2084864,"data_stored":919722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29040,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342800,"statfs":{"total":96636764160,"available":96607027200,"internally_reserved":0,"allocated":2056192,"data_stored":906602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51236,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320604,"statfs":{"total":96636764160,"available":96584298496,"internally_reserved":0,"allocated":2043904,"data_stored":900785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542258,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55992,"kb_used_data":2588,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315848,"statfs":{"total":96636764160,"available":96579428352,"internally_reserved":0,"allocated":2650112,"data_stored":1496970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55412,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316428,"statfs":{"total":96636764160,"available":96580022272,"internally_reserved":0,"allocated":2056192,"data_stored":906602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:21:25.666 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:21:25.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.799+0000 7fab3b2ae640 1 Processor -- start 2024-09-15T23:21:25.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.799+0000 7fab3b2ae640 1 -- start start 2024-09-15T23:21:25.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.800+0000 7fab3b2ae640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fab3406c320 0x7fab3415bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:25.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.800+0000 7fab3b2ae640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab34071180 con 0x7fab340b2d40 2024-09-15T23:21:25.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.800+0000 7fab3b2ae640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab34071460 con 0x7fab3413eb20 2024-09-15T23:21:25.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.800+0000 7fab3b2ae640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fab34071ab0 con 0x7fab3406c320 2024-09-15T23:21:25.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.800+0000 7fab3904a640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fab340b2d40 0x7fab3406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:57268/0 (socket says 172.21.15.123:57268) 2024-09-15T23:21:25.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.800+0000 7fab3904a640 1 -- 172.21.15.123:0/2274244173 learned_addr learned my addr 172.21.15.123:0/2274244173 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:21:25.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.800+0000 7fab33fff640 1 -- 172.21.15.123:0/2274244173 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2195815573 0 0) 0x7fab34071180 con 0x7fab340b2d40 2024-09-15T23:21:25.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.801+0000 7fab33fff640 1 -- 172.21.15.123:0/2274244173 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab1c003520 con 0x7fab340b2d40 2024-09-15T23:21:25.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.801+0000 7fab38849640 1 --2- 172.21.15.123:0/2274244173 >> v2:172.21.15.188:3300/0 conn(0x7fab3406c320 0x7fab3415bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:25.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.801+0000 7fab33fff640 1 -- 172.21.15.123:0/2274244173 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1704889034 0 0) 0x7fab1c003520 con 0x7fab340b2d40 2024-09-15T23:21:25.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.801+0000 7fab33fff640 1 -- 172.21.15.123:0/2274244173 >> v2:172.21.15.188:3300/0 conn(0x7fab3406c320 msgr2=0x7fab3415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:25.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.801+0000 7fab33fff640 1 --2- 172.21.15.123:0/2274244173 >> v2:172.21.15.188:3300/0 conn(0x7fab3406c320 0x7fab3415bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.801+0000 7fab33fff640 1 -- 172.21.15.123:0/2274244173 >> v1:172.21.15.188:6789/0 conn(0x7fab3413eb20 legacy=0x7fab3415c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:25.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.801+0000 7fab33fff640 1 -- 172.21.15.123:0/2274244173 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab34071740 con 0x7fab340b2d40 2024-09-15T23:21:25.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.801+0000 7fab33fff640 1 -- 172.21.15.123:0/2274244173 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fab240019f0 con 0x7fab340b2d40 2024-09-15T23:21:25.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.801+0000 7fab33fff640 1 -- 172.21.15.123:0/2274244173 >> v1:172.21.15.123:6789/0 conn(0x7fab340b2d40 legacy=0x7fab3406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:25.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.801+0000 7fab33fff640 1 --2- 172.21.15.123:0/2274244173 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fab1c0039b0 0x7fab1c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:25.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.801+0000 7fab33fff640 1 --2- 172.21.15.123:0/2274244173 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fab1c004800 0x7fab1c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:25.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.801+0000 7fab33fff640 1 --2- 172.21.15.123:0/2274244173 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab1c0051c0 0x7fab1c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:25.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.801+0000 7fab33fff640 1 -- 172.21.15.123:0/2274244173 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fab34071ab0 con 0x7fab1c0051c0 2024-09-15T23:21:25.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.801+0000 7fab33fff640 1 -- 172.21.15.123:0/2274244173 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fab1c00c060 con 0x7fab1c004800 2024-09-15T23:21:25.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.801+0000 7fab33fff640 1 -- 172.21.15.123:0/2274244173 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fab1c00c260 con 0x7fab1c0039b0 2024-09-15T23:21:25.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.801+0000 7fab3984b640 1 --2- 172.21.15.123:0/2274244173 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab1c0051c0 0x7fab1c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:25.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.801+0000 7fab38849640 1 --2- 172.21.15.123:0/2274244173 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fab1c004800 0x7fab1c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:25.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.801+0000 7fab3904a640 1 --2- 172.21.15.123:0/2274244173 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fab1c0039b0 0x7fab1c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:25.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.801+0000 7fab3984b640 1 -- 172.21.15.123:0/2274244173 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fab1c0039b0 msgr2=0x7fab1c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:25.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.801+0000 7fab3984b640 1 --2- 172.21.15.123:0/2274244173 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fab1c0039b0 0x7fab1c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.801+0000 7fab3984b640 1 -- 172.21.15.123:0/2274244173 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fab1c004800 msgr2=0x7fab1c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:25.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.801+0000 7fab3984b640 1 --2- 172.21.15.123:0/2274244173 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fab1c004800 0x7fab1c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.801+0000 7fab3984b640 1 -- 172.21.15.123:0/2274244173 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab1c003520 con 0x7fab1c0051c0 2024-09-15T23:21:25.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.802+0000 7fab3984b640 1 -- 172.21.15.123:0/2274244173 reap_dead start 2024-09-15T23:21:25.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.802+0000 7fab3984b640 1 --2- 172.21.15.123:0/2274244173 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab1c0051c0 0x7fab1c00b9c0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7fab2c001750 tx=0x7fab1c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c8a949bea1c9116 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:25.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.802+0000 7fab33fff640 1 -- 172.21.15.123:0/2274244173 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c001370 con 0x7fab1c0051c0 2024-09-15T23:21:25.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.802+0000 7fab33fff640 1 -- 172.21.15.123:0/2274244173 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab2c0052f0 con 0x7fab1c0051c0 2024-09-15T23:21:25.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.802+0000 7fab33fff640 1 -- 172.21.15.123:0/2274244173 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c02abe0 con 0x7fab1c0051c0 2024-09-15T23:21:25.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.803+0000 7fab3b2ae640 1 -- 172.21.15.123:0/2274244173 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab1c0051c0 msgr2=0x7fab1c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:25.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.803+0000 7fab3b2ae640 1 --2- 172.21.15.123:0/2274244173 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab1c0051c0 0x7fab1c00b9c0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7fab2c001750 tx=0x7fab1c005830 comp rx=0 tx=0).stop 2024-09-15T23:21:25.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.803+0000 7fab3b2ae640 1 -- 172.21.15.123:0/2274244173 shutdown_connections 2024-09-15T23:21:25.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.803+0000 7fab3b2ae640 1 --2- 172.21.15.123:0/2274244173 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab1c0051c0 0x7fab1c00b9c0 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.803+0000 7fab3b2ae640 1 -- 172.21.15.123:0/2274244173 >> 172.21.15.123:0/2274244173 conn(0x7fab340ccec0 msgr2=0x7fab340cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:25.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.803+0000 7fab3b2ae640 1 -- 172.21.15.123:0/2274244173 shutdown_connections 2024-09-15T23:21:25.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.803+0000 7fab3b2ae640 1 -- 172.21.15.123:0/2274244173 wait complete. 2024-09-15T23:21:25.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.804+0000 7fab3b2ae640 1 Processor -- start 2024-09-15T23:21:25.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.804+0000 7fab3b2ae640 1 -- start start 2024-09-15T23:21:25.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.805+0000 7fab3b2ae640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fab1c0051c0 0x7fab3413daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:25.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.805+0000 7fab3b2ae640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fab34142540 0x7fab341575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:25.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.805+0000 7fab3b2ae640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab34157b10 0x7fab341f36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:25.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.805+0000 7fab3b2ae640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fab3406bfa0 con 0x7fab34157b10 2024-09-15T23:21:25.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.805+0000 7fab3b2ae640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fab3406be20 con 0x7fab1c0051c0 2024-09-15T23:21:25.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.805+0000 7fab3b2ae640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fab3406c120 con 0x7fab34142540 2024-09-15T23:21:25.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.805+0000 7fab3984b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab34157b10 0x7fab341f36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:25.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.805+0000 7fab3984b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab34157b10 0x7fab341f36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57372/0 (socket says 172.21.15.123:57372) 2024-09-15T23:21:25.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.805+0000 7fab3984b640 1 -- 172.21.15.123:0/3866769016 learned_addr learned my addr 172.21.15.123:0/3866769016 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:25.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.805+0000 7fab3904a640 1 --2- 172.21.15.123:0/3866769016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fab1c0051c0 0x7fab3413daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:25.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.805+0000 7fab38849640 1 --2- 172.21.15.123:0/3866769016 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fab34142540 0x7fab341575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:25.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.805+0000 7fab3984b640 1 -- 172.21.15.123:0/3866769016 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fab34142540 msgr2=0x7fab341575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:25.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.805+0000 7fab3984b640 1 --2- 172.21.15.123:0/3866769016 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fab34142540 0x7fab341575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.805+0000 7fab3984b640 1 -- 172.21.15.123:0/3866769016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fab1c0051c0 msgr2=0x7fab3413daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:25.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.805+0000 7fab3984b640 1 --2- 172.21.15.123:0/3866769016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fab1c0051c0 0x7fab3413daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.805+0000 7fab3984b640 1 -- 172.21.15.123:0/3866769016 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab340b6230 con 0x7fab34157b10 2024-09-15T23:21:25.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.805+0000 7fab3984b640 1 --2- 172.21.15.123:0/3866769016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab34157b10 0x7fab341f36f0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fab2c001870 tx=0x7fab2c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:25.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.805+0000 7fab31ffb640 1 -- 172.21.15.123:0/3866769016 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c007a30 con 0x7fab34157b10 2024-09-15T23:21:25.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.805+0000 7fab31ffb640 1 -- 172.21.15.123:0/3866769016 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab2c0054a0 con 0x7fab34157b10 2024-09-15T23:21:25.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.805+0000 7fab31ffb640 1 -- 172.21.15.123:0/3866769016 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab2c004d40 con 0x7fab34157b10 2024-09-15T23:21:25.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.805+0000 7fab3b2ae640 1 -- 172.21.15.123:0/3866769016 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab34142d90 con 0x7fab34157b10 2024-09-15T23:21:25.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.806+0000 7fab3b2ae640 1 -- 172.21.15.123:0/3866769016 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab340b6510 con 0x7fab34157b10 2024-09-15T23:21:25.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.806+0000 7fab3b2ae640 1 -- 172.21.15.123:0/3866769016 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab3415bcf0 con 0x7fab34157b10 2024-09-15T23:21:25.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.807+0000 7fab31ffb640 1 -- 172.21.15.123:0/3866769016 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fab2c007030 con 0x7fab34157b10 2024-09-15T23:21:25.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.807+0000 7fab31ffb640 1 --2- 172.21.15.123:0/3866769016 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fab2006c2e0 0x7fab2006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:25.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.807+0000 7fab31ffb640 1 -- 172.21.15.123:0/3866769016 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7fab2c0aa560 con 0x7fab34157b10 2024-09-15T23:21:25.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.808+0000 7fab3904a640 1 --2- 172.21.15.123:0/3866769016 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fab2006c2e0 0x7fab2006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:25.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.808+0000 7fab3904a640 1 --2- 172.21.15.123:0/3866769016 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fab2006c2e0 0x7fab2006e7a0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fab24004d00 tx=0x7fab24006040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:25.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.812+0000 7fab31ffb640 1 -- 172.21.15.123:0/3866769016 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fab2c02ae20 con 0x7fab34157b10 2024-09-15T23:21:25.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.973+0000 7fab3b2ae640 1 -- 172.21.15.123:0/3866769016 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fab3406c9c0 con 0x7fab2006c2e0 2024-09-15T23:21:25.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.979+0000 7fab31ffb640 1 -- 172.21.15.123:0/3866769016 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246041 (secure 0 0 0) 0x7fab3406c9c0 con 0x7fab2006c2e0 2024-09-15T23:21:25.983 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:25.984 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:21:25.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.982+0000 7fab3b2ae640 1 -- 172.21.15.123:0/3866769016 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fab2006c2e0 msgr2=0x7fab2006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:25.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.982+0000 7fab3b2ae640 1 --2- 172.21.15.123:0/3866769016 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fab2006c2e0 0x7fab2006e7a0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fab24004d00 tx=0x7fab24006040 comp rx=0 tx=0).stop 2024-09-15T23:21:25.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.982+0000 7fab3b2ae640 1 -- 172.21.15.123:0/3866769016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab34157b10 msgr2=0x7fab341f36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:25.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.982+0000 7fab3b2ae640 1 --2- 172.21.15.123:0/3866769016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab34157b10 0x7fab341f36f0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fab2c001870 tx=0x7fab2c001120 comp rx=0 tx=0).stop 2024-09-15T23:21:25.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.982+0000 7fab3b2ae640 1 -- 172.21.15.123:0/3866769016 shutdown_connections 2024-09-15T23:21:25.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.982+0000 7fab3b2ae640 1 --2- 172.21.15.123:0/3866769016 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fab2006c2e0 0x7fab2006e7a0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.982+0000 7fab3b2ae640 1 --2- 172.21.15.123:0/3866769016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab34157b10 0x7fab341f36f0 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.982+0000 7fab3b2ae640 1 --2- 172.21.15.123:0/3866769016 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fab34142540 0x7fab341575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.982+0000 7fab3b2ae640 1 --2- 172.21.15.123:0/3866769016 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fab1c0051c0 0x7fab3413daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:25.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.982+0000 7fab3b2ae640 1 -- 172.21.15.123:0/3866769016 >> 172.21.15.123:0/3866769016 conn(0x7fab340ccec0 msgr2=0x7fab3415afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:25.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.982+0000 7fab3b2ae640 1 -- 172.21.15.123:0/3866769016 shutdown_connections 2024-09-15T23:21:25.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:25.983+0000 7fab3b2ae640 1 -- 172.21.15.123:0/3866769016 wait complete. 2024-09-15T23:21:25.994 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":443,"stamp":"2024-09-15T23:21:25.634886+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592654,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":186,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":122,"acting":122,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":383456,"kb_used_data":17304,"kb_used_omap":12,"kb_used_meta":365939,"kb_avail":754591264,"statfs":{"total":773094113280,"available":772701454336,"internally_reserved":0,"allocated":17719296,"data_stored":8468089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":374722096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2286,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.921505"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.741607+0000","last_change":"2024-09-15T23:21:22.726816+0000","last_active":"2024-09-15T23:21:22.741607+0000","last_peered":"2024-09-15T23:21:22.741607+0000","last_clean":"2024-09-15T23:21:22.741607+0000","last_became_active":"2024-09-15T23:21:22.726529+0000","last_became_peered":"2024-09-15T23:21:22.726529+0000","last_unstale":"2024-09-15T23:21:22.741607+0000","last_undegraded":"2024-09-15T23:21:22.741607+0000","last_fullsized":"2024-09-15T23:21:22.741607+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:22:20.946782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.741502+0000","last_change":"2024-09-15T23:21:22.725283+0000","last_active":"2024-09-15T23:21:22.741502+0000","last_peered":"2024-09-15T23:21:22.741502+0000","last_clean":"2024-09-15T23:21:22.741502+0000","last_became_active":"2024-09-15T23:21:22.725020+0000","last_became_peered":"2024-09-15T23:21:22.725020+0000","last_unstale":"2024-09-15T23:21:22.741502+0000","last_undegraded":"2024-09-15T23:21:22.741502+0000","last_fullsized":"2024-09-15T23:21:22.741502+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:01:36.316467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.741521+0000","last_change":"2024-09-15T23:21:22.725523+0000","last_active":"2024-09-15T23:21:22.741521+0000","last_peered":"2024-09-15T23:21:22.741521+0000","last_clean":"2024-09-15T23:21:22.741521+0000","last_became_active":"2024-09-15T23:21:22.723213+0000","last_became_peered":"2024-09-15T23:21:22.723213+0000","last_unstale":"2024-09-15T23:21:22.741521+0000","last_undegraded":"2024-09-15T23:21:22.741521+0000","last_fullsized":"2024-09-15T23:21:22.741521+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:19.979292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.729685+0000","last_change":"2024-09-15T23:21:22.728138+0000","last_active":"2024-09-15T23:21:22.729685+0000","last_peered":"2024-09-15T23:21:22.729685+0000","last_clean":"2024-09-15T23:21:22.729685+0000","last_became_active":"2024-09-15T23:21:22.727856+0000","last_became_peered":"2024-09-15T23:21:22.727856+0000","last_unstale":"2024-09-15T23:21:22.729685+0000","last_undegraded":"2024-09-15T23:21:22.729685+0000","last_fullsized":"2024-09-15T23:21:22.729685+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:12:43.918097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.730449+0000","last_change":"2024-09-15T23:21:22.728181+0000","last_active":"2024-09-15T23:21:22.730449+0000","last_peered":"2024-09-15T23:21:22.730449+0000","last_clean":"2024-09-15T23:21:22.730449+0000","last_became_active":"2024-09-15T23:21:22.727863+0000","last_became_peered":"2024-09-15T23:21:22.727863+0000","last_unstale":"2024-09-15T23:21:22.730449+0000","last_undegraded":"2024-09-15T23:21:22.730449+0000","last_fullsized":"2024-09-15T23:21:22.730449+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:50.794279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.725293+0000","last_change":"2024-09-15T23:21:22.720386+0000","last_active":"2024-09-15T23:21:22.725293+0000","last_peered":"2024-09-15T23:21:22.725293+0000","last_clean":"2024-09-15T23:21:22.725293+0000","last_became_active":"2024-09-15T23:21:22.720114+0000","last_became_peered":"2024-09-15T23:21:22.720114+0000","last_unstale":"2024-09-15T23:21:22.725293+0000","last_undegraded":"2024-09-15T23:21:22.725293+0000","last_fullsized":"2024-09-15T23:21:22.725293+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:36.841290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.725869+0000","last_change":"2024-09-15T23:21:22.723261+0000","last_active":"2024-09-15T23:21:22.725869+0000","last_peered":"2024-09-15T23:21:22.725869+0000","last_clean":"2024-09-15T23:21:22.725869+0000","last_became_active":"2024-09-15T23:21:22.722993+0000","last_became_peered":"2024-09-15T23:21:22.722993+0000","last_unstale":"2024-09-15T23:21:22.725869+0000","last_undegraded":"2024-09-15T23:21:22.725869+0000","last_fullsized":"2024-09-15T23:21:22.725869+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:41:48.886638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.736515+0000","last_change":"2024-09-15T23:21:22.734444+0000","last_active":"2024-09-15T23:21:22.736515+0000","last_peered":"2024-09-15T23:21:22.736515+0000","last_clean":"2024-09-15T23:21:22.736515+0000","last_became_active":"2024-09-15T23:21:22.732810+0000","last_became_peered":"2024-09-15T23:21:22.732810+0000","last_unstale":"2024-09-15T23:21:22.736515+0000","last_undegraded":"2024-09-15T23:21:22.736515+0000","last_fullsized":"2024-09-15T23:21:22.736515+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:36.986973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.734171+0000","last_change":"2024-09-15T23:21:22.730945+0000","last_active":"2024-09-15T23:21:22.734171+0000","last_peered":"2024-09-15T23:21:22.734171+0000","last_clean":"2024-09-15T23:21:22.734171+0000","last_became_active":"2024-09-15T23:21:22.730645+0000","last_became_peered":"2024-09-15T23:21:22.730645+0000","last_unstale":"2024-09-15T23:21:22.734171+0000","last_undegraded":"2024-09-15T23:21:22.734171+0000","last_fullsized":"2024-09-15T23:21:22.734171+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:40.008114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.734637+0000","last_change":"2024-09-15T23:21:22.733734+0000","last_active":"2024-09-15T23:21:22.734637+0000","last_peered":"2024-09-15T23:21:22.734637+0000","last_clean":"2024-09-15T23:21:22.734637+0000","last_became_active":"2024-09-15T23:21:22.733441+0000","last_became_peered":"2024-09-15T23:21:22.733441+0000","last_unstale":"2024-09-15T23:21:22.734637+0000","last_undegraded":"2024-09-15T23:21:22.734637+0000","last_fullsized":"2024-09-15T23:21:22.734637+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:12.914045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.731172+0000","last_change":"2024-09-15T23:21:22.729776+0000","last_active":"2024-09-15T23:21:22.731172+0000","last_peered":"2024-09-15T23:21:22.731172+0000","last_clean":"2024-09-15T23:21:22.731172+0000","last_became_active":"2024-09-15T23:21:22.728949+0000","last_became_peered":"2024-09-15T23:21:22.728949+0000","last_unstale":"2024-09-15T23:21:22.731172+0000","last_undegraded":"2024-09-15T23:21:22.731172+0000","last_fullsized":"2024-09-15T23:21:22.731172+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:22.338146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.733707+0000","last_change":"2024-09-15T23:21:22.732516+0000","last_active":"2024-09-15T23:21:22.733707+0000","last_peered":"2024-09-15T23:21:22.733707+0000","last_clean":"2024-09-15T23:21:22.733707+0000","last_became_active":"2024-09-15T23:21:22.732251+0000","last_became_peered":"2024-09-15T23:21:22.732251+0000","last_unstale":"2024-09-15T23:21:22.733707+0000","last_undegraded":"2024-09-15T23:21:22.733707+0000","last_fullsized":"2024-09-15T23:21:22.733707+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:01.081667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.734147+0000","last_change":"2024-09-15T23:21:22.726724+0000","last_active":"2024-09-15T23:21:22.734147+0000","last_peered":"2024-09-15T23:21:22.734147+0000","last_clean":"2024-09-15T23:21:22.734147+0000","last_became_active":"2024-09-15T23:21:22.726437+0000","last_became_peered":"2024-09-15T23:21:22.726437+0000","last_unstale":"2024-09-15T23:21:22.734147+0000","last_undegraded":"2024-09-15T23:21:22.734147+0000","last_fullsized":"2024-09-15T23:21:22.734147+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:20:55.725352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.732514+0000","last_change":"2024-09-15T23:21:22.731809+0000","last_active":"2024-09-15T23:21:22.732514+0000","last_peered":"2024-09-15T23:21:22.732514+0000","last_clean":"2024-09-15T23:21:22.732514+0000","last_became_active":"2024-09-15T23:21:22.731525+0000","last_became_peered":"2024-09-15T23:21:22.731525+0000","last_unstale":"2024-09-15T23:21:22.732514+0000","last_undegraded":"2024-09-15T23:21:22.732514+0000","last_fullsized":"2024-09-15T23:21:22.732514+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:24.714284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.732205+0000","last_change":"2024-09-15T23:21:22.730534+0000","last_active":"2024-09-15T23:21:22.732205+0000","last_peered":"2024-09-15T23:21:22.732205+0000","last_clean":"2024-09-15T23:21:22.732205+0000","last_became_active":"2024-09-15T23:21:22.730254+0000","last_became_peered":"2024-09-15T23:21:22.730254+0000","last_unstale":"2024-09-15T23:21:22.732205+0000","last_undegraded":"2024-09-15T23:21:22.732205+0000","last_fullsized":"2024-09-15T23:21:22.732205+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:43:29.335197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.740501+0000","last_change":"2024-09-15T23:21:22.738611+0000","last_active":"2024-09-15T23:21:22.740501+0000","last_peered":"2024-09-15T23:21:22.740501+0000","last_clean":"2024-09-15T23:21:22.740501+0000","last_became_active":"2024-09-15T23:21:22.738306+0000","last_became_peered":"2024-09-15T23:21:22.738306+0000","last_unstale":"2024-09-15T23:21:22.740501+0000","last_undegraded":"2024-09-15T23:21:22.740501+0000","last_fullsized":"2024-09-15T23:21:22.740501+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:46:31.588595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.732222+0000","last_change":"2024-09-15T23:21:22.730551+0000","last_active":"2024-09-15T23:21:22.732222+0000","last_peered":"2024-09-15T23:21:22.732222+0000","last_clean":"2024-09-15T23:21:22.732222+0000","last_became_active":"2024-09-15T23:21:22.730157+0000","last_became_peered":"2024-09-15T23:21:22.730157+0000","last_unstale":"2024-09-15T23:21:22.732222+0000","last_undegraded":"2024-09-15T23:21:22.732222+0000","last_fullsized":"2024-09-15T23:21:22.732222+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:42.508730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.741558+0000","last_change":"2024-09-15T23:21:22.725781+0000","last_active":"2024-09-15T23:21:22.741558+0000","last_peered":"2024-09-15T23:21:22.741558+0000","last_clean":"2024-09-15T23:21:22.741558+0000","last_became_active":"2024-09-15T23:21:22.724370+0000","last_became_peered":"2024-09-15T23:21:22.724370+0000","last_unstale":"2024-09-15T23:21:22.741558+0000","last_undegraded":"2024-09-15T23:21:22.741558+0000","last_fullsized":"2024-09-15T23:21:22.741558+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:17.342891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.731192+0000","last_change":"2024-09-15T23:21:22.729757+0000","last_active":"2024-09-15T23:21:22.731192+0000","last_peered":"2024-09-15T23:21:22.731192+0000","last_clean":"2024-09-15T23:21:22.731192+0000","last_became_active":"2024-09-15T23:21:22.728468+0000","last_became_peered":"2024-09-15T23:21:22.728468+0000","last_unstale":"2024-09-15T23:21:22.731192+0000","last_undegraded":"2024-09-15T23:21:22.731192+0000","last_fullsized":"2024-09-15T23:21:22.731192+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:47.009845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.721997+0000","last_change":"2024-09-15T23:21:22.719925+0000","last_active":"2024-09-15T23:21:22.721997+0000","last_peered":"2024-09-15T23:21:22.721997+0000","last_clean":"2024-09-15T23:21:22.721997+0000","last_became_active":"2024-09-15T23:21:22.719532+0000","last_became_peered":"2024-09-15T23:21:22.719532+0000","last_unstale":"2024-09-15T23:21:22.721997+0000","last_undegraded":"2024-09-15T23:21:22.721997+0000","last_fullsized":"2024-09-15T23:21:22.721997+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:58.514360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1f","version":"167'4","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.744482+0000","last_change":"2024-09-15T23:21:21.737653+0000","last_active":"2024-09-15T23:21:22.744482+0000","last_peered":"2024-09-15T23:21:22.744482+0000","last_clean":"2024-09-15T23:21:22.744482+0000","last_became_active":"2024-09-15T23:21:21.737345+0000","last_became_peered":"2024-09-15T23:21:21.737345+0000","last_unstale":"2024-09-15T23:21:22.744482+0000","last_undegraded":"2024-09-15T23:21:22.744482+0000","last_fullsized":"2024-09-15T23:21:22.744482+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:56:25.666102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.741922+0000","last_change":"2024-09-15T23:21:22.737797+0000","last_active":"2024-09-15T23:21:22.741922+0000","last_peered":"2024-09-15T23:21:22.741922+0000","last_clean":"2024-09-15T23:21:22.741922+0000","last_became_active":"2024-09-15T23:21:22.737320+0000","last_became_peered":"2024-09-15T23:21:22.737320+0000","last_unstale":"2024-09-15T23:21:22.741922+0000","last_undegraded":"2024-09-15T23:21:22.741922+0000","last_fullsized":"2024-09-15T23:21:22.741922+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:45.051354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1e","version":"167'1","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.734840+0000","last_change":"2024-09-15T23:21:21.729577+0000","last_active":"2024-09-15T23:21:22.734840+0000","last_peered":"2024-09-15T23:21:22.734840+0000","last_clean":"2024-09-15T23:21:22.734840+0000","last_became_active":"2024-09-15T23:21:21.729284+0000","last_became_peered":"2024-09-15T23:21:21.729284+0000","last_unstale":"2024-09-15T23:21:22.734840+0000","last_undegraded":"2024-09-15T23:21:22.734840+0000","last_fullsized":"2024-09-15T23:21:22.734840+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:16:10.026756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.713977+0000","last_change":"2024-09-15T23:21:20.713977+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.713977+0000","last_undegraded":"2024-09-15T23:21:20.713977+0000","last_fullsized":"2024-09-15T23:21:20.713977+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.732818+0000","last_change":"2024-09-15T23:21:22.731852+0000","last_active":"2024-09-15T23:21:22.732818+0000","last_peered":"2024-09-15T23:21:22.732818+0000","last_clean":"2024-09-15T23:21:22.732818+0000","last_became_active":"2024-09-15T23:21:22.731572+0000","last_became_peered":"2024-09-15T23:21:22.731572+0000","last_unstale":"2024-09-15T23:21:22.732818+0000","last_undegraded":"2024-09-15T23:21:22.732818+0000","last_fullsized":"2024-09-15T23:21:22.732818+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:54.053199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.719297+0000","last_change":"2024-09-15T23:21:20.719297+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.719297+0000","last_undegraded":"2024-09-15T23:21:20.719297+0000","last_fullsized":"2024-09-15T23:21:20.719297+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1b","version":"167'1","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.741971+0000","last_change":"2024-09-15T23:21:21.737750+0000","last_active":"2024-09-15T23:21:22.741971+0000","last_peered":"2024-09-15T23:21:22.741971+0000","last_clean":"2024-09-15T23:21:22.741971+0000","last_became_active":"2024-09-15T23:21:21.737470+0000","last_became_peered":"2024-09-15T23:21:21.737470+0000","last_unstale":"2024-09-15T23:21:22.741971+0000","last_undegraded":"2024-09-15T23:21:22.741971+0000","last_fullsized":"2024-09-15T23:21:22.741971+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:21.410602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.716844+0000","last_change":"2024-09-15T23:21:20.716844+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.716844+0000","last_undegraded":"2024-09-15T23:21:20.716844+0000","last_fullsized":"2024-09-15T23:21:20.716844+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.717545+0000","last_change":"2024-09-15T23:21:21.737521+0000","last_active":"2024-09-15T23:21:22.717545+0000","last_peered":"2024-09-15T23:21:22.717545+0000","last_clean":"2024-09-15T23:21:22.717545+0000","last_became_active":"2024-09-15T23:21:21.736819+0000","last_became_peered":"2024-09-15T23:21:21.736819+0000","last_unstale":"2024-09-15T23:21:22.717545+0000","last_undegraded":"2024-09-15T23:21:22.717545+0000","last_fullsized":"2024-09-15T23:21:22.717545+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:40.716470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.717982+0000","last_change":"2024-09-15T23:21:20.717982+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.717982+0000","last_undegraded":"2024-09-15T23:21:20.717982+0000","last_fullsized":"2024-09-15T23:21:20.717982+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.713984+0000","last_change":"2024-09-15T23:21:20.713984+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.713984+0000","last_undegraded":"2024-09-15T23:21:20.713984+0000","last_fullsized":"2024-09-15T23:21:20.713984+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.718425+0000","last_change":"2024-09-15T23:21:20.718425+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.718425+0000","last_undegraded":"2024-09-15T23:21:20.718425+0000","last_fullsized":"2024-09-15T23:21:20.718425+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.739910+0000","last_change":"2024-09-15T23:21:22.722686+0000","last_active":"2024-09-15T23:21:22.739910+0000","last_peered":"2024-09-15T23:21:22.739910+0000","last_clean":"2024-09-15T23:21:22.739910+0000","last_became_active":"2024-09-15T23:21:22.722367+0000","last_became_peered":"2024-09-15T23:21:22.722367+0000","last_unstale":"2024-09-15T23:21:22.739910+0000","last_undegraded":"2024-09-15T23:21:22.739910+0000","last_fullsized":"2024-09-15T23:21:22.739910+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:02:39.146127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.14","version":"167'6","reported_seq":18,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.745850+0000","last_change":"2024-09-15T23:21:21.728632+0000","last_active":"2024-09-15T23:21:22.745850+0000","last_peered":"2024-09-15T23:21:22.745850+0000","last_clean":"2024-09-15T23:21:22.745850+0000","last_became_active":"2024-09-15T23:21:21.728358+0000","last_became_peered":"2024-09-15T23:21:21.728358+0000","last_unstale":"2024-09-15T23:21:22.745850+0000","last_undegraded":"2024-09-15T23:21:22.745850+0000","last_fullsized":"2024-09-15T23:21:22.745850+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:16:00.181183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.716832+0000","last_change":"2024-09-15T23:21:20.716832+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.716832+0000","last_undegraded":"2024-09-15T23:21:20.716832+0000","last_fullsized":"2024-09-15T23:21:20.716832+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.713926+0000","last_change":"2024-09-15T23:21:20.713926+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.713926+0000","last_undegraded":"2024-09-15T23:21:20.713926+0000","last_fullsized":"2024-09-15T23:21:20.713926+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.717947+0000","last_change":"2024-09-15T23:21:20.717947+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.717947+0000","last_undegraded":"2024-09-15T23:21:20.717947+0000","last_fullsized":"2024-09-15T23:21:20.717947+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.732170+0000","last_change":"2024-09-15T23:21:22.730786+0000","last_active":"2024-09-15T23:21:22.732170+0000","last_peered":"2024-09-15T23:21:22.732170+0000","last_clean":"2024-09-15T23:21:22.732170+0000","last_became_active":"2024-09-15T23:21:22.730507+0000","last_became_peered":"2024-09-15T23:21:22.730507+0000","last_unstale":"2024-09-15T23:21:22.732170+0000","last_undegraded":"2024-09-15T23:21:22.732170+0000","last_fullsized":"2024-09-15T23:21:22.732170+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:16.216690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.10","version":"167'8","reported_seq":20,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.743899+0000","last_change":"2024-09-15T23:21:21.725050+0000","last_active":"2024-09-15T23:21:22.743899+0000","last_peered":"2024-09-15T23:21:22.743899+0000","last_clean":"2024-09-15T23:21:22.743899+0000","last_became_active":"2024-09-15T23:21:21.724729+0000","last_became_peered":"2024-09-15T23:21:21.724729+0000","last_unstale":"2024-09-15T23:21:22.743899+0000","last_undegraded":"2024-09-15T23:21:22.743899+0000","last_fullsized":"2024-09-15T23:21:22.743899+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:40.841373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.f","version":"167'1","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.743367+0000","last_change":"2024-09-15T23:21:21.732704+0000","last_active":"2024-09-15T23:21:22.743367+0000","last_peered":"2024-09-15T23:21:22.743367+0000","last_clean":"2024-09-15T23:21:22.743367+0000","last_became_active":"2024-09-15T23:21:21.732406+0000","last_became_peered":"2024-09-15T23:21:21.732406+0000","last_unstale":"2024-09-15T23:21:22.743367+0000","last_undegraded":"2024-09-15T23:21:22.743367+0000","last_fullsized":"2024-09-15T23:21:22.743367+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:28.211194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.e","version":"167'2","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.735925+0000","last_change":"2024-09-15T23:21:21.729354+0000","last_active":"2024-09-15T23:21:22.735925+0000","last_peered":"2024-09-15T23:21:22.735925+0000","last_clean":"2024-09-15T23:21:22.735925+0000","last_became_active":"2024-09-15T23:21:21.729019+0000","last_became_peered":"2024-09-15T23:21:21.729019+0000","last_unstale":"2024-09-15T23:21:22.735925+0000","last_undegraded":"2024-09-15T23:21:22.735925+0000","last_fullsized":"2024-09-15T23:21:22.735925+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:34.813792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.d","version":"167'1","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.739278+0000","last_change":"2024-09-15T23:21:21.733634+0000","last_active":"2024-09-15T23:21:22.739278+0000","last_peered":"2024-09-15T23:21:22.739278+0000","last_clean":"2024-09-15T23:21:22.739278+0000","last_became_active":"2024-09-15T23:21:21.733369+0000","last_became_peered":"2024-09-15T23:21:21.733369+0000","last_unstale":"2024-09-15T23:21:22.739278+0000","last_undegraded":"2024-09-15T23:21:22.739278+0000","last_fullsized":"2024-09-15T23:21:22.739278+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:44.350966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.720906+0000","last_change":"2024-09-15T23:21:21.732863+0000","last_active":"2024-09-15T23:21:22.720906+0000","last_peered":"2024-09-15T23:21:22.720906+0000","last_clean":"2024-09-15T23:21:22.720906+0000","last_became_active":"2024-09-15T23:21:21.731828+0000","last_became_peered":"2024-09-15T23:21:21.731828+0000","last_unstale":"2024-09-15T23:21:22.720906+0000","last_undegraded":"2024-09-15T23:21:22.720906+0000","last_fullsized":"2024-09-15T23:21:22.720906+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:12.222045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.719790+0000","last_change":"2024-09-15T23:21:22.718883+0000","last_active":"2024-09-15T23:21:22.719790+0000","last_peered":"2024-09-15T23:21:22.719790+0000","last_clean":"2024-09-15T23:21:22.719790+0000","last_became_active":"2024-09-15T23:21:22.718466+0000","last_became_peered":"2024-09-15T23:21:22.718466+0000","last_unstale":"2024-09-15T23:21:22.719790+0000","last_undegraded":"2024-09-15T23:21:22.719790+0000","last_fullsized":"2024-09-15T23:21:22.719790+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:49:53.278979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.718048+0000","last_change":"2024-09-15T23:21:20.718048+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.718048+0000","last_undegraded":"2024-09-15T23:21:20.718048+0000","last_fullsized":"2024-09-15T23:21:20.718048+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.721696+0000","last_change":"2024-09-15T23:21:21.728470+0000","last_active":"2024-09-15T23:21:22.721696+0000","last_peered":"2024-09-15T23:21:22.721696+0000","last_clean":"2024-09-15T23:21:22.721696+0000","last_became_active":"2024-09-15T23:21:21.728205+0000","last_became_peered":"2024-09-15T23:21:21.728205+0000","last_unstale":"2024-09-15T23:21:22.721696+0000","last_undegraded":"2024-09-15T23:21:22.721696+0000","last_fullsized":"2024-09-15T23:21:22.721696+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:33:14.843299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.741635+0000","last_change":"2024-09-15T23:21:22.729733+0000","last_active":"2024-09-15T23:21:22.741635+0000","last_peered":"2024-09-15T23:21:22.741635+0000","last_clean":"2024-09-15T23:21:22.741635+0000","last_became_active":"2024-09-15T23:21:22.729412+0000","last_became_peered":"2024-09-15T23:21:22.729412+0000","last_unstale":"2024-09-15T23:21:22.741635+0000","last_undegraded":"2024-09-15T23:21:22.741635+0000","last_fullsized":"2024-09-15T23:21:22.741635+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:59:51.046663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.716832+0000","last_change":"2024-09-15T23:21:20.716832+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.716832+0000","last_undegraded":"2024-09-15T23:21:20.716832+0000","last_fullsized":"2024-09-15T23:21:20.716832+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.720087+0000","last_change":"2024-09-15T23:21:21.731639+0000","last_active":"2024-09-15T23:21:22.720087+0000","last_peered":"2024-09-15T23:21:22.720087+0000","last_clean":"2024-09-15T23:21:22.720087+0000","last_became_active":"2024-09-15T23:21:21.731378+0000","last_became_peered":"2024-09-15T23:21:21.731378+0000","last_unstale":"2024-09-15T23:21:22.720087+0000","last_undegraded":"2024-09-15T23:21:22.720087+0000","last_fullsized":"2024-09-15T23:21:22.720087+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:12.282318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.713993+0000","last_change":"2024-09-15T23:21:20.713993+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.713993+0000","last_undegraded":"2024-09-15T23:21:20.713993+0000","last_fullsized":"2024-09-15T23:21:20.713993+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.720264+0000","last_change":"2024-09-15T23:21:21.737932+0000","last_active":"2024-09-15T23:21:22.720264+0000","last_peered":"2024-09-15T23:21:22.720264+0000","last_clean":"2024-09-15T23:21:22.720264+0000","last_became_active":"2024-09-15T23:21:21.737595+0000","last_became_peered":"2024-09-15T23:21:21.737595+0000","last_unstale":"2024-09-15T23:21:22.720264+0000","last_undegraded":"2024-09-15T23:21:22.720264+0000","last_fullsized":"2024-09-15T23:21:22.720264+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:01:08.141687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.718118+0000","last_change":"2024-09-15T23:21:21.737759+0000","last_active":"2024-09-15T23:21:22.718118+0000","last_peered":"2024-09-15T23:21:22.718118+0000","last_clean":"2024-09-15T23:21:22.718118+0000","last_became_active":"2024-09-15T23:21:21.737161+0000","last_became_peered":"2024-09-15T23:21:21.737161+0000","last_unstale":"2024-09-15T23:21:22.718118+0000","last_undegraded":"2024-09-15T23:21:22.718118+0000","last_fullsized":"2024-09-15T23:21:22.718118+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:17.646086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.718894+0000","last_change":"2024-09-15T23:21:20.718894+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.718894+0000","last_undegraded":"2024-09-15T23:21:20.718894+0000","last_fullsized":"2024-09-15T23:21:20.718894+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.717751+0000","last_change":"2024-09-15T23:21:21.730211+0000","last_active":"2024-09-15T23:21:22.717751+0000","last_peered":"2024-09-15T23:21:22.717751+0000","last_clean":"2024-09-15T23:21:22.717751+0000","last_became_active":"2024-09-15T23:21:21.729919+0000","last_became_peered":"2024-09-15T23:21:21.729919+0000","last_unstale":"2024-09-15T23:21:22.717751+0000","last_undegraded":"2024-09-15T23:21:22.717751+0000","last_fullsized":"2024-09-15T23:21:22.717751+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:03.318606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.741683+0000","last_change":"2024-09-15T23:21:22.736340+0000","last_active":"2024-09-15T23:21:22.741683+0000","last_peered":"2024-09-15T23:21:22.741683+0000","last_clean":"2024-09-15T23:21:22.741683+0000","last_became_active":"2024-09-15T23:21:22.724766+0000","last_became_peered":"2024-09-15T23:21:22.724766+0000","last_unstale":"2024-09-15T23:21:22.741683+0000","last_undegraded":"2024-09-15T23:21:22.741683+0000","last_fullsized":"2024-09-15T23:21:22.741683+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:36:38.151336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.719106+0000","last_change":"2024-09-15T23:21:20.719106+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.719106+0000","last_undegraded":"2024-09-15T23:21:20.719106+0000","last_fullsized":"2024-09-15T23:21:20.719106+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.717686+0000","last_change":"2024-09-15T23:21:21.737328+0000","last_active":"2024-09-15T23:21:22.717686+0000","last_peered":"2024-09-15T23:21:22.717686+0000","last_clean":"2024-09-15T23:21:22.717686+0000","last_became_active":"2024-09-15T23:21:21.736636+0000","last_became_peered":"2024-09-15T23:21:21.736636+0000","last_unstale":"2024-09-15T23:21:22.717686+0000","last_undegraded":"2024-09-15T23:21:22.717686+0000","last_fullsized":"2024-09-15T23:21:22.717686+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:04:32.575098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.739008+0000","last_change":"2024-09-15T23:21:22.722542+0000","last_active":"2024-09-15T23:21:22.739008+0000","last_peered":"2024-09-15T23:21:22.739008+0000","last_clean":"2024-09-15T23:21:22.739008+0000","last_became_active":"2024-09-15T23:21:22.722242+0000","last_became_peered":"2024-09-15T23:21:22.722242+0000","last_unstale":"2024-09-15T23:21:22.739008+0000","last_undegraded":"2024-09-15T23:21:22.739008+0000","last_fullsized":"2024-09-15T23:21:22.739008+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:56.416229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.715556+0000","last_change":"2024-09-15T23:21:21.736127+0000","last_active":"2024-09-15T23:21:22.715556+0000","last_peered":"2024-09-15T23:21:22.715556+0000","last_clean":"2024-09-15T23:21:22.715556+0000","last_became_active":"2024-09-15T23:21:21.735854+0000","last_became_peered":"2024-09-15T23:21:21.735854+0000","last_unstale":"2024-09-15T23:21:22.715556+0000","last_undegraded":"2024-09-15T23:21:22.715556+0000","last_fullsized":"2024-09-15T23:21:22.715556+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:00.080011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.717406+0000","last_change":"2024-09-15T23:21:21.733268+0000","last_active":"2024-09-15T23:21:22.717406+0000","last_peered":"2024-09-15T23:21:22.717406+0000","last_clean":"2024-09-15T23:21:22.717406+0000","last_became_active":"2024-09-15T23:21:21.733003+0000","last_became_peered":"2024-09-15T23:21:21.733003+0000","last_unstale":"2024-09-15T23:21:22.717406+0000","last_undegraded":"2024-09-15T23:21:22.717406+0000","last_fullsized":"2024-09-15T23:21:22.717406+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:27.535113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":440,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.719463+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:21:22.719463+0000","last_peered":"2024-09-15T23:21:22.719463+0000","last_clean":"2024-09-15T23:21:22.719463+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:21:22.719463+0000","last_undegraded":"2024-09-15T23:21:22.719463+0000","last_fullsized":"2024-09-15T23:21:22.719463+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":56,"acting":56,"num_store_stats":4},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2286,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476854,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55448,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316392,"statfs":{"total":96636764160,"available":96579985408,"internally_reserved":0,"allocated":2097152,"data_stored":921286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476851,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55416,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316424,"statfs":{"total":96636764160,"available":96580018176,"internally_reserved":0,"allocated":2068480,"data_stored":912877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51840,"kb_used_data":2600,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320000,"statfs":{"total":96636764160,"available":96583680000,"internally_reserved":0,"allocated":2662400,"data_stored":1503245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476853,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29072,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342768,"statfs":{"total":96636764160,"available":96606994432,"internally_reserved":0,"allocated":2084864,"data_stored":919722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29040,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342800,"statfs":{"total":96636764160,"available":96607027200,"internally_reserved":0,"allocated":2056192,"data_stored":906602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51236,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320604,"statfs":{"total":96636764160,"available":96584298496,"internally_reserved":0,"allocated":2043904,"data_stored":900785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542258,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55992,"kb_used_data":2588,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315848,"statfs":{"total":96636764160,"available":96579428352,"internally_reserved":0,"allocated":2650112,"data_stored":1496970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55412,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316428,"statfs":{"total":96636764160,"available":96580022272,"internally_reserved":0,"allocated":2056192,"data_stored":906602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:21:25.998 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:21:26.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.132+0000 7f1b630af640 1 Processor -- start 2024-09-15T23:21:26.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.132+0000 7f1b630af640 1 -- start start 2024-09-15T23:21:26.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.133+0000 7f1b630af640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1b5c15ab40 0x7f1b5c06c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:26.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.133+0000 7f1b630af640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b5c072520 con 0x7f1b5c0720b0 2024-09-15T23:21:26.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.133+0000 7f1b630af640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b5c071010 con 0x7f1b5c15af20 2024-09-15T23:21:26.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.133+0000 7f1b630af640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f1b5c0712f0 con 0x7f1b5c15ab40 2024-09-15T23:21:26.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.133+0000 7f1b5bfff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1b5c0720b0 0x7f1b5c073990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:57274/0 (socket says 172.21.15.123:57274) 2024-09-15T23:21:26.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.133+0000 7f1b5bfff640 1 -- 172.21.15.123:0/182738690 learned_addr learned my addr 172.21.15.123:0/182738690 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:21:26.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.133+0000 7f1b5b7fe640 1 -- 172.21.15.123:0/182738690 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3204385556 0 0) 0x7f1b5c072520 con 0x7f1b5c0720b0 2024-09-15T23:21:26.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.133+0000 7f1b5b7fe640 1 -- 172.21.15.123:0/182738690 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b4c003520 con 0x7f1b5c0720b0 2024-09-15T23:21:26.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.133+0000 7f1b60e4b640 1 --2- 172.21.15.123:0/182738690 >> v2:172.21.15.188:3300/0 conn(0x7f1b5c15ab40 0x7f1b5c06c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:26.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.133+0000 7f1b5b7fe640 1 -- 172.21.15.123:0/182738690 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4274867590 0 0) 0x7f1b4c003520 con 0x7f1b5c0720b0 2024-09-15T23:21:26.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.133+0000 7f1b5b7fe640 1 -- 172.21.15.123:0/182738690 >> v2:172.21.15.188:3300/0 conn(0x7f1b5c15ab40 msgr2=0x7f1b5c06c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:26.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.133+0000 7f1b5b7fe640 1 --2- 172.21.15.123:0/182738690 >> v2:172.21.15.188:3300/0 conn(0x7f1b5c15ab40 0x7f1b5c06c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:26.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.133+0000 7f1b5b7fe640 1 -- 172.21.15.123:0/182738690 >> v1:172.21.15.188:6789/0 conn(0x7f1b5c15af20 legacy=0x7f1b5c15b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:26.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.133+0000 7f1b5b7fe640 1 -- 172.21.15.123:0/182738690 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b5c0715d0 con 0x7f1b5c0720b0 2024-09-15T23:21:26.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.133+0000 7f1b5b7fe640 1 -- 172.21.15.123:0/182738690 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f1b48001670 con 0x7f1b5c0720b0 2024-09-15T23:21:26.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.133+0000 7f1b5b7fe640 1 -- 172.21.15.123:0/182738690 >> v1:172.21.15.123:6789/0 conn(0x7f1b5c0720b0 legacy=0x7f1b5c073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:26.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.133+0000 7f1b5b7fe640 1 --2- 172.21.15.123:0/182738690 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b4c0039b0 0x7f1b4c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:26.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.133+0000 7f1b5b7fe640 1 --2- 172.21.15.123:0/182738690 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b4c004800 0x7f1b4c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:26.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.133+0000 7f1b5b7fe640 1 --2- 172.21.15.123:0/182738690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b4c0051c0 0x7f1b4c00cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:26.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.133+0000 7f1b5b7fe640 1 -- 172.21.15.123:0/182738690 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5c0712f0 con 0x7f1b4c0051c0 2024-09-15T23:21:26.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.133+0000 7f1b5b7fe640 1 -- 172.21.15.123:0/182738690 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4c0059c0 con 0x7f1b4c0039b0 2024-09-15T23:21:26.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.133+0000 7f1b5b7fe640 1 -- 172.21.15.123:0/182738690 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1b4c005bc0 con 0x7f1b4c004800 2024-09-15T23:21:26.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.134+0000 7f1b6164c640 1 --2- 172.21.15.123:0/182738690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b4c0051c0 0x7f1b4c00cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:26.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.134+0000 7f1b60e4b640 1 --2- 172.21.15.123:0/182738690 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b4c0039b0 0x7f1b4c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:26.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.134+0000 7f1b5bfff640 1 --2- 172.21.15.123:0/182738690 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b4c004800 0x7f1b4c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:26.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.134+0000 7f1b6164c640 1 -- 172.21.15.123:0/182738690 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b4c004800 msgr2=0x7f1b4c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:26.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.134+0000 7f1b6164c640 1 --2- 172.21.15.123:0/182738690 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b4c004800 0x7f1b4c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:26.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.134+0000 7f1b6164c640 1 -- 172.21.15.123:0/182738690 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b4c0039b0 msgr2=0x7f1b4c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:26.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.134+0000 7f1b6164c640 1 --2- 172.21.15.123:0/182738690 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b4c0039b0 0x7f1b4c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:26.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.134+0000 7f1b6164c640 1 -- 172.21.15.123:0/182738690 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b4c003520 con 0x7f1b4c0051c0 2024-09-15T23:21:26.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.134+0000 7f1b6164c640 1 -- 172.21.15.123:0/182738690 reap_dead start 2024-09-15T23:21:26.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.135+0000 7f1b6164c640 1 --2- 172.21.15.123:0/182738690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b4c0051c0 0x7f1b4c00cad0 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f1b54001e50 tx=0x7f1b4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a03b9988d0cdec81 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:26.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.135+0000 7f1b5b7fe640 1 -- 172.21.15.123:0/182738690 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b54001a70 con 0x7f1b4c0051c0 2024-09-15T23:21:26.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.135+0000 7f1b5b7fe640 1 -- 172.21.15.123:0/182738690 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b54003970 con 0x7f1b4c0051c0 2024-09-15T23:21:26.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.135+0000 7f1b5b7fe640 1 -- 172.21.15.123:0/182738690 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b54003d60 con 0x7f1b4c0051c0 2024-09-15T23:21:26.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.135+0000 7f1b630af640 1 -- 172.21.15.123:0/182738690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b4c0051c0 msgr2=0x7f1b4c00cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:26.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.135+0000 7f1b630af640 1 --2- 172.21.15.123:0/182738690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b4c0051c0 0x7f1b4c00cad0 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f1b54001e50 tx=0x7f1b4c005830 comp rx=0 tx=0).stop 2024-09-15T23:21:26.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.135+0000 7f1b630af640 1 -- 172.21.15.123:0/182738690 shutdown_connections 2024-09-15T23:21:26.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.135+0000 7f1b630af640 1 --2- 172.21.15.123:0/182738690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b4c0051c0 0x7f1b4c00cad0 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:26.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.135+0000 7f1b630af640 1 -- 172.21.15.123:0/182738690 >> 172.21.15.123:0/182738690 conn(0x7f1b5c0ccec0 msgr2=0x7f1b5c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:26.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.135+0000 7f1b630af640 1 -- 172.21.15.123:0/182738690 shutdown_connections 2024-09-15T23:21:26.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.135+0000 7f1b630af640 1 -- 172.21.15.123:0/182738690 wait complete. 2024-09-15T23:21:26.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.136+0000 7f1b630af640 1 Processor -- start 2024-09-15T23:21:26.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.136+0000 7f1b630af640 1 -- start start 2024-09-15T23:21:26.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.137+0000 7f1b630af640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b4c0051c0 0x7f1b5c14c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:26.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.137+0000 7f1b630af640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b5c1f4050 0x7f1b5c1e91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:26.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.137+0000 7f1b630af640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b5c1e9710 0x7f1b5c1e6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:26.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.137+0000 7f1b630af640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5c06c820 con 0x7f1b5c1f4050 2024-09-15T23:21:26.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.137+0000 7f1b630af640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5c06c6a0 con 0x7f1b5c1e9710 2024-09-15T23:21:26.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.137+0000 7f1b630af640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1b5c06c9a0 con 0x7f1b4c0051c0 2024-09-15T23:21:26.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.137+0000 7f1b5bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b5c1f4050 0x7f1b5c1e91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:26.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.137+0000 7f1b5bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b5c1f4050 0x7f1b5c1e91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57392/0 (socket says 172.21.15.123:57392) 2024-09-15T23:21:26.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.137+0000 7f1b5bfff640 1 -- 172.21.15.123:0/2579807247 learned_addr learned my addr 172.21.15.123:0/2579807247 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:26.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.138+0000 7f1b60e4b640 1 --2- 172.21.15.123:0/2579807247 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b4c0051c0 0x7f1b5c14c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:26.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.138+0000 7f1b6164c640 1 --2- 172.21.15.123:0/2579807247 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b5c1e9710 0x7f1b5c1e6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:26.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.138+0000 7f1b5bfff640 1 -- 172.21.15.123:0/2579807247 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b4c0051c0 msgr2=0x7f1b5c14c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:26.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.138+0000 7f1b5bfff640 1 --2- 172.21.15.123:0/2579807247 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b4c0051c0 0x7f1b5c14c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:26.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.138+0000 7f1b5bfff640 1 -- 172.21.15.123:0/2579807247 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b5c1e9710 msgr2=0x7f1b5c1e6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:26.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.138+0000 7f1b5bfff640 1 --2- 172.21.15.123:0/2579807247 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b5c1e9710 0x7f1b5c1e6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:26.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.138+0000 7f1b5bfff640 1 -- 172.21.15.123:0/2579807247 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b5c1e2390 con 0x7f1b5c1f4050 2024-09-15T23:21:26.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.138+0000 7f1b5bfff640 1 --2- 172.21.15.123:0/2579807247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b5c1f4050 0x7f1b5c1e91d0 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f1b48007370 tx=0x7f1b48007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:26.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.138+0000 7f1b597fa640 1 -- 172.21.15.123:0/2579807247 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4801a070 con 0x7f1b5c1f4050 2024-09-15T23:21:26.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.138+0000 7f1b597fa640 1 -- 172.21.15.123:0/2579807247 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b4800f9c0 con 0x7f1b5c1f4050 2024-09-15T23:21:26.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.138+0000 7f1b597fa640 1 -- 172.21.15.123:0/2579807247 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4800fd90 con 0x7f1b5c1f4050 2024-09-15T23:21:26.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.138+0000 7f1b630af640 1 -- 172.21.15.123:0/2579807247 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b5c1e2670 con 0x7f1b5c1f4050 2024-09-15T23:21:26.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.138+0000 7f1b630af640 1 -- 172.21.15.123:0/2579807247 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b5c1e2c30 con 0x7f1b5c1f4050 2024-09-15T23:21:26.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.139+0000 7f1b630af640 1 -- 172.21.15.123:0/2579807247 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b5c073990 con 0x7f1b5c1f4050 2024-09-15T23:21:26.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.140+0000 7f1b597fa640 1 -- 172.21.15.123:0/2579807247 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1b4801d070 con 0x7f1b5c1f4050 2024-09-15T23:21:26.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.140+0000 7f1b597fa640 1 --2- 172.21.15.123:0/2579807247 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1b4006c2b0 0x7f1b4006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:26.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.140+0000 7f1b597fa640 1 -- 172.21.15.123:0/2579807247 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7f1b4808aed0 con 0x7f1b5c1f4050 2024-09-15T23:21:26.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.140+0000 7f1b60e4b640 1 --2- 172.21.15.123:0/2579807247 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1b4006c2b0 0x7f1b4006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:26.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.141+0000 7f1b60e4b640 1 --2- 172.21.15.123:0/2579807247 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1b4006c2b0 0x7f1b4006e770 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f1b50009a80 tx=0x7f1b50008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:26.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.144+0000 7f1b597fa640 1 -- 172.21.15.123:0/2579807247 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1b48059640 con 0x7f1b5c1f4050 2024-09-15T23:21:26.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.306+0000 7f1b630af640 1 -- 172.21.15.123:0/2579807247 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1b5c0cf060 con 0x7f1b4006c2b0 2024-09-15T23:21:26.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.312+0000 7f1b597fa640 1 -- 172.21.15.123:0/2579807247 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246041 (secure 0 0 0) 0x7f1b5c0cf060 con 0x7f1b4006c2b0 2024-09-15T23:21:26.316 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:26.317 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:21:26.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.315+0000 7f1b630af640 1 -- 172.21.15.123:0/2579807247 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1b4006c2b0 msgr2=0x7f1b4006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:26.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.315+0000 7f1b630af640 1 --2- 172.21.15.123:0/2579807247 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1b4006c2b0 0x7f1b4006e770 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f1b50009a80 tx=0x7f1b50008040 comp rx=0 tx=0).stop 2024-09-15T23:21:26.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.315+0000 7f1b630af640 1 -- 172.21.15.123:0/2579807247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b5c1f4050 msgr2=0x7f1b5c1e91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:26.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.315+0000 7f1b630af640 1 --2- 172.21.15.123:0/2579807247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b5c1f4050 0x7f1b5c1e91d0 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f1b48007370 tx=0x7f1b48007830 comp rx=0 tx=0).stop 2024-09-15T23:21:26.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.315+0000 7f1b630af640 1 -- 172.21.15.123:0/2579807247 shutdown_connections 2024-09-15T23:21:26.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.315+0000 7f1b630af640 1 --2- 172.21.15.123:0/2579807247 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b5c1e9710 0x7f1b5c1e6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:26.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.315+0000 7f1b630af640 1 --2- 172.21.15.123:0/2579807247 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1b4006c2b0 0x7f1b4006e770 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:26.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.315+0000 7f1b630af640 1 --2- 172.21.15.123:0/2579807247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b5c1f4050 0x7f1b5c1e91d0 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:26.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.315+0000 7f1b630af640 1 --2- 172.21.15.123:0/2579807247 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b4c0051c0 0x7f1b5c14c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:26.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.315+0000 7f1b630af640 1 -- 172.21.15.123:0/2579807247 >> 172.21.15.123:0/2579807247 conn(0x7f1b5c0ccec0 msgr2=0x7f1b5c0cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:26.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.315+0000 7f1b630af640 1 -- 172.21.15.123:0/2579807247 shutdown_connections 2024-09-15T23:21:26.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.315+0000 7f1b630af640 1 -- 172.21.15.123:0/2579807247 wait complete. 2024-09-15T23:21:26.327 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":443,"stamp":"2024-09-15T23:21:25.634886+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592654,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":186,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":122,"acting":122,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":383456,"kb_used_data":17304,"kb_used_omap":12,"kb_used_meta":365939,"kb_avail":754591264,"statfs":{"total":773094113280,"available":772701454336,"internally_reserved":0,"allocated":17719296,"data_stored":8468089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":374722096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2286,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.921505"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.741607+0000","last_change":"2024-09-15T23:21:22.726816+0000","last_active":"2024-09-15T23:21:22.741607+0000","last_peered":"2024-09-15T23:21:22.741607+0000","last_clean":"2024-09-15T23:21:22.741607+0000","last_became_active":"2024-09-15T23:21:22.726529+0000","last_became_peered":"2024-09-15T23:21:22.726529+0000","last_unstale":"2024-09-15T23:21:22.741607+0000","last_undegraded":"2024-09-15T23:21:22.741607+0000","last_fullsized":"2024-09-15T23:21:22.741607+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:22:20.946782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.741502+0000","last_change":"2024-09-15T23:21:22.725283+0000","last_active":"2024-09-15T23:21:22.741502+0000","last_peered":"2024-09-15T23:21:22.741502+0000","last_clean":"2024-09-15T23:21:22.741502+0000","last_became_active":"2024-09-15T23:21:22.725020+0000","last_became_peered":"2024-09-15T23:21:22.725020+0000","last_unstale":"2024-09-15T23:21:22.741502+0000","last_undegraded":"2024-09-15T23:21:22.741502+0000","last_fullsized":"2024-09-15T23:21:22.741502+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:01:36.316467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.741521+0000","last_change":"2024-09-15T23:21:22.725523+0000","last_active":"2024-09-15T23:21:22.741521+0000","last_peered":"2024-09-15T23:21:22.741521+0000","last_clean":"2024-09-15T23:21:22.741521+0000","last_became_active":"2024-09-15T23:21:22.723213+0000","last_became_peered":"2024-09-15T23:21:22.723213+0000","last_unstale":"2024-09-15T23:21:22.741521+0000","last_undegraded":"2024-09-15T23:21:22.741521+0000","last_fullsized":"2024-09-15T23:21:22.741521+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:19.979292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.729685+0000","last_change":"2024-09-15T23:21:22.728138+0000","last_active":"2024-09-15T23:21:22.729685+0000","last_peered":"2024-09-15T23:21:22.729685+0000","last_clean":"2024-09-15T23:21:22.729685+0000","last_became_active":"2024-09-15T23:21:22.727856+0000","last_became_peered":"2024-09-15T23:21:22.727856+0000","last_unstale":"2024-09-15T23:21:22.729685+0000","last_undegraded":"2024-09-15T23:21:22.729685+0000","last_fullsized":"2024-09-15T23:21:22.729685+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:12:43.918097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.730449+0000","last_change":"2024-09-15T23:21:22.728181+0000","last_active":"2024-09-15T23:21:22.730449+0000","last_peered":"2024-09-15T23:21:22.730449+0000","last_clean":"2024-09-15T23:21:22.730449+0000","last_became_active":"2024-09-15T23:21:22.727863+0000","last_became_peered":"2024-09-15T23:21:22.727863+0000","last_unstale":"2024-09-15T23:21:22.730449+0000","last_undegraded":"2024-09-15T23:21:22.730449+0000","last_fullsized":"2024-09-15T23:21:22.730449+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:50.794279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.725293+0000","last_change":"2024-09-15T23:21:22.720386+0000","last_active":"2024-09-15T23:21:22.725293+0000","last_peered":"2024-09-15T23:21:22.725293+0000","last_clean":"2024-09-15T23:21:22.725293+0000","last_became_active":"2024-09-15T23:21:22.720114+0000","last_became_peered":"2024-09-15T23:21:22.720114+0000","last_unstale":"2024-09-15T23:21:22.725293+0000","last_undegraded":"2024-09-15T23:21:22.725293+0000","last_fullsized":"2024-09-15T23:21:22.725293+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:36.841290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.725869+0000","last_change":"2024-09-15T23:21:22.723261+0000","last_active":"2024-09-15T23:21:22.725869+0000","last_peered":"2024-09-15T23:21:22.725869+0000","last_clean":"2024-09-15T23:21:22.725869+0000","last_became_active":"2024-09-15T23:21:22.722993+0000","last_became_peered":"2024-09-15T23:21:22.722993+0000","last_unstale":"2024-09-15T23:21:22.725869+0000","last_undegraded":"2024-09-15T23:21:22.725869+0000","last_fullsized":"2024-09-15T23:21:22.725869+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:41:48.886638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.736515+0000","last_change":"2024-09-15T23:21:22.734444+0000","last_active":"2024-09-15T23:21:22.736515+0000","last_peered":"2024-09-15T23:21:22.736515+0000","last_clean":"2024-09-15T23:21:22.736515+0000","last_became_active":"2024-09-15T23:21:22.732810+0000","last_became_peered":"2024-09-15T23:21:22.732810+0000","last_unstale":"2024-09-15T23:21:22.736515+0000","last_undegraded":"2024-09-15T23:21:22.736515+0000","last_fullsized":"2024-09-15T23:21:22.736515+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:36.986973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.734171+0000","last_change":"2024-09-15T23:21:22.730945+0000","last_active":"2024-09-15T23:21:22.734171+0000","last_peered":"2024-09-15T23:21:22.734171+0000","last_clean":"2024-09-15T23:21:22.734171+0000","last_became_active":"2024-09-15T23:21:22.730645+0000","last_became_peered":"2024-09-15T23:21:22.730645+0000","last_unstale":"2024-09-15T23:21:22.734171+0000","last_undegraded":"2024-09-15T23:21:22.734171+0000","last_fullsized":"2024-09-15T23:21:22.734171+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:40.008114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.734637+0000","last_change":"2024-09-15T23:21:22.733734+0000","last_active":"2024-09-15T23:21:22.734637+0000","last_peered":"2024-09-15T23:21:22.734637+0000","last_clean":"2024-09-15T23:21:22.734637+0000","last_became_active":"2024-09-15T23:21:22.733441+0000","last_became_peered":"2024-09-15T23:21:22.733441+0000","last_unstale":"2024-09-15T23:21:22.734637+0000","last_undegraded":"2024-09-15T23:21:22.734637+0000","last_fullsized":"2024-09-15T23:21:22.734637+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:12.914045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.731172+0000","last_change":"2024-09-15T23:21:22.729776+0000","last_active":"2024-09-15T23:21:22.731172+0000","last_peered":"2024-09-15T23:21:22.731172+0000","last_clean":"2024-09-15T23:21:22.731172+0000","last_became_active":"2024-09-15T23:21:22.728949+0000","last_became_peered":"2024-09-15T23:21:22.728949+0000","last_unstale":"2024-09-15T23:21:22.731172+0000","last_undegraded":"2024-09-15T23:21:22.731172+0000","last_fullsized":"2024-09-15T23:21:22.731172+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:22.338146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.733707+0000","last_change":"2024-09-15T23:21:22.732516+0000","last_active":"2024-09-15T23:21:22.733707+0000","last_peered":"2024-09-15T23:21:22.733707+0000","last_clean":"2024-09-15T23:21:22.733707+0000","last_became_active":"2024-09-15T23:21:22.732251+0000","last_became_peered":"2024-09-15T23:21:22.732251+0000","last_unstale":"2024-09-15T23:21:22.733707+0000","last_undegraded":"2024-09-15T23:21:22.733707+0000","last_fullsized":"2024-09-15T23:21:22.733707+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:01.081667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.734147+0000","last_change":"2024-09-15T23:21:22.726724+0000","last_active":"2024-09-15T23:21:22.734147+0000","last_peered":"2024-09-15T23:21:22.734147+0000","last_clean":"2024-09-15T23:21:22.734147+0000","last_became_active":"2024-09-15T23:21:22.726437+0000","last_became_peered":"2024-09-15T23:21:22.726437+0000","last_unstale":"2024-09-15T23:21:22.734147+0000","last_undegraded":"2024-09-15T23:21:22.734147+0000","last_fullsized":"2024-09-15T23:21:22.734147+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:20:55.725352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.732514+0000","last_change":"2024-09-15T23:21:22.731809+0000","last_active":"2024-09-15T23:21:22.732514+0000","last_peered":"2024-09-15T23:21:22.732514+0000","last_clean":"2024-09-15T23:21:22.732514+0000","last_became_active":"2024-09-15T23:21:22.731525+0000","last_became_peered":"2024-09-15T23:21:22.731525+0000","last_unstale":"2024-09-15T23:21:22.732514+0000","last_undegraded":"2024-09-15T23:21:22.732514+0000","last_fullsized":"2024-09-15T23:21:22.732514+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:24.714284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.732205+0000","last_change":"2024-09-15T23:21:22.730534+0000","last_active":"2024-09-15T23:21:22.732205+0000","last_peered":"2024-09-15T23:21:22.732205+0000","last_clean":"2024-09-15T23:21:22.732205+0000","last_became_active":"2024-09-15T23:21:22.730254+0000","last_became_peered":"2024-09-15T23:21:22.730254+0000","last_unstale":"2024-09-15T23:21:22.732205+0000","last_undegraded":"2024-09-15T23:21:22.732205+0000","last_fullsized":"2024-09-15T23:21:22.732205+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:43:29.335197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.740501+0000","last_change":"2024-09-15T23:21:22.738611+0000","last_active":"2024-09-15T23:21:22.740501+0000","last_peered":"2024-09-15T23:21:22.740501+0000","last_clean":"2024-09-15T23:21:22.740501+0000","last_became_active":"2024-09-15T23:21:22.738306+0000","last_became_peered":"2024-09-15T23:21:22.738306+0000","last_unstale":"2024-09-15T23:21:22.740501+0000","last_undegraded":"2024-09-15T23:21:22.740501+0000","last_fullsized":"2024-09-15T23:21:22.740501+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:46:31.588595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.732222+0000","last_change":"2024-09-15T23:21:22.730551+0000","last_active":"2024-09-15T23:21:22.732222+0000","last_peered":"2024-09-15T23:21:22.732222+0000","last_clean":"2024-09-15T23:21:22.732222+0000","last_became_active":"2024-09-15T23:21:22.730157+0000","last_became_peered":"2024-09-15T23:21:22.730157+0000","last_unstale":"2024-09-15T23:21:22.732222+0000","last_undegraded":"2024-09-15T23:21:22.732222+0000","last_fullsized":"2024-09-15T23:21:22.732222+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:42.508730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.741558+0000","last_change":"2024-09-15T23:21:22.725781+0000","last_active":"2024-09-15T23:21:22.741558+0000","last_peered":"2024-09-15T23:21:22.741558+0000","last_clean":"2024-09-15T23:21:22.741558+0000","last_became_active":"2024-09-15T23:21:22.724370+0000","last_became_peered":"2024-09-15T23:21:22.724370+0000","last_unstale":"2024-09-15T23:21:22.741558+0000","last_undegraded":"2024-09-15T23:21:22.741558+0000","last_fullsized":"2024-09-15T23:21:22.741558+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:17.342891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.731192+0000","last_change":"2024-09-15T23:21:22.729757+0000","last_active":"2024-09-15T23:21:22.731192+0000","last_peered":"2024-09-15T23:21:22.731192+0000","last_clean":"2024-09-15T23:21:22.731192+0000","last_became_active":"2024-09-15T23:21:22.728468+0000","last_became_peered":"2024-09-15T23:21:22.728468+0000","last_unstale":"2024-09-15T23:21:22.731192+0000","last_undegraded":"2024-09-15T23:21:22.731192+0000","last_fullsized":"2024-09-15T23:21:22.731192+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:47.009845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.721997+0000","last_change":"2024-09-15T23:21:22.719925+0000","last_active":"2024-09-15T23:21:22.721997+0000","last_peered":"2024-09-15T23:21:22.721997+0000","last_clean":"2024-09-15T23:21:22.721997+0000","last_became_active":"2024-09-15T23:21:22.719532+0000","last_became_peered":"2024-09-15T23:21:22.719532+0000","last_unstale":"2024-09-15T23:21:22.721997+0000","last_undegraded":"2024-09-15T23:21:22.721997+0000","last_fullsized":"2024-09-15T23:21:22.721997+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:58.514360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1f","version":"167'4","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.744482+0000","last_change":"2024-09-15T23:21:21.737653+0000","last_active":"2024-09-15T23:21:22.744482+0000","last_peered":"2024-09-15T23:21:22.744482+0000","last_clean":"2024-09-15T23:21:22.744482+0000","last_became_active":"2024-09-15T23:21:21.737345+0000","last_became_peered":"2024-09-15T23:21:21.737345+0000","last_unstale":"2024-09-15T23:21:22.744482+0000","last_undegraded":"2024-09-15T23:21:22.744482+0000","last_fullsized":"2024-09-15T23:21:22.744482+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:56:25.666102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.741922+0000","last_change":"2024-09-15T23:21:22.737797+0000","last_active":"2024-09-15T23:21:22.741922+0000","last_peered":"2024-09-15T23:21:22.741922+0000","last_clean":"2024-09-15T23:21:22.741922+0000","last_became_active":"2024-09-15T23:21:22.737320+0000","last_became_peered":"2024-09-15T23:21:22.737320+0000","last_unstale":"2024-09-15T23:21:22.741922+0000","last_undegraded":"2024-09-15T23:21:22.741922+0000","last_fullsized":"2024-09-15T23:21:22.741922+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:45.051354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1e","version":"167'1","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.734840+0000","last_change":"2024-09-15T23:21:21.729577+0000","last_active":"2024-09-15T23:21:22.734840+0000","last_peered":"2024-09-15T23:21:22.734840+0000","last_clean":"2024-09-15T23:21:22.734840+0000","last_became_active":"2024-09-15T23:21:21.729284+0000","last_became_peered":"2024-09-15T23:21:21.729284+0000","last_unstale":"2024-09-15T23:21:22.734840+0000","last_undegraded":"2024-09-15T23:21:22.734840+0000","last_fullsized":"2024-09-15T23:21:22.734840+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:16:10.026756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.713977+0000","last_change":"2024-09-15T23:21:20.713977+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.713977+0000","last_undegraded":"2024-09-15T23:21:20.713977+0000","last_fullsized":"2024-09-15T23:21:20.713977+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.732818+0000","last_change":"2024-09-15T23:21:22.731852+0000","last_active":"2024-09-15T23:21:22.732818+0000","last_peered":"2024-09-15T23:21:22.732818+0000","last_clean":"2024-09-15T23:21:22.732818+0000","last_became_active":"2024-09-15T23:21:22.731572+0000","last_became_peered":"2024-09-15T23:21:22.731572+0000","last_unstale":"2024-09-15T23:21:22.732818+0000","last_undegraded":"2024-09-15T23:21:22.732818+0000","last_fullsized":"2024-09-15T23:21:22.732818+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:54.053199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.719297+0000","last_change":"2024-09-15T23:21:20.719297+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.719297+0000","last_undegraded":"2024-09-15T23:21:20.719297+0000","last_fullsized":"2024-09-15T23:21:20.719297+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1b","version":"167'1","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.741971+0000","last_change":"2024-09-15T23:21:21.737750+0000","last_active":"2024-09-15T23:21:22.741971+0000","last_peered":"2024-09-15T23:21:22.741971+0000","last_clean":"2024-09-15T23:21:22.741971+0000","last_became_active":"2024-09-15T23:21:21.737470+0000","last_became_peered":"2024-09-15T23:21:21.737470+0000","last_unstale":"2024-09-15T23:21:22.741971+0000","last_undegraded":"2024-09-15T23:21:22.741971+0000","last_fullsized":"2024-09-15T23:21:22.741971+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:21.410602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.716844+0000","last_change":"2024-09-15T23:21:20.716844+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.716844+0000","last_undegraded":"2024-09-15T23:21:20.716844+0000","last_fullsized":"2024-09-15T23:21:20.716844+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.717545+0000","last_change":"2024-09-15T23:21:21.737521+0000","last_active":"2024-09-15T23:21:22.717545+0000","last_peered":"2024-09-15T23:21:22.717545+0000","last_clean":"2024-09-15T23:21:22.717545+0000","last_became_active":"2024-09-15T23:21:21.736819+0000","last_became_peered":"2024-09-15T23:21:21.736819+0000","last_unstale":"2024-09-15T23:21:22.717545+0000","last_undegraded":"2024-09-15T23:21:22.717545+0000","last_fullsized":"2024-09-15T23:21:22.717545+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:40.716470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.717982+0000","last_change":"2024-09-15T23:21:20.717982+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.717982+0000","last_undegraded":"2024-09-15T23:21:20.717982+0000","last_fullsized":"2024-09-15T23:21:20.717982+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.713984+0000","last_change":"2024-09-15T23:21:20.713984+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.713984+0000","last_undegraded":"2024-09-15T23:21:20.713984+0000","last_fullsized":"2024-09-15T23:21:20.713984+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.718425+0000","last_change":"2024-09-15T23:21:20.718425+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.718425+0000","last_undegraded":"2024-09-15T23:21:20.718425+0000","last_fullsized":"2024-09-15T23:21:20.718425+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.739910+0000","last_change":"2024-09-15T23:21:22.722686+0000","last_active":"2024-09-15T23:21:22.739910+0000","last_peered":"2024-09-15T23:21:22.739910+0000","last_clean":"2024-09-15T23:21:22.739910+0000","last_became_active":"2024-09-15T23:21:22.722367+0000","last_became_peered":"2024-09-15T23:21:22.722367+0000","last_unstale":"2024-09-15T23:21:22.739910+0000","last_undegraded":"2024-09-15T23:21:22.739910+0000","last_fullsized":"2024-09-15T23:21:22.739910+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:02:39.146127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.14","version":"167'6","reported_seq":18,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.745850+0000","last_change":"2024-09-15T23:21:21.728632+0000","last_active":"2024-09-15T23:21:22.745850+0000","last_peered":"2024-09-15T23:21:22.745850+0000","last_clean":"2024-09-15T23:21:22.745850+0000","last_became_active":"2024-09-15T23:21:21.728358+0000","last_became_peered":"2024-09-15T23:21:21.728358+0000","last_unstale":"2024-09-15T23:21:22.745850+0000","last_undegraded":"2024-09-15T23:21:22.745850+0000","last_fullsized":"2024-09-15T23:21:22.745850+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:16:00.181183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.716832+0000","last_change":"2024-09-15T23:21:20.716832+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.716832+0000","last_undegraded":"2024-09-15T23:21:20.716832+0000","last_fullsized":"2024-09-15T23:21:20.716832+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.713926+0000","last_change":"2024-09-15T23:21:20.713926+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.713926+0000","last_undegraded":"2024-09-15T23:21:20.713926+0000","last_fullsized":"2024-09-15T23:21:20.713926+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.717947+0000","last_change":"2024-09-15T23:21:20.717947+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.717947+0000","last_undegraded":"2024-09-15T23:21:20.717947+0000","last_fullsized":"2024-09-15T23:21:20.717947+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.732170+0000","last_change":"2024-09-15T23:21:22.730786+0000","last_active":"2024-09-15T23:21:22.732170+0000","last_peered":"2024-09-15T23:21:22.732170+0000","last_clean":"2024-09-15T23:21:22.732170+0000","last_became_active":"2024-09-15T23:21:22.730507+0000","last_became_peered":"2024-09-15T23:21:22.730507+0000","last_unstale":"2024-09-15T23:21:22.732170+0000","last_undegraded":"2024-09-15T23:21:22.732170+0000","last_fullsized":"2024-09-15T23:21:22.732170+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:16.216690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.10","version":"167'8","reported_seq":20,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.743899+0000","last_change":"2024-09-15T23:21:21.725050+0000","last_active":"2024-09-15T23:21:22.743899+0000","last_peered":"2024-09-15T23:21:22.743899+0000","last_clean":"2024-09-15T23:21:22.743899+0000","last_became_active":"2024-09-15T23:21:21.724729+0000","last_became_peered":"2024-09-15T23:21:21.724729+0000","last_unstale":"2024-09-15T23:21:22.743899+0000","last_undegraded":"2024-09-15T23:21:22.743899+0000","last_fullsized":"2024-09-15T23:21:22.743899+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:40.841373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.f","version":"167'1","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.743367+0000","last_change":"2024-09-15T23:21:21.732704+0000","last_active":"2024-09-15T23:21:22.743367+0000","last_peered":"2024-09-15T23:21:22.743367+0000","last_clean":"2024-09-15T23:21:22.743367+0000","last_became_active":"2024-09-15T23:21:21.732406+0000","last_became_peered":"2024-09-15T23:21:21.732406+0000","last_unstale":"2024-09-15T23:21:22.743367+0000","last_undegraded":"2024-09-15T23:21:22.743367+0000","last_fullsized":"2024-09-15T23:21:22.743367+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:28.211194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.e","version":"167'2","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.735925+0000","last_change":"2024-09-15T23:21:21.729354+0000","last_active":"2024-09-15T23:21:22.735925+0000","last_peered":"2024-09-15T23:21:22.735925+0000","last_clean":"2024-09-15T23:21:22.735925+0000","last_became_active":"2024-09-15T23:21:21.729019+0000","last_became_peered":"2024-09-15T23:21:21.729019+0000","last_unstale":"2024-09-15T23:21:22.735925+0000","last_undegraded":"2024-09-15T23:21:22.735925+0000","last_fullsized":"2024-09-15T23:21:22.735925+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:34.813792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.d","version":"167'1","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.739278+0000","last_change":"2024-09-15T23:21:21.733634+0000","last_active":"2024-09-15T23:21:22.739278+0000","last_peered":"2024-09-15T23:21:22.739278+0000","last_clean":"2024-09-15T23:21:22.739278+0000","last_became_active":"2024-09-15T23:21:21.733369+0000","last_became_peered":"2024-09-15T23:21:21.733369+0000","last_unstale":"2024-09-15T23:21:22.739278+0000","last_undegraded":"2024-09-15T23:21:22.739278+0000","last_fullsized":"2024-09-15T23:21:22.739278+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:44.350966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.720906+0000","last_change":"2024-09-15T23:21:21.732863+0000","last_active":"2024-09-15T23:21:22.720906+0000","last_peered":"2024-09-15T23:21:22.720906+0000","last_clean":"2024-09-15T23:21:22.720906+0000","last_became_active":"2024-09-15T23:21:21.731828+0000","last_became_peered":"2024-09-15T23:21:21.731828+0000","last_unstale":"2024-09-15T23:21:22.720906+0000","last_undegraded":"2024-09-15T23:21:22.720906+0000","last_fullsized":"2024-09-15T23:21:22.720906+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:12.222045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.719790+0000","last_change":"2024-09-15T23:21:22.718883+0000","last_active":"2024-09-15T23:21:22.719790+0000","last_peered":"2024-09-15T23:21:22.719790+0000","last_clean":"2024-09-15T23:21:22.719790+0000","last_became_active":"2024-09-15T23:21:22.718466+0000","last_became_peered":"2024-09-15T23:21:22.718466+0000","last_unstale":"2024-09-15T23:21:22.719790+0000","last_undegraded":"2024-09-15T23:21:22.719790+0000","last_fullsized":"2024-09-15T23:21:22.719790+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:49:53.278979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.718048+0000","last_change":"2024-09-15T23:21:20.718048+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.718048+0000","last_undegraded":"2024-09-15T23:21:20.718048+0000","last_fullsized":"2024-09-15T23:21:20.718048+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.721696+0000","last_change":"2024-09-15T23:21:21.728470+0000","last_active":"2024-09-15T23:21:22.721696+0000","last_peered":"2024-09-15T23:21:22.721696+0000","last_clean":"2024-09-15T23:21:22.721696+0000","last_became_active":"2024-09-15T23:21:21.728205+0000","last_became_peered":"2024-09-15T23:21:21.728205+0000","last_unstale":"2024-09-15T23:21:22.721696+0000","last_undegraded":"2024-09-15T23:21:22.721696+0000","last_fullsized":"2024-09-15T23:21:22.721696+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:33:14.843299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.741635+0000","last_change":"2024-09-15T23:21:22.729733+0000","last_active":"2024-09-15T23:21:22.741635+0000","last_peered":"2024-09-15T23:21:22.741635+0000","last_clean":"2024-09-15T23:21:22.741635+0000","last_became_active":"2024-09-15T23:21:22.729412+0000","last_became_peered":"2024-09-15T23:21:22.729412+0000","last_unstale":"2024-09-15T23:21:22.741635+0000","last_undegraded":"2024-09-15T23:21:22.741635+0000","last_fullsized":"2024-09-15T23:21:22.741635+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:59:51.046663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.716832+0000","last_change":"2024-09-15T23:21:20.716832+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.716832+0000","last_undegraded":"2024-09-15T23:21:20.716832+0000","last_fullsized":"2024-09-15T23:21:20.716832+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.720087+0000","last_change":"2024-09-15T23:21:21.731639+0000","last_active":"2024-09-15T23:21:22.720087+0000","last_peered":"2024-09-15T23:21:22.720087+0000","last_clean":"2024-09-15T23:21:22.720087+0000","last_became_active":"2024-09-15T23:21:21.731378+0000","last_became_peered":"2024-09-15T23:21:21.731378+0000","last_unstale":"2024-09-15T23:21:22.720087+0000","last_undegraded":"2024-09-15T23:21:22.720087+0000","last_fullsized":"2024-09-15T23:21:22.720087+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:12.282318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.713993+0000","last_change":"2024-09-15T23:21:20.713993+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.713993+0000","last_undegraded":"2024-09-15T23:21:20.713993+0000","last_fullsized":"2024-09-15T23:21:20.713993+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.720264+0000","last_change":"2024-09-15T23:21:21.737932+0000","last_active":"2024-09-15T23:21:22.720264+0000","last_peered":"2024-09-15T23:21:22.720264+0000","last_clean":"2024-09-15T23:21:22.720264+0000","last_became_active":"2024-09-15T23:21:21.737595+0000","last_became_peered":"2024-09-15T23:21:21.737595+0000","last_unstale":"2024-09-15T23:21:22.720264+0000","last_undegraded":"2024-09-15T23:21:22.720264+0000","last_fullsized":"2024-09-15T23:21:22.720264+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:01:08.141687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.718118+0000","last_change":"2024-09-15T23:21:21.737759+0000","last_active":"2024-09-15T23:21:22.718118+0000","last_peered":"2024-09-15T23:21:22.718118+0000","last_clean":"2024-09-15T23:21:22.718118+0000","last_became_active":"2024-09-15T23:21:21.737161+0000","last_became_peered":"2024-09-15T23:21:21.737161+0000","last_unstale":"2024-09-15T23:21:22.718118+0000","last_undegraded":"2024-09-15T23:21:22.718118+0000","last_fullsized":"2024-09-15T23:21:22.718118+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:17.646086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.718894+0000","last_change":"2024-09-15T23:21:20.718894+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.718894+0000","last_undegraded":"2024-09-15T23:21:20.718894+0000","last_fullsized":"2024-09-15T23:21:20.718894+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.717751+0000","last_change":"2024-09-15T23:21:21.730211+0000","last_active":"2024-09-15T23:21:22.717751+0000","last_peered":"2024-09-15T23:21:22.717751+0000","last_clean":"2024-09-15T23:21:22.717751+0000","last_became_active":"2024-09-15T23:21:21.729919+0000","last_became_peered":"2024-09-15T23:21:21.729919+0000","last_unstale":"2024-09-15T23:21:22.717751+0000","last_undegraded":"2024-09-15T23:21:22.717751+0000","last_fullsized":"2024-09-15T23:21:22.717751+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:03.318606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.741683+0000","last_change":"2024-09-15T23:21:22.736340+0000","last_active":"2024-09-15T23:21:22.741683+0000","last_peered":"2024-09-15T23:21:22.741683+0000","last_clean":"2024-09-15T23:21:22.741683+0000","last_became_active":"2024-09-15T23:21:22.724766+0000","last_became_peered":"2024-09-15T23:21:22.724766+0000","last_unstale":"2024-09-15T23:21:22.741683+0000","last_undegraded":"2024-09-15T23:21:22.741683+0000","last_fullsized":"2024-09-15T23:21:22.741683+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:36:38.151336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.719106+0000","last_change":"2024-09-15T23:21:20.719106+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.719106+0000","last_undegraded":"2024-09-15T23:21:20.719106+0000","last_fullsized":"2024-09-15T23:21:20.719106+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.717686+0000","last_change":"2024-09-15T23:21:21.737328+0000","last_active":"2024-09-15T23:21:22.717686+0000","last_peered":"2024-09-15T23:21:22.717686+0000","last_clean":"2024-09-15T23:21:22.717686+0000","last_became_active":"2024-09-15T23:21:21.736636+0000","last_became_peered":"2024-09-15T23:21:21.736636+0000","last_unstale":"2024-09-15T23:21:22.717686+0000","last_undegraded":"2024-09-15T23:21:22.717686+0000","last_fullsized":"2024-09-15T23:21:22.717686+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:04:32.575098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.739008+0000","last_change":"2024-09-15T23:21:22.722542+0000","last_active":"2024-09-15T23:21:22.739008+0000","last_peered":"2024-09-15T23:21:22.739008+0000","last_clean":"2024-09-15T23:21:22.739008+0000","last_became_active":"2024-09-15T23:21:22.722242+0000","last_became_peered":"2024-09-15T23:21:22.722242+0000","last_unstale":"2024-09-15T23:21:22.739008+0000","last_undegraded":"2024-09-15T23:21:22.739008+0000","last_fullsized":"2024-09-15T23:21:22.739008+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:56.416229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.715556+0000","last_change":"2024-09-15T23:21:21.736127+0000","last_active":"2024-09-15T23:21:22.715556+0000","last_peered":"2024-09-15T23:21:22.715556+0000","last_clean":"2024-09-15T23:21:22.715556+0000","last_became_active":"2024-09-15T23:21:21.735854+0000","last_became_peered":"2024-09-15T23:21:21.735854+0000","last_unstale":"2024-09-15T23:21:22.715556+0000","last_undegraded":"2024-09-15T23:21:22.715556+0000","last_fullsized":"2024-09-15T23:21:22.715556+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:00.080011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.717406+0000","last_change":"2024-09-15T23:21:21.733268+0000","last_active":"2024-09-15T23:21:22.717406+0000","last_peered":"2024-09-15T23:21:22.717406+0000","last_clean":"2024-09-15T23:21:22.717406+0000","last_became_active":"2024-09-15T23:21:21.733003+0000","last_became_peered":"2024-09-15T23:21:21.733003+0000","last_unstale":"2024-09-15T23:21:22.717406+0000","last_undegraded":"2024-09-15T23:21:22.717406+0000","last_fullsized":"2024-09-15T23:21:22.717406+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:27.535113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":440,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.719463+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:21:22.719463+0000","last_peered":"2024-09-15T23:21:22.719463+0000","last_clean":"2024-09-15T23:21:22.719463+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:21:22.719463+0000","last_undegraded":"2024-09-15T23:21:22.719463+0000","last_fullsized":"2024-09-15T23:21:22.719463+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":56,"acting":56,"num_store_stats":4},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2286,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476854,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55448,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316392,"statfs":{"total":96636764160,"available":96579985408,"internally_reserved":0,"allocated":2097152,"data_stored":921286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476851,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55416,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316424,"statfs":{"total":96636764160,"available":96580018176,"internally_reserved":0,"allocated":2068480,"data_stored":912877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51840,"kb_used_data":2600,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320000,"statfs":{"total":96636764160,"available":96583680000,"internally_reserved":0,"allocated":2662400,"data_stored":1503245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476853,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29072,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342768,"statfs":{"total":96636764160,"available":96606994432,"internally_reserved":0,"allocated":2084864,"data_stored":919722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29040,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342800,"statfs":{"total":96636764160,"available":96607027200,"internally_reserved":0,"allocated":2056192,"data_stored":906602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51236,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320604,"statfs":{"total":96636764160,"available":96584298496,"internally_reserved":0,"allocated":2043904,"data_stored":900785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542258,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55992,"kb_used_data":2588,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315848,"statfs":{"total":96636764160,"available":96579428352,"internally_reserved":0,"allocated":2650112,"data_stored":1496970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55412,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316428,"statfs":{"total":96636764160,"available":96580022272,"internally_reserved":0,"allocated":2056192,"data_stored":906602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:21:26.331 INFO:tasks.ceph.ceph_manager.ceph:PG 23.3c is not active+clean 2024-09-15T23:21:26.331 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:21:21.708561+0000', 'last_change': '2024-09-15T23:21:21.708561+0000', 'last_active': '2024-09-15T23:21:21.708561+0000', 'last_peered': '2024-09-15T23:21:21.708561+0000', 'last_clean': '2024-09-15T23:21:21.708561+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:21.708561+0000', 'last_undegraded': '2024-09-15T23:21:21.708561+0000', 'last_fullsized': '2024-09-15T23:21:21.708561+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:21:26.331 INFO:tasks.ceph.ceph_manager.ceph:PG 23.3a is not active+clean 2024-09-15T23:21:26.331 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:21:21.708561+0000', 'last_change': '2024-09-15T23:21:21.708561+0000', 'last_active': '2024-09-15T23:21:21.708561+0000', 'last_peered': '2024-09-15T23:21:21.708561+0000', 'last_clean': '2024-09-15T23:21:21.708561+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:21.708561+0000', 'last_undegraded': '2024-09-15T23:21:21.708561+0000', 'last_fullsized': '2024-09-15T23:21:21.708561+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:21:26.331 INFO:tasks.ceph.ceph_manager.ceph:PG 23.39 is not active+clean 2024-09-15T23:21:26.332 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:21:21.708561+0000', 'last_change': '2024-09-15T23:21:21.708561+0000', 'last_active': '2024-09-15T23:21:21.708561+0000', 'last_peered': '2024-09-15T23:21:21.708561+0000', 'last_clean': '2024-09-15T23:21:21.708561+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:21.708561+0000', 'last_undegraded': '2024-09-15T23:21:21.708561+0000', 'last_fullsized': '2024-09-15T23:21:21.708561+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:21:26.332 INFO:tasks.ceph.ceph_manager.ceph:PG 23.30 is not active+clean 2024-09-15T23:21:26.332 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:21:21.708561+0000', 'last_change': '2024-09-15T23:21:21.708561+0000', 'last_active': '2024-09-15T23:21:21.708561+0000', 'last_peered': '2024-09-15T23:21:21.708561+0000', 'last_clean': '2024-09-15T23:21:21.708561+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:21.708561+0000', 'last_undegraded': '2024-09-15T23:21:21.708561+0000', 'last_fullsized': '2024-09-15T23:21:21.708561+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:21:26.332 INFO:tasks.ceph.ceph_manager.ceph:PG 23.2f is not active+clean 2024-09-15T23:21:26.332 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:21:21.708561+0000', 'last_change': '2024-09-15T23:21:21.708561+0000', 'last_active': '2024-09-15T23:21:21.708561+0000', 'last_peered': '2024-09-15T23:21:21.708561+0000', 'last_clean': '2024-09-15T23:21:21.708561+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:21.708561+0000', 'last_undegraded': '2024-09-15T23:21:21.708561+0000', 'last_fullsized': '2024-09-15T23:21:21.708561+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:21:26.332 INFO:tasks.ceph.ceph_manager.ceph:PG 23.2e is not active+clean 2024-09-15T23:21:26.332 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:21:21.708561+0000', 'last_change': '2024-09-15T23:21:21.708561+0000', 'last_active': '2024-09-15T23:21:21.708561+0000', 'last_peered': '2024-09-15T23:21:21.708561+0000', 'last_clean': '2024-09-15T23:21:21.708561+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:21.708561+0000', 'last_undegraded': '2024-09-15T23:21:21.708561+0000', 'last_fullsized': '2024-09-15T23:21:21.708561+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:21:26.332 INFO:tasks.ceph.ceph_manager.ceph:PG 23.2d is not active+clean 2024-09-15T23:21:26.332 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:21:21.708561+0000', 'last_change': '2024-09-15T23:21:21.708561+0000', 'last_active': '2024-09-15T23:21:21.708561+0000', 'last_peered': '2024-09-15T23:21:21.708561+0000', 'last_clean': '2024-09-15T23:21:21.708561+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:21.708561+0000', 'last_undegraded': '2024-09-15T23:21:21.708561+0000', 'last_fullsized': '2024-09-15T23:21:21.708561+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:21:26.332 INFO:tasks.ceph.ceph_manager.ceph:PG 23.2b is not active+clean 2024-09-15T23:21:26.332 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:21:21.708561+0000', 'last_change': '2024-09-15T23:21:21.708561+0000', 'last_active': '2024-09-15T23:21:21.708561+0000', 'last_peered': '2024-09-15T23:21:21.708561+0000', 'last_clean': '2024-09-15T23:21:21.708561+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:21.708561+0000', 'last_undegraded': '2024-09-15T23:21:21.708561+0000', 'last_fullsized': '2024-09-15T23:21:21.708561+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:21:26.333 INFO:tasks.ceph.ceph_manager.ceph:PG 23.29 is not active+clean 2024-09-15T23:21:26.333 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:21:21.708561+0000', 'last_change': '2024-09-15T23:21:21.708561+0000', 'last_active': '2024-09-15T23:21:21.708561+0000', 'last_peered': '2024-09-15T23:21:21.708561+0000', 'last_clean': '2024-09-15T23:21:21.708561+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:21.708561+0000', 'last_undegraded': '2024-09-15T23:21:21.708561+0000', 'last_fullsized': '2024-09-15T23:21:21.708561+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:21:26.333 INFO:tasks.ceph.ceph_manager.ceph:PG 23.26 is not active+clean 2024-09-15T23:21:26.333 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:21:21.708561+0000', 'last_change': '2024-09-15T23:21:21.708561+0000', 'last_active': '2024-09-15T23:21:21.708561+0000', 'last_peered': '2024-09-15T23:21:21.708561+0000', 'last_clean': '2024-09-15T23:21:21.708561+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:21.708561+0000', 'last_undegraded': '2024-09-15T23:21:21.708561+0000', 'last_fullsized': '2024-09-15T23:21:21.708561+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:21:26.333 INFO:tasks.ceph.ceph_manager.ceph:PG 23.24 is not active+clean 2024-09-15T23:21:26.333 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:21:21.708561+0000', 'last_change': '2024-09-15T23:21:21.708561+0000', 'last_active': '2024-09-15T23:21:21.708561+0000', 'last_peered': '2024-09-15T23:21:21.708561+0000', 'last_clean': '2024-09-15T23:21:21.708561+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:21.708561+0000', 'last_undegraded': '2024-09-15T23:21:21.708561+0000', 'last_fullsized': '2024-09-15T23:21:21.708561+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:21:26.333 INFO:tasks.ceph.ceph_manager.ceph:PG 23.20 is not active+clean 2024-09-15T23:21:26.333 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:21:21.708561+0000', 'last_change': '2024-09-15T23:21:21.708561+0000', 'last_active': '2024-09-15T23:21:21.708561+0000', 'last_peered': '2024-09-15T23:21:21.708561+0000', 'last_clean': '2024-09-15T23:21:21.708561+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:21.708561+0000', 'last_undegraded': '2024-09-15T23:21:21.708561+0000', 'last_fullsized': '2024-09-15T23:21:21.708561+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:21:26.333 INFO:tasks.ceph.ceph_manager.ceph:PG 23.1e is not active+clean 2024-09-15T23:21:26.333 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:21:21.708561+0000', 'last_change': '2024-09-15T23:21:21.708561+0000', 'last_active': '2024-09-15T23:21:21.708561+0000', 'last_peered': '2024-09-15T23:21:21.708561+0000', 'last_clean': '2024-09-15T23:21:21.708561+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:21.708561+0000', 'last_undegraded': '2024-09-15T23:21:21.708561+0000', 'last_fullsized': '2024-09-15T23:21:21.708561+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:21:26.333 INFO:tasks.ceph.ceph_manager.ceph:PG 23.1c is not active+clean 2024-09-15T23:21:26.334 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:21:21.708561+0000', 'last_change': '2024-09-15T23:21:21.708561+0000', 'last_active': '2024-09-15T23:21:21.708561+0000', 'last_peered': '2024-09-15T23:21:21.708561+0000', 'last_clean': '2024-09-15T23:21:21.708561+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:21.708561+0000', 'last_undegraded': '2024-09-15T23:21:21.708561+0000', 'last_fullsized': '2024-09-15T23:21:21.708561+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:21:26.334 INFO:tasks.ceph.ceph_manager.ceph:PG 22.1d is not active+clean 2024-09-15T23:21:26.334 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:21:20.713977+0000', 'last_change': '2024-09-15T23:21:20.713977+0000', 'last_active': '2024-09-15T23:21:20.706905+0000', 'last_peered': '2024-09-15T23:21:20.706905+0000', 'last_clean': '2024-09-15T23:21:20.706905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:20.713977+0000', 'last_undegraded': '2024-09-15T23:21:20.713977+0000', 'last_fullsized': '2024-09-15T23:21:20.713977+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T23:21:26.334 INFO:tasks.ceph.ceph_manager.ceph:PG 22.1c is not active+clean 2024-09-15T23:21:26.334 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:21:20.719297+0000', 'last_change': '2024-09-15T23:21:20.719297+0000', 'last_active': '2024-09-15T23:21:20.706905+0000', 'last_peered': '2024-09-15T23:21:20.706905+0000', 'last_clean': '2024-09-15T23:21:20.706905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:20.719297+0000', 'last_undegraded': '2024-09-15T23:21:20.719297+0000', 'last_fullsized': '2024-09-15T23:21:20.719297+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T23:21:26.334 INFO:tasks.ceph.ceph_manager.ceph:PG 23.1a is not active+clean 2024-09-15T23:21:26.334 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:21:21.708561+0000', 'last_change': '2024-09-15T23:21:21.708561+0000', 'last_active': '2024-09-15T23:21:21.708561+0000', 'last_peered': '2024-09-15T23:21:21.708561+0000', 'last_clean': '2024-09-15T23:21:21.708561+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:21.708561+0000', 'last_undegraded': '2024-09-15T23:21:21.708561+0000', 'last_fullsized': '2024-09-15T23:21:21.708561+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:21:26.334 INFO:tasks.ceph.ceph_manager.ceph:PG 23.1b is not active+clean 2024-09-15T23:21:26.334 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:21:21.708561+0000', 'last_change': '2024-09-15T23:21:21.708561+0000', 'last_active': '2024-09-15T23:21:21.708561+0000', 'last_peered': '2024-09-15T23:21:21.708561+0000', 'last_clean': '2024-09-15T23:21:21.708561+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:21.708561+0000', 'last_undegraded': '2024-09-15T23:21:21.708561+0000', 'last_fullsized': '2024-09-15T23:21:21.708561+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:21:26.334 INFO:tasks.ceph.ceph_manager.ceph:PG 22.1a is not active+clean 2024-09-15T23:21:26.334 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:21:20.716844+0000', 'last_change': '2024-09-15T23:21:20.716844+0000', 'last_active': '2024-09-15T23:21:20.706905+0000', 'last_peered': '2024-09-15T23:21:20.706905+0000', 'last_clean': '2024-09-15T23:21:20.706905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:20.716844+0000', 'last_undegraded': '2024-09-15T23:21:20.716844+0000', 'last_fullsized': '2024-09-15T23:21:20.716844+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T23:21:26.335 INFO:tasks.ceph.ceph_manager.ceph:PG 23.18 is not active+clean 2024-09-15T23:21:26.335 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:21:21.708561+0000', 'last_change': '2024-09-15T23:21:21.708561+0000', 'last_active': '2024-09-15T23:21:21.708561+0000', 'last_peered': '2024-09-15T23:21:21.708561+0000', 'last_clean': '2024-09-15T23:21:21.708561+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:21.708561+0000', 'last_undegraded': '2024-09-15T23:21:21.708561+0000', 'last_fullsized': '2024-09-15T23:21:21.708561+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:21:26.335 INFO:tasks.ceph.ceph_manager.ceph:PG 23.19 is not active+clean 2024-09-15T23:21:26.335 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:21:21.708561+0000', 'last_change': '2024-09-15T23:21:21.708561+0000', 'last_active': '2024-09-15T23:21:21.708561+0000', 'last_peered': '2024-09-15T23:21:21.708561+0000', 'last_clean': '2024-09-15T23:21:21.708561+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:21.708561+0000', 'last_undegraded': '2024-09-15T23:21:21.708561+0000', 'last_fullsized': '2024-09-15T23:21:21.708561+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:21:26.335 INFO:tasks.ceph.ceph_manager.ceph:PG 22.18 is not active+clean 2024-09-15T23:21:26.335 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:21:20.717982+0000', 'last_change': '2024-09-15T23:21:20.717982+0000', 'last_active': '2024-09-15T23:21:20.706905+0000', 'last_peered': '2024-09-15T23:21:20.706905+0000', 'last_clean': '2024-09-15T23:21:20.706905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:20.717982+0000', 'last_undegraded': '2024-09-15T23:21:20.717982+0000', 'last_fullsized': '2024-09-15T23:21:20.717982+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T23:21:26.335 INFO:tasks.ceph.ceph_manager.ceph:PG 23.17 is not active+clean 2024-09-15T23:21:26.335 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:21:21.708561+0000', 'last_change': '2024-09-15T23:21:21.708561+0000', 'last_active': '2024-09-15T23:21:21.708561+0000', 'last_peered': '2024-09-15T23:21:21.708561+0000', 'last_clean': '2024-09-15T23:21:21.708561+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:21.708561+0000', 'last_undegraded': '2024-09-15T23:21:21.708561+0000', 'last_fullsized': '2024-09-15T23:21:21.708561+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:21:26.335 INFO:tasks.ceph.ceph_manager.ceph:PG 22.16 is not active+clean 2024-09-15T23:21:26.335 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:21:20.713984+0000', 'last_change': '2024-09-15T23:21:20.713984+0000', 'last_active': '2024-09-15T23:21:20.706905+0000', 'last_peered': '2024-09-15T23:21:20.706905+0000', 'last_clean': '2024-09-15T23:21:20.706905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:20.713984+0000', 'last_undegraded': '2024-09-15T23:21:20.713984+0000', 'last_fullsized': '2024-09-15T23:21:20.713984+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T23:21:26.335 INFO:tasks.ceph.ceph_manager.ceph:PG 23.14 is not active+clean 2024-09-15T23:21:26.335 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:21:21.708561+0000', 'last_change': '2024-09-15T23:21:21.708561+0000', 'last_active': '2024-09-15T23:21:21.708561+0000', 'last_peered': '2024-09-15T23:21:21.708561+0000', 'last_clean': '2024-09-15T23:21:21.708561+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:21.708561+0000', 'last_undegraded': '2024-09-15T23:21:21.708561+0000', 'last_fullsized': '2024-09-15T23:21:21.708561+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:21:26.336 INFO:tasks.ceph.ceph_manager.ceph:PG 22.15 is not active+clean 2024-09-15T23:21:26.336 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:21:20.718425+0000', 'last_change': '2024-09-15T23:21:20.718425+0000', 'last_active': '2024-09-15T23:21:20.706905+0000', 'last_peered': '2024-09-15T23:21:20.706905+0000', 'last_clean': '2024-09-15T23:21:20.706905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:20.718425+0000', 'last_undegraded': '2024-09-15T23:21:20.718425+0000', 'last_fullsized': '2024-09-15T23:21:20.718425+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T23:21:26.336 INFO:tasks.ceph.ceph_manager.ceph:PG 23.12 is not active+clean 2024-09-15T23:21:26.336 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:21:21.708561+0000', 'last_change': '2024-09-15T23:21:21.708561+0000', 'last_active': '2024-09-15T23:21:21.708561+0000', 'last_peered': '2024-09-15T23:21:21.708561+0000', 'last_clean': '2024-09-15T23:21:21.708561+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:21.708561+0000', 'last_undegraded': '2024-09-15T23:21:21.708561+0000', 'last_fullsized': '2024-09-15T23:21:21.708561+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:21:26.336 INFO:tasks.ceph.ceph_manager.ceph:PG 22.13 is not active+clean 2024-09-15T23:21:26.336 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:21:20.716832+0000', 'last_change': '2024-09-15T23:21:20.716832+0000', 'last_active': '2024-09-15T23:21:20.706905+0000', 'last_peered': '2024-09-15T23:21:20.706905+0000', 'last_clean': '2024-09-15T23:21:20.706905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:20.716832+0000', 'last_undegraded': '2024-09-15T23:21:20.716832+0000', 'last_fullsized': '2024-09-15T23:21:20.716832+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T23:21:26.336 INFO:tasks.ceph.ceph_manager.ceph:PG 23.13 is not active+clean 2024-09-15T23:21:26.336 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:21:21.708561+0000', 'last_change': '2024-09-15T23:21:21.708561+0000', 'last_active': '2024-09-15T23:21:21.708561+0000', 'last_peered': '2024-09-15T23:21:21.708561+0000', 'last_clean': '2024-09-15T23:21:21.708561+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:21.708561+0000', 'last_undegraded': '2024-09-15T23:21:21.708561+0000', 'last_fullsized': '2024-09-15T23:21:21.708561+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:21:26.336 INFO:tasks.ceph.ceph_manager.ceph:PG 22.12 is not active+clean 2024-09-15T23:21:26.336 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:21:20.713926+0000', 'last_change': '2024-09-15T23:21:20.713926+0000', 'last_active': '2024-09-15T23:21:20.706905+0000', 'last_peered': '2024-09-15T23:21:20.706905+0000', 'last_clean': '2024-09-15T23:21:20.706905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:20.713926+0000', 'last_undegraded': '2024-09-15T23:21:20.713926+0000', 'last_fullsized': '2024-09-15T23:21:20.713926+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T23:21:26.336 INFO:tasks.ceph.ceph_manager.ceph:PG 23.10 is not active+clean 2024-09-15T23:21:26.336 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:21:21.708561+0000', 'last_change': '2024-09-15T23:21:21.708561+0000', 'last_active': '2024-09-15T23:21:21.708561+0000', 'last_peered': '2024-09-15T23:21:21.708561+0000', 'last_clean': '2024-09-15T23:21:21.708561+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:21.708561+0000', 'last_undegraded': '2024-09-15T23:21:21.708561+0000', 'last_fullsized': '2024-09-15T23:21:21.708561+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:21:26.337 INFO:tasks.ceph.ceph_manager.ceph:PG 22.11 is not active+clean 2024-09-15T23:21:26.337 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:21:20.717947+0000', 'last_change': '2024-09-15T23:21:20.717947+0000', 'last_active': '2024-09-15T23:21:20.706905+0000', 'last_peered': '2024-09-15T23:21:20.706905+0000', 'last_clean': '2024-09-15T23:21:20.706905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:20.717947+0000', 'last_undegraded': '2024-09-15T23:21:20.717947+0000', 'last_fullsized': '2024-09-15T23:21:20.717947+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T23:21:26.337 INFO:tasks.ceph.ceph_manager.ceph:PG 23.e is not active+clean 2024-09-15T23:21:26.337 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:21:21.708561+0000', 'last_change': '2024-09-15T23:21:21.708561+0000', 'last_active': '2024-09-15T23:21:21.708561+0000', 'last_peered': '2024-09-15T23:21:21.708561+0000', 'last_clean': '2024-09-15T23:21:21.708561+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:21.708561+0000', 'last_undegraded': '2024-09-15T23:21:21.708561+0000', 'last_fullsized': '2024-09-15T23:21:21.708561+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:21:26.337 INFO:tasks.ceph.ceph_manager.ceph:PG 23.f is not active+clean 2024-09-15T23:21:26.337 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:21:21.708561+0000', 'last_change': '2024-09-15T23:21:21.708561+0000', 'last_active': '2024-09-15T23:21:21.708561+0000', 'last_peered': '2024-09-15T23:21:21.708561+0000', 'last_clean': '2024-09-15T23:21:21.708561+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:21.708561+0000', 'last_undegraded': '2024-09-15T23:21:21.708561+0000', 'last_fullsized': '2024-09-15T23:21:21.708561+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:21:26.337 INFO:tasks.ceph.ceph_manager.ceph:PG 23.c is not active+clean 2024-09-15T23:21:26.337 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:21:21.708561+0000', 'last_change': '2024-09-15T23:21:21.708561+0000', 'last_active': '2024-09-15T23:21:21.708561+0000', 'last_peered': '2024-09-15T23:21:21.708561+0000', 'last_clean': '2024-09-15T23:21:21.708561+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:21.708561+0000', 'last_undegraded': '2024-09-15T23:21:21.708561+0000', 'last_fullsized': '2024-09-15T23:21:21.708561+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:21:26.337 INFO:tasks.ceph.ceph_manager.ceph:PG 23.d is not active+clean 2024-09-15T23:21:26.337 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:21:21.708561+0000', 'last_change': '2024-09-15T23:21:21.708561+0000', 'last_active': '2024-09-15T23:21:21.708561+0000', 'last_peered': '2024-09-15T23:21:21.708561+0000', 'last_clean': '2024-09-15T23:21:21.708561+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:21.708561+0000', 'last_undegraded': '2024-09-15T23:21:21.708561+0000', 'last_fullsized': '2024-09-15T23:21:21.708561+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:21:26.337 INFO:tasks.ceph.ceph_manager.ceph:PG 22.b is not active+clean 2024-09-15T23:21:26.338 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:21:20.718048+0000', 'last_change': '2024-09-15T23:21:20.718048+0000', 'last_active': '2024-09-15T23:21:20.706905+0000', 'last_peered': '2024-09-15T23:21:20.706905+0000', 'last_clean': '2024-09-15T23:21:20.706905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:20.718048+0000', 'last_undegraded': '2024-09-15T23:21:20.718048+0000', 'last_fullsized': '2024-09-15T23:21:20.718048+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T23:21:26.338 INFO:tasks.ceph.ceph_manager.ceph:PG 23.b is not active+clean 2024-09-15T23:21:26.338 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:21:21.708561+0000', 'last_change': '2024-09-15T23:21:21.708561+0000', 'last_active': '2024-09-15T23:21:21.708561+0000', 'last_peered': '2024-09-15T23:21:21.708561+0000', 'last_clean': '2024-09-15T23:21:21.708561+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:21.708561+0000', 'last_undegraded': '2024-09-15T23:21:21.708561+0000', 'last_fullsized': '2024-09-15T23:21:21.708561+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:21:26.338 INFO:tasks.ceph.ceph_manager.ceph:PG 22.9 is not active+clean 2024-09-15T23:21:26.338 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:21:20.716832+0000', 'last_change': '2024-09-15T23:21:20.716832+0000', 'last_active': '2024-09-15T23:21:20.706905+0000', 'last_peered': '2024-09-15T23:21:20.706905+0000', 'last_clean': '2024-09-15T23:21:20.706905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:20.716832+0000', 'last_undegraded': '2024-09-15T23:21:20.716832+0000', 'last_fullsized': '2024-09-15T23:21:20.716832+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T23:21:26.338 INFO:tasks.ceph.ceph_manager.ceph:PG 23.9 is not active+clean 2024-09-15T23:21:26.338 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:21:21.708561+0000', 'last_change': '2024-09-15T23:21:21.708561+0000', 'last_active': '2024-09-15T23:21:21.708561+0000', 'last_peered': '2024-09-15T23:21:21.708561+0000', 'last_clean': '2024-09-15T23:21:21.708561+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:21.708561+0000', 'last_undegraded': '2024-09-15T23:21:21.708561+0000', 'last_fullsized': '2024-09-15T23:21:21.708561+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:21:26.338 INFO:tasks.ceph.ceph_manager.ceph:PG 23.6 is not active+clean 2024-09-15T23:21:26.338 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:21:21.708561+0000', 'last_change': '2024-09-15T23:21:21.708561+0000', 'last_active': '2024-09-15T23:21:21.708561+0000', 'last_peered': '2024-09-15T23:21:21.708561+0000', 'last_clean': '2024-09-15T23:21:21.708561+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:21.708561+0000', 'last_undegraded': '2024-09-15T23:21:21.708561+0000', 'last_fullsized': '2024-09-15T23:21:21.708561+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:21:26.338 INFO:tasks.ceph.ceph_manager.ceph:PG 22.7 is not active+clean 2024-09-15T23:21:26.338 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:21:20.713993+0000', 'last_change': '2024-09-15T23:21:20.713993+0000', 'last_active': '2024-09-15T23:21:20.706905+0000', 'last_peered': '2024-09-15T23:21:20.706905+0000', 'last_clean': '2024-09-15T23:21:20.706905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:20.713993+0000', 'last_undegraded': '2024-09-15T23:21:20.713993+0000', 'last_fullsized': '2024-09-15T23:21:20.713993+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T23:21:26.339 INFO:tasks.ceph.ceph_manager.ceph:PG 23.7 is not active+clean 2024-09-15T23:21:26.339 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:21:21.708561+0000', 'last_change': '2024-09-15T23:21:21.708561+0000', 'last_active': '2024-09-15T23:21:21.708561+0000', 'last_peered': '2024-09-15T23:21:21.708561+0000', 'last_clean': '2024-09-15T23:21:21.708561+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:21.708561+0000', 'last_undegraded': '2024-09-15T23:21:21.708561+0000', 'last_fullsized': '2024-09-15T23:21:21.708561+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:21:26.339 INFO:tasks.ceph.ceph_manager.ceph:PG 23.4 is not active+clean 2024-09-15T23:21:26.339 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:21:21.708561+0000', 'last_change': '2024-09-15T23:21:21.708561+0000', 'last_active': '2024-09-15T23:21:21.708561+0000', 'last_peered': '2024-09-15T23:21:21.708561+0000', 'last_clean': '2024-09-15T23:21:21.708561+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:21.708561+0000', 'last_undegraded': '2024-09-15T23:21:21.708561+0000', 'last_fullsized': '2024-09-15T23:21:21.708561+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:21:26.339 INFO:tasks.ceph.ceph_manager.ceph:PG 23.5 is not active+clean 2024-09-15T23:21:26.339 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:21:21.708561+0000', 'last_change': '2024-09-15T23:21:21.708561+0000', 'last_active': '2024-09-15T23:21:21.708561+0000', 'last_peered': '2024-09-15T23:21:21.708561+0000', 'last_clean': '2024-09-15T23:21:21.708561+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:21.708561+0000', 'last_undegraded': '2024-09-15T23:21:21.708561+0000', 'last_fullsized': '2024-09-15T23:21:21.708561+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:21:26.339 INFO:tasks.ceph.ceph_manager.ceph:PG 22.4 is not active+clean 2024-09-15T23:21:26.339 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:21:20.718894+0000', 'last_change': '2024-09-15T23:21:20.718894+0000', 'last_active': '2024-09-15T23:21:20.706905+0000', 'last_peered': '2024-09-15T23:21:20.706905+0000', 'last_clean': '2024-09-15T23:21:20.706905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:20.718894+0000', 'last_undegraded': '2024-09-15T23:21:20.718894+0000', 'last_fullsized': '2024-09-15T23:21:20.718894+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T23:21:26.339 INFO:tasks.ceph.ceph_manager.ceph:PG 23.2 is not active+clean 2024-09-15T23:21:26.339 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:21:21.708561+0000', 'last_change': '2024-09-15T23:21:21.708561+0000', 'last_active': '2024-09-15T23:21:21.708561+0000', 'last_peered': '2024-09-15T23:21:21.708561+0000', 'last_clean': '2024-09-15T23:21:21.708561+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:21.708561+0000', 'last_undegraded': '2024-09-15T23:21:21.708561+0000', 'last_fullsized': '2024-09-15T23:21:21.708561+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:21:26.339 INFO:tasks.ceph.ceph_manager.ceph:PG 22.2 is not active+clean 2024-09-15T23:21:26.340 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '22.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 165, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:21:20.719106+0000', 'last_change': '2024-09-15T23:21:20.719106+0000', 'last_active': '2024-09-15T23:21:20.706905+0000', 'last_peered': '2024-09-15T23:21:20.706905+0000', 'last_clean': '2024-09-15T23:21:20.706905+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:20.719106+0000', 'last_undegraded': '2024-09-15T23:21:20.719106+0000', 'last_fullsized': '2024-09-15T23:21:20.719106+0000', 'mapping_epoch': 165, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 165, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:20.706905+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T23:21:26.340 INFO:tasks.ceph.ceph_manager.ceph:PG 23.0 is not active+clean 2024-09-15T23:21:26.340 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:21:21.708561+0000', 'last_change': '2024-09-15T23:21:21.708561+0000', 'last_active': '2024-09-15T23:21:21.708561+0000', 'last_peered': '2024-09-15T23:21:21.708561+0000', 'last_clean': '2024-09-15T23:21:21.708561+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:21.708561+0000', 'last_undegraded': '2024-09-15T23:21:21.708561+0000', 'last_fullsized': '2024-09-15T23:21:21.708561+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:21:26.340 INFO:tasks.ceph.ceph_manager.ceph:PG 23.16 is not active+clean 2024-09-15T23:21:26.340 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:21:21.708561+0000', 'last_change': '2024-09-15T23:21:21.708561+0000', 'last_active': '2024-09-15T23:21:21.708561+0000', 'last_peered': '2024-09-15T23:21:21.708561+0000', 'last_clean': '2024-09-15T23:21:21.708561+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:21:21.708561+0000', 'last_undegraded': '2024-09-15T23:21:21.708561+0000', 'last_fullsized': '2024-09-15T23:21:21.708561+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'last_clean_scrub_stamp': '2024-09-15T23:21:21.708561+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:21:26.340 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:21:26.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.464+0000 7f46d4f4b640 1 Processor -- start 2024-09-15T23:21:26.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.464+0000 7f46d4f4b640 1 -- start start 2024-09-15T23:21:26.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.465+0000 7f46d4f4b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f46d006c320 0x7f46d015bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:26.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.465+0000 7f46d4f4b640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46d0071180 con 0x7f46d013eb20 2024-09-15T23:21:26.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.465+0000 7f46d4f4b640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46d0071460 con 0x7f46d00b2d40 2024-09-15T23:21:26.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.465+0000 7f46d4f4b640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f46d0071ab0 con 0x7f46d006c320 2024-09-15T23:21:26.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.465+0000 7f46cdd9b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f46d006c320 0x7f46d015bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:26.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.465+0000 7f46cdd9b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f46d006c320 0x7f46d015bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57716/0 (socket says 172.21.15.123:57716) 2024-09-15T23:21:26.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.465+0000 7f46cdd9b640 1 -- 172.21.15.123:0/4233366808 learned_addr learned my addr 172.21.15.123:0/4233366808 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:26.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.465+0000 7f46ced9d640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f46d013eb20 0x7f46d015c230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49596/0 (socket says 172.21.15.123:49596) 2024-09-15T23:21:26.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.465+0000 7f46cdd9b640 1 -- 172.21.15.123:0/4233366808 >> v1:172.21.15.188:6789/0 conn(0x7f46d00b2d40 legacy=0x7f46d006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:26.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.465+0000 7f46cdd9b640 1 -- 172.21.15.123:0/4233366808 >> v1:172.21.15.123:6789/0 conn(0x7f46d013eb20 legacy=0x7f46d015c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:26.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.465+0000 7f46cdd9b640 1 -- 172.21.15.123:0/4233366808 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46d0071740 con 0x7f46d006c320 2024-09-15T23:21:26.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.466+0000 7f46cdd9b640 1 --2- 172.21.15.123:0/4233366808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46d006c320 0x7f46d015bcf0 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f46b800bb10 tx=0x7f46b802c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b27d8601d3eff70 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:26.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.466+0000 7f46cd59a640 1 -- 172.21.15.123:0/4233366808 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b8036020 con 0x7f46d006c320 2024-09-15T23:21:26.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.466+0000 7f46cd59a640 1 -- 172.21.15.123:0/4233366808 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46b8032820 con 0x7f46d006c320 2024-09-15T23:21:26.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.466+0000 7f46cd59a640 1 -- 172.21.15.123:0/4233366808 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b8032bf0 con 0x7f46d006c320 2024-09-15T23:21:26.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.466+0000 7f46d4f4b640 1 -- 172.21.15.123:0/4233366808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46d006c320 msgr2=0x7f46d015bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:26.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.466+0000 7f46d4f4b640 1 --2- 172.21.15.123:0/4233366808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46d006c320 0x7f46d015bcf0 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f46b800bb10 tx=0x7f46b802c960 comp rx=0 tx=0).stop 2024-09-15T23:21:26.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.466+0000 7f46d4f4b640 1 -- 172.21.15.123:0/4233366808 shutdown_connections 2024-09-15T23:21:26.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.466+0000 7f46d4f4b640 1 --2- 172.21.15.123:0/4233366808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46d006c320 0x7f46d015bcf0 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:26.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.466+0000 7f46d4f4b640 1 -- 172.21.15.123:0/4233366808 >> 172.21.15.123:0/4233366808 conn(0x7f46d00ccec0 msgr2=0x7f46d00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:26.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.467+0000 7f46d4f4b640 1 -- 172.21.15.123:0/4233366808 shutdown_connections 2024-09-15T23:21:26.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.467+0000 7f46d4f4b640 1 -- 172.21.15.123:0/4233366808 wait complete. 2024-09-15T23:21:26.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.468+0000 7f46d4f4b640 1 Processor -- start 2024-09-15T23:21:26.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.468+0000 7f46d4f4b640 1 -- start start 2024-09-15T23:21:26.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.469+0000 7f46d4f4b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46d006c320 0x7f46d013d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:26.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.469+0000 7f46d4f4b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46d00b2d40 0x7f46d00c9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:26.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.469+0000 7f46d4f4b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46d013eb20 0x7f46d00c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:26.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.469+0000 7f46d4f4b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f46d00b3980 con 0x7f46d013eb20 2024-09-15T23:21:26.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.469+0000 7f46d4f4b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f46d00b3800 con 0x7f46d00b2d40 2024-09-15T23:21:26.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.469+0000 7f46d4f4b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f46d00b3b00 con 0x7f46d006c320 2024-09-15T23:21:26.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.469+0000 7f46ced9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46d013eb20 0x7f46d00c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:26.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.469+0000 7f46ced9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46d013eb20 0x7f46d00c9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57722/0 (socket says 172.21.15.123:57722) 2024-09-15T23:21:26.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.469+0000 7f46ced9d640 1 -- 172.21.15.123:0/1373019683 learned_addr learned my addr 172.21.15.123:0/1373019683 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:26.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.469+0000 7f46cdd9b640 1 --2- 172.21.15.123:0/1373019683 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46d00b2d40 0x7f46d00c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:26.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.469+0000 7f46ce59c640 1 --2- 172.21.15.123:0/1373019683 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46d006c320 0x7f46d013d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:26.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.469+0000 7f46ced9d640 1 -- 172.21.15.123:0/1373019683 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46d006c320 msgr2=0x7f46d013d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:26.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.469+0000 7f46ced9d640 1 --2- 172.21.15.123:0/1373019683 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46d006c320 0x7f46d013d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:26.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.469+0000 7f46ced9d640 1 -- 172.21.15.123:0/1373019683 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46d00b2d40 msgr2=0x7f46d00c9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:26.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.469+0000 7f46ced9d640 1 --2- 172.21.15.123:0/1373019683 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46d00b2d40 0x7f46d00c9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:26.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.469+0000 7f46ced9d640 1 -- 172.21.15.123:0/1373019683 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46d013d6d0 con 0x7f46d013eb20 2024-09-15T23:21:26.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.469+0000 7f46cdd9b640 1 --2- 172.21.15.123:0/1373019683 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46d00b2d40 0x7f46d00c9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:21:26.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.469+0000 7f46ce59c640 1 --2- 172.21.15.123:0/1373019683 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46d006c320 0x7f46d013d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:21:26.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.469+0000 7f46ced9d640 1 --2- 172.21.15.123:0/1373019683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46d013eb20 0x7f46d00c9da0 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f46c800c730 tx=0x7f46c800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:26.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.469+0000 7f46c6ffd640 1 -- 172.21.15.123:0/1373019683 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c8017070 con 0x7f46d013eb20 2024-09-15T23:21:26.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.469+0000 7f46c6ffd640 1 -- 172.21.15.123:0/1373019683 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46c800ce40 con 0x7f46d013eb20 2024-09-15T23:21:26.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.469+0000 7f46c6ffd640 1 -- 172.21.15.123:0/1373019683 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c800a840 con 0x7f46d013eb20 2024-09-15T23:21:26.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.469+0000 7f46d4f4b640 1 -- 172.21.15.123:0/1373019683 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46d0157050 con 0x7f46d013eb20 2024-09-15T23:21:26.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.469+0000 7f46d4f4b640 1 -- 172.21.15.123:0/1373019683 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46d0157610 con 0x7f46d013eb20 2024-09-15T23:21:26.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.470+0000 7f46d4f4b640 1 -- 172.21.15.123:0/1373019683 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46d006bc10 con 0x7f46d013eb20 2024-09-15T23:21:26.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.471+0000 7f46c6ffd640 1 -- 172.21.15.123:0/1373019683 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f46c801a070 con 0x7f46d013eb20 2024-09-15T23:21:26.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.471+0000 7f46c6ffd640 1 --2- 172.21.15.123:0/1373019683 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f46b006c2b0 0x7f46b006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:26.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.471+0000 7f46c6ffd640 1 -- 172.21.15.123:0/1373019683 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7f46c808a8d0 con 0x7f46d013eb20 2024-09-15T23:21:26.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.472+0000 7f46ce59c640 1 --2- 172.21.15.123:0/1373019683 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f46b006c2b0 0x7f46b006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:26.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.472+0000 7f46ce59c640 1 --2- 172.21.15.123:0/1373019683 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f46b006c2b0 0x7f46b006e770 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f46c0003eb0 tx=0x7f46c0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:26.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.475+0000 7f46c6ffd640 1 -- 172.21.15.123:0/1373019683 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f46c80589f0 con 0x7f46d013eb20 2024-09-15T23:21:26.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.705+0000 7f46d4f4b640 1 -- 172.21.15.123:0/1373019683 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f46d006c9c0 con 0x7f46d013eb20 2024-09-15T23:21:26.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.706+0000 7f46c6ffd640 1 -- 172.21.15.123:0/1373019683 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1770 (secure 0 0 0) 0x7f46c805ccf0 con 0x7f46d013eb20 2024-09-15T23:21:26.707 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:26.707 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":577,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":168,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":47},{"state_name":"unknown","count":36},{"state_name":"creating+peering","count":14}],"num_pgs":97,"num_pools":3,"num_objects":15,"data_bytes":592654,"bytes_used":392658944,"bytes_avail":772701454336,"bytes_total":773094113280,"unknown_pgs_ratio":0.37113401293754578,"inactive_pgs_ratio":0.14432989060878754,"write_bytes_sec":1248,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":100,"btime":"2024-09-15T23:21:24:727971+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"a","status":"up:active","gid":9564}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-09-15T23:21:01.629595+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T23:21:26.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.707+0000 7f46d4f4b640 1 -- 172.21.15.123:0/1373019683 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f46b006c2b0 msgr2=0x7f46b006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:26.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.707+0000 7f46d4f4b640 1 --2- 172.21.15.123:0/1373019683 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f46b006c2b0 0x7f46b006e770 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f46c0003eb0 tx=0x7f46c0009040 comp rx=0 tx=0).stop 2024-09-15T23:21:26.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.707+0000 7f46d4f4b640 1 -- 172.21.15.123:0/1373019683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46d013eb20 msgr2=0x7f46d00c9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:26.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.707+0000 7f46d4f4b640 1 --2- 172.21.15.123:0/1373019683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46d013eb20 0x7f46d00c9da0 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f46c800c730 tx=0x7f46c800cbf0 comp rx=0 tx=0).stop 2024-09-15T23:21:26.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.707+0000 7f46d4f4b640 1 -- 172.21.15.123:0/1373019683 shutdown_connections 2024-09-15T23:21:26.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.707+0000 7f46d4f4b640 1 --2- 172.21.15.123:0/1373019683 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f46b006c2b0 0x7f46b006e770 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:26.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.707+0000 7f46d4f4b640 1 --2- 172.21.15.123:0/1373019683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46d013eb20 0x7f46d00c9da0 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:26.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.707+0000 7f46d4f4b640 1 --2- 172.21.15.123:0/1373019683 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f46d00b2d40 0x7f46d00c9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:26.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.707+0000 7f46d4f4b640 1 --2- 172.21.15.123:0/1373019683 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f46d006c320 0x7f46d013d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:26.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.707+0000 7f46d4f4b640 1 -- 172.21.15.123:0/1373019683 >> 172.21.15.123:0/1373019683 conn(0x7f46d00ccec0 msgr2=0x7f46d00b5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:26.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.708+0000 7f46d4f4b640 1 -- 172.21.15.123:0/1373019683 shutdown_connections 2024-09-15T23:21:26.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.708+0000 7f46d4f4b640 1 -- 172.21.15.123:0/1373019683 wait complete. 2024-09-15T23:21:26.719 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-15T23:21:26.719 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:21:26.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.817+0000 7f20d8e8d640 1 Processor -- start 2024-09-15T23:21:26.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.817+0000 7f20d8e8d640 1 -- start start 2024-09-15T23:21:26.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.818+0000 7f20d8e8d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f20d406c320 0x7f20d415bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:26.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.818+0000 7f20d8e8d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20d413eb20 0x7f20d415c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:26.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.818+0000 7f20d8e8d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20d4071180 con 0x7f20d40b2d40 2024-09-15T23:21:26.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.818+0000 7f20d8e8d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f20d4071ab0 con 0x7f20d406c320 2024-09-15T23:21:26.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.818+0000 7f20d8e8d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f20d4071460 con 0x7f20d413eb20 2024-09-15T23:21:26.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.818+0000 7f20d1d9b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f20d406c320 0x7f20d415bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:26.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.818+0000 7f20d259c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f20d40b2d40 0x7f20d406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49610/0 (socket says 172.21.15.123:49610) 2024-09-15T23:21:26.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.818+0000 7f20d1d9b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f20d406c320 0x7f20d415bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57734/0 (socket says 172.21.15.123:57734) 2024-09-15T23:21:26.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.818+0000 7f20d259c640 1 -- 172.21.15.123:0/459830654 learned_addr learned my addr 172.21.15.123:0/459830654 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:21:26.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.818+0000 7f20d2d9d640 1 --2- 172.21.15.123:0/459830654 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20d413eb20 0x7f20d415c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:26.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.818+0000 7f20d1d9b640 1 -- 172.21.15.123:0/459830654 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20d413eb20 msgr2=0x7f20d415c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:26.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.818+0000 7f20d1d9b640 1 --2- 172.21.15.123:0/459830654 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20d413eb20 0x7f20d415c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:26.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.818+0000 7f20d1d9b640 1 -- 172.21.15.123:0/459830654 >> v1:172.21.15.123:6789/0 conn(0x7f20d40b2d40 legacy=0x7f20d406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:26.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.818+0000 7f20d159a640 1 -- 172.21.15.123:0/459830654 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3301990021 0 0) 0x7f20d4071180 con 0x7f20d40b2d40 2024-09-15T23:21:26.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.818+0000 7f20d1d9b640 1 -- 172.21.15.123:0/459830654 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d4071740 con 0x7f20d406c320 2024-09-15T23:21:26.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.819+0000 7f20d1d9b640 1 --2- 172.21.15.123:0/459830654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20d406c320 0x7f20d415bcf0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f20bc0097a0 tx=0x7f20bc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5207b030a5631a42 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:26.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.819+0000 7f20d159a640 1 -- 172.21.15.123:0/459830654 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20bc037070 con 0x7f20d406c320 2024-09-15T23:21:26.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.819+0000 7f20d159a640 1 -- 172.21.15.123:0/459830654 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20bc032440 con 0x7f20d406c320 2024-09-15T23:21:26.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.819+0000 7f20d159a640 1 -- 172.21.15.123:0/459830654 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20bc032810 con 0x7f20d406c320 2024-09-15T23:21:26.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.820+0000 7f20d8e8d640 1 -- 172.21.15.123:0/459830654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20d406c320 msgr2=0x7f20d415bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:26.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.820+0000 7f20d8e8d640 1 --2- 172.21.15.123:0/459830654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20d406c320 0x7f20d415bcf0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f20bc0097a0 tx=0x7f20bc02a180 comp rx=0 tx=0).stop 2024-09-15T23:21:26.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.820+0000 7f20d8e8d640 1 -- 172.21.15.123:0/459830654 shutdown_connections 2024-09-15T23:21:26.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.820+0000 7f20d8e8d640 1 --2- 172.21.15.123:0/459830654 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20d413eb20 0x7f20d415c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:26.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.820+0000 7f20d8e8d640 1 --2- 172.21.15.123:0/459830654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20d406c320 0x7f20d415bcf0 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:26.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.820+0000 7f20d8e8d640 1 -- 172.21.15.123:0/459830654 >> 172.21.15.123:0/459830654 conn(0x7f20d40ccec0 msgr2=0x7f20d40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:26.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.820+0000 7f20d8e8d640 1 -- 172.21.15.123:0/459830654 shutdown_connections 2024-09-15T23:21:26.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.820+0000 7f20d8e8d640 1 -- 172.21.15.123:0/459830654 wait complete. 2024-09-15T23:21:26.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.821+0000 7f20d8e8d640 1 Processor -- start 2024-09-15T23:21:26.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.821+0000 7f20d8e8d640 1 -- start start 2024-09-15T23:21:26.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.822+0000 7f20d8e8d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20d406c320 0x7f20d413dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:26.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.822+0000 7f20d8e8d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20d40b2d40 0x7f20d41e63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:26.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.822+0000 7f20d8e8d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20d413eb20 0x7f20d41e6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:26.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.822+0000 7f20d8e8d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f20d40720c0 con 0x7f20d413eb20 2024-09-15T23:21:26.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.822+0000 7f20d8e8d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f20d4071f40 con 0x7f20d406c320 2024-09-15T23:21:26.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.822+0000 7f20d8e8d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f20d4072240 con 0x7f20d40b2d40 2024-09-15T23:21:26.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.822+0000 7f20d2d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20d413eb20 0x7f20d41e6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:26.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.822+0000 7f20d2d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20d413eb20 0x7f20d41e6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57736/0 (socket says 172.21.15.123:57736) 2024-09-15T23:21:26.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.822+0000 7f20d2d9d640 1 -- 172.21.15.123:0/63363973 learned_addr learned my addr 172.21.15.123:0/63363973 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:26.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.822+0000 7f20d259c640 1 --2- 172.21.15.123:0/63363973 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20d406c320 0x7f20d413dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:26.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.822+0000 7f20d1d9b640 1 --2- 172.21.15.123:0/63363973 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20d40b2d40 0x7f20d41e63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:26.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.822+0000 7f20d2d9d640 1 -- 172.21.15.123:0/63363973 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20d40b2d40 msgr2=0x7f20d41e63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:26.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.822+0000 7f20d2d9d640 1 --2- 172.21.15.123:0/63363973 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20d40b2d40 0x7f20d41e63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:26.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.822+0000 7f20d2d9d640 1 -- 172.21.15.123:0/63363973 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20d406c320 msgr2=0x7f20d413dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:26.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.822+0000 7f20d2d9d640 1 --2- 172.21.15.123:0/63363973 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20d406c320 0x7f20d413dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:26.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.822+0000 7f20d2d9d640 1 -- 172.21.15.123:0/63363973 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d40cc120 con 0x7f20d413eb20 2024-09-15T23:21:26.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.822+0000 7f20d2d9d640 1 --2- 172.21.15.123:0/63363973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20d413eb20 0x7f20d41e6910 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f20cc00efc0 tx=0x7f20cc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:26.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.823+0000 7f20caffd640 1 -- 172.21.15.123:0/63363973 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20cc018020 con 0x7f20d413eb20 2024-09-15T23:21:26.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.823+0000 7f20caffd640 1 -- 172.21.15.123:0/63363973 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20cc014480 con 0x7f20d413eb20 2024-09-15T23:21:26.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.823+0000 7f20d8e8d640 1 -- 172.21.15.123:0/63363973 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20d40cc400 con 0x7f20d413eb20 2024-09-15T23:21:26.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.823+0000 7f20caffd640 1 -- 172.21.15.123:0/63363973 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20cc014870 con 0x7f20d413eb20 2024-09-15T23:21:26.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.823+0000 7f20d8e8d640 1 -- 172.21.15.123:0/63363973 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20d40cbdb0 con 0x7f20d413eb20 2024-09-15T23:21:26.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.824+0000 7f20d8e8d640 1 -- 172.21.15.123:0/63363973 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20d40b2810 con 0x7f20d413eb20 2024-09-15T23:21:26.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.824+0000 7f20caffd640 1 -- 172.21.15.123:0/63363973 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f20cc01b020 con 0x7f20d413eb20 2024-09-15T23:21:26.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.825+0000 7f20caffd640 1 --2- 172.21.15.123:0/63363973 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f20b406c2b0 0x7f20b406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:26.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.825+0000 7f20caffd640 1 -- 172.21.15.123:0/63363973 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7f20cc08c0c0 con 0x7f20d413eb20 2024-09-15T23:21:26.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.825+0000 7f20d259c640 1 --2- 172.21.15.123:0/63363973 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f20b406c2b0 0x7f20b406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:26.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.825+0000 7f20d259c640 1 --2- 172.21.15.123:0/63363973 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f20b406c2b0 0x7f20b406e770 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f20c4000f60 tx=0x7f20c4007d50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:26.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.829+0000 7f20caffd640 1 -- 172.21.15.123:0/63363973 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f20d40b2810 con 0x7f20d413eb20 2024-09-15T23:21:26.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.990+0000 7f20d8e8d640 1 -- 172.21.15.123:0/63363973 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f20d406bc10 con 0x7f20b406c2b0 2024-09-15T23:21:26.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.996+0000 7f20caffd640 1 -- 172.21.15.123:0/63363973 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246041 (secure 0 0 0) 0x7f20d406bc10 con 0x7f20b406c2b0 2024-09-15T23:21:27.000 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:27.001 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:21:27.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.999+0000 7f20d8e8d640 1 -- 172.21.15.123:0/63363973 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f20b406c2b0 msgr2=0x7f20b406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:27.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.999+0000 7f20d8e8d640 1 --2- 172.21.15.123:0/63363973 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f20b406c2b0 0x7f20b406e770 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f20c4000f60 tx=0x7f20c4007d50 comp rx=0 tx=0).stop 2024-09-15T23:21:27.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.999+0000 7f20d8e8d640 1 -- 172.21.15.123:0/63363973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20d413eb20 msgr2=0x7f20d41e6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:27.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:26.999+0000 7f20d8e8d640 1 --2- 172.21.15.123:0/63363973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20d413eb20 0x7f20d41e6910 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f20cc00efc0 tx=0x7f20cc00c490 comp rx=0 tx=0).stop 2024-09-15T23:21:27.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:27.000+0000 7f20d8e8d640 1 -- 172.21.15.123:0/63363973 shutdown_connections 2024-09-15T23:21:27.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:27.000+0000 7f20d8e8d640 1 --2- 172.21.15.123:0/63363973 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f20b406c2b0 0x7f20b406e770 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:27.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:27.000+0000 7f20d8e8d640 1 --2- 172.21.15.123:0/63363973 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20d413eb20 0x7f20d41e6910 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:27.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:27.000+0000 7f20d8e8d640 1 --2- 172.21.15.123:0/63363973 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20d40b2d40 0x7f20d41e63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:27.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:27.000+0000 7f20d8e8d640 1 --2- 172.21.15.123:0/63363973 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f20d406c320 0x7f20d413dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:27.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:27.000+0000 7f20d8e8d640 1 -- 172.21.15.123:0/63363973 >> 172.21.15.123:0/63363973 conn(0x7f20d40ccec0 msgr2=0x7f20d413ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:27.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:27.000+0000 7f20d8e8d640 1 -- 172.21.15.123:0/63363973 shutdown_connections 2024-09-15T23:21:27.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:27.000+0000 7f20d8e8d640 1 -- 172.21.15.123:0/63363973 wait complete. 2024-09-15T23:21:27.011 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":443,"stamp":"2024-09-15T23:21:25.634886+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592654,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":186,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":122,"acting":122,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":42,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":383456,"kb_used_data":17304,"kb_used_omap":12,"kb_used_meta":365939,"kb_avail":754591264,"statfs":{"total":773094113280,"available":772701454336,"internally_reserved":0,"allocated":17719296,"data_stored":8468089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":374722096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2286,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.921505"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.741607+0000","last_change":"2024-09-15T23:21:22.726816+0000","last_active":"2024-09-15T23:21:22.741607+0000","last_peered":"2024-09-15T23:21:22.741607+0000","last_clean":"2024-09-15T23:21:22.741607+0000","last_became_active":"2024-09-15T23:21:22.726529+0000","last_became_peered":"2024-09-15T23:21:22.726529+0000","last_unstale":"2024-09-15T23:21:22.741607+0000","last_undegraded":"2024-09-15T23:21:22.741607+0000","last_fullsized":"2024-09-15T23:21:22.741607+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:22:20.946782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.741502+0000","last_change":"2024-09-15T23:21:22.725283+0000","last_active":"2024-09-15T23:21:22.741502+0000","last_peered":"2024-09-15T23:21:22.741502+0000","last_clean":"2024-09-15T23:21:22.741502+0000","last_became_active":"2024-09-15T23:21:22.725020+0000","last_became_peered":"2024-09-15T23:21:22.725020+0000","last_unstale":"2024-09-15T23:21:22.741502+0000","last_undegraded":"2024-09-15T23:21:22.741502+0000","last_fullsized":"2024-09-15T23:21:22.741502+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:01:36.316467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.741521+0000","last_change":"2024-09-15T23:21:22.725523+0000","last_active":"2024-09-15T23:21:22.741521+0000","last_peered":"2024-09-15T23:21:22.741521+0000","last_clean":"2024-09-15T23:21:22.741521+0000","last_became_active":"2024-09-15T23:21:22.723213+0000","last_became_peered":"2024-09-15T23:21:22.723213+0000","last_unstale":"2024-09-15T23:21:22.741521+0000","last_undegraded":"2024-09-15T23:21:22.741521+0000","last_fullsized":"2024-09-15T23:21:22.741521+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:19.979292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.729685+0000","last_change":"2024-09-15T23:21:22.728138+0000","last_active":"2024-09-15T23:21:22.729685+0000","last_peered":"2024-09-15T23:21:22.729685+0000","last_clean":"2024-09-15T23:21:22.729685+0000","last_became_active":"2024-09-15T23:21:22.727856+0000","last_became_peered":"2024-09-15T23:21:22.727856+0000","last_unstale":"2024-09-15T23:21:22.729685+0000","last_undegraded":"2024-09-15T23:21:22.729685+0000","last_fullsized":"2024-09-15T23:21:22.729685+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:12:43.918097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.730449+0000","last_change":"2024-09-15T23:21:22.728181+0000","last_active":"2024-09-15T23:21:22.730449+0000","last_peered":"2024-09-15T23:21:22.730449+0000","last_clean":"2024-09-15T23:21:22.730449+0000","last_became_active":"2024-09-15T23:21:22.727863+0000","last_became_peered":"2024-09-15T23:21:22.727863+0000","last_unstale":"2024-09-15T23:21:22.730449+0000","last_undegraded":"2024-09-15T23:21:22.730449+0000","last_fullsized":"2024-09-15T23:21:22.730449+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:50.794279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.725293+0000","last_change":"2024-09-15T23:21:22.720386+0000","last_active":"2024-09-15T23:21:22.725293+0000","last_peered":"2024-09-15T23:21:22.725293+0000","last_clean":"2024-09-15T23:21:22.725293+0000","last_became_active":"2024-09-15T23:21:22.720114+0000","last_became_peered":"2024-09-15T23:21:22.720114+0000","last_unstale":"2024-09-15T23:21:22.725293+0000","last_undegraded":"2024-09-15T23:21:22.725293+0000","last_fullsized":"2024-09-15T23:21:22.725293+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:36.841290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.725869+0000","last_change":"2024-09-15T23:21:22.723261+0000","last_active":"2024-09-15T23:21:22.725869+0000","last_peered":"2024-09-15T23:21:22.725869+0000","last_clean":"2024-09-15T23:21:22.725869+0000","last_became_active":"2024-09-15T23:21:22.722993+0000","last_became_peered":"2024-09-15T23:21:22.722993+0000","last_unstale":"2024-09-15T23:21:22.725869+0000","last_undegraded":"2024-09-15T23:21:22.725869+0000","last_fullsized":"2024-09-15T23:21:22.725869+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:41:48.886638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.736515+0000","last_change":"2024-09-15T23:21:22.734444+0000","last_active":"2024-09-15T23:21:22.736515+0000","last_peered":"2024-09-15T23:21:22.736515+0000","last_clean":"2024-09-15T23:21:22.736515+0000","last_became_active":"2024-09-15T23:21:22.732810+0000","last_became_peered":"2024-09-15T23:21:22.732810+0000","last_unstale":"2024-09-15T23:21:22.736515+0000","last_undegraded":"2024-09-15T23:21:22.736515+0000","last_fullsized":"2024-09-15T23:21:22.736515+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:36.986973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.734171+0000","last_change":"2024-09-15T23:21:22.730945+0000","last_active":"2024-09-15T23:21:22.734171+0000","last_peered":"2024-09-15T23:21:22.734171+0000","last_clean":"2024-09-15T23:21:22.734171+0000","last_became_active":"2024-09-15T23:21:22.730645+0000","last_became_peered":"2024-09-15T23:21:22.730645+0000","last_unstale":"2024-09-15T23:21:22.734171+0000","last_undegraded":"2024-09-15T23:21:22.734171+0000","last_fullsized":"2024-09-15T23:21:22.734171+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:24:40.008114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.734637+0000","last_change":"2024-09-15T23:21:22.733734+0000","last_active":"2024-09-15T23:21:22.734637+0000","last_peered":"2024-09-15T23:21:22.734637+0000","last_clean":"2024-09-15T23:21:22.734637+0000","last_became_active":"2024-09-15T23:21:22.733441+0000","last_became_peered":"2024-09-15T23:21:22.733441+0000","last_unstale":"2024-09-15T23:21:22.734637+0000","last_undegraded":"2024-09-15T23:21:22.734637+0000","last_fullsized":"2024-09-15T23:21:22.734637+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:50:12.914045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.731172+0000","last_change":"2024-09-15T23:21:22.729776+0000","last_active":"2024-09-15T23:21:22.731172+0000","last_peered":"2024-09-15T23:21:22.731172+0000","last_clean":"2024-09-15T23:21:22.731172+0000","last_became_active":"2024-09-15T23:21:22.728949+0000","last_became_peered":"2024-09-15T23:21:22.728949+0000","last_unstale":"2024-09-15T23:21:22.731172+0000","last_undegraded":"2024-09-15T23:21:22.731172+0000","last_fullsized":"2024-09-15T23:21:22.731172+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:22.338146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.733707+0000","last_change":"2024-09-15T23:21:22.732516+0000","last_active":"2024-09-15T23:21:22.733707+0000","last_peered":"2024-09-15T23:21:22.733707+0000","last_clean":"2024-09-15T23:21:22.733707+0000","last_became_active":"2024-09-15T23:21:22.732251+0000","last_became_peered":"2024-09-15T23:21:22.732251+0000","last_unstale":"2024-09-15T23:21:22.733707+0000","last_undegraded":"2024-09-15T23:21:22.733707+0000","last_fullsized":"2024-09-15T23:21:22.733707+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:01.081667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.734147+0000","last_change":"2024-09-15T23:21:22.726724+0000","last_active":"2024-09-15T23:21:22.734147+0000","last_peered":"2024-09-15T23:21:22.734147+0000","last_clean":"2024-09-15T23:21:22.734147+0000","last_became_active":"2024-09-15T23:21:22.726437+0000","last_became_peered":"2024-09-15T23:21:22.726437+0000","last_unstale":"2024-09-15T23:21:22.734147+0000","last_undegraded":"2024-09-15T23:21:22.734147+0000","last_fullsized":"2024-09-15T23:21:22.734147+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:20:55.725352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.732514+0000","last_change":"2024-09-15T23:21:22.731809+0000","last_active":"2024-09-15T23:21:22.732514+0000","last_peered":"2024-09-15T23:21:22.732514+0000","last_clean":"2024-09-15T23:21:22.732514+0000","last_became_active":"2024-09-15T23:21:22.731525+0000","last_became_peered":"2024-09-15T23:21:22.731525+0000","last_unstale":"2024-09-15T23:21:22.732514+0000","last_undegraded":"2024-09-15T23:21:22.732514+0000","last_fullsized":"2024-09-15T23:21:22.732514+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:24.714284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.732205+0000","last_change":"2024-09-15T23:21:22.730534+0000","last_active":"2024-09-15T23:21:22.732205+0000","last_peered":"2024-09-15T23:21:22.732205+0000","last_clean":"2024-09-15T23:21:22.732205+0000","last_became_active":"2024-09-15T23:21:22.730254+0000","last_became_peered":"2024-09-15T23:21:22.730254+0000","last_unstale":"2024-09-15T23:21:22.732205+0000","last_undegraded":"2024-09-15T23:21:22.732205+0000","last_fullsized":"2024-09-15T23:21:22.732205+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:43:29.335197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.740501+0000","last_change":"2024-09-15T23:21:22.738611+0000","last_active":"2024-09-15T23:21:22.740501+0000","last_peered":"2024-09-15T23:21:22.740501+0000","last_clean":"2024-09-15T23:21:22.740501+0000","last_became_active":"2024-09-15T23:21:22.738306+0000","last_became_peered":"2024-09-15T23:21:22.738306+0000","last_unstale":"2024-09-15T23:21:22.740501+0000","last_undegraded":"2024-09-15T23:21:22.740501+0000","last_fullsized":"2024-09-15T23:21:22.740501+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:46:31.588595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.732222+0000","last_change":"2024-09-15T23:21:22.730551+0000","last_active":"2024-09-15T23:21:22.732222+0000","last_peered":"2024-09-15T23:21:22.732222+0000","last_clean":"2024-09-15T23:21:22.732222+0000","last_became_active":"2024-09-15T23:21:22.730157+0000","last_became_peered":"2024-09-15T23:21:22.730157+0000","last_unstale":"2024-09-15T23:21:22.732222+0000","last_undegraded":"2024-09-15T23:21:22.732222+0000","last_fullsized":"2024-09-15T23:21:22.732222+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:42.508730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.741558+0000","last_change":"2024-09-15T23:21:22.725781+0000","last_active":"2024-09-15T23:21:22.741558+0000","last_peered":"2024-09-15T23:21:22.741558+0000","last_clean":"2024-09-15T23:21:22.741558+0000","last_became_active":"2024-09-15T23:21:22.724370+0000","last_became_peered":"2024-09-15T23:21:22.724370+0000","last_unstale":"2024-09-15T23:21:22.741558+0000","last_undegraded":"2024-09-15T23:21:22.741558+0000","last_fullsized":"2024-09-15T23:21:22.741558+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:17.342891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.731192+0000","last_change":"2024-09-15T23:21:22.729757+0000","last_active":"2024-09-15T23:21:22.731192+0000","last_peered":"2024-09-15T23:21:22.731192+0000","last_clean":"2024-09-15T23:21:22.731192+0000","last_became_active":"2024-09-15T23:21:22.728468+0000","last_became_peered":"2024-09-15T23:21:22.728468+0000","last_unstale":"2024-09-15T23:21:22.731192+0000","last_undegraded":"2024-09-15T23:21:22.731192+0000","last_fullsized":"2024-09-15T23:21:22.731192+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:22:47.009845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.721997+0000","last_change":"2024-09-15T23:21:22.719925+0000","last_active":"2024-09-15T23:21:22.721997+0000","last_peered":"2024-09-15T23:21:22.721997+0000","last_clean":"2024-09-15T23:21:22.721997+0000","last_became_active":"2024-09-15T23:21:22.719532+0000","last_became_peered":"2024-09-15T23:21:22.719532+0000","last_unstale":"2024-09-15T23:21:22.721997+0000","last_undegraded":"2024-09-15T23:21:22.721997+0000","last_fullsized":"2024-09-15T23:21:22.721997+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:58.514360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1f","version":"167'4","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.744482+0000","last_change":"2024-09-15T23:21:21.737653+0000","last_active":"2024-09-15T23:21:22.744482+0000","last_peered":"2024-09-15T23:21:22.744482+0000","last_clean":"2024-09-15T23:21:22.744482+0000","last_became_active":"2024-09-15T23:21:21.737345+0000","last_became_peered":"2024-09-15T23:21:21.737345+0000","last_unstale":"2024-09-15T23:21:22.744482+0000","last_undegraded":"2024-09-15T23:21:22.744482+0000","last_fullsized":"2024-09-15T23:21:22.744482+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:56:25.666102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.741922+0000","last_change":"2024-09-15T23:21:22.737797+0000","last_active":"2024-09-15T23:21:22.741922+0000","last_peered":"2024-09-15T23:21:22.741922+0000","last_clean":"2024-09-15T23:21:22.741922+0000","last_became_active":"2024-09-15T23:21:22.737320+0000","last_became_peered":"2024-09-15T23:21:22.737320+0000","last_unstale":"2024-09-15T23:21:22.741922+0000","last_undegraded":"2024-09-15T23:21:22.741922+0000","last_fullsized":"2024-09-15T23:21:22.741922+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:45.051354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1e","version":"167'1","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.734840+0000","last_change":"2024-09-15T23:21:21.729577+0000","last_active":"2024-09-15T23:21:22.734840+0000","last_peered":"2024-09-15T23:21:22.734840+0000","last_clean":"2024-09-15T23:21:22.734840+0000","last_became_active":"2024-09-15T23:21:21.729284+0000","last_became_peered":"2024-09-15T23:21:21.729284+0000","last_unstale":"2024-09-15T23:21:22.734840+0000","last_undegraded":"2024-09-15T23:21:22.734840+0000","last_fullsized":"2024-09-15T23:21:22.734840+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:16:10.026756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.713977+0000","last_change":"2024-09-15T23:21:20.713977+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.713977+0000","last_undegraded":"2024-09-15T23:21:20.713977+0000","last_fullsized":"2024-09-15T23:21:20.713977+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.732818+0000","last_change":"2024-09-15T23:21:22.731852+0000","last_active":"2024-09-15T23:21:22.732818+0000","last_peered":"2024-09-15T23:21:22.732818+0000","last_clean":"2024-09-15T23:21:22.732818+0000","last_became_active":"2024-09-15T23:21:22.731572+0000","last_became_peered":"2024-09-15T23:21:22.731572+0000","last_unstale":"2024-09-15T23:21:22.732818+0000","last_undegraded":"2024-09-15T23:21:22.732818+0000","last_fullsized":"2024-09-15T23:21:22.732818+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:39:54.053199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.719297+0000","last_change":"2024-09-15T23:21:20.719297+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.719297+0000","last_undegraded":"2024-09-15T23:21:20.719297+0000","last_fullsized":"2024-09-15T23:21:20.719297+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1b","version":"167'1","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.741971+0000","last_change":"2024-09-15T23:21:21.737750+0000","last_active":"2024-09-15T23:21:22.741971+0000","last_peered":"2024-09-15T23:21:22.741971+0000","last_clean":"2024-09-15T23:21:22.741971+0000","last_became_active":"2024-09-15T23:21:21.737470+0000","last_became_peered":"2024-09-15T23:21:21.737470+0000","last_unstale":"2024-09-15T23:21:22.741971+0000","last_undegraded":"2024-09-15T23:21:22.741971+0000","last_fullsized":"2024-09-15T23:21:22.741971+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:21.410602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.716844+0000","last_change":"2024-09-15T23:21:20.716844+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.716844+0000","last_undegraded":"2024-09-15T23:21:20.716844+0000","last_fullsized":"2024-09-15T23:21:20.716844+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.717545+0000","last_change":"2024-09-15T23:21:21.737521+0000","last_active":"2024-09-15T23:21:22.717545+0000","last_peered":"2024-09-15T23:21:22.717545+0000","last_clean":"2024-09-15T23:21:22.717545+0000","last_became_active":"2024-09-15T23:21:21.736819+0000","last_became_peered":"2024-09-15T23:21:21.736819+0000","last_unstale":"2024-09-15T23:21:22.717545+0000","last_undegraded":"2024-09-15T23:21:22.717545+0000","last_fullsized":"2024-09-15T23:21:22.717545+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:40.716470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.717982+0000","last_change":"2024-09-15T23:21:20.717982+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.717982+0000","last_undegraded":"2024-09-15T23:21:20.717982+0000","last_fullsized":"2024-09-15T23:21:20.717982+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.713984+0000","last_change":"2024-09-15T23:21:20.713984+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.713984+0000","last_undegraded":"2024-09-15T23:21:20.713984+0000","last_fullsized":"2024-09-15T23:21:20.713984+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.718425+0000","last_change":"2024-09-15T23:21:20.718425+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.718425+0000","last_undegraded":"2024-09-15T23:21:20.718425+0000","last_fullsized":"2024-09-15T23:21:20.718425+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.739910+0000","last_change":"2024-09-15T23:21:22.722686+0000","last_active":"2024-09-15T23:21:22.739910+0000","last_peered":"2024-09-15T23:21:22.739910+0000","last_clean":"2024-09-15T23:21:22.739910+0000","last_became_active":"2024-09-15T23:21:22.722367+0000","last_became_peered":"2024-09-15T23:21:22.722367+0000","last_unstale":"2024-09-15T23:21:22.739910+0000","last_undegraded":"2024-09-15T23:21:22.739910+0000","last_fullsized":"2024-09-15T23:21:22.739910+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:02:39.146127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.14","version":"167'6","reported_seq":18,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.745850+0000","last_change":"2024-09-15T23:21:21.728632+0000","last_active":"2024-09-15T23:21:22.745850+0000","last_peered":"2024-09-15T23:21:22.745850+0000","last_clean":"2024-09-15T23:21:22.745850+0000","last_became_active":"2024-09-15T23:21:21.728358+0000","last_became_peered":"2024-09-15T23:21:21.728358+0000","last_unstale":"2024-09-15T23:21:22.745850+0000","last_undegraded":"2024-09-15T23:21:22.745850+0000","last_fullsized":"2024-09-15T23:21:22.745850+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:16:00.181183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.716832+0000","last_change":"2024-09-15T23:21:20.716832+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.716832+0000","last_undegraded":"2024-09-15T23:21:20.716832+0000","last_fullsized":"2024-09-15T23:21:20.716832+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.713926+0000","last_change":"2024-09-15T23:21:20.713926+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.713926+0000","last_undegraded":"2024-09-15T23:21:20.713926+0000","last_fullsized":"2024-09-15T23:21:20.713926+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.717947+0000","last_change":"2024-09-15T23:21:20.717947+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.717947+0000","last_undegraded":"2024-09-15T23:21:20.717947+0000","last_fullsized":"2024-09-15T23:21:20.717947+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.732170+0000","last_change":"2024-09-15T23:21:22.730786+0000","last_active":"2024-09-15T23:21:22.732170+0000","last_peered":"2024-09-15T23:21:22.732170+0000","last_clean":"2024-09-15T23:21:22.732170+0000","last_became_active":"2024-09-15T23:21:22.730507+0000","last_became_peered":"2024-09-15T23:21:22.730507+0000","last_unstale":"2024-09-15T23:21:22.732170+0000","last_undegraded":"2024-09-15T23:21:22.732170+0000","last_fullsized":"2024-09-15T23:21:22.732170+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:16.216690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.10","version":"167'8","reported_seq":20,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.743899+0000","last_change":"2024-09-15T23:21:21.725050+0000","last_active":"2024-09-15T23:21:22.743899+0000","last_peered":"2024-09-15T23:21:22.743899+0000","last_clean":"2024-09-15T23:21:22.743899+0000","last_became_active":"2024-09-15T23:21:21.724729+0000","last_became_peered":"2024-09-15T23:21:21.724729+0000","last_unstale":"2024-09-15T23:21:22.743899+0000","last_undegraded":"2024-09-15T23:21:22.743899+0000","last_fullsized":"2024-09-15T23:21:22.743899+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:40.841373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.f","version":"167'1","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.743367+0000","last_change":"2024-09-15T23:21:21.732704+0000","last_active":"2024-09-15T23:21:22.743367+0000","last_peered":"2024-09-15T23:21:22.743367+0000","last_clean":"2024-09-15T23:21:22.743367+0000","last_became_active":"2024-09-15T23:21:21.732406+0000","last_became_peered":"2024-09-15T23:21:21.732406+0000","last_unstale":"2024-09-15T23:21:22.743367+0000","last_undegraded":"2024-09-15T23:21:22.743367+0000","last_fullsized":"2024-09-15T23:21:22.743367+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:28.211194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.e","version":"167'2","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.735925+0000","last_change":"2024-09-15T23:21:21.729354+0000","last_active":"2024-09-15T23:21:22.735925+0000","last_peered":"2024-09-15T23:21:22.735925+0000","last_clean":"2024-09-15T23:21:22.735925+0000","last_became_active":"2024-09-15T23:21:21.729019+0000","last_became_peered":"2024-09-15T23:21:21.729019+0000","last_unstale":"2024-09-15T23:21:22.735925+0000","last_undegraded":"2024-09-15T23:21:22.735925+0000","last_fullsized":"2024-09-15T23:21:22.735925+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:34.813792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.d","version":"167'1","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.739278+0000","last_change":"2024-09-15T23:21:21.733634+0000","last_active":"2024-09-15T23:21:22.739278+0000","last_peered":"2024-09-15T23:21:22.739278+0000","last_clean":"2024-09-15T23:21:22.739278+0000","last_became_active":"2024-09-15T23:21:21.733369+0000","last_became_peered":"2024-09-15T23:21:21.733369+0000","last_unstale":"2024-09-15T23:21:22.739278+0000","last_undegraded":"2024-09-15T23:21:22.739278+0000","last_fullsized":"2024-09-15T23:21:22.739278+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:44.350966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.720906+0000","last_change":"2024-09-15T23:21:21.732863+0000","last_active":"2024-09-15T23:21:22.720906+0000","last_peered":"2024-09-15T23:21:22.720906+0000","last_clean":"2024-09-15T23:21:22.720906+0000","last_became_active":"2024-09-15T23:21:21.731828+0000","last_became_peered":"2024-09-15T23:21:21.731828+0000","last_unstale":"2024-09-15T23:21:22.720906+0000","last_undegraded":"2024-09-15T23:21:22.720906+0000","last_fullsized":"2024-09-15T23:21:22.720906+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:12.222045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.719790+0000","last_change":"2024-09-15T23:21:22.718883+0000","last_active":"2024-09-15T23:21:22.719790+0000","last_peered":"2024-09-15T23:21:22.719790+0000","last_clean":"2024-09-15T23:21:22.719790+0000","last_became_active":"2024-09-15T23:21:22.718466+0000","last_became_peered":"2024-09-15T23:21:22.718466+0000","last_unstale":"2024-09-15T23:21:22.719790+0000","last_undegraded":"2024-09-15T23:21:22.719790+0000","last_fullsized":"2024-09-15T23:21:22.719790+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:49:53.278979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.718048+0000","last_change":"2024-09-15T23:21:20.718048+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.718048+0000","last_undegraded":"2024-09-15T23:21:20.718048+0000","last_fullsized":"2024-09-15T23:21:20.718048+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.721696+0000","last_change":"2024-09-15T23:21:21.728470+0000","last_active":"2024-09-15T23:21:22.721696+0000","last_peered":"2024-09-15T23:21:22.721696+0000","last_clean":"2024-09-15T23:21:22.721696+0000","last_became_active":"2024-09-15T23:21:21.728205+0000","last_became_peered":"2024-09-15T23:21:21.728205+0000","last_unstale":"2024-09-15T23:21:22.721696+0000","last_undegraded":"2024-09-15T23:21:22.721696+0000","last_fullsized":"2024-09-15T23:21:22.721696+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:33:14.843299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.741635+0000","last_change":"2024-09-15T23:21:22.729733+0000","last_active":"2024-09-15T23:21:22.741635+0000","last_peered":"2024-09-15T23:21:22.741635+0000","last_clean":"2024-09-15T23:21:22.741635+0000","last_became_active":"2024-09-15T23:21:22.729412+0000","last_became_peered":"2024-09-15T23:21:22.729412+0000","last_unstale":"2024-09-15T23:21:22.741635+0000","last_undegraded":"2024-09-15T23:21:22.741635+0000","last_fullsized":"2024-09-15T23:21:22.741635+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:59:51.046663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.716832+0000","last_change":"2024-09-15T23:21:20.716832+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.716832+0000","last_undegraded":"2024-09-15T23:21:20.716832+0000","last_fullsized":"2024-09-15T23:21:20.716832+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.720087+0000","last_change":"2024-09-15T23:21:21.731639+0000","last_active":"2024-09-15T23:21:22.720087+0000","last_peered":"2024-09-15T23:21:22.720087+0000","last_clean":"2024-09-15T23:21:22.720087+0000","last_became_active":"2024-09-15T23:21:21.731378+0000","last_became_peered":"2024-09-15T23:21:21.731378+0000","last_unstale":"2024-09-15T23:21:22.720087+0000","last_undegraded":"2024-09-15T23:21:22.720087+0000","last_fullsized":"2024-09-15T23:21:22.720087+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:12.282318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.713993+0000","last_change":"2024-09-15T23:21:20.713993+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.713993+0000","last_undegraded":"2024-09-15T23:21:20.713993+0000","last_fullsized":"2024-09-15T23:21:20.713993+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.720264+0000","last_change":"2024-09-15T23:21:21.737932+0000","last_active":"2024-09-15T23:21:22.720264+0000","last_peered":"2024-09-15T23:21:22.720264+0000","last_clean":"2024-09-15T23:21:22.720264+0000","last_became_active":"2024-09-15T23:21:21.737595+0000","last_became_peered":"2024-09-15T23:21:21.737595+0000","last_unstale":"2024-09-15T23:21:22.720264+0000","last_undegraded":"2024-09-15T23:21:22.720264+0000","last_fullsized":"2024-09-15T23:21:22.720264+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:01:08.141687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.718118+0000","last_change":"2024-09-15T23:21:21.737759+0000","last_active":"2024-09-15T23:21:22.718118+0000","last_peered":"2024-09-15T23:21:22.718118+0000","last_clean":"2024-09-15T23:21:22.718118+0000","last_became_active":"2024-09-15T23:21:21.737161+0000","last_became_peered":"2024-09-15T23:21:21.737161+0000","last_unstale":"2024-09-15T23:21:22.718118+0000","last_undegraded":"2024-09-15T23:21:22.718118+0000","last_fullsized":"2024-09-15T23:21:22.718118+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:17.646086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.718894+0000","last_change":"2024-09-15T23:21:20.718894+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.718894+0000","last_undegraded":"2024-09-15T23:21:20.718894+0000","last_fullsized":"2024-09-15T23:21:20.718894+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.717751+0000","last_change":"2024-09-15T23:21:21.730211+0000","last_active":"2024-09-15T23:21:22.717751+0000","last_peered":"2024-09-15T23:21:22.717751+0000","last_clean":"2024-09-15T23:21:22.717751+0000","last_became_active":"2024-09-15T23:21:21.729919+0000","last_became_peered":"2024-09-15T23:21:21.729919+0000","last_unstale":"2024-09-15T23:21:22.717751+0000","last_undegraded":"2024-09-15T23:21:22.717751+0000","last_fullsized":"2024-09-15T23:21:22.717751+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:03.318606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.741683+0000","last_change":"2024-09-15T23:21:22.736340+0000","last_active":"2024-09-15T23:21:22.741683+0000","last_peered":"2024-09-15T23:21:22.741683+0000","last_clean":"2024-09-15T23:21:22.741683+0000","last_became_active":"2024-09-15T23:21:22.724766+0000","last_became_peered":"2024-09-15T23:21:22.724766+0000","last_unstale":"2024-09-15T23:21:22.741683+0000","last_undegraded":"2024-09-15T23:21:22.741683+0000","last_fullsized":"2024-09-15T23:21:22.741683+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:36:38.151336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":1,"reported_epoch":165,"state":"creating+peering","last_fresh":"2024-09-15T23:21:20.719106+0000","last_change":"2024-09-15T23:21:20.719106+0000","last_active":"2024-09-15T23:21:20.706905+0000","last_peered":"2024-09-15T23:21:20.706905+0000","last_clean":"2024-09-15T23:21:20.706905+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:20.719106+0000","last_undegraded":"2024-09-15T23:21:20.719106+0000","last_fullsized":"2024-09-15T23:21:20.719106+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.717686+0000","last_change":"2024-09-15T23:21:21.737328+0000","last_active":"2024-09-15T23:21:22.717686+0000","last_peered":"2024-09-15T23:21:22.717686+0000","last_clean":"2024-09-15T23:21:22.717686+0000","last_became_active":"2024-09-15T23:21:21.736636+0000","last_became_peered":"2024-09-15T23:21:21.736636+0000","last_unstale":"2024-09-15T23:21:22.717686+0000","last_undegraded":"2024-09-15T23:21:22.717686+0000","last_fullsized":"2024-09-15T23:21:22.717686+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:04:32.575098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.739008+0000","last_change":"2024-09-15T23:21:22.722542+0000","last_active":"2024-09-15T23:21:22.739008+0000","last_peered":"2024-09-15T23:21:22.739008+0000","last_clean":"2024-09-15T23:21:22.739008+0000","last_became_active":"2024-09-15T23:21:22.722242+0000","last_became_peered":"2024-09-15T23:21:22.722242+0000","last_unstale":"2024-09-15T23:21:22.739008+0000","last_undegraded":"2024-09-15T23:21:22.739008+0000","last_fullsized":"2024-09-15T23:21:22.739008+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:56.416229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.715556+0000","last_change":"2024-09-15T23:21:21.736127+0000","last_active":"2024-09-15T23:21:22.715556+0000","last_peered":"2024-09-15T23:21:22.715556+0000","last_clean":"2024-09-15T23:21:22.715556+0000","last_became_active":"2024-09-15T23:21:21.735854+0000","last_became_peered":"2024-09-15T23:21:21.735854+0000","last_unstale":"2024-09-15T23:21:22.715556+0000","last_undegraded":"2024-09-15T23:21:22.715556+0000","last_fullsized":"2024-09-15T23:21:22.715556+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:00.080011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:21:21.708561+0000","last_change":"2024-09-15T23:21:21.708561+0000","last_active":"2024-09-15T23:21:21.708561+0000","last_peered":"2024-09-15T23:21:21.708561+0000","last_clean":"2024-09-15T23:21:21.708561+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:21:21.708561+0000","last_undegraded":"2024-09-15T23:21:21.708561+0000","last_fullsized":"2024-09-15T23:21:21.708561+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.717406+0000","last_change":"2024-09-15T23:21:21.733268+0000","last_active":"2024-09-15T23:21:22.717406+0000","last_peered":"2024-09-15T23:21:22.717406+0000","last_clean":"2024-09-15T23:21:22.717406+0000","last_became_active":"2024-09-15T23:21:21.733003+0000","last_became_peered":"2024-09-15T23:21:21.733003+0000","last_unstale":"2024-09-15T23:21:22.717406+0000","last_undegraded":"2024-09-15T23:21:22.717406+0000","last_fullsized":"2024-09-15T23:21:22.717406+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:27.535113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":440,"reported_epoch":167,"state":"active+clean","last_fresh":"2024-09-15T23:21:22.719463+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:21:22.719463+0000","last_peered":"2024-09-15T23:21:22.719463+0000","last_clean":"2024-09-15T23:21:22.719463+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:21:22.719463+0000","last_undegraded":"2024-09-15T23:21:22.719463+0000","last_fullsized":"2024-09-15T23:21:22.719463+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":56,"acting":56,"num_store_stats":4},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2286,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476854,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55448,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316392,"statfs":{"total":96636764160,"available":96579985408,"internally_reserved":0,"allocated":2097152,"data_stored":921286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476851,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55416,"kb_used_data":2020,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316424,"statfs":{"total":96636764160,"available":96580018176,"internally_reserved":0,"allocated":2068480,"data_stored":912877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51840,"kb_used_data":2600,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320000,"statfs":{"total":96636764160,"available":96583680000,"internally_reserved":0,"allocated":2662400,"data_stored":1503245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476853,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29072,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342768,"statfs":{"total":96636764160,"available":96606994432,"internally_reserved":0,"allocated":2084864,"data_stored":919722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29040,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342800,"statfs":{"total":96636764160,"available":96607027200,"internally_reserved":0,"allocated":2056192,"data_stored":906602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51236,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320604,"statfs":{"total":96636764160,"available":96584298496,"internally_reserved":0,"allocated":2043904,"data_stored":900785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542258,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55992,"kb_used_data":2588,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315848,"statfs":{"total":96636764160,"available":96579428352,"internally_reserved":0,"allocated":2650112,"data_stored":1496970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55412,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316428,"statfs":{"total":96636764160,"available":96580022272,"internally_reserved":0,"allocated":2056192,"data_stored":906602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:21:28.706 INFO:tasks.ceph.mds.a.smithi123.stderr:2024-09-15T23:21:28.705+0000 7ff9b8e6f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:21:30.016 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:21:30.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.133+0000 7f7d94f52640 1 Processor -- start 2024-09-15T23:21:30.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.133+0000 7f7d94f52640 1 -- start start 2024-09-15T23:21:30.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.134+0000 7f7d94f52640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7d90162490 0x7f7d9015ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:30.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.134+0000 7f7d94f52640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7d900b66b0 0x7f7d900b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:30.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.134+0000 7f7d94f52640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d9015f570 con 0x7f7d9015eab0 2024-09-15T23:21:30.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.134+0000 7f7d94f52640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f7d900b7040 con 0x7f7d90162490 2024-09-15T23:21:30.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.134+0000 7f7d94f52640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7d9015f850 con 0x7f7d900b66b0 2024-09-15T23:21:30.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.135+0000 7f7d8ed9d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7d900b66b0 0x7f7d900b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:30.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.135+0000 7f7d8dd9b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7d90162490 0x7f7d9015ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:30.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.135+0000 7f7d8ed9d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7d900b66b0 0x7f7d900b6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:34188/0 (socket says 172.21.15.123:34188) 2024-09-15T23:21:30.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.135+0000 7f7d8dd9b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7d90162490 0x7f7d9015ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:42924/0 (socket says 172.21.15.123:42924) 2024-09-15T23:21:30.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.135+0000 7f7d8e59c640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f7d9015eab0 0x7f7d900d2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:58418/0 (socket says 172.21.15.123:58418) 2024-09-15T23:21:30.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.135+0000 7f7d8ed9d640 1 -- 172.21.15.123:0/3962429169 learned_addr learned my addr 172.21.15.123:0/3962429169 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:30.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.135+0000 7f7d8ed9d640 1 -- 172.21.15.123:0/3962429169 >> v2:172.21.15.188:3300/0 conn(0x7f7d90162490 msgr2=0x7f7d9015ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:30.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.135+0000 7f7d8ed9d640 1 --2- 172.21.15.123:0/3962429169 >> v2:172.21.15.188:3300/0 conn(0x7f7d90162490 0x7f7d9015ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:30.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.135+0000 7f7d8ed9d640 1 -- 172.21.15.123:0/3962429169 >> v1:172.21.15.188:6789/0 conn(0x7f7d9015eab0 legacy=0x7f7d900d2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:30.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.135+0000 7f7d8ed9d640 1 -- 172.21.15.123:0/3962429169 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d9015fb30 con 0x7f7d900b66b0 2024-09-15T23:21:30.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.135+0000 7f7d8dd9b640 1 --2- 172.21.15.123:0/3962429169 >> v2:172.21.15.188:3300/0 conn(0x7f7d90162490 0x7f7d9015ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:21:30.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.136+0000 7f7d8ed9d640 1 --2- 172.21.15.123:0/3962429169 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7d900b66b0 0x7f7d900b6b00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7d88009e50 tx=0x7f7d8802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7452629fc88666 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:30.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.136+0000 7f7d8d59a640 1 -- 172.21.15.123:0/3962429169 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d88036070 con 0x7f7d900b66b0 2024-09-15T23:21:30.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.136+0000 7f7d8d59a640 1 -- 172.21.15.123:0/3962429169 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d88031600 con 0x7f7d900b66b0 2024-09-15T23:21:30.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.136+0000 7f7d8d59a640 1 -- 172.21.15.123:0/3962429169 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d880319d0 con 0x7f7d900b66b0 2024-09-15T23:21:30.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.137+0000 7f7d94f52640 1 -- 172.21.15.123:0/3962429169 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7d900b66b0 msgr2=0x7f7d900b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:30.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.137+0000 7f7d94f52640 1 --2- 172.21.15.123:0/3962429169 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7d900b66b0 0x7f7d900b6b00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7d88009e50 tx=0x7f7d8802a710 comp rx=0 tx=0).stop 2024-09-15T23:21:30.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.137+0000 7f7d94f52640 1 -- 172.21.15.123:0/3962429169 shutdown_connections 2024-09-15T23:21:30.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.137+0000 7f7d94f52640 1 --2- 172.21.15.123:0/3962429169 >> v2:172.21.15.188:3300/0 conn(0x7f7d90162490 0x7f7d9015ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:30.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.137+0000 7f7d94f52640 1 --2- 172.21.15.123:0/3962429169 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7d900b66b0 0x7f7d900b6b00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:30.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.137+0000 7f7d94f52640 1 -- 172.21.15.123:0/3962429169 >> 172.21.15.123:0/3962429169 conn(0x7f7d900d16d0 msgr2=0x7f7d900d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:30.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.137+0000 7f7d94f52640 1 -- 172.21.15.123:0/3962429169 shutdown_connections 2024-09-15T23:21:30.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.137+0000 7f7d94f52640 1 -- 172.21.15.123:0/3962429169 wait complete. 2024-09-15T23:21:30.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.138+0000 7f7d94f52640 1 Processor -- start 2024-09-15T23:21:30.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.138+0000 7f7d94f52640 1 -- start start 2024-09-15T23:21:30.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.139+0000 7f7d94f52640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7d900b66b0 0x7f7d900c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:30.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.139+0000 7f7d94f52640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d9015eab0 0x7f7d9015ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:30.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.139+0000 7f7d94f52640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7d90162490 0x7f7d9006d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:30.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.139+0000 7f7d94f52640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7d900d4460 con 0x7f7d9015eab0 2024-09-15T23:21:30.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.139+0000 7f7d94f52640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7d900cef20 con 0x7f7d90162490 2024-09-15T23:21:30.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.139+0000 7f7d94f52640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7d900d45e0 con 0x7f7d900b66b0 2024-09-15T23:21:30.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.139+0000 7f7d8dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d9015eab0 0x7f7d9015ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:30.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.139+0000 7f7d8dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d9015eab0 0x7f7d9015ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57744/0 (socket says 172.21.15.123:57744) 2024-09-15T23:21:30.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.139+0000 7f7d8dd9b640 1 -- 172.21.15.123:0/1300482215 learned_addr learned my addr 172.21.15.123:0/1300482215 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:30.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.139+0000 7f7d8e59c640 1 --2- 172.21.15.123:0/1300482215 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7d900b66b0 0x7f7d900c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:30.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.139+0000 7f7d8ed9d640 1 --2- 172.21.15.123:0/1300482215 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7d90162490 0x7f7d9006d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:30.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.140+0000 7f7d8dd9b640 1 -- 172.21.15.123:0/1300482215 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7d900b66b0 msgr2=0x7f7d900c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:30.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.140+0000 7f7d8dd9b640 1 --2- 172.21.15.123:0/1300482215 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7d900b66b0 0x7f7d900c8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:30.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.140+0000 7f7d8dd9b640 1 -- 172.21.15.123:0/1300482215 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7d90162490 msgr2=0x7f7d9006d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:30.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.140+0000 7f7d8dd9b640 1 --2- 172.21.15.123:0/1300482215 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7d90162490 0x7f7d9006d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:30.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.140+0000 7f7d8dd9b640 1 -- 172.21.15.123:0/1300482215 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d901e9070 con 0x7f7d9015eab0 2024-09-15T23:21:30.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.140+0000 7f7d8dd9b640 1 --2- 172.21.15.123:0/1300482215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d9015eab0 0x7f7d9015ce50 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f7d8400ec10 tx=0x7f7d8400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:30.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.140+0000 7f7d7effd640 1 -- 172.21.15.123:0/1300482215 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d84017070 con 0x7f7d9015eab0 2024-09-15T23:21:30.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.140+0000 7f7d7effd640 1 -- 172.21.15.123:0/1300482215 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d8400cc30 con 0x7f7d9015eab0 2024-09-15T23:21:30.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.140+0000 7f7d7effd640 1 -- 172.21.15.123:0/1300482215 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d84013470 con 0x7f7d9015eab0 2024-09-15T23:21:30.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.140+0000 7f7d94f52640 1 -- 172.21.15.123:0/1300482215 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d900c8af0 con 0x7f7d9015eab0 2024-09-15T23:21:30.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.140+0000 7f7d94f52640 1 -- 172.21.15.123:0/1300482215 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d900cbb10 con 0x7f7d9015eab0 2024-09-15T23:21:30.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.141+0000 7f7d94f52640 1 -- 172.21.15.123:0/1300482215 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d900b6b00 con 0x7f7d9015eab0 2024-09-15T23:21:30.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.142+0000 7f7d7effd640 1 -- 172.21.15.123:0/1300482215 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7d8401a070 con 0x7f7d9015eab0 2024-09-15T23:21:30.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.142+0000 7f7d7effd640 1 --2- 172.21.15.123:0/1300482215 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7d7006c2b0 0x7f7d7006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:30.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.142+0000 7f7d7effd640 1 -- 172.21.15.123:0/1300482215 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7f7d8408b330 con 0x7f7d9015eab0 2024-09-15T23:21:30.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.143+0000 7f7d8e59c640 1 --2- 172.21.15.123:0/1300482215 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7d7006c2b0 0x7f7d7006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:30.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.143+0000 7f7d8e59c640 1 --2- 172.21.15.123:0/1300482215 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7d7006c2b0 0x7f7d7006e770 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f7d80007fd0 tx=0x7f7d80007e80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:30.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.147+0000 7f7d7effd640 1 -- 172.21.15.123:0/1300482215 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7d84059460 con 0x7f7d9015eab0 2024-09-15T23:21:30.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.310+0000 7f7d94f52640 1 -- 172.21.15.123:0/1300482215 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7d900c80e0 con 0x7f7d7006c2b0 2024-09-15T23:21:30.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.317+0000 7f7d7effd640 1 -- 172.21.15.123:0/1300482215 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252438 (secure 0 0 0) 0x7f7d900c80e0 con 0x7f7d7006c2b0 2024-09-15T23:21:30.321 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:30.322 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:21:30.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.320+0000 7f7d94f52640 1 -- 172.21.15.123:0/1300482215 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7d7006c2b0 msgr2=0x7f7d7006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:30.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.320+0000 7f7d94f52640 1 --2- 172.21.15.123:0/1300482215 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7d7006c2b0 0x7f7d7006e770 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f7d80007fd0 tx=0x7f7d80007e80 comp rx=0 tx=0).stop 2024-09-15T23:21:30.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.320+0000 7f7d94f52640 1 -- 172.21.15.123:0/1300482215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d9015eab0 msgr2=0x7f7d9015ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:30.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.320+0000 7f7d94f52640 1 --2- 172.21.15.123:0/1300482215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d9015eab0 0x7f7d9015ce50 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f7d8400ec10 tx=0x7f7d8400c520 comp rx=0 tx=0).stop 2024-09-15T23:21:30.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.320+0000 7f7d94f52640 1 -- 172.21.15.123:0/1300482215 shutdown_connections 2024-09-15T23:21:30.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.320+0000 7f7d94f52640 1 --2- 172.21.15.123:0/1300482215 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7d90162490 0x7f7d9006d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:30.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.320+0000 7f7d94f52640 1 --2- 172.21.15.123:0/1300482215 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7d7006c2b0 0x7f7d7006e770 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:30.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.320+0000 7f7d94f52640 1 --2- 172.21.15.123:0/1300482215 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d9015eab0 0x7f7d9015ce50 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:30.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.320+0000 7f7d94f52640 1 --2- 172.21.15.123:0/1300482215 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7d900b66b0 0x7f7d900c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:30.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.320+0000 7f7d94f52640 1 -- 172.21.15.123:0/1300482215 >> 172.21.15.123:0/1300482215 conn(0x7f7d900d16d0 msgr2=0x7f7d9015d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:30.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.320+0000 7f7d94f52640 1 -- 172.21.15.123:0/1300482215 shutdown_connections 2024-09-15T23:21:30.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.320+0000 7f7d94f52640 1 -- 172.21.15.123:0/1300482215 wait complete. 2024-09-15T23:21:30.332 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":445,"stamp":"2024-09-15T23:21:29.636089+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":401748,"kb_used_data":17576,"kb_used_omap":12,"kb_used_meta":383987,"kb_avail":754572972,"statfs":{"total":773094113280,"available":772682723328,"internally_reserved":0,"allocated":17997824,"data_stored":8593172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":393203248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.918626"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.731760+0000","last_change":"2024-09-15T23:21:22.726816+0000","last_active":"2024-09-15T23:21:24.731760+0000","last_peered":"2024-09-15T23:21:24.731760+0000","last_clean":"2024-09-15T23:21:24.731760+0000","last_became_active":"2024-09-15T23:21:22.726529+0000","last_became_peered":"2024-09-15T23:21:22.726529+0000","last_unstale":"2024-09-15T23:21:24.731760+0000","last_undegraded":"2024-09-15T23:21:24.731760+0000","last_fullsized":"2024-09-15T23:21:24.731760+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:59:47.863389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.731712+0000","last_change":"2024-09-15T23:21:22.725283+0000","last_active":"2024-09-15T23:21:24.731712+0000","last_peered":"2024-09-15T23:21:24.731712+0000","last_clean":"2024-09-15T23:21:24.731712+0000","last_became_active":"2024-09-15T23:21:22.725020+0000","last_became_peered":"2024-09-15T23:21:22.725020+0000","last_unstale":"2024-09-15T23:21:24.731712+0000","last_undegraded":"2024-09-15T23:21:24.731712+0000","last_fullsized":"2024-09-15T23:21:24.731712+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:12:55.183824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.731625+0000","last_change":"2024-09-15T23:21:22.725523+0000","last_active":"2024-09-15T23:21:24.731625+0000","last_peered":"2024-09-15T23:21:24.731625+0000","last_clean":"2024-09-15T23:21:24.731625+0000","last_became_active":"2024-09-15T23:21:22.723213+0000","last_became_peered":"2024-09-15T23:21:22.723213+0000","last_unstale":"2024-09-15T23:21:24.731625+0000","last_undegraded":"2024-09-15T23:21:24.731625+0000","last_fullsized":"2024-09-15T23:21:24.731625+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:20.685332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.945406+0000","last_change":"2024-09-15T23:21:22.730399+0000","last_active":"2024-09-15T23:21:24.945406+0000","last_peered":"2024-09-15T23:21:24.945406+0000","last_clean":"2024-09-15T23:21:24.945406+0000","last_became_active":"2024-09-15T23:21:22.730129+0000","last_became_peered":"2024-09-15T23:21:22.730129+0000","last_unstale":"2024-09-15T23:21:24.945406+0000","last_undegraded":"2024-09-15T23:21:24.945406+0000","last_fullsized":"2024-09-15T23:21:24.945406+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:00:37.078905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.732172+0000","last_change":"2024-09-15T23:21:22.728138+0000","last_active":"2024-09-15T23:21:23.732172+0000","last_peered":"2024-09-15T23:21:23.732172+0000","last_clean":"2024-09-15T23:21:23.732172+0000","last_became_active":"2024-09-15T23:21:22.727856+0000","last_became_peered":"2024-09-15T23:21:22.727856+0000","last_unstale":"2024-09-15T23:21:23.732172+0000","last_undegraded":"2024-09-15T23:21:23.732172+0000","last_fullsized":"2024-09-15T23:21:23.732172+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:16:55.160089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.730675+0000","last_change":"2024-09-15T23:21:22.731881+0000","last_active":"2024-09-15T23:21:23.730675+0000","last_peered":"2024-09-15T23:21:23.730675+0000","last_clean":"2024-09-15T23:21:23.730675+0000","last_became_active":"2024-09-15T23:21:22.731615+0000","last_became_peered":"2024-09-15T23:21:22.731615+0000","last_unstale":"2024-09-15T23:21:23.730675+0000","last_undegraded":"2024-09-15T23:21:23.730675+0000","last_fullsized":"2024-09-15T23:21:23.730675+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:15:42.517026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.945606+0000","last_change":"2024-09-15T23:21:22.734486+0000","last_active":"2024-09-15T23:21:24.945606+0000","last_peered":"2024-09-15T23:21:24.945606+0000","last_clean":"2024-09-15T23:21:24.945606+0000","last_became_active":"2024-09-15T23:21:22.734137+0000","last_became_peered":"2024-09-15T23:21:22.734137+0000","last_unstale":"2024-09-15T23:21:24.945606+0000","last_undegraded":"2024-09-15T23:21:24.945606+0000","last_fullsized":"2024-09-15T23:21:24.945606+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:24.269542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.944766+0000","last_change":"2024-09-15T23:21:22.728181+0000","last_active":"2024-09-15T23:21:24.944766+0000","last_peered":"2024-09-15T23:21:24.944766+0000","last_clean":"2024-09-15T23:21:24.944766+0000","last_became_active":"2024-09-15T23:21:22.727863+0000","last_became_peered":"2024-09-15T23:21:22.727863+0000","last_unstale":"2024-09-15T23:21:24.944766+0000","last_undegraded":"2024-09-15T23:21:24.944766+0000","last_fullsized":"2024-09-15T23:21:24.944766+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:18.647742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.945076+0000","last_change":"2024-09-15T23:21:22.720386+0000","last_active":"2024-09-15T23:21:24.945076+0000","last_peered":"2024-09-15T23:21:24.945076+0000","last_clean":"2024-09-15T23:21:24.945076+0000","last_became_active":"2024-09-15T23:21:22.720114+0000","last_became_peered":"2024-09-15T23:21:22.720114+0000","last_unstale":"2024-09-15T23:21:24.945076+0000","last_undegraded":"2024-09-15T23:21:24.945076+0000","last_fullsized":"2024-09-15T23:21:24.945076+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:56.416229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.944919+0000","last_change":"2024-09-15T23:21:22.723261+0000","last_active":"2024-09-15T23:21:24.944919+0000","last_peered":"2024-09-15T23:21:24.944919+0000","last_clean":"2024-09-15T23:21:24.944919+0000","last_became_active":"2024-09-15T23:21:22.722993+0000","last_became_peered":"2024-09-15T23:21:22.722993+0000","last_unstale":"2024-09-15T23:21:24.944919+0000","last_undegraded":"2024-09-15T23:21:24.944919+0000","last_fullsized":"2024-09-15T23:21:24.944919+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:58.514360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.732400+0000","last_change":"2024-09-15T23:21:22.734444+0000","last_active":"2024-09-15T23:21:23.732400+0000","last_peered":"2024-09-15T23:21:23.732400+0000","last_clean":"2024-09-15T23:21:23.732400+0000","last_became_active":"2024-09-15T23:21:22.732810+0000","last_became_peered":"2024-09-15T23:21:22.732810+0000","last_unstale":"2024-09-15T23:21:23.732400+0000","last_undegraded":"2024-09-15T23:21:23.732400+0000","last_fullsized":"2024-09-15T23:21:23.732400+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:38:28.751894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.729203+0000","last_change":"2024-09-15T23:21:22.730945+0000","last_active":"2024-09-15T23:21:24.729203+0000","last_peered":"2024-09-15T23:21:24.729203+0000","last_clean":"2024-09-15T23:21:24.729203+0000","last_became_active":"2024-09-15T23:21:22.730645+0000","last_became_peered":"2024-09-15T23:21:22.730645+0000","last_unstale":"2024-09-15T23:21:24.729203+0000","last_undegraded":"2024-09-15T23:21:24.729203+0000","last_fullsized":"2024-09-15T23:21:24.729203+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:59:14.651999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.729228+0000","last_change":"2024-09-15T23:21:22.733734+0000","last_active":"2024-09-15T23:21:24.729228+0000","last_peered":"2024-09-15T23:21:24.729228+0000","last_clean":"2024-09-15T23:21:24.729228+0000","last_became_active":"2024-09-15T23:21:22.733441+0000","last_became_peered":"2024-09-15T23:21:22.733441+0000","last_unstale":"2024-09-15T23:21:24.729228+0000","last_undegraded":"2024-09-15T23:21:24.729228+0000","last_fullsized":"2024-09-15T23:21:24.729228+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:24:46.165613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.944642+0000","last_change":"2024-09-15T23:21:22.729776+0000","last_active":"2024-09-15T23:21:24.944642+0000","last_peered":"2024-09-15T23:21:24.944642+0000","last_clean":"2024-09-15T23:21:24.944642+0000","last_became_active":"2024-09-15T23:21:22.728949+0000","last_became_peered":"2024-09-15T23:21:22.728949+0000","last_unstale":"2024-09-15T23:21:24.944642+0000","last_undegraded":"2024-09-15T23:21:24.944642+0000","last_fullsized":"2024-09-15T23:21:24.944642+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:04:33.576754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.944643+0000","last_change":"2024-09-15T23:21:22.732516+0000","last_active":"2024-09-15T23:21:24.944643+0000","last_peered":"2024-09-15T23:21:24.944643+0000","last_clean":"2024-09-15T23:21:24.944643+0000","last_became_active":"2024-09-15T23:21:22.732251+0000","last_became_peered":"2024-09-15T23:21:22.732251+0000","last_unstale":"2024-09-15T23:21:24.944643+0000","last_undegraded":"2024-09-15T23:21:24.944643+0000","last_fullsized":"2024-09-15T23:21:24.944643+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:22.412258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.944890+0000","last_change":"2024-09-15T23:21:22.735136+0000","last_active":"2024-09-15T23:21:24.944890+0000","last_peered":"2024-09-15T23:21:24.944890+0000","last_clean":"2024-09-15T23:21:24.944890+0000","last_became_active":"2024-09-15T23:21:22.734848+0000","last_became_peered":"2024-09-15T23:21:22.734848+0000","last_unstale":"2024-09-15T23:21:24.944890+0000","last_undegraded":"2024-09-15T23:21:24.944890+0000","last_fullsized":"2024-09-15T23:21:24.944890+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:58:22.603882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.731972+0000","last_change":"2024-09-15T23:21:22.726184+0000","last_active":"2024-09-15T23:21:23.731972+0000","last_peered":"2024-09-15T23:21:23.731972+0000","last_clean":"2024-09-15T23:21:23.731972+0000","last_became_active":"2024-09-15T23:21:22.725893+0000","last_became_peered":"2024-09-15T23:21:22.725893+0000","last_unstale":"2024-09-15T23:21:23.731972+0000","last_undegraded":"2024-09-15T23:21:23.731972+0000","last_fullsized":"2024-09-15T23:21:23.731972+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:16:11.028411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.945244+0000","last_change":"2024-09-15T23:21:22.725267+0000","last_active":"2024-09-15T23:21:24.945244+0000","last_peered":"2024-09-15T23:21:24.945244+0000","last_clean":"2024-09-15T23:21:24.945244+0000","last_became_active":"2024-09-15T23:21:22.724997+0000","last_became_peered":"2024-09-15T23:21:22.724997+0000","last_unstale":"2024-09-15T23:21:24.945244+0000","last_undegraded":"2024-09-15T23:21:24.945244+0000","last_fullsized":"2024-09-15T23:21:24.945244+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:59:26.033736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.945260+0000","last_change":"2024-09-15T23:21:22.742640+0000","last_active":"2024-09-15T23:21:24.945260+0000","last_peered":"2024-09-15T23:21:24.945260+0000","last_clean":"2024-09-15T23:21:24.945260+0000","last_became_active":"2024-09-15T23:21:22.742272+0000","last_became_peered":"2024-09-15T23:21:22.742272+0000","last_unstale":"2024-09-15T23:21:24.945260+0000","last_undegraded":"2024-09-15T23:21:24.945260+0000","last_fullsized":"2024-09-15T23:21:24.945260+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:36:27.856577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.729251+0000","last_change":"2024-09-15T23:21:22.726724+0000","last_active":"2024-09-15T23:21:24.729251+0000","last_peered":"2024-09-15T23:21:24.729251+0000","last_clean":"2024-09-15T23:21:24.729251+0000","last_became_active":"2024-09-15T23:21:22.726437+0000","last_became_peered":"2024-09-15T23:21:22.726437+0000","last_unstale":"2024-09-15T23:21:24.729251+0000","last_undegraded":"2024-09-15T23:21:24.729251+0000","last_fullsized":"2024-09-15T23:21:24.729251+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:10.686832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.730698+0000","last_change":"2024-09-15T23:21:22.725838+0000","last_active":"2024-09-15T23:21:23.730698+0000","last_peered":"2024-09-15T23:21:23.730698+0000","last_clean":"2024-09-15T23:21:23.730698+0000","last_became_active":"2024-09-15T23:21:22.725580+0000","last_became_peered":"2024-09-15T23:21:22.725580+0000","last_unstale":"2024-09-15T23:21:23.730698+0000","last_undegraded":"2024-09-15T23:21:23.730698+0000","last_fullsized":"2024-09-15T23:21:23.730698+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:36:45.813133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.732002+0000","last_change":"2024-09-15T23:21:22.731809+0000","last_active":"2024-09-15T23:21:23.732002+0000","last_peered":"2024-09-15T23:21:23.732002+0000","last_clean":"2024-09-15T23:21:23.732002+0000","last_became_active":"2024-09-15T23:21:22.731525+0000","last_became_peered":"2024-09-15T23:21:22.731525+0000","last_unstale":"2024-09-15T23:21:23.732002+0000","last_undegraded":"2024-09-15T23:21:23.732002+0000","last_fullsized":"2024-09-15T23:21:23.732002+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:19:31.877136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.731432+0000","last_change":"2024-09-15T23:21:22.728305+0000","last_active":"2024-09-15T23:21:23.731432+0000","last_peered":"2024-09-15T23:21:23.731432+0000","last_clean":"2024-09-15T23:21:23.731432+0000","last_became_active":"2024-09-15T23:21:22.727718+0000","last_became_peered":"2024-09-15T23:21:22.727718+0000","last_unstale":"2024-09-15T23:21:23.731432+0000","last_undegraded":"2024-09-15T23:21:23.731432+0000","last_fullsized":"2024-09-15T23:21:23.731432+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:04.233817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.731831+0000","last_change":"2024-09-15T23:21:22.730534+0000","last_active":"2024-09-15T23:21:23.731831+0000","last_peered":"2024-09-15T23:21:23.731831+0000","last_clean":"2024-09-15T23:21:23.731831+0000","last_became_active":"2024-09-15T23:21:22.730254+0000","last_became_peered":"2024-09-15T23:21:22.730254+0000","last_unstale":"2024-09-15T23:21:23.731831+0000","last_undegraded":"2024-09-15T23:21:23.731831+0000","last_fullsized":"2024-09-15T23:21:23.731831+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:46:59.566788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.731984+0000","last_change":"2024-09-15T23:21:22.738611+0000","last_active":"2024-09-15T23:21:23.731984+0000","last_peered":"2024-09-15T23:21:23.731984+0000","last_clean":"2024-09-15T23:21:23.731984+0000","last_became_active":"2024-09-15T23:21:22.738306+0000","last_became_peered":"2024-09-15T23:21:22.738306+0000","last_unstale":"2024-09-15T23:21:23.731984+0000","last_undegraded":"2024-09-15T23:21:23.731984+0000","last_fullsized":"2024-09-15T23:21:23.731984+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:36.687412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.732121+0000","last_change":"2024-09-15T23:21:22.737302+0000","last_active":"2024-09-15T23:21:23.732121+0000","last_peered":"2024-09-15T23:21:23.732121+0000","last_clean":"2024-09-15T23:21:23.732121+0000","last_became_active":"2024-09-15T23:21:22.737036+0000","last_became_peered":"2024-09-15T23:21:22.737036+0000","last_unstale":"2024-09-15T23:21:23.732121+0000","last_undegraded":"2024-09-15T23:21:23.732121+0000","last_fullsized":"2024-09-15T23:21:23.732121+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:16:37.563172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.732406+0000","last_change":"2024-09-15T23:21:22.730551+0000","last_active":"2024-09-15T23:21:23.732406+0000","last_peered":"2024-09-15T23:21:23.732406+0000","last_clean":"2024-09-15T23:21:23.732406+0000","last_became_active":"2024-09-15T23:21:22.730157+0000","last_became_peered":"2024-09-15T23:21:22.730157+0000","last_unstale":"2024-09-15T23:21:23.732406+0000","last_undegraded":"2024-09-15T23:21:23.732406+0000","last_fullsized":"2024-09-15T23:21:23.732406+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:13:47.130972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.945336+0000","last_change":"2024-09-15T23:21:22.742689+0000","last_active":"2024-09-15T23:21:24.945336+0000","last_peered":"2024-09-15T23:21:24.945336+0000","last_clean":"2024-09-15T23:21:24.945336+0000","last_became_active":"2024-09-15T23:21:22.742360+0000","last_became_peered":"2024-09-15T23:21:22.742360+0000","last_unstale":"2024-09-15T23:21:24.945336+0000","last_undegraded":"2024-09-15T23:21:24.945336+0000","last_fullsized":"2024-09-15T23:21:24.945336+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:39:20.685332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.731926+0000","last_change":"2024-09-15T23:21:22.725781+0000","last_active":"2024-09-15T23:21:24.731926+0000","last_peered":"2024-09-15T23:21:24.731926+0000","last_clean":"2024-09-15T23:21:24.731926+0000","last_became_active":"2024-09-15T23:21:22.724370+0000","last_became_peered":"2024-09-15T23:21:22.724370+0000","last_unstale":"2024-09-15T23:21:24.731926+0000","last_undegraded":"2024-09-15T23:21:24.731926+0000","last_fullsized":"2024-09-15T23:21:24.731926+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:24.269542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.944654+0000","last_change":"2024-09-15T23:21:22.729757+0000","last_active":"2024-09-15T23:21:24.944654+0000","last_peered":"2024-09-15T23:21:24.944654+0000","last_clean":"2024-09-15T23:21:24.944654+0000","last_became_active":"2024-09-15T23:21:22.728468+0000","last_became_peered":"2024-09-15T23:21:22.728468+0000","last_unstale":"2024-09-15T23:21:24.944654+0000","last_undegraded":"2024-09-15T23:21:24.944654+0000","last_fullsized":"2024-09-15T23:21:24.944654+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:41.718126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.731461+0000","last_change":"2024-09-15T23:21:22.719925+0000","last_active":"2024-09-15T23:21:24.731461+0000","last_peered":"2024-09-15T23:21:24.731461+0000","last_clean":"2024-09-15T23:21:24.731461+0000","last_became_active":"2024-09-15T23:21:22.719532+0000","last_became_peered":"2024-09-15T23:21:22.719532+0000","last_unstale":"2024-09-15T23:21:24.731461+0000","last_undegraded":"2024-09-15T23:21:24.731461+0000","last_fullsized":"2024-09-15T23:21:24.731461+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:41.076937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.731763+0000","last_change":"2024-09-15T23:21:22.739759+0000","last_active":"2024-09-15T23:21:23.731763+0000","last_peered":"2024-09-15T23:21:23.731763+0000","last_clean":"2024-09-15T23:21:23.731763+0000","last_became_active":"2024-09-15T23:21:22.739152+0000","last_became_peered":"2024-09-15T23:21:22.739152+0000","last_unstale":"2024-09-15T23:21:23.731763+0000","last_undegraded":"2024-09-15T23:21:23.731763+0000","last_fullsized":"2024-09-15T23:21:23.731763+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:28:08.022689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.945345+0000","last_change":"2024-09-15T23:21:22.731283+0000","last_active":"2024-09-15T23:21:24.945345+0000","last_peered":"2024-09-15T23:21:24.945345+0000","last_clean":"2024-09-15T23:21:24.945345+0000","last_became_active":"2024-09-15T23:21:22.730992+0000","last_became_peered":"2024-09-15T23:21:22.730992+0000","last_unstale":"2024-09-15T23:21:24.945345+0000","last_undegraded":"2024-09-15T23:21:24.945345+0000","last_fullsized":"2024-09-15T23:21:24.945345+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:21:49.554683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1f","version":"167'4","reported_seq":18,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.732042+0000","last_change":"2024-09-15T23:21:21.737653+0000","last_active":"2024-09-15T23:21:24.732042+0000","last_peered":"2024-09-15T23:21:24.732042+0000","last_clean":"2024-09-15T23:21:24.732042+0000","last_became_active":"2024-09-15T23:21:21.737345+0000","last_became_peered":"2024-09-15T23:21:21.737345+0000","last_unstale":"2024-09-15T23:21:24.732042+0000","last_undegraded":"2024-09-15T23:21:24.732042+0000","last_fullsized":"2024-09-15T23:21:24.732042+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:56:25.666102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.731940+0000","last_change":"2024-09-15T23:21:22.737797+0000","last_active":"2024-09-15T23:21:24.731940+0000","last_peered":"2024-09-15T23:21:24.731940+0000","last_clean":"2024-09-15T23:21:24.731940+0000","last_became_active":"2024-09-15T23:21:22.737320+0000","last_became_peered":"2024-09-15T23:21:22.737320+0000","last_unstale":"2024-09-15T23:21:24.731940+0000","last_undegraded":"2024-09-15T23:21:24.731940+0000","last_fullsized":"2024-09-15T23:21:24.731940+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:08.290590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1e","version":"167'1","reported_seq":15,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.944903+0000","last_change":"2024-09-15T23:21:21.729577+0000","last_active":"2024-09-15T23:21:24.944903+0000","last_peered":"2024-09-15T23:21:24.944903+0000","last_clean":"2024-09-15T23:21:24.944903+0000","last_became_active":"2024-09-15T23:21:21.729284+0000","last_became_peered":"2024-09-15T23:21:21.729284+0000","last_unstale":"2024-09-15T23:21:24.944903+0000","last_undegraded":"2024-09-15T23:21:24.944903+0000","last_fullsized":"2024-09-15T23:21:24.944903+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:16:10.026756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.731968+0000","last_change":"2024-09-15T23:21:22.724674+0000","last_active":"2024-09-15T23:21:23.731968+0000","last_peered":"2024-09-15T23:21:23.731968+0000","last_clean":"2024-09-15T23:21:23.731968+0000","last_became_active":"2024-09-15T23:21:22.724396+0000","last_became_peered":"2024-09-15T23:21:22.724396+0000","last_unstale":"2024-09-15T23:21:23.731968+0000","last_undegraded":"2024-09-15T23:21:23.731968+0000","last_fullsized":"2024-09-15T23:21:23.731968+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:59:26.961276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1d","version":"167'2","reported_seq":16,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.731413+0000","last_change":"2024-09-15T23:21:21.727865+0000","last_active":"2024-09-15T23:21:23.731413+0000","last_peered":"2024-09-15T23:21:23.731413+0000","last_clean":"2024-09-15T23:21:23.731413+0000","last_became_active":"2024-09-15T23:21:21.727587+0000","last_became_peered":"2024-09-15T23:21:21.727587+0000","last_unstale":"2024-09-15T23:21:23.731413+0000","last_undegraded":"2024-09-15T23:21:23.731413+0000","last_fullsized":"2024-09-15T23:21:23.731413+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:36:24.962405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.944853+0000","last_change":"2024-09-15T23:21:22.731852+0000","last_active":"2024-09-15T23:21:24.944853+0000","last_peered":"2024-09-15T23:21:24.944853+0000","last_clean":"2024-09-15T23:21:24.944853+0000","last_became_active":"2024-09-15T23:21:22.731572+0000","last_became_peered":"2024-09-15T23:21:22.731572+0000","last_unstale":"2024-09-15T23:21:24.944853+0000","last_undegraded":"2024-09-15T23:21:24.944853+0000","last_fullsized":"2024-09-15T23:21:24.944853+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:49:53.278979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1c","version":"167'2","reported_seq":16,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.731538+0000","last_change":"2024-09-15T23:21:21.732886+0000","last_active":"2024-09-15T23:21:23.731538+0000","last_peered":"2024-09-15T23:21:23.731538+0000","last_clean":"2024-09-15T23:21:23.731538+0000","last_became_active":"2024-09-15T23:21:21.732469+0000","last_became_peered":"2024-09-15T23:21:21.732469+0000","last_unstale":"2024-09-15T23:21:23.731538+0000","last_undegraded":"2024-09-15T23:21:23.731538+0000","last_fullsized":"2024-09-15T23:21:23.731538+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:08.939625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.945052+0000","last_change":"2024-09-15T23:21:22.731104+0000","last_active":"2024-09-15T23:21:24.945052+0000","last_peered":"2024-09-15T23:21:24.945052+0000","last_clean":"2024-09-15T23:21:24.945052+0000","last_became_active":"2024-09-15T23:21:22.730793+0000","last_became_peered":"2024-09-15T23:21:22.730793+0000","last_unstale":"2024-09-15T23:21:24.945052+0000","last_undegraded":"2024-09-15T23:21:24.945052+0000","last_fullsized":"2024-09-15T23:21:24.945052+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:51:37.801036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1b","version":"167'1","reported_seq":15,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.731816+0000","last_change":"2024-09-15T23:21:21.737750+0000","last_active":"2024-09-15T23:21:24.731816+0000","last_peered":"2024-09-15T23:21:24.731816+0000","last_clean":"2024-09-15T23:21:24.731816+0000","last_became_active":"2024-09-15T23:21:21.737470+0000","last_became_peered":"2024-09-15T23:21:21.737470+0000","last_unstale":"2024-09-15T23:21:24.731816+0000","last_undegraded":"2024-09-15T23:21:24.731816+0000","last_fullsized":"2024-09-15T23:21:24.731816+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:21.410602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.731329+0000","last_change":"2024-09-15T23:21:22.738228+0000","last_active":"2024-09-15T23:21:23.731329+0000","last_peered":"2024-09-15T23:21:23.731329+0000","last_clean":"2024-09-15T23:21:23.731329+0000","last_became_active":"2024-09-15T23:21:22.737874+0000","last_became_peered":"2024-09-15T23:21:22.737874+0000","last_unstale":"2024-09-15T23:21:23.731329+0000","last_undegraded":"2024-09-15T23:21:23.731329+0000","last_fullsized":"2024-09-15T23:21:23.731329+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:33:12.910400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1a","version":"167'1","reported_seq":15,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.945114+0000","last_change":"2024-09-15T23:21:21.736499+0000","last_active":"2024-09-15T23:21:24.945114+0000","last_peered":"2024-09-15T23:21:24.945114+0000","last_clean":"2024-09-15T23:21:24.945114+0000","last_became_active":"2024-09-15T23:21:21.736247+0000","last_became_peered":"2024-09-15T23:21:21.736247+0000","last_unstale":"2024-09-15T23:21:24.945114+0000","last_undegraded":"2024-09-15T23:21:24.945114+0000","last_fullsized":"2024-09-15T23:21:24.945114+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:23.973307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.730830+0000","last_change":"2024-09-15T23:21:22.732634+0000","last_active":"2024-09-15T23:21:23.730830+0000","last_peered":"2024-09-15T23:21:23.730830+0000","last_clean":"2024-09-15T23:21:23.730830+0000","last_became_active":"2024-09-15T23:21:22.729431+0000","last_became_peered":"2024-09-15T23:21:22.729431+0000","last_unstale":"2024-09-15T23:21:23.730830+0000","last_undegraded":"2024-09-15T23:21:23.730830+0000","last_fullsized":"2024-09-15T23:21:23.730830+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:10:40.378875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.731567+0000","last_change":"2024-09-15T23:21:21.737521+0000","last_active":"2024-09-15T23:21:24.731567+0000","last_peered":"2024-09-15T23:21:24.731567+0000","last_clean":"2024-09-15T23:21:24.731567+0000","last_became_active":"2024-09-15T23:21:21.736819+0000","last_became_peered":"2024-09-15T23:21:21.736819+0000","last_unstale":"2024-09-15T23:21:24.731567+0000","last_undegraded":"2024-09-15T23:21:24.731567+0000","last_fullsized":"2024-09-15T23:21:24.731567+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:40.716470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.945225+0000","last_change":"2024-09-15T23:21:22.732709+0000","last_active":"2024-09-15T23:21:24.945225+0000","last_peered":"2024-09-15T23:21:24.945225+0000","last_clean":"2024-09-15T23:21:24.945225+0000","last_became_active":"2024-09-15T23:21:22.731365+0000","last_became_peered":"2024-09-15T23:21:22.731365+0000","last_unstale":"2024-09-15T23:21:24.945225+0000","last_undegraded":"2024-09-15T23:21:24.945225+0000","last_fullsized":"2024-09-15T23:21:24.945225+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:19:48.599138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.730741+0000","last_change":"2024-09-15T23:21:21.731052+0000","last_active":"2024-09-15T23:21:23.730741+0000","last_peered":"2024-09-15T23:21:23.730741+0000","last_clean":"2024-09-15T23:21:23.730741+0000","last_became_active":"2024-09-15T23:21:21.730720+0000","last_became_peered":"2024-09-15T23:21:21.730720+0000","last_unstale":"2024-09-15T23:21:23.730741+0000","last_undegraded":"2024-09-15T23:21:23.730741+0000","last_fullsized":"2024-09-15T23:21:23.730741+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:23.176751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.945483+0000","last_change":"2024-09-15T23:21:22.729989+0000","last_active":"2024-09-15T23:21:24.945483+0000","last_peered":"2024-09-15T23:21:24.945483+0000","last_clean":"2024-09-15T23:21:24.945483+0000","last_became_active":"2024-09-15T23:21:22.729681+0000","last_became_peered":"2024-09-15T23:21:22.729681+0000","last_unstale":"2024-09-15T23:21:24.945483+0000","last_undegraded":"2024-09-15T23:21:24.945483+0000","last_fullsized":"2024-09-15T23:21:24.945483+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:42.989286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.731641+0000","last_change":"2024-09-15T23:21:21.737787+0000","last_active":"2024-09-15T23:21:23.731641+0000","last_peered":"2024-09-15T23:21:23.731641+0000","last_clean":"2024-09-15T23:21:23.731641+0000","last_became_active":"2024-09-15T23:21:21.737475+0000","last_became_peered":"2024-09-15T23:21:21.737475+0000","last_unstale":"2024-09-15T23:21:23.731641+0000","last_undegraded":"2024-09-15T23:21:23.731641+0000","last_fullsized":"2024-09-15T23:21:23.731641+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:20:57.636541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.945545+0000","last_change":"2024-09-15T23:21:22.729980+0000","last_active":"2024-09-15T23:21:24.945545+0000","last_peered":"2024-09-15T23:21:24.945545+0000","last_clean":"2024-09-15T23:21:24.945545+0000","last_became_active":"2024-09-15T23:21:22.729655+0000","last_became_peered":"2024-09-15T23:21:22.729655+0000","last_unstale":"2024-09-15T23:21:24.945545+0000","last_undegraded":"2024-09-15T23:21:24.945545+0000","last_fullsized":"2024-09-15T23:21:24.945545+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:59:47.863389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.15","version":"167'3","reported_seq":17,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.731153+0000","last_change":"2024-09-15T23:21:21.733624+0000","last_active":"2024-09-15T23:21:23.731153+0000","last_peered":"2024-09-15T23:21:23.731153+0000","last_clean":"2024-09-15T23:21:23.731153+0000","last_became_active":"2024-09-15T23:21:21.733394+0000","last_became_peered":"2024-09-15T23:21:21.733394+0000","last_unstale":"2024-09-15T23:21:23.731153+0000","last_undegraded":"2024-09-15T23:21:23.731153+0000","last_fullsized":"2024-09-15T23:21:23.731153+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:02:09.186672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.731728+0000","last_change":"2024-09-15T23:21:22.722686+0000","last_active":"2024-09-15T23:21:24.731728+0000","last_peered":"2024-09-15T23:21:24.731728+0000","last_clean":"2024-09-15T23:21:24.731728+0000","last_became_active":"2024-09-15T23:21:22.722367+0000","last_became_peered":"2024-09-15T23:21:22.722367+0000","last_unstale":"2024-09-15T23:21:24.731728+0000","last_undegraded":"2024-09-15T23:21:24.731728+0000","last_fullsized":"2024-09-15T23:21:24.731728+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:42.989286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.14","version":"167'6","reported_seq":20,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.732057+0000","last_change":"2024-09-15T23:21:21.728632+0000","last_active":"2024-09-15T23:21:23.732057+0000","last_peered":"2024-09-15T23:21:23.732057+0000","last_clean":"2024-09-15T23:21:23.732057+0000","last_became_active":"2024-09-15T23:21:21.728358+0000","last_became_peered":"2024-09-15T23:21:21.728358+0000","last_unstale":"2024-09-15T23:21:23.732057+0000","last_undegraded":"2024-09-15T23:21:23.732057+0000","last_fullsized":"2024-09-15T23:21:23.732057+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:16:00.181183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.945060+0000","last_change":"2024-09-15T23:21:22.735685+0000","last_active":"2024-09-15T23:21:24.945060+0000","last_peered":"2024-09-15T23:21:24.945060+0000","last_clean":"2024-09-15T23:21:24.945060+0000","last_became_active":"2024-09-15T23:21:22.734783+0000","last_became_peered":"2024-09-15T23:21:22.734783+0000","last_unstale":"2024-09-15T23:21:24.945060+0000","last_undegraded":"2024-09-15T23:21:24.945060+0000","last_fullsized":"2024-09-15T23:21:24.945060+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:41.076937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"167'2","reported_seq":16,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.945419+0000","last_change":"2024-09-15T23:21:21.731864+0000","last_active":"2024-09-15T23:21:24.945419+0000","last_peered":"2024-09-15T23:21:24.945419+0000","last_clean":"2024-09-15T23:21:24.945419+0000","last_became_active":"2024-09-15T23:21:21.731416+0000","last_became_peered":"2024-09-15T23:21:21.731416+0000","last_unstale":"2024-09-15T23:21:24.945419+0000","last_undegraded":"2024-09-15T23:21:24.945419+0000","last_fullsized":"2024-09-15T23:21:24.945419+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:16:36.561516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.731386+0000","last_change":"2024-09-15T23:21:22.736817+0000","last_active":"2024-09-15T23:21:23.731386+0000","last_peered":"2024-09-15T23:21:23.731386+0000","last_clean":"2024-09-15T23:21:23.731386+0000","last_became_active":"2024-09-15T23:21:22.736510+0000","last_became_peered":"2024-09-15T23:21:22.736510+0000","last_unstale":"2024-09-15T23:21:23.731386+0000","last_undegraded":"2024-09-15T23:21:23.731386+0000","last_fullsized":"2024-09-15T23:21:23.731386+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:45:09.250919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.730736+0000","last_change":"2024-09-15T23:21:21.729833+0000","last_active":"2024-09-15T23:21:23.730736+0000","last_peered":"2024-09-15T23:21:23.730736+0000","last_clean":"2024-09-15T23:21:23.730736+0000","last_became_active":"2024-09-15T23:21:21.729520+0000","last_became_peered":"2024-09-15T23:21:21.729520+0000","last_unstale":"2024-09-15T23:21:23.730736+0000","last_undegraded":"2024-09-15T23:21:23.730736+0000","last_fullsized":"2024-09-15T23:21:23.730736+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:40.409130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.731778+0000","last_change":"2024-09-15T23:21:22.728715+0000","last_active":"2024-09-15T23:21:23.731778+0000","last_peered":"2024-09-15T23:21:23.731778+0000","last_clean":"2024-09-15T23:21:23.731778+0000","last_became_active":"2024-09-15T23:21:22.728424+0000","last_became_peered":"2024-09-15T23:21:22.728424+0000","last_unstale":"2024-09-15T23:21:23.731778+0000","last_undegraded":"2024-09-15T23:21:23.731778+0000","last_fullsized":"2024-09-15T23:21:23.731778+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:55:20.537036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.945614+0000","last_change":"2024-09-15T23:21:21.730006+0000","last_active":"2024-09-15T23:21:24.945614+0000","last_peered":"2024-09-15T23:21:24.945614+0000","last_clean":"2024-09-15T23:21:24.945614+0000","last_became_active":"2024-09-15T23:21:21.729554+0000","last_became_peered":"2024-09-15T23:21:21.729554+0000","last_unstale":"2024-09-15T23:21:24.945614+0000","last_undegraded":"2024-09-15T23:21:24.945614+0000","last_fullsized":"2024-09-15T23:21:24.945614+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:56:25.666102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.944702+0000","last_change":"2024-09-15T23:21:22.730786+0000","last_active":"2024-09-15T23:21:24.944702+0000","last_peered":"2024-09-15T23:21:24.944702+0000","last_clean":"2024-09-15T23:21:24.944702+0000","last_became_active":"2024-09-15T23:21:22.730507+0000","last_became_peered":"2024-09-15T23:21:22.730507+0000","last_unstale":"2024-09-15T23:21:24.944702+0000","last_undegraded":"2024-09-15T23:21:24.944702+0000","last_fullsized":"2024-09-15T23:21:24.944702+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:56:26.667757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.10","version":"167'8","reported_seq":22,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.731849+0000","last_change":"2024-09-15T23:21:21.725050+0000","last_active":"2024-09-15T23:21:23.731849+0000","last_peered":"2024-09-15T23:21:23.731849+0000","last_clean":"2024-09-15T23:21:23.731849+0000","last_became_active":"2024-09-15T23:21:21.724729+0000","last_became_peered":"2024-09-15T23:21:21.724729+0000","last_unstale":"2024-09-15T23:21:23.731849+0000","last_undegraded":"2024-09-15T23:21:23.731849+0000","last_fullsized":"2024-09-15T23:21:23.731849+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:40.841373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.945654+0000","last_change":"2024-09-15T23:21:22.731293+0000","last_active":"2024-09-15T23:21:24.945654+0000","last_peered":"2024-09-15T23:21:24.945654+0000","last_clean":"2024-09-15T23:21:24.945654+0000","last_became_active":"2024-09-15T23:21:22.730323+0000","last_became_peered":"2024-09-15T23:21:22.730323+0000","last_unstale":"2024-09-15T23:21:24.945654+0000","last_undegraded":"2024-09-15T23:21:24.945654+0000","last_fullsized":"2024-09-15T23:21:24.945654+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:08.290590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.f","version":"167'1","reported_seq":15,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.732145+0000","last_change":"2024-09-15T23:21:21.732704+0000","last_active":"2024-09-15T23:21:23.732145+0000","last_peered":"2024-09-15T23:21:23.732145+0000","last_clean":"2024-09-15T23:21:23.732145+0000","last_became_active":"2024-09-15T23:21:21.732406+0000","last_became_peered":"2024-09-15T23:21:21.732406+0000","last_unstale":"2024-09-15T23:21:23.732145+0000","last_undegraded":"2024-09-15T23:21:23.732145+0000","last_fullsized":"2024-09-15T23:21:23.732145+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:28.211194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.945693+0000","last_change":"2024-09-15T23:21:22.721205+0000","last_active":"2024-09-15T23:21:24.945693+0000","last_peered":"2024-09-15T23:21:24.945693+0000","last_clean":"2024-09-15T23:21:24.945693+0000","last_became_active":"2024-09-15T23:21:22.720797+0000","last_became_peered":"2024-09-15T23:21:22.720797+0000","last_unstale":"2024-09-15T23:21:24.945693+0000","last_undegraded":"2024-09-15T23:21:24.945693+0000","last_fullsized":"2024-09-15T23:21:24.945693+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:01:14.095086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.e","version":"167'2","reported_seq":16,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.945002+0000","last_change":"2024-09-15T23:21:21.729354+0000","last_active":"2024-09-15T23:21:24.945002+0000","last_peered":"2024-09-15T23:21:24.945002+0000","last_clean":"2024-09-15T23:21:24.945002+0000","last_became_active":"2024-09-15T23:21:21.729019+0000","last_became_peered":"2024-09-15T23:21:21.729019+0000","last_unstale":"2024-09-15T23:21:24.945002+0000","last_undegraded":"2024-09-15T23:21:24.945002+0000","last_fullsized":"2024-09-15T23:21:24.945002+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:48:34.813792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.945596+0000","last_change":"2024-09-15T23:21:22.729841+0000","last_active":"2024-09-15T23:21:24.945596+0000","last_peered":"2024-09-15T23:21:24.945596+0000","last_clean":"2024-09-15T23:21:24.945596+0000","last_became_active":"2024-09-15T23:21:22.729556+0000","last_became_peered":"2024-09-15T23:21:22.729556+0000","last_unstale":"2024-09-15T23:21:24.945596+0000","last_undegraded":"2024-09-15T23:21:24.945596+0000","last_fullsized":"2024-09-15T23:21:24.945596+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:30.257741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.d","version":"167'1","reported_seq":15,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.732454+0000","last_change":"2024-09-15T23:21:21.733634+0000","last_active":"2024-09-15T23:21:23.732454+0000","last_peered":"2024-09-15T23:21:23.732454+0000","last_clean":"2024-09-15T23:21:23.732454+0000","last_became_active":"2024-09-15T23:21:21.733369+0000","last_became_peered":"2024-09-15T23:21:21.733369+0000","last_unstale":"2024-09-15T23:21:23.732454+0000","last_undegraded":"2024-09-15T23:21:23.732454+0000","last_fullsized":"2024-09-15T23:21:23.732454+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:48:44.350966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.731231+0000","last_change":"2024-09-15T23:21:22.742582+0000","last_active":"2024-09-15T23:21:23.731231+0000","last_peered":"2024-09-15T23:21:23.731231+0000","last_clean":"2024-09-15T23:21:23.731231+0000","last_became_active":"2024-09-15T23:21:22.742236+0000","last_became_peered":"2024-09-15T23:21:22.742236+0000","last_unstale":"2024-09-15T23:21:23.731231+0000","last_undegraded":"2024-09-15T23:21:23.731231+0000","last_fullsized":"2024-09-15T23:21:23.731231+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:02:12.179771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.729308+0000","last_change":"2024-09-15T23:21:21.732863+0000","last_active":"2024-09-15T23:21:24.729308+0000","last_peered":"2024-09-15T23:21:24.729308+0000","last_clean":"2024-09-15T23:21:24.729308+0000","last_became_active":"2024-09-15T23:21:21.731828+0000","last_became_peered":"2024-09-15T23:21:21.731828+0000","last_unstale":"2024-09-15T23:21:24.729308+0000","last_undegraded":"2024-09-15T23:21:24.729308+0000","last_fullsized":"2024-09-15T23:21:24.729308+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:12.222045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.731442+0000","last_change":"2024-09-15T23:21:22.718883+0000","last_active":"2024-09-15T23:21:24.731442+0000","last_peered":"2024-09-15T23:21:24.731442+0000","last_clean":"2024-09-15T23:21:24.731442+0000","last_became_active":"2024-09-15T23:21:22.718466+0000","last_became_peered":"2024-09-15T23:21:22.718466+0000","last_unstale":"2024-09-15T23:21:24.731442+0000","last_undegraded":"2024-09-15T23:21:24.731442+0000","last_fullsized":"2024-09-15T23:21:24.731442+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:31.365481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.b","version":"167'2","reported_seq":16,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.731785+0000","last_change":"2024-09-15T23:21:21.731925+0000","last_active":"2024-09-15T23:21:23.731785+0000","last_peered":"2024-09-15T23:21:23.731785+0000","last_clean":"2024-09-15T23:21:23.731785+0000","last_became_active":"2024-09-15T23:21:21.731579+0000","last_became_peered":"2024-09-15T23:21:21.731579+0000","last_unstale":"2024-09-15T23:21:23.731785+0000","last_undegraded":"2024-09-15T23:21:23.731785+0000","last_fullsized":"2024-09-15T23:21:23.731785+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:53.737526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.731720+0000","last_change":"2024-09-15T23:21:22.728788+0000","last_active":"2024-09-15T23:21:23.731720+0000","last_peered":"2024-09-15T23:21:23.731720+0000","last_clean":"2024-09-15T23:21:23.731720+0000","last_became_active":"2024-09-15T23:21:22.727651+0000","last_became_peered":"2024-09-15T23:21:22.727651+0000","last_unstale":"2024-09-15T23:21:23.731720+0000","last_undegraded":"2024-09-15T23:21:23.731720+0000","last_fullsized":"2024-09-15T23:21:23.731720+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:38.274750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.729097+0000","last_change":"2024-09-15T23:21:21.728470+0000","last_active":"2024-09-15T23:21:24.729097+0000","last_peered":"2024-09-15T23:21:24.729097+0000","last_clean":"2024-09-15T23:21:24.729097+0000","last_became_active":"2024-09-15T23:21:21.728205+0000","last_became_peered":"2024-09-15T23:21:21.728205+0000","last_unstale":"2024-09-15T23:21:24.729097+0000","last_undegraded":"2024-09-15T23:21:24.729097+0000","last_fullsized":"2024-09-15T23:21:24.729097+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:33:14.843299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.731239+0000","last_change":"2024-09-15T23:21:22.729733+0000","last_active":"2024-09-15T23:21:24.731239+0000","last_peered":"2024-09-15T23:21:24.731239+0000","last_clean":"2024-09-15T23:21:24.731239+0000","last_became_active":"2024-09-15T23:21:22.729412+0000","last_became_peered":"2024-09-15T23:21:22.729412+0000","last_unstale":"2024-09-15T23:21:24.731239+0000","last_undegraded":"2024-09-15T23:21:24.731239+0000","last_fullsized":"2024-09-15T23:21:24.731239+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:42.248482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.944843+0000","last_change":"2024-09-15T23:21:21.738718+0000","last_active":"2024-09-15T23:21:24.944843+0000","last_peered":"2024-09-15T23:21:24.944843+0000","last_clean":"2024-09-15T23:21:24.944843+0000","last_became_active":"2024-09-15T23:21:21.738405+0000","last_became_peered":"2024-09-15T23:21:21.738405+0000","last_unstale":"2024-09-15T23:21:24.944843+0000","last_undegraded":"2024-09-15T23:21:24.944843+0000","last_fullsized":"2024-09-15T23:21:24.944843+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:50.484755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.945454+0000","last_change":"2024-09-15T23:21:22.732432+0000","last_active":"2024-09-15T23:21:24.945454+0000","last_peered":"2024-09-15T23:21:24.945454+0000","last_clean":"2024-09-15T23:21:24.945454+0000","last_became_active":"2024-09-15T23:21:22.732112+0000","last_became_peered":"2024-09-15T23:21:22.732112+0000","last_unstale":"2024-09-15T23:21:24.945454+0000","last_undegraded":"2024-09-15T23:21:24.945454+0000","last_fullsized":"2024-09-15T23:21:24.945454+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:12:55.183824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.729068+0000","last_change":"2024-09-15T23:21:21.731639+0000","last_active":"2024-09-15T23:21:24.729068+0000","last_peered":"2024-09-15T23:21:24.729068+0000","last_clean":"2024-09-15T23:21:24.729068+0000","last_became_active":"2024-09-15T23:21:21.731378+0000","last_became_peered":"2024-09-15T23:21:21.731378+0000","last_unstale":"2024-09-15T23:21:24.729068+0000","last_undegraded":"2024-09-15T23:21:24.729068+0000","last_fullsized":"2024-09-15T23:21:24.729068+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:12.282318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.732138+0000","last_change":"2024-09-15T23:21:22.730308+0000","last_active":"2024-09-15T23:21:23.732138+0000","last_peered":"2024-09-15T23:21:23.732138+0000","last_clean":"2024-09-15T23:21:23.732138+0000","last_became_active":"2024-09-15T23:21:22.729995+0000","last_became_peered":"2024-09-15T23:21:22.729995+0000","last_unstale":"2024-09-15T23:21:23.732138+0000","last_undegraded":"2024-09-15T23:21:23.732138+0000","last_fullsized":"2024-09-15T23:21:23.732138+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:44:24.974962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.7","version":"167'2","reported_seq":16,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.732023+0000","last_change":"2024-09-15T23:21:21.728922+0000","last_active":"2024-09-15T23:21:23.732023+0000","last_peered":"2024-09-15T23:21:23.732023+0000","last_clean":"2024-09-15T23:21:23.732023+0000","last_became_active":"2024-09-15T23:21:21.728643+0000","last_became_peered":"2024-09-15T23:21:21.728643+0000","last_unstale":"2024-09-15T23:21:23.732023+0000","last_undegraded":"2024-09-15T23:21:23.732023+0000","last_fullsized":"2024-09-15T23:21:23.732023+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:53.202013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.945762+0000","last_change":"2024-09-15T23:21:22.727003+0000","last_active":"2024-09-15T23:21:24.945762+0000","last_peered":"2024-09-15T23:21:24.945762+0000","last_clean":"2024-09-15T23:21:24.945762+0000","last_became_active":"2024-09-15T23:21:22.725758+0000","last_became_peered":"2024-09-15T23:21:22.725758+0000","last_unstale":"2024-09-15T23:21:24.945762+0000","last_undegraded":"2024-09-15T23:21:24.945762+0000","last_fullsized":"2024-09-15T23:21:24.945762+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:19.879555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.6","version":"168'1","reported_seq":15,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.729392+0000","last_change":"2024-09-15T23:21:21.737932+0000","last_active":"2024-09-15T23:21:24.729392+0000","last_peered":"2024-09-15T23:21:24.729392+0000","last_clean":"2024-09-15T23:21:24.729392+0000","last_became_active":"2024-09-15T23:21:21.737595+0000","last_became_peered":"2024-09-15T23:21:21.737595+0000","last_unstale":"2024-09-15T23:21:24.729392+0000","last_undegraded":"2024-09-15T23:21:24.729392+0000","last_fullsized":"2024-09-15T23:21:24.729392+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:01:08.141687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.945773+0000","last_change":"2024-09-15T23:21:22.726112+0000","last_active":"2024-09-15T23:21:24.945773+0000","last_peered":"2024-09-15T23:21:24.945773+0000","last_clean":"2024-09-15T23:21:24.945773+0000","last_became_active":"2024-09-15T23:21:22.725786+0000","last_became_peered":"2024-09-15T23:21:22.725786+0000","last_unstale":"2024-09-15T23:21:24.945773+0000","last_undegraded":"2024-09-15T23:21:24.945773+0000","last_fullsized":"2024-09-15T23:21:24.945773+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:13.784965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.731817+0000","last_change":"2024-09-15T23:21:21.737759+0000","last_active":"2024-09-15T23:21:24.731817+0000","last_peered":"2024-09-15T23:21:24.731817+0000","last_clean":"2024-09-15T23:21:24.731817+0000","last_became_active":"2024-09-15T23:21:21.737161+0000","last_became_peered":"2024-09-15T23:21:21.737161+0000","last_unstale":"2024-09-15T23:21:24.731817+0000","last_undegraded":"2024-09-15T23:21:24.731817+0000","last_fullsized":"2024-09-15T23:21:24.731817+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:17.646086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.945154+0000","last_change":"2024-09-15T23:21:22.734240+0000","last_active":"2024-09-15T23:21:24.945154+0000","last_peered":"2024-09-15T23:21:24.945154+0000","last_clean":"2024-09-15T23:21:24.945154+0000","last_became_active":"2024-09-15T23:21:22.733946+0000","last_became_peered":"2024-09-15T23:21:22.733946+0000","last_unstale":"2024-09-15T23:21:24.945154+0000","last_undegraded":"2024-09-15T23:21:24.945154+0000","last_fullsized":"2024-09-15T23:21:24.945154+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:33:51.433397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.731883+0000","last_change":"2024-09-15T23:21:21.732466+0000","last_active":"2024-09-15T23:21:23.731883+0000","last_peered":"2024-09-15T23:21:23.731883+0000","last_clean":"2024-09-15T23:21:23.731883+0000","last_became_active":"2024-09-15T23:21:21.732165+0000","last_became_peered":"2024-09-15T23:21:21.732165+0000","last_unstale":"2024-09-15T23:21:23.731883+0000","last_undegraded":"2024-09-15T23:21:23.731883+0000","last_fullsized":"2024-09-15T23:21:23.731883+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:09:18.828211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.731385+0000","last_change":"2024-09-15T23:21:22.739100+0000","last_active":"2024-09-15T23:21:23.731385+0000","last_peered":"2024-09-15T23:21:23.731385+0000","last_clean":"2024-09-15T23:21:23.731385+0000","last_became_active":"2024-09-15T23:21:22.738747+0000","last_became_peered":"2024-09-15T23:21:22.738747+0000","last_unstale":"2024-09-15T23:21:23.731385+0000","last_undegraded":"2024-09-15T23:21:23.731385+0000","last_fullsized":"2024-09-15T23:21:23.731385+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:43:06.161087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.732256+0000","last_change":"2024-09-15T23:21:21.730211+0000","last_active":"2024-09-15T23:21:23.732256+0000","last_peered":"2024-09-15T23:21:23.732256+0000","last_clean":"2024-09-15T23:21:23.732256+0000","last_became_active":"2024-09-15T23:21:21.729919+0000","last_became_peered":"2024-09-15T23:21:21.729919+0000","last_unstale":"2024-09-15T23:21:23.732256+0000","last_undegraded":"2024-09-15T23:21:23.732256+0000","last_fullsized":"2024-09-15T23:21:23.732256+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:03.318606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.731603+0000","last_change":"2024-09-15T23:21:22.736340+0000","last_active":"2024-09-15T23:21:24.731603+0000","last_peered":"2024-09-15T23:21:24.731603+0000","last_clean":"2024-09-15T23:21:24.731603+0000","last_became_active":"2024-09-15T23:21:22.724766+0000","last_became_peered":"2024-09-15T23:21:22.724766+0000","last_unstale":"2024-09-15T23:21:24.731603+0000","last_undegraded":"2024-09-15T23:21:24.731603+0000","last_fullsized":"2024-09-15T23:21:24.731603+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:36:27.856577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.945116+0000","last_change":"2024-09-15T23:21:21.730791+0000","last_active":"2024-09-15T23:21:24.945116+0000","last_peered":"2024-09-15T23:21:24.945116+0000","last_clean":"2024-09-15T23:21:24.945116+0000","last_became_active":"2024-09-15T23:21:21.730406+0000","last_became_peered":"2024-09-15T23:21:21.730406+0000","last_unstale":"2024-09-15T23:21:24.945116+0000","last_undegraded":"2024-09-15T23:21:24.945116+0000","last_fullsized":"2024-09-15T23:21:24.945116+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:04:32.575098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.944956+0000","last_change":"2024-09-15T23:21:22.733631+0000","last_active":"2024-09-15T23:21:24.944956+0000","last_peered":"2024-09-15T23:21:24.944956+0000","last_clean":"2024-09-15T23:21:24.944956+0000","last_became_active":"2024-09-15T23:21:22.732770+0000","last_became_peered":"2024-09-15T23:21:22.732770+0000","last_unstale":"2024-09-15T23:21:24.944956+0000","last_undegraded":"2024-09-15T23:21:24.944956+0000","last_fullsized":"2024-09-15T23:21:24.944956+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:44:31.365481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.731685+0000","last_change":"2024-09-15T23:21:21.737328+0000","last_active":"2024-09-15T23:21:24.731685+0000","last_peered":"2024-09-15T23:21:24.731685+0000","last_clean":"2024-09-15T23:21:24.731685+0000","last_became_active":"2024-09-15T23:21:21.736636+0000","last_became_peered":"2024-09-15T23:21:21.736636+0000","last_unstale":"2024-09-15T23:21:24.731685+0000","last_undegraded":"2024-09-15T23:21:24.731685+0000","last_fullsized":"2024-09-15T23:21:24.731685+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:04:32.575098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.731263+0000","last_change":"2024-09-15T23:21:22.722542+0000","last_active":"2024-09-15T23:21:24.731263+0000","last_peered":"2024-09-15T23:21:24.731263+0000","last_clean":"2024-09-15T23:21:24.731263+0000","last_became_active":"2024-09-15T23:21:22.722242+0000","last_became_peered":"2024-09-15T23:21:22.722242+0000","last_unstale":"2024-09-15T23:21:24.731263+0000","last_undegraded":"2024-09-15T23:21:24.731263+0000","last_fullsized":"2024-09-15T23:21:24.731263+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:58:22.603882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.731157+0000","last_change":"2024-09-15T23:21:21.736127+0000","last_active":"2024-09-15T23:21:24.731157+0000","last_peered":"2024-09-15T23:21:24.731157+0000","last_clean":"2024-09-15T23:21:24.731157+0000","last_became_active":"2024-09-15T23:21:21.735854+0000","last_became_peered":"2024-09-15T23:21:21.735854+0000","last_unstale":"2024-09-15T23:21:24.731157+0000","last_undegraded":"2024-09-15T23:21:24.731157+0000","last_fullsized":"2024-09-15T23:21:24.731157+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:00.080011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:24.945788+0000","last_change":"2024-09-15T23:21:22.737668+0000","last_active":"2024-09-15T23:21:24.945788+0000","last_peered":"2024-09-15T23:21:24.945788+0000","last_clean":"2024-09-15T23:21:24.945788+0000","last_became_active":"2024-09-15T23:21:22.737398+0000","last_became_peered":"2024-09-15T23:21:22.737398+0000","last_unstale":"2024-09-15T23:21:24.945788+0000","last_undegraded":"2024-09-15T23:21:24.945788+0000","last_fullsized":"2024-09-15T23:21:24.945788+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:21.708561+0000","last_clean_scrub_stamp":"2024-09-15T23:21:21.708561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:15:48.492974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.732063+0000","last_change":"2024-09-15T23:21:21.733268+0000","last_active":"2024-09-15T23:21:23.732063+0000","last_peered":"2024-09-15T23:21:23.732063+0000","last_clean":"2024-09-15T23:21:23.732063+0000","last_became_active":"2024-09-15T23:21:21.733003+0000","last_became_peered":"2024-09-15T23:21:21.733003+0000","last_unstale":"2024-09-15T23:21:23.732063+0000","last_undegraded":"2024-09-15T23:21:23.732063+0000","last_fullsized":"2024-09-15T23:21:23.732063+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:21:20.706905+0000","last_clean_scrub_stamp":"2024-09-15T23:21:20.706905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:41:27.535113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":442,"reported_epoch":168,"state":"active+clean","last_fresh":"2024-09-15T23:21:23.731933+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:21:23.731933+0000","last_peered":"2024-09-15T23:21:23.731933+0000","last_clean":"2024-09-15T23:21:23.731933+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:21:23.731933+0000","last_undegraded":"2024-09-15T23:21:23.731933+0000","last_fullsized":"2024-09-15T23:21:23.731933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55456,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316384,"statfs":{"total":96636764160,"available":96579977216,"internally_reserved":0,"allocated":2109440,"data_stored":927586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55444,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316396,"statfs":{"total":96636764160,"available":96579989504,"internally_reserved":0,"allocated":2097152,"data_stored":926534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51884,"kb_used_data":2648,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319956,"statfs":{"total":96636764160,"available":96583634944,"internally_reserved":0,"allocated":2711552,"data_stored":1518114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476854,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29076,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342764,"statfs":{"total":96636764160,"available":96606990336,"internally_reserved":0,"allocated":2097152,"data_stored":926022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542260,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47124,"kb_used_data":2044,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324716,"statfs":{"total":96636764160,"available":96588509184,"internally_reserved":0,"allocated":2093056,"data_stored":925952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":46135754},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542260,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51284,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320556,"statfs":{"total":96636764160,"available":96584249344,"internally_reserved":0,"allocated":2097152,"data_stored":925986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542259,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56036,"kb_used_data":2632,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315804,"statfs":{"total":96636764160,"available":96579383296,"internally_reserved":0,"allocated":2695168,"data_stored":1516992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542261,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55444,"kb_used_data":2048,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316396,"statfs":{"total":96636764160,"available":96579989504,"internally_reserved":0,"allocated":2097152,"data_stored":925986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:21:30.339 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T23:21:30.339 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T23:21:30.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.477+0000 7f5603d2c640 1 Processor -- start 2024-09-15T23:21:30.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.477+0000 7f5603d2c640 1 -- start start 2024-09-15T23:21:30.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.478+0000 7f5603d2c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f55fc06f8b0 0x7f55fc1600c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:30.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.478+0000 7f5603d2c640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55fc0b38b0 con 0x7f55fc160600 2024-09-15T23:21:30.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.478+0000 7f5603d2c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55fc0cfee0 con 0x7f55fc0cf8c0 2024-09-15T23:21:30.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.478+0000 7f5603d2c640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f55fc160a50 con 0x7f55fc06f8b0 2024-09-15T23:21:30.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.478+0000 7f5601ac8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f55fc06f8b0 0x7f55fc1600c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:30.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.478+0000 7f56012c7640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f55fc160600 0x7f55fc0cf1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49612/0 (socket says 172.21.15.123:49612) 2024-09-15T23:21:30.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.478+0000 7f5601ac8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f55fc06f8b0 0x7f55fc1600c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57750/0 (socket says 172.21.15.123:57750) 2024-09-15T23:21:30.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.478+0000 7f56012c7640 1 -- 172.21.15.123:0/1225065525 learned_addr learned my addr 172.21.15.123:0/1225065525 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:21:30.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.478+0000 7f5601ac8640 1 -- 172.21.15.123:0/1225065525 >> v1:172.21.15.188:6789/0 conn(0x7f55fc0cf8c0 legacy=0x7f55fc0b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:30.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.478+0000 7f5601ac8640 1 -- 172.21.15.123:0/1225065525 >> v1:172.21.15.123:6789/0 conn(0x7f55fc160600 legacy=0x7f55fc0cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:30.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.478+0000 7f5601ac8640 1 -- 172.21.15.123:0/1225065525 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55fc0d01c0 con 0x7f55fc06f8b0 2024-09-15T23:21:30.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.478+0000 7f5600ac6640 1 -- 172.21.15.123:0/1225065525 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 909707052 0 0) 0x7f55fc0b38b0 con 0x7f55fc160600 2024-09-15T23:21:30.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.479+0000 7f5601ac8640 1 --2- 172.21.15.123:0/1225065525 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55fc06f8b0 0x7f55fc1600c0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f55f80097a0 tx=0x7f55f802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=256157a29dfc261d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:30.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.479+0000 7f5600ac6640 1 -- 172.21.15.123:0/1225065525 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f8037070 con 0x7f55fc06f8b0 2024-09-15T23:21:30.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.479+0000 7f5600ac6640 1 -- 172.21.15.123:0/1225065525 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55f802ae50 con 0x7f55fc06f8b0 2024-09-15T23:21:30.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.479+0000 7f5600ac6640 1 -- 172.21.15.123:0/1225065525 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f8032660 con 0x7f55fc06f8b0 2024-09-15T23:21:30.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.480+0000 7f5603d2c640 1 -- 172.21.15.123:0/1225065525 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55fc06f8b0 msgr2=0x7f55fc1600c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:30.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.480+0000 7f5603d2c640 1 --2- 172.21.15.123:0/1225065525 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55fc06f8b0 0x7f55fc1600c0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f55f80097a0 tx=0x7f55f802a140 comp rx=0 tx=0).stop 2024-09-15T23:21:30.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.480+0000 7f5603d2c640 1 -- 172.21.15.123:0/1225065525 shutdown_connections 2024-09-15T23:21:30.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.480+0000 7f5603d2c640 1 --2- 172.21.15.123:0/1225065525 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55fc06f8b0 0x7f55fc1600c0 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:30.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.480+0000 7f5603d2c640 1 -- 172.21.15.123:0/1225065525 >> 172.21.15.123:0/1225065525 conn(0x7f55fc0b2510 msgr2=0x7f55fc0b28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:30.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.480+0000 7f5603d2c640 1 -- 172.21.15.123:0/1225065525 shutdown_connections 2024-09-15T23:21:30.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.480+0000 7f5603d2c640 1 -- 172.21.15.123:0/1225065525 wait complete. 2024-09-15T23:21:30.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.481+0000 7f5603d2c640 1 Processor -- start 2024-09-15T23:21:30.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.481+0000 7f5603d2c640 1 -- start start 2024-09-15T23:21:30.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.482+0000 7f5603d2c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f55fc06f8b0 0x7f55fc0b0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:30.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.482+0000 7f5603d2c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55fc0cf8c0 0x7f55fc0b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:30.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.482+0000 7f5603d2c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f55fc160600 0x7f55fc147a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:30.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.482+0000 7f5603d2c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f55fc06fc90 con 0x7f55fc0cf8c0 2024-09-15T23:21:30.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.482+0000 7f5603d2c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f55fc0d04a0 con 0x7f55fc06f8b0 2024-09-15T23:21:30.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.482+0000 7f5603d2c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f55fc0b4750 con 0x7f55fc160600 2024-09-15T23:21:30.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.482+0000 7f56012c7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55fc0cf8c0 0x7f55fc0b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:30.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.482+0000 7f56012c7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55fc0cf8c0 0x7f55fc0b0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57756/0 (socket says 172.21.15.123:57756) 2024-09-15T23:21:30.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.482+0000 7f56012c7640 1 -- 172.21.15.123:0/464805422 learned_addr learned my addr 172.21.15.123:0/464805422 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:30.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.482+0000 7f5601ac8640 1 --2- 172.21.15.123:0/464805422 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f55fc06f8b0 0x7f55fc0b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:30.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.482+0000 7f56012c7640 1 -- 172.21.15.123:0/464805422 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f55fc160600 msgr2=0x7f55fc147a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:30.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.482+0000 7f56012c7640 1 --2- 172.21.15.123:0/464805422 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f55fc160600 0x7f55fc147a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:30.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.482+0000 7f56012c7640 1 -- 172.21.15.123:0/464805422 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f55fc06f8b0 msgr2=0x7f55fc0b0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:30.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.482+0000 7f56012c7640 1 --2- 172.21.15.123:0/464805422 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f55fc06f8b0 0x7f55fc0b0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:30.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.482+0000 7f56012c7640 1 -- 172.21.15.123:0/464805422 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55fc1564c0 con 0x7f55fc0cf8c0 2024-09-15T23:21:30.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.482+0000 7f56012c7640 1 --2- 172.21.15.123:0/464805422 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55fc0cf8c0 0x7f55fc0b0ab0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f55ec00c500 tx=0x7f55ec00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:30.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.482+0000 7f55f27fc640 1 -- 172.21.15.123:0/464805422 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ec018070 con 0x7f55fc0cf8c0 2024-09-15T23:21:30.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.482+0000 7f55f27fc640 1 -- 172.21.15.123:0/464805422 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55ec007580 con 0x7f55fc0cf8c0 2024-09-15T23:21:30.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.482+0000 7f5603d2c640 1 -- 172.21.15.123:0/464805422 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55fc148630 con 0x7f55fc0cf8c0 2024-09-15T23:21:30.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.482+0000 7f55f27fc640 1 -- 172.21.15.123:0/464805422 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55ec004a20 con 0x7f55fc0cf8c0 2024-09-15T23:21:30.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.483+0000 7f5603d2c640 1 -- 172.21.15.123:0/464805422 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55fc148bf0 con 0x7f55fc0cf8c0 2024-09-15T23:21:30.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.483+0000 7f5603d2c640 1 -- 172.21.15.123:0/464805422 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55fc1600c0 con 0x7f55fc0cf8c0 2024-09-15T23:21:30.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.484+0000 7f55f27fc640 1 -- 172.21.15.123:0/464805422 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f55ec01b070 con 0x7f55fc0cf8c0 2024-09-15T23:21:30.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.484+0000 7f55f27fc640 1 --2- 172.21.15.123:0/464805422 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f55e006c2e0 0x7f55e006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:30.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.485+0000 7f55f27fc640 1 -- 172.21.15.123:0/464805422 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7f55ec08a6d0 con 0x7f55fc0cf8c0 2024-09-15T23:21:30.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.485+0000 7f5601ac8640 1 --2- 172.21.15.123:0/464805422 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f55e006c2e0 0x7f55e006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:30.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.485+0000 7f5601ac8640 1 --2- 172.21.15.123:0/464805422 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f55e006c2e0 0x7f55e006e7a0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f55f8034000 tx=0x7f55f802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:30.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.489+0000 7f55f27fc640 1 -- 172.21.15.123:0/464805422 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f55fc1564c0 con 0x7f55fc0cf8c0 2024-09-15T23:21:30.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.718+0000 7f5603d2c640 1 -- 172.21.15.123:0/464805422 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f55fc15dda0 con 0x7f55fc0cf8c0 2024-09-15T23:21:30.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.719+0000 7f55f27fc640 1 -- 172.21.15.123:0/464805422 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) ==== 190+0+147 (secure 0 0 0) 0x7f55ec058e40 con 0x7f55fc0cf8c0 2024-09-15T23:21:30.721 INFO:teuthology.orchestra.run.smithi123.stdout:[client.0] 2024-09-15T23:21:30.721 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCNaedmzQPqJRAAhUf1dnVYohN4obCfeu8+7g== 2024-09-15T23:21:30.721 INFO:teuthology.orchestra.run.smithi123.stdout: caps mds = "allow" 2024-09-15T23:21:30.721 INFO:teuthology.orchestra.run.smithi123.stdout: caps mon = "allow r" 2024-09-15T23:21:30.721 INFO:teuthology.orchestra.run.smithi123.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T23:21:30.721 INFO:teuthology.orchestra.run.smithi123.stderr:updated caps for client.0 2024-09-15T23:21:30.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.722+0000 7f5603d2c640 1 -- 172.21.15.123:0/464805422 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f55e006c2e0 msgr2=0x7f55e006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:30.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.722+0000 7f5603d2c640 1 --2- 172.21.15.123:0/464805422 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f55e006c2e0 0x7f55e006e7a0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f55f8034000 tx=0x7f55f802e000 comp rx=0 tx=0).stop 2024-09-15T23:21:30.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.722+0000 7f5603d2c640 1 -- 172.21.15.123:0/464805422 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55fc0cf8c0 msgr2=0x7f55fc0b0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:30.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.722+0000 7f5603d2c640 1 --2- 172.21.15.123:0/464805422 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55fc0cf8c0 0x7f55fc0b0ab0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f55ec00c500 tx=0x7f55ec00c9c0 comp rx=0 tx=0).stop 2024-09-15T23:21:30.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.722+0000 7f5603d2c640 1 -- 172.21.15.123:0/464805422 shutdown_connections 2024-09-15T23:21:30.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.722+0000 7f5603d2c640 1 --2- 172.21.15.123:0/464805422 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f55fc160600 0x7f55fc147a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:30.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.722+0000 7f5603d2c640 1 --2- 172.21.15.123:0/464805422 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f55e006c2e0 0x7f55e006e7a0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:30.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.722+0000 7f5603d2c640 1 --2- 172.21.15.123:0/464805422 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f55fc0cf8c0 0x7f55fc0b0ab0 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:30.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.722+0000 7f5603d2c640 1 --2- 172.21.15.123:0/464805422 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f55fc06f8b0 0x7f55fc0b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:30.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.722+0000 7f5603d2c640 1 -- 172.21.15.123:0/464805422 >> 172.21.15.123:0/464805422 conn(0x7f55fc0b2510 msgr2=0x7f55fc15ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:30.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.722+0000 7f5603d2c640 1 -- 172.21.15.123:0/464805422 shutdown_connections 2024-09-15T23:21:30.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.722+0000 7f5603d2c640 1 -- 172.21.15.123:0/464805422 wait complete. 2024-09-15T23:21:30.741 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:21:30.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.838+0000 7f1a75978640 1 Processor -- start 2024-09-15T23:21:30.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.839+0000 7f1a75978640 1 -- start start 2024-09-15T23:21:30.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.839+0000 7f1a75978640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a70073330 0x7f1a70073990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:30.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.839+0000 7f1a75978640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1a70162b10 0x7f1a700ce260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:30.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.839+0000 7f1a75978640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a701632f0 con 0x7f1a7015e740 2024-09-15T23:21:30.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.839+0000 7f1a75978640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f1a7006d430 con 0x7f1a70162b10 2024-09-15T23:21:30.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.839+0000 7f1a75978640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1a7006cb00 con 0x7f1a70073330 2024-09-15T23:21:30.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.840+0000 7f1a6f7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1a70162b10 0x7f1a700ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:30.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.840+0000 7f1a6f7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1a70162b10 0x7f1a700ce260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57768/0 (socket says 172.21.15.123:57768) 2024-09-15T23:21:30.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.840+0000 7f1a6f7fe640 1 -- 172.21.15.123:0/255469668 learned_addr learned my addr 172.21.15.123:0/255469668 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:30.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.840+0000 7f1a6f7fe640 1 -- 172.21.15.123:0/255469668 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a70073330 msgr2=0x7f1a70073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:30.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.840+0000 7f1a67fff640 1 --2- 172.21.15.123:0/255469668 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a70073330 0x7f1a70073990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:30.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.840+0000 7f1a6f7fe640 1 --2- 172.21.15.123:0/255469668 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a70073330 0x7f1a70073990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:30.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.840+0000 7f1a6f7fe640 1 -- 172.21.15.123:0/255469668 >> v1:172.21.15.188:6789/0 conn(0x7f1a7015e740 legacy=0x7f1a70162400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:30.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.840+0000 7f1a6f7fe640 1 -- 172.21.15.123:0/255469668 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a7006cde0 con 0x7f1a70162b10 2024-09-15T23:21:30.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.841+0000 7f1a6f7fe640 1 --2- 172.21.15.123:0/255469668 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a70162b10 0x7f1a700ce260 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f1a7006d5b0 tx=0x7f1a6802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba0197881503314c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:30.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.841+0000 7f1a6e7fc640 1 -- 172.21.15.123:0/255469668 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a68036070 con 0x7f1a70162b10 2024-09-15T23:21:30.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.841+0000 7f1a6e7fc640 1 -- 172.21.15.123:0/255469668 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a68031600 con 0x7f1a70162b10 2024-09-15T23:21:30.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.841+0000 7f1a6e7fc640 1 -- 172.21.15.123:0/255469668 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a680319d0 con 0x7f1a70162b10 2024-09-15T23:21:30.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.841+0000 7f1a75978640 1 -- 172.21.15.123:0/255469668 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a70162b10 msgr2=0x7f1a700ce260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:30.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.841+0000 7f1a75978640 1 --2- 172.21.15.123:0/255469668 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a70162b10 0x7f1a700ce260 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f1a7006d5b0 tx=0x7f1a6802a6c0 comp rx=0 tx=0).stop 2024-09-15T23:21:30.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.841+0000 7f1a75978640 1 -- 172.21.15.123:0/255469668 shutdown_connections 2024-09-15T23:21:30.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.841+0000 7f1a75978640 1 --2- 172.21.15.123:0/255469668 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a70162b10 0x7f1a700ce260 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:30.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.841+0000 7f1a75978640 1 --2- 172.21.15.123:0/255469668 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a70073330 0x7f1a70073990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:30.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.841+0000 7f1a75978640 1 -- 172.21.15.123:0/255469668 >> 172.21.15.123:0/255469668 conn(0x7f1a7006f400 msgr2=0x7f1a7006f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:30.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.841+0000 7f1a75978640 1 -- 172.21.15.123:0/255469668 shutdown_connections 2024-09-15T23:21:30.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.841+0000 7f1a75978640 1 -- 172.21.15.123:0/255469668 wait complete. 2024-09-15T23:21:30.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.842+0000 7f1a75978640 1 Processor -- start 2024-09-15T23:21:30.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.843+0000 7f1a75978640 1 -- start start 2024-09-15T23:21:30.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.843+0000 7f1a75978640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a70073330 0x7f1a700b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:30.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.843+0000 7f1a75978640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a7015e740 0x7f1a70157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:30.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.843+0000 7f1a75978640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a70162b10 0x7f1a701611c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:30.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.843+0000 7f1a75978640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1a70162f40 con 0x7f1a70162b10 2024-09-15T23:21:30.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.843+0000 7f1a75978640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1a700ae880 con 0x7f1a7015e740 2024-09-15T23:21:30.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.843+0000 7f1a75978640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1a701e94a0 con 0x7f1a70073330 2024-09-15T23:21:30.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.843+0000 7f1a6f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a70162b10 0x7f1a701611c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:30.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.843+0000 7f1a6f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a70162b10 0x7f1a701611c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57778/0 (socket says 172.21.15.123:57778) 2024-09-15T23:21:30.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.843+0000 7f1a6f7fe640 1 -- 172.21.15.123:0/2098798020 learned_addr learned my addr 172.21.15.123:0/2098798020 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:30.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.844+0000 7f1a67fff640 1 --2- 172.21.15.123:0/2098798020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a7015e740 0x7f1a70157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:30.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.844+0000 7f1a6effd640 1 --2- 172.21.15.123:0/2098798020 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a70073330 0x7f1a700b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:30.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.844+0000 7f1a6f7fe640 1 -- 172.21.15.123:0/2098798020 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a70073330 msgr2=0x7f1a700b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:30.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.844+0000 7f1a6f7fe640 1 --2- 172.21.15.123:0/2098798020 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a70073330 0x7f1a700b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:30.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.844+0000 7f1a6f7fe640 1 -- 172.21.15.123:0/2098798020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a7015e740 msgr2=0x7f1a70157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:30.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.844+0000 7f1a6f7fe640 1 --2- 172.21.15.123:0/2098798020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a7015e740 0x7f1a70157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:30.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.844+0000 7f1a6f7fe640 1 -- 172.21.15.123:0/2098798020 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a700b4240 con 0x7f1a70162b10 2024-09-15T23:21:30.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.844+0000 7f1a6effd640 1 --2- 172.21.15.123:0/2098798020 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a70073330 0x7f1a700b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:21:30.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.844+0000 7f1a67fff640 1 --2- 172.21.15.123:0/2098798020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a7015e740 0x7f1a70157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:21:30.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.844+0000 7f1a6f7fe640 1 --2- 172.21.15.123:0/2098798020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a70162b10 0x7f1a701611c0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f1a68009f40 tx=0x7f1a68004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:30.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.844+0000 7f1a6cff9640 1 -- 172.21.15.123:0/2098798020 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a68041020 con 0x7f1a70162b10 2024-09-15T23:21:30.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.844+0000 7f1a6cff9640 1 -- 172.21.15.123:0/2098798020 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a68007820 con 0x7f1a70162b10 2024-09-15T23:21:30.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.844+0000 7f1a75978640 1 -- 172.21.15.123:0/2098798020 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a700b4520 con 0x7f1a70162b10 2024-09-15T23:21:30.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.844+0000 7f1a6cff9640 1 -- 172.21.15.123:0/2098798020 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a68036040 con 0x7f1a70162b10 2024-09-15T23:21:30.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.844+0000 7f1a75978640 1 -- 172.21.15.123:0/2098798020 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a700b4ea0 con 0x7f1a70162b10 2024-09-15T23:21:30.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.845+0000 7f1a75978640 1 -- 172.21.15.123:0/2098798020 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a70162220 con 0x7f1a70162b10 2024-09-15T23:21:30.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.846+0000 7f1a6cff9640 1 -- 172.21.15.123:0/2098798020 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1a68044020 con 0x7f1a70162b10 2024-09-15T23:21:30.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.846+0000 7f1a6cff9640 1 --2- 172.21.15.123:0/2098798020 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1a5006c2b0 0x7f1a5006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:30.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.846+0000 7f1a6cff9640 1 -- 172.21.15.123:0/2098798020 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7f1a680ac2e0 con 0x7f1a70162b10 2024-09-15T23:21:30.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.846+0000 7f1a6effd640 1 --2- 172.21.15.123:0/2098798020 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1a5006c2b0 0x7f1a5006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:30.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.847+0000 7f1a6effd640 1 --2- 172.21.15.123:0/2098798020 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1a5006c2b0 0x7f1a5006e770 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f1a60003eb0 tx=0x7f1a60009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:30.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:30.850+0000 7f1a6cff9640 1 -- 172.21.15.123:0/2098798020 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1a70162220 con 0x7f1a70162b10 2024-09-15T23:21:31.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.051+0000 7f1a75978640 1 -- 172.21.15.123:0/2098798020 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1a700b4a40 con 0x7f1a70162b10 2024-09-15T23:21:31.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.052+0000 7f1a6cff9640 1 -- 172.21.15.123:0/2098798020 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) ==== 95+0+5241 (secure 0 0 0) 0x7f1a6804b030 con 0x7f1a70162b10 2024-09-15T23:21:31.053 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:31.053 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":100,"btime":"2024-09-15T23:21:24:727971+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7214,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/1648353391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1648353391},{"type":"v1","addr":"172.21.15.188:6837","nonce":1648353391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8122,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/1714717257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":1714717257},{"type":"v1","addr":"172.21.15.188:6836","nonce":1714717257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":9552,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/3722702026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3722702026},{"type":"v1","addr":"172.21.15.123:6833","nonce":3722702026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:21:22.066391+0000","modified":"2024-09-15T23:21:24.056941+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9564},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9564":{"gid":9564,"name":"a","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/1883512279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1883512279},{"type":"v1","addr":"172.21.15.123:6835","nonce":1883512279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9564,"qdb_cluster":[9564]},"id":11}]} 2024-09-15T23:21:31.054 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 100 2024-09-15T23:21:31.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.054+0000 7f1a75978640 1 -- 172.21.15.123:0/2098798020 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1a5006c2b0 msgr2=0x7f1a5006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:31.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.054+0000 7f1a75978640 1 --2- 172.21.15.123:0/2098798020 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1a5006c2b0 0x7f1a5006e770 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f1a60003eb0 tx=0x7f1a60009040 comp rx=0 tx=0).stop 2024-09-15T23:21:31.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.054+0000 7f1a75978640 1 -- 172.21.15.123:0/2098798020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a70162b10 msgr2=0x7f1a701611c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:31.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.054+0000 7f1a75978640 1 --2- 172.21.15.123:0/2098798020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a70162b10 0x7f1a701611c0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f1a68009f40 tx=0x7f1a68004a40 comp rx=0 tx=0).stop 2024-09-15T23:21:31.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.054+0000 7f1a75978640 1 -- 172.21.15.123:0/2098798020 shutdown_connections 2024-09-15T23:21:31.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.054+0000 7f1a75978640 1 --2- 172.21.15.123:0/2098798020 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1a5006c2b0 0x7f1a5006e770 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.054+0000 7f1a75978640 1 --2- 172.21.15.123:0/2098798020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1a70162b10 0x7f1a701611c0 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.054+0000 7f1a75978640 1 --2- 172.21.15.123:0/2098798020 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1a7015e740 0x7f1a70157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.054+0000 7f1a75978640 1 --2- 172.21.15.123:0/2098798020 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1a70073330 0x7f1a700b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.054+0000 7f1a75978640 1 -- 172.21.15.123:0/2098798020 >> 172.21.15.123:0/2098798020 conn(0x7f1a7006f400 msgr2=0x7f1a700d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:31.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.054+0000 7f1a75978640 1 -- 172.21.15.123:0/2098798020 shutdown_connections 2024-09-15T23:21:31.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.054+0000 7f1a75978640 1 -- 172.21.15.123:0/2098798020 wait complete. 2024-09-15T23:21:31.470 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 100, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:21:22.066391+0000', 'modified': '2024-09-15T23:21:24.056941+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9564}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9564': {'gid': 9564, 'name': 'a', 'rank': 0, 'incarnation': 98, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.123:6835/1883512279', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6834', 'nonce': 1883512279}, {'type': 'v1', 'addr': '172.21.15.123:6835', 'nonce': 1883512279}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9564, 'qdb_cluster': [9564]} 2024-09-15T23:21:31.470 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:21:31.470 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-15T23:21:31.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.570+0000 7f7480ffd640 1 Processor -- start 2024-09-15T23:21:31.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.570+0000 7f7480ffd640 1 -- start start 2024-09-15T23:21:31.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.571+0000 7f7480ffd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f747c0b2d40 0x7f747c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:31.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.571+0000 7f7480ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f747c13eb20 0x7f747c06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:31.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.571+0000 7f7480ffd640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f747c071180 con 0x7f747c15bcf0 2024-09-15T23:21:31.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.571+0000 7f7480ffd640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f747c15c890 con 0x7f747c13eb20 2024-09-15T23:21:31.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.571+0000 7f7480ffd640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f747c071ab0 con 0x7f747c0b2d40 2024-09-15T23:21:31.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.571+0000 7f7479d9b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f747c13eb20 0x7f747c06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:31.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.571+0000 7f747ad9d640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f747c15bcf0 0x7f747c15c180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49618/0 (socket says 172.21.15.123:49618) 2024-09-15T23:21:31.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.571+0000 7f747ad9d640 1 -- 172.21.15.123:0/665955481 learned_addr learned my addr 172.21.15.123:0/665955481 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:21:31.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.571+0000 7f747a59c640 1 --2- 172.21.15.123:0/665955481 >> v2:172.21.15.188:3300/0 conn(0x7f747c0b2d40 0x7f747c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:31.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.571+0000 7f747959a640 1 -- 172.21.15.123:0/665955481 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1437099432 0 0) 0x7f747c071180 con 0x7f747c15bcf0 2024-09-15T23:21:31.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.571+0000 7f747959a640 1 -- 172.21.15.123:0/665955481 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7464005730 con 0x7f747c15bcf0 2024-09-15T23:21:31.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.571+0000 7f7479d9b640 1 -- 172.21.15.123:0/665955481 >> v2:172.21.15.188:3300/0 conn(0x7f747c0b2d40 msgr2=0x7f747c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:31.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.571+0000 7f7479d9b640 1 --2- 172.21.15.123:0/665955481 >> v2:172.21.15.188:3300/0 conn(0x7f747c0b2d40 0x7f747c06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.571+0000 7f7479d9b640 1 -- 172.21.15.123:0/665955481 >> v1:172.21.15.123:6789/0 conn(0x7f747c15bcf0 legacy=0x7f747c15c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:31.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.571+0000 7f7479d9b640 1 -- 172.21.15.123:0/665955481 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f747c071460 con 0x7f747c13eb20 2024-09-15T23:21:31.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.572+0000 7f7479d9b640 1 --2- 172.21.15.123:0/665955481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f747c13eb20 0x7f747c06c150 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f747c069be0 tx=0x7f747002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d63d7c956493f04 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:31.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.572+0000 7f747959a640 1 -- 172.21.15.123:0/665955481 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7470037070 con 0x7f747c13eb20 2024-09-15T23:21:31.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.572+0000 7f747959a640 1 -- 172.21.15.123:0/665955481 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7470032440 con 0x7f747c13eb20 2024-09-15T23:21:31.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.572+0000 7f747959a640 1 -- 172.21.15.123:0/665955481 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7470032810 con 0x7f747c13eb20 2024-09-15T23:21:31.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.573+0000 7f7480ffd640 1 -- 172.21.15.123:0/665955481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f747c13eb20 msgr2=0x7f747c06c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:31.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.573+0000 7f7480ffd640 1 --2- 172.21.15.123:0/665955481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f747c13eb20 0x7f747c06c150 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f747c069be0 tx=0x7f747002a1a0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.573+0000 7f7480ffd640 1 -- 172.21.15.123:0/665955481 shutdown_connections 2024-09-15T23:21:31.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.573+0000 7f7480ffd640 1 --2- 172.21.15.123:0/665955481 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f747c13eb20 0x7f747c06c150 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.573+0000 7f7480ffd640 1 --2- 172.21.15.123:0/665955481 >> v2:172.21.15.188:3300/0 conn(0x7f747c0b2d40 0x7f747c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.573+0000 7f7480ffd640 1 -- 172.21.15.123:0/665955481 >> 172.21.15.123:0/665955481 conn(0x7f747c0ccec0 msgr2=0x7f747c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:31.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.573+0000 7f7480ffd640 1 -- 172.21.15.123:0/665955481 shutdown_connections 2024-09-15T23:21:31.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.573+0000 7f7480ffd640 1 -- 172.21.15.123:0/665955481 wait complete. 2024-09-15T23:21:31.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.574+0000 7f7480ffd640 1 Processor -- start 2024-09-15T23:21:31.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.574+0000 7f7480ffd640 1 -- start start 2024-09-15T23:21:31.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.575+0000 7f7480ffd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f747c0b2d40 0x7f747c13d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:31.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.575+0000 7f7480ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f747c13eb20 0x7f747c0b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:31.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.575+0000 7f7480ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f747c15bcf0 0x7f747c0b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:31.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.575+0000 7f7480ffd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f747c0720c0 con 0x7f747c15bcf0 2024-09-15T23:21:31.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.575+0000 7f7480ffd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f747c071f40 con 0x7f747c13eb20 2024-09-15T23:21:31.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.575+0000 7f7480ffd640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f747c072240 con 0x7f747c0b2d40 2024-09-15T23:21:31.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.575+0000 7f747ad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f747c15bcf0 0x7f747c0b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:31.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.575+0000 7f747ad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f747c15bcf0 0x7f747c0b41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57788/0 (socket says 172.21.15.123:57788) 2024-09-15T23:21:31.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.575+0000 7f747ad9d640 1 -- 172.21.15.123:0/595588892 learned_addr learned my addr 172.21.15.123:0/595588892 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:31.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.575+0000 7f747a59c640 1 --2- 172.21.15.123:0/595588892 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f747c0b2d40 0x7f747c13d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:31.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.575+0000 7f7479d9b640 1 --2- 172.21.15.123:0/595588892 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f747c13eb20 0x7f747c0b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:31.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.575+0000 7f747ad9d640 1 -- 172.21.15.123:0/595588892 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f747c0b2d40 msgr2=0x7f747c13d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:31.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.575+0000 7f747ad9d640 1 --2- 172.21.15.123:0/595588892 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f747c0b2d40 0x7f747c13d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.575+0000 7f747ad9d640 1 -- 172.21.15.123:0/595588892 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f747c13eb20 msgr2=0x7f747c0b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:31.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.575+0000 7f747ad9d640 1 --2- 172.21.15.123:0/595588892 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f747c13eb20 0x7f747c0b3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.575+0000 7f747ad9d640 1 -- 172.21.15.123:0/595588892 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f747c13ded0 con 0x7f747c15bcf0 2024-09-15T23:21:31.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.575+0000 7f747ad9d640 1 --2- 172.21.15.123:0/595588892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f747c15bcf0 0x7f747c0b41a0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f747400cad0 tx=0x7f747400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:31.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.576+0000 7f746affd640 1 -- 172.21.15.123:0/595588892 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7474017070 con 0x7f747c15bcf0 2024-09-15T23:21:31.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.576+0000 7f746affd640 1 -- 172.21.15.123:0/595588892 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f747400ac30 con 0x7f747c15bcf0 2024-09-15T23:21:31.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.576+0000 7f7480ffd640 1 -- 172.21.15.123:0/595588892 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f747c1f5240 con 0x7f747c15bcf0 2024-09-15T23:21:31.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.576+0000 7f746affd640 1 -- 172.21.15.123:0/595588892 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7474012400 con 0x7f747c15bcf0 2024-09-15T23:21:31.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.576+0000 7f7480ffd640 1 -- 172.21.15.123:0/595588892 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f747c157180 con 0x7f747c15bcf0 2024-09-15T23:21:31.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.577+0000 7f746affd640 1 -- 172.21.15.123:0/595588892 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f747401a070 con 0x7f747c15bcf0 2024-09-15T23:21:31.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.578+0000 7f746affd640 1 --2- 172.21.15.123:0/595588892 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f745c06c2b0 0x7f745c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:31.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.578+0000 7f746affd640 1 -- 172.21.15.123:0/595588892 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7f747408b140 con 0x7f747c15bcf0 2024-09-15T23:21:31.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.578+0000 7f747a59c640 1 --2- 172.21.15.123:0/595588892 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f745c06c2b0 0x7f745c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:31.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.578+0000 7f747a59c640 1 --2- 172.21.15.123:0/595588892 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f745c06c2b0 0x7f745c06e770 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f746c006fd0 tx=0x7f746c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:31.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.578+0000 7f7483e7b740 1 Processor -- start 2024-09-15T23:21:31.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.579+0000 7f7483e7b740 1 -- start start 2024-09-15T23:21:31.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.579+0000 7f7483e7b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555cc2a242c0 0x555cc2a69a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:31.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.579+0000 7f7483e7b740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555cc2a21a80 0x555cc2a246a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:31.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.579+0000 7f7483e7b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555cc2a25a50 0x555cc2a1e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:31.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.579+0000 7f7483e7b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x555cc2986520 con 0x555cc2a25a50 2024-09-15T23:21:31.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.579+0000 7f7483e7b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x555cc292e3e0 con 0x555cc2a242c0 2024-09-15T23:21:31.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.579+0000 7f7483e7b740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x555cc29824e0 con 0x555cc2a21a80 2024-09-15T23:21:31.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.579+0000 7f747ad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555cc2a25a50 0x555cc2a1e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:31.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.579+0000 7f747a59c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555cc2a242c0 0x555cc2a69a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:31.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.579+0000 7f747ad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555cc2a25a50 0x555cc2a1e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57792/0 (socket says 172.21.15.123:57792) 2024-09-15T23:21:31.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.579+0000 7f747a59c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555cc2a242c0 0x555cc2a69a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:42978/0 (socket says 172.21.15.123:42978) 2024-09-15T23:21:31.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.579+0000 7f747ad9d640 1 -- 172.21.15.123:0/4001086399 learned_addr learned my addr 172.21.15.123:0/4001086399 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:31.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.579+0000 7f7479d9b640 1 --2- 172.21.15.123:0/4001086399 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555cc2a21a80 0x555cc2a246a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:31.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.580+0000 7f747ad9d640 1 -- 172.21.15.123:0/4001086399 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555cc2a21a80 msgr2=0x555cc2a246a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:31.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.580+0000 7f747ad9d640 1 --2- 172.21.15.123:0/4001086399 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555cc2a21a80 0x555cc2a246a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.580+0000 7f747ad9d640 1 -- 172.21.15.123:0/4001086399 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555cc2a242c0 msgr2=0x555cc2a69a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:31.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.580+0000 7f747ad9d640 1 --2- 172.21.15.123:0/4001086399 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555cc2a242c0 0x555cc2a69a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.580+0000 7f747ad9d640 1 -- 172.21.15.123:0/4001086399 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cc29492f0 con 0x555cc2a25a50 2024-09-15T23:21:31.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.580+0000 7f747ad9d640 1 --2- 172.21.15.123:0/4001086399 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555cc2a25a50 0x555cc2a1e8b0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f74740895e0 tx=0x7f747405d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3bc668abcf138ad server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:31.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.580+0000 7f745bfff640 1 -- 172.21.15.123:0/4001086399 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74740558d0 con 0x555cc2a25a50 2024-09-15T23:21:31.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.580+0000 7f745bfff640 1 -- 172.21.15.123:0/4001086399 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f747405d120 con 0x555cc2a25a50 2024-09-15T23:21:31.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.580+0000 7f745bfff640 1 -- 172.21.15.123:0/4001086399 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7474055a70 con 0x555cc2a25a50 2024-09-15T23:21:31.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.581+0000 7f7483e7b740 1 -- 172.21.15.123:0/4001086399 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555cc2a25a50 msgr2=0x555cc2a1e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:31.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.581+0000 7f7483e7b740 1 --2- 172.21.15.123:0/4001086399 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555cc2a25a50 0x555cc2a1e8b0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f74740895e0 tx=0x7f747405d560 comp rx=0 tx=0).stop 2024-09-15T23:21:31.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.581+0000 7f7483e7b740 1 -- 172.21.15.123:0/4001086399 shutdown_connections 2024-09-15T23:21:31.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.581+0000 7f7483e7b740 1 --2- 172.21.15.123:0/4001086399 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555cc2a25a50 0x555cc2a1e8b0 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.581+0000 7f7483e7b740 1 --2- 172.21.15.123:0/4001086399 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555cc2a21a80 0x555cc2a246a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.581+0000 7f7483e7b740 1 --2- 172.21.15.123:0/4001086399 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555cc2a242c0 0x555cc2a69a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.581+0000 7f7483e7b740 1 -- 172.21.15.123:0/4001086399 >> 172.21.15.123:0/4001086399 conn(0x555cc2a20a80 msgr2=0x555cc2a68f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:31.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.581+0000 7f7483e7b740 1 -- 172.21.15.123:0/4001086399 shutdown_connections 2024-09-15T23:21:31.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.581+0000 7f7483e7b740 1 -- 172.21.15.123:0/4001086399 wait complete. 2024-09-15T23:21:31.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.581+0000 7f7483e7b740 1 -- start start 2024-09-15T23:21:31.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.581+0000 7f7483e7b740 1 Processor -- start 2024-09-15T23:21:31.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.582+0000 7f7483e7b740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555cc2a242c0 0x555cc2a1f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:31.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.582+0000 7f7483e7b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555cc2a25a50 0x555cc2a4c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:31.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.582+0000 7f7483e7b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555cc2a66570 0x555cc2a6c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:31.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.582+0000 7f7483e7b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x555cc2a1ff20 con 0x555cc2a25a50 2024-09-15T23:21:31.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.582+0000 7f7483e7b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x555cc290f450 con 0x555cc2a66570 2024-09-15T23:21:31.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.582+0000 7f7483e7b740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x555cc2a6a290 con 0x555cc2a242c0 2024-09-15T23:21:31.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.582+0000 7f7483e7b740 10 client.0 _ll_register_callbacks cb 0x555cc2698ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:21:31.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.582+0000 7f7479d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555cc2a25a50 0x555cc2a4c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:31.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.582+0000 7f7479d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555cc2a25a50 0x555cc2a4c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57804/0 (socket says 172.21.15.123:57804) 2024-09-15T23:21:31.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.582+0000 7f7479d9b640 1 -- 172.21.15.123:0/3343363866 learned_addr learned my addr 172.21.15.123:0/3343363866 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:31.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.582+0000 7f747ad9d640 1 --2- 172.21.15.123:0/3343363866 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555cc2a66570 0x555cc2a6c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:31.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.582+0000 7f747a59c640 1 --2- 172.21.15.123:0/3343363866 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555cc2a242c0 0x555cc2a1f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:31.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.583+0000 7f7479d9b640 1 -- 172.21.15.123:0/3343363866 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555cc2a242c0 msgr2=0x555cc2a1f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:31.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.583+0000 7f7479d9b640 1 --2- 172.21.15.123:0/3343363866 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555cc2a242c0 0x555cc2a1f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.583+0000 7f7479d9b640 1 -- 172.21.15.123:0/3343363866 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555cc2a66570 msgr2=0x555cc2a6c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:31.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.583+0000 7f7479d9b640 1 --2- 172.21.15.123:0/3343363866 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555cc2a66570 0x555cc2a6c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.583+0000 7f7479d9b640 1 -- 172.21.15.123:0/3343363866 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cc26992d0 con 0x555cc2a25a50 2024-09-15T23:21:31.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.583+0000 7f7479d9b640 1 --2- 172.21.15.123:0/3343363866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555cc2a25a50 0x555cc2a4c080 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f747002a790 tx=0x7f7470004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=114c10b5ec8a4a01 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:31.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.583+0000 7f74597fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:21:31.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.583+0000 7f74597fa640 1 -- 172.21.15.123:0/3343363866 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7470037040 con 0x555cc2a25a50 2024-09-15T23:21:31.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.583+0000 7f74597fa640 1 -- 172.21.15.123:0/3343363866 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7f7470046ae0 con 0x555cc2a25a50 2024-09-15T23:21:31.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.583+0000 7f7483e7b740 1 -- 172.21.15.123:0/3343363866 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f747405d120 con 0x555cc2a25a50 2024-09-15T23:21:31.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.583+0000 7f74597fa640 1 -- 172.21.15.123:0/3343363866 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7f7470046ce0 con 0x555cc2a25a50 2024-09-15T23:21:31.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.583+0000 7f7483e7b740 10 client.9714 fetch_fsmap learned FSMap version 100 2024-09-15T23:21:31.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.583+0000 7f7483e7b740 1 -- 172.21.15.123:0/3343363866 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x555cc27636b0 con 0x555cc2a25a50 2024-09-15T23:21:31.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.583+0000 7f74597fa640 1 -- 172.21.15.123:0/3343363866 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f747405d120 con 0x555cc2a25a50 2024-09-15T23:21:31.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.583+0000 7f74597fa640 1 -- 172.21.15.123:0/3343363866 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 100) ==== 3502+0+0 (secure 0 0 0) 0x7f747004d050 con 0x555cc2a25a50 2024-09-15T23:21:31.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.583+0000 7f7483e7b740 10 client.9714 fetch_fsmap finished waiting for FSMap version 100 2024-09-15T23:21:31.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.583+0000 7f7483e7b740 10 client.9714 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T23:21:31.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.583+0000 7f7483e7b740 20 client.9714 populate_metadata read hostname 'smithi123' 2024-09-15T23:21:31.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.583+0000 7f7483e7b740 1 --2- 172.21.15.123:0/3343363866 >> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] conn(0x555cc2a43870 0x555cc2a1dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:31.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.583+0000 7f7483e7b740 4 client.9714 mds_command: new command op to 9564 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:21:31.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.583+0000 7f7483e7b740 1 -- 172.21.15.123:0/3343363866 --> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555cc2993c50 con 0x555cc2a43870 2024-09-15T23:21:31.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.584+0000 7f747a59c640 1 --2- 172.21.15.123:0/3343363866 >> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] conn(0x555cc2a43870 0x555cc2a1dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:31.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.584+0000 7f74597fa640 10 client.9714 ms_handle_connect on v2:172.21.15.123:6834/1883512279 2024-09-15T23:21:31.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.584+0000 7f747a59c640 1 --2- 172.21.15.123:0/3343363866 >> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] conn(0x555cc2a43870 0x555cc2a1dd00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=751ddc46225b3e9c server_cookie=adeb1ff81755e546 in_seq=0 out_seq=0 2024-09-15T23:21:31.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.584+0000 7f74597fa640 1 -- 172.21.15.123:0/3343363866 <== mds.0 v2:172.21.15.123:6834/1883512279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555cc2993c50 con 0x555cc2a43870 2024-09-15T23:21:31.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.584+0000 7f74597fa640 10 client.9714 handle_command_reply: tid=0 2024-09-15T23:21:31.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.584+0000 7f7483e7b740 1 client.9714 shutdown 2024-09-15T23:21:31.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.585+0000 7f7483e7b740 1 -- 172.21.15.123:0/3343363866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555cc2a25a50 msgr2=0x555cc2a4c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:31.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.585+0000 7f7483e7b740 1 --2- 172.21.15.123:0/3343363866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555cc2a25a50 0x555cc2a4c080 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f747002a790 tx=0x7f7470004730 comp rx=0 tx=0).stop 2024-09-15T23:21:31.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.585+0000 7f7483e7b740 1 -- 172.21.15.123:0/3343363866 shutdown_connections 2024-09-15T23:21:31.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.585+0000 7f7483e7b740 1 --2- 172.21.15.123:0/3343363866 >> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] conn(0x555cc2a43870 0x555cc2a1dd00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.585+0000 7f7483e7b740 1 --2- 172.21.15.123:0/3343363866 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555cc2a66570 0x555cc2a6c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.585+0000 7f7483e7b740 1 --2- 172.21.15.123:0/3343363866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555cc2a25a50 0x555cc2a4c080 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.585+0000 7f7483e7b740 1 --2- 172.21.15.123:0/3343363866 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555cc2a242c0 0x555cc2a1f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.585+0000 7f74597fa640 0 client.9714 ms_handle_reset on v2:172.21.15.123:6834/1883512279 2024-09-15T23:21:31.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.585+0000 7f7483e7b740 1 -- 172.21.15.123:0/3343363866 >> 172.21.15.123:0/3343363866 conn(0x555cc2a21a80 msgr2=0x555cc2a66fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:31.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.585+0000 7f7483e7b740 1 -- 172.21.15.123:0/3343363866 shutdown_connections 2024-09-15T23:21:31.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.585+0000 7f7483e7b740 1 -- 172.21.15.123:0/3343363866 wait complete. 2024-09-15T23:21:31.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.585+0000 7f7483e7b740 20 client.9714 trim_cache size 0 max 16384 2024-09-15T23:21:31.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.602+0000 7f7483e7b740 1 Processor -- start 2024-09-15T23:21:31.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.603+0000 7f7483e7b740 1 -- start start 2024-09-15T23:21:31.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.603+0000 7f7483e7b740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555cc2a242c0 0x555cc2a4da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:31.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.603+0000 7f7483e7b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555cc2a25a50 0x555cc2a1f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:31.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.603+0000 7f7483e7b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555cc2a66570 0x555cc2a68020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:31.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.603+0000 7f7483e7b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f747c158900 con 0x555cc2a66570 2024-09-15T23:21:31.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.603+0000 7f7483e7b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f747c157c60 con 0x555cc2a25a50 2024-09-15T23:21:31.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.603+0000 7f7483e7b740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f747c1582b0 con 0x555cc2a242c0 2024-09-15T23:21:31.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.603+0000 7f747ad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555cc2a66570 0x555cc2a68020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:31.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.603+0000 7f747ad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555cc2a66570 0x555cc2a68020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57816/0 (socket says 172.21.15.123:57816) 2024-09-15T23:21:31.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.603+0000 7f747ad9d640 1 -- 172.21.15.123:0/3352181946 learned_addr learned my addr 172.21.15.123:0/3352181946 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:31.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.604+0000 7f747a59c640 1 --2- 172.21.15.123:0/3352181946 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555cc2a242c0 0x555cc2a4da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:31.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.604+0000 7f7479d9b640 1 --2- 172.21.15.123:0/3352181946 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555cc2a25a50 0x555cc2a1f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:31.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.604+0000 7f747ad9d640 1 -- 172.21.15.123:0/3352181946 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555cc2a242c0 msgr2=0x555cc2a4da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:31.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.604+0000 7f747ad9d640 1 --2- 172.21.15.123:0/3352181946 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555cc2a242c0 0x555cc2a4da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.604+0000 7f747ad9d640 1 -- 172.21.15.123:0/3352181946 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555cc2a25a50 msgr2=0x555cc2a1f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:31.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.604+0000 7f747ad9d640 1 --2- 172.21.15.123:0/3352181946 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555cc2a25a50 0x555cc2a1f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.604+0000 7f747ad9d640 1 -- 172.21.15.123:0/3352181946 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cc2a6c7b0 con 0x555cc2a66570 2024-09-15T23:21:31.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.604+0000 7f747ad9d640 1 --2- 172.21.15.123:0/3352181946 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555cc2a66570 0x555cc2a68020 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f7474061f50 tx=0x7f747401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98a029cf13b36aef server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:31.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.604+0000 7f745b7fe640 1 -- 172.21.15.123:0/3352181946 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74740558d0 con 0x555cc2a66570 2024-09-15T23:21:31.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.604+0000 7f745b7fe640 1 -- 172.21.15.123:0/3352181946 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f747405d120 con 0x555cc2a66570 2024-09-15T23:21:31.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.604+0000 7f745b7fe640 1 -- 172.21.15.123:0/3352181946 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7474055a70 con 0x555cc2a66570 2024-09-15T23:21:31.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.604+0000 7f7483e7b740 1 -- 172.21.15.123:0/3352181946 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555cc2a66570 msgr2=0x555cc2a68020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:31.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.604+0000 7f7483e7b740 1 --2- 172.21.15.123:0/3352181946 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555cc2a66570 0x555cc2a68020 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f7474061f50 tx=0x7f747401e000 comp rx=0 tx=0).stop 2024-09-15T23:21:31.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.605+0000 7f7483e7b740 1 -- 172.21.15.123:0/3352181946 shutdown_connections 2024-09-15T23:21:31.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.605+0000 7f7483e7b740 1 --2- 172.21.15.123:0/3352181946 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555cc2a66570 0x555cc2a68020 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.605+0000 7f7483e7b740 1 --2- 172.21.15.123:0/3352181946 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555cc2a25a50 0x555cc2a1f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.605+0000 7f7483e7b740 1 --2- 172.21.15.123:0/3352181946 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555cc2a242c0 0x555cc2a4da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.605+0000 7f7483e7b740 1 -- 172.21.15.123:0/3352181946 >> 172.21.15.123:0/3352181946 conn(0x555cc2a21a80 msgr2=0x555cc2a67390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:31.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.605+0000 7f7483e7b740 1 -- 172.21.15.123:0/3352181946 shutdown_connections 2024-09-15T23:21:31.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.605+0000 7f7483e7b740 1 -- 172.21.15.123:0/3352181946 wait complete. 2024-09-15T23:21:31.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.605+0000 7f7483e7b740 1 -- start start 2024-09-15T23:21:31.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.605+0000 7f7483e7b740 1 Processor -- start 2024-09-15T23:21:31.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.606+0000 7f7483e7b740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555cc2a242c0 0x555cc2ae8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:31.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.606+0000 7f7483e7b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555cc2a25a50 0x555cc2a69370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:31.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.606+0000 7f7483e7b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555cc2a66570 0x555cc2ae7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:31.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.606+0000 7f7483e7b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x555cc2a436f0 con 0x555cc2a66570 2024-09-15T23:21:31.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.606+0000 7f7483e7b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x555cc2a4ebf0 con 0x555cc2a25a50 2024-09-15T23:21:31.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.606+0000 7f7483e7b740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x555cc2a43d10 con 0x555cc2a242c0 2024-09-15T23:21:31.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.606+0000 7f7483e7b740 10 client.0 _ll_register_callbacks cb 0x7f7470009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:21:31.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.606+0000 7f747ad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555cc2a66570 0x555cc2ae7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:31.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.606+0000 7f747ad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555cc2a66570 0x555cc2ae7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57830/0 (socket says 172.21.15.123:57830) 2024-09-15T23:21:31.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.606+0000 7f747ad9d640 1 -- 172.21.15.123:0/2355547997 learned_addr learned my addr 172.21.15.123:0/2355547997 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:31.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.606+0000 7f747a59c640 1 --2- 172.21.15.123:0/2355547997 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555cc2a242c0 0x555cc2ae8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:31.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.606+0000 7f7479d9b640 1 --2- 172.21.15.123:0/2355547997 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555cc2a25a50 0x555cc2a69370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:31.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.606+0000 7f747ad9d640 1 -- 172.21.15.123:0/2355547997 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555cc2a242c0 msgr2=0x555cc2ae8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:31.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.606+0000 7f747ad9d640 1 --2- 172.21.15.123:0/2355547997 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555cc2a242c0 0x555cc2ae8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.606+0000 7f747ad9d640 1 -- 172.21.15.123:0/2355547997 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555cc2a25a50 msgr2=0x555cc2a69370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:31.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.606+0000 7f747ad9d640 1 --2- 172.21.15.123:0/2355547997 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555cc2a25a50 0x555cc2a69370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.606+0000 7f747ad9d640 1 -- 172.21.15.123:0/2355547997 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cc2ae8e60 con 0x555cc2a66570 2024-09-15T23:21:31.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.607+0000 7f747ad9d640 1 --2- 172.21.15.123:0/2355547997 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555cc2a66570 0x555cc2ae7730 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f74740591f0 tx=0x7f7474001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=984b1be574fee899 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:31.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.607+0000 7f74597fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:21:31.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.607+0000 7f74597fa640 1 -- 172.21.15.123:0/2355547997 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7474061900 con 0x555cc2a66570 2024-09-15T23:21:31.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.607+0000 7f74597fa640 1 -- 172.21.15.123:0/2355547997 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7f7474061aa0 con 0x555cc2a66570 2024-09-15T23:21:31.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.607+0000 7f7483e7b740 1 -- 172.21.15.123:0/2355547997 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f747405d120 con 0x555cc2a66570 2024-09-15T23:21:31.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.607+0000 7f74597fa640 1 -- 172.21.15.123:0/2355547997 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7f7474076050 con 0x555cc2a66570 2024-09-15T23:21:31.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.607+0000 7f7483e7b740 10 client.9720 fetch_fsmap learned FSMap version 100 2024-09-15T23:21:31.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.607+0000 7f7483e7b740 1 -- 172.21.15.123:0/2355547997 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x555cc2a42ee0 con 0x555cc2a66570 2024-09-15T23:21:31.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.607+0000 7f74597fa640 1 -- 172.21.15.123:0/2355547997 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f747405d120 con 0x555cc2a66570 2024-09-15T23:21:31.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.607+0000 7f74597fa640 1 -- 172.21.15.123:0/2355547997 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 100) ==== 3502+0+0 (secure 0 0 0) 0x7f7474004b60 con 0x555cc2a66570 2024-09-15T23:21:31.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.607+0000 7f7483e7b740 10 client.9720 fetch_fsmap finished waiting for FSMap version 100 2024-09-15T23:21:31.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.607+0000 7f7483e7b740 10 client.9720 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T23:21:31.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.607+0000 7f7483e7b740 20 client.9720 populate_metadata read hostname 'smithi123' 2024-09-15T23:21:31.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.607+0000 7f7483e7b740 1 --2- 172.21.15.123:0/2355547997 >> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] conn(0x555cc2a67d50 0x555cc2a68130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:31.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.607+0000 7f7483e7b740 4 client.9720 mds_command: new command op to 9564 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:21:31.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.607+0000 7f7483e7b740 1 -- 172.21.15.123:0/2355547997 --> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] -- command(tid 0: {"prefix": "status"}) -- 0x555cc298dfa0 con 0x555cc2a67d50 2024-09-15T23:21:31.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.607+0000 7f747a59c640 1 --2- 172.21.15.123:0/2355547997 >> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] conn(0x555cc2a67d50 0x555cc2a68130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:31.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.608+0000 7f74597fa640 10 client.9720 ms_handle_connect on v2:172.21.15.123:6834/1883512279 2024-09-15T23:21:31.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.608+0000 7f747a59c640 1 --2- 172.21.15.123:0/2355547997 >> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] conn(0x555cc2a67d50 0x555cc2a68130 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7bb3cf96c571cde server_cookie=4659559a0ca1db46 in_seq=0 out_seq=0 2024-09-15T23:21:31.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.608+0000 7f74597fa640 1 -- 172.21.15.123:0/2355547997 <== mds.0 v2:172.21.15.123:6834/1883512279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+328 (crc 0 0 0) 0x555cc298dfa0 con 0x555cc2a67d50 2024-09-15T23:21:31.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.608+0000 7f74597fa640 10 client.9720 handle_command_reply: tid=0 2024-09-15T23:21:31.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.608+0000 7f7483e7b740 1 client.9720 shutdown 2024-09-15T23:21:31.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.608+0000 7f7483e7b740 1 -- 172.21.15.123:0/2355547997 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555cc2a66570 msgr2=0x555cc2ae7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:31.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.608+0000 7f7483e7b740 1 --2- 172.21.15.123:0/2355547997 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555cc2a66570 0x555cc2ae7730 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f74740591f0 tx=0x7f7474001250 comp rx=0 tx=0).stop 2024-09-15T23:21:31.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.608+0000 7f7483e7b740 1 -- 172.21.15.123:0/2355547997 shutdown_connections 2024-09-15T23:21:31.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.608+0000 7f7483e7b740 1 --2- 172.21.15.123:0/2355547997 >> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] conn(0x555cc2a67d50 0x555cc2a68130 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.608+0000 7f7483e7b740 1 --2- 172.21.15.123:0/2355547997 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555cc2a66570 0x555cc2ae7730 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.608+0000 7f7483e7b740 1 --2- 172.21.15.123:0/2355547997 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555cc2a25a50 0x555cc2a69370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.608+0000 7f7483e7b740 1 --2- 172.21.15.123:0/2355547997 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555cc2a242c0 0x555cc2ae8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.608+0000 7f74597fa640 0 client.9720 ms_handle_reset on v2:172.21.15.123:6834/1883512279 2024-09-15T23:21:31.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.608+0000 7f7483e7b740 1 -- 172.21.15.123:0/2355547997 >> 172.21.15.123:0/2355547997 conn(0x555cc2a21a80 msgr2=0x555cc2a4d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:31.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.608+0000 7f7483e7b740 1 -- 172.21.15.123:0/2355547997 shutdown_connections 2024-09-15T23:21:31.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.608+0000 7f7483e7b740 1 -- 172.21.15.123:0/2355547997 wait complete. 2024-09-15T23:21:31.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.608+0000 7f7483e7b740 20 client.9720 trim_cache size 0 max 16384 2024-09-15T23:21:31.616 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:21:31.616 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "cb968ac4-8d3a-4b17-a673-6177aeaea589", 2024-09-15T23:21:31.616 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2024-09-15T23:21:31.616 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 9564, 2024-09-15T23:21:31.616 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-09-15T23:21:31.616 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-09-15T23:21:31.616 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-09-15T23:21:31.616 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 8.8871470820000003, 2024-09-15T23:21:31.616 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 100, 2024-09-15T23:21:31.616 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 168, 2024-09-15T23:21:31.616 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 168, 2024-09-15T23:21:31.617 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 13.127149929 2024-09-15T23:21:31.617 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:21:31.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.609+0000 7f7480ffd640 1 -- 172.21.15.123:0/595588892 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f745c06c2b0 msgr2=0x7f745c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:31.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.609+0000 7f7480ffd640 1 --2- 172.21.15.123:0/595588892 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f745c06c2b0 0x7f745c06e770 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f746c006fd0 tx=0x7f746c008040 comp rx=0 tx=0).stop 2024-09-15T23:21:31.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.609+0000 7f7480ffd640 1 -- 172.21.15.123:0/595588892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f747c15bcf0 msgr2=0x7f747c0b41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:31.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.609+0000 7f7480ffd640 1 --2- 172.21.15.123:0/595588892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f747c15bcf0 0x7f747c0b41a0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f747400cad0 tx=0x7f747400cf90 comp rx=0 tx=0).stop 2024-09-15T23:21:31.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.609+0000 7f7480ffd640 1 -- 172.21.15.123:0/595588892 shutdown_connections 2024-09-15T23:21:31.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.609+0000 7f7480ffd640 1 --2- 172.21.15.123:0/595588892 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f745c06c2b0 0x7f745c06e770 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.609+0000 7f7480ffd640 1 --2- 172.21.15.123:0/595588892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f747c15bcf0 0x7f747c0b41a0 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.609+0000 7f7480ffd640 1 --2- 172.21.15.123:0/595588892 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f747c13eb20 0x7f747c0b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.609+0000 7f7480ffd640 1 --2- 172.21.15.123:0/595588892 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f747c0b2d40 0x7f747c13d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.609+0000 7f7480ffd640 1 -- 172.21.15.123:0/595588892 >> 172.21.15.123:0/595588892 conn(0x7f747c0ccec0 msgr2=0x7f747c0d0400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:31.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.609+0000 7f7480ffd640 1 -- 172.21.15.123:0/595588892 shutdown_connections 2024-09-15T23:21:31.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.609+0000 7f7480ffd640 1 -- 172.21.15.123:0/595588892 wait complete. 2024-09-15T23:21:31.621 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:21:31.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.719+0000 7f2e6ed9f640 1 Processor -- start 2024-09-15T23:21:31.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.719+0000 7f2e6ed9f640 1 -- start start 2024-09-15T23:21:31.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.719+0000 7f2e6ed9f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2e680b6970 0x7f2e680b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:31.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.719+0000 7f2e6ed9f640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e680d0e70 con 0x7f2e6815ed20 2024-09-15T23:21:31.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.719+0000 7f2e6ed9f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e680d41c0 con 0x7f2e680d23b0 2024-09-15T23:21:31.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.719+0000 7f2e6ed9f640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f2e680d35b0 con 0x7f2e680b6970 2024-09-15T23:21:31.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.720+0000 7f2e6cb3b640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f2e6815ed20 0x7f2e680b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49630/0 (socket says 172.21.15.123:49630) 2024-09-15T23:21:31.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.720+0000 7f2e6cb3b640 1 -- 172.21.15.123:0/1993109776 learned_addr learned my addr 172.21.15.123:0/1993109776 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:21:31.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.720+0000 7f2e67fff640 1 --2- 172.21.15.123:0/1993109776 >> v2:172.21.15.188:3300/0 conn(0x7f2e680b6970 0x7f2e680b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:31.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.720+0000 7f2e677fe640 1 -- 172.21.15.123:0/1993109776 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3136181989 0 0) 0x7f2e5c001110 con 0x7f2e6815ed20 2024-09-15T23:21:31.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.720+0000 7f2e677fe640 1 -- 172.21.15.123:0/1993109776 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e58003520 con 0x7f2e6815ed20 2024-09-15T23:21:31.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.720+0000 7f2e677fe640 1 -- 172.21.15.123:0/1993109776 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4072907757 0 0) 0x7f2e58003520 con 0x7f2e6815ed20 2024-09-15T23:21:31.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.720+0000 7f2e67fff640 1 -- 172.21.15.123:0/1993109776 >> v1:172.21.15.188:6789/0 conn(0x7f2e680d23b0 legacy=0x7f2e680b8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:31.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.720+0000 7f2e67fff640 1 -- 172.21.15.123:0/1993109776 >> v1:172.21.15.123:6789/0 conn(0x7f2e6815ed20 legacy=0x7f2e680b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:31.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.720+0000 7f2e67fff640 1 -- 172.21.15.123:0/1993109776 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e680d3890 con 0x7f2e680b6970 2024-09-15T23:21:31.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.721+0000 7f2e67fff640 1 --2- 172.21.15.123:0/1993109776 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e680b6970 0x7f2e680b80d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2e540097a0 tx=0x7f2e5402a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=144b6c48763a541 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:31.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.721+0000 7f2e677fe640 1 -- 172.21.15.123:0/1993109776 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e54037070 con 0x7f2e680b6970 2024-09-15T23:21:31.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.721+0000 7f2e677fe640 1 -- 172.21.15.123:0/1993109776 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e5402abc0 con 0x7f2e680b6970 2024-09-15T23:21:31.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.721+0000 7f2e677fe640 1 -- 172.21.15.123:0/1993109776 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c001840 con 0x7f2e680b6970 2024-09-15T23:21:31.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.721+0000 7f2e6ed9f640 1 -- 172.21.15.123:0/1993109776 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e680b6970 msgr2=0x7f2e680b80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:31.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.721+0000 7f2e6ed9f640 1 --2- 172.21.15.123:0/1993109776 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e680b6970 0x7f2e680b80d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2e540097a0 tx=0x7f2e5402a130 comp rx=0 tx=0).stop 2024-09-15T23:21:31.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.722+0000 7f2e6ed9f640 1 -- 172.21.15.123:0/1993109776 shutdown_connections 2024-09-15T23:21:31.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.722+0000 7f2e6ed9f640 1 --2- 172.21.15.123:0/1993109776 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e680b6970 0x7f2e680b80d0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.722+0000 7f2e6ed9f640 1 -- 172.21.15.123:0/1993109776 >> 172.21.15.123:0/1993109776 conn(0x7f2e680d1260 msgr2=0x7f2e680d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:31.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.722+0000 7f2e6ed9f640 1 -- 172.21.15.123:0/1993109776 shutdown_connections 2024-09-15T23:21:31.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.722+0000 7f2e6ed9f640 1 -- 172.21.15.123:0/1993109776 wait complete. 2024-09-15T23:21:31.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.723+0000 7f2e6ed9f640 1 Processor -- start 2024-09-15T23:21:31.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.723+0000 7f2e6ed9f640 1 -- start start 2024-09-15T23:21:31.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.724+0000 7f2e6ed9f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e680b6970 0x7f2e68154c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:31.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.724+0000 7f2e6ed9f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e680d23b0 0x7f2e68160190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:31.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.724+0000 7f2e6ed9f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e6815ed20 0x7f2e68152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:31.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.724+0000 7f2e6ed9f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2e680d32a0 con 0x7f2e6815ed20 2024-09-15T23:21:31.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.724+0000 7f2e6ed9f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2e680d3e50 con 0x7f2e680b6970 2024-09-15T23:21:31.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.724+0000 7f2e6ed9f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f2e6815f100 con 0x7f2e680d23b0 2024-09-15T23:21:31.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.724+0000 7f2e6d33c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e6815ed20 0x7f2e68152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:31.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.724+0000 7f2e6d33c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e6815ed20 0x7f2e68152d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57846/0 (socket says 172.21.15.123:57846) 2024-09-15T23:21:31.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.724+0000 7f2e6d33c640 1 -- 172.21.15.123:0/1902833711 learned_addr learned my addr 172.21.15.123:0/1902833711 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:31.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.724+0000 7f2e6cb3b640 1 --2- 172.21.15.123:0/1902833711 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e680b6970 0x7f2e68154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:31.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.724+0000 7f2e67fff640 1 --2- 172.21.15.123:0/1902833711 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e680d23b0 0x7f2e68160190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:31.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.724+0000 7f2e6d33c640 1 -- 172.21.15.123:0/1902833711 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e680d23b0 msgr2=0x7f2e68160190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:31.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.724+0000 7f2e6d33c640 1 --2- 172.21.15.123:0/1902833711 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e680d23b0 0x7f2e68160190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.724+0000 7f2e6d33c640 1 -- 172.21.15.123:0/1902833711 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e680b6970 msgr2=0x7f2e68154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:31.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.724+0000 7f2e6d33c640 1 --2- 172.21.15.123:0/1902833711 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e680b6970 0x7f2e68154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.724+0000 7f2e6d33c640 1 -- 172.21.15.123:0/1902833711 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e6815a660 con 0x7f2e6815ed20 2024-09-15T23:21:31.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.724+0000 7f2e6cb3b640 1 --2- 172.21.15.123:0/1902833711 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e680b6970 0x7f2e68154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:21:31.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.724+0000 7f2e67fff640 1 --2- 172.21.15.123:0/1902833711 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e680d23b0 0x7f2e68160190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:21:31.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.724+0000 7f2e6d33c640 1 --2- 172.21.15.123:0/1902833711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e6815ed20 0x7f2e68152d80 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f2e6000c7d0 tx=0x7f2e6000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:31.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.724+0000 7f2e657fa640 1 -- 172.21.15.123:0/1902833711 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e60003b70 con 0x7f2e6815ed20 2024-09-15T23:21:31.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.724+0000 7f2e657fa640 1 -- 172.21.15.123:0/1902833711 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e60003d30 con 0x7f2e6815ed20 2024-09-15T23:21:31.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.724+0000 7f2e6ed9f640 1 -- 172.21.15.123:0/1902833711 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e6815a940 con 0x7f2e6815ed20 2024-09-15T23:21:31.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.724+0000 7f2e657fa640 1 -- 172.21.15.123:0/1902833711 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e6000aa90 con 0x7f2e6815ed20 2024-09-15T23:21:31.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.724+0000 7f2e6ed9f640 1 -- 172.21.15.123:0/1902833711 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e6815af00 con 0x7f2e6815ed20 2024-09-15T23:21:31.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.725+0000 7f2e6ed9f640 1 -- 172.21.15.123:0/1902833711 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e680b7010 con 0x7f2e6815ed20 2024-09-15T23:21:31.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.726+0000 7f2e657fa640 1 -- 172.21.15.123:0/1902833711 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2e6000ac30 con 0x7f2e6815ed20 2024-09-15T23:21:31.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.726+0000 7f2e657fa640 1 --2- 172.21.15.123:0/1902833711 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2e4c06c2b0 0x7f2e4c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:31.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.726+0000 7f2e657fa640 1 -- 172.21.15.123:0/1902833711 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7f2e6008b3e0 con 0x7f2e6815ed20 2024-09-15T23:21:31.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.726+0000 7f2e6cb3b640 1 --2- 172.21.15.123:0/1902833711 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2e4c06c2b0 0x7f2e4c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:31.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.727+0000 7f2e6cb3b640 1 --2- 172.21.15.123:0/1902833711 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2e4c06c2b0 0x7f2e4c06e770 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c005880 tx=0x7f2e5c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:31.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.731+0000 7f2e657fa640 1 -- 172.21.15.123:0/1902833711 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2e60059b50 con 0x7f2e6815ed20 2024-09-15T23:21:31.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.932+0000 7f2e6ed9f640 1 -- 172.21.15.123:0/1902833711 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2e680d0260 con 0x7f2e6815ed20 2024-09-15T23:21:31.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.933+0000 7f2e657fa640 1 -- 172.21.15.123:0/1902833711 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v100) ==== 53+0+73 (secure 0 0 0) 0x7f2e60059450 con 0x7f2e6815ed20 2024-09-15T23:21:31.934 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:21:31.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.934+0000 7f2e6ed9f640 1 -- 172.21.15.123:0/1902833711 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2e4c06c2b0 msgr2=0x7f2e4c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:31.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.934+0000 7f2e6ed9f640 1 --2- 172.21.15.123:0/1902833711 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2e4c06c2b0 0x7f2e4c06e770 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c005880 tx=0x7f2e5c009040 comp rx=0 tx=0).stop 2024-09-15T23:21:31.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.934+0000 7f2e6ed9f640 1 -- 172.21.15.123:0/1902833711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e6815ed20 msgr2=0x7f2e68152d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:31.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.934+0000 7f2e6ed9f640 1 --2- 172.21.15.123:0/1902833711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e6815ed20 0x7f2e68152d80 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f2e6000c7d0 tx=0x7f2e6000cc90 comp rx=0 tx=0).stop 2024-09-15T23:21:31.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.934+0000 7f2e6ed9f640 1 -- 172.21.15.123:0/1902833711 shutdown_connections 2024-09-15T23:21:31.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.934+0000 7f2e6ed9f640 1 --2- 172.21.15.123:0/1902833711 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2e4c06c2b0 0x7f2e4c06e770 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.934+0000 7f2e6ed9f640 1 --2- 172.21.15.123:0/1902833711 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e6815ed20 0x7f2e68152d80 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.934+0000 7f2e6ed9f640 1 --2- 172.21.15.123:0/1902833711 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e680d23b0 0x7f2e68160190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.934+0000 7f2e6ed9f640 1 --2- 172.21.15.123:0/1902833711 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e680b6970 0x7f2e68154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:31.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.935+0000 7f2e6ed9f640 1 -- 172.21.15.123:0/1902833711 >> 172.21.15.123:0/1902833711 conn(0x7f2e680d1260 msgr2=0x7f2e6815c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:31.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.935+0000 7f2e6ed9f640 1 -- 172.21.15.123:0/1902833711 shutdown_connections 2024-09-15T23:21:31.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:31.935+0000 7f2e6ed9f640 1 -- 172.21.15.123:0/1902833711 wait complete. 2024-09-15T23:21:31.946 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T23:21:31.947 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:21:31.947 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-09-15T23:21:31.947 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T23:21:31.947 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T23:21:31.947 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T23:21:31.947 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T23:21:31.947 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:21:31.947 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:21:31.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:21:31.947 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-09-15T23:21:31.964 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:21:31.964 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:21:31.964 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:21:31.964 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:21:31.964 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-09-15T23:21:31.964 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:21:31.964 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:21:31.964 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-09-15T23:21:31.964 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f0 2024-09-15T23:21:31.964 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:21:31.965 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:21:31.965 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f1 2024-09-15T23:21:31.965 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:21:31.965 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:21:31.965 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:21:31.965 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:21:31.965 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T23:21:31.965 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42248sec preferred_lft 42248sec 2024-09-15T23:21:31.965 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link noprefixroute 2024-09-15T23:21:31.965 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:21:31.965 INFO:teuthology.orchestra.run.smithi123.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:21:31.965 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 46:55:5a:e0:32:4d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:21:31.965 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:21:31.966 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:21:31.966 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::1c6f:d5ff:fe19:ff05/64 scope link 2024-09-15T23:21:31.966 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:21:31.966 INFO:teuthology.orchestra.run.smithi123.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:21:31.966 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 46:55:5a:e0:32:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:21:31.966 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::4455:5aff:fee0:324d/64 scope link 2024-09-15T23:21:31.966 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:21:31.966 INFO:teuthology.orchestra.run.smithi123.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:21:31.966 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether be:c1:f3:63:cb:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:21:31.966 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::bcc1:f3ff:fe63:cb24/64 scope link 2024-09-15T23:21:31.966 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:21:31.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:21:31.967 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:21:32.027 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-09-15T23:21:32.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:21:32.029 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-09-15T23:21:32.085 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-09-15T23:21:32.085 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:21:32.085 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:21:32.086 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:21:32.086 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:21:32.086 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:21:32.086 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:21:32.086 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:21:32.086 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:21:32.086 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:21:32.086 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:21:32.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:21:32.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:21:32.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:21:32.212 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-09-15T23:21:32.227 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T23:21:32.227 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:21:32.228 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:21:32.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:21:32.228 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2024-09-15T23:21:32.292 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:21:32.293 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T23:21:32.348 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:21:32.348 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:21:32.348 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:21:32.404 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T23:21:32.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:21:32.404 DEBUG:teuthology.orchestra.run.smithi123:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:21:32.487 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:21:32.488 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:21:32.488 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:21:32.496 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:21:32.496 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:21:32.496 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:21:32.496 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.188:3300,172.21.15.188:3301" 2024-09-15T23:21:32.496 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T23:21:32.501 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:21:32.501 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:21:32.501 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:21:32.501 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.188:3300,172.21.15.188:3301" 2024-09-15T23:21:32.501 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T23:21:32.501 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:6789,172.21.15.188:6789,172.21.15.188:6790" 2024-09-15T23:21:32.502 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.123:6789,172.21.15.188:6789,172.21.15.188:6790:/ 2024-09-15T23:21:32.502 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=cb968ac4-8d3a-4b17-a673-6177aeaea589" will pass to kernel 2024-09-15T23:21:32.502 INFO:teuthology.orchestra.run.smithi123.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-15T23:21:32.502 INFO:teuthology.orchestra.run.smithi123.stdout: You just mounted a file system that supports labels which does not 2024-09-15T23:21:32.502 INFO:teuthology.orchestra.run.smithi123.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T23:21:32.502 INFO:teuthology.orchestra.run.smithi123.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T23:21:32.502 INFO:teuthology.orchestra.run.smithi123.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T23:21:32.504 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T23:21:32.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:21:32.504 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:21:32.569 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T23:21:32.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:21:32.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:21:32.671 INFO:teuthology.orchestra.run.smithi123.stdout:client8242 2024-09-15T23:21:32.672 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:21:32.672 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:21:32.688 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:21:32.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.826+0000 7f6d1fc53640 1 Processor -- start 2024-09-15T23:21:32.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.827+0000 7f6d1fc53640 1 -- start start 2024-09-15T23:21:32.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.827+0000 7f6d1fc53640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f6d1815ed20 0x7f6d180b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:32.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.827+0000 7f6d1fc53640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6d180d23b0 0x7f6d180b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:32.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.827+0000 7f6d1fc53640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d180d0e70 con 0x7f6d180cf2d0 2024-09-15T23:21:32.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.827+0000 7f6d1fc53640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f6d180d41c0 con 0x7f6d180d23b0 2024-09-15T23:21:32.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.827+0000 7f6d1fc53640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f6d180d35b0 con 0x7f6d1815ed20 2024-09-15T23:21:32.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.828+0000 7f6d1d1ee640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6d180d23b0 0x7f6d180b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:32.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.828+0000 7f6d1e1f0640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6d180cf2d0 0x7f6d180cf700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49632/0 (socket says 172.21.15.123:49632) 2024-09-15T23:21:32.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.828+0000 7f6d1d1ee640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6d180d23b0 0x7f6d180b67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57858/0 (socket says 172.21.15.123:57858) 2024-09-15T23:21:32.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.828+0000 7f6d1e1f0640 1 -- 172.21.15.123:0/4294597366 learned_addr learned my addr 172.21.15.123:0/4294597366 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:21:32.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.828+0000 7f6d1d1ee640 1 -- 172.21.15.123:0/4294597366 >> v2:172.21.15.188:3300/0 conn(0x7f6d1815ed20 msgr2=0x7f6d180b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:32.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.828+0000 7f6d1d1ee640 1 --2- 172.21.15.123:0/4294597366 >> v2:172.21.15.188:3300/0 conn(0x7f6d1815ed20 0x7f6d180b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:32.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.828+0000 7f6d1d1ee640 1 -- 172.21.15.123:0/4294597366 >> v1:172.21.15.123:6789/0 conn(0x7f6d180cf2d0 legacy=0x7f6d180cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:32.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.828+0000 7f6d1d1ee640 1 -- 172.21.15.123:0/4294597366 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d180d3890 con 0x7f6d180d23b0 2024-09-15T23:21:32.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.829+0000 7f6d1d1ee640 1 --2- 172.21.15.123:0/4294597366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d180d23b0 0x7f6d180b67a0 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f6d180d47b0 tx=0x7f6d1402a010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f49f2ee3ab05c551 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:32.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.829+0000 7f6d1c9ed640 1 -- 172.21.15.123:0/4294597366 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d14037070 con 0x7f6d180d23b0 2024-09-15T23:21:32.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.829+0000 7f6d1c9ed640 1 -- 172.21.15.123:0/4294597366 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d1402aca0 con 0x7f6d180d23b0 2024-09-15T23:21:32.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.829+0000 7f6d1c9ed640 1 -- 172.21.15.123:0/4294597366 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d14032660 con 0x7f6d180d23b0 2024-09-15T23:21:32.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.829+0000 7f6d1fc53640 1 -- 172.21.15.123:0/4294597366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d180d23b0 msgr2=0x7f6d180b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:32.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.829+0000 7f6d1fc53640 1 --2- 172.21.15.123:0/4294597366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d180d23b0 0x7f6d180b67a0 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f6d180d47b0 tx=0x7f6d1402a010 comp rx=0 tx=0).stop 2024-09-15T23:21:32.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.829+0000 7f6d1fc53640 1 -- 172.21.15.123:0/4294597366 shutdown_connections 2024-09-15T23:21:32.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.829+0000 7f6d1fc53640 1 --2- 172.21.15.123:0/4294597366 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d180d23b0 0x7f6d180b67a0 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:32.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.829+0000 7f6d1fc53640 1 --2- 172.21.15.123:0/4294597366 >> v2:172.21.15.188:3300/0 conn(0x7f6d1815ed20 0x7f6d180b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:32.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.829+0000 7f6d1fc53640 1 -- 172.21.15.123:0/4294597366 >> 172.21.15.123:0/4294597366 conn(0x7f6d180d1260 msgr2=0x7f6d180d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:32.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.829+0000 7f6d1fc53640 1 -- 172.21.15.123:0/4294597366 shutdown_connections 2024-09-15T23:21:32.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.829+0000 7f6d1fc53640 1 -- 172.21.15.123:0/4294597366 wait complete. 2024-09-15T23:21:32.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.831+0000 7f6d1fc53640 1 Processor -- start 2024-09-15T23:21:32.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.831+0000 7f6d1fc53640 1 -- start start 2024-09-15T23:21:32.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.831+0000 7f6d1fc53640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d180cf2d0 0x7f6d180cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:32.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.831+0000 7f6d1fc53640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6d180d23b0 0x7f6d180cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:32.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.831+0000 7f6d1fc53640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6d1815ed20 0x7f6d1814a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:32.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.831+0000 7f6d1fc53640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6d180d32a0 con 0x7f6d180cf2d0 2024-09-15T23:21:32.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.831+0000 7f6d1fc53640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6d180d3e50 con 0x7f6d180d23b0 2024-09-15T23:21:32.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.831+0000 7f6d1fc53640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6d1815f100 con 0x7f6d1815ed20 2024-09-15T23:21:32.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.831+0000 7f6d1d9ef640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d180cf2d0 0x7f6d180cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:32.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.831+0000 7f6d1d9ef640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d180cf2d0 0x7f6d180cbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57872/0 (socket says 172.21.15.123:57872) 2024-09-15T23:21:32.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.831+0000 7f6d1d9ef640 1 -- 172.21.15.123:0/740207294 learned_addr learned my addr 172.21.15.123:0/740207294 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:32.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.832+0000 7f6d1d9ef640 1 -- 172.21.15.123:0/740207294 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6d1815ed20 msgr2=0x7f6d1814a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:32.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.832+0000 7f6d1d9ef640 1 --2- 172.21.15.123:0/740207294 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6d1815ed20 0x7f6d1814a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:32.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.832+0000 7f6d1d9ef640 1 -- 172.21.15.123:0/740207294 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6d180d23b0 msgr2=0x7f6d180cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:32.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.832+0000 7f6d1d9ef640 1 --2- 172.21.15.123:0/740207294 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6d180d23b0 0x7f6d180cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:32.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.832+0000 7f6d1d9ef640 1 -- 172.21.15.123:0/740207294 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d180cde30 con 0x7f6d180cf2d0 2024-09-15T23:21:32.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.832+0000 7f6d1d9ef640 1 --2- 172.21.15.123:0/740207294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d180cf2d0 0x7f6d180cbc70 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f6d0800b4d0 tx=0x7f6d0800b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:32.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.832+0000 7f6d0e7fc640 1 -- 172.21.15.123:0/740207294 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d08014070 con 0x7f6d180cf2d0 2024-09-15T23:21:32.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.832+0000 7f6d0e7fc640 1 -- 172.21.15.123:0/740207294 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d08010870 con 0x7f6d180cf2d0 2024-09-15T23:21:32.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.832+0000 7f6d1fc53640 1 -- 172.21.15.123:0/740207294 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d180ce110 con 0x7f6d180cf2d0 2024-09-15T23:21:32.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.832+0000 7f6d0e7fc640 1 -- 172.21.15.123:0/740207294 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d08010c60 con 0x7f6d180cf2d0 2024-09-15T23:21:32.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.832+0000 7f6d1fc53640 1 -- 172.21.15.123:0/740207294 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d180ce6d0 con 0x7f6d180cf2d0 2024-09-15T23:21:32.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.833+0000 7f6d1fc53640 1 -- 172.21.15.123:0/740207294 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d180b7010 con 0x7f6d180cf2d0 2024-09-15T23:21:32.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.834+0000 7f6d0e7fc640 1 -- 172.21.15.123:0/740207294 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6d08017070 con 0x7f6d180cf2d0 2024-09-15T23:21:32.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.834+0000 7f6d0e7fc640 1 --2- 172.21.15.123:0/740207294 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6cfc06c2e0 0x7f6cfc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:32.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.834+0000 7f6d0e7fc640 1 -- 172.21.15.123:0/740207294 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7f6d0808b1a0 con 0x7f6d180cf2d0 2024-09-15T23:21:32.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.835+0000 7f6d1d1ee640 1 --2- 172.21.15.123:0/740207294 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6cfc06c2e0 0x7f6cfc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:32.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.835+0000 7f6d1d1ee640 1 --2- 172.21.15.123:0/740207294 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6cfc06c2e0 0x7f6cfc06e7a0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f6d14034000 tx=0x7f6d1402c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:32.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:32.839+0000 7f6d0e7fc640 1 -- 172.21.15.123:0/740207294 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6d080599a0 con 0x7f6d180cf2d0 2024-09-15T23:21:33.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.038+0000 7f6d1fc53640 1 -- 172.21.15.123:0/740207294 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d18162190 con 0x7f6d180cf2d0 2024-09-15T23:21:33.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.039+0000 7f6d0e7fc640 1 -- 172.21.15.123:0/740207294 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) ==== 95+0+5241 (secure 0 0 0) 0x7f6d080592a0 con 0x7f6d180cf2d0 2024-09-15T23:21:33.040 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:33.040 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":100,"btime":"2024-09-15T23:21:24:727971+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7214,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/1648353391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1648353391},{"type":"v1","addr":"172.21.15.188:6837","nonce":1648353391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8122,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/1714717257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":1714717257},{"type":"v1","addr":"172.21.15.188:6836","nonce":1714717257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":9552,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/3722702026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3722702026},{"type":"v1","addr":"172.21.15.123:6833","nonce":3722702026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:21:22.066391+0000","modified":"2024-09-15T23:21:24.056941+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9564},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9564":{"gid":9564,"name":"a","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/1883512279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1883512279},{"type":"v1","addr":"172.21.15.123:6835","nonce":1883512279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9564,"qdb_cluster":[9564]},"id":11}]} 2024-09-15T23:21:33.040 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 100 2024-09-15T23:21:33.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.041+0000 7f6d1fc53640 1 -- 172.21.15.123:0/740207294 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6cfc06c2e0 msgr2=0x7f6cfc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:33.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.041+0000 7f6d1fc53640 1 --2- 172.21.15.123:0/740207294 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6cfc06c2e0 0x7f6cfc06e7a0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f6d14034000 tx=0x7f6d1402c000 comp rx=0 tx=0).stop 2024-09-15T23:21:33.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.041+0000 7f6d1fc53640 1 -- 172.21.15.123:0/740207294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d180cf2d0 msgr2=0x7f6d180cbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:33.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.041+0000 7f6d1fc53640 1 --2- 172.21.15.123:0/740207294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d180cf2d0 0x7f6d180cbc70 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f6d0800b4d0 tx=0x7f6d0800b990 comp rx=0 tx=0).stop 2024-09-15T23:21:33.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.041+0000 7f6d1fc53640 1 -- 172.21.15.123:0/740207294 shutdown_connections 2024-09-15T23:21:33.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.041+0000 7f6d1fc53640 1 --2- 172.21.15.123:0/740207294 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6d1815ed20 0x7f6d1814a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:33.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.041+0000 7f6d1fc53640 1 --2- 172.21.15.123:0/740207294 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6d180d23b0 0x7f6d180cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:33.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.041+0000 7f6d1fc53640 1 --2- 172.21.15.123:0/740207294 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6cfc06c2e0 0x7f6cfc06e7a0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:33.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.041+0000 7f6d1fc53640 1 --2- 172.21.15.123:0/740207294 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6d180cf2d0 0x7f6d180cbc70 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:33.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.041+0000 7f6d1fc53640 1 -- 172.21.15.123:0/740207294 >> 172.21.15.123:0/740207294 conn(0x7f6d180d1260 msgr2=0x7f6d180b5350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:33.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.041+0000 7f6d1fc53640 1 -- 172.21.15.123:0/740207294 shutdown_connections 2024-09-15T23:21:33.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.041+0000 7f6d1fc53640 1 -- 172.21.15.123:0/740207294 wait complete. 2024-09-15T23:21:33.053 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:21:33.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.150+0000 7f6ed64eb640 1 Processor -- start 2024-09-15T23:21:33.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.151+0000 7f6ed64eb640 1 -- start start 2024-09-15T23:21:33.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.151+0000 7f6ed64eb640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6ed00b6970 0x7f6ed00b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:33.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.151+0000 7f6ed64eb640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ed00d0e70 con 0x7f6ed015ed20 2024-09-15T23:21:33.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.151+0000 7f6ed64eb640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ed00d41c0 con 0x7f6ed00d23b0 2024-09-15T23:21:33.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.151+0000 7f6ed64eb640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f6ed00d35b0 con 0x7f6ed00b6970 2024-09-15T23:21:33.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.151+0000 7f6ecf7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6ed00b6970 0x7f6ed00b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:33.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.151+0000 7f6ecffff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6ed015ed20 0x7f6ed00b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:49644/0 (socket says 172.21.15.123:49644) 2024-09-15T23:21:33.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.151+0000 7f6ecf7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6ed00b6970 0x7f6ed00b80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57886/0 (socket says 172.21.15.123:57886) 2024-09-15T23:21:33.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.152+0000 7f6ecffff640 1 -- 172.21.15.123:0/3075980681 learned_addr learned my addr 172.21.15.123:0/3075980681 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:21:33.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.152+0000 7f6ecf7fe640 1 -- 172.21.15.123:0/3075980681 >> v1:172.21.15.188:6789/0 conn(0x7f6ed00d23b0 legacy=0x7f6ed00b8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:33.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.152+0000 7f6ecf7fe640 1 -- 172.21.15.123:0/3075980681 >> v1:172.21.15.123:6789/0 conn(0x7f6ed015ed20 legacy=0x7f6ed00b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:33.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.152+0000 7f6ecf7fe640 1 -- 172.21.15.123:0/3075980681 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ed00d3890 con 0x7f6ed00b6970 2024-09-15T23:21:33.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.152+0000 7f6eceffd640 1 -- 172.21.15.123:0/3075980681 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3369032110 0 0) 0x7f6ec0001110 con 0x7f6ed015ed20 2024-09-15T23:21:33.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.152+0000 7f6ecf7fe640 1 --2- 172.21.15.123:0/3075980681 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ed00b6970 0x7f6ed00b80d0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f6ec40097a0 tx=0x7f6ec402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da2f3816bb5d6bf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:33.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.153+0000 7f6eceffd640 1 -- 172.21.15.123:0/3075980681 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4037070 con 0x7f6ed00b6970 2024-09-15T23:21:33.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.153+0000 7f6eceffd640 1 -- 172.21.15.123:0/3075980681 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ec4032440 con 0x7f6ed00b6970 2024-09-15T23:21:33.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.153+0000 7f6eceffd640 1 -- 172.21.15.123:0/3075980681 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4032810 con 0x7f6ed00b6970 2024-09-15T23:21:33.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.153+0000 7f6ed64eb640 1 -- 172.21.15.123:0/3075980681 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ed00b6970 msgr2=0x7f6ed00b80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:33.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.153+0000 7f6ed64eb640 1 --2- 172.21.15.123:0/3075980681 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ed00b6970 0x7f6ed00b80d0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f6ec40097a0 tx=0x7f6ec402a1a0 comp rx=0 tx=0).stop 2024-09-15T23:21:33.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.153+0000 7f6ed64eb640 1 -- 172.21.15.123:0/3075980681 shutdown_connections 2024-09-15T23:21:33.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.153+0000 7f6ed64eb640 1 --2- 172.21.15.123:0/3075980681 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ed00b6970 0x7f6ed00b80d0 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:33.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.153+0000 7f6ed64eb640 1 -- 172.21.15.123:0/3075980681 >> 172.21.15.123:0/3075980681 conn(0x7f6ed00d1260 msgr2=0x7f6ed00d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:33.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.153+0000 7f6ed64eb640 1 -- 172.21.15.123:0/3075980681 shutdown_connections 2024-09-15T23:21:33.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.153+0000 7f6ed64eb640 1 -- 172.21.15.123:0/3075980681 wait complete. 2024-09-15T23:21:33.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.154+0000 7f6ed64eb640 1 Processor -- start 2024-09-15T23:21:33.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.155+0000 7f6ed64eb640 1 -- start start 2024-09-15T23:21:33.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.155+0000 7f6ed64eb640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ed00b6970 0x7f6ed00ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:33.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.155+0000 7f6ed64eb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ed00d23b0 0x7f6ed0154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:33.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.155+0000 7f6ed64eb640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ed015ed20 0x7f6ed0157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:33.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.155+0000 7f6ed64eb640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed00d32a0 con 0x7f6ed00d23b0 2024-09-15T23:21:33.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.155+0000 7f6ed64eb640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed00d3e50 con 0x7f6ed00b6970 2024-09-15T23:21:33.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.155+0000 7f6ed64eb640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6ed015f100 con 0x7f6ed015ed20 2024-09-15T23:21:33.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.155+0000 7f6ecf7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ed00d23b0 0x7f6ed0154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:33.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.155+0000 7f6ecf7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ed00d23b0 0x7f6ed0154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57892/0 (socket says 172.21.15.123:57892) 2024-09-15T23:21:33.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.155+0000 7f6ecf7fe640 1 -- 172.21.15.123:0/1328227251 learned_addr learned my addr 172.21.15.123:0/1328227251 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:33.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.155+0000 7f6ecffff640 1 --2- 172.21.15.123:0/1328227251 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ed00b6970 0x7f6ed00ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:33.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.156+0000 7f6ed4a88640 1 --2- 172.21.15.123:0/1328227251 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ed015ed20 0x7f6ed0157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:33.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.156+0000 7f6ecf7fe640 1 -- 172.21.15.123:0/1328227251 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ed015ed20 msgr2=0x7f6ed0157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:33.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.156+0000 7f6ecf7fe640 1 --2- 172.21.15.123:0/1328227251 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ed015ed20 0x7f6ed0157a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:33.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.156+0000 7f6ecf7fe640 1 -- 172.21.15.123:0/1328227251 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ed00b6970 msgr2=0x7f6ed00ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:33.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.156+0000 7f6ecf7fe640 1 --2- 172.21.15.123:0/1328227251 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ed00b6970 0x7f6ed00ccdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:33.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.156+0000 7f6ecf7fe640 1 -- 172.21.15.123:0/1328227251 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ed00cbd20 con 0x7f6ed00d23b0 2024-09-15T23:21:33.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.156+0000 7f6ecffff640 1 --2- 172.21.15.123:0/1328227251 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ed00b6970 0x7f6ed00ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:21:33.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.156+0000 7f6ecf7fe640 1 --2- 172.21.15.123:0/1328227251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ed00d23b0 0x7f6ed0154810 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f6ec40097a0 tx=0x7f6ec40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:33.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.156+0000 7f6eccff9640 1 -- 172.21.15.123:0/1328227251 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4037050 con 0x7f6ed00d23b0 2024-09-15T23:21:33.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.156+0000 7f6eccff9640 1 -- 172.21.15.123:0/1328227251 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ec4038040 con 0x7f6ed00d23b0 2024-09-15T23:21:33.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.156+0000 7f6ed64eb640 1 -- 172.21.15.123:0/1328227251 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ed00cc000 con 0x7f6ed00d23b0 2024-09-15T23:21:33.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.156+0000 7f6eccff9640 1 -- 172.21.15.123:0/1328227251 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4004490 con 0x7f6ed00d23b0 2024-09-15T23:21:33.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.156+0000 7f6ed64eb640 1 -- 172.21.15.123:0/1328227251 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ed00cc5c0 con 0x7f6ed00d23b0 2024-09-15T23:21:33.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.157+0000 7f6ed64eb640 1 -- 172.21.15.123:0/1328227251 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ed00d1f60 con 0x7f6ed00d23b0 2024-09-15T23:21:33.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.158+0000 7f6eccff9640 1 -- 172.21.15.123:0/1328227251 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6ec4030900 con 0x7f6ed00d23b0 2024-09-15T23:21:33.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.158+0000 7f6eccff9640 1 --2- 172.21.15.123:0/1328227251 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6ebc06c2b0 0x7f6ebc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:33.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.158+0000 7f6eccff9640 1 -- 172.21.15.123:0/1328227251 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7f6ec40ac0f0 con 0x7f6ed00d23b0 2024-09-15T23:21:33.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.158+0000 7f6ecffff640 1 --2- 172.21.15.123:0/1328227251 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6ebc06c2b0 0x7f6ebc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:33.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.159+0000 7f6ecffff640 1 --2- 172.21.15.123:0/1328227251 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6ebc06c2b0 0x7f6ebc06e770 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0000f60 tx=0x7f6ec0007a10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:33.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.162+0000 7f6eccff9640 1 -- 172.21.15.123:0/1328227251 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6ed00d1f60 con 0x7f6ed00d23b0 2024-09-15T23:21:33.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.360+0000 7f6ed64eb640 1 -- 172.21.15.123:0/1328227251 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ed00b7010 con 0x7f6ed00d23b0 2024-09-15T23:21:33.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.361+0000 7f6eccff9640 1 -- 172.21.15.123:0/1328227251 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) ==== 95+0+5241 (secure 0 0 0) 0x7f6ec407aa10 con 0x7f6ed00d23b0 2024-09-15T23:21:33.362 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:33.362 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":100,"btime":"2024-09-15T23:21:24:727971+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7214,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/1648353391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1648353391},{"type":"v1","addr":"172.21.15.188:6837","nonce":1648353391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8122,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/1714717257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":1714717257},{"type":"v1","addr":"172.21.15.188:6836","nonce":1714717257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":9552,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/3722702026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3722702026},{"type":"v1","addr":"172.21.15.123:6833","nonce":3722702026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:21:22.066391+0000","modified":"2024-09-15T23:21:24.056941+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9564},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9564":{"gid":9564,"name":"a","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/1883512279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1883512279},{"type":"v1","addr":"172.21.15.123:6835","nonce":1883512279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9564,"qdb_cluster":[9564]},"id":11}]} 2024-09-15T23:21:33.363 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 100 2024-09-15T23:21:33.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.363+0000 7f6ed64eb640 1 -- 172.21.15.123:0/1328227251 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6ebc06c2b0 msgr2=0x7f6ebc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:33.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.363+0000 7f6ed64eb640 1 --2- 172.21.15.123:0/1328227251 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6ebc06c2b0 0x7f6ebc06e770 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0000f60 tx=0x7f6ec0007a10 comp rx=0 tx=0).stop 2024-09-15T23:21:33.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.363+0000 7f6ed64eb640 1 -- 172.21.15.123:0/1328227251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ed00d23b0 msgr2=0x7f6ed0154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:33.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.363+0000 7f6ed64eb640 1 --2- 172.21.15.123:0/1328227251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ed00d23b0 0x7f6ed0154810 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f6ec40097a0 tx=0x7f6ec40046c0 comp rx=0 tx=0).stop 2024-09-15T23:21:33.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.363+0000 7f6ed64eb640 1 -- 172.21.15.123:0/1328227251 shutdown_connections 2024-09-15T23:21:33.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.363+0000 7f6ed64eb640 1 --2- 172.21.15.123:0/1328227251 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6ed015ed20 0x7f6ed0157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:33.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.363+0000 7f6ed64eb640 1 --2- 172.21.15.123:0/1328227251 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6ebc06c2b0 0x7f6ebc06e770 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:33.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.363+0000 7f6ed64eb640 1 --2- 172.21.15.123:0/1328227251 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ed00d23b0 0x7f6ed0154810 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:33.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.363+0000 7f6ed64eb640 1 --2- 172.21.15.123:0/1328227251 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6ed00b6970 0x7f6ed00ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:33.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.363+0000 7f6ed64eb640 1 -- 172.21.15.123:0/1328227251 >> 172.21.15.123:0/1328227251 conn(0x7f6ed00d1260 msgr2=0x7f6ed00b4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:33.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.363+0000 7f6ed64eb640 1 -- 172.21.15.123:0/1328227251 shutdown_connections 2024-09-15T23:21:33.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33.363+0000 7f6ed64eb640 1 -- 172.21.15.123:0/1328227251 wait complete. 2024-09-15T23:21:33.375 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:21:33.375 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:21:33.376 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.0 2024-09-15T23:21:33.376 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:21:33.376 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:21:33.376 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:21:33.376 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:21:33.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:21:33.442 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.443 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.443 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00997858 s, 105 MB/s 2024-09-15T23:21:33.452 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.452 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.452 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00796022 s, 132 MB/s 2024-09-15T23:21:33.462 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.463 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.463 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00875945 s, 120 MB/s 2024-09-15T23:21:33.471 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.472 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.472 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072364 s, 145 MB/s 2024-09-15T23:21:33.480 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.480 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.480 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068622 s, 153 MB/s 2024-09-15T23:21:33.490 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.490 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.490 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00834797 s, 126 MB/s 2024-09-15T23:21:33.499 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.499 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.499 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741136 s, 141 MB/s 2024-09-15T23:21:33.508 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.509 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.509 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00825781 s, 127 MB/s 2024-09-15T23:21:33.517 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.517 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.517 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652146 s, 161 MB/s 2024-09-15T23:21:33.526 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.526 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.526 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717624 s, 146 MB/s 2024-09-15T23:21:33.534 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.534 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.534 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669019 s, 157 MB/s 2024-09-15T23:21:33.541 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.541 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.541 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597976 s, 175 MB/s 2024-09-15T23:21:33.549 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.549 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.549 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059036 s, 178 MB/s 2024-09-15T23:21:33.558 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.558 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.558 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757444 s, 138 MB/s 2024-09-15T23:21:33.567 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.568 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.568 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074914 s, 140 MB/s 2024-09-15T23:21:33.575 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.575 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.576 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613357 s, 171 MB/s 2024-09-15T23:21:33.585 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.585 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.585 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759494 s, 138 MB/s 2024-09-15T23:21:33.594 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.594 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.594 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752767 s, 139 MB/s 2024-09-15T23:21:33.602 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.602 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.602 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682899 s, 154 MB/s 2024-09-15T23:21:33.610 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.611 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.611 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647148 s, 162 MB/s 2024-09-15T23:21:33.620 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.620 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.620 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768473 s, 136 MB/s 2024-09-15T23:21:33.628 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.628 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.628 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666235 s, 157 MB/s 2024-09-15T23:21:33.637 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.637 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.637 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680598 s, 154 MB/s 2024-09-15T23:21:33.644 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.644 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.644 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579191 s, 181 MB/s 2024-09-15T23:21:33.652 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.653 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.653 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671097 s, 156 MB/s 2024-09-15T23:21:33.662 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.662 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.662 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776809 s, 135 MB/s 2024-09-15T23:21:33.670 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.670 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.670 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065362 s, 160 MB/s 2024-09-15T23:21:33.679 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.679 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.679 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695822 s, 151 MB/s 2024-09-15T23:21:33.688 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.688 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.688 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749058 s, 140 MB/s 2024-09-15T23:21:33.696 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.696 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.696 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683816 s, 153 MB/s 2024-09-15T23:21:33.704 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.705 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.705 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667832 s, 157 MB/s 2024-09-15T23:21:33.713 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.713 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.713 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666301 s, 157 MB/s 2024-09-15T23:21:33.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:21:33.720 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:21:33.720 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:21:33.720 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.1 2024-09-15T23:21:33.720 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:21:33.721 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:21:33.721 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:21:33.721 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:21:33.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:21:33.781 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.781 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.781 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747481 s, 140 MB/s 2024-09-15T23:21:33.790 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.790 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.790 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738216 s, 142 MB/s 2024-09-15T23:21:33.797 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.797 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.797 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058644 s, 179 MB/s 2024-09-15T23:21:33.805 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.805 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.805 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641891 s, 163 MB/s 2024-09-15T23:21:33.813 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.814 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.814 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637675 s, 164 MB/s 2024-09-15T23:21:33.821 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.822 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.822 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652393 s, 161 MB/s 2024-09-15T23:21:33.830 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.830 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.830 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072721 s, 144 MB/s 2024-09-15T23:21:33.840 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.840 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.840 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655066 s, 160 MB/s 2024-09-15T23:21:33.847 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.847 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.847 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714353 s, 147 MB/s 2024-09-15T23:21:33.856 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.856 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.856 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728894 s, 144 MB/s 2024-09-15T23:21:33.864 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.864 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.864 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644306 s, 163 MB/s 2024-09-15T23:21:33.873 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.873 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.873 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754764 s, 139 MB/s 2024-09-15T23:21:33.881 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.881 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.881 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592259 s, 177 MB/s 2024-09-15T23:21:33.889 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.889 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.889 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668473 s, 157 MB/s 2024-09-15T23:21:33.897 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.898 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.898 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072532 s, 145 MB/s 2024-09-15T23:21:33.906 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.906 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.906 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655199 s, 160 MB/s 2024-09-15T23:21:33.915 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.915 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.915 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074778 s, 140 MB/s 2024-09-15T23:21:33.923 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.923 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.923 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645274 s, 163 MB/s 2024-09-15T23:21:33.930 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.930 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.930 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589553 s, 178 MB/s 2024-09-15T23:21:33.939 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.939 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.940 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745253 s, 141 MB/s 2024-09-15T23:21:33.947 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.947 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.947 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632074 s, 166 MB/s 2024-09-15T23:21:33.955 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.955 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.955 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642432 s, 163 MB/s 2024-09-15T23:21:33.964 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.964 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.964 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726357 s, 144 MB/s 2024-09-15T23:21:33.973 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.973 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.973 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723461 s, 145 MB/s 2024-09-15T23:21:33.981 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.981 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.981 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651659 s, 161 MB/s 2024-09-15T23:21:33.990 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.990 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.990 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741439 s, 141 MB/s 2024-09-15T23:21:33.999 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:33.999 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:33.999 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072521 s, 145 MB/s 2024-09-15T23:21:34.007 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.007 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.007 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614856 s, 171 MB/s 2024-09-15T23:21:34.014 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.014 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.015 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588473 s, 178 MB/s 2024-09-15T23:21:34.023 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.023 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.023 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702414 s, 149 MB/s 2024-09-15T23:21:34.031 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.031 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.031 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638524 s, 164 MB/s 2024-09-15T23:21:34.039 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.039 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.039 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586383 s, 179 MB/s 2024-09-15T23:21:34.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:21:34.049 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:21:34.049 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:21:34.049 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.2 2024-09-15T23:21:34.049 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:21:34.049 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:21:34.049 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:21:34.049 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:21:34.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:21:34.107 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.107 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.107 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656329 s, 160 MB/s 2024-09-15T23:21:34.116 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.116 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.116 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739173 s, 142 MB/s 2024-09-15T23:21:34.124 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.124 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.124 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647779 s, 162 MB/s 2024-09-15T23:21:34.132 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.132 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.132 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660169 s, 159 MB/s 2024-09-15T23:21:34.141 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.141 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.141 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735454 s, 143 MB/s 2024-09-15T23:21:34.149 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.149 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.149 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059041 s, 178 MB/s 2024-09-15T23:21:34.158 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.158 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.158 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728759 s, 144 MB/s 2024-09-15T23:21:34.166 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.166 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.166 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656066 s, 160 MB/s 2024-09-15T23:21:34.174 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.174 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.174 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653719 s, 160 MB/s 2024-09-15T23:21:34.183 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.183 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.183 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712672 s, 147 MB/s 2024-09-15T23:21:34.191 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.191 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.191 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632664 s, 166 MB/s 2024-09-15T23:21:34.199 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.199 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.199 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671993 s, 156 MB/s 2024-09-15T23:21:34.208 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.209 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.209 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739378 s, 142 MB/s 2024-09-15T23:21:34.216 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.216 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.216 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658255 s, 159 MB/s 2024-09-15T23:21:34.224 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.224 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.224 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635144 s, 165 MB/s 2024-09-15T23:21:34.233 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.233 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.234 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754641 s, 139 MB/s 2024-09-15T23:21:34.242 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.242 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.242 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687907 s, 152 MB/s 2024-09-15T23:21:34.249 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.249 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.250 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574478 s, 183 MB/s 2024-09-15T23:21:34.258 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.258 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.259 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072582 s, 144 MB/s 2024-09-15T23:21:34.266 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.266 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.266 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057703 s, 182 MB/s 2024-09-15T23:21:34.273 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.274 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.274 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569813 s, 184 MB/s 2024-09-15T23:21:34.282 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.282 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.283 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716259 s, 146 MB/s 2024-09-15T23:21:34.291 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.291 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.291 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063823 s, 164 MB/s 2024-09-15T23:21:34.300 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.300 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.300 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678394 s, 155 MB/s 2024-09-15T23:21:34.309 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.309 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.309 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722722 s, 145 MB/s 2024-09-15T23:21:34.317 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.317 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.317 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623715 s, 168 MB/s 2024-09-15T23:21:34.325 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.325 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.325 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605513 s, 173 MB/s 2024-09-15T23:21:34.334 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.334 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.334 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663755 s, 158 MB/s 2024-09-15T23:21:34.343 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.343 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.343 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738553 s, 142 MB/s 2024-09-15T23:21:34.352 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.352 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.352 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636965 s, 165 MB/s 2024-09-15T23:21:34.361 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.361 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.361 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708429 s, 148 MB/s 2024-09-15T23:21:34.370 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.370 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.370 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714095 s, 147 MB/s 2024-09-15T23:21:34.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:21:34.377 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:21:34.377 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:21:34.377 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.3 2024-09-15T23:21:34.377 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:21:34.377 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:21:34.377 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:21:34.377 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:21:34.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:21:34.436 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.436 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.437 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745601 s, 141 MB/s 2024-09-15T23:21:34.445 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.446 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.446 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707944 s, 148 MB/s 2024-09-15T23:21:34.455 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.455 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.455 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729832 s, 144 MB/s 2024-09-15T23:21:34.463 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.463 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.463 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656884 s, 160 MB/s 2024-09-15T23:21:34.473 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.473 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.473 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729788 s, 144 MB/s 2024-09-15T23:21:34.481 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.482 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.482 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677776 s, 155 MB/s 2024-09-15T23:21:34.490 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.490 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.490 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655709 s, 160 MB/s 2024-09-15T23:21:34.499 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.499 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.499 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752669 s, 139 MB/s 2024-09-15T23:21:34.507 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.507 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.507 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620388 s, 169 MB/s 2024-09-15T23:21:34.516 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.516 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.516 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644361 s, 163 MB/s 2024-09-15T23:21:34.525 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.525 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.525 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667704 s, 157 MB/s 2024-09-15T23:21:34.533 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.533 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.533 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643331 s, 163 MB/s 2024-09-15T23:21:34.541 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.541 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.541 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578932 s, 181 MB/s 2024-09-15T23:21:34.549 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.549 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.550 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642955 s, 163 MB/s 2024-09-15T23:21:34.558 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.558 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.558 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651711 s, 161 MB/s 2024-09-15T23:21:34.567 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.567 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.567 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719683 s, 146 MB/s 2024-09-15T23:21:34.575 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.575 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.576 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631175 s, 166 MB/s 2024-09-15T23:21:34.584 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.584 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.584 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695865 s, 151 MB/s 2024-09-15T23:21:34.593 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.593 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.594 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721401 s, 145 MB/s 2024-09-15T23:21:34.602 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.603 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.603 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711854 s, 147 MB/s 2024-09-15T23:21:34.612 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.612 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.612 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739752 s, 142 MB/s 2024-09-15T23:21:34.620 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.620 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.620 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625626 s, 168 MB/s 2024-09-15T23:21:34.629 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.629 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.629 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735456 s, 143 MB/s 2024-09-15T23:21:34.638 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.638 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.638 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699353 s, 150 MB/s 2024-09-15T23:21:34.646 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.646 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.646 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604811 s, 173 MB/s 2024-09-15T23:21:34.655 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.655 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.655 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655974 s, 160 MB/s 2024-09-15T23:21:34.663 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.663 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.663 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646889 s, 162 MB/s 2024-09-15T23:21:34.671 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.671 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.671 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592417 s, 177 MB/s 2024-09-15T23:21:34.679 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.679 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.679 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579244 s, 181 MB/s 2024-09-15T23:21:34.688 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.688 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.688 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651821 s, 161 MB/s 2024-09-15T23:21:34.696 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.697 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.697 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678143 s, 155 MB/s 2024-09-15T23:21:34.705 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.705 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.705 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625911 s, 168 MB/s 2024-09-15T23:21:34.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:21:34.711 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:21:34.711 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:21:34.711 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.4 2024-09-15T23:21:34.712 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:21:34.712 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:21:34.712 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:21:34.712 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:21:34.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:21:34.769 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.769 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.769 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565036 s, 186 MB/s 2024-09-15T23:21:34.777 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.777 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.777 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573169 s, 183 MB/s 2024-09-15T23:21:34.785 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.785 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.785 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706836 s, 148 MB/s 2024-09-15T23:21:34.794 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.794 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.794 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711331 s, 147 MB/s 2024-09-15T23:21:34.802 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.802 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.803 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662743 s, 158 MB/s 2024-09-15T23:21:34.810 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.811 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.811 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657291 s, 160 MB/s 2024-09-15T23:21:34.819 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.819 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.819 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658708 s, 159 MB/s 2024-09-15T23:21:34.826 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.826 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.826 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629372 s, 167 MB/s 2024-09-15T23:21:34.834 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.834 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.834 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063697 s, 165 MB/s 2024-09-15T23:21:34.842 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.842 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.842 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611144 s, 172 MB/s 2024-09-15T23:21:34.850 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.850 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.850 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592608 s, 177 MB/s 2024-09-15T23:21:34.857 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.857 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.857 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571725 s, 183 MB/s 2024-09-15T23:21:34.864 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.864 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.868 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573596 s, 183 MB/s 2024-09-15T23:21:34.872 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.873 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.873 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649135 s, 162 MB/s 2024-09-15T23:21:34.881 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.881 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.881 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647832 s, 162 MB/s 2024-09-15T23:21:34.889 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.889 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.889 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638809 s, 164 MB/s 2024-09-15T23:21:34.897 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.897 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.897 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663171 s, 158 MB/s 2024-09-15T23:21:34.904 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.904 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.904 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564512 s, 186 MB/s 2024-09-15T23:21:34.912 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.912 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.912 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643192 s, 163 MB/s 2024-09-15T23:21:34.920 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.921 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.921 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672614 s, 156 MB/s 2024-09-15T23:21:34.928 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.928 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.928 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571084 s, 184 MB/s 2024-09-15T23:21:34.936 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.936 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.936 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625535 s, 168 MB/s 2024-09-15T23:21:34.945 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.945 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.945 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720154 s, 146 MB/s 2024-09-15T23:21:34.953 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.953 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.953 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650809 s, 161 MB/s 2024-09-15T23:21:34.961 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.961 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.961 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636336 s, 165 MB/s 2024-09-15T23:21:34.969 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.969 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.969 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626214 s, 167 MB/s 2024-09-15T23:21:34.977 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.977 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.977 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626862 s, 167 MB/s 2024-09-15T23:21:34.984 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.984 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.984 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638467 s, 164 MB/s 2024-09-15T23:21:34.992 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:34.992 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:34.992 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641331 s, 163 MB/s 2024-09-15T23:21:35.001 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.001 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.001 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720729 s, 145 MB/s 2024-09-15T23:21:35.010 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.011 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.011 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720351 s, 146 MB/s 2024-09-15T23:21:35.018 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.018 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.018 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642331 s, 163 MB/s 2024-09-15T23:21:35.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:21:35.025 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:21:35.025 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:21:35.025 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.5 2024-09-15T23:21:35.025 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:21:35.025 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:21:35.025 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:21:35.025 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:21:35.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:21:35.084 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.084 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.084 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659855 s, 159 MB/s 2024-09-15T23:21:35.092 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.092 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.092 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666504 s, 157 MB/s 2024-09-15T23:21:35.101 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.101 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.101 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719704 s, 146 MB/s 2024-09-15T23:21:35.109 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.109 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.109 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637419 s, 165 MB/s 2024-09-15T23:21:35.117 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.117 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.117 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066222 s, 158 MB/s 2024-09-15T23:21:35.126 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.126 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.126 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718073 s, 146 MB/s 2024-09-15T23:21:35.135 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.135 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.135 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724653 s, 145 MB/s 2024-09-15T23:21:35.144 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.144 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.144 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704499 s, 149 MB/s 2024-09-15T23:21:35.153 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.153 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.153 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718167 s, 146 MB/s 2024-09-15T23:21:35.162 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.162 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.162 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673467 s, 156 MB/s 2024-09-15T23:21:35.170 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.170 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.170 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629046 s, 167 MB/s 2024-09-15T23:21:35.179 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.179 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.179 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734394 s, 143 MB/s 2024-09-15T23:21:35.187 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.187 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.187 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593754 s, 177 MB/s 2024-09-15T23:21:35.196 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.196 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.197 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660692 s, 159 MB/s 2024-09-15T23:21:35.205 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.205 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.205 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721852 s, 145 MB/s 2024-09-15T23:21:35.213 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.213 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.213 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590978 s, 177 MB/s 2024-09-15T23:21:35.222 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.222 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.223 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725484 s, 145 MB/s 2024-09-15T23:21:35.231 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.231 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.231 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650121 s, 161 MB/s 2024-09-15T23:21:35.239 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.239 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.239 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648322 s, 162 MB/s 2024-09-15T23:21:35.247 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.247 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.247 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629052 s, 167 MB/s 2024-09-15T23:21:35.255 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.255 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.256 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637591 s, 164 MB/s 2024-09-15T23:21:35.265 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.265 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.265 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076426 s, 137 MB/s 2024-09-15T23:21:35.274 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.274 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.274 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677707 s, 155 MB/s 2024-09-15T23:21:35.282 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.282 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.282 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597136 s, 176 MB/s 2024-09-15T23:21:35.291 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.291 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.291 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708532 s, 148 MB/s 2024-09-15T23:21:35.299 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.299 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.300 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619443 s, 169 MB/s 2024-09-15T23:21:35.307 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.307 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.307 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059758 s, 175 MB/s 2024-09-15T23:21:35.316 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.317 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.317 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739835 s, 142 MB/s 2024-09-15T23:21:35.325 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.325 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.325 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621157 s, 169 MB/s 2024-09-15T23:21:35.333 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.333 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.333 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643666 s, 163 MB/s 2024-09-15T23:21:35.341 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.341 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.341 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611175 s, 172 MB/s 2024-09-15T23:21:35.349 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.350 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.350 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642513 s, 163 MB/s 2024-09-15T23:21:35.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:21:35.356 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:21:35.356 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:21:35.356 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.6 2024-09-15T23:21:35.357 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:21:35.357 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:21:35.357 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:21:35.357 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:21:35.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:21:35.416 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.416 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.416 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723439 s, 145 MB/s 2024-09-15T23:21:35.424 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.424 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.425 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642795 s, 163 MB/s 2024-09-15T23:21:35.433 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.433 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.433 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063141 s, 166 MB/s 2024-09-15T23:21:35.442 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.442 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.442 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707907 s, 148 MB/s 2024-09-15T23:21:35.451 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.451 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.451 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738273 s, 142 MB/s 2024-09-15T23:21:35.459 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.459 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.459 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648449 s, 162 MB/s 2024-09-15T23:21:35.467 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.467 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.467 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604405 s, 173 MB/s 2024-09-15T23:21:35.476 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.476 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.476 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058017 s, 181 MB/s 2024-09-15T23:21:35.484 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.484 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.484 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742934 s, 141 MB/s 2024-09-15T23:21:35.491 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.491 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.491 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568813 s, 184 MB/s 2024-09-15T23:21:35.500 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.500 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.500 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682136 s, 154 MB/s 2024-09-15T23:21:35.508 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.508 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.509 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650199 s, 161 MB/s 2024-09-15T23:21:35.516 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.517 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.517 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620969 s, 169 MB/s 2024-09-15T23:21:35.526 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.526 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.527 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00787579 s, 133 MB/s 2024-09-15T23:21:35.536 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.536 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.536 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074214 s, 141 MB/s 2024-09-15T23:21:35.544 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.544 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.545 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650272 s, 161 MB/s 2024-09-15T23:21:35.552 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.552 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.552 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057521 s, 182 MB/s 2024-09-15T23:21:35.562 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.562 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.562 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756618 s, 139 MB/s 2024-09-15T23:21:35.571 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.571 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.571 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715629 s, 147 MB/s 2024-09-15T23:21:35.580 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.580 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.580 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703489 s, 149 MB/s 2024-09-15T23:21:35.588 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.588 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.588 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578205 s, 181 MB/s 2024-09-15T23:21:35.597 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.597 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.597 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711265 s, 147 MB/s 2024-09-15T23:21:35.606 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.606 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.606 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664885 s, 158 MB/s 2024-09-15T23:21:35.614 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.614 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.614 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627599 s, 167 MB/s 2024-09-15T23:21:35.622 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.622 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.622 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642429 s, 163 MB/s 2024-09-15T23:21:35.630 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.631 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.631 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643934 s, 163 MB/s 2024-09-15T23:21:35.641 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.641 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.641 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0081244 s, 129 MB/s 2024-09-15T23:21:35.650 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.650 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.650 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682503 s, 154 MB/s 2024-09-15T23:21:35.659 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.659 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.659 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737379 s, 142 MB/s 2024-09-15T23:21:35.668 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.668 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.668 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748313 s, 140 MB/s 2024-09-15T23:21:35.676 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.676 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.676 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653826 s, 160 MB/s 2024-09-15T23:21:35.684 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.685 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.685 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681589 s, 154 MB/s 2024-09-15T23:21:35.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:21:35.692 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:21:35.692 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:21:35.692 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.7 2024-09-15T23:21:35.692 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:21:35.692 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:21:35.692 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:21:35.692 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:21:35.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:21:35.751 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.751 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.751 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659913 s, 159 MB/s 2024-09-15T23:21:35.760 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.760 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.760 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771987 s, 136 MB/s 2024-09-15T23:21:35.770 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.770 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.770 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0078267 s, 134 MB/s 2024-09-15T23:21:35.778 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.778 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.778 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066704 s, 157 MB/s 2024-09-15T23:21:35.785 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.785 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.785 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570975 s, 184 MB/s 2024-09-15T23:21:35.794 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.794 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.794 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643386 s, 163 MB/s 2024-09-15T23:21:35.801 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.801 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.801 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589387 s, 178 MB/s 2024-09-15T23:21:35.809 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.809 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.809 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632635 s, 166 MB/s 2024-09-15T23:21:35.817 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.817 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.818 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680782 s, 154 MB/s 2024-09-15T23:21:35.826 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.826 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.826 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679778 s, 154 MB/s 2024-09-15T23:21:35.834 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.834 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.834 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664703 s, 158 MB/s 2024-09-15T23:21:35.843 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.843 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.843 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733617 s, 143 MB/s 2024-09-15T23:21:35.852 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.852 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.852 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709597 s, 148 MB/s 2024-09-15T23:21:35.859 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.859 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.859 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615167 s, 170 MB/s 2024-09-15T23:21:35.867 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.868 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.868 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660746 s, 159 MB/s 2024-09-15T23:21:35.877 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.877 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.877 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764123 s, 137 MB/s 2024-09-15T23:21:35.884 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.884 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.885 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006007 s, 175 MB/s 2024-09-15T23:21:35.893 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.893 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.893 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007071 s, 148 MB/s 2024-09-15T23:21:35.903 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.903 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.903 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00829646 s, 126 MB/s 2024-09-15T23:21:35.912 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.912 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.912 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727351 s, 144 MB/s 2024-09-15T23:21:35.920 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.920 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.920 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065265 s, 161 MB/s 2024-09-15T23:21:35.928 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.928 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.928 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639471 s, 164 MB/s 2024-09-15T23:21:35.936 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.936 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.937 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070272 s, 149 MB/s 2024-09-15T23:21:35.944 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.945 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.945 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649061 s, 162 MB/s 2024-09-15T23:21:35.952 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.952 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.952 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608008 s, 172 MB/s 2024-09-15T23:21:35.961 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.961 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.961 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740835 s, 142 MB/s 2024-09-15T23:21:35.968 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.969 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.969 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00555014 s, 189 MB/s 2024-09-15T23:21:35.977 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.977 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.977 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655453 s, 160 MB/s 2024-09-15T23:21:35.985 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.985 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.985 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681379 s, 154 MB/s 2024-09-15T23:21:35.993 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:35.993 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:35.993 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630743 s, 166 MB/s 2024-09-15T23:21:36.001 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.001 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.001 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686582 s, 153 MB/s 2024-09-15T23:21:36.009 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.009 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.009 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623528 s, 168 MB/s 2024-09-15T23:21:36.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:21:36.016 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:21:36.016 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:21:36.016 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.8 2024-09-15T23:21:36.016 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:21:36.016 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:21:36.016 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:21:36.016 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:21:36.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:21:36.074 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.074 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.074 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638609 s, 164 MB/s 2024-09-15T23:21:36.084 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.084 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.084 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764504 s, 137 MB/s 2024-09-15T23:21:36.092 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.092 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.092 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658274 s, 159 MB/s 2024-09-15T23:21:36.099 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.099 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.100 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613764 s, 171 MB/s 2024-09-15T23:21:36.108 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.108 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.108 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656604 s, 160 MB/s 2024-09-15T23:21:36.115 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.116 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.116 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632144 s, 166 MB/s 2024-09-15T23:21:36.124 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.124 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.124 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658717 s, 159 MB/s 2024-09-15T23:21:36.133 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.133 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.133 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730408 s, 144 MB/s 2024-09-15T23:21:36.142 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.142 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.142 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00774229 s, 135 MB/s 2024-09-15T23:21:36.150 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.150 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.150 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613453 s, 171 MB/s 2024-09-15T23:21:36.159 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.159 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.159 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731814 s, 143 MB/s 2024-09-15T23:21:36.167 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.167 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.167 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627683 s, 167 MB/s 2024-09-15T23:21:36.175 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.176 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.176 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719157 s, 146 MB/s 2024-09-15T23:21:36.185 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.185 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.185 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731504 s, 143 MB/s 2024-09-15T23:21:36.192 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.192 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.192 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570251 s, 184 MB/s 2024-09-15T23:21:36.204 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.204 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.205 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110179 s, 95.2 MB/s 2024-09-15T23:21:36.212 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.212 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.212 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586749 s, 179 MB/s 2024-09-15T23:21:36.221 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.224 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.224 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735539 s, 143 MB/s 2024-09-15T23:21:36.230 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.230 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.230 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708592 s, 148 MB/s 2024-09-15T23:21:36.239 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.239 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.239 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719869 s, 146 MB/s 2024-09-15T23:21:36.246 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.247 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.247 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633193 s, 166 MB/s 2024-09-15T23:21:36.255 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.255 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.255 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733833 s, 143 MB/s 2024-09-15T23:21:36.263 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.263 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.263 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563129 s, 186 MB/s 2024-09-15T23:21:36.272 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.272 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.273 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746961 s, 140 MB/s 2024-09-15T23:21:36.280 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.280 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.280 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584199 s, 179 MB/s 2024-09-15T23:21:36.289 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.289 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.289 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062451 s, 168 MB/s 2024-09-15T23:21:36.297 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.297 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.297 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632057 s, 166 MB/s 2024-09-15T23:21:36.305 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.305 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.305 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629744 s, 167 MB/s 2024-09-15T23:21:36.314 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.315 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.315 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733026 s, 143 MB/s 2024-09-15T23:21:36.324 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.324 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.324 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075367 s, 139 MB/s 2024-09-15T23:21:36.333 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.333 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.333 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733589 s, 143 MB/s 2024-09-15T23:21:36.342 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.342 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.342 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626554 s, 167 MB/s 2024-09-15T23:21:36.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:21:36.348 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:21:36.348 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:21:36.348 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.9 2024-09-15T23:21:36.349 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:21:36.349 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:21:36.349 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:21:36.349 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:21:36.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:21:36.408 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.408 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.408 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681283 s, 154 MB/s 2024-09-15T23:21:36.417 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.417 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.417 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754136 s, 139 MB/s 2024-09-15T23:21:36.426 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.426 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.426 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675964 s, 155 MB/s 2024-09-15T23:21:36.434 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.434 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.434 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652515 s, 161 MB/s 2024-09-15T23:21:36.443 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.444 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.444 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728556 s, 144 MB/s 2024-09-15T23:21:36.453 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.453 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.453 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730479 s, 144 MB/s 2024-09-15T23:21:36.460 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.461 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.461 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587422 s, 179 MB/s 2024-09-15T23:21:36.469 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.469 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.469 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640436 s, 164 MB/s 2024-09-15T23:21:36.478 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.478 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.478 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066218 s, 158 MB/s 2024-09-15T23:21:36.487 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.487 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.487 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723211 s, 145 MB/s 2024-09-15T23:21:36.495 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.495 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.495 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639162 s, 164 MB/s 2024-09-15T23:21:36.503 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.503 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.504 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627744 s, 167 MB/s 2024-09-15T23:21:36.513 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.513 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.513 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763091 s, 137 MB/s 2024-09-15T23:21:36.522 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.522 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.522 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073445 s, 143 MB/s 2024-09-15T23:21:36.531 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.532 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.532 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698812 s, 150 MB/s 2024-09-15T23:21:36.541 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.541 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.541 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738456 s, 142 MB/s 2024-09-15T23:21:36.549 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.549 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.549 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656478 s, 160 MB/s 2024-09-15T23:21:36.559 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.559 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.559 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734224 s, 143 MB/s 2024-09-15T23:21:36.567 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.567 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.567 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660722 s, 159 MB/s 2024-09-15T23:21:36.575 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.575 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.575 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565988 s, 185 MB/s 2024-09-15T23:21:36.583 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.583 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.583 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572795 s, 183 MB/s 2024-09-15T23:21:36.592 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.592 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.592 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741148 s, 141 MB/s 2024-09-15T23:21:36.601 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.601 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.602 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710471 s, 148 MB/s 2024-09-15T23:21:36.611 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.611 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.611 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706574 s, 148 MB/s 2024-09-15T23:21:36.619 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.619 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.619 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624212 s, 168 MB/s 2024-09-15T23:21:36.627 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.627 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.627 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634266 s, 165 MB/s 2024-09-15T23:21:36.636 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.636 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.636 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744596 s, 141 MB/s 2024-09-15T23:21:36.645 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.645 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.645 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638808 s, 164 MB/s 2024-09-15T23:21:36.653 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.653 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.653 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641782 s, 163 MB/s 2024-09-15T23:21:36.662 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.663 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.663 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740187 s, 142 MB/s 2024-09-15T23:21:36.671 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.671 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.671 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664174 s, 158 MB/s 2024-09-15T23:21:36.679 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.679 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.679 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588697 s, 178 MB/s 2024-09-15T23:21:36.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:21:36.686 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:21:36.686 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:21:36.686 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.10 2024-09-15T23:21:36.686 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:21:36.686 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:21:36.686 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:21:36.686 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:21:36.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:21:36.744 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.744 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.744 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602681 s, 174 MB/s 2024-09-15T23:21:36.753 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.753 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.753 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006629 s, 158 MB/s 2024-09-15T23:21:36.760 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.760 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.760 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060207 s, 174 MB/s 2024-09-15T23:21:36.769 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.769 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.769 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697412 s, 150 MB/s 2024-09-15T23:21:36.778 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.778 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.778 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736818 s, 142 MB/s 2024-09-15T23:21:36.787 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.787 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.787 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075222 s, 139 MB/s 2024-09-15T23:21:36.795 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.795 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.795 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635035 s, 165 MB/s 2024-09-15T23:21:36.803 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.803 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.803 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639138 s, 164 MB/s 2024-09-15T23:21:36.811 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.811 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.811 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629927 s, 166 MB/s 2024-09-15T23:21:36.818 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.819 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.819 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587552 s, 178 MB/s 2024-09-15T23:21:36.827 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.827 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.827 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065034 s, 161 MB/s 2024-09-15T23:21:36.834 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.835 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.835 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630833 s, 166 MB/s 2024-09-15T23:21:36.843 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.843 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.843 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651441 s, 161 MB/s 2024-09-15T23:21:36.852 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.852 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.852 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737348 s, 142 MB/s 2024-09-15T23:21:36.860 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.860 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.860 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685546 s, 153 MB/s 2024-09-15T23:21:36.869 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.869 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.869 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677099 s, 155 MB/s 2024-09-15T23:21:36.877 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.877 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.877 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696093 s, 151 MB/s 2024-09-15T23:21:36.885 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.885 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.885 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628675 s, 167 MB/s 2024-09-15T23:21:36.894 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.894 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.894 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072381 s, 145 MB/s 2024-09-15T23:21:36.903 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.903 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.903 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702055 s, 149 MB/s 2024-09-15T23:21:36.913 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.913 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.913 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662262 s, 158 MB/s 2024-09-15T23:21:36.920 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.920 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.920 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700316 s, 150 MB/s 2024-09-15T23:21:36.929 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.929 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.929 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772097 s, 136 MB/s 2024-09-15T23:21:36.938 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.938 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.938 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698402 s, 150 MB/s 2024-09-15T23:21:36.946 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.946 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.947 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071499 s, 147 MB/s 2024-09-15T23:21:36.954 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.954 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.954 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585958 s, 179 MB/s 2024-09-15T23:21:36.962 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.962 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.962 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624933 s, 168 MB/s 2024-09-15T23:21:36.970 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.970 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.970 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629761 s, 167 MB/s 2024-09-15T23:21:36.977 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.978 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.978 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594929 s, 176 MB/s 2024-09-15T23:21:36.986 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.986 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.986 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706363 s, 148 MB/s 2024-09-15T23:21:36.994 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:36.994 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:36.994 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582221 s, 180 MB/s 2024-09-15T23:21:37.002 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.002 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.002 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634668 s, 165 MB/s 2024-09-15T23:21:37.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:21:37.009 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:21:37.009 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:21:37.009 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.11 2024-09-15T23:21:37.009 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:21:37.009 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:21:37.009 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:21:37.009 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:21:37.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:21:37.067 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.067 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.067 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065082 s, 161 MB/s 2024-09-15T23:21:37.075 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.076 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.076 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068523 s, 153 MB/s 2024-09-15T23:21:37.083 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.083 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.083 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584668 s, 179 MB/s 2024-09-15T23:21:37.091 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.091 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.091 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620601 s, 169 MB/s 2024-09-15T23:21:37.098 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.098 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.099 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587697 s, 178 MB/s 2024-09-15T23:21:37.107 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.107 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.107 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667684 s, 157 MB/s 2024-09-15T23:21:37.115 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.115 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.115 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652553 s, 161 MB/s 2024-09-15T23:21:37.124 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.124 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.124 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706281 s, 148 MB/s 2024-09-15T23:21:37.133 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.134 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.134 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754343 s, 139 MB/s 2024-09-15T23:21:37.142 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.142 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.142 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063049 s, 166 MB/s 2024-09-15T23:21:37.151 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.151 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.151 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703477 s, 149 MB/s 2024-09-15T23:21:37.159 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.160 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.160 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656725 s, 160 MB/s 2024-09-15T23:21:37.169 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.169 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.169 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075867 s, 138 MB/s 2024-09-15T23:21:37.178 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.179 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.179 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717934 s, 146 MB/s 2024-09-15T23:21:37.188 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.188 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.188 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734822 s, 143 MB/s 2024-09-15T23:21:37.197 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.197 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.197 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733175 s, 143 MB/s 2024-09-15T23:21:37.206 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.206 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.206 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645426 s, 162 MB/s 2024-09-15T23:21:37.213 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.213 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.213 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590561 s, 178 MB/s 2024-09-15T23:21:37.222 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.222 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.222 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660031 s, 159 MB/s 2024-09-15T23:21:37.231 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.231 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.231 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725656 s, 145 MB/s 2024-09-15T23:21:37.238 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.238 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.239 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573796 s, 183 MB/s 2024-09-15T23:21:37.247 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.247 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.247 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720088 s, 146 MB/s 2024-09-15T23:21:37.255 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.255 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.255 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636643 s, 165 MB/s 2024-09-15T23:21:37.263 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.264 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.264 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665051 s, 158 MB/s 2024-09-15T23:21:37.272 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.272 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.272 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706151 s, 148 MB/s 2024-09-15T23:21:37.280 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.281 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.281 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659255 s, 159 MB/s 2024-09-15T23:21:37.290 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.290 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.290 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741206 s, 141 MB/s 2024-09-15T23:21:37.298 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.298 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.298 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698096 s, 150 MB/s 2024-09-15T23:21:37.307 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.307 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.307 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070557 s, 149 MB/s 2024-09-15T23:21:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676116 s, 155 MB/s 2024-09-15T23:21:37.324 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.324 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.324 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721988 s, 145 MB/s 2024-09-15T23:21:37.332 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.332 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.332 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627706 s, 167 MB/s 2024-09-15T23:21:37.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:21:37.339 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:21:37.339 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:21:37.339 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.12 2024-09-15T23:21:37.339 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:21:37.339 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:21:37.339 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:21:37.339 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:21:37.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:21:37.397 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.397 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.397 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614277 s, 171 MB/s 2024-09-15T23:21:37.406 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.406 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.406 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730264 s, 144 MB/s 2024-09-15T23:21:37.415 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.415 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.415 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741946 s, 141 MB/s 2024-09-15T23:21:37.424 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.424 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.424 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729264 s, 144 MB/s 2024-09-15T23:21:37.432 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.432 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.432 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641258 s, 164 MB/s 2024-09-15T23:21:37.439 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.439 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.439 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589018 s, 178 MB/s 2024-09-15T23:21:37.450 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.450 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.450 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0086096 s, 122 MB/s 2024-09-15T23:21:37.458 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.458 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.458 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678286 s, 155 MB/s 2024-09-15T23:21:37.466 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.466 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.467 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669426 s, 157 MB/s 2024-09-15T23:21:37.474 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.474 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.474 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641748 s, 163 MB/s 2024-09-15T23:21:37.482 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.482 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.483 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635225 s, 165 MB/s 2024-09-15T23:21:37.490 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.490 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.490 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648183 s, 162 MB/s 2024-09-15T23:21:37.498 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.498 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.498 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638827 s, 164 MB/s 2024-09-15T23:21:37.507 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.507 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.507 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733864 s, 143 MB/s 2024-09-15T23:21:37.515 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.515 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.515 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066808 s, 157 MB/s 2024-09-15T23:21:37.525 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.525 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.525 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657731 s, 159 MB/s 2024-09-15T23:21:37.532 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.532 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.532 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640865 s, 164 MB/s 2024-09-15T23:21:37.540 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.540 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.540 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688971 s, 152 MB/s 2024-09-15T23:21:37.547 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.547 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.547 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00555318 s, 189 MB/s 2024-09-15T23:21:37.555 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.556 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.556 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656235 s, 160 MB/s 2024-09-15T23:21:37.564 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.564 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.565 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716725 s, 146 MB/s 2024-09-15T23:21:37.572 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.573 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.573 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645725 s, 162 MB/s 2024-09-15T23:21:37.581 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.581 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.582 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728778 s, 144 MB/s 2024-09-15T23:21:37.589 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.589 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.589 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0055816 s, 188 MB/s 2024-09-15T23:21:37.597 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.597 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.597 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643014 s, 163 MB/s 2024-09-15T23:21:37.605 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.605 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.605 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650069 s, 161 MB/s 2024-09-15T23:21:37.613 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.613 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.613 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629848 s, 166 MB/s 2024-09-15T23:21:37.621 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.621 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.621 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683975 s, 153 MB/s 2024-09-15T23:21:37.630 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.630 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.630 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655187 s, 160 MB/s 2024-09-15T23:21:37.638 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.638 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.638 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683742 s, 153 MB/s 2024-09-15T23:21:37.646 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.647 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.647 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672902 s, 156 MB/s 2024-09-15T23:21:37.655 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.655 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.655 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722647 s, 145 MB/s 2024-09-15T23:21:37.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:21:37.662 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:21:37.662 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:21:37.662 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.13 2024-09-15T23:21:37.662 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:21:37.662 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:21:37.662 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:21:37.662 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:21:37.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:21:37.720 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.720 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.720 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636209 s, 165 MB/s 2024-09-15T23:21:37.729 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.729 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.729 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609524 s, 172 MB/s 2024-09-15T23:21:37.737 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.738 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.738 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076539 s, 137 MB/s 2024-09-15T23:21:37.747 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.747 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.747 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709945 s, 148 MB/s 2024-09-15T23:21:37.754 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.755 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.755 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578734 s, 181 MB/s 2024-09-15T23:21:37.764 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.764 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.765 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776918 s, 135 MB/s 2024-09-15T23:21:37.773 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.773 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.773 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715088 s, 147 MB/s 2024-09-15T23:21:37.783 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.783 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.783 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075577 s, 139 MB/s 2024-09-15T23:21:37.790 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.790 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.790 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00562919 s, 186 MB/s 2024-09-15T23:21:37.799 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.799 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.799 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648343 s, 162 MB/s 2024-09-15T23:21:37.809 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.809 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.809 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761484 s, 138 MB/s 2024-09-15T23:21:37.816 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.816 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.817 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589408 s, 178 MB/s 2024-09-15T23:21:37.825 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.825 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.826 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669506 s, 157 MB/s 2024-09-15T23:21:37.833 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.833 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.833 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581977 s, 180 MB/s 2024-09-15T23:21:37.842 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.842 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.842 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071262 s, 147 MB/s 2024-09-15T23:21:37.852 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.852 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.852 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742621 s, 141 MB/s 2024-09-15T23:21:37.860 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.860 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.860 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630351 s, 166 MB/s 2024-09-15T23:21:37.868 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.868 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.868 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0056264 s, 186 MB/s 2024-09-15T23:21:37.877 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.877 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.877 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669832 s, 157 MB/s 2024-09-15T23:21:37.884 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.884 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.884 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593234 s, 177 MB/s 2024-09-15T23:21:37.893 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.893 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.893 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643112 s, 163 MB/s 2024-09-15T23:21:37.902 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.902 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.902 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740876 s, 142 MB/s 2024-09-15T23:21:37.910 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.910 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.910 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648496 s, 162 MB/s 2024-09-15T23:21:37.919 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.919 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.919 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660066 s, 159 MB/s 2024-09-15T23:21:37.926 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.927 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.927 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576411 s, 182 MB/s 2024-09-15T23:21:37.936 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.936 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.936 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731833 s, 143 MB/s 2024-09-15T23:21:37.944 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.944 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.944 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635319 s, 165 MB/s 2024-09-15T23:21:37.953 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.953 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.953 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652829 s, 161 MB/s 2024-09-15T23:21:37.962 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.962 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.962 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712286 s, 147 MB/s 2024-09-15T23:21:37.970 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.970 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.970 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591813 s, 177 MB/s 2024-09-15T23:21:37.979 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.979 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.979 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708051 s, 148 MB/s 2024-09-15T23:21:37.988 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:37.988 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:37.988 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682631 s, 154 MB/s 2024-09-15T23:21:37.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:21:37.994 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:21:37.995 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:21:37.995 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.14 2024-09-15T23:21:37.995 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:21:37.995 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:21:37.995 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:21:37.995 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:21:38.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:21:38.054 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.054 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.054 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657661 s, 159 MB/s 2024-09-15T23:21:38.062 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.062 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.062 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063002 s, 166 MB/s 2024-09-15T23:21:38.070 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.071 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.071 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650495 s, 161 MB/s 2024-09-15T23:21:38.078 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.078 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.078 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585959 s, 179 MB/s 2024-09-15T23:21:38.087 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.087 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.087 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641523 s, 163 MB/s 2024-09-15T23:21:38.095 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.095 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.095 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648702 s, 162 MB/s 2024-09-15T23:21:38.103 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.104 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.104 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632913 s, 166 MB/s 2024-09-15T23:21:38.113 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.113 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.113 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737017 s, 142 MB/s 2024-09-15T23:21:38.121 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.122 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.122 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661731 s, 158 MB/s 2024-09-15T23:21:38.130 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.130 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.130 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651295 s, 161 MB/s 2024-09-15T23:21:38.139 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.139 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.139 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653004 s, 161 MB/s 2024-09-15T23:21:38.147 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.147 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.147 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634019 s, 165 MB/s 2024-09-15T23:21:38.155 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.156 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.156 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631907 s, 166 MB/s 2024-09-15T23:21:38.164 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.164 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.164 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627608 s, 167 MB/s 2024-09-15T23:21:38.173 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.173 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.173 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756032 s, 139 MB/s 2024-09-15T23:21:38.182 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.182 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.182 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648132 s, 162 MB/s 2024-09-15T23:21:38.189 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.190 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.190 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580891 s, 181 MB/s 2024-09-15T23:21:38.199 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.199 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.199 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737862 s, 142 MB/s 2024-09-15T23:21:38.207 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.207 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.207 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585062 s, 179 MB/s 2024-09-15T23:21:38.215 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.215 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.215 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655615 s, 160 MB/s 2024-09-15T23:21:38.224 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.224 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.225 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718756 s, 146 MB/s 2024-09-15T23:21:38.234 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.234 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.234 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074265 s, 141 MB/s 2024-09-15T23:21:38.243 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.243 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.243 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073116 s, 143 MB/s 2024-09-15T23:21:38.252 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.252 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.253 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724568 s, 145 MB/s 2024-09-15T23:21:38.260 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.260 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.260 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566431 s, 185 MB/s 2024-09-15T23:21:38.268 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.268 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.268 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00614044 s, 171 MB/s 2024-09-15T23:21:38.277 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.277 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.277 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630639 s, 166 MB/s 2024-09-15T23:21:38.286 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.286 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.286 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718488 s, 146 MB/s 2024-09-15T23:21:38.295 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.295 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.295 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734442 s, 143 MB/s 2024-09-15T23:21:38.303 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.303 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.303 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616016 s, 170 MB/s 2024-09-15T23:21:38.313 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.313 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.313 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723189 s, 145 MB/s 2024-09-15T23:21:38.321 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.321 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.321 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651005 s, 161 MB/s 2024-09-15T23:21:38.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:21:38.328 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:21:38.328 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:21:38.328 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.15 2024-09-15T23:21:38.328 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:21:38.328 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:21:38.328 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:21:38.328 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:21:38.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:21:38.387 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.387 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.387 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071713 s, 146 MB/s 2024-09-15T23:21:38.396 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.396 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.396 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661331 s, 159 MB/s 2024-09-15T23:21:38.405 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.405 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.405 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699746 s, 150 MB/s 2024-09-15T23:21:38.414 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.414 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.414 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719716 s, 146 MB/s 2024-09-15T23:21:38.423 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.423 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.423 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710531 s, 148 MB/s 2024-09-15T23:21:38.431 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.432 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.432 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680997 s, 154 MB/s 2024-09-15T23:21:38.440 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.441 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.441 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646875 s, 162 MB/s 2024-09-15T23:21:38.448 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.449 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.449 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667604 s, 157 MB/s 2024-09-15T23:21:38.458 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.458 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.458 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725633 s, 145 MB/s 2024-09-15T23:21:38.466 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.466 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.466 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064081 s, 164 MB/s 2024-09-15T23:21:38.474 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.475 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.475 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649073 s, 162 MB/s 2024-09-15T23:21:38.483 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.483 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.483 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675306 s, 155 MB/s 2024-09-15T23:21:38.493 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.493 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.493 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00792724 s, 132 MB/s 2024-09-15T23:21:38.502 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.502 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.502 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672283 s, 156 MB/s 2024-09-15T23:21:38.509 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.510 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.510 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616231 s, 170 MB/s 2024-09-15T23:21:38.517 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.517 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.517 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580698 s, 181 MB/s 2024-09-15T23:21:38.526 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.526 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.527 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762455 s, 138 MB/s 2024-09-15T23:21:38.535 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.535 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.536 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720485 s, 146 MB/s 2024-09-15T23:21:38.544 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.544 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.545 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724021 s, 145 MB/s 2024-09-15T23:21:38.553 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.553 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.553 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661073 s, 159 MB/s 2024-09-15T23:21:38.561 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.561 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.561 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664701 s, 158 MB/s 2024-09-15T23:21:38.570 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.570 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.570 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717106 s, 146 MB/s 2024-09-15T23:21:38.579 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.579 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.579 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006593 s, 159 MB/s 2024-09-15T23:21:38.589 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.589 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.589 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00805989 s, 130 MB/s 2024-09-15T23:21:38.598 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.598 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.598 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762766 s, 137 MB/s 2024-09-15T23:21:38.607 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.607 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.607 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670161 s, 156 MB/s 2024-09-15T23:21:38.616 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.616 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.616 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717193 s, 146 MB/s 2024-09-15T23:21:38.624 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.624 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.624 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665468 s, 158 MB/s 2024-09-15T23:21:38.633 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.633 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.633 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642088 s, 163 MB/s 2024-09-15T23:21:38.641 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.641 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.641 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069168 s, 152 MB/s 2024-09-15T23:21:38.649 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.649 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.650 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644475 s, 163 MB/s 2024-09-15T23:21:38.658 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.658 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.658 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713701 s, 147 MB/s 2024-09-15T23:21:38.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:21:38.665 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:21:38.665 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:21:38.665 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.16 2024-09-15T23:21:38.665 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:21:38.665 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:21:38.665 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:21:38.665 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:21:38.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:21:38.723 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.723 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.723 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642807 s, 163 MB/s 2024-09-15T23:21:38.731 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.732 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.732 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716243 s, 146 MB/s 2024-09-15T23:21:38.740 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.740 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.740 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644247 s, 163 MB/s 2024-09-15T23:21:38.748 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.748 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.748 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062701 s, 167 MB/s 2024-09-15T23:21:38.756 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.756 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.756 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637113 s, 165 MB/s 2024-09-15T23:21:38.764 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.765 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.765 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704301 s, 149 MB/s 2024-09-15T23:21:38.773 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.773 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.774 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720077 s, 146 MB/s 2024-09-15T23:21:38.782 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.782 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.782 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716009 s, 146 MB/s 2024-09-15T23:21:38.791 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.791 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.791 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071159 s, 147 MB/s 2024-09-15T23:21:38.799 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.799 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.799 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653264 s, 161 MB/s 2024-09-15T23:21:38.807 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.807 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.807 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645109 s, 163 MB/s 2024-09-15T23:21:38.815 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.815 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.815 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006569 s, 160 MB/s 2024-09-15T23:21:38.823 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.823 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.823 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639221 s, 164 MB/s 2024-09-15T23:21:38.832 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.832 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.832 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654201 s, 160 MB/s 2024-09-15T23:21:38.839 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.839 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.839 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627499 s, 167 MB/s 2024-09-15T23:21:38.847 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.847 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.847 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650551 s, 161 MB/s 2024-09-15T23:21:38.855 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.855 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.855 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649311 s, 161 MB/s 2024-09-15T23:21:38.862 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.862 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.863 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573343 s, 183 MB/s 2024-09-15T23:21:38.871 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.871 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.871 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673165 s, 156 MB/s 2024-09-15T23:21:38.880 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.880 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.880 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719918 s, 146 MB/s 2024-09-15T23:21:38.889 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.889 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.889 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733376 s, 143 MB/s 2024-09-15T23:21:38.898 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.898 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.898 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753322 s, 139 MB/s 2024-09-15T23:21:38.906 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.906 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.907 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641748 s, 163 MB/s 2024-09-15T23:21:38.914 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.914 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.915 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649002 s, 162 MB/s 2024-09-15T23:21:38.923 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.923 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.923 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732154 s, 143 MB/s 2024-09-15T23:21:38.931 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.931 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.931 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580157 s, 181 MB/s 2024-09-15T23:21:38.939 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.940 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.940 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716519 s, 146 MB/s 2024-09-15T23:21:38.947 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.947 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.948 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623992 s, 168 MB/s 2024-09-15T23:21:38.954 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.955 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.955 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578275 s, 181 MB/s 2024-09-15T23:21:38.963 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.963 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.963 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637521 s, 164 MB/s 2024-09-15T23:21:38.972 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.972 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.972 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735355 s, 143 MB/s 2024-09-15T23:21:38.980 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:38.980 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:38.980 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631788 s, 166 MB/s 2024-09-15T23:21:38.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:21:38.986 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:21:38.986 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:21:38.986 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.17 2024-09-15T23:21:38.986 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:21:38.987 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:21:38.987 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:21:38.987 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:21:39.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:21:39.046 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.046 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.046 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717831 s, 146 MB/s 2024-09-15T23:21:39.055 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.055 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.055 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729951 s, 144 MB/s 2024-09-15T23:21:39.063 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.063 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.063 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636258 s, 165 MB/s 2024-09-15T23:21:39.072 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.073 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.073 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00828911 s, 127 MB/s 2024-09-15T23:21:39.080 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.080 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.081 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596072 s, 176 MB/s 2024-09-15T23:21:39.089 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.089 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.089 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667847 s, 157 MB/s 2024-09-15T23:21:39.097 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.097 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.097 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645478 s, 162 MB/s 2024-09-15T23:21:39.105 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.105 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.105 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652154 s, 161 MB/s 2024-09-15T23:21:39.113 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.113 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.113 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618768 s, 169 MB/s 2024-09-15T23:21:39.120 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.120 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.120 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587244 s, 179 MB/s 2024-09-15T23:21:39.127 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.128 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.128 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564158 s, 186 MB/s 2024-09-15T23:21:39.136 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.136 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.136 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642574 s, 163 MB/s 2024-09-15T23:21:39.143 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.144 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.144 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646125 s, 162 MB/s 2024-09-15T23:21:39.152 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.152 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.153 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715628 s, 147 MB/s 2024-09-15T23:21:39.160 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.160 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.160 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617371 s, 170 MB/s 2024-09-15T23:21:39.169 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.169 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.169 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668846 s, 157 MB/s 2024-09-15T23:21:39.177 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.177 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.177 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712543 s, 147 MB/s 2024-09-15T23:21:39.186 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.186 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.187 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727309 s, 144 MB/s 2024-09-15T23:21:39.195 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.195 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.195 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730156 s, 144 MB/s 2024-09-15T23:21:39.203 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.204 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.204 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665863 s, 157 MB/s 2024-09-15T23:21:39.211 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.211 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.211 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584318 s, 179 MB/s 2024-09-15T23:21:39.219 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.219 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.219 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609985 s, 172 MB/s 2024-09-15T23:21:39.227 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.227 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.227 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663285 s, 158 MB/s 2024-09-15T23:21:39.234 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.234 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.234 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057218 s, 183 MB/s 2024-09-15T23:21:39.243 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.243 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.244 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737582 s, 142 MB/s 2024-09-15T23:21:39.252 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.252 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.252 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661915 s, 158 MB/s 2024-09-15T23:21:39.261 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.261 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.261 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725914 s, 144 MB/s 2024-09-15T23:21:39.269 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.269 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.269 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640657 s, 164 MB/s 2024-09-15T23:21:39.278 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.278 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.278 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714382 s, 147 MB/s 2024-09-15T23:21:39.285 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.285 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.285 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00569786 s, 184 MB/s 2024-09-15T23:21:39.293 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.293 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.293 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642549 s, 163 MB/s 2024-09-15T23:21:39.301 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.301 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.301 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637288 s, 165 MB/s 2024-09-15T23:21:39.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:21:39.308 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:21:39.309 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:21:39.309 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.18 2024-09-15T23:21:39.309 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:21:39.309 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:21:39.309 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:21:39.309 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:21:39.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:21:39.367 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.367 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.367 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684712 s, 153 MB/s 2024-09-15T23:21:39.374 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.374 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.375 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582464 s, 180 MB/s 2024-09-15T23:21:39.384 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.384 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.384 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720224 s, 146 MB/s 2024-09-15T23:21:39.392 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.393 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.393 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726189 s, 144 MB/s 2024-09-15T23:21:39.401 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.402 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.402 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727172 s, 144 MB/s 2024-09-15T23:21:39.410 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.410 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.411 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729464 s, 144 MB/s 2024-09-15T23:21:39.419 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.419 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.420 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739126 s, 142 MB/s 2024-09-15T23:21:39.427 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.427 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.427 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585635 s, 179 MB/s 2024-09-15T23:21:39.435 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.435 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.435 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063129 s, 166 MB/s 2024-09-15T23:21:39.443 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.443 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.444 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717394 s, 146 MB/s 2024-09-15T23:21:39.451 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.451 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.451 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597604 s, 175 MB/s 2024-09-15T23:21:39.459 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.459 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.459 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662504 s, 158 MB/s 2024-09-15T23:21:39.467 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.467 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.468 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660288 s, 159 MB/s 2024-09-15T23:21:39.475 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.476 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.476 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651994 s, 161 MB/s 2024-09-15T23:21:39.484 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.484 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.484 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641286 s, 164 MB/s 2024-09-15T23:21:39.492 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.492 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.492 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631608 s, 166 MB/s 2024-09-15T23:21:39.501 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.501 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.501 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722212 s, 145 MB/s 2024-09-15T23:21:39.508 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.508 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.508 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00565529 s, 185 MB/s 2024-09-15T23:21:39.522 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.522 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.522 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126377 s, 83.0 MB/s 2024-09-15T23:21:39.531 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.531 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.531 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731947 s, 143 MB/s 2024-09-15T23:21:39.540 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.540 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.540 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725488 s, 145 MB/s 2024-09-15T23:21:39.549 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.549 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.549 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739636 s, 142 MB/s 2024-09-15T23:21:39.557 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.557 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.557 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637288 s, 165 MB/s 2024-09-15T23:21:39.564 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.564 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.564 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566626 s, 185 MB/s 2024-09-15T23:21:39.572 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.572 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.573 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666716 s, 157 MB/s 2024-09-15T23:21:39.580 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.581 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.581 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642857 s, 163 MB/s 2024-09-15T23:21:39.589 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.589 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.589 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644671 s, 163 MB/s 2024-09-15T23:21:39.597 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.597 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.598 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723096 s, 145 MB/s 2024-09-15T23:21:39.605 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.605 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.605 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579671 s, 181 MB/s 2024-09-15T23:21:39.613 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.614 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.614 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674907 s, 155 MB/s 2024-09-15T23:21:39.621 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.621 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.621 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618413 s, 170 MB/s 2024-09-15T23:21:39.629 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.629 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.629 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645438 s, 162 MB/s 2024-09-15T23:21:39.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:21:39.636 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:21:39.636 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:21:39.636 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.19 2024-09-15T23:21:39.636 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:21:39.636 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:21:39.636 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:21:39.636 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:21:39.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:21:39.695 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.695 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.695 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722768 s, 145 MB/s 2024-09-15T23:21:39.703 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.704 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.704 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069707 s, 150 MB/s 2024-09-15T23:21:39.712 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.712 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.712 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721066 s, 145 MB/s 2024-09-15T23:21:39.720 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.720 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.721 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656884 s, 160 MB/s 2024-09-15T23:21:39.728 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.728 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.728 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568954 s, 184 MB/s 2024-09-15T23:21:39.737 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.737 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.737 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725061 s, 145 MB/s 2024-09-15T23:21:39.745 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.745 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.745 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674617 s, 155 MB/s 2024-09-15T23:21:39.753 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.753 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.753 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060505 s, 173 MB/s 2024-09-15T23:21:39.761 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.761 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.761 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059955 s, 175 MB/s 2024-09-15T23:21:39.768 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.768 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.768 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584964 s, 179 MB/s 2024-09-15T23:21:39.775 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.776 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.776 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577721 s, 182 MB/s 2024-09-15T23:21:39.785 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.785 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.785 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734909 s, 143 MB/s 2024-09-15T23:21:39.794 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.794 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.794 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733666 s, 143 MB/s 2024-09-15T23:21:39.802 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.802 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.802 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693876 s, 151 MB/s 2024-09-15T23:21:39.810 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.810 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.810 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645333 s, 162 MB/s 2024-09-15T23:21:39.818 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.818 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.818 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637369 s, 165 MB/s 2024-09-15T23:21:39.827 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.827 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.827 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705784 s, 149 MB/s 2024-09-15T23:21:39.835 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.835 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.835 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066619 s, 157 MB/s 2024-09-15T23:21:39.843 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.843 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.843 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638327 s, 164 MB/s 2024-09-15T23:21:39.851 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.852 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.852 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671659 s, 156 MB/s 2024-09-15T23:21:39.861 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.861 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.861 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777884 s, 135 MB/s 2024-09-15T23:21:39.869 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.870 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.870 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712046 s, 147 MB/s 2024-09-15T23:21:39.877 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.878 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.878 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644657 s, 163 MB/s 2024-09-15T23:21:39.886 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.886 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.886 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646167 s, 162 MB/s 2024-09-15T23:21:39.894 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.894 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.894 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649061 s, 162 MB/s 2024-09-15T23:21:39.902 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.903 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.903 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714243 s, 147 MB/s 2024-09-15T23:21:39.910 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.911 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.911 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646979 s, 162 MB/s 2024-09-15T23:21:39.919 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.919 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.919 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698272 s, 150 MB/s 2024-09-15T23:21:39.927 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.927 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.927 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613648 s, 171 MB/s 2024-09-15T23:21:39.935 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.935 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.935 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652521 s, 161 MB/s 2024-09-15T23:21:39.944 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.944 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.944 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731546 s, 143 MB/s 2024-09-15T23:21:39.952 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:39.952 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:39.952 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642759 s, 163 MB/s 2024-09-15T23:21:39.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:21:39.958 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:21:39.958 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:21:39.959 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.20 2024-09-15T23:21:39.959 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:21:39.959 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:21:39.959 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:21:39.959 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:21:40.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:21:40.016 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.017 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.017 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593874 s, 177 MB/s 2024-09-15T23:21:40.024 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.024 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.024 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573836 s, 183 MB/s 2024-09-15T23:21:40.032 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.032 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.032 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645684 s, 162 MB/s 2024-09-15T23:21:40.040 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.040 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.040 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643265 s, 163 MB/s 2024-09-15T23:21:40.048 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.049 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.049 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645799 s, 162 MB/s 2024-09-15T23:21:40.056 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.056 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.056 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663507 s, 158 MB/s 2024-09-15T23:21:40.065 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.065 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.065 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734721 s, 143 MB/s 2024-09-15T23:21:40.073 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.073 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.073 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618276 s, 170 MB/s 2024-09-15T23:21:40.080 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.080 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.080 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570133 s, 184 MB/s 2024-09-15T23:21:40.089 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.089 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.089 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007131 s, 147 MB/s 2024-09-15T23:21:40.097 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.098 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.098 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665007 s, 158 MB/s 2024-09-15T23:21:40.105 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.105 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.105 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578131 s, 181 MB/s 2024-09-15T23:21:40.113 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.113 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.113 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670117 s, 156 MB/s 2024-09-15T23:21:40.122 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.122 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.122 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723107 s, 145 MB/s 2024-09-15T23:21:40.129 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.129 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.129 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574576 s, 182 MB/s 2024-09-15T23:21:40.137 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.137 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.137 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626785 s, 167 MB/s 2024-09-15T23:21:40.145 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.145 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.145 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573949 s, 183 MB/s 2024-09-15T23:21:40.153 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.153 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.153 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641194 s, 164 MB/s 2024-09-15T23:21:40.162 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.162 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.162 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713618 s, 147 MB/s 2024-09-15T23:21:40.171 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.171 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.171 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072557 s, 145 MB/s 2024-09-15T23:21:40.179 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.179 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.179 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635564 s, 165 MB/s 2024-09-15T23:21:40.186 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.187 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.187 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630658 s, 166 MB/s 2024-09-15T23:21:40.194 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.195 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.195 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624321 s, 168 MB/s 2024-09-15T23:21:40.203 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.203 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.203 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717701 s, 146 MB/s 2024-09-15T23:21:40.211 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.211 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.211 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585669 s, 179 MB/s 2024-09-15T23:21:40.219 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.220 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.220 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706433 s, 148 MB/s 2024-09-15T23:21:40.229 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.229 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.229 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725635 s, 145 MB/s 2024-09-15T23:21:40.236 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:21:40.237 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.237 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.237 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656674 s, 160 MB/s 2024-09-15T23:21:40.239 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:21:40.246 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.246 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.246 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731649 s, 143 MB/s 2024-09-15T23:21:40.255 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.255 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.256 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074054 s, 142 MB/s 2024-09-15T23:21:40.263 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.263 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.264 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610941 s, 172 MB/s 2024-09-15T23:21:40.272 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.273 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.273 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709998 s, 148 MB/s 2024-09-15T23:21:40.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:21:40.279 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:21:40.279 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:21:40.279 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.21 2024-09-15T23:21:40.279 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:21:40.279 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:21:40.279 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:21:40.280 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:21:40.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:21:40.401 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.402 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.402 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633041 s, 166 MB/s 2024-09-15T23:21:40.410 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.410 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.410 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636381 s, 165 MB/s 2024-09-15T23:21:40.419 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.419 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.420 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075365 s, 139 MB/s 2024-09-15T23:21:40.428 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.428 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.428 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595634 s, 176 MB/s 2024-09-15T23:21:40.436 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.436 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.437 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703435 s, 149 MB/s 2024-09-15T23:21:40.444 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.445 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.445 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672624 s, 156 MB/s 2024-09-15T23:21:40.453 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.453 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.453 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657502 s, 159 MB/s 2024-09-15T23:21:40.461 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.461 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.461 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662631 s, 158 MB/s 2024-09-15T23:21:40.469 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.469 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.469 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00558245 s, 188 MB/s 2024-09-15T23:21:40.478 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.478 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.479 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761443 s, 138 MB/s 2024-09-15T23:21:40.486 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.487 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.487 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642576 s, 163 MB/s 2024-09-15T23:21:40.495 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.495 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.495 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657737 s, 159 MB/s 2024-09-15T23:21:40.503 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.503 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.503 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618097 s, 170 MB/s 2024-09-15T23:21:40.511 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.511 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.511 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648084 s, 162 MB/s 2024-09-15T23:21:40.520 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.520 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.521 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00790722 s, 133 MB/s 2024-09-15T23:21:40.530 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.530 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.530 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758171 s, 138 MB/s 2024-09-15T23:21:40.538 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.538 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.538 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667573 s, 157 MB/s 2024-09-15T23:21:40.547 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.547 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.547 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729161 s, 144 MB/s 2024-09-15T23:21:40.555 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.556 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.556 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686255 s, 153 MB/s 2024-09-15T23:21:40.564 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.565 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.565 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756598 s, 139 MB/s 2024-09-15T23:21:40.572 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.573 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.573 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633701 s, 165 MB/s 2024-09-15T23:21:40.581 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.581 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.581 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726141 s, 144 MB/s 2024-09-15T23:21:40.590 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.590 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.590 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665152 s, 158 MB/s 2024-09-15T23:21:40.597 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.597 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.597 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00560548 s, 187 MB/s 2024-09-15T23:21:40.606 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.606 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.606 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752622 s, 139 MB/s 2024-09-15T23:21:40.613 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.613 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.613 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581275 s, 180 MB/s 2024-09-15T23:21:40.621 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.621 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.621 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598577 s, 175 MB/s 2024-09-15T23:21:40.630 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.630 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.630 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727179 s, 144 MB/s 2024-09-15T23:21:40.638 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.638 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.638 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662909 s, 158 MB/s 2024-09-15T23:21:40.646 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.646 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.646 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625014 s, 168 MB/s 2024-09-15T23:21:40.654 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.654 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.654 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658054 s, 159 MB/s 2024-09-15T23:21:40.663 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.663 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.663 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748887 s, 140 MB/s 2024-09-15T23:21:40.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:21:40.670 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:21:40.670 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:21:40.670 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.22 2024-09-15T23:21:40.670 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:21:40.670 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:21:40.670 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:21:40.670 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:21:40.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:21:40.731 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.731 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.731 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00922555 s, 114 MB/s 2024-09-15T23:21:40.740 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.740 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.740 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070881 s, 148 MB/s 2024-09-15T23:21:40.747 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.747 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.748 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623397 s, 168 MB/s 2024-09-15T23:21:40.756 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.756 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.756 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710484 s, 148 MB/s 2024-09-15T23:21:40.764 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.764 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.764 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620928 s, 169 MB/s 2024-09-15T23:21:40.774 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.774 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.774 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0084007 s, 125 MB/s 2024-09-15T23:21:40.783 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.783 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.783 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007289 s, 144 MB/s 2024-09-15T23:21:40.792 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.793 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.793 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758065 s, 138 MB/s 2024-09-15T23:21:40.800 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.800 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.800 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571931 s, 183 MB/s 2024-09-15T23:21:40.808 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.808 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.808 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662965 s, 158 MB/s 2024-09-15T23:21:40.816 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.817 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.817 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067861 s, 155 MB/s 2024-09-15T23:21:40.826 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.826 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.826 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00796861 s, 132 MB/s 2024-09-15T23:21:40.834 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.834 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.834 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658365 s, 159 MB/s 2024-09-15T23:21:40.843 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.843 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.843 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706119 s, 148 MB/s 2024-09-15T23:21:40.851 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.851 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.851 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633453 s, 166 MB/s 2024-09-15T23:21:40.858 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.858 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.858 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599924 s, 175 MB/s 2024-09-15T23:21:40.867 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.867 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.867 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744346 s, 141 MB/s 2024-09-15T23:21:40.875 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.876 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.876 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634401 s, 165 MB/s 2024-09-15T23:21:40.884 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.884 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.884 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651763 s, 161 MB/s 2024-09-15T23:21:40.891 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.892 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.892 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063197 s, 166 MB/s 2024-09-15T23:21:40.900 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.900 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.900 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669272 s, 157 MB/s 2024-09-15T23:21:40.907 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.907 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.907 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578025 s, 181 MB/s 2024-09-15T23:21:40.915 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.915 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.915 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571043 s, 184 MB/s 2024-09-15T23:21:40.924 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.924 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.924 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744047 s, 141 MB/s 2024-09-15T23:21:40.933 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.933 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.933 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703234 s, 149 MB/s 2024-09-15T23:21:40.940 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.940 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.940 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585923 s, 179 MB/s 2024-09-15T23:21:40.950 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.950 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.950 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00813058 s, 129 MB/s 2024-09-15T23:21:40.958 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.958 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.958 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624611 s, 168 MB/s 2024-09-15T23:21:40.966 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.966 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.966 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626919 s, 167 MB/s 2024-09-15T23:21:40.974 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.974 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.974 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644867 s, 163 MB/s 2024-09-15T23:21:40.982 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.982 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.983 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682681 s, 154 MB/s 2024-09-15T23:21:40.990 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:40.990 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:40.990 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634788 s, 165 MB/s 2024-09-15T23:21:40.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:21:40.997 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:21:40.997 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:21:40.997 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.23 2024-09-15T23:21:40.997 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:21:40.997 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:21:40.997 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:21:40.997 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:21:41.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:21:41.056 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.056 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.056 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669442 s, 157 MB/s 2024-09-15T23:21:41.065 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.065 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.065 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750014 s, 140 MB/s 2024-09-15T23:21:41.072 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.072 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.072 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057901 s, 181 MB/s 2024-09-15T23:21:41.080 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.080 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.080 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654529 s, 160 MB/s 2024-09-15T23:21:41.088 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.088 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.089 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660978 s, 159 MB/s 2024-09-15T23:21:41.096 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.096 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.096 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059259 s, 177 MB/s 2024-09-15T23:21:41.104 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.105 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.105 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633745 s, 165 MB/s 2024-09-15T23:21:41.112 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.112 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.112 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653683 s, 160 MB/s 2024-09-15T23:21:41.120 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.120 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.120 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632704 s, 166 MB/s 2024-09-15T23:21:41.129 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.129 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.129 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730671 s, 144 MB/s 2024-09-15T23:21:41.137 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.137 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.137 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581398 s, 180 MB/s 2024-09-15T23:21:41.145 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.145 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.145 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638979 s, 164 MB/s 2024-09-15T23:21:41.154 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.154 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.154 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731827 s, 143 MB/s 2024-09-15T23:21:41.161 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.161 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.161 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592014 s, 177 MB/s 2024-09-15T23:21:41.170 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.171 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.171 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717527 s, 146 MB/s 2024-09-15T23:21:41.179 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.179 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.179 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738792 s, 142 MB/s 2024-09-15T23:21:41.188 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.188 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.188 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729527 s, 144 MB/s 2024-09-15T23:21:41.196 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.196 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.196 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634379 s, 165 MB/s 2024-09-15T23:21:41.204 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.205 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.205 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645117 s, 163 MB/s 2024-09-15T23:21:41.212 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.212 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.212 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579794 s, 181 MB/s 2024-09-15T23:21:41.220 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.221 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.221 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702861 s, 149 MB/s 2024-09-15T23:21:41.228 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.229 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.229 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648685 s, 162 MB/s 2024-09-15T23:21:41.237 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.237 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.237 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644504 s, 163 MB/s 2024-09-15T23:21:41.244 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.244 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.244 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573581 s, 183 MB/s 2024-09-15T23:21:41.253 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.253 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.253 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742822 s, 141 MB/s 2024-09-15T23:21:41.262 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.262 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.262 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702537 s, 149 MB/s 2024-09-15T23:21:41.270 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.270 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.270 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645314 s, 162 MB/s 2024-09-15T23:21:41.278 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.278 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.278 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646127 s, 162 MB/s 2024-09-15T23:21:41.285 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.285 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.285 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570668 s, 184 MB/s 2024-09-15T23:21:41.294 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.294 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.294 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649955 s, 161 MB/s 2024-09-15T23:21:41.301 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.301 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.301 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620951 s, 169 MB/s 2024-09-15T23:21:41.310 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.310 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.310 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731612 s, 143 MB/s 2024-09-15T23:21:41.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:21:41.317 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:21:41.317 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:21:41.317 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.24 2024-09-15T23:21:41.317 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:21:41.317 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:21:41.317 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:21:41.317 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:21:41.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:21:41.376 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.376 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.376 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712081 s, 147 MB/s 2024-09-15T23:21:41.384 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.384 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.384 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672978 s, 156 MB/s 2024-09-15T23:21:41.392 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.392 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.393 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684673 s, 153 MB/s 2024-09-15T23:21:41.400 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.400 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.401 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635427 s, 165 MB/s 2024-09-15T23:21:41.408 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.408 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.408 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628731 s, 167 MB/s 2024-09-15T23:21:41.416 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.417 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.417 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634698 s, 165 MB/s 2024-09-15T23:21:41.424 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.424 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.424 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00580074 s, 181 MB/s 2024-09-15T23:21:41.432 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.432 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.432 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647996 s, 162 MB/s 2024-09-15T23:21:41.441 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.441 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.441 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761606 s, 138 MB/s 2024-09-15T23:21:41.450 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.450 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.450 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715898 s, 146 MB/s 2024-09-15T23:21:41.459 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.459 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.459 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720526 s, 146 MB/s 2024-09-15T23:21:41.467 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.467 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.468 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687604 s, 152 MB/s 2024-09-15T23:21:41.475 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.476 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.476 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634674 s, 165 MB/s 2024-09-15T23:21:41.484 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.484 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.484 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726012 s, 144 MB/s 2024-09-15T23:21:41.492 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.492 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.492 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627987 s, 167 MB/s 2024-09-15T23:21:41.500 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.500 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.500 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646511 s, 162 MB/s 2024-09-15T23:21:41.508 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.508 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.508 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630862 s, 166 MB/s 2024-09-15T23:21:41.516 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.516 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.516 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604494 s, 173 MB/s 2024-09-15T23:21:41.525 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.525 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.526 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726943 s, 144 MB/s 2024-09-15T23:21:41.534 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.534 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.534 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756122 s, 139 MB/s 2024-09-15T23:21:41.541 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.542 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.542 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584174 s, 179 MB/s 2024-09-15T23:21:41.549 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.550 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.550 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631621 s, 166 MB/s 2024-09-15T23:21:41.557 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.557 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.557 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564284 s, 186 MB/s 2024-09-15T23:21:41.566 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.566 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.566 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738345 s, 142 MB/s 2024-09-15T23:21:41.574 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.574 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.574 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647472 s, 162 MB/s 2024-09-15T23:21:41.583 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.583 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.583 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711326 s, 147 MB/s 2024-09-15T23:21:41.591 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.591 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.591 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666896 s, 157 MB/s 2024-09-15T23:21:41.600 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.600 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.600 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732303 s, 143 MB/s 2024-09-15T23:21:41.608 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.609 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.609 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719097 s, 146 MB/s 2024-09-15T23:21:41.617 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.617 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.617 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668601 s, 157 MB/s 2024-09-15T23:21:41.625 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.625 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.625 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660039 s, 159 MB/s 2024-09-15T23:21:41.634 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.634 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.634 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716866 s, 146 MB/s 2024-09-15T23:21:41.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:21:41.641 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:21:41.641 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:21:41.641 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.25 2024-09-15T23:21:41.641 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:21:41.641 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:21:41.641 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:21:41.641 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:21:41.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:21:41.700 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.700 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.700 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656057 s, 160 MB/s 2024-09-15T23:21:41.707 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.707 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.707 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582903 s, 180 MB/s 2024-09-15T23:21:41.715 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.715 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.715 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585792 s, 179 MB/s 2024-09-15T23:21:41.723 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.723 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.724 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691058 s, 152 MB/s 2024-09-15T23:21:41.732 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.732 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.732 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668588 s, 157 MB/s 2024-09-15T23:21:41.740 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.740 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.741 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728261 s, 144 MB/s 2024-09-15T23:21:41.748 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.748 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.749 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638601 s, 164 MB/s 2024-09-15T23:21:41.756 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.756 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.756 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588038 s, 178 MB/s 2024-09-15T23:21:41.764 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.764 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.764 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631928 s, 166 MB/s 2024-09-15T23:21:41.773 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.773 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.773 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750989 s, 140 MB/s 2024-09-15T23:21:41.781 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.782 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.782 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065685 s, 160 MB/s 2024-09-15T23:21:41.790 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.790 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.790 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724506 s, 145 MB/s 2024-09-15T23:21:41.798 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.799 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.799 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644116 s, 163 MB/s 2024-09-15T23:21:41.807 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.807 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.807 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658869 s, 159 MB/s 2024-09-15T23:21:41.815 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.815 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.815 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644185 s, 163 MB/s 2024-09-15T23:21:41.823 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.823 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.824 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727546 s, 144 MB/s 2024-09-15T23:21:41.831 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.831 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.832 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630748 s, 166 MB/s 2024-09-15T23:21:41.841 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.841 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.841 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712773 s, 147 MB/s 2024-09-15T23:21:41.849 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.849 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.849 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700361 s, 150 MB/s 2024-09-15T23:21:41.857 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.858 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.858 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704599 s, 149 MB/s 2024-09-15T23:21:41.866 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.866 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.866 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737482 s, 142 MB/s 2024-09-15T23:21:41.874 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.874 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.874 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652848 s, 161 MB/s 2024-09-15T23:21:41.883 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.883 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.883 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725276 s, 145 MB/s 2024-09-15T23:21:41.891 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.891 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.891 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637838 s, 164 MB/s 2024-09-15T23:21:41.900 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.900 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.900 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737194 s, 142 MB/s 2024-09-15T23:21:41.909 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.909 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.909 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712932 s, 147 MB/s 2024-09-15T23:21:41.918 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.918 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.918 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074502 s, 141 MB/s 2024-09-15T23:21:41.927 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.927 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.927 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730355 s, 144 MB/s 2024-09-15T23:21:41.935 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.935 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.935 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694575 s, 151 MB/s 2024-09-15T23:21:41.943 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.943 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.944 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649889 s, 161 MB/s 2024-09-15T23:21:41.952 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.952 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.952 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701663 s, 149 MB/s 2024-09-15T23:21:41.961 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:41.961 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:41.961 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711119 s, 147 MB/s 2024-09-15T23:21:41.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:21:41.967 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:21:41.967 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:21:41.967 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.26 2024-09-15T23:21:41.967 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:21:41.968 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:21:41.968 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:21:41.968 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:21:42.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:21:42.025 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.025 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.025 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0056996 s, 184 MB/s 2024-09-15T23:21:42.032 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.033 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.033 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602137 s, 174 MB/s 2024-09-15T23:21:42.040 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.041 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.041 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649988 s, 161 MB/s 2024-09-15T23:21:42.048 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.048 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.048 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631972 s, 166 MB/s 2024-09-15T23:21:42.057 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.057 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.057 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700404 s, 150 MB/s 2024-09-15T23:21:42.065 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.065 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.065 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667297 s, 157 MB/s 2024-09-15T23:21:42.073 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.073 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.073 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634248 s, 165 MB/s 2024-09-15T23:21:42.082 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.082 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.082 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725686 s, 144 MB/s 2024-09-15T23:21:42.090 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.090 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.090 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645688 s, 162 MB/s 2024-09-15T23:21:42.099 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.099 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.099 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752484 s, 139 MB/s 2024-09-15T23:21:42.109 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.109 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.109 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00795461 s, 132 MB/s 2024-09-15T23:21:42.117 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.117 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.117 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642717 s, 163 MB/s 2024-09-15T23:21:42.126 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.126 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.126 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727436 s, 144 MB/s 2024-09-15T23:21:42.134 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.134 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.134 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643549 s, 163 MB/s 2024-09-15T23:21:42.143 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.143 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.143 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718177 s, 146 MB/s 2024-09-15T23:21:42.151 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.152 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.152 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718071 s, 146 MB/s 2024-09-15T23:21:42.160 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.160 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.160 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660248 s, 159 MB/s 2024-09-15T23:21:42.167 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.167 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.168 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059363 s, 177 MB/s 2024-09-15T23:21:42.176 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.176 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.176 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728147 s, 144 MB/s 2024-09-15T23:21:42.185 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.185 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.185 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732415 s, 143 MB/s 2024-09-15T23:21:42.194 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.194 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.194 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724785 s, 145 MB/s 2024-09-15T23:21:42.203 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.203 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.203 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709259 s, 148 MB/s 2024-09-15T23:21:42.211 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.264 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.265 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641093 s, 164 MB/s 2024-09-15T23:21:42.266 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.266 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.266 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583704 s, 180 MB/s 2024-09-15T23:21:42.266 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.266 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.266 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690708 s, 152 MB/s 2024-09-15T23:21:42.266 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.266 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.266 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655406 s, 160 MB/s 2024-09-15T23:21:42.266 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.266 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.267 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723048 s, 145 MB/s 2024-09-15T23:21:42.267 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.267 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.267 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712615 s, 147 MB/s 2024-09-15T23:21:42.267 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.267 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.267 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672134 s, 156 MB/s 2024-09-15T23:21:42.269 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.269 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.269 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654962 s, 160 MB/s 2024-09-15T23:21:42.277 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.277 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.277 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652823 s, 161 MB/s 2024-09-15T23:21:42.284 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.285 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.285 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574436 s, 183 MB/s 2024-09-15T23:21:42.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:21:42.291 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:21:42.291 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:21:42.291 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.27 2024-09-15T23:21:42.292 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:21:42.292 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:21:42.292 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:21:42.292 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:21:42.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:21:42.350 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.350 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.350 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065119 s, 161 MB/s 2024-09-15T23:21:42.358 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.358 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.358 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641508 s, 163 MB/s 2024-09-15T23:21:42.366 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.366 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.367 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682155 s, 154 MB/s 2024-09-15T23:21:42.374 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.374 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.374 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590419 s, 178 MB/s 2024-09-15T23:21:42.383 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.383 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.383 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749625 s, 140 MB/s 2024-09-15T23:21:42.390 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.390 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.391 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576457 s, 182 MB/s 2024-09-15T23:21:42.399 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.399 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.400 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736223 s, 142 MB/s 2024-09-15T23:21:42.407 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.408 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.408 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646792 s, 162 MB/s 2024-09-15T23:21:42.415 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.415 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.416 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00619723 s, 169 MB/s 2024-09-15T23:21:42.424 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.424 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.425 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745567 s, 141 MB/s 2024-09-15T23:21:42.432 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.432 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.432 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.005809 s, 181 MB/s 2024-09-15T23:21:42.441 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.441 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.441 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073381 s, 143 MB/s 2024-09-15T23:21:42.450 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.450 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.450 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726331 s, 144 MB/s 2024-09-15T23:21:42.458 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.458 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.458 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645746 s, 162 MB/s 2024-09-15T23:21:42.465 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.465 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.465 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563829 s, 186 MB/s 2024-09-15T23:21:42.473 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.473 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.473 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643624 s, 163 MB/s 2024-09-15T23:21:42.481 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.481 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.481 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606777 s, 173 MB/s 2024-09-15T23:21:42.489 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.490 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.490 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702258 s, 149 MB/s 2024-09-15T23:21:42.497 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.497 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.498 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628705 s, 167 MB/s 2024-09-15T23:21:42.506 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.506 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.506 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723355 s, 145 MB/s 2024-09-15T23:21:42.514 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.514 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.514 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643583 s, 163 MB/s 2024-09-15T23:21:42.522 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.522 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.522 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659926 s, 159 MB/s 2024-09-15T23:21:42.531 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.531 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.531 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066935 s, 157 MB/s 2024-09-15T23:21:42.539 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.539 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.539 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672822 s, 156 MB/s 2024-09-15T23:21:42.547 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.547 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.547 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679604 s, 154 MB/s 2024-09-15T23:21:42.556 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.556 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.556 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740045 s, 142 MB/s 2024-09-15T23:21:42.563 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.564 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.564 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564814 s, 186 MB/s 2024-09-15T23:21:42.571 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.571 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.571 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582084 s, 180 MB/s 2024-09-15T23:21:42.580 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.580 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.580 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666394 s, 157 MB/s 2024-09-15T23:21:42.588 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.588 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.589 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715435 s, 147 MB/s 2024-09-15T23:21:42.596 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.596 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.596 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00562786 s, 186 MB/s 2024-09-15T23:21:42.605 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.605 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.605 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765286 s, 137 MB/s 2024-09-15T23:21:42.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:21:42.612 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:21:42.612 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:21:42.612 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.28 2024-09-15T23:21:42.612 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:21:42.612 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:21:42.612 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:21:42.612 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:21:42.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:21:42.670 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.671 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.671 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642734 s, 163 MB/s 2024-09-15T23:21:42.678 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.678 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.678 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623711 s, 168 MB/s 2024-09-15T23:21:42.686 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.686 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.686 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651705 s, 161 MB/s 2024-09-15T23:21:42.694 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.694 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.694 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637203 s, 165 MB/s 2024-09-15T23:21:42.702 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.702 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.703 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0069358 s, 151 MB/s 2024-09-15T23:21:42.709 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.710 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.710 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00552186 s, 190 MB/s 2024-09-15T23:21:42.717 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.717 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.717 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563456 s, 186 MB/s 2024-09-15T23:21:42.726 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.726 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.726 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710163 s, 148 MB/s 2024-09-15T23:21:42.733 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.733 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.733 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059221 s, 177 MB/s 2024-09-15T23:21:42.740 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.741 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.741 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00553578 s, 189 MB/s 2024-09-15T23:21:42.749 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.750 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.750 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715344 s, 147 MB/s 2024-09-15T23:21:42.757 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.757 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.757 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594015 s, 177 MB/s 2024-09-15T23:21:42.766 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.766 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.766 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707276 s, 148 MB/s 2024-09-15T23:21:42.775 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.775 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.775 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071936 s, 146 MB/s 2024-09-15T23:21:42.783 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.783 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.783 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650393 s, 161 MB/s 2024-09-15T23:21:42.791 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.792 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.792 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724266 s, 145 MB/s 2024-09-15T23:21:42.799 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.799 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.799 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601788 s, 174 MB/s 2024-09-15T23:21:42.807 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.808 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.808 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067426 s, 156 MB/s 2024-09-15T23:21:42.815 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.815 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.815 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638976 s, 164 MB/s 2024-09-15T23:21:42.825 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.825 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.825 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00774688 s, 135 MB/s 2024-09-15T23:21:42.833 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.833 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.833 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655256 s, 160 MB/s 2024-09-15T23:21:42.842 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.842 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.842 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00775787 s, 135 MB/s 2024-09-15T23:21:42.851 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.851 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.851 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721031 s, 145 MB/s 2024-09-15T23:21:42.859 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.859 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.859 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647957 s, 162 MB/s 2024-09-15T23:21:42.867 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.867 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.867 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057897 s, 181 MB/s 2024-09-15T23:21:42.875 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.875 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.875 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669582 s, 157 MB/s 2024-09-15T23:21:42.883 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.883 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.883 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621752 s, 169 MB/s 2024-09-15T23:21:42.891 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.892 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.892 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717424 s, 146 MB/s 2024-09-15T23:21:42.900 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.900 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.900 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666375 s, 157 MB/s 2024-09-15T23:21:42.908 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.908 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.908 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648994 s, 162 MB/s 2024-09-15T23:21:42.916 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.916 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.917 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714804 s, 147 MB/s 2024-09-15T23:21:42.924 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.924 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.924 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00601645 s, 174 MB/s 2024-09-15T23:21:42.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:21:42.931 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:21:42.931 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:21:42.931 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.29 2024-09-15T23:21:42.931 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:21:42.931 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:21:42.931 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:21:42.931 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:21:42.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:21:42.990 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.990 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.990 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765169 s, 137 MB/s 2024-09-15T23:21:42.998 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:42.999 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:42.999 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652755 s, 161 MB/s 2024-09-15T23:21:43.007 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.008 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.008 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731038 s, 143 MB/s 2024-09-15T23:21:43.015 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.016 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.016 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637959 s, 164 MB/s 2024-09-15T23:21:43.023 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.023 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.023 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622685 s, 168 MB/s 2024-09-15T23:21:43.031 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.031 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.031 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630814 s, 166 MB/s 2024-09-15T23:21:43.038 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.038 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.039 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00550956 s, 190 MB/s 2024-09-15T23:21:43.046 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.047 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.047 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643022 s, 163 MB/s 2024-09-15T23:21:43.054 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.054 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.054 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630304 s, 166 MB/s 2024-09-15T23:21:43.061 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.062 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.062 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588638 s, 178 MB/s 2024-09-15T23:21:43.071 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.071 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.071 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00782238 s, 134 MB/s 2024-09-15T23:21:43.078 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.079 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.079 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573793 s, 183 MB/s 2024-09-15T23:21:43.087 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.087 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.087 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640004 s, 164 MB/s 2024-09-15T23:21:43.095 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.095 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.095 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657432 s, 159 MB/s 2024-09-15T23:21:43.103 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.103 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.103 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653548 s, 160 MB/s 2024-09-15T23:21:43.112 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.112 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.112 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00793145 s, 132 MB/s 2024-09-15T23:21:43.122 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.122 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.122 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00826462 s, 127 MB/s 2024-09-15T23:21:43.130 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.130 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.130 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658284 s, 159 MB/s 2024-09-15T23:21:43.138 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.138 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.138 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651726 s, 161 MB/s 2024-09-15T23:21:43.147 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.147 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.147 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721608 s, 145 MB/s 2024-09-15T23:21:43.156 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.156 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.156 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00683645 s, 153 MB/s 2024-09-15T23:21:43.163 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.163 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.163 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573109 s, 183 MB/s 2024-09-15T23:21:43.171 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.171 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.171 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651599 s, 161 MB/s 2024-09-15T23:21:43.180 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.180 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.180 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071551 s, 147 MB/s 2024-09-15T23:21:43.189 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.189 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.189 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713352 s, 147 MB/s 2024-09-15T23:21:43.197 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.198 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.198 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730512 s, 144 MB/s 2024-09-15T23:21:43.206 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.206 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.206 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694775 s, 151 MB/s 2024-09-15T23:21:43.214 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.214 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.214 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646847 s, 162 MB/s 2024-09-15T23:21:43.222 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.222 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.222 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065012 s, 161 MB/s 2024-09-15T23:21:43.230 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.230 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.231 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651847 s, 161 MB/s 2024-09-15T23:21:43.240 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.240 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.240 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695801 s, 151 MB/s 2024-09-15T23:21:43.248 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.248 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.248 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742682 s, 141 MB/s 2024-09-15T23:21:43.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:21:43.254 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:21:43.255 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:21:43.255 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.30 2024-09-15T23:21:43.255 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:21:43.255 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:21:43.255 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:21:43.255 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:21:43.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:21:43.313 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.313 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.313 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650931 s, 161 MB/s 2024-09-15T23:21:43.322 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.322 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.322 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767632 s, 137 MB/s 2024-09-15T23:21:43.331 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.331 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.331 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00755897 s, 139 MB/s 2024-09-15T23:21:43.340 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.340 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.340 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714869 s, 147 MB/s 2024-09-15T23:21:43.348 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.348 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.348 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653273 s, 161 MB/s 2024-09-15T23:21:43.356 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.356 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.356 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635884 s, 165 MB/s 2024-09-15T23:21:43.364 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.364 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.364 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662837 s, 158 MB/s 2024-09-15T23:21:43.373 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.373 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.373 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661668 s, 158 MB/s 2024-09-15T23:21:43.381 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.381 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.381 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717374 s, 146 MB/s 2024-09-15T23:21:43.390 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.390 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.390 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737433 s, 142 MB/s 2024-09-15T23:21:43.399 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.399 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.399 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732391 s, 143 MB/s 2024-09-15T23:21:43.407 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.407 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.408 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065028 s, 161 MB/s 2024-09-15T23:21:43.415 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.415 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.415 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593471 s, 177 MB/s 2024-09-15T23:21:43.423 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.423 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.423 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638968 s, 164 MB/s 2024-09-15T23:21:43.430 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.430 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.430 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577131 s, 182 MB/s 2024-09-15T23:21:43.439 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.439 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.439 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741515 s, 141 MB/s 2024-09-15T23:21:43.448 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.448 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.448 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713506 s, 147 MB/s 2024-09-15T23:21:43.456 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.456 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.456 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586417 s, 179 MB/s 2024-09-15T23:21:43.463 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.463 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.464 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594848 s, 176 MB/s 2024-09-15T23:21:43.472 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.472 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.472 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695263 s, 151 MB/s 2024-09-15T23:21:43.479 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.479 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.480 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574461 s, 183 MB/s 2024-09-15T23:21:43.487 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.487 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.487 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593851 s, 177 MB/s 2024-09-15T23:21:43.495 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.495 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.495 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643154 s, 163 MB/s 2024-09-15T23:21:43.504 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.504 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.504 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067038 s, 156 MB/s 2024-09-15T23:21:43.512 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.512 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.512 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615395 s, 170 MB/s 2024-09-15T23:21:43.520 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.520 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.520 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646596 s, 162 MB/s 2024-09-15T23:21:43.529 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.529 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.529 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064649 s, 162 MB/s 2024-09-15T23:21:43.538 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.538 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.538 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00801279 s, 131 MB/s 2024-09-15T23:21:43.548 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.548 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.548 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00836258 s, 125 MB/s 2024-09-15T23:21:43.556 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.556 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.556 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658986 s, 159 MB/s 2024-09-15T23:21:43.564 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.564 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.564 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061201 s, 171 MB/s 2024-09-15T23:21:43.572 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.572 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.572 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629071 s, 167 MB/s 2024-09-15T23:21:43.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:21:43.579 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:21:43.579 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:21:43.579 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.31 2024-09-15T23:21:43.579 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:21:43.579 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:21:43.579 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:21:43.579 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:21:43.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:21:43.637 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.637 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.638 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638913 s, 164 MB/s 2024-09-15T23:21:43.645 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.645 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.645 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587327 s, 179 MB/s 2024-09-15T23:21:43.653 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.653 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.653 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00561327 s, 187 MB/s 2024-09-15T23:21:43.661 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.661 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.661 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587417 s, 179 MB/s 2024-09-15T23:21:43.670 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.670 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.671 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00790822 s, 133 MB/s 2024-09-15T23:21:43.679 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.679 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.680 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724307 s, 145 MB/s 2024-09-15T23:21:43.688 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.688 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.689 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728599 s, 144 MB/s 2024-09-15T23:21:43.696 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.697 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.697 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652958 s, 161 MB/s 2024-09-15T23:21:43.706 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.706 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.707 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735766 s, 143 MB/s 2024-09-15T23:21:43.713 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.714 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.714 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645991 s, 162 MB/s 2024-09-15T23:21:43.721 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.721 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.721 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572842 s, 183 MB/s 2024-09-15T23:21:43.730 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.730 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.730 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726576 s, 144 MB/s 2024-09-15T23:21:43.739 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.740 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.740 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742667 s, 141 MB/s 2024-09-15T23:21:43.748 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.748 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.748 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693078 s, 151 MB/s 2024-09-15T23:21:43.757 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.757 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.757 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748447 s, 140 MB/s 2024-09-15T23:21:43.765 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.765 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.765 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572832 s, 183 MB/s 2024-09-15T23:21:43.773 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.773 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.773 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649889 s, 161 MB/s 2024-09-15T23:21:43.782 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.782 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.782 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750135 s, 140 MB/s 2024-09-15T23:21:43.790 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.791 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.791 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670516 s, 156 MB/s 2024-09-15T23:21:43.798 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.798 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.798 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573347 s, 183 MB/s 2024-09-15T23:21:43.806 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.806 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.806 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639052 s, 164 MB/s 2024-09-15T23:21:43.813 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.813 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.814 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575381 s, 182 MB/s 2024-09-15T23:21:43.822 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.822 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.822 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693628 s, 151 MB/s 2024-09-15T23:21:43.831 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.831 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.831 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753772 s, 139 MB/s 2024-09-15T23:21:43.840 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.840 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.840 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685701 s, 153 MB/s 2024-09-15T23:21:43.847 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.847 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.848 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630635 s, 166 MB/s 2024-09-15T23:21:43.856 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.856 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.856 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632142 s, 166 MB/s 2024-09-15T23:21:43.862 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.863 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.863 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574543 s, 183 MB/s 2024-09-15T23:21:43.870 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.870 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.871 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633855 s, 165 MB/s 2024-09-15T23:21:43.879 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.879 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.880 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750056 s, 140 MB/s 2024-09-15T23:21:43.888 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.888 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.888 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657881 s, 159 MB/s 2024-09-15T23:21:43.896 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:21:43.897 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:21:43.897 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717779 s, 146 MB/s 2024-09-15T23:21:43.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:21:43.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:21:43.903 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.11:0 scrub start /scrub_control_test_path recursive 2024-09-15T23:21:44.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.005+0000 7f34965f6640 1 Processor -- start 2024-09-15T23:21:44.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.005+0000 7f34965f6640 1 -- start start 2024-09-15T23:21:44.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.006+0000 7f34965f6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3490155b20 0x7f34900b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.006+0000 7f34965f6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34900b21a0 0x7f34900cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.006+0000 7f34965f6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f34900cf960 0x7f349015ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.006+0000 7f34965f6640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f34900b2600 con 0x7f3490155b20 2024-09-15T23:21:44.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.006+0000 7f34965f6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f34900b01e0 con 0x7f34900cf960 2024-09-15T23:21:44.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.006+0000 7f34965f6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f34900b0680 con 0x7f34900b21a0 2024-09-15T23:21:44.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.006+0000 7f348ffff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3490155b20 0x7f34900b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.006+0000 7f348ffff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3490155b20 0x7f34900b1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52212/0 (socket says 172.21.15.123:52212) 2024-09-15T23:21:44.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.006+0000 7f348ffff640 1 -- 172.21.15.123:0/2369966716 learned_addr learned my addr 172.21.15.123:0/2369966716 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:44.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.006+0000 7f3494b93640 1 --2- 172.21.15.123:0/2369966716 >> v2:172.21.15.188:3300/0 conn(0x7f34900cf960 0x7f349015ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.006+0000 7f348f7fe640 1 --2- 172.21.15.123:0/2369966716 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34900b21a0 0x7f34900cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.006+0000 7f348ffff640 1 -- 172.21.15.123:0/2369966716 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34900b21a0 msgr2=0x7f34900cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:44.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.006+0000 7f348ffff640 1 --2- 172.21.15.123:0/2369966716 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34900b21a0 0x7f34900cf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.006+0000 7f348ffff640 1 -- 172.21.15.123:0/2369966716 >> v2:172.21.15.188:3300/0 conn(0x7f34900cf960 msgr2=0x7f349015ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:44.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.006+0000 7f348ffff640 1 --2- 172.21.15.123:0/2369966716 >> v2:172.21.15.188:3300/0 conn(0x7f34900cf960 0x7f349015ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.006+0000 7f348ffff640 1 -- 172.21.15.123:0/2369966716 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34900ccf70 con 0x7f3490155b20 2024-09-15T23:21:44.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.006+0000 7f3494b93640 1 --2- 172.21.15.123:0/2369966716 >> v2:172.21.15.188:3300/0 conn(0x7f34900cf960 0x7f349015ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:21:44.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.006+0000 7f348f7fe640 1 --2- 172.21.15.123:0/2369966716 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34900b21a0 0x7f34900cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:21:44.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.007+0000 7f348ffff640 1 --2- 172.21.15.123:0/2369966716 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3490155b20 0x7f34900b1c60 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f349015eeb0 tx=0x7f348002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec3fb904e657052 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:44.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.007+0000 7f348effd640 1 -- 172.21.15.123:0/2369966716 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3480037070 con 0x7f3490155b20 2024-09-15T23:21:44.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.007+0000 7f348effd640 1 -- 172.21.15.123:0/2369966716 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3480032440 con 0x7f3490155b20 2024-09-15T23:21:44.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.007+0000 7f348effd640 1 -- 172.21.15.123:0/2369966716 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3480032810 con 0x7f3490155b20 2024-09-15T23:21:44.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.008+0000 7f34965f6640 1 -- 172.21.15.123:0/2369966716 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3490155b20 msgr2=0x7f34900b1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.008+0000 7f34965f6640 1 --2- 172.21.15.123:0/2369966716 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3490155b20 0x7f34900b1c60 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f349015eeb0 tx=0x7f348002a210 comp rx=0 tx=0).stop 2024-09-15T23:21:44.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.008+0000 7f34965f6640 1 -- 172.21.15.123:0/2369966716 shutdown_connections 2024-09-15T23:21:44.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.008+0000 7f34965f6640 1 --2- 172.21.15.123:0/2369966716 >> v2:172.21.15.188:3300/0 conn(0x7f34900cf960 0x7f349015ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.008+0000 7f34965f6640 1 --2- 172.21.15.123:0/2369966716 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34900b21a0 0x7f34900cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.008+0000 7f34965f6640 1 --2- 172.21.15.123:0/2369966716 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3490155b20 0x7f34900b1c60 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.008+0000 7f34965f6640 1 -- 172.21.15.123:0/2369966716 >> 172.21.15.123:0/2369966716 conn(0x7f349006c240 msgr2=0x7f349006d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:44.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.008+0000 7f34965f6640 1 -- 172.21.15.123:0/2369966716 shutdown_connections 2024-09-15T23:21:44.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.008+0000 7f34965f6640 1 -- 172.21.15.123:0/2369966716 wait complete. 2024-09-15T23:21:44.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.009+0000 7f34965f6640 1 Processor -- start 2024-09-15T23:21:44.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.009+0000 7f34965f6640 1 -- start start 2024-09-15T23:21:44.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.010+0000 7f34965f6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34900b21a0 0x7f3490143e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.010+0000 7f34965f6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34900cf960 0x7f3490158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.010+0000 7f34965f6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3490155b20 0x7f34901595a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.010+0000 7f34965f6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f34900cef00 con 0x7f34900cf960 2024-09-15T23:21:44.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.010+0000 7f34965f6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f34900cec20 con 0x7f3490155b20 2024-09-15T23:21:44.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.010+0000 7f34965f6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f34900cfdb0 con 0x7f34900b21a0 2024-09-15T23:21:44.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.010+0000 7f348f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34900cf960 0x7f3490158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.010+0000 7f348f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34900cf960 0x7f3490158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52228/0 (socket says 172.21.15.123:52228) 2024-09-15T23:21:44.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.010+0000 7f348f7fe640 1 -- 172.21.15.123:0/108667972 learned_addr learned my addr 172.21.15.123:0/108667972 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:44.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.010+0000 7f348ffff640 1 --2- 172.21.15.123:0/108667972 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34900b21a0 0x7f3490143e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.010+0000 7f3494b93640 1 --2- 172.21.15.123:0/108667972 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3490155b20 0x7f34901595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.010+0000 7f348f7fe640 1 -- 172.21.15.123:0/108667972 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34900b21a0 msgr2=0x7f3490143e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.010+0000 7f348f7fe640 1 --2- 172.21.15.123:0/108667972 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34900b21a0 0x7f3490143e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.010+0000 7f348f7fe640 1 -- 172.21.15.123:0/108667972 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3490155b20 msgr2=0x7f34901595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.010+0000 7f348f7fe640 1 --2- 172.21.15.123:0/108667972 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3490155b20 0x7f34901595a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.010+0000 7f348f7fe640 1 -- 172.21.15.123:0/108667972 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3490158b90 con 0x7f34900cf960 2024-09-15T23:21:44.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.010+0000 7f348f7fe640 1 --2- 172.21.15.123:0/108667972 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34900cf960 0x7f3490158110 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f348400e810 tx=0x7f348400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:44.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.010+0000 7f348cff9640 1 -- 172.21.15.123:0/108667972 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348400f040 con 0x7f34900cf960 2024-09-15T23:21:44.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.010+0000 7f348cff9640 1 -- 172.21.15.123:0/108667972 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3484004030 con 0x7f34900cf960 2024-09-15T23:21:44.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.010+0000 7f348cff9640 1 -- 172.21.15.123:0/108667972 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3484004400 con 0x7f34900cf960 2024-09-15T23:21:44.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.010+0000 7f34965f6640 1 -- 172.21.15.123:0/108667972 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f349015bc00 con 0x7f34900cf960 2024-09-15T23:21:44.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.011+0000 7f34965f6640 1 -- 172.21.15.123:0/108667972 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f349015c1c0 con 0x7f34900cf960 2024-09-15T23:21:44.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.012+0000 7f348cff9640 1 -- 172.21.15.123:0/108667972 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f348400c670 con 0x7f34900cf960 2024-09-15T23:21:44.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.013+0000 7f348cff9640 1 --2- 172.21.15.123:0/108667972 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f347c06c2b0 0x7f347c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.013+0000 7f348cff9640 1 -- 172.21.15.123:0/108667972 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7f348408afe0 con 0x7f34900cf960 2024-09-15T23:21:44.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.013+0000 7f348ffff640 1 --2- 172.21.15.123:0/108667972 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f347c06c2b0 0x7f347c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.014+0000 7f348ffff640 1 --2- 172.21.15.123:0/108667972 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f347c06c2b0 0x7f347c06e770 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f3480034000 tx=0x7f348002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:44.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.014+0000 7f349946b740 1 Processor -- start 2024-09-15T23:21:44.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.014+0000 7f349946b740 1 -- start start 2024-09-15T23:21:44.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.014+0000 7f349946b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55989aedfa70 0x55989aedfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.014+0000 7f349946b740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55989aec61f0 0x55989aec4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.014+0000 7f349946b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55989af10420 0x55989af10970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.014+0000 7f349946b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55989ae2dbc0 con 0x55989aedfa70 2024-09-15T23:21:44.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.014+0000 7f349946b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55989add5970 con 0x55989af10420 2024-09-15T23:21:44.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.014+0000 7f349946b740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55989ae29b80 con 0x55989aec61f0 2024-09-15T23:21:44.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.015+0000 7f348ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55989aedfa70 0x55989aedfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.015+0000 7f348ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55989aedfa70 0x55989aedfe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52242/0 (socket says 172.21.15.123:52242) 2024-09-15T23:21:44.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.015+0000 7f348ffff640 1 -- 172.21.15.123:0/1242367695 learned_addr learned my addr 172.21.15.123:0/1242367695 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:44.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.015+0000 7f3494b93640 1 --2- 172.21.15.123:0/1242367695 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55989af10420 0x55989af10970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.015+0000 7f348f7fe640 1 --2- 172.21.15.123:0/1242367695 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55989aec61f0 0x55989aec4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.015+0000 7f348ffff640 1 -- 172.21.15.123:0/1242367695 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55989aec61f0 msgr2=0x55989aec4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:44.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.015+0000 7f348ffff640 1 --2- 172.21.15.123:0/1242367695 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55989aec61f0 0x55989aec4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.015+0000 7f348ffff640 1 -- 172.21.15.123:0/1242367695 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55989af10420 msgr2=0x55989af10970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:44.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.015+0000 7f348ffff640 1 --2- 172.21.15.123:0/1242367695 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55989af10420 0x55989af10970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.015+0000 7f348ffff640 1 -- 172.21.15.123:0/1242367695 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55989ac0cba0 con 0x55989aedfa70 2024-09-15T23:21:44.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.015+0000 7f348ffff640 1 --2- 172.21.15.123:0/1242367695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55989aedfa70 0x55989aedfe50 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f3480009990 tx=0x7f348002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92339daf2c9e8318 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:44.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.015+0000 7f34767fc640 1 -- 172.21.15.123:0/1242367695 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3480037040 con 0x55989aedfa70 2024-09-15T23:21:44.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.015+0000 7f34767fc640 1 -- 172.21.15.123:0/1242367695 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f348004e070 con 0x55989aedfa70 2024-09-15T23:21:44.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.015+0000 7f34767fc640 1 -- 172.21.15.123:0/1242367695 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3480032d40 con 0x55989aedfa70 2024-09-15T23:21:44.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.016+0000 7f349946b740 1 -- 172.21.15.123:0/1242367695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55989aedfa70 msgr2=0x55989aedfe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.016+0000 7f349946b740 1 --2- 172.21.15.123:0/1242367695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55989aedfa70 0x55989aedfe50 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f3480009990 tx=0x7f348002c000 comp rx=0 tx=0).stop 2024-09-15T23:21:44.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.016+0000 7f349946b740 1 -- 172.21.15.123:0/1242367695 shutdown_connections 2024-09-15T23:21:44.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.016+0000 7f349946b740 1 --2- 172.21.15.123:0/1242367695 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55989af10420 0x55989af10970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.016+0000 7f349946b740 1 --2- 172.21.15.123:0/1242367695 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55989aec61f0 0x55989aec4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.016+0000 7f349946b740 1 --2- 172.21.15.123:0/1242367695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55989aedfa70 0x55989aedfe50 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.016+0000 7f349946b740 1 -- 172.21.15.123:0/1242367695 >> 172.21.15.123:0/1242367695 conn(0x55989aec6c20 msgr2=0x55989af0efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:44.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.016+0000 7f349946b740 1 -- 172.21.15.123:0/1242367695 shutdown_connections 2024-09-15T23:21:44.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.016+0000 7f349946b740 1 -- 172.21.15.123:0/1242367695 wait complete. 2024-09-15T23:21:44.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.016+0000 7f349946b740 1 -- start start 2024-09-15T23:21:44.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.016+0000 7f349946b740 1 Processor -- start 2024-09-15T23:21:44.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.017+0000 7f349946b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55989aedfa70 0x55989af1ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.017+0000 7f349946b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55989af10420 0x55989aece4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.017+0000 7f349946b740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55989aee9eb0 0x55989aecea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.017+0000 7f349946b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55989aec5150 con 0x55989af10420 2024-09-15T23:21:44.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.017+0000 7f349946b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55989ade8d70 con 0x55989aedfa70 2024-09-15T23:21:44.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.017+0000 7f349946b740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55989aec5430 con 0x55989aee9eb0 2024-09-15T23:21:44.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.017+0000 7f349946b740 10 client.0 _ll_register_callbacks cb 0x55989ab3ff80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:21:44.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.017+0000 7f348f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55989af10420 0x55989aece4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.017+0000 7f348f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55989af10420 0x55989aece4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52254/0 (socket says 172.21.15.123:52254) 2024-09-15T23:21:44.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.017+0000 7f348ffff640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55989aedfa70 0x55989af1ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.017+0000 7f348f7fe640 1 -- 172.21.15.123:0/1952325822 learned_addr learned my addr 172.21.15.123:0/1952325822 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:44.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.017+0000 7f3494b93640 1 --2- 172.21.15.123:0/1952325822 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55989aee9eb0 0x55989aecea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.018+0000 7f348f7fe640 1 -- 172.21.15.123:0/1952325822 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55989aee9eb0 msgr2=0x55989aecea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:44.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.018+0000 7f348f7fe640 1 --2- 172.21.15.123:0/1952325822 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55989aee9eb0 0x55989aecea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.018+0000 7f348f7fe640 1 -- 172.21.15.123:0/1952325822 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55989aedfa70 msgr2=0x55989af1ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:44.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.018+0000 7f348f7fe640 1 --2- 172.21.15.123:0/1952325822 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55989aedfa70 0x55989af1ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.018+0000 7f348f7fe640 1 -- 172.21.15.123:0/1952325822 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55989ab00490 con 0x55989af10420 2024-09-15T23:21:44.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.018+0000 7f348ffff640 1 --2- 172.21.15.123:0/1952325822 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55989aedfa70 0x55989af1ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:21:44.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.018+0000 7f348f7fe640 1 --2- 172.21.15.123:0/1952325822 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55989af10420 0x55989aece4d0 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f3484058e00 tx=0x7f3484058d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be7b4367232242ff server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:44.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.018+0000 7f346effd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:21:44.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.018+0000 7f346effd640 1 -- 172.21.15.123:0/1952325822 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3484020040 con 0x55989af10420 2024-09-15T23:21:44.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.018+0000 7f346effd640 1 -- 172.21.15.123:0/1952325822 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7f3484058750 con 0x55989af10420 2024-09-15T23:21:44.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.018+0000 7f349946b740 1 -- 172.21.15.123:0/1952325822 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f348004e070 con 0x55989af10420 2024-09-15T23:21:44.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.018+0000 7f346effd640 1 -- 172.21.15.123:0/1952325822 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7f34840574c0 con 0x55989af10420 2024-09-15T23:21:44.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.018+0000 7f349946b740 10 client.9756 fetch_fsmap learned FSMap version 100 2024-09-15T23:21:44.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.018+0000 7f349946b740 1 -- 172.21.15.123:0/1952325822 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x55989ac6d330 con 0x55989af10420 2024-09-15T23:21:44.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.018+0000 7f346effd640 1 -- 172.21.15.123:0/1952325822 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f348004e070 con 0x55989af10420 2024-09-15T23:21:44.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.018+0000 7f346effd640 1 -- 172.21.15.123:0/1952325822 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 100) ==== 3502+0+0 (secure 0 0 0) 0x7f3484012050 con 0x55989af10420 2024-09-15T23:21:44.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.018+0000 7f349946b740 10 client.9756 fetch_fsmap finished waiting for FSMap version 100 2024-09-15T23:21:44.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.018+0000 7f349946b740 10 client.9756 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.a 2024-09-15T23:21:44.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.018+0000 7f349946b740 20 client.9756 populate_metadata read hostname 'smithi123' 2024-09-15T23:21:44.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.018+0000 7f349946b740 1 --2- 172.21.15.123:0/1952325822 >> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] conn(0x55989af22f20 0x55989af23390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.018+0000 7f349946b740 4 client.9756 mds_command: new command op to 9564 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:21:44.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.018+0000 7f349946b740 1 -- 172.21.15.123:0/1952325822 --> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55989adb2c80 con 0x55989af22f20 2024-09-15T23:21:44.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.018+0000 7f348ffff640 1 --2- 172.21.15.123:0/1952325822 >> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] conn(0x55989af22f20 0x55989af23390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.019+0000 7f346effd640 10 client.9756 ms_handle_connect on v2:172.21.15.123:6834/1883512279 2024-09-15T23:21:44.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.019+0000 7f348ffff640 1 --2- 172.21.15.123:0/1952325822 >> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] conn(0x55989af22f20 0x55989af23390 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cf53427b895f4f server_cookie=bdc1c4ff01d43e8b in_seq=0 out_seq=0 2024-09-15T23:21:44.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.019+0000 7f346effd640 1 -- 172.21.15.123:0/1952325822 <== mds.0 v2:172.21.15.123:6834/1883512279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55989adb2c80 con 0x55989af22f20 2024-09-15T23:21:44.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.019+0000 7f346effd640 10 client.9756 handle_command_reply: tid=0 2024-09-15T23:21:44.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.019+0000 7f349946b740 1 client.9756 shutdown 2024-09-15T23:21:44.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.019+0000 7f349946b740 1 -- 172.21.15.123:0/1952325822 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55989af10420 msgr2=0x55989aece4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.019+0000 7f349946b740 1 --2- 172.21.15.123:0/1952325822 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55989af10420 0x55989aece4d0 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f3484058e00 tx=0x7f3484058d50 comp rx=0 tx=0).stop 2024-09-15T23:21:44.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.019+0000 7f349946b740 1 -- 172.21.15.123:0/1952325822 shutdown_connections 2024-09-15T23:21:44.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.019+0000 7f349946b740 1 --2- 172.21.15.123:0/1952325822 >> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] conn(0x55989af22f20 0x55989af23390 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.020+0000 7f349946b740 1 --2- 172.21.15.123:0/1952325822 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55989aee9eb0 0x55989aecea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.020+0000 7f349946b740 1 --2- 172.21.15.123:0/1952325822 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55989af10420 0x55989aece4d0 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.020+0000 7f349946b740 1 --2- 172.21.15.123:0/1952325822 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55989aedfa70 0x55989af1ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.020+0000 7f346effd640 0 client.9756 ms_handle_reset on v2:172.21.15.123:6834/1883512279 2024-09-15T23:21:44.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.020+0000 7f349946b740 1 -- 172.21.15.123:0/1952325822 >> 172.21.15.123:0/1952325822 conn(0x55989aec61f0 msgr2=0x55989af0c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:44.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.020+0000 7f349946b740 1 -- 172.21.15.123:0/1952325822 shutdown_connections 2024-09-15T23:21:44.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.020+0000 7f349946b740 1 -- 172.21.15.123:0/1952325822 wait complete. 2024-09-15T23:21:44.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.020+0000 7f349946b740 20 client.9756 trim_cache size 0 max 16384 2024-09-15T23:21:44.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.037+0000 7f349946b740 1 Processor -- start 2024-09-15T23:21:44.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.037+0000 7f349946b740 1 -- start start 2024-09-15T23:21:44.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.038+0000 7f349946b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55989aedfa70 0x55989aef4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.038+0000 7f349946b740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55989aee9eb0 0x55989aef4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.038+0000 7f349946b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55989af10420 0x55989af0d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.038+0000 7f349946b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f34901fe8c0 con 0x55989af10420 2024-09-15T23:21:44.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.038+0000 7f349946b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f34901fda10 con 0x55989aedfa70 2024-09-15T23:21:44.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.038+0000 7f349946b740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f349015d3c0 con 0x55989aee9eb0 2024-09-15T23:21:44.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.038+0000 7f3494b93640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55989af10420 0x55989af0d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.038+0000 7f3494b93640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55989af10420 0x55989af0d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52262/0 (socket says 172.21.15.123:52262) 2024-09-15T23:21:44.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.038+0000 7f3494b93640 1 -- 172.21.15.123:0/3066420371 learned_addr learned my addr 172.21.15.123:0/3066420371 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:44.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.038+0000 7f348ffff640 1 --2- 172.21.15.123:0/3066420371 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55989aedfa70 0x55989aef4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.038+0000 7f348f7fe640 1 --2- 172.21.15.123:0/3066420371 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55989aee9eb0 0x55989aef4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.038+0000 7f3494b93640 1 -- 172.21.15.123:0/3066420371 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55989aee9eb0 msgr2=0x55989aef4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:44.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.038+0000 7f3494b93640 1 --2- 172.21.15.123:0/3066420371 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55989aee9eb0 0x55989aef4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.038+0000 7f3494b93640 1 -- 172.21.15.123:0/3066420371 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55989aedfa70 msgr2=0x55989aef4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:44.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.038+0000 7f3494b93640 1 --2- 172.21.15.123:0/3066420371 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55989aedfa70 0x55989aef4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.038+0000 7f3494b93640 1 -- 172.21.15.123:0/3066420371 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55989aec6940 con 0x55989af10420 2024-09-15T23:21:44.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.038+0000 7f3494b93640 1 --2- 172.21.15.123:0/3066420371 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55989af10420 0x55989af0d240 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f3488003e20 tx=0x7f3488003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b65d7e808ee8c01 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:44.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.038+0000 7f3475ffb640 1 -- 172.21.15.123:0/3066420371 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3488020620 con 0x55989af10420 2024-09-15T23:21:44.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.038+0000 7f3475ffb640 1 -- 172.21.15.123:0/3066420371 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f348801b030 con 0x55989af10420 2024-09-15T23:21:44.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.038+0000 7f3475ffb640 1 -- 172.21.15.123:0/3066420371 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3488020a00 con 0x55989af10420 2024-09-15T23:21:44.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.039+0000 7f349946b740 1 -- 172.21.15.123:0/3066420371 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55989af10420 msgr2=0x55989af0d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.039+0000 7f349946b740 1 --2- 172.21.15.123:0/3066420371 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55989af10420 0x55989af0d240 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f3488003e20 tx=0x7f3488003f10 comp rx=0 tx=0).stop 2024-09-15T23:21:44.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.039+0000 7f349946b740 1 -- 172.21.15.123:0/3066420371 shutdown_connections 2024-09-15T23:21:44.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.039+0000 7f349946b740 1 --2- 172.21.15.123:0/3066420371 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55989af10420 0x55989af0d240 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.039+0000 7f349946b740 1 --2- 172.21.15.123:0/3066420371 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55989aee9eb0 0x55989aef4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.039+0000 7f349946b740 1 --2- 172.21.15.123:0/3066420371 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55989aedfa70 0x55989aef4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.039+0000 7f349946b740 1 -- 172.21.15.123:0/3066420371 >> 172.21.15.123:0/3066420371 conn(0x55989aec61f0 msgr2=0x55989af1eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:44.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.039+0000 7f349946b740 1 -- 172.21.15.123:0/3066420371 shutdown_connections 2024-09-15T23:21:44.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.039+0000 7f349946b740 1 -- 172.21.15.123:0/3066420371 wait complete. 2024-09-15T23:21:44.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.040+0000 7f349946b740 1 -- start start 2024-09-15T23:21:44.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.040+0000 7f349946b740 1 Processor -- start 2024-09-15T23:21:44.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.040+0000 7f349946b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55989aedfa70 0x55989af84500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.040+0000 7f349946b740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55989aee9eb0 0x55989af21db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.040+0000 7f349946b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55989af10420 0x55989af222f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.040+0000 7f349946b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55989aee9980 con 0x55989aedfa70 2024-09-15T23:21:44.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.040+0000 7f349946b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f34901567e0 con 0x55989af10420 2024-09-15T23:21:44.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.040+0000 7f349946b740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55989ae62640 con 0x55989aee9eb0 2024-09-15T23:21:44.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.040+0000 7f349946b740 10 client.0 _ll_register_callbacks cb 0x7f3484009f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:21:44.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.040+0000 7f348ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55989aedfa70 0x55989af84500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.040+0000 7f348ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55989aedfa70 0x55989af84500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52264/0 (socket says 172.21.15.123:52264) 2024-09-15T23:21:44.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.040+0000 7f348ffff640 1 -- 172.21.15.123:0/2465423672 learned_addr learned my addr 172.21.15.123:0/2465423672 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:44.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.041+0000 7f348f7fe640 1 --2- 172.21.15.123:0/2465423672 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55989aee9eb0 0x55989af21db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.041+0000 7f3494b93640 1 --2- 172.21.15.123:0/2465423672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55989af10420 0x55989af222f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.041+0000 7f348ffff640 1 -- 172.21.15.123:0/2465423672 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55989aee9eb0 msgr2=0x55989af21db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:44.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.041+0000 7f348ffff640 1 --2- 172.21.15.123:0/2465423672 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55989aee9eb0 0x55989af21db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.041+0000 7f348ffff640 1 -- 172.21.15.123:0/2465423672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55989af10420 msgr2=0x55989af222f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:44.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.041+0000 7f348ffff640 1 --2- 172.21.15.123:0/2465423672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55989af10420 0x55989af222f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.041+0000 7f348ffff640 1 -- 172.21.15.123:0/2465423672 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55989aecf6a0 con 0x55989aedfa70 2024-09-15T23:21:44.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.041+0000 7f348ffff640 1 --2- 172.21.15.123:0/2465423672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55989aedfa70 0x55989af84500 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f3480009990 tx=0x7f348002c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=977fb67a254dd5db server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:44.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.041+0000 7f346effd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:21:44.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.041+0000 7f346effd640 1 -- 172.21.15.123:0/2465423672 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3480060070 con 0x55989aedfa70 2024-09-15T23:21:44.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.041+0000 7f346effd640 1 -- 172.21.15.123:0/2465423672 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7f348005b5a0 con 0x55989aedfa70 2024-09-15T23:21:44.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.041+0000 7f349946b740 1 -- 172.21.15.123:0/2465423672 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f348801b030 con 0x55989aedfa70 2024-09-15T23:21:44.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.041+0000 7f346effd640 1 -- 172.21.15.123:0/2465423672 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7f3480037040 con 0x55989aedfa70 2024-09-15T23:21:44.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.041+0000 7f349946b740 10 client.9762 fetch_fsmap learned FSMap version 100 2024-09-15T23:21:44.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.041+0000 7f349946b740 1 -- 172.21.15.123:0/2465423672 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x55989aad9550 con 0x55989aedfa70 2024-09-15T23:21:44.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.041+0000 7f346effd640 1 -- 172.21.15.123:0/2465423672 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f348801b030 con 0x55989aedfa70 2024-09-15T23:21:44.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.041+0000 7f346effd640 1 -- 172.21.15.123:0/2465423672 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 100) ==== 3502+0+0 (secure 0 0 0) 0x7f348005b7a0 con 0x55989aedfa70 2024-09-15T23:21:44.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.041+0000 7f349946b740 10 client.9762 fetch_fsmap finished waiting for FSMap version 100 2024-09-15T23:21:44.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.041+0000 7f349946b740 10 client.9762 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.a 2024-09-15T23:21:44.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.041+0000 7f349946b740 20 client.9762 populate_metadata read hostname 'smithi123' 2024-09-15T23:21:44.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.042+0000 7f349946b740 1 --2- 172.21.15.123:0/2465423672 >> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] conn(0x55989af21540 0x55989af0af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.042+0000 7f349946b740 4 client.9762 mds_command: new command op to 9564 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-15T23:21:44.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.042+0000 7f349946b740 1 -- 172.21.15.123:0/2465423672 --> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x55989ae3b2f0 con 0x55989af21540 2024-09-15T23:21:44.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.042+0000 7f348f7fe640 1 --2- 172.21.15.123:0/2465423672 >> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] conn(0x55989af21540 0x55989af0af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.042+0000 7f348f7fe640 1 --2- 172.21.15.123:0/2465423672 >> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] conn(0x55989af21540 0x55989af0af90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7f061104d2a9c33 server_cookie=e24a29355c8c94c in_seq=0 out_seq=0 2024-09-15T23:21:44.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.042+0000 7f346effd640 10 client.9762 ms_handle_connect on v2:172.21.15.123:6834/1883512279 2024-09-15T23:21:44.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.044+0000 7f346effd640 1 -- 172.21.15.123:0/2465423672 <== mds.0 v2:172.21.15.123:6834/1883512279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55989ae3b2f0 con 0x55989af21540 2024-09-15T23:21:44.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.044+0000 7f346effd640 10 client.9762 handle_command_reply: tid=0 2024-09-15T23:21:44.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.044+0000 7f349946b740 1 client.9762 shutdown 2024-09-15T23:21:44.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.044+0000 7f349946b740 1 -- 172.21.15.123:0/2465423672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55989aedfa70 msgr2=0x55989af84500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.044+0000 7f349946b740 1 --2- 172.21.15.123:0/2465423672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55989aedfa70 0x55989af84500 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f3480009990 tx=0x7f348002c070 comp rx=0 tx=0).stop 2024-09-15T23:21:44.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.044+0000 7f349946b740 1 -- 172.21.15.123:0/2465423672 shutdown_connections 2024-09-15T23:21:44.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.044+0000 7f349946b740 1 --2- 172.21.15.123:0/2465423672 >> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] conn(0x55989af21540 0x55989af0af90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.044+0000 7f349946b740 1 --2- 172.21.15.123:0/2465423672 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55989af10420 0x55989af222f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.044+0000 7f349946b740 1 --2- 172.21.15.123:0/2465423672 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55989aee9eb0 0x55989af21db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.044+0000 7f349946b740 1 --2- 172.21.15.123:0/2465423672 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55989aedfa70 0x55989af84500 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.044+0000 7f349946b740 1 -- 172.21.15.123:0/2465423672 >> 172.21.15.123:0/2465423672 conn(0x55989aec61f0 msgr2=0x55989aef4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:44.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.044+0000 7f346effd640 0 client.9762 ms_handle_reset on v2:172.21.15.123:6834/1883512279 2024-09-15T23:21:44.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.044+0000 7f349946b740 1 -- 172.21.15.123:0/2465423672 shutdown_connections 2024-09-15T23:21:44.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.044+0000 7f349946b740 1 -- 172.21.15.123:0/2465423672 wait complete. 2024-09-15T23:21:44.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.045+0000 7f349946b740 20 client.9762 trim_cache size 0 max 16384 2024-09-15T23:21:44.050 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:21:44.050 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0, 2024-09-15T23:21:44.050 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_tag": "9386dae5-82b2-43a4-9514-db920ffe924b", 2024-09-15T23:21:44.050 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": "asynchronous" 2024-09-15T23:21:44.051 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:21:44.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.045+0000 7f34965f6640 1 -- 172.21.15.123:0/108667972 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f347c06c2b0 msgr2=0x7f347c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.045+0000 7f34965f6640 1 --2- 172.21.15.123:0/108667972 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f347c06c2b0 0x7f347c06e770 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f3480034000 tx=0x7f348002e000 comp rx=0 tx=0).stop 2024-09-15T23:21:44.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.045+0000 7f34965f6640 1 -- 172.21.15.123:0/108667972 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34900cf960 msgr2=0x7f3490158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.045+0000 7f34965f6640 1 --2- 172.21.15.123:0/108667972 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34900cf960 0x7f3490158110 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f348400e810 tx=0x7f348400ecd0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.045+0000 7f34965f6640 1 -- 172.21.15.123:0/108667972 shutdown_connections 2024-09-15T23:21:44.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.045+0000 7f34965f6640 1 --2- 172.21.15.123:0/108667972 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3490155b20 0x7f34901595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.045+0000 7f34965f6640 1 --2- 172.21.15.123:0/108667972 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f347c06c2b0 0x7f347c06e770 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.045+0000 7f34965f6640 1 --2- 172.21.15.123:0/108667972 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34900cf960 0x7f3490158110 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.045+0000 7f34965f6640 1 --2- 172.21.15.123:0/108667972 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34900b21a0 0x7f3490143e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.045+0000 7f34965f6640 1 -- 172.21.15.123:0/108667972 >> 172.21.15.123:0/108667972 conn(0x7f349006c240 msgr2=0x7f34900710d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:44.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.045+0000 7f34965f6640 1 -- 172.21.15.123:0/108667972 shutdown_connections 2024-09-15T23:21:44.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.046+0000 7f34965f6640 1 -- 172.21.15.123:0/108667972 wait complete. 2024-09-15T23:21:44.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:21:44.060 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.11:0 scrub pause 2024-09-15T23:21:44.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.191+0000 7fea52d33640 1 Processor -- start 2024-09-15T23:21:44.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.191+0000 7fea52d33640 1 -- start start 2024-09-15T23:21:44.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.192+0000 7fea52d33640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fea4c15c7e0 0x7fea4c073ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.192+0000 7fea52d33640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea4c15cbc0 con 0x7fea4c0b4060 2024-09-15T23:21:44.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.192+0000 7fea52d33640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea4c0d0240 con 0x7fea4c0cde30 2024-09-15T23:21:44.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.192+0000 7fea52d33640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fea4c0d0520 con 0x7fea4c15c7e0 2024-09-15T23:21:44.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.192+0000 7fea50acf640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fea4c15c7e0 0x7fea4c073ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.192+0000 7fea4bfff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fea4c0b4060 0x7fea4c0b4480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53260/0 (socket says 172.21.15.123:53260) 2024-09-15T23:21:44.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.192+0000 7fea4bfff640 1 -- 172.21.15.123:0/850829324 learned_addr learned my addr 172.21.15.123:0/850829324 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:21:44.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.192+0000 7fea50acf640 1 --2- 172.21.15.123:0/850829324 >> v2:172.21.15.123:3300/0 conn(0x7fea4c15c7e0 0x7fea4c073ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52272/0 (socket says 172.21.15.123:52272) 2024-09-15T23:21:44.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.192+0000 7fea50acf640 1 -- 172.21.15.123:0/850829324 >> v1:172.21.15.188:6789/0 conn(0x7fea4c0cde30 legacy=0x7fea4c0ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.192+0000 7fea50acf640 1 -- 172.21.15.123:0/850829324 >> v1:172.21.15.123:6789/0 conn(0x7fea4c0b4060 legacy=0x7fea4c0b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.192+0000 7fea50acf640 1 -- 172.21.15.123:0/850829324 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea4c0d0800 con 0x7fea4c15c7e0 2024-09-15T23:21:44.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.192+0000 7fea4b7fe640 1 -- 172.21.15.123:0/850829324 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3388199610 0 0) 0x7fea4c15cbc0 con 0x7fea4c0b4060 2024-09-15T23:21:44.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.193+0000 7fea50acf640 1 --2- 172.21.15.123:0/850829324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea4c15c7e0 0x7fea4c073ab0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7fea40009790 tx=0x7fea4002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53aee694308dbf37 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:44.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.193+0000 7fea4b7fe640 1 -- 172.21.15.123:0/850829324 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea40037070 con 0x7fea4c15c7e0 2024-09-15T23:21:44.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.193+0000 7fea4b7fe640 1 -- 172.21.15.123:0/850829324 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea40032440 con 0x7fea4c15c7e0 2024-09-15T23:21:44.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.193+0000 7fea4b7fe640 1 -- 172.21.15.123:0/850829324 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea40032810 con 0x7fea4c15c7e0 2024-09-15T23:21:44.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.194+0000 7fea52d33640 1 -- 172.21.15.123:0/850829324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea4c15c7e0 msgr2=0x7fea4c073ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.194+0000 7fea52d33640 1 --2- 172.21.15.123:0/850829324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea4c15c7e0 0x7fea4c073ab0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7fea40009790 tx=0x7fea4002a210 comp rx=0 tx=0).stop 2024-09-15T23:21:44.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.194+0000 7fea52d33640 1 -- 172.21.15.123:0/850829324 shutdown_connections 2024-09-15T23:21:44.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.194+0000 7fea52d33640 1 --2- 172.21.15.123:0/850829324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea4c15c7e0 0x7fea4c073ab0 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.194+0000 7fea52d33640 1 -- 172.21.15.123:0/850829324 >> 172.21.15.123:0/850829324 conn(0x7fea4c0cefe0 msgr2=0x7fea4c0cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:44.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.194+0000 7fea52d33640 1 -- 172.21.15.123:0/850829324 shutdown_connections 2024-09-15T23:21:44.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.194+0000 7fea52d33640 1 -- 172.21.15.123:0/850829324 wait complete. 2024-09-15T23:21:44.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.195+0000 7fea52d33640 1 Processor -- start 2024-09-15T23:21:44.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.195+0000 7fea52d33640 1 -- start start 2024-09-15T23:21:44.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.196+0000 7fea52d33640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea4c0b4060 0x7fea4c06e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.196+0000 7fea52d33640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea4c0cde30 0x7fea4c151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.196+0000 7fea52d33640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fea4c15c7e0 0x7fea4c0af100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.196+0000 7fea52d33640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fea4c0b53d0 con 0x7fea4c0cde30 2024-09-15T23:21:44.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.196+0000 7fea52d33640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fea4c073110 con 0x7fea4c0b4060 2024-09-15T23:21:44.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.196+0000 7fea52d33640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fea4c0b5550 con 0x7fea4c15c7e0 2024-09-15T23:21:44.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.196+0000 7fea4bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea4c0cde30 0x7fea4c151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.196+0000 7fea4bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea4c0cde30 0x7fea4c151a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52280/0 (socket says 172.21.15.123:52280) 2024-09-15T23:21:44.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.196+0000 7fea4bfff640 1 -- 172.21.15.123:0/439729631 learned_addr learned my addr 172.21.15.123:0/439729631 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:44.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.196+0000 7fea512d0640 1 --2- 172.21.15.123:0/439729631 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fea4c15c7e0 0x7fea4c0af100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.196+0000 7fea50acf640 1 --2- 172.21.15.123:0/439729631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea4c0b4060 0x7fea4c06e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.196+0000 7fea4bfff640 1 -- 172.21.15.123:0/439729631 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fea4c15c7e0 msgr2=0x7fea4c0af100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.196+0000 7fea4bfff640 1 --2- 172.21.15.123:0/439729631 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fea4c15c7e0 0x7fea4c0af100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.196+0000 7fea4bfff640 1 -- 172.21.15.123:0/439729631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea4c0b4060 msgr2=0x7fea4c06e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.196+0000 7fea4bfff640 1 --2- 172.21.15.123:0/439729631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea4c0b4060 0x7fea4c06e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.196+0000 7fea4bfff640 1 -- 172.21.15.123:0/439729631 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea4c06d860 con 0x7fea4c0cde30 2024-09-15T23:21:44.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.196+0000 7fea50acf640 1 --2- 172.21.15.123:0/439729631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea4c0b4060 0x7fea4c06e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:21:44.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.196+0000 7fea4bfff640 1 --2- 172.21.15.123:0/439729631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea4c0cde30 0x7fea4c151a60 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7fea3800c4d0 tx=0x7fea3800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:44.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.197+0000 7fea497fa640 1 -- 172.21.15.123:0/439729631 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea38018070 con 0x7fea4c0cde30 2024-09-15T23:21:44.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.197+0000 7fea497fa640 1 -- 172.21.15.123:0/439729631 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea380074e0 con 0x7fea4c0cde30 2024-09-15T23:21:44.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.197+0000 7fea52d33640 1 -- 172.21.15.123:0/439729631 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea4c151fa0 con 0x7fea4c0cde30 2024-09-15T23:21:44.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.197+0000 7fea497fa640 1 -- 172.21.15.123:0/439729631 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea38004a20 con 0x7fea4c0cde30 2024-09-15T23:21:44.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.197+0000 7fea52d33640 1 -- 172.21.15.123:0/439729631 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea4c06dde0 con 0x7fea4c0cde30 2024-09-15T23:21:44.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.198+0000 7fea497fa640 1 -- 172.21.15.123:0/439729631 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fea3801b070 con 0x7fea4c0cde30 2024-09-15T23:21:44.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.198+0000 7fea497fa640 1 --2- 172.21.15.123:0/439729631 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fea3006c2b0 0x7fea3006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.199+0000 7fea497fa640 1 -- 172.21.15.123:0/439729631 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7fea3808a610 con 0x7fea4c0cde30 2024-09-15T23:21:44.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.199+0000 7fea50acf640 1 --2- 172.21.15.123:0/439729631 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fea3006c2b0 0x7fea3006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.199+0000 7fea50acf640 1 --2- 172.21.15.123:0/439729631 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fea3006c2b0 0x7fea3006e770 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fea40034000 tx=0x7fea4002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:44.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.199+0000 7fea55ac8740 1 Processor -- start 2024-09-15T23:21:44.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.199+0000 7fea55ac8740 1 -- start start 2024-09-15T23:21:44.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.200+0000 7fea55ac8740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bae2b65e0 0x563bae2b69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.200+0000 7fea55ac8740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bae2b3da0 0x563bae2b5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.200+0000 7fea55ac8740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563bae2b4200 0x563bae296560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.200+0000 7fea55ac8740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x563bae1d28d0 con 0x563bae2b65e0 2024-09-15T23:21:44.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.200+0000 7fea55ac8740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x563bae17a620 con 0x563bae2b3da0 2024-09-15T23:21:44.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.200+0000 7fea55ac8740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x563bae1ce890 con 0x563bae2b4200 2024-09-15T23:21:44.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.200+0000 7fea50acf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bae2b65e0 0x563bae2b69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.200+0000 7fea50acf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bae2b65e0 0x563bae2b69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52294/0 (socket says 172.21.15.123:52294) 2024-09-15T23:21:44.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.200+0000 7fea50acf640 1 -- 172.21.15.123:0/1896001971 learned_addr learned my addr 172.21.15.123:0/1896001971 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:44.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.200+0000 7fea4bfff640 1 --2- 172.21.15.123:0/1896001971 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bae2b3da0 0x563bae2b5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.200+0000 7fea512d0640 1 --2- 172.21.15.123:0/1896001971 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563bae2b4200 0x563bae296560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.200+0000 7fea50acf640 1 -- 172.21.15.123:0/1896001971 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563bae2b4200 msgr2=0x563bae296560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:44.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.200+0000 7fea50acf640 1 --2- 172.21.15.123:0/1896001971 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563bae2b4200 0x563bae296560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.200+0000 7fea50acf640 1 -- 172.21.15.123:0/1896001971 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bae2b3da0 msgr2=0x563bae2b5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:44.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.200+0000 7fea50acf640 1 --2- 172.21.15.123:0/1896001971 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bae2b3da0 0x563bae2b5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.200+0000 7fea50acf640 1 -- 172.21.15.123:0/1896001971 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563badfaf7d0 con 0x563bae2b65e0 2024-09-15T23:21:44.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.201+0000 7fea50acf640 1 --2- 172.21.15.123:0/1896001971 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bae2b65e0 0x563bae2b69c0 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7fea40035040 tx=0x7fea4002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d69ed50554b3cc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:44.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.201+0000 7fea367fc640 1 -- 172.21.15.123:0/1896001971 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea40037040 con 0x563bae2b65e0 2024-09-15T23:21:44.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.201+0000 7fea367fc640 1 -- 172.21.15.123:0/1896001971 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea4004d070 con 0x563bae2b65e0 2024-09-15T23:21:44.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.201+0000 7fea367fc640 1 -- 172.21.15.123:0/1896001971 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4003d840 con 0x563bae2b65e0 2024-09-15T23:21:44.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.201+0000 7fea55ac8740 1 -- 172.21.15.123:0/1896001971 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bae2b65e0 msgr2=0x563bae2b69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.201+0000 7fea55ac8740 1 --2- 172.21.15.123:0/1896001971 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bae2b65e0 0x563bae2b69c0 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7fea40035040 tx=0x7fea4002c000 comp rx=0 tx=0).stop 2024-09-15T23:21:44.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.201+0000 7fea55ac8740 1 -- 172.21.15.123:0/1896001971 shutdown_connections 2024-09-15T23:21:44.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.201+0000 7fea55ac8740 1 --2- 172.21.15.123:0/1896001971 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563bae2b4200 0x563bae296560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.201+0000 7fea55ac8740 1 --2- 172.21.15.123:0/1896001971 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bae2b3da0 0x563bae2b5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.201+0000 7fea55ac8740 1 --2- 172.21.15.123:0/1896001971 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bae2b65e0 0x563bae2b69c0 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.201+0000 7fea55ac8740 1 -- 172.21.15.123:0/1896001971 >> 172.21.15.123:0/1896001971 conn(0x563bae26c240 msgr2=0x563bae2b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:44.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.201+0000 7fea55ac8740 1 -- 172.21.15.123:0/1896001971 shutdown_connections 2024-09-15T23:21:44.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.201+0000 7fea55ac8740 1 -- 172.21.15.123:0/1896001971 wait complete. 2024-09-15T23:21:44.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.202+0000 7fea55ac8740 1 -- start start 2024-09-15T23:21:44.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.202+0000 7fea55ac8740 1 Processor -- start 2024-09-15T23:21:44.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.203+0000 7fea55ac8740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bae2b4200 0x563bae2ab4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.203+0000 7fea55ac8740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563bae2b65e0 0x563bae26a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.203+0000 7fea55ac8740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bae2aeaf0 0x563bae299260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.203+0000 7fea55ac8740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x563bae2b2d00 con 0x563bae2aeaf0 2024-09-15T23:21:44.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.203+0000 7fea55ac8740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x563bae15b750 con 0x563bae2b4200 2024-09-15T23:21:44.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.203+0000 7fea55ac8740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x563bae2b2fe0 con 0x563bae2b65e0 2024-09-15T23:21:44.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.203+0000 7fea55ac8740 10 client.0 _ll_register_callbacks cb 0x563bae17f780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:21:44.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.203+0000 7fea512d0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bae2aeaf0 0x563bae299260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.203+0000 7fea512d0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bae2aeaf0 0x563bae299260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52298/0 (socket says 172.21.15.123:52298) 2024-09-15T23:21:44.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.203+0000 7fea512d0640 1 -- 172.21.15.123:0/1960775155 learned_addr learned my addr 172.21.15.123:0/1960775155 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:44.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.203+0000 7fea4bfff640 1 --2- 172.21.15.123:0/1960775155 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563bae2b65e0 0x563bae26a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.203+0000 7fea50acf640 1 --2- 172.21.15.123:0/1960775155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bae2b4200 0x563bae2ab4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.203+0000 7fea512d0640 1 -- 172.21.15.123:0/1960775155 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563bae2b65e0 msgr2=0x563bae26a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:44.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.203+0000 7fea512d0640 1 --2- 172.21.15.123:0/1960775155 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563bae2b65e0 0x563bae26a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.203+0000 7fea512d0640 1 -- 172.21.15.123:0/1960775155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bae2b4200 msgr2=0x563bae2ab4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:44.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.203+0000 7fea512d0640 1 --2- 172.21.15.123:0/1960775155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bae2b4200 0x563bae2ab4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.203+0000 7fea512d0640 1 -- 172.21.15.123:0/1960775155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563badea50f0 con 0x563bae2aeaf0 2024-09-15T23:21:44.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.204+0000 7fea512d0640 1 --2- 172.21.15.123:0/1960775155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bae2aeaf0 0x563bae299260 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7fea44012660 tx=0x7fea44012b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc178e8b6cc46b8b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:44.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.204+0000 7fea2b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:21:44.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.204+0000 7fea2b7fe640 1 -- 172.21.15.123:0/1960775155 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea44019020 con 0x563bae2aeaf0 2024-09-15T23:21:44.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.204+0000 7fea2b7fe640 1 -- 172.21.15.123:0/1960775155 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7fea44003970 con 0x563bae2aeaf0 2024-09-15T23:21:44.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.204+0000 7fea55ac8740 1 -- 172.21.15.123:0/1960775155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea4004d070 con 0x563bae2aeaf0 2024-09-15T23:21:44.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.204+0000 7fea2b7fe640 1 -- 172.21.15.123:0/1960775155 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7fea44023050 con 0x563bae2aeaf0 2024-09-15T23:21:44.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.204+0000 7fea55ac8740 10 client.9777 fetch_fsmap learned FSMap version 100 2024-09-15T23:21:44.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.204+0000 7fea55ac8740 1 -- 172.21.15.123:0/1960775155 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x563bae00ff60 con 0x563bae2aeaf0 2024-09-15T23:21:44.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.204+0000 7fea2b7fe640 1 -- 172.21.15.123:0/1960775155 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea4004d070 con 0x563bae2aeaf0 2024-09-15T23:21:44.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.204+0000 7fea2b7fe640 1 -- 172.21.15.123:0/1960775155 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 100) ==== 3502+0+0 (secure 0 0 0) 0x7fea44026020 con 0x563bae2aeaf0 2024-09-15T23:21:44.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.204+0000 7fea55ac8740 10 client.9777 fetch_fsmap finished waiting for FSMap version 100 2024-09-15T23:21:44.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.204+0000 7fea55ac8740 10 client.9777 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.a 2024-09-15T23:21:44.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.204+0000 7fea55ac8740 20 client.9777 populate_metadata read hostname 'smithi123' 2024-09-15T23:21:44.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.204+0000 7fea55ac8740 1 --2- 172.21.15.123:0/1960775155 >> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] conn(0x563bae297bf0 0x563bae298050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.204+0000 7fea55ac8740 4 client.9777 mds_command: new command op to 9564 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:21:44.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.204+0000 7fea55ac8740 1 -- 172.21.15.123:0/1960775155 --> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563bae1e0000 con 0x563bae297bf0 2024-09-15T23:21:44.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.204+0000 7fea50acf640 1 --2- 172.21.15.123:0/1960775155 >> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] conn(0x563bae297bf0 0x563bae298050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.205+0000 7fea2b7fe640 10 client.9777 ms_handle_connect on v2:172.21.15.123:6834/1883512279 2024-09-15T23:21:44.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.205+0000 7fea50acf640 1 --2- 172.21.15.123:0/1960775155 >> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] conn(0x563bae297bf0 0x563bae298050 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf3d1f8e2ed42e1c server_cookie=4d5b035cef08e5d4 in_seq=0 out_seq=0 2024-09-15T23:21:44.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.205+0000 7fea2b7fe640 1 -- 172.21.15.123:0/1960775155 <== mds.0 v2:172.21.15.123:6834/1883512279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563bae1e0000 con 0x563bae297bf0 2024-09-15T23:21:44.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.205+0000 7fea2b7fe640 10 client.9777 handle_command_reply: tid=0 2024-09-15T23:21:44.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.205+0000 7fea55ac8740 1 client.9777 shutdown 2024-09-15T23:21:44.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.205+0000 7fea55ac8740 1 -- 172.21.15.123:0/1960775155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bae2aeaf0 msgr2=0x563bae299260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.205+0000 7fea55ac8740 1 --2- 172.21.15.123:0/1960775155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bae2aeaf0 0x563bae299260 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7fea44012660 tx=0x7fea44012b20 comp rx=0 tx=0).stop 2024-09-15T23:21:44.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.205+0000 7fea55ac8740 1 -- 172.21.15.123:0/1960775155 shutdown_connections 2024-09-15T23:21:44.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.205+0000 7fea55ac8740 1 --2- 172.21.15.123:0/1960775155 >> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] conn(0x563bae297bf0 0x563bae298050 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.205+0000 7fea55ac8740 1 --2- 172.21.15.123:0/1960775155 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bae2aeaf0 0x563bae299260 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.205+0000 7fea55ac8740 1 --2- 172.21.15.123:0/1960775155 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563bae2b65e0 0x563bae26a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.205+0000 7fea2b7fe640 0 client.9777 ms_handle_reset on v2:172.21.15.123:6834/1883512279 2024-09-15T23:21:44.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.205+0000 7fea55ac8740 1 --2- 172.21.15.123:0/1960775155 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bae2b4200 0x563bae2ab4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.205+0000 7fea55ac8740 1 -- 172.21.15.123:0/1960775155 >> 172.21.15.123:0/1960775155 conn(0x563bae2b3da0 msgr2=0x563bae2b7090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:44.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.206+0000 7fea55ac8740 1 -- 172.21.15.123:0/1960775155 shutdown_connections 2024-09-15T23:21:44.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.206+0000 7fea55ac8740 1 -- 172.21.15.123:0/1960775155 wait complete. 2024-09-15T23:21:44.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.206+0000 7fea55ac8740 20 client.9777 trim_cache size 0 max 16384 2024-09-15T23:21:44.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.222+0000 7fea55ac8740 1 Processor -- start 2024-09-15T23:21:44.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.222+0000 7fea55ac8740 1 -- start start 2024-09-15T23:21:44.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.223+0000 7fea55ac8740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563bae2aeaf0 0x563bae2b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.223+0000 7fea55ac8740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bae2b4200 0x563bae2b1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.223+0000 7fea55ac8740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bae2b65e0 0x563bae2b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.223+0000 7fea55ac8740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fea4c200a80 con 0x563bae2b4200 2024-09-15T23:21:44.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.223+0000 7fea55ac8740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fea4c15eac0 con 0x563bae2b65e0 2024-09-15T23:21:44.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.223+0000 7fea55ac8740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fea4c15de20 con 0x563bae2aeaf0 2024-09-15T23:21:44.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.223+0000 7fea4bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bae2b4200 0x563bae2b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.223+0000 7fea4bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bae2b4200 0x563bae2b1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52300/0 (socket says 172.21.15.123:52300) 2024-09-15T23:21:44.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.223+0000 7fea4bfff640 1 -- 172.21.15.123:0/407459242 learned_addr learned my addr 172.21.15.123:0/407459242 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:44.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.223+0000 7fea4bfff640 1 -- 172.21.15.123:0/407459242 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563bae2aeaf0 msgr2=0x563bae2b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:44.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.223+0000 7fea4bfff640 1 --2- 172.21.15.123:0/407459242 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563bae2aeaf0 0x563bae2b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.223+0000 7fea4bfff640 1 -- 172.21.15.123:0/407459242 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bae2b65e0 msgr2=0x563bae2b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:44.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.223+0000 7fea4bfff640 1 --2- 172.21.15.123:0/407459242 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bae2b65e0 0x563bae2b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.223+0000 7fea4bfff640 1 -- 172.21.15.123:0/407459242 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bade7e1b0 con 0x563bae2b4200 2024-09-15T23:21:44.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.224+0000 7fea4bfff640 1 --2- 172.21.15.123:0/407459242 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bae2b4200 0x563bae2b1290 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7fea38054c20 tx=0x7fea3808a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddfa6453cbbb7077 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:44.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.224+0000 7fea35ffb640 1 -- 172.21.15.123:0/407459242 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea38056ac0 con 0x563bae2b4200 2024-09-15T23:21:44.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.224+0000 7fea35ffb640 1 -- 172.21.15.123:0/407459242 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea38054e30 con 0x563bae2b4200 2024-09-15T23:21:44.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.224+0000 7fea35ffb640 1 -- 172.21.15.123:0/407459242 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea38004dc0 con 0x563bae2b4200 2024-09-15T23:21:44.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.224+0000 7fea55ac8740 1 -- 172.21.15.123:0/407459242 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bae2b4200 msgr2=0x563bae2b1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.224+0000 7fea55ac8740 1 --2- 172.21.15.123:0/407459242 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bae2b4200 0x563bae2b1290 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7fea38054c20 tx=0x7fea3808a040 comp rx=0 tx=0).stop 2024-09-15T23:21:44.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.224+0000 7fea55ac8740 1 -- 172.21.15.123:0/407459242 shutdown_connections 2024-09-15T23:21:44.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.224+0000 7fea55ac8740 1 --2- 172.21.15.123:0/407459242 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bae2b65e0 0x563bae2b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.224+0000 7fea55ac8740 1 --2- 172.21.15.123:0/407459242 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bae2b4200 0x563bae2b1290 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.224+0000 7fea55ac8740 1 --2- 172.21.15.123:0/407459242 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563bae2aeaf0 0x563bae2b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.224+0000 7fea55ac8740 1 -- 172.21.15.123:0/407459242 >> 172.21.15.123:0/407459242 conn(0x563bae2b3da0 msgr2=0x563bae26b360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:44.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.224+0000 7fea55ac8740 1 -- 172.21.15.123:0/407459242 shutdown_connections 2024-09-15T23:21:44.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.224+0000 7fea55ac8740 1 -- 172.21.15.123:0/407459242 wait complete. 2024-09-15T23:21:44.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.225+0000 7fea55ac8740 1 -- start start 2024-09-15T23:21:44.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.225+0000 7fea55ac8740 1 Processor -- start 2024-09-15T23:21:44.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.226+0000 7fea55ac8740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bae2aeaf0 0x563bae332610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.226+0000 7fea55ac8740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563bae2b4200 0x563bae2b4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.226+0000 7fea55ac8740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bae2b65e0 0x563bae2b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.226+0000 7fea55ac8740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x563bae26a720 con 0x563bae2b65e0 2024-09-15T23:21:44.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.226+0000 7fea55ac8740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fea4c15e470 con 0x563bae2aeaf0 2024-09-15T23:21:44.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.226+0000 7fea55ac8740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x563bae2cad60 con 0x563bae2b4200 2024-09-15T23:21:44.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.226+0000 7fea55ac8740 10 client.0 _ll_register_callbacks cb 0x7fea44001a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:21:44.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.226+0000 7fea512d0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bae2b65e0 0x563bae2b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.226+0000 7fea512d0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bae2b65e0 0x563bae2b4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52312/0 (socket says 172.21.15.123:52312) 2024-09-15T23:21:44.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.226+0000 7fea512d0640 1 -- 172.21.15.123:0/690509144 learned_addr learned my addr 172.21.15.123:0/690509144 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:44.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.226+0000 7fea512d0640 1 -- 172.21.15.123:0/690509144 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563bae2b4200 msgr2=0x563bae2b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:44.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.226+0000 7fea512d0640 1 --2- 172.21.15.123:0/690509144 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563bae2b4200 0x563bae2b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.226+0000 7fea512d0640 1 -- 172.21.15.123:0/690509144 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bae2aeaf0 msgr2=0x563bae332610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:44.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.226+0000 7fea512d0640 1 --2- 172.21.15.123:0/690509144 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bae2aeaf0 0x563bae332610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.226+0000 7fea512d0640 1 -- 172.21.15.123:0/690509144 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bae2aa290 con 0x563bae2b65e0 2024-09-15T23:21:44.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.226+0000 7fea512d0640 1 --2- 172.21.15.123:0/690509144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bae2b65e0 0x563bae2b4c40 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7fea44010e90 tx=0x7fea44001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec67826dcdad80c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:44.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.226+0000 7fea2b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:21:44.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.226+0000 7fea2b7fe640 1 -- 172.21.15.123:0/690509144 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4402c060 con 0x563bae2b65e0 2024-09-15T23:21:44.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.227+0000 7fea2b7fe640 1 -- 172.21.15.123:0/690509144 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7fea44010040 con 0x563bae2b65e0 2024-09-15T23:21:44.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.227+0000 7fea55ac8740 1 -- 172.21.15.123:0/690509144 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea38054e30 con 0x563bae2b65e0 2024-09-15T23:21:44.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.227+0000 7fea2b7fe640 1 -- 172.21.15.123:0/690509144 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7fea44019070 con 0x563bae2b65e0 2024-09-15T23:21:44.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.227+0000 7fea55ac8740 10 client.9783 fetch_fsmap learned FSMap version 100 2024-09-15T23:21:44.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.227+0000 7fea55ac8740 1 -- 172.21.15.123:0/690509144 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x563bae332b50 con 0x563bae2b65e0 2024-09-15T23:21:44.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.227+0000 7fea2b7fe640 1 -- 172.21.15.123:0/690509144 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea38054e30 con 0x563bae2b65e0 2024-09-15T23:21:44.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.227+0000 7fea2b7fe640 1 -- 172.21.15.123:0/690509144 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 100) ==== 3502+0+0 (secure 0 0 0) 0x7fea44026070 con 0x563bae2b65e0 2024-09-15T23:21:44.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.227+0000 7fea55ac8740 10 client.9783 fetch_fsmap finished waiting for FSMap version 100 2024-09-15T23:21:44.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.227+0000 7fea55ac8740 10 client.9783 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.a 2024-09-15T23:21:44.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.227+0000 7fea55ac8740 20 client.9783 populate_metadata read hostname 'smithi123' 2024-09-15T23:21:44.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.227+0000 7fea55ac8740 1 --2- 172.21.15.123:0/690509144 >> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] conn(0x563bae2ca660 0x563bae2d6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.227+0000 7fea55ac8740 4 client.9783 mds_command: new command op to 9564 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-15T23:21:44.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.227+0000 7fea55ac8740 1 -- 172.21.15.123:0/690509144 --> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x563bae1da350 con 0x563bae2ca660 2024-09-15T23:21:44.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.227+0000 7fea50acf640 1 --2- 172.21.15.123:0/690509144 >> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] conn(0x563bae2ca660 0x563bae2d6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.227+0000 7fea2b7fe640 10 client.9783 ms_handle_connect on v2:172.21.15.123:6834/1883512279 2024-09-15T23:21:44.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.227+0000 7fea50acf640 1 --2- 172.21.15.123:0/690509144 >> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] conn(0x563bae2ca660 0x563bae2d6890 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ab2c0829030c709 server_cookie=220604c5ea2f17c9 in_seq=0 out_seq=0 2024-09-15T23:21:44.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.228+0000 7fea2b7fe640 1 -- 172.21.15.123:0/690509144 <== mds.0 v2:172.21.15.123:6834/1883512279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563bae1da350 con 0x563bae2ca660 2024-09-15T23:21:44.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.228+0000 7fea2b7fe640 10 client.9783 handle_command_reply: tid=0 2024-09-15T23:21:44.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.228+0000 7fea55ac8740 1 client.9783 shutdown 2024-09-15T23:21:44.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.228+0000 7fea55ac8740 1 -- 172.21.15.123:0/690509144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bae2b65e0 msgr2=0x563bae2b4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.228+0000 7fea55ac8740 1 --2- 172.21.15.123:0/690509144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bae2b65e0 0x563bae2b4c40 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7fea44010e90 tx=0x7fea44001250 comp rx=0 tx=0).stop 2024-09-15T23:21:44.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.228+0000 7fea55ac8740 1 -- 172.21.15.123:0/690509144 shutdown_connections 2024-09-15T23:21:44.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.228+0000 7fea55ac8740 1 --2- 172.21.15.123:0/690509144 >> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] conn(0x563bae2ca660 0x563bae2d6890 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.228+0000 7fea55ac8740 1 --2- 172.21.15.123:0/690509144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563bae2b65e0 0x563bae2b4c40 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.228+0000 7fea55ac8740 1 --2- 172.21.15.123:0/690509144 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563bae2b4200 0x563bae2b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.228+0000 7fea2b7fe640 0 client.9783 ms_handle_reset on v2:172.21.15.123:6834/1883512279 2024-09-15T23:21:44.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.228+0000 7fea55ac8740 1 --2- 172.21.15.123:0/690509144 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563bae2aeaf0 0x563bae332610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.228+0000 7fea55ac8740 1 -- 172.21.15.123:0/690509144 >> 172.21.15.123:0/690509144 conn(0x563bae2b3da0 msgr2=0x563bae2b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:44.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.228+0000 7fea55ac8740 1 -- 172.21.15.123:0/690509144 shutdown_connections 2024-09-15T23:21:44.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.228+0000 7fea55ac8740 1 -- 172.21.15.123:0/690509144 wait complete. 2024-09-15T23:21:44.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.228+0000 7fea55ac8740 20 client.9783 trim_cache size 0 max 16384 2024-09-15T23:21:44.235 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:21:44.235 INFO:teuthology.orchestra.run.smithi123.stdout: "message": "", 2024-09-15T23:21:44.236 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0 2024-09-15T23:21:44.236 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:21:44.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.228+0000 7fea52d33640 1 -- 172.21.15.123:0/439729631 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fea3006c2b0 msgr2=0x7fea3006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.228+0000 7fea52d33640 1 --2- 172.21.15.123:0/439729631 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fea3006c2b0 0x7fea3006e770 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fea40034000 tx=0x7fea4002e000 comp rx=0 tx=0).stop 2024-09-15T23:21:44.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.228+0000 7fea52d33640 1 -- 172.21.15.123:0/439729631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea4c0cde30 msgr2=0x7fea4c151a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.228+0000 7fea52d33640 1 --2- 172.21.15.123:0/439729631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea4c0cde30 0x7fea4c151a60 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7fea3800c4d0 tx=0x7fea3800c990 comp rx=0 tx=0).stop 2024-09-15T23:21:44.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.229+0000 7fea52d33640 1 -- 172.21.15.123:0/439729631 shutdown_connections 2024-09-15T23:21:44.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.229+0000 7fea52d33640 1 --2- 172.21.15.123:0/439729631 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fea4c15c7e0 0x7fea4c0af100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.229+0000 7fea52d33640 1 --2- 172.21.15.123:0/439729631 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fea3006c2b0 0x7fea3006e770 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.229+0000 7fea52d33640 1 --2- 172.21.15.123:0/439729631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea4c0cde30 0x7fea4c151a60 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.229+0000 7fea52d33640 1 --2- 172.21.15.123:0/439729631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea4c0b4060 0x7fea4c06e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.229+0000 7fea52d33640 1 -- 172.21.15.123:0/439729631 >> 172.21.15.123:0/439729631 conn(0x7fea4c0cefe0 msgr2=0x7fea4c0d1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:44.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.229+0000 7fea52d33640 1 -- 172.21.15.123:0/439729631 shutdown_connections 2024-09-15T23:21:44.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.229+0000 7fea52d33640 1 -- 172.21.15.123:0/439729631 wait complete. 2024-09-15T23:21:44.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:21:44.240 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.11:0 scrub status 2024-09-15T23:21:44.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.340+0000 7fd95cee6640 1 Processor -- start 2024-09-15T23:21:44.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.340+0000 7fd95cee6640 1 -- start start 2024-09-15T23:21:44.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.341+0000 7fd95cee6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd958155950 0x7fd958073600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.341+0000 7fd95cee6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd9580afb20 0x7fd9580aff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.341+0000 7fd95cee6640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd958073cc0 con 0x7fd958162c80 2024-09-15T23:21:44.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.341+0000 7fd95cee6640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fd9580b04d0 con 0x7fd9580afb20 2024-09-15T23:21:44.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.341+0000 7fd95cee6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fd958070370 con 0x7fd958155950 2024-09-15T23:21:44.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.341+0000 7fd956d9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd9580afb20 0x7fd9580aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.341+0000 7fd956d9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd9580afb20 0x7fd9580aff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52316/0 (socket says 172.21.15.123:52316) 2024-09-15T23:21:44.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.341+0000 7fd956d9d640 1 -- 172.21.15.123:0/2708512754 learned_addr learned my addr 172.21.15.123:0/2708512754 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:44.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.341+0000 7fd95659c640 1 --2- 172.21.15.123:0/2708512754 >> v2:172.21.15.188:3300/0 conn(0x7fd958155950 0x7fd958073600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.341+0000 7fd956d9d640 1 -- 172.21.15.123:0/2708512754 >> v2:172.21.15.188:3300/0 conn(0x7fd958155950 msgr2=0x7fd958073600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:44.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.341+0000 7fd956d9d640 1 --2- 172.21.15.123:0/2708512754 >> v2:172.21.15.188:3300/0 conn(0x7fd958155950 0x7fd958073600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.341+0000 7fd956d9d640 1 -- 172.21.15.123:0/2708512754 >> v1:172.21.15.188:6789/0 conn(0x7fd958162c80 legacy=0x7fd95806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.341+0000 7fd956d9d640 1 -- 172.21.15.123:0/2708512754 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd958071aa0 con 0x7fd9580afb20 2024-09-15T23:21:44.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.342+0000 7fd956d9d640 1 --2- 172.21.15.123:0/2708512754 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9580afb20 0x7fd9580aff90 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7fd95806d830 tx=0x7fd94802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59069f999f97526f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:44.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.342+0000 7fd95559a640 1 -- 172.21.15.123:0/2708512754 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd948037070 con 0x7fd9580afb20 2024-09-15T23:21:44.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.342+0000 7fd95559a640 1 -- 172.21.15.123:0/2708512754 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd948032440 con 0x7fd9580afb20 2024-09-15T23:21:44.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.342+0000 7fd95559a640 1 -- 172.21.15.123:0/2708512754 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd948032810 con 0x7fd9580afb20 2024-09-15T23:21:44.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.343+0000 7fd95cee6640 1 -- 172.21.15.123:0/2708512754 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9580afb20 msgr2=0x7fd9580aff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.343+0000 7fd95cee6640 1 --2- 172.21.15.123:0/2708512754 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9580afb20 0x7fd9580aff90 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7fd95806d830 tx=0x7fd94802a270 comp rx=0 tx=0).stop 2024-09-15T23:21:44.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.343+0000 7fd95cee6640 1 -- 172.21.15.123:0/2708512754 shutdown_connections 2024-09-15T23:21:44.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.343+0000 7fd95cee6640 1 --2- 172.21.15.123:0/2708512754 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd9580afb20 0x7fd9580aff90 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.343+0000 7fd95cee6640 1 --2- 172.21.15.123:0/2708512754 >> v2:172.21.15.188:3300/0 conn(0x7fd958155950 0x7fd958073600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.343+0000 7fd95cee6640 1 -- 172.21.15.123:0/2708512754 >> 172.21.15.123:0/2708512754 conn(0x7fd95806db30 msgr2=0x7fd95806df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:44.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.343+0000 7fd95cee6640 1 -- 172.21.15.123:0/2708512754 shutdown_connections 2024-09-15T23:21:44.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.343+0000 7fd95cee6640 1 -- 172.21.15.123:0/2708512754 wait complete. 2024-09-15T23:21:44.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.344+0000 7fd95cee6640 1 Processor -- start 2024-09-15T23:21:44.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.344+0000 7fd95cee6640 1 -- start start 2024-09-15T23:21:44.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.345+0000 7fd95cee6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd9580afb20 0x7fd958162250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.345+0000 7fd95cee6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd958162c80 0x7fd958158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.345+0000 7fd95cee6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd958158740 0x7fd958155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.345+0000 7fd95cee6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd9581630e0 con 0x7fd958162c80 2024-09-15T23:21:44.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.345+0000 7fd95cee6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd95806c320 con 0x7fd958158740 2024-09-15T23:21:44.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.345+0000 7fd95cee6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd958072060 con 0x7fd9580afb20 2024-09-15T23:21:44.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.345+0000 7fd955d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd958162c80 0x7fd958158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.345+0000 7fd955d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd958162c80 0x7fd958158200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52328/0 (socket says 172.21.15.123:52328) 2024-09-15T23:21:44.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.345+0000 7fd955d9b640 1 -- 172.21.15.123:0/3964049896 learned_addr learned my addr 172.21.15.123:0/3964049896 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:44.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.345+0000 7fd956d9d640 1 --2- 172.21.15.123:0/3964049896 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd958158740 0x7fd958155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.345+0000 7fd95659c640 1 --2- 172.21.15.123:0/3964049896 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd9580afb20 0x7fd958162250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.345+0000 7fd955d9b640 1 -- 172.21.15.123:0/3964049896 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd9580afb20 msgr2=0x7fd958162250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.345+0000 7fd955d9b640 1 --2- 172.21.15.123:0/3964049896 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd9580afb20 0x7fd958162250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.345+0000 7fd955d9b640 1 -- 172.21.15.123:0/3964049896 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd958158740 msgr2=0x7fd958155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.345+0000 7fd955d9b640 1 --2- 172.21.15.123:0/3964049896 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd958158740 0x7fd958155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.345+0000 7fd955d9b640 1 -- 172.21.15.123:0/3964049896 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd958156d50 con 0x7fd958162c80 2024-09-15T23:21:44.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.346+0000 7fd955d9b640 1 --2- 172.21.15.123:0/3964049896 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd958162c80 0x7fd958158200 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7fd94000c3c0 tx=0x7fd94000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:44.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.346+0000 7fd94effd640 1 -- 172.21.15.123:0/3964049896 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9400052d0 con 0x7fd958162c80 2024-09-15T23:21:44.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.346+0000 7fd94effd640 1 -- 172.21.15.123:0/3964049896 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd940005490 con 0x7fd958162c80 2024-09-15T23:21:44.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.346+0000 7fd95cee6640 1 -- 172.21.15.123:0/3964049896 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd958157030 con 0x7fd958162c80 2024-09-15T23:21:44.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.346+0000 7fd94effd640 1 -- 172.21.15.123:0/3964049896 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd940007260 con 0x7fd958162c80 2024-09-15T23:21:44.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.346+0000 7fd95cee6640 1 -- 172.21.15.123:0/3964049896 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9581575f0 con 0x7fd958162c80 2024-09-15T23:21:44.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.347+0000 7fd94effd640 1 -- 172.21.15.123:0/3964049896 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd940007400 con 0x7fd958162c80 2024-09-15T23:21:44.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.348+0000 7fd94effd640 1 --2- 172.21.15.123:0/3964049896 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd93806c2b0 0x7fd93806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.348+0000 7fd94effd640 1 -- 172.21.15.123:0/3964049896 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7fd94008a850 con 0x7fd958162c80 2024-09-15T23:21:44.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.348+0000 7fd95659c640 1 --2- 172.21.15.123:0/3964049896 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd93806c2b0 0x7fd93806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.348+0000 7fd95659c640 1 --2- 172.21.15.123:0/3964049896 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd93806c2b0 0x7fd93806e770 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fd9500113e0 tx=0x7fd95000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:44.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.348+0000 7fd95fc77740 1 Processor -- start 2024-09-15T23:21:44.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.349+0000 7fd95fc77740 1 -- start start 2024-09-15T23:21:44.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.349+0000 7fd95fc77740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647482ee920 0x5647483340c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.349+0000 7fd95fc77740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5647482ec0e0 0x5647482eed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.349+0000 7fd95fc77740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5647482f00b0 0x5647482e91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.349+0000 7fd95fc77740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5647482516f0 con 0x5647482ee920 2024-09-15T23:21:44.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.349+0000 7fd95fc77740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5647481f9330 con 0x5647482f00b0 2024-09-15T23:21:44.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.349+0000 7fd95fc77740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x56474824d6b0 con 0x5647482ec0e0 2024-09-15T23:21:44.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.349+0000 7fd95659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647482ee920 0x5647483340c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.350+0000 7fd95659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647482ee920 0x5647483340c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52340/0 (socket says 172.21.15.123:52340) 2024-09-15T23:21:44.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.350+0000 7fd95659c640 1 -- 172.21.15.123:0/3225332205 learned_addr learned my addr 172.21.15.123:0/3225332205 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:44.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.350+0000 7fd956d9d640 1 --2- 172.21.15.123:0/3225332205 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5647482f00b0 0x5647482e91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.350+0000 7fd955d9b640 1 --2- 172.21.15.123:0/3225332205 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5647482ec0e0 0x5647482eed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.350+0000 7fd95659c640 1 -- 172.21.15.123:0/3225332205 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5647482ec0e0 msgr2=0x5647482eed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:44.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.350+0000 7fd95659c640 1 --2- 172.21.15.123:0/3225332205 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5647482ec0e0 0x5647482eed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.350+0000 7fd95659c640 1 -- 172.21.15.123:0/3225332205 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5647482f00b0 msgr2=0x5647482e91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:44.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.350+0000 7fd95659c640 1 --2- 172.21.15.123:0/3225332205 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5647482f00b0 0x5647482e91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.350+0000 7fd95659c640 1 -- 172.21.15.123:0/3225332205 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56474821f0d0 con 0x5647482ee920 2024-09-15T23:21:44.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.350+0000 7fd95659c640 1 --2- 172.21.15.123:0/3225332205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647482ee920 0x5647483340c0 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7fd950003dd0 tx=0x7fd950014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1632d68c6e7c4289 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:44.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.350+0000 7fd937fff640 1 -- 172.21.15.123:0/3225332205 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd95001b070 con 0x5647482ee920 2024-09-15T23:21:44.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.350+0000 7fd937fff640 1 -- 172.21.15.123:0/3225332205 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd950027070 con 0x5647482ee920 2024-09-15T23:21:44.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.350+0000 7fd937fff640 1 -- 172.21.15.123:0/3225332205 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd950017a50 con 0x5647482ee920 2024-09-15T23:21:44.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.351+0000 7fd95fc77740 1 -- 172.21.15.123:0/3225332205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647482ee920 msgr2=0x5647483340c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.351+0000 7fd95fc77740 1 --2- 172.21.15.123:0/3225332205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647482ee920 0x5647483340c0 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7fd950003dd0 tx=0x7fd950014000 comp rx=0 tx=0).stop 2024-09-15T23:21:44.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.351+0000 7fd95fc77740 1 -- 172.21.15.123:0/3225332205 shutdown_connections 2024-09-15T23:21:44.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.351+0000 7fd95fc77740 1 --2- 172.21.15.123:0/3225332205 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5647482f00b0 0x5647482e91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.351+0000 7fd95fc77740 1 --2- 172.21.15.123:0/3225332205 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5647482ec0e0 0x5647482eed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.351+0000 7fd95fc77740 1 --2- 172.21.15.123:0/3225332205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647482ee920 0x5647483340c0 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.351+0000 7fd95fc77740 1 -- 172.21.15.123:0/3225332205 >> 172.21.15.123:0/3225332205 conn(0x5647482eb370 msgr2=0x564748333590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:44.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.351+0000 7fd95fc77740 1 -- 172.21.15.123:0/3225332205 shutdown_connections 2024-09-15T23:21:44.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.351+0000 7fd95fc77740 1 -- 172.21.15.123:0/3225332205 wait complete. 2024-09-15T23:21:44.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.351+0000 7fd95fc77740 1 -- start start 2024-09-15T23:21:44.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.352+0000 7fd95fc77740 1 Processor -- start 2024-09-15T23:21:44.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.352+0000 7fd95fc77740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5647482ee920 0x56474830d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.352+0000 7fd95fc77740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647482f00b0 0x56474830f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.352+0000 7fd95fc77740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56474830f690 0x5647482ecdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.352+0000 7fd95fc77740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5647482ea810 con 0x5647482f00b0 2024-09-15T23:21:44.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.352+0000 7fd95fc77740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5647481da4f0 con 0x56474830f690 2024-09-15T23:21:44.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.352+0000 7fd95fc77740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5647483348f0 con 0x5647482ee920 2024-09-15T23:21:44.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.353+0000 7fd95fc77740 10 client.0 _ll_register_callbacks cb 0x5647481fbb50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:21:44.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.353+0000 7fd955d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647482f00b0 0x56474830f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.353+0000 7fd955d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647482f00b0 0x56474830f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52356/0 (socket says 172.21.15.123:52356) 2024-09-15T23:21:44.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.353+0000 7fd956d9d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56474830f690 0x5647482ecdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.353+0000 7fd955d9b640 1 -- 172.21.15.123:0/1135623226 learned_addr learned my addr 172.21.15.123:0/1135623226 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:44.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.353+0000 7fd95659c640 1 --2- 172.21.15.123:0/1135623226 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5647482ee920 0x56474830d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.353+0000 7fd955d9b640 1 -- 172.21.15.123:0/1135623226 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5647482ee920 msgr2=0x56474830d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:44.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.353+0000 7fd955d9b640 1 --2- 172.21.15.123:0/1135623226 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5647482ee920 0x56474830d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.353+0000 7fd955d9b640 1 -- 172.21.15.123:0/1135623226 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56474830f690 msgr2=0x5647482ecdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:44.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.353+0000 7fd955d9b640 1 --2- 172.21.15.123:0/1135623226 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56474830f690 0x5647482ecdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.353+0000 7fd955d9b640 1 -- 172.21.15.123:0/1135623226 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56474802e7d0 con 0x5647482f00b0 2024-09-15T23:21:44.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.353+0000 7fd955d9b640 1 --2- 172.21.15.123:0/1135623226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647482f00b0 0x56474830f150 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7fd940058660 tx=0x7fd940000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd7273657425af11 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:44.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.353+0000 7fd9357fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:21:44.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.353+0000 7fd9357fa640 1 -- 172.21.15.123:0/1135623226 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94005f070 con 0x5647482f00b0 2024-09-15T23:21:44.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.353+0000 7fd9357fa640 1 -- 172.21.15.123:0/1135623226 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7fd940070800 con 0x5647482f00b0 2024-09-15T23:21:44.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.353+0000 7fd95fc77740 1 -- 172.21.15.123:0/1135623226 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd950027070 con 0x5647482f00b0 2024-09-15T23:21:44.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.353+0000 7fd9357fa640 1 -- 172.21.15.123:0/1135623226 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7fd940087050 con 0x5647482f00b0 2024-09-15T23:21:44.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.353+0000 7fd95fc77740 10 client.9795 fetch_fsmap learned FSMap version 100 2024-09-15T23:21:44.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.353+0000 7fd95fc77740 1 -- 172.21.15.123:0/1135623226 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x564747f643f0 con 0x5647482f00b0 2024-09-15T23:21:44.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.353+0000 7fd9357fa640 1 -- 172.21.15.123:0/1135623226 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd950027070 con 0x5647482f00b0 2024-09-15T23:21:44.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.354+0000 7fd9357fa640 1 -- 172.21.15.123:0/1135623226 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 100) ==== 3502+0+0 (secure 0 0 0) 0x7fd940054fd0 con 0x5647482f00b0 2024-09-15T23:21:44.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.354+0000 7fd95fc77740 10 client.9795 fetch_fsmap finished waiting for FSMap version 100 2024-09-15T23:21:44.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.354+0000 7fd95fc77740 10 client.9795 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.a 2024-09-15T23:21:44.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.354+0000 7fd95fc77740 20 client.9795 populate_metadata read hostname 'smithi123' 2024-09-15T23:21:44.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.354+0000 7fd95fc77740 1 --2- 172.21.15.123:0/1135623226 >> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] conn(0x56474830dc00 0x56474830dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.354+0000 7fd95fc77740 4 client.9795 mds_command: new command op to 9564 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:21:44.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.354+0000 7fd95fc77740 1 -- 172.21.15.123:0/1135623226 --> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56474825ee20 con 0x56474830dc00 2024-09-15T23:21:44.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.354+0000 7fd95659c640 1 --2- 172.21.15.123:0/1135623226 >> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] conn(0x56474830dc00 0x56474830dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.354+0000 7fd95659c640 1 --2- 172.21.15.123:0/1135623226 >> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] conn(0x56474830dc00 0x56474830dfe0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da95ff63710f2df7 server_cookie=55ea406134a9df69 in_seq=0 out_seq=0 2024-09-15T23:21:44.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.354+0000 7fd9357fa640 10 client.9795 ms_handle_connect on v2:172.21.15.123:6834/1883512279 2024-09-15T23:21:44.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.354+0000 7fd9357fa640 1 -- 172.21.15.123:0/1135623226 <== mds.0 v2:172.21.15.123:6834/1883512279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56474825ee20 con 0x56474830dc00 2024-09-15T23:21:44.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.354+0000 7fd9357fa640 10 client.9795 handle_command_reply: tid=0 2024-09-15T23:21:44.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.355+0000 7fd95fc77740 1 client.9795 shutdown 2024-09-15T23:21:44.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.355+0000 7fd95fc77740 1 -- 172.21.15.123:0/1135623226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647482f00b0 msgr2=0x56474830f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.355+0000 7fd95fc77740 1 --2- 172.21.15.123:0/1135623226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647482f00b0 0x56474830f150 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7fd940058660 tx=0x7fd940000bc0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.355+0000 7fd95fc77740 1 -- 172.21.15.123:0/1135623226 shutdown_connections 2024-09-15T23:21:44.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.355+0000 7fd95fc77740 1 --2- 172.21.15.123:0/1135623226 >> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] conn(0x56474830dc00 0x56474830dfe0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.355+0000 7fd95fc77740 1 --2- 172.21.15.123:0/1135623226 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56474830f690 0x5647482ecdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.355+0000 7fd95fc77740 1 --2- 172.21.15.123:0/1135623226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5647482f00b0 0x56474830f150 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.355+0000 7fd95fc77740 1 --2- 172.21.15.123:0/1135623226 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5647482ee920 0x56474830d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.355+0000 7fd9357fa640 0 client.9795 ms_handle_reset on v2:172.21.15.123:6834/1883512279 2024-09-15T23:21:44.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.355+0000 7fd95fc77740 1 -- 172.21.15.123:0/1135623226 >> 172.21.15.123:0/1135623226 conn(0x5647482ec0e0 msgr2=0x564748331610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:44.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.355+0000 7fd95fc77740 1 -- 172.21.15.123:0/1135623226 shutdown_connections 2024-09-15T23:21:44.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.355+0000 7fd95fc77740 1 -- 172.21.15.123:0/1135623226 wait complete. 2024-09-15T23:21:44.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.355+0000 7fd95fc77740 20 client.9795 trim_cache size 0 max 16384 2024-09-15T23:21:44.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.372+0000 7fd95fc77740 1 Processor -- start 2024-09-15T23:21:44.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.372+0000 7fd95fc77740 1 -- start start 2024-09-15T23:21:44.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.373+0000 7fd95fc77740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5647482ee920 0x564748337390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.373+0000 7fd95fc77740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5647482f00b0 0x564748342ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.373+0000 7fd95fc77740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56474830f690 0x564748357960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.373+0000 7fd95fc77740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd958200c30 con 0x56474830f690 2024-09-15T23:21:44.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.373+0000 7fd95fc77740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd9581617a0 con 0x5647482ee920 2024-09-15T23:21:44.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.373+0000 7fd95fc77740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd9580ce5b0 con 0x5647482f00b0 2024-09-15T23:21:44.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.373+0000 7fd956d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56474830f690 0x564748357960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.373+0000 7fd956d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56474830f690 0x564748357960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52366/0 (socket says 172.21.15.123:52366) 2024-09-15T23:21:44.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.373+0000 7fd956d9d640 1 -- 172.21.15.123:0/3856593793 learned_addr learned my addr 172.21.15.123:0/3856593793 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:44.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.373+0000 7fd95659c640 1 --2- 172.21.15.123:0/3856593793 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5647482ee920 0x564748337390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.373+0000 7fd955d9b640 1 --2- 172.21.15.123:0/3856593793 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5647482f00b0 0x564748342ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.373+0000 7fd956d9d640 1 -- 172.21.15.123:0/3856593793 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5647482f00b0 msgr2=0x564748342ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:44.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.373+0000 7fd956d9d640 1 --2- 172.21.15.123:0/3856593793 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5647482f00b0 0x564748342ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.373+0000 7fd956d9d640 1 -- 172.21.15.123:0/3856593793 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5647482ee920 msgr2=0x564748337390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:44.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.373+0000 7fd956d9d640 1 --2- 172.21.15.123:0/3856593793 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5647482ee920 0x564748337390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.373+0000 7fd956d9d640 1 -- 172.21.15.123:0/3856593793 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56474830cba0 con 0x56474830f690 2024-09-15T23:21:44.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.373+0000 7fd956d9d640 1 --2- 172.21.15.123:0/3856593793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56474830f690 0x564748357960 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7fd9480090b0 tx=0x7fd94802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5019a520472907 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:44.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.373+0000 7fd9377fe640 1 -- 172.21.15.123:0/3856593793 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94804b070 con 0x56474830f690 2024-09-15T23:21:44.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.373+0000 7fd9377fe640 1 -- 172.21.15.123:0/3856593793 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9480327f0 con 0x56474830f690 2024-09-15T23:21:44.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.373+0000 7fd9377fe640 1 -- 172.21.15.123:0/3856593793 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd948037040 con 0x56474830f690 2024-09-15T23:21:44.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.374+0000 7fd95fc77740 1 -- 172.21.15.123:0/3856593793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56474830f690 msgr2=0x564748357960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.374+0000 7fd95fc77740 1 --2- 172.21.15.123:0/3856593793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56474830f690 0x564748357960 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7fd9480090b0 tx=0x7fd94802e000 comp rx=0 tx=0).stop 2024-09-15T23:21:44.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.374+0000 7fd95fc77740 1 -- 172.21.15.123:0/3856593793 shutdown_connections 2024-09-15T23:21:44.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.374+0000 7fd95fc77740 1 --2- 172.21.15.123:0/3856593793 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56474830f690 0x564748357960 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.374+0000 7fd95fc77740 1 --2- 172.21.15.123:0/3856593793 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5647482f00b0 0x564748342ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.374+0000 7fd95fc77740 1 --2- 172.21.15.123:0/3856593793 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5647482ee920 0x564748337390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.374+0000 7fd95fc77740 1 -- 172.21.15.123:0/3856593793 >> 172.21.15.123:0/3856593793 conn(0x5647482ec0e0 msgr2=0x564748331610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:44.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.374+0000 7fd95fc77740 1 -- 172.21.15.123:0/3856593793 shutdown_connections 2024-09-15T23:21:44.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.374+0000 7fd95fc77740 1 -- 172.21.15.123:0/3856593793 wait complete. 2024-09-15T23:21:44.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.374+0000 7fd95fc77740 1 -- start start 2024-09-15T23:21:44.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.374+0000 7fd95fc77740 1 Processor -- start 2024-09-15T23:21:44.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.375+0000 7fd95fc77740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5647482ee920 0x564748394910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.375+0000 7fd95fc77740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5647482f00b0 0x56474830cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.375+0000 7fd95fc77740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56474830f690 0x56474830d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.375+0000 7fd95fc77740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x564748316530 con 0x56474830f690 2024-09-15T23:21:44.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.375+0000 7fd95fc77740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd958161150 con 0x5647482f00b0 2024-09-15T23:21:44.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.375+0000 7fd95fc77740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x564748253b90 con 0x5647482ee920 2024-09-15T23:21:44.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.375+0000 7fd95fc77740 10 client.0 _ll_register_callbacks cb 0x7fd9400582c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:21:44.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.375+0000 7fd956d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56474830f690 0x56474830d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.375+0000 7fd956d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56474830f690 0x56474830d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52380/0 (socket says 172.21.15.123:52380) 2024-09-15T23:21:44.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.375+0000 7fd956d9d640 1 -- 172.21.15.123:0/956586129 learned_addr learned my addr 172.21.15.123:0/956586129 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:44.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.376+0000 7fd95659c640 1 --2- 172.21.15.123:0/956586129 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5647482ee920 0x564748394910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.376+0000 7fd955d9b640 1 --2- 172.21.15.123:0/956586129 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5647482f00b0 0x56474830cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.376+0000 7fd956d9d640 1 -- 172.21.15.123:0/956586129 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5647482ee920 msgr2=0x564748394910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:44.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.376+0000 7fd956d9d640 1 --2- 172.21.15.123:0/956586129 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5647482ee920 0x564748394910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.376+0000 7fd956d9d640 1 -- 172.21.15.123:0/956586129 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5647482f00b0 msgr2=0x56474830cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:44.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.376+0000 7fd956d9d640 1 --2- 172.21.15.123:0/956586129 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5647482f00b0 0x56474830cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.376+0000 7fd956d9d640 1 -- 172.21.15.123:0/956586129 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564747f240f0 con 0x56474830f690 2024-09-15T23:21:44.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.376+0000 7fd956d9d640 1 --2- 172.21.15.123:0/956586129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56474830f690 0x56474830d2d0 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7fd94802a2b0 tx=0x7fd948004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db6e421959b59971 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:44.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.376+0000 7fd9357fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:21:44.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.376+0000 7fd9357fa640 1 -- 172.21.15.123:0/956586129 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd948054060 con 0x56474830f690 2024-09-15T23:21:44.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.376+0000 7fd9357fa640 1 -- 172.21.15.123:0/956586129 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7fd9480329a0 con 0x56474830f690 2024-09-15T23:21:44.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.376+0000 7fd95fc77740 1 -- 172.21.15.123:0/956586129 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9480327f0 con 0x56474830f690 2024-09-15T23:21:44.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.376+0000 7fd9357fa640 1 -- 172.21.15.123:0/956586129 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7fd94804b070 con 0x56474830f690 2024-09-15T23:21:44.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.376+0000 7fd95fc77740 10 client.9801 fetch_fsmap learned FSMap version 100 2024-09-15T23:21:44.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.376+0000 7fd95fc77740 1 -- 172.21.15.123:0/956586129 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x5647483179d0 con 0x56474830f690 2024-09-15T23:21:44.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.376+0000 7fd9357fa640 1 -- 172.21.15.123:0/956586129 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9480327f0 con 0x56474830f690 2024-09-15T23:21:44.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.376+0000 7fd9357fa640 1 -- 172.21.15.123:0/956586129 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 100) ==== 3502+0+0 (secure 0 0 0) 0x7fd948032ba0 con 0x56474830f690 2024-09-15T23:21:44.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.376+0000 7fd95fc77740 10 client.9801 fetch_fsmap finished waiting for FSMap version 100 2024-09-15T23:21:44.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.376+0000 7fd95fc77740 10 client.9801 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.a 2024-09-15T23:21:44.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.376+0000 7fd95fc77740 20 client.9801 populate_metadata read hostname 'smithi123' 2024-09-15T23:21:44.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.376+0000 7fd95fc77740 1 --2- 172.21.15.123:0/956586129 >> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] conn(0x564748318310 0x564748397260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.376+0000 7fd95fc77740 4 client.9801 mds_command: new command op to 9564 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:21:44.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.376+0000 7fd95fc77740 1 -- 172.21.15.123:0/956586129 --> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564748259170 con 0x564748318310 2024-09-15T23:21:44.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.377+0000 7fd95659c640 1 --2- 172.21.15.123:0/956586129 >> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] conn(0x564748318310 0x564748397260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.377+0000 7fd9357fa640 10 client.9801 ms_handle_connect on v2:172.21.15.123:6834/1883512279 2024-09-15T23:21:44.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.377+0000 7fd95659c640 1 --2- 172.21.15.123:0/956586129 >> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] conn(0x564748318310 0x564748397260 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ed398ea306b9b27 server_cookie=edee78e5ced2b99 in_seq=0 out_seq=0 2024-09-15T23:21:44.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.377+0000 7fd9357fa640 1 -- 172.21.15.123:0/956586129 <== mds.0 v2:172.21.15.123:6834/1883512279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+276 (crc 0 0 0) 0x564748259170 con 0x564748318310 2024-09-15T23:21:44.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.377+0000 7fd9357fa640 10 client.9801 handle_command_reply: tid=0 2024-09-15T23:21:44.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.377+0000 7fd95fc77740 1 client.9801 shutdown 2024-09-15T23:21:44.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.377+0000 7fd95fc77740 1 -- 172.21.15.123:0/956586129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56474830f690 msgr2=0x56474830d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.377+0000 7fd95fc77740 1 --2- 172.21.15.123:0/956586129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56474830f690 0x56474830d2d0 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7fd94802a2b0 tx=0x7fd948004730 comp rx=0 tx=0).stop 2024-09-15T23:21:44.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.377+0000 7fd95fc77740 1 -- 172.21.15.123:0/956586129 shutdown_connections 2024-09-15T23:21:44.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.377+0000 7fd95fc77740 1 --2- 172.21.15.123:0/956586129 >> [v2:172.21.15.123:6834/1883512279,v1:172.21.15.123:6835/1883512279] conn(0x564748318310 0x564748397260 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.377+0000 7fd95fc77740 1 --2- 172.21.15.123:0/956586129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56474830f690 0x56474830d2d0 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.377+0000 7fd9357fa640 0 client.9801 ms_handle_reset on v2:172.21.15.123:6834/1883512279 2024-09-15T23:21:44.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.377+0000 7fd95fc77740 1 --2- 172.21.15.123:0/956586129 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5647482f00b0 0x56474830cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.377+0000 7fd95fc77740 1 --2- 172.21.15.123:0/956586129 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5647482ee920 0x564748394910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.377+0000 7fd95fc77740 1 -- 172.21.15.123:0/956586129 >> 172.21.15.123:0/956586129 conn(0x5647482ec0e0 msgr2=0x5647483154e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:44.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.377+0000 7fd95fc77740 1 -- 172.21.15.123:0/956586129 shutdown_connections 2024-09-15T23:21:44.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.377+0000 7fd95fc77740 1 -- 172.21.15.123:0/956586129 wait complete. 2024-09-15T23:21:44.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.377+0000 7fd95fc77740 20 client.9801 trim_cache size 0 max 16384 2024-09-15T23:21:44.385 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:21:44.385 INFO:teuthology.orchestra.run.smithi123.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-15T23:21:44.385 INFO:teuthology.orchestra.run.smithi123.stdout: "scrubs": { 2024-09-15T23:21:44.386 INFO:teuthology.orchestra.run.smithi123.stdout: "9386dae5-82b2-43a4-9514-db920ffe924b": { 2024-09-15T23:21:44.386 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/scrub_control_test_path", 2024-09-15T23:21:44.386 INFO:teuthology.orchestra.run.smithi123.stdout: "tag": "9386dae5-82b2-43a4-9514-db920ffe924b", 2024-09-15T23:21:44.386 INFO:teuthology.orchestra.run.smithi123.stdout: "options": "recursive" 2024-09-15T23:21:44.386 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:21:44.386 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:21:44.386 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:21:44.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.378+0000 7fd95cee6640 1 -- 172.21.15.123:0/3964049896 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd93806c2b0 msgr2=0x7fd93806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.378+0000 7fd95cee6640 1 --2- 172.21.15.123:0/3964049896 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd93806c2b0 0x7fd93806e770 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fd9500113e0 tx=0x7fd95000b040 comp rx=0 tx=0).stop 2024-09-15T23:21:44.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.378+0000 7fd95cee6640 1 -- 172.21.15.123:0/3964049896 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd958162c80 msgr2=0x7fd958158200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.378+0000 7fd95cee6640 1 --2- 172.21.15.123:0/3964049896 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd958162c80 0x7fd958158200 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7fd94000c3c0 tx=0x7fd94000c880 comp rx=0 tx=0).stop 2024-09-15T23:21:44.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.378+0000 7fd95cee6640 1 -- 172.21.15.123:0/3964049896 shutdown_connections 2024-09-15T23:21:44.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.378+0000 7fd95cee6640 1 --2- 172.21.15.123:0/3964049896 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd958158740 0x7fd958155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.378+0000 7fd95cee6640 1 --2- 172.21.15.123:0/3964049896 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd93806c2b0 0x7fd93806e770 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.378+0000 7fd95cee6640 1 --2- 172.21.15.123:0/3964049896 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd958162c80 0x7fd958158200 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.378+0000 7fd95cee6640 1 --2- 172.21.15.123:0/3964049896 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd9580afb20 0x7fd958162250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.378+0000 7fd95cee6640 1 -- 172.21.15.123:0/3964049896 >> 172.21.15.123:0/3964049896 conn(0x7fd95806db30 msgr2=0x7fd9580b46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:44.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.378+0000 7fd95cee6640 1 -- 172.21.15.123:0/3964049896 shutdown_connections 2024-09-15T23:21:44.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.378+0000 7fd95cee6640 1 -- 172.21.15.123:0/3964049896 wait complete. 2024-09-15T23:21:44.389 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:21:44.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.487+0000 7f2dfe4f1640 1 Processor -- start 2024-09-15T23:21:44.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.487+0000 7f2dfe4f1640 1 -- start start 2024-09-15T23:21:44.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.488+0000 7f2dfe4f1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2df8162c60 0x7f2df8073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.488+0000 7f2dfe4f1640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2df806f730 0x7f2df806fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.488+0000 7f2dfe4f1640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2df81631c0 con 0x7f2df815e790 2024-09-15T23:21:44.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.488+0000 7f2dfe4f1640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f2df815eb70 con 0x7f2df806f730 2024-09-15T23:21:44.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.488+0000 7f2dfe4f1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f2df80ae9a0 con 0x7f2df8162c60 2024-09-15T23:21:44.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.488+0000 7f2dfca8e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2df806f730 0x7f2df806fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.488+0000 7f2df7fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f2df815e790 0x7f2df80b5430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53270/0 (socket says 172.21.15.123:53270) 2024-09-15T23:21:44.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.488+0000 7f2dfca8e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2df806f730 0x7f2df806fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52392/0 (socket says 172.21.15.123:52392) 2024-09-15T23:21:44.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.488+0000 7f2df7fff640 1 -- 172.21.15.123:0/3761100766 learned_addr learned my addr 172.21.15.123:0/3761100766 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:21:44.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.488+0000 7f2df77fe640 1 --2- 172.21.15.123:0/3761100766 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2df8162c60 0x7f2df8073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.489+0000 7f2dfca8e640 1 -- 172.21.15.123:0/3761100766 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2df8162c60 msgr2=0x7f2df8073a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:44.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.489+0000 7f2dfca8e640 1 --2- 172.21.15.123:0/3761100766 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2df8162c60 0x7f2df8073a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.489+0000 7f2dfca8e640 1 -- 172.21.15.123:0/3761100766 >> v1:172.21.15.123:6789/0 conn(0x7f2df815e790 legacy=0x7f2df80b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.489+0000 7f2dfca8e640 1 -- 172.21.15.123:0/3761100766 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2df80aec40 con 0x7f2df806f730 2024-09-15T23:21:44.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.489+0000 7f2df6ffd640 1 -- 172.21.15.123:0/3761100766 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2572236344 0 0) 0x7f2df81631c0 con 0x7f2df815e790 2024-09-15T23:21:44.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.489+0000 7f2dfca8e640 1 --2- 172.21.15.123:0/3761100766 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2df806f730 0x7f2df806fbe0 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f2df0009d90 tx=0x7f2df002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e843392809b1bdf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:44.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.489+0000 7f2df6ffd640 1 -- 172.21.15.123:0/3761100766 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df0031600 con 0x7f2df806f730 2024-09-15T23:21:44.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.490+0000 7f2df6ffd640 1 -- 172.21.15.123:0/3761100766 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2df00317a0 con 0x7f2df806f730 2024-09-15T23:21:44.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.490+0000 7f2df6ffd640 1 -- 172.21.15.123:0/3761100766 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df0031b70 con 0x7f2df806f730 2024-09-15T23:21:44.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.490+0000 7f2dfe4f1640 1 -- 172.21.15.123:0/3761100766 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2df806f730 msgr2=0x7f2df806fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.490+0000 7f2dfe4f1640 1 --2- 172.21.15.123:0/3761100766 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2df806f730 0x7f2df806fbe0 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f2df0009d90 tx=0x7f2df002a5d0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.490+0000 7f2dfe4f1640 1 -- 172.21.15.123:0/3761100766 shutdown_connections 2024-09-15T23:21:44.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.490+0000 7f2dfe4f1640 1 --2- 172.21.15.123:0/3761100766 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2df806f730 0x7f2df806fbe0 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.490+0000 7f2dfe4f1640 1 --2- 172.21.15.123:0/3761100766 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2df8162c60 0x7f2df8073a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.490+0000 7f2dfe4f1640 1 -- 172.21.15.123:0/3761100766 >> 172.21.15.123:0/3761100766 conn(0x7f2df80b0a80 msgr2=0x7f2df80b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:44.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.490+0000 7f2dfe4f1640 1 -- 172.21.15.123:0/3761100766 shutdown_connections 2024-09-15T23:21:44.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.490+0000 7f2dfe4f1640 1 -- 172.21.15.123:0/3761100766 wait complete. 2024-09-15T23:21:44.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.491+0000 7f2dfe4f1640 1 Processor -- start 2024-09-15T23:21:44.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.491+0000 7f2dfe4f1640 1 -- start start 2024-09-15T23:21:44.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.492+0000 7f2dfe4f1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2df806f730 0x7f2df8148730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.492+0000 7f2dfe4f1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2df815e790 0x7f2df8160710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.492+0000 7f2dfe4f1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2df8162c60 0x7f2df80cfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.492+0000 7f2dfe4f1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2df80b5b40 con 0x7f2df806f730 2024-09-15T23:21:44.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.492+0000 7f2dfe4f1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2df80af200 con 0x7f2df815e790 2024-09-15T23:21:44.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.492+0000 7f2dfe4f1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f2df806f430 con 0x7f2df8162c60 2024-09-15T23:21:44.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.492+0000 7f2df7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2df806f730 0x7f2df8148730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.492+0000 7f2df7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2df806f730 0x7f2df8148730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52394/0 (socket says 172.21.15.123:52394) 2024-09-15T23:21:44.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.492+0000 7f2df7fff640 1 -- 172.21.15.123:0/724575308 learned_addr learned my addr 172.21.15.123:0/724575308 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:44.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.492+0000 7f2df77fe640 1 --2- 172.21.15.123:0/724575308 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2df815e790 0x7f2df8160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.492+0000 7f2dfca8e640 1 --2- 172.21.15.123:0/724575308 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2df8162c60 0x7f2df80cfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.492+0000 7f2df7fff640 1 -- 172.21.15.123:0/724575308 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2df8162c60 msgr2=0x7f2df80cfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.492+0000 7f2df7fff640 1 --2- 172.21.15.123:0/724575308 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2df8162c60 0x7f2df80cfbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.492+0000 7f2df7fff640 1 -- 172.21.15.123:0/724575308 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2df815e790 msgr2=0x7f2df8160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.493+0000 7f2df7fff640 1 --2- 172.21.15.123:0/724575308 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2df815e790 0x7f2df8160710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.493+0000 7f2df7fff640 1 -- 172.21.15.123:0/724575308 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2df8160c50 con 0x7f2df806f730 2024-09-15T23:21:44.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.493+0000 7f2df77fe640 1 --2- 172.21.15.123:0/724575308 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2df815e790 0x7f2df8160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:21:44.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.493+0000 7f2df7fff640 1 --2- 172.21.15.123:0/724575308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2df806f730 0x7f2df8148730 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f2de800c4d0 tx=0x7f2de800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:44.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.493+0000 7f2df4ff9640 1 -- 172.21.15.123:0/724575308 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de8018070 con 0x7f2df806f730 2024-09-15T23:21:44.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.493+0000 7f2df4ff9640 1 -- 172.21.15.123:0/724575308 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2de8007500 con 0x7f2df806f730 2024-09-15T23:21:44.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.493+0000 7f2df4ff9640 1 -- 172.21.15.123:0/724575308 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de8004a20 con 0x7f2df806f730 2024-09-15T23:21:44.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.493+0000 7f2dfe4f1640 1 -- 172.21.15.123:0/724575308 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2df80cd5c0 con 0x7f2df806f730 2024-09-15T23:21:44.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.493+0000 7f2dfe4f1640 1 -- 172.21.15.123:0/724575308 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2df81611b0 con 0x7f2df806f730 2024-09-15T23:21:44.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.494+0000 7f2dfe4f1640 1 -- 172.21.15.123:0/724575308 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2df8073a40 con 0x7f2df806f730 2024-09-15T23:21:44.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.494+0000 7f2df4ff9640 1 -- 172.21.15.123:0/724575308 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2de801b070 con 0x7f2df806f730 2024-09-15T23:21:44.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.495+0000 7f2df4ff9640 1 --2- 172.21.15.123:0/724575308 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2de406c2e0 0x7f2de406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.495+0000 7f2df4ff9640 1 -- 172.21.15.123:0/724575308 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7f2de808a6b0 con 0x7f2df806f730 2024-09-15T23:21:44.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.495+0000 7f2df77fe640 1 --2- 172.21.15.123:0/724575308 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2de406c2e0 0x7f2de406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.495+0000 7f2df77fe640 1 --2- 172.21.15.123:0/724575308 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2de406c2e0 0x7f2de406e7a0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f2df8161a90 tx=0x7f2dec008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:44.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.499+0000 7f2df4ff9640 1 -- 172.21.15.123:0/724575308 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2df8160c50 con 0x7f2df806f730 2024-09-15T23:21:44.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.698+0000 7f2dfe4f1640 1 -- 172.21.15.123:0/724575308 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2df80b15c0 con 0x7f2df806f730 2024-09-15T23:21:44.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.699+0000 7f2df4ff9640 1 -- 172.21.15.123:0/724575308 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) ==== 95+0+5241 (secure 0 0 0) 0x7f2de8058eb0 con 0x7f2df806f730 2024-09-15T23:21:44.700 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:44.700 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":100,"btime":"2024-09-15T23:21:24:727971+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7214,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/1648353391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1648353391},{"type":"v1","addr":"172.21.15.188:6837","nonce":1648353391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8122,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/1714717257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":1714717257},{"type":"v1","addr":"172.21.15.188:6836","nonce":1714717257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":9552,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/3722702026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3722702026},{"type":"v1","addr":"172.21.15.123:6833","nonce":3722702026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:21:22.066391+0000","modified":"2024-09-15T23:21:24.056941+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9564},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9564":{"gid":9564,"name":"a","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/1883512279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1883512279},{"type":"v1","addr":"172.21.15.123:6835","nonce":1883512279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9564,"qdb_cluster":[9564]},"id":11}]} 2024-09-15T23:21:44.700 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 100 2024-09-15T23:21:44.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.701+0000 7f2dfe4f1640 1 -- 172.21.15.123:0/724575308 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2de406c2e0 msgr2=0x7f2de406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.701+0000 7f2dfe4f1640 1 --2- 172.21.15.123:0/724575308 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2de406c2e0 0x7f2de406e7a0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f2df8161a90 tx=0x7f2dec008040 comp rx=0 tx=0).stop 2024-09-15T23:21:44.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.701+0000 7f2dfe4f1640 1 -- 172.21.15.123:0/724575308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2df806f730 msgr2=0x7f2df8148730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.701+0000 7f2dfe4f1640 1 --2- 172.21.15.123:0/724575308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2df806f730 0x7f2df8148730 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f2de800c4d0 tx=0x7f2de800c990 comp rx=0 tx=0).stop 2024-09-15T23:21:44.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.701+0000 7f2dfe4f1640 1 -- 172.21.15.123:0/724575308 shutdown_connections 2024-09-15T23:21:44.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.701+0000 7f2dfe4f1640 1 --2- 172.21.15.123:0/724575308 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2df8162c60 0x7f2df80cfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.701+0000 7f2dfe4f1640 1 --2- 172.21.15.123:0/724575308 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2df815e790 0x7f2df8160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.701+0000 7f2dfe4f1640 1 --2- 172.21.15.123:0/724575308 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2de406c2e0 0x7f2de406e7a0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.701+0000 7f2dfe4f1640 1 --2- 172.21.15.123:0/724575308 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2df806f730 0x7f2df8148730 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.701+0000 7f2dfe4f1640 1 -- 172.21.15.123:0/724575308 >> 172.21.15.123:0/724575308 conn(0x7f2df80b0a80 msgr2=0x7f2df806fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:44.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.701+0000 7f2dfe4f1640 1 -- 172.21.15.123:0/724575308 shutdown_connections 2024-09-15T23:21:44.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.701+0000 7f2dfe4f1640 1 -- 172.21.15.123:0/724575308 wait complete. 2024-09-15T23:21:44.712 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-15T23:21:44.713 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:21:44.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.809+0000 7f7089131640 1 Processor -- start 2024-09-15T23:21:44.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.809+0000 7f7089131640 1 -- start start 2024-09-15T23:21:44.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.810+0000 7f7089131640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f708406c320 0x7f708415bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.810+0000 7f7089131640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f708413eb20 0x7f708415c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.810+0000 7f7089131640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7084071180 con 0x7f70840b2d40 2024-09-15T23:21:44.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.810+0000 7f7089131640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f7084071ab0 con 0x7f708413eb20 2024-09-15T23:21:44.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.810+0000 7f7089131640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7084071460 con 0x7f708406c320 2024-09-15T23:21:44.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.810+0000 7f708359e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f708413eb20 0x7f708415c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.810+0000 7f708359e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f708413eb20 0x7f708415c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52400/0 (socket says 172.21.15.123:52400) 2024-09-15T23:21:44.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.810+0000 7f708359e640 1 -- 172.21.15.123:0/259804645 learned_addr learned my addr 172.21.15.123:0/259804645 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:44.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.811+0000 7f708259c640 1 --2- 172.21.15.123:0/259804645 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f708406c320 0x7f708415bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.811+0000 7f708359e640 1 -- 172.21.15.123:0/259804645 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f708406c320 msgr2=0x7f708415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:44.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.811+0000 7f708359e640 1 --2- 172.21.15.123:0/259804645 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f708406c320 0x7f708415bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.811+0000 7f708359e640 1 -- 172.21.15.123:0/259804645 >> v1:172.21.15.188:6789/0 conn(0x7f70840b2d40 legacy=0x7f708406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.811+0000 7f708359e640 1 -- 172.21.15.123:0/259804645 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7084071740 con 0x7f708413eb20 2024-09-15T23:21:44.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.811+0000 7f708259c640 1 --2- 172.21.15.123:0/259804645 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f708406c320 0x7f708415bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:21:44.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.811+0000 7f708359e640 1 --2- 172.21.15.123:0/259804645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f708413eb20 0x7f708415c230 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7f707400bb10 tx=0x7f707402c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ba55e775d40e79 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:44.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.812+0000 7f7081d9b640 1 -- 172.21.15.123:0/259804645 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7074036020 con 0x7f708413eb20 2024-09-15T23:21:44.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.812+0000 7f7081d9b640 1 -- 172.21.15.123:0/259804645 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7074032820 con 0x7f708413eb20 2024-09-15T23:21:44.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.812+0000 7f7081d9b640 1 -- 172.21.15.123:0/259804645 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7074032bf0 con 0x7f708413eb20 2024-09-15T23:21:44.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.812+0000 7f7089131640 1 -- 172.21.15.123:0/259804645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f708413eb20 msgr2=0x7f708415c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.812+0000 7f7089131640 1 --2- 172.21.15.123:0/259804645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f708413eb20 0x7f708415c230 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7f707400bb10 tx=0x7f707402c920 comp rx=0 tx=0).stop 2024-09-15T23:21:44.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.812+0000 7f7089131640 1 -- 172.21.15.123:0/259804645 shutdown_connections 2024-09-15T23:21:44.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.812+0000 7f7089131640 1 --2- 172.21.15.123:0/259804645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f708413eb20 0x7f708415c230 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.812+0000 7f7089131640 1 --2- 172.21.15.123:0/259804645 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f708406c320 0x7f708415bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.812+0000 7f7089131640 1 -- 172.21.15.123:0/259804645 >> 172.21.15.123:0/259804645 conn(0x7f70840ccec0 msgr2=0x7f70840cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:44.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.812+0000 7f7089131640 1 -- 172.21.15.123:0/259804645 shutdown_connections 2024-09-15T23:21:44.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.812+0000 7f7089131640 1 -- 172.21.15.123:0/259804645 wait complete. 2024-09-15T23:21:44.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.814+0000 7f7089131640 1 Processor -- start 2024-09-15T23:21:44.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.814+0000 7f7089131640 1 -- start start 2024-09-15T23:21:44.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.814+0000 7f7089131640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f708406c320 0x7f70840cc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.814+0000 7f7089131640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f70840b2d40 0x7f708413df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.814+0000 7f7089131640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f708413eb20 0x7f708415b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.814+0000 7f7089131640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f70840720c0 con 0x7f708413eb20 2024-09-15T23:21:44.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.814+0000 7f7089131640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7084071f40 con 0x7f70840b2d40 2024-09-15T23:21:44.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.814+0000 7f7089131640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7084072240 con 0x7f708406c320 2024-09-15T23:21:44.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.814+0000 7f708359e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f708413eb20 0x7f708415b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.814+0000 7f708359e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f708413eb20 0x7f708415b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52412/0 (socket says 172.21.15.123:52412) 2024-09-15T23:21:44.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.814+0000 7f708359e640 1 -- 172.21.15.123:0/1963909706 learned_addr learned my addr 172.21.15.123:0/1963909706 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:44.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.815+0000 7f708259c640 1 --2- 172.21.15.123:0/1963909706 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f70840b2d40 0x7f708413df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.814+0000 7f7082d9d640 1 --2- 172.21.15.123:0/1963909706 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f708406c320 0x7f70840cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.815+0000 7f708359e640 1 -- 172.21.15.123:0/1963909706 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f708406c320 msgr2=0x7f70840cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.815+0000 7f708359e640 1 --2- 172.21.15.123:0/1963909706 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f708406c320 0x7f70840cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.815+0000 7f708359e640 1 -- 172.21.15.123:0/1963909706 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f70840b2d40 msgr2=0x7f708413df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:44.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.815+0000 7f708359e640 1 --2- 172.21.15.123:0/1963909706 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f70840b2d40 0x7f708413df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:44.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.815+0000 7f708359e640 1 -- 172.21.15.123:0/1963909706 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7084159a60 con 0x7f708413eb20 2024-09-15T23:21:44.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.815+0000 7f708359e640 1 --2- 172.21.15.123:0/1963909706 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f708413eb20 0x7f708415b7e0 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f707400b2c0 tx=0x7f70740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:44.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.815+0000 7f706b7fe640 1 -- 172.21.15.123:0/1963909706 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7074036040 con 0x7f708413eb20 2024-09-15T23:21:44.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.815+0000 7f706b7fe640 1 -- 172.21.15.123:0/1963909706 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f707403bd60 con 0x7f708413eb20 2024-09-15T23:21:44.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.815+0000 7f7089131640 1 -- 172.21.15.123:0/1963909706 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7084159d40 con 0x7f708413eb20 2024-09-15T23:21:44.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.815+0000 7f706b7fe640 1 -- 172.21.15.123:0/1963909706 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7074045630 con 0x7f708413eb20 2024-09-15T23:21:44.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.815+0000 7f7089131640 1 -- 172.21.15.123:0/1963909706 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70840b3f50 con 0x7f708413eb20 2024-09-15T23:21:44.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.816+0000 7f7089131640 1 -- 172.21.15.123:0/1963909706 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f708406bc10 con 0x7f708413eb20 2024-09-15T23:21:44.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.816+0000 7f706b7fe640 1 -- 172.21.15.123:0/1963909706 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f707404c060 con 0x7f708413eb20 2024-09-15T23:21:44.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.817+0000 7f706b7fe640 1 --2- 172.21.15.123:0/1963909706 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f707006c2b0 0x7f707006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:44.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.817+0000 7f706b7fe640 1 -- 172.21.15.123:0/1963909706 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7f70740ae360 con 0x7f708413eb20 2024-09-15T23:21:44.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.817+0000 7f7082d9d640 1 --2- 172.21.15.123:0/1963909706 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f707006c2b0 0x7f707006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:44.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.817+0000 7f7082d9d640 1 --2- 172.21.15.123:0/1963909706 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f707006c2b0 0x7f707006e770 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f707c001780 tx=0x7f707c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:44.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:44.821+0000 7f706b7fe640 1 -- 172.21.15.123:0/1963909706 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7074040070 con 0x7f708413eb20 2024-09-15T23:21:45.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:45.050+0000 7f7089131640 1 -- 172.21.15.123:0/1963909706 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f708406c9c0 con 0x7f708413eb20 2024-09-15T23:21:45.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:45.050+0000 7f706b7fe640 1 -- 172.21.15.123:0/1963909706 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1618 (secure 0 0 0) 0x7f707402f070 con 0x7f708413eb20 2024-09-15T23:21:45.051 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:45.051 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":595,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":168,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":890,"data_bytes":910797272,"bytes_used":2159624192,"bytes_avail":770934489088,"bytes_total":773094113280,"write_bytes_sec":75841248,"read_op_per_sec":0,"write_op_per_sec":74},"fsmap":{"epoch":100,"btime":"2024-09-15T23:21:24:727971+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"a","status":"up:active","gid":9564}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-09-15T23:21:01.629595+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T23:21:45.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:45.052+0000 7f7089131640 1 -- 172.21.15.123:0/1963909706 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f707006c2b0 msgr2=0x7f707006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:45.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:45.052+0000 7f7089131640 1 --2- 172.21.15.123:0/1963909706 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f707006c2b0 0x7f707006e770 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f707c001780 tx=0x7f707c009040 comp rx=0 tx=0).stop 2024-09-15T23:21:45.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:45.052+0000 7f7089131640 1 -- 172.21.15.123:0/1963909706 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f708413eb20 msgr2=0x7f708415b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:45.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:45.052+0000 7f7089131640 1 --2- 172.21.15.123:0/1963909706 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f708413eb20 0x7f708415b7e0 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f707400b2c0 tx=0x7f70740046c0 comp rx=0 tx=0).stop 2024-09-15T23:21:45.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:45.052+0000 7f7089131640 1 -- 172.21.15.123:0/1963909706 shutdown_connections 2024-09-15T23:21:45.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:45.052+0000 7f7089131640 1 --2- 172.21.15.123:0/1963909706 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f707006c2b0 0x7f707006e770 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:45.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:45.052+0000 7f7089131640 1 --2- 172.21.15.123:0/1963909706 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f708413eb20 0x7f708415b7e0 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:45.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:45.052+0000 7f7089131640 1 --2- 172.21.15.123:0/1963909706 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f70840b2d40 0x7f708413df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:45.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:45.052+0000 7f7089131640 1 --2- 172.21.15.123:0/1963909706 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f708406c320 0x7f70840cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:45.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:45.052+0000 7f7089131640 1 -- 172.21.15.123:0/1963909706 >> 172.21.15.123:0/1963909706 conn(0x7f70840ccec0 msgr2=0x7f70841e4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:45.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:45.052+0000 7f7089131640 1 -- 172.21.15.123:0/1963909706 shutdown_connections 2024-09-15T23:21:45.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:45.052+0000 7f7089131640 1 -- 172.21.15.123:0/1963909706 wait complete. 2024-09-15T23:21:45.064 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-15T23:21:46.065 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:21:46.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.174+0000 7f8d5c36d640 1 Processor -- start 2024-09-15T23:21:46.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.174+0000 7f8d5c36d640 1 -- start start 2024-09-15T23:21:46.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.175+0000 7f8d5c36d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f8d5415c4b0 0x7f8d540b6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:46.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.175+0000 7f8d5c36d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8d540b02b0 0x7f8d540b6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:46.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.175+0000 7f8d5c36d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d54067b50 con 0x7f8d540d08e0 2024-09-15T23:21:46.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.175+0000 7f8d5c36d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f8d540ce860 con 0x7f8d540b02b0 2024-09-15T23:21:46.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.175+0000 7f8d5c36d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f8d54070130 con 0x7f8d5415c4b0 2024-09-15T23:21:46.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.175+0000 7f8d59908640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8d540b02b0 0x7f8d540b6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:46.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.175+0000 7f8d5a90a640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8d540d08e0 0x7f8d54160120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53274/0 (socket says 172.21.15.123:53274) 2024-09-15T23:21:46.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.175+0000 7f8d5a90a640 1 -- 172.21.15.123:0/3332162477 learned_addr learned my addr 172.21.15.123:0/3332162477 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:21:46.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.176+0000 7f8d5a109640 1 --2- 172.21.15.123:0/3332162477 >> v2:172.21.15.188:3300/0 conn(0x7f8d5415c4b0 0x7f8d540b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:46.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.176+0000 7f8d59908640 1 -- 172.21.15.123:0/3332162477 >> v2:172.21.15.188:3300/0 conn(0x7f8d5415c4b0 msgr2=0x7f8d540b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:46.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.176+0000 7f8d59908640 1 --2- 172.21.15.123:0/3332162477 >> v2:172.21.15.188:3300/0 conn(0x7f8d5415c4b0 0x7f8d540b6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:46.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.176+0000 7f8d59908640 1 -- 172.21.15.123:0/3332162477 >> v1:172.21.15.123:6789/0 conn(0x7f8d540d08e0 legacy=0x7f8d54160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:46.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.176+0000 7f8d59908640 1 -- 172.21.15.123:0/3332162477 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d5406fe50 con 0x7f8d540b02b0 2024-09-15T23:21:46.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.176+0000 7f8d59908640 1 --2- 172.21.15.123:0/3332162477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d540b02b0 0x7f8d540b6660 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7f8d54069d90 tx=0x7f8d4802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46519661138a69c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:46.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.177+0000 7f8d59107640 1 -- 172.21.15.123:0/3332162477 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d48037070 con 0x7f8d540b02b0 2024-09-15T23:21:46.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.177+0000 7f8d59107640 1 -- 172.21.15.123:0/3332162477 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d48032440 con 0x7f8d540b02b0 2024-09-15T23:21:46.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.177+0000 7f8d59107640 1 -- 172.21.15.123:0/3332162477 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d48032810 con 0x7f8d540b02b0 2024-09-15T23:21:46.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.177+0000 7f8d5c36d640 1 -- 172.21.15.123:0/3332162477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d540b02b0 msgr2=0x7f8d540b6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:46.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.177+0000 7f8d5c36d640 1 --2- 172.21.15.123:0/3332162477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d540b02b0 0x7f8d540b6660 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7f8d54069d90 tx=0x7f8d4802a1a0 comp rx=0 tx=0).stop 2024-09-15T23:21:46.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.177+0000 7f8d5c36d640 1 -- 172.21.15.123:0/3332162477 shutdown_connections 2024-09-15T23:21:46.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.177+0000 7f8d5c36d640 1 --2- 172.21.15.123:0/3332162477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d540b02b0 0x7f8d540b6660 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:46.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.177+0000 7f8d5c36d640 1 --2- 172.21.15.123:0/3332162477 >> v2:172.21.15.188:3300/0 conn(0x7f8d5415c4b0 0x7f8d540b6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:46.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.177+0000 7f8d5c36d640 1 -- 172.21.15.123:0/3332162477 >> 172.21.15.123:0/3332162477 conn(0x7f8d540b0a80 msgr2=0x7f8d540b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:46.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.177+0000 7f8d5c36d640 1 -- 172.21.15.123:0/3332162477 shutdown_connections 2024-09-15T23:21:46.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.177+0000 7f8d5c36d640 1 -- 172.21.15.123:0/3332162477 wait complete. 2024-09-15T23:21:46.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.179+0000 7f8d5c36d640 1 Processor -- start 2024-09-15T23:21:46.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.179+0000 7f8d5c36d640 1 -- start start 2024-09-15T23:21:46.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.179+0000 7f8d5c36d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d540b02b0 0x7f8d54150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:46.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.179+0000 7f8d5c36d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8d540d08e0 0x7f8d540b4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:46.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.179+0000 7f8d5c36d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8d5415c4b0 0x7f8d540ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:46.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.179+0000 7f8d5c36d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5406dcc0 con 0x7f8d540b02b0 2024-09-15T23:21:46.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.179+0000 7f8d5c36d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8d540ce580 con 0x7f8d5415c4b0 2024-09-15T23:21:46.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.179+0000 7f8d5c36d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8d5415c890 con 0x7f8d540d08e0 2024-09-15T23:21:46.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.179+0000 7f8d5a109640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d540b02b0 0x7f8d54150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:46.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.179+0000 7f8d5a109640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d540b02b0 0x7f8d54150ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52434/0 (socket says 172.21.15.123:52434) 2024-09-15T23:21:46.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.179+0000 7f8d5a109640 1 -- 172.21.15.123:0/1038806083 learned_addr learned my addr 172.21.15.123:0/1038806083 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:46.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.180+0000 7f8d5a90a640 1 --2- 172.21.15.123:0/1038806083 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8d5415c4b0 0x7f8d540ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:46.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.180+0000 7f8d59908640 1 --2- 172.21.15.123:0/1038806083 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8d540d08e0 0x7f8d540b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:46.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.180+0000 7f8d5a109640 1 -- 172.21.15.123:0/1038806083 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8d540d08e0 msgr2=0x7f8d540b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:46.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.180+0000 7f8d5a109640 1 --2- 172.21.15.123:0/1038806083 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8d540d08e0 0x7f8d540b4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:46.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.180+0000 7f8d5a109640 1 -- 172.21.15.123:0/1038806083 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8d5415c4b0 msgr2=0x7f8d540ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:46.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.180+0000 7f8d5a109640 1 --2- 172.21.15.123:0/1038806083 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8d5415c4b0 0x7f8d540ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:46.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.180+0000 7f8d5a109640 1 -- 172.21.15.123:0/1038806083 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d540b50a0 con 0x7f8d540b02b0 2024-09-15T23:21:46.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.180+0000 7f8d5a90a640 1 --2- 172.21.15.123:0/1038806083 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8d5415c4b0 0x7f8d540ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:21:46.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.180+0000 7f8d5a109640 1 --2- 172.21.15.123:0/1038806083 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d540b02b0 0x7f8d54150ad0 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f8d44007e70 tx=0x7f8d4400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:46.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.180+0000 7f8d52ffd640 1 -- 172.21.15.123:0/1038806083 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d44014620 con 0x7f8d540b02b0 2024-09-15T23:21:46.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.180+0000 7f8d52ffd640 1 -- 172.21.15.123:0/1038806083 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d44019070 con 0x7f8d540b02b0 2024-09-15T23:21:46.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.180+0000 7f8d52ffd640 1 -- 172.21.15.123:0/1038806083 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d44014a00 con 0x7f8d540b02b0 2024-09-15T23:21:46.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.180+0000 7f8d5c36d640 1 -- 172.21.15.123:0/1038806083 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d540b5380 con 0x7f8d540b02b0 2024-09-15T23:21:46.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.180+0000 7f8d5c36d640 1 -- 172.21.15.123:0/1038806083 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d540b5940 con 0x7f8d540b02b0 2024-09-15T23:21:46.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.181+0000 7f8d5c36d640 1 -- 172.21.15.123:0/1038806083 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d540b6120 con 0x7f8d540b02b0 2024-09-15T23:21:46.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.182+0000 7f8d52ffd640 1 -- 172.21.15.123:0/1038806083 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8d44014ba0 con 0x7f8d540b02b0 2024-09-15T23:21:46.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.182+0000 7f8d52ffd640 1 --2- 172.21.15.123:0/1038806083 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8d4006c2b0 0x7f8d4006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:46.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.182+0000 7f8d52ffd640 1 -- 172.21.15.123:0/1038806083 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7f8d4408bce0 con 0x7f8d540b02b0 2024-09-15T23:21:46.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.182+0000 7f8d59908640 1 --2- 172.21.15.123:0/1038806083 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8d4006c2b0 0x7f8d4006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:46.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.183+0000 7f8d59908640 1 --2- 172.21.15.123:0/1038806083 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8d4006c2b0 0x7f8d4006e770 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f8d48034000 tx=0x7f8d4802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:46.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.187+0000 7f8d52ffd640 1 -- 172.21.15.123:0/1038806083 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8d4405a4e0 con 0x7f8d540b02b0 2024-09-15T23:21:46.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.386+0000 7f8d5c36d640 1 -- 172.21.15.123:0/1038806083 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d540b2f70 con 0x7f8d540b02b0 2024-09-15T23:21:46.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.386+0000 7f8d52ffd640 1 -- 172.21.15.123:0/1038806083 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) ==== 95+0+5241 (secure 0 0 0) 0x7f8d44059de0 con 0x7f8d540b02b0 2024-09-15T23:21:46.387 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:46.388 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":100,"btime":"2024-09-15T23:21:24:727971+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7214,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/1648353391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1648353391},{"type":"v1","addr":"172.21.15.188:6837","nonce":1648353391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8122,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/1714717257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":1714717257},{"type":"v1","addr":"172.21.15.188:6836","nonce":1714717257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":9552,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/3722702026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3722702026},{"type":"v1","addr":"172.21.15.123:6833","nonce":3722702026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:21:22.066391+0000","modified":"2024-09-15T23:21:24.056941+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9564},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9564":{"gid":9564,"name":"a","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/1883512279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1883512279},{"type":"v1","addr":"172.21.15.123:6835","nonce":1883512279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9564,"qdb_cluster":[9564]},"id":11}]} 2024-09-15T23:21:46.388 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 100 2024-09-15T23:21:46.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.388+0000 7f8d5c36d640 1 -- 172.21.15.123:0/1038806083 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8d4006c2b0 msgr2=0x7f8d4006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:46.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.388+0000 7f8d5c36d640 1 --2- 172.21.15.123:0/1038806083 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8d4006c2b0 0x7f8d4006e770 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f8d48034000 tx=0x7f8d4802e000 comp rx=0 tx=0).stop 2024-09-15T23:21:46.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.388+0000 7f8d5c36d640 1 -- 172.21.15.123:0/1038806083 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d540b02b0 msgr2=0x7f8d54150ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:46.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.388+0000 7f8d5c36d640 1 --2- 172.21.15.123:0/1038806083 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d540b02b0 0x7f8d54150ad0 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f8d44007e70 tx=0x7f8d4400e4b0 comp rx=0 tx=0).stop 2024-09-15T23:21:46.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.388+0000 7f8d5c36d640 1 -- 172.21.15.123:0/1038806083 shutdown_connections 2024-09-15T23:21:46.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.388+0000 7f8d5c36d640 1 --2- 172.21.15.123:0/1038806083 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8d5415c4b0 0x7f8d540ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:46.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.388+0000 7f8d5c36d640 1 --2- 172.21.15.123:0/1038806083 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8d540d08e0 0x7f8d540b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:46.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.388+0000 7f8d5c36d640 1 --2- 172.21.15.123:0/1038806083 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8d4006c2b0 0x7f8d4006e770 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:46.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.388+0000 7f8d5c36d640 1 --2- 172.21.15.123:0/1038806083 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8d540b02b0 0x7f8d54150ad0 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:46.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.388+0000 7f8d5c36d640 1 -- 172.21.15.123:0/1038806083 >> 172.21.15.123:0/1038806083 conn(0x7f8d540b0a80 msgr2=0x7f8d54073160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:46.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.388+0000 7f8d5c36d640 1 -- 172.21.15.123:0/1038806083 shutdown_connections 2024-09-15T23:21:46.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.388+0000 7f8d5c36d640 1 -- 172.21.15.123:0/1038806083 wait complete. 2024-09-15T23:21:46.400 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-15T23:21:46.400 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:21:46.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.496+0000 7f192f09b640 1 Processor -- start 2024-09-15T23:21:46.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.497+0000 7f192f09b640 1 -- start start 2024-09-15T23:21:46.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.497+0000 7f192f09b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f19280d0200 0x7f19280d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:46.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.497+0000 7f192f09b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19280d1620 0x7f19280d1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:46.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.497+0000 7f192f09b640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1928073400 con 0x7f192815c4f0 2024-09-15T23:21:46.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.497+0000 7f192f09b640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f19280d0bb0 con 0x7f19280d0200 2024-09-15T23:21:46.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.497+0000 7f192f09b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f19280736e0 con 0x7f19280d1620 2024-09-15T23:21:46.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.497+0000 7f1927fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f19280d0200 0x7f19280d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:46.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.497+0000 7f1927fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f19280d0200 0x7f19280d0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52496/0 (socket says 172.21.15.123:52496) 2024-09-15T23:21:46.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.497+0000 7f192ce37640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f192815c4f0 0x7f192815d4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55066/0 (socket says 172.21.15.123:55066) 2024-09-15T23:21:46.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.497+0000 7f1927fff640 1 -- 172.21.15.123:0/1866401355 learned_addr learned my addr 172.21.15.123:0/1866401355 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:46.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.498+0000 7f192d638640 1 --2- 172.21.15.123:0/1866401355 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19280d1620 0x7f19280d1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:46.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.498+0000 7f1927fff640 1 -- 172.21.15.123:0/1866401355 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19280d1620 msgr2=0x7f19280d1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:46.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.498+0000 7f1927fff640 1 --2- 172.21.15.123:0/1866401355 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19280d1620 0x7f19280d1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:46.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.498+0000 7f1927fff640 1 -- 172.21.15.123:0/1866401355 >> v1:172.21.15.123:6789/0 conn(0x7f192815c4f0 legacy=0x7f192815d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:46.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.498+0000 7f1927fff640 1 -- 172.21.15.123:0/1866401355 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19280739c0 con 0x7f19280d0200 2024-09-15T23:21:46.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.498+0000 7f19277fe640 1 -- 172.21.15.123:0/1866401355 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3539015396 0 0) 0x7f1928073400 con 0x7f192815c4f0 2024-09-15T23:21:46.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.498+0000 7f1927fff640 1 --2- 172.21.15.123:0/1866401355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19280d0200 0x7f19280d0670 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f1918009e50 tx=0x7f191802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5cf20d90bb15168 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:46.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.499+0000 7f19277fe640 1 -- 172.21.15.123:0/1866401355 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1918036070 con 0x7f19280d0200 2024-09-15T23:21:46.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.499+0000 7f19277fe640 1 -- 172.21.15.123:0/1866401355 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1918031600 con 0x7f19280d0200 2024-09-15T23:21:46.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.499+0000 7f19277fe640 1 -- 172.21.15.123:0/1866401355 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19180319d0 con 0x7f19280d0200 2024-09-15T23:21:46.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.499+0000 7f192f09b640 1 -- 172.21.15.123:0/1866401355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19280d0200 msgr2=0x7f19280d0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:46.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.499+0000 7f192f09b640 1 --2- 172.21.15.123:0/1866401355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19280d0200 0x7f19280d0670 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f1918009e50 tx=0x7f191802a710 comp rx=0 tx=0).stop 2024-09-15T23:21:46.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.499+0000 7f192f09b640 1 -- 172.21.15.123:0/1866401355 shutdown_connections 2024-09-15T23:21:46.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.499+0000 7f192f09b640 1 --2- 172.21.15.123:0/1866401355 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19280d1620 0x7f19280d1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:46.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.499+0000 7f192f09b640 1 --2- 172.21.15.123:0/1866401355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19280d0200 0x7f19280d0670 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:46.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.499+0000 7f192f09b640 1 -- 172.21.15.123:0/1866401355 >> 172.21.15.123:0/1866401355 conn(0x7f192806f400 msgr2=0x7f192806f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:46.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.499+0000 7f192f09b640 1 -- 172.21.15.123:0/1866401355 shutdown_connections 2024-09-15T23:21:46.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.499+0000 7f192f09b640 1 -- 172.21.15.123:0/1866401355 wait complete. 2024-09-15T23:21:46.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.500+0000 7f192f09b640 1 Processor -- start 2024-09-15T23:21:46.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.500+0000 7f192f09b640 1 -- start start 2024-09-15T23:21:46.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.501+0000 7f192f09b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19280d0200 0x7f192814d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:46.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.501+0000 7f192f09b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19280d1620 0x7f19280aba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:46.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.501+0000 7f192f09b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f192815c4f0 0x7f192815e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:46.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.501+0000 7f192f09b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f19280d0fa0 con 0x7f19280d0200 2024-09-15T23:21:46.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.501+0000 7f192f09b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1928073f80 con 0x7f192815c4f0 2024-09-15T23:21:46.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.501+0000 7f192f09b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f192815c8d0 con 0x7f19280d1620 2024-09-15T23:21:46.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.501+0000 7f192ce37640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19280d0200 0x7f192814d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:46.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.501+0000 7f192ce37640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19280d0200 0x7f192814d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52502/0 (socket says 172.21.15.123:52502) 2024-09-15T23:21:46.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.501+0000 7f192ce37640 1 -- 172.21.15.123:0/3557069708 learned_addr learned my addr 172.21.15.123:0/3557069708 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:46.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.502+0000 7f192ce37640 1 -- 172.21.15.123:0/3557069708 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19280d1620 msgr2=0x7f19280aba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:46.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.502+0000 7f192ce37640 1 --2- 172.21.15.123:0/3557069708 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19280d1620 0x7f19280aba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:46.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.502+0000 7f192ce37640 1 -- 172.21.15.123:0/3557069708 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f192815c4f0 msgr2=0x7f192815e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:46.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.502+0000 7f192ce37640 1 --2- 172.21.15.123:0/3557069708 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f192815c4f0 0x7f192815e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:46.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.502+0000 7f192ce37640 1 -- 172.21.15.123:0/3557069708 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19280aa850 con 0x7f19280d0200 2024-09-15T23:21:46.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.502+0000 7f192ce37640 1 --2- 172.21.15.123:0/3557069708 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19280d0200 0x7f192814d9f0 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7f192000c4b0 tx=0x7f192000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:46.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.502+0000 7f19257fa640 1 -- 172.21.15.123:0/3557069708 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1920018070 con 0x7f19280d0200 2024-09-15T23:21:46.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.502+0000 7f19257fa640 1 -- 172.21.15.123:0/3557069708 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1920007480 con 0x7f19280d0200 2024-09-15T23:21:46.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.502+0000 7f19257fa640 1 -- 172.21.15.123:0/3557069708 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1920004820 con 0x7f19280d0200 2024-09-15T23:21:46.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.502+0000 7f192f09b640 1 -- 172.21.15.123:0/3557069708 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19280aab30 con 0x7f19280d0200 2024-09-15T23:21:46.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.502+0000 7f192f09b640 1 -- 172.21.15.123:0/3557069708 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19280ab0f0 con 0x7f19280d0200 2024-09-15T23:21:46.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.503+0000 7f192f09b640 1 -- 172.21.15.123:0/3557069708 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19280b7bc0 con 0x7f19280d0200 2024-09-15T23:21:46.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.503+0000 7f19257fa640 1 -- 172.21.15.123:0/3557069708 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f192001b070 con 0x7f19280d0200 2024-09-15T23:21:46.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.504+0000 7f19257fa640 1 --2- 172.21.15.123:0/3557069708 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f190806c2b0 0x7f190806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:46.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.504+0000 7f19257fa640 1 -- 172.21.15.123:0/3557069708 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7f192008a6b0 con 0x7f19280d0200 2024-09-15T23:21:46.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.504+0000 7f1927fff640 1 --2- 172.21.15.123:0/3557069708 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f190806c2b0 0x7f190806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:46.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.505+0000 7f1927fff640 1 --2- 172.21.15.123:0/3557069708 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f190806c2b0 0x7f190806e770 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1918033000 tx=0x7f191802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:46.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.508+0000 7f19257fa640 1 -- 172.21.15.123:0/3557069708 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f19280b7bc0 con 0x7f19280d0200 2024-09-15T23:21:46.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.743+0000 7f192f09b640 1 -- 172.21.15.123:0/3557069708 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f19280cdbe0 con 0x7f19280d0200 2024-09-15T23:21:46.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.743+0000 7f19257fa640 1 -- 172.21.15.123:0/3557069708 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1618 (secure 0 0 0) 0x7f19280cdbe0 con 0x7f19280d0200 2024-09-15T23:21:46.744 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:46.744 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":597,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":168,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":890,"data_bytes":910797272,"bytes_used":2159624192,"bytes_avail":770934489088,"bytes_total":773094113280,"write_bytes_sec":75226545,"read_op_per_sec":0,"write_op_per_sec":73},"fsmap":{"epoch":100,"btime":"2024-09-15T23:21:24:727971+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"a","status":"up:active","gid":9564}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-09-15T23:21:01.629595+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T23:21:46.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.745+0000 7f192f09b640 1 -- 172.21.15.123:0/3557069708 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f190806c2b0 msgr2=0x7f190806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:46.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.745+0000 7f192f09b640 1 --2- 172.21.15.123:0/3557069708 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f190806c2b0 0x7f190806e770 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1918033000 tx=0x7f191802e000 comp rx=0 tx=0).stop 2024-09-15T23:21:46.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.745+0000 7f192f09b640 1 -- 172.21.15.123:0/3557069708 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19280d0200 msgr2=0x7f192814d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:46.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.745+0000 7f192f09b640 1 --2- 172.21.15.123:0/3557069708 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19280d0200 0x7f192814d9f0 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7f192000c4b0 tx=0x7f192000c970 comp rx=0 tx=0).stop 2024-09-15T23:21:46.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.745+0000 7f192f09b640 1 -- 172.21.15.123:0/3557069708 shutdown_connections 2024-09-15T23:21:46.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.745+0000 7f192f09b640 1 --2- 172.21.15.123:0/3557069708 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f192815c4f0 0x7f192815e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:46.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.745+0000 7f192f09b640 1 --2- 172.21.15.123:0/3557069708 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19280d1620 0x7f19280aba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:46.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.745+0000 7f192f09b640 1 --2- 172.21.15.123:0/3557069708 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f190806c2b0 0x7f190806e770 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:46.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.745+0000 7f192f09b640 1 --2- 172.21.15.123:0/3557069708 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f19280d0200 0x7f192814d9f0 unknown :-1 s=CLOSED pgs=1974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:46.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.745+0000 7f192f09b640 1 -- 172.21.15.123:0/3557069708 >> 172.21.15.123:0/3557069708 conn(0x7f192806f400 msgr2=0x7f19280cf830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:46.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.745+0000 7f192f09b640 1 -- 172.21.15.123:0/3557069708 shutdown_connections 2024-09-15T23:21:46.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:46.745+0000 7f192f09b640 1 -- 172.21.15.123:0/3557069708 wait complete. 2024-09-15T23:21:46.757 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-15T23:21:47.757 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:21:47.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.869+0000 7f3789ff6640 1 Processor -- start 2024-09-15T23:21:47.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.870+0000 7f3789ff6640 1 -- start start 2024-09-15T23:21:47.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.870+0000 7f3789ff6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f37840d23b0 0x7f37840b87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:47.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.870+0000 7f3789ff6640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37840d0e70 con 0x7f37840b6970 2024-09-15T23:21:47.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.870+0000 7f3789ff6640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37840d41c0 con 0x7f378415ed20 2024-09-15T23:21:47.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.870+0000 7f3789ff6640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f37840d35b0 con 0x7f37840d23b0 2024-09-15T23:21:47.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.871+0000 7f3783fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f37840d23b0 0x7f37840b87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:47.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.871+0000 7f3783fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f37840d23b0 0x7f37840b87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52516/0 (socket says 172.21.15.123:52516) 2024-09-15T23:21:47.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.871+0000 7f377affd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f37840b6970 0x7f37840b80d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55080/0 (socket says 172.21.15.123:55080) 2024-09-15T23:21:47.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.871+0000 7f3783fff640 1 -- 172.21.15.123:0/852880608 learned_addr learned my addr 172.21.15.123:0/852880608 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:47.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.871+0000 7f3783fff640 1 -- 172.21.15.123:0/852880608 >> v1:172.21.15.188:6789/0 conn(0x7f378415ed20 legacy=0x7f37840b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:47.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.871+0000 7f3783fff640 1 -- 172.21.15.123:0/852880608 >> v1:172.21.15.123:6789/0 conn(0x7f37840b6970 legacy=0x7f37840b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:47.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.871+0000 7f3783fff640 1 -- 172.21.15.123:0/852880608 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37840d3890 con 0x7f37840d23b0 2024-09-15T23:21:47.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.871+0000 7f3782ffd640 1 -- 172.21.15.123:0/852880608 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 376120387 0 0) 0x7f376c001110 con 0x7f37840b6970 2024-09-15T23:21:47.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.872+0000 7f3783fff640 1 --2- 172.21.15.123:0/852880608 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37840d23b0 0x7f37840b87e0 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f377c009e50 tx=0x7f377c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb8edd0af277300 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:47.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.872+0000 7f3782ffd640 1 -- 172.21.15.123:0/852880608 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377c036070 con 0x7f37840d23b0 2024-09-15T23:21:47.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.872+0000 7f3782ffd640 1 -- 172.21.15.123:0/852880608 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f377c031600 con 0x7f37840d23b0 2024-09-15T23:21:47.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.872+0000 7f3782ffd640 1 -- 172.21.15.123:0/852880608 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377c0319d0 con 0x7f37840d23b0 2024-09-15T23:21:47.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.872+0000 7f3789ff6640 1 -- 172.21.15.123:0/852880608 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37840d23b0 msgr2=0x7f37840b87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:47.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.872+0000 7f3789ff6640 1 --2- 172.21.15.123:0/852880608 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37840d23b0 0x7f37840b87e0 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f377c009e50 tx=0x7f377c02a730 comp rx=0 tx=0).stop 2024-09-15T23:21:47.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.872+0000 7f3789ff6640 1 -- 172.21.15.123:0/852880608 shutdown_connections 2024-09-15T23:21:47.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.872+0000 7f3789ff6640 1 --2- 172.21.15.123:0/852880608 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37840d23b0 0x7f37840b87e0 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:47.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.872+0000 7f3789ff6640 1 -- 172.21.15.123:0/852880608 >> 172.21.15.123:0/852880608 conn(0x7f37840d1260 msgr2=0x7f37840d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:47.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.872+0000 7f3789ff6640 1 -- 172.21.15.123:0/852880608 shutdown_connections 2024-09-15T23:21:47.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.872+0000 7f3789ff6640 1 -- 172.21.15.123:0/852880608 wait complete. 2024-09-15T23:21:47.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.874+0000 7f3789ff6640 1 Processor -- start 2024-09-15T23:21:47.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.874+0000 7f3789ff6640 1 -- start start 2024-09-15T23:21:47.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.874+0000 7f3789ff6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37840b6970 0x7f3784154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:47.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.874+0000 7f3789ff6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37840d23b0 0x7f3784159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:47.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.874+0000 7f3789ff6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f378415ed20 0x7f37841558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:47.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.874+0000 7f3789ff6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f37840d32a0 con 0x7f37840b6970 2024-09-15T23:21:47.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.874+0000 7f3789ff6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f37840d3e50 con 0x7f378415ed20 2024-09-15T23:21:47.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.874+0000 7f3789ff6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f378415f100 con 0x7f37840d23b0 2024-09-15T23:21:47.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.875+0000 7f37837fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37840b6970 0x7f3784154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:47.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.875+0000 7f37837fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37840b6970 0x7f3784154c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52526/0 (socket says 172.21.15.123:52526) 2024-09-15T23:21:47.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.875+0000 7f37837fe640 1 -- 172.21.15.123:0/98102674 learned_addr learned my addr 172.21.15.123:0/98102674 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:47.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.875+0000 7f3783fff640 1 --2- 172.21.15.123:0/98102674 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f378415ed20 0x7f37841558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:47.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.875+0000 7f377affd640 1 --2- 172.21.15.123:0/98102674 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37840d23b0 0x7f3784159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:47.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.875+0000 7f37837fe640 1 -- 172.21.15.123:0/98102674 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37840d23b0 msgr2=0x7f3784159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:47.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.875+0000 7f37837fe640 1 --2- 172.21.15.123:0/98102674 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37840d23b0 0x7f3784159ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:47.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.875+0000 7f37837fe640 1 -- 172.21.15.123:0/98102674 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f378415ed20 msgr2=0x7f37841558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:47.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.875+0000 7f37837fe640 1 --2- 172.21.15.123:0/98102674 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f378415ed20 0x7f37841558f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:47.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.875+0000 7f37837fe640 1 -- 172.21.15.123:0/98102674 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f378415a840 con 0x7f37840b6970 2024-09-15T23:21:47.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.875+0000 7f377affd640 1 --2- 172.21.15.123:0/98102674 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37840d23b0 0x7f3784159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:21:47.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.875+0000 7f37837fe640 1 --2- 172.21.15.123:0/98102674 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37840b6970 0x7f3784154c80 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7f377400c450 tx=0x7f377400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:47.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.875+0000 7f3780ff9640 1 -- 172.21.15.123:0/98102674 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37740052d0 con 0x7f37840b6970 2024-09-15T23:21:47.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.875+0000 7f3780ff9640 1 -- 172.21.15.123:0/98102674 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3774005470 con 0x7f37840b6970 2024-09-15T23:21:47.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.875+0000 7f3780ff9640 1 -- 172.21.15.123:0/98102674 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3774012870 con 0x7f37840b6970 2024-09-15T23:21:47.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.875+0000 7f3789ff6640 1 -- 172.21.15.123:0/98102674 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f378415ab20 con 0x7f37840b6970 2024-09-15T23:21:47.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.875+0000 7f3789ff6640 1 -- 172.21.15.123:0/98102674 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f378415b0e0 con 0x7f37840b6970 2024-09-15T23:21:47.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.876+0000 7f3789ff6640 1 -- 172.21.15.123:0/98102674 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37840b7010 con 0x7f37840b6970 2024-09-15T23:21:47.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.877+0000 7f3780ff9640 1 -- 172.21.15.123:0/98102674 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3774012a10 con 0x7f37840b6970 2024-09-15T23:21:47.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.877+0000 7f3780ff9640 1 --2- 172.21.15.123:0/98102674 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f376406c2e0 0x7f376406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:47.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.877+0000 7f3780ff9640 1 -- 172.21.15.123:0/98102674 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7f377408af90 con 0x7f37840b6970 2024-09-15T23:21:47.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.878+0000 7f377affd640 1 --2- 172.21.15.123:0/98102674 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f376406c2e0 0x7f376406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:47.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.878+0000 7f377affd640 1 --2- 172.21.15.123:0/98102674 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f376406c2e0 0x7f376406e7a0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f376c007fd0 tx=0x7f376c007dc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:47.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:47.882+0000 7f3780ff9640 1 -- 172.21.15.123:0/98102674 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3774059790 con 0x7f37840b6970 2024-09-15T23:21:48.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.079+0000 7f3789ff6640 1 -- 172.21.15.123:0/98102674 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f37840b3f20 con 0x7f37840b6970 2024-09-15T23:21:48.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.079+0000 7f3780ff9640 1 -- 172.21.15.123:0/98102674 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) ==== 95+0+5241 (secure 0 0 0) 0x7f3774059090 con 0x7f37840b6970 2024-09-15T23:21:48.081 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:48.081 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":100,"btime":"2024-09-15T23:21:24:727971+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7214,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/1648353391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1648353391},{"type":"v1","addr":"172.21.15.188:6837","nonce":1648353391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8122,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/1714717257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":1714717257},{"type":"v1","addr":"172.21.15.188:6836","nonce":1714717257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":9552,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/3722702026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3722702026},{"type":"v1","addr":"172.21.15.123:6833","nonce":3722702026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:21:22.066391+0000","modified":"2024-09-15T23:21:24.056941+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9564},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9564":{"gid":9564,"name":"a","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/1883512279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1883512279},{"type":"v1","addr":"172.21.15.123:6835","nonce":1883512279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9564,"qdb_cluster":[9564]},"id":11}]} 2024-09-15T23:21:48.081 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 100 2024-09-15T23:21:48.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.081+0000 7f3789ff6640 1 -- 172.21.15.123:0/98102674 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f376406c2e0 msgr2=0x7f376406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:48.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.081+0000 7f3789ff6640 1 --2- 172.21.15.123:0/98102674 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f376406c2e0 0x7f376406e7a0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f376c007fd0 tx=0x7f376c007dc0 comp rx=0 tx=0).stop 2024-09-15T23:21:48.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.081+0000 7f3789ff6640 1 -- 172.21.15.123:0/98102674 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37840b6970 msgr2=0x7f3784154c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:48.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.081+0000 7f3789ff6640 1 --2- 172.21.15.123:0/98102674 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37840b6970 0x7f3784154c80 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7f377400c450 tx=0x7f377400c910 comp rx=0 tx=0).stop 2024-09-15T23:21:48.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.081+0000 7f3789ff6640 1 -- 172.21.15.123:0/98102674 shutdown_connections 2024-09-15T23:21:48.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.081+0000 7f3789ff6640 1 --2- 172.21.15.123:0/98102674 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f378415ed20 0x7f37841558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:48.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.081+0000 7f3789ff6640 1 --2- 172.21.15.123:0/98102674 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37840d23b0 0x7f3784159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:48.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.081+0000 7f3789ff6640 1 --2- 172.21.15.123:0/98102674 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f376406c2e0 0x7f376406e7a0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:48.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.081+0000 7f3789ff6640 1 --2- 172.21.15.123:0/98102674 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37840b6970 0x7f3784154c80 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:48.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.081+0000 7f3789ff6640 1 -- 172.21.15.123:0/98102674 >> 172.21.15.123:0/98102674 conn(0x7f37840d1260 msgr2=0x7f37840b9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:48.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.082+0000 7f3789ff6640 1 -- 172.21.15.123:0/98102674 shutdown_connections 2024-09-15T23:21:48.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.082+0000 7f3789ff6640 1 -- 172.21.15.123:0/98102674 wait complete. 2024-09-15T23:21:48.093 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-15T23:21:48.094 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:21:48.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.189+0000 7f8bf9c42640 1 Processor -- start 2024-09-15T23:21:48.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.189+0000 7f8bf9c42640 1 -- start start 2024-09-15T23:21:48.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.190+0000 7f8bf9c42640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8bf40b2d40 0x7f8bf406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:48.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.190+0000 7f8bf9c42640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f8bf406c150 0x7f8bf415c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:48.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.190+0000 7f8bf9c42640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bf4071180 con 0x7f8bf413eb20 2024-09-15T23:21:48.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.190+0000 7f8bf9c42640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f8bf4071ab0 con 0x7f8bf406c150 2024-09-15T23:21:48.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.190+0000 7f8bf9c42640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8bf4071460 con 0x7f8bf40b2d40 2024-09-15T23:21:48.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.190+0000 7f8bebfff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8bf413eb20 0x7f8bf415bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55090/0 (socket says 172.21.15.123:55090) 2024-09-15T23:21:48.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.190+0000 7f8bebfff640 1 -- 172.21.15.123:0/644512062 learned_addr learned my addr 172.21.15.123:0/644512062 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:21:48.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.191+0000 7f8bf3fff640 1 --2- 172.21.15.123:0/644512062 >> v2:172.21.15.188:3300/0 conn(0x7f8bf406c150 0x7f8bf415c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:48.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.191+0000 7f8bf37fe640 1 --2- 172.21.15.123:0/644512062 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8bf40b2d40 0x7f8bf406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:48.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.191+0000 7f8bf2ffd640 1 -- 172.21.15.123:0/644512062 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3458305753 0 0) 0x7f8bf4071180 con 0x7f8bf413eb20 2024-09-15T23:21:48.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.191+0000 7f8bf2ffd640 1 -- 172.21.15.123:0/644512062 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8be0003520 con 0x7f8bf413eb20 2024-09-15T23:21:48.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.191+0000 7f8bf2ffd640 1 -- 172.21.15.123:0/644512062 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3124746854 0 0) 0x7f8be0003520 con 0x7f8bf413eb20 2024-09-15T23:21:48.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.191+0000 7f8bf2ffd640 1 -- 172.21.15.123:0/644512062 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8bf40b2d40 msgr2=0x7f8bf406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:48.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.191+0000 7f8bf2ffd640 1 --2- 172.21.15.123:0/644512062 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8bf40b2d40 0x7f8bf406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:48.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.191+0000 7f8bf2ffd640 1 -- 172.21.15.123:0/644512062 >> v2:172.21.15.188:3300/0 conn(0x7f8bf406c150 msgr2=0x7f8bf415c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:48.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.191+0000 7f8bf2ffd640 1 --2- 172.21.15.123:0/644512062 >> v2:172.21.15.188:3300/0 conn(0x7f8bf406c150 0x7f8bf415c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:48.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.191+0000 7f8bf2ffd640 1 -- 172.21.15.123:0/644512062 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf4071740 con 0x7f8bf413eb20 2024-09-15T23:21:48.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.191+0000 7f8bf2ffd640 1 -- 172.21.15.123:0/644512062 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f8bdc001670 con 0x7f8bf413eb20 2024-09-15T23:21:48.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.191+0000 7f8bf37fe640 1 --2- 172.21.15.123:0/644512062 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8bf40b2d40 0x7f8bf406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:21:48.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.191+0000 7f8bf2ffd640 1 -- 172.21.15.123:0/644512062 >> v1:172.21.15.123:6789/0 conn(0x7f8bf413eb20 legacy=0x7f8bf415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:48.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.191+0000 7f8bf2ffd640 1 --2- 172.21.15.123:0/644512062 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8bf40b2d40 0x7f8be00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:48.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.191+0000 7f8bf2ffd640 1 --2- 172.21.15.123:0/644512062 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8be0003f60 0x7f8be0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:48.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.191+0000 7f8bf2ffd640 1 --2- 172.21.15.123:0/644512062 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8be0004d40 0x7f8be00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:48.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.191+0000 7f8bf2ffd640 1 -- 172.21.15.123:0/644512062 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf4071ab0 con 0x7f8be0004d40 2024-09-15T23:21:48.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.191+0000 7f8bf2ffd640 1 -- 172.21.15.123:0/644512062 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf4071460 con 0x7f8be0003f60 2024-09-15T23:21:48.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.191+0000 7f8bf2ffd640 1 -- 172.21.15.123:0/644512062 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8be000dbd0 con 0x7f8bf40b2d40 2024-09-15T23:21:48.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.191+0000 7f8bf3fff640 1 --2- 172.21.15.123:0/644512062 >> v2:172.21.15.188:3300/0 conn(0x7f8bf406c150 0x7f8bf415c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:21:48.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.191+0000 7f8bf37fe640 1 --2- 172.21.15.123:0/644512062 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8bf40b2d40 0x7f8be00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:48.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.191+0000 7f8bf3fff640 1 --2- 172.21.15.123:0/644512062 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8be0004d40 0x7f8be00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:48.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.191+0000 7f8bebfff640 1 --2- 172.21.15.123:0/644512062 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8be0003f60 0x7f8be0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:48.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.191+0000 7f8bf3fff640 1 -- 172.21.15.123:0/644512062 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8bf40b2d40 msgr2=0x7f8be00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:48.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.191+0000 7f8bf3fff640 1 --2- 172.21.15.123:0/644512062 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8bf40b2d40 0x7f8be00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:48.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.191+0000 7f8bf3fff640 1 -- 172.21.15.123:0/644512062 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8be0003f60 msgr2=0x7f8be0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:48.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.191+0000 7f8bf3fff640 1 --2- 172.21.15.123:0/644512062 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8be0003f60 0x7f8be0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:48.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.191+0000 7f8bf3fff640 1 -- 172.21.15.123:0/644512062 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be0003520 con 0x7f8be0004d40 2024-09-15T23:21:48.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.192+0000 7f8bf3fff640 1 --2- 172.21.15.123:0/644512062 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8be0004d40 0x7f8be00051c0 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00e350 tx=0x7f8be0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb5be951b0fa3bac server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:48.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.192+0000 7f8bf2ffd640 1 -- 172.21.15.123:0/644512062 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bec009dc0 con 0x7f8be0004d40 2024-09-15T23:21:48.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.192+0000 7f8bf2ffd640 1 -- 172.21.15.123:0/644512062 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bec003b90 con 0x7f8be0004d40 2024-09-15T23:21:48.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.192+0000 7f8bf2ffd640 1 -- 172.21.15.123:0/644512062 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bec004020 con 0x7f8be0004d40 2024-09-15T23:21:48.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.193+0000 7f8bf9c42640 1 -- 172.21.15.123:0/644512062 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8be0004d40 msgr2=0x7f8be00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:48.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.193+0000 7f8bf9c42640 1 --2- 172.21.15.123:0/644512062 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8be0004d40 0x7f8be00051c0 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00e350 tx=0x7f8be0005830 comp rx=0 tx=0).stop 2024-09-15T23:21:48.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.193+0000 7f8bf3fff640 1 -- 172.21.15.123:0/644512062 reap_dead start 2024-09-15T23:21:48.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.193+0000 7f8bf9c42640 1 -- 172.21.15.123:0/644512062 shutdown_connections 2024-09-15T23:21:48.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.193+0000 7f8bf9c42640 1 -- 172.21.15.123:0/644512062 >> 172.21.15.123:0/644512062 conn(0x7f8bf40ccec0 msgr2=0x7f8bf40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:48.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.193+0000 7f8bf9c42640 1 -- 172.21.15.123:0/644512062 shutdown_connections 2024-09-15T23:21:48.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.193+0000 7f8bf9c42640 1 -- 172.21.15.123:0/644512062 wait complete. 2024-09-15T23:21:48.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.194+0000 7f8bf9c42640 1 Processor -- start 2024-09-15T23:21:48.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.194+0000 7f8bf9c42640 1 -- start start 2024-09-15T23:21:48.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.195+0000 7f8bf9c42640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8be0004d40 0x7f8bf40ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:48.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.195+0000 7f8bf9c42640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8bf41f8b10 0x7f8bf41f81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:48.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.195+0000 7f8bf9c42640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8bf40cc1c0 0x7f8bf4143f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:48.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.195+0000 7f8bf9c42640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf406bfa0 con 0x7f8be0004d40 2024-09-15T23:21:48.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.195+0000 7f8bf9c42640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf406be20 con 0x7f8bf40cc1c0 2024-09-15T23:21:48.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.195+0000 7f8bf9c42640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8bf4071f40 con 0x7f8bf41f8b10 2024-09-15T23:21:48.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.195+0000 7f8bf37fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8be0004d40 0x7f8bf40ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:48.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.195+0000 7f8bf37fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8be0004d40 0x7f8bf40ca6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52546/0 (socket says 172.21.15.123:52546) 2024-09-15T23:21:48.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.195+0000 7f8bf37fe640 1 -- 172.21.15.123:0/2145935886 learned_addr learned my addr 172.21.15.123:0/2145935886 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:48.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.195+0000 7f8bebfff640 1 --2- 172.21.15.123:0/2145935886 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8bf41f8b10 0x7f8bf41f81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:48.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.195+0000 7f8bf3fff640 1 --2- 172.21.15.123:0/2145935886 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8bf40cc1c0 0x7f8bf4143f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:48.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.195+0000 7f8bf37fe640 1 -- 172.21.15.123:0/2145935886 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8bf41f8b10 msgr2=0x7f8bf41f81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:48.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.195+0000 7f8bf37fe640 1 --2- 172.21.15.123:0/2145935886 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8bf41f8b10 0x7f8bf41f81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:48.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.195+0000 7f8bf37fe640 1 -- 172.21.15.123:0/2145935886 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8bf40cc1c0 msgr2=0x7f8bf4143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:48.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.195+0000 7f8bf37fe640 1 --2- 172.21.15.123:0/2145935886 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8bf40cc1c0 0x7f8bf4143f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:48.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.195+0000 7f8bf37fe640 1 -- 172.21.15.123:0/2145935886 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf415c5d0 con 0x7f8be0004d40 2024-09-15T23:21:48.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.195+0000 7f8bf3fff640 1 --2- 172.21.15.123:0/2145935886 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8bf40cc1c0 0x7f8bf4143f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:21:48.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.195+0000 7f8bf37fe640 1 --2- 172.21.15.123:0/2145935886 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8be0004d40 0x7f8bf40ca6b0 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7f8be40119d0 tx=0x7f8be4011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:48.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.196+0000 7f8bf0ff9640 1 -- 172.21.15.123:0/2145935886 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be400faf0 con 0x7f8be0004d40 2024-09-15T23:21:48.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.196+0000 7f8bf0ff9640 1 -- 172.21.15.123:0/2145935886 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8be400fc90 con 0x7f8be0004d40 2024-09-15T23:21:48.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.196+0000 7f8bf9c42640 1 -- 172.21.15.123:0/2145935886 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bf415c2f0 con 0x7f8be0004d40 2024-09-15T23:21:48.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.196+0000 7f8bf0ff9640 1 -- 172.21.15.123:0/2145935886 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be4004030 con 0x7f8be0004d40 2024-09-15T23:21:48.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.196+0000 7f8bf9c42640 1 -- 172.21.15.123:0/2145935886 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bf40cb9e0 con 0x7f8be0004d40 2024-09-15T23:21:48.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.197+0000 7f8bf9c42640 1 -- 172.21.15.123:0/2145935886 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bf4072370 con 0x7f8be0004d40 2024-09-15T23:21:48.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.197+0000 7f8bf0ff9640 1 -- 172.21.15.123:0/2145935886 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8be4012040 con 0x7f8be0004d40 2024-09-15T23:21:48.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.198+0000 7f8bf0ff9640 1 --2- 172.21.15.123:0/2145935886 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8bd406c2b0 0x7f8bd406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:48.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.198+0000 7f8bf0ff9640 1 -- 172.21.15.123:0/2145935886 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7f8be408b7c0 con 0x7f8be0004d40 2024-09-15T23:21:48.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.198+0000 7f8bebfff640 1 --2- 172.21.15.123:0/2145935886 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8bd406c2b0 0x7f8bd406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:48.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.198+0000 7f8bebfff640 1 --2- 172.21.15.123:0/2145935886 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8bd406c2b0 0x7f8bd406e770 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f8bf40ce8d0 tx=0x7f8bdc001df0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:48.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.202+0000 7f8bf0ff9640 1 -- 172.21.15.123:0/2145935886 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8be4019070 con 0x7f8be0004d40 2024-09-15T23:21:48.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.427+0000 7f8bf9c42640 1 -- 172.21.15.123:0/2145935886 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f8bf4159280 con 0x7f8be0004d40 2024-09-15T23:21:48.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.428+0000 7f8bf0ff9640 1 -- 172.21.15.123:0/2145935886 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1620 (secure 0 0 0) 0x7f8be40598e0 con 0x7f8be0004d40 2024-09-15T23:21:48.429 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:48.429 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":598,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":168,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1033,"data_bytes":1060743640,"bytes_used":2482585600,"bytes_avail":770611527680,"bytes_total":773094113280,"write_bytes_sec":87718952,"read_op_per_sec":0,"write_op_per_sec":85},"fsmap":{"epoch":100,"btime":"2024-09-15T23:21:24:727971+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"a","status":"up:active","gid":9564}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-09-15T23:21:01.629595+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T23:21:48.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.429+0000 7f8bf9c42640 1 -- 172.21.15.123:0/2145935886 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8bd406c2b0 msgr2=0x7f8bd406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:48.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.430+0000 7f8bf9c42640 1 --2- 172.21.15.123:0/2145935886 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8bd406c2b0 0x7f8bd406e770 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f8bf40ce8d0 tx=0x7f8bdc001df0 comp rx=0 tx=0).stop 2024-09-15T23:21:48.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.430+0000 7f8bf9c42640 1 -- 172.21.15.123:0/2145935886 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8be0004d40 msgr2=0x7f8bf40ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:48.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.430+0000 7f8bf9c42640 1 --2- 172.21.15.123:0/2145935886 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8be0004d40 0x7f8bf40ca6b0 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7f8be40119d0 tx=0x7f8be4011e90 comp rx=0 tx=0).stop 2024-09-15T23:21:48.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.430+0000 7f8bf9c42640 1 -- 172.21.15.123:0/2145935886 shutdown_connections 2024-09-15T23:21:48.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.430+0000 7f8bf9c42640 1 --2- 172.21.15.123:0/2145935886 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8bf40cc1c0 0x7f8bf4143f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:48.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.430+0000 7f8bf9c42640 1 --2- 172.21.15.123:0/2145935886 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8bf41f8b10 0x7f8bf41f81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:48.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.430+0000 7f8bf9c42640 1 --2- 172.21.15.123:0/2145935886 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8bd406c2b0 0x7f8bd406e770 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:48.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.430+0000 7f8bf9c42640 1 --2- 172.21.15.123:0/2145935886 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8be0004d40 0x7f8bf40ca6b0 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:48.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.430+0000 7f8bf9c42640 1 -- 172.21.15.123:0/2145935886 >> 172.21.15.123:0/2145935886 conn(0x7f8bf40ccec0 msgr2=0x7f8bf40cf870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:48.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.430+0000 7f8bf9c42640 1 -- 172.21.15.123:0/2145935886 shutdown_connections 2024-09-15T23:21:48.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:48.430+0000 7f8bf9c42640 1 -- 172.21.15.123:0/2145935886 wait complete. 2024-09-15T23:21:48.441 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-15T23:21:49.442 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:21:49.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.556+0000 7f0c30a53640 1 Processor -- start 2024-09-15T23:21:49.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.556+0000 7f0c30a53640 1 -- start start 2024-09-15T23:21:49.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.557+0000 7f0c30a53640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f0c2c0b2d40 0x7f0c2c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:49.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.557+0000 7f0c30a53640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c2c13eb20 0x7f0c2c06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:49.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.558+0000 7f0c30a53640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c2c071180 con 0x7f0c2c15bcf0 2024-09-15T23:21:49.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.558+0000 7f0c30a53640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f0c2c071ab0 con 0x7f0c2c0b2d40 2024-09-15T23:21:49.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.558+0000 7f0c30a53640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0c2c071460 con 0x7f0c2c13eb20 2024-09-15T23:21:49.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.558+0000 7f0c2ad9d640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f0c2c15bcf0 0x7f0c2c15c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55104/0 (socket says 172.21.15.123:55104) 2024-09-15T23:21:49.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.558+0000 7f0c2ad9d640 1 -- 172.21.15.123:0/371379932 learned_addr learned my addr 172.21.15.123:0/371379932 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:21:49.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.558+0000 7f0c29d9b640 1 --2- 172.21.15.123:0/371379932 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c2c13eb20 0x7f0c2c06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:49.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.558+0000 7f0c2a59c640 1 --2- 172.21.15.123:0/371379932 >> v2:172.21.15.188:3300/0 conn(0x7f0c2c0b2d40 0x7f0c2c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:49.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.558+0000 7f0c2959a640 1 -- 172.21.15.123:0/371379932 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2017214635 0 0) 0x7f0c2c071180 con 0x7f0c2c15bcf0 2024-09-15T23:21:49.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.558+0000 7f0c2959a640 1 -- 172.21.15.123:0/371379932 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c14005730 con 0x7f0c2c15bcf0 2024-09-15T23:21:49.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.558+0000 7f0c2959a640 1 -- 172.21.15.123:0/371379932 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1711279817 0 0) 0x7f0c14005730 con 0x7f0c2c15bcf0 2024-09-15T23:21:49.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.558+0000 7f0c2959a640 1 -- 172.21.15.123:0/371379932 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c2c13eb20 msgr2=0x7f0c2c06c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:49.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.558+0000 7f0c2959a640 1 --2- 172.21.15.123:0/371379932 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c2c13eb20 0x7f0c2c06c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:49.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.558+0000 7f0c2959a640 1 -- 172.21.15.123:0/371379932 >> v2:172.21.15.188:3300/0 conn(0x7f0c2c0b2d40 msgr2=0x7f0c2c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:49.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.558+0000 7f0c2959a640 1 --2- 172.21.15.123:0/371379932 >> v2:172.21.15.188:3300/0 conn(0x7f0c2c0b2d40 0x7f0c2c06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:49.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.558+0000 7f0c2959a640 1 -- 172.21.15.123:0/371379932 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2c071740 con 0x7f0c2c15bcf0 2024-09-15T23:21:49.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.558+0000 7f0c2959a640 1 -- 172.21.15.123:0/371379932 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f0c240019f0 con 0x7f0c2c15bcf0 2024-09-15T23:21:49.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.558+0000 7f0c2959a640 1 -- 172.21.15.123:0/371379932 >> v1:172.21.15.123:6789/0 conn(0x7f0c2c15bcf0 legacy=0x7f0c2c15c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:49.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.558+0000 7f0c2959a640 1 --2- 172.21.15.123:0/371379932 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c2c13eb20 0x7f0c14005be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:49.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.558+0000 7f0c2959a640 1 --2- 172.21.15.123:0/371379932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c14006160 0x7f0c14006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:49.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.558+0000 7f0c2959a640 1 --2- 172.21.15.123:0/371379932 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c14006f50 0x7f0c140073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:49.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.558+0000 7f0c2959a640 1 -- 172.21.15.123:0/371379932 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2c071ab0 con 0x7f0c14006160 2024-09-15T23:21:49.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.558+0000 7f0c2959a640 1 -- 172.21.15.123:0/371379932 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2c071460 con 0x7f0c14006f50 2024-09-15T23:21:49.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.558+0000 7f0c2959a640 1 -- 172.21.15.123:0/371379932 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0c1400dbd0 con 0x7f0c2c13eb20 2024-09-15T23:21:49.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.559+0000 7f0c29d9b640 1 --2- 172.21.15.123:0/371379932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c14006160 0x7f0c14006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:49.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.559+0000 7f0c2a59c640 1 --2- 172.21.15.123:0/371379932 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c2c13eb20 0x7f0c14005be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:49.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.559+0000 7f0c2ad9d640 1 --2- 172.21.15.123:0/371379932 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c14006f50 0x7f0c140073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:49.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.559+0000 7f0c29d9b640 1 -- 172.21.15.123:0/371379932 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c2c13eb20 msgr2=0x7f0c14005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:49.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.559+0000 7f0c29d9b640 1 --2- 172.21.15.123:0/371379932 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c2c13eb20 0x7f0c14005be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:49.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.559+0000 7f0c29d9b640 1 -- 172.21.15.123:0/371379932 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c14006f50 msgr2=0x7f0c140073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:49.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.559+0000 7f0c29d9b640 1 --2- 172.21.15.123:0/371379932 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c14006f50 0x7f0c140073d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:49.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.559+0000 7f0c29d9b640 1 -- 172.21.15.123:0/371379932 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c14005730 con 0x7f0c14006160 2024-09-15T23:21:49.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.560+0000 7f0c29d9b640 1 --2- 172.21.15.123:0/371379932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c14006160 0x7f0c14006a10 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7f0c20009ac0 tx=0x7f0c14007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b38773d03587545 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:49.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.560+0000 7f0c2959a640 1 -- 172.21.15.123:0/371379932 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c20036070 con 0x7f0c14006160 2024-09-15T23:21:49.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.560+0000 7f0c2959a640 1 -- 172.21.15.123:0/371379932 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c20031400 con 0x7f0c14006160 2024-09-15T23:21:49.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.560+0000 7f0c2959a640 1 -- 172.21.15.123:0/371379932 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c20009690 con 0x7f0c14006160 2024-09-15T23:21:49.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.560+0000 7f0c30a53640 1 -- 172.21.15.123:0/371379932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c14006160 msgr2=0x7f0c14006a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:49.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.560+0000 7f0c30a53640 1 --2- 172.21.15.123:0/371379932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c14006160 0x7f0c14006a10 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7f0c20009ac0 tx=0x7f0c14007a40 comp rx=0 tx=0).stop 2024-09-15T23:21:49.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.560+0000 7f0c2ad9d640 1 -- 172.21.15.123:0/371379932 reap_dead start 2024-09-15T23:21:49.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.560+0000 7f0c30a53640 1 -- 172.21.15.123:0/371379932 shutdown_connections 2024-09-15T23:21:49.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.560+0000 7f0c30a53640 1 -- 172.21.15.123:0/371379932 >> 172.21.15.123:0/371379932 conn(0x7f0c2c0ccec0 msgr2=0x7f0c2c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:49.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.560+0000 7f0c30a53640 1 -- 172.21.15.123:0/371379932 shutdown_connections 2024-09-15T23:21:49.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.561+0000 7f0c30a53640 1 -- 172.21.15.123:0/371379932 wait complete. 2024-09-15T23:21:49.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.562+0000 7f0c30a53640 1 Processor -- start 2024-09-15T23:21:49.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.562+0000 7f0c30a53640 1 -- start start 2024-09-15T23:21:49.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.563+0000 7f0c30a53640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c14006160 0x7f0c2c0b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:49.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.563+0000 7f0c30a53640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c2c0b52a0 0x7f0c2c13b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:49.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.563+0000 7f0c30a53640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c2c13b920 0x7f0c2c157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:49.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.563+0000 7f0c30a53640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2c06c4e0 con 0x7f0c2c13b920 2024-09-15T23:21:49.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.563+0000 7f0c30a53640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2c06c360 con 0x7f0c2c0b52a0 2024-09-15T23:21:49.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.563+0000 7f0c30a53640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0c2c071f40 con 0x7f0c14006160 2024-09-15T23:21:49.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.563+0000 7f0c2ad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c2c13b920 0x7f0c2c157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:49.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.563+0000 7f0c2ad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c2c13b920 0x7f0c2c157fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52554/0 (socket says 172.21.15.123:52554) 2024-09-15T23:21:49.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.563+0000 7f0c2ad9d640 1 -- 172.21.15.123:0/3049478778 learned_addr learned my addr 172.21.15.123:0/3049478778 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:49.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.563+0000 7f0c29d9b640 1 --2- 172.21.15.123:0/3049478778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c2c0b52a0 0x7f0c2c13b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:49.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.563+0000 7f0c2a59c640 1 --2- 172.21.15.123:0/3049478778 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c14006160 0x7f0c2c0b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:49.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.563+0000 7f0c2ad9d640 1 -- 172.21.15.123:0/3049478778 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c14006160 msgr2=0x7f0c2c0b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:49.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.563+0000 7f0c2ad9d640 1 --2- 172.21.15.123:0/3049478778 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c14006160 0x7f0c2c0b6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:49.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.563+0000 7f0c2ad9d640 1 -- 172.21.15.123:0/3049478778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c2c0b52a0 msgr2=0x7f0c2c13b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:49.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.563+0000 7f0c2ad9d640 1 --2- 172.21.15.123:0/3049478778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c2c0b52a0 0x7f0c2c13b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:49.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.563+0000 7f0c2ad9d640 1 -- 172.21.15.123:0/3049478778 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2c15cd90 con 0x7f0c2c13b920 2024-09-15T23:21:49.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.563+0000 7f0c2ad9d640 1 --2- 172.21.15.123:0/3049478778 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c2c13b920 0x7f0c2c157fb0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c0cdf80 tx=0x7f0c24007a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:49.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.564+0000 7f0c1affd640 1 -- 172.21.15.123:0/3049478778 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2400ab90 con 0x7f0c2c13b920 2024-09-15T23:21:49.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.564+0000 7f0c1affd640 1 -- 172.21.15.123:0/3049478778 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c24018070 con 0x7f0c2c13b920 2024-09-15T23:21:49.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.564+0000 7f0c30a53640 1 -- 172.21.15.123:0/3049478778 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c2c15d070 con 0x7f0c2c13b920 2024-09-15T23:21:49.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.564+0000 7f0c1affd640 1 -- 172.21.15.123:0/3049478778 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c240133f0 con 0x7f0c2c13b920 2024-09-15T23:21:49.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.564+0000 7f0c30a53640 1 -- 172.21.15.123:0/3049478778 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c2c15d630 con 0x7f0c2c13b920 2024-09-15T23:21:49.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.565+0000 7f0c30a53640 1 -- 172.21.15.123:0/3049478778 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c2c06bc10 con 0x7f0c2c13b920 2024-09-15T23:21:49.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.565+0000 7f0c1affd640 1 -- 172.21.15.123:0/3049478778 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0c24013590 con 0x7f0c2c13b920 2024-09-15T23:21:49.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.566+0000 7f0c1affd640 1 --2- 172.21.15.123:0/3049478778 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0c0c06c2b0 0x7f0c0c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:49.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.566+0000 7f0c1affd640 1 -- 172.21.15.123:0/3049478778 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7f0c2408b8d0 con 0x7f0c2c13b920 2024-09-15T23:21:49.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.566+0000 7f0c2a59c640 1 --2- 172.21.15.123:0/3049478778 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0c0c06c2b0 0x7f0c0c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:49.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.566+0000 7f0c2a59c640 1 --2- 172.21.15.123:0/3049478778 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0c0c06c2b0 0x7f0c0c06e770 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c009c40 tx=0x7f0c1c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:49.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.570+0000 7f0c1affd640 1 -- 172.21.15.123:0/3049478778 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0c2405a040 con 0x7f0c2c13b920 2024-09-15T23:21:49.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.770+0000 7f0c30a53640 1 -- 172.21.15.123:0/3049478778 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c2c06c9c0 con 0x7f0c2c13b920 2024-09-15T23:21:49.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.771+0000 7f0c1affd640 1 -- 172.21.15.123:0/3049478778 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) ==== 95+0+5241 (secure 0 0 0) 0x7f0c24059940 con 0x7f0c2c13b920 2024-09-15T23:21:49.772 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:49.772 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":100,"btime":"2024-09-15T23:21:24:727971+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7214,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/1648353391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1648353391},{"type":"v1","addr":"172.21.15.188:6837","nonce":1648353391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8122,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/1714717257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":1714717257},{"type":"v1","addr":"172.21.15.188:6836","nonce":1714717257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":9552,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/3722702026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3722702026},{"type":"v1","addr":"172.21.15.123:6833","nonce":3722702026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:21:22.066391+0000","modified":"2024-09-15T23:21:24.056941+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9564},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9564":{"gid":9564,"name":"a","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/1883512279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1883512279},{"type":"v1","addr":"172.21.15.123:6835","nonce":1883512279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9564,"qdb_cluster":[9564]},"id":11}]} 2024-09-15T23:21:49.773 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 100 2024-09-15T23:21:49.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.773+0000 7f0c30a53640 1 -- 172.21.15.123:0/3049478778 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0c0c06c2b0 msgr2=0x7f0c0c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:49.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.773+0000 7f0c30a53640 1 --2- 172.21.15.123:0/3049478778 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0c0c06c2b0 0x7f0c0c06e770 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c009c40 tx=0x7f0c1c009190 comp rx=0 tx=0).stop 2024-09-15T23:21:49.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.773+0000 7f0c30a53640 1 -- 172.21.15.123:0/3049478778 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c2c13b920 msgr2=0x7f0c2c157fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:49.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.773+0000 7f0c30a53640 1 --2- 172.21.15.123:0/3049478778 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c2c13b920 0x7f0c2c157fb0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c0cdf80 tx=0x7f0c24007a60 comp rx=0 tx=0).stop 2024-09-15T23:21:49.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.773+0000 7f0c30a53640 1 -- 172.21.15.123:0/3049478778 shutdown_connections 2024-09-15T23:21:49.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.773+0000 7f0c30a53640 1 --2- 172.21.15.123:0/3049478778 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0c0c06c2b0 0x7f0c0c06e770 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:49.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.773+0000 7f0c30a53640 1 --2- 172.21.15.123:0/3049478778 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c2c13b920 0x7f0c2c157fb0 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:49.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.773+0000 7f0c30a53640 1 --2- 172.21.15.123:0/3049478778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c2c0b52a0 0x7f0c2c13b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:49.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.773+0000 7f0c30a53640 1 --2- 172.21.15.123:0/3049478778 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c14006160 0x7f0c2c0b6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:49.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.773+0000 7f0c30a53640 1 -- 172.21.15.123:0/3049478778 >> 172.21.15.123:0/3049478778 conn(0x7f0c2c0ccec0 msgr2=0x7f0c2c0d01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:49.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.773+0000 7f0c30a53640 1 -- 172.21.15.123:0/3049478778 shutdown_connections 2024-09-15T23:21:49.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.773+0000 7f0c30a53640 1 -- 172.21.15.123:0/3049478778 wait complete. 2024-09-15T23:21:49.785 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2024-09-15T23:21:49.785 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:21:49.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.881+0000 7fd432b3b640 1 Processor -- start 2024-09-15T23:21:49.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.881+0000 7fd432b3b640 1 -- start start 2024-09-15T23:21:49.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.881+0000 7fd432b3b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd42c0d23b0 0x7fd42c0b87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:49.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.881+0000 7fd432b3b640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd42c0d0e70 con 0x7fd42c0b6970 2024-09-15T23:21:49.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.881+0000 7fd432b3b640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd42c0d41c0 con 0x7fd42c15ed20 2024-09-15T23:21:49.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.881+0000 7fd432b3b640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fd42c0d35b0 con 0x7fd42c0d23b0 2024-09-15T23:21:49.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.882+0000 7fd4310d8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd42c0d23b0 0x7fd42c0b87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:49.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.882+0000 7fd42bfff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd42c0b6970 0x7fd42c0b80d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55114/0 (socket says 172.21.15.123:55114) 2024-09-15T23:21:49.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.882+0000 7fd4310d8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd42c0d23b0 0x7fd42c0b87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52556/0 (socket says 172.21.15.123:52556) 2024-09-15T23:21:49.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.882+0000 7fd42bfff640 1 -- 172.21.15.123:0/2000445427 learned_addr learned my addr 172.21.15.123:0/2000445427 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:21:49.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.882+0000 7fd4310d8640 1 -- 172.21.15.123:0/2000445427 >> v1:172.21.15.188:6789/0 conn(0x7fd42c15ed20 legacy=0x7fd42c0b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:49.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.882+0000 7fd4310d8640 1 -- 172.21.15.123:0/2000445427 >> v1:172.21.15.123:6789/0 conn(0x7fd42c0b6970 legacy=0x7fd42c0b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:49.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.882+0000 7fd4310d8640 1 -- 172.21.15.123:0/2000445427 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd42c0d3890 con 0x7fd42c0d23b0 2024-09-15T23:21:49.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.882+0000 7fd42b7fe640 1 -- 172.21.15.123:0/2000445427 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3880302867 0 0) 0x7fd418001110 con 0x7fd42c0b6970 2024-09-15T23:21:49.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.883+0000 7fd4310d8640 1 --2- 172.21.15.123:0/2000445427 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd42c0d23b0 0x7fd42c0b87e0 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7fd424009d90 tx=0x7fd42402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc4c7cbf31f52e42 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:49.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.883+0000 7fd42b7fe640 1 -- 172.21.15.123:0/2000445427 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd424007740 con 0x7fd42c0d23b0 2024-09-15T23:21:49.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.883+0000 7fd42b7fe640 1 -- 172.21.15.123:0/2000445427 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4240078e0 con 0x7fd42c0d23b0 2024-09-15T23:21:49.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.883+0000 7fd42b7fe640 1 -- 172.21.15.123:0/2000445427 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd424007cb0 con 0x7fd42c0d23b0 2024-09-15T23:21:49.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.883+0000 7fd432b3b640 1 -- 172.21.15.123:0/2000445427 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd42c0d23b0 msgr2=0x7fd42c0b87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:49.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.883+0000 7fd432b3b640 1 --2- 172.21.15.123:0/2000445427 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd42c0d23b0 0x7fd42c0b87e0 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7fd424009d90 tx=0x7fd42402a660 comp rx=0 tx=0).stop 2024-09-15T23:21:49.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.883+0000 7fd432b3b640 1 -- 172.21.15.123:0/2000445427 shutdown_connections 2024-09-15T23:21:49.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.883+0000 7fd432b3b640 1 --2- 172.21.15.123:0/2000445427 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd42c0d23b0 0x7fd42c0b87e0 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:49.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.883+0000 7fd432b3b640 1 -- 172.21.15.123:0/2000445427 >> 172.21.15.123:0/2000445427 conn(0x7fd42c0d1260 msgr2=0x7fd42c0d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:49.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.883+0000 7fd432b3b640 1 -- 172.21.15.123:0/2000445427 shutdown_connections 2024-09-15T23:21:49.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.883+0000 7fd432b3b640 1 -- 172.21.15.123:0/2000445427 wait complete. 2024-09-15T23:21:49.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.884+0000 7fd432b3b640 1 Processor -- start 2024-09-15T23:21:49.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.885+0000 7fd432b3b640 1 -- start start 2024-09-15T23:21:49.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.885+0000 7fd432b3b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd42c0b6970 0x7fd42c156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:49.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.885+0000 7fd432b3b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd42c0d23b0 0x7fd42c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:49.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.885+0000 7fd432b3b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd42c15ed20 0x7fd42c0b8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:49.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.885+0000 7fd432b3b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd42c0d32a0 con 0x7fd42c0d23b0 2024-09-15T23:21:49.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.885+0000 7fd432b3b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd42c0d3e50 con 0x7fd42c0b6970 2024-09-15T23:21:49.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.885+0000 7fd432b3b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd42c15f100 con 0x7fd42c15ed20 2024-09-15T23:21:49.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.885+0000 7fd42bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd42c0d23b0 0x7fd42c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:49.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.885+0000 7fd42bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd42c0d23b0 0x7fd42c154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52560/0 (socket says 172.21.15.123:52560) 2024-09-15T23:21:49.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.886+0000 7fd42bfff640 1 -- 172.21.15.123:0/4029017820 learned_addr learned my addr 172.21.15.123:0/4029017820 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:49.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.886+0000 7fd42bfff640 1 -- 172.21.15.123:0/4029017820 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd42c15ed20 msgr2=0x7fd42c0b8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:49.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.886+0000 7fd42bfff640 1 --2- 172.21.15.123:0/4029017820 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd42c15ed20 0x7fd42c0b8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:49.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.886+0000 7fd42bfff640 1 -- 172.21.15.123:0/4029017820 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd42c0b6970 msgr2=0x7fd42c156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:49.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.886+0000 7fd42bfff640 1 --2- 172.21.15.123:0/4029017820 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd42c0b6970 0x7fd42c156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:49.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.886+0000 7fd42bfff640 1 -- 172.21.15.123:0/4029017820 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd42c1576f0 con 0x7fd42c0d23b0 2024-09-15T23:21:49.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.886+0000 7fd42bfff640 1 --2- 172.21.15.123:0/4029017820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd42c0d23b0 0x7fd42c154f00 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7fd41800c3f0 tx=0x7fd41800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:49.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.886+0000 7fd4297fa640 1 -- 172.21.15.123:0/4029017820 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4180074e0 con 0x7fd42c0d23b0 2024-09-15T23:21:49.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.886+0000 7fd4297fa640 1 -- 172.21.15.123:0/4029017820 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4180047e0 con 0x7fd42c0d23b0 2024-09-15T23:21:49.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.886+0000 7fd432b3b640 1 -- 172.21.15.123:0/4029017820 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd42c1579d0 con 0x7fd42c0d23b0 2024-09-15T23:21:49.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.886+0000 7fd4297fa640 1 -- 172.21.15.123:0/4029017820 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd418004c10 con 0x7fd42c0d23b0 2024-09-15T23:21:49.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.886+0000 7fd432b3b640 1 -- 172.21.15.123:0/4029017820 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd42c157f90 con 0x7fd42c0d23b0 2024-09-15T23:21:49.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.887+0000 7fd432b3b640 1 -- 172.21.15.123:0/4029017820 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd42c0ba120 con 0x7fd42c0d23b0 2024-09-15T23:21:49.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.888+0000 7fd4297fa640 1 -- 172.21.15.123:0/4029017820 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd418011070 con 0x7fd42c0d23b0 2024-09-15T23:21:49.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.888+0000 7fd4297fa640 1 --2- 172.21.15.123:0/4029017820 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd41006c2b0 0x7fd41006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:49.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.888+0000 7fd4297fa640 1 -- 172.21.15.123:0/4029017820 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7fd41808afe0 con 0x7fd42c0d23b0 2024-09-15T23:21:49.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.888+0000 7fd4308d7640 1 --2- 172.21.15.123:0/4029017820 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd41006c2b0 0x7fd41006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:49.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.889+0000 7fd4308d7640 1 --2- 172.21.15.123:0/4029017820 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd41006c2b0 0x7fd41006e770 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fd420000f60 tx=0x7fd4200079b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:49.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:49.893+0000 7fd4297fa640 1 -- 172.21.15.123:0/4029017820 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd42c0ba120 con 0x7fd42c0d23b0 2024-09-15T23:21:50.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.123+0000 7fd432b3b640 1 -- 172.21.15.123:0/4029017820 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fd42c0b3f20 con 0x7fd42c0d23b0 2024-09-15T23:21:50.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.123+0000 7fd4297fa640 1 -- 172.21.15.123:0/4029017820 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1676 (secure 0 0 0) 0x7fd42c0d0e70 con 0x7fd42c0d23b0 2024-09-15T23:21:50.124 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:50.125 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":600,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":168,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1048,"data_bytes":1076567305,"bytes_used":2575884288,"bytes_avail":770518228992,"bytes_total":773094113280,"write_bytes_sec":72877625,"read_op_per_sec":0,"write_op_per_sec":72},"fsmap":{"epoch":100,"btime":"2024-09-15T23:21:24:727971+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"a","status":"up:active","gid":9564}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":27,"modified":"2024-09-15T23:21:49.641217+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T23:21:50.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.125+0000 7fd432b3b640 1 -- 172.21.15.123:0/4029017820 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd41006c2b0 msgr2=0x7fd41006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:50.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.125+0000 7fd432b3b640 1 --2- 172.21.15.123:0/4029017820 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd41006c2b0 0x7fd41006e770 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fd420000f60 tx=0x7fd4200079b0 comp rx=0 tx=0).stop 2024-09-15T23:21:50.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.125+0000 7fd432b3b640 1 -- 172.21.15.123:0/4029017820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd42c0d23b0 msgr2=0x7fd42c154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:50.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.125+0000 7fd432b3b640 1 --2- 172.21.15.123:0/4029017820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd42c0d23b0 0x7fd42c154f00 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7fd41800c3f0 tx=0x7fd41800c8b0 comp rx=0 tx=0).stop 2024-09-15T23:21:50.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.125+0000 7fd432b3b640 1 -- 172.21.15.123:0/4029017820 shutdown_connections 2024-09-15T23:21:50.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.125+0000 7fd432b3b640 1 --2- 172.21.15.123:0/4029017820 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd42c15ed20 0x7fd42c0b8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:50.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.125+0000 7fd432b3b640 1 --2- 172.21.15.123:0/4029017820 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd41006c2b0 0x7fd41006e770 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:50.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.125+0000 7fd432b3b640 1 --2- 172.21.15.123:0/4029017820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd42c0d23b0 0x7fd42c154f00 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:50.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.125+0000 7fd432b3b640 1 --2- 172.21.15.123:0/4029017820 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd42c0b6970 0x7fd42c156ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:50.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.125+0000 7fd432b3b640 1 -- 172.21.15.123:0/4029017820 >> 172.21.15.123:0/4029017820 conn(0x7fd42c0d1260 msgr2=0x7fd42c15dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:50.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.125+0000 7fd432b3b640 1 -- 172.21.15.123:0/4029017820 shutdown_connections 2024-09-15T23:21:50.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.125+0000 7fd432b3b640 1 -- 172.21.15.123:0/4029017820 wait complete. 2024-09-15T23:21:50.137 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/scrub_control_test_path]'} 2024-09-15T23:21:50.137 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T23:21:50.137 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:21:50.148 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T23:21:50.148 INFO:tasks.cephfs.test_scrub_checks:Waiting for promotion of one of the original standbys {'c', 'b', 'd'} 2024-09-15T23:21:50.148 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2024-09-15T23:21:50.291 INFO:teuthology.orchestra.run.smithi123.stdout:{"mds_beacon_grace":"15.000000"} 2024-09-15T23:21:50.292 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2024-09-15T23:21:50.292 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:21:50.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.390+0000 7fc337142640 1 Processor -- start 2024-09-15T23:21:50.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.390+0000 7fc337142640 1 -- start start 2024-09-15T23:21:50.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.390+0000 7fc337142640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc330158f80 0x7fc330071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:50.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.390+0000 7fc337142640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc33015b9a0 0x7fc3300b6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:50.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.390+0000 7fc337142640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc3300b70a0 0x7fc33015ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:50.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.390+0000 7fc337142640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc3300b7510 con 0x7fc33015b9a0 2024-09-15T23:21:50.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.390+0000 7fc337142640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fc330072930 con 0x7fc330158f80 2024-09-15T23:21:50.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.390+0000 7fc337142640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc330072c10 con 0x7fc3300b70a0 2024-09-15T23:21:50.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.391+0000 7fc32ffff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc33015b9a0 0x7fc3300b6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:50.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.391+0000 7fc32ffff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc33015b9a0 0x7fc3300b6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52562/0 (socket says 172.21.15.123:52562) 2024-09-15T23:21:50.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.391+0000 7fc32ffff640 1 -- 172.21.15.123:0/3700306972 learned_addr learned my addr 172.21.15.123:0/3700306972 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:50.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.391+0000 7fc32ffff640 1 -- 172.21.15.123:0/3700306972 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc3300b70a0 msgr2=0x7fc33015ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:50.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.391+0000 7fc334ede640 1 --2- 172.21.15.123:0/3700306972 >> v2:172.21.15.188:3300/0 conn(0x7fc330158f80 0x7fc330071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:50.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.391+0000 7fc32ffff640 1 --2- 172.21.15.123:0/3700306972 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc3300b70a0 0x7fc33015ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:50.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.391+0000 7fc32ffff640 1 -- 172.21.15.123:0/3700306972 >> v2:172.21.15.188:3300/0 conn(0x7fc330158f80 msgr2=0x7fc330071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:50.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.391+0000 7fc32ffff640 1 --2- 172.21.15.123:0/3700306972 >> v2:172.21.15.188:3300/0 conn(0x7fc330158f80 0x7fc330071fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:50.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.391+0000 7fc32ffff640 1 -- 172.21.15.123:0/3700306972 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc330072ef0 con 0x7fc33015b9a0 2024-09-15T23:21:50.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.392+0000 7fc32ffff640 1 --2- 172.21.15.123:0/3700306972 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc33015b9a0 0x7fc3300b6b60 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7fc3300757c0 tx=0x7fc32002c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=587f3cf230f916f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:50.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.392+0000 7fc32f7fe640 1 -- 172.21.15.123:0/3700306972 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32000b2e0 con 0x7fc33015b9a0 2024-09-15T23:21:50.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.392+0000 7fc32f7fe640 1 -- 172.21.15.123:0/3700306972 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc320009600 con 0x7fc33015b9a0 2024-09-15T23:21:50.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.392+0000 7fc32f7fe640 1 -- 172.21.15.123:0/3700306972 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32000b480 con 0x7fc33015b9a0 2024-09-15T23:21:50.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.392+0000 7fc337142640 1 -- 172.21.15.123:0/3700306972 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc33015b9a0 msgr2=0x7fc3300b6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:50.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.392+0000 7fc337142640 1 --2- 172.21.15.123:0/3700306972 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc33015b9a0 0x7fc3300b6b60 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7fc3300757c0 tx=0x7fc32002c8a0 comp rx=0 tx=0).stop 2024-09-15T23:21:50.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.392+0000 7fc337142640 1 -- 172.21.15.123:0/3700306972 shutdown_connections 2024-09-15T23:21:50.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.392+0000 7fc337142640 1 --2- 172.21.15.123:0/3700306972 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc3300b70a0 0x7fc33015ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:50.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.392+0000 7fc337142640 1 --2- 172.21.15.123:0/3700306972 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc33015b9a0 0x7fc3300b6b60 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:50.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.392+0000 7fc337142640 1 --2- 172.21.15.123:0/3700306972 >> v2:172.21.15.188:3300/0 conn(0x7fc330158f80 0x7fc330071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:50.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.392+0000 7fc337142640 1 -- 172.21.15.123:0/3700306972 >> 172.21.15.123:0/3700306972 conn(0x7fc33006cd20 msgr2=0x7fc33006d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:50.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.392+0000 7fc337142640 1 -- 172.21.15.123:0/3700306972 shutdown_connections 2024-09-15T23:21:50.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.392+0000 7fc337142640 1 -- 172.21.15.123:0/3700306972 wait complete. 2024-09-15T23:21:50.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.393+0000 7fc337142640 1 Processor -- start 2024-09-15T23:21:50.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.393+0000 7fc337142640 1 -- start start 2024-09-15T23:21:50.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.394+0000 7fc337142640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3300b70a0 0x7fc33014ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:50.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.394+0000 7fc337142640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc330158f80 0x7fc3301e5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:50.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.394+0000 7fc337142640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc33015b9a0 0x7fc3301e6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:50.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.394+0000 7fc337142640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc330072500 con 0x7fc3300b70a0 2024-09-15T23:21:50.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.394+0000 7fc337142640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc3300734b0 con 0x7fc33015b9a0 2024-09-15T23:21:50.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.394+0000 7fc337142640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc330072680 con 0x7fc330158f80 2024-09-15T23:21:50.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.394+0000 7fc334ede640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3300b70a0 0x7fc33014ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:50.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.394+0000 7fc334ede640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3300b70a0 0x7fc33014ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52566/0 (socket says 172.21.15.123:52566) 2024-09-15T23:21:50.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.394+0000 7fc334ede640 1 -- 172.21.15.123:0/997523254 learned_addr learned my addr 172.21.15.123:0/997523254 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:50.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.395+0000 7fc32ffff640 1 --2- 172.21.15.123:0/997523254 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc330158f80 0x7fc3301e5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:50.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.395+0000 7fc3356df640 1 --2- 172.21.15.123:0/997523254 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc33015b9a0 0x7fc3301e6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:50.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.395+0000 7fc334ede640 1 -- 172.21.15.123:0/997523254 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc330158f80 msgr2=0x7fc3301e5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:50.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.395+0000 7fc334ede640 1 --2- 172.21.15.123:0/997523254 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc330158f80 0x7fc3301e5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:50.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.395+0000 7fc334ede640 1 -- 172.21.15.123:0/997523254 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc33015b9a0 msgr2=0x7fc3301e6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:50.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.395+0000 7fc334ede640 1 --2- 172.21.15.123:0/997523254 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc33015b9a0 0x7fc3301e6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:50.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.395+0000 7fc334ede640 1 -- 172.21.15.123:0/997523254 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc33014f1f0 con 0x7fc3300b70a0 2024-09-15T23:21:50.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.395+0000 7fc334ede640 1 --2- 172.21.15.123:0/997523254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3300b70a0 0x7fc33014ea90 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7fc32800c820 tx=0x7fc32800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:50.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.395+0000 7fc32d7fa640 1 -- 172.21.15.123:0/997523254 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc328015070 con 0x7fc3300b70a0 2024-09-15T23:21:50.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.395+0000 7fc32d7fa640 1 -- 172.21.15.123:0/997523254 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc328004240 con 0x7fc3300b70a0 2024-09-15T23:21:50.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.395+0000 7fc337142640 1 -- 172.21.15.123:0/997523254 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc33014f490 con 0x7fc3300b70a0 2024-09-15T23:21:50.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.395+0000 7fc32d7fa640 1 -- 172.21.15.123:0/997523254 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32800ce10 con 0x7fc3300b70a0 2024-09-15T23:21:50.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.395+0000 7fc337142640 1 -- 172.21.15.123:0/997523254 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc33014fa50 con 0x7fc3300b70a0 2024-09-15T23:21:50.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.396+0000 7fc337142640 1 -- 172.21.15.123:0/997523254 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc330073f20 con 0x7fc3300b70a0 2024-09-15T23:21:50.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.397+0000 7fc32d7fa640 1 -- 172.21.15.123:0/997523254 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc328007830 con 0x7fc3300b70a0 2024-09-15T23:21:50.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.397+0000 7fc32d7fa640 1 --2- 172.21.15.123:0/997523254 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc31006c2b0 0x7fc31006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:50.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.397+0000 7fc32d7fa640 1 -- 172.21.15.123:0/997523254 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7fc32808b1e0 con 0x7fc3300b70a0 2024-09-15T23:21:50.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.397+0000 7fc32ffff640 1 --2- 172.21.15.123:0/997523254 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc31006c2b0 0x7fc31006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:50.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.398+0000 7fc32ffff640 1 --2- 172.21.15.123:0/997523254 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc31006c2b0 0x7fc31006e770 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fc320036000 tx=0x7fc32000b000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:50.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.401+0000 7fc32d7fa640 1 -- 172.21.15.123:0/997523254 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc330073f20 con 0x7fc3300b70a0 2024-09-15T23:21:50.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.601+0000 7fc337142640 1 -- 172.21.15.123:0/997523254 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc3300739d0 con 0x7fc3300b70a0 2024-09-15T23:21:50.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.601+0000 7fc32d7fa640 1 -- 172.21.15.123:0/997523254 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) ==== 95+0+5241 (secure 0 0 0) 0x7fc328059390 con 0x7fc3300b70a0 2024-09-15T23:21:50.604 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:50.604 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":100,"btime":"2024-09-15T23:21:24:727971+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7214,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/1648353391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1648353391},{"type":"v1","addr":"172.21.15.188:6837","nonce":1648353391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8122,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/1714717257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":1714717257},{"type":"v1","addr":"172.21.15.188:6836","nonce":1714717257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":9552,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/3722702026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3722702026},{"type":"v1","addr":"172.21.15.123:6833","nonce":3722702026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:21:22.066391+0000","modified":"2024-09-15T23:21:24.056941+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9564},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9564":{"gid":9564,"name":"a","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/1883512279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1883512279},{"type":"v1","addr":"172.21.15.123:6835","nonce":1883512279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9564,"qdb_cluster":[9564]},"id":11}]} 2024-09-15T23:21:50.605 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 100 2024-09-15T23:21:50.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.603+0000 7fc337142640 1 -- 172.21.15.123:0/997523254 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc31006c2b0 msgr2=0x7fc31006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:50.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.603+0000 7fc337142640 1 --2- 172.21.15.123:0/997523254 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc31006c2b0 0x7fc31006e770 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fc320036000 tx=0x7fc32000b000 comp rx=0 tx=0).stop 2024-09-15T23:21:50.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.603+0000 7fc337142640 1 -- 172.21.15.123:0/997523254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3300b70a0 msgr2=0x7fc33014ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:50.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.603+0000 7fc337142640 1 --2- 172.21.15.123:0/997523254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3300b70a0 0x7fc33014ea90 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7fc32800c820 tx=0x7fc32800cce0 comp rx=0 tx=0).stop 2024-09-15T23:21:50.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.603+0000 7fc337142640 1 -- 172.21.15.123:0/997523254 shutdown_connections 2024-09-15T23:21:50.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.603+0000 7fc337142640 1 --2- 172.21.15.123:0/997523254 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc33015b9a0 0x7fc3301e6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:50.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.603+0000 7fc337142640 1 --2- 172.21.15.123:0/997523254 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc330158f80 0x7fc3301e5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:50.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.603+0000 7fc337142640 1 --2- 172.21.15.123:0/997523254 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc31006c2b0 0x7fc31006e770 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:50.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.603+0000 7fc337142640 1 --2- 172.21.15.123:0/997523254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc3300b70a0 0x7fc33014ea90 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:50.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.603+0000 7fc337142640 1 -- 172.21.15.123:0/997523254 >> 172.21.15.123:0/997523254 conn(0x7fc33006cd20 msgr2=0x7fc330158220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:50.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.603+0000 7fc337142640 1 -- 172.21.15.123:0/997523254 shutdown_connections 2024-09-15T23:21:50.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:50.604+0000 7fc337142640 1 -- 172.21.15.123:0/997523254 wait complete. 2024-09-15T23:21:50.616 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-15T23:21:55.617 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:21:55.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.729+0000 7f3b945bd640 1 Processor -- start 2024-09-15T23:21:55.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.729+0000 7f3b945bd640 1 -- start start 2024-09-15T23:21:55.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.730+0000 7f3b945bd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3b8c15ed20 0x7f3b8c0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:55.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.730+0000 7f3b945bd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3b8c0b90e0 0x7f3b8c0b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:55.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.730+0000 7f3b945bd640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b8c0d0e70 con 0x7f3b8c0d23b0 2024-09-15T23:21:55.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.730+0000 7f3b945bd640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f3b8c0d41c0 con 0x7f3b8c15ed20 2024-09-15T23:21:55.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.730+0000 7f3b945bd640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f3b8c0d35b0 con 0x7f3b8c0b90e0 2024-09-15T23:21:55.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.731+0000 7f3b92359640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3b8c15ed20 0x7f3b8c0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:55.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.731+0000 7f3b91b58640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f3b8c0d23b0 0x7f3b8c0cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55130/0 (socket says 172.21.15.123:55130) 2024-09-15T23:21:55.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.731+0000 7f3b91b58640 1 -- 172.21.15.123:0/868888853 learned_addr learned my addr 172.21.15.123:0/868888853 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:21:55.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.731+0000 7f3b92b5a640 1 --2- 172.21.15.123:0/868888853 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3b8c0b90e0 0x7f3b8c0b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:55.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.731+0000 7f3b91357640 1 -- 172.21.15.123:0/868888853 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2377292801 0 0) 0x7f3b7c001110 con 0x7f3b8c0d23b0 2024-09-15T23:21:55.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.731+0000 7f3b91357640 1 -- 172.21.15.123:0/868888853 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b78003520 con 0x7f3b8c0d23b0 2024-09-15T23:21:55.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.731+0000 7f3b92359640 1 -- 172.21.15.123:0/868888853 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3b8c0b90e0 msgr2=0x7f3b8c0b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:21:55.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.731+0000 7f3b92359640 1 --2- 172.21.15.123:0/868888853 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3b8c0b90e0 0x7f3b8c0b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:55.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.731+0000 7f3b92359640 1 -- 172.21.15.123:0/868888853 >> v1:172.21.15.123:6789/0 conn(0x7f3b8c0d23b0 legacy=0x7f3b8c0cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:55.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.731+0000 7f3b92359640 1 -- 172.21.15.123:0/868888853 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b8c0d3890 con 0x7f3b8c15ed20 2024-09-15T23:21:55.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.732+0000 7f3b92359640 1 --2- 172.21.15.123:0/868888853 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b8c15ed20 0x7f3b8c0b6260 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f3b88009d90 tx=0x7f3b8802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f966b183a85347 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:55.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.732+0000 7f3b91357640 1 -- 172.21.15.123:0/868888853 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b88031600 con 0x7f3b8c15ed20 2024-09-15T23:21:55.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.732+0000 7f3b91357640 1 -- 172.21.15.123:0/868888853 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b880317a0 con 0x7f3b8c15ed20 2024-09-15T23:21:55.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.732+0000 7f3b91357640 1 -- 172.21.15.123:0/868888853 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b88031b70 con 0x7f3b8c15ed20 2024-09-15T23:21:55.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.732+0000 7f3b945bd640 1 -- 172.21.15.123:0/868888853 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b8c15ed20 msgr2=0x7f3b8c0b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:55.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.732+0000 7f3b945bd640 1 --2- 172.21.15.123:0/868888853 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b8c15ed20 0x7f3b8c0b6260 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f3b88009d90 tx=0x7f3b8802a5d0 comp rx=0 tx=0).stop 2024-09-15T23:21:55.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.733+0000 7f3b945bd640 1 -- 172.21.15.123:0/868888853 shutdown_connections 2024-09-15T23:21:55.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.733+0000 7f3b945bd640 1 --2- 172.21.15.123:0/868888853 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3b8c0b90e0 0x7f3b8c0b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:55.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.733+0000 7f3b945bd640 1 --2- 172.21.15.123:0/868888853 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b8c15ed20 0x7f3b8c0b6260 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:55.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.733+0000 7f3b945bd640 1 -- 172.21.15.123:0/868888853 >> 172.21.15.123:0/868888853 conn(0x7f3b8c0d1260 msgr2=0x7f3b8c0d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:55.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.733+0000 7f3b945bd640 1 -- 172.21.15.123:0/868888853 shutdown_connections 2024-09-15T23:21:55.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.733+0000 7f3b945bd640 1 -- 172.21.15.123:0/868888853 wait complete. 2024-09-15T23:21:55.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.734+0000 7f3b945bd640 1 Processor -- start 2024-09-15T23:21:55.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.734+0000 7f3b945bd640 1 -- start start 2024-09-15T23:21:55.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.735+0000 7f3b945bd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3b8c0b90e0 0x7f3b8c1599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:55.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.735+0000 7f3b945bd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3b8c0d23b0 0x7f3b8c0cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:55.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.735+0000 7f3b945bd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b8c15ed20 0x7f3b8c15f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:55.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.735+0000 7f3b945bd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c0d32a0 con 0x7f3b8c15ed20 2024-09-15T23:21:55.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.735+0000 7f3b945bd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c0d3e50 con 0x7f3b8c0b90e0 2024-09-15T23:21:55.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.735+0000 7f3b945bd640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f3b8c15f100 con 0x7f3b8c0d23b0 2024-09-15T23:21:55.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.735+0000 7f3b92b5a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b8c15ed20 0x7f3b8c15f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:55.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.735+0000 7f3b92b5a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b8c15ed20 0x7f3b8c15f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:52590/0 (socket says 172.21.15.123:52590) 2024-09-15T23:21:55.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.735+0000 7f3b92b5a640 1 -- 172.21.15.123:0/2601734901 learned_addr learned my addr 172.21.15.123:0/2601734901 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:21:55.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.735+0000 7f3b92359640 1 --2- 172.21.15.123:0/2601734901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3b8c0b90e0 0x7f3b8c1599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:55.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.735+0000 7f3b91b58640 1 --2- 172.21.15.123:0/2601734901 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3b8c0d23b0 0x7f3b8c0cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:55.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.735+0000 7f3b92b5a640 1 -- 172.21.15.123:0/2601734901 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3b8c0d23b0 msgr2=0x7f3b8c0cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:55.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.735+0000 7f3b92b5a640 1 --2- 172.21.15.123:0/2601734901 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3b8c0d23b0 0x7f3b8c0cdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:55.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.735+0000 7f3b92b5a640 1 -- 172.21.15.123:0/2601734901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3b8c0b90e0 msgr2=0x7f3b8c1599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:55.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.735+0000 7f3b92b5a640 1 --2- 172.21.15.123:0/2601734901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3b8c0b90e0 0x7f3b8c1599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:55.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.735+0000 7f3b92b5a640 1 -- 172.21.15.123:0/2601734901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b8c0ce4a0 con 0x7f3b8c15ed20 2024-09-15T23:21:55.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.735+0000 7f3b92b5a640 1 --2- 172.21.15.123:0/2601734901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b8c15ed20 0x7f3b8c15f390 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f3b8400e7f0 tx=0x7f3b8400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:55.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.735+0000 7f3b82ffd640 1 -- 172.21.15.123:0/2601734901 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b84017070 con 0x7f3b8c15ed20 2024-09-15T23:21:55.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.735+0000 7f3b82ffd640 1 -- 172.21.15.123:0/2601734901 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b8400ee40 con 0x7f3b8c15ed20 2024-09-15T23:21:55.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.735+0000 7f3b82ffd640 1 -- 172.21.15.123:0/2601734901 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8400cb80 con 0x7f3b8c15ed20 2024-09-15T23:21:55.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.735+0000 7f3b945bd640 1 -- 172.21.15.123:0/2601734901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b8c0ce780 con 0x7f3b8c15ed20 2024-09-15T23:21:55.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.736+0000 7f3b945bd640 1 -- 172.21.15.123:0/2601734901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b8c0cdfe0 con 0x7f3b8c15ed20 2024-09-15T23:21:55.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.736+0000 7f3b945bd640 1 -- 172.21.15.123:0/2601734901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b8c151510 con 0x7f3b8c15ed20 2024-09-15T23:21:55.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.737+0000 7f3b82ffd640 1 -- 172.21.15.123:0/2601734901 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3b8401a070 con 0x7f3b8c15ed20 2024-09-15T23:21:55.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.737+0000 7f3b82ffd640 1 --2- 172.21.15.123:0/2601734901 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3b7006c2b0 0x7f3b7006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:55.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.737+0000 7f3b82ffd640 1 -- 172.21.15.123:0/2601734901 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 5709+0+0 (secure 0 0 0) 0x7f3b8408b590 con 0x7f3b8c15ed20 2024-09-15T23:21:55.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.738+0000 7f3b92359640 1 --2- 172.21.15.123:0/2601734901 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3b7006c2b0 0x7f3b7006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:55.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.738+0000 7f3b92359640 1 --2- 172.21.15.123:0/2601734901 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3b7006c2b0 0x7f3b7006e770 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f3b88034000 tx=0x7f3b8802f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:55.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.742+0000 7f3b82ffd640 1 -- 172.21.15.123:0/2601734901 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3b840596b0 con 0x7f3b8c15ed20 2024-09-15T23:21:55.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.942+0000 7f3b945bd640 1 -- 172.21.15.123:0/2601734901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b8c0b7010 con 0x7f3b8c15ed20 2024-09-15T23:21:55.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.942+0000 7f3b82ffd640 1 -- 172.21.15.123:0/2601734901 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) ==== 95+0+5241 (secure 0 0 0) 0x7f3b8405d9b0 con 0x7f3b8c15ed20 2024-09-15T23:21:55.944 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:21:55.944 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":100,"btime":"2024-09-15T23:21:24:727971+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7214,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/1648353391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1648353391},{"type":"v1","addr":"172.21.15.188:6837","nonce":1648353391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8122,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/1714717257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":1714717257},{"type":"v1","addr":"172.21.15.188:6836","nonce":1714717257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":9552,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/3722702026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3722702026},{"type":"v1","addr":"172.21.15.123:6833","nonce":3722702026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:21:22.066391+0000","modified":"2024-09-15T23:21:24.056941+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9564},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9564":{"gid":9564,"name":"a","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/1883512279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1883512279},{"type":"v1","addr":"172.21.15.123:6835","nonce":1883512279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9564,"qdb_cluster":[9564]},"id":11}]} 2024-09-15T23:21:55.944 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 100 2024-09-15T23:21:55.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.944+0000 7f3b945bd640 1 -- 172.21.15.123:0/2601734901 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3b7006c2b0 msgr2=0x7f3b7006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:55.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.944+0000 7f3b945bd640 1 --2- 172.21.15.123:0/2601734901 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3b7006c2b0 0x7f3b7006e770 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f3b88034000 tx=0x7f3b8802f000 comp rx=0 tx=0).stop 2024-09-15T23:21:55.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.944+0000 7f3b945bd640 1 -- 172.21.15.123:0/2601734901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b8c15ed20 msgr2=0x7f3b8c15f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:55.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.944+0000 7f3b945bd640 1 --2- 172.21.15.123:0/2601734901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b8c15ed20 0x7f3b8c15f390 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f3b8400e7f0 tx=0x7f3b8400ebf0 comp rx=0 tx=0).stop 2024-09-15T23:21:55.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.944+0000 7f3b945bd640 1 -- 172.21.15.123:0/2601734901 shutdown_connections 2024-09-15T23:21:55.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.944+0000 7f3b945bd640 1 --2- 172.21.15.123:0/2601734901 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3b7006c2b0 0x7f3b7006e770 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:55.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.944+0000 7f3b945bd640 1 --2- 172.21.15.123:0/2601734901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b8c15ed20 0x7f3b8c15f390 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:55.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.944+0000 7f3b945bd640 1 --2- 172.21.15.123:0/2601734901 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3b8c0d23b0 0x7f3b8c0cdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:55.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.944+0000 7f3b945bd640 1 --2- 172.21.15.123:0/2601734901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3b8c0b90e0 0x7f3b8c1599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:55.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.944+0000 7f3b945bd640 1 -- 172.21.15.123:0/2601734901 >> 172.21.15.123:0/2601734901 conn(0x7f3b8c0d1260 msgr2=0x7f3b8c0b5430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:55.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.944+0000 7f3b945bd640 1 -- 172.21.15.123:0/2601734901 shutdown_connections 2024-09-15T23:21:55.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:21:55.945+0000 7f3b945bd640 1 -- 172.21.15.123:0/2601734901 wait complete. 2024-09-15T23:21:55.957 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-15T23:22:00.957 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:22:01.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.072+0000 7f26f66ba640 1 Processor -- start 2024-09-15T23:22:01.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.072+0000 7f26f66ba640 1 -- start start 2024-09-15T23:22:01.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.073+0000 7f26f66ba640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f26f014c480 0x7f26f0163be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:01.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.073+0000 7f26f66ba640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26f0073bc0 0x7f26f006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:01.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.073+0000 7f26f66ba640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26f0164120 con 0x7f26f0073750 2024-09-15T23:22:01.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.073+0000 7f26f66ba640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f26f00732c0 con 0x7f26f014c480 2024-09-15T23:22:01.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.073+0000 7f26f66ba640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f26f00712a0 con 0x7f26f0073bc0 2024-09-15T23:22:01.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.073+0000 7f26effff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f26f014c480 0x7f26f0163be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:01.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.073+0000 7f26ef7fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f26f0073750 0x7f26f0164650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:47316/0 (socket says 172.21.15.123:47316) 2024-09-15T23:22:01.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.073+0000 7f26ef7fe640 1 -- 172.21.15.123:0/820277329 learned_addr learned my addr 172.21.15.123:0/820277329 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:01.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.073+0000 7f26f4c57640 1 --2- 172.21.15.123:0/820277329 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26f0073bc0 0x7f26f006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:01.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.073+0000 7f26effff640 1 -- 172.21.15.123:0/820277329 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26f0073bc0 msgr2=0x7f26f006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:01.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.073+0000 7f26effff640 1 --2- 172.21.15.123:0/820277329 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26f0073bc0 0x7f26f006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:01.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.073+0000 7f26effff640 1 -- 172.21.15.123:0/820277329 >> v1:172.21.15.123:6789/0 conn(0x7f26f0073750 legacy=0x7f26f0164650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:01.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.073+0000 7f26eeffd640 1 -- 172.21.15.123:0/820277329 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3581461658 0 0) 0x7f26e4001110 con 0x7f26f0073750 2024-09-15T23:22:01.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.073+0000 7f26effff640 1 -- 172.21.15.123:0/820277329 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f0072c70 con 0x7f26f014c480 2024-09-15T23:22:01.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.074+0000 7f26effff640 1 --2- 172.21.15.123:0/820277329 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26f014c480 0x7f26f0163be0 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f26e00097a0 tx=0x7f26e002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a8d069a57292dd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:01.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.074+0000 7f26eeffd640 1 -- 172.21.15.123:0/820277329 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e0037070 con 0x7f26f014c480 2024-09-15T23:22:01.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.074+0000 7f26eeffd640 1 -- 172.21.15.123:0/820277329 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26e0032440 con 0x7f26f014c480 2024-09-15T23:22:01.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.074+0000 7f26eeffd640 1 -- 172.21.15.123:0/820277329 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e0032810 con 0x7f26f014c480 2024-09-15T23:22:01.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.075+0000 7f26f66ba640 1 -- 172.21.15.123:0/820277329 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26f014c480 msgr2=0x7f26f0163be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:01.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.075+0000 7f26f66ba640 1 --2- 172.21.15.123:0/820277329 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26f014c480 0x7f26f0163be0 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f26e00097a0 tx=0x7f26e002a180 comp rx=0 tx=0).stop 2024-09-15T23:22:01.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.075+0000 7f26f66ba640 1 -- 172.21.15.123:0/820277329 shutdown_connections 2024-09-15T23:22:01.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.075+0000 7f26f66ba640 1 --2- 172.21.15.123:0/820277329 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26f0073bc0 0x7f26f006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:01.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.075+0000 7f26f66ba640 1 --2- 172.21.15.123:0/820277329 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26f014c480 0x7f26f0163be0 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:01.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.075+0000 7f26f66ba640 1 -- 172.21.15.123:0/820277329 >> 172.21.15.123:0/820277329 conn(0x7f26f00ccec0 msgr2=0x7f26f00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:01.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.075+0000 7f26f66ba640 1 -- 172.21.15.123:0/820277329 shutdown_connections 2024-09-15T23:22:01.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.075+0000 7f26f66ba640 1 -- 172.21.15.123:0/820277329 wait complete. 2024-09-15T23:22:01.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.076+0000 7f26f66ba640 1 Processor -- start 2024-09-15T23:22:01.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.077+0000 7f26f66ba640 1 -- start start 2024-09-15T23:22:01.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.077+0000 7f26f66ba640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26f0073750 0x7f26f0160410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:01.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.077+0000 7f26f66ba640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26f0073bc0 0x7f26f014b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:01.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.077+0000 7f26f66ba640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26f014c480 0x7f26f0149a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:01.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.077+0000 7f26f66ba640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f26f0071580 con 0x7f26f0073bc0 2024-09-15T23:22:01.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.077+0000 7f26f66ba640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f26f0070f70 con 0x7f26f014c480 2024-09-15T23:22:01.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.077+0000 7f26f66ba640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f26f00b6350 con 0x7f26f0073750 2024-09-15T23:22:01.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.077+0000 7f26ef7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26f0073bc0 0x7f26f014b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:01.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.077+0000 7f26ef7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26f0073bc0 0x7f26f014b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57776/0 (socket says 172.21.15.123:57776) 2024-09-15T23:22:01.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.077+0000 7f26ef7fe640 1 -- 172.21.15.123:0/1910942118 learned_addr learned my addr 172.21.15.123:0/1910942118 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:01.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.078+0000 7f26effff640 1 --2- 172.21.15.123:0/1910942118 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26f0073750 0x7f26f0160410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:01.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.078+0000 7f26f4c57640 1 --2- 172.21.15.123:0/1910942118 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26f014c480 0x7f26f0149a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:01.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.078+0000 7f26ef7fe640 1 -- 172.21.15.123:0/1910942118 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26f0073750 msgr2=0x7f26f0160410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:01.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.078+0000 7f26ef7fe640 1 --2- 172.21.15.123:0/1910942118 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26f0073750 0x7f26f0160410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:01.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.078+0000 7f26ef7fe640 1 -- 172.21.15.123:0/1910942118 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26f014c480 msgr2=0x7f26f0149a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:01.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.078+0000 7f26ef7fe640 1 --2- 172.21.15.123:0/1910942118 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26f014c480 0x7f26f0149a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:01.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.078+0000 7f26ef7fe640 1 -- 172.21.15.123:0/1910942118 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f0160950 con 0x7f26f0073bc0 2024-09-15T23:22:01.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.078+0000 7f26f4c57640 1 --2- 172.21.15.123:0/1910942118 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26f014c480 0x7f26f0149a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:01.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.078+0000 7f26ef7fe640 1 --2- 172.21.15.123:0/1910942118 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26f0073bc0 0x7f26f014b440 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f26e400c780 tx=0x7f26e400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:01.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.078+0000 7f26ecff9640 1 -- 172.21.15.123:0/1910942118 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e4018070 con 0x7f26f0073bc0 2024-09-15T23:22:01.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.078+0000 7f26ecff9640 1 -- 172.21.15.123:0/1910942118 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26e40072d0 con 0x7f26f0073bc0 2024-09-15T23:22:01.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.078+0000 7f26ecff9640 1 -- 172.21.15.123:0/1910942118 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e40047e0 con 0x7f26f0073bc0 2024-09-15T23:22:01.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.078+0000 7f26f66ba640 1 -- 172.21.15.123:0/1910942118 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26f014b980 con 0x7f26f0073bc0 2024-09-15T23:22:01.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.078+0000 7f26f66ba640 1 -- 172.21.15.123:0/1910942118 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26f014a680 con 0x7f26f0073bc0 2024-09-15T23:22:01.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.079+0000 7f26f66ba640 1 -- 172.21.15.123:0/1910942118 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26f0163be0 con 0x7f26f0073bc0 2024-09-15T23:22:01.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.080+0000 7f26ecff9640 1 -- 172.21.15.123:0/1910942118 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f26e401b070 con 0x7f26f0073bc0 2024-09-15T23:22:01.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.080+0000 7f26ecff9640 1 --2- 172.21.15.123:0/1910942118 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f26dc06c2b0 0x7f26dc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:01.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.080+0000 7f26ecff9640 1 -- 172.21.15.123:0/1910942118 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(170..170 src has 1..170) ==== 5796+0+0 (secure 0 0 0) 0x7f26e408a700 con 0x7f26f0073bc0 2024-09-15T23:22:01.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.081+0000 7f26effff640 1 --2- 172.21.15.123:0/1910942118 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f26dc06c2b0 0x7f26dc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:01.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.081+0000 7f26effff640 1 --2- 172.21.15.123:0/1910942118 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f26dc06c2b0 0x7f26dc06e770 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f26e0034000 tx=0x7f26e002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:01.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.085+0000 7f26ecff9640 1 -- 172.21.15.123:0/1910942118 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f26f0160950 con 0x7f26f0073bc0 2024-09-15T23:22:01.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.283+0000 7f26f66ba640 1 -- 172.21.15.123:0/1910942118 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f26f00cdbf0 con 0x7f26f0073bc0 2024-09-15T23:22:01.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.284+0000 7f26ecff9640 1 -- 172.21.15.123:0/1910942118 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) ==== 95+0+5241 (secure 0 0 0) 0x7f26f0164120 con 0x7f26f0073bc0 2024-09-15T23:22:01.285 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:22:01.285 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":100,"btime":"2024-09-15T23:21:24:727971+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7214,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/1648353391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1648353391},{"type":"v1","addr":"172.21.15.188:6837","nonce":1648353391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8122,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/1714717257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":1714717257},{"type":"v1","addr":"172.21.15.188:6836","nonce":1714717257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":9552,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/3722702026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3722702026},{"type":"v1","addr":"172.21.15.123:6833","nonce":3722702026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:21:22.066391+0000","modified":"2024-09-15T23:21:24.056941+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9564},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9564":{"gid":9564,"name":"a","rank":0,"incarnation":98,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/1883512279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1883512279},{"type":"v1","addr":"172.21.15.123:6835","nonce":1883512279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9564,"qdb_cluster":[9564]},"id":11}]} 2024-09-15T23:22:01.286 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 100 2024-09-15T23:22:01.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.286+0000 7f26f66ba640 1 -- 172.21.15.123:0/1910942118 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f26dc06c2b0 msgr2=0x7f26dc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:01.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.286+0000 7f26f66ba640 1 --2- 172.21.15.123:0/1910942118 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f26dc06c2b0 0x7f26dc06e770 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f26e0034000 tx=0x7f26e002e000 comp rx=0 tx=0).stop 2024-09-15T23:22:01.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.286+0000 7f26f66ba640 1 -- 172.21.15.123:0/1910942118 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26f0073bc0 msgr2=0x7f26f014b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.286+0000 7f26f66ba640 1 --2- 172.21.15.123:0/1910942118 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26f0073bc0 0x7f26f014b440 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f26e400c780 tx=0x7f26e400cc40 comp rx=0 tx=0).stop 2024-09-15T23:22:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.286+0000 7f26f66ba640 1 -- 172.21.15.123:0/1910942118 shutdown_connections 2024-09-15T23:22:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.286+0000 7f26f66ba640 1 --2- 172.21.15.123:0/1910942118 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26f014c480 0x7f26f0149a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.286+0000 7f26f66ba640 1 --2- 172.21.15.123:0/1910942118 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f26dc06c2b0 0x7f26dc06e770 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.286+0000 7f26f66ba640 1 --2- 172.21.15.123:0/1910942118 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26f0073bc0 0x7f26f014b440 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.286+0000 7f26f66ba640 1 --2- 172.21.15.123:0/1910942118 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26f0073750 0x7f26f0160410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.286+0000 7f26f66ba640 1 -- 172.21.15.123:0/1910942118 >> 172.21.15.123:0/1910942118 conn(0x7f26f00ccec0 msgr2=0x7f26f00cdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.286+0000 7f26f66ba640 1 -- 172.21.15.123:0/1910942118 shutdown_connections 2024-09-15T23:22:01.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:01.286+0000 7f26f66ba640 1 -- 172.21.15.123:0/1910942118 wait complete. 2024-09-15T23:22:01.298 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-15T23:22:06.299 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:22:06.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.412+0000 7f063b398640 1 Processor -- start 2024-09-15T23:22:06.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.412+0000 7f063b398640 1 -- start start 2024-09-15T23:22:06.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.413+0000 7f063b398640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0634145ed0 0x7f06340b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:06.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.413+0000 7f063b398640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f06340b5f90 0x7f06340735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:06.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.413+0000 7f063b398640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06340b4020 con 0x7f0634073180 2024-09-15T23:22:06.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.413+0000 7f063b398640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f06340b63d0 con 0x7f0634145ed0 2024-09-15T23:22:06.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.413+0000 7f063b398640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f0634073b00 con 0x7f06340b5f90 2024-09-15T23:22:06.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.413+0000 7f0639134640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0634145ed0 0x7f06340b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:06.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.413+0000 7f0638933640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f0634073180 0x7f06340b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41866/0 (socket says 172.21.15.123:41866) 2024-09-15T23:22:06.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.413+0000 7f0638933640 1 -- 172.21.15.123:0/2896274126 learned_addr learned my addr 172.21.15.123:0/2896274126 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:06.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.414+0000 7f0639134640 1 -- 172.21.15.123:0/2896274126 >> v2:172.21.15.188:3300/0 conn(0x7f06340b5f90 msgr2=0x7f06340735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:06.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.414+0000 7f0639935640 1 --2- 172.21.15.123:0/2896274126 >> v2:172.21.15.188:3300/0 conn(0x7f06340b5f90 0x7f06340735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:06.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.414+0000 7f0639134640 1 --2- 172.21.15.123:0/2896274126 >> v2:172.21.15.188:3300/0 conn(0x7f06340b5f90 0x7f06340735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:06.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.414+0000 7f0639134640 1 -- 172.21.15.123:0/2896274126 >> v1:172.21.15.123:6789/0 conn(0x7f0634073180 legacy=0x7f06340b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:06.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.414+0000 7f0639134640 1 -- 172.21.15.123:0/2896274126 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06340b42c0 con 0x7f0634145ed0 2024-09-15T23:22:06.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.414+0000 7f062bfff640 1 -- 172.21.15.123:0/2896274126 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 97898116 0 0) 0x7f06340b4020 con 0x7f0634073180 2024-09-15T23:22:06.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.414+0000 7f0639935640 1 --2- 172.21.15.123:0/2896274126 >> v2:172.21.15.188:3300/0 conn(0x7f06340b5f90 0x7f06340735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:22:06.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.414+0000 7f0639134640 1 --2- 172.21.15.123:0/2896274126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0634145ed0 0x7f06340b5080 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f0634070080 tx=0x7f063002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82b7df8ce08dd5bd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:06.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.415+0000 7f062bfff640 1 -- 172.21.15.123:0/2896274126 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0630037070 con 0x7f0634145ed0 2024-09-15T23:22:06.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.415+0000 7f062bfff640 1 -- 172.21.15.123:0/2896274126 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0630032440 con 0x7f0634145ed0 2024-09-15T23:22:06.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.415+0000 7f062bfff640 1 -- 172.21.15.123:0/2896274126 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0630032810 con 0x7f0634145ed0 2024-09-15T23:22:06.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.415+0000 7f063b398640 1 -- 172.21.15.123:0/2896274126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0634145ed0 msgr2=0x7f06340b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:06.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.415+0000 7f063b398640 1 --2- 172.21.15.123:0/2896274126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0634145ed0 0x7f06340b5080 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f0634070080 tx=0x7f063002a1a0 comp rx=0 tx=0).stop 2024-09-15T23:22:06.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.415+0000 7f063b398640 1 -- 172.21.15.123:0/2896274126 shutdown_connections 2024-09-15T23:22:06.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.415+0000 7f063b398640 1 --2- 172.21.15.123:0/2896274126 >> v2:172.21.15.188:3300/0 conn(0x7f06340b5f90 0x7f06340735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:06.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.415+0000 7f063b398640 1 --2- 172.21.15.123:0/2896274126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0634145ed0 0x7f06340b5080 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:06.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.415+0000 7f063b398640 1 -- 172.21.15.123:0/2896274126 >> 172.21.15.123:0/2896274126 conn(0x7f06340ccec0 msgr2=0x7f06340cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:06.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.415+0000 7f063b398640 1 -- 172.21.15.123:0/2896274126 shutdown_connections 2024-09-15T23:22:06.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.415+0000 7f063b398640 1 -- 172.21.15.123:0/2896274126 wait complete. 2024-09-15T23:22:06.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.416+0000 7f063b398640 1 Processor -- start 2024-09-15T23:22:06.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.417+0000 7f063b398640 1 -- start start 2024-09-15T23:22:06.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.417+0000 7f063b398640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0634073180 0x7f0634157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:06.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.417+0000 7f063b398640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06340b5f90 0x7f063413c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:06.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.417+0000 7f063b398640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0634145ed0 0x7f0634141d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:06.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.417+0000 7f063b398640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f06340b4b60 con 0x7f0634145ed0 2024-09-15T23:22:06.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.417+0000 7f063b398640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f06340b4880 con 0x7f0634073180 2024-09-15T23:22:06.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.417+0000 7f063b398640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f06341462b0 con 0x7f06340b5f90 2024-09-15T23:22:06.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.417+0000 7f0639935640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0634145ed0 0x7f0634141d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:06.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.417+0000 7f0639935640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0634145ed0 0x7f0634141d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36890/0 (socket says 172.21.15.123:36890) 2024-09-15T23:22:06.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.417+0000 7f0639935640 1 -- 172.21.15.123:0/1878086766 learned_addr learned my addr 172.21.15.123:0/1878086766 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:06.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.418+0000 7f0638933640 1 --2- 172.21.15.123:0/1878086766 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06340b5f90 0x7f063413c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:06.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.418+0000 7f0639134640 1 --2- 172.21.15.123:0/1878086766 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0634073180 0x7f0634157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:06.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.418+0000 7f0639935640 1 -- 172.21.15.123:0/1878086766 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06340b5f90 msgr2=0x7f063413c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:06.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.418+0000 7f0639935640 1 --2- 172.21.15.123:0/1878086766 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06340b5f90 0x7f063413c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:06.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.418+0000 7f0639935640 1 -- 172.21.15.123:0/1878086766 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0634073180 msgr2=0x7f0634157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:06.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.418+0000 7f0639935640 1 --2- 172.21.15.123:0/1878086766 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0634073180 0x7f0634157a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:06.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.418+0000 7f0639935640 1 -- 172.21.15.123:0/1878086766 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f063413f100 con 0x7f0634145ed0 2024-09-15T23:22:06.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.418+0000 7f0638933640 1 --2- 172.21.15.123:0/1878086766 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06340b5f90 0x7f063413c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:22:06.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.418+0000 7f0639134640 1 --2- 172.21.15.123:0/1878086766 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0634073180 0x7f0634157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:22:06.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.418+0000 7f0639935640 1 --2- 172.21.15.123:0/1878086766 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0634145ed0 0x7f0634141d90 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7f062c00cef0 tx=0x7f062c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:06.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.418+0000 7f0629ffb640 1 -- 172.21.15.123:0/1878086766 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062c01a070 con 0x7f0634145ed0 2024-09-15T23:22:06.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.418+0000 7f0629ffb640 1 -- 172.21.15.123:0/1878086766 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f062c00d860 con 0x7f0634145ed0 2024-09-15T23:22:06.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.418+0000 7f063b398640 1 -- 172.21.15.123:0/1878086766 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f063413e630 con 0x7f0634145ed0 2024-09-15T23:22:06.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.418+0000 7f0629ffb640 1 -- 172.21.15.123:0/1878086766 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062c00dc50 con 0x7f0634145ed0 2024-09-15T23:22:06.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.418+0000 7f063b398640 1 -- 172.21.15.123:0/1878086766 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f063413ebf0 con 0x7f0634145ed0 2024-09-15T23:22:06.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.419+0000 7f063b398640 1 -- 172.21.15.123:0/1878086766 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06340735c0 con 0x7f0634145ed0 2024-09-15T23:22:06.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.420+0000 7f0629ffb640 1 -- 172.21.15.123:0/1878086766 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f062c01d070 con 0x7f0634145ed0 2024-09-15T23:22:06.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.420+0000 7f0629ffb640 1 --2- 172.21.15.123:0/1878086766 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f061806c2b0 0x7f061806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:06.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.420+0000 7f0629ffb640 1 -- 172.21.15.123:0/1878086766 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5882+0+0 (secure 0 0 0) 0x7f062c08bda0 con 0x7f0634145ed0 2024-09-15T23:22:06.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.420+0000 7f0639134640 1 --2- 172.21.15.123:0/1878086766 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f061806c2b0 0x7f061806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:06.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.421+0000 7f0639134640 1 --2- 172.21.15.123:0/1878086766 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f061806c2b0 0x7f061806e770 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f0630034000 tx=0x7f063002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:06.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.424+0000 7f0629ffb640 1 -- 172.21.15.123:0/1878086766 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f062c05a520 con 0x7f0634145ed0 2024-09-15T23:22:06.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.626+0000 7f063b398640 1 -- 172.21.15.123:0/1878086766 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f06340cef80 con 0x7f0634145ed0 2024-09-15T23:22:06.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.627+0000 7f0629ffb640 1 -- 172.21.15.123:0/1878086766 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+4410 (secure 0 0 0) 0x7f062c059e20 con 0x7f0634145ed0 2024-09-15T23:22:06.628 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:22:06.628 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":103,"btime":"2024-09-15T23:22:06:315569+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7214,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/1648353391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1648353391},{"type":"v1","addr":"172.21.15.188:6837","nonce":1648353391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8122,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/1714717257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":1714717257},{"type":"v1","addr":"172.21.15.188:6836","nonce":1714717257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:21:22.066391+0000","modified":"2024-09-15T23:22:05.324287+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":171,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9552},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9552":{"gid":9552,"name":"c","rank":0,"incarnation":101,"state":"up:rejoin","state_seq":15,"addr":"172.21.15.123:6833/3722702026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3722702026},{"type":"v1","addr":"172.21.15.123:6833","nonce":3722702026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":11}]} 2024-09-15T23:22:06.628 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 103 2024-09-15T23:22:06.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.629+0000 7f063b398640 1 -- 172.21.15.123:0/1878086766 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f061806c2b0 msgr2=0x7f061806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:06.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.629+0000 7f063b398640 1 --2- 172.21.15.123:0/1878086766 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f061806c2b0 0x7f061806e770 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f0630034000 tx=0x7f063002e000 comp rx=0 tx=0).stop 2024-09-15T23:22:06.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.629+0000 7f063b398640 1 -- 172.21.15.123:0/1878086766 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0634145ed0 msgr2=0x7f0634141d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:06.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.629+0000 7f063b398640 1 --2- 172.21.15.123:0/1878086766 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0634145ed0 0x7f0634141d90 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7f062c00cef0 tx=0x7f062c00a710 comp rx=0 tx=0).stop 2024-09-15T23:22:06.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.629+0000 7f063b398640 1 -- 172.21.15.123:0/1878086766 shutdown_connections 2024-09-15T23:22:06.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.629+0000 7f063b398640 1 --2- 172.21.15.123:0/1878086766 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f061806c2b0 0x7f061806e770 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:06.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.629+0000 7f063b398640 1 --2- 172.21.15.123:0/1878086766 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0634145ed0 0x7f0634141d90 unknown :-1 s=CLOSED pgs=1997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:06.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.629+0000 7f063b398640 1 --2- 172.21.15.123:0/1878086766 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06340b5f90 0x7f063413c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:06.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.629+0000 7f063b398640 1 --2- 172.21.15.123:0/1878086766 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0634073180 0x7f0634157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:06.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.629+0000 7f063b398640 1 -- 172.21.15.123:0/1878086766 >> 172.21.15.123:0/1878086766 conn(0x7f06340ccec0 msgr2=0x7f0634144cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:06.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.629+0000 7f063b398640 1 -- 172.21.15.123:0/1878086766 shutdown_connections 2024-09-15T23:22:06.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:06.629+0000 7f063b398640 1 -- 172.21.15.123:0/1878086766 wait complete. 2024-09-15T23:22:06.640 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2024-09-15T23:22:07.848 INFO:tasks.ceph.mds.c.smithi123.stderr:2024-09-15T23:22:07.847+0000 7fd9832b5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:22:10.385 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:22:10.388 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:22:11.642 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:22:11.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.751+0000 7fa59f6af640 1 Processor -- start 2024-09-15T23:22:11.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.751+0000 7fa59f6af640 1 -- start start 2024-09-15T23:22:11.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.752+0000 7fa59f6af640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa598145ed0 0x7fa5980b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:11.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.752+0000 7fa59f6af640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa598073180 0x7fa5980735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:11.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.752+0000 7fa59f6af640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa5980b5880 0x7fa5980b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:11.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.752+0000 7fa59f6af640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fa598073b00 con 0x7fa598145ed0 2024-09-15T23:22:11.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.752+0000 7fa59f6af640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fa5980b4020 con 0x7fa598073180 2024-09-15T23:22:11.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.752+0000 7fa59f6af640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa5980b42c0 con 0x7fa5980b5880 2024-09-15T23:22:11.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.752+0000 7fa59d44b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa598145ed0 0x7fa5980b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:11.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.752+0000 7fa59d44b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa598145ed0 0x7fa5980b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36900/0 (socket says 172.21.15.123:36900) 2024-09-15T23:22:11.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.752+0000 7fa59d44b640 1 -- 172.21.15.123:0/4154651690 learned_addr learned my addr 172.21.15.123:0/4154651690 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:11.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.752+0000 7fa59cc4a640 1 --2- 172.21.15.123:0/4154651690 >> v2:172.21.15.188:3300/0 conn(0x7fa598073180 0x7fa5980735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:11.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.752+0000 7fa59dc4c640 1 --2- 172.21.15.123:0/4154651690 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa5980b5880 0x7fa5980b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:11.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.752+0000 7fa59d44b640 1 -- 172.21.15.123:0/4154651690 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa5980b5880 msgr2=0x7fa5980b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:11.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.752+0000 7fa59d44b640 1 --2- 172.21.15.123:0/4154651690 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa5980b5880 0x7fa5980b5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:11.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.752+0000 7fa59d44b640 1 -- 172.21.15.123:0/4154651690 >> v2:172.21.15.188:3300/0 conn(0x7fa598073180 msgr2=0x7fa5980735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:11.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.752+0000 7fa59d44b640 1 --2- 172.21.15.123:0/4154651690 >> v2:172.21.15.188:3300/0 conn(0x7fa598073180 0x7fa5980735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:11.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.752+0000 7fa59d44b640 1 -- 172.21.15.123:0/4154651690 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5980b45a0 con 0x7fa598145ed0 2024-09-15T23:22:11.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.753+0000 7fa59d44b640 1 --2- 172.21.15.123:0/4154651690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa598145ed0 0x7fa5980b5080 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7fa5980d1490 tx=0x7fa59402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db6ad27916aec4a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:11.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.753+0000 7fa58ffff640 1 -- 172.21.15.123:0/4154651690 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa594037070 con 0x7fa598145ed0 2024-09-15T23:22:11.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.753+0000 7fa58ffff640 1 -- 172.21.15.123:0/4154651690 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa594032440 con 0x7fa598145ed0 2024-09-15T23:22:11.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.753+0000 7fa58ffff640 1 -- 172.21.15.123:0/4154651690 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa594032810 con 0x7fa598145ed0 2024-09-15T23:22:11.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.754+0000 7fa59f6af640 1 -- 172.21.15.123:0/4154651690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa598145ed0 msgr2=0x7fa5980b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:11.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.754+0000 7fa59f6af640 1 --2- 172.21.15.123:0/4154651690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa598145ed0 0x7fa5980b5080 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7fa5980d1490 tx=0x7fa59402a1e0 comp rx=0 tx=0).stop 2024-09-15T23:22:11.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.754+0000 7fa59f6af640 1 -- 172.21.15.123:0/4154651690 shutdown_connections 2024-09-15T23:22:11.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.754+0000 7fa59f6af640 1 --2- 172.21.15.123:0/4154651690 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa5980b5880 0x7fa5980b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:11.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.754+0000 7fa59f6af640 1 --2- 172.21.15.123:0/4154651690 >> v2:172.21.15.188:3300/0 conn(0x7fa598073180 0x7fa5980735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:11.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.754+0000 7fa59f6af640 1 --2- 172.21.15.123:0/4154651690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa598145ed0 0x7fa5980b5080 unknown :-1 s=CLOSED pgs=1998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:11.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.754+0000 7fa59f6af640 1 -- 172.21.15.123:0/4154651690 >> 172.21.15.123:0/4154651690 conn(0x7fa5980ccec0 msgr2=0x7fa5980cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:11.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.754+0000 7fa59f6af640 1 -- 172.21.15.123:0/4154651690 shutdown_connections 2024-09-15T23:22:11.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.754+0000 7fa59f6af640 1 -- 172.21.15.123:0/4154651690 wait complete. 2024-09-15T23:22:11.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.755+0000 7fa59f6af640 1 Processor -- start 2024-09-15T23:22:11.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.755+0000 7fa59f6af640 1 -- start start 2024-09-15T23:22:11.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.756+0000 7fa59f6af640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa598073180 0x7fa59813b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:11.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.756+0000 7fa59f6af640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa5980b5880 0x7fa598141540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:11.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.756+0000 7fa59f6af640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa598145ed0 0x7fa5981590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:11.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.756+0000 7fa59f6af640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa5980b6250 con 0x7fa598145ed0 2024-09-15T23:22:11.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.756+0000 7fa59f6af640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa5980b4b60 con 0x7fa5980b5880 2024-09-15T23:22:11.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.756+0000 7fa59f6af640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa5980b63d0 con 0x7fa598073180 2024-09-15T23:22:11.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.756+0000 7fa59dc4c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa598145ed0 0x7fa5981590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:11.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.756+0000 7fa59dc4c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa598145ed0 0x7fa5981590d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36904/0 (socket says 172.21.15.123:36904) 2024-09-15T23:22:11.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.756+0000 7fa59dc4c640 1 -- 172.21.15.123:0/3261878990 learned_addr learned my addr 172.21.15.123:0/3261878990 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:11.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.756+0000 7fa59cc4a640 1 --2- 172.21.15.123:0/3261878990 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa5980b5880 0x7fa598141540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:11.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.756+0000 7fa59d44b640 1 --2- 172.21.15.123:0/3261878990 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa598073180 0x7fa59813b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:11.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.756+0000 7fa59dc4c640 1 -- 172.21.15.123:0/3261878990 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa598073180 msgr2=0x7fa59813b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:11.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.756+0000 7fa59dc4c640 1 --2- 172.21.15.123:0/3261878990 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa598073180 0x7fa59813b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:11.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.756+0000 7fa59dc4c640 1 -- 172.21.15.123:0/3261878990 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa5980b5880 msgr2=0x7fa598141540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:11.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.756+0000 7fa59dc4c640 1 --2- 172.21.15.123:0/3261878990 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa5980b5880 0x7fa598141540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:11.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.756+0000 7fa59dc4c640 1 -- 172.21.15.123:0/3261878990 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa59813bac0 con 0x7fa598145ed0 2024-09-15T23:22:11.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.756+0000 7fa59dc4c640 1 --2- 172.21.15.123:0/3261878990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa598145ed0 0x7fa5981590d0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7fa590007e40 tx=0x7fa59000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:11.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.756+0000 7fa58dffb640 1 -- 172.21.15.123:0/3261878990 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa590014620 con 0x7fa598145ed0 2024-09-15T23:22:11.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.757+0000 7fa58dffb640 1 -- 172.21.15.123:0/3261878990 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa590019070 con 0x7fa598145ed0 2024-09-15T23:22:11.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.757+0000 7fa59f6af640 1 -- 172.21.15.123:0/3261878990 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa59813bd60 con 0x7fa598145ed0 2024-09-15T23:22:11.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.757+0000 7fa58dffb640 1 -- 172.21.15.123:0/3261878990 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa590014a20 con 0x7fa598145ed0 2024-09-15T23:22:11.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.757+0000 7fa59f6af640 1 -- 172.21.15.123:0/3261878990 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa59813b620 con 0x7fa598145ed0 2024-09-15T23:22:11.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.758+0000 7fa59f6af640 1 -- 172.21.15.123:0/3261878990 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5981462b0 con 0x7fa598145ed0 2024-09-15T23:22:11.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.758+0000 7fa58dffb640 1 -- 172.21.15.123:0/3261878990 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa590014bc0 con 0x7fa598145ed0 2024-09-15T23:22:11.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.759+0000 7fa58dffb640 1 --2- 172.21.15.123:0/3261878990 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa57c06c2b0 0x7fa57c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:11.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.759+0000 7fa58dffb640 1 -- 172.21.15.123:0/3261878990 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5882+0+0 (secure 0 0 0) 0x7fa59008bd30 con 0x7fa598145ed0 2024-09-15T23:22:11.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.759+0000 7fa59d44b640 1 --2- 172.21.15.123:0/3261878990 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa57c06c2b0 0x7fa57c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:11.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.759+0000 7fa59d44b640 1 --2- 172.21.15.123:0/3261878990 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa57c06c2b0 0x7fa57c06e770 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fa594034000 tx=0x7fa59402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:11.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.763+0000 7fa58dffb640 1 -- 172.21.15.123:0/3261878990 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa590059d10 con 0x7fa598145ed0 2024-09-15T23:22:11.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.962+0000 7fa59f6af640 1 -- 172.21.15.123:0/3261878990 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa5980cf720 con 0x7fa598145ed0 2024-09-15T23:22:11.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.962+0000 7fa58dffb640 1 -- 172.21.15.123:0/3261878990 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+4417 (secure 0 0 0) 0x7fa59005e010 con 0x7fa598145ed0 2024-09-15T23:22:11.964 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:22:11.964 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":104,"btime":"2024-09-15T23:22:07:320455+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7214,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/1648353391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1648353391},{"type":"v1","addr":"172.21.15.188:6837","nonce":1648353391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8122,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/1714717257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":1714717257},{"type":"v1","addr":"172.21.15.188:6836","nonce":1714717257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:21:22.066391+0000","modified":"2024-09-15T23:22:07.320447+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":171,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9552},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9552":{"gid":9552,"name":"c","rank":0,"incarnation":101,"state":"up:active","state_seq":16,"addr":"172.21.15.123:6833/3722702026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3722702026},{"type":"v1","addr":"172.21.15.123:6833","nonce":3722702026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9552,"qdb_cluster":[9552]},"id":11}]} 2024-09-15T23:22:11.964 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 104 2024-09-15T23:22:11.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.964+0000 7fa59f6af640 1 -- 172.21.15.123:0/3261878990 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa57c06c2b0 msgr2=0x7fa57c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:11.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.964+0000 7fa59f6af640 1 --2- 172.21.15.123:0/3261878990 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa57c06c2b0 0x7fa57c06e770 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fa594034000 tx=0x7fa59402e000 comp rx=0 tx=0).stop 2024-09-15T23:22:11.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.964+0000 7fa59f6af640 1 -- 172.21.15.123:0/3261878990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa598145ed0 msgr2=0x7fa5981590d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:11.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.964+0000 7fa59f6af640 1 --2- 172.21.15.123:0/3261878990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa598145ed0 0x7fa5981590d0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7fa590007e40 tx=0x7fa59000e4b0 comp rx=0 tx=0).stop 2024-09-15T23:22:11.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.964+0000 7fa59f6af640 1 -- 172.21.15.123:0/3261878990 shutdown_connections 2024-09-15T23:22:11.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.964+0000 7fa59f6af640 1 --2- 172.21.15.123:0/3261878990 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa57c06c2b0 0x7fa57c06e770 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:11.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.964+0000 7fa59f6af640 1 --2- 172.21.15.123:0/3261878990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa598145ed0 0x7fa5981590d0 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:11.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.964+0000 7fa59f6af640 1 --2- 172.21.15.123:0/3261878990 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa5980b5880 0x7fa598141540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:11.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.964+0000 7fa59f6af640 1 --2- 172.21.15.123:0/3261878990 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa598073180 0x7fa59813b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:11.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.964+0000 7fa59f6af640 1 -- 172.21.15.123:0/3261878990 >> 172.21.15.123:0/3261878990 conn(0x7fa5980ccec0 msgr2=0x7fa598144070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:11.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.964+0000 7fa59f6af640 1 -- 172.21.15.123:0/3261878990 shutdown_connections 2024-09-15T23:22:11.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:11.964+0000 7fa59f6af640 1 -- 172.21.15.123:0/3261878990 wait complete. 2024-09-15T23:22:11.977 DEBUG:tasks.ceph_test_case:wait_until_true: success in 20s and 0 retries 2024-09-15T23:22:11.977 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:22:12.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.075+0000 7f4ac26f8640 1 Processor -- start 2024-09-15T23:22:12.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.075+0000 7f4ac26f8640 1 -- start start 2024-09-15T23:22:12.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.075+0000 7f4ac26f8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4abc0b6970 0x7f4abc0b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:12.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.075+0000 7f4ac26f8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4abc0d23b0 0x7f4abc0b8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:12.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.075+0000 7f4ac26f8640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4abc0d0e70 con 0x7f4abc15ed20 2024-09-15T23:22:12.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.076+0000 7f4ac26f8640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f4abc0d41c0 con 0x7f4abc0d23b0 2024-09-15T23:22:12.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.076+0000 7f4ac26f8640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f4abc0d35b0 con 0x7f4abc0b6970 2024-09-15T23:22:12.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.076+0000 7f4ac0c95640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4abc0d23b0 0x7f4abc0b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:12.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.076+0000 7f4ac0c95640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4abc0d23b0 0x7f4abc0b8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36908/0 (socket says 172.21.15.123:36908) 2024-09-15T23:22:12.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.076+0000 7f4ac0c95640 1 -- 172.21.15.123:0/1548765132 learned_addr learned my addr 172.21.15.123:0/1548765132 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:12.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.076+0000 7f4abb7fe640 1 --2- 172.21.15.123:0/1548765132 >> v2:172.21.15.188:3300/0 conn(0x7f4abc0b6970 0x7f4abc0b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:12.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.076+0000 7f4ac0c95640 1 -- 172.21.15.123:0/1548765132 >> v2:172.21.15.188:3300/0 conn(0x7f4abc0b6970 msgr2=0x7f4abc0b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:12.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.076+0000 7f4ac0c95640 1 --2- 172.21.15.123:0/1548765132 >> v2:172.21.15.188:3300/0 conn(0x7f4abc0b6970 0x7f4abc0b80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:12.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.076+0000 7f4ac0c95640 1 -- 172.21.15.123:0/1548765132 >> v1:172.21.15.188:6789/0 conn(0x7f4abc15ed20 legacy=0x7f4abc0b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:12.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.076+0000 7f4ac0c95640 1 -- 172.21.15.123:0/1548765132 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4abc0d3890 con 0x7f4abc0d23b0 2024-09-15T23:22:12.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.077+0000 7f4ac0c95640 1 --2- 172.21.15.123:0/1548765132 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4abc0d23b0 0x7f4abc0b8610 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7f4abc0d4690 tx=0x7f4ab402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a91bad7c0bc9547f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:12.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.077+0000 7f4abaffd640 1 -- 172.21.15.123:0/1548765132 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4036070 con 0x7f4abc0d23b0 2024-09-15T23:22:12.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.077+0000 7f4abaffd640 1 -- 172.21.15.123:0/1548765132 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab4031600 con 0x7f4abc0d23b0 2024-09-15T23:22:12.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.077+0000 7f4abaffd640 1 -- 172.21.15.123:0/1548765132 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab40319d0 con 0x7f4abc0d23b0 2024-09-15T23:22:12.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.077+0000 7f4ac26f8640 1 -- 172.21.15.123:0/1548765132 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4abc0d23b0 msgr2=0x7f4abc0b8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:12.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.077+0000 7f4ac26f8640 1 --2- 172.21.15.123:0/1548765132 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4abc0d23b0 0x7f4abc0b8610 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7f4abc0d4690 tx=0x7f4ab402a660 comp rx=0 tx=0).stop 2024-09-15T23:22:12.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.077+0000 7f4ac26f8640 1 -- 172.21.15.123:0/1548765132 shutdown_connections 2024-09-15T23:22:12.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.077+0000 7f4ac26f8640 1 --2- 172.21.15.123:0/1548765132 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4abc0d23b0 0x7f4abc0b8610 unknown :-1 s=CLOSED pgs=2000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:12.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.077+0000 7f4ac26f8640 1 --2- 172.21.15.123:0/1548765132 >> v2:172.21.15.188:3300/0 conn(0x7f4abc0b6970 0x7f4abc0b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:12.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.077+0000 7f4ac26f8640 1 -- 172.21.15.123:0/1548765132 >> 172.21.15.123:0/1548765132 conn(0x7f4abc0d1260 msgr2=0x7f4abc0d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:12.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.077+0000 7f4ac26f8640 1 -- 172.21.15.123:0/1548765132 shutdown_connections 2024-09-15T23:22:12.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.077+0000 7f4ac26f8640 1 -- 172.21.15.123:0/1548765132 wait complete. 2024-09-15T23:22:12.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.079+0000 7f4ac26f8640 1 Processor -- start 2024-09-15T23:22:12.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.079+0000 7f4ac26f8640 1 -- start start 2024-09-15T23:22:12.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.079+0000 7f4ac26f8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4abc0b6970 0x7f4abc154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:12.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.079+0000 7f4ac26f8640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4abc0d23b0 0x7f4abc0ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:12.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.080+0000 7f4ac26f8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4abc15ed20 0x7f4abc155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:12.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.080+0000 7f4ac26f8640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4abc0d32a0 con 0x7f4abc15ed20 2024-09-15T23:22:12.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.080+0000 7f4ac26f8640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4abc0d3e50 con 0x7f4abc0b6970 2024-09-15T23:22:12.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.080+0000 7f4ac26f8640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4abc15f100 con 0x7f4abc0d23b0 2024-09-15T23:22:12.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.080+0000 7f4ac0c95640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4abc15ed20 0x7f4abc155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:12.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.080+0000 7f4ac0c95640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4abc15ed20 0x7f4abc155860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36918/0 (socket says 172.21.15.123:36918) 2024-09-15T23:22:12.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.080+0000 7f4ac0c95640 1 -- 172.21.15.123:0/3894864989 learned_addr learned my addr 172.21.15.123:0/3894864989 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:12.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.080+0000 7f4abbfff640 1 --2- 172.21.15.123:0/3894864989 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4abc0b6970 0x7f4abc154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:12.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.080+0000 7f4abb7fe640 1 --2- 172.21.15.123:0/3894864989 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4abc0d23b0 0x7f4abc0ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:12.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.080+0000 7f4ac0c95640 1 -- 172.21.15.123:0/3894864989 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4abc0d23b0 msgr2=0x7f4abc0ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:12.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.080+0000 7f4ac0c95640 1 --2- 172.21.15.123:0/3894864989 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4abc0d23b0 0x7f4abc0ce4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:12.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.080+0000 7f4ac0c95640 1 -- 172.21.15.123:0/3894864989 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4abc0b6970 msgr2=0x7f4abc154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:12.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.080+0000 7f4ac0c95640 1 --2- 172.21.15.123:0/3894864989 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4abc0b6970 0x7f4abc154d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:12.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.080+0000 7f4ac0c95640 1 -- 172.21.15.123:0/3894864989 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4abc157c90 con 0x7f4abc15ed20 2024-09-15T23:22:12.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.080+0000 7f4abbfff640 1 --2- 172.21.15.123:0/3894864989 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4abc0b6970 0x7f4abc154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:12.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.080+0000 7f4abb7fe640 1 --2- 172.21.15.123:0/3894864989 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4abc0d23b0 0x7f4abc0ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:12.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.080+0000 7f4ac0c95640 1 --2- 172.21.15.123:0/3894864989 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4abc15ed20 0x7f4abc155860 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4034040 tx=0x7f4ab4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:12.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.080+0000 7f4ab8ff9640 1 -- 172.21.15.123:0/3894864989 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4036050 con 0x7f4abc15ed20 2024-09-15T23:22:12.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.080+0000 7f4ab8ff9640 1 -- 172.21.15.123:0/3894864989 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab4042070 con 0x7f4abc15ed20 2024-09-15T23:22:12.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.080+0000 7f4ab8ff9640 1 -- 172.21.15.123:0/3894864989 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4009510 con 0x7f4abc15ed20 2024-09-15T23:22:12.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.080+0000 7f4ac26f8640 1 -- 172.21.15.123:0/3894864989 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4abc157f70 con 0x7f4abc15ed20 2024-09-15T23:22:12.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.080+0000 7f4ac26f8640 1 -- 172.21.15.123:0/3894864989 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4abc0cbcc0 con 0x7f4abc15ed20 2024-09-15T23:22:12.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.081+0000 7f4ac26f8640 1 -- 172.21.15.123:0/3894864989 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4abc0d0490 con 0x7f4abc15ed20 2024-09-15T23:22:12.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.082+0000 7f4ab8ff9640 1 -- 172.21.15.123:0/3894864989 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4ab4007bf0 con 0x7f4abc15ed20 2024-09-15T23:22:12.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.082+0000 7f4ab8ff9640 1 --2- 172.21.15.123:0/3894864989 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4aa806c2b0 0x7f4aa806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:12.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.082+0000 7f4ab8ff9640 1 -- 172.21.15.123:0/3894864989 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5882+0+0 (secure 0 0 0) 0x7f4ab40ac3a0 con 0x7f4abc15ed20 2024-09-15T23:22:12.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.082+0000 7f4abbfff640 1 --2- 172.21.15.123:0/3894864989 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4aa806c2b0 0x7f4aa806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:12.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.083+0000 7f4abbfff640 1 --2- 172.21.15.123:0/3894864989 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4aa806c2b0 0x7f4aa806e770 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f4aac001750 tx=0x7f4aac009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:12.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.087+0000 7f4ab8ff9640 1 -- 172.21.15.123:0/3894864989 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4abc0d0490 con 0x7f4abc15ed20 2024-09-15T23:22:12.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.284+0000 7f4ac26f8640 1 -- 172.21.15.123:0/3894864989 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4abc0cbec0 con 0x7f4abc15ed20 2024-09-15T23:22:12.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.285+0000 7f4ab8ff9640 1 -- 172.21.15.123:0/3894864989 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+4417 (secure 0 0 0) 0x7f4abc0cbec0 con 0x7f4abc15ed20 2024-09-15T23:22:12.286 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:22:12.286 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":104,"btime":"2024-09-15T23:22:07:320455+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7214,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/1648353391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1648353391},{"type":"v1","addr":"172.21.15.188:6837","nonce":1648353391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8122,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/1714717257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":1714717257},{"type":"v1","addr":"172.21.15.188:6836","nonce":1714717257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:21:22.066391+0000","modified":"2024-09-15T23:22:07.320447+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":171,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9552},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9552":{"gid":9552,"name":"c","rank":0,"incarnation":101,"state":"up:active","state_seq":16,"addr":"172.21.15.123:6833/3722702026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3722702026},{"type":"v1","addr":"172.21.15.123:6833","nonce":3722702026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9552,"qdb_cluster":[9552]},"id":11}]} 2024-09-15T23:22:12.286 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 104 2024-09-15T23:22:12.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.286+0000 7f4ac26f8640 1 -- 172.21.15.123:0/3894864989 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4aa806c2b0 msgr2=0x7f4aa806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:12.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.286+0000 7f4ac26f8640 1 --2- 172.21.15.123:0/3894864989 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4aa806c2b0 0x7f4aa806e770 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f4aac001750 tx=0x7f4aac009040 comp rx=0 tx=0).stop 2024-09-15T23:22:12.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.286+0000 7f4ac26f8640 1 -- 172.21.15.123:0/3894864989 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4abc15ed20 msgr2=0x7f4abc155860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:12.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.286+0000 7f4ac26f8640 1 --2- 172.21.15.123:0/3894864989 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4abc15ed20 0x7f4abc155860 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4034040 tx=0x7f4ab4004a40 comp rx=0 tx=0).stop 2024-09-15T23:22:12.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.286+0000 7f4ac26f8640 1 -- 172.21.15.123:0/3894864989 shutdown_connections 2024-09-15T23:22:12.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.286+0000 7f4ac26f8640 1 --2- 172.21.15.123:0/3894864989 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4aa806c2b0 0x7f4aa806e770 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:12.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.286+0000 7f4ac26f8640 1 --2- 172.21.15.123:0/3894864989 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4abc15ed20 0x7f4abc155860 unknown :-1 s=CLOSED pgs=2001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:12.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.286+0000 7f4ac26f8640 1 --2- 172.21.15.123:0/3894864989 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4abc0d23b0 0x7f4abc0ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:12.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.286+0000 7f4ac26f8640 1 --2- 172.21.15.123:0/3894864989 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4abc0b6970 0x7f4abc154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:12.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.286+0000 7f4ac26f8640 1 -- 172.21.15.123:0/3894864989 >> 172.21.15.123:0/3894864989 conn(0x7f4abc0d1260 msgr2=0x7f4abc0b50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:12.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.287+0000 7f4ac26f8640 1 -- 172.21.15.123:0/3894864989 shutdown_connections 2024-09-15T23:22:12.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.287+0000 7f4ac26f8640 1 -- 172.21.15.123:0/3894864989 wait complete. 2024-09-15T23:22:12.299 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2024-09-15T23:22:12.299 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:22:12.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.396+0000 7fdab872a640 1 Processor -- start 2024-09-15T23:22:12.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.396+0000 7fdab872a640 1 -- start start 2024-09-15T23:22:12.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.397+0000 7fdab872a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdab015e6d0 0x7fdab0071390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:12.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.397+0000 7fdab872a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdab006cd20 0x7fdab00b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:12.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.397+0000 7fdab872a640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdab015eab0 con 0x7fdab0070b80 2024-09-15T23:22:12.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.397+0000 7fdab872a640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fdab015ed70 con 0x7fdab006cd20 2024-09-15T23:22:12.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.397+0000 7fdab872a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fdab015f050 con 0x7fdab015e6d0 2024-09-15T23:22:12.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.397+0000 7fdab5cc5640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdab006cd20 0x7fdab00b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:12.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.397+0000 7fdab5cc5640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdab006cd20 0x7fdab00b6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36928/0 (socket says 172.21.15.123:36928) 2024-09-15T23:22:12.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.397+0000 7fdab5cc5640 1 -- 172.21.15.123:0/964178146 learned_addr learned my addr 172.21.15.123:0/964178146 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:12.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.397+0000 7fdab5cc5640 1 -- 172.21.15.123:0/964178146 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdab015e6d0 msgr2=0x7fdab0071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:12.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.397+0000 7fdab64c6640 1 --2- 172.21.15.123:0/964178146 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdab015e6d0 0x7fdab0071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:12.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.397+0000 7fdab5cc5640 1 --2- 172.21.15.123:0/964178146 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdab015e6d0 0x7fdab0071390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:12.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.397+0000 7fdab5cc5640 1 -- 172.21.15.123:0/964178146 >> v1:172.21.15.188:6789/0 conn(0x7fdab0070b80 legacy=0x7fdab00731a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:12.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.397+0000 7fdab5cc5640 1 -- 172.21.15.123:0/964178146 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdab015f330 con 0x7fdab006cd20 2024-09-15T23:22:12.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.397+0000 7fdab64c6640 1 --2- 172.21.15.123:0/964178146 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdab015e6d0 0x7fdab0071390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:22:12.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.398+0000 7fdab5cc5640 1 --2- 172.21.15.123:0/964178146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdab006cd20 0x7fdab00b6d60 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0009870 tx=0x7fdaa002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa91fda00339644 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:12.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.398+0000 7fdab54c4640 1 -- 172.21.15.123:0/964178146 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0037070 con 0x7fdab006cd20 2024-09-15T23:22:12.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.398+0000 7fdab54c4640 1 -- 172.21.15.123:0/964178146 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaa0032440 con 0x7fdab006cd20 2024-09-15T23:22:12.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.398+0000 7fdab54c4640 1 -- 172.21.15.123:0/964178146 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0032810 con 0x7fdab006cd20 2024-09-15T23:22:12.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.398+0000 7fdab872a640 1 -- 172.21.15.123:0/964178146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdab006cd20 msgr2=0x7fdab00b6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:12.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.398+0000 7fdab872a640 1 --2- 172.21.15.123:0/964178146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdab006cd20 0x7fdab00b6d60 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0009870 tx=0x7fdaa002a210 comp rx=0 tx=0).stop 2024-09-15T23:22:12.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.399+0000 7fdab872a640 1 -- 172.21.15.123:0/964178146 shutdown_connections 2024-09-15T23:22:12.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.399+0000 7fdab872a640 1 --2- 172.21.15.123:0/964178146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdab006cd20 0x7fdab00b6d60 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:12.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.399+0000 7fdab872a640 1 --2- 172.21.15.123:0/964178146 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdab015e6d0 0x7fdab0071390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:12.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.399+0000 7fdab872a640 1 -- 172.21.15.123:0/964178146 >> 172.21.15.123:0/964178146 conn(0x7fdab0067fb0 msgr2=0x7fdab006f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:12.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.399+0000 7fdab872a640 1 -- 172.21.15.123:0/964178146 shutdown_connections 2024-09-15T23:22:12.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.399+0000 7fdab872a640 1 -- 172.21.15.123:0/964178146 wait complete. 2024-09-15T23:22:12.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.400+0000 7fdab872a640 1 Processor -- start 2024-09-15T23:22:12.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.400+0000 7fdab872a640 1 -- start start 2024-09-15T23:22:12.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.400+0000 7fdab872a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdab006cd20 0x7fdab0149050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:12.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.400+0000 7fdab872a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdab0070b80 0x7fdab00b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:12.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.400+0000 7fdab872a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdab015e6d0 0x7fdab015d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:12.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.400+0000 7fdab872a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdab00718d0 con 0x7fdab0070b80 2024-09-15T23:22:12.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.400+0000 7fdab872a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fdab015f8f0 con 0x7fdab015e6d0 2024-09-15T23:22:12.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.400+0000 7fdab872a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fdab0071a50 con 0x7fdab006cd20 2024-09-15T23:22:12.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.401+0000 7fdab5cc5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdab0070b80 0x7fdab00b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:12.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.401+0000 7fdab5cc5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdab0070b80 0x7fdab00b43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36934/0 (socket says 172.21.15.123:36934) 2024-09-15T23:22:12.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.401+0000 7fdab5cc5640 1 -- 172.21.15.123:0/2851128057 learned_addr learned my addr 172.21.15.123:0/2851128057 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:12.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.401+0000 7fdab64c6640 1 --2- 172.21.15.123:0/2851128057 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdab006cd20 0x7fdab0149050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:12.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.401+0000 7fdab6cc7640 1 --2- 172.21.15.123:0/2851128057 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdab015e6d0 0x7fdab015d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:12.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.401+0000 7fdab5cc5640 1 -- 172.21.15.123:0/2851128057 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdab006cd20 msgr2=0x7fdab0149050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:12.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.401+0000 7fdab5cc5640 1 --2- 172.21.15.123:0/2851128057 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdab006cd20 0x7fdab0149050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:12.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.401+0000 7fdab5cc5640 1 -- 172.21.15.123:0/2851128057 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdab015e6d0 msgr2=0x7fdab015d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:12.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.401+0000 7fdab5cc5640 1 --2- 172.21.15.123:0/2851128057 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdab015e6d0 0x7fdab015d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:12.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.401+0000 7fdab5cc5640 1 -- 172.21.15.123:0/2851128057 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdab00b3350 con 0x7fdab0070b80 2024-09-15T23:22:12.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.401+0000 7fdab6cc7640 1 --2- 172.21.15.123:0/2851128057 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdab015e6d0 0x7fdab015d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:12.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.401+0000 7fdab64c6640 1 --2- 172.21.15.123:0/2851128057 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdab006cd20 0x7fdab0149050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:12.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.401+0000 7fdab5cc5640 1 --2- 172.21.15.123:0/2851128057 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdab0070b80 0x7fdab00b43f0 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0009870 tx=0x7fdaa00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:12.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.401+0000 7fdaa6ffd640 1 -- 172.21.15.123:0/2851128057 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0041020 con 0x7fdab0070b80 2024-09-15T23:22:12.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.401+0000 7fdaa6ffd640 1 -- 172.21.15.123:0/2851128057 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaa0030970 con 0x7fdab0070b80 2024-09-15T23:22:12.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.401+0000 7fdaa6ffd640 1 -- 172.21.15.123:0/2851128057 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0037040 con 0x7fdab0070b80 2024-09-15T23:22:12.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.401+0000 7fdab872a640 1 -- 172.21.15.123:0/2851128057 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdab00b3630 con 0x7fdab0070b80 2024-09-15T23:22:12.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.401+0000 7fdab872a640 1 -- 172.21.15.123:0/2851128057 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdab00b3bf0 con 0x7fdab0070b80 2024-09-15T23:22:12.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.402+0000 7fdab872a640 1 -- 172.21.15.123:0/2851128057 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdab0071390 con 0x7fdab0070b80 2024-09-15T23:22:12.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.403+0000 7fdaa6ffd640 1 -- 172.21.15.123:0/2851128057 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdaa0044020 con 0x7fdab0070b80 2024-09-15T23:22:12.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.403+0000 7fdaa6ffd640 1 --2- 172.21.15.123:0/2851128057 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fda9406c2b0 0x7fda9406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:12.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.403+0000 7fdaa6ffd640 1 -- 172.21.15.123:0/2851128057 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5882+0+0 (secure 0 0 0) 0x7fdaa00abe10 con 0x7fdab0070b80 2024-09-15T23:22:12.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.404+0000 7fdab64c6640 1 --2- 172.21.15.123:0/2851128057 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fda9406c2b0 0x7fda9406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:12.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.404+0000 7fdab64c6640 1 --2- 172.21.15.123:0/2851128057 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fda9406c2b0 0x7fda9406e770 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fdaac00a990 tx=0x7fdaac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:12.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.407+0000 7fdaa6ffd640 1 -- 172.21.15.123:0/2851128057 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdaa004b030 con 0x7fdab0070b80 2024-09-15T23:22:12.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.647+0000 7fdab872a640 1 -- 172.21.15.123:0/2851128057 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fdab006f580 con 0x7fdab0070b80 2024-09-15T23:22:12.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.647+0000 7fdaa6ffd640 1 -- 172.21.15.123:0/2851128057 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1514 (secure 0 0 0) 0x7fdaa007a560 con 0x7fdab0070b80 2024-09-15T23:22:12.649 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:22:12.649 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":623,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":171,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":1049,"data_bytes":1078889278,"bytes_used":2583506944,"bytes_avail":770510606336,"bytes_total":773094113280,"read_bytes_sec":238532,"write_bytes_sec":285318,"read_op_per_sec":7,"write_op_per_sec":102},"fsmap":{"epoch":104,"btime":"2024-09-15T23:22:07:320455+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"c","status":"up:active","gid":9552}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":28,"modified":"2024-09-15T23:22:05.645189+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T23:22:12.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.649+0000 7fdab872a640 1 -- 172.21.15.123:0/2851128057 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fda9406c2b0 msgr2=0x7fda9406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:12.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.649+0000 7fdab872a640 1 --2- 172.21.15.123:0/2851128057 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fda9406c2b0 0x7fda9406e770 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fdaac00a990 tx=0x7fdaac008040 comp rx=0 tx=0).stop 2024-09-15T23:22:12.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.649+0000 7fdab872a640 1 -- 172.21.15.123:0/2851128057 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdab0070b80 msgr2=0x7fdab00b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:12.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.649+0000 7fdab872a640 1 --2- 172.21.15.123:0/2851128057 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdab0070b80 0x7fdab00b43f0 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0009870 tx=0x7fdaa00046c0 comp rx=0 tx=0).stop 2024-09-15T23:22:12.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.649+0000 7fdab872a640 1 -- 172.21.15.123:0/2851128057 shutdown_connections 2024-09-15T23:22:12.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.649+0000 7fdab872a640 1 --2- 172.21.15.123:0/2851128057 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdab015e6d0 0x7fdab015d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:12.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.649+0000 7fdab872a640 1 --2- 172.21.15.123:0/2851128057 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fda9406c2b0 0x7fda9406e770 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:12.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.649+0000 7fdab872a640 1 --2- 172.21.15.123:0/2851128057 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdab0070b80 0x7fdab00b43f0 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:12.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.649+0000 7fdab872a640 1 --2- 172.21.15.123:0/2851128057 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdab006cd20 0x7fdab0149050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:12.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.649+0000 7fdab872a640 1 -- 172.21.15.123:0/2851128057 >> 172.21.15.123:0/2851128057 conn(0x7fdab0067fb0 msgr2=0x7fdab0160a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:12.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.649+0000 7fdab872a640 1 -- 172.21.15.123:0/2851128057 shutdown_connections 2024-09-15T23:22:12.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.649+0000 7fdab872a640 1 -- 172.21.15.123:0/2851128057 wait complete. 2024-09-15T23:22:12.661 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-15T23:22:12.662 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:22:12.662 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:22:12.699 DEBUG:teuthology.orchestra.run.smithi188:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:22:12.743 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:22:12.744 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:22:12.744 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:22:12.744 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:22:12.759 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:22:12.760 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:22:12.816 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:22:12.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.954+0000 7fe4f7c96640 1 Processor -- start 2024-09-15T23:22:12.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.954+0000 7fe4f7c96640 1 -- start start 2024-09-15T23:22:12.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.955+0000 7fe4f7c96640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fe4f015c210 0x7fe4f015f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:12.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.955+0000 7fe4f7c96640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe4f00b6b20 0x7fe4f0162310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:12.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.955+0000 7fe4f7c96640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe4f006f400 0x7fe4f0162850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:12.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.955+0000 7fe4f7c96640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe4f00b7840 con 0x7fe4f006f400 2024-09-15T23:22:12.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.955+0000 7fe4f7c96640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fe4f00b6fa0 con 0x7fe4f015c210 2024-09-15T23:22:12.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.955+0000 7fe4f7c96640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe4f00b7280 con 0x7fe4f00b6b20 2024-09-15T23:22:12.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.955+0000 7fe4f6233640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe4f006f400 0x7fe4f0162850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:12.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.955+0000 7fe4f6233640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe4f006f400 0x7fe4f0162850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36946/0 (socket says 172.21.15.123:36946) 2024-09-15T23:22:12.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.955+0000 7fe4f6233640 1 -- 172.21.15.123:0/3233476047 learned_addr learned my addr 172.21.15.123:0/3233476047 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:12.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.955+0000 7fe4f5231640 1 --2- 172.21.15.123:0/3233476047 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe4f00b6b20 0x7fe4f0162310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:12.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.955+0000 7fe4f5a32640 1 --2- 172.21.15.123:0/3233476047 >> v2:172.21.15.188:3300/0 conn(0x7fe4f015c210 0x7fe4f015f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:12.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.955+0000 7fe4f6233640 1 -- 172.21.15.123:0/3233476047 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe4f00b6b20 msgr2=0x7fe4f0162310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:12.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.955+0000 7fe4f6233640 1 --2- 172.21.15.123:0/3233476047 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe4f00b6b20 0x7fe4f0162310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:12.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.955+0000 7fe4f6233640 1 -- 172.21.15.123:0/3233476047 >> v2:172.21.15.188:3300/0 conn(0x7fe4f015c210 msgr2=0x7fe4f015f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:12.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.955+0000 7fe4f6233640 1 --2- 172.21.15.123:0/3233476047 >> v2:172.21.15.188:3300/0 conn(0x7fe4f015c210 0x7fe4f015f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:12.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.955+0000 7fe4f6233640 1 -- 172.21.15.123:0/3233476047 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f00b7560 con 0x7fe4f006f400 2024-09-15T23:22:12.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.955+0000 7fe4f5a32640 1 --2- 172.21.15.123:0/3233476047 >> v2:172.21.15.188:3300/0 conn(0x7fe4f015c210 0x7fe4f015f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:12.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.956+0000 7fe4f6233640 1 --2- 172.21.15.123:0/3233476047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4f006f400 0x7fe4f0162850 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7fe4f00d3680 tx=0x7fe4e802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7785b533f893c16 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:12.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.956+0000 7fe4f4a30640 1 -- 172.21.15.123:0/3233476047 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8037070 con 0x7fe4f006f400 2024-09-15T23:22:12.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.956+0000 7fe4f4a30640 1 -- 172.21.15.123:0/3233476047 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4e8032440 con 0x7fe4f006f400 2024-09-15T23:22:12.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.956+0000 7fe4f4a30640 1 -- 172.21.15.123:0/3233476047 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8032810 con 0x7fe4f006f400 2024-09-15T23:22:12.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.957+0000 7fe4f7c96640 1 -- 172.21.15.123:0/3233476047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4f006f400 msgr2=0x7fe4f0162850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:12.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.957+0000 7fe4f7c96640 1 --2- 172.21.15.123:0/3233476047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4f006f400 0x7fe4f0162850 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7fe4f00d3680 tx=0x7fe4e802a140 comp rx=0 tx=0).stop 2024-09-15T23:22:12.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.957+0000 7fe4f7c96640 1 -- 172.21.15.123:0/3233476047 shutdown_connections 2024-09-15T23:22:12.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.957+0000 7fe4f7c96640 1 --2- 172.21.15.123:0/3233476047 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4f006f400 0x7fe4f0162850 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:12.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.957+0000 7fe4f7c96640 1 --2- 172.21.15.123:0/3233476047 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe4f00b6b20 0x7fe4f0162310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:12.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.957+0000 7fe4f7c96640 1 --2- 172.21.15.123:0/3233476047 >> v2:172.21.15.188:3300/0 conn(0x7fe4f015c210 0x7fe4f015f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:12.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.957+0000 7fe4f7c96640 1 -- 172.21.15.123:0/3233476047 >> 172.21.15.123:0/3233476047 conn(0x7fe4f00b7c50 msgr2=0x7fe4f00b8060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:12.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.957+0000 7fe4f7c96640 1 -- 172.21.15.123:0/3233476047 shutdown_connections 2024-09-15T23:22:12.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.957+0000 7fe4f7c96640 1 -- 172.21.15.123:0/3233476047 wait complete. 2024-09-15T23:22:12.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.958+0000 7fe4f7c96640 1 Processor -- start 2024-09-15T23:22:12.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.958+0000 7fe4f7c96640 1 -- start start 2024-09-15T23:22:12.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.959+0000 7fe4f7c96640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe4f006f400 0x7fe4f0156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:12.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.959+0000 7fe4f7c96640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe4f00b6b20 0x7fe4f0157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:12.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.959+0000 7fe4f7c96640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4f015c210 0x7fe4f0157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:12.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.959+0000 7fe4f7c96640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f006fd10 con 0x7fe4f015c210 2024-09-15T23:22:12.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.959+0000 7fe4f7c96640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f006fb90 con 0x7fe4f006f400 2024-09-15T23:22:12.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.959+0000 7fe4f7c96640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe4f006fe90 con 0x7fe4f00b6b20 2024-09-15T23:22:12.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.959+0000 7fe4f6233640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4f015c210 0x7fe4f0157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:12.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.959+0000 7fe4f6233640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4f015c210 0x7fe4f0157fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36948/0 (socket says 172.21.15.123:36948) 2024-09-15T23:22:12.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.959+0000 7fe4f6233640 1 -- 172.21.15.123:0/78472137 learned_addr learned my addr 172.21.15.123:0/78472137 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:12.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.959+0000 7fe4f5a32640 1 --2- 172.21.15.123:0/78472137 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe4f006f400 0x7fe4f0156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:12.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.959+0000 7fe4f5231640 1 --2- 172.21.15.123:0/78472137 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe4f00b6b20 0x7fe4f0157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:12.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.959+0000 7fe4f6233640 1 -- 172.21.15.123:0/78472137 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe4f00b6b20 msgr2=0x7fe4f0157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:12.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.959+0000 7fe4f6233640 1 --2- 172.21.15.123:0/78472137 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe4f00b6b20 0x7fe4f0157a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:12.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.959+0000 7fe4f6233640 1 -- 172.21.15.123:0/78472137 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe4f006f400 msgr2=0x7fe4f0156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:12.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.959+0000 7fe4f6233640 1 --2- 172.21.15.123:0/78472137 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe4f006f400 0x7fe4f0156120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:12.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.959+0000 7fe4f6233640 1 -- 172.21.15.123:0/78472137 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f00cfb30 con 0x7fe4f015c210 2024-09-15T23:22:12.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.959+0000 7fe4f6233640 1 --2- 172.21.15.123:0/78472137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4f015c210 0x7fe4f0157fa0 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7fe4e80090b0 tx=0x7fe4e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:12.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.959+0000 7fe4e67fc640 1 -- 172.21.15.123:0/78472137 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8037040 con 0x7fe4f015c210 2024-09-15T23:22:12.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.959+0000 7fe4e67fc640 1 -- 172.21.15.123:0/78472137 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4e8042070 con 0x7fe4f015c210 2024-09-15T23:22:12.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.959+0000 7fe4f7c96640 1 -- 172.21.15.123:0/78472137 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4f01585d0 con 0x7fe4f015c210 2024-09-15T23:22:12.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.959+0000 7fe4e67fc640 1 -- 172.21.15.123:0/78472137 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4e8030920 con 0x7fe4f015c210 2024-09-15T23:22:12.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.959+0000 7fe4f7c96640 1 -- 172.21.15.123:0/78472137 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4f0158b90 con 0x7fe4f015c210 2024-09-15T23:22:12.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.960+0000 7fe4f7c96640 1 -- 172.21.15.123:0/78472137 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4f015f3e0 con 0x7fe4f015c210 2024-09-15T23:22:12.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.961+0000 7fe4e67fc640 1 -- 172.21.15.123:0/78472137 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe4e8030ac0 con 0x7fe4f015c210 2024-09-15T23:22:12.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.961+0000 7fe4e67fc640 1 --2- 172.21.15.123:0/78472137 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe4d406c2b0 0x7fe4d406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:12.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.961+0000 7fe4e67fc640 1 -- 172.21.15.123:0/78472137 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5882+0+0 (secure 0 0 0) 0x7fe4e80abd60 con 0x7fe4f015c210 2024-09-15T23:22:12.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.962+0000 7fe4f5a32640 1 --2- 172.21.15.123:0/78472137 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe4d406c2b0 0x7fe4d406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:12.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.962+0000 7fe4f5a32640 1 --2- 172.21.15.123:0/78472137 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe4d406c2b0 0x7fe4d406e770 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0155b30 tx=0x7fe4ec00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:12.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:12.965+0000 7fe4e67fc640 1 -- 172.21.15.123:0/78472137 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe4e8079e60 con 0x7fe4f015c210 2024-09-15T23:22:13.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.142+0000 7fe4f7c96640 1 -- 172.21.15.123:0/78472137 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe4f00cfd80 con 0x7fe4f015c210 2024-09-15T23:22:13.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.143+0000 7fe4e67fc640 1 -- 172.21.15.123:0/78472137 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v171) ==== 80+0+124 (secure 0 0 0) 0x7fe4e807e160 con 0x7fe4f015c210 2024-09-15T23:22:13.144 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6835/1883512279 2024-09-16T23:22:04.310006+0000 2024-09-15T23:22:13.144 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6834/1883512279 2024-09-16T23:22:04.310006+0000 2024-09-15T23:22:13.144 INFO:teuthology.orchestra.run.smithi123.stderr:listed 2 entries 2024-09-15T23:22:13.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.145+0000 7fe4f7c96640 1 -- 172.21.15.123:0/78472137 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe4d406c2b0 msgr2=0x7fe4d406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:13.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.145+0000 7fe4f7c96640 1 --2- 172.21.15.123:0/78472137 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe4d406c2b0 0x7fe4d406e770 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fe4f0155b30 tx=0x7fe4ec00b040 comp rx=0 tx=0).stop 2024-09-15T23:22:13.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.145+0000 7fe4f7c96640 1 -- 172.21.15.123:0/78472137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4f015c210 msgr2=0x7fe4f0157fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:13.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.145+0000 7fe4f7c96640 1 --2- 172.21.15.123:0/78472137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4f015c210 0x7fe4f0157fa0 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7fe4e80090b0 tx=0x7fe4e80046c0 comp rx=0 tx=0).stop 2024-09-15T23:22:13.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.145+0000 7fe4f7c96640 1 -- 172.21.15.123:0/78472137 shutdown_connections 2024-09-15T23:22:13.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.145+0000 7fe4f7c96640 1 --2- 172.21.15.123:0/78472137 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe4d406c2b0 0x7fe4d406e770 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:13.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.145+0000 7fe4f7c96640 1 --2- 172.21.15.123:0/78472137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe4f015c210 0x7fe4f0157fa0 unknown :-1 s=CLOSED pgs=2005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:13.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.145+0000 7fe4f7c96640 1 --2- 172.21.15.123:0/78472137 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe4f00b6b20 0x7fe4f0157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:13.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.145+0000 7fe4f7c96640 1 --2- 172.21.15.123:0/78472137 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe4f006f400 0x7fe4f0156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:13.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.145+0000 7fe4f7c96640 1 -- 172.21.15.123:0/78472137 >> 172.21.15.123:0/78472137 conn(0x7fe4f00b7c50 msgr2=0x7fe4f00b8030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:13.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.145+0000 7fe4f7c96640 1 -- 172.21.15.123:0/78472137 shutdown_connections 2024-09-15T23:22:13.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.145+0000 7fe4f7c96640 1 -- 172.21.15.123:0/78472137 wait complete. 2024-09-15T23:22:13.156 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-15T23:22:13.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:22:13.157 DEBUG:teuthology.orchestra.run.smithi123:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-15T23:22:13.184 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-09-15T23:22:13.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:22:13.185 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T23:22:13.241 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:22:13.241 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:22:13.241 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:22:13.260 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:22:13.260 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:22:13.260 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:22:13.260 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:22:13.296 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:22:13.296 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:22:13.296 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:22:13.296 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:22:13.318 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:22:13.318 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:22:13.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.434+0000 7f1b7772c640 1 Processor -- start 2024-09-15T23:22:13.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.434+0000 7f1b7772c640 1 -- start start 2024-09-15T23:22:13.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.434+0000 7f1b7772c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1b700b2d40 0x7f1b7006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:13.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.434+0000 7f1b7772c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b7013eb20 0x7f1b7006c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:13.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.435+0000 7f1b7772c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1b7015bcf0 0x7f1b7015c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:13.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.435+0000 7f1b7772c640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f1b70071ab0 con 0x7f1b700b2d40 2024-09-15T23:22:13.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.435+0000 7f1b7772c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f1b70071180 con 0x7f1b7015bcf0 2024-09-15T23:22:13.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.435+0000 7f1b7772c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1b70071460 con 0x7f1b7013eb20 2024-09-15T23:22:13.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.435+0000 7f1b754c8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1b700b2d40 0x7f1b7006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:13.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.435+0000 7f1b754c8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1b700b2d40 0x7f1b7006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36954/0 (socket says 172.21.15.123:36954) 2024-09-15T23:22:13.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.435+0000 7f1b754c8640 1 -- 172.21.15.123:0/244031465 learned_addr learned my addr 172.21.15.123:0/244031465 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:13.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.435+0000 7f1b74cc7640 1 --2- 172.21.15.123:0/244031465 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b7013eb20 0x7f1b7006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:13.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.435+0000 7f1b75cc9640 1 --2- 172.21.15.123:0/244031465 >> v2:172.21.15.188:3300/0 conn(0x7f1b7015bcf0 0x7f1b7015c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:13.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.435+0000 7f1b754c8640 1 -- 172.21.15.123:0/244031465 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b7013eb20 msgr2=0x7f1b7006c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:13.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.435+0000 7f1b754c8640 1 --2- 172.21.15.123:0/244031465 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b7013eb20 0x7f1b7006c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:13.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.435+0000 7f1b754c8640 1 -- 172.21.15.123:0/244031465 >> v2:172.21.15.188:3300/0 conn(0x7f1b7015bcf0 msgr2=0x7f1b7015c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:13.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.435+0000 7f1b754c8640 1 --2- 172.21.15.123:0/244031465 >> v2:172.21.15.188:3300/0 conn(0x7f1b7015bcf0 0x7f1b7015c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:13.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.435+0000 7f1b754c8640 1 -- 172.21.15.123:0/244031465 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b70071740 con 0x7f1b700b2d40 2024-09-15T23:22:13.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.436+0000 7f1b754c8640 1 --2- 172.21.15.123:0/244031465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b700b2d40 0x7f1b7006bc10 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f1b701595c0 tx=0x7f1b6402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ae1d985f7992205 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:13.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.436+0000 7f1b63fff640 1 -- 172.21.15.123:0/244031465 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b64037070 con 0x7f1b700b2d40 2024-09-15T23:22:13.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.436+0000 7f1b63fff640 1 -- 172.21.15.123:0/244031465 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b64032440 con 0x7f1b700b2d40 2024-09-15T23:22:13.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.436+0000 7f1b63fff640 1 -- 172.21.15.123:0/244031465 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b64032810 con 0x7f1b700b2d40 2024-09-15T23:22:13.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.436+0000 7f1b7772c640 1 -- 172.21.15.123:0/244031465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b700b2d40 msgr2=0x7f1b7006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:13.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.436+0000 7f1b7772c640 1 --2- 172.21.15.123:0/244031465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b700b2d40 0x7f1b7006bc10 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f1b701595c0 tx=0x7f1b6402a1e0 comp rx=0 tx=0).stop 2024-09-15T23:22:13.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.436+0000 7f1b7772c640 1 -- 172.21.15.123:0/244031465 shutdown_connections 2024-09-15T23:22:13.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.436+0000 7f1b7772c640 1 --2- 172.21.15.123:0/244031465 >> v2:172.21.15.188:3300/0 conn(0x7f1b7015bcf0 0x7f1b7015c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:13.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.436+0000 7f1b7772c640 1 --2- 172.21.15.123:0/244031465 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b7013eb20 0x7f1b7006c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:13.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.436+0000 7f1b7772c640 1 --2- 172.21.15.123:0/244031465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b700b2d40 0x7f1b7006bc10 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:13.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.436+0000 7f1b7772c640 1 -- 172.21.15.123:0/244031465 >> 172.21.15.123:0/244031465 conn(0x7f1b700ccec0 msgr2=0x7f1b700cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:13.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.437+0000 7f1b7772c640 1 -- 172.21.15.123:0/244031465 shutdown_connections 2024-09-15T23:22:13.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.437+0000 7f1b7772c640 1 -- 172.21.15.123:0/244031465 wait complete. 2024-09-15T23:22:13.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.438+0000 7f1b7772c640 1 Processor -- start 2024-09-15T23:22:13.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.438+0000 7f1b7772c640 1 -- start start 2024-09-15T23:22:13.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.438+0000 7f1b7772c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b700b2d40 0x7f1b70154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:13.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.438+0000 7f1b7772c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b7013eb20 0x7f1b70156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:13.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.438+0000 7f1b7772c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b7015bcf0 0x7f1b70157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:13.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.438+0000 7f1b7772c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7015f140 con 0x7f1b7013eb20 2024-09-15T23:22:13.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.438+0000 7f1b7772c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7015efc0 con 0x7f1b7015bcf0 2024-09-15T23:22:13.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.438+0000 7f1b7772c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7015f2c0 con 0x7f1b700b2d40 2024-09-15T23:22:13.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.439+0000 7f1b74cc7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b7013eb20 0x7f1b70156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:13.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.439+0000 7f1b74cc7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b7013eb20 0x7f1b70156c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36960/0 (socket says 172.21.15.123:36960) 2024-09-15T23:22:13.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.439+0000 7f1b74cc7640 1 -- 172.21.15.123:0/4158823448 learned_addr learned my addr 172.21.15.123:0/4158823448 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:13.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.439+0000 7f1b754c8640 1 --2- 172.21.15.123:0/4158823448 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b700b2d40 0x7f1b70154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:13.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.439+0000 7f1b75cc9640 1 --2- 172.21.15.123:0/4158823448 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b7015bcf0 0x7f1b70157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:13.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.439+0000 7f1b74cc7640 1 -- 172.21.15.123:0/4158823448 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b700b2d40 msgr2=0x7f1b70154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:13.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.439+0000 7f1b74cc7640 1 --2- 172.21.15.123:0/4158823448 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b700b2d40 0x7f1b70154bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:13.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.439+0000 7f1b74cc7640 1 -- 172.21.15.123:0/4158823448 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b7015bcf0 msgr2=0x7f1b70157180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:13.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.439+0000 7f1b74cc7640 1 --2- 172.21.15.123:0/4158823448 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b7015bcf0 0x7f1b70157180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:13.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.439+0000 7f1b74cc7640 1 -- 172.21.15.123:0/4158823448 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b701f18b0 con 0x7f1b7013eb20 2024-09-15T23:22:13.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.439+0000 7f1b74cc7640 1 --2- 172.21.15.123:0/4158823448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b7013eb20 0x7f1b70156c40 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c00d7d0 tx=0x7f1b6c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:13.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.439+0000 7f1b61ffb640 1 -- 172.21.15.123:0/4158823448 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c018030 con 0x7f1b7013eb20 2024-09-15T23:22:13.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.439+0000 7f1b61ffb640 1 -- 172.21.15.123:0/4158823448 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b6c004020 con 0x7f1b7013eb20 2024-09-15T23:22:13.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.439+0000 7f1b7772c640 1 -- 172.21.15.123:0/4158823448 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b701f1b50 con 0x7f1b7013eb20 2024-09-15T23:22:13.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.439+0000 7f1b61ffb640 1 -- 172.21.15.123:0/4158823448 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c004230 con 0x7f1b7013eb20 2024-09-15T23:22:13.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.439+0000 7f1b7772c640 1 -- 172.21.15.123:0/4158823448 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b701f2110 con 0x7f1b7013eb20 2024-09-15T23:22:13.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.440+0000 7f1b7772c640 1 -- 172.21.15.123:0/4158823448 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b70156040 con 0x7f1b7013eb20 2024-09-15T23:22:13.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.441+0000 7f1b61ffb640 1 -- 172.21.15.123:0/4158823448 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1b6c01b070 con 0x7f1b7013eb20 2024-09-15T23:22:13.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.441+0000 7f1b61ffb640 1 --2- 172.21.15.123:0/4158823448 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1b5406c2b0 0x7f1b5406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:13.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.441+0000 7f1b61ffb640 1 -- 172.21.15.123:0/4158823448 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5882+0+0 (secure 0 0 0) 0x7f1b6c08b4a0 con 0x7f1b7013eb20 2024-09-15T23:22:13.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.441+0000 7f1b754c8640 1 --2- 172.21.15.123:0/4158823448 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1b5406c2b0 0x7f1b5406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:13.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.442+0000 7f1b754c8640 1 --2- 172.21.15.123:0/4158823448 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1b5406c2b0 0x7f1b5406e770 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f1b64034000 tx=0x7f1b6402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:13.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.445+0000 7f1b61ffb640 1 -- 172.21.15.123:0/4158823448 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1b6c059510 con 0x7f1b7013eb20 2024-09-15T23:22:13.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.646+0000 7f1b7772c640 1 -- 172.21.15.123:0/4158823448 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1b7015c1a0 con 0x7f1b7013eb20 2024-09-15T23:22:13.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.646+0000 7f1b61ffb640 1 -- 172.21.15.123:0/4158823448 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+4417 (secure 0 0 0) 0x7f1b6c05d810 con 0x7f1b7013eb20 2024-09-15T23:22:13.648 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:22:13.648 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":104,"btime":"2024-09-15T23:22:07:320455+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7214,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/1648353391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1648353391},{"type":"v1","addr":"172.21.15.188:6837","nonce":1648353391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8122,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/1714717257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":1714717257},{"type":"v1","addr":"172.21.15.188:6836","nonce":1714717257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:21:22.066391+0000","modified":"2024-09-15T23:22:07.320447+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":171,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9552},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9552":{"gid":9552,"name":"c","rank":0,"incarnation":101,"state":"up:active","state_seq":16,"addr":"172.21.15.123:6833/3722702026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3722702026},{"type":"v1","addr":"172.21.15.123:6833","nonce":3722702026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9552,"qdb_cluster":[9552]},"id":11}]} 2024-09-15T23:22:13.648 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 104 2024-09-15T23:22:13.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.648+0000 7f1b7772c640 1 -- 172.21.15.123:0/4158823448 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1b5406c2b0 msgr2=0x7f1b5406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:13.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.648+0000 7f1b7772c640 1 --2- 172.21.15.123:0/4158823448 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1b5406c2b0 0x7f1b5406e770 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f1b64034000 tx=0x7f1b6402e000 comp rx=0 tx=0).stop 2024-09-15T23:22:13.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.648+0000 7f1b7772c640 1 -- 172.21.15.123:0/4158823448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b7013eb20 msgr2=0x7f1b70156c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:13.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.648+0000 7f1b7772c640 1 --2- 172.21.15.123:0/4158823448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b7013eb20 0x7f1b70156c40 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c00d7d0 tx=0x7f1b6c00dc90 comp rx=0 tx=0).stop 2024-09-15T23:22:13.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.648+0000 7f1b7772c640 1 -- 172.21.15.123:0/4158823448 shutdown_connections 2024-09-15T23:22:13.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.648+0000 7f1b7772c640 1 --2- 172.21.15.123:0/4158823448 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1b7015bcf0 0x7f1b70157180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:13.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.648+0000 7f1b7772c640 1 --2- 172.21.15.123:0/4158823448 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1b5406c2b0 0x7f1b5406e770 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:13.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.648+0000 7f1b7772c640 1 --2- 172.21.15.123:0/4158823448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b7013eb20 0x7f1b70156c40 unknown :-1 s=CLOSED pgs=2007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:13.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.649+0000 7f1b7772c640 1 --2- 172.21.15.123:0/4158823448 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1b700b2d40 0x7f1b70154bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:13.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.649+0000 7f1b7772c640 1 -- 172.21.15.123:0/4158823448 >> 172.21.15.123:0/4158823448 conn(0x7f1b700ccec0 msgr2=0x7f1b700cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:13.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.649+0000 7f1b7772c640 1 -- 172.21.15.123:0/4158823448 shutdown_connections 2024-09-15T23:22:13.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.649+0000 7f1b7772c640 1 -- 172.21.15.123:0/4158823448 wait complete. 2024-09-15T23:22:13.660 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:22:13.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.758+0000 7fb57ed9f640 1 Processor -- start 2024-09-15T23:22:13.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.758+0000 7fb57ed9f640 1 -- start start 2024-09-15T23:22:13.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.759+0000 7fb57ed9f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb57815e870 0x7fb5780ae870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:13.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.759+0000 7fb57ed9f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb5780b2170 0x7fb578072cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:13.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.759+0000 7fb57ed9f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb57815f6e0 con 0x7fb57806f2a0 2024-09-15T23:22:13.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.759+0000 7fb57ed9f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fb578071c00 con 0x7fb5780b2170 2024-09-15T23:22:13.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.759+0000 7fb57ed9f640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fb57815f9c0 con 0x7fb57815e870 2024-09-15T23:22:13.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.759+0000 7fb57d59c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb5780b2170 0x7fb578072cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:13.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.759+0000 7fb57d59c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb5780b2170 0x7fb578072cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36968/0 (socket says 172.21.15.123:36968) 2024-09-15T23:22:13.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.759+0000 7fb57d59c640 1 -- 172.21.15.123:0/2036684119 learned_addr learned my addr 172.21.15.123:0/2036684119 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:13.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.759+0000 7fb57d59c640 1 -- 172.21.15.123:0/2036684119 >> v2:172.21.15.188:3300/0 conn(0x7fb57815e870 msgr2=0x7fb5780ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:13.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.759+0000 7fb57d59c640 1 --2- 172.21.15.123:0/2036684119 >> v2:172.21.15.188:3300/0 conn(0x7fb57815e870 0x7fb5780ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:13.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.759+0000 7fb57d59c640 1 -- 172.21.15.123:0/2036684119 >> v1:172.21.15.188:6789/0 conn(0x7fb57806f2a0 legacy=0x7fb578072090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:13.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.759+0000 7fb57d59c640 1 -- 172.21.15.123:0/2036684119 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb578071890 con 0x7fb5780b2170 2024-09-15T23:22:13.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.760+0000 7fb57d59c640 1 --2- 172.21.15.123:0/2036684119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5780b2170 0x7fb578072cd0 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7fb578071370 tx=0x7fb56802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef398fab1b2bcff3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:13.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.760+0000 7fb57cd9b640 1 -- 172.21.15.123:0/2036684119 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb568037070 con 0x7fb5780b2170 2024-09-15T23:22:13.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.760+0000 7fb57cd9b640 1 -- 172.21.15.123:0/2036684119 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb56802ae20 con 0x7fb5780b2170 2024-09-15T23:22:13.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.760+0000 7fb57cd9b640 1 -- 172.21.15.123:0/2036684119 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb568032660 con 0x7fb5780b2170 2024-09-15T23:22:13.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.760+0000 7fb57ed9f640 1 -- 172.21.15.123:0/2036684119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5780b2170 msgr2=0x7fb578072cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:13.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.760+0000 7fb57ed9f640 1 --2- 172.21.15.123:0/2036684119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5780b2170 0x7fb578072cd0 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7fb578071370 tx=0x7fb56802a110 comp rx=0 tx=0).stop 2024-09-15T23:22:13.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.760+0000 7fb57ed9f640 1 -- 172.21.15.123:0/2036684119 shutdown_connections 2024-09-15T23:22:13.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.760+0000 7fb57ed9f640 1 --2- 172.21.15.123:0/2036684119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5780b2170 0x7fb578072cd0 unknown :-1 s=CLOSED pgs=2008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:13.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.760+0000 7fb57ed9f640 1 --2- 172.21.15.123:0/2036684119 >> v2:172.21.15.188:3300/0 conn(0x7fb57815e870 0x7fb5780ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:13.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.760+0000 7fb57ed9f640 1 -- 172.21.15.123:0/2036684119 >> 172.21.15.123:0/2036684119 conn(0x7fb5780b0640 msgr2=0x7fb5780b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:13.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.761+0000 7fb57ed9f640 1 -- 172.21.15.123:0/2036684119 shutdown_connections 2024-09-15T23:22:13.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.761+0000 7fb57ed9f640 1 -- 172.21.15.123:0/2036684119 wait complete. 2024-09-15T23:22:13.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.762+0000 7fb57ed9f640 1 Processor -- start 2024-09-15T23:22:13.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.762+0000 7fb57ed9f640 1 -- start start 2024-09-15T23:22:13.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.762+0000 7fb57ed9f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb57806f2a0 0x7fb57814ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:13.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.762+0000 7fb57ed9f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5780b2170 0x7fb578162940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:13.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.762+0000 7fb57ed9f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb57814d0c0 0x7fb578160150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:13.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.762+0000 7fb57ed9f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb5780aef30 con 0x7fb57806f2a0 2024-09-15T23:22:13.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.762+0000 7fb57ed9f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb5780aedb0 con 0x7fb57814d0c0 2024-09-15T23:22:13.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.762+0000 7fb57ed9f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb5780727a0 con 0x7fb5780b2170 2024-09-15T23:22:13.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.762+0000 7fb57dd9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb57806f2a0 0x7fb57814ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:13.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.763+0000 7fb57dd9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb57806f2a0 0x7fb57814ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36984/0 (socket says 172.21.15.123:36984) 2024-09-15T23:22:13.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.763+0000 7fb57dd9d640 1 -- 172.21.15.123:0/3651641542 learned_addr learned my addr 172.21.15.123:0/3651641542 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:13.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.763+0000 7fb57d59c640 1 --2- 172.21.15.123:0/3651641542 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5780b2170 0x7fb578162940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:13.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.763+0000 7fb57e59e640 1 --2- 172.21.15.123:0/3651641542 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb57814d0c0 0x7fb578160150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:13.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.763+0000 7fb57dd9d640 1 -- 172.21.15.123:0/3651641542 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5780b2170 msgr2=0x7fb578162940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:13.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.763+0000 7fb57dd9d640 1 --2- 172.21.15.123:0/3651641542 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5780b2170 0x7fb578162940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:13.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.763+0000 7fb57dd9d640 1 -- 172.21.15.123:0/3651641542 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb57814d0c0 msgr2=0x7fb578160150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:13.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.763+0000 7fb57dd9d640 1 --2- 172.21.15.123:0/3651641542 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb57814d0c0 0x7fb578160150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:13.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.763+0000 7fb57dd9d640 1 -- 172.21.15.123:0/3651641542 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb578162e80 con 0x7fb57806f2a0 2024-09-15T23:22:13.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.763+0000 7fb57e59e640 1 --2- 172.21.15.123:0/3651641542 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb57814d0c0 0x7fb578160150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:22:13.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.763+0000 7fb57dd9d640 1 --2- 172.21.15.123:0/3651641542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb57806f2a0 0x7fb57814ca10 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7fb57400b410 tx=0x7fb57400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:13.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.763+0000 7fb56e7fc640 1 -- 172.21.15.123:0/3651641542 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb574015020 con 0x7fb57806f2a0 2024-09-15T23:22:13.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.763+0000 7fb56e7fc640 1 -- 172.21.15.123:0/3651641542 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb574011850 con 0x7fb57806f2a0 2024-09-15T23:22:13.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.763+0000 7fb57ed9f640 1 -- 172.21.15.123:0/3651641542 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb578160e20 con 0x7fb57806f2a0 2024-09-15T23:22:13.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.763+0000 7fb56e7fc640 1 -- 172.21.15.123:0/3651641542 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb574011c40 con 0x7fb57806f2a0 2024-09-15T23:22:13.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.763+0000 7fb57ed9f640 1 -- 172.21.15.123:0/3651641542 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5781613e0 con 0x7fb57806f2a0 2024-09-15T23:22:13.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.764+0000 7fb57ed9f640 1 -- 172.21.15.123:0/3651641542 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb57814d8d0 con 0x7fb57806f2a0 2024-09-15T23:22:13.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.765+0000 7fb56e7fc640 1 -- 172.21.15.123:0/3651641542 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb574018020 con 0x7fb57806f2a0 2024-09-15T23:22:13.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.765+0000 7fb56e7fc640 1 --2- 172.21.15.123:0/3651641542 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb55c06c2b0 0x7fb55c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:13.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.765+0000 7fb56e7fc640 1 -- 172.21.15.123:0/3651641542 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5882+0+0 (secure 0 0 0) 0x7fb57408b450 con 0x7fb57806f2a0 2024-09-15T23:22:13.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.765+0000 7fb57d59c640 1 --2- 172.21.15.123:0/3651641542 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb55c06c2b0 0x7fb55c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:13.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.766+0000 7fb57d59c640 1 --2- 172.21.15.123:0/3651641542 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb55c06c2b0 0x7fb55c06e770 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fb568034000 tx=0x7fb56802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:13.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.769+0000 7fb56e7fc640 1 -- 172.21.15.123:0/3651641542 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb57401f020 con 0x7fb57806f2a0 2024-09-15T23:22:13.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.966+0000 7fb57ed9f640 1 -- 172.21.15.123:0/3651641542 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb5780ae870 con 0x7fb57806f2a0 2024-09-15T23:22:13.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.967+0000 7fb56e7fc640 1 -- 172.21.15.123:0/3651641542 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+4417 (secure 0 0 0) 0x7fb5740172c0 con 0x7fb57806f2a0 2024-09-15T23:22:13.968 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:22:13.968 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":104,"btime":"2024-09-15T23:22:07:320455+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7214,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/1648353391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1648353391},{"type":"v1","addr":"172.21.15.188:6837","nonce":1648353391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8122,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/1714717257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":1714717257},{"type":"v1","addr":"172.21.15.188:6836","nonce":1714717257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:21:22.066391+0000","modified":"2024-09-15T23:22:07.320447+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":171,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9552},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9552":{"gid":9552,"name":"c","rank":0,"incarnation":101,"state":"up:active","state_seq":16,"addr":"172.21.15.123:6833/3722702026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3722702026},{"type":"v1","addr":"172.21.15.123:6833","nonce":3722702026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9552,"qdb_cluster":[9552]},"id":11}]} 2024-09-15T23:22:13.969 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 104 2024-09-15T23:22:13.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.969+0000 7fb57ed9f640 1 -- 172.21.15.123:0/3651641542 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb55c06c2b0 msgr2=0x7fb55c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:13.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.969+0000 7fb57ed9f640 1 --2- 172.21.15.123:0/3651641542 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb55c06c2b0 0x7fb55c06e770 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fb568034000 tx=0x7fb56802e000 comp rx=0 tx=0).stop 2024-09-15T23:22:13.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.969+0000 7fb57ed9f640 1 -- 172.21.15.123:0/3651641542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb57806f2a0 msgr2=0x7fb57814ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:13.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.969+0000 7fb57ed9f640 1 --2- 172.21.15.123:0/3651641542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb57806f2a0 0x7fb57814ca10 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7fb57400b410 tx=0x7fb57400b8d0 comp rx=0 tx=0).stop 2024-09-15T23:22:13.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.969+0000 7fb57ed9f640 1 -- 172.21.15.123:0/3651641542 shutdown_connections 2024-09-15T23:22:13.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.969+0000 7fb57ed9f640 1 --2- 172.21.15.123:0/3651641542 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb57814d0c0 0x7fb578160150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:13.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.969+0000 7fb57ed9f640 1 --2- 172.21.15.123:0/3651641542 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5780b2170 0x7fb578162940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:13.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.969+0000 7fb57ed9f640 1 --2- 172.21.15.123:0/3651641542 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb55c06c2b0 0x7fb55c06e770 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:13.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.969+0000 7fb57ed9f640 1 --2- 172.21.15.123:0/3651641542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb57806f2a0 0x7fb57814ca10 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:13.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.969+0000 7fb57ed9f640 1 -- 172.21.15.123:0/3651641542 >> 172.21.15.123:0/3651641542 conn(0x7fb5780b0640 msgr2=0x7fb5780b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:13.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.969+0000 7fb57ed9f640 1 -- 172.21.15.123:0/3651641542 shutdown_connections 2024-09-15T23:22:13.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:13.969+0000 7fb57ed9f640 1 -- 172.21.15.123:0/3651641542 wait complete. 2024-09-15T23:22:13.981 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:22:14.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.079+0000 7f7f5db11640 1 Processor -- start 2024-09-15T23:22:14.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.079+0000 7f7f5db11640 1 -- start start 2024-09-15T23:22:14.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.080+0000 7f7f5db11640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7f580b6830 0x7f7f5806e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:14.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.080+0000 7f7f5db11640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f58067b50 con 0x7f7f580b02b0 2024-09-15T23:22:14.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.080+0000 7f7f5db11640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f580ce860 con 0x7f7f5815c4b0 2024-09-15T23:22:14.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.080+0000 7f7f5db11640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f7f58070130 con 0x7f7f580b6830 2024-09-15T23:22:14.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.080+0000 7f7f57fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7f580b02b0 0x7f7f5806e720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41876/0 (socket says 172.21.15.123:41876) 2024-09-15T23:22:14.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.080+0000 7f7f57fff640 1 -- 172.21.15.123:0/267477286 learned_addr learned my addr 172.21.15.123:0/267477286 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:14.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.080+0000 7f7f56ffd640 1 --2- 172.21.15.123:0/267477286 >> v2:172.21.15.188:3300/0 conn(0x7f7f580b6830 0x7f7f5806e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:14.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.080+0000 7f7f567fc640 1 -- 172.21.15.123:0/267477286 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3180218711 0 0) 0x7f7f50001490 con 0x7f7f580b02b0 2024-09-15T23:22:14.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.080+0000 7f7f567fc640 1 -- 172.21.15.123:0/267477286 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f40003520 con 0x7f7f580b02b0 2024-09-15T23:22:14.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.080+0000 7f7f567fc640 1 -- 172.21.15.123:0/267477286 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2830892670 0 0) 0x7f7f40003520 con 0x7f7f580b02b0 2024-09-15T23:22:14.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.080+0000 7f7f567fc640 1 -- 172.21.15.123:0/267477286 >> v2:172.21.15.188:3300/0 conn(0x7f7f580b6830 msgr2=0x7f7f5806e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:14.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.080+0000 7f7f567fc640 1 --2- 172.21.15.123:0/267477286 >> v2:172.21.15.188:3300/0 conn(0x7f7f580b6830 0x7f7f5806e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:14.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.080+0000 7f7f567fc640 1 -- 172.21.15.123:0/267477286 >> v1:172.21.15.188:6789/0 conn(0x7f7f5815c4b0 legacy=0x7f7f580b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:14.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.080+0000 7f7f567fc640 1 -- 172.21.15.123:0/267477286 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f5806fe50 con 0x7f7f580b02b0 2024-09-15T23:22:14.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.080+0000 7f7f567fc640 1 -- 172.21.15.123:0/267477286 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f7f50001bc0 con 0x7f7f580b02b0 2024-09-15T23:22:14.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.080+0000 7f7f567fc640 1 -- 172.21.15.123:0/267477286 >> v1:172.21.15.123:6789/0 conn(0x7f7f580b02b0 legacy=0x7f7f5806e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:14.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.080+0000 7f7f567fc640 1 --2- 172.21.15.123:0/267477286 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f400039b0 0x7f7f40003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:14.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.080+0000 7f7f567fc640 1 --2- 172.21.15.123:0/267477286 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f40004800 0x7f7f40004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:14.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.080+0000 7f7f567fc640 1 --2- 172.21.15.123:0/267477286 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f400051c0 0x7f7f4000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:14.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.080+0000 7f7f567fc640 1 -- 172.21.15.123:0/267477286 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7f58070130 con 0x7f7f400039b0 2024-09-15T23:22:14.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.080+0000 7f7f567fc640 1 -- 172.21.15.123:0/267477286 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4000c060 con 0x7f7f40004800 2024-09-15T23:22:14.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.080+0000 7f7f567fc640 1 -- 172.21.15.123:0/267477286 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7f4000c260 con 0x7f7f400051c0 2024-09-15T23:22:14.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.080+0000 7f7f577fe640 1 --2- 172.21.15.123:0/267477286 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f400039b0 0x7f7f40003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:14.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.081+0000 7f7f56ffd640 1 --2- 172.21.15.123:0/267477286 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f40004800 0x7f7f40004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:14.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.081+0000 7f7f57fff640 1 --2- 172.21.15.123:0/267477286 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f400051c0 0x7f7f4000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:14.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.081+0000 7f7f577fe640 1 -- 172.21.15.123:0/267477286 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f400051c0 msgr2=0x7f7f4000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:14.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.081+0000 7f7f577fe640 1 --2- 172.21.15.123:0/267477286 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f400051c0 0x7f7f4000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:14.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.081+0000 7f7f577fe640 1 -- 172.21.15.123:0/267477286 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f40004800 msgr2=0x7f7f40004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:14.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.081+0000 7f7f577fe640 1 --2- 172.21.15.123:0/267477286 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f40004800 0x7f7f40004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:14.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.081+0000 7f7f57fff640 1 -- 172.21.15.123:0/267477286 reap_dead start 2024-09-15T23:22:14.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.081+0000 7f7f577fe640 1 -- 172.21.15.123:0/267477286 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f40003520 con 0x7f7f400039b0 2024-09-15T23:22:14.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.081+0000 7f7f577fe640 1 --2- 172.21.15.123:0/267477286 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f400039b0 0x7f7f40003dd0 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7f7f48001750 tx=0x7f7f40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee19740859bfaa53 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:14.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.082+0000 7f7f567fc640 1 -- 172.21.15.123:0/267477286 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f48001370 con 0x7f7f400039b0 2024-09-15T23:22:14.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.082+0000 7f7f567fc640 1 -- 172.21.15.123:0/267477286 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f480052d0 con 0x7f7f400039b0 2024-09-15T23:22:14.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.082+0000 7f7f567fc640 1 -- 172.21.15.123:0/267477286 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f4802abe0 con 0x7f7f400039b0 2024-09-15T23:22:14.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.082+0000 7f7f5db11640 1 -- 172.21.15.123:0/267477286 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f400039b0 msgr2=0x7f7f40003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:14.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.082+0000 7f7f5db11640 1 --2- 172.21.15.123:0/267477286 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f400039b0 0x7f7f40003dd0 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7f7f48001750 tx=0x7f7f40005830 comp rx=0 tx=0).stop 2024-09-15T23:22:14.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.082+0000 7f7f5db11640 1 -- 172.21.15.123:0/267477286 shutdown_connections 2024-09-15T23:22:14.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.082+0000 7f7f5db11640 1 --2- 172.21.15.123:0/267477286 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f400039b0 0x7f7f40003dd0 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:14.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.082+0000 7f7f5db11640 1 -- 172.21.15.123:0/267477286 >> 172.21.15.123:0/267477286 conn(0x7f7f580b0a80 msgr2=0x7f7f580b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:14.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.082+0000 7f7f5db11640 1 -- 172.21.15.123:0/267477286 shutdown_connections 2024-09-15T23:22:14.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.082+0000 7f7f5db11640 1 -- 172.21.15.123:0/267477286 wait complete. 2024-09-15T23:22:14.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.083+0000 7f7f5db11640 1 Processor -- start 2024-09-15T23:22:14.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.083+0000 7f7f5db11640 1 -- start start 2024-09-15T23:22:14.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.084+0000 7f7f5db11640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f400039b0 0x7f7f58141200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:14.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.084+0000 7f7f5db11640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f58158620 0x7f7f581e7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:14.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.084+0000 7f7f5db11640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f58158aa0 0x7f7f580728b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:14.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.084+0000 7f7f5db11640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5806dcc0 con 0x7f7f58158aa0 2024-09-15T23:22:14.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.084+0000 7f7f5db11640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7f580ce580 con 0x7f7f58158620 2024-09-15T23:22:14.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.084+0000 7f7f5db11640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7f5815c890 con 0x7f7f400039b0 2024-09-15T23:22:14.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.084+0000 7f7f57fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f58158aa0 0x7f7f580728b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:14.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.084+0000 7f7f57fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f58158aa0 0x7f7f580728b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37006/0 (socket says 172.21.15.123:37006) 2024-09-15T23:22:14.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.084+0000 7f7f57fff640 1 -- 172.21.15.123:0/192965235 learned_addr learned my addr 172.21.15.123:0/192965235 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:14.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.084+0000 7f7f56ffd640 1 --2- 172.21.15.123:0/192965235 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f58158620 0x7f7f581e7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:14.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.084+0000 7f7f577fe640 1 --2- 172.21.15.123:0/192965235 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f400039b0 0x7f7f58141200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:14.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.085+0000 7f7f57fff640 1 -- 172.21.15.123:0/192965235 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f400039b0 msgr2=0x7f7f58141200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:14.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.085+0000 7f7f57fff640 1 --2- 172.21.15.123:0/192965235 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f400039b0 0x7f7f58141200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:14.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.085+0000 7f7f57fff640 1 -- 172.21.15.123:0/192965235 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f58158620 msgr2=0x7f7f581e7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:14.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.085+0000 7f7f57fff640 1 --2- 172.21.15.123:0/192965235 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f58158620 0x7f7f581e7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:14.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.085+0000 7f7f57fff640 1 -- 172.21.15.123:0/192965235 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f58141c20 con 0x7f7f58158aa0 2024-09-15T23:22:14.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.085+0000 7f7f56ffd640 1 --2- 172.21.15.123:0/192965235 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f58158620 0x7f7f581e7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:14.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.085+0000 7f7f57fff640 1 --2- 172.21.15.123:0/192965235 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f58158aa0 0x7f7f580728b0 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f7f580b6e70 tx=0x7f7f50007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:14.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.085+0000 7f7f3ffff640 1 -- 172.21.15.123:0/192965235 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f50017020 con 0x7f7f58158aa0 2024-09-15T23:22:14.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.085+0000 7f7f3ffff640 1 -- 172.21.15.123:0/192965235 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f5000eaa0 con 0x7f7f58158aa0 2024-09-15T23:22:14.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.085+0000 7f7f5db11640 1 -- 172.21.15.123:0/192965235 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f58141f00 con 0x7f7f58158aa0 2024-09-15T23:22:14.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.085+0000 7f7f3ffff640 1 -- 172.21.15.123:0/192965235 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5000ee70 con 0x7f7f58158aa0 2024-09-15T23:22:14.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.085+0000 7f7f5db11640 1 -- 172.21.15.123:0/192965235 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f581424c0 con 0x7f7f58158aa0 2024-09-15T23:22:14.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.086+0000 7f7f5db11640 1 -- 172.21.15.123:0/192965235 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f580d08e0 con 0x7f7f58158aa0 2024-09-15T23:22:14.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.086+0000 7f7f3ffff640 1 -- 172.21.15.123:0/192965235 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7f5001a020 con 0x7f7f58158aa0 2024-09-15T23:22:14.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.087+0000 7f7f3ffff640 1 --2- 172.21.15.123:0/192965235 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7f4406c2b0 0x7f7f4406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:14.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.087+0000 7f7f3ffff640 1 -- 172.21.15.123:0/192965235 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5882+0+0 (secure 0 0 0) 0x7f7f5008b570 con 0x7f7f58158aa0 2024-09-15T23:22:14.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.087+0000 7f7f577fe640 1 --2- 172.21.15.123:0/192965235 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7f4406c2b0 0x7f7f4406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:14.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.088+0000 7f7f577fe640 1 --2- 172.21.15.123:0/192965235 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7f4406c2b0 0x7f7f4406e770 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f7f48032000 tx=0x7f7f4802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:14.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.091+0000 7f7f3ffff640 1 -- 172.21.15.123:0/192965235 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7f50021030 con 0x7f7f58158aa0 2024-09-15T23:22:14.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.257+0000 7f7f5db11640 1 -- 172.21.15.123:0/192965235 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7f580b1910 con 0x7f7f58158aa0 2024-09-15T23:22:14.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.258+0000 7f7f3ffff640 1 -- 172.21.15.123:0/192965235 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v171) ==== 74+0+17040 (secure 0 0 0) 0x7f7f58067b50 con 0x7f7f58158aa0 2024-09-15T23:22:14.259 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:22:14.259 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":171,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:22:04.310090+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:21:20.662502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-15T23:21:21.024002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"23.19","mappings":[{"from":5,"to":7}]},{"pgid":"23.1a","mappings":[{"from":4,"to":3}]},{"pgid":"23.2a","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6835/1883512279":"2024-09-16T23:22:04.310006+0000","172.21.15.123:6834/1883512279":"2024-09-16T23:22:04.310006+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:22:14.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.260+0000 7f7f5db11640 1 -- 172.21.15.123:0/192965235 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7f4406c2b0 msgr2=0x7f7f4406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:14.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.260+0000 7f7f5db11640 1 --2- 172.21.15.123:0/192965235 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7f4406c2b0 0x7f7f4406e770 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f7f48032000 tx=0x7f7f4802e000 comp rx=0 tx=0).stop 2024-09-15T23:22:14.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.260+0000 7f7f5db11640 1 -- 172.21.15.123:0/192965235 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f58158aa0 msgr2=0x7f7f580728b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:14.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.260+0000 7f7f5db11640 1 --2- 172.21.15.123:0/192965235 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f58158aa0 0x7f7f580728b0 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f7f580b6e70 tx=0x7f7f50007bc0 comp rx=0 tx=0).stop 2024-09-15T23:22:14.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.260+0000 7f7f5db11640 1 -- 172.21.15.123:0/192965235 shutdown_connections 2024-09-15T23:22:14.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.260+0000 7f7f5db11640 1 --2- 172.21.15.123:0/192965235 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7f4406c2b0 0x7f7f4406e770 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:14.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.260+0000 7f7f5db11640 1 --2- 172.21.15.123:0/192965235 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f58158aa0 0x7f7f580728b0 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:14.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.260+0000 7f7f5db11640 1 --2- 172.21.15.123:0/192965235 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7f58158620 0x7f7f581e7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:14.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.260+0000 7f7f5db11640 1 --2- 172.21.15.123:0/192965235 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7f400039b0 0x7f7f58141200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:14.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.260+0000 7f7f5db11640 1 -- 172.21.15.123:0/192965235 >> 172.21.15.123:0/192965235 conn(0x7f7f580b0a80 msgr2=0x7f7f5815f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:14.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.260+0000 7f7f5db11640 1 -- 172.21.15.123:0/192965235 shutdown_connections 2024-09-15T23:22:14.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.260+0000 7f7f5db11640 1 -- 172.21.15.123:0/192965235 wait complete. 2024-09-15T23:22:14.272 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T23:22:14.273 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:22:14.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.371+0000 7f1eb07d6640 1 Processor -- start 2024-09-15T23:22:14.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.371+0000 7f1eb07d6640 1 -- start start 2024-09-15T23:22:14.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.372+0000 7f1eb07d6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1ea806c6a0 0x7f1ea80720b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:14.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.372+0000 7f1eb07d6640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ea8071010 con 0x7f1ea815af20 2024-09-15T23:22:14.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.372+0000 7f1eb07d6640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ea80712f0 con 0x7f1ea815ab40 2024-09-15T23:22:14.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.372+0000 7f1eb07d6640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f1ea806cb10 con 0x7f1ea806c6a0 2024-09-15T23:22:14.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.372+0000 7f1eadd71640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1ea806c6a0 0x7f1ea80720b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:14.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.372+0000 7f1eaed73640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1ea815af20 0x7f1ea815b370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41888/0 (socket says 172.21.15.123:41888) 2024-09-15T23:22:14.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.372+0000 7f1eaed73640 1 -- 172.21.15.123:0/3878193363 learned_addr learned my addr 172.21.15.123:0/3878193363 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:14.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.372+0000 7f1eadd71640 1 -- 172.21.15.123:0/3878193363 >> v1:172.21.15.188:6789/0 conn(0x7f1ea815ab40 legacy=0x7f1ea8073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:14.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.372+0000 7f1eadd71640 1 -- 172.21.15.123:0/3878193363 >> v1:172.21.15.123:6789/0 conn(0x7f1ea815af20 legacy=0x7f1ea815b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:14.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.372+0000 7f1ead570640 1 -- 172.21.15.123:0/3878193363 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1115762894 0 0) 0x7f1ea8071010 con 0x7f1ea815af20 2024-09-15T23:22:14.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.372+0000 7f1eadd71640 1 -- 172.21.15.123:0/3878193363 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea80715d0 con 0x7f1ea806c6a0 2024-09-15T23:22:14.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.373+0000 7f1eadd71640 1 --2- 172.21.15.123:0/3878193363 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ea806c6a0 0x7f1ea80720b0 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7f1e9800a940 tx=0x7f1e9802b510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daa6c3ec8a7a18a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:14.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.373+0000 7f1ead570640 1 -- 172.21.15.123:0/3878193363 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e9800b040 con 0x7f1ea806c6a0 2024-09-15T23:22:14.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.373+0000 7f1ead570640 1 -- 172.21.15.123:0/3878193363 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e98030710 con 0x7f1ea806c6a0 2024-09-15T23:22:14.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.373+0000 7f1ead570640 1 -- 172.21.15.123:0/3878193363 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e98030ae0 con 0x7f1ea806c6a0 2024-09-15T23:22:14.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.374+0000 7f1eb07d6640 1 -- 172.21.15.123:0/3878193363 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ea806c6a0 msgr2=0x7f1ea80720b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:14.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.374+0000 7f1eb07d6640 1 --2- 172.21.15.123:0/3878193363 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ea806c6a0 0x7f1ea80720b0 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7f1e9800a940 tx=0x7f1e9802b510 comp rx=0 tx=0).stop 2024-09-15T23:22:14.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.374+0000 7f1eb07d6640 1 -- 172.21.15.123:0/3878193363 shutdown_connections 2024-09-15T23:22:14.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.374+0000 7f1eb07d6640 1 --2- 172.21.15.123:0/3878193363 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ea806c6a0 0x7f1ea80720b0 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:14.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.374+0000 7f1eb07d6640 1 -- 172.21.15.123:0/3878193363 >> 172.21.15.123:0/3878193363 conn(0x7f1ea80ccec0 msgr2=0x7f1ea80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:14.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.374+0000 7f1eb07d6640 1 -- 172.21.15.123:0/3878193363 shutdown_connections 2024-09-15T23:22:14.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.374+0000 7f1eb07d6640 1 -- 172.21.15.123:0/3878193363 wait complete. 2024-09-15T23:22:14.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.375+0000 7f1eb07d6640 1 Processor -- start 2024-09-15T23:22:14.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.375+0000 7f1eb07d6640 1 -- start start 2024-09-15T23:22:14.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.376+0000 7f1eb07d6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1ea806c6a0 0x7f1ea814d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:14.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.376+0000 7f1eb07d6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1ea815ab40 0x7f1ea80cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:14.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.376+0000 7f1eb07d6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ea815af20 0x7f1ea80cb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:14.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.376+0000 7f1eb07d6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea806bc10 con 0x7f1ea815af20 2024-09-15T23:22:14.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.376+0000 7f1eb07d6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea815ba80 con 0x7f1ea806c6a0 2024-09-15T23:22:14.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.376+0000 7f1eb07d6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1ea806bd90 con 0x7f1ea815ab40 2024-09-15T23:22:14.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.376+0000 7f1eaed73640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ea815af20 0x7f1ea80cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:14.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.376+0000 7f1eaed73640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ea815af20 0x7f1ea80cb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37022/0 (socket says 172.21.15.123:37022) 2024-09-15T23:22:14.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.376+0000 7f1eaed73640 1 -- 172.21.15.123:0/681693964 learned_addr learned my addr 172.21.15.123:0/681693964 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:14.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.376+0000 7f1eadd71640 1 --2- 172.21.15.123:0/681693964 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1ea815ab40 0x7f1ea80cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:14.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.376+0000 7f1eae572640 1 --2- 172.21.15.123:0/681693964 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1ea806c6a0 0x7f1ea814d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:14.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.376+0000 7f1eaed73640 1 -- 172.21.15.123:0/681693964 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1ea815ab40 msgr2=0x7f1ea80cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:14.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.376+0000 7f1eaed73640 1 --2- 172.21.15.123:0/681693964 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1ea815ab40 0x7f1ea80cac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:14.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.376+0000 7f1eaed73640 1 -- 172.21.15.123:0/681693964 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1ea806c6a0 msgr2=0x7f1ea814d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:14.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.376+0000 7f1eaed73640 1 --2- 172.21.15.123:0/681693964 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1ea806c6a0 0x7f1ea814d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:14.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.376+0000 7f1eaed73640 1 -- 172.21.15.123:0/681693964 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea80c8da0 con 0x7f1ea815af20 2024-09-15T23:22:14.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.376+0000 7f1eaed73640 1 --2- 172.21.15.123:0/681693964 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ea815af20 0x7f1ea80cb190 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7f1ea000c730 tx=0x7f1ea000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:14.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.376+0000 7f1e9effd640 1 -- 172.21.15.123:0/681693964 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea0018070 con 0x7f1ea815af20 2024-09-15T23:22:14.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.376+0000 7f1e9effd640 1 -- 172.21.15.123:0/681693964 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ea000ce40 con 0x7f1ea815af20 2024-09-15T23:22:14.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.376+0000 7f1e9effd640 1 -- 172.21.15.123:0/681693964 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea000a860 con 0x7f1ea815af20 2024-09-15T23:22:14.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.376+0000 7f1eb07d6640 1 -- 172.21.15.123:0/681693964 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ea80c9080 con 0x7f1ea815af20 2024-09-15T23:22:14.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.376+0000 7f1eb07d6640 1 -- 172.21.15.123:0/681693964 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ea80c9640 con 0x7f1ea815af20 2024-09-15T23:22:14.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.377+0000 7f1eb07d6640 1 -- 172.21.15.123:0/681693964 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ea806c120 con 0x7f1ea815af20 2024-09-15T23:22:14.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.378+0000 7f1e9effd640 1 -- 172.21.15.123:0/681693964 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1ea001b070 con 0x7f1ea815af20 2024-09-15T23:22:14.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.378+0000 7f1e9effd640 1 --2- 172.21.15.123:0/681693964 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1e8c06c2b0 0x7f1e8c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:14.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.379+0000 7f1e9effd640 1 -- 172.21.15.123:0/681693964 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5882+0+0 (secure 0 0 0) 0x7f1ea008aa50 con 0x7f1ea815af20 2024-09-15T23:22:14.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.379+0000 7f1eae572640 1 --2- 172.21.15.123:0/681693964 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1e8c06c2b0 0x7f1e8c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:14.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.379+0000 7f1eae572640 1 --2- 172.21.15.123:0/681693964 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1e8c06c2b0 0x7f1e8c06e770 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4004f60 tx=0x7f1ea4007e30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:14.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.383+0000 7f1e9effd640 1 -- 172.21.15.123:0/681693964 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1ea0058ac0 con 0x7f1ea815af20 2024-09-15T23:22:14.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.585+0000 7f1eb07d6640 1 -- 172.21.15.123:0/681693964 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ea8072510 con 0x7f1ea815af20 2024-09-15T23:22:14.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.585+0000 7f1e9effd640 1 -- 172.21.15.123:0/681693964 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+4417 (secure 0 0 0) 0x7f1ea005cdc0 con 0x7f1ea815af20 2024-09-15T23:22:14.587 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:22:14.587 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":104,"btime":"2024-09-15T23:22:07:320455+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7214,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/1648353391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1648353391},{"type":"v1","addr":"172.21.15.188:6837","nonce":1648353391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8122,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/1714717257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":1714717257},{"type":"v1","addr":"172.21.15.188:6836","nonce":1714717257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:21:22.066391+0000","modified":"2024-09-15T23:22:07.320447+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":171,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9552},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9552":{"gid":9552,"name":"c","rank":0,"incarnation":101,"state":"up:active","state_seq":16,"addr":"172.21.15.123:6833/3722702026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3722702026},{"type":"v1","addr":"172.21.15.123:6833","nonce":3722702026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9552,"qdb_cluster":[9552]},"id":11}]} 2024-09-15T23:22:14.587 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 104 2024-09-15T23:22:14.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.587+0000 7f1eb07d6640 1 -- 172.21.15.123:0/681693964 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1e8c06c2b0 msgr2=0x7f1e8c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:14.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.587+0000 7f1eb07d6640 1 --2- 172.21.15.123:0/681693964 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1e8c06c2b0 0x7f1e8c06e770 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4004f60 tx=0x7f1ea4007e30 comp rx=0 tx=0).stop 2024-09-15T23:22:14.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.587+0000 7f1eb07d6640 1 -- 172.21.15.123:0/681693964 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ea815af20 msgr2=0x7f1ea80cb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:14.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.587+0000 7f1eb07d6640 1 --2- 172.21.15.123:0/681693964 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ea815af20 0x7f1ea80cb190 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7f1ea000c730 tx=0x7f1ea000cbf0 comp rx=0 tx=0).stop 2024-09-15T23:22:14.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.587+0000 7f1eb07d6640 1 -- 172.21.15.123:0/681693964 shutdown_connections 2024-09-15T23:22:14.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.587+0000 7f1eb07d6640 1 --2- 172.21.15.123:0/681693964 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1e8c06c2b0 0x7f1e8c06e770 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:14.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.587+0000 7f1eb07d6640 1 --2- 172.21.15.123:0/681693964 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ea815af20 0x7f1ea80cb190 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:14.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.587+0000 7f1eb07d6640 1 --2- 172.21.15.123:0/681693964 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1ea815ab40 0x7f1ea80cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:14.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.587+0000 7f1eb07d6640 1 --2- 172.21.15.123:0/681693964 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1ea806c6a0 0x7f1ea814d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:14.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.587+0000 7f1eb07d6640 1 -- 172.21.15.123:0/681693964 >> 172.21.15.123:0/681693964 conn(0x7f1ea80ccec0 msgr2=0x7f1ea80cf3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:14.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.587+0000 7f1eb07d6640 1 -- 172.21.15.123:0/681693964 shutdown_connections 2024-09-15T23:22:14.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.587+0000 7f1eb07d6640 1 -- 172.21.15.123:0/681693964 wait complete. 2024-09-15T23:22:14.600 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:22:14.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.697+0000 7fb5dcad0640 1 Processor -- start 2024-09-15T23:22:14.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.697+0000 7fb5dcad0640 1 -- start start 2024-09-15T23:22:14.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.698+0000 7fb5dcad0640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb5d8145ed0 0x7fb5d80b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:14.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.698+0000 7fb5dcad0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5d8073180 0x7fb5d80735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:14.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.698+0000 7fb5dcad0640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5d80b4020 con 0x7fb5d80b5880 2024-09-15T23:22:14.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.698+0000 7fb5dcad0640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fb5d8073b00 con 0x7fb5d8145ed0 2024-09-15T23:22:14.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.698+0000 7fb5dcad0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb5d80b42c0 con 0x7fb5d8073180 2024-09-15T23:22:14.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.698+0000 7fb5d659c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb5d8145ed0 0x7fb5d80b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:14.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.698+0000 7fb5d659c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb5d8145ed0 0x7fb5d80b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37028/0 (socket says 172.21.15.123:37028) 2024-09-15T23:22:14.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.698+0000 7fb5d6d9d640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb5d80b5880 0x7fb5d80b5d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41900/0 (socket says 172.21.15.123:41900) 2024-09-15T23:22:14.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.698+0000 7fb5d659c640 1 -- 172.21.15.123:0/1970411666 learned_addr learned my addr 172.21.15.123:0/1970411666 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:14.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.698+0000 7fb5d5d9b640 1 --2- 172.21.15.123:0/1970411666 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5d8073180 0x7fb5d80735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:14.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.698+0000 7fb5d659c640 1 -- 172.21.15.123:0/1970411666 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5d8073180 msgr2=0x7fb5d80735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:14.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.698+0000 7fb5d659c640 1 --2- 172.21.15.123:0/1970411666 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5d8073180 0x7fb5d80735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:14.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.698+0000 7fb5d659c640 1 -- 172.21.15.123:0/1970411666 >> v1:172.21.15.123:6789/0 conn(0x7fb5d80b5880 legacy=0x7fb5d80b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:14.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.698+0000 7fb5d659c640 1 -- 172.21.15.123:0/1970411666 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5d80b45a0 con 0x7fb5d8145ed0 2024-09-15T23:22:14.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.698+0000 7fb5d5d9b640 1 --2- 172.21.15.123:0/1970411666 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5d8073180 0x7fb5d80735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:22:14.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.699+0000 7fb5d659c640 1 --2- 172.21.15.123:0/1970411666 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5d8145ed0 0x7fb5d80b5080 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8009870 tx=0x7fb5c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=405492845f6d2ebd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:14.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.699+0000 7fb5d559a640 1 -- 172.21.15.123:0/1970411666 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c8037070 con 0x7fb5d8145ed0 2024-09-15T23:22:14.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.699+0000 7fb5d559a640 1 -- 172.21.15.123:0/1970411666 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5c8032440 con 0x7fb5d8145ed0 2024-09-15T23:22:14.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.699+0000 7fb5d559a640 1 -- 172.21.15.123:0/1970411666 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c8032810 con 0x7fb5d8145ed0 2024-09-15T23:22:14.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.700+0000 7fb5dcad0640 1 -- 172.21.15.123:0/1970411666 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5d8145ed0 msgr2=0x7fb5d80b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:14.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.700+0000 7fb5dcad0640 1 --2- 172.21.15.123:0/1970411666 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5d8145ed0 0x7fb5d80b5080 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8009870 tx=0x7fb5c802a270 comp rx=0 tx=0).stop 2024-09-15T23:22:14.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.700+0000 7fb5dcad0640 1 -- 172.21.15.123:0/1970411666 shutdown_connections 2024-09-15T23:22:14.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.700+0000 7fb5dcad0640 1 --2- 172.21.15.123:0/1970411666 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5d8073180 0x7fb5d80735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:14.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.700+0000 7fb5dcad0640 1 --2- 172.21.15.123:0/1970411666 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5d8145ed0 0x7fb5d80b5080 unknown :-1 s=CLOSED pgs=2017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:14.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.700+0000 7fb5dcad0640 1 -- 172.21.15.123:0/1970411666 >> 172.21.15.123:0/1970411666 conn(0x7fb5d80ccec0 msgr2=0x7fb5d80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:14.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.700+0000 7fb5dcad0640 1 -- 172.21.15.123:0/1970411666 shutdown_connections 2024-09-15T23:22:14.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.700+0000 7fb5dcad0640 1 -- 172.21.15.123:0/1970411666 wait complete. 2024-09-15T23:22:14.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.701+0000 7fb5dcad0640 1 Processor -- start 2024-09-15T23:22:14.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.701+0000 7fb5dcad0640 1 -- start start 2024-09-15T23:22:14.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.702+0000 7fb5dcad0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb5d8073180 0x7fb5d8141df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:14.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.702+0000 7fb5dcad0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5d80b5880 0x7fb5d8159810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:14.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.702+0000 7fb5dcad0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5d8145ed0 0x7fb5d80c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:14.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.702+0000 7fb5dcad0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d81462b0 con 0x7fb5d8145ed0 2024-09-15T23:22:14.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.702+0000 7fb5dcad0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d80b4b60 con 0x7fb5d8073180 2024-09-15T23:22:14.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.702+0000 7fb5dcad0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb5d8146430 con 0x7fb5d80b5880 2024-09-15T23:22:14.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.702+0000 7fb5d6d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5d8145ed0 0x7fb5d80c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:14.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.702+0000 7fb5d6d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5d8145ed0 0x7fb5d80c7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37044/0 (socket says 172.21.15.123:37044) 2024-09-15T23:22:14.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.702+0000 7fb5d6d9d640 1 -- 172.21.15.123:0/501591098 learned_addr learned my addr 172.21.15.123:0/501591098 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:14.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.702+0000 7fb5d659c640 1 --2- 172.21.15.123:0/501591098 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb5d8073180 0x7fb5d8141df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:14.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.702+0000 7fb5d5d9b640 1 --2- 172.21.15.123:0/501591098 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5d80b5880 0x7fb5d8159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:14.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.702+0000 7fb5d6d9d640 1 -- 172.21.15.123:0/501591098 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5d80b5880 msgr2=0x7fb5d8159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:14.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.702+0000 7fb5d6d9d640 1 --2- 172.21.15.123:0/501591098 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5d80b5880 0x7fb5d8159810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:14.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.702+0000 7fb5d6d9d640 1 -- 172.21.15.123:0/501591098 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb5d8073180 msgr2=0x7fb5d8141df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:14.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.702+0000 7fb5d6d9d640 1 --2- 172.21.15.123:0/501591098 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb5d8073180 0x7fb5d8141df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:14.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.702+0000 7fb5d6d9d640 1 -- 172.21.15.123:0/501591098 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5d81f6c50 con 0x7fb5d8145ed0 2024-09-15T23:22:14.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.702+0000 7fb5d5d9b640 1 --2- 172.21.15.123:0/501591098 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5d80b5880 0x7fb5d8159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:14.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.703+0000 7fb5d6d9d640 1 --2- 172.21.15.123:0/501591098 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5d8145ed0 0x7fb5d80c7dd0 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7fb5d000c7b0 tx=0x7fb5d000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:14.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.703+0000 7fb5ceffd640 1 -- 172.21.15.123:0/501591098 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d0017070 con 0x7fb5d8145ed0 2024-09-15T23:22:14.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.703+0000 7fb5ceffd640 1 -- 172.21.15.123:0/501591098 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5d000a640 con 0x7fb5d8145ed0 2024-09-15T23:22:14.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.703+0000 7fb5dcad0640 1 -- 172.21.15.123:0/501591098 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5d813fcd0 con 0x7fb5d8145ed0 2024-09-15T23:22:14.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.703+0000 7fb5ceffd640 1 -- 172.21.15.123:0/501591098 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d000a9f0 con 0x7fb5d8145ed0 2024-09-15T23:22:14.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.703+0000 7fb5dcad0640 1 -- 172.21.15.123:0/501591098 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5d813ff70 con 0x7fb5d8145ed0 2024-09-15T23:22:14.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.704+0000 7fb5dcad0640 1 -- 172.21.15.123:0/501591098 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5d80d1550 con 0x7fb5d8145ed0 2024-09-15T23:22:14.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.704+0000 7fb5ceffd640 1 -- 172.21.15.123:0/501591098 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb5d001a070 con 0x7fb5d8145ed0 2024-09-15T23:22:14.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.705+0000 7fb5ceffd640 1 --2- 172.21.15.123:0/501591098 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb5b806c2b0 0x7fb5b806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:14.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.705+0000 7fb5ceffd640 1 -- 172.21.15.123:0/501591098 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5882+0+0 (secure 0 0 0) 0x7fb5d008a940 con 0x7fb5d8145ed0 2024-09-15T23:22:14.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.705+0000 7fb5d659c640 1 --2- 172.21.15.123:0/501591098 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb5b806c2b0 0x7fb5b806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:14.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.705+0000 7fb5d659c640 1 --2- 172.21.15.123:0/501591098 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb5b806c2b0 0x7fb5b806e770 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8034000 tx=0x7fb5c802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:14.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.709+0000 7fb5ceffd640 1 -- 172.21.15.123:0/501591098 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb5d80d1550 con 0x7fb5d8145ed0 2024-09-15T23:22:14.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.906+0000 7fb5dcad0640 1 -- 172.21.15.123:0/501591098 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb5d80735c0 con 0x7fb5d8145ed0 2024-09-15T23:22:14.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.907+0000 7fb5ceffd640 1 -- 172.21.15.123:0/501591098 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+4417 (secure 0 0 0) 0x7fb5d0058a40 con 0x7fb5d8145ed0 2024-09-15T23:22:14.908 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:22:14.908 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":104,"btime":"2024-09-15T23:22:07:320455+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7214,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/1648353391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1648353391},{"type":"v1","addr":"172.21.15.188:6837","nonce":1648353391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8122,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/1714717257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":1714717257},{"type":"v1","addr":"172.21.15.188:6836","nonce":1714717257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:21:22.066391+0000","modified":"2024-09-15T23:22:07.320447+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":171,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9552},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9552":{"gid":9552,"name":"c","rank":0,"incarnation":101,"state":"up:active","state_seq":16,"addr":"172.21.15.123:6833/3722702026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":3722702026},{"type":"v1","addr":"172.21.15.123:6833","nonce":3722702026}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9552,"qdb_cluster":[9552]},"id":11}]} 2024-09-15T23:22:14.909 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 104 2024-09-15T23:22:14.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.909+0000 7fb5dcad0640 1 -- 172.21.15.123:0/501591098 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb5b806c2b0 msgr2=0x7fb5b806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:14.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.909+0000 7fb5dcad0640 1 --2- 172.21.15.123:0/501591098 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb5b806c2b0 0x7fb5b806e770 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fb5c8034000 tx=0x7fb5c802e000 comp rx=0 tx=0).stop 2024-09-15T23:22:14.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.909+0000 7fb5dcad0640 1 -- 172.21.15.123:0/501591098 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5d8145ed0 msgr2=0x7fb5d80c7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:14.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.909+0000 7fb5dcad0640 1 --2- 172.21.15.123:0/501591098 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5d8145ed0 0x7fb5d80c7dd0 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7fb5d000c7b0 tx=0x7fb5d000cc70 comp rx=0 tx=0).stop 2024-09-15T23:22:14.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.909+0000 7fb5dcad0640 1 -- 172.21.15.123:0/501591098 shutdown_connections 2024-09-15T23:22:14.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.909+0000 7fb5dcad0640 1 --2- 172.21.15.123:0/501591098 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb5b806c2b0 0x7fb5b806e770 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:14.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.909+0000 7fb5dcad0640 1 --2- 172.21.15.123:0/501591098 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5d8145ed0 0x7fb5d80c7dd0 unknown :-1 s=CLOSED pgs=2018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:14.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.909+0000 7fb5dcad0640 1 --2- 172.21.15.123:0/501591098 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5d80b5880 0x7fb5d8159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:14.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.909+0000 7fb5dcad0640 1 --2- 172.21.15.123:0/501591098 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb5d8073180 0x7fb5d8141df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:14.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.909+0000 7fb5dcad0640 1 -- 172.21.15.123:0/501591098 >> 172.21.15.123:0/501591098 conn(0x7fb5d80ccec0 msgr2=0x7fb5d80b3470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:14.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.909+0000 7fb5dcad0640 1 -- 172.21.15.123:0/501591098 shutdown_connections 2024-09-15T23:22:14.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:14.909+0000 7fb5dcad0640 1 -- 172.21.15.123:0/501591098 wait complete. 2024-09-15T23:22:14.921 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:22:15.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.017+0000 7fbdac323640 1 Processor -- start 2024-09-15T23:22:15.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.017+0000 7fbdac323640 1 -- start start 2024-09-15T23:22:15.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.018+0000 7fbdac323640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fbda415ed20 0x7fbda40b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:15.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.018+0000 7fbdac323640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbda40d0e70 con 0x7fbda40d23b0 2024-09-15T23:22:15.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.018+0000 7fbdac323640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbda40d00f0 con 0x7fbda40b90e0 2024-09-15T23:22:15.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.018+0000 7fbdac323640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fbda40d41c0 con 0x7fbda415ed20 2024-09-15T23:22:15.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.018+0000 7fbda98be640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fbda40d23b0 0x7fbda40cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41910/0 (socket says 172.21.15.123:41910) 2024-09-15T23:22:15.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.019+0000 7fbda98be640 1 -- 172.21.15.123:0/1129544869 learned_addr learned my addr 172.21.15.123:0/1129544869 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:15.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.019+0000 7fbdaa0bf640 1 --2- 172.21.15.123:0/1129544869 >> v2:172.21.15.188:3300/0 conn(0x7fbda415ed20 0x7fbda40b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:15.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.019+0000 7fbda90bd640 1 -- 172.21.15.123:0/1129544869 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 721620826 0 0) 0x7fbd98001110 con 0x7fbda40d23b0 2024-09-15T23:22:15.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.019+0000 7fbda90bd640 1 -- 172.21.15.123:0/1129544869 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd8c003520 con 0x7fbda40d23b0 2024-09-15T23:22:15.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.019+0000 7fbda90bd640 1 -- 172.21.15.123:0/1129544869 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 793619584 0 0) 0x7fbd8c003520 con 0x7fbda40d23b0 2024-09-15T23:22:15.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.019+0000 7fbda90bd640 1 -- 172.21.15.123:0/1129544869 >> v2:172.21.15.188:3300/0 conn(0x7fbda415ed20 msgr2=0x7fbda40b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:15.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.019+0000 7fbda90bd640 1 --2- 172.21.15.123:0/1129544869 >> v2:172.21.15.188:3300/0 conn(0x7fbda415ed20 0x7fbda40b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:15.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.019+0000 7fbda90bd640 1 -- 172.21.15.123:0/1129544869 >> v1:172.21.15.188:6789/0 conn(0x7fbda40b90e0 legacy=0x7fbda40cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:15.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.019+0000 7fbda90bd640 1 -- 172.21.15.123:0/1129544869 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda40d35b0 con 0x7fbda40d23b0 2024-09-15T23:22:15.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.019+0000 7fbda90bd640 1 -- 172.21.15.123:0/1129544869 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fbd98001840 con 0x7fbda40d23b0 2024-09-15T23:22:15.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.019+0000 7fbda90bd640 1 -- 172.21.15.123:0/1129544869 >> v1:172.21.15.123:6789/0 conn(0x7fbda40d23b0 legacy=0x7fbda40cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:15.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.019+0000 7fbda90bd640 1 --2- 172.21.15.123:0/1129544869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd8c0039b0 0x7fbd8c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:15.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.019+0000 7fbda90bd640 1 --2- 172.21.15.123:0/1129544869 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbd8c004800 0x7fbd8c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:15.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.019+0000 7fbda90bd640 1 --2- 172.21.15.123:0/1129544869 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd8c0051c0 0x7fbd8c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:15.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.019+0000 7fbda90bd640 1 -- 172.21.15.123:0/1129544869 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbda40d41c0 con 0x7fbd8c0039b0 2024-09-15T23:22:15.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.019+0000 7fbda90bd640 1 -- 172.21.15.123:0/1129544869 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbd8c00c160 con 0x7fbd8c004800 2024-09-15T23:22:15.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.019+0000 7fbda90bd640 1 -- 172.21.15.123:0/1129544869 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbd8c00c360 con 0x7fbd8c0051c0 2024-09-15T23:22:15.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.019+0000 7fbdaa0bf640 1 --2- 172.21.15.123:0/1129544869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd8c0039b0 0x7fbd8c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:15.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.019+0000 7fbda98be640 1 --2- 172.21.15.123:0/1129544869 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbd8c004800 0x7fbd8c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:15.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.019+0000 7fbdaa8c0640 1 --2- 172.21.15.123:0/1129544869 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd8c0051c0 0x7fbd8c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:15.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.019+0000 7fbdaa0bf640 1 -- 172.21.15.123:0/1129544869 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd8c0051c0 msgr2=0x7fbd8c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:15.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.019+0000 7fbdaa0bf640 1 --2- 172.21.15.123:0/1129544869 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd8c0051c0 0x7fbd8c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:15.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.019+0000 7fbdaa0bf640 1 -- 172.21.15.123:0/1129544869 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbd8c004800 msgr2=0x7fbd8c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:15.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.019+0000 7fbdaa0bf640 1 --2- 172.21.15.123:0/1129544869 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbd8c004800 0x7fbd8c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:15.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.019+0000 7fbdaa0bf640 1 -- 172.21.15.123:0/1129544869 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd8c003520 con 0x7fbd8c0039b0 2024-09-15T23:22:15.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.019+0000 7fbdaa8c0640 1 -- 172.21.15.123:0/1129544869 reap_dead start 2024-09-15T23:22:15.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.019+0000 7fbda98be640 1 --2- 172.21.15.123:0/1129544869 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbd8c004800 0x7fbd8c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:15.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.020+0000 7fbdaa0bf640 1 --2- 172.21.15.123:0/1129544869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd8c0039b0 0x7fbd8c003dd0 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7fbd94009fc0 tx=0x7fbd8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e43b227b3bc0a4cc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:15.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.020+0000 7fbda90bd640 1 -- 172.21.15.123:0/1129544869 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd94034020 con 0x7fbd8c0039b0 2024-09-15T23:22:15.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.020+0000 7fbda90bd640 1 -- 172.21.15.123:0/1129544869 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd940305f0 con 0x7fbd8c0039b0 2024-09-15T23:22:15.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.020+0000 7fbda90bd640 1 -- 172.21.15.123:0/1129544869 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd94009c10 con 0x7fbd8c0039b0 2024-09-15T23:22:15.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.021+0000 7fbdac323640 1 -- 172.21.15.123:0/1129544869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd8c0039b0 msgr2=0x7fbd8c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:15.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.021+0000 7fbdac323640 1 --2- 172.21.15.123:0/1129544869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd8c0039b0 0x7fbd8c003dd0 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7fbd94009fc0 tx=0x7fbd8c005830 comp rx=0 tx=0).stop 2024-09-15T23:22:15.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.021+0000 7fbdac323640 1 -- 172.21.15.123:0/1129544869 shutdown_connections 2024-09-15T23:22:15.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.021+0000 7fbdac323640 1 --2- 172.21.15.123:0/1129544869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd8c0039b0 0x7fbd8c003dd0 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:15.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.021+0000 7fbdac323640 1 -- 172.21.15.123:0/1129544869 >> 172.21.15.123:0/1129544869 conn(0x7fbda40d1260 msgr2=0x7fbda40d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:15.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.021+0000 7fbdac323640 1 -- 172.21.15.123:0/1129544869 shutdown_connections 2024-09-15T23:22:15.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.021+0000 7fbdac323640 1 -- 172.21.15.123:0/1129544869 wait complete. 2024-09-15T23:22:15.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.022+0000 7fbdac323640 1 Processor -- start 2024-09-15T23:22:15.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.022+0000 7fbdac323640 1 -- start start 2024-09-15T23:22:15.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.023+0000 7fbdac323640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd8c0039b0 0x7fbda40b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:15.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.023+0000 7fbdac323640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbda415ceb0 0x7fbda41f4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:15.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.023+0000 7fbdac323640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbda415c640 0x7fbda40cdc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:15.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.023+0000 7fbdac323640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbda40d3e50 con 0x7fbda415c640 2024-09-15T23:22:15.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.023+0000 7fbdac323640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbda40d3b70 con 0x7fbda415ceb0 2024-09-15T23:22:15.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.023+0000 7fbdac323640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbda40d32a0 con 0x7fbd8c0039b0 2024-09-15T23:22:15.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.023+0000 7fbdaa8c0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbda415c640 0x7fbda40cdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:15.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.023+0000 7fbdaa8c0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbda415c640 0x7fbda40cdc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37068/0 (socket says 172.21.15.123:37068) 2024-09-15T23:22:15.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.023+0000 7fbdaa8c0640 1 -- 172.21.15.123:0/2353678778 learned_addr learned my addr 172.21.15.123:0/2353678778 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:15.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.023+0000 7fbdaa0bf640 1 --2- 172.21.15.123:0/2353678778 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd8c0039b0 0x7fbda40b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:15.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.023+0000 7fbda98be640 1 --2- 172.21.15.123:0/2353678778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbda415ceb0 0x7fbda41f4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:15.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.023+0000 7fbdaa8c0640 1 -- 172.21.15.123:0/2353678778 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd8c0039b0 msgr2=0x7fbda40b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:15.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.023+0000 7fbdaa8c0640 1 --2- 172.21.15.123:0/2353678778 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd8c0039b0 0x7fbda40b34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:15.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.023+0000 7fbdaa8c0640 1 -- 172.21.15.123:0/2353678778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbda415ceb0 msgr2=0x7fbda41f4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:15.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.023+0000 7fbdaa8c0640 1 --2- 172.21.15.123:0/2353678778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbda415ceb0 0x7fbda41f4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:15.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.023+0000 7fbdaa8c0640 1 -- 172.21.15.123:0/2353678778 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda40c9670 con 0x7fbda415c640 2024-09-15T23:22:15.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.023+0000 7fbdaa0bf640 1 --2- 172.21.15.123:0/2353678778 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd8c0039b0 0x7fbda40b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:15.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.023+0000 7fbda98be640 1 --2- 172.21.15.123:0/2353678778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbda415ceb0 0x7fbda41f4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:15.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.023+0000 7fbdaa8c0640 1 --2- 172.21.15.123:0/2353678778 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbda415c640 0x7fbda40cdc30 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7fbda4068a80 tx=0x7fbd9c00e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:15.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.023+0000 7fbda2ffd640 1 -- 172.21.15.123:0/2353678778 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c019070 con 0x7fbda415c640 2024-09-15T23:22:15.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.023+0000 7fbda2ffd640 1 -- 172.21.15.123:0/2353678778 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd9c0052e0 con 0x7fbda415c640 2024-09-15T23:22:15.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.023+0000 7fbdac323640 1 -- 172.21.15.123:0/2353678778 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbda40c9950 con 0x7fbda415c640 2024-09-15T23:22:15.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.023+0000 7fbda2ffd640 1 -- 172.21.15.123:0/2353678778 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c003830 con 0x7fbda415c640 2024-09-15T23:22:15.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.024+0000 7fbdac323640 1 -- 172.21.15.123:0/2353678778 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbda40c9f10 con 0x7fbda415c640 2024-09-15T23:22:15.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.024+0000 7fbdac323640 1 -- 172.21.15.123:0/2353678778 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbda4160280 con 0x7fbda415c640 2024-09-15T23:22:15.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.025+0000 7fbda2ffd640 1 -- 172.21.15.123:0/2353678778 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbd9c0039d0 con 0x7fbda415c640 2024-09-15T23:22:15.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.025+0000 7fbda2ffd640 1 --2- 172.21.15.123:0/2353678778 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbd9006c2e0 0x7fbd9006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:15.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.025+0000 7fbda2ffd640 1 -- 172.21.15.123:0/2353678778 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5882+0+0 (secure 0 0 0) 0x7fbd9c08a860 con 0x7fbda415c640 2024-09-15T23:22:15.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.026+0000 7fbdaa0bf640 1 --2- 172.21.15.123:0/2353678778 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbd9006c2e0 0x7fbd9006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:15.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.026+0000 7fbdaa0bf640 1 --2- 172.21.15.123:0/2353678778 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbd9006c2e0 0x7fbd9006e7a0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fbd94035000 tx=0x7fbd9402f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:15.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.029+0000 7fbda2ffd640 1 -- 172.21.15.123:0/2353678778 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbd9c04fd50 con 0x7fbda415c640 2024-09-15T23:22:15.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.195+0000 7fbdac323640 1 -- 172.21.15.123:0/2353678778 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbda40b3f20 con 0x7fbda415c640 2024-09-15T23:22:15.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.197+0000 7fbda2ffd640 1 -- 172.21.15.123:0/2353678778 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v171) ==== 74+0+17040 (secure 0 0 0) 0x7fbd9c058e90 con 0x7fbda415c640 2024-09-15T23:22:15.202 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:22:15.202 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":171,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:22:04.310090+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:21:20.662502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-15T23:21:21.024002+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"23.19","mappings":[{"from":5,"to":7}]},{"pgid":"23.1a","mappings":[{"from":4,"to":3}]},{"pgid":"23.2a","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6835/1883512279":"2024-09-16T23:22:04.310006+0000","172.21.15.123:6834/1883512279":"2024-09-16T23:22:04.310006+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:22:15.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.199+0000 7fbdac323640 1 -- 172.21.15.123:0/2353678778 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbd9006c2e0 msgr2=0x7fbd9006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:15.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.199+0000 7fbdac323640 1 --2- 172.21.15.123:0/2353678778 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbd9006c2e0 0x7fbd9006e7a0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fbd94035000 tx=0x7fbd9402f000 comp rx=0 tx=0).stop 2024-09-15T23:22:15.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.199+0000 7fbdac323640 1 -- 172.21.15.123:0/2353678778 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbda415c640 msgr2=0x7fbda40cdc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:15.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.199+0000 7fbdac323640 1 --2- 172.21.15.123:0/2353678778 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbda415c640 0x7fbda40cdc30 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7fbda4068a80 tx=0x7fbd9c00e8a0 comp rx=0 tx=0).stop 2024-09-15T23:22:15.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.199+0000 7fbdac323640 1 -- 172.21.15.123:0/2353678778 shutdown_connections 2024-09-15T23:22:15.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.199+0000 7fbdac323640 1 --2- 172.21.15.123:0/2353678778 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbd9006c2e0 0x7fbd9006e7a0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:15.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.199+0000 7fbdac323640 1 --2- 172.21.15.123:0/2353678778 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbda415c640 0x7fbda40cdc30 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:15.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.199+0000 7fbdac323640 1 --2- 172.21.15.123:0/2353678778 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbda415ceb0 0x7fbda41f4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:15.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.199+0000 7fbdac323640 1 --2- 172.21.15.123:0/2353678778 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd8c0039b0 0x7fbda40b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:15.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.199+0000 7fbdac323640 1 -- 172.21.15.123:0/2353678778 >> 172.21.15.123:0/2353678778 conn(0x7fbda40d1260 msgr2=0x7fbda40b60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:15.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.199+0000 7fbdac323640 1 -- 172.21.15.123:0/2353678778 shutdown_connections 2024-09-15T23:22:15.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.199+0000 7fbdac323640 1 -- 172.21.15.123:0/2353678778 wait complete. 2024-09-15T23:22:15.211 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T23:22:15.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.309+0000 7fa7d3ed7640 1 Processor -- start 2024-09-15T23:22:15.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.309+0000 7fa7d3ed7640 1 -- start start 2024-09-15T23:22:15.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.310+0000 7fa7d3ed7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7cc0d2c30 0x7fa7cc160a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:15.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.310+0000 7fa7d3ed7640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa7cc0b1990 0x7fa7cc0d0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:15.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.310+0000 7fa7d3ed7640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7cc071b60 con 0x7fa7cc15c420 2024-09-15T23:22:15.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.310+0000 7fa7d3ed7640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fa7cc0d04c0 con 0x7fa7cc0b1990 2024-09-15T23:22:15.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.310+0000 7fa7d3ed7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa7cc0b1e20 con 0x7fa7cc0d2c30 2024-09-15T23:22:15.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.310+0000 7fa7d1c73640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa7cc15c420 0x7fa7cc0d2520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41916/0 (socket says 172.21.15.123:41916) 2024-09-15T23:22:15.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.310+0000 7fa7d1c73640 1 -- 172.21.15.123:0/1916547690 learned_addr learned my addr 172.21.15.123:0/1916547690 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:15.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.310+0000 7fa7d0c71640 1 -- 172.21.15.123:0/1916547690 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3889587015 0 0) 0x7fa7cc071b60 con 0x7fa7cc15c420 2024-09-15T23:22:15.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.310+0000 7fa7d1472640 1 --2- 172.21.15.123:0/1916547690 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7cc0d2c30 0x7fa7cc160a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:15.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.310+0000 7fa7d2474640 1 --2- 172.21.15.123:0/1916547690 >> v2:172.21.15.188:3300/0 conn(0x7fa7cc0b1990 0x7fa7cc0d0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:15.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.310+0000 7fa7d0c71640 1 -- 172.21.15.123:0/1916547690 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7b8003520 con 0x7fa7cc15c420 2024-09-15T23:22:15.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.310+0000 7fa7d0c71640 1 -- 172.21.15.123:0/1916547690 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1460803317 0 0) 0x7fa7b8003520 con 0x7fa7cc15c420 2024-09-15T23:22:15.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.311+0000 7fa7d0c71640 1 -- 172.21.15.123:0/1916547690 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7cc0d2c30 msgr2=0x7fa7cc160a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:15.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.311+0000 7fa7d0c71640 1 --2- 172.21.15.123:0/1916547690 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7cc0d2c30 0x7fa7cc160a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:15.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.311+0000 7fa7d0c71640 1 -- 172.21.15.123:0/1916547690 >> v2:172.21.15.188:3300/0 conn(0x7fa7cc0b1990 msgr2=0x7fa7cc0d0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:15.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.311+0000 7fa7d0c71640 1 --2- 172.21.15.123:0/1916547690 >> v2:172.21.15.188:3300/0 conn(0x7fa7cc0b1990 0x7fa7cc0d0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:15.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.311+0000 7fa7d0c71640 1 -- 172.21.15.123:0/1916547690 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7cc0715a0 con 0x7fa7cc15c420 2024-09-15T23:22:15.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.311+0000 7fa7d0c71640 1 -- 172.21.15.123:0/1916547690 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fa7c8001670 con 0x7fa7cc15c420 2024-09-15T23:22:15.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.311+0000 7fa7d0c71640 1 -- 172.21.15.123:0/1916547690 >> v1:172.21.15.123:6789/0 conn(0x7fa7cc15c420 legacy=0x7fa7cc0d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:15.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.311+0000 7fa7d0c71640 1 --2- 172.21.15.123:0/1916547690 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7cc0d2c30 0x7fa7b80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:15.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.311+0000 7fa7d0c71640 1 --2- 172.21.15.123:0/1916547690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7b8003f30 0x7fa7b8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:15.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.311+0000 7fa7d0c71640 1 --2- 172.21.15.123:0/1916547690 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa7b8004d40 0x7fa7b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:15.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.311+0000 7fa7d0c71640 1 -- 172.21.15.123:0/1916547690 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa7cc0d04c0 con 0x7fa7b8003f30 2024-09-15T23:22:15.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.311+0000 7fa7d0c71640 1 -- 172.21.15.123:0/1916547690 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa7cc0b1e20 con 0x7fa7b8004d40 2024-09-15T23:22:15.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.311+0000 7fa7d0c71640 1 -- 172.21.15.123:0/1916547690 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa7b800baa0 con 0x7fa7cc0d2c30 2024-09-15T23:22:15.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.311+0000 7fa7d1472640 1 --2- 172.21.15.123:0/1916547690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7b8003f30 0x7fa7b8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:15.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.311+0000 7fa7d1c73640 1 --2- 172.21.15.123:0/1916547690 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7cc0d2c30 0x7fa7b80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:15.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.311+0000 7fa7d2474640 1 --2- 172.21.15.123:0/1916547690 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa7b8004d40 0x7fa7b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:15.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.311+0000 7fa7d1472640 1 -- 172.21.15.123:0/1916547690 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7cc0d2c30 msgr2=0x7fa7b80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:15.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.311+0000 7fa7d1472640 1 --2- 172.21.15.123:0/1916547690 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7cc0d2c30 0x7fa7b80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:15.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.311+0000 7fa7d1472640 1 -- 172.21.15.123:0/1916547690 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa7b8004d40 msgr2=0x7fa7b80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:15.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.311+0000 7fa7d1472640 1 --2- 172.21.15.123:0/1916547690 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa7b8004d40 0x7fa7b80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:15.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.311+0000 7fa7d1472640 1 -- 172.21.15.123:0/1916547690 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b8003520 con 0x7fa7b8003f30 2024-09-15T23:22:15.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.311+0000 7fa7d1c73640 1 --2- 172.21.15.123:0/1916547690 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7cc0d2c30 0x7fa7b80039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:15.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.312+0000 7fa7d1472640 1 --2- 172.21.15.123:0/1916547690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7b8003f30 0x7fa7b8004800 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc074290 tx=0x7fa7b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c36ec4e62cc9f570 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:15.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.312+0000 7fa7d0c71640 1 -- 172.21.15.123:0/1916547690 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc036070 con 0x7fa7b8003f30 2024-09-15T23:22:15.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.312+0000 7fa7d0c71640 1 -- 172.21.15.123:0/1916547690 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7bc031400 con 0x7fa7b8003f30 2024-09-15T23:22:15.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.312+0000 7fa7d0c71640 1 -- 172.21.15.123:0/1916547690 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc009690 con 0x7fa7b8003f30 2024-09-15T23:22:15.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.312+0000 7fa7d3ed7640 1 -- 172.21.15.123:0/1916547690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7b8003f30 msgr2=0x7fa7b8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:15.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.312+0000 7fa7d3ed7640 1 --2- 172.21.15.123:0/1916547690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7b8003f30 0x7fa7b8004800 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc074290 tx=0x7fa7b8005830 comp rx=0 tx=0).stop 2024-09-15T23:22:15.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.312+0000 7fa7d2474640 1 -- 172.21.15.123:0/1916547690 reap_dead start 2024-09-15T23:22:15.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.312+0000 7fa7d3ed7640 1 -- 172.21.15.123:0/1916547690 shutdown_connections 2024-09-15T23:22:15.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.312+0000 7fa7d3ed7640 1 -- 172.21.15.123:0/1916547690 >> 172.21.15.123:0/1916547690 conn(0x7fa7cc067fb0 msgr2=0x7fa7cc06f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:15.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.313+0000 7fa7d3ed7640 1 -- 172.21.15.123:0/1916547690 shutdown_connections 2024-09-15T23:22:15.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.313+0000 7fa7d3ed7640 1 -- 172.21.15.123:0/1916547690 wait complete. 2024-09-15T23:22:15.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.314+0000 7fa7d3ed7640 1 Processor -- start 2024-09-15T23:22:15.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.314+0000 7fa7d3ed7640 1 -- start start 2024-09-15T23:22:15.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.314+0000 7fa7d3ed7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7b8003f30 0x7fa7cc15f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:15.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.314+0000 7fa7d3ed7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa7cc14c560 0x7fa7cc150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:15.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.314+0000 7fa7d3ed7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7cc14fe00 0x7fa7cc150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:15.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.314+0000 7fa7d3ed7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa7cc160a40 con 0x7fa7b8003f30 2024-09-15T23:22:15.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.314+0000 7fa7d3ed7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa7cc15c800 con 0x7fa7cc14c560 2024-09-15T23:22:15.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.314+0000 7fa7d3ed7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa7cc160bc0 con 0x7fa7cc14fe00 2024-09-15T23:22:15.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.315+0000 7fa7d1c73640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7b8003f30 0x7fa7cc15f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:15.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.315+0000 7fa7d1c73640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7b8003f30 0x7fa7cc15f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37096/0 (socket says 172.21.15.123:37096) 2024-09-15T23:22:15.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.315+0000 7fa7d1c73640 1 -- 172.21.15.123:0/3206060195 learned_addr learned my addr 172.21.15.123:0/3206060195 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:15.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.315+0000 7fa7d1472640 1 --2- 172.21.15.123:0/3206060195 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa7cc14c560 0x7fa7cc150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:15.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.315+0000 7fa7d2474640 1 --2- 172.21.15.123:0/3206060195 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7cc14fe00 0x7fa7cc150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:15.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.315+0000 7fa7d1c73640 1 -- 172.21.15.123:0/3206060195 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7cc14fe00 msgr2=0x7fa7cc150280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:15.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.315+0000 7fa7d1c73640 1 --2- 172.21.15.123:0/3206060195 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7cc14fe00 0x7fa7cc150280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:15.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.315+0000 7fa7d1c73640 1 -- 172.21.15.123:0/3206060195 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa7cc14c560 msgr2=0x7fa7cc150a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:15.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.315+0000 7fa7d1c73640 1 --2- 172.21.15.123:0/3206060195 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa7cc14c560 0x7fa7cc150a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:15.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.315+0000 7fa7d1c73640 1 -- 172.21.15.123:0/3206060195 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7cc150f40 con 0x7fa7b8003f30 2024-09-15T23:22:15.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.315+0000 7fa7d2474640 1 --2- 172.21.15.123:0/3206060195 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7cc14fe00 0x7fa7cc150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:15.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.315+0000 7fa7d1c73640 1 --2- 172.21.15.123:0/3206060195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7b8003f30 0x7fa7cc15f670 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800e7f0 tx=0x7fa7c800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:15.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.315+0000 7fa7c27fc640 1 -- 172.21.15.123:0/3206060195 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c800c870 con 0x7fa7b8003f30 2024-09-15T23:22:15.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.315+0000 7fa7c27fc640 1 -- 172.21.15.123:0/3206060195 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7c8018070 con 0x7fa7b8003f30 2024-09-15T23:22:15.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.315+0000 7fa7d3ed7640 1 -- 172.21.15.123:0/3206060195 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7cc1511c0 con 0x7fa7b8003f30 2024-09-15T23:22:15.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.315+0000 7fa7c27fc640 1 -- 172.21.15.123:0/3206060195 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c800cc30 con 0x7fa7b8003f30 2024-09-15T23:22:15.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.315+0000 7fa7d3ed7640 1 -- 172.21.15.123:0/3206060195 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7cc14f600 con 0x7fa7b8003f30 2024-09-15T23:22:15.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.316+0000 7fa7d3ed7640 1 -- 172.21.15.123:0/3206060195 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7cc0d1390 con 0x7fa7b8003f30 2024-09-15T23:22:15.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.317+0000 7fa7c27fc640 1 -- 172.21.15.123:0/3206060195 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa7c801d460 con 0x7fa7b8003f30 2024-09-15T23:22:15.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.318+0000 7fa7c27fc640 1 --2- 172.21.15.123:0/3206060195 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa7b006c2e0 0x7fa7b006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:15.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.318+0000 7fa7c27fc640 1 -- 172.21.15.123:0/3206060195 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5882+0+0 (secure 0 0 0) 0x7fa7c808b260 con 0x7fa7b8003f30 2024-09-15T23:22:15.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.318+0000 7fa7d1472640 1 --2- 172.21.15.123:0/3206060195 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa7b006c2e0 0x7fa7b006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:15.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.318+0000 7fa7d1472640 1 --2- 172.21.15.123:0/3206060195 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa7b006c2e0 0x7fa7b006e7a0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc033000 tx=0x7fa7bc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:15.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.322+0000 7fa7c27fc640 1 -- 172.21.15.123:0/3206060195 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa7cc150f40 con 0x7fa7b8003f30 2024-09-15T23:22:15.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.523+0000 7fa7d3ed7640 1 -- 172.21.15.123:0/3206060195 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa7cc0d0dd0 con 0x7fa7b8003f30 2024-09-15T23:22:15.525 INFO:tasks.ceph.mon.a.smithi123.stderr:2024-09-15T23:22:15.524+0000 7f8a6ccf0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:22:15.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.525+0000 7fa7c27fc640 1 -- 172.21.15.123:0/3206060195 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v105) ==== 161+0+0 (secure 0 0 0) 0x7fa7c80599b0 con 0x7fa7b8003f30 2024-09-15T23:22:15.526 INFO:teuthology.orchestra.run.smithi123.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T23:22:15.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.528+0000 7fa7d3ed7640 1 -- 172.21.15.123:0/3206060195 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa7b006c2e0 msgr2=0x7fa7b006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:15.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.528+0000 7fa7d3ed7640 1 --2- 172.21.15.123:0/3206060195 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa7b006c2e0 0x7fa7b006e7a0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc033000 tx=0x7fa7bc008030 comp rx=0 tx=0).stop 2024-09-15T23:22:15.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.528+0000 7fa7d3ed7640 1 -- 172.21.15.123:0/3206060195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7b8003f30 msgr2=0x7fa7cc15f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:15.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.528+0000 7fa7d3ed7640 1 --2- 172.21.15.123:0/3206060195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7b8003f30 0x7fa7cc15f670 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7fa7c800e7f0 tx=0x7fa7c800ecb0 comp rx=0 tx=0).stop 2024-09-15T23:22:15.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.528+0000 7fa7d3ed7640 1 -- 172.21.15.123:0/3206060195 shutdown_connections 2024-09-15T23:22:15.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.528+0000 7fa7d3ed7640 1 --2- 172.21.15.123:0/3206060195 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7cc14fe00 0x7fa7cc150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:15.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.528+0000 7fa7d3ed7640 1 --2- 172.21.15.123:0/3206060195 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa7cc14c560 0x7fa7cc150a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:15.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.528+0000 7fa7d3ed7640 1 --2- 172.21.15.123:0/3206060195 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa7b006c2e0 0x7fa7b006e7a0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:15.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.528+0000 7fa7d3ed7640 1 --2- 172.21.15.123:0/3206060195 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7b8003f30 0x7fa7cc15f670 unknown :-1 s=CLOSED pgs=2024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:15.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.528+0000 7fa7d3ed7640 1 -- 172.21.15.123:0/3206060195 >> 172.21.15.123:0/3206060195 conn(0x7fa7cc067fb0 msgr2=0x7fa7cc1579d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:15.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.528+0000 7fa7d3ed7640 1 -- 172.21.15.123:0/3206060195 shutdown_connections 2024-09-15T23:22:15.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.528+0000 7fa7d3ed7640 1 -- 172.21.15.123:0/3206060195 wait complete. 2024-09-15T23:22:15.541 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T23:22:15.566 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-15T23:22:15.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.640+0000 7fdbecc9b640 1 Processor -- start 2024-09-15T23:22:15.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.641+0000 7fdbecc9b640 1 -- start start 2024-09-15T23:22:15.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.641+0000 7fdbecc9b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdbe80ccf30 0x7fdbe80b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:15.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.642+0000 7fdbecc9b640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbe80cf2e0 con 0x7fdbe815b7c0 2024-09-15T23:22:15.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.642+0000 7fdbecc9b640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbe8070fe0 con 0x7fdbe80cead0 2024-09-15T23:22:15.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.642+0000 7fdbecc9b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fdbe80712c0 con 0x7fdbe80ccf30 2024-09-15T23:22:15.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.642+0000 7fdbe5d9b640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fdbe815b7c0 0x7fdbe80cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41932/0 (socket says 172.21.15.123:41932) 2024-09-15T23:22:15.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.642+0000 7fdbe5d9b640 1 -- 172.21.15.123:0/3795865916 learned_addr learned my addr 172.21.15.123:0/3795865916 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:15.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.642+0000 7fdbe659c640 1 --2- 172.21.15.123:0/3795865916 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdbe80ccf30 0x7fdbe80b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:15.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.642+0000 7fdbe559a640 1 -- 172.21.15.123:0/3795865916 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4220060624 0 0) 0x7fdbe80cf2e0 con 0x7fdbe815b7c0 2024-09-15T23:22:15.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.642+0000 7fdbe559a640 1 -- 172.21.15.123:0/3795865916 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbd4003520 con 0x7fdbe815b7c0 2024-09-15T23:22:15.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.642+0000 7fdbe559a640 1 -- 172.21.15.123:0/3795865916 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3760783406 0 0) 0x7fdbe8070fe0 con 0x7fdbe80cead0 2024-09-15T23:22:15.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.642+0000 7fdbe559a640 1 -- 172.21.15.123:0/3795865916 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbe80cf2e0 con 0x7fdbe80cead0 2024-09-15T23:22:15.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.642+0000 7fdbe659c640 1 -- 172.21.15.123:0/3795865916 >> v1:172.21.15.188:6789/0 conn(0x7fdbe80cead0 legacy=0x7fdbe8071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:15.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.642+0000 7fdbe559a640 1 -- 172.21.15.123:0/3795865916 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2204588144 0 0) 0x7fdbd4003520 con 0x7fdbe815b7c0 2024-09-15T23:22:15.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.642+0000 7fdbe659c640 1 -- 172.21.15.123:0/3795865916 >> v1:172.21.15.123:6789/0 conn(0x7fdbe815b7c0 legacy=0x7fdbe80cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:15.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.642+0000 7fdbe659c640 1 -- 172.21.15.123:0/3795865916 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe80715a0 con 0x7fdbe80ccf30 2024-09-15T23:22:15.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.643+0000 7fdbe659c640 1 --2- 172.21.15.123:0/3795865916 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdbe80ccf30 0x7fdbe80b2c50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdbd80097d0 tx=0x7fdbd802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63284b0bc80e41c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:15.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.643+0000 7fdbe559a640 1 -- 172.21.15.123:0/3795865916 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8037070 con 0x7fdbe80ccf30 2024-09-15T23:22:15.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.643+0000 7fdbe559a640 1 -- 172.21.15.123:0/3795865916 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbd802ab90 con 0x7fdbe80ccf30 2024-09-15T23:22:15.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.643+0000 7fdbe559a640 1 -- 172.21.15.123:0/3795865916 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd0001670 con 0x7fdbe80ccf30 2024-09-15T23:22:15.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.644+0000 7fdbecc9b640 1 -- 172.21.15.123:0/3795865916 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdbe80ccf30 msgr2=0x7fdbe80b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:15.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.644+0000 7fdbecc9b640 1 --2- 172.21.15.123:0/3795865916 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdbe80ccf30 0x7fdbe80b2c50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdbd80097d0 tx=0x7fdbd802a100 comp rx=0 tx=0).stop 2024-09-15T23:22:15.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.644+0000 7fdbecc9b640 1 -- 172.21.15.123:0/3795865916 shutdown_connections 2024-09-15T23:22:15.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.644+0000 7fdbecc9b640 1 --2- 172.21.15.123:0/3795865916 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdbe80ccf30 0x7fdbe80b2c50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:15.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.644+0000 7fdbecc9b640 1 -- 172.21.15.123:0/3795865916 >> 172.21.15.123:0/3795865916 conn(0x7fdbe806d0f0 msgr2=0x7fdbe806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:15.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.644+0000 7fdbecc9b640 1 -- 172.21.15.123:0/3795865916 shutdown_connections 2024-09-15T23:22:15.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.644+0000 7fdbecc9b640 1 -- 172.21.15.123:0/3795865916 wait complete. 2024-09-15T23:22:15.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.645+0000 7fdbecc9b640 1 Processor -- start 2024-09-15T23:22:15.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.645+0000 7fdbecc9b640 1 -- start start 2024-09-15T23:22:15.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.646+0000 7fdbecc9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbe80ccf30 0x7fdbe81537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:15.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.646+0000 7fdbecc9b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdbe80cead0 0x7fdbe81f1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:15.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.646+0000 7fdbecc9b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdbe815b7c0 0x7fdbe80c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:15.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.646+0000 7fdbecc9b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe80721d0 con 0x7fdbe80ccf30 2024-09-15T23:22:15.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.646+0000 7fdbecc9b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe80cef60 con 0x7fdbe80cead0 2024-09-15T23:22:15.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.646+0000 7fdbecc9b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fdbe8072350 con 0x7fdbe815b7c0 2024-09-15T23:22:15.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.646+0000 7fdbe659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbe80ccf30 0x7fdbe81537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:15.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.646+0000 7fdbe659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbe80ccf30 0x7fdbe81537d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37130/0 (socket says 172.21.15.123:37130) 2024-09-15T23:22:15.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.646+0000 7fdbe659c640 1 -- 172.21.15.123:0/957570783 learned_addr learned my addr 172.21.15.123:0/957570783 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:15.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.646+0000 7fdbe5d9b640 1 --2- 172.21.15.123:0/957570783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdbe80cead0 0x7fdbe81f1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:15.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.646+0000 7fdbe659c640 1 -- 172.21.15.123:0/957570783 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdbe815b7c0 msgr2=0x7fdbe80c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:15.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.646+0000 7fdbe659c640 1 --2- 172.21.15.123:0/957570783 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdbe815b7c0 0x7fdbe80c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:15.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.646+0000 7fdbe659c640 1 -- 172.21.15.123:0/957570783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdbe80cead0 msgr2=0x7fdbe81f1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:15.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.646+0000 7fdbe659c640 1 --2- 172.21.15.123:0/957570783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdbe80cead0 0x7fdbe81f1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:15.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.646+0000 7fdbe659c640 1 -- 172.21.15.123:0/957570783 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe8159460 con 0x7fdbe80ccf30 2024-09-15T23:22:15.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.646+0000 7fdbe659c640 1 --2- 172.21.15.123:0/957570783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbe80ccf30 0x7fdbe81537d0 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8035040 tx=0x7fdbd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:15.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.647+0000 7fdbdeffd640 1 -- 172.21.15.123:0/957570783 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8003b60 con 0x7fdbe80ccf30 2024-09-15T23:22:15.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.647+0000 7fdbdeffd640 1 -- 172.21.15.123:0/957570783 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbd8003d00 con 0x7fdbe80ccf30 2024-09-15T23:22:15.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.647+0000 7fdbecc9b640 1 -- 172.21.15.123:0/957570783 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbe8159740 con 0x7fdbe80ccf30 2024-09-15T23:22:15.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.647+0000 7fdbdeffd640 1 -- 172.21.15.123:0/957570783 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd80456c0 con 0x7fdbe80ccf30 2024-09-15T23:22:15.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.647+0000 7fdbecc9b640 1 -- 172.21.15.123:0/957570783 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbe8159d00 con 0x7fdbe80ccf30 2024-09-15T23:22:15.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.648+0000 7fdbecc9b640 1 -- 172.21.15.123:0/957570783 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbe80b2c50 con 0x7fdbe80ccf30 2024-09-15T23:22:15.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.648+0000 7fdbdeffd640 1 -- 172.21.15.123:0/957570783 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdbd8045860 con 0x7fdbe80ccf30 2024-09-15T23:22:15.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.649+0000 7fdbdeffd640 1 --2- 172.21.15.123:0/957570783 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdbc806c2b0 0x7fdbc806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:15.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.649+0000 7fdbdeffd640 1 -- 172.21.15.123:0/957570783 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(172..172 src has 1..172) ==== 5968+0+0 (secure 0 0 0) 0x7fdbd80adc40 con 0x7fdbe80ccf30 2024-09-15T23:22:15.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.649+0000 7fdbe5d9b640 1 --2- 172.21.15.123:0/957570783 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdbc806c2b0 0x7fdbc806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:15.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.649+0000 7fdbe5d9b640 1 --2- 172.21.15.123:0/957570783 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdbc806c2b0 0x7fdbc806e770 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0005880 tx=0x7fdbd0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:15.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.653+0000 7fdbdeffd640 1 -- 172.21.15.123:0/957570783 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdbd807c340 con 0x7fdbe80ccf30 2024-09-15T23:22:15.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:15.854+0000 7fdbecc9b640 1 -- 172.21.15.123:0/957570783 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fdbe80cc960 con 0x7fdbe80ccf30 2024-09-15T23:22:16.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.530+0000 7fdbdeffd640 1 -- 172.21.15.123:0/957570783 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v106) ==== 104+0+0 (secure 0 0 0) 0x7fdbd807bc40 con 0x7fdbe80ccf30 2024-09-15T23:22:16.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.532+0000 7fdbecc9b640 1 -- 172.21.15.123:0/957570783 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdbc806c2b0 msgr2=0x7fdbc806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:16.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.532+0000 7fdbecc9b640 1 --2- 172.21.15.123:0/957570783 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdbc806c2b0 0x7fdbc806e770 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0005880 tx=0x7fdbd0009040 comp rx=0 tx=0).stop 2024-09-15T23:22:16.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.532+0000 7fdbecc9b640 1 -- 172.21.15.123:0/957570783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbe80ccf30 msgr2=0x7fdbe81537d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:16.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.532+0000 7fdbecc9b640 1 --2- 172.21.15.123:0/957570783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbe80ccf30 0x7fdbe81537d0 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8035040 tx=0x7fdbd80046c0 comp rx=0 tx=0).stop 2024-09-15T23:22:16.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.532+0000 7fdbecc9b640 1 -- 172.21.15.123:0/957570783 shutdown_connections 2024-09-15T23:22:16.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.532+0000 7fdbecc9b640 1 --2- 172.21.15.123:0/957570783 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdbe815b7c0 0x7fdbe80c54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:16.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.532+0000 7fdbecc9b640 1 --2- 172.21.15.123:0/957570783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdbe80cead0 0x7fdbe81f1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:16.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.532+0000 7fdbecc9b640 1 --2- 172.21.15.123:0/957570783 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdbc806c2b0 0x7fdbc806e770 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:16.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.532+0000 7fdbecc9b640 1 --2- 172.21.15.123:0/957570783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbe80ccf30 0x7fdbe81537d0 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:16.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.532+0000 7fdbecc9b640 1 -- 172.21.15.123:0/957570783 >> 172.21.15.123:0/957570783 conn(0x7fdbe806d0f0 msgr2=0x7fdbe80cf7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:16.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.533+0000 7fdbecc9b640 1 -- 172.21.15.123:0/957570783 shutdown_connections 2024-09-15T23:22:16.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.533+0000 7fdbecc9b640 1 -- 172.21.15.123:0/957570783 wait complete. 2024-09-15T23:22:16.548 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T23:22:16.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.695+0000 7f80ec731640 1 Processor -- start 2024-09-15T23:22:16.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.695+0000 7f80ec731640 1 -- start start 2024-09-15T23:22:16.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.696+0000 7f80ec731640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f80e41454b0 0x7f80e40b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:16.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.696+0000 7f80ec731640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f80e41459a0 0x7f80e40b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:16.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.696+0000 7f80ec731640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80e4146220 con 0x7f80e40b1db0 2024-09-15T23:22:16.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.696+0000 7f80ec731640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f80e40b1920 con 0x7f80e41459a0 2024-09-15T23:22:16.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.696+0000 7f80ec731640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f80e40cf640 con 0x7f80e41454b0 2024-09-15T23:22:16.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.696+0000 7f80e9ccc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f80e41459a0 0x7f80e40b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:16.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.696+0000 7f80eacce640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f80e40b1db0 0x7f80e40b2260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59102/0 (socket says 172.21.15.123:59102) 2024-09-15T23:22:16.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.696+0000 7f80eacce640 1 -- 172.21.15.123:0/370112974 learned_addr learned my addr 172.21.15.123:0/370112974 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:16.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.696+0000 7f80ea4cd640 1 --2- 172.21.15.123:0/370112974 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f80e41454b0 0x7f80e40b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:16.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.696+0000 7f80e9ccc640 1 -- 172.21.15.123:0/370112974 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f80e41454b0 msgr2=0x7f80e40b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:16.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.696+0000 7f80e9ccc640 1 --2- 172.21.15.123:0/370112974 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f80e41454b0 0x7f80e40b58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:16.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.696+0000 7f80e9ccc640 1 -- 172.21.15.123:0/370112974 >> v1:172.21.15.123:6789/0 conn(0x7f80e40b1db0 legacy=0x7f80e40b2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:16.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.696+0000 7f80e9ccc640 1 -- 172.21.15.123:0/370112974 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e40cf8e0 con 0x7f80e41459a0 2024-09-15T23:22:16.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.696+0000 7f80e94cb640 1 -- 172.21.15.123:0/370112974 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1863474025 0 0) 0x7f80dc001490 con 0x7f80e40b1db0 2024-09-15T23:22:16.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.697+0000 7f80e9ccc640 1 --2- 172.21.15.123:0/370112974 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80e41459a0 0x7f80e40b5e30 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f80d40097a0 tx=0x7f80d402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84239959e9c57374 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:16.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.697+0000 7f80e94cb640 1 -- 172.21.15.123:0/370112974 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d4037070 con 0x7f80e41459a0 2024-09-15T23:22:16.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.697+0000 7f80e94cb640 1 -- 172.21.15.123:0/370112974 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80d4032440 con 0x7f80e41459a0 2024-09-15T23:22:16.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.697+0000 7f80e94cb640 1 -- 172.21.15.123:0/370112974 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d4032810 con 0x7f80e41459a0 2024-09-15T23:22:16.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.698+0000 7f80ec731640 1 -- 172.21.15.123:0/370112974 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80e41459a0 msgr2=0x7f80e40b5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:16.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.698+0000 7f80ec731640 1 --2- 172.21.15.123:0/370112974 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80e41459a0 0x7f80e40b5e30 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f80d40097a0 tx=0x7f80d402a210 comp rx=0 tx=0).stop 2024-09-15T23:22:16.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.698+0000 7f80ec731640 1 -- 172.21.15.123:0/370112974 shutdown_connections 2024-09-15T23:22:16.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.698+0000 7f80ec731640 1 --2- 172.21.15.123:0/370112974 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80e41459a0 0x7f80e40b5e30 unknown :-1 s=CLOSED pgs=2031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:16.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.698+0000 7f80ec731640 1 --2- 172.21.15.123:0/370112974 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f80e41454b0 0x7f80e40b58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:16.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.698+0000 7f80ec731640 1 -- 172.21.15.123:0/370112974 >> 172.21.15.123:0/370112974 conn(0x7f80e406c240 msgr2=0x7f80e406d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:16.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.698+0000 7f80ec731640 1 -- 172.21.15.123:0/370112974 shutdown_connections 2024-09-15T23:22:16.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.698+0000 7f80ec731640 1 -- 172.21.15.123:0/370112974 wait complete. 2024-09-15T23:22:16.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.699+0000 7f80ec731640 1 Processor -- start 2024-09-15T23:22:16.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.699+0000 7f80ec731640 1 -- start start 2024-09-15T23:22:16.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.700+0000 7f80ec731640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80e40b1db0 0x7f80e415b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:16.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.700+0000 7f80ec731640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f80e41454b0 0x7f80e413ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:16.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.700+0000 7f80ec731640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f80e41459a0 0x7f80e413d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:16.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.700+0000 7f80ec731640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f80e40d0180 con 0x7f80e40b1db0 2024-09-15T23:22:16.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.700+0000 7f80ec731640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f80e40cfea0 con 0x7f80e41459a0 2024-09-15T23:22:16.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.700+0000 7f80ec731640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f80e40b0e50 con 0x7f80e41454b0 2024-09-15T23:22:16.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.700+0000 7f80ea4cd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80e40b1db0 0x7f80e415b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:16.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.700+0000 7f80ea4cd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80e40b1db0 0x7f80e415b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54850/0 (socket says 172.21.15.123:54850) 2024-09-15T23:22:16.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.700+0000 7f80ea4cd640 1 -- 172.21.15.123:0/407603879 learned_addr learned my addr 172.21.15.123:0/407603879 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:16.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.700+0000 7f80eacce640 1 --2- 172.21.15.123:0/407603879 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f80e41459a0 0x7f80e413d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:16.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.700+0000 7f80e9ccc640 1 --2- 172.21.15.123:0/407603879 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f80e41454b0 0x7f80e413ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:16.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.700+0000 7f80ea4cd640 1 -- 172.21.15.123:0/407603879 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f80e41454b0 msgr2=0x7f80e413ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:16.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.700+0000 7f80ea4cd640 1 --2- 172.21.15.123:0/407603879 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f80e41454b0 0x7f80e413ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:16.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.700+0000 7f80ea4cd640 1 -- 172.21.15.123:0/407603879 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f80e41459a0 msgr2=0x7f80e413d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:16.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.700+0000 7f80ea4cd640 1 --2- 172.21.15.123:0/407603879 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f80e41459a0 0x7f80e413d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:16.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.700+0000 7f80ea4cd640 1 -- 172.21.15.123:0/407603879 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e415cc50 con 0x7f80e40b1db0 2024-09-15T23:22:16.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.700+0000 7f80eacce640 1 --2- 172.21.15.123:0/407603879 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f80e41459a0 0x7f80e413d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:16.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.701+0000 7f80ea4cd640 1 --2- 172.21.15.123:0/407603879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80e40b1db0 0x7f80e415b950 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f80e000d830 tx=0x7f80e000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:16.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.701+0000 7f80daffd640 1 -- 172.21.15.123:0/407603879 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e000b660 con 0x7f80e40b1db0 2024-09-15T23:22:16.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.701+0000 7f80daffd640 1 -- 172.21.15.123:0/407603879 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80e0019070 con 0x7f80e40b1db0 2024-09-15T23:22:16.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.701+0000 7f80ec731640 1 -- 172.21.15.123:0/407603879 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80e415cf30 con 0x7f80e40b1db0 2024-09-15T23:22:16.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.701+0000 7f80daffd640 1 -- 172.21.15.123:0/407603879 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80e000ba20 con 0x7f80e40b1db0 2024-09-15T23:22:16.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.701+0000 7f80ec731640 1 -- 172.21.15.123:0/407603879 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80e415d4f0 con 0x7f80e40b1db0 2024-09-15T23:22:16.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.702+0000 7f80ec731640 1 -- 172.21.15.123:0/407603879 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80e40b58f0 con 0x7f80e40b1db0 2024-09-15T23:22:16.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.702+0000 7f80daffd640 1 -- 172.21.15.123:0/407603879 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f80e000bbc0 con 0x7f80e40b1db0 2024-09-15T23:22:16.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.703+0000 7f80daffd640 1 --2- 172.21.15.123:0/407603879 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f80c806c2b0 0x7f80c806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:16.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.703+0000 7f80daffd640 1 -- 172.21.15.123:0/407603879 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(172..172 src has 1..172) ==== 5968+0+0 (secure 0 0 0) 0x7f80e008b8c0 con 0x7f80e40b1db0 2024-09-15T23:22:16.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.703+0000 7f80e9ccc640 1 --2- 172.21.15.123:0/407603879 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f80c806c2b0 0x7f80c806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:16.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.703+0000 7f80e9ccc640 1 --2- 172.21.15.123:0/407603879 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f80c806c2b0 0x7f80c806e770 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f80d4034000 tx=0x7f80d402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:16.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.707+0000 7f80daffd640 1 -- 172.21.15.123:0/407603879 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f80e0059f30 con 0x7f80e40b1db0 2024-09-15T23:22:16.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:16.873+0000 7f80ec731640 1 -- 172.21.15.123:0/407603879 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f80e415fc60 con 0x7f80e40b1db0 2024-09-15T23:22:17.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.530+0000 7f80daffd640 1 -- 172.21.15.123:0/407603879 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v173) ==== 181+0+0 (secure 0 0 0) 0x7f80e0059830 con 0x7f80e40b1db0 2024-09-15T23:22:17.532 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' removed 2024-09-15T23:22:17.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.533+0000 7f80ec731640 1 -- 172.21.15.123:0/407603879 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f80c806c2b0 msgr2=0x7f80c806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:17.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.533+0000 7f80ec731640 1 --2- 172.21.15.123:0/407603879 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f80c806c2b0 0x7f80c806e770 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f80d4034000 tx=0x7f80d402e000 comp rx=0 tx=0).stop 2024-09-15T23:22:17.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.533+0000 7f80ec731640 1 -- 172.21.15.123:0/407603879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80e40b1db0 msgr2=0x7f80e415b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:17.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.533+0000 7f80ec731640 1 --2- 172.21.15.123:0/407603879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80e40b1db0 0x7f80e415b950 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7f80e000d830 tx=0x7f80e000dcf0 comp rx=0 tx=0).stop 2024-09-15T23:22:17.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.534+0000 7f80ec731640 1 -- 172.21.15.123:0/407603879 shutdown_connections 2024-09-15T23:22:17.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.534+0000 7f80ec731640 1 --2- 172.21.15.123:0/407603879 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f80e41459a0 0x7f80e413d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:17.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.534+0000 7f80ec731640 1 --2- 172.21.15.123:0/407603879 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f80e41454b0 0x7f80e413ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:17.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.534+0000 7f80ec731640 1 --2- 172.21.15.123:0/407603879 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f80c806c2b0 0x7f80c806e770 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:17.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.534+0000 7f80ec731640 1 --2- 172.21.15.123:0/407603879 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f80e40b1db0 0x7f80e415b950 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:17.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.534+0000 7f80ec731640 1 -- 172.21.15.123:0/407603879 >> 172.21.15.123:0/407603879 conn(0x7f80e406c240 msgr2=0x7f80e40cdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:17.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.534+0000 7f80ec731640 1 -- 172.21.15.123:0/407603879 shutdown_connections 2024-09-15T23:22:17.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.534+0000 7f80ec731640 1 -- 172.21.15.123:0/407603879 wait complete. 2024-09-15T23:22:17.549 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T23:22:17.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.652+0000 7f4e3d68b640 1 Processor -- start 2024-09-15T23:22:17.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.652+0000 7f4e3d68b640 1 -- start start 2024-09-15T23:22:17.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.653+0000 7f4e3d68b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4e3815ea90 0x7f4e380d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:17.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.653+0000 7f4e3d68b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4e380d16e0 0x7f4e380b7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:17.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.653+0000 7f4e3d68b640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e380cf060 con 0x7f4e380d40b0 2024-09-15T23:22:17.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.653+0000 7f4e3d68b640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f4e380d34c0 con 0x7f4e3815ea90 2024-09-15T23:22:17.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.653+0000 7f4e3d68b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4e380cf340 con 0x7f4e380d16e0 2024-09-15T23:22:17.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.653+0000 7f4e377fe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4e380d16e0 0x7f4e380b7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:17.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.653+0000 7f4e36ffd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4e3815ea90 0x7f4e380d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:17.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.653+0000 7f4e367fc640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f4e380d40b0 0x7f4e380d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:36506/0 (socket says 172.21.15.123:36506) 2024-09-15T23:22:17.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.653+0000 7f4e367fc640 1 -- 172.21.15.123:0/1475818611 learned_addr learned my addr 172.21.15.123:0/1475818611 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:17.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.653+0000 7f4e36ffd640 1 -- 172.21.15.123:0/1475818611 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4e380d16e0 msgr2=0x7f4e380b7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:17.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.653+0000 7f4e36ffd640 1 --2- 172.21.15.123:0/1475818611 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4e380d16e0 0x7f4e380b7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:17.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.653+0000 7f4e36ffd640 1 -- 172.21.15.123:0/1475818611 >> v1:172.21.15.188:6789/0 conn(0x7f4e380d40b0 legacy=0x7f4e380d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:17.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.653+0000 7f4e36ffd640 1 -- 172.21.15.123:0/1475818611 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e380cf620 con 0x7f4e3815ea90 2024-09-15T23:22:17.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.653+0000 7f4e377fe640 1 --2- 172.21.15.123:0/1475818611 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4e380d16e0 0x7f4e380b7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:22:17.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.654+0000 7f4e36ffd640 1 --2- 172.21.15.123:0/1475818611 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4e3815ea90 0x7f4e380d2f80 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f4e280097a0 tx=0x7f4e2802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29a3c9e2d9aa3fe server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:17.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.654+0000 7f4e35ffb640 1 -- 172.21.15.123:0/1475818611 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e28037070 con 0x7f4e3815ea90 2024-09-15T23:22:17.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.654+0000 7f4e35ffb640 1 -- 172.21.15.123:0/1475818611 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e28032440 con 0x7f4e3815ea90 2024-09-15T23:22:17.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.654+0000 7f4e35ffb640 1 -- 172.21.15.123:0/1475818611 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e28032810 con 0x7f4e3815ea90 2024-09-15T23:22:17.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.655+0000 7f4e3d68b640 1 -- 172.21.15.123:0/1475818611 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4e3815ea90 msgr2=0x7f4e380d2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:17.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.655+0000 7f4e3d68b640 1 --2- 172.21.15.123:0/1475818611 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4e3815ea90 0x7f4e380d2f80 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f4e280097a0 tx=0x7f4e2802a180 comp rx=0 tx=0).stop 2024-09-15T23:22:17.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.655+0000 7f4e3d68b640 1 -- 172.21.15.123:0/1475818611 shutdown_connections 2024-09-15T23:22:17.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.655+0000 7f4e3d68b640 1 --2- 172.21.15.123:0/1475818611 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4e380d16e0 0x7f4e380b7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:17.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.655+0000 7f4e3d68b640 1 --2- 172.21.15.123:0/1475818611 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4e3815ea90 0x7f4e380d2f80 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:17.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.655+0000 7f4e3d68b640 1 -- 172.21.15.123:0/1475818611 >> 172.21.15.123:0/1475818611 conn(0x7f4e3806c0e0 msgr2=0x7f4e3806c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:17.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.655+0000 7f4e3d68b640 1 -- 172.21.15.123:0/1475818611 shutdown_connections 2024-09-15T23:22:17.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.655+0000 7f4e3d68b640 1 -- 172.21.15.123:0/1475818611 wait complete. 2024-09-15T23:22:17.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.656+0000 7f4e3d68b640 1 Processor -- start 2024-09-15T23:22:17.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.656+0000 7f4e3d68b640 1 -- start start 2024-09-15T23:22:17.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.657+0000 7f4e3d68b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4e380d16e0 0x7f4e381e7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:17.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.657+0000 7f4e3d68b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4e380d40b0 0x7f4e3815e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:17.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.657+0000 7f4e3d68b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e3815ea90 0x7f4e380cda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:17.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.657+0000 7f4e3d68b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4e3815ee70 con 0x7f4e3815ea90 2024-09-15T23:22:17.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.657+0000 7f4e3d68b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4e380cfbe0 con 0x7f4e380d40b0 2024-09-15T23:22:17.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.657+0000 7f4e3d68b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4e380b8000 con 0x7f4e380d16e0 2024-09-15T23:22:17.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.657+0000 7f4e377fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e3815ea90 0x7f4e380cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:17.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.657+0000 7f4e377fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e3815ea90 0x7f4e380cda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54854/0 (socket says 172.21.15.123:54854) 2024-09-15T23:22:17.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.657+0000 7f4e377fe640 1 -- 172.21.15.123:0/3290910196 learned_addr learned my addr 172.21.15.123:0/3290910196 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:17.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.657+0000 7f4e367fc640 1 --2- 172.21.15.123:0/3290910196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4e380d40b0 0x7f4e3815e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:17.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.657+0000 7f4e36ffd640 1 --2- 172.21.15.123:0/3290910196 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4e380d16e0 0x7f4e381e7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:17.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.657+0000 7f4e377fe640 1 -- 172.21.15.123:0/3290910196 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4e380d16e0 msgr2=0x7f4e381e7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:17.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.657+0000 7f4e377fe640 1 --2- 172.21.15.123:0/3290910196 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4e380d16e0 0x7f4e381e7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:17.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.657+0000 7f4e377fe640 1 -- 172.21.15.123:0/3290910196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4e380d40b0 msgr2=0x7f4e3815e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:17.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.657+0000 7f4e377fe640 1 --2- 172.21.15.123:0/3290910196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4e380d40b0 0x7f4e3815e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:17.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.657+0000 7f4e377fe640 1 -- 172.21.15.123:0/3290910196 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e380b2930 con 0x7f4e3815ea90 2024-09-15T23:22:17.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.658+0000 7f4e377fe640 1 --2- 172.21.15.123:0/3290910196 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e3815ea90 0x7f4e380cda30 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7f4e30009eb0 tx=0x7f4e3000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:17.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.658+0000 7f4e1f7fe640 1 -- 172.21.15.123:0/3290910196 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e30018020 con 0x7f4e3815ea90 2024-09-15T23:22:17.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.658+0000 7f4e1f7fe640 1 -- 172.21.15.123:0/3290910196 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e30014480 con 0x7f4e3815ea90 2024-09-15T23:22:17.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.658+0000 7f4e3d68b640 1 -- 172.21.15.123:0/3290910196 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e381f8010 con 0x7f4e3815ea90 2024-09-15T23:22:17.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.658+0000 7f4e1f7fe640 1 -- 172.21.15.123:0/3290910196 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e30014850 con 0x7f4e3815ea90 2024-09-15T23:22:17.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.658+0000 7f4e3d68b640 1 -- 172.21.15.123:0/3290910196 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e381f8590 con 0x7f4e3815ea90 2024-09-15T23:22:17.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.659+0000 7f4e3d68b640 1 -- 172.21.15.123:0/3290910196 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e380b7ac0 con 0x7f4e3815ea90 2024-09-15T23:22:17.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.659+0000 7f4e1f7fe640 1 -- 172.21.15.123:0/3290910196 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4e30005d10 con 0x7f4e3815ea90 2024-09-15T23:22:17.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.660+0000 7f4e1f7fe640 1 --2- 172.21.15.123:0/3290910196 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4e2406c2b0 0x7f4e2406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:17.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.660+0000 7f4e1f7fe640 1 -- 172.21.15.123:0/3290910196 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 5530+0+0 (secure 0 0 0) 0x7f4e3008bfb0 con 0x7f4e3815ea90 2024-09-15T23:22:17.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.660+0000 7f4e36ffd640 1 --2- 172.21.15.123:0/3290910196 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4e2406c2b0 0x7f4e2406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:17.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.660+0000 7f4e36ffd640 1 --2- 172.21.15.123:0/3290910196 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4e2406c2b0 0x7f4e2406e770 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f4e28034000 tx=0x7f4e2802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:17.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.664+0000 7f4e1f7fe640 1 -- 172.21.15.123:0/3290910196 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4e30022030 con 0x7f4e3815ea90 2024-09-15T23:22:17.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:17.830+0000 7f4e3d68b640 1 -- 172.21.15.123:0/3290910196 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4e380b8e90 con 0x7f4e3815ea90 2024-09-15T23:22:18.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.535+0000 7f4e1f7fe640 1 -- 172.21.15.123:0/3290910196 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v174) ==== 169+0+0 (secure 0 0 0) 0x7f4e380b2930 con 0x7f4e3815ea90 2024-09-15T23:22:18.537 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' removed 2024-09-15T23:22:18.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.543+0000 7f4e3d68b640 1 -- 172.21.15.123:0/3290910196 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4e2406c2b0 msgr2=0x7f4e2406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:18.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.543+0000 7f4e3d68b640 1 --2- 172.21.15.123:0/3290910196 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4e2406c2b0 0x7f4e2406e770 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f4e28034000 tx=0x7f4e2802e000 comp rx=0 tx=0).stop 2024-09-15T23:22:18.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.543+0000 7f4e3d68b640 1 -- 172.21.15.123:0/3290910196 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e3815ea90 msgr2=0x7f4e380cda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:18.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.543+0000 7f4e3d68b640 1 --2- 172.21.15.123:0/3290910196 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e3815ea90 0x7f4e380cda30 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7f4e30009eb0 tx=0x7f4e3000c490 comp rx=0 tx=0).stop 2024-09-15T23:22:18.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.544+0000 7f4e3d68b640 1 -- 172.21.15.123:0/3290910196 shutdown_connections 2024-09-15T23:22:18.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.544+0000 7f4e3d68b640 1 --2- 172.21.15.123:0/3290910196 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4e2406c2b0 0x7f4e2406e770 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:18.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.544+0000 7f4e3d68b640 1 --2- 172.21.15.123:0/3290910196 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e3815ea90 0x7f4e380cda30 unknown :-1 s=CLOSED pgs=2033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:18.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.544+0000 7f4e3d68b640 1 --2- 172.21.15.123:0/3290910196 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4e380d40b0 0x7f4e3815e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:18.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.544+0000 7f4e3d68b640 1 --2- 172.21.15.123:0/3290910196 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4e380d16e0 0x7f4e381e7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:18.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.544+0000 7f4e3d68b640 1 -- 172.21.15.123:0/3290910196 >> 172.21.15.123:0/3290910196 conn(0x7f4e3806c0e0 msgr2=0x7f4e380b83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:18.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.545+0000 7f4e3d68b640 1 -- 172.21.15.123:0/3290910196 shutdown_connections 2024-09-15T23:22:18.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.545+0000 7f4e3d68b640 1 -- 172.21.15.123:0/3290910196 wait complete. 2024-09-15T23:22:18.574 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T23:22:18.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.680+0000 7fc978cc9640 1 Processor -- start 2024-09-15T23:22:18.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.680+0000 7fc978cc9640 1 -- start start 2024-09-15T23:22:18.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.681+0000 7fc978cc9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc9740b6e00 0x7fc9740d3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:18.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.681+0000 7fc978cc9640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc974162d90 0x7fc9740b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:18.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.681+0000 7fc978cc9640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc974071160 0x7fc97406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:18.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.681+0000 7fc978cc9640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc97406e7f0 con 0x7fc974071160 2024-09-15T23:22:18.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.681+0000 7fc978cc9640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fc9741631d0 con 0x7fc974162d90 2024-09-15T23:22:18.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.681+0000 7fc978cc9640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc97415ec10 con 0x7fc9740b6e00 2024-09-15T23:22:18.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.681+0000 7fc972d9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc974071160 0x7fc97406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:18.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.681+0000 7fc972d9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc974071160 0x7fc97406cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54864/0 (socket says 172.21.15.123:54864) 2024-09-15T23:22:18.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.681+0000 7fc972d9d640 1 -- 172.21.15.123:0/2977610573 learned_addr learned my addr 172.21.15.123:0/2977610573 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:18.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.682+0000 7fc971d9b640 1 --2- 172.21.15.123:0/2977610573 >> v2:172.21.15.188:3300/0 conn(0x7fc974162d90 0x7fc9740b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:18.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.682+0000 7fc97259c640 1 --2- 172.21.15.123:0/2977610573 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc9740b6e00 0x7fc9740d3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:18.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.682+0000 7fc972d9d640 1 -- 172.21.15.123:0/2977610573 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc9740b6e00 msgr2=0x7fc9740d3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:18.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.682+0000 7fc972d9d640 1 --2- 172.21.15.123:0/2977610573 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc9740b6e00 0x7fc9740d3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:18.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.682+0000 7fc972d9d640 1 -- 172.21.15.123:0/2977610573 >> v2:172.21.15.188:3300/0 conn(0x7fc974162d90 msgr2=0x7fc9740b71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:18.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.682+0000 7fc972d9d640 1 --2- 172.21.15.123:0/2977610573 >> v2:172.21.15.188:3300/0 conn(0x7fc974162d90 0x7fc9740b71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:18.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.682+0000 7fc972d9d640 1 -- 172.21.15.123:0/2977610573 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc97406ed20 con 0x7fc974071160 2024-09-15T23:22:18.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.682+0000 7fc972d9d640 1 --2- 172.21.15.123:0/2977610573 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc974071160 0x7fc97406cd20 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7fc97406a110 tx=0x7fc96c02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93bb384081e9a739 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:18.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.682+0000 7fc97159a640 1 -- 172.21.15.123:0/2977610573 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c037070 con 0x7fc974071160 2024-09-15T23:22:18.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.683+0000 7fc97159a640 1 -- 172.21.15.123:0/2977610573 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc96c02ae00 con 0x7fc974071160 2024-09-15T23:22:18.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.683+0000 7fc97159a640 1 -- 172.21.15.123:0/2977610573 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c032660 con 0x7fc974071160 2024-09-15T23:22:18.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.683+0000 7fc978cc9640 1 -- 172.21.15.123:0/2977610573 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc974071160 msgr2=0x7fc97406cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:18.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.683+0000 7fc978cc9640 1 --2- 172.21.15.123:0/2977610573 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc974071160 0x7fc97406cd20 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7fc97406a110 tx=0x7fc96c02a0b0 comp rx=0 tx=0).stop 2024-09-15T23:22:18.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.683+0000 7fc978cc9640 1 -- 172.21.15.123:0/2977610573 shutdown_connections 2024-09-15T23:22:18.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.683+0000 7fc978cc9640 1 --2- 172.21.15.123:0/2977610573 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc974071160 0x7fc97406cd20 unknown :-1 s=CLOSED pgs=2034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:18.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.683+0000 7fc978cc9640 1 --2- 172.21.15.123:0/2977610573 >> v2:172.21.15.188:3300/0 conn(0x7fc974162d90 0x7fc9740b71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:18.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.683+0000 7fc978cc9640 1 --2- 172.21.15.123:0/2977610573 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc9740b6e00 0x7fc9740d3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:18.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.683+0000 7fc978cc9640 1 -- 172.21.15.123:0/2977610573 >> 172.21.15.123:0/2977610573 conn(0x7fc9740d2550 msgr2=0x7fc9740d2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:18.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.683+0000 7fc978cc9640 1 -- 172.21.15.123:0/2977610573 shutdown_connections 2024-09-15T23:22:18.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.683+0000 7fc978cc9640 1 -- 172.21.15.123:0/2977610573 wait complete. 2024-09-15T23:22:18.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.684+0000 7fc978cc9640 1 Processor -- start 2024-09-15T23:22:18.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.685+0000 7fc978cc9640 1 -- start start 2024-09-15T23:22:18.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.685+0000 7fc978cc9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc974071160 0x7fc97414b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:18.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.685+0000 7fc978cc9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc9740b6e00 0x7fc97414bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:18.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.685+0000 7fc978cc9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc974162d90 0x7fc97414c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:18.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.685+0000 7fc978cc9640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc974070960 con 0x7fc974071160 2024-09-15T23:22:18.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.685+0000 7fc978cc9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc97406ea40 con 0x7fc9740b6e00 2024-09-15T23:22:18.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.685+0000 7fc978cc9640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc974070c40 con 0x7fc974162d90 2024-09-15T23:22:18.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.685+0000 7fc97259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc974071160 0x7fc97414b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:18.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.685+0000 7fc97259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc974071160 0x7fc97414b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54876/0 (socket says 172.21.15.123:54876) 2024-09-15T23:22:18.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.685+0000 7fc97259c640 1 -- 172.21.15.123:0/2252544300 learned_addr learned my addr 172.21.15.123:0/2252544300 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:18.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.686+0000 7fc97259c640 1 -- 172.21.15.123:0/2252544300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc974162d90 msgr2=0x7fc97414c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:18.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.686+0000 7fc97259c640 1 --2- 172.21.15.123:0/2252544300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc974162d90 0x7fc97414c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:18.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.686+0000 7fc97259c640 1 -- 172.21.15.123:0/2252544300 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc9740b6e00 msgr2=0x7fc97414bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:18.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.686+0000 7fc971d9b640 1 --2- 172.21.15.123:0/2252544300 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc9740b6e00 0x7fc97414bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:18.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.686+0000 7fc97259c640 1 --2- 172.21.15.123:0/2252544300 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc9740b6e00 0x7fc97414bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:18.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.686+0000 7fc97259c640 1 -- 172.21.15.123:0/2252544300 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc97415c490 con 0x7fc974071160 2024-09-15T23:22:18.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.686+0000 7fc97259c640 1 --2- 172.21.15.123:0/2252544300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc974071160 0x7fc97414b2b0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7fc964007e60 tx=0x7fc96400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:18.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.686+0000 7fc96affd640 1 -- 172.21.15.123:0/2252544300 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc964014620 con 0x7fc974071160 2024-09-15T23:22:18.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.686+0000 7fc96affd640 1 -- 172.21.15.123:0/2252544300 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc964019070 con 0x7fc974071160 2024-09-15T23:22:18.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.686+0000 7fc96affd640 1 -- 172.21.15.123:0/2252544300 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc964014a00 con 0x7fc974071160 2024-09-15T23:22:18.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.686+0000 7fc978cc9640 1 -- 172.21.15.123:0/2252544300 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc97414c6e0 con 0x7fc974071160 2024-09-15T23:22:18.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.686+0000 7fc978cc9640 1 -- 172.21.15.123:0/2252544300 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc97414cca0 con 0x7fc974071160 2024-09-15T23:22:18.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.687+0000 7fc978cc9640 1 -- 172.21.15.123:0/2252544300 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc97415e270 con 0x7fc974071160 2024-09-15T23:22:18.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.688+0000 7fc96affd640 1 -- 172.21.15.123:0/2252544300 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc964014ba0 con 0x7fc974071160 2024-09-15T23:22:18.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.688+0000 7fc96affd640 1 --2- 172.21.15.123:0/2252544300 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc95406c2b0 0x7fc95406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:18.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.688+0000 7fc96affd640 1 -- 172.21.15.123:0/2252544300 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 5029+0+0 (secure 0 0 0) 0x7fc96408baa0 con 0x7fc974071160 2024-09-15T23:22:18.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.688+0000 7fc971d9b640 1 --2- 172.21.15.123:0/2252544300 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc95406c2b0 0x7fc95406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:18.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.689+0000 7fc971d9b640 1 --2- 172.21.15.123:0/2252544300 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc95406c2b0 0x7fc95406e770 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fc95c006fd0 tx=0x7fc95c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:18.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.692+0000 7fc96affd640 1 -- 172.21.15.123:0/2252544300 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc97415e270 con 0x7fc974071160 2024-09-15T23:22:18.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.859+0000 7fc978cc9640 1 -- 172.21.15.123:0/2252544300 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fc97406d150 con 0x7fc974071160 2024-09-15T23:22:18.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.862+0000 7fc96affd640 1 -- 172.21.15.123:0/2252544300 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v43) ==== 104+0+0 (secure 0 0 0) 0x7fc96405a420 con 0x7fc974071160 2024-09-15T23:22:18.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.864+0000 7fc978cc9640 1 -- 172.21.15.123:0/2252544300 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc95406c2b0 msgr2=0x7fc95406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:18.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.864+0000 7fc978cc9640 1 --2- 172.21.15.123:0/2252544300 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc95406c2b0 0x7fc95406e770 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fc95c006fd0 tx=0x7fc95c008040 comp rx=0 tx=0).stop 2024-09-15T23:22:18.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.864+0000 7fc978cc9640 1 -- 172.21.15.123:0/2252544300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc974071160 msgr2=0x7fc97414b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:18.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.864+0000 7fc978cc9640 1 --2- 172.21.15.123:0/2252544300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc974071160 0x7fc97414b2b0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7fc964007e60 tx=0x7fc96400e4b0 comp rx=0 tx=0).stop 2024-09-15T23:22:18.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.864+0000 7fc978cc9640 1 -- 172.21.15.123:0/2252544300 shutdown_connections 2024-09-15T23:22:18.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.864+0000 7fc978cc9640 1 --2- 172.21.15.123:0/2252544300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc974162d90 0x7fc97414c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:18.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.864+0000 7fc978cc9640 1 --2- 172.21.15.123:0/2252544300 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc9740b6e00 0x7fc97414bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:18.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.864+0000 7fc978cc9640 1 --2- 172.21.15.123:0/2252544300 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc95406c2b0 0x7fc95406e770 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:18.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.864+0000 7fc978cc9640 1 --2- 172.21.15.123:0/2252544300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc974071160 0x7fc97414b2b0 unknown :-1 s=CLOSED pgs=2035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:18.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.864+0000 7fc978cc9640 1 -- 172.21.15.123:0/2252544300 >> 172.21.15.123:0/2252544300 conn(0x7fc9740d2550 msgr2=0x7fc9740b29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:18.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.864+0000 7fc978cc9640 1 -- 172.21.15.123:0/2252544300 shutdown_connections 2024-09-15T23:22:18.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.864+0000 7fc978cc9640 1 -- 172.21.15.123:0/2252544300 wait complete. 2024-09-15T23:22:18.878 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover' 2024-09-15T23:22:18.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.974+0000 7fb5378e6640 1 Processor -- start 2024-09-15T23:22:18.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.975+0000 7fb5378e6640 1 -- start start 2024-09-15T23:22:18.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.975+0000 7fb5378e6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb53015ed20 0x7fb5300b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:18.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.975+0000 7fb5378e6640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5300d0e70 con 0x7fb5300d23b0 2024-09-15T23:22:18.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.975+0000 7fb5378e6640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5300d00f0 con 0x7fb5300b90e0 2024-09-15T23:22:18.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.975+0000 7fb5378e6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fb5300d41c0 con 0x7fb53015ed20 2024-09-15T23:22:18.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.976+0000 7fb534e81640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb5300d23b0 0x7fb5300cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59116/0 (socket says 172.21.15.123:59116) 2024-09-15T23:22:18.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.976+0000 7fb534e81640 1 -- 172.21.15.123:0/1784006233 learned_addr learned my addr 172.21.15.123:0/1784006233 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:18.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.976+0000 7fb535682640 1 --2- 172.21.15.123:0/1784006233 >> v2:172.21.15.188:3300/0 conn(0x7fb53015ed20 0x7fb5300b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:18.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.976+0000 7fb52ffff640 1 -- 172.21.15.123:0/1784006233 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3149739889 0 0) 0x7fb524001490 con 0x7fb5300d23b0 2024-09-15T23:22:18.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.976+0000 7fb52ffff640 1 -- 172.21.15.123:0/1784006233 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb518003520 con 0x7fb5300d23b0 2024-09-15T23:22:18.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.976+0000 7fb52ffff640 1 -- 172.21.15.123:0/1784006233 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 735486302 0 0) 0x7fb518003520 con 0x7fb5300d23b0 2024-09-15T23:22:18.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.976+0000 7fb52ffff640 1 -- 172.21.15.123:0/1784006233 >> v2:172.21.15.188:3300/0 conn(0x7fb53015ed20 msgr2=0x7fb5300b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:18.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.976+0000 7fb52ffff640 1 --2- 172.21.15.123:0/1784006233 >> v2:172.21.15.188:3300/0 conn(0x7fb53015ed20 0x7fb5300b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:18.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.976+0000 7fb52ffff640 1 -- 172.21.15.123:0/1784006233 >> v1:172.21.15.188:6789/0 conn(0x7fb5300b90e0 legacy=0x7fb5300cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:18.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.976+0000 7fb52ffff640 1 -- 172.21.15.123:0/1784006233 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5300d35b0 con 0x7fb5300d23b0 2024-09-15T23:22:18.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.976+0000 7fb52ffff640 1 -- 172.21.15.123:0/1784006233 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fb524001bc0 con 0x7fb5300d23b0 2024-09-15T23:22:18.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.976+0000 7fb52ffff640 1 -- 172.21.15.123:0/1784006233 >> v1:172.21.15.123:6789/0 conn(0x7fb5300d23b0 legacy=0x7fb5300cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:18.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.976+0000 7fb52ffff640 1 --2- 172.21.15.123:0/1784006233 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5180039b0 0x7fb518003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:18.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.976+0000 7fb52ffff640 1 --2- 172.21.15.123:0/1784006233 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb518004800 0x7fb518004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:18.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.976+0000 7fb52ffff640 1 --2- 172.21.15.123:0/1784006233 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5180051c0 0x7fb51800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:18.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.976+0000 7fb52ffff640 1 -- 172.21.15.123:0/1784006233 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb5300d41c0 con 0x7fb5180039b0 2024-09-15T23:22:18.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.976+0000 7fb52ffff640 1 -- 172.21.15.123:0/1784006233 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb51800c160 con 0x7fb518004800 2024-09-15T23:22:18.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.976+0000 7fb52ffff640 1 -- 172.21.15.123:0/1784006233 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb51800c360 con 0x7fb5180051c0 2024-09-15T23:22:18.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.976+0000 7fb535682640 1 --2- 172.21.15.123:0/1784006233 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5180039b0 0x7fb518003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:18.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.976+0000 7fb534e81640 1 --2- 172.21.15.123:0/1784006233 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb518004800 0x7fb518004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:18.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.976+0000 7fb535e83640 1 --2- 172.21.15.123:0/1784006233 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5180051c0 0x7fb51800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:18.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.976+0000 7fb535682640 1 -- 172.21.15.123:0/1784006233 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5180051c0 msgr2=0x7fb51800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:18.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.976+0000 7fb535682640 1 --2- 172.21.15.123:0/1784006233 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5180051c0 0x7fb51800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:18.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.977+0000 7fb535682640 1 -- 172.21.15.123:0/1784006233 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb518004800 msgr2=0x7fb518004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:18.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.977+0000 7fb535682640 1 --2- 172.21.15.123:0/1784006233 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb518004800 0x7fb518004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:18.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.977+0000 7fb535e83640 1 -- 172.21.15.123:0/1784006233 reap_dead start 2024-09-15T23:22:18.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.977+0000 7fb535682640 1 -- 172.21.15.123:0/1784006233 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb518003520 con 0x7fb5180039b0 2024-09-15T23:22:18.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.977+0000 7fb535682640 1 --2- 172.21.15.123:0/1784006233 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5180039b0 0x7fb518003dd0 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7fb528009ac0 tx=0x7fb518005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b8185c51ae5cdfe server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:18.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.977+0000 7fb52ffff640 1 -- 172.21.15.123:0/1784006233 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb528036070 con 0x7fb5180039b0 2024-09-15T23:22:18.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.977+0000 7fb52ffff640 1 -- 172.21.15.123:0/1784006233 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb528031400 con 0x7fb5180039b0 2024-09-15T23:22:18.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.977+0000 7fb52ffff640 1 -- 172.21.15.123:0/1784006233 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb528009690 con 0x7fb5180039b0 2024-09-15T23:22:18.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.978+0000 7fb5378e6640 1 -- 172.21.15.123:0/1784006233 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5180039b0 msgr2=0x7fb518003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:18.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.978+0000 7fb5378e6640 1 --2- 172.21.15.123:0/1784006233 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5180039b0 0x7fb518003dd0 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7fb528009ac0 tx=0x7fb518005830 comp rx=0 tx=0).stop 2024-09-15T23:22:18.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.978+0000 7fb5378e6640 1 -- 172.21.15.123:0/1784006233 shutdown_connections 2024-09-15T23:22:18.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.978+0000 7fb5378e6640 1 --2- 172.21.15.123:0/1784006233 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5180039b0 0x7fb518003dd0 unknown :-1 s=CLOSED pgs=2037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:18.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.978+0000 7fb5378e6640 1 -- 172.21.15.123:0/1784006233 >> 172.21.15.123:0/1784006233 conn(0x7fb5300d1260 msgr2=0x7fb5300d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:18.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.978+0000 7fb5378e6640 1 -- 172.21.15.123:0/1784006233 shutdown_connections 2024-09-15T23:22:18.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.978+0000 7fb5378e6640 1 -- 172.21.15.123:0/1784006233 wait complete. 2024-09-15T23:22:18.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.979+0000 7fb5378e6640 1 Processor -- start 2024-09-15T23:22:18.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.979+0000 7fb5378e6640 1 -- start start 2024-09-15T23:22:18.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.980+0000 7fb5378e6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5180039b0 0x7fb53014fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:18.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.980+0000 7fb5378e6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb530150300 0x7fb5300ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:18.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.980+0000 7fb5378e6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5300cf1e0 0x7fb5300b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:18.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.980+0000 7fb5378e6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb5300d3e50 con 0x7fb5300cf1e0 2024-09-15T23:22:18.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.980+0000 7fb5378e6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb5300d3b70 con 0x7fb530150300 2024-09-15T23:22:18.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.980+0000 7fb5378e6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb5300d32a0 con 0x7fb5180039b0 2024-09-15T23:22:18.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.980+0000 7fb535e83640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5300cf1e0 0x7fb5300b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:18.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.980+0000 7fb535e83640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5300cf1e0 0x7fb5300b44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54894/0 (socket says 172.21.15.123:54894) 2024-09-15T23:22:18.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.980+0000 7fb535e83640 1 -- 172.21.15.123:0/2469246905 learned_addr learned my addr 172.21.15.123:0/2469246905 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:18.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.980+0000 7fb534e81640 1 --2- 172.21.15.123:0/2469246905 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb530150300 0x7fb5300ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:18.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.980+0000 7fb535682640 1 --2- 172.21.15.123:0/2469246905 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5180039b0 0x7fb53014fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:18.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.980+0000 7fb535e83640 1 -- 172.21.15.123:0/2469246905 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5180039b0 msgr2=0x7fb53014fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:18.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.980+0000 7fb535e83640 1 --2- 172.21.15.123:0/2469246905 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5180039b0 0x7fb53014fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:18.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.980+0000 7fb535e83640 1 -- 172.21.15.123:0/2469246905 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb530150300 msgr2=0x7fb5300ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:18.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.980+0000 7fb535e83640 1 --2- 172.21.15.123:0/2469246905 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb530150300 0x7fb5300ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:18.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.980+0000 7fb535e83640 1 -- 172.21.15.123:0/2469246905 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5300cf670 con 0x7fb5300cf1e0 2024-09-15T23:22:18.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.980+0000 7fb535e83640 1 --2- 172.21.15.123:0/2469246905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5300cf1e0 0x7fb5300b44e0 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7fb530068a80 tx=0x7fb52000e760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:18.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.981+0000 7fb52dffb640 1 -- 172.21.15.123:0/2469246905 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb520019070 con 0x7fb5300cf1e0 2024-09-15T23:22:18.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.981+0000 7fb52dffb640 1 -- 172.21.15.123:0/2469246905 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5200050d0 con 0x7fb5300cf1e0 2024-09-15T23:22:18.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.981+0000 7fb5378e6640 1 -- 172.21.15.123:0/2469246905 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5301f84f0 con 0x7fb5300cf1e0 2024-09-15T23:22:18.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.981+0000 7fb52dffb640 1 -- 172.21.15.123:0/2469246905 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5200054a0 con 0x7fb5300cf1e0 2024-09-15T23:22:18.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.981+0000 7fb5378e6640 1 -- 172.21.15.123:0/2469246905 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5301f8ab0 con 0x7fb5300cf1e0 2024-09-15T23:22:18.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.982+0000 7fb5378e6640 1 -- 172.21.15.123:0/2469246905 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb53015f100 con 0x7fb5300cf1e0 2024-09-15T23:22:18.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.982+0000 7fb52dffb640 1 -- 172.21.15.123:0/2469246905 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb52001c070 con 0x7fb5300cf1e0 2024-09-15T23:22:18.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.983+0000 7fb52dffb640 1 --2- 172.21.15.123:0/2469246905 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb51c06c450 0x7fb51c06e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:18.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.983+0000 7fb52dffb640 1 -- 172.21.15.123:0/2469246905 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 5029+0+0 (secure 0 0 0) 0x7fb52008a430 con 0x7fb5300cf1e0 2024-09-15T23:22:18.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.983+0000 7fb535682640 1 --2- 172.21.15.123:0/2469246905 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb51c06c450 0x7fb51c06e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:18.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.983+0000 7fb535682640 1 --2- 172.21.15.123:0/2469246905 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb51c06c450 0x7fb51c06e910 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fb528033000 tx=0x7fb528008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:18.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:18.987+0000 7fb52dffb640 1 -- 172.21.15.123:0/2469246905 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb520058e40 con 0x7fb5300cf1e0 2024-09-15T23:22:19.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.220+0000 7fb5378e6640 1 -- 172.21.15.123:0/2469246905 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]} v 0) -- 0x7fb5300d0a90 con 0x7fb5300cf1e0 2024-09-15T23:22:19.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.536+0000 7fb52dffb640 1 -- 172.21.15.123:0/2469246905 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]}]=0 v502) ==== 166+0+0 (secure 0 0 0) 0x7fb520058740 con 0x7fb5300cf1e0 2024-09-15T23:22:19.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.538+0000 7fb5378e6640 1 -- 172.21.15.123:0/2469246905 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb51c06c450 msgr2=0x7fb51c06e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:19.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.538+0000 7fb5378e6640 1 --2- 172.21.15.123:0/2469246905 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb51c06c450 0x7fb51c06e910 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fb528033000 tx=0x7fb528008030 comp rx=0 tx=0).stop 2024-09-15T23:22:19.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.538+0000 7fb5378e6640 1 -- 172.21.15.123:0/2469246905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5300cf1e0 msgr2=0x7fb5300b44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:19.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.538+0000 7fb5378e6640 1 --2- 172.21.15.123:0/2469246905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5300cf1e0 0x7fb5300b44e0 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7fb530068a80 tx=0x7fb52000e760 comp rx=0 tx=0).stop 2024-09-15T23:22:19.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.538+0000 7fb5378e6640 1 -- 172.21.15.123:0/2469246905 shutdown_connections 2024-09-15T23:22:19.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.538+0000 7fb5378e6640 1 --2- 172.21.15.123:0/2469246905 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb51c06c450 0x7fb51c06e910 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:19.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.538+0000 7fb5378e6640 1 --2- 172.21.15.123:0/2469246905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb5300cf1e0 0x7fb5300b44e0 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:19.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.538+0000 7fb5378e6640 1 --2- 172.21.15.123:0/2469246905 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb530150300 0x7fb5300ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:19.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.538+0000 7fb5378e6640 1 --2- 172.21.15.123:0/2469246905 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb5180039b0 0x7fb53014fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:19.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.538+0000 7fb5378e6640 1 -- 172.21.15.123:0/2469246905 >> 172.21.15.123:0/2469246905 conn(0x7fb5300d1260 msgr2=0x7fb53015cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:19.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.538+0000 7fb5378e6640 1 -- 172.21.15.123:0/2469246905 shutdown_connections 2024-09-15T23:22:19.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.538+0000 7fb5378e6640 1 -- 172.21.15.123:0/2469246905 wait complete. 2024-09-15T23:22:19.552 INFO:tasks.cephfs_test_runner:test_scrub_task_status_on_mds_failover (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-15T23:22:19.552 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) 2024-09-15T23:22:19.552 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:22:19.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.650+0000 7f6832faf640 1 Processor -- start 2024-09-15T23:22:19.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.650+0000 7f6832faf640 1 -- start start 2024-09-15T23:22:19.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.651+0000 7f6832faf640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f682c15e790 0x7f682c073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:19.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.651+0000 7f6832faf640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f682c1631c0 con 0x7f682c162c60 2024-09-15T23:22:19.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.651+0000 7f6832faf640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f682c0ae9a0 con 0x7f682c06f730 2024-09-15T23:22:19.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.651+0000 7f6832faf640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f682c15eb70 con 0x7f682c15e790 2024-09-15T23:22:19.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.651+0000 7f6830d4b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f682c15e790 0x7f682c073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:19.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.651+0000 7f6823fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f682c162c60 0x7f682c0b5430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59122/0 (socket says 172.21.15.123:59122) 2024-09-15T23:22:19.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.651+0000 7f6830d4b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f682c15e790 0x7f682c073a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54902/0 (socket says 172.21.15.123:54902) 2024-09-15T23:22:19.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.651+0000 7f6823fff640 1 -- 172.21.15.123:0/2670930791 learned_addr learned my addr 172.21.15.123:0/2670930791 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:19.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.651+0000 7f6830d4b640 1 -- 172.21.15.123:0/2670930791 >> v1:172.21.15.188:6789/0 conn(0x7f682c06f730 legacy=0x7f682c06fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:19.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.651+0000 7f6830d4b640 1 -- 172.21.15.123:0/2670930791 >> v1:172.21.15.123:6789/0 conn(0x7f682c162c60 legacy=0x7f682c0b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:19.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.651+0000 7f68237fe640 1 -- 172.21.15.123:0/2670930791 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 160856419 0 0) 0x7f682c1631c0 con 0x7f682c162c60 2024-09-15T23:22:19.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.651+0000 7f6830d4b640 1 -- 172.21.15.123:0/2670930791 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f682c0aec40 con 0x7f682c15e790 2024-09-15T23:22:19.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.652+0000 7f6830d4b640 1 --2- 172.21.15.123:0/2670930791 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f682c15e790 0x7f682c073a40 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f682c0aeb70 tx=0x7f682802a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c0dcb42cb017fcd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:19.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.652+0000 7f68237fe640 1 -- 172.21.15.123:0/2670930791 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6828037070 con 0x7f682c15e790 2024-09-15T23:22:19.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.652+0000 7f68237fe640 1 -- 172.21.15.123:0/2670930791 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f682802adb0 con 0x7f682c15e790 2024-09-15T23:22:19.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.652+0000 7f68237fe640 1 -- 172.21.15.123:0/2670930791 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6828032660 con 0x7f682c15e790 2024-09-15T23:22:19.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.652+0000 7f6832faf640 1 -- 172.21.15.123:0/2670930791 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f682c15e790 msgr2=0x7f682c073a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:19.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.653+0000 7f6832faf640 1 --2- 172.21.15.123:0/2670930791 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f682c15e790 0x7f682c073a40 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7f682c0aeb70 tx=0x7f682802a0a0 comp rx=0 tx=0).stop 2024-09-15T23:22:19.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.653+0000 7f6832faf640 1 -- 172.21.15.123:0/2670930791 shutdown_connections 2024-09-15T23:22:19.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.653+0000 7f6832faf640 1 --2- 172.21.15.123:0/2670930791 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f682c15e790 0x7f682c073a40 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:19.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.653+0000 7f6832faf640 1 -- 172.21.15.123:0/2670930791 >> 172.21.15.123:0/2670930791 conn(0x7f682c0b0a80 msgr2=0x7f682c0b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:19.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.653+0000 7f6832faf640 1 -- 172.21.15.123:0/2670930791 shutdown_connections 2024-09-15T23:22:19.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.653+0000 7f6832faf640 1 -- 172.21.15.123:0/2670930791 wait complete. 2024-09-15T23:22:19.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.654+0000 7f6832faf640 1 Processor -- start 2024-09-15T23:22:19.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.654+0000 7f6832faf640 1 -- start start 2024-09-15T23:22:19.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.655+0000 7f6832faf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f682c06f730 0x7f682c153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:19.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.655+0000 7f6832faf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f682c15e790 0x7f682c160dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:19.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.655+0000 7f6832faf640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f682c162c60 0x7f682c1ea1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:19.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.655+0000 7f6832faf640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f682c0b5b40 con 0x7f682c15e790 2024-09-15T23:22:19.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.655+0000 7f6832faf640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f682c0af200 con 0x7f682c06f730 2024-09-15T23:22:19.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.655+0000 7f6832faf640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f682c06f430 con 0x7f682c162c60 2024-09-15T23:22:19.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.655+0000 7f6823fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f682c15e790 0x7f682c160dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:19.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.655+0000 7f6823fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f682c15e790 0x7f682c160dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54908/0 (socket says 172.21.15.123:54908) 2024-09-15T23:22:19.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.655+0000 7f6823fff640 1 -- 172.21.15.123:0/3494759040 learned_addr learned my addr 172.21.15.123:0/3494759040 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:19.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.655+0000 7f6830d4b640 1 --2- 172.21.15.123:0/3494759040 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f682c06f730 0x7f682c153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:19.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.655+0000 7f683154c640 1 --2- 172.21.15.123:0/3494759040 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f682c162c60 0x7f682c1ea1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:19.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.655+0000 7f6823fff640 1 -- 172.21.15.123:0/3494759040 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f682c162c60 msgr2=0x7f682c1ea1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:19.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.655+0000 7f6823fff640 1 --2- 172.21.15.123:0/3494759040 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f682c162c60 0x7f682c1ea1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:19.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.655+0000 7f6823fff640 1 -- 172.21.15.123:0/3494759040 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f682c06f730 msgr2=0x7f682c153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:19.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.655+0000 7f6823fff640 1 --2- 172.21.15.123:0/3494759040 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f682c06f730 0x7f682c153fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:19.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.655+0000 7f6823fff640 1 -- 172.21.15.123:0/3494759040 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f682c154520 con 0x7f682c15e790 2024-09-15T23:22:19.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.655+0000 7f683154c640 1 --2- 172.21.15.123:0/3494759040 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f682c162c60 0x7f682c1ea1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:22:19.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.655+0000 7f6830d4b640 1 --2- 172.21.15.123:0/3494759040 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f682c06f730 0x7f682c153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:22:19.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.655+0000 7f6823fff640 1 --2- 172.21.15.123:0/3494759040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f682c15e790 0x7f682c160dc0 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7f681c00c430 tx=0x7f681c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:19.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.655+0000 7f68217fa640 1 -- 172.21.15.123:0/3494759040 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f681c0074e0 con 0x7f682c15e790 2024-09-15T23:22:19.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.655+0000 7f68217fa640 1 -- 172.21.15.123:0/3494759040 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f681c0047e0 con 0x7f682c15e790 2024-09-15T23:22:19.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.655+0000 7f6832faf640 1 -- 172.21.15.123:0/3494759040 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f682c1617a0 con 0x7f682c15e790 2024-09-15T23:22:19.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.655+0000 7f68217fa640 1 -- 172.21.15.123:0/3494759040 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f681c004bd0 con 0x7f682c15e790 2024-09-15T23:22:19.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.655+0000 7f6832faf640 1 -- 172.21.15.123:0/3494759040 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f682c0c5f20 con 0x7f682c15e790 2024-09-15T23:22:19.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.656+0000 7f6832faf640 1 -- 172.21.15.123:0/3494759040 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f682c073a40 con 0x7f682c15e790 2024-09-15T23:22:19.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.657+0000 7f68217fa640 1 -- 172.21.15.123:0/3494759040 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f681c011070 con 0x7f682c15e790 2024-09-15T23:22:19.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.657+0000 7f68217fa640 1 --2- 172.21.15.123:0/3494759040 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f681806c2b0 0x7f681806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:19.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.657+0000 7f68217fa640 1 -- 172.21.15.123:0/3494759040 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 5029+0+0 (secure 0 0 0) 0x7f681c08ae00 con 0x7f682c15e790 2024-09-15T23:22:19.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.658+0000 7f6830d4b640 1 --2- 172.21.15.123:0/3494759040 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f681806c2b0 0x7f681806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:19.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.658+0000 7f6830d4b640 1 --2- 172.21.15.123:0/3494759040 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f681806c2b0 0x7f681806e770 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f6828034000 tx=0x7f682802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:19.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.662+0000 7f68217fa640 1 -- 172.21.15.123:0/3494759040 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f681c059810 con 0x7f682c15e790 2024-09-15T23:22:19.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.826+0000 7f6832faf640 1 -- 172.21.15.123:0/3494759040 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f682c0cdfc0 con 0x7f682c15e790 2024-09-15T23:22:19.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.827+0000 7f68217fa640 1 -- 172.21.15.123:0/3494759040 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v174) ==== 74+0+13200 (secure 0 0 0) 0x7f681c059110 con 0x7f682c15e790 2024-09-15T23:22:19.829 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:22:19.829 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":174,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:22:18.532670+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6833/3722702026":"2024-09-16T23:22:15.524643+0000","172.21.15.123:6832/3722702026":"2024-09-16T23:22:15.524643+0000","172.21.15.123:6835/1883512279":"2024-09-16T23:22:04.310006+0000","172.21.15.123:6834/1883512279":"2024-09-16T23:22:04.310006+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:22:19.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.829+0000 7f6832faf640 1 -- 172.21.15.123:0/3494759040 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f681806c2b0 msgr2=0x7f681806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:19.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.829+0000 7f6832faf640 1 --2- 172.21.15.123:0/3494759040 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f681806c2b0 0x7f681806e770 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f6828034000 tx=0x7f682802e000 comp rx=0 tx=0).stop 2024-09-15T23:22:19.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.829+0000 7f6832faf640 1 -- 172.21.15.123:0/3494759040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f682c15e790 msgr2=0x7f682c160dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:19.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.829+0000 7f6832faf640 1 --2- 172.21.15.123:0/3494759040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f682c15e790 0x7f682c160dc0 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7f681c00c430 tx=0x7f681c00c8f0 comp rx=0 tx=0).stop 2024-09-15T23:22:19.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.829+0000 7f6832faf640 1 -- 172.21.15.123:0/3494759040 shutdown_connections 2024-09-15T23:22:19.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.829+0000 7f6832faf640 1 --2- 172.21.15.123:0/3494759040 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f682c162c60 0x7f682c1ea1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:19.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.829+0000 7f6832faf640 1 --2- 172.21.15.123:0/3494759040 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f681806c2b0 0x7f681806e770 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:19.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.829+0000 7f6832faf640 1 --2- 172.21.15.123:0/3494759040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f682c15e790 0x7f682c160dc0 unknown :-1 s=CLOSED pgs=2041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:19.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.829+0000 7f6832faf640 1 --2- 172.21.15.123:0/3494759040 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f682c06f730 0x7f682c153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:19.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.829+0000 7f6832faf640 1 -- 172.21.15.123:0/3494759040 >> 172.21.15.123:0/3494759040 conn(0x7f682c0b0a80 msgr2=0x7f682c071ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:19.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.829+0000 7f6832faf640 1 -- 172.21.15.123:0/3494759040 shutdown_connections 2024-09-15T23:22:19.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.829+0000 7f6832faf640 1 -- 172.21.15.123:0/3494759040 wait complete. 2024-09-15T23:22:19.843 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T23:12:01.531886+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T23:22:19.843 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T23:22:19.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.942+0000 7fc4aca8d640 1 Processor -- start 2024-09-15T23:22:19.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.943+0000 7fc4aca8d640 1 -- start start 2024-09-15T23:22:19.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.944+0000 7fc4aca8d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc4a80cd2a0 0x7fc4a815c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:19.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.944+0000 7fc4aca8d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4a80714b0 con 0x7fc4a80732e0 2024-09-15T23:22:19.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.944+0000 7fc4aca8d640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4a80cd880 con 0x7fc4a80cce30 2024-09-15T23:22:19.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.944+0000 7fc4aca8d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc4a80cdb60 con 0x7fc4a80cd2a0 2024-09-15T23:22:19.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.944+0000 7fc4a6d9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc4a80cd2a0 0x7fc4a815c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:19.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.944+0000 7fc4a659c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc4a80732e0 0x7fc4a80736c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59138/0 (socket says 172.21.15.123:59138) 2024-09-15T23:22:19.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.944+0000 7fc4a659c640 1 -- 172.21.15.123:0/1336511486 learned_addr learned my addr 172.21.15.123:0/1336511486 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:19.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.944+0000 7fc4a6d9d640 1 -- 172.21.15.123:0/1336511486 >> v1:172.21.15.188:6789/0 conn(0x7fc4a80cce30 legacy=0x7fc4a8071c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:19.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.944+0000 7fc4a6d9d640 1 -- 172.21.15.123:0/1336511486 >> v1:172.21.15.123:6789/0 conn(0x7fc4a80732e0 legacy=0x7fc4a80736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:19.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.944+0000 7fc4a559a640 1 -- 172.21.15.123:0/1336511486 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3546923487 0 0) 0x7fc4a80714b0 con 0x7fc4a80732e0 2024-09-15T23:22:19.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.944+0000 7fc4a6d9d640 1 -- 172.21.15.123:0/1336511486 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4a80cde40 con 0x7fc4a80cd2a0 2024-09-15T23:22:19.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.945+0000 7fc4a6d9d640 1 --2- 172.21.15.123:0/1336511486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4a80cd2a0 0x7fc4a815c8d0 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7fc4980097a0 tx=0x7fc49802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=defa285576f6de6c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:19.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.945+0000 7fc4a559a640 1 -- 172.21.15.123:0/1336511486 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc498037070 con 0x7fc4a80cd2a0 2024-09-15T23:22:19.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.945+0000 7fc4a559a640 1 -- 172.21.15.123:0/1336511486 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc49802ae50 con 0x7fc4a80cd2a0 2024-09-15T23:22:19.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.945+0000 7fc4a559a640 1 -- 172.21.15.123:0/1336511486 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc498032660 con 0x7fc4a80cd2a0 2024-09-15T23:22:19.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.945+0000 7fc4aca8d640 1 -- 172.21.15.123:0/1336511486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4a80cd2a0 msgr2=0x7fc4a815c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:19.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.945+0000 7fc4aca8d640 1 --2- 172.21.15.123:0/1336511486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4a80cd2a0 0x7fc4a815c8d0 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7fc4980097a0 tx=0x7fc49802a140 comp rx=0 tx=0).stop 2024-09-15T23:22:19.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.945+0000 7fc4aca8d640 1 -- 172.21.15.123:0/1336511486 shutdown_connections 2024-09-15T23:22:19.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.945+0000 7fc4aca8d640 1 --2- 172.21.15.123:0/1336511486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4a80cd2a0 0x7fc4a815c8d0 unknown :-1 s=CLOSED pgs=2043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:19.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.945+0000 7fc4aca8d640 1 -- 172.21.15.123:0/1336511486 >> 172.21.15.123:0/1336511486 conn(0x7fc4a806d0f0 msgr2=0x7fc4a806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:19.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.945+0000 7fc4aca8d640 1 -- 172.21.15.123:0/1336511486 shutdown_connections 2024-09-15T23:22:19.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.945+0000 7fc4aca8d640 1 -- 172.21.15.123:0/1336511486 wait complete. 2024-09-15T23:22:19.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.947+0000 7fc4aca8d640 1 Processor -- start 2024-09-15T23:22:19.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.947+0000 7fc4aca8d640 1 -- start start 2024-09-15T23:22:19.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.947+0000 7fc4aca8d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4a80732e0 0x7fc4a8152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:19.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.947+0000 7fc4aca8d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4a80cce30 0x7fc4a8159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:19.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.947+0000 7fc4aca8d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4a80cd2a0 0x7fc4a8157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:19.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.947+0000 7fc4aca8d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a8072500 con 0x7fc4a80cce30 2024-09-15T23:22:19.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.947+0000 7fc4aca8d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a8072380 con 0x7fc4a80cd2a0 2024-09-15T23:22:19.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.947+0000 7fc4aca8d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc4a815ce10 con 0x7fc4a80732e0 2024-09-15T23:22:19.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.948+0000 7fc4a5d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4a80cce30 0x7fc4a8159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:19.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.948+0000 7fc4a5d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4a80cce30 0x7fc4a8159870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54926/0 (socket says 172.21.15.123:54926) 2024-09-15T23:22:19.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.948+0000 7fc4a5d9b640 1 -- 172.21.15.123:0/1518604626 learned_addr learned my addr 172.21.15.123:0/1518604626 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:19.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.948+0000 7fc4a659c640 1 --2- 172.21.15.123:0/1518604626 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4a80732e0 0x7fc4a8152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:19.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.948+0000 7fc4a6d9d640 1 --2- 172.21.15.123:0/1518604626 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4a80cd2a0 0x7fc4a8157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:19.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.948+0000 7fc4a5d9b640 1 -- 172.21.15.123:0/1518604626 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4a80732e0 msgr2=0x7fc4a8152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:19.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.948+0000 7fc4a5d9b640 1 --2- 172.21.15.123:0/1518604626 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4a80732e0 0x7fc4a8152400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:19.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.948+0000 7fc4a5d9b640 1 -- 172.21.15.123:0/1518604626 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4a80cd2a0 msgr2=0x7fc4a8157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:19.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.948+0000 7fc4a5d9b640 1 --2- 172.21.15.123:0/1518604626 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4a80cd2a0 0x7fc4a8157c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:19.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.948+0000 7fc4a5d9b640 1 -- 172.21.15.123:0/1518604626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4a8156bb0 con 0x7fc4a80cce30 2024-09-15T23:22:19.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.948+0000 7fc4a5d9b640 1 --2- 172.21.15.123:0/1518604626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4a80cce30 0x7fc4a8159870 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7fc49000c430 tx=0x7fc49000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:19.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.948+0000 7fc49effd640 1 -- 172.21.15.123:0/1518604626 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc490011790 con 0x7fc4a80cce30 2024-09-15T23:22:19.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.948+0000 7fc49effd640 1 -- 172.21.15.123:0/1518604626 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc490017070 con 0x7fc4a80cce30 2024-09-15T23:22:19.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.948+0000 7fc4aca8d640 1 -- 172.21.15.123:0/1518604626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4a8156e90 con 0x7fc4a80cce30 2024-09-15T23:22:19.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.948+0000 7fc49effd640 1 -- 172.21.15.123:0/1518604626 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc490011bb0 con 0x7fc4a80cce30 2024-09-15T23:22:19.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.948+0000 7fc4aca8d640 1 -- 172.21.15.123:0/1518604626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4a8157450 con 0x7fc4a80cce30 2024-09-15T23:22:19.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.949+0000 7fc4aca8d640 1 -- 172.21.15.123:0/1518604626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4a80c6070 con 0x7fc4a80cce30 2024-09-15T23:22:19.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.950+0000 7fc49effd640 1 -- 172.21.15.123:0/1518604626 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc49001c460 con 0x7fc4a80cce30 2024-09-15T23:22:19.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.950+0000 7fc49effd640 1 --2- 172.21.15.123:0/1518604626 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc48806c2b0 0x7fc48806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:19.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.951+0000 7fc49effd640 1 -- 172.21.15.123:0/1518604626 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 5029+0+0 (secure 0 0 0) 0x7fc49008b090 con 0x7fc4a80cce30 2024-09-15T23:22:19.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.951+0000 7fc4a659c640 1 --2- 172.21.15.123:0/1518604626 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc48806c2b0 0x7fc48806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:19.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.951+0000 7fc4a659c640 1 --2- 172.21.15.123:0/1518604626 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc48806c2b0 0x7fc48806e770 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fc4a00012e0 tx=0x7fc4a0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:19.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:19.955+0000 7fc49effd640 1 -- 172.21.15.123:0/1518604626 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc490059aa0 con 0x7fc4a80cce30 2024-09-15T23:22:20.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.121+0000 7fc4aca8d640 1 -- 172.21.15.123:0/1518604626 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc4a80711f0 con 0x7fc4a80cce30 2024-09-15T23:22:20.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.122+0000 7fc49effd640 1 -- 172.21.15.123:0/1518604626 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v174) ==== 93+0+10 (secure 0 0 0) 0x7fc4900593a0 con 0x7fc4a80cce30 2024-09-15T23:22:20.124 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-15T23:22:20.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.123+0000 7fc4aca8d640 1 -- 172.21.15.123:0/1518604626 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc48806c2b0 msgr2=0x7fc48806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:20.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.123+0000 7fc4aca8d640 1 --2- 172.21.15.123:0/1518604626 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc48806c2b0 0x7fc48806e770 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fc4a00012e0 tx=0x7fc4a0009040 comp rx=0 tx=0).stop 2024-09-15T23:22:20.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.123+0000 7fc4aca8d640 1 -- 172.21.15.123:0/1518604626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4a80cce30 msgr2=0x7fc4a8159870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:20.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.123+0000 7fc4aca8d640 1 --2- 172.21.15.123:0/1518604626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4a80cce30 0x7fc4a8159870 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7fc49000c430 tx=0x7fc49000c8f0 comp rx=0 tx=0).stop 2024-09-15T23:22:20.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.123+0000 7fc4aca8d640 1 -- 172.21.15.123:0/1518604626 shutdown_connections 2024-09-15T23:22:20.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.123+0000 7fc4aca8d640 1 --2- 172.21.15.123:0/1518604626 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4a80cd2a0 0x7fc4a8157c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:20.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.124+0000 7fc4aca8d640 1 --2- 172.21.15.123:0/1518604626 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc48806c2b0 0x7fc48806e770 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:20.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.124+0000 7fc4aca8d640 1 --2- 172.21.15.123:0/1518604626 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4a80cce30 0x7fc4a8159870 unknown :-1 s=CLOSED pgs=2044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:20.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.124+0000 7fc4aca8d640 1 --2- 172.21.15.123:0/1518604626 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc4a80732e0 0x7fc4a8152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:20.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.124+0000 7fc4aca8d640 1 -- 172.21.15.123:0/1518604626 >> 172.21.15.123:0/1518604626 conn(0x7fc4a806d0f0 msgr2=0x7fc4a806c040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:20.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.124+0000 7fc4aca8d640 1 -- 172.21.15.123:0/1518604626 shutdown_connections 2024-09-15T23:22:20.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.124+0000 7fc4aca8d640 1 -- 172.21.15.123:0/1518604626 wait complete. 2024-09-15T23:22:20.137 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive' 2024-09-15T23:22:20.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.233+0000 7f85bbf18640 1 Processor -- start 2024-09-15T23:22:20.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.233+0000 7f85bbf18640 1 -- start start 2024-09-15T23:22:20.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.234+0000 7f85bbf18640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f85b40b2d40 0x7f85b406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:20.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.234+0000 7f85bbf18640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85b413eb20 0x7f85b406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:20.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.234+0000 7f85bbf18640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85b4071180 con 0x7f85b415bcf0 2024-09-15T23:22:20.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.234+0000 7f85bbf18640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f85b4071ab0 con 0x7f85b40b2d40 2024-09-15T23:22:20.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.234+0000 7f85bbf18640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f85b4071460 con 0x7f85b413eb20 2024-09-15T23:22:20.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.234+0000 7f85b9cb4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f85b40b2d40 0x7f85b406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:20.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.234+0000 7f85b9cb4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f85b40b2d40 0x7f85b406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54936/0 (socket says 172.21.15.123:54936) 2024-09-15T23:22:20.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.234+0000 7f85b9cb4640 1 -- 172.21.15.123:0/152644426 learned_addr learned my addr 172.21.15.123:0/152644426 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:20.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.234+0000 7f85b9cb4640 1 -- 172.21.15.123:0/152644426 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85b413eb20 msgr2=0x7f85b406c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:20.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.234+0000 7f85b9cb4640 1 --2- 172.21.15.123:0/152644426 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85b413eb20 0x7f85b406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:20.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.234+0000 7f85b9cb4640 1 -- 172.21.15.123:0/152644426 >> v1:172.21.15.188:6789/0 conn(0x7f85b415bcf0 legacy=0x7f85b415c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:20.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.234+0000 7f85b9cb4640 1 -- 172.21.15.123:0/152644426 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85b4071740 con 0x7f85b40b2d40 2024-09-15T23:22:20.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.235+0000 7f85b9cb4640 1 --2- 172.21.15.123:0/152644426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85b40b2d40 0x7f85b406bc10 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f85b4071c30 tx=0x7f85b002a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74fca2239800c901 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:20.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.235+0000 7f85b8cb2640 1 -- 172.21.15.123:0/152644426 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b0037070 con 0x7f85b40b2d40 2024-09-15T23:22:20.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.235+0000 7f85b8cb2640 1 -- 172.21.15.123:0/152644426 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85b0032440 con 0x7f85b40b2d40 2024-09-15T23:22:20.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.235+0000 7f85b8cb2640 1 -- 172.21.15.123:0/152644426 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85b0032810 con 0x7f85b40b2d40 2024-09-15T23:22:20.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.235+0000 7f85bbf18640 1 -- 172.21.15.123:0/152644426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85b40b2d40 msgr2=0x7f85b406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:20.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.235+0000 7f85bbf18640 1 --2- 172.21.15.123:0/152644426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85b40b2d40 0x7f85b406bc10 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f85b4071c30 tx=0x7f85b002a200 comp rx=0 tx=0).stop 2024-09-15T23:22:20.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.236+0000 7f85bbf18640 1 -- 172.21.15.123:0/152644426 shutdown_connections 2024-09-15T23:22:20.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.236+0000 7f85bbf18640 1 --2- 172.21.15.123:0/152644426 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85b413eb20 0x7f85b406c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:20.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.236+0000 7f85bbf18640 1 --2- 172.21.15.123:0/152644426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85b40b2d40 0x7f85b406bc10 unknown :-1 s=CLOSED pgs=2045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:20.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.236+0000 7f85bbf18640 1 -- 172.21.15.123:0/152644426 >> 172.21.15.123:0/152644426 conn(0x7f85b40ccec0 msgr2=0x7f85b40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:20.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.236+0000 7f85bbf18640 1 -- 172.21.15.123:0/152644426 shutdown_connections 2024-09-15T23:22:20.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.236+0000 7f85bbf18640 1 -- 172.21.15.123:0/152644426 wait complete. 2024-09-15T23:22:20.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.237+0000 7f85bbf18640 1 Processor -- start 2024-09-15T23:22:20.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.237+0000 7f85bbf18640 1 -- start start 2024-09-15T23:22:20.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.237+0000 7f85bbf18640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85b40b2d40 0x7f85b413ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:20.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.237+0000 7f85bbf18640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85b413eb20 0x7f85b4144250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:20.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.237+0000 7f85bbf18640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85b415bcf0 0x7f85b4144790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:20.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.238+0000 7f85bbf18640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f85b40722d0 con 0x7f85b415bcf0 2024-09-15T23:22:20.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.238+0000 7f85bbf18640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f85b4072150 con 0x7f85b413eb20 2024-09-15T23:22:20.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.238+0000 7f85bbf18640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f85b4072450 con 0x7f85b40b2d40 2024-09-15T23:22:20.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.238+0000 7f85ba4b5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85b415bcf0 0x7f85b4144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:20.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.238+0000 7f85ba4b5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85b415bcf0 0x7f85b4144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54940/0 (socket says 172.21.15.123:54940) 2024-09-15T23:22:20.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.238+0000 7f85ba4b5640 1 -- 172.21.15.123:0/2988021451 learned_addr learned my addr 172.21.15.123:0/2988021451 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:20.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.238+0000 7f85b9cb4640 1 --2- 172.21.15.123:0/2988021451 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85b40b2d40 0x7f85b413ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:20.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.238+0000 7f85b94b3640 1 --2- 172.21.15.123:0/2988021451 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85b413eb20 0x7f85b4144250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:20.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.238+0000 7f85ba4b5640 1 -- 172.21.15.123:0/2988021451 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85b40b2d40 msgr2=0x7f85b413ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:20.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.238+0000 7f85ba4b5640 1 --2- 172.21.15.123:0/2988021451 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85b40b2d40 0x7f85b413ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:20.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.238+0000 7f85ba4b5640 1 -- 172.21.15.123:0/2988021451 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85b413eb20 msgr2=0x7f85b4144250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:20.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.238+0000 7f85ba4b5640 1 --2- 172.21.15.123:0/2988021451 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85b413eb20 0x7f85b4144250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:20.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.238+0000 7f85ba4b5640 1 -- 172.21.15.123:0/2988021451 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85b4168360 con 0x7f85b415bcf0 2024-09-15T23:22:20.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.238+0000 7f85b9cb4640 1 --2- 172.21.15.123:0/2988021451 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85b40b2d40 0x7f85b413ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:20.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.238+0000 7f85b94b3640 1 --2- 172.21.15.123:0/2988021451 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85b413eb20 0x7f85b4144250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:20.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.238+0000 7f85ba4b5640 1 --2- 172.21.15.123:0/2988021451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85b415bcf0 0x7f85b4144790 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7f85ac00b970 tx=0x7f85ac00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:20.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.238+0000 7f85aa7fc640 1 -- 172.21.15.123:0/2988021451 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac019070 con 0x7f85b415bcf0 2024-09-15T23:22:20.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.238+0000 7f85aa7fc640 1 -- 172.21.15.123:0/2988021451 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85ac00cb40 con 0x7f85b415bcf0 2024-09-15T23:22:20.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.238+0000 7f85bbf18640 1 -- 172.21.15.123:0/2988021451 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85b413a820 con 0x7f85b415bcf0 2024-09-15T23:22:20.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.238+0000 7f85aa7fc640 1 -- 172.21.15.123:0/2988021451 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac014440 con 0x7f85b415bcf0 2024-09-15T23:22:20.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.238+0000 7f85bbf18640 1 -- 172.21.15.123:0/2988021451 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85b413ade0 con 0x7f85b415bcf0 2024-09-15T23:22:20.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.239+0000 7f85bbf18640 1 -- 172.21.15.123:0/2988021451 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85b4072920 con 0x7f85b415bcf0 2024-09-15T23:22:20.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.240+0000 7f85aa7fc640 1 -- 172.21.15.123:0/2988021451 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f85ac01c070 con 0x7f85b415bcf0 2024-09-15T23:22:20.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.240+0000 7f85aa7fc640 1 --2- 172.21.15.123:0/2988021451 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f859806c2b0 0x7f859806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:20.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.240+0000 7f85aa7fc640 1 -- 172.21.15.123:0/2988021451 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 5029+0+0 (secure 0 0 0) 0x7f85ac08ad60 con 0x7f85b415bcf0 2024-09-15T23:22:20.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.241+0000 7f85b9cb4640 1 --2- 172.21.15.123:0/2988021451 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f859806c2b0 0x7f859806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:20.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.241+0000 7f85b9cb4640 1 --2- 172.21.15.123:0/2988021451 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f859806c2b0 0x7f859806e770 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f85b0034000 tx=0x7f85b002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:20.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.245+0000 7f85aa7fc640 1 -- 172.21.15.123:0/2988021451 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f85b4168360 con 0x7f85b415bcf0 2024-09-15T23:22:20.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.474+0000 7f85bbf18640 1 -- 172.21.15.123:0/2988021451 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]} v 0) -- 0x7f85b40cf7b0 con 0x7f85b415bcf0 2024-09-15T23:22:20.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.540+0000 7f85aa7fc640 1 -- 172.21.15.123:0/2988021451 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]}]=0 v503) ==== 162+0+0 (secure 0 0 0) 0x7f85ac059800 con 0x7f85b415bcf0 2024-09-15T23:22:20.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.543+0000 7f85bbf18640 1 -- 172.21.15.123:0/2988021451 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f859806c2b0 msgr2=0x7f859806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:20.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.543+0000 7f85bbf18640 1 --2- 172.21.15.123:0/2988021451 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f859806c2b0 0x7f859806e770 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f85b0034000 tx=0x7f85b002e000 comp rx=0 tx=0).stop 2024-09-15T23:22:20.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.543+0000 7f85bbf18640 1 -- 172.21.15.123:0/2988021451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85b415bcf0 msgr2=0x7f85b4144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:20.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.543+0000 7f85bbf18640 1 --2- 172.21.15.123:0/2988021451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85b415bcf0 0x7f85b4144790 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7f85ac00b970 tx=0x7f85ac00be30 comp rx=0 tx=0).stop 2024-09-15T23:22:20.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.543+0000 7f85bbf18640 1 -- 172.21.15.123:0/2988021451 shutdown_connections 2024-09-15T23:22:20.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.543+0000 7f85bbf18640 1 --2- 172.21.15.123:0/2988021451 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f859806c2b0 0x7f859806e770 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:20.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.543+0000 7f85bbf18640 1 --2- 172.21.15.123:0/2988021451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85b415bcf0 0x7f85b4144790 unknown :-1 s=CLOSED pgs=2046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:20.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.543+0000 7f85bbf18640 1 --2- 172.21.15.123:0/2988021451 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85b413eb20 0x7f85b4144250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:20.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.543+0000 7f85bbf18640 1 --2- 172.21.15.123:0/2988021451 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85b40b2d40 0x7f85b413ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:20.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.543+0000 7f85bbf18640 1 -- 172.21.15.123:0/2988021451 >> 172.21.15.123:0/2988021451 conn(0x7f85b40ccec0 msgr2=0x7f85b413efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:20.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.543+0000 7f85bbf18640 1 -- 172.21.15.123:0/2988021451 shutdown_connections 2024-09-15T23:22:20.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.543+0000 7f85bbf18640 1 -- 172.21.15.123:0/2988021451 wait complete. 2024-09-15T23:22:20.556 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T23:22:20.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.654+0000 7fa768b42640 1 Processor -- start 2024-09-15T23:22:20.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.654+0000 7fa768b42640 1 -- start start 2024-09-15T23:22:20.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.655+0000 7fa768b42640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa7640b3350 0x7fa7640d2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:20.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.655+0000 7fa768b42640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7640b38a0 0x7fa7640d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:20.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.655+0000 7fa768b42640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7640cf710 con 0x7fa76406bfd0 2024-09-15T23:22:20.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.655+0000 7fa768b42640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fa7640b78a0 con 0x7fa7640b3350 2024-09-15T23:22:20.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.655+0000 7fa768b42640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa7640cffb0 con 0x7fa7640b38a0 2024-09-15T23:22:20.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.656+0000 7fa761d9b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa7640b3350 0x7fa7640d2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:20.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.656+0000 7fa76259c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa76406bfd0 0x7fa76406c3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59148/0 (socket says 172.21.15.123:59148) 2024-09-15T23:22:20.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.656+0000 7fa76259c640 1 -- 172.21.15.123:0/4063679156 learned_addr learned my addr 172.21.15.123:0/4063679156 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:20.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.656+0000 7fa762d9d640 1 --2- 172.21.15.123:0/4063679156 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7640b38a0 0x7fa7640d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:20.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.656+0000 7fa761d9b640 1 -- 172.21.15.123:0/4063679156 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7640b38a0 msgr2=0x7fa7640d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:20.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.656+0000 7fa761d9b640 1 --2- 172.21.15.123:0/4063679156 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7640b38a0 0x7fa7640d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:20.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.656+0000 7fa761d9b640 1 -- 172.21.15.123:0/4063679156 >> v1:172.21.15.123:6789/0 conn(0x7fa76406bfd0 legacy=0x7fa76406c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:20.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.656+0000 7fa761d9b640 1 -- 172.21.15.123:0/4063679156 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7640cf9f0 con 0x7fa7640b3350 2024-09-15T23:22:20.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.656+0000 7fa76159a640 1 -- 172.21.15.123:0/4063679156 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3415537589 0 0) 0x7fa7640cf710 con 0x7fa76406bfd0 2024-09-15T23:22:20.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.656+0000 7fa762d9d640 1 --2- 172.21.15.123:0/4063679156 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7640b38a0 0x7fa7640d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:22:20.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.657+0000 7fa761d9b640 1 --2- 172.21.15.123:0/4063679156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7640b3350 0x7fa7640d2920 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7fa7580097a0 tx=0x7fa75802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e91b5f8de3d30a4b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:20.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.657+0000 7fa76159a640 1 -- 172.21.15.123:0/4063679156 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa758037070 con 0x7fa7640b3350 2024-09-15T23:22:20.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.657+0000 7fa76159a640 1 -- 172.21.15.123:0/4063679156 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa758032440 con 0x7fa7640b3350 2024-09-15T23:22:20.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.657+0000 7fa76159a640 1 -- 172.21.15.123:0/4063679156 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa758032810 con 0x7fa7640b3350 2024-09-15T23:22:20.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.657+0000 7fa768b42640 1 -- 172.21.15.123:0/4063679156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7640b3350 msgr2=0x7fa7640d2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:20.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.657+0000 7fa768b42640 1 --2- 172.21.15.123:0/4063679156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7640b3350 0x7fa7640d2920 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7fa7580097a0 tx=0x7fa75802a210 comp rx=0 tx=0).stop 2024-09-15T23:22:20.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.657+0000 7fa768b42640 1 -- 172.21.15.123:0/4063679156 shutdown_connections 2024-09-15T23:22:20.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.657+0000 7fa768b42640 1 --2- 172.21.15.123:0/4063679156 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7640b38a0 0x7fa7640d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:20.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.657+0000 7fa768b42640 1 --2- 172.21.15.123:0/4063679156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7640b3350 0x7fa7640d2920 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:20.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.657+0000 7fa768b42640 1 -- 172.21.15.123:0/4063679156 >> 172.21.15.123:0/4063679156 conn(0x7fa7640d11c0 msgr2=0x7fa7640d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:20.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.657+0000 7fa768b42640 1 -- 172.21.15.123:0/4063679156 shutdown_connections 2024-09-15T23:22:20.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.657+0000 7fa768b42640 1 -- 172.21.15.123:0/4063679156 wait complete. 2024-09-15T23:22:20.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.659+0000 7fa768b42640 1 Processor -- start 2024-09-15T23:22:20.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.659+0000 7fa768b42640 1 -- start start 2024-09-15T23:22:20.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.659+0000 7fa768b42640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa76406bfd0 0x7fa7640b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:20.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.659+0000 7fa768b42640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7640b3350 0x7fa7640b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:20.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.659+0000 7fa768b42640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7640b38a0 0x7fa7640b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:20.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.659+0000 7fa768b42640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa76406cd50 con 0x7fa7640b38a0 2024-09-15T23:22:20.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.659+0000 7fa768b42640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa7640d2400 con 0x7fa76406bfd0 2024-09-15T23:22:20.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.659+0000 7fa768b42640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa76415eae0 con 0x7fa7640b3350 2024-09-15T23:22:20.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.659+0000 7fa762d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7640b38a0 0x7fa7640b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:20.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.660+0000 7fa762d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7640b38a0 0x7fa7640b45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54960/0 (socket says 172.21.15.123:54960) 2024-09-15T23:22:20.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.660+0000 7fa762d9d640 1 -- 172.21.15.123:0/2304751888 learned_addr learned my addr 172.21.15.123:0/2304751888 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:20.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.660+0000 7fa761d9b640 1 --2- 172.21.15.123:0/2304751888 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7640b3350 0x7fa7640b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:20.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.660+0000 7fa76259c640 1 --2- 172.21.15.123:0/2304751888 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa76406bfd0 0x7fa7640b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:20.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.660+0000 7fa762d9d640 1 -- 172.21.15.123:0/2304751888 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7640b3350 msgr2=0x7fa7640b40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:20.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.660+0000 7fa762d9d640 1 --2- 172.21.15.123:0/2304751888 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7640b3350 0x7fa7640b40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:20.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.660+0000 7fa762d9d640 1 -- 172.21.15.123:0/2304751888 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa76406bfd0 msgr2=0x7fa7640b52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:20.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.660+0000 7fa762d9d640 1 --2- 172.21.15.123:0/2304751888 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa76406bfd0 0x7fa7640b52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:20.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.660+0000 7fa762d9d640 1 -- 172.21.15.123:0/2304751888 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa764159c30 con 0x7fa7640b38a0 2024-09-15T23:22:20.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.660+0000 7fa76259c640 1 --2- 172.21.15.123:0/2304751888 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa76406bfd0 0x7fa7640b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:20.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.660+0000 7fa762d9d640 1 --2- 172.21.15.123:0/2304751888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7640b38a0 0x7fa7640b45e0 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00cd50 tx=0x7fa75c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:20.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.660+0000 7fa752ffd640 1 -- 172.21.15.123:0/2304751888 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75c00f680 con 0x7fa7640b38a0 2024-09-15T23:22:20.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.660+0000 7fa752ffd640 1 -- 172.21.15.123:0/2304751888 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa75c00f840 con 0x7fa7640b38a0 2024-09-15T23:22:20.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.660+0000 7fa768b42640 1 -- 172.21.15.123:0/2304751888 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa764159f10 con 0x7fa7640b38a0 2024-09-15T23:22:20.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.660+0000 7fa752ffd640 1 -- 172.21.15.123:0/2304751888 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75c00fc30 con 0x7fa7640b38a0 2024-09-15T23:22:20.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.660+0000 7fa768b42640 1 -- 172.21.15.123:0/2304751888 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa76415a4d0 con 0x7fa7640b38a0 2024-09-15T23:22:20.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.661+0000 7fa768b42640 1 -- 172.21.15.123:0/2304751888 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa76406c3b0 con 0x7fa7640b38a0 2024-09-15T23:22:20.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.662+0000 7fa752ffd640 1 -- 172.21.15.123:0/2304751888 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa75c0213f0 con 0x7fa7640b38a0 2024-09-15T23:22:20.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.662+0000 7fa752ffd640 1 --2- 172.21.15.123:0/2304751888 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa74406c2e0 0x7fa74406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:20.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.662+0000 7fa752ffd640 1 -- 172.21.15.123:0/2304751888 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 5029+0+0 (secure 0 0 0) 0x7fa75c08bee0 con 0x7fa7640b38a0 2024-09-15T23:22:20.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.662+0000 7fa76259c640 1 --2- 172.21.15.123:0/2304751888 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa74406c2e0 0x7fa74406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:20.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.663+0000 7fa76259c640 1 --2- 172.21.15.123:0/2304751888 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa74406c2e0 0x7fa74406e7a0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fa754000f60 tx=0x7fa754007c10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:20.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.666+0000 7fa752ffd640 1 -- 172.21.15.123:0/2304751888 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa75c014030 con 0x7fa7640b38a0 2024-09-15T23:22:20.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.832+0000 7fa768b42640 1 -- 172.21.15.123:0/2304751888 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fa7640d0cf0 con 0x7fa7640b38a0 2024-09-15T23:22:20.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.835+0000 7fa752ffd640 1 -- 172.21.15.123:0/2304751888 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v44)=0 v44) ==== 122+0+0 (secure 0 0 0) 0x7fa75c05a8f0 con 0x7fa7640b38a0 2024-09-15T23:22:20.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.837+0000 7fa768b42640 1 -- 172.21.15.123:0/2304751888 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa74406c2e0 msgr2=0x7fa74406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:20.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.837+0000 7fa768b42640 1 --2- 172.21.15.123:0/2304751888 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa74406c2e0 0x7fa74406e7a0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fa754000f60 tx=0x7fa754007c10 comp rx=0 tx=0).stop 2024-09-15T23:22:20.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.837+0000 7fa768b42640 1 -- 172.21.15.123:0/2304751888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7640b38a0 msgr2=0x7fa7640b45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:20.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.837+0000 7fa768b42640 1 --2- 172.21.15.123:0/2304751888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7640b38a0 0x7fa7640b45e0 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00cd50 tx=0x7fa75c00a650 comp rx=0 tx=0).stop 2024-09-15T23:22:20.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.837+0000 7fa768b42640 1 -- 172.21.15.123:0/2304751888 shutdown_connections 2024-09-15T23:22:20.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.837+0000 7fa768b42640 1 --2- 172.21.15.123:0/2304751888 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa74406c2e0 0x7fa74406e7a0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:20.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.837+0000 7fa768b42640 1 --2- 172.21.15.123:0/2304751888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7640b38a0 0x7fa7640b45e0 unknown :-1 s=CLOSED pgs=2049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:20.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.837+0000 7fa768b42640 1 --2- 172.21.15.123:0/2304751888 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7640b3350 0x7fa7640b40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:20.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.837+0000 7fa768b42640 1 --2- 172.21.15.123:0/2304751888 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa76406bfd0 0x7fa7640b52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:20.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.837+0000 7fa768b42640 1 -- 172.21.15.123:0/2304751888 >> 172.21.15.123:0/2304751888 conn(0x7fa7640d11c0 msgr2=0x7fa76406c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:20.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.837+0000 7fa768b42640 1 -- 172.21.15.123:0/2304751888 shutdown_connections 2024-09-15T23:22:20.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:20.837+0000 7fa768b42640 1 -- 172.21.15.123:0/2304751888 wait complete. 2024-09-15T23:22:20.851 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:22:20.851 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:22:20.888 DEBUG:teuthology.orchestra.run.smithi188:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:22:20.935 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:22:20.935 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:22:20.935 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:22:20.951 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:22:20.951 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:22:20.951 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:22:20.969 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:22:20.969 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:22:20.969 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:22:21.006 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:22:21.007 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:22:21.007 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:22:21.028 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:22:21.028 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-15T23:22:21.028 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:22:21.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.142+0000 7fbea7a53640 1 Processor -- start 2024-09-15T23:22:21.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.143+0000 7fbea7a53640 1 -- start start 2024-09-15T23:22:21.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.143+0000 7fbea7a53640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbea015ed20 0x7fbea00b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:21.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.143+0000 7fbea7a53640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fbea00d23b0 0x7fbea00b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:21.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.143+0000 7fbea7a53640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbea00cf2d0 0x7fbea00cf740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:21.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.143+0000 7fbea7a53640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fbea00d0e70 con 0x7fbea015ed20 2024-09-15T23:22:21.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.143+0000 7fbea7a53640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fbea00d41c0 con 0x7fbea00d23b0 2024-09-15T23:22:21.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.143+0000 7fbea7a53640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbea00d35b0 con 0x7fbea00cf2d0 2024-09-15T23:22:21.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.144+0000 7fbea57ef640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbea015ed20 0x7fbea00b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:21.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.144+0000 7fbea57ef640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbea015ed20 0x7fbea00b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54970/0 (socket says 172.21.15.123:54970) 2024-09-15T23:22:21.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.144+0000 7fbea57ef640 1 -- 172.21.15.123:0/3557092448 learned_addr learned my addr 172.21.15.123:0/3557092448 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:21.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.144+0000 7fbea5ff0640 1 --2- 172.21.15.123:0/3557092448 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbea00cf2d0 0x7fbea00cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:21.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.144+0000 7fbea57ef640 1 -- 172.21.15.123:0/3557092448 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbea00cf2d0 msgr2=0x7fbea00cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:21.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.144+0000 7fbea4fee640 1 --2- 172.21.15.123:0/3557092448 >> v2:172.21.15.188:3300/0 conn(0x7fbea00d23b0 0x7fbea00b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:21.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.144+0000 7fbea57ef640 1 --2- 172.21.15.123:0/3557092448 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbea00cf2d0 0x7fbea00cf740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:21.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.144+0000 7fbea57ef640 1 -- 172.21.15.123:0/3557092448 >> v2:172.21.15.188:3300/0 conn(0x7fbea00d23b0 msgr2=0x7fbea00b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:21.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.144+0000 7fbea57ef640 1 --2- 172.21.15.123:0/3557092448 >> v2:172.21.15.188:3300/0 conn(0x7fbea00d23b0 0x7fbea00b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:21.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.144+0000 7fbea57ef640 1 -- 172.21.15.123:0/3557092448 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea00d3890 con 0x7fbea015ed20 2024-09-15T23:22:21.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.144+0000 7fbea4fee640 1 --2- 172.21.15.123:0/3557092448 >> v2:172.21.15.188:3300/0 conn(0x7fbea00d23b0 0x7fbea00b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:22:21.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.145+0000 7fbea57ef640 1 --2- 172.21.15.123:0/3557092448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbea015ed20 0x7fbea00b6260 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7fbea00d4690 tx=0x7fbe9c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc3c1e766d035a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:21.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.145+0000 7fbe93fff640 1 -- 172.21.15.123:0/3557092448 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c037070 con 0x7fbea015ed20 2024-09-15T23:22:21.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.145+0000 7fbe93fff640 1 -- 172.21.15.123:0/3557092448 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe9c032440 con 0x7fbea015ed20 2024-09-15T23:22:21.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.145+0000 7fbe93fff640 1 -- 172.21.15.123:0/3557092448 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c032810 con 0x7fbea015ed20 2024-09-15T23:22:21.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.145+0000 7fbea7a53640 1 -- 172.21.15.123:0/3557092448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbea015ed20 msgr2=0x7fbea00b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:21.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.145+0000 7fbea7a53640 1 --2- 172.21.15.123:0/3557092448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbea015ed20 0x7fbea00b6260 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7fbea00d4690 tx=0x7fbe9c02a140 comp rx=0 tx=0).stop 2024-09-15T23:22:21.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.145+0000 7fbea7a53640 1 -- 172.21.15.123:0/3557092448 shutdown_connections 2024-09-15T23:22:21.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.145+0000 7fbea7a53640 1 --2- 172.21.15.123:0/3557092448 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbea00cf2d0 0x7fbea00cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:21.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.145+0000 7fbea7a53640 1 --2- 172.21.15.123:0/3557092448 >> v2:172.21.15.188:3300/0 conn(0x7fbea00d23b0 0x7fbea00b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:21.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.145+0000 7fbea7a53640 1 --2- 172.21.15.123:0/3557092448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbea015ed20 0x7fbea00b6260 unknown :-1 s=CLOSED pgs=2050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:21.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.145+0000 7fbea7a53640 1 -- 172.21.15.123:0/3557092448 >> 172.21.15.123:0/3557092448 conn(0x7fbea00d1260 msgr2=0x7fbea00d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:21.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.146+0000 7fbea7a53640 1 -- 172.21.15.123:0/3557092448 shutdown_connections 2024-09-15T23:22:21.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.146+0000 7fbea7a53640 1 -- 172.21.15.123:0/3557092448 wait complete. 2024-09-15T23:22:21.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.147+0000 7fbea7a53640 1 Processor -- start 2024-09-15T23:22:21.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.147+0000 7fbea7a53640 1 -- start start 2024-09-15T23:22:21.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.147+0000 7fbea7a53640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbea00cf2d0 0x7fbea01e8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:21.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.147+0000 7fbea7a53640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbea00d23b0 0x7fbea00c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:21.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.147+0000 7fbea7a53640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbea015ed20 0x7fbea015d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:21.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.147+0000 7fbea7a53640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbea00d32a0 con 0x7fbea015ed20 2024-09-15T23:22:21.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.147+0000 7fbea7a53640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbea00d3e50 con 0x7fbea00d23b0 2024-09-15T23:22:21.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.147+0000 7fbea7a53640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbea015f100 con 0x7fbea00cf2d0 2024-09-15T23:22:21.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.148+0000 7fbea5ff0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbea015ed20 0x7fbea015d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:21.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.148+0000 7fbea5ff0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbea015ed20 0x7fbea015d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54984/0 (socket says 172.21.15.123:54984) 2024-09-15T23:22:21.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.148+0000 7fbea5ff0640 1 -- 172.21.15.123:0/3634629505 learned_addr learned my addr 172.21.15.123:0/3634629505 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:21.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.148+0000 7fbea57ef640 1 --2- 172.21.15.123:0/3634629505 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbea00cf2d0 0x7fbea01e8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:21.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.148+0000 7fbea4fee640 1 --2- 172.21.15.123:0/3634629505 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbea00d23b0 0x7fbea00c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:21.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.148+0000 7fbea5ff0640 1 -- 172.21.15.123:0/3634629505 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbea00cf2d0 msgr2=0x7fbea01e8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:21.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.148+0000 7fbea5ff0640 1 --2- 172.21.15.123:0/3634629505 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbea00cf2d0 0x7fbea01e8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:21.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.148+0000 7fbea5ff0640 1 -- 172.21.15.123:0/3634629505 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbea00d23b0 msgr2=0x7fbea00c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:21.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.148+0000 7fbea5ff0640 1 --2- 172.21.15.123:0/3634629505 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbea00d23b0 0x7fbea00c8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:21.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.148+0000 7fbea5ff0640 1 -- 172.21.15.123:0/3634629505 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea01e8900 con 0x7fbea015ed20 2024-09-15T23:22:21.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.148+0000 7fbea4fee640 1 --2- 172.21.15.123:0/3634629505 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbea00d23b0 0x7fbea00c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:21.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.148+0000 7fbea5ff0640 1 --2- 172.21.15.123:0/3634629505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbea015ed20 0x7fbea015d910 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7fbe9800ccf0 tx=0x7fbe9800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:21.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.148+0000 7fbe91ffb640 1 -- 172.21.15.123:0/3634629505 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe98003b90 con 0x7fbea015ed20 2024-09-15T23:22:21.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.148+0000 7fbe91ffb640 1 -- 172.21.15.123:0/3634629505 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe98003d30 con 0x7fbea015ed20 2024-09-15T23:22:21.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.148+0000 7fbea7a53640 1 -- 172.21.15.123:0/3634629505 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbea01e8be0 con 0x7fbea015ed20 2024-09-15T23:22:21.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.148+0000 7fbe91ffb640 1 -- 172.21.15.123:0/3634629505 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe98004240 con 0x7fbea015ed20 2024-09-15T23:22:21.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.148+0000 7fbea7a53640 1 -- 172.21.15.123:0/3634629505 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbea01e91a0 con 0x7fbea015ed20 2024-09-15T23:22:21.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.149+0000 7fbea7a53640 1 -- 172.21.15.123:0/3634629505 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbea00b7010 con 0x7fbea015ed20 2024-09-15T23:22:21.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.150+0000 7fbe91ffb640 1 -- 172.21.15.123:0/3634629505 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbe980043e0 con 0x7fbea015ed20 2024-09-15T23:22:21.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.150+0000 7fbe91ffb640 1 --2- 172.21.15.123:0/3634629505 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbe8406c2b0 0x7fbe8406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:21.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.150+0000 7fbe91ffb640 1 -- 172.21.15.123:0/3634629505 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 5029+0+0 (secure 0 0 0) 0x7fbe9808bae0 con 0x7fbea015ed20 2024-09-15T23:22:21.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.150+0000 7fbea57ef640 1 --2- 172.21.15.123:0/3634629505 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbe8406c2b0 0x7fbe8406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:21.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.151+0000 7fbea57ef640 1 --2- 172.21.15.123:0/3634629505 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbe8406c2b0 0x7fbe8406e770 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c034000 tx=0x7fbe9c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:21.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.154+0000 7fbe91ffb640 1 -- 172.21.15.123:0/3634629505 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbe9805a580 con 0x7fbea015ed20 2024-09-15T23:22:21.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.354+0000 7fbea7a53640 1 -- 172.21.15.123:0/3634629505 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbea00b3f20 con 0x7fbea015ed20 2024-09-15T23:22:21.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.355+0000 7fbe91ffb640 1 -- 172.21.15.123:0/3634629505 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) ==== 95+0+3097 (secure 0 0 0) 0x7fbe98059e80 con 0x7fbea015ed20 2024-09-15T23:22:21.357 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:22:21.357 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":106,"btime":"2024-09-15T23:22:16:526312+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7214,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/1648353391","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1648353391},{"type":"v1","addr":"172.21.15.188:6837","nonce":1648353391}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":8122,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/1714717257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":1714717257},{"type":"v1","addr":"172.21.15.188:6836","nonce":1714717257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":9978,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/2519477924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2519477924},{"type":"v1","addr":"172.21.15.123:6833","nonce":2519477924}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":106}],"filesystems":[]} 2024-09-15T23:22:21.357 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 106 2024-09-15T23:22:21.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.357+0000 7fbea7a53640 1 -- 172.21.15.123:0/3634629505 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbe8406c2b0 msgr2=0x7fbe8406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:21.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.357+0000 7fbea7a53640 1 --2- 172.21.15.123:0/3634629505 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbe8406c2b0 0x7fbe8406e770 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c034000 tx=0x7fbe9c02e000 comp rx=0 tx=0).stop 2024-09-15T23:22:21.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.357+0000 7fbea7a53640 1 -- 172.21.15.123:0/3634629505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbea015ed20 msgr2=0x7fbea015d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:21.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.357+0000 7fbea7a53640 1 --2- 172.21.15.123:0/3634629505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbea015ed20 0x7fbea015d910 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7fbe9800ccf0 tx=0x7fbe9800a660 comp rx=0 tx=0).stop 2024-09-15T23:22:21.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.357+0000 7fbea7a53640 1 -- 172.21.15.123:0/3634629505 shutdown_connections 2024-09-15T23:22:21.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.357+0000 7fbea7a53640 1 --2- 172.21.15.123:0/3634629505 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbe8406c2b0 0x7fbe8406e770 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:21.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.357+0000 7fbea7a53640 1 --2- 172.21.15.123:0/3634629505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbea015ed20 0x7fbea015d910 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:21.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.357+0000 7fbea7a53640 1 --2- 172.21.15.123:0/3634629505 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbea00d23b0 0x7fbea00c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:21.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.357+0000 7fbea7a53640 1 --2- 172.21.15.123:0/3634629505 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbea00cf2d0 0x7fbea01e8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:21.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.357+0000 7fbea7a53640 1 -- 172.21.15.123:0/3634629505 >> 172.21.15.123:0/3634629505 conn(0x7fbea00d1260 msgr2=0x7fbea00cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:21.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.357+0000 7fbea7a53640 1 -- 172.21.15.123:0/3634629505 shutdown_connections 2024-09-15T23:22:21.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.357+0000 7fbea7a53640 1 -- 172.21.15.123:0/3634629505 wait complete. 2024-09-15T23:22:21.370 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T23:22:21.371 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T23:22:21.371 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T23:22:21.371 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T23:22:21.371 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T23:22:21.371 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:22:21.372 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T23:22:21.372 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T23:22:21.372 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T23:22:21.372 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:22:21.372 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T23:22:21.372 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T23:22:21.373 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T23:22:21.373 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:22:21.380 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T23:22:21.380 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T23:22:21.381 INFO:tasks.ceph.mds.a:Started 2024-09-15T23:22:21.381 DEBUG:teuthology.parallel:result is None 2024-09-15T23:22:21.384 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T23:22:21.384 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T23:22:21.385 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T23:22:21.385 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T23:22:21.424 INFO:tasks.ceph.mds.c:Started 2024-09-15T23:22:21.424 DEBUG:teuthology.parallel:result is None 2024-09-15T23:22:21.427 INFO:tasks.ceph.mds.d:Started 2024-09-15T23:22:21.428 DEBUG:teuthology.parallel:result is None 2024-09-15T23:22:21.428 INFO:tasks.ceph.mds.b:Started 2024-09-15T23:22:21.429 DEBUG:teuthology.parallel:result is None 2024-09-15T23:22:21.429 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T23:22:21.454 INFO:tasks.ceph.mds.a.smithi123.stdout:starting mds.a at 2024-09-15T23:22:21.501 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-15T23:22:21.513 INFO:tasks.ceph.mds.d.smithi188.stdout:starting mds.d at 2024-09-15T23:22:21.513 INFO:tasks.ceph.mds.b.smithi188.stdout:starting mds.b at 2024-09-15T23:22:21.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.532+0000 7f2f7f053640 1 Processor -- start 2024-09-15T23:22:21.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.532+0000 7f2f7f053640 1 -- start start 2024-09-15T23:22:21.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.533+0000 7f2f7f053640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2f780720b0 0x7f2f7806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:21.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.533+0000 7f2f7f053640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2f7815c1d0 0x7f2f7815c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:21.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.533+0000 7f2f7f053640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f78072520 con 0x7f2f7806c6a0 2024-09-15T23:22:21.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.533+0000 7f2f7f053640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f2f7806ca80 con 0x7f2f7815c1d0 2024-09-15T23:22:21.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.533+0000 7f2f7f053640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f2f78071010 con 0x7f2f780720b0 2024-09-15T23:22:21.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.533+0000 7f2f7d5f0640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2f7815c1d0 0x7f2f7815c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:21.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.533+0000 7f2f7d5f0640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2f7815c1d0 0x7f2f7815c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55038/0 (socket says 172.21.15.123:55038) 2024-09-15T23:22:21.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.533+0000 7f2f7d5f0640 1 -- 172.21.15.123:0/3318163870 learned_addr learned my addr 172.21.15.123:0/3318163870 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:21.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.533+0000 7f2f77fff640 1 --2- 172.21.15.123:0/3318163870 >> v2:172.21.15.188:3300/0 conn(0x7f2f780720b0 0x7f2f7806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:21.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.533+0000 7f2f7d5f0640 1 -- 172.21.15.123:0/3318163870 >> v2:172.21.15.188:3300/0 conn(0x7f2f780720b0 msgr2=0x7f2f7806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:21.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.533+0000 7f2f7d5f0640 1 --2- 172.21.15.123:0/3318163870 >> v2:172.21.15.188:3300/0 conn(0x7f2f780720b0 0x7f2f7806bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:21.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.533+0000 7f2f7d5f0640 1 -- 172.21.15.123:0/3318163870 >> v1:172.21.15.188:6789/0 conn(0x7f2f7806c6a0 legacy=0x7f2f78073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:21.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.533+0000 7f2f7d5f0640 1 -- 172.21.15.123:0/3318163870 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f780712f0 con 0x7f2f7815c1d0 2024-09-15T23:22:21.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.534+0000 7f2f7d5f0640 1 --2- 172.21.15.123:0/3318163870 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f7815c1d0 0x7f2f7815c620 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7f2f780cded0 tx=0x7f2f7002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a500b0050cff40 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:21.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.534+0000 7f2f777fe640 1 -- 172.21.15.123:0/3318163870 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f70036070 con 0x7f2f7815c1d0 2024-09-15T23:22:21.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.534+0000 7f2f777fe640 1 -- 172.21.15.123:0/3318163870 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f70031600 con 0x7f2f7815c1d0 2024-09-15T23:22:21.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.534+0000 7f2f777fe640 1 -- 172.21.15.123:0/3318163870 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f700319d0 con 0x7f2f7815c1d0 2024-09-15T23:22:21.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.535+0000 7f2f7f053640 1 -- 172.21.15.123:0/3318163870 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f7815c1d0 msgr2=0x7f2f7815c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:21.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.535+0000 7f2f7f053640 1 --2- 172.21.15.123:0/3318163870 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f7815c1d0 0x7f2f7815c620 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7f2f780cded0 tx=0x7f2f7002a660 comp rx=0 tx=0).stop 2024-09-15T23:22:21.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.535+0000 7f2f7f053640 1 -- 172.21.15.123:0/3318163870 shutdown_connections 2024-09-15T23:22:21.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.535+0000 7f2f7f053640 1 --2- 172.21.15.123:0/3318163870 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f7815c1d0 0x7f2f7815c620 unknown :-1 s=CLOSED pgs=2059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:21.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.535+0000 7f2f7f053640 1 --2- 172.21.15.123:0/3318163870 >> v2:172.21.15.188:3300/0 conn(0x7f2f780720b0 0x7f2f7806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:21.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.535+0000 7f2f7f053640 1 -- 172.21.15.123:0/3318163870 >> 172.21.15.123:0/3318163870 conn(0x7f2f780ccec0 msgr2=0x7f2f780cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:21.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.535+0000 7f2f7f053640 1 -- 172.21.15.123:0/3318163870 shutdown_connections 2024-09-15T23:22:21.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.535+0000 7f2f7f053640 1 -- 172.21.15.123:0/3318163870 wait complete. 2024-09-15T23:22:21.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.536+0000 7f2f7f053640 1 Processor -- start 2024-09-15T23:22:21.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.536+0000 7f2f7f053640 1 -- start start 2024-09-15T23:22:21.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.537+0000 7f2f7f053640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f7806c6a0 0x7f2f781555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:21.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.537+0000 7f2f7f053640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f780720b0 0x7f2f78156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:21.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.537+0000 7f2f7f053640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f7815c1d0 0x7f2f78156d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:21.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.537+0000 7f2f7f053640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7806c150 con 0x7f2f7815c1d0 2024-09-15T23:22:21.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.537+0000 7f2f7f053640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2f780718b0 con 0x7f2f780720b0 2024-09-15T23:22:21.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.537+0000 7f2f7f053640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f2f7806c2d0 con 0x7f2f7806c6a0 2024-09-15T23:22:21.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.537+0000 7f2f7d5f0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f7815c1d0 0x7f2f78156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:21.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.537+0000 7f2f7d5f0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f7815c1d0 0x7f2f78156d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55048/0 (socket says 172.21.15.123:55048) 2024-09-15T23:22:21.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.537+0000 7f2f7d5f0640 1 -- 172.21.15.123:0/3861242379 learned_addr learned my addr 172.21.15.123:0/3861242379 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:21.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.537+0000 7f2f77fff640 1 --2- 172.21.15.123:0/3861242379 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f780720b0 0x7f2f78156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:21.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.537+0000 7f2f7cdef640 1 --2- 172.21.15.123:0/3861242379 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f7806c6a0 0x7f2f781555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:21.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.537+0000 7f2f7d5f0640 1 -- 172.21.15.123:0/3861242379 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f7806c6a0 msgr2=0x7f2f781555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:21.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.537+0000 7f2f7d5f0640 1 --2- 172.21.15.123:0/3861242379 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f7806c6a0 0x7f2f781555c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:21.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.537+0000 7f2f7d5f0640 1 -- 172.21.15.123:0/3861242379 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f780720b0 msgr2=0x7f2f78156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:21.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.537+0000 7f2f7d5f0640 1 --2- 172.21.15.123:0/3861242379 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f780720b0 0x7f2f78156810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:21.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.537+0000 7f2f7d5f0640 1 -- 172.21.15.123:0/3861242379 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f78155f10 con 0x7f2f7815c1d0 2024-09-15T23:22:21.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.537+0000 7f2f7cdef640 1 --2- 172.21.15.123:0/3861242379 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f7806c6a0 0x7f2f781555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:22:21.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.538+0000 7f2f7d5f0640 1 --2- 172.21.15.123:0/3861242379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f7815c1d0 0x7f2f78156d50 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7f2f70009f40 tx=0x7f2f70004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:21.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.538+0000 7f2f757fa640 1 -- 172.21.15.123:0/3861242379 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f70036050 con 0x7f2f7815c1d0 2024-09-15T23:22:21.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.538+0000 7f2f757fa640 1 -- 172.21.15.123:0/3861242379 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f70042070 con 0x7f2f7815c1d0 2024-09-15T23:22:21.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.538+0000 7f2f7f053640 1 -- 172.21.15.123:0/3861242379 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f781561f0 con 0x7f2f7815c1d0 2024-09-15T23:22:21.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.538+0000 7f2f757fa640 1 -- 172.21.15.123:0/3861242379 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f70009510 con 0x7f2f7815c1d0 2024-09-15T23:22:21.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.538+0000 7f2f7f053640 1 -- 172.21.15.123:0/3861242379 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f7814f140 con 0x7f2f7815c1d0 2024-09-15T23:22:21.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.539+0000 7f2f7f053640 1 -- 172.21.15.123:0/3861242379 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f780b3cf0 con 0x7f2f7815c1d0 2024-09-15T23:22:21.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.540+0000 7f2f757fa640 1 -- 172.21.15.123:0/3861242379 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2f70007bd0 con 0x7f2f7815c1d0 2024-09-15T23:22:21.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.540+0000 7f2f757fa640 1 --2- 172.21.15.123:0/3861242379 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2f6406c2b0 0x7f2f6406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:21.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.540+0000 7f2f757fa640 1 -- 172.21.15.123:0/3861242379 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 5029+0+0 (secure 0 0 0) 0x7f2f700ac180 con 0x7f2f7815c1d0 2024-09-15T23:22:21.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.540+0000 7f2f7cdef640 1 --2- 172.21.15.123:0/3861242379 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2f6406c2b0 0x7f2f6406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:21.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.541+0000 7f2f7cdef640 1 --2- 172.21.15.123:0/3861242379 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2f6406c2b0 0x7f2f6406e770 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f2f6800a830 tx=0x7f2f68008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:21.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.544+0000 7f2f757fa640 1 -- 172.21.15.123:0/3861242379 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2f780b3cf0 con 0x7f2f7815c1d0 2024-09-15T23:22:21.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:21.724+0000 7f2f7f053640 1 -- 172.21.15.123:0/3861242379 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f2f7806bc10 con 0x7f2f7815c1d0 2024-09-15T23:22:22.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.554+0000 7f2f757fa640 1 -- 172.21.15.123:0/3861242379 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v178) ==== 97+0+0 (secure 0 0 0) 0x7f2f7007ab90 con 0x7f2f7815c1d0 2024-09-15T23:22:22.557 INFO:teuthology.orchestra.run.smithi123.stderr: removed all blocklist entries 2024-09-15T23:22:22.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.557+0000 7f2f7f053640 1 -- 172.21.15.123:0/3861242379 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2f6406c2b0 msgr2=0x7f2f6406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:22.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.557+0000 7f2f7f053640 1 --2- 172.21.15.123:0/3861242379 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2f6406c2b0 0x7f2f6406e770 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f2f6800a830 tx=0x7f2f68008040 comp rx=0 tx=0).stop 2024-09-15T23:22:22.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.558+0000 7f2f7f053640 1 -- 172.21.15.123:0/3861242379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f7815c1d0 msgr2=0x7f2f78156d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:22.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.558+0000 7f2f7f053640 1 --2- 172.21.15.123:0/3861242379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f7815c1d0 0x7f2f78156d50 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7f2f70009f40 tx=0x7f2f70004a40 comp rx=0 tx=0).stop 2024-09-15T23:22:22.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.558+0000 7f2f7f053640 1 -- 172.21.15.123:0/3861242379 shutdown_connections 2024-09-15T23:22:22.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.558+0000 7f2f7f053640 1 --2- 172.21.15.123:0/3861242379 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2f6406c2b0 0x7f2f6406e770 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:22.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.558+0000 7f2f7f053640 1 --2- 172.21.15.123:0/3861242379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f7815c1d0 0x7f2f78156d50 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:22.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.558+0000 7f2f7f053640 1 --2- 172.21.15.123:0/3861242379 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f780720b0 0x7f2f78156810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:22.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.558+0000 7f2f7f053640 1 --2- 172.21.15.123:0/3861242379 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f7806c6a0 0x7f2f781555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:22.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.558+0000 7f2f7f053640 1 -- 172.21.15.123:0/3861242379 >> 172.21.15.123:0/3861242379 conn(0x7f2f780ccec0 msgr2=0x7f2f780b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:22.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.558+0000 7f2f7f053640 1 -- 172.21.15.123:0/3861242379 shutdown_connections 2024-09-15T23:22:22.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.558+0000 7f2f7f053640 1 -- 172.21.15.123:0/3861242379 wait complete. 2024-09-15T23:22:22.573 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T23:22:22.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.716+0000 7f144930c640 1 Processor -- start 2024-09-15T23:22:22.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.716+0000 7f144930c640 1 -- start start 2024-09-15T23:22:22.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.717+0000 7f144930c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f144406c320 0x7f14440b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:22.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.717+0000 7f144930c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f14440b5100 0x7f14440b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:22.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.717+0000 7f144930c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14440b5770 con 0x7f1444148420 2024-09-15T23:22:22.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.717+0000 7f144930c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f14440b1070 con 0x7f144406c320 2024-09-15T23:22:22.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.717+0000 7f144930c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f14440b13e0 con 0x7f14440b5100 2024-09-15T23:22:22.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.718+0000 7f14427fc640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f144406c320 0x7f14440b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:22.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.718+0000 7f14437fe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f14440b5100 0x7f14440b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:22.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.718+0000 7f14427fc640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f144406c320 0x7f14440b4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:41578/0 (socket says 172.21.15.123:41578) 2024-09-15T23:22:22.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.718+0000 7f14437fe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f14440b5100 0x7f14440b1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:54554/0 (socket says 172.21.15.123:54554) 2024-09-15T23:22:22.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.718+0000 7f1442ffd640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f1444148420 0x7f144406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:36570/0 (socket says 172.21.15.123:36570) 2024-09-15T23:22:22.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.718+0000 7f14427fc640 1 -- 172.21.15.123:0/2666563577 learned_addr learned my addr 172.21.15.123:0/2666563577 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:22.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.718+0000 7f14427fc640 1 -- 172.21.15.123:0/2666563577 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f14440b5100 msgr2=0x7f14440b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:22.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.718+0000 7f14427fc640 1 --2- 172.21.15.123:0/2666563577 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f14440b5100 0x7f14440b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:22.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.718+0000 7f14427fc640 1 -- 172.21.15.123:0/2666563577 >> v1:172.21.15.188:6789/0 conn(0x7f1444148420 legacy=0x7f144406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:22.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.718+0000 7f14427fc640 1 -- 172.21.15.123:0/2666563577 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14440b5a50 con 0x7f144406c320 2024-09-15T23:22:22.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.718+0000 7f14437fe640 1 --2- 172.21.15.123:0/2666563577 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f14440b5100 0x7f14440b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:22:22.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.719+0000 7f14427fc640 1 --2- 172.21.15.123:0/2666563577 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f144406c320 0x7f14440b4ab0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1438009870 tx=0x7f143802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1c4cc47176f2ba7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:22.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.719+0000 7f1441ffb640 1 -- 172.21.15.123:0/2666563577 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1438037070 con 0x7f144406c320 2024-09-15T23:22:22.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.719+0000 7f1441ffb640 1 -- 172.21.15.123:0/2666563577 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1438032440 con 0x7f144406c320 2024-09-15T23:22:22.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.719+0000 7f1441ffb640 1 -- 172.21.15.123:0/2666563577 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1438032810 con 0x7f144406c320 2024-09-15T23:22:22.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.720+0000 7f144930c640 1 -- 172.21.15.123:0/2666563577 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f144406c320 msgr2=0x7f14440b4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:22.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.720+0000 7f144930c640 1 --2- 172.21.15.123:0/2666563577 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f144406c320 0x7f14440b4ab0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1438009870 tx=0x7f143802a1c0 comp rx=0 tx=0).stop 2024-09-15T23:22:22.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.720+0000 7f144930c640 1 -- 172.21.15.123:0/2666563577 shutdown_connections 2024-09-15T23:22:22.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.720+0000 7f144930c640 1 --2- 172.21.15.123:0/2666563577 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f144406c320 0x7f14440b4ab0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:22.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.720+0000 7f144930c640 1 --2- 172.21.15.123:0/2666563577 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f14440b5100 0x7f14440b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:22.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.720+0000 7f144930c640 1 -- 172.21.15.123:0/2666563577 >> 172.21.15.123:0/2666563577 conn(0x7f144406cd20 msgr2=0x7f144406d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:22.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.720+0000 7f144930c640 1 -- 172.21.15.123:0/2666563577 shutdown_connections 2024-09-15T23:22:22.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.720+0000 7f144930c640 1 -- 172.21.15.123:0/2666563577 wait complete. 2024-09-15T23:22:22.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.721+0000 7f144930c640 1 Processor -- start 2024-09-15T23:22:22.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.721+0000 7f144930c640 1 -- start start 2024-09-15T23:22:22.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.722+0000 7f144930c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f144406c320 0x7f1444150e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:22.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.722+0000 7f144930c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f14440b5100 0x7f1444143780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:22.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.722+0000 7f144930c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1444148420 0x7f14440c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:22.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.722+0000 7f144930c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f14440b1db0 con 0x7f1444148420 2024-09-15T23:22:22.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.722+0000 7f144930c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f14440b6010 con 0x7f14440b5100 2024-09-15T23:22:22.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.722+0000 7f144930c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f14440b1f30 con 0x7f144406c320 2024-09-15T23:22:22.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.722+0000 7f14437fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1444148420 0x7f14440c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:22.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.722+0000 7f14437fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1444148420 0x7f14440c9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55056/0 (socket says 172.21.15.123:55056) 2024-09-15T23:22:22.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.722+0000 7f14437fe640 1 -- 172.21.15.123:0/518434022 learned_addr learned my addr 172.21.15.123:0/518434022 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:22.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.722+0000 7f14427fc640 1 --2- 172.21.15.123:0/518434022 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f14440b5100 0x7f1444143780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:22.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.722+0000 7f1442ffd640 1 --2- 172.21.15.123:0/518434022 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f144406c320 0x7f1444150e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:22.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.722+0000 7f14437fe640 1 -- 172.21.15.123:0/518434022 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f144406c320 msgr2=0x7f1444150e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:22.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.722+0000 7f14437fe640 1 --2- 172.21.15.123:0/518434022 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f144406c320 0x7f1444150e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:22.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.722+0000 7f14437fe640 1 -- 172.21.15.123:0/518434022 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f14440b5100 msgr2=0x7f1444143780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:22.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.722+0000 7f14437fe640 1 --2- 172.21.15.123:0/518434022 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f14440b5100 0x7f1444143780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:22.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.722+0000 7f14437fe640 1 -- 172.21.15.123:0/518434022 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1444144240 con 0x7f1444148420 2024-09-15T23:22:22.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.722+0000 7f14437fe640 1 --2- 172.21.15.123:0/518434022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1444148420 0x7f14440c9640 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7f143c00e930 tx=0x7f143c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:22.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.723+0000 7f142b7fe640 1 -- 172.21.15.123:0/518434022 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143c017070 con 0x7f1444148420 2024-09-15T23:22:22.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.723+0000 7f142b7fe640 1 -- 172.21.15.123:0/518434022 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f143c00ca00 con 0x7f1444148420 2024-09-15T23:22:22.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.723+0000 7f144930c640 1 -- 172.21.15.123:0/518434022 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1444144520 con 0x7f1444148420 2024-09-15T23:22:22.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.723+0000 7f142b7fe640 1 -- 172.21.15.123:0/518434022 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143c00cdd0 con 0x7f1444148420 2024-09-15T23:22:22.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.723+0000 7f144930c640 1 -- 172.21.15.123:0/518434022 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1444151350 con 0x7f1444148420 2024-09-15T23:22:22.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.724+0000 7f144930c640 1 -- 172.21.15.123:0/518434022 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14440b4ab0 con 0x7f1444148420 2024-09-15T23:22:22.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.724+0000 7f142b7fe640 1 -- 172.21.15.123:0/518434022 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f143c013470 con 0x7f1444148420 2024-09-15T23:22:22.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.725+0000 7f142b7fe640 1 --2- 172.21.15.123:0/518434022 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f143006c2b0 0x7f143006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:22.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.725+0000 7f142b7fe640 1 -- 172.21.15.123:0/518434022 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 4857+0+0 (secure 0 0 0) 0x7f143c08af60 con 0x7f1444148420 2024-09-15T23:22:22.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.725+0000 7f1442ffd640 1 --2- 172.21.15.123:0/518434022 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f143006c2b0 0x7f143006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:22.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.725+0000 7f1442ffd640 1 --2- 172.21.15.123:0/518434022 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f143006c2b0 0x7f143006e770 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f1434007fd0 tx=0x7f1434001630 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:22.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.729+0000 7f142b7fe640 1 -- 172.21.15.123:0/518434022 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f143c059490 con 0x7f1444148420 2024-09-15T23:22:22.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.956+0000 7f144930c640 1 -- 172.21.15.123:0/518434022 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f14440b2350 con 0x7f1444148420 2024-09-15T23:22:22.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.956+0000 7f142b7fe640 1 -- 172.21.15.123:0/518434022 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) ==== 80+0+5304 (secure 0 0 0) 0x7f143c05d790 con 0x7f1444148420 2024-09-15T23:22:22.959 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:22:22.959 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:22:22.959 INFO:teuthology.orchestra.run.smithi123.stdout: "auth_dump": [ 2024-09-15T23:22:22.959 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:22:22.959 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.a", 2024-09-15T23:22:22.959 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm9ATVDhAAnukyZogTuG4YCbzRXSCkiQ==", 2024-09-15T23:22:22.959 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:22:22.959 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:22:22.959 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:22:22.959 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:22:22.959 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:22:22.959 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:22:22.960 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:22:22.960 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:22:22.960 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.b", 2024-09-15T23:22:22.960 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm4KmaGhAAbf6vcffqiJTOYXK5DCXcZA==", 2024-09-15T23:22:22.960 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:22:22.960 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:22:22.960 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:22:22.960 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:22:22.960 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:22:22.960 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:22:22.960 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:22:22.961 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:22:22.961 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.c", 2024-09-15T23:22:22.961 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmua/VFRAAwbPm2TslrfQkrvHiO8oeLg==", 2024-09-15T23:22:22.961 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:22:22.961 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:22:22.961 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:22:22.961 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:22:22.961 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:22:22.961 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:22:22.961 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:22:22.961 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:22:22.961 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.d", 2024-09-15T23:22:22.961 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmzw3eIRAAaE+5y9USwp+xM3MTAndn7Q==", 2024-09-15T23:22:22.961 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:22:22.962 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:22:22.962 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:22:22.962 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:22:22.962 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:22:22.962 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:22:22.962 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:22:22.962 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:22:22.962 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.0", 2024-09-15T23:22:22.962 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCRaedmFrHGAxAAy/jTkothESNn2DC9xcHDAQ==", 2024-09-15T23:22:22.962 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:22:22.962 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:22:22.962 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:22:22.962 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:22:22.963 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:22:22.963 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:22:22.963 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:22:22.963 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.1", 2024-09-15T23:22:22.963 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCUaedm6vZlIxAAdsnLqFSng6SRpCT6UZKGsw==", 2024-09-15T23:22:22.963 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:22:22.963 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:22:22.963 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:22:22.963 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:22:22.963 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:22:22.963 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:22:22.963 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:22:22.963 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.2", 2024-09-15T23:22:22.963 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCYaedmXgVwFRAA1mOzzRafhKMsU7kTAT6TqA==", 2024-09-15T23:22:22.964 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:22:22.964 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:22:22.964 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:22:22.964 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:22:22.964 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:22:22.964 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:22:22.964 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:22:22.964 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.3", 2024-09-15T23:22:22.964 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCcaedm+APAFhAAb8blNFzswwHriSmCrMuA0A==", 2024-09-15T23:22:22.964 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:22:22.964 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:22:22.964 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:22:22.964 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:22:22.965 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:22:22.965 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:22:22.965 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:22:22.965 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.4", 2024-09-15T23:22:22.965 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCjaedmReUmABAAXpxsK7osxn/ZelVXKiCLOw==", 2024-09-15T23:22:22.965 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:22:22.965 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:22:22.965 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:22:22.965 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:22:22.965 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:22:22.965 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:22:22.965 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:22:22.965 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.5", 2024-09-15T23:22:22.965 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCnaedmtbdmARAAdxguBdtwBmtiaIx/y992GA==", 2024-09-15T23:22:22.966 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:22:22.966 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:22:22.966 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:22:22.966 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:22:22.966 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:22:22.966 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:22:22.966 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:22:22.966 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.6", 2024-09-15T23:22:22.966 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCraedmkR+NAxAAd2GAAH0BgOMonU8iTSn+Fw==", 2024-09-15T23:22:22.966 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:22:22.966 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:22:22.966 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:22:22.967 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:22:22.967 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:22:22.967 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:22:22.967 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:22:22.967 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.7", 2024-09-15T23:22:22.967 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCvaedmAaCwBBAAdpDtCbXchArmy019wiOdSQ==", 2024-09-15T23:22:22.967 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:22:22.967 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:22:22.967 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:22:22.967 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:22:22.968 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:22:22.968 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:22:22.968 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:22:22.968 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.0", 2024-09-15T23:22:22.968 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmzQPqJRAAhUf1dnVYohN4obCfeu8+7g==", 2024-09-15T23:22:22.968 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:22:22.968 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:22:22.968 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow r", 2024-09-15T23:22:22.968 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-15T23:22:22.968 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:22:22.968 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:22:22.968 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:22:22.968 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.1", 2024-09-15T23:22:22.969 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmdKK0LhAAXXmUkxVwMEjRTRXUh9CL/g==", 2024-09-15T23:22:22.969 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:22:22.969 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:22:22.969 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:22:22.969 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:22:22.969 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:22:22.969 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:22:22.969 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:22:22.969 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:22:22.969 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.2", 2024-09-15T23:22:22.969 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmRz55KxAARi7B4WYOY1QqH1CK81z9pA==", 2024-09-15T23:22:22.969 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:22:22.969 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:22:22.970 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:22:22.970 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:22:22.970 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:22:22.970 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:22:22.970 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:22:22.970 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:22:22.970 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.3", 2024-09-15T23:22:22.970 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmbWo8NBAAR1qGX1bs35ojx6lMxftcfg==", 2024-09-15T23:22:22.970 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:22:22.970 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:22:22.970 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:22:22.970 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:22:22.970 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:22:22.970 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:22:22.971 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:22:22.971 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:22:22.971 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.admin", 2024-09-15T23:22:22.971 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCMaedmVUW0LhAAqgPFk1HtxsZXcIStNN43pA==", 2024-09-15T23:22:22.971 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:22:22.971 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:22:22.971 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:22:22.971 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:22:22.971 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:22:22.971 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:22:22.971 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:22:22.971 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:22:22.972 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.x", 2024-09-15T23:22:22.972 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmGPSBCxAAHAhXQERogdAOm0ZPNtlxpw==", 2024-09-15T23:22:22.972 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:22:22.972 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:22:22.972 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-15T23:22:22.972 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:22:22.972 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:22:22.972 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:22:22.972 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:22:22.972 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.y", 2024-09-15T23:22:22.973 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm5Om4BxAA/7ZtMMlbUA3bvMCfaNMQyg==", 2024-09-15T23:22:22.973 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:22:22.973 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:22:22.973 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-15T23:22:22.973 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:22:22.973 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:22:22.973 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:22:22.973 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-15T23:22:22.973 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:22:22.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.958+0000 7f144930c640 1 -- 172.21.15.123:0/518434022 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f143006c2b0 msgr2=0x7f143006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:22.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.958+0000 7f144930c640 1 --2- 172.21.15.123:0/518434022 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f143006c2b0 0x7f143006e770 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f1434007fd0 tx=0x7f1434001630 comp rx=0 tx=0).stop 2024-09-15T23:22:22.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.958+0000 7f144930c640 1 -- 172.21.15.123:0/518434022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1444148420 msgr2=0x7f14440c9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:22.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.958+0000 7f144930c640 1 --2- 172.21.15.123:0/518434022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1444148420 0x7f14440c9640 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7f143c00e930 tx=0x7f143c00edf0 comp rx=0 tx=0).stop 2024-09-15T23:22:22.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.958+0000 7f144930c640 1 -- 172.21.15.123:0/518434022 shutdown_connections 2024-09-15T23:22:22.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.958+0000 7f144930c640 1 --2- 172.21.15.123:0/518434022 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f143006c2b0 0x7f143006e770 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:22.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.958+0000 7f144930c640 1 --2- 172.21.15.123:0/518434022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1444148420 0x7f14440c9640 unknown :-1 s=CLOSED pgs=2061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:22.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.958+0000 7f144930c640 1 --2- 172.21.15.123:0/518434022 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f14440b5100 0x7f1444143780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:22.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.958+0000 7f144930c640 1 --2- 172.21.15.123:0/518434022 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f144406c320 0x7f1444150e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:22.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.958+0000 7f144930c640 1 -- 172.21.15.123:0/518434022 >> 172.21.15.123:0/518434022 conn(0x7f144406cd20 msgr2=0x7f144406eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:22.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.958+0000 7f144930c640 1 -- 172.21.15.123:0/518434022 shutdown_connections 2024-09-15T23:22:22.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:22.958+0000 7f144930c640 1 -- 172.21.15.123:0/518434022 wait complete. 2024-09-15T23:22:22.976 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T23:22:23.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.074+0000 7f66a1da6640 1 Processor -- start 2024-09-15T23:22:23.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.074+0000 7f66a1da6640 1 -- start start 2024-09-15T23:22:23.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.075+0000 7f66a1da6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f669c0b6970 0x7f669c0b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:23.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.075+0000 7f66a1da6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f669c0d23b0 0x7f669c0b8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:23.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.075+0000 7f66a1da6640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f669c0d0e70 con 0x7f669c15ed20 2024-09-15T23:22:23.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.075+0000 7f66a1da6640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f669c0d41c0 con 0x7f669c0b6970 2024-09-15T23:22:23.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.075+0000 7f66a1da6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f669c0d35b0 con 0x7f669c0d23b0 2024-09-15T23:22:23.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.075+0000 7f669b7fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f669c15ed20 0x7f669c0b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59174/0 (socket says 172.21.15.123:59174) 2024-09-15T23:22:23.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.075+0000 7f669b7fe640 1 -- 172.21.15.123:0/3762649456 learned_addr learned my addr 172.21.15.123:0/3762649456 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:23.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.075+0000 7f6693fff640 1 --2- 172.21.15.123:0/3762649456 >> v2:172.21.15.123:3300/0 conn(0x7f669c0b6970 0x7f669c0b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:23.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.075+0000 7f669affd640 1 -- 172.21.15.123:0/3762649456 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4271994171 0 0) 0x7f668c001110 con 0x7f669c15ed20 2024-09-15T23:22:23.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.075+0000 7f669affd640 1 -- 172.21.15.123:0/3762649456 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6688003520 con 0x7f669c15ed20 2024-09-15T23:22:23.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.075+0000 7f669bfff640 1 --2- 172.21.15.123:0/3762649456 >> v2:172.21.15.188:3300/0 conn(0x7f669c0d23b0 0x7f669c0b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:23.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.075+0000 7f6693fff640 1 -- 172.21.15.123:0/3762649456 >> v2:172.21.15.188:3300/0 conn(0x7f669c0d23b0 msgr2=0x7f669c0b8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:23.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.075+0000 7f6693fff640 1 --2- 172.21.15.123:0/3762649456 >> v2:172.21.15.188:3300/0 conn(0x7f669c0d23b0 0x7f669c0b8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:23.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.075+0000 7f6693fff640 1 -- 172.21.15.123:0/3762649456 >> v1:172.21.15.123:6789/0 conn(0x7f669c15ed20 legacy=0x7f669c0b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:23.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.075+0000 7f6693fff640 1 -- 172.21.15.123:0/3762649456 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f669c0d3890 con 0x7f669c0b6970 2024-09-15T23:22:23.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.076+0000 7f6693fff640 1 --2- 172.21.15.123:0/3762649456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f669c0b6970 0x7f669c0b80d0 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7f669c0d4130 tx=0x7f668402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402d2710a80c04b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:23.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.076+0000 7f669affd640 1 -- 172.21.15.123:0/3762649456 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6684037070 con 0x7f669c0b6970 2024-09-15T23:22:23.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.076+0000 7f669affd640 1 -- 172.21.15.123:0/3762649456 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6684032440 con 0x7f669c0b6970 2024-09-15T23:22:23.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.076+0000 7f669affd640 1 -- 172.21.15.123:0/3762649456 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668402ae60 con 0x7f669c0b6970 2024-09-15T23:22:23.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.076+0000 7f66a1da6640 1 -- 172.21.15.123:0/3762649456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f669c0b6970 msgr2=0x7f669c0b80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:23.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.076+0000 7f66a1da6640 1 --2- 172.21.15.123:0/3762649456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f669c0b6970 0x7f669c0b80d0 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7f669c0d4130 tx=0x7f668402a110 comp rx=0 tx=0).stop 2024-09-15T23:22:23.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.076+0000 7f66a1da6640 1 -- 172.21.15.123:0/3762649456 shutdown_connections 2024-09-15T23:22:23.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.077+0000 7f66a1da6640 1 --2- 172.21.15.123:0/3762649456 >> v2:172.21.15.188:3300/0 conn(0x7f669c0d23b0 0x7f669c0b8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:23.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.077+0000 7f66a1da6640 1 --2- 172.21.15.123:0/3762649456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f669c0b6970 0x7f669c0b80d0 unknown :-1 s=CLOSED pgs=2063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:23.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.077+0000 7f66a1da6640 1 -- 172.21.15.123:0/3762649456 >> 172.21.15.123:0/3762649456 conn(0x7f669c0d1260 msgr2=0x7f669c0d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:23.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.077+0000 7f66a1da6640 1 -- 172.21.15.123:0/3762649456 shutdown_connections 2024-09-15T23:22:23.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.077+0000 7f66a1da6640 1 -- 172.21.15.123:0/3762649456 wait complete. 2024-09-15T23:22:23.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.078+0000 7f66a1da6640 1 Processor -- start 2024-09-15T23:22:23.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.078+0000 7f66a1da6640 1 -- start start 2024-09-15T23:22:23.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.078+0000 7f66a1da6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f669c0b6970 0x7f669c157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:23.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.078+0000 7f66a1da6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f669c0d23b0 0x7f669c15a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:23.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.078+0000 7f66a1da6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f669c15ed20 0x7f669c0cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:23.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.078+0000 7f66a1da6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f669c0d32a0 con 0x7f669c15ed20 2024-09-15T23:22:23.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.078+0000 7f66a1da6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f669c0d3e50 con 0x7f669c0d23b0 2024-09-15T23:22:23.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.078+0000 7f66a1da6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f669c15f100 con 0x7f669c0b6970 2024-09-15T23:22:23.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.079+0000 7f669bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f669c15ed20 0x7f669c0cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:23.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.079+0000 7f669bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f669c15ed20 0x7f669c0cdb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55070/0 (socket says 172.21.15.123:55070) 2024-09-15T23:22:23.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.079+0000 7f669bfff640 1 -- 172.21.15.123:0/3189926354 learned_addr learned my addr 172.21.15.123:0/3189926354 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:23.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.079+0000 7f6693fff640 1 --2- 172.21.15.123:0/3189926354 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f669c0d23b0 0x7f669c15a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:23.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.079+0000 7f669b7fe640 1 --2- 172.21.15.123:0/3189926354 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f669c0b6970 0x7f669c157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:23.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.079+0000 7f669bfff640 1 -- 172.21.15.123:0/3189926354 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f669c0b6970 msgr2=0x7f669c157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:23.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.079+0000 7f669bfff640 1 --2- 172.21.15.123:0/3189926354 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f669c0b6970 0x7f669c157c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:23.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.079+0000 7f669bfff640 1 -- 172.21.15.123:0/3189926354 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f669c0d23b0 msgr2=0x7f669c15a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:23.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.079+0000 7f669bfff640 1 --2- 172.21.15.123:0/3189926354 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f669c0d23b0 0x7f669c15a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:23.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.079+0000 7f669bfff640 1 -- 172.21.15.123:0/3189926354 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f669c159580 con 0x7f669c15ed20 2024-09-15T23:22:23.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.079+0000 7f669b7fe640 1 --2- 172.21.15.123:0/3189926354 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f669c0b6970 0x7f669c157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:23.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.079+0000 7f669bfff640 1 --2- 172.21.15.123:0/3189926354 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f669c15ed20 0x7f669c0cdb80 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7f669400cd70 tx=0x7f669400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:23.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.079+0000 7f6698ff9640 1 -- 172.21.15.123:0/3189926354 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6694003b90 con 0x7f669c15ed20 2024-09-15T23:22:23.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.079+0000 7f6698ff9640 1 -- 172.21.15.123:0/3189926354 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6694003d30 con 0x7f669c15ed20 2024-09-15T23:22:23.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.079+0000 7f6698ff9640 1 -- 172.21.15.123:0/3189926354 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6694004240 con 0x7f669c15ed20 2024-09-15T23:22:23.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.079+0000 7f66a1da6640 1 -- 172.21.15.123:0/3189926354 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f669c159860 con 0x7f669c15ed20 2024-09-15T23:22:23.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.079+0000 7f66a1da6640 1 -- 172.21.15.123:0/3189926354 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f669c159e20 con 0x7f669c15ed20 2024-09-15T23:22:23.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.080+0000 7f66a1da6640 1 -- 172.21.15.123:0/3189926354 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f669c0b7010 con 0x7f669c15ed20 2024-09-15T23:22:23.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.081+0000 7f6698ff9640 1 -- 172.21.15.123:0/3189926354 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f66940043e0 con 0x7f669c15ed20 2024-09-15T23:22:23.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.081+0000 7f6698ff9640 1 --2- 172.21.15.123:0/3189926354 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f667c06c2b0 0x7f667c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:23.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.081+0000 7f6698ff9640 1 -- 172.21.15.123:0/3189926354 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 4857+0+0 (secure 0 0 0) 0x7f669408baf0 con 0x7f669c15ed20 2024-09-15T23:22:23.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.081+0000 7f669b7fe640 1 --2- 172.21.15.123:0/3189926354 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f667c06c2b0 0x7f667c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:23.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.082+0000 7f669b7fe640 1 --2- 172.21.15.123:0/3189926354 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f667c06c2b0 0x7f667c06e770 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f668c007fd0 tx=0x7f668c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:23.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.085+0000 7f6698ff9640 1 -- 172.21.15.123:0/3189926354 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f669405a640 con 0x7f669c15ed20 2024-09-15T23:22:23.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.252+0000 7f66a1da6640 1 -- 172.21.15.123:0/3189926354 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f669c0d0a90 con 0x7f669c15ed20 2024-09-15T23:22:23.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.252+0000 7f6698ff9640 1 -- 172.21.15.123:0/3189926354 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v178) ==== 84+0+65 (secure 0 0 0) 0x7f6694059f40 con 0x7f669c15ed20 2024-09-15T23:22:23.289 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:22:23.289 INFO:teuthology.orchestra.run.smithi123.stdout:[ 2024-09-15T23:22:23.289 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:22:23.289 INFO:teuthology.orchestra.run.smithi123.stdout: "poolnum": 1, 2024-09-15T23:22:23.289 INFO:teuthology.orchestra.run.smithi123.stdout: "poolname": ".mgr" 2024-09-15T23:22:23.289 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:22:23.289 INFO:teuthology.orchestra.run.smithi123.stdout:] 2024-09-15T23:22:23.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.254+0000 7f66a1da6640 1 -- 172.21.15.123:0/3189926354 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f667c06c2b0 msgr2=0x7f667c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:23.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.254+0000 7f66a1da6640 1 --2- 172.21.15.123:0/3189926354 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f667c06c2b0 0x7f667c06e770 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f668c007fd0 tx=0x7f668c009040 comp rx=0 tx=0).stop 2024-09-15T23:22:23.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.254+0000 7f66a1da6640 1 -- 172.21.15.123:0/3189926354 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f669c15ed20 msgr2=0x7f669c0cdb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:23.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.254+0000 7f66a1da6640 1 --2- 172.21.15.123:0/3189926354 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f669c15ed20 0x7f669c0cdb80 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7f669400cd70 tx=0x7f669400a660 comp rx=0 tx=0).stop 2024-09-15T23:22:23.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.254+0000 7f66a1da6640 1 -- 172.21.15.123:0/3189926354 shutdown_connections 2024-09-15T23:22:23.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.254+0000 7f66a1da6640 1 --2- 172.21.15.123:0/3189926354 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f667c06c2b0 0x7f667c06e770 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:23.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.254+0000 7f66a1da6640 1 --2- 172.21.15.123:0/3189926354 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f669c15ed20 0x7f669c0cdb80 unknown :-1 s=CLOSED pgs=2064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:23.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.254+0000 7f66a1da6640 1 --2- 172.21.15.123:0/3189926354 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f669c0d23b0 0x7f669c15a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:23.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.254+0000 7f66a1da6640 1 --2- 172.21.15.123:0/3189926354 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f669c0b6970 0x7f669c157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:23.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.254+0000 7f66a1da6640 1 -- 172.21.15.123:0/3189926354 >> 172.21.15.123:0/3189926354 conn(0x7f669c0d1260 msgr2=0x7f669c0b51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:23.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.254+0000 7f66a1da6640 1 -- 172.21.15.123:0/3189926354 shutdown_connections 2024-09-15T23:22:23.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.254+0000 7f66a1da6640 1 -- 172.21.15.123:0/3189926354 wait complete. 2024-09-15T23:22:23.292 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T23:22:23.292 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T23:22:23.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.392+0000 7f74b6731640 1 Processor -- start 2024-09-15T23:22:23.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.392+0000 7f74b6731640 1 -- start start 2024-09-15T23:22:23.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.393+0000 7f74b6731640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f74b015e6e0 0x7f74b00b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:23.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.393+0000 7f74b6731640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f74b0073cd0 0x7f74b00d21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:23.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.393+0000 7f74b6731640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74b015ee80 con 0x7f74b00b4720 2024-09-15T23:22:23.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.393+0000 7f74b6731640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f74b015fc40 con 0x7f74b0073cd0 2024-09-15T23:22:23.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.393+0000 7f74b6731640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f74b00b4c10 con 0x7f74b015e6e0 2024-09-15T23:22:23.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.393+0000 7f74b4cce640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f74b0073cd0 0x7f74b00d21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:23.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.393+0000 7f74b4cce640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f74b0073cd0 0x7f74b00d21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55080/0 (socket says 172.21.15.123:55080) 2024-09-15T23:22:23.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.393+0000 7f74b4cce640 1 -- 172.21.15.123:0/569833877 learned_addr learned my addr 172.21.15.123:0/569833877 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:23.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.393+0000 7f74affff640 1 --2- 172.21.15.123:0/569833877 >> v2:172.21.15.188:3300/0 conn(0x7f74b015e6e0 0x7f74b00b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:23.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.393+0000 7f74b4cce640 1 -- 172.21.15.123:0/569833877 >> v2:172.21.15.188:3300/0 conn(0x7f74b015e6e0 msgr2=0x7f74b00b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:23.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.393+0000 7f74b4cce640 1 --2- 172.21.15.123:0/569833877 >> v2:172.21.15.188:3300/0 conn(0x7f74b015e6e0 0x7f74b00b41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:23.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.393+0000 7f74b4cce640 1 -- 172.21.15.123:0/569833877 >> v1:172.21.15.188:6789/0 conn(0x7f74b00b4720 legacy=0x7f74b00735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:23.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.393+0000 7f74b4cce640 1 -- 172.21.15.123:0/569833877 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b015f160 con 0x7f74b0073cd0 2024-09-15T23:22:23.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.394+0000 7f74b4cce640 1 --2- 172.21.15.123:0/569833877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74b0073cd0 0x7f74b00d21d0 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7f74a8009e50 tx=0x7f74a802a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb4f95dbbf113d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:23.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.394+0000 7f74aeffd640 1 -- 172.21.15.123:0/569833877 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a8036070 con 0x7f74b0073cd0 2024-09-15T23:22:23.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.394+0000 7f74aeffd640 1 -- 172.21.15.123:0/569833877 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74a8031600 con 0x7f74b0073cd0 2024-09-15T23:22:23.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.394+0000 7f74aeffd640 1 -- 172.21.15.123:0/569833877 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a80319d0 con 0x7f74b0073cd0 2024-09-15T23:22:23.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.395+0000 7f74b6731640 1 -- 172.21.15.123:0/569833877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74b0073cd0 msgr2=0x7f74b00d21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:23.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.395+0000 7f74b6731640 1 --2- 172.21.15.123:0/569833877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74b0073cd0 0x7f74b00d21d0 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7f74a8009e50 tx=0x7f74a802a760 comp rx=0 tx=0).stop 2024-09-15T23:22:23.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.395+0000 7f74b6731640 1 -- 172.21.15.123:0/569833877 shutdown_connections 2024-09-15T23:22:23.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.395+0000 7f74b6731640 1 --2- 172.21.15.123:0/569833877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74b0073cd0 0x7f74b00d21d0 unknown :-1 s=CLOSED pgs=2065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:23.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.395+0000 7f74b6731640 1 --2- 172.21.15.123:0/569833877 >> v2:172.21.15.188:3300/0 conn(0x7f74b015e6e0 0x7f74b00b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:23.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.395+0000 7f74b6731640 1 -- 172.21.15.123:0/569833877 >> 172.21.15.123:0/569833877 conn(0x7f74b0067950 msgr2=0x7f74b0067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:23.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.395+0000 7f74b6731640 1 -- 172.21.15.123:0/569833877 shutdown_connections 2024-09-15T23:22:23.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.395+0000 7f74b6731640 1 -- 172.21.15.123:0/569833877 wait complete. 2024-09-15T23:22:23.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.396+0000 7f74b6731640 1 Processor -- start 2024-09-15T23:22:23.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.396+0000 7f74b6731640 1 -- start start 2024-09-15T23:22:23.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.397+0000 7f74b6731640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f74b0073cd0 0x7f74b0151630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:23.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.397+0000 7f74b6731640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f74b00b4720 0x7f74b0150d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:23.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.397+0000 7f74b6731640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74b015e6e0 0x7f74b0143cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:23.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.397+0000 7f74b6731640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f74b00b5710 con 0x7f74b015e6e0 2024-09-15T23:22:23.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.397+0000 7f74b6731640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f74b015f720 con 0x7f74b00b4720 2024-09-15T23:22:23.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.397+0000 7f74b6731640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f74b00b5890 con 0x7f74b0073cd0 2024-09-15T23:22:23.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.397+0000 7f74b4cce640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74b015e6e0 0x7f74b0143cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:23.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.397+0000 7f74b4cce640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74b015e6e0 0x7f74b0143cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55084/0 (socket says 172.21.15.123:55084) 2024-09-15T23:22:23.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.397+0000 7f74b4cce640 1 -- 172.21.15.123:0/3095913958 learned_addr learned my addr 172.21.15.123:0/3095913958 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:23.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.397+0000 7f74af7fe640 1 --2- 172.21.15.123:0/3095913958 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f74b00b4720 0x7f74b0150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:23.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.397+0000 7f74affff640 1 --2- 172.21.15.123:0/3095913958 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f74b0073cd0 0x7f74b0151630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:23.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.397+0000 7f74b4cce640 1 -- 172.21.15.123:0/3095913958 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f74b0073cd0 msgr2=0x7f74b0151630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:23.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.397+0000 7f74b4cce640 1 --2- 172.21.15.123:0/3095913958 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f74b0073cd0 0x7f74b0151630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:23.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.397+0000 7f74b4cce640 1 -- 172.21.15.123:0/3095913958 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f74b00b4720 msgr2=0x7f74b0150d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:23.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.397+0000 7f74b4cce640 1 --2- 172.21.15.123:0/3095913958 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f74b00b4720 0x7f74b0150d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:23.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.397+0000 7f74b4cce640 1 -- 172.21.15.123:0/3095913958 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b0151c10 con 0x7f74b015e6e0 2024-09-15T23:22:23.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.397+0000 7f74b4cce640 1 --2- 172.21.15.123:0/3095913958 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74b015e6e0 0x7f74b0143cf0 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7f74a8034040 tx=0x7f74a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:23.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.397+0000 7f74acff9640 1 -- 172.21.15.123:0/3095913958 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a8036050 con 0x7f74b015e6e0 2024-09-15T23:22:23.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.398+0000 7f74acff9640 1 -- 172.21.15.123:0/3095913958 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74a8042070 con 0x7f74b015e6e0 2024-09-15T23:22:23.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.398+0000 7f74acff9640 1 -- 172.21.15.123:0/3095913958 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a8009510 con 0x7f74b015e6e0 2024-09-15T23:22:23.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.398+0000 7f74b6731640 1 -- 172.21.15.123:0/3095913958 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74b015c930 con 0x7f74b015e6e0 2024-09-15T23:22:23.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.398+0000 7f74b6731640 1 -- 172.21.15.123:0/3095913958 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74b015cef0 con 0x7f74b015e6e0 2024-09-15T23:22:23.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.399+0000 7f74b6731640 1 -- 172.21.15.123:0/3095913958 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74b015d0f0 con 0x7f74b015e6e0 2024-09-15T23:22:23.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.399+0000 7f74acff9640 1 -- 172.21.15.123:0/3095913958 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f74a8007bf0 con 0x7f74b015e6e0 2024-09-15T23:22:23.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.400+0000 7f74acff9640 1 --2- 172.21.15.123:0/3095913958 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f749c06c2b0 0x7f749c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:23.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.400+0000 7f74acff9640 1 -- 172.21.15.123:0/3095913958 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 4857+0+0 (secure 0 0 0) 0x7f74a80abc30 con 0x7f74b015e6e0 2024-09-15T23:22:23.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.400+0000 7f74affff640 1 --2- 172.21.15.123:0/3095913958 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f749c06c2b0 0x7f749c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:23.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.400+0000 7f74affff640 1 --2- 172.21.15.123:0/3095913958 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f749c06c2b0 0x7f749c06e770 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f74a0009aa0 tx=0x7f74a0009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:23.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.404+0000 7f74acff9640 1 -- 172.21.15.123:0/3095913958 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f74b015d0f0 con 0x7f74b015e6e0 2024-09-15T23:22:23.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:23.573+0000 7f74b6731640 1 -- 172.21.15.123:0/3095913958 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f74b00b41e0 con 0x7f74b015e6e0 2024-09-15T23:22:24.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.554+0000 7f74acff9640 1 -- 172.21.15.123:0/3095913958 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v179) ==== 138+0+0 (secure 0 0 0) 0x7f74a807a130 con 0x7f74b015e6e0 2024-09-15T23:22:24.556 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' created 2024-09-15T23:22:24.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.558+0000 7f74b6731640 1 -- 172.21.15.123:0/3095913958 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f749c06c2b0 msgr2=0x7f749c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:24.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.558+0000 7f74b6731640 1 --2- 172.21.15.123:0/3095913958 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f749c06c2b0 0x7f749c06e770 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f74a0009aa0 tx=0x7f74a0009190 comp rx=0 tx=0).stop 2024-09-15T23:22:24.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.558+0000 7f74b6731640 1 -- 172.21.15.123:0/3095913958 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74b015e6e0 msgr2=0x7f74b0143cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:24.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.558+0000 7f74b6731640 1 --2- 172.21.15.123:0/3095913958 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74b015e6e0 0x7f74b0143cf0 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7f74a8034040 tx=0x7f74a8004a40 comp rx=0 tx=0).stop 2024-09-15T23:22:24.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.558+0000 7f74b6731640 1 -- 172.21.15.123:0/3095913958 shutdown_connections 2024-09-15T23:22:24.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.558+0000 7f74b6731640 1 --2- 172.21.15.123:0/3095913958 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f749c06c2b0 0x7f749c06e770 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:24.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.558+0000 7f74b6731640 1 --2- 172.21.15.123:0/3095913958 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74b015e6e0 0x7f74b0143cf0 unknown :-1 s=CLOSED pgs=2066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:24.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.558+0000 7f74b6731640 1 --2- 172.21.15.123:0/3095913958 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f74b00b4720 0x7f74b0150d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:24.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.558+0000 7f74b6731640 1 --2- 172.21.15.123:0/3095913958 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f74b0073cd0 0x7f74b0151630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:24.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.558+0000 7f74b6731640 1 -- 172.21.15.123:0/3095913958 >> 172.21.15.123:0/3095913958 conn(0x7f74b0067950 msgr2=0x7f74b015afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:24.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.560+0000 7f74b6731640 1 -- 172.21.15.123:0/3095913958 shutdown_connections 2024-09-15T23:22:24.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.560+0000 7f74b6731640 1 -- 172.21.15.123:0/3095913958 wait complete. 2024-09-15T23:22:24.576 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T23:22:24.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.685+0000 7f6525c23640 1 Processor -- start 2024-09-15T23:22:24.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.685+0000 7f6525c23640 1 -- start start 2024-09-15T23:22:24.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.686+0000 7f6525c23640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f65200ccf30 0x7f65200b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:24.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.686+0000 7f6525c23640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f65200cead0 0x7f6520071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:24.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.686+0000 7f6525c23640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65200cf2e0 con 0x7f652015b7c0 2024-09-15T23:22:24.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.686+0000 7f6525c23640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f6520070fe0 con 0x7f65200cead0 2024-09-15T23:22:24.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.686+0000 7f6525c23640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f65200712c0 con 0x7f65200ccf30 2024-09-15T23:22:24.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.686+0000 7f651ffff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f65200cead0 0x7f6520071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:24.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.686+0000 7f651effd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f652015b7c0 0x7f65200cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59178/0 (socket says 172.21.15.123:59178) 2024-09-15T23:22:24.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.686+0000 7f651ffff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f65200cead0 0x7f6520071ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55088/0 (socket says 172.21.15.123:55088) 2024-09-15T23:22:24.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.686+0000 7f651effd640 1 -- 172.21.15.123:0/3060283560 learned_addr learned my addr 172.21.15.123:0/3060283560 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:24.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.686+0000 7f651f7fe640 1 --2- 172.21.15.123:0/3060283560 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f65200ccf30 0x7f65200b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:24.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.687+0000 7f651ffff640 1 -- 172.21.15.123:0/3060283560 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f65200ccf30 msgr2=0x7f65200b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:24.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.687+0000 7f651ffff640 1 --2- 172.21.15.123:0/3060283560 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f65200ccf30 0x7f65200b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:24.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.687+0000 7f651ffff640 1 -- 172.21.15.123:0/3060283560 >> v1:172.21.15.123:6789/0 conn(0x7f652015b7c0 legacy=0x7f65200cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:24.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.687+0000 7f651e7fc640 1 -- 172.21.15.123:0/3060283560 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1297943624 0 0) 0x7f65200cf2e0 con 0x7f652015b7c0 2024-09-15T23:22:24.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.687+0000 7f651ffff640 1 -- 172.21.15.123:0/3060283560 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65200715a0 con 0x7f65200cead0 2024-09-15T23:22:24.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.687+0000 7f651f7fe640 1 --2- 172.21.15.123:0/3060283560 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f65200ccf30 0x7f65200b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:22:24.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.687+0000 7f651ffff640 1 --2- 172.21.15.123:0/3060283560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65200cead0 0x7f6520071ac0 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7f65180097a0 tx=0x7f651802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=907d477d5fce4288 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:24.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.687+0000 7f651e7fc640 1 -- 172.21.15.123:0/3060283560 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6518037070 con 0x7f65200cead0 2024-09-15T23:22:24.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.687+0000 7f651e7fc640 1 -- 172.21.15.123:0/3060283560 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f651802ae50 con 0x7f65200cead0 2024-09-15T23:22:24.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.687+0000 7f651e7fc640 1 -- 172.21.15.123:0/3060283560 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6518032660 con 0x7f65200cead0 2024-09-15T23:22:24.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.688+0000 7f6525c23640 1 -- 172.21.15.123:0/3060283560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65200cead0 msgr2=0x7f6520071ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:24.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.688+0000 7f6525c23640 1 --2- 172.21.15.123:0/3060283560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65200cead0 0x7f6520071ac0 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7f65180097a0 tx=0x7f651802a100 comp rx=0 tx=0).stop 2024-09-15T23:22:24.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.688+0000 7f6525c23640 1 -- 172.21.15.123:0/3060283560 shutdown_connections 2024-09-15T23:22:24.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.688+0000 7f6525c23640 1 --2- 172.21.15.123:0/3060283560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65200cead0 0x7f6520071ac0 unknown :-1 s=CLOSED pgs=2068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:24.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.688+0000 7f6525c23640 1 --2- 172.21.15.123:0/3060283560 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f65200ccf30 0x7f65200b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:24.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.688+0000 7f6525c23640 1 -- 172.21.15.123:0/3060283560 >> 172.21.15.123:0/3060283560 conn(0x7f652006d0f0 msgr2=0x7f652006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:24.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.688+0000 7f6525c23640 1 -- 172.21.15.123:0/3060283560 shutdown_connections 2024-09-15T23:22:24.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.688+0000 7f6525c23640 1 -- 172.21.15.123:0/3060283560 wait complete. 2024-09-15T23:22:24.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.689+0000 7f6525c23640 1 Processor -- start 2024-09-15T23:22:24.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.689+0000 7f6525c23640 1 -- start start 2024-09-15T23:22:24.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.690+0000 7f6525c23640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65200ccf30 0x7f65201472c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:24.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.690+0000 7f6525c23640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65200cead0 0x7f652015bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:24.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.690+0000 7f6525c23640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f652015b7c0 0x7f65201f47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:24.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.690+0000 7f6525c23640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6520072000 con 0x7f65200cead0 2024-09-15T23:22:24.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.690+0000 7f6525c23640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f65200cef60 con 0x7f65200ccf30 2024-09-15T23:22:24.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.690+0000 7f6525c23640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6520072180 con 0x7f652015b7c0 2024-09-15T23:22:24.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.690+0000 7f651effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65200cead0 0x7f652015bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:24.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.690+0000 7f651effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65200cead0 0x7f652015bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55104/0 (socket says 172.21.15.123:55104) 2024-09-15T23:22:24.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.690+0000 7f651effd640 1 -- 172.21.15.123:0/2828495213 learned_addr learned my addr 172.21.15.123:0/2828495213 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:24.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.690+0000 7f651effd640 1 -- 172.21.15.123:0/2828495213 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f652015b7c0 msgr2=0x7f65201f47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:24.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.690+0000 7f651effd640 1 --2- 172.21.15.123:0/2828495213 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f652015b7c0 0x7f65201f47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:24.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.691+0000 7f651effd640 1 -- 172.21.15.123:0/2828495213 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65200ccf30 msgr2=0x7f65201472c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:24.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.691+0000 7f651f7fe640 1 --2- 172.21.15.123:0/2828495213 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65200ccf30 0x7f65201472c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:24.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.691+0000 7f651effd640 1 --2- 172.21.15.123:0/2828495213 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65200ccf30 0x7f65201472c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:24.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.691+0000 7f651effd640 1 -- 172.21.15.123:0/2828495213 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6520147800 con 0x7f65200cead0 2024-09-15T23:22:24.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.691+0000 7f651effd640 1 --2- 172.21.15.123:0/2828495213 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65200cead0 0x7f652015bd90 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7f651400e660 tx=0x7f651400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:24.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.691+0000 7f6507fff640 1 -- 172.21.15.123:0/2828495213 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65140070d0 con 0x7f65200cead0 2024-09-15T23:22:24.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.691+0000 7f6507fff640 1 -- 172.21.15.123:0/2828495213 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6514016020 con 0x7f65200cead0 2024-09-15T23:22:24.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.691+0000 7f6525c23640 1 -- 172.21.15.123:0/2828495213 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f652015e880 con 0x7f65200cead0 2024-09-15T23:22:24.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.691+0000 7f6507fff640 1 -- 172.21.15.123:0/2828495213 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65140074d0 con 0x7f65200cead0 2024-09-15T23:22:24.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.691+0000 7f6525c23640 1 -- 172.21.15.123:0/2828495213 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6520155c90 con 0x7f65200cead0 2024-09-15T23:22:24.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.692+0000 7f6525c23640 1 -- 172.21.15.123:0/2828495213 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6520071ac0 con 0x7f65200cead0 2024-09-15T23:22:24.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.692+0000 7f6507fff640 1 -- 172.21.15.123:0/2828495213 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6514001730 con 0x7f65200cead0 2024-09-15T23:22:24.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.693+0000 7f6507fff640 1 --2- 172.21.15.123:0/2828495213 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f650c06c2b0 0x7f650c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:24.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.693+0000 7f6507fff640 1 -- 172.21.15.123:0/2828495213 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 5227+0+0 (secure 0 0 0) 0x7f651408d410 con 0x7f65200cead0 2024-09-15T23:22:24.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.693+0000 7f651f7fe640 1 --2- 172.21.15.123:0/2828495213 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f650c06c2b0 0x7f650c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:24.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.694+0000 7f651f7fe640 1 --2- 172.21.15.123:0/2828495213 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f650c06c2b0 0x7f650c06e770 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f6520157770 tx=0x7f65100084f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:24.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.698+0000 7f6507fff640 1 -- 172.21.15.123:0/2828495213 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6514020030 con 0x7f65200cead0 2024-09-15T23:22:24.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:24.864+0000 7f6525c23640 1 -- 172.21.15.123:0/2828495213 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f65200cc960 con 0x7f65200cead0 2024-09-15T23:22:25.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.557+0000 7f6507fff640 1 -- 172.21.15.123:0/2828495213 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v180) ==== 170+0+0 (secure 0 0 0) 0x7f6520147800 con 0x7f65200cead0 2024-09-15T23:22:25.558 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' created 2024-09-15T23:22:25.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.559+0000 7f6525c23640 1 -- 172.21.15.123:0/2828495213 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f650c06c2b0 msgr2=0x7f650c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:25.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.559+0000 7f6525c23640 1 --2- 172.21.15.123:0/2828495213 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f650c06c2b0 0x7f650c06e770 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f6520157770 tx=0x7f65100084f0 comp rx=0 tx=0).stop 2024-09-15T23:22:25.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.559+0000 7f6525c23640 1 -- 172.21.15.123:0/2828495213 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65200cead0 msgr2=0x7f652015bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:25.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.559+0000 7f6525c23640 1 --2- 172.21.15.123:0/2828495213 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65200cead0 0x7f652015bd90 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7f651400e660 tx=0x7f651400eb20 comp rx=0 tx=0).stop 2024-09-15T23:22:25.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.559+0000 7f6525c23640 1 -- 172.21.15.123:0/2828495213 shutdown_connections 2024-09-15T23:22:25.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.560+0000 7f6525c23640 1 --2- 172.21.15.123:0/2828495213 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f652015b7c0 0x7f65201f47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:25.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.560+0000 7f6525c23640 1 --2- 172.21.15.123:0/2828495213 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f650c06c2b0 0x7f650c06e770 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:25.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.560+0000 7f6525c23640 1 --2- 172.21.15.123:0/2828495213 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65200cead0 0x7f652015bd90 unknown :-1 s=CLOSED pgs=2069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:25.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.560+0000 7f6525c23640 1 --2- 172.21.15.123:0/2828495213 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65200ccf30 0x7f65201472c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:25.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.560+0000 7f6525c23640 1 -- 172.21.15.123:0/2828495213 >> 172.21.15.123:0/2828495213 conn(0x7f652006d0f0 msgr2=0x7f65200ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:25.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.560+0000 7f6525c23640 1 -- 172.21.15.123:0/2828495213 shutdown_connections 2024-09-15T23:22:25.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.560+0000 7f6525c23640 1 -- 172.21.15.123:0/2828495213 wait complete. 2024-09-15T23:22:25.581 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T23:22:25.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.683+0000 7fa1b49cf640 1 Processor -- start 2024-09-15T23:22:25.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.683+0000 7fa1b49cf640 1 -- start start 2024-09-15T23:22:25.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.684+0000 7fa1b49cf640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa1b006bfd0 0x7fa1b006c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:25.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.684+0000 7fa1b49cf640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1b00d3930 0x7fa1b0162ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:25.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.684+0000 7fa1b49cf640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1b006c8f0 con 0x7fa1b00b3350 2024-09-15T23:22:25.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.684+0000 7fa1b49cf640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fa1b00b78a0 con 0x7fa1b006bfd0 2024-09-15T23:22:25.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.684+0000 7fa1b49cf640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa1b00cffb0 con 0x7fa1b00d3930 2024-09-15T23:22:25.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.684+0000 7fa1ae59c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa1b006bfd0 0x7fa1b006c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:25.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.684+0000 7fa1aed9d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1b00d3930 0x7fa1b0162ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:25.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.684+0000 7fa1add9b640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fa1b00b3350 0x7fa1b01623a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:36586/0 (socket says 172.21.15.123:36586) 2024-09-15T23:22:25.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.684+0000 7fa1add9b640 1 -- 172.21.15.123:0/677471583 learned_addr learned my addr 172.21.15.123:0/677471583 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:25.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.684+0000 7fa1ad59a640 1 -- 172.21.15.123:0/677471583 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1955662626 0 0) 0x7fa1b006c8f0 con 0x7fa1b00b3350 2024-09-15T23:22:25.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.684+0000 7fa1ad59a640 1 -- 172.21.15.123:0/677471583 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa19c003520 con 0x7fa1b00b3350 2024-09-15T23:22:25.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.684+0000 7fa1aed9d640 1 -- 172.21.15.123:0/677471583 >> v2:172.21.15.188:3300/0 conn(0x7fa1b006bfd0 msgr2=0x7fa1b006c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:25.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.684+0000 7fa1aed9d640 1 --2- 172.21.15.123:0/677471583 >> v2:172.21.15.188:3300/0 conn(0x7fa1b006bfd0 0x7fa1b006c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:25.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.684+0000 7fa1aed9d640 1 -- 172.21.15.123:0/677471583 >> v1:172.21.15.188:6789/0 conn(0x7fa1b00b3350 legacy=0x7fa1b01623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:25.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.684+0000 7fa1aed9d640 1 -- 172.21.15.123:0/677471583 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1b00cf710 con 0x7fa1b00d3930 2024-09-15T23:22:25.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.684+0000 7fa1ae59c640 1 --2- 172.21.15.123:0/677471583 >> v2:172.21.15.188:3300/0 conn(0x7fa1b006bfd0 0x7fa1b006c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:22:25.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.685+0000 7fa1aed9d640 1 --2- 172.21.15.123:0/677471583 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1b00d3930 0x7fa1b0162ab0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa1a00097a0 tx=0x7fa1a002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d99728f13fcf92f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:25.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.685+0000 7fa1ad59a640 1 -- 172.21.15.123:0/677471583 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a0037070 con 0x7fa1b00d3930 2024-09-15T23:22:25.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.685+0000 7fa1ad59a640 1 -- 172.21.15.123:0/677471583 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1a0032440 con 0x7fa1b00d3930 2024-09-15T23:22:25.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.685+0000 7fa1ad59a640 1 -- 172.21.15.123:0/677471583 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a00327f0 con 0x7fa1b00d3930 2024-09-15T23:22:25.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.686+0000 7fa1b49cf640 1 -- 172.21.15.123:0/677471583 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1b00d3930 msgr2=0x7fa1b0162ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:25.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.686+0000 7fa1b49cf640 1 --2- 172.21.15.123:0/677471583 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1b00d3930 0x7fa1b0162ab0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa1a00097a0 tx=0x7fa1a002a180 comp rx=0 tx=0).stop 2024-09-15T23:22:25.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.686+0000 7fa1b49cf640 1 -- 172.21.15.123:0/677471583 shutdown_connections 2024-09-15T23:22:25.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.686+0000 7fa1b49cf640 1 --2- 172.21.15.123:0/677471583 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1b00d3930 0x7fa1b0162ab0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:25.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.686+0000 7fa1b49cf640 1 --2- 172.21.15.123:0/677471583 >> v2:172.21.15.188:3300/0 conn(0x7fa1b006bfd0 0x7fa1b006c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:25.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.686+0000 7fa1b49cf640 1 -- 172.21.15.123:0/677471583 >> 172.21.15.123:0/677471583 conn(0x7fa1b00d11c0 msgr2=0x7fa1b00d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:25.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.686+0000 7fa1b49cf640 1 -- 172.21.15.123:0/677471583 shutdown_connections 2024-09-15T23:22:25.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.686+0000 7fa1b49cf640 1 -- 172.21.15.123:0/677471583 wait complete. 2024-09-15T23:22:25.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.687+0000 7fa1b49cf640 1 Processor -- start 2024-09-15T23:22:25.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.687+0000 7fa1b49cf640 1 -- start start 2024-09-15T23:22:25.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.688+0000 7fa1b49cf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa1b006bfd0 0x7fa1b015cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:25.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.688+0000 7fa1b49cf640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1b00b3350 0x7fa1b00cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:25.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.688+0000 7fa1b49cf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1b00d3930 0x7fa1b00cc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:25.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.688+0000 7fa1b49cf640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b00d2400 con 0x7fa1b00d3930 2024-09-15T23:22:25.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.688+0000 7fa1b49cf640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b00cfcd0 con 0x7fa1b006bfd0 2024-09-15T23:22:25.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.688+0000 7fa1b49cf640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa1b006cd50 con 0x7fa1b00b3350 2024-09-15T23:22:25.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.688+0000 7fa1aed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1b00d3930 0x7fa1b00cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:25.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.688+0000 7fa1aed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1b00d3930 0x7fa1b00cc000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55114/0 (socket says 172.21.15.123:55114) 2024-09-15T23:22:25.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.688+0000 7fa1aed9d640 1 -- 172.21.15.123:0/2040638395 learned_addr learned my addr 172.21.15.123:0/2040638395 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:25.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.688+0000 7fa1ae59c640 1 --2- 172.21.15.123:0/2040638395 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa1b006bfd0 0x7fa1b015cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:25.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.688+0000 7fa1add9b640 1 --2- 172.21.15.123:0/2040638395 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1b00b3350 0x7fa1b00cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:25.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.689+0000 7fa1aed9d640 1 -- 172.21.15.123:0/2040638395 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1b00b3350 msgr2=0x7fa1b00cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:25.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.689+0000 7fa1aed9d640 1 --2- 172.21.15.123:0/2040638395 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1b00b3350 0x7fa1b00cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:25.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.689+0000 7fa1aed9d640 1 -- 172.21.15.123:0/2040638395 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa1b006bfd0 msgr2=0x7fa1b015cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:25.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.689+0000 7fa1aed9d640 1 --2- 172.21.15.123:0/2040638395 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa1b006bfd0 0x7fa1b015cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:25.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.689+0000 7fa1aed9d640 1 -- 172.21.15.123:0/2040638395 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1b015ecf0 con 0x7fa1b00d3930 2024-09-15T23:22:25.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.689+0000 7fa1add9b640 1 --2- 172.21.15.123:0/2040638395 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1b00b3350 0x7fa1b00cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:25.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.689+0000 7fa1aed9d640 1 --2- 172.21.15.123:0/2040638395 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1b00d3930 0x7fa1b00cc000 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7fa1a00098c0 tx=0x7fa1a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:25.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.689+0000 7fa1a6ffd640 1 -- 172.21.15.123:0/2040638395 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a0037050 con 0x7fa1b00d3930 2024-09-15T23:22:25.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.689+0000 7fa1a6ffd640 1 -- 172.21.15.123:0/2040638395 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1a0043070 con 0x7fa1b00d3930 2024-09-15T23:22:25.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.689+0000 7fa1b49cf640 1 -- 172.21.15.123:0/2040638395 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1b015efd0 con 0x7fa1b00d3930 2024-09-15T23:22:25.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.689+0000 7fa1a6ffd640 1 -- 172.21.15.123:0/2040638395 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a0006e10 con 0x7fa1b00d3930 2024-09-15T23:22:25.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.689+0000 7fa1b49cf640 1 -- 172.21.15.123:0/2040638395 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1b015f590 con 0x7fa1b00d3930 2024-09-15T23:22:25.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.690+0000 7fa1b49cf640 1 -- 172.21.15.123:0/2040638395 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1b015eae0 con 0x7fa1b00d3930 2024-09-15T23:22:25.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.690+0000 7fa1a6ffd640 1 -- 172.21.15.123:0/2040638395 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa1a0032810 con 0x7fa1b00d3930 2024-09-15T23:22:25.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.691+0000 7fa1a6ffd640 1 --2- 172.21.15.123:0/2040638395 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa19006c2b0 0x7fa19006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:25.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.691+0000 7fa1a6ffd640 1 -- 172.21.15.123:0/2040638395 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 5609+0+0 (secure 0 0 0) 0x7fa1a00abd10 con 0x7fa1b00d3930 2024-09-15T23:22:25.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.691+0000 7fa1ae59c640 1 --2- 172.21.15.123:0/2040638395 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa19006c2b0 0x7fa19006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:25.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.692+0000 7fa1ae59c640 1 --2- 172.21.15.123:0/2040638395 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa19006c2b0 0x7fa19006e770 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fa1b00c7ef0 tx=0x7fa1a8009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:25.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.696+0000 7fa1a6ffd640 1 -- 172.21.15.123:0/2040638395 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa1a007a4e0 con 0x7fa1b00d3930 2024-09-15T23:22:25.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:25.895+0000 7fa1b49cf640 1 -- 172.21.15.123:0/2040638395 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fa1b00d0cf0 con 0x7fa1b00d3930 2024-09-15T23:22:26.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.571+0000 7fa1a6ffd640 1 -- 172.21.15.123:0/2040638395 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 24 and data pool 25 v108) ==== 174+0+0 (secure 0 0 0) 0x7fa1a0079de0 con 0x7fa1b00d3930 2024-09-15T23:22:26.573 INFO:teuthology.orchestra.run.smithi123.stderr:new fs with metadata pool 24 and data pool 25 2024-09-15T23:22:26.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.581+0000 7fa1b49cf640 1 -- 172.21.15.123:0/2040638395 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa19006c2b0 msgr2=0x7fa19006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:26.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.581+0000 7fa1b49cf640 1 --2- 172.21.15.123:0/2040638395 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa19006c2b0 0x7fa19006e770 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fa1b00c7ef0 tx=0x7fa1a8009190 comp rx=0 tx=0).stop 2024-09-15T23:22:26.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.581+0000 7fa1b49cf640 1 -- 172.21.15.123:0/2040638395 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1b00d3930 msgr2=0x7fa1b00cc000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:26.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.581+0000 7fa1b49cf640 1 --2- 172.21.15.123:0/2040638395 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1b00d3930 0x7fa1b00cc000 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7fa1a00098c0 tx=0x7fa1a00046c0 comp rx=0 tx=0).stop 2024-09-15T23:22:26.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.581+0000 7fa1b49cf640 1 -- 172.21.15.123:0/2040638395 shutdown_connections 2024-09-15T23:22:26.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.581+0000 7fa1b49cf640 1 --2- 172.21.15.123:0/2040638395 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa19006c2b0 0x7fa19006e770 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:26.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.581+0000 7fa1b49cf640 1 --2- 172.21.15.123:0/2040638395 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa1b00d3930 0x7fa1b00cc000 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:26.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.581+0000 7fa1b49cf640 1 --2- 172.21.15.123:0/2040638395 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa1b00b3350 0x7fa1b00cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:26.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.581+0000 7fa1b49cf640 1 --2- 172.21.15.123:0/2040638395 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa1b006bfd0 0x7fa1b015cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:26.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.581+0000 7fa1b49cf640 1 -- 172.21.15.123:0/2040638395 >> 172.21.15.123:0/2040638395 conn(0x7fa1b00d11c0 msgr2=0x7fa1b00b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:26.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.582+0000 7fa1b49cf640 1 -- 172.21.15.123:0/2040638395 shutdown_connections 2024-09-15T23:22:26.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.582+0000 7fa1b49cf640 1 -- 172.21.15.123:0/2040638395 wait complete. 2024-09-15T23:22:26.601 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:22:26.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.701+0000 7f3728db7640 1 Processor -- start 2024-09-15T23:22:26.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.702+0000 7f3728db7640 1 -- start start 2024-09-15T23:22:26.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.702+0000 7f3728db7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f372406f390 0x7f372406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:26.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.702+0000 7f3728db7640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37240b4270 con 0x7f372415fab0 2024-09-15T23:22:26.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.702+0000 7f3728db7640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37240b3f90 con 0x7f3724158d80 2024-09-15T23:22:26.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.702+0000 7f3728db7640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f372415efd0 con 0x7f372406f390 2024-09-15T23:22:26.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.703+0000 7f3721d9b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f372406f390 0x7f372406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:26.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.703+0000 7f3722d9d640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f372415fab0 0x7f372406e170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36734/0 (socket says 172.21.15.123:36734) 2024-09-15T23:22:26.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.703+0000 7f3722d9d640 1 -- 172.21.15.123:0/1100796221 learned_addr learned my addr 172.21.15.123:0/1100796221 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:26.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.703+0000 7f3721d9b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f372406f390 0x7f372406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35352/0 (socket says 172.21.15.123:35352) 2024-09-15T23:22:26.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.703+0000 7f3721d9b640 1 -- 172.21.15.123:0/1100796221 >> v1:172.21.15.188:6789/0 conn(0x7f3724158d80 legacy=0x7f37240b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:26.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.703+0000 7f3721d9b640 1 -- 172.21.15.123:0/1100796221 >> v1:172.21.15.123:6789/0 conn(0x7f372415fab0 legacy=0x7f372406e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:26.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.703+0000 7f3721d9b640 1 -- 172.21.15.123:0/1100796221 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f372415f2b0 con 0x7f372406f390 2024-09-15T23:22:26.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.703+0000 7f372159a640 1 -- 172.21.15.123:0/1100796221 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2117952197 0 0) 0x7f37240b4270 con 0x7f372415fab0 2024-09-15T23:22:26.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.704+0000 7f3721d9b640 1 --2- 172.21.15.123:0/1100796221 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f372406f390 0x7f372406bc10 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7f3718009d90 tx=0x7f371802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93bdd047d6756fe7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:26.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.704+0000 7f372159a640 1 -- 172.21.15.123:0/1100796221 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3718007740 con 0x7f372406f390 2024-09-15T23:22:26.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.704+0000 7f372159a640 1 -- 172.21.15.123:0/1100796221 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37180078e0 con 0x7f372406f390 2024-09-15T23:22:26.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.704+0000 7f372159a640 1 -- 172.21.15.123:0/1100796221 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3718007cb0 con 0x7f372406f390 2024-09-15T23:22:26.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.704+0000 7f3728db7640 1 -- 172.21.15.123:0/1100796221 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f372406f390 msgr2=0x7f372406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:26.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.704+0000 7f3728db7640 1 --2- 172.21.15.123:0/1100796221 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f372406f390 0x7f372406bc10 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7f3718009d90 tx=0x7f371802a6a0 comp rx=0 tx=0).stop 2024-09-15T23:22:26.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.704+0000 7f3728db7640 1 -- 172.21.15.123:0/1100796221 shutdown_connections 2024-09-15T23:22:26.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.704+0000 7f3728db7640 1 --2- 172.21.15.123:0/1100796221 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f372406f390 0x7f372406bc10 unknown :-1 s=CLOSED pgs=2072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:26.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.704+0000 7f3728db7640 1 -- 172.21.15.123:0/1100796221 >> 172.21.15.123:0/1100796221 conn(0x7f372406cd20 msgr2=0x7f372406d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:26.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.704+0000 7f3728db7640 1 -- 172.21.15.123:0/1100796221 shutdown_connections 2024-09-15T23:22:26.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.704+0000 7f3728db7640 1 -- 172.21.15.123:0/1100796221 wait complete. 2024-09-15T23:22:26.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.706+0000 7f3728db7640 1 Processor -- start 2024-09-15T23:22:26.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.706+0000 7f3728db7640 1 -- start start 2024-09-15T23:22:26.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.706+0000 7f3728db7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f372406f390 0x7f37240b5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:26.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.706+0000 7f3728db7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3724158d80 0x7f37241531e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:26.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.706+0000 7f3728db7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f372415fab0 0x7f37241544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:26.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.706+0000 7f3728db7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f37241592e0 con 0x7f372406f390 2024-09-15T23:22:26.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.706+0000 7f3728db7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3724159160 con 0x7f3724158d80 2024-09-15T23:22:26.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.706+0000 7f3728db7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f372406c150 con 0x7f372415fab0 2024-09-15T23:22:26.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.707+0000 7f372259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f372406f390 0x7f37240b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:26.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.707+0000 7f372259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f372406f390 0x7f37240b5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35364/0 (socket says 172.21.15.123:35364) 2024-09-15T23:22:26.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.707+0000 7f372259c640 1 -- 172.21.15.123:0/619019312 learned_addr learned my addr 172.21.15.123:0/619019312 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:26.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.707+0000 7f3721d9b640 1 --2- 172.21.15.123:0/619019312 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3724158d80 0x7f37241531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:26.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.707+0000 7f3722d9d640 1 --2- 172.21.15.123:0/619019312 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f372415fab0 0x7f37241544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:26.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.707+0000 7f372259c640 1 -- 172.21.15.123:0/619019312 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f372415fab0 msgr2=0x7f37241544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:26.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.707+0000 7f372259c640 1 --2- 172.21.15.123:0/619019312 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f372415fab0 0x7f37241544c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:26.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.707+0000 7f372259c640 1 -- 172.21.15.123:0/619019312 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3724158d80 msgr2=0x7f37241531e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:26.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.707+0000 7f372259c640 1 --2- 172.21.15.123:0/619019312 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3724158d80 0x7f37241531e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:26.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.707+0000 7f372259c640 1 -- 172.21.15.123:0/619019312 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f372415b7d0 con 0x7f372406f390 2024-09-15T23:22:26.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.707+0000 7f3721d9b640 1 --2- 172.21.15.123:0/619019312 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3724158d80 0x7f37241531e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:22:26.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.707+0000 7f3722d9d640 1 --2- 172.21.15.123:0/619019312 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f372415fab0 0x7f37241544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:22:26.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.707+0000 7f372259c640 1 --2- 172.21.15.123:0/619019312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f372406f390 0x7f37240b5070 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7f371c00c430 tx=0x7f371c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:26.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.707+0000 7f3712ffd640 1 -- 172.21.15.123:0/619019312 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c011790 con 0x7f372406f390 2024-09-15T23:22:26.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.707+0000 7f3712ffd640 1 -- 172.21.15.123:0/619019312 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f371c017070 con 0x7f372406f390 2024-09-15T23:22:26.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.707+0000 7f3712ffd640 1 -- 172.21.15.123:0/619019312 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c011bb0 con 0x7f372406f390 2024-09-15T23:22:26.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.707+0000 7f3728db7640 1 -- 172.21.15.123:0/619019312 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3724155190 con 0x7f372406f390 2024-09-15T23:22:26.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.707+0000 7f3728db7640 1 -- 172.21.15.123:0/619019312 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f372415b4f0 con 0x7f372406f390 2024-09-15T23:22:26.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.708+0000 7f3728db7640 1 -- 172.21.15.123:0/619019312 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f372406c490 con 0x7f372406f390 2024-09-15T23:22:26.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.709+0000 7f3712ffd640 1 -- 172.21.15.123:0/619019312 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f371c01c460 con 0x7f372406f390 2024-09-15T23:22:26.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.709+0000 7f3712ffd640 1 --2- 172.21.15.123:0/619019312 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f370406c2b0 0x7f370406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:26.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.709+0000 7f3712ffd640 1 -- 172.21.15.123:0/619019312 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(181..181 src has 1..181) ==== 5709+0+0 (secure 0 0 0) 0x7f371c08b310 con 0x7f372406f390 2024-09-15T23:22:26.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.709+0000 7f3721d9b640 1 --2- 172.21.15.123:0/619019312 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f370406c2b0 0x7f370406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:26.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.710+0000 7f3721d9b640 1 --2- 172.21.15.123:0/619019312 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f370406c2b0 0x7f370406e770 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f3718034000 tx=0x7f371802f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:26.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.713+0000 7f3712ffd640 1 -- 172.21.15.123:0/619019312 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f372415b7d0 con 0x7f372406f390 2024-09-15T23:22:26.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.880+0000 7f3728db7640 1 -- 172.21.15.123:0/619019312 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f37240d1300 con 0x7f372406f390 2024-09-15T23:22:26.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.881+0000 7f3712ffd640 1 -- 172.21.15.123:0/619019312 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v181) ==== 74+0+16720 (secure 0 0 0) 0x7f371c059a80 con 0x7f372406f390 2024-09-15T23:22:26.882 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:22:26.883 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":181,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:22:25.896226+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:22:23.593537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-15T23:22:24.884391+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:22:26.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.883+0000 7f3728db7640 1 -- 172.21.15.123:0/619019312 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f370406c2b0 msgr2=0x7f370406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:26.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.883+0000 7f3728db7640 1 --2- 172.21.15.123:0/619019312 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f370406c2b0 0x7f370406e770 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f3718034000 tx=0x7f371802f000 comp rx=0 tx=0).stop 2024-09-15T23:22:26.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.883+0000 7f3728db7640 1 -- 172.21.15.123:0/619019312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f372406f390 msgr2=0x7f37240b5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:26.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.883+0000 7f3728db7640 1 --2- 172.21.15.123:0/619019312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f372406f390 0x7f37240b5070 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7f371c00c430 tx=0x7f371c00c8f0 comp rx=0 tx=0).stop 2024-09-15T23:22:26.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.883+0000 7f3728db7640 1 -- 172.21.15.123:0/619019312 shutdown_connections 2024-09-15T23:22:26.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.883+0000 7f3728db7640 1 --2- 172.21.15.123:0/619019312 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f372415fab0 0x7f37241544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:26.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.884+0000 7f3728db7640 1 --2- 172.21.15.123:0/619019312 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3724158d80 0x7f37241531e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:26.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.884+0000 7f3728db7640 1 --2- 172.21.15.123:0/619019312 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f370406c2b0 0x7f370406e770 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:26.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.884+0000 7f3728db7640 1 --2- 172.21.15.123:0/619019312 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f372406f390 0x7f37240b5070 unknown :-1 s=CLOSED pgs=2073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:26.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.884+0000 7f3728db7640 1 -- 172.21.15.123:0/619019312 >> 172.21.15.123:0/619019312 conn(0x7f372406cd20 msgr2=0x7f372415d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:26.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.884+0000 7f3728db7640 1 -- 172.21.15.123:0/619019312 shutdown_connections 2024-09-15T23:22:26.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.884+0000 7f3728db7640 1 -- 172.21.15.123:0/619019312 wait complete. 2024-09-15T23:22:26.896 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:22:26.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.992+0000 7f0469801640 1 Processor -- start 2024-09-15T23:22:26.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.992+0000 7f0469801640 1 -- start start 2024-09-15T23:22:26.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.993+0000 7f0469801640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f04640cec20 0x7f046406f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:26.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.993+0000 7f0469801640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f046406f940 0x7f046406def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:26.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.993+0000 7f0469801640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04640d21a0 con 0x7f046415e660 2024-09-15T23:22:26.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.993+0000 7f0469801640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f046415ea40 con 0x7f04640cec20 2024-09-15T23:22:26.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.993+0000 7f0469801640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f046406fd90 con 0x7f046406f940 2024-09-15T23:22:26.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.993+0000 7f04627fc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f04640cec20 0x7f046406f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:26.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.993+0000 7f04627fc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f04640cec20 0x7f046406f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35380/0 (socket says 172.21.15.123:35380) 2024-09-15T23:22:26.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.993+0000 7f04627fc640 1 -- 172.21.15.123:0/76476238 learned_addr learned my addr 172.21.15.123:0/76476238 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:26.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.993+0000 7f04637fe640 1 --2- 172.21.15.123:0/76476238 >> v2:172.21.15.188:3300/0 conn(0x7f046406f940 0x7f046406def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:26.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.994+0000 7f04627fc640 1 -- 172.21.15.123:0/76476238 >> v2:172.21.15.188:3300/0 conn(0x7f046406f940 msgr2=0x7f046406def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:26.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.994+0000 7f04627fc640 1 --2- 172.21.15.123:0/76476238 >> v2:172.21.15.188:3300/0 conn(0x7f046406f940 0x7f046406def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:26.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.994+0000 7f04627fc640 1 -- 172.21.15.123:0/76476238 >> v1:172.21.15.188:6789/0 conn(0x7f046415e660 legacy=0x7f04640d1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:26.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.994+0000 7f04627fc640 1 -- 172.21.15.123:0/76476238 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f046406ce50 con 0x7f04640cec20 2024-09-15T23:22:26.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.994+0000 7f04627fc640 1 --2- 172.21.15.123:0/76476238 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04640cec20 0x7f046406f400 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7f04640b5a60 tx=0x7f044c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94fa00b77ea47fe6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:26.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.995+0000 7f0461ffb640 1 -- 172.21.15.123:0/76476238 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c037070 con 0x7f04640cec20 2024-09-15T23:22:26.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.995+0000 7f0461ffb640 1 -- 172.21.15.123:0/76476238 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f044c032440 con 0x7f04640cec20 2024-09-15T23:22:26.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.995+0000 7f0461ffb640 1 -- 172.21.15.123:0/76476238 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c032810 con 0x7f04640cec20 2024-09-15T23:22:26.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.995+0000 7f0469801640 1 -- 172.21.15.123:0/76476238 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04640cec20 msgr2=0x7f046406f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:26.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.995+0000 7f0469801640 1 --2- 172.21.15.123:0/76476238 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04640cec20 0x7f046406f400 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7f04640b5a60 tx=0x7f044c02a210 comp rx=0 tx=0).stop 2024-09-15T23:22:26.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.995+0000 7f0469801640 1 -- 172.21.15.123:0/76476238 shutdown_connections 2024-09-15T23:22:26.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.995+0000 7f0469801640 1 --2- 172.21.15.123:0/76476238 >> v2:172.21.15.188:3300/0 conn(0x7f046406f940 0x7f046406def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:26.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.995+0000 7f0469801640 1 --2- 172.21.15.123:0/76476238 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f04640cec20 0x7f046406f400 unknown :-1 s=CLOSED pgs=2074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:26.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.995+0000 7f0469801640 1 -- 172.21.15.123:0/76476238 >> 172.21.15.123:0/76476238 conn(0x7f04640b41b0 msgr2=0x7f04640b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:26.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.995+0000 7f0469801640 1 -- 172.21.15.123:0/76476238 shutdown_connections 2024-09-15T23:22:26.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.995+0000 7f0469801640 1 -- 172.21.15.123:0/76476238 wait complete. 2024-09-15T23:22:26.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.996+0000 7f0469801640 1 Processor -- start 2024-09-15T23:22:27.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.996+0000 7f0469801640 1 -- start start 2024-09-15T23:22:27.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.997+0000 7f0469801640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f046406f940 0x7f046415a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:27.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.997+0000 7f0469801640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04640cec20 0x7f04640abcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:27.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.997+0000 7f0469801640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f046415e660 0x7f0464160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:27.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.997+0000 7f0469801640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f046406d6f0 con 0x7f046415e660 2024-09-15T23:22:27.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.997+0000 7f0469801640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f046406d410 con 0x7f046406f940 2024-09-15T23:22:27.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.997+0000 7f0469801640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f046406d9d0 con 0x7f04640cec20 2024-09-15T23:22:27.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.997+0000 7f04637fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f046415e660 0x7f0464160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:27.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.997+0000 7f04637fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f046415e660 0x7f0464160fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35396/0 (socket says 172.21.15.123:35396) 2024-09-15T23:22:27.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.997+0000 7f04637fe640 1 -- 172.21.15.123:0/1928871582 learned_addr learned my addr 172.21.15.123:0/1928871582 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:27.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.997+0000 7f0462ffd640 1 --2- 172.21.15.123:0/1928871582 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f046406f940 0x7f046415a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:27.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.997+0000 7f04627fc640 1 --2- 172.21.15.123:0/1928871582 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04640cec20 0x7f04640abcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:27.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.997+0000 7f04637fe640 1 -- 172.21.15.123:0/1928871582 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04640cec20 msgr2=0x7f04640abcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:27.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.997+0000 7f04637fe640 1 --2- 172.21.15.123:0/1928871582 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04640cec20 0x7f04640abcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:27.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.997+0000 7f04637fe640 1 -- 172.21.15.123:0/1928871582 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f046406f940 msgr2=0x7f046415a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:27.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.997+0000 7f04637fe640 1 --2- 172.21.15.123:0/1928871582 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f046406f940 0x7f046415a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:27.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.997+0000 7f04637fe640 1 -- 172.21.15.123:0/1928871582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04640cd920 con 0x7f046415e660 2024-09-15T23:22:27.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.997+0000 7f04627fc640 1 --2- 172.21.15.123:0/1928871582 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04640cec20 0x7f04640abcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:27.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.998+0000 7f04637fe640 1 --2- 172.21.15.123:0/1928871582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f046415e660 0x7f0464160fe0 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7f045c00efc0 tx=0x7f045c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:27.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.998+0000 7f045b7fe640 1 -- 172.21.15.123:0/1928871582 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045c018020 con 0x7f046415e660 2024-09-15T23:22:27.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.998+0000 7f045b7fe640 1 -- 172.21.15.123:0/1928871582 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f045c014480 con 0x7f046415e660 2024-09-15T23:22:27.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.998+0000 7f0469801640 1 -- 172.21.15.123:0/1928871582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04640cdc00 con 0x7f046415e660 2024-09-15T23:22:27.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.998+0000 7f045b7fe640 1 -- 172.21.15.123:0/1928871582 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045c014870 con 0x7f046415e660 2024-09-15T23:22:27.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.998+0000 7f0469801640 1 -- 172.21.15.123:0/1928871582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04640ce1c0 con 0x7f046415e660 2024-09-15T23:22:27.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.999+0000 7f0469801640 1 -- 172.21.15.123:0/1928871582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04640b56e0 con 0x7f046415e660 2024-09-15T23:22:27.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:26.999+0000 7f045b7fe640 1 -- 172.21.15.123:0/1928871582 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f045c005d10 con 0x7f046415e660 2024-09-15T23:22:27.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.000+0000 7f045b7fe640 1 --2- 172.21.15.123:0/1928871582 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f044406c2b0 0x7f044406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:27.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.000+0000 7f045b7fe640 1 -- 172.21.15.123:0/1928871582 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(181..181 src has 1..181) ==== 5709+0+0 (secure 0 0 0) 0x7f045c08be30 con 0x7f046415e660 2024-09-15T23:22:27.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.000+0000 7f0462ffd640 1 --2- 172.21.15.123:0/1928871582 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f044406c2b0 0x7f044406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:27.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.000+0000 7f0462ffd640 1 --2- 172.21.15.123:0/1928871582 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f044406c2b0 0x7f044406e770 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f04640b3410 tx=0x7f0454009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:27.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.004+0000 7f045b7fe640 1 -- 172.21.15.123:0/1928871582 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f045c022070 con 0x7f046415e660 2024-09-15T23:22:27.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.170+0000 7f0469801640 1 -- 172.21.15.123:0/1928871582 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0464069b20 con 0x7f046415e660 2024-09-15T23:22:27.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.171+0000 7f045b7fe640 1 -- 172.21.15.123:0/1928871582 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v181) ==== 74+0+16720 (secure 0 0 0) 0x7f045c010040 con 0x7f046415e660 2024-09-15T23:22:27.172 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:22:27.172 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":181,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:22:25.896226+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:22:23.593537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-15T23:22:24.884391+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:22:27.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.173+0000 7f0469801640 1 -- 172.21.15.123:0/1928871582 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f044406c2b0 msgr2=0x7f044406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:27.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.173+0000 7f0469801640 1 --2- 172.21.15.123:0/1928871582 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f044406c2b0 0x7f044406e770 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f04640b3410 tx=0x7f0454009040 comp rx=0 tx=0).stop 2024-09-15T23:22:27.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.173+0000 7f0469801640 1 -- 172.21.15.123:0/1928871582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f046415e660 msgr2=0x7f0464160fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:27.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.173+0000 7f0469801640 1 --2- 172.21.15.123:0/1928871582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f046415e660 0x7f0464160fe0 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7f045c00efc0 tx=0x7f045c00c490 comp rx=0 tx=0).stop 2024-09-15T23:22:27.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.173+0000 7f0469801640 1 -- 172.21.15.123:0/1928871582 shutdown_connections 2024-09-15T23:22:27.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.173+0000 7f0469801640 1 --2- 172.21.15.123:0/1928871582 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f044406c2b0 0x7f044406e770 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:27.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.173+0000 7f0469801640 1 --2- 172.21.15.123:0/1928871582 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f046415e660 0x7f0464160fe0 unknown :-1 s=CLOSED pgs=2075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:27.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.173+0000 7f0469801640 1 --2- 172.21.15.123:0/1928871582 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04640cec20 0x7f04640abcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:27.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.173+0000 7f0469801640 1 --2- 172.21.15.123:0/1928871582 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f046406f940 0x7f046415a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:27.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.173+0000 7f0469801640 1 -- 172.21.15.123:0/1928871582 >> 172.21.15.123:0/1928871582 conn(0x7f04640b41b0 msgr2=0x7f04640cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:27.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.173+0000 7f0469801640 1 -- 172.21.15.123:0/1928871582 shutdown_connections 2024-09-15T23:22:27.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.173+0000 7f0469801640 1 -- 172.21.15.123:0/1928871582 wait complete. 2024-09-15T23:22:27.186 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T23:22:27.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.287+0000 7facd75d8640 1 Processor -- start 2024-09-15T23:22:27.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.287+0000 7facd75d8640 1 -- start start 2024-09-15T23:22:27.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.288+0000 7facd75d8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7facd00ccf30 0x7facd00b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:27.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.288+0000 7facd75d8640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7facd015b7c0 0x7facd00cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:27.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.288+0000 7facd75d8640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facd00cd850 con 0x7facd00cead0 2024-09-15T23:22:27.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.288+0000 7facd75d8640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7facd00cf2e0 con 0x7facd00ccf30 2024-09-15T23:22:27.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.288+0000 7facd75d8640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7facd0070fe0 con 0x7facd015b7c0 2024-09-15T23:22:27.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.288+0000 7facd5374640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7facd00ccf30 0x7facd00b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:27.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.288+0000 7facd4b73640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7facd015b7c0 0x7facd00cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:27.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.288+0000 7facd5374640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7facd00ccf30 0x7facd00b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:55612/0 (socket says 172.21.15.123:55612) 2024-09-15T23:22:27.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.288+0000 7facd5374640 1 -- 172.21.15.123:0/393141918 learned_addr learned my addr 172.21.15.123:0/393141918 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:27.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.288+0000 7facd5374640 1 -- 172.21.15.123:0/393141918 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7facd015b7c0 msgr2=0x7facd00cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:27.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.288+0000 7facd5374640 1 --2- 172.21.15.123:0/393141918 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7facd015b7c0 0x7facd00cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:27.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.288+0000 7facd5374640 1 -- 172.21.15.123:0/393141918 >> v1:172.21.15.188:6789/0 conn(0x7facd00cead0 legacy=0x7facd015f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:27.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.288+0000 7facd5374640 1 -- 172.21.15.123:0/393141918 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facd00712c0 con 0x7facd00ccf30 2024-09-15T23:22:27.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.289+0000 7facd5374640 1 --2- 172.21.15.123:0/393141918 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facd00ccf30 0x7facd00b2c50 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7faccc009870 tx=0x7faccc02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e8dd6a869dab463 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:27.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.289+0000 7facc7fff640 1 -- 172.21.15.123:0/393141918 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faccc037070 con 0x7facd00ccf30 2024-09-15T23:22:27.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.289+0000 7facc7fff640 1 -- 172.21.15.123:0/393141918 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faccc032440 con 0x7facd00ccf30 2024-09-15T23:22:27.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.289+0000 7facc7fff640 1 -- 172.21.15.123:0/393141918 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faccc032810 con 0x7facd00ccf30 2024-09-15T23:22:27.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.290+0000 7facd75d8640 1 -- 172.21.15.123:0/393141918 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facd00ccf30 msgr2=0x7facd00b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:27.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.290+0000 7facd75d8640 1 --2- 172.21.15.123:0/393141918 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facd00ccf30 0x7facd00b2c50 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7faccc009870 tx=0x7faccc02a1c0 comp rx=0 tx=0).stop 2024-09-15T23:22:27.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.290+0000 7facd75d8640 1 -- 172.21.15.123:0/393141918 shutdown_connections 2024-09-15T23:22:27.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.290+0000 7facd75d8640 1 --2- 172.21.15.123:0/393141918 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7facd015b7c0 0x7facd00cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:27.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.290+0000 7facd75d8640 1 --2- 172.21.15.123:0/393141918 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facd00ccf30 0x7facd00b2c50 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:27.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.290+0000 7facd75d8640 1 -- 172.21.15.123:0/393141918 >> 172.21.15.123:0/393141918 conn(0x7facd006d0f0 msgr2=0x7facd006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:27.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.290+0000 7facd75d8640 1 -- 172.21.15.123:0/393141918 shutdown_connections 2024-09-15T23:22:27.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.290+0000 7facd75d8640 1 -- 172.21.15.123:0/393141918 wait complete. 2024-09-15T23:22:27.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.291+0000 7facd75d8640 1 Processor -- start 2024-09-15T23:22:27.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.291+0000 7facd75d8640 1 -- start start 2024-09-15T23:22:27.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.292+0000 7facd75d8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facd00ccf30 0x7facd0147af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:27.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.292+0000 7facd75d8640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7facd00cead0 0x7facd0150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:27.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.292+0000 7facd75d8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facd015b7c0 0x7facd014d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:27.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.292+0000 7facd75d8640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7facd00cef20 con 0x7facd00ccf30 2024-09-15T23:22:27.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.292+0000 7facd75d8640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7facd00cf5c0 con 0x7facd015b7c0 2024-09-15T23:22:27.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.292+0000 7facd75d8640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7facd00cf0a0 con 0x7facd00cead0 2024-09-15T23:22:27.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.292+0000 7facd5374640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facd00ccf30 0x7facd0147af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:27.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.292+0000 7facd5374640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facd00ccf30 0x7facd0147af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35402/0 (socket says 172.21.15.123:35402) 2024-09-15T23:22:27.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.292+0000 7facd5374640 1 -- 172.21.15.123:0/3856653322 learned_addr learned my addr 172.21.15.123:0/3856653322 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:27.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.292+0000 7facd5374640 1 -- 172.21.15.123:0/3856653322 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7facd00cead0 msgr2=0x7facd0150b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:27.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.292+0000 7facd4b73640 1 --2- 172.21.15.123:0/3856653322 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7facd00cead0 0x7facd0150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:27.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.292+0000 7facd5374640 1 --2- 172.21.15.123:0/3856653322 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7facd00cead0 0x7facd0150b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:27.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.292+0000 7facd5374640 1 -- 172.21.15.123:0/3856653322 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facd015b7c0 msgr2=0x7facd014d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:27.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.292+0000 7facd5b75640 1 --2- 172.21.15.123:0/3856653322 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facd015b7c0 0x7facd014d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:27.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.292+0000 7facd5374640 1 --2- 172.21.15.123:0/3856653322 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facd015b7c0 0x7facd014d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:27.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.292+0000 7facd5374640 1 -- 172.21.15.123:0/3856653322 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facd0165e90 con 0x7facd00ccf30 2024-09-15T23:22:27.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.292+0000 7facd5b75640 1 --2- 172.21.15.123:0/3856653322 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facd015b7c0 0x7facd014d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:22:27.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.293+0000 7facd5374640 1 --2- 172.21.15.123:0/3856653322 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facd00ccf30 0x7facd0147af0 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7faccc02a200 tx=0x7faccc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:27.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.293+0000 7facc5ffb640 1 -- 172.21.15.123:0/3856653322 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faccc037040 con 0x7facd00ccf30 2024-09-15T23:22:27.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.293+0000 7facc5ffb640 1 -- 172.21.15.123:0/3856653322 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faccc042070 con 0x7facd00ccf30 2024-09-15T23:22:27.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.293+0000 7facc5ffb640 1 -- 172.21.15.123:0/3856653322 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faccc030860 con 0x7facd00ccf30 2024-09-15T23:22:27.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.293+0000 7facd75d8640 1 -- 172.21.15.123:0/3856653322 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facd0166170 con 0x7facd00ccf30 2024-09-15T23:22:27.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.293+0000 7facd75d8640 1 -- 172.21.15.123:0/3856653322 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facd015bbd0 con 0x7facd00ccf30 2024-09-15T23:22:27.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.294+0000 7facd75d8640 1 -- 172.21.15.123:0/3856653322 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facd015f7d0 con 0x7facd00ccf30 2024-09-15T23:22:27.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.294+0000 7facc5ffb640 1 -- 172.21.15.123:0/3856653322 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7faccc02ad10 con 0x7facd00ccf30 2024-09-15T23:22:27.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.295+0000 7facc5ffb640 1 --2- 172.21.15.123:0/3856653322 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7facb406c2b0 0x7facb406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:27.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.295+0000 7facc5ffb640 1 -- 172.21.15.123:0/3856653322 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(181..181 src has 1..181) ==== 5709+0+0 (secure 0 0 0) 0x7faccc0ab9e0 con 0x7facd00ccf30 2024-09-15T23:22:27.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.295+0000 7facd4b73640 1 --2- 172.21.15.123:0/3856653322 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7facb406c2b0 0x7facb406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:27.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.295+0000 7facd4b73640 1 --2- 172.21.15.123:0/3856653322 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7facb406c2b0 0x7facb406e770 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7facd0166750 tx=0x7facc0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:27.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.299+0000 7facc5ffb640 1 -- 172.21.15.123:0/3856653322 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7facd015f7d0 con 0x7facd00ccf30 2024-09-15T23:22:27.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.498+0000 7facd75d8640 1 -- 172.21.15.123:0/3856653322 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7facd00cc960 con 0x7facd00ccf30 2024-09-15T23:22:27.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.576+0000 7facc5ffb640 1 -- 172.21.15.123:0/3856653322 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v109) ==== 118+0+0 (secure 0 0 0) 0x7faccc07a150 con 0x7facd00ccf30 2024-09-15T23:22:27.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.578+0000 7facd75d8640 1 -- 172.21.15.123:0/3856653322 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7facb406c2b0 msgr2=0x7facb406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:27.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.578+0000 7facd75d8640 1 --2- 172.21.15.123:0/3856653322 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7facb406c2b0 0x7facb406e770 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7facd0166750 tx=0x7facc0008040 comp rx=0 tx=0).stop 2024-09-15T23:22:27.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.579+0000 7facd75d8640 1 -- 172.21.15.123:0/3856653322 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facd00ccf30 msgr2=0x7facd0147af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:27.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.579+0000 7facd75d8640 1 --2- 172.21.15.123:0/3856653322 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facd00ccf30 0x7facd0147af0 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7faccc02a200 tx=0x7faccc0046c0 comp rx=0 tx=0).stop 2024-09-15T23:22:27.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.579+0000 7facd75d8640 1 -- 172.21.15.123:0/3856653322 shutdown_connections 2024-09-15T23:22:27.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.579+0000 7facd75d8640 1 --2- 172.21.15.123:0/3856653322 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7facd015b7c0 0x7facd014d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:27.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.579+0000 7facd75d8640 1 --2- 172.21.15.123:0/3856653322 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7facd00cead0 0x7facd0150b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:27.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.579+0000 7facd75d8640 1 --2- 172.21.15.123:0/3856653322 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7facb406c2b0 0x7facb406e770 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:27.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.579+0000 7facd75d8640 1 --2- 172.21.15.123:0/3856653322 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7facd00ccf30 0x7facd0147af0 unknown :-1 s=CLOSED pgs=2076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:27.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.579+0000 7facd75d8640 1 -- 172.21.15.123:0/3856653322 >> 172.21.15.123:0/3856653322 conn(0x7facd006d0f0 msgr2=0x7facd00b51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:27.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.579+0000 7facd75d8640 1 -- 172.21.15.123:0/3856653322 shutdown_connections 2024-09-15T23:22:27.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.579+0000 7facd75d8640 1 -- 172.21.15.123:0/3856653322 wait complete. 2024-09-15T23:22:27.591 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T23:22:27.591 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T23:22:27.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.691+0000 7f02c92a4640 1 Processor -- start 2024-09-15T23:22:27.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.691+0000 7f02c92a4640 1 -- start start 2024-09-15T23:22:27.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.692+0000 7f02c92a4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02c40b38a0 0x7f02c40d3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:27.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.692+0000 7f02c92a4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02c40cf710 con 0x7f02c40b3350 2024-09-15T23:22:27.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.692+0000 7f02c92a4640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02c40cf9f0 con 0x7f02c406bfd0 2024-09-15T23:22:27.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.692+0000 7f02c92a4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f02c40b78a0 con 0x7f02c40b38a0 2024-09-15T23:22:27.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.692+0000 7f02c27fc640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f02c40b3350 0x7f02c40d2920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36750/0 (socket says 172.21.15.123:36750) 2024-09-15T23:22:27.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.692+0000 7f02c27fc640 1 -- 172.21.15.123:0/4008091888 learned_addr learned my addr 172.21.15.123:0/4008091888 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:27.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.693+0000 7f02c37fe640 1 --2- 172.21.15.123:0/4008091888 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02c40b38a0 0x7f02c40d3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:27.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.693+0000 7f02c1ffb640 1 -- 172.21.15.123:0/4008091888 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2700119669 0 0) 0x7f02c40cf710 con 0x7f02c40b3350 2024-09-15T23:22:27.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.693+0000 7f02c1ffb640 1 -- 172.21.15.123:0/4008091888 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02b0003520 con 0x7f02c40b3350 2024-09-15T23:22:27.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.693+0000 7f02c1ffb640 1 -- 172.21.15.123:0/4008091888 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 955464281 0 0) 0x7f02b0003520 con 0x7f02c40b3350 2024-09-15T23:22:27.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.693+0000 7f02c1ffb640 1 -- 172.21.15.123:0/4008091888 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02c40b38a0 msgr2=0x7f02c40d3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:27.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.693+0000 7f02c1ffb640 1 --2- 172.21.15.123:0/4008091888 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02c40b38a0 0x7f02c40d3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:27.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.693+0000 7f02c1ffb640 1 -- 172.21.15.123:0/4008091888 >> v1:172.21.15.188:6789/0 conn(0x7f02c406bfd0 legacy=0x7f02c406c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:27.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.693+0000 7f02c1ffb640 1 -- 172.21.15.123:0/4008091888 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c40cfcd0 con 0x7f02c40b3350 2024-09-15T23:22:27.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.693+0000 7f02c1ffb640 1 -- 172.21.15.123:0/4008091888 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f02ac001670 con 0x7f02c40b3350 2024-09-15T23:22:27.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.693+0000 7f02c1ffb640 1 -- 172.21.15.123:0/4008091888 >> v1:172.21.15.123:6789/0 conn(0x7f02c40b3350 legacy=0x7f02c40d2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:27.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.693+0000 7f02c1ffb640 1 --2- 172.21.15.123:0/4008091888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02b00039e0 0x7f02b0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:27.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.693+0000 7f02c1ffb640 1 --2- 172.21.15.123:0/4008091888 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f02b0004390 0x7f02b0004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:27.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.693+0000 7f02c1ffb640 1 --2- 172.21.15.123:0/4008091888 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02c40b38a0 0x7f02b00050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:27.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.693+0000 7f02c1ffb640 1 -- 172.21.15.123:0/4008091888 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f02b000b9c0 con 0x7f02b00039e0 2024-09-15T23:22:27.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.693+0000 7f02c1ffb640 1 -- 172.21.15.123:0/4008091888 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f02b000bb70 con 0x7f02b0004390 2024-09-15T23:22:27.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.693+0000 7f02c1ffb640 1 -- 172.21.15.123:0/4008091888 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f02b000bd70 con 0x7f02c40b38a0 2024-09-15T23:22:27.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.693+0000 7f02c2ffd640 1 --2- 172.21.15.123:0/4008091888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02b00039e0 0x7f02b0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:27.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.693+0000 7f02c37fe640 1 --2- 172.21.15.123:0/4008091888 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02c40b38a0 0x7f02b00050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:27.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.693+0000 7f02c27fc640 1 --2- 172.21.15.123:0/4008091888 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f02b0004390 0x7f02b0004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:27.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.693+0000 7f02c2ffd640 1 -- 172.21.15.123:0/4008091888 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02c40b38a0 msgr2=0x7f02b00050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:27.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.693+0000 7f02c2ffd640 1 --2- 172.21.15.123:0/4008091888 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02c40b38a0 0x7f02b00050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:27.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.693+0000 7f02c2ffd640 1 -- 172.21.15.123:0/4008091888 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f02b0004390 msgr2=0x7f02b0004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:27.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.693+0000 7f02c2ffd640 1 --2- 172.21.15.123:0/4008091888 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f02b0004390 0x7f02b0004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:27.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.693+0000 7f02c2ffd640 1 -- 172.21.15.123:0/4008091888 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02b0003520 con 0x7f02b00039e0 2024-09-15T23:22:27.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.694+0000 7f02c2ffd640 1 --2- 172.21.15.123:0/4008091888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02b00039e0 0x7f02b0003dc0 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7f02b4001860 tx=0x7f02b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a801459b36ff2953 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:27.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.694+0000 7f02c1ffb640 1 -- 172.21.15.123:0/4008091888 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b4037070 con 0x7f02b00039e0 2024-09-15T23:22:27.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.694+0000 7f02c1ffb640 1 -- 172.21.15.123:0/4008091888 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02b402ac30 con 0x7f02b00039e0 2024-09-15T23:22:27.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.694+0000 7f02c1ffb640 1 -- 172.21.15.123:0/4008091888 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b4001430 con 0x7f02b00039e0 2024-09-15T23:22:27.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.695+0000 7f02c92a4640 1 -- 172.21.15.123:0/4008091888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02b00039e0 msgr2=0x7f02b0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:27.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.695+0000 7f02c92a4640 1 --2- 172.21.15.123:0/4008091888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02b00039e0 0x7f02b0003dc0 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7f02b4001860 tx=0x7f02b0005830 comp rx=0 tx=0).stop 2024-09-15T23:22:27.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.695+0000 7f02c37fe640 1 -- 172.21.15.123:0/4008091888 reap_dead start 2024-09-15T23:22:27.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.695+0000 7f02c92a4640 1 -- 172.21.15.123:0/4008091888 shutdown_connections 2024-09-15T23:22:27.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.695+0000 7f02c92a4640 1 -- 172.21.15.123:0/4008091888 >> 172.21.15.123:0/4008091888 conn(0x7f02c40d11c0 msgr2=0x7f02c40d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:27.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.695+0000 7f02c92a4640 1 -- 172.21.15.123:0/4008091888 shutdown_connections 2024-09-15T23:22:27.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.695+0000 7f02c92a4640 1 -- 172.21.15.123:0/4008091888 wait complete. 2024-09-15T23:22:27.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.696+0000 7f02c92a4640 1 Processor -- start 2024-09-15T23:22:27.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.696+0000 7f02c92a4640 1 -- start start 2024-09-15T23:22:27.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.697+0000 7f02c92a4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02b00039e0 0x7f02c41541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:27.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.697+0000 7f02c92a4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f02c41548d0 0x7f02c4156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:27.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.697+0000 7f02c92a4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02c4157ee0 0x7f02c41f47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:27.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.697+0000 7f02c92a4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f02c406cd50 con 0x7f02c4157ee0 2024-09-15T23:22:27.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.697+0000 7f02c92a4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f02c40cffb0 con 0x7f02c41548d0 2024-09-15T23:22:27.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.697+0000 7f02c92a4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f02c415eae0 con 0x7f02b00039e0 2024-09-15T23:22:27.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.697+0000 7f02c37fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02c4157ee0 0x7f02c41f47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:27.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.697+0000 7f02c37fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02c4157ee0 0x7f02c41f47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35424/0 (socket says 172.21.15.123:35424) 2024-09-15T23:22:27.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.697+0000 7f02c37fe640 1 -- 172.21.15.123:0/2580733467 learned_addr learned my addr 172.21.15.123:0/2580733467 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:27.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.697+0000 7f02c27fc640 1 --2- 172.21.15.123:0/2580733467 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f02c41548d0 0x7f02c4156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:27.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.697+0000 7f02c2ffd640 1 --2- 172.21.15.123:0/2580733467 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02b00039e0 0x7f02c41541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:27.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.697+0000 7f02c37fe640 1 -- 172.21.15.123:0/2580733467 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02b00039e0 msgr2=0x7f02c41541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:27.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.697+0000 7f02c37fe640 1 --2- 172.21.15.123:0/2580733467 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02b00039e0 0x7f02c41541b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:27.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.697+0000 7f02c37fe640 1 -- 172.21.15.123:0/2580733467 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f02c41548d0 msgr2=0x7f02c4156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:27.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.697+0000 7f02c37fe640 1 --2- 172.21.15.123:0/2580733467 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f02c41548d0 0x7f02c4156630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:27.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.697+0000 7f02c37fe640 1 -- 172.21.15.123:0/2580733467 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c41607d0 con 0x7f02c4157ee0 2024-09-15T23:22:27.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.697+0000 7f02c37fe640 1 --2- 172.21.15.123:0/2580733467 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02c4157ee0 0x7f02c41f47a0 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7f02c40b3c80 tx=0x7f02bc0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:27.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.698+0000 7f02bb7fe640 1 -- 172.21.15.123:0/2580733467 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc011e70 con 0x7f02c4157ee0 2024-09-15T23:22:27.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.698+0000 7f02bb7fe640 1 -- 172.21.15.123:0/2580733467 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02bc01b070 con 0x7f02c4157ee0 2024-09-15T23:22:27.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.698+0000 7f02c92a4640 1 -- 172.21.15.123:0/2580733467 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02c4160ab0 con 0x7f02c4157ee0 2024-09-15T23:22:27.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.698+0000 7f02bb7fe640 1 -- 172.21.15.123:0/2580733467 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc003990 con 0x7f02c4157ee0 2024-09-15T23:22:27.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.698+0000 7f02c92a4640 1 -- 172.21.15.123:0/2580733467 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02c41f4ce0 con 0x7f02c4157ee0 2024-09-15T23:22:27.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.699+0000 7f02c92a4640 1 -- 172.21.15.123:0/2580733467 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02c41f4fa0 con 0x7f02c4157ee0 2024-09-15T23:22:27.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.699+0000 7f02bb7fe640 1 -- 172.21.15.123:0/2580733467 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f02bc003b30 con 0x7f02c4157ee0 2024-09-15T23:22:27.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.699+0000 7f02bb7fe640 1 --2- 172.21.15.123:0/2580733467 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f02a406c2e0 0x7f02a406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:27.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.700+0000 7f02bb7fe640 1 -- 172.21.15.123:0/2580733467 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f02bc08b970 con 0x7f02c4157ee0 2024-09-15T23:22:27.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.700+0000 7f02c2ffd640 1 --2- 172.21.15.123:0/2580733467 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f02a406c2e0 0x7f02a406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:27.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.700+0000 7f02c2ffd640 1 --2- 172.21.15.123:0/2580733467 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f02a406c2e0 0x7f02a406e7a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f02b4034000 tx=0x7f02b4009030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:27.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.704+0000 7f02bb7fe640 1 -- 172.21.15.123:0/2580733467 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f02bc003e20 con 0x7f02c4157ee0 2024-09-15T23:22:27.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:27.903+0000 7f02c92a4640 1 -- 172.21.15.123:0/2580733467 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f02c406c3b0 con 0x7f02c4157ee0 2024-09-15T23:22:28.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.581+0000 7f02bb7fe640 1 -- 172.21.15.123:0/2580733467 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v110) ==== 122+0+0 (secure 0 0 0) 0x7f02bc059b20 con 0x7f02c4157ee0 2024-09-15T23:22:28.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.585+0000 7f02c92a4640 1 -- 172.21.15.123:0/2580733467 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f02a406c2e0 msgr2=0x7f02a406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:28.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.585+0000 7f02c92a4640 1 --2- 172.21.15.123:0/2580733467 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f02a406c2e0 0x7f02a406e7a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f02b4034000 tx=0x7f02b4009030 comp rx=0 tx=0).stop 2024-09-15T23:22:28.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.585+0000 7f02c92a4640 1 -- 172.21.15.123:0/2580733467 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02c4157ee0 msgr2=0x7f02c41f47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:28.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.585+0000 7f02c92a4640 1 --2- 172.21.15.123:0/2580733467 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02c4157ee0 0x7f02c41f47a0 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7f02c40b3c80 tx=0x7f02bc0115a0 comp rx=0 tx=0).stop 2024-09-15T23:22:28.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.585+0000 7f02c92a4640 1 -- 172.21.15.123:0/2580733467 shutdown_connections 2024-09-15T23:22:28.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.585+0000 7f02c92a4640 1 --2- 172.21.15.123:0/2580733467 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f02a406c2e0 0x7f02a406e7a0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:28.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.585+0000 7f02c92a4640 1 --2- 172.21.15.123:0/2580733467 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02c4157ee0 0x7f02c41f47a0 unknown :-1 s=CLOSED pgs=2079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:28.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.585+0000 7f02c92a4640 1 --2- 172.21.15.123:0/2580733467 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f02c41548d0 0x7f02c4156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:28.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.585+0000 7f02c92a4640 1 --2- 172.21.15.123:0/2580733467 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02b00039e0 0x7f02c41541b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:28.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.585+0000 7f02c92a4640 1 -- 172.21.15.123:0/2580733467 >> 172.21.15.123:0/2580733467 conn(0x7f02c40d11c0 msgr2=0x7f02c40d2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:28.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.585+0000 7f02c92a4640 1 -- 172.21.15.123:0/2580733467 shutdown_connections 2024-09-15T23:22:28.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.585+0000 7f02c92a4640 1 -- 172.21.15.123:0/2580733467 wait complete. 2024-09-15T23:22:28.600 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T23:22:28.600 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:22:28.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.703+0000 7f8e65f03640 1 Processor -- start 2024-09-15T23:22:28.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.703+0000 7f8e65f03640 1 -- start start 2024-09-15T23:22:28.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.704+0000 7f8e65f03640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8e60145ed0 0x7f8e600b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:28.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.704+0000 7f8e65f03640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f8e60073180 0x7f8e600735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:28.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.704+0000 7f8e65f03640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e600b4020 con 0x7f8e600b5880 2024-09-15T23:22:28.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.704+0000 7f8e65f03640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f8e60073b00 con 0x7f8e60145ed0 2024-09-15T23:22:28.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.704+0000 7f8e65f03640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f8e600b63d0 con 0x7f8e60073180 2024-09-15T23:22:28.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.704+0000 7f8e5f7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8e60145ed0 0x7f8e600b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:28.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.704+0000 7f8e5f7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8e60145ed0 0x7f8e600b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35430/0 (socket says 172.21.15.123:35430) 2024-09-15T23:22:28.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.704+0000 7f8e5f7fe640 1 -- 172.21.15.123:0/740754363 learned_addr learned my addr 172.21.15.123:0/740754363 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:28.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.704+0000 7f8e5f7fe640 1 -- 172.21.15.123:0/740754363 >> v2:172.21.15.188:3300/0 conn(0x7f8e60073180 msgr2=0x7f8e600735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:28.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.704+0000 7f8e5f7fe640 1 --2- 172.21.15.123:0/740754363 >> v2:172.21.15.188:3300/0 conn(0x7f8e60073180 0x7f8e600735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:28.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.704+0000 7f8e5f7fe640 1 -- 172.21.15.123:0/740754363 >> v1:172.21.15.188:6789/0 conn(0x7f8e600b5880 legacy=0x7f8e600b5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:28.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.704+0000 7f8e5f7fe640 1 -- 172.21.15.123:0/740754363 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e600b42c0 con 0x7f8e60145ed0 2024-09-15T23:22:28.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.705+0000 7f8e5f7fe640 1 --2- 172.21.15.123:0/740754363 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e60145ed0 0x7f8e600b5080 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7f8e60069cd0 tx=0x7f8e5002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47dcd744c7ff979c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:28.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.705+0000 7f8e5e7fc640 1 -- 172.21.15.123:0/740754363 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e50037070 con 0x7f8e60145ed0 2024-09-15T23:22:28.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.705+0000 7f8e5e7fc640 1 -- 172.21.15.123:0/740754363 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e50032440 con 0x7f8e60145ed0 2024-09-15T23:22:28.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.705+0000 7f8e5e7fc640 1 -- 172.21.15.123:0/740754363 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e50032810 con 0x7f8e60145ed0 2024-09-15T23:22:28.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.705+0000 7f8e65f03640 1 -- 172.21.15.123:0/740754363 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e60145ed0 msgr2=0x7f8e600b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:28.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.705+0000 7f8e65f03640 1 --2- 172.21.15.123:0/740754363 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e60145ed0 0x7f8e600b5080 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7f8e60069cd0 tx=0x7f8e5002a210 comp rx=0 tx=0).stop 2024-09-15T23:22:28.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.705+0000 7f8e65f03640 1 -- 172.21.15.123:0/740754363 shutdown_connections 2024-09-15T23:22:28.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.705+0000 7f8e65f03640 1 --2- 172.21.15.123:0/740754363 >> v2:172.21.15.188:3300/0 conn(0x7f8e60073180 0x7f8e600735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:28.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.705+0000 7f8e65f03640 1 --2- 172.21.15.123:0/740754363 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e60145ed0 0x7f8e600b5080 unknown :-1 s=CLOSED pgs=2080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:28.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.705+0000 7f8e65f03640 1 -- 172.21.15.123:0/740754363 >> 172.21.15.123:0/740754363 conn(0x7f8e600ccec0 msgr2=0x7f8e600cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:28.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.706+0000 7f8e65f03640 1 -- 172.21.15.123:0/740754363 shutdown_connections 2024-09-15T23:22:28.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.706+0000 7f8e65f03640 1 -- 172.21.15.123:0/740754363 wait complete. 2024-09-15T23:22:28.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.707+0000 7f8e65f03640 1 Processor -- start 2024-09-15T23:22:28.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.707+0000 7f8e65f03640 1 -- start start 2024-09-15T23:22:28.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.708+0000 7f8e65f03640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e60073180 0x7f8e60154b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:28.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.708+0000 7f8e65f03640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e600b5880 0x7f8e6013cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:28.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.708+0000 7f8e65f03640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8e60145ed0 0x7f8e6015a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:28.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.708+0000 7f8e65f03640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8e600b4b60 con 0x7f8e600b5880 2024-09-15T23:22:28.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.708+0000 7f8e65f03640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8e600b4880 con 0x7f8e60073180 2024-09-15T23:22:28.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.708+0000 7f8e65f03640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8e601462b0 con 0x7f8e60145ed0 2024-09-15T23:22:28.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.708+0000 7f8e5effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e600b5880 0x7f8e6013cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:28.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.708+0000 7f8e5effd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e600b5880 0x7f8e6013cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35436/0 (socket says 172.21.15.123:35436) 2024-09-15T23:22:28.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.708+0000 7f8e5effd640 1 -- 172.21.15.123:0/1836475703 learned_addr learned my addr 172.21.15.123:0/1836475703 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:28.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.708+0000 7f8e5f7fe640 1 --2- 172.21.15.123:0/1836475703 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e60073180 0x7f8e60154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:28.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.708+0000 7f8e5ffff640 1 --2- 172.21.15.123:0/1836475703 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8e60145ed0 0x7f8e6015a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:28.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.708+0000 7f8e5effd640 1 -- 172.21.15.123:0/1836475703 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8e60145ed0 msgr2=0x7f8e6015a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:28.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.708+0000 7f8e5effd640 1 --2- 172.21.15.123:0/1836475703 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8e60145ed0 0x7f8e6015a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:28.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.708+0000 7f8e5effd640 1 -- 172.21.15.123:0/1836475703 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e60073180 msgr2=0x7f8e60154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:28.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.708+0000 7f8e5effd640 1 --2- 172.21.15.123:0/1836475703 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e60073180 0x7f8e60154b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:28.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.708+0000 7f8e5effd640 1 -- 172.21.15.123:0/1836475703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e601553a0 con 0x7f8e600b5880 2024-09-15T23:22:28.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.708+0000 7f8e5effd640 1 --2- 172.21.15.123:0/1836475703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e600b5880 0x7f8e6013cd60 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f8e5400b4a0 tx=0x7f8e5400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:28.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.708+0000 7f8e47fff640 1 -- 172.21.15.123:0/1836475703 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e54014070 con 0x7f8e600b5880 2024-09-15T23:22:28.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.708+0000 7f8e47fff640 1 -- 172.21.15.123:0/1836475703 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e54010610 con 0x7f8e600b5880 2024-09-15T23:22:28.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.709+0000 7f8e47fff640 1 -- 172.21.15.123:0/1836475703 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e54010a00 con 0x7f8e600b5880 2024-09-15T23:22:28.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.709+0000 7f8e65f03640 1 -- 172.21.15.123:0/1836475703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e60155680 con 0x7f8e600b5880 2024-09-15T23:22:28.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.709+0000 7f8e65f03640 1 -- 172.21.15.123:0/1836475703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e60155c40 con 0x7f8e600b5880 2024-09-15T23:22:28.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.710+0000 7f8e65f03640 1 -- 172.21.15.123:0/1836475703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e600735c0 con 0x7f8e600b5880 2024-09-15T23:22:28.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.710+0000 7f8e47fff640 1 -- 172.21.15.123:0/1836475703 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8e54017070 con 0x7f8e600b5880 2024-09-15T23:22:28.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.710+0000 7f8e47fff640 1 --2- 172.21.15.123:0/1836475703 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8e4c06c2b0 0x7f8e4c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:28.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.711+0000 7f8e47fff640 1 -- 172.21.15.123:0/1836475703 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f8e5408ae10 con 0x7f8e600b5880 2024-09-15T23:22:28.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.711+0000 7f8e5f7fe640 1 --2- 172.21.15.123:0/1836475703 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8e4c06c2b0 0x7f8e4c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:28.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.711+0000 7f8e5f7fe640 1 --2- 172.21.15.123:0/1836475703 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8e4c06c2b0 0x7f8e4c06e770 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f8e50034000 tx=0x7f8e5002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:28.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.715+0000 7f8e47fff640 1 -- 172.21.15.123:0/1836475703 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8e54058f30 con 0x7f8e600b5880 2024-09-15T23:22:28.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.912+0000 7f8e65f03640 1 -- 172.21.15.123:0/1836475703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e600686b0 con 0x7f8e600b5880 2024-09-15T23:22:28.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.913+0000 7f8e47fff640 1 -- 172.21.15.123:0/1836475703 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) ==== 95+0+5252 (secure 0 0 0) 0x7f8e5405d230 con 0x7f8e600b5880 2024-09-15T23:22:28.914 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:22:28.914 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":110,"btime":"2024-09-15T23:22:28:577201+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8452,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/1861304244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1861304244},{"type":"v1","addr":"172.21.15.188:6837","nonce":1861304244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":10056,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/2869473990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2869473990},{"type":"v1","addr":"172.21.15.123:6833","nonce":2869473990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":10062,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3239002092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3239002092},{"type":"v1","addr":"172.21.15.123:6835","nonce":3239002092}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:22:25.896547+0000","modified":"2024-09-15T23:22:27.904790+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10074},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10074":{"gid":10074,"name":"d","rank":0,"incarnation":108,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6836/2164993019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2164993019},{"type":"v1","addr":"172.21.15.188:6836","nonce":2164993019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10074,"qdb_cluster":[10074]},"id":12}]} 2024-09-15T23:22:28.915 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 110 2024-09-15T23:22:28.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.915+0000 7f8e65f03640 1 -- 172.21.15.123:0/1836475703 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8e4c06c2b0 msgr2=0x7f8e4c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:28.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.915+0000 7f8e65f03640 1 --2- 172.21.15.123:0/1836475703 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8e4c06c2b0 0x7f8e4c06e770 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f8e50034000 tx=0x7f8e5002e000 comp rx=0 tx=0).stop 2024-09-15T23:22:28.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.915+0000 7f8e65f03640 1 -- 172.21.15.123:0/1836475703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e600b5880 msgr2=0x7f8e6013cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:28.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.915+0000 7f8e65f03640 1 --2- 172.21.15.123:0/1836475703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e600b5880 0x7f8e6013cd60 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f8e5400b4a0 tx=0x7f8e5400b960 comp rx=0 tx=0).stop 2024-09-15T23:22:28.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.915+0000 7f8e65f03640 1 -- 172.21.15.123:0/1836475703 shutdown_connections 2024-09-15T23:22:28.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.915+0000 7f8e65f03640 1 --2- 172.21.15.123:0/1836475703 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8e60145ed0 0x7f8e6015a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:28.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.915+0000 7f8e65f03640 1 --2- 172.21.15.123:0/1836475703 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8e4c06c2b0 0x7f8e4c06e770 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:28.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.915+0000 7f8e65f03640 1 --2- 172.21.15.123:0/1836475703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8e600b5880 0x7f8e6013cd60 unknown :-1 s=CLOSED pgs=2081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:28.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.915+0000 7f8e65f03640 1 --2- 172.21.15.123:0/1836475703 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8e60073180 0x7f8e60154b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:28.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.915+0000 7f8e65f03640 1 -- 172.21.15.123:0/1836475703 >> 172.21.15.123:0/1836475703 conn(0x7f8e600ccec0 msgr2=0x7f8e60144e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:28.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.915+0000 7f8e65f03640 1 -- 172.21.15.123:0/1836475703 shutdown_connections 2024-09-15T23:22:28.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:28.915+0000 7f8e65f03640 1 -- 172.21.15.123:0/1836475703 wait complete. 2024-09-15T23:22:28.928 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:22:29.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.026+0000 7f562dc27640 1 Processor -- start 2024-09-15T23:22:29.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.026+0000 7f562dc27640 1 -- start start 2024-09-15T23:22:29.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.027+0000 7f562dc27640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56280b2d40 0x7f562806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:29.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.027+0000 7f562dc27640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f562813eb20 0x7f562806c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:29.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.027+0000 7f562dc27640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5628071180 con 0x7f562815bcf0 2024-09-15T23:22:29.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.027+0000 7f562dc27640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f5628071ab0 con 0x7f562813eb20 2024-09-15T23:22:29.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.027+0000 7f562dc27640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5628071460 con 0x7f56280b2d40 2024-09-15T23:22:29.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.027+0000 7f5627fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f562815bcf0 0x7f562815c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36756/0 (socket says 172.21.15.123:36756) 2024-09-15T23:22:29.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.027+0000 7f5627fff640 1 -- 172.21.15.123:0/2526986631 learned_addr learned my addr 172.21.15.123:0/2526986631 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:29.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.027+0000 7f56267fc640 1 -- 172.21.15.123:0/2526986631 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1500962592 0 0) 0x7f5628071180 con 0x7f562815bcf0 2024-09-15T23:22:29.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.027+0000 7f56267fc640 1 -- 172.21.15.123:0/2526986631 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5610003520 con 0x7f562815bcf0 2024-09-15T23:22:29.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.027+0000 7f56277fe640 1 --2- 172.21.15.123:0/2526986631 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56280b2d40 0x7f562806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:29.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.027+0000 7f5626ffd640 1 --2- 172.21.15.123:0/2526986631 >> v2:172.21.15.188:3300/0 conn(0x7f562813eb20 0x7f562806c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:29.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.027+0000 7f56267fc640 1 -- 172.21.15.123:0/2526986631 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2967487101 0 0) 0x7f5610003520 con 0x7f562815bcf0 2024-09-15T23:22:29.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.027+0000 7f56267fc640 1 -- 172.21.15.123:0/2526986631 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56280b2d40 msgr2=0x7f562806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:29.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.027+0000 7f56267fc640 1 --2- 172.21.15.123:0/2526986631 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56280b2d40 0x7f562806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.027+0000 7f56267fc640 1 -- 172.21.15.123:0/2526986631 >> v2:172.21.15.188:3300/0 conn(0x7f562813eb20 msgr2=0x7f562806c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:29.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.027+0000 7f56267fc640 1 --2- 172.21.15.123:0/2526986631 >> v2:172.21.15.188:3300/0 conn(0x7f562813eb20 0x7f562806c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.027+0000 7f56267fc640 1 -- 172.21.15.123:0/2526986631 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5628071740 con 0x7f562815bcf0 2024-09-15T23:22:29.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.027+0000 7f56267fc640 1 -- 172.21.15.123:0/2526986631 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f56200019f0 con 0x7f562815bcf0 2024-09-15T23:22:29.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.027+0000 7f56277fe640 1 --2- 172.21.15.123:0/2526986631 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56280b2d40 0x7f562806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:29.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.027+0000 7f56267fc640 1 -- 172.21.15.123:0/2526986631 >> v1:172.21.15.123:6789/0 conn(0x7f562815bcf0 legacy=0x7f562815c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:29.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.027+0000 7f56267fc640 1 --2- 172.21.15.123:0/2526986631 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56280b2d40 0x7f56100039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:29.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.027+0000 7f56267fc640 1 --2- 172.21.15.123:0/2526986631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5610003f10 0x7f5610004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:29.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.027+0000 7f56267fc640 1 --2- 172.21.15.123:0/2526986631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5610004d40 0x7f56100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:29.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.027+0000 7f56267fc640 1 -- 172.21.15.123:0/2526986631 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5628071ab0 con 0x7f5610004d40 2024-09-15T23:22:29.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.027+0000 7f56267fc640 1 -- 172.21.15.123:0/2526986631 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5628071460 con 0x7f5610003f10 2024-09-15T23:22:29.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.027+0000 7f56267fc640 1 -- 172.21.15.123:0/2526986631 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f561000b9f0 con 0x7f56280b2d40 2024-09-15T23:22:29.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.027+0000 7f5627fff640 1 --2- 172.21.15.123:0/2526986631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5610004d40 0x7f56100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:29.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.028+0000 7f56277fe640 1 --2- 172.21.15.123:0/2526986631 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56280b2d40 0x7f56100039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:29.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.028+0000 7f5626ffd640 1 --2- 172.21.15.123:0/2526986631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5610003f10 0x7f5610004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:29.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.028+0000 7f5627fff640 1 -- 172.21.15.123:0/2526986631 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56280b2d40 msgr2=0x7f56100039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:29.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.028+0000 7f5627fff640 1 --2- 172.21.15.123:0/2526986631 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56280b2d40 0x7f56100039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.028+0000 7f5627fff640 1 -- 172.21.15.123:0/2526986631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5610003f10 msgr2=0x7f5610004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:29.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.028+0000 7f5627fff640 1 --2- 172.21.15.123:0/2526986631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5610003f10 0x7f5610004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.028+0000 7f5627fff640 1 -- 172.21.15.123:0/2526986631 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5610003520 con 0x7f5610004d40 2024-09-15T23:22:29.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.028+0000 7f56277fe640 1 --2- 172.21.15.123:0/2526986631 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56280b2d40 0x7f56100039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:29.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.028+0000 7f5627fff640 1 --2- 172.21.15.123:0/2526986631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5610004d40 0x7f56100051c0 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7f562000a880 tx=0x7f5610005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b896e8d914c92442 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:29.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.028+0000 7f56267fc640 1 -- 172.21.15.123:0/2526986631 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562000a4a0 con 0x7f5610004d40 2024-09-15T23:22:29.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.029+0000 7f56267fc640 1 -- 172.21.15.123:0/2526986631 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f562002f070 con 0x7f5610004d40 2024-09-15T23:22:29.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.029+0000 7f56267fc640 1 -- 172.21.15.123:0/2526986631 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562002bd40 con 0x7f5610004d40 2024-09-15T23:22:29.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.029+0000 7f562dc27640 1 -- 172.21.15.123:0/2526986631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5610004d40 msgr2=0x7f56100051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:29.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.029+0000 7f562dc27640 1 --2- 172.21.15.123:0/2526986631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5610004d40 0x7f56100051c0 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7f562000a880 tx=0x7f5610005830 comp rx=0 tx=0).stop 2024-09-15T23:22:29.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.029+0000 7f5627fff640 1 -- 172.21.15.123:0/2526986631 reap_dead start 2024-09-15T23:22:29.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.029+0000 7f562dc27640 1 -- 172.21.15.123:0/2526986631 shutdown_connections 2024-09-15T23:22:29.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.029+0000 7f562dc27640 1 -- 172.21.15.123:0/2526986631 >> 172.21.15.123:0/2526986631 conn(0x7f56280ccec0 msgr2=0x7f56280cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:29.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.029+0000 7f562dc27640 1 -- 172.21.15.123:0/2526986631 shutdown_connections 2024-09-15T23:22:29.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.029+0000 7f562dc27640 1 -- 172.21.15.123:0/2526986631 wait complete. 2024-09-15T23:22:29.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.030+0000 7f562dc27640 1 Processor -- start 2024-09-15T23:22:29.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.030+0000 7f562dc27640 1 -- start start 2024-09-15T23:22:29.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.031+0000 7f562dc27640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5610004d40 0x7f562813b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:29.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.031+0000 7f562dc27640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56281680e0 0x7f562815a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:29.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.031+0000 7f562dc27640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f562815a9e0 0x7f562813cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:29.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.031+0000 7f562dc27640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f562806bfa0 con 0x7f5610004d40 2024-09-15T23:22:29.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.031+0000 7f562dc27640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f562806be20 con 0x7f562815a9e0 2024-09-15T23:22:29.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.031+0000 7f562dc27640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5628071f40 con 0x7f56281680e0 2024-09-15T23:22:29.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.031+0000 7f56277fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5610004d40 0x7f562813b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:29.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.031+0000 7f56277fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5610004d40 0x7f562813b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35454/0 (socket says 172.21.15.123:35454) 2024-09-15T23:22:29.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.031+0000 7f56277fe640 1 -- 172.21.15.123:0/2646731892 learned_addr learned my addr 172.21.15.123:0/2646731892 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:29.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.031+0000 7f5626ffd640 1 --2- 172.21.15.123:0/2646731892 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56281680e0 0x7f562815a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:29.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.031+0000 7f5627fff640 1 --2- 172.21.15.123:0/2646731892 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f562815a9e0 0x7f562813cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:29.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.032+0000 7f56277fe640 1 -- 172.21.15.123:0/2646731892 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56281680e0 msgr2=0x7f562815a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:29.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.032+0000 7f56277fe640 1 --2- 172.21.15.123:0/2646731892 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56281680e0 0x7f562815a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.032+0000 7f56277fe640 1 -- 172.21.15.123:0/2646731892 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f562815a9e0 msgr2=0x7f562813cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:29.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.032+0000 7f56277fe640 1 --2- 172.21.15.123:0/2646731892 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f562815a9e0 0x7f562813cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.032+0000 7f56277fe640 1 -- 172.21.15.123:0/2646731892 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5628166d60 con 0x7f5610004d40 2024-09-15T23:22:29.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.032+0000 7f56277fe640 1 --2- 172.21.15.123:0/2646731892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5610004d40 0x7f562813b170 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7f5618010860 tx=0x7f5618010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:29.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.032+0000 7f560ffff640 1 -- 172.21.15.123:0/2646731892 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f561801a020 con 0x7f5610004d40 2024-09-15T23:22:29.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.032+0000 7f560ffff640 1 -- 172.21.15.123:0/2646731892 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f561800eb00 con 0x7f5610004d40 2024-09-15T23:22:29.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.032+0000 7f562dc27640 1 -- 172.21.15.123:0/2646731892 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5628167040 con 0x7f5610004d40 2024-09-15T23:22:29.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.032+0000 7f560ffff640 1 -- 172.21.15.123:0/2646731892 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f561800f040 con 0x7f5610004d40 2024-09-15T23:22:29.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.032+0000 7f562dc27640 1 -- 172.21.15.123:0/2646731892 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5628167600 con 0x7f5610004d40 2024-09-15T23:22:29.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.033+0000 7f562dc27640 1 -- 172.21.15.123:0/2646731892 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f562815fde0 con 0x7f5610004d40 2024-09-15T23:22:29.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.033+0000 7f560ffff640 1 -- 172.21.15.123:0/2646731892 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f561801d020 con 0x7f5610004d40 2024-09-15T23:22:29.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.034+0000 7f560ffff640 1 --2- 172.21.15.123:0/2646731892 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f561406c2e0 0x7f561406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:29.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.034+0000 7f560ffff640 1 -- 172.21.15.123:0/2646731892 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f561808bbf0 con 0x7f5610004d40 2024-09-15T23:22:29.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.034+0000 7f5626ffd640 1 --2- 172.21.15.123:0/2646731892 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f561406c2e0 0x7f561406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:29.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.035+0000 7f5626ffd640 1 --2- 172.21.15.123:0/2646731892 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f561406c2e0 0x7f561406e7a0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f56280cc690 tx=0x7f561c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:29.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.038+0000 7f560ffff640 1 -- 172.21.15.123:0/2646731892 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5618024020 con 0x7f5610004d40 2024-09-15T23:22:29.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.207+0000 7f562dc27640 1 -- 172.21.15.123:0/2646731892 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f562806c120 con 0x7f5610004d40 2024-09-15T23:22:29.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.208+0000 7f560ffff640 1 -- 172.21.15.123:0/2646731892 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v182) ==== 74+0+16707 (secure 0 0 0) 0x7f561805a360 con 0x7f5610004d40 2024-09-15T23:22:29.210 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:22:29.210 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":182,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:22:27.559444+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:22:23.593537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-15T23:22:24.884391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:22:29.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.210+0000 7f562dc27640 1 -- 172.21.15.123:0/2646731892 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f561406c2e0 msgr2=0x7f561406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:29.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.210+0000 7f562dc27640 1 --2- 172.21.15.123:0/2646731892 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f561406c2e0 0x7f561406e7a0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f56280cc690 tx=0x7f561c008040 comp rx=0 tx=0).stop 2024-09-15T23:22:29.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.210+0000 7f562dc27640 1 -- 172.21.15.123:0/2646731892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5610004d40 msgr2=0x7f562813b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:29.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.210+0000 7f562dc27640 1 --2- 172.21.15.123:0/2646731892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5610004d40 0x7f562813b170 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7f5618010860 tx=0x7f5618010d20 comp rx=0 tx=0).stop 2024-09-15T23:22:29.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.211+0000 7f562dc27640 1 -- 172.21.15.123:0/2646731892 shutdown_connections 2024-09-15T23:22:29.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.211+0000 7f562dc27640 1 --2- 172.21.15.123:0/2646731892 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f562815a9e0 0x7f562813cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.211+0000 7f562dc27640 1 --2- 172.21.15.123:0/2646731892 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56281680e0 0x7f562815a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.211+0000 7f562dc27640 1 --2- 172.21.15.123:0/2646731892 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f561406c2e0 0x7f561406e7a0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.211+0000 7f562dc27640 1 --2- 172.21.15.123:0/2646731892 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5610004d40 0x7f562813b170 unknown :-1 s=CLOSED pgs=2084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.211+0000 7f562dc27640 1 -- 172.21.15.123:0/2646731892 >> 172.21.15.123:0/2646731892 conn(0x7f56280ccec0 msgr2=0x7f56280b5920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:29.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.211+0000 7f562dc27640 1 -- 172.21.15.123:0/2646731892 shutdown_connections 2024-09-15T23:22:29.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.211+0000 7f562dc27640 1 -- 172.21.15.123:0/2646731892 wait complete. 2024-09-15T23:22:29.223 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T23:22:29.223 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:22:29.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.321+0000 7fd40362e640 1 Processor -- start 2024-09-15T23:22:29.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.321+0000 7fd40362e640 1 -- start start 2024-09-15T23:22:29.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.322+0000 7fd40362e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd3fc162490 0x7fd3fc15ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:29.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.322+0000 7fd40362e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd3fc0b66b0 0x7fd3fc0b6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:29.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.322+0000 7fd40362e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3fc0b7000 con 0x7fd3fc15eab0 2024-09-15T23:22:29.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.322+0000 7fd40362e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fd3fc15f570 con 0x7fd3fc0b66b0 2024-09-15T23:22:29.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.322+0000 7fd40362e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fd3fc15f850 con 0x7fd3fc162490 2024-09-15T23:22:29.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.322+0000 7fd401bcb640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd3fc0b66b0 0x7fd3fc0b6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:29.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.322+0000 7fd4013ca640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd3fc15eab0 0x7fd3fc0d2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36766/0 (socket says 172.21.15.123:36766) 2024-09-15T23:22:29.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.322+0000 7fd4013ca640 1 -- 172.21.15.123:0/363729104 learned_addr learned my addr 172.21.15.123:0/363729104 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:29.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.322+0000 7fd400bc9640 1 --2- 172.21.15.123:0/363729104 >> v2:172.21.15.188:3300/0 conn(0x7fd3fc162490 0x7fd3fc15ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:29.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.323+0000 7fd401bcb640 1 -- 172.21.15.123:0/363729104 >> v2:172.21.15.188:3300/0 conn(0x7fd3fc162490 msgr2=0x7fd3fc15ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:29.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.323+0000 7fd401bcb640 1 --2- 172.21.15.123:0/363729104 >> v2:172.21.15.188:3300/0 conn(0x7fd3fc162490 0x7fd3fc15ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.323+0000 7fd401bcb640 1 -- 172.21.15.123:0/363729104 >> v1:172.21.15.123:6789/0 conn(0x7fd3fc15eab0 legacy=0x7fd3fc0d2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:29.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.323+0000 7fd401bcb640 1 -- 172.21.15.123:0/363729104 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3fc15fb30 con 0x7fd3fc0b66b0 2024-09-15T23:22:29.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.323+0000 7fd3f3fff640 1 -- 172.21.15.123:0/363729104 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3060517872 0 0) 0x7fd3f8001110 con 0x7fd3fc15eab0 2024-09-15T23:22:29.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.323+0000 7fd400bc9640 1 --2- 172.21.15.123:0/363729104 >> v2:172.21.15.188:3300/0 conn(0x7fd3fc162490 0x7fd3fc15ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:22:29.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.323+0000 7fd401bcb640 1 --2- 172.21.15.123:0/363729104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3fc0b66b0 0x7fd3fc0b6ac0 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc068890 tx=0x7fd3f402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7180df4bc1862ca4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:29.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.323+0000 7fd3f3fff640 1 -- 172.21.15.123:0/363729104 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4007740 con 0x7fd3fc0b66b0 2024-09-15T23:22:29.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.323+0000 7fd3f3fff640 1 -- 172.21.15.123:0/363729104 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3f40078e0 con 0x7fd3fc0b66b0 2024-09-15T23:22:29.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.323+0000 7fd3f3fff640 1 -- 172.21.15.123:0/363729104 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4007cb0 con 0x7fd3fc0b66b0 2024-09-15T23:22:29.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.324+0000 7fd40362e640 1 -- 172.21.15.123:0/363729104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3fc0b66b0 msgr2=0x7fd3fc0b6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:29.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.324+0000 7fd40362e640 1 --2- 172.21.15.123:0/363729104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3fc0b66b0 0x7fd3fc0b6ac0 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc068890 tx=0x7fd3f402a680 comp rx=0 tx=0).stop 2024-09-15T23:22:29.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.324+0000 7fd40362e640 1 -- 172.21.15.123:0/363729104 shutdown_connections 2024-09-15T23:22:29.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.324+0000 7fd40362e640 1 --2- 172.21.15.123:0/363729104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3fc0b66b0 0x7fd3fc0b6ac0 unknown :-1 s=CLOSED pgs=2086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.324+0000 7fd40362e640 1 --2- 172.21.15.123:0/363729104 >> v2:172.21.15.188:3300/0 conn(0x7fd3fc162490 0x7fd3fc15ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.324+0000 7fd40362e640 1 -- 172.21.15.123:0/363729104 >> 172.21.15.123:0/363729104 conn(0x7fd3fc0d16d0 msgr2=0x7fd3fc0d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:29.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.324+0000 7fd40362e640 1 -- 172.21.15.123:0/363729104 shutdown_connections 2024-09-15T23:22:29.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.324+0000 7fd40362e640 1 -- 172.21.15.123:0/363729104 wait complete. 2024-09-15T23:22:29.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.325+0000 7fd40362e640 1 Processor -- start 2024-09-15T23:22:29.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.325+0000 7fd40362e640 1 -- start start 2024-09-15T23:22:29.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.326+0000 7fd40362e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd3fc0b66b0 0x7fd3fc1f7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:29.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.326+0000 7fd40362e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd3fc15eab0 0x7fd3fc0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:29.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.326+0000 7fd40362e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3fc162490 0x7fd3fc0b8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:29.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.326+0000 7fd40362e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd3fc0d4460 con 0x7fd3fc162490 2024-09-15T23:22:29.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.326+0000 7fd40362e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd3fc0cef20 con 0x7fd3fc15eab0 2024-09-15T23:22:29.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.326+0000 7fd40362e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd3fc0d45e0 con 0x7fd3fc0b66b0 2024-09-15T23:22:29.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.326+0000 7fd401bcb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3fc162490 0x7fd3fc0b8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:29.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.326+0000 7fd401bcb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3fc162490 0x7fd3fc0b8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35476/0 (socket says 172.21.15.123:35476) 2024-09-15T23:22:29.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.326+0000 7fd401bcb640 1 -- 172.21.15.123:0/2140529161 learned_addr learned my addr 172.21.15.123:0/2140529161 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:29.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.326+0000 7fd4013ca640 1 --2- 172.21.15.123:0/2140529161 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd3fc0b66b0 0x7fd3fc1f7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:29.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.326+0000 7fd400bc9640 1 --2- 172.21.15.123:0/2140529161 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd3fc15eab0 0x7fd3fc0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:29.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.326+0000 7fd401bcb640 1 -- 172.21.15.123:0/2140529161 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd3fc0b66b0 msgr2=0x7fd3fc1f7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:29.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.326+0000 7fd401bcb640 1 --2- 172.21.15.123:0/2140529161 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd3fc0b66b0 0x7fd3fc1f7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.326+0000 7fd401bcb640 1 -- 172.21.15.123:0/2140529161 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd3fc15eab0 msgr2=0x7fd3fc0b8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:29.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.326+0000 7fd401bcb640 1 --2- 172.21.15.123:0/2140529161 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd3fc15eab0 0x7fd3fc0b8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.326+0000 7fd401bcb640 1 -- 172.21.15.123:0/2140529161 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3fc1f4eb0 con 0x7fd3fc162490 2024-09-15T23:22:29.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.327+0000 7fd401bcb640 1 --2- 172.21.15.123:0/2140529161 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3fc162490 0x7fd3fc0b8fb0 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4009e80 tx=0x7fd3f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:29.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.327+0000 7fd3f1ffb640 1 -- 172.21.15.123:0/2140529161 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f403f070 con 0x7fd3fc162490 2024-09-15T23:22:29.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.327+0000 7fd3f1ffb640 1 -- 172.21.15.123:0/2140529161 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3f4031c40 con 0x7fd3fc162490 2024-09-15T23:22:29.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.327+0000 7fd3f1ffb640 1 -- 172.21.15.123:0/2140529161 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4003b90 con 0x7fd3fc162490 2024-09-15T23:22:29.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.327+0000 7fd40362e640 1 -- 172.21.15.123:0/2140529161 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3fc1f5170 con 0x7fd3fc162490 2024-09-15T23:22:29.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.327+0000 7fd40362e640 1 -- 172.21.15.123:0/2140529161 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3fc1f5730 con 0x7fd3fc162490 2024-09-15T23:22:29.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.328+0000 7fd40362e640 1 -- 172.21.15.123:0/2140529161 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3fc0b6ac0 con 0x7fd3fc162490 2024-09-15T23:22:29.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.328+0000 7fd3f1ffb640 1 -- 172.21.15.123:0/2140529161 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd3f4004030 con 0x7fd3fc162490 2024-09-15T23:22:29.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.329+0000 7fd3f1ffb640 1 --2- 172.21.15.123:0/2140529161 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd3e006c2b0 0x7fd3e006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:29.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.329+0000 7fd3f1ffb640 1 -- 172.21.15.123:0/2140529161 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7fd3f40ac600 con 0x7fd3fc162490 2024-09-15T23:22:29.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.329+0000 7fd4013ca640 1 --2- 172.21.15.123:0/2140529161 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd3e006c2b0 0x7fd3e006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:29.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.330+0000 7fd4013ca640 1 --2- 172.21.15.123:0/2140529161 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd3e006c2b0 0x7fd3e006e770 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8007fd0 tx=0x7fd3f8007de0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:29.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.333+0000 7fd3f1ffb640 1 -- 172.21.15.123:0/2140529161 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd3f407a7b0 con 0x7fd3fc162490 2024-09-15T23:22:29.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.496+0000 7fd40362e640 1 -- 172.21.15.123:0/2140529161 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd3fc0d2500 con 0x7fd3e006c2b0 2024-09-15T23:22:29.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.502+0000 7fd3f1ffb640 1 -- 172.21.15.123:0/2140529161 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244664 (secure 0 0 0) 0x7fd3fc0d2500 con 0x7fd3e006c2b0 2024-09-15T23:22:29.507 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:22:29.508 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:22:29.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.505+0000 7fd40362e640 1 -- 172.21.15.123:0/2140529161 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd3e006c2b0 msgr2=0x7fd3e006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:29.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.505+0000 7fd40362e640 1 --2- 172.21.15.123:0/2140529161 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd3e006c2b0 0x7fd3e006e770 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8007fd0 tx=0x7fd3f8007de0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.505+0000 7fd40362e640 1 -- 172.21.15.123:0/2140529161 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3fc162490 msgr2=0x7fd3fc0b8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:29.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.505+0000 7fd40362e640 1 --2- 172.21.15.123:0/2140529161 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3fc162490 0x7fd3fc0b8fb0 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4009e80 tx=0x7fd3f4004a40 comp rx=0 tx=0).stop 2024-09-15T23:22:29.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.506+0000 7fd40362e640 1 -- 172.21.15.123:0/2140529161 shutdown_connections 2024-09-15T23:22:29.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.506+0000 7fd40362e640 1 --2- 172.21.15.123:0/2140529161 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd3e006c2b0 0x7fd3e006e770 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.506+0000 7fd40362e640 1 --2- 172.21.15.123:0/2140529161 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3fc162490 0x7fd3fc0b8fb0 unknown :-1 s=CLOSED pgs=2087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.506+0000 7fd40362e640 1 --2- 172.21.15.123:0/2140529161 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd3fc15eab0 0x7fd3fc0b8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.506+0000 7fd40362e640 1 --2- 172.21.15.123:0/2140529161 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd3fc0b66b0 0x7fd3fc1f7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.506+0000 7fd40362e640 1 -- 172.21.15.123:0/2140529161 >> 172.21.15.123:0/2140529161 conn(0x7fd3fc0d16d0 msgr2=0x7fd3fc0d3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:29.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.506+0000 7fd40362e640 1 -- 172.21.15.123:0/2140529161 shutdown_connections 2024-09-15T23:22:29.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.506+0000 7fd40362e640 1 -- 172.21.15.123:0/2140529161 wait complete. 2024-09-15T23:22:29.518 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":488,"stamp":"2024-09-15T23:22:27.650149+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":108,"acting":108,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":423596,"kb_used_data":18608,"kb_used_omap":12,"kb_used_meta":404787,"kb_avail":754551124,"statfs":{"total":773094113280,"available":772660350976,"internally_reserved":0,"allocated":19054592,"data_stored":9084622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":414502448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000835"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:25.556310+0000","last_change":"2024-09-15T23:22:25.556310+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:25.556310+0000","last_undegraded":"2024-09-15T23:22:25.556310+0000","last_fullsized":"2024-09-15T23:22:25.556310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:25.556310+0000","last_change":"2024-09-15T23:22:25.556310+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:25.556310+0000","last_undegraded":"2024-09-15T23:22:25.556310+0000","last_fullsized":"2024-09-15T23:22:25.556310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.578422+0000","last_change":"2024-09-15T23:22:26.577028+0000","last_active":"2024-09-15T23:22:26.578422+0000","last_peered":"2024-09-15T23:22:26.578422+0000","last_clean":"2024-09-15T23:22:26.578422+0000","last_became_active":"2024-09-15T23:22:26.576357+0000","last_became_peered":"2024-09-15T23:22:26.576357+0000","last_unstale":"2024-09-15T23:22:26.578422+0000","last_undegraded":"2024-09-15T23:22:26.578422+0000","last_fullsized":"2024-09-15T23:22:26.578422+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:29.118197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:25.556310+0000","last_change":"2024-09-15T23:22:25.556310+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:25.556310+0000","last_undegraded":"2024-09-15T23:22:25.556310+0000","last_fullsized":"2024-09-15T23:22:25.556310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.574310+0000","last_change":"2024-09-15T23:22:26.574310+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.574310+0000","last_undegraded":"2024-09-15T23:22:26.574310+0000","last_fullsized":"2024-09-15T23:22:26.574310+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.581851+0000","last_change":"2024-09-15T23:22:26.580389+0000","last_active":"2024-09-15T23:22:26.581851+0000","last_peered":"2024-09-15T23:22:26.581851+0000","last_clean":"2024-09-15T23:22:26.581851+0000","last_became_active":"2024-09-15T23:22:26.579875+0000","last_became_peered":"2024-09-15T23:22:26.579875+0000","last_unstale":"2024-09-15T23:22:26.581851+0000","last_undegraded":"2024-09-15T23:22:26.581851+0000","last_fullsized":"2024-09-15T23:22:26.581851+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:52.838239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:25.556310+0000","last_change":"2024-09-15T23:22:25.556310+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:25.556310+0000","last_undegraded":"2024-09-15T23:22:25.556310+0000","last_fullsized":"2024-09-15T23:22:25.556310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.571753+0000","last_change":"2024-09-15T23:22:26.571753+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.571753+0000","last_undegraded":"2024-09-15T23:22:26.571753+0000","last_fullsized":"2024-09-15T23:22:26.571753+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:25.556310+0000","last_change":"2024-09-15T23:22:25.556310+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:25.556310+0000","last_undegraded":"2024-09-15T23:22:25.556310+0000","last_fullsized":"2024-09-15T23:22:25.556310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.581325+0000","last_change":"2024-09-15T23:22:26.581325+0000","last_active":"2024-09-15T23:22:26.581325+0000","last_peered":"2024-09-15T23:22:26.581325+0000","last_clean":"2024-09-15T23:22:26.581325+0000","last_became_active":"2024-09-15T23:22:26.581025+0000","last_became_peered":"2024-09-15T23:22:26.581025+0000","last_unstale":"2024-09-15T23:22:26.581325+0000","last_undegraded":"2024-09-15T23:22:26.581325+0000","last_fullsized":"2024-09-15T23:22:26.581325+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:12.991092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:25.556310+0000","last_change":"2024-09-15T23:22:25.556310+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:25.556310+0000","last_undegraded":"2024-09-15T23:22:25.556310+0000","last_fullsized":"2024-09-15T23:22:25.556310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:25.556310+0000","last_change":"2024-09-15T23:22:25.556310+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:25.556310+0000","last_undegraded":"2024-09-15T23:22:25.556310+0000","last_fullsized":"2024-09-15T23:22:25.556310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:25.556310+0000","last_change":"2024-09-15T23:22:25.556310+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:25.556310+0000","last_undegraded":"2024-09-15T23:22:25.556310+0000","last_fullsized":"2024-09-15T23:22:25.556310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:25.556310+0000","last_change":"2024-09-15T23:22:25.556310+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:25.556310+0000","last_undegraded":"2024-09-15T23:22:25.556310+0000","last_fullsized":"2024-09-15T23:22:25.556310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:25.556310+0000","last_change":"2024-09-15T23:22:25.556310+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:25.556310+0000","last_undegraded":"2024-09-15T23:22:25.556310+0000","last_fullsized":"2024-09-15T23:22:25.556310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.574059+0000","last_change":"2024-09-15T23:22:26.567832+0000","last_active":"2024-09-15T23:22:26.574059+0000","last_peered":"2024-09-15T23:22:26.574059+0000","last_clean":"2024-09-15T23:22:26.574059+0000","last_became_active":"2024-09-15T23:22:26.567505+0000","last_became_peered":"2024-09-15T23:22:26.567505+0000","last_unstale":"2024-09-15T23:22:26.574059+0000","last_undegraded":"2024-09-15T23:22:26.574059+0000","last_fullsized":"2024-09-15T23:22:26.574059+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:51.435086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.576620+0000","last_change":"2024-09-15T23:22:26.575007+0000","last_active":"2024-09-15T23:22:26.576620+0000","last_peered":"2024-09-15T23:22:26.576620+0000","last_clean":"2024-09-15T23:22:26.576620+0000","last_became_active":"2024-09-15T23:22:26.573900+0000","last_became_peered":"2024-09-15T23:22:26.573900+0000","last_unstale":"2024-09-15T23:22:26.576620+0000","last_undegraded":"2024-09-15T23:22:26.576620+0000","last_fullsized":"2024-09-15T23:22:26.576620+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:49.276352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:25.556310+0000","last_change":"2024-09-15T23:22:25.556310+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:25.556310+0000","last_undegraded":"2024-09-15T23:22:25.556310+0000","last_fullsized":"2024-09-15T23:22:25.556310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.578439+0000","last_change":"2024-09-15T23:22:26.577138+0000","last_active":"2024-09-15T23:22:26.578439+0000","last_peered":"2024-09-15T23:22:26.578439+0000","last_clean":"2024-09-15T23:22:26.578439+0000","last_became_active":"2024-09-15T23:22:26.574892+0000","last_became_peered":"2024-09-15T23:22:26.574892+0000","last_unstale":"2024-09-15T23:22:26.578439+0000","last_undegraded":"2024-09-15T23:22:26.578439+0000","last_fullsized":"2024-09-15T23:22:26.578439+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:00:10.891295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.583560+0000","last_change":"2024-09-15T23:22:26.581119+0000","last_active":"2024-09-15T23:22:26.583560+0000","last_peered":"2024-09-15T23:22:26.583560+0000","last_clean":"2024-09-15T23:22:26.583560+0000","last_became_active":"2024-09-15T23:22:26.580871+0000","last_became_peered":"2024-09-15T23:22:26.580871+0000","last_unstale":"2024-09-15T23:22:26.583560+0000","last_undegraded":"2024-09-15T23:22:26.583560+0000","last_fullsized":"2024-09-15T23:22:26.583560+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:23.329097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.577766+0000","last_change":"2024-09-15T23:22:26.575475+0000","last_active":"2024-09-15T23:22:26.577766+0000","last_peered":"2024-09-15T23:22:26.577766+0000","last_clean":"2024-09-15T23:22:26.577766+0000","last_became_active":"2024-09-15T23:22:26.575072+0000","last_became_peered":"2024-09-15T23:22:26.575072+0000","last_unstale":"2024-09-15T23:22:26.577766+0000","last_undegraded":"2024-09-15T23:22:26.577766+0000","last_fullsized":"2024-09-15T23:22:26.577766+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:54.325106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.575546+0000","last_change":"2024-09-15T23:22:26.575546+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.575546+0000","last_undegraded":"2024-09-15T23:22:26.575546+0000","last_fullsized":"2024-09-15T23:22:26.575546+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.566403+0000","last_change":"2024-09-15T23:22:26.566403+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.566403+0000","last_undegraded":"2024-09-15T23:22:26.566403+0000","last_fullsized":"2024-09-15T23:22:26.566403+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":["6","7"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.583113+0000","last_change":"2024-09-15T23:22:26.583113+0000","last_active":"2024-09-15T23:22:26.583113+0000","last_peered":"2024-09-15T23:22:26.583113+0000","last_clean":"2024-09-15T23:22:26.583113+0000","last_became_active":"2024-09-15T23:22:26.582600+0000","last_became_peered":"2024-09-15T23:22:26.582600+0000","last_unstale":"2024-09-15T23:22:26.583113+0000","last_undegraded":"2024-09-15T23:22:26.583113+0000","last_fullsized":"2024-09-15T23:22:26.583113+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:57:04.492522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:25.556310+0000","last_change":"2024-09-15T23:22:25.556310+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:25.556310+0000","last_undegraded":"2024-09-15T23:22:25.556310+0000","last_fullsized":"2024-09-15T23:22:25.556310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:25.556310+0000","last_change":"2024-09-15T23:22:25.556310+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:25.556310+0000","last_undegraded":"2024-09-15T23:22:25.556310+0000","last_fullsized":"2024-09-15T23:22:25.556310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.578403+0000","last_change":"2024-09-15T23:22:26.576639+0000","last_active":"2024-09-15T23:22:26.578403+0000","last_peered":"2024-09-15T23:22:26.578403+0000","last_clean":"2024-09-15T23:22:26.578403+0000","last_became_active":"2024-09-15T23:22:26.575205+0000","last_became_peered":"2024-09-15T23:22:26.575205+0000","last_unstale":"2024-09-15T23:22:26.578403+0000","last_undegraded":"2024-09-15T23:22:26.578403+0000","last_fullsized":"2024-09-15T23:22:26.578403+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:56:38.977444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.577328+0000","last_change":"2024-09-15T23:22:26.576356+0000","last_active":"2024-09-15T23:22:26.577328+0000","last_peered":"2024-09-15T23:22:26.577328+0000","last_clean":"2024-09-15T23:22:26.577328+0000","last_became_active":"2024-09-15T23:22:26.576081+0000","last_became_peered":"2024-09-15T23:22:26.576081+0000","last_unstale":"2024-09-15T23:22:26.577328+0000","last_undegraded":"2024-09-15T23:22:26.577328+0000","last_fullsized":"2024-09-15T23:22:26.577328+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:51.939872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:25.556310+0000","last_change":"2024-09-15T23:22:25.556310+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:25.556310+0000","last_undegraded":"2024-09-15T23:22:25.556310+0000","last_fullsized":"2024-09-15T23:22:25.556310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:25.556310+0000","last_change":"2024-09-15T23:22:25.556310+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:25.556310+0000","last_undegraded":"2024-09-15T23:22:25.556310+0000","last_fullsized":"2024-09-15T23:22:25.556310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.572280+0000","last_change":"2024-09-15T23:22:26.572280+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.572280+0000","last_undegraded":"2024-09-15T23:22:26.572280+0000","last_fullsized":"2024-09-15T23:22:26.572280+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":["7","0"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.572389+0000","last_change":"2024-09-15T23:22:26.572389+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.572389+0000","last_undegraded":"2024-09-15T23:22:26.572389+0000","last_fullsized":"2024-09-15T23:22:26.572389+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.582653+0000","last_change":"2024-09-15T23:22:26.582653+0000","last_active":"2024-09-15T23:22:26.582653+0000","last_peered":"2024-09-15T23:22:26.582653+0000","last_clean":"2024-09-15T23:22:26.582653+0000","last_became_active":"2024-09-15T23:22:26.581898+0000","last_became_peered":"2024-09-15T23:22:26.581898+0000","last_unstale":"2024-09-15T23:22:26.582653+0000","last_undegraded":"2024-09-15T23:22:26.582653+0000","last_fullsized":"2024-09-15T23:22:26.582653+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:05:43.582002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.563441+0000","last_change":"2024-09-15T23:22:25.571785+0000","last_active":"2024-09-15T23:22:26.563441+0000","last_peered":"2024-09-15T23:22:26.563441+0000","last_clean":"2024-09-15T23:22:26.563441+0000","last_became_active":"2024-09-15T23:22:25.571482+0000","last_became_peered":"2024-09-15T23:22:25.571482+0000","last_unstale":"2024-09-15T23:22:26.563441+0000","last_undegraded":"2024-09-15T23:22:26.563441+0000","last_fullsized":"2024-09-15T23:22:26.563441+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:55:16.627253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.581429+0000","last_change":"2024-09-15T23:22:26.581429+0000","last_active":"2024-09-15T23:22:26.581429+0000","last_peered":"2024-09-15T23:22:26.581429+0000","last_clean":"2024-09-15T23:22:26.581429+0000","last_became_active":"2024-09-15T23:22:26.580652+0000","last_became_peered":"2024-09-15T23:22:26.580652+0000","last_unstale":"2024-09-15T23:22:26.581429+0000","last_undegraded":"2024-09-15T23:22:26.581429+0000","last_fullsized":"2024-09-15T23:22:26.581429+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:31:17.071450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:24.550849+0000","last_change":"2024-09-15T23:22:24.550849+0000","last_active":"2024-09-15T23:22:24.550849+0000","last_peered":"2024-09-15T23:22:24.550849+0000","last_clean":"2024-09-15T23:22:24.550849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:24.550849+0000","last_undegraded":"2024-09-15T23:22:24.550849+0000","last_fullsized":"2024-09-15T23:22:24.550849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:25.556310+0000","last_change":"2024-09-15T23:22:25.556310+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:25.556310+0000","last_undegraded":"2024-09-15T23:22:25.556310+0000","last_fullsized":"2024-09-15T23:22:25.556310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.574749+0000","last_change":"2024-09-15T23:22:25.581273+0000","last_active":"2024-09-15T23:22:26.574749+0000","last_peered":"2024-09-15T23:22:26.574749+0000","last_clean":"2024-09-15T23:22:26.574749+0000","last_became_active":"2024-09-15T23:22:25.580975+0000","last_became_peered":"2024-09-15T23:22:25.580975+0000","last_unstale":"2024-09-15T23:22:26.574749+0000","last_undegraded":"2024-09-15T23:22:26.574749+0000","last_fullsized":"2024-09-15T23:22:26.574749+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:00:50.705677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:25.556310+0000","last_change":"2024-09-15T23:22:25.556310+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:25.556310+0000","last_undegraded":"2024-09-15T23:22:25.556310+0000","last_fullsized":"2024-09-15T23:22:25.556310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:24.550849+0000","last_change":"2024-09-15T23:22:24.550849+0000","last_active":"2024-09-15T23:22:24.550849+0000","last_peered":"2024-09-15T23:22:24.550849+0000","last_clean":"2024-09-15T23:22:24.550849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:24.550849+0000","last_undegraded":"2024-09-15T23:22:24.550849+0000","last_fullsized":"2024-09-15T23:22:24.550849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.581830+0000","last_change":"2024-09-15T23:22:26.580161+0000","last_active":"2024-09-15T23:22:26.581830+0000","last_peered":"2024-09-15T23:22:26.581830+0000","last_clean":"2024-09-15T23:22:26.581830+0000","last_became_active":"2024-09-15T23:22:26.579508+0000","last_became_peered":"2024-09-15T23:22:26.579508+0000","last_unstale":"2024-09-15T23:22:26.581830+0000","last_undegraded":"2024-09-15T23:22:26.581830+0000","last_fullsized":"2024-09-15T23:22:26.581830+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:49.916954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.574869+0000","last_change":"2024-09-15T23:22:25.581967+0000","last_active":"2024-09-15T23:22:26.574869+0000","last_peered":"2024-09-15T23:22:26.574869+0000","last_clean":"2024-09-15T23:22:26.574869+0000","last_became_active":"2024-09-15T23:22:25.581530+0000","last_became_peered":"2024-09-15T23:22:25.581530+0000","last_unstale":"2024-09-15T23:22:26.574869+0000","last_undegraded":"2024-09-15T23:22:26.574869+0000","last_fullsized":"2024-09-15T23:22:26.574869+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:27.111829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.574455+0000","last_change":"2024-09-15T23:22:26.574455+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.574455+0000","last_undegraded":"2024-09-15T23:22:26.574455+0000","last_fullsized":"2024-09-15T23:22:26.574455+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.575821+0000","last_change":"2024-09-15T23:22:25.578495+0000","last_active":"2024-09-15T23:22:26.575821+0000","last_peered":"2024-09-15T23:22:26.575821+0000","last_clean":"2024-09-15T23:22:26.575821+0000","last_became_active":"2024-09-15T23:22:25.578014+0000","last_became_peered":"2024-09-15T23:22:25.578014+0000","last_unstale":"2024-09-15T23:22:26.575821+0000","last_undegraded":"2024-09-15T23:22:26.575821+0000","last_fullsized":"2024-09-15T23:22:26.575821+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:39:21.619939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:25.556310+0000","last_change":"2024-09-15T23:22:25.556310+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:25.556310+0000","last_undegraded":"2024-09-15T23:22:25.556310+0000","last_fullsized":"2024-09-15T23:22:25.556310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:24.550849+0000","last_change":"2024-09-15T23:22:24.550849+0000","last_active":"2024-09-15T23:22:24.550849+0000","last_peered":"2024-09-15T23:22:24.550849+0000","last_clean":"2024-09-15T23:22:24.550849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:24.550849+0000","last_undegraded":"2024-09-15T23:22:24.550849+0000","last_fullsized":"2024-09-15T23:22:24.550849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.577007+0000","last_change":"2024-09-15T23:22:26.573073+0000","last_active":"2024-09-15T23:22:26.577007+0000","last_peered":"2024-09-15T23:22:26.577007+0000","last_clean":"2024-09-15T23:22:26.577007+0000","last_became_active":"2024-09-15T23:22:26.572211+0000","last_became_peered":"2024-09-15T23:22:26.572211+0000","last_unstale":"2024-09-15T23:22:26.577007+0000","last_undegraded":"2024-09-15T23:22:26.577007+0000","last_fullsized":"2024-09-15T23:22:26.577007+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:46.592940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:24.550849+0000","last_change":"2024-09-15T23:22:24.550849+0000","last_active":"2024-09-15T23:22:24.550849+0000","last_peered":"2024-09-15T23:22:24.550849+0000","last_clean":"2024-09-15T23:22:24.550849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:24.550849+0000","last_undegraded":"2024-09-15T23:22:24.550849+0000","last_fullsized":"2024-09-15T23:22:24.550849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.581186+0000","last_change":"2024-09-15T23:22:26.581186+0000","last_active":"2024-09-15T23:22:26.581186+0000","last_peered":"2024-09-15T23:22:26.581186+0000","last_clean":"2024-09-15T23:22:26.581186+0000","last_became_active":"2024-09-15T23:22:26.580278+0000","last_became_peered":"2024-09-15T23:22:26.580278+0000","last_unstale":"2024-09-15T23:22:26.581186+0000","last_undegraded":"2024-09-15T23:22:26.581186+0000","last_fullsized":"2024-09-15T23:22:26.581186+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:17.131723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.568273+0000","last_change":"2024-09-15T23:22:25.573560+0000","last_active":"2024-09-15T23:22:26.568273+0000","last_peered":"2024-09-15T23:22:26.568273+0000","last_clean":"2024-09-15T23:22:26.568273+0000","last_became_active":"2024-09-15T23:22:25.573270+0000","last_became_peered":"2024-09-15T23:22:25.573270+0000","last_unstale":"2024-09-15T23:22:26.568273+0000","last_undegraded":"2024-09-15T23:22:26.568273+0000","last_fullsized":"2024-09-15T23:22:26.568273+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:44.556930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:25.556310+0000","last_change":"2024-09-15T23:22:25.556310+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:25.556310+0000","last_undegraded":"2024-09-15T23:22:25.556310+0000","last_fullsized":"2024-09-15T23:22:25.556310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.574886+0000","last_change":"2024-09-15T23:22:25.580281+0000","last_active":"2024-09-15T23:22:26.574886+0000","last_peered":"2024-09-15T23:22:26.574886+0000","last_clean":"2024-09-15T23:22:26.574886+0000","last_became_active":"2024-09-15T23:22:25.579966+0000","last_became_peered":"2024-09-15T23:22:25.579966+0000","last_unstale":"2024-09-15T23:22:26.574886+0000","last_undegraded":"2024-09-15T23:22:26.574886+0000","last_fullsized":"2024-09-15T23:22:26.574886+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:11.132878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.568134+0000","last_change":"2024-09-15T23:22:26.568134+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.568134+0000","last_undegraded":"2024-09-15T23:22:26.568134+0000","last_fullsized":"2024-09-15T23:22:26.568134+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":["6","5"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.574342+0000","last_change":"2024-09-15T23:22:25.582774+0000","last_active":"2024-09-15T23:22:26.574342+0000","last_peered":"2024-09-15T23:22:26.574342+0000","last_clean":"2024-09-15T23:22:26.574342+0000","last_became_active":"2024-09-15T23:22:25.582455+0000","last_became_peered":"2024-09-15T23:22:25.582455+0000","last_unstale":"2024-09-15T23:22:26.574342+0000","last_undegraded":"2024-09-15T23:22:26.574342+0000","last_fullsized":"2024-09-15T23:22:26.574342+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:58.026111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.579221+0000","last_change":"2024-09-15T23:22:26.579221+0000","last_active":"2024-09-15T23:22:26.579221+0000","last_peered":"2024-09-15T23:22:26.579221+0000","last_clean":"2024-09-15T23:22:26.579221+0000","last_became_active":"2024-09-15T23:22:26.578424+0000","last_became_peered":"2024-09-15T23:22:26.578424+0000","last_unstale":"2024-09-15T23:22:26.579221+0000","last_undegraded":"2024-09-15T23:22:26.579221+0000","last_fullsized":"2024-09-15T23:22:26.579221+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:51.710387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:24.550849+0000","last_change":"2024-09-15T23:22:24.550849+0000","last_active":"2024-09-15T23:22:24.550849+0000","last_peered":"2024-09-15T23:22:24.550849+0000","last_clean":"2024-09-15T23:22:24.550849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:24.550849+0000","last_undegraded":"2024-09-15T23:22:24.550849+0000","last_fullsized":"2024-09-15T23:22:24.550849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:25.556310+0000","last_change":"2024-09-15T23:22:25.556310+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:25.556310+0000","last_undegraded":"2024-09-15T23:22:25.556310+0000","last_fullsized":"2024-09-15T23:22:25.556310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.567290+0000","last_change":"2024-09-15T23:22:25.579017+0000","last_active":"2024-09-15T23:22:26.567290+0000","last_peered":"2024-09-15T23:22:26.567290+0000","last_clean":"2024-09-15T23:22:26.567290+0000","last_became_active":"2024-09-15T23:22:25.578734+0000","last_became_peered":"2024-09-15T23:22:25.578734+0000","last_unstale":"2024-09-15T23:22:26.567290+0000","last_undegraded":"2024-09-15T23:22:26.567290+0000","last_fullsized":"2024-09-15T23:22:26.567290+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:40:23.282623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:25.556310+0000","last_change":"2024-09-15T23:22:25.556310+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:25.556310+0000","last_undegraded":"2024-09-15T23:22:25.556310+0000","last_fullsized":"2024-09-15T23:22:25.556310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.572851+0000","last_change":"2024-09-15T23:22:25.583097+0000","last_active":"2024-09-15T23:22:26.572851+0000","last_peered":"2024-09-15T23:22:26.572851+0000","last_clean":"2024-09-15T23:22:26.572851+0000","last_became_active":"2024-09-15T23:22:25.582619+0000","last_became_peered":"2024-09-15T23:22:25.582619+0000","last_unstale":"2024-09-15T23:22:26.572851+0000","last_undegraded":"2024-09-15T23:22:26.572851+0000","last_fullsized":"2024-09-15T23:22:26.572851+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:37:30.698864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.579456+0000","last_change":"2024-09-15T23:22:26.579456+0000","last_active":"2024-09-15T23:22:26.579456+0000","last_peered":"2024-09-15T23:22:26.579456+0000","last_clean":"2024-09-15T23:22:26.579456+0000","last_became_active":"2024-09-15T23:22:26.579149+0000","last_became_peered":"2024-09-15T23:22:26.579149+0000","last_unstale":"2024-09-15T23:22:26.579456+0000","last_undegraded":"2024-09-15T23:22:26.579456+0000","last_fullsized":"2024-09-15T23:22:26.579456+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:00:44.482957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:24.550849+0000","last_change":"2024-09-15T23:22:24.550849+0000","last_active":"2024-09-15T23:22:24.550849+0000","last_peered":"2024-09-15T23:22:24.550849+0000","last_clean":"2024-09-15T23:22:24.550849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:24.550849+0000","last_undegraded":"2024-09-15T23:22:24.550849+0000","last_fullsized":"2024-09-15T23:22:24.550849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.579012+0000","last_change":"2024-09-15T23:22:26.579012+0000","last_active":"2024-09-15T23:22:26.579012+0000","last_peered":"2024-09-15T23:22:26.579012+0000","last_clean":"2024-09-15T23:22:26.579012+0000","last_became_active":"2024-09-15T23:22:26.578733+0000","last_became_peered":"2024-09-15T23:22:26.578733+0000","last_unstale":"2024-09-15T23:22:26.579012+0000","last_undegraded":"2024-09-15T23:22:26.579012+0000","last_fullsized":"2024-09-15T23:22:26.579012+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:43.656480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.574284+0000","last_change":"2024-09-15T23:22:25.581794+0000","last_active":"2024-09-15T23:22:26.574284+0000","last_peered":"2024-09-15T23:22:26.574284+0000","last_clean":"2024-09-15T23:22:26.574284+0000","last_became_active":"2024-09-15T23:22:25.581463+0000","last_became_peered":"2024-09-15T23:22:25.581463+0000","last_unstale":"2024-09-15T23:22:26.574284+0000","last_undegraded":"2024-09-15T23:22:26.574284+0000","last_fullsized":"2024-09-15T23:22:26.574284+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:40:23.527619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:25.556310+0000","last_change":"2024-09-15T23:22:25.556310+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:25.556310+0000","last_undegraded":"2024-09-15T23:22:25.556310+0000","last_fullsized":"2024-09-15T23:22:25.556310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.e","version":"181'2","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.569958+0000","last_change":"2024-09-15T23:22:25.576185+0000","last_active":"2024-09-15T23:22:26.569958+0000","last_peered":"2024-09-15T23:22:26.569958+0000","last_clean":"2024-09-15T23:22:26.569958+0000","last_became_active":"2024-09-15T23:22:25.575627+0000","last_became_peered":"2024-09-15T23:22:25.575627+0000","last_unstale":"2024-09-15T23:22:26.569958+0000","last_undegraded":"2024-09-15T23:22:26.569958+0000","last_fullsized":"2024-09-15T23:22:26.569958+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:01:31.306518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:25.556310+0000","last_change":"2024-09-15T23:22:25.556310+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:25.556310+0000","last_undegraded":"2024-09-15T23:22:25.556310+0000","last_fullsized":"2024-09-15T23:22:25.556310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:24.550849+0000","last_change":"2024-09-15T23:22:24.550849+0000","last_active":"2024-09-15T23:22:24.550849+0000","last_peered":"2024-09-15T23:22:24.550849+0000","last_clean":"2024-09-15T23:22:24.550849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:24.550849+0000","last_undegraded":"2024-09-15T23:22:24.550849+0000","last_fullsized":"2024-09-15T23:22:24.550849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:25.556310+0000","last_change":"2024-09-15T23:22:25.556310+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:25.556310+0000","last_undegraded":"2024-09-15T23:22:25.556310+0000","last_fullsized":"2024-09-15T23:22:25.556310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:24.550849+0000","last_change":"2024-09-15T23:22:24.550849+0000","last_active":"2024-09-15T23:22:24.550849+0000","last_peered":"2024-09-15T23:22:24.550849+0000","last_clean":"2024-09-15T23:22:24.550849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:24.550849+0000","last_undegraded":"2024-09-15T23:22:24.550849+0000","last_fullsized":"2024-09-15T23:22:24.550849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.575704+0000","last_change":"2024-09-15T23:22:26.572799+0000","last_active":"2024-09-15T23:22:26.575704+0000","last_peered":"2024-09-15T23:22:26.575704+0000","last_clean":"2024-09-15T23:22:26.575704+0000","last_became_active":"2024-09-15T23:22:26.572539+0000","last_became_peered":"2024-09-15T23:22:26.572539+0000","last_unstale":"2024-09-15T23:22:26.575704+0000","last_undegraded":"2024-09-15T23:22:26.575704+0000","last_fullsized":"2024-09-15T23:22:26.575704+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:40:36.495840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.575004+0000","last_change":"2024-09-15T23:22:25.580246+0000","last_active":"2024-09-15T23:22:26.575004+0000","last_peered":"2024-09-15T23:22:26.575004+0000","last_clean":"2024-09-15T23:22:26.575004+0000","last_became_active":"2024-09-15T23:22:25.579936+0000","last_became_peered":"2024-09-15T23:22:25.579936+0000","last_unstale":"2024-09-15T23:22:26.575004+0000","last_undegraded":"2024-09-15T23:22:26.575004+0000","last_fullsized":"2024-09-15T23:22:26.575004+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:51.335262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:25.556310+0000","last_change":"2024-09-15T23:22:25.556310+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:25.556310+0000","last_undegraded":"2024-09-15T23:22:25.556310+0000","last_fullsized":"2024-09-15T23:22:25.556310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.569190+0000","last_change":"2024-09-15T23:22:25.577475+0000","last_active":"2024-09-15T23:22:26.569190+0000","last_peered":"2024-09-15T23:22:26.569190+0000","last_clean":"2024-09-15T23:22:26.569190+0000","last_became_active":"2024-09-15T23:22:25.577195+0000","last_became_peered":"2024-09-15T23:22:25.577195+0000","last_unstale":"2024-09-15T23:22:26.569190+0000","last_undegraded":"2024-09-15T23:22:26.569190+0000","last_fullsized":"2024-09-15T23:22:26.569190+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:09.611603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:25.556310+0000","last_change":"2024-09-15T23:22:25.556310+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:25.556310+0000","last_undegraded":"2024-09-15T23:22:25.556310+0000","last_fullsized":"2024-09-15T23:22:25.556310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.569225+0000","last_change":"2024-09-15T23:22:25.576650+0000","last_active":"2024-09-15T23:22:26.569225+0000","last_peered":"2024-09-15T23:22:26.569225+0000","last_clean":"2024-09-15T23:22:26.569225+0000","last_became_active":"2024-09-15T23:22:25.576362+0000","last_became_peered":"2024-09-15T23:22:25.576362+0000","last_unstale":"2024-09-15T23:22:26.569225+0000","last_undegraded":"2024-09-15T23:22:26.569225+0000","last_fullsized":"2024-09-15T23:22:26.569225+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:00:27.234261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.580637+0000","last_change":"2024-09-15T23:22:26.580637+0000","last_active":"2024-09-15T23:22:26.580637+0000","last_peered":"2024-09-15T23:22:26.580637+0000","last_clean":"2024-09-15T23:22:26.580637+0000","last_became_active":"2024-09-15T23:22:26.580301+0000","last_became_peered":"2024-09-15T23:22:26.580301+0000","last_unstale":"2024-09-15T23:22:26.580637+0000","last_undegraded":"2024-09-15T23:22:26.580637+0000","last_fullsized":"2024-09-15T23:22:26.580637+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:50.916622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:24.550849+0000","last_change":"2024-09-15T23:22:24.550849+0000","last_active":"2024-09-15T23:22:24.550849+0000","last_peered":"2024-09-15T23:22:24.550849+0000","last_clean":"2024-09-15T23:22:24.550849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:24.550849+0000","last_undegraded":"2024-09-15T23:22:24.550849+0000","last_fullsized":"2024-09-15T23:22:24.550849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.582919+0000","last_change":"2024-09-15T23:22:26.581001+0000","last_active":"2024-09-15T23:22:26.582919+0000","last_peered":"2024-09-15T23:22:26.582919+0000","last_clean":"2024-09-15T23:22:26.582919+0000","last_became_active":"2024-09-15T23:22:26.580287+0000","last_became_peered":"2024-09-15T23:22:26.580287+0000","last_unstale":"2024-09-15T23:22:26.582919+0000","last_undegraded":"2024-09-15T23:22:26.582919+0000","last_fullsized":"2024-09-15T23:22:26.582919+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:32.384598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:24.550849+0000","last_change":"2024-09-15T23:22:24.550849+0000","last_active":"2024-09-15T23:22:24.550849+0000","last_peered":"2024-09-15T23:22:24.550849+0000","last_clean":"2024-09-15T23:22:24.550849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:24.550849+0000","last_undegraded":"2024-09-15T23:22:24.550849+0000","last_fullsized":"2024-09-15T23:22:24.550849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.582270+0000","last_change":"2024-09-15T23:22:26.578188+0000","last_active":"2024-09-15T23:22:26.582270+0000","last_peered":"2024-09-15T23:22:26.582270+0000","last_clean":"2024-09-15T23:22:26.582270+0000","last_became_active":"2024-09-15T23:22:26.577930+0000","last_became_peered":"2024-09-15T23:22:26.577930+0000","last_unstale":"2024-09-15T23:22:26.582270+0000","last_undegraded":"2024-09-15T23:22:26.582270+0000","last_fullsized":"2024-09-15T23:22:26.582270+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:51:54.832034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.563588+0000","last_change":"2024-09-15T23:22:25.575025+0000","last_active":"2024-09-15T23:22:26.563588+0000","last_peered":"2024-09-15T23:22:26.563588+0000","last_clean":"2024-09-15T23:22:26.563588+0000","last_became_active":"2024-09-15T23:22:25.574715+0000","last_became_peered":"2024-09-15T23:22:25.574715+0000","last_unstale":"2024-09-15T23:22:26.563588+0000","last_undegraded":"2024-09-15T23:22:26.563588+0000","last_fullsized":"2024-09-15T23:22:26.563588+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:26.917144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.562462+0000","last_change":"2024-09-15T23:22:26.562462+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.562462+0000","last_undegraded":"2024-09-15T23:22:26.562462+0000","last_fullsized":"2024-09-15T23:22:26.562462+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.564020+0000","last_change":"2024-09-15T23:22:25.576386+0000","last_active":"2024-09-15T23:22:26.564020+0000","last_peered":"2024-09-15T23:22:26.564020+0000","last_clean":"2024-09-15T23:22:26.564020+0000","last_became_active":"2024-09-15T23:22:25.574655+0000","last_became_peered":"2024-09-15T23:22:25.574655+0000","last_unstale":"2024-09-15T23:22:26.564020+0000","last_undegraded":"2024-09-15T23:22:26.564020+0000","last_fullsized":"2024-09-15T23:22:26.564020+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:00:02.848434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.574474+0000","last_change":"2024-09-15T23:22:26.574474+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.574474+0000","last_undegraded":"2024-09-15T23:22:26.574474+0000","last_fullsized":"2024-09-15T23:22:26.574474+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.574601+0000","last_change":"2024-09-15T23:22:25.582743+0000","last_active":"2024-09-15T23:22:26.574601+0000","last_peered":"2024-09-15T23:22:26.574601+0000","last_clean":"2024-09-15T23:22:26.574601+0000","last_became_active":"2024-09-15T23:22:25.582439+0000","last_became_peered":"2024-09-15T23:22:25.582439+0000","last_unstale":"2024-09-15T23:22:26.574601+0000","last_undegraded":"2024-09-15T23:22:26.574601+0000","last_fullsized":"2024-09-15T23:22:26.574601+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:45.831574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:25.556310+0000","last_change":"2024-09-15T23:22:25.556310+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:25.556310+0000","last_undegraded":"2024-09-15T23:22:25.556310+0000","last_fullsized":"2024-09-15T23:22:25.556310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:24.550849+0000","last_change":"2024-09-15T23:22:24.550849+0000","last_active":"2024-09-15T23:22:24.550849+0000","last_peered":"2024-09-15T23:22:24.550849+0000","last_clean":"2024-09-15T23:22:24.550849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:24.550849+0000","last_undegraded":"2024-09-15T23:22:24.550849+0000","last_fullsized":"2024-09-15T23:22:24.550849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:25.556310+0000","last_change":"2024-09-15T23:22:25.556310+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:25.556310+0000","last_undegraded":"2024-09-15T23:22:25.556310+0000","last_fullsized":"2024-09-15T23:22:25.556310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:24.550849+0000","last_change":"2024-09-15T23:22:24.550849+0000","last_active":"2024-09-15T23:22:24.550849+0000","last_peered":"2024-09-15T23:22:24.550849+0000","last_clean":"2024-09-15T23:22:24.550849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:24.550849+0000","last_undegraded":"2024-09-15T23:22:24.550849+0000","last_fullsized":"2024-09-15T23:22:24.550849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:25.556310+0000","last_change":"2024-09-15T23:22:25.556310+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:25.556310+0000","last_undegraded":"2024-09-15T23:22:25.556310+0000","last_fullsized":"2024-09-15T23:22:25.556310+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:24.550849+0000","last_change":"2024-09-15T23:22:24.550849+0000","last_active":"2024-09-15T23:22:24.550849+0000","last_peered":"2024-09-15T23:22:24.550849+0000","last_clean":"2024-09-15T23:22:24.550849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:24.550849+0000","last_undegraded":"2024-09-15T23:22:24.550849+0000","last_fullsized":"2024-09-15T23:22:24.550849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.580413+0000","last_change":"2024-09-15T23:22:26.580413+0000","last_active":"2024-09-15T23:22:26.580413+0000","last_peered":"2024-09-15T23:22:26.580413+0000","last_clean":"2024-09-15T23:22:26.580413+0000","last_became_active":"2024-09-15T23:22:26.580139+0000","last_became_peered":"2024-09-15T23:22:26.580139+0000","last_unstale":"2024-09-15T23:22:26.580413+0000","last_undegraded":"2024-09-15T23:22:26.580413+0000","last_fullsized":"2024-09-15T23:22:26.580413+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:22:31.713809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.567955+0000","last_change":"2024-09-15T23:22:25.574211+0000","last_active":"2024-09-15T23:22:26.567955+0000","last_peered":"2024-09-15T23:22:26.567955+0000","last_clean":"2024-09-15T23:22:26.567955+0000","last_became_active":"2024-09-15T23:22:25.573828+0000","last_became_peered":"2024-09-15T23:22:25.573828+0000","last_unstale":"2024-09-15T23:22:26.567955+0000","last_undegraded":"2024-09-15T23:22:26.567955+0000","last_fullsized":"2024-09-15T23:22:26.567955+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:53.008952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.579577+0000","last_change":"2024-09-15T23:22:26.578711+0000","last_active":"2024-09-15T23:22:26.579577+0000","last_peered":"2024-09-15T23:22:26.579577+0000","last_clean":"2024-09-15T23:22:26.579577+0000","last_became_active":"2024-09-15T23:22:26.578300+0000","last_became_peered":"2024-09-15T23:22:26.578300+0000","last_unstale":"2024-09-15T23:22:26.579577+0000","last_undegraded":"2024-09-15T23:22:26.579577+0000","last_fullsized":"2024-09-15T23:22:26.579577+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:20:01.080774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:22:24.550849+0000","last_change":"2024-09-15T23:22:24.550849+0000","last_active":"2024-09-15T23:22:24.550849+0000","last_peered":"2024-09-15T23:22:24.550849+0000","last_clean":"2024-09-15T23:22:24.550849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:24.550849+0000","last_undegraded":"2024-09-15T23:22:24.550849+0000","last_fullsized":"2024-09-15T23:22:24.550849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":459,"reported_epoch":177,"state":"active+clean","last_fresh":"2024-09-15T23:22:21.558624+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:22:21.558624+0000","last_peered":"2024-09-15T23:22:21.558624+0000","last_clean":"2024-09-15T23:22:21.558624+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:22:21.558624+0000","last_undegraded":"2024-09-15T23:22:21.558624+0000","last_fullsized":"2024-09-15T23:22:21.558624+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":70,"acting":70,"num_store_stats":4},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":36,"acting":36,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59740,"kb_used_data":2172,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312100,"statfs":{"total":96636764160,"available":96575590400,"internally_reserved":0,"allocated":2224128,"data_stored":983239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55556,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316284,"statfs":{"total":96636764160,"available":96579874816,"internally_reserved":0,"allocated":2211840,"data_stored":978042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56136,"kb_used_data":2740,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315704,"statfs":{"total":96636764160,"available":96579280896,"internally_reserved":0,"allocated":2805760,"data_stored":1568410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":29212,"kb_used_data":2172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342628,"statfs":{"total":96636764160,"available":96606851072,"internally_reserved":0,"allocated":2224128,"data_stored":983239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542272,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51428,"kb_used_data":2196,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320412,"statfs":{"total":96636764160,"available":96584101888,"internally_reserved":0,"allocated":2248704,"data_stored":995331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542272,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55600,"kb_used_data":2196,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316240,"statfs":{"total":96636764160,"available":96579829760,"internally_reserved":0,"allocated":2248704,"data_stored":995331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542271,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60332,"kb_used_data":2776,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311508,"statfs":{"total":96636764160,"available":96574984192,"internally_reserved":0,"allocated":2842624,"data_stored":1585699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542273,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55592,"kb_used_data":2196,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316248,"statfs":{"total":96636764160,"available":96579837952,"internally_reserved":0,"allocated":2248704,"data_stored":995331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:22:29.523 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:22:29.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.655+0000 7efdebcba640 1 Processor -- start 2024-09-15T23:22:29.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.655+0000 7efdebcba640 1 -- start start 2024-09-15T23:22:29.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.656+0000 7efdebcba640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7efde406cd20 0x7efde40b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:29.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.656+0000 7efdebcba640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efde4070b80 0x7efde40b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:29.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.656+0000 7efdebcba640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efde415eab0 con 0x7efde415e6d0 2024-09-15T23:22:29.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.656+0000 7efdebcba640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7efde40b77e0 con 0x7efde4070b80 2024-09-15T23:22:29.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.656+0000 7efdebcba640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7efde415ed70 con 0x7efde406cd20 2024-09-15T23:22:29.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.656+0000 7efde9a56640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7efde415e6d0 0x7efde4071390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36770/0 (socket says 172.21.15.123:36770) 2024-09-15T23:22:29.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.656+0000 7efdea257640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efde4070b80 0x7efde40b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:29.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.656+0000 7efde9a56640 1 -- 172.21.15.123:0/1382085330 learned_addr learned my addr 172.21.15.123:0/1382085330 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:29.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.657+0000 7efdea257640 1 -- 172.21.15.123:0/1382085330 >> v2:172.21.15.188:3300/0 conn(0x7efde406cd20 msgr2=0x7efde40b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:29.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.657+0000 7efdea257640 1 --2- 172.21.15.123:0/1382085330 >> v2:172.21.15.188:3300/0 conn(0x7efde406cd20 0x7efde40b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.657+0000 7efdea257640 1 -- 172.21.15.123:0/1382085330 >> v1:172.21.15.123:6789/0 conn(0x7efde415e6d0 legacy=0x7efde4071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:29.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.657+0000 7efde8a54640 1 -- 172.21.15.123:0/1382085330 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 433140601 0 0) 0x7efde415eab0 con 0x7efde415e6d0 2024-09-15T23:22:29.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.657+0000 7efdea257640 1 -- 172.21.15.123:0/1382085330 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde415f050 con 0x7efde4070b80 2024-09-15T23:22:29.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.657+0000 7efdea257640 1 --2- 172.21.15.123:0/1382085330 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efde4070b80 0x7efde40b72a0 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7efde4072f80 tx=0x7efddc02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7853cae7a90f22bc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:29.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.657+0000 7efde8a54640 1 -- 172.21.15.123:0/1382085330 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efddc007740 con 0x7efde4070b80 2024-09-15T23:22:29.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.657+0000 7efde8a54640 1 -- 172.21.15.123:0/1382085330 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efddc0078e0 con 0x7efde4070b80 2024-09-15T23:22:29.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.657+0000 7efde8a54640 1 -- 172.21.15.123:0/1382085330 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efddc007cb0 con 0x7efde4070b80 2024-09-15T23:22:29.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.658+0000 7efdebcba640 1 -- 172.21.15.123:0/1382085330 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efde4070b80 msgr2=0x7efde40b72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:29.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.658+0000 7efdebcba640 1 --2- 172.21.15.123:0/1382085330 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efde4070b80 0x7efde40b72a0 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7efde4072f80 tx=0x7efddc02a680 comp rx=0 tx=0).stop 2024-09-15T23:22:29.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.658+0000 7efdebcba640 1 -- 172.21.15.123:0/1382085330 shutdown_connections 2024-09-15T23:22:29.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.658+0000 7efdebcba640 1 --2- 172.21.15.123:0/1382085330 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efde4070b80 0x7efde40b72a0 unknown :-1 s=CLOSED pgs=2089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.658+0000 7efdebcba640 1 --2- 172.21.15.123:0/1382085330 >> v2:172.21.15.188:3300/0 conn(0x7efde406cd20 0x7efde40b6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.658+0000 7efdebcba640 1 -- 172.21.15.123:0/1382085330 >> 172.21.15.123:0/1382085330 conn(0x7efde4067fb0 msgr2=0x7efde406f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:29.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.658+0000 7efdebcba640 1 -- 172.21.15.123:0/1382085330 shutdown_connections 2024-09-15T23:22:29.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.658+0000 7efdebcba640 1 -- 172.21.15.123:0/1382085330 wait complete. 2024-09-15T23:22:29.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.659+0000 7efdebcba640 1 Processor -- start 2024-09-15T23:22:29.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.659+0000 7efdebcba640 1 -- start start 2024-09-15T23:22:29.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.660+0000 7efdebcba640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efde406cd20 0x7efde4151270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:29.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.660+0000 7efdebcba640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efde4070b80 0x7efde40b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:29.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.660+0000 7efdebcba640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efde415e6d0 0x7efde40b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:29.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.660+0000 7efdebcba640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efde415f8f0 con 0x7efde4070b80 2024-09-15T23:22:29.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.660+0000 7efdebcba640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7efde415f610 con 0x7efde406cd20 2024-09-15T23:22:29.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.660+0000 7efdebcba640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7efde41622a0 con 0x7efde415e6d0 2024-09-15T23:22:29.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.660+0000 7efde9255640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efde4070b80 0x7efde40b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:29.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.660+0000 7efde9255640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efde4070b80 0x7efde40b3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35492/0 (socket says 172.21.15.123:35492) 2024-09-15T23:22:29.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.660+0000 7efde9255640 1 -- 172.21.15.123:0/1146078809 learned_addr learned my addr 172.21.15.123:0/1146078809 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:29.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.660+0000 7efde9a56640 1 --2- 172.21.15.123:0/1146078809 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efde406cd20 0x7efde4151270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:29.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.660+0000 7efdea257640 1 --2- 172.21.15.123:0/1146078809 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efde415e6d0 0x7efde40b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:29.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.660+0000 7efde9255640 1 -- 172.21.15.123:0/1146078809 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efde415e6d0 msgr2=0x7efde40b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:29.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.660+0000 7efde9255640 1 --2- 172.21.15.123:0/1146078809 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efde415e6d0 0x7efde40b43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.660+0000 7efde9255640 1 -- 172.21.15.123:0/1146078809 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efde406cd20 msgr2=0x7efde4151270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:29.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.660+0000 7efde9255640 1 --2- 172.21.15.123:0/1146078809 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efde406cd20 0x7efde4151270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.660+0000 7efde9255640 1 -- 172.21.15.123:0/1146078809 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde4155360 con 0x7efde4070b80 2024-09-15T23:22:29.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.661+0000 7efde9255640 1 --2- 172.21.15.123:0/1146078809 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efde4070b80 0x7efde40b3ea0 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7efdd400b450 tx=0x7efdd400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:29.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.661+0000 7efdda7fc640 1 -- 172.21.15.123:0/1146078809 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd4015020 con 0x7efde4070b80 2024-09-15T23:22:29.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.661+0000 7efdda7fc640 1 -- 172.21.15.123:0/1146078809 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdd4011890 con 0x7efde4070b80 2024-09-15T23:22:29.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.661+0000 7efdebcba640 1 -- 172.21.15.123:0/1146078809 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efde4155640 con 0x7efde4070b80 2024-09-15T23:22:29.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.661+0000 7efdda7fc640 1 -- 172.21.15.123:0/1146078809 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd4011c80 con 0x7efde4070b80 2024-09-15T23:22:29.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.661+0000 7efdebcba640 1 -- 172.21.15.123:0/1146078809 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efde4155c00 con 0x7efde4070b80 2024-09-15T23:22:29.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.662+0000 7efdebcba640 1 -- 172.21.15.123:0/1146078809 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efde4155e00 con 0x7efde4070b80 2024-09-15T23:22:29.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.662+0000 7efdda7fc640 1 -- 172.21.15.123:0/1146078809 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7efdd4018020 con 0x7efde4070b80 2024-09-15T23:22:29.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.663+0000 7efdda7fc640 1 --2- 172.21.15.123:0/1146078809 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efdc806c2b0 0x7efdc806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:29.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.663+0000 7efdda7fc640 1 -- 172.21.15.123:0/1146078809 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7efdd408b600 con 0x7efde4070b80 2024-09-15T23:22:29.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.663+0000 7efde9a56640 1 --2- 172.21.15.123:0/1146078809 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efdc806c2b0 0x7efdc806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:29.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.664+0000 7efde9a56640 1 --2- 172.21.15.123:0/1146078809 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efdc806c2b0 0x7efdc806e770 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7efde0000f60 tx=0x7efde0007c00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:29.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.667+0000 7efdda7fc640 1 -- 172.21.15.123:0/1146078809 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efde4155e00 con 0x7efde4070b80 2024-09-15T23:22:29.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.829+0000 7efdebcba640 1 -- 172.21.15.123:0/1146078809 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efde4071390 con 0x7efdc806c2b0 2024-09-15T23:22:29.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.835+0000 7efdda7fc640 1 -- 172.21.15.123:0/1146078809 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251686 (secure 0 0 0) 0x7efde4071390 con 0x7efdc806c2b0 2024-09-15T23:22:29.839 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:22:29.840 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:22:29.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.838+0000 7efdebcba640 1 -- 172.21.15.123:0/1146078809 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efdc806c2b0 msgr2=0x7efdc806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:29.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.838+0000 7efdebcba640 1 --2- 172.21.15.123:0/1146078809 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efdc806c2b0 0x7efdc806e770 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7efde0000f60 tx=0x7efde0007c00 comp rx=0 tx=0).stop 2024-09-15T23:22:29.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.838+0000 7efdebcba640 1 -- 172.21.15.123:0/1146078809 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efde4070b80 msgr2=0x7efde40b3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:29.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.838+0000 7efdebcba640 1 --2- 172.21.15.123:0/1146078809 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efde4070b80 0x7efde40b3ea0 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7efdd400b450 tx=0x7efdd400b910 comp rx=0 tx=0).stop 2024-09-15T23:22:29.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.838+0000 7efdebcba640 1 -- 172.21.15.123:0/1146078809 shutdown_connections 2024-09-15T23:22:29.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.838+0000 7efdebcba640 1 --2- 172.21.15.123:0/1146078809 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7efde415e6d0 0x7efde40b43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.838+0000 7efdebcba640 1 --2- 172.21.15.123:0/1146078809 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7efdc806c2b0 0x7efdc806e770 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.838+0000 7efdebcba640 1 --2- 172.21.15.123:0/1146078809 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efde4070b80 0x7efde40b3ea0 unknown :-1 s=CLOSED pgs=2090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.838+0000 7efdebcba640 1 --2- 172.21.15.123:0/1146078809 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7efde406cd20 0x7efde4151270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.838+0000 7efdebcba640 1 -- 172.21.15.123:0/1146078809 >> 172.21.15.123:0/1146078809 conn(0x7efde4067fb0 msgr2=0x7efde4160580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:29.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.838+0000 7efdebcba640 1 -- 172.21.15.123:0/1146078809 shutdown_connections 2024-09-15T23:22:29.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.838+0000 7efdebcba640 1 -- 172.21.15.123:0/1146078809 wait complete. 2024-09-15T23:22:29.850 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":489,"stamp":"2024-09-15T23:22:29.650518+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590472,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":184,"num_write_kb":2424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":441864,"kb_used_data":18840,"kb_used_omap":12,"kb_used_meta":422835,"kb_avail":754532856,"statfs":{"total":773094113280,"available":772641644544,"internally_reserved":0,"allocated":19292160,"data_stored":9191752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":432983600},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":104,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.093509"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563494+0000","last_change":"2024-09-15T23:22:26.576654+0000","last_active":"2024-09-15T23:22:27.563494+0000","last_peered":"2024-09-15T23:22:27.563494+0000","last_clean":"2024-09-15T23:22:27.563494+0000","last_became_active":"2024-09-15T23:22:26.576393+0000","last_became_peered":"2024-09-15T23:22:26.576393+0000","last_unstale":"2024-09-15T23:22:27.563494+0000","last_undegraded":"2024-09-15T23:22:27.563494+0000","last_fullsized":"2024-09-15T23:22:27.563494+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:11.370324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.986158+0000","last_change":"2024-09-15T23:22:26.579287+0000","last_active":"2024-09-15T23:22:27.986158+0000","last_peered":"2024-09-15T23:22:27.986158+0000","last_clean":"2024-09-15T23:22:27.986158+0000","last_became_active":"2024-09-15T23:22:26.579010+0000","last_became_peered":"2024-09-15T23:22:26.579010+0000","last_unstale":"2024-09-15T23:22:27.986158+0000","last_undegraded":"2024-09-15T23:22:27.986158+0000","last_fullsized":"2024-09-15T23:22:27.986158+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:21.190640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.578422+0000","last_change":"2024-09-15T23:22:26.577028+0000","last_active":"2024-09-15T23:22:26.578422+0000","last_peered":"2024-09-15T23:22:26.578422+0000","last_clean":"2024-09-15T23:22:26.578422+0000","last_became_active":"2024-09-15T23:22:26.576357+0000","last_became_peered":"2024-09-15T23:22:26.576357+0000","last_unstale":"2024-09-15T23:22:26.578422+0000","last_undegraded":"2024-09-15T23:22:26.578422+0000","last_fullsized":"2024-09-15T23:22:26.578422+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:29.118197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.986050+0000","last_change":"2024-09-15T23:22:26.579531+0000","last_active":"2024-09-15T23:22:27.986050+0000","last_peered":"2024-09-15T23:22:27.986050+0000","last_clean":"2024-09-15T23:22:27.986050+0000","last_became_active":"2024-09-15T23:22:26.579239+0000","last_became_peered":"2024-09-15T23:22:26.579239+0000","last_unstale":"2024-09-15T23:22:27.986050+0000","last_undegraded":"2024-09-15T23:22:27.986050+0000","last_fullsized":"2024-09-15T23:22:27.986050+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:02:40.164216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.574310+0000","last_change":"2024-09-15T23:22:26.574310+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.574310+0000","last_undegraded":"2024-09-15T23:22:26.574310+0000","last_fullsized":"2024-09-15T23:22:26.574310+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.581851+0000","last_change":"2024-09-15T23:22:26.580389+0000","last_active":"2024-09-15T23:22:26.581851+0000","last_peered":"2024-09-15T23:22:26.581851+0000","last_clean":"2024-09-15T23:22:26.581851+0000","last_became_active":"2024-09-15T23:22:26.579875+0000","last_became_peered":"2024-09-15T23:22:26.579875+0000","last_unstale":"2024-09-15T23:22:26.581851+0000","last_undegraded":"2024-09-15T23:22:26.581851+0000","last_fullsized":"2024-09-15T23:22:26.581851+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:52.838239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:28.129375+0000","last_change":"2024-09-15T23:22:26.572953+0000","last_active":"2024-09-15T23:22:28.129375+0000","last_peered":"2024-09-15T23:22:28.129375+0000","last_clean":"2024-09-15T23:22:28.129375+0000","last_became_active":"2024-09-15T23:22:26.572610+0000","last_became_peered":"2024-09-15T23:22:26.572610+0000","last_unstale":"2024-09-15T23:22:28.129375+0000","last_undegraded":"2024-09-15T23:22:28.129375+0000","last_fullsized":"2024-09-15T23:22:28.129375+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:51.710387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.571753+0000","last_change":"2024-09-15T23:22:26.571753+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.571753+0000","last_undegraded":"2024-09-15T23:22:26.571753+0000","last_fullsized":"2024-09-15T23:22:26.571753+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.986186+0000","last_change":"2024-09-15T23:22:26.581016+0000","last_active":"2024-09-15T23:22:27.986186+0000","last_peered":"2024-09-15T23:22:27.986186+0000","last_clean":"2024-09-15T23:22:27.986186+0000","last_became_active":"2024-09-15T23:22:26.580740+0000","last_became_peered":"2024-09-15T23:22:26.580740+0000","last_unstale":"2024-09-15T23:22:27.986186+0000","last_undegraded":"2024-09-15T23:22:27.986186+0000","last_fullsized":"2024-09-15T23:22:27.986186+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:23:24.794531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.581325+0000","last_change":"2024-09-15T23:22:26.581325+0000","last_active":"2024-09-15T23:22:26.581325+0000","last_peered":"2024-09-15T23:22:26.581325+0000","last_clean":"2024-09-15T23:22:26.581325+0000","last_became_active":"2024-09-15T23:22:26.581025+0000","last_became_peered":"2024-09-15T23:22:26.581025+0000","last_unstale":"2024-09-15T23:22:26.581325+0000","last_undegraded":"2024-09-15T23:22:26.581325+0000","last_fullsized":"2024-09-15T23:22:26.581325+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:12.991092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563019+0000","last_change":"2024-09-15T23:22:26.574870+0000","last_active":"2024-09-15T23:22:27.563019+0000","last_peered":"2024-09-15T23:22:27.563019+0000","last_clean":"2024-09-15T23:22:27.563019+0000","last_became_active":"2024-09-15T23:22:26.574579+0000","last_became_peered":"2024-09-15T23:22:26.574579+0000","last_unstale":"2024-09-15T23:22:27.563019+0000","last_undegraded":"2024-09-15T23:22:27.563019+0000","last_fullsized":"2024-09-15T23:22:27.563019+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:42:03.421717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.562887+0000","last_change":"2024-09-15T23:22:26.573762+0000","last_active":"2024-09-15T23:22:27.562887+0000","last_peered":"2024-09-15T23:22:27.562887+0000","last_clean":"2024-09-15T23:22:27.562887+0000","last_became_active":"2024-09-15T23:22:26.571383+0000","last_became_peered":"2024-09-15T23:22:26.571383+0000","last_unstale":"2024-09-15T23:22:27.562887+0000","last_undegraded":"2024-09-15T23:22:27.562887+0000","last_fullsized":"2024-09-15T23:22:27.562887+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:42.282972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563296+0000","last_change":"2024-09-15T23:22:26.571287+0000","last_active":"2024-09-15T23:22:27.563296+0000","last_peered":"2024-09-15T23:22:27.563296+0000","last_clean":"2024-09-15T23:22:27.563296+0000","last_became_active":"2024-09-15T23:22:26.570992+0000","last_became_peered":"2024-09-15T23:22:26.570992+0000","last_unstale":"2024-09-15T23:22:27.563296+0000","last_undegraded":"2024-09-15T23:22:27.563296+0000","last_fullsized":"2024-09-15T23:22:27.563296+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:19:58.188543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.985969+0000","last_change":"2024-09-15T23:22:26.576051+0000","last_active":"2024-09-15T23:22:27.985969+0000","last_peered":"2024-09-15T23:22:27.985969+0000","last_clean":"2024-09-15T23:22:27.985969+0000","last_became_active":"2024-09-15T23:22:26.575761+0000","last_became_peered":"2024-09-15T23:22:26.575761+0000","last_unstale":"2024-09-15T23:22:27.985969+0000","last_undegraded":"2024-09-15T23:22:27.985969+0000","last_fullsized":"2024-09-15T23:22:27.985969+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:42.993876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563151+0000","last_change":"2024-09-15T23:22:26.574261+0000","last_active":"2024-09-15T23:22:27.563151+0000","last_peered":"2024-09-15T23:22:27.563151+0000","last_clean":"2024-09-15T23:22:27.563151+0000","last_became_active":"2024-09-15T23:22:26.573988+0000","last_became_peered":"2024-09-15T23:22:26.573988+0000","last_unstale":"2024-09-15T23:22:27.563151+0000","last_undegraded":"2024-09-15T23:22:27.563151+0000","last_fullsized":"2024-09-15T23:22:27.563151+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:03:56.300826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.574059+0000","last_change":"2024-09-15T23:22:26.567832+0000","last_active":"2024-09-15T23:22:26.574059+0000","last_peered":"2024-09-15T23:22:26.574059+0000","last_clean":"2024-09-15T23:22:26.574059+0000","last_became_active":"2024-09-15T23:22:26.567505+0000","last_became_peered":"2024-09-15T23:22:26.567505+0000","last_unstale":"2024-09-15T23:22:26.574059+0000","last_undegraded":"2024-09-15T23:22:26.574059+0000","last_fullsized":"2024-09-15T23:22:26.574059+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:51.435086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.576620+0000","last_change":"2024-09-15T23:22:26.575007+0000","last_active":"2024-09-15T23:22:26.576620+0000","last_peered":"2024-09-15T23:22:26.576620+0000","last_clean":"2024-09-15T23:22:26.576620+0000","last_became_active":"2024-09-15T23:22:26.573900+0000","last_became_peered":"2024-09-15T23:22:26.573900+0000","last_unstale":"2024-09-15T23:22:26.576620+0000","last_undegraded":"2024-09-15T23:22:26.576620+0000","last_fullsized":"2024-09-15T23:22:26.576620+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:49.276352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:28.129650+0000","last_change":"2024-09-15T23:22:26.580243+0000","last_active":"2024-09-15T23:22:28.129650+0000","last_peered":"2024-09-15T23:22:28.129650+0000","last_clean":"2024-09-15T23:22:28.129650+0000","last_became_active":"2024-09-15T23:22:26.579566+0000","last_became_peered":"2024-09-15T23:22:26.579566+0000","last_unstale":"2024-09-15T23:22:28.129650+0000","last_undegraded":"2024-09-15T23:22:28.129650+0000","last_fullsized":"2024-09-15T23:22:28.129650+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:12.991092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.578439+0000","last_change":"2024-09-15T23:22:26.577138+0000","last_active":"2024-09-15T23:22:26.578439+0000","last_peered":"2024-09-15T23:22:26.578439+0000","last_clean":"2024-09-15T23:22:26.578439+0000","last_became_active":"2024-09-15T23:22:26.574892+0000","last_became_peered":"2024-09-15T23:22:26.574892+0000","last_unstale":"2024-09-15T23:22:26.578439+0000","last_undegraded":"2024-09-15T23:22:26.578439+0000","last_fullsized":"2024-09-15T23:22:26.578439+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:00:10.891295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.583560+0000","last_change":"2024-09-15T23:22:26.581119+0000","last_active":"2024-09-15T23:22:26.583560+0000","last_peered":"2024-09-15T23:22:26.583560+0000","last_clean":"2024-09-15T23:22:26.583560+0000","last_became_active":"2024-09-15T23:22:26.580871+0000","last_became_peered":"2024-09-15T23:22:26.580871+0000","last_unstale":"2024-09-15T23:22:26.583560+0000","last_undegraded":"2024-09-15T23:22:26.583560+0000","last_fullsized":"2024-09-15T23:22:26.583560+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:23.329097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.577766+0000","last_change":"2024-09-15T23:22:26.575475+0000","last_active":"2024-09-15T23:22:26.577766+0000","last_peered":"2024-09-15T23:22:26.577766+0000","last_clean":"2024-09-15T23:22:26.577766+0000","last_became_active":"2024-09-15T23:22:26.575072+0000","last_became_peered":"2024-09-15T23:22:26.575072+0000","last_unstale":"2024-09-15T23:22:26.577766+0000","last_undegraded":"2024-09-15T23:22:26.577766+0000","last_fullsized":"2024-09-15T23:22:26.577766+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:54.325106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.575546+0000","last_change":"2024-09-15T23:22:26.575546+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.575546+0000","last_undegraded":"2024-09-15T23:22:26.575546+0000","last_fullsized":"2024-09-15T23:22:26.575546+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.566403+0000","last_change":"2024-09-15T23:22:26.566403+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.566403+0000","last_undegraded":"2024-09-15T23:22:26.566403+0000","last_fullsized":"2024-09-15T23:22:26.566403+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":["6","7"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.583113+0000","last_change":"2024-09-15T23:22:26.583113+0000","last_active":"2024-09-15T23:22:26.583113+0000","last_peered":"2024-09-15T23:22:26.583113+0000","last_clean":"2024-09-15T23:22:26.583113+0000","last_became_active":"2024-09-15T23:22:26.582600+0000","last_became_peered":"2024-09-15T23:22:26.582600+0000","last_unstale":"2024-09-15T23:22:26.583113+0000","last_undegraded":"2024-09-15T23:22:26.583113+0000","last_fullsized":"2024-09-15T23:22:26.583113+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:57:04.492522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.986222+0000","last_change":"2024-09-15T23:22:26.574747+0000","last_active":"2024-09-15T23:22:27.986222+0000","last_peered":"2024-09-15T23:22:27.986222+0000","last_clean":"2024-09-15T23:22:27.986222+0000","last_became_active":"2024-09-15T23:22:26.574496+0000","last_became_peered":"2024-09-15T23:22:26.574496+0000","last_unstale":"2024-09-15T23:22:27.986222+0000","last_undegraded":"2024-09-15T23:22:27.986222+0000","last_fullsized":"2024-09-15T23:22:27.986222+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:48.899103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.562879+0000","last_change":"2024-09-15T23:22:26.575300+0000","last_active":"2024-09-15T23:22:27.562879+0000","last_peered":"2024-09-15T23:22:27.562879+0000","last_clean":"2024-09-15T23:22:27.562879+0000","last_became_active":"2024-09-15T23:22:26.575032+0000","last_became_peered":"2024-09-15T23:22:26.575032+0000","last_unstale":"2024-09-15T23:22:27.562879+0000","last_undegraded":"2024-09-15T23:22:27.562879+0000","last_fullsized":"2024-09-15T23:22:27.562879+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:44.667091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.578403+0000","last_change":"2024-09-15T23:22:26.576639+0000","last_active":"2024-09-15T23:22:26.578403+0000","last_peered":"2024-09-15T23:22:26.578403+0000","last_clean":"2024-09-15T23:22:26.578403+0000","last_became_active":"2024-09-15T23:22:26.575205+0000","last_became_peered":"2024-09-15T23:22:26.575205+0000","last_unstale":"2024-09-15T23:22:26.578403+0000","last_undegraded":"2024-09-15T23:22:26.578403+0000","last_fullsized":"2024-09-15T23:22:26.578403+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:56:38.977444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.577328+0000","last_change":"2024-09-15T23:22:26.576356+0000","last_active":"2024-09-15T23:22:26.577328+0000","last_peered":"2024-09-15T23:22:26.577328+0000","last_clean":"2024-09-15T23:22:26.577328+0000","last_became_active":"2024-09-15T23:22:26.576081+0000","last_became_peered":"2024-09-15T23:22:26.576081+0000","last_unstale":"2024-09-15T23:22:26.577328+0000","last_undegraded":"2024-09-15T23:22:26.577328+0000","last_fullsized":"2024-09-15T23:22:26.577328+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:51.939872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.562894+0000","last_change":"2024-09-15T23:22:26.571980+0000","last_active":"2024-09-15T23:22:27.562894+0000","last_peered":"2024-09-15T23:22:27.562894+0000","last_clean":"2024-09-15T23:22:27.562894+0000","last_became_active":"2024-09-15T23:22:26.571547+0000","last_became_peered":"2024-09-15T23:22:26.571547+0000","last_unstale":"2024-09-15T23:22:27.562894+0000","last_undegraded":"2024-09-15T23:22:27.562894+0000","last_fullsized":"2024-09-15T23:22:27.562894+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:40:24.288085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563009+0000","last_change":"2024-09-15T23:22:26.573500+0000","last_active":"2024-09-15T23:22:27.563009+0000","last_peered":"2024-09-15T23:22:27.563009+0000","last_clean":"2024-09-15T23:22:27.563009+0000","last_became_active":"2024-09-15T23:22:26.573213+0000","last_became_peered":"2024-09-15T23:22:26.573213+0000","last_unstale":"2024-09-15T23:22:27.563009+0000","last_undegraded":"2024-09-15T23:22:27.563009+0000","last_fullsized":"2024-09-15T23:22:27.563009+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:45.562391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.572280+0000","last_change":"2024-09-15T23:22:26.572280+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.572280+0000","last_undegraded":"2024-09-15T23:22:26.572280+0000","last_fullsized":"2024-09-15T23:22:26.572280+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":["7","0"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.572389+0000","last_change":"2024-09-15T23:22:26.572389+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.572389+0000","last_undegraded":"2024-09-15T23:22:26.572389+0000","last_fullsized":"2024-09-15T23:22:26.572389+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.582653+0000","last_change":"2024-09-15T23:22:26.582653+0000","last_active":"2024-09-15T23:22:26.582653+0000","last_peered":"2024-09-15T23:22:26.582653+0000","last_clean":"2024-09-15T23:22:26.582653+0000","last_became_active":"2024-09-15T23:22:26.581898+0000","last_became_peered":"2024-09-15T23:22:26.581898+0000","last_unstale":"2024-09-15T23:22:26.582653+0000","last_undegraded":"2024-09-15T23:22:26.582653+0000","last_fullsized":"2024-09-15T23:22:26.582653+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:05:43.582002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.563441+0000","last_change":"2024-09-15T23:22:25.571785+0000","last_active":"2024-09-15T23:22:26.563441+0000","last_peered":"2024-09-15T23:22:26.563441+0000","last_clean":"2024-09-15T23:22:26.563441+0000","last_became_active":"2024-09-15T23:22:25.571482+0000","last_became_peered":"2024-09-15T23:22:25.571482+0000","last_unstale":"2024-09-15T23:22:26.563441+0000","last_undegraded":"2024-09-15T23:22:26.563441+0000","last_fullsized":"2024-09-15T23:22:26.563441+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:55:16.627253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.581429+0000","last_change":"2024-09-15T23:22:26.581429+0000","last_active":"2024-09-15T23:22:26.581429+0000","last_peered":"2024-09-15T23:22:26.581429+0000","last_clean":"2024-09-15T23:22:26.581429+0000","last_became_active":"2024-09-15T23:22:26.580652+0000","last_became_peered":"2024-09-15T23:22:26.580652+0000","last_unstale":"2024-09-15T23:22:26.581429+0000","last_undegraded":"2024-09-15T23:22:26.581429+0000","last_fullsized":"2024-09-15T23:22:26.581429+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:31:17.071450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1e","version":"181'1","reported_seq":15,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563060+0000","last_change":"2024-09-15T23:22:25.570459+0000","last_active":"2024-09-15T23:22:27.563060+0000","last_peered":"2024-09-15T23:22:27.563060+0000","last_clean":"2024-09-15T23:22:27.563060+0000","last_became_active":"2024-09-15T23:22:25.570185+0000","last_became_peered":"2024-09-15T23:22:25.570185+0000","last_unstale":"2024-09-15T23:22:27.563060+0000","last_undegraded":"2024-09-15T23:22:27.563060+0000","last_fullsized":"2024-09-15T23:22:27.563060+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:53:00.426242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.986062+0000","last_change":"2024-09-15T23:22:26.576480+0000","last_active":"2024-09-15T23:22:27.986062+0000","last_peered":"2024-09-15T23:22:27.986062+0000","last_clean":"2024-09-15T23:22:27.986062+0000","last_became_active":"2024-09-15T23:22:26.575599+0000","last_became_peered":"2024-09-15T23:22:26.575599+0000","last_unstale":"2024-09-15T23:22:27.986062+0000","last_undegraded":"2024-09-15T23:22:27.986062+0000","last_fullsized":"2024-09-15T23:22:27.986062+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:23.827041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.574749+0000","last_change":"2024-09-15T23:22:25.581273+0000","last_active":"2024-09-15T23:22:26.574749+0000","last_peered":"2024-09-15T23:22:26.574749+0000","last_clean":"2024-09-15T23:22:26.574749+0000","last_became_active":"2024-09-15T23:22:25.580975+0000","last_became_peered":"2024-09-15T23:22:25.580975+0000","last_unstale":"2024-09-15T23:22:26.574749+0000","last_undegraded":"2024-09-15T23:22:26.574749+0000","last_fullsized":"2024-09-15T23:22:26.574749+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:00:50.705677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.986205+0000","last_change":"2024-09-15T23:22:26.579120+0000","last_active":"2024-09-15T23:22:27.986205+0000","last_peered":"2024-09-15T23:22:27.986205+0000","last_clean":"2024-09-15T23:22:27.986205+0000","last_became_active":"2024-09-15T23:22:26.576159+0000","last_became_peered":"2024-09-15T23:22:26.576159+0000","last_unstale":"2024-09-15T23:22:27.986205+0000","last_undegraded":"2024-09-15T23:22:27.986205+0000","last_fullsized":"2024-09-15T23:22:27.986205+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:00:54.894412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1c","version":"181'2","reported_seq":16,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563523+0000","last_change":"2024-09-15T23:22:25.569211+0000","last_active":"2024-09-15T23:22:27.563523+0000","last_peered":"2024-09-15T23:22:27.563523+0000","last_clean":"2024-09-15T23:22:27.563523+0000","last_became_active":"2024-09-15T23:22:25.568965+0000","last_became_peered":"2024-09-15T23:22:25.568965+0000","last_unstale":"2024-09-15T23:22:27.563523+0000","last_undegraded":"2024-09-15T23:22:27.563523+0000","last_fullsized":"2024-09-15T23:22:27.563523+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:27.282812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.581830+0000","last_change":"2024-09-15T23:22:26.580161+0000","last_active":"2024-09-15T23:22:26.581830+0000","last_peered":"2024-09-15T23:22:26.581830+0000","last_clean":"2024-09-15T23:22:26.581830+0000","last_became_active":"2024-09-15T23:22:26.579508+0000","last_became_peered":"2024-09-15T23:22:26.579508+0000","last_unstale":"2024-09-15T23:22:26.581830+0000","last_undegraded":"2024-09-15T23:22:26.581830+0000","last_fullsized":"2024-09-15T23:22:26.581830+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:49.916954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.574869+0000","last_change":"2024-09-15T23:22:25.581967+0000","last_active":"2024-09-15T23:22:26.574869+0000","last_peered":"2024-09-15T23:22:26.574869+0000","last_clean":"2024-09-15T23:22:26.574869+0000","last_became_active":"2024-09-15T23:22:25.581530+0000","last_became_peered":"2024-09-15T23:22:25.581530+0000","last_unstale":"2024-09-15T23:22:26.574869+0000","last_undegraded":"2024-09-15T23:22:26.574869+0000","last_fullsized":"2024-09-15T23:22:26.574869+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:27.111829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.574455+0000","last_change":"2024-09-15T23:22:26.574455+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.574455+0000","last_undegraded":"2024-09-15T23:22:26.574455+0000","last_fullsized":"2024-09-15T23:22:26.574455+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.575821+0000","last_change":"2024-09-15T23:22:25.578495+0000","last_active":"2024-09-15T23:22:26.575821+0000","last_peered":"2024-09-15T23:22:26.575821+0000","last_clean":"2024-09-15T23:22:26.575821+0000","last_became_active":"2024-09-15T23:22:25.578014+0000","last_became_peered":"2024-09-15T23:22:25.578014+0000","last_unstale":"2024-09-15T23:22:26.575821+0000","last_undegraded":"2024-09-15T23:22:26.575821+0000","last_fullsized":"2024-09-15T23:22:26.575821+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:39:21.619939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563153+0000","last_change":"2024-09-15T23:22:26.582956+0000","last_active":"2024-09-15T23:22:27.563153+0000","last_peered":"2024-09-15T23:22:27.563153+0000","last_clean":"2024-09-15T23:22:27.563153+0000","last_became_active":"2024-09-15T23:22:26.582658+0000","last_became_peered":"2024-09-15T23:22:26.582658+0000","last_unstale":"2024-09-15T23:22:27.563153+0000","last_undegraded":"2024-09-15T23:22:27.563153+0000","last_fullsized":"2024-09-15T23:22:27.563153+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:48:01.666250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:28.129357+0000","last_change":"2024-09-15T23:22:25.573476+0000","last_active":"2024-09-15T23:22:28.129357+0000","last_peered":"2024-09-15T23:22:28.129357+0000","last_clean":"2024-09-15T23:22:28.129357+0000","last_became_active":"2024-09-15T23:22:25.573203+0000","last_became_peered":"2024-09-15T23:22:25.573203+0000","last_unstale":"2024-09-15T23:22:28.129357+0000","last_undegraded":"2024-09-15T23:22:28.129357+0000","last_fullsized":"2024-09-15T23:22:28.129357+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:43.661629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.577007+0000","last_change":"2024-09-15T23:22:26.573073+0000","last_active":"2024-09-15T23:22:26.577007+0000","last_peered":"2024-09-15T23:22:26.577007+0000","last_clean":"2024-09-15T23:22:26.577007+0000","last_became_active":"2024-09-15T23:22:26.572211+0000","last_became_peered":"2024-09-15T23:22:26.572211+0000","last_unstale":"2024-09-15T23:22:26.577007+0000","last_undegraded":"2024-09-15T23:22:26.577007+0000","last_fullsized":"2024-09-15T23:22:26.577007+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:46.592940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563476+0000","last_change":"2024-09-15T23:22:25.573132+0000","last_active":"2024-09-15T23:22:27.563476+0000","last_peered":"2024-09-15T23:22:27.563476+0000","last_clean":"2024-09-15T23:22:27.563476+0000","last_became_active":"2024-09-15T23:22:25.572496+0000","last_became_peered":"2024-09-15T23:22:25.572496+0000","last_unstale":"2024-09-15T23:22:27.563476+0000","last_undegraded":"2024-09-15T23:22:27.563476+0000","last_fullsized":"2024-09-15T23:22:27.563476+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:57.876840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.581186+0000","last_change":"2024-09-15T23:22:26.581186+0000","last_active":"2024-09-15T23:22:26.581186+0000","last_peered":"2024-09-15T23:22:26.581186+0000","last_clean":"2024-09-15T23:22:26.581186+0000","last_became_active":"2024-09-15T23:22:26.580278+0000","last_became_peered":"2024-09-15T23:22:26.580278+0000","last_unstale":"2024-09-15T23:22:26.581186+0000","last_undegraded":"2024-09-15T23:22:26.581186+0000","last_fullsized":"2024-09-15T23:22:26.581186+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:17.131723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.568273+0000","last_change":"2024-09-15T23:22:25.573560+0000","last_active":"2024-09-15T23:22:26.568273+0000","last_peered":"2024-09-15T23:22:26.568273+0000","last_clean":"2024-09-15T23:22:26.568273+0000","last_became_active":"2024-09-15T23:22:25.573270+0000","last_became_peered":"2024-09-15T23:22:25.573270+0000","last_unstale":"2024-09-15T23:22:26.568273+0000","last_undegraded":"2024-09-15T23:22:26.568273+0000","last_fullsized":"2024-09-15T23:22:26.568273+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:44.556930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563429+0000","last_change":"2024-09-15T23:22:26.576066+0000","last_active":"2024-09-15T23:22:27.563429+0000","last_peered":"2024-09-15T23:22:27.563429+0000","last_clean":"2024-09-15T23:22:27.563429+0000","last_became_active":"2024-09-15T23:22:26.575722+0000","last_became_peered":"2024-09-15T23:22:26.575722+0000","last_unstale":"2024-09-15T23:22:27.563429+0000","last_undegraded":"2024-09-15T23:22:27.563429+0000","last_fullsized":"2024-09-15T23:22:27.563429+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:51.710387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.574886+0000","last_change":"2024-09-15T23:22:25.580281+0000","last_active":"2024-09-15T23:22:26.574886+0000","last_peered":"2024-09-15T23:22:26.574886+0000","last_clean":"2024-09-15T23:22:26.574886+0000","last_became_active":"2024-09-15T23:22:25.579966+0000","last_became_peered":"2024-09-15T23:22:25.579966+0000","last_unstale":"2024-09-15T23:22:26.574886+0000","last_undegraded":"2024-09-15T23:22:26.574886+0000","last_fullsized":"2024-09-15T23:22:26.574886+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:11.132878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.568134+0000","last_change":"2024-09-15T23:22:26.568134+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.568134+0000","last_undegraded":"2024-09-15T23:22:26.568134+0000","last_fullsized":"2024-09-15T23:22:26.568134+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":["6","5"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.574342+0000","last_change":"2024-09-15T23:22:25.582774+0000","last_active":"2024-09-15T23:22:26.574342+0000","last_peered":"2024-09-15T23:22:26.574342+0000","last_clean":"2024-09-15T23:22:26.574342+0000","last_became_active":"2024-09-15T23:22:25.582455+0000","last_became_peered":"2024-09-15T23:22:25.582455+0000","last_unstale":"2024-09-15T23:22:26.574342+0000","last_undegraded":"2024-09-15T23:22:26.574342+0000","last_fullsized":"2024-09-15T23:22:26.574342+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:58.026111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.579221+0000","last_change":"2024-09-15T23:22:26.579221+0000","last_active":"2024-09-15T23:22:26.579221+0000","last_peered":"2024-09-15T23:22:26.579221+0000","last_clean":"2024-09-15T23:22:26.579221+0000","last_became_active":"2024-09-15T23:22:26.578424+0000","last_became_peered":"2024-09-15T23:22:26.578424+0000","last_unstale":"2024-09-15T23:22:26.579221+0000","last_undegraded":"2024-09-15T23:22:26.579221+0000","last_fullsized":"2024-09-15T23:22:26.579221+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:51.710387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.13","version":"181'2","reported_seq":16,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.562990+0000","last_change":"2024-09-15T23:22:25.574790+0000","last_active":"2024-09-15T23:22:27.562990+0000","last_peered":"2024-09-15T23:22:27.562990+0000","last_clean":"2024-09-15T23:22:27.562990+0000","last_became_active":"2024-09-15T23:22:25.572871+0000","last_became_peered":"2024-09-15T23:22:25.572871+0000","last_unstale":"2024-09-15T23:22:27.562990+0000","last_undegraded":"2024-09-15T23:22:27.562990+0000","last_fullsized":"2024-09-15T23:22:27.562990+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:57:03.487060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:28.129624+0000","last_change":"2024-09-15T23:22:26.570568+0000","last_active":"2024-09-15T23:22:28.129624+0000","last_peered":"2024-09-15T23:22:28.129624+0000","last_clean":"2024-09-15T23:22:28.129624+0000","last_became_active":"2024-09-15T23:22:26.570294+0000","last_became_peered":"2024-09-15T23:22:26.570294+0000","last_unstale":"2024-09-15T23:22:28.129624+0000","last_undegraded":"2024-09-15T23:22:28.129624+0000","last_fullsized":"2024-09-15T23:22:28.129624+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:50.916622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.567290+0000","last_change":"2024-09-15T23:22:25.579017+0000","last_active":"2024-09-15T23:22:26.567290+0000","last_peered":"2024-09-15T23:22:26.567290+0000","last_clean":"2024-09-15T23:22:26.567290+0000","last_became_active":"2024-09-15T23:22:25.578734+0000","last_became_peered":"2024-09-15T23:22:25.578734+0000","last_unstale":"2024-09-15T23:22:26.567290+0000","last_undegraded":"2024-09-15T23:22:26.567290+0000","last_fullsized":"2024-09-15T23:22:26.567290+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:40:23.282623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.562723+0000","last_change":"2024-09-15T23:22:26.576304+0000","last_active":"2024-09-15T23:22:27.562723+0000","last_peered":"2024-09-15T23:22:27.562723+0000","last_clean":"2024-09-15T23:22:27.562723+0000","last_became_active":"2024-09-15T23:22:26.575471+0000","last_became_peered":"2024-09-15T23:22:26.575471+0000","last_unstale":"2024-09-15T23:22:27.562723+0000","last_undegraded":"2024-09-15T23:22:27.562723+0000","last_fullsized":"2024-09-15T23:22:27.562723+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:03.748163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.572851+0000","last_change":"2024-09-15T23:22:25.583097+0000","last_active":"2024-09-15T23:22:26.572851+0000","last_peered":"2024-09-15T23:22:26.572851+0000","last_clean":"2024-09-15T23:22:26.572851+0000","last_became_active":"2024-09-15T23:22:25.582619+0000","last_became_peered":"2024-09-15T23:22:25.582619+0000","last_unstale":"2024-09-15T23:22:26.572851+0000","last_undegraded":"2024-09-15T23:22:26.572851+0000","last_fullsized":"2024-09-15T23:22:26.572851+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:37:30.698864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.579456+0000","last_change":"2024-09-15T23:22:26.579456+0000","last_active":"2024-09-15T23:22:26.579456+0000","last_peered":"2024-09-15T23:22:26.579456+0000","last_clean":"2024-09-15T23:22:26.579456+0000","last_became_active":"2024-09-15T23:22:26.579149+0000","last_became_peered":"2024-09-15T23:22:26.579149+0000","last_unstale":"2024-09-15T23:22:26.579456+0000","last_undegraded":"2024-09-15T23:22:26.579456+0000","last_fullsized":"2024-09-15T23:22:26.579456+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:00:44.482957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.10","version":"181'8","reported_seq":22,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:28.129402+0000","last_change":"2024-09-15T23:22:25.571365+0000","last_active":"2024-09-15T23:22:28.129402+0000","last_peered":"2024-09-15T23:22:28.129402+0000","last_clean":"2024-09-15T23:22:28.129402+0000","last_became_active":"2024-09-15T23:22:25.571094+0000","last_became_peered":"2024-09-15T23:22:25.571094+0000","last_unstale":"2024-09-15T23:22:28.129402+0000","last_undegraded":"2024-09-15T23:22:28.129402+0000","last_fullsized":"2024-09-15T23:22:28.129402+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:41.277510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.579012+0000","last_change":"2024-09-15T23:22:26.579012+0000","last_active":"2024-09-15T23:22:26.579012+0000","last_peered":"2024-09-15T23:22:26.579012+0000","last_clean":"2024-09-15T23:22:26.579012+0000","last_became_active":"2024-09-15T23:22:26.578733+0000","last_became_peered":"2024-09-15T23:22:26.578733+0000","last_unstale":"2024-09-15T23:22:26.579012+0000","last_undegraded":"2024-09-15T23:22:26.579012+0000","last_fullsized":"2024-09-15T23:22:26.579012+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:43.656480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.574284+0000","last_change":"2024-09-15T23:22:25.581794+0000","last_active":"2024-09-15T23:22:26.574284+0000","last_peered":"2024-09-15T23:22:26.574284+0000","last_clean":"2024-09-15T23:22:26.574284+0000","last_became_active":"2024-09-15T23:22:25.581463+0000","last_became_peered":"2024-09-15T23:22:25.581463+0000","last_unstale":"2024-09-15T23:22:26.574284+0000","last_undegraded":"2024-09-15T23:22:26.574284+0000","last_fullsized":"2024-09-15T23:22:26.574284+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:40:23.527619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563286+0000","last_change":"2024-09-15T23:22:26.585935+0000","last_active":"2024-09-15T23:22:27.563286+0000","last_peered":"2024-09-15T23:22:27.563286+0000","last_clean":"2024-09-15T23:22:27.563286+0000","last_became_active":"2024-09-15T23:22:26.585643+0000","last_became_peered":"2024-09-15T23:22:26.585643+0000","last_unstale":"2024-09-15T23:22:27.563286+0000","last_undegraded":"2024-09-15T23:22:27.563286+0000","last_fullsized":"2024-09-15T23:22:27.563286+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:43.656480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.e","version":"181'2","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.569958+0000","last_change":"2024-09-15T23:22:25.576185+0000","last_active":"2024-09-15T23:22:26.569958+0000","last_peered":"2024-09-15T23:22:26.569958+0000","last_clean":"2024-09-15T23:22:26.569958+0000","last_became_active":"2024-09-15T23:22:25.575627+0000","last_became_peered":"2024-09-15T23:22:25.575627+0000","last_unstale":"2024-09-15T23:22:26.569958+0000","last_undegraded":"2024-09-15T23:22:26.569958+0000","last_fullsized":"2024-09-15T23:22:26.569958+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:01:31.306518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.986215+0000","last_change":"2024-09-15T23:22:26.581845+0000","last_active":"2024-09-15T23:22:27.986215+0000","last_peered":"2024-09-15T23:22:27.986215+0000","last_clean":"2024-09-15T23:22:27.986215+0000","last_became_active":"2024-09-15T23:22:26.581503+0000","last_became_peered":"2024-09-15T23:22:26.581503+0000","last_unstale":"2024-09-15T23:22:27.986215+0000","last_undegraded":"2024-09-15T23:22:27.986215+0000","last_fullsized":"2024-09-15T23:22:27.986215+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:37:41.999085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.d","version":"181'1","reported_seq":15,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563012+0000","last_change":"2024-09-15T23:22:25.571321+0000","last_active":"2024-09-15T23:22:27.563012+0000","last_peered":"2024-09-15T23:22:27.563012+0000","last_clean":"2024-09-15T23:22:27.563012+0000","last_became_active":"2024-09-15T23:22:25.570992+0000","last_became_peered":"2024-09-15T23:22:25.570992+0000","last_unstale":"2024-09-15T23:22:27.563012+0000","last_undegraded":"2024-09-15T23:22:27.563012+0000","last_fullsized":"2024-09-15T23:22:27.563012+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:04.372195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563162+0000","last_change":"2024-09-15T23:22:26.578668+0000","last_active":"2024-09-15T23:22:27.563162+0000","last_peered":"2024-09-15T23:22:27.563162+0000","last_clean":"2024-09-15T23:22:27.563162+0000","last_became_active":"2024-09-15T23:22:26.578321+0000","last_became_peered":"2024-09-15T23:22:26.578321+0000","last_unstale":"2024-09-15T23:22:27.563162+0000","last_undegraded":"2024-09-15T23:22:27.563162+0000","last_fullsized":"2024-09-15T23:22:27.563162+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:51.939872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563376+0000","last_change":"2024-09-15T23:22:25.575239+0000","last_active":"2024-09-15T23:22:27.563376+0000","last_peered":"2024-09-15T23:22:27.563376+0000","last_clean":"2024-09-15T23:22:27.563376+0000","last_became_active":"2024-09-15T23:22:25.574930+0000","last_became_peered":"2024-09-15T23:22:25.574930+0000","last_unstale":"2024-09-15T23:22:27.563376+0000","last_undegraded":"2024-09-15T23:22:27.563376+0000","last_fullsized":"2024-09-15T23:22:27.563376+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:40.632139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.575704+0000","last_change":"2024-09-15T23:22:26.572799+0000","last_active":"2024-09-15T23:22:26.575704+0000","last_peered":"2024-09-15T23:22:26.575704+0000","last_clean":"2024-09-15T23:22:26.575704+0000","last_became_active":"2024-09-15T23:22:26.572539+0000","last_became_peered":"2024-09-15T23:22:26.572539+0000","last_unstale":"2024-09-15T23:22:26.575704+0000","last_undegraded":"2024-09-15T23:22:26.575704+0000","last_fullsized":"2024-09-15T23:22:26.575704+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:40:36.495840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.575004+0000","last_change":"2024-09-15T23:22:25.580246+0000","last_active":"2024-09-15T23:22:26.575004+0000","last_peered":"2024-09-15T23:22:26.575004+0000","last_clean":"2024-09-15T23:22:26.575004+0000","last_became_active":"2024-09-15T23:22:25.579936+0000","last_became_peered":"2024-09-15T23:22:25.579936+0000","last_unstale":"2024-09-15T23:22:26.575004+0000","last_undegraded":"2024-09-15T23:22:26.575004+0000","last_fullsized":"2024-09-15T23:22:26.575004+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:51.335262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:28.129629+0000","last_change":"2024-09-15T23:22:26.572247+0000","last_active":"2024-09-15T23:22:28.129629+0000","last_peered":"2024-09-15T23:22:28.129629+0000","last_clean":"2024-09-15T23:22:28.129629+0000","last_became_active":"2024-09-15T23:22:26.571874+0000","last_became_peered":"2024-09-15T23:22:26.571874+0000","last_unstale":"2024-09-15T23:22:28.129629+0000","last_undegraded":"2024-09-15T23:22:28.129629+0000","last_fullsized":"2024-09-15T23:22:28.129629+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:17.131723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.569190+0000","last_change":"2024-09-15T23:22:25.577475+0000","last_active":"2024-09-15T23:22:26.569190+0000","last_peered":"2024-09-15T23:22:26.569190+0000","last_clean":"2024-09-15T23:22:26.569190+0000","last_became_active":"2024-09-15T23:22:25.577195+0000","last_became_peered":"2024-09-15T23:22:25.577195+0000","last_unstale":"2024-09-15T23:22:26.569190+0000","last_undegraded":"2024-09-15T23:22:26.569190+0000","last_fullsized":"2024-09-15T23:22:26.569190+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:09.611603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563196+0000","last_change":"2024-09-15T23:22:26.577654+0000","last_active":"2024-09-15T23:22:27.563196+0000","last_peered":"2024-09-15T23:22:27.563196+0000","last_clean":"2024-09-15T23:22:27.563196+0000","last_became_active":"2024-09-15T23:22:26.577344+0000","last_became_peered":"2024-09-15T23:22:26.577344+0000","last_unstale":"2024-09-15T23:22:27.563196+0000","last_undegraded":"2024-09-15T23:22:27.563196+0000","last_fullsized":"2024-09-15T23:22:27.563196+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:24.318992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.569225+0000","last_change":"2024-09-15T23:22:25.576650+0000","last_active":"2024-09-15T23:22:26.569225+0000","last_peered":"2024-09-15T23:22:26.569225+0000","last_clean":"2024-09-15T23:22:26.569225+0000","last_became_active":"2024-09-15T23:22:25.576362+0000","last_became_peered":"2024-09-15T23:22:25.576362+0000","last_unstale":"2024-09-15T23:22:26.569225+0000","last_undegraded":"2024-09-15T23:22:26.569225+0000","last_fullsized":"2024-09-15T23:22:26.569225+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:00:27.234261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.580637+0000","last_change":"2024-09-15T23:22:26.580637+0000","last_active":"2024-09-15T23:22:26.580637+0000","last_peered":"2024-09-15T23:22:26.580637+0000","last_clean":"2024-09-15T23:22:26.580637+0000","last_became_active":"2024-09-15T23:22:26.580301+0000","last_became_peered":"2024-09-15T23:22:26.580301+0000","last_unstale":"2024-09-15T23:22:26.580637+0000","last_undegraded":"2024-09-15T23:22:26.580637+0000","last_fullsized":"2024-09-15T23:22:26.580637+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:50.916622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563278+0000","last_change":"2024-09-15T23:22:25.571376+0000","last_active":"2024-09-15T23:22:27.563278+0000","last_peered":"2024-09-15T23:22:27.563278+0000","last_clean":"2024-09-15T23:22:27.563278+0000","last_became_active":"2024-09-15T23:22:25.571006+0000","last_became_peered":"2024-09-15T23:22:25.571006+0000","last_unstale":"2024-09-15T23:22:27.563278+0000","last_undegraded":"2024-09-15T23:22:27.563278+0000","last_fullsized":"2024-09-15T23:22:27.563278+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:05.631862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.582919+0000","last_change":"2024-09-15T23:22:26.581001+0000","last_active":"2024-09-15T23:22:26.582919+0000","last_peered":"2024-09-15T23:22:26.582919+0000","last_clean":"2024-09-15T23:22:26.582919+0000","last_became_active":"2024-09-15T23:22:26.580287+0000","last_became_peered":"2024-09-15T23:22:26.580287+0000","last_unstale":"2024-09-15T23:22:26.582919+0000","last_undegraded":"2024-09-15T23:22:26.582919+0000","last_fullsized":"2024-09-15T23:22:26.582919+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:32.384598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.7","version":"181'2","reported_seq":16,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563566+0000","last_change":"2024-09-15T23:22:25.573610+0000","last_active":"2024-09-15T23:22:27.563566+0000","last_peered":"2024-09-15T23:22:27.563566+0000","last_clean":"2024-09-15T23:22:27.563566+0000","last_became_active":"2024-09-15T23:22:25.573342+0000","last_became_peered":"2024-09-15T23:22:25.573342+0000","last_unstale":"2024-09-15T23:22:27.563566+0000","last_undegraded":"2024-09-15T23:22:27.563566+0000","last_fullsized":"2024-09-15T23:22:27.563566+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:08.553326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.582270+0000","last_change":"2024-09-15T23:22:26.578188+0000","last_active":"2024-09-15T23:22:26.582270+0000","last_peered":"2024-09-15T23:22:26.582270+0000","last_clean":"2024-09-15T23:22:26.582270+0000","last_became_active":"2024-09-15T23:22:26.577930+0000","last_became_peered":"2024-09-15T23:22:26.577930+0000","last_unstale":"2024-09-15T23:22:26.582270+0000","last_undegraded":"2024-09-15T23:22:26.582270+0000","last_fullsized":"2024-09-15T23:22:26.582270+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:51:54.832034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.563588+0000","last_change":"2024-09-15T23:22:25.575025+0000","last_active":"2024-09-15T23:22:26.563588+0000","last_peered":"2024-09-15T23:22:26.563588+0000","last_clean":"2024-09-15T23:22:26.563588+0000","last_became_active":"2024-09-15T23:22:25.574715+0000","last_became_peered":"2024-09-15T23:22:25.574715+0000","last_unstale":"2024-09-15T23:22:26.563588+0000","last_undegraded":"2024-09-15T23:22:26.563588+0000","last_fullsized":"2024-09-15T23:22:26.563588+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:26.917144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.562462+0000","last_change":"2024-09-15T23:22:26.562462+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.562462+0000","last_undegraded":"2024-09-15T23:22:26.562462+0000","last_fullsized":"2024-09-15T23:22:26.562462+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.564020+0000","last_change":"2024-09-15T23:22:25.576386+0000","last_active":"2024-09-15T23:22:26.564020+0000","last_peered":"2024-09-15T23:22:26.564020+0000","last_clean":"2024-09-15T23:22:26.564020+0000","last_became_active":"2024-09-15T23:22:25.574655+0000","last_became_peered":"2024-09-15T23:22:25.574655+0000","last_unstale":"2024-09-15T23:22:26.564020+0000","last_undegraded":"2024-09-15T23:22:26.564020+0000","last_fullsized":"2024-09-15T23:22:26.564020+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:00:02.848434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.574474+0000","last_change":"2024-09-15T23:22:26.574474+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.574474+0000","last_undegraded":"2024-09-15T23:22:26.574474+0000","last_fullsized":"2024-09-15T23:22:26.574474+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.574601+0000","last_change":"2024-09-15T23:22:25.582743+0000","last_active":"2024-09-15T23:22:26.574601+0000","last_peered":"2024-09-15T23:22:26.574601+0000","last_clean":"2024-09-15T23:22:26.574601+0000","last_became_active":"2024-09-15T23:22:25.582439+0000","last_became_peered":"2024-09-15T23:22:25.582439+0000","last_unstale":"2024-09-15T23:22:26.574601+0000","last_undegraded":"2024-09-15T23:22:26.574601+0000","last_fullsized":"2024-09-15T23:22:26.574601+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:45.831574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.985888+0000","last_change":"2024-09-15T23:22:26.586161+0000","last_active":"2024-09-15T23:22:27.985888+0000","last_peered":"2024-09-15T23:22:27.985888+0000","last_clean":"2024-09-15T23:22:27.985888+0000","last_became_active":"2024-09-15T23:22:26.585670+0000","last_became_peered":"2024-09-15T23:22:26.585670+0000","last_unstale":"2024-09-15T23:22:27.985888+0000","last_undegraded":"2024-09-15T23:22:27.985888+0000","last_fullsized":"2024-09-15T23:22:27.985888+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:02.362109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.985935+0000","last_change":"2024-09-15T23:22:25.574571+0000","last_active":"2024-09-15T23:22:27.985935+0000","last_peered":"2024-09-15T23:22:27.985935+0000","last_clean":"2024-09-15T23:22:27.985935+0000","last_became_active":"2024-09-15T23:22:25.574287+0000","last_became_peered":"2024-09-15T23:22:25.574287+0000","last_unstale":"2024-09-15T23:22:27.985935+0000","last_undegraded":"2024-09-15T23:22:27.985935+0000","last_fullsized":"2024-09-15T23:22:27.985935+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:39.683578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563363+0000","last_change":"2024-09-15T23:22:26.572903+0000","last_active":"2024-09-15T23:22:27.563363+0000","last_peered":"2024-09-15T23:22:27.563363+0000","last_clean":"2024-09-15T23:22:27.563363+0000","last_became_active":"2024-09-15T23:22:26.572625+0000","last_became_peered":"2024-09-15T23:22:26.572625+0000","last_unstale":"2024-09-15T23:22:27.563363+0000","last_undegraded":"2024-09-15T23:22:27.563363+0000","last_fullsized":"2024-09-15T23:22:27.563363+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:42:23.881842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.985998+0000","last_change":"2024-09-15T23:22:25.572720+0000","last_active":"2024-09-15T23:22:27.985998+0000","last_peered":"2024-09-15T23:22:27.985998+0000","last_clean":"2024-09-15T23:22:27.985998+0000","last_became_active":"2024-09-15T23:22:25.572239+0000","last_became_peered":"2024-09-15T23:22:25.572239+0000","last_unstale":"2024-09-15T23:22:27.985998+0000","last_undegraded":"2024-09-15T23:22:27.985998+0000","last_fullsized":"2024-09-15T23:22:27.985998+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:08:53.636567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.985897+0000","last_change":"2024-09-15T23:22:26.576393+0000","last_active":"2024-09-15T23:22:27.985897+0000","last_peered":"2024-09-15T23:22:27.985897+0000","last_clean":"2024-09-15T23:22:27.985897+0000","last_became_active":"2024-09-15T23:22:26.575901+0000","last_became_peered":"2024-09-15T23:22:26.575901+0000","last_unstale":"2024-09-15T23:22:27.985897+0000","last_undegraded":"2024-09-15T23:22:27.985897+0000","last_fullsized":"2024-09-15T23:22:27.985897+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:46:00.263978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.985843+0000","last_change":"2024-09-15T23:22:25.572258+0000","last_active":"2024-09-15T23:22:27.985843+0000","last_peered":"2024-09-15T23:22:27.985843+0000","last_clean":"2024-09-15T23:22:27.985843+0000","last_became_active":"2024-09-15T23:22:25.572005+0000","last_became_peered":"2024-09-15T23:22:25.572005+0000","last_unstale":"2024-09-15T23:22:27.985843+0000","last_undegraded":"2024-09-15T23:22:27.985843+0000","last_fullsized":"2024-09-15T23:22:27.985843+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:51.728926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.580413+0000","last_change":"2024-09-15T23:22:26.580413+0000","last_active":"2024-09-15T23:22:26.580413+0000","last_peered":"2024-09-15T23:22:26.580413+0000","last_clean":"2024-09-15T23:22:26.580413+0000","last_became_active":"2024-09-15T23:22:26.580139+0000","last_became_peered":"2024-09-15T23:22:26.580139+0000","last_unstale":"2024-09-15T23:22:26.580413+0000","last_undegraded":"2024-09-15T23:22:26.580413+0000","last_fullsized":"2024-09-15T23:22:26.580413+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:22:31.713809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.567955+0000","last_change":"2024-09-15T23:22:25.574211+0000","last_active":"2024-09-15T23:22:26.567955+0000","last_peered":"2024-09-15T23:22:26.567955+0000","last_clean":"2024-09-15T23:22:26.567955+0000","last_became_active":"2024-09-15T23:22:25.573828+0000","last_became_peered":"2024-09-15T23:22:25.573828+0000","last_unstale":"2024-09-15T23:22:26.567955+0000","last_undegraded":"2024-09-15T23:22:26.567955+0000","last_fullsized":"2024-09-15T23:22:26.567955+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:53.008952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.579577+0000","last_change":"2024-09-15T23:22:26.578711+0000","last_active":"2024-09-15T23:22:26.579577+0000","last_peered":"2024-09-15T23:22:26.579577+0000","last_clean":"2024-09-15T23:22:26.579577+0000","last_became_active":"2024-09-15T23:22:26.578300+0000","last_became_peered":"2024-09-15T23:22:26.578300+0000","last_unstale":"2024-09-15T23:22:26.579577+0000","last_undegraded":"2024-09-15T23:22:26.579577+0000","last_fullsized":"2024-09-15T23:22:26.579577+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:20:01.080774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.562721+0000","last_change":"2024-09-15T23:22:25.572154+0000","last_active":"2024-09-15T23:22:27.562721+0000","last_peered":"2024-09-15T23:22:27.562721+0000","last_clean":"2024-09-15T23:22:27.562721+0000","last_became_active":"2024-09-15T23:22:25.571908+0000","last_became_peered":"2024-09-15T23:22:25.571908+0000","last_unstale":"2024-09-15T23:22:27.562721+0000","last_undegraded":"2024-09-15T23:22:27.562721+0000","last_fullsized":"2024-09-15T23:22:27.562721+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:05:42.576540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":469,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.985762+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:22:27.985762+0000","last_peered":"2024-09-15T23:22:27.985762+0000","last_clean":"2024-09-15T23:22:27.985762+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:22:27.985762+0000","last_undegraded":"2024-09-15T23:22:27.985762+0000","last_fullsized":"2024-09-15T23:22:27.985762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":104,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476867,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59796,"kb_used_data":2236,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312044,"statfs":{"total":96636764160,"available":96575533056,"internally_reserved":0,"allocated":2289664,"data_stored":1010088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55608,"kb_used_data":2212,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316232,"statfs":{"total":96636764160,"available":96579821568,"internally_reserved":0,"allocated":2265088,"data_stored":1002176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476866,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56200,"kb_used_data":2800,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315640,"statfs":{"total":96636764160,"available":96579215360,"internally_reserved":0,"allocated":2867200,"data_stored":1598774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476866,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47308,"kb_used_data":2228,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324532,"statfs":{"total":96636764160,"available":96588320768,"internally_reserved":0,"allocated":2281472,"data_stored":1009022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542272,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51428,"kb_used_data":2196,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320412,"statfs":{"total":96636764160,"available":96584101888,"internally_reserved":0,"allocated":2248704,"data_stored":995331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542272,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55600,"kb_used_data":2196,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316240,"statfs":{"total":96636764160,"available":96579829760,"internally_reserved":0,"allocated":2248704,"data_stored":995331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542271,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60332,"kb_used_data":2776,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311508,"statfs":{"total":96636764160,"available":96574984192,"internally_reserved":0,"allocated":2842624,"data_stored":1585699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542273,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55592,"kb_used_data":2196,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316248,"statfs":{"total":96636764160,"available":96579837952,"internally_reserved":0,"allocated":2248704,"data_stored":995331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:22:29.853 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:22:29.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.987+0000 7f0632a77640 1 Processor -- start 2024-09-15T23:22:29.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.987+0000 7f0632a77640 1 -- start start 2024-09-15T23:22:29.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.988+0000 7f0632a77640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f062c06c320 0x7f062c15bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:29.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.988+0000 7f0632a77640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f062c071180 con 0x7f062c13eb20 2024-09-15T23:22:29.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.988+0000 7f0632a77640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f062c071460 con 0x7f062c0b2d40 2024-09-15T23:22:29.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.988+0000 7f0632a77640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f062c071ab0 con 0x7f062c06c320 2024-09-15T23:22:29.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.988+0000 7f0623fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f062c06c320 0x7f062c15bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:29.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.988+0000 7f0631014640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f062c13eb20 0x7f062c15c230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36786/0 (socket says 172.21.15.123:36786) 2024-09-15T23:22:29.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.988+0000 7f0631014640 1 -- 172.21.15.123:0/2228713131 learned_addr learned my addr 172.21.15.123:0/2228713131 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:29.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.988+0000 7f0623fff640 1 -- 172.21.15.123:0/2228713131 >> v1:172.21.15.188:6789/0 conn(0x7f062c0b2d40 legacy=0x7f062c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:29.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.988+0000 7f0623fff640 1 -- 172.21.15.123:0/2228713131 >> v1:172.21.15.123:6789/0 conn(0x7f062c13eb20 legacy=0x7f062c15c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:29.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.988+0000 7f06237fe640 1 -- 172.21.15.123:0/2228713131 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1265525354 0 0) 0x7f062c071180 con 0x7f062c13eb20 2024-09-15T23:22:29.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.989+0000 7f0623fff640 1 -- 172.21.15.123:0/2228713131 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f062c071740 con 0x7f062c06c320 2024-09-15T23:22:29.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.989+0000 7f0623fff640 1 --2- 172.21.15.123:0/2228713131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f062c06c320 0x7f062c15bcf0 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7f061c0097a0 tx=0x7f061c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2ff7454f66ceb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:29.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.989+0000 7f06237fe640 1 -- 172.21.15.123:0/2228713131 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f061c037070 con 0x7f062c06c320 2024-09-15T23:22:29.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.989+0000 7f06237fe640 1 -- 172.21.15.123:0/2228713131 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f061c032440 con 0x7f062c06c320 2024-09-15T23:22:29.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.989+0000 7f06237fe640 1 -- 172.21.15.123:0/2228713131 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f061c032810 con 0x7f062c06c320 2024-09-15T23:22:29.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.990+0000 7f0632a77640 1 -- 172.21.15.123:0/2228713131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f062c06c320 msgr2=0x7f062c15bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:29.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.990+0000 7f0632a77640 1 --2- 172.21.15.123:0/2228713131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f062c06c320 0x7f062c15bcf0 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7f061c0097a0 tx=0x7f061c02a1e0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.990+0000 7f0632a77640 1 -- 172.21.15.123:0/2228713131 shutdown_connections 2024-09-15T23:22:29.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.990+0000 7f0632a77640 1 --2- 172.21.15.123:0/2228713131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f062c06c320 0x7f062c15bcf0 unknown :-1 s=CLOSED pgs=2092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.990+0000 7f0632a77640 1 -- 172.21.15.123:0/2228713131 >> 172.21.15.123:0/2228713131 conn(0x7f062c0ccec0 msgr2=0x7f062c0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:29.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.990+0000 7f0632a77640 1 -- 172.21.15.123:0/2228713131 shutdown_connections 2024-09-15T23:22:29.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.990+0000 7f0632a77640 1 -- 172.21.15.123:0/2228713131 wait complete. 2024-09-15T23:22:29.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.991+0000 7f0632a77640 1 Processor -- start 2024-09-15T23:22:29.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.991+0000 7f0632a77640 1 -- start start 2024-09-15T23:22:29.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.992+0000 7f0632a77640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f062c06c320 0x7f062c15cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:29.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.992+0000 7f0632a77640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f062c0b2d40 0x7f062c15bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:29.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.992+0000 7f0632a77640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f062c13eb20 0x7f062c158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:29.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.992+0000 7f0632a77640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f062c1666e0 con 0x7f062c06c320 2024-09-15T23:22:29.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.992+0000 7f0632a77640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f062c166560 con 0x7f062c13eb20 2024-09-15T23:22:29.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.992+0000 7f0632a77640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f062c166860 con 0x7f062c0b2d40 2024-09-15T23:22:29.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.992+0000 7f0630813640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f062c06c320 0x7f062c15cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:29.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.992+0000 7f0630813640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f062c06c320 0x7f062c15cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35506/0 (socket says 172.21.15.123:35506) 2024-09-15T23:22:29.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.992+0000 7f0630813640 1 -- 172.21.15.123:0/1708511031 learned_addr learned my addr 172.21.15.123:0/1708511031 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:29.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.992+0000 7f0630813640 1 -- 172.21.15.123:0/1708511031 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f062c0b2d40 msgr2=0x7f062c15bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:29.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.992+0000 7f0630813640 1 --2- 172.21.15.123:0/1708511031 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f062c0b2d40 0x7f062c15bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.992+0000 7f0631014640 1 --2- 172.21.15.123:0/1708511031 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f062c13eb20 0x7f062c158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:29.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.992+0000 7f0630813640 1 -- 172.21.15.123:0/1708511031 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f062c13eb20 msgr2=0x7f062c158b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:29.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.992+0000 7f0630813640 1 --2- 172.21.15.123:0/1708511031 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f062c13eb20 0x7f062c158b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.992+0000 7f0630813640 1 -- 172.21.15.123:0/1708511031 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f062c0b5a90 con 0x7f062c06c320 2024-09-15T23:22:29.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.993+0000 7f0630813640 1 --2- 172.21.15.123:0/1708511031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f062c06c320 0x7f062c15cb70 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7f062800c430 tx=0x7f062800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:29.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.993+0000 7f06217fa640 1 -- 172.21.15.123:0/1708511031 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0628011790 con 0x7f062c06c320 2024-09-15T23:22:29.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.993+0000 7f06217fa640 1 -- 172.21.15.123:0/1708511031 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0628017070 con 0x7f062c06c320 2024-09-15T23:22:29.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.993+0000 7f06217fa640 1 -- 172.21.15.123:0/1708511031 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0628011bb0 con 0x7f062c06c320 2024-09-15T23:22:29.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.993+0000 7f0632a77640 1 -- 172.21.15.123:0/1708511031 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f062c0b5d70 con 0x7f062c06c320 2024-09-15T23:22:29.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.993+0000 7f0632a77640 1 -- 172.21.15.123:0/1708511031 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f062c144550 con 0x7f062c06c320 2024-09-15T23:22:29.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.994+0000 7f0632a77640 1 -- 172.21.15.123:0/1708511031 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f062c0b5f40 con 0x7f062c06c320 2024-09-15T23:22:29.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.994+0000 7f06217fa640 1 -- 172.21.15.123:0/1708511031 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f062801c460 con 0x7f062c06c320 2024-09-15T23:22:29.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.994+0000 7f06217fa640 1 --2- 172.21.15.123:0/1708511031 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f061806c2e0 0x7f061806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:29.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.995+0000 7f06217fa640 1 -- 172.21.15.123:0/1708511031 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f062808b220 con 0x7f062c06c320 2024-09-15T23:22:29.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.995+0000 7f0623fff640 1 --2- 172.21.15.123:0/1708511031 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f061806c2e0 0x7f061806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:29.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.995+0000 7f0623fff640 1 --2- 172.21.15.123:0/1708511031 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f061806c2e0 0x7f061806e7a0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f061c034000 tx=0x7f061c02c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:29.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:29.999+0000 7f06217fa640 1 -- 172.21.15.123:0/1708511031 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0628059a20 con 0x7f062c06c320 2024-09-15T23:22:30.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.162+0000 7f0632a77640 1 -- 172.21.15.123:0/1708511031 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f062c06c9c0 con 0x7f061806c2e0 2024-09-15T23:22:30.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.168+0000 7f06217fa640 1 -- 172.21.15.123:0/1708511031 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251686 (secure 0 0 0) 0x7f062c06c9c0 con 0x7f061806c2e0 2024-09-15T23:22:30.172 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:22:30.173 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:22:30.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.172+0000 7f0632a77640 1 -- 172.21.15.123:0/1708511031 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f061806c2e0 msgr2=0x7f061806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:30.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.172+0000 7f0632a77640 1 --2- 172.21.15.123:0/1708511031 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f061806c2e0 0x7f061806e7a0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f061c034000 tx=0x7f061c02c000 comp rx=0 tx=0).stop 2024-09-15T23:22:30.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.172+0000 7f0632a77640 1 -- 172.21.15.123:0/1708511031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f062c06c320 msgr2=0x7f062c15cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:30.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.172+0000 7f0632a77640 1 --2- 172.21.15.123:0/1708511031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f062c06c320 0x7f062c15cb70 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7f062800c430 tx=0x7f062800c8f0 comp rx=0 tx=0).stop 2024-09-15T23:22:30.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.172+0000 7f0632a77640 1 -- 172.21.15.123:0/1708511031 shutdown_connections 2024-09-15T23:22:30.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.172+0000 7f0632a77640 1 --2- 172.21.15.123:0/1708511031 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f062c13eb20 0x7f062c158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:30.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.172+0000 7f0632a77640 1 --2- 172.21.15.123:0/1708511031 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f062c0b2d40 0x7f062c15bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:30.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.172+0000 7f0632a77640 1 --2- 172.21.15.123:0/1708511031 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f061806c2e0 0x7f061806e7a0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:30.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.172+0000 7f0632a77640 1 --2- 172.21.15.123:0/1708511031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f062c06c320 0x7f062c15cb70 unknown :-1 s=CLOSED pgs=2093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:30.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.172+0000 7f0632a77640 1 -- 172.21.15.123:0/1708511031 >> 172.21.15.123:0/1708511031 conn(0x7f062c0ccec0 msgr2=0x7f062c157980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:30.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.172+0000 7f0632a77640 1 -- 172.21.15.123:0/1708511031 shutdown_connections 2024-09-15T23:22:30.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.172+0000 7f0632a77640 1 -- 172.21.15.123:0/1708511031 wait complete. 2024-09-15T23:22:30.183 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":489,"stamp":"2024-09-15T23:22:29.650518+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590472,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":184,"num_write_kb":2424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":441864,"kb_used_data":18840,"kb_used_omap":12,"kb_used_meta":422835,"kb_avail":754532856,"statfs":{"total":773094113280,"available":772641644544,"internally_reserved":0,"allocated":19292160,"data_stored":9191752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":432983600},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":104,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.093509"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563494+0000","last_change":"2024-09-15T23:22:26.576654+0000","last_active":"2024-09-15T23:22:27.563494+0000","last_peered":"2024-09-15T23:22:27.563494+0000","last_clean":"2024-09-15T23:22:27.563494+0000","last_became_active":"2024-09-15T23:22:26.576393+0000","last_became_peered":"2024-09-15T23:22:26.576393+0000","last_unstale":"2024-09-15T23:22:27.563494+0000","last_undegraded":"2024-09-15T23:22:27.563494+0000","last_fullsized":"2024-09-15T23:22:27.563494+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:11.370324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.986158+0000","last_change":"2024-09-15T23:22:26.579287+0000","last_active":"2024-09-15T23:22:27.986158+0000","last_peered":"2024-09-15T23:22:27.986158+0000","last_clean":"2024-09-15T23:22:27.986158+0000","last_became_active":"2024-09-15T23:22:26.579010+0000","last_became_peered":"2024-09-15T23:22:26.579010+0000","last_unstale":"2024-09-15T23:22:27.986158+0000","last_undegraded":"2024-09-15T23:22:27.986158+0000","last_fullsized":"2024-09-15T23:22:27.986158+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:21.190640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.578422+0000","last_change":"2024-09-15T23:22:26.577028+0000","last_active":"2024-09-15T23:22:26.578422+0000","last_peered":"2024-09-15T23:22:26.578422+0000","last_clean":"2024-09-15T23:22:26.578422+0000","last_became_active":"2024-09-15T23:22:26.576357+0000","last_became_peered":"2024-09-15T23:22:26.576357+0000","last_unstale":"2024-09-15T23:22:26.578422+0000","last_undegraded":"2024-09-15T23:22:26.578422+0000","last_fullsized":"2024-09-15T23:22:26.578422+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:29.118197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.986050+0000","last_change":"2024-09-15T23:22:26.579531+0000","last_active":"2024-09-15T23:22:27.986050+0000","last_peered":"2024-09-15T23:22:27.986050+0000","last_clean":"2024-09-15T23:22:27.986050+0000","last_became_active":"2024-09-15T23:22:26.579239+0000","last_became_peered":"2024-09-15T23:22:26.579239+0000","last_unstale":"2024-09-15T23:22:27.986050+0000","last_undegraded":"2024-09-15T23:22:27.986050+0000","last_fullsized":"2024-09-15T23:22:27.986050+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:02:40.164216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.574310+0000","last_change":"2024-09-15T23:22:26.574310+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.574310+0000","last_undegraded":"2024-09-15T23:22:26.574310+0000","last_fullsized":"2024-09-15T23:22:26.574310+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.581851+0000","last_change":"2024-09-15T23:22:26.580389+0000","last_active":"2024-09-15T23:22:26.581851+0000","last_peered":"2024-09-15T23:22:26.581851+0000","last_clean":"2024-09-15T23:22:26.581851+0000","last_became_active":"2024-09-15T23:22:26.579875+0000","last_became_peered":"2024-09-15T23:22:26.579875+0000","last_unstale":"2024-09-15T23:22:26.581851+0000","last_undegraded":"2024-09-15T23:22:26.581851+0000","last_fullsized":"2024-09-15T23:22:26.581851+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:52.838239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:28.129375+0000","last_change":"2024-09-15T23:22:26.572953+0000","last_active":"2024-09-15T23:22:28.129375+0000","last_peered":"2024-09-15T23:22:28.129375+0000","last_clean":"2024-09-15T23:22:28.129375+0000","last_became_active":"2024-09-15T23:22:26.572610+0000","last_became_peered":"2024-09-15T23:22:26.572610+0000","last_unstale":"2024-09-15T23:22:28.129375+0000","last_undegraded":"2024-09-15T23:22:28.129375+0000","last_fullsized":"2024-09-15T23:22:28.129375+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:51.710387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.571753+0000","last_change":"2024-09-15T23:22:26.571753+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.571753+0000","last_undegraded":"2024-09-15T23:22:26.571753+0000","last_fullsized":"2024-09-15T23:22:26.571753+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.986186+0000","last_change":"2024-09-15T23:22:26.581016+0000","last_active":"2024-09-15T23:22:27.986186+0000","last_peered":"2024-09-15T23:22:27.986186+0000","last_clean":"2024-09-15T23:22:27.986186+0000","last_became_active":"2024-09-15T23:22:26.580740+0000","last_became_peered":"2024-09-15T23:22:26.580740+0000","last_unstale":"2024-09-15T23:22:27.986186+0000","last_undegraded":"2024-09-15T23:22:27.986186+0000","last_fullsized":"2024-09-15T23:22:27.986186+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:23:24.794531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.581325+0000","last_change":"2024-09-15T23:22:26.581325+0000","last_active":"2024-09-15T23:22:26.581325+0000","last_peered":"2024-09-15T23:22:26.581325+0000","last_clean":"2024-09-15T23:22:26.581325+0000","last_became_active":"2024-09-15T23:22:26.581025+0000","last_became_peered":"2024-09-15T23:22:26.581025+0000","last_unstale":"2024-09-15T23:22:26.581325+0000","last_undegraded":"2024-09-15T23:22:26.581325+0000","last_fullsized":"2024-09-15T23:22:26.581325+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:12.991092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563019+0000","last_change":"2024-09-15T23:22:26.574870+0000","last_active":"2024-09-15T23:22:27.563019+0000","last_peered":"2024-09-15T23:22:27.563019+0000","last_clean":"2024-09-15T23:22:27.563019+0000","last_became_active":"2024-09-15T23:22:26.574579+0000","last_became_peered":"2024-09-15T23:22:26.574579+0000","last_unstale":"2024-09-15T23:22:27.563019+0000","last_undegraded":"2024-09-15T23:22:27.563019+0000","last_fullsized":"2024-09-15T23:22:27.563019+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:42:03.421717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.562887+0000","last_change":"2024-09-15T23:22:26.573762+0000","last_active":"2024-09-15T23:22:27.562887+0000","last_peered":"2024-09-15T23:22:27.562887+0000","last_clean":"2024-09-15T23:22:27.562887+0000","last_became_active":"2024-09-15T23:22:26.571383+0000","last_became_peered":"2024-09-15T23:22:26.571383+0000","last_unstale":"2024-09-15T23:22:27.562887+0000","last_undegraded":"2024-09-15T23:22:27.562887+0000","last_fullsized":"2024-09-15T23:22:27.562887+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:42.282972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563296+0000","last_change":"2024-09-15T23:22:26.571287+0000","last_active":"2024-09-15T23:22:27.563296+0000","last_peered":"2024-09-15T23:22:27.563296+0000","last_clean":"2024-09-15T23:22:27.563296+0000","last_became_active":"2024-09-15T23:22:26.570992+0000","last_became_peered":"2024-09-15T23:22:26.570992+0000","last_unstale":"2024-09-15T23:22:27.563296+0000","last_undegraded":"2024-09-15T23:22:27.563296+0000","last_fullsized":"2024-09-15T23:22:27.563296+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:19:58.188543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.985969+0000","last_change":"2024-09-15T23:22:26.576051+0000","last_active":"2024-09-15T23:22:27.985969+0000","last_peered":"2024-09-15T23:22:27.985969+0000","last_clean":"2024-09-15T23:22:27.985969+0000","last_became_active":"2024-09-15T23:22:26.575761+0000","last_became_peered":"2024-09-15T23:22:26.575761+0000","last_unstale":"2024-09-15T23:22:27.985969+0000","last_undegraded":"2024-09-15T23:22:27.985969+0000","last_fullsized":"2024-09-15T23:22:27.985969+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:42.993876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563151+0000","last_change":"2024-09-15T23:22:26.574261+0000","last_active":"2024-09-15T23:22:27.563151+0000","last_peered":"2024-09-15T23:22:27.563151+0000","last_clean":"2024-09-15T23:22:27.563151+0000","last_became_active":"2024-09-15T23:22:26.573988+0000","last_became_peered":"2024-09-15T23:22:26.573988+0000","last_unstale":"2024-09-15T23:22:27.563151+0000","last_undegraded":"2024-09-15T23:22:27.563151+0000","last_fullsized":"2024-09-15T23:22:27.563151+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:03:56.300826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.574059+0000","last_change":"2024-09-15T23:22:26.567832+0000","last_active":"2024-09-15T23:22:26.574059+0000","last_peered":"2024-09-15T23:22:26.574059+0000","last_clean":"2024-09-15T23:22:26.574059+0000","last_became_active":"2024-09-15T23:22:26.567505+0000","last_became_peered":"2024-09-15T23:22:26.567505+0000","last_unstale":"2024-09-15T23:22:26.574059+0000","last_undegraded":"2024-09-15T23:22:26.574059+0000","last_fullsized":"2024-09-15T23:22:26.574059+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:51.435086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.576620+0000","last_change":"2024-09-15T23:22:26.575007+0000","last_active":"2024-09-15T23:22:26.576620+0000","last_peered":"2024-09-15T23:22:26.576620+0000","last_clean":"2024-09-15T23:22:26.576620+0000","last_became_active":"2024-09-15T23:22:26.573900+0000","last_became_peered":"2024-09-15T23:22:26.573900+0000","last_unstale":"2024-09-15T23:22:26.576620+0000","last_undegraded":"2024-09-15T23:22:26.576620+0000","last_fullsized":"2024-09-15T23:22:26.576620+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:49.276352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:28.129650+0000","last_change":"2024-09-15T23:22:26.580243+0000","last_active":"2024-09-15T23:22:28.129650+0000","last_peered":"2024-09-15T23:22:28.129650+0000","last_clean":"2024-09-15T23:22:28.129650+0000","last_became_active":"2024-09-15T23:22:26.579566+0000","last_became_peered":"2024-09-15T23:22:26.579566+0000","last_unstale":"2024-09-15T23:22:28.129650+0000","last_undegraded":"2024-09-15T23:22:28.129650+0000","last_fullsized":"2024-09-15T23:22:28.129650+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:12.991092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.578439+0000","last_change":"2024-09-15T23:22:26.577138+0000","last_active":"2024-09-15T23:22:26.578439+0000","last_peered":"2024-09-15T23:22:26.578439+0000","last_clean":"2024-09-15T23:22:26.578439+0000","last_became_active":"2024-09-15T23:22:26.574892+0000","last_became_peered":"2024-09-15T23:22:26.574892+0000","last_unstale":"2024-09-15T23:22:26.578439+0000","last_undegraded":"2024-09-15T23:22:26.578439+0000","last_fullsized":"2024-09-15T23:22:26.578439+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:00:10.891295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.583560+0000","last_change":"2024-09-15T23:22:26.581119+0000","last_active":"2024-09-15T23:22:26.583560+0000","last_peered":"2024-09-15T23:22:26.583560+0000","last_clean":"2024-09-15T23:22:26.583560+0000","last_became_active":"2024-09-15T23:22:26.580871+0000","last_became_peered":"2024-09-15T23:22:26.580871+0000","last_unstale":"2024-09-15T23:22:26.583560+0000","last_undegraded":"2024-09-15T23:22:26.583560+0000","last_fullsized":"2024-09-15T23:22:26.583560+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:23.329097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.577766+0000","last_change":"2024-09-15T23:22:26.575475+0000","last_active":"2024-09-15T23:22:26.577766+0000","last_peered":"2024-09-15T23:22:26.577766+0000","last_clean":"2024-09-15T23:22:26.577766+0000","last_became_active":"2024-09-15T23:22:26.575072+0000","last_became_peered":"2024-09-15T23:22:26.575072+0000","last_unstale":"2024-09-15T23:22:26.577766+0000","last_undegraded":"2024-09-15T23:22:26.577766+0000","last_fullsized":"2024-09-15T23:22:26.577766+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:54.325106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.575546+0000","last_change":"2024-09-15T23:22:26.575546+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.575546+0000","last_undegraded":"2024-09-15T23:22:26.575546+0000","last_fullsized":"2024-09-15T23:22:26.575546+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.566403+0000","last_change":"2024-09-15T23:22:26.566403+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.566403+0000","last_undegraded":"2024-09-15T23:22:26.566403+0000","last_fullsized":"2024-09-15T23:22:26.566403+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":["6","7"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.583113+0000","last_change":"2024-09-15T23:22:26.583113+0000","last_active":"2024-09-15T23:22:26.583113+0000","last_peered":"2024-09-15T23:22:26.583113+0000","last_clean":"2024-09-15T23:22:26.583113+0000","last_became_active":"2024-09-15T23:22:26.582600+0000","last_became_peered":"2024-09-15T23:22:26.582600+0000","last_unstale":"2024-09-15T23:22:26.583113+0000","last_undegraded":"2024-09-15T23:22:26.583113+0000","last_fullsized":"2024-09-15T23:22:26.583113+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:57:04.492522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.986222+0000","last_change":"2024-09-15T23:22:26.574747+0000","last_active":"2024-09-15T23:22:27.986222+0000","last_peered":"2024-09-15T23:22:27.986222+0000","last_clean":"2024-09-15T23:22:27.986222+0000","last_became_active":"2024-09-15T23:22:26.574496+0000","last_became_peered":"2024-09-15T23:22:26.574496+0000","last_unstale":"2024-09-15T23:22:27.986222+0000","last_undegraded":"2024-09-15T23:22:27.986222+0000","last_fullsized":"2024-09-15T23:22:27.986222+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:48.899103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.562879+0000","last_change":"2024-09-15T23:22:26.575300+0000","last_active":"2024-09-15T23:22:27.562879+0000","last_peered":"2024-09-15T23:22:27.562879+0000","last_clean":"2024-09-15T23:22:27.562879+0000","last_became_active":"2024-09-15T23:22:26.575032+0000","last_became_peered":"2024-09-15T23:22:26.575032+0000","last_unstale":"2024-09-15T23:22:27.562879+0000","last_undegraded":"2024-09-15T23:22:27.562879+0000","last_fullsized":"2024-09-15T23:22:27.562879+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:44.667091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.578403+0000","last_change":"2024-09-15T23:22:26.576639+0000","last_active":"2024-09-15T23:22:26.578403+0000","last_peered":"2024-09-15T23:22:26.578403+0000","last_clean":"2024-09-15T23:22:26.578403+0000","last_became_active":"2024-09-15T23:22:26.575205+0000","last_became_peered":"2024-09-15T23:22:26.575205+0000","last_unstale":"2024-09-15T23:22:26.578403+0000","last_undegraded":"2024-09-15T23:22:26.578403+0000","last_fullsized":"2024-09-15T23:22:26.578403+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:56:38.977444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.577328+0000","last_change":"2024-09-15T23:22:26.576356+0000","last_active":"2024-09-15T23:22:26.577328+0000","last_peered":"2024-09-15T23:22:26.577328+0000","last_clean":"2024-09-15T23:22:26.577328+0000","last_became_active":"2024-09-15T23:22:26.576081+0000","last_became_peered":"2024-09-15T23:22:26.576081+0000","last_unstale":"2024-09-15T23:22:26.577328+0000","last_undegraded":"2024-09-15T23:22:26.577328+0000","last_fullsized":"2024-09-15T23:22:26.577328+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:51.939872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.562894+0000","last_change":"2024-09-15T23:22:26.571980+0000","last_active":"2024-09-15T23:22:27.562894+0000","last_peered":"2024-09-15T23:22:27.562894+0000","last_clean":"2024-09-15T23:22:27.562894+0000","last_became_active":"2024-09-15T23:22:26.571547+0000","last_became_peered":"2024-09-15T23:22:26.571547+0000","last_unstale":"2024-09-15T23:22:27.562894+0000","last_undegraded":"2024-09-15T23:22:27.562894+0000","last_fullsized":"2024-09-15T23:22:27.562894+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:40:24.288085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563009+0000","last_change":"2024-09-15T23:22:26.573500+0000","last_active":"2024-09-15T23:22:27.563009+0000","last_peered":"2024-09-15T23:22:27.563009+0000","last_clean":"2024-09-15T23:22:27.563009+0000","last_became_active":"2024-09-15T23:22:26.573213+0000","last_became_peered":"2024-09-15T23:22:26.573213+0000","last_unstale":"2024-09-15T23:22:27.563009+0000","last_undegraded":"2024-09-15T23:22:27.563009+0000","last_fullsized":"2024-09-15T23:22:27.563009+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:45.562391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.572280+0000","last_change":"2024-09-15T23:22:26.572280+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.572280+0000","last_undegraded":"2024-09-15T23:22:26.572280+0000","last_fullsized":"2024-09-15T23:22:26.572280+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":["7","0"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.572389+0000","last_change":"2024-09-15T23:22:26.572389+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.572389+0000","last_undegraded":"2024-09-15T23:22:26.572389+0000","last_fullsized":"2024-09-15T23:22:26.572389+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.582653+0000","last_change":"2024-09-15T23:22:26.582653+0000","last_active":"2024-09-15T23:22:26.582653+0000","last_peered":"2024-09-15T23:22:26.582653+0000","last_clean":"2024-09-15T23:22:26.582653+0000","last_became_active":"2024-09-15T23:22:26.581898+0000","last_became_peered":"2024-09-15T23:22:26.581898+0000","last_unstale":"2024-09-15T23:22:26.582653+0000","last_undegraded":"2024-09-15T23:22:26.582653+0000","last_fullsized":"2024-09-15T23:22:26.582653+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:05:43.582002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.563441+0000","last_change":"2024-09-15T23:22:25.571785+0000","last_active":"2024-09-15T23:22:26.563441+0000","last_peered":"2024-09-15T23:22:26.563441+0000","last_clean":"2024-09-15T23:22:26.563441+0000","last_became_active":"2024-09-15T23:22:25.571482+0000","last_became_peered":"2024-09-15T23:22:25.571482+0000","last_unstale":"2024-09-15T23:22:26.563441+0000","last_undegraded":"2024-09-15T23:22:26.563441+0000","last_fullsized":"2024-09-15T23:22:26.563441+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:55:16.627253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.581429+0000","last_change":"2024-09-15T23:22:26.581429+0000","last_active":"2024-09-15T23:22:26.581429+0000","last_peered":"2024-09-15T23:22:26.581429+0000","last_clean":"2024-09-15T23:22:26.581429+0000","last_became_active":"2024-09-15T23:22:26.580652+0000","last_became_peered":"2024-09-15T23:22:26.580652+0000","last_unstale":"2024-09-15T23:22:26.581429+0000","last_undegraded":"2024-09-15T23:22:26.581429+0000","last_fullsized":"2024-09-15T23:22:26.581429+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:31:17.071450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1e","version":"181'1","reported_seq":15,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563060+0000","last_change":"2024-09-15T23:22:25.570459+0000","last_active":"2024-09-15T23:22:27.563060+0000","last_peered":"2024-09-15T23:22:27.563060+0000","last_clean":"2024-09-15T23:22:27.563060+0000","last_became_active":"2024-09-15T23:22:25.570185+0000","last_became_peered":"2024-09-15T23:22:25.570185+0000","last_unstale":"2024-09-15T23:22:27.563060+0000","last_undegraded":"2024-09-15T23:22:27.563060+0000","last_fullsized":"2024-09-15T23:22:27.563060+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:53:00.426242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.986062+0000","last_change":"2024-09-15T23:22:26.576480+0000","last_active":"2024-09-15T23:22:27.986062+0000","last_peered":"2024-09-15T23:22:27.986062+0000","last_clean":"2024-09-15T23:22:27.986062+0000","last_became_active":"2024-09-15T23:22:26.575599+0000","last_became_peered":"2024-09-15T23:22:26.575599+0000","last_unstale":"2024-09-15T23:22:27.986062+0000","last_undegraded":"2024-09-15T23:22:27.986062+0000","last_fullsized":"2024-09-15T23:22:27.986062+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:23.827041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.574749+0000","last_change":"2024-09-15T23:22:25.581273+0000","last_active":"2024-09-15T23:22:26.574749+0000","last_peered":"2024-09-15T23:22:26.574749+0000","last_clean":"2024-09-15T23:22:26.574749+0000","last_became_active":"2024-09-15T23:22:25.580975+0000","last_became_peered":"2024-09-15T23:22:25.580975+0000","last_unstale":"2024-09-15T23:22:26.574749+0000","last_undegraded":"2024-09-15T23:22:26.574749+0000","last_fullsized":"2024-09-15T23:22:26.574749+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:00:50.705677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.986205+0000","last_change":"2024-09-15T23:22:26.579120+0000","last_active":"2024-09-15T23:22:27.986205+0000","last_peered":"2024-09-15T23:22:27.986205+0000","last_clean":"2024-09-15T23:22:27.986205+0000","last_became_active":"2024-09-15T23:22:26.576159+0000","last_became_peered":"2024-09-15T23:22:26.576159+0000","last_unstale":"2024-09-15T23:22:27.986205+0000","last_undegraded":"2024-09-15T23:22:27.986205+0000","last_fullsized":"2024-09-15T23:22:27.986205+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:00:54.894412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1c","version":"181'2","reported_seq":16,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563523+0000","last_change":"2024-09-15T23:22:25.569211+0000","last_active":"2024-09-15T23:22:27.563523+0000","last_peered":"2024-09-15T23:22:27.563523+0000","last_clean":"2024-09-15T23:22:27.563523+0000","last_became_active":"2024-09-15T23:22:25.568965+0000","last_became_peered":"2024-09-15T23:22:25.568965+0000","last_unstale":"2024-09-15T23:22:27.563523+0000","last_undegraded":"2024-09-15T23:22:27.563523+0000","last_fullsized":"2024-09-15T23:22:27.563523+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:27.282812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.581830+0000","last_change":"2024-09-15T23:22:26.580161+0000","last_active":"2024-09-15T23:22:26.581830+0000","last_peered":"2024-09-15T23:22:26.581830+0000","last_clean":"2024-09-15T23:22:26.581830+0000","last_became_active":"2024-09-15T23:22:26.579508+0000","last_became_peered":"2024-09-15T23:22:26.579508+0000","last_unstale":"2024-09-15T23:22:26.581830+0000","last_undegraded":"2024-09-15T23:22:26.581830+0000","last_fullsized":"2024-09-15T23:22:26.581830+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:49.916954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.574869+0000","last_change":"2024-09-15T23:22:25.581967+0000","last_active":"2024-09-15T23:22:26.574869+0000","last_peered":"2024-09-15T23:22:26.574869+0000","last_clean":"2024-09-15T23:22:26.574869+0000","last_became_active":"2024-09-15T23:22:25.581530+0000","last_became_peered":"2024-09-15T23:22:25.581530+0000","last_unstale":"2024-09-15T23:22:26.574869+0000","last_undegraded":"2024-09-15T23:22:26.574869+0000","last_fullsized":"2024-09-15T23:22:26.574869+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:27.111829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.574455+0000","last_change":"2024-09-15T23:22:26.574455+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.574455+0000","last_undegraded":"2024-09-15T23:22:26.574455+0000","last_fullsized":"2024-09-15T23:22:26.574455+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.575821+0000","last_change":"2024-09-15T23:22:25.578495+0000","last_active":"2024-09-15T23:22:26.575821+0000","last_peered":"2024-09-15T23:22:26.575821+0000","last_clean":"2024-09-15T23:22:26.575821+0000","last_became_active":"2024-09-15T23:22:25.578014+0000","last_became_peered":"2024-09-15T23:22:25.578014+0000","last_unstale":"2024-09-15T23:22:26.575821+0000","last_undegraded":"2024-09-15T23:22:26.575821+0000","last_fullsized":"2024-09-15T23:22:26.575821+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:39:21.619939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563153+0000","last_change":"2024-09-15T23:22:26.582956+0000","last_active":"2024-09-15T23:22:27.563153+0000","last_peered":"2024-09-15T23:22:27.563153+0000","last_clean":"2024-09-15T23:22:27.563153+0000","last_became_active":"2024-09-15T23:22:26.582658+0000","last_became_peered":"2024-09-15T23:22:26.582658+0000","last_unstale":"2024-09-15T23:22:27.563153+0000","last_undegraded":"2024-09-15T23:22:27.563153+0000","last_fullsized":"2024-09-15T23:22:27.563153+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:48:01.666250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:28.129357+0000","last_change":"2024-09-15T23:22:25.573476+0000","last_active":"2024-09-15T23:22:28.129357+0000","last_peered":"2024-09-15T23:22:28.129357+0000","last_clean":"2024-09-15T23:22:28.129357+0000","last_became_active":"2024-09-15T23:22:25.573203+0000","last_became_peered":"2024-09-15T23:22:25.573203+0000","last_unstale":"2024-09-15T23:22:28.129357+0000","last_undegraded":"2024-09-15T23:22:28.129357+0000","last_fullsized":"2024-09-15T23:22:28.129357+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:43.661629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.577007+0000","last_change":"2024-09-15T23:22:26.573073+0000","last_active":"2024-09-15T23:22:26.577007+0000","last_peered":"2024-09-15T23:22:26.577007+0000","last_clean":"2024-09-15T23:22:26.577007+0000","last_became_active":"2024-09-15T23:22:26.572211+0000","last_became_peered":"2024-09-15T23:22:26.572211+0000","last_unstale":"2024-09-15T23:22:26.577007+0000","last_undegraded":"2024-09-15T23:22:26.577007+0000","last_fullsized":"2024-09-15T23:22:26.577007+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:46.592940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563476+0000","last_change":"2024-09-15T23:22:25.573132+0000","last_active":"2024-09-15T23:22:27.563476+0000","last_peered":"2024-09-15T23:22:27.563476+0000","last_clean":"2024-09-15T23:22:27.563476+0000","last_became_active":"2024-09-15T23:22:25.572496+0000","last_became_peered":"2024-09-15T23:22:25.572496+0000","last_unstale":"2024-09-15T23:22:27.563476+0000","last_undegraded":"2024-09-15T23:22:27.563476+0000","last_fullsized":"2024-09-15T23:22:27.563476+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:57.876840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.581186+0000","last_change":"2024-09-15T23:22:26.581186+0000","last_active":"2024-09-15T23:22:26.581186+0000","last_peered":"2024-09-15T23:22:26.581186+0000","last_clean":"2024-09-15T23:22:26.581186+0000","last_became_active":"2024-09-15T23:22:26.580278+0000","last_became_peered":"2024-09-15T23:22:26.580278+0000","last_unstale":"2024-09-15T23:22:26.581186+0000","last_undegraded":"2024-09-15T23:22:26.581186+0000","last_fullsized":"2024-09-15T23:22:26.581186+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:17.131723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.568273+0000","last_change":"2024-09-15T23:22:25.573560+0000","last_active":"2024-09-15T23:22:26.568273+0000","last_peered":"2024-09-15T23:22:26.568273+0000","last_clean":"2024-09-15T23:22:26.568273+0000","last_became_active":"2024-09-15T23:22:25.573270+0000","last_became_peered":"2024-09-15T23:22:25.573270+0000","last_unstale":"2024-09-15T23:22:26.568273+0000","last_undegraded":"2024-09-15T23:22:26.568273+0000","last_fullsized":"2024-09-15T23:22:26.568273+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:44.556930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563429+0000","last_change":"2024-09-15T23:22:26.576066+0000","last_active":"2024-09-15T23:22:27.563429+0000","last_peered":"2024-09-15T23:22:27.563429+0000","last_clean":"2024-09-15T23:22:27.563429+0000","last_became_active":"2024-09-15T23:22:26.575722+0000","last_became_peered":"2024-09-15T23:22:26.575722+0000","last_unstale":"2024-09-15T23:22:27.563429+0000","last_undegraded":"2024-09-15T23:22:27.563429+0000","last_fullsized":"2024-09-15T23:22:27.563429+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:51.710387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.574886+0000","last_change":"2024-09-15T23:22:25.580281+0000","last_active":"2024-09-15T23:22:26.574886+0000","last_peered":"2024-09-15T23:22:26.574886+0000","last_clean":"2024-09-15T23:22:26.574886+0000","last_became_active":"2024-09-15T23:22:25.579966+0000","last_became_peered":"2024-09-15T23:22:25.579966+0000","last_unstale":"2024-09-15T23:22:26.574886+0000","last_undegraded":"2024-09-15T23:22:26.574886+0000","last_fullsized":"2024-09-15T23:22:26.574886+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:11.132878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.568134+0000","last_change":"2024-09-15T23:22:26.568134+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.568134+0000","last_undegraded":"2024-09-15T23:22:26.568134+0000","last_fullsized":"2024-09-15T23:22:26.568134+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":["6","5"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.574342+0000","last_change":"2024-09-15T23:22:25.582774+0000","last_active":"2024-09-15T23:22:26.574342+0000","last_peered":"2024-09-15T23:22:26.574342+0000","last_clean":"2024-09-15T23:22:26.574342+0000","last_became_active":"2024-09-15T23:22:25.582455+0000","last_became_peered":"2024-09-15T23:22:25.582455+0000","last_unstale":"2024-09-15T23:22:26.574342+0000","last_undegraded":"2024-09-15T23:22:26.574342+0000","last_fullsized":"2024-09-15T23:22:26.574342+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:58.026111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.579221+0000","last_change":"2024-09-15T23:22:26.579221+0000","last_active":"2024-09-15T23:22:26.579221+0000","last_peered":"2024-09-15T23:22:26.579221+0000","last_clean":"2024-09-15T23:22:26.579221+0000","last_became_active":"2024-09-15T23:22:26.578424+0000","last_became_peered":"2024-09-15T23:22:26.578424+0000","last_unstale":"2024-09-15T23:22:26.579221+0000","last_undegraded":"2024-09-15T23:22:26.579221+0000","last_fullsized":"2024-09-15T23:22:26.579221+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:51.710387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.13","version":"181'2","reported_seq":16,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.562990+0000","last_change":"2024-09-15T23:22:25.574790+0000","last_active":"2024-09-15T23:22:27.562990+0000","last_peered":"2024-09-15T23:22:27.562990+0000","last_clean":"2024-09-15T23:22:27.562990+0000","last_became_active":"2024-09-15T23:22:25.572871+0000","last_became_peered":"2024-09-15T23:22:25.572871+0000","last_unstale":"2024-09-15T23:22:27.562990+0000","last_undegraded":"2024-09-15T23:22:27.562990+0000","last_fullsized":"2024-09-15T23:22:27.562990+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:57:03.487060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:28.129624+0000","last_change":"2024-09-15T23:22:26.570568+0000","last_active":"2024-09-15T23:22:28.129624+0000","last_peered":"2024-09-15T23:22:28.129624+0000","last_clean":"2024-09-15T23:22:28.129624+0000","last_became_active":"2024-09-15T23:22:26.570294+0000","last_became_peered":"2024-09-15T23:22:26.570294+0000","last_unstale":"2024-09-15T23:22:28.129624+0000","last_undegraded":"2024-09-15T23:22:28.129624+0000","last_fullsized":"2024-09-15T23:22:28.129624+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:50.916622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.567290+0000","last_change":"2024-09-15T23:22:25.579017+0000","last_active":"2024-09-15T23:22:26.567290+0000","last_peered":"2024-09-15T23:22:26.567290+0000","last_clean":"2024-09-15T23:22:26.567290+0000","last_became_active":"2024-09-15T23:22:25.578734+0000","last_became_peered":"2024-09-15T23:22:25.578734+0000","last_unstale":"2024-09-15T23:22:26.567290+0000","last_undegraded":"2024-09-15T23:22:26.567290+0000","last_fullsized":"2024-09-15T23:22:26.567290+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:40:23.282623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.562723+0000","last_change":"2024-09-15T23:22:26.576304+0000","last_active":"2024-09-15T23:22:27.562723+0000","last_peered":"2024-09-15T23:22:27.562723+0000","last_clean":"2024-09-15T23:22:27.562723+0000","last_became_active":"2024-09-15T23:22:26.575471+0000","last_became_peered":"2024-09-15T23:22:26.575471+0000","last_unstale":"2024-09-15T23:22:27.562723+0000","last_undegraded":"2024-09-15T23:22:27.562723+0000","last_fullsized":"2024-09-15T23:22:27.562723+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:03.748163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.572851+0000","last_change":"2024-09-15T23:22:25.583097+0000","last_active":"2024-09-15T23:22:26.572851+0000","last_peered":"2024-09-15T23:22:26.572851+0000","last_clean":"2024-09-15T23:22:26.572851+0000","last_became_active":"2024-09-15T23:22:25.582619+0000","last_became_peered":"2024-09-15T23:22:25.582619+0000","last_unstale":"2024-09-15T23:22:26.572851+0000","last_undegraded":"2024-09-15T23:22:26.572851+0000","last_fullsized":"2024-09-15T23:22:26.572851+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:37:30.698864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.579456+0000","last_change":"2024-09-15T23:22:26.579456+0000","last_active":"2024-09-15T23:22:26.579456+0000","last_peered":"2024-09-15T23:22:26.579456+0000","last_clean":"2024-09-15T23:22:26.579456+0000","last_became_active":"2024-09-15T23:22:26.579149+0000","last_became_peered":"2024-09-15T23:22:26.579149+0000","last_unstale":"2024-09-15T23:22:26.579456+0000","last_undegraded":"2024-09-15T23:22:26.579456+0000","last_fullsized":"2024-09-15T23:22:26.579456+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:00:44.482957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.10","version":"181'8","reported_seq":22,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:28.129402+0000","last_change":"2024-09-15T23:22:25.571365+0000","last_active":"2024-09-15T23:22:28.129402+0000","last_peered":"2024-09-15T23:22:28.129402+0000","last_clean":"2024-09-15T23:22:28.129402+0000","last_became_active":"2024-09-15T23:22:25.571094+0000","last_became_peered":"2024-09-15T23:22:25.571094+0000","last_unstale":"2024-09-15T23:22:28.129402+0000","last_undegraded":"2024-09-15T23:22:28.129402+0000","last_fullsized":"2024-09-15T23:22:28.129402+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:41.277510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.579012+0000","last_change":"2024-09-15T23:22:26.579012+0000","last_active":"2024-09-15T23:22:26.579012+0000","last_peered":"2024-09-15T23:22:26.579012+0000","last_clean":"2024-09-15T23:22:26.579012+0000","last_became_active":"2024-09-15T23:22:26.578733+0000","last_became_peered":"2024-09-15T23:22:26.578733+0000","last_unstale":"2024-09-15T23:22:26.579012+0000","last_undegraded":"2024-09-15T23:22:26.579012+0000","last_fullsized":"2024-09-15T23:22:26.579012+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:43.656480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.574284+0000","last_change":"2024-09-15T23:22:25.581794+0000","last_active":"2024-09-15T23:22:26.574284+0000","last_peered":"2024-09-15T23:22:26.574284+0000","last_clean":"2024-09-15T23:22:26.574284+0000","last_became_active":"2024-09-15T23:22:25.581463+0000","last_became_peered":"2024-09-15T23:22:25.581463+0000","last_unstale":"2024-09-15T23:22:26.574284+0000","last_undegraded":"2024-09-15T23:22:26.574284+0000","last_fullsized":"2024-09-15T23:22:26.574284+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:40:23.527619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563286+0000","last_change":"2024-09-15T23:22:26.585935+0000","last_active":"2024-09-15T23:22:27.563286+0000","last_peered":"2024-09-15T23:22:27.563286+0000","last_clean":"2024-09-15T23:22:27.563286+0000","last_became_active":"2024-09-15T23:22:26.585643+0000","last_became_peered":"2024-09-15T23:22:26.585643+0000","last_unstale":"2024-09-15T23:22:27.563286+0000","last_undegraded":"2024-09-15T23:22:27.563286+0000","last_fullsized":"2024-09-15T23:22:27.563286+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:43.656480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.e","version":"181'2","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.569958+0000","last_change":"2024-09-15T23:22:25.576185+0000","last_active":"2024-09-15T23:22:26.569958+0000","last_peered":"2024-09-15T23:22:26.569958+0000","last_clean":"2024-09-15T23:22:26.569958+0000","last_became_active":"2024-09-15T23:22:25.575627+0000","last_became_peered":"2024-09-15T23:22:25.575627+0000","last_unstale":"2024-09-15T23:22:26.569958+0000","last_undegraded":"2024-09-15T23:22:26.569958+0000","last_fullsized":"2024-09-15T23:22:26.569958+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:01:31.306518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.986215+0000","last_change":"2024-09-15T23:22:26.581845+0000","last_active":"2024-09-15T23:22:27.986215+0000","last_peered":"2024-09-15T23:22:27.986215+0000","last_clean":"2024-09-15T23:22:27.986215+0000","last_became_active":"2024-09-15T23:22:26.581503+0000","last_became_peered":"2024-09-15T23:22:26.581503+0000","last_unstale":"2024-09-15T23:22:27.986215+0000","last_undegraded":"2024-09-15T23:22:27.986215+0000","last_fullsized":"2024-09-15T23:22:27.986215+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:37:41.999085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.d","version":"181'1","reported_seq":15,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563012+0000","last_change":"2024-09-15T23:22:25.571321+0000","last_active":"2024-09-15T23:22:27.563012+0000","last_peered":"2024-09-15T23:22:27.563012+0000","last_clean":"2024-09-15T23:22:27.563012+0000","last_became_active":"2024-09-15T23:22:25.570992+0000","last_became_peered":"2024-09-15T23:22:25.570992+0000","last_unstale":"2024-09-15T23:22:27.563012+0000","last_undegraded":"2024-09-15T23:22:27.563012+0000","last_fullsized":"2024-09-15T23:22:27.563012+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:04.372195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563162+0000","last_change":"2024-09-15T23:22:26.578668+0000","last_active":"2024-09-15T23:22:27.563162+0000","last_peered":"2024-09-15T23:22:27.563162+0000","last_clean":"2024-09-15T23:22:27.563162+0000","last_became_active":"2024-09-15T23:22:26.578321+0000","last_became_peered":"2024-09-15T23:22:26.578321+0000","last_unstale":"2024-09-15T23:22:27.563162+0000","last_undegraded":"2024-09-15T23:22:27.563162+0000","last_fullsized":"2024-09-15T23:22:27.563162+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:51.939872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563376+0000","last_change":"2024-09-15T23:22:25.575239+0000","last_active":"2024-09-15T23:22:27.563376+0000","last_peered":"2024-09-15T23:22:27.563376+0000","last_clean":"2024-09-15T23:22:27.563376+0000","last_became_active":"2024-09-15T23:22:25.574930+0000","last_became_peered":"2024-09-15T23:22:25.574930+0000","last_unstale":"2024-09-15T23:22:27.563376+0000","last_undegraded":"2024-09-15T23:22:27.563376+0000","last_fullsized":"2024-09-15T23:22:27.563376+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:40.632139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.575704+0000","last_change":"2024-09-15T23:22:26.572799+0000","last_active":"2024-09-15T23:22:26.575704+0000","last_peered":"2024-09-15T23:22:26.575704+0000","last_clean":"2024-09-15T23:22:26.575704+0000","last_became_active":"2024-09-15T23:22:26.572539+0000","last_became_peered":"2024-09-15T23:22:26.572539+0000","last_unstale":"2024-09-15T23:22:26.575704+0000","last_undegraded":"2024-09-15T23:22:26.575704+0000","last_fullsized":"2024-09-15T23:22:26.575704+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:40:36.495840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.575004+0000","last_change":"2024-09-15T23:22:25.580246+0000","last_active":"2024-09-15T23:22:26.575004+0000","last_peered":"2024-09-15T23:22:26.575004+0000","last_clean":"2024-09-15T23:22:26.575004+0000","last_became_active":"2024-09-15T23:22:25.579936+0000","last_became_peered":"2024-09-15T23:22:25.579936+0000","last_unstale":"2024-09-15T23:22:26.575004+0000","last_undegraded":"2024-09-15T23:22:26.575004+0000","last_fullsized":"2024-09-15T23:22:26.575004+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:51.335262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:28.129629+0000","last_change":"2024-09-15T23:22:26.572247+0000","last_active":"2024-09-15T23:22:28.129629+0000","last_peered":"2024-09-15T23:22:28.129629+0000","last_clean":"2024-09-15T23:22:28.129629+0000","last_became_active":"2024-09-15T23:22:26.571874+0000","last_became_peered":"2024-09-15T23:22:26.571874+0000","last_unstale":"2024-09-15T23:22:28.129629+0000","last_undegraded":"2024-09-15T23:22:28.129629+0000","last_fullsized":"2024-09-15T23:22:28.129629+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:17.131723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.569190+0000","last_change":"2024-09-15T23:22:25.577475+0000","last_active":"2024-09-15T23:22:26.569190+0000","last_peered":"2024-09-15T23:22:26.569190+0000","last_clean":"2024-09-15T23:22:26.569190+0000","last_became_active":"2024-09-15T23:22:25.577195+0000","last_became_peered":"2024-09-15T23:22:25.577195+0000","last_unstale":"2024-09-15T23:22:26.569190+0000","last_undegraded":"2024-09-15T23:22:26.569190+0000","last_fullsized":"2024-09-15T23:22:26.569190+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:09.611603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563196+0000","last_change":"2024-09-15T23:22:26.577654+0000","last_active":"2024-09-15T23:22:27.563196+0000","last_peered":"2024-09-15T23:22:27.563196+0000","last_clean":"2024-09-15T23:22:27.563196+0000","last_became_active":"2024-09-15T23:22:26.577344+0000","last_became_peered":"2024-09-15T23:22:26.577344+0000","last_unstale":"2024-09-15T23:22:27.563196+0000","last_undegraded":"2024-09-15T23:22:27.563196+0000","last_fullsized":"2024-09-15T23:22:27.563196+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:24.318992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.569225+0000","last_change":"2024-09-15T23:22:25.576650+0000","last_active":"2024-09-15T23:22:26.569225+0000","last_peered":"2024-09-15T23:22:26.569225+0000","last_clean":"2024-09-15T23:22:26.569225+0000","last_became_active":"2024-09-15T23:22:25.576362+0000","last_became_peered":"2024-09-15T23:22:25.576362+0000","last_unstale":"2024-09-15T23:22:26.569225+0000","last_undegraded":"2024-09-15T23:22:26.569225+0000","last_fullsized":"2024-09-15T23:22:26.569225+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:00:27.234261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.580637+0000","last_change":"2024-09-15T23:22:26.580637+0000","last_active":"2024-09-15T23:22:26.580637+0000","last_peered":"2024-09-15T23:22:26.580637+0000","last_clean":"2024-09-15T23:22:26.580637+0000","last_became_active":"2024-09-15T23:22:26.580301+0000","last_became_peered":"2024-09-15T23:22:26.580301+0000","last_unstale":"2024-09-15T23:22:26.580637+0000","last_undegraded":"2024-09-15T23:22:26.580637+0000","last_fullsized":"2024-09-15T23:22:26.580637+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:50.916622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563278+0000","last_change":"2024-09-15T23:22:25.571376+0000","last_active":"2024-09-15T23:22:27.563278+0000","last_peered":"2024-09-15T23:22:27.563278+0000","last_clean":"2024-09-15T23:22:27.563278+0000","last_became_active":"2024-09-15T23:22:25.571006+0000","last_became_peered":"2024-09-15T23:22:25.571006+0000","last_unstale":"2024-09-15T23:22:27.563278+0000","last_undegraded":"2024-09-15T23:22:27.563278+0000","last_fullsized":"2024-09-15T23:22:27.563278+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:05.631862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.582919+0000","last_change":"2024-09-15T23:22:26.581001+0000","last_active":"2024-09-15T23:22:26.582919+0000","last_peered":"2024-09-15T23:22:26.582919+0000","last_clean":"2024-09-15T23:22:26.582919+0000","last_became_active":"2024-09-15T23:22:26.580287+0000","last_became_peered":"2024-09-15T23:22:26.580287+0000","last_unstale":"2024-09-15T23:22:26.582919+0000","last_undegraded":"2024-09-15T23:22:26.582919+0000","last_fullsized":"2024-09-15T23:22:26.582919+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:32.384598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.7","version":"181'2","reported_seq":16,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563566+0000","last_change":"2024-09-15T23:22:25.573610+0000","last_active":"2024-09-15T23:22:27.563566+0000","last_peered":"2024-09-15T23:22:27.563566+0000","last_clean":"2024-09-15T23:22:27.563566+0000","last_became_active":"2024-09-15T23:22:25.573342+0000","last_became_peered":"2024-09-15T23:22:25.573342+0000","last_unstale":"2024-09-15T23:22:27.563566+0000","last_undegraded":"2024-09-15T23:22:27.563566+0000","last_fullsized":"2024-09-15T23:22:27.563566+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:08.553326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.582270+0000","last_change":"2024-09-15T23:22:26.578188+0000","last_active":"2024-09-15T23:22:26.582270+0000","last_peered":"2024-09-15T23:22:26.582270+0000","last_clean":"2024-09-15T23:22:26.582270+0000","last_became_active":"2024-09-15T23:22:26.577930+0000","last_became_peered":"2024-09-15T23:22:26.577930+0000","last_unstale":"2024-09-15T23:22:26.582270+0000","last_undegraded":"2024-09-15T23:22:26.582270+0000","last_fullsized":"2024-09-15T23:22:26.582270+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:51:54.832034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.563588+0000","last_change":"2024-09-15T23:22:25.575025+0000","last_active":"2024-09-15T23:22:26.563588+0000","last_peered":"2024-09-15T23:22:26.563588+0000","last_clean":"2024-09-15T23:22:26.563588+0000","last_became_active":"2024-09-15T23:22:25.574715+0000","last_became_peered":"2024-09-15T23:22:25.574715+0000","last_unstale":"2024-09-15T23:22:26.563588+0000","last_undegraded":"2024-09-15T23:22:26.563588+0000","last_fullsized":"2024-09-15T23:22:26.563588+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:26.917144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.562462+0000","last_change":"2024-09-15T23:22:26.562462+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.562462+0000","last_undegraded":"2024-09-15T23:22:26.562462+0000","last_fullsized":"2024-09-15T23:22:26.562462+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.564020+0000","last_change":"2024-09-15T23:22:25.576386+0000","last_active":"2024-09-15T23:22:26.564020+0000","last_peered":"2024-09-15T23:22:26.564020+0000","last_clean":"2024-09-15T23:22:26.564020+0000","last_became_active":"2024-09-15T23:22:25.574655+0000","last_became_peered":"2024-09-15T23:22:25.574655+0000","last_unstale":"2024-09-15T23:22:26.564020+0000","last_undegraded":"2024-09-15T23:22:26.564020+0000","last_fullsized":"2024-09-15T23:22:26.564020+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:00:02.848434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.574474+0000","last_change":"2024-09-15T23:22:26.574474+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.574474+0000","last_undegraded":"2024-09-15T23:22:26.574474+0000","last_fullsized":"2024-09-15T23:22:26.574474+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.574601+0000","last_change":"2024-09-15T23:22:25.582743+0000","last_active":"2024-09-15T23:22:26.574601+0000","last_peered":"2024-09-15T23:22:26.574601+0000","last_clean":"2024-09-15T23:22:26.574601+0000","last_became_active":"2024-09-15T23:22:25.582439+0000","last_became_peered":"2024-09-15T23:22:25.582439+0000","last_unstale":"2024-09-15T23:22:26.574601+0000","last_undegraded":"2024-09-15T23:22:26.574601+0000","last_fullsized":"2024-09-15T23:22:26.574601+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:45.831574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.985888+0000","last_change":"2024-09-15T23:22:26.586161+0000","last_active":"2024-09-15T23:22:27.985888+0000","last_peered":"2024-09-15T23:22:27.985888+0000","last_clean":"2024-09-15T23:22:27.985888+0000","last_became_active":"2024-09-15T23:22:26.585670+0000","last_became_peered":"2024-09-15T23:22:26.585670+0000","last_unstale":"2024-09-15T23:22:27.985888+0000","last_undegraded":"2024-09-15T23:22:27.985888+0000","last_fullsized":"2024-09-15T23:22:27.985888+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:02.362109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.985935+0000","last_change":"2024-09-15T23:22:25.574571+0000","last_active":"2024-09-15T23:22:27.985935+0000","last_peered":"2024-09-15T23:22:27.985935+0000","last_clean":"2024-09-15T23:22:27.985935+0000","last_became_active":"2024-09-15T23:22:25.574287+0000","last_became_peered":"2024-09-15T23:22:25.574287+0000","last_unstale":"2024-09-15T23:22:27.985935+0000","last_undegraded":"2024-09-15T23:22:27.985935+0000","last_fullsized":"2024-09-15T23:22:27.985935+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:39.683578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563363+0000","last_change":"2024-09-15T23:22:26.572903+0000","last_active":"2024-09-15T23:22:27.563363+0000","last_peered":"2024-09-15T23:22:27.563363+0000","last_clean":"2024-09-15T23:22:27.563363+0000","last_became_active":"2024-09-15T23:22:26.572625+0000","last_became_peered":"2024-09-15T23:22:26.572625+0000","last_unstale":"2024-09-15T23:22:27.563363+0000","last_undegraded":"2024-09-15T23:22:27.563363+0000","last_fullsized":"2024-09-15T23:22:27.563363+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:42:23.881842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.985998+0000","last_change":"2024-09-15T23:22:25.572720+0000","last_active":"2024-09-15T23:22:27.985998+0000","last_peered":"2024-09-15T23:22:27.985998+0000","last_clean":"2024-09-15T23:22:27.985998+0000","last_became_active":"2024-09-15T23:22:25.572239+0000","last_became_peered":"2024-09-15T23:22:25.572239+0000","last_unstale":"2024-09-15T23:22:27.985998+0000","last_undegraded":"2024-09-15T23:22:27.985998+0000","last_fullsized":"2024-09-15T23:22:27.985998+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:08:53.636567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.985897+0000","last_change":"2024-09-15T23:22:26.576393+0000","last_active":"2024-09-15T23:22:27.985897+0000","last_peered":"2024-09-15T23:22:27.985897+0000","last_clean":"2024-09-15T23:22:27.985897+0000","last_became_active":"2024-09-15T23:22:26.575901+0000","last_became_peered":"2024-09-15T23:22:26.575901+0000","last_unstale":"2024-09-15T23:22:27.985897+0000","last_undegraded":"2024-09-15T23:22:27.985897+0000","last_fullsized":"2024-09-15T23:22:27.985897+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:46:00.263978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.985843+0000","last_change":"2024-09-15T23:22:25.572258+0000","last_active":"2024-09-15T23:22:27.985843+0000","last_peered":"2024-09-15T23:22:27.985843+0000","last_clean":"2024-09-15T23:22:27.985843+0000","last_became_active":"2024-09-15T23:22:25.572005+0000","last_became_peered":"2024-09-15T23:22:25.572005+0000","last_unstale":"2024-09-15T23:22:27.985843+0000","last_undegraded":"2024-09-15T23:22:27.985843+0000","last_fullsized":"2024-09-15T23:22:27.985843+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:51.728926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.580413+0000","last_change":"2024-09-15T23:22:26.580413+0000","last_active":"2024-09-15T23:22:26.580413+0000","last_peered":"2024-09-15T23:22:26.580413+0000","last_clean":"2024-09-15T23:22:26.580413+0000","last_became_active":"2024-09-15T23:22:26.580139+0000","last_became_peered":"2024-09-15T23:22:26.580139+0000","last_unstale":"2024-09-15T23:22:26.580413+0000","last_undegraded":"2024-09-15T23:22:26.580413+0000","last_fullsized":"2024-09-15T23:22:26.580413+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:22:31.713809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.567955+0000","last_change":"2024-09-15T23:22:25.574211+0000","last_active":"2024-09-15T23:22:26.567955+0000","last_peered":"2024-09-15T23:22:26.567955+0000","last_clean":"2024-09-15T23:22:26.567955+0000","last_became_active":"2024-09-15T23:22:25.573828+0000","last_became_peered":"2024-09-15T23:22:25.573828+0000","last_unstale":"2024-09-15T23:22:26.567955+0000","last_undegraded":"2024-09-15T23:22:26.567955+0000","last_fullsized":"2024-09-15T23:22:26.567955+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:53.008952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.579577+0000","last_change":"2024-09-15T23:22:26.578711+0000","last_active":"2024-09-15T23:22:26.579577+0000","last_peered":"2024-09-15T23:22:26.579577+0000","last_clean":"2024-09-15T23:22:26.579577+0000","last_became_active":"2024-09-15T23:22:26.578300+0000","last_became_peered":"2024-09-15T23:22:26.578300+0000","last_unstale":"2024-09-15T23:22:26.579577+0000","last_undegraded":"2024-09-15T23:22:26.579577+0000","last_fullsized":"2024-09-15T23:22:26.579577+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:20:01.080774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.562721+0000","last_change":"2024-09-15T23:22:25.572154+0000","last_active":"2024-09-15T23:22:27.562721+0000","last_peered":"2024-09-15T23:22:27.562721+0000","last_clean":"2024-09-15T23:22:27.562721+0000","last_became_active":"2024-09-15T23:22:25.571908+0000","last_became_peered":"2024-09-15T23:22:25.571908+0000","last_unstale":"2024-09-15T23:22:27.562721+0000","last_undegraded":"2024-09-15T23:22:27.562721+0000","last_fullsized":"2024-09-15T23:22:27.562721+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:05:42.576540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":469,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.985762+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:22:27.985762+0000","last_peered":"2024-09-15T23:22:27.985762+0000","last_clean":"2024-09-15T23:22:27.985762+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:22:27.985762+0000","last_undegraded":"2024-09-15T23:22:27.985762+0000","last_fullsized":"2024-09-15T23:22:27.985762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":104,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476867,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59796,"kb_used_data":2236,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312044,"statfs":{"total":96636764160,"available":96575533056,"internally_reserved":0,"allocated":2289664,"data_stored":1010088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55608,"kb_used_data":2212,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316232,"statfs":{"total":96636764160,"available":96579821568,"internally_reserved":0,"allocated":2265088,"data_stored":1002176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476866,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56200,"kb_used_data":2800,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315640,"statfs":{"total":96636764160,"available":96579215360,"internally_reserved":0,"allocated":2867200,"data_stored":1598774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476866,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47308,"kb_used_data":2228,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324532,"statfs":{"total":96636764160,"available":96588320768,"internally_reserved":0,"allocated":2281472,"data_stored":1009022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542272,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51428,"kb_used_data":2196,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320412,"statfs":{"total":96636764160,"available":96584101888,"internally_reserved":0,"allocated":2248704,"data_stored":995331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542272,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55600,"kb_used_data":2196,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316240,"statfs":{"total":96636764160,"available":96579829760,"internally_reserved":0,"allocated":2248704,"data_stored":995331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542271,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60332,"kb_used_data":2776,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311508,"statfs":{"total":96636764160,"available":96574984192,"internally_reserved":0,"allocated":2842624,"data_stored":1585699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542273,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55592,"kb_used_data":2196,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316248,"statfs":{"total":96636764160,"available":96579837952,"internally_reserved":0,"allocated":2248704,"data_stored":995331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:22:30.187 INFO:tasks.ceph.ceph_manager.ceph:PG 25.3b is not active+clean 2024-09-15T23:22:30.188 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.3b', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 181, 'state': 'creating+activating', 'last_fresh': '2024-09-15T23:22:26.574310+0000', 'last_change': '2024-09-15T23:22:26.574310+0000', 'last_active': '2024-09-15T23:22:25.556310+0000', 'last_peered': '2024-09-15T23:22:25.556310+0000', 'last_clean': '2024-09-15T23:22:25.556310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:22:26.574310+0000', 'last_undegraded': '2024-09-15T23:22:26.574310+0000', 'last_fullsized': '2024-09-15T23:22:26.574310+0000', 'mapping_epoch': 180, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 180, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:22:25.556310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:22:25.556310+0000', 'last_clean_scrub_stamp': '2024-09-15T23:22:25.556310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': ['7', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T23:22:30.188 INFO:tasks.ceph.ceph_manager.ceph:PG 25.38 is not active+clean 2024-09-15T23:22:30.188 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.38', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 181, 'state': 'creating+activating', 'last_fresh': '2024-09-15T23:22:26.571753+0000', 'last_change': '2024-09-15T23:22:26.571753+0000', 'last_active': '2024-09-15T23:22:25.556310+0000', 'last_peered': '2024-09-15T23:22:25.556310+0000', 'last_clean': '2024-09-15T23:22:25.556310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:22:26.571753+0000', 'last_undegraded': '2024-09-15T23:22:26.571753+0000', 'last_fullsized': '2024-09-15T23:22:26.571753+0000', 'mapping_epoch': 180, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 180, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:22:25.556310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:22:25.556310+0000', 'last_clean_scrub_stamp': '2024-09-15T23:22:25.556310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': ['7', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T23:22:30.188 INFO:tasks.ceph.ceph_manager.ceph:PG 25.2a is not active+clean 2024-09-15T23:22:30.188 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.2a', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 181, 'state': 'creating+activating', 'last_fresh': '2024-09-15T23:22:26.575546+0000', 'last_change': '2024-09-15T23:22:26.575546+0000', 'last_active': '2024-09-15T23:22:25.556310+0000', 'last_peered': '2024-09-15T23:22:25.556310+0000', 'last_clean': '2024-09-15T23:22:25.556310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:22:26.575546+0000', 'last_undegraded': '2024-09-15T23:22:26.575546+0000', 'last_fullsized': '2024-09-15T23:22:26.575546+0000', 'mapping_epoch': 180, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 180, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:22:25.556310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:22:25.556310+0000', 'last_clean_scrub_stamp': '2024-09-15T23:22:25.556310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': ['7', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T23:22:30.188 INFO:tasks.ceph.ceph_manager.ceph:PG 25.29 is not active+clean 2024-09-15T23:22:30.188 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.29', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 181, 'state': 'creating+activating', 'last_fresh': '2024-09-15T23:22:26.566403+0000', 'last_change': '2024-09-15T23:22:26.566403+0000', 'last_active': '2024-09-15T23:22:25.556310+0000', 'last_peered': '2024-09-15T23:22:25.556310+0000', 'last_clean': '2024-09-15T23:22:25.556310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:22:26.566403+0000', 'last_undegraded': '2024-09-15T23:22:26.566403+0000', 'last_fullsized': '2024-09-15T23:22:26.566403+0000', 'mapping_epoch': 180, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 180, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:22:25.556310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:22:25.556310+0000', 'last_clean_scrub_stamp': '2024-09-15T23:22:25.556310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': ['6', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T23:22:30.188 INFO:tasks.ceph.ceph_manager.ceph:PG 25.21 is not active+clean 2024-09-15T23:22:30.189 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.21', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 181, 'state': 'creating+activating', 'last_fresh': '2024-09-15T23:22:26.572280+0000', 'last_change': '2024-09-15T23:22:26.572280+0000', 'last_active': '2024-09-15T23:22:25.556310+0000', 'last_peered': '2024-09-15T23:22:25.556310+0000', 'last_clean': '2024-09-15T23:22:25.556310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:22:26.572280+0000', 'last_undegraded': '2024-09-15T23:22:26.572280+0000', 'last_fullsized': '2024-09-15T23:22:26.572280+0000', 'mapping_epoch': 180, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 180, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:22:25.556310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:22:25.556310+0000', 'last_clean_scrub_stamp': '2024-09-15T23:22:25.556310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': ['7', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T23:22:30.189 INFO:tasks.ceph.ceph_manager.ceph:PG 25.20 is not active+clean 2024-09-15T23:22:30.189 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.20', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 181, 'state': 'creating+activating', 'last_fresh': '2024-09-15T23:22:26.572389+0000', 'last_change': '2024-09-15T23:22:26.572389+0000', 'last_active': '2024-09-15T23:22:25.556310+0000', 'last_peered': '2024-09-15T23:22:25.556310+0000', 'last_clean': '2024-09-15T23:22:25.556310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:22:26.572389+0000', 'last_undegraded': '2024-09-15T23:22:26.572389+0000', 'last_fullsized': '2024-09-15T23:22:26.572389+0000', 'mapping_epoch': 180, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 180, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:22:25.556310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:22:25.556310+0000', 'last_clean_scrub_stamp': '2024-09-15T23:22:25.556310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': ['7', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T23:22:30.189 INFO:tasks.ceph.ceph_manager.ceph:PG 25.1b is not active+clean 2024-09-15T23:22:30.189 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.1b', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 181, 'state': 'creating+activating', 'last_fresh': '2024-09-15T23:22:26.574455+0000', 'last_change': '2024-09-15T23:22:26.574455+0000', 'last_active': '2024-09-15T23:22:25.556310+0000', 'last_peered': '2024-09-15T23:22:25.556310+0000', 'last_clean': '2024-09-15T23:22:25.556310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:22:26.574455+0000', 'last_undegraded': '2024-09-15T23:22:26.574455+0000', 'last_fullsized': '2024-09-15T23:22:26.574455+0000', 'mapping_epoch': 180, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 180, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:22:25.556310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:22:25.556310+0000', 'last_clean_scrub_stamp': '2024-09-15T23:22:25.556310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': ['7', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T23:22:30.189 INFO:tasks.ceph.ceph_manager.ceph:PG 25.15 is not active+clean 2024-09-15T23:22:30.189 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.15', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 181, 'state': 'creating+activating', 'last_fresh': '2024-09-15T23:22:26.568134+0000', 'last_change': '2024-09-15T23:22:26.568134+0000', 'last_active': '2024-09-15T23:22:25.556310+0000', 'last_peered': '2024-09-15T23:22:25.556310+0000', 'last_clean': '2024-09-15T23:22:25.556310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:22:26.568134+0000', 'last_undegraded': '2024-09-15T23:22:26.568134+0000', 'last_fullsized': '2024-09-15T23:22:26.568134+0000', 'mapping_epoch': 180, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 180, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:22:25.556310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:22:25.556310+0000', 'last_clean_scrub_stamp': '2024-09-15T23:22:25.556310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': ['6', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T23:22:30.189 INFO:tasks.ceph.ceph_manager.ceph:PG 25.4 is not active+clean 2024-09-15T23:22:30.189 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.4', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 181, 'state': 'creating+activating', 'last_fresh': '2024-09-15T23:22:26.562462+0000', 'last_change': '2024-09-15T23:22:26.562462+0000', 'last_active': '2024-09-15T23:22:25.556310+0000', 'last_peered': '2024-09-15T23:22:25.556310+0000', 'last_clean': '2024-09-15T23:22:25.556310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:22:26.562462+0000', 'last_undegraded': '2024-09-15T23:22:26.562462+0000', 'last_fullsized': '2024-09-15T23:22:26.562462+0000', 'mapping_epoch': 180, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 180, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:22:25.556310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:22:25.556310+0000', 'last_clean_scrub_stamp': '2024-09-15T23:22:25.556310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': ['5', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T23:22:30.189 INFO:tasks.ceph.ceph_manager.ceph:PG 25.5 is not active+clean 2024-09-15T23:22:30.189 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '25.5', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 181, 'state': 'creating+activating', 'last_fresh': '2024-09-15T23:22:26.574474+0000', 'last_change': '2024-09-15T23:22:26.574474+0000', 'last_active': '2024-09-15T23:22:25.556310+0000', 'last_peered': '2024-09-15T23:22:25.556310+0000', 'last_clean': '2024-09-15T23:22:25.556310+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:22:26.574474+0000', 'last_undegraded': '2024-09-15T23:22:26.574474+0000', 'last_fullsized': '2024-09-15T23:22:26.574474+0000', 'mapping_epoch': 180, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 180, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:22:25.556310+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:22:25.556310+0000', 'last_clean_scrub_stamp': '2024-09-15T23:22:25.556310+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': ['7', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T23:22:30.190 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:22:30.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.319+0000 7fbfb8fb9640 1 Processor -- start 2024-09-15T23:22:30.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.320+0000 7fbfb8fb9640 1 -- start start 2024-09-15T23:22:30.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.320+0000 7fbfb8fb9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbfb413eb20 0x7fbfb415c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:30.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.321+0000 7fbfb8fb9640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfb4071180 con 0x7fbfb406c320 2024-09-15T23:22:30.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.321+0000 7fbfb8fb9640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfb4071460 con 0x7fbfb40b2d40 2024-09-15T23:22:30.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.321+0000 7fbfb8fb9640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbfb4071ab0 con 0x7fbfb413eb20 2024-09-15T23:22:30.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.321+0000 7fbfb1d9b640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fbfb406c320 0x7fbfb415bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36790/0 (socket says 172.21.15.123:36790) 2024-09-15T23:22:30.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.321+0000 7fbfb1d9b640 1 -- 172.21.15.123:0/3368440501 learned_addr learned my addr 172.21.15.123:0/3368440501 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:30.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.321+0000 7fbfb2d9d640 1 --2- 172.21.15.123:0/3368440501 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbfb413eb20 0x7fbfb415c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:30.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.321+0000 7fbfb159a640 1 -- 172.21.15.123:0/3368440501 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4274402888 0 0) 0x7fbfb4071180 con 0x7fbfb406c320 2024-09-15T23:22:30.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.321+0000 7fbfb159a640 1 -- 172.21.15.123:0/3368440501 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfa0003520 con 0x7fbfb406c320 2024-09-15T23:22:30.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.321+0000 7fbfb159a640 1 -- 172.21.15.123:0/3368440501 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 349512031 0 0) 0x7fbfb4071460 con 0x7fbfb40b2d40 2024-09-15T23:22:30.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.321+0000 7fbfb159a640 1 -- 172.21.15.123:0/3368440501 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfb4071180 con 0x7fbfb40b2d40 2024-09-15T23:22:30.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.321+0000 7fbfb159a640 1 -- 172.21.15.123:0/3368440501 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 443012114 0 0) 0x7fbfa0003520 con 0x7fbfb406c320 2024-09-15T23:22:30.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.321+0000 7fbfb2d9d640 1 -- 172.21.15.123:0/3368440501 >> v1:172.21.15.188:6789/0 conn(0x7fbfb40b2d40 legacy=0x7fbfb406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:30.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.321+0000 7fbfb2d9d640 1 -- 172.21.15.123:0/3368440501 >> v1:172.21.15.123:6789/0 conn(0x7fbfb406c320 legacy=0x7fbfb415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:30.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.321+0000 7fbfb2d9d640 1 -- 172.21.15.123:0/3368440501 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb4071740 con 0x7fbfb413eb20 2024-09-15T23:22:30.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.322+0000 7fbfb2d9d640 1 --2- 172.21.15.123:0/3368440501 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbfb413eb20 0x7fbfb415c400 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbfac009dc0 tx=0x7fbfac02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c21083f30c4ed4cb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:30.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.322+0000 7fbfb159a640 1 -- 172.21.15.123:0/3368440501 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c001670 con 0x7fbfb413eb20 2024-09-15T23:22:30.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.322+0000 7fbfb159a640 1 -- 172.21.15.123:0/3368440501 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfac007540 con 0x7fbfb413eb20 2024-09-15T23:22:30.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.322+0000 7fbfb159a640 1 -- 172.21.15.123:0/3368440501 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfac0078f0 con 0x7fbfb413eb20 2024-09-15T23:22:30.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.323+0000 7fbfb8fb9640 1 -- 172.21.15.123:0/3368440501 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbfb413eb20 msgr2=0x7fbfb415c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:30.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.323+0000 7fbfb8fb9640 1 --2- 172.21.15.123:0/3368440501 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbfb413eb20 0x7fbfb415c400 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbfac009dc0 tx=0x7fbfac02a660 comp rx=0 tx=0).stop 2024-09-15T23:22:30.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.323+0000 7fbfb8fb9640 1 -- 172.21.15.123:0/3368440501 shutdown_connections 2024-09-15T23:22:30.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.323+0000 7fbfb8fb9640 1 --2- 172.21.15.123:0/3368440501 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbfb413eb20 0x7fbfb415c400 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:30.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.323+0000 7fbfb8fb9640 1 -- 172.21.15.123:0/3368440501 >> 172.21.15.123:0/3368440501 conn(0x7fbfb40ccec0 msgr2=0x7fbfb40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:30.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.323+0000 7fbfb8fb9640 1 -- 172.21.15.123:0/3368440501 shutdown_connections 2024-09-15T23:22:30.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.323+0000 7fbfb8fb9640 1 -- 172.21.15.123:0/3368440501 wait complete. 2024-09-15T23:22:30.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.324+0000 7fbfb8fb9640 1 Processor -- start 2024-09-15T23:22:30.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.324+0000 7fbfb8fb9640 1 -- start start 2024-09-15T23:22:30.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.325+0000 7fbfb8fb9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbfb406c320 0x7fbfb41362b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:30.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.325+0000 7fbfb8fb9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfb40b2d40 0x7fbfb413af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:30.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.325+0000 7fbfb8fb9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbfb413eb20 0x7fbfb413b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:30.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.325+0000 7fbfb8fb9640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb41666e0 con 0x7fbfb40b2d40 2024-09-15T23:22:30.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.325+0000 7fbfb8fb9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb4166560 con 0x7fbfb406c320 2024-09-15T23:22:30.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.325+0000 7fbfb8fb9640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbfb4166860 con 0x7fbfb413eb20 2024-09-15T23:22:30.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.325+0000 7fbfb1d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfb40b2d40 0x7fbfb413af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:30.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.325+0000 7fbfb1d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfb40b2d40 0x7fbfb413af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35516/0 (socket says 172.21.15.123:35516) 2024-09-15T23:22:30.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.325+0000 7fbfb1d9b640 1 -- 172.21.15.123:0/2954212882 learned_addr learned my addr 172.21.15.123:0/2954212882 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:30.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.325+0000 7fbfb259c640 1 --2- 172.21.15.123:0/2954212882 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbfb406c320 0x7fbfb41362b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:30.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.325+0000 7fbfb2d9d640 1 --2- 172.21.15.123:0/2954212882 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbfb413eb20 0x7fbfb413b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:30.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.325+0000 7fbfb1d9b640 1 -- 172.21.15.123:0/2954212882 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbfb413eb20 msgr2=0x7fbfb413b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:30.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.325+0000 7fbfb1d9b640 1 --2- 172.21.15.123:0/2954212882 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbfb413eb20 0x7fbfb413b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:30.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.325+0000 7fbfb1d9b640 1 -- 172.21.15.123:0/2954212882 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbfb406c320 msgr2=0x7fbfb41362b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:30.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.325+0000 7fbfb1d9b640 1 --2- 172.21.15.123:0/2954212882 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbfb406c320 0x7fbfb41362b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:30.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.325+0000 7fbfb1d9b640 1 -- 172.21.15.123:0/2954212882 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb4152df0 con 0x7fbfb40b2d40 2024-09-15T23:22:30.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.325+0000 7fbfb1d9b640 1 --2- 172.21.15.123:0/2954212882 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfb40b2d40 0x7fbfb413af60 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c00c5a0 tx=0x7fbf9c00ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:30.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.326+0000 7fbfaaffd640 1 -- 172.21.15.123:0/2954212882 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c017070 con 0x7fbfb40b2d40 2024-09-15T23:22:30.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.326+0000 7fbfaaffd640 1 -- 172.21.15.123:0/2954212882 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf9c005ce0 con 0x7fbfb40b2d40 2024-09-15T23:22:30.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.326+0000 7fbfb8fb9640 1 -- 172.21.15.123:0/2954212882 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfb40b58e0 con 0x7fbfb40b2d40 2024-09-15T23:22:30.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.326+0000 7fbfaaffd640 1 -- 172.21.15.123:0/2954212882 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c0072b0 con 0x7fbfb40b2d40 2024-09-15T23:22:30.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.326+0000 7fbfb8fb9640 1 -- 172.21.15.123:0/2954212882 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfb4155470 con 0x7fbfb40b2d40 2024-09-15T23:22:30.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.327+0000 7fbfb8fb9640 1 -- 172.21.15.123:0/2954212882 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfb406bc10 con 0x7fbfb40b2d40 2024-09-15T23:22:30.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.327+0000 7fbfaaffd640 1 -- 172.21.15.123:0/2954212882 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbf9c01a070 con 0x7fbfb40b2d40 2024-09-15T23:22:30.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.327+0000 7fbfaaffd640 1 --2- 172.21.15.123:0/2954212882 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbf9406c2b0 0x7fbf9406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:30.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.328+0000 7fbfaaffd640 1 -- 172.21.15.123:0/2954212882 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7fbf9c08a870 con 0x7fbfb40b2d40 2024-09-15T23:22:30.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.328+0000 7fbfb259c640 1 --2- 172.21.15.123:0/2954212882 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbf9406c2b0 0x7fbf9406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:30.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.328+0000 7fbfb259c640 1 --2- 172.21.15.123:0/2954212882 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbf9406c2b0 0x7fbf9406e770 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fbfa40011e0 tx=0x7fbfa4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:30.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.332+0000 7fbfaaffd640 1 -- 172.21.15.123:0/2954212882 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbf9c058a20 con 0x7fbfb40b2d40 2024-09-15T23:22:30.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.558+0000 7fbfb8fb9640 1 -- 172.21.15.123:0/2954212882 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fbfb406c9c0 con 0x7fbfb40b2d40 2024-09-15T23:22:30.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.559+0000 7fbfaaffd640 1 -- 172.21.15.123:0/2954212882 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1222 (secure 0 0 0) 0x7fbf9c05cd20 con 0x7fbfb40b2d40 2024-09-15T23:22:30.560 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:22:30.560 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":641,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":182,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":44},{"state_name":"unknown","count":43},{"state_name":"creating+activating","count":10}],"num_pgs":97,"num_pools":3,"num_objects":3,"data_bytes":590368,"bytes_used":433762304,"bytes_avail":772660350976,"bytes_total":773094113280,"unknown_pgs_ratio":0.44329896569252014,"inactive_pgs_ratio":0.10309278219938278,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":110,"btime":"2024-09-15T23:22:28:577201+0000","id":12,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":12,"rank":0,"name":"d","status":"up:active","gid":10074}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":30,"modified":"2024-09-15T23:22:15.647794+0000","services":{}},"progress_events":{}} 2024-09-15T23:22:30.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.561+0000 7fbfb8fb9640 1 -- 172.21.15.123:0/2954212882 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbf9406c2b0 msgr2=0x7fbf9406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:30.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.561+0000 7fbfb8fb9640 1 --2- 172.21.15.123:0/2954212882 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbf9406c2b0 0x7fbf9406e770 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fbfa40011e0 tx=0x7fbfa4009040 comp rx=0 tx=0).stop 2024-09-15T23:22:30.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.561+0000 7fbfb8fb9640 1 -- 172.21.15.123:0/2954212882 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfb40b2d40 msgr2=0x7fbfb413af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:30.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.561+0000 7fbfb8fb9640 1 --2- 172.21.15.123:0/2954212882 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfb40b2d40 0x7fbfb413af60 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c00c5a0 tx=0x7fbf9c00ca60 comp rx=0 tx=0).stop 2024-09-15T23:22:30.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.561+0000 7fbfb8fb9640 1 -- 172.21.15.123:0/2954212882 shutdown_connections 2024-09-15T23:22:30.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.561+0000 7fbfb8fb9640 1 --2- 172.21.15.123:0/2954212882 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbfb413eb20 0x7fbfb413b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:30.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.561+0000 7fbfb8fb9640 1 --2- 172.21.15.123:0/2954212882 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbf9406c2b0 0x7fbf9406e770 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:30.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.561+0000 7fbfb8fb9640 1 --2- 172.21.15.123:0/2954212882 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbfb40b2d40 0x7fbfb413af60 unknown :-1 s=CLOSED pgs=2095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:30.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.561+0000 7fbfb8fb9640 1 --2- 172.21.15.123:0/2954212882 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbfb406c320 0x7fbfb41362b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:30.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.561+0000 7fbfb8fb9640 1 -- 172.21.15.123:0/2954212882 >> 172.21.15.123:0/2954212882 conn(0x7fbfb40ccec0 msgr2=0x7fbfb413ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:30.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.561+0000 7fbfb8fb9640 1 -- 172.21.15.123:0/2954212882 shutdown_connections 2024-09-15T23:22:30.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.561+0000 7fbfb8fb9640 1 -- 172.21.15.123:0/2954212882 wait complete. 2024-09-15T23:22:30.573 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-15T23:22:30.576 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:22:30.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.674+0000 7f50bc05e640 1 Processor -- start 2024-09-15T23:22:30.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.674+0000 7f50bc05e640 1 -- start start 2024-09-15T23:22:30.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.675+0000 7f50bc05e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50b406c6a0 0x7f50b40720b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:30.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.675+0000 7f50bc05e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f50b415af20 0x7f50b415b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:30.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.675+0000 7f50bc05e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50b4071010 con 0x7f50b415ab40 2024-09-15T23:22:30.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.675+0000 7f50bc05e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f50b406cb10 con 0x7f50b415af20 2024-09-15T23:22:30.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.675+0000 7f50bc05e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f50b40712f0 con 0x7f50b406c6a0 2024-09-15T23:22:30.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.675+0000 7f50ba5fb640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f50b415af20 0x7f50b415b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:30.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.675+0000 7f50b9dfa640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f50b415ab40 0x7f50b4073990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36802/0 (socket says 172.21.15.123:36802) 2024-09-15T23:22:30.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.675+0000 7f50b9dfa640 1 -- 172.21.15.123:0/1904781948 learned_addr learned my addr 172.21.15.123:0/1904781948 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:30.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.675+0000 7f50b95f9640 1 --2- 172.21.15.123:0/1904781948 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50b406c6a0 0x7f50b40720b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:30.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.675+0000 7f50ba5fb640 1 -- 172.21.15.123:0/1904781948 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50b406c6a0 msgr2=0x7f50b40720b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:30.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.675+0000 7f50ba5fb640 1 --2- 172.21.15.123:0/1904781948 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50b406c6a0 0x7f50b40720b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:30.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.675+0000 7f50ba5fb640 1 -- 172.21.15.123:0/1904781948 >> v1:172.21.15.123:6789/0 conn(0x7f50b415ab40 legacy=0x7f50b4073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:30.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.675+0000 7f50ba5fb640 1 -- 172.21.15.123:0/1904781948 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50b40715d0 con 0x7f50b415af20 2024-09-15T23:22:30.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.676+0000 7f50ba5fb640 1 --2- 172.21.15.123:0/1904781948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50b415af20 0x7f50b415b390 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7f50ac009d90 tx=0x7f50ac02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c92a79c8e31ba0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:30.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.676+0000 7f50b8df8640 1 -- 172.21.15.123:0/1904781948 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ac031600 con 0x7f50b415af20 2024-09-15T23:22:30.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.676+0000 7f50b8df8640 1 -- 172.21.15.123:0/1904781948 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50ac0317a0 con 0x7f50b415af20 2024-09-15T23:22:30.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.676+0000 7f50b8df8640 1 -- 172.21.15.123:0/1904781948 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ac031b70 con 0x7f50b415af20 2024-09-15T23:22:30.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.677+0000 7f50bc05e640 1 -- 172.21.15.123:0/1904781948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50b415af20 msgr2=0x7f50b415b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:30.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.677+0000 7f50bc05e640 1 --2- 172.21.15.123:0/1904781948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50b415af20 0x7f50b415b390 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7f50ac009d90 tx=0x7f50ac02a5d0 comp rx=0 tx=0).stop 2024-09-15T23:22:30.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.677+0000 7f50bc05e640 1 -- 172.21.15.123:0/1904781948 shutdown_connections 2024-09-15T23:22:30.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.677+0000 7f50bc05e640 1 --2- 172.21.15.123:0/1904781948 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50b415af20 0x7f50b415b390 unknown :-1 s=CLOSED pgs=2097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:30.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.677+0000 7f50bc05e640 1 --2- 172.21.15.123:0/1904781948 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50b406c6a0 0x7f50b40720b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:30.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.677+0000 7f50bc05e640 1 -- 172.21.15.123:0/1904781948 >> 172.21.15.123:0/1904781948 conn(0x7f50b40ccec0 msgr2=0x7f50b40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:30.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.677+0000 7f50bc05e640 1 -- 172.21.15.123:0/1904781948 shutdown_connections 2024-09-15T23:22:30.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.677+0000 7f50bc05e640 1 -- 172.21.15.123:0/1904781948 wait complete. 2024-09-15T23:22:30.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.678+0000 7f50bc05e640 1 Processor -- start 2024-09-15T23:22:30.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.678+0000 7f50bc05e640 1 -- start start 2024-09-15T23:22:30.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.678+0000 7f50bc05e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50b406c6a0 0x7f50b40cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:30.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.678+0000 7f50bc05e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50b415ab40 0x7f50b40c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:30.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.679+0000 7f50bc05e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50b415af20 0x7f50b40c5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:30.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.679+0000 7f50bc05e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f50b415ba50 con 0x7f50b406c6a0 2024-09-15T23:22:30.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.679+0000 7f50bc05e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f50b415b8d0 con 0x7f50b415ab40 2024-09-15T23:22:30.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.679+0000 7f50bc05e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f50b415c1d0 con 0x7f50b415af20 2024-09-15T23:22:30.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.679+0000 7f50b9dfa640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50b406c6a0 0x7f50b40cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:30.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.679+0000 7f50b9dfa640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50b406c6a0 0x7f50b40cbe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35540/0 (socket says 172.21.15.123:35540) 2024-09-15T23:22:30.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.679+0000 7f50b9dfa640 1 -- 172.21.15.123:0/420355314 learned_addr learned my addr 172.21.15.123:0/420355314 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:30.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.679+0000 7f50ba5fb640 1 --2- 172.21.15.123:0/420355314 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50b415af20 0x7f50b40c5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:30.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.679+0000 7f50b9dfa640 1 -- 172.21.15.123:0/420355314 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50b415af20 msgr2=0x7f50b40c5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:30.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.679+0000 7f50b9dfa640 1 --2- 172.21.15.123:0/420355314 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50b415af20 0x7f50b40c5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:30.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.679+0000 7f50b9dfa640 1 -- 172.21.15.123:0/420355314 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50b415ab40 msgr2=0x7f50b40c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:30.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.679+0000 7f50b9dfa640 1 --2- 172.21.15.123:0/420355314 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50b415ab40 0x7f50b40c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:30.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.679+0000 7f50b9dfa640 1 -- 172.21.15.123:0/420355314 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50b41535a0 con 0x7f50b406c6a0 2024-09-15T23:22:30.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.679+0000 7f50b9dfa640 1 --2- 172.21.15.123:0/420355314 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50b406c6a0 0x7f50b40cbe00 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 crypto rx=0x7f50b000c400 tx=0x7f50b000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:30.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.679+0000 7f50aa7fc640 1 -- 172.21.15.123:0/420355314 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b0017070 con 0x7f50b406c6a0 2024-09-15T23:22:30.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.679+0000 7f50aa7fc640 1 -- 172.21.15.123:0/420355314 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50b0005ce0 con 0x7f50b406c6a0 2024-09-15T23:22:30.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.679+0000 7f50bc05e640 1 -- 172.21.15.123:0/420355314 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50b40c5f50 con 0x7f50b406c6a0 2024-09-15T23:22:30.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.679+0000 7f50aa7fc640 1 -- 172.21.15.123:0/420355314 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b0007310 con 0x7f50b406c6a0 2024-09-15T23:22:30.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.679+0000 7f50bc05e640 1 -- 172.21.15.123:0/420355314 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50b41f5b90 con 0x7f50b406c6a0 2024-09-15T23:22:30.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.680+0000 7f50bc05e640 1 -- 172.21.15.123:0/420355314 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50b41f56a0 con 0x7f50b406c6a0 2024-09-15T23:22:30.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.681+0000 7f50aa7fc640 1 -- 172.21.15.123:0/420355314 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f50b001a070 con 0x7f50b406c6a0 2024-09-15T23:22:30.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.681+0000 7f50aa7fc640 1 --2- 172.21.15.123:0/420355314 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f509806c2b0 0x7f509806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:30.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.681+0000 7f50aa7fc640 1 -- 172.21.15.123:0/420355314 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f50b008a860 con 0x7f50b406c6a0 2024-09-15T23:22:30.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.681+0000 7f50b95f9640 1 --2- 172.21.15.123:0/420355314 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f509806c2b0 0x7f509806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:30.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.682+0000 7f50b95f9640 1 --2- 172.21.15.123:0/420355314 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f509806c2b0 0x7f509806e770 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f50b4157330 tx=0x7f50a4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:30.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.685+0000 7f50aa7fc640 1 -- 172.21.15.123:0/420355314 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f50b0058fd0 con 0x7f50b406c6a0 2024-09-15T23:22:30.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.845+0000 7f50bc05e640 1 -- 172.21.15.123:0/420355314 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f50b40cd720 con 0x7f509806c2b0 2024-09-15T23:22:30.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.851+0000 7f50aa7fc640 1 -- 172.21.15.123:0/420355314 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251686 (secure 0 0 0) 0x7f50b40cd720 con 0x7f509806c2b0 2024-09-15T23:22:30.855 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:22:30.856 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:22:30.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.854+0000 7f50bc05e640 1 -- 172.21.15.123:0/420355314 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f509806c2b0 msgr2=0x7f509806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:30.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.854+0000 7f50bc05e640 1 --2- 172.21.15.123:0/420355314 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f509806c2b0 0x7f509806e770 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f50b4157330 tx=0x7f50a4008040 comp rx=0 tx=0).stop 2024-09-15T23:22:30.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.854+0000 7f50bc05e640 1 -- 172.21.15.123:0/420355314 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50b406c6a0 msgr2=0x7f50b40cbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:30.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.854+0000 7f50bc05e640 1 --2- 172.21.15.123:0/420355314 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50b406c6a0 0x7f50b40cbe00 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 crypto rx=0x7f50b000c400 tx=0x7f50b000c8c0 comp rx=0 tx=0).stop 2024-09-15T23:22:30.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.854+0000 7f50bc05e640 1 -- 172.21.15.123:0/420355314 shutdown_connections 2024-09-15T23:22:30.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.854+0000 7f50bc05e640 1 --2- 172.21.15.123:0/420355314 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50b415af20 0x7f50b40c5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:30.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.854+0000 7f50bc05e640 1 --2- 172.21.15.123:0/420355314 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50b415ab40 0x7f50b40c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:30.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.854+0000 7f50bc05e640 1 --2- 172.21.15.123:0/420355314 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f509806c2b0 0x7f509806e770 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:30.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.854+0000 7f50bc05e640 1 --2- 172.21.15.123:0/420355314 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50b406c6a0 0x7f50b40cbe00 unknown :-1 s=CLOSED pgs=2098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:30.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.854+0000 7f50bc05e640 1 -- 172.21.15.123:0/420355314 >> 172.21.15.123:0/420355314 conn(0x7f50b40ccec0 msgr2=0x7f50b4071fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:30.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.854+0000 7f50bc05e640 1 -- 172.21.15.123:0/420355314 shutdown_connections 2024-09-15T23:22:30.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:30.854+0000 7f50bc05e640 1 -- 172.21.15.123:0/420355314 wait complete. 2024-09-15T23:22:30.866 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":489,"stamp":"2024-09-15T23:22:29.650518+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590472,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":184,"num_write_kb":2424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":441864,"kb_used_data":18840,"kb_used_omap":12,"kb_used_meta":422835,"kb_avail":754532856,"statfs":{"total":773094113280,"available":772641644544,"internally_reserved":0,"allocated":19292160,"data_stored":9191752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":432983600},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":104,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.093509"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563494+0000","last_change":"2024-09-15T23:22:26.576654+0000","last_active":"2024-09-15T23:22:27.563494+0000","last_peered":"2024-09-15T23:22:27.563494+0000","last_clean":"2024-09-15T23:22:27.563494+0000","last_became_active":"2024-09-15T23:22:26.576393+0000","last_became_peered":"2024-09-15T23:22:26.576393+0000","last_unstale":"2024-09-15T23:22:27.563494+0000","last_undegraded":"2024-09-15T23:22:27.563494+0000","last_fullsized":"2024-09-15T23:22:27.563494+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:11.370324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.986158+0000","last_change":"2024-09-15T23:22:26.579287+0000","last_active":"2024-09-15T23:22:27.986158+0000","last_peered":"2024-09-15T23:22:27.986158+0000","last_clean":"2024-09-15T23:22:27.986158+0000","last_became_active":"2024-09-15T23:22:26.579010+0000","last_became_peered":"2024-09-15T23:22:26.579010+0000","last_unstale":"2024-09-15T23:22:27.986158+0000","last_undegraded":"2024-09-15T23:22:27.986158+0000","last_fullsized":"2024-09-15T23:22:27.986158+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:21.190640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.578422+0000","last_change":"2024-09-15T23:22:26.577028+0000","last_active":"2024-09-15T23:22:26.578422+0000","last_peered":"2024-09-15T23:22:26.578422+0000","last_clean":"2024-09-15T23:22:26.578422+0000","last_became_active":"2024-09-15T23:22:26.576357+0000","last_became_peered":"2024-09-15T23:22:26.576357+0000","last_unstale":"2024-09-15T23:22:26.578422+0000","last_undegraded":"2024-09-15T23:22:26.578422+0000","last_fullsized":"2024-09-15T23:22:26.578422+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:29.118197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.986050+0000","last_change":"2024-09-15T23:22:26.579531+0000","last_active":"2024-09-15T23:22:27.986050+0000","last_peered":"2024-09-15T23:22:27.986050+0000","last_clean":"2024-09-15T23:22:27.986050+0000","last_became_active":"2024-09-15T23:22:26.579239+0000","last_became_peered":"2024-09-15T23:22:26.579239+0000","last_unstale":"2024-09-15T23:22:27.986050+0000","last_undegraded":"2024-09-15T23:22:27.986050+0000","last_fullsized":"2024-09-15T23:22:27.986050+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:02:40.164216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.574310+0000","last_change":"2024-09-15T23:22:26.574310+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.574310+0000","last_undegraded":"2024-09-15T23:22:26.574310+0000","last_fullsized":"2024-09-15T23:22:26.574310+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.581851+0000","last_change":"2024-09-15T23:22:26.580389+0000","last_active":"2024-09-15T23:22:26.581851+0000","last_peered":"2024-09-15T23:22:26.581851+0000","last_clean":"2024-09-15T23:22:26.581851+0000","last_became_active":"2024-09-15T23:22:26.579875+0000","last_became_peered":"2024-09-15T23:22:26.579875+0000","last_unstale":"2024-09-15T23:22:26.581851+0000","last_undegraded":"2024-09-15T23:22:26.581851+0000","last_fullsized":"2024-09-15T23:22:26.581851+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:37:52.838239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:28.129375+0000","last_change":"2024-09-15T23:22:26.572953+0000","last_active":"2024-09-15T23:22:28.129375+0000","last_peered":"2024-09-15T23:22:28.129375+0000","last_clean":"2024-09-15T23:22:28.129375+0000","last_became_active":"2024-09-15T23:22:26.572610+0000","last_became_peered":"2024-09-15T23:22:26.572610+0000","last_unstale":"2024-09-15T23:22:28.129375+0000","last_undegraded":"2024-09-15T23:22:28.129375+0000","last_fullsized":"2024-09-15T23:22:28.129375+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:51.710387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.571753+0000","last_change":"2024-09-15T23:22:26.571753+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.571753+0000","last_undegraded":"2024-09-15T23:22:26.571753+0000","last_fullsized":"2024-09-15T23:22:26.571753+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.986186+0000","last_change":"2024-09-15T23:22:26.581016+0000","last_active":"2024-09-15T23:22:27.986186+0000","last_peered":"2024-09-15T23:22:27.986186+0000","last_clean":"2024-09-15T23:22:27.986186+0000","last_became_active":"2024-09-15T23:22:26.580740+0000","last_became_peered":"2024-09-15T23:22:26.580740+0000","last_unstale":"2024-09-15T23:22:27.986186+0000","last_undegraded":"2024-09-15T23:22:27.986186+0000","last_fullsized":"2024-09-15T23:22:27.986186+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:23:24.794531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.581325+0000","last_change":"2024-09-15T23:22:26.581325+0000","last_active":"2024-09-15T23:22:26.581325+0000","last_peered":"2024-09-15T23:22:26.581325+0000","last_clean":"2024-09-15T23:22:26.581325+0000","last_became_active":"2024-09-15T23:22:26.581025+0000","last_became_peered":"2024-09-15T23:22:26.581025+0000","last_unstale":"2024-09-15T23:22:26.581325+0000","last_undegraded":"2024-09-15T23:22:26.581325+0000","last_fullsized":"2024-09-15T23:22:26.581325+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:12.991092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563019+0000","last_change":"2024-09-15T23:22:26.574870+0000","last_active":"2024-09-15T23:22:27.563019+0000","last_peered":"2024-09-15T23:22:27.563019+0000","last_clean":"2024-09-15T23:22:27.563019+0000","last_became_active":"2024-09-15T23:22:26.574579+0000","last_became_peered":"2024-09-15T23:22:26.574579+0000","last_unstale":"2024-09-15T23:22:27.563019+0000","last_undegraded":"2024-09-15T23:22:27.563019+0000","last_fullsized":"2024-09-15T23:22:27.563019+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:42:03.421717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.562887+0000","last_change":"2024-09-15T23:22:26.573762+0000","last_active":"2024-09-15T23:22:27.562887+0000","last_peered":"2024-09-15T23:22:27.562887+0000","last_clean":"2024-09-15T23:22:27.562887+0000","last_became_active":"2024-09-15T23:22:26.571383+0000","last_became_peered":"2024-09-15T23:22:26.571383+0000","last_unstale":"2024-09-15T23:22:27.562887+0000","last_undegraded":"2024-09-15T23:22:27.562887+0000","last_fullsized":"2024-09-15T23:22:27.562887+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:42.282972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563296+0000","last_change":"2024-09-15T23:22:26.571287+0000","last_active":"2024-09-15T23:22:27.563296+0000","last_peered":"2024-09-15T23:22:27.563296+0000","last_clean":"2024-09-15T23:22:27.563296+0000","last_became_active":"2024-09-15T23:22:26.570992+0000","last_became_peered":"2024-09-15T23:22:26.570992+0000","last_unstale":"2024-09-15T23:22:27.563296+0000","last_undegraded":"2024-09-15T23:22:27.563296+0000","last_fullsized":"2024-09-15T23:22:27.563296+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:19:58.188543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.985969+0000","last_change":"2024-09-15T23:22:26.576051+0000","last_active":"2024-09-15T23:22:27.985969+0000","last_peered":"2024-09-15T23:22:27.985969+0000","last_clean":"2024-09-15T23:22:27.985969+0000","last_became_active":"2024-09-15T23:22:26.575761+0000","last_became_peered":"2024-09-15T23:22:26.575761+0000","last_unstale":"2024-09-15T23:22:27.985969+0000","last_undegraded":"2024-09-15T23:22:27.985969+0000","last_fullsized":"2024-09-15T23:22:27.985969+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:42.993876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563151+0000","last_change":"2024-09-15T23:22:26.574261+0000","last_active":"2024-09-15T23:22:27.563151+0000","last_peered":"2024-09-15T23:22:27.563151+0000","last_clean":"2024-09-15T23:22:27.563151+0000","last_became_active":"2024-09-15T23:22:26.573988+0000","last_became_peered":"2024-09-15T23:22:26.573988+0000","last_unstale":"2024-09-15T23:22:27.563151+0000","last_undegraded":"2024-09-15T23:22:27.563151+0000","last_fullsized":"2024-09-15T23:22:27.563151+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:03:56.300826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.574059+0000","last_change":"2024-09-15T23:22:26.567832+0000","last_active":"2024-09-15T23:22:26.574059+0000","last_peered":"2024-09-15T23:22:26.574059+0000","last_clean":"2024-09-15T23:22:26.574059+0000","last_became_active":"2024-09-15T23:22:26.567505+0000","last_became_peered":"2024-09-15T23:22:26.567505+0000","last_unstale":"2024-09-15T23:22:26.574059+0000","last_undegraded":"2024-09-15T23:22:26.574059+0000","last_fullsized":"2024-09-15T23:22:26.574059+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:32:51.435086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.576620+0000","last_change":"2024-09-15T23:22:26.575007+0000","last_active":"2024-09-15T23:22:26.576620+0000","last_peered":"2024-09-15T23:22:26.576620+0000","last_clean":"2024-09-15T23:22:26.576620+0000","last_became_active":"2024-09-15T23:22:26.573900+0000","last_became_peered":"2024-09-15T23:22:26.573900+0000","last_unstale":"2024-09-15T23:22:26.576620+0000","last_undegraded":"2024-09-15T23:22:26.576620+0000","last_fullsized":"2024-09-15T23:22:26.576620+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:20:49.276352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:28.129650+0000","last_change":"2024-09-15T23:22:26.580243+0000","last_active":"2024-09-15T23:22:28.129650+0000","last_peered":"2024-09-15T23:22:28.129650+0000","last_clean":"2024-09-15T23:22:28.129650+0000","last_became_active":"2024-09-15T23:22:26.579566+0000","last_became_peered":"2024-09-15T23:22:26.579566+0000","last_unstale":"2024-09-15T23:22:28.129650+0000","last_undegraded":"2024-09-15T23:22:28.129650+0000","last_fullsized":"2024-09-15T23:22:28.129650+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:12.991092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.578439+0000","last_change":"2024-09-15T23:22:26.577138+0000","last_active":"2024-09-15T23:22:26.578439+0000","last_peered":"2024-09-15T23:22:26.578439+0000","last_clean":"2024-09-15T23:22:26.578439+0000","last_became_active":"2024-09-15T23:22:26.574892+0000","last_became_peered":"2024-09-15T23:22:26.574892+0000","last_unstale":"2024-09-15T23:22:26.578439+0000","last_undegraded":"2024-09-15T23:22:26.578439+0000","last_fullsized":"2024-09-15T23:22:26.578439+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:00:10.891295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.583560+0000","last_change":"2024-09-15T23:22:26.581119+0000","last_active":"2024-09-15T23:22:26.583560+0000","last_peered":"2024-09-15T23:22:26.583560+0000","last_clean":"2024-09-15T23:22:26.583560+0000","last_became_active":"2024-09-15T23:22:26.580871+0000","last_became_peered":"2024-09-15T23:22:26.580871+0000","last_unstale":"2024-09-15T23:22:26.583560+0000","last_undegraded":"2024-09-15T23:22:26.583560+0000","last_fullsized":"2024-09-15T23:22:26.583560+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:23.329097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.577766+0000","last_change":"2024-09-15T23:22:26.575475+0000","last_active":"2024-09-15T23:22:26.577766+0000","last_peered":"2024-09-15T23:22:26.577766+0000","last_clean":"2024-09-15T23:22:26.577766+0000","last_became_active":"2024-09-15T23:22:26.575072+0000","last_became_peered":"2024-09-15T23:22:26.575072+0000","last_unstale":"2024-09-15T23:22:26.577766+0000","last_undegraded":"2024-09-15T23:22:26.577766+0000","last_fullsized":"2024-09-15T23:22:26.577766+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:54.325106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.575546+0000","last_change":"2024-09-15T23:22:26.575546+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.575546+0000","last_undegraded":"2024-09-15T23:22:26.575546+0000","last_fullsized":"2024-09-15T23:22:26.575546+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":["7","2"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.566403+0000","last_change":"2024-09-15T23:22:26.566403+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.566403+0000","last_undegraded":"2024-09-15T23:22:26.566403+0000","last_fullsized":"2024-09-15T23:22:26.566403+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":["6","7"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.583113+0000","last_change":"2024-09-15T23:22:26.583113+0000","last_active":"2024-09-15T23:22:26.583113+0000","last_peered":"2024-09-15T23:22:26.583113+0000","last_clean":"2024-09-15T23:22:26.583113+0000","last_became_active":"2024-09-15T23:22:26.582600+0000","last_became_peered":"2024-09-15T23:22:26.582600+0000","last_unstale":"2024-09-15T23:22:26.583113+0000","last_undegraded":"2024-09-15T23:22:26.583113+0000","last_fullsized":"2024-09-15T23:22:26.583113+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:57:04.492522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.986222+0000","last_change":"2024-09-15T23:22:26.574747+0000","last_active":"2024-09-15T23:22:27.986222+0000","last_peered":"2024-09-15T23:22:27.986222+0000","last_clean":"2024-09-15T23:22:27.986222+0000","last_became_active":"2024-09-15T23:22:26.574496+0000","last_became_peered":"2024-09-15T23:22:26.574496+0000","last_unstale":"2024-09-15T23:22:27.986222+0000","last_undegraded":"2024-09-15T23:22:27.986222+0000","last_fullsized":"2024-09-15T23:22:27.986222+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:48.899103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.562879+0000","last_change":"2024-09-15T23:22:26.575300+0000","last_active":"2024-09-15T23:22:27.562879+0000","last_peered":"2024-09-15T23:22:27.562879+0000","last_clean":"2024-09-15T23:22:27.562879+0000","last_became_active":"2024-09-15T23:22:26.575032+0000","last_became_peered":"2024-09-15T23:22:26.575032+0000","last_unstale":"2024-09-15T23:22:27.562879+0000","last_undegraded":"2024-09-15T23:22:27.562879+0000","last_fullsized":"2024-09-15T23:22:27.562879+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:44.667091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.578403+0000","last_change":"2024-09-15T23:22:26.576639+0000","last_active":"2024-09-15T23:22:26.578403+0000","last_peered":"2024-09-15T23:22:26.578403+0000","last_clean":"2024-09-15T23:22:26.578403+0000","last_became_active":"2024-09-15T23:22:26.575205+0000","last_became_peered":"2024-09-15T23:22:26.575205+0000","last_unstale":"2024-09-15T23:22:26.578403+0000","last_undegraded":"2024-09-15T23:22:26.578403+0000","last_fullsized":"2024-09-15T23:22:26.578403+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:56:38.977444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.577328+0000","last_change":"2024-09-15T23:22:26.576356+0000","last_active":"2024-09-15T23:22:26.577328+0000","last_peered":"2024-09-15T23:22:26.577328+0000","last_clean":"2024-09-15T23:22:26.577328+0000","last_became_active":"2024-09-15T23:22:26.576081+0000","last_became_peered":"2024-09-15T23:22:26.576081+0000","last_unstale":"2024-09-15T23:22:26.577328+0000","last_undegraded":"2024-09-15T23:22:26.577328+0000","last_fullsized":"2024-09-15T23:22:26.577328+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:51.939872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.562894+0000","last_change":"2024-09-15T23:22:26.571980+0000","last_active":"2024-09-15T23:22:27.562894+0000","last_peered":"2024-09-15T23:22:27.562894+0000","last_clean":"2024-09-15T23:22:27.562894+0000","last_became_active":"2024-09-15T23:22:26.571547+0000","last_became_peered":"2024-09-15T23:22:26.571547+0000","last_unstale":"2024-09-15T23:22:27.562894+0000","last_undegraded":"2024-09-15T23:22:27.562894+0000","last_fullsized":"2024-09-15T23:22:27.562894+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:40:24.288085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563009+0000","last_change":"2024-09-15T23:22:26.573500+0000","last_active":"2024-09-15T23:22:27.563009+0000","last_peered":"2024-09-15T23:22:27.563009+0000","last_clean":"2024-09-15T23:22:27.563009+0000","last_became_active":"2024-09-15T23:22:26.573213+0000","last_became_peered":"2024-09-15T23:22:26.573213+0000","last_unstale":"2024-09-15T23:22:27.563009+0000","last_undegraded":"2024-09-15T23:22:27.563009+0000","last_fullsized":"2024-09-15T23:22:27.563009+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:45.562391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.572280+0000","last_change":"2024-09-15T23:22:26.572280+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.572280+0000","last_undegraded":"2024-09-15T23:22:26.572280+0000","last_fullsized":"2024-09-15T23:22:26.572280+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":["7","0"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.572389+0000","last_change":"2024-09-15T23:22:26.572389+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.572389+0000","last_undegraded":"2024-09-15T23:22:26.572389+0000","last_fullsized":"2024-09-15T23:22:26.572389+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.582653+0000","last_change":"2024-09-15T23:22:26.582653+0000","last_active":"2024-09-15T23:22:26.582653+0000","last_peered":"2024-09-15T23:22:26.582653+0000","last_clean":"2024-09-15T23:22:26.582653+0000","last_became_active":"2024-09-15T23:22:26.581898+0000","last_became_peered":"2024-09-15T23:22:26.581898+0000","last_unstale":"2024-09-15T23:22:26.582653+0000","last_undegraded":"2024-09-15T23:22:26.582653+0000","last_fullsized":"2024-09-15T23:22:26.582653+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:05:43.582002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.563441+0000","last_change":"2024-09-15T23:22:25.571785+0000","last_active":"2024-09-15T23:22:26.563441+0000","last_peered":"2024-09-15T23:22:26.563441+0000","last_clean":"2024-09-15T23:22:26.563441+0000","last_became_active":"2024-09-15T23:22:25.571482+0000","last_became_peered":"2024-09-15T23:22:25.571482+0000","last_unstale":"2024-09-15T23:22:26.563441+0000","last_undegraded":"2024-09-15T23:22:26.563441+0000","last_fullsized":"2024-09-15T23:22:26.563441+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:55:16.627253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.581429+0000","last_change":"2024-09-15T23:22:26.581429+0000","last_active":"2024-09-15T23:22:26.581429+0000","last_peered":"2024-09-15T23:22:26.581429+0000","last_clean":"2024-09-15T23:22:26.581429+0000","last_became_active":"2024-09-15T23:22:26.580652+0000","last_became_peered":"2024-09-15T23:22:26.580652+0000","last_unstale":"2024-09-15T23:22:26.581429+0000","last_undegraded":"2024-09-15T23:22:26.581429+0000","last_fullsized":"2024-09-15T23:22:26.581429+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:31:17.071450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1e","version":"181'1","reported_seq":15,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563060+0000","last_change":"2024-09-15T23:22:25.570459+0000","last_active":"2024-09-15T23:22:27.563060+0000","last_peered":"2024-09-15T23:22:27.563060+0000","last_clean":"2024-09-15T23:22:27.563060+0000","last_became_active":"2024-09-15T23:22:25.570185+0000","last_became_peered":"2024-09-15T23:22:25.570185+0000","last_unstale":"2024-09-15T23:22:27.563060+0000","last_undegraded":"2024-09-15T23:22:27.563060+0000","last_fullsized":"2024-09-15T23:22:27.563060+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:53:00.426242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.986062+0000","last_change":"2024-09-15T23:22:26.576480+0000","last_active":"2024-09-15T23:22:27.986062+0000","last_peered":"2024-09-15T23:22:27.986062+0000","last_clean":"2024-09-15T23:22:27.986062+0000","last_became_active":"2024-09-15T23:22:26.575599+0000","last_became_peered":"2024-09-15T23:22:26.575599+0000","last_unstale":"2024-09-15T23:22:27.986062+0000","last_undegraded":"2024-09-15T23:22:27.986062+0000","last_fullsized":"2024-09-15T23:22:27.986062+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:23.827041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.574749+0000","last_change":"2024-09-15T23:22:25.581273+0000","last_active":"2024-09-15T23:22:26.574749+0000","last_peered":"2024-09-15T23:22:26.574749+0000","last_clean":"2024-09-15T23:22:26.574749+0000","last_became_active":"2024-09-15T23:22:25.580975+0000","last_became_peered":"2024-09-15T23:22:25.580975+0000","last_unstale":"2024-09-15T23:22:26.574749+0000","last_undegraded":"2024-09-15T23:22:26.574749+0000","last_fullsized":"2024-09-15T23:22:26.574749+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:00:50.705677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.986205+0000","last_change":"2024-09-15T23:22:26.579120+0000","last_active":"2024-09-15T23:22:27.986205+0000","last_peered":"2024-09-15T23:22:27.986205+0000","last_clean":"2024-09-15T23:22:27.986205+0000","last_became_active":"2024-09-15T23:22:26.576159+0000","last_became_peered":"2024-09-15T23:22:26.576159+0000","last_unstale":"2024-09-15T23:22:27.986205+0000","last_undegraded":"2024-09-15T23:22:27.986205+0000","last_fullsized":"2024-09-15T23:22:27.986205+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:00:54.894412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1c","version":"181'2","reported_seq":16,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563523+0000","last_change":"2024-09-15T23:22:25.569211+0000","last_active":"2024-09-15T23:22:27.563523+0000","last_peered":"2024-09-15T23:22:27.563523+0000","last_clean":"2024-09-15T23:22:27.563523+0000","last_became_active":"2024-09-15T23:22:25.568965+0000","last_became_peered":"2024-09-15T23:22:25.568965+0000","last_unstale":"2024-09-15T23:22:27.563523+0000","last_undegraded":"2024-09-15T23:22:27.563523+0000","last_fullsized":"2024-09-15T23:22:27.563523+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:27.282812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.581830+0000","last_change":"2024-09-15T23:22:26.580161+0000","last_active":"2024-09-15T23:22:26.581830+0000","last_peered":"2024-09-15T23:22:26.581830+0000","last_clean":"2024-09-15T23:22:26.581830+0000","last_became_active":"2024-09-15T23:22:26.579508+0000","last_became_peered":"2024-09-15T23:22:26.579508+0000","last_unstale":"2024-09-15T23:22:26.581830+0000","last_undegraded":"2024-09-15T23:22:26.581830+0000","last_fullsized":"2024-09-15T23:22:26.581830+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:49.916954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.574869+0000","last_change":"2024-09-15T23:22:25.581967+0000","last_active":"2024-09-15T23:22:26.574869+0000","last_peered":"2024-09-15T23:22:26.574869+0000","last_clean":"2024-09-15T23:22:26.574869+0000","last_became_active":"2024-09-15T23:22:25.581530+0000","last_became_peered":"2024-09-15T23:22:25.581530+0000","last_unstale":"2024-09-15T23:22:26.574869+0000","last_undegraded":"2024-09-15T23:22:26.574869+0000","last_fullsized":"2024-09-15T23:22:26.574869+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:27.111829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.574455+0000","last_change":"2024-09-15T23:22:26.574455+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.574455+0000","last_undegraded":"2024-09-15T23:22:26.574455+0000","last_fullsized":"2024-09-15T23:22:26.574455+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.575821+0000","last_change":"2024-09-15T23:22:25.578495+0000","last_active":"2024-09-15T23:22:26.575821+0000","last_peered":"2024-09-15T23:22:26.575821+0000","last_clean":"2024-09-15T23:22:26.575821+0000","last_became_active":"2024-09-15T23:22:25.578014+0000","last_became_peered":"2024-09-15T23:22:25.578014+0000","last_unstale":"2024-09-15T23:22:26.575821+0000","last_undegraded":"2024-09-15T23:22:26.575821+0000","last_fullsized":"2024-09-15T23:22:26.575821+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:39:21.619939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563153+0000","last_change":"2024-09-15T23:22:26.582956+0000","last_active":"2024-09-15T23:22:27.563153+0000","last_peered":"2024-09-15T23:22:27.563153+0000","last_clean":"2024-09-15T23:22:27.563153+0000","last_became_active":"2024-09-15T23:22:26.582658+0000","last_became_peered":"2024-09-15T23:22:26.582658+0000","last_unstale":"2024-09-15T23:22:27.563153+0000","last_undegraded":"2024-09-15T23:22:27.563153+0000","last_fullsized":"2024-09-15T23:22:27.563153+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:48:01.666250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:28.129357+0000","last_change":"2024-09-15T23:22:25.573476+0000","last_active":"2024-09-15T23:22:28.129357+0000","last_peered":"2024-09-15T23:22:28.129357+0000","last_clean":"2024-09-15T23:22:28.129357+0000","last_became_active":"2024-09-15T23:22:25.573203+0000","last_became_peered":"2024-09-15T23:22:25.573203+0000","last_unstale":"2024-09-15T23:22:28.129357+0000","last_undegraded":"2024-09-15T23:22:28.129357+0000","last_fullsized":"2024-09-15T23:22:28.129357+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:43.661629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.577007+0000","last_change":"2024-09-15T23:22:26.573073+0000","last_active":"2024-09-15T23:22:26.577007+0000","last_peered":"2024-09-15T23:22:26.577007+0000","last_clean":"2024-09-15T23:22:26.577007+0000","last_became_active":"2024-09-15T23:22:26.572211+0000","last_became_peered":"2024-09-15T23:22:26.572211+0000","last_unstale":"2024-09-15T23:22:26.577007+0000","last_undegraded":"2024-09-15T23:22:26.577007+0000","last_fullsized":"2024-09-15T23:22:26.577007+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:46.592940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563476+0000","last_change":"2024-09-15T23:22:25.573132+0000","last_active":"2024-09-15T23:22:27.563476+0000","last_peered":"2024-09-15T23:22:27.563476+0000","last_clean":"2024-09-15T23:22:27.563476+0000","last_became_active":"2024-09-15T23:22:25.572496+0000","last_became_peered":"2024-09-15T23:22:25.572496+0000","last_unstale":"2024-09-15T23:22:27.563476+0000","last_undegraded":"2024-09-15T23:22:27.563476+0000","last_fullsized":"2024-09-15T23:22:27.563476+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:57.876840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.581186+0000","last_change":"2024-09-15T23:22:26.581186+0000","last_active":"2024-09-15T23:22:26.581186+0000","last_peered":"2024-09-15T23:22:26.581186+0000","last_clean":"2024-09-15T23:22:26.581186+0000","last_became_active":"2024-09-15T23:22:26.580278+0000","last_became_peered":"2024-09-15T23:22:26.580278+0000","last_unstale":"2024-09-15T23:22:26.581186+0000","last_undegraded":"2024-09-15T23:22:26.581186+0000","last_fullsized":"2024-09-15T23:22:26.581186+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:17.131723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.568273+0000","last_change":"2024-09-15T23:22:25.573560+0000","last_active":"2024-09-15T23:22:26.568273+0000","last_peered":"2024-09-15T23:22:26.568273+0000","last_clean":"2024-09-15T23:22:26.568273+0000","last_became_active":"2024-09-15T23:22:25.573270+0000","last_became_peered":"2024-09-15T23:22:25.573270+0000","last_unstale":"2024-09-15T23:22:26.568273+0000","last_undegraded":"2024-09-15T23:22:26.568273+0000","last_fullsized":"2024-09-15T23:22:26.568273+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:44.556930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563429+0000","last_change":"2024-09-15T23:22:26.576066+0000","last_active":"2024-09-15T23:22:27.563429+0000","last_peered":"2024-09-15T23:22:27.563429+0000","last_clean":"2024-09-15T23:22:27.563429+0000","last_became_active":"2024-09-15T23:22:26.575722+0000","last_became_peered":"2024-09-15T23:22:26.575722+0000","last_unstale":"2024-09-15T23:22:27.563429+0000","last_undegraded":"2024-09-15T23:22:27.563429+0000","last_fullsized":"2024-09-15T23:22:27.563429+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:51.710387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.574886+0000","last_change":"2024-09-15T23:22:25.580281+0000","last_active":"2024-09-15T23:22:26.574886+0000","last_peered":"2024-09-15T23:22:26.574886+0000","last_clean":"2024-09-15T23:22:26.574886+0000","last_became_active":"2024-09-15T23:22:25.579966+0000","last_became_peered":"2024-09-15T23:22:25.579966+0000","last_unstale":"2024-09-15T23:22:26.574886+0000","last_undegraded":"2024-09-15T23:22:26.574886+0000","last_fullsized":"2024-09-15T23:22:26.574886+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:11.132878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.568134+0000","last_change":"2024-09-15T23:22:26.568134+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.568134+0000","last_undegraded":"2024-09-15T23:22:26.568134+0000","last_fullsized":"2024-09-15T23:22:26.568134+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":["6","5"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.574342+0000","last_change":"2024-09-15T23:22:25.582774+0000","last_active":"2024-09-15T23:22:26.574342+0000","last_peered":"2024-09-15T23:22:26.574342+0000","last_clean":"2024-09-15T23:22:26.574342+0000","last_became_active":"2024-09-15T23:22:25.582455+0000","last_became_peered":"2024-09-15T23:22:25.582455+0000","last_unstale":"2024-09-15T23:22:26.574342+0000","last_undegraded":"2024-09-15T23:22:26.574342+0000","last_fullsized":"2024-09-15T23:22:26.574342+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:58.026111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.579221+0000","last_change":"2024-09-15T23:22:26.579221+0000","last_active":"2024-09-15T23:22:26.579221+0000","last_peered":"2024-09-15T23:22:26.579221+0000","last_clean":"2024-09-15T23:22:26.579221+0000","last_became_active":"2024-09-15T23:22:26.578424+0000","last_became_peered":"2024-09-15T23:22:26.578424+0000","last_unstale":"2024-09-15T23:22:26.579221+0000","last_undegraded":"2024-09-15T23:22:26.579221+0000","last_fullsized":"2024-09-15T23:22:26.579221+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:51.710387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.13","version":"181'2","reported_seq":16,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.562990+0000","last_change":"2024-09-15T23:22:25.574790+0000","last_active":"2024-09-15T23:22:27.562990+0000","last_peered":"2024-09-15T23:22:27.562990+0000","last_clean":"2024-09-15T23:22:27.562990+0000","last_became_active":"2024-09-15T23:22:25.572871+0000","last_became_peered":"2024-09-15T23:22:25.572871+0000","last_unstale":"2024-09-15T23:22:27.562990+0000","last_undegraded":"2024-09-15T23:22:27.562990+0000","last_fullsized":"2024-09-15T23:22:27.562990+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:57:03.487060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:28.129624+0000","last_change":"2024-09-15T23:22:26.570568+0000","last_active":"2024-09-15T23:22:28.129624+0000","last_peered":"2024-09-15T23:22:28.129624+0000","last_clean":"2024-09-15T23:22:28.129624+0000","last_became_active":"2024-09-15T23:22:26.570294+0000","last_became_peered":"2024-09-15T23:22:26.570294+0000","last_unstale":"2024-09-15T23:22:28.129624+0000","last_undegraded":"2024-09-15T23:22:28.129624+0000","last_fullsized":"2024-09-15T23:22:28.129624+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:50.916622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.567290+0000","last_change":"2024-09-15T23:22:25.579017+0000","last_active":"2024-09-15T23:22:26.567290+0000","last_peered":"2024-09-15T23:22:26.567290+0000","last_clean":"2024-09-15T23:22:26.567290+0000","last_became_active":"2024-09-15T23:22:25.578734+0000","last_became_peered":"2024-09-15T23:22:25.578734+0000","last_unstale":"2024-09-15T23:22:26.567290+0000","last_undegraded":"2024-09-15T23:22:26.567290+0000","last_fullsized":"2024-09-15T23:22:26.567290+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:40:23.282623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.562723+0000","last_change":"2024-09-15T23:22:26.576304+0000","last_active":"2024-09-15T23:22:27.562723+0000","last_peered":"2024-09-15T23:22:27.562723+0000","last_clean":"2024-09-15T23:22:27.562723+0000","last_became_active":"2024-09-15T23:22:26.575471+0000","last_became_peered":"2024-09-15T23:22:26.575471+0000","last_unstale":"2024-09-15T23:22:27.562723+0000","last_undegraded":"2024-09-15T23:22:27.562723+0000","last_fullsized":"2024-09-15T23:22:27.562723+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:03.748163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.572851+0000","last_change":"2024-09-15T23:22:25.583097+0000","last_active":"2024-09-15T23:22:26.572851+0000","last_peered":"2024-09-15T23:22:26.572851+0000","last_clean":"2024-09-15T23:22:26.572851+0000","last_became_active":"2024-09-15T23:22:25.582619+0000","last_became_peered":"2024-09-15T23:22:25.582619+0000","last_unstale":"2024-09-15T23:22:26.572851+0000","last_undegraded":"2024-09-15T23:22:26.572851+0000","last_fullsized":"2024-09-15T23:22:26.572851+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:37:30.698864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.579456+0000","last_change":"2024-09-15T23:22:26.579456+0000","last_active":"2024-09-15T23:22:26.579456+0000","last_peered":"2024-09-15T23:22:26.579456+0000","last_clean":"2024-09-15T23:22:26.579456+0000","last_became_active":"2024-09-15T23:22:26.579149+0000","last_became_peered":"2024-09-15T23:22:26.579149+0000","last_unstale":"2024-09-15T23:22:26.579456+0000","last_undegraded":"2024-09-15T23:22:26.579456+0000","last_fullsized":"2024-09-15T23:22:26.579456+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:00:44.482957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.10","version":"181'8","reported_seq":22,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:28.129402+0000","last_change":"2024-09-15T23:22:25.571365+0000","last_active":"2024-09-15T23:22:28.129402+0000","last_peered":"2024-09-15T23:22:28.129402+0000","last_clean":"2024-09-15T23:22:28.129402+0000","last_became_active":"2024-09-15T23:22:25.571094+0000","last_became_peered":"2024-09-15T23:22:25.571094+0000","last_unstale":"2024-09-15T23:22:28.129402+0000","last_undegraded":"2024-09-15T23:22:28.129402+0000","last_fullsized":"2024-09-15T23:22:28.129402+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:41.277510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.579012+0000","last_change":"2024-09-15T23:22:26.579012+0000","last_active":"2024-09-15T23:22:26.579012+0000","last_peered":"2024-09-15T23:22:26.579012+0000","last_clean":"2024-09-15T23:22:26.579012+0000","last_became_active":"2024-09-15T23:22:26.578733+0000","last_became_peered":"2024-09-15T23:22:26.578733+0000","last_unstale":"2024-09-15T23:22:26.579012+0000","last_undegraded":"2024-09-15T23:22:26.579012+0000","last_fullsized":"2024-09-15T23:22:26.579012+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:43.656480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.574284+0000","last_change":"2024-09-15T23:22:25.581794+0000","last_active":"2024-09-15T23:22:26.574284+0000","last_peered":"2024-09-15T23:22:26.574284+0000","last_clean":"2024-09-15T23:22:26.574284+0000","last_became_active":"2024-09-15T23:22:25.581463+0000","last_became_peered":"2024-09-15T23:22:25.581463+0000","last_unstale":"2024-09-15T23:22:26.574284+0000","last_undegraded":"2024-09-15T23:22:26.574284+0000","last_fullsized":"2024-09-15T23:22:26.574284+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:40:23.527619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563286+0000","last_change":"2024-09-15T23:22:26.585935+0000","last_active":"2024-09-15T23:22:27.563286+0000","last_peered":"2024-09-15T23:22:27.563286+0000","last_clean":"2024-09-15T23:22:27.563286+0000","last_became_active":"2024-09-15T23:22:26.585643+0000","last_became_peered":"2024-09-15T23:22:26.585643+0000","last_unstale":"2024-09-15T23:22:27.563286+0000","last_undegraded":"2024-09-15T23:22:27.563286+0000","last_fullsized":"2024-09-15T23:22:27.563286+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:43.656480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.e","version":"181'2","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.569958+0000","last_change":"2024-09-15T23:22:25.576185+0000","last_active":"2024-09-15T23:22:26.569958+0000","last_peered":"2024-09-15T23:22:26.569958+0000","last_clean":"2024-09-15T23:22:26.569958+0000","last_became_active":"2024-09-15T23:22:25.575627+0000","last_became_peered":"2024-09-15T23:22:25.575627+0000","last_unstale":"2024-09-15T23:22:26.569958+0000","last_undegraded":"2024-09-15T23:22:26.569958+0000","last_fullsized":"2024-09-15T23:22:26.569958+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:01:31.306518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.986215+0000","last_change":"2024-09-15T23:22:26.581845+0000","last_active":"2024-09-15T23:22:27.986215+0000","last_peered":"2024-09-15T23:22:27.986215+0000","last_clean":"2024-09-15T23:22:27.986215+0000","last_became_active":"2024-09-15T23:22:26.581503+0000","last_became_peered":"2024-09-15T23:22:26.581503+0000","last_unstale":"2024-09-15T23:22:27.986215+0000","last_undegraded":"2024-09-15T23:22:27.986215+0000","last_fullsized":"2024-09-15T23:22:27.986215+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:37:41.999085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.d","version":"181'1","reported_seq":15,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563012+0000","last_change":"2024-09-15T23:22:25.571321+0000","last_active":"2024-09-15T23:22:27.563012+0000","last_peered":"2024-09-15T23:22:27.563012+0000","last_clean":"2024-09-15T23:22:27.563012+0000","last_became_active":"2024-09-15T23:22:25.570992+0000","last_became_peered":"2024-09-15T23:22:25.570992+0000","last_unstale":"2024-09-15T23:22:27.563012+0000","last_undegraded":"2024-09-15T23:22:27.563012+0000","last_fullsized":"2024-09-15T23:22:27.563012+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:04.372195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563162+0000","last_change":"2024-09-15T23:22:26.578668+0000","last_active":"2024-09-15T23:22:27.563162+0000","last_peered":"2024-09-15T23:22:27.563162+0000","last_clean":"2024-09-15T23:22:27.563162+0000","last_became_active":"2024-09-15T23:22:26.578321+0000","last_became_peered":"2024-09-15T23:22:26.578321+0000","last_unstale":"2024-09-15T23:22:27.563162+0000","last_undegraded":"2024-09-15T23:22:27.563162+0000","last_fullsized":"2024-09-15T23:22:27.563162+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:51.939872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563376+0000","last_change":"2024-09-15T23:22:25.575239+0000","last_active":"2024-09-15T23:22:27.563376+0000","last_peered":"2024-09-15T23:22:27.563376+0000","last_clean":"2024-09-15T23:22:27.563376+0000","last_became_active":"2024-09-15T23:22:25.574930+0000","last_became_peered":"2024-09-15T23:22:25.574930+0000","last_unstale":"2024-09-15T23:22:27.563376+0000","last_undegraded":"2024-09-15T23:22:27.563376+0000","last_fullsized":"2024-09-15T23:22:27.563376+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:40.632139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.575704+0000","last_change":"2024-09-15T23:22:26.572799+0000","last_active":"2024-09-15T23:22:26.575704+0000","last_peered":"2024-09-15T23:22:26.575704+0000","last_clean":"2024-09-15T23:22:26.575704+0000","last_became_active":"2024-09-15T23:22:26.572539+0000","last_became_peered":"2024-09-15T23:22:26.572539+0000","last_unstale":"2024-09-15T23:22:26.575704+0000","last_undegraded":"2024-09-15T23:22:26.575704+0000","last_fullsized":"2024-09-15T23:22:26.575704+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:40:36.495840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.575004+0000","last_change":"2024-09-15T23:22:25.580246+0000","last_active":"2024-09-15T23:22:26.575004+0000","last_peered":"2024-09-15T23:22:26.575004+0000","last_clean":"2024-09-15T23:22:26.575004+0000","last_became_active":"2024-09-15T23:22:25.579936+0000","last_became_peered":"2024-09-15T23:22:25.579936+0000","last_unstale":"2024-09-15T23:22:26.575004+0000","last_undegraded":"2024-09-15T23:22:26.575004+0000","last_fullsized":"2024-09-15T23:22:26.575004+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:51.335262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:28.129629+0000","last_change":"2024-09-15T23:22:26.572247+0000","last_active":"2024-09-15T23:22:28.129629+0000","last_peered":"2024-09-15T23:22:28.129629+0000","last_clean":"2024-09-15T23:22:28.129629+0000","last_became_active":"2024-09-15T23:22:26.571874+0000","last_became_peered":"2024-09-15T23:22:26.571874+0000","last_unstale":"2024-09-15T23:22:28.129629+0000","last_undegraded":"2024-09-15T23:22:28.129629+0000","last_fullsized":"2024-09-15T23:22:28.129629+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:17.131723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.569190+0000","last_change":"2024-09-15T23:22:25.577475+0000","last_active":"2024-09-15T23:22:26.569190+0000","last_peered":"2024-09-15T23:22:26.569190+0000","last_clean":"2024-09-15T23:22:26.569190+0000","last_became_active":"2024-09-15T23:22:25.577195+0000","last_became_peered":"2024-09-15T23:22:25.577195+0000","last_unstale":"2024-09-15T23:22:26.569190+0000","last_undegraded":"2024-09-15T23:22:26.569190+0000","last_fullsized":"2024-09-15T23:22:26.569190+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:09.611603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563196+0000","last_change":"2024-09-15T23:22:26.577654+0000","last_active":"2024-09-15T23:22:27.563196+0000","last_peered":"2024-09-15T23:22:27.563196+0000","last_clean":"2024-09-15T23:22:27.563196+0000","last_became_active":"2024-09-15T23:22:26.577344+0000","last_became_peered":"2024-09-15T23:22:26.577344+0000","last_unstale":"2024-09-15T23:22:27.563196+0000","last_undegraded":"2024-09-15T23:22:27.563196+0000","last_fullsized":"2024-09-15T23:22:27.563196+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:24.318992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.569225+0000","last_change":"2024-09-15T23:22:25.576650+0000","last_active":"2024-09-15T23:22:26.569225+0000","last_peered":"2024-09-15T23:22:26.569225+0000","last_clean":"2024-09-15T23:22:26.569225+0000","last_became_active":"2024-09-15T23:22:25.576362+0000","last_became_peered":"2024-09-15T23:22:25.576362+0000","last_unstale":"2024-09-15T23:22:26.569225+0000","last_undegraded":"2024-09-15T23:22:26.569225+0000","last_fullsized":"2024-09-15T23:22:26.569225+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:00:27.234261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.580637+0000","last_change":"2024-09-15T23:22:26.580637+0000","last_active":"2024-09-15T23:22:26.580637+0000","last_peered":"2024-09-15T23:22:26.580637+0000","last_clean":"2024-09-15T23:22:26.580637+0000","last_became_active":"2024-09-15T23:22:26.580301+0000","last_became_peered":"2024-09-15T23:22:26.580301+0000","last_unstale":"2024-09-15T23:22:26.580637+0000","last_undegraded":"2024-09-15T23:22:26.580637+0000","last_fullsized":"2024-09-15T23:22:26.580637+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:50.916622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563278+0000","last_change":"2024-09-15T23:22:25.571376+0000","last_active":"2024-09-15T23:22:27.563278+0000","last_peered":"2024-09-15T23:22:27.563278+0000","last_clean":"2024-09-15T23:22:27.563278+0000","last_became_active":"2024-09-15T23:22:25.571006+0000","last_became_peered":"2024-09-15T23:22:25.571006+0000","last_unstale":"2024-09-15T23:22:27.563278+0000","last_undegraded":"2024-09-15T23:22:27.563278+0000","last_fullsized":"2024-09-15T23:22:27.563278+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:05.631862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.582919+0000","last_change":"2024-09-15T23:22:26.581001+0000","last_active":"2024-09-15T23:22:26.582919+0000","last_peered":"2024-09-15T23:22:26.582919+0000","last_clean":"2024-09-15T23:22:26.582919+0000","last_became_active":"2024-09-15T23:22:26.580287+0000","last_became_peered":"2024-09-15T23:22:26.580287+0000","last_unstale":"2024-09-15T23:22:26.582919+0000","last_undegraded":"2024-09-15T23:22:26.582919+0000","last_fullsized":"2024-09-15T23:22:26.582919+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:32.384598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.7","version":"181'2","reported_seq":16,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563566+0000","last_change":"2024-09-15T23:22:25.573610+0000","last_active":"2024-09-15T23:22:27.563566+0000","last_peered":"2024-09-15T23:22:27.563566+0000","last_clean":"2024-09-15T23:22:27.563566+0000","last_became_active":"2024-09-15T23:22:25.573342+0000","last_became_peered":"2024-09-15T23:22:25.573342+0000","last_unstale":"2024-09-15T23:22:27.563566+0000","last_undegraded":"2024-09-15T23:22:27.563566+0000","last_fullsized":"2024-09-15T23:22:27.563566+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:08.553326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.582270+0000","last_change":"2024-09-15T23:22:26.578188+0000","last_active":"2024-09-15T23:22:26.582270+0000","last_peered":"2024-09-15T23:22:26.582270+0000","last_clean":"2024-09-15T23:22:26.582270+0000","last_became_active":"2024-09-15T23:22:26.577930+0000","last_became_peered":"2024-09-15T23:22:26.577930+0000","last_unstale":"2024-09-15T23:22:26.582270+0000","last_undegraded":"2024-09-15T23:22:26.582270+0000","last_fullsized":"2024-09-15T23:22:26.582270+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:51:54.832034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.563588+0000","last_change":"2024-09-15T23:22:25.575025+0000","last_active":"2024-09-15T23:22:26.563588+0000","last_peered":"2024-09-15T23:22:26.563588+0000","last_clean":"2024-09-15T23:22:26.563588+0000","last_became_active":"2024-09-15T23:22:25.574715+0000","last_became_peered":"2024-09-15T23:22:25.574715+0000","last_unstale":"2024-09-15T23:22:26.563588+0000","last_undegraded":"2024-09-15T23:22:26.563588+0000","last_fullsized":"2024-09-15T23:22:26.563588+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:26.917144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.562462+0000","last_change":"2024-09-15T23:22:26.562462+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.562462+0000","last_undegraded":"2024-09-15T23:22:26.562462+0000","last_fullsized":"2024-09-15T23:22:26.562462+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.564020+0000","last_change":"2024-09-15T23:22:25.576386+0000","last_active":"2024-09-15T23:22:26.564020+0000","last_peered":"2024-09-15T23:22:26.564020+0000","last_clean":"2024-09-15T23:22:26.564020+0000","last_became_active":"2024-09-15T23:22:25.574655+0000","last_became_peered":"2024-09-15T23:22:25.574655+0000","last_unstale":"2024-09-15T23:22:26.564020+0000","last_undegraded":"2024-09-15T23:22:26.564020+0000","last_fullsized":"2024-09-15T23:22:26.564020+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:00:02.848434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":3,"reported_epoch":181,"state":"creating+activating","last_fresh":"2024-09-15T23:22:26.574474+0000","last_change":"2024-09-15T23:22:26.574474+0000","last_active":"2024-09-15T23:22:25.556310+0000","last_peered":"2024-09-15T23:22:25.556310+0000","last_clean":"2024-09-15T23:22:25.556310+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:22:26.574474+0000","last_undegraded":"2024-09-15T23:22:26.574474+0000","last_fullsized":"2024-09-15T23:22:26.574474+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":["7","1"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.574601+0000","last_change":"2024-09-15T23:22:25.582743+0000","last_active":"2024-09-15T23:22:26.574601+0000","last_peered":"2024-09-15T23:22:26.574601+0000","last_clean":"2024-09-15T23:22:26.574601+0000","last_became_active":"2024-09-15T23:22:25.582439+0000","last_became_peered":"2024-09-15T23:22:25.582439+0000","last_unstale":"2024-09-15T23:22:26.574601+0000","last_undegraded":"2024-09-15T23:22:26.574601+0000","last_fullsized":"2024-09-15T23:22:26.574601+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:45.831574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.985888+0000","last_change":"2024-09-15T23:22:26.586161+0000","last_active":"2024-09-15T23:22:27.985888+0000","last_peered":"2024-09-15T23:22:27.985888+0000","last_clean":"2024-09-15T23:22:27.985888+0000","last_became_active":"2024-09-15T23:22:26.585670+0000","last_became_peered":"2024-09-15T23:22:26.585670+0000","last_unstale":"2024-09-15T23:22:27.985888+0000","last_undegraded":"2024-09-15T23:22:27.985888+0000","last_fullsized":"2024-09-15T23:22:27.985888+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:02.362109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.985935+0000","last_change":"2024-09-15T23:22:25.574571+0000","last_active":"2024-09-15T23:22:27.985935+0000","last_peered":"2024-09-15T23:22:27.985935+0000","last_clean":"2024-09-15T23:22:27.985935+0000","last_became_active":"2024-09-15T23:22:25.574287+0000","last_became_peered":"2024-09-15T23:22:25.574287+0000","last_unstale":"2024-09-15T23:22:27.985935+0000","last_undegraded":"2024-09-15T23:22:27.985935+0000","last_fullsized":"2024-09-15T23:22:27.985935+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:39.683578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563363+0000","last_change":"2024-09-15T23:22:26.572903+0000","last_active":"2024-09-15T23:22:27.563363+0000","last_peered":"2024-09-15T23:22:27.563363+0000","last_clean":"2024-09-15T23:22:27.563363+0000","last_became_active":"2024-09-15T23:22:26.572625+0000","last_became_peered":"2024-09-15T23:22:26.572625+0000","last_unstale":"2024-09-15T23:22:27.563363+0000","last_undegraded":"2024-09-15T23:22:27.563363+0000","last_fullsized":"2024-09-15T23:22:27.563363+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:42:23.881842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.985998+0000","last_change":"2024-09-15T23:22:25.572720+0000","last_active":"2024-09-15T23:22:27.985998+0000","last_peered":"2024-09-15T23:22:27.985998+0000","last_clean":"2024-09-15T23:22:27.985998+0000","last_became_active":"2024-09-15T23:22:25.572239+0000","last_became_peered":"2024-09-15T23:22:25.572239+0000","last_unstale":"2024-09-15T23:22:27.985998+0000","last_undegraded":"2024-09-15T23:22:27.985998+0000","last_fullsized":"2024-09-15T23:22:27.985998+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:08:53.636567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.985897+0000","last_change":"2024-09-15T23:22:26.576393+0000","last_active":"2024-09-15T23:22:27.985897+0000","last_peered":"2024-09-15T23:22:27.985897+0000","last_clean":"2024-09-15T23:22:27.985897+0000","last_became_active":"2024-09-15T23:22:26.575901+0000","last_became_peered":"2024-09-15T23:22:26.575901+0000","last_unstale":"2024-09-15T23:22:27.985897+0000","last_undegraded":"2024-09-15T23:22:27.985897+0000","last_fullsized":"2024-09-15T23:22:27.985897+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:46:00.263978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.985843+0000","last_change":"2024-09-15T23:22:25.572258+0000","last_active":"2024-09-15T23:22:27.985843+0000","last_peered":"2024-09-15T23:22:27.985843+0000","last_clean":"2024-09-15T23:22:27.985843+0000","last_became_active":"2024-09-15T23:22:25.572005+0000","last_became_peered":"2024-09-15T23:22:25.572005+0000","last_unstale":"2024-09-15T23:22:27.985843+0000","last_undegraded":"2024-09-15T23:22:27.985843+0000","last_fullsized":"2024-09-15T23:22:27.985843+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:51.728926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":8,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.580413+0000","last_change":"2024-09-15T23:22:26.580413+0000","last_active":"2024-09-15T23:22:26.580413+0000","last_peered":"2024-09-15T23:22:26.580413+0000","last_clean":"2024-09-15T23:22:26.580413+0000","last_became_active":"2024-09-15T23:22:26.580139+0000","last_became_peered":"2024-09-15T23:22:26.580139+0000","last_unstale":"2024-09-15T23:22:26.580413+0000","last_undegraded":"2024-09-15T23:22:26.580413+0000","last_fullsized":"2024-09-15T23:22:26.580413+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:22:31.713809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.567955+0000","last_change":"2024-09-15T23:22:25.574211+0000","last_active":"2024-09-15T23:22:26.567955+0000","last_peered":"2024-09-15T23:22:26.567955+0000","last_clean":"2024-09-15T23:22:26.567955+0000","last_became_active":"2024-09-15T23:22:25.573828+0000","last_became_peered":"2024-09-15T23:22:25.573828+0000","last_unstale":"2024-09-15T23:22:26.567955+0000","last_undegraded":"2024-09-15T23:22:26.567955+0000","last_fullsized":"2024-09-15T23:22:26.567955+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:53.008952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-15T23:22:26.579577+0000","last_change":"2024-09-15T23:22:26.578711+0000","last_active":"2024-09-15T23:22:26.579577+0000","last_peered":"2024-09-15T23:22:26.579577+0000","last_clean":"2024-09-15T23:22:26.579577+0000","last_became_active":"2024-09-15T23:22:26.578300+0000","last_became_peered":"2024-09-15T23:22:26.578300+0000","last_unstale":"2024-09-15T23:22:26.579577+0000","last_undegraded":"2024-09-15T23:22:26.579577+0000","last_fullsized":"2024-09-15T23:22:26.579577+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:20:01.080774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.562721+0000","last_change":"2024-09-15T23:22:25.572154+0000","last_active":"2024-09-15T23:22:27.562721+0000","last_peered":"2024-09-15T23:22:27.562721+0000","last_clean":"2024-09-15T23:22:27.562721+0000","last_became_active":"2024-09-15T23:22:25.571908+0000","last_became_peered":"2024-09-15T23:22:25.571908+0000","last_unstale":"2024-09-15T23:22:27.562721+0000","last_undegraded":"2024-09-15T23:22:27.562721+0000","last_fullsized":"2024-09-15T23:22:27.562721+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:05:42.576540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":469,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.985762+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:22:27.985762+0000","last_peered":"2024-09-15T23:22:27.985762+0000","last_clean":"2024-09-15T23:22:27.985762+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:22:27.985762+0000","last_undegraded":"2024-09-15T23:22:27.985762+0000","last_fullsized":"2024-09-15T23:22:27.985762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":104,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476867,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59796,"kb_used_data":2236,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312044,"statfs":{"total":96636764160,"available":96575533056,"internally_reserved":0,"allocated":2289664,"data_stored":1010088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55608,"kb_used_data":2212,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316232,"statfs":{"total":96636764160,"available":96579821568,"internally_reserved":0,"allocated":2265088,"data_stored":1002176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476866,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56200,"kb_used_data":2800,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315640,"statfs":{"total":96636764160,"available":96579215360,"internally_reserved":0,"allocated":2867200,"data_stored":1598774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476866,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47308,"kb_used_data":2228,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324532,"statfs":{"total":96636764160,"available":96588320768,"internally_reserved":0,"allocated":2281472,"data_stored":1009022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542272,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51428,"kb_used_data":2196,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320412,"statfs":{"total":96636764160,"available":96584101888,"internally_reserved":0,"allocated":2248704,"data_stored":995331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542272,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55600,"kb_used_data":2196,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316240,"statfs":{"total":96636764160,"available":96579829760,"internally_reserved":0,"allocated":2248704,"data_stored":995331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542271,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60332,"kb_used_data":2776,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311508,"statfs":{"total":96636764160,"available":96574984192,"internally_reserved":0,"allocated":2842624,"data_stored":1585699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542273,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55592,"kb_used_data":2196,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316248,"statfs":{"total":96636764160,"available":96579837952,"internally_reserved":0,"allocated":2248704,"data_stored":995331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:22:31.844 INFO:tasks.ceph.mds.d.smithi188.stderr:2024-09-15T23:22:31.843+0000 7f3067fe7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:22:33.871 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:22:33.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.980+0000 7f56ee19f640 1 Processor -- start 2024-09-15T23:22:33.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.981+0000 7f56ee19f640 1 -- start start 2024-09-15T23:22:33.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.981+0000 7f56ee19f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56e815e4c0 0x7f56e80cef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:33.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.981+0000 7f56ee19f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f56e8162b70 0x7f56e80b6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:33.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.982+0000 7f56ee19f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56e80cf5e0 con 0x7f56e80b65c0 2024-09-15T23:22:33.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.982+0000 7f56ee19f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f56e80b69f0 con 0x7f56e8162b70 2024-09-15T23:22:33.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.982+0000 7f56ee19f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f56e80cf8c0 con 0x7f56e815e4c0 2024-09-15T23:22:33.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.982+0000 7f56ec99c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f56e8162b70 0x7f56e80b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:33.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.982+0000 7f56ec99c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f56e8162b70 0x7f56e80b6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35548/0 (socket says 172.21.15.123:35548) 2024-09-15T23:22:33.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.982+0000 7f56ec99c640 1 -- 172.21.15.123:0/713828918 learned_addr learned my addr 172.21.15.123:0/713828918 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:33.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.982+0000 7f56ed19d640 1 --2- 172.21.15.123:0/713828918 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56e815e4c0 0x7f56e80cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:33.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.982+0000 7f56ec99c640 1 -- 172.21.15.123:0/713828918 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56e815e4c0 msgr2=0x7f56e80cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:33.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.982+0000 7f56ec99c640 1 --2- 172.21.15.123:0/713828918 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56e815e4c0 0x7f56e80cef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:33.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.982+0000 7f56ec99c640 1 -- 172.21.15.123:0/713828918 >> v1:172.21.15.188:6789/0 conn(0x7f56e80b65c0 legacy=0x7f56e806be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:33.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.982+0000 7f56ec99c640 1 -- 172.21.15.123:0/713828918 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e80d2980 con 0x7f56e8162b70 2024-09-15T23:22:33.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.982+0000 7f56ed19d640 1 --2- 172.21.15.123:0/713828918 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56e815e4c0 0x7f56e80cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:22:33.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.983+0000 7f56ec99c640 1 --2- 172.21.15.123:0/713828918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56e8162b70 0x7f56e80b6080 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7f56dc009870 tx=0x7f56dc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc4e2810ed23096 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:33.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.983+0000 7f56dbfff640 1 -- 172.21.15.123:0/713828918 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56dc037070 con 0x7f56e8162b70 2024-09-15T23:22:33.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.983+0000 7f56dbfff640 1 -- 172.21.15.123:0/713828918 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56dc032440 con 0x7f56e8162b70 2024-09-15T23:22:33.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.983+0000 7f56dbfff640 1 -- 172.21.15.123:0/713828918 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56dc032810 con 0x7f56e8162b70 2024-09-15T23:22:33.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.983+0000 7f56ee19f640 1 -- 172.21.15.123:0/713828918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56e8162b70 msgr2=0x7f56e80b6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:33.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.983+0000 7f56ee19f640 1 --2- 172.21.15.123:0/713828918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56e8162b70 0x7f56e80b6080 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7f56dc009870 tx=0x7f56dc02a210 comp rx=0 tx=0).stop 2024-09-15T23:22:33.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.984+0000 7f56ee19f640 1 -- 172.21.15.123:0/713828918 shutdown_connections 2024-09-15T23:22:33.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.984+0000 7f56ee19f640 1 --2- 172.21.15.123:0/713828918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56e8162b70 0x7f56e80b6080 unknown :-1 s=CLOSED pgs=2099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:33.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.984+0000 7f56ee19f640 1 --2- 172.21.15.123:0/713828918 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56e815e4c0 0x7f56e80cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:33.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.984+0000 7f56ee19f640 1 -- 172.21.15.123:0/713828918 >> 172.21.15.123:0/713828918 conn(0x7f56e80d1080 msgr2=0x7f56e80d1460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:33.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.984+0000 7f56ee19f640 1 -- 172.21.15.123:0/713828918 shutdown_connections 2024-09-15T23:22:33.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.984+0000 7f56ee19f640 1 -- 172.21.15.123:0/713828918 wait complete. 2024-09-15T23:22:33.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.985+0000 7f56ee19f640 1 Processor -- start 2024-09-15T23:22:33.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.985+0000 7f56ee19f640 1 -- start start 2024-09-15T23:22:33.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.986+0000 7f56ee19f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56e80b65c0 0x7f56e80c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:33.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.986+0000 7f56ee19f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f56e815e4c0 0x7f56e814abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:33.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.986+0000 7f56ee19f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56e8162b70 0x7f56e814a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:33.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.986+0000 7f56ee19f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f56e80cfba0 con 0x7f56e80b65c0 2024-09-15T23:22:33.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.986+0000 7f56ee19f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f56e8162fd0 con 0x7f56e815e4c0 2024-09-15T23:22:33.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.986+0000 7f56ee19f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f56e815e8a0 con 0x7f56e8162b70 2024-09-15T23:22:33.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.986+0000 7f56ed19d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56e80b65c0 0x7f56e80c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:33.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.986+0000 7f56ed19d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56e80b65c0 0x7f56e80c8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35560/0 (socket says 172.21.15.123:35560) 2024-09-15T23:22:33.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.986+0000 7f56ed19d640 1 -- 172.21.15.123:0/3816237477 learned_addr learned my addr 172.21.15.123:0/3816237477 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:33.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.986+0000 7f56ec99c640 1 --2- 172.21.15.123:0/3816237477 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f56e815e4c0 0x7f56e814abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:33.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.986+0000 7f56ed99e640 1 --2- 172.21.15.123:0/3816237477 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56e8162b70 0x7f56e814a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:33.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.986+0000 7f56ed19d640 1 -- 172.21.15.123:0/3816237477 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56e8162b70 msgr2=0x7f56e814a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:33.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.986+0000 7f56ed19d640 1 --2- 172.21.15.123:0/3816237477 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56e8162b70 0x7f56e814a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:33.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.986+0000 7f56ed19d640 1 -- 172.21.15.123:0/3816237477 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f56e815e4c0 msgr2=0x7f56e814abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:33.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.986+0000 7f56ed19d640 1 --2- 172.21.15.123:0/3816237477 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f56e815e4c0 0x7f56e814abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:33.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.986+0000 7f56ed19d640 1 -- 172.21.15.123:0/3816237477 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e814b110 con 0x7f56e80b65c0 2024-09-15T23:22:33.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.986+0000 7f56ed99e640 1 --2- 172.21.15.123:0/3816237477 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56e8162b70 0x7f56e814a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:22:33.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.986+0000 7f56ec99c640 1 --2- 172.21.15.123:0/3816237477 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f56e815e4c0 0x7f56e814abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:33.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.986+0000 7f56ed19d640 1 --2- 172.21.15.123:0/3816237477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56e80b65c0 0x7f56e80c8910 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7f56e400c7f0 tx=0x7f56e400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:33.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.986+0000 7f56d9ffb640 1 -- 172.21.15.123:0/3816237477 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e4015070 con 0x7f56e80b65c0 2024-09-15T23:22:33.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.986+0000 7f56d9ffb640 1 -- 172.21.15.123:0/3816237477 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56e4007a30 con 0x7f56e80b65c0 2024-09-15T23:22:33.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.986+0000 7f56d9ffb640 1 -- 172.21.15.123:0/3816237477 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e4007e00 con 0x7f56e80b65c0 2024-09-15T23:22:33.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.986+0000 7f56ee19f640 1 -- 172.21.15.123:0/3816237477 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56e8161ec0 con 0x7f56e80b65c0 2024-09-15T23:22:33.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.987+0000 7f56ee19f640 1 -- 172.21.15.123:0/3816237477 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56e81e8390 con 0x7f56e80b65c0 2024-09-15T23:22:33.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.988+0000 7f56ee19f640 1 -- 172.21.15.123:0/3816237477 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56e80cef50 con 0x7f56e80b65c0 2024-09-15T23:22:33.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.988+0000 7f56d9ffb640 1 -- 172.21.15.123:0/3816237477 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f56e4018070 con 0x7f56e80b65c0 2024-09-15T23:22:33.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.988+0000 7f56d9ffb640 1 --2- 172.21.15.123:0/3816237477 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f56cc06c2b0 0x7f56cc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:33.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.989+0000 7f56d9ffb640 1 -- 172.21.15.123:0/3816237477 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f56e408b3e0 con 0x7f56e80b65c0 2024-09-15T23:22:33.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.989+0000 7f56ec99c640 1 --2- 172.21.15.123:0/3816237477 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f56cc06c2b0 0x7f56cc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:33.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.989+0000 7f56ec99c640 1 --2- 172.21.15.123:0/3816237477 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f56cc06c2b0 0x7f56cc06e770 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f56dc034000 tx=0x7f56dc02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:33.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:33.993+0000 7f56d9ffb640 1 -- 172.21.15.123:0/3816237477 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f56e4059b60 con 0x7f56e80b65c0 2024-09-15T23:22:34.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.154+0000 7f56ee19f640 1 -- 172.21.15.123:0/3816237477 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f56e80ba580 con 0x7f56cc06c2b0 2024-09-15T23:22:34.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.160+0000 7f56d9ffb640 1 -- 172.21.15.123:0/3816237477 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252428 (secure 0 0 0) 0x7f56dc07fa20 con 0x7f56cc06c2b0 2024-09-15T23:22:34.163 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:22:34.165 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:22:34.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.163+0000 7f56ee19f640 1 -- 172.21.15.123:0/3816237477 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f56cc06c2b0 msgr2=0x7f56cc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:34.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.163+0000 7f56ee19f640 1 --2- 172.21.15.123:0/3816237477 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f56cc06c2b0 0x7f56cc06e770 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f56dc034000 tx=0x7f56dc02e000 comp rx=0 tx=0).stop 2024-09-15T23:22:34.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.163+0000 7f56ee19f640 1 -- 172.21.15.123:0/3816237477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56e80b65c0 msgr2=0x7f56e80c8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:34.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.163+0000 7f56ee19f640 1 --2- 172.21.15.123:0/3816237477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56e80b65c0 0x7f56e80c8910 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7f56e400c7f0 tx=0x7f56e400cbf0 comp rx=0 tx=0).stop 2024-09-15T23:22:34.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.163+0000 7f56ee19f640 1 -- 172.21.15.123:0/3816237477 shutdown_connections 2024-09-15T23:22:34.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.163+0000 7f56ee19f640 1 --2- 172.21.15.123:0/3816237477 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f56e8162b70 0x7f56e814a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:34.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.163+0000 7f56ee19f640 1 --2- 172.21.15.123:0/3816237477 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f56e815e4c0 0x7f56e814abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:34.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.163+0000 7f56ee19f640 1 --2- 172.21.15.123:0/3816237477 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f56cc06c2b0 0x7f56cc06e770 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:34.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.163+0000 7f56ee19f640 1 --2- 172.21.15.123:0/3816237477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56e80b65c0 0x7f56e80c8910 unknown :-1 s=CLOSED pgs=2100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:34.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.163+0000 7f56ee19f640 1 -- 172.21.15.123:0/3816237477 >> 172.21.15.123:0/3816237477 conn(0x7f56e80d1080 msgr2=0x7f56e80d4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:34.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.163+0000 7f56ee19f640 1 -- 172.21.15.123:0/3816237477 shutdown_connections 2024-09-15T23:22:34.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.163+0000 7f56ee19f640 1 -- 172.21.15.123:0/3816237477 wait complete. 2024-09-15T23:22:34.175 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":491,"stamp":"2024-09-15T23:22:33.651765+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":442024,"kb_used_data":18984,"kb_used_omap":12,"kb_used_meta":422835,"kb_avail":754532696,"statfs":{"total":773094113280,"available":772641480704,"internally_reserved":0,"allocated":19439616,"data_stored":9252804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":432983600},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002080"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563494+0000","last_change":"2024-09-15T23:22:26.576654+0000","last_active":"2024-09-15T23:22:27.563494+0000","last_peered":"2024-09-15T23:22:27.563494+0000","last_clean":"2024-09-15T23:22:27.563494+0000","last_became_active":"2024-09-15T23:22:26.576393+0000","last_became_peered":"2024-09-15T23:22:26.576393+0000","last_unstale":"2024-09-15T23:22:27.563494+0000","last_undegraded":"2024-09-15T23:22:27.563494+0000","last_fullsized":"2024-09-15T23:22:27.563494+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:26:11.370324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.986158+0000","last_change":"2024-09-15T23:22:26.579287+0000","last_active":"2024-09-15T23:22:27.986158+0000","last_peered":"2024-09-15T23:22:27.986158+0000","last_clean":"2024-09-15T23:22:27.986158+0000","last_became_active":"2024-09-15T23:22:26.579010+0000","last_became_peered":"2024-09-15T23:22:26.579010+0000","last_unstale":"2024-09-15T23:22:27.986158+0000","last_undegraded":"2024-09-15T23:22:27.986158+0000","last_fullsized":"2024-09-15T23:22:27.986158+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:43:21.190640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.584109+0000","last_change":"2024-09-15T23:22:26.577028+0000","last_active":"2024-09-15T23:22:27.584109+0000","last_peered":"2024-09-15T23:22:27.584109+0000","last_clean":"2024-09-15T23:22:27.584109+0000","last_became_active":"2024-09-15T23:22:26.576357+0000","last_became_peered":"2024-09-15T23:22:26.576357+0000","last_unstale":"2024-09-15T23:22:27.584109+0000","last_undegraded":"2024-09-15T23:22:27.584109+0000","last_fullsized":"2024-09-15T23:22:27.584109+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:05:08.352908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.986050+0000","last_change":"2024-09-15T23:22:26.579531+0000","last_active":"2024-09-15T23:22:27.986050+0000","last_peered":"2024-09-15T23:22:27.986050+0000","last_clean":"2024-09-15T23:22:27.986050+0000","last_became_active":"2024-09-15T23:22:26.579239+0000","last_became_peered":"2024-09-15T23:22:26.579239+0000","last_unstale":"2024-09-15T23:22:27.986050+0000","last_undegraded":"2024-09-15T23:22:27.986050+0000","last_fullsized":"2024-09-15T23:22:27.986050+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:02:40.164216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.564204+0000","last_change":"2024-09-15T23:22:26.587123+0000","last_active":"2024-09-15T23:22:27.564204+0000","last_peered":"2024-09-15T23:22:27.564204+0000","last_clean":"2024-09-15T23:22:27.564204+0000","last_became_active":"2024-09-15T23:22:26.585826+0000","last_became_peered":"2024-09-15T23:22:26.585826+0000","last_unstale":"2024-09-15T23:22:27.564204+0000","last_undegraded":"2024-09-15T23:22:27.564204+0000","last_fullsized":"2024-09-15T23:22:27.564204+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:45.562391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:28.129210+0000","last_change":"2024-09-15T23:22:26.580389+0000","last_active":"2024-09-15T23:22:28.129210+0000","last_peered":"2024-09-15T23:22:28.129210+0000","last_clean":"2024-09-15T23:22:28.129210+0000","last_became_active":"2024-09-15T23:22:26.579875+0000","last_became_peered":"2024-09-15T23:22:26.579875+0000","last_unstale":"2024-09-15T23:22:28.129210+0000","last_undegraded":"2024-09-15T23:22:28.129210+0000","last_fullsized":"2024-09-15T23:22:28.129210+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:44:19.192658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:28.129375+0000","last_change":"2024-09-15T23:22:26.572953+0000","last_active":"2024-09-15T23:22:28.129375+0000","last_peered":"2024-09-15T23:22:28.129375+0000","last_clean":"2024-09-15T23:22:28.129375+0000","last_became_active":"2024-09-15T23:22:26.572610+0000","last_became_peered":"2024-09-15T23:22:26.572610+0000","last_unstale":"2024-09-15T23:22:28.129375+0000","last_undegraded":"2024-09-15T23:22:28.129375+0000","last_fullsized":"2024-09-15T23:22:28.129375+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:51.710387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563653+0000","last_change":"2024-09-15T23:22:26.587968+0000","last_active":"2024-09-15T23:22:27.563653+0000","last_peered":"2024-09-15T23:22:27.563653+0000","last_clean":"2024-09-15T23:22:27.563653+0000","last_became_active":"2024-09-15T23:22:26.585474+0000","last_became_peered":"2024-09-15T23:22:26.585474+0000","last_unstale":"2024-09-15T23:22:27.563653+0000","last_undegraded":"2024-09-15T23:22:27.563653+0000","last_fullsized":"2024-09-15T23:22:27.563653+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:36:28.224296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.986186+0000","last_change":"2024-09-15T23:22:26.581016+0000","last_active":"2024-09-15T23:22:27.986186+0000","last_peered":"2024-09-15T23:22:27.986186+0000","last_clean":"2024-09-15T23:22:27.986186+0000","last_became_active":"2024-09-15T23:22:26.580740+0000","last_became_peered":"2024-09-15T23:22:26.580740+0000","last_unstale":"2024-09-15T23:22:27.986186+0000","last_undegraded":"2024-09-15T23:22:27.986186+0000","last_fullsized":"2024-09-15T23:22:27.986186+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:23:24.794531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.586461+0000","last_change":"2024-09-15T23:22:26.581325+0000","last_active":"2024-09-15T23:22:27.586461+0000","last_peered":"2024-09-15T23:22:27.586461+0000","last_clean":"2024-09-15T23:22:27.586461+0000","last_became_active":"2024-09-15T23:22:26.581025+0000","last_became_peered":"2024-09-15T23:22:26.581025+0000","last_unstale":"2024-09-15T23:22:27.586461+0000","last_undegraded":"2024-09-15T23:22:27.586461+0000","last_fullsized":"2024-09-15T23:22:27.586461+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:14.534581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563019+0000","last_change":"2024-09-15T23:22:26.574870+0000","last_active":"2024-09-15T23:22:27.563019+0000","last_peered":"2024-09-15T23:22:27.563019+0000","last_clean":"2024-09-15T23:22:27.563019+0000","last_became_active":"2024-09-15T23:22:26.574579+0000","last_became_peered":"2024-09-15T23:22:26.574579+0000","last_unstale":"2024-09-15T23:22:27.563019+0000","last_undegraded":"2024-09-15T23:22:27.563019+0000","last_fullsized":"2024-09-15T23:22:27.563019+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:42:03.421717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.562887+0000","last_change":"2024-09-15T23:22:26.573762+0000","last_active":"2024-09-15T23:22:27.562887+0000","last_peered":"2024-09-15T23:22:27.562887+0000","last_clean":"2024-09-15T23:22:27.562887+0000","last_became_active":"2024-09-15T23:22:26.571383+0000","last_became_peered":"2024-09-15T23:22:26.571383+0000","last_unstale":"2024-09-15T23:22:27.562887+0000","last_undegraded":"2024-09-15T23:22:27.562887+0000","last_fullsized":"2024-09-15T23:22:27.562887+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:42.282972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563296+0000","last_change":"2024-09-15T23:22:26.571287+0000","last_active":"2024-09-15T23:22:27.563296+0000","last_peered":"2024-09-15T23:22:27.563296+0000","last_clean":"2024-09-15T23:22:27.563296+0000","last_became_active":"2024-09-15T23:22:26.570992+0000","last_became_peered":"2024-09-15T23:22:26.570992+0000","last_unstale":"2024-09-15T23:22:27.563296+0000","last_undegraded":"2024-09-15T23:22:27.563296+0000","last_fullsized":"2024-09-15T23:22:27.563296+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:19:58.188543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.985969+0000","last_change":"2024-09-15T23:22:26.576051+0000","last_active":"2024-09-15T23:22:27.985969+0000","last_peered":"2024-09-15T23:22:27.985969+0000","last_clean":"2024-09-15T23:22:27.985969+0000","last_became_active":"2024-09-15T23:22:26.575761+0000","last_became_peered":"2024-09-15T23:22:26.575761+0000","last_unstale":"2024-09-15T23:22:27.985969+0000","last_undegraded":"2024-09-15T23:22:27.985969+0000","last_fullsized":"2024-09-15T23:22:27.985969+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:42.993876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563151+0000","last_change":"2024-09-15T23:22:26.574261+0000","last_active":"2024-09-15T23:22:27.563151+0000","last_peered":"2024-09-15T23:22:27.563151+0000","last_clean":"2024-09-15T23:22:27.563151+0000","last_became_active":"2024-09-15T23:22:26.573988+0000","last_became_peered":"2024-09-15T23:22:26.573988+0000","last_unstale":"2024-09-15T23:22:27.563151+0000","last_undegraded":"2024-09-15T23:22:27.563151+0000","last_fullsized":"2024-09-15T23:22:27.563151+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:03:56.300826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.583876+0000","last_change":"2024-09-15T23:22:26.567832+0000","last_active":"2024-09-15T23:22:27.583876+0000","last_peered":"2024-09-15T23:22:27.583876+0000","last_clean":"2024-09-15T23:22:27.583876+0000","last_became_active":"2024-09-15T23:22:26.567505+0000","last_became_peered":"2024-09-15T23:22:26.567505+0000","last_unstale":"2024-09-15T23:22:27.583876+0000","last_undegraded":"2024-09-15T23:22:27.583876+0000","last_fullsized":"2024-09-15T23:22:27.583876+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:38:31.689155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:28.129582+0000","last_change":"2024-09-15T23:22:26.575007+0000","last_active":"2024-09-15T23:22:28.129582+0000","last_peered":"2024-09-15T23:22:28.129582+0000","last_clean":"2024-09-15T23:22:28.129582+0000","last_became_active":"2024-09-15T23:22:26.573900+0000","last_became_peered":"2024-09-15T23:22:26.573900+0000","last_unstale":"2024-09-15T23:22:28.129582+0000","last_undegraded":"2024-09-15T23:22:28.129582+0000","last_fullsized":"2024-09-15T23:22:28.129582+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:14.379794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:28.129650+0000","last_change":"2024-09-15T23:22:26.580243+0000","last_active":"2024-09-15T23:22:28.129650+0000","last_peered":"2024-09-15T23:22:28.129650+0000","last_clean":"2024-09-15T23:22:28.129650+0000","last_became_active":"2024-09-15T23:22:26.579566+0000","last_became_peered":"2024-09-15T23:22:26.579566+0000","last_unstale":"2024-09-15T23:22:28.129650+0000","last_undegraded":"2024-09-15T23:22:28.129650+0000","last_fullsized":"2024-09-15T23:22:28.129650+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:12.991092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.584177+0000","last_change":"2024-09-15T23:22:26.577138+0000","last_active":"2024-09-15T23:22:27.584177+0000","last_peered":"2024-09-15T23:22:27.584177+0000","last_clean":"2024-09-15T23:22:27.584177+0000","last_became_active":"2024-09-15T23:22:26.574892+0000","last_became_peered":"2024-09-15T23:22:26.574892+0000","last_unstale":"2024-09-15T23:22:27.584177+0000","last_undegraded":"2024-09-15T23:22:27.584177+0000","last_fullsized":"2024-09-15T23:22:27.584177+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:34:39.221787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.564650+0000","last_change":"2024-09-15T23:22:26.581119+0000","last_active":"2024-09-15T23:22:27.564650+0000","last_peered":"2024-09-15T23:22:27.564650+0000","last_clean":"2024-09-15T23:22:27.564650+0000","last_became_active":"2024-09-15T23:22:26.580871+0000","last_became_peered":"2024-09-15T23:22:26.580871+0000","last_unstale":"2024-09-15T23:22:27.564650+0000","last_undegraded":"2024-09-15T23:22:27.564650+0000","last_fullsized":"2024-09-15T23:22:27.564650+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:50.916622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.583917+0000","last_change":"2024-09-15T23:22:26.575475+0000","last_active":"2024-09-15T23:22:27.583917+0000","last_peered":"2024-09-15T23:22:27.583917+0000","last_clean":"2024-09-15T23:22:27.583917+0000","last_became_active":"2024-09-15T23:22:26.575072+0000","last_became_peered":"2024-09-15T23:22:26.575072+0000","last_unstale":"2024-09-15T23:22:27.583917+0000","last_undegraded":"2024-09-15T23:22:27.583917+0000","last_fullsized":"2024-09-15T23:22:27.583917+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:09.759797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563988+0000","last_change":"2024-09-15T23:22:26.588661+0000","last_active":"2024-09-15T23:22:27.563988+0000","last_peered":"2024-09-15T23:22:27.563988+0000","last_clean":"2024-09-15T23:22:27.563988+0000","last_became_active":"2024-09-15T23:22:26.585342+0000","last_became_peered":"2024-09-15T23:22:26.585342+0000","last_unstale":"2024-09-15T23:22:27.563988+0000","last_undegraded":"2024-09-15T23:22:27.563988+0000","last_fullsized":"2024-09-15T23:22:27.563988+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:42.282972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.586184+0000","last_change":"2024-09-15T23:22:26.582408+0000","last_active":"2024-09-15T23:22:27.586184+0000","last_peered":"2024-09-15T23:22:27.586184+0000","last_clean":"2024-09-15T23:22:27.586184+0000","last_became_active":"2024-09-15T23:22:26.582126+0000","last_became_peered":"2024-09-15T23:22:26.582126+0000","last_unstale":"2024-09-15T23:22:27.586184+0000","last_undegraded":"2024-09-15T23:22:27.586184+0000","last_fullsized":"2024-09-15T23:22:27.586184+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:25:43.855863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563648+0000","last_change":"2024-09-15T23:22:26.583113+0000","last_active":"2024-09-15T23:22:27.563648+0000","last_peered":"2024-09-15T23:22:27.563648+0000","last_clean":"2024-09-15T23:22:27.563648+0000","last_became_active":"2024-09-15T23:22:26.582600+0000","last_became_peered":"2024-09-15T23:22:26.582600+0000","last_unstale":"2024-09-15T23:22:27.563648+0000","last_undegraded":"2024-09-15T23:22:27.563648+0000","last_fullsized":"2024-09-15T23:22:27.563648+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:11:34.410061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.986222+0000","last_change":"2024-09-15T23:22:26.574747+0000","last_active":"2024-09-15T23:22:27.986222+0000","last_peered":"2024-09-15T23:22:27.986222+0000","last_clean":"2024-09-15T23:22:27.986222+0000","last_became_active":"2024-09-15T23:22:26.574496+0000","last_became_peered":"2024-09-15T23:22:26.574496+0000","last_unstale":"2024-09-15T23:22:27.986222+0000","last_undegraded":"2024-09-15T23:22:27.986222+0000","last_fullsized":"2024-09-15T23:22:27.986222+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:48.899103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.562879+0000","last_change":"2024-09-15T23:22:26.575300+0000","last_active":"2024-09-15T23:22:27.562879+0000","last_peered":"2024-09-15T23:22:27.562879+0000","last_clean":"2024-09-15T23:22:27.562879+0000","last_became_active":"2024-09-15T23:22:26.575032+0000","last_became_peered":"2024-09-15T23:22:26.575032+0000","last_unstale":"2024-09-15T23:22:27.562879+0000","last_undegraded":"2024-09-15T23:22:27.562879+0000","last_fullsized":"2024-09-15T23:22:27.562879+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:44.667091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.584288+0000","last_change":"2024-09-15T23:22:26.576639+0000","last_active":"2024-09-15T23:22:27.584288+0000","last_peered":"2024-09-15T23:22:27.584288+0000","last_clean":"2024-09-15T23:22:27.584288+0000","last_became_active":"2024-09-15T23:22:26.575205+0000","last_became_peered":"2024-09-15T23:22:26.575205+0000","last_unstale":"2024-09-15T23:22:27.584288+0000","last_undegraded":"2024-09-15T23:22:27.584288+0000","last_fullsized":"2024-09-15T23:22:27.584288+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:07:13.582498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.586416+0000","last_change":"2024-09-15T23:22:26.576356+0000","last_active":"2024-09-15T23:22:27.586416+0000","last_peered":"2024-09-15T23:22:27.586416+0000","last_clean":"2024-09-15T23:22:27.586416+0000","last_became_active":"2024-09-15T23:22:26.576081+0000","last_became_peered":"2024-09-15T23:22:26.576081+0000","last_unstale":"2024-09-15T23:22:27.586416+0000","last_undegraded":"2024-09-15T23:22:27.586416+0000","last_fullsized":"2024-09-15T23:22:27.586416+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:25:50.013362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.562894+0000","last_change":"2024-09-15T23:22:26.571980+0000","last_active":"2024-09-15T23:22:27.562894+0000","last_peered":"2024-09-15T23:22:27.562894+0000","last_clean":"2024-09-15T23:22:27.562894+0000","last_became_active":"2024-09-15T23:22:26.571547+0000","last_became_peered":"2024-09-15T23:22:26.571547+0000","last_unstale":"2024-09-15T23:22:27.562894+0000","last_undegraded":"2024-09-15T23:22:27.562894+0000","last_fullsized":"2024-09-15T23:22:27.562894+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:40:24.288085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563009+0000","last_change":"2024-09-15T23:22:26.573500+0000","last_active":"2024-09-15T23:22:27.563009+0000","last_peered":"2024-09-15T23:22:27.563009+0000","last_clean":"2024-09-15T23:22:27.563009+0000","last_became_active":"2024-09-15T23:22:26.573213+0000","last_became_peered":"2024-09-15T23:22:26.573213+0000","last_unstale":"2024-09-15T23:22:27.563009+0000","last_undegraded":"2024-09-15T23:22:27.563009+0000","last_fullsized":"2024-09-15T23:22:27.563009+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:45.562391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563682+0000","last_change":"2024-09-15T23:22:26.587964+0000","last_active":"2024-09-15T23:22:27.563682+0000","last_peered":"2024-09-15T23:22:27.563682+0000","last_clean":"2024-09-15T23:22:27.563682+0000","last_became_active":"2024-09-15T23:22:26.587538+0000","last_became_peered":"2024-09-15T23:22:26.587538+0000","last_unstale":"2024-09-15T23:22:27.563682+0000","last_undegraded":"2024-09-15T23:22:27.563682+0000","last_fullsized":"2024-09-15T23:22:27.563682+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:55:18.940179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563889+0000","last_change":"2024-09-15T23:22:26.587110+0000","last_active":"2024-09-15T23:22:27.563889+0000","last_peered":"2024-09-15T23:22:27.563889+0000","last_clean":"2024-09-15T23:22:27.563889+0000","last_became_active":"2024-09-15T23:22:26.585910+0000","last_became_peered":"2024-09-15T23:22:26.585910+0000","last_unstale":"2024-09-15T23:22:27.563889+0000","last_undegraded":"2024-09-15T23:22:27.563889+0000","last_fullsized":"2024-09-15T23:22:27.563889+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:03.748163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.564352+0000","last_change":"2024-09-15T23:22:26.582653+0000","last_active":"2024-09-15T23:22:27.564352+0000","last_peered":"2024-09-15T23:22:27.564352+0000","last_clean":"2024-09-15T23:22:27.564352+0000","last_became_active":"2024-09-15T23:22:26.581898+0000","last_became_peered":"2024-09-15T23:22:26.581898+0000","last_unstale":"2024-09-15T23:22:27.564352+0000","last_undegraded":"2024-09-15T23:22:27.564352+0000","last_fullsized":"2024-09-15T23:22:27.564352+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:43.656480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1f","version":"181'4","reported_seq":18,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.584253+0000","last_change":"2024-09-15T23:22:25.571785+0000","last_active":"2024-09-15T23:22:27.584253+0000","last_peered":"2024-09-15T23:22:27.584253+0000","last_clean":"2024-09-15T23:22:27.584253+0000","last_became_active":"2024-09-15T23:22:25.571482+0000","last_became_peered":"2024-09-15T23:22:25.571482+0000","last_unstale":"2024-09-15T23:22:27.584253+0000","last_undegraded":"2024-09-15T23:22:27.584253+0000","last_fullsized":"2024-09-15T23:22:27.584253+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:55:16.627253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.586555+0000","last_change":"2024-09-15T23:22:26.581429+0000","last_active":"2024-09-15T23:22:27.586555+0000","last_peered":"2024-09-15T23:22:27.586555+0000","last_clean":"2024-09-15T23:22:27.586555+0000","last_became_active":"2024-09-15T23:22:26.580652+0000","last_became_peered":"2024-09-15T23:22:26.580652+0000","last_unstale":"2024-09-15T23:22:27.586555+0000","last_undegraded":"2024-09-15T23:22:27.586555+0000","last_fullsized":"2024-09-15T23:22:27.586555+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:17.266524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1e","version":"181'1","reported_seq":15,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563060+0000","last_change":"2024-09-15T23:22:25.570459+0000","last_active":"2024-09-15T23:22:27.563060+0000","last_peered":"2024-09-15T23:22:27.563060+0000","last_clean":"2024-09-15T23:22:27.563060+0000","last_became_active":"2024-09-15T23:22:25.570185+0000","last_became_peered":"2024-09-15T23:22:25.570185+0000","last_unstale":"2024-09-15T23:22:27.563060+0000","last_undegraded":"2024-09-15T23:22:27.563060+0000","last_fullsized":"2024-09-15T23:22:27.563060+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:53:00.426242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.986062+0000","last_change":"2024-09-15T23:22:26.576480+0000","last_active":"2024-09-15T23:22:27.986062+0000","last_peered":"2024-09-15T23:22:27.986062+0000","last_clean":"2024-09-15T23:22:27.986062+0000","last_became_active":"2024-09-15T23:22:26.575599+0000","last_became_peered":"2024-09-15T23:22:26.575599+0000","last_unstale":"2024-09-15T23:22:27.986062+0000","last_undegraded":"2024-09-15T23:22:27.986062+0000","last_fullsized":"2024-09-15T23:22:27.986062+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:17:23.827041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"181'2","reported_seq":16,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.564297+0000","last_change":"2024-09-15T23:22:25.581273+0000","last_active":"2024-09-15T23:22:27.564297+0000","last_peered":"2024-09-15T23:22:27.564297+0000","last_clean":"2024-09-15T23:22:27.564297+0000","last_became_active":"2024-09-15T23:22:25.580975+0000","last_became_peered":"2024-09-15T23:22:25.580975+0000","last_unstale":"2024-09-15T23:22:27.564297+0000","last_undegraded":"2024-09-15T23:22:27.564297+0000","last_fullsized":"2024-09-15T23:22:27.564297+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:00:50.705677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.986205+0000","last_change":"2024-09-15T23:22:26.579120+0000","last_active":"2024-09-15T23:22:27.986205+0000","last_peered":"2024-09-15T23:22:27.986205+0000","last_clean":"2024-09-15T23:22:27.986205+0000","last_became_active":"2024-09-15T23:22:26.576159+0000","last_became_peered":"2024-09-15T23:22:26.576159+0000","last_unstale":"2024-09-15T23:22:27.986205+0000","last_undegraded":"2024-09-15T23:22:27.986205+0000","last_fullsized":"2024-09-15T23:22:27.986205+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:00:54.894412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1c","version":"181'2","reported_seq":16,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563523+0000","last_change":"2024-09-15T23:22:25.569211+0000","last_active":"2024-09-15T23:22:27.563523+0000","last_peered":"2024-09-15T23:22:27.563523+0000","last_clean":"2024-09-15T23:22:27.563523+0000","last_became_active":"2024-09-15T23:22:25.568965+0000","last_became_peered":"2024-09-15T23:22:25.568965+0000","last_unstale":"2024-09-15T23:22:27.563523+0000","last_undegraded":"2024-09-15T23:22:27.563523+0000","last_fullsized":"2024-09-15T23:22:27.563523+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:27.282812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:28.129267+0000","last_change":"2024-09-15T23:22:26.580161+0000","last_active":"2024-09-15T23:22:28.129267+0000","last_peered":"2024-09-15T23:22:28.129267+0000","last_clean":"2024-09-15T23:22:28.129267+0000","last_became_active":"2024-09-15T23:22:26.579508+0000","last_became_peered":"2024-09-15T23:22:26.579508+0000","last_unstale":"2024-09-15T23:22:28.129267+0000","last_undegraded":"2024-09-15T23:22:28.129267+0000","last_fullsized":"2024-09-15T23:22:28.129267+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:17:59.666527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1b","version":"181'1","reported_seq":15,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.564503+0000","last_change":"2024-09-15T23:22:25.581967+0000","last_active":"2024-09-15T23:22:27.564503+0000","last_peered":"2024-09-15T23:22:27.564503+0000","last_clean":"2024-09-15T23:22:27.564503+0000","last_became_active":"2024-09-15T23:22:25.581530+0000","last_became_peered":"2024-09-15T23:22:25.581530+0000","last_unstale":"2024-09-15T23:22:27.564503+0000","last_undegraded":"2024-09-15T23:22:27.564503+0000","last_fullsized":"2024-09-15T23:22:27.564503+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:27.111829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.564077+0000","last_change":"2024-09-15T23:22:26.587725+0000","last_active":"2024-09-15T23:22:27.564077+0000","last_peered":"2024-09-15T23:22:27.564077+0000","last_clean":"2024-09-15T23:22:27.564077+0000","last_became_active":"2024-09-15T23:22:26.587342+0000","last_became_peered":"2024-09-15T23:22:26.587342+0000","last_unstale":"2024-09-15T23:22:27.564077+0000","last_undegraded":"2024-09-15T23:22:27.564077+0000","last_fullsized":"2024-09-15T23:22:27.564077+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:51.710387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"181'1","reported_seq":15,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563971+0000","last_change":"2024-09-15T23:22:25.578495+0000","last_active":"2024-09-15T23:22:27.563971+0000","last_peered":"2024-09-15T23:22:27.563971+0000","last_clean":"2024-09-15T23:22:27.563971+0000","last_became_active":"2024-09-15T23:22:25.578014+0000","last_became_peered":"2024-09-15T23:22:25.578014+0000","last_unstale":"2024-09-15T23:22:27.563971+0000","last_undegraded":"2024-09-15T23:22:27.563971+0000","last_fullsized":"2024-09-15T23:22:27.563971+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:39:21.619939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563153+0000","last_change":"2024-09-15T23:22:26.582956+0000","last_active":"2024-09-15T23:22:27.563153+0000","last_peered":"2024-09-15T23:22:27.563153+0000","last_clean":"2024-09-15T23:22:27.563153+0000","last_became_active":"2024-09-15T23:22:26.582658+0000","last_became_peered":"2024-09-15T23:22:26.582658+0000","last_unstale":"2024-09-15T23:22:27.563153+0000","last_undegraded":"2024-09-15T23:22:27.563153+0000","last_fullsized":"2024-09-15T23:22:27.563153+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:48:01.666250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:28.129357+0000","last_change":"2024-09-15T23:22:25.573476+0000","last_active":"2024-09-15T23:22:28.129357+0000","last_peered":"2024-09-15T23:22:28.129357+0000","last_clean":"2024-09-15T23:22:28.129357+0000","last_became_active":"2024-09-15T23:22:25.573203+0000","last_became_peered":"2024-09-15T23:22:25.573203+0000","last_unstale":"2024-09-15T23:22:28.129357+0000","last_undegraded":"2024-09-15T23:22:28.129357+0000","last_fullsized":"2024-09-15T23:22:28.129357+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:43.661629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.584217+0000","last_change":"2024-09-15T23:22:26.573073+0000","last_active":"2024-09-15T23:22:27.584217+0000","last_peered":"2024-09-15T23:22:27.584217+0000","last_clean":"2024-09-15T23:22:27.584217+0000","last_became_active":"2024-09-15T23:22:26.572211+0000","last_became_peered":"2024-09-15T23:22:26.572211+0000","last_unstale":"2024-09-15T23:22:27.584217+0000","last_undegraded":"2024-09-15T23:22:27.584217+0000","last_fullsized":"2024-09-15T23:22:27.584217+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:29:49.161767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563476+0000","last_change":"2024-09-15T23:22:25.573132+0000","last_active":"2024-09-15T23:22:27.563476+0000","last_peered":"2024-09-15T23:22:27.563476+0000","last_clean":"2024-09-15T23:22:27.563476+0000","last_became_active":"2024-09-15T23:22:25.572496+0000","last_became_peered":"2024-09-15T23:22:25.572496+0000","last_unstale":"2024-09-15T23:22:27.563476+0000","last_undegraded":"2024-09-15T23:22:27.563476+0000","last_fullsized":"2024-09-15T23:22:27.563476+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:57.876840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.586642+0000","last_change":"2024-09-15T23:22:26.581186+0000","last_active":"2024-09-15T23:22:27.586642+0000","last_peered":"2024-09-15T23:22:27.586642+0000","last_clean":"2024-09-15T23:22:27.586642+0000","last_became_active":"2024-09-15T23:22:26.580278+0000","last_became_peered":"2024-09-15T23:22:26.580278+0000","last_unstale":"2024-09-15T23:22:27.586642+0000","last_undegraded":"2024-09-15T23:22:27.586642+0000","last_fullsized":"2024-09-15T23:22:27.586642+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:05:33.311333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.586596+0000","last_change":"2024-09-15T23:22:25.573560+0000","last_active":"2024-09-15T23:22:27.586596+0000","last_peered":"2024-09-15T23:22:27.586596+0000","last_clean":"2024-09-15T23:22:27.586596+0000","last_became_active":"2024-09-15T23:22:25.573270+0000","last_became_peered":"2024-09-15T23:22:25.573270+0000","last_unstale":"2024-09-15T23:22:27.586596+0000","last_undegraded":"2024-09-15T23:22:27.586596+0000","last_fullsized":"2024-09-15T23:22:27.586596+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:44.556930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563429+0000","last_change":"2024-09-15T23:22:26.576066+0000","last_active":"2024-09-15T23:22:27.563429+0000","last_peered":"2024-09-15T23:22:27.563429+0000","last_clean":"2024-09-15T23:22:27.563429+0000","last_became_active":"2024-09-15T23:22:26.575722+0000","last_became_peered":"2024-09-15T23:22:26.575722+0000","last_unstale":"2024-09-15T23:22:27.563429+0000","last_undegraded":"2024-09-15T23:22:27.563429+0000","last_fullsized":"2024-09-15T23:22:27.563429+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:51.710387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.15","version":"181'3","reported_seq":17,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.564406+0000","last_change":"2024-09-15T23:22:25.580281+0000","last_active":"2024-09-15T23:22:27.564406+0000","last_peered":"2024-09-15T23:22:27.564406+0000","last_clean":"2024-09-15T23:22:27.564406+0000","last_became_active":"2024-09-15T23:22:25.579966+0000","last_became_peered":"2024-09-15T23:22:25.579966+0000","last_unstale":"2024-09-15T23:22:27.564406+0000","last_undegraded":"2024-09-15T23:22:27.564406+0000","last_fullsized":"2024-09-15T23:22:27.564406+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:42:11.132878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.586492+0000","last_change":"2024-09-15T23:22:26.583487+0000","last_active":"2024-09-15T23:22:27.586492+0000","last_peered":"2024-09-15T23:22:27.586492+0000","last_clean":"2024-09-15T23:22:27.586492+0000","last_became_active":"2024-09-15T23:22:26.583191+0000","last_became_peered":"2024-09-15T23:22:26.583191+0000","last_unstale":"2024-09-15T23:22:27.586492+0000","last_undegraded":"2024-09-15T23:22:27.586492+0000","last_fullsized":"2024-09-15T23:22:27.586492+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:57.435960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.14","version":"181'6","reported_seq":20,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.564453+0000","last_change":"2024-09-15T23:22:25.582774+0000","last_active":"2024-09-15T23:22:27.564453+0000","last_peered":"2024-09-15T23:22:27.564453+0000","last_clean":"2024-09-15T23:22:27.564453+0000","last_became_active":"2024-09-15T23:22:25.582455+0000","last_became_peered":"2024-09-15T23:22:25.582455+0000","last_unstale":"2024-09-15T23:22:27.564453+0000","last_undegraded":"2024-09-15T23:22:27.564453+0000","last_fullsized":"2024-09-15T23:22:27.564453+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:13:58.026111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.586291+0000","last_change":"2024-09-15T23:22:26.579221+0000","last_active":"2024-09-15T23:22:27.586291+0000","last_peered":"2024-09-15T23:22:27.586291+0000","last_clean":"2024-09-15T23:22:27.586291+0000","last_became_active":"2024-09-15T23:22:26.578424+0000","last_became_peered":"2024-09-15T23:22:26.578424+0000","last_unstale":"2024-09-15T23:22:27.586291+0000","last_undegraded":"2024-09-15T23:22:27.586291+0000","last_fullsized":"2024-09-15T23:22:27.586291+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:16.761794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.13","version":"181'2","reported_seq":16,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.562990+0000","last_change":"2024-09-15T23:22:25.574790+0000","last_active":"2024-09-15T23:22:27.562990+0000","last_peered":"2024-09-15T23:22:27.562990+0000","last_clean":"2024-09-15T23:22:27.562990+0000","last_became_active":"2024-09-15T23:22:25.572871+0000","last_became_peered":"2024-09-15T23:22:25.572871+0000","last_unstale":"2024-09-15T23:22:27.562990+0000","last_undegraded":"2024-09-15T23:22:27.562990+0000","last_fullsized":"2024-09-15T23:22:27.562990+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:57:03.487060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:28.129624+0000","last_change":"2024-09-15T23:22:26.570568+0000","last_active":"2024-09-15T23:22:28.129624+0000","last_peered":"2024-09-15T23:22:28.129624+0000","last_clean":"2024-09-15T23:22:28.129624+0000","last_became_active":"2024-09-15T23:22:26.570294+0000","last_became_peered":"2024-09-15T23:22:26.570294+0000","last_unstale":"2024-09-15T23:22:28.129624+0000","last_undegraded":"2024-09-15T23:22:28.129624+0000","last_fullsized":"2024-09-15T23:22:28.129624+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:50.916622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.586283+0000","last_change":"2024-09-15T23:22:25.579017+0000","last_active":"2024-09-15T23:22:27.586283+0000","last_peered":"2024-09-15T23:22:27.586283+0000","last_clean":"2024-09-15T23:22:27.586283+0000","last_became_active":"2024-09-15T23:22:25.578734+0000","last_became_peered":"2024-09-15T23:22:25.578734+0000","last_unstale":"2024-09-15T23:22:27.586283+0000","last_undegraded":"2024-09-15T23:22:27.586283+0000","last_fullsized":"2024-09-15T23:22:27.586283+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:40:23.282623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.562723+0000","last_change":"2024-09-15T23:22:26.576304+0000","last_active":"2024-09-15T23:22:27.562723+0000","last_peered":"2024-09-15T23:22:27.562723+0000","last_clean":"2024-09-15T23:22:27.562723+0000","last_became_active":"2024-09-15T23:22:26.575471+0000","last_became_peered":"2024-09-15T23:22:26.575471+0000","last_unstale":"2024-09-15T23:22:27.562723+0000","last_undegraded":"2024-09-15T23:22:27.562723+0000","last_fullsized":"2024-09-15T23:22:27.562723+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:03.748163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.564281+0000","last_change":"2024-09-15T23:22:25.583097+0000","last_active":"2024-09-15T23:22:27.564281+0000","last_peered":"2024-09-15T23:22:27.564281+0000","last_clean":"2024-09-15T23:22:27.564281+0000","last_became_active":"2024-09-15T23:22:25.582619+0000","last_became_peered":"2024-09-15T23:22:25.582619+0000","last_unstale":"2024-09-15T23:22:27.564281+0000","last_undegraded":"2024-09-15T23:22:27.564281+0000","last_fullsized":"2024-09-15T23:22:27.564281+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:37:30.698864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.564099+0000","last_change":"2024-09-15T23:22:26.579456+0000","last_active":"2024-09-15T23:22:27.564099+0000","last_peered":"2024-09-15T23:22:27.564099+0000","last_clean":"2024-09-15T23:22:27.564099+0000","last_became_active":"2024-09-15T23:22:26.579149+0000","last_became_peered":"2024-09-15T23:22:26.579149+0000","last_unstale":"2024-09-15T23:22:27.564099+0000","last_undegraded":"2024-09-15T23:22:27.564099+0000","last_fullsized":"2024-09-15T23:22:27.564099+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:40:24.288085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.10","version":"181'8","reported_seq":22,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:28.129402+0000","last_change":"2024-09-15T23:22:25.571365+0000","last_active":"2024-09-15T23:22:28.129402+0000","last_peered":"2024-09-15T23:22:28.129402+0000","last_clean":"2024-09-15T23:22:28.129402+0000","last_became_active":"2024-09-15T23:22:25.571094+0000","last_became_peered":"2024-09-15T23:22:25.571094+0000","last_unstale":"2024-09-15T23:22:28.129402+0000","last_undegraded":"2024-09-15T23:22:28.129402+0000","last_fullsized":"2024-09-15T23:22:28.129402+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:41.277510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.586500+0000","last_change":"2024-09-15T23:22:26.579012+0000","last_active":"2024-09-15T23:22:27.586500+0000","last_peered":"2024-09-15T23:22:27.586500+0000","last_clean":"2024-09-15T23:22:27.586500+0000","last_became_active":"2024-09-15T23:22:26.578733+0000","last_became_peered":"2024-09-15T23:22:26.578733+0000","last_unstale":"2024-09-15T23:22:27.586500+0000","last_undegraded":"2024-09-15T23:22:27.586500+0000","last_fullsized":"2024-09-15T23:22:27.586500+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:08.039054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.f","version":"181'1","reported_seq":15,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.564306+0000","last_change":"2024-09-15T23:22:25.581794+0000","last_active":"2024-09-15T23:22:27.564306+0000","last_peered":"2024-09-15T23:22:27.564306+0000","last_clean":"2024-09-15T23:22:27.564306+0000","last_became_active":"2024-09-15T23:22:25.581463+0000","last_became_peered":"2024-09-15T23:22:25.581463+0000","last_unstale":"2024-09-15T23:22:27.564306+0000","last_undegraded":"2024-09-15T23:22:27.564306+0000","last_fullsized":"2024-09-15T23:22:27.564306+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:40:23.527619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563286+0000","last_change":"2024-09-15T23:22:26.585935+0000","last_active":"2024-09-15T23:22:27.563286+0000","last_peered":"2024-09-15T23:22:27.563286+0000","last_clean":"2024-09-15T23:22:27.563286+0000","last_became_active":"2024-09-15T23:22:26.585643+0000","last_became_peered":"2024-09-15T23:22:26.585643+0000","last_unstale":"2024-09-15T23:22:27.563286+0000","last_undegraded":"2024-09-15T23:22:27.563286+0000","last_fullsized":"2024-09-15T23:22:27.563286+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:43.656480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.e","version":"181'2","reported_seq":16,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:28.129464+0000","last_change":"2024-09-15T23:22:25.576185+0000","last_active":"2024-09-15T23:22:28.129464+0000","last_peered":"2024-09-15T23:22:28.129464+0000","last_clean":"2024-09-15T23:22:28.129464+0000","last_became_active":"2024-09-15T23:22:25.575627+0000","last_became_peered":"2024-09-15T23:22:25.575627+0000","last_unstale":"2024-09-15T23:22:28.129464+0000","last_undegraded":"2024-09-15T23:22:28.129464+0000","last_fullsized":"2024-09-15T23:22:28.129464+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:01:31.306518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.986215+0000","last_change":"2024-09-15T23:22:26.581845+0000","last_active":"2024-09-15T23:22:27.986215+0000","last_peered":"2024-09-15T23:22:27.986215+0000","last_clean":"2024-09-15T23:22:27.986215+0000","last_became_active":"2024-09-15T23:22:26.581503+0000","last_became_peered":"2024-09-15T23:22:26.581503+0000","last_unstale":"2024-09-15T23:22:27.986215+0000","last_undegraded":"2024-09-15T23:22:27.986215+0000","last_fullsized":"2024-09-15T23:22:27.986215+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:37:41.999085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.d","version":"181'1","reported_seq":15,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563012+0000","last_change":"2024-09-15T23:22:25.571321+0000","last_active":"2024-09-15T23:22:27.563012+0000","last_peered":"2024-09-15T23:22:27.563012+0000","last_clean":"2024-09-15T23:22:27.563012+0000","last_became_active":"2024-09-15T23:22:25.570992+0000","last_became_peered":"2024-09-15T23:22:25.570992+0000","last_unstale":"2024-09-15T23:22:27.563012+0000","last_undegraded":"2024-09-15T23:22:27.563012+0000","last_fullsized":"2024-09-15T23:22:27.563012+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:04.372195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563162+0000","last_change":"2024-09-15T23:22:26.578668+0000","last_active":"2024-09-15T23:22:27.563162+0000","last_peered":"2024-09-15T23:22:27.563162+0000","last_clean":"2024-09-15T23:22:27.563162+0000","last_became_active":"2024-09-15T23:22:26.578321+0000","last_became_peered":"2024-09-15T23:22:26.578321+0000","last_unstale":"2024-09-15T23:22:27.563162+0000","last_undegraded":"2024-09-15T23:22:27.563162+0000","last_fullsized":"2024-09-15T23:22:27.563162+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:51.939872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563376+0000","last_change":"2024-09-15T23:22:25.575239+0000","last_active":"2024-09-15T23:22:27.563376+0000","last_peered":"2024-09-15T23:22:27.563376+0000","last_clean":"2024-09-15T23:22:27.563376+0000","last_became_active":"2024-09-15T23:22:25.574930+0000","last_became_peered":"2024-09-15T23:22:25.574930+0000","last_unstale":"2024-09-15T23:22:27.563376+0000","last_undegraded":"2024-09-15T23:22:27.563376+0000","last_fullsized":"2024-09-15T23:22:27.563376+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:09:40.632139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:28.129491+0000","last_change":"2024-09-15T23:22:26.572799+0000","last_active":"2024-09-15T23:22:28.129491+0000","last_peered":"2024-09-15T23:22:28.129491+0000","last_clean":"2024-09-15T23:22:28.129491+0000","last_became_active":"2024-09-15T23:22:26.572539+0000","last_became_peered":"2024-09-15T23:22:26.572539+0000","last_unstale":"2024-09-15T23:22:28.129491+0000","last_undegraded":"2024-09-15T23:22:28.129491+0000","last_fullsized":"2024-09-15T23:22:28.129491+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:25:01.528553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.b","version":"181'2","reported_seq":16,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.564606+0000","last_change":"2024-09-15T23:22:25.580246+0000","last_active":"2024-09-15T23:22:27.564606+0000","last_peered":"2024-09-15T23:22:27.564606+0000","last_clean":"2024-09-15T23:22:27.564606+0000","last_became_active":"2024-09-15T23:22:25.579936+0000","last_became_peered":"2024-09-15T23:22:25.579936+0000","last_unstale":"2024-09-15T23:22:27.564606+0000","last_undegraded":"2024-09-15T23:22:27.564606+0000","last_fullsized":"2024-09-15T23:22:27.564606+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:16:51.335262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:28.129629+0000","last_change":"2024-09-15T23:22:26.572247+0000","last_active":"2024-09-15T23:22:28.129629+0000","last_peered":"2024-09-15T23:22:28.129629+0000","last_clean":"2024-09-15T23:22:28.129629+0000","last_became_active":"2024-09-15T23:22:26.571874+0000","last_became_peered":"2024-09-15T23:22:26.571874+0000","last_unstale":"2024-09-15T23:22:28.129629+0000","last_undegraded":"2024-09-15T23:22:28.129629+0000","last_fullsized":"2024-09-15T23:22:28.129629+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:17.131723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:28.129391+0000","last_change":"2024-09-15T23:22:25.577475+0000","last_active":"2024-09-15T23:22:28.129391+0000","last_peered":"2024-09-15T23:22:28.129391+0000","last_clean":"2024-09-15T23:22:28.129391+0000","last_became_active":"2024-09-15T23:22:25.577195+0000","last_became_peered":"2024-09-15T23:22:25.577195+0000","last_unstale":"2024-09-15T23:22:28.129391+0000","last_undegraded":"2024-09-15T23:22:28.129391+0000","last_fullsized":"2024-09-15T23:22:28.129391+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:30:09.611603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563196+0000","last_change":"2024-09-15T23:22:26.577654+0000","last_active":"2024-09-15T23:22:27.563196+0000","last_peered":"2024-09-15T23:22:27.563196+0000","last_clean":"2024-09-15T23:22:27.563196+0000","last_became_active":"2024-09-15T23:22:26.577344+0000","last_became_peered":"2024-09-15T23:22:26.577344+0000","last_unstale":"2024-09-15T23:22:27.563196+0000","last_undegraded":"2024-09-15T23:22:27.563196+0000","last_fullsized":"2024-09-15T23:22:27.563196+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:23:24.318992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:28.129109+0000","last_change":"2024-09-15T23:22:25.576650+0000","last_active":"2024-09-15T23:22:28.129109+0000","last_peered":"2024-09-15T23:22:28.129109+0000","last_clean":"2024-09-15T23:22:28.129109+0000","last_became_active":"2024-09-15T23:22:25.576362+0000","last_became_peered":"2024-09-15T23:22:25.576362+0000","last_unstale":"2024-09-15T23:22:28.129109+0000","last_undegraded":"2024-09-15T23:22:28.129109+0000","last_fullsized":"2024-09-15T23:22:28.129109+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:00:27.234261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.586346+0000","last_change":"2024-09-15T23:22:26.580637+0000","last_active":"2024-09-15T23:22:27.586346+0000","last_peered":"2024-09-15T23:22:27.586346+0000","last_clean":"2024-09-15T23:22:27.586346+0000","last_became_active":"2024-09-15T23:22:26.580301+0000","last_became_peered":"2024-09-15T23:22:26.580301+0000","last_unstale":"2024-09-15T23:22:27.586346+0000","last_undegraded":"2024-09-15T23:22:27.586346+0000","last_fullsized":"2024-09-15T23:22:27.586346+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:18.499748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563278+0000","last_change":"2024-09-15T23:22:25.571376+0000","last_active":"2024-09-15T23:22:27.563278+0000","last_peered":"2024-09-15T23:22:27.563278+0000","last_clean":"2024-09-15T23:22:27.563278+0000","last_became_active":"2024-09-15T23:22:25.571006+0000","last_became_peered":"2024-09-15T23:22:25.571006+0000","last_unstale":"2024-09-15T23:22:27.563278+0000","last_undegraded":"2024-09-15T23:22:27.563278+0000","last_fullsized":"2024-09-15T23:22:27.563278+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:05.631862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.584229+0000","last_change":"2024-09-15T23:22:26.581001+0000","last_active":"2024-09-15T23:22:27.584229+0000","last_peered":"2024-09-15T23:22:27.584229+0000","last_clean":"2024-09-15T23:22:27.584229+0000","last_became_active":"2024-09-15T23:22:26.580287+0000","last_became_peered":"2024-09-15T23:22:26.580287+0000","last_unstale":"2024-09-15T23:22:27.584229+0000","last_undegraded":"2024-09-15T23:22:27.584229+0000","last_fullsized":"2024-09-15T23:22:27.584229+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:26:49.573870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.7","version":"181'2","reported_seq":16,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563566+0000","last_change":"2024-09-15T23:22:25.573610+0000","last_active":"2024-09-15T23:22:27.563566+0000","last_peered":"2024-09-15T23:22:27.563566+0000","last_clean":"2024-09-15T23:22:27.563566+0000","last_became_active":"2024-09-15T23:22:25.573342+0000","last_became_peered":"2024-09-15T23:22:25.573342+0000","last_unstale":"2024-09-15T23:22:27.563566+0000","last_undegraded":"2024-09-15T23:22:27.563566+0000","last_fullsized":"2024-09-15T23:22:27.563566+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:08.553326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.584253+0000","last_change":"2024-09-15T23:22:26.578188+0000","last_active":"2024-09-15T23:22:27.584253+0000","last_peered":"2024-09-15T23:22:27.584253+0000","last_clean":"2024-09-15T23:22:27.584253+0000","last_became_active":"2024-09-15T23:22:26.577930+0000","last_became_peered":"2024-09-15T23:22:26.577930+0000","last_unstale":"2024-09-15T23:22:27.584253+0000","last_undegraded":"2024-09-15T23:22:27.584253+0000","last_fullsized":"2024-09-15T23:22:27.584253+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:35.916003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"182'1","reported_seq":15,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.584380+0000","last_change":"2024-09-15T23:22:25.575025+0000","last_active":"2024-09-15T23:22:27.584380+0000","last_peered":"2024-09-15T23:22:27.584380+0000","last_clean":"2024-09-15T23:22:27.584380+0000","last_became_active":"2024-09-15T23:22:25.574715+0000","last_became_peered":"2024-09-15T23:22:25.574715+0000","last_unstale":"2024-09-15T23:22:27.584380+0000","last_undegraded":"2024-09-15T23:22:27.584380+0000","last_fullsized":"2024-09-15T23:22:27.584380+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:26.917144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.583996+0000","last_change":"2024-09-15T23:22:26.586301+0000","last_active":"2024-09-15T23:22:27.583996+0000","last_peered":"2024-09-15T23:22:27.583996+0000","last_clean":"2024-09-15T23:22:27.583996+0000","last_became_active":"2024-09-15T23:22:26.586022+0000","last_became_peered":"2024-09-15T23:22:26.586022+0000","last_unstale":"2024-09-15T23:22:27.583996+0000","last_undegraded":"2024-09-15T23:22:27.583996+0000","last_fullsized":"2024-09-15T23:22:27.583996+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:54:37.980199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.584312+0000","last_change":"2024-09-15T23:22:25.576386+0000","last_active":"2024-09-15T23:22:27.584312+0000","last_peered":"2024-09-15T23:22:27.584312+0000","last_clean":"2024-09-15T23:22:27.584312+0000","last_became_active":"2024-09-15T23:22:25.574655+0000","last_became_peered":"2024-09-15T23:22:25.574655+0000","last_unstale":"2024-09-15T23:22:27.584312+0000","last_undegraded":"2024-09-15T23:22:27.584312+0000","last_fullsized":"2024-09-15T23:22:27.584312+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:00:02.848434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.564221+0000","last_change":"2024-09-15T23:22:26.585622+0000","last_active":"2024-09-15T23:22:27.564221+0000","last_peered":"2024-09-15T23:22:27.564221+0000","last_clean":"2024-09-15T23:22:27.564221+0000","last_became_active":"2024-09-15T23:22:26.585295+0000","last_became_peered":"2024-09-15T23:22:26.585295+0000","last_unstale":"2024-09-15T23:22:27.564221+0000","last_undegraded":"2024-09-15T23:22:27.564221+0000","last_fullsized":"2024-09-15T23:22:27.564221+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:51.939872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.564574+0000","last_change":"2024-09-15T23:22:25.582743+0000","last_active":"2024-09-15T23:22:27.564574+0000","last_peered":"2024-09-15T23:22:27.564574+0000","last_clean":"2024-09-15T23:22:27.564574+0000","last_became_active":"2024-09-15T23:22:25.582439+0000","last_became_peered":"2024-09-15T23:22:25.582439+0000","last_unstale":"2024-09-15T23:22:27.564574+0000","last_undegraded":"2024-09-15T23:22:27.564574+0000","last_fullsized":"2024-09-15T23:22:27.564574+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:40:45.831574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.985888+0000","last_change":"2024-09-15T23:22:26.586161+0000","last_active":"2024-09-15T23:22:27.985888+0000","last_peered":"2024-09-15T23:22:27.985888+0000","last_clean":"2024-09-15T23:22:27.985888+0000","last_became_active":"2024-09-15T23:22:26.585670+0000","last_became_peered":"2024-09-15T23:22:26.585670+0000","last_unstale":"2024-09-15T23:22:27.985888+0000","last_undegraded":"2024-09-15T23:22:27.985888+0000","last_fullsized":"2024-09-15T23:22:27.985888+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:02:02.362109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.985935+0000","last_change":"2024-09-15T23:22:25.574571+0000","last_active":"2024-09-15T23:22:27.985935+0000","last_peered":"2024-09-15T23:22:27.985935+0000","last_clean":"2024-09-15T23:22:27.985935+0000","last_became_active":"2024-09-15T23:22:25.574287+0000","last_became_peered":"2024-09-15T23:22:25.574287+0000","last_unstale":"2024-09-15T23:22:27.985935+0000","last_undegraded":"2024-09-15T23:22:27.985935+0000","last_fullsized":"2024-09-15T23:22:27.985935+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:25:39.683578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563363+0000","last_change":"2024-09-15T23:22:26.572903+0000","last_active":"2024-09-15T23:22:27.563363+0000","last_peered":"2024-09-15T23:22:27.563363+0000","last_clean":"2024-09-15T23:22:27.563363+0000","last_became_active":"2024-09-15T23:22:26.572625+0000","last_became_peered":"2024-09-15T23:22:26.572625+0000","last_unstale":"2024-09-15T23:22:27.563363+0000","last_undegraded":"2024-09-15T23:22:27.563363+0000","last_fullsized":"2024-09-15T23:22:27.563363+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:42:23.881842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.985998+0000","last_change":"2024-09-15T23:22:25.572720+0000","last_active":"2024-09-15T23:22:27.985998+0000","last_peered":"2024-09-15T23:22:27.985998+0000","last_clean":"2024-09-15T23:22:27.985998+0000","last_became_active":"2024-09-15T23:22:25.572239+0000","last_became_peered":"2024-09-15T23:22:25.572239+0000","last_unstale":"2024-09-15T23:22:27.985998+0000","last_undegraded":"2024-09-15T23:22:27.985998+0000","last_fullsized":"2024-09-15T23:22:27.985998+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:08:53.636567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.985897+0000","last_change":"2024-09-15T23:22:26.576393+0000","last_active":"2024-09-15T23:22:27.985897+0000","last_peered":"2024-09-15T23:22:27.985897+0000","last_clean":"2024-09-15T23:22:27.985897+0000","last_became_active":"2024-09-15T23:22:26.575901+0000","last_became_peered":"2024-09-15T23:22:26.575901+0000","last_unstale":"2024-09-15T23:22:27.985897+0000","last_undegraded":"2024-09-15T23:22:27.985897+0000","last_fullsized":"2024-09-15T23:22:27.985897+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:46:00.263978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.985843+0000","last_change":"2024-09-15T23:22:25.572258+0000","last_active":"2024-09-15T23:22:27.985843+0000","last_peered":"2024-09-15T23:22:27.985843+0000","last_clean":"2024-09-15T23:22:27.985843+0000","last_became_active":"2024-09-15T23:22:25.572005+0000","last_became_peered":"2024-09-15T23:22:25.572005+0000","last_unstale":"2024-09-15T23:22:27.985843+0000","last_undegraded":"2024-09-15T23:22:27.985843+0000","last_fullsized":"2024-09-15T23:22:27.985843+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:42:51.728926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.563963+0000","last_change":"2024-09-15T23:22:26.580413+0000","last_active":"2024-09-15T23:22:27.563963+0000","last_peered":"2024-09-15T23:22:27.563963+0000","last_clean":"2024-09-15T23:22:27.563963+0000","last_became_active":"2024-09-15T23:22:26.580139+0000","last_became_peered":"2024-09-15T23:22:26.580139+0000","last_unstale":"2024-09-15T23:22:27.563963+0000","last_undegraded":"2024-09-15T23:22:27.563963+0000","last_fullsized":"2024-09-15T23:22:27.563963+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:44.667091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:28.129161+0000","last_change":"2024-09-15T23:22:25.574211+0000","last_active":"2024-09-15T23:22:28.129161+0000","last_peered":"2024-09-15T23:22:28.129161+0000","last_clean":"2024-09-15T23:22:28.129161+0000","last_became_active":"2024-09-15T23:22:25.573828+0000","last_became_peered":"2024-09-15T23:22:25.573828+0000","last_unstale":"2024-09-15T23:22:28.129161+0000","last_undegraded":"2024-09-15T23:22:28.129161+0000","last_fullsized":"2024-09-15T23:22:28.129161+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:23:53.008952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":12,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:28.129211+0000","last_change":"2024-09-15T23:22:26.578711+0000","last_active":"2024-09-15T23:22:28.129211+0000","last_peered":"2024-09-15T23:22:28.129211+0000","last_clean":"2024-09-15T23:22:28.129211+0000","last_became_active":"2024-09-15T23:22:26.578300+0000","last_became_peered":"2024-09-15T23:22:26.578300+0000","last_unstale":"2024-09-15T23:22:28.129211+0000","last_undegraded":"2024-09-15T23:22:28.129211+0000","last_fullsized":"2024-09-15T23:22:28.129211+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:25.556310+0000","last_clean_scrub_stamp":"2024-09-15T23:22:25.556310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:46.415739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":14,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.562721+0000","last_change":"2024-09-15T23:22:25.572154+0000","last_active":"2024-09-15T23:22:27.562721+0000","last_peered":"2024-09-15T23:22:27.562721+0000","last_clean":"2024-09-15T23:22:27.562721+0000","last_became_active":"2024-09-15T23:22:25.571908+0000","last_became_peered":"2024-09-15T23:22:25.571908+0000","last_unstale":"2024-09-15T23:22:27.562721+0000","last_undegraded":"2024-09-15T23:22:27.562721+0000","last_fullsized":"2024-09-15T23:22:27.562721+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:22:24.550849+0000","last_clean_scrub_stamp":"2024-09-15T23:22:24.550849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:05:42.576540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":469,"reported_epoch":182,"state":"active+clean","last_fresh":"2024-09-15T23:22:27.985762+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:22:27.985762+0000","last_peered":"2024-09-15T23:22:27.985762+0000","last_clean":"2024-09-15T23:22:27.985762+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:22:27.985762+0000","last_undegraded":"2024-09-15T23:22:27.985762+0000","last_fullsized":"2024-09-15T23:22:27.985762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476868,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59796,"kb_used_data":2236,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312044,"statfs":{"total":96636764160,"available":96575533056,"internally_reserved":0,"allocated":2289664,"data_stored":1010088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55624,"kb_used_data":2224,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316216,"statfs":{"total":96636764160,"available":96579805184,"internally_reserved":0,"allocated":2277376,"data_stored":1008476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476867,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56200,"kb_used_data":2800,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315640,"statfs":{"total":96636764160,"available":96579215360,"internally_reserved":0,"allocated":2867200,"data_stored":1598774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47308,"kb_used_data":2228,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324532,"statfs":{"total":96636764160,"available":96588320768,"internally_reserved":0,"allocated":2281472,"data_stored":1009022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542273,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51480,"kb_used_data":2240,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320360,"statfs":{"total":96636764160,"available":96584048640,"internally_reserved":0,"allocated":2293760,"data_stored":1010130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542273,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55624,"kb_used_data":2224,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316216,"statfs":{"total":96636764160,"available":96579805184,"internally_reserved":0,"allocated":2277376,"data_stored":1008496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542272,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60372,"kb_used_data":2808,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311468,"statfs":{"total":96636764160,"available":96574943232,"internally_reserved":0,"allocated":2875392,"data_stored":1599378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542274,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55620,"kb_used_data":2224,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316220,"statfs":{"total":96636764160,"available":96579809280,"internally_reserved":0,"allocated":2277376,"data_stored":1008440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:22:34.179 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T23:22:34.179 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T23:22:34.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.321+0000 7f21ed754640 1 Processor -- start 2024-09-15T23:22:34.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.321+0000 7f21ed754640 1 -- start start 2024-09-15T23:22:34.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.322+0000 7f21ed754640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f21e806bfd0 0x7f21e806c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:34.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.322+0000 7f21ed754640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f21e80b3350 0x7f21e81623a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:34.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.322+0000 7f21ed754640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21e80b38a0 0x7f21e81628e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:34.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.322+0000 7f21ed754640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f21e80b78a0 con 0x7f21e806bfd0 2024-09-15T23:22:34.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.322+0000 7f21ed754640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f21e80cffb0 con 0x7f21e80b3350 2024-09-15T23:22:34.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.322+0000 7f21ed754640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f21e806c8f0 con 0x7f21e80b38a0 2024-09-15T23:22:34.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.322+0000 7f21e6ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f21e806bfd0 0x7f21e806c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:34.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.322+0000 7f21e6ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f21e806bfd0 0x7f21e806c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35574/0 (socket says 172.21.15.123:35574) 2024-09-15T23:22:34.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.322+0000 7f21e6ffd640 1 -- 172.21.15.123:0/2516685631 learned_addr learned my addr 172.21.15.123:0/2516685631 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:34.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.322+0000 7f21e6ffd640 1 -- 172.21.15.123:0/2516685631 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21e80b38a0 msgr2=0x7f21e81628e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:34.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.322+0000 7f21e6ffd640 1 --2- 172.21.15.123:0/2516685631 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21e80b38a0 0x7f21e81628e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:34.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.322+0000 7f21e6ffd640 1 -- 172.21.15.123:0/2516685631 >> v2:172.21.15.188:3300/0 conn(0x7f21e80b3350 msgr2=0x7f21e81623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:34.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.322+0000 7f21e6ffd640 1 --2- 172.21.15.123:0/2516685631 >> v2:172.21.15.188:3300/0 conn(0x7f21e80b3350 0x7f21e81623a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:34.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.322+0000 7f21e6ffd640 1 -- 172.21.15.123:0/2516685631 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e80cf710 con 0x7f21e806bfd0 2024-09-15T23:22:34.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.323+0000 7f21e6ffd640 1 --2- 172.21.15.123:0/2516685631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21e806bfd0 0x7f21e806c3b0 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 crypto rx=0x7f21e80d05e0 tx=0x7f21d802a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77fad022870394c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:34.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.323+0000 7f21e5ffb640 1 -- 172.21.15.123:0/2516685631 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d8036070 con 0x7f21e806bfd0 2024-09-15T23:22:34.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.323+0000 7f21e5ffb640 1 -- 172.21.15.123:0/2516685631 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21d8031600 con 0x7f21e806bfd0 2024-09-15T23:22:34.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.323+0000 7f21e5ffb640 1 -- 172.21.15.123:0/2516685631 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d80319d0 con 0x7f21e806bfd0 2024-09-15T23:22:34.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.324+0000 7f21ed754640 1 -- 172.21.15.123:0/2516685631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21e806bfd0 msgr2=0x7f21e806c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:34.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.324+0000 7f21ed754640 1 --2- 172.21.15.123:0/2516685631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21e806bfd0 0x7f21e806c3b0 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 crypto rx=0x7f21e80d05e0 tx=0x7f21d802a750 comp rx=0 tx=0).stop 2024-09-15T23:22:34.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.324+0000 7f21ed754640 1 -- 172.21.15.123:0/2516685631 shutdown_connections 2024-09-15T23:22:34.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.324+0000 7f21ed754640 1 --2- 172.21.15.123:0/2516685631 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21e80b38a0 0x7f21e81628e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:34.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.324+0000 7f21ed754640 1 --2- 172.21.15.123:0/2516685631 >> v2:172.21.15.188:3300/0 conn(0x7f21e80b3350 0x7f21e81623a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:34.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.324+0000 7f21ed754640 1 --2- 172.21.15.123:0/2516685631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21e806bfd0 0x7f21e806c3b0 unknown :-1 s=CLOSED pgs=2101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:34.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.324+0000 7f21ed754640 1 -- 172.21.15.123:0/2516685631 >> 172.21.15.123:0/2516685631 conn(0x7f21e80d11c0 msgr2=0x7f21e80d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:34.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.324+0000 7f21ed754640 1 -- 172.21.15.123:0/2516685631 shutdown_connections 2024-09-15T23:22:34.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.324+0000 7f21ed754640 1 -- 172.21.15.123:0/2516685631 wait complete. 2024-09-15T23:22:34.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.325+0000 7f21ed754640 1 Processor -- start 2024-09-15T23:22:34.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.325+0000 7f21ed754640 1 -- start start 2024-09-15T23:22:34.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.326+0000 7f21ed754640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21e806bfd0 0x7f21e80cee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:34.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.326+0000 7f21ed754640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21e80b3350 0x7f21e8159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:34.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.326+0000 7f21ed754640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f21e80b38a0 0x7f21e815a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:34.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.326+0000 7f21ed754640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f21e80d2400 con 0x7f21e80b3350 2024-09-15T23:22:34.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.326+0000 7f21ed754640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f21e80cfcd0 con 0x7f21e80b38a0 2024-09-15T23:22:34.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.326+0000 7f21ed754640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f21e806cd50 con 0x7f21e806bfd0 2024-09-15T23:22:34.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.326+0000 7f21e67fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21e80b3350 0x7f21e8159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:34.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.326+0000 7f21e67fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21e80b3350 0x7f21e8159e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35584/0 (socket says 172.21.15.123:35584) 2024-09-15T23:22:34.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.326+0000 7f21e67fc640 1 -- 172.21.15.123:0/3358996994 learned_addr learned my addr 172.21.15.123:0/3358996994 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:34.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.326+0000 7f21e67fc640 1 -- 172.21.15.123:0/3358996994 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21e806bfd0 msgr2=0x7f21e80cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:34.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.326+0000 7f21e6ffd640 1 --2- 172.21.15.123:0/3358996994 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21e806bfd0 0x7f21e80cee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:34.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.326+0000 7f21e67fc640 1 --2- 172.21.15.123:0/3358996994 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21e806bfd0 0x7f21e80cee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:34.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.326+0000 7f21e67fc640 1 -- 172.21.15.123:0/3358996994 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f21e80b38a0 msgr2=0x7f21e815a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:34.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.326+0000 7f21e77fe640 1 --2- 172.21.15.123:0/3358996994 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f21e80b38a0 0x7f21e815a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:34.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.326+0000 7f21e67fc640 1 --2- 172.21.15.123:0/3358996994 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f21e80b38a0 0x7f21e815a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:34.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.326+0000 7f21e67fc640 1 -- 172.21.15.123:0/3358996994 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e8160060 con 0x7f21e80b3350 2024-09-15T23:22:34.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.327+0000 7f21e67fc640 1 --2- 172.21.15.123:0/3358996994 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21e80b3350 0x7f21e8159e90 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7f21dc00b4a0 tx=0x7f21dc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:34.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.327+0000 7f21cf7fe640 1 -- 172.21.15.123:0/3358996994 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21dc014070 con 0x7f21e80b3350 2024-09-15T23:22:34.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.327+0000 7f21cf7fe640 1 -- 172.21.15.123:0/3358996994 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21dc010610 con 0x7f21e80b3350 2024-09-15T23:22:34.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.327+0000 7f21ed754640 1 -- 172.21.15.123:0/3358996994 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21e81f5c70 con 0x7f21e80b3350 2024-09-15T23:22:34.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.327+0000 7f21cf7fe640 1 -- 172.21.15.123:0/3358996994 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21dc010a00 con 0x7f21e80b3350 2024-09-15T23:22:34.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.327+0000 7f21ed754640 1 -- 172.21.15.123:0/3358996994 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21e8157c40 con 0x7f21e80b3350 2024-09-15T23:22:34.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.328+0000 7f21ed754640 1 -- 172.21.15.123:0/3358996994 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21e815eae0 con 0x7f21e80b3350 2024-09-15T23:22:34.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.328+0000 7f21cf7fe640 1 -- 172.21.15.123:0/3358996994 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f21dc017070 con 0x7f21e80b3350 2024-09-15T23:22:34.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.329+0000 7f21cf7fe640 1 --2- 172.21.15.123:0/3358996994 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f21d406c2b0 0x7f21d406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:34.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.329+0000 7f21cf7fe640 1 -- 172.21.15.123:0/3358996994 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f21dc08ae10 con 0x7f21e80b3350 2024-09-15T23:22:34.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.329+0000 7f21e6ffd640 1 --2- 172.21.15.123:0/3358996994 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f21d406c2b0 0x7f21d406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:34.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.330+0000 7f21e6ffd640 1 --2- 172.21.15.123:0/3358996994 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f21d406c2b0 0x7f21d406e770 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f21d8033000 tx=0x7f21d8009000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:34.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.333+0000 7f21cf7fe640 1 -- 172.21.15.123:0/3358996994 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f21dc059610 con 0x7f21e80b3350 2024-09-15T23:22:34.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.565+0000 7f21ed754640 1 -- 172.21.15.123:0/3358996994 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f21e80cb540 con 0x7f21e80b3350 2024-09-15T23:22:34.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.567+0000 7f21cf7fe640 1 -- 172.21.15.123:0/3358996994 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) ==== 190+0+147 (secure 0 0 0) 0x7f21dc058f10 con 0x7f21e80b3350 2024-09-15T23:22:34.568 INFO:teuthology.orchestra.run.smithi123.stdout:[client.0] 2024-09-15T23:22:34.569 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCNaedmzQPqJRAAhUf1dnVYohN4obCfeu8+7g== 2024-09-15T23:22:34.569 INFO:teuthology.orchestra.run.smithi123.stdout: caps mds = "allow" 2024-09-15T23:22:34.569 INFO:teuthology.orchestra.run.smithi123.stdout: caps mon = "allow r" 2024-09-15T23:22:34.569 INFO:teuthology.orchestra.run.smithi123.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T23:22:34.569 INFO:teuthology.orchestra.run.smithi123.stderr:updated caps for client.0 2024-09-15T23:22:34.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.569+0000 7f21ed754640 1 -- 172.21.15.123:0/3358996994 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f21d406c2b0 msgr2=0x7f21d406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:34.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.569+0000 7f21ed754640 1 --2- 172.21.15.123:0/3358996994 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f21d406c2b0 0x7f21d406e770 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f21d8033000 tx=0x7f21d8009000 comp rx=0 tx=0).stop 2024-09-15T23:22:34.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.569+0000 7f21ed754640 1 -- 172.21.15.123:0/3358996994 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21e80b3350 msgr2=0x7f21e8159e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:34.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.569+0000 7f21ed754640 1 --2- 172.21.15.123:0/3358996994 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21e80b3350 0x7f21e8159e90 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7f21dc00b4a0 tx=0x7f21dc00b960 comp rx=0 tx=0).stop 2024-09-15T23:22:34.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.569+0000 7f21ed754640 1 -- 172.21.15.123:0/3358996994 shutdown_connections 2024-09-15T23:22:34.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.569+0000 7f21ed754640 1 --2- 172.21.15.123:0/3358996994 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f21e80b38a0 0x7f21e815a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:34.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.569+0000 7f21ed754640 1 --2- 172.21.15.123:0/3358996994 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f21d406c2b0 0x7f21d406e770 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:34.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.569+0000 7f21ed754640 1 --2- 172.21.15.123:0/3358996994 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21e80b3350 0x7f21e8159e90 unknown :-1 s=CLOSED pgs=2102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:34.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.569+0000 7f21ed754640 1 --2- 172.21.15.123:0/3358996994 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f21e806bfd0 0x7f21e80cee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:34.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.570+0000 7f21ed754640 1 -- 172.21.15.123:0/3358996994 >> 172.21.15.123:0/3358996994 conn(0x7f21e80d11c0 msgr2=0x7f21e80b40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:34.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.570+0000 7f21ed754640 1 -- 172.21.15.123:0/3358996994 shutdown_connections 2024-09-15T23:22:34.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.570+0000 7f21ed754640 1 -- 172.21.15.123:0/3358996994 wait complete. 2024-09-15T23:22:34.583 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:22:34.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.679+0000 7f5754be8640 1 Processor -- start 2024-09-15T23:22:34.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.679+0000 7f5754be8640 1 -- start start 2024-09-15T23:22:34.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.680+0000 7f5754be8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f5750073890 0x7f57500b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:34.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.680+0000 7f5754be8640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57500b4020 con 0x7f5750145ed0 2024-09-15T23:22:34.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.680+0000 7f5754be8640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57500b42c0 con 0x7f57500b5880 2024-09-15T23:22:34.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.680+0000 7f5754be8640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f57500b63f0 con 0x7f5750073890 2024-09-15T23:22:34.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.680+0000 7f574e59c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f5750145ed0 0x7f5750073180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36808/0 (socket says 172.21.15.123:36808) 2024-09-15T23:22:34.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.680+0000 7f574e59c640 1 -- 172.21.15.123:0/4228368068 learned_addr learned my addr 172.21.15.123:0/4228368068 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:34.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.680+0000 7f574d59a640 1 -- 172.21.15.123:0/4228368068 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3731124858 0 0) 0x7f57500b4020 con 0x7f5750145ed0 2024-09-15T23:22:34.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.680+0000 7f574d59a640 1 -- 172.21.15.123:0/4228368068 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5738003520 con 0x7f5750145ed0 2024-09-15T23:22:34.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.680+0000 7f574dd9b640 1 --2- 172.21.15.123:0/4228368068 >> v2:172.21.15.188:3300/0 conn(0x7f5750073890 0x7f57500b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:34.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.680+0000 7f574d59a640 1 -- 172.21.15.123:0/4228368068 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1583892638 0 0) 0x7f5738003520 con 0x7f5750145ed0 2024-09-15T23:22:34.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.680+0000 7f574d59a640 1 -- 172.21.15.123:0/4228368068 >> v2:172.21.15.188:3300/0 conn(0x7f5750073890 msgr2=0x7f57500b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:34.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.680+0000 7f574d59a640 1 --2- 172.21.15.123:0/4228368068 >> v2:172.21.15.188:3300/0 conn(0x7f5750073890 0x7f57500b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:34.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.680+0000 7f574d59a640 1 -- 172.21.15.123:0/4228368068 >> v1:172.21.15.188:6789/0 conn(0x7f57500b5880 legacy=0x7f57500b5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:34.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.681+0000 7f574d59a640 1 -- 172.21.15.123:0/4228368068 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57500b45a0 con 0x7f5750145ed0 2024-09-15T23:22:34.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.681+0000 7f574d59a640 1 -- 172.21.15.123:0/4228368068 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f5740001690 con 0x7f5750145ed0 2024-09-15T23:22:34.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.681+0000 7f574d59a640 1 -- 172.21.15.123:0/4228368068 >> v1:172.21.15.123:6789/0 conn(0x7f5750145ed0 legacy=0x7f5750073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:34.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.681+0000 7f574d59a640 1 --2- 172.21.15.123:0/4228368068 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f57380039b0 0x7f5738003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:34.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.681+0000 7f574d59a640 1 --2- 172.21.15.123:0/4228368068 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5738004800 0x7f5738004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:34.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.681+0000 7f574d59a640 1 --2- 172.21.15.123:0/4228368068 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f57380051c0 0x7f573800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:34.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.681+0000 7f574d59a640 1 -- 172.21.15.123:0/4228368068 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f573800c030 con 0x7f5738004800 2024-09-15T23:22:34.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.681+0000 7f574d59a640 1 -- 172.21.15.123:0/4228368068 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f573800c1e0 con 0x7f57380051c0 2024-09-15T23:22:34.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.681+0000 7f574d59a640 1 -- 172.21.15.123:0/4228368068 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f573800c3e0 con 0x7f57380039b0 2024-09-15T23:22:34.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.681+0000 7f574dd9b640 1 --2- 172.21.15.123:0/4228368068 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5738004800 0x7f5738004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:34.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.681+0000 7f574ed9d640 1 --2- 172.21.15.123:0/4228368068 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f57380051c0 0x7f573800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:34.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.681+0000 7f574e59c640 1 --2- 172.21.15.123:0/4228368068 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f57380039b0 0x7f5738003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:34.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.681+0000 7f574dd9b640 1 -- 172.21.15.123:0/4228368068 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f57380039b0 msgr2=0x7f5738003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:34.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.681+0000 7f574dd9b640 1 --2- 172.21.15.123:0/4228368068 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f57380039b0 0x7f5738003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:34.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.681+0000 7f574dd9b640 1 -- 172.21.15.123:0/4228368068 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f57380051c0 msgr2=0x7f573800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:34.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.681+0000 7f574dd9b640 1 --2- 172.21.15.123:0/4228368068 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f57380051c0 0x7f573800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:34.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.681+0000 7f574dd9b640 1 -- 172.21.15.123:0/4228368068 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5738003520 con 0x7f5738004800 2024-09-15T23:22:34.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.681+0000 7f574ed9d640 1 --2- 172.21.15.123:0/4228368068 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f57380051c0 0x7f573800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:34.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.681+0000 7f574ed9d640 1 -- 172.21.15.123:0/4228368068 reap_dead start 2024-09-15T23:22:34.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.682+0000 7f574dd9b640 1 --2- 172.21.15.123:0/4228368068 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5738004800 0x7f5738004c80 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 crypto rx=0x7f5744009ac0 tx=0x7f5738005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96fbdd2586fa83c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:34.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.682+0000 7f574d59a640 1 -- 172.21.15.123:0/4228368068 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5744036070 con 0x7f5738004800 2024-09-15T23:22:34.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.682+0000 7f574d59a640 1 -- 172.21.15.123:0/4228368068 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5744031400 con 0x7f5738004800 2024-09-15T23:22:34.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.682+0000 7f574d59a640 1 -- 172.21.15.123:0/4228368068 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5744009690 con 0x7f5738004800 2024-09-15T23:22:34.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.682+0000 7f5754be8640 1 -- 172.21.15.123:0/4228368068 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5738004800 msgr2=0x7f5738004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:34.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.682+0000 7f5754be8640 1 --2- 172.21.15.123:0/4228368068 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5738004800 0x7f5738004c80 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 crypto rx=0x7f5744009ac0 tx=0x7f5738005830 comp rx=0 tx=0).stop 2024-09-15T23:22:34.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.682+0000 7f5754be8640 1 -- 172.21.15.123:0/4228368068 shutdown_connections 2024-09-15T23:22:34.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.682+0000 7f5754be8640 1 --2- 172.21.15.123:0/4228368068 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5738004800 0x7f5738004c80 unknown :-1 s=CLOSED pgs=2104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:34.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.682+0000 7f5754be8640 1 -- 172.21.15.123:0/4228368068 >> 172.21.15.123:0/4228368068 conn(0x7f57500ccec0 msgr2=0x7f57500cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:34.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.682+0000 7f5754be8640 1 -- 172.21.15.123:0/4228368068 shutdown_connections 2024-09-15T23:22:34.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.682+0000 7f5754be8640 1 -- 172.21.15.123:0/4228368068 wait complete. 2024-09-15T23:22:34.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.684+0000 7f5754be8640 1 Processor -- start 2024-09-15T23:22:34.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.684+0000 7f5754be8640 1 -- start start 2024-09-15T23:22:34.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.684+0000 7f5754be8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5738004800 0x7f57500cb840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:34.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.684+0000 7f5754be8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f57500cbd80 0x7f57501f56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:34.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.685+0000 7f5754be8640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f57501f5c10 0x7f57501f60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:34.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.685+0000 7f5754be8640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f57501462b0 con 0x7f5738004800 2024-09-15T23:22:34.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.685+0000 7f5754be8640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f57500b4b60 con 0x7f57500cbd80 2024-09-15T23:22:34.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.685+0000 7f5754be8640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5750146430 con 0x7f57501f5c10 2024-09-15T23:22:34.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.685+0000 7f574e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5738004800 0x7f57500cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:34.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.685+0000 7f574e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5738004800 0x7f57500cb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35598/0 (socket says 172.21.15.123:35598) 2024-09-15T23:22:34.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.685+0000 7f574e59c640 1 -- 172.21.15.123:0/2771639062 learned_addr learned my addr 172.21.15.123:0/2771639062 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:34.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.685+0000 7f574ed9d640 1 --2- 172.21.15.123:0/2771639062 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f57501f5c10 0x7f57501f60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:34.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.685+0000 7f574dd9b640 1 --2- 172.21.15.123:0/2771639062 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f57500cbd80 0x7f57501f56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:34.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.685+0000 7f574e59c640 1 -- 172.21.15.123:0/2771639062 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f57501f5c10 msgr2=0x7f57501f60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:34.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.685+0000 7f574e59c640 1 --2- 172.21.15.123:0/2771639062 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f57501f5c10 0x7f57501f60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:34.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.685+0000 7f574e59c640 1 -- 172.21.15.123:0/2771639062 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f57500cbd80 msgr2=0x7f57501f56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:34.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.685+0000 7f574e59c640 1 --2- 172.21.15.123:0/2771639062 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f57500cbd80 0x7f57501f56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:34.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.685+0000 7f574e59c640 1 -- 172.21.15.123:0/2771639062 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57500ca9e0 con 0x7f5738004800 2024-09-15T23:22:34.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.685+0000 7f574dd9b640 1 --2- 172.21.15.123:0/2771639062 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f57500cbd80 0x7f57501f56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:22:34.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.685+0000 7f574ed9d640 1 --2- 172.21.15.123:0/2771639062 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f57501f5c10 0x7f57501f60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:34.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.685+0000 7f574e59c640 1 --2- 172.21.15.123:0/2771639062 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5738004800 0x7f57500cb840 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7f574000e850 tx=0x7f574000ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:34.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.685+0000 7f573effd640 1 -- 172.21.15.123:0/2771639062 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574000c870 con 0x7f5738004800 2024-09-15T23:22:34.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.685+0000 7f573effd640 1 -- 172.21.15.123:0/2771639062 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5740018070 con 0x7f5738004800 2024-09-15T23:22:34.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.685+0000 7f573effd640 1 -- 172.21.15.123:0/2771639062 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574000cc50 con 0x7f5738004800 2024-09-15T23:22:34.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.685+0000 7f5754be8640 1 -- 172.21.15.123:0/2771639062 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57500cacc0 con 0x7f5738004800 2024-09-15T23:22:34.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.685+0000 7f5754be8640 1 -- 172.21.15.123:0/2771639062 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f575013dde0 con 0x7f5738004800 2024-09-15T23:22:34.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.686+0000 7f5754be8640 1 -- 172.21.15.123:0/2771639062 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f575013dfe0 con 0x7f5738004800 2024-09-15T23:22:34.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.687+0000 7f573effd640 1 -- 172.21.15.123:0/2771639062 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f574001d460 con 0x7f5738004800 2024-09-15T23:22:34.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.687+0000 7f573effd640 1 --2- 172.21.15.123:0/2771639062 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f573006c2e0 0x7f573006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:34.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.687+0000 7f573effd640 1 -- 172.21.15.123:0/2771639062 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f574008b2b0 con 0x7f5738004800 2024-09-15T23:22:34.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.687+0000 7f574dd9b640 1 --2- 172.21.15.123:0/2771639062 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f573006c2e0 0x7f573006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:34.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.688+0000 7f574dd9b640 1 --2- 172.21.15.123:0/2771639062 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f573006c2e0 0x7f573006e7a0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f5744033000 tx=0x7f5744008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:34.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.691+0000 7f573effd640 1 -- 172.21.15.123:0/2771639062 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f575013dfe0 con 0x7f5738004800 2024-09-15T23:22:34.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.890+0000 7f5754be8640 1 -- 172.21.15.123:0/2771639062 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f57500cc160 con 0x7f5738004800 2024-09-15T23:22:34.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.891+0000 7f573effd640 1 -- 172.21.15.123:0/2771639062 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) ==== 95+0+5252 (secure 0 0 0) 0x7f5740059ab0 con 0x7f5738004800 2024-09-15T23:22:34.892 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:22:34.892 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":110,"btime":"2024-09-15T23:22:28:577201+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8452,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/1861304244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1861304244},{"type":"v1","addr":"172.21.15.188:6837","nonce":1861304244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":10056,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/2869473990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2869473990},{"type":"v1","addr":"172.21.15.123:6833","nonce":2869473990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":10062,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3239002092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3239002092},{"type":"v1","addr":"172.21.15.123:6835","nonce":3239002092}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:22:25.896547+0000","modified":"2024-09-15T23:22:27.904790+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10074},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10074":{"gid":10074,"name":"d","rank":0,"incarnation":108,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6836/2164993019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2164993019},{"type":"v1","addr":"172.21.15.188:6836","nonce":2164993019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10074,"qdb_cluster":[10074]},"id":12}]} 2024-09-15T23:22:34.892 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 110 2024-09-15T23:22:34.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.893+0000 7f5754be8640 1 -- 172.21.15.123:0/2771639062 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f573006c2e0 msgr2=0x7f573006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:34.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.893+0000 7f5754be8640 1 --2- 172.21.15.123:0/2771639062 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f573006c2e0 0x7f573006e7a0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f5744033000 tx=0x7f5744008030 comp rx=0 tx=0).stop 2024-09-15T23:22:34.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.893+0000 7f5754be8640 1 -- 172.21.15.123:0/2771639062 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5738004800 msgr2=0x7f57500cb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:34.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.893+0000 7f5754be8640 1 --2- 172.21.15.123:0/2771639062 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5738004800 0x7f57500cb840 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7f574000e850 tx=0x7f574000ed10 comp rx=0 tx=0).stop 2024-09-15T23:22:34.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.893+0000 7f5754be8640 1 -- 172.21.15.123:0/2771639062 shutdown_connections 2024-09-15T23:22:34.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.893+0000 7f5754be8640 1 --2- 172.21.15.123:0/2771639062 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f57501f5c10 0x7f57501f60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:34.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.893+0000 7f5754be8640 1 --2- 172.21.15.123:0/2771639062 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f57500cbd80 0x7f57501f56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:34.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.893+0000 7f5754be8640 1 --2- 172.21.15.123:0/2771639062 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f573006c2e0 0x7f573006e7a0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:34.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.893+0000 7f5754be8640 1 --2- 172.21.15.123:0/2771639062 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5738004800 0x7f57500cb840 unknown :-1 s=CLOSED pgs=2105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:34.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.893+0000 7f5754be8640 1 -- 172.21.15.123:0/2771639062 >> 172.21.15.123:0/2771639062 conn(0x7f57500ccec0 msgr2=0x7f5750144ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:34.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.893+0000 7f5754be8640 1 -- 172.21.15.123:0/2771639062 shutdown_connections 2024-09-15T23:22:34.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:34.893+0000 7f5754be8640 1 -- 172.21.15.123:0/2771639062 wait complete. 2024-09-15T23:22:35.307 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 110, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:22:25.896547+0000', 'modified': '2024-09-15T23:22:27.904790+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10074}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10074': {'gid': 10074, 'name': 'd', 'rank': 0, 'incarnation': 108, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.188:6836/2164993019', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6834', 'nonce': 2164993019}, {'type': 'v1', 'addr': '172.21.15.188:6836', 'nonce': 2164993019}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [25], 'metadata_pool': 24, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 10074, 'qdb_cluster': [10074]} 2024-09-15T23:22:35.308 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:22:35.308 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-15T23:22:35.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.408+0000 7f34d259f640 1 Processor -- start 2024-09-15T23:22:35.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.408+0000 7f34d259f640 1 -- start start 2024-09-15T23:22:35.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.409+0000 7f34d259f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f34cc0b63f0 0x7f34cc0cef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:35.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.409+0000 7f34d259f640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34cc0cfb40 con 0x7f34cc0b7a30 2024-09-15T23:22:35.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.409+0000 7f34d259f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34cc0cfe20 con 0x7f34cc0b67d0 2024-09-15T23:22:35.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.409+0000 7f34d259f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f34cc0d27f0 con 0x7f34cc0b63f0 2024-09-15T23:22:35.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.409+0000 7f34d159d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f34cc0b63f0 0x7f34cc0cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:35.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.409+0000 7f34d159d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f34cc0b63f0 0x7f34cc0cef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35606/0 (socket says 172.21.15.123:35606) 2024-09-15T23:22:35.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.409+0000 7f34d0d9c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f34cc0b7a30 0x7f34cc15df80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36814/0 (socket says 172.21.15.123:36814) 2024-09-15T23:22:35.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.409+0000 7f34d159d640 1 -- 172.21.15.123:0/2717834169 learned_addr learned my addr 172.21.15.123:0/2717834169 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:35.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.409+0000 7f34d159d640 1 -- 172.21.15.123:0/2717834169 >> v1:172.21.15.188:6789/0 conn(0x7f34cc0b67d0 legacy=0x7f34cc0d35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:35.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.409+0000 7f34d159d640 1 -- 172.21.15.123:0/2717834169 >> v1:172.21.15.123:6789/0 conn(0x7f34cc0b7a30 legacy=0x7f34cc15df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:35.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.409+0000 7f34d159d640 1 -- 172.21.15.123:0/2717834169 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34cc0d2e00 con 0x7f34cc0b63f0 2024-09-15T23:22:35.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.409+0000 7f34c3fff640 1 -- 172.21.15.123:0/2717834169 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2638501874 0 0) 0x7f34cc0cfb40 con 0x7f34cc0b7a30 2024-09-15T23:22:35.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.410+0000 7f34d159d640 1 --2- 172.21.15.123:0/2717834169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34cc0b63f0 0x7f34cc0cef60 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7f34c8009e80 tx=0x7f34c802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=328c0181c13eacba server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:35.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.410+0000 7f34c3fff640 1 -- 172.21.15.123:0/2717834169 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c8036070 con 0x7f34cc0b63f0 2024-09-15T23:22:35.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.410+0000 7f34c3fff640 1 -- 172.21.15.123:0/2717834169 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34c8031600 con 0x7f34cc0b63f0 2024-09-15T23:22:35.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.410+0000 7f34c3fff640 1 -- 172.21.15.123:0/2717834169 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c80319d0 con 0x7f34cc0b63f0 2024-09-15T23:22:35.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.411+0000 7f34d259f640 1 -- 172.21.15.123:0/2717834169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34cc0b63f0 msgr2=0x7f34cc0cef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:35.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.411+0000 7f34d259f640 1 --2- 172.21.15.123:0/2717834169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34cc0b63f0 0x7f34cc0cef60 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7f34c8009e80 tx=0x7f34c802a7a0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.411+0000 7f34d259f640 1 -- 172.21.15.123:0/2717834169 shutdown_connections 2024-09-15T23:22:35.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.411+0000 7f34d259f640 1 --2- 172.21.15.123:0/2717834169 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34cc0b63f0 0x7f34cc0cef60 unknown :-1 s=CLOSED pgs=2107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.411+0000 7f34d259f640 1 -- 172.21.15.123:0/2717834169 >> 172.21.15.123:0/2717834169 conn(0x7f34cc0d1360 msgr2=0x7f34cc0d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:35.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.411+0000 7f34d259f640 1 -- 172.21.15.123:0/2717834169 shutdown_connections 2024-09-15T23:22:35.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.411+0000 7f34d259f640 1 -- 172.21.15.123:0/2717834169 wait complete. 2024-09-15T23:22:35.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.412+0000 7f34d259f640 1 Processor -- start 2024-09-15T23:22:35.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.412+0000 7f34d259f640 1 -- start start 2024-09-15T23:22:35.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.413+0000 7f34d259f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34cc0b63f0 0x7f34cc157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:35.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.413+0000 7f34d259f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34cc0b67d0 0x7f34cc1f1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:35.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.413+0000 7f34d259f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34cc0b7a30 0x7f34cc154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:35.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.413+0000 7f34d259f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc0cf620 con 0x7f34cc0b63f0 2024-09-15T23:22:35.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.413+0000 7f34d259f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc0cf4a0 con 0x7f34cc0b67d0 2024-09-15T23:22:35.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.413+0000 7f34d259f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f34cc0cf7a0 con 0x7f34cc0b7a30 2024-09-15T23:22:35.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.413+0000 7f34d159d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34cc0b63f0 0x7f34cc157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:35.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.413+0000 7f34d159d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34cc0b63f0 0x7f34cc157510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35614/0 (socket says 172.21.15.123:35614) 2024-09-15T23:22:35.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.413+0000 7f34d159d640 1 -- 172.21.15.123:0/2366718178 learned_addr learned my addr 172.21.15.123:0/2366718178 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:35.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.413+0000 7f34d0d9c640 1 --2- 172.21.15.123:0/2366718178 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34cc0b67d0 0x7f34cc1f1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:35.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.413+0000 7f34d1d9e640 1 --2- 172.21.15.123:0/2366718178 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34cc0b7a30 0x7f34cc154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:35.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.413+0000 7f34d159d640 1 -- 172.21.15.123:0/2366718178 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34cc0b7a30 msgr2=0x7f34cc154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:35.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.413+0000 7f34d159d640 1 --2- 172.21.15.123:0/2366718178 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34cc0b7a30 0x7f34cc154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.413+0000 7f34d159d640 1 -- 172.21.15.123:0/2366718178 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34cc0b67d0 msgr2=0x7f34cc1f1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:35.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.413+0000 7f34d159d640 1 --2- 172.21.15.123:0/2366718178 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34cc0b67d0 0x7f34cc1f1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.413+0000 7f34d159d640 1 -- 172.21.15.123:0/2366718178 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34cc147700 con 0x7f34cc0b63f0 2024-09-15T23:22:35.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.413+0000 7f34d1d9e640 1 --2- 172.21.15.123:0/2366718178 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34cc0b7a30 0x7f34cc154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:22:35.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.413+0000 7f34d159d640 1 --2- 172.21.15.123:0/2366718178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34cc0b63f0 0x7f34cc157510 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 crypto rx=0x7f34c8034040 tx=0x7f34c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:35.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.413+0000 7f34c1ffb640 1 -- 172.21.15.123:0/2366718178 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c8041030 con 0x7f34cc0b63f0 2024-09-15T23:22:35.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.413+0000 7f34c1ffb640 1 -- 172.21.15.123:0/2366718178 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34c8031400 con 0x7f34cc0b63f0 2024-09-15T23:22:35.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.413+0000 7f34d259f640 1 -- 172.21.15.123:0/2366718178 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34cc156a30 con 0x7f34cc0b63f0 2024-09-15T23:22:35.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.413+0000 7f34c1ffb640 1 -- 172.21.15.123:0/2366718178 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c8036040 con 0x7f34cc0b63f0 2024-09-15T23:22:35.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.414+0000 7f34d259f640 1 -- 172.21.15.123:0/2366718178 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34cc1f1950 con 0x7f34cc0b63f0 2024-09-15T23:22:35.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.415+0000 7f34c1ffb640 1 -- 172.21.15.123:0/2366718178 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f34c8044070 con 0x7f34cc0b63f0 2024-09-15T23:22:35.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.415+0000 7f34c1ffb640 1 --2- 172.21.15.123:0/2366718178 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f34b006c2b0 0x7f34b006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:35.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.415+0000 7f34c1ffb640 1 -- 172.21.15.123:0/2366718178 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f34c80abe30 con 0x7f34cc0b63f0 2024-09-15T23:22:35.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.416+0000 7f34d0d9c640 1 --2- 172.21.15.123:0/2366718178 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f34b006c2b0 0x7f34b006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:35.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.416+0000 7f34d0d9c640 1 --2- 172.21.15.123:0/2366718178 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f34b006c2b0 0x7f34b006e770 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f34cc1446f0 tx=0x7f34bc007b90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:35.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.417+0000 7f34d6671740 1 Processor -- start 2024-09-15T23:22:35.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.417+0000 7f34d6671740 1 -- start start 2024-09-15T23:22:35.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.417+0000 7f34d6671740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557a5a8424b0 0x557a5a887c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:35.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.417+0000 7f34d6671740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a5a83fc70 0x557a5a842890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:35.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.417+0000 7f34d6671740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a5a843c40 0x557a5a83caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:35.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.417+0000 7f34d6671740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x557a5a7a4520 con 0x557a5a843c40 2024-09-15T23:22:35.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.417+0000 7f34d6671740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x557a5a74c3e0 con 0x557a5a83fc70 2024-09-15T23:22:35.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.417+0000 7f34d6671740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x557a5a7a04e0 con 0x557a5a8424b0 2024-09-15T23:22:35.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.417+0000 7f34d1d9e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a5a843c40 0x557a5a83caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:35.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.417+0000 7f34d1d9e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a5a843c40 0x557a5a83caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35616/0 (socket says 172.21.15.123:35616) 2024-09-15T23:22:35.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.417+0000 7f34d1d9e640 1 -- 172.21.15.123:0/3727721832 learned_addr learned my addr 172.21.15.123:0/3727721832 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:35.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.418+0000 7f34d0d9c640 1 --2- 172.21.15.123:0/3727721832 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a5a83fc70 0x557a5a842890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:35.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.418+0000 7f34d159d640 1 --2- 172.21.15.123:0/3727721832 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557a5a8424b0 0x557a5a887c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:35.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.418+0000 7f34d1d9e640 1 -- 172.21.15.123:0/3727721832 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557a5a8424b0 msgr2=0x557a5a887c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:35.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.418+0000 7f34d1d9e640 1 --2- 172.21.15.123:0/3727721832 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557a5a8424b0 0x557a5a887c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.418+0000 7f34d1d9e640 1 -- 172.21.15.123:0/3727721832 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a5a83fc70 msgr2=0x557a5a842890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:35.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.418+0000 7f34d1d9e640 1 --2- 172.21.15.123:0/3727721832 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a5a83fc70 0x557a5a842890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.418+0000 7f34d1d9e640 1 -- 172.21.15.123:0/3727721832 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a5a7672f0 con 0x557a5a843c40 2024-09-15T23:22:35.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.418+0000 7f34d159d640 1 --2- 172.21.15.123:0/3727721832 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557a5a8424b0 0x557a5a887c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:35.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.418+0000 7f34d1d9e640 1 --2- 172.21.15.123:0/3727721832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a5a843c40 0x557a5a83caa0 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 crypto rx=0x7f34c40017a0 tx=0x7f34c4001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0236fb86c6d2b3b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:35.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.418+0000 7f34b6ffd640 1 -- 172.21.15.123:0/3727721832 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c4018070 con 0x557a5a843c40 2024-09-15T23:22:35.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.418+0000 7f34b6ffd640 1 -- 172.21.15.123:0/3727721832 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34c400d730 con 0x557a5a843c40 2024-09-15T23:22:35.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.418+0000 7f34b6ffd640 1 -- 172.21.15.123:0/3727721832 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c400db20 con 0x557a5a843c40 2024-09-15T23:22:35.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.419+0000 7f34d6671740 1 -- 172.21.15.123:0/3727721832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a5a843c40 msgr2=0x557a5a83caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:35.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.419+0000 7f34d6671740 1 --2- 172.21.15.123:0/3727721832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a5a843c40 0x557a5a83caa0 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 crypto rx=0x7f34c40017a0 tx=0x7f34c4001c60 comp rx=0 tx=0).stop 2024-09-15T23:22:35.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.419+0000 7f34d6671740 1 -- 172.21.15.123:0/3727721832 shutdown_connections 2024-09-15T23:22:35.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.419+0000 7f34d6671740 1 --2- 172.21.15.123:0/3727721832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a5a843c40 0x557a5a83caa0 unknown :-1 s=CLOSED pgs=2109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.419+0000 7f34d6671740 1 --2- 172.21.15.123:0/3727721832 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a5a83fc70 0x557a5a842890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.419+0000 7f34d6671740 1 --2- 172.21.15.123:0/3727721832 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557a5a8424b0 0x557a5a887c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.419+0000 7f34d6671740 1 -- 172.21.15.123:0/3727721832 >> 172.21.15.123:0/3727721832 conn(0x557a5a83ec70 msgr2=0x557a5a887120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:35.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.419+0000 7f34d6671740 1 -- 172.21.15.123:0/3727721832 shutdown_connections 2024-09-15T23:22:35.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.419+0000 7f34d6671740 1 -- 172.21.15.123:0/3727721832 wait complete. 2024-09-15T23:22:35.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.419+0000 7f34d6671740 1 -- start start 2024-09-15T23:22:35.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.419+0000 7f34d6671740 1 Processor -- start 2024-09-15T23:22:35.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.420+0000 7f34d6671740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557a5a8424b0 0x557a5a862860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:35.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.420+0000 7f34d6671740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a5a843c40 0x557a5a861d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:35.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.420+0000 7f34d6671740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a5a8975b0 0x557a5a863040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:35.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.420+0000 7f34d6671740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x557a5a83e110 con 0x557a5a8975b0 2024-09-15T23:22:35.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.420+0000 7f34d6671740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x557a5a72d450 con 0x557a5a843c40 2024-09-15T23:22:35.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.420+0000 7f34d6671740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x557a5a888480 con 0x557a5a8424b0 2024-09-15T23:22:35.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.420+0000 7f34d6671740 10 client.0 _ll_register_callbacks cb 0x557a5a4b6ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:22:35.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.420+0000 7f34d1d9e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a5a8975b0 0x557a5a863040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:35.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.420+0000 7f34d1d9e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a5a8975b0 0x557a5a863040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35628/0 (socket says 172.21.15.123:35628) 2024-09-15T23:22:35.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.420+0000 7f34d1d9e640 1 -- 172.21.15.123:0/3457794386 learned_addr learned my addr 172.21.15.123:0/3457794386 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:35.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.420+0000 7f34d159d640 1 --2- 172.21.15.123:0/3457794386 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557a5a8424b0 0x557a5a862860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:35.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.420+0000 7f34d0d9c640 1 --2- 172.21.15.123:0/3457794386 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a5a843c40 0x557a5a861d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:35.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.421+0000 7f34d1d9e640 1 -- 172.21.15.123:0/3457794386 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557a5a8424b0 msgr2=0x557a5a862860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:35.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.421+0000 7f34d1d9e640 1 --2- 172.21.15.123:0/3457794386 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557a5a8424b0 0x557a5a862860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.421+0000 7f34d1d9e640 1 -- 172.21.15.123:0/3457794386 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a5a843c40 msgr2=0x557a5a861d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:35.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.421+0000 7f34d1d9e640 1 --2- 172.21.15.123:0/3457794386 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a5a843c40 0x557a5a861d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.421+0000 7f34d1d9e640 1 -- 172.21.15.123:0/3457794386 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a5a4b72d0 con 0x557a5a8975b0 2024-09-15T23:22:35.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.421+0000 7f34d0d9c640 1 --2- 172.21.15.123:0/3457794386 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a5a843c40 0x557a5a861d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:35.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.421+0000 7f34d1d9e640 1 --2- 172.21.15.123:0/3457794386 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a5a8975b0 0x557a5a863040 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7f34c400d520 tx=0x7f34c4000fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=525b6c3f16d2e249 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:35.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.421+0000 7f34abfff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:22:35.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.421+0000 7f34abfff640 1 -- 172.21.15.123:0/3457794386 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c4023020 con 0x557a5a8975b0 2024-09-15T23:22:35.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.421+0000 7f34abfff640 1 -- 172.21.15.123:0/3457794386 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f34c400dc70 con 0x557a5a8975b0 2024-09-15T23:22:35.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.421+0000 7f34d6671740 1 -- 172.21.15.123:0/3457794386 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34c400d730 con 0x557a5a8975b0 2024-09-15T23:22:35.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.421+0000 7f34abfff640 1 -- 172.21.15.123:0/3457794386 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) ==== 24+0+0 (secure 0 0 0) 0x7f34c402d050 con 0x557a5a8975b0 2024-09-15T23:22:35.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.421+0000 7f34d6671740 10 client.10224 fetch_fsmap learned FSMap version 110 2024-09-15T23:22:35.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.421+0000 7f34d6671740 1 -- 172.21.15.123:0/3457794386 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=2+}) -- 0x557a5a5816b0 con 0x557a5a8975b0 2024-09-15T23:22:35.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.421+0000 7f34abfff640 1 -- 172.21.15.123:0/3457794386 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34c400d730 con 0x557a5a8975b0 2024-09-15T23:22:35.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.421+0000 7f34abfff640 1 -- 172.21.15.123:0/3457794386 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 110) ==== 3502+0+0 (secure 0 0 0) 0x7f34c401e070 con 0x557a5a8975b0 2024-09-15T23:22:35.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.421+0000 7f34d6671740 10 client.10224 fetch_fsmap finished waiting for FSMap version 110 2024-09-15T23:22:35.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.421+0000 7f34d6671740 10 client.10224 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-15T23:22:35.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.421+0000 7f34d6671740 20 client.10224 populate_metadata read hostname 'smithi123' 2024-09-15T23:22:35.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.421+0000 7f34d6671740 1 --2- 172.21.15.123:0/3457794386 >> [v2:172.21.15.188:6834/2164993019,v1:172.21.15.188:6836/2164993019] conn(0x557a5a8a2ef0 0x557a5a8a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:35.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.421+0000 7f34d6671740 4 client.10224 mds_command: new command op to 10074 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:22:35.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.421+0000 7f34d6671740 1 -- 172.21.15.123:0/3457794386 --> [v2:172.21.15.188:6834/2164993019,v1:172.21.15.188:6836/2164993019] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a5a7b1c50 con 0x557a5a8a2ef0 2024-09-15T23:22:35.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.422+0000 7f34d159d640 1 --2- 172.21.15.123:0/3457794386 >> [v2:172.21.15.188:6834/2164993019,v1:172.21.15.188:6836/2164993019] conn(0x557a5a8a2ef0 0x557a5a8a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:35.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.422+0000 7f34abfff640 10 client.10224 ms_handle_connect on v2:172.21.15.188:6834/2164993019 2024-09-15T23:22:35.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.422+0000 7f34d159d640 1 --2- 172.21.15.123:0/3457794386 >> [v2:172.21.15.188:6834/2164993019,v1:172.21.15.188:6836/2164993019] conn(0x557a5a8a2ef0 0x557a5a8a52e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dece119b5a971e7b server_cookie=a860cf8f3634e63d in_seq=0 out_seq=0 2024-09-15T23:22:35.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.423+0000 7f34abfff640 1 -- 172.21.15.123:0/3457794386 <== mds.0 v2:172.21.15.188:6834/2164993019 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557a5a7b1c50 con 0x557a5a8a2ef0 2024-09-15T23:22:35.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.423+0000 7f34abfff640 10 client.10224 handle_command_reply: tid=0 2024-09-15T23:22:35.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.423+0000 7f34d6671740 1 client.10224 shutdown 2024-09-15T23:22:35.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.423+0000 7f34d6671740 1 -- 172.21.15.123:0/3457794386 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a5a8975b0 msgr2=0x557a5a863040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:35.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.423+0000 7f34d6671740 1 --2- 172.21.15.123:0/3457794386 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a5a8975b0 0x557a5a863040 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7f34c400d520 tx=0x7f34c4000fb0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.423+0000 7f34d6671740 1 -- 172.21.15.123:0/3457794386 shutdown_connections 2024-09-15T23:22:35.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.423+0000 7f34d6671740 1 --2- 172.21.15.123:0/3457794386 >> [v2:172.21.15.188:6834/2164993019,v1:172.21.15.188:6836/2164993019] conn(0x557a5a8a2ef0 0x557a5a8a52e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.423+0000 7f34d6671740 1 --2- 172.21.15.123:0/3457794386 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a5a8975b0 0x557a5a863040 unknown :-1 s=CLOSED pgs=2110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.423+0000 7f34d6671740 1 --2- 172.21.15.123:0/3457794386 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a5a843c40 0x557a5a861d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.423+0000 7f34abfff640 0 client.10224 ms_handle_reset on v2:172.21.15.188:6834/2164993019 2024-09-15T23:22:35.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.423+0000 7f34d6671740 1 --2- 172.21.15.123:0/3457794386 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557a5a8424b0 0x557a5a862860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.423+0000 7f34d6671740 1 -- 172.21.15.123:0/3457794386 >> 172.21.15.123:0/3457794386 conn(0x557a5a83fc70 msgr2=0x557a5a8851a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:35.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.423+0000 7f34d6671740 1 -- 172.21.15.123:0/3457794386 shutdown_connections 2024-09-15T23:22:35.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.423+0000 7f34d6671740 1 -- 172.21.15.123:0/3457794386 wait complete. 2024-09-15T23:22:35.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.423+0000 7f34d6671740 20 client.10224 trim_cache size 0 max 16384 2024-09-15T23:22:35.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.441+0000 7f34d6671740 1 Processor -- start 2024-09-15T23:22:35.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.441+0000 7f34d6671740 1 -- start start 2024-09-15T23:22:35.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.441+0000 7f34d6671740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a5a8424b0 0x557a5a864680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:35.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.441+0000 7f34d6671740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557a5a843c40 0x557a5a86c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:35.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.441+0000 7f34d6671740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a5a8975b0 0x557a5a888c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:35.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.441+0000 7f34d6671740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc1ffad0 con 0x557a5a8975b0 2024-09-15T23:22:35.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.441+0000 7f34d6671740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc1f8360 con 0x557a5a8424b0 2024-09-15T23:22:35.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.441+0000 7f34d6671740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f34cc0cd280 con 0x557a5a843c40 2024-09-15T23:22:35.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.441+0000 7f34d1d9e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a5a8975b0 0x557a5a888c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:35.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.442+0000 7f34d1d9e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a5a8975b0 0x557a5a888c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35636/0 (socket says 172.21.15.123:35636) 2024-09-15T23:22:35.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.442+0000 7f34d1d9e640 1 -- 172.21.15.123:0/1239139594 learned_addr learned my addr 172.21.15.123:0/1239139594 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:35.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.442+0000 7f34d159d640 1 --2- 172.21.15.123:0/1239139594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a5a8424b0 0x557a5a864680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:35.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.442+0000 7f34d0d9c640 1 --2- 172.21.15.123:0/1239139594 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557a5a843c40 0x557a5a86c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:35.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.442+0000 7f34d1d9e640 1 -- 172.21.15.123:0/1239139594 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557a5a843c40 msgr2=0x557a5a86c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:35.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.442+0000 7f34d1d9e640 1 --2- 172.21.15.123:0/1239139594 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557a5a843c40 0x557a5a86c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.442+0000 7f34d1d9e640 1 -- 172.21.15.123:0/1239139594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a5a8424b0 msgr2=0x557a5a864680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:35.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.442+0000 7f34d1d9e640 1 --2- 172.21.15.123:0/1239139594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a5a8424b0 0x557a5a864680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.442+0000 7f34d1d9e640 1 -- 172.21.15.123:0/1239139594 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a5a8384f0 con 0x557a5a8975b0 2024-09-15T23:22:35.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.442+0000 7f34d1d9e640 1 --2- 172.21.15.123:0/1239139594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a5a8975b0 0x557a5a888c80 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7f34c4007e40 tx=0x7f34c401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=692a55808fff2cc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:35.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.442+0000 7f34b67fc640 1 -- 172.21.15.123:0/1239139594 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c4023070 con 0x557a5a8975b0 2024-09-15T23:22:35.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.442+0000 7f34b67fc640 1 -- 172.21.15.123:0/1239139594 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34c400d730 con 0x557a5a8975b0 2024-09-15T23:22:35.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.442+0000 7f34b67fc640 1 -- 172.21.15.123:0/1239139594 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c4018030 con 0x557a5a8975b0 2024-09-15T23:22:35.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.443+0000 7f34d6671740 1 -- 172.21.15.123:0/1239139594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a5a8975b0 msgr2=0x557a5a888c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:35.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.443+0000 7f34d6671740 1 --2- 172.21.15.123:0/1239139594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a5a8975b0 0x557a5a888c80 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7f34c4007e40 tx=0x7f34c401e000 comp rx=0 tx=0).stop 2024-09-15T23:22:35.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.443+0000 7f34d6671740 1 -- 172.21.15.123:0/1239139594 shutdown_connections 2024-09-15T23:22:35.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.443+0000 7f34d6671740 1 --2- 172.21.15.123:0/1239139594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a5a8975b0 0x557a5a888c80 unknown :-1 s=CLOSED pgs=2111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.443+0000 7f34d6671740 1 --2- 172.21.15.123:0/1239139594 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557a5a843c40 0x557a5a86c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.443+0000 7f34d6671740 1 --2- 172.21.15.123:0/1239139594 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a5a8424b0 0x557a5a864680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.443+0000 7f34d6671740 1 -- 172.21.15.123:0/1239139594 >> 172.21.15.123:0/1239139594 conn(0x557a5a83fc70 msgr2=0x557a5a886760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:35.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.443+0000 7f34d6671740 1 -- 172.21.15.123:0/1239139594 shutdown_connections 2024-09-15T23:22:35.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.443+0000 7f34d6671740 1 -- 172.21.15.123:0/1239139594 wait complete. 2024-09-15T23:22:35.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.443+0000 7f34d6671740 1 -- start start 2024-09-15T23:22:35.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.443+0000 7f34d6671740 1 Processor -- start 2024-09-15T23:22:35.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.444+0000 7f34d6671740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557a5a8424b0 0x557a5a905060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:35.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.444+0000 7f34d6671740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a5a843c40 0x557a5a89deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:35.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.444+0000 7f34d6671740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a5a8975b0 0x557a5a867cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:35.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.444+0000 7f34d6671740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x557a5a862290 con 0x557a5a8975b0 2024-09-15T23:22:35.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.444+0000 7f34d6671740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x557a5a898350 con 0x557a5a843c40 2024-09-15T23:22:35.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.444+0000 7f34d6671740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x557a5a89af00 con 0x557a5a8424b0 2024-09-15T23:22:35.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.444+0000 7f34d6671740 10 client.0 _ll_register_callbacks cb 0x7f34c4016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:22:35.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.444+0000 7f34d1d9e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a5a8975b0 0x557a5a867cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:35.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.444+0000 7f34d1d9e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a5a8975b0 0x557a5a867cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35638/0 (socket says 172.21.15.123:35638) 2024-09-15T23:22:35.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.444+0000 7f34d1d9e640 1 -- 172.21.15.123:0/1412576136 learned_addr learned my addr 172.21.15.123:0/1412576136 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:35.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.444+0000 7f34d0d9c640 1 --2- 172.21.15.123:0/1412576136 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a5a843c40 0x557a5a89deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:35.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.444+0000 7f34d159d640 1 --2- 172.21.15.123:0/1412576136 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557a5a8424b0 0x557a5a905060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:35.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.445+0000 7f34d1d9e640 1 -- 172.21.15.123:0/1412576136 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557a5a8424b0 msgr2=0x557a5a905060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:35.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.445+0000 7f34d1d9e640 1 --2- 172.21.15.123:0/1412576136 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557a5a8424b0 0x557a5a905060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.445+0000 7f34d1d9e640 1 -- 172.21.15.123:0/1412576136 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a5a843c40 msgr2=0x557a5a89deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:35.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.445+0000 7f34d1d9e640 1 --2- 172.21.15.123:0/1412576136 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a5a843c40 0x557a5a89deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.445+0000 7f34d1d9e640 1 -- 172.21.15.123:0/1412576136 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a5a894c70 con 0x557a5a8975b0 2024-09-15T23:22:35.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.445+0000 7f34d159d640 1 --2- 172.21.15.123:0/1412576136 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557a5a8424b0 0x557a5a905060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:35.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.445+0000 7f34d1d9e640 1 --2- 172.21.15.123:0/1412576136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a5a8975b0 0x557a5a867cf0 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7f34c4001690 tx=0x7f34c4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21fd40c86b5bb7f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:35.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.445+0000 7f34abfff640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:22:35.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.445+0000 7f34abfff640 1 -- 172.21.15.123:0/1412576136 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c4023050 con 0x557a5a8975b0 2024-09-15T23:22:35.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.445+0000 7f34abfff640 1 -- 172.21.15.123:0/1412576136 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f34c4003d60 con 0x557a5a8975b0 2024-09-15T23:22:35.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.445+0000 7f34d6671740 1 -- 172.21.15.123:0/1412576136 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34c400d730 con 0x557a5a8975b0 2024-09-15T23:22:35.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.445+0000 7f34abfff640 1 -- 172.21.15.123:0/1412576136 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) ==== 24+0+0 (secure 0 0 0) 0x7f34c4041050 con 0x557a5a8975b0 2024-09-15T23:22:35.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.445+0000 7f34d6671740 10 client.10230 fetch_fsmap learned FSMap version 110 2024-09-15T23:22:35.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.445+0000 7f34d6671740 1 -- 172.21.15.123:0/1412576136 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=2+}) -- 0x557a5a8a0a70 con 0x557a5a8975b0 2024-09-15T23:22:35.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.445+0000 7f34abfff640 1 -- 172.21.15.123:0/1412576136 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34c400d730 con 0x557a5a8975b0 2024-09-15T23:22:35.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.445+0000 7f34abfff640 1 -- 172.21.15.123:0/1412576136 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 110) ==== 3502+0+0 (secure 0 0 0) 0x7f34c4044020 con 0x557a5a8975b0 2024-09-15T23:22:35.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.445+0000 7f34d6671740 10 client.10230 fetch_fsmap finished waiting for FSMap version 110 2024-09-15T23:22:35.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.445+0000 7f34d6671740 10 client.10230 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-15T23:22:35.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.445+0000 7f34d6671740 20 client.10230 populate_metadata read hostname 'smithi123' 2024-09-15T23:22:35.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.445+0000 7f34d6671740 1 --2- 172.21.15.123:0/1412576136 >> [v2:172.21.15.188:6834/2164993019,v1:172.21.15.188:6836/2164993019] conn(0x557a5a8a0620 0x557a5a868230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:35.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.445+0000 7f34d6671740 4 client.10230 mds_command: new command op to 10074 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:22:35.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.445+0000 7f34d6671740 1 -- 172.21.15.123:0/1412576136 --> [v2:172.21.15.188:6834/2164993019,v1:172.21.15.188:6836/2164993019] -- command(tid 0: {"prefix": "status"}) -- 0x557a5a7abfa0 con 0x557a5a8a0620 2024-09-15T23:22:35.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.446+0000 7f34d159d640 1 --2- 172.21.15.123:0/1412576136 >> [v2:172.21.15.188:6834/2164993019,v1:172.21.15.188:6836/2164993019] conn(0x557a5a8a0620 0x557a5a868230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:35.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.446+0000 7f34abfff640 10 client.10230 ms_handle_connect on v2:172.21.15.188:6834/2164993019 2024-09-15T23:22:35.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.446+0000 7f34d159d640 1 --2- 172.21.15.123:0/1412576136 >> [v2:172.21.15.188:6834/2164993019,v1:172.21.15.188:6836/2164993019] conn(0x557a5a8a0620 0x557a5a868230 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=429a8bbfd630aec5 server_cookie=16635260cbddcba8 in_seq=0 out_seq=0 2024-09-15T23:22:35.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.446+0000 7f34abfff640 1 -- 172.21.15.123:0/1412576136 <== mds.0 v2:172.21.15.188:6834/2164993019 1 ==== command_reply(tid 0: 0 ) ==== 8+0+335 (crc 0 0 0) 0x557a5a7abfa0 con 0x557a5a8a0620 2024-09-15T23:22:35.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.446+0000 7f34abfff640 10 client.10230 handle_command_reply: tid=0 2024-09-15T23:22:35.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.446+0000 7f34d6671740 1 client.10230 shutdown 2024-09-15T23:22:35.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.446+0000 7f34d6671740 1 -- 172.21.15.123:0/1412576136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a5a8975b0 msgr2=0x557a5a867cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:35.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.446+0000 7f34d6671740 1 --2- 172.21.15.123:0/1412576136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a5a8975b0 0x557a5a867cf0 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7f34c4001690 tx=0x7f34c4009040 comp rx=0 tx=0).stop 2024-09-15T23:22:35.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.446+0000 7f34d6671740 1 -- 172.21.15.123:0/1412576136 shutdown_connections 2024-09-15T23:22:35.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.446+0000 7f34d6671740 1 --2- 172.21.15.123:0/1412576136 >> [v2:172.21.15.188:6834/2164993019,v1:172.21.15.188:6836/2164993019] conn(0x557a5a8a0620 0x557a5a868230 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.446+0000 7f34d6671740 1 --2- 172.21.15.123:0/1412576136 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557a5a8975b0 0x557a5a867cf0 unknown :-1 s=CLOSED pgs=2112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.446+0000 7f34abfff640 0 client.10230 ms_handle_reset on v2:172.21.15.188:6834/2164993019 2024-09-15T23:22:35.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.446+0000 7f34d6671740 1 --2- 172.21.15.123:0/1412576136 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x557a5a843c40 0x557a5a89deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.446+0000 7f34d6671740 1 --2- 172.21.15.123:0/1412576136 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x557a5a8424b0 0x557a5a905060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.446+0000 7f34d6671740 1 -- 172.21.15.123:0/1412576136 >> 172.21.15.123:0/1412576136 conn(0x557a5a83fc70 msgr2=0x557a5a888c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:35.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.446+0000 7f34d6671740 1 -- 172.21.15.123:0/1412576136 shutdown_connections 2024-09-15T23:22:35.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.446+0000 7f34d6671740 1 -- 172.21.15.123:0/1412576136 wait complete. 2024-09-15T23:22:35.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.447+0000 7f34d6671740 20 client.10230 trim_cache size 0 max 16384 2024-09-15T23:22:35.455 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:22:35.455 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "cb968ac4-8d3a-4b17-a673-6177aeaea589", 2024-09-15T23:22:35.456 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2024-09-15T23:22:35.456 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 10074, 2024-09-15T23:22:35.456 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-09-15T23:22:35.456 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-09-15T23:22:35.456 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-09-15T23:22:35.456 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 8.8730476379999992, 2024-09-15T23:22:35.456 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 110, 2024-09-15T23:22:35.456 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 182, 2024-09-15T23:22:35.456 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 182, 2024-09-15T23:22:35.456 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 13.932959245999999 2024-09-15T23:22:35.456 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:22:35.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.447+0000 7f34d259f640 1 -- 172.21.15.123:0/2366718178 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f34b006c2b0 msgr2=0x7f34b006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:35.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.447+0000 7f34d259f640 1 --2- 172.21.15.123:0/2366718178 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f34b006c2b0 0x7f34b006e770 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f34cc1446f0 tx=0x7f34bc007b90 comp rx=0 tx=0).stop 2024-09-15T23:22:35.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.447+0000 7f34d259f640 1 -- 172.21.15.123:0/2366718178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34cc0b63f0 msgr2=0x7f34cc157510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:35.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.447+0000 7f34d259f640 1 --2- 172.21.15.123:0/2366718178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34cc0b63f0 0x7f34cc157510 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 crypto rx=0x7f34c8034040 tx=0x7f34c8004a40 comp rx=0 tx=0).stop 2024-09-15T23:22:35.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.447+0000 7f34d259f640 1 -- 172.21.15.123:0/2366718178 shutdown_connections 2024-09-15T23:22:35.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.447+0000 7f34d259f640 1 --2- 172.21.15.123:0/2366718178 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f34cc0b7a30 0x7f34cc154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.447+0000 7f34d259f640 1 --2- 172.21.15.123:0/2366718178 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f34cc0b67d0 0x7f34cc1f1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.447+0000 7f34d259f640 1 --2- 172.21.15.123:0/2366718178 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f34b006c2b0 0x7f34b006e770 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.447+0000 7f34d259f640 1 --2- 172.21.15.123:0/2366718178 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f34cc0b63f0 0x7f34cc157510 unknown :-1 s=CLOSED pgs=2108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.447+0000 7f34d259f640 1 -- 172.21.15.123:0/2366718178 >> 172.21.15.123:0/2366718178 conn(0x7f34cc0d1360 msgr2=0x7f34cc15d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:35.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.447+0000 7f34d259f640 1 -- 172.21.15.123:0/2366718178 shutdown_connections 2024-09-15T23:22:35.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.447+0000 7f34d259f640 1 -- 172.21.15.123:0/2366718178 wait complete. 2024-09-15T23:22:35.459 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:22:35.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.557+0000 7fbb0985e640 1 Processor -- start 2024-09-15T23:22:35.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.557+0000 7fbb0985e640 1 -- start start 2024-09-15T23:22:35.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.558+0000 7fbb0985e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fbb0406cd20 0x7fbb040b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:35.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.558+0000 7fbb0985e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb0415eab0 con 0x7fbb04070b80 2024-09-15T23:22:35.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.558+0000 7fbb0985e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb0415ed70 con 0x7fbb0415e6d0 2024-09-15T23:22:35.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.558+0000 7fbb0985e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fbb0415f050 con 0x7fbb0406cd20 2024-09-15T23:22:35.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.558+0000 7fbb037fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fbb04070b80 0x7fbb041622a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36816/0 (socket says 172.21.15.123:36816) 2024-09-15T23:22:35.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.558+0000 7fbb037fe640 1 -- 172.21.15.123:0/1292399636 learned_addr learned my addr 172.21.15.123:0/1292399636 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:35.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.558+0000 7fbb027fc640 1 -- 172.21.15.123:0/1292399636 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3603397459 0 0) 0x7fbb0415eab0 con 0x7fbb04070b80 2024-09-15T23:22:35.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.558+0000 7fbafa7fc640 1 --2- 172.21.15.123:0/1292399636 >> v2:172.21.15.188:3300/0 conn(0x7fbb0406cd20 0x7fbb040b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:35.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.558+0000 7fbb027fc640 1 -- 172.21.15.123:0/1292399636 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbaf0003520 con 0x7fbb04070b80 2024-09-15T23:22:35.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.559+0000 7fbb027fc640 1 -- 172.21.15.123:0/1292399636 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3042706041 0 0) 0x7fbaf0003520 con 0x7fbb04070b80 2024-09-15T23:22:35.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.559+0000 7fbb027fc640 1 -- 172.21.15.123:0/1292399636 >> v2:172.21.15.188:3300/0 conn(0x7fbb0406cd20 msgr2=0x7fbb040b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:35.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.559+0000 7fbb027fc640 1 --2- 172.21.15.123:0/1292399636 >> v2:172.21.15.188:3300/0 conn(0x7fbb0406cd20 0x7fbb040b6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.559+0000 7fbb027fc640 1 -- 172.21.15.123:0/1292399636 >> v1:172.21.15.188:6789/0 conn(0x7fbb0415e6d0 legacy=0x7fbb04071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:35.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.559+0000 7fbb027fc640 1 -- 172.21.15.123:0/1292399636 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb0415f330 con 0x7fbb04070b80 2024-09-15T23:22:35.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.559+0000 7fbb027fc640 1 -- 172.21.15.123:0/1292399636 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fbafc0019f0 con 0x7fbb04070b80 2024-09-15T23:22:35.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.559+0000 7fbb027fc640 1 -- 172.21.15.123:0/1292399636 >> v1:172.21.15.123:6789/0 conn(0x7fbb04070b80 legacy=0x7fbb041622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:35.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.559+0000 7fbb027fc640 1 --2- 172.21.15.123:0/1292399636 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbaf00039b0 0x7fbaf0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:35.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.559+0000 7fbb027fc640 1 --2- 172.21.15.123:0/1292399636 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbaf0004800 0x7fbaf0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:35.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.559+0000 7fbb027fc640 1 --2- 172.21.15.123:0/1292399636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbaf00051c0 0x7fbaf000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:35.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.559+0000 7fbb027fc640 1 -- 172.21.15.123:0/1292399636 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0415f050 con 0x7fbaf00051c0 2024-09-15T23:22:35.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.559+0000 7fbb027fc640 1 -- 172.21.15.123:0/1292399636 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf000c060 con 0x7fbaf0004800 2024-09-15T23:22:35.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.559+0000 7fbb027fc640 1 -- 172.21.15.123:0/1292399636 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbaf000c260 con 0x7fbaf00039b0 2024-09-15T23:22:35.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.559+0000 7fbb037fe640 1 --2- 172.21.15.123:0/1292399636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbaf00051c0 0x7fbaf000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:35.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.559+0000 7fbb02ffd640 1 --2- 172.21.15.123:0/1292399636 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbaf00039b0 0x7fbaf0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:35.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.559+0000 7fbafa7fc640 1 --2- 172.21.15.123:0/1292399636 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbaf0004800 0x7fbaf0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:35.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.559+0000 7fbb037fe640 1 -- 172.21.15.123:0/1292399636 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbaf00039b0 msgr2=0x7fbaf0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:35.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.559+0000 7fbb037fe640 1 --2- 172.21.15.123:0/1292399636 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbaf00039b0 0x7fbaf0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.559+0000 7fbb037fe640 1 -- 172.21.15.123:0/1292399636 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbaf0004800 msgr2=0x7fbaf0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:35.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.559+0000 7fbb037fe640 1 --2- 172.21.15.123:0/1292399636 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbaf0004800 0x7fbaf0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.559+0000 7fbb037fe640 1 -- 172.21.15.123:0/1292399636 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf0003520 con 0x7fbaf00051c0 2024-09-15T23:22:35.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.560+0000 7fbb037fe640 1 -- 172.21.15.123:0/1292399636 reap_dead start 2024-09-15T23:22:35.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.560+0000 7fbb037fe640 1 --2- 172.21.15.123:0/1292399636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbaf00051c0 0x7fbaf000b9c0 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7fbafc00a840 tx=0x7fbaf0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79b492ff156cbfcb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:35.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.560+0000 7fbb027fc640 1 -- 172.21.15.123:0/1292399636 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbafc00a460 con 0x7fbaf00051c0 2024-09-15T23:22:35.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.560+0000 7fbb027fc640 1 -- 172.21.15.123:0/1292399636 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbafc02f070 con 0x7fbaf00051c0 2024-09-15T23:22:35.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.560+0000 7fbb027fc640 1 -- 172.21.15.123:0/1292399636 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbafc02bcb0 con 0x7fbaf00051c0 2024-09-15T23:22:35.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.561+0000 7fbb0985e640 1 -- 172.21.15.123:0/1292399636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbaf00051c0 msgr2=0x7fbaf000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:35.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.561+0000 7fbb0985e640 1 --2- 172.21.15.123:0/1292399636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbaf00051c0 0x7fbaf000b9c0 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7fbafc00a840 tx=0x7fbaf0005830 comp rx=0 tx=0).stop 2024-09-15T23:22:35.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.561+0000 7fbb0985e640 1 -- 172.21.15.123:0/1292399636 shutdown_connections 2024-09-15T23:22:35.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.561+0000 7fbb0985e640 1 --2- 172.21.15.123:0/1292399636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbaf00051c0 0x7fbaf000b9c0 unknown :-1 s=CLOSED pgs=2114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.561+0000 7fbb0985e640 1 -- 172.21.15.123:0/1292399636 >> 172.21.15.123:0/1292399636 conn(0x7fbb04067fb0 msgr2=0x7fbb0406f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:35.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.561+0000 7fbb0985e640 1 -- 172.21.15.123:0/1292399636 shutdown_connections 2024-09-15T23:22:35.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.561+0000 7fbb0985e640 1 -- 172.21.15.123:0/1292399636 wait complete. 2024-09-15T23:22:35.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.562+0000 7fbb0985e640 1 Processor -- start 2024-09-15T23:22:35.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.562+0000 7fbb0985e640 1 -- start start 2024-09-15T23:22:35.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.563+0000 7fbb0985e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbaf00051c0 0x7fbb041f18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:35.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.563+0000 7fbb0985e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb04152af0 0x7fbb04152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:35.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.563+0000 7fbb0985e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbb0414b440 0x7fbb0414b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:35.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.563+0000 7fbb0985e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbb04071390 con 0x7fbb04152af0 2024-09-15T23:22:35.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.563+0000 7fbb0985e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0415f8f0 con 0x7fbb0414b440 2024-09-15T23:22:35.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.563+0000 7fbb0985e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbb04071510 con 0x7fbaf00051c0 2024-09-15T23:22:35.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.563+0000 7fbafa7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb04152af0 0x7fbb04152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:35.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.563+0000 7fbafa7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb04152af0 0x7fbb04152f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35658/0 (socket says 172.21.15.123:35658) 2024-09-15T23:22:35.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.563+0000 7fbafa7fc640 1 -- 172.21.15.123:0/1736177055 learned_addr learned my addr 172.21.15.123:0/1736177055 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:35.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.563+0000 7fbb02ffd640 1 --2- 172.21.15.123:0/1736177055 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbaf00051c0 0x7fbb041f18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:35.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.563+0000 7fbb037fe640 1 --2- 172.21.15.123:0/1736177055 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbb0414b440 0x7fbb0414b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:35.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.563+0000 7fbafa7fc640 1 -- 172.21.15.123:0/1736177055 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbaf00051c0 msgr2=0x7fbb041f18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:35.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.563+0000 7fbafa7fc640 1 --2- 172.21.15.123:0/1736177055 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbaf00051c0 0x7fbb041f18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.563+0000 7fbafa7fc640 1 -- 172.21.15.123:0/1736177055 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbb0414b440 msgr2=0x7fbb0414b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:35.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.563+0000 7fbafa7fc640 1 --2- 172.21.15.123:0/1736177055 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbb0414b440 0x7fbb0414b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.563+0000 7fbafa7fc640 1 -- 172.21.15.123:0/1736177055 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb041f1e10 con 0x7fbb04152af0 2024-09-15T23:22:35.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.563+0000 7fbb02ffd640 1 --2- 172.21.15.123:0/1736177055 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbaf00051c0 0x7fbb041f18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:35.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.563+0000 7fbafa7fc640 1 --2- 172.21.15.123:0/1736177055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb04152af0 0x7fbb04152f50 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7fbaec0115c0 tx=0x7fbaec011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:35.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.563+0000 7fbb00ff9640 1 -- 172.21.15.123:0/1736177055 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaec004220 con 0x7fbb04152af0 2024-09-15T23:22:35.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.563+0000 7fbb00ff9640 1 -- 172.21.15.123:0/1736177055 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaec0043c0 con 0x7fbb04152af0 2024-09-15T23:22:35.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.563+0000 7fbb00ff9640 1 -- 172.21.15.123:0/1736177055 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaec015930 con 0x7fbb04152af0 2024-09-15T23:22:35.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.563+0000 7fbb0985e640 1 -- 172.21.15.123:0/1736177055 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb0414c050 con 0x7fbb04152af0 2024-09-15T23:22:35.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.564+0000 7fbb0985e640 1 -- 172.21.15.123:0/1736177055 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb0414c610 con 0x7fbb04152af0 2024-09-15T23:22:35.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.564+0000 7fbb0985e640 1 -- 172.21.15.123:0/1736177055 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb0415cad0 con 0x7fbb04152af0 2024-09-15T23:22:35.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.565+0000 7fbb00ff9640 1 -- 172.21.15.123:0/1736177055 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbaec015ad0 con 0x7fbb04152af0 2024-09-15T23:22:35.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.565+0000 7fbb00ff9640 1 --2- 172.21.15.123:0/1736177055 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbae406c2e0 0x7fbae406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:35.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.565+0000 7fbb00ff9640 1 -- 172.21.15.123:0/1736177055 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7fbaec08b620 con 0x7fbb04152af0 2024-09-15T23:22:35.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.565+0000 7fbb02ffd640 1 --2- 172.21.15.123:0/1736177055 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbae406c2e0 0x7fbae406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:35.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.566+0000 7fbb02ffd640 1 --2- 172.21.15.123:0/1736177055 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbae406c2e0 0x7fbae406e7a0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4000c00 tx=0x7fbaf4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:35.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.569+0000 7fbb00ff9640 1 -- 172.21.15.123:0/1736177055 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbaec019030 con 0x7fbb04152af0 2024-09-15T23:22:35.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.768+0000 7fbb0985e640 1 -- 172.21.15.123:0/1736177055 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fbb040718a0 con 0x7fbb04152af0 2024-09-15T23:22:35.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.769+0000 7fbb00ff9640 1 -- 172.21.15.123:0/1736177055 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v110) ==== 53+0+73 (secure 0 0 0) 0x7fbaec059d90 con 0x7fbb04152af0 2024-09-15T23:22:35.770 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:22:35.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.771+0000 7fbb0985e640 1 -- 172.21.15.123:0/1736177055 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbae406c2e0 msgr2=0x7fbae406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:35.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.771+0000 7fbb0985e640 1 --2- 172.21.15.123:0/1736177055 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbae406c2e0 0x7fbae406e7a0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4000c00 tx=0x7fbaf4009040 comp rx=0 tx=0).stop 2024-09-15T23:22:35.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.771+0000 7fbb0985e640 1 -- 172.21.15.123:0/1736177055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb04152af0 msgr2=0x7fbb04152f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:35.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.771+0000 7fbb0985e640 1 --2- 172.21.15.123:0/1736177055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb04152af0 0x7fbb04152f50 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7fbaec0115c0 tx=0x7fbaec011a80 comp rx=0 tx=0).stop 2024-09-15T23:22:35.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.771+0000 7fbb0985e640 1 -- 172.21.15.123:0/1736177055 shutdown_connections 2024-09-15T23:22:35.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.771+0000 7fbb0985e640 1 --2- 172.21.15.123:0/1736177055 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbb0414b440 0x7fbb0414b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.771+0000 7fbb0985e640 1 --2- 172.21.15.123:0/1736177055 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbae406c2e0 0x7fbae406e7a0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.771+0000 7fbb0985e640 1 --2- 172.21.15.123:0/1736177055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbb04152af0 0x7fbb04152f50 unknown :-1 s=CLOSED pgs=2115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.771+0000 7fbb0985e640 1 --2- 172.21.15.123:0/1736177055 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbaf00051c0 0x7fbb041f18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:35.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.771+0000 7fbb0985e640 1 -- 172.21.15.123:0/1736177055 >> 172.21.15.123:0/1736177055 conn(0x7fbb04067fb0 msgr2=0x7fbb040b2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:35.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.771+0000 7fbb0985e640 1 -- 172.21.15.123:0/1736177055 shutdown_connections 2024-09-15T23:22:35.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:35.771+0000 7fbb0985e640 1 -- 172.21.15.123:0/1736177055 wait complete. 2024-09-15T23:22:35.783 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T23:22:35.783 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:22:35.783 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-09-15T23:22:35.783 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T23:22:35.783 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T23:22:35.783 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T23:22:35.783 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T23:22:35.783 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:22:35.783 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:22:35.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:22:35.784 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-09-15T23:22:35.799 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:22:35.800 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:22:35.800 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:22:35.800 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:22:35.800 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-09-15T23:22:35.800 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:22:35.800 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:22:35.800 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-09-15T23:22:35.800 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f0 2024-09-15T23:22:35.800 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:22:35.800 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:22:35.800 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f1 2024-09-15T23:22:35.800 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:22:35.801 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:22:35.801 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:22:35.801 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:22:35.801 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T23:22:35.801 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42184sec preferred_lft 42184sec 2024-09-15T23:22:35.801 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link noprefixroute 2024-09-15T23:22:35.801 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:22:35.801 INFO:teuthology.orchestra.run.smithi123.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:22:35.801 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 46:55:5a:e0:32:4d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:22:35.801 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:22:35.801 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:22:35.801 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::1c6f:d5ff:fe19:ff05/64 scope link 2024-09-15T23:22:35.801 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:22:35.801 INFO:teuthology.orchestra.run.smithi123.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:22:35.802 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 46:55:5a:e0:32:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:22:35.802 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::4455:5aff:fee0:324d/64 scope link 2024-09-15T23:22:35.802 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:22:35.802 INFO:teuthology.orchestra.run.smithi123.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:22:35.802 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether be:c1:f3:63:cb:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:22:35.802 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::bcc1:f3ff:fe63:cb24/64 scope link 2024-09-15T23:22:35.802 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:22:35.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:22:35.802 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:22:35.863 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-09-15T23:22:35.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:22:35.864 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-09-15T23:22:35.921 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-09-15T23:22:35.921 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:22:35.921 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:22:35.922 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:22:35.922 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:22:35.922 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:22:35.922 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:22:35.922 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:22:35.922 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:22:35.923 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:22:35.923 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:22:36.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:22:36.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:22:36.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:22:36.048 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-09-15T23:22:36.063 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T23:22:36.064 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:22:36.064 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:22:36.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:22:36.064 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2024-09-15T23:22:36.128 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:22:36.128 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T23:22:36.184 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:22:36.185 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:22:36.185 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:22:36.239 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T23:22:36.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:22:36.240 DEBUG:teuthology.orchestra.run.smithi123:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:22:36.323 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:22:36.323 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:22:36.323 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:22:36.331 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:22:36.332 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:22:36.332 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:22:36.332 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.188:3300,172.21.15.188:3301" 2024-09-15T23:22:36.332 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T23:22:36.350 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:22:36.350 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:22:36.350 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:22:36.350 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.188:3300,172.21.15.188:3301" 2024-09-15T23:22:36.350 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T23:22:36.350 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:6789,172.21.15.188:6789,172.21.15.188:6790" 2024-09-15T23:22:36.350 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.123:6789,172.21.15.188:6789,172.21.15.188:6790:/ 2024-09-15T23:22:36.350 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=cb968ac4-8d3a-4b17-a673-6177aeaea589" will pass to kernel 2024-09-15T23:22:36.351 INFO:teuthology.orchestra.run.smithi123.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-15T23:22:36.351 INFO:teuthology.orchestra.run.smithi123.stdout: You just mounted a file system that supports labels which does not 2024-09-15T23:22:36.351 INFO:teuthology.orchestra.run.smithi123.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T23:22:36.351 INFO:teuthology.orchestra.run.smithi123.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T23:22:36.351 INFO:teuthology.orchestra.run.smithi123.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T23:22:36.352 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T23:22:36.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:22:36.352 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:22:36.418 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T23:22:36.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:22:36.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:22:36.520 INFO:teuthology.orchestra.run.smithi123.stdout:client7547 2024-09-15T23:22:36.521 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:22:36.521 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:22:36.537 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:22:36.537 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:22:36.537 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.0 2024-09-15T23:22:36.537 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:22:36.537 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:22:36.537 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:22:36.537 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:22:36.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:22:36.643 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:36.643 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:36.643 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100392 s, 104 MB/s 2024-09-15T23:22:36.652 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:36.652 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:36.652 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764525 s, 137 MB/s 2024-09-15T23:22:36.661 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:36.662 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:36.662 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00785823 s, 133 MB/s 2024-09-15T23:22:36.670 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:36.670 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:36.670 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702396 s, 149 MB/s 2024-09-15T23:22:36.679 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:36.679 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:36.679 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00685577 s, 153 MB/s 2024-09-15T23:22:36.688 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:36.688 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:36.688 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726904 s, 144 MB/s 2024-09-15T23:22:36.697 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:36.697 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:36.697 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724774 s, 145 MB/s 2024-09-15T23:22:36.706 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:36.706 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:36.706 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718478 s, 146 MB/s 2024-09-15T23:22:36.716 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:36.717 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:36.717 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00824946 s, 127 MB/s 2024-09-15T23:22:36.724 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:36.724 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:36.724 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609257 s, 172 MB/s 2024-09-15T23:22:36.733 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:36.733 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:36.733 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672638 s, 156 MB/s 2024-09-15T23:22:36.741 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:36.741 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:36.741 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671016 s, 156 MB/s 2024-09-15T23:22:36.749 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:36.749 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:36.749 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639622 s, 164 MB/s 2024-09-15T23:22:36.759 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:36.759 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:36.759 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00834879 s, 126 MB/s 2024-09-15T23:22:36.768 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:36.768 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:36.768 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750341 s, 140 MB/s 2024-09-15T23:22:36.777 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:36.778 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:36.778 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744717 s, 141 MB/s 2024-09-15T23:22:36.786 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:36.787 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:36.787 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707534 s, 148 MB/s 2024-09-15T23:22:36.796 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:36.796 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:36.796 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00757155 s, 138 MB/s 2024-09-15T23:22:36.804 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:36.804 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:36.804 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670367 s, 156 MB/s 2024-09-15T23:22:36.814 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:36.814 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:36.814 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00794871 s, 132 MB/s 2024-09-15T23:22:36.823 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:36.823 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:36.823 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707995 s, 148 MB/s 2024-09-15T23:22:36.833 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:36.833 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:36.833 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740808 s, 142 MB/s 2024-09-15T23:22:36.841 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:36.841 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:36.841 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716586 s, 146 MB/s 2024-09-15T23:22:36.850 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:36.850 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:36.850 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675024 s, 155 MB/s 2024-09-15T23:22:36.857 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:36.857 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:36.857 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583882 s, 180 MB/s 2024-09-15T23:22:36.865 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:36.866 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:36.866 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670135 s, 156 MB/s 2024-09-15T23:22:36.873 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:36.874 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:36.874 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635306 s, 165 MB/s 2024-09-15T23:22:36.881 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:36.881 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:36.881 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585958 s, 179 MB/s 2024-09-15T23:22:36.889 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:36.889 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:36.889 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687984 s, 152 MB/s 2024-09-15T23:22:36.898 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:36.898 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:36.898 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728062 s, 144 MB/s 2024-09-15T23:22:36.906 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:36.907 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:36.907 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648335 s, 162 MB/s 2024-09-15T23:22:36.916 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:36.916 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:36.916 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00806363 s, 130 MB/s 2024-09-15T23:22:36.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:22:36.923 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:22:36.923 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:22:36.923 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.1 2024-09-15T23:22:36.923 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:22:36.923 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:22:36.923 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:22:36.923 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:22:36.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:22:36.982 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:36.982 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:36.982 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659178 s, 159 MB/s 2024-09-15T23:22:36.991 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:36.991 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:36.991 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731725 s, 143 MB/s 2024-09-15T23:22:37.000 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.000 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.000 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725481 s, 145 MB/s 2024-09-15T23:22:37.009 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.009 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.009 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676582 s, 155 MB/s 2024-09-15T23:22:37.017 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.017 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.017 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669309 s, 157 MB/s 2024-09-15T23:22:37.025 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.025 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.025 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600046 s, 175 MB/s 2024-09-15T23:22:37.034 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.034 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.034 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733607 s, 143 MB/s 2024-09-15T23:22:37.042 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.042 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.042 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600935 s, 174 MB/s 2024-09-15T23:22:37.051 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.051 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.051 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733497 s, 143 MB/s 2024-09-15T23:22:37.059 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.059 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.059 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638137 s, 164 MB/s 2024-09-15T23:22:37.067 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.067 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.068 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637202 s, 165 MB/s 2024-09-15T23:22:37.075 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.076 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.076 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067351 s, 156 MB/s 2024-09-15T23:22:37.085 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.085 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.085 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720374 s, 146 MB/s 2024-09-15T23:22:37.094 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.094 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.094 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746959 s, 140 MB/s 2024-09-15T23:22:37.102 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.102 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.102 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654617 s, 160 MB/s 2024-09-15T23:22:37.111 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.111 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.111 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738129 s, 142 MB/s 2024-09-15T23:22:37.121 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.121 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.121 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743856 s, 141 MB/s 2024-09-15T23:22:37.129 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.129 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.129 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732093 s, 143 MB/s 2024-09-15T23:22:37.138 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.138 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.138 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648694 s, 162 MB/s 2024-09-15T23:22:37.147 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.147 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.147 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748209 s, 140 MB/s 2024-09-15T23:22:37.156 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.156 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.156 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735148 s, 143 MB/s 2024-09-15T23:22:37.164 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.164 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.165 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681132 s, 154 MB/s 2024-09-15T23:22:37.174 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.174 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.174 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751126 s, 140 MB/s 2024-09-15T23:22:37.182 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.182 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.182 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658076 s, 159 MB/s 2024-09-15T23:22:37.191 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.191 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.191 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00774643 s, 135 MB/s 2024-09-15T23:22:37.199 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.200 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.200 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064949 s, 161 MB/s 2024-09-15T23:22:37.207 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.208 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.208 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640932 s, 164 MB/s 2024-09-15T23:22:37.216 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.216 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.216 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673314 s, 156 MB/s 2024-09-15T23:22:37.224 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.225 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.225 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644937 s, 163 MB/s 2024-09-15T23:22:37.232 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.232 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.232 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637523 s, 164 MB/s 2024-09-15T23:22:37.240 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.240 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.240 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582985 s, 180 MB/s 2024-09-15T23:22:37.248 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.248 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.248 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652164 s, 161 MB/s 2024-09-15T23:22:37.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:22:37.255 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:22:37.255 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:22:37.255 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.2 2024-09-15T23:22:37.255 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:22:37.255 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:22:37.255 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:22:37.255 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:22:37.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:22:37.314 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.314 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.314 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671877 s, 156 MB/s 2024-09-15T23:22:37.322 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.322 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.322 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659474 s, 159 MB/s 2024-09-15T23:22:37.330 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.330 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.330 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654614 s, 160 MB/s 2024-09-15T23:22:37.338 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.338 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.338 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620467 s, 169 MB/s 2024-09-15T23:22:37.346 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.346 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.346 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624718 s, 168 MB/s 2024-09-15T23:22:37.354 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.354 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.354 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605889 s, 173 MB/s 2024-09-15T23:22:37.362 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.362 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.362 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645923 s, 162 MB/s 2024-09-15T23:22:37.370 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.371 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.371 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660778 s, 159 MB/s 2024-09-15T23:22:37.378 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.378 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.378 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589626 s, 178 MB/s 2024-09-15T23:22:37.387 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.387 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.387 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707788 s, 148 MB/s 2024-09-15T23:22:37.394 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.394 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.394 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579489 s, 181 MB/s 2024-09-15T23:22:37.403 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.403 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.404 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742665 s, 141 MB/s 2024-09-15T23:22:37.412 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.412 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.412 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735463 s, 143 MB/s 2024-09-15T23:22:37.421 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.421 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.421 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716551 s, 146 MB/s 2024-09-15T23:22:37.429 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.430 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.430 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664282 s, 158 MB/s 2024-09-15T23:22:37.438 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.438 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.438 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670429 s, 156 MB/s 2024-09-15T23:22:37.446 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.446 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.446 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623963 s, 168 MB/s 2024-09-15T23:22:37.455 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.455 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.455 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736725 s, 142 MB/s 2024-09-15T23:22:37.463 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.463 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.463 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652041 s, 161 MB/s 2024-09-15T23:22:37.472 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.472 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.472 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733236 s, 143 MB/s 2024-09-15T23:22:37.480 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.480 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.480 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604507 s, 173 MB/s 2024-09-15T23:22:37.488 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.488 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.488 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660774 s, 159 MB/s 2024-09-15T23:22:37.497 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.497 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.497 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717665 s, 146 MB/s 2024-09-15T23:22:37.505 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.506 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.506 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657951 s, 159 MB/s 2024-09-15T23:22:37.514 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.514 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.514 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724728 s, 145 MB/s 2024-09-15T23:22:37.522 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.522 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.522 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579081 s, 181 MB/s 2024-09-15T23:22:37.530 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.530 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.530 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654174 s, 160 MB/s 2024-09-15T23:22:37.539 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.540 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.540 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752589 s, 139 MB/s 2024-09-15T23:22:37.548 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.548 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.548 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715844 s, 146 MB/s 2024-09-15T23:22:37.557 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.557 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.557 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655295 s, 160 MB/s 2024-09-15T23:22:37.564 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.565 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.565 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634044 s, 165 MB/s 2024-09-15T23:22:37.573 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.573 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.573 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065683 s, 160 MB/s 2024-09-15T23:22:37.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:22:37.579 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:22:37.579 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:22:37.579 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.3 2024-09-15T23:22:37.579 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:22:37.580 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:22:37.580 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:22:37.580 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:22:37.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:22:37.639 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.639 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.639 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671532 s, 156 MB/s 2024-09-15T23:22:37.648 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.648 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.648 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703225 s, 149 MB/s 2024-09-15T23:22:37.656 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.656 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.656 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633895 s, 165 MB/s 2024-09-15T23:22:37.665 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.665 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.665 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072763 s, 144 MB/s 2024-09-15T23:22:37.673 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.673 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.673 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064895 s, 162 MB/s 2024-09-15T23:22:37.681 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.681 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.681 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616026 s, 170 MB/s 2024-09-15T23:22:37.689 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.689 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.689 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057003 s, 184 MB/s 2024-09-15T23:22:37.697 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.697 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.697 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682607 s, 154 MB/s 2024-09-15T23:22:37.705 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.705 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.705 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587225 s, 179 MB/s 2024-09-15T23:22:37.714 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.714 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.714 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741574 s, 141 MB/s 2024-09-15T23:22:37.722 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.722 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.722 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061387 s, 171 MB/s 2024-09-15T23:22:37.730 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.730 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.730 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634419 s, 165 MB/s 2024-09-15T23:22:37.740 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.740 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.740 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0080169 s, 131 MB/s 2024-09-15T23:22:37.748 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.748 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.749 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646917 s, 162 MB/s 2024-09-15T23:22:37.756 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.756 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.756 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647762 s, 162 MB/s 2024-09-15T23:22:37.764 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.764 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.764 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632193 s, 166 MB/s 2024-09-15T23:22:37.773 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.773 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.773 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723542 s, 145 MB/s 2024-09-15T23:22:37.782 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.782 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.782 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727276 s, 144 MB/s 2024-09-15T23:22:37.791 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.791 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.791 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751268 s, 140 MB/s 2024-09-15T23:22:37.799 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.799 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.799 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606423 s, 173 MB/s 2024-09-15T23:22:37.807 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.807 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.807 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642389 s, 163 MB/s 2024-09-15T23:22:37.815 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.815 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.815 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572317 s, 183 MB/s 2024-09-15T23:22:37.823 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.824 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.824 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672799 s, 156 MB/s 2024-09-15T23:22:37.831 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.831 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.832 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648344 s, 162 MB/s 2024-09-15T23:22:37.839 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.840 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.840 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639803 s, 164 MB/s 2024-09-15T23:22:37.849 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.849 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.849 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761164 s, 138 MB/s 2024-09-15T23:22:37.859 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.859 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.859 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00869786 s, 121 MB/s 2024-09-15T23:22:37.867 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.867 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.868 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653131 s, 161 MB/s 2024-09-15T23:22:37.875 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.876 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.876 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064728 s, 162 MB/s 2024-09-15T23:22:37.884 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.884 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.884 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667335 s, 157 MB/s 2024-09-15T23:22:37.891 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.891 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.891 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584521 s, 179 MB/s 2024-09-15T23:22:37.899 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.899 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.899 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575657 s, 182 MB/s 2024-09-15T23:22:37.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:22:37.906 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:22:37.906 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:22:37.906 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.4 2024-09-15T23:22:37.906 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:22:37.906 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:22:37.906 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:22:37.906 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:22:37.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:22:37.965 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.965 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.965 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073025 s, 144 MB/s 2024-09-15T23:22:37.974 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.974 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.974 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725892 s, 144 MB/s 2024-09-15T23:22:37.982 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.982 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.983 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713564 s, 147 MB/s 2024-09-15T23:22:37.991 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.991 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.991 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707307 s, 148 MB/s 2024-09-15T23:22:37.999 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:37.999 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:37.999 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564437 s, 186 MB/s 2024-09-15T23:22:38.008 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.008 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.008 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720987 s, 145 MB/s 2024-09-15T23:22:38.017 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.017 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.017 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076235 s, 138 MB/s 2024-09-15T23:22:38.025 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.025 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.025 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667641 s, 157 MB/s 2024-09-15T23:22:38.034 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.034 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.034 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712506 s, 147 MB/s 2024-09-15T23:22:38.043 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.043 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.043 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704834 s, 149 MB/s 2024-09-15T23:22:38.052 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.052 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.052 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705219 s, 149 MB/s 2024-09-15T23:22:38.060 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.060 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.060 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638861 s, 164 MB/s 2024-09-15T23:22:38.069 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.069 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.069 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736709 s, 142 MB/s 2024-09-15T23:22:38.077 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.077 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.077 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592098 s, 177 MB/s 2024-09-15T23:22:38.085 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.086 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.086 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071181 s, 147 MB/s 2024-09-15T23:22:38.095 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.095 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.095 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717606 s, 146 MB/s 2024-09-15T23:22:38.103 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.103 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.103 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652412 s, 161 MB/s 2024-09-15T23:22:38.112 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.112 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.112 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777385 s, 135 MB/s 2024-09-15T23:22:38.121 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.121 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.121 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656759 s, 160 MB/s 2024-09-15T23:22:38.130 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.130 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.130 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745115 s, 141 MB/s 2024-09-15T23:22:38.138 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.138 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.138 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653764 s, 160 MB/s 2024-09-15T23:22:38.148 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.148 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.148 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635439 s, 165 MB/s 2024-09-15T23:22:38.155 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.155 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.156 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744186 s, 141 MB/s 2024-09-15T23:22:38.165 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.165 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.165 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00794496 s, 132 MB/s 2024-09-15T23:22:38.172 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.172 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.173 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578665 s, 181 MB/s 2024-09-15T23:22:38.180 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.180 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.180 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590843 s, 177 MB/s 2024-09-15T23:22:38.190 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.190 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.190 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007648 s, 137 MB/s 2024-09-15T23:22:38.198 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.198 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.198 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629182 s, 167 MB/s 2024-09-15T23:22:38.207 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.207 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.207 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756598 s, 139 MB/s 2024-09-15T23:22:38.215 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.215 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.215 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064006 s, 164 MB/s 2024-09-15T23:22:38.224 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.224 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.224 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729803 s, 144 MB/s 2024-09-15T23:22:38.232 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.232 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.233 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635308 s, 165 MB/s 2024-09-15T23:22:38.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:22:38.240 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:22:38.240 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:22:38.241 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.5 2024-09-15T23:22:38.241 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:22:38.241 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:22:38.241 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:22:38.241 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:22:38.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:22:38.300 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.300 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.300 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00674056 s, 156 MB/s 2024-09-15T23:22:38.308 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.308 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.308 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634598 s, 165 MB/s 2024-09-15T23:22:38.317 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.317 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.317 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720713 s, 145 MB/s 2024-09-15T23:22:38.325 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.325 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.326 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642757 s, 163 MB/s 2024-09-15T23:22:38.333 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.333 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.333 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590093 s, 178 MB/s 2024-09-15T23:22:38.342 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.342 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.342 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00737491 s, 142 MB/s 2024-09-15T23:22:38.352 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.352 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.352 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641622 s, 163 MB/s 2024-09-15T23:22:38.364 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.365 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.365 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125731 s, 83.4 MB/s 2024-09-15T23:22:38.373 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.373 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.373 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648035 s, 162 MB/s 2024-09-15T23:22:38.381 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.381 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.381 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661505 s, 159 MB/s 2024-09-15T23:22:38.390 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.390 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.390 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759569 s, 138 MB/s 2024-09-15T23:22:38.399 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.399 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.400 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00769236 s, 136 MB/s 2024-09-15T23:22:38.408 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.409 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.409 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723635 s, 145 MB/s 2024-09-15T23:22:38.416 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.416 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.416 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566148 s, 185 MB/s 2024-09-15T23:22:38.424 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.425 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.425 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679629 s, 154 MB/s 2024-09-15T23:22:38.433 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.434 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.434 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745939 s, 141 MB/s 2024-09-15T23:22:38.442 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.442 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.442 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632636 s, 166 MB/s 2024-09-15T23:22:38.450 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.450 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.450 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658254 s, 159 MB/s 2024-09-15T23:22:38.459 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.459 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.459 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730891 s, 143 MB/s 2024-09-15T23:22:38.467 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.467 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.467 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668778 s, 157 MB/s 2024-09-15T23:22:38.475 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.475 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.475 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575043 s, 182 MB/s 2024-09-15T23:22:38.484 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.484 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.484 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735674 s, 143 MB/s 2024-09-15T23:22:38.492 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.493 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.493 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066922 s, 157 MB/s 2024-09-15T23:22:38.500 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.500 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.500 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608874 s, 172 MB/s 2024-09-15T23:22:38.509 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.510 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.510 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740671 s, 142 MB/s 2024-09-15T23:22:38.519 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.519 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.519 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752111 s, 139 MB/s 2024-09-15T23:22:38.528 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.528 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.528 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738885 s, 142 MB/s 2024-09-15T23:22:38.536 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.536 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.536 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668906 s, 157 MB/s 2024-09-15T23:22:38.544 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.544 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.544 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058083 s, 181 MB/s 2024-09-15T23:22:38.553 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.554 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.554 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710775 s, 148 MB/s 2024-09-15T23:22:38.560 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.560 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.561 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595928 s, 176 MB/s 2024-09-15T23:22:38.567 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.568 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.568 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00547302 s, 192 MB/s 2024-09-15T23:22:38.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:22:38.574 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:22:38.574 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:22:38.574 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.6 2024-09-15T23:22:38.574 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:22:38.574 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:22:38.574 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:22:38.575 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:22:38.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:22:38.633 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.634 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.634 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637134 s, 165 MB/s 2024-09-15T23:22:38.641 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.641 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.642 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689129 s, 152 MB/s 2024-09-15T23:22:38.649 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.649 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.649 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00564025 s, 186 MB/s 2024-09-15T23:22:38.658 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.658 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.658 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718878 s, 146 MB/s 2024-09-15T23:22:38.666 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.667 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.667 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071873 s, 146 MB/s 2024-09-15T23:22:38.674 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.674 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.674 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603894 s, 174 MB/s 2024-09-15T23:22:38.683 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.683 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.683 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698379 s, 150 MB/s 2024-09-15T23:22:38.691 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.691 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.691 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626509 s, 167 MB/s 2024-09-15T23:22:38.698 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.698 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.698 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00567445 s, 185 MB/s 2024-09-15T23:22:38.706 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.706 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.707 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645094 s, 163 MB/s 2024-09-15T23:22:38.714 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.714 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.714 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594248 s, 176 MB/s 2024-09-15T23:22:38.724 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.724 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.724 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667243 s, 157 MB/s 2024-09-15T23:22:38.732 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.732 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.732 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647189 s, 162 MB/s 2024-09-15T23:22:38.739 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.739 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.739 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697839 s, 150 MB/s 2024-09-15T23:22:38.748 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.748 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.748 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699385 s, 150 MB/s 2024-09-15T23:22:38.756 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.756 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.756 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654822 s, 160 MB/s 2024-09-15T23:22:38.764 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.764 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.764 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634931 s, 165 MB/s 2024-09-15T23:22:38.772 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.772 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.772 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063591 s, 165 MB/s 2024-09-15T23:22:38.781 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.781 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.781 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673466 s, 156 MB/s 2024-09-15T23:22:38.790 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.790 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.790 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741377 s, 141 MB/s 2024-09-15T23:22:38.799 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.799 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.799 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706411 s, 148 MB/s 2024-09-15T23:22:38.807 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.807 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.807 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645593 s, 162 MB/s 2024-09-15T23:22:38.814 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.815 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.815 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057358 s, 183 MB/s 2024-09-15T23:22:38.823 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.823 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.823 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701957 s, 149 MB/s 2024-09-15T23:22:38.831 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.831 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.831 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589784 s, 178 MB/s 2024-09-15T23:22:38.840 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.840 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.840 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748107 s, 140 MB/s 2024-09-15T23:22:38.848 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.848 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.849 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668335 s, 157 MB/s 2024-09-15T23:22:38.857 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.857 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.857 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717374 s, 146 MB/s 2024-09-15T23:22:38.866 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.866 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.866 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073472 s, 143 MB/s 2024-09-15T23:22:38.874 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.874 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.875 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642426 s, 163 MB/s 2024-09-15T23:22:38.883 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.883 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.883 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658378 s, 159 MB/s 2024-09-15T23:22:38.891 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.891 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.891 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655454 s, 160 MB/s 2024-09-15T23:22:38.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:22:38.898 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:22:38.898 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:22:38.898 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.7 2024-09-15T23:22:38.899 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:22:38.899 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:22:38.899 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:22:38.899 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:22:38.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:22:38.957 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.957 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.957 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642102 s, 163 MB/s 2024-09-15T23:22:38.967 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.967 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.967 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673653 s, 156 MB/s 2024-09-15T23:22:38.974 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.974 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.975 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732479 s, 143 MB/s 2024-09-15T23:22:38.982 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.982 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.982 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628153 s, 167 MB/s 2024-09-15T23:22:38.990 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.990 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.990 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594795 s, 176 MB/s 2024-09-15T23:22:38.999 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:38.999 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:38.999 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723769 s, 145 MB/s 2024-09-15T23:22:39.007 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.007 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.007 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626395 s, 167 MB/s 2024-09-15T23:22:39.015 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.015 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.015 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609135 s, 172 MB/s 2024-09-15T23:22:39.023 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.024 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.024 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669305 s, 157 MB/s 2024-09-15T23:22:39.032 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.032 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.032 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639331 s, 164 MB/s 2024-09-15T23:22:39.041 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.041 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.041 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748675 s, 140 MB/s 2024-09-15T23:22:39.049 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.049 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.049 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659041 s, 159 MB/s 2024-09-15T23:22:39.059 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.059 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.059 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768786 s, 136 MB/s 2024-09-15T23:22:39.067 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.068 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.068 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712161 s, 147 MB/s 2024-09-15T23:22:39.076 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.076 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.076 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591906 s, 177 MB/s 2024-09-15T23:22:39.084 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.084 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.084 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665863 s, 157 MB/s 2024-09-15T23:22:39.093 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.093 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.093 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007206 s, 146 MB/s 2024-09-15T23:22:39.101 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.102 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.102 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689069 s, 152 MB/s 2024-09-15T23:22:39.109 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.109 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.109 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621256 s, 169 MB/s 2024-09-15T23:22:39.117 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.117 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.118 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664318 s, 158 MB/s 2024-09-15T23:22:39.126 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.126 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.126 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722903 s, 145 MB/s 2024-09-15T23:22:39.134 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.134 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.134 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597543 s, 175 MB/s 2024-09-15T23:22:39.143 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.143 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.143 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731716 s, 143 MB/s 2024-09-15T23:22:39.153 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.153 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.153 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076783 s, 137 MB/s 2024-09-15T23:22:39.161 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.161 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.161 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662193 s, 158 MB/s 2024-09-15T23:22:39.169 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.170 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.170 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661373 s, 159 MB/s 2024-09-15T23:22:39.178 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.178 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.178 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064786 s, 162 MB/s 2024-09-15T23:22:39.185 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.186 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.186 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591988 s, 177 MB/s 2024-09-15T23:22:39.193 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.193 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.194 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642604 s, 163 MB/s 2024-09-15T23:22:39.202 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.202 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.203 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746584 s, 140 MB/s 2024-09-15T23:22:39.211 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.211 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.211 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719611 s, 146 MB/s 2024-09-15T23:22:39.220 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.220 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.220 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651887 s, 161 MB/s 2024-09-15T23:22:39.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:22:39.226 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:22:39.226 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:22:39.226 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.8 2024-09-15T23:22:39.226 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:22:39.226 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:22:39.227 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:22:39.227 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:22:39.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:22:39.286 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.286 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.286 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720547 s, 146 MB/s 2024-09-15T23:22:39.294 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.294 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.295 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652517 s, 161 MB/s 2024-09-15T23:22:39.303 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.303 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.303 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728974 s, 144 MB/s 2024-09-15T23:22:39.311 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.311 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.311 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588641 s, 178 MB/s 2024-09-15T23:22:39.320 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.320 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.320 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759923 s, 138 MB/s 2024-09-15T23:22:39.328 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.328 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.328 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0057267 s, 183 MB/s 2024-09-15T23:22:39.336 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.336 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.337 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661966 s, 158 MB/s 2024-09-15T23:22:39.344 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.344 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.344 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576661 s, 182 MB/s 2024-09-15T23:22:39.353 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.353 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.353 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075342 s, 139 MB/s 2024-09-15T23:22:39.362 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.362 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.362 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711966 s, 147 MB/s 2024-09-15T23:22:39.370 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.370 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.370 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677912 s, 155 MB/s 2024-09-15T23:22:39.378 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.378 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.378 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566218 s, 185 MB/s 2024-09-15T23:22:39.386 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.386 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.386 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656507 s, 160 MB/s 2024-09-15T23:22:39.395 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.395 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.395 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716157 s, 146 MB/s 2024-09-15T23:22:39.403 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.403 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.403 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664304 s, 158 MB/s 2024-09-15T23:22:39.412 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.412 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.412 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074544 s, 141 MB/s 2024-09-15T23:22:39.421 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.421 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.421 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732314 s, 143 MB/s 2024-09-15T23:22:39.429 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.429 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.430 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638128 s, 164 MB/s 2024-09-15T23:22:39.439 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.439 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.439 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00789982 s, 133 MB/s 2024-09-15T23:22:39.448 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.448 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.448 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651759 s, 161 MB/s 2024-09-15T23:22:39.457 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.457 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.457 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726752 s, 144 MB/s 2024-09-15T23:22:39.465 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.466 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.466 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732076 s, 143 MB/s 2024-09-15T23:22:39.474 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.474 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.474 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700296 s, 150 MB/s 2024-09-15T23:22:39.483 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.483 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.483 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648239 s, 162 MB/s 2024-09-15T23:22:39.491 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.492 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.492 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707642 s, 148 MB/s 2024-09-15T23:22:39.500 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.500 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.500 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715152 s, 147 MB/s 2024-09-15T23:22:39.509 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.509 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.509 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713053 s, 147 MB/s 2024-09-15T23:22:39.518 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.518 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.518 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669481 s, 157 MB/s 2024-09-15T23:22:39.526 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.526 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.527 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00682903 s, 154 MB/s 2024-09-15T23:22:39.534 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.535 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.535 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642941 s, 163 MB/s 2024-09-15T23:22:39.543 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.543 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.543 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663287 s, 158 MB/s 2024-09-15T23:22:39.552 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.552 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.552 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749408 s, 140 MB/s 2024-09-15T23:22:39.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:22:39.559 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:22:39.559 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:22:39.559 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.9 2024-09-15T23:22:39.559 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:22:39.559 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:22:39.559 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:22:39.559 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:22:39.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:22:39.616 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.616 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.616 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590141 s, 178 MB/s 2024-09-15T23:22:39.624 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.624 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.625 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664853 s, 158 MB/s 2024-09-15T23:22:39.633 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.633 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.634 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721646 s, 145 MB/s 2024-09-15T23:22:39.642 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.642 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.642 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681811 s, 154 MB/s 2024-09-15T23:22:39.650 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.650 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.650 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646954 s, 162 MB/s 2024-09-15T23:22:39.658 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.658 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.658 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698212 s, 150 MB/s 2024-09-15T23:22:39.667 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.667 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.667 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680668 s, 154 MB/s 2024-09-15T23:22:39.675 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.675 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.676 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067365 s, 156 MB/s 2024-09-15T23:22:39.684 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.685 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.685 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734677 s, 143 MB/s 2024-09-15T23:22:39.694 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.694 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.694 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746467 s, 140 MB/s 2024-09-15T23:22:39.702 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.703 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.703 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711158 s, 147 MB/s 2024-09-15T23:22:39.712 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.712 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.712 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745281 s, 141 MB/s 2024-09-15T23:22:39.720 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.720 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.720 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668914 s, 157 MB/s 2024-09-15T23:22:39.729 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.729 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.729 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703591 s, 149 MB/s 2024-09-15T23:22:39.738 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.738 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.739 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007295 s, 144 MB/s 2024-09-15T23:22:39.746 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.747 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.747 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00681286 s, 154 MB/s 2024-09-15T23:22:39.754 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.754 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.754 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563784 s, 186 MB/s 2024-09-15T23:22:39.762 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.762 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.762 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658145 s, 159 MB/s 2024-09-15T23:22:39.772 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.772 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.772 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766274 s, 137 MB/s 2024-09-15T23:22:39.780 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.780 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.780 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650133 s, 161 MB/s 2024-09-15T23:22:39.788 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.788 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.789 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659324 s, 159 MB/s 2024-09-15T23:22:39.796 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.797 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.797 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647243 s, 162 MB/s 2024-09-15T23:22:39.805 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.805 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.805 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643634 s, 163 MB/s 2024-09-15T23:22:39.813 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.813 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.813 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692355 s, 151 MB/s 2024-09-15T23:22:39.821 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.821 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.821 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637698 s, 164 MB/s 2024-09-15T23:22:39.830 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.830 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.830 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074215 s, 141 MB/s 2024-09-15T23:22:39.838 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.839 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.839 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644142 s, 163 MB/s 2024-09-15T23:22:39.846 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.846 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.847 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625683 s, 168 MB/s 2024-09-15T23:22:39.854 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.854 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.854 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606279 s, 173 MB/s 2024-09-15T23:22:39.862 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.862 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.862 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621572 s, 169 MB/s 2024-09-15T23:22:39.870 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.871 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.871 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646741 s, 162 MB/s 2024-09-15T23:22:39.878 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.878 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.878 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626378 s, 167 MB/s 2024-09-15T23:22:39.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:22:39.885 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:22:39.885 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:22:39.885 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.10 2024-09-15T23:22:39.885 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:22:39.885 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:22:39.885 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:22:39.885 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:22:39.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:22:39.943 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.944 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.944 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677356 s, 155 MB/s 2024-09-15T23:22:39.955 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.955 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.955 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666334 s, 157 MB/s 2024-09-15T23:22:39.959 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.959 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.959 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566023 s, 185 MB/s 2024-09-15T23:22:39.969 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.969 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.969 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00774885 s, 135 MB/s 2024-09-15T23:22:39.977 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.977 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.977 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657403 s, 160 MB/s 2024-09-15T23:22:39.985 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.985 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.985 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653262 s, 161 MB/s 2024-09-15T23:22:39.994 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:39.994 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:39.994 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727972 s, 144 MB/s 2024-09-15T23:22:40.003 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.004 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.004 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722575 s, 145 MB/s 2024-09-15T23:22:40.012 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.012 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.012 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706173 s, 148 MB/s 2024-09-15T23:22:40.021 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.022 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.022 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761834 s, 138 MB/s 2024-09-15T23:22:40.029 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.029 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.030 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636113 s, 165 MB/s 2024-09-15T23:22:40.038 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.038 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.038 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654223 s, 160 MB/s 2024-09-15T23:22:40.045 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.045 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.045 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061738 s, 170 MB/s 2024-09-15T23:22:40.054 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.054 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.054 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070733 s, 148 MB/s 2024-09-15T23:22:40.063 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.063 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.063 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722998 s, 145 MB/s 2024-09-15T23:22:40.071 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.071 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.071 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574929 s, 182 MB/s 2024-09-15T23:22:40.080 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.080 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.080 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702402 s, 149 MB/s 2024-09-15T23:22:40.087 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.087 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.088 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578938 s, 181 MB/s 2024-09-15T23:22:40.095 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.095 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.095 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647027 s, 162 MB/s 2024-09-15T23:22:40.105 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.105 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.105 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00803477 s, 131 MB/s 2024-09-15T23:22:40.112 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.113 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.113 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574404 s, 183 MB/s 2024-09-15T23:22:40.121 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.121 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.121 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632101 s, 166 MB/s 2024-09-15T23:22:40.129 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.129 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.129 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694796 s, 151 MB/s 2024-09-15T23:22:40.138 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.138 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.138 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723778 s, 145 MB/s 2024-09-15T23:22:40.147 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.147 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.147 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671789 s, 156 MB/s 2024-09-15T23:22:40.154 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.154 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.154 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579583 s, 181 MB/s 2024-09-15T23:22:40.162 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.162 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.162 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583261 s, 180 MB/s 2024-09-15T23:22:40.171 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.171 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.172 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758298 s, 138 MB/s 2024-09-15T23:22:40.180 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.180 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.180 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00676683 s, 155 MB/s 2024-09-15T23:22:40.187 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.187 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.187 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563057 s, 186 MB/s 2024-09-15T23:22:40.195 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.195 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.195 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061573 s, 170 MB/s 2024-09-15T23:22:40.202 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.203 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.203 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568289 s, 185 MB/s 2024-09-15T23:22:40.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:22:40.209 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:22:40.209 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:22:40.209 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.11 2024-09-15T23:22:40.209 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:22:40.210 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:22:40.210 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:22:40.210 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:22:40.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:22:40.267 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.267 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.267 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574462 s, 183 MB/s 2024-09-15T23:22:40.275 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.275 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.276 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635827 s, 165 MB/s 2024-09-15T23:22:40.284 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.284 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.284 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670067 s, 156 MB/s 2024-09-15T23:22:40.291 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.291 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.292 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584302 s, 179 MB/s 2024-09-15T23:22:40.299 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.300 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.300 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006397 s, 164 MB/s 2024-09-15T23:22:40.308 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.308 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.308 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595756 s, 176 MB/s 2024-09-15T23:22:40.315 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.315 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.315 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576554 s, 182 MB/s 2024-09-15T23:22:40.323 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.323 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.323 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668323 s, 157 MB/s 2024-09-15T23:22:40.332 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.332 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.332 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680422 s, 154 MB/s 2024-09-15T23:22:40.340 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.340 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.340 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659269 s, 159 MB/s 2024-09-15T23:22:40.349 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.350 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.350 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779069 s, 135 MB/s 2024-09-15T23:22:40.357 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.357 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.357 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581499 s, 180 MB/s 2024-09-15T23:22:40.366 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.366 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.366 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673251 s, 156 MB/s 2024-09-15T23:22:40.375 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.375 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.376 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0078734 s, 133 MB/s 2024-09-15T23:22:40.383 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.383 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.383 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633064 s, 166 MB/s 2024-09-15T23:22:40.392 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.392 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.392 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666007 s, 157 MB/s 2024-09-15T23:22:40.400 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.400 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.400 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687529 s, 153 MB/s 2024-09-15T23:22:40.409 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.409 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.409 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740879 s, 142 MB/s 2024-09-15T23:22:40.418 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.418 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.418 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677516 s, 155 MB/s 2024-09-15T23:22:40.426 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.427 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.427 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726091 s, 144 MB/s 2024-09-15T23:22:40.436 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.436 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.436 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739362 s, 142 MB/s 2024-09-15T23:22:40.444 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:22:40.444 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.444 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.444 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063188 s, 166 MB/s 2024-09-15T23:22:40.446 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:22:40.451 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.452 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.452 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572873 s, 183 MB/s 2024-09-15T23:22:40.459 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.459 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.459 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059639 s, 176 MB/s 2024-09-15T23:22:40.467 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.467 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.467 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663105 s, 158 MB/s 2024-09-15T23:22:40.476 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.476 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.476 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752884 s, 139 MB/s 2024-09-15T23:22:40.484 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.484 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.484 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642569 s, 163 MB/s 2024-09-15T23:22:40.493 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.493 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.493 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660122 s, 159 MB/s 2024-09-15T23:22:40.501 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.501 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.501 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670681 s, 156 MB/s 2024-09-15T23:22:40.510 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.510 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.511 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00775991 s, 135 MB/s 2024-09-15T23:22:40.519 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.519 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.519 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672813 s, 156 MB/s 2024-09-15T23:22:40.526 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.526 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.526 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00566003 s, 185 MB/s 2024-09-15T23:22:40.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:22:40.533 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:22:40.533 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:22:40.533 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.12 2024-09-15T23:22:40.533 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:22:40.533 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:22:40.533 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:22:40.533 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:22:40.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:22:40.631 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.631 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.631 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628203 s, 167 MB/s 2024-09-15T23:22:40.640 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.640 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.640 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696835 s, 150 MB/s 2024-09-15T23:22:40.649 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.650 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.650 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00815773 s, 129 MB/s 2024-09-15T23:22:40.659 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.659 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.659 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00785579 s, 133 MB/s 2024-09-15T23:22:40.668 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.668 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.668 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712445 s, 147 MB/s 2024-09-15T23:22:40.676 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.676 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.677 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701665 s, 149 MB/s 2024-09-15T23:22:40.685 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.685 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.685 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675303 s, 155 MB/s 2024-09-15T23:22:40.693 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.693 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.693 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647138 s, 162 MB/s 2024-09-15T23:22:40.700 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.700 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.700 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577034 s, 182 MB/s 2024-09-15T23:22:40.708 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.708 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.708 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581958 s, 180 MB/s 2024-09-15T23:22:40.720 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.720 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.720 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102618 s, 102 MB/s 2024-09-15T23:22:40.728 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.728 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.728 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662799 s, 158 MB/s 2024-09-15T23:22:40.737 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.738 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.738 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765659 s, 137 MB/s 2024-09-15T23:22:40.746 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.746 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.746 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658286 s, 159 MB/s 2024-09-15T23:22:40.753 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.754 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.754 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00590024 s, 178 MB/s 2024-09-15T23:22:40.762 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.762 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.762 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00689479 s, 152 MB/s 2024-09-15T23:22:40.771 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.772 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.772 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741609 s, 141 MB/s 2024-09-15T23:22:40.780 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.781 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.781 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749237 s, 140 MB/s 2024-09-15T23:22:40.788 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.788 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.788 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600824 s, 175 MB/s 2024-09-15T23:22:40.798 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.798 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.798 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00804485 s, 130 MB/s 2024-09-15T23:22:40.808 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.808 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.808 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00820855 s, 128 MB/s 2024-09-15T23:22:40.816 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.816 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.816 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643338 s, 163 MB/s 2024-09-15T23:22:40.824 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.824 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.825 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658436 s, 159 MB/s 2024-09-15T23:22:40.833 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.833 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.833 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698738 s, 150 MB/s 2024-09-15T23:22:40.843 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.843 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.843 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00804119 s, 130 MB/s 2024-09-15T23:22:40.852 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.852 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.852 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747507 s, 140 MB/s 2024-09-15T23:22:40.860 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.861 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.861 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671006 s, 156 MB/s 2024-09-15T23:22:40.869 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.869 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.869 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651007 s, 161 MB/s 2024-09-15T23:22:40.877 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.877 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.877 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629749 s, 167 MB/s 2024-09-15T23:22:40.886 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.886 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.886 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739828 s, 142 MB/s 2024-09-15T23:22:40.893 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.894 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.894 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595329 s, 176 MB/s 2024-09-15T23:22:40.903 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.903 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.903 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732242 s, 143 MB/s 2024-09-15T23:22:40.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:22:40.910 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:22:40.910 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:22:40.910 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.13 2024-09-15T23:22:40.910 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:22:40.910 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:22:40.910 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:22:40.910 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:22:40.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:22:40.968 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.968 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.968 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00593716 s, 177 MB/s 2024-09-15T23:22:40.976 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.976 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.976 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660748 s, 159 MB/s 2024-09-15T23:22:40.984 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.984 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.984 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620685 s, 169 MB/s 2024-09-15T23:22:40.993 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:40.993 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:40.993 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725596 s, 145 MB/s 2024-09-15T23:22:41.001 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.001 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.002 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669629 s, 157 MB/s 2024-09-15T23:22:41.011 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.011 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.011 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00774115 s, 135 MB/s 2024-09-15T23:22:41.020 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.020 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.020 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00768888 s, 136 MB/s 2024-09-15T23:22:41.029 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.029 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.029 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701444 s, 149 MB/s 2024-09-15T23:22:41.037 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.037 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.037 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659527 s, 159 MB/s 2024-09-15T23:22:41.046 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.046 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.047 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00759835 s, 138 MB/s 2024-09-15T23:22:41.054 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.055 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.055 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643089 s, 163 MB/s 2024-09-15T23:22:41.063 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.063 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.063 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716314 s, 146 MB/s 2024-09-15T23:22:41.072 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.072 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.072 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714444 s, 147 MB/s 2024-09-15T23:22:41.080 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.080 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.080 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642689 s, 163 MB/s 2024-09-15T23:22:41.088 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.088 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.089 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063714 s, 165 MB/s 2024-09-15T23:22:41.096 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.096 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.097 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645018 s, 163 MB/s 2024-09-15T23:22:41.104 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.104 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.104 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00610004 s, 172 MB/s 2024-09-15T23:22:41.111 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.112 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.112 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572821 s, 183 MB/s 2024-09-15T23:22:41.119 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.119 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.119 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615285 s, 170 MB/s 2024-09-15T23:22:41.128 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.128 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.129 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761469 s, 138 MB/s 2024-09-15T23:22:41.136 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.136 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.136 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575464 s, 182 MB/s 2024-09-15T23:22:41.145 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.145 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.145 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068399 s, 153 MB/s 2024-09-15T23:22:41.152 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.152 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.152 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586162 s, 179 MB/s 2024-09-15T23:22:41.160 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.160 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.160 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.005758 s, 182 MB/s 2024-09-15T23:22:41.167 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.168 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.168 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627275 s, 167 MB/s 2024-09-15T23:22:41.176 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.176 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.176 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066134 s, 159 MB/s 2024-09-15T23:22:41.184 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.184 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.184 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0066704 s, 157 MB/s 2024-09-15T23:22:41.192 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.192 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.192 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006282 s, 167 MB/s 2024-09-15T23:22:41.200 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.201 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.201 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653952 s, 160 MB/s 2024-09-15T23:22:41.209 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.209 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.209 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654438 s, 160 MB/s 2024-09-15T23:22:41.218 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.218 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.218 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00794232 s, 132 MB/s 2024-09-15T23:22:41.227 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.227 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.227 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745877 s, 141 MB/s 2024-09-15T23:22:41.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:22:41.234 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:22:41.234 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:22:41.234 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.14 2024-09-15T23:22:41.234 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:22:41.234 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:22:41.234 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:22:41.234 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:22:41.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:22:41.292 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.292 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.292 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594072 s, 177 MB/s 2024-09-15T23:22:41.301 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.301 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.301 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703579 s, 149 MB/s 2024-09-15T23:22:41.309 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.310 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.310 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714763 s, 147 MB/s 2024-09-15T23:22:41.317 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.317 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.318 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00625028 s, 168 MB/s 2024-09-15T23:22:41.327 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.327 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.327 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00813489 s, 129 MB/s 2024-09-15T23:22:41.335 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.335 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.335 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588375 s, 178 MB/s 2024-09-15T23:22:41.343 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.343 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.343 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647605 s, 162 MB/s 2024-09-15T23:22:41.351 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.351 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.352 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655163 s, 160 MB/s 2024-09-15T23:22:41.359 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.359 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.359 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645823 s, 162 MB/s 2024-09-15T23:22:41.367 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.367 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.367 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631387 s, 166 MB/s 2024-09-15T23:22:41.376 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.376 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.376 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715397 s, 147 MB/s 2024-09-15T23:22:41.383 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.384 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.384 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0060285 s, 174 MB/s 2024-09-15T23:22:41.392 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.392 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.392 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659808 s, 159 MB/s 2024-09-15T23:22:41.401 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.401 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.401 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752201 s, 139 MB/s 2024-09-15T23:22:41.410 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.410 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.410 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724126 s, 145 MB/s 2024-09-15T23:22:41.420 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.420 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.420 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758943 s, 138 MB/s 2024-09-15T23:22:41.427 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.428 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.428 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635323 s, 165 MB/s 2024-09-15T23:22:41.437 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.437 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.437 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00749526 s, 140 MB/s 2024-09-15T23:22:41.444 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.445 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.445 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591961 s, 177 MB/s 2024-09-15T23:22:41.454 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.454 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.454 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750757 s, 140 MB/s 2024-09-15T23:22:41.463 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.463 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.463 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718917 s, 146 MB/s 2024-09-15T23:22:41.471 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.471 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.471 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645943 s, 162 MB/s 2024-09-15T23:22:41.479 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.479 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.480 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648332 s, 162 MB/s 2024-09-15T23:22:41.488 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.488 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.488 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656882 s, 160 MB/s 2024-09-15T23:22:41.499 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.499 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.499 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725231 s, 145 MB/s 2024-09-15T23:22:41.505 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.505 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.505 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677113 s, 155 MB/s 2024-09-15T23:22:41.513 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.513 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.513 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649192 s, 162 MB/s 2024-09-15T23:22:41.522 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.523 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.523 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779432 s, 135 MB/s 2024-09-15T23:22:41.532 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.532 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.532 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746161 s, 141 MB/s 2024-09-15T23:22:41.540 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.541 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.541 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006973 s, 150 MB/s 2024-09-15T23:22:41.549 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.549 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.549 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710356 s, 148 MB/s 2024-09-15T23:22:41.559 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.559 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.559 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00751582 s, 140 MB/s 2024-09-15T23:22:41.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:22:41.566 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:22:41.566 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:22:41.566 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.15 2024-09-15T23:22:41.566 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:22:41.566 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:22:41.566 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:22:41.566 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:22:41.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:22:41.629 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.629 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.629 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00805958 s, 130 MB/s 2024-09-15T23:22:41.637 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.637 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.637 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613148 s, 171 MB/s 2024-09-15T23:22:41.645 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.645 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.645 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677882 s, 155 MB/s 2024-09-15T23:22:41.654 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.654 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.654 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687646 s, 152 MB/s 2024-09-15T23:22:41.663 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.663 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.663 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00758171 s, 138 MB/s 2024-09-15T23:22:41.672 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.672 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.673 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075214 s, 139 MB/s 2024-09-15T23:22:41.682 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.682 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.682 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779424 s, 135 MB/s 2024-09-15T23:22:41.691 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.691 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.691 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736427 s, 142 MB/s 2024-09-15T23:22:41.699 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.700 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.700 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656787 s, 160 MB/s 2024-09-15T23:22:41.708 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.709 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.709 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728099 s, 144 MB/s 2024-09-15T23:22:41.719 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.719 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.719 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00853863 s, 123 MB/s 2024-09-15T23:22:41.728 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.728 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.728 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723578 s, 145 MB/s 2024-09-15T23:22:41.737 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.737 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.737 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776341 s, 135 MB/s 2024-09-15T23:22:41.745 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.746 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.746 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671245 s, 156 MB/s 2024-09-15T23:22:41.753 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.753 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.754 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624964 s, 168 MB/s 2024-09-15T23:22:41.762 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.762 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.762 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668895 s, 157 MB/s 2024-09-15T23:22:41.771 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.771 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.771 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748801 s, 140 MB/s 2024-09-15T23:22:41.780 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.780 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.780 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073105 s, 143 MB/s 2024-09-15T23:22:41.788 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.788 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.788 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650592 s, 161 MB/s 2024-09-15T23:22:41.796 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.796 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.796 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058334 s, 180 MB/s 2024-09-15T23:22:41.803 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.803 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.803 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582966 s, 180 MB/s 2024-09-15T23:22:41.812 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.812 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.812 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734113 s, 143 MB/s 2024-09-15T23:22:41.820 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.821 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.821 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0062672 s, 167 MB/s 2024-09-15T23:22:41.828 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.828 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.829 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639345 s, 164 MB/s 2024-09-15T23:22:41.837 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.837 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.837 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690741 s, 152 MB/s 2024-09-15T23:22:41.847 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.847 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.847 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00807793 s, 130 MB/s 2024-09-15T23:22:41.855 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.855 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.855 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662108 s, 158 MB/s 2024-09-15T23:22:41.863 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.863 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.863 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653539 s, 160 MB/s 2024-09-15T23:22:41.871 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.871 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.871 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648903 s, 162 MB/s 2024-09-15T23:22:41.879 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.879 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.880 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649929 s, 161 MB/s 2024-09-15T23:22:41.888 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.888 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.888 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648441 s, 162 MB/s 2024-09-15T23:22:41.896 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.896 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.896 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690165 s, 152 MB/s 2024-09-15T23:22:41.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:22:41.903 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:22:41.903 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:22:41.903 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.16 2024-09-15T23:22:41.903 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:22:41.903 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:22:41.903 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:22:41.903 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:22:41.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:22:41.963 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.963 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.963 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720243 s, 146 MB/s 2024-09-15T23:22:41.971 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.971 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.971 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655161 s, 160 MB/s 2024-09-15T23:22:41.979 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.979 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.979 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672854 s, 156 MB/s 2024-09-15T23:22:41.988 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.988 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.988 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739018 s, 142 MB/s 2024-09-15T23:22:41.996 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:41.996 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:41.996 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00575606 s, 182 MB/s 2024-09-15T23:22:42.004 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.004 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.004 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065969 s, 159 MB/s 2024-09-15T23:22:42.013 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.013 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.013 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736346 s, 142 MB/s 2024-09-15T23:22:42.021 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.022 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.022 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647965 s, 162 MB/s 2024-09-15T23:22:42.030 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.030 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.030 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708327 s, 148 MB/s 2024-09-15T23:22:42.038 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.038 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.038 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00654344 s, 160 MB/s 2024-09-15T23:22:42.049 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.049 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.050 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587079 s, 179 MB/s 2024-09-15T23:22:42.055 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.055 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.055 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761639 s, 138 MB/s 2024-09-15T23:22:42.063 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.063 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.063 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606281 s, 173 MB/s 2024-09-15T23:22:42.071 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.071 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.071 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00605581 s, 173 MB/s 2024-09-15T23:22:42.079 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.079 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.080 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667587 s, 157 MB/s 2024-09-15T23:22:42.089 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.089 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.090 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771943 s, 136 MB/s 2024-09-15T23:22:42.098 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.098 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.098 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727731 s, 144 MB/s 2024-09-15T23:22:42.105 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.105 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.105 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594461 s, 176 MB/s 2024-09-15T23:22:42.113 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.114 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.114 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637694 s, 164 MB/s 2024-09-15T23:22:42.123 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.123 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.123 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764973 s, 137 MB/s 2024-09-15T23:22:42.132 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.132 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.133 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00710444 s, 148 MB/s 2024-09-15T23:22:42.140 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.140 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.140 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661588 s, 158 MB/s 2024-09-15T23:22:42.149 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.150 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.150 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645071 s, 163 MB/s 2024-09-15T23:22:42.157 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.157 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.157 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661082 s, 159 MB/s 2024-09-15T23:22:42.165 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.166 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.166 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068745 s, 153 MB/s 2024-09-15T23:22:42.174 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.174 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.174 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705849 s, 149 MB/s 2024-09-15T23:22:42.183 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.184 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.184 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00722475 s, 145 MB/s 2024-09-15T23:22:42.191 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.191 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.191 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602372 s, 174 MB/s 2024-09-15T23:22:42.199 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.199 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.200 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00670479 s, 156 MB/s 2024-09-15T23:22:42.208 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.208 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.208 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644385 s, 163 MB/s 2024-09-15T23:22:42.216 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.216 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.216 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726765 s, 144 MB/s 2024-09-15T23:22:42.225 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.225 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.225 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734654 s, 143 MB/s 2024-09-15T23:22:42.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:22:42.232 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:22:42.232 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:22:42.232 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.17 2024-09-15T23:22:42.232 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:22:42.232 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:22:42.232 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:22:42.232 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:22:42.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:22:42.293 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.293 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.293 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00812039 s, 129 MB/s 2024-09-15T23:22:42.302 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.302 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.302 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0071373 s, 147 MB/s 2024-09-15T23:22:42.310 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.311 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.311 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734135 s, 143 MB/s 2024-09-15T23:22:42.319 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.319 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.319 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672887 s, 156 MB/s 2024-09-15T23:22:42.329 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.329 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.329 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00771843 s, 136 MB/s 2024-09-15T23:22:42.337 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.337 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.337 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663574 s, 158 MB/s 2024-09-15T23:22:42.345 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.345 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.345 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622893 s, 168 MB/s 2024-09-15T23:22:42.353 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.354 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.354 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720454 s, 146 MB/s 2024-09-15T23:22:42.363 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.363 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.363 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00762308 s, 138 MB/s 2024-09-15T23:22:42.371 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.371 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.371 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00608585 s, 172 MB/s 2024-09-15T23:22:42.381 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.381 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.381 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772876 s, 136 MB/s 2024-09-15T23:22:42.389 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.390 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.390 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726094 s, 144 MB/s 2024-09-15T23:22:42.399 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.399 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.399 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00783447 s, 134 MB/s 2024-09-15T23:22:42.407 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.407 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.407 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658943 s, 159 MB/s 2024-09-15T23:22:42.415 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.415 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.415 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577318 s, 182 MB/s 2024-09-15T23:22:42.424 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.425 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.425 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779803 s, 134 MB/s 2024-09-15T23:22:42.434 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.434 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.434 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733778 s, 143 MB/s 2024-09-15T23:22:42.443 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.443 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.443 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738813 s, 142 MB/s 2024-09-15T23:22:42.451 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.451 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.451 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641688 s, 163 MB/s 2024-09-15T23:22:42.459 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.459 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.459 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606693 s, 173 MB/s 2024-09-15T23:22:42.467 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.467 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.467 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664864 s, 158 MB/s 2024-09-15T23:22:42.476 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.476 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.477 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740865 s, 142 MB/s 2024-09-15T23:22:42.486 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.486 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.486 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770532 s, 136 MB/s 2024-09-15T23:22:42.496 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.496 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.496 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00753175 s, 139 MB/s 2024-09-15T23:22:42.504 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.504 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.505 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716377 s, 146 MB/s 2024-09-15T23:22:42.513 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.514 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.514 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00745963 s, 141 MB/s 2024-09-15T23:22:42.523 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.523 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.523 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720937 s, 145 MB/s 2024-09-15T23:22:42.531 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.531 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.532 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00687003 s, 153 MB/s 2024-09-15T23:22:42.540 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.541 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.541 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720423 s, 146 MB/s 2024-09-15T23:22:42.549 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.549 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.549 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741123 s, 141 MB/s 2024-09-15T23:22:42.557 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.557 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.557 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598324 s, 175 MB/s 2024-09-15T23:22:42.565 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.566 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.566 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00701728 s, 149 MB/s 2024-09-15T23:22:42.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:22:42.573 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:22:42.573 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:22:42.573 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.18 2024-09-15T23:22:42.573 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:22:42.573 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:22:42.573 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:22:42.573 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:22:42.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:22:42.632 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.633 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.633 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00752913 s, 139 MB/s 2024-09-15T23:22:42.640 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.640 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.640 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597602 s, 175 MB/s 2024-09-15T23:22:42.649 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.649 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.649 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668921 s, 157 MB/s 2024-09-15T23:22:42.658 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.658 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.658 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744954 s, 141 MB/s 2024-09-15T23:22:42.666 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.666 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.666 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675947 s, 155 MB/s 2024-09-15T23:22:42.674 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.674 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.675 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653476 s, 160 MB/s 2024-09-15T23:22:42.682 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.683 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.683 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064721 s, 162 MB/s 2024-09-15T23:22:42.690 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.691 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.691 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632159 s, 166 MB/s 2024-09-15T23:22:42.698 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.699 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.699 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656232 s, 160 MB/s 2024-09-15T23:22:42.707 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.707 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.707 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717537 s, 146 MB/s 2024-09-15T23:22:42.716 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.716 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.716 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663782 s, 158 MB/s 2024-09-15T23:22:42.725 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.725 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.725 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072849 s, 144 MB/s 2024-09-15T23:22:42.732 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.732 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.733 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00592443 s, 177 MB/s 2024-09-15T23:22:42.740 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.740 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.740 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583916 s, 180 MB/s 2024-09-15T23:22:42.748 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.748 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.748 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063807 s, 164 MB/s 2024-09-15T23:22:42.756 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.756 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.756 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00594734 s, 176 MB/s 2024-09-15T23:22:42.764 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.765 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.765 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00675772 s, 155 MB/s 2024-09-15T23:22:42.773 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.773 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.773 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656745 s, 160 MB/s 2024-09-15T23:22:42.781 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.781 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.781 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648034 s, 162 MB/s 2024-09-15T23:22:42.789 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.789 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.789 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637033 s, 165 MB/s 2024-09-15T23:22:42.798 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.799 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.799 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00770377 s, 136 MB/s 2024-09-15T23:22:42.807 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.807 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.807 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653899 s, 160 MB/s 2024-09-15T23:22:42.816 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.816 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.816 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765993 s, 137 MB/s 2024-09-15T23:22:42.826 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.826 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.827 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736509 s, 142 MB/s 2024-09-15T23:22:42.833 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.833 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.833 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599231 s, 175 MB/s 2024-09-15T23:22:42.841 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.841 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.841 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632907 s, 166 MB/s 2024-09-15T23:22:42.850 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.851 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.851 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719998 s, 146 MB/s 2024-09-15T23:22:42.859 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.859 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.860 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00691899 s, 152 MB/s 2024-09-15T23:22:42.866 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.867 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.867 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583185 s, 180 MB/s 2024-09-15T23:22:42.875 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.875 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.875 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708419 s, 148 MB/s 2024-09-15T23:22:42.883 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.884 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.884 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677535 s, 155 MB/s 2024-09-15T23:22:42.892 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.892 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.892 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615653 s, 170 MB/s 2024-09-15T23:22:42.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:22:42.898 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:22:42.898 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:22:42.898 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.19 2024-09-15T23:22:42.899 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:22:42.899 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:22:42.899 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:22:42.899 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:22:42.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:22:42.959 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.960 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.960 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00787308 s, 133 MB/s 2024-09-15T23:22:42.969 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.969 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.969 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00780774 s, 134 MB/s 2024-09-15T23:22:42.978 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.978 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.978 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761727 s, 138 MB/s 2024-09-15T23:22:42.986 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.986 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.986 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578033 s, 181 MB/s 2024-09-15T23:22:42.995 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:42.995 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:42.995 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678087 s, 155 MB/s 2024-09-15T23:22:43.003 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.003 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.003 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678936 s, 154 MB/s 2024-09-15T23:22:43.013 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.013 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.013 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00820115 s, 128 MB/s 2024-09-15T23:22:43.022 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.022 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.022 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741788 s, 141 MB/s 2024-09-15T23:22:43.031 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.031 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.031 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635854 s, 165 MB/s 2024-09-15T23:22:43.040 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.040 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.040 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00763991 s, 137 MB/s 2024-09-15T23:22:43.049 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.049 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.049 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715801 s, 146 MB/s 2024-09-15T23:22:43.057 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.057 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.057 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653453 s, 160 MB/s 2024-09-15T23:22:43.066 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.066 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.066 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690498 s, 152 MB/s 2024-09-15T23:22:43.074 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.075 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.075 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725626 s, 145 MB/s 2024-09-15T23:22:43.083 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.084 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.084 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698898 s, 150 MB/s 2024-09-15T23:22:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.091 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579674 s, 181 MB/s 2024-09-15T23:22:43.100 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.100 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.100 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756808 s, 139 MB/s 2024-09-15T23:22:43.109 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.109 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.109 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00733784 s, 143 MB/s 2024-09-15T23:22:43.118 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.118 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.118 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720744 s, 145 MB/s 2024-09-15T23:22:43.126 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.126 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.127 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659772 s, 159 MB/s 2024-09-15T23:22:43.135 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.135 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.135 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00660846 s, 159 MB/s 2024-09-15T23:22:43.144 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.144 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.145 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00800006 s, 131 MB/s 2024-09-15T23:22:43.153 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.154 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.154 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728906 s, 144 MB/s 2024-09-15T23:22:43.161 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.161 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.161 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596102 s, 176 MB/s 2024-09-15T23:22:43.169 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.169 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.169 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635762 s, 165 MB/s 2024-09-15T23:22:43.177 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.177 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.177 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632903 s, 166 MB/s 2024-09-15T23:22:43.185 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.185 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.185 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576715 s, 182 MB/s 2024-09-15T23:22:43.193 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.193 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.193 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652366 s, 161 MB/s 2024-09-15T23:22:43.201 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.201 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.201 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650893 s, 161 MB/s 2024-09-15T23:22:43.210 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.210 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.210 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00739023 s, 142 MB/s 2024-09-15T23:22:43.218 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.218 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.218 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647931 s, 162 MB/s 2024-09-15T23:22:43.225 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.225 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.225 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00563587 s, 186 MB/s 2024-09-15T23:22:43.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:22:43.232 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:22:43.232 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:22:43.232 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.20 2024-09-15T23:22:43.232 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:22:43.232 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:22:43.232 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:22:43.233 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:22:43.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:22:43.291 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.291 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.291 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630236 s, 166 MB/s 2024-09-15T23:22:43.299 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.299 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.300 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00690824 s, 152 MB/s 2024-09-15T23:22:43.308 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.308 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.308 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647891 s, 162 MB/s 2024-09-15T23:22:43.315 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.315 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.315 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586383 s, 179 MB/s 2024-09-15T23:22:43.323 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.323 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.323 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598511 s, 175 MB/s 2024-09-15T23:22:43.331 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.332 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.332 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656331 s, 160 MB/s 2024-09-15T23:22:43.339 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.339 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.339 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643511 s, 163 MB/s 2024-09-15T23:22:43.348 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.348 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.348 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662167 s, 158 MB/s 2024-09-15T23:22:43.355 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.356 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.356 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598904 s, 175 MB/s 2024-09-15T23:22:43.364 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.365 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.365 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740089 s, 142 MB/s 2024-09-15T23:22:43.373 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.373 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.373 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649305 s, 161 MB/s 2024-09-15T23:22:43.381 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.381 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.381 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649478 s, 161 MB/s 2024-09-15T23:22:43.390 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.391 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.391 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777446 s, 135 MB/s 2024-09-15T23:22:43.400 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.400 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.400 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00788268 s, 133 MB/s 2024-09-15T23:22:43.408 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.408 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.408 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585674 s, 179 MB/s 2024-09-15T23:22:43.417 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.417 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.417 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726344 s, 144 MB/s 2024-09-15T23:22:43.425 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.425 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.426 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661351 s, 159 MB/s 2024-09-15T23:22:43.433 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.433 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.433 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00589538 s, 178 MB/s 2024-09-15T23:22:43.441 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.441 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.441 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652368 s, 161 MB/s 2024-09-15T23:22:43.450 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.450 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.450 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748074 s, 140 MB/s 2024-09-15T23:22:43.459 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.459 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.459 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659985 s, 159 MB/s 2024-09-15T23:22:43.466 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.466 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.466 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587493 s, 178 MB/s 2024-09-15T23:22:43.474 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.474 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.474 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00586788 s, 179 MB/s 2024-09-15T23:22:43.482 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.483 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.483 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711374 s, 147 MB/s 2024-09-15T23:22:43.491 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.491 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.491 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673599 s, 156 MB/s 2024-09-15T23:22:43.499 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.499 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.499 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628076 s, 167 MB/s 2024-09-15T23:22:43.508 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.508 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.508 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725258 s, 145 MB/s 2024-09-15T23:22:43.516 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.516 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.516 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647481 s, 162 MB/s 2024-09-15T23:22:43.525 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.525 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.525 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748587 s, 140 MB/s 2024-09-15T23:22:43.534 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.534 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.534 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705482 s, 149 MB/s 2024-09-15T23:22:43.543 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.543 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.543 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743575 s, 141 MB/s 2024-09-15T23:22:43.553 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.553 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.553 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00806951 s, 130 MB/s 2024-09-15T23:22:43.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:22:43.560 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:22:43.560 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:22:43.560 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.21 2024-09-15T23:22:43.560 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:22:43.560 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:22:43.560 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:22:43.561 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:22:43.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:22:43.620 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.621 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.621 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00756897 s, 139 MB/s 2024-09-15T23:22:43.628 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.628 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.628 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599138 s, 175 MB/s 2024-09-15T23:22:43.637 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.637 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.637 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686456 s, 153 MB/s 2024-09-15T23:22:43.645 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.645 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.645 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642103 s, 163 MB/s 2024-09-15T23:22:43.654 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.654 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.654 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00734939 s, 143 MB/s 2024-09-15T23:22:43.662 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.662 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.663 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707956 s, 148 MB/s 2024-09-15T23:22:43.671 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.671 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.671 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665143 s, 158 MB/s 2024-09-15T23:22:43.679 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.680 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.680 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671111 s, 156 MB/s 2024-09-15T23:22:43.688 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.688 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.688 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00697791 s, 150 MB/s 2024-09-15T23:22:43.697 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.697 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.697 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074856 s, 140 MB/s 2024-09-15T23:22:43.705 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.706 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.706 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650602 s, 161 MB/s 2024-09-15T23:22:43.713 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.714 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.714 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635496 s, 165 MB/s 2024-09-15T23:22:43.722 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.722 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.722 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00672974 s, 156 MB/s 2024-09-15T23:22:43.730 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.730 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.730 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647561 s, 162 MB/s 2024-09-15T23:22:43.738 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.738 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.738 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646606 s, 162 MB/s 2024-09-15T23:22:43.747 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.747 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.747 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00707652 s, 148 MB/s 2024-09-15T23:22:43.754 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.755 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.755 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579266 s, 181 MB/s 2024-09-15T23:22:43.764 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.764 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.764 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00747747 s, 140 MB/s 2024-09-15T23:22:43.772 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.772 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.772 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661852 s, 158 MB/s 2024-09-15T23:22:43.781 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.781 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.781 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750092 s, 140 MB/s 2024-09-15T23:22:43.790 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.790 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.790 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702008 s, 149 MB/s 2024-09-15T23:22:43.798 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.798 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.798 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642009 s, 163 MB/s 2024-09-15T23:22:43.806 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.806 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.806 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649051 s, 162 MB/s 2024-09-15T23:22:43.815 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.816 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.816 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076332 s, 137 MB/s 2024-09-15T23:22:43.825 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.825 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.825 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765553 s, 137 MB/s 2024-09-15T23:22:43.834 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.834 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.834 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719147 s, 146 MB/s 2024-09-15T23:22:43.843 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.843 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.843 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732373 s, 143 MB/s 2024-09-15T23:22:43.851 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.851 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.851 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636202 s, 165 MB/s 2024-09-15T23:22:43.858 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.858 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.858 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574636 s, 182 MB/s 2024-09-15T23:22:43.866 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.867 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.867 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651681 s, 161 MB/s 2024-09-15T23:22:43.876 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.876 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.876 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744732 s, 141 MB/s 2024-09-15T23:22:43.885 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.885 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.885 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669485 s, 157 MB/s 2024-09-15T23:22:43.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:22:43.890 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:22:43.891 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:22:43.891 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.22 2024-09-15T23:22:43.891 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:22:43.891 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:22:43.891 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:22:43.891 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:22:43.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:22:43.949 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.949 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.950 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648853 s, 162 MB/s 2024-09-15T23:22:43.958 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.958 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.958 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729675 s, 144 MB/s 2024-09-15T23:22:43.966 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.966 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.966 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064038 s, 164 MB/s 2024-09-15T23:22:43.974 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.974 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.974 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647333 s, 162 MB/s 2024-09-15T23:22:43.982 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.982 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.982 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640945 s, 164 MB/s 2024-09-15T23:22:43.991 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.991 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.991 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064669 s, 162 MB/s 2024-09-15T23:22:43.999 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:43.999 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:43.999 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00686714 s, 153 MB/s 2024-09-15T23:22:44.008 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.008 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.008 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730774 s, 143 MB/s 2024-09-15T23:22:44.016 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.016 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.016 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622742 s, 168 MB/s 2024-09-15T23:22:44.024 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.024 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.024 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00606637 s, 173 MB/s 2024-09-15T23:22:44.032 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.032 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.032 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658117 s, 159 MB/s 2024-09-15T23:22:44.041 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.041 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.041 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726399 s, 144 MB/s 2024-09-15T23:22:44.049 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.049 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.049 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00571809 s, 183 MB/s 2024-09-15T23:22:44.057 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.057 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.057 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602562 s, 174 MB/s 2024-09-15T23:22:44.065 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.065 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.065 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063126 s, 166 MB/s 2024-09-15T23:22:44.072 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.073 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.073 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600002 s, 175 MB/s 2024-09-15T23:22:44.082 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.082 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.082 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779981 s, 134 MB/s 2024-09-15T23:22:44.090 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.090 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.090 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630852 s, 166 MB/s 2024-09-15T23:22:44.098 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.099 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.099 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666748 s, 157 MB/s 2024-09-15T23:22:44.106 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.106 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.106 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584558 s, 179 MB/s 2024-09-15T23:22:44.115 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.116 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.116 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726739 s, 144 MB/s 2024-09-15T23:22:44.125 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.125 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.125 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746918 s, 140 MB/s 2024-09-15T23:22:44.132 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.133 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.133 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647835 s, 162 MB/s 2024-09-15T23:22:44.141 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.141 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.141 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692258 s, 151 MB/s 2024-09-15T23:22:44.151 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.151 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.151 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00779554 s, 135 MB/s 2024-09-15T23:22:44.158 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.158 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.158 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00574329 s, 183 MB/s 2024-09-15T23:22:44.167 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.167 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.167 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715302 s, 147 MB/s 2024-09-15T23:22:44.175 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.175 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.176 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0067562 s, 155 MB/s 2024-09-15T23:22:44.183 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.183 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.183 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597257 s, 176 MB/s 2024-09-15T23:22:44.191 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.191 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.191 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572576 s, 183 MB/s 2024-09-15T23:22:44.199 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.199 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.199 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059947 s, 175 MB/s 2024-09-15T23:22:44.206 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.206 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.207 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00572098 s, 183 MB/s 2024-09-15T23:22:44.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:22:44.213 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:22:44.213 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:22:44.213 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.23 2024-09-15T23:22:44.213 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:22:44.213 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:22:44.213 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:22:44.213 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:22:44.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:22:44.272 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.272 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.272 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721837 s, 145 MB/s 2024-09-15T23:22:44.280 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.280 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.280 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065697 s, 160 MB/s 2024-09-15T23:22:44.288 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.289 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.289 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648919 s, 162 MB/s 2024-09-15T23:22:44.298 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.298 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.298 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715073 s, 147 MB/s 2024-09-15T23:22:44.306 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.306 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.306 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00698759 s, 150 MB/s 2024-09-15T23:22:44.314 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.314 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.314 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006208 s, 169 MB/s 2024-09-15T23:22:44.323 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.323 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.323 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714291 s, 147 MB/s 2024-09-15T23:22:44.332 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.332 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.332 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765347 s, 137 MB/s 2024-09-15T23:22:44.341 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.342 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.342 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740052 s, 142 MB/s 2024-09-15T23:22:44.351 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.351 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.351 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644368 s, 163 MB/s 2024-09-15T23:22:44.359 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.359 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.359 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746144 s, 141 MB/s 2024-09-15T23:22:44.367 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.367 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.367 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631495 s, 166 MB/s 2024-09-15T23:22:44.375 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.376 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.376 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680852 s, 154 MB/s 2024-09-15T23:22:44.383 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.384 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.384 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650357 s, 161 MB/s 2024-09-15T23:22:44.393 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.393 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.393 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00744407 s, 141 MB/s 2024-09-15T23:22:44.400 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.401 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.401 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063875 s, 164 MB/s 2024-09-15T23:22:44.409 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.409 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.409 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655019 s, 160 MB/s 2024-09-15T23:22:44.417 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.417 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.417 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00609541 s, 172 MB/s 2024-09-15T23:22:44.425 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.425 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.425 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636153 s, 165 MB/s 2024-09-15T23:22:44.432 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.432 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.433 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058686 s, 179 MB/s 2024-09-15T23:22:44.441 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.442 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.442 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073641 s, 142 MB/s 2024-09-15T23:22:44.449 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.449 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.449 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599022 s, 175 MB/s 2024-09-15T23:22:44.458 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.458 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.458 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00702732 s, 149 MB/s 2024-09-15T23:22:44.466 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.466 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.466 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00618366 s, 170 MB/s 2024-09-15T23:22:44.474 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.474 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.474 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00699668 s, 150 MB/s 2024-09-15T23:22:44.483 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.483 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.483 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665072 s, 158 MB/s 2024-09-15T23:22:44.490 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.490 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.491 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615449 s, 170 MB/s 2024-09-15T23:22:44.500 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.500 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.500 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725635 s, 145 MB/s 2024-09-15T23:22:44.509 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.509 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.509 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721513 s, 145 MB/s 2024-09-15T23:22:44.517 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.518 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.518 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00708213 s, 148 MB/s 2024-09-15T23:22:44.527 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.527 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.527 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00764894 s, 137 MB/s 2024-09-15T23:22:44.536 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.536 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.536 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720926 s, 145 MB/s 2024-09-15T23:22:44.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:22:44.544 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:22:44.544 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:22:44.545 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.24 2024-09-15T23:22:44.545 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:22:44.545 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:22:44.545 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:22:44.545 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:22:44.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:22:44.603 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.603 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.603 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667642 s, 157 MB/s 2024-09-15T23:22:44.612 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.612 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.612 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736302 s, 142 MB/s 2024-09-15T23:22:44.620 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.620 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.620 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581785 s, 180 MB/s 2024-09-15T23:22:44.628 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.629 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.629 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00718178 s, 146 MB/s 2024-09-15T23:22:44.636 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.637 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.637 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623736 s, 168 MB/s 2024-09-15T23:22:44.645 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.645 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.645 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006797 s, 154 MB/s 2024-09-15T23:22:44.653 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.653 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.653 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00635793 s, 165 MB/s 2024-09-15T23:22:44.661 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.662 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.662 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00679827 s, 154 MB/s 2024-09-15T23:22:44.670 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.671 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.671 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00727917 s, 144 MB/s 2024-09-15T23:22:44.679 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.679 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.679 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658998 s, 159 MB/s 2024-09-15T23:22:44.688 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.688 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.688 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728566 s, 144 MB/s 2024-09-15T23:22:44.697 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.697 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.697 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00720618 s, 146 MB/s 2024-09-15T23:22:44.705 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.705 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.706 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646784 s, 162 MB/s 2024-09-15T23:22:44.714 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.714 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.714 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723384 s, 145 MB/s 2024-09-15T23:22:44.722 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.722 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.722 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596462 s, 176 MB/s 2024-09-15T23:22:44.729 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.729 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.730 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579135 s, 181 MB/s 2024-09-15T23:22:44.737 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.738 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.738 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00631966 s, 166 MB/s 2024-09-15T23:22:44.746 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.747 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.747 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0074796 s, 140 MB/s 2024-09-15T23:22:44.755 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.755 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.755 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666095 s, 157 MB/s 2024-09-15T23:22:44.763 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.763 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.763 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642423 s, 163 MB/s 2024-09-15T23:22:44.771 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.771 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.771 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00603285 s, 174 MB/s 2024-09-15T23:22:44.778 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.779 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.779 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595669 s, 176 MB/s 2024-09-15T23:22:44.787 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.787 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.787 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647916 s, 162 MB/s 2024-09-15T23:22:44.795 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.795 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.795 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00673813 s, 156 MB/s 2024-09-15T23:22:44.802 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.803 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.803 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00576214 s, 182 MB/s 2024-09-15T23:22:44.810 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.810 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.810 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613907 s, 171 MB/s 2024-09-15T23:22:44.818 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.818 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.819 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636643 s, 165 MB/s 2024-09-15T23:22:44.828 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.828 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.828 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761499 s, 138 MB/s 2024-09-15T23:22:44.836 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.836 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.836 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630255 s, 166 MB/s 2024-09-15T23:22:44.843 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.843 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.844 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00584523 s, 179 MB/s 2024-09-15T23:22:44.852 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.852 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.852 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638464 s, 164 MB/s 2024-09-15T23:22:44.860 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.860 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.860 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00649538 s, 161 MB/s 2024-09-15T23:22:44.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:22:44.867 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:22:44.867 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:22:44.867 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.25 2024-09-15T23:22:44.867 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:22:44.867 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:22:44.867 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:22:44.867 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:22:44.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:22:44.927 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.927 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.927 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073952 s, 142 MB/s 2024-09-15T23:22:44.936 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.936 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.936 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715348 s, 147 MB/s 2024-09-15T23:22:44.944 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.944 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.944 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0058962 s, 178 MB/s 2024-09-15T23:22:44.951 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.951 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.951 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583444 s, 180 MB/s 2024-09-15T23:22:44.960 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.960 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.960 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070062 s, 150 MB/s 2024-09-15T23:22:44.968 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.968 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.969 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640824 s, 164 MB/s 2024-09-15T23:22:44.977 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.977 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.978 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729908 s, 144 MB/s 2024-09-15T23:22:44.985 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.985 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.985 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00577079 s, 182 MB/s 2024-09-15T23:22:44.994 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:44.994 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:44.994 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00715314 s, 147 MB/s 2024-09-15T23:22:45.003 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.003 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.003 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688778 s, 152 MB/s 2024-09-15T23:22:45.012 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.012 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.012 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00728728 s, 144 MB/s 2024-09-15T23:22:45.021 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.021 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.021 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007202 s, 146 MB/s 2024-09-15T23:22:45.030 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.030 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.031 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00773013 s, 136 MB/s 2024-09-15T23:22:45.038 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.038 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.039 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064734 s, 162 MB/s 2024-09-15T23:22:45.047 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.047 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.047 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653816 s, 160 MB/s 2024-09-15T23:22:45.055 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.056 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.056 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694871 s, 151 MB/s 2024-09-15T23:22:45.065 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.065 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.065 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643813 s, 163 MB/s 2024-09-15T23:22:45.073 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.073 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.073 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00775491 s, 135 MB/s 2024-09-15T23:22:45.081 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.082 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.082 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00664278 s, 158 MB/s 2024-09-15T23:22:45.091 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.091 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.091 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00765404 s, 137 MB/s 2024-09-15T23:22:45.100 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.100 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.100 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738823 s, 142 MB/s 2024-09-15T23:22:45.113 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.113 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.113 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00742516 s, 141 MB/s 2024-09-15T23:22:45.117 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.117 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.117 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632082 s, 166 MB/s 2024-09-15T23:22:45.125 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.125 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.125 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616567 s, 170 MB/s 2024-09-15T23:22:45.133 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.133 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.133 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630414 s, 166 MB/s 2024-09-15T23:22:45.142 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.142 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.143 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746638 s, 140 MB/s 2024-09-15T23:22:45.151 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.151 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.151 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644761 s, 163 MB/s 2024-09-15T23:22:45.159 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.159 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.159 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064972 s, 161 MB/s 2024-09-15T23:22:45.167 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.167 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.167 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645733 s, 162 MB/s 2024-09-15T23:22:45.175 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.175 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.175 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653267 s, 161 MB/s 2024-09-15T23:22:45.185 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.185 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.185 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00754921 s, 139 MB/s 2024-09-15T23:22:45.194 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.194 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.194 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00766768 s, 137 MB/s 2024-09-15T23:22:45.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:22:45.201 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:22:45.201 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:22:45.201 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.26 2024-09-15T23:22:45.201 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:22:45.201 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:22:45.201 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:22:45.201 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:22:45.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:22:45.259 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.259 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.260 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662718 s, 158 MB/s 2024-09-15T23:22:45.267 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.267 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.267 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00591459 s, 177 MB/s 2024-09-15T23:22:45.276 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.276 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.276 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00693054 s, 151 MB/s 2024-09-15T23:22:45.283 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.283 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.283 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00582323 s, 180 MB/s 2024-09-15T23:22:45.292 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.292 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.292 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736771 s, 142 MB/s 2024-09-15T23:22:45.301 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.301 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.301 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0070152 s, 149 MB/s 2024-09-15T23:22:45.309 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.309 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.309 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645685 s, 162 MB/s 2024-09-15T23:22:45.317 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.317 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.317 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598294 s, 175 MB/s 2024-09-15T23:22:45.325 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.325 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.325 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00567657 s, 185 MB/s 2024-09-15T23:22:45.333 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.333 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.333 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630717 s, 166 MB/s 2024-09-15T23:22:45.341 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.341 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.341 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680985 s, 154 MB/s 2024-09-15T23:22:45.350 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.350 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.350 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711648 s, 147 MB/s 2024-09-15T23:22:45.358 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.359 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.359 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651831 s, 161 MB/s 2024-09-15T23:22:45.367 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.367 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.368 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072108 s, 145 MB/s 2024-09-15T23:22:45.377 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.377 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.377 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00785937 s, 133 MB/s 2024-09-15T23:22:45.385 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.386 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.386 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00680702 s, 154 MB/s 2024-09-15T23:22:45.394 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.394 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.394 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719293 s, 146 MB/s 2024-09-15T23:22:45.402 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.403 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.403 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641507 s, 163 MB/s 2024-09-15T23:22:45.411 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.411 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.411 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630518 s, 166 MB/s 2024-09-15T23:22:45.419 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.419 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.419 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688371 s, 152 MB/s 2024-09-15T23:22:45.428 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.428 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.428 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669973 s, 157 MB/s 2024-09-15T23:22:45.436 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.437 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.437 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642764 s, 163 MB/s 2024-09-15T23:22:45.444 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.444 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.444 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059383 s, 177 MB/s 2024-09-15T23:22:45.452 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.452 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.452 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643273 s, 163 MB/s 2024-09-15T23:22:45.460 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.460 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.460 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00617393 s, 170 MB/s 2024-09-15T23:22:45.469 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.469 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.469 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743005 s, 141 MB/s 2024-09-15T23:22:45.478 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.478 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.478 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661777 s, 158 MB/s 2024-09-15T23:22:45.485 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.486 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.486 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628606 s, 167 MB/s 2024-09-15T23:22:45.493 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.494 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.494 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00616962 s, 170 MB/s 2024-09-15T23:22:45.501 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.501 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.501 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00568815 s, 184 MB/s 2024-09-15T23:22:45.510 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.510 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.510 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741969 s, 141 MB/s 2024-09-15T23:22:45.519 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.519 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.519 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00750164 s, 140 MB/s 2024-09-15T23:22:45.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:22:45.526 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:22:45.526 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:22:45.526 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.27 2024-09-15T23:22:45.526 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:22:45.526 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:22:45.527 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:22:45.527 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:22:45.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:22:45.585 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.586 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.586 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714318 s, 147 MB/s 2024-09-15T23:22:45.593 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.593 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.594 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704433 s, 149 MB/s 2024-09-15T23:22:45.602 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.602 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.603 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706695 s, 148 MB/s 2024-09-15T23:22:45.611 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.611 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.612 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740763 s, 142 MB/s 2024-09-15T23:22:45.620 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.620 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.620 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00712256 s, 147 MB/s 2024-09-15T23:22:45.628 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.628 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.628 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640617 s, 164 MB/s 2024-09-15T23:22:45.637 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.637 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.638 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725057 s, 145 MB/s 2024-09-15T23:22:45.645 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.645 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.646 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0059697 s, 176 MB/s 2024-09-15T23:22:45.654 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.654 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.654 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00688029 s, 152 MB/s 2024-09-15T23:22:45.662 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.663 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.663 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00663042 s, 158 MB/s 2024-09-15T23:22:45.671 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.671 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.671 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669368 s, 157 MB/s 2024-09-15T23:22:45.679 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.679 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.679 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00694837 s, 151 MB/s 2024-09-15T23:22:45.687 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.688 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.688 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651683 s, 161 MB/s 2024-09-15T23:22:45.696 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.696 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.696 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00615918 s, 170 MB/s 2024-09-15T23:22:45.703 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.703 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.703 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00604145 s, 174 MB/s 2024-09-15T23:22:45.711 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.711 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.712 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642999 s, 163 MB/s 2024-09-15T23:22:45.721 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.721 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.721 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00730327 s, 144 MB/s 2024-09-15T23:22:45.730 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.730 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.730 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00746759 s, 140 MB/s 2024-09-15T23:22:45.738 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.738 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.738 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00596429 s, 176 MB/s 2024-09-15T23:22:45.747 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.747 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.747 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00678268 s, 155 MB/s 2024-09-15T23:22:45.754 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.754 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.754 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00642595 s, 163 MB/s 2024-09-15T23:22:45.762 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.762 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.762 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00622123 s, 169 MB/s 2024-09-15T23:22:45.770 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.770 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.770 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581829 s, 180 MB/s 2024-09-15T23:22:45.779 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.779 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.779 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072284 s, 145 MB/s 2024-09-15T23:22:45.786 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.786 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.786 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00553496 s, 189 MB/s 2024-09-15T23:22:45.795 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.795 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.795 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731493 s, 143 MB/s 2024-09-15T23:22:45.804 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.804 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.804 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704721 s, 149 MB/s 2024-09-15T23:22:45.812 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.812 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.812 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633459 s, 166 MB/s 2024-09-15T23:22:45.821 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.821 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.821 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636913 s, 165 MB/s 2024-09-15T23:22:45.830 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.830 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.830 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00773008 s, 136 MB/s 2024-09-15T23:22:45.839 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.839 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.839 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00774313 s, 135 MB/s 2024-09-15T23:22:45.847 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.847 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.848 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655434 s, 160 MB/s 2024-09-15T23:22:45.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:22:45.854 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:22:45.854 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:22:45.854 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.28 2024-09-15T23:22:45.854 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:22:45.854 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:22:45.854 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:22:45.855 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:22:45.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:22:45.913 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.913 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.913 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00652003 s, 161 MB/s 2024-09-15T23:22:45.920 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.920 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.920 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00573404 s, 183 MB/s 2024-09-15T23:22:45.928 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.929 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.929 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655505 s, 160 MB/s 2024-09-15T23:22:45.936 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.936 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.937 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627479 s, 167 MB/s 2024-09-15T23:22:45.944 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.945 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.945 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650966 s, 161 MB/s 2024-09-15T23:22:45.954 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.954 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.954 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00777235 s, 135 MB/s 2024-09-15T23:22:45.962 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.962 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.962 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666829 s, 157 MB/s 2024-09-15T23:22:45.970 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.971 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.971 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662192 s, 158 MB/s 2024-09-15T23:22:45.979 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.979 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.979 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645762 s, 162 MB/s 2024-09-15T23:22:45.988 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.988 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.988 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741119 s, 141 MB/s 2024-09-15T23:22:45.996 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:45.996 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:45.997 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646017 s, 162 MB/s 2024-09-15T23:22:46.004 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.004 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.004 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626018 s, 167 MB/s 2024-09-15T23:22:46.012 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.012 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.012 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00600285 s, 175 MB/s 2024-09-15T23:22:46.020 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.020 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.020 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636701 s, 165 MB/s 2024-09-15T23:22:46.027 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.027 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.027 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00598675 s, 175 MB/s 2024-09-15T23:22:46.036 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.036 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.036 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00668366 s, 157 MB/s 2024-09-15T23:22:46.045 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.045 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.045 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767434 s, 137 MB/s 2024-09-15T23:22:46.054 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.054 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.054 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725904 s, 144 MB/s 2024-09-15T23:22:46.062 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.062 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.062 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658799 s, 159 MB/s 2024-09-15T23:22:46.071 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.071 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.072 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00709125 s, 148 MB/s 2024-09-15T23:22:46.080 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.080 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.081 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729616 s, 144 MB/s 2024-09-15T23:22:46.089 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.089 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.089 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662175 s, 158 MB/s 2024-09-15T23:22:46.097 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.097 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.097 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00620199 s, 169 MB/s 2024-09-15T23:22:46.106 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.106 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.106 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748448 s, 140 MB/s 2024-09-15T23:22:46.114 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.114 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.114 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00651794 s, 161 MB/s 2024-09-15T23:22:46.123 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.123 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.123 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00743254 s, 141 MB/s 2024-09-15T23:22:46.131 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.131 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.131 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00585669 s, 179 MB/s 2024-09-15T23:22:46.139 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.139 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.139 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00643469 s, 163 MB/s 2024-09-15T23:22:46.148 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.148 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.149 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00716678 s, 146 MB/s 2024-09-15T23:22:46.156 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.156 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.157 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658831 s, 159 MB/s 2024-09-15T23:22:46.164 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.164 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.165 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00629284 s, 167 MB/s 2024-09-15T23:22:46.173 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.173 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.173 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00704823 s, 149 MB/s 2024-09-15T23:22:46.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:22:46.180 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:22:46.180 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:22:46.180 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.29 2024-09-15T23:22:46.180 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:22:46.180 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:22:46.180 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:22:46.180 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:22:46.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:22:46.239 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.239 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.239 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0065957 s, 159 MB/s 2024-09-15T23:22:46.247 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.247 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.247 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00667791 s, 157 MB/s 2024-09-15T23:22:46.255 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.255 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.255 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00657341 s, 160 MB/s 2024-09-15T23:22:46.264 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.264 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.264 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726822 s, 144 MB/s 2024-09-15T23:22:46.273 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.273 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.273 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00656019 s, 160 MB/s 2024-09-15T23:22:46.281 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.281 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.282 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719402 s, 146 MB/s 2024-09-15T23:22:46.291 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.291 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.291 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00780394 s, 134 MB/s 2024-09-15T23:22:46.299 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.300 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.300 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00662622 s, 158 MB/s 2024-09-15T23:22:46.307 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.308 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.308 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640621 s, 164 MB/s 2024-09-15T23:22:46.316 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.317 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.317 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00740454 s, 142 MB/s 2024-09-15T23:22:46.326 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.327 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.327 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00808619 s, 130 MB/s 2024-09-15T23:22:46.335 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.335 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.335 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659179 s, 159 MB/s 2024-09-15T23:22:46.343 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.343 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.344 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00646849 s, 162 MB/s 2024-09-15T23:22:46.351 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.351 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.351 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653352 s, 160 MB/s 2024-09-15T23:22:46.359 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.359 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.359 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633959 s, 165 MB/s 2024-09-15T23:22:46.368 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.368 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.368 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00738416 s, 142 MB/s 2024-09-15T23:22:46.377 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.377 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.377 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724431 s, 145 MB/s 2024-09-15T23:22:46.386 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.386 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.386 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721554 s, 145 MB/s 2024-09-15T23:22:46.394 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.394 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.394 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00639899 s, 164 MB/s 2024-09-15T23:22:46.402 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.402 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.402 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00648534 s, 162 MB/s 2024-09-15T23:22:46.410 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.411 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.411 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00645226 s, 163 MB/s 2024-09-15T23:22:46.419 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.419 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.419 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00703749 s, 149 MB/s 2024-09-15T23:22:46.428 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.429 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.429 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0076003 s, 138 MB/s 2024-09-15T23:22:46.437 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.437 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.438 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00732814 s, 143 MB/s 2024-09-15T23:22:46.446 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.446 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.446 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00696368 s, 151 MB/s 2024-09-15T23:22:46.455 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.455 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.455 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661781 s, 158 MB/s 2024-09-15T23:22:46.462 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.463 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.463 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00636099 s, 165 MB/s 2024-09-15T23:22:46.471 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.472 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.472 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0073933 s, 142 MB/s 2024-09-15T23:22:46.480 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.480 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.480 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634971 s, 165 MB/s 2024-09-15T23:22:46.489 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.489 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.489 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713795 s, 147 MB/s 2024-09-15T23:22:46.497 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.497 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.497 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640375 s, 164 MB/s 2024-09-15T23:22:46.505 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.505 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.505 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00623961 s, 168 MB/s 2024-09-15T23:22:46.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:22:46.511 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:22:46.511 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:22:46.511 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.30 2024-09-15T23:22:46.512 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:22:46.512 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:22:46.512 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:22:46.512 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:22:46.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:22:46.662 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.662 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.662 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633738 s, 165 MB/s 2024-09-15T23:22:46.670 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.670 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.670 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00626433 s, 167 MB/s 2024-09-15T23:22:46.678 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.678 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.678 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613987 s, 171 MB/s 2024-09-15T23:22:46.687 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.687 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.687 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00729958 s, 144 MB/s 2024-09-15T23:22:46.695 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.695 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.695 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0064582 s, 162 MB/s 2024-09-15T23:22:46.703 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.703 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.703 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00583532 s, 180 MB/s 2024-09-15T23:22:46.711 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.711 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.712 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00621928 s, 169 MB/s 2024-09-15T23:22:46.719 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.719 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.719 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634888 s, 165 MB/s 2024-09-15T23:22:46.728 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.729 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.729 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00736095 s, 142 MB/s 2024-09-15T23:22:46.737 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.737 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.737 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00665005 s, 158 MB/s 2024-09-15T23:22:46.745 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.745 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.745 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637671 s, 164 MB/s 2024-09-15T23:22:46.753 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.753 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.754 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00711251 s, 147 MB/s 2024-09-15T23:22:46.761 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.761 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.762 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632191 s, 166 MB/s 2024-09-15T23:22:46.770 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.771 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.771 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695492 s, 151 MB/s 2024-09-15T23:22:46.779 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.779 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.779 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00653803 s, 160 MB/s 2024-09-15T23:22:46.788 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.788 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.788 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.007356 s, 143 MB/s 2024-09-15T23:22:46.796 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.796 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.796 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650393 s, 161 MB/s 2024-09-15T23:22:46.804 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.805 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.805 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00725827 s, 144 MB/s 2024-09-15T23:22:46.813 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.813 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.813 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006444 s, 163 MB/s 2024-09-15T23:22:46.821 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.821 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.821 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00671109 s, 156 MB/s 2024-09-15T23:22:46.829 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.829 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.829 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063523 s, 165 MB/s 2024-09-15T23:22:46.838 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.838 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.838 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00723049 s, 145 MB/s 2024-09-15T23:22:46.847 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.848 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.848 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00724192 s, 145 MB/s 2024-09-15T23:22:46.855 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.856 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.856 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578184 s, 181 MB/s 2024-09-15T23:22:46.864 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.864 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.864 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00719453 s, 146 MB/s 2024-09-15T23:22:46.873 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.873 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.873 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0072185 s, 145 MB/s 2024-09-15T23:22:46.881 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.881 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.881 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644178 s, 163 MB/s 2024-09-15T23:22:46.888 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.889 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.889 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00613822 s, 171 MB/s 2024-09-15T23:22:46.898 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.898 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.898 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00748668 s, 140 MB/s 2024-09-15T23:22:46.905 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.906 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.906 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00624001 s, 168 MB/s 2024-09-15T23:22:46.914 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.914 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.914 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00666581 s, 157 MB/s 2024-09-15T23:22:46.923 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.923 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.924 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00717391 s, 146 MB/s 2024-09-15T23:22:46.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:22:46.930 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c ' 2024-09-15T23:22:46.930 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:22:46.930 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p scrub_control_test_path/dir.31 2024-09-15T23:22:46.930 DEBUG:teuthology.orchestra.run.smithi123:> for ((i = 0; i < 32; i++)); do 2024-09-15T23:22:46.930 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2024-09-15T23:22:46.931 DEBUG:teuthology.orchestra.run.smithi123:> done 2024-09-15T23:22:46.931 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:22:46.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:22:46.988 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.989 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.989 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00579316 s, 181 MB/s 2024-09-15T23:22:46.997 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:46.997 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:46.997 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00647169 s, 162 MB/s 2024-09-15T23:22:47.004 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:47.005 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:47.005 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00587226 s, 179 MB/s 2024-09-15T23:22:47.014 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:47.014 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:47.014 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00726718 s, 144 MB/s 2024-09-15T23:22:47.022 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:47.022 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:47.022 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0063444 s, 165 MB/s 2024-09-15T23:22:47.030 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:47.031 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:47.031 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0068491 s, 153 MB/s 2024-09-15T23:22:47.039 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:47.040 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:47.040 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0075185 s, 139 MB/s 2024-09-15T23:22:47.048 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:47.048 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:47.048 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658741 s, 159 MB/s 2024-09-15T23:22:47.057 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:47.057 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:47.057 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00731841 s, 143 MB/s 2024-09-15T23:22:47.065 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:47.065 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:47.065 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00630798 s, 166 MB/s 2024-09-15T23:22:47.073 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:47.074 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:47.074 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00677239 s, 155 MB/s 2024-09-15T23:22:47.082 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:47.082 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:47.082 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00633866 s, 165 MB/s 2024-09-15T23:22:47.090 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:47.090 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:47.090 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00637015 s, 165 MB/s 2024-09-15T23:22:47.098 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:47.099 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:47.099 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658004 s, 159 MB/s 2024-09-15T23:22:47.107 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:47.107 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:47.107 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00661521 s, 159 MB/s 2024-09-15T23:22:47.115 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:47.115 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:47.115 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00641047 s, 164 MB/s 2024-09-15T23:22:47.124 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:47.124 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:47.124 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741392 s, 141 MB/s 2024-09-15T23:22:47.133 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:47.133 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:47.133 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00669862 s, 157 MB/s 2024-09-15T23:22:47.140 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:47.141 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:47.141 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00599419 s, 175 MB/s 2024-09-15T23:22:47.149 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:47.149 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:47.149 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00640226 s, 164 MB/s 2024-09-15T23:22:47.157 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:47.158 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:47.158 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00578809 s, 181 MB/s 2024-09-15T23:22:47.164 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:47.164 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:47.164 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00602914 s, 174 MB/s 2024-09-15T23:22:47.172 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:47.172 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:47.172 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00628999 s, 167 MB/s 2024-09-15T23:22:47.180 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:47.181 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:47.181 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00655517 s, 160 MB/s 2024-09-15T23:22:47.188 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:47.188 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:47.188 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00597697 s, 175 MB/s 2024-09-15T23:22:47.196 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:47.196 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:47.196 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00638826 s, 164 MB/s 2024-09-15T23:22:47.205 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:47.205 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:47.205 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00714643 s, 147 MB/s 2024-09-15T23:22:47.214 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:47.214 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:47.214 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00700658 s, 150 MB/s 2024-09-15T23:22:47.223 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:47.223 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:47.223 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00706368 s, 148 MB/s 2024-09-15T23:22:47.232 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:47.232 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:47.232 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00705229 s, 149 MB/s 2024-09-15T23:22:47.240 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:47.240 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:47.241 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00659961 s, 159 MB/s 2024-09-15T23:22:47.250 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-09-15T23:22:47.250 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-09-15T23:22:47.250 INFO:teuthology.orchestra.run.smithi123.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721041 s, 145 MB/s 2024-09-15T23:22:47.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:22:47.256 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2024-09-15T23:22:47.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.356+0000 7f4f9e1e4640 1 Processor -- start 2024-09-15T23:22:47.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.356+0000 7f4f9e1e4640 1 -- start start 2024-09-15T23:22:47.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.357+0000 7f4f9e1e4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f98163190 0x7f4f9806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:47.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.357+0000 7f4f9e1e4640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4f9806c150 0x7f4f980ce860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:47.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.357+0000 7f4f9e1e4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f9814c8f0 con 0x7f4f9814c510 2024-09-15T23:22:47.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.357+0000 7f4f9e1e4640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f4f980ce0f0 con 0x7f4f9806c150 2024-09-15T23:22:47.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.357+0000 7f4f9e1e4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4f98073a80 con 0x7f4f98163190 2024-09-15T23:22:47.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.357+0000 7f4f977fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f4f9814c510 0x7f4f98070f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:45218/0 (socket says 172.21.15.123:45218) 2024-09-15T23:22:47.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.357+0000 7f4f977fe640 1 -- 172.21.15.123:0/199915004 learned_addr learned my addr 172.21.15.123:0/199915004 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:47.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.357+0000 7f4f967fc640 1 -- 172.21.15.123:0/199915004 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 890777842 0 0) 0x7f4f9814c8f0 con 0x7f4f9814c510 2024-09-15T23:22:47.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.357+0000 7f4f967fc640 1 -- 172.21.15.123:0/199915004 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f80003520 con 0x7f4f9814c510 2024-09-15T23:22:47.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.357+0000 7f4f96ffd640 1 --2- 172.21.15.123:0/199915004 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f98163190 0x7f4f9806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:47.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.357+0000 7f4f97fff640 1 --2- 172.21.15.123:0/199915004 >> v2:172.21.15.188:3300/0 conn(0x7f4f9806c150 0x7f4f980ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:47.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.357+0000 7f4f967fc640 1 -- 172.21.15.123:0/199915004 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 161059665 0 0) 0x7f4f80003520 con 0x7f4f9814c510 2024-09-15T23:22:47.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.357+0000 7f4f967fc640 1 -- 172.21.15.123:0/199915004 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f98163190 msgr2=0x7f4f9806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:47.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.357+0000 7f4f967fc640 1 --2- 172.21.15.123:0/199915004 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f98163190 0x7f4f9806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:47.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.357+0000 7f4f967fc640 1 -- 172.21.15.123:0/199915004 >> v2:172.21.15.188:3300/0 conn(0x7f4f9806c150 msgr2=0x7f4f980ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:47.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.357+0000 7f4f967fc640 1 --2- 172.21.15.123:0/199915004 >> v2:172.21.15.188:3300/0 conn(0x7f4f9806c150 0x7f4f980ce860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:47.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.357+0000 7f4f967fc640 1 -- 172.21.15.123:0/199915004 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f98073d60 con 0x7f4f9814c510 2024-09-15T23:22:47.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.357+0000 7f4f967fc640 1 -- 172.21.15.123:0/199915004 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f4f88001670 con 0x7f4f9814c510 2024-09-15T23:22:47.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.357+0000 7f4f967fc640 1 -- 172.21.15.123:0/199915004 >> v1:172.21.15.123:6789/0 conn(0x7f4f9814c510 legacy=0x7f4f98070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:47.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.357+0000 7f4f967fc640 1 --2- 172.21.15.123:0/199915004 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f98163190 0x7f4f800039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:47.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.357+0000 7f4f967fc640 1 --2- 172.21.15.123:0/199915004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f80003f30 0x7f4f80004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:47.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.357+0000 7f4f967fc640 1 --2- 172.21.15.123:0/199915004 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f80004d40 0x7f4f800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:47.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.357+0000 7f4f967fc640 1 -- 172.21.15.123:0/199915004 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4f980ce0f0 con 0x7f4f80003f30 2024-09-15T23:22:47.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.357+0000 7f4f967fc640 1 -- 172.21.15.123:0/199915004 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4f98073a80 con 0x7f4f80004d40 2024-09-15T23:22:47.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.357+0000 7f4f967fc640 1 -- 172.21.15.123:0/199915004 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4f8000b9c0 con 0x7f4f98163190 2024-09-15T23:22:47.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.357+0000 7f4f96ffd640 1 --2- 172.21.15.123:0/199915004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f80003f30 0x7f4f80004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:47.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.358+0000 7f4f977fe640 1 --2- 172.21.15.123:0/199915004 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f98163190 0x7f4f800039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:47.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.358+0000 7f4f97fff640 1 --2- 172.21.15.123:0/199915004 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f80004d40 0x7f4f800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:47.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.358+0000 7f4f96ffd640 1 -- 172.21.15.123:0/199915004 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f98163190 msgr2=0x7f4f800039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:47.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.358+0000 7f4f96ffd640 1 --2- 172.21.15.123:0/199915004 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f98163190 0x7f4f800039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:47.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.358+0000 7f4f96ffd640 1 -- 172.21.15.123:0/199915004 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f80004d40 msgr2=0x7f4f800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:47.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.358+0000 7f4f96ffd640 1 --2- 172.21.15.123:0/199915004 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f80004d40 0x7f4f800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:47.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.358+0000 7f4f96ffd640 1 -- 172.21.15.123:0/199915004 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f80003520 con 0x7f4f80003f30 2024-09-15T23:22:47.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.358+0000 7f4f96ffd640 1 --2- 172.21.15.123:0/199915004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f80003f30 0x7f4f80004800 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009a90 tx=0x7f4f80005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f9c2020879625c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:47.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.359+0000 7f4f967fc640 1 -- 172.21.15.123:0/199915004 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c036070 con 0x7f4f80003f30 2024-09-15T23:22:47.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.359+0000 7f4f967fc640 1 -- 172.21.15.123:0/199915004 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f8c031400 con 0x7f4f80003f30 2024-09-15T23:22:47.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.359+0000 7f4f967fc640 1 -- 172.21.15.123:0/199915004 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c009690 con 0x7f4f80003f30 2024-09-15T23:22:47.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.359+0000 7f4f9e1e4640 1 -- 172.21.15.123:0/199915004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f80003f30 msgr2=0x7f4f80004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:47.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.359+0000 7f4f9e1e4640 1 --2- 172.21.15.123:0/199915004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f80003f30 0x7f4f80004800 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009a90 tx=0x7f4f80005830 comp rx=0 tx=0).stop 2024-09-15T23:22:47.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.359+0000 7f4f97fff640 1 -- 172.21.15.123:0/199915004 reap_dead start 2024-09-15T23:22:47.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.359+0000 7f4f9e1e4640 1 -- 172.21.15.123:0/199915004 shutdown_connections 2024-09-15T23:22:47.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.359+0000 7f4f9e1e4640 1 -- 172.21.15.123:0/199915004 >> 172.21.15.123:0/199915004 conn(0x7f4f9806d0f0 msgr2=0x7f4f9806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:47.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.359+0000 7f4f9e1e4640 1 -- 172.21.15.123:0/199915004 shutdown_connections 2024-09-15T23:22:47.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.359+0000 7f4f9e1e4640 1 -- 172.21.15.123:0/199915004 wait complete. 2024-09-15T23:22:47.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.360+0000 7f4f9e1e4640 1 Processor -- start 2024-09-15T23:22:47.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.361+0000 7f4f9e1e4640 1 -- start start 2024-09-15T23:22:47.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.361+0000 7f4f9e1e4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f80003f30 0x7f4f981f8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:47.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.361+0000 7f4f9e1e4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f98160e50 0x7f4f98140930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:47.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.361+0000 7f4f9e1e4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f98139000 0x7f4f98139480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:47.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.361+0000 7f4f9e1e4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4f98071650 con 0x7f4f98160e50 2024-09-15T23:22:47.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.361+0000 7f4f9e1e4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4f980ce340 con 0x7f4f98139000 2024-09-15T23:22:47.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.361+0000 7f4f9e1e4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4f98073610 con 0x7f4f80003f30 2024-09-15T23:22:47.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.361+0000 7f4f96ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f98160e50 0x7f4f98140930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:47.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.361+0000 7f4f96ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f98160e50 0x7f4f98140930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59078/0 (socket says 172.21.15.123:59078) 2024-09-15T23:22:47.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.361+0000 7f4f96ffd640 1 -- 172.21.15.123:0/1069083323 learned_addr learned my addr 172.21.15.123:0/1069083323 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:47.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.361+0000 7f4f97fff640 1 --2- 172.21.15.123:0/1069083323 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f98139000 0x7f4f98139480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:47.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.361+0000 7f4f977fe640 1 --2- 172.21.15.123:0/1069083323 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f80003f30 0x7f4f981f8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:47.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.362+0000 7f4f96ffd640 1 -- 172.21.15.123:0/1069083323 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f80003f30 msgr2=0x7f4f981f8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:47.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.362+0000 7f4f96ffd640 1 --2- 172.21.15.123:0/1069083323 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f80003f30 0x7f4f981f8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:47.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.362+0000 7f4f96ffd640 1 -- 172.21.15.123:0/1069083323 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f98139000 msgr2=0x7f4f98139480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:47.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.362+0000 7f4f96ffd640 1 --2- 172.21.15.123:0/1069083323 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f98139000 0x7f4f98139480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:47.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.362+0000 7f4f96ffd640 1 -- 172.21.15.123:0/1069083323 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f981399c0 con 0x7f4f98160e50 2024-09-15T23:22:47.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.362+0000 7f4f977fe640 1 --2- 172.21.15.123:0/1069083323 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f80003f30 0x7f4f981f8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:47.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.362+0000 7f4f96ffd640 1 --2- 172.21.15.123:0/1069083323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f98160e50 0x7f4f98140930 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009a90 tx=0x7f4f8c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:47.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.362+0000 7f4f7ffff640 1 -- 172.21.15.123:0/1069083323 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c040020 con 0x7f4f98160e50 2024-09-15T23:22:47.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.362+0000 7f4f7ffff640 1 -- 172.21.15.123:0/1069083323 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f8c03b660 con 0x7f4f98160e50 2024-09-15T23:22:47.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.362+0000 7f4f7ffff640 1 -- 172.21.15.123:0/1069083323 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c036040 con 0x7f4f98160e50 2024-09-15T23:22:47.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.362+0000 7f4f9e1e4640 1 -- 172.21.15.123:0/1069083323 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f981f9670 con 0x7f4f98160e50 2024-09-15T23:22:47.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.362+0000 7f4f9e1e4640 1 -- 172.21.15.123:0/1069083323 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f981f9c30 con 0x7f4f98160e50 2024-09-15T23:22:47.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.363+0000 7f4f9e1e4640 1 -- 172.21.15.123:0/1069083323 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f9806bc10 con 0x7f4f98160e50 2024-09-15T23:22:47.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.363+0000 7f4f7ffff640 1 -- 172.21.15.123:0/1069083323 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4f8c043020 con 0x7f4f98160e50 2024-09-15T23:22:47.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.364+0000 7f4f7ffff640 1 --2- 172.21.15.123:0/1069083323 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4f8406c2e0 0x7f4f8406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:47.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.364+0000 7f4f7ffff640 1 -- 172.21.15.123:0/1069083323 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f4f8c0abac0 con 0x7f4f98160e50 2024-09-15T23:22:47.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.364+0000 7f4f977fe640 1 --2- 172.21.15.123:0/1069083323 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4f8406c2e0 0x7f4f8406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:47.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.364+0000 7f4f977fe640 1 --2- 172.21.15.123:0/1069083323 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4f8406c2e0 0x7f4f8406e7a0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f4f88007fd0 tx=0x7f4f88009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:47.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.368+0000 7f4f7ffff640 1 -- 172.21.15.123:0/1069083323 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4f8c04a030 con 0x7f4f98160e50 2024-09-15T23:22:47.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.568+0000 7f4f9e1e4640 1 -- 172.21.15.123:0/1069083323 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) -- 0x7f4f980cdda0 con 0x7f4f98160e50 2024-09-15T23:22:47.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.725+0000 7f4f7ffff640 1 -- 172.21.15.123:0/1069083323 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v111) ==== 105+0+0 (secure 0 0 0) 0x7f4f8c079ad0 con 0x7f4f98160e50 2024-09-15T23:22:47.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.727+0000 7f4f9e1e4640 1 -- 172.21.15.123:0/1069083323 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4f8406c2e0 msgr2=0x7f4f8406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:47.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.727+0000 7f4f9e1e4640 1 --2- 172.21.15.123:0/1069083323 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4f8406c2e0 0x7f4f8406e7a0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f4f88007fd0 tx=0x7f4f88009040 comp rx=0 tx=0).stop 2024-09-15T23:22:47.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.727+0000 7f4f9e1e4640 1 -- 172.21.15.123:0/1069083323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f98160e50 msgr2=0x7f4f98140930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:47.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.727+0000 7f4f9e1e4640 1 --2- 172.21.15.123:0/1069083323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f98160e50 0x7f4f98140930 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009a90 tx=0x7f4f8c004730 comp rx=0 tx=0).stop 2024-09-15T23:22:47.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.727+0000 7f4f9e1e4640 1 -- 172.21.15.123:0/1069083323 shutdown_connections 2024-09-15T23:22:47.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.727+0000 7f4f9e1e4640 1 --2- 172.21.15.123:0/1069083323 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4f98139000 0x7f4f98139480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:47.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.727+0000 7f4f9e1e4640 1 --2- 172.21.15.123:0/1069083323 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4f8406c2e0 0x7f4f8406e7a0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:47.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.727+0000 7f4f9e1e4640 1 --2- 172.21.15.123:0/1069083323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f98160e50 0x7f4f98140930 unknown :-1 s=CLOSED pgs=2118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:47.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.727+0000 7f4f9e1e4640 1 --2- 172.21.15.123:0/1069083323 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4f80003f30 0x7f4f981f8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:47.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.727+0000 7f4f9e1e4640 1 -- 172.21.15.123:0/1069083323 >> 172.21.15.123:0/1069083323 conn(0x7f4f9806d0f0 msgr2=0x7f4f9814a520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:47.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.727+0000 7f4f9e1e4640 1 -- 172.21.15.123:0/1069083323 shutdown_connections 2024-09-15T23:22:47.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.727+0000 7f4f9e1e4640 1 -- 172.21.15.123:0/1069083323 wait complete. 2024-09-15T23:22:47.739 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-09-15T23:22:47.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.839+0000 7fe17f077640 1 Processor -- start 2024-09-15T23:22:47.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.839+0000 7fe17f077640 1 -- start start 2024-09-15T23:22:47.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.840+0000 7fe17f077640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe178071db0 0x7fe178072210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:47.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.840+0000 7fe17f077640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1781590f0 con 0x7fe178158d10 2024-09-15T23:22:47.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.840+0000 7fe17f077640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe17815f040 con 0x7fe178160100 2024-09-15T23:22:47.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.840+0000 7fe17f077640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe178071ab0 con 0x7fe178071db0 2024-09-15T23:22:47.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.840+0000 7fe17ce13640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe178158d10 0x7fe1780713a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:45230/0 (socket says 172.21.15.123:45230) 2024-09-15T23:22:47.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.840+0000 7fe17ce13640 1 -- 172.21.15.123:0/2100108008 learned_addr learned my addr 172.21.15.123:0/2100108008 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:47.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.840+0000 7fe177fff640 1 --2- 172.21.15.123:0/2100108008 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe178071db0 0x7fe178072210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:47.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.840+0000 7fe1777fe640 1 -- 172.21.15.123:0/2100108008 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4101896570 0 0) 0x7fe1781590f0 con 0x7fe178158d10 2024-09-15T23:22:47.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.840+0000 7fe1777fe640 1 -- 172.21.15.123:0/2100108008 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe168003520 con 0x7fe178158d10 2024-09-15T23:22:47.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.840+0000 7fe1777fe640 1 -- 172.21.15.123:0/2100108008 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2853522698 0 0) 0x7fe17815f040 con 0x7fe178160100 2024-09-15T23:22:47.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.840+0000 7fe1777fe640 1 -- 172.21.15.123:0/2100108008 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1781590f0 con 0x7fe178160100 2024-09-15T23:22:47.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.840+0000 7fe1777fe640 1 -- 172.21.15.123:0/2100108008 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2300415858 0 0) 0x7fe168003520 con 0x7fe178158d10 2024-09-15T23:22:47.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.840+0000 7fe177fff640 1 -- 172.21.15.123:0/2100108008 >> v1:172.21.15.188:6789/0 conn(0x7fe178160100 legacy=0x7fe178160570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:47.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.840+0000 7fe177fff640 1 -- 172.21.15.123:0/2100108008 >> v1:172.21.15.123:6789/0 conn(0x7fe178158d10 legacy=0x7fe1780713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:47.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.840+0000 7fe177fff640 1 -- 172.21.15.123:0/2100108008 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe17815f320 con 0x7fe178071db0 2024-09-15T23:22:47.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.841+0000 7fe177fff640 1 --2- 172.21.15.123:0/2100108008 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe178071db0 0x7fe178072210 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe1640097d0 tx=0x7fe16402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0d10bb7f56efbb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:47.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.841+0000 7fe1777fe640 1 -- 172.21.15.123:0/2100108008 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe164037070 con 0x7fe178071db0 2024-09-15T23:22:47.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.841+0000 7fe1777fe640 1 -- 172.21.15.123:0/2100108008 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe16402ac30 con 0x7fe178071db0 2024-09-15T23:22:47.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.841+0000 7fe1777fe640 1 -- 172.21.15.123:0/2100108008 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe16c001670 con 0x7fe178071db0 2024-09-15T23:22:47.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.842+0000 7fe17f077640 1 -- 172.21.15.123:0/2100108008 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe178071db0 msgr2=0x7fe178072210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:47.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.842+0000 7fe17f077640 1 --2- 172.21.15.123:0/2100108008 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe178071db0 0x7fe178072210 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe1640097d0 tx=0x7fe16402a1a0 comp rx=0 tx=0).stop 2024-09-15T23:22:47.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.842+0000 7fe17f077640 1 -- 172.21.15.123:0/2100108008 shutdown_connections 2024-09-15T23:22:47.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.842+0000 7fe17f077640 1 --2- 172.21.15.123:0/2100108008 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe178071db0 0x7fe178072210 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:47.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.842+0000 7fe17f077640 1 -- 172.21.15.123:0/2100108008 >> 172.21.15.123:0/2100108008 conn(0x7fe1780b2510 msgr2=0x7fe1780b28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:47.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.842+0000 7fe17f077640 1 -- 172.21.15.123:0/2100108008 shutdown_connections 2024-09-15T23:22:47.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.842+0000 7fe17f077640 1 -- 172.21.15.123:0/2100108008 wait complete. 2024-09-15T23:22:47.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.843+0000 7fe17f077640 1 Processor -- start 2024-09-15T23:22:47.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.843+0000 7fe17f077640 1 -- start start 2024-09-15T23:22:47.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.844+0000 7fe17f077640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe178071db0 0x7fe178153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:47.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.844+0000 7fe17f077640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe178158d10 0x7fe178159320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:47.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.844+0000 7fe17f077640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe178160100 0x7fe17815b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:47.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.844+0000 7fe17f077640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe17815f8e0 con 0x7fe178160100 2024-09-15T23:22:47.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.844+0000 7fe17f077640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe17815fbc0 con 0x7fe178158d10 2024-09-15T23:22:47.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.844+0000 7fe17f077640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe17815ec00 con 0x7fe178071db0 2024-09-15T23:22:47.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.844+0000 7fe17d614640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe178160100 0x7fe17815b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:47.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.844+0000 7fe17d614640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe178160100 0x7fe17815b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59086/0 (socket says 172.21.15.123:59086) 2024-09-15T23:22:47.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.844+0000 7fe17d614640 1 -- 172.21.15.123:0/3306394067 learned_addr learned my addr 172.21.15.123:0/3306394067 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:47.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.844+0000 7fe17ce13640 1 --2- 172.21.15.123:0/3306394067 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe178071db0 0x7fe178153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:47.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.844+0000 7fe177fff640 1 --2- 172.21.15.123:0/3306394067 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe178158d10 0x7fe178159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:47.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.844+0000 7fe17d614640 1 -- 172.21.15.123:0/3306394067 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe178071db0 msgr2=0x7fe178153040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:47.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.844+0000 7fe17d614640 1 --2- 172.21.15.123:0/3306394067 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe178071db0 0x7fe178153040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:47.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.845+0000 7fe17d614640 1 -- 172.21.15.123:0/3306394067 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe178158d10 msgr2=0x7fe178159320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:47.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.845+0000 7fe17d614640 1 --2- 172.21.15.123:0/3306394067 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe178158d10 0x7fe178159320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:47.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.845+0000 7fe17d614640 1 -- 172.21.15.123:0/3306394067 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe178159ca0 con 0x7fe178160100 2024-09-15T23:22:47.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.845+0000 7fe177fff640 1 --2- 172.21.15.123:0/3306394067 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe178158d10 0x7fe178159320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:47.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.845+0000 7fe17d614640 1 --2- 172.21.15.123:0/3306394067 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe178160100 0x7fe17815b800 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7fe17000c790 tx=0x7fe17000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:47.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.845+0000 7fe1757fa640 1 -- 172.21.15.123:0/3306394067 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe170003b70 con 0x7fe178160100 2024-09-15T23:22:47.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.845+0000 7fe1757fa640 1 -- 172.21.15.123:0/3306394067 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe170003d10 con 0x7fe178160100 2024-09-15T23:22:47.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.845+0000 7fe1757fa640 1 -- 172.21.15.123:0/3306394067 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17000aa50 con 0x7fe178160100 2024-09-15T23:22:47.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.845+0000 7fe17f077640 1 -- 172.21.15.123:0/3306394067 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe178159f60 con 0x7fe178160100 2024-09-15T23:22:47.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.845+0000 7fe17f077640 1 -- 172.21.15.123:0/3306394067 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1781545b0 con 0x7fe178160100 2024-09-15T23:22:47.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.846+0000 7fe17f077640 1 -- 172.21.15.123:0/3306394067 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1780b58c0 con 0x7fe178160100 2024-09-15T23:22:47.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.846+0000 7fe1757fa640 1 -- 172.21.15.123:0/3306394067 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe17000abf0 con 0x7fe178160100 2024-09-15T23:22:47.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.847+0000 7fe1757fa640 1 --2- 172.21.15.123:0/3306394067 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe15c06c2b0 0x7fe15c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:47.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.847+0000 7fe1757fa640 1 -- 172.21.15.123:0/3306394067 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7fe17008b2d0 con 0x7fe178160100 2024-09-15T23:22:47.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.847+0000 7fe17ce13640 1 --2- 172.21.15.123:0/3306394067 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe15c06c2b0 0x7fe15c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:47.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.847+0000 7fe17ce13640 1 --2- 172.21.15.123:0/3306394067 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe15c06c2b0 0x7fe15c06e770 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0017e0 tx=0x7fe16c001610 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:47.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:47.851+0000 7fe1757fa640 1 -- 172.21.15.123:0/3306394067 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe1780b58c0 con 0x7fe178160100 2024-09-15T23:22:48.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.050+0000 7fe17f077640 1 -- 172.21.15.123:0/3306394067 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fe1781614f0 con 0x7fe178160100 2024-09-15T23:22:48.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.732+0000 7fe1757fa640 1 -- 172.21.15.123:0/3306394067 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v112) ==== 121+0+0 (secure 0 0 0) 0x7fe170059ad0 con 0x7fe178160100 2024-09-15T23:22:48.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.734+0000 7fe17f077640 1 -- 172.21.15.123:0/3306394067 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe15c06c2b0 msgr2=0x7fe15c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:48.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.734+0000 7fe17f077640 1 --2- 172.21.15.123:0/3306394067 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe15c06c2b0 0x7fe15c06e770 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0017e0 tx=0x7fe16c001610 comp rx=0 tx=0).stop 2024-09-15T23:22:48.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.734+0000 7fe17f077640 1 -- 172.21.15.123:0/3306394067 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe178160100 msgr2=0x7fe17815b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:48.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.734+0000 7fe17f077640 1 --2- 172.21.15.123:0/3306394067 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe178160100 0x7fe17815b800 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7fe17000c790 tx=0x7fe17000cc50 comp rx=0 tx=0).stop 2024-09-15T23:22:48.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.734+0000 7fe17f077640 1 -- 172.21.15.123:0/3306394067 shutdown_connections 2024-09-15T23:22:48.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.734+0000 7fe17f077640 1 --2- 172.21.15.123:0/3306394067 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe15c06c2b0 0x7fe15c06e770 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:48.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.734+0000 7fe17f077640 1 --2- 172.21.15.123:0/3306394067 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe178160100 0x7fe17815b800 unknown :-1 s=CLOSED pgs=2120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:48.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.734+0000 7fe17f077640 1 --2- 172.21.15.123:0/3306394067 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe178158d10 0x7fe178159320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:48.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.734+0000 7fe17f077640 1 --2- 172.21.15.123:0/3306394067 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe178071db0 0x7fe178153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:48.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.734+0000 7fe17f077640 1 -- 172.21.15.123:0/3306394067 >> 172.21.15.123:0/3306394067 conn(0x7fe1780b2510 msgr2=0x7fe1780b4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:48.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.734+0000 7fe17f077640 1 -- 172.21.15.123:0/3306394067 shutdown_connections 2024-09-15T23:22:48.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.734+0000 7fe17f077640 1 -- 172.21.15.123:0/3306394067 wait complete. 2024-09-15T23:22:48.750 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:22:48.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.854+0000 7f0255627640 1 Processor -- start 2024-09-15T23:22:48.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.854+0000 7f0255627640 1 -- start start 2024-09-15T23:22:48.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.854+0000 7f0255627640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02500b2d40 0x7f025006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:48.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.855+0000 7f0255627640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0250071180 con 0x7f025013eb20 2024-09-15T23:22:48.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.855+0000 7f0255627640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0250071460 con 0x7f025006c150 2024-09-15T23:22:48.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.855+0000 7f0255627640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0250071ab0 con 0x7f02500b2d40 2024-09-15T23:22:48.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.855+0000 7f024e7fc640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f025013eb20 0x7f025015bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:45244/0 (socket says 172.21.15.123:45244) 2024-09-15T23:22:48.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.855+0000 7f024e7fc640 1 -- 172.21.15.123:0/3268375709 learned_addr learned my addr 172.21.15.123:0/3268375709 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:48.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.855+0000 7f024effd640 1 --2- 172.21.15.123:0/3268375709 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02500b2d40 0x7f025006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:48.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.855+0000 7f024dffb640 1 -- 172.21.15.123:0/3268375709 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1122017785 0 0) 0x7f0250071180 con 0x7f025013eb20 2024-09-15T23:22:48.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.855+0000 7f024dffb640 1 -- 172.21.15.123:0/3268375709 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0238003520 con 0x7f025013eb20 2024-09-15T23:22:48.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.855+0000 7f024dffb640 1 -- 172.21.15.123:0/3268375709 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 802195340 0 0) 0x7f0238003520 con 0x7f025013eb20 2024-09-15T23:22:48.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.855+0000 7f024dffb640 1 -- 172.21.15.123:0/3268375709 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02500b2d40 msgr2=0x7f025006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:48.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.855+0000 7f024dffb640 1 --2- 172.21.15.123:0/3268375709 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02500b2d40 0x7f025006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:48.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.855+0000 7f024dffb640 1 -- 172.21.15.123:0/3268375709 >> v1:172.21.15.188:6789/0 conn(0x7f025006c150 legacy=0x7f0250071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:48.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.855+0000 7f024dffb640 1 -- 172.21.15.123:0/3268375709 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0250071740 con 0x7f025013eb20 2024-09-15T23:22:48.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.855+0000 7f024dffb640 1 -- 172.21.15.123:0/3268375709 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f0244001670 con 0x7f025013eb20 2024-09-15T23:22:48.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.855+0000 7f024dffb640 1 -- 172.21.15.123:0/3268375709 >> v1:172.21.15.123:6789/0 conn(0x7f025013eb20 legacy=0x7f025015bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:48.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.855+0000 7f024dffb640 1 --2- 172.21.15.123:0/3268375709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02380039e0 0x7f0238003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:48.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.855+0000 7f024dffb640 1 --2- 172.21.15.123:0/3268375709 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02500b2d40 0x7f0238004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:48.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.855+0000 7f024dffb640 1 --2- 172.21.15.123:0/3268375709 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0238004d40 0x7f02380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:48.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.855+0000 7f024dffb640 1 -- 172.21.15.123:0/3268375709 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0250071ab0 con 0x7f02380039e0 2024-09-15T23:22:48.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.855+0000 7f024dffb640 1 -- 172.21.15.123:0/3268375709 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f023800b9c0 con 0x7f0238004d40 2024-09-15T23:22:48.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.855+0000 7f024dffb640 1 -- 172.21.15.123:0/3268375709 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f023800bbc0 con 0x7f02500b2d40 2024-09-15T23:22:48.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.855+0000 7f024effd640 1 --2- 172.21.15.123:0/3268375709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02380039e0 0x7f0238003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:48.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.856+0000 7f024e7fc640 1 --2- 172.21.15.123:0/3268375709 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02500b2d40 0x7f0238004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:48.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.856+0000 7f024f7fe640 1 --2- 172.21.15.123:0/3268375709 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0238004d40 0x7f02380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:48.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.856+0000 7f024effd640 1 -- 172.21.15.123:0/3268375709 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02500b2d40 msgr2=0x7f0238004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:48.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.856+0000 7f024effd640 1 --2- 172.21.15.123:0/3268375709 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02500b2d40 0x7f0238004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:48.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.856+0000 7f024effd640 1 -- 172.21.15.123:0/3268375709 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0238004d40 msgr2=0x7f02380051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:48.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.856+0000 7f024effd640 1 --2- 172.21.15.123:0/3268375709 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0238004d40 0x7f02380051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:48.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.856+0000 7f024effd640 1 -- 172.21.15.123:0/3268375709 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0238003520 con 0x7f02380039e0 2024-09-15T23:22:48.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.856+0000 7f024f7fe640 1 --2- 172.21.15.123:0/3268375709 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0238004d40 0x7f02380051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:48.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.856+0000 7f024effd640 1 --2- 172.21.15.123:0/3268375709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02380039e0 0x7f0238003dc0 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7f0240009aa0 tx=0x7f0238005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc3f033868e04a3d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:48.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.857+0000 7f024dffb640 1 -- 172.21.15.123:0/3268375709 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0240036070 con 0x7f02380039e0 2024-09-15T23:22:48.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.857+0000 7f024dffb640 1 -- 172.21.15.123:0/3268375709 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0240031400 con 0x7f02380039e0 2024-09-15T23:22:48.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.857+0000 7f024dffb640 1 -- 172.21.15.123:0/3268375709 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0240009670 con 0x7f02380039e0 2024-09-15T23:22:48.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.857+0000 7f0255627640 1 -- 172.21.15.123:0/3268375709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02380039e0 msgr2=0x7f0238003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:48.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.857+0000 7f0255627640 1 --2- 172.21.15.123:0/3268375709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02380039e0 0x7f0238003dc0 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7f0240009aa0 tx=0x7f0238005830 comp rx=0 tx=0).stop 2024-09-15T23:22:48.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.857+0000 7f024f7fe640 1 -- 172.21.15.123:0/3268375709 reap_dead start 2024-09-15T23:22:48.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.857+0000 7f0255627640 1 -- 172.21.15.123:0/3268375709 shutdown_connections 2024-09-15T23:22:48.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.857+0000 7f0255627640 1 -- 172.21.15.123:0/3268375709 >> 172.21.15.123:0/3268375709 conn(0x7f02500ccec0 msgr2=0x7f02500cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:48.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.857+0000 7f0255627640 1 -- 172.21.15.123:0/3268375709 shutdown_connections 2024-09-15T23:22:48.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.857+0000 7f0255627640 1 -- 172.21.15.123:0/3268375709 wait complete. 2024-09-15T23:22:48.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.859+0000 7f0255627640 1 Processor -- start 2024-09-15T23:22:48.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.859+0000 7f0255627640 1 -- start start 2024-09-15T23:22:48.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.859+0000 7f0255627640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02380039e0 0x7f02500cc310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:48.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.859+0000 7f0255627640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02500cc850 0x7f02500b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:48.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.859+0000 7f0255627640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f02500b3ab0 0x7f0250156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:48.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.859+0000 7f0255627640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f025006bfa0 con 0x7f02500cc850 2024-09-15T23:22:48.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.859+0000 7f0255627640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f025006be20 con 0x7f02500b3ab0 2024-09-15T23:22:48.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.859+0000 7f0255627640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f025015c400 con 0x7f02380039e0 2024-09-15T23:22:48.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.859+0000 7f024e7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02500cc850 0x7f02500b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:48.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.859+0000 7f024e7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02500cc850 0x7f02500b3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59090/0 (socket says 172.21.15.123:59090) 2024-09-15T23:22:48.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.859+0000 7f024e7fc640 1 -- 172.21.15.123:0/2977591722 learned_addr learned my addr 172.21.15.123:0/2977591722 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:48.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.859+0000 7f024effd640 1 --2- 172.21.15.123:0/2977591722 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02380039e0 0x7f02500cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:48.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.860+0000 7f024f7fe640 1 --2- 172.21.15.123:0/2977591722 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f02500b3ab0 0x7f0250156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:48.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.860+0000 7f024e7fc640 1 -- 172.21.15.123:0/2977591722 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02380039e0 msgr2=0x7f02500cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:48.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.860+0000 7f024e7fc640 1 --2- 172.21.15.123:0/2977591722 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02380039e0 0x7f02500cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:48.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.860+0000 7f024e7fc640 1 -- 172.21.15.123:0/2977591722 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f02500b3ab0 msgr2=0x7f0250156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:48.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.860+0000 7f024e7fc640 1 --2- 172.21.15.123:0/2977591722 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f02500b3ab0 0x7f0250156090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:48.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.860+0000 7f024e7fc640 1 -- 172.21.15.123:0/2977591722 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02501f4a80 con 0x7f02500cc850 2024-09-15T23:22:48.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.860+0000 7f024effd640 1 --2- 172.21.15.123:0/2977591722 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02380039e0 0x7f02500cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:48.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.860+0000 7f024e7fc640 1 --2- 172.21.15.123:0/2977591722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02500cc850 0x7f02500b3570 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7f02440073a0 tx=0x7f0244007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:48.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.860+0000 7f02377fe640 1 -- 172.21.15.123:0/2977591722 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024401a070 con 0x7f02500cc850 2024-09-15T23:22:48.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.860+0000 7f02377fe640 1 -- 172.21.15.123:0/2977591722 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f024400f960 con 0x7f02500cc850 2024-09-15T23:22:48.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.860+0000 7f0255627640 1 -- 172.21.15.123:0/2977591722 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02501f4d60 con 0x7f02500cc850 2024-09-15T23:22:48.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.860+0000 7f02377fe640 1 -- 172.21.15.123:0/2977591722 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024400fd30 con 0x7f02500cc850 2024-09-15T23:22:48.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.860+0000 7f0255627640 1 -- 172.21.15.123:0/2977591722 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02501f5320 con 0x7f02500cc850 2024-09-15T23:22:48.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.861+0000 7f0255627640 1 -- 172.21.15.123:0/2977591722 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02500cccd0 con 0x7f02500cc850 2024-09-15T23:22:48.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.861+0000 7f02377fe640 1 -- 172.21.15.123:0/2977591722 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f024401d360 con 0x7f02500cc850 2024-09-15T23:22:48.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.862+0000 7f02377fe640 1 --2- 172.21.15.123:0/2977591722 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f023c06c2b0 0x7f023c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:48.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.862+0000 7f02377fe640 1 -- 172.21.15.123:0/2977591722 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f024408ad50 con 0x7f02500cc850 2024-09-15T23:22:48.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.862+0000 7f024effd640 1 --2- 172.21.15.123:0/2977591722 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f023c06c2b0 0x7f023c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:48.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.863+0000 7f024effd640 1 --2- 172.21.15.123:0/2977591722 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f023c06c2b0 0x7f023c06e770 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f0240033000 tx=0x7f0240008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:48.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:48.866+0000 7f02377fe640 1 -- 172.21.15.123:0/2977591722 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f024408e030 con 0x7f02500cc850 2024-09-15T23:22:49.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.066+0000 7f0255627640 1 -- 172.21.15.123:0/2977591722 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f02500ca0c0 con 0x7f02500cc850 2024-09-15T23:22:49.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.067+0000 7f02377fe640 1 -- 172.21.15.123:0/2977591722 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) ==== 95+0+5259 (secure 0 0 0) 0x7f0244059440 con 0x7f02500cc850 2024-09-15T23:22:49.068 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:22:49.068 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":113,"btime":"2024-09-15T23:22:48:735356+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8452,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/1861304244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1861304244},{"type":"v1","addr":"172.21.15.188:6837","nonce":1861304244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":10056,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/2869473990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2869473990},{"type":"v1","addr":"172.21.15.123:6833","nonce":2869473990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":113,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:22:25.896547+0000","modified":"2024-09-15T23:22:48.735339+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10074},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10062":{"gid":10062,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6835/3239002092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3239002092},{"type":"v1","addr":"172.21.15.123:6835","nonce":3239002092}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_10074":{"gid":10074,"name":"d","rank":0,"incarnation":108,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6836/2164993019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2164993019},{"type":"v1","addr":"172.21.15.188:6836","nonce":2164993019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10074,"qdb_cluster":[10074]},"id":12}]} 2024-09-15T23:22:49.069 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 113 2024-09-15T23:22:49.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.068+0000 7f0255627640 1 -- 172.21.15.123:0/2977591722 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f023c06c2b0 msgr2=0x7f023c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:49.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.068+0000 7f0255627640 1 --2- 172.21.15.123:0/2977591722 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f023c06c2b0 0x7f023c06e770 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f0240033000 tx=0x7f0240008030 comp rx=0 tx=0).stop 2024-09-15T23:22:49.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.068+0000 7f0255627640 1 -- 172.21.15.123:0/2977591722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02500cc850 msgr2=0x7f02500b3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:49.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.068+0000 7f0255627640 1 --2- 172.21.15.123:0/2977591722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02500cc850 0x7f02500b3570 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7f02440073a0 tx=0x7f0244007860 comp rx=0 tx=0).stop 2024-09-15T23:22:49.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.068+0000 7f0255627640 1 -- 172.21.15.123:0/2977591722 shutdown_connections 2024-09-15T23:22:49.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.069+0000 7f0255627640 1 --2- 172.21.15.123:0/2977591722 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f02500b3ab0 0x7f0250156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.069+0000 7f0255627640 1 --2- 172.21.15.123:0/2977591722 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f023c06c2b0 0x7f023c06e770 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.069+0000 7f0255627640 1 --2- 172.21.15.123:0/2977591722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02500cc850 0x7f02500b3570 unknown :-1 s=CLOSED pgs=2123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.069+0000 7f0255627640 1 --2- 172.21.15.123:0/2977591722 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f02380039e0 0x7f02500cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.069+0000 7f0255627640 1 -- 172.21.15.123:0/2977591722 >> 172.21.15.123:0/2977591722 conn(0x7f02500ccec0 msgr2=0x7f02500b4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:49.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.069+0000 7f0255627640 1 -- 172.21.15.123:0/2977591722 shutdown_connections 2024-09-15T23:22:49.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.069+0000 7f0255627640 1 -- 172.21.15.123:0/2977591722 wait complete. 2024-09-15T23:22:49.483 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 113, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-15T23:22:25.896547+0000', 'modified': '2024-09-15T23:22:48.735339+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10074}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10062': {'gid': 10062, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.123:6835/3239002092', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6834', 'nonce': 3239002092}, {'type': 'v1', 'addr': '172.21.15.123:6835', 'nonce': 3239002092}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_10074': {'gid': 10074, 'name': 'd', 'rank': 0, 'incarnation': 108, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.188:6836/2164993019', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.188:6834', 'nonce': 2164993019}, {'type': 'v1', 'addr': '172.21.15.188:6836', 'nonce': 2164993019}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [25], 'metadata_pool': 24, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 10074, 'qdb_cluster': [10074]} 2024-09-15T23:22:49.484 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:22:49.484 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-15T23:22:49.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.585+0000 7f06f6665640 1 Processor -- start 2024-09-15T23:22:49.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.585+0000 7f06f6665640 1 -- start start 2024-09-15T23:22:49.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.585+0000 7f06f6665640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f06f015ed20 0x7f06f00b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.585+0000 7f06f6665640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f06f00b90e0 0x7f06f00b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.585+0000 7f06f6665640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06f00d0e70 con 0x7f06f00d23b0 2024-09-15T23:22:49.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.585+0000 7f06f6665640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f06f00d41c0 con 0x7f06f00b90e0 2024-09-15T23:22:49.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.585+0000 7f06f6665640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f06f00d35b0 con 0x7f06f015ed20 2024-09-15T23:22:49.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.586+0000 7f06f4c02640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f06f00b90e0 0x7f06f00b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.586+0000 7f06effff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f06f015ed20 0x7f06f00b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.586+0000 7f06ef7fe640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f06f00d23b0 0x7f06f00cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:36732/0 (socket says 172.21.15.123:36732) 2024-09-15T23:22:49.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.586+0000 7f06ef7fe640 1 -- 172.21.15.123:0/268161740 learned_addr learned my addr 172.21.15.123:0/268161740 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:49.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.586+0000 7f06f4c02640 1 --2- 172.21.15.123:0/268161740 >> v2:172.21.15.123:3300/0 conn(0x7f06f00b90e0 0x7f06f00b67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59094/0 (socket says 172.21.15.123:59094) 2024-09-15T23:22:49.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.586+0000 7f06f4c02640 1 -- 172.21.15.123:0/268161740 >> v2:172.21.15.188:3300/0 conn(0x7f06f015ed20 msgr2=0x7f06f00b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:49.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.586+0000 7f06f4c02640 1 --2- 172.21.15.123:0/268161740 >> v2:172.21.15.188:3300/0 conn(0x7f06f015ed20 0x7f06f00b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.586+0000 7f06f4c02640 1 -- 172.21.15.123:0/268161740 >> v1:172.21.15.188:6789/0 conn(0x7f06f00d23b0 legacy=0x7f06f00cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:49.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.586+0000 7f06f4c02640 1 -- 172.21.15.123:0/268161740 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f00d3890 con 0x7f06f00b90e0 2024-09-15T23:22:49.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.587+0000 7f06f4c02640 1 --2- 172.21.15.123:0/268161740 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06f00b90e0 0x7f06f00b67a0 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7f06f00d47b0 tx=0x7f06e802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5722a003e81e17d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:49.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.587+0000 7f06eeffd640 1 -- 172.21.15.123:0/268161740 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e8007740 con 0x7f06f00b90e0 2024-09-15T23:22:49.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.587+0000 7f06eeffd640 1 -- 172.21.15.123:0/268161740 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e80078e0 con 0x7f06f00b90e0 2024-09-15T23:22:49.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.587+0000 7f06eeffd640 1 -- 172.21.15.123:0/268161740 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e8007cb0 con 0x7f06f00b90e0 2024-09-15T23:22:49.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.587+0000 7f06f6665640 1 -- 172.21.15.123:0/268161740 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06f00b90e0 msgr2=0x7f06f00b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:49.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.587+0000 7f06f6665640 1 --2- 172.21.15.123:0/268161740 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06f00b90e0 0x7f06f00b67a0 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7f06f00d47b0 tx=0x7f06e802a5f0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.587+0000 7f06f6665640 1 -- 172.21.15.123:0/268161740 shutdown_connections 2024-09-15T23:22:49.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.587+0000 7f06f6665640 1 --2- 172.21.15.123:0/268161740 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06f00b90e0 0x7f06f00b67a0 unknown :-1 s=CLOSED pgs=2124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.587+0000 7f06f6665640 1 --2- 172.21.15.123:0/268161740 >> v2:172.21.15.188:3300/0 conn(0x7f06f015ed20 0x7f06f00b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.587+0000 7f06f6665640 1 -- 172.21.15.123:0/268161740 >> 172.21.15.123:0/268161740 conn(0x7f06f00d1260 msgr2=0x7f06f00d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:49.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.588+0000 7f06f6665640 1 -- 172.21.15.123:0/268161740 shutdown_connections 2024-09-15T23:22:49.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.588+0000 7f06f6665640 1 -- 172.21.15.123:0/268161740 wait complete. 2024-09-15T23:22:49.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.589+0000 7f06f6665640 1 Processor -- start 2024-09-15T23:22:49.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.589+0000 7f06f6665640 1 -- start start 2024-09-15T23:22:49.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.590+0000 7f06f6665640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f06f00b90e0 0x7f06f01f4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.590+0000 7f06f6665640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06f00d23b0 0x7f06f0156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.590+0000 7f06f6665640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06f015ed20 0x7f06f01572b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.590+0000 7f06f6665640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f06f00d32a0 con 0x7f06f015ed20 2024-09-15T23:22:49.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.590+0000 7f06f6665640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f06f00d3e50 con 0x7f06f00b90e0 2024-09-15T23:22:49.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.590+0000 7f06f6665640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f06f015f100 con 0x7f06f00d23b0 2024-09-15T23:22:49.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.590+0000 7f06f4c02640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06f015ed20 0x7f06f01572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.590+0000 7f06f4c02640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06f015ed20 0x7f06f01572b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59104/0 (socket says 172.21.15.123:59104) 2024-09-15T23:22:49.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.590+0000 7f06f4c02640 1 -- 172.21.15.123:0/424075222 learned_addr learned my addr 172.21.15.123:0/424075222 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:49.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.590+0000 7f06effff640 1 --2- 172.21.15.123:0/424075222 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f06f00b90e0 0x7f06f01f4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.590+0000 7f06ef7fe640 1 --2- 172.21.15.123:0/424075222 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06f00d23b0 0x7f06f0156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.590+0000 7f06f4c02640 1 -- 172.21.15.123:0/424075222 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06f00d23b0 msgr2=0x7f06f0156d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:49.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.590+0000 7f06f4c02640 1 --2- 172.21.15.123:0/424075222 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06f00d23b0 0x7f06f0156d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.590+0000 7f06f4c02640 1 -- 172.21.15.123:0/424075222 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f06f00b90e0 msgr2=0x7f06f01f4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:49.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.590+0000 7f06f4c02640 1 --2- 172.21.15.123:0/424075222 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f06f00b90e0 0x7f06f01f4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.590+0000 7f06f4c02640 1 -- 172.21.15.123:0/424075222 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f01577f0 con 0x7f06f015ed20 2024-09-15T23:22:49.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.590+0000 7f06f4c02640 1 --2- 172.21.15.123:0/424075222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06f015ed20 0x7f06f01572b0 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7f06e802abe0 tx=0x7f06e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:49.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.590+0000 7f06ecff9640 1 -- 172.21.15.123:0/424075222 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e8040070 con 0x7f06f015ed20 2024-09-15T23:22:49.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.590+0000 7f06ecff9640 1 -- 172.21.15.123:0/424075222 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e8031bc0 con 0x7f06f015ed20 2024-09-15T23:22:49.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.590+0000 7f06f6665640 1 -- 172.21.15.123:0/424075222 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06f0157a60 con 0x7f06f015ed20 2024-09-15T23:22:49.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.590+0000 7f06ecff9640 1 -- 172.21.15.123:0/424075222 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e8009450 con 0x7f06f015ed20 2024-09-15T23:22:49.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.590+0000 7f06f6665640 1 -- 172.21.15.123:0/424075222 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06f0158020 con 0x7f06f015ed20 2024-09-15T23:22:49.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.592+0000 7f06ecff9640 1 -- 172.21.15.123:0/424075222 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f06e8039040 con 0x7f06f015ed20 2024-09-15T23:22:49.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.592+0000 7f06ecff9640 1 --2- 172.21.15.123:0/424075222 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f06dc06c2b0 0x7f06dc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.593+0000 7f06ecff9640 1 -- 172.21.15.123:0/424075222 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f06e80accb0 con 0x7f06f015ed20 2024-09-15T23:22:49.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.593+0000 7f06effff640 1 --2- 172.21.15.123:0/424075222 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f06dc06c2b0 0x7f06dc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.593+0000 7f06effff640 1 --2- 172.21.15.123:0/424075222 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f06dc06c2b0 0x7f06dc06e770 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f06f015c100 tx=0x7f06e0009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:49.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.593+0000 7f06f9404740 1 Processor -- start 2024-09-15T23:22:49.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.593+0000 7f06f9404740 1 -- start start 2024-09-15T23:22:49.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.594+0000 7f06f9404740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e13a0d72c0 0x55e13a11ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.594+0000 7f06f9404740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e13a0d4a80 0x55e13a0d76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.594+0000 7f06f9404740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e13a0d8a50 0x55e13a0d18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.594+0000 7f06f9404740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55e13a039520 con 0x55e13a0d8a50 2024-09-15T23:22:49.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.594+0000 7f06f9404740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55e139fe13e0 con 0x55e13a0d4a80 2024-09-15T23:22:49.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.594+0000 7f06f9404740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55e13a0354e0 con 0x55e13a0d72c0 2024-09-15T23:22:49.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.594+0000 7f06f4c02640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e13a0d8a50 0x55e13a0d18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.594+0000 7f06f4c02640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e13a0d8a50 0x55e13a0d18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59120/0 (socket says 172.21.15.123:59120) 2024-09-15T23:22:49.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.594+0000 7f06f4c02640 1 -- 172.21.15.123:0/767638652 learned_addr learned my addr 172.21.15.123:0/767638652 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:49.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.594+0000 7f06effff640 1 --2- 172.21.15.123:0/767638652 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e13a0d72c0 0x55e13a11ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.594+0000 7f06ef7fe640 1 --2- 172.21.15.123:0/767638652 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e13a0d4a80 0x55e13a0d76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.594+0000 7f06f4c02640 1 -- 172.21.15.123:0/767638652 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e13a0d72c0 msgr2=0x55e13a11ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:49.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.594+0000 7f06f4c02640 1 --2- 172.21.15.123:0/767638652 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e13a0d72c0 0x55e13a11ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.594+0000 7f06f4c02640 1 -- 172.21.15.123:0/767638652 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e13a0d4a80 msgr2=0x55e13a0d76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:49.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.594+0000 7f06f4c02640 1 --2- 172.21.15.123:0/767638652 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e13a0d4a80 0x55e13a0d76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.594+0000 7f06f4c02640 1 -- 172.21.15.123:0/767638652 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e139ffc2f0 con 0x55e13a0d8a50 2024-09-15T23:22:49.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.594+0000 7f06ef7fe640 1 --2- 172.21.15.123:0/767638652 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e13a0d4a80 0x55e13a0d76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:49.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.595+0000 7f06f4c02640 1 --2- 172.21.15.123:0/767638652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e13a0d8a50 0x55e13a0d18b0 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7f06e8077190 tx=0x7f06e8031f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b36c7dc063ea7d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:49.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.595+0000 7f06d5ffb640 1 -- 172.21.15.123:0/767638652 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e80a9070 con 0x55e13a0d8a50 2024-09-15T23:22:49.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.595+0000 7f06d5ffb640 1 -- 172.21.15.123:0/767638652 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e8007840 con 0x55e13a0d8a50 2024-09-15T23:22:49.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.595+0000 7f06d5ffb640 1 -- 172.21.15.123:0/767638652 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e80773a0 con 0x55e13a0d8a50 2024-09-15T23:22:49.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.595+0000 7f06f9404740 1 -- 172.21.15.123:0/767638652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e13a0d8a50 msgr2=0x55e13a0d18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:49.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.595+0000 7f06f9404740 1 --2- 172.21.15.123:0/767638652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e13a0d8a50 0x55e13a0d18b0 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7f06e8077190 tx=0x7f06e8031f90 comp rx=0 tx=0).stop 2024-09-15T23:22:49.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.595+0000 7f06f9404740 1 -- 172.21.15.123:0/767638652 shutdown_connections 2024-09-15T23:22:49.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.595+0000 7f06f9404740 1 --2- 172.21.15.123:0/767638652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e13a0d8a50 0x55e13a0d18b0 unknown :-1 s=CLOSED pgs=2126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.595+0000 7f06f9404740 1 --2- 172.21.15.123:0/767638652 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e13a0d4a80 0x55e13a0d76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.595+0000 7f06f9404740 1 --2- 172.21.15.123:0/767638652 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e13a0d72c0 0x55e13a11ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.595+0000 7f06f9404740 1 -- 172.21.15.123:0/767638652 >> 172.21.15.123:0/767638652 conn(0x55e13a0d3a80 msgr2=0x55e13a11bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:49.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.595+0000 7f06f9404740 1 -- 172.21.15.123:0/767638652 shutdown_connections 2024-09-15T23:22:49.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.595+0000 7f06f9404740 1 -- 172.21.15.123:0/767638652 wait complete. 2024-09-15T23:22:49.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.596+0000 7f06f9404740 1 -- start start 2024-09-15T23:22:49.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.596+0000 7f06f9404740 1 Processor -- start 2024-09-15T23:22:49.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.597+0000 7f06f9404740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e13a0d72c0 0x55e13a117740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.597+0000 7f06f9404740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e13a0d8a50 0x55e13a116790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.597+0000 7f06f9404740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e13a0fc790 0x55e13a118c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.597+0000 7f06f9404740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55e13a039520 con 0x55e13a0d8a50 2024-09-15T23:22:49.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.597+0000 7f06f9404740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55e139fc2450 con 0x55e13a0fc790 2024-09-15T23:22:49.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.597+0000 7f06f9404740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55e13a0d2f20 con 0x55e13a0d72c0 2024-09-15T23:22:49.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.597+0000 7f06f9404740 10 client.0 _ll_register_callbacks cb 0x55e139d4bac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:22:49.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.597+0000 7f06ef7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e13a0d8a50 0x55e13a116790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.597+0000 7f06ef7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e13a0d8a50 0x55e13a116790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59128/0 (socket says 172.21.15.123:59128) 2024-09-15T23:22:49.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.597+0000 7f06ef7fe640 1 -- 172.21.15.123:0/2567948883 learned_addr learned my addr 172.21.15.123:0/2567948883 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:49.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.597+0000 7f06f4c02640 1 --2- 172.21.15.123:0/2567948883 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e13a0fc790 0x55e13a118c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.597+0000 7f06effff640 1 --2- 172.21.15.123:0/2567948883 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e13a0d72c0 0x55e13a117740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.597+0000 7f06ef7fe640 1 -- 172.21.15.123:0/2567948883 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e13a0d72c0 msgr2=0x55e13a117740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:49.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.597+0000 7f06ef7fe640 1 --2- 172.21.15.123:0/2567948883 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e13a0d72c0 0x55e13a117740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.597+0000 7f06ef7fe640 1 -- 172.21.15.123:0/2567948883 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e13a0fc790 msgr2=0x55e13a118c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:49.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.597+0000 7f06ef7fe640 1 --2- 172.21.15.123:0/2567948883 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e13a0fc790 0x55e13a118c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.597+0000 7f06ef7fe640 1 -- 172.21.15.123:0/2567948883 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e139d4c2d0 con 0x55e13a0d8a50 2024-09-15T23:22:49.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.597+0000 7f06ef7fe640 1 --2- 172.21.15.123:0/2567948883 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e13a0d8a50 0x55e13a116790 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7f06e40076b0 tx=0x7f06e4001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e4aa32f1315f1f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:49.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.597+0000 7f06ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:22:49.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.598+0000 7f06ceffd640 1 -- 172.21.15.123:0/2567948883 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e4001ce0 con 0x55e13a0d8a50 2024-09-15T23:22:49.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.598+0000 7f06ceffd640 1 -- 172.21.15.123:0/2567948883 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f06e400c780 con 0x55e13a0d8a50 2024-09-15T23:22:49.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.598+0000 7f06f9404740 1 -- 172.21.15.123:0/2567948883 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06e8007840 con 0x55e13a0d8a50 2024-09-15T23:22:49.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.598+0000 7f06ceffd640 1 -- 172.21.15.123:0/2567948883 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) ==== 24+0+0 (secure 0 0 0) 0x7f06e400c980 con 0x55e13a0d8a50 2024-09-15T23:22:49.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.598+0000 7f06f9404740 10 client.10266 fetch_fsmap learned FSMap version 113 2024-09-15T23:22:49.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.598+0000 7f06f9404740 1 -- 172.21.15.123:0/2567948883 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) -- 0x55e139e166b0 con 0x55e13a0d8a50 2024-09-15T23:22:49.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.598+0000 7f06ceffd640 1 -- 172.21.15.123:0/2567948883 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e8007840 con 0x55e13a0d8a50 2024-09-15T23:22:49.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.598+0000 7f06ceffd640 1 -- 172.21.15.123:0/2567948883 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 113) ==== 3490+0+0 (secure 0 0 0) 0x7f06e400cb20 con 0x55e13a0d8a50 2024-09-15T23:22:49.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.598+0000 7f06f9404740 10 client.10266 fetch_fsmap finished waiting for FSMap version 113 2024-09-15T23:22:49.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.598+0000 7f06f9404740 10 client.10266 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-15T23:22:49.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.598+0000 7f06f9404740 20 client.10266 populate_metadata read hostname 'smithi123' 2024-09-15T23:22:49.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.598+0000 7f06f9404740 1 --2- 172.21.15.123:0/2567948883 >> [v2:172.21.15.188:6834/2164993019,v1:172.21.15.188:6836/2164993019] conn(0x55e13a12f570 0x55e13a12f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.598+0000 7f06f9404740 4 client.10266 mds_command: new command op to 10074 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:22:49.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.598+0000 7f06f9404740 1 -- 172.21.15.123:0/2567948883 --> [v2:172.21.15.188:6834/2164993019,v1:172.21.15.188:6836/2164993019] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e13a046c50 con 0x55e13a12f570 2024-09-15T23:22:49.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.598+0000 7f06effff640 1 --2- 172.21.15.123:0/2567948883 >> [v2:172.21.15.188:6834/2164993019,v1:172.21.15.188:6836/2164993019] conn(0x55e13a12f570 0x55e13a12f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.599+0000 7f06effff640 1 --2- 172.21.15.123:0/2567948883 >> [v2:172.21.15.188:6834/2164993019,v1:172.21.15.188:6836/2164993019] conn(0x55e13a12f570 0x55e13a12f950 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73d5c36fdece8d70 server_cookie=82538176676874d in_seq=0 out_seq=0 2024-09-15T23:22:49.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.599+0000 7f06ceffd640 10 client.10266 ms_handle_connect on v2:172.21.15.188:6834/2164993019 2024-09-15T23:22:49.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.599+0000 7f06ceffd640 1 -- 172.21.15.123:0/2567948883 <== mds.0 v2:172.21.15.188:6834/2164993019 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e13a046c50 con 0x55e13a12f570 2024-09-15T23:22:49.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.599+0000 7f06ceffd640 10 client.10266 handle_command_reply: tid=0 2024-09-15T23:22:49.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.599+0000 7f06f9404740 1 client.10266 shutdown 2024-09-15T23:22:49.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.599+0000 7f06f9404740 1 -- 172.21.15.123:0/2567948883 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e13a0d8a50 msgr2=0x55e13a116790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:49.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.600+0000 7f06f9404740 1 --2- 172.21.15.123:0/2567948883 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e13a0d8a50 0x55e13a116790 secure :-1 s=READY pgs=2127 cs=0 l=1 rev1=1 crypto rx=0x7f06e40076b0 tx=0x7f06e4001630 comp rx=0 tx=0).stop 2024-09-15T23:22:49.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.600+0000 7f06f9404740 1 -- 172.21.15.123:0/2567948883 shutdown_connections 2024-09-15T23:22:49.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.600+0000 7f06f9404740 1 --2- 172.21.15.123:0/2567948883 >> [v2:172.21.15.188:6834/2164993019,v1:172.21.15.188:6836/2164993019] conn(0x55e13a12f570 0x55e13a12f950 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.600+0000 7f06f9404740 1 --2- 172.21.15.123:0/2567948883 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e13a0fc790 0x55e13a118c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.600+0000 7f06f9404740 1 --2- 172.21.15.123:0/2567948883 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e13a0d8a50 0x55e13a116790 unknown :-1 s=CLOSED pgs=2127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.600+0000 7f06ceffd640 0 client.10266 ms_handle_reset on v2:172.21.15.188:6834/2164993019 2024-09-15T23:22:49.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.600+0000 7f06f9404740 1 --2- 172.21.15.123:0/2567948883 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e13a0d72c0 0x55e13a117740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.600+0000 7f06f9404740 1 -- 172.21.15.123:0/2567948883 >> 172.21.15.123:0/2567948883 conn(0x55e13a0d4a80 msgr2=0x55e13a119fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:49.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.600+0000 7f06f9404740 1 -- 172.21.15.123:0/2567948883 shutdown_connections 2024-09-15T23:22:49.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.600+0000 7f06f9404740 1 -- 172.21.15.123:0/2567948883 wait complete. 2024-09-15T23:22:49.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.600+0000 7f06f9404740 20 client.10266 trim_cache size 0 max 16384 2024-09-15T23:22:49.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.617+0000 7f06f9404740 1 Processor -- start 2024-09-15T23:22:49.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.617+0000 7f06f9404740 1 -- start start 2024-09-15T23:22:49.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.618+0000 7f06f9404740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e13a0d72c0 0x55e13a0d3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.618+0000 7f06f9404740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e13a0d8a50 0x55e13a140180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.618+0000 7f06f9404740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e13a0fc790 0x55e13a101a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.618+0000 7f06f9404740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f06f0200cb0 con 0x55e13a0d8a50 2024-09-15T23:22:49.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.618+0000 7f06f9404740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f06f00cc9f0 con 0x55e13a0fc790 2024-09-15T23:22:49.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.618+0000 7f06f9404740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f06f01ff710 con 0x55e13a0d72c0 2024-09-15T23:22:49.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.618+0000 7f06ef7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e13a0d8a50 0x55e13a140180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.618+0000 7f06ef7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e13a0d8a50 0x55e13a140180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59130/0 (socket says 172.21.15.123:59130) 2024-09-15T23:22:49.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.618+0000 7f06ef7fe640 1 -- 172.21.15.123:0/1162038140 learned_addr learned my addr 172.21.15.123:0/1162038140 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:49.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.618+0000 7f06effff640 1 --2- 172.21.15.123:0/1162038140 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e13a0d72c0 0x55e13a0d3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.618+0000 7f06f4c02640 1 --2- 172.21.15.123:0/1162038140 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e13a0fc790 0x55e13a101a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.619+0000 7f06ef7fe640 1 -- 172.21.15.123:0/1162038140 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e13a0d72c0 msgr2=0x55e13a0d3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:49.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.619+0000 7f06ef7fe640 1 --2- 172.21.15.123:0/1162038140 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e13a0d72c0 0x55e13a0d3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.619+0000 7f06ef7fe640 1 -- 172.21.15.123:0/1162038140 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e13a0fc790 msgr2=0x55e13a101a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:49.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.619+0000 7f06ef7fe640 1 --2- 172.21.15.123:0/1162038140 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e13a0fc790 0x55e13a101a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.619+0000 7f06ef7fe640 1 -- 172.21.15.123:0/1162038140 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e13a0cd8b0 con 0x55e13a0d8a50 2024-09-15T23:22:49.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.619+0000 7f06f4c02640 1 --2- 172.21.15.123:0/1162038140 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e13a0fc790 0x55e13a101a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:22:49.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.619+0000 7f06ef7fe640 1 --2- 172.21.15.123:0/1162038140 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e13a0d8a50 0x55e13a140180 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7f06e400cd30 tx=0x7f06e400f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74f1a86377075776 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:49.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.619+0000 7f06d57fa640 1 -- 172.21.15.123:0/1162038140 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e4001d30 con 0x55e13a0d8a50 2024-09-15T23:22:49.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.619+0000 7f06d57fa640 1 -- 172.21.15.123:0/1162038140 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e401a070 con 0x55e13a0d8a50 2024-09-15T23:22:49.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.619+0000 7f06d57fa640 1 -- 172.21.15.123:0/1162038140 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e400c4e0 con 0x55e13a0d8a50 2024-09-15T23:22:49.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.619+0000 7f06f9404740 1 -- 172.21.15.123:0/1162038140 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e13a0d8a50 msgr2=0x55e13a140180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:49.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.619+0000 7f06f9404740 1 --2- 172.21.15.123:0/1162038140 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e13a0d8a50 0x55e13a140180 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7f06e400cd30 tx=0x7f06e400f000 comp rx=0 tx=0).stop 2024-09-15T23:22:49.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.619+0000 7f06f9404740 1 -- 172.21.15.123:0/1162038140 shutdown_connections 2024-09-15T23:22:49.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.619+0000 7f06f9404740 1 --2- 172.21.15.123:0/1162038140 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e13a0fc790 0x55e13a101a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.619+0000 7f06f9404740 1 --2- 172.21.15.123:0/1162038140 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e13a0d8a50 0x55e13a140180 unknown :-1 s=CLOSED pgs=2128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.619+0000 7f06f9404740 1 --2- 172.21.15.123:0/1162038140 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e13a0d72c0 0x55e13a0d3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.619+0000 7f06f9404740 1 -- 172.21.15.123:0/1162038140 >> 172.21.15.123:0/1162038140 conn(0x55e13a0d4a80 msgr2=0x55e13a135cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:49.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.619+0000 7f06f9404740 1 -- 172.21.15.123:0/1162038140 shutdown_connections 2024-09-15T23:22:49.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.619+0000 7f06f9404740 1 -- 172.21.15.123:0/1162038140 wait complete. 2024-09-15T23:22:49.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.620+0000 7f06f9404740 1 -- start start 2024-09-15T23:22:49.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.620+0000 7f06f9404740 1 Processor -- start 2024-09-15T23:22:49.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.621+0000 7f06f9404740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e13a0d72c0 0x55e13a11f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.621+0000 7f06f9404740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e13a0d8a50 0x55e13a118470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.621+0000 7f06f9404740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e13a0fc790 0x55e13a1189b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.621+0000 7f06f9404740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55e13a12bfe0 con 0x55e13a0d72c0 2024-09-15T23:22:49.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.621+0000 7f06f9404740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55e13a0ffb20 con 0x55e13a0d8a50 2024-09-15T23:22:49.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.621+0000 7f06f9404740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55e13a100230 con 0x55e13a0fc790 2024-09-15T23:22:49.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.621+0000 7f06f9404740 10 client.0 _ll_register_callbacks cb 0x7f06e4004840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:22:49.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.621+0000 7f06effff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e13a0d72c0 0x55e13a11f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.621+0000 7f06effff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e13a0d72c0 0x55e13a11f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59144/0 (socket says 172.21.15.123:59144) 2024-09-15T23:22:49.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.621+0000 7f06effff640 1 -- 172.21.15.123:0/4055264901 learned_addr learned my addr 172.21.15.123:0/4055264901 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:49.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.621+0000 7f06ef7fe640 1 --2- 172.21.15.123:0/4055264901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e13a0d8a50 0x55e13a118470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.621+0000 7f06f4c02640 1 --2- 172.21.15.123:0/4055264901 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e13a0fc790 0x55e13a1189b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.621+0000 7f06effff640 1 -- 172.21.15.123:0/4055264901 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e13a0fc790 msgr2=0x55e13a1189b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:49.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.621+0000 7f06effff640 1 --2- 172.21.15.123:0/4055264901 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e13a0fc790 0x55e13a1189b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.621+0000 7f06effff640 1 -- 172.21.15.123:0/4055264901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e13a0d8a50 msgr2=0x55e13a118470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:49.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.621+0000 7f06effff640 1 --2- 172.21.15.123:0/4055264901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e13a0d8a50 0x55e13a118470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.621+0000 7f06effff640 1 -- 172.21.15.123:0/4055264901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e13a12ebc0 con 0x55e13a0d72c0 2024-09-15T23:22:49.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.621+0000 7f06ef7fe640 1 --2- 172.21.15.123:0/4055264901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e13a0d8a50 0x55e13a118470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:49.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.621+0000 7f06effff640 1 --2- 172.21.15.123:0/4055264901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e13a0d72c0 0x55e13a11f7b0 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7f06e0009fd0 tx=0x7f06e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb7c292fbafb4bf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:49.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.621+0000 7f06ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:22:49.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.621+0000 7f06ceffd640 1 -- 172.21.15.123:0/4055264901 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e002f030 con 0x55e13a0d72c0 2024-09-15T23:22:49.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.621+0000 7f06ceffd640 1 -- 172.21.15.123:0/4055264901 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f06e000f040 con 0x55e13a0d72c0 2024-09-15T23:22:49.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.621+0000 7f06f9404740 1 -- 172.21.15.123:0/4055264901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06e401a070 con 0x55e13a0d72c0 2024-09-15T23:22:49.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.622+0000 7f06ceffd640 1 -- 172.21.15.123:0/4055264901 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) ==== 24+0+0 (secure 0 0 0) 0x7f06e0003cf0 con 0x55e13a0d72c0 2024-09-15T23:22:49.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.622+0000 7f06f9404740 10 client.10272 fetch_fsmap learned FSMap version 113 2024-09-15T23:22:49.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.622+0000 7f06f9404740 1 -- 172.21.15.123:0/4055264901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) -- 0x55e13a11bed0 con 0x55e13a0d72c0 2024-09-15T23:22:49.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.622+0000 7f06ceffd640 1 -- 172.21.15.123:0/4055264901 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06e401a070 con 0x55e13a0d72c0 2024-09-15T23:22:49.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.622+0000 7f06ceffd640 1 -- 172.21.15.123:0/4055264901 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 113) ==== 3490+0+0 (secure 0 0 0) 0x7f06e0020040 con 0x55e13a0d72c0 2024-09-15T23:22:49.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.622+0000 7f06f9404740 10 client.10272 fetch_fsmap finished waiting for FSMap version 113 2024-09-15T23:22:49.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.622+0000 7f06f9404740 10 client.10272 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-15T23:22:49.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.622+0000 7f06f9404740 20 client.10272 populate_metadata read hostname 'smithi123' 2024-09-15T23:22:49.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.622+0000 7f06f9404740 1 --2- 172.21.15.123:0/4055264901 >> [v2:172.21.15.188:6834/2164993019,v1:172.21.15.188:6836/2164993019] conn(0x55e13a199bc0 0x55e13a199fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.622+0000 7f06f9404740 4 client.10272 mds_command: new command op to 10074 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:22:49.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.622+0000 7f06f9404740 1 -- 172.21.15.123:0/4055264901 --> [v2:172.21.15.188:6834/2164993019,v1:172.21.15.188:6836/2164993019] -- command(tid 0: {"prefix": "status"}) -- 0x55e13a040fa0 con 0x55e13a199bc0 2024-09-15T23:22:49.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.622+0000 7f06ef7fe640 1 --2- 172.21.15.123:0/4055264901 >> [v2:172.21.15.188:6834/2164993019,v1:172.21.15.188:6836/2164993019] conn(0x55e13a199bc0 0x55e13a199fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.623+0000 7f06ef7fe640 1 --2- 172.21.15.123:0/4055264901 >> [v2:172.21.15.188:6834/2164993019,v1:172.21.15.188:6836/2164993019] conn(0x55e13a199bc0 0x55e13a199fa0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3743542b6d89530f server_cookie=deee93e286a75dc8 in_seq=0 out_seq=0 2024-09-15T23:22:49.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.623+0000 7f06ceffd640 10 client.10272 ms_handle_connect on v2:172.21.15.188:6834/2164993019 2024-09-15T23:22:49.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.623+0000 7f06ceffd640 1 -- 172.21.15.123:0/4055264901 <== mds.0 v2:172.21.15.188:6834/2164993019 1 ==== command_reply(tid 0: 0 ) ==== 8+0+335 (crc 0 0 0) 0x55e13a040fa0 con 0x55e13a199bc0 2024-09-15T23:22:49.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.623+0000 7f06ceffd640 10 client.10272 handle_command_reply: tid=0 2024-09-15T23:22:49.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.623+0000 7f06f9404740 1 client.10272 shutdown 2024-09-15T23:22:49.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.623+0000 7f06f9404740 1 -- 172.21.15.123:0/4055264901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e13a0d72c0 msgr2=0x55e13a11f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:49.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.623+0000 7f06f9404740 1 --2- 172.21.15.123:0/4055264901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e13a0d72c0 0x55e13a11f7b0 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7f06e0009fd0 tx=0x7f06e0004730 comp rx=0 tx=0).stop 2024-09-15T23:22:49.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.623+0000 7f06f9404740 1 -- 172.21.15.123:0/4055264901 shutdown_connections 2024-09-15T23:22:49.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.623+0000 7f06f9404740 1 --2- 172.21.15.123:0/4055264901 >> [v2:172.21.15.188:6834/2164993019,v1:172.21.15.188:6836/2164993019] conn(0x55e13a199bc0 0x55e13a199fa0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.623+0000 7f06f9404740 1 --2- 172.21.15.123:0/4055264901 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55e13a0fc790 0x55e13a1189b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.623+0000 7f06f9404740 1 --2- 172.21.15.123:0/4055264901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55e13a0d8a50 0x55e13a118470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.623+0000 7f06ceffd640 0 client.10272 ms_handle_reset on v2:172.21.15.188:6834/2164993019 2024-09-15T23:22:49.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.623+0000 7f06f9404740 1 --2- 172.21.15.123:0/4055264901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55e13a0d72c0 0x55e13a11f7b0 unknown :-1 s=CLOSED pgs=2129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.623+0000 7f06f9404740 1 -- 172.21.15.123:0/4055264901 >> 172.21.15.123:0/4055264901 conn(0x55e13a0d4a80 msgr2=0x55e13a135f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:49.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.623+0000 7f06f9404740 1 -- 172.21.15.123:0/4055264901 shutdown_connections 2024-09-15T23:22:49.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.623+0000 7f06f9404740 1 -- 172.21.15.123:0/4055264901 wait complete. 2024-09-15T23:22:49.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.623+0000 7f06f9404740 20 client.10272 trim_cache size 0 max 16384 2024-09-15T23:22:49.634 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:22:49.634 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "cb968ac4-8d3a-4b17-a673-6177aeaea589", 2024-09-15T23:22:49.634 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2024-09-15T23:22:49.634 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 10074, 2024-09-15T23:22:49.634 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-09-15T23:22:49.634 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-09-15T23:22:49.634 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-09-15T23:22:49.634 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 23.049624961999999, 2024-09-15T23:22:49.634 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 113, 2024-09-15T23:22:49.634 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 182, 2024-09-15T23:22:49.634 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 182, 2024-09-15T23:22:49.635 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 28.109536300999999 2024-09-15T23:22:49.635 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:22:49.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.624+0000 7f06f6665640 1 -- 172.21.15.123:0/424075222 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f06dc06c2b0 msgr2=0x7f06dc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:49.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.624+0000 7f06f6665640 1 --2- 172.21.15.123:0/424075222 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f06dc06c2b0 0x7f06dc06e770 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f06f015c100 tx=0x7f06e0009190 comp rx=0 tx=0).stop 2024-09-15T23:22:49.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.624+0000 7f06f6665640 1 -- 172.21.15.123:0/424075222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06f015ed20 msgr2=0x7f06f01572b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:49.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.624+0000 7f06f6665640 1 --2- 172.21.15.123:0/424075222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06f015ed20 0x7f06f01572b0 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7f06e802abe0 tx=0x7f06e8004a40 comp rx=0 tx=0).stop 2024-09-15T23:22:49.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.624+0000 7f06f6665640 1 -- 172.21.15.123:0/424075222 shutdown_connections 2024-09-15T23:22:49.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.624+0000 7f06f6665640 1 --2- 172.21.15.123:0/424075222 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f06dc06c2b0 0x7f06dc06e770 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.624+0000 7f06f6665640 1 --2- 172.21.15.123:0/424075222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06f015ed20 0x7f06f01572b0 unknown :-1 s=CLOSED pgs=2125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.624+0000 7f06f6665640 1 --2- 172.21.15.123:0/424075222 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f06f00d23b0 0x7f06f0156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.624+0000 7f06f6665640 1 --2- 172.21.15.123:0/424075222 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f06f00b90e0 0x7f06f01f4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.624+0000 7f06f6665640 1 -- 172.21.15.123:0/424075222 >> 172.21.15.123:0/424075222 conn(0x7f06f00d1260 msgr2=0x7f06f00cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:49.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.624+0000 7f06f6665640 1 -- 172.21.15.123:0/424075222 shutdown_connections 2024-09-15T23:22:49.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.624+0000 7f06f6665640 1 -- 172.21.15.123:0/424075222 wait complete. 2024-09-15T23:22:49.637 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c scrub start /scrub_control_test_path recursive 2024-09-15T23:22:49.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.740+0000 7fbfa0265640 1 Processor -- start 2024-09-15T23:22:49.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.741+0000 7fbfa0265640 1 -- start start 2024-09-15T23:22:49.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.742+0000 7fbfa0265640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fbf980d2cb0 0x7fbf980b5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.742+0000 7fbfa0265640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf98160a10 0x7fbf980d1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.742+0000 7fbfa0265640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf980b1d70 con 0x7fbf9815fa00 2024-09-15T23:22:49.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.742+0000 7fbfa0265640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fbf9815fde0 con 0x7fbf980d2cb0 2024-09-15T23:22:49.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.742+0000 7fbfa0265640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbf98071c80 con 0x7fbf98160a10 2024-09-15T23:22:49.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.742+0000 7fbf9e001640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fbf9815fa00 0x7fbf980d25a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:45260/0 (socket says 172.21.15.123:45260) 2024-09-15T23:22:49.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.742+0000 7fbf9e001640 1 -- 172.21.15.123:0/1916577919 learned_addr learned my addr 172.21.15.123:0/1916577919 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:49.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.742+0000 7fbf9d800640 1 --2- 172.21.15.123:0/1916577919 >> v2:172.21.15.188:3300/0 conn(0x7fbf980d2cb0 0x7fbf980b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.742+0000 7fbf9e802640 1 --2- 172.21.15.123:0/1916577919 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf98160a10 0x7fbf980d1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.742+0000 7fbf9cfff640 1 -- 172.21.15.123:0/1916577919 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1090680108 0 0) 0x7fbf94001110 con 0x7fbf9815fa00 2024-09-15T23:22:49.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.742+0000 7fbf9cfff640 1 -- 172.21.15.123:0/1916577919 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf84003520 con 0x7fbf9815fa00 2024-09-15T23:22:49.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.742+0000 7fbf9d800640 1 -- 172.21.15.123:0/1916577919 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf98160a10 msgr2=0x7fbf980d1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:49.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.742+0000 7fbf9d800640 1 --2- 172.21.15.123:0/1916577919 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf98160a10 0x7fbf980d1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.742+0000 7fbf9d800640 1 -- 172.21.15.123:0/1916577919 >> v1:172.21.15.123:6789/0 conn(0x7fbf9815fa00 legacy=0x7fbf980d25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:49.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.742+0000 7fbf9d800640 1 -- 172.21.15.123:0/1916577919 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf980716c0 con 0x7fbf980d2cb0 2024-09-15T23:22:49.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.743+0000 7fbf9d800640 1 --2- 172.21.15.123:0/1916577919 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf980d2cb0 0x7fbf980b5710 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c0097a0 tx=0x7fbf8c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11ad95c06fcf1eee server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:49.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.745+0000 7fbf9cfff640 1 -- 172.21.15.123:0/1916577919 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c037070 con 0x7fbf980d2cb0 2024-09-15T23:22:49.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.745+0000 7fbf9cfff640 1 -- 172.21.15.123:0/1916577919 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf8c032440 con 0x7fbf980d2cb0 2024-09-15T23:22:49.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.745+0000 7fbf9cfff640 1 -- 172.21.15.123:0/1916577919 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c0327f0 con 0x7fbf980d2cb0 2024-09-15T23:22:49.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.746+0000 7fbfa0265640 1 -- 172.21.15.123:0/1916577919 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf980d2cb0 msgr2=0x7fbf980b5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:49.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.746+0000 7fbfa0265640 1 --2- 172.21.15.123:0/1916577919 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf980d2cb0 0x7fbf980b5710 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c0097a0 tx=0x7fbf8c02a180 comp rx=0 tx=0).stop 2024-09-15T23:22:49.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.746+0000 7fbfa0265640 1 -- 172.21.15.123:0/1916577919 shutdown_connections 2024-09-15T23:22:49.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.746+0000 7fbfa0265640 1 --2- 172.21.15.123:0/1916577919 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf98160a10 0x7fbf980d1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.746+0000 7fbfa0265640 1 --2- 172.21.15.123:0/1916577919 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf980d2cb0 0x7fbf980b5710 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.746+0000 7fbfa0265640 1 -- 172.21.15.123:0/1916577919 >> 172.21.15.123:0/1916577919 conn(0x7fbf9806f3e0 msgr2=0x7fbf9806f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:49.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.746+0000 7fbfa0265640 1 -- 172.21.15.123:0/1916577919 shutdown_connections 2024-09-15T23:22:49.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.746+0000 7fbfa0265640 1 -- 172.21.15.123:0/1916577919 wait complete. 2024-09-15T23:22:49.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.747+0000 7fbfa0265640 1 Processor -- start 2024-09-15T23:22:49.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.747+0000 7fbfa0265640 1 -- start start 2024-09-15T23:22:49.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.748+0000 7fbfa0265640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf980d2cb0 0x7fbf98152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.748+0000 7fbfa0265640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf9815fa00 0x7fbf981566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.748+0000 7fbfa0265640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf98160a10 0x7fbf981402f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.748+0000 7fbfa0265640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbf980d0aa0 con 0x7fbf98160a10 2024-09-15T23:22:49.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.748+0000 7fbfa0265640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbf980d0580 con 0x7fbf9815fa00 2024-09-15T23:22:49.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.748+0000 7fbfa0265640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbf980d0c20 con 0x7fbf980d2cb0 2024-09-15T23:22:49.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.748+0000 7fbf9e802640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf98160a10 0x7fbf981402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.748+0000 7fbf9e802640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf98160a10 0x7fbf981402f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59158/0 (socket says 172.21.15.123:59158) 2024-09-15T23:22:49.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.748+0000 7fbf9e802640 1 -- 172.21.15.123:0/1045117264 learned_addr learned my addr 172.21.15.123:0/1045117264 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:49.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.748+0000 7fbf9e001640 1 --2- 172.21.15.123:0/1045117264 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf980d2cb0 0x7fbf98152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.748+0000 7fbf9d800640 1 --2- 172.21.15.123:0/1045117264 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf9815fa00 0x7fbf981566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.748+0000 7fbf9e802640 1 -- 172.21.15.123:0/1045117264 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf980d2cb0 msgr2=0x7fbf98152420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:49.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.748+0000 7fbf9e802640 1 --2- 172.21.15.123:0/1045117264 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbf980d2cb0 0x7fbf98152420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.748+0000 7fbf9e802640 1 -- 172.21.15.123:0/1045117264 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf9815fa00 msgr2=0x7fbf981566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:49.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.748+0000 7fbf9e802640 1 --2- 172.21.15.123:0/1045117264 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf9815fa00 0x7fbf981566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.748+0000 7fbf9e802640 1 -- 172.21.15.123:0/1045117264 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf98152b20 con 0x7fbf98160a10 2024-09-15T23:22:49.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.748+0000 7fbf9d800640 1 --2- 172.21.15.123:0/1045117264 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbf9815fa00 0x7fbf981566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:49.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.748+0000 7fbf9e802640 1 --2- 172.21.15.123:0/1045117264 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbf98160a10 0x7fbf981402f0 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7fbf90009d30 tx=0x7fbf9000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:49.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.748+0000 7fbf8a7fc640 1 -- 172.21.15.123:0/1045117264 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf90018020 con 0x7fbf98160a10 2024-09-15T23:22:49.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.749+0000 7fbf8a7fc640 1 -- 172.21.15.123:0/1045117264 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf90014480 con 0x7fbf98160a10 2024-09-15T23:22:49.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.749+0000 7fbfa0265640 1 -- 172.21.15.123:0/1045117264 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf98152e00 con 0x7fbf98160a10 2024-09-15T23:22:49.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.749+0000 7fbf8a7fc640 1 -- 172.21.15.123:0/1045117264 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf90014870 con 0x7fbf98160a10 2024-09-15T23:22:49.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.749+0000 7fbfa0265640 1 -- 172.21.15.123:0/1045117264 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf981533c0 con 0x7fbf98160a10 2024-09-15T23:22:49.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.750+0000 7fbf8a7fc640 1 -- 172.21.15.123:0/1045117264 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbf90005d10 con 0x7fbf98160a10 2024-09-15T23:22:49.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.751+0000 7fbf8a7fc640 1 --2- 172.21.15.123:0/1045117264 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbf7c06c2b0 0x7fbf7c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.751+0000 7fbf8a7fc640 1 -- 172.21.15.123:0/1045117264 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7fbf9008bec0 con 0x7fbf98160a10 2024-09-15T23:22:49.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.751+0000 7fbf9e001640 1 --2- 172.21.15.123:0/1045117264 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbf7c06c2b0 0x7fbf7c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.751+0000 7fbf9e001640 1 --2- 172.21.15.123:0/1045117264 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbf7c06c2b0 0x7fbf7c06e770 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fbf94005880 tx=0x7fbf94009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:49.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.752+0000 7fbfa3006740 1 Processor -- start 2024-09-15T23:22:49.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.752+0000 7fbfa3006740 1 -- start start 2024-09-15T23:22:49.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.752+0000 7fbfa3006740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5da37cb40 0x55f5da3c22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.752+0000 7fbfa3006740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f5da37a300 0x55f5da37cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.752+0000 7fbfa3006740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f5da37e2d0 0x55f5da377130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.752+0000 7fbfa3006740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55f5da33e8a0 con 0x55f5da37a300 2024-09-15T23:22:49.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.752+0000 7fbfa3006740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55f5da2df960 con 0x55f5da37cb40 2024-09-15T23:22:49.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.752+0000 7fbfa3006740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55f5da287650 con 0x55f5da37e2d0 2024-09-15T23:22:49.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.753+0000 7fbf9d800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f5da37a300 0x55f5da37cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.753+0000 7fbf9d800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f5da37a300 0x55f5da37cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59168/0 (socket says 172.21.15.123:59168) 2024-09-15T23:22:49.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.753+0000 7fbf9d800640 1 -- 172.21.15.123:0/3622592993 learned_addr learned my addr 172.21.15.123:0/3622592993 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:49.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.753+0000 7fbf9e001640 1 --2- 172.21.15.123:0/3622592993 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5da37cb40 0x55f5da3c22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.753+0000 7fbf9e802640 1 --2- 172.21.15.123:0/3622592993 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f5da37e2d0 0x55f5da377130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.753+0000 7fbf9d800640 1 -- 172.21.15.123:0/3622592993 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f5da37e2d0 msgr2=0x55f5da377130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:49.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.753+0000 7fbf9d800640 1 --2- 172.21.15.123:0/3622592993 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f5da37e2d0 0x55f5da377130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.753+0000 7fbf9d800640 1 -- 172.21.15.123:0/3622592993 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5da37cb40 msgr2=0x55f5da3c22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:49.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.753+0000 7fbf9d800640 1 --2- 172.21.15.123:0/3622592993 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5da37cb40 0x55f5da3c22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.753+0000 7fbf9d800640 1 -- 172.21.15.123:0/3622592993 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5da0be940 con 0x55f5da37a300 2024-09-15T23:22:49.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.753+0000 7fbf9e001640 1 --2- 172.21.15.123:0/3622592993 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5da37cb40 0x55f5da3c22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:49.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.753+0000 7fbf9d800640 1 --2- 172.21.15.123:0/3622592993 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f5da37a300 0x55f5da37cf20 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c02a770 tx=0x7fbf8c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc23a1031db52a48 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:49.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.753+0000 7fbf7b7fe640 1 -- 172.21.15.123:0/3622592993 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c037040 con 0x55f5da37a300 2024-09-15T23:22:49.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.753+0000 7fbf7b7fe640 1 -- 172.21.15.123:0/3622592993 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf8c042070 con 0x55f5da37a300 2024-09-15T23:22:49.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.753+0000 7fbf7b7fe640 1 -- 172.21.15.123:0/3622592993 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c003610 con 0x55f5da37a300 2024-09-15T23:22:49.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.754+0000 7fbfa3006740 1 -- 172.21.15.123:0/3622592993 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f5da37a300 msgr2=0x55f5da37cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:49.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.754+0000 7fbfa3006740 1 --2- 172.21.15.123:0/3622592993 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f5da37a300 0x55f5da37cf20 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c02a770 tx=0x7fbf8c02c000 comp rx=0 tx=0).stop 2024-09-15T23:22:49.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.754+0000 7fbfa3006740 1 -- 172.21.15.123:0/3622592993 shutdown_connections 2024-09-15T23:22:49.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.754+0000 7fbfa3006740 1 --2- 172.21.15.123:0/3622592993 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f5da37e2d0 0x55f5da377130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.754+0000 7fbfa3006740 1 --2- 172.21.15.123:0/3622592993 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f5da37a300 0x55f5da37cf20 unknown :-1 s=CLOSED pgs=2132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.754+0000 7fbfa3006740 1 --2- 172.21.15.123:0/3622592993 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5da37cb40 0x55f5da3c22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.754+0000 7fbfa3006740 1 -- 172.21.15.123:0/3622592993 >> 172.21.15.123:0/3622592993 conn(0x55f5da379300 msgr2=0x55f5da3c17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:49.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.754+0000 7fbfa3006740 1 -- 172.21.15.123:0/3622592993 shutdown_connections 2024-09-15T23:22:49.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.754+0000 7fbfa3006740 1 -- 172.21.15.123:0/3622592993 wait complete. 2024-09-15T23:22:49.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.754+0000 7fbfa3006740 1 -- start start 2024-09-15T23:22:49.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.755+0000 7fbfa3006740 1 Processor -- start 2024-09-15T23:22:49.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.755+0000 7fbfa3006740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f5da37cb40 0x55f5da3a65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.755+0000 7fbfa3006740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f5da37e2d0 0x55f5da3d5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.755+0000 7fbfa3006740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5da3bd3b0 0x55f5da37bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.755+0000 7fbfa3006740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55f5da268650 con 0x55f5da37cb40 2024-09-15T23:22:49.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.755+0000 7fbfa3006740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55f5da2db920 con 0x55f5da3bd3b0 2024-09-15T23:22:49.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.755+0000 7fbfa3006740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55f5da3787a0 con 0x55f5da37e2d0 2024-09-15T23:22:49.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.755+0000 7fbfa3006740 10 client.0 _ll_register_callbacks cb 0x55f5d9ff1d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:22:49.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.755+0000 7fbf9e001640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f5da37cb40 0x55f5da3a65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.756+0000 7fbf9e001640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f5da37cb40 0x55f5da3a65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59182/0 (socket says 172.21.15.123:59182) 2024-09-15T23:22:49.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.756+0000 7fbf9e001640 1 -- 172.21.15.123:0/2937752249 learned_addr learned my addr 172.21.15.123:0/2937752249 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:49.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.756+0000 7fbf9d800640 1 --2- 172.21.15.123:0/2937752249 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f5da37e2d0 0x55f5da3d5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.756+0000 7fbf9e802640 1 --2- 172.21.15.123:0/2937752249 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5da3bd3b0 0x55f5da37bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.756+0000 7fbf9e001640 1 -- 172.21.15.123:0/2937752249 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f5da37e2d0 msgr2=0x55f5da3d5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:49.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.756+0000 7fbf9e001640 1 --2- 172.21.15.123:0/2937752249 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f5da37e2d0 0x55f5da3d5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.756+0000 7fbf9e001640 1 -- 172.21.15.123:0/2937752249 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5da3bd3b0 msgr2=0x55f5da37bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:49.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.756+0000 7fbf9e001640 1 --2- 172.21.15.123:0/2937752249 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5da3bd3b0 0x55f5da37bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.756+0000 7fbf9e001640 1 -- 172.21.15.123:0/2937752249 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5da11f0d0 con 0x55f5da37cb40 2024-09-15T23:22:49.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.756+0000 7fbf9d800640 1 --2- 172.21.15.123:0/2937752249 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f5da37e2d0 0x55f5da3d5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:49.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.756+0000 7fbf9e001640 1 --2- 172.21.15.123:0/2937752249 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f5da37cb40 0x55f5da3a65d0 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7fbf940147b0 tx=0x7fbf94000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d360a2698d0e584e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:49.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.756+0000 7fbf78ff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:22:49.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.756+0000 7fbf78ff9640 1 -- 172.21.15.123:0/2937752249 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf94013930 con 0x55f5da37cb40 2024-09-15T23:22:49.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.756+0000 7fbf78ff9640 1 -- 172.21.15.123:0/2937752249 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7fbf94013ad0 con 0x55f5da37cb40 2024-09-15T23:22:49.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.756+0000 7fbfa3006740 1 -- 172.21.15.123:0/2937752249 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf8c042070 con 0x55f5da37cb40 2024-09-15T23:22:49.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.756+0000 7fbf78ff9640 1 -- 172.21.15.123:0/2937752249 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) ==== 24+0+0 (secure 0 0 0) 0x7fbf9402e050 con 0x55f5da37cb40 2024-09-15T23:22:49.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.756+0000 7fbfa3006740 10 client.10284 fetch_fsmap learned FSMap version 113 2024-09-15T23:22:49.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.756+0000 7fbfa3006740 1 -- 172.21.15.123:0/2937752249 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) -- 0x55f5d9fb2230 con 0x55f5da37cb40 2024-09-15T23:22:49.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.756+0000 7fbf78ff9640 1 -- 172.21.15.123:0/2937752249 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf8c042070 con 0x55f5da37cb40 2024-09-15T23:22:49.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.756+0000 7fbf78ff9640 1 -- 172.21.15.123:0/2937752249 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 113) ==== 3490+0+0 (secure 0 0 0) 0x7fbf94031020 con 0x55f5da37cb40 2024-09-15T23:22:49.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.756+0000 7fbfa3006740 10 client.10284 fetch_fsmap finished waiting for FSMap version 113 2024-09-15T23:22:49.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.756+0000 7fbfa3006740 10 client.10284 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T23:22:49.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.756+0000 7fbfa3006740 20 client.10284 populate_metadata read hostname 'smithi123' 2024-09-15T23:22:49.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.757+0000 7fbfa3006740 1 --2- 172.21.15.123:0/2937752249 >> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] conn(0x55f5da3bda80 0x55f5da3bbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.757+0000 7fbfa3006740 4 client.10284 mds_command: new command op to 10062 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:22:49.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.757+0000 7fbfa3006740 1 -- 172.21.15.123:0/2937752249 --> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f5da2ed090 con 0x55f5da3bda80 2024-09-15T23:22:49.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.757+0000 7fbf9d800640 1 --2- 172.21.15.123:0/2937752249 >> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] conn(0x55f5da3bda80 0x55f5da3bbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.757+0000 7fbf78ff9640 10 client.10284 ms_handle_connect on v2:172.21.15.123:6834/3239002092 2024-09-15T23:22:49.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.757+0000 7fbf9d800640 1 --2- 172.21.15.123:0/2937752249 >> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] conn(0x55f5da3bda80 0x55f5da3bbf20 crc :-1 s=READY pgs=9 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.10062 client_cookie=bf4312389bb940db server_cookie=3ecf22bb26a6c06d in_seq=0 out_seq=0 2024-09-15T23:22:49.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.757+0000 7fbf78ff9640 1 -- 172.21.15.123:0/2937752249 <== mds.10062 v2:172.21.15.123:6834/3239002092 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f5da2ed090 con 0x55f5da3bda80 2024-09-15T23:22:49.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.758+0000 7fbf78ff9640 10 client.10284 handle_command_reply: tid=0 2024-09-15T23:22:49.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.758+0000 7fbfa3006740 1 client.10284 shutdown 2024-09-15T23:22:49.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.758+0000 7fbfa3006740 1 -- 172.21.15.123:0/2937752249 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f5da37cb40 msgr2=0x55f5da3a65d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:49.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.758+0000 7fbfa3006740 1 --2- 172.21.15.123:0/2937752249 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f5da37cb40 0x55f5da3a65d0 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7fbf940147b0 tx=0x7fbf94000ed0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.758+0000 7fbfa3006740 1 -- 172.21.15.123:0/2937752249 shutdown_connections 2024-09-15T23:22:49.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.758+0000 7fbfa3006740 1 --2- 172.21.15.123:0/2937752249 >> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] conn(0x55f5da3bda80 0x55f5da3bbf20 crc :-1 s=READY pgs=9 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.758+0000 7fbfa3006740 1 --2- 172.21.15.123:0/2937752249 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5da3bd3b0 0x55f5da37bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.758+0000 7fbfa3006740 1 --2- 172.21.15.123:0/2937752249 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f5da37e2d0 0x55f5da3d5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.758+0000 7fbf78ff9640 0 client.10284 ms_handle_reset on v2:172.21.15.123:6834/3239002092 2024-09-15T23:22:49.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.758+0000 7fbfa3006740 1 --2- 172.21.15.123:0/2937752249 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f5da37cb40 0x55f5da3a65d0 unknown :-1 s=CLOSED pgs=2133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.758+0000 7fbfa3006740 1 -- 172.21.15.123:0/2937752249 >> 172.21.15.123:0/2937752249 conn(0x55f5da37a300 msgr2=0x55f5da3c0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:49.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.758+0000 7fbfa3006740 1 -- 172.21.15.123:0/2937752249 shutdown_connections 2024-09-15T23:22:49.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.758+0000 7fbfa3006740 1 -- 172.21.15.123:0/2937752249 wait complete. 2024-09-15T23:22:49.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.758+0000 7fbfa3006740 20 client.10284 trim_cache size 0 max 16384 2024-09-15T23:22:49.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.775+0000 7fbfa3006740 1 Processor -- start 2024-09-15T23:22:49.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.775+0000 7fbfa3006740 1 -- start start 2024-09-15T23:22:49.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.776+0000 7fbfa3006740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f5da37cb40 0x55f5da3bf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.776+0000 7fbfa3006740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f5da37e2d0 0x55f5da3bfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.776+0000 7fbfa3006740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5da3bd3b0 0x55f5da3c15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.776+0000 7fbfa3006740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbf981fe2f0 con 0x55f5da37e2d0 2024-09-15T23:22:49.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.776+0000 7fbfa3006740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbf981fe9c0 con 0x55f5da3bd3b0 2024-09-15T23:22:49.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.776+0000 7fbfa3006740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbf981fcd60 con 0x55f5da37cb40 2024-09-15T23:22:49.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.776+0000 7fbf9d800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f5da37e2d0 0x55f5da3bfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.776+0000 7fbf9d800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f5da37e2d0 0x55f5da3bfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59194/0 (socket says 172.21.15.123:59194) 2024-09-15T23:22:49.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.776+0000 7fbf9d800640 1 -- 172.21.15.123:0/1315134431 learned_addr learned my addr 172.21.15.123:0/1315134431 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:49.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.776+0000 7fbf9d800640 1 -- 172.21.15.123:0/1315134431 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f5da37cb40 msgr2=0x55f5da3bf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:49.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.776+0000 7fbf9d800640 1 --2- 172.21.15.123:0/1315134431 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f5da37cb40 0x55f5da3bf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.776+0000 7fbf9d800640 1 -- 172.21.15.123:0/1315134431 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5da3bd3b0 msgr2=0x55f5da3c15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:49.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.776+0000 7fbf9d800640 1 --2- 172.21.15.123:0/1315134431 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5da3bd3b0 0x55f5da3c15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.776+0000 7fbf9d800640 1 -- 172.21.15.123:0/1315134431 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5da3d5120 con 0x55f5da37e2d0 2024-09-15T23:22:49.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.776+0000 7fbf9d800640 1 --2- 172.21.15.123:0/1315134431 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f5da37e2d0 0x55f5da3bfd70 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c03f040 tx=0x7fbf8c008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd3d1bad18d6ea05 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:49.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.776+0000 7fbf7affd640 1 -- 172.21.15.123:0/1315134431 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c055070 con 0x55f5da37e2d0 2024-09-15T23:22:49.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.776+0000 7fbf7affd640 1 -- 172.21.15.123:0/1315134431 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf8c042040 con 0x55f5da37e2d0 2024-09-15T23:22:49.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.776+0000 7fbf7affd640 1 -- 172.21.15.123:0/1315134431 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c04e070 con 0x55f5da37e2d0 2024-09-15T23:22:49.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.777+0000 7fbfa3006740 1 -- 172.21.15.123:0/1315134431 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f5da37e2d0 msgr2=0x55f5da3bfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:49.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.777+0000 7fbfa3006740 1 --2- 172.21.15.123:0/1315134431 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f5da37e2d0 0x55f5da3bfd70 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c03f040 tx=0x7fbf8c008030 comp rx=0 tx=0).stop 2024-09-15T23:22:49.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.777+0000 7fbfa3006740 1 -- 172.21.15.123:0/1315134431 shutdown_connections 2024-09-15T23:22:49.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.777+0000 7fbfa3006740 1 --2- 172.21.15.123:0/1315134431 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5da3bd3b0 0x55f5da3c15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.777+0000 7fbfa3006740 1 --2- 172.21.15.123:0/1315134431 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f5da37e2d0 0x55f5da3bfd70 unknown :-1 s=CLOSED pgs=2134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.777+0000 7fbfa3006740 1 --2- 172.21.15.123:0/1315134431 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f5da37cb40 0x55f5da3bf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.777+0000 7fbfa3006740 1 -- 172.21.15.123:0/1315134431 >> 172.21.15.123:0/1315134431 conn(0x55f5da37a300 msgr2=0x55f5da3d5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:49.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.777+0000 7fbfa3006740 1 -- 172.21.15.123:0/1315134431 shutdown_connections 2024-09-15T23:22:49.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.777+0000 7fbfa3006740 1 -- 172.21.15.123:0/1315134431 wait complete. 2024-09-15T23:22:49.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.778+0000 7fbfa3006740 1 -- start start 2024-09-15T23:22:49.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.778+0000 7fbfa3006740 1 Processor -- start 2024-09-15T23:22:49.786 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T23:22:49.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.778+0000 7fbfa3006740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f5da37cb40 0x55f5da437350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.779+0000 7fbfa3006740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f5da37e2d0 0x55f5da435050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.779+0000 7fbfa3006740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5da3bd3b0 0x55f5da3c3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.779+0000 7fbfa3006740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55f5da3a5320 con 0x55f5da37cb40 2024-09-15T23:22:49.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.779+0000 7fbfa3006740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbf981fd3b0 con 0x55f5da3bd3b0 2024-09-15T23:22:49.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.779+0000 7fbfa3006740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55f5da3bd830 con 0x55f5da37e2d0 2024-09-15T23:22:49.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.779+0000 7fbfa3006740 10 client.0 _ll_register_callbacks cb 0x7fbf94017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:22:49.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.779+0000 7fbf9e001640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f5da37cb40 0x55f5da437350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.779+0000 7fbf9e001640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f5da37cb40 0x55f5da437350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59204/0 (socket says 172.21.15.123:59204) 2024-09-15T23:22:49.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.779+0000 7fbf9e001640 1 -- 172.21.15.123:0/426749526 learned_addr learned my addr 172.21.15.123:0/426749526 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:49.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.779+0000 7fbf9d800640 1 --2- 172.21.15.123:0/426749526 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f5da37e2d0 0x55f5da435050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.779+0000 7fbf9e802640 1 --2- 172.21.15.123:0/426749526 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5da3bd3b0 0x55f5da3c3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.779+0000 7fbf9e001640 1 -- 172.21.15.123:0/426749526 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f5da37e2d0 msgr2=0x55f5da435050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:49.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.779+0000 7fbf9e001640 1 --2- 172.21.15.123:0/426749526 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f5da37e2d0 0x55f5da435050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.779+0000 7fbf9e001640 1 -- 172.21.15.123:0/426749526 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5da3bd3b0 msgr2=0x55f5da3c3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:49.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.779+0000 7fbf9e001640 1 --2- 172.21.15.123:0/426749526 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5da3bd3b0 0x55f5da3c3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.779+0000 7fbf9e001640 1 -- 172.21.15.123:0/426749526 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5da3a59b0 con 0x55f5da37cb40 2024-09-15T23:22:49.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.779+0000 7fbf9e001640 1 --2- 172.21.15.123:0/426749526 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f5da37cb40 0x55f5da437350 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 crypto rx=0x7fbf94001eb0 tx=0x7fbf94007b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b074ac7eb74851 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:49.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.779+0000 7fbf78ff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:22:49.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.779+0000 7fbf78ff9640 1 -- 172.21.15.123:0/426749526 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf9400f5f0 con 0x55f5da37cb40 2024-09-15T23:22:49.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.779+0000 7fbf78ff9640 1 -- 172.21.15.123:0/426749526 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7fbf940049f0 con 0x55f5da37cb40 2024-09-15T23:22:49.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.779+0000 7fbfa3006740 1 -- 172.21.15.123:0/426749526 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf8c042040 con 0x55f5da37cb40 2024-09-15T23:22:49.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.779+0000 7fbf78ff9640 1 -- 172.21.15.123:0/426749526 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) ==== 24+0+0 (secure 0 0 0) 0x7fbf94040050 con 0x55f5da37cb40 2024-09-15T23:22:49.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.779+0000 7fbfa3006740 10 client.10290 fetch_fsmap learned FSMap version 113 2024-09-15T23:22:49.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.779+0000 7fbfa3006740 1 -- 172.21.15.123:0/426749526 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) -- 0x55f5da437990 con 0x55f5da37cb40 2024-09-15T23:22:49.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.780+0000 7fbf78ff9640 1 -- 172.21.15.123:0/426749526 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf8c042040 con 0x55f5da37cb40 2024-09-15T23:22:49.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.780+0000 7fbf78ff9640 1 -- 172.21.15.123:0/426749526 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 113) ==== 3490+0+0 (secure 0 0 0) 0x7fbf94043020 con 0x55f5da37cb40 2024-09-15T23:22:49.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.780+0000 7fbfa3006740 10 client.10290 fetch_fsmap finished waiting for FSMap version 113 2024-09-15T23:22:49.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.780+0000 7fbfa3006740 10 client.10290 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T23:22:49.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.780+0000 7fbfa3006740 20 client.10290 populate_metadata read hostname 'smithi123' 2024-09-15T23:22:49.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.780+0000 7fbfa3006740 1 --2- 172.21.15.123:0/426749526 >> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] conn(0x55f5da3c1950 0x55f5da3bbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.780+0000 7fbfa3006740 4 client.10290 mds_command: new command op to 10062 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2024-09-15T23:22:49.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.780+0000 7fbfa3006740 1 -- 172.21.15.123:0/426749526 --> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) -- 0x55f5da3d4dd0 con 0x55f5da3c1950 2024-09-15T23:22:49.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.780+0000 7fbf9d800640 1 --2- 172.21.15.123:0/426749526 >> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] conn(0x55f5da3c1950 0x55f5da3bbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.780+0000 7fbf78ff9640 10 client.10290 ms_handle_connect on v2:172.21.15.123:6834/3239002092 2024-09-15T23:22:49.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.780+0000 7fbf9d800640 1 --2- 172.21.15.123:0/426749526 >> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] conn(0x55f5da3c1950 0x55f5da3bbd40 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.10062 client_cookie=ec6f92c1f05d76bd server_cookie=dd2012c3d4e32bf7 in_seq=0 out_seq=0 2024-09-15T23:22:49.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.780+0000 7fbf78ff9640 1 -- 172.21.15.123:0/426749526 <== mds.10062 v2:172.21.15.123:6834/3239002092 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x55f5da3d4dd0 con 0x55f5da3c1950 2024-09-15T23:22:49.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.780+0000 7fbf78ff9640 10 client.10290 handle_command_reply: tid=0 2024-09-15T23:22:49.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.780+0000 7fbfa3006740 1 client.10290 shutdown 2024-09-15T23:22:49.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.780+0000 7fbfa3006740 1 -- 172.21.15.123:0/426749526 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f5da37cb40 msgr2=0x55f5da437350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:49.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.780+0000 7fbfa3006740 1 --2- 172.21.15.123:0/426749526 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f5da37cb40 0x55f5da437350 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 crypto rx=0x7fbf94001eb0 tx=0x7fbf94007b50 comp rx=0 tx=0).stop 2024-09-15T23:22:49.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.780+0000 7fbfa3006740 1 -- 172.21.15.123:0/426749526 shutdown_connections 2024-09-15T23:22:49.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.780+0000 7fbfa3006740 1 --2- 172.21.15.123:0/426749526 >> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] conn(0x55f5da3c1950 0x55f5da3bbd40 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.780+0000 7fbfa3006740 1 --2- 172.21.15.123:0/426749526 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f5da3bd3b0 0x55f5da3c3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.780+0000 7fbfa3006740 1 --2- 172.21.15.123:0/426749526 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f5da37e2d0 0x55f5da435050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.780+0000 7fbf78ff9640 0 client.10290 ms_handle_reset on v2:172.21.15.123:6834/3239002092 2024-09-15T23:22:49.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.780+0000 7fbfa3006740 1 --2- 172.21.15.123:0/426749526 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f5da37cb40 0x55f5da437350 unknown :-1 s=CLOSED pgs=2135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.780+0000 7fbfa3006740 1 -- 172.21.15.123:0/426749526 >> 172.21.15.123:0/426749526 conn(0x55f5da37a300 msgr2=0x55f5da3a3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:49.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.781+0000 7fbfa3006740 1 -- 172.21.15.123:0/426749526 shutdown_connections 2024-09-15T23:22:49.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.781+0000 7fbfa3006740 1 -- 172.21.15.123:0/426749526 wait complete. 2024-09-15T23:22:49.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.781+0000 7fbfa3006740 20 client.10290 trim_cache size 0 max 16384 2024-09-15T23:22:49.790 INFO:teuthology.orchestra.run.smithi123.stderr:Error EINVAL: MDS is not active 2024-09-15T23:22:49.791 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c scrub pause 2024-09-15T23:22:49.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.890+0000 7f6265d68640 1 Processor -- start 2024-09-15T23:22:49.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.891+0000 7f6265d68640 1 -- start start 2024-09-15T23:22:49.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.891+0000 7f6265d68640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f62600730f0 0x7f6260073530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.891+0000 7f6265d68640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f626006f460 0x7f626006f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.891+0000 7f6265d68640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f626015cbd0 con 0x7f626015c7f0 2024-09-15T23:22:49.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.891+0000 7f6265d68640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f62600cecf0 con 0x7f62600730f0 2024-09-15T23:22:49.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.891+0000 7f6265d68640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6260073a70 con 0x7f626006f460 2024-09-15T23:22:49.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.892+0000 7f625effd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f62600730f0 0x7f6260073530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.892+0000 7f625ffff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f626006f460 0x7f626006f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.892+0000 7f625ffff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f626006f460 0x7f626006f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:52814/0 (socket says 172.21.15.123:52814) 2024-09-15T23:22:49.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.892+0000 7f625effd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f62600730f0 0x7f6260073530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:47548/0 (socket says 172.21.15.123:47548) 2024-09-15T23:22:49.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.892+0000 7f625ffff640 1 -- 172.21.15.123:0/288664657 learned_addr learned my addr 172.21.15.123:0/288664657 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:49.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.892+0000 7f625effd640 1 -- 172.21.15.123:0/288664657 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f626006f460 msgr2=0x7f626006f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:49.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.892+0000 7f625effd640 1 --2- 172.21.15.123:0/288664657 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f626006f460 0x7f626006f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.892+0000 7f625effd640 1 -- 172.21.15.123:0/288664657 >> v1:172.21.15.188:6789/0 conn(0x7f626015c7f0 legacy=0x7f62600b16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:49.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.892+0000 7f625e7fc640 1 -- 172.21.15.123:0/288664657 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 610518304 0 0) 0x7f626015cbd0 con 0x7f626015c7f0 2024-09-15T23:22:49.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.892+0000 7f625effd640 1 -- 172.21.15.123:0/288664657 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62600ce0e0 con 0x7f62600730f0 2024-09-15T23:22:49.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.892+0000 7f625ffff640 1 --2- 172.21.15.123:0/288664657 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f626006f460 0x7f626006f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:22:49.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.893+0000 7f625effd640 1 --2- 172.21.15.123:0/288664657 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f62600730f0 0x7f6260073530 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f62540097a0 tx=0x7f625402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82371fc1593141e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:49.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.893+0000 7f625e7fc640 1 -- 172.21.15.123:0/288664657 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6254037070 con 0x7f62600730f0 2024-09-15T23:22:49.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.893+0000 7f625e7fc640 1 -- 172.21.15.123:0/288664657 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6254032440 con 0x7f62600730f0 2024-09-15T23:22:49.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.893+0000 7f625e7fc640 1 -- 172.21.15.123:0/288664657 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6254032810 con 0x7f62600730f0 2024-09-15T23:22:49.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.893+0000 7f6265d68640 1 -- 172.21.15.123:0/288664657 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f62600730f0 msgr2=0x7f6260073530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:49.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.893+0000 7f6265d68640 1 --2- 172.21.15.123:0/288664657 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f62600730f0 0x7f6260073530 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f62540097a0 tx=0x7f625402a180 comp rx=0 tx=0).stop 2024-09-15T23:22:49.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.893+0000 7f6265d68640 1 -- 172.21.15.123:0/288664657 shutdown_connections 2024-09-15T23:22:49.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.893+0000 7f6265d68640 1 --2- 172.21.15.123:0/288664657 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f62600730f0 0x7f6260073530 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.893+0000 7f6265d68640 1 --2- 172.21.15.123:0/288664657 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f626006f460 0x7f626006f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.893+0000 7f6265d68640 1 -- 172.21.15.123:0/288664657 >> 172.21.15.123:0/288664657 conn(0x7f62600d2570 msgr2=0x7f62600d2980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:49.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.894+0000 7f6265d68640 1 -- 172.21.15.123:0/288664657 shutdown_connections 2024-09-15T23:22:49.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.894+0000 7f6265d68640 1 -- 172.21.15.123:0/288664657 wait complete. 2024-09-15T23:22:49.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.895+0000 7f6265d68640 1 Processor -- start 2024-09-15T23:22:49.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.895+0000 7f6265d68640 1 -- start start 2024-09-15T23:22:49.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.895+0000 7f6265d68640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f626006f460 0x7f6260155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.895+0000 7f6265d68640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f62600730f0 0x7f62600cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.895+0000 7f6265d68640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f626015c7f0 0x7f62600cc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.896+0000 7f6265d68640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f62600ce980 con 0x7f626015c7f0 2024-09-15T23:22:49.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.896+0000 7f6265d68640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f62600ce6a0 con 0x7f62600730f0 2024-09-15T23:22:49.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.896+0000 7f6265d68640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f62600b1e00 con 0x7f626006f460 2024-09-15T23:22:49.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.896+0000 7f625ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f626015c7f0 0x7f62600cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.896+0000 7f625ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f626015c7f0 0x7f62600cc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59218/0 (socket says 172.21.15.123:59218) 2024-09-15T23:22:49.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.896+0000 7f625ffff640 1 -- 172.21.15.123:0/2917046993 learned_addr learned my addr 172.21.15.123:0/2917046993 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:49.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.896+0000 7f625f7fe640 1 --2- 172.21.15.123:0/2917046993 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f626006f460 0x7f6260155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.896+0000 7f625effd640 1 --2- 172.21.15.123:0/2917046993 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f62600730f0 0x7f62600cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.896+0000 7f625ffff640 1 -- 172.21.15.123:0/2917046993 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f626006f460 msgr2=0x7f6260155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:49.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.896+0000 7f625ffff640 1 --2- 172.21.15.123:0/2917046993 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f626006f460 0x7f6260155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.896+0000 7f625ffff640 1 -- 172.21.15.123:0/2917046993 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f62600730f0 msgr2=0x7f62600cbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:49.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.896+0000 7f625ffff640 1 --2- 172.21.15.123:0/2917046993 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f62600730f0 0x7f62600cbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.896+0000 7f625ffff640 1 -- 172.21.15.123:0/2917046993 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62601f4590 con 0x7f626015c7f0 2024-09-15T23:22:49.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.896+0000 7f625ffff640 1 --2- 172.21.15.123:0/2917046993 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f626015c7f0 0x7f62600cc500 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7f625800efc0 tx=0x7f625800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:49.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.896+0000 7f6247fff640 1 -- 172.21.15.123:0/2917046993 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625800cbe0 con 0x7f626015c7f0 2024-09-15T23:22:49.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.896+0000 7f6247fff640 1 -- 172.21.15.123:0/2917046993 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f625800cd80 con 0x7f626015c7f0 2024-09-15T23:22:49.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.896+0000 7f6247fff640 1 -- 172.21.15.123:0/2917046993 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6258003bb0 con 0x7f626015c7f0 2024-09-15T23:22:49.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.896+0000 7f6265d68640 1 -- 172.21.15.123:0/2917046993 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62601f4870 con 0x7f626015c7f0 2024-09-15T23:22:49.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.896+0000 7f6265d68640 1 -- 172.21.15.123:0/2917046993 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62601f4e30 con 0x7f626015c7f0 2024-09-15T23:22:49.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.898+0000 7f6247fff640 1 -- 172.21.15.123:0/2917046993 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f625801b030 con 0x7f626015c7f0 2024-09-15T23:22:49.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.898+0000 7f6247fff640 1 --2- 172.21.15.123:0/2917046993 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f624c06c2b0 0x7f624c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.899+0000 7f6247fff640 1 -- 172.21.15.123:0/2917046993 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f625808b720 con 0x7f626015c7f0 2024-09-15T23:22:49.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.899+0000 7f625f7fe640 1 --2- 172.21.15.123:0/2917046993 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f624c06c2b0 0x7f624c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.899+0000 7f625f7fe640 1 --2- 172.21.15.123:0/2917046993 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f624c06c2b0 0x7f624c06e770 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f6250000f60 tx=0x7f6250009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:49.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.899+0000 7f6268bd9740 1 Processor -- start 2024-09-15T23:22:49.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.899+0000 7f6268bd9740 1 -- start start 2024-09-15T23:22:49.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.900+0000 7f6268bd9740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5573ab089800 0x5573ab089be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.900+0000 7f6268bd9740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5573ab086fc0 0x5573ab088b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.900+0000 7f6268bd9740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5573ab087420 0x5573ab069780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.900+0000 7f6268bd9740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5573aafa58a0 con 0x5573ab089800 2024-09-15T23:22:49.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.900+0000 7f6268bd9740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5573aaf4d5f0 con 0x5573ab087420 2024-09-15T23:22:49.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.900+0000 7f6268bd9740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5573aafa1860 con 0x5573ab086fc0 2024-09-15T23:22:49.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.900+0000 7f625f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5573ab089800 0x5573ab089be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.900+0000 7f625f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5573ab089800 0x5573ab089be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59228/0 (socket says 172.21.15.123:59228) 2024-09-15T23:22:49.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.900+0000 7f625f7fe640 1 -- 172.21.15.123:0/2490280496 learned_addr learned my addr 172.21.15.123:0/2490280496 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:49.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.900+0000 7f625effd640 1 --2- 172.21.15.123:0/2490280496 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5573ab086fc0 0x5573ab088b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.900+0000 7f625ffff640 1 --2- 172.21.15.123:0/2490280496 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5573ab087420 0x5573ab069780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.900+0000 7f625f7fe640 1 -- 172.21.15.123:0/2490280496 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5573ab086fc0 msgr2=0x5573ab088b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:49.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.901+0000 7f625f7fe640 1 --2- 172.21.15.123:0/2490280496 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5573ab086fc0 0x5573ab088b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.901+0000 7f625f7fe640 1 -- 172.21.15.123:0/2490280496 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5573ab087420 msgr2=0x5573ab069780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:49.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.901+0000 7f625f7fe640 1 --2- 172.21.15.123:0/2490280496 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5573ab087420 0x5573ab069780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.901+0000 7f625f7fe640 1 -- 172.21.15.123:0/2490280496 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573aac9c120 con 0x5573ab089800 2024-09-15T23:22:49.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.901+0000 7f625ffff640 1 --2- 172.21.15.123:0/2490280496 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5573ab087420 0x5573ab069780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:49.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.901+0000 7f625f7fe640 1 --2- 172.21.15.123:0/2490280496 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5573ab089800 0x5573ab089be0 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7f625000fb70 tx=0x7f6250012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb922aeb243a0a3b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:49.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.901+0000 7f62457fa640 1 -- 172.21.15.123:0/2490280496 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6250025070 con 0x5573ab089800 2024-09-15T23:22:49.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.901+0000 7f62457fa640 1 -- 172.21.15.123:0/2490280496 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f625001b050 con 0x5573ab089800 2024-09-15T23:22:49.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.901+0000 7f62457fa640 1 -- 172.21.15.123:0/2490280496 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6250014de0 con 0x5573ab089800 2024-09-15T23:22:49.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.901+0000 7f6268bd9740 1 -- 172.21.15.123:0/2490280496 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5573ab089800 msgr2=0x5573ab089be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:49.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.901+0000 7f6268bd9740 1 --2- 172.21.15.123:0/2490280496 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5573ab089800 0x5573ab089be0 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7f625000fb70 tx=0x7f6250012000 comp rx=0 tx=0).stop 2024-09-15T23:22:49.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.902+0000 7f6268bd9740 1 -- 172.21.15.123:0/2490280496 shutdown_connections 2024-09-15T23:22:49.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.902+0000 7f6268bd9740 1 --2- 172.21.15.123:0/2490280496 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5573ab087420 0x5573ab069780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.902+0000 7f6268bd9740 1 --2- 172.21.15.123:0/2490280496 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5573ab086fc0 0x5573ab088b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.902+0000 7f6268bd9740 1 --2- 172.21.15.123:0/2490280496 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5573ab089800 0x5573ab089be0 unknown :-1 s=CLOSED pgs=2137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.902+0000 7f6268bd9740 1 -- 172.21.15.123:0/2490280496 >> 172.21.15.123:0/2490280496 conn(0x5573ab03f6f0 msgr2=0x5573ab087870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:49.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.902+0000 7f6268bd9740 1 -- 172.21.15.123:0/2490280496 shutdown_connections 2024-09-15T23:22:49.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.902+0000 7f6268bd9740 1 -- 172.21.15.123:0/2490280496 wait complete. 2024-09-15T23:22:49.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.902+0000 7f6268bd9740 1 -- start start 2024-09-15T23:22:49.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.902+0000 7f6268bd9740 1 Processor -- start 2024-09-15T23:22:49.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.903+0000 7f6268bd9740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5573ab087420 0x5573ab06c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.903+0000 7f6268bd9740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5573ab089800 0x5573ab081e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.903+0000 7f6268bd9740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5573ab083b90 0x5573ab083ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.903+0000 7f6268bd9740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5573ab085f20 con 0x5573ab087420 2024-09-15T23:22:49.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.903+0000 7f6268bd9740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5573aaf2e3f0 con 0x5573ab089800 2024-09-15T23:22:49.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.903+0000 7f6268bd9740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5573ab086200 con 0x5573ab083b90 2024-09-15T23:22:49.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.903+0000 7f6268bd9740 10 client.0 _ll_register_callbacks cb 0x5573aacb7910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:22:49.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.903+0000 7f625f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5573ab087420 0x5573ab06c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.903+0000 7f625f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5573ab087420 0x5573ab06c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59244/0 (socket says 172.21.15.123:59244) 2024-09-15T23:22:49.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.903+0000 7f625f7fe640 1 -- 172.21.15.123:0/53421907 learned_addr learned my addr 172.21.15.123:0/53421907 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:49.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.903+0000 7f625effd640 1 --2- 172.21.15.123:0/53421907 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5573ab089800 0x5573ab081e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.903+0000 7f625ffff640 1 --2- 172.21.15.123:0/53421907 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5573ab083b90 0x5573ab083ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.903+0000 7f625f7fe640 1 -- 172.21.15.123:0/53421907 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5573ab083b90 msgr2=0x5573ab083ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:49.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.903+0000 7f625f7fe640 1 --2- 172.21.15.123:0/53421907 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5573ab083b90 0x5573ab083ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.903+0000 7f625f7fe640 1 -- 172.21.15.123:0/53421907 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5573ab089800 msgr2=0x5573ab081e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:49.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.903+0000 7f625f7fe640 1 --2- 172.21.15.123:0/53421907 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5573ab089800 0x5573ab081e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.903+0000 7f625f7fe640 1 -- 172.21.15.123:0/53421907 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573aad82500 con 0x5573ab087420 2024-09-15T23:22:49.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.904+0000 7f625f7fe640 1 --2- 172.21.15.123:0/53421907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5573ab087420 0x5573ab06c830 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x7f6250014820 tx=0x7f6250001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30f4cbb06afee809 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:49.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.904+0000 7f623e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:22:49.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.904+0000 7f623e7fc640 1 -- 172.21.15.123:0/53421907 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625002f060 con 0x5573ab087420 2024-09-15T23:22:49.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.904+0000 7f6268bd9740 1 -- 172.21.15.123:0/53421907 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f625001b050 con 0x5573ab087420 2024-09-15T23:22:49.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.904+0000 7f623e7fc640 1 -- 172.21.15.123:0/53421907 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f6250020a50 con 0x5573ab087420 2024-09-15T23:22:49.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.904+0000 7f623e7fc640 1 -- 172.21.15.123:0/53421907 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) ==== 24+0+0 (secure 0 0 0) 0x7f6250035050 con 0x5573ab087420 2024-09-15T23:22:49.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.904+0000 7f6268bd9740 10 client.10299 fetch_fsmap learned FSMap version 113 2024-09-15T23:22:49.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.904+0000 7f6268bd9740 1 -- 172.21.15.123:0/53421907 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) -- 0x5573aade2c90 con 0x5573ab087420 2024-09-15T23:22:49.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.904+0000 7f623e7fc640 1 -- 172.21.15.123:0/53421907 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f625001b050 con 0x5573ab087420 2024-09-15T23:22:49.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.904+0000 7f623e7fc640 1 -- 172.21.15.123:0/53421907 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 113) ==== 3490+0+0 (secure 0 0 0) 0x7f6250038020 con 0x5573ab087420 2024-09-15T23:22:49.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.904+0000 7f6268bd9740 10 client.10299 fetch_fsmap finished waiting for FSMap version 113 2024-09-15T23:22:49.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.904+0000 7f6268bd9740 10 client.10299 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T23:22:49.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.904+0000 7f6268bd9740 20 client.10299 populate_metadata read hostname 'smithi123' 2024-09-15T23:22:49.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.904+0000 7f6268bd9740 1 --2- 172.21.15.123:0/53421907 >> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] conn(0x5573ab0a3230 0x5573ab0a5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.904+0000 7f6268bd9740 4 client.10299 mds_command: new command op to 10062 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:22:49.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.904+0000 7f6268bd9740 1 -- 172.21.15.123:0/53421907 --> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5573aafb2fd0 con 0x5573ab0a3230 2024-09-15T23:22:49.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.904+0000 7f625effd640 1 --2- 172.21.15.123:0/53421907 >> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] conn(0x5573ab0a3230 0x5573ab0a5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.905+0000 7f625effd640 1 --2- 172.21.15.123:0/53421907 >> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] conn(0x5573ab0a3230 0x5573ab0a5620 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.10062 client_cookie=d4ea9f849b7654b0 server_cookie=719354eab90c4807 in_seq=0 out_seq=0 2024-09-15T23:22:49.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.905+0000 7f623e7fc640 10 client.10299 ms_handle_connect on v2:172.21.15.123:6834/3239002092 2024-09-15T23:22:49.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.905+0000 7f623e7fc640 1 -- 172.21.15.123:0/53421907 <== mds.10062 v2:172.21.15.123:6834/3239002092 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5573aafb2fd0 con 0x5573ab0a3230 2024-09-15T23:22:49.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.905+0000 7f623e7fc640 10 client.10299 handle_command_reply: tid=0 2024-09-15T23:22:49.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.905+0000 7f6268bd9740 1 client.10299 shutdown 2024-09-15T23:22:49.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.905+0000 7f6268bd9740 1 -- 172.21.15.123:0/53421907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5573ab087420 msgr2=0x5573ab06c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:49.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.905+0000 7f6268bd9740 1 --2- 172.21.15.123:0/53421907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5573ab087420 0x5573ab06c830 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x7f6250014820 tx=0x7f6250001080 comp rx=0 tx=0).stop 2024-09-15T23:22:49.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.905+0000 7f6268bd9740 1 -- 172.21.15.123:0/53421907 shutdown_connections 2024-09-15T23:22:49.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.905+0000 7f6268bd9740 1 --2- 172.21.15.123:0/53421907 >> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] conn(0x5573ab0a3230 0x5573ab0a5620 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.905+0000 7f6268bd9740 1 --2- 172.21.15.123:0/53421907 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5573ab083b90 0x5573ab083ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.905+0000 7f6268bd9740 1 --2- 172.21.15.123:0/53421907 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5573ab089800 0x5573ab081e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.905+0000 7f6268bd9740 1 --2- 172.21.15.123:0/53421907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5573ab087420 0x5573ab06c830 unknown :-1 s=CLOSED pgs=2138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.905+0000 7f6268bd9740 1 -- 172.21.15.123:0/53421907 >> 172.21.15.123:0/53421907 conn(0x5573ab086fc0 msgr2=0x5573ab087870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:49.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.905+0000 7f623e7fc640 0 client.10299 ms_handle_reset on v2:172.21.15.123:6834/3239002092 2024-09-15T23:22:49.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.906+0000 7f6268bd9740 1 -- 172.21.15.123:0/53421907 shutdown_connections 2024-09-15T23:22:49.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.906+0000 7f6268bd9740 1 -- 172.21.15.123:0/53421907 wait complete. 2024-09-15T23:22:49.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.906+0000 7f6268bd9740 20 client.10299 trim_cache size 0 max 16384 2024-09-15T23:22:49.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.922+0000 7f6268bd9740 1 Processor -- start 2024-09-15T23:22:49.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.922+0000 7f6268bd9740 1 -- start start 2024-09-15T23:22:49.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.923+0000 7f6268bd9740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5573ab083b90 0x5573ab082900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.923+0000 7f6268bd9740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5573ab087420 0x5573ab082e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.923+0000 7f6268bd9740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5573ab089800 0x5573ab098db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.923+0000 7f6268bd9740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6260200be0 con 0x5573ab083b90 2024-09-15T23:22:49.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.923+0000 7f6268bd9740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f626015da30 con 0x5573ab087420 2024-09-15T23:22:49.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.923+0000 7f6268bd9740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f626015e080 con 0x5573ab089800 2024-09-15T23:22:49.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.923+0000 7f625f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5573ab083b90 0x5573ab082900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.923+0000 7f625f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5573ab083b90 0x5573ab082900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59246/0 (socket says 172.21.15.123:59246) 2024-09-15T23:22:49.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.923+0000 7f625f7fe640 1 -- 172.21.15.123:0/3639887888 learned_addr learned my addr 172.21.15.123:0/3639887888 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:49.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.924+0000 7f625ffff640 1 --2- 172.21.15.123:0/3639887888 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5573ab089800 0x5573ab098db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.924+0000 7f625effd640 1 --2- 172.21.15.123:0/3639887888 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5573ab087420 0x5573ab082e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.924+0000 7f625f7fe640 1 -- 172.21.15.123:0/3639887888 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5573ab089800 msgr2=0x5573ab098db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:49.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.924+0000 7f625f7fe640 1 --2- 172.21.15.123:0/3639887888 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5573ab089800 0x5573ab098db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.924+0000 7f625f7fe640 1 -- 172.21.15.123:0/3639887888 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5573ab087420 msgr2=0x5573ab082e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:49.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.924+0000 7f625f7fe640 1 --2- 172.21.15.123:0/3639887888 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5573ab087420 0x5573ab082e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.924+0000 7f625f7fe640 1 -- 172.21.15.123:0/3639887888 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573aac77e20 con 0x5573ab083b90 2024-09-15T23:22:49.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.924+0000 7f625effd640 1 --2- 172.21.15.123:0/3639887888 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5573ab087420 0x5573ab082e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:22:49.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.924+0000 7f625ffff640 1 --2- 172.21.15.123:0/3639887888 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5573ab089800 0x5573ab098db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:22:49.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.924+0000 7f625f7fe640 1 --2- 172.21.15.123:0/3639887888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5573ab083b90 0x5573ab082900 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7f6250007840 tx=0x7f6250028000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f95755ebc450384 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:49.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.924+0000 7f6244ff9640 1 -- 172.21.15.123:0/3639887888 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6250025040 con 0x5573ab083b90 2024-09-15T23:22:49.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.924+0000 7f6244ff9640 1 -- 172.21.15.123:0/3639887888 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f625001b030 con 0x5573ab083b90 2024-09-15T23:22:49.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.924+0000 7f6244ff9640 1 -- 172.21.15.123:0/3639887888 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625002a600 con 0x5573ab083b90 2024-09-15T23:22:49.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.925+0000 7f6268bd9740 1 -- 172.21.15.123:0/3639887888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5573ab083b90 msgr2=0x5573ab082900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:49.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.925+0000 7f6268bd9740 1 --2- 172.21.15.123:0/3639887888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5573ab083b90 0x5573ab082900 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7f6250007840 tx=0x7f6250028000 comp rx=0 tx=0).stop 2024-09-15T23:22:49.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.925+0000 7f6268bd9740 1 -- 172.21.15.123:0/3639887888 shutdown_connections 2024-09-15T23:22:49.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.925+0000 7f6268bd9740 1 --2- 172.21.15.123:0/3639887888 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5573ab089800 0x5573ab098db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.925+0000 7f6268bd9740 1 --2- 172.21.15.123:0/3639887888 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5573ab087420 0x5573ab082e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.925+0000 7f6268bd9740 1 --2- 172.21.15.123:0/3639887888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5573ab083b90 0x5573ab082900 unknown :-1 s=CLOSED pgs=2139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.925+0000 7f6268bd9740 1 -- 172.21.15.123:0/3639887888 >> 172.21.15.123:0/3639887888 conn(0x5573ab086fc0 msgr2=0x5573ab068340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:49.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.925+0000 7f6268bd9740 1 -- 172.21.15.123:0/3639887888 shutdown_connections 2024-09-15T23:22:49.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.925+0000 7f6268bd9740 1 -- 172.21.15.123:0/3639887888 wait complete. 2024-09-15T23:22:49.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.925+0000 7f6268bd9740 1 -- start start 2024-09-15T23:22:49.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.925+0000 7f6268bd9740 1 Processor -- start 2024-09-15T23:22:49.932 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T23:22:49.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.926+0000 7f6268bd9740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5573ab083b90 0x5573ab087800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.926+0000 7f6268bd9740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5573ab087420 0x5573ab087d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.926+0000 7f6268bd9740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5573ab089800 0x5573ab042a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.926+0000 7f6268bd9740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5573ab084530 con 0x5573ab083b90 2024-09-15T23:22:49.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.926+0000 7f6268bd9740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5573ab085100 con 0x5573ab089800 2024-09-15T23:22:49.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.926+0000 7f6268bd9740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5573ab05dfd0 con 0x5573ab087420 2024-09-15T23:22:49.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.926+0000 7f6268bd9740 10 client.0 _ll_register_callbacks cb 0x7f6250023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:22:49.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.926+0000 7f625f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5573ab083b90 0x5573ab087800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.926+0000 7f625f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5573ab083b90 0x5573ab087800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59262/0 (socket says 172.21.15.123:59262) 2024-09-15T23:22:49.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.926+0000 7f625f7fe640 1 -- 172.21.15.123:0/2360563534 learned_addr learned my addr 172.21.15.123:0/2360563534 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:49.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.926+0000 7f625effd640 1 --2- 172.21.15.123:0/2360563534 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5573ab087420 0x5573ab087d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.926+0000 7f625ffff640 1 --2- 172.21.15.123:0/2360563534 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5573ab089800 0x5573ab042a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.926+0000 7f625f7fe640 1 -- 172.21.15.123:0/2360563534 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5573ab087420 msgr2=0x5573ab087d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:49.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.926+0000 7f625f7fe640 1 --2- 172.21.15.123:0/2360563534 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5573ab087420 0x5573ab087d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.926+0000 7f625f7fe640 1 -- 172.21.15.123:0/2360563534 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5573ab089800 msgr2=0x5573ab042a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:49.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.926+0000 7f625f7fe640 1 --2- 172.21.15.123:0/2360563534 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5573ab089800 0x5573ab042a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.926+0000 7f625f7fe640 1 -- 172.21.15.123:0/2360563534 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573ab0a1ba0 con 0x5573ab083b90 2024-09-15T23:22:49.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.927+0000 7f625f7fe640 1 --2- 172.21.15.123:0/2360563534 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5573ab083b90 0x5573ab087800 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7f625003b040 tx=0x7f625000a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98eff430ff541195 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:49.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.927+0000 7f623e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:22:49.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.927+0000 7f623e7fc640 1 -- 172.21.15.123:0/2360563534 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f625003d040 con 0x5573ab083b90 2024-09-15T23:22:49.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.927+0000 7f623e7fc640 1 -- 172.21.15.123:0/2360563534 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f625002f820 con 0x5573ab083b90 2024-09-15T23:22:49.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.927+0000 7f6268bd9740 1 -- 172.21.15.123:0/2360563534 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f625001b030 con 0x5573ab083b90 2024-09-15T23:22:49.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.927+0000 7f623e7fc640 1 -- 172.21.15.123:0/2360563534 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) ==== 24+0+0 (secure 0 0 0) 0x7f6250025040 con 0x5573ab083b90 2024-09-15T23:22:49.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.927+0000 7f6268bd9740 10 client.10305 fetch_fsmap learned FSMap version 113 2024-09-15T23:22:49.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.927+0000 7f6268bd9740 1 -- 172.21.15.123:0/2360563534 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) -- 0x5573ab1094e0 con 0x5573ab083b90 2024-09-15T23:22:49.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.927+0000 7f623e7fc640 1 -- 172.21.15.123:0/2360563534 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f625001b030 con 0x5573ab083b90 2024-09-15T23:22:49.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.927+0000 7f623e7fc640 1 -- 172.21.15.123:0/2360563534 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 113) ==== 3490+0+0 (secure 0 0 0) 0x7f6250040020 con 0x5573ab083b90 2024-09-15T23:22:49.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.927+0000 7f6268bd9740 10 client.10305 fetch_fsmap finished waiting for FSMap version 113 2024-09-15T23:22:49.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.927+0000 7f6268bd9740 10 client.10305 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T23:22:49.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.927+0000 7f6268bd9740 20 client.10305 populate_metadata read hostname 'smithi123' 2024-09-15T23:22:49.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.927+0000 7f6268bd9740 1 --2- 172.21.15.123:0/2360563534 >> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] conn(0x5573ab042fa0 0x5573ab043380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:49.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.927+0000 7f6268bd9740 4 client.10305 mds_command: new command op to 10062 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-15T23:22:49.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.927+0000 7f6268bd9740 1 -- 172.21.15.123:0/2360563534 --> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x5573aafad320 con 0x5573ab042fa0 2024-09-15T23:22:49.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.927+0000 7f625effd640 1 --2- 172.21.15.123:0/2360563534 >> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] conn(0x5573ab042fa0 0x5573ab043380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:49.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.928+0000 7f623e7fc640 10 client.10305 ms_handle_connect on v2:172.21.15.123:6834/3239002092 2024-09-15T23:22:49.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.928+0000 7f625effd640 1 --2- 172.21.15.123:0/2360563534 >> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] conn(0x5573ab042fa0 0x5573ab043380 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.10062 client_cookie=da3d9c231cb8bd1d server_cookie=ee2eb2923ee41aa7 in_seq=0 out_seq=0 2024-09-15T23:22:49.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.928+0000 7f623e7fc640 1 -- 172.21.15.123:0/2360563534 <== mds.10062 v2:172.21.15.123:6834/3239002092 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x5573aafad320 con 0x5573ab042fa0 2024-09-15T23:22:49.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.928+0000 7f623e7fc640 10 client.10305 handle_command_reply: tid=0 2024-09-15T23:22:49.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.928+0000 7f6268bd9740 1 client.10305 shutdown 2024-09-15T23:22:49.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.928+0000 7f6268bd9740 1 -- 172.21.15.123:0/2360563534 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5573ab083b90 msgr2=0x5573ab087800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:49.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.928+0000 7f6268bd9740 1 --2- 172.21.15.123:0/2360563534 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5573ab083b90 0x5573ab087800 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7f625003b040 tx=0x7f625000a000 comp rx=0 tx=0).stop 2024-09-15T23:22:49.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.928+0000 7f6268bd9740 1 -- 172.21.15.123:0/2360563534 shutdown_connections 2024-09-15T23:22:49.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.928+0000 7f6268bd9740 1 --2- 172.21.15.123:0/2360563534 >> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] conn(0x5573ab042fa0 0x5573ab043380 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.928+0000 7f6268bd9740 1 --2- 172.21.15.123:0/2360563534 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5573ab089800 0x5573ab042a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.928+0000 7f6268bd9740 1 --2- 172.21.15.123:0/2360563534 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5573ab087420 0x5573ab087d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.928+0000 7f623e7fc640 0 client.10305 ms_handle_reset on v2:172.21.15.123:6834/3239002092 2024-09-15T23:22:49.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.928+0000 7f6268bd9740 1 --2- 172.21.15.123:0/2360563534 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5573ab083b90 0x5573ab087800 unknown :-1 s=CLOSED pgs=2140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:49.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.928+0000 7f6268bd9740 1 -- 172.21.15.123:0/2360563534 >> 172.21.15.123:0/2360563534 conn(0x5573ab086fc0 msgr2=0x5573ab082900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:49.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.928+0000 7f6268bd9740 1 -- 172.21.15.123:0/2360563534 shutdown_connections 2024-09-15T23:22:49.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.928+0000 7f6268bd9740 1 -- 172.21.15.123:0/2360563534 wait complete. 2024-09-15T23:22:49.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:49.928+0000 7f6268bd9740 20 client.10305 trim_cache size 0 max 16384 2024-09-15T23:22:49.937 INFO:teuthology.orchestra.run.smithi123.stderr:Error EINVAL: MDS is not active 2024-09-15T23:22:49.937 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c scrub abort 2024-09-15T23:22:50.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.036+0000 7f7cf48a6640 1 Processor -- start 2024-09-15T23:22:50.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.036+0000 7f7cf48a6640 1 -- start start 2024-09-15T23:22:50.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.036+0000 7f7cf48a6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7cf0155950 0x7f7cf0073600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.036+0000 7f7cf48a6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7cf0162c80 0x7f7cf006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.036+0000 7f7cf48a6640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cf0073cc0 con 0x7f7cf006c150 2024-09-15T23:22:50.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.036+0000 7f7cf48a6640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f7cf0070370 con 0x7f7cf0162c80 2024-09-15T23:22:50.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.037+0000 7f7cf48a6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f7cf0071aa0 con 0x7f7cf0155950 2024-09-15T23:22:50.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.037+0000 7f7ce7fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7cf0162c80 0x7f7cf006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.037+0000 7f7ceed9d640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7cf006c150 0x7f7cf00afb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:45276/0 (socket says 172.21.15.123:45276) 2024-09-15T23:22:50.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.037+0000 7f7ce7fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7cf0162c80 0x7f7cf006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59276/0 (socket says 172.21.15.123:59276) 2024-09-15T23:22:50.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.037+0000 7f7ceed9d640 1 -- 172.21.15.123:0/1876843651 learned_addr learned my addr 172.21.15.123:0/1876843651 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:50.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.037+0000 7f7cee59c640 1 --2- 172.21.15.123:0/1876843651 >> v2:172.21.15.188:3300/0 conn(0x7f7cf0155950 0x7f7cf0073600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.037+0000 7f7ce7fff640 1 -- 172.21.15.123:0/1876843651 >> v2:172.21.15.188:3300/0 conn(0x7f7cf0155950 msgr2=0x7f7cf0073600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:50.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.037+0000 7f7ce7fff640 1 --2- 172.21.15.123:0/1876843651 >> v2:172.21.15.188:3300/0 conn(0x7f7cf0155950 0x7f7cf0073600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.037+0000 7f7ce7fff640 1 -- 172.21.15.123:0/1876843651 >> v1:172.21.15.123:6789/0 conn(0x7f7cf006c150 legacy=0x7f7cf00afb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:50.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.037+0000 7f7cedd9b640 1 -- 172.21.15.123:0/1876843651 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 369015708 0 0) 0x7f7cf0073cc0 con 0x7f7cf006c150 2024-09-15T23:22:50.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.037+0000 7f7ce7fff640 1 -- 172.21.15.123:0/1876843651 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf0071d80 con 0x7f7cf0162c80 2024-09-15T23:22:50.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.038+0000 7f7ce7fff640 1 --2- 172.21.15.123:0/1876843651 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7cf0162c80 0x7f7cf006bc10 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7f7cf006d830 tx=0x7f7cd802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da3fd2bfbf71ff6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:50.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.038+0000 7f7cedd9b640 1 -- 172.21.15.123:0/1876843651 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8037070 con 0x7f7cf0162c80 2024-09-15T23:22:50.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.038+0000 7f7cedd9b640 1 -- 172.21.15.123:0/1876843651 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cd8032440 con 0x7f7cf0162c80 2024-09-15T23:22:50.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.038+0000 7f7cedd9b640 1 -- 172.21.15.123:0/1876843651 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8032810 con 0x7f7cf0162c80 2024-09-15T23:22:50.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.038+0000 7f7cf48a6640 1 -- 172.21.15.123:0/1876843651 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7cf0162c80 msgr2=0x7f7cf006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:50.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.038+0000 7f7cf48a6640 1 --2- 172.21.15.123:0/1876843651 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7cf0162c80 0x7f7cf006bc10 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7f7cf006d830 tx=0x7f7cd802a1a0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.038+0000 7f7cf48a6640 1 -- 172.21.15.123:0/1876843651 shutdown_connections 2024-09-15T23:22:50.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.038+0000 7f7cf48a6640 1 --2- 172.21.15.123:0/1876843651 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7cf0162c80 0x7f7cf006bc10 unknown :-1 s=CLOSED pgs=2142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.038+0000 7f7cf48a6640 1 --2- 172.21.15.123:0/1876843651 >> v2:172.21.15.188:3300/0 conn(0x7f7cf0155950 0x7f7cf0073600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.038+0000 7f7cf48a6640 1 -- 172.21.15.123:0/1876843651 >> 172.21.15.123:0/1876843651 conn(0x7f7cf006db30 msgr2=0x7f7cf006df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:50.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.039+0000 7f7cf48a6640 1 -- 172.21.15.123:0/1876843651 shutdown_connections 2024-09-15T23:22:50.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.039+0000 7f7cf48a6640 1 -- 172.21.15.123:0/1876843651 wait complete. 2024-09-15T23:22:50.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.040+0000 7f7cf48a6640 1 Processor -- start 2024-09-15T23:22:50.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.040+0000 7f7cf48a6640 1 -- start start 2024-09-15T23:22:50.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.041+0000 7f7cf48a6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7cf006c150 0x7f7cf00ce270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.041+0000 7f7cf48a6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7cf0162c80 0x7f7cf00ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.041+0000 7f7cf48a6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7cf00cf560 0x7f7cf00cfa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.041+0000 7f7cf48a6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf00721e0 con 0x7f7cf00cf560 2024-09-15T23:22:50.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.041+0000 7f7cf48a6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf0072060 con 0x7f7cf006c150 2024-09-15T23:22:50.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.041+0000 7f7cf48a6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7cf00b0230 con 0x7f7cf0162c80 2024-09-15T23:22:50.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.041+0000 7f7ceed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7cf00cf560 0x7f7cf00cfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.041+0000 7f7ceed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7cf00cf560 0x7f7cf00cfa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59284/0 (socket says 172.21.15.123:59284) 2024-09-15T23:22:50.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.041+0000 7f7ceed9d640 1 -- 172.21.15.123:0/4011396761 learned_addr learned my addr 172.21.15.123:0/4011396761 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:50.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.041+0000 7f7cee59c640 1 --2- 172.21.15.123:0/4011396761 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7cf006c150 0x7f7cf00ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.041+0000 7f7ce7fff640 1 --2- 172.21.15.123:0/4011396761 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7cf0162c80 0x7f7cf00ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.041+0000 7f7ceed9d640 1 -- 172.21.15.123:0/4011396761 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7cf0162c80 msgr2=0x7f7cf00ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:50.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.041+0000 7f7ceed9d640 1 --2- 172.21.15.123:0/4011396761 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7cf0162c80 0x7f7cf00ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.041+0000 7f7ceed9d640 1 -- 172.21.15.123:0/4011396761 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7cf006c150 msgr2=0x7f7cf00ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:50.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.041+0000 7f7ceed9d640 1 --2- 172.21.15.123:0/4011396761 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7cf006c150 0x7f7cf00ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.041+0000 7f7ceed9d640 1 -- 172.21.15.123:0/4011396761 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf0155de0 con 0x7f7cf00cf560 2024-09-15T23:22:50.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.041+0000 7f7ceed9d640 1 --2- 172.21.15.123:0/4011396761 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7cf00cf560 0x7f7cf00cfa10 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800c780 tx=0x7f7ce800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:50.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.041+0000 7f7ce6ffd640 1 -- 172.21.15.123:0/4011396761 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8018070 con 0x7f7cf00cf560 2024-09-15T23:22:50.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.041+0000 7f7ce6ffd640 1 -- 172.21.15.123:0/4011396761 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ce800a640 con 0x7f7cf00cf560 2024-09-15T23:22:50.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.041+0000 7f7ce6ffd640 1 -- 172.21.15.123:0/4011396761 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce800aa70 con 0x7f7cf00cf560 2024-09-15T23:22:50.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.041+0000 7f7cf48a6640 1 -- 172.21.15.123:0/4011396761 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cf00cecf0 con 0x7f7cf00cf560 2024-09-15T23:22:50.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.041+0000 7f7cf48a6640 1 -- 172.21.15.123:0/4011396761 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cf0156050 con 0x7f7cf00cf560 2024-09-15T23:22:50.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.043+0000 7f7ce6ffd640 1 -- 172.21.15.123:0/4011396761 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7ce801b070 con 0x7f7cf00cf560 2024-09-15T23:22:50.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.043+0000 7f7ce6ffd640 1 --2- 172.21.15.123:0/4011396761 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7cd006c2e0 0x7f7cd006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.043+0000 7f7ce6ffd640 1 -- 172.21.15.123:0/4011396761 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f7ce808aa30 con 0x7f7cf00cf560 2024-09-15T23:22:50.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.044+0000 7f7cee59c640 1 --2- 172.21.15.123:0/4011396761 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7cd006c2e0 0x7f7cd006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.044+0000 7f7cee59c640 1 --2- 172.21.15.123:0/4011396761 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7cd006c2e0 0x7f7cd006e7a0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0006fd0 tx=0x7f7ce0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:50.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.044+0000 7f7cf763b740 1 Processor -- start 2024-09-15T23:22:50.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.044+0000 7f7cf763b740 1 -- start start 2024-09-15T23:22:50.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.045+0000 7f7cf763b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5594a2357800 0x5594a2357be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.045+0000 7f7cf763b740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5594a2354fc0 0x5594a2356b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.045+0000 7f7cf763b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5594a2355420 0x5594a2337780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.045+0000 7f7cf763b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5594a22738a0 con 0x5594a2355420 2024-09-15T23:22:50.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.045+0000 7f7cf763b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5594a221b5f0 con 0x5594a2357800 2024-09-15T23:22:50.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.045+0000 7f7cf763b740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5594a226f860 con 0x5594a2354fc0 2024-09-15T23:22:50.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.045+0000 7f7ceed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5594a2355420 0x5594a2337780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.045+0000 7f7ceed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5594a2355420 0x5594a2337780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59300/0 (socket says 172.21.15.123:59300) 2024-09-15T23:22:50.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.045+0000 7f7ceed9d640 1 -- 172.21.15.123:0/3284254472 learned_addr learned my addr 172.21.15.123:0/3284254472 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:50.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.045+0000 7f7ce7fff640 1 --2- 172.21.15.123:0/3284254472 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5594a2354fc0 0x5594a2356b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.045+0000 7f7cee59c640 1 --2- 172.21.15.123:0/3284254472 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5594a2357800 0x5594a2357be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.045+0000 7f7ceed9d640 1 -- 172.21.15.123:0/3284254472 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5594a2354fc0 msgr2=0x5594a2356b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:50.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.045+0000 7f7ceed9d640 1 --2- 172.21.15.123:0/3284254472 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5594a2354fc0 0x5594a2356b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.045+0000 7f7ceed9d640 1 -- 172.21.15.123:0/3284254472 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5594a2357800 msgr2=0x5594a2357be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:50.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.045+0000 7f7ceed9d640 1 --2- 172.21.15.123:0/3284254472 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5594a2357800 0x5594a2357be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.045+0000 7f7ceed9d640 1 -- 172.21.15.123:0/3284254472 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594a1f6a120 con 0x5594a2355420 2024-09-15T23:22:50.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.046+0000 7f7ceed9d640 1 --2- 172.21.15.123:0/3284254472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5594a2355420 0x5594a2337780 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8054e70 tx=0x7f7ce800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed6ca7c03b43832c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:50.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.046+0000 7f7ccffff640 1 -- 172.21.15.123:0/3284254472 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8061680 con 0x5594a2355420 2024-09-15T23:22:50.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.046+0000 7f7ccffff640 1 -- 172.21.15.123:0/3284254472 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ce8056d10 con 0x5594a2355420 2024-09-15T23:22:50.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.046+0000 7f7ccffff640 1 -- 172.21.15.123:0/3284254472 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce80611f0 con 0x5594a2355420 2024-09-15T23:22:50.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.046+0000 7f7cf763b740 1 -- 172.21.15.123:0/3284254472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5594a2355420 msgr2=0x5594a2337780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:50.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.046+0000 7f7cf763b740 1 --2- 172.21.15.123:0/3284254472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5594a2355420 0x5594a2337780 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8054e70 tx=0x7f7ce800cf90 comp rx=0 tx=0).stop 2024-09-15T23:22:50.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.046+0000 7f7cf763b740 1 -- 172.21.15.123:0/3284254472 shutdown_connections 2024-09-15T23:22:50.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.046+0000 7f7cf763b740 1 --2- 172.21.15.123:0/3284254472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5594a2355420 0x5594a2337780 unknown :-1 s=CLOSED pgs=2144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.046+0000 7f7cf763b740 1 --2- 172.21.15.123:0/3284254472 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5594a2354fc0 0x5594a2356b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.046+0000 7f7cf763b740 1 --2- 172.21.15.123:0/3284254472 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5594a2357800 0x5594a2357be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.047+0000 7f7cf763b740 1 -- 172.21.15.123:0/3284254472 >> 172.21.15.123:0/3284254472 conn(0x5594a230d6f0 msgr2=0x5594a2355870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:50.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.047+0000 7f7cf763b740 1 -- 172.21.15.123:0/3284254472 shutdown_connections 2024-09-15T23:22:50.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.047+0000 7f7cf763b740 1 -- 172.21.15.123:0/3284254472 wait complete. 2024-09-15T23:22:50.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.047+0000 7f7cf763b740 1 -- start start 2024-09-15T23:22:50.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.047+0000 7f7cf763b740 1 Processor -- start 2024-09-15T23:22:50.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.048+0000 7f7cf763b740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5594a2355420 0x5594a2334ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.048+0000 7f7cf763b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5594a2357800 0x5594a2310ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.048+0000 7f7cf763b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5594a233b430 0x5594a2311430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.048+0000 7f7cf763b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5594a2353f20 con 0x5594a2357800 2024-09-15T23:22:50.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.048+0000 7f7cf763b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5594a21fc3f0 con 0x5594a233b430 2024-09-15T23:22:50.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.048+0000 7f7cf763b740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5594a2354200 con 0x5594a2355420 2024-09-15T23:22:50.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.048+0000 7f7cf763b740 10 client.0 _ll_register_callbacks cb 0x5594a1f85910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:22:50.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.048+0000 7f7ce7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5594a2357800 0x5594a2310ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.048+0000 7f7ce7fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5594a2357800 0x5594a2310ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59314/0 (socket says 172.21.15.123:59314) 2024-09-15T23:22:50.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.048+0000 7f7ce7fff640 1 -- 172.21.15.123:0/2473812901 learned_addr learned my addr 172.21.15.123:0/2473812901 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:50.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.048+0000 7f7cee59c640 1 --2- 172.21.15.123:0/2473812901 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5594a2355420 0x5594a2334ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.048+0000 7f7ceed9d640 1 --2- 172.21.15.123:0/2473812901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5594a233b430 0x5594a2311430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.049+0000 7f7ce7fff640 1 -- 172.21.15.123:0/2473812901 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5594a2355420 msgr2=0x5594a2334ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:50.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.049+0000 7f7ce7fff640 1 --2- 172.21.15.123:0/2473812901 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5594a2355420 0x5594a2334ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.049+0000 7f7ce7fff640 1 -- 172.21.15.123:0/2473812901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5594a233b430 msgr2=0x5594a2311430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:50.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.049+0000 7f7ce7fff640 1 --2- 172.21.15.123:0/2473812901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5594a233b430 0x5594a2311430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.049+0000 7f7ce7fff640 1 -- 172.21.15.123:0/2473812901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594a2050500 con 0x5594a2357800 2024-09-15T23:22:50.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.049+0000 7f7ce7fff640 1 --2- 172.21.15.123:0/2473812901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5594a2357800 0x5594a2310ef0 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8009890 tx=0x7f7cd8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d159909958e5c01a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:50.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.049+0000 7f7ccd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:22:50.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.049+0000 7f7ccd7fa640 1 -- 172.21.15.123:0/2473812901 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8041030 con 0x5594a2357800 2024-09-15T23:22:50.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.049+0000 7f7cf763b740 1 -- 172.21.15.123:0/2473812901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ce8056d10 con 0x5594a2357800 2024-09-15T23:22:50.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.049+0000 7f7ccd7fa640 1 -- 172.21.15.123:0/2473812901 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f7cd80328d0 con 0x5594a2357800 2024-09-15T23:22:50.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.049+0000 7f7ccd7fa640 1 -- 172.21.15.123:0/2473812901 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) ==== 24+0+0 (secure 0 0 0) 0x7f7cd804d050 con 0x5594a2357800 2024-09-15T23:22:50.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.049+0000 7f7cf763b740 10 client.10320 fetch_fsmap learned FSMap version 113 2024-09-15T23:22:50.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.049+0000 7f7cf763b740 1 -- 172.21.15.123:0/2473812901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) -- 0x5594a20b0c90 con 0x5594a2357800 2024-09-15T23:22:50.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.049+0000 7f7ccd7fa640 1 -- 172.21.15.123:0/2473812901 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ce8056d10 con 0x5594a2357800 2024-09-15T23:22:50.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.049+0000 7f7ccd7fa640 1 -- 172.21.15.123:0/2473812901 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 113) ==== 3490+0+0 (secure 0 0 0) 0x7f7cd8050020 con 0x5594a2357800 2024-09-15T23:22:50.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.049+0000 7f7cf763b740 10 client.10320 fetch_fsmap finished waiting for FSMap version 113 2024-09-15T23:22:50.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.049+0000 7f7cf763b740 10 client.10320 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T23:22:50.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.049+0000 7f7cf763b740 20 client.10320 populate_metadata read hostname 'smithi123' 2024-09-15T23:22:50.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.049+0000 7f7cf763b740 1 --2- 172.21.15.123:0/2473812901 >> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] conn(0x5594a2369890 0x5594a2338e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.049+0000 7f7cf763b740 4 client.10320 mds_command: new command op to 10062 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:22:50.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.049+0000 7f7cf763b740 1 -- 172.21.15.123:0/2473812901 --> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5594a2280fd0 con 0x5594a2369890 2024-09-15T23:22:50.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.049+0000 7f7cee59c640 1 --2- 172.21.15.123:0/2473812901 >> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] conn(0x5594a2369890 0x5594a2338e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.050+0000 7f7ccd7fa640 10 client.10320 ms_handle_connect on v2:172.21.15.123:6834/3239002092 2024-09-15T23:22:50.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.050+0000 7f7cee59c640 1 --2- 172.21.15.123:0/2473812901 >> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] conn(0x5594a2369890 0x5594a2338e70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.10062 client_cookie=853644c4c6e2c27c server_cookie=f3d87abcc365fde5 in_seq=0 out_seq=0 2024-09-15T23:22:50.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.050+0000 7f7ccd7fa640 1 -- 172.21.15.123:0/2473812901 <== mds.10062 v2:172.21.15.123:6834/3239002092 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5594a2280fd0 con 0x5594a2369890 2024-09-15T23:22:50.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.050+0000 7f7ccd7fa640 10 client.10320 handle_command_reply: tid=0 2024-09-15T23:22:50.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.050+0000 7f7cf763b740 1 client.10320 shutdown 2024-09-15T23:22:50.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.050+0000 7f7cf763b740 1 -- 172.21.15.123:0/2473812901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5594a2357800 msgr2=0x5594a2310ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:50.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.050+0000 7f7cf763b740 1 --2- 172.21.15.123:0/2473812901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5594a2357800 0x5594a2310ef0 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8009890 tx=0x7f7cd8004730 comp rx=0 tx=0).stop 2024-09-15T23:22:50.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.051+0000 7f7cf763b740 1 -- 172.21.15.123:0/2473812901 shutdown_connections 2024-09-15T23:22:50.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.051+0000 7f7cf763b740 1 --2- 172.21.15.123:0/2473812901 >> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] conn(0x5594a2369890 0x5594a2338e70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.051+0000 7f7cf763b740 1 --2- 172.21.15.123:0/2473812901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5594a233b430 0x5594a2311430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.051+0000 7f7cf763b740 1 --2- 172.21.15.123:0/2473812901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5594a2357800 0x5594a2310ef0 unknown :-1 s=CLOSED pgs=2145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.051+0000 7f7cf763b740 1 --2- 172.21.15.123:0/2473812901 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5594a2355420 0x5594a2334ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.051+0000 7f7ccd7fa640 0 client.10320 ms_handle_reset on v2:172.21.15.123:6834/3239002092 2024-09-15T23:22:50.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.051+0000 7f7cf763b740 1 -- 172.21.15.123:0/2473812901 >> 172.21.15.123:0/2473812901 conn(0x5594a2354fc0 msgr2=0x5594a2337d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:50.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.051+0000 7f7cf763b740 1 -- 172.21.15.123:0/2473812901 shutdown_connections 2024-09-15T23:22:50.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.051+0000 7f7cf763b740 1 -- 172.21.15.123:0/2473812901 wait complete. 2024-09-15T23:22:50.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.051+0000 7f7cf763b740 20 client.10320 trim_cache size 0 max 16384 2024-09-15T23:22:50.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.067+0000 7f7cf763b740 1 Processor -- start 2024-09-15T23:22:50.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.067+0000 7f7cf763b740 1 -- start start 2024-09-15T23:22:50.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.068+0000 7f7cf763b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5594a233b430 0x5594a2331b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.068+0000 7f7cf763b740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5594a2355420 0x5594a2379cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.068+0000 7f7cf763b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5594a2357800 0x5594a234dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.068+0000 7f7cf763b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf02009f0 con 0x5594a233b430 2024-09-15T23:22:50.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.068+0000 7f7cf763b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf01fee40 con 0x5594a2357800 2024-09-15T23:22:50.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.068+0000 7f7cf763b740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7cf01ff460 con 0x5594a2355420 2024-09-15T23:22:50.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.068+0000 7f7cee59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5594a233b430 0x5594a2331b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.068+0000 7f7cee59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5594a233b430 0x5594a2331b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59320/0 (socket says 172.21.15.123:59320) 2024-09-15T23:22:50.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.068+0000 7f7cee59c640 1 -- 172.21.15.123:0/3434093065 learned_addr learned my addr 172.21.15.123:0/3434093065 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:50.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.068+0000 7f7cee59c640 1 -- 172.21.15.123:0/3434093065 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5594a2355420 msgr2=0x5594a2379cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:50.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.068+0000 7f7cee59c640 1 --2- 172.21.15.123:0/3434093065 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5594a2355420 0x5594a2379cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.068+0000 7f7cee59c640 1 -- 172.21.15.123:0/3434093065 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5594a2357800 msgr2=0x5594a234dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:50.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.068+0000 7f7ceed9d640 1 --2- 172.21.15.123:0/3434093065 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5594a2357800 0x5594a234dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.069+0000 7f7cee59c640 1 --2- 172.21.15.123:0/3434093065 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5594a2357800 0x5594a234dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.069+0000 7f7cee59c640 1 -- 172.21.15.123:0/3434093065 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594a1f45e20 con 0x5594a233b430 2024-09-15T23:22:50.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.069+0000 7f7ceed9d640 1 --2- 172.21.15.123:0/3434093065 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5594a2357800 0x5594a234dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:22:50.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.069+0000 7f7cee59c640 1 --2- 172.21.15.123:0/3434093065 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5594a233b430 0x5594a2331b80 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000fc30 tx=0x7f7ce0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d30d8690ee6366 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:50.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.069+0000 7f7ccf7fe640 1 -- 172.21.15.123:0/3434093065 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0030070 con 0x5594a233b430 2024-09-15T23:22:50.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.069+0000 7f7ccf7fe640 1 -- 172.21.15.123:0/3434093065 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ce001c040 con 0x5594a233b430 2024-09-15T23:22:50.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.069+0000 7f7ccf7fe640 1 -- 172.21.15.123:0/3434093065 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce001b070 con 0x5594a233b430 2024-09-15T23:22:50.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.069+0000 7f7cf763b740 1 -- 172.21.15.123:0/3434093065 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5594a233b430 msgr2=0x5594a2331b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:50.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.069+0000 7f7cf763b740 1 --2- 172.21.15.123:0/3434093065 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5594a233b430 0x5594a2331b80 secure :-1 s=READY pgs=2146 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000fc30 tx=0x7f7ce0015000 comp rx=0 tx=0).stop 2024-09-15T23:22:50.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.069+0000 7f7cf763b740 1 -- 172.21.15.123:0/3434093065 shutdown_connections 2024-09-15T23:22:50.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.069+0000 7f7cf763b740 1 --2- 172.21.15.123:0/3434093065 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5594a2357800 0x5594a234dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.069+0000 7f7cf763b740 1 --2- 172.21.15.123:0/3434093065 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5594a2355420 0x5594a2379cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.069+0000 7f7cf763b740 1 --2- 172.21.15.123:0/3434093065 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5594a233b430 0x5594a2331b80 unknown :-1 s=CLOSED pgs=2146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.069+0000 7f7cf763b740 1 -- 172.21.15.123:0/3434093065 >> 172.21.15.123:0/3434093065 conn(0x5594a2354fc0 msgr2=0x5594a233a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:50.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.069+0000 7f7cf763b740 1 -- 172.21.15.123:0/3434093065 shutdown_connections 2024-09-15T23:22:50.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.069+0000 7f7cf763b740 1 -- 172.21.15.123:0/3434093065 wait complete. 2024-09-15T23:22:50.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.070+0000 7f7cf763b740 1 -- start start 2024-09-15T23:22:50.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.070+0000 7f7cf763b740 1 Processor -- start 2024-09-15T23:22:50.078 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T23:22:50.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.071+0000 7f7cf763b740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5594a233b430 0x5594a2378e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.071+0000 7f7cf763b740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5594a2355420 0x5594a234dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.071+0000 7f7cf763b740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5594a2357800 0x5594a23d3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.071+0000 7f7cf763b740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5594a2369710 con 0x5594a2357800 2024-09-15T23:22:50.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.071+0000 7f7cf763b740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5594a234ecf0 con 0x5594a233b430 2024-09-15T23:22:50.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.071+0000 7f7cf763b740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5594a2369d30 con 0x5594a2355420 2024-09-15T23:22:50.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.071+0000 7f7cf763b740 10 client.0 _ll_register_callbacks cb 0x7f7cd8035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:22:50.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.071+0000 7f7ceed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5594a2357800 0x5594a23d3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.071+0000 7f7ceed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5594a2357800 0x5594a23d3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59336/0 (socket says 172.21.15.123:59336) 2024-09-15T23:22:50.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.071+0000 7f7ceed9d640 1 -- 172.21.15.123:0/1058654357 learned_addr learned my addr 172.21.15.123:0/1058654357 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:50.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.071+0000 7f7ce7fff640 1 --2- 172.21.15.123:0/1058654357 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5594a2355420 0x5594a234dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.071+0000 7f7cee59c640 1 --2- 172.21.15.123:0/1058654357 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5594a233b430 0x5594a2378e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.071+0000 7f7ceed9d640 1 -- 172.21.15.123:0/1058654357 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5594a2355420 msgr2=0x5594a234dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:50.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.071+0000 7f7ceed9d640 1 --2- 172.21.15.123:0/1058654357 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5594a2355420 0x5594a234dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.071+0000 7f7ceed9d640 1 -- 172.21.15.123:0/1058654357 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5594a233b430 msgr2=0x5594a2378e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:50.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.071+0000 7f7ceed9d640 1 --2- 172.21.15.123:0/1058654357 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5594a233b430 0x5594a2378e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.071+0000 7f7ceed9d640 1 -- 172.21.15.123:0/1058654357 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594a2339d20 con 0x5594a2357800 2024-09-15T23:22:50.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.071+0000 7f7ce7fff640 1 --2- 172.21.15.123:0/1058654357 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5594a2355420 0x5594a234dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:50.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.071+0000 7f7ceed9d640 1 --2- 172.21.15.123:0/1058654357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5594a2357800 0x5594a23d3fb0 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8058710 tx=0x7f7ce8001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0fdbfd4428697ca server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:50.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.071+0000 7f7ccd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:22:50.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.072+0000 7f7ccd7fa640 1 -- 172.21.15.123:0/1058654357 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8075070 con 0x5594a2357800 2024-09-15T23:22:50.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.072+0000 7f7ccd7fa640 1 -- 172.21.15.123:0/1058654357 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f7ce80613f0 con 0x5594a2357800 2024-09-15T23:22:50.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.072+0000 7f7cf763b740 1 -- 172.21.15.123:0/1058654357 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ce001c040 con 0x5594a2357800 2024-09-15T23:22:50.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.072+0000 7f7ccd7fa640 1 -- 172.21.15.123:0/1058654357 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) ==== 24+0+0 (secure 0 0 0) 0x7f7ce807f050 con 0x5594a2357800 2024-09-15T23:22:50.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.072+0000 7f7cf763b740 10 client.10326 fetch_fsmap learned FSMap version 113 2024-09-15T23:22:50.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.072+0000 7f7cf763b740 1 -- 172.21.15.123:0/1058654357 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) -- 0x5594a234e190 con 0x5594a2357800 2024-09-15T23:22:50.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.072+0000 7f7ccd7fa640 1 -- 172.21.15.123:0/1058654357 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ce001c040 con 0x5594a2357800 2024-09-15T23:22:50.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.072+0000 7f7ccd7fa640 1 -- 172.21.15.123:0/1058654357 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 113) ==== 3490+0+0 (secure 0 0 0) 0x7f7ce8082020 con 0x5594a2357800 2024-09-15T23:22:50.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.072+0000 7f7cf763b740 10 client.10326 fetch_fsmap finished waiting for FSMap version 113 2024-09-15T23:22:50.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.072+0000 7f7cf763b740 10 client.10326 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T23:22:50.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.072+0000 7f7cf763b740 20 client.10326 populate_metadata read hostname 'smithi123' 2024-09-15T23:22:50.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.072+0000 7f7cf763b740 1 --2- 172.21.15.123:0/1058654357 >> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] conn(0x5594a2337ee0 0x5594a23382c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.072+0000 7f7cf763b740 4 client.10326 mds_command: new command op to 10062 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-09-15T23:22:50.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.072+0000 7f7cf763b740 1 -- 172.21.15.123:0/1058654357 --> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] -- command(tid 0: {"prefix": "scrub abort"}) -- 0x5594a227b320 con 0x5594a2337ee0 2024-09-15T23:22:50.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.072+0000 7f7cee59c640 1 --2- 172.21.15.123:0/1058654357 >> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] conn(0x5594a2337ee0 0x5594a23382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.072+0000 7f7ccd7fa640 10 client.10326 ms_handle_connect on v2:172.21.15.123:6834/3239002092 2024-09-15T23:22:50.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.072+0000 7f7cee59c640 1 --2- 172.21.15.123:0/1058654357 >> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] conn(0x5594a2337ee0 0x5594a23382c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.10062 client_cookie=afbacd50e3128ddc server_cookie=e4481b92e2f7ac3 in_seq=0 out_seq=0 2024-09-15T23:22:50.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.073+0000 7f7ccd7fa640 1 -- 172.21.15.123:0/1058654357 <== mds.10062 v2:172.21.15.123:6834/3239002092 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x5594a227b320 con 0x5594a2337ee0 2024-09-15T23:22:50.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.073+0000 7f7ccd7fa640 10 client.10326 handle_command_reply: tid=0 2024-09-15T23:22:50.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.073+0000 7f7cf763b740 1 client.10326 shutdown 2024-09-15T23:22:50.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.073+0000 7f7cf763b740 1 -- 172.21.15.123:0/1058654357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5594a2357800 msgr2=0x5594a23d3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:50.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.073+0000 7f7cf763b740 1 --2- 172.21.15.123:0/1058654357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5594a2357800 0x5594a23d3fb0 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8058710 tx=0x7f7ce8001250 comp rx=0 tx=0).stop 2024-09-15T23:22:50.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.073+0000 7f7cf763b740 1 -- 172.21.15.123:0/1058654357 shutdown_connections 2024-09-15T23:22:50.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.073+0000 7f7cf763b740 1 --2- 172.21.15.123:0/1058654357 >> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] conn(0x5594a2337ee0 0x5594a23382c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.073+0000 7f7cf763b740 1 --2- 172.21.15.123:0/1058654357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5594a2357800 0x5594a23d3fb0 unknown :-1 s=CLOSED pgs=2147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.073+0000 7f7cf763b740 1 --2- 172.21.15.123:0/1058654357 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5594a2355420 0x5594a234dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.073+0000 7f7cf763b740 1 --2- 172.21.15.123:0/1058654357 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5594a233b430 0x5594a2378e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.073+0000 7f7ccd7fa640 0 client.10326 ms_handle_reset on v2:172.21.15.123:6834/3239002092 2024-09-15T23:22:50.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.073+0000 7f7cf763b740 1 -- 172.21.15.123:0/1058654357 >> 172.21.15.123:0/1058654357 conn(0x5594a2354fc0 msgr2=0x5594a2334640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:50.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.073+0000 7f7cf763b740 1 -- 172.21.15.123:0/1058654357 shutdown_connections 2024-09-15T23:22:50.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.073+0000 7f7cf763b740 1 -- 172.21.15.123:0/1058654357 wait complete. 2024-09-15T23:22:50.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.073+0000 7f7cf763b740 20 client.10326 trim_cache size 0 max 16384 2024-09-15T23:22:50.082 INFO:teuthology.orchestra.run.smithi123.stderr:Error EINVAL: MDS is not active 2024-09-15T23:22:50.083 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c scrub resume 2024-09-15T23:22:50.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.182+0000 7ff3f5766640 1 Processor -- start 2024-09-15T23:22:50.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.182+0000 7ff3f5766640 1 -- start start 2024-09-15T23:22:50.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.183+0000 7ff3f5766640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff3f0153550 0x7ff3f015d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.183+0000 7ff3f5766640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff3f00b3e80 0x7ff3f00b58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.183+0000 7ff3f5766640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff3f00b53b0 0x7ff3f00b5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.183+0000 7ff3f5766640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7ff3f00b4310 con 0x7ff3f00b53b0 2024-09-15T23:22:50.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.183+0000 7ff3f5766640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7ff3f00b45f0 con 0x7ff3f0153550 2024-09-15T23:22:50.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.183+0000 7ff3f5766640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ff3f00b48d0 con 0x7ff3f00b3e80 2024-09-15T23:22:50.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.183+0000 7ff3ef7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff3f00b53b0 0x7ff3f00b5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.183+0000 7ff3ef7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff3f00b53b0 0x7ff3f00b5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59350/0 (socket says 172.21.15.123:59350) 2024-09-15T23:22:50.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.183+0000 7ff3ef7fe640 1 -- 172.21.15.123:0/2526085012 learned_addr learned my addr 172.21.15.123:0/2526085012 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:50.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.183+0000 7ff3eeffd640 1 --2- 172.21.15.123:0/2526085012 >> v2:172.21.15.188:3300/0 conn(0x7ff3f0153550 0x7ff3f015d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.183+0000 7ff3ee7fc640 1 --2- 172.21.15.123:0/2526085012 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff3f00b3e80 0x7ff3f00b58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.183+0000 7ff3ef7fe640 1 -- 172.21.15.123:0/2526085012 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff3f00b3e80 msgr2=0x7ff3f00b58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:50.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.183+0000 7ff3ef7fe640 1 --2- 172.21.15.123:0/2526085012 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff3f00b3e80 0x7ff3f00b58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.183+0000 7ff3ef7fe640 1 -- 172.21.15.123:0/2526085012 >> v2:172.21.15.188:3300/0 conn(0x7ff3f0153550 msgr2=0x7ff3f015d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:50.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.183+0000 7ff3ef7fe640 1 --2- 172.21.15.123:0/2526085012 >> v2:172.21.15.188:3300/0 conn(0x7ff3f0153550 0x7ff3f015d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.183+0000 7ff3ef7fe640 1 -- 172.21.15.123:0/2526085012 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f00b4bb0 con 0x7ff3f00b53b0 2024-09-15T23:22:50.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.183+0000 7ff3eeffd640 1 --2- 172.21.15.123:0/2526085012 >> v2:172.21.15.188:3300/0 conn(0x7ff3f0153550 0x7ff3f015d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:50.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.184+0000 7ff3ef7fe640 1 --2- 172.21.15.123:0/2526085012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3f00b53b0 0x7ff3f00b5df0 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7ff3f006d830 tx=0x7ff3e802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac0b378ef8aefa00 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:50.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.184+0000 7ff3edffb640 1 -- 172.21.15.123:0/2526085012 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8036070 con 0x7ff3f00b53b0 2024-09-15T23:22:50.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.184+0000 7ff3edffb640 1 -- 172.21.15.123:0/2526085012 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3e8031600 con 0x7ff3f00b53b0 2024-09-15T23:22:50.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.184+0000 7ff3edffb640 1 -- 172.21.15.123:0/2526085012 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e80319d0 con 0x7ff3f00b53b0 2024-09-15T23:22:50.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.185+0000 7ff3f5766640 1 -- 172.21.15.123:0/2526085012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3f00b53b0 msgr2=0x7ff3f00b5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:50.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.185+0000 7ff3f5766640 1 --2- 172.21.15.123:0/2526085012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3f00b53b0 0x7ff3f00b5df0 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7ff3f006d830 tx=0x7ff3e802a6a0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.185+0000 7ff3f5766640 1 -- 172.21.15.123:0/2526085012 shutdown_connections 2024-09-15T23:22:50.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.185+0000 7ff3f5766640 1 --2- 172.21.15.123:0/2526085012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3f00b53b0 0x7ff3f00b5df0 unknown :-1 s=CLOSED pgs=2148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.185+0000 7ff3f5766640 1 --2- 172.21.15.123:0/2526085012 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff3f00b3e80 0x7ff3f00b58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.185+0000 7ff3f5766640 1 --2- 172.21.15.123:0/2526085012 >> v2:172.21.15.188:3300/0 conn(0x7ff3f0153550 0x7ff3f015d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.185+0000 7ff3f5766640 1 -- 172.21.15.123:0/2526085012 >> 172.21.15.123:0/2526085012 conn(0x7ff3f006db30 msgr2=0x7ff3f006df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:50.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.185+0000 7ff3f5766640 1 -- 172.21.15.123:0/2526085012 shutdown_connections 2024-09-15T23:22:50.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.185+0000 7ff3f5766640 1 -- 172.21.15.123:0/2526085012 wait complete. 2024-09-15T23:22:50.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.186+0000 7ff3f5766640 1 Processor -- start 2024-09-15T23:22:50.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.186+0000 7ff3f5766640 1 -- start start 2024-09-15T23:22:50.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.187+0000 7ff3f5766640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff3f00b53b0 0x7ff3f0144920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.187+0000 7ff3f5766640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff3f0153550 0x7ff3f0160870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.187+0000 7ff3f5766640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3f0160db0 0x7ff3f0157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.187+0000 7ff3f5766640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f0070120 con 0x7ff3f0160db0 2024-09-15T23:22:50.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.187+0000 7ff3f5766640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f0153930 con 0x7ff3f00b53b0 2024-09-15T23:22:50.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.187+0000 7ff3f5766640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ff3f00cfe90 con 0x7ff3f0153550 2024-09-15T23:22:50.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.187+0000 7ff3ef7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3f0160db0 0x7ff3f0157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.187+0000 7ff3ef7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3f0160db0 0x7ff3f0157230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59362/0 (socket says 172.21.15.123:59362) 2024-09-15T23:22:50.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.187+0000 7ff3ef7fe640 1 -- 172.21.15.123:0/1826805175 learned_addr learned my addr 172.21.15.123:0/1826805175 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:50.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.187+0000 7ff3eeffd640 1 --2- 172.21.15.123:0/1826805175 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff3f00b53b0 0x7ff3f0144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.187+0000 7ff3ee7fc640 1 --2- 172.21.15.123:0/1826805175 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff3f0153550 0x7ff3f0160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.187+0000 7ff3ef7fe640 1 -- 172.21.15.123:0/1826805175 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff3f0153550 msgr2=0x7ff3f0160870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:50.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.187+0000 7ff3ef7fe640 1 --2- 172.21.15.123:0/1826805175 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff3f0153550 0x7ff3f0160870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.187+0000 7ff3ef7fe640 1 -- 172.21.15.123:0/1826805175 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff3f00b53b0 msgr2=0x7ff3f0144920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:50.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.187+0000 7ff3ef7fe640 1 --2- 172.21.15.123:0/1826805175 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff3f00b53b0 0x7ff3f0144920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.187+0000 7ff3ef7fe640 1 -- 172.21.15.123:0/1826805175 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f015f7d0 con 0x7ff3f0160db0 2024-09-15T23:22:50.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.187+0000 7ff3eeffd640 1 --2- 172.21.15.123:0/1826805175 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff3f00b53b0 0x7ff3f0144920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:50.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.187+0000 7ff3ef7fe640 1 --2- 172.21.15.123:0/1826805175 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3f0160db0 0x7ff3f0157230 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8009f40 tx=0x7ff3e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:50.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.187+0000 7ff3d77fe640 1 -- 172.21.15.123:0/1826805175 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8036050 con 0x7ff3f0160db0 2024-09-15T23:22:50.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.187+0000 7ff3d77fe640 1 -- 172.21.15.123:0/1826805175 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3e8042070 con 0x7ff3f0160db0 2024-09-15T23:22:50.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.187+0000 7ff3f5766640 1 -- 172.21.15.123:0/1826805175 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3f015fab0 con 0x7ff3f0160db0 2024-09-15T23:22:50.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.188+0000 7ff3d77fe640 1 -- 172.21.15.123:0/1826805175 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8009510 con 0x7ff3f0160db0 2024-09-15T23:22:50.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.188+0000 7ff3f5766640 1 -- 172.21.15.123:0/1826805175 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3f0160070 con 0x7ff3f0160db0 2024-09-15T23:22:50.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.189+0000 7ff3d77fe640 1 -- 172.21.15.123:0/1826805175 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff3e8007bd0 con 0x7ff3f0160db0 2024-09-15T23:22:50.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.189+0000 7ff3d77fe640 1 --2- 172.21.15.123:0/1826805175 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff3dc06c2b0 0x7ff3dc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.190+0000 7ff3d77fe640 1 -- 172.21.15.123:0/1826805175 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7ff3e80ac320 con 0x7ff3f0160db0 2024-09-15T23:22:50.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.190+0000 7ff3eeffd640 1 --2- 172.21.15.123:0/1826805175 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff3dc06c2b0 0x7ff3dc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.190+0000 7ff3eeffd640 1 --2- 172.21.15.123:0/1826805175 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff3dc06c2b0 0x7ff3dc06e770 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7ff3e0006fd0 tx=0x7ff3e0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:50.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.190+0000 7ff3f85e0740 1 Processor -- start 2024-09-15T23:22:50.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.191+0000 7ff3f85e0740 1 -- start start 2024-09-15T23:22:50.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.191+0000 7ff3f85e0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555a8a1b85e0 0x555a8a1b89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.191+0000 7ff3f85e0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555a8a1b5da0 0x555a8a1b7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.191+0000 7ff3f85e0740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555a8a1b6200 0x555a8a198560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.191+0000 7ff3f85e0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x555a8a0d48d0 con 0x555a8a1b5da0 2024-09-15T23:22:50.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.191+0000 7ff3f85e0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x555a8a07c620 con 0x555a8a1b85e0 2024-09-15T23:22:50.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.191+0000 7ff3f85e0740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x555a8a0d0890 con 0x555a8a1b6200 2024-09-15T23:22:50.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.191+0000 7ff3ee7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555a8a1b5da0 0x555a8a1b7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.191+0000 7ff3ee7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555a8a1b5da0 0x555a8a1b7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59372/0 (socket says 172.21.15.123:59372) 2024-09-15T23:22:50.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.191+0000 7ff3ee7fc640 1 -- 172.21.15.123:0/4068976741 learned_addr learned my addr 172.21.15.123:0/4068976741 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:50.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.192+0000 7ff3eeffd640 1 --2- 172.21.15.123:0/4068976741 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555a8a1b85e0 0x555a8a1b89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.192+0000 7ff3ef7fe640 1 --2- 172.21.15.123:0/4068976741 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555a8a1b6200 0x555a8a198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.192+0000 7ff3ee7fc640 1 -- 172.21.15.123:0/4068976741 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555a8a1b6200 msgr2=0x555a8a198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:50.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.192+0000 7ff3ee7fc640 1 --2- 172.21.15.123:0/4068976741 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555a8a1b6200 0x555a8a198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.192+0000 7ff3ee7fc640 1 -- 172.21.15.123:0/4068976741 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555a8a1b85e0 msgr2=0x555a8a1b89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:50.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.192+0000 7ff3ee7fc640 1 --2- 172.21.15.123:0/4068976741 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555a8a1b85e0 0x555a8a1b89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.192+0000 7ff3ee7fc640 1 -- 172.21.15.123:0/4068976741 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a89eb17d0 con 0x555a8a1b5da0 2024-09-15T23:22:50.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.192+0000 7ff3ee7fc640 1 --2- 172.21.15.123:0/4068976741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555a8a1b5da0 0x555a8a1b7930 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4006fd0 tx=0x7ff3e400bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d742a878d57e0b45 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:50.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.192+0000 7ff3d4ff9640 1 -- 172.21.15.123:0/4068976741 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e4004230 con 0x555a8a1b5da0 2024-09-15T23:22:50.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.192+0000 7ff3d4ff9640 1 -- 172.21.15.123:0/4068976741 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3e40043d0 con 0x555a8a1b5da0 2024-09-15T23:22:50.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.192+0000 7ff3d4ff9640 1 -- 172.21.15.123:0/4068976741 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e400f9e0 con 0x555a8a1b5da0 2024-09-15T23:22:50.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.193+0000 7ff3f85e0740 1 -- 172.21.15.123:0/4068976741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555a8a1b5da0 msgr2=0x555a8a1b7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:50.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.193+0000 7ff3f85e0740 1 --2- 172.21.15.123:0/4068976741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555a8a1b5da0 0x555a8a1b7930 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4006fd0 tx=0x7ff3e400bd60 comp rx=0 tx=0).stop 2024-09-15T23:22:50.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.193+0000 7ff3f85e0740 1 -- 172.21.15.123:0/4068976741 shutdown_connections 2024-09-15T23:22:50.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.193+0000 7ff3f85e0740 1 --2- 172.21.15.123:0/4068976741 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555a8a1b6200 0x555a8a198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.193+0000 7ff3f85e0740 1 --2- 172.21.15.123:0/4068976741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555a8a1b5da0 0x555a8a1b7930 unknown :-1 s=CLOSED pgs=2150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.193+0000 7ff3f85e0740 1 --2- 172.21.15.123:0/4068976741 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555a8a1b85e0 0x555a8a1b89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.193+0000 7ff3f85e0740 1 -- 172.21.15.123:0/4068976741 >> 172.21.15.123:0/4068976741 conn(0x555a8a16e240 msgr2=0x555a8a1b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:50.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.193+0000 7ff3f85e0740 1 -- 172.21.15.123:0/4068976741 shutdown_connections 2024-09-15T23:22:50.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.193+0000 7ff3f85e0740 1 -- 172.21.15.123:0/4068976741 wait complete. 2024-09-15T23:22:50.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.193+0000 7ff3f85e0740 1 -- start start 2024-09-15T23:22:50.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.193+0000 7ff3f85e0740 1 Processor -- start 2024-09-15T23:22:50.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.194+0000 7ff3f85e0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555a8a1b6200 0x555a8a1b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.194+0000 7ff3f85e0740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555a8a1b85e0 0x555a8a195d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.194+0000 7ff3f85e0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555a8a19aca0 0x555a8a196a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.194+0000 7ff3f85e0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x555a8a1b4d00 con 0x555a8a19aca0 2024-09-15T23:22:50.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.194+0000 7ff3f85e0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x555a8a05d750 con 0x555a8a1b6200 2024-09-15T23:22:50.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.194+0000 7ff3f85e0740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x555a8a1b4fe0 con 0x555a8a1b85e0 2024-09-15T23:22:50.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.194+0000 7ff3f85e0740 10 client.0 _ll_register_callbacks cb 0x555a8a081780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:22:50.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.194+0000 7ff3ef7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555a8a19aca0 0x555a8a196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.194+0000 7ff3ef7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555a8a19aca0 0x555a8a196a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59384/0 (socket says 172.21.15.123:59384) 2024-09-15T23:22:50.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.194+0000 7ff3ef7fe640 1 -- 172.21.15.123:0/2155503943 learned_addr learned my addr 172.21.15.123:0/2155503943 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:50.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.194+0000 7ff3ee7fc640 1 --2- 172.21.15.123:0/2155503943 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555a8a1b85e0 0x555a8a195d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.194+0000 7ff3ef7fe640 1 -- 172.21.15.123:0/2155503943 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555a8a1b85e0 msgr2=0x555a8a195d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:50.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.194+0000 7ff3ef7fe640 1 --2- 172.21.15.123:0/2155503943 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555a8a1b85e0 0x555a8a195d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.194+0000 7ff3eeffd640 1 --2- 172.21.15.123:0/2155503943 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555a8a1b6200 0x555a8a1b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.194+0000 7ff3ef7fe640 1 -- 172.21.15.123:0/2155503943 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555a8a1b6200 msgr2=0x555a8a1b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:50.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.195+0000 7ff3ef7fe640 1 --2- 172.21.15.123:0/2155503943 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555a8a1b6200 0x555a8a1b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.195+0000 7ff3ef7fe640 1 -- 172.21.15.123:0/2155503943 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a89da70f0 con 0x555a8a19aca0 2024-09-15T23:22:50.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.195+0000 7ff3ef7fe640 1 --2- 172.21.15.123:0/2155503943 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555a8a19aca0 0x555a8a196a50 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8009f10 tx=0x7ff3e8079cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd681d778730811c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:50.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.195+0000 7ff3cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:22:50.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.195+0000 7ff3cdffb640 1 -- 172.21.15.123:0/2155503943 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e807aa90 con 0x555a8a19aca0 2024-09-15T23:22:50.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.195+0000 7ff3cdffb640 1 -- 172.21.15.123:0/2155503943 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7ff3e8092180 con 0x555a8a19aca0 2024-09-15T23:22:50.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.195+0000 7ff3f85e0740 1 -- 172.21.15.123:0/2155503943 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3e40043d0 con 0x555a8a19aca0 2024-09-15T23:22:50.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.195+0000 7ff3cdffb640 1 -- 172.21.15.123:0/2155503943 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) ==== 24+0+0 (secure 0 0 0) 0x7ff3e807a390 con 0x555a8a19aca0 2024-09-15T23:22:50.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.195+0000 7ff3f85e0740 10 client.10338 fetch_fsmap learned FSMap version 113 2024-09-15T23:22:50.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.195+0000 7ff3f85e0740 1 -- 172.21.15.123:0/2155503943 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) -- 0x555a89f11f60 con 0x555a8a19aca0 2024-09-15T23:22:50.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.195+0000 7ff3cdffb640 1 -- 172.21.15.123:0/2155503943 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3e40043d0 con 0x555a8a19aca0 2024-09-15T23:22:50.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.195+0000 7ff3cdffb640 1 -- 172.21.15.123:0/2155503943 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 113) ==== 3490+0+0 (secure 0 0 0) 0x7ff3e80797e0 con 0x555a8a19aca0 2024-09-15T23:22:50.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.195+0000 7ff3f85e0740 10 client.10338 fetch_fsmap finished waiting for FSMap version 113 2024-09-15T23:22:50.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.195+0000 7ff3f85e0740 10 client.10338 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T23:22:50.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.195+0000 7ff3f85e0740 20 client.10338 populate_metadata read hostname 'smithi123' 2024-09-15T23:22:50.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.195+0000 7ff3f85e0740 1 --2- 172.21.15.123:0/2155503943 >> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] conn(0x555a8a1b0e70 0x555a8a1b1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.195+0000 7ff3f85e0740 4 client.10338 mds_command: new command op to 10062 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:22:50.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.195+0000 7ff3f85e0740 1 -- 172.21.15.123:0/2155503943 --> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a8a0e2000 con 0x555a8a1b0e70 2024-09-15T23:22:50.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.195+0000 7ff3eeffd640 1 --2- 172.21.15.123:0/2155503943 >> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] conn(0x555a8a1b0e70 0x555a8a1b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.196+0000 7ff3cdffb640 10 client.10338 ms_handle_connect on v2:172.21.15.123:6834/3239002092 2024-09-15T23:22:50.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.196+0000 7ff3eeffd640 1 --2- 172.21.15.123:0/2155503943 >> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] conn(0x555a8a1b0e70 0x555a8a1b1250 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.10062 client_cookie=97169905bcd8b442 server_cookie=59a0ea48c06876a3 in_seq=0 out_seq=0 2024-09-15T23:22:50.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.196+0000 7ff3cdffb640 1 -- 172.21.15.123:0/2155503943 <== mds.10062 v2:172.21.15.123:6834/3239002092 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555a8a0e2000 con 0x555a8a1b0e70 2024-09-15T23:22:50.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.196+0000 7ff3cdffb640 10 client.10338 handle_command_reply: tid=0 2024-09-15T23:22:50.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.196+0000 7ff3f85e0740 1 client.10338 shutdown 2024-09-15T23:22:50.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.196+0000 7ff3f85e0740 1 -- 172.21.15.123:0/2155503943 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555a8a19aca0 msgr2=0x555a8a196a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:50.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.196+0000 7ff3f85e0740 1 --2- 172.21.15.123:0/2155503943 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555a8a19aca0 0x555a8a196a50 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8009f10 tx=0x7ff3e8079cf0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.196+0000 7ff3f85e0740 1 -- 172.21.15.123:0/2155503943 shutdown_connections 2024-09-15T23:22:50.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.196+0000 7ff3f85e0740 1 --2- 172.21.15.123:0/2155503943 >> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] conn(0x555a8a1b0e70 0x555a8a1b1250 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.196+0000 7ff3f85e0740 1 --2- 172.21.15.123:0/2155503943 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555a8a19aca0 0x555a8a196a50 unknown :-1 s=CLOSED pgs=2151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.196+0000 7ff3cdffb640 0 client.10338 ms_handle_reset on v2:172.21.15.123:6834/3239002092 2024-09-15T23:22:50.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.196+0000 7ff3f85e0740 1 --2- 172.21.15.123:0/2155503943 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555a8a1b85e0 0x555a8a195d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.196+0000 7ff3f85e0740 1 --2- 172.21.15.123:0/2155503943 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555a8a1b6200 0x555a8a1b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.196+0000 7ff3f85e0740 1 -- 172.21.15.123:0/2155503943 >> 172.21.15.123:0/2155503943 conn(0x555a8a1b5da0 msgr2=0x555a8a1b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:50.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.197+0000 7ff3f85e0740 1 -- 172.21.15.123:0/2155503943 shutdown_connections 2024-09-15T23:22:50.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.197+0000 7ff3f85e0740 1 -- 172.21.15.123:0/2155503943 wait complete. 2024-09-15T23:22:50.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.197+0000 7ff3f85e0740 20 client.10338 trim_cache size 0 max 16384 2024-09-15T23:22:50.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.213+0000 7ff3f85e0740 1 Processor -- start 2024-09-15T23:22:50.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.213+0000 7ff3f85e0740 1 -- start start 2024-09-15T23:22:50.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.214+0000 7ff3f85e0740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555a8a19aca0 0x555a8a16d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.214+0000 7ff3f85e0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555a8a1b6200 0x555a8a1ace10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.214+0000 7ff3f85e0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555a8a1b85e0 0x555a8a1c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.214+0000 7ff3f85e0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f01feb70 con 0x555a8a1b85e0 2024-09-15T23:22:50.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.214+0000 7ff3f85e0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f0159720 con 0x555a8a1b6200 2024-09-15T23:22:50.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.214+0000 7ff3f85e0740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ff3f015e0d0 con 0x555a8a19aca0 2024-09-15T23:22:50.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.214+0000 7ff3ef7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555a8a1b85e0 0x555a8a1c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.214+0000 7ff3ef7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555a8a1b85e0 0x555a8a1c4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59398/0 (socket says 172.21.15.123:59398) 2024-09-15T23:22:50.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.214+0000 7ff3ef7fe640 1 -- 172.21.15.123:0/163989522 learned_addr learned my addr 172.21.15.123:0/163989522 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:50.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.214+0000 7ff3ee7fc640 1 --2- 172.21.15.123:0/163989522 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555a8a1b6200 0x555a8a1ace10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.214+0000 7ff3eeffd640 1 --2- 172.21.15.123:0/163989522 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555a8a19aca0 0x555a8a16d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.214+0000 7ff3ef7fe640 1 -- 172.21.15.123:0/163989522 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555a8a19aca0 msgr2=0x555a8a16d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:50.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.214+0000 7ff3ef7fe640 1 --2- 172.21.15.123:0/163989522 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555a8a19aca0 0x555a8a16d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.214+0000 7ff3ef7fe640 1 -- 172.21.15.123:0/163989522 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555a8a1b6200 msgr2=0x555a8a1ace10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:50.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.214+0000 7ff3ef7fe640 1 --2- 172.21.15.123:0/163989522 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555a8a1b6200 0x555a8a1ace10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.214+0000 7ff3ef7fe640 1 -- 172.21.15.123:0/163989522 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a89d801b0 con 0x555a8a1b85e0 2024-09-15T23:22:50.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.214+0000 7ff3ee7fc640 1 --2- 172.21.15.123:0/163989522 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555a8a1b6200 0x555a8a1ace10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:22:50.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.214+0000 7ff3eeffd640 1 --2- 172.21.15.123:0/163989522 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555a8a19aca0 0x555a8a16d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:22:50.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.215+0000 7ff3ef7fe640 1 --2- 172.21.15.123:0/163989522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555a8a1b85e0 0x555a8a1c4d70 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8031780 tx=0x7ff3e807d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a12f0adf2a2bf3fc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:50.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.215+0000 7ff3cffff640 1 -- 172.21.15.123:0/163989522 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e80a0070 con 0x555a8a1b85e0 2024-09-15T23:22:50.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.215+0000 7ff3cffff640 1 -- 172.21.15.123:0/163989522 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3e8037040 con 0x555a8a1b85e0 2024-09-15T23:22:50.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.215+0000 7ff3cffff640 1 -- 172.21.15.123:0/163989522 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e80aa790 con 0x555a8a1b85e0 2024-09-15T23:22:50.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.215+0000 7ff3f85e0740 1 -- 172.21.15.123:0/163989522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555a8a1b85e0 msgr2=0x555a8a1c4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:50.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.215+0000 7ff3f85e0740 1 --2- 172.21.15.123:0/163989522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555a8a1b85e0 0x555a8a1c4d70 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8031780 tx=0x7ff3e807d000 comp rx=0 tx=0).stop 2024-09-15T23:22:50.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.215+0000 7ff3f85e0740 1 -- 172.21.15.123:0/163989522 shutdown_connections 2024-09-15T23:22:50.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.215+0000 7ff3f85e0740 1 --2- 172.21.15.123:0/163989522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555a8a1b85e0 0x555a8a1c4d70 unknown :-1 s=CLOSED pgs=2152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.215+0000 7ff3f85e0740 1 --2- 172.21.15.123:0/163989522 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555a8a1b6200 0x555a8a1ace10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.215+0000 7ff3f85e0740 1 --2- 172.21.15.123:0/163989522 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555a8a19aca0 0x555a8a16d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.215+0000 7ff3f85e0740 1 -- 172.21.15.123:0/163989522 >> 172.21.15.123:0/163989522 conn(0x555a8a1b5da0 msgr2=0x555a8a1ac610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:50.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.215+0000 7ff3f85e0740 1 -- 172.21.15.123:0/163989522 shutdown_connections 2024-09-15T23:22:50.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.215+0000 7ff3f85e0740 1 -- 172.21.15.123:0/163989522 wait complete. 2024-09-15T23:22:50.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.216+0000 7ff3f85e0740 1 -- start start 2024-09-15T23:22:50.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.216+0000 7ff3f85e0740 1 Processor -- start 2024-09-15T23:22:50.226 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T23:22:50.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.217+0000 7ff3f85e0740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555a8a19aca0 0x555a8a1c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.217+0000 7ff3f85e0740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555a8a1b6200 0x555a8a1c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.217+0000 7ff3f85e0740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555a8a1b85e0 0x555a8a1d2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.217+0000 7ff3f85e0740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x555a8a1b3360 con 0x555a8a1b85e0 2024-09-15T23:22:50.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.217+0000 7ff3f85e0740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x555a8a1b4d00 con 0x555a8a19aca0 2024-09-15T23:22:50.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.217+0000 7ff3f85e0740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x555a8a1c65f0 con 0x555a8a1b6200 2024-09-15T23:22:50.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.217+0000 7ff3f85e0740 10 client.0 _ll_register_callbacks cb 0x7ff3e807a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:22:50.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.217+0000 7ff3ef7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555a8a1b85e0 0x555a8a1d2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.217+0000 7ff3ef7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555a8a1b85e0 0x555a8a1d2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59406/0 (socket says 172.21.15.123:59406) 2024-09-15T23:22:50.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.217+0000 7ff3ef7fe640 1 -- 172.21.15.123:0/1781107654 learned_addr learned my addr 172.21.15.123:0/1781107654 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:50.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.217+0000 7ff3ee7fc640 1 --2- 172.21.15.123:0/1781107654 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555a8a1b6200 0x555a8a1c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.217+0000 7ff3eeffd640 1 --2- 172.21.15.123:0/1781107654 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555a8a19aca0 0x555a8a1c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.217+0000 7ff3ef7fe640 1 -- 172.21.15.123:0/1781107654 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555a8a1b6200 msgr2=0x555a8a1c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:50.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.217+0000 7ff3ef7fe640 1 --2- 172.21.15.123:0/1781107654 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555a8a1b6200 0x555a8a1c52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.217+0000 7ff3ef7fe640 1 -- 172.21.15.123:0/1781107654 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555a8a19aca0 msgr2=0x555a8a1c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:50.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.217+0000 7ff3ef7fe640 1 --2- 172.21.15.123:0/1781107654 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555a8a19aca0 0x555a8a1c4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.217+0000 7ff3ef7fe640 1 -- 172.21.15.123:0/1781107654 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a8a1d9820 con 0x555a8a1b85e0 2024-09-15T23:22:50.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.217+0000 7ff3ef7fe640 1 --2- 172.21.15.123:0/1781107654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555a8a1b85e0 0x555a8a1d2a00 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7ff3e80073c0 tx=0x7ff3e80aa720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a2bb66fcf3add8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:50.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.217+0000 7ff3cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:22:50.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.217+0000 7ff3cdffb640 1 -- 172.21.15.123:0/1781107654 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e80a0070 con 0x555a8a1b85e0 2024-09-15T23:22:50.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.217+0000 7ff3cdffb640 1 -- 172.21.15.123:0/1781107654 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7ff3e80797e0 con 0x555a8a1b85e0 2024-09-15T23:22:50.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.217+0000 7ff3f85e0740 1 -- 172.21.15.123:0/1781107654 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3e8037040 con 0x555a8a1b85e0 2024-09-15T23:22:50.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.217+0000 7ff3cdffb640 1 -- 172.21.15.123:0/1781107654 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) ==== 24+0+0 (secure 0 0 0) 0x7ff3e808a050 con 0x555a8a1b85e0 2024-09-15T23:22:50.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.217+0000 7ff3f85e0740 10 client.10344 fetch_fsmap learned FSMap version 113 2024-09-15T23:22:50.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.217+0000 7ff3f85e0740 1 -- 172.21.15.123:0/1781107654 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=2+}) -- 0x555a8a1d9820 con 0x555a8a1b85e0 2024-09-15T23:22:50.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.217+0000 7ff3cdffb640 1 -- 172.21.15.123:0/1781107654 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3e8037040 con 0x555a8a1b85e0 2024-09-15T23:22:50.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.218+0000 7ff3cdffb640 1 -- 172.21.15.123:0/1781107654 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 113) ==== 3490+0+0 (secure 0 0 0) 0x7ff3e8092180 con 0x555a8a1b85e0 2024-09-15T23:22:50.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.218+0000 7ff3f85e0740 10 client.10344 fetch_fsmap finished waiting for FSMap version 113 2024-09-15T23:22:50.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.218+0000 7ff3f85e0740 10 client.10344 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T23:22:50.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.218+0000 7ff3f85e0740 20 client.10344 populate_metadata read hostname 'smithi123' 2024-09-15T23:22:50.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.218+0000 7ff3f85e0740 1 --2- 172.21.15.123:0/1781107654 >> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] conn(0x555a8a1d2fb0 0x555a8a1d3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.218+0000 7ff3f85e0740 4 client.10344 mds_command: new command op to 10062 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-09-15T23:22:50.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.218+0000 7ff3f85e0740 1 -- 172.21.15.123:0/1781107654 --> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] -- command(tid 0: {"prefix": "scrub resume"}) -- 0x555a8a0dc350 con 0x555a8a1d2fb0 2024-09-15T23:22:50.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.218+0000 7ff3eeffd640 1 --2- 172.21.15.123:0/1781107654 >> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] conn(0x555a8a1d2fb0 0x555a8a1d3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.218+0000 7ff3cdffb640 10 client.10344 ms_handle_connect on v2:172.21.15.123:6834/3239002092 2024-09-15T23:22:50.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.218+0000 7ff3eeffd640 1 --2- 172.21.15.123:0/1781107654 >> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] conn(0x555a8a1d2fb0 0x555a8a1d3390 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.10062 client_cookie=dfeca2a6d1a7fcb server_cookie=f6274a5b426c1f94 in_seq=0 out_seq=0 2024-09-15T23:22:50.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.218+0000 7ff3cdffb640 1 -- 172.21.15.123:0/1781107654 <== mds.10062 v2:172.21.15.123:6834/3239002092 1 ==== command_reply(tid 0: -22 MDS is not active) ==== 25+0+0 (crc 0 0 0) 0x555a8a0dc350 con 0x555a8a1d2fb0 2024-09-15T23:22:50.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.218+0000 7ff3cdffb640 10 client.10344 handle_command_reply: tid=0 2024-09-15T23:22:50.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.218+0000 7ff3f85e0740 1 client.10344 shutdown 2024-09-15T23:22:50.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.218+0000 7ff3f85e0740 1 -- 172.21.15.123:0/1781107654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555a8a1b85e0 msgr2=0x555a8a1d2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:50.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.218+0000 7ff3f85e0740 1 --2- 172.21.15.123:0/1781107654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555a8a1b85e0 0x555a8a1d2a00 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7ff3e80073c0 tx=0x7ff3e80aa720 comp rx=0 tx=0).stop 2024-09-15T23:22:50.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.218+0000 7ff3f85e0740 1 -- 172.21.15.123:0/1781107654 shutdown_connections 2024-09-15T23:22:50.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.218+0000 7ff3f85e0740 1 --2- 172.21.15.123:0/1781107654 >> [v2:172.21.15.123:6834/3239002092,v1:172.21.15.123:6835/3239002092] conn(0x555a8a1d2fb0 0x555a8a1d3390 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.218+0000 7ff3f85e0740 1 --2- 172.21.15.123:0/1781107654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555a8a1b85e0 0x555a8a1d2a00 unknown :-1 s=CLOSED pgs=2153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.218+0000 7ff3f85e0740 1 --2- 172.21.15.123:0/1781107654 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x555a8a1b6200 0x555a8a1c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.218+0000 7ff3f85e0740 1 --2- 172.21.15.123:0/1781107654 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x555a8a19aca0 0x555a8a1c4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.218+0000 7ff3cdffb640 0 client.10344 ms_handle_reset on v2:172.21.15.123:6834/3239002092 2024-09-15T23:22:50.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.218+0000 7ff3f85e0740 1 -- 172.21.15.123:0/1781107654 >> 172.21.15.123:0/1781107654 conn(0x555a8a1b5da0 msgr2=0x555a8a1b7940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:50.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.218+0000 7ff3f85e0740 1 -- 172.21.15.123:0/1781107654 shutdown_connections 2024-09-15T23:22:50.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.218+0000 7ff3f85e0740 1 -- 172.21.15.123:0/1781107654 wait complete. 2024-09-15T23:22:50.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.219+0000 7ff3f85e0740 20 client.10344 trim_cache size 0 max 16384 2024-09-15T23:22:50.231 INFO:teuthology.orchestra.run.smithi123.stderr:Error EINVAL: MDS is not active 2024-09-15T23:22:50.231 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:22:50.231 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:22:50.272 DEBUG:teuthology.orchestra.run.smithi188:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:22:50.317 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:22:50.318 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:22:50.318 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:22:50.318 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:22:50.334 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:22:50.334 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:22:50.391 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:22:50.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.528+0000 7f370745c640 1 Processor -- start 2024-09-15T23:22:50.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.529+0000 7f370745c640 1 -- start start 2024-09-15T23:22:50.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.529+0000 7f370745c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f37000b6970 0x7f37000b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.529+0000 7f370745c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37000d23b0 0x7f37000b8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.529+0000 7f370745c640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37000d0e70 con 0x7f370015ed20 2024-09-15T23:22:50.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.529+0000 7f370745c640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f37000d41c0 con 0x7f37000b6970 2024-09-15T23:22:50.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.529+0000 7f370745c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f37000d35b0 con 0x7f37000d23b0 2024-09-15T23:22:50.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.529+0000 7f37049f7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f37000b6970 0x7f37000b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.529+0000 7f37051f8640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f370015ed20 0x7f37000b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:45280/0 (socket says 172.21.15.123:45280) 2024-09-15T23:22:50.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.529+0000 7f37051f8640 1 -- 172.21.15.123:0/518224515 learned_addr learned my addr 172.21.15.123:0/518224515 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:50.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.530+0000 7f37049f7640 1 -- 172.21.15.123:0/518224515 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37000d23b0 msgr2=0x7f37000b8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:50.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.530+0000 7f37049f7640 1 --2- 172.21.15.123:0/518224515 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37000d23b0 0x7f37000b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.530+0000 7f37049f7640 1 -- 172.21.15.123:0/518224515 >> v1:172.21.15.123:6789/0 conn(0x7f370015ed20 legacy=0x7f37000b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:50.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.530+0000 7f37049f7640 1 -- 172.21.15.123:0/518224515 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37000d3890 con 0x7f37000b6970 2024-09-15T23:22:50.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.530+0000 7f36f3fff640 1 -- 172.21.15.123:0/518224515 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2897064480 0 0) 0x7f36f4001110 con 0x7f370015ed20 2024-09-15T23:22:50.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.530+0000 7f37049f7640 1 --2- 172.21.15.123:0/518224515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37000b6970 0x7f37000b80d0 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7f36fc0097a0 tx=0x7f36fc02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=218034fbca2ca8dc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:50.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.531+0000 7f36f3fff640 1 -- 172.21.15.123:0/518224515 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36fc037070 con 0x7f37000b6970 2024-09-15T23:22:50.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.531+0000 7f36f3fff640 1 -- 172.21.15.123:0/518224515 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36fc02ae50 con 0x7f37000b6970 2024-09-15T23:22:50.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.531+0000 7f36f3fff640 1 -- 172.21.15.123:0/518224515 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36fc032660 con 0x7f37000b6970 2024-09-15T23:22:50.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.531+0000 7f370745c640 1 -- 172.21.15.123:0/518224515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37000b6970 msgr2=0x7f37000b80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:50.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.531+0000 7f370745c640 1 --2- 172.21.15.123:0/518224515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37000b6970 0x7f37000b80d0 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7f36fc0097a0 tx=0x7f36fc02a100 comp rx=0 tx=0).stop 2024-09-15T23:22:50.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.531+0000 7f370745c640 1 -- 172.21.15.123:0/518224515 shutdown_connections 2024-09-15T23:22:50.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.531+0000 7f370745c640 1 --2- 172.21.15.123:0/518224515 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37000d23b0 0x7f37000b8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.531+0000 7f370745c640 1 --2- 172.21.15.123:0/518224515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37000b6970 0x7f37000b80d0 unknown :-1 s=CLOSED pgs=2155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.531+0000 7f370745c640 1 -- 172.21.15.123:0/518224515 >> 172.21.15.123:0/518224515 conn(0x7f37000d1260 msgr2=0x7f37000d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:50.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.531+0000 7f370745c640 1 -- 172.21.15.123:0/518224515 shutdown_connections 2024-09-15T23:22:50.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.531+0000 7f370745c640 1 -- 172.21.15.123:0/518224515 wait complete. 2024-09-15T23:22:50.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.532+0000 7f370745c640 1 Processor -- start 2024-09-15T23:22:50.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.532+0000 7f370745c640 1 -- start start 2024-09-15T23:22:50.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.533+0000 7f370745c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37000b6970 0x7f3700154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.533+0000 7f370745c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37000d23b0 0x7f37000cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.533+0000 7f370745c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f370015ed20 0x7f37001f80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.533+0000 7f370745c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f37000d32a0 con 0x7f37000d23b0 2024-09-15T23:22:50.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.533+0000 7f370745c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f37000d3e50 con 0x7f370015ed20 2024-09-15T23:22:50.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.533+0000 7f370745c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f370015f100 con 0x7f37000b6970 2024-09-15T23:22:50.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.533+0000 7f37049f7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37000d23b0 0x7f37000cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.533+0000 7f37049f7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37000d23b0 0x7f37000cb8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59428/0 (socket says 172.21.15.123:59428) 2024-09-15T23:22:50.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.533+0000 7f37049f7640 1 -- 172.21.15.123:0/2297564009 learned_addr learned my addr 172.21.15.123:0/2297564009 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:50.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.534+0000 7f37049f7640 1 -- 172.21.15.123:0/2297564009 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37000b6970 msgr2=0x7f3700154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:50.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.534+0000 7f37051f8640 1 --2- 172.21.15.123:0/2297564009 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37000b6970 0x7f3700154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.534+0000 7f37059f9640 1 --2- 172.21.15.123:0/2297564009 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f370015ed20 0x7f37001f80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.534+0000 7f37049f7640 1 --2- 172.21.15.123:0/2297564009 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37000b6970 0x7f3700154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.534+0000 7f37049f7640 1 -- 172.21.15.123:0/2297564009 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f370015ed20 msgr2=0x7f37001f80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:50.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.534+0000 7f37049f7640 1 --2- 172.21.15.123:0/2297564009 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f370015ed20 0x7f37001f80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.534+0000 7f37049f7640 1 -- 172.21.15.123:0/2297564009 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37001f8a90 con 0x7f37000d23b0 2024-09-15T23:22:50.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.534+0000 7f37049f7640 1 --2- 172.21.15.123:0/2297564009 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37000d23b0 0x7f37000cb8b0 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7f36fc0097a0 tx=0x7f36fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:50.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.534+0000 7f36f1ffb640 1 -- 172.21.15.123:0/2297564009 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36fc037040 con 0x7f37000d23b0 2024-09-15T23:22:50.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.534+0000 7f36f1ffb640 1 -- 172.21.15.123:0/2297564009 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36fc004030 con 0x7f37000d23b0 2024-09-15T23:22:50.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.534+0000 7f370745c640 1 -- 172.21.15.123:0/2297564009 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37001f8d70 con 0x7f37000d23b0 2024-09-15T23:22:50.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.534+0000 7f36f1ffb640 1 -- 172.21.15.123:0/2297564009 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36fc006e10 con 0x7f37000d23b0 2024-09-15T23:22:50.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.534+0000 7f370745c640 1 -- 172.21.15.123:0/2297564009 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3700154f80 con 0x7f37000d23b0 2024-09-15T23:22:50.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.535+0000 7f370745c640 1 -- 172.21.15.123:0/2297564009 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37000b7010 con 0x7f37000d23b0 2024-09-15T23:22:50.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.536+0000 7f36f1ffb640 1 -- 172.21.15.123:0/2297564009 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f36fc03d650 con 0x7f37000d23b0 2024-09-15T23:22:50.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.536+0000 7f36f1ffb640 1 --2- 172.21.15.123:0/2297564009 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f36e406c2b0 0x7f36e406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:50.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.536+0000 7f36f1ffb640 1 -- 172.21.15.123:0/2297564009 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f36fc0abd00 con 0x7f37000d23b0 2024-09-15T23:22:50.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.536+0000 7f37051f8640 1 --2- 172.21.15.123:0/2297564009 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f36e406c2b0 0x7f36e406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:50.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.537+0000 7f37051f8640 1 --2- 172.21.15.123:0/2297564009 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f36e406c2b0 0x7f36e406e770 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f36f4000f60 tx=0x7f36f4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:50.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.540+0000 7f36f1ffb640 1 -- 172.21.15.123:0/2297564009 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f36fc042020 con 0x7f37000d23b0 2024-09-15T23:22:50.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.719+0000 7f370745c640 1 -- 172.21.15.123:0/2297564009 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f37000b3f20 con 0x7f37000d23b0 2024-09-15T23:22:50.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.719+0000 7f36f1ffb640 1 -- 172.21.15.123:0/2297564009 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v182) ==== 80+0+0 (secure 0 0 0) 0x7f36fc07a590 con 0x7f37000d23b0 2024-09-15T23:22:50.721 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-15T23:22:50.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.721+0000 7f370745c640 1 -- 172.21.15.123:0/2297564009 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f36e406c2b0 msgr2=0x7f36e406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:50.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.721+0000 7f370745c640 1 --2- 172.21.15.123:0/2297564009 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f36e406c2b0 0x7f36e406e770 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f36f4000f60 tx=0x7f36f4009040 comp rx=0 tx=0).stop 2024-09-15T23:22:50.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.721+0000 7f370745c640 1 -- 172.21.15.123:0/2297564009 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37000d23b0 msgr2=0x7f37000cb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:50.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.721+0000 7f370745c640 1 --2- 172.21.15.123:0/2297564009 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37000d23b0 0x7f37000cb8b0 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7f36fc0097a0 tx=0x7f36fc0046c0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.721+0000 7f370745c640 1 -- 172.21.15.123:0/2297564009 shutdown_connections 2024-09-15T23:22:50.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.721+0000 7f370745c640 1 --2- 172.21.15.123:0/2297564009 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f370015ed20 0x7f37001f80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.721+0000 7f370745c640 1 --2- 172.21.15.123:0/2297564009 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f36e406c2b0 0x7f36e406e770 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.721+0000 7f370745c640 1 --2- 172.21.15.123:0/2297564009 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37000d23b0 0x7f37000cb8b0 unknown :-1 s=CLOSED pgs=2156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.721+0000 7f370745c640 1 --2- 172.21.15.123:0/2297564009 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f37000b6970 0x7f3700154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:50.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.721+0000 7f370745c640 1 -- 172.21.15.123:0/2297564009 >> 172.21.15.123:0/2297564009 conn(0x7f37000d1260 msgr2=0x7f37000b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:50.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.721+0000 7f370745c640 1 -- 172.21.15.123:0/2297564009 shutdown_connections 2024-09-15T23:22:50.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:50.721+0000 7f370745c640 1 -- 172.21.15.123:0/2297564009 wait complete. 2024-09-15T23:22:50.733 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-15T23:22:50.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:22:50.733 DEBUG:teuthology.orchestra.run.smithi123:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-15T23:22:51.513 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-09-15T23:22:51.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:22:51.513 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T23:22:51.529 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:22:51.529 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:22:51.529 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:22:51.545 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:22:51.545 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:22:51.545 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:22:51.545 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:22:51.584 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:22:51.584 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:22:51.584 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:22:51.584 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:22:51.600 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:22:51.601 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:22:51.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.721+0000 7f455dea6640 1 Processor -- start 2024-09-15T23:22:51.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.721+0000 7f455dea6640 1 -- start start 2024-09-15T23:22:51.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.722+0000 7f455dea6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f455815e6d0 0x7f4558071390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:51.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.722+0000 7f455dea6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f455806cd20 0x7f45580b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:51.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.722+0000 7f455dea6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f4558070b80 0x7f45580b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:51.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.722+0000 7f455dea6640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f45580b77e0 con 0x7f455806cd20 2024-09-15T23:22:51.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.722+0000 7f455dea6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f455815eab0 con 0x7f4558070b80 2024-09-15T23:22:51.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.722+0000 7f455dea6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f455815ed70 con 0x7f455815e6d0 2024-09-15T23:22:51.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.722+0000 7f4556ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f455806cd20 0x7f45580b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:51.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.722+0000 7f4556ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f455806cd20 0x7f45580b6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59430/0 (socket says 172.21.15.123:59430) 2024-09-15T23:22:51.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.722+0000 7f4556ffd640 1 -- 172.21.15.123:0/1917798546 learned_addr learned my addr 172.21.15.123:0/1917798546 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:51.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.722+0000 7f45577fe640 1 --2- 172.21.15.123:0/1917798546 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f455815e6d0 0x7f4558071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:51.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.722+0000 7f4557fff640 1 --2- 172.21.15.123:0/1917798546 >> v2:172.21.15.188:3300/0 conn(0x7f4558070b80 0x7f45580b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:51.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.723+0000 7f4556ffd640 1 -- 172.21.15.123:0/1917798546 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f455815e6d0 msgr2=0x7f4558071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:51.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.723+0000 7f4556ffd640 1 --2- 172.21.15.123:0/1917798546 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f455815e6d0 0x7f4558071390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:51.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.723+0000 7f4556ffd640 1 -- 172.21.15.123:0/1917798546 >> v2:172.21.15.188:3300/0 conn(0x7f4558070b80 msgr2=0x7f45580b72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:51.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.723+0000 7f4556ffd640 1 --2- 172.21.15.123:0/1917798546 >> v2:172.21.15.188:3300/0 conn(0x7f4558070b80 0x7f45580b72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:51.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.723+0000 7f4556ffd640 1 -- 172.21.15.123:0/1917798546 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f455815f050 con 0x7f455806cd20 2024-09-15T23:22:51.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.723+0000 7f4556ffd640 1 --2- 172.21.15.123:0/1917798546 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f455806cd20 0x7f45580b6d60 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 crypto rx=0x7f4558070420 tx=0x7f454c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ca07324e18684b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:51.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.723+0000 7f45567fc640 1 -- 172.21.15.123:0/1917798546 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454c037070 con 0x7f455806cd20 2024-09-15T23:22:51.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.723+0000 7f45567fc640 1 -- 172.21.15.123:0/1917798546 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f454c032440 con 0x7f455806cd20 2024-09-15T23:22:51.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.723+0000 7f45567fc640 1 -- 172.21.15.123:0/1917798546 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454c032810 con 0x7f455806cd20 2024-09-15T23:22:51.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.724+0000 7f455dea6640 1 -- 172.21.15.123:0/1917798546 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f455806cd20 msgr2=0x7f45580b6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:51.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.724+0000 7f455dea6640 1 --2- 172.21.15.123:0/1917798546 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f455806cd20 0x7f45580b6d60 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 crypto rx=0x7f4558070420 tx=0x7f454c02a1e0 comp rx=0 tx=0).stop 2024-09-15T23:22:51.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.724+0000 7f455dea6640 1 -- 172.21.15.123:0/1917798546 shutdown_connections 2024-09-15T23:22:51.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.724+0000 7f455dea6640 1 --2- 172.21.15.123:0/1917798546 >> v2:172.21.15.188:3300/0 conn(0x7f4558070b80 0x7f45580b72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:51.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.724+0000 7f455dea6640 1 --2- 172.21.15.123:0/1917798546 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f455806cd20 0x7f45580b6d60 unknown :-1 s=CLOSED pgs=2157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:51.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.724+0000 7f455dea6640 1 --2- 172.21.15.123:0/1917798546 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f455815e6d0 0x7f4558071390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:51.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.724+0000 7f455dea6640 1 -- 172.21.15.123:0/1917798546 >> 172.21.15.123:0/1917798546 conn(0x7f4558067fb0 msgr2=0x7f455806f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:51.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.724+0000 7f455dea6640 1 -- 172.21.15.123:0/1917798546 shutdown_connections 2024-09-15T23:22:51.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.724+0000 7f455dea6640 1 -- 172.21.15.123:0/1917798546 wait complete. 2024-09-15T23:22:51.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.725+0000 7f455dea6640 1 Processor -- start 2024-09-15T23:22:51.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.725+0000 7f455dea6640 1 -- start start 2024-09-15T23:22:51.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.726+0000 7f455dea6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f455806cd20 0x7f4558151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:51.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.726+0000 7f455dea6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4558070b80 0x7f4558151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:51.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.726+0000 7f455dea6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f455815e6d0 0x7f455815b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:51.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.726+0000 7f455dea6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f455815f8f0 con 0x7f455806cd20 2024-09-15T23:22:51.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.726+0000 7f455dea6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f455815f610 con 0x7f4558070b80 2024-09-15T23:22:51.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.726+0000 7f455dea6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f45580718d0 con 0x7f455815e6d0 2024-09-15T23:22:51.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.726+0000 7f45577fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f455806cd20 0x7f4558151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:51.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.726+0000 7f45577fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f455806cd20 0x7f4558151c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59444/0 (socket says 172.21.15.123:59444) 2024-09-15T23:22:51.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.726+0000 7f45577fe640 1 -- 172.21.15.123:0/2576895466 learned_addr learned my addr 172.21.15.123:0/2576895466 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:51.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.726+0000 7f4556ffd640 1 --2- 172.21.15.123:0/2576895466 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4558070b80 0x7f4558151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:51.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.726+0000 7f4557fff640 1 --2- 172.21.15.123:0/2576895466 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f455815e6d0 0x7f455815b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:51.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.726+0000 7f45577fe640 1 -- 172.21.15.123:0/2576895466 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f455815e6d0 msgr2=0x7f455815b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:51.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.726+0000 7f45577fe640 1 --2- 172.21.15.123:0/2576895466 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f455815e6d0 0x7f455815b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:51.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.726+0000 7f45577fe640 1 -- 172.21.15.123:0/2576895466 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4558070b80 msgr2=0x7f4558151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:51.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.727+0000 7f45577fe640 1 --2- 172.21.15.123:0/2576895466 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4558070b80 0x7f4558151190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:51.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.727+0000 7f45577fe640 1 -- 172.21.15.123:0/2576895466 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4558152240 con 0x7f455806cd20 2024-09-15T23:22:51.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.727+0000 7f45577fe640 1 --2- 172.21.15.123:0/2576895466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f455806cd20 0x7f4558151c40 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7f4548007ec0 tx=0x7f454800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:51.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.727+0000 7f453ffff640 1 -- 172.21.15.123:0/2576895466 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4548014620 con 0x7f455806cd20 2024-09-15T23:22:51.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.727+0000 7f453ffff640 1 -- 172.21.15.123:0/2576895466 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4548019070 con 0x7f455806cd20 2024-09-15T23:22:51.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.727+0000 7f455dea6640 1 -- 172.21.15.123:0/2576895466 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4558152520 con 0x7f455806cd20 2024-09-15T23:22:51.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.727+0000 7f453ffff640 1 -- 172.21.15.123:0/2576895466 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4548014a20 con 0x7f455806cd20 2024-09-15T23:22:51.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.727+0000 7f455dea6640 1 -- 172.21.15.123:0/2576895466 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4558152ae0 con 0x7f455806cd20 2024-09-15T23:22:51.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.728+0000 7f455dea6640 1 -- 172.21.15.123:0/2576895466 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4558071390 con 0x7f455806cd20 2024-09-15T23:22:51.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.728+0000 7f453ffff640 1 -- 172.21.15.123:0/2576895466 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4548014bc0 con 0x7f455806cd20 2024-09-15T23:22:51.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.729+0000 7f453ffff640 1 --2- 172.21.15.123:0/2576895466 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f454406c2b0 0x7f454406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:51.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.729+0000 7f453ffff640 1 -- 172.21.15.123:0/2576895466 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f454808bba0 con 0x7f455806cd20 2024-09-15T23:22:51.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.729+0000 7f4556ffd640 1 --2- 172.21.15.123:0/2576895466 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f454406c2b0 0x7f454406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:51.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.729+0000 7f4556ffd640 1 --2- 172.21.15.123:0/2576895466 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f454406c2b0 0x7f454406e770 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f454c034000 tx=0x7f454c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:51.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.733+0000 7f453ffff640 1 -- 172.21.15.123:0/2576895466 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4548059cc0 con 0x7f455806cd20 2024-09-15T23:22:51.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.938+0000 7f455dea6640 1 -- 172.21.15.123:0/2576895466 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45580d2f90 con 0x7f455806cd20 2024-09-15T23:22:51.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.939+0000 7f453ffff640 1 -- 172.21.15.123:0/2576895466 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) ==== 95+0+5259 (secure 0 0 0) 0x7f454805dfc0 con 0x7f455806cd20 2024-09-15T23:22:51.940 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:22:51.940 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":113,"btime":"2024-09-15T23:22:48:735356+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8452,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/1861304244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1861304244},{"type":"v1","addr":"172.21.15.188:6837","nonce":1861304244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":10056,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/2869473990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2869473990},{"type":"v1","addr":"172.21.15.123:6833","nonce":2869473990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":113,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:22:25.896547+0000","modified":"2024-09-15T23:22:48.735339+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10074},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10062":{"gid":10062,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6835/3239002092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3239002092},{"type":"v1","addr":"172.21.15.123:6835","nonce":3239002092}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_10074":{"gid":10074,"name":"d","rank":0,"incarnation":108,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6836/2164993019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2164993019},{"type":"v1","addr":"172.21.15.188:6836","nonce":2164993019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10074,"qdb_cluster":[10074]},"id":12}]} 2024-09-15T23:22:51.940 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 113 2024-09-15T23:22:51.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.941+0000 7f455dea6640 1 -- 172.21.15.123:0/2576895466 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f454406c2b0 msgr2=0x7f454406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:51.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.941+0000 7f455dea6640 1 --2- 172.21.15.123:0/2576895466 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f454406c2b0 0x7f454406e770 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f454c034000 tx=0x7f454c02e000 comp rx=0 tx=0).stop 2024-09-15T23:22:51.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.941+0000 7f455dea6640 1 -- 172.21.15.123:0/2576895466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f455806cd20 msgr2=0x7f4558151c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:51.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.941+0000 7f455dea6640 1 --2- 172.21.15.123:0/2576895466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f455806cd20 0x7f4558151c40 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7f4548007ec0 tx=0x7f454800e4b0 comp rx=0 tx=0).stop 2024-09-15T23:22:51.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.941+0000 7f455dea6640 1 -- 172.21.15.123:0/2576895466 shutdown_connections 2024-09-15T23:22:51.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.941+0000 7f455dea6640 1 --2- 172.21.15.123:0/2576895466 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f455815e6d0 0x7f455815b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:51.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.941+0000 7f455dea6640 1 --2- 172.21.15.123:0/2576895466 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4558070b80 0x7f4558151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:51.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.941+0000 7f455dea6640 1 --2- 172.21.15.123:0/2576895466 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f454406c2b0 0x7f454406e770 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:51.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.941+0000 7f455dea6640 1 --2- 172.21.15.123:0/2576895466 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f455806cd20 0x7f4558151c40 unknown :-1 s=CLOSED pgs=2158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:51.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.941+0000 7f455dea6640 1 -- 172.21.15.123:0/2576895466 >> 172.21.15.123:0/2576895466 conn(0x7f4558067fb0 msgr2=0x7f4558160f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:51.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.941+0000 7f455dea6640 1 -- 172.21.15.123:0/2576895466 shutdown_connections 2024-09-15T23:22:51.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:51.941+0000 7f455dea6640 1 -- 172.21.15.123:0/2576895466 wait complete. 2024-09-15T23:22:51.953 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:22:52.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.050+0000 7fb3c9fc6640 1 Processor -- start 2024-09-15T23:22:52.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.050+0000 7fb3c9fc6640 1 -- start start 2024-09-15T23:22:52.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.050+0000 7fb3c9fc6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb3c415ed20 0x7fb3c40b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:52.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.050+0000 7fb3c9fc6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb3c40d23b0 0x7fb3c40b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:52.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.050+0000 7fb3c9fc6640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3c40d0e70 con 0x7fb3c40cf2d0 2024-09-15T23:22:52.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.050+0000 7fb3c9fc6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fb3c40d41c0 con 0x7fb3c40d23b0 2024-09-15T23:22:52.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.050+0000 7fb3c9fc6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb3c40d35b0 con 0x7fb3c415ed20 2024-09-15T23:22:52.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.051+0000 7fb3c37fe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb3c415ed20 0x7fb3c40b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:52.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.051+0000 7fb3c2ffd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb3c40d23b0 0x7fb3c40b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:52.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.051+0000 7fb3c2ffd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb3c40d23b0 0x7fb3c40b67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:47750/0 (socket says 172.21.15.123:47750) 2024-09-15T23:22:52.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.051+0000 7fb3c37fe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb3c415ed20 0x7fb3c40b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:52972/0 (socket says 172.21.15.123:52972) 2024-09-15T23:22:52.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.051+0000 7fb3c2ffd640 1 -- 172.21.15.123:0/1300949739 learned_addr learned my addr 172.21.15.123:0/1300949739 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:52.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.051+0000 7fb3c3fff640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fb3c40cf2d0 0x7fb3c40cf760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:36744/0 (socket says 172.21.15.123:36744) 2024-09-15T23:22:52.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.051+0000 7fb3c37fe640 1 -- 172.21.15.123:0/1300949739 >> v2:172.21.15.188:3300/0 conn(0x7fb3c40d23b0 msgr2=0x7fb3c40b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:52.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.051+0000 7fb3c37fe640 1 --2- 172.21.15.123:0/1300949739 >> v2:172.21.15.188:3300/0 conn(0x7fb3c40d23b0 0x7fb3c40b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:52.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.051+0000 7fb3c37fe640 1 -- 172.21.15.123:0/1300949739 >> v1:172.21.15.188:6789/0 conn(0x7fb3c40cf2d0 legacy=0x7fb3c40cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:52.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.051+0000 7fb3c27fc640 1 -- 172.21.15.123:0/1300949739 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3836705230 0 0) 0x7fb3bc001490 con 0x7fb3c40cf2d0 2024-09-15T23:22:52.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.051+0000 7fb3c37fe640 1 -- 172.21.15.123:0/1300949739 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3c40d3890 con 0x7fb3c415ed20 2024-09-15T23:22:52.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.051+0000 7fb3c2ffd640 1 --2- 172.21.15.123:0/1300949739 >> v2:172.21.15.188:3300/0 conn(0x7fb3c40d23b0 0x7fb3c40b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:22:52.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.052+0000 7fb3c37fe640 1 --2- 172.21.15.123:0/1300949739 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb3c415ed20 0x7fb3c40b6260 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb3b40097a0 tx=0x7fb3b402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a82e538a524d783 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:52.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.052+0000 7fb3c27fc640 1 -- 172.21.15.123:0/1300949739 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4037070 con 0x7fb3c415ed20 2024-09-15T23:22:52.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.052+0000 7fb3c27fc640 1 -- 172.21.15.123:0/1300949739 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3b4032440 con 0x7fb3c415ed20 2024-09-15T23:22:52.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.052+0000 7fb3c27fc640 1 -- 172.21.15.123:0/1300949739 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4032810 con 0x7fb3c415ed20 2024-09-15T23:22:52.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.052+0000 7fb3c9fc6640 1 -- 172.21.15.123:0/1300949739 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb3c415ed20 msgr2=0x7fb3c40b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:52.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.052+0000 7fb3c9fc6640 1 --2- 172.21.15.123:0/1300949739 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb3c415ed20 0x7fb3c40b6260 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb3b40097a0 tx=0x7fb3b402a180 comp rx=0 tx=0).stop 2024-09-15T23:22:52.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.053+0000 7fb3c9fc6640 1 -- 172.21.15.123:0/1300949739 shutdown_connections 2024-09-15T23:22:52.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.053+0000 7fb3c9fc6640 1 --2- 172.21.15.123:0/1300949739 >> v2:172.21.15.188:3300/0 conn(0x7fb3c40d23b0 0x7fb3c40b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:52.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.053+0000 7fb3c9fc6640 1 --2- 172.21.15.123:0/1300949739 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb3c415ed20 0x7fb3c40b6260 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:52.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.053+0000 7fb3c9fc6640 1 -- 172.21.15.123:0/1300949739 >> 172.21.15.123:0/1300949739 conn(0x7fb3c40d1260 msgr2=0x7fb3c40d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:52.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.053+0000 7fb3c9fc6640 1 -- 172.21.15.123:0/1300949739 shutdown_connections 2024-09-15T23:22:52.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.053+0000 7fb3c9fc6640 1 -- 172.21.15.123:0/1300949739 wait complete. 2024-09-15T23:22:52.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.054+0000 7fb3c9fc6640 1 Processor -- start 2024-09-15T23:22:52.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.054+0000 7fb3c9fc6640 1 -- start start 2024-09-15T23:22:52.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.055+0000 7fb3c9fc6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb3c40cf2d0 0x7fb3c40ac930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:52.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.055+0000 7fb3c9fc6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb3c40d23b0 0x7fb3c4153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:52.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.055+0000 7fb3c9fc6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3c415ed20 0x7fb3c40ad7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:52.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.055+0000 7fb3c9fc6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c40d32a0 con 0x7fb3c415ed20 2024-09-15T23:22:52.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.055+0000 7fb3c9fc6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c40d3e50 con 0x7fb3c40d23b0 2024-09-15T23:22:52.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.055+0000 7fb3c9fc6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb3c415f100 con 0x7fb3c40cf2d0 2024-09-15T23:22:52.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.055+0000 7fb3c3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3c415ed20 0x7fb3c40ad7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:52.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.055+0000 7fb3c37fe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb3c40cf2d0 0x7fb3c40ac930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:52.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.055+0000 7fb3c37fe640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb3c40cf2d0 0x7fb3c40ac930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:52978/0 (socket says 172.21.15.123:52978) 2024-09-15T23:22:52.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.055+0000 7fb3c2ffd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb3c40d23b0 0x7fb3c4153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:52.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.055+0000 7fb3c3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3c415ed20 0x7fb3c40ad7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59460/0 (socket says 172.21.15.123:59460) 2024-09-15T23:22:52.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.055+0000 7fb3c37fe640 1 -- 172.21.15.123:0/3022373067 learned_addr learned my addr 172.21.15.123:0/3022373067 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:52.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.055+0000 7fb3c3fff640 1 -- 172.21.15.123:0/3022373067 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb3c40cf2d0 msgr2=0x7fb3c40ac930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:52.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.055+0000 7fb3c3fff640 1 --2- 172.21.15.123:0/3022373067 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb3c40cf2d0 0x7fb3c40ac930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:52.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.055+0000 7fb3c3fff640 1 -- 172.21.15.123:0/3022373067 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb3c40d23b0 msgr2=0x7fb3c4153b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:52.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.055+0000 7fb3c3fff640 1 --2- 172.21.15.123:0/3022373067 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb3c40d23b0 0x7fb3c4153b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:52.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.055+0000 7fb3c3fff640 1 -- 172.21.15.123:0/3022373067 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3c40ab890 con 0x7fb3c415ed20 2024-09-15T23:22:52.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.055+0000 7fb3c37fe640 1 --2- 172.21.15.123:0/3022373067 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb3c40cf2d0 0x7fb3c40ac930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:22:52.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.055+0000 7fb3c3fff640 1 --2- 172.21.15.123:0/3022373067 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3c415ed20 0x7fb3c40ad7f0 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc00c750 tx=0x7fb3bc00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:52.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.055+0000 7fb3abfff640 1 -- 172.21.15.123:0/3022373067 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc018070 con 0x7fb3c415ed20 2024-09-15T23:22:52.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.055+0000 7fb3abfff640 1 -- 172.21.15.123:0/3022373067 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3bc004d60 con 0x7fb3c415ed20 2024-09-15T23:22:52.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.055+0000 7fb3c9fc6640 1 -- 172.21.15.123:0/3022373067 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3c40abb70 con 0x7fb3c415ed20 2024-09-15T23:22:52.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.055+0000 7fb3abfff640 1 -- 172.21.15.123:0/3022373067 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc00a880 con 0x7fb3c415ed20 2024-09-15T23:22:52.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.055+0000 7fb3c9fc6640 1 -- 172.21.15.123:0/3022373067 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3c40ac130 con 0x7fb3c415ed20 2024-09-15T23:22:52.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.056+0000 7fb3c9fc6640 1 -- 172.21.15.123:0/3022373067 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3c40b7010 con 0x7fb3c415ed20 2024-09-15T23:22:52.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.057+0000 7fb3abfff640 1 -- 172.21.15.123:0/3022373067 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb3bc00aa20 con 0x7fb3c415ed20 2024-09-15T23:22:52.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.057+0000 7fb3abfff640 1 --2- 172.21.15.123:0/3022373067 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb3b006c2b0 0x7fb3b006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:52.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.057+0000 7fb3abfff640 1 -- 172.21.15.123:0/3022373067 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7fb3bc08a900 con 0x7fb3c415ed20 2024-09-15T23:22:52.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.058+0000 7fb3c37fe640 1 --2- 172.21.15.123:0/3022373067 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb3b006c2b0 0x7fb3b006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:52.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.058+0000 7fb3c37fe640 1 --2- 172.21.15.123:0/3022373067 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb3b006c2b0 0x7fb3b006e770 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fb3b402a1c0 tx=0x7fb3b402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:52.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.061+0000 7fb3abfff640 1 -- 172.21.15.123:0/3022373067 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb3c40d0e70 con 0x7fb3c415ed20 2024-09-15T23:22:52.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.264+0000 7fb3c9fc6640 1 -- 172.21.15.123:0/3022373067 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb3c40d0a90 con 0x7fb3c415ed20 2024-09-15T23:22:52.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.264+0000 7fb3abfff640 1 -- 172.21.15.123:0/3022373067 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) ==== 95+0+5259 (secure 0 0 0) 0x7fb3bc0589a0 con 0x7fb3c415ed20 2024-09-15T23:22:52.266 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:22:52.266 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":113,"btime":"2024-09-15T23:22:48:735356+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8452,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/1861304244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1861304244},{"type":"v1","addr":"172.21.15.188:6837","nonce":1861304244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":10056,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/2869473990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2869473990},{"type":"v1","addr":"172.21.15.123:6833","nonce":2869473990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":113,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:22:25.896547+0000","modified":"2024-09-15T23:22:48.735339+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10074},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10062":{"gid":10062,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6835/3239002092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3239002092},{"type":"v1","addr":"172.21.15.123:6835","nonce":3239002092}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_10074":{"gid":10074,"name":"d","rank":0,"incarnation":108,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6836/2164993019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2164993019},{"type":"v1","addr":"172.21.15.188:6836","nonce":2164993019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10074,"qdb_cluster":[10074]},"id":12}]} 2024-09-15T23:22:52.266 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 113 2024-09-15T23:22:52.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.267+0000 7fb3c9fc6640 1 -- 172.21.15.123:0/3022373067 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb3b006c2b0 msgr2=0x7fb3b006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:52.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.267+0000 7fb3c9fc6640 1 --2- 172.21.15.123:0/3022373067 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb3b006c2b0 0x7fb3b006e770 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fb3b402a1c0 tx=0x7fb3b402e000 comp rx=0 tx=0).stop 2024-09-15T23:22:52.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.267+0000 7fb3c9fc6640 1 -- 172.21.15.123:0/3022373067 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3c415ed20 msgr2=0x7fb3c40ad7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:52.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.267+0000 7fb3c9fc6640 1 --2- 172.21.15.123:0/3022373067 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3c415ed20 0x7fb3c40ad7f0 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc00c750 tx=0x7fb3bc00cc10 comp rx=0 tx=0).stop 2024-09-15T23:22:52.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.267+0000 7fb3c9fc6640 1 -- 172.21.15.123:0/3022373067 shutdown_connections 2024-09-15T23:22:52.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.267+0000 7fb3c9fc6640 1 --2- 172.21.15.123:0/3022373067 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb3b006c2b0 0x7fb3b006e770 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:52.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.267+0000 7fb3c9fc6640 1 --2- 172.21.15.123:0/3022373067 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3c415ed20 0x7fb3c40ad7f0 unknown :-1 s=CLOSED pgs=2159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:52.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.267+0000 7fb3c9fc6640 1 --2- 172.21.15.123:0/3022373067 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb3c40d23b0 0x7fb3c4153b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:52.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.267+0000 7fb3c9fc6640 1 --2- 172.21.15.123:0/3022373067 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb3c40cf2d0 0x7fb3c40ac930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:52.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.267+0000 7fb3c9fc6640 1 -- 172.21.15.123:0/3022373067 >> 172.21.15.123:0/3022373067 conn(0x7fb3c40d1260 msgr2=0x7fb3c40b5400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:52.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.267+0000 7fb3c9fc6640 1 -- 172.21.15.123:0/3022373067 shutdown_connections 2024-09-15T23:22:52.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.267+0000 7fb3c9fc6640 1 -- 172.21.15.123:0/3022373067 wait complete. 2024-09-15T23:22:52.279 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:22:52.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.377+0000 7fd15b24c640 1 Processor -- start 2024-09-15T23:22:52.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.377+0000 7fd15b24c640 1 -- start start 2024-09-15T23:22:52.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.378+0000 7fd15b24c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd15406c320 0x7fd15415bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:52.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.378+0000 7fd15b24c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd15413eb20 0x7fd15415c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:52.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.378+0000 7fd15b24c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd154071180 con 0x7fd1540b2d40 2024-09-15T23:22:52.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.378+0000 7fd15b24c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fd154071ab0 con 0x7fd15413eb20 2024-09-15T23:22:52.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.378+0000 7fd15b24c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd154071460 con 0x7fd15406c320 2024-09-15T23:22:52.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.378+0000 7fd153fff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd15406c320 0x7fd15415bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:52.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.378+0000 7fd1597e9640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd15413eb20 0x7fd15415c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:52.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.378+0000 7fd1597e9640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd15413eb20 0x7fd15415c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:47762/0 (socket says 172.21.15.123:47762) 2024-09-15T23:22:52.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.378+0000 7fd158fe8640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fd1540b2d40 0x7fd15406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:36748/0 (socket says 172.21.15.123:36748) 2024-09-15T23:22:52.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.378+0000 7fd153fff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd15406c320 0x7fd15415bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:52994/0 (socket says 172.21.15.123:52994) 2024-09-15T23:22:52.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.378+0000 7fd1597e9640 1 -- 172.21.15.123:0/489658589 learned_addr learned my addr 172.21.15.123:0/489658589 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:52.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.378+0000 7fd1537fe640 1 -- 172.21.15.123:0/489658589 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1350118619 0 0) 0x7fd154071180 con 0x7fd1540b2d40 2024-09-15T23:22:52.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.378+0000 7fd153fff640 1 -- 172.21.15.123:0/489658589 >> v2:172.21.15.188:3300/0 conn(0x7fd15413eb20 msgr2=0x7fd15415c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:52.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.378+0000 7fd153fff640 1 --2- 172.21.15.123:0/489658589 >> v2:172.21.15.188:3300/0 conn(0x7fd15413eb20 0x7fd15415c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:52.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.378+0000 7fd153fff640 1 -- 172.21.15.123:0/489658589 >> v1:172.21.15.188:6789/0 conn(0x7fd1540b2d40 legacy=0x7fd15406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:52.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.378+0000 7fd153fff640 1 -- 172.21.15.123:0/489658589 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd154071740 con 0x7fd15406c320 2024-09-15T23:22:52.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.378+0000 7fd1597e9640 1 --2- 172.21.15.123:0/489658589 >> v2:172.21.15.188:3300/0 conn(0x7fd15413eb20 0x7fd15415c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:22:52.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.379+0000 7fd153fff640 1 --2- 172.21.15.123:0/489658589 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd15406c320 0x7fd15415bcf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd1400097a0 tx=0x7fd14002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5ebb3fd33408e2b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:52.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.379+0000 7fd1537fe640 1 -- 172.21.15.123:0/489658589 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd140037070 con 0x7fd15406c320 2024-09-15T23:22:52.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.379+0000 7fd1537fe640 1 -- 172.21.15.123:0/489658589 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd140032440 con 0x7fd15406c320 2024-09-15T23:22:52.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.379+0000 7fd1537fe640 1 -- 172.21.15.123:0/489658589 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd140032810 con 0x7fd15406c320 2024-09-15T23:22:52.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.380+0000 7fd15b24c640 1 -- 172.21.15.123:0/489658589 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd15406c320 msgr2=0x7fd15415bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:52.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.380+0000 7fd15b24c640 1 --2- 172.21.15.123:0/489658589 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd15406c320 0x7fd15415bcf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd1400097a0 tx=0x7fd14002a180 comp rx=0 tx=0).stop 2024-09-15T23:22:52.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.380+0000 7fd15b24c640 1 -- 172.21.15.123:0/489658589 shutdown_connections 2024-09-15T23:22:52.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.380+0000 7fd15b24c640 1 --2- 172.21.15.123:0/489658589 >> v2:172.21.15.188:3300/0 conn(0x7fd15413eb20 0x7fd15415c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:52.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.380+0000 7fd15b24c640 1 --2- 172.21.15.123:0/489658589 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd15406c320 0x7fd15415bcf0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:52.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.380+0000 7fd15b24c640 1 -- 172.21.15.123:0/489658589 >> 172.21.15.123:0/489658589 conn(0x7fd1540ccec0 msgr2=0x7fd1540cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:52.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.380+0000 7fd15b24c640 1 -- 172.21.15.123:0/489658589 shutdown_connections 2024-09-15T23:22:52.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.380+0000 7fd15b24c640 1 -- 172.21.15.123:0/489658589 wait complete. 2024-09-15T23:22:52.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.381+0000 7fd15b24c640 1 Processor -- start 2024-09-15T23:22:52.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.381+0000 7fd15b24c640 1 -- start start 2024-09-15T23:22:52.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.382+0000 7fd15b24c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd15406c320 0x7fd1541554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:52.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.382+0000 7fd15b24c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd1540b2d40 0x7fd154157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:52.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.382+0000 7fd15b24c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd15413eb20 0x7fd154158170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:52.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.382+0000 7fd15b24c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd1540720c0 con 0x7fd15413eb20 2024-09-15T23:22:52.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.382+0000 7fd15b24c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd154071f40 con 0x7fd15406c320 2024-09-15T23:22:52.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.382+0000 7fd15b24c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd154072240 con 0x7fd1540b2d40 2024-09-15T23:22:52.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.382+0000 7fd1597e9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd15413eb20 0x7fd154158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:52.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.382+0000 7fd1597e9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd15413eb20 0x7fd154158170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59466/0 (socket says 172.21.15.123:59466) 2024-09-15T23:22:52.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.382+0000 7fd1597e9640 1 -- 172.21.15.123:0/276775729 learned_addr learned my addr 172.21.15.123:0/276775729 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:52.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.382+0000 7fd153fff640 1 --2- 172.21.15.123:0/276775729 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd1540b2d40 0x7fd154157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:52.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.382+0000 7fd158fe8640 1 --2- 172.21.15.123:0/276775729 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd15406c320 0x7fd1541554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:52.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.382+0000 7fd1597e9640 1 -- 172.21.15.123:0/276775729 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd1540b2d40 msgr2=0x7fd154157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:52.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.382+0000 7fd1597e9640 1 --2- 172.21.15.123:0/276775729 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd1540b2d40 0x7fd154157c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:52.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.382+0000 7fd1597e9640 1 -- 172.21.15.123:0/276775729 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd15406c320 msgr2=0x7fd1541554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:52.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.382+0000 7fd1597e9640 1 --2- 172.21.15.123:0/276775729 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd15406c320 0x7fd1541554c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:52.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.382+0000 7fd1597e9640 1 -- 172.21.15.123:0/276775729 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd15415b310 con 0x7fd15413eb20 2024-09-15T23:22:52.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.383+0000 7fd1597e9640 1 --2- 172.21.15.123:0/276775729 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd15413eb20 0x7fd154158170 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7fd14c009430 tx=0x7fd14c00e490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:52.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.383+0000 7fd1517fa640 1 -- 172.21.15.123:0/276775729 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14c01a070 con 0x7fd15413eb20 2024-09-15T23:22:52.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.383+0000 7fd1517fa640 1 -- 172.21.15.123:0/276775729 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd14c00b2f0 con 0x7fd15413eb20 2024-09-15T23:22:52.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.383+0000 7fd1517fa640 1 -- 172.21.15.123:0/276775729 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14c009840 con 0x7fd15413eb20 2024-09-15T23:22:52.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.383+0000 7fd15b24c640 1 -- 172.21.15.123:0/276775729 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd15415a270 con 0x7fd15413eb20 2024-09-15T23:22:52.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.383+0000 7fd15b24c640 1 -- 172.21.15.123:0/276775729 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd15415a830 con 0x7fd15413eb20 2024-09-15T23:22:52.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.384+0000 7fd15b24c640 1 -- 172.21.15.123:0/276775729 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd15406bc10 con 0x7fd15413eb20 2024-09-15T23:22:52.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.384+0000 7fd1517fa640 1 -- 172.21.15.123:0/276775729 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd14c005d10 con 0x7fd15413eb20 2024-09-15T23:22:52.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.385+0000 7fd1517fa640 1 --2- 172.21.15.123:0/276775729 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd13806c2e0 0x7fd13806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:52.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.385+0000 7fd1517fa640 1 -- 172.21.15.123:0/276775729 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7fd14c08b710 con 0x7fd15413eb20 2024-09-15T23:22:52.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.385+0000 7fd158fe8640 1 --2- 172.21.15.123:0/276775729 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd13806c2e0 0x7fd13806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:52.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.385+0000 7fd158fe8640 1 --2- 172.21.15.123:0/276775729 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd13806c2e0 0x7fd13806e7a0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fd148000f60 tx=0x7fd148007b70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:52.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.389+0000 7fd1517fa640 1 -- 172.21.15.123:0/276775729 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd14c059e80 con 0x7fd15413eb20 2024-09-15T23:22:52.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.555+0000 7fd15b24c640 1 -- 172.21.15.123:0/276775729 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd15406c9c0 con 0x7fd15413eb20 2024-09-15T23:22:52.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.556+0000 7fd1517fa640 1 -- 172.21.15.123:0/276775729 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v182) ==== 74+0+16707 (secure 0 0 0) 0x7fd14c059780 con 0x7fd15413eb20 2024-09-15T23:22:52.557 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:22:52.557 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":182,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:22:27.559444+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:22:23.593537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-15T23:22:24.884391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:22:52.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.558+0000 7fd15b24c640 1 -- 172.21.15.123:0/276775729 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd13806c2e0 msgr2=0x7fd13806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:52.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.558+0000 7fd15b24c640 1 --2- 172.21.15.123:0/276775729 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd13806c2e0 0x7fd13806e7a0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fd148000f60 tx=0x7fd148007b70 comp rx=0 tx=0).stop 2024-09-15T23:22:52.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.558+0000 7fd15b24c640 1 -- 172.21.15.123:0/276775729 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd15413eb20 msgr2=0x7fd154158170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:52.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.558+0000 7fd15b24c640 1 --2- 172.21.15.123:0/276775729 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd15413eb20 0x7fd154158170 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7fd14c009430 tx=0x7fd14c00e490 comp rx=0 tx=0).stop 2024-09-15T23:22:52.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.558+0000 7fd15b24c640 1 -- 172.21.15.123:0/276775729 shutdown_connections 2024-09-15T23:22:52.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.558+0000 7fd15b24c640 1 --2- 172.21.15.123:0/276775729 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd13806c2e0 0x7fd13806e7a0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:52.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.558+0000 7fd15b24c640 1 --2- 172.21.15.123:0/276775729 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd15413eb20 0x7fd154158170 unknown :-1 s=CLOSED pgs=2160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:52.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.558+0000 7fd15b24c640 1 --2- 172.21.15.123:0/276775729 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd1540b2d40 0x7fd154157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:52.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.558+0000 7fd15b24c640 1 --2- 172.21.15.123:0/276775729 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd15406c320 0x7fd1541554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:52.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.558+0000 7fd15b24c640 1 -- 172.21.15.123:0/276775729 >> 172.21.15.123:0/276775729 conn(0x7fd1540ccec0 msgr2=0x7fd15413d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:52.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.558+0000 7fd15b24c640 1 -- 172.21.15.123:0/276775729 shutdown_connections 2024-09-15T23:22:52.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.558+0000 7fd15b24c640 1 -- 172.21.15.123:0/276775729 wait complete. 2024-09-15T23:22:52.570 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T23:22:52.570 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:22:52.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.668+0000 7f8a395f8640 1 Processor -- start 2024-09-15T23:22:52.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.668+0000 7f8a395f8640 1 -- start start 2024-09-15T23:22:52.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.669+0000 7f8a395f8640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8a340b6970 0x7f8a340b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:52.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.669+0000 7f8a395f8640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a340d0e70 con 0x7f8a340d23b0 2024-09-15T23:22:52.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.669+0000 7f8a395f8640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a340d41c0 con 0x7f8a3415ed20 2024-09-15T23:22:52.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.669+0000 7f8a395f8640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8a340d35b0 con 0x7f8a340b6970 2024-09-15T23:22:52.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.669+0000 7f8a337fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8a340d23b0 0x7f8a340b8610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:45294/0 (socket says 172.21.15.123:45294) 2024-09-15T23:22:52.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.669+0000 7f8a337fe640 1 -- 172.21.15.123:0/2057553818 learned_addr learned my addr 172.21.15.123:0/2057553818 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:52.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.669+0000 7f8a327fc640 1 --2- 172.21.15.123:0/2057553818 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8a340b6970 0x7f8a340b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:52.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.669+0000 7f8a31ffb640 1 -- 172.21.15.123:0/2057553818 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2413847561 0 0) 0x7f8a2c001490 con 0x7f8a340d23b0 2024-09-15T23:22:52.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.669+0000 7f8a31ffb640 1 -- 172.21.15.123:0/2057553818 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a1c003520 con 0x7f8a340d23b0 2024-09-15T23:22:52.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.669+0000 7f8a31ffb640 1 -- 172.21.15.123:0/2057553818 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1325141713 0 0) 0x7f8a340d41c0 con 0x7f8a3415ed20 2024-09-15T23:22:52.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.669+0000 7f8a31ffb640 1 -- 172.21.15.123:0/2057553818 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a2c001490 con 0x7f8a3415ed20 2024-09-15T23:22:52.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.669+0000 7f8a31ffb640 1 -- 172.21.15.123:0/2057553818 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2457976474 0 0) 0x7f8a1c003520 con 0x7f8a340d23b0 2024-09-15T23:22:52.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.669+0000 7f8a327fc640 1 -- 172.21.15.123:0/2057553818 >> v1:172.21.15.188:6789/0 conn(0x7f8a3415ed20 legacy=0x7f8a340b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:52.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.669+0000 7f8a327fc640 1 -- 172.21.15.123:0/2057553818 >> v1:172.21.15.123:6789/0 conn(0x7f8a340d23b0 legacy=0x7f8a340b8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:52.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.669+0000 7f8a327fc640 1 -- 172.21.15.123:0/2057553818 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a340d3890 con 0x7f8a340b6970 2024-09-15T23:22:52.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.670+0000 7f8a327fc640 1 --2- 172.21.15.123:0/2057553818 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8a340b6970 0x7f8a340b80d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8a280097d0 tx=0x7f8a2802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd83ee294b062c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:52.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.670+0000 7f8a31ffb640 1 -- 172.21.15.123:0/2057553818 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a28037070 con 0x7f8a340b6970 2024-09-15T23:22:52.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.670+0000 7f8a31ffb640 1 -- 172.21.15.123:0/2057553818 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a2802ab90 con 0x7f8a340b6970 2024-09-15T23:22:52.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.670+0000 7f8a31ffb640 1 -- 172.21.15.123:0/2057553818 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c001bc0 con 0x7f8a340b6970 2024-09-15T23:22:52.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.671+0000 7f8a395f8640 1 -- 172.21.15.123:0/2057553818 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8a340b6970 msgr2=0x7f8a340b80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:52.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.671+0000 7f8a395f8640 1 --2- 172.21.15.123:0/2057553818 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8a340b6970 0x7f8a340b80d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8a280097d0 tx=0x7f8a2802a100 comp rx=0 tx=0).stop 2024-09-15T23:22:52.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.671+0000 7f8a395f8640 1 -- 172.21.15.123:0/2057553818 shutdown_connections 2024-09-15T23:22:52.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.671+0000 7f8a395f8640 1 --2- 172.21.15.123:0/2057553818 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8a340b6970 0x7f8a340b80d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:52.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.671+0000 7f8a395f8640 1 -- 172.21.15.123:0/2057553818 >> 172.21.15.123:0/2057553818 conn(0x7f8a340d1260 msgr2=0x7f8a340d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:52.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.671+0000 7f8a395f8640 1 -- 172.21.15.123:0/2057553818 shutdown_connections 2024-09-15T23:22:52.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.671+0000 7f8a395f8640 1 -- 172.21.15.123:0/2057553818 wait complete. 2024-09-15T23:22:52.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.672+0000 7f8a395f8640 1 Processor -- start 2024-09-15T23:22:52.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.672+0000 7f8a395f8640 1 -- start start 2024-09-15T23:22:52.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.673+0000 7f8a395f8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a340b6970 0x7f8a340ce860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:52.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.673+0000 7f8a395f8640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8a340d23b0 0x7f8a341576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:52.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.673+0000 7f8a395f8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a3415ed20 0x7f8a340b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:52.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.673+0000 7f8a395f8640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8a340d32a0 con 0x7f8a3415ed20 2024-09-15T23:22:52.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.673+0000 7f8a395f8640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8a340d3e50 con 0x7f8a340b6970 2024-09-15T23:22:52.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.673+0000 7f8a395f8640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8a3415f100 con 0x7f8a340d23b0 2024-09-15T23:22:52.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.673+0000 7f8a337fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a3415ed20 0x7f8a340b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:52.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.673+0000 7f8a337fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a3415ed20 0x7f8a340b32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59474/0 (socket says 172.21.15.123:59474) 2024-09-15T23:22:52.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.673+0000 7f8a337fe640 1 -- 172.21.15.123:0/2827580542 learned_addr learned my addr 172.21.15.123:0/2827580542 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:52.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.673+0000 7f8a327fc640 1 --2- 172.21.15.123:0/2827580542 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8a340d23b0 0x7f8a341576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:52.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.673+0000 7f8a32ffd640 1 --2- 172.21.15.123:0/2827580542 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a340b6970 0x7f8a340ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:52.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.673+0000 7f8a337fe640 1 -- 172.21.15.123:0/2827580542 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8a340d23b0 msgr2=0x7f8a341576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:52.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.673+0000 7f8a337fe640 1 --2- 172.21.15.123:0/2827580542 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8a340d23b0 0x7f8a341576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:52.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.673+0000 7f8a337fe640 1 -- 172.21.15.123:0/2827580542 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a340b6970 msgr2=0x7f8a340ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:52.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.673+0000 7f8a337fe640 1 --2- 172.21.15.123:0/2827580542 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a340b6970 0x7f8a340ce860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:52.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.673+0000 7f8a337fe640 1 -- 172.21.15.123:0/2827580542 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a34157e70 con 0x7f8a3415ed20 2024-09-15T23:22:52.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.674+0000 7f8a337fe640 1 --2- 172.21.15.123:0/2827580542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a3415ed20 0x7f8a340b32d0 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c005c00 tx=0x7f8a2c001cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:52.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.674+0000 7f8a1b7fe640 1 -- 172.21.15.123:0/2827580542 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c017070 con 0x7f8a3415ed20 2024-09-15T23:22:52.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.674+0000 7f8a1b7fe640 1 -- 172.21.15.123:0/2827580542 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a2c012400 con 0x7f8a3415ed20 2024-09-15T23:22:52.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.674+0000 7f8a395f8640 1 -- 172.21.15.123:0/2827580542 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a34158150 con 0x7f8a3415ed20 2024-09-15T23:22:52.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.674+0000 7f8a1b7fe640 1 -- 172.21.15.123:0/2827580542 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c0127d0 con 0x7f8a3415ed20 2024-09-15T23:22:52.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.674+0000 7f8a395f8640 1 -- 172.21.15.123:0/2827580542 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a340cb8b0 con 0x7f8a3415ed20 2024-09-15T23:22:52.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.675+0000 7f8a395f8640 1 -- 172.21.15.123:0/2827580542 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a340b7010 con 0x7f8a3415ed20 2024-09-15T23:22:52.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.675+0000 7f8a1b7fe640 1 -- 172.21.15.123:0/2827580542 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8a2c01a070 con 0x7f8a3415ed20 2024-09-15T23:22:52.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.676+0000 7f8a1b7fe640 1 --2- 172.21.15.123:0/2827580542 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8a2006c2b0 0x7f8a2006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:52.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.676+0000 7f8a1b7fe640 1 -- 172.21.15.123:0/2827580542 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f8a2c08b5a0 con 0x7f8a3415ed20 2024-09-15T23:22:52.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.676+0000 7f8a32ffd640 1 --2- 172.21.15.123:0/2827580542 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8a2006c2b0 0x7f8a2006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:52.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.676+0000 7f8a32ffd640 1 --2- 172.21.15.123:0/2827580542 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8a2006c2b0 0x7f8a2006e770 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f8a240011e0 tx=0x7f8a24009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:52.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.680+0000 7f8a1b7fe640 1 -- 172.21.15.123:0/2827580542 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8a340d0e70 con 0x7f8a3415ed20 2024-09-15T23:22:52.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.879+0000 7f8a395f8640 1 -- 172.21.15.123:0/2827580542 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a340b3f20 con 0x7f8a3415ed20 2024-09-15T23:22:52.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.880+0000 7f8a1b7fe640 1 -- 172.21.15.123:0/2827580542 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) ==== 95+0+5259 (secure 0 0 0) 0x7f8a2c059d10 con 0x7f8a3415ed20 2024-09-15T23:22:52.881 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:22:52.881 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":113,"btime":"2024-09-15T23:22:48:735356+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8452,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/1861304244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1861304244},{"type":"v1","addr":"172.21.15.188:6837","nonce":1861304244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":10056,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/2869473990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2869473990},{"type":"v1","addr":"172.21.15.123:6833","nonce":2869473990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":113,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:22:25.896547+0000","modified":"2024-09-15T23:22:48.735339+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10074},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10062":{"gid":10062,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6835/3239002092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3239002092},{"type":"v1","addr":"172.21.15.123:6835","nonce":3239002092}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_10074":{"gid":10074,"name":"d","rank":0,"incarnation":108,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6836/2164993019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2164993019},{"type":"v1","addr":"172.21.15.188:6836","nonce":2164993019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10074,"qdb_cluster":[10074]},"id":12}]} 2024-09-15T23:22:52.881 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 113 2024-09-15T23:22:52.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.881+0000 7f8a395f8640 1 -- 172.21.15.123:0/2827580542 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8a2006c2b0 msgr2=0x7f8a2006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:52.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.881+0000 7f8a395f8640 1 --2- 172.21.15.123:0/2827580542 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8a2006c2b0 0x7f8a2006e770 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f8a240011e0 tx=0x7f8a24009040 comp rx=0 tx=0).stop 2024-09-15T23:22:52.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.881+0000 7f8a395f8640 1 -- 172.21.15.123:0/2827580542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a3415ed20 msgr2=0x7f8a340b32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:52.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.881+0000 7f8a395f8640 1 --2- 172.21.15.123:0/2827580542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a3415ed20 0x7f8a340b32d0 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c005c00 tx=0x7f8a2c001cf0 comp rx=0 tx=0).stop 2024-09-15T23:22:52.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.882+0000 7f8a395f8640 1 -- 172.21.15.123:0/2827580542 shutdown_connections 2024-09-15T23:22:52.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.882+0000 7f8a395f8640 1 --2- 172.21.15.123:0/2827580542 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8a2006c2b0 0x7f8a2006e770 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:52.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.882+0000 7f8a395f8640 1 --2- 172.21.15.123:0/2827580542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a3415ed20 0x7f8a340b32d0 unknown :-1 s=CLOSED pgs=2162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:52.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.882+0000 7f8a395f8640 1 --2- 172.21.15.123:0/2827580542 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8a340d23b0 0x7f8a341576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:52.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.882+0000 7f8a395f8640 1 --2- 172.21.15.123:0/2827580542 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a340b6970 0x7f8a340ce860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:52.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.882+0000 7f8a395f8640 1 -- 172.21.15.123:0/2827580542 >> 172.21.15.123:0/2827580542 conn(0x7f8a340d1260 msgr2=0x7f8a340d1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:52.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.882+0000 7f8a395f8640 1 -- 172.21.15.123:0/2827580542 shutdown_connections 2024-09-15T23:22:52.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.882+0000 7f8a395f8640 1 -- 172.21.15.123:0/2827580542 wait complete. 2024-09-15T23:22:52.894 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:22:52.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.991+0000 7f85beb9f640 1 Processor -- start 2024-09-15T23:22:52.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.991+0000 7f85beb9f640 1 -- start start 2024-09-15T23:22:52.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.992+0000 7f85beb9f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f85b815e790 0x7f85b8073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:52.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.992+0000 7f85beb9f640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85b81631c0 con 0x7f85b8162c60 2024-09-15T23:22:52.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.992+0000 7f85beb9f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85b80ae9a0 con 0x7f85b806f730 2024-09-15T23:22:52.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.992+0000 7f85beb9f640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f85b815eb70 con 0x7f85b815e790 2024-09-15T23:22:52.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.992+0000 7f85b7fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f85b8162c60 0x7f85b80b5430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:45308/0 (socket says 172.21.15.123:45308) 2024-09-15T23:22:52.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.992+0000 7f85b7fff640 1 -- 172.21.15.123:0/330092574 learned_addr learned my addr 172.21.15.123:0/330092574 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:52.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.992+0000 7f85bc93b640 1 --2- 172.21.15.123:0/330092574 >> v2:172.21.15.188:3300/0 conn(0x7f85b815e790 0x7f85b8073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:52.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.992+0000 7f85b77fe640 1 -- 172.21.15.123:0/330092574 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3851264226 0 0) 0x7f85b81631c0 con 0x7f85b8162c60 2024-09-15T23:22:52.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.992+0000 7f85b77fe640 1 -- 172.21.15.123:0/330092574 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85a8003520 con 0x7f85b8162c60 2024-09-15T23:22:52.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.992+0000 7f85b77fe640 1 -- 172.21.15.123:0/330092574 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 450931035 0 0) 0x7f85a8003520 con 0x7f85b8162c60 2024-09-15T23:22:52.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.992+0000 7f85b77fe640 1 -- 172.21.15.123:0/330092574 >> v2:172.21.15.188:3300/0 conn(0x7f85b815e790 msgr2=0x7f85b8073a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:52.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.992+0000 7f85b77fe640 1 --2- 172.21.15.123:0/330092574 >> v2:172.21.15.188:3300/0 conn(0x7f85b815e790 0x7f85b8073a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:52.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.992+0000 7f85b77fe640 1 -- 172.21.15.123:0/330092574 >> v1:172.21.15.188:6789/0 conn(0x7f85b806f730 legacy=0x7f85b806fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:52.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.992+0000 7f85b77fe640 1 -- 172.21.15.123:0/330092574 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85b80aec40 con 0x7f85b8162c60 2024-09-15T23:22:52.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.992+0000 7f85b77fe640 1 -- 172.21.15.123:0/330092574 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f85a4001670 con 0x7f85b8162c60 2024-09-15T23:22:52.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.992+0000 7f85b77fe640 1 -- 172.21.15.123:0/330092574 >> v1:172.21.15.123:6789/0 conn(0x7f85b8162c60 legacy=0x7f85b80b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:52.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.992+0000 7f85b77fe640 1 --2- 172.21.15.123:0/330092574 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85a80039b0 0x7f85a8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:52.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.992+0000 7f85b77fe640 1 --2- 172.21.15.123:0/330092574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85a8004800 0x7f85a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:52.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.992+0000 7f85b77fe640 1 --2- 172.21.15.123:0/330092574 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85a80052e0 0x7f85a800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:52.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.992+0000 7f85b77fe640 1 -- 172.21.15.123:0/330092574 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f85a800c180 con 0x7f85a8004800 2024-09-15T23:22:52.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.992+0000 7f85b77fe640 1 -- 172.21.15.123:0/330092574 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f85a800c330 con 0x7f85a80052e0 2024-09-15T23:22:52.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.992+0000 7f85b77fe640 1 -- 172.21.15.123:0/330092574 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f85a800c530 con 0x7f85a80039b0 2024-09-15T23:22:52.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.993+0000 7f85b7fff640 1 --2- 172.21.15.123:0/330092574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85a8004800 0x7f85a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:52.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.993+0000 7f85bc93b640 1 --2- 172.21.15.123:0/330092574 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85a80039b0 0x7f85a8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:52.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.993+0000 7f85bd13c640 1 --2- 172.21.15.123:0/330092574 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85a80052e0 0x7f85a800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:52.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.993+0000 7f85b7fff640 1 -- 172.21.15.123:0/330092574 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85a80039b0 msgr2=0x7f85a8003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:52.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.993+0000 7f85b7fff640 1 --2- 172.21.15.123:0/330092574 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85a80039b0 0x7f85a8003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:52.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.993+0000 7f85b7fff640 1 -- 172.21.15.123:0/330092574 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85a80052e0 msgr2=0x7f85a800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:52.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.993+0000 7f85b7fff640 1 --2- 172.21.15.123:0/330092574 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85a80052e0 0x7f85a800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:52.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.993+0000 7f85b7fff640 1 -- 172.21.15.123:0/330092574 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85a8003520 con 0x7f85a8004800 2024-09-15T23:22:52.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.993+0000 7f85bd13c640 1 -- 172.21.15.123:0/330092574 reap_dead start 2024-09-15T23:22:52.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.994+0000 7f85b7fff640 1 --2- 172.21.15.123:0/330092574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85a8004800 0x7f85a8004c80 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7f85a400c240 tx=0x7f85a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac88cc3ae00ff839 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:52.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.994+0000 7f85b77fe640 1 -- 172.21.15.123:0/330092574 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a4007d10 con 0x7f85a8004800 2024-09-15T23:22:52.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.994+0000 7f85b77fe640 1 -- 172.21.15.123:0/330092574 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85a4005ad0 con 0x7f85a8004800 2024-09-15T23:22:52.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.994+0000 7f85b77fe640 1 -- 172.21.15.123:0/330092574 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a4007070 con 0x7f85a8004800 2024-09-15T23:22:52.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.994+0000 7f85beb9f640 1 -- 172.21.15.123:0/330092574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85a8004800 msgr2=0x7f85a8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:52.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.994+0000 7f85beb9f640 1 --2- 172.21.15.123:0/330092574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85a8004800 0x7f85a8004c80 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7f85a400c240 tx=0x7f85a8005830 comp rx=0 tx=0).stop 2024-09-15T23:22:52.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.994+0000 7f85beb9f640 1 -- 172.21.15.123:0/330092574 shutdown_connections 2024-09-15T23:22:52.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.994+0000 7f85beb9f640 1 --2- 172.21.15.123:0/330092574 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85a8004800 0x7f85a8004c80 unknown :-1 s=CLOSED pgs=2164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:52.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.994+0000 7f85beb9f640 1 -- 172.21.15.123:0/330092574 >> 172.21.15.123:0/330092574 conn(0x7f85b80b0a80 msgr2=0x7f85b80b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:52.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.994+0000 7f85beb9f640 1 -- 172.21.15.123:0/330092574 shutdown_connections 2024-09-15T23:22:52.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.994+0000 7f85beb9f640 1 -- 172.21.15.123:0/330092574 wait complete. 2024-09-15T23:22:53.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.995+0000 7f85beb9f640 1 Processor -- start 2024-09-15T23:22:53.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.995+0000 7f85beb9f640 1 -- start start 2024-09-15T23:22:53.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.996+0000 7f85beb9f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85a8004800 0x7f85b80ce910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:53.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.996+0000 7f85beb9f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85b814b330 0x7f85b814b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:53.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.996+0000 7f85beb9f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85b815f480 0x7f85b815f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:53.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.996+0000 7f85beb9f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f85b806f430 con 0x7f85a8004800 2024-09-15T23:22:53.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.996+0000 7f85beb9f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f85b80af200 con 0x7f85b815f480 2024-09-15T23:22:53.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.996+0000 7f85beb9f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f85b8073a40 con 0x7f85b814b330 2024-09-15T23:22:53.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.996+0000 7f85bc93b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85a8004800 0x7f85b80ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:53.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.996+0000 7f85bc93b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85a8004800 0x7f85b80ce910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59492/0 (socket says 172.21.15.123:59492) 2024-09-15T23:22:53.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.996+0000 7f85bc93b640 1 -- 172.21.15.123:0/424827926 learned_addr learned my addr 172.21.15.123:0/424827926 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:53.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.996+0000 7f85bd13c640 1 --2- 172.21.15.123:0/424827926 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85b815f480 0x7f85b815f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:53.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.997+0000 7f85b7fff640 1 --2- 172.21.15.123:0/424827926 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85b814b330 0x7f85b814b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:53.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.997+0000 7f85bc93b640 1 -- 172.21.15.123:0/424827926 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85b814b330 msgr2=0x7f85b814b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:53.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.997+0000 7f85bc93b640 1 --2- 172.21.15.123:0/424827926 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85b814b330 0x7f85b814b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:53.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.997+0000 7f85bc93b640 1 -- 172.21.15.123:0/424827926 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85b815f480 msgr2=0x7f85b815f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:53.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.997+0000 7f85bc93b640 1 --2- 172.21.15.123:0/424827926 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85b815f480 0x7f85b815f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:53.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.997+0000 7f85bc93b640 1 -- 172.21.15.123:0/424827926 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85b815b880 con 0x7f85a8004800 2024-09-15T23:22:53.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.997+0000 7f85bd13c640 1 --2- 172.21.15.123:0/424827926 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85b815f480 0x7f85b815f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:53.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.997+0000 7f85bc93b640 1 --2- 172.21.15.123:0/424827926 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85a8004800 0x7f85b80ce910 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7f85ac011a70 tx=0x7f85ac011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:53.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.997+0000 7f85b57fa640 1 -- 172.21.15.123:0/424827926 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac00fb50 con 0x7f85a8004800 2024-09-15T23:22:53.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.997+0000 7f85b57fa640 1 -- 172.21.15.123:0/424827926 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85ac00fcf0 con 0x7f85a8004800 2024-09-15T23:22:53.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.997+0000 7f85beb9f640 1 -- 172.21.15.123:0/424827926 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85b815aac0 con 0x7f85a8004800 2024-09-15T23:22:53.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.997+0000 7f85b57fa640 1 -- 172.21.15.123:0/424827926 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ac00fea0 con 0x7f85a8004800 2024-09-15T23:22:53.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.997+0000 7f85beb9f640 1 -- 172.21.15.123:0/424827926 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85b815b080 con 0x7f85a8004800 2024-09-15T23:22:53.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.998+0000 7f85beb9f640 1 -- 172.21.15.123:0/424827926 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85b8069400 con 0x7f85a8004800 2024-09-15T23:22:53.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.998+0000 7f85b57fa640 1 -- 172.21.15.123:0/424827926 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f85ac012040 con 0x7f85a8004800 2024-09-15T23:22:53.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.999+0000 7f85b57fa640 1 --2- 172.21.15.123:0/424827926 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f859c06c2e0 0x7f859c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:53.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.999+0000 7f85b57fa640 1 -- 172.21.15.123:0/424827926 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f85ac08bba0 con 0x7f85a8004800 2024-09-15T23:22:53.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.999+0000 7f85b7fff640 1 --2- 172.21.15.123:0/424827926 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f859c06c2e0 0x7f859c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:53.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:52.999+0000 7f85b7fff640 1 --2- 172.21.15.123:0/424827926 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f859c06c2e0 0x7f859c06e7a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f85a4033000 tx=0x7f85a402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:53.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.003+0000 7f85b57fa640 1 -- 172.21.15.123:0/424827926 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f85b8069400 con 0x7f85a8004800 2024-09-15T23:22:53.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.200+0000 7f85beb9f640 1 -- 172.21.15.123:0/424827926 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85b80b2200 con 0x7f85a8004800 2024-09-15T23:22:53.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.200+0000 7f85b57fa640 1 -- 172.21.15.123:0/424827926 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) ==== 95+0+5259 (secure 0 0 0) 0x7f85ac019030 con 0x7f85a8004800 2024-09-15T23:22:53.202 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:22:53.202 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":113,"btime":"2024-09-15T23:22:48:735356+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8452,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/1861304244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1861304244},{"type":"v1","addr":"172.21.15.188:6837","nonce":1861304244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":10056,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/2869473990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2869473990},{"type":"v1","addr":"172.21.15.123:6833","nonce":2869473990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":113,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:22:25.896547+0000","modified":"2024-09-15T23:22:48.735339+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10074},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10062":{"gid":10062,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6835/3239002092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3239002092},{"type":"v1","addr":"172.21.15.123:6835","nonce":3239002092}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_10074":{"gid":10074,"name":"d","rank":0,"incarnation":108,"state":"up:active","state_seq":3,"addr":"172.21.15.188:6836/2164993019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2164993019},{"type":"v1","addr":"172.21.15.188:6836","nonce":2164993019}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10074,"qdb_cluster":[10074]},"id":12}]} 2024-09-15T23:22:53.202 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 113 2024-09-15T23:22:53.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.202+0000 7f85beb9f640 1 -- 172.21.15.123:0/424827926 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f859c06c2e0 msgr2=0x7f859c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:53.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.202+0000 7f85beb9f640 1 --2- 172.21.15.123:0/424827926 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f859c06c2e0 0x7f859c06e7a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f85a4033000 tx=0x7f85a402e000 comp rx=0 tx=0).stop 2024-09-15T23:22:53.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.202+0000 7f85beb9f640 1 -- 172.21.15.123:0/424827926 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85a8004800 msgr2=0x7f85b80ce910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:53.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.202+0000 7f85beb9f640 1 --2- 172.21.15.123:0/424827926 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85a8004800 0x7f85b80ce910 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7f85ac011a70 tx=0x7f85ac011f30 comp rx=0 tx=0).stop 2024-09-15T23:22:53.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.202+0000 7f85beb9f640 1 -- 172.21.15.123:0/424827926 shutdown_connections 2024-09-15T23:22:53.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.202+0000 7f85beb9f640 1 --2- 172.21.15.123:0/424827926 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85b815f480 0x7f85b815f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:53.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.202+0000 7f85beb9f640 1 --2- 172.21.15.123:0/424827926 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85b814b330 0x7f85b814b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:53.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.202+0000 7f85beb9f640 1 --2- 172.21.15.123:0/424827926 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f859c06c2e0 0x7f859c06e7a0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:53.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.202+0000 7f85beb9f640 1 --2- 172.21.15.123:0/424827926 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85a8004800 0x7f85b80ce910 unknown :-1 s=CLOSED pgs=2165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:53.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.203+0000 7f85beb9f640 1 -- 172.21.15.123:0/424827926 >> 172.21.15.123:0/424827926 conn(0x7f85b80b0a80 msgr2=0x7f85b8159280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:53.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.203+0000 7f85beb9f640 1 -- 172.21.15.123:0/424827926 shutdown_connections 2024-09-15T23:22:53.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.203+0000 7f85beb9f640 1 -- 172.21.15.123:0/424827926 wait complete. 2024-09-15T23:22:53.215 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:22:53.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.312+0000 7f956a5d6640 1 Processor -- start 2024-09-15T23:22:53.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.312+0000 7f956a5d6640 1 -- start start 2024-09-15T23:22:53.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.313+0000 7f956a5d6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9564071680 0x7f9564169750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:53.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.313+0000 7f956a5d6640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9564071b30 con 0x7f9564147e80 2024-09-15T23:22:53.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.313+0000 7f956a5d6640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95640b3510 con 0x7f9564148260 2024-09-15T23:22:53.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.313+0000 7f956a5d6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9564074200 con 0x7f9564071680 2024-09-15T23:22:53.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.313+0000 7f9563fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f9564147e80 0x7f9564070f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:45324/0 (socket says 172.21.15.123:45324) 2024-09-15T23:22:53.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.313+0000 7f9563fff640 1 -- 172.21.15.123:0/2919254139 learned_addr learned my addr 172.21.15.123:0/2919254139 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:53.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.313+0000 7f95637fe640 1 -- 172.21.15.123:0/2919254139 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1436144231 0 0) 0x7f9564071b30 con 0x7f9564147e80 2024-09-15T23:22:53.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.313+0000 7f9568b73640 1 --2- 172.21.15.123:0/2919254139 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9564071680 0x7f9564169750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:53.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.313+0000 7f95637fe640 1 -- 172.21.15.123:0/2919254139 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9550003520 con 0x7f9564147e80 2024-09-15T23:22:53.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.314+0000 7f95637fe640 1 -- 172.21.15.123:0/2919254139 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3740388624 0 0) 0x7f9550003520 con 0x7f9564147e80 2024-09-15T23:22:53.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.314+0000 7f95637fe640 1 -- 172.21.15.123:0/2919254139 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9564071680 msgr2=0x7f9564169750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:53.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.314+0000 7f95637fe640 1 --2- 172.21.15.123:0/2919254139 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9564071680 0x7f9564169750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:53.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.314+0000 7f95637fe640 1 -- 172.21.15.123:0/2919254139 >> v1:172.21.15.188:6789/0 conn(0x7f9564148260 legacy=0x7f956406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:53.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.314+0000 7f95637fe640 1 -- 172.21.15.123:0/2919254139 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95640b37f0 con 0x7f9564147e80 2024-09-15T23:22:53.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.314+0000 7f95637fe640 1 -- 172.21.15.123:0/2919254139 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f9554001670 con 0x7f9564147e80 2024-09-15T23:22:53.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.314+0000 7f95637fe640 1 -- 172.21.15.123:0/2919254139 >> v1:172.21.15.123:6789/0 conn(0x7f9564147e80 legacy=0x7f9564070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:53.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.314+0000 7f95637fe640 1 --2- 172.21.15.123:0/2919254139 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95500039e0 0x7f9550003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:53.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.314+0000 7f95637fe640 1 --2- 172.21.15.123:0/2919254139 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9564071680 0x7f9550004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:53.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.314+0000 7f95637fe640 1 --2- 172.21.15.123:0/2919254139 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9550004d40 0x7f95500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:53.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.314+0000 7f95637fe640 1 -- 172.21.15.123:0/2919254139 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9564074200 con 0x7f95500039e0 2024-09-15T23:22:53.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.314+0000 7f95637fe640 1 -- 172.21.15.123:0/2919254139 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f955000bb50 con 0x7f9550004d40 2024-09-15T23:22:53.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.314+0000 7f95637fe640 1 -- 172.21.15.123:0/2919254139 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f955000bd20 con 0x7f9564071680 2024-09-15T23:22:53.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.314+0000 7f9563fff640 1 --2- 172.21.15.123:0/2919254139 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95500039e0 0x7f9550003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:53.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.314+0000 7f9568b73640 1 --2- 172.21.15.123:0/2919254139 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9550004d40 0x7f95500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:53.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.314+0000 7f955bfff640 1 --2- 172.21.15.123:0/2919254139 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9564071680 0x7f9550004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:53.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.314+0000 7f9563fff640 1 -- 172.21.15.123:0/2919254139 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9564071680 msgr2=0x7f9550004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:53.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.314+0000 7f9563fff640 1 --2- 172.21.15.123:0/2919254139 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9564071680 0x7f9550004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:53.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.314+0000 7f9563fff640 1 -- 172.21.15.123:0/2919254139 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9550004d40 msgr2=0x7f95500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:53.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.314+0000 7f9563fff640 1 --2- 172.21.15.123:0/2919254139 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9550004d40 0x7f95500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:53.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.314+0000 7f9563fff640 1 -- 172.21.15.123:0/2919254139 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9550003520 con 0x7f95500039e0 2024-09-15T23:22:53.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.314+0000 7f9568b73640 1 --2- 172.21.15.123:0/2919254139 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9550004d40 0x7f95500051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:53.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.315+0000 7f9563fff640 1 --2- 172.21.15.123:0/2919254139 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95500039e0 0x7f9550003e00 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7f955400c270 tx=0x7f9550005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8de28275ec740dc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:53.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.315+0000 7f95637fe640 1 -- 172.21.15.123:0/2919254139 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9554007cf0 con 0x7f95500039e0 2024-09-15T23:22:53.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.315+0000 7f95637fe640 1 -- 172.21.15.123:0/2919254139 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9554005ad0 con 0x7f95500039e0 2024-09-15T23:22:53.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.315+0000 7f95637fe640 1 -- 172.21.15.123:0/2919254139 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9554007070 con 0x7f95500039e0 2024-09-15T23:22:53.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.315+0000 7f956a5d6640 1 -- 172.21.15.123:0/2919254139 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95500039e0 msgr2=0x7f9550003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:53.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.315+0000 7f956a5d6640 1 --2- 172.21.15.123:0/2919254139 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95500039e0 0x7f9550003e00 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7f955400c270 tx=0x7f9550005830 comp rx=0 tx=0).stop 2024-09-15T23:22:53.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.315+0000 7f9568b73640 1 -- 172.21.15.123:0/2919254139 reap_dead start 2024-09-15T23:22:53.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.316+0000 7f956a5d6640 1 -- 172.21.15.123:0/2919254139 shutdown_connections 2024-09-15T23:22:53.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.316+0000 7f956a5d6640 1 -- 172.21.15.123:0/2919254139 >> 172.21.15.123:0/2919254139 conn(0x7f95640ccec0 msgr2=0x7f95640cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:53.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.316+0000 7f956a5d6640 1 -- 172.21.15.123:0/2919254139 shutdown_connections 2024-09-15T23:22:53.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.316+0000 7f956a5d6640 1 -- 172.21.15.123:0/2919254139 wait complete. 2024-09-15T23:22:53.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.317+0000 7f956a5d6640 1 Processor -- start 2024-09-15T23:22:53.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.317+0000 7f956a5d6640 1 -- start start 2024-09-15T23:22:53.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.317+0000 7f956a5d6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95500039e0 0x7f95641f56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:53.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.317+0000 7f956a5d6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95641f43e0 0x7f95641f4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:53.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.317+0000 7f956a5d6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9564135cf0 0x7f9564136170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:53.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.317+0000 7f956a5d6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f956406c320 con 0x7f95641f43e0 2024-09-15T23:22:53.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.317+0000 7f956a5d6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f95640b3e40 con 0x7f95500039e0 2024-09-15T23:22:53.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.317+0000 7f956a5d6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f956406c4a0 con 0x7f9564135cf0 2024-09-15T23:22:53.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.318+0000 7f955bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95641f43e0 0x7f95641f4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:53.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.318+0000 7f955bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95641f43e0 0x7f95641f4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59522/0 (socket says 172.21.15.123:59522) 2024-09-15T23:22:53.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.318+0000 7f955bfff640 1 -- 172.21.15.123:0/3142523 learned_addr learned my addr 172.21.15.123:0/3142523 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:53.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.318+0000 7f9563fff640 1 --2- 172.21.15.123:0/3142523 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95500039e0 0x7f95641f56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:53.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.318+0000 7f9568b73640 1 --2- 172.21.15.123:0/3142523 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9564135cf0 0x7f9564136170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:53.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.318+0000 7f955bfff640 1 -- 172.21.15.123:0/3142523 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9564135cf0 msgr2=0x7f9564136170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:53.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.318+0000 7f955bfff640 1 --2- 172.21.15.123:0/3142523 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9564135cf0 0x7f9564136170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:53.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.318+0000 7f955bfff640 1 -- 172.21.15.123:0/3142523 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95500039e0 msgr2=0x7f95641f56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:53.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.318+0000 7f955bfff640 1 --2- 172.21.15.123:0/3142523 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95500039e0 0x7f95641f56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:53.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.318+0000 7f955bfff640 1 -- 172.21.15.123:0/3142523 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95641f5be0 con 0x7f95641f43e0 2024-09-15T23:22:53.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.318+0000 7f955bfff640 1 --2- 172.21.15.123:0/3142523 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95641f43e0 0x7f95641f4860 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7f954c00e550 tx=0x7f954c00ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:53.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.318+0000 7f95617fa640 1 -- 172.21.15.123:0/3142523 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954c0052e0 con 0x7f95641f43e0 2024-09-15T23:22:53.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.318+0000 7f95617fa640 1 -- 172.21.15.123:0/3142523 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f954c018070 con 0x7f95641f43e0 2024-09-15T23:22:53.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.318+0000 7f95617fa640 1 -- 172.21.15.123:0/3142523 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954c003810 con 0x7f95641f43e0 2024-09-15T23:22:53.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.318+0000 7f956a5d6640 1 -- 172.21.15.123:0/3142523 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95641367b0 con 0x7f95641f43e0 2024-09-15T23:22:53.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.318+0000 7f956a5d6640 1 -- 172.21.15.123:0/3142523 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95641f4ea0 con 0x7f95641f43e0 2024-09-15T23:22:53.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.319+0000 7f956a5d6640 1 -- 172.21.15.123:0/3142523 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9564070f70 con 0x7f95641f43e0 2024-09-15T23:22:53.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.320+0000 7f95617fa640 1 -- 172.21.15.123:0/3142523 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f954c0039b0 con 0x7f95641f43e0 2024-09-15T23:22:53.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.320+0000 7f95617fa640 1 --2- 172.21.15.123:0/3142523 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f954406c2b0 0x7f954406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:53.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.320+0000 7f95617fa640 1 -- 172.21.15.123:0/3142523 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f954c08b100 con 0x7f95641f43e0 2024-09-15T23:22:53.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.321+0000 7f9563fff640 1 --2- 172.21.15.123:0/3142523 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f954406c2b0 0x7f954406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:53.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.321+0000 7f9563fff640 1 --2- 172.21.15.123:0/3142523 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f954406c2b0 0x7f954406e770 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f9554033000 tx=0x7f9554035040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:53.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.325+0000 7f95617fa640 1 -- 172.21.15.123:0/3142523 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f95641f5be0 con 0x7f95641f43e0 2024-09-15T23:22:53.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.490+0000 7f956a5d6640 1 -- 172.21.15.123:0/3142523 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f956406c9c0 con 0x7f95641f43e0 2024-09-15T23:22:53.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.491+0000 7f95617fa640 1 -- 172.21.15.123:0/3142523 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v182) ==== 74+0+16707 (secure 0 0 0) 0x7f954c059870 con 0x7f95641f43e0 2024-09-15T23:22:53.493 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:22:53.493 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":182,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:22:27.559444+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:22:23.593537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-15T23:22:24.884391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:22:53.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.494+0000 7f956a5d6640 1 -- 172.21.15.123:0/3142523 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f954406c2b0 msgr2=0x7f954406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:53.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.494+0000 7f956a5d6640 1 --2- 172.21.15.123:0/3142523 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f954406c2b0 0x7f954406e770 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f9554033000 tx=0x7f9554035040 comp rx=0 tx=0).stop 2024-09-15T23:22:53.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.494+0000 7f956a5d6640 1 -- 172.21.15.123:0/3142523 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95641f43e0 msgr2=0x7f95641f4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:53.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.494+0000 7f956a5d6640 1 --2- 172.21.15.123:0/3142523 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95641f43e0 0x7f95641f4860 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7f954c00e550 tx=0x7f954c00ea10 comp rx=0 tx=0).stop 2024-09-15T23:22:53.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.494+0000 7f956a5d6640 1 -- 172.21.15.123:0/3142523 shutdown_connections 2024-09-15T23:22:53.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.494+0000 7f956a5d6640 1 --2- 172.21.15.123:0/3142523 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9564135cf0 0x7f9564136170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:53.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.494+0000 7f956a5d6640 1 --2- 172.21.15.123:0/3142523 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f954406c2b0 0x7f954406e770 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:53.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.494+0000 7f956a5d6640 1 --2- 172.21.15.123:0/3142523 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95641f43e0 0x7f95641f4860 unknown :-1 s=CLOSED pgs=2168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:53.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.494+0000 7f956a5d6640 1 --2- 172.21.15.123:0/3142523 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f95500039e0 0x7f95641f56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:53.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.494+0000 7f956a5d6640 1 -- 172.21.15.123:0/3142523 >> 172.21.15.123:0/3142523 conn(0x7f95640ccec0 msgr2=0x7f95640cf600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:53.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.494+0000 7f956a5d6640 1 -- 172.21.15.123:0/3142523 shutdown_connections 2024-09-15T23:22:53.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.494+0000 7f956a5d6640 1 -- 172.21.15.123:0/3142523 wait complete. 2024-09-15T23:22:53.506 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T23:22:53.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.605+0000 7f83e539f640 1 Processor -- start 2024-09-15T23:22:53.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.605+0000 7f83e539f640 1 -- start start 2024-09-15T23:22:53.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.606+0000 7f83e539f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f83e015ed20 0x7f83e00b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:53.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.606+0000 7f83e539f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f83e00d23b0 0x7f83e00b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:53.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.606+0000 7f83e539f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83e00d0e70 con 0x7f83e00cf2d0 2024-09-15T23:22:53.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.606+0000 7f83e539f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f83e00d41c0 con 0x7f83e015ed20 2024-09-15T23:22:53.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.606+0000 7f83e539f640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f83e00d35b0 con 0x7f83e00d23b0 2024-09-15T23:22:53.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.606+0000 7f83deffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f83e015ed20 0x7f83e00b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:53.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.606+0000 7f83deffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f83e015ed20 0x7f83e00b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59538/0 (socket says 172.21.15.123:59538) 2024-09-15T23:22:53.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.606+0000 7f83deffd640 1 -- 172.21.15.123:0/191533560 learned_addr learned my addr 172.21.15.123:0/191533560 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:53.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.606+0000 7f83deffd640 1 -- 172.21.15.123:0/191533560 >> v2:172.21.15.188:3300/0 conn(0x7f83e00d23b0 msgr2=0x7f83e00b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:53.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.606+0000 7f83de7fc640 1 --2- 172.21.15.123:0/191533560 >> v2:172.21.15.188:3300/0 conn(0x7f83e00d23b0 0x7f83e00b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:53.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.606+0000 7f83deffd640 1 --2- 172.21.15.123:0/191533560 >> v2:172.21.15.188:3300/0 conn(0x7f83e00d23b0 0x7f83e00b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:53.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.606+0000 7f83deffd640 1 -- 172.21.15.123:0/191533560 >> v1:172.21.15.188:6789/0 conn(0x7f83e00cf2d0 legacy=0x7f83e00cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:53.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.606+0000 7f83deffd640 1 -- 172.21.15.123:0/191533560 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e00d3890 con 0x7f83e015ed20 2024-09-15T23:22:53.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.606+0000 7f83de7fc640 1 --2- 172.21.15.123:0/191533560 >> v2:172.21.15.188:3300/0 conn(0x7f83e00d23b0 0x7f83e00b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:22:53.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.607+0000 7f83deffd640 1 --2- 172.21.15.123:0/191533560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83e015ed20 0x7f83e00b6260 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7f83e00d4690 tx=0x7f83d002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e6641865d5c84 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:53.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.607+0000 7f83ddffb640 1 -- 172.21.15.123:0/191533560 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d0037070 con 0x7f83e015ed20 2024-09-15T23:22:53.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.607+0000 7f83ddffb640 1 -- 172.21.15.123:0/191533560 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83d0032440 con 0x7f83e015ed20 2024-09-15T23:22:53.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.607+0000 7f83ddffb640 1 -- 172.21.15.123:0/191533560 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d0032810 con 0x7f83e015ed20 2024-09-15T23:22:53.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.608+0000 7f83e539f640 1 -- 172.21.15.123:0/191533560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83e015ed20 msgr2=0x7f83e00b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:53.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.608+0000 7f83e539f640 1 --2- 172.21.15.123:0/191533560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83e015ed20 0x7f83e00b6260 secure :-1 s=READY pgs=2169 cs=0 l=1 rev1=1 crypto rx=0x7f83e00d4690 tx=0x7f83d002a1a0 comp rx=0 tx=0).stop 2024-09-15T23:22:53.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.608+0000 7f83e539f640 1 -- 172.21.15.123:0/191533560 shutdown_connections 2024-09-15T23:22:53.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.608+0000 7f83e539f640 1 --2- 172.21.15.123:0/191533560 >> v2:172.21.15.188:3300/0 conn(0x7f83e00d23b0 0x7f83e00b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:53.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.608+0000 7f83e539f640 1 --2- 172.21.15.123:0/191533560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83e015ed20 0x7f83e00b6260 unknown :-1 s=CLOSED pgs=2169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:53.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.608+0000 7f83e539f640 1 -- 172.21.15.123:0/191533560 >> 172.21.15.123:0/191533560 conn(0x7f83e00d1260 msgr2=0x7f83e00d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:53.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.608+0000 7f83e539f640 1 -- 172.21.15.123:0/191533560 shutdown_connections 2024-09-15T23:22:53.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.608+0000 7f83e539f640 1 -- 172.21.15.123:0/191533560 wait complete. 2024-09-15T23:22:53.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.609+0000 7f83e539f640 1 Processor -- start 2024-09-15T23:22:53.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.609+0000 7f83e539f640 1 -- start start 2024-09-15T23:22:53.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.610+0000 7f83e539f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83e00cf2d0 0x7f83e015ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:53.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.610+0000 7f83e539f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f83e00d23b0 0x7f83e015c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:53.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.610+0000 7f83e539f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f83e015ed20 0x7f83e01e90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:53.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.610+0000 7f83e539f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f83e00d32a0 con 0x7f83e00cf2d0 2024-09-15T23:22:53.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.610+0000 7f83e539f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f83e00d3e50 con 0x7f83e015ed20 2024-09-15T23:22:53.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.610+0000 7f83e539f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f83e015f100 con 0x7f83e00d23b0 2024-09-15T23:22:53.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.610+0000 7f83deffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83e00cf2d0 0x7f83e015ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:53.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.610+0000 7f83deffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83e00cf2d0 0x7f83e015ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59554/0 (socket says 172.21.15.123:59554) 2024-09-15T23:22:53.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.610+0000 7f83deffd640 1 -- 172.21.15.123:0/1726042320 learned_addr learned my addr 172.21.15.123:0/1726042320 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:53.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.610+0000 7f83df7fe640 1 --2- 172.21.15.123:0/1726042320 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f83e015ed20 0x7f83e01e90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:53.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.610+0000 7f83de7fc640 1 --2- 172.21.15.123:0/1726042320 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f83e00d23b0 0x7f83e015c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:53.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.610+0000 7f83deffd640 1 -- 172.21.15.123:0/1726042320 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f83e00d23b0 msgr2=0x7f83e015c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:53.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.610+0000 7f83deffd640 1 --2- 172.21.15.123:0/1726042320 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f83e00d23b0 0x7f83e015c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:53.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.610+0000 7f83deffd640 1 -- 172.21.15.123:0/1726042320 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f83e015ed20 msgr2=0x7f83e01e90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:53.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.610+0000 7f83deffd640 1 --2- 172.21.15.123:0/1726042320 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f83e015ed20 0x7f83e01e90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:53.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.610+0000 7f83deffd640 1 -- 172.21.15.123:0/1726042320 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e00ca6f0 con 0x7f83e00cf2d0 2024-09-15T23:22:53.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.611+0000 7f83deffd640 1 --2- 172.21.15.123:0/1726042320 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83e00cf2d0 0x7f83e015ce50 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7f83d0000c00 tx=0x7f83d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:53.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.611+0000 7f83c77fe640 1 -- 172.21.15.123:0/1726042320 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d0037040 con 0x7f83e00cf2d0 2024-09-15T23:22:53.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.611+0000 7f83c77fe640 1 -- 172.21.15.123:0/1726042320 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83d0042070 con 0x7f83e00cf2d0 2024-09-15T23:22:53.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.611+0000 7f83e539f640 1 -- 172.21.15.123:0/1726042320 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83e00ca9d0 con 0x7f83e00cf2d0 2024-09-15T23:22:53.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.611+0000 7f83c77fe640 1 -- 172.21.15.123:0/1726042320 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d0030bb0 con 0x7f83e00cf2d0 2024-09-15T23:22:53.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.611+0000 7f83e539f640 1 -- 172.21.15.123:0/1726042320 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83e00caf90 con 0x7f83e00cf2d0 2024-09-15T23:22:53.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.612+0000 7f83e539f640 1 -- 172.21.15.123:0/1726042320 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83e00b7010 con 0x7f83e00cf2d0 2024-09-15T23:22:53.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.612+0000 7f83c77fe640 1 -- 172.21.15.123:0/1726042320 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f83d0047460 con 0x7f83e00cf2d0 2024-09-15T23:22:53.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.613+0000 7f83c77fe640 1 --2- 172.21.15.123:0/1726042320 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f83cc06c2b0 0x7f83cc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:53.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.613+0000 7f83c77fe640 1 -- 172.21.15.123:0/1726042320 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f83d00abfe0 con 0x7f83e00cf2d0 2024-09-15T23:22:53.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.613+0000 7f83de7fc640 1 --2- 172.21.15.123:0/1726042320 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f83cc06c2b0 0x7f83cc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:53.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.613+0000 7f83de7fc640 1 --2- 172.21.15.123:0/1726042320 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f83cc06c2b0 0x7f83cc06e770 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f83e015e270 tx=0x7f83d4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:53.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.617+0000 7f83c77fe640 1 -- 172.21.15.123:0/1726042320 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f83e00d0e70 con 0x7f83e00cf2d0 2024-09-15T23:22:53.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.820+0000 7f83e539f640 1 -- 172.21.15.123:0/1726042320 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f83e00b3f20 con 0x7f83e00cf2d0 2024-09-15T23:22:53.821 INFO:tasks.ceph.mon.a.smithi123.stderr:2024-09-15T23:22:53.820+0000 7f8a6ccf0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:22:53.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.821+0000 7f83c77fe640 1 -- 172.21.15.123:0/1726042320 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v114) ==== 161+0+0 (secure 0 0 0) 0x7f83d0045360 con 0x7f83e00cf2d0 2024-09-15T23:22:53.822 INFO:teuthology.orchestra.run.smithi123.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T23:22:53.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.824+0000 7f83e539f640 1 -- 172.21.15.123:0/1726042320 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f83cc06c2b0 msgr2=0x7f83cc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:53.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.824+0000 7f83e539f640 1 --2- 172.21.15.123:0/1726042320 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f83cc06c2b0 0x7f83cc06e770 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f83e015e270 tx=0x7f83d4008040 comp rx=0 tx=0).stop 2024-09-15T23:22:53.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.825+0000 7f83e539f640 1 -- 172.21.15.123:0/1726042320 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83e00cf2d0 msgr2=0x7f83e015ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:53.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.825+0000 7f83e539f640 1 --2- 172.21.15.123:0/1726042320 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83e00cf2d0 0x7f83e015ce50 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7f83d0000c00 tx=0x7f83d00046c0 comp rx=0 tx=0).stop 2024-09-15T23:22:53.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.825+0000 7f83e539f640 1 -- 172.21.15.123:0/1726042320 shutdown_connections 2024-09-15T23:22:53.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.825+0000 7f83e539f640 1 --2- 172.21.15.123:0/1726042320 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f83e015ed20 0x7f83e01e90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:53.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.825+0000 7f83e539f640 1 --2- 172.21.15.123:0/1726042320 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f83e00d23b0 0x7f83e015c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:53.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.825+0000 7f83e539f640 1 --2- 172.21.15.123:0/1726042320 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f83cc06c2b0 0x7f83cc06e770 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:53.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.825+0000 7f83e539f640 1 --2- 172.21.15.123:0/1726042320 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83e00cf2d0 0x7f83e015ce50 unknown :-1 s=CLOSED pgs=2170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:53.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.825+0000 7f83e539f640 1 -- 172.21.15.123:0/1726042320 >> 172.21.15.123:0/1726042320 conn(0x7f83e00d1260 msgr2=0x7f83e00b5480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:53.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.825+0000 7f83e539f640 1 -- 172.21.15.123:0/1726042320 shutdown_connections 2024-09-15T23:22:53.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.825+0000 7f83e539f640 1 -- 172.21.15.123:0/1726042320 wait complete. 2024-09-15T23:22:53.837 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T23:22:53.862 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-15T23:22:53.866 INFO:tasks.ceph.mds.d.smithi188.stdout:starting mds.d at 2024-09-15T23:22:53.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.938+0000 7f25499cf640 1 Processor -- start 2024-09-15T23:22:53.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.938+0000 7f25499cf640 1 -- start start 2024-09-15T23:22:53.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.939+0000 7f25499cf640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f25440ccf30 0x7f25440b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:53.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.939+0000 7f25499cf640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25440cf2e0 con 0x7f254415b7c0 2024-09-15T23:22:53.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.939+0000 7f25499cf640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2544070fe0 con 0x7f25440cead0 2024-09-15T23:22:53.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.939+0000 7f25499cf640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f25440712c0 con 0x7f25440ccf30 2024-09-15T23:22:53.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.939+0000 7f2542ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f25440ccf30 0x7f25440b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:53.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.939+0000 7f25427fc640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f254415b7c0 0x7f25440cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:45340/0 (socket says 172.21.15.123:45340) 2024-09-15T23:22:53.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.939+0000 7f25427fc640 1 -- 172.21.15.123:0/596804467 learned_addr learned my addr 172.21.15.123:0/596804467 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:53.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.939+0000 7f2542ffd640 1 -- 172.21.15.123:0/596804467 >> v1:172.21.15.188:6789/0 conn(0x7f25440cead0 legacy=0x7f2544071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:53.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.939+0000 7f2542ffd640 1 -- 172.21.15.123:0/596804467 >> v1:172.21.15.123:6789/0 conn(0x7f254415b7c0 legacy=0x7f25440cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:53.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.939+0000 7f2542ffd640 1 -- 172.21.15.123:0/596804467 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25440715a0 con 0x7f25440ccf30 2024-09-15T23:22:53.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.940+0000 7f2542ffd640 1 --2- 172.21.15.123:0/596804467 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25440ccf30 0x7f25440b2c50 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7f25340097a0 tx=0x7f253402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0598a910bcda71e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:53.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.940+0000 7f2541ffb640 1 -- 172.21.15.123:0/596804467 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2534037070 con 0x7f25440ccf30 2024-09-15T23:22:53.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.940+0000 7f2541ffb640 1 -- 172.21.15.123:0/596804467 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f253402ae50 con 0x7f25440ccf30 2024-09-15T23:22:53.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.940+0000 7f2541ffb640 1 -- 172.21.15.123:0/596804467 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2534032660 con 0x7f25440ccf30 2024-09-15T23:22:53.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.941+0000 7f25499cf640 1 -- 172.21.15.123:0/596804467 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25440ccf30 msgr2=0x7f25440b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:53.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.941+0000 7f25499cf640 1 --2- 172.21.15.123:0/596804467 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25440ccf30 0x7f25440b2c50 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7f25340097a0 tx=0x7f253402a140 comp rx=0 tx=0).stop 2024-09-15T23:22:53.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.941+0000 7f25499cf640 1 -- 172.21.15.123:0/596804467 shutdown_connections 2024-09-15T23:22:53.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.941+0000 7f25499cf640 1 --2- 172.21.15.123:0/596804467 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f25440ccf30 0x7f25440b2c50 unknown :-1 s=CLOSED pgs=2174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:53.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.941+0000 7f25499cf640 1 -- 172.21.15.123:0/596804467 >> 172.21.15.123:0/596804467 conn(0x7f254406d0f0 msgr2=0x7f254406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:53.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.941+0000 7f25499cf640 1 -- 172.21.15.123:0/596804467 shutdown_connections 2024-09-15T23:22:53.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.941+0000 7f25499cf640 1 -- 172.21.15.123:0/596804467 wait complete. 2024-09-15T23:22:53.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.942+0000 7f25499cf640 1 Processor -- start 2024-09-15T23:22:53.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.942+0000 7f25499cf640 1 -- start start 2024-09-15T23:22:53.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.943+0000 7f25499cf640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f25440ccf30 0x7f2544150e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:53.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.943+0000 7f25499cf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f25440cead0 0x7f25441522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:53.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.943+0000 7f25499cf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f254415b7c0 0x7f25440c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:53.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.943+0000 7f25499cf640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f25440cf080 con 0x7f254415b7c0 2024-09-15T23:22:53.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.943+0000 7f25499cf640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f25440cef00 con 0x7f25440cead0 2024-09-15T23:22:53.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.943+0000 7f25499cf640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f25440721d0 con 0x7f25440ccf30 2024-09-15T23:22:53.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.943+0000 7f25437fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f254415b7c0 0x7f25440c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:53.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.943+0000 7f25437fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f254415b7c0 0x7f25440c9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59582/0 (socket says 172.21.15.123:59582) 2024-09-15T23:22:53.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.943+0000 7f25437fe640 1 -- 172.21.15.123:0/359324592 learned_addr learned my addr 172.21.15.123:0/359324592 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:53.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.943+0000 7f25427fc640 1 --2- 172.21.15.123:0/359324592 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f25440cead0 0x7f25441522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:53.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.943+0000 7f2542ffd640 1 --2- 172.21.15.123:0/359324592 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f25440ccf30 0x7f2544150e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:53.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.943+0000 7f25437fe640 1 -- 172.21.15.123:0/359324592 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f25440ccf30 msgr2=0x7f2544150e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:53.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.943+0000 7f25437fe640 1 --2- 172.21.15.123:0/359324592 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f25440ccf30 0x7f2544150e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:53.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.943+0000 7f25437fe640 1 -- 172.21.15.123:0/359324592 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f25440cead0 msgr2=0x7f25441522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:53.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.943+0000 7f25437fe640 1 --2- 172.21.15.123:0/359324592 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f25440cead0 0x7f25441522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:53.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.943+0000 7f25437fe640 1 -- 172.21.15.123:0/359324592 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25440c89e0 con 0x7f254415b7c0 2024-09-15T23:22:53.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.943+0000 7f2542ffd640 1 --2- 172.21.15.123:0/359324592 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f25440ccf30 0x7f2544150e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:53.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.943+0000 7f25427fc640 1 --2- 172.21.15.123:0/359324592 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f25440cead0 0x7f25441522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:53.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.943+0000 7f25437fe640 1 --2- 172.21.15.123:0/359324592 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f254415b7c0 0x7f25440c9a80 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7f253c00ea20 tx=0x7f253c00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:53.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.943+0000 7f252bfff640 1 -- 172.21.15.123:0/359324592 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c004750 con 0x7f254415b7c0 2024-09-15T23:22:53.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.943+0000 7f252bfff640 1 -- 172.21.15.123:0/359324592 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f253c011470 con 0x7f254415b7c0 2024-09-15T23:22:53.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.943+0000 7f25499cf640 1 -- 172.21.15.123:0/359324592 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25440c8cc0 con 0x7f254415b7c0 2024-09-15T23:22:53.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.943+0000 7f252bfff640 1 -- 172.21.15.123:0/359324592 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253c0118a0 con 0x7f254415b7c0 2024-09-15T23:22:53.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.943+0000 7f25499cf640 1 -- 172.21.15.123:0/359324592 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25440c9280 con 0x7f254415b7c0 2024-09-15T23:22:53.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.945+0000 7f25499cf640 1 -- 172.21.15.123:0/359324592 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25440b2c50 con 0x7f254415b7c0 2024-09-15T23:22:53.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.945+0000 7f252bfff640 1 -- 172.21.15.123:0/359324592 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f253c011a40 con 0x7f254415b7c0 2024-09-15T23:22:53.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.945+0000 7f252bfff640 1 --2- 172.21.15.123:0/359324592 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f253006c2b0 0x7f253006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:53.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.946+0000 7f252bfff640 1 -- 172.21.15.123:0/359324592 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5795+0+0 (secure 0 0 0) 0x7f253c08de80 con 0x7f254415b7c0 2024-09-15T23:22:53.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.946+0000 7f2542ffd640 1 --2- 172.21.15.123:0/359324592 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f253006c2b0 0x7f253006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:53.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.946+0000 7f2542ffd640 1 --2- 172.21.15.123:0/359324592 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f253006c2b0 0x7f253006e770 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f2534034000 tx=0x7f253402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:53.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:53.950+0000 7f252bfff640 1 -- 172.21.15.123:0/359324592 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f253c016030 con 0x7f254415b7c0 2024-09-15T23:22:54.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.147+0000 7f25499cf640 1 -- 172.21.15.123:0/359324592 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f25440cc960 con 0x7f254415b7c0 2024-09-15T23:22:54.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.823+0000 7f252bfff640 1 -- 172.21.15.123:0/359324592 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v115) ==== 104+0+0 (secure 0 0 0) 0x7f253c00fe20 con 0x7f254415b7c0 2024-09-15T23:22:54.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.825+0000 7f25499cf640 1 -- 172.21.15.123:0/359324592 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f253006c2b0 msgr2=0x7f253006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:54.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.825+0000 7f25499cf640 1 --2- 172.21.15.123:0/359324592 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f253006c2b0 0x7f253006e770 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f2534034000 tx=0x7f253402e000 comp rx=0 tx=0).stop 2024-09-15T23:22:54.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.825+0000 7f25499cf640 1 -- 172.21.15.123:0/359324592 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f254415b7c0 msgr2=0x7f25440c9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:54.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.825+0000 7f25499cf640 1 --2- 172.21.15.123:0/359324592 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f254415b7c0 0x7f25440c9a80 secure :-1 s=READY pgs=2175 cs=0 l=1 rev1=1 crypto rx=0x7f253c00ea20 tx=0x7f253c00eee0 comp rx=0 tx=0).stop 2024-09-15T23:22:54.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.826+0000 7f25499cf640 1 -- 172.21.15.123:0/359324592 shutdown_connections 2024-09-15T23:22:54.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.826+0000 7f25499cf640 1 --2- 172.21.15.123:0/359324592 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f253006c2b0 0x7f253006e770 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:54.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.826+0000 7f25499cf640 1 --2- 172.21.15.123:0/359324592 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f254415b7c0 0x7f25440c9a80 unknown :-1 s=CLOSED pgs=2175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:54.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.826+0000 7f25499cf640 1 --2- 172.21.15.123:0/359324592 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f25440cead0 0x7f25441522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:54.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.826+0000 7f25499cf640 1 --2- 172.21.15.123:0/359324592 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f25440ccf30 0x7f2544150e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:54.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.826+0000 7f25499cf640 1 -- 172.21.15.123:0/359324592 >> 172.21.15.123:0/359324592 conn(0x7f254406d0f0 msgr2=0x7f254415de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:54.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.826+0000 7f25499cf640 1 -- 172.21.15.123:0/359324592 shutdown_connections 2024-09-15T23:22:54.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.826+0000 7f25499cf640 1 -- 172.21.15.123:0/359324592 wait complete. 2024-09-15T23:22:54.840 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T23:22:54.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.986+0000 7f1d7f8f1640 1 Processor -- start 2024-09-15T23:22:54.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.986+0000 7f1d7f8f1640 1 -- start start 2024-09-15T23:22:54.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.987+0000 7f1d7f8f1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1d780b2370 0x7f1d780cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:54.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.987+0000 7f1d7f8f1640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1d780cf960 0x7f1d7815c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:54.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.987+0000 7f1d7f8f1640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d780b0680 con 0x7f1d78155b20 2024-09-15T23:22:54.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.987+0000 7f1d7f8f1640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f1d780b01e0 con 0x7f1d780cf960 2024-09-15T23:22:54.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.987+0000 7f1d7f8f1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1d780ccf70 con 0x7f1d780b2370 2024-09-15T23:22:54.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.987+0000 7f1d7ce8c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1d780b2370 0x7f1d780cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:54.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.987+0000 7f1d7de8e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1d780cf960 0x7f1d7815c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:54.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.987+0000 7f1d7ce8c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1d780b2370 0x7f1d780cf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:53118/0 (socket says 172.21.15.123:53118) 2024-09-15T23:22:54.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.987+0000 7f1d7de8e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1d780cf960 0x7f1d7815c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:47866/0 (socket says 172.21.15.123:47866) 2024-09-15T23:22:54.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.987+0000 7f1d7ce8c640 1 -- 172.21.15.123:0/2357513944 learned_addr learned my addr 172.21.15.123:0/2357513944 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:54.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.988+0000 7f1d7de8e640 1 -- 172.21.15.123:0/2357513944 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1d780b2370 msgr2=0x7f1d780cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:54.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.988+0000 7f1d7de8e640 1 --2- 172.21.15.123:0/2357513944 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1d780b2370 0x7f1d780cf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:54.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.988+0000 7f1d7de8e640 1 -- 172.21.15.123:0/2357513944 >> v1:172.21.15.188:6789/0 conn(0x7f1d78155b20 legacy=0x7f1d780b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:54.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.988+0000 7f1d7de8e640 1 -- 172.21.15.123:0/2357513944 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d780ce940 con 0x7f1d780cf960 2024-09-15T23:22:54.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.988+0000 7f1d7ce8c640 1 --2- 172.21.15.123:0/2357513944 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1d780b2370 0x7f1d780cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:22:54.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.988+0000 7f1d7de8e640 1 --2- 172.21.15.123:0/2357513944 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1d780cf960 0x7f1d7815c3b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f1d70009d90 tx=0x7f1d7002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9c67d9805a885cf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:54.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.989+0000 7f1d6ffff640 1 -- 172.21.15.123:0/2357513944 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d70007740 con 0x7f1d780cf960 2024-09-15T23:22:54.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.989+0000 7f1d6ffff640 1 -- 172.21.15.123:0/2357513944 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d700078e0 con 0x7f1d780cf960 2024-09-15T23:22:54.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.989+0000 7f1d6ffff640 1 -- 172.21.15.123:0/2357513944 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d70007cb0 con 0x7f1d780cf960 2024-09-15T23:22:54.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.989+0000 7f1d7f8f1640 1 -- 172.21.15.123:0/2357513944 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1d780cf960 msgr2=0x7f1d7815c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:54.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.989+0000 7f1d7f8f1640 1 --2- 172.21.15.123:0/2357513944 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1d780cf960 0x7f1d7815c3b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f1d70009d90 tx=0x7f1d7002a660 comp rx=0 tx=0).stop 2024-09-15T23:22:54.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.989+0000 7f1d7f8f1640 1 -- 172.21.15.123:0/2357513944 shutdown_connections 2024-09-15T23:22:54.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.989+0000 7f1d7f8f1640 1 --2- 172.21.15.123:0/2357513944 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1d780cf960 0x7f1d7815c3b0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:54.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.989+0000 7f1d7f8f1640 1 --2- 172.21.15.123:0/2357513944 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1d780b2370 0x7f1d780cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:54.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.989+0000 7f1d7f8f1640 1 -- 172.21.15.123:0/2357513944 >> 172.21.15.123:0/2357513944 conn(0x7f1d7806c240 msgr2=0x7f1d7806d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:54.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.989+0000 7f1d7f8f1640 1 -- 172.21.15.123:0/2357513944 shutdown_connections 2024-09-15T23:22:54.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.989+0000 7f1d7f8f1640 1 -- 172.21.15.123:0/2357513944 wait complete. 2024-09-15T23:22:54.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.990+0000 7f1d7f8f1640 1 Processor -- start 2024-09-15T23:22:54.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.990+0000 7f1d7f8f1640 1 -- start start 2024-09-15T23:22:54.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.991+0000 7f1d7f8f1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1d780b2370 0x7f1d78147940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:54.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.991+0000 7f1d7f8f1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d780cf960 0x7f1d78155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:54.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.991+0000 7f1d7f8f1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1d78155b20 0x7f1d78144630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:54.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.991+0000 7f1d7f8f1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1d780ce610 con 0x7f1d780cf960 2024-09-15T23:22:54.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.991+0000 7f1d7f8f1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1d780cef00 con 0x7f1d780b2370 2024-09-15T23:22:54.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.991+0000 7f1d7f8f1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1d780cfd80 con 0x7f1d78155b20 2024-09-15T23:22:54.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.991+0000 7f1d7ce8c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d780cf960 0x7f1d78155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:54.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.991+0000 7f1d7ce8c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d780cf960 0x7f1d78155f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59588/0 (socket says 172.21.15.123:59588) 2024-09-15T23:22:54.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.991+0000 7f1d7ce8c640 1 -- 172.21.15.123:0/2080025938 learned_addr learned my addr 172.21.15.123:0/2080025938 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:54.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.991+0000 7f1d7de8e640 1 --2- 172.21.15.123:0/2080025938 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1d78155b20 0x7f1d78144630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:54.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.991+0000 7f1d7d68d640 1 --2- 172.21.15.123:0/2080025938 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1d780b2370 0x7f1d78147940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:54.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.992+0000 7f1d7ce8c640 1 -- 172.21.15.123:0/2080025938 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1d78155b20 msgr2=0x7f1d78144630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:54.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.992+0000 7f1d7ce8c640 1 --2- 172.21.15.123:0/2080025938 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1d78155b20 0x7f1d78144630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:54.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.992+0000 7f1d7ce8c640 1 -- 172.21.15.123:0/2080025938 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1d780b2370 msgr2=0x7f1d78147940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:54.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.992+0000 7f1d7ce8c640 1 --2- 172.21.15.123:0/2080025938 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1d780b2370 0x7f1d78147940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:54.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.992+0000 7f1d7ce8c640 1 -- 172.21.15.123:0/2080025938 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d781578d0 con 0x7f1d780cf960 2024-09-15T23:22:54.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.992+0000 7f1d7ce8c640 1 --2- 172.21.15.123:0/2080025938 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d780cf960 0x7f1d78155f00 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7f1d6800ed40 tx=0x7f1d6800d720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:54.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.992+0000 7f1d6dffb640 1 -- 172.21.15.123:0/2080025938 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d68010850 con 0x7f1d780cf960 2024-09-15T23:22:54.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.992+0000 7f1d6dffb640 1 -- 172.21.15.123:0/2080025938 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d680109f0 con 0x7f1d780cf960 2024-09-15T23:22:54.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.992+0000 7f1d7f8f1640 1 -- 172.21.15.123:0/2080025938 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d78144b70 con 0x7f1d780cf960 2024-09-15T23:22:54.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.992+0000 7f1d6dffb640 1 -- 172.21.15.123:0/2080025938 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d68010da0 con 0x7f1d780cf960 2024-09-15T23:22:54.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.992+0000 7f1d7f8f1640 1 -- 172.21.15.123:0/2080025938 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d78157e50 con 0x7f1d780cf960 2024-09-15T23:22:54.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.993+0000 7f1d7f8f1640 1 -- 172.21.15.123:0/2080025938 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d780ccb20 con 0x7f1d780cf960 2024-09-15T23:22:54.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.993+0000 7f1d6dffb640 1 -- 172.21.15.123:0/2080025938 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1d6800f3d0 con 0x7f1d780cf960 2024-09-15T23:22:54.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.994+0000 7f1d6dffb640 1 --2- 172.21.15.123:0/2080025938 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1d5c06c2b0 0x7f1d5c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:54.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.994+0000 7f1d6dffb640 1 -- 172.21.15.123:0/2080025938 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5795+0+0 (secure 0 0 0) 0x7f1d6808bf10 con 0x7f1d780cf960 2024-09-15T23:22:54.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.994+0000 7f1d7d68d640 1 --2- 172.21.15.123:0/2080025938 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1d5c06c2b0 0x7f1d5c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:54.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.995+0000 7f1d7d68d640 1 --2- 172.21.15.123:0/2080025938 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1d5c06c2b0 0x7f1d5c06e770 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f1d740016e0 tx=0x7f1d74009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:54.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:54.998+0000 7f1d6dffb640 1 -- 172.21.15.123:0/2080025938 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1d6805a060 con 0x7f1d780cf960 2024-09-15T23:22:55.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.162+0000 7f1d7f8f1640 1 -- 172.21.15.123:0/2080025938 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1d7806e820 con 0x7f1d780cf960 2024-09-15T23:22:55.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.827+0000 7f1d6dffb640 1 -- 172.21.15.123:0/2080025938 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v184) ==== 181+0+0 (secure 0 0 0) 0x7f1d6805e360 con 0x7f1d780cf960 2024-09-15T23:22:55.828 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' removed 2024-09-15T23:22:55.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.832+0000 7f1d7f8f1640 1 -- 172.21.15.123:0/2080025938 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1d5c06c2b0 msgr2=0x7f1d5c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:55.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.832+0000 7f1d7f8f1640 1 --2- 172.21.15.123:0/2080025938 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1d5c06c2b0 0x7f1d5c06e770 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f1d740016e0 tx=0x7f1d74009040 comp rx=0 tx=0).stop 2024-09-15T23:22:55.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.832+0000 7f1d7f8f1640 1 -- 172.21.15.123:0/2080025938 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d780cf960 msgr2=0x7f1d78155f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:55.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.832+0000 7f1d7f8f1640 1 --2- 172.21.15.123:0/2080025938 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d780cf960 0x7f1d78155f00 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7f1d6800ed40 tx=0x7f1d6800d720 comp rx=0 tx=0).stop 2024-09-15T23:22:55.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.833+0000 7f1d7f8f1640 1 -- 172.21.15.123:0/2080025938 shutdown_connections 2024-09-15T23:22:55.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.833+0000 7f1d7f8f1640 1 --2- 172.21.15.123:0/2080025938 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1d78155b20 0x7f1d78144630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:55.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.833+0000 7f1d7f8f1640 1 --2- 172.21.15.123:0/2080025938 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1d5c06c2b0 0x7f1d5c06e770 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:55.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.833+0000 7f1d7f8f1640 1 --2- 172.21.15.123:0/2080025938 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1d780cf960 0x7f1d78155f00 unknown :-1 s=CLOSED pgs=2176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:55.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.833+0000 7f1d7f8f1640 1 --2- 172.21.15.123:0/2080025938 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1d780b2370 0x7f1d78147940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:55.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.833+0000 7f1d7f8f1640 1 -- 172.21.15.123:0/2080025938 >> 172.21.15.123:0/2080025938 conn(0x7f1d7806c240 msgr2=0x7f1d7815aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:55.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.833+0000 7f1d7f8f1640 1 -- 172.21.15.123:0/2080025938 shutdown_connections 2024-09-15T23:22:55.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.833+0000 7f1d7f8f1640 1 -- 172.21.15.123:0/2080025938 wait complete. 2024-09-15T23:22:55.849 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T23:22:55.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.952+0000 7f66076af640 1 Processor -- start 2024-09-15T23:22:55.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.953+0000 7f66076af640 1 -- start start 2024-09-15T23:22:55.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.953+0000 7f66076af640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f660015ea90 0x7f66000d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:55.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.953+0000 7f66076af640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66000d16e0 0x7f66000b7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:55.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.953+0000 7f66076af640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66000cf060 con 0x7f66000d40b0 2024-09-15T23:22:55.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.953+0000 7f66076af640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f66000d34c0 con 0x7f660015ea90 2024-09-15T23:22:55.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.953+0000 7f66076af640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f66000cf340 con 0x7f66000d16e0 2024-09-15T23:22:55.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.954+0000 7f6604c4a640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f66000d40b0 0x7f66000d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:45342/0 (socket says 172.21.15.123:45342) 2024-09-15T23:22:55.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.954+0000 7f6604c4a640 1 -- 172.21.15.123:0/3581059255 learned_addr learned my addr 172.21.15.123:0/3581059255 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:55.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.954+0000 7f660544b640 1 --2- 172.21.15.123:0/3581059255 >> v2:172.21.15.188:3300/0 conn(0x7f660015ea90 0x7f66000d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:55.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.954+0000 7f6605c4c640 1 --2- 172.21.15.123:0/3581059255 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66000d16e0 0x7f66000b7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:55.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.954+0000 7f65f7fff640 1 -- 172.21.15.123:0/3581059255 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 10209093 0 0) 0x7f66000cf060 con 0x7f66000d40b0 2024-09-15T23:22:55.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.954+0000 7f65f7fff640 1 -- 172.21.15.123:0/3581059255 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65ec003520 con 0x7f66000d40b0 2024-09-15T23:22:55.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.954+0000 7f65f7fff640 1 -- 172.21.15.123:0/3581059255 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 633065579 0 0) 0x7f65ec003520 con 0x7f66000d40b0 2024-09-15T23:22:55.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.954+0000 7f65f7fff640 1 -- 172.21.15.123:0/3581059255 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66000d16e0 msgr2=0x7f66000b7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:55.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.954+0000 7f65f7fff640 1 --2- 172.21.15.123:0/3581059255 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66000d16e0 0x7f66000b7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:55.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.954+0000 7f65f7fff640 1 -- 172.21.15.123:0/3581059255 >> v2:172.21.15.188:3300/0 conn(0x7f660015ea90 msgr2=0x7f66000d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:55.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.954+0000 7f65f7fff640 1 --2- 172.21.15.123:0/3581059255 >> v2:172.21.15.188:3300/0 conn(0x7f660015ea90 0x7f66000d2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:55.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.954+0000 7f65f7fff640 1 -- 172.21.15.123:0/3581059255 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66000cf620 con 0x7f66000d40b0 2024-09-15T23:22:55.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.954+0000 7f65f7fff640 1 -- 172.21.15.123:0/3581059255 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f65f0001670 con 0x7f66000d40b0 2024-09-15T23:22:55.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.954+0000 7f65f7fff640 1 -- 172.21.15.123:0/3581059255 >> v1:172.21.15.123:6789/0 conn(0x7f66000d40b0 legacy=0x7f66000d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:55.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.954+0000 7f65f7fff640 1 --2- 172.21.15.123:0/3581059255 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65ec0039b0 0x7f65ec003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:55.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.954+0000 7f65f7fff640 1 --2- 172.21.15.123:0/3581059255 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f65ec004800 0x7f65ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:55.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.954+0000 7f65f7fff640 1 --2- 172.21.15.123:0/3581059255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65ec0051c0 0x7f65ec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:55.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.954+0000 7f65f7fff640 1 -- 172.21.15.123:0/3581059255 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f66000d34c0 con 0x7f65ec0051c0 2024-09-15T23:22:55.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.954+0000 7f65f7fff640 1 -- 172.21.15.123:0/3581059255 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f66000cf340 con 0x7f65ec0039b0 2024-09-15T23:22:55.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.954+0000 7f65f7fff640 1 -- 172.21.15.123:0/3581059255 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f65ec00bf00 con 0x7f65ec004800 2024-09-15T23:22:55.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.954+0000 7f660544b640 1 --2- 172.21.15.123:0/3581059255 >> v2:172.21.15.188:3300/0 conn(0x7f660015ea90 0x7f66000d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:22:55.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.954+0000 7f6605c4c640 1 --2- 172.21.15.123:0/3581059255 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66000d16e0 0x7f66000b7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:22:55.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.954+0000 7f6605c4c640 1 --2- 172.21.15.123:0/3581059255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65ec0051c0 0x7f65ec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:55.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.954+0000 7f660544b640 1 --2- 172.21.15.123:0/3581059255 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65ec0039b0 0x7f65ec003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:55.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.954+0000 7f6604c4a640 1 --2- 172.21.15.123:0/3581059255 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f65ec004800 0x7f65ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:55.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.955+0000 7f6605c4c640 1 -- 172.21.15.123:0/3581059255 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f65ec004800 msgr2=0x7f65ec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:55.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.955+0000 7f6605c4c640 1 --2- 172.21.15.123:0/3581059255 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f65ec004800 0x7f65ec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:55.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.955+0000 7f6605c4c640 1 -- 172.21.15.123:0/3581059255 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65ec0039b0 msgr2=0x7f65ec003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:55.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.955+0000 7f6605c4c640 1 --2- 172.21.15.123:0/3581059255 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65ec0039b0 0x7f65ec003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:55.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.955+0000 7f6605c4c640 1 -- 172.21.15.123:0/3581059255 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65ec003520 con 0x7f65ec0051c0 2024-09-15T23:22:55.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.955+0000 7f6605c4c640 1 --2- 172.21.15.123:0/3581059255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65ec0051c0 0x7f65ec00b9c0 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7f65f800e1f0 tx=0x7f65ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21927c0429ce8ae4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:55.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.955+0000 7f65f7fff640 1 -- 172.21.15.123:0/3581059255 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f8009d40 con 0x7f65ec0051c0 2024-09-15T23:22:55.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.955+0000 7f65f7fff640 1 -- 172.21.15.123:0/3581059255 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65f8035070 con 0x7f65ec0051c0 2024-09-15T23:22:55.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.955+0000 7f65f7fff640 1 -- 172.21.15.123:0/3581059255 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f8004030 con 0x7f65ec0051c0 2024-09-15T23:22:55.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.956+0000 7f66076af640 1 -- 172.21.15.123:0/3581059255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65ec0051c0 msgr2=0x7f65ec00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:55.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.956+0000 7f66076af640 1 --2- 172.21.15.123:0/3581059255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65ec0051c0 0x7f65ec00b9c0 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7f65f800e1f0 tx=0x7f65ec005830 comp rx=0 tx=0).stop 2024-09-15T23:22:55.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.956+0000 7f6605c4c640 1 -- 172.21.15.123:0/3581059255 reap_dead start 2024-09-15T23:22:55.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.956+0000 7f66076af640 1 -- 172.21.15.123:0/3581059255 shutdown_connections 2024-09-15T23:22:55.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.956+0000 7f66076af640 1 -- 172.21.15.123:0/3581059255 >> 172.21.15.123:0/3581059255 conn(0x7f660006c0e0 msgr2=0x7f660006c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:55.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.956+0000 7f66076af640 1 -- 172.21.15.123:0/3581059255 shutdown_connections 2024-09-15T23:22:55.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.956+0000 7f66076af640 1 -- 172.21.15.123:0/3581059255 wait complete. 2024-09-15T23:22:55.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.957+0000 7f66076af640 1 Processor -- start 2024-09-15T23:22:55.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.957+0000 7f66076af640 1 -- start start 2024-09-15T23:22:55.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.958+0000 7f66076af640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65ec0051c0 0x7f66000b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:55.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.958+0000 7f66076af640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66000b6e80 0x7f66000b6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:55.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.958+0000 7f66076af640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66000b5be0 0x7f660015dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:55.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.958+0000 7f66076af640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f660015ee70 con 0x7f66000b5be0 2024-09-15T23:22:55.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.958+0000 7f66076af640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f66000cfbe0 con 0x7f65ec0051c0 2024-09-15T23:22:55.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.958+0000 7f66076af640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f66000b7ac0 con 0x7f66000b6e80 2024-09-15T23:22:55.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.958+0000 7f6605c4c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66000b5be0 0x7f660015dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:55.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.958+0000 7f6605c4c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66000b5be0 0x7f660015dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:59600/0 (socket says 172.21.15.123:59600) 2024-09-15T23:22:55.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.958+0000 7f6605c4c640 1 -- 172.21.15.123:0/2328077368 learned_addr learned my addr 172.21.15.123:0/2328077368 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:55.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.958+0000 7f660544b640 1 --2- 172.21.15.123:0/2328077368 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65ec0051c0 0x7f66000b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:55.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.958+0000 7f6604c4a640 1 --2- 172.21.15.123:0/2328077368 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66000b6e80 0x7f66000b6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:55.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.958+0000 7f6605c4c640 1 -- 172.21.15.123:0/2328077368 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66000b6e80 msgr2=0x7f66000b6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:55.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.958+0000 7f6605c4c640 1 --2- 172.21.15.123:0/2328077368 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66000b6e80 0x7f66000b6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:55.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.958+0000 7f6605c4c640 1 -- 172.21.15.123:0/2328077368 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65ec0051c0 msgr2=0x7f66000b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:55.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.958+0000 7f6605c4c640 1 --2- 172.21.15.123:0/2328077368 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65ec0051c0 0x7f66000b41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:55.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.958+0000 7f6605c4c640 1 -- 172.21.15.123:0/2328077368 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66000b4b40 con 0x7f66000b5be0 2024-09-15T23:22:55.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.958+0000 7f660544b640 1 --2- 172.21.15.123:0/2328077368 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65ec0051c0 0x7f66000b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:55.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.959+0000 7f6605c4c640 1 --2- 172.21.15.123:0/2328077368 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66000b5be0 0x7f660015dcd0 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7f65f8032040 tx=0x7f65f8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:55.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.959+0000 7f65f5ffb640 1 -- 172.21.15.123:0/2328077368 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f8009d40 con 0x7f66000b5be0 2024-09-15T23:22:55.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.959+0000 7f65f5ffb640 1 -- 172.21.15.123:0/2328077368 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65f8040070 con 0x7f66000b5be0 2024-09-15T23:22:55.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.959+0000 7f66076af640 1 -- 172.21.15.123:0/2328077368 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66000b4e20 con 0x7f66000b5be0 2024-09-15T23:22:55.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.959+0000 7f65f5ffb640 1 -- 172.21.15.123:0/2328077368 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f8045690 con 0x7f66000b5be0 2024-09-15T23:22:55.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.959+0000 7f66076af640 1 -- 172.21.15.123:0/2328077368 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66000b53e0 con 0x7f66000b5be0 2024-09-15T23:22:55.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.960+0000 7f66076af640 1 -- 172.21.15.123:0/2328077368 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66000d2f80 con 0x7f66000b5be0 2024-09-15T23:22:55.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.960+0000 7f65f5ffb640 1 -- 172.21.15.123:0/2328077368 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f65f8005d10 con 0x7f66000b5be0 2024-09-15T23:22:55.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.961+0000 7f65f5ffb640 1 --2- 172.21.15.123:0/2328077368 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f65e406c2b0 0x7f65e406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:55.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.961+0000 7f65f5ffb640 1 -- 172.21.15.123:0/2328077368 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 5415+0+0 (secure 0 0 0) 0x7f65f80aca90 con 0x7f66000b5be0 2024-09-15T23:22:55.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.961+0000 7f660544b640 1 --2- 172.21.15.123:0/2328077368 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f65e406c2b0 0x7f65e406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:55.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.962+0000 7f660544b640 1 --2- 172.21.15.123:0/2328077368 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f65e406c2b0 0x7f65e406e770 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f65fc009d50 tx=0x7f65fc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:55.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:55.965+0000 7f65f5ffb640 1 -- 172.21.15.123:0/2328077368 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f65f807b290 con 0x7f66000b5be0 2024-09-15T23:22:56.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.132+0000 7f66076af640 1 -- 172.21.15.123:0/2328077368 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f66000b8210 con 0x7f66000b5be0 2024-09-15T23:22:56.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.829+0000 7f65f5ffb640 1 -- 172.21.15.123:0/2328077368 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v185) ==== 169+0+0 (secure 0 0 0) 0x7f65f807ab90 con 0x7f66000b5be0 2024-09-15T23:22:56.830 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' removed 2024-09-15T23:22:56.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.832+0000 7f66076af640 1 -- 172.21.15.123:0/2328077368 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f65e406c2b0 msgr2=0x7f65e406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:56.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.832+0000 7f66076af640 1 --2- 172.21.15.123:0/2328077368 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f65e406c2b0 0x7f65e406e770 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f65fc009d50 tx=0x7f65fc008040 comp rx=0 tx=0).stop 2024-09-15T23:22:56.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.833+0000 7f66076af640 1 -- 172.21.15.123:0/2328077368 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66000b5be0 msgr2=0x7f660015dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:56.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.833+0000 7f66076af640 1 --2- 172.21.15.123:0/2328077368 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66000b5be0 0x7f660015dcd0 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7f65f8032040 tx=0x7f65f8009750 comp rx=0 tx=0).stop 2024-09-15T23:22:56.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.833+0000 7f66076af640 1 -- 172.21.15.123:0/2328077368 shutdown_connections 2024-09-15T23:22:56.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.833+0000 7f66076af640 1 --2- 172.21.15.123:0/2328077368 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f65e406c2b0 0x7f65e406e770 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:56.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.833+0000 7f66076af640 1 --2- 172.21.15.123:0/2328077368 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f66000b5be0 0x7f660015dcd0 unknown :-1 s=CLOSED pgs=2179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:56.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.833+0000 7f66076af640 1 --2- 172.21.15.123:0/2328077368 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f66000b6e80 0x7f66000b6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:56.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.833+0000 7f66076af640 1 --2- 172.21.15.123:0/2328077368 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65ec0051c0 0x7f66000b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:56.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.833+0000 7f66076af640 1 -- 172.21.15.123:0/2328077368 >> 172.21.15.123:0/2328077368 conn(0x7f660006c0e0 msgr2=0x7f66001603f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:56.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.833+0000 7f66076af640 1 -- 172.21.15.123:0/2328077368 shutdown_connections 2024-09-15T23:22:56.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.833+0000 7f66076af640 1 -- 172.21.15.123:0/2328077368 wait complete. 2024-09-15T23:22:56.854 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T23:22:56.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.969+0000 7fb0468ba640 1 Processor -- start 2024-09-15T23:22:56.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.969+0000 7fb0468ba640 1 -- start start 2024-09-15T23:22:56.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.969+0000 7fb0468ba640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0400ccf30 0x7fb0400b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:56.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.969+0000 7fb0468ba640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb04015b7c0 0x7fb0400cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:56.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.969+0000 7fb0468ba640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0400cd850 con 0x7fb0400cead0 2024-09-15T23:22:56.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.969+0000 7fb0468ba640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fb0400cf2e0 con 0x7fb04015b7c0 2024-09-15T23:22:56.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.969+0000 7fb0468ba640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb040070fe0 con 0x7fb0400ccf30 2024-09-15T23:22:56.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.970+0000 7fb03f7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb04015b7c0 0x7fb0400cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:56.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.970+0000 7fb044e57640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb0400cead0 0x7fb04015f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59394/0 (socket says 172.21.15.123:59394) 2024-09-15T23:22:56.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.970+0000 7fb044e57640 1 -- 172.21.15.123:0/47678443 learned_addr learned my addr 172.21.15.123:0/47678443 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:56.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.970+0000 7fb03ffff640 1 --2- 172.21.15.123:0/47678443 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0400ccf30 0x7fb0400b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:56.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.970+0000 7fb03f7fe640 1 -- 172.21.15.123:0/47678443 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0400ccf30 msgr2=0x7fb0400b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:56.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.970+0000 7fb03f7fe640 1 --2- 172.21.15.123:0/47678443 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0400ccf30 0x7fb0400b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:56.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.970+0000 7fb03f7fe640 1 -- 172.21.15.123:0/47678443 >> v1:172.21.15.123:6789/0 conn(0x7fb0400cead0 legacy=0x7fb04015f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:56.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.970+0000 7fb03effd640 1 -- 172.21.15.123:0/47678443 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2694926843 0 0) 0x7fb0400cd850 con 0x7fb0400cead0 2024-09-15T23:22:56.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.970+0000 7fb03f7fe640 1 -- 172.21.15.123:0/47678443 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0400712c0 con 0x7fb04015b7c0 2024-09-15T23:22:56.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.971+0000 7fb03f7fe640 1 --2- 172.21.15.123:0/47678443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb04015b7c0 0x7fb0400cd310 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7fb03400ba40 tx=0x7fb03402c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bcfc6815ca50ab5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:56.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.971+0000 7fb03effd640 1 -- 172.21.15.123:0/47678443 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb034031710 con 0x7fb04015b7c0 2024-09-15T23:22:56.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.971+0000 7fb03effd640 1 -- 172.21.15.123:0/47678443 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0340318b0 con 0x7fb04015b7c0 2024-09-15T23:22:56.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.971+0000 7fb03effd640 1 -- 172.21.15.123:0/47678443 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb034031c80 con 0x7fb04015b7c0 2024-09-15T23:22:56.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.971+0000 7fb0468ba640 1 -- 172.21.15.123:0/47678443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb04015b7c0 msgr2=0x7fb0400cd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:56.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.971+0000 7fb0468ba640 1 --2- 172.21.15.123:0/47678443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb04015b7c0 0x7fb0400cd310 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7fb03400ba40 tx=0x7fb03402c7b0 comp rx=0 tx=0).stop 2024-09-15T23:22:56.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.971+0000 7fb0468ba640 1 -- 172.21.15.123:0/47678443 shutdown_connections 2024-09-15T23:22:56.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.971+0000 7fb0468ba640 1 --2- 172.21.15.123:0/47678443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb04015b7c0 0x7fb0400cd310 unknown :-1 s=CLOSED pgs=2181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:56.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.971+0000 7fb0468ba640 1 --2- 172.21.15.123:0/47678443 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0400ccf30 0x7fb0400b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:56.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.971+0000 7fb0468ba640 1 -- 172.21.15.123:0/47678443 >> 172.21.15.123:0/47678443 conn(0x7fb04006d0f0 msgr2=0x7fb04006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:56.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.971+0000 7fb0468ba640 1 -- 172.21.15.123:0/47678443 shutdown_connections 2024-09-15T23:22:56.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.971+0000 7fb0468ba640 1 -- 172.21.15.123:0/47678443 wait complete. 2024-09-15T23:22:56.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.972+0000 7fb0468ba640 1 Processor -- start 2024-09-15T23:22:56.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.973+0000 7fb0468ba640 1 -- start start 2024-09-15T23:22:56.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.973+0000 7fb0468ba640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0400ccf30 0x7fb04015c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:56.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.973+0000 7fb0468ba640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0400cead0 0x7fb04014d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:56.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.973+0000 7fb0468ba640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb04015b7c0 0x7fb04014dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:56.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.973+0000 7fb0468ba640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb0400cef40 con 0x7fb0400ccf30 2024-09-15T23:22:56.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.973+0000 7fb0468ba640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb0400cf5c0 con 0x7fb04015b7c0 2024-09-15T23:22:56.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.973+0000 7fb0468ba640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb0400cf0c0 con 0x7fb0400cead0 2024-09-15T23:22:56.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.973+0000 7fb03ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0400ccf30 0x7fb04015c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:56.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.973+0000 7fb03ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0400ccf30 0x7fb04015c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41546/0 (socket says 172.21.15.123:41546) 2024-09-15T23:22:56.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.973+0000 7fb03ffff640 1 -- 172.21.15.123:0/1136377919 learned_addr learned my addr 172.21.15.123:0/1136377919 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:56.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.974+0000 7fb03f7fe640 1 --2- 172.21.15.123:0/1136377919 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0400cead0 0x7fb04014d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:56.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.974+0000 7fb044e57640 1 --2- 172.21.15.123:0/1136377919 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb04015b7c0 0x7fb04014dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:56.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.974+0000 7fb03ffff640 1 -- 172.21.15.123:0/1136377919 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0400cead0 msgr2=0x7fb04014d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:56.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.974+0000 7fb03ffff640 1 --2- 172.21.15.123:0/1136377919 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0400cead0 0x7fb04014d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:56.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.974+0000 7fb03ffff640 1 -- 172.21.15.123:0/1136377919 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb04015b7c0 msgr2=0x7fb04014dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:56.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.974+0000 7fb03ffff640 1 --2- 172.21.15.123:0/1136377919 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb04015b7c0 0x7fb04014dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:56.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.974+0000 7fb03ffff640 1 -- 172.21.15.123:0/1136377919 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb04015ea30 con 0x7fb0400ccf30 2024-09-15T23:22:56.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.974+0000 7fb044e57640 1 --2- 172.21.15.123:0/1136377919 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb04015b7c0 0x7fb04014dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:56.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.974+0000 7fb03ffff640 1 --2- 172.21.15.123:0/1136377919 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0400ccf30 0x7fb04015c1d0 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7fb03000d830 tx=0x7fb03000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:56.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.974+0000 7fb03cff9640 1 -- 172.21.15.123:0/1136377919 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03000b6c0 con 0x7fb0400ccf30 2024-09-15T23:22:56.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.974+0000 7fb03cff9640 1 -- 172.21.15.123:0/1136377919 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb030019070 con 0x7fb0400ccf30 2024-09-15T23:22:56.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.974+0000 7fb0468ba640 1 -- 172.21.15.123:0/1136377919 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb04015e190 con 0x7fb0400ccf30 2024-09-15T23:22:56.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.974+0000 7fb03cff9640 1 -- 172.21.15.123:0/1136377919 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03000ba80 con 0x7fb0400ccf30 2024-09-15T23:22:56.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.974+0000 7fb0468ba640 1 -- 172.21.15.123:0/1136377919 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb04015e750 con 0x7fb0400ccf30 2024-09-15T23:22:56.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.975+0000 7fb0468ba640 1 -- 172.21.15.123:0/1136377919 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0400cc960 con 0x7fb0400ccf30 2024-09-15T23:22:56.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.976+0000 7fb03cff9640 1 -- 172.21.15.123:0/1136377919 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb03001e460 con 0x7fb0400ccf30 2024-09-15T23:22:56.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.976+0000 7fb03cff9640 1 --2- 172.21.15.123:0/1136377919 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb02c06c2e0 0x7fb02c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:56.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.976+0000 7fb03cff9640 1 -- 172.21.15.123:0/1136377919 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 4943+0+0 (secure 0 0 0) 0x7fb03008b710 con 0x7fb0400ccf30 2024-09-15T23:22:56.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.976+0000 7fb03f7fe640 1 --2- 172.21.15.123:0/1136377919 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb02c06c2e0 0x7fb02c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:56.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.977+0000 7fb03f7fe640 1 --2- 172.21.15.123:0/1136377919 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb02c06c2e0 0x7fb02c06e7a0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fb04006dc70 tx=0x7fb034031000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:56.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:56.980+0000 7fb03cff9640 1 -- 172.21.15.123:0/1136377919 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb03005a180 con 0x7fb0400ccf30 2024-09-15T23:22:57.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.158+0000 7fb0468ba640 1 -- 172.21.15.123:0/1136377919 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fb04015f200 con 0x7fb0400ccf30 2024-09-15T23:22:57.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.161+0000 7fb03cff9640 1 -- 172.21.15.123:0/1136377919 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v45) ==== 104+0+0 (secure 0 0 0) 0x7fb030059a80 con 0x7fb0400ccf30 2024-09-15T23:22:57.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.163+0000 7fb0468ba640 1 -- 172.21.15.123:0/1136377919 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb02c06c2e0 msgr2=0x7fb02c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:57.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.163+0000 7fb0468ba640 1 --2- 172.21.15.123:0/1136377919 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb02c06c2e0 0x7fb02c06e7a0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fb04006dc70 tx=0x7fb034031000 comp rx=0 tx=0).stop 2024-09-15T23:22:57.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.163+0000 7fb0468ba640 1 -- 172.21.15.123:0/1136377919 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0400ccf30 msgr2=0x7fb04015c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:57.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.163+0000 7fb0468ba640 1 --2- 172.21.15.123:0/1136377919 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0400ccf30 0x7fb04015c1d0 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7fb03000d830 tx=0x7fb03000dcf0 comp rx=0 tx=0).stop 2024-09-15T23:22:57.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.163+0000 7fb0468ba640 1 -- 172.21.15.123:0/1136377919 shutdown_connections 2024-09-15T23:22:57.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.163+0000 7fb0468ba640 1 --2- 172.21.15.123:0/1136377919 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb04015b7c0 0x7fb04014dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:57.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.163+0000 7fb0468ba640 1 --2- 172.21.15.123:0/1136377919 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb0400cead0 0x7fb04014d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:57.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.163+0000 7fb0468ba640 1 --2- 172.21.15.123:0/1136377919 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb02c06c2e0 0x7fb02c06e7a0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:57.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.163+0000 7fb0468ba640 1 --2- 172.21.15.123:0/1136377919 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb0400ccf30 0x7fb04015c1d0 unknown :-1 s=CLOSED pgs=2182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:57.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.163+0000 7fb0468ba640 1 -- 172.21.15.123:0/1136377919 >> 172.21.15.123:0/1136377919 conn(0x7fb04006d0f0 msgr2=0x7fb04015f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:57.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.164+0000 7fb0468ba640 1 -- 172.21.15.123:0/1136377919 shutdown_connections 2024-09-15T23:22:57.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.164+0000 7fb0468ba640 1 -- 172.21.15.123:0/1136377919 wait complete. 2024-09-15T23:22:57.176 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive' 2024-09-15T23:22:57.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.272+0000 7fafbcedd640 1 Processor -- start 2024-09-15T23:22:57.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.272+0000 7fafbcedd640 1 -- start start 2024-09-15T23:22:57.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.273+0000 7fafbcedd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fafb8162c60 0x7fafb8073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:57.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.273+0000 7fafbcedd640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafb81631c0 con 0x7fafb815e790 2024-09-15T23:22:57.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.273+0000 7fafbcedd640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafb80ae9a0 con 0x7fafb806f730 2024-09-15T23:22:57.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.273+0000 7fafbcedd640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fafb815eb70 con 0x7fafb8162c60 2024-09-15T23:22:57.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.273+0000 7fafb659c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fafb815e790 0x7fafb80b5430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59402/0 (socket says 172.21.15.123:59402) 2024-09-15T23:22:57.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.273+0000 7fafb659c640 1 -- 172.21.15.123:0/2801899314 learned_addr learned my addr 172.21.15.123:0/2801899314 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:57.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.273+0000 7fafb559a640 1 -- 172.21.15.123:0/2801899314 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3700832425 0 0) 0x7fafb81631c0 con 0x7fafb815e790 2024-09-15T23:22:57.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.274+0000 7fafb559a640 1 -- 172.21.15.123:0/2801899314 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafa0003520 con 0x7fafb815e790 2024-09-15T23:22:57.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.274+0000 7fafb5d9b640 1 --2- 172.21.15.123:0/2801899314 >> v2:172.21.15.188:3300/0 conn(0x7fafb8162c60 0x7fafb8073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:57.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.274+0000 7fafb559a640 1 -- 172.21.15.123:0/2801899314 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2394082506 0 0) 0x7fafa0003520 con 0x7fafb815e790 2024-09-15T23:22:57.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.274+0000 7fafb559a640 1 -- 172.21.15.123:0/2801899314 >> v2:172.21.15.188:3300/0 conn(0x7fafb8162c60 msgr2=0x7fafb8073a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:57.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.274+0000 7fafb559a640 1 --2- 172.21.15.123:0/2801899314 >> v2:172.21.15.188:3300/0 conn(0x7fafb8162c60 0x7fafb8073a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:57.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.274+0000 7fafb559a640 1 -- 172.21.15.123:0/2801899314 >> v1:172.21.15.188:6789/0 conn(0x7fafb806f730 legacy=0x7fafb80af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:57.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.274+0000 7fafb559a640 1 -- 172.21.15.123:0/2801899314 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb80aec40 con 0x7fafb815e790 2024-09-15T23:22:57.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.274+0000 7fafb559a640 1 -- 172.21.15.123:0/2801899314 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fafa8001670 con 0x7fafb815e790 2024-09-15T23:22:57.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.274+0000 7fafb559a640 1 -- 172.21.15.123:0/2801899314 >> v1:172.21.15.123:6789/0 conn(0x7fafb815e790 legacy=0x7fafb80b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:57.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.274+0000 7fafb559a640 1 --2- 172.21.15.123:0/2801899314 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fafa00039b0 0x7fafa0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:57.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.274+0000 7fafb559a640 1 --2- 172.21.15.123:0/2801899314 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fafa0004800 0x7fafa0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:57.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.274+0000 7fafb559a640 1 --2- 172.21.15.123:0/2801899314 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafa00051c0 0x7fafa000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:57.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.274+0000 7fafb559a640 1 -- 172.21.15.123:0/2801899314 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fafa000c130 con 0x7fafa00051c0 2024-09-15T23:22:57.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.274+0000 7fafb559a640 1 -- 172.21.15.123:0/2801899314 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fafa000c2e0 con 0x7fafa00039b0 2024-09-15T23:22:57.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.274+0000 7fafb559a640 1 -- 172.21.15.123:0/2801899314 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fafa000c4e0 con 0x7fafa0004800 2024-09-15T23:22:57.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.274+0000 7fafb6d9d640 1 --2- 172.21.15.123:0/2801899314 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafa00051c0 0x7fafa000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:57.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.274+0000 7fafb659c640 1 --2- 172.21.15.123:0/2801899314 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fafa00039b0 0x7fafa0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:57.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.274+0000 7fafb5d9b640 1 --2- 172.21.15.123:0/2801899314 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fafa0004800 0x7fafa0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:57.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.274+0000 7fafb6d9d640 1 -- 172.21.15.123:0/2801899314 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fafa0004800 msgr2=0x7fafa0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:57.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.274+0000 7fafb6d9d640 1 --2- 172.21.15.123:0/2801899314 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fafa0004800 0x7fafa0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:57.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.274+0000 7fafb6d9d640 1 -- 172.21.15.123:0/2801899314 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fafa00039b0 msgr2=0x7fafa0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:57.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.274+0000 7fafb6d9d640 1 --2- 172.21.15.123:0/2801899314 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fafa00039b0 0x7fafa0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:57.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.274+0000 7fafb6d9d640 1 -- 172.21.15.123:0/2801899314 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafa0003520 con 0x7fafa00051c0 2024-09-15T23:22:57.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.275+0000 7fafb6d9d640 1 -- 172.21.15.123:0/2801899314 reap_dead start 2024-09-15T23:22:57.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.275+0000 7fafb6d9d640 1 --2- 172.21.15.123:0/2801899314 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafa00051c0 0x7fafa000b9c0 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7fafb0001e50 tx=0x7fafa0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe5188c73cc7443 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:57.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.275+0000 7fafb559a640 1 -- 172.21.15.123:0/2801899314 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb0001a70 con 0x7fafa00051c0 2024-09-15T23:22:57.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.275+0000 7fafb559a640 1 -- 172.21.15.123:0/2801899314 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafb0003970 con 0x7fafa00051c0 2024-09-15T23:22:57.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.275+0000 7fafb559a640 1 -- 172.21.15.123:0/2801899314 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb0003d60 con 0x7fafa00051c0 2024-09-15T23:22:57.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.276+0000 7fafbcedd640 1 -- 172.21.15.123:0/2801899314 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafa00051c0 msgr2=0x7fafa000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:57.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.276+0000 7fafbcedd640 1 --2- 172.21.15.123:0/2801899314 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafa00051c0 0x7fafa000b9c0 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7fafb0001e50 tx=0x7fafa0005830 comp rx=0 tx=0).stop 2024-09-15T23:22:57.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.276+0000 7fafbcedd640 1 -- 172.21.15.123:0/2801899314 shutdown_connections 2024-09-15T23:22:57.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.276+0000 7fafbcedd640 1 --2- 172.21.15.123:0/2801899314 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafa00051c0 0x7fafa000b9c0 unknown :-1 s=CLOSED pgs=2184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:57.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.276+0000 7fafbcedd640 1 -- 172.21.15.123:0/2801899314 >> 172.21.15.123:0/2801899314 conn(0x7fafb80b0a80 msgr2=0x7fafb80b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:57.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.276+0000 7fafbcedd640 1 -- 172.21.15.123:0/2801899314 shutdown_connections 2024-09-15T23:22:57.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.276+0000 7fafbcedd640 1 -- 172.21.15.123:0/2801899314 wait complete. 2024-09-15T23:22:57.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.277+0000 7fafbcedd640 1 Processor -- start 2024-09-15T23:22:57.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.277+0000 7fafbcedd640 1 -- start start 2024-09-15T23:22:57.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.278+0000 7fafbcedd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fafa00051c0 0x7fafb8161c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:57.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.278+0000 7fafbcedd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fafb81f4560 0x7fafb8143540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:57.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.278+0000 7fafbcedd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafb8151380 0x7fafb815f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:57.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.278+0000 7fafbcedd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fafb806f430 con 0x7fafb8151380 2024-09-15T23:22:57.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.278+0000 7fafbcedd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fafb80af200 con 0x7fafa00051c0 2024-09-15T23:22:57.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.278+0000 7fafbcedd640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fafb8073a40 con 0x7fafb81f4560 2024-09-15T23:22:57.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.278+0000 7fafb6d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafb8151380 0x7fafb815f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:57.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.278+0000 7fafb6d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafb8151380 0x7fafb815f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41558/0 (socket says 172.21.15.123:41558) 2024-09-15T23:22:57.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.278+0000 7fafb6d9d640 1 -- 172.21.15.123:0/3487030949 learned_addr learned my addr 172.21.15.123:0/3487030949 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:57.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.278+0000 7fafb659c640 1 --2- 172.21.15.123:0/3487030949 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fafa00051c0 0x7fafb8161c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:57.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.278+0000 7fafb5d9b640 1 --2- 172.21.15.123:0/3487030949 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fafb81f4560 0x7fafb8143540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:57.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.278+0000 7fafb6d9d640 1 -- 172.21.15.123:0/3487030949 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fafb81f4560 msgr2=0x7fafb8143540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:57.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.278+0000 7fafb6d9d640 1 --2- 172.21.15.123:0/3487030949 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fafb81f4560 0x7fafb8143540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:57.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.278+0000 7fafb6d9d640 1 -- 172.21.15.123:0/3487030949 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fafa00051c0 msgr2=0x7fafb8161c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:57.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.278+0000 7fafb6d9d640 1 --2- 172.21.15.123:0/3487030949 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fafa00051c0 0x7fafb8161c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:57.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.278+0000 7fafb6d9d640 1 -- 172.21.15.123:0/3487030949 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb814f7a0 con 0x7fafb8151380 2024-09-15T23:22:57.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.278+0000 7fafb6d9d640 1 --2- 172.21.15.123:0/3487030949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafb8151380 0x7fafb815f260 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7fafb002a920 tx=0x7fafb00014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:57.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.279+0000 7fafa6ffd640 1 -- 172.21.15.123:0/3487030949 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb0007db0 con 0x7fafb8151380 2024-09-15T23:22:57.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.279+0000 7fafa6ffd640 1 -- 172.21.15.123:0/3487030949 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafb002ac70 con 0x7fafb8151380 2024-09-15T23:22:57.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.279+0000 7fafbcedd640 1 -- 172.21.15.123:0/3487030949 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafb815c560 con 0x7fafb8151380 2024-09-15T23:22:57.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.279+0000 7fafa6ffd640 1 -- 172.21.15.123:0/3487030949 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb0001a70 con 0x7fafb8151380 2024-09-15T23:22:57.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.279+0000 7fafbcedd640 1 -- 172.21.15.123:0/3487030949 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafb8143a80 con 0x7fafb8151380 2024-09-15T23:22:57.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.279+0000 7fafbcedd640 1 -- 172.21.15.123:0/3487030949 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafb806fb80 con 0x7fafb8151380 2024-09-15T23:22:57.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.280+0000 7fafa6ffd640 1 -- 172.21.15.123:0/3487030949 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fafb0007030 con 0x7fafb8151380 2024-09-15T23:22:57.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.280+0000 7fafa6ffd640 1 --2- 172.21.15.123:0/3487030949 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7faf9806c2b0 0x7faf9806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:57.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.281+0000 7fafa6ffd640 1 -- 172.21.15.123:0/3487030949 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 4943+0+0 (secure 0 0 0) 0x7fafb00aac60 con 0x7fafb8151380 2024-09-15T23:22:57.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.281+0000 7fafb659c640 1 --2- 172.21.15.123:0/3487030949 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7faf9806c2b0 0x7faf9806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:57.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.281+0000 7fafb659c640 1 --2- 172.21.15.123:0/3487030949 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7faf9806c2b0 0x7faf9806e770 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fafa8001050 tx=0x7fafa80078f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:57.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.285+0000 7fafa6ffd640 1 -- 172.21.15.123:0/3487030949 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fafb0043060 con 0x7fafb8151380 2024-09-15T23:22:57.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.511+0000 7fafbcedd640 1 -- 172.21.15.123:0/3487030949 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]} v 0) -- 0x7fafb80b1120 con 0x7fafb8151380 2024-09-15T23:22:57.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.830+0000 7fafa6ffd640 1 -- 172.21.15.123:0/3487030949 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_when_mds_is_inactive"]}]=0 v533) ==== 159+0+0 (secure 0 0 0) 0x7fafb00796d0 con 0x7fafb8151380 2024-09-15T23:22:57.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.832+0000 7fafbcedd640 1 -- 172.21.15.123:0/3487030949 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7faf9806c2b0 msgr2=0x7faf9806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:57.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.832+0000 7fafbcedd640 1 --2- 172.21.15.123:0/3487030949 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7faf9806c2b0 0x7faf9806e770 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fafa8001050 tx=0x7fafa80078f0 comp rx=0 tx=0).stop 2024-09-15T23:22:57.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.833+0000 7fafbcedd640 1 -- 172.21.15.123:0/3487030949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafb8151380 msgr2=0x7fafb815f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:57.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.833+0000 7fafbcedd640 1 --2- 172.21.15.123:0/3487030949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafb8151380 0x7fafb815f260 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7fafb002a920 tx=0x7fafb00014a0 comp rx=0 tx=0).stop 2024-09-15T23:22:57.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.833+0000 7fafbcedd640 1 -- 172.21.15.123:0/3487030949 shutdown_connections 2024-09-15T23:22:57.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.833+0000 7fafbcedd640 1 --2- 172.21.15.123:0/3487030949 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7faf9806c2b0 0x7faf9806e770 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:57.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.833+0000 7fafbcedd640 1 --2- 172.21.15.123:0/3487030949 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fafb8151380 0x7fafb815f260 unknown :-1 s=CLOSED pgs=2185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:57.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.833+0000 7fafbcedd640 1 --2- 172.21.15.123:0/3487030949 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fafb81f4560 0x7fafb8143540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:57.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.833+0000 7fafbcedd640 1 --2- 172.21.15.123:0/3487030949 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fafa00051c0 0x7fafb8161c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:57.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.833+0000 7fafbcedd640 1 -- 172.21.15.123:0/3487030949 >> 172.21.15.123:0/3487030949 conn(0x7fafb80b0a80 msgr2=0x7fafb80af570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:57.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.833+0000 7fafbcedd640 1 -- 172.21.15.123:0/3487030949 shutdown_connections 2024-09-15T23:22:57.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.833+0000 7fafbcedd640 1 -- 172.21.15.123:0/3487030949 wait complete. 2024-09-15T23:22:57.845 INFO:tasks.cephfs_test_runner:test_scrub_when_mds_is_inactive (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2024-09-15T23:22:57.846 INFO:tasks.cephfs_test_runner:Starting test: test_mdsdir_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-15T23:22:57.846 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:22:57.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.943+0000 7fbdd7f4b640 1 Processor -- start 2024-09-15T23:22:57.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.943+0000 7fbdd7f4b640 1 -- start start 2024-09-15T23:22:57.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.944+0000 7fbdd7f4b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbdd006c320 0x7fbdd015bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:57.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.944+0000 7fbdd7f4b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbdd013eb20 0x7fbdd015c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:57.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.944+0000 7fbdd7f4b640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdd0071180 con 0x7fbdd00b2d40 2024-09-15T23:22:57.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.944+0000 7fbdd7f4b640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fbdd0071ab0 con 0x7fbdd013eb20 2024-09-15T23:22:57.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.944+0000 7fbdd7f4b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbdd0071460 con 0x7fbdd006c320 2024-09-15T23:22:57.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.944+0000 7fbdd5ce7640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fbdd00b2d40 0x7fbdd006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59418/0 (socket says 172.21.15.123:59418) 2024-09-15T23:22:57.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.944+0000 7fbdd5ce7640 1 -- 172.21.15.123:0/1248728823 learned_addr learned my addr 172.21.15.123:0/1248728823 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:57.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.944+0000 7fbdd64e8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbdd013eb20 0x7fbdd015c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:57.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.944+0000 7fbdd64e8640 1 -- 172.21.15.123:0/1248728823 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbdd006c320 msgr2=0x7fbdd015bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:57.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.944+0000 7fbdd64e8640 1 --2- 172.21.15.123:0/1248728823 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbdd006c320 0x7fbdd015bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:57.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.945+0000 7fbdd64e8640 1 -- 172.21.15.123:0/1248728823 >> v1:172.21.15.123:6789/0 conn(0x7fbdd00b2d40 legacy=0x7fbdd006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:57.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.945+0000 7fbdd4ce5640 1 -- 172.21.15.123:0/1248728823 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3451715998 0 0) 0x7fbdd0071180 con 0x7fbdd00b2d40 2024-09-15T23:22:57.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.945+0000 7fbdd64e8640 1 -- 172.21.15.123:0/1248728823 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd0071740 con 0x7fbdd013eb20 2024-09-15T23:22:57.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.945+0000 7fbdd64e8640 1 --2- 172.21.15.123:0/1248728823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdd013eb20 0x7fbdd015c230 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8009d90 tx=0x7fbdc802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f030854242417cd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:57.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.945+0000 7fbdd4ce5640 1 -- 172.21.15.123:0/1248728823 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8007740 con 0x7fbdd013eb20 2024-09-15T23:22:57.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.945+0000 7fbdd4ce5640 1 -- 172.21.15.123:0/1248728823 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc80078e0 con 0x7fbdd013eb20 2024-09-15T23:22:57.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.945+0000 7fbdd4ce5640 1 -- 172.21.15.123:0/1248728823 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8007cb0 con 0x7fbdd013eb20 2024-09-15T23:22:57.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.946+0000 7fbdd7f4b640 1 -- 172.21.15.123:0/1248728823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdd013eb20 msgr2=0x7fbdd015c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:57.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.946+0000 7fbdd7f4b640 1 --2- 172.21.15.123:0/1248728823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdd013eb20 0x7fbdd015c230 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8009d90 tx=0x7fbdc802a660 comp rx=0 tx=0).stop 2024-09-15T23:22:57.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.946+0000 7fbdd7f4b640 1 -- 172.21.15.123:0/1248728823 shutdown_connections 2024-09-15T23:22:57.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.946+0000 7fbdd7f4b640 1 --2- 172.21.15.123:0/1248728823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdd013eb20 0x7fbdd015c230 unknown :-1 s=CLOSED pgs=2187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:57.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.946+0000 7fbdd7f4b640 1 --2- 172.21.15.123:0/1248728823 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbdd006c320 0x7fbdd015bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:57.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.946+0000 7fbdd7f4b640 1 -- 172.21.15.123:0/1248728823 >> 172.21.15.123:0/1248728823 conn(0x7fbdd00ccec0 msgr2=0x7fbdd00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:57.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.946+0000 7fbdd7f4b640 1 -- 172.21.15.123:0/1248728823 shutdown_connections 2024-09-15T23:22:57.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.946+0000 7fbdd7f4b640 1 -- 172.21.15.123:0/1248728823 wait complete. 2024-09-15T23:22:57.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.947+0000 7fbdd7f4b640 1 Processor -- start 2024-09-15T23:22:57.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.947+0000 7fbdd7f4b640 1 -- start start 2024-09-15T23:22:57.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.948+0000 7fbdd7f4b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdd006c320 0x7fbdd0142a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:57.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.948+0000 7fbdd7f4b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbdd00b2d40 0x7fbdd0151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:57.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.948+0000 7fbdd7f4b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdd013eb20 0x7fbdd0137ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:57.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.948+0000 7fbdd7f4b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd00720c0 con 0x7fbdd006c320 2024-09-15T23:22:57.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.948+0000 7fbdd7f4b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd0071f40 con 0x7fbdd013eb20 2024-09-15T23:22:57.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.948+0000 7fbdd7f4b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbdd0072240 con 0x7fbdd00b2d40 2024-09-15T23:22:57.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.948+0000 7fbdd5ce7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdd006c320 0x7fbdd0142a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:57.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.948+0000 7fbdd5ce7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdd006c320 0x7fbdd0142a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41576/0 (socket says 172.21.15.123:41576) 2024-09-15T23:22:57.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.948+0000 7fbdd5ce7640 1 -- 172.21.15.123:0/1380452860 learned_addr learned my addr 172.21.15.123:0/1380452860 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:57.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.948+0000 7fbdd64e8640 1 --2- 172.21.15.123:0/1380452860 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdd013eb20 0x7fbdd0137ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:57.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.948+0000 7fbdd54e6640 1 --2- 172.21.15.123:0/1380452860 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbdd00b2d40 0x7fbdd0151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:57.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.948+0000 7fbdd5ce7640 1 -- 172.21.15.123:0/1380452860 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbdd00b2d40 msgr2=0x7fbdd0151be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:57.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.948+0000 7fbdd5ce7640 1 --2- 172.21.15.123:0/1380452860 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbdd00b2d40 0x7fbdd0151be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:57.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.948+0000 7fbdd5ce7640 1 -- 172.21.15.123:0/1380452860 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdd013eb20 msgr2=0x7fbdd0137ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:57.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.948+0000 7fbdd5ce7640 1 --2- 172.21.15.123:0/1380452860 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdd013eb20 0x7fbdd0137ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:57.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.948+0000 7fbdd5ce7640 1 -- 172.21.15.123:0/1380452860 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd0143150 con 0x7fbdd006c320 2024-09-15T23:22:57.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.948+0000 7fbdd64e8640 1 --2- 172.21.15.123:0/1380452860 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdd013eb20 0x7fbdd0137ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:22:57.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.948+0000 7fbdd54e6640 1 --2- 172.21.15.123:0/1380452860 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbdd00b2d40 0x7fbdd0151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:22:57.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.948+0000 7fbdd5ce7640 1 --2- 172.21.15.123:0/1380452860 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdd006c320 0x7fbdd0142a20 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00c500 tx=0x7fbdcc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:57.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.949+0000 7fbdc67fc640 1 -- 172.21.15.123:0/1380452860 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc018070 con 0x7fbdd006c320 2024-09-15T23:22:57.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.949+0000 7fbdc67fc640 1 -- 172.21.15.123:0/1380452860 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdcc007580 con 0x7fbdd006c320 2024-09-15T23:22:57.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.949+0000 7fbdd7f4b640 1 -- 172.21.15.123:0/1380452860 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdd0143430 con 0x7fbdd006c320 2024-09-15T23:22:57.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.949+0000 7fbdc67fc640 1 -- 172.21.15.123:0/1380452860 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc004a20 con 0x7fbdd006c320 2024-09-15T23:22:57.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.949+0000 7fbdd7f4b640 1 -- 172.21.15.123:0/1380452860 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdd01439f0 con 0x7fbdd006c320 2024-09-15T23:22:57.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.950+0000 7fbdd7f4b640 1 -- 172.21.15.123:0/1380452860 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdd006bc10 con 0x7fbdd006c320 2024-09-15T23:22:57.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.950+0000 7fbdc67fc640 1 -- 172.21.15.123:0/1380452860 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbdcc01b070 con 0x7fbdd006c320 2024-09-15T23:22:57.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.950+0000 7fbdc67fc640 1 --2- 172.21.15.123:0/1380452860 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbdb406c2b0 0x7fbdb406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:57.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.951+0000 7fbdc67fc640 1 -- 172.21.15.123:0/1380452860 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 4943+0+0 (secure 0 0 0) 0x7fbdcc08a460 con 0x7fbdd006c320 2024-09-15T23:22:57.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.951+0000 7fbdd54e6640 1 --2- 172.21.15.123:0/1380452860 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbdb406c2b0 0x7fbdb406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:57.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.951+0000 7fbdd54e6640 1 --2- 172.21.15.123:0/1380452860 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbdb406c2b0 0x7fbdb406e770 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0006fd0 tx=0x7fbdc0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:57.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:57.955+0000 7fbdc67fc640 1 -- 172.21.15.123:0/1380452860 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbdcc058f60 con 0x7fbdd006c320 2024-09-15T23:22:58.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.120+0000 7fbdd7f4b640 1 -- 172.21.15.123:0/1380452860 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbdd006c9c0 con 0x7fbdd006c320 2024-09-15T23:22:58.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.121+0000 7fbdc67fc640 1 -- 172.21.15.123:0/1380452860 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v185) ==== 74+0+13068 (secure 0 0 0) 0x7fbdcc058860 con 0x7fbdd006c320 2024-09-15T23:22:58.122 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:22:58.122 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":185,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:22:56.828117+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.188:6836/2164993019":"2024-09-16T23:22:53.821264+0000","172.21.15.188:6834/2164993019":"2024-09-16T23:22:53.821264+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:22:58.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.123+0000 7fbdd7f4b640 1 -- 172.21.15.123:0/1380452860 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbdb406c2b0 msgr2=0x7fbdb406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:58.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.123+0000 7fbdd7f4b640 1 --2- 172.21.15.123:0/1380452860 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbdb406c2b0 0x7fbdb406e770 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fbdc0006fd0 tx=0x7fbdc0008040 comp rx=0 tx=0).stop 2024-09-15T23:22:58.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.123+0000 7fbdd7f4b640 1 -- 172.21.15.123:0/1380452860 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdd006c320 msgr2=0x7fbdd0142a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:58.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.123+0000 7fbdd7f4b640 1 --2- 172.21.15.123:0/1380452860 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdd006c320 0x7fbdd0142a20 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00c500 tx=0x7fbdcc00c9c0 comp rx=0 tx=0).stop 2024-09-15T23:22:58.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.123+0000 7fbdd7f4b640 1 -- 172.21.15.123:0/1380452860 shutdown_connections 2024-09-15T23:22:58.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.123+0000 7fbdd7f4b640 1 --2- 172.21.15.123:0/1380452860 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdd013eb20 0x7fbdd0137ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:58.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.123+0000 7fbdd7f4b640 1 --2- 172.21.15.123:0/1380452860 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbdd00b2d40 0x7fbdd0151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:58.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.123+0000 7fbdd7f4b640 1 --2- 172.21.15.123:0/1380452860 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbdb406c2b0 0x7fbdb406e770 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:58.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.123+0000 7fbdd7f4b640 1 --2- 172.21.15.123:0/1380452860 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdd006c320 0x7fbdd0142a20 unknown :-1 s=CLOSED pgs=2188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:58.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.123+0000 7fbdd7f4b640 1 -- 172.21.15.123:0/1380452860 >> 172.21.15.123:0/1380452860 conn(0x7fbdd00ccec0 msgr2=0x7fbdd013f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:58.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.123+0000 7fbdd7f4b640 1 -- 172.21.15.123:0/1380452860 shutdown_connections 2024-09-15T23:22:58.126 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.123+0000 7fbdd7f4b640 1 -- 172.21.15.123:0/1380452860 wait complete. 2024-09-15T23:22:58.135 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T23:12:01.531886+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T23:22:58.136 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T23:22:58.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.237+0000 7f31933bd640 1 Processor -- start 2024-09-15T23:22:58.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.237+0000 7f31933bd640 1 -- start start 2024-09-15T23:22:58.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.238+0000 7f31933bd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f318c155950 0x7f318c073600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:58.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.238+0000 7f31933bd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f318c162c80 0x7f318c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:58.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.238+0000 7f31933bd640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f318c073cc0 con 0x7f318c06c150 2024-09-15T23:22:58.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.238+0000 7f31933bd640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f318c070370 con 0x7f318c155950 2024-09-15T23:22:58.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.238+0000 7f31933bd640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f318c071aa0 con 0x7f318c162c80 2024-09-15T23:22:58.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.238+0000 7f3191159640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f318c155950 0x7f318c073600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:58.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.238+0000 7f319195a640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f318c06c150 0x7f318c0afb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59430/0 (socket says 172.21.15.123:59430) 2024-09-15T23:22:58.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.238+0000 7f3191159640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f318c155950 0x7f318c073600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41586/0 (socket says 172.21.15.123:41586) 2024-09-15T23:22:58.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.238+0000 7f319195a640 1 -- 172.21.15.123:0/618873316 learned_addr learned my addr 172.21.15.123:0/618873316 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:58.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.238+0000 7f3191159640 1 -- 172.21.15.123:0/618873316 >> v2:172.21.15.188:3300/0 conn(0x7f318c162c80 msgr2=0x7f318c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:58.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.238+0000 7f3191159640 1 --2- 172.21.15.123:0/618873316 >> v2:172.21.15.188:3300/0 conn(0x7f318c162c80 0x7f318c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:58.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.238+0000 7f3191159640 1 -- 172.21.15.123:0/618873316 >> v1:172.21.15.123:6789/0 conn(0x7f318c06c150 legacy=0x7f318c0afb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:58.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.238+0000 7f3191159640 1 -- 172.21.15.123:0/618873316 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f318c071d80 con 0x7f318c155950 2024-09-15T23:22:58.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.238+0000 7f3183fff640 1 -- 172.21.15.123:0/618873316 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3782869026 0 0) 0x7f318c073cc0 con 0x7f318c06c150 2024-09-15T23:22:58.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.239+0000 7f3191159640 1 --2- 172.21.15.123:0/618873316 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f318c155950 0x7f318c073600 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7f318c06d720 tx=0x7f318802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2262ec708fc1e73 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:58.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.239+0000 7f3183fff640 1 -- 172.21.15.123:0/618873316 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3188037070 con 0x7f318c155950 2024-09-15T23:22:58.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.239+0000 7f3183fff640 1 -- 172.21.15.123:0/618873316 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3188032440 con 0x7f318c155950 2024-09-15T23:22:58.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.239+0000 7f3183fff640 1 -- 172.21.15.123:0/618873316 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3188032810 con 0x7f318c155950 2024-09-15T23:22:58.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.240+0000 7f31933bd640 1 -- 172.21.15.123:0/618873316 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f318c155950 msgr2=0x7f318c073600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:58.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.240+0000 7f31933bd640 1 --2- 172.21.15.123:0/618873316 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f318c155950 0x7f318c073600 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7f318c06d720 tx=0x7f318802a1a0 comp rx=0 tx=0).stop 2024-09-15T23:22:58.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.240+0000 7f31933bd640 1 -- 172.21.15.123:0/618873316 shutdown_connections 2024-09-15T23:22:58.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.240+0000 7f31933bd640 1 --2- 172.21.15.123:0/618873316 >> v2:172.21.15.188:3300/0 conn(0x7f318c162c80 0x7f318c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:58.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.240+0000 7f31933bd640 1 --2- 172.21.15.123:0/618873316 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f318c155950 0x7f318c073600 unknown :-1 s=CLOSED pgs=2190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:58.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.240+0000 7f31933bd640 1 -- 172.21.15.123:0/618873316 >> 172.21.15.123:0/618873316 conn(0x7f318c06db30 msgr2=0x7f318c06df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:58.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.240+0000 7f31933bd640 1 -- 172.21.15.123:0/618873316 shutdown_connections 2024-09-15T23:22:58.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.240+0000 7f31933bd640 1 -- 172.21.15.123:0/618873316 wait complete. 2024-09-15T23:22:58.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.241+0000 7f31933bd640 1 Processor -- start 2024-09-15T23:22:58.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.241+0000 7f31933bd640 1 -- start start 2024-09-15T23:22:58.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.242+0000 7f31933bd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f318c06c150 0x7f318c158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:58.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.242+0000 7f31933bd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f318c162c80 0x7f318c152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:58.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.242+0000 7f31933bd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f318c1534b0 0x7f318c0cf070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:58.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.242+0000 7f31933bd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f318c0721e0 con 0x7f318c162c80 2024-09-15T23:22:58.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.242+0000 7f31933bd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f318c072060 con 0x7f318c1534b0 2024-09-15T23:22:58.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.242+0000 7f31933bd640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f318c0b0230 con 0x7f318c06c150 2024-09-15T23:22:58.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.242+0000 7f3190958640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f318c162c80 0x7f318c152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:58.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.242+0000 7f3190958640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f318c162c80 0x7f318c152d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41602/0 (socket says 172.21.15.123:41602) 2024-09-15T23:22:58.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.242+0000 7f3190958640 1 -- 172.21.15.123:0/3293468357 learned_addr learned my addr 172.21.15.123:0/3293468357 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:58.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.242+0000 7f319195a640 1 --2- 172.21.15.123:0/3293468357 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f318c1534b0 0x7f318c0cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:58.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.242+0000 7f3191159640 1 --2- 172.21.15.123:0/3293468357 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f318c06c150 0x7f318c158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:58.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.242+0000 7f3190958640 1 -- 172.21.15.123:0/3293468357 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f318c06c150 msgr2=0x7f318c158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:58.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.242+0000 7f3190958640 1 --2- 172.21.15.123:0/3293468357 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f318c06c150 0x7f318c158270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:58.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.242+0000 7f3190958640 1 -- 172.21.15.123:0/3293468357 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f318c1534b0 msgr2=0x7f318c0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:58.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.242+0000 7f3190958640 1 --2- 172.21.15.123:0/3293468357 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f318c1534b0 0x7f318c0cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:58.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.242+0000 7f3190958640 1 -- 172.21.15.123:0/3293468357 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f318c1587b0 con 0x7f318c162c80 2024-09-15T23:22:58.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.242+0000 7f3191159640 1 --2- 172.21.15.123:0/3293468357 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f318c06c150 0x7f318c158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:58.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.242+0000 7f319195a640 1 --2- 172.21.15.123:0/3293468357 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f318c1534b0 0x7f318c0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:58.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.242+0000 7f3190958640 1 --2- 172.21.15.123:0/3293468357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f318c162c80 0x7f318c152d40 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7f317c00b410 tx=0x7f317c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:58.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.242+0000 7f3181ffb640 1 -- 172.21.15.123:0/3293468357 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317c015020 con 0x7f318c162c80 2024-09-15T23:22:58.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.242+0000 7f3181ffb640 1 -- 172.21.15.123:0/3293468357 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f317c011850 con 0x7f318c162c80 2024-09-15T23:22:58.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.242+0000 7f3181ffb640 1 -- 172.21.15.123:0/3293468357 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317c011c40 con 0x7f318c162c80 2024-09-15T23:22:58.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.242+0000 7f31933bd640 1 -- 172.21.15.123:0/3293468357 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f318c153280 con 0x7f318c162c80 2024-09-15T23:22:58.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.243+0000 7f31933bd640 1 -- 172.21.15.123:0/3293468357 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f318c0cff40 con 0x7f318c162c80 2024-09-15T23:22:58.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.243+0000 7f31933bd640 1 -- 172.21.15.123:0/3293468357 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f318c0d0550 con 0x7f318c162c80 2024-09-15T23:22:58.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.244+0000 7f3181ffb640 1 -- 172.21.15.123:0/3293468357 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f317c018020 con 0x7f318c162c80 2024-09-15T23:22:58.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.244+0000 7f3181ffb640 1 --2- 172.21.15.123:0/3293468357 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f317006c2b0 0x7f317006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:58.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.245+0000 7f3181ffb640 1 -- 172.21.15.123:0/3293468357 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 4943+0+0 (secure 0 0 0) 0x7f317c08b0e0 con 0x7f318c162c80 2024-09-15T23:22:58.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.245+0000 7f3191159640 1 --2- 172.21.15.123:0/3293468357 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f317006c2b0 0x7f317006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:58.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.245+0000 7f3191159640 1 --2- 172.21.15.123:0/3293468357 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f317006c2b0 0x7f317006e770 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f3188034000 tx=0x7f318802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:58.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.249+0000 7f3181ffb640 1 -- 172.21.15.123:0/3293468357 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f317c01f020 con 0x7f318c162c80 2024-09-15T23:22:58.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.412+0000 7f31933bd640 1 -- 172.21.15.123:0/3293468357 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f318c0b6360 con 0x7f318c162c80 2024-09-15T23:22:58.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.413+0000 7f3181ffb640 1 -- 172.21.15.123:0/3293468357 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v185) ==== 93+0+10 (secure 0 0 0) 0x7f317c0172c0 con 0x7f318c162c80 2024-09-15T23:22:58.414 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-15T23:22:58.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.415+0000 7f31933bd640 1 -- 172.21.15.123:0/3293468357 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f317006c2b0 msgr2=0x7f317006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:58.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.415+0000 7f31933bd640 1 --2- 172.21.15.123:0/3293468357 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f317006c2b0 0x7f317006e770 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f3188034000 tx=0x7f318802e000 comp rx=0 tx=0).stop 2024-09-15T23:22:58.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.415+0000 7f31933bd640 1 -- 172.21.15.123:0/3293468357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f318c162c80 msgr2=0x7f318c152d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:58.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.415+0000 7f31933bd640 1 --2- 172.21.15.123:0/3293468357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f318c162c80 0x7f318c152d40 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7f317c00b410 tx=0x7f317c00b8d0 comp rx=0 tx=0).stop 2024-09-15T23:22:58.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.415+0000 7f31933bd640 1 -- 172.21.15.123:0/3293468357 shutdown_connections 2024-09-15T23:22:58.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.415+0000 7f31933bd640 1 --2- 172.21.15.123:0/3293468357 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f318c1534b0 0x7f318c0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:58.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.415+0000 7f31933bd640 1 --2- 172.21.15.123:0/3293468357 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f317006c2b0 0x7f317006e770 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:58.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.415+0000 7f31933bd640 1 --2- 172.21.15.123:0/3293468357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f318c162c80 0x7f318c152d40 unknown :-1 s=CLOSED pgs=2191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:58.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.415+0000 7f31933bd640 1 --2- 172.21.15.123:0/3293468357 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f318c06c150 0x7f318c158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:58.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.415+0000 7f31933bd640 1 -- 172.21.15.123:0/3293468357 >> 172.21.15.123:0/3293468357 conn(0x7f318c06db30 msgr2=0x7f318c06f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:58.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.415+0000 7f31933bd640 1 -- 172.21.15.123:0/3293468357 shutdown_connections 2024-09-15T23:22:58.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.415+0000 7f31933bd640 1 -- 172.21.15.123:0/3293468357 wait complete. 2024-09-15T23:22:58.427 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace' 2024-09-15T23:22:58.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.525+0000 7fbdf6877640 1 Processor -- start 2024-09-15T23:22:58.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.525+0000 7fbdf6877640 1 -- start start 2024-09-15T23:22:58.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.525+0000 7fbdf6877640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fbdf015c4f0 0x7fbdf015d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:58.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.526+0000 7fbdf6877640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdf0160f20 con 0x7fbdf00d0200 2024-09-15T23:22:58.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.526+0000 7fbdf6877640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdf0073400 con 0x7fbdf00d2630 2024-09-15T23:22:58.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.526+0000 7fbdf6877640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fbdf00736e0 con 0x7fbdf015c4f0 2024-09-15T23:22:58.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.526+0000 7fbdef7fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fbdf00d0200 0x7fbdf0160100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59438/0 (socket says 172.21.15.123:59438) 2024-09-15T23:22:58.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.526+0000 7fbdef7fe640 1 -- 172.21.15.123:0/739577867 learned_addr learned my addr 172.21.15.123:0/739577867 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:58.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.526+0000 7fbdeffff640 1 --2- 172.21.15.123:0/739577867 >> v2:172.21.15.188:3300/0 conn(0x7fbdf015c4f0 0x7fbdf015d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:58.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.526+0000 7fbdeeffd640 1 -- 172.21.15.123:0/739577867 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3404522269 0 0) 0x7fbdf0160f20 con 0x7fbdf00d0200 2024-09-15T23:22:58.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.526+0000 7fbdeeffd640 1 -- 172.21.15.123:0/739577867 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdd8003520 con 0x7fbdf00d0200 2024-09-15T23:22:58.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.526+0000 7fbdeffff640 1 -- 172.21.15.123:0/739577867 >> v1:172.21.15.188:6789/0 conn(0x7fbdf00d2630 legacy=0x7fbdf0160810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:58.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.526+0000 7fbdeffff640 1 -- 172.21.15.123:0/739577867 >> v1:172.21.15.123:6789/0 conn(0x7fbdf00d0200 legacy=0x7fbdf0160100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:58.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.526+0000 7fbdeeffd640 1 -- 172.21.15.123:0/739577867 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4029566995 0 0) 0x7fbdd8003520 con 0x7fbdf00d0200 2024-09-15T23:22:58.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.526+0000 7fbdeffff640 1 -- 172.21.15.123:0/739577867 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdf00739c0 con 0x7fbdf015c4f0 2024-09-15T23:22:58.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.527+0000 7fbdeffff640 1 --2- 172.21.15.123:0/739577867 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdf015c4f0 0x7fbdf015d4b0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fbde00097a0 tx=0x7fbde002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c3c68d0d31b0718 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:58.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.527+0000 7fbdeeffd640 1 -- 172.21.15.123:0/739577867 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde0037070 con 0x7fbdf015c4f0 2024-09-15T23:22:58.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.527+0000 7fbdeeffd640 1 -- 172.21.15.123:0/739577867 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbde002ac50 con 0x7fbdf015c4f0 2024-09-15T23:22:58.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.527+0000 7fbdeeffd640 1 -- 172.21.15.123:0/739577867 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde4001670 con 0x7fbdf015c4f0 2024-09-15T23:22:58.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.528+0000 7fbdf6877640 1 -- 172.21.15.123:0/739577867 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdf015c4f0 msgr2=0x7fbdf015d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:58.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.528+0000 7fbdf6877640 1 --2- 172.21.15.123:0/739577867 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdf015c4f0 0x7fbdf015d4b0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fbde00097a0 tx=0x7fbde002a1c0 comp rx=0 tx=0).stop 2024-09-15T23:22:58.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.528+0000 7fbdf6877640 1 -- 172.21.15.123:0/739577867 shutdown_connections 2024-09-15T23:22:58.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.528+0000 7fbdf6877640 1 --2- 172.21.15.123:0/739577867 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdf015c4f0 0x7fbdf015d4b0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:58.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.528+0000 7fbdf6877640 1 -- 172.21.15.123:0/739577867 >> 172.21.15.123:0/739577867 conn(0x7fbdf006f400 msgr2=0x7fbdf006f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:58.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.528+0000 7fbdf6877640 1 -- 172.21.15.123:0/739577867 shutdown_connections 2024-09-15T23:22:58.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.528+0000 7fbdf6877640 1 -- 172.21.15.123:0/739577867 wait complete. 2024-09-15T23:22:58.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.529+0000 7fbdf6877640 1 Processor -- start 2024-09-15T23:22:58.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.529+0000 7fbdf6877640 1 -- start start 2024-09-15T23:22:58.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.530+0000 7fbdf6877640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdf00d0200 0x7fbdf00b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:58.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.530+0000 7fbdf6877640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbdf00d2630 0x7fbdf00b3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:58.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.530+0000 7fbdf6877640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdf015c4f0 0x7fbdf0154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:58.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.530+0000 7fbdf6877640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf00d0fa0 con 0x7fbdf015c4f0 2024-09-15T23:22:58.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.530+0000 7fbdf6877640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf0073f80 con 0x7fbdf00d0200 2024-09-15T23:22:58.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.530+0000 7fbdf6877640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbdf015c8d0 con 0x7fbdf00d2630 2024-09-15T23:22:58.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.530+0000 7fbdf4e14640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdf015c4f0 0x7fbdf0154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:58.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.530+0000 7fbdf4e14640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdf015c4f0 0x7fbdf0154c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41608/0 (socket says 172.21.15.123:41608) 2024-09-15T23:22:58.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.530+0000 7fbdf4e14640 1 -- 172.21.15.123:0/2086580562 learned_addr learned my addr 172.21.15.123:0/2086580562 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:58.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.530+0000 7fbdeffff640 1 --2- 172.21.15.123:0/2086580562 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdf00d0200 0x7fbdf00b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:58.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.530+0000 7fbdef7fe640 1 --2- 172.21.15.123:0/2086580562 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbdf00d2630 0x7fbdf00b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:58.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.530+0000 7fbdf4e14640 1 -- 172.21.15.123:0/2086580562 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbdf00d2630 msgr2=0x7fbdf00b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:58.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.530+0000 7fbdf4e14640 1 --2- 172.21.15.123:0/2086580562 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbdf00d2630 0x7fbdf00b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:58.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.530+0000 7fbdf4e14640 1 -- 172.21.15.123:0/2086580562 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdf00d0200 msgr2=0x7fbdf00b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:58.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.530+0000 7fbdf4e14640 1 --2- 172.21.15.123:0/2086580562 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdf00d0200 0x7fbdf00b22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:58.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.530+0000 7fbdf4e14640 1 -- 172.21.15.123:0/2086580562 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdf00b28a0 con 0x7fbdf015c4f0 2024-09-15T23:22:58.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.530+0000 7fbdf4e14640 1 --2- 172.21.15.123:0/2086580562 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdf015c4f0 0x7fbdf0154c40 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7fbde800c730 tx=0x7fbde800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:58.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.531+0000 7fbdecff9640 1 -- 172.21.15.123:0/2086580562 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde8003b70 con 0x7fbdf015c4f0 2024-09-15T23:22:58.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.531+0000 7fbdecff9640 1 -- 172.21.15.123:0/2086580562 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbde8003d10 con 0x7fbdf015c4f0 2024-09-15T23:22:58.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.531+0000 7fbdecff9640 1 -- 172.21.15.123:0/2086580562 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde800aa90 con 0x7fbdf015c4f0 2024-09-15T23:22:58.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.531+0000 7fbdf6877640 1 -- 172.21.15.123:0/2086580562 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdf00b2b80 con 0x7fbdf015c4f0 2024-09-15T23:22:58.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.531+0000 7fbdf6877640 1 -- 172.21.15.123:0/2086580562 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdf00b3420 con 0x7fbdf015c4f0 2024-09-15T23:22:58.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.532+0000 7fbdf6877640 1 -- 172.21.15.123:0/2086580562 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdf00b3620 con 0x7fbdf015c4f0 2024-09-15T23:22:58.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.532+0000 7fbdecff9640 1 -- 172.21.15.123:0/2086580562 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbde800ac30 con 0x7fbdf015c4f0 2024-09-15T23:22:58.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.533+0000 7fbdecff9640 1 --2- 172.21.15.123:0/2086580562 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbddc06c2b0 0x7fbddc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:58.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.533+0000 7fbdecff9640 1 -- 172.21.15.123:0/2086580562 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 4943+0+0 (secure 0 0 0) 0x7fbde808af00 con 0x7fbdf015c4f0 2024-09-15T23:22:58.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.533+0000 7fbdeffff640 1 --2- 172.21.15.123:0/2086580562 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbddc06c2b0 0x7fbddc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:58.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.533+0000 7fbdeffff640 1 --2- 172.21.15.123:0/2086580562 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbddc06c2b0 0x7fbddc06e770 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fbde0034000 tx=0x7fbde002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:58.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.537+0000 7fbdecff9640 1 -- 172.21.15.123:0/2086580562 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbdf00b3620 con 0x7fbdf015c4f0 2024-09-15T23:22:58.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.765+0000 7fbdf6877640 1 -- 172.21.15.123:0/2086580562 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]} v 0) -- 0x7fbdf0073080 con 0x7fbdf015c4f0 2024-09-15T23:22:58.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.832+0000 7fbdecff9640 1 -- 172.21.15.123:0/2086580562 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]}]=0 v534) ==== 143+0+0 (secure 0 0 0) 0x7fbde8059320 con 0x7fbdf015c4f0 2024-09-15T23:22:58.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.833+0000 7fbdf6877640 1 -- 172.21.15.123:0/2086580562 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbddc06c2b0 msgr2=0x7fbddc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:58.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.833+0000 7fbdf6877640 1 --2- 172.21.15.123:0/2086580562 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbddc06c2b0 0x7fbddc06e770 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fbde0034000 tx=0x7fbde002e000 comp rx=0 tx=0).stop 2024-09-15T23:22:58.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.834+0000 7fbdf6877640 1 -- 172.21.15.123:0/2086580562 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdf015c4f0 msgr2=0x7fbdf0154c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:58.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.834+0000 7fbdf6877640 1 --2- 172.21.15.123:0/2086580562 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdf015c4f0 0x7fbdf0154c40 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7fbde800c730 tx=0x7fbde800cbf0 comp rx=0 tx=0).stop 2024-09-15T23:22:58.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.834+0000 7fbdf6877640 1 -- 172.21.15.123:0/2086580562 shutdown_connections 2024-09-15T23:22:58.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.834+0000 7fbdf6877640 1 --2- 172.21.15.123:0/2086580562 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbddc06c2b0 0x7fbddc06e770 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:58.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.834+0000 7fbdf6877640 1 --2- 172.21.15.123:0/2086580562 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdf015c4f0 0x7fbdf0154c40 unknown :-1 s=CLOSED pgs=2193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:58.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.834+0000 7fbdf6877640 1 --2- 172.21.15.123:0/2086580562 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbdf00d2630 0x7fbdf00b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:58.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.834+0000 7fbdf6877640 1 --2- 172.21.15.123:0/2086580562 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdf00d0200 0x7fbdf00b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:58.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.834+0000 7fbdf6877640 1 -- 172.21.15.123:0/2086580562 >> 172.21.15.123:0/2086580562 conn(0x7fbdf006f400 msgr2=0x7fbdf006f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:58.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.834+0000 7fbdf6877640 1 -- 172.21.15.123:0/2086580562 shutdown_connections 2024-09-15T23:22:58.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.834+0000 7fbdf6877640 1 -- 172.21.15.123:0/2086580562 wait complete. 2024-09-15T23:22:58.846 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T23:22:58.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.947+0000 7f044eb8d640 1 Processor -- start 2024-09-15T23:22:58.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.947+0000 7f044eb8d640 1 -- start start 2024-09-15T23:22:58.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.948+0000 7f044eb8d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f044815b7c0 0x7f04480b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:58.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.948+0000 7f044eb8d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f04480cead0 0x7f0448071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:58.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.948+0000 7f044eb8d640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04480cf2e0 con 0x7f04480ccf30 2024-09-15T23:22:58.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.948+0000 7f044eb8d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f0448070fe0 con 0x7f04480cead0 2024-09-15T23:22:58.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.948+0000 7f044eb8d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f04480712c0 con 0x7f044815b7c0 2024-09-15T23:22:58.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.948+0000 7f044d12a640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f04480cead0 0x7f0448071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:58.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.948+0000 7f0447fff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f044815b7c0 0x7f04480b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:58.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.948+0000 7f044c929640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f04480ccf30 0x7f04480cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:53868/0 (socket says 172.21.15.123:53868) 2024-09-15T23:22:58.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.948+0000 7f044c929640 1 -- 172.21.15.123:0/3447774171 learned_addr learned my addr 172.21.15.123:0/3447774171 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:22:58.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.949+0000 7f044d12a640 1 -- 172.21.15.123:0/3447774171 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f044815b7c0 msgr2=0x7f04480b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:58.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.949+0000 7f044d12a640 1 --2- 172.21.15.123:0/3447774171 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f044815b7c0 0x7f04480b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:58.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.949+0000 7f044d12a640 1 -- 172.21.15.123:0/3447774171 >> v1:172.21.15.188:6789/0 conn(0x7f04480ccf30 legacy=0x7f04480cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:58.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.949+0000 7f044d12a640 1 -- 172.21.15.123:0/3447774171 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04480715a0 con 0x7f04480cead0 2024-09-15T23:22:58.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.949+0000 7f04477fe640 1 -- 172.21.15.123:0/3447774171 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2192424651 0 0) 0x7f04480cf2e0 con 0x7f04480ccf30 2024-09-15T23:22:58.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.949+0000 7f044d12a640 1 --2- 172.21.15.123:0/3447774171 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04480cead0 0x7f0448071ac0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f0440009d90 tx=0x7f044002a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d86ae81ec3b26471 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:58.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.950+0000 7f04477fe640 1 -- 172.21.15.123:0/3447774171 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0440031600 con 0x7f04480cead0 2024-09-15T23:22:58.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.950+0000 7f04477fe640 1 -- 172.21.15.123:0/3447774171 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04400317a0 con 0x7f04480cead0 2024-09-15T23:22:58.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.950+0000 7f04477fe640 1 -- 172.21.15.123:0/3447774171 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0440031b70 con 0x7f04480cead0 2024-09-15T23:22:58.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.950+0000 7f044eb8d640 1 -- 172.21.15.123:0/3447774171 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04480cead0 msgr2=0x7f0448071ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:58.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.950+0000 7f044eb8d640 1 --2- 172.21.15.123:0/3447774171 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04480cead0 0x7f0448071ac0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f0440009d90 tx=0x7f044002a5d0 comp rx=0 tx=0).stop 2024-09-15T23:22:58.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.950+0000 7f044eb8d640 1 -- 172.21.15.123:0/3447774171 shutdown_connections 2024-09-15T23:22:58.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.950+0000 7f044eb8d640 1 --2- 172.21.15.123:0/3447774171 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04480cead0 0x7f0448071ac0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:58.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.950+0000 7f044eb8d640 1 --2- 172.21.15.123:0/3447774171 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f044815b7c0 0x7f04480b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:58.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.950+0000 7f044eb8d640 1 -- 172.21.15.123:0/3447774171 >> 172.21.15.123:0/3447774171 conn(0x7f044806d0f0 msgr2=0x7f044806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:58.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.950+0000 7f044eb8d640 1 -- 172.21.15.123:0/3447774171 shutdown_connections 2024-09-15T23:22:58.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.950+0000 7f044eb8d640 1 -- 172.21.15.123:0/3447774171 wait complete. 2024-09-15T23:22:58.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.951+0000 7f044eb8d640 1 Processor -- start 2024-09-15T23:22:58.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.951+0000 7f044eb8d640 1 -- start start 2024-09-15T23:22:58.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.952+0000 7f044eb8d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04480ccf30 0x7f044814d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:58.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.952+0000 7f044eb8d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04480cead0 0x7f04481546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:58.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.952+0000 7f044eb8d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f044815b7c0 0x7f0448154c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:58.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.952+0000 7f044eb8d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f04480cf0c0 con 0x7f044815b7c0 2024-09-15T23:22:58.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.952+0000 7f044eb8d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f04480cef40 con 0x7f04480ccf30 2024-09-15T23:22:58.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.952+0000 7f044eb8d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0448072000 con 0x7f04480cead0 2024-09-15T23:22:58.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.952+0000 7f044d12a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f044815b7c0 0x7f0448154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:58.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.952+0000 7f044d12a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f044815b7c0 0x7f0448154c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41612/0 (socket says 172.21.15.123:41612) 2024-09-15T23:22:58.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.952+0000 7f044d12a640 1 -- 172.21.15.123:0/525024182 learned_addr learned my addr 172.21.15.123:0/525024182 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:58.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.953+0000 7f044c929640 1 --2- 172.21.15.123:0/525024182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04480ccf30 0x7f044814d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:58.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.953+0000 7f0447fff640 1 --2- 172.21.15.123:0/525024182 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04480cead0 0x7f04481546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:58.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.953+0000 7f044d12a640 1 -- 172.21.15.123:0/525024182 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04480cead0 msgr2=0x7f04481546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:58.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.953+0000 7f044d12a640 1 --2- 172.21.15.123:0/525024182 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04480cead0 0x7f04481546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:58.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.953+0000 7f044d12a640 1 -- 172.21.15.123:0/525024182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04480ccf30 msgr2=0x7f044814d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:58.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.953+0000 7f044d12a640 1 --2- 172.21.15.123:0/525024182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04480ccf30 0x7f044814d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:58.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.953+0000 7f044d12a640 1 -- 172.21.15.123:0/525024182 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f044815dd80 con 0x7f044815b7c0 2024-09-15T23:22:58.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.953+0000 7f044d12a640 1 --2- 172.21.15.123:0/525024182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f044815b7c0 0x7f0448154c00 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7f0440009eb0 tx=0x7f0440004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:58.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.953+0000 7f04457fa640 1 -- 172.21.15.123:0/525024182 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0440040070 con 0x7f044815b7c0 2024-09-15T23:22:58.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.953+0000 7f04457fa640 1 -- 172.21.15.123:0/525024182 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0440030be0 con 0x7f044815b7c0 2024-09-15T23:22:58.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.953+0000 7f044eb8d640 1 -- 172.21.15.123:0/525024182 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f044815e060 con 0x7f044815b7c0 2024-09-15T23:22:58.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.953+0000 7f04457fa640 1 -- 172.21.15.123:0/525024182 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0440009450 con 0x7f044815b7c0 2024-09-15T23:22:58.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.953+0000 7f044eb8d640 1 -- 172.21.15.123:0/525024182 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0448152350 con 0x7f044815b7c0 2024-09-15T23:22:58.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.954+0000 7f044eb8d640 1 -- 172.21.15.123:0/525024182 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0448071ac0 con 0x7f044815b7c0 2024-09-15T23:22:58.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.954+0000 7f04457fa640 1 -- 172.21.15.123:0/525024182 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0440039040 con 0x7f044815b7c0 2024-09-15T23:22:58.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.955+0000 7f04457fa640 1 --2- 172.21.15.123:0/525024182 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f043406c2b0 0x7f043406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:58.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.955+0000 7f04457fa640 1 -- 172.21.15.123:0/525024182 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 4943+0+0 (secure 0 0 0) 0x7f04400ac080 con 0x7f044815b7c0 2024-09-15T23:22:58.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.955+0000 7f044c929640 1 --2- 172.21.15.123:0/525024182 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f043406c2b0 0x7f043406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:58.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.956+0000 7f044c929640 1 --2- 172.21.15.123:0/525024182 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f043406c2b0 0x7f043406e770 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f0438000f60 tx=0x7f0438007b50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:58.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:58.959+0000 7f04457fa640 1 -- 172.21.15.123:0/525024182 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f044007ab80 con 0x7f044815b7c0 2024-09-15T23:22:59.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.126+0000 7f044eb8d640 1 -- 172.21.15.123:0/525024182 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f04480cc960 con 0x7f044815b7c0 2024-09-15T23:22:59.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.131+0000 7f04457fa640 1 -- 172.21.15.123:0/525024182 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v46)=0 v46) ==== 122+0+0 (secure 0 0 0) 0x7f044007a480 con 0x7f044815b7c0 2024-09-15T23:22:59.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.134+0000 7f044eb8d640 1 -- 172.21.15.123:0/525024182 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f043406c2b0 msgr2=0x7f043406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:59.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.134+0000 7f044eb8d640 1 --2- 172.21.15.123:0/525024182 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f043406c2b0 0x7f043406e770 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f0438000f60 tx=0x7f0438007b50 comp rx=0 tx=0).stop 2024-09-15T23:22:59.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.134+0000 7f044eb8d640 1 -- 172.21.15.123:0/525024182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f044815b7c0 msgr2=0x7f0448154c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:59.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.134+0000 7f044eb8d640 1 --2- 172.21.15.123:0/525024182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f044815b7c0 0x7f0448154c00 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7f0440009eb0 tx=0x7f0440004a40 comp rx=0 tx=0).stop 2024-09-15T23:22:59.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.134+0000 7f044eb8d640 1 -- 172.21.15.123:0/525024182 shutdown_connections 2024-09-15T23:22:59.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.134+0000 7f044eb8d640 1 --2- 172.21.15.123:0/525024182 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f043406c2b0 0x7f043406e770 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:59.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.134+0000 7f044eb8d640 1 --2- 172.21.15.123:0/525024182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f044815b7c0 0x7f0448154c00 unknown :-1 s=CLOSED pgs=2194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:59.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.134+0000 7f044eb8d640 1 --2- 172.21.15.123:0/525024182 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f04480cead0 0x7f04481546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:59.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.134+0000 7f044eb8d640 1 --2- 172.21.15.123:0/525024182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f04480ccf30 0x7f044814d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:59.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.134+0000 7f044eb8d640 1 -- 172.21.15.123:0/525024182 >> 172.21.15.123:0/525024182 conn(0x7f044806d0f0 msgr2=0x7f04480cd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:59.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.134+0000 7f044eb8d640 1 -- 172.21.15.123:0/525024182 shutdown_connections 2024-09-15T23:22:59.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.134+0000 7f044eb8d640 1 -- 172.21.15.123:0/525024182 wait complete. 2024-09-15T23:22:59.147 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:22:59.148 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:22:59.196 DEBUG:teuthology.orchestra.run.smithi188:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:22:59.245 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:22:59.246 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:22:59.246 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:22:59.262 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:22:59.262 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:22:59.262 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:22:59.280 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:22:59.280 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:22:59.280 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:22:59.317 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:22:59.318 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:22:59.318 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:22:59.339 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:22:59.339 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-15T23:22:59.340 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:22:59.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.454+0000 7fd4f4442640 1 Processor -- start 2024-09-15T23:22:59.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.454+0000 7fd4f4442640 1 -- start start 2024-09-15T23:22:59.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.455+0000 7fd4f4442640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd4ec145ed0 0x7fd4ec0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:59.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.455+0000 7fd4f4442640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd4ec073180 0x7fd4ec0735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:59.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.455+0000 7fd4f4442640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4ec0b5880 0x7fd4ec0b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:59.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.455+0000 7fd4f4442640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fd4ec073b00 con 0x7fd4ec073180 2024-09-15T23:22:59.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.455+0000 7fd4f4442640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fd4ec0b4020 con 0x7fd4ec145ed0 2024-09-15T23:22:59.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.455+0000 7fd4f4442640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd4ec0b42c0 con 0x7fd4ec0b5880 2024-09-15T23:22:59.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.455+0000 7fd4f19dd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd4ec073180 0x7fd4ec0735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:59.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.455+0000 7fd4f19dd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd4ec073180 0x7fd4ec0735c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41624/0 (socket says 172.21.15.123:41624) 2024-09-15T23:22:59.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.455+0000 7fd4f19dd640 1 -- 172.21.15.123:0/1984329166 learned_addr learned my addr 172.21.15.123:0/1984329166 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:59.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.455+0000 7fd4f21de640 1 --2- 172.21.15.123:0/1984329166 >> v2:172.21.15.188:3300/0 conn(0x7fd4ec145ed0 0x7fd4ec0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:59.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.455+0000 7fd4f29df640 1 --2- 172.21.15.123:0/1984329166 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4ec0b5880 0x7fd4ec0b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:59.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.455+0000 7fd4f19dd640 1 -- 172.21.15.123:0/1984329166 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4ec0b5880 msgr2=0x7fd4ec0b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:59.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.455+0000 7fd4f19dd640 1 --2- 172.21.15.123:0/1984329166 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4ec0b5880 0x7fd4ec0b5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:59.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.455+0000 7fd4f19dd640 1 -- 172.21.15.123:0/1984329166 >> v2:172.21.15.188:3300/0 conn(0x7fd4ec145ed0 msgr2=0x7fd4ec0b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:22:59.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.455+0000 7fd4f19dd640 1 --2- 172.21.15.123:0/1984329166 >> v2:172.21.15.188:3300/0 conn(0x7fd4ec145ed0 0x7fd4ec0b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:59.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.455+0000 7fd4f19dd640 1 -- 172.21.15.123:0/1984329166 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4ec0b45a0 con 0x7fd4ec073180 2024-09-15T23:22:59.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.456+0000 7fd4f19dd640 1 --2- 172.21.15.123:0/1984329166 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4ec073180 0x7fd4ec0735c0 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec069cd0 tx=0x7fd4dc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd71b20c7112372 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:59.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.456+0000 7fd4f11dc640 1 -- 172.21.15.123:0/1984329166 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc037070 con 0x7fd4ec073180 2024-09-15T23:22:59.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.456+0000 7fd4f11dc640 1 -- 172.21.15.123:0/1984329166 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4dc032440 con 0x7fd4ec073180 2024-09-15T23:22:59.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.456+0000 7fd4f11dc640 1 -- 172.21.15.123:0/1984329166 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc032810 con 0x7fd4ec073180 2024-09-15T23:22:59.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.457+0000 7fd4f4442640 1 -- 172.21.15.123:0/1984329166 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4ec073180 msgr2=0x7fd4ec0735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:59.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.457+0000 7fd4f4442640 1 --2- 172.21.15.123:0/1984329166 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4ec073180 0x7fd4ec0735c0 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec069cd0 tx=0x7fd4dc02a1e0 comp rx=0 tx=0).stop 2024-09-15T23:22:59.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.457+0000 7fd4f4442640 1 -- 172.21.15.123:0/1984329166 shutdown_connections 2024-09-15T23:22:59.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.457+0000 7fd4f4442640 1 --2- 172.21.15.123:0/1984329166 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4ec0b5880 0x7fd4ec0b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:59.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.457+0000 7fd4f4442640 1 --2- 172.21.15.123:0/1984329166 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4ec073180 0x7fd4ec0735c0 unknown :-1 s=CLOSED pgs=2195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:59.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.457+0000 7fd4f4442640 1 --2- 172.21.15.123:0/1984329166 >> v2:172.21.15.188:3300/0 conn(0x7fd4ec145ed0 0x7fd4ec0b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:59.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.457+0000 7fd4f4442640 1 -- 172.21.15.123:0/1984329166 >> 172.21.15.123:0/1984329166 conn(0x7fd4ec0ccec0 msgr2=0x7fd4ec0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:59.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.457+0000 7fd4f4442640 1 -- 172.21.15.123:0/1984329166 shutdown_connections 2024-09-15T23:22:59.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.457+0000 7fd4f4442640 1 -- 172.21.15.123:0/1984329166 wait complete. 2024-09-15T23:22:59.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.458+0000 7fd4f4442640 1 Processor -- start 2024-09-15T23:22:59.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.458+0000 7fd4f4442640 1 -- start start 2024-09-15T23:22:59.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.459+0000 7fd4f4442640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4ec073180 0x7fd4ec1f2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:59.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.459+0000 7fd4f4442640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4ec0b5880 0x7fd4ec0cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:59.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.459+0000 7fd4f4442640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4ec145ed0 0x7fd4ec140100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:59.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.459+0000 7fd4f4442640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ec0b6250 con 0x7fd4ec145ed0 2024-09-15T23:22:59.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.459+0000 7fd4f4442640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ec0b4b60 con 0x7fd4ec073180 2024-09-15T23:22:59.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.459+0000 7fd4f4442640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd4ec0b63d0 con 0x7fd4ec0b5880 2024-09-15T23:22:59.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.459+0000 7fd4f29df640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4ec145ed0 0x7fd4ec140100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:59.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.459+0000 7fd4f29df640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4ec145ed0 0x7fd4ec140100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41634/0 (socket says 172.21.15.123:41634) 2024-09-15T23:22:59.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.459+0000 7fd4f29df640 1 -- 172.21.15.123:0/55349537 learned_addr learned my addr 172.21.15.123:0/55349537 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:22:59.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.459+0000 7fd4f19dd640 1 --2- 172.21.15.123:0/55349537 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4ec0b5880 0x7fd4ec0cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:59.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.459+0000 7fd4f21de640 1 --2- 172.21.15.123:0/55349537 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4ec073180 0x7fd4ec1f2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:59.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.459+0000 7fd4f29df640 1 -- 172.21.15.123:0/55349537 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4ec0b5880 msgr2=0x7fd4ec0cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:59.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.459+0000 7fd4f29df640 1 --2- 172.21.15.123:0/55349537 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4ec0b5880 0x7fd4ec0cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:59.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.459+0000 7fd4f29df640 1 -- 172.21.15.123:0/55349537 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4ec073180 msgr2=0x7fd4ec1f2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:59.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.459+0000 7fd4f29df640 1 --2- 172.21.15.123:0/55349537 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4ec073180 0x7fd4ec1f2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:59.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.459+0000 7fd4f29df640 1 -- 172.21.15.123:0/55349537 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4ec140980 con 0x7fd4ec145ed0 2024-09-15T23:22:59.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.459+0000 7fd4f21de640 1 --2- 172.21.15.123:0/55349537 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4ec073180 0x7fd4ec1f2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:22:59.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.459+0000 7fd4f29df640 1 --2- 172.21.15.123:0/55349537 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4ec145ed0 0x7fd4ec140100 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7fd4e400eed0 tx=0x7fd4e400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:59.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.459+0000 7fd4e2ffd640 1 -- 172.21.15.123:0/55349537 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e4018020 con 0x7fd4ec145ed0 2024-09-15T23:22:59.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.459+0000 7fd4e2ffd640 1 -- 172.21.15.123:0/55349537 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4e4014400 con 0x7fd4ec145ed0 2024-09-15T23:22:59.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.459+0000 7fd4f4442640 1 -- 172.21.15.123:0/55349537 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4ec1f23e0 con 0x7fd4ec145ed0 2024-09-15T23:22:59.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.459+0000 7fd4e2ffd640 1 -- 172.21.15.123:0/55349537 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e40147f0 con 0x7fd4ec145ed0 2024-09-15T23:22:59.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.460+0000 7fd4f4442640 1 -- 172.21.15.123:0/55349537 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4ec140640 con 0x7fd4ec145ed0 2024-09-15T23:22:59.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.461+0000 7fd4f4442640 1 -- 172.21.15.123:0/55349537 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4ec1462b0 con 0x7fd4ec145ed0 2024-09-15T23:22:59.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.461+0000 7fd4e2ffd640 1 -- 172.21.15.123:0/55349537 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd4e4005d10 con 0x7fd4ec145ed0 2024-09-15T23:22:59.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.462+0000 7fd4e2ffd640 1 --2- 172.21.15.123:0/55349537 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd4d006c2b0 0x7fd4d006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:59.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.462+0000 7fd4e2ffd640 1 -- 172.21.15.123:0/55349537 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 4943+0+0 (secure 0 0 0) 0x7fd4e408b790 con 0x7fd4ec145ed0 2024-09-15T23:22:59.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.462+0000 7fd4f21de640 1 --2- 172.21.15.123:0/55349537 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd4d006c2b0 0x7fd4d006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:59.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.463+0000 7fd4f21de640 1 --2- 172.21.15.123:0/55349537 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd4d006c2b0 0x7fd4d006e770 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8009af0 tx=0x7fd4e8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:59.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.466+0000 7fd4e2ffd640 1 -- 172.21.15.123:0/55349537 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd4e4022070 con 0x7fd4ec145ed0 2024-09-15T23:22:59.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.664+0000 7fd4f4442640 1 -- 172.21.15.123:0/55349537 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4ec0b37f0 con 0x7fd4ec145ed0 2024-09-15T23:22:59.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.665+0000 7fd4e2ffd640 1 -- 172.21.15.123:0/55349537 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) ==== 95+0+3930 (secure 0 0 0) 0x7fd4e405a200 con 0x7fd4ec145ed0 2024-09-15T23:22:59.667 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:22:59.667 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":115,"btime":"2024-09-15T23:22:54:822655+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7676,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/1063668006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":1063668006},{"type":"v1","addr":"172.21.15.188:6836","nonce":1063668006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115},{"gid":8452,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/1861304244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":1861304244},{"type":"v1","addr":"172.21.15.188:6837","nonce":1861304244}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":10056,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/2869473990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2869473990},{"type":"v1","addr":"172.21.15.123:6833","nonce":2869473990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":107},{"gid":10398,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/3258637583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":3258637583},{"type":"v1","addr":"172.21.15.123:6835","nonce":3258637583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":115}],"filesystems":[]} 2024-09-15T23:22:59.667 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 115 2024-09-15T23:22:59.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.666+0000 7fd4f4442640 1 -- 172.21.15.123:0/55349537 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd4d006c2b0 msgr2=0x7fd4d006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:59.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.666+0000 7fd4f4442640 1 --2- 172.21.15.123:0/55349537 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd4d006c2b0 0x7fd4d006e770 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8009af0 tx=0x7fd4e8008040 comp rx=0 tx=0).stop 2024-09-15T23:22:59.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.667+0000 7fd4f4442640 1 -- 172.21.15.123:0/55349537 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4ec145ed0 msgr2=0x7fd4ec140100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:59.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.667+0000 7fd4f4442640 1 --2- 172.21.15.123:0/55349537 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4ec145ed0 0x7fd4ec140100 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7fd4e400eed0 tx=0x7fd4e400b480 comp rx=0 tx=0).stop 2024-09-15T23:22:59.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.667+0000 7fd4f4442640 1 -- 172.21.15.123:0/55349537 shutdown_connections 2024-09-15T23:22:59.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.667+0000 7fd4f4442640 1 --2- 172.21.15.123:0/55349537 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd4d006c2b0 0x7fd4d006e770 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:59.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.667+0000 7fd4f4442640 1 --2- 172.21.15.123:0/55349537 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4ec145ed0 0x7fd4ec140100 unknown :-1 s=CLOSED pgs=2196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:59.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.667+0000 7fd4f4442640 1 --2- 172.21.15.123:0/55349537 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd4ec0b5880 0x7fd4ec0cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:59.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.667+0000 7fd4f4442640 1 --2- 172.21.15.123:0/55349537 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd4ec073180 0x7fd4ec1f2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:59.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.667+0000 7fd4f4442640 1 -- 172.21.15.123:0/55349537 >> 172.21.15.123:0/55349537 conn(0x7fd4ec0ccec0 msgr2=0x7fd4ec142de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:59.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.667+0000 7fd4f4442640 1 -- 172.21.15.123:0/55349537 shutdown_connections 2024-09-15T23:22:59.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:22:59.667+0000 7fd4f4442640 1 -- 172.21.15.123:0/55349537 wait complete. 2024-09-15T23:22:59.680 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T23:22:59.680 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T23:22:59.680 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T23:22:59.680 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:22:59.680 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T23:22:59.680 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T23:22:59.681 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T23:22:59.681 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:22:59.681 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T23:22:59.681 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T23:22:59.681 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T23:22:59.681 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:22:59.681 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T23:22:59.682 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T23:22:59.682 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T23:22:59.682 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:22:59.691 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T23:22:59.691 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T23:22:59.693 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T23:22:59.693 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T23:22:59.694 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T23:22:59.694 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T23:22:59.733 INFO:tasks.ceph.mds.c:Started 2024-09-15T23:22:59.733 DEBUG:teuthology.parallel:result is None 2024-09-15T23:22:59.736 INFO:tasks.ceph.mds.b:Started 2024-09-15T23:22:59.736 DEBUG:teuthology.parallel:result is None 2024-09-15T23:22:59.737 INFO:tasks.ceph.mds.d:Started 2024-09-15T23:22:59.737 DEBUG:teuthology.parallel:result is None 2024-09-15T23:22:59.805 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-15T23:22:59.818 INFO:tasks.ceph.mds.b.smithi188.stdout:starting mds.b at 2024-09-15T23:22:59.819 INFO:tasks.ceph.mds.d.smithi188.stdout:starting mds.d at 2024-09-15T23:23:05.691 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T23:23:05.691 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T23:23:05.694 INFO:tasks.ceph.mds.a:Started 2024-09-15T23:23:05.695 DEBUG:teuthology.parallel:result is None 2024-09-15T23:23:05.695 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T23:23:05.782 INFO:tasks.ceph.mds.a.smithi123.stdout:starting mds.a at 2024-09-15T23:23:05.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.808+0000 7feba445c640 1 Processor -- start 2024-09-15T23:23:05.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.808+0000 7feba445c640 1 -- start start 2024-09-15T23:23:05.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.809+0000 7feba445c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7feb9c15ed20 0x7feb9c0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:05.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.809+0000 7feba445c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feb9c0b90e0 0x7feb9c0b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:05.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.809+0000 7feba445c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb9c0d0e70 con 0x7feb9c0d23b0 2024-09-15T23:23:05.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.809+0000 7feba445c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7feb9c0d41c0 con 0x7feb9c15ed20 2024-09-15T23:23:05.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.809+0000 7feba445c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7feb9c0d35b0 con 0x7feb9c0b90e0 2024-09-15T23:23:05.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.809+0000 7feba21f8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7feb9c15ed20 0x7feb9c0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:05.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.809+0000 7feba29f9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feb9c0b90e0 0x7feb9c0b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:05.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.809+0000 7feba21f8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7feb9c15ed20 0x7feb9c0b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:41882/0 (socket says 172.21.15.123:41882) 2024-09-15T23:23:05.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.809+0000 7feba29f9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feb9c0b90e0 0x7feb9c0b67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:50472/0 (socket says 172.21.15.123:50472) 2024-09-15T23:23:05.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.809+0000 7feba19f7640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7feb9c0d23b0 0x7feb9c0cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:53892/0 (socket says 172.21.15.123:53892) 2024-09-15T23:23:05.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.809+0000 7feba21f8640 1 -- 172.21.15.123:0/1894037022 learned_addr learned my addr 172.21.15.123:0/1894037022 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:05.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.810+0000 7feba29f9640 1 -- 172.21.15.123:0/1894037022 >> v2:172.21.15.188:3300/0 conn(0x7feb9c15ed20 msgr2=0x7feb9c0b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:05.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.810+0000 7feba29f9640 1 --2- 172.21.15.123:0/1894037022 >> v2:172.21.15.188:3300/0 conn(0x7feb9c15ed20 0x7feb9c0b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:05.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.810+0000 7feba29f9640 1 -- 172.21.15.123:0/1894037022 >> v1:172.21.15.188:6789/0 conn(0x7feb9c0d23b0 legacy=0x7feb9c0cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:05.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.810+0000 7feba29f9640 1 -- 172.21.15.123:0/1894037022 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb9c0d3890 con 0x7feb9c0b90e0 2024-09-15T23:23:05.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.810+0000 7feba21f8640 1 --2- 172.21.15.123:0/1894037022 >> v2:172.21.15.188:3300/0 conn(0x7feb9c15ed20 0x7feb9c0b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:23:05.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.810+0000 7feba29f9640 1 --2- 172.21.15.123:0/1894037022 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feb9c0b90e0 0x7feb9c0b67a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7feb940097a0 tx=0x7feb9402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1c6557f81184c9c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:05.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.811+0000 7feba11f6640 1 -- 172.21.15.123:0/1894037022 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb94037070 con 0x7feb9c0b90e0 2024-09-15T23:23:05.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.811+0000 7feba11f6640 1 -- 172.21.15.123:0/1894037022 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb9402ae50 con 0x7feb9c0b90e0 2024-09-15T23:23:05.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.811+0000 7feba11f6640 1 -- 172.21.15.123:0/1894037022 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb94032660 con 0x7feb9c0b90e0 2024-09-15T23:23:05.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.811+0000 7feba445c640 1 -- 172.21.15.123:0/1894037022 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feb9c0b90e0 msgr2=0x7feb9c0b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:05.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.811+0000 7feba445c640 1 --2- 172.21.15.123:0/1894037022 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feb9c0b90e0 0x7feb9c0b67a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7feb940097a0 tx=0x7feb9402a100 comp rx=0 tx=0).stop 2024-09-15T23:23:05.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.811+0000 7feba445c640 1 -- 172.21.15.123:0/1894037022 shutdown_connections 2024-09-15T23:23:05.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.811+0000 7feba445c640 1 --2- 172.21.15.123:0/1894037022 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feb9c0b90e0 0x7feb9c0b67a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:05.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.811+0000 7feba445c640 1 --2- 172.21.15.123:0/1894037022 >> v2:172.21.15.188:3300/0 conn(0x7feb9c15ed20 0x7feb9c0b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:05.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.811+0000 7feba445c640 1 -- 172.21.15.123:0/1894037022 >> 172.21.15.123:0/1894037022 conn(0x7feb9c0d1260 msgr2=0x7feb9c0d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:05.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.811+0000 7feba445c640 1 -- 172.21.15.123:0/1894037022 shutdown_connections 2024-09-15T23:23:05.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.811+0000 7feba445c640 1 -- 172.21.15.123:0/1894037022 wait complete. 2024-09-15T23:23:05.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.813+0000 7feba445c640 1 Processor -- start 2024-09-15T23:23:05.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.813+0000 7feba445c640 1 -- start start 2024-09-15T23:23:05.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.813+0000 7feba445c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feb9c0b90e0 0x7feb9c0cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:05.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.813+0000 7feba445c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feb9c0d23b0 0x7feb9c15c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:05.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.813+0000 7feba445c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb9c15ed20 0x7feb9c1e9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:05.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.813+0000 7feba445c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7feb9c0d32a0 con 0x7feb9c15ed20 2024-09-15T23:23:05.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.814+0000 7feba445c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7feb9c0d3e50 con 0x7feb9c0d23b0 2024-09-15T23:23:05.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.814+0000 7feba445c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7feb9c15f100 con 0x7feb9c0b90e0 2024-09-15T23:23:05.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.814+0000 7feba29f9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb9c15ed20 0x7feb9c1e9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:05.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.814+0000 7feba29f9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb9c15ed20 0x7feb9c1e9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41662/0 (socket says 172.21.15.123:41662) 2024-09-15T23:23:05.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.814+0000 7feba29f9640 1 -- 172.21.15.123:0/4178944546 learned_addr learned my addr 172.21.15.123:0/4178944546 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:05.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.814+0000 7feba21f8640 1 --2- 172.21.15.123:0/4178944546 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feb9c0b90e0 0x7feb9c0cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:05.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.814+0000 7feba19f7640 1 --2- 172.21.15.123:0/4178944546 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feb9c0d23b0 0x7feb9c15c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:05.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.814+0000 7feba29f9640 1 -- 172.21.15.123:0/4178944546 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feb9c0b90e0 msgr2=0x7feb9c0cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:05.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.814+0000 7feba29f9640 1 --2- 172.21.15.123:0/4178944546 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feb9c0b90e0 0x7feb9c0cadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:05.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.814+0000 7feba29f9640 1 -- 172.21.15.123:0/4178944546 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feb9c0d23b0 msgr2=0x7feb9c15c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:05.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.814+0000 7feba29f9640 1 --2- 172.21.15.123:0/4178944546 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feb9c0d23b0 0x7feb9c15c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:05.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.814+0000 7feba29f9640 1 -- 172.21.15.123:0/4178944546 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb9c0c9d30 con 0x7feb9c15ed20 2024-09-15T23:23:05.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.814+0000 7feba29f9640 1 --2- 172.21.15.123:0/4178944546 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb9c15ed20 0x7feb9c1e9600 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 crypto rx=0x7feb94035040 tx=0x7feb940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:05.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.814+0000 7feb9affd640 1 -- 172.21.15.123:0/4178944546 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb94041070 con 0x7feb9c15ed20 2024-09-15T23:23:05.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.814+0000 7feb9affd640 1 -- 172.21.15.123:0/4178944546 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb9403c460 con 0x7feb9c15ed20 2024-09-15T23:23:05.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.814+0000 7feba445c640 1 -- 172.21.15.123:0/4178944546 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb9c0ca010 con 0x7feb9c15ed20 2024-09-15T23:23:05.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.814+0000 7feb9affd640 1 -- 172.21.15.123:0/4178944546 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb94037040 con 0x7feb9c15ed20 2024-09-15T23:23:05.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.814+0000 7feba445c640 1 -- 172.21.15.123:0/4178944546 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb9c0ca5d0 con 0x7feb9c15ed20 2024-09-15T23:23:05.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.815+0000 7feba445c640 1 -- 172.21.15.123:0/4178944546 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb9c0b7010 con 0x7feb9c15ed20 2024-09-15T23:23:05.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.816+0000 7feb9affd640 1 -- 172.21.15.123:0/4178944546 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7feb94044070 con 0x7feb9c15ed20 2024-09-15T23:23:05.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.816+0000 7feb9affd640 1 --2- 172.21.15.123:0/4178944546 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7feb8806c2b0 0x7feb8806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:05.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.816+0000 7feb9affd640 1 -- 172.21.15.123:0/4178944546 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 4943+0+0 (secure 0 0 0) 0x7feb940ab780 con 0x7feb9c15ed20 2024-09-15T23:23:05.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.817+0000 7feba21f8640 1 --2- 172.21.15.123:0/4178944546 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7feb8806c2b0 0x7feb8806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:05.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.817+0000 7feba21f8640 1 --2- 172.21.15.123:0/4178944546 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7feb8806c2b0 0x7feb8806e770 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7feb8c009c90 tx=0x7feb8c00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:05.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:05.821+0000 7feb9affd640 1 -- 172.21.15.123:0/4178944546 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feb94079cd0 con 0x7feb9c15ed20 2024-09-15T23:23:06.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.002+0000 7feba445c640 1 -- 172.21.15.123:0/4178944546 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7feb9c0b3f20 con 0x7feb9c15ed20 2024-09-15T23:23:06.109 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-09-15T23:23:06.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.853+0000 7feb9affd640 1 -- 172.21.15.123:0/4178944546 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v190) ==== 97+0+0 (secure 0 0 0) 0x7feb9407dfd0 con 0x7feb9c15ed20 2024-09-15T23:23:06.854 INFO:teuthology.orchestra.run.smithi123.stderr: removed all blocklist entries 2024-09-15T23:23:06.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.856+0000 7feba445c640 1 -- 172.21.15.123:0/4178944546 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7feb8806c2b0 msgr2=0x7feb8806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:06.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.856+0000 7feba445c640 1 --2- 172.21.15.123:0/4178944546 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7feb8806c2b0 0x7feb8806e770 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7feb8c009c90 tx=0x7feb8c00b040 comp rx=0 tx=0).stop 2024-09-15T23:23:06.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.856+0000 7feba445c640 1 -- 172.21.15.123:0/4178944546 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb9c15ed20 msgr2=0x7feb9c1e9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:06.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.856+0000 7feba445c640 1 --2- 172.21.15.123:0/4178944546 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb9c15ed20 0x7feb9c1e9600 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 crypto rx=0x7feb94035040 tx=0x7feb940046c0 comp rx=0 tx=0).stop 2024-09-15T23:23:06.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.856+0000 7feba445c640 1 -- 172.21.15.123:0/4178944546 shutdown_connections 2024-09-15T23:23:06.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.856+0000 7feba445c640 1 --2- 172.21.15.123:0/4178944546 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7feb8806c2b0 0x7feb8806e770 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:06.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.856+0000 7feba445c640 1 --2- 172.21.15.123:0/4178944546 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feb9c15ed20 0x7feb9c1e9600 unknown :-1 s=CLOSED pgs=2203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:06.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.856+0000 7feba445c640 1 --2- 172.21.15.123:0/4178944546 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feb9c0d23b0 0x7feb9c15c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:06.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.856+0000 7feba445c640 1 --2- 172.21.15.123:0/4178944546 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feb9c0b90e0 0x7feb9c0cadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:06.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.856+0000 7feba445c640 1 -- 172.21.15.123:0/4178944546 >> 172.21.15.123:0/4178944546 conn(0x7feb9c0d1260 msgr2=0x7feb9c0b4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:06.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.856+0000 7feba445c640 1 -- 172.21.15.123:0/4178944546 shutdown_connections 2024-09-15T23:23:06.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.856+0000 7feba445c640 1 -- 172.21.15.123:0/4178944546 wait complete. 2024-09-15T23:23:06.870 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T23:23:06.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.974+0000 7f3c2059f640 1 Processor -- start 2024-09-15T23:23:06.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.975+0000 7f3c2059f640 1 -- start start 2024-09-15T23:23:06.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.975+0000 7f3c2059f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f3c1806cd20 0x7f3c180b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:06.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.975+0000 7f3c2059f640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c1815eab0 con 0x7f3c18070b80 2024-09-15T23:23:06.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.975+0000 7f3c2059f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c1815ed70 con 0x7f3c1815e6d0 2024-09-15T23:23:06.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.975+0000 7f3c2059f640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f3c1815f050 con 0x7f3c1806cd20 2024-09-15T23:23:06.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.976+0000 7f3c1eb3c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f3c18070b80 0x7f3c181622a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:34784/0 (socket says 172.21.15.123:34784) 2024-09-15T23:23:06.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.976+0000 7f3c1eb3c640 1 -- 172.21.15.123:0/450136980 learned_addr learned my addr 172.21.15.123:0/450136980 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:23:06.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.976+0000 7f3c1db3a640 1 --2- 172.21.15.123:0/450136980 >> v2:172.21.15.188:3300/0 conn(0x7f3c1806cd20 0x7f3c180b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:06.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.976+0000 7f3c1d339640 1 -- 172.21.15.123:0/450136980 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2113823172 0 0) 0x7f3c1815eab0 con 0x7f3c18070b80 2024-09-15T23:23:06.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.976+0000 7f3c1d339640 1 -- 172.21.15.123:0/450136980 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c00003520 con 0x7f3c18070b80 2024-09-15T23:23:06.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.976+0000 7f3c1d339640 1 -- 172.21.15.123:0/450136980 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3536264079 0 0) 0x7f3c00003520 con 0x7f3c18070b80 2024-09-15T23:23:06.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.976+0000 7f3c1d339640 1 -- 172.21.15.123:0/450136980 >> v2:172.21.15.188:3300/0 conn(0x7f3c1806cd20 msgr2=0x7f3c180b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:06.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.976+0000 7f3c1d339640 1 --2- 172.21.15.123:0/450136980 >> v2:172.21.15.188:3300/0 conn(0x7f3c1806cd20 0x7f3c180b6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:06.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.976+0000 7f3c1d339640 1 -- 172.21.15.123:0/450136980 >> v1:172.21.15.188:6789/0 conn(0x7f3c1815e6d0 legacy=0x7f3c18071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:06.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.976+0000 7f3c1d339640 1 -- 172.21.15.123:0/450136980 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c1815f330 con 0x7f3c18070b80 2024-09-15T23:23:06.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.976+0000 7f3c1d339640 1 -- 172.21.15.123:0/450136980 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f3c080019f0 con 0x7f3c18070b80 2024-09-15T23:23:06.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.976+0000 7f3c1d339640 1 -- 172.21.15.123:0/450136980 >> v1:172.21.15.123:6789/0 conn(0x7f3c18070b80 legacy=0x7f3c181622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:06.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.976+0000 7f3c1d339640 1 --2- 172.21.15.123:0/450136980 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3c000039b0 0x7f3c00003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:06.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.976+0000 7f3c1d339640 1 --2- 172.21.15.123:0/450136980 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3c00004800 0x7f3c00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:06.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.976+0000 7f3c1d339640 1 --2- 172.21.15.123:0/450136980 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c000051c0 0x7f3c0000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:06.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.976+0000 7f3c1d339640 1 -- 172.21.15.123:0/450136980 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1815f050 con 0x7f3c000051c0 2024-09-15T23:23:06.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.976+0000 7f3c1d339640 1 -- 172.21.15.123:0/450136980 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0000c060 con 0x7f3c00004800 2024-09-15T23:23:06.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.976+0000 7f3c1d339640 1 -- 172.21.15.123:0/450136980 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f3c0000c260 con 0x7f3c000039b0 2024-09-15T23:23:06.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.976+0000 7f3c1eb3c640 1 --2- 172.21.15.123:0/450136980 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c000051c0 0x7f3c0000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:06.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.976+0000 7f3c1db3a640 1 --2- 172.21.15.123:0/450136980 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3c00004800 0x7f3c00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:06.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.976+0000 7f3c1e33b640 1 --2- 172.21.15.123:0/450136980 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3c000039b0 0x7f3c00003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:06.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.977+0000 7f3c1eb3c640 1 -- 172.21.15.123:0/450136980 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3c000039b0 msgr2=0x7f3c00003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:06.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.977+0000 7f3c1eb3c640 1 --2- 172.21.15.123:0/450136980 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3c000039b0 0x7f3c00003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:06.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.977+0000 7f3c1eb3c640 1 -- 172.21.15.123:0/450136980 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3c00004800 msgr2=0x7f3c00004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:06.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.977+0000 7f3c1eb3c640 1 --2- 172.21.15.123:0/450136980 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3c00004800 0x7f3c00004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:06.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.977+0000 7f3c1eb3c640 1 -- 172.21.15.123:0/450136980 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c00003520 con 0x7f3c000051c0 2024-09-15T23:23:06.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.977+0000 7f3c1eb3c640 1 -- 172.21.15.123:0/450136980 reap_dead start 2024-09-15T23:23:06.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.977+0000 7f3c1eb3c640 1 --2- 172.21.15.123:0/450136980 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c000051c0 0x7f3c0000b9c0 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7f3c0800a840 tx=0x7f3c00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fb716e5dba5b943 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:06.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.978+0000 7f3c1d339640 1 -- 172.21.15.123:0/450136980 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0800a460 con 0x7f3c000051c0 2024-09-15T23:23:06.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.978+0000 7f3c1d339640 1 -- 172.21.15.123:0/450136980 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c0802f070 con 0x7f3c000051c0 2024-09-15T23:23:06.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.978+0000 7f3c1d339640 1 -- 172.21.15.123:0/450136980 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0802bcb0 con 0x7f3c000051c0 2024-09-15T23:23:06.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.978+0000 7f3c2059f640 1 -- 172.21.15.123:0/450136980 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c000051c0 msgr2=0x7f3c0000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:06.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.978+0000 7f3c2059f640 1 --2- 172.21.15.123:0/450136980 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c000051c0 0x7f3c0000b9c0 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7f3c0800a840 tx=0x7f3c00005830 comp rx=0 tx=0).stop 2024-09-15T23:23:06.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.978+0000 7f3c2059f640 1 -- 172.21.15.123:0/450136980 shutdown_connections 2024-09-15T23:23:06.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.978+0000 7f3c2059f640 1 --2- 172.21.15.123:0/450136980 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c000051c0 0x7f3c0000b9c0 unknown :-1 s=CLOSED pgs=2205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:06.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.978+0000 7f3c2059f640 1 -- 172.21.15.123:0/450136980 >> 172.21.15.123:0/450136980 conn(0x7f3c18067fb0 msgr2=0x7f3c1806f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:06.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.978+0000 7f3c2059f640 1 -- 172.21.15.123:0/450136980 shutdown_connections 2024-09-15T23:23:06.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.978+0000 7f3c2059f640 1 -- 172.21.15.123:0/450136980 wait complete. 2024-09-15T23:23:06.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.979+0000 7f3c2059f640 1 Processor -- start 2024-09-15T23:23:06.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.979+0000 7f3c2059f640 1 -- start start 2024-09-15T23:23:06.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.980+0000 7f3c2059f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c000051c0 0x7f3c181f18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:06.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.980+0000 7f3c2059f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3c18152af0 0x7f3c18152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:06.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.980+0000 7f3c2059f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3c1814b440 0x7f3c1814b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:06.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.980+0000 7f3c2059f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3c18071390 con 0x7f3c000051c0 2024-09-15T23:23:06.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.980+0000 7f3c2059f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1815f8f0 con 0x7f3c18152af0 2024-09-15T23:23:06.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.980+0000 7f3c2059f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f3c18071510 con 0x7f3c1814b440 2024-09-15T23:23:06.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.980+0000 7f3c1e33b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c000051c0 0x7f3c181f18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:06.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.980+0000 7f3c1e33b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c000051c0 0x7f3c181f18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44786/0 (socket says 172.21.15.123:44786) 2024-09-15T23:23:06.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.980+0000 7f3c1e33b640 1 -- 172.21.15.123:0/644563596 learned_addr learned my addr 172.21.15.123:0/644563596 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:06.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.980+0000 7f3c1e33b640 1 -- 172.21.15.123:0/644563596 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3c1814b440 msgr2=0x7f3c1814b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:06.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.980+0000 7f3c1e33b640 1 --2- 172.21.15.123:0/644563596 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3c1814b440 0x7f3c1814b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:06.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.980+0000 7f3c1e33b640 1 -- 172.21.15.123:0/644563596 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3c18152af0 msgr2=0x7f3c18152f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:06.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.980+0000 7f3c1e33b640 1 --2- 172.21.15.123:0/644563596 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3c18152af0 0x7f3c18152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:06.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.980+0000 7f3c1e33b640 1 -- 172.21.15.123:0/644563596 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c181f1e10 con 0x7f3c000051c0 2024-09-15T23:23:06.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.981+0000 7f3c1e33b640 1 --2- 172.21.15.123:0/644563596 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c000051c0 0x7f3c181f18d0 secure :-1 s=READY pgs=2206 cs=0 l=1 rev1=1 crypto rx=0x7f3c1000f620 tx=0x7f3c1000fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:06.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.981+0000 7f3c16ffd640 1 -- 172.21.15.123:0/644563596 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c100053a0 con 0x7f3c000051c0 2024-09-15T23:23:06.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.981+0000 7f3c16ffd640 1 -- 172.21.15.123:0/644563596 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c10018070 con 0x7f3c000051c0 2024-09-15T23:23:06.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.981+0000 7f3c2059f640 1 -- 172.21.15.123:0/644563596 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c1814c050 con 0x7f3c000051c0 2024-09-15T23:23:06.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.981+0000 7f3c16ffd640 1 -- 172.21.15.123:0/644563596 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c10003830 con 0x7f3c000051c0 2024-09-15T23:23:06.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.981+0000 7f3c2059f640 1 -- 172.21.15.123:0/644563596 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c1814c610 con 0x7f3c000051c0 2024-09-15T23:23:06.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.982+0000 7f3c2059f640 1 -- 172.21.15.123:0/644563596 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c1815cad0 con 0x7f3c000051c0 2024-09-15T23:23:06.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.982+0000 7f3c16ffd640 1 -- 172.21.15.123:0/644563596 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3c100039d0 con 0x7f3c000051c0 2024-09-15T23:23:06.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.983+0000 7f3c16ffd640 1 --2- 172.21.15.123:0/644563596 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3c0406c2e0 0x7f3c0406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:06.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.983+0000 7f3c16ffd640 1 -- 172.21.15.123:0/644563596 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 4857+0+0 (secure 0 0 0) 0x7f3c1008ae90 con 0x7f3c000051c0 2024-09-15T23:23:06.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.983+0000 7f3c1db3a640 1 --2- 172.21.15.123:0/644563596 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3c0406c2e0 0x7f3c0406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:06.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.983+0000 7f3c1db3a640 1 --2- 172.21.15.123:0/644563596 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3c0406c2e0 0x7f3c0406e7a0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f3c180b7840 tx=0x7f3c0c009320 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:06.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:06.987+0000 7f3c16ffd640 1 -- 172.21.15.123:0/644563596 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3c10059950 con 0x7f3c000051c0 2024-09-15T23:23:07.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.212+0000 7f3c2059f640 1 -- 172.21.15.123:0/644563596 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f3c180718a0 con 0x7f3c000051c0 2024-09-15T23:23:07.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.212+0000 7f3c16ffd640 1 -- 172.21.15.123:0/644563596 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) ==== 80+0+5304 (secure 0 0 0) 0x7f3c10059250 con 0x7f3c000051c0 2024-09-15T23:23:07.213 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:23:07.214 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:23:07.214 INFO:teuthology.orchestra.run.smithi123.stdout: "auth_dump": [ 2024-09-15T23:23:07.214 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:23:07.214 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.a", 2024-09-15T23:23:07.214 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm9ATVDhAAnukyZogTuG4YCbzRXSCkiQ==", 2024-09-15T23:23:07.214 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:23:07.214 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:23:07.214 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:23:07.214 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:23:07.214 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:23:07.214 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:23:07.214 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:23:07.214 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:23:07.215 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.b", 2024-09-15T23:23:07.215 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm4KmaGhAAbf6vcffqiJTOYXK5DCXcZA==", 2024-09-15T23:23:07.215 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:23:07.215 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:23:07.215 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:23:07.215 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:23:07.215 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:23:07.215 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:23:07.215 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:23:07.215 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:23:07.216 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.c", 2024-09-15T23:23:07.216 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmua/VFRAAwbPm2TslrfQkrvHiO8oeLg==", 2024-09-15T23:23:07.216 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:23:07.216 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:23:07.216 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:23:07.216 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:23:07.216 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:23:07.216 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:23:07.216 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:23:07.216 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:23:07.216 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.d", 2024-09-15T23:23:07.216 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmzw3eIRAAaE+5y9USwp+xM3MTAndn7Q==", 2024-09-15T23:23:07.216 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:23:07.216 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:23:07.217 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:23:07.217 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:23:07.217 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:23:07.217 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:23:07.217 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:23:07.217 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:23:07.217 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.0", 2024-09-15T23:23:07.217 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCRaedmFrHGAxAAy/jTkothESNn2DC9xcHDAQ==", 2024-09-15T23:23:07.217 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:23:07.217 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:23:07.217 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:23:07.217 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:23:07.217 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:23:07.218 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:23:07.218 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:23:07.218 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.1", 2024-09-15T23:23:07.218 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCUaedm6vZlIxAAdsnLqFSng6SRpCT6UZKGsw==", 2024-09-15T23:23:07.218 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:23:07.218 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:23:07.218 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:23:07.218 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:23:07.218 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:23:07.218 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:23:07.218 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:23:07.218 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.2", 2024-09-15T23:23:07.218 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCYaedmXgVwFRAA1mOzzRafhKMsU7kTAT6TqA==", 2024-09-15T23:23:07.218 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:23:07.219 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:23:07.219 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:23:07.219 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:23:07.219 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:23:07.219 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:23:07.219 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:23:07.219 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.3", 2024-09-15T23:23:07.219 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCcaedm+APAFhAAb8blNFzswwHriSmCrMuA0A==", 2024-09-15T23:23:07.219 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:23:07.219 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:23:07.219 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:23:07.219 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:23:07.219 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:23:07.219 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:23:07.220 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:23:07.220 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.4", 2024-09-15T23:23:07.220 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCjaedmReUmABAAXpxsK7osxn/ZelVXKiCLOw==", 2024-09-15T23:23:07.220 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:23:07.220 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:23:07.220 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:23:07.220 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:23:07.220 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:23:07.220 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:23:07.220 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:23:07.220 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.5", 2024-09-15T23:23:07.220 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCnaedmtbdmARAAdxguBdtwBmtiaIx/y992GA==", 2024-09-15T23:23:07.220 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:23:07.220 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:23:07.221 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:23:07.221 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:23:07.221 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:23:07.221 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:23:07.221 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:23:07.221 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.6", 2024-09-15T23:23:07.221 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCraedmkR+NAxAAd2GAAH0BgOMonU8iTSn+Fw==", 2024-09-15T23:23:07.221 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:23:07.221 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:23:07.221 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:23:07.221 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:23:07.221 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:23:07.221 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:23:07.221 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:23:07.222 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.7", 2024-09-15T23:23:07.222 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCvaedmAaCwBBAAdpDtCbXchArmy019wiOdSQ==", 2024-09-15T23:23:07.222 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:23:07.222 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:23:07.222 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:23:07.222 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:23:07.222 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:23:07.222 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:23:07.222 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:23:07.223 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.0", 2024-09-15T23:23:07.223 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmzQPqJRAAhUf1dnVYohN4obCfeu8+7g==", 2024-09-15T23:23:07.223 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:23:07.223 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:23:07.223 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow r", 2024-09-15T23:23:07.224 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-15T23:23:07.224 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:23:07.224 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:23:07.224 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:23:07.224 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.1", 2024-09-15T23:23:07.224 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmdKK0LhAAXXmUkxVwMEjRTRXUh9CL/g==", 2024-09-15T23:23:07.224 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:23:07.224 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:23:07.224 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:23:07.224 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:23:07.224 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:23:07.224 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:23:07.224 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:23:07.225 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:23:07.225 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.2", 2024-09-15T23:23:07.225 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmRz55KxAARi7B4WYOY1QqH1CK81z9pA==", 2024-09-15T23:23:07.225 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:23:07.225 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:23:07.225 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:23:07.225 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:23:07.225 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:23:07.225 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:23:07.225 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:23:07.225 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:23:07.225 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.3", 2024-09-15T23:23:07.225 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmbWo8NBAAR1qGX1bs35ojx6lMxftcfg==", 2024-09-15T23:23:07.226 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:23:07.226 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:23:07.226 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:23:07.226 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:23:07.226 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:23:07.226 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:23:07.226 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:23:07.226 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:23:07.226 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.admin", 2024-09-15T23:23:07.226 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCMaedmVUW0LhAAqgPFk1HtxsZXcIStNN43pA==", 2024-09-15T23:23:07.226 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:23:07.226 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:23:07.226 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:23:07.227 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:23:07.227 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:23:07.227 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:23:07.227 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:23:07.227 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:23:07.227 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.x", 2024-09-15T23:23:07.227 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmGPSBCxAAHAhXQERogdAOm0ZPNtlxpw==", 2024-09-15T23:23:07.227 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:23:07.227 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:23:07.227 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-15T23:23:07.227 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:23:07.227 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:23:07.228 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:23:07.228 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:23:07.228 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.y", 2024-09-15T23:23:07.228 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm5Om4BxAA/7ZtMMlbUA3bvMCfaNMQyg==", 2024-09-15T23:23:07.228 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:23:07.228 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:23:07.228 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-15T23:23:07.228 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:23:07.228 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:23:07.229 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:23:07.229 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-15T23:23:07.229 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:23:07.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.214+0000 7f3c2059f640 1 -- 172.21.15.123:0/644563596 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3c0406c2e0 msgr2=0x7f3c0406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:07.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.214+0000 7f3c2059f640 1 --2- 172.21.15.123:0/644563596 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3c0406c2e0 0x7f3c0406e7a0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f3c180b7840 tx=0x7f3c0c009320 comp rx=0 tx=0).stop 2024-09-15T23:23:07.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.214+0000 7f3c2059f640 1 -- 172.21.15.123:0/644563596 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c000051c0 msgr2=0x7f3c181f18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:07.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.214+0000 7f3c2059f640 1 --2- 172.21.15.123:0/644563596 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c000051c0 0x7f3c181f18d0 secure :-1 s=READY pgs=2206 cs=0 l=1 rev1=1 crypto rx=0x7f3c1000f620 tx=0x7f3c1000fae0 comp rx=0 tx=0).stop 2024-09-15T23:23:07.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.214+0000 7f3c2059f640 1 -- 172.21.15.123:0/644563596 shutdown_connections 2024-09-15T23:23:07.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.214+0000 7f3c2059f640 1 --2- 172.21.15.123:0/644563596 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3c1814b440 0x7f3c1814b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:07.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.214+0000 7f3c2059f640 1 --2- 172.21.15.123:0/644563596 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3c18152af0 0x7f3c18152f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:07.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.214+0000 7f3c2059f640 1 --2- 172.21.15.123:0/644563596 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3c0406c2e0 0x7f3c0406e7a0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:07.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.214+0000 7f3c2059f640 1 --2- 172.21.15.123:0/644563596 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c000051c0 0x7f3c181f18d0 unknown :-1 s=CLOSED pgs=2206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:07.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.214+0000 7f3c2059f640 1 -- 172.21.15.123:0/644563596 >> 172.21.15.123:0/644563596 conn(0x7f3c18067fb0 msgr2=0x7f3c180b2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:07.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.214+0000 7f3c2059f640 1 -- 172.21.15.123:0/644563596 shutdown_connections 2024-09-15T23:23:07.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.214+0000 7f3c2059f640 1 -- 172.21.15.123:0/644563596 wait complete. 2024-09-15T23:23:07.232 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T23:23:07.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.329+0000 7f41a7d98640 1 Processor -- start 2024-09-15T23:23:07.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.329+0000 7f41a7d98640 1 -- start start 2024-09-15T23:23:07.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.330+0000 7f41a7d98640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f41a006bc10 0x7f41a006bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:07.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.330+0000 7f41a7d98640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f41a00cef60 0x7f41a015eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:07.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.330+0000 7f41a7d98640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41a006c530 con 0x7f41a00b3790 2024-09-15T23:23:07.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.330+0000 7f41a7d98640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f41a00cd690 con 0x7f41a00cef60 2024-09-15T23:23:07.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.330+0000 7f41a7d98640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f41a00d06f0 con 0x7f41a006bc10 2024-09-15T23:23:07.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.330+0000 7f41a6335640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f41a00b3790 0x7f41a00b67a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:34792/0 (socket says 172.21.15.123:34792) 2024-09-15T23:23:07.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.330+0000 7f41a6335640 1 -- 172.21.15.123:0/561758282 learned_addr learned my addr 172.21.15.123:0/561758282 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:23:07.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.331+0000 7f41a5333640 1 --2- 172.21.15.123:0/561758282 >> v2:172.21.15.188:3300/0 conn(0x7f41a00cef60 0x7f41a015eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:07.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.331+0000 7f41a5b34640 1 --2- 172.21.15.123:0/561758282 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f41a006bc10 0x7f41a006bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:07.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.331+0000 7f41a4b32640 1 -- 172.21.15.123:0/561758282 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1927687759 0 0) 0x7f41a006c530 con 0x7f41a00b3790 2024-09-15T23:23:07.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.331+0000 7f41a4b32640 1 -- 172.21.15.123:0/561758282 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4188003520 con 0x7f41a00b3790 2024-09-15T23:23:07.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.331+0000 7f41a4b32640 1 -- 172.21.15.123:0/561758282 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1179559217 0 0) 0x7f4188003520 con 0x7f41a00b3790 2024-09-15T23:23:07.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.331+0000 7f41a4b32640 1 -- 172.21.15.123:0/561758282 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f41a006bc10 msgr2=0x7f41a006bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:07.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.331+0000 7f41a4b32640 1 --2- 172.21.15.123:0/561758282 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f41a006bc10 0x7f41a006bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:07.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.331+0000 7f41a4b32640 1 -- 172.21.15.123:0/561758282 >> v2:172.21.15.188:3300/0 conn(0x7f41a00cef60 msgr2=0x7f41a015eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:07.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.331+0000 7f41a4b32640 1 --2- 172.21.15.123:0/561758282 >> v2:172.21.15.188:3300/0 conn(0x7f41a00cef60 0x7f41a015eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:07.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.331+0000 7f41a4b32640 1 -- 172.21.15.123:0/561758282 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a015f060 con 0x7f41a00b3790 2024-09-15T23:23:07.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.331+0000 7f41a4b32640 1 -- 172.21.15.123:0/561758282 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f4198001670 con 0x7f41a00b3790 2024-09-15T23:23:07.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.331+0000 7f41a4b32640 1 -- 172.21.15.123:0/561758282 >> v1:172.21.15.123:6789/0 conn(0x7f41a00b3790 legacy=0x7f41a00b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:07.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.331+0000 7f41a4b32640 1 --2- 172.21.15.123:0/561758282 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41880039e0 0x7f4188003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:07.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.331+0000 7f41a4b32640 1 --2- 172.21.15.123:0/561758282 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4188004800 0x7f4188004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:07.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.331+0000 7f41a4b32640 1 --2- 172.21.15.123:0/561758282 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f41a006bc10 0x7f41880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:07.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.331+0000 7f41a4b32640 1 -- 172.21.15.123:0/561758282 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f41a00cd690 con 0x7f41880039e0 2024-09-15T23:23:07.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.331+0000 7f41a4b32640 1 -- 172.21.15.123:0/561758282 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f41a00d06f0 con 0x7f4188004800 2024-09-15T23:23:07.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.331+0000 7f41a4b32640 1 -- 172.21.15.123:0/561758282 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f418800b9f0 con 0x7f41a006bc10 2024-09-15T23:23:07.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.331+0000 7f41a5b34640 1 --2- 172.21.15.123:0/561758282 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41880039e0 0x7f4188003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:07.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.331+0000 7f41a6335640 1 --2- 172.21.15.123:0/561758282 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f41a006bc10 0x7f41880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:07.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.331+0000 7f41a5333640 1 --2- 172.21.15.123:0/561758282 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4188004800 0x7f4188004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:07.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.331+0000 7f41a5b34640 1 -- 172.21.15.123:0/561758282 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f41a006bc10 msgr2=0x7f41880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:07.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.331+0000 7f41a5b34640 1 --2- 172.21.15.123:0/561758282 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f41a006bc10 0x7f41880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:07.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.331+0000 7f41a5b34640 1 -- 172.21.15.123:0/561758282 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4188004800 msgr2=0x7f4188004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:07.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.331+0000 7f41a5b34640 1 --2- 172.21.15.123:0/561758282 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4188004800 0x7f4188004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:07.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.331+0000 7f41a5b34640 1 -- 172.21.15.123:0/561758282 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4188003520 con 0x7f41880039e0 2024-09-15T23:23:07.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.332+0000 7f41a5b34640 1 --2- 172.21.15.123:0/561758282 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41880039e0 0x7f4188003e00 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7f4190009fc0 tx=0x7f4188005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b26f3b307f73b1bd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:07.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.332+0000 7f41a4b32640 1 -- 172.21.15.123:0/561758282 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4190009c10 con 0x7f41880039e0 2024-09-15T23:23:07.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.332+0000 7f41a4b32640 1 -- 172.21.15.123:0/561758282 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4190036070 con 0x7f41880039e0 2024-09-15T23:23:07.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.332+0000 7f41a4b32640 1 -- 172.21.15.123:0/561758282 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4190031670 con 0x7f41880039e0 2024-09-15T23:23:07.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.333+0000 7f41a7d98640 1 -- 172.21.15.123:0/561758282 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41880039e0 msgr2=0x7f4188003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:07.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.333+0000 7f41a7d98640 1 --2- 172.21.15.123:0/561758282 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41880039e0 0x7f4188003e00 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7f4190009fc0 tx=0x7f4188005830 comp rx=0 tx=0).stop 2024-09-15T23:23:07.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.333+0000 7f41a6335640 1 -- 172.21.15.123:0/561758282 reap_dead start 2024-09-15T23:23:07.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.333+0000 7f41a7d98640 1 -- 172.21.15.123:0/561758282 shutdown_connections 2024-09-15T23:23:07.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.333+0000 7f41a7d98640 1 -- 172.21.15.123:0/561758282 >> 172.21.15.123:0/561758282 conn(0x7f41a006cd20 msgr2=0x7f41a006d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:07.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.333+0000 7f41a7d98640 1 -- 172.21.15.123:0/561758282 shutdown_connections 2024-09-15T23:23:07.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.333+0000 7f41a7d98640 1 -- 172.21.15.123:0/561758282 wait complete. 2024-09-15T23:23:07.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.334+0000 7f41a7d98640 1 Processor -- start 2024-09-15T23:23:07.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.334+0000 7f41a7d98640 1 -- start start 2024-09-15T23:23:07.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.335+0000 7f41a7d98640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f41880039e0 0x7f41a015a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:07.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.335+0000 7f41a7d98640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f41a0156fa0 0x7f41a01567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:07.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.335+0000 7f41a7d98640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41a0159a70 0x7f41a00b4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:07.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.335+0000 7f41a7d98640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f41a00d0c30 con 0x7f41a0159a70 2024-09-15T23:23:07.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.335+0000 7f41a7d98640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f41a00d0950 con 0x7f41a0156fa0 2024-09-15T23:23:07.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.335+0000 7f41a7d98640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f41a00d0f10 con 0x7f41880039e0 2024-09-15T23:23:07.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.335+0000 7f41a6335640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41a0159a70 0x7f41a00b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:07.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.335+0000 7f41a6335640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41a0159a70 0x7f41a00b4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44806/0 (socket says 172.21.15.123:44806) 2024-09-15T23:23:07.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.335+0000 7f41a6335640 1 -- 172.21.15.123:0/188686134 learned_addr learned my addr 172.21.15.123:0/188686134 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:07.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.335+0000 7f41a5333640 1 --2- 172.21.15.123:0/188686134 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f41a0156fa0 0x7f41a01567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:07.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.335+0000 7f41a5b34640 1 --2- 172.21.15.123:0/188686134 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f41880039e0 0x7f41a015a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:07.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.335+0000 7f41a6335640 1 -- 172.21.15.123:0/188686134 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f41880039e0 msgr2=0x7f41a015a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:07.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.335+0000 7f41a6335640 1 --2- 172.21.15.123:0/188686134 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f41880039e0 0x7f41a015a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:07.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.335+0000 7f41a6335640 1 -- 172.21.15.123:0/188686134 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f41a0156fa0 msgr2=0x7f41a01567d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:07.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.335+0000 7f41a6335640 1 --2- 172.21.15.123:0/188686134 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f41a0156fa0 0x7f41a01567d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:07.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.335+0000 7f41a6335640 1 -- 172.21.15.123:0/188686134 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a0156d10 con 0x7f41a0159a70 2024-09-15T23:23:07.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.335+0000 7f41a5b34640 1 --2- 172.21.15.123:0/188686134 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f41880039e0 0x7f41a015a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:23:07.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.335+0000 7f41a6335640 1 --2- 172.21.15.123:0/188686134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41a0159a70 0x7f41a00b4790 secure :-1 s=READY pgs=2209 cs=0 l=1 rev1=1 crypto rx=0x7f4198001cd0 tx=0x7f419800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:07.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.335+0000 7f419e7fc640 1 -- 172.21.15.123:0/188686134 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419800c5b0 con 0x7f41a0159a70 2024-09-15T23:23:07.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.335+0000 7f419e7fc640 1 -- 172.21.15.123:0/188686134 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4198018070 con 0x7f41a0159a70 2024-09-15T23:23:07.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.335+0000 7f41a7d98640 1 -- 172.21.15.123:0/188686134 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41a01589d0 con 0x7f41a0159a70 2024-09-15T23:23:07.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.335+0000 7f419e7fc640 1 -- 172.21.15.123:0/188686134 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419800c9b0 con 0x7f41a0159a70 2024-09-15T23:23:07.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.335+0000 7f41a7d98640 1 -- 172.21.15.123:0/188686134 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41a0158f90 con 0x7f41a0159a70 2024-09-15T23:23:07.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.336+0000 7f41a7d98640 1 -- 172.21.15.123:0/188686134 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41a00b3c40 con 0x7f41a0159a70 2024-09-15T23:23:07.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.337+0000 7f419e7fc640 1 -- 172.21.15.123:0/188686134 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f419800cb50 con 0x7f41a0159a70 2024-09-15T23:23:07.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.337+0000 7f419e7fc640 1 --2- 172.21.15.123:0/188686134 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f418c06c2b0 0x7f418c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:07.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.338+0000 7f419e7fc640 1 -- 172.21.15.123:0/188686134 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 4857+0+0 (secure 0 0 0) 0x7f419808ab30 con 0x7f41a0159a70 2024-09-15T23:23:07.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.338+0000 7f41a5b34640 1 --2- 172.21.15.123:0/188686134 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f418c06c2b0 0x7f418c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:07.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.338+0000 7f41a5b34640 1 --2- 172.21.15.123:0/188686134 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f418c06c2b0 0x7f418c06e770 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f4190035000 tx=0x7f419002f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:07.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.342+0000 7f419e7fc640 1 -- 172.21.15.123:0/188686134 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f41980595f0 con 0x7f41a0159a70 2024-09-15T23:23:07.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.510+0000 7f41a7d98640 1 -- 172.21.15.123:0/188686134 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f41a0072f20 con 0x7f41a0159a70 2024-09-15T23:23:07.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.510+0000 7f419e7fc640 1 -- 172.21.15.123:0/188686134 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v190) ==== 84+0+65 (secure 0 0 0) 0x7f4198058ef0 con 0x7f41a0159a70 2024-09-15T23:23:07.512 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:23:07.512 INFO:teuthology.orchestra.run.smithi123.stdout:[ 2024-09-15T23:23:07.512 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:23:07.512 INFO:teuthology.orchestra.run.smithi123.stdout: "poolnum": 1, 2024-09-15T23:23:07.512 INFO:teuthology.orchestra.run.smithi123.stdout: "poolname": ".mgr" 2024-09-15T23:23:07.512 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:23:07.513 INFO:teuthology.orchestra.run.smithi123.stdout:] 2024-09-15T23:23:07.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.512+0000 7f41a7d98640 1 -- 172.21.15.123:0/188686134 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f418c06c2b0 msgr2=0x7f418c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:07.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.512+0000 7f41a7d98640 1 --2- 172.21.15.123:0/188686134 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f418c06c2b0 0x7f418c06e770 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f4190035000 tx=0x7f419002f000 comp rx=0 tx=0).stop 2024-09-15T23:23:07.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.512+0000 7f41a7d98640 1 -- 172.21.15.123:0/188686134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41a0159a70 msgr2=0x7f41a00b4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:07.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.512+0000 7f41a7d98640 1 --2- 172.21.15.123:0/188686134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41a0159a70 0x7f41a00b4790 secure :-1 s=READY pgs=2209 cs=0 l=1 rev1=1 crypto rx=0x7f4198001cd0 tx=0x7f419800eb90 comp rx=0 tx=0).stop 2024-09-15T23:23:07.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.512+0000 7f41a7d98640 1 -- 172.21.15.123:0/188686134 shutdown_connections 2024-09-15T23:23:07.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.512+0000 7f41a7d98640 1 --2- 172.21.15.123:0/188686134 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f418c06c2b0 0x7f418c06e770 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:07.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.512+0000 7f41a7d98640 1 --2- 172.21.15.123:0/188686134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41a0159a70 0x7f41a00b4790 unknown :-1 s=CLOSED pgs=2209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:07.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.512+0000 7f41a7d98640 1 --2- 172.21.15.123:0/188686134 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f41a0156fa0 0x7f41a01567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:07.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.512+0000 7f41a7d98640 1 --2- 172.21.15.123:0/188686134 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f41880039e0 0x7f41a015a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:07.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.512+0000 7f41a7d98640 1 -- 172.21.15.123:0/188686134 >> 172.21.15.123:0/188686134 conn(0x7f41a006cd20 msgr2=0x7f41a015d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:07.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.512+0000 7f41a7d98640 1 -- 172.21.15.123:0/188686134 shutdown_connections 2024-09-15T23:23:07.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.512+0000 7f41a7d98640 1 -- 172.21.15.123:0/188686134 wait complete. 2024-09-15T23:23:07.524 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T23:23:07.525 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T23:23:07.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.627+0000 7f1635d6d640 1 Processor -- start 2024-09-15T23:23:07.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.627+0000 7f1635d6d640 1 -- start start 2024-09-15T23:23:07.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.627+0000 7f1635d6d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f163015ea90 0x7f16300d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:07.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.627+0000 7f1635d6d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16300d16e0 0x7f16300b7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:07.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.627+0000 7f1635d6d640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16300cf060 con 0x7f16300d40b0 2024-09-15T23:23:07.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.627+0000 7f1635d6d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f16300d34c0 con 0x7f163015ea90 2024-09-15T23:23:07.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.627+0000 7f1635d6d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f16300cf340 con 0x7f16300d16e0 2024-09-15T23:23:07.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.628+0000 7f162f7fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f163015ea90 0x7f16300d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:07.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.628+0000 7f162ffff640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16300d16e0 0x7f16300b7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:07.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.628+0000 7f162effd640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f16300d40b0 0x7f16300d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:43688/0 (socket says 172.21.15.123:43688) 2024-09-15T23:23:07.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.628+0000 7f162f7fe640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f163015ea90 0x7f16300d2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:42566/0 (socket says 172.21.15.123:42566) 2024-09-15T23:23:07.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.628+0000 7f162effd640 1 -- 172.21.15.123:0/3948288543 learned_addr learned my addr 172.21.15.123:0/3948288543 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:23:07.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.628+0000 7f162f7fe640 1 -- 172.21.15.123:0/3948288543 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16300d16e0 msgr2=0x7f16300b7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:07.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.628+0000 7f162f7fe640 1 --2- 172.21.15.123:0/3948288543 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16300d16e0 0x7f16300b7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:07.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.628+0000 7f162f7fe640 1 -- 172.21.15.123:0/3948288543 >> v1:172.21.15.188:6789/0 conn(0x7f16300d40b0 legacy=0x7f16300d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:07.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.628+0000 7f162f7fe640 1 -- 172.21.15.123:0/3948288543 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16300cf620 con 0x7f163015ea90 2024-09-15T23:23:07.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.629+0000 7f162f7fe640 1 --2- 172.21.15.123:0/3948288543 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f163015ea90 0x7f16300d2f80 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f16200097a0 tx=0x7f162002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fea8c12df7cf83 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:07.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.629+0000 7f162e7fc640 1 -- 172.21.15.123:0/3948288543 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1620037070 con 0x7f163015ea90 2024-09-15T23:23:07.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.629+0000 7f162e7fc640 1 -- 172.21.15.123:0/3948288543 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1620032440 con 0x7f163015ea90 2024-09-15T23:23:07.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.629+0000 7f162e7fc640 1 -- 172.21.15.123:0/3948288543 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1620032810 con 0x7f163015ea90 2024-09-15T23:23:07.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.630+0000 7f1635d6d640 1 -- 172.21.15.123:0/3948288543 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f163015ea90 msgr2=0x7f16300d2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:07.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.630+0000 7f1635d6d640 1 --2- 172.21.15.123:0/3948288543 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f163015ea90 0x7f16300d2f80 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f16200097a0 tx=0x7f162002a180 comp rx=0 tx=0).stop 2024-09-15T23:23:07.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.630+0000 7f1635d6d640 1 -- 172.21.15.123:0/3948288543 shutdown_connections 2024-09-15T23:23:07.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.630+0000 7f1635d6d640 1 --2- 172.21.15.123:0/3948288543 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16300d16e0 0x7f16300b7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:07.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.630+0000 7f1635d6d640 1 --2- 172.21.15.123:0/3948288543 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f163015ea90 0x7f16300d2f80 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:07.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.630+0000 7f1635d6d640 1 -- 172.21.15.123:0/3948288543 >> 172.21.15.123:0/3948288543 conn(0x7f163006c0e0 msgr2=0x7f163006c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:07.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.630+0000 7f1635d6d640 1 -- 172.21.15.123:0/3948288543 shutdown_connections 2024-09-15T23:23:07.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.630+0000 7f1635d6d640 1 -- 172.21.15.123:0/3948288543 wait complete. 2024-09-15T23:23:07.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.631+0000 7f1635d6d640 1 Processor -- start 2024-09-15T23:23:07.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.631+0000 7f1635d6d640 1 -- start start 2024-09-15T23:23:07.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.632+0000 7f1635d6d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16300d16e0 0x7f16301550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:07.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.632+0000 7f1635d6d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16300d40b0 0x7f163015eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:07.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.632+0000 7f1635d6d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f163015ea90 0x7f163015f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:07.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.632+0000 7f1635d6d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f163015ee70 con 0x7f16300d16e0 2024-09-15T23:23:07.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.632+0000 7f1635d6d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f16300cfbe0 con 0x7f16300d40b0 2024-09-15T23:23:07.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.632+0000 7f1635d6d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f16300b8000 con 0x7f163015ea90 2024-09-15T23:23:07.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.632+0000 7f162f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16300d16e0 0x7f16301550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:07.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.632+0000 7f162f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16300d16e0 0x7f16301550d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44814/0 (socket says 172.21.15.123:44814) 2024-09-15T23:23:07.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.632+0000 7f162f7fe640 1 -- 172.21.15.123:0/1256727708 learned_addr learned my addr 172.21.15.123:0/1256727708 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:07.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.632+0000 7f162effd640 1 --2- 172.21.15.123:0/1256727708 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16300d40b0 0x7f163015eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:07.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.632+0000 7f162ffff640 1 --2- 172.21.15.123:0/1256727708 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f163015ea90 0x7f163015f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:07.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.632+0000 7f162f7fe640 1 -- 172.21.15.123:0/1256727708 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f163015ea90 msgr2=0x7f163015f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:07.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.632+0000 7f162f7fe640 1 --2- 172.21.15.123:0/1256727708 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f163015ea90 0x7f163015f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:07.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.632+0000 7f162f7fe640 1 -- 172.21.15.123:0/1256727708 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16300d40b0 msgr2=0x7f163015eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:07.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.632+0000 7f162f7fe640 1 --2- 172.21.15.123:0/1256727708 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16300d40b0 0x7f163015eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:07.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.632+0000 7f162f7fe640 1 -- 172.21.15.123:0/1256727708 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16300ccfa0 con 0x7f16300d16e0 2024-09-15T23:23:07.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.632+0000 7f162f7fe640 1 --2- 172.21.15.123:0/1256727708 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16300d16e0 0x7f16301550d0 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7f1620035040 tx=0x7f16200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:07.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.633+0000 7f1617fff640 1 -- 172.21.15.123:0/1256727708 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1620037040 con 0x7f16300d16e0 2024-09-15T23:23:07.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.633+0000 7f1617fff640 1 -- 172.21.15.123:0/1256727708 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1620030500 con 0x7f16300d16e0 2024-09-15T23:23:07.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.633+0000 7f1617fff640 1 -- 172.21.15.123:0/1256727708 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1620030910 con 0x7f16300d16e0 2024-09-15T23:23:07.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.633+0000 7f1635d6d640 1 -- 172.21.15.123:0/1256727708 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16300cd280 con 0x7f16300d16e0 2024-09-15T23:23:07.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.633+0000 7f1635d6d640 1 -- 172.21.15.123:0/1256727708 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16300cd840 con 0x7f16300d16e0 2024-09-15T23:23:07.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.634+0000 7f1635d6d640 1 -- 172.21.15.123:0/1256727708 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16300b7ac0 con 0x7f16300d16e0 2024-09-15T23:23:07.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.634+0000 7f1617fff640 1 -- 172.21.15.123:0/1256727708 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1620044020 con 0x7f16300d16e0 2024-09-15T23:23:07.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.635+0000 7f1617fff640 1 --2- 172.21.15.123:0/1256727708 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f161c06c2e0 0x7f161c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:07.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.635+0000 7f1617fff640 1 -- 172.21.15.123:0/1256727708 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(190..190 src has 1..190) ==== 4857+0+0 (secure 0 0 0) 0x7f16200ab150 con 0x7f16300d16e0 2024-09-15T23:23:07.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.635+0000 7f162effd640 1 --2- 172.21.15.123:0/1256727708 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f161c06c2e0 0x7f161c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:07.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.635+0000 7f162effd640 1 --2- 172.21.15.123:0/1256727708 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f161c06c2e0 0x7f161c06e7a0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f16300cb0f0 tx=0x7f1624007e80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:07.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.639+0000 7f1617fff640 1 -- 172.21.15.123:0/1256727708 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1620079650 con 0x7f16300d16e0 2024-09-15T23:23:07.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.808+0000 7f1635d6d640 1 -- 172.21.15.123:0/1256727708 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f1630156090 con 0x7f16300d16e0 2024-09-15T23:23:07.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.860+0000 7f1617fff640 1 -- 172.21.15.123:0/1256727708 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v191) ==== 138+0+0 (secure 0 0 0) 0x7f162007d950 con 0x7f16300d16e0 2024-09-15T23:23:07.861 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' created 2024-09-15T23:23:07.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.862+0000 7f1635d6d640 1 -- 172.21.15.123:0/1256727708 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f161c06c2e0 msgr2=0x7f161c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:07.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.862+0000 7f1635d6d640 1 --2- 172.21.15.123:0/1256727708 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f161c06c2e0 0x7f161c06e7a0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f16300cb0f0 tx=0x7f1624007e80 comp rx=0 tx=0).stop 2024-09-15T23:23:07.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.862+0000 7f1635d6d640 1 -- 172.21.15.123:0/1256727708 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16300d16e0 msgr2=0x7f16301550d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:07.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.862+0000 7f1635d6d640 1 --2- 172.21.15.123:0/1256727708 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16300d16e0 0x7f16301550d0 secure :-1 s=READY pgs=2210 cs=0 l=1 rev1=1 crypto rx=0x7f1620035040 tx=0x7f16200046c0 comp rx=0 tx=0).stop 2024-09-15T23:23:07.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.862+0000 7f1635d6d640 1 -- 172.21.15.123:0/1256727708 shutdown_connections 2024-09-15T23:23:07.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.862+0000 7f1635d6d640 1 --2- 172.21.15.123:0/1256727708 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f163015ea90 0x7f163015f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:07.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.862+0000 7f1635d6d640 1 --2- 172.21.15.123:0/1256727708 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16300d40b0 0x7f163015eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:07.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.862+0000 7f1635d6d640 1 --2- 172.21.15.123:0/1256727708 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f161c06c2e0 0x7f161c06e7a0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:07.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.862+0000 7f1635d6d640 1 --2- 172.21.15.123:0/1256727708 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16300d16e0 0x7f16301550d0 unknown :-1 s=CLOSED pgs=2210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:07.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.862+0000 7f1635d6d640 1 -- 172.21.15.123:0/1256727708 >> 172.21.15.123:0/1256727708 conn(0x7f163006c0e0 msgr2=0x7f163006c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:07.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.862+0000 7f1635d6d640 1 -- 172.21.15.123:0/1256727708 shutdown_connections 2024-09-15T23:23:07.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.862+0000 7f1635d6d640 1 -- 172.21.15.123:0/1256727708 wait complete. 2024-09-15T23:23:07.878 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T23:23:07.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.983+0000 7f838fb86640 1 Processor -- start 2024-09-15T23:23:07.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.983+0000 7f838fb86640 1 -- start start 2024-09-15T23:23:07.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.984+0000 7f838fb86640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f83880b6e00 0x7f83880d3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:07.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.984+0000 7f838fb86640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8388162d90 0x7f83880b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:07.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.984+0000 7f838fb86640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8388071160 0x7f838806cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:07.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.984+0000 7f838fb86640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f838806e7f0 con 0x7f8388162d90 2024-09-15T23:23:07.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.984+0000 7f838fb86640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f83881631d0 con 0x7f83880b6e00 2024-09-15T23:23:07.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.984+0000 7f838fb86640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f838815ec10 con 0x7f8388071160 2024-09-15T23:23:07.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.984+0000 7f838d121640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8388162d90 0x7f83880b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:07.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.984+0000 7f838d121640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8388162d90 0x7f83880b71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44830/0 (socket says 172.21.15.123:44830) 2024-09-15T23:23:07.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.984+0000 7f838d121640 1 -- 172.21.15.123:0/211165028 learned_addr learned my addr 172.21.15.123:0/211165028 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:07.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.985+0000 7f838d922640 1 --2- 172.21.15.123:0/211165028 >> v2:172.21.15.188:3300/0 conn(0x7f83880b6e00 0x7f83880d3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:07.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.985+0000 7f838e123640 1 --2- 172.21.15.123:0/211165028 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8388071160 0x7f838806cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:07.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.985+0000 7f838d121640 1 -- 172.21.15.123:0/211165028 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8388071160 msgr2=0x7f838806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:07.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.985+0000 7f838d121640 1 --2- 172.21.15.123:0/211165028 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8388071160 0x7f838806cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:07.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.985+0000 7f838d121640 1 -- 172.21.15.123:0/211165028 >> v2:172.21.15.188:3300/0 conn(0x7f83880b6e00 msgr2=0x7f83880d3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:07.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.985+0000 7f838d121640 1 --2- 172.21.15.123:0/211165028 >> v2:172.21.15.188:3300/0 conn(0x7f83880b6e00 0x7f83880d3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:07.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.985+0000 7f838d121640 1 -- 172.21.15.123:0/211165028 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f838806ed20 con 0x7f8388162d90 2024-09-15T23:23:07.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.985+0000 7f838d121640 1 --2- 172.21.15.123:0/211165028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8388162d90 0x7f83880b71e0 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7f838806a210 tx=0x7f837802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3617297c7ced6e45 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:07.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.986+0000 7f838c920640 1 -- 172.21.15.123:0/211165028 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8378037070 con 0x7f8388162d90 2024-09-15T23:23:07.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.986+0000 7f838c920640 1 -- 172.21.15.123:0/211165028 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f837802ae00 con 0x7f8388162d90 2024-09-15T23:23:07.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.986+0000 7f838c920640 1 -- 172.21.15.123:0/211165028 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8378032660 con 0x7f8388162d90 2024-09-15T23:23:07.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.986+0000 7f838fb86640 1 -- 172.21.15.123:0/211165028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8388162d90 msgr2=0x7f83880b71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:07.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.986+0000 7f838fb86640 1 --2- 172.21.15.123:0/211165028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8388162d90 0x7f83880b71e0 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7f838806a210 tx=0x7f837802a0b0 comp rx=0 tx=0).stop 2024-09-15T23:23:07.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.986+0000 7f838fb86640 1 -- 172.21.15.123:0/211165028 shutdown_connections 2024-09-15T23:23:07.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.986+0000 7f838fb86640 1 --2- 172.21.15.123:0/211165028 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8388071160 0x7f838806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:07.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.986+0000 7f838fb86640 1 --2- 172.21.15.123:0/211165028 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8388162d90 0x7f83880b71e0 unknown :-1 s=CLOSED pgs=2211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:07.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.986+0000 7f838fb86640 1 --2- 172.21.15.123:0/211165028 >> v2:172.21.15.188:3300/0 conn(0x7f83880b6e00 0x7f83880d3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:07.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.986+0000 7f838fb86640 1 -- 172.21.15.123:0/211165028 >> 172.21.15.123:0/211165028 conn(0x7f83880d2550 msgr2=0x7f83880d2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:07.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.986+0000 7f838fb86640 1 -- 172.21.15.123:0/211165028 shutdown_connections 2024-09-15T23:23:07.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.986+0000 7f838fb86640 1 -- 172.21.15.123:0/211165028 wait complete. 2024-09-15T23:23:07.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.987+0000 7f838fb86640 1 Processor -- start 2024-09-15T23:23:07.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.987+0000 7f838fb86640 1 -- start start 2024-09-15T23:23:07.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.988+0000 7f838fb86640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8388071160 0x7f838815ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:07.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.988+0000 7f838fb86640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83880b6e00 0x7f8388156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.988+0000 7f838fb86640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8388162d90 0x7f8388152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.988+0000 7f838fb86640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8388070960 con 0x7f83880b6e00 2024-09-15T23:23:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.988+0000 7f838fb86640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f838806ea40 con 0x7f8388162d90 2024-09-15T23:23:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.988+0000 7f838fb86640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8388070c40 con 0x7f8388071160 2024-09-15T23:23:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.988+0000 7f838d121640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83880b6e00 0x7f8388156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.988+0000 7f838d121640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83880b6e00 0x7f8388156a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44840/0 (socket says 172.21.15.123:44840) 2024-09-15T23:23:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.988+0000 7f838d121640 1 -- 172.21.15.123:0/992588407 learned_addr learned my addr 172.21.15.123:0/992588407 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.988+0000 7f838e123640 1 --2- 172.21.15.123:0/992588407 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8388162d90 0x7f8388152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.988+0000 7f838d922640 1 --2- 172.21.15.123:0/992588407 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8388071160 0x7f838815ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.989+0000 7f838d121640 1 -- 172.21.15.123:0/992588407 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8388071160 msgr2=0x7f838815ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.989+0000 7f838d121640 1 --2- 172.21.15.123:0/992588407 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8388071160 0x7f838815ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.989+0000 7f838d121640 1 -- 172.21.15.123:0/992588407 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8388162d90 msgr2=0x7f8388152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.989+0000 7f838d121640 1 --2- 172.21.15.123:0/992588407 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8388162d90 0x7f8388152ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:07.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.989+0000 7f838d121640 1 -- 172.21.15.123:0/992588407 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f838815fca0 con 0x7f83880b6e00 2024-09-15T23:23:07.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.989+0000 7f838d121640 1 --2- 172.21.15.123:0/992588407 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83880b6e00 0x7f8388156a80 secure :-1 s=READY pgs=2212 cs=0 l=1 rev1=1 crypto rx=0x7f8378000c00 tx=0x7f83780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:07.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.989+0000 7f837e7fc640 1 -- 172.21.15.123:0/992588407 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8378041030 con 0x7f83880b6e00 2024-09-15T23:23:07.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.989+0000 7f837e7fc640 1 -- 172.21.15.123:0/992588407 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f837802ac00 con 0x7f83880b6e00 2024-09-15T23:23:07.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.989+0000 7f838fb86640 1 -- 172.21.15.123:0/992588407 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f838815f400 con 0x7f83880b6e00 2024-09-15T23:23:07.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.989+0000 7f837e7fc640 1 -- 172.21.15.123:0/992588407 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8378037040 con 0x7f83880b6e00 2024-09-15T23:23:07.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.989+0000 7f838fb86640 1 -- 172.21.15.123:0/992588407 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f838815f9c0 con 0x7f83880b6e00 2024-09-15T23:23:07.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.990+0000 7f838fb86640 1 -- 172.21.15.123:0/992588407 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83880d1a70 con 0x7f83880b6e00 2024-09-15T23:23:07.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.990+0000 7f837e7fc640 1 -- 172.21.15.123:0/992588407 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8378044070 con 0x7f83880b6e00 2024-09-15T23:23:07.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.991+0000 7f837e7fc640 1 --2- 172.21.15.123:0/992588407 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f836c06c2b0 0x7f836c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:07.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.991+0000 7f837e7fc640 1 -- 172.21.15.123:0/992588407 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 5227+0+0 (secure 0 0 0) 0x7f83780ab420 con 0x7f83880b6e00 2024-09-15T23:23:07.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.991+0000 7f838d922640 1 --2- 172.21.15.123:0/992588407 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f836c06c2b0 0x7f836c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:07.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.992+0000 7f838d922640 1 --2- 172.21.15.123:0/992588407 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f836c06c2b0 0x7f836c06e770 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f8388156840 tx=0x7f838400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:07.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:07.995+0000 7f837e7fc640 1 -- 172.21.15.123:0/992588407 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f837804b070 con 0x7f83880b6e00 2024-09-15T23:23:08.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.165+0000 7f838fb86640 1 -- 172.21.15.123:0/992588407 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f838815d940 con 0x7f83880b6e00 2024-09-15T23:23:08.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.866+0000 7f837e7fc640 1 -- 172.21.15.123:0/992588407 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v192) ==== 170+0+0 (secure 0 0 0) 0x7f83780797b0 con 0x7f83880b6e00 2024-09-15T23:23:08.867 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' created 2024-09-15T23:23:08.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.871+0000 7f838fb86640 1 -- 172.21.15.123:0/992588407 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f836c06c2b0 msgr2=0x7f836c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:08.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.871+0000 7f838fb86640 1 --2- 172.21.15.123:0/992588407 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f836c06c2b0 0x7f836c06e770 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f8388156840 tx=0x7f838400b040 comp rx=0 tx=0).stop 2024-09-15T23:23:08.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.871+0000 7f838fb86640 1 -- 172.21.15.123:0/992588407 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83880b6e00 msgr2=0x7f8388156a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:08.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.872+0000 7f838fb86640 1 --2- 172.21.15.123:0/992588407 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83880b6e00 0x7f8388156a80 secure :-1 s=READY pgs=2212 cs=0 l=1 rev1=1 crypto rx=0x7f8378000c00 tx=0x7f83780046c0 comp rx=0 tx=0).stop 2024-09-15T23:23:08.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.872+0000 7f838fb86640 1 -- 172.21.15.123:0/992588407 shutdown_connections 2024-09-15T23:23:08.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.872+0000 7f838fb86640 1 --2- 172.21.15.123:0/992588407 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8388162d90 0x7f8388152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:08.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.872+0000 7f838fb86640 1 --2- 172.21.15.123:0/992588407 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f836c06c2b0 0x7f836c06e770 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:08.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.872+0000 7f838fb86640 1 --2- 172.21.15.123:0/992588407 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f83880b6e00 0x7f8388156a80 secure :-1 s=CLOSED pgs=2212 cs=0 l=1 rev1=1 crypto rx=0x7f8378000c00 tx=0x7f83780046c0 comp rx=0 tx=0).stop 2024-09-15T23:23:08.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.872+0000 7f838fb86640 1 --2- 172.21.15.123:0/992588407 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8388071160 0x7f838815ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:08.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.872+0000 7f838fb86640 1 -- 172.21.15.123:0/992588407 >> 172.21.15.123:0/992588407 conn(0x7f83880d2550 msgr2=0x7f83880b2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:08.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.874+0000 7f838fb86640 1 -- 172.21.15.123:0/992588407 shutdown_connections 2024-09-15T23:23:08.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.875+0000 7f838fb86640 1 -- 172.21.15.123:0/992588407 wait complete. 2024-09-15T23:23:08.895 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T23:23:08.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.996+0000 7fc454b81640 1 Processor -- start 2024-09-15T23:23:08.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.996+0000 7fc454b81640 1 -- start start 2024-09-15T23:23:08.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.997+0000 7fc454b81640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc45015b7c0 0x7fc4500b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:08.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.997+0000 7fc454b81640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc4500cead0 0x7fc450071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:08.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.997+0000 7fc454b81640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4500cf2e0 con 0x7fc4500ccf30 2024-09-15T23:23:08.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.997+0000 7fc454b81640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc450070fe0 con 0x7fc45015b7c0 2024-09-15T23:23:08.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.997+0000 7fc454b81640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fc4500712c0 con 0x7fc4500cead0 2024-09-15T23:23:08.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.997+0000 7fc44dd9b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc45015b7c0 0x7fc4500b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:08.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.997+0000 7fc44dd9b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc45015b7c0 0x7fc4500b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44848/0 (socket says 172.21.15.123:44848) 2024-09-15T23:23:08.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.997+0000 7fc44dd9b640 1 -- 172.21.15.123:0/845019872 learned_addr learned my addr 172.21.15.123:0/845019872 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:08.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.997+0000 7fc44e59c640 1 --1- 172.21.15.123:0/845019872 >> v1:172.21.15.123:6789/0 conn(0x7fc4500ccf30 0x7fc4500cd310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:34808/0 (socket says 172.21.15.123:34808) 2024-09-15T23:23:08.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.997+0000 7fc44dd9b640 1 -- 172.21.15.123:0/845019872 >> v2:172.21.15.188:3300/0 conn(0x7fc4500cead0 msgr2=0x7fc450071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:08.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.997+0000 7fc44dd9b640 1 --2- 172.21.15.123:0/845019872 >> v2:172.21.15.188:3300/0 conn(0x7fc4500cead0 0x7fc450071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:08.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.997+0000 7fc44dd9b640 1 -- 172.21.15.123:0/845019872 >> v1:172.21.15.123:6789/0 conn(0x7fc4500ccf30 legacy=0x7fc4500cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:08.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.997+0000 7fc44dd9b640 1 -- 172.21.15.123:0/845019872 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4500715a0 con 0x7fc45015b7c0 2024-09-15T23:23:08.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.997+0000 7fc44d59a640 1 -- 172.21.15.123:0/845019872 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1596949723 0 0) 0x7fc4500cf2e0 con 0x7fc4500ccf30 2024-09-15T23:23:09.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.998+0000 7fc44dd9b640 1 --2- 172.21.15.123:0/845019872 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc45015b7c0 0x7fc4500b2c50 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7fc45006f170 tx=0x7fc44402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2374b90ffa71564b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:09.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.998+0000 7fc44d59a640 1 -- 172.21.15.123:0/845019872 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc444037070 con 0x7fc45015b7c0 2024-09-15T23:23:09.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.998+0000 7fc44d59a640 1 -- 172.21.15.123:0/845019872 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc444032440 con 0x7fc45015b7c0 2024-09-15T23:23:09.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.998+0000 7fc44d59a640 1 -- 172.21.15.123:0/845019872 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc444032810 con 0x7fc45015b7c0 2024-09-15T23:23:09.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.999+0000 7fc454b81640 1 -- 172.21.15.123:0/845019872 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc45015b7c0 msgr2=0x7fc4500b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:09.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.999+0000 7fc454b81640 1 --2- 172.21.15.123:0/845019872 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc45015b7c0 0x7fc4500b2c50 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7fc45006f170 tx=0x7fc44402a1e0 comp rx=0 tx=0).stop 2024-09-15T23:23:09.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.999+0000 7fc454b81640 1 -- 172.21.15.123:0/845019872 shutdown_connections 2024-09-15T23:23:09.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.999+0000 7fc454b81640 1 --2- 172.21.15.123:0/845019872 >> v2:172.21.15.188:3300/0 conn(0x7fc4500cead0 0x7fc450071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:09.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.999+0000 7fc454b81640 1 --2- 172.21.15.123:0/845019872 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc45015b7c0 0x7fc4500b2c50 unknown :-1 s=CLOSED pgs=2214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:09.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.999+0000 7fc454b81640 1 -- 172.21.15.123:0/845019872 >> 172.21.15.123:0/845019872 conn(0x7fc45006d0f0 msgr2=0x7fc45006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:09.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.999+0000 7fc454b81640 1 -- 172.21.15.123:0/845019872 shutdown_connections 2024-09-15T23:23:09.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:08.999+0000 7fc454b81640 1 -- 172.21.15.123:0/845019872 wait complete. 2024-09-15T23:23:09.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.000+0000 7fc454b81640 1 Processor -- start 2024-09-15T23:23:09.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.000+0000 7fc454b81640 1 -- start start 2024-09-15T23:23:09.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.001+0000 7fc454b81640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4500ccf30 0x7fc45015d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:09.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.001+0000 7fc454b81640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4500cead0 0x7fc4500cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:09.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.001+0000 7fc454b81640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc45015b7c0 0x7fc45014f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:09.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.001+0000 7fc454b81640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc4500cf080 con 0x7fc4500ccf30 2024-09-15T23:23:09.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.001+0000 7fc454b81640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc4500cef00 con 0x7fc4500cead0 2024-09-15T23:23:09.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.001+0000 7fc454b81640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc450072000 con 0x7fc45015b7c0 2024-09-15T23:23:09.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.001+0000 7fc44e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4500ccf30 0x7fc45015d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:09.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.001+0000 7fc44e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4500ccf30 0x7fc45015d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44864/0 (socket says 172.21.15.123:44864) 2024-09-15T23:23:09.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.001+0000 7fc44e59c640 1 -- 172.21.15.123:0/2287695501 learned_addr learned my addr 172.21.15.123:0/2287695501 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:09.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.001+0000 7fc44dd9b640 1 --2- 172.21.15.123:0/2287695501 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4500cead0 0x7fc4500cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:09.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.001+0000 7fc44ed9d640 1 --2- 172.21.15.123:0/2287695501 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc45015b7c0 0x7fc45014f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:09.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.001+0000 7fc44e59c640 1 -- 172.21.15.123:0/2287695501 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc45015b7c0 msgr2=0x7fc45014f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:09.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.001+0000 7fc44e59c640 1 --2- 172.21.15.123:0/2287695501 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc45015b7c0 0x7fc45014f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:09.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.001+0000 7fc44e59c640 1 -- 172.21.15.123:0/2287695501 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4500cead0 msgr2=0x7fc4500cbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:09.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.001+0000 7fc44e59c640 1 --2- 172.21.15.123:0/2287695501 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4500cead0 0x7fc4500cbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:09.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.001+0000 7fc44e59c640 1 -- 172.21.15.123:0/2287695501 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4500cc120 con 0x7fc4500ccf30 2024-09-15T23:23:09.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.001+0000 7fc44dd9b640 1 --2- 172.21.15.123:0/2287695501 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4500cead0 0x7fc4500cbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:23:09.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.001+0000 7fc44e59c640 1 --2- 172.21.15.123:0/2287695501 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4500ccf30 0x7fc45015d760 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7fc44000c500 tx=0x7fc44000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:09.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.001+0000 7fc43effd640 1 -- 172.21.15.123:0/2287695501 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc440018070 con 0x7fc4500ccf30 2024-09-15T23:23:09.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.001+0000 7fc43effd640 1 -- 172.21.15.123:0/2287695501 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc440007580 con 0x7fc4500ccf30 2024-09-15T23:23:09.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.001+0000 7fc454b81640 1 -- 172.21.15.123:0/2287695501 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc45015ddb0 con 0x7fc4500ccf30 2024-09-15T23:23:09.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.001+0000 7fc43effd640 1 -- 172.21.15.123:0/2287695501 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc440004a20 con 0x7fc4500ccf30 2024-09-15T23:23:09.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.002+0000 7fc454b81640 1 -- 172.21.15.123:0/2287695501 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc45015e370 con 0x7fc4500ccf30 2024-09-15T23:23:09.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.003+0000 7fc454b81640 1 -- 172.21.15.123:0/2287695501 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc450071ac0 con 0x7fc4500ccf30 2024-09-15T23:23:09.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.003+0000 7fc43effd640 1 -- 172.21.15.123:0/2287695501 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc44001b070 con 0x7fc4500ccf30 2024-09-15T23:23:09.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.003+0000 7fc43effd640 1 --2- 172.21.15.123:0/2287695501 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc43006c2e0 0x7fc43006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:09.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.004+0000 7fc43effd640 1 -- 172.21.15.123:0/2287695501 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(192..192 src has 1..192) ==== 5609+0+0 (secure 0 0 0) 0x7fc44008a630 con 0x7fc4500ccf30 2024-09-15T23:23:09.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.004+0000 7fc44dd9b640 1 --2- 172.21.15.123:0/2287695501 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc43006c2e0 0x7fc43006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:09.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.004+0000 7fc44dd9b640 1 --2- 172.21.15.123:0/2287695501 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc43006c2e0 0x7fc43006e7a0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fc444034000 tx=0x7fc44402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:09.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.008+0000 7fc43effd640 1 -- 172.21.15.123:0/2287695501 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc4500cc120 con 0x7fc4500ccf30 2024-09-15T23:23:09.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.206+0000 7fc454b81640 1 -- 172.21.15.123:0/2287695501 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc4500cc960 con 0x7fc4500ccf30 2024-09-15T23:23:09.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.873+0000 7fc43effd640 1 -- 172.21.15.123:0/2287695501 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 26 and data pool 27 v118) ==== 174+0+0 (secure 0 0 0) 0x7fc440058e90 con 0x7fc4500ccf30 2024-09-15T23:23:09.874 INFO:teuthology.orchestra.run.smithi123.stderr:new fs with metadata pool 26 and data pool 27 2024-09-15T23:23:09.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.881+0000 7fc454b81640 1 -- 172.21.15.123:0/2287695501 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc43006c2e0 msgr2=0x7fc43006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:09.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.881+0000 7fc454b81640 1 --2- 172.21.15.123:0/2287695501 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc43006c2e0 0x7fc43006e7a0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fc444034000 tx=0x7fc44402e000 comp rx=0 tx=0).stop 2024-09-15T23:23:09.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.881+0000 7fc454b81640 1 -- 172.21.15.123:0/2287695501 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4500ccf30 msgr2=0x7fc45015d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:09.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.881+0000 7fc454b81640 1 --2- 172.21.15.123:0/2287695501 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4500ccf30 0x7fc45015d760 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7fc44000c500 tx=0x7fc44000c9c0 comp rx=0 tx=0).stop 2024-09-15T23:23:09.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.882+0000 7fc454b81640 1 -- 172.21.15.123:0/2287695501 shutdown_connections 2024-09-15T23:23:09.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.882+0000 7fc454b81640 1 --2- 172.21.15.123:0/2287695501 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc45015b7c0 0x7fc45014f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:09.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.882+0000 7fc454b81640 1 --2- 172.21.15.123:0/2287695501 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc4500cead0 0x7fc4500cbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:09.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.882+0000 7fc454b81640 1 --2- 172.21.15.123:0/2287695501 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc43006c2e0 0x7fc43006e7a0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:09.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.882+0000 7fc454b81640 1 --2- 172.21.15.123:0/2287695501 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc4500ccf30 0x7fc45015d760 unknown :-1 s=CLOSED pgs=2215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:09.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.882+0000 7fc454b81640 1 -- 172.21.15.123:0/2287695501 >> 172.21.15.123:0/2287695501 conn(0x7fc45006d0f0 msgr2=0x7fc4500b5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:09.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.884+0000 7fc454b81640 1 -- 172.21.15.123:0/2287695501 shutdown_connections 2024-09-15T23:23:09.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:09.886+0000 7fc454b81640 1 -- 172.21.15.123:0/2287695501 wait complete. 2024-09-15T23:23:09.906 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:23:10.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.005+0000 7f4cc685c640 1 Processor -- start 2024-09-15T23:23:10.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.005+0000 7f4cc685c640 1 -- start start 2024-09-15T23:23:10.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.006+0000 7f4cc685c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4cc006fe40 0x7f4cc0073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:10.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.006+0000 7f4cc685c640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cc01631c0 con 0x7f4cc0162c60 2024-09-15T23:23:10.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.006+0000 7f4cc685c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cc00ae9a0 con 0x7f4cc015e790 2024-09-15T23:23:10.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.006+0000 7f4cc685c640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f4cc015eb70 con 0x7f4cc006fe40 2024-09-15T23:23:10.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.006+0000 7f4cc4df9640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4cc006fe40 0x7f4cc0073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:10.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.006+0000 7f4cbf7fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f4cc0162c60 0x7f4cc006f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:34810/0 (socket says 172.21.15.123:34810) 2024-09-15T23:23:10.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.006+0000 7f4cbf7fe640 1 -- 172.21.15.123:0/1406515993 learned_addr learned my addr 172.21.15.123:0/1406515993 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:23:10.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.006+0000 7f4cc4df9640 1 -- 172.21.15.123:0/1406515993 >> v1:172.21.15.188:6789/0 conn(0x7f4cc015e790 legacy=0x7f4cc00b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:10.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.006+0000 7f4cc4df9640 1 -- 172.21.15.123:0/1406515993 >> v1:172.21.15.123:6789/0 conn(0x7f4cc0162c60 legacy=0x7f4cc006f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:10.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.006+0000 7f4cc4df9640 1 -- 172.21.15.123:0/1406515993 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc00aec40 con 0x7f4cc006fe40 2024-09-15T23:23:10.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.006+0000 7f4cbeffd640 1 -- 172.21.15.123:0/1406515993 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2281289395 0 0) 0x7f4cc01631c0 con 0x7f4cc0162c60 2024-09-15T23:23:10.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.007+0000 7f4cc4df9640 1 --2- 172.21.15.123:0/1406515993 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cc006fe40 0x7f4cc0073a40 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8009d90 tx=0x7f4cb802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=488edae2934e7dff server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:10.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.007+0000 7f4cbeffd640 1 -- 172.21.15.123:0/1406515993 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb8031600 con 0x7f4cc006fe40 2024-09-15T23:23:10.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.007+0000 7f4cbeffd640 1 -- 172.21.15.123:0/1406515993 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cb80317a0 con 0x7f4cc006fe40 2024-09-15T23:23:10.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.007+0000 7f4cbeffd640 1 -- 172.21.15.123:0/1406515993 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb8031b70 con 0x7f4cc006fe40 2024-09-15T23:23:10.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.008+0000 7f4cc685c640 1 -- 172.21.15.123:0/1406515993 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cc006fe40 msgr2=0x7f4cc0073a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:10.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.008+0000 7f4cc685c640 1 --2- 172.21.15.123:0/1406515993 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cc006fe40 0x7f4cc0073a40 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8009d90 tx=0x7f4cb802a610 comp rx=0 tx=0).stop 2024-09-15T23:23:10.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.008+0000 7f4cc685c640 1 -- 172.21.15.123:0/1406515993 shutdown_connections 2024-09-15T23:23:10.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.008+0000 7f4cc685c640 1 --2- 172.21.15.123:0/1406515993 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cc006fe40 0x7f4cc0073a40 unknown :-1 s=CLOSED pgs=2217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:10.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.008+0000 7f4cc685c640 1 -- 172.21.15.123:0/1406515993 >> 172.21.15.123:0/1406515993 conn(0x7f4cc00b0a80 msgr2=0x7f4cc00b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:10.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.008+0000 7f4cc685c640 1 -- 172.21.15.123:0/1406515993 shutdown_connections 2024-09-15T23:23:10.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.008+0000 7f4cc685c640 1 -- 172.21.15.123:0/1406515993 wait complete. 2024-09-15T23:23:10.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.009+0000 7f4cc685c640 1 Processor -- start 2024-09-15T23:23:10.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.009+0000 7f4cc685c640 1 -- start start 2024-09-15T23:23:10.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.010+0000 7f4cc685c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4cc006fe40 0x7f4cc01543c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:10.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.010+0000 7f4cc685c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cc015e790 0x7f4cc0157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:10.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.010+0000 7f4cc685c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4cc0162c60 0x7f4cc0157780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:10.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.010+0000 7f4cc685c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc00b5b40 con 0x7f4cc015e790 2024-09-15T23:23:10.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.010+0000 7f4cc685c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc00af200 con 0x7f4cc006fe40 2024-09-15T23:23:10.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.010+0000 7f4cc685c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f4cc006f430 con 0x7f4cc0162c60 2024-09-15T23:23:10.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.010+0000 7f4cbf7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cc015e790 0x7f4cc0157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:10.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.010+0000 7f4cbf7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cc015e790 0x7f4cc0157240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44882/0 (socket says 172.21.15.123:44882) 2024-09-15T23:23:10.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.010+0000 7f4cbf7fe640 1 -- 172.21.15.123:0/2657024146 learned_addr learned my addr 172.21.15.123:0/2657024146 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:10.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.010+0000 7f4cbffff640 1 --2- 172.21.15.123:0/2657024146 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4cc006fe40 0x7f4cc01543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:10.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.010+0000 7f4cc4df9640 1 --2- 172.21.15.123:0/2657024146 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4cc0162c60 0x7f4cc0157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:10.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.010+0000 7f4cbf7fe640 1 -- 172.21.15.123:0/2657024146 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4cc0162c60 msgr2=0x7f4cc0157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:10.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.010+0000 7f4cbf7fe640 1 --2- 172.21.15.123:0/2657024146 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4cc0162c60 0x7f4cc0157780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:10.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.010+0000 7f4cbf7fe640 1 -- 172.21.15.123:0/2657024146 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4cc006fe40 msgr2=0x7f4cc01543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:10.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.010+0000 7f4cbf7fe640 1 --2- 172.21.15.123:0/2657024146 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4cc006fe40 0x7f4cc01543c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:10.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.010+0000 7f4cbf7fe640 1 -- 172.21.15.123:0/2657024146 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc0161000 con 0x7f4cc015e790 2024-09-15T23:23:10.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.010+0000 7f4cbffff640 1 --2- 172.21.15.123:0/2657024146 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4cc006fe40 0x7f4cc01543c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:23:10.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.010+0000 7f4cbf7fe640 1 --2- 172.21.15.123:0/2657024146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cc015e790 0x7f4cc0157240 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7f4ca800c460 tx=0x7f4ca800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:10.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.011+0000 7f4cbcff9640 1 -- 172.21.15.123:0/2657024146 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8018070 con 0x7f4cc015e790 2024-09-15T23:23:10.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.011+0000 7f4cbcff9640 1 -- 172.21.15.123:0/2657024146 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ca8007500 con 0x7f4cc015e790 2024-09-15T23:23:10.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.011+0000 7f4cc685c640 1 -- 172.21.15.123:0/2657024146 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc01612e0 con 0x7f4cc015e790 2024-09-15T23:23:10.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.011+0000 7f4cbcff9640 1 -- 172.21.15.123:0/2657024146 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8004a20 con 0x7f4cc015e790 2024-09-15T23:23:10.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.011+0000 7f4cc685c640 1 -- 172.21.15.123:0/2657024146 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc01618a0 con 0x7f4cc015e790 2024-09-15T23:23:10.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.012+0000 7f4cc685c640 1 -- 172.21.15.123:0/2657024146 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cc00b5430 con 0x7f4cc015e790 2024-09-15T23:23:10.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.012+0000 7f4cbcff9640 1 -- 172.21.15.123:0/2657024146 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4ca801b070 con 0x7f4cc015e790 2024-09-15T23:23:10.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.012+0000 7f4cbcff9640 1 --2- 172.21.15.123:0/2657024146 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4ca006c2b0 0x7f4ca006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:10.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.013+0000 7f4cbcff9640 1 -- 172.21.15.123:0/2657024146 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 5709+0+0 (secure 0 0 0) 0x7f4ca808a6f0 con 0x7f4cc015e790 2024-09-15T23:23:10.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.013+0000 7f4cbffff640 1 --2- 172.21.15.123:0/2657024146 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4ca006c2b0 0x7f4ca006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:10.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.013+0000 7f4cbffff640 1 --2- 172.21.15.123:0/2657024146 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4ca006c2b0 0x7f4ca006e770 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0003eb0 tx=0x7f4cb0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:10.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.017+0000 7f4cbcff9640 1 -- 172.21.15.123:0/2657024146 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4cc00b5430 con 0x7f4cc015e790 2024-09-15T23:23:10.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.183+0000 7f4cc685c640 1 -- 172.21.15.123:0/2657024146 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4cc0073a40 con 0x7f4cc015e790 2024-09-15T23:23:10.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.184+0000 7f4cbcff9640 1 -- 172.21.15.123:0/2657024146 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v193) ==== 74+0+16712 (secure 0 0 0) 0x7f4ca8058e50 con 0x7f4cc015e790 2024-09-15T23:23:10.185 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:23:10.185 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":193,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:23:09.208145+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:23:07.827379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"193","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-15T23:23:08.184780+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"193","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:23:10.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.186+0000 7f4cc685c640 1 -- 172.21.15.123:0/2657024146 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4ca006c2b0 msgr2=0x7f4ca006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:10.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.186+0000 7f4cc685c640 1 --2- 172.21.15.123:0/2657024146 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4ca006c2b0 0x7f4ca006e770 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0003eb0 tx=0x7f4cb0009040 comp rx=0 tx=0).stop 2024-09-15T23:23:10.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.186+0000 7f4cc685c640 1 -- 172.21.15.123:0/2657024146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cc015e790 msgr2=0x7f4cc0157240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:10.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.186+0000 7f4cc685c640 1 --2- 172.21.15.123:0/2657024146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cc015e790 0x7f4cc0157240 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7f4ca800c460 tx=0x7f4ca800c920 comp rx=0 tx=0).stop 2024-09-15T23:23:10.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.186+0000 7f4cc685c640 1 -- 172.21.15.123:0/2657024146 shutdown_connections 2024-09-15T23:23:10.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.186+0000 7f4cc685c640 1 --2- 172.21.15.123:0/2657024146 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4cc0162c60 0x7f4cc0157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:10.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.186+0000 7f4cc685c640 1 --2- 172.21.15.123:0/2657024146 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4ca006c2b0 0x7f4ca006e770 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:10.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.186+0000 7f4cc685c640 1 --2- 172.21.15.123:0/2657024146 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cc015e790 0x7f4cc0157240 unknown :-1 s=CLOSED pgs=2218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:10.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.186+0000 7f4cc685c640 1 --2- 172.21.15.123:0/2657024146 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f4cc006fe40 0x7f4cc01543c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:10.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.186+0000 7f4cc685c640 1 -- 172.21.15.123:0/2657024146 >> 172.21.15.123:0/2657024146 conn(0x7f4cc00b0a80 msgr2=0x7f4cc0071910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:10.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.186+0000 7f4cc685c640 1 -- 172.21.15.123:0/2657024146 shutdown_connections 2024-09-15T23:23:10.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.186+0000 7f4cc685c640 1 -- 172.21.15.123:0/2657024146 wait complete. 2024-09-15T23:23:10.198 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:23:10.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.295+0000 7f5a48ef1640 1 Processor -- start 2024-09-15T23:23:10.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.295+0000 7f5a48ef1640 1 -- start start 2024-09-15T23:23:10.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.296+0000 7f5a48ef1640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5a440b2d40 0x7f5a4406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:10.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.296+0000 7f5a48ef1640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f5a4413eb20 0x7f5a4406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:10.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.296+0000 7f5a48ef1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a4415bcf0 0x7f5a4415c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:10.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.296+0000 7f5a48ef1640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f5a44071ab0 con 0x7f5a440b2d40 2024-09-15T23:23:10.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.296+0000 7f5a48ef1640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f5a44071180 con 0x7f5a4413eb20 2024-09-15T23:23:10.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.296+0000 7f5a48ef1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5a44071460 con 0x7f5a4415bcf0 2024-09-15T23:23:10.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.296+0000 7f5a4259c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5a440b2d40 0x7f5a4406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:10.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.296+0000 7f5a4259c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5a440b2d40 0x7f5a4406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44888/0 (socket says 172.21.15.123:44888) 2024-09-15T23:23:10.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.296+0000 7f5a4259c640 1 -- 172.21.15.123:0/2198488186 learned_addr learned my addr 172.21.15.123:0/2198488186 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:10.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.297+0000 7f5a4259c640 1 -- 172.21.15.123:0/2198488186 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a4415bcf0 msgr2=0x7f5a4415c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:10.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.297+0000 7f5a4259c640 1 --2- 172.21.15.123:0/2198488186 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a4415bcf0 0x7f5a4415c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:10.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.297+0000 7f5a4259c640 1 -- 172.21.15.123:0/2198488186 >> v2:172.21.15.188:3300/0 conn(0x7f5a4413eb20 msgr2=0x7f5a4406c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:10.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.297+0000 7f5a4259c640 1 --2- 172.21.15.123:0/2198488186 >> v2:172.21.15.188:3300/0 conn(0x7f5a4413eb20 0x7f5a4406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:10.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.297+0000 7f5a4259c640 1 -- 172.21.15.123:0/2198488186 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a44071740 con 0x7f5a440b2d40 2024-09-15T23:23:10.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.297+0000 7f5a4259c640 1 --2- 172.21.15.123:0/2198488186 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a440b2d40 0x7f5a4406bc10 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7f5a440d1500 tx=0x7f5a3402c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3afd180990768f0d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:10.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.297+0000 7f5a4159a640 1 -- 172.21.15.123:0/2198488186 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a34038070 con 0x7f5a440b2d40 2024-09-15T23:23:10.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.297+0000 7f5a4159a640 1 -- 172.21.15.123:0/2198488186 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a34031710 con 0x7f5a440b2d40 2024-09-15T23:23:10.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.297+0000 7f5a4159a640 1 -- 172.21.15.123:0/2198488186 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a34031ae0 con 0x7f5a440b2d40 2024-09-15T23:23:10.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.298+0000 7f5a48ef1640 1 -- 172.21.15.123:0/2198488186 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a440b2d40 msgr2=0x7f5a4406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:10.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.298+0000 7f5a48ef1640 1 --2- 172.21.15.123:0/2198488186 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a440b2d40 0x7f5a4406bc10 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7f5a440d1500 tx=0x7f5a3402c3f0 comp rx=0 tx=0).stop 2024-09-15T23:23:10.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.298+0000 7f5a48ef1640 1 -- 172.21.15.123:0/2198488186 shutdown_connections 2024-09-15T23:23:10.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.298+0000 7f5a48ef1640 1 --2- 172.21.15.123:0/2198488186 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a4415bcf0 0x7f5a4415c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:10.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.298+0000 7f5a48ef1640 1 --2- 172.21.15.123:0/2198488186 >> v2:172.21.15.188:3300/0 conn(0x7f5a4413eb20 0x7f5a4406c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:10.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.298+0000 7f5a48ef1640 1 --2- 172.21.15.123:0/2198488186 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a440b2d40 0x7f5a4406bc10 unknown :-1 s=CLOSED pgs=2219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:10.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.298+0000 7f5a48ef1640 1 -- 172.21.15.123:0/2198488186 >> 172.21.15.123:0/2198488186 conn(0x7f5a440ccec0 msgr2=0x7f5a440cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:10.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.298+0000 7f5a48ef1640 1 -- 172.21.15.123:0/2198488186 shutdown_connections 2024-09-15T23:23:10.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.298+0000 7f5a48ef1640 1 -- 172.21.15.123:0/2198488186 wait complete. 2024-09-15T23:23:10.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.299+0000 7f5a48ef1640 1 Processor -- start 2024-09-15T23:23:10.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.299+0000 7f5a48ef1640 1 -- start start 2024-09-15T23:23:10.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.300+0000 7f5a48ef1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a440b2d40 0x7f5a441550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:10.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.300+0000 7f5a48ef1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a4413eb20 0x7f5a44156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:10.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.300+0000 7f5a48ef1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5a4415bcf0 0x7f5a4413efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:10.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.300+0000 7f5a48ef1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4415f140 con 0x7f5a440b2d40 2024-09-15T23:23:10.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.300+0000 7f5a48ef1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4415efc0 con 0x7f5a4415bcf0 2024-09-15T23:23:10.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.300+0000 7f5a48ef1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5a4415f2c0 con 0x7f5a4413eb20 2024-09-15T23:23:10.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.300+0000 7f5a4259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a440b2d40 0x7f5a441550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:10.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.300+0000 7f5a4259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a440b2d40 0x7f5a441550d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44898/0 (socket says 172.21.15.123:44898) 2024-09-15T23:23:10.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.300+0000 7f5a4259c640 1 -- 172.21.15.123:0/1172589705 learned_addr learned my addr 172.21.15.123:0/1172589705 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:10.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.300+0000 7f5a4259c640 1 -- 172.21.15.123:0/1172589705 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a4413eb20 msgr2=0x7f5a44156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:10.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.300+0000 7f5a4259c640 1 --2- 172.21.15.123:0/1172589705 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a4413eb20 0x7f5a44156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:10.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.300+0000 7f5a4259c640 1 -- 172.21.15.123:0/1172589705 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5a4415bcf0 msgr2=0x7f5a4413efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:10.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.300+0000 7f5a4259c640 1 --2- 172.21.15.123:0/1172589705 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5a4415bcf0 0x7f5a4413efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:10.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.301+0000 7f5a4259c640 1 -- 172.21.15.123:0/1172589705 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a44155e80 con 0x7f5a440b2d40 2024-09-15T23:23:10.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.301+0000 7f5a4259c640 1 --2- 172.21.15.123:0/1172589705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a440b2d40 0x7f5a441550d0 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7f5a34000c00 tx=0x7f5a340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:10.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.301+0000 7f5a32ffd640 1 -- 172.21.15.123:0/1172589705 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a34043070 con 0x7f5a440b2d40 2024-09-15T23:23:10.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.301+0000 7f5a32ffd640 1 -- 172.21.15.123:0/1172589705 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a34033890 con 0x7f5a440b2d40 2024-09-15T23:23:10.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.301+0000 7f5a32ffd640 1 -- 172.21.15.123:0/1172589705 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a34038040 con 0x7f5a440b2d40 2024-09-15T23:23:10.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.301+0000 7f5a48ef1640 1 -- 172.21.15.123:0/1172589705 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a44156160 con 0x7f5a440b2d40 2024-09-15T23:23:10.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.301+0000 7f5a48ef1640 1 -- 172.21.15.123:0/1172589705 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a44156720 con 0x7f5a440b2d40 2024-09-15T23:23:10.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.302+0000 7f5a48ef1640 1 -- 172.21.15.123:0/1172589705 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a4415c1a0 con 0x7f5a440b2d40 2024-09-15T23:23:10.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.302+0000 7f5a32ffd640 1 -- 172.21.15.123:0/1172589705 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5a34046070 con 0x7f5a440b2d40 2024-09-15T23:23:10.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.303+0000 7f5a32ffd640 1 --2- 172.21.15.123:0/1172589705 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5a2406c2b0 0x7f5a2406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:10.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.303+0000 7f5a32ffd640 1 -- 172.21.15.123:0/1172589705 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 5709+0+0 (secure 0 0 0) 0x7f5a340ae230 con 0x7f5a440b2d40 2024-09-15T23:23:10.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.303+0000 7f5a41d9b640 1 --2- 172.21.15.123:0/1172589705 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5a2406c2b0 0x7f5a2406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:10.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.304+0000 7f5a41d9b640 1 --2- 172.21.15.123:0/1172589705 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5a2406c2b0 0x7f5a2406e770 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f5a4415bc10 tx=0x7f5a38006cb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:10.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.307+0000 7f5a32ffd640 1 -- 172.21.15.123:0/1172589705 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5a3407cb50 con 0x7f5a440b2d40 2024-09-15T23:23:10.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.472+0000 7f5a48ef1640 1 -- 172.21.15.123:0/1172589705 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5a4415d580 con 0x7f5a440b2d40 2024-09-15T23:23:10.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.473+0000 7f5a32ffd640 1 -- 172.21.15.123:0/1172589705 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v193) ==== 74+0+16712 (secure 0 0 0) 0x7f5a3407c450 con 0x7f5a440b2d40 2024-09-15T23:23:10.474 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:23:10.474 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":193,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:23:09.208145+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:23:07.827379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"193","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-15T23:23:08.184780+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"193","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:23:10.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.475+0000 7f5a48ef1640 1 -- 172.21.15.123:0/1172589705 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5a2406c2b0 msgr2=0x7f5a2406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:10.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.475+0000 7f5a48ef1640 1 --2- 172.21.15.123:0/1172589705 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5a2406c2b0 0x7f5a2406e770 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f5a4415bc10 tx=0x7f5a38006cb0 comp rx=0 tx=0).stop 2024-09-15T23:23:10.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.475+0000 7f5a48ef1640 1 -- 172.21.15.123:0/1172589705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a440b2d40 msgr2=0x7f5a441550d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:10.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.475+0000 7f5a48ef1640 1 --2- 172.21.15.123:0/1172589705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a440b2d40 0x7f5a441550d0 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7f5a34000c00 tx=0x7f5a340046c0 comp rx=0 tx=0).stop 2024-09-15T23:23:10.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.475+0000 7f5a48ef1640 1 -- 172.21.15.123:0/1172589705 shutdown_connections 2024-09-15T23:23:10.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.475+0000 7f5a48ef1640 1 --2- 172.21.15.123:0/1172589705 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5a4415bcf0 0x7f5a4413efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:10.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.475+0000 7f5a48ef1640 1 --2- 172.21.15.123:0/1172589705 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5a4413eb20 0x7f5a44156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:10.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.475+0000 7f5a48ef1640 1 --2- 172.21.15.123:0/1172589705 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5a2406c2b0 0x7f5a2406e770 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:10.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.475+0000 7f5a48ef1640 1 --2- 172.21.15.123:0/1172589705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5a440b2d40 0x7f5a441550d0 unknown :-1 s=CLOSED pgs=2220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:10.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.475+0000 7f5a48ef1640 1 -- 172.21.15.123:0/1172589705 >> 172.21.15.123:0/1172589705 conn(0x7f5a440ccec0 msgr2=0x7f5a44071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:10.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.475+0000 7f5a48ef1640 1 -- 172.21.15.123:0/1172589705 shutdown_connections 2024-09-15T23:23:10.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.475+0000 7f5a48ef1640 1 -- 172.21.15.123:0/1172589705 wait complete. 2024-09-15T23:23:10.489 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T23:23:10.504 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:23:10.536 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:23:10.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.593+0000 7f7d39366640 1 Processor -- start 2024-09-15T23:23:10.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.593+0000 7f7d39366640 1 -- start start 2024-09-15T23:23:10.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.593+0000 7f7d39366640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7d3415c7e0 0x7f7d3406ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:10.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.593+0000 7f7d39366640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7d340732d0 0x7f7d340736e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:10.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.593+0000 7f7d39366640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d3406f240 con 0x7f7d3406bc10 2024-09-15T23:23:10.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.593+0000 7f7d39366640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f7d34074220 con 0x7f7d340732d0 2024-09-15T23:23:10.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.593+0000 7f7d39366640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f7d34073f40 con 0x7f7d3415c7e0 2024-09-15T23:23:10.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.594+0000 7f7d337fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7d340732d0 0x7f7d340736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:10.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.594+0000 7f7d337fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7d340732d0 0x7f7d340736e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44906/0 (socket says 172.21.15.123:44906) 2024-09-15T23:23:10.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.594+0000 7f7d337fe640 1 -- 172.21.15.123:0/1087571429 learned_addr learned my addr 172.21.15.123:0/1087571429 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:10.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.594+0000 7f7d32ffd640 1 --2- 172.21.15.123:0/1087571429 >> v2:172.21.15.188:3300/0 conn(0x7f7d3415c7e0 0x7f7d3406ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:10.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.594+0000 7f7d337fe640 1 -- 172.21.15.123:0/1087571429 >> v2:172.21.15.188:3300/0 conn(0x7f7d3415c7e0 msgr2=0x7f7d3406ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:10.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.594+0000 7f7d337fe640 1 --2- 172.21.15.123:0/1087571429 >> v2:172.21.15.188:3300/0 conn(0x7f7d3415c7e0 0x7f7d3406ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:10.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.594+0000 7f7d337fe640 1 -- 172.21.15.123:0/1087571429 >> v1:172.21.15.123:6789/0 conn(0x7f7d3406bc10 legacy=0x7f7d3406c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:10.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.594+0000 7f7d327fc640 1 -- 172.21.15.123:0/1087571429 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 314953207 0 0) 0x7f7d1c001110 con 0x7f7d3406bc10 2024-09-15T23:23:10.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.594+0000 7f7d337fe640 1 -- 172.21.15.123:0/1087571429 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d3406e220 con 0x7f7d340732d0 2024-09-15T23:23:10.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.594+0000 7f7d32ffd640 1 --2- 172.21.15.123:0/1087571429 >> v2:172.21.15.188:3300/0 conn(0x7f7d3415c7e0 0x7f7d3406ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:23:10.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.595+0000 7f7d337fe640 1 --2- 172.21.15.123:0/1087571429 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d340732d0 0x7f7d340736e0 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7f7d340689e0 tx=0x7f7d2c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39cd182528a4e9ee server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:10.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.595+0000 7f7d327fc640 1 -- 172.21.15.123:0/1087571429 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c036070 con 0x7f7d340732d0 2024-09-15T23:23:10.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.595+0000 7f7d327fc640 1 -- 172.21.15.123:0/1087571429 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d2c031600 con 0x7f7d340732d0 2024-09-15T23:23:10.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.595+0000 7f7d327fc640 1 -- 172.21.15.123:0/1087571429 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c0319d0 con 0x7f7d340732d0 2024-09-15T23:23:10.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.595+0000 7f7d39366640 1 -- 172.21.15.123:0/1087571429 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d340732d0 msgr2=0x7f7d340736e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:10.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.595+0000 7f7d39366640 1 --2- 172.21.15.123:0/1087571429 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d340732d0 0x7f7d340736e0 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7f7d340689e0 tx=0x7f7d2c02a730 comp rx=0 tx=0).stop 2024-09-15T23:23:10.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.595+0000 7f7d39366640 1 -- 172.21.15.123:0/1087571429 shutdown_connections 2024-09-15T23:23:10.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.595+0000 7f7d39366640 1 --2- 172.21.15.123:0/1087571429 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d340732d0 0x7f7d340736e0 unknown :-1 s=CLOSED pgs=2222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:10.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.595+0000 7f7d39366640 1 --2- 172.21.15.123:0/1087571429 >> v2:172.21.15.188:3300/0 conn(0x7f7d3415c7e0 0x7f7d3406ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:10.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.595+0000 7f7d39366640 1 -- 172.21.15.123:0/1087571429 >> 172.21.15.123:0/1087571429 conn(0x7f7d340d1530 msgr2=0x7f7d340d1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:10.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.595+0000 7f7d39366640 1 -- 172.21.15.123:0/1087571429 shutdown_connections 2024-09-15T23:23:10.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.595+0000 7f7d39366640 1 -- 172.21.15.123:0/1087571429 wait complete. 2024-09-15T23:23:10.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.597+0000 7f7d39366640 1 Processor -- start 2024-09-15T23:23:10.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.597+0000 7f7d39366640 1 -- start start 2024-09-15T23:23:10.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.597+0000 7f7d39366640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7d3406bc10 0x7f7d341f1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:10.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.597+0000 7f7d39366640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d340732d0 0x7f7d3414d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:10.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.597+0000 7f7d39366640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7d3415c7e0 0x7f7d340ca470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:10.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.597+0000 7f7d39366640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7d340d22e0 con 0x7f7d340732d0 2024-09-15T23:23:10.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.597+0000 7f7d39366640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3406e7e0 con 0x7f7d3406bc10 2024-09-15T23:23:10.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.597+0000 7f7d39366640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7d34073c20 con 0x7f7d3415c7e0 2024-09-15T23:23:10.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.597+0000 7f7d2bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d340732d0 0x7f7d3414d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:10.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.597+0000 7f7d2bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d340732d0 0x7f7d3414d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44914/0 (socket says 172.21.15.123:44914) 2024-09-15T23:23:10.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.597+0000 7f7d2bfff640 1 -- 172.21.15.123:0/3191216052 learned_addr learned my addr 172.21.15.123:0/3191216052 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:10.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.598+0000 7f7d32ffd640 1 --2- 172.21.15.123:0/3191216052 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7d3406bc10 0x7f7d341f1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:10.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.598+0000 7f7d337fe640 1 --2- 172.21.15.123:0/3191216052 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7d3415c7e0 0x7f7d340ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:10.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.598+0000 7f7d2bfff640 1 -- 172.21.15.123:0/3191216052 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7d3415c7e0 msgr2=0x7f7d340ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:10.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.598+0000 7f7d2bfff640 1 --2- 172.21.15.123:0/3191216052 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7d3415c7e0 0x7f7d340ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:10.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.598+0000 7f7d2bfff640 1 -- 172.21.15.123:0/3191216052 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7d3406bc10 msgr2=0x7f7d341f1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:10.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.598+0000 7f7d2bfff640 1 --2- 172.21.15.123:0/3191216052 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7d3406bc10 0x7f7d341f1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:10.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.598+0000 7f7d2bfff640 1 -- 172.21.15.123:0/3191216052 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d3414d8f0 con 0x7f7d340732d0 2024-09-15T23:23:10.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.598+0000 7f7d2bfff640 1 --2- 172.21.15.123:0/3191216052 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d340732d0 0x7f7d3414d3b0 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c00c410 tx=0x7f7d1c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:10.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.598+0000 7f7d2b7fe640 1 -- 172.21.15.123:0/3191216052 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c017070 con 0x7f7d340732d0 2024-09-15T23:23:10.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.598+0000 7f7d2b7fe640 1 -- 172.21.15.123:0/3191216052 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d1c0035f0 con 0x7f7d340732d0 2024-09-15T23:23:10.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.598+0000 7f7d39366640 1 -- 172.21.15.123:0/3191216052 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d3414acb0 con 0x7f7d340732d0 2024-09-15T23:23:10.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.598+0000 7f7d2b7fe640 1 -- 172.21.15.123:0/3191216052 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c0039e0 con 0x7f7d340732d0 2024-09-15T23:23:10.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.598+0000 7f7d39366640 1 -- 172.21.15.123:0/3191216052 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d3414b270 con 0x7f7d340732d0 2024-09-15T23:23:10.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.599+0000 7f7d39366640 1 -- 172.21.15.123:0/3191216052 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d3415cbc0 con 0x7f7d340732d0 2024-09-15T23:23:10.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.600+0000 7f7d2b7fe640 1 -- 172.21.15.123:0/3191216052 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7d1c01a070 con 0x7f7d340732d0 2024-09-15T23:23:10.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.600+0000 7f7d2b7fe640 1 --2- 172.21.15.123:0/3191216052 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7d1406c2e0 0x7f7d1406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:10.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.600+0000 7f7d2b7fe640 1 -- 172.21.15.123:0/3191216052 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 5709+0+0 (secure 0 0 0) 0x7f7d1c08a780 con 0x7f7d340732d0 2024-09-15T23:23:10.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.600+0000 7f7d32ffd640 1 --2- 172.21.15.123:0/3191216052 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7d1406c2e0 0x7f7d1406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:10.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.601+0000 7f7d32ffd640 1 --2- 172.21.15.123:0/3191216052 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7d1406c2e0 0x7f7d1406e7a0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f7d2400ab60 tx=0x7f7d24008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:10.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.604+0000 7f7d2b7fe640 1 -- 172.21.15.123:0/3191216052 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7d3414d8f0 con 0x7f7d340732d0 2024-09-15T23:23:10.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.801+0000 7f7d39366640 1 -- 172.21.15.123:0/3191216052 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f7d340b1c00 con 0x7f7d340732d0 2024-09-15T23:23:10.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.879+0000 7f7d2b7fe640 1 -- 172.21.15.123:0/3191216052 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v119) ==== 118+0+0 (secure 0 0 0) 0x7f7d3406f240 con 0x7f7d340732d0 2024-09-15T23:23:10.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.881+0000 7f7d39366640 1 -- 172.21.15.123:0/3191216052 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7d1406c2e0 msgr2=0x7f7d1406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:10.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.881+0000 7f7d39366640 1 --2- 172.21.15.123:0/3191216052 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7d1406c2e0 0x7f7d1406e7a0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f7d2400ab60 tx=0x7f7d24008040 comp rx=0 tx=0).stop 2024-09-15T23:23:10.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.881+0000 7f7d39366640 1 -- 172.21.15.123:0/3191216052 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d340732d0 msgr2=0x7f7d3414d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:10.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.881+0000 7f7d39366640 1 --2- 172.21.15.123:0/3191216052 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d340732d0 0x7f7d3414d3b0 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c00c410 tx=0x7f7d1c00c8d0 comp rx=0 tx=0).stop 2024-09-15T23:23:10.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.881+0000 7f7d39366640 1 -- 172.21.15.123:0/3191216052 shutdown_connections 2024-09-15T23:23:10.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.881+0000 7f7d39366640 1 --2- 172.21.15.123:0/3191216052 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7d3415c7e0 0x7f7d340ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:10.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.881+0000 7f7d39366640 1 --2- 172.21.15.123:0/3191216052 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7d1406c2e0 0x7f7d1406e7a0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:10.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.881+0000 7f7d39366640 1 --2- 172.21.15.123:0/3191216052 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d340732d0 0x7f7d3414d3b0 unknown :-1 s=CLOSED pgs=2223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:10.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.881+0000 7f7d39366640 1 --2- 172.21.15.123:0/3191216052 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7d3406bc10 0x7f7d341f1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:10.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.881+0000 7f7d39366640 1 -- 172.21.15.123:0/3191216052 >> 172.21.15.123:0/3191216052 conn(0x7f7d340d1530 msgr2=0x7f7d340b23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:10.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.881+0000 7f7d39366640 1 -- 172.21.15.123:0/3191216052 shutdown_connections 2024-09-15T23:23:10.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:10.881+0000 7f7d39366640 1 -- 172.21.15.123:0/3191216052 wait complete. 2024-09-15T23:23:10.894 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T23:23:10.894 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T23:23:11.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.035+0000 7f74a69b7640 1 Processor -- start 2024-09-15T23:23:11.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.035+0000 7f74a69b7640 1 -- start start 2024-09-15T23:23:11.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.036+0000 7f74a69b7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f74a015c690 0x7f74a00ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:11.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.036+0000 7f74a69b7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f74a006c320 0x7f74a015ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:11.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.036+0000 7f74a69b7640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74a00b5a80 con 0x7f74a00b7320 2024-09-15T23:23:11.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.036+0000 7f74a69b7640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f74a00b6620 con 0x7f74a006c320 2024-09-15T23:23:11.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.036+0000 7f74a69b7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f74a00b6ab0 con 0x7f74a015c690 2024-09-15T23:23:11.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.036+0000 7f74a4f54640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f74a006c320 0x7f74a015ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:11.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.036+0000 7f74a4f54640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f74a006c320 0x7f74a015ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44918/0 (socket says 172.21.15.123:44918) 2024-09-15T23:23:11.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.036+0000 7f74a4f54640 1 -- 172.21.15.123:0/626637180 learned_addr learned my addr 172.21.15.123:0/626637180 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:11.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.036+0000 7f749ffff640 1 --2- 172.21.15.123:0/626637180 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f74a015c690 0x7f74a00ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:11.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.036+0000 7f74a4f54640 1 -- 172.21.15.123:0/626637180 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f74a015c690 msgr2=0x7f74a00ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:11.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.036+0000 7f74a4f54640 1 --2- 172.21.15.123:0/626637180 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f74a015c690 0x7f74a00ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:11.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.036+0000 7f74a4f54640 1 -- 172.21.15.123:0/626637180 >> v1:172.21.15.123:6789/0 conn(0x7f74a00b7320 legacy=0x7f74a006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:11.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.036+0000 7f74a4f54640 1 -- 172.21.15.123:0/626637180 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74a00b5cf0 con 0x7f74a006c320 2024-09-15T23:23:11.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.037+0000 7f74a4f54640 1 --2- 172.21.15.123:0/626637180 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74a006c320 0x7f74a015ca70 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 crypto rx=0x7f7498009e50 tx=0x7f749802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d086738a14006a46 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:11.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.037+0000 7f749effd640 1 -- 172.21.15.123:0/626637180 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7498036070 con 0x7f74a006c320 2024-09-15T23:23:11.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.037+0000 7f749effd640 1 -- 172.21.15.123:0/626637180 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7498031600 con 0x7f74a006c320 2024-09-15T23:23:11.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.037+0000 7f749effd640 1 -- 172.21.15.123:0/626637180 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74980319d0 con 0x7f74a006c320 2024-09-15T23:23:11.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.037+0000 7f74a69b7640 1 -- 172.21.15.123:0/626637180 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74a006c320 msgr2=0x7f74a015ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:11.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.037+0000 7f74a69b7640 1 --2- 172.21.15.123:0/626637180 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74a006c320 0x7f74a015ca70 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 crypto rx=0x7f7498009e50 tx=0x7f749802a710 comp rx=0 tx=0).stop 2024-09-15T23:23:11.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.038+0000 7f74a69b7640 1 -- 172.21.15.123:0/626637180 shutdown_connections 2024-09-15T23:23:11.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.038+0000 7f74a69b7640 1 --2- 172.21.15.123:0/626637180 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74a006c320 0x7f74a015ca70 unknown :-1 s=CLOSED pgs=2225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:11.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.038+0000 7f74a69b7640 1 --2- 172.21.15.123:0/626637180 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f74a015c690 0x7f74a00ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:11.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.038+0000 7f74a69b7640 1 -- 172.21.15.123:0/626637180 >> 172.21.15.123:0/626637180 conn(0x7f74a006cd20 msgr2=0x7f74a006d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:11.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.038+0000 7f74a69b7640 1 -- 172.21.15.123:0/626637180 shutdown_connections 2024-09-15T23:23:11.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.038+0000 7f74a69b7640 1 -- 172.21.15.123:0/626637180 wait complete. 2024-09-15T23:23:11.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.039+0000 7f74a69b7640 1 Processor -- start 2024-09-15T23:23:11.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.039+0000 7f74a69b7640 1 -- start start 2024-09-15T23:23:11.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.040+0000 7f74a69b7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f74a006c320 0x7f74a01f6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:11.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.040+0000 7f74a69b7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74a00b7320 0x7f74a01f22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:11.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.040+0000 7f74a69b7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f74a015c690 0x7f74a0158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:11.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.040+0000 7f74a69b7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f74a00cefe0 con 0x7f74a00b7320 2024-09-15T23:23:11.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.040+0000 7f74a69b7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f74a00b62b0 con 0x7f74a015c690 2024-09-15T23:23:11.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.040+0000 7f74a69b7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f74a00cf160 con 0x7f74a006c320 2024-09-15T23:23:11.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.040+0000 7f749f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74a00b7320 0x7f74a01f22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:11.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.040+0000 7f749f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74a00b7320 0x7f74a01f22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44930/0 (socket says 172.21.15.123:44930) 2024-09-15T23:23:11.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.040+0000 7f749f7fe640 1 -- 172.21.15.123:0/2059881783 learned_addr learned my addr 172.21.15.123:0/2059881783 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:11.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.040+0000 7f749ffff640 1 --2- 172.21.15.123:0/2059881783 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f74a006c320 0x7f74a01f6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:11.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.040+0000 7f74a4f54640 1 --2- 172.21.15.123:0/2059881783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f74a015c690 0x7f74a0158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:11.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.040+0000 7f749f7fe640 1 -- 172.21.15.123:0/2059881783 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f74a006c320 msgr2=0x7f74a01f6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:11.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.040+0000 7f749f7fe640 1 --2- 172.21.15.123:0/2059881783 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f74a006c320 0x7f74a01f6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:11.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.040+0000 7f749f7fe640 1 -- 172.21.15.123:0/2059881783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f74a015c690 msgr2=0x7f74a0158300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:11.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.040+0000 7f749f7fe640 1 --2- 172.21.15.123:0/2059881783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f74a015c690 0x7f74a0158300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:11.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.040+0000 7f749f7fe640 1 -- 172.21.15.123:0/2059881783 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74a01f2bb0 con 0x7f74a00b7320 2024-09-15T23:23:11.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.040+0000 7f74a4f54640 1 --2- 172.21.15.123:0/2059881783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f74a015c690 0x7f74a0158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:23:11.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.040+0000 7f749f7fe640 1 --2- 172.21.15.123:0/2059881783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74a00b7320 0x7f74a01f22f0 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7f748800c440 tx=0x7f7488001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:11.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.040+0000 7f749cff9640 1 -- 172.21.15.123:0/2059881783 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74880052d0 con 0x7f74a00b7320 2024-09-15T23:23:11.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.040+0000 7f749cff9640 1 -- 172.21.15.123:0/2059881783 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7488005470 con 0x7f74a00b7320 2024-09-15T23:23:11.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.040+0000 7f74a69b7640 1 -- 172.21.15.123:0/2059881783 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74a01f2e90 con 0x7f74a00b7320 2024-09-15T23:23:11.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.040+0000 7f749cff9640 1 -- 172.21.15.123:0/2059881783 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7488007260 con 0x7f74a00b7320 2024-09-15T23:23:11.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.040+0000 7f74a69b7640 1 -- 172.21.15.123:0/2059881783 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74a01f5980 con 0x7f74a00b7320 2024-09-15T23:23:11.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.041+0000 7f74a69b7640 1 -- 172.21.15.123:0/2059881783 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74a00ceaa0 con 0x7f74a00b7320 2024-09-15T23:23:11.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.042+0000 7f749cff9640 1 -- 172.21.15.123:0/2059881783 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7488007400 con 0x7f74a00b7320 2024-09-15T23:23:11.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.042+0000 7f749cff9640 1 --2- 172.21.15.123:0/2059881783 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f748006c2b0 0x7f748006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:11.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.042+0000 7f749cff9640 1 -- 172.21.15.123:0/2059881783 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7f748808a890 con 0x7f74a00b7320 2024-09-15T23:23:11.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.043+0000 7f749ffff640 1 --2- 172.21.15.123:0/2059881783 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f748006c2b0 0x7f748006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:11.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.043+0000 7f749ffff640 1 --2- 172.21.15.123:0/2059881783 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f748006c2b0 0x7f748006e770 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f74a00b2640 tx=0x7f7490008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:11.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.047+0000 7f749cff9640 1 -- 172.21.15.123:0/2059881783 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f74880589b0 con 0x7f74a00b7320 2024-09-15T23:23:11.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.246+0000 7f74a69b7640 1 -- 172.21.15.123:0/2059881783 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f74a015a910 con 0x7f74a00b7320 2024-09-15T23:23:11.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.888+0000 7f749cff9640 1 -- 172.21.15.123:0/2059881783 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v120) ==== 122+0+0 (secure 0 0 0) 0x7f748805ccb0 con 0x7f74a00b7320 2024-09-15T23:23:11.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.890+0000 7f74a69b7640 1 -- 172.21.15.123:0/2059881783 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f748006c2b0 msgr2=0x7f748006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:11.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.890+0000 7f74a69b7640 1 --2- 172.21.15.123:0/2059881783 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f748006c2b0 0x7f748006e770 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f74a00b2640 tx=0x7f7490008040 comp rx=0 tx=0).stop 2024-09-15T23:23:11.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.890+0000 7f74a69b7640 1 -- 172.21.15.123:0/2059881783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74a00b7320 msgr2=0x7f74a01f22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:11.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.890+0000 7f74a69b7640 1 --2- 172.21.15.123:0/2059881783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74a00b7320 0x7f74a01f22f0 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7f748800c440 tx=0x7f7488001e70 comp rx=0 tx=0).stop 2024-09-15T23:23:11.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.890+0000 7f74a69b7640 1 -- 172.21.15.123:0/2059881783 shutdown_connections 2024-09-15T23:23:11.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.890+0000 7f74a69b7640 1 --2- 172.21.15.123:0/2059881783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f74a015c690 0x7f74a0158300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:11.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.890+0000 7f74a69b7640 1 --2- 172.21.15.123:0/2059881783 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f748006c2b0 0x7f748006e770 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:11.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.890+0000 7f74a69b7640 1 --2- 172.21.15.123:0/2059881783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74a00b7320 0x7f74a01f22f0 unknown :-1 s=CLOSED pgs=2226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:11.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.890+0000 7f74a69b7640 1 --2- 172.21.15.123:0/2059881783 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f74a006c320 0x7f74a01f6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:11.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.890+0000 7f74a69b7640 1 -- 172.21.15.123:0/2059881783 >> 172.21.15.123:0/2059881783 conn(0x7f74a006cd20 msgr2=0x7f74a006d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:11.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.890+0000 7f74a69b7640 1 -- 172.21.15.123:0/2059881783 shutdown_connections 2024-09-15T23:23:11.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:11.890+0000 7f74a69b7640 1 -- 172.21.15.123:0/2059881783 wait complete. 2024-09-15T23:23:11.905 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T23:23:11.905 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:23:12.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.008+0000 7f0397053640 1 Processor -- start 2024-09-15T23:23:12.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.008+0000 7f0397053640 1 -- start start 2024-09-15T23:23:12.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.009+0000 7f0397053640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0390160040 0x7f03900d0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:12.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.009+0000 7f0397053640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f039015d150 0x7f039015d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:12.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.009+0000 7f0397053640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03900cdbc0 con 0x7f03900b42c0 2024-09-15T23:23:12.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.009+0000 7f0397053640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f03901606d0 con 0x7f0390160040 2024-09-15T23:23:12.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.009+0000 7f0397053640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f03901609b0 con 0x7f039015d150 2024-09-15T23:23:12.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.009+0000 7f038ffff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0390160040 0x7f03900d0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:12.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.009+0000 7f038ffff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0390160040 0x7f03900d0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44932/0 (socket says 172.21.15.123:44932) 2024-09-15T23:23:12.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.009+0000 7f038ffff640 1 -- 172.21.15.123:0/1795187057 learned_addr learned my addr 172.21.15.123:0/1795187057 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:12.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.010+0000 7f03955f0640 1 --2- 172.21.15.123:0/1795187057 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f039015d150 0x7f039015d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:12.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.010+0000 7f038ffff640 1 -- 172.21.15.123:0/1795187057 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f039015d150 msgr2=0x7f039015d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:12.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.010+0000 7f038ffff640 1 --2- 172.21.15.123:0/1795187057 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f039015d150 0x7f039015d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:12.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.010+0000 7f038ffff640 1 -- 172.21.15.123:0/1795187057 >> v1:172.21.15.188:6789/0 conn(0x7f03900b42c0 legacy=0x7f03900b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:12.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.010+0000 7f038ffff640 1 -- 172.21.15.123:0/1795187057 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0390160c90 con 0x7f0390160040 2024-09-15T23:23:12.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.010+0000 7f03955f0640 1 --2- 172.21.15.123:0/1795187057 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f039015d150 0x7f039015d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:23:12.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.010+0000 7f038ffff640 1 --2- 172.21.15.123:0/1795187057 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0390160040 0x7f03900d0230 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7f0384009870 tx=0x7f038402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad3969d1f3c1cb94 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:12.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.011+0000 7f038f7fe640 1 -- 172.21.15.123:0/1795187057 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0384037070 con 0x7f0390160040 2024-09-15T23:23:12.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.011+0000 7f038f7fe640 1 -- 172.21.15.123:0/1795187057 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0384032440 con 0x7f0390160040 2024-09-15T23:23:12.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.011+0000 7f038f7fe640 1 -- 172.21.15.123:0/1795187057 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0384032810 con 0x7f0390160040 2024-09-15T23:23:12.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.011+0000 7f0397053640 1 -- 172.21.15.123:0/1795187057 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0390160040 msgr2=0x7f03900d0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:12.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.011+0000 7f0397053640 1 --2- 172.21.15.123:0/1795187057 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0390160040 0x7f03900d0230 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7f0384009870 tx=0x7f038402a210 comp rx=0 tx=0).stop 2024-09-15T23:23:12.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.011+0000 7f0397053640 1 -- 172.21.15.123:0/1795187057 shutdown_connections 2024-09-15T23:23:12.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.011+0000 7f0397053640 1 --2- 172.21.15.123:0/1795187057 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0390160040 0x7f03900d0230 unknown :-1 s=CLOSED pgs=2227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:12.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.011+0000 7f0397053640 1 --2- 172.21.15.123:0/1795187057 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f039015d150 0x7f039015d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:12.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.011+0000 7f0397053640 1 -- 172.21.15.123:0/1795187057 >> 172.21.15.123:0/1795187057 conn(0x7f0390067950 msgr2=0x7f0390067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:12.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.011+0000 7f0397053640 1 -- 172.21.15.123:0/1795187057 shutdown_connections 2024-09-15T23:23:12.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.011+0000 7f0397053640 1 -- 172.21.15.123:0/1795187057 wait complete. 2024-09-15T23:23:12.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.012+0000 7f0397053640 1 Processor -- start 2024-09-15T23:23:12.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.013+0000 7f0397053640 1 -- start start 2024-09-15T23:23:12.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.013+0000 7f0397053640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f03900b42c0 0x7f03900b3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:12.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.013+0000 7f0397053640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f039015d150 0x7f039013c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:12.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.013+0000 7f0397053640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0390160040 0x7f03900b7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:12.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.013+0000 7f0397053640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f03900ce4e0 con 0x7f039015d150 2024-09-15T23:23:12.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.013+0000 7f0397053640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f03900ce360 con 0x7f0390160040 2024-09-15T23:23:12.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.013+0000 7f0397053640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f03900ce660 con 0x7f03900b42c0 2024-09-15T23:23:12.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.013+0000 7f038ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f039015d150 0x7f039013c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:12.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.014+0000 7f038ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f039015d150 0x7f039013c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44948/0 (socket says 172.21.15.123:44948) 2024-09-15T23:23:12.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.014+0000 7f038ffff640 1 -- 172.21.15.123:0/104765551 learned_addr learned my addr 172.21.15.123:0/104765551 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:12.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.014+0000 7f0394def640 1 --2- 172.21.15.123:0/104765551 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f03900b42c0 0x7f03900b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:12.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.014+0000 7f03955f0640 1 --2- 172.21.15.123:0/104765551 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0390160040 0x7f03900b7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:12.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.014+0000 7f038ffff640 1 -- 172.21.15.123:0/104765551 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f03900b42c0 msgr2=0x7f03900b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:12.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.014+0000 7f038ffff640 1 --2- 172.21.15.123:0/104765551 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f03900b42c0 0x7f03900b3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:12.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.014+0000 7f038ffff640 1 -- 172.21.15.123:0/104765551 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0390160040 msgr2=0x7f03900b7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:12.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.014+0000 7f038ffff640 1 --2- 172.21.15.123:0/104765551 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0390160040 0x7f03900b7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:12.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.014+0000 7f038ffff640 1 -- 172.21.15.123:0/104765551 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03900b2580 con 0x7f039015d150 2024-09-15T23:23:12.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.014+0000 7f03955f0640 1 --2- 172.21.15.123:0/104765551 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0390160040 0x7f03900b7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:23:12.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.014+0000 7f038ffff640 1 --2- 172.21.15.123:0/104765551 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f039015d150 0x7f039013c950 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 crypto rx=0x7f03840090b0 tx=0x7f03840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:12.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.014+0000 7f038d7fa640 1 -- 172.21.15.123:0/104765551 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0384041020 con 0x7f039015d150 2024-09-15T23:23:12.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.014+0000 7f038d7fa640 1 -- 172.21.15.123:0/104765551 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0384030990 con 0x7f039015d150 2024-09-15T23:23:12.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.014+0000 7f038d7fa640 1 -- 172.21.15.123:0/104765551 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0384037040 con 0x7f039015d150 2024-09-15T23:23:12.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.014+0000 7f0397053640 1 -- 172.21.15.123:0/104765551 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03900b2860 con 0x7f039015d150 2024-09-15T23:23:12.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.014+0000 7f0397053640 1 -- 172.21.15.123:0/104765551 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03900b2e20 con 0x7f039015d150 2024-09-15T23:23:12.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.015+0000 7f0397053640 1 -- 172.21.15.123:0/104765551 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f039015d5e0 con 0x7f039015d150 2024-09-15T23:23:12.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.016+0000 7f038d7fa640 1 -- 172.21.15.123:0/104765551 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0384044020 con 0x7f039015d150 2024-09-15T23:23:12.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.016+0000 7f038d7fa640 1 --2- 172.21.15.123:0/104765551 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f037c06c2b0 0x7f037c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:12.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.016+0000 7f038d7fa640 1 -- 172.21.15.123:0/104765551 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7f03840abec0 con 0x7f039015d150 2024-09-15T23:23:12.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.017+0000 7f0394def640 1 --2- 172.21.15.123:0/104765551 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f037c06c2b0 0x7f037c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:12.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.017+0000 7f0394def640 1 --2- 172.21.15.123:0/104765551 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f037c06c2b0 0x7f037c06e770 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f0380003d90 tx=0x7f0380009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:12.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.021+0000 7f038d7fa640 1 -- 172.21.15.123:0/104765551 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f038404b030 con 0x7f039015d150 2024-09-15T23:23:12.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.221+0000 7f0397053640 1 -- 172.21.15.123:0/104765551 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0390152da0 con 0x7f039015d150 2024-09-15T23:23:12.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.222+0000 7f038d7fa640 1 -- 172.21.15.123:0/104765551 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) ==== 95+0+5248 (secure 0 0 0) 0x7f03900cdbc0 con 0x7f039015d150 2024-09-15T23:23:12.223 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:23:12.223 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":120,"btime":"2024-09-15T23:23:11:879993+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8785,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2171656296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2171656296},{"type":"v1","addr":"172.21.15.188:6836","nonce":2171656296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":8788,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/136119431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":136119431},{"type":"v1","addr":"172.21.15.188:6837","nonce":136119431}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":10473,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/2374047694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2374047694},{"type":"v1","addr":"172.21.15.123:6833","nonce":2374047694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":120,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:23:09.208435+0000","modified":"2024-09-15T23:23:11.247532+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10491},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10491":{"gid":10491,"name":"a","rank":0,"incarnation":118,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/2653908784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2653908784},{"type":"v1","addr":"172.21.15.123:6835","nonce":2653908784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10491,"qdb_cluster":[10491]},"id":13}]} 2024-09-15T23:23:12.223 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 120 2024-09-15T23:23:12.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.224+0000 7f0397053640 1 -- 172.21.15.123:0/104765551 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f037c06c2b0 msgr2=0x7f037c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:12.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.224+0000 7f0397053640 1 --2- 172.21.15.123:0/104765551 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f037c06c2b0 0x7f037c06e770 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f0380003d90 tx=0x7f0380009040 comp rx=0 tx=0).stop 2024-09-15T23:23:12.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.224+0000 7f0397053640 1 -- 172.21.15.123:0/104765551 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f039015d150 msgr2=0x7f039013c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:12.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.224+0000 7f0397053640 1 --2- 172.21.15.123:0/104765551 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f039015d150 0x7f039013c950 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 crypto rx=0x7f03840090b0 tx=0x7f03840046c0 comp rx=0 tx=0).stop 2024-09-15T23:23:12.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.224+0000 7f0397053640 1 -- 172.21.15.123:0/104765551 shutdown_connections 2024-09-15T23:23:12.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.224+0000 7f0397053640 1 --2- 172.21.15.123:0/104765551 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0390160040 0x7f03900b7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:12.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.224+0000 7f0397053640 1 --2- 172.21.15.123:0/104765551 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f037c06c2b0 0x7f037c06e770 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:12.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.224+0000 7f0397053640 1 --2- 172.21.15.123:0/104765551 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f039015d150 0x7f039013c950 unknown :-1 s=CLOSED pgs=2228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:12.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.224+0000 7f0397053640 1 --2- 172.21.15.123:0/104765551 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f03900b42c0 0x7f03900b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:12.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.224+0000 7f0397053640 1 -- 172.21.15.123:0/104765551 >> 172.21.15.123:0/104765551 conn(0x7f0390067950 msgr2=0x7f0390067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:12.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.224+0000 7f0397053640 1 -- 172.21.15.123:0/104765551 shutdown_connections 2024-09-15T23:23:12.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.224+0000 7f0397053640 1 -- 172.21.15.123:0/104765551 wait complete. 2024-09-15T23:23:12.236 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:23:12.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.332+0000 7fa83bbc4640 1 Processor -- start 2024-09-15T23:23:12.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.332+0000 7fa83bbc4640 1 -- start start 2024-09-15T23:23:12.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.333+0000 7fa83bbc4640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa83415e6d0 0x7fa834071390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:12.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.333+0000 7fa83bbc4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa83415eab0 con 0x7fa834070b80 2024-09-15T23:23:12.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.333+0000 7fa83bbc4640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa83415ed70 con 0x7fa83406cd20 2024-09-15T23:23:12.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.333+0000 7fa83bbc4640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fa83415f050 con 0x7fa83415e6d0 2024-09-15T23:23:12.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.333+0000 7fa83a161640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa834070b80 0x7fa8341622a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:34842/0 (socket says 172.21.15.123:34842) 2024-09-15T23:23:12.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.333+0000 7fa83a161640 1 -- 172.21.15.123:0/2613185357 learned_addr learned my addr 172.21.15.123:0/2613185357 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:23:12.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.334+0000 7fa839960640 1 --2- 172.21.15.123:0/2613185357 >> v2:172.21.15.188:3300/0 conn(0x7fa83415e6d0 0x7fa834071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:12.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.334+0000 7fa83895e640 1 -- 172.21.15.123:0/2613185357 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2481580908 0 0) 0x7fa83415eab0 con 0x7fa834070b80 2024-09-15T23:23:12.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.334+0000 7fa83895e640 1 -- 172.21.15.123:0/2613185357 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa81c003520 con 0x7fa834070b80 2024-09-15T23:23:12.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.334+0000 7fa83895e640 1 -- 172.21.15.123:0/2613185357 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1469534872 0 0) 0x7fa81c003520 con 0x7fa834070b80 2024-09-15T23:23:12.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.334+0000 7fa83895e640 1 -- 172.21.15.123:0/2613185357 >> v2:172.21.15.188:3300/0 conn(0x7fa83415e6d0 msgr2=0x7fa834071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:12.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.334+0000 7fa83895e640 1 --2- 172.21.15.123:0/2613185357 >> v2:172.21.15.188:3300/0 conn(0x7fa83415e6d0 0x7fa834071390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:12.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.334+0000 7fa83895e640 1 -- 172.21.15.123:0/2613185357 >> v1:172.21.15.188:6789/0 conn(0x7fa83406cd20 legacy=0x7fa8340b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:12.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.334+0000 7fa83895e640 1 -- 172.21.15.123:0/2613185357 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa83415f330 con 0x7fa834070b80 2024-09-15T23:23:12.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.334+0000 7fa83895e640 1 -- 172.21.15.123:0/2613185357 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fa82c001670 con 0x7fa834070b80 2024-09-15T23:23:12.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.334+0000 7fa83895e640 1 -- 172.21.15.123:0/2613185357 >> v1:172.21.15.123:6789/0 conn(0x7fa834070b80 legacy=0x7fa8341622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:12.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.334+0000 7fa83895e640 1 --2- 172.21.15.123:0/2613185357 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa81c0039b0 0x7fa81c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:12.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.334+0000 7fa83895e640 1 --2- 172.21.15.123:0/2613185357 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa81c004800 0x7fa81c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:12.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.334+0000 7fa83895e640 1 --2- 172.21.15.123:0/2613185357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa81c0051c0 0x7fa81c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:12.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.334+0000 7fa83895e640 1 -- 172.21.15.123:0/2613185357 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa83415f050 con 0x7fa81c0051c0 2024-09-15T23:23:12.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.334+0000 7fa83895e640 1 -- 172.21.15.123:0/2613185357 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa81c00c060 con 0x7fa81c0039b0 2024-09-15T23:23:12.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.334+0000 7fa83895e640 1 -- 172.21.15.123:0/2613185357 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa81c00c260 con 0x7fa81c004800 2024-09-15T23:23:12.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.334+0000 7fa83a161640 1 --2- 172.21.15.123:0/2613185357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa81c0051c0 0x7fa81c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:12.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.334+0000 7fa839960640 1 --2- 172.21.15.123:0/2613185357 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa81c0039b0 0x7fa81c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:12.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.334+0000 7fa83915f640 1 --2- 172.21.15.123:0/2613185357 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa81c004800 0x7fa81c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:12.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.334+0000 7fa83a161640 1 -- 172.21.15.123:0/2613185357 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa81c004800 msgr2=0x7fa81c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:12.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.334+0000 7fa83a161640 1 --2- 172.21.15.123:0/2613185357 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa81c004800 0x7fa81c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:12.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.334+0000 7fa83a161640 1 -- 172.21.15.123:0/2613185357 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa81c0039b0 msgr2=0x7fa81c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:12.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.334+0000 7fa83a161640 1 --2- 172.21.15.123:0/2613185357 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa81c0039b0 0x7fa81c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:12.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.334+0000 7fa83a161640 1 -- 172.21.15.123:0/2613185357 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa81c003520 con 0x7fa81c0051c0 2024-09-15T23:23:12.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.335+0000 7fa83a161640 1 -- 172.21.15.123:0/2613185357 reap_dead start 2024-09-15T23:23:12.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.335+0000 7fa83a161640 1 --2- 172.21.15.123:0/2613185357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa81c0051c0 0x7fa81c00b9c0 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7fa82c00c240 tx=0x7fa81c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d969dbb004098a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:12.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.335+0000 7fa83895e640 1 -- 172.21.15.123:0/2613185357 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82c007cf0 con 0x7fa81c0051c0 2024-09-15T23:23:12.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.335+0000 7fa83895e640 1 -- 172.21.15.123:0/2613185357 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa82c0058d0 con 0x7fa81c0051c0 2024-09-15T23:23:12.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.335+0000 7fa83895e640 1 -- 172.21.15.123:0/2613185357 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82c005ce0 con 0x7fa81c0051c0 2024-09-15T23:23:12.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.336+0000 7fa83bbc4640 1 -- 172.21.15.123:0/2613185357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa81c0051c0 msgr2=0x7fa81c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:12.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.336+0000 7fa83bbc4640 1 --2- 172.21.15.123:0/2613185357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa81c0051c0 0x7fa81c00b9c0 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7fa82c00c240 tx=0x7fa81c005830 comp rx=0 tx=0).stop 2024-09-15T23:23:12.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.336+0000 7fa83bbc4640 1 -- 172.21.15.123:0/2613185357 shutdown_connections 2024-09-15T23:23:12.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.336+0000 7fa83bbc4640 1 --2- 172.21.15.123:0/2613185357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa81c0051c0 0x7fa81c00b9c0 unknown :-1 s=CLOSED pgs=2230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:12.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.336+0000 7fa83bbc4640 1 -- 172.21.15.123:0/2613185357 >> 172.21.15.123:0/2613185357 conn(0x7fa834067fb0 msgr2=0x7fa83406f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:12.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.336+0000 7fa83bbc4640 1 -- 172.21.15.123:0/2613185357 shutdown_connections 2024-09-15T23:23:12.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.336+0000 7fa83bbc4640 1 -- 172.21.15.123:0/2613185357 wait complete. 2024-09-15T23:23:12.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.337+0000 7fa83bbc4640 1 Processor -- start 2024-09-15T23:23:12.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.337+0000 7fa83bbc4640 1 -- start start 2024-09-15T23:23:12.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.338+0000 7fa83bbc4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa81c0051c0 0x7fa83415be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:12.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.338+0000 7fa83bbc4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa83415dc00 0x7fa8340ac0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:12.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.338+0000 7fa83bbc4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8341563f0 0x7fa83414bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:12.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.338+0000 7fa83bbc4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa834071390 con 0x7fa81c0051c0 2024-09-15T23:23:12.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.338+0000 7fa83bbc4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa83415f8f0 con 0x7fa83415dc00 2024-09-15T23:23:12.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.338+0000 7fa83bbc4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa834071510 con 0x7fa8341563f0 2024-09-15T23:23:12.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.338+0000 7fa839960640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa81c0051c0 0x7fa83415be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:12.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.338+0000 7fa839960640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa81c0051c0 0x7fa83415be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44966/0 (socket says 172.21.15.123:44966) 2024-09-15T23:23:12.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.338+0000 7fa839960640 1 -- 172.21.15.123:0/734634135 learned_addr learned my addr 172.21.15.123:0/734634135 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:12.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.338+0000 7fa83915f640 1 --2- 172.21.15.123:0/734634135 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa83415dc00 0x7fa8340ac0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:12.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.338+0000 7fa83a161640 1 --2- 172.21.15.123:0/734634135 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8341563f0 0x7fa83414bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:12.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.338+0000 7fa839960640 1 -- 172.21.15.123:0/734634135 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8341563f0 msgr2=0x7fa83414bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:12.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.338+0000 7fa839960640 1 --2- 172.21.15.123:0/734634135 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8341563f0 0x7fa83414bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:12.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.338+0000 7fa839960640 1 -- 172.21.15.123:0/734634135 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa83415dc00 msgr2=0x7fa8340ac0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:12.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.338+0000 7fa839960640 1 --2- 172.21.15.123:0/734634135 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa83415dc00 0x7fa8340ac0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:12.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.338+0000 7fa839960640 1 -- 172.21.15.123:0/734634135 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa83415ade0 con 0x7fa81c0051c0 2024-09-15T23:23:12.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.338+0000 7fa839960640 1 --2- 172.21.15.123:0/734634135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa81c0051c0 0x7fa83415be80 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7fa824009f90 tx=0x7fa82400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:12.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.339+0000 7fa8327fc640 1 -- 172.21.15.123:0/734634135 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82400fea0 con 0x7fa81c0051c0 2024-09-15T23:23:12.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.339+0000 7fa8327fc640 1 -- 172.21.15.123:0/734634135 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa824015630 con 0x7fa81c0051c0 2024-09-15T23:23:12.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.339+0000 7fa83bbc4640 1 -- 172.21.15.123:0/734634135 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa83415b0c0 con 0x7fa81c0051c0 2024-09-15T23:23:12.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.339+0000 7fa8327fc640 1 -- 172.21.15.123:0/734634135 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa824015a20 con 0x7fa81c0051c0 2024-09-15T23:23:12.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.339+0000 7fa83bbc4640 1 -- 172.21.15.123:0/734634135 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa83415b680 con 0x7fa81c0051c0 2024-09-15T23:23:12.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.340+0000 7fa83bbc4640 1 -- 172.21.15.123:0/734634135 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8340718a0 con 0x7fa81c0051c0 2024-09-15T23:23:12.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.340+0000 7fa8327fc640 1 -- 172.21.15.123:0/734634135 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa824015bc0 con 0x7fa81c0051c0 2024-09-15T23:23:12.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.341+0000 7fa8327fc640 1 --2- 172.21.15.123:0/734634135 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa82006c2b0 0x7fa82006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:12.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.341+0000 7fa8327fc640 1 -- 172.21.15.123:0/734634135 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7fa82408c4e0 con 0x7fa81c0051c0 2024-09-15T23:23:12.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.341+0000 7fa83915f640 1 --2- 172.21.15.123:0/734634135 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa82006c2b0 0x7fa82006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:12.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.341+0000 7fa83915f640 1 --2- 172.21.15.123:0/734634135 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa82006c2b0 0x7fa82006e770 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fa8341f7ab0 tx=0x7fa828009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:12.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.345+0000 7fa8327fc640 1 -- 172.21.15.123:0/734634135 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa824019030 con 0x7fa81c0051c0 2024-09-15T23:23:12.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.510+0000 7fa83bbc4640 1 -- 172.21.15.123:0/734634135 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa834160ff0 con 0x7fa81c0051c0 2024-09-15T23:23:12.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.511+0000 7fa8327fc640 1 -- 172.21.15.123:0/734634135 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v194) ==== 74+0+16699 (secure 0 0 0) 0x7fa824010040 con 0x7fa81c0051c0 2024-09-15T23:23:12.513 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:23:12.513 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":194,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:23:10.873327+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:23:07.827379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"193","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-15T23:23:08.184780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"194","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:23:12.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.513+0000 7fa83bbc4640 1 -- 172.21.15.123:0/734634135 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa82006c2b0 msgr2=0x7fa82006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:12.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.513+0000 7fa83bbc4640 1 --2- 172.21.15.123:0/734634135 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa82006c2b0 0x7fa82006e770 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fa8341f7ab0 tx=0x7fa828009040 comp rx=0 tx=0).stop 2024-09-15T23:23:12.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.513+0000 7fa83bbc4640 1 -- 172.21.15.123:0/734634135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa81c0051c0 msgr2=0x7fa83415be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:12.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.513+0000 7fa83bbc4640 1 --2- 172.21.15.123:0/734634135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa81c0051c0 0x7fa83415be80 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7fa824009f90 tx=0x7fa82400f580 comp rx=0 tx=0).stop 2024-09-15T23:23:12.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.513+0000 7fa83bbc4640 1 -- 172.21.15.123:0/734634135 shutdown_connections 2024-09-15T23:23:12.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.513+0000 7fa83bbc4640 1 --2- 172.21.15.123:0/734634135 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8341563f0 0x7fa83414bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:12.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.513+0000 7fa83bbc4640 1 --2- 172.21.15.123:0/734634135 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa83415dc00 0x7fa8340ac0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:12.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.513+0000 7fa83bbc4640 1 --2- 172.21.15.123:0/734634135 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa82006c2b0 0x7fa82006e770 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:12.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.513+0000 7fa83bbc4640 1 --2- 172.21.15.123:0/734634135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa81c0051c0 0x7fa83415be80 unknown :-1 s=CLOSED pgs=2231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:12.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.513+0000 7fa83bbc4640 1 -- 172.21.15.123:0/734634135 >> 172.21.15.123:0/734634135 conn(0x7fa834067fb0 msgr2=0x7fa8341612d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:12.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.513+0000 7fa83bbc4640 1 -- 172.21.15.123:0/734634135 shutdown_connections 2024-09-15T23:23:12.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.513+0000 7fa83bbc4640 1 -- 172.21.15.123:0/734634135 wait complete. 2024-09-15T23:23:12.525 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T23:23:12.525 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:23:12.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.622+0000 7f29f9c23640 1 Processor -- start 2024-09-15T23:23:12.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.622+0000 7f29f9c23640 1 -- start start 2024-09-15T23:23:12.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.623+0000 7f29f9c23640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f29f413eb20 0x7f29f415c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:12.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.623+0000 7f29f9c23640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29f4071180 con 0x7f29f406c320 2024-09-15T23:23:12.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.623+0000 7f29f9c23640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29f4071460 con 0x7f29f40b2d40 2024-09-15T23:23:12.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.623+0000 7f29f9c23640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f29f4071ab0 con 0x7f29f413eb20 2024-09-15T23:23:12.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.623+0000 7f29f3fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f29f413eb20 0x7f29f415c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:12.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.623+0000 7f29f2ffd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f29f406c320 0x7f29f415bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:34856/0 (socket says 172.21.15.123:34856) 2024-09-15T23:23:12.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.623+0000 7f29f2ffd640 1 -- 172.21.15.123:0/2478847331 learned_addr learned my addr 172.21.15.123:0/2478847331 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:23:12.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.623+0000 7f29f3fff640 1 -- 172.21.15.123:0/2478847331 >> v1:172.21.15.188:6789/0 conn(0x7f29f40b2d40 legacy=0x7f29f406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:12.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.623+0000 7f29f3fff640 1 -- 172.21.15.123:0/2478847331 >> v1:172.21.15.123:6789/0 conn(0x7f29f406c320 legacy=0x7f29f415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:12.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.623+0000 7f29f3fff640 1 -- 172.21.15.123:0/2478847331 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f4071740 con 0x7f29f413eb20 2024-09-15T23:23:12.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.623+0000 7f29f27fc640 1 -- 172.21.15.123:0/2478847331 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 502618217 0 0) 0x7f29f4071180 con 0x7f29f406c320 2024-09-15T23:23:12.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.624+0000 7f29f3fff640 1 --2- 172.21.15.123:0/2478847331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29f413eb20 0x7f29f415c400 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7f29ec0097a0 tx=0x7f29ec02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b3e40677af4547c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:12.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.624+0000 7f29f27fc640 1 -- 172.21.15.123:0/2478847331 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ec037070 con 0x7f29f413eb20 2024-09-15T23:23:12.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.624+0000 7f29f27fc640 1 -- 172.21.15.123:0/2478847331 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29ec032440 con 0x7f29f413eb20 2024-09-15T23:23:12.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.624+0000 7f29f27fc640 1 -- 172.21.15.123:0/2478847331 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ec032810 con 0x7f29f413eb20 2024-09-15T23:23:12.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.625+0000 7f29f9c23640 1 -- 172.21.15.123:0/2478847331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29f413eb20 msgr2=0x7f29f415c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:12.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.625+0000 7f29f9c23640 1 --2- 172.21.15.123:0/2478847331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29f413eb20 0x7f29f415c400 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7f29ec0097a0 tx=0x7f29ec02a230 comp rx=0 tx=0).stop 2024-09-15T23:23:12.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.625+0000 7f29f9c23640 1 -- 172.21.15.123:0/2478847331 shutdown_connections 2024-09-15T23:23:12.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.625+0000 7f29f9c23640 1 --2- 172.21.15.123:0/2478847331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29f413eb20 0x7f29f415c400 unknown :-1 s=CLOSED pgs=2233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:12.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.625+0000 7f29f9c23640 1 -- 172.21.15.123:0/2478847331 >> 172.21.15.123:0/2478847331 conn(0x7f29f40ccec0 msgr2=0x7f29f40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:12.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.625+0000 7f29f9c23640 1 -- 172.21.15.123:0/2478847331 shutdown_connections 2024-09-15T23:23:12.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.625+0000 7f29f9c23640 1 -- 172.21.15.123:0/2478847331 wait complete. 2024-09-15T23:23:12.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.626+0000 7f29f9c23640 1 Processor -- start 2024-09-15T23:23:12.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.626+0000 7f29f9c23640 1 -- start start 2024-09-15T23:23:12.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.627+0000 7f29f9c23640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f29f406c320 0x7f29f4154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:12.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.627+0000 7f29f9c23640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29f40b2d40 0x7f29f4136140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:12.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.627+0000 7f29f9c23640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f29f413eb20 0x7f29f40cf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:12.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.627+0000 7f29f9c23640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f29f41666e0 con 0x7f29f40b2d40 2024-09-15T23:23:12.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.627+0000 7f29f9c23640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f29f4166560 con 0x7f29f406c320 2024-09-15T23:23:12.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.627+0000 7f29f9c23640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f29f4166860 con 0x7f29f413eb20 2024-09-15T23:23:12.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.627+0000 7f29f2ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29f40b2d40 0x7f29f4136140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:12.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.627+0000 7f29f2ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29f40b2d40 0x7f29f4136140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44986/0 (socket says 172.21.15.123:44986) 2024-09-15T23:23:12.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.627+0000 7f29f2ffd640 1 -- 172.21.15.123:0/408305134 learned_addr learned my addr 172.21.15.123:0/408305134 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:12.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.627+0000 7f29f3fff640 1 --2- 172.21.15.123:0/408305134 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f29f413eb20 0x7f29f40cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:12.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.627+0000 7f29f37fe640 1 --2- 172.21.15.123:0/408305134 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f29f406c320 0x7f29f4154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:12.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.627+0000 7f29f2ffd640 1 -- 172.21.15.123:0/408305134 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f29f413eb20 msgr2=0x7f29f40cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:12.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.627+0000 7f29f2ffd640 1 --2- 172.21.15.123:0/408305134 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f29f413eb20 0x7f29f40cf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:12.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.627+0000 7f29f2ffd640 1 -- 172.21.15.123:0/408305134 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f29f406c320 msgr2=0x7f29f4154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:12.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.627+0000 7f29f2ffd640 1 --2- 172.21.15.123:0/408305134 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f29f406c320 0x7f29f4154d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:12.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.627+0000 7f29f2ffd640 1 -- 172.21.15.123:0/408305134 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f413d1a0 con 0x7f29f40b2d40 2024-09-15T23:23:12.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.627+0000 7f29f37fe640 1 --2- 172.21.15.123:0/408305134 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f29f406c320 0x7f29f4154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:23:12.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.627+0000 7f29f2ffd640 1 --2- 172.21.15.123:0/408305134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29f40b2d40 0x7f29f4136140 secure :-1 s=READY pgs=2234 cs=0 l=1 rev1=1 crypto rx=0x7f29e800c4a0 tx=0x7f29e800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:12.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.628+0000 7f29dbfff640 1 -- 172.21.15.123:0/408305134 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e8018070 con 0x7f29f40b2d40 2024-09-15T23:23:12.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.628+0000 7f29dbfff640 1 -- 172.21.15.123:0/408305134 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29e80074e0 con 0x7f29f40b2d40 2024-09-15T23:23:12.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.628+0000 7f29dbfff640 1 -- 172.21.15.123:0/408305134 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e8004a20 con 0x7f29f40b2d40 2024-09-15T23:23:12.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.628+0000 7f29f9c23640 1 -- 172.21.15.123:0/408305134 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29f4135050 con 0x7f29f40b2d40 2024-09-15T23:23:12.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.628+0000 7f29f9c23640 1 -- 172.21.15.123:0/408305134 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29f4135610 con 0x7f29f40b2d40 2024-09-15T23:23:12.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.629+0000 7f29f9c23640 1 -- 172.21.15.123:0/408305134 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29f413d370 con 0x7f29f40b2d40 2024-09-15T23:23:12.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.629+0000 7f29dbfff640 1 -- 172.21.15.123:0/408305134 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f29e801b070 con 0x7f29f40b2d40 2024-09-15T23:23:12.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.630+0000 7f29dbfff640 1 --2- 172.21.15.123:0/408305134 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f29e006c2b0 0x7f29e006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:12.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.630+0000 7f29dbfff640 1 -- 172.21.15.123:0/408305134 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7f29e808a730 con 0x7f29f40b2d40 2024-09-15T23:23:12.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.630+0000 7f29f37fe640 1 --2- 172.21.15.123:0/408305134 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f29e006c2b0 0x7f29e006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:12.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.630+0000 7f29f37fe640 1 --2- 172.21.15.123:0/408305134 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f29e006c2b0 0x7f29e006e770 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f29f4155e70 tx=0x7f29e4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:12.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.634+0000 7f29dbfff640 1 -- 172.21.15.123:0/408305134 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f29e8058ea0 con 0x7f29f40b2d40 2024-09-15T23:23:12.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.795+0000 7f29f9c23640 1 -- 172.21.15.123:0/408305134 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f29f413f000 con 0x7f29e006c2b0 2024-09-15T23:23:12.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.801+0000 7f29dbfff640 1 -- 172.21.15.123:0/408305134 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246982 (secure 0 0 0) 0x7f29f413f000 con 0x7f29e006c2b0 2024-09-15T23:23:12.805 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:23:12.807 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:23:12.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.804+0000 7f29f9c23640 1 -- 172.21.15.123:0/408305134 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f29e006c2b0 msgr2=0x7f29e006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:12.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.804+0000 7f29f9c23640 1 --2- 172.21.15.123:0/408305134 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f29e006c2b0 0x7f29e006e770 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f29f4155e70 tx=0x7f29e4009040 comp rx=0 tx=0).stop 2024-09-15T23:23:12.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.804+0000 7f29f9c23640 1 -- 172.21.15.123:0/408305134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29f40b2d40 msgr2=0x7f29f4136140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:12.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.804+0000 7f29f9c23640 1 --2- 172.21.15.123:0/408305134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29f40b2d40 0x7f29f4136140 secure :-1 s=READY pgs=2234 cs=0 l=1 rev1=1 crypto rx=0x7f29e800c4a0 tx=0x7f29e800c960 comp rx=0 tx=0).stop 2024-09-15T23:23:12.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.804+0000 7f29f9c23640 1 -- 172.21.15.123:0/408305134 shutdown_connections 2024-09-15T23:23:12.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.804+0000 7f29f9c23640 1 --2- 172.21.15.123:0/408305134 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f29f413eb20 0x7f29f40cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:12.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.804+0000 7f29f9c23640 1 --2- 172.21.15.123:0/408305134 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f29e006c2b0 0x7f29e006e770 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:12.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.804+0000 7f29f9c23640 1 --2- 172.21.15.123:0/408305134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29f40b2d40 0x7f29f4136140 unknown :-1 s=CLOSED pgs=2234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:12.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.804+0000 7f29f9c23640 1 --2- 172.21.15.123:0/408305134 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f29f406c320 0x7f29f4154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:12.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.804+0000 7f29f9c23640 1 -- 172.21.15.123:0/408305134 >> 172.21.15.123:0/408305134 conn(0x7f29f40ccec0 msgr2=0x7f29f40b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:12.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.804+0000 7f29f9c23640 1 -- 172.21.15.123:0/408305134 shutdown_connections 2024-09-15T23:23:12.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.804+0000 7f29f9c23640 1 -- 172.21.15.123:0/408305134 wait complete. 2024-09-15T23:23:12.816 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":522,"stamp":"2024-09-15T23:23:11.659727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590550,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":184,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":138,"acting":138,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":451376,"kb_used_data":19996,"kb_used_omap":12,"kb_used_meta":431155,"kb_avail":754523344,"statfs":{"total":773094113280,"available":772631904256,"internally_reserved":0,"allocated":20475904,"data_stored":9708825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":441503280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":182,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000842"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389542+0000","last_change":"2024-09-15T23:23:09.896392+0000","last_active":"2024-09-15T23:23:11.389542+0000","last_peered":"2024-09-15T23:23:11.389542+0000","last_clean":"2024-09-15T23:23:11.389542+0000","last_became_active":"2024-09-15T23:23:09.896113+0000","last_became_peered":"2024-09-15T23:23:09.896113+0000","last_unstale":"2024-09-15T23:23:11.389542+0000","last_undegraded":"2024-09-15T23:23:11.389542+0000","last_fullsized":"2024-09-15T23:23:11.389542+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:42.157923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878505+0000","last_change":"2024-09-15T23:23:09.890448+0000","last_active":"2024-09-15T23:23:10.878505+0000","last_peered":"2024-09-15T23:23:10.878505+0000","last_clean":"2024-09-15T23:23:10.878505+0000","last_became_active":"2024-09-15T23:23:09.890146+0000","last_became_peered":"2024-09-15T23:23:09.890146+0000","last_unstale":"2024-09-15T23:23:10.878505+0000","last_undegraded":"2024-09-15T23:23:10.878505+0000","last_fullsized":"2024-09-15T23:23:10.878505+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:10.381055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.879038+0000","last_change":"2024-09-15T23:23:09.893118+0000","last_active":"2024-09-15T23:23:10.879038+0000","last_peered":"2024-09-15T23:23:10.879038+0000","last_clean":"2024-09-15T23:23:10.879038+0000","last_became_active":"2024-09-15T23:23:09.892821+0000","last_became_peered":"2024-09-15T23:23:09.892821+0000","last_unstale":"2024-09-15T23:23:10.879038+0000","last_undegraded":"2024-09-15T23:23:10.879038+0000","last_fullsized":"2024-09-15T23:23:10.879038+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:49.942314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389282+0000","last_change":"2024-09-15T23:23:09.898540+0000","last_active":"2024-09-15T23:23:11.389282+0000","last_peered":"2024-09-15T23:23:11.389282+0000","last_clean":"2024-09-15T23:23:11.389282+0000","last_became_active":"2024-09-15T23:23:09.898254+0000","last_became_peered":"2024-09-15T23:23:09.898254+0000","last_unstale":"2024-09-15T23:23:11.389282+0000","last_undegraded":"2024-09-15T23:23:11.389282+0000","last_fullsized":"2024-09-15T23:23:11.389282+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:41.394415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389205+0000","last_change":"2024-09-15T23:23:09.897940+0000","last_active":"2024-09-15T23:23:11.389205+0000","last_peered":"2024-09-15T23:23:11.389205+0000","last_clean":"2024-09-15T23:23:11.389205+0000","last_became_active":"2024-09-15T23:23:09.897615+0000","last_became_peered":"2024-09-15T23:23:09.897615+0000","last_unstale":"2024-09-15T23:23:11.389205+0000","last_undegraded":"2024-09-15T23:23:11.389205+0000","last_fullsized":"2024-09-15T23:23:11.389205+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:31:06.944151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.877651+0000","last_change":"2024-09-15T23:23:09.898922+0000","last_active":"2024-09-15T23:23:10.877651+0000","last_peered":"2024-09-15T23:23:10.877651+0000","last_clean":"2024-09-15T23:23:10.877651+0000","last_became_active":"2024-09-15T23:23:09.898387+0000","last_became_peered":"2024-09-15T23:23:09.898387+0000","last_unstale":"2024-09-15T23:23:10.877651+0000","last_undegraded":"2024-09-15T23:23:10.877651+0000","last_fullsized":"2024-09-15T23:23:10.877651+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:16.268734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.877907+0000","last_change":"2024-09-15T23:23:09.894886+0000","last_active":"2024-09-15T23:23:10.877907+0000","last_peered":"2024-09-15T23:23:10.877907+0000","last_clean":"2024-09-15T23:23:10.877907+0000","last_became_active":"2024-09-15T23:23:09.894452+0000","last_became_peered":"2024-09-15T23:23:09.894452+0000","last_unstale":"2024-09-15T23:23:10.877907+0000","last_undegraded":"2024-09-15T23:23:10.877907+0000","last_fullsized":"2024-09-15T23:23:10.877907+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:16.788699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389717+0000","last_change":"2024-09-15T23:23:09.892595+0000","last_active":"2024-09-15T23:23:11.389717+0000","last_peered":"2024-09-15T23:23:11.389717+0000","last_clean":"2024-09-15T23:23:11.389717+0000","last_became_active":"2024-09-15T23:23:09.892325+0000","last_became_peered":"2024-09-15T23:23:09.892325+0000","last_unstale":"2024-09-15T23:23:11.389717+0000","last_undegraded":"2024-09-15T23:23:11.389717+0000","last_fullsized":"2024-09-15T23:23:11.389717+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:17.682368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388886+0000","last_change":"2024-09-15T23:23:09.886114+0000","last_active":"2024-09-15T23:23:11.388886+0000","last_peered":"2024-09-15T23:23:11.388886+0000","last_clean":"2024-09-15T23:23:11.388886+0000","last_became_active":"2024-09-15T23:23:09.885637+0000","last_became_peered":"2024-09-15T23:23:09.885637+0000","last_unstale":"2024-09-15T23:23:11.388886+0000","last_undegraded":"2024-09-15T23:23:11.388886+0000","last_fullsized":"2024-09-15T23:23:11.388886+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:49.942314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389344+0000","last_change":"2024-09-15T23:23:09.891894+0000","last_active":"2024-09-15T23:23:11.389344+0000","last_peered":"2024-09-15T23:23:11.389344+0000","last_clean":"2024-09-15T23:23:11.389344+0000","last_became_active":"2024-09-15T23:23:09.891392+0000","last_became_peered":"2024-09-15T23:23:09.891392+0000","last_unstale":"2024-09-15T23:23:11.389344+0000","last_undegraded":"2024-09-15T23:23:11.389344+0000","last_fullsized":"2024-09-15T23:23:11.389344+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:35.402255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389097+0000","last_change":"2024-09-15T23:23:09.895144+0000","last_active":"2024-09-15T23:23:11.389097+0000","last_peered":"2024-09-15T23:23:11.389097+0000","last_clean":"2024-09-15T23:23:11.389097+0000","last_became_active":"2024-09-15T23:23:09.894871+0000","last_became_peered":"2024-09-15T23:23:09.894871+0000","last_unstale":"2024-09-15T23:23:11.389097+0000","last_undegraded":"2024-09-15T23:23:11.389097+0000","last_fullsized":"2024-09-15T23:23:11.389097+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:49:41.077299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389677+0000","last_change":"2024-09-15T23:23:09.888650+0000","last_active":"2024-09-15T23:23:11.389677+0000","last_peered":"2024-09-15T23:23:11.389677+0000","last_clean":"2024-09-15T23:23:11.389677+0000","last_became_active":"2024-09-15T23:23:09.888057+0000","last_became_peered":"2024-09-15T23:23:09.888057+0000","last_unstale":"2024-09-15T23:23:11.389677+0000","last_undegraded":"2024-09-15T23:23:11.389677+0000","last_fullsized":"2024-09-15T23:23:11.389677+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:07.797869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878074+0000","last_change":"2024-09-15T23:23:09.892556+0000","last_active":"2024-09-15T23:23:10.878074+0000","last_peered":"2024-09-15T23:23:10.878074+0000","last_clean":"2024-09-15T23:23:10.878074+0000","last_became_active":"2024-09-15T23:23:09.892282+0000","last_became_peered":"2024-09-15T23:23:09.892282+0000","last_unstale":"2024-09-15T23:23:10.878074+0000","last_undegraded":"2024-09-15T23:23:10.878074+0000","last_fullsized":"2024-09-15T23:23:10.878074+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:17.364225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878678+0000","last_change":"2024-09-15T23:23:09.888937+0000","last_active":"2024-09-15T23:23:10.878678+0000","last_peered":"2024-09-15T23:23:10.878678+0000","last_clean":"2024-09-15T23:23:10.878678+0000","last_became_active":"2024-09-15T23:23:09.888173+0000","last_became_peered":"2024-09-15T23:23:09.888173+0000","last_unstale":"2024-09-15T23:23:10.878678+0000","last_undegraded":"2024-09-15T23:23:10.878678+0000","last_fullsized":"2024-09-15T23:23:10.878678+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:55:42.187292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878432+0000","last_change":"2024-09-15T23:23:09.884518+0000","last_active":"2024-09-15T23:23:10.878432+0000","last_peered":"2024-09-15T23:23:10.878432+0000","last_clean":"2024-09-15T23:23:10.878432+0000","last_became_active":"2024-09-15T23:23:09.884229+0000","last_became_peered":"2024-09-15T23:23:09.884229+0000","last_unstale":"2024-09-15T23:23:10.878432+0000","last_undegraded":"2024-09-15T23:23:10.878432+0000","last_fullsized":"2024-09-15T23:23:10.878432+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:07.994162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.879088+0000","last_change":"2024-09-15T23:23:09.885890+0000","last_active":"2024-09-15T23:23:10.879088+0000","last_peered":"2024-09-15T23:23:10.879088+0000","last_clean":"2024-09-15T23:23:10.879088+0000","last_became_active":"2024-09-15T23:23:09.885585+0000","last_became_peered":"2024-09-15T23:23:09.885585+0000","last_unstale":"2024-09-15T23:23:10.879088+0000","last_undegraded":"2024-09-15T23:23:10.879088+0000","last_fullsized":"2024-09-15T23:23:10.879088+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:12.472633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878586+0000","last_change":"2024-09-15T23:23:09.889164+0000","last_active":"2024-09-15T23:23:10.878586+0000","last_peered":"2024-09-15T23:23:10.878586+0000","last_clean":"2024-09-15T23:23:10.878586+0000","last_became_active":"2024-09-15T23:23:09.888868+0000","last_became_peered":"2024-09-15T23:23:09.888868+0000","last_unstale":"2024-09-15T23:23:10.878586+0000","last_undegraded":"2024-09-15T23:23:10.878586+0000","last_fullsized":"2024-09-15T23:23:10.878586+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:12:17.516107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878136+0000","last_change":"2024-09-15T23:23:09.884750+0000","last_active":"2024-09-15T23:23:10.878136+0000","last_peered":"2024-09-15T23:23:10.878136+0000","last_clean":"2024-09-15T23:23:10.878136+0000","last_became_active":"2024-09-15T23:23:09.884395+0000","last_became_peered":"2024-09-15T23:23:09.884395+0000","last_unstale":"2024-09-15T23:23:10.878136+0000","last_undegraded":"2024-09-15T23:23:10.878136+0000","last_fullsized":"2024-09-15T23:23:10.878136+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:45.924003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388853+0000","last_change":"2024-09-15T23:23:09.889967+0000","last_active":"2024-09-15T23:23:11.388853+0000","last_peered":"2024-09-15T23:23:11.388853+0000","last_clean":"2024-09-15T23:23:11.388853+0000","last_became_active":"2024-09-15T23:23:09.889690+0000","last_became_peered":"2024-09-15T23:23:09.889690+0000","last_unstale":"2024-09-15T23:23:11.388853+0000","last_undegraded":"2024-09-15T23:23:11.388853+0000","last_fullsized":"2024-09-15T23:23:11.388853+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:52.863778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.867875+0000","last_change":"2024-09-15T23:23:07.867875+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.867875+0000","last_undegraded":"2024-09-15T23:23:07.867875+0000","last_fullsized":"2024-09-15T23:23:07.867875+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.865671+0000","last_change":"2024-09-15T23:23:07.865671+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.865671+0000","last_undegraded":"2024-09-15T23:23:07.865671+0000","last_fullsized":"2024-09-15T23:23:07.865671+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878490+0000","last_change":"2024-09-15T23:23:09.893191+0000","last_active":"2024-09-15T23:23:10.878490+0000","last_peered":"2024-09-15T23:23:10.878490+0000","last_clean":"2024-09-15T23:23:10.878490+0000","last_became_active":"2024-09-15T23:23:09.892564+0000","last_became_peered":"2024-09-15T23:23:09.892564+0000","last_unstale":"2024-09-15T23:23:10.878490+0000","last_undegraded":"2024-09-15T23:23:10.878490+0000","last_fullsized":"2024-09-15T23:23:10.878490+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:43:10.307662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1d","version":"193'2","reported_seq":16,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.879004+0000","last_change":"2024-09-15T23:23:08.883380+0000","last_active":"2024-09-15T23:23:10.879004+0000","last_peered":"2024-09-15T23:23:10.879004+0000","last_clean":"2024-09-15T23:23:10.879004+0000","last_became_active":"2024-09-15T23:23:08.883076+0000","last_became_peered":"2024-09-15T23:23:08.883076+0000","last_unstale":"2024-09-15T23:23:10.879004+0000","last_undegraded":"2024-09-15T23:23:10.879004+0000","last_fullsized":"2024-09-15T23:23:10.879004+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:41.150625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878773+0000","last_change":"2024-09-15T23:23:09.889863+0000","last_active":"2024-09-15T23:23:10.878773+0000","last_peered":"2024-09-15T23:23:10.878773+0000","last_clean":"2024-09-15T23:23:10.878773+0000","last_became_active":"2024-09-15T23:23:09.889275+0000","last_became_peered":"2024-09-15T23:23:09.889275+0000","last_unstale":"2024-09-15T23:23:10.878773+0000","last_undegraded":"2024-09-15T23:23:10.878773+0000","last_fullsized":"2024-09-15T23:23:10.878773+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:48.682646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.866154+0000","last_change":"2024-09-15T23:23:07.866154+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.866154+0000","last_undegraded":"2024-09-15T23:23:07.866154+0000","last_fullsized":"2024-09-15T23:23:07.866154+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1a","version":"193'1","reported_seq":15,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389577+0000","last_change":"2024-09-15T23:23:08.884833+0000","last_active":"2024-09-15T23:23:11.389577+0000","last_peered":"2024-09-15T23:23:11.389577+0000","last_clean":"2024-09-15T23:23:11.389577+0000","last_became_active":"2024-09-15T23:23:08.884446+0000","last_became_peered":"2024-09-15T23:23:08.884446+0000","last_unstale":"2024-09-15T23:23:11.389577+0000","last_undegraded":"2024-09-15T23:23:11.389577+0000","last_fullsized":"2024-09-15T23:23:11.389577+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:25:43.826245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389249+0000","last_change":"2024-09-15T23:23:09.887857+0000","last_active":"2024-09-15T23:23:11.389249+0000","last_peered":"2024-09-15T23:23:11.389249+0000","last_clean":"2024-09-15T23:23:11.389249+0000","last_became_active":"2024-09-15T23:23:09.887005+0000","last_became_peered":"2024-09-15T23:23:09.887005+0000","last_unstale":"2024-09-15T23:23:11.389249+0000","last_undegraded":"2024-09-15T23:23:11.389249+0000","last_fullsized":"2024-09-15T23:23:11.389249+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:13.448014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878250+0000","last_change":"2024-09-15T23:23:08.887529+0000","last_active":"2024-09-15T23:23:10.878250+0000","last_peered":"2024-09-15T23:23:10.878250+0000","last_clean":"2024-09-15T23:23:10.878250+0000","last_became_active":"2024-09-15T23:23:08.887256+0000","last_became_peered":"2024-09-15T23:23:08.887256+0000","last_unstale":"2024-09-15T23:23:10.878250+0000","last_undegraded":"2024-09-15T23:23:10.878250+0000","last_fullsized":"2024-09-15T23:23:10.878250+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:34.394956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.866068+0000","last_change":"2024-09-15T23:23:07.866068+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.866068+0000","last_undegraded":"2024-09-15T23:23:07.866068+0000","last_fullsized":"2024-09-15T23:23:07.866068+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878930+0000","last_change":"2024-09-15T23:23:08.882342+0000","last_active":"2024-09-15T23:23:10.878930+0000","last_peered":"2024-09-15T23:23:10.878930+0000","last_clean":"2024-09-15T23:23:10.878930+0000","last_became_active":"2024-09-15T23:23:08.882046+0000","last_became_peered":"2024-09-15T23:23:08.882046+0000","last_unstale":"2024-09-15T23:23:10.878930+0000","last_undegraded":"2024-09-15T23:23:10.878930+0000","last_fullsized":"2024-09-15T23:23:10.878930+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:46.966470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388963+0000","last_change":"2024-09-15T23:23:09.887039+0000","last_active":"2024-09-15T23:23:11.388963+0000","last_peered":"2024-09-15T23:23:11.388963+0000","last_clean":"2024-09-15T23:23:11.388963+0000","last_became_active":"2024-09-15T23:23:09.886178+0000","last_became_peered":"2024-09-15T23:23:09.886178+0000","last_unstale":"2024-09-15T23:23:11.388963+0000","last_undegraded":"2024-09-15T23:23:11.388963+0000","last_fullsized":"2024-09-15T23:23:11.388963+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:24.942591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.865590+0000","last_change":"2024-09-15T23:23:07.865590+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.865590+0000","last_undegraded":"2024-09-15T23:23:07.865590+0000","last_fullsized":"2024-09-15T23:23:07.865590+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.15","version":"193'3","reported_seq":17,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.879081+0000","last_change":"2024-09-15T23:23:08.888755+0000","last_active":"2024-09-15T23:23:10.879081+0000","last_peered":"2024-09-15T23:23:10.879081+0000","last_clean":"2024-09-15T23:23:10.879081+0000","last_became_active":"2024-09-15T23:23:08.888250+0000","last_became_peered":"2024-09-15T23:23:08.888250+0000","last_unstale":"2024-09-15T23:23:10.879081+0000","last_undegraded":"2024-09-15T23:23:10.879081+0000","last_fullsized":"2024-09-15T23:23:10.879081+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:08.440981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878357+0000","last_change":"2024-09-15T23:23:09.881198+0000","last_active":"2024-09-15T23:23:10.878357+0000","last_peered":"2024-09-15T23:23:10.878357+0000","last_clean":"2024-09-15T23:23:10.878357+0000","last_became_active":"2024-09-15T23:23:09.880910+0000","last_became_peered":"2024-09-15T23:23:09.880910+0000","last_unstale":"2024-09-15T23:23:10.878357+0000","last_undegraded":"2024-09-15T23:23:10.878357+0000","last_fullsized":"2024-09-15T23:23:10.878357+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:53:34.689769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.867069+0000","last_change":"2024-09-15T23:23:07.867069+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.867069+0000","last_undegraded":"2024-09-15T23:23:07.867069+0000","last_fullsized":"2024-09-15T23:23:07.867069+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388862+0000","last_change":"2024-09-15T23:23:09.890661+0000","last_active":"2024-09-15T23:23:11.388862+0000","last_peered":"2024-09-15T23:23:11.388862+0000","last_clean":"2024-09-15T23:23:11.388862+0000","last_became_active":"2024-09-15T23:23:09.890390+0000","last_became_peered":"2024-09-15T23:23:09.890390+0000","last_unstale":"2024-09-15T23:23:11.388862+0000","last_undegraded":"2024-09-15T23:23:11.388862+0000","last_fullsized":"2024-09-15T23:23:11.388862+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:48.682646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.867063+0000","last_change":"2024-09-15T23:23:07.867063+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.867063+0000","last_undegraded":"2024-09-15T23:23:07.867063+0000","last_fullsized":"2024-09-15T23:23:07.867063+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.879038+0000","last_change":"2024-09-15T23:23:09.890142+0000","last_active":"2024-09-15T23:23:10.879038+0000","last_peered":"2024-09-15T23:23:10.879038+0000","last_clean":"2024-09-15T23:23:10.879038+0000","last_became_active":"2024-09-15T23:23:09.889857+0000","last_became_peered":"2024-09-15T23:23:09.889857+0000","last_unstale":"2024-09-15T23:23:10.879038+0000","last_undegraded":"2024-09-15T23:23:10.879038+0000","last_fullsized":"2024-09-15T23:23:10.879038+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:24.942591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.865223+0000","last_change":"2024-09-15T23:23:07.865223+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.865223+0000","last_undegraded":"2024-09-15T23:23:07.865223+0000","last_fullsized":"2024-09-15T23:23:07.865223+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.877739+0000","last_change":"2024-09-15T23:23:09.894373+0000","last_active":"2024-09-15T23:23:10.877739+0000","last_peered":"2024-09-15T23:23:10.877739+0000","last_clean":"2024-09-15T23:23:10.877739+0000","last_became_active":"2024-09-15T23:23:09.894027+0000","last_became_peered":"2024-09-15T23:23:09.894027+0000","last_unstale":"2024-09-15T23:23:10.877739+0000","last_undegraded":"2024-09-15T23:23:10.877739+0000","last_fullsized":"2024-09-15T23:23:10.877739+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:05:43.347414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878324+0000","last_change":"2024-09-15T23:23:08.883287+0000","last_active":"2024-09-15T23:23:10.878324+0000","last_peered":"2024-09-15T23:23:10.878324+0000","last_clean":"2024-09-15T23:23:10.878324+0000","last_became_active":"2024-09-15T23:23:08.882904+0000","last_became_peered":"2024-09-15T23:23:08.882904+0000","last_unstale":"2024-09-15T23:23:10.878324+0000","last_undegraded":"2024-09-15T23:23:10.878324+0000","last_fullsized":"2024-09-15T23:23:10.878324+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:34:43.070529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389575+0000","last_change":"2024-09-15T23:23:09.887792+0000","last_active":"2024-09-15T23:23:11.389575+0000","last_peered":"2024-09-15T23:23:11.389575+0000","last_clean":"2024-09-15T23:23:11.389575+0000","last_became_active":"2024-09-15T23:23:09.887392+0000","last_became_peered":"2024-09-15T23:23:09.887392+0000","last_unstale":"2024-09-15T23:23:11.389575+0000","last_undegraded":"2024-09-15T23:23:11.389575+0000","last_fullsized":"2024-09-15T23:23:11.389575+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:09.448279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.10","version":"193'8","reported_seq":22,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878455+0000","last_change":"2024-09-15T23:23:08.880773+0000","last_active":"2024-09-15T23:23:10.878455+0000","last_peered":"2024-09-15T23:23:10.878455+0000","last_clean":"2024-09-15T23:23:10.878455+0000","last_became_active":"2024-09-15T23:23:08.880261+0000","last_became_peered":"2024-09-15T23:23:08.880261+0000","last_unstale":"2024-09-15T23:23:10.878455+0000","last_undegraded":"2024-09-15T23:23:10.878455+0000","last_fullsized":"2024-09-15T23:23:10.878455+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:32.801604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.f","version":"193'1","reported_seq":15,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389869+0000","last_change":"2024-09-15T23:23:08.887550+0000","last_active":"2024-09-15T23:23:11.389869+0000","last_peered":"2024-09-15T23:23:11.389869+0000","last_clean":"2024-09-15T23:23:11.389869+0000","last_became_active":"2024-09-15T23:23:08.887255+0000","last_became_peered":"2024-09-15T23:23:08.887255+0000","last_unstale":"2024-09-15T23:23:11.389869+0000","last_undegraded":"2024-09-15T23:23:11.389869+0000","last_fullsized":"2024-09-15T23:23:11.389869+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:56.677486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.867227+0000","last_change":"2024-09-15T23:23:07.867227+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.867227+0000","last_undegraded":"2024-09-15T23:23:07.867227+0000","last_fullsized":"2024-09-15T23:23:07.867227+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878585+0000","last_change":"2024-09-15T23:23:09.893387+0000","last_active":"2024-09-15T23:23:10.878585+0000","last_peered":"2024-09-15T23:23:10.878585+0000","last_clean":"2024-09-15T23:23:10.878585+0000","last_became_active":"2024-09-15T23:23:09.892927+0000","last_became_peered":"2024-09-15T23:23:09.892927+0000","last_unstale":"2024-09-15T23:23:10.878585+0000","last_undegraded":"2024-09-15T23:23:10.878585+0000","last_fullsized":"2024-09-15T23:23:10.878585+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:56.972413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.d","version":"193'1","reported_seq":15,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389475+0000","last_change":"2024-09-15T23:23:08.880228+0000","last_active":"2024-09-15T23:23:11.389475+0000","last_peered":"2024-09-15T23:23:11.389475+0000","last_clean":"2024-09-15T23:23:11.389475+0000","last_became_active":"2024-09-15T23:23:08.879937+0000","last_became_peered":"2024-09-15T23:23:08.879937+0000","last_unstale":"2024-09-15T23:23:11.389475+0000","last_undegraded":"2024-09-15T23:23:11.389475+0000","last_fullsized":"2024-09-15T23:23:11.389475+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:06.986864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389822+0000","last_change":"2024-09-15T23:23:09.900172+0000","last_active":"2024-09-15T23:23:11.389822+0000","last_peered":"2024-09-15T23:23:11.389822+0000","last_clean":"2024-09-15T23:23:11.389822+0000","last_became_active":"2024-09-15T23:23:09.899812+0000","last_became_peered":"2024-09-15T23:23:09.899812+0000","last_unstale":"2024-09-15T23:23:11.389822+0000","last_undegraded":"2024-09-15T23:23:11.389822+0000","last_fullsized":"2024-09-15T23:23:11.389822+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:48:35.079778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389230+0000","last_change":"2024-09-15T23:23:08.884635+0000","last_active":"2024-09-15T23:23:11.389230+0000","last_peered":"2024-09-15T23:23:11.389230+0000","last_clean":"2024-09-15T23:23:11.389230+0000","last_became_active":"2024-09-15T23:23:08.884343+0000","last_became_peered":"2024-09-15T23:23:08.884343+0000","last_unstale":"2024-09-15T23:23:11.389230+0000","last_undegraded":"2024-09-15T23:23:11.389230+0000","last_fullsized":"2024-09-15T23:23:11.389230+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:28.713430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.877765+0000","last_change":"2024-09-15T23:23:09.896745+0000","last_active":"2024-09-15T23:23:10.877765+0000","last_peered":"2024-09-15T23:23:10.877765+0000","last_clean":"2024-09-15T23:23:10.877765+0000","last_became_active":"2024-09-15T23:23:09.895939+0000","last_became_peered":"2024-09-15T23:23:09.895939+0000","last_unstale":"2024-09-15T23:23:10.877765+0000","last_undegraded":"2024-09-15T23:23:10.877765+0000","last_fullsized":"2024-09-15T23:23:10.877765+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:27.624450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.b","version":"193'2","reported_seq":16,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388819+0000","last_change":"2024-09-15T23:23:08.881657+0000","last_active":"2024-09-15T23:23:11.388819+0000","last_peered":"2024-09-15T23:23:11.388819+0000","last_clean":"2024-09-15T23:23:11.388819+0000","last_became_active":"2024-09-15T23:23:08.881338+0000","last_became_peered":"2024-09-15T23:23:08.881338+0000","last_unstale":"2024-09-15T23:23:11.388819+0000","last_undegraded":"2024-09-15T23:23:11.388819+0000","last_fullsized":"2024-09-15T23:23:11.388819+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:44.916704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389406+0000","last_change":"2024-09-15T23:23:09.899726+0000","last_active":"2024-09-15T23:23:11.389406+0000","last_peered":"2024-09-15T23:23:11.389406+0000","last_clean":"2024-09-15T23:23:11.389406+0000","last_became_active":"2024-09-15T23:23:09.898418+0000","last_became_peered":"2024-09-15T23:23:09.898418+0000","last_unstale":"2024-09-15T23:23:11.389406+0000","last_undegraded":"2024-09-15T23:23:11.389406+0000","last_fullsized":"2024-09-15T23:23:11.389406+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:58.508749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878430+0000","last_change":"2024-09-15T23:23:08.885820+0000","last_active":"2024-09-15T23:23:10.878430+0000","last_peered":"2024-09-15T23:23:10.878430+0000","last_clean":"2024-09-15T23:23:10.878430+0000","last_became_active":"2024-09-15T23:23:08.885545+0000","last_became_peered":"2024-09-15T23:23:08.885545+0000","last_unstale":"2024-09-15T23:23:10.878430+0000","last_undegraded":"2024-09-15T23:23:10.878430+0000","last_fullsized":"2024-09-15T23:23:10.878430+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:06.790571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878190+0000","last_change":"2024-09-15T23:23:08.886258+0000","last_active":"2024-09-15T23:23:10.878190+0000","last_peered":"2024-09-15T23:23:10.878190+0000","last_clean":"2024-09-15T23:23:10.878190+0000","last_became_active":"2024-09-15T23:23:08.884216+0000","last_became_peered":"2024-09-15T23:23:08.884216+0000","last_unstale":"2024-09-15T23:23:10.878190+0000","last_undegraded":"2024-09-15T23:23:10.878190+0000","last_fullsized":"2024-09-15T23:23:10.878190+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:39.101978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878528+0000","last_change":"2024-09-15T23:23:08.889246+0000","last_active":"2024-09-15T23:23:10.878528+0000","last_peered":"2024-09-15T23:23:10.878528+0000","last_clean":"2024-09-15T23:23:10.878528+0000","last_became_active":"2024-09-15T23:23:08.888672+0000","last_became_peered":"2024-09-15T23:23:08.888672+0000","last_unstale":"2024-09-15T23:23:10.878528+0000","last_undegraded":"2024-09-15T23:23:10.878528+0000","last_fullsized":"2024-09-15T23:23:10.878528+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:16.675069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.7","version":"193'2","reported_seq":16,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878776+0000","last_change":"2024-09-15T23:23:08.881862+0000","last_active":"2024-09-15T23:23:10.878776+0000","last_peered":"2024-09-15T23:23:10.878776+0000","last_clean":"2024-09-15T23:23:10.878776+0000","last_became_active":"2024-09-15T23:23:08.881581+0000","last_became_peered":"2024-09-15T23:23:08.881581+0000","last_unstale":"2024-09-15T23:23:10.878776+0000","last_undegraded":"2024-09-15T23:23:10.878776+0000","last_fullsized":"2024-09-15T23:23:10.878776+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:57.501450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389734+0000","last_change":"2024-09-15T23:23:09.888350+0000","last_active":"2024-09-15T23:23:11.389734+0000","last_peered":"2024-09-15T23:23:11.389734+0000","last_clean":"2024-09-15T23:23:11.389734+0000","last_became_active":"2024-09-15T23:23:09.887980+0000","last_became_peered":"2024-09-15T23:23:09.887980+0000","last_unstale":"2024-09-15T23:23:11.389734+0000","last_undegraded":"2024-09-15T23:23:11.389734+0000","last_fullsized":"2024-09-15T23:23:11.389734+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:33.808903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.865216+0000","last_change":"2024-09-15T23:23:07.865216+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.865216+0000","last_undegraded":"2024-09-15T23:23:07.865216+0000","last_fullsized":"2024-09-15T23:23:07.865216+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389860+0000","last_change":"2024-09-15T23:23:08.885600+0000","last_active":"2024-09-15T23:23:11.389860+0000","last_peered":"2024-09-15T23:23:11.389860+0000","last_clean":"2024-09-15T23:23:11.389860+0000","last_became_active":"2024-09-15T23:23:08.885248+0000","last_became_peered":"2024-09-15T23:23:08.885248+0000","last_unstale":"2024-09-15T23:23:11.389860+0000","last_undegraded":"2024-09-15T23:23:11.389860+0000","last_fullsized":"2024-09-15T23:23:11.389860+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:18:41.964218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389195+0000","last_change":"2024-09-15T23:23:08.887072+0000","last_active":"2024-09-15T23:23:11.389195+0000","last_peered":"2024-09-15T23:23:11.389195+0000","last_clean":"2024-09-15T23:23:11.389195+0000","last_became_active":"2024-09-15T23:23:08.886725+0000","last_became_peered":"2024-09-15T23:23:08.886725+0000","last_unstale":"2024-09-15T23:23:11.389195+0000","last_undegraded":"2024-09-15T23:23:11.389195+0000","last_fullsized":"2024-09-15T23:23:11.389195+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:45:01.490349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389480+0000","last_change":"2024-09-15T23:23:09.898656+0000","last_active":"2024-09-15T23:23:11.389480+0000","last_peered":"2024-09-15T23:23:11.389480+0000","last_clean":"2024-09-15T23:23:11.389480+0000","last_became_active":"2024-09-15T23:23:09.898380+0000","last_became_peered":"2024-09-15T23:23:09.898380+0000","last_unstale":"2024-09-15T23:23:11.389480+0000","last_undegraded":"2024-09-15T23:23:11.389480+0000","last_fullsized":"2024-09-15T23:23:11.389480+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:34:44.077827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.865565+0000","last_change":"2024-09-15T23:23:07.865565+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.865565+0000","last_undegraded":"2024-09-15T23:23:07.865565+0000","last_fullsized":"2024-09-15T23:23:07.865565+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.877954+0000","last_change":"2024-09-15T23:23:08.889390+0000","last_active":"2024-09-15T23:23:10.877954+0000","last_peered":"2024-09-15T23:23:10.877954+0000","last_clean":"2024-09-15T23:23:10.877954+0000","last_became_active":"2024-09-15T23:23:08.889130+0000","last_became_peered":"2024-09-15T23:23:08.889130+0000","last_unstale":"2024-09-15T23:23:10.877954+0000","last_undegraded":"2024-09-15T23:23:10.877954+0000","last_fullsized":"2024-09-15T23:23:10.877954+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:00:26.192065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878132+0000","last_change":"2024-09-15T23:23:09.887444+0000","last_active":"2024-09-15T23:23:10.878132+0000","last_peered":"2024-09-15T23:23:10.878132+0000","last_clean":"2024-09-15T23:23:10.878132+0000","last_became_active":"2024-09-15T23:23:09.887177+0000","last_became_peered":"2024-09-15T23:23:09.887177+0000","last_unstale":"2024-09-15T23:23:10.878132+0000","last_undegraded":"2024-09-15T23:23:10.878132+0000","last_fullsized":"2024-09-15T23:23:10.878132+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:49.433015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.867500+0000","last_change":"2024-09-15T23:23:07.867500+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.867500+0000","last_undegraded":"2024-09-15T23:23:07.867500+0000","last_fullsized":"2024-09-15T23:23:07.867500+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.865589+0000","last_change":"2024-09-15T23:23:07.865589+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.865589+0000","last_undegraded":"2024-09-15T23:23:07.865589+0000","last_fullsized":"2024-09-15T23:23:07.865589+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878709+0000","last_change":"2024-09-15T23:23:09.895737+0000","last_active":"2024-09-15T23:23:10.878709+0000","last_peered":"2024-09-15T23:23:10.878709+0000","last_clean":"2024-09-15T23:23:10.878709+0000","last_became_active":"2024-09-15T23:23:09.895480+0000","last_became_peered":"2024-09-15T23:23:09.895480+0000","last_unstale":"2024-09-15T23:23:10.878709+0000","last_undegraded":"2024-09-15T23:23:10.878709+0000","last_fullsized":"2024-09-15T23:23:10.878709+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:52.863778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.865208+0000","last_change":"2024-09-15T23:23:07.865208+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.865208+0000","last_undegraded":"2024-09-15T23:23:07.865208+0000","last_fullsized":"2024-09-15T23:23:07.865208+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":486,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-15T23:23:07.862631+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:23:07.862631+0000","last_peered":"2024-09-15T23:23:07.862631+0000","last_clean":"2024-09-15T23:23:07.862631+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:23:07.862631+0000","last_undegraded":"2024-09-15T23:23:07.862631+0000","last_fullsized":"2024-09-15T23:23:07.862631+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":182,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":72,"acting":72,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59900,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311940,"statfs":{"total":96636764160,"available":96575426560,"internally_reserved":0,"allocated":2392064,"data_stored":1057737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55740,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316100,"statfs":{"total":96636764160,"available":96579686400,"internally_reserved":0,"allocated":2392064,"data_stored":1057737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56304,"kb_used_data":2904,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315536,"statfs":{"total":96636764160,"available":96579108864,"internally_reserved":0,"allocated":2973696,"data_stored":1642288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51580,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320260,"statfs":{"total":96636764160,"available":96583946240,"internally_reserved":0,"allocated":2392064,"data_stored":1057737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542281,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51612,"kb_used_data":2376,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320228,"statfs":{"total":96636764160,"available":96583913472,"internally_reserved":0,"allocated":2433024,"data_stored":1077109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542281,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55780,"kb_used_data":2376,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316060,"statfs":{"total":96636764160,"available":96579645440,"internally_reserved":0,"allocated":2433024,"data_stored":1077157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542280,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60528,"kb_used_data":2956,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311312,"statfs":{"total":96636764160,"available":96574783488,"internally_reserved":0,"allocated":3026944,"data_stored":1661883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542282,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59932,"kb_used_data":2376,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311908,"statfs":{"total":96636764160,"available":96575393792,"internally_reserved":0,"allocated":2433024,"data_stored":1077177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:23:12.820 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:23:12.822 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-09-15T23:23:12.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.955+0000 7ff81eb9f640 1 Processor -- start 2024-09-15T23:23:12.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.955+0000 7ff81eb9f640 1 -- start start 2024-09-15T23:23:12.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.956+0000 7ff81eb9f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff8180d1050 0x7ff8180cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:12.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.956+0000 7ff81eb9f640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8180cfc90 con 0x7ff8180cf880 2024-09-15T23:23:12.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.956+0000 7ff81eb9f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8180d33c0 con 0x7ff81815e5b0 2024-09-15T23:23:12.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.956+0000 7ff81eb9f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7ff8180b78c0 con 0x7ff8180d1050 2024-09-15T23:23:12.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.956+0000 7ff81d39c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff8180d1050 0x7ff8180cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:12.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.956+0000 7ff81d39c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff8180d1050 0x7ff8180cf340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44992/0 (socket says 172.21.15.123:44992) 2024-09-15T23:23:12.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.956+0000 7ff81e39e640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff8180cf880 0x7ff8180b8010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:34870/0 (socket says 172.21.15.123:34870) 2024-09-15T23:23:12.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.956+0000 7ff81d39c640 1 -- 172.21.15.123:0/2581242965 learned_addr learned my addr 172.21.15.123:0/2581242965 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:12.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.957+0000 7ff81d39c640 1 -- 172.21.15.123:0/2581242965 >> v1:172.21.15.188:6789/0 conn(0x7ff81815e5b0 legacy=0x7ff8180d2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:12.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.957+0000 7ff81d39c640 1 -- 172.21.15.123:0/2581242965 >> v1:172.21.15.123:6789/0 conn(0x7ff8180cf880 legacy=0x7ff8180b8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:12.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.957+0000 7ff81d39c640 1 -- 172.21.15.123:0/2581242965 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff81815e990 con 0x7ff8180d1050 2024-09-15T23:23:12.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.957+0000 7ff81cb9b640 1 -- 172.21.15.123:0/2581242965 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3352699651 0 0) 0x7ff810001490 con 0x7ff8180cf880 2024-09-15T23:23:12.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.957+0000 7ff81d39c640 1 --2- 172.21.15.123:0/2581242965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8180d1050 0x7ff8180cf340 secure :-1 s=READY pgs=2236 cs=0 l=1 rev1=1 crypto rx=0x7ff808009870 tx=0x7ff80802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3fea767576c422 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:12.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.957+0000 7ff81cb9b640 1 -- 172.21.15.123:0/2581242965 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff808037070 con 0x7ff8180d1050 2024-09-15T23:23:12.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.957+0000 7ff81cb9b640 1 -- 172.21.15.123:0/2581242965 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff808032440 con 0x7ff8180d1050 2024-09-15T23:23:12.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.957+0000 7ff81cb9b640 1 -- 172.21.15.123:0/2581242965 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff808032810 con 0x7ff8180d1050 2024-09-15T23:23:12.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.958+0000 7ff81eb9f640 1 -- 172.21.15.123:0/2581242965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8180d1050 msgr2=0x7ff8180cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:12.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.958+0000 7ff81eb9f640 1 --2- 172.21.15.123:0/2581242965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8180d1050 0x7ff8180cf340 secure :-1 s=READY pgs=2236 cs=0 l=1 rev1=1 crypto rx=0x7ff808009870 tx=0x7ff80802a2a0 comp rx=0 tx=0).stop 2024-09-15T23:23:12.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.958+0000 7ff81eb9f640 1 -- 172.21.15.123:0/2581242965 shutdown_connections 2024-09-15T23:23:12.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.958+0000 7ff81eb9f640 1 --2- 172.21.15.123:0/2581242965 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8180d1050 0x7ff8180cf340 unknown :-1 s=CLOSED pgs=2236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:12.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.958+0000 7ff81eb9f640 1 -- 172.21.15.123:0/2581242965 >> 172.21.15.123:0/2581242965 conn(0x7ff8180b63c0 msgr2=0x7ff8180b67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:12.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.958+0000 7ff81eb9f640 1 -- 172.21.15.123:0/2581242965 shutdown_connections 2024-09-15T23:23:12.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.958+0000 7ff81eb9f640 1 -- 172.21.15.123:0/2581242965 wait complete. 2024-09-15T23:23:12.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.959+0000 7ff81eb9f640 1 Processor -- start 2024-09-15T23:23:12.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.959+0000 7ff81eb9f640 1 -- start start 2024-09-15T23:23:12.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.960+0000 7ff81eb9f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff8180cf880 0x7ff818160f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:12.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.960+0000 7ff81eb9f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8180d1050 0x7ff8180cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:12.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.960+0000 7ff81eb9f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff81815e5b0 0x7ff818150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:12.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.960+0000 7ff81eb9f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff8180d30e0 con 0x7ff8180d1050 2024-09-15T23:23:12.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.960+0000 7ff81eb9f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff8180d2e00 con 0x7ff81815e5b0 2024-09-15T23:23:12.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.960+0000 7ff81eb9f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ff8180b7af0 con 0x7ff8180cf880 2024-09-15T23:23:12.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.960+0000 7ff81d39c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8180d1050 0x7ff8180cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:12.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.960+0000 7ff81d39c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8180d1050 0x7ff8180cdee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45006/0 (socket says 172.21.15.123:45006) 2024-09-15T23:23:12.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.960+0000 7ff81d39c640 1 -- 172.21.15.123:0/4173098945 learned_addr learned my addr 172.21.15.123:0/4173098945 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:12.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.960+0000 7ff81d39c640 1 -- 172.21.15.123:0/4173098945 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff8180cf880 msgr2=0x7ff818160f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:12.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.960+0000 7ff81d39c640 1 --2- 172.21.15.123:0/4173098945 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff8180cf880 0x7ff818160f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:12.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.960+0000 7ff81d39c640 1 -- 172.21.15.123:0/4173098945 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff81815e5b0 msgr2=0x7ff818150bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:12.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.960+0000 7ff81d39c640 1 --2- 172.21.15.123:0/4173098945 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff81815e5b0 0x7ff818150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:12.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.960+0000 7ff81d39c640 1 -- 172.21.15.123:0/4173098945 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff818161470 con 0x7ff8180d1050 2024-09-15T23:23:12.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.961+0000 7ff81d39c640 1 --2- 172.21.15.123:0/4173098945 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8180d1050 0x7ff8180cdee0 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 crypto rx=0x7ff808009870 tx=0x7ff8080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:12.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.961+0000 7ff80e7fc640 1 -- 172.21.15.123:0/4173098945 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff808037040 con 0x7ff8180d1050 2024-09-15T23:23:12.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.961+0000 7ff80e7fc640 1 -- 172.21.15.123:0/4173098945 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff808004250 con 0x7ff8180d1050 2024-09-15T23:23:12.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.961+0000 7ff81eb9f640 1 -- 172.21.15.123:0/4173098945 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8180ce420 con 0x7ff8180d1050 2024-09-15T23:23:12.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.961+0000 7ff80e7fc640 1 -- 172.21.15.123:0/4173098945 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff80803c730 con 0x7ff8180d1050 2024-09-15T23:23:12.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.961+0000 7ff81eb9f640 1 -- 172.21.15.123:0/4173098945 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff818160170 con 0x7ff8180d1050 2024-09-15T23:23:12.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.962+0000 7ff81eb9f640 1 -- 172.21.15.123:0/4173098945 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8180cf340 con 0x7ff8180d1050 2024-09-15T23:23:12.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.962+0000 7ff80e7fc640 1 -- 172.21.15.123:0/4173098945 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff80803a070 con 0x7ff8180d1050 2024-09-15T23:23:12.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.963+0000 7ff80e7fc640 1 --2- 172.21.15.123:0/4173098945 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff7fc06c2b0 0x7ff7fc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:12.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.963+0000 7ff80e7fc640 1 -- 172.21.15.123:0/4173098945 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7ff8080abee0 con 0x7ff8180d1050 2024-09-15T23:23:12.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.963+0000 7ff81db9d640 1 --2- 172.21.15.123:0/4173098945 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff7fc06c2b0 0x7ff7fc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:12.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.963+0000 7ff81db9d640 1 --2- 172.21.15.123:0/4173098945 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff7fc06c2b0 0x7ff7fc06e770 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7ff8180b9f30 tx=0x7ff814006ba0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:12.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:12.967+0000 7ff80e7fc640 1 -- 172.21.15.123:0/4173098945 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff818161470 con 0x7ff8180d1050 2024-09-15T23:23:13.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.128+0000 7ff81eb9f640 1 -- 172.21.15.123:0/4173098945 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff818151510 con 0x7ff7fc06c2b0 2024-09-15T23:23:13.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.135+0000 7ff80e7fc640 1 -- 172.21.15.123:0/4173098945 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246982 (secure 0 0 0) 0x7ff814012390 con 0x7ff7fc06c2b0 2024-09-15T23:23:13.138 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:23:13.139 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:23:13.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.138+0000 7ff81eb9f640 1 -- 172.21.15.123:0/4173098945 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff7fc06c2b0 msgr2=0x7ff7fc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:13.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.138+0000 7ff81eb9f640 1 --2- 172.21.15.123:0/4173098945 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff7fc06c2b0 0x7ff7fc06e770 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7ff8180b9f30 tx=0x7ff814006ba0 comp rx=0 tx=0).stop 2024-09-15T23:23:13.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.138+0000 7ff81eb9f640 1 -- 172.21.15.123:0/4173098945 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8180d1050 msgr2=0x7ff8180cdee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:13.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.138+0000 7ff81eb9f640 1 --2- 172.21.15.123:0/4173098945 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8180d1050 0x7ff8180cdee0 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 crypto rx=0x7ff808009870 tx=0x7ff8080046c0 comp rx=0 tx=0).stop 2024-09-15T23:23:13.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.138+0000 7ff81eb9f640 1 -- 172.21.15.123:0/4173098945 shutdown_connections 2024-09-15T23:23:13.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.138+0000 7ff81eb9f640 1 --2- 172.21.15.123:0/4173098945 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff81815e5b0 0x7ff818150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:13.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.138+0000 7ff81eb9f640 1 --2- 172.21.15.123:0/4173098945 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff7fc06c2b0 0x7ff7fc06e770 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:13.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.138+0000 7ff81eb9f640 1 --2- 172.21.15.123:0/4173098945 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff8180d1050 0x7ff8180cdee0 unknown :-1 s=CLOSED pgs=2237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:13.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.138+0000 7ff81eb9f640 1 --2- 172.21.15.123:0/4173098945 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff8180cf880 0x7ff818160f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:13.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.138+0000 7ff81eb9f640 1 -- 172.21.15.123:0/4173098945 >> 172.21.15.123:0/4173098945 conn(0x7ff8180b63c0 msgr2=0x7ff81815ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:13.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.138+0000 7ff81eb9f640 1 -- 172.21.15.123:0/4173098945 shutdown_connections 2024-09-15T23:23:13.142 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.138+0000 7ff81eb9f640 1 -- 172.21.15.123:0/4173098945 wait complete. 2024-09-15T23:23:13.150 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":522,"stamp":"2024-09-15T23:23:11.659727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590550,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":184,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":138,"acting":138,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":451376,"kb_used_data":19996,"kb_used_omap":12,"kb_used_meta":431155,"kb_avail":754523344,"statfs":{"total":773094113280,"available":772631904256,"internally_reserved":0,"allocated":20475904,"data_stored":9708825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":441503280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":182,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000842"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389542+0000","last_change":"2024-09-15T23:23:09.896392+0000","last_active":"2024-09-15T23:23:11.389542+0000","last_peered":"2024-09-15T23:23:11.389542+0000","last_clean":"2024-09-15T23:23:11.389542+0000","last_became_active":"2024-09-15T23:23:09.896113+0000","last_became_peered":"2024-09-15T23:23:09.896113+0000","last_unstale":"2024-09-15T23:23:11.389542+0000","last_undegraded":"2024-09-15T23:23:11.389542+0000","last_fullsized":"2024-09-15T23:23:11.389542+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:42.157923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878505+0000","last_change":"2024-09-15T23:23:09.890448+0000","last_active":"2024-09-15T23:23:10.878505+0000","last_peered":"2024-09-15T23:23:10.878505+0000","last_clean":"2024-09-15T23:23:10.878505+0000","last_became_active":"2024-09-15T23:23:09.890146+0000","last_became_peered":"2024-09-15T23:23:09.890146+0000","last_unstale":"2024-09-15T23:23:10.878505+0000","last_undegraded":"2024-09-15T23:23:10.878505+0000","last_fullsized":"2024-09-15T23:23:10.878505+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:10.381055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.879038+0000","last_change":"2024-09-15T23:23:09.893118+0000","last_active":"2024-09-15T23:23:10.879038+0000","last_peered":"2024-09-15T23:23:10.879038+0000","last_clean":"2024-09-15T23:23:10.879038+0000","last_became_active":"2024-09-15T23:23:09.892821+0000","last_became_peered":"2024-09-15T23:23:09.892821+0000","last_unstale":"2024-09-15T23:23:10.879038+0000","last_undegraded":"2024-09-15T23:23:10.879038+0000","last_fullsized":"2024-09-15T23:23:10.879038+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:49.942314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389282+0000","last_change":"2024-09-15T23:23:09.898540+0000","last_active":"2024-09-15T23:23:11.389282+0000","last_peered":"2024-09-15T23:23:11.389282+0000","last_clean":"2024-09-15T23:23:11.389282+0000","last_became_active":"2024-09-15T23:23:09.898254+0000","last_became_peered":"2024-09-15T23:23:09.898254+0000","last_unstale":"2024-09-15T23:23:11.389282+0000","last_undegraded":"2024-09-15T23:23:11.389282+0000","last_fullsized":"2024-09-15T23:23:11.389282+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:41.394415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389205+0000","last_change":"2024-09-15T23:23:09.897940+0000","last_active":"2024-09-15T23:23:11.389205+0000","last_peered":"2024-09-15T23:23:11.389205+0000","last_clean":"2024-09-15T23:23:11.389205+0000","last_became_active":"2024-09-15T23:23:09.897615+0000","last_became_peered":"2024-09-15T23:23:09.897615+0000","last_unstale":"2024-09-15T23:23:11.389205+0000","last_undegraded":"2024-09-15T23:23:11.389205+0000","last_fullsized":"2024-09-15T23:23:11.389205+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:31:06.944151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.877651+0000","last_change":"2024-09-15T23:23:09.898922+0000","last_active":"2024-09-15T23:23:10.877651+0000","last_peered":"2024-09-15T23:23:10.877651+0000","last_clean":"2024-09-15T23:23:10.877651+0000","last_became_active":"2024-09-15T23:23:09.898387+0000","last_became_peered":"2024-09-15T23:23:09.898387+0000","last_unstale":"2024-09-15T23:23:10.877651+0000","last_undegraded":"2024-09-15T23:23:10.877651+0000","last_fullsized":"2024-09-15T23:23:10.877651+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:16.268734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.877907+0000","last_change":"2024-09-15T23:23:09.894886+0000","last_active":"2024-09-15T23:23:10.877907+0000","last_peered":"2024-09-15T23:23:10.877907+0000","last_clean":"2024-09-15T23:23:10.877907+0000","last_became_active":"2024-09-15T23:23:09.894452+0000","last_became_peered":"2024-09-15T23:23:09.894452+0000","last_unstale":"2024-09-15T23:23:10.877907+0000","last_undegraded":"2024-09-15T23:23:10.877907+0000","last_fullsized":"2024-09-15T23:23:10.877907+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:16.788699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389717+0000","last_change":"2024-09-15T23:23:09.892595+0000","last_active":"2024-09-15T23:23:11.389717+0000","last_peered":"2024-09-15T23:23:11.389717+0000","last_clean":"2024-09-15T23:23:11.389717+0000","last_became_active":"2024-09-15T23:23:09.892325+0000","last_became_peered":"2024-09-15T23:23:09.892325+0000","last_unstale":"2024-09-15T23:23:11.389717+0000","last_undegraded":"2024-09-15T23:23:11.389717+0000","last_fullsized":"2024-09-15T23:23:11.389717+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:17.682368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388886+0000","last_change":"2024-09-15T23:23:09.886114+0000","last_active":"2024-09-15T23:23:11.388886+0000","last_peered":"2024-09-15T23:23:11.388886+0000","last_clean":"2024-09-15T23:23:11.388886+0000","last_became_active":"2024-09-15T23:23:09.885637+0000","last_became_peered":"2024-09-15T23:23:09.885637+0000","last_unstale":"2024-09-15T23:23:11.388886+0000","last_undegraded":"2024-09-15T23:23:11.388886+0000","last_fullsized":"2024-09-15T23:23:11.388886+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:49.942314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389344+0000","last_change":"2024-09-15T23:23:09.891894+0000","last_active":"2024-09-15T23:23:11.389344+0000","last_peered":"2024-09-15T23:23:11.389344+0000","last_clean":"2024-09-15T23:23:11.389344+0000","last_became_active":"2024-09-15T23:23:09.891392+0000","last_became_peered":"2024-09-15T23:23:09.891392+0000","last_unstale":"2024-09-15T23:23:11.389344+0000","last_undegraded":"2024-09-15T23:23:11.389344+0000","last_fullsized":"2024-09-15T23:23:11.389344+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:35.402255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389097+0000","last_change":"2024-09-15T23:23:09.895144+0000","last_active":"2024-09-15T23:23:11.389097+0000","last_peered":"2024-09-15T23:23:11.389097+0000","last_clean":"2024-09-15T23:23:11.389097+0000","last_became_active":"2024-09-15T23:23:09.894871+0000","last_became_peered":"2024-09-15T23:23:09.894871+0000","last_unstale":"2024-09-15T23:23:11.389097+0000","last_undegraded":"2024-09-15T23:23:11.389097+0000","last_fullsized":"2024-09-15T23:23:11.389097+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:49:41.077299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389677+0000","last_change":"2024-09-15T23:23:09.888650+0000","last_active":"2024-09-15T23:23:11.389677+0000","last_peered":"2024-09-15T23:23:11.389677+0000","last_clean":"2024-09-15T23:23:11.389677+0000","last_became_active":"2024-09-15T23:23:09.888057+0000","last_became_peered":"2024-09-15T23:23:09.888057+0000","last_unstale":"2024-09-15T23:23:11.389677+0000","last_undegraded":"2024-09-15T23:23:11.389677+0000","last_fullsized":"2024-09-15T23:23:11.389677+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:07.797869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878074+0000","last_change":"2024-09-15T23:23:09.892556+0000","last_active":"2024-09-15T23:23:10.878074+0000","last_peered":"2024-09-15T23:23:10.878074+0000","last_clean":"2024-09-15T23:23:10.878074+0000","last_became_active":"2024-09-15T23:23:09.892282+0000","last_became_peered":"2024-09-15T23:23:09.892282+0000","last_unstale":"2024-09-15T23:23:10.878074+0000","last_undegraded":"2024-09-15T23:23:10.878074+0000","last_fullsized":"2024-09-15T23:23:10.878074+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:17.364225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878678+0000","last_change":"2024-09-15T23:23:09.888937+0000","last_active":"2024-09-15T23:23:10.878678+0000","last_peered":"2024-09-15T23:23:10.878678+0000","last_clean":"2024-09-15T23:23:10.878678+0000","last_became_active":"2024-09-15T23:23:09.888173+0000","last_became_peered":"2024-09-15T23:23:09.888173+0000","last_unstale":"2024-09-15T23:23:10.878678+0000","last_undegraded":"2024-09-15T23:23:10.878678+0000","last_fullsized":"2024-09-15T23:23:10.878678+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:55:42.187292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878432+0000","last_change":"2024-09-15T23:23:09.884518+0000","last_active":"2024-09-15T23:23:10.878432+0000","last_peered":"2024-09-15T23:23:10.878432+0000","last_clean":"2024-09-15T23:23:10.878432+0000","last_became_active":"2024-09-15T23:23:09.884229+0000","last_became_peered":"2024-09-15T23:23:09.884229+0000","last_unstale":"2024-09-15T23:23:10.878432+0000","last_undegraded":"2024-09-15T23:23:10.878432+0000","last_fullsized":"2024-09-15T23:23:10.878432+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:07.994162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.879088+0000","last_change":"2024-09-15T23:23:09.885890+0000","last_active":"2024-09-15T23:23:10.879088+0000","last_peered":"2024-09-15T23:23:10.879088+0000","last_clean":"2024-09-15T23:23:10.879088+0000","last_became_active":"2024-09-15T23:23:09.885585+0000","last_became_peered":"2024-09-15T23:23:09.885585+0000","last_unstale":"2024-09-15T23:23:10.879088+0000","last_undegraded":"2024-09-15T23:23:10.879088+0000","last_fullsized":"2024-09-15T23:23:10.879088+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:12.472633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878586+0000","last_change":"2024-09-15T23:23:09.889164+0000","last_active":"2024-09-15T23:23:10.878586+0000","last_peered":"2024-09-15T23:23:10.878586+0000","last_clean":"2024-09-15T23:23:10.878586+0000","last_became_active":"2024-09-15T23:23:09.888868+0000","last_became_peered":"2024-09-15T23:23:09.888868+0000","last_unstale":"2024-09-15T23:23:10.878586+0000","last_undegraded":"2024-09-15T23:23:10.878586+0000","last_fullsized":"2024-09-15T23:23:10.878586+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:12:17.516107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878136+0000","last_change":"2024-09-15T23:23:09.884750+0000","last_active":"2024-09-15T23:23:10.878136+0000","last_peered":"2024-09-15T23:23:10.878136+0000","last_clean":"2024-09-15T23:23:10.878136+0000","last_became_active":"2024-09-15T23:23:09.884395+0000","last_became_peered":"2024-09-15T23:23:09.884395+0000","last_unstale":"2024-09-15T23:23:10.878136+0000","last_undegraded":"2024-09-15T23:23:10.878136+0000","last_fullsized":"2024-09-15T23:23:10.878136+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:45.924003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388853+0000","last_change":"2024-09-15T23:23:09.889967+0000","last_active":"2024-09-15T23:23:11.388853+0000","last_peered":"2024-09-15T23:23:11.388853+0000","last_clean":"2024-09-15T23:23:11.388853+0000","last_became_active":"2024-09-15T23:23:09.889690+0000","last_became_peered":"2024-09-15T23:23:09.889690+0000","last_unstale":"2024-09-15T23:23:11.388853+0000","last_undegraded":"2024-09-15T23:23:11.388853+0000","last_fullsized":"2024-09-15T23:23:11.388853+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:52.863778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.867875+0000","last_change":"2024-09-15T23:23:07.867875+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.867875+0000","last_undegraded":"2024-09-15T23:23:07.867875+0000","last_fullsized":"2024-09-15T23:23:07.867875+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.865671+0000","last_change":"2024-09-15T23:23:07.865671+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.865671+0000","last_undegraded":"2024-09-15T23:23:07.865671+0000","last_fullsized":"2024-09-15T23:23:07.865671+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878490+0000","last_change":"2024-09-15T23:23:09.893191+0000","last_active":"2024-09-15T23:23:10.878490+0000","last_peered":"2024-09-15T23:23:10.878490+0000","last_clean":"2024-09-15T23:23:10.878490+0000","last_became_active":"2024-09-15T23:23:09.892564+0000","last_became_peered":"2024-09-15T23:23:09.892564+0000","last_unstale":"2024-09-15T23:23:10.878490+0000","last_undegraded":"2024-09-15T23:23:10.878490+0000","last_fullsized":"2024-09-15T23:23:10.878490+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:43:10.307662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1d","version":"193'2","reported_seq":16,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.879004+0000","last_change":"2024-09-15T23:23:08.883380+0000","last_active":"2024-09-15T23:23:10.879004+0000","last_peered":"2024-09-15T23:23:10.879004+0000","last_clean":"2024-09-15T23:23:10.879004+0000","last_became_active":"2024-09-15T23:23:08.883076+0000","last_became_peered":"2024-09-15T23:23:08.883076+0000","last_unstale":"2024-09-15T23:23:10.879004+0000","last_undegraded":"2024-09-15T23:23:10.879004+0000","last_fullsized":"2024-09-15T23:23:10.879004+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:41.150625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878773+0000","last_change":"2024-09-15T23:23:09.889863+0000","last_active":"2024-09-15T23:23:10.878773+0000","last_peered":"2024-09-15T23:23:10.878773+0000","last_clean":"2024-09-15T23:23:10.878773+0000","last_became_active":"2024-09-15T23:23:09.889275+0000","last_became_peered":"2024-09-15T23:23:09.889275+0000","last_unstale":"2024-09-15T23:23:10.878773+0000","last_undegraded":"2024-09-15T23:23:10.878773+0000","last_fullsized":"2024-09-15T23:23:10.878773+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:48.682646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.866154+0000","last_change":"2024-09-15T23:23:07.866154+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.866154+0000","last_undegraded":"2024-09-15T23:23:07.866154+0000","last_fullsized":"2024-09-15T23:23:07.866154+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1a","version":"193'1","reported_seq":15,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389577+0000","last_change":"2024-09-15T23:23:08.884833+0000","last_active":"2024-09-15T23:23:11.389577+0000","last_peered":"2024-09-15T23:23:11.389577+0000","last_clean":"2024-09-15T23:23:11.389577+0000","last_became_active":"2024-09-15T23:23:08.884446+0000","last_became_peered":"2024-09-15T23:23:08.884446+0000","last_unstale":"2024-09-15T23:23:11.389577+0000","last_undegraded":"2024-09-15T23:23:11.389577+0000","last_fullsized":"2024-09-15T23:23:11.389577+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:25:43.826245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389249+0000","last_change":"2024-09-15T23:23:09.887857+0000","last_active":"2024-09-15T23:23:11.389249+0000","last_peered":"2024-09-15T23:23:11.389249+0000","last_clean":"2024-09-15T23:23:11.389249+0000","last_became_active":"2024-09-15T23:23:09.887005+0000","last_became_peered":"2024-09-15T23:23:09.887005+0000","last_unstale":"2024-09-15T23:23:11.389249+0000","last_undegraded":"2024-09-15T23:23:11.389249+0000","last_fullsized":"2024-09-15T23:23:11.389249+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:13.448014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878250+0000","last_change":"2024-09-15T23:23:08.887529+0000","last_active":"2024-09-15T23:23:10.878250+0000","last_peered":"2024-09-15T23:23:10.878250+0000","last_clean":"2024-09-15T23:23:10.878250+0000","last_became_active":"2024-09-15T23:23:08.887256+0000","last_became_peered":"2024-09-15T23:23:08.887256+0000","last_unstale":"2024-09-15T23:23:10.878250+0000","last_undegraded":"2024-09-15T23:23:10.878250+0000","last_fullsized":"2024-09-15T23:23:10.878250+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:34.394956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.866068+0000","last_change":"2024-09-15T23:23:07.866068+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.866068+0000","last_undegraded":"2024-09-15T23:23:07.866068+0000","last_fullsized":"2024-09-15T23:23:07.866068+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878930+0000","last_change":"2024-09-15T23:23:08.882342+0000","last_active":"2024-09-15T23:23:10.878930+0000","last_peered":"2024-09-15T23:23:10.878930+0000","last_clean":"2024-09-15T23:23:10.878930+0000","last_became_active":"2024-09-15T23:23:08.882046+0000","last_became_peered":"2024-09-15T23:23:08.882046+0000","last_unstale":"2024-09-15T23:23:10.878930+0000","last_undegraded":"2024-09-15T23:23:10.878930+0000","last_fullsized":"2024-09-15T23:23:10.878930+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:46.966470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388963+0000","last_change":"2024-09-15T23:23:09.887039+0000","last_active":"2024-09-15T23:23:11.388963+0000","last_peered":"2024-09-15T23:23:11.388963+0000","last_clean":"2024-09-15T23:23:11.388963+0000","last_became_active":"2024-09-15T23:23:09.886178+0000","last_became_peered":"2024-09-15T23:23:09.886178+0000","last_unstale":"2024-09-15T23:23:11.388963+0000","last_undegraded":"2024-09-15T23:23:11.388963+0000","last_fullsized":"2024-09-15T23:23:11.388963+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:24.942591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.865590+0000","last_change":"2024-09-15T23:23:07.865590+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.865590+0000","last_undegraded":"2024-09-15T23:23:07.865590+0000","last_fullsized":"2024-09-15T23:23:07.865590+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.15","version":"193'3","reported_seq":17,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.879081+0000","last_change":"2024-09-15T23:23:08.888755+0000","last_active":"2024-09-15T23:23:10.879081+0000","last_peered":"2024-09-15T23:23:10.879081+0000","last_clean":"2024-09-15T23:23:10.879081+0000","last_became_active":"2024-09-15T23:23:08.888250+0000","last_became_peered":"2024-09-15T23:23:08.888250+0000","last_unstale":"2024-09-15T23:23:10.879081+0000","last_undegraded":"2024-09-15T23:23:10.879081+0000","last_fullsized":"2024-09-15T23:23:10.879081+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:08.440981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878357+0000","last_change":"2024-09-15T23:23:09.881198+0000","last_active":"2024-09-15T23:23:10.878357+0000","last_peered":"2024-09-15T23:23:10.878357+0000","last_clean":"2024-09-15T23:23:10.878357+0000","last_became_active":"2024-09-15T23:23:09.880910+0000","last_became_peered":"2024-09-15T23:23:09.880910+0000","last_unstale":"2024-09-15T23:23:10.878357+0000","last_undegraded":"2024-09-15T23:23:10.878357+0000","last_fullsized":"2024-09-15T23:23:10.878357+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:53:34.689769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.867069+0000","last_change":"2024-09-15T23:23:07.867069+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.867069+0000","last_undegraded":"2024-09-15T23:23:07.867069+0000","last_fullsized":"2024-09-15T23:23:07.867069+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388862+0000","last_change":"2024-09-15T23:23:09.890661+0000","last_active":"2024-09-15T23:23:11.388862+0000","last_peered":"2024-09-15T23:23:11.388862+0000","last_clean":"2024-09-15T23:23:11.388862+0000","last_became_active":"2024-09-15T23:23:09.890390+0000","last_became_peered":"2024-09-15T23:23:09.890390+0000","last_unstale":"2024-09-15T23:23:11.388862+0000","last_undegraded":"2024-09-15T23:23:11.388862+0000","last_fullsized":"2024-09-15T23:23:11.388862+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:48.682646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.867063+0000","last_change":"2024-09-15T23:23:07.867063+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.867063+0000","last_undegraded":"2024-09-15T23:23:07.867063+0000","last_fullsized":"2024-09-15T23:23:07.867063+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.879038+0000","last_change":"2024-09-15T23:23:09.890142+0000","last_active":"2024-09-15T23:23:10.879038+0000","last_peered":"2024-09-15T23:23:10.879038+0000","last_clean":"2024-09-15T23:23:10.879038+0000","last_became_active":"2024-09-15T23:23:09.889857+0000","last_became_peered":"2024-09-15T23:23:09.889857+0000","last_unstale":"2024-09-15T23:23:10.879038+0000","last_undegraded":"2024-09-15T23:23:10.879038+0000","last_fullsized":"2024-09-15T23:23:10.879038+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:24.942591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.865223+0000","last_change":"2024-09-15T23:23:07.865223+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.865223+0000","last_undegraded":"2024-09-15T23:23:07.865223+0000","last_fullsized":"2024-09-15T23:23:07.865223+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.877739+0000","last_change":"2024-09-15T23:23:09.894373+0000","last_active":"2024-09-15T23:23:10.877739+0000","last_peered":"2024-09-15T23:23:10.877739+0000","last_clean":"2024-09-15T23:23:10.877739+0000","last_became_active":"2024-09-15T23:23:09.894027+0000","last_became_peered":"2024-09-15T23:23:09.894027+0000","last_unstale":"2024-09-15T23:23:10.877739+0000","last_undegraded":"2024-09-15T23:23:10.877739+0000","last_fullsized":"2024-09-15T23:23:10.877739+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:05:43.347414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878324+0000","last_change":"2024-09-15T23:23:08.883287+0000","last_active":"2024-09-15T23:23:10.878324+0000","last_peered":"2024-09-15T23:23:10.878324+0000","last_clean":"2024-09-15T23:23:10.878324+0000","last_became_active":"2024-09-15T23:23:08.882904+0000","last_became_peered":"2024-09-15T23:23:08.882904+0000","last_unstale":"2024-09-15T23:23:10.878324+0000","last_undegraded":"2024-09-15T23:23:10.878324+0000","last_fullsized":"2024-09-15T23:23:10.878324+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:34:43.070529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389575+0000","last_change":"2024-09-15T23:23:09.887792+0000","last_active":"2024-09-15T23:23:11.389575+0000","last_peered":"2024-09-15T23:23:11.389575+0000","last_clean":"2024-09-15T23:23:11.389575+0000","last_became_active":"2024-09-15T23:23:09.887392+0000","last_became_peered":"2024-09-15T23:23:09.887392+0000","last_unstale":"2024-09-15T23:23:11.389575+0000","last_undegraded":"2024-09-15T23:23:11.389575+0000","last_fullsized":"2024-09-15T23:23:11.389575+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:09.448279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.10","version":"193'8","reported_seq":22,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878455+0000","last_change":"2024-09-15T23:23:08.880773+0000","last_active":"2024-09-15T23:23:10.878455+0000","last_peered":"2024-09-15T23:23:10.878455+0000","last_clean":"2024-09-15T23:23:10.878455+0000","last_became_active":"2024-09-15T23:23:08.880261+0000","last_became_peered":"2024-09-15T23:23:08.880261+0000","last_unstale":"2024-09-15T23:23:10.878455+0000","last_undegraded":"2024-09-15T23:23:10.878455+0000","last_fullsized":"2024-09-15T23:23:10.878455+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:32.801604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.f","version":"193'1","reported_seq":15,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389869+0000","last_change":"2024-09-15T23:23:08.887550+0000","last_active":"2024-09-15T23:23:11.389869+0000","last_peered":"2024-09-15T23:23:11.389869+0000","last_clean":"2024-09-15T23:23:11.389869+0000","last_became_active":"2024-09-15T23:23:08.887255+0000","last_became_peered":"2024-09-15T23:23:08.887255+0000","last_unstale":"2024-09-15T23:23:11.389869+0000","last_undegraded":"2024-09-15T23:23:11.389869+0000","last_fullsized":"2024-09-15T23:23:11.389869+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:56.677486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.867227+0000","last_change":"2024-09-15T23:23:07.867227+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.867227+0000","last_undegraded":"2024-09-15T23:23:07.867227+0000","last_fullsized":"2024-09-15T23:23:07.867227+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878585+0000","last_change":"2024-09-15T23:23:09.893387+0000","last_active":"2024-09-15T23:23:10.878585+0000","last_peered":"2024-09-15T23:23:10.878585+0000","last_clean":"2024-09-15T23:23:10.878585+0000","last_became_active":"2024-09-15T23:23:09.892927+0000","last_became_peered":"2024-09-15T23:23:09.892927+0000","last_unstale":"2024-09-15T23:23:10.878585+0000","last_undegraded":"2024-09-15T23:23:10.878585+0000","last_fullsized":"2024-09-15T23:23:10.878585+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:56.972413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.d","version":"193'1","reported_seq":15,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389475+0000","last_change":"2024-09-15T23:23:08.880228+0000","last_active":"2024-09-15T23:23:11.389475+0000","last_peered":"2024-09-15T23:23:11.389475+0000","last_clean":"2024-09-15T23:23:11.389475+0000","last_became_active":"2024-09-15T23:23:08.879937+0000","last_became_peered":"2024-09-15T23:23:08.879937+0000","last_unstale":"2024-09-15T23:23:11.389475+0000","last_undegraded":"2024-09-15T23:23:11.389475+0000","last_fullsized":"2024-09-15T23:23:11.389475+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:06.986864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389822+0000","last_change":"2024-09-15T23:23:09.900172+0000","last_active":"2024-09-15T23:23:11.389822+0000","last_peered":"2024-09-15T23:23:11.389822+0000","last_clean":"2024-09-15T23:23:11.389822+0000","last_became_active":"2024-09-15T23:23:09.899812+0000","last_became_peered":"2024-09-15T23:23:09.899812+0000","last_unstale":"2024-09-15T23:23:11.389822+0000","last_undegraded":"2024-09-15T23:23:11.389822+0000","last_fullsized":"2024-09-15T23:23:11.389822+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:48:35.079778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389230+0000","last_change":"2024-09-15T23:23:08.884635+0000","last_active":"2024-09-15T23:23:11.389230+0000","last_peered":"2024-09-15T23:23:11.389230+0000","last_clean":"2024-09-15T23:23:11.389230+0000","last_became_active":"2024-09-15T23:23:08.884343+0000","last_became_peered":"2024-09-15T23:23:08.884343+0000","last_unstale":"2024-09-15T23:23:11.389230+0000","last_undegraded":"2024-09-15T23:23:11.389230+0000","last_fullsized":"2024-09-15T23:23:11.389230+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:28.713430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.877765+0000","last_change":"2024-09-15T23:23:09.896745+0000","last_active":"2024-09-15T23:23:10.877765+0000","last_peered":"2024-09-15T23:23:10.877765+0000","last_clean":"2024-09-15T23:23:10.877765+0000","last_became_active":"2024-09-15T23:23:09.895939+0000","last_became_peered":"2024-09-15T23:23:09.895939+0000","last_unstale":"2024-09-15T23:23:10.877765+0000","last_undegraded":"2024-09-15T23:23:10.877765+0000","last_fullsized":"2024-09-15T23:23:10.877765+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:27.624450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.b","version":"193'2","reported_seq":16,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388819+0000","last_change":"2024-09-15T23:23:08.881657+0000","last_active":"2024-09-15T23:23:11.388819+0000","last_peered":"2024-09-15T23:23:11.388819+0000","last_clean":"2024-09-15T23:23:11.388819+0000","last_became_active":"2024-09-15T23:23:08.881338+0000","last_became_peered":"2024-09-15T23:23:08.881338+0000","last_unstale":"2024-09-15T23:23:11.388819+0000","last_undegraded":"2024-09-15T23:23:11.388819+0000","last_fullsized":"2024-09-15T23:23:11.388819+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:44.916704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389406+0000","last_change":"2024-09-15T23:23:09.899726+0000","last_active":"2024-09-15T23:23:11.389406+0000","last_peered":"2024-09-15T23:23:11.389406+0000","last_clean":"2024-09-15T23:23:11.389406+0000","last_became_active":"2024-09-15T23:23:09.898418+0000","last_became_peered":"2024-09-15T23:23:09.898418+0000","last_unstale":"2024-09-15T23:23:11.389406+0000","last_undegraded":"2024-09-15T23:23:11.389406+0000","last_fullsized":"2024-09-15T23:23:11.389406+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:58.508749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878430+0000","last_change":"2024-09-15T23:23:08.885820+0000","last_active":"2024-09-15T23:23:10.878430+0000","last_peered":"2024-09-15T23:23:10.878430+0000","last_clean":"2024-09-15T23:23:10.878430+0000","last_became_active":"2024-09-15T23:23:08.885545+0000","last_became_peered":"2024-09-15T23:23:08.885545+0000","last_unstale":"2024-09-15T23:23:10.878430+0000","last_undegraded":"2024-09-15T23:23:10.878430+0000","last_fullsized":"2024-09-15T23:23:10.878430+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:06.790571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878190+0000","last_change":"2024-09-15T23:23:08.886258+0000","last_active":"2024-09-15T23:23:10.878190+0000","last_peered":"2024-09-15T23:23:10.878190+0000","last_clean":"2024-09-15T23:23:10.878190+0000","last_became_active":"2024-09-15T23:23:08.884216+0000","last_became_peered":"2024-09-15T23:23:08.884216+0000","last_unstale":"2024-09-15T23:23:10.878190+0000","last_undegraded":"2024-09-15T23:23:10.878190+0000","last_fullsized":"2024-09-15T23:23:10.878190+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:39.101978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878528+0000","last_change":"2024-09-15T23:23:08.889246+0000","last_active":"2024-09-15T23:23:10.878528+0000","last_peered":"2024-09-15T23:23:10.878528+0000","last_clean":"2024-09-15T23:23:10.878528+0000","last_became_active":"2024-09-15T23:23:08.888672+0000","last_became_peered":"2024-09-15T23:23:08.888672+0000","last_unstale":"2024-09-15T23:23:10.878528+0000","last_undegraded":"2024-09-15T23:23:10.878528+0000","last_fullsized":"2024-09-15T23:23:10.878528+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:16.675069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.7","version":"193'2","reported_seq":16,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878776+0000","last_change":"2024-09-15T23:23:08.881862+0000","last_active":"2024-09-15T23:23:10.878776+0000","last_peered":"2024-09-15T23:23:10.878776+0000","last_clean":"2024-09-15T23:23:10.878776+0000","last_became_active":"2024-09-15T23:23:08.881581+0000","last_became_peered":"2024-09-15T23:23:08.881581+0000","last_unstale":"2024-09-15T23:23:10.878776+0000","last_undegraded":"2024-09-15T23:23:10.878776+0000","last_fullsized":"2024-09-15T23:23:10.878776+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:57.501450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389734+0000","last_change":"2024-09-15T23:23:09.888350+0000","last_active":"2024-09-15T23:23:11.389734+0000","last_peered":"2024-09-15T23:23:11.389734+0000","last_clean":"2024-09-15T23:23:11.389734+0000","last_became_active":"2024-09-15T23:23:09.887980+0000","last_became_peered":"2024-09-15T23:23:09.887980+0000","last_unstale":"2024-09-15T23:23:11.389734+0000","last_undegraded":"2024-09-15T23:23:11.389734+0000","last_fullsized":"2024-09-15T23:23:11.389734+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:33.808903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.865216+0000","last_change":"2024-09-15T23:23:07.865216+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.865216+0000","last_undegraded":"2024-09-15T23:23:07.865216+0000","last_fullsized":"2024-09-15T23:23:07.865216+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389860+0000","last_change":"2024-09-15T23:23:08.885600+0000","last_active":"2024-09-15T23:23:11.389860+0000","last_peered":"2024-09-15T23:23:11.389860+0000","last_clean":"2024-09-15T23:23:11.389860+0000","last_became_active":"2024-09-15T23:23:08.885248+0000","last_became_peered":"2024-09-15T23:23:08.885248+0000","last_unstale":"2024-09-15T23:23:11.389860+0000","last_undegraded":"2024-09-15T23:23:11.389860+0000","last_fullsized":"2024-09-15T23:23:11.389860+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:18:41.964218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389195+0000","last_change":"2024-09-15T23:23:08.887072+0000","last_active":"2024-09-15T23:23:11.389195+0000","last_peered":"2024-09-15T23:23:11.389195+0000","last_clean":"2024-09-15T23:23:11.389195+0000","last_became_active":"2024-09-15T23:23:08.886725+0000","last_became_peered":"2024-09-15T23:23:08.886725+0000","last_unstale":"2024-09-15T23:23:11.389195+0000","last_undegraded":"2024-09-15T23:23:11.389195+0000","last_fullsized":"2024-09-15T23:23:11.389195+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:45:01.490349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389480+0000","last_change":"2024-09-15T23:23:09.898656+0000","last_active":"2024-09-15T23:23:11.389480+0000","last_peered":"2024-09-15T23:23:11.389480+0000","last_clean":"2024-09-15T23:23:11.389480+0000","last_became_active":"2024-09-15T23:23:09.898380+0000","last_became_peered":"2024-09-15T23:23:09.898380+0000","last_unstale":"2024-09-15T23:23:11.389480+0000","last_undegraded":"2024-09-15T23:23:11.389480+0000","last_fullsized":"2024-09-15T23:23:11.389480+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:34:44.077827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.865565+0000","last_change":"2024-09-15T23:23:07.865565+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.865565+0000","last_undegraded":"2024-09-15T23:23:07.865565+0000","last_fullsized":"2024-09-15T23:23:07.865565+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.877954+0000","last_change":"2024-09-15T23:23:08.889390+0000","last_active":"2024-09-15T23:23:10.877954+0000","last_peered":"2024-09-15T23:23:10.877954+0000","last_clean":"2024-09-15T23:23:10.877954+0000","last_became_active":"2024-09-15T23:23:08.889130+0000","last_became_peered":"2024-09-15T23:23:08.889130+0000","last_unstale":"2024-09-15T23:23:10.877954+0000","last_undegraded":"2024-09-15T23:23:10.877954+0000","last_fullsized":"2024-09-15T23:23:10.877954+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:00:26.192065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878132+0000","last_change":"2024-09-15T23:23:09.887444+0000","last_active":"2024-09-15T23:23:10.878132+0000","last_peered":"2024-09-15T23:23:10.878132+0000","last_clean":"2024-09-15T23:23:10.878132+0000","last_became_active":"2024-09-15T23:23:09.887177+0000","last_became_peered":"2024-09-15T23:23:09.887177+0000","last_unstale":"2024-09-15T23:23:10.878132+0000","last_undegraded":"2024-09-15T23:23:10.878132+0000","last_fullsized":"2024-09-15T23:23:10.878132+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:49.433015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.867500+0000","last_change":"2024-09-15T23:23:07.867500+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.867500+0000","last_undegraded":"2024-09-15T23:23:07.867500+0000","last_fullsized":"2024-09-15T23:23:07.867500+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.865589+0000","last_change":"2024-09-15T23:23:07.865589+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.865589+0000","last_undegraded":"2024-09-15T23:23:07.865589+0000","last_fullsized":"2024-09-15T23:23:07.865589+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878709+0000","last_change":"2024-09-15T23:23:09.895737+0000","last_active":"2024-09-15T23:23:10.878709+0000","last_peered":"2024-09-15T23:23:10.878709+0000","last_clean":"2024-09-15T23:23:10.878709+0000","last_became_active":"2024-09-15T23:23:09.895480+0000","last_became_peered":"2024-09-15T23:23:09.895480+0000","last_unstale":"2024-09-15T23:23:10.878709+0000","last_undegraded":"2024-09-15T23:23:10.878709+0000","last_fullsized":"2024-09-15T23:23:10.878709+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:52.863778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.865208+0000","last_change":"2024-09-15T23:23:07.865208+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.865208+0000","last_undegraded":"2024-09-15T23:23:07.865208+0000","last_fullsized":"2024-09-15T23:23:07.865208+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":486,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-15T23:23:07.862631+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:23:07.862631+0000","last_peered":"2024-09-15T23:23:07.862631+0000","last_clean":"2024-09-15T23:23:07.862631+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:23:07.862631+0000","last_undegraded":"2024-09-15T23:23:07.862631+0000","last_fullsized":"2024-09-15T23:23:07.862631+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":182,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":72,"acting":72,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59900,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311940,"statfs":{"total":96636764160,"available":96575426560,"internally_reserved":0,"allocated":2392064,"data_stored":1057737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55740,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316100,"statfs":{"total":96636764160,"available":96579686400,"internally_reserved":0,"allocated":2392064,"data_stored":1057737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56304,"kb_used_data":2904,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315536,"statfs":{"total":96636764160,"available":96579108864,"internally_reserved":0,"allocated":2973696,"data_stored":1642288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51580,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320260,"statfs":{"total":96636764160,"available":96583946240,"internally_reserved":0,"allocated":2392064,"data_stored":1057737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542281,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51612,"kb_used_data":2376,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320228,"statfs":{"total":96636764160,"available":96583913472,"internally_reserved":0,"allocated":2433024,"data_stored":1077109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542281,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55780,"kb_used_data":2376,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316060,"statfs":{"total":96636764160,"available":96579645440,"internally_reserved":0,"allocated":2433024,"data_stored":1077157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542280,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60528,"kb_used_data":2956,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311312,"statfs":{"total":96636764160,"available":96574783488,"internally_reserved":0,"allocated":3026944,"data_stored":1661883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542282,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59932,"kb_used_data":2376,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311908,"statfs":{"total":96636764160,"available":96575393792,"internally_reserved":0,"allocated":2433024,"data_stored":1077177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:23:13.153 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:23:13.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.287+0000 7f195f5c4640 1 Processor -- start 2024-09-15T23:23:13.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.287+0000 7f195f5c4640 1 -- start start 2024-09-15T23:23:13.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.288+0000 7f195f5c4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1958145ed0 0x7f19580b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:13.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.288+0000 7f195f5c4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19580b5f90 0x7f19580735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:13.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.288+0000 7f195f5c4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19580b4020 con 0x7f1958073180 2024-09-15T23:23:13.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.288+0000 7f195f5c4640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f1958073b00 con 0x7f1958145ed0 2024-09-15T23:23:13.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.288+0000 7f195f5c4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f19580b42c0 con 0x7f19580b5f90 2024-09-15T23:23:13.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.288+0000 7f195d360640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1958145ed0 0x7f19580b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:13.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.288+0000 7f195d360640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1958145ed0 0x7f19580b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45020/0 (socket says 172.21.15.123:45020) 2024-09-15T23:23:13.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.288+0000 7f195cb5f640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1958073180 0x7f19580b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:34874/0 (socket says 172.21.15.123:34874) 2024-09-15T23:23:13.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.288+0000 7f195d360640 1 -- 172.21.15.123:0/841344156 learned_addr learned my addr 172.21.15.123:0/841344156 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:13.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.288+0000 7f195db61640 1 --2- 172.21.15.123:0/841344156 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19580b5f90 0x7f19580735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:13.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.288+0000 7f195d360640 1 -- 172.21.15.123:0/841344156 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19580b5f90 msgr2=0x7f19580735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:13.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.288+0000 7f195d360640 1 --2- 172.21.15.123:0/841344156 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19580b5f90 0x7f19580735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:13.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.288+0000 7f195d360640 1 -- 172.21.15.123:0/841344156 >> v1:172.21.15.123:6789/0 conn(0x7f1958073180 legacy=0x7f19580b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:13.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.288+0000 7f195d360640 1 -- 172.21.15.123:0/841344156 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19580b45a0 con 0x7f1958145ed0 2024-09-15T23:23:13.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.288+0000 7f194ffff640 1 -- 172.21.15.123:0/841344156 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 322340112 0 0) 0x7f19580b4020 con 0x7f1958073180 2024-09-15T23:23:13.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.289+0000 7f195d360640 1 --2- 172.21.15.123:0/841344156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1958145ed0 0x7f19580b5080 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7f1958073c80 tx=0x7f195402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=946390c1d7dd81d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:13.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.289+0000 7f194ffff640 1 -- 172.21.15.123:0/841344156 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1954037070 con 0x7f1958145ed0 2024-09-15T23:23:13.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.289+0000 7f194ffff640 1 -- 172.21.15.123:0/841344156 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1954032440 con 0x7f1958145ed0 2024-09-15T23:23:13.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.289+0000 7f194ffff640 1 -- 172.21.15.123:0/841344156 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1954032810 con 0x7f1958145ed0 2024-09-15T23:23:13.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.290+0000 7f195f5c4640 1 -- 172.21.15.123:0/841344156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1958145ed0 msgr2=0x7f19580b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:13.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.290+0000 7f195f5c4640 1 --2- 172.21.15.123:0/841344156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1958145ed0 0x7f19580b5080 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7f1958073c80 tx=0x7f195402a250 comp rx=0 tx=0).stop 2024-09-15T23:23:13.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.290+0000 7f195f5c4640 1 -- 172.21.15.123:0/841344156 shutdown_connections 2024-09-15T23:23:13.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.290+0000 7f195f5c4640 1 --2- 172.21.15.123:0/841344156 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f19580b5f90 0x7f19580735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:13.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.290+0000 7f195f5c4640 1 --2- 172.21.15.123:0/841344156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1958145ed0 0x7f19580b5080 unknown :-1 s=CLOSED pgs=2239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:13.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.290+0000 7f195f5c4640 1 -- 172.21.15.123:0/841344156 >> 172.21.15.123:0/841344156 conn(0x7f19580ccec0 msgr2=0x7f19580cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:13.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.290+0000 7f195f5c4640 1 -- 172.21.15.123:0/841344156 shutdown_connections 2024-09-15T23:23:13.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.290+0000 7f195f5c4640 1 -- 172.21.15.123:0/841344156 wait complete. 2024-09-15T23:23:13.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.291+0000 7f195f5c4640 1 Processor -- start 2024-09-15T23:23:13.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.291+0000 7f195f5c4640 1 -- start start 2024-09-15T23:23:13.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.292+0000 7f195f5c4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1958073180 0x7f19581f4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:13.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.292+0000 7f195f5c4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19580b5f90 0x7f1958143a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:13.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.292+0000 7f195f5c4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1958145ed0 0x7f1958143fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:13.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.292+0000 7f195f5c4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f19581462b0 con 0x7f1958145ed0 2024-09-15T23:23:13.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.292+0000 7f195f5c4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f19580b4b60 con 0x7f19580b5f90 2024-09-15T23:23:13.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.292+0000 7f195f5c4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1958146430 con 0x7f1958073180 2024-09-15T23:23:13.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.292+0000 7f195db61640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1958145ed0 0x7f1958143fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:13.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.292+0000 7f195db61640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1958145ed0 0x7f1958143fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45024/0 (socket says 172.21.15.123:45024) 2024-09-15T23:23:13.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.292+0000 7f195db61640 1 -- 172.21.15.123:0/3302091909 learned_addr learned my addr 172.21.15.123:0/3302091909 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:13.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.292+0000 7f195d360640 1 --2- 172.21.15.123:0/3302091909 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1958073180 0x7f19581f4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:13.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.292+0000 7f195cb5f640 1 --2- 172.21.15.123:0/3302091909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19580b5f90 0x7f1958143a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:13.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.292+0000 7f195db61640 1 -- 172.21.15.123:0/3302091909 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1958073180 msgr2=0x7f19581f4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:13.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.292+0000 7f195db61640 1 --2- 172.21.15.123:0/3302091909 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1958073180 0x7f19581f4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:13.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.292+0000 7f195db61640 1 -- 172.21.15.123:0/3302091909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19580b5f90 msgr2=0x7f1958143a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:13.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.292+0000 7f195db61640 1 --2- 172.21.15.123:0/3302091909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19580b5f90 0x7f1958143a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:13.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.292+0000 7f195db61640 1 -- 172.21.15.123:0/3302091909 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19580710a0 con 0x7f1958145ed0 2024-09-15T23:23:13.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.292+0000 7f195cb5f640 1 --2- 172.21.15.123:0/3302091909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19580b5f90 0x7f1958143a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:23:13.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.292+0000 7f195db61640 1 --2- 172.21.15.123:0/3302091909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1958145ed0 0x7f1958143fd0 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 crypto rx=0x7f1950007e70 tx=0x7f195000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:13.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.292+0000 7f194dffb640 1 -- 172.21.15.123:0/3302091909 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1950014620 con 0x7f1958145ed0 2024-09-15T23:23:13.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.292+0000 7f194dffb640 1 -- 172.21.15.123:0/3302091909 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1950019070 con 0x7f1958145ed0 2024-09-15T23:23:13.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.292+0000 7f195f5c4640 1 -- 172.21.15.123:0/3302091909 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1958071380 con 0x7f1958145ed0 2024-09-15T23:23:13.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.292+0000 7f194dffb640 1 -- 172.21.15.123:0/3302091909 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1950014a20 con 0x7f1958145ed0 2024-09-15T23:23:13.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.293+0000 7f195f5c4640 1 -- 172.21.15.123:0/3302091909 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1958071940 con 0x7f1958145ed0 2024-09-15T23:23:13.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.294+0000 7f195f5c4640 1 -- 172.21.15.123:0/3302091909 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19580735c0 con 0x7f1958145ed0 2024-09-15T23:23:13.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.294+0000 7f194dffb640 1 -- 172.21.15.123:0/3302091909 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1950014bc0 con 0x7f1958145ed0 2024-09-15T23:23:13.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.294+0000 7f194dffb640 1 --2- 172.21.15.123:0/3302091909 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f193c06c2b0 0x7f193c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:13.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.294+0000 7f194dffb640 1 -- 172.21.15.123:0/3302091909 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7f195008bbd0 con 0x7f1958145ed0 2024-09-15T23:23:13.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.295+0000 7f195d360640 1 --2- 172.21.15.123:0/3302091909 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f193c06c2b0 0x7f193c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:13.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.295+0000 7f195d360640 1 --2- 172.21.15.123:0/3302091909 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f193c06c2b0 0x7f193c06e770 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f1954034000 tx=0x7f195402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:13.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.299+0000 7f194dffb640 1 -- 172.21.15.123:0/3302091909 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f195005a3d0 con 0x7f1958145ed0 2024-09-15T23:23:13.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.460+0000 7f195f5c4640 1 -- 172.21.15.123:0/3302091909 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f19580ceb60 con 0x7f193c06c2b0 2024-09-15T23:23:13.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.466+0000 7f194dffb640 1 -- 172.21.15.123:0/3302091909 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246982 (secure 0 0 0) 0x7f19580ceb60 con 0x7f193c06c2b0 2024-09-15T23:23:13.470 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:23:13.471 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:23:13.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.469+0000 7f195f5c4640 1 -- 172.21.15.123:0/3302091909 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f193c06c2b0 msgr2=0x7f193c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:13.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.469+0000 7f195f5c4640 1 --2- 172.21.15.123:0/3302091909 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f193c06c2b0 0x7f193c06e770 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f1954034000 tx=0x7f195402e000 comp rx=0 tx=0).stop 2024-09-15T23:23:13.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.469+0000 7f195f5c4640 1 -- 172.21.15.123:0/3302091909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1958145ed0 msgr2=0x7f1958143fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:13.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.469+0000 7f195f5c4640 1 --2- 172.21.15.123:0/3302091909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1958145ed0 0x7f1958143fd0 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 crypto rx=0x7f1950007e70 tx=0x7f195000e4b0 comp rx=0 tx=0).stop 2024-09-15T23:23:13.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.469+0000 7f195f5c4640 1 -- 172.21.15.123:0/3302091909 shutdown_connections 2024-09-15T23:23:13.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.469+0000 7f195f5c4640 1 --2- 172.21.15.123:0/3302091909 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f193c06c2b0 0x7f193c06e770 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:13.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.469+0000 7f195f5c4640 1 --2- 172.21.15.123:0/3302091909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1958145ed0 0x7f1958143fd0 unknown :-1 s=CLOSED pgs=2240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:13.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.469+0000 7f195f5c4640 1 --2- 172.21.15.123:0/3302091909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f19580b5f90 0x7f1958143a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:13.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.469+0000 7f195f5c4640 1 --2- 172.21.15.123:0/3302091909 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1958073180 0x7f19581f4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:13.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.469+0000 7f195f5c4640 1 -- 172.21.15.123:0/3302091909 >> 172.21.15.123:0/3302091909 conn(0x7f19580ccec0 msgr2=0x7f19581432c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:13.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.469+0000 7f195f5c4640 1 -- 172.21.15.123:0/3302091909 shutdown_connections 2024-09-15T23:23:13.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.469+0000 7f195f5c4640 1 -- 172.21.15.123:0/3302091909 wait complete. 2024-09-15T23:23:13.481 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":522,"stamp":"2024-09-15T23:23:11.659727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590550,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":184,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":138,"acting":138,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":451376,"kb_used_data":19996,"kb_used_omap":12,"kb_used_meta":431155,"kb_avail":754523344,"statfs":{"total":773094113280,"available":772631904256,"internally_reserved":0,"allocated":20475904,"data_stored":9708825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":441503280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":182,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000842"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389542+0000","last_change":"2024-09-15T23:23:09.896392+0000","last_active":"2024-09-15T23:23:11.389542+0000","last_peered":"2024-09-15T23:23:11.389542+0000","last_clean":"2024-09-15T23:23:11.389542+0000","last_became_active":"2024-09-15T23:23:09.896113+0000","last_became_peered":"2024-09-15T23:23:09.896113+0000","last_unstale":"2024-09-15T23:23:11.389542+0000","last_undegraded":"2024-09-15T23:23:11.389542+0000","last_fullsized":"2024-09-15T23:23:11.389542+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:42.157923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878505+0000","last_change":"2024-09-15T23:23:09.890448+0000","last_active":"2024-09-15T23:23:10.878505+0000","last_peered":"2024-09-15T23:23:10.878505+0000","last_clean":"2024-09-15T23:23:10.878505+0000","last_became_active":"2024-09-15T23:23:09.890146+0000","last_became_peered":"2024-09-15T23:23:09.890146+0000","last_unstale":"2024-09-15T23:23:10.878505+0000","last_undegraded":"2024-09-15T23:23:10.878505+0000","last_fullsized":"2024-09-15T23:23:10.878505+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:10.381055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.879038+0000","last_change":"2024-09-15T23:23:09.893118+0000","last_active":"2024-09-15T23:23:10.879038+0000","last_peered":"2024-09-15T23:23:10.879038+0000","last_clean":"2024-09-15T23:23:10.879038+0000","last_became_active":"2024-09-15T23:23:09.892821+0000","last_became_peered":"2024-09-15T23:23:09.892821+0000","last_unstale":"2024-09-15T23:23:10.879038+0000","last_undegraded":"2024-09-15T23:23:10.879038+0000","last_fullsized":"2024-09-15T23:23:10.879038+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:49.942314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389282+0000","last_change":"2024-09-15T23:23:09.898540+0000","last_active":"2024-09-15T23:23:11.389282+0000","last_peered":"2024-09-15T23:23:11.389282+0000","last_clean":"2024-09-15T23:23:11.389282+0000","last_became_active":"2024-09-15T23:23:09.898254+0000","last_became_peered":"2024-09-15T23:23:09.898254+0000","last_unstale":"2024-09-15T23:23:11.389282+0000","last_undegraded":"2024-09-15T23:23:11.389282+0000","last_fullsized":"2024-09-15T23:23:11.389282+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:41.394415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389205+0000","last_change":"2024-09-15T23:23:09.897940+0000","last_active":"2024-09-15T23:23:11.389205+0000","last_peered":"2024-09-15T23:23:11.389205+0000","last_clean":"2024-09-15T23:23:11.389205+0000","last_became_active":"2024-09-15T23:23:09.897615+0000","last_became_peered":"2024-09-15T23:23:09.897615+0000","last_unstale":"2024-09-15T23:23:11.389205+0000","last_undegraded":"2024-09-15T23:23:11.389205+0000","last_fullsized":"2024-09-15T23:23:11.389205+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:31:06.944151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.877651+0000","last_change":"2024-09-15T23:23:09.898922+0000","last_active":"2024-09-15T23:23:10.877651+0000","last_peered":"2024-09-15T23:23:10.877651+0000","last_clean":"2024-09-15T23:23:10.877651+0000","last_became_active":"2024-09-15T23:23:09.898387+0000","last_became_peered":"2024-09-15T23:23:09.898387+0000","last_unstale":"2024-09-15T23:23:10.877651+0000","last_undegraded":"2024-09-15T23:23:10.877651+0000","last_fullsized":"2024-09-15T23:23:10.877651+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:16.268734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.877907+0000","last_change":"2024-09-15T23:23:09.894886+0000","last_active":"2024-09-15T23:23:10.877907+0000","last_peered":"2024-09-15T23:23:10.877907+0000","last_clean":"2024-09-15T23:23:10.877907+0000","last_became_active":"2024-09-15T23:23:09.894452+0000","last_became_peered":"2024-09-15T23:23:09.894452+0000","last_unstale":"2024-09-15T23:23:10.877907+0000","last_undegraded":"2024-09-15T23:23:10.877907+0000","last_fullsized":"2024-09-15T23:23:10.877907+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:16.788699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389717+0000","last_change":"2024-09-15T23:23:09.892595+0000","last_active":"2024-09-15T23:23:11.389717+0000","last_peered":"2024-09-15T23:23:11.389717+0000","last_clean":"2024-09-15T23:23:11.389717+0000","last_became_active":"2024-09-15T23:23:09.892325+0000","last_became_peered":"2024-09-15T23:23:09.892325+0000","last_unstale":"2024-09-15T23:23:11.389717+0000","last_undegraded":"2024-09-15T23:23:11.389717+0000","last_fullsized":"2024-09-15T23:23:11.389717+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:17.682368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388886+0000","last_change":"2024-09-15T23:23:09.886114+0000","last_active":"2024-09-15T23:23:11.388886+0000","last_peered":"2024-09-15T23:23:11.388886+0000","last_clean":"2024-09-15T23:23:11.388886+0000","last_became_active":"2024-09-15T23:23:09.885637+0000","last_became_peered":"2024-09-15T23:23:09.885637+0000","last_unstale":"2024-09-15T23:23:11.388886+0000","last_undegraded":"2024-09-15T23:23:11.388886+0000","last_fullsized":"2024-09-15T23:23:11.388886+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:49.942314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389344+0000","last_change":"2024-09-15T23:23:09.891894+0000","last_active":"2024-09-15T23:23:11.389344+0000","last_peered":"2024-09-15T23:23:11.389344+0000","last_clean":"2024-09-15T23:23:11.389344+0000","last_became_active":"2024-09-15T23:23:09.891392+0000","last_became_peered":"2024-09-15T23:23:09.891392+0000","last_unstale":"2024-09-15T23:23:11.389344+0000","last_undegraded":"2024-09-15T23:23:11.389344+0000","last_fullsized":"2024-09-15T23:23:11.389344+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:35.402255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389097+0000","last_change":"2024-09-15T23:23:09.895144+0000","last_active":"2024-09-15T23:23:11.389097+0000","last_peered":"2024-09-15T23:23:11.389097+0000","last_clean":"2024-09-15T23:23:11.389097+0000","last_became_active":"2024-09-15T23:23:09.894871+0000","last_became_peered":"2024-09-15T23:23:09.894871+0000","last_unstale":"2024-09-15T23:23:11.389097+0000","last_undegraded":"2024-09-15T23:23:11.389097+0000","last_fullsized":"2024-09-15T23:23:11.389097+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:49:41.077299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389677+0000","last_change":"2024-09-15T23:23:09.888650+0000","last_active":"2024-09-15T23:23:11.389677+0000","last_peered":"2024-09-15T23:23:11.389677+0000","last_clean":"2024-09-15T23:23:11.389677+0000","last_became_active":"2024-09-15T23:23:09.888057+0000","last_became_peered":"2024-09-15T23:23:09.888057+0000","last_unstale":"2024-09-15T23:23:11.389677+0000","last_undegraded":"2024-09-15T23:23:11.389677+0000","last_fullsized":"2024-09-15T23:23:11.389677+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:07.797869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878074+0000","last_change":"2024-09-15T23:23:09.892556+0000","last_active":"2024-09-15T23:23:10.878074+0000","last_peered":"2024-09-15T23:23:10.878074+0000","last_clean":"2024-09-15T23:23:10.878074+0000","last_became_active":"2024-09-15T23:23:09.892282+0000","last_became_peered":"2024-09-15T23:23:09.892282+0000","last_unstale":"2024-09-15T23:23:10.878074+0000","last_undegraded":"2024-09-15T23:23:10.878074+0000","last_fullsized":"2024-09-15T23:23:10.878074+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:17.364225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878678+0000","last_change":"2024-09-15T23:23:09.888937+0000","last_active":"2024-09-15T23:23:10.878678+0000","last_peered":"2024-09-15T23:23:10.878678+0000","last_clean":"2024-09-15T23:23:10.878678+0000","last_became_active":"2024-09-15T23:23:09.888173+0000","last_became_peered":"2024-09-15T23:23:09.888173+0000","last_unstale":"2024-09-15T23:23:10.878678+0000","last_undegraded":"2024-09-15T23:23:10.878678+0000","last_fullsized":"2024-09-15T23:23:10.878678+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:55:42.187292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878432+0000","last_change":"2024-09-15T23:23:09.884518+0000","last_active":"2024-09-15T23:23:10.878432+0000","last_peered":"2024-09-15T23:23:10.878432+0000","last_clean":"2024-09-15T23:23:10.878432+0000","last_became_active":"2024-09-15T23:23:09.884229+0000","last_became_peered":"2024-09-15T23:23:09.884229+0000","last_unstale":"2024-09-15T23:23:10.878432+0000","last_undegraded":"2024-09-15T23:23:10.878432+0000","last_fullsized":"2024-09-15T23:23:10.878432+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:07.994162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.879088+0000","last_change":"2024-09-15T23:23:09.885890+0000","last_active":"2024-09-15T23:23:10.879088+0000","last_peered":"2024-09-15T23:23:10.879088+0000","last_clean":"2024-09-15T23:23:10.879088+0000","last_became_active":"2024-09-15T23:23:09.885585+0000","last_became_peered":"2024-09-15T23:23:09.885585+0000","last_unstale":"2024-09-15T23:23:10.879088+0000","last_undegraded":"2024-09-15T23:23:10.879088+0000","last_fullsized":"2024-09-15T23:23:10.879088+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:12.472633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878586+0000","last_change":"2024-09-15T23:23:09.889164+0000","last_active":"2024-09-15T23:23:10.878586+0000","last_peered":"2024-09-15T23:23:10.878586+0000","last_clean":"2024-09-15T23:23:10.878586+0000","last_became_active":"2024-09-15T23:23:09.888868+0000","last_became_peered":"2024-09-15T23:23:09.888868+0000","last_unstale":"2024-09-15T23:23:10.878586+0000","last_undegraded":"2024-09-15T23:23:10.878586+0000","last_fullsized":"2024-09-15T23:23:10.878586+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:12:17.516107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878136+0000","last_change":"2024-09-15T23:23:09.884750+0000","last_active":"2024-09-15T23:23:10.878136+0000","last_peered":"2024-09-15T23:23:10.878136+0000","last_clean":"2024-09-15T23:23:10.878136+0000","last_became_active":"2024-09-15T23:23:09.884395+0000","last_became_peered":"2024-09-15T23:23:09.884395+0000","last_unstale":"2024-09-15T23:23:10.878136+0000","last_undegraded":"2024-09-15T23:23:10.878136+0000","last_fullsized":"2024-09-15T23:23:10.878136+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:45.924003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388853+0000","last_change":"2024-09-15T23:23:09.889967+0000","last_active":"2024-09-15T23:23:11.388853+0000","last_peered":"2024-09-15T23:23:11.388853+0000","last_clean":"2024-09-15T23:23:11.388853+0000","last_became_active":"2024-09-15T23:23:09.889690+0000","last_became_peered":"2024-09-15T23:23:09.889690+0000","last_unstale":"2024-09-15T23:23:11.388853+0000","last_undegraded":"2024-09-15T23:23:11.388853+0000","last_fullsized":"2024-09-15T23:23:11.388853+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:52.863778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.867875+0000","last_change":"2024-09-15T23:23:07.867875+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.867875+0000","last_undegraded":"2024-09-15T23:23:07.867875+0000","last_fullsized":"2024-09-15T23:23:07.867875+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.865671+0000","last_change":"2024-09-15T23:23:07.865671+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.865671+0000","last_undegraded":"2024-09-15T23:23:07.865671+0000","last_fullsized":"2024-09-15T23:23:07.865671+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878490+0000","last_change":"2024-09-15T23:23:09.893191+0000","last_active":"2024-09-15T23:23:10.878490+0000","last_peered":"2024-09-15T23:23:10.878490+0000","last_clean":"2024-09-15T23:23:10.878490+0000","last_became_active":"2024-09-15T23:23:09.892564+0000","last_became_peered":"2024-09-15T23:23:09.892564+0000","last_unstale":"2024-09-15T23:23:10.878490+0000","last_undegraded":"2024-09-15T23:23:10.878490+0000","last_fullsized":"2024-09-15T23:23:10.878490+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:43:10.307662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1d","version":"193'2","reported_seq":16,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.879004+0000","last_change":"2024-09-15T23:23:08.883380+0000","last_active":"2024-09-15T23:23:10.879004+0000","last_peered":"2024-09-15T23:23:10.879004+0000","last_clean":"2024-09-15T23:23:10.879004+0000","last_became_active":"2024-09-15T23:23:08.883076+0000","last_became_peered":"2024-09-15T23:23:08.883076+0000","last_unstale":"2024-09-15T23:23:10.879004+0000","last_undegraded":"2024-09-15T23:23:10.879004+0000","last_fullsized":"2024-09-15T23:23:10.879004+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:41.150625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878773+0000","last_change":"2024-09-15T23:23:09.889863+0000","last_active":"2024-09-15T23:23:10.878773+0000","last_peered":"2024-09-15T23:23:10.878773+0000","last_clean":"2024-09-15T23:23:10.878773+0000","last_became_active":"2024-09-15T23:23:09.889275+0000","last_became_peered":"2024-09-15T23:23:09.889275+0000","last_unstale":"2024-09-15T23:23:10.878773+0000","last_undegraded":"2024-09-15T23:23:10.878773+0000","last_fullsized":"2024-09-15T23:23:10.878773+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:48.682646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.866154+0000","last_change":"2024-09-15T23:23:07.866154+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.866154+0000","last_undegraded":"2024-09-15T23:23:07.866154+0000","last_fullsized":"2024-09-15T23:23:07.866154+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.1a","version":"193'1","reported_seq":15,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389577+0000","last_change":"2024-09-15T23:23:08.884833+0000","last_active":"2024-09-15T23:23:11.389577+0000","last_peered":"2024-09-15T23:23:11.389577+0000","last_clean":"2024-09-15T23:23:11.389577+0000","last_became_active":"2024-09-15T23:23:08.884446+0000","last_became_peered":"2024-09-15T23:23:08.884446+0000","last_unstale":"2024-09-15T23:23:11.389577+0000","last_undegraded":"2024-09-15T23:23:11.389577+0000","last_fullsized":"2024-09-15T23:23:11.389577+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:25:43.826245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389249+0000","last_change":"2024-09-15T23:23:09.887857+0000","last_active":"2024-09-15T23:23:11.389249+0000","last_peered":"2024-09-15T23:23:11.389249+0000","last_clean":"2024-09-15T23:23:11.389249+0000","last_became_active":"2024-09-15T23:23:09.887005+0000","last_became_peered":"2024-09-15T23:23:09.887005+0000","last_unstale":"2024-09-15T23:23:11.389249+0000","last_undegraded":"2024-09-15T23:23:11.389249+0000","last_fullsized":"2024-09-15T23:23:11.389249+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:13.448014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878250+0000","last_change":"2024-09-15T23:23:08.887529+0000","last_active":"2024-09-15T23:23:10.878250+0000","last_peered":"2024-09-15T23:23:10.878250+0000","last_clean":"2024-09-15T23:23:10.878250+0000","last_became_active":"2024-09-15T23:23:08.887256+0000","last_became_peered":"2024-09-15T23:23:08.887256+0000","last_unstale":"2024-09-15T23:23:10.878250+0000","last_undegraded":"2024-09-15T23:23:10.878250+0000","last_fullsized":"2024-09-15T23:23:10.878250+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:34.394956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.866068+0000","last_change":"2024-09-15T23:23:07.866068+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.866068+0000","last_undegraded":"2024-09-15T23:23:07.866068+0000","last_fullsized":"2024-09-15T23:23:07.866068+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878930+0000","last_change":"2024-09-15T23:23:08.882342+0000","last_active":"2024-09-15T23:23:10.878930+0000","last_peered":"2024-09-15T23:23:10.878930+0000","last_clean":"2024-09-15T23:23:10.878930+0000","last_became_active":"2024-09-15T23:23:08.882046+0000","last_became_peered":"2024-09-15T23:23:08.882046+0000","last_unstale":"2024-09-15T23:23:10.878930+0000","last_undegraded":"2024-09-15T23:23:10.878930+0000","last_fullsized":"2024-09-15T23:23:10.878930+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:46.966470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388963+0000","last_change":"2024-09-15T23:23:09.887039+0000","last_active":"2024-09-15T23:23:11.388963+0000","last_peered":"2024-09-15T23:23:11.388963+0000","last_clean":"2024-09-15T23:23:11.388963+0000","last_became_active":"2024-09-15T23:23:09.886178+0000","last_became_peered":"2024-09-15T23:23:09.886178+0000","last_unstale":"2024-09-15T23:23:11.388963+0000","last_undegraded":"2024-09-15T23:23:11.388963+0000","last_fullsized":"2024-09-15T23:23:11.388963+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:24.942591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.865590+0000","last_change":"2024-09-15T23:23:07.865590+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.865590+0000","last_undegraded":"2024-09-15T23:23:07.865590+0000","last_fullsized":"2024-09-15T23:23:07.865590+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.15","version":"193'3","reported_seq":17,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.879081+0000","last_change":"2024-09-15T23:23:08.888755+0000","last_active":"2024-09-15T23:23:10.879081+0000","last_peered":"2024-09-15T23:23:10.879081+0000","last_clean":"2024-09-15T23:23:10.879081+0000","last_became_active":"2024-09-15T23:23:08.888250+0000","last_became_peered":"2024-09-15T23:23:08.888250+0000","last_unstale":"2024-09-15T23:23:10.879081+0000","last_undegraded":"2024-09-15T23:23:10.879081+0000","last_fullsized":"2024-09-15T23:23:10.879081+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:08.440981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878357+0000","last_change":"2024-09-15T23:23:09.881198+0000","last_active":"2024-09-15T23:23:10.878357+0000","last_peered":"2024-09-15T23:23:10.878357+0000","last_clean":"2024-09-15T23:23:10.878357+0000","last_became_active":"2024-09-15T23:23:09.880910+0000","last_became_peered":"2024-09-15T23:23:09.880910+0000","last_unstale":"2024-09-15T23:23:10.878357+0000","last_undegraded":"2024-09-15T23:23:10.878357+0000","last_fullsized":"2024-09-15T23:23:10.878357+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:53:34.689769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.867069+0000","last_change":"2024-09-15T23:23:07.867069+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.867069+0000","last_undegraded":"2024-09-15T23:23:07.867069+0000","last_fullsized":"2024-09-15T23:23:07.867069+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388862+0000","last_change":"2024-09-15T23:23:09.890661+0000","last_active":"2024-09-15T23:23:11.388862+0000","last_peered":"2024-09-15T23:23:11.388862+0000","last_clean":"2024-09-15T23:23:11.388862+0000","last_became_active":"2024-09-15T23:23:09.890390+0000","last_became_peered":"2024-09-15T23:23:09.890390+0000","last_unstale":"2024-09-15T23:23:11.388862+0000","last_undegraded":"2024-09-15T23:23:11.388862+0000","last_fullsized":"2024-09-15T23:23:11.388862+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:48.682646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.867063+0000","last_change":"2024-09-15T23:23:07.867063+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.867063+0000","last_undegraded":"2024-09-15T23:23:07.867063+0000","last_fullsized":"2024-09-15T23:23:07.867063+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.879038+0000","last_change":"2024-09-15T23:23:09.890142+0000","last_active":"2024-09-15T23:23:10.879038+0000","last_peered":"2024-09-15T23:23:10.879038+0000","last_clean":"2024-09-15T23:23:10.879038+0000","last_became_active":"2024-09-15T23:23:09.889857+0000","last_became_peered":"2024-09-15T23:23:09.889857+0000","last_unstale":"2024-09-15T23:23:10.879038+0000","last_undegraded":"2024-09-15T23:23:10.879038+0000","last_fullsized":"2024-09-15T23:23:10.879038+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:24.942591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.865223+0000","last_change":"2024-09-15T23:23:07.865223+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.865223+0000","last_undegraded":"2024-09-15T23:23:07.865223+0000","last_fullsized":"2024-09-15T23:23:07.865223+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.877739+0000","last_change":"2024-09-15T23:23:09.894373+0000","last_active":"2024-09-15T23:23:10.877739+0000","last_peered":"2024-09-15T23:23:10.877739+0000","last_clean":"2024-09-15T23:23:10.877739+0000","last_became_active":"2024-09-15T23:23:09.894027+0000","last_became_peered":"2024-09-15T23:23:09.894027+0000","last_unstale":"2024-09-15T23:23:10.877739+0000","last_undegraded":"2024-09-15T23:23:10.877739+0000","last_fullsized":"2024-09-15T23:23:10.877739+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:05:43.347414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878324+0000","last_change":"2024-09-15T23:23:08.883287+0000","last_active":"2024-09-15T23:23:10.878324+0000","last_peered":"2024-09-15T23:23:10.878324+0000","last_clean":"2024-09-15T23:23:10.878324+0000","last_became_active":"2024-09-15T23:23:08.882904+0000","last_became_peered":"2024-09-15T23:23:08.882904+0000","last_unstale":"2024-09-15T23:23:10.878324+0000","last_undegraded":"2024-09-15T23:23:10.878324+0000","last_fullsized":"2024-09-15T23:23:10.878324+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:34:43.070529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389575+0000","last_change":"2024-09-15T23:23:09.887792+0000","last_active":"2024-09-15T23:23:11.389575+0000","last_peered":"2024-09-15T23:23:11.389575+0000","last_clean":"2024-09-15T23:23:11.389575+0000","last_became_active":"2024-09-15T23:23:09.887392+0000","last_became_peered":"2024-09-15T23:23:09.887392+0000","last_unstale":"2024-09-15T23:23:11.389575+0000","last_undegraded":"2024-09-15T23:23:11.389575+0000","last_fullsized":"2024-09-15T23:23:11.389575+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:09.448279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.10","version":"193'8","reported_seq":22,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878455+0000","last_change":"2024-09-15T23:23:08.880773+0000","last_active":"2024-09-15T23:23:10.878455+0000","last_peered":"2024-09-15T23:23:10.878455+0000","last_clean":"2024-09-15T23:23:10.878455+0000","last_became_active":"2024-09-15T23:23:08.880261+0000","last_became_peered":"2024-09-15T23:23:08.880261+0000","last_unstale":"2024-09-15T23:23:10.878455+0000","last_undegraded":"2024-09-15T23:23:10.878455+0000","last_fullsized":"2024-09-15T23:23:10.878455+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:32.801604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.f","version":"193'1","reported_seq":15,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389869+0000","last_change":"2024-09-15T23:23:08.887550+0000","last_active":"2024-09-15T23:23:11.389869+0000","last_peered":"2024-09-15T23:23:11.389869+0000","last_clean":"2024-09-15T23:23:11.389869+0000","last_became_active":"2024-09-15T23:23:08.887255+0000","last_became_peered":"2024-09-15T23:23:08.887255+0000","last_unstale":"2024-09-15T23:23:11.389869+0000","last_undegraded":"2024-09-15T23:23:11.389869+0000","last_fullsized":"2024-09-15T23:23:11.389869+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:56.677486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.867227+0000","last_change":"2024-09-15T23:23:07.867227+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.867227+0000","last_undegraded":"2024-09-15T23:23:07.867227+0000","last_fullsized":"2024-09-15T23:23:07.867227+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878585+0000","last_change":"2024-09-15T23:23:09.893387+0000","last_active":"2024-09-15T23:23:10.878585+0000","last_peered":"2024-09-15T23:23:10.878585+0000","last_clean":"2024-09-15T23:23:10.878585+0000","last_became_active":"2024-09-15T23:23:09.892927+0000","last_became_peered":"2024-09-15T23:23:09.892927+0000","last_unstale":"2024-09-15T23:23:10.878585+0000","last_undegraded":"2024-09-15T23:23:10.878585+0000","last_fullsized":"2024-09-15T23:23:10.878585+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:56.972413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.d","version":"193'1","reported_seq":15,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389475+0000","last_change":"2024-09-15T23:23:08.880228+0000","last_active":"2024-09-15T23:23:11.389475+0000","last_peered":"2024-09-15T23:23:11.389475+0000","last_clean":"2024-09-15T23:23:11.389475+0000","last_became_active":"2024-09-15T23:23:08.879937+0000","last_became_peered":"2024-09-15T23:23:08.879937+0000","last_unstale":"2024-09-15T23:23:11.389475+0000","last_undegraded":"2024-09-15T23:23:11.389475+0000","last_fullsized":"2024-09-15T23:23:11.389475+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:06.986864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389822+0000","last_change":"2024-09-15T23:23:09.900172+0000","last_active":"2024-09-15T23:23:11.389822+0000","last_peered":"2024-09-15T23:23:11.389822+0000","last_clean":"2024-09-15T23:23:11.389822+0000","last_became_active":"2024-09-15T23:23:09.899812+0000","last_became_peered":"2024-09-15T23:23:09.899812+0000","last_unstale":"2024-09-15T23:23:11.389822+0000","last_undegraded":"2024-09-15T23:23:11.389822+0000","last_fullsized":"2024-09-15T23:23:11.389822+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:48:35.079778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389230+0000","last_change":"2024-09-15T23:23:08.884635+0000","last_active":"2024-09-15T23:23:11.389230+0000","last_peered":"2024-09-15T23:23:11.389230+0000","last_clean":"2024-09-15T23:23:11.389230+0000","last_became_active":"2024-09-15T23:23:08.884343+0000","last_became_peered":"2024-09-15T23:23:08.884343+0000","last_unstale":"2024-09-15T23:23:11.389230+0000","last_undegraded":"2024-09-15T23:23:11.389230+0000","last_fullsized":"2024-09-15T23:23:11.389230+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:28.713430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.877765+0000","last_change":"2024-09-15T23:23:09.896745+0000","last_active":"2024-09-15T23:23:10.877765+0000","last_peered":"2024-09-15T23:23:10.877765+0000","last_clean":"2024-09-15T23:23:10.877765+0000","last_became_active":"2024-09-15T23:23:09.895939+0000","last_became_peered":"2024-09-15T23:23:09.895939+0000","last_unstale":"2024-09-15T23:23:10.877765+0000","last_undegraded":"2024-09-15T23:23:10.877765+0000","last_fullsized":"2024-09-15T23:23:10.877765+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:27.624450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.b","version":"193'2","reported_seq":16,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388819+0000","last_change":"2024-09-15T23:23:08.881657+0000","last_active":"2024-09-15T23:23:11.388819+0000","last_peered":"2024-09-15T23:23:11.388819+0000","last_clean":"2024-09-15T23:23:11.388819+0000","last_became_active":"2024-09-15T23:23:08.881338+0000","last_became_peered":"2024-09-15T23:23:08.881338+0000","last_unstale":"2024-09-15T23:23:11.388819+0000","last_undegraded":"2024-09-15T23:23:11.388819+0000","last_fullsized":"2024-09-15T23:23:11.388819+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:44.916704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389406+0000","last_change":"2024-09-15T23:23:09.899726+0000","last_active":"2024-09-15T23:23:11.389406+0000","last_peered":"2024-09-15T23:23:11.389406+0000","last_clean":"2024-09-15T23:23:11.389406+0000","last_became_active":"2024-09-15T23:23:09.898418+0000","last_became_peered":"2024-09-15T23:23:09.898418+0000","last_unstale":"2024-09-15T23:23:11.389406+0000","last_undegraded":"2024-09-15T23:23:11.389406+0000","last_fullsized":"2024-09-15T23:23:11.389406+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:58.508749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878430+0000","last_change":"2024-09-15T23:23:08.885820+0000","last_active":"2024-09-15T23:23:10.878430+0000","last_peered":"2024-09-15T23:23:10.878430+0000","last_clean":"2024-09-15T23:23:10.878430+0000","last_became_active":"2024-09-15T23:23:08.885545+0000","last_became_peered":"2024-09-15T23:23:08.885545+0000","last_unstale":"2024-09-15T23:23:10.878430+0000","last_undegraded":"2024-09-15T23:23:10.878430+0000","last_fullsized":"2024-09-15T23:23:10.878430+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:06.790571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878190+0000","last_change":"2024-09-15T23:23:08.886258+0000","last_active":"2024-09-15T23:23:10.878190+0000","last_peered":"2024-09-15T23:23:10.878190+0000","last_clean":"2024-09-15T23:23:10.878190+0000","last_became_active":"2024-09-15T23:23:08.884216+0000","last_became_peered":"2024-09-15T23:23:08.884216+0000","last_unstale":"2024-09-15T23:23:10.878190+0000","last_undegraded":"2024-09-15T23:23:10.878190+0000","last_fullsized":"2024-09-15T23:23:10.878190+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:39.101978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878528+0000","last_change":"2024-09-15T23:23:08.889246+0000","last_active":"2024-09-15T23:23:10.878528+0000","last_peered":"2024-09-15T23:23:10.878528+0000","last_clean":"2024-09-15T23:23:10.878528+0000","last_became_active":"2024-09-15T23:23:08.888672+0000","last_became_peered":"2024-09-15T23:23:08.888672+0000","last_unstale":"2024-09-15T23:23:10.878528+0000","last_undegraded":"2024-09-15T23:23:10.878528+0000","last_fullsized":"2024-09-15T23:23:10.878528+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:16.675069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.7","version":"193'2","reported_seq":16,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878776+0000","last_change":"2024-09-15T23:23:08.881862+0000","last_active":"2024-09-15T23:23:10.878776+0000","last_peered":"2024-09-15T23:23:10.878776+0000","last_clean":"2024-09-15T23:23:10.878776+0000","last_became_active":"2024-09-15T23:23:08.881581+0000","last_became_peered":"2024-09-15T23:23:08.881581+0000","last_unstale":"2024-09-15T23:23:10.878776+0000","last_undegraded":"2024-09-15T23:23:10.878776+0000","last_fullsized":"2024-09-15T23:23:10.878776+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:57.501450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389734+0000","last_change":"2024-09-15T23:23:09.888350+0000","last_active":"2024-09-15T23:23:11.389734+0000","last_peered":"2024-09-15T23:23:11.389734+0000","last_clean":"2024-09-15T23:23:11.389734+0000","last_became_active":"2024-09-15T23:23:09.887980+0000","last_became_peered":"2024-09-15T23:23:09.887980+0000","last_unstale":"2024-09-15T23:23:11.389734+0000","last_undegraded":"2024-09-15T23:23:11.389734+0000","last_fullsized":"2024-09-15T23:23:11.389734+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:33.808903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.865216+0000","last_change":"2024-09-15T23:23:07.865216+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.865216+0000","last_undegraded":"2024-09-15T23:23:07.865216+0000","last_fullsized":"2024-09-15T23:23:07.865216+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389860+0000","last_change":"2024-09-15T23:23:08.885600+0000","last_active":"2024-09-15T23:23:11.389860+0000","last_peered":"2024-09-15T23:23:11.389860+0000","last_clean":"2024-09-15T23:23:11.389860+0000","last_became_active":"2024-09-15T23:23:08.885248+0000","last_became_peered":"2024-09-15T23:23:08.885248+0000","last_unstale":"2024-09-15T23:23:11.389860+0000","last_undegraded":"2024-09-15T23:23:11.389860+0000","last_fullsized":"2024-09-15T23:23:11.389860+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:18:41.964218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389195+0000","last_change":"2024-09-15T23:23:08.887072+0000","last_active":"2024-09-15T23:23:11.389195+0000","last_peered":"2024-09-15T23:23:11.389195+0000","last_clean":"2024-09-15T23:23:11.389195+0000","last_became_active":"2024-09-15T23:23:08.886725+0000","last_became_peered":"2024-09-15T23:23:08.886725+0000","last_unstale":"2024-09-15T23:23:11.389195+0000","last_undegraded":"2024-09-15T23:23:11.389195+0000","last_fullsized":"2024-09-15T23:23:11.389195+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:45:01.490349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389480+0000","last_change":"2024-09-15T23:23:09.898656+0000","last_active":"2024-09-15T23:23:11.389480+0000","last_peered":"2024-09-15T23:23:11.389480+0000","last_clean":"2024-09-15T23:23:11.389480+0000","last_became_active":"2024-09-15T23:23:09.898380+0000","last_became_peered":"2024-09-15T23:23:09.898380+0000","last_unstale":"2024-09-15T23:23:11.389480+0000","last_undegraded":"2024-09-15T23:23:11.389480+0000","last_fullsized":"2024-09-15T23:23:11.389480+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:34:44.077827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.865565+0000","last_change":"2024-09-15T23:23:07.865565+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.865565+0000","last_undegraded":"2024-09-15T23:23:07.865565+0000","last_fullsized":"2024-09-15T23:23:07.865565+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.877954+0000","last_change":"2024-09-15T23:23:08.889390+0000","last_active":"2024-09-15T23:23:10.877954+0000","last_peered":"2024-09-15T23:23:10.877954+0000","last_clean":"2024-09-15T23:23:10.877954+0000","last_became_active":"2024-09-15T23:23:08.889130+0000","last_became_peered":"2024-09-15T23:23:08.889130+0000","last_unstale":"2024-09-15T23:23:10.877954+0000","last_undegraded":"2024-09-15T23:23:10.877954+0000","last_fullsized":"2024-09-15T23:23:10.877954+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:00:26.192065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878132+0000","last_change":"2024-09-15T23:23:09.887444+0000","last_active":"2024-09-15T23:23:10.878132+0000","last_peered":"2024-09-15T23:23:10.878132+0000","last_clean":"2024-09-15T23:23:10.878132+0000","last_became_active":"2024-09-15T23:23:09.887177+0000","last_became_peered":"2024-09-15T23:23:09.887177+0000","last_unstale":"2024-09-15T23:23:10.878132+0000","last_undegraded":"2024-09-15T23:23:10.878132+0000","last_fullsized":"2024-09-15T23:23:10.878132+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:49.433015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.867500+0000","last_change":"2024-09-15T23:23:07.867500+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.867500+0000","last_undegraded":"2024-09-15T23:23:07.867500+0000","last_fullsized":"2024-09-15T23:23:07.867500+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:23:08.861300+0000","last_change":"2024-09-15T23:23:08.861300+0000","last_active":"2024-09-15T23:23:08.861300+0000","last_peered":"2024-09-15T23:23:08.861300+0000","last_clean":"2024-09-15T23:23:08.861300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:08.861300+0000","last_undegraded":"2024-09-15T23:23:08.861300+0000","last_fullsized":"2024-09-15T23:23:08.861300+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.865589+0000","last_change":"2024-09-15T23:23:07.865589+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.865589+0000","last_undegraded":"2024-09-15T23:23:07.865589+0000","last_fullsized":"2024-09-15T23:23:07.865589+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878709+0000","last_change":"2024-09-15T23:23:09.895737+0000","last_active":"2024-09-15T23:23:10.878709+0000","last_peered":"2024-09-15T23:23:10.878709+0000","last_clean":"2024-09-15T23:23:10.878709+0000","last_became_active":"2024-09-15T23:23:09.895480+0000","last_became_peered":"2024-09-15T23:23:09.895480+0000","last_unstale":"2024-09-15T23:23:10.878709+0000","last_undegraded":"2024-09-15T23:23:10.878709+0000","last_fullsized":"2024-09-15T23:23:10.878709+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:52.863778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":1,"reported_epoch":191,"state":"creating+peering","last_fresh":"2024-09-15T23:23:07.865208+0000","last_change":"2024-09-15T23:23:07.865208+0000","last_active":"2024-09-15T23:23:07.854002+0000","last_peered":"2024-09-15T23:23:07.854002+0000","last_clean":"2024-09-15T23:23:07.854002+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:23:07.865208+0000","last_undegraded":"2024-09-15T23:23:07.865208+0000","last_fullsized":"2024-09-15T23:23:07.865208+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":486,"reported_epoch":191,"state":"active+clean","last_fresh":"2024-09-15T23:23:07.862631+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:23:07.862631+0000","last_peered":"2024-09-15T23:23:07.862631+0000","last_clean":"2024-09-15T23:23:07.862631+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:23:07.862631+0000","last_undegraded":"2024-09-15T23:23:07.862631+0000","last_fullsized":"2024-09-15T23:23:07.862631+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":182,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":72,"acting":72,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59900,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311940,"statfs":{"total":96636764160,"available":96575426560,"internally_reserved":0,"allocated":2392064,"data_stored":1057737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55740,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316100,"statfs":{"total":96636764160,"available":96579686400,"internally_reserved":0,"allocated":2392064,"data_stored":1057737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56304,"kb_used_data":2904,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315536,"statfs":{"total":96636764160,"available":96579108864,"internally_reserved":0,"allocated":2973696,"data_stored":1642288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51580,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320260,"statfs":{"total":96636764160,"available":96583946240,"internally_reserved":0,"allocated":2392064,"data_stored":1057737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542281,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51612,"kb_used_data":2376,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320228,"statfs":{"total":96636764160,"available":96583913472,"internally_reserved":0,"allocated":2433024,"data_stored":1077109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542281,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55780,"kb_used_data":2376,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316060,"statfs":{"total":96636764160,"available":96579645440,"internally_reserved":0,"allocated":2433024,"data_stored":1077157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542280,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60528,"kb_used_data":2956,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311312,"statfs":{"total":96636764160,"available":96574783488,"internally_reserved":0,"allocated":3026944,"data_stored":1661883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542282,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59932,"kb_used_data":2376,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311908,"statfs":{"total":96636764160,"available":96575393792,"internally_reserved":0,"allocated":2433024,"data_stored":1077177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:23:13.486 INFO:tasks.ceph.ceph_manager.ceph:PG 27.3e is not active+clean 2024-09-15T23:23:13.486 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:23:08.861300+0000', 'last_change': '2024-09-15T23:23:08.861300+0000', 'last_active': '2024-09-15T23:23:08.861300+0000', 'last_peered': '2024-09-15T23:23:08.861300+0000', 'last_clean': '2024-09-15T23:23:08.861300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:08.861300+0000', 'last_undegraded': '2024-09-15T23:23:08.861300+0000', 'last_fullsized': '2024-09-15T23:23:08.861300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:23:13.486 INFO:tasks.ceph.ceph_manager.ceph:PG 27.3c is not active+clean 2024-09-15T23:23:13.486 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:23:08.861300+0000', 'last_change': '2024-09-15T23:23:08.861300+0000', 'last_active': '2024-09-15T23:23:08.861300+0000', 'last_peered': '2024-09-15T23:23:08.861300+0000', 'last_clean': '2024-09-15T23:23:08.861300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:08.861300+0000', 'last_undegraded': '2024-09-15T23:23:08.861300+0000', 'last_fullsized': '2024-09-15T23:23:08.861300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:23:13.487 INFO:tasks.ceph.ceph_manager.ceph:PG 27.37 is not active+clean 2024-09-15T23:23:13.487 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:23:08.861300+0000', 'last_change': '2024-09-15T23:23:08.861300+0000', 'last_active': '2024-09-15T23:23:08.861300+0000', 'last_peered': '2024-09-15T23:23:08.861300+0000', 'last_clean': '2024-09-15T23:23:08.861300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:08.861300+0000', 'last_undegraded': '2024-09-15T23:23:08.861300+0000', 'last_fullsized': '2024-09-15T23:23:08.861300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:23:13.487 INFO:tasks.ceph.ceph_manager.ceph:PG 27.34 is not active+clean 2024-09-15T23:23:13.487 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:23:08.861300+0000', 'last_change': '2024-09-15T23:23:08.861300+0000', 'last_active': '2024-09-15T23:23:08.861300+0000', 'last_peered': '2024-09-15T23:23:08.861300+0000', 'last_clean': '2024-09-15T23:23:08.861300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:08.861300+0000', 'last_undegraded': '2024-09-15T23:23:08.861300+0000', 'last_fullsized': '2024-09-15T23:23:08.861300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:23:13.487 INFO:tasks.ceph.ceph_manager.ceph:PG 27.33 is not active+clean 2024-09-15T23:23:13.487 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:23:08.861300+0000', 'last_change': '2024-09-15T23:23:08.861300+0000', 'last_active': '2024-09-15T23:23:08.861300+0000', 'last_peered': '2024-09-15T23:23:08.861300+0000', 'last_clean': '2024-09-15T23:23:08.861300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:08.861300+0000', 'last_undegraded': '2024-09-15T23:23:08.861300+0000', 'last_fullsized': '2024-09-15T23:23:08.861300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:23:13.487 INFO:tasks.ceph.ceph_manager.ceph:PG 27.2b is not active+clean 2024-09-15T23:23:13.487 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:23:08.861300+0000', 'last_change': '2024-09-15T23:23:08.861300+0000', 'last_active': '2024-09-15T23:23:08.861300+0000', 'last_peered': '2024-09-15T23:23:08.861300+0000', 'last_clean': '2024-09-15T23:23:08.861300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:08.861300+0000', 'last_undegraded': '2024-09-15T23:23:08.861300+0000', 'last_fullsized': '2024-09-15T23:23:08.861300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:23:13.487 INFO:tasks.ceph.ceph_manager.ceph:PG 27.2a is not active+clean 2024-09-15T23:23:13.487 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:23:08.861300+0000', 'last_change': '2024-09-15T23:23:08.861300+0000', 'last_active': '2024-09-15T23:23:08.861300+0000', 'last_peered': '2024-09-15T23:23:08.861300+0000', 'last_clean': '2024-09-15T23:23:08.861300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:08.861300+0000', 'last_undegraded': '2024-09-15T23:23:08.861300+0000', 'last_fullsized': '2024-09-15T23:23:08.861300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:23:13.488 INFO:tasks.ceph.ceph_manager.ceph:PG 27.29 is not active+clean 2024-09-15T23:23:13.488 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:23:08.861300+0000', 'last_change': '2024-09-15T23:23:08.861300+0000', 'last_active': '2024-09-15T23:23:08.861300+0000', 'last_peered': '2024-09-15T23:23:08.861300+0000', 'last_clean': '2024-09-15T23:23:08.861300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:08.861300+0000', 'last_undegraded': '2024-09-15T23:23:08.861300+0000', 'last_fullsized': '2024-09-15T23:23:08.861300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:23:13.488 INFO:tasks.ceph.ceph_manager.ceph:PG 27.28 is not active+clean 2024-09-15T23:23:13.488 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:23:08.861300+0000', 'last_change': '2024-09-15T23:23:08.861300+0000', 'last_active': '2024-09-15T23:23:08.861300+0000', 'last_peered': '2024-09-15T23:23:08.861300+0000', 'last_clean': '2024-09-15T23:23:08.861300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:08.861300+0000', 'last_undegraded': '2024-09-15T23:23:08.861300+0000', 'last_fullsized': '2024-09-15T23:23:08.861300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:23:13.488 INFO:tasks.ceph.ceph_manager.ceph:PG 27.27 is not active+clean 2024-09-15T23:23:13.488 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:23:08.861300+0000', 'last_change': '2024-09-15T23:23:08.861300+0000', 'last_active': '2024-09-15T23:23:08.861300+0000', 'last_peered': '2024-09-15T23:23:08.861300+0000', 'last_clean': '2024-09-15T23:23:08.861300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:08.861300+0000', 'last_undegraded': '2024-09-15T23:23:08.861300+0000', 'last_fullsized': '2024-09-15T23:23:08.861300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:23:13.488 INFO:tasks.ceph.ceph_manager.ceph:PG 27.25 is not active+clean 2024-09-15T23:23:13.488 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:23:08.861300+0000', 'last_change': '2024-09-15T23:23:08.861300+0000', 'last_active': '2024-09-15T23:23:08.861300+0000', 'last_peered': '2024-09-15T23:23:08.861300+0000', 'last_clean': '2024-09-15T23:23:08.861300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:08.861300+0000', 'last_undegraded': '2024-09-15T23:23:08.861300+0000', 'last_fullsized': '2024-09-15T23:23:08.861300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:23:13.488 INFO:tasks.ceph.ceph_manager.ceph:PG 27.23 is not active+clean 2024-09-15T23:23:13.488 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:23:08.861300+0000', 'last_change': '2024-09-15T23:23:08.861300+0000', 'last_active': '2024-09-15T23:23:08.861300+0000', 'last_peered': '2024-09-15T23:23:08.861300+0000', 'last_clean': '2024-09-15T23:23:08.861300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:08.861300+0000', 'last_undegraded': '2024-09-15T23:23:08.861300+0000', 'last_fullsized': '2024-09-15T23:23:08.861300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:23:13.488 INFO:tasks.ceph.ceph_manager.ceph:PG 27.22 is not active+clean 2024-09-15T23:23:13.489 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:23:08.861300+0000', 'last_change': '2024-09-15T23:23:08.861300+0000', 'last_active': '2024-09-15T23:23:08.861300+0000', 'last_peered': '2024-09-15T23:23:08.861300+0000', 'last_clean': '2024-09-15T23:23:08.861300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:08.861300+0000', 'last_undegraded': '2024-09-15T23:23:08.861300+0000', 'last_fullsized': '2024-09-15T23:23:08.861300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:23:13.489 INFO:tasks.ceph.ceph_manager.ceph:PG 27.1e is not active+clean 2024-09-15T23:23:13.489 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:23:08.861300+0000', 'last_change': '2024-09-15T23:23:08.861300+0000', 'last_active': '2024-09-15T23:23:08.861300+0000', 'last_peered': '2024-09-15T23:23:08.861300+0000', 'last_clean': '2024-09-15T23:23:08.861300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:08.861300+0000', 'last_undegraded': '2024-09-15T23:23:08.861300+0000', 'last_fullsized': '2024-09-15T23:23:08.861300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:23:13.489 INFO:tasks.ceph.ceph_manager.ceph:PG 26.1f is not active+clean 2024-09-15T23:23:13.489 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 191, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:23:07.867875+0000', 'last_change': '2024-09-15T23:23:07.867875+0000', 'last_active': '2024-09-15T23:23:07.854002+0000', 'last_peered': '2024-09-15T23:23:07.854002+0000', 'last_clean': '2024-09-15T23:23:07.854002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:07.867875+0000', 'last_undegraded': '2024-09-15T23:23:07.867875+0000', 'last_fullsized': '2024-09-15T23:23:07.867875+0000', 'mapping_epoch': 191, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 191, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:23:13.489 INFO:tasks.ceph.ceph_manager.ceph:PG 27.1f is not active+clean 2024-09-15T23:23:13.489 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:23:08.861300+0000', 'last_change': '2024-09-15T23:23:08.861300+0000', 'last_active': '2024-09-15T23:23:08.861300+0000', 'last_peered': '2024-09-15T23:23:08.861300+0000', 'last_clean': '2024-09-15T23:23:08.861300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:08.861300+0000', 'last_undegraded': '2024-09-15T23:23:08.861300+0000', 'last_fullsized': '2024-09-15T23:23:08.861300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:23:13.489 INFO:tasks.ceph.ceph_manager.ceph:PG 26.1e is not active+clean 2024-09-15T23:23:13.489 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 191, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:23:07.865671+0000', 'last_change': '2024-09-15T23:23:07.865671+0000', 'last_active': '2024-09-15T23:23:07.854002+0000', 'last_peered': '2024-09-15T23:23:07.854002+0000', 'last_clean': '2024-09-15T23:23:07.854002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:07.865671+0000', 'last_undegraded': '2024-09-15T23:23:07.865671+0000', 'last_fullsized': '2024-09-15T23:23:07.865671+0000', 'mapping_epoch': 191, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 191, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:23:13.489 INFO:tasks.ceph.ceph_manager.ceph:PG 26.1c is not active+clean 2024-09-15T23:23:13.489 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 191, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:23:07.866154+0000', 'last_change': '2024-09-15T23:23:07.866154+0000', 'last_active': '2024-09-15T23:23:07.854002+0000', 'last_peered': '2024-09-15T23:23:07.854002+0000', 'last_clean': '2024-09-15T23:23:07.854002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:07.866154+0000', 'last_undegraded': '2024-09-15T23:23:07.866154+0000', 'last_fullsized': '2024-09-15T23:23:07.866154+0000', 'mapping_epoch': 191, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 191, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:23:13.490 INFO:tasks.ceph.ceph_manager.ceph:PG 27.1b is not active+clean 2024-09-15T23:23:13.490 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:23:08.861300+0000', 'last_change': '2024-09-15T23:23:08.861300+0000', 'last_active': '2024-09-15T23:23:08.861300+0000', 'last_peered': '2024-09-15T23:23:08.861300+0000', 'last_clean': '2024-09-15T23:23:08.861300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:08.861300+0000', 'last_undegraded': '2024-09-15T23:23:08.861300+0000', 'last_fullsized': '2024-09-15T23:23:08.861300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:23:13.490 INFO:tasks.ceph.ceph_manager.ceph:PG 27.19 is not active+clean 2024-09-15T23:23:13.490 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:23:08.861300+0000', 'last_change': '2024-09-15T23:23:08.861300+0000', 'last_active': '2024-09-15T23:23:08.861300+0000', 'last_peered': '2024-09-15T23:23:08.861300+0000', 'last_clean': '2024-09-15T23:23:08.861300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:08.861300+0000', 'last_undegraded': '2024-09-15T23:23:08.861300+0000', 'last_fullsized': '2024-09-15T23:23:08.861300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:23:13.490 INFO:tasks.ceph.ceph_manager.ceph:PG 26.18 is not active+clean 2024-09-15T23:23:13.490 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 191, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:23:07.866068+0000', 'last_change': '2024-09-15T23:23:07.866068+0000', 'last_active': '2024-09-15T23:23:07.854002+0000', 'last_peered': '2024-09-15T23:23:07.854002+0000', 'last_clean': '2024-09-15T23:23:07.854002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:07.866068+0000', 'last_undegraded': '2024-09-15T23:23:07.866068+0000', 'last_fullsized': '2024-09-15T23:23:07.866068+0000', 'mapping_epoch': 191, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 191, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:23:13.490 INFO:tasks.ceph.ceph_manager.ceph:PG 27.16 is not active+clean 2024-09-15T23:23:13.490 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:23:08.861300+0000', 'last_change': '2024-09-15T23:23:08.861300+0000', 'last_active': '2024-09-15T23:23:08.861300+0000', 'last_peered': '2024-09-15T23:23:08.861300+0000', 'last_clean': '2024-09-15T23:23:08.861300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:08.861300+0000', 'last_undegraded': '2024-09-15T23:23:08.861300+0000', 'last_fullsized': '2024-09-15T23:23:08.861300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:23:13.490 INFO:tasks.ceph.ceph_manager.ceph:PG 26.16 is not active+clean 2024-09-15T23:23:13.490 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 191, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:23:07.865590+0000', 'last_change': '2024-09-15T23:23:07.865590+0000', 'last_active': '2024-09-15T23:23:07.854002+0000', 'last_peered': '2024-09-15T23:23:07.854002+0000', 'last_clean': '2024-09-15T23:23:07.854002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:07.865590+0000', 'last_undegraded': '2024-09-15T23:23:07.865590+0000', 'last_fullsized': '2024-09-15T23:23:07.865590+0000', 'mapping_epoch': 191, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 191, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:23:13.491 INFO:tasks.ceph.ceph_manager.ceph:PG 27.14 is not active+clean 2024-09-15T23:23:13.491 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:23:08.861300+0000', 'last_change': '2024-09-15T23:23:08.861300+0000', 'last_active': '2024-09-15T23:23:08.861300+0000', 'last_peered': '2024-09-15T23:23:08.861300+0000', 'last_clean': '2024-09-15T23:23:08.861300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:08.861300+0000', 'last_undegraded': '2024-09-15T23:23:08.861300+0000', 'last_fullsized': '2024-09-15T23:23:08.861300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:23:13.491 INFO:tasks.ceph.ceph_manager.ceph:PG 26.14 is not active+clean 2024-09-15T23:23:13.491 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 191, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:23:07.867069+0000', 'last_change': '2024-09-15T23:23:07.867069+0000', 'last_active': '2024-09-15T23:23:07.854002+0000', 'last_peered': '2024-09-15T23:23:07.854002+0000', 'last_clean': '2024-09-15T23:23:07.854002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:07.867069+0000', 'last_undegraded': '2024-09-15T23:23:07.867069+0000', 'last_fullsized': '2024-09-15T23:23:07.867069+0000', 'mapping_epoch': 191, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 191, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:23:13.491 INFO:tasks.ceph.ceph_manager.ceph:PG 26.13 is not active+clean 2024-09-15T23:23:13.491 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 191, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:23:07.867063+0000', 'last_change': '2024-09-15T23:23:07.867063+0000', 'last_active': '2024-09-15T23:23:07.854002+0000', 'last_peered': '2024-09-15T23:23:07.854002+0000', 'last_clean': '2024-09-15T23:23:07.854002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:07.867063+0000', 'last_undegraded': '2024-09-15T23:23:07.867063+0000', 'last_fullsized': '2024-09-15T23:23:07.867063+0000', 'mapping_epoch': 191, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 191, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:23:13.491 INFO:tasks.ceph.ceph_manager.ceph:PG 26.12 is not active+clean 2024-09-15T23:23:13.491 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 191, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:23:07.865223+0000', 'last_change': '2024-09-15T23:23:07.865223+0000', 'last_active': '2024-09-15T23:23:07.854002+0000', 'last_peered': '2024-09-15T23:23:07.854002+0000', 'last_clean': '2024-09-15T23:23:07.854002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:07.865223+0000', 'last_undegraded': '2024-09-15T23:23:07.865223+0000', 'last_fullsized': '2024-09-15T23:23:07.865223+0000', 'mapping_epoch': 191, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 191, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:23:13.491 INFO:tasks.ceph.ceph_manager.ceph:PG 27.e is not active+clean 2024-09-15T23:23:13.491 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:23:08.861300+0000', 'last_change': '2024-09-15T23:23:08.861300+0000', 'last_active': '2024-09-15T23:23:08.861300+0000', 'last_peered': '2024-09-15T23:23:08.861300+0000', 'last_clean': '2024-09-15T23:23:08.861300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:08.861300+0000', 'last_undegraded': '2024-09-15T23:23:08.861300+0000', 'last_fullsized': '2024-09-15T23:23:08.861300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:23:13.492 INFO:tasks.ceph.ceph_manager.ceph:PG 27.f is not active+clean 2024-09-15T23:23:13.492 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:23:08.861300+0000', 'last_change': '2024-09-15T23:23:08.861300+0000', 'last_active': '2024-09-15T23:23:08.861300+0000', 'last_peered': '2024-09-15T23:23:08.861300+0000', 'last_clean': '2024-09-15T23:23:08.861300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:08.861300+0000', 'last_undegraded': '2024-09-15T23:23:08.861300+0000', 'last_fullsized': '2024-09-15T23:23:08.861300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:23:13.492 INFO:tasks.ceph.ceph_manager.ceph:PG 26.e is not active+clean 2024-09-15T23:23:13.492 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 191, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:23:07.867227+0000', 'last_change': '2024-09-15T23:23:07.867227+0000', 'last_active': '2024-09-15T23:23:07.854002+0000', 'last_peered': '2024-09-15T23:23:07.854002+0000', 'last_clean': '2024-09-15T23:23:07.854002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:07.867227+0000', 'last_undegraded': '2024-09-15T23:23:07.867227+0000', 'last_fullsized': '2024-09-15T23:23:07.867227+0000', 'mapping_epoch': 191, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 191, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:23:13.492 INFO:tasks.ceph.ceph_manager.ceph:PG 27.8 is not active+clean 2024-09-15T23:23:13.492 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:23:08.861300+0000', 'last_change': '2024-09-15T23:23:08.861300+0000', 'last_active': '2024-09-15T23:23:08.861300+0000', 'last_peered': '2024-09-15T23:23:08.861300+0000', 'last_clean': '2024-09-15T23:23:08.861300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:08.861300+0000', 'last_undegraded': '2024-09-15T23:23:08.861300+0000', 'last_fullsized': '2024-09-15T23:23:08.861300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:23:13.492 INFO:tasks.ceph.ceph_manager.ceph:PG 27.9 is not active+clean 2024-09-15T23:23:13.492 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:23:08.861300+0000', 'last_change': '2024-09-15T23:23:08.861300+0000', 'last_active': '2024-09-15T23:23:08.861300+0000', 'last_peered': '2024-09-15T23:23:08.861300+0000', 'last_clean': '2024-09-15T23:23:08.861300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:08.861300+0000', 'last_undegraded': '2024-09-15T23:23:08.861300+0000', 'last_fullsized': '2024-09-15T23:23:08.861300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:23:13.492 INFO:tasks.ceph.ceph_manager.ceph:PG 27.6 is not active+clean 2024-09-15T23:23:13.492 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:23:08.861300+0000', 'last_change': '2024-09-15T23:23:08.861300+0000', 'last_active': '2024-09-15T23:23:08.861300+0000', 'last_peered': '2024-09-15T23:23:08.861300+0000', 'last_clean': '2024-09-15T23:23:08.861300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:08.861300+0000', 'last_undegraded': '2024-09-15T23:23:08.861300+0000', 'last_fullsized': '2024-09-15T23:23:08.861300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:23:13.492 INFO:tasks.ceph.ceph_manager.ceph:PG 26.6 is not active+clean 2024-09-15T23:23:13.493 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 191, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:23:07.865216+0000', 'last_change': '2024-09-15T23:23:07.865216+0000', 'last_active': '2024-09-15T23:23:07.854002+0000', 'last_peered': '2024-09-15T23:23:07.854002+0000', 'last_clean': '2024-09-15T23:23:07.854002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:07.865216+0000', 'last_undegraded': '2024-09-15T23:23:07.865216+0000', 'last_fullsized': '2024-09-15T23:23:07.865216+0000', 'mapping_epoch': 191, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 191, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:23:13.493 INFO:tasks.ceph.ceph_manager.ceph:PG 27.4 is not active+clean 2024-09-15T23:23:13.493 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:23:08.861300+0000', 'last_change': '2024-09-15T23:23:08.861300+0000', 'last_active': '2024-09-15T23:23:08.861300+0000', 'last_peered': '2024-09-15T23:23:08.861300+0000', 'last_clean': '2024-09-15T23:23:08.861300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:08.861300+0000', 'last_undegraded': '2024-09-15T23:23:08.861300+0000', 'last_fullsized': '2024-09-15T23:23:08.861300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:23:13.493 INFO:tasks.ceph.ceph_manager.ceph:PG 27.5 is not active+clean 2024-09-15T23:23:13.493 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:23:08.861300+0000', 'last_change': '2024-09-15T23:23:08.861300+0000', 'last_active': '2024-09-15T23:23:08.861300+0000', 'last_peered': '2024-09-15T23:23:08.861300+0000', 'last_clean': '2024-09-15T23:23:08.861300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:08.861300+0000', 'last_undegraded': '2024-09-15T23:23:08.861300+0000', 'last_fullsized': '2024-09-15T23:23:08.861300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:23:13.493 INFO:tasks.ceph.ceph_manager.ceph:PG 26.3 is not active+clean 2024-09-15T23:23:13.493 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 191, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:23:07.865565+0000', 'last_change': '2024-09-15T23:23:07.865565+0000', 'last_active': '2024-09-15T23:23:07.854002+0000', 'last_peered': '2024-09-15T23:23:07.854002+0000', 'last_clean': '2024-09-15T23:23:07.854002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:07.865565+0000', 'last_undegraded': '2024-09-15T23:23:07.865565+0000', 'last_fullsized': '2024-09-15T23:23:07.865565+0000', 'mapping_epoch': 191, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 191, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:23:13.493 INFO:tasks.ceph.ceph_manager.ceph:PG 27.3 is not active+clean 2024-09-15T23:23:13.493 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:23:08.861300+0000', 'last_change': '2024-09-15T23:23:08.861300+0000', 'last_active': '2024-09-15T23:23:08.861300+0000', 'last_peered': '2024-09-15T23:23:08.861300+0000', 'last_clean': '2024-09-15T23:23:08.861300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:08.861300+0000', 'last_undegraded': '2024-09-15T23:23:08.861300+0000', 'last_fullsized': '2024-09-15T23:23:08.861300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:23:13.493 INFO:tasks.ceph.ceph_manager.ceph:PG 26.1 is not active+clean 2024-09-15T23:23:13.493 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 191, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:23:07.867500+0000', 'last_change': '2024-09-15T23:23:07.867500+0000', 'last_active': '2024-09-15T23:23:07.854002+0000', 'last_peered': '2024-09-15T23:23:07.854002+0000', 'last_clean': '2024-09-15T23:23:07.854002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:07.867500+0000', 'last_undegraded': '2024-09-15T23:23:07.867500+0000', 'last_fullsized': '2024-09-15T23:23:07.867500+0000', 'mapping_epoch': 191, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 191, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:23:13.494 INFO:tasks.ceph.ceph_manager.ceph:PG 27.1 is not active+clean 2024-09-15T23:23:13.494 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '27.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-15T23:23:08.861300+0000', 'last_change': '2024-09-15T23:23:08.861300+0000', 'last_active': '2024-09-15T23:23:08.861300+0000', 'last_peered': '2024-09-15T23:23:08.861300+0000', 'last_clean': '2024-09-15T23:23:08.861300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:08.861300+0000', 'last_undegraded': '2024-09-15T23:23:08.861300+0000', 'last_fullsized': '2024-09-15T23:23:08.861300+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:08.861300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-15T23:23:13.494 INFO:tasks.ceph.ceph_manager.ceph:PG 26.0 is not active+clean 2024-09-15T23:23:13.494 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 191, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:23:07.865589+0000', 'last_change': '2024-09-15T23:23:07.865589+0000', 'last_active': '2024-09-15T23:23:07.854002+0000', 'last_peered': '2024-09-15T23:23:07.854002+0000', 'last_clean': '2024-09-15T23:23:07.854002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:07.865589+0000', 'last_undegraded': '2024-09-15T23:23:07.865589+0000', 'last_fullsized': '2024-09-15T23:23:07.865589+0000', 'mapping_epoch': 191, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 191, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:23:13.494 INFO:tasks.ceph.ceph_manager.ceph:PG 26.1b is not active+clean 2024-09-15T23:23:13.494 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '26.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 191, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:23:07.865208+0000', 'last_change': '2024-09-15T23:23:07.865208+0000', 'last_active': '2024-09-15T23:23:07.854002+0000', 'last_peered': '2024-09-15T23:23:07.854002+0000', 'last_clean': '2024-09-15T23:23:07.854002+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:23:07.865208+0000', 'last_undegraded': '2024-09-15T23:23:07.865208+0000', 'last_fullsized': '2024-09-15T23:23:07.865208+0000', 'mapping_epoch': 191, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 191, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'last_clean_scrub_stamp': '2024-09-15T23:23:07.854002+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:23:13.494 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:23:13.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.619+0000 7f855d3c0640 1 Processor -- start 2024-09-15T23:23:13.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.619+0000 7f855d3c0640 1 -- start start 2024-09-15T23:23:13.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.620+0000 7f855d3c0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85580b6970 0x7f85580b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:13.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.620+0000 7f855d3c0640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85580d0e70 con 0x7f85580d23b0 2024-09-15T23:23:13.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.620+0000 7f855d3c0640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85580d41c0 con 0x7f855815ed20 2024-09-15T23:23:13.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.620+0000 7f855d3c0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f85580d35b0 con 0x7f85580b6970 2024-09-15T23:23:13.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.620+0000 7f85577fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f85580d23b0 0x7f85580b8610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:34878/0 (socket says 172.21.15.123:34878) 2024-09-15T23:23:13.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.620+0000 7f85577fe640 1 -- 172.21.15.123:0/1882743270 learned_addr learned my addr 172.21.15.123:0/1882743270 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:23:13.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.620+0000 7f85567fc640 1 --2- 172.21.15.123:0/1882743270 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85580b6970 0x7f85580b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:13.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.620+0000 7f8555ffb640 1 -- 172.21.15.123:0/1882743270 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2058131463 0 0) 0x7f8550001490 con 0x7f85580d23b0 2024-09-15T23:23:13.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.620+0000 7f8555ffb640 1 -- 172.21.15.123:0/1882743270 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8544003520 con 0x7f85580d23b0 2024-09-15T23:23:13.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.620+0000 7f8555ffb640 1 -- 172.21.15.123:0/1882743270 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 378130616 0 0) 0x7f8544003520 con 0x7f85580d23b0 2024-09-15T23:23:13.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.620+0000 7f8555ffb640 1 -- 172.21.15.123:0/1882743270 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85580b6970 msgr2=0x7f85580b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:13.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.620+0000 7f8555ffb640 1 --2- 172.21.15.123:0/1882743270 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85580b6970 0x7f85580b80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:13.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.620+0000 7f8555ffb640 1 -- 172.21.15.123:0/1882743270 >> v1:172.21.15.188:6789/0 conn(0x7f855815ed20 legacy=0x7f85580b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:13.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.620+0000 7f8555ffb640 1 -- 172.21.15.123:0/1882743270 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85580d3890 con 0x7f85580d23b0 2024-09-15T23:23:13.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.620+0000 7f8555ffb640 1 -- 172.21.15.123:0/1882743270 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f8550001bc0 con 0x7f85580d23b0 2024-09-15T23:23:13.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.620+0000 7f8555ffb640 1 -- 172.21.15.123:0/1882743270 >> v1:172.21.15.123:6789/0 conn(0x7f85580d23b0 legacy=0x7f85580b8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:13.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.620+0000 7f8555ffb640 1 --2- 172.21.15.123:0/1882743270 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85440039e0 0x7f8544003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:13.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.621+0000 7f8555ffb640 1 --2- 172.21.15.123:0/1882743270 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85580b6970 0x7f8544004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:13.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.621+0000 7f8555ffb640 1 --2- 172.21.15.123:0/1882743270 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8544004d40 0x7f85440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:13.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.621+0000 7f8555ffb640 1 -- 172.21.15.123:0/1882743270 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f85580d35b0 con 0x7f85440039e0 2024-09-15T23:23:13.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.621+0000 7f8555ffb640 1 -- 172.21.15.123:0/1882743270 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f854400bb20 con 0x7f8544004d40 2024-09-15T23:23:13.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.621+0000 7f8555ffb640 1 -- 172.21.15.123:0/1882743270 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f854400bd20 con 0x7f85580b6970 2024-09-15T23:23:13.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.621+0000 7f8556ffd640 1 --2- 172.21.15.123:0/1882743270 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85440039e0 0x7f8544003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:13.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.621+0000 7f85577fe640 1 --2- 172.21.15.123:0/1882743270 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8544004d40 0x7f85440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:13.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.621+0000 7f85567fc640 1 --2- 172.21.15.123:0/1882743270 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85580b6970 0x7f8544004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:13.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.621+0000 7f8556ffd640 1 -- 172.21.15.123:0/1882743270 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85580b6970 msgr2=0x7f8544004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:13.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.621+0000 7f8556ffd640 1 --2- 172.21.15.123:0/1882743270 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85580b6970 0x7f8544004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:13.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.621+0000 7f8556ffd640 1 -- 172.21.15.123:0/1882743270 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8544004d40 msgr2=0x7f85440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:13.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.621+0000 7f8556ffd640 1 --2- 172.21.15.123:0/1882743270 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8544004d40 0x7f85440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:13.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.621+0000 7f8556ffd640 1 -- 172.21.15.123:0/1882743270 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8544003520 con 0x7f85440039e0 2024-09-15T23:23:13.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.621+0000 7f85577fe640 1 --2- 172.21.15.123:0/1882743270 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8544004d40 0x7f85440051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:23:13.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.622+0000 7f8556ffd640 1 --2- 172.21.15.123:0/1882743270 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85440039e0 0x7f8544003e00 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7f8548001750 tx=0x7f8544005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5bdb6c33d85ecb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:13.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.622+0000 7f8555ffb640 1 -- 172.21.15.123:0/1882743270 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8548001370 con 0x7f85440039e0 2024-09-15T23:23:13.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.622+0000 7f8555ffb640 1 -- 172.21.15.123:0/1882743270 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85480052d0 con 0x7f85440039e0 2024-09-15T23:23:13.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.622+0000 7f8555ffb640 1 -- 172.21.15.123:0/1882743270 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854802ab20 con 0x7f85440039e0 2024-09-15T23:23:13.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.622+0000 7f855d3c0640 1 -- 172.21.15.123:0/1882743270 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85440039e0 msgr2=0x7f8544003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:13.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.622+0000 7f855d3c0640 1 --2- 172.21.15.123:0/1882743270 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85440039e0 0x7f8544003e00 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7f8548001750 tx=0x7f8544005830 comp rx=0 tx=0).stop 2024-09-15T23:23:13.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.622+0000 7f85577fe640 1 -- 172.21.15.123:0/1882743270 reap_dead start 2024-09-15T23:23:13.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.622+0000 7f855d3c0640 1 -- 172.21.15.123:0/1882743270 shutdown_connections 2024-09-15T23:23:13.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.622+0000 7f855d3c0640 1 -- 172.21.15.123:0/1882743270 >> 172.21.15.123:0/1882743270 conn(0x7f85580d1260 msgr2=0x7f85580d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:13.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.622+0000 7f855d3c0640 1 -- 172.21.15.123:0/1882743270 shutdown_connections 2024-09-15T23:23:13.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.622+0000 7f855d3c0640 1 -- 172.21.15.123:0/1882743270 wait complete. 2024-09-15T23:23:13.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.624+0000 7f855d3c0640 1 Processor -- start 2024-09-15T23:23:13.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.624+0000 7f855d3c0640 1 -- start start 2024-09-15T23:23:13.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.624+0000 7f855d3c0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85440039e0 0x7f85580ce830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:13.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.624+0000 7f855d3c0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85581e97d0 0x7f85581e8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:13.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.624+0000 7f855d3c0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85581e8860 0x7f85581e8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:13.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.624+0000 7f855d3c0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f85580d32a0 con 0x7f85440039e0 2024-09-15T23:23:13.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.624+0000 7f855d3c0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f85580d3e50 con 0x7f85581e8860 2024-09-15T23:23:13.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.624+0000 7f855d3c0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f855815f100 con 0x7f85581e97d0 2024-09-15T23:23:13.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.624+0000 7f8556ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85440039e0 0x7f85580ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:13.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.624+0000 7f8556ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85440039e0 0x7f85580ce830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45042/0 (socket says 172.21.15.123:45042) 2024-09-15T23:23:13.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.624+0000 7f8556ffd640 1 -- 172.21.15.123:0/249005260 learned_addr learned my addr 172.21.15.123:0/249005260 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:13.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.625+0000 7f85567fc640 1 --2- 172.21.15.123:0/249005260 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85581e97d0 0x7f85581e8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:13.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.625+0000 7f85577fe640 1 --2- 172.21.15.123:0/249005260 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85581e8860 0x7f85581e8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:13.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.625+0000 7f8556ffd640 1 -- 172.21.15.123:0/249005260 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85581e97d0 msgr2=0x7f85581e8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:13.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.625+0000 7f8556ffd640 1 --2- 172.21.15.123:0/249005260 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85581e97d0 0x7f85581e8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:13.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.625+0000 7f8556ffd640 1 -- 172.21.15.123:0/249005260 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85581e8860 msgr2=0x7f85581e8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:13.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.625+0000 7f8556ffd640 1 --2- 172.21.15.123:0/249005260 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85581e8860 0x7f85581e8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:13.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.625+0000 7f8556ffd640 1 -- 172.21.15.123:0/249005260 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8558151540 con 0x7f85440039e0 2024-09-15T23:23:13.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.625+0000 7f85567fc640 1 --2- 172.21.15.123:0/249005260 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85581e97d0 0x7f85581e8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:23:13.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.625+0000 7f85577fe640 1 --2- 172.21.15.123:0/249005260 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85581e8860 0x7f85581e8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:23:13.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.625+0000 7f8556ffd640 1 --2- 172.21.15.123:0/249005260 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85440039e0 0x7f85580ce830 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 crypto rx=0x7f854802a4d0 tx=0x7f8548001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:13.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.625+0000 7f854f7fe640 1 -- 172.21.15.123:0/249005260 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8548037040 con 0x7f85440039e0 2024-09-15T23:23:13.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.625+0000 7f854f7fe640 1 -- 172.21.15.123:0/249005260 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8548005480 con 0x7f85440039e0 2024-09-15T23:23:13.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.625+0000 7f855d3c0640 1 -- 172.21.15.123:0/249005260 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85580cc100 con 0x7f85440039e0 2024-09-15T23:23:13.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.625+0000 7f854f7fe640 1 -- 172.21.15.123:0/249005260 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8548007470 con 0x7f85440039e0 2024-09-15T23:23:13.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.625+0000 7f855d3c0640 1 -- 172.21.15.123:0/249005260 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85580ab540 con 0x7f85440039e0 2024-09-15T23:23:13.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.626+0000 7f855d3c0640 1 -- 172.21.15.123:0/249005260 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85580b7010 con 0x7f85440039e0 2024-09-15T23:23:13.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.627+0000 7f854f7fe640 1 -- 172.21.15.123:0/249005260 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8548044020 con 0x7f85440039e0 2024-09-15T23:23:13.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.627+0000 7f854f7fe640 1 --2- 172.21.15.123:0/249005260 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f853806c2e0 0x7f853806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:13.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.627+0000 7f854f7fe640 1 -- 172.21.15.123:0/249005260 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7f85480aafd0 con 0x7f85440039e0 2024-09-15T23:23:13.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.627+0000 7f85567fc640 1 --2- 172.21.15.123:0/249005260 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f853806c2e0 0x7f853806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:13.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.628+0000 7f85567fc640 1 --2- 172.21.15.123:0/249005260 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f853806c2e0 0x7f853806e7a0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f85580cbeb0 tx=0x7f8540008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:13.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.631+0000 7f854f7fe640 1 -- 172.21.15.123:0/249005260 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8558151540 con 0x7f85440039e0 2024-09-15T23:23:13.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.857+0000 7f855d3c0640 1 -- 172.21.15.123:0/249005260 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f85580b3f20 con 0x7f85440039e0 2024-09-15T23:23:13.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.857+0000 7f854f7fe640 1 -- 172.21.15.123:0/249005260 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1222 (secure 0 0 0) 0x7f85480798f0 con 0x7f85440039e0 2024-09-15T23:23:13.858 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:23:13.859 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":684,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":194,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":55},{"state_name":"unknown","count":28},{"state_name":"creating+peering","count":14}],"num_pgs":97,"num_pools":3,"num_objects":13,"data_bytes":590550,"bytes_used":462209024,"bytes_avail":772631904256,"bytes_total":773094113280,"unknown_pgs_ratio":0.28865978121757507,"inactive_pgs_ratio":0.14432989060878754,"write_bytes_sec":767,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":120,"btime":"2024-09-15T23:23:11:879993+0000","id":13,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":13,"rank":0,"name":"a","status":"up:active","gid":10491}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":30,"modified":"2024-09-15T23:22:15.647794+0000","services":{}},"progress_events":{}} 2024-09-15T23:23:13.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.859+0000 7f855d3c0640 1 -- 172.21.15.123:0/249005260 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f853806c2e0 msgr2=0x7f853806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:13.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.859+0000 7f855d3c0640 1 --2- 172.21.15.123:0/249005260 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f853806c2e0 0x7f853806e7a0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f85580cbeb0 tx=0x7f8540008040 comp rx=0 tx=0).stop 2024-09-15T23:23:13.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.859+0000 7f855d3c0640 1 -- 172.21.15.123:0/249005260 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85440039e0 msgr2=0x7f85580ce830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:13.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.859+0000 7f855d3c0640 1 --2- 172.21.15.123:0/249005260 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85440039e0 0x7f85580ce830 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 crypto rx=0x7f854802a4d0 tx=0x7f8548001120 comp rx=0 tx=0).stop 2024-09-15T23:23:13.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.859+0000 7f855d3c0640 1 -- 172.21.15.123:0/249005260 shutdown_connections 2024-09-15T23:23:13.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.859+0000 7f855d3c0640 1 --2- 172.21.15.123:0/249005260 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f85581e8860 0x7f85581e8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:13.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.859+0000 7f855d3c0640 1 --2- 172.21.15.123:0/249005260 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f85581e97d0 0x7f85581e8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:13.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.859+0000 7f855d3c0640 1 --2- 172.21.15.123:0/249005260 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f853806c2e0 0x7f853806e7a0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:13.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.859+0000 7f855d3c0640 1 --2- 172.21.15.123:0/249005260 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f85440039e0 0x7f85580ce830 unknown :-1 s=CLOSED pgs=2243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:13.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.859+0000 7f855d3c0640 1 -- 172.21.15.123:0/249005260 >> 172.21.15.123:0/249005260 conn(0x7f85580d1260 msgr2=0x7f85580cfcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:13.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.859+0000 7f855d3c0640 1 -- 172.21.15.123:0/249005260 shutdown_connections 2024-09-15T23:23:13.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.859+0000 7f855d3c0640 1 -- 172.21.15.123:0/249005260 wait complete. 2024-09-15T23:23:13.871 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-15T23:23:13.871 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:23:13.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.970+0000 7f9845742640 1 Processor -- start 2024-09-15T23:23:13.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.970+0000 7f9845742640 1 -- start start 2024-09-15T23:23:13.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.970+0000 7f9845742640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f984015e990 0x7f98400d2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:13.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.970+0000 7f9845742640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f98400cf030 0x7f98400b6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:13.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.970+0000 7f9845742640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f98400b6740 0x7f984006c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:13.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.970+0000 7f9845742640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f98400d4410 con 0x7f98400cf030 2024-09-15T23:23:13.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.970+0000 7f9845742640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f98400d3370 con 0x7f984015e990 2024-09-15T23:23:13.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.971+0000 7f9845742640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f98400d3650 con 0x7f98400b6740 2024-09-15T23:23:13.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.971+0000 7f983e7fc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f98400cf030 0x7f98400b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:13.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.971+0000 7f983e7fc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f98400cf030 0x7f98400b6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45050/0 (socket says 172.21.15.123:45050) 2024-09-15T23:23:13.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.971+0000 7f983e7fc640 1 -- 172.21.15.123:0/1363615486 learned_addr learned my addr 172.21.15.123:0/1363615486 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:13.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.971+0000 7f983effd640 1 --2- 172.21.15.123:0/1363615486 >> v2:172.21.15.188:3300/0 conn(0x7f984015e990 0x7f98400d2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:13.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.971+0000 7f983f7fe640 1 --2- 172.21.15.123:0/1363615486 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f98400b6740 0x7f984006c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:13.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.971+0000 7f983e7fc640 1 -- 172.21.15.123:0/1363615486 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f98400b6740 msgr2=0x7f984006c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:13.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.971+0000 7f983e7fc640 1 --2- 172.21.15.123:0/1363615486 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f98400b6740 0x7f984006c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:13.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.971+0000 7f983e7fc640 1 -- 172.21.15.123:0/1363615486 >> v2:172.21.15.188:3300/0 conn(0x7f984015e990 msgr2=0x7f98400d2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:13.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.971+0000 7f983e7fc640 1 --2- 172.21.15.123:0/1363615486 >> v2:172.21.15.188:3300/0 conn(0x7f984015e990 0x7f98400d2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:13.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.971+0000 7f983e7fc640 1 -- 172.21.15.123:0/1363615486 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98400d3930 con 0x7f98400cf030 2024-09-15T23:23:13.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.972+0000 7f983e7fc640 1 --2- 172.21.15.123:0/1363615486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98400cf030 0x7f98400b6200 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 crypto rx=0x7f98400d3860 tx=0x7f983402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dcd3b7ec2c6a6f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:13.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.972+0000 7f983dffb640 1 -- 172.21.15.123:0/1363615486 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9834037070 con 0x7f98400cf030 2024-09-15T23:23:13.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.972+0000 7f983dffb640 1 -- 172.21.15.123:0/1363615486 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9834032440 con 0x7f98400cf030 2024-09-15T23:23:13.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.972+0000 7f983dffb640 1 -- 172.21.15.123:0/1363615486 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9834032810 con 0x7f98400cf030 2024-09-15T23:23:13.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.972+0000 7f9845742640 1 -- 172.21.15.123:0/1363615486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98400cf030 msgr2=0x7f98400b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:13.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.972+0000 7f9845742640 1 --2- 172.21.15.123:0/1363615486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98400cf030 0x7f98400b6200 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 crypto rx=0x7f98400d3860 tx=0x7f983402a130 comp rx=0 tx=0).stop 2024-09-15T23:23:13.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.972+0000 7f9845742640 1 -- 172.21.15.123:0/1363615486 shutdown_connections 2024-09-15T23:23:13.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.972+0000 7f9845742640 1 --2- 172.21.15.123:0/1363615486 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f98400b6740 0x7f984006c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:13.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.972+0000 7f9845742640 1 --2- 172.21.15.123:0/1363615486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98400cf030 0x7f98400b6200 unknown :-1 s=CLOSED pgs=2244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:13.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.972+0000 7f9845742640 1 --2- 172.21.15.123:0/1363615486 >> v2:172.21.15.188:3300/0 conn(0x7f984015e990 0x7f98400d2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:13.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.972+0000 7f9845742640 1 -- 172.21.15.123:0/1363615486 >> 172.21.15.123:0/1363615486 conn(0x7f98400d4780 msgr2=0x7f98400d4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:13.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.972+0000 7f9845742640 1 -- 172.21.15.123:0/1363615486 shutdown_connections 2024-09-15T23:23:13.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.972+0000 7f9845742640 1 -- 172.21.15.123:0/1363615486 wait complete. 2024-09-15T23:23:13.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.974+0000 7f9845742640 1 Processor -- start 2024-09-15T23:23:13.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.974+0000 7f9845742640 1 -- start start 2024-09-15T23:23:13.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.974+0000 7f9845742640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f98400b6740 0x7f98400cda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:13.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.974+0000 7f9845742640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f98400cf030 0x7f9840153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:13.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.974+0000 7f9845742640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f984015e990 0x7f9840153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:13.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.974+0000 7f9845742640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f984015ed70 con 0x7f984015e990 2024-09-15T23:23:13.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.974+0000 7f9845742640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f98400d3ef0 con 0x7f98400cf030 2024-09-15T23:23:13.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.974+0000 7f9845742640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f984015eef0 con 0x7f98400b6740 2024-09-15T23:23:13.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.975+0000 7f983f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f984015e990 0x7f9840153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:13.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.975+0000 7f983f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f984015e990 0x7f9840153ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45064/0 (socket says 172.21.15.123:45064) 2024-09-15T23:23:13.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.975+0000 7f983f7fe640 1 -- 172.21.15.123:0/2920426506 learned_addr learned my addr 172.21.15.123:0/2920426506 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:13.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.975+0000 7f983effd640 1 --2- 172.21.15.123:0/2920426506 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f98400b6740 0x7f98400cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:13.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.975+0000 7f983e7fc640 1 --2- 172.21.15.123:0/2920426506 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f98400cf030 0x7f9840153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:13.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.975+0000 7f983f7fe640 1 -- 172.21.15.123:0/2920426506 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f98400b6740 msgr2=0x7f98400cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:13.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.975+0000 7f983f7fe640 1 --2- 172.21.15.123:0/2920426506 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f98400b6740 0x7f98400cda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:13.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.975+0000 7f983f7fe640 1 -- 172.21.15.123:0/2920426506 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f98400cf030 msgr2=0x7f9840153050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:13.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.975+0000 7f983f7fe640 1 --2- 172.21.15.123:0/2920426506 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f98400cf030 0x7f9840153050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:13.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.975+0000 7f983f7fe640 1 -- 172.21.15.123:0/2920426506 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98401620a0 con 0x7f984015e990 2024-09-15T23:23:13.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.975+0000 7f983f7fe640 1 --2- 172.21.15.123:0/2920426506 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f984015e990 0x7f9840153ec0 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7f9838007e90 tx=0x7f983800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:13.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.975+0000 7f98277fe640 1 -- 172.21.15.123:0/2920426506 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9838014420 con 0x7f984015e990 2024-09-15T23:23:13.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.975+0000 7f98277fe640 1 -- 172.21.15.123:0/2920426506 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9838019070 con 0x7f984015e990 2024-09-15T23:23:13.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.975+0000 7f98277fe640 1 -- 172.21.15.123:0/2920426506 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9838014820 con 0x7f984015e990 2024-09-15T23:23:13.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.975+0000 7f9845742640 1 -- 172.21.15.123:0/2920426506 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98400ccc80 con 0x7f984015e990 2024-09-15T23:23:13.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.975+0000 7f9845742640 1 -- 172.21.15.123:0/2920426506 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98400cd240 con 0x7f984015e990 2024-09-15T23:23:13.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.976+0000 7f9845742640 1 -- 172.21.15.123:0/2920426506 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98400b6200 con 0x7f984015e990 2024-09-15T23:23:13.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.977+0000 7f98277fe640 1 -- 172.21.15.123:0/2920426506 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f98380149c0 con 0x7f984015e990 2024-09-15T23:23:13.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.977+0000 7f98277fe640 1 --2- 172.21.15.123:0/2920426506 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f982c06c2b0 0x7f982c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:13.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.977+0000 7f98277fe640 1 -- 172.21.15.123:0/2920426506 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7f983808bb30 con 0x7f984015e990 2024-09-15T23:23:13.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.977+0000 7f983effd640 1 --2- 172.21.15.123:0/2920426506 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f982c06c2b0 0x7f982c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:13.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.978+0000 7f983effd640 1 --2- 172.21.15.123:0/2920426506 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f982c06c2b0 0x7f982c06e770 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f98300079a0 tx=0x7f9830008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:13.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:13.981+0000 7f98277fe640 1 -- 172.21.15.123:0/2920426506 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9838059c50 con 0x7f984015e990 2024-09-15T23:23:14.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:14.144+0000 7f9845742640 1 -- 172.21.15.123:0/2920426506 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f984006cf90 con 0x7f982c06c2b0 2024-09-15T23:23:14.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:14.150+0000 7f98277fe640 1 -- 172.21.15.123:0/2920426506 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252478 (secure 0 0 0) 0x7f984006cf90 con 0x7f982c06c2b0 2024-09-15T23:23:14.153 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:23:14.155 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:23:14.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:14.153+0000 7f9845742640 1 -- 172.21.15.123:0/2920426506 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f982c06c2b0 msgr2=0x7f982c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:14.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:14.153+0000 7f9845742640 1 --2- 172.21.15.123:0/2920426506 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f982c06c2b0 0x7f982c06e770 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f98300079a0 tx=0x7f9830008040 comp rx=0 tx=0).stop 2024-09-15T23:23:14.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:14.153+0000 7f9845742640 1 -- 172.21.15.123:0/2920426506 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f984015e990 msgr2=0x7f9840153ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:14.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:14.153+0000 7f9845742640 1 --2- 172.21.15.123:0/2920426506 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f984015e990 0x7f9840153ec0 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7f9838007e90 tx=0x7f983800e4b0 comp rx=0 tx=0).stop 2024-09-15T23:23:14.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:14.153+0000 7f9845742640 1 -- 172.21.15.123:0/2920426506 shutdown_connections 2024-09-15T23:23:14.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:14.153+0000 7f9845742640 1 --2- 172.21.15.123:0/2920426506 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f982c06c2b0 0x7f982c06e770 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:14.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:14.153+0000 7f9845742640 1 --2- 172.21.15.123:0/2920426506 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f984015e990 0x7f9840153ec0 unknown :-1 s=CLOSED pgs=2245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:14.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:14.153+0000 7f9845742640 1 --2- 172.21.15.123:0/2920426506 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f98400cf030 0x7f9840153050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:14.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:14.153+0000 7f9845742640 1 --2- 172.21.15.123:0/2920426506 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f98400b6740 0x7f98400cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:14.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:14.153+0000 7f9845742640 1 -- 172.21.15.123:0/2920426506 >> 172.21.15.123:0/2920426506 conn(0x7f98400d4780 msgr2=0x7f984006c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:14.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:14.153+0000 7f9845742640 1 -- 172.21.15.123:0/2920426506 shutdown_connections 2024-09-15T23:23:14.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:14.153+0000 7f9845742640 1 -- 172.21.15.123:0/2920426506 wait complete. 2024-09-15T23:23:14.165 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":523,"stamp":"2024-09-15T23:23:13.660226+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":126,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":451564,"kb_used_data":20188,"kb_used_omap":12,"kb_used_meta":431155,"kb_avail":754523156,"statfs":{"total":773094113280,"available":772631711744,"internally_reserved":0,"allocated":20672512,"data_stored":9795952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":441503280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.796168"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389542+0000","last_change":"2024-09-15T23:23:09.896392+0000","last_active":"2024-09-15T23:23:11.389542+0000","last_peered":"2024-09-15T23:23:11.389542+0000","last_clean":"2024-09-15T23:23:11.389542+0000","last_became_active":"2024-09-15T23:23:09.896113+0000","last_became_peered":"2024-09-15T23:23:09.896113+0000","last_unstale":"2024-09-15T23:23:11.389542+0000","last_undegraded":"2024-09-15T23:23:11.389542+0000","last_fullsized":"2024-09-15T23:23:11.389542+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:42.157923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388566+0000","last_change":"2024-09-15T23:23:09.879756+0000","last_active":"2024-09-15T23:23:11.388566+0000","last_peered":"2024-09-15T23:23:11.388566+0000","last_clean":"2024-09-15T23:23:11.388566+0000","last_became_active":"2024-09-15T23:23:09.879473+0000","last_became_peered":"2024-09-15T23:23:09.879473+0000","last_unstale":"2024-09-15T23:23:11.388566+0000","last_undegraded":"2024-09-15T23:23:11.388566+0000","last_fullsized":"2024-09-15T23:23:11.388566+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:00.780850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878505+0000","last_change":"2024-09-15T23:23:09.890448+0000","last_active":"2024-09-15T23:23:10.878505+0000","last_peered":"2024-09-15T23:23:10.878505+0000","last_clean":"2024-09-15T23:23:10.878505+0000","last_became_active":"2024-09-15T23:23:09.890146+0000","last_became_peered":"2024-09-15T23:23:09.890146+0000","last_unstale":"2024-09-15T23:23:10.878505+0000","last_undegraded":"2024-09-15T23:23:10.878505+0000","last_fullsized":"2024-09-15T23:23:10.878505+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:10.381055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.876782+0000","last_change":"2024-09-15T23:23:09.884572+0000","last_active":"2024-09-15T23:23:10.876782+0000","last_peered":"2024-09-15T23:23:10.876782+0000","last_clean":"2024-09-15T23:23:10.876782+0000","last_became_active":"2024-09-15T23:23:09.883008+0000","last_became_peered":"2024-09-15T23:23:09.883008+0000","last_unstale":"2024-09-15T23:23:10.876782+0000","last_undegraded":"2024-09-15T23:23:10.876782+0000","last_fullsized":"2024-09-15T23:23:10.876782+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:26:27.160853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.879038+0000","last_change":"2024-09-15T23:23:09.893118+0000","last_active":"2024-09-15T23:23:10.879038+0000","last_peered":"2024-09-15T23:23:10.879038+0000","last_clean":"2024-09-15T23:23:10.879038+0000","last_became_active":"2024-09-15T23:23:09.892821+0000","last_became_peered":"2024-09-15T23:23:09.892821+0000","last_unstale":"2024-09-15T23:23:10.879038+0000","last_undegraded":"2024-09-15T23:23:10.879038+0000","last_fullsized":"2024-09-15T23:23:10.879038+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:49.942314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389282+0000","last_change":"2024-09-15T23:23:09.898540+0000","last_active":"2024-09-15T23:23:11.389282+0000","last_peered":"2024-09-15T23:23:11.389282+0000","last_clean":"2024-09-15T23:23:11.389282+0000","last_became_active":"2024-09-15T23:23:09.898254+0000","last_became_peered":"2024-09-15T23:23:09.898254+0000","last_unstale":"2024-09-15T23:23:11.389282+0000","last_undegraded":"2024-09-15T23:23:11.389282+0000","last_fullsized":"2024-09-15T23:23:11.389282+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:41.394415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389205+0000","last_change":"2024-09-15T23:23:09.897940+0000","last_active":"2024-09-15T23:23:11.389205+0000","last_peered":"2024-09-15T23:23:11.389205+0000","last_clean":"2024-09-15T23:23:11.389205+0000","last_became_active":"2024-09-15T23:23:09.897615+0000","last_became_peered":"2024-09-15T23:23:09.897615+0000","last_unstale":"2024-09-15T23:23:11.389205+0000","last_undegraded":"2024-09-15T23:23:11.389205+0000","last_fullsized":"2024-09-15T23:23:11.389205+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:31:06.944151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.877651+0000","last_change":"2024-09-15T23:23:09.898922+0000","last_active":"2024-09-15T23:23:10.877651+0000","last_peered":"2024-09-15T23:23:10.877651+0000","last_clean":"2024-09-15T23:23:10.877651+0000","last_became_active":"2024-09-15T23:23:09.898387+0000","last_became_peered":"2024-09-15T23:23:09.898387+0000","last_unstale":"2024-09-15T23:23:10.877651+0000","last_undegraded":"2024-09-15T23:23:10.877651+0000","last_fullsized":"2024-09-15T23:23:10.877651+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:16.268734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388772+0000","last_change":"2024-09-15T23:23:09.880932+0000","last_active":"2024-09-15T23:23:11.388772+0000","last_peered":"2024-09-15T23:23:11.388772+0000","last_clean":"2024-09-15T23:23:11.388772+0000","last_became_active":"2024-09-15T23:23:09.880634+0000","last_became_peered":"2024-09-15T23:23:09.880634+0000","last_unstale":"2024-09-15T23:23:11.388772+0000","last_undegraded":"2024-09-15T23:23:11.388772+0000","last_fullsized":"2024-09-15T23:23:11.388772+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:29.758575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.877907+0000","last_change":"2024-09-15T23:23:09.894886+0000","last_active":"2024-09-15T23:23:10.877907+0000","last_peered":"2024-09-15T23:23:10.877907+0000","last_clean":"2024-09-15T23:23:10.877907+0000","last_became_active":"2024-09-15T23:23:09.894452+0000","last_became_peered":"2024-09-15T23:23:09.894452+0000","last_unstale":"2024-09-15T23:23:10.877907+0000","last_undegraded":"2024-09-15T23:23:10.877907+0000","last_fullsized":"2024-09-15T23:23:10.877907+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:16.788699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389717+0000","last_change":"2024-09-15T23:23:09.892595+0000","last_active":"2024-09-15T23:23:11.389717+0000","last_peered":"2024-09-15T23:23:11.389717+0000","last_clean":"2024-09-15T23:23:11.389717+0000","last_became_active":"2024-09-15T23:23:09.892325+0000","last_became_peered":"2024-09-15T23:23:09.892325+0000","last_unstale":"2024-09-15T23:23:11.389717+0000","last_undegraded":"2024-09-15T23:23:11.389717+0000","last_fullsized":"2024-09-15T23:23:11.389717+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:17.682368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.888139+0000","last_change":"2024-09-15T23:23:09.882541+0000","last_active":"2024-09-15T23:23:10.888139+0000","last_peered":"2024-09-15T23:23:10.888139+0000","last_clean":"2024-09-15T23:23:10.888139+0000","last_became_active":"2024-09-15T23:23:09.881999+0000","last_became_peered":"2024-09-15T23:23:09.881999+0000","last_unstale":"2024-09-15T23:23:10.888139+0000","last_undegraded":"2024-09-15T23:23:10.888139+0000","last_fullsized":"2024-09-15T23:23:10.888139+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:44.365436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.876512+0000","last_change":"2024-09-15T23:23:09.888465+0000","last_active":"2024-09-15T23:23:10.876512+0000","last_peered":"2024-09-15T23:23:10.876512+0000","last_clean":"2024-09-15T23:23:10.876512+0000","last_became_active":"2024-09-15T23:23:09.888153+0000","last_became_peered":"2024-09-15T23:23:09.888153+0000","last_unstale":"2024-09-15T23:23:10.876512+0000","last_undegraded":"2024-09-15T23:23:10.876512+0000","last_fullsized":"2024-09-15T23:23:10.876512+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:00.436713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388886+0000","last_change":"2024-09-15T23:23:09.886114+0000","last_active":"2024-09-15T23:23:11.388886+0000","last_peered":"2024-09-15T23:23:11.388886+0000","last_clean":"2024-09-15T23:23:11.388886+0000","last_became_active":"2024-09-15T23:23:09.885637+0000","last_became_peered":"2024-09-15T23:23:09.885637+0000","last_unstale":"2024-09-15T23:23:11.388886+0000","last_undegraded":"2024-09-15T23:23:11.388886+0000","last_fullsized":"2024-09-15T23:23:11.388886+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:49.942314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389344+0000","last_change":"2024-09-15T23:23:09.891894+0000","last_active":"2024-09-15T23:23:11.389344+0000","last_peered":"2024-09-15T23:23:11.389344+0000","last_clean":"2024-09-15T23:23:11.389344+0000","last_became_active":"2024-09-15T23:23:09.891392+0000","last_became_peered":"2024-09-15T23:23:09.891392+0000","last_unstale":"2024-09-15T23:23:11.389344+0000","last_undegraded":"2024-09-15T23:23:11.389344+0000","last_fullsized":"2024-09-15T23:23:11.389344+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:35.402255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389097+0000","last_change":"2024-09-15T23:23:09.895144+0000","last_active":"2024-09-15T23:23:11.389097+0000","last_peered":"2024-09-15T23:23:11.389097+0000","last_clean":"2024-09-15T23:23:11.389097+0000","last_became_active":"2024-09-15T23:23:09.894871+0000","last_became_peered":"2024-09-15T23:23:09.894871+0000","last_unstale":"2024-09-15T23:23:11.389097+0000","last_undegraded":"2024-09-15T23:23:11.389097+0000","last_fullsized":"2024-09-15T23:23:11.389097+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:49:41.077299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389677+0000","last_change":"2024-09-15T23:23:09.888650+0000","last_active":"2024-09-15T23:23:11.389677+0000","last_peered":"2024-09-15T23:23:11.389677+0000","last_clean":"2024-09-15T23:23:11.389677+0000","last_became_active":"2024-09-15T23:23:09.888057+0000","last_became_peered":"2024-09-15T23:23:09.888057+0000","last_unstale":"2024-09-15T23:23:11.389677+0000","last_undegraded":"2024-09-15T23:23:11.389677+0000","last_fullsized":"2024-09-15T23:23:11.389677+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:07.797869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878074+0000","last_change":"2024-09-15T23:23:09.892556+0000","last_active":"2024-09-15T23:23:10.878074+0000","last_peered":"2024-09-15T23:23:10.878074+0000","last_clean":"2024-09-15T23:23:10.878074+0000","last_became_active":"2024-09-15T23:23:09.892282+0000","last_became_peered":"2024-09-15T23:23:09.892282+0000","last_unstale":"2024-09-15T23:23:10.878074+0000","last_undegraded":"2024-09-15T23:23:10.878074+0000","last_fullsized":"2024-09-15T23:23:10.878074+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:17.364225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878678+0000","last_change":"2024-09-15T23:23:09.888937+0000","last_active":"2024-09-15T23:23:10.878678+0000","last_peered":"2024-09-15T23:23:10.878678+0000","last_clean":"2024-09-15T23:23:10.878678+0000","last_became_active":"2024-09-15T23:23:09.888173+0000","last_became_peered":"2024-09-15T23:23:09.888173+0000","last_unstale":"2024-09-15T23:23:10.878678+0000","last_undegraded":"2024-09-15T23:23:10.878678+0000","last_fullsized":"2024-09-15T23:23:10.878678+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:55:42.187292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878432+0000","last_change":"2024-09-15T23:23:09.884518+0000","last_active":"2024-09-15T23:23:10.878432+0000","last_peered":"2024-09-15T23:23:10.878432+0000","last_clean":"2024-09-15T23:23:10.878432+0000","last_became_active":"2024-09-15T23:23:09.884229+0000","last_became_peered":"2024-09-15T23:23:09.884229+0000","last_unstale":"2024-09-15T23:23:10.878432+0000","last_undegraded":"2024-09-15T23:23:10.878432+0000","last_fullsized":"2024-09-15T23:23:10.878432+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:07.994162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.888125+0000","last_change":"2024-09-15T23:23:09.877411+0000","last_active":"2024-09-15T23:23:10.888125+0000","last_peered":"2024-09-15T23:23:10.888125+0000","last_clean":"2024-09-15T23:23:10.888125+0000","last_became_active":"2024-09-15T23:23:09.877160+0000","last_became_peered":"2024-09-15T23:23:09.877160+0000","last_unstale":"2024-09-15T23:23:10.888125+0000","last_undegraded":"2024-09-15T23:23:10.888125+0000","last_fullsized":"2024-09-15T23:23:10.888125+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:09.752514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388325+0000","last_change":"2024-09-15T23:23:09.883852+0000","last_active":"2024-09-15T23:23:11.388325+0000","last_peered":"2024-09-15T23:23:11.388325+0000","last_clean":"2024-09-15T23:23:11.388325+0000","last_became_active":"2024-09-15T23:23:09.883577+0000","last_became_peered":"2024-09-15T23:23:09.883577+0000","last_unstale":"2024-09-15T23:23:11.388325+0000","last_undegraded":"2024-09-15T23:23:11.388325+0000","last_fullsized":"2024-09-15T23:23:11.388325+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:51:27.652085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.876391+0000","last_change":"2024-09-15T23:23:09.889256+0000","last_active":"2024-09-15T23:23:10.876391+0000","last_peered":"2024-09-15T23:23:10.876391+0000","last_clean":"2024-09-15T23:23:10.876391+0000","last_became_active":"2024-09-15T23:23:09.888952+0000","last_became_peered":"2024-09-15T23:23:09.888952+0000","last_unstale":"2024-09-15T23:23:10.876391+0000","last_undegraded":"2024-09-15T23:23:10.876391+0000","last_fullsized":"2024-09-15T23:23:10.876391+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:44:35.015377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388557+0000","last_change":"2024-09-15T23:23:09.883964+0000","last_active":"2024-09-15T23:23:11.388557+0000","last_peered":"2024-09-15T23:23:11.388557+0000","last_clean":"2024-09-15T23:23:11.388557+0000","last_became_active":"2024-09-15T23:23:09.882965+0000","last_became_peered":"2024-09-15T23:23:09.882965+0000","last_unstale":"2024-09-15T23:23:11.388557+0000","last_undegraded":"2024-09-15T23:23:11.388557+0000","last_fullsized":"2024-09-15T23:23:11.388557+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:35:12.976722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.876775+0000","last_change":"2024-09-15T23:23:09.889908+0000","last_active":"2024-09-15T23:23:10.876775+0000","last_peered":"2024-09-15T23:23:10.876775+0000","last_clean":"2024-09-15T23:23:10.876775+0000","last_became_active":"2024-09-15T23:23:09.889670+0000","last_became_peered":"2024-09-15T23:23:09.889670+0000","last_unstale":"2024-09-15T23:23:10.876775+0000","last_undegraded":"2024-09-15T23:23:10.876775+0000","last_fullsized":"2024-09-15T23:23:10.876775+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:42.878091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.879088+0000","last_change":"2024-09-15T23:23:09.885890+0000","last_active":"2024-09-15T23:23:10.879088+0000","last_peered":"2024-09-15T23:23:10.879088+0000","last_clean":"2024-09-15T23:23:10.879088+0000","last_became_active":"2024-09-15T23:23:09.885585+0000","last_became_peered":"2024-09-15T23:23:09.885585+0000","last_unstale":"2024-09-15T23:23:10.879088+0000","last_undegraded":"2024-09-15T23:23:10.879088+0000","last_fullsized":"2024-09-15T23:23:10.879088+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:12.472633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.888255+0000","last_change":"2024-09-15T23:23:09.879160+0000","last_active":"2024-09-15T23:23:10.888255+0000","last_peered":"2024-09-15T23:23:10.888255+0000","last_clean":"2024-09-15T23:23:10.888255+0000","last_became_active":"2024-09-15T23:23:09.878880+0000","last_became_peered":"2024-09-15T23:23:09.878880+0000","last_unstale":"2024-09-15T23:23:10.888255+0000","last_undegraded":"2024-09-15T23:23:10.888255+0000","last_fullsized":"2024-09-15T23:23:10.888255+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:10.748997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878586+0000","last_change":"2024-09-15T23:23:09.889164+0000","last_active":"2024-09-15T23:23:10.878586+0000","last_peered":"2024-09-15T23:23:10.878586+0000","last_clean":"2024-09-15T23:23:10.878586+0000","last_became_active":"2024-09-15T23:23:09.888868+0000","last_became_peered":"2024-09-15T23:23:09.888868+0000","last_unstale":"2024-09-15T23:23:10.878586+0000","last_undegraded":"2024-09-15T23:23:10.878586+0000","last_fullsized":"2024-09-15T23:23:10.878586+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:12:17.516107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388515+0000","last_change":"2024-09-15T23:23:09.882896+0000","last_active":"2024-09-15T23:23:11.388515+0000","last_peered":"2024-09-15T23:23:11.388515+0000","last_clean":"2024-09-15T23:23:11.388515+0000","last_became_active":"2024-09-15T23:23:09.882578+0000","last_became_peered":"2024-09-15T23:23:09.882578+0000","last_unstale":"2024-09-15T23:23:11.388515+0000","last_undegraded":"2024-09-15T23:23:11.388515+0000","last_fullsized":"2024-09-15T23:23:11.388515+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:11:25.977617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.876522+0000","last_change":"2024-09-15T23:23:09.890580+0000","last_active":"2024-09-15T23:23:10.876522+0000","last_peered":"2024-09-15T23:23:10.876522+0000","last_clean":"2024-09-15T23:23:10.876522+0000","last_became_active":"2024-09-15T23:23:09.890332+0000","last_became_peered":"2024-09-15T23:23:09.890332+0000","last_unstale":"2024-09-15T23:23:10.876522+0000","last_undegraded":"2024-09-15T23:23:10.876522+0000","last_fullsized":"2024-09-15T23:23:10.876522+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:56.296082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878136+0000","last_change":"2024-09-15T23:23:09.884750+0000","last_active":"2024-09-15T23:23:10.878136+0000","last_peered":"2024-09-15T23:23:10.878136+0000","last_clean":"2024-09-15T23:23:10.878136+0000","last_became_active":"2024-09-15T23:23:09.884395+0000","last_became_peered":"2024-09-15T23:23:09.884395+0000","last_unstale":"2024-09-15T23:23:10.878136+0000","last_undegraded":"2024-09-15T23:23:10.878136+0000","last_fullsized":"2024-09-15T23:23:10.878136+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:45.924003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388853+0000","last_change":"2024-09-15T23:23:09.889967+0000","last_active":"2024-09-15T23:23:11.388853+0000","last_peered":"2024-09-15T23:23:11.388853+0000","last_clean":"2024-09-15T23:23:11.388853+0000","last_became_active":"2024-09-15T23:23:09.889690+0000","last_became_peered":"2024-09-15T23:23:09.889690+0000","last_unstale":"2024-09-15T23:23:11.388853+0000","last_undegraded":"2024-09-15T23:23:11.388853+0000","last_fullsized":"2024-09-15T23:23:11.388853+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:52.863778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.888193+0000","last_change":"2024-09-15T23:23:09.884871+0000","last_active":"2024-09-15T23:23:10.888193+0000","last_peered":"2024-09-15T23:23:10.888193+0000","last_clean":"2024-09-15T23:23:10.888193+0000","last_became_active":"2024-09-15T23:23:09.884619+0000","last_became_peered":"2024-09-15T23:23:09.884619+0000","last_unstale":"2024-09-15T23:23:10.888193+0000","last_undegraded":"2024-09-15T23:23:10.888193+0000","last_fullsized":"2024-09-15T23:23:10.888193+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:35:12.976722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1f","version":"193'4","reported_seq":18,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.888168+0000","last_change":"2024-09-15T23:23:08.885291+0000","last_active":"2024-09-15T23:23:10.888168+0000","last_peered":"2024-09-15T23:23:10.888168+0000","last_clean":"2024-09-15T23:23:10.888168+0000","last_became_active":"2024-09-15T23:23:08.884981+0000","last_became_peered":"2024-09-15T23:23:08.884981+0000","last_unstale":"2024-09-15T23:23:10.888168+0000","last_undegraded":"2024-09-15T23:23:10.888168+0000","last_fullsized":"2024-09-15T23:23:10.888168+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:21:39.932815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.876805+0000","last_change":"2024-09-15T23:23:09.878667+0000","last_active":"2024-09-15T23:23:10.876805+0000","last_peered":"2024-09-15T23:23:10.876805+0000","last_clean":"2024-09-15T23:23:10.876805+0000","last_became_active":"2024-09-15T23:23:09.878411+0000","last_became_peered":"2024-09-15T23:23:09.878411+0000","last_unstale":"2024-09-15T23:23:10.876805+0000","last_undegraded":"2024-09-15T23:23:10.876805+0000","last_fullsized":"2024-09-15T23:23:10.876805+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:01:01.804738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1e","version":"193'1","reported_seq":15,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388612+0000","last_change":"2024-09-15T23:23:08.873830+0000","last_active":"2024-09-15T23:23:11.388612+0000","last_peered":"2024-09-15T23:23:11.388612+0000","last_clean":"2024-09-15T23:23:11.388612+0000","last_became_active":"2024-09-15T23:23:08.873532+0000","last_became_peered":"2024-09-15T23:23:08.873532+0000","last_unstale":"2024-09-15T23:23:11.388612+0000","last_undegraded":"2024-09-15T23:23:11.388612+0000","last_fullsized":"2024-09-15T23:23:11.388612+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:53:42.495426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878490+0000","last_change":"2024-09-15T23:23:09.893191+0000","last_active":"2024-09-15T23:23:10.878490+0000","last_peered":"2024-09-15T23:23:10.878490+0000","last_clean":"2024-09-15T23:23:10.878490+0000","last_became_active":"2024-09-15T23:23:09.892564+0000","last_became_peered":"2024-09-15T23:23:09.892564+0000","last_unstale":"2024-09-15T23:23:10.878490+0000","last_undegraded":"2024-09-15T23:23:10.878490+0000","last_fullsized":"2024-09-15T23:23:10.878490+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:43:10.307662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1d","version":"193'2","reported_seq":16,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.879004+0000","last_change":"2024-09-15T23:23:08.883380+0000","last_active":"2024-09-15T23:23:10.879004+0000","last_peered":"2024-09-15T23:23:10.879004+0000","last_clean":"2024-09-15T23:23:10.879004+0000","last_became_active":"2024-09-15T23:23:08.883076+0000","last_became_peered":"2024-09-15T23:23:08.883076+0000","last_unstale":"2024-09-15T23:23:10.879004+0000","last_undegraded":"2024-09-15T23:23:10.879004+0000","last_fullsized":"2024-09-15T23:23:10.879004+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:41.150625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878773+0000","last_change":"2024-09-15T23:23:09.889863+0000","last_active":"2024-09-15T23:23:10.878773+0000","last_peered":"2024-09-15T23:23:10.878773+0000","last_clean":"2024-09-15T23:23:10.878773+0000","last_became_active":"2024-09-15T23:23:09.889275+0000","last_became_peered":"2024-09-15T23:23:09.889275+0000","last_unstale":"2024-09-15T23:23:10.878773+0000","last_undegraded":"2024-09-15T23:23:10.878773+0000","last_fullsized":"2024-09-15T23:23:10.878773+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:48.682646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1c","version":"193'2","reported_seq":16,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.876699+0000","last_change":"2024-09-15T23:23:08.877981+0000","last_active":"2024-09-15T23:23:10.876699+0000","last_peered":"2024-09-15T23:23:10.876699+0000","last_clean":"2024-09-15T23:23:10.876699+0000","last_became_active":"2024-09-15T23:23:08.877606+0000","last_became_peered":"2024-09-15T23:23:08.877606+0000","last_unstale":"2024-09-15T23:23:10.876699+0000","last_undegraded":"2024-09-15T23:23:10.876699+0000","last_fullsized":"2024-09-15T23:23:10.876699+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:34:57.450091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.876541+0000","last_change":"2024-09-15T23:23:09.883973+0000","last_active":"2024-09-15T23:23:10.876541+0000","last_peered":"2024-09-15T23:23:10.876541+0000","last_clean":"2024-09-15T23:23:10.876541+0000","last_became_active":"2024-09-15T23:23:09.883710+0000","last_became_peered":"2024-09-15T23:23:09.883710+0000","last_unstale":"2024-09-15T23:23:10.876541+0000","last_undegraded":"2024-09-15T23:23:10.876541+0000","last_fullsized":"2024-09-15T23:23:10.876541+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:35:02.997694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1a","version":"193'1","reported_seq":15,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389577+0000","last_change":"2024-09-15T23:23:08.884833+0000","last_active":"2024-09-15T23:23:11.389577+0000","last_peered":"2024-09-15T23:23:11.389577+0000","last_clean":"2024-09-15T23:23:11.389577+0000","last_became_active":"2024-09-15T23:23:08.884446+0000","last_became_peered":"2024-09-15T23:23:08.884446+0000","last_unstale":"2024-09-15T23:23:11.389577+0000","last_undegraded":"2024-09-15T23:23:11.389577+0000","last_fullsized":"2024-09-15T23:23:11.389577+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:25:43.826245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389249+0000","last_change":"2024-09-15T23:23:09.887857+0000","last_active":"2024-09-15T23:23:11.389249+0000","last_peered":"2024-09-15T23:23:11.389249+0000","last_clean":"2024-09-15T23:23:11.389249+0000","last_became_active":"2024-09-15T23:23:09.887005+0000","last_became_peered":"2024-09-15T23:23:09.887005+0000","last_unstale":"2024-09-15T23:23:11.389249+0000","last_undegraded":"2024-09-15T23:23:11.389249+0000","last_fullsized":"2024-09-15T23:23:11.389249+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:13.448014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878250+0000","last_change":"2024-09-15T23:23:08.887529+0000","last_active":"2024-09-15T23:23:10.878250+0000","last_peered":"2024-09-15T23:23:10.878250+0000","last_clean":"2024-09-15T23:23:10.878250+0000","last_became_active":"2024-09-15T23:23:08.887256+0000","last_became_peered":"2024-09-15T23:23:08.887256+0000","last_unstale":"2024-09-15T23:23:10.878250+0000","last_undegraded":"2024-09-15T23:23:10.878250+0000","last_fullsized":"2024-09-15T23:23:10.878250+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:34.394956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388850+0000","last_change":"2024-09-15T23:23:09.875524+0000","last_active":"2024-09-15T23:23:11.388850+0000","last_peered":"2024-09-15T23:23:11.388850+0000","last_clean":"2024-09-15T23:23:11.388850+0000","last_became_active":"2024-09-15T23:23:09.875258+0000","last_became_peered":"2024-09-15T23:23:09.875258+0000","last_unstale":"2024-09-15T23:23:11.388850+0000","last_undegraded":"2024-09-15T23:23:11.388850+0000","last_fullsized":"2024-09-15T23:23:11.388850+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:10.748997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.876318+0000","last_change":"2024-09-15T23:23:08.885856+0000","last_active":"2024-09-15T23:23:10.876318+0000","last_peered":"2024-09-15T23:23:10.876318+0000","last_clean":"2024-09-15T23:23:10.876318+0000","last_became_active":"2024-09-15T23:23:08.885459+0000","last_became_peered":"2024-09-15T23:23:08.885459+0000","last_unstale":"2024-09-15T23:23:10.876318+0000","last_undegraded":"2024-09-15T23:23:10.876318+0000","last_fullsized":"2024-09-15T23:23:10.876318+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:06:25.879694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.876797+0000","last_change":"2024-09-15T23:23:09.897389+0000","last_active":"2024-09-15T23:23:10.876797+0000","last_peered":"2024-09-15T23:23:10.876797+0000","last_clean":"2024-09-15T23:23:10.876797+0000","last_became_active":"2024-09-15T23:23:09.897087+0000","last_became_peered":"2024-09-15T23:23:09.897087+0000","last_unstale":"2024-09-15T23:23:10.876797+0000","last_undegraded":"2024-09-15T23:23:10.876797+0000","last_fullsized":"2024-09-15T23:23:10.876797+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:00.066784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878930+0000","last_change":"2024-09-15T23:23:08.882342+0000","last_active":"2024-09-15T23:23:10.878930+0000","last_peered":"2024-09-15T23:23:10.878930+0000","last_clean":"2024-09-15T23:23:10.878930+0000","last_became_active":"2024-09-15T23:23:08.882046+0000","last_became_peered":"2024-09-15T23:23:08.882046+0000","last_unstale":"2024-09-15T23:23:10.878930+0000","last_undegraded":"2024-09-15T23:23:10.878930+0000","last_fullsized":"2024-09-15T23:23:10.878930+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:46.966470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388963+0000","last_change":"2024-09-15T23:23:09.887039+0000","last_active":"2024-09-15T23:23:11.388963+0000","last_peered":"2024-09-15T23:23:11.388963+0000","last_clean":"2024-09-15T23:23:11.388963+0000","last_became_active":"2024-09-15T23:23:09.886178+0000","last_became_peered":"2024-09-15T23:23:09.886178+0000","last_unstale":"2024-09-15T23:23:11.388963+0000","last_undegraded":"2024-09-15T23:23:11.388963+0000","last_fullsized":"2024-09-15T23:23:11.388963+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:24.942591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.876675+0000","last_change":"2024-09-15T23:23:08.880340+0000","last_active":"2024-09-15T23:23:10.876675+0000","last_peered":"2024-09-15T23:23:10.876675+0000","last_clean":"2024-09-15T23:23:10.876675+0000","last_became_active":"2024-09-15T23:23:08.880064+0000","last_became_peered":"2024-09-15T23:23:08.880064+0000","last_unstale":"2024-09-15T23:23:10.876675+0000","last_undegraded":"2024-09-15T23:23:10.876675+0000","last_fullsized":"2024-09-15T23:23:10.876675+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:47.391744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388869+0000","last_change":"2024-09-15T23:23:09.884504+0000","last_active":"2024-09-15T23:23:11.388869+0000","last_peered":"2024-09-15T23:23:11.388869+0000","last_clean":"2024-09-15T23:23:11.388869+0000","last_became_active":"2024-09-15T23:23:09.884242+0000","last_became_peered":"2024-09-15T23:23:09.884242+0000","last_unstale":"2024-09-15T23:23:11.388869+0000","last_undegraded":"2024-09-15T23:23:11.388869+0000","last_fullsized":"2024-09-15T23:23:11.388869+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:31.076892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.15","version":"193'3","reported_seq":17,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.879081+0000","last_change":"2024-09-15T23:23:08.888755+0000","last_active":"2024-09-15T23:23:10.879081+0000","last_peered":"2024-09-15T23:23:10.879081+0000","last_clean":"2024-09-15T23:23:10.879081+0000","last_became_active":"2024-09-15T23:23:08.888250+0000","last_became_peered":"2024-09-15T23:23:08.888250+0000","last_unstale":"2024-09-15T23:23:10.879081+0000","last_undegraded":"2024-09-15T23:23:10.879081+0000","last_fullsized":"2024-09-15T23:23:10.879081+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:08.440981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878357+0000","last_change":"2024-09-15T23:23:09.881198+0000","last_active":"2024-09-15T23:23:10.878357+0000","last_peered":"2024-09-15T23:23:10.878357+0000","last_clean":"2024-09-15T23:23:10.878357+0000","last_became_active":"2024-09-15T23:23:09.880910+0000","last_became_peered":"2024-09-15T23:23:09.880910+0000","last_unstale":"2024-09-15T23:23:10.878357+0000","last_undegraded":"2024-09-15T23:23:10.878357+0000","last_fullsized":"2024-09-15T23:23:10.878357+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:53:34.689769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.14","version":"193'6","reported_seq":20,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388814+0000","last_change":"2024-09-15T23:23:08.874211+0000","last_active":"2024-09-15T23:23:11.388814+0000","last_peered":"2024-09-15T23:23:11.388814+0000","last_clean":"2024-09-15T23:23:11.388814+0000","last_became_active":"2024-09-15T23:23:08.873954+0000","last_became_peered":"2024-09-15T23:23:08.873954+0000","last_unstale":"2024-09-15T23:23:11.388814+0000","last_undegraded":"2024-09-15T23:23:11.388814+0000","last_fullsized":"2024-09-15T23:23:11.388814+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:28:49.634455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388862+0000","last_change":"2024-09-15T23:23:09.890661+0000","last_active":"2024-09-15T23:23:11.388862+0000","last_peered":"2024-09-15T23:23:11.388862+0000","last_clean":"2024-09-15T23:23:11.388862+0000","last_became_active":"2024-09-15T23:23:09.890390+0000","last_became_peered":"2024-09-15T23:23:09.890390+0000","last_unstale":"2024-09-15T23:23:11.388862+0000","last_undegraded":"2024-09-15T23:23:11.388862+0000","last_fullsized":"2024-09-15T23:23:11.388862+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:48.682646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.13","version":"193'2","reported_seq":16,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388442+0000","last_change":"2024-09-15T23:23:08.887007+0000","last_active":"2024-09-15T23:23:11.388442+0000","last_peered":"2024-09-15T23:23:11.388442+0000","last_clean":"2024-09-15T23:23:11.388442+0000","last_became_active":"2024-09-15T23:23:08.886687+0000","last_became_peered":"2024-09-15T23:23:08.886687+0000","last_unstale":"2024-09-15T23:23:11.388442+0000","last_undegraded":"2024-09-15T23:23:11.388442+0000","last_fullsized":"2024-09-15T23:23:11.388442+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:49:35.045796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.879038+0000","last_change":"2024-09-15T23:23:09.890142+0000","last_active":"2024-09-15T23:23:10.879038+0000","last_peered":"2024-09-15T23:23:10.879038+0000","last_clean":"2024-09-15T23:23:10.879038+0000","last_became_active":"2024-09-15T23:23:09.889857+0000","last_became_peered":"2024-09-15T23:23:09.889857+0000","last_unstale":"2024-09-15T23:23:10.879038+0000","last_undegraded":"2024-09-15T23:23:10.879038+0000","last_fullsized":"2024-09-15T23:23:10.879038+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:24.942591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388247+0000","last_change":"2024-09-15T23:23:08.878078+0000","last_active":"2024-09-15T23:23:11.388247+0000","last_peered":"2024-09-15T23:23:11.388247+0000","last_clean":"2024-09-15T23:23:11.388247+0000","last_became_active":"2024-09-15T23:23:08.877795+0000","last_became_peered":"2024-09-15T23:23:08.877795+0000","last_unstale":"2024-09-15T23:23:11.388247+0000","last_undegraded":"2024-09-15T23:23:11.388247+0000","last_fullsized":"2024-09-15T23:23:11.388247+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:51.929458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.877739+0000","last_change":"2024-09-15T23:23:09.894373+0000","last_active":"2024-09-15T23:23:10.877739+0000","last_peered":"2024-09-15T23:23:10.877739+0000","last_clean":"2024-09-15T23:23:10.877739+0000","last_became_active":"2024-09-15T23:23:09.894027+0000","last_became_peered":"2024-09-15T23:23:09.894027+0000","last_unstale":"2024-09-15T23:23:10.877739+0000","last_undegraded":"2024-09-15T23:23:10.877739+0000","last_fullsized":"2024-09-15T23:23:10.877739+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:05:43.347414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878324+0000","last_change":"2024-09-15T23:23:08.883287+0000","last_active":"2024-09-15T23:23:10.878324+0000","last_peered":"2024-09-15T23:23:10.878324+0000","last_clean":"2024-09-15T23:23:10.878324+0000","last_became_active":"2024-09-15T23:23:08.882904+0000","last_became_peered":"2024-09-15T23:23:08.882904+0000","last_unstale":"2024-09-15T23:23:10.878324+0000","last_undegraded":"2024-09-15T23:23:10.878324+0000","last_fullsized":"2024-09-15T23:23:10.878324+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:34:43.070529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389575+0000","last_change":"2024-09-15T23:23:09.887792+0000","last_active":"2024-09-15T23:23:11.389575+0000","last_peered":"2024-09-15T23:23:11.389575+0000","last_clean":"2024-09-15T23:23:11.389575+0000","last_became_active":"2024-09-15T23:23:09.887392+0000","last_became_peered":"2024-09-15T23:23:09.887392+0000","last_unstale":"2024-09-15T23:23:11.389575+0000","last_undegraded":"2024-09-15T23:23:11.389575+0000","last_fullsized":"2024-09-15T23:23:11.389575+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:09.448279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.10","version":"193'8","reported_seq":22,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878455+0000","last_change":"2024-09-15T23:23:08.880773+0000","last_active":"2024-09-15T23:23:10.878455+0000","last_peered":"2024-09-15T23:23:10.878455+0000","last_clean":"2024-09-15T23:23:10.878455+0000","last_became_active":"2024-09-15T23:23:08.880261+0000","last_became_peered":"2024-09-15T23:23:08.880261+0000","last_unstale":"2024-09-15T23:23:10.878455+0000","last_undegraded":"2024-09-15T23:23:10.878455+0000","last_fullsized":"2024-09-15T23:23:10.878455+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:32.801604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.888219+0000","last_change":"2024-09-15T23:23:09.879294+0000","last_active":"2024-09-15T23:23:10.888219+0000","last_peered":"2024-09-15T23:23:10.888219+0000","last_clean":"2024-09-15T23:23:10.888219+0000","last_became_active":"2024-09-15T23:23:09.879008+0000","last_became_peered":"2024-09-15T23:23:09.879008+0000","last_unstale":"2024-09-15T23:23:10.888219+0000","last_undegraded":"2024-09-15T23:23:10.888219+0000","last_fullsized":"2024-09-15T23:23:10.888219+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:29.758575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.f","version":"193'1","reported_seq":15,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389869+0000","last_change":"2024-09-15T23:23:08.887550+0000","last_active":"2024-09-15T23:23:11.389869+0000","last_peered":"2024-09-15T23:23:11.389869+0000","last_clean":"2024-09-15T23:23:11.389869+0000","last_became_active":"2024-09-15T23:23:08.887255+0000","last_became_peered":"2024-09-15T23:23:08.887255+0000","last_unstale":"2024-09-15T23:23:11.389869+0000","last_undegraded":"2024-09-15T23:23:11.389869+0000","last_fullsized":"2024-09-15T23:23:11.389869+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:56.677486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.876906+0000","last_change":"2024-09-15T23:23:09.881687+0000","last_active":"2024-09-15T23:23:10.876906+0000","last_peered":"2024-09-15T23:23:10.876906+0000","last_clean":"2024-09-15T23:23:10.876906+0000","last_became_active":"2024-09-15T23:23:09.881354+0000","last_became_peered":"2024-09-15T23:23:09.881354+0000","last_unstale":"2024-09-15T23:23:10.876906+0000","last_undegraded":"2024-09-15T23:23:10.876906+0000","last_fullsized":"2024-09-15T23:23:10.876906+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:26:33.318352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.e","version":"193'2","reported_seq":16,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388645+0000","last_change":"2024-09-15T23:23:08.884016+0000","last_active":"2024-09-15T23:23:11.388645+0000","last_peered":"2024-09-15T23:23:11.388645+0000","last_clean":"2024-09-15T23:23:11.388645+0000","last_became_active":"2024-09-15T23:23:08.883683+0000","last_became_peered":"2024-09-15T23:23:08.883683+0000","last_unstale":"2024-09-15T23:23:11.388645+0000","last_undegraded":"2024-09-15T23:23:11.388645+0000","last_fullsized":"2024-09-15T23:23:11.388645+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:33.247627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878585+0000","last_change":"2024-09-15T23:23:09.893387+0000","last_active":"2024-09-15T23:23:10.878585+0000","last_peered":"2024-09-15T23:23:10.878585+0000","last_clean":"2024-09-15T23:23:10.878585+0000","last_became_active":"2024-09-15T23:23:09.892927+0000","last_became_peered":"2024-09-15T23:23:09.892927+0000","last_unstale":"2024-09-15T23:23:10.878585+0000","last_undegraded":"2024-09-15T23:23:10.878585+0000","last_fullsized":"2024-09-15T23:23:10.878585+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:56.972413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.d","version":"193'1","reported_seq":15,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389475+0000","last_change":"2024-09-15T23:23:08.880228+0000","last_active":"2024-09-15T23:23:11.389475+0000","last_peered":"2024-09-15T23:23:11.389475+0000","last_clean":"2024-09-15T23:23:11.389475+0000","last_became_active":"2024-09-15T23:23:08.879937+0000","last_became_peered":"2024-09-15T23:23:08.879937+0000","last_unstale":"2024-09-15T23:23:11.389475+0000","last_undegraded":"2024-09-15T23:23:11.389475+0000","last_fullsized":"2024-09-15T23:23:11.389475+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:06.986864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389822+0000","last_change":"2024-09-15T23:23:09.900172+0000","last_active":"2024-09-15T23:23:11.389822+0000","last_peered":"2024-09-15T23:23:11.389822+0000","last_clean":"2024-09-15T23:23:11.389822+0000","last_became_active":"2024-09-15T23:23:09.899812+0000","last_became_peered":"2024-09-15T23:23:09.899812+0000","last_unstale":"2024-09-15T23:23:11.389822+0000","last_undegraded":"2024-09-15T23:23:11.389822+0000","last_fullsized":"2024-09-15T23:23:11.389822+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:48:35.079778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389230+0000","last_change":"2024-09-15T23:23:08.884635+0000","last_active":"2024-09-15T23:23:11.389230+0000","last_peered":"2024-09-15T23:23:11.389230+0000","last_clean":"2024-09-15T23:23:11.389230+0000","last_became_active":"2024-09-15T23:23:08.884343+0000","last_became_peered":"2024-09-15T23:23:08.884343+0000","last_unstale":"2024-09-15T23:23:11.389230+0000","last_undegraded":"2024-09-15T23:23:11.389230+0000","last_fullsized":"2024-09-15T23:23:11.389230+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:28.713430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.877765+0000","last_change":"2024-09-15T23:23:09.896745+0000","last_active":"2024-09-15T23:23:10.877765+0000","last_peered":"2024-09-15T23:23:10.877765+0000","last_clean":"2024-09-15T23:23:10.877765+0000","last_became_active":"2024-09-15T23:23:09.895939+0000","last_became_peered":"2024-09-15T23:23:09.895939+0000","last_unstale":"2024-09-15T23:23:10.877765+0000","last_undegraded":"2024-09-15T23:23:10.877765+0000","last_fullsized":"2024-09-15T23:23:10.877765+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:27.624450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.b","version":"193'2","reported_seq":16,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388819+0000","last_change":"2024-09-15T23:23:08.881657+0000","last_active":"2024-09-15T23:23:11.388819+0000","last_peered":"2024-09-15T23:23:11.388819+0000","last_clean":"2024-09-15T23:23:11.388819+0000","last_became_active":"2024-09-15T23:23:08.881338+0000","last_became_peered":"2024-09-15T23:23:08.881338+0000","last_unstale":"2024-09-15T23:23:11.388819+0000","last_undegraded":"2024-09-15T23:23:11.388819+0000","last_fullsized":"2024-09-15T23:23:11.388819+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:44.916704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389406+0000","last_change":"2024-09-15T23:23:09.899726+0000","last_active":"2024-09-15T23:23:11.389406+0000","last_peered":"2024-09-15T23:23:11.389406+0000","last_clean":"2024-09-15T23:23:11.389406+0000","last_became_active":"2024-09-15T23:23:09.898418+0000","last_became_peered":"2024-09-15T23:23:09.898418+0000","last_unstale":"2024-09-15T23:23:11.389406+0000","last_undegraded":"2024-09-15T23:23:11.389406+0000","last_fullsized":"2024-09-15T23:23:11.389406+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:58.508749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878430+0000","last_change":"2024-09-15T23:23:08.885820+0000","last_active":"2024-09-15T23:23:10.878430+0000","last_peered":"2024-09-15T23:23:10.878430+0000","last_clean":"2024-09-15T23:23:10.878430+0000","last_became_active":"2024-09-15T23:23:08.885545+0000","last_became_peered":"2024-09-15T23:23:08.885545+0000","last_unstale":"2024-09-15T23:23:10.878430+0000","last_undegraded":"2024-09-15T23:23:10.878430+0000","last_fullsized":"2024-09-15T23:23:10.878430+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:06.790571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.876352+0000","last_change":"2024-09-15T23:23:09.881140+0000","last_active":"2024-09-15T23:23:10.876352+0000","last_peered":"2024-09-15T23:23:10.876352+0000","last_clean":"2024-09-15T23:23:10.876352+0000","last_became_active":"2024-09-15T23:23:09.880760+0000","last_became_peered":"2024-09-15T23:23:09.880760+0000","last_unstale":"2024-09-15T23:23:10.876352+0000","last_undegraded":"2024-09-15T23:23:10.876352+0000","last_fullsized":"2024-09-15T23:23:10.876352+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:05:26.961470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878190+0000","last_change":"2024-09-15T23:23:08.886258+0000","last_active":"2024-09-15T23:23:10.878190+0000","last_peered":"2024-09-15T23:23:10.878190+0000","last_clean":"2024-09-15T23:23:10.878190+0000","last_became_active":"2024-09-15T23:23:08.884216+0000","last_became_peered":"2024-09-15T23:23:08.884216+0000","last_unstale":"2024-09-15T23:23:10.878190+0000","last_undegraded":"2024-09-15T23:23:10.878190+0000","last_fullsized":"2024-09-15T23:23:10.878190+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:39.101978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.876459+0000","last_change":"2024-09-15T23:23:09.888492+0000","last_active":"2024-09-15T23:23:10.876459+0000","last_peered":"2024-09-15T23:23:10.876459+0000","last_clean":"2024-09-15T23:23:10.876459+0000","last_became_active":"2024-09-15T23:23:09.888183+0000","last_became_peered":"2024-09-15T23:23:09.888183+0000","last_unstale":"2024-09-15T23:23:10.876459+0000","last_undegraded":"2024-09-15T23:23:10.876459+0000","last_fullsized":"2024-09-15T23:23:10.876459+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:53:34.221612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878528+0000","last_change":"2024-09-15T23:23:08.889246+0000","last_active":"2024-09-15T23:23:10.878528+0000","last_peered":"2024-09-15T23:23:10.878528+0000","last_clean":"2024-09-15T23:23:10.878528+0000","last_became_active":"2024-09-15T23:23:08.888672+0000","last_became_peered":"2024-09-15T23:23:08.888672+0000","last_unstale":"2024-09-15T23:23:10.878528+0000","last_undegraded":"2024-09-15T23:23:10.878528+0000","last_fullsized":"2024-09-15T23:23:10.878528+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:16.675069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.888333+0000","last_change":"2024-09-15T23:23:09.891264+0000","last_active":"2024-09-15T23:23:10.888333+0000","last_peered":"2024-09-15T23:23:10.888333+0000","last_clean":"2024-09-15T23:23:10.888333+0000","last_became_active":"2024-09-15T23:23:09.890877+0000","last_became_peered":"2024-09-15T23:23:09.890877+0000","last_unstale":"2024-09-15T23:23:10.888333+0000","last_undegraded":"2024-09-15T23:23:10.888333+0000","last_fullsized":"2024-09-15T23:23:10.888333+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:55.912652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.7","version":"193'2","reported_seq":16,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878776+0000","last_change":"2024-09-15T23:23:08.881862+0000","last_active":"2024-09-15T23:23:10.878776+0000","last_peered":"2024-09-15T23:23:10.878776+0000","last_clean":"2024-09-15T23:23:10.878776+0000","last_became_active":"2024-09-15T23:23:08.881581+0000","last_became_peered":"2024-09-15T23:23:08.881581+0000","last_unstale":"2024-09-15T23:23:10.878776+0000","last_undegraded":"2024-09-15T23:23:10.878776+0000","last_fullsized":"2024-09-15T23:23:10.878776+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:57.501450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389734+0000","last_change":"2024-09-15T23:23:09.888350+0000","last_active":"2024-09-15T23:23:11.389734+0000","last_peered":"2024-09-15T23:23:11.389734+0000","last_clean":"2024-09-15T23:23:11.389734+0000","last_became_active":"2024-09-15T23:23:09.887980+0000","last_became_peered":"2024-09-15T23:23:09.887980+0000","last_unstale":"2024-09-15T23:23:11.389734+0000","last_undegraded":"2024-09-15T23:23:11.389734+0000","last_fullsized":"2024-09-15T23:23:11.389734+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:33.808903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.6","version":"194'1","reported_seq":15,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388742+0000","last_change":"2024-09-15T23:23:08.877900+0000","last_active":"2024-09-15T23:23:11.388742+0000","last_peered":"2024-09-15T23:23:11.388742+0000","last_clean":"2024-09-15T23:23:11.388742+0000","last_became_active":"2024-09-15T23:23:08.877583+0000","last_became_peered":"2024-09-15T23:23:08.877583+0000","last_unstale":"2024-09-15T23:23:11.388742+0000","last_undegraded":"2024-09-15T23:23:11.388742+0000","last_fullsized":"2024-09-15T23:23:11.388742+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:18.540309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388420+0000","last_change":"2024-09-15T23:23:09.882079+0000","last_active":"2024-09-15T23:23:11.388420+0000","last_peered":"2024-09-15T23:23:11.388420+0000","last_clean":"2024-09-15T23:23:11.388420+0000","last_became_active":"2024-09-15T23:23:09.881800+0000","last_became_peered":"2024-09-15T23:23:09.881800+0000","last_unstale":"2024-09-15T23:23:11.388420+0000","last_undegraded":"2024-09-15T23:23:11.388420+0000","last_fullsized":"2024-09-15T23:23:11.388420+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:23:14.966836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389860+0000","last_change":"2024-09-15T23:23:08.885600+0000","last_active":"2024-09-15T23:23:11.389860+0000","last_peered":"2024-09-15T23:23:11.389860+0000","last_clean":"2024-09-15T23:23:11.389860+0000","last_became_active":"2024-09-15T23:23:08.885248+0000","last_became_peered":"2024-09-15T23:23:08.885248+0000","last_unstale":"2024-09-15T23:23:11.389860+0000","last_undegraded":"2024-09-15T23:23:11.389860+0000","last_fullsized":"2024-09-15T23:23:11.389860+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:18:41.964218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.888299+0000","last_change":"2024-09-15T23:23:09.885691+0000","last_active":"2024-09-15T23:23:10.888299+0000","last_peered":"2024-09-15T23:23:10.888299+0000","last_clean":"2024-09-15T23:23:10.888299+0000","last_became_active":"2024-09-15T23:23:09.885430+0000","last_became_peered":"2024-09-15T23:23:09.885430+0000","last_unstale":"2024-09-15T23:23:10.888299+0000","last_undegraded":"2024-09-15T23:23:10.888299+0000","last_fullsized":"2024-09-15T23:23:10.888299+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:31.076892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389195+0000","last_change":"2024-09-15T23:23:08.887072+0000","last_active":"2024-09-15T23:23:11.389195+0000","last_peered":"2024-09-15T23:23:11.389195+0000","last_clean":"2024-09-15T23:23:11.389195+0000","last_became_active":"2024-09-15T23:23:08.886725+0000","last_became_peered":"2024-09-15T23:23:08.886725+0000","last_unstale":"2024-09-15T23:23:11.389195+0000","last_undegraded":"2024-09-15T23:23:11.389195+0000","last_fullsized":"2024-09-15T23:23:11.389195+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:45:01.490349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389480+0000","last_change":"2024-09-15T23:23:09.898656+0000","last_active":"2024-09-15T23:23:11.389480+0000","last_peered":"2024-09-15T23:23:11.389480+0000","last_clean":"2024-09-15T23:23:11.389480+0000","last_became_active":"2024-09-15T23:23:09.898380+0000","last_became_peered":"2024-09-15T23:23:09.898380+0000","last_unstale":"2024-09-15T23:23:11.389480+0000","last_undegraded":"2024-09-15T23:23:11.389480+0000","last_fullsized":"2024-09-15T23:23:11.389480+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:34:44.077827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.876563+0000","last_change":"2024-09-15T23:23:08.883474+0000","last_active":"2024-09-15T23:23:10.876563+0000","last_peered":"2024-09-15T23:23:10.876563+0000","last_clean":"2024-09-15T23:23:10.876563+0000","last_became_active":"2024-09-15T23:23:08.883194+0000","last_became_peered":"2024-09-15T23:23:08.883194+0000","last_unstale":"2024-09-15T23:23:10.876563+0000","last_undegraded":"2024-09-15T23:23:10.876563+0000","last_fullsized":"2024-09-15T23:23:10.876563+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:53:43.729395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388423+0000","last_change":"2024-09-15T23:23:09.883691+0000","last_active":"2024-09-15T23:23:11.388423+0000","last_peered":"2024-09-15T23:23:11.388423+0000","last_clean":"2024-09-15T23:23:11.388423+0000","last_became_active":"2024-09-15T23:23:09.883438+0000","last_became_peered":"2024-09-15T23:23:09.883438+0000","last_unstale":"2024-09-15T23:23:11.388423+0000","last_undegraded":"2024-09-15T23:23:11.388423+0000","last_fullsized":"2024-09-15T23:23:11.388423+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:10:42.119855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.877954+0000","last_change":"2024-09-15T23:23:08.889390+0000","last_active":"2024-09-15T23:23:10.877954+0000","last_peered":"2024-09-15T23:23:10.877954+0000","last_clean":"2024-09-15T23:23:10.877954+0000","last_became_active":"2024-09-15T23:23:08.889130+0000","last_became_peered":"2024-09-15T23:23:08.889130+0000","last_unstale":"2024-09-15T23:23:10.877954+0000","last_undegraded":"2024-09-15T23:23:10.877954+0000","last_fullsized":"2024-09-15T23:23:10.877954+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:00:26.192065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878132+0000","last_change":"2024-09-15T23:23:09.887444+0000","last_active":"2024-09-15T23:23:10.878132+0000","last_peered":"2024-09-15T23:23:10.878132+0000","last_clean":"2024-09-15T23:23:10.878132+0000","last_became_active":"2024-09-15T23:23:09.887177+0000","last_became_peered":"2024-09-15T23:23:09.887177+0000","last_unstale":"2024-09-15T23:23:10.878132+0000","last_undegraded":"2024-09-15T23:23:10.878132+0000","last_fullsized":"2024-09-15T23:23:10.878132+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:49.433015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.887969+0000","last_change":"2024-09-15T23:23:08.879418+0000","last_active":"2024-09-15T23:23:10.887969+0000","last_peered":"2024-09-15T23:23:10.887969+0000","last_clean":"2024-09-15T23:23:10.887969+0000","last_became_active":"2024-09-15T23:23:08.879150+0000","last_became_peered":"2024-09-15T23:23:08.879150+0000","last_unstale":"2024-09-15T23:23:10.887969+0000","last_undegraded":"2024-09-15T23:23:10.887969+0000","last_fullsized":"2024-09-15T23:23:10.887969+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:15.609024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.876531+0000","last_change":"2024-09-15T23:23:09.888915+0000","last_active":"2024-09-15T23:23:10.876531+0000","last_peered":"2024-09-15T23:23:10.876531+0000","last_clean":"2024-09-15T23:23:10.876531+0000","last_became_active":"2024-09-15T23:23:09.888562+0000","last_became_peered":"2024-09-15T23:23:09.888562+0000","last_unstale":"2024-09-15T23:23:10.876531+0000","last_undegraded":"2024-09-15T23:23:10.876531+0000","last_fullsized":"2024-09-15T23:23:10.876531+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:00.376440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.876406+0000","last_change":"2024-09-15T23:23:08.882191+0000","last_active":"2024-09-15T23:23:10.876406+0000","last_peered":"2024-09-15T23:23:10.876406+0000","last_clean":"2024-09-15T23:23:10.876406+0000","last_became_active":"2024-09-15T23:23:08.881889+0000","last_became_peered":"2024-09-15T23:23:08.881889+0000","last_unstale":"2024-09-15T23:23:10.876406+0000","last_undegraded":"2024-09-15T23:23:10.876406+0000","last_fullsized":"2024-09-15T23:23:10.876406+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:35:10.585965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878709+0000","last_change":"2024-09-15T23:23:09.895737+0000","last_active":"2024-09-15T23:23:10.878709+0000","last_peered":"2024-09-15T23:23:10.878709+0000","last_clean":"2024-09-15T23:23:10.878709+0000","last_became_active":"2024-09-15T23:23:09.895480+0000","last_became_peered":"2024-09-15T23:23:09.895480+0000","last_unstale":"2024-09-15T23:23:10.878709+0000","last_undegraded":"2024-09-15T23:23:10.878709+0000","last_fullsized":"2024-09-15T23:23:10.878709+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:52.863778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1b","version":"193'1","reported_seq":15,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388472+0000","last_change":"2024-09-15T23:23:08.873814+0000","last_active":"2024-09-15T23:23:11.388472+0000","last_peered":"2024-09-15T23:23:11.388472+0000","last_clean":"2024-09-15T23:23:11.388472+0000","last_became_active":"2024-09-15T23:23:08.873523+0000","last_became_peered":"2024-09-15T23:23:08.873523+0000","last_unstale":"2024-09-15T23:23:11.388472+0000","last_undegraded":"2024-09-15T23:23:11.388472+0000","last_fullsized":"2024-09-15T23:23:11.388472+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:00.357297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":492,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.876430+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:23:10.876430+0000","last_peered":"2024-09-15T23:23:10.876430+0000","last_clean":"2024-09-15T23:23:10.876430+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:23:10.876430+0000","last_undegraded":"2024-09-15T23:23:10.876430+0000","last_fullsized":"2024-09-15T23:23:10.876430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476876,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59940,"kb_used_data":2384,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311900,"statfs":{"total":96636764160,"available":96575385600,"internally_reserved":0,"allocated":2441216,"data_stored":1078699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476873,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55796,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316044,"statfs":{"total":96636764160,"available":96579629056,"internally_reserved":0,"allocated":2449408,"data_stored":1078803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476875,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56356,"kb_used_data":2952,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315484,"statfs":{"total":96636764160,"available":96579055616,"internally_reserved":0,"allocated":3022848,"data_stored":1667455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476875,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51620,"kb_used_data":2376,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320220,"statfs":{"total":96636764160,"available":96583905280,"internally_reserved":0,"allocated":2433024,"data_stored":1077669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542281,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51612,"kb_used_data":2376,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320228,"statfs":{"total":96636764160,"available":96583913472,"internally_reserved":0,"allocated":2433024,"data_stored":1077109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542281,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55780,"kb_used_data":2376,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316060,"statfs":{"total":96636764160,"available":96579645440,"internally_reserved":0,"allocated":2433024,"data_stored":1077157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542280,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60528,"kb_used_data":2956,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311312,"statfs":{"total":96636764160,"available":96574783488,"internally_reserved":0,"allocated":3026944,"data_stored":1661883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542282,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59932,"kb_used_data":2376,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311908,"statfs":{"total":96636764160,"available":96575393792,"internally_reserved":0,"allocated":2433024,"data_stored":1077177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:23:15.857 INFO:tasks.ceph.mds.a.smithi123.stderr:2024-09-15T23:23:15.856+0000 7f72c660e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:23:17.170 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:23:17.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.283+0000 7f2f96f54640 1 Processor -- start 2024-09-15T23:23:17.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.283+0000 7f2f96f54640 1 -- start start 2024-09-15T23:23:17.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.284+0000 7f2f96f54640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f9006c320 0x7f2f9015bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:17.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.284+0000 7f2f96f54640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f90071180 con 0x7f2f9013eb20 2024-09-15T23:23:17.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.284+0000 7f2f96f54640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f90071460 con 0x7f2f900b2d40 2024-09-15T23:23:17.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.284+0000 7f2f96f54640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f2f90071ab0 con 0x7f2f9006c320 2024-09-15T23:23:17.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.284+0000 7f2f954f1640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f2f9013eb20 0x7f2f9015c230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:46878/0 (socket says 172.21.15.123:46878) 2024-09-15T23:23:17.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.284+0000 7f2f954f1640 1 -- 172.21.15.123:0/3338118156 learned_addr learned my addr 172.21.15.123:0/3338118156 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:23:17.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.284+0000 7f2f87fff640 1 --2- 172.21.15.123:0/3338118156 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f9006c320 0x7f2f9015bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:17.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.284+0000 7f2f877fe640 1 -- 172.21.15.123:0/3338118156 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3388840995 0 0) 0x7f2f90071180 con 0x7f2f9013eb20 2024-09-15T23:23:17.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.284+0000 7f2f877fe640 1 -- 172.21.15.123:0/3338118156 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f78003520 con 0x7f2f9013eb20 2024-09-15T23:23:17.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.285+0000 7f2f877fe640 1 -- 172.21.15.123:0/3338118156 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1350948067 0 0) 0x7f2f90071460 con 0x7f2f900b2d40 2024-09-15T23:23:17.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.285+0000 7f2f877fe640 1 -- 172.21.15.123:0/3338118156 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f90071180 con 0x7f2f900b2d40 2024-09-15T23:23:17.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.285+0000 7f2f877fe640 1 -- 172.21.15.123:0/3338118156 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1084363895 0 0) 0x7f2f78003520 con 0x7f2f9013eb20 2024-09-15T23:23:17.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.285+0000 7f2f877fe640 1 -- 172.21.15.123:0/3338118156 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f9006c320 msgr2=0x7f2f9015bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:17.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.285+0000 7f2f877fe640 1 --2- 172.21.15.123:0/3338118156 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f9006c320 0x7f2f9015bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:17.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.285+0000 7f2f877fe640 1 -- 172.21.15.123:0/3338118156 >> v1:172.21.15.188:6789/0 conn(0x7f2f900b2d40 legacy=0x7f2f9006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:17.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.285+0000 7f2f877fe640 1 -- 172.21.15.123:0/3338118156 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f90071740 con 0x7f2f9013eb20 2024-09-15T23:23:17.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.285+0000 7f2f877fe640 1 -- 172.21.15.123:0/3338118156 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f2f880019f0 con 0x7f2f9013eb20 2024-09-15T23:23:17.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.285+0000 7f2f877fe640 1 -- 172.21.15.123:0/3338118156 >> v1:172.21.15.123:6789/0 conn(0x7f2f9013eb20 legacy=0x7f2f9015c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:17.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.285+0000 7f2f877fe640 1 --2- 172.21.15.123:0/3338118156 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f9006c320 0x7f2f78003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:17.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.285+0000 7f2f877fe640 1 --2- 172.21.15.123:0/3338118156 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f78004120 0x7f2f78004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:17.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.285+0000 7f2f877fe640 1 --2- 172.21.15.123:0/3338118156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f78004d40 0x7f2f780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:17.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.285+0000 7f2f877fe640 1 -- 172.21.15.123:0/3338118156 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2f90071ab0 con 0x7f2f78004d40 2024-09-15T23:23:17.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.285+0000 7f2f877fe640 1 -- 172.21.15.123:0/3338118156 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7800dd10 con 0x7f2f78004120 2024-09-15T23:23:17.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.285+0000 7f2f877fe640 1 -- 172.21.15.123:0/3338118156 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f2f7800df10 con 0x7f2f9006c320 2024-09-15T23:23:17.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.285+0000 7f2f94cf0640 1 --2- 172.21.15.123:0/3338118156 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f9006c320 0x7f2f78003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:17.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.285+0000 7f2f954f1640 1 --2- 172.21.15.123:0/3338118156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f78004d40 0x7f2f780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:17.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.285+0000 7f2f87fff640 1 --2- 172.21.15.123:0/3338118156 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f78004120 0x7f2f78004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:17.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.285+0000 7f2f954f1640 1 -- 172.21.15.123:0/3338118156 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f9006c320 msgr2=0x7f2f78003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:17.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.285+0000 7f2f954f1640 1 --2- 172.21.15.123:0/3338118156 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f9006c320 0x7f2f78003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:17.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.285+0000 7f2f954f1640 1 -- 172.21.15.123:0/3338118156 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f78004120 msgr2=0x7f2f78004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:17.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.285+0000 7f2f954f1640 1 --2- 172.21.15.123:0/3338118156 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f78004120 0x7f2f78004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:17.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.285+0000 7f2f954f1640 1 -- 172.21.15.123:0/3338118156 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f78003520 con 0x7f2f78004d40 2024-09-15T23:23:17.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.286+0000 7f2f954f1640 1 --2- 172.21.15.123:0/3338118156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f78004d40 0x7f2f780051c0 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 crypto rx=0x7f2f8800a6e0 tx=0x7f2f78005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8cc67e5e4583a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:17.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.286+0000 7f2f877fe640 1 -- 172.21.15.123:0/3338118156 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8800a330 con 0x7f2f78004d40 2024-09-15T23:23:17.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.286+0000 7f2f877fe640 1 -- 172.21.15.123:0/3338118156 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f8802f070 con 0x7f2f78004d40 2024-09-15T23:23:17.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.286+0000 7f2f877fe640 1 -- 172.21.15.123:0/3338118156 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8802bb30 con 0x7f2f78004d40 2024-09-15T23:23:17.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.287+0000 7f2f96f54640 1 -- 172.21.15.123:0/3338118156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f78004d40 msgr2=0x7f2f780051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:17.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.287+0000 7f2f96f54640 1 --2- 172.21.15.123:0/3338118156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f78004d40 0x7f2f780051c0 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 crypto rx=0x7f2f8800a6e0 tx=0x7f2f78005830 comp rx=0 tx=0).stop 2024-09-15T23:23:17.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.287+0000 7f2f954f1640 1 -- 172.21.15.123:0/3338118156 reap_dead start 2024-09-15T23:23:17.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.287+0000 7f2f96f54640 1 -- 172.21.15.123:0/3338118156 shutdown_connections 2024-09-15T23:23:17.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.287+0000 7f2f96f54640 1 -- 172.21.15.123:0/3338118156 >> 172.21.15.123:0/3338118156 conn(0x7f2f900ccec0 msgr2=0x7f2f900cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:17.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.287+0000 7f2f96f54640 1 -- 172.21.15.123:0/3338118156 shutdown_connections 2024-09-15T23:23:17.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.287+0000 7f2f96f54640 1 -- 172.21.15.123:0/3338118156 wait complete. 2024-09-15T23:23:17.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.288+0000 7f2f96f54640 1 Processor -- start 2024-09-15T23:23:17.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.288+0000 7f2f96f54640 1 -- start start 2024-09-15T23:23:17.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.289+0000 7f2f96f54640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f78004d40 0x7f2f9015efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:17.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.289+0000 7f2f96f54640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f90154af0 0x7f2f90140b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:17.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.289+0000 7f2f96f54640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f90141050 0x7f2f900b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:17.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.289+0000 7f2f96f54640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9015c080 con 0x7f2f90141050 2024-09-15T23:23:17.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.289+0000 7f2f96f54640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9015bf00 con 0x7f2f90154af0 2024-09-15T23:23:17.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.289+0000 7f2f96f54640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f2f900b3570 con 0x7f2f78004d40 2024-09-15T23:23:17.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.289+0000 7f2f954f1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f90141050 0x7f2f900b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:17.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.289+0000 7f2f954f1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f90141050 0x7f2f900b3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37660/0 (socket says 172.21.15.123:37660) 2024-09-15T23:23:17.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.289+0000 7f2f954f1640 1 -- 172.21.15.123:0/425879980 learned_addr learned my addr 172.21.15.123:0/425879980 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:17.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.289+0000 7f2f94cf0640 1 --2- 172.21.15.123:0/425879980 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f78004d40 0x7f2f9015efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:17.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.289+0000 7f2f87fff640 1 --2- 172.21.15.123:0/425879980 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f90154af0 0x7f2f90140b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:17.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.289+0000 7f2f954f1640 1 -- 172.21.15.123:0/425879980 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f78004d40 msgr2=0x7f2f9015efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:17.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.289+0000 7f2f954f1640 1 --2- 172.21.15.123:0/425879980 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f78004d40 0x7f2f9015efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:17.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.289+0000 7f2f954f1640 1 -- 172.21.15.123:0/425879980 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f90154af0 msgr2=0x7f2f90140b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:17.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.289+0000 7f2f954f1640 1 --2- 172.21.15.123:0/425879980 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f90154af0 0x7f2f90140b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:17.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.289+0000 7f2f954f1640 1 -- 172.21.15.123:0/425879980 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f9015e220 con 0x7f2f90141050 2024-09-15T23:23:17.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.289+0000 7f2f94cf0640 1 --2- 172.21.15.123:0/425879980 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f78004d40 0x7f2f9015efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:23:17.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.289+0000 7f2f87fff640 1 --2- 172.21.15.123:0/425879980 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f90154af0 0x7f2f90140b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:23:17.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.289+0000 7f2f954f1640 1 --2- 172.21.15.123:0/425879980 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f90141050 0x7f2f900b3b10 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7f2f8802b380 tx=0x7f2f900738d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:17.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.290+0000 7f2f857fa640 1 -- 172.21.15.123:0/425879980 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8800a330 con 0x7f2f90141050 2024-09-15T23:23:17.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.290+0000 7f2f857fa640 1 -- 172.21.15.123:0/425879980 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f8802ca10 con 0x7f2f90141050 2024-09-15T23:23:17.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.290+0000 7f2f857fa640 1 -- 172.21.15.123:0/425879980 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f88001e80 con 0x7f2f90141050 2024-09-15T23:23:17.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.290+0000 7f2f96f54640 1 -- 172.21.15.123:0/425879980 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f9015e4e0 con 0x7f2f90141050 2024-09-15T23:23:17.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.290+0000 7f2f96f54640 1 -- 172.21.15.123:0/425879980 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f9015eaa0 con 0x7f2f90141050 2024-09-15T23:23:17.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.291+0000 7f2f96f54640 1 -- 172.21.15.123:0/425879980 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f9006bc10 con 0x7f2f90141050 2024-09-15T23:23:17.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.291+0000 7f2f857fa640 1 -- 172.21.15.123:0/425879980 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2f88034470 con 0x7f2f90141050 2024-09-15T23:23:17.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.292+0000 7f2f857fa640 1 --2- 172.21.15.123:0/425879980 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2f7c06c2b0 0x7f2f7c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:17.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.292+0000 7f2f857fa640 1 -- 172.21.15.123:0/425879980 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7f2f880ab4a0 con 0x7f2f90141050 2024-09-15T23:23:17.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.292+0000 7f2f94cf0640 1 --2- 172.21.15.123:0/425879980 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2f7c06c2b0 0x7f2f7c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:17.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.292+0000 7f2f94cf0640 1 --2- 172.21.15.123:0/425879980 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2f7c06c2b0 0x7f2f7c06e770 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c0036b0 tx=0x7f2f8c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:17.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.296+0000 7f2f857fa640 1 -- 172.21.15.123:0/425879980 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2f88079b70 con 0x7f2f90141050 2024-09-15T23:23:17.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.460+0000 7f2f96f54640 1 -- 172.21.15.123:0/425879980 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2f9006c9c0 con 0x7f2f7c06c2b0 2024-09-15T23:23:17.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.466+0000 7f2f857fa640 1 -- 172.21.15.123:0/425879980 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252478 (secure 0 0 0) 0x7f2f9006c9c0 con 0x7f2f7c06c2b0 2024-09-15T23:23:17.473 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:23:17.474 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:23:17.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.469+0000 7f2f96f54640 1 -- 172.21.15.123:0/425879980 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2f7c06c2b0 msgr2=0x7f2f7c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:17.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.469+0000 7f2f96f54640 1 --2- 172.21.15.123:0/425879980 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2f7c06c2b0 0x7f2f7c06e770 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c0036b0 tx=0x7f2f8c009040 comp rx=0 tx=0).stop 2024-09-15T23:23:17.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.469+0000 7f2f96f54640 1 -- 172.21.15.123:0/425879980 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f90141050 msgr2=0x7f2f900b3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:17.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.469+0000 7f2f96f54640 1 --2- 172.21.15.123:0/425879980 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f90141050 0x7f2f900b3b10 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7f2f8802b380 tx=0x7f2f900738d0 comp rx=0 tx=0).stop 2024-09-15T23:23:17.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.469+0000 7f2f96f54640 1 -- 172.21.15.123:0/425879980 shutdown_connections 2024-09-15T23:23:17.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.469+0000 7f2f96f54640 1 --2- 172.21.15.123:0/425879980 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2f7c06c2b0 0x7f2f7c06e770 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:17.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.469+0000 7f2f96f54640 1 --2- 172.21.15.123:0/425879980 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2f90141050 0x7f2f900b3b10 unknown :-1 s=CLOSED pgs=2248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:17.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.469+0000 7f2f96f54640 1 --2- 172.21.15.123:0/425879980 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2f90154af0 0x7f2f90140b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:17.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.469+0000 7f2f96f54640 1 --2- 172.21.15.123:0/425879980 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2f78004d40 0x7f2f9015efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:17.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.469+0000 7f2f96f54640 1 -- 172.21.15.123:0/425879980 >> 172.21.15.123:0/425879980 conn(0x7f2f900ccec0 msgr2=0x7f2f900cd600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:17.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.470+0000 7f2f96f54640 1 -- 172.21.15.123:0/425879980 shutdown_connections 2024-09-15T23:23:17.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.470+0000 7f2f96f54640 1 -- 172.21.15.123:0/425879980 wait complete. 2024-09-15T23:23:17.482 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":524,"stamp":"2024-09-15T23:23:15.660824+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":126,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":451564,"kb_used_data":20188,"kb_used_omap":12,"kb_used_meta":431155,"kb_avail":754523156,"statfs":{"total":773094113280,"available":772631711744,"internally_reserved":0,"allocated":20672512,"data_stored":9795952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":441503280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.793102"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389542+0000","last_change":"2024-09-15T23:23:09.896392+0000","last_active":"2024-09-15T23:23:11.389542+0000","last_peered":"2024-09-15T23:23:11.389542+0000","last_clean":"2024-09-15T23:23:11.389542+0000","last_became_active":"2024-09-15T23:23:09.896113+0000","last_became_peered":"2024-09-15T23:23:09.896113+0000","last_unstale":"2024-09-15T23:23:11.389542+0000","last_undegraded":"2024-09-15T23:23:11.389542+0000","last_fullsized":"2024-09-15T23:23:11.389542+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:42.157923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388566+0000","last_change":"2024-09-15T23:23:09.879756+0000","last_active":"2024-09-15T23:23:11.388566+0000","last_peered":"2024-09-15T23:23:11.388566+0000","last_clean":"2024-09-15T23:23:11.388566+0000","last_became_active":"2024-09-15T23:23:09.879473+0000","last_became_peered":"2024-09-15T23:23:09.879473+0000","last_unstale":"2024-09-15T23:23:11.388566+0000","last_undegraded":"2024-09-15T23:23:11.388566+0000","last_fullsized":"2024-09-15T23:23:11.388566+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:00.780850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878505+0000","last_change":"2024-09-15T23:23:09.890448+0000","last_active":"2024-09-15T23:23:10.878505+0000","last_peered":"2024-09-15T23:23:10.878505+0000","last_clean":"2024-09-15T23:23:10.878505+0000","last_became_active":"2024-09-15T23:23:09.890146+0000","last_became_peered":"2024-09-15T23:23:09.890146+0000","last_unstale":"2024-09-15T23:23:10.878505+0000","last_undegraded":"2024-09-15T23:23:10.878505+0000","last_fullsized":"2024-09-15T23:23:10.878505+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:10.381055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.876782+0000","last_change":"2024-09-15T23:23:09.884572+0000","last_active":"2024-09-15T23:23:10.876782+0000","last_peered":"2024-09-15T23:23:10.876782+0000","last_clean":"2024-09-15T23:23:10.876782+0000","last_became_active":"2024-09-15T23:23:09.883008+0000","last_became_peered":"2024-09-15T23:23:09.883008+0000","last_unstale":"2024-09-15T23:23:10.876782+0000","last_undegraded":"2024-09-15T23:23:10.876782+0000","last_fullsized":"2024-09-15T23:23:10.876782+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:26:27.160853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.879038+0000","last_change":"2024-09-15T23:23:09.893118+0000","last_active":"2024-09-15T23:23:10.879038+0000","last_peered":"2024-09-15T23:23:10.879038+0000","last_clean":"2024-09-15T23:23:10.879038+0000","last_became_active":"2024-09-15T23:23:09.892821+0000","last_became_peered":"2024-09-15T23:23:09.892821+0000","last_unstale":"2024-09-15T23:23:10.879038+0000","last_undegraded":"2024-09-15T23:23:10.879038+0000","last_fullsized":"2024-09-15T23:23:10.879038+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:49.942314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389282+0000","last_change":"2024-09-15T23:23:09.898540+0000","last_active":"2024-09-15T23:23:11.389282+0000","last_peered":"2024-09-15T23:23:11.389282+0000","last_clean":"2024-09-15T23:23:11.389282+0000","last_became_active":"2024-09-15T23:23:09.898254+0000","last_became_peered":"2024-09-15T23:23:09.898254+0000","last_unstale":"2024-09-15T23:23:11.389282+0000","last_undegraded":"2024-09-15T23:23:11.389282+0000","last_fullsized":"2024-09-15T23:23:11.389282+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:56:41.394415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389205+0000","last_change":"2024-09-15T23:23:09.897940+0000","last_active":"2024-09-15T23:23:11.389205+0000","last_peered":"2024-09-15T23:23:11.389205+0000","last_clean":"2024-09-15T23:23:11.389205+0000","last_became_active":"2024-09-15T23:23:09.897615+0000","last_became_peered":"2024-09-15T23:23:09.897615+0000","last_unstale":"2024-09-15T23:23:11.389205+0000","last_undegraded":"2024-09-15T23:23:11.389205+0000","last_fullsized":"2024-09-15T23:23:11.389205+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:31:06.944151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.877651+0000","last_change":"2024-09-15T23:23:09.898922+0000","last_active":"2024-09-15T23:23:10.877651+0000","last_peered":"2024-09-15T23:23:10.877651+0000","last_clean":"2024-09-15T23:23:10.877651+0000","last_became_active":"2024-09-15T23:23:09.898387+0000","last_became_peered":"2024-09-15T23:23:09.898387+0000","last_unstale":"2024-09-15T23:23:10.877651+0000","last_undegraded":"2024-09-15T23:23:10.877651+0000","last_fullsized":"2024-09-15T23:23:10.877651+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:02:16.268734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388772+0000","last_change":"2024-09-15T23:23:09.880932+0000","last_active":"2024-09-15T23:23:11.388772+0000","last_peered":"2024-09-15T23:23:11.388772+0000","last_clean":"2024-09-15T23:23:11.388772+0000","last_became_active":"2024-09-15T23:23:09.880634+0000","last_became_peered":"2024-09-15T23:23:09.880634+0000","last_unstale":"2024-09-15T23:23:11.388772+0000","last_undegraded":"2024-09-15T23:23:11.388772+0000","last_fullsized":"2024-09-15T23:23:11.388772+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:29.758575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.877907+0000","last_change":"2024-09-15T23:23:09.894886+0000","last_active":"2024-09-15T23:23:10.877907+0000","last_peered":"2024-09-15T23:23:10.877907+0000","last_clean":"2024-09-15T23:23:10.877907+0000","last_became_active":"2024-09-15T23:23:09.894452+0000","last_became_peered":"2024-09-15T23:23:09.894452+0000","last_unstale":"2024-09-15T23:23:10.877907+0000","last_undegraded":"2024-09-15T23:23:10.877907+0000","last_fullsized":"2024-09-15T23:23:10.877907+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:16.788699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389717+0000","last_change":"2024-09-15T23:23:09.892595+0000","last_active":"2024-09-15T23:23:11.389717+0000","last_peered":"2024-09-15T23:23:11.389717+0000","last_clean":"2024-09-15T23:23:11.389717+0000","last_became_active":"2024-09-15T23:23:09.892325+0000","last_became_peered":"2024-09-15T23:23:09.892325+0000","last_unstale":"2024-09-15T23:23:11.389717+0000","last_undegraded":"2024-09-15T23:23:11.389717+0000","last_fullsized":"2024-09-15T23:23:11.389717+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:17.682368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.888139+0000","last_change":"2024-09-15T23:23:09.882541+0000","last_active":"2024-09-15T23:23:10.888139+0000","last_peered":"2024-09-15T23:23:10.888139+0000","last_clean":"2024-09-15T23:23:10.888139+0000","last_became_active":"2024-09-15T23:23:09.881999+0000","last_became_peered":"2024-09-15T23:23:09.881999+0000","last_unstale":"2024-09-15T23:23:10.888139+0000","last_undegraded":"2024-09-15T23:23:10.888139+0000","last_fullsized":"2024-09-15T23:23:10.888139+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:44.365436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.876512+0000","last_change":"2024-09-15T23:23:09.888465+0000","last_active":"2024-09-15T23:23:10.876512+0000","last_peered":"2024-09-15T23:23:10.876512+0000","last_clean":"2024-09-15T23:23:10.876512+0000","last_became_active":"2024-09-15T23:23:09.888153+0000","last_became_peered":"2024-09-15T23:23:09.888153+0000","last_unstale":"2024-09-15T23:23:10.876512+0000","last_undegraded":"2024-09-15T23:23:10.876512+0000","last_fullsized":"2024-09-15T23:23:10.876512+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:00.436713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388886+0000","last_change":"2024-09-15T23:23:09.886114+0000","last_active":"2024-09-15T23:23:11.388886+0000","last_peered":"2024-09-15T23:23:11.388886+0000","last_clean":"2024-09-15T23:23:11.388886+0000","last_became_active":"2024-09-15T23:23:09.885637+0000","last_became_peered":"2024-09-15T23:23:09.885637+0000","last_unstale":"2024-09-15T23:23:11.388886+0000","last_undegraded":"2024-09-15T23:23:11.388886+0000","last_fullsized":"2024-09-15T23:23:11.388886+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:38:49.942314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389344+0000","last_change":"2024-09-15T23:23:09.891894+0000","last_active":"2024-09-15T23:23:11.389344+0000","last_peered":"2024-09-15T23:23:11.389344+0000","last_clean":"2024-09-15T23:23:11.389344+0000","last_became_active":"2024-09-15T23:23:09.891392+0000","last_became_peered":"2024-09-15T23:23:09.891392+0000","last_unstale":"2024-09-15T23:23:11.389344+0000","last_undegraded":"2024-09-15T23:23:11.389344+0000","last_fullsized":"2024-09-15T23:23:11.389344+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:35.402255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389097+0000","last_change":"2024-09-15T23:23:09.895144+0000","last_active":"2024-09-15T23:23:11.389097+0000","last_peered":"2024-09-15T23:23:11.389097+0000","last_clean":"2024-09-15T23:23:11.389097+0000","last_became_active":"2024-09-15T23:23:09.894871+0000","last_became_peered":"2024-09-15T23:23:09.894871+0000","last_unstale":"2024-09-15T23:23:11.389097+0000","last_undegraded":"2024-09-15T23:23:11.389097+0000","last_fullsized":"2024-09-15T23:23:11.389097+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:49:41.077299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389677+0000","last_change":"2024-09-15T23:23:09.888650+0000","last_active":"2024-09-15T23:23:11.389677+0000","last_peered":"2024-09-15T23:23:11.389677+0000","last_clean":"2024-09-15T23:23:11.389677+0000","last_became_active":"2024-09-15T23:23:09.888057+0000","last_became_peered":"2024-09-15T23:23:09.888057+0000","last_unstale":"2024-09-15T23:23:11.389677+0000","last_undegraded":"2024-09-15T23:23:11.389677+0000","last_fullsized":"2024-09-15T23:23:11.389677+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:07.797869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878074+0000","last_change":"2024-09-15T23:23:09.892556+0000","last_active":"2024-09-15T23:23:10.878074+0000","last_peered":"2024-09-15T23:23:10.878074+0000","last_clean":"2024-09-15T23:23:10.878074+0000","last_became_active":"2024-09-15T23:23:09.892282+0000","last_became_peered":"2024-09-15T23:23:09.892282+0000","last_unstale":"2024-09-15T23:23:10.878074+0000","last_undegraded":"2024-09-15T23:23:10.878074+0000","last_fullsized":"2024-09-15T23:23:10.878074+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:17.364225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878678+0000","last_change":"2024-09-15T23:23:09.888937+0000","last_active":"2024-09-15T23:23:10.878678+0000","last_peered":"2024-09-15T23:23:10.878678+0000","last_clean":"2024-09-15T23:23:10.878678+0000","last_became_active":"2024-09-15T23:23:09.888173+0000","last_became_peered":"2024-09-15T23:23:09.888173+0000","last_unstale":"2024-09-15T23:23:10.878678+0000","last_undegraded":"2024-09-15T23:23:10.878678+0000","last_fullsized":"2024-09-15T23:23:10.878678+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:55:42.187292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878432+0000","last_change":"2024-09-15T23:23:09.884518+0000","last_active":"2024-09-15T23:23:10.878432+0000","last_peered":"2024-09-15T23:23:10.878432+0000","last_clean":"2024-09-15T23:23:10.878432+0000","last_became_active":"2024-09-15T23:23:09.884229+0000","last_became_peered":"2024-09-15T23:23:09.884229+0000","last_unstale":"2024-09-15T23:23:10.878432+0000","last_undegraded":"2024-09-15T23:23:10.878432+0000","last_fullsized":"2024-09-15T23:23:10.878432+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:07.994162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.888125+0000","last_change":"2024-09-15T23:23:09.877411+0000","last_active":"2024-09-15T23:23:10.888125+0000","last_peered":"2024-09-15T23:23:10.888125+0000","last_clean":"2024-09-15T23:23:10.888125+0000","last_became_active":"2024-09-15T23:23:09.877160+0000","last_became_peered":"2024-09-15T23:23:09.877160+0000","last_unstale":"2024-09-15T23:23:10.888125+0000","last_undegraded":"2024-09-15T23:23:10.888125+0000","last_fullsized":"2024-09-15T23:23:10.888125+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:58:09.752514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388325+0000","last_change":"2024-09-15T23:23:09.883852+0000","last_active":"2024-09-15T23:23:11.388325+0000","last_peered":"2024-09-15T23:23:11.388325+0000","last_clean":"2024-09-15T23:23:11.388325+0000","last_became_active":"2024-09-15T23:23:09.883577+0000","last_became_peered":"2024-09-15T23:23:09.883577+0000","last_unstale":"2024-09-15T23:23:11.388325+0000","last_undegraded":"2024-09-15T23:23:11.388325+0000","last_fullsized":"2024-09-15T23:23:11.388325+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:51:27.652085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.876391+0000","last_change":"2024-09-15T23:23:09.889256+0000","last_active":"2024-09-15T23:23:10.876391+0000","last_peered":"2024-09-15T23:23:10.876391+0000","last_clean":"2024-09-15T23:23:10.876391+0000","last_became_active":"2024-09-15T23:23:09.888952+0000","last_became_peered":"2024-09-15T23:23:09.888952+0000","last_unstale":"2024-09-15T23:23:10.876391+0000","last_undegraded":"2024-09-15T23:23:10.876391+0000","last_fullsized":"2024-09-15T23:23:10.876391+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:44:35.015377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388557+0000","last_change":"2024-09-15T23:23:09.883964+0000","last_active":"2024-09-15T23:23:11.388557+0000","last_peered":"2024-09-15T23:23:11.388557+0000","last_clean":"2024-09-15T23:23:11.388557+0000","last_became_active":"2024-09-15T23:23:09.882965+0000","last_became_peered":"2024-09-15T23:23:09.882965+0000","last_unstale":"2024-09-15T23:23:11.388557+0000","last_undegraded":"2024-09-15T23:23:11.388557+0000","last_fullsized":"2024-09-15T23:23:11.388557+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:35:12.976722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.876775+0000","last_change":"2024-09-15T23:23:09.889908+0000","last_active":"2024-09-15T23:23:10.876775+0000","last_peered":"2024-09-15T23:23:10.876775+0000","last_clean":"2024-09-15T23:23:10.876775+0000","last_became_active":"2024-09-15T23:23:09.889670+0000","last_became_peered":"2024-09-15T23:23:09.889670+0000","last_unstale":"2024-09-15T23:23:10.876775+0000","last_undegraded":"2024-09-15T23:23:10.876775+0000","last_fullsized":"2024-09-15T23:23:10.876775+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:42.878091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.879088+0000","last_change":"2024-09-15T23:23:09.885890+0000","last_active":"2024-09-15T23:23:10.879088+0000","last_peered":"2024-09-15T23:23:10.879088+0000","last_clean":"2024-09-15T23:23:10.879088+0000","last_became_active":"2024-09-15T23:23:09.885585+0000","last_became_peered":"2024-09-15T23:23:09.885585+0000","last_unstale":"2024-09-15T23:23:10.879088+0000","last_undegraded":"2024-09-15T23:23:10.879088+0000","last_fullsized":"2024-09-15T23:23:10.879088+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:50:12.472633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.888255+0000","last_change":"2024-09-15T23:23:09.879160+0000","last_active":"2024-09-15T23:23:10.888255+0000","last_peered":"2024-09-15T23:23:10.888255+0000","last_clean":"2024-09-15T23:23:10.888255+0000","last_became_active":"2024-09-15T23:23:09.878880+0000","last_became_peered":"2024-09-15T23:23:09.878880+0000","last_unstale":"2024-09-15T23:23:10.888255+0000","last_undegraded":"2024-09-15T23:23:10.888255+0000","last_fullsized":"2024-09-15T23:23:10.888255+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:10.748997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878586+0000","last_change":"2024-09-15T23:23:09.889164+0000","last_active":"2024-09-15T23:23:10.878586+0000","last_peered":"2024-09-15T23:23:10.878586+0000","last_clean":"2024-09-15T23:23:10.878586+0000","last_became_active":"2024-09-15T23:23:09.888868+0000","last_became_peered":"2024-09-15T23:23:09.888868+0000","last_unstale":"2024-09-15T23:23:10.878586+0000","last_undegraded":"2024-09-15T23:23:10.878586+0000","last_fullsized":"2024-09-15T23:23:10.878586+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:12:17.516107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388515+0000","last_change":"2024-09-15T23:23:09.882896+0000","last_active":"2024-09-15T23:23:11.388515+0000","last_peered":"2024-09-15T23:23:11.388515+0000","last_clean":"2024-09-15T23:23:11.388515+0000","last_became_active":"2024-09-15T23:23:09.882578+0000","last_became_peered":"2024-09-15T23:23:09.882578+0000","last_unstale":"2024-09-15T23:23:11.388515+0000","last_undegraded":"2024-09-15T23:23:11.388515+0000","last_fullsized":"2024-09-15T23:23:11.388515+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:11:25.977617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.876522+0000","last_change":"2024-09-15T23:23:09.890580+0000","last_active":"2024-09-15T23:23:10.876522+0000","last_peered":"2024-09-15T23:23:10.876522+0000","last_clean":"2024-09-15T23:23:10.876522+0000","last_became_active":"2024-09-15T23:23:09.890332+0000","last_became_peered":"2024-09-15T23:23:09.890332+0000","last_unstale":"2024-09-15T23:23:10.876522+0000","last_undegraded":"2024-09-15T23:23:10.876522+0000","last_fullsized":"2024-09-15T23:23:10.876522+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:56.296082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878136+0000","last_change":"2024-09-15T23:23:09.884750+0000","last_active":"2024-09-15T23:23:10.878136+0000","last_peered":"2024-09-15T23:23:10.878136+0000","last_clean":"2024-09-15T23:23:10.878136+0000","last_became_active":"2024-09-15T23:23:09.884395+0000","last_became_peered":"2024-09-15T23:23:09.884395+0000","last_unstale":"2024-09-15T23:23:10.878136+0000","last_undegraded":"2024-09-15T23:23:10.878136+0000","last_fullsized":"2024-09-15T23:23:10.878136+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:45.924003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388853+0000","last_change":"2024-09-15T23:23:09.889967+0000","last_active":"2024-09-15T23:23:11.388853+0000","last_peered":"2024-09-15T23:23:11.388853+0000","last_clean":"2024-09-15T23:23:11.388853+0000","last_became_active":"2024-09-15T23:23:09.889690+0000","last_became_peered":"2024-09-15T23:23:09.889690+0000","last_unstale":"2024-09-15T23:23:11.388853+0000","last_undegraded":"2024-09-15T23:23:11.388853+0000","last_fullsized":"2024-09-15T23:23:11.388853+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:52.863778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.888193+0000","last_change":"2024-09-15T23:23:09.884871+0000","last_active":"2024-09-15T23:23:10.888193+0000","last_peered":"2024-09-15T23:23:10.888193+0000","last_clean":"2024-09-15T23:23:10.888193+0000","last_became_active":"2024-09-15T23:23:09.884619+0000","last_became_peered":"2024-09-15T23:23:09.884619+0000","last_unstale":"2024-09-15T23:23:10.888193+0000","last_undegraded":"2024-09-15T23:23:10.888193+0000","last_fullsized":"2024-09-15T23:23:10.888193+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:35:12.976722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1f","version":"193'4","reported_seq":18,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.888168+0000","last_change":"2024-09-15T23:23:08.885291+0000","last_active":"2024-09-15T23:23:10.888168+0000","last_peered":"2024-09-15T23:23:10.888168+0000","last_clean":"2024-09-15T23:23:10.888168+0000","last_became_active":"2024-09-15T23:23:08.884981+0000","last_became_peered":"2024-09-15T23:23:08.884981+0000","last_unstale":"2024-09-15T23:23:10.888168+0000","last_undegraded":"2024-09-15T23:23:10.888168+0000","last_fullsized":"2024-09-15T23:23:10.888168+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:21:39.932815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.876805+0000","last_change":"2024-09-15T23:23:09.878667+0000","last_active":"2024-09-15T23:23:10.876805+0000","last_peered":"2024-09-15T23:23:10.876805+0000","last_clean":"2024-09-15T23:23:10.876805+0000","last_became_active":"2024-09-15T23:23:09.878411+0000","last_became_peered":"2024-09-15T23:23:09.878411+0000","last_unstale":"2024-09-15T23:23:10.876805+0000","last_undegraded":"2024-09-15T23:23:10.876805+0000","last_fullsized":"2024-09-15T23:23:10.876805+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:01:01.804738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1e","version":"193'1","reported_seq":15,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388612+0000","last_change":"2024-09-15T23:23:08.873830+0000","last_active":"2024-09-15T23:23:11.388612+0000","last_peered":"2024-09-15T23:23:11.388612+0000","last_clean":"2024-09-15T23:23:11.388612+0000","last_became_active":"2024-09-15T23:23:08.873532+0000","last_became_peered":"2024-09-15T23:23:08.873532+0000","last_unstale":"2024-09-15T23:23:11.388612+0000","last_undegraded":"2024-09-15T23:23:11.388612+0000","last_fullsized":"2024-09-15T23:23:11.388612+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:53:42.495426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878490+0000","last_change":"2024-09-15T23:23:09.893191+0000","last_active":"2024-09-15T23:23:10.878490+0000","last_peered":"2024-09-15T23:23:10.878490+0000","last_clean":"2024-09-15T23:23:10.878490+0000","last_became_active":"2024-09-15T23:23:09.892564+0000","last_became_peered":"2024-09-15T23:23:09.892564+0000","last_unstale":"2024-09-15T23:23:10.878490+0000","last_undegraded":"2024-09-15T23:23:10.878490+0000","last_fullsized":"2024-09-15T23:23:10.878490+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:43:10.307662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1d","version":"193'2","reported_seq":16,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.879004+0000","last_change":"2024-09-15T23:23:08.883380+0000","last_active":"2024-09-15T23:23:10.879004+0000","last_peered":"2024-09-15T23:23:10.879004+0000","last_clean":"2024-09-15T23:23:10.879004+0000","last_became_active":"2024-09-15T23:23:08.883076+0000","last_became_peered":"2024-09-15T23:23:08.883076+0000","last_unstale":"2024-09-15T23:23:10.879004+0000","last_undegraded":"2024-09-15T23:23:10.879004+0000","last_fullsized":"2024-09-15T23:23:10.879004+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:41.150625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878773+0000","last_change":"2024-09-15T23:23:09.889863+0000","last_active":"2024-09-15T23:23:10.878773+0000","last_peered":"2024-09-15T23:23:10.878773+0000","last_clean":"2024-09-15T23:23:10.878773+0000","last_became_active":"2024-09-15T23:23:09.889275+0000","last_became_peered":"2024-09-15T23:23:09.889275+0000","last_unstale":"2024-09-15T23:23:10.878773+0000","last_undegraded":"2024-09-15T23:23:10.878773+0000","last_fullsized":"2024-09-15T23:23:10.878773+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:48.682646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1c","version":"193'2","reported_seq":16,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.876699+0000","last_change":"2024-09-15T23:23:08.877981+0000","last_active":"2024-09-15T23:23:10.876699+0000","last_peered":"2024-09-15T23:23:10.876699+0000","last_clean":"2024-09-15T23:23:10.876699+0000","last_became_active":"2024-09-15T23:23:08.877606+0000","last_became_peered":"2024-09-15T23:23:08.877606+0000","last_unstale":"2024-09-15T23:23:10.876699+0000","last_undegraded":"2024-09-15T23:23:10.876699+0000","last_fullsized":"2024-09-15T23:23:10.876699+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:34:57.450091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.876541+0000","last_change":"2024-09-15T23:23:09.883973+0000","last_active":"2024-09-15T23:23:10.876541+0000","last_peered":"2024-09-15T23:23:10.876541+0000","last_clean":"2024-09-15T23:23:10.876541+0000","last_became_active":"2024-09-15T23:23:09.883710+0000","last_became_peered":"2024-09-15T23:23:09.883710+0000","last_unstale":"2024-09-15T23:23:10.876541+0000","last_undegraded":"2024-09-15T23:23:10.876541+0000","last_fullsized":"2024-09-15T23:23:10.876541+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:35:02.997694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1a","version":"193'1","reported_seq":15,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389577+0000","last_change":"2024-09-15T23:23:08.884833+0000","last_active":"2024-09-15T23:23:11.389577+0000","last_peered":"2024-09-15T23:23:11.389577+0000","last_clean":"2024-09-15T23:23:11.389577+0000","last_became_active":"2024-09-15T23:23:08.884446+0000","last_became_peered":"2024-09-15T23:23:08.884446+0000","last_unstale":"2024-09-15T23:23:11.389577+0000","last_undegraded":"2024-09-15T23:23:11.389577+0000","last_fullsized":"2024-09-15T23:23:11.389577+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:25:43.826245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389249+0000","last_change":"2024-09-15T23:23:09.887857+0000","last_active":"2024-09-15T23:23:11.389249+0000","last_peered":"2024-09-15T23:23:11.389249+0000","last_clean":"2024-09-15T23:23:11.389249+0000","last_became_active":"2024-09-15T23:23:09.887005+0000","last_became_peered":"2024-09-15T23:23:09.887005+0000","last_unstale":"2024-09-15T23:23:11.389249+0000","last_undegraded":"2024-09-15T23:23:11.389249+0000","last_fullsized":"2024-09-15T23:23:11.389249+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:13.448014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878250+0000","last_change":"2024-09-15T23:23:08.887529+0000","last_active":"2024-09-15T23:23:10.878250+0000","last_peered":"2024-09-15T23:23:10.878250+0000","last_clean":"2024-09-15T23:23:10.878250+0000","last_became_active":"2024-09-15T23:23:08.887256+0000","last_became_peered":"2024-09-15T23:23:08.887256+0000","last_unstale":"2024-09-15T23:23:10.878250+0000","last_undegraded":"2024-09-15T23:23:10.878250+0000","last_fullsized":"2024-09-15T23:23:10.878250+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:34.394956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388850+0000","last_change":"2024-09-15T23:23:09.875524+0000","last_active":"2024-09-15T23:23:11.388850+0000","last_peered":"2024-09-15T23:23:11.388850+0000","last_clean":"2024-09-15T23:23:11.388850+0000","last_became_active":"2024-09-15T23:23:09.875258+0000","last_became_peered":"2024-09-15T23:23:09.875258+0000","last_unstale":"2024-09-15T23:23:11.388850+0000","last_undegraded":"2024-09-15T23:23:11.388850+0000","last_fullsized":"2024-09-15T23:23:11.388850+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:10.748997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.876318+0000","last_change":"2024-09-15T23:23:08.885856+0000","last_active":"2024-09-15T23:23:10.876318+0000","last_peered":"2024-09-15T23:23:10.876318+0000","last_clean":"2024-09-15T23:23:10.876318+0000","last_became_active":"2024-09-15T23:23:08.885459+0000","last_became_peered":"2024-09-15T23:23:08.885459+0000","last_unstale":"2024-09-15T23:23:10.876318+0000","last_undegraded":"2024-09-15T23:23:10.876318+0000","last_fullsized":"2024-09-15T23:23:10.876318+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:06:25.879694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.876797+0000","last_change":"2024-09-15T23:23:09.897389+0000","last_active":"2024-09-15T23:23:10.876797+0000","last_peered":"2024-09-15T23:23:10.876797+0000","last_clean":"2024-09-15T23:23:10.876797+0000","last_became_active":"2024-09-15T23:23:09.897087+0000","last_became_peered":"2024-09-15T23:23:09.897087+0000","last_unstale":"2024-09-15T23:23:10.876797+0000","last_undegraded":"2024-09-15T23:23:10.876797+0000","last_fullsized":"2024-09-15T23:23:10.876797+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:00.066784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878930+0000","last_change":"2024-09-15T23:23:08.882342+0000","last_active":"2024-09-15T23:23:10.878930+0000","last_peered":"2024-09-15T23:23:10.878930+0000","last_clean":"2024-09-15T23:23:10.878930+0000","last_became_active":"2024-09-15T23:23:08.882046+0000","last_became_peered":"2024-09-15T23:23:08.882046+0000","last_unstale":"2024-09-15T23:23:10.878930+0000","last_undegraded":"2024-09-15T23:23:10.878930+0000","last_fullsized":"2024-09-15T23:23:10.878930+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:46.966470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388963+0000","last_change":"2024-09-15T23:23:09.887039+0000","last_active":"2024-09-15T23:23:11.388963+0000","last_peered":"2024-09-15T23:23:11.388963+0000","last_clean":"2024-09-15T23:23:11.388963+0000","last_became_active":"2024-09-15T23:23:09.886178+0000","last_became_peered":"2024-09-15T23:23:09.886178+0000","last_unstale":"2024-09-15T23:23:11.388963+0000","last_undegraded":"2024-09-15T23:23:11.388963+0000","last_fullsized":"2024-09-15T23:23:11.388963+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:24.942591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.876675+0000","last_change":"2024-09-15T23:23:08.880340+0000","last_active":"2024-09-15T23:23:10.876675+0000","last_peered":"2024-09-15T23:23:10.876675+0000","last_clean":"2024-09-15T23:23:10.876675+0000","last_became_active":"2024-09-15T23:23:08.880064+0000","last_became_peered":"2024-09-15T23:23:08.880064+0000","last_unstale":"2024-09-15T23:23:10.876675+0000","last_undegraded":"2024-09-15T23:23:10.876675+0000","last_fullsized":"2024-09-15T23:23:10.876675+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:47.391744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388869+0000","last_change":"2024-09-15T23:23:09.884504+0000","last_active":"2024-09-15T23:23:11.388869+0000","last_peered":"2024-09-15T23:23:11.388869+0000","last_clean":"2024-09-15T23:23:11.388869+0000","last_became_active":"2024-09-15T23:23:09.884242+0000","last_became_peered":"2024-09-15T23:23:09.884242+0000","last_unstale":"2024-09-15T23:23:11.388869+0000","last_undegraded":"2024-09-15T23:23:11.388869+0000","last_fullsized":"2024-09-15T23:23:11.388869+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:31.076892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.15","version":"193'3","reported_seq":17,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.879081+0000","last_change":"2024-09-15T23:23:08.888755+0000","last_active":"2024-09-15T23:23:10.879081+0000","last_peered":"2024-09-15T23:23:10.879081+0000","last_clean":"2024-09-15T23:23:10.879081+0000","last_became_active":"2024-09-15T23:23:08.888250+0000","last_became_peered":"2024-09-15T23:23:08.888250+0000","last_unstale":"2024-09-15T23:23:10.879081+0000","last_undegraded":"2024-09-15T23:23:10.879081+0000","last_fullsized":"2024-09-15T23:23:10.879081+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:08.440981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878357+0000","last_change":"2024-09-15T23:23:09.881198+0000","last_active":"2024-09-15T23:23:10.878357+0000","last_peered":"2024-09-15T23:23:10.878357+0000","last_clean":"2024-09-15T23:23:10.878357+0000","last_became_active":"2024-09-15T23:23:09.880910+0000","last_became_peered":"2024-09-15T23:23:09.880910+0000","last_unstale":"2024-09-15T23:23:10.878357+0000","last_undegraded":"2024-09-15T23:23:10.878357+0000","last_fullsized":"2024-09-15T23:23:10.878357+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:53:34.689769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.14","version":"193'6","reported_seq":20,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388814+0000","last_change":"2024-09-15T23:23:08.874211+0000","last_active":"2024-09-15T23:23:11.388814+0000","last_peered":"2024-09-15T23:23:11.388814+0000","last_clean":"2024-09-15T23:23:11.388814+0000","last_became_active":"2024-09-15T23:23:08.873954+0000","last_became_peered":"2024-09-15T23:23:08.873954+0000","last_unstale":"2024-09-15T23:23:11.388814+0000","last_undegraded":"2024-09-15T23:23:11.388814+0000","last_fullsized":"2024-09-15T23:23:11.388814+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:28:49.634455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388862+0000","last_change":"2024-09-15T23:23:09.890661+0000","last_active":"2024-09-15T23:23:11.388862+0000","last_peered":"2024-09-15T23:23:11.388862+0000","last_clean":"2024-09-15T23:23:11.388862+0000","last_became_active":"2024-09-15T23:23:09.890390+0000","last_became_peered":"2024-09-15T23:23:09.890390+0000","last_unstale":"2024-09-15T23:23:11.388862+0000","last_undegraded":"2024-09-15T23:23:11.388862+0000","last_fullsized":"2024-09-15T23:23:11.388862+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:48.682646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.13","version":"193'2","reported_seq":16,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388442+0000","last_change":"2024-09-15T23:23:08.887007+0000","last_active":"2024-09-15T23:23:11.388442+0000","last_peered":"2024-09-15T23:23:11.388442+0000","last_clean":"2024-09-15T23:23:11.388442+0000","last_became_active":"2024-09-15T23:23:08.886687+0000","last_became_peered":"2024-09-15T23:23:08.886687+0000","last_unstale":"2024-09-15T23:23:11.388442+0000","last_undegraded":"2024-09-15T23:23:11.388442+0000","last_fullsized":"2024-09-15T23:23:11.388442+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:49:35.045796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.879038+0000","last_change":"2024-09-15T23:23:09.890142+0000","last_active":"2024-09-15T23:23:10.879038+0000","last_peered":"2024-09-15T23:23:10.879038+0000","last_clean":"2024-09-15T23:23:10.879038+0000","last_became_active":"2024-09-15T23:23:09.889857+0000","last_became_peered":"2024-09-15T23:23:09.889857+0000","last_unstale":"2024-09-15T23:23:10.879038+0000","last_undegraded":"2024-09-15T23:23:10.879038+0000","last_fullsized":"2024-09-15T23:23:10.879038+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:10:24.942591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388247+0000","last_change":"2024-09-15T23:23:08.878078+0000","last_active":"2024-09-15T23:23:11.388247+0000","last_peered":"2024-09-15T23:23:11.388247+0000","last_clean":"2024-09-15T23:23:11.388247+0000","last_became_active":"2024-09-15T23:23:08.877795+0000","last_became_peered":"2024-09-15T23:23:08.877795+0000","last_unstale":"2024-09-15T23:23:11.388247+0000","last_undegraded":"2024-09-15T23:23:11.388247+0000","last_fullsized":"2024-09-15T23:23:11.388247+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:51.929458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.877739+0000","last_change":"2024-09-15T23:23:09.894373+0000","last_active":"2024-09-15T23:23:10.877739+0000","last_peered":"2024-09-15T23:23:10.877739+0000","last_clean":"2024-09-15T23:23:10.877739+0000","last_became_active":"2024-09-15T23:23:09.894027+0000","last_became_peered":"2024-09-15T23:23:09.894027+0000","last_unstale":"2024-09-15T23:23:10.877739+0000","last_undegraded":"2024-09-15T23:23:10.877739+0000","last_fullsized":"2024-09-15T23:23:10.877739+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:05:43.347414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878324+0000","last_change":"2024-09-15T23:23:08.883287+0000","last_active":"2024-09-15T23:23:10.878324+0000","last_peered":"2024-09-15T23:23:10.878324+0000","last_clean":"2024-09-15T23:23:10.878324+0000","last_became_active":"2024-09-15T23:23:08.882904+0000","last_became_peered":"2024-09-15T23:23:08.882904+0000","last_unstale":"2024-09-15T23:23:10.878324+0000","last_undegraded":"2024-09-15T23:23:10.878324+0000","last_fullsized":"2024-09-15T23:23:10.878324+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:34:43.070529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389575+0000","last_change":"2024-09-15T23:23:09.887792+0000","last_active":"2024-09-15T23:23:11.389575+0000","last_peered":"2024-09-15T23:23:11.389575+0000","last_clean":"2024-09-15T23:23:11.389575+0000","last_became_active":"2024-09-15T23:23:09.887392+0000","last_became_peered":"2024-09-15T23:23:09.887392+0000","last_unstale":"2024-09-15T23:23:11.389575+0000","last_undegraded":"2024-09-15T23:23:11.389575+0000","last_fullsized":"2024-09-15T23:23:11.389575+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:10:09.448279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.10","version":"193'8","reported_seq":22,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878455+0000","last_change":"2024-09-15T23:23:08.880773+0000","last_active":"2024-09-15T23:23:10.878455+0000","last_peered":"2024-09-15T23:23:10.878455+0000","last_clean":"2024-09-15T23:23:10.878455+0000","last_became_active":"2024-09-15T23:23:08.880261+0000","last_became_peered":"2024-09-15T23:23:08.880261+0000","last_unstale":"2024-09-15T23:23:10.878455+0000","last_undegraded":"2024-09-15T23:23:10.878455+0000","last_fullsized":"2024-09-15T23:23:10.878455+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:32.801604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.888219+0000","last_change":"2024-09-15T23:23:09.879294+0000","last_active":"2024-09-15T23:23:10.888219+0000","last_peered":"2024-09-15T23:23:10.888219+0000","last_clean":"2024-09-15T23:23:10.888219+0000","last_became_active":"2024-09-15T23:23:09.879008+0000","last_became_peered":"2024-09-15T23:23:09.879008+0000","last_unstale":"2024-09-15T23:23:10.888219+0000","last_undegraded":"2024-09-15T23:23:10.888219+0000","last_fullsized":"2024-09-15T23:23:10.888219+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:29.758575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.f","version":"193'1","reported_seq":15,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389869+0000","last_change":"2024-09-15T23:23:08.887550+0000","last_active":"2024-09-15T23:23:11.389869+0000","last_peered":"2024-09-15T23:23:11.389869+0000","last_clean":"2024-09-15T23:23:11.389869+0000","last_became_active":"2024-09-15T23:23:08.887255+0000","last_became_peered":"2024-09-15T23:23:08.887255+0000","last_unstale":"2024-09-15T23:23:11.389869+0000","last_undegraded":"2024-09-15T23:23:11.389869+0000","last_fullsized":"2024-09-15T23:23:11.389869+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:56.677486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.876906+0000","last_change":"2024-09-15T23:23:09.881687+0000","last_active":"2024-09-15T23:23:10.876906+0000","last_peered":"2024-09-15T23:23:10.876906+0000","last_clean":"2024-09-15T23:23:10.876906+0000","last_became_active":"2024-09-15T23:23:09.881354+0000","last_became_peered":"2024-09-15T23:23:09.881354+0000","last_unstale":"2024-09-15T23:23:10.876906+0000","last_undegraded":"2024-09-15T23:23:10.876906+0000","last_fullsized":"2024-09-15T23:23:10.876906+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:26:33.318352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.e","version":"193'2","reported_seq":16,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388645+0000","last_change":"2024-09-15T23:23:08.884016+0000","last_active":"2024-09-15T23:23:11.388645+0000","last_peered":"2024-09-15T23:23:11.388645+0000","last_clean":"2024-09-15T23:23:11.388645+0000","last_became_active":"2024-09-15T23:23:08.883683+0000","last_became_peered":"2024-09-15T23:23:08.883683+0000","last_unstale":"2024-09-15T23:23:11.388645+0000","last_undegraded":"2024-09-15T23:23:11.388645+0000","last_fullsized":"2024-09-15T23:23:11.388645+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:33.247627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878585+0000","last_change":"2024-09-15T23:23:09.893387+0000","last_active":"2024-09-15T23:23:10.878585+0000","last_peered":"2024-09-15T23:23:10.878585+0000","last_clean":"2024-09-15T23:23:10.878585+0000","last_became_active":"2024-09-15T23:23:09.892927+0000","last_became_peered":"2024-09-15T23:23:09.892927+0000","last_unstale":"2024-09-15T23:23:10.878585+0000","last_undegraded":"2024-09-15T23:23:10.878585+0000","last_fullsized":"2024-09-15T23:23:10.878585+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:56.972413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.d","version":"193'1","reported_seq":15,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389475+0000","last_change":"2024-09-15T23:23:08.880228+0000","last_active":"2024-09-15T23:23:11.389475+0000","last_peered":"2024-09-15T23:23:11.389475+0000","last_clean":"2024-09-15T23:23:11.389475+0000","last_became_active":"2024-09-15T23:23:08.879937+0000","last_became_peered":"2024-09-15T23:23:08.879937+0000","last_unstale":"2024-09-15T23:23:11.389475+0000","last_undegraded":"2024-09-15T23:23:11.389475+0000","last_fullsized":"2024-09-15T23:23:11.389475+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:06.986864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389822+0000","last_change":"2024-09-15T23:23:09.900172+0000","last_active":"2024-09-15T23:23:11.389822+0000","last_peered":"2024-09-15T23:23:11.389822+0000","last_clean":"2024-09-15T23:23:11.389822+0000","last_became_active":"2024-09-15T23:23:09.899812+0000","last_became_peered":"2024-09-15T23:23:09.899812+0000","last_unstale":"2024-09-15T23:23:11.389822+0000","last_undegraded":"2024-09-15T23:23:11.389822+0000","last_fullsized":"2024-09-15T23:23:11.389822+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:48:35.079778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389230+0000","last_change":"2024-09-15T23:23:08.884635+0000","last_active":"2024-09-15T23:23:11.389230+0000","last_peered":"2024-09-15T23:23:11.389230+0000","last_clean":"2024-09-15T23:23:11.389230+0000","last_became_active":"2024-09-15T23:23:08.884343+0000","last_became_peered":"2024-09-15T23:23:08.884343+0000","last_unstale":"2024-09-15T23:23:11.389230+0000","last_undegraded":"2024-09-15T23:23:11.389230+0000","last_fullsized":"2024-09-15T23:23:11.389230+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:58:28.713430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.877765+0000","last_change":"2024-09-15T23:23:09.896745+0000","last_active":"2024-09-15T23:23:10.877765+0000","last_peered":"2024-09-15T23:23:10.877765+0000","last_clean":"2024-09-15T23:23:10.877765+0000","last_became_active":"2024-09-15T23:23:09.895939+0000","last_became_peered":"2024-09-15T23:23:09.895939+0000","last_unstale":"2024-09-15T23:23:10.877765+0000","last_undegraded":"2024-09-15T23:23:10.877765+0000","last_fullsized":"2024-09-15T23:23:10.877765+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:18:27.624450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.b","version":"193'2","reported_seq":16,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388819+0000","last_change":"2024-09-15T23:23:08.881657+0000","last_active":"2024-09-15T23:23:11.388819+0000","last_peered":"2024-09-15T23:23:11.388819+0000","last_clean":"2024-09-15T23:23:11.388819+0000","last_became_active":"2024-09-15T23:23:08.881338+0000","last_became_peered":"2024-09-15T23:23:08.881338+0000","last_unstale":"2024-09-15T23:23:11.388819+0000","last_undegraded":"2024-09-15T23:23:11.388819+0000","last_fullsized":"2024-09-15T23:23:11.388819+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:44.916704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389406+0000","last_change":"2024-09-15T23:23:09.899726+0000","last_active":"2024-09-15T23:23:11.389406+0000","last_peered":"2024-09-15T23:23:11.389406+0000","last_clean":"2024-09-15T23:23:11.389406+0000","last_became_active":"2024-09-15T23:23:09.898418+0000","last_became_peered":"2024-09-15T23:23:09.898418+0000","last_unstale":"2024-09-15T23:23:11.389406+0000","last_undegraded":"2024-09-15T23:23:11.389406+0000","last_fullsized":"2024-09-15T23:23:11.389406+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:58.508749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878430+0000","last_change":"2024-09-15T23:23:08.885820+0000","last_active":"2024-09-15T23:23:10.878430+0000","last_peered":"2024-09-15T23:23:10.878430+0000","last_clean":"2024-09-15T23:23:10.878430+0000","last_became_active":"2024-09-15T23:23:08.885545+0000","last_became_peered":"2024-09-15T23:23:08.885545+0000","last_unstale":"2024-09-15T23:23:10.878430+0000","last_undegraded":"2024-09-15T23:23:10.878430+0000","last_fullsized":"2024-09-15T23:23:10.878430+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:06.790571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.876352+0000","last_change":"2024-09-15T23:23:09.881140+0000","last_active":"2024-09-15T23:23:10.876352+0000","last_peered":"2024-09-15T23:23:10.876352+0000","last_clean":"2024-09-15T23:23:10.876352+0000","last_became_active":"2024-09-15T23:23:09.880760+0000","last_became_peered":"2024-09-15T23:23:09.880760+0000","last_unstale":"2024-09-15T23:23:10.876352+0000","last_undegraded":"2024-09-15T23:23:10.876352+0000","last_fullsized":"2024-09-15T23:23:10.876352+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:05:26.961470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878190+0000","last_change":"2024-09-15T23:23:08.886258+0000","last_active":"2024-09-15T23:23:10.878190+0000","last_peered":"2024-09-15T23:23:10.878190+0000","last_clean":"2024-09-15T23:23:10.878190+0000","last_became_active":"2024-09-15T23:23:08.884216+0000","last_became_peered":"2024-09-15T23:23:08.884216+0000","last_unstale":"2024-09-15T23:23:10.878190+0000","last_undegraded":"2024-09-15T23:23:10.878190+0000","last_fullsized":"2024-09-15T23:23:10.878190+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:39.101978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.876459+0000","last_change":"2024-09-15T23:23:09.888492+0000","last_active":"2024-09-15T23:23:10.876459+0000","last_peered":"2024-09-15T23:23:10.876459+0000","last_clean":"2024-09-15T23:23:10.876459+0000","last_became_active":"2024-09-15T23:23:09.888183+0000","last_became_peered":"2024-09-15T23:23:09.888183+0000","last_unstale":"2024-09-15T23:23:10.876459+0000","last_undegraded":"2024-09-15T23:23:10.876459+0000","last_fullsized":"2024-09-15T23:23:10.876459+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:53:34.221612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878528+0000","last_change":"2024-09-15T23:23:08.889246+0000","last_active":"2024-09-15T23:23:10.878528+0000","last_peered":"2024-09-15T23:23:10.878528+0000","last_clean":"2024-09-15T23:23:10.878528+0000","last_became_active":"2024-09-15T23:23:08.888672+0000","last_became_peered":"2024-09-15T23:23:08.888672+0000","last_unstale":"2024-09-15T23:23:10.878528+0000","last_undegraded":"2024-09-15T23:23:10.878528+0000","last_fullsized":"2024-09-15T23:23:10.878528+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:16.675069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.888333+0000","last_change":"2024-09-15T23:23:09.891264+0000","last_active":"2024-09-15T23:23:10.888333+0000","last_peered":"2024-09-15T23:23:10.888333+0000","last_clean":"2024-09-15T23:23:10.888333+0000","last_became_active":"2024-09-15T23:23:09.890877+0000","last_became_peered":"2024-09-15T23:23:09.890877+0000","last_unstale":"2024-09-15T23:23:10.888333+0000","last_undegraded":"2024-09-15T23:23:10.888333+0000","last_fullsized":"2024-09-15T23:23:10.888333+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:55.912652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.7","version":"193'2","reported_seq":16,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878776+0000","last_change":"2024-09-15T23:23:08.881862+0000","last_active":"2024-09-15T23:23:10.878776+0000","last_peered":"2024-09-15T23:23:10.878776+0000","last_clean":"2024-09-15T23:23:10.878776+0000","last_became_active":"2024-09-15T23:23:08.881581+0000","last_became_peered":"2024-09-15T23:23:08.881581+0000","last_unstale":"2024-09-15T23:23:10.878776+0000","last_undegraded":"2024-09-15T23:23:10.878776+0000","last_fullsized":"2024-09-15T23:23:10.878776+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:51:57.501450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389734+0000","last_change":"2024-09-15T23:23:09.888350+0000","last_active":"2024-09-15T23:23:11.389734+0000","last_peered":"2024-09-15T23:23:11.389734+0000","last_clean":"2024-09-15T23:23:11.389734+0000","last_became_active":"2024-09-15T23:23:09.887980+0000","last_became_peered":"2024-09-15T23:23:09.887980+0000","last_unstale":"2024-09-15T23:23:11.389734+0000","last_undegraded":"2024-09-15T23:23:11.389734+0000","last_fullsized":"2024-09-15T23:23:11.389734+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:02:33.808903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.6","version":"194'1","reported_seq":15,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388742+0000","last_change":"2024-09-15T23:23:08.877900+0000","last_active":"2024-09-15T23:23:11.388742+0000","last_peered":"2024-09-15T23:23:11.388742+0000","last_clean":"2024-09-15T23:23:11.388742+0000","last_became_active":"2024-09-15T23:23:08.877583+0000","last_became_peered":"2024-09-15T23:23:08.877583+0000","last_unstale":"2024-09-15T23:23:11.388742+0000","last_undegraded":"2024-09-15T23:23:11.388742+0000","last_fullsized":"2024-09-15T23:23:11.388742+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:12:18.540309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388420+0000","last_change":"2024-09-15T23:23:09.882079+0000","last_active":"2024-09-15T23:23:11.388420+0000","last_peered":"2024-09-15T23:23:11.388420+0000","last_clean":"2024-09-15T23:23:11.388420+0000","last_became_active":"2024-09-15T23:23:09.881800+0000","last_became_peered":"2024-09-15T23:23:09.881800+0000","last_unstale":"2024-09-15T23:23:11.388420+0000","last_undegraded":"2024-09-15T23:23:11.388420+0000","last_fullsized":"2024-09-15T23:23:11.388420+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:23:14.966836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389860+0000","last_change":"2024-09-15T23:23:08.885600+0000","last_active":"2024-09-15T23:23:11.389860+0000","last_peered":"2024-09-15T23:23:11.389860+0000","last_clean":"2024-09-15T23:23:11.389860+0000","last_became_active":"2024-09-15T23:23:08.885248+0000","last_became_peered":"2024-09-15T23:23:08.885248+0000","last_unstale":"2024-09-15T23:23:11.389860+0000","last_undegraded":"2024-09-15T23:23:11.389860+0000","last_fullsized":"2024-09-15T23:23:11.389860+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:18:41.964218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.888299+0000","last_change":"2024-09-15T23:23:09.885691+0000","last_active":"2024-09-15T23:23:10.888299+0000","last_peered":"2024-09-15T23:23:10.888299+0000","last_clean":"2024-09-15T23:23:10.888299+0000","last_became_active":"2024-09-15T23:23:09.885430+0000","last_became_peered":"2024-09-15T23:23:09.885430+0000","last_unstale":"2024-09-15T23:23:10.888299+0000","last_undegraded":"2024-09-15T23:23:10.888299+0000","last_fullsized":"2024-09-15T23:23:10.888299+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:17:31.076892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389195+0000","last_change":"2024-09-15T23:23:08.887072+0000","last_active":"2024-09-15T23:23:11.389195+0000","last_peered":"2024-09-15T23:23:11.389195+0000","last_clean":"2024-09-15T23:23:11.389195+0000","last_became_active":"2024-09-15T23:23:08.886725+0000","last_became_peered":"2024-09-15T23:23:08.886725+0000","last_unstale":"2024-09-15T23:23:11.389195+0000","last_undegraded":"2024-09-15T23:23:11.389195+0000","last_fullsized":"2024-09-15T23:23:11.389195+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:45:01.490349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.389480+0000","last_change":"2024-09-15T23:23:09.898656+0000","last_active":"2024-09-15T23:23:11.389480+0000","last_peered":"2024-09-15T23:23:11.389480+0000","last_clean":"2024-09-15T23:23:11.389480+0000","last_became_active":"2024-09-15T23:23:09.898380+0000","last_became_peered":"2024-09-15T23:23:09.898380+0000","last_unstale":"2024-09-15T23:23:11.389480+0000","last_undegraded":"2024-09-15T23:23:11.389480+0000","last_fullsized":"2024-09-15T23:23:11.389480+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:34:44.077827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.876563+0000","last_change":"2024-09-15T23:23:08.883474+0000","last_active":"2024-09-15T23:23:10.876563+0000","last_peered":"2024-09-15T23:23:10.876563+0000","last_clean":"2024-09-15T23:23:10.876563+0000","last_became_active":"2024-09-15T23:23:08.883194+0000","last_became_peered":"2024-09-15T23:23:08.883194+0000","last_unstale":"2024-09-15T23:23:10.876563+0000","last_undegraded":"2024-09-15T23:23:10.876563+0000","last_fullsized":"2024-09-15T23:23:10.876563+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:53:43.729395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388423+0000","last_change":"2024-09-15T23:23:09.883691+0000","last_active":"2024-09-15T23:23:11.388423+0000","last_peered":"2024-09-15T23:23:11.388423+0000","last_clean":"2024-09-15T23:23:11.388423+0000","last_became_active":"2024-09-15T23:23:09.883438+0000","last_became_peered":"2024-09-15T23:23:09.883438+0000","last_unstale":"2024-09-15T23:23:11.388423+0000","last_undegraded":"2024-09-15T23:23:11.388423+0000","last_fullsized":"2024-09-15T23:23:11.388423+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:10:42.119855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.877954+0000","last_change":"2024-09-15T23:23:08.889390+0000","last_active":"2024-09-15T23:23:10.877954+0000","last_peered":"2024-09-15T23:23:10.877954+0000","last_clean":"2024-09-15T23:23:10.877954+0000","last_became_active":"2024-09-15T23:23:08.889130+0000","last_became_peered":"2024-09-15T23:23:08.889130+0000","last_unstale":"2024-09-15T23:23:10.877954+0000","last_undegraded":"2024-09-15T23:23:10.877954+0000","last_fullsized":"2024-09-15T23:23:10.877954+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:00:26.192065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878132+0000","last_change":"2024-09-15T23:23:09.887444+0000","last_active":"2024-09-15T23:23:10.878132+0000","last_peered":"2024-09-15T23:23:10.878132+0000","last_clean":"2024-09-15T23:23:10.878132+0000","last_became_active":"2024-09-15T23:23:09.887177+0000","last_became_peered":"2024-09-15T23:23:09.887177+0000","last_unstale":"2024-09-15T23:23:10.878132+0000","last_undegraded":"2024-09-15T23:23:10.878132+0000","last_fullsized":"2024-09-15T23:23:10.878132+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:55:49.433015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.887969+0000","last_change":"2024-09-15T23:23:08.879418+0000","last_active":"2024-09-15T23:23:10.887969+0000","last_peered":"2024-09-15T23:23:10.887969+0000","last_clean":"2024-09-15T23:23:10.887969+0000","last_became_active":"2024-09-15T23:23:08.879150+0000","last_became_peered":"2024-09-15T23:23:08.879150+0000","last_unstale":"2024-09-15T23:23:10.887969+0000","last_undegraded":"2024-09-15T23:23:10.887969+0000","last_fullsized":"2024-09-15T23:23:10.887969+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:15.609024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.876531+0000","last_change":"2024-09-15T23:23:09.888915+0000","last_active":"2024-09-15T23:23:10.876531+0000","last_peered":"2024-09-15T23:23:10.876531+0000","last_clean":"2024-09-15T23:23:10.876531+0000","last_became_active":"2024-09-15T23:23:09.888562+0000","last_became_peered":"2024-09-15T23:23:09.888562+0000","last_unstale":"2024-09-15T23:23:10.876531+0000","last_undegraded":"2024-09-15T23:23:10.876531+0000","last_fullsized":"2024-09-15T23:23:10.876531+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:32:00.376440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":14,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.876406+0000","last_change":"2024-09-15T23:23:08.882191+0000","last_active":"2024-09-15T23:23:10.876406+0000","last_peered":"2024-09-15T23:23:10.876406+0000","last_clean":"2024-09-15T23:23:10.876406+0000","last_became_active":"2024-09-15T23:23:08.881889+0000","last_became_peered":"2024-09-15T23:23:08.881889+0000","last_unstale":"2024-09-15T23:23:10.876406+0000","last_undegraded":"2024-09-15T23:23:10.876406+0000","last_fullsized":"2024-09-15T23:23:10.876406+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:35:10.585965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":12,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.878709+0000","last_change":"2024-09-15T23:23:09.895737+0000","last_active":"2024-09-15T23:23:10.878709+0000","last_peered":"2024-09-15T23:23:10.878709+0000","last_clean":"2024-09-15T23:23:10.878709+0000","last_became_active":"2024-09-15T23:23:09.895480+0000","last_became_peered":"2024-09-15T23:23:09.895480+0000","last_unstale":"2024-09-15T23:23:10.878709+0000","last_undegraded":"2024-09-15T23:23:10.878709+0000","last_fullsized":"2024-09-15T23:23:10.878709+0000","mapping_epoch":192,"log_start":"0'0","ondisk_log_start":"0'0","created":192,"last_epoch_clean":193,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:08.861300+0000","last_clean_scrub_stamp":"2024-09-15T23:23:08.861300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:11:52.863778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1b","version":"193'1","reported_seq":15,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:11.388472+0000","last_change":"2024-09-15T23:23:08.873814+0000","last_active":"2024-09-15T23:23:11.388472+0000","last_peered":"2024-09-15T23:23:11.388472+0000","last_clean":"2024-09-15T23:23:11.388472+0000","last_became_active":"2024-09-15T23:23:08.873523+0000","last_became_peered":"2024-09-15T23:23:08.873523+0000","last_unstale":"2024-09-15T23:23:11.388472+0000","last_undegraded":"2024-09-15T23:23:11.388472+0000","last_fullsized":"2024-09-15T23:23:11.388472+0000","mapping_epoch":191,"log_start":"0'0","ondisk_log_start":"0'0","created":191,"last_epoch_clean":192,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:23:07.854002+0000","last_clean_scrub_stamp":"2024-09-15T23:23:07.854002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:00.357297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":492,"reported_epoch":194,"state":"active+clean","last_fresh":"2024-09-15T23:23:10.876430+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:23:10.876430+0000","last_peered":"2024-09-15T23:23:10.876430+0000","last_clean":"2024-09-15T23:23:10.876430+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:23:10.876430+0000","last_undegraded":"2024-09-15T23:23:10.876430+0000","last_fullsized":"2024-09-15T23:23:10.876430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476876,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59940,"kb_used_data":2384,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311900,"statfs":{"total":96636764160,"available":96575385600,"internally_reserved":0,"allocated":2441216,"data_stored":1078699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476873,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55796,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316044,"statfs":{"total":96636764160,"available":96579629056,"internally_reserved":0,"allocated":2449408,"data_stored":1078803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476875,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56356,"kb_used_data":2952,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315484,"statfs":{"total":96636764160,"available":96579055616,"internally_reserved":0,"allocated":3022848,"data_stored":1667455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476875,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51620,"kb_used_data":2376,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320220,"statfs":{"total":96636764160,"available":96583905280,"internally_reserved":0,"allocated":2433024,"data_stored":1077669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542281,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51612,"kb_used_data":2376,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320228,"statfs":{"total":96636764160,"available":96583913472,"internally_reserved":0,"allocated":2433024,"data_stored":1077109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542281,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55780,"kb_used_data":2376,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316060,"statfs":{"total":96636764160,"available":96579645440,"internally_reserved":0,"allocated":2433024,"data_stored":1077157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542280,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60528,"kb_used_data":2956,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311312,"statfs":{"total":96636764160,"available":96574783488,"internally_reserved":0,"allocated":3026944,"data_stored":1661883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542282,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59932,"kb_used_data":2376,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311908,"statfs":{"total":96636764160,"available":96575393792,"internally_reserved":0,"allocated":2433024,"data_stored":1077177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:23:17.485 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T23:23:17.486 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T23:23:17.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.626+0000 7fd79d1c4640 1 Processor -- start 2024-09-15T23:23:17.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.626+0000 7fd79d1c4640 1 -- start start 2024-09-15T23:23:17.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.627+0000 7fd79d1c4640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd79815e990 0x7fd79815ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:17.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.627+0000 7fd79d1c4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd798162a00 0x7fd798162e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:17.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.627+0000 7fd79d1c4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd79815f2b0 con 0x7fd7980b5520 2024-09-15T23:23:17.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.627+0000 7fd79d1c4640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fd79815f550 con 0x7fd798162a00 2024-09-15T23:23:17.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.627+0000 7fd79d1c4640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fd79815f830 con 0x7fd79815e990 2024-09-15T23:23:17.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.627+0000 7fd79659c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd7980b5520 0x7fd79806cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:46892/0 (socket says 172.21.15.123:46892) 2024-09-15T23:23:17.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.627+0000 7fd79659c640 1 -- 172.21.15.123:0/473865016 learned_addr learned my addr 172.21.15.123:0/473865016 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:23:17.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.627+0000 7fd79759e640 1 --2- 172.21.15.123:0/473865016 >> v2:172.21.15.123:3300/0 conn(0x7fd798162a00 0x7fd798162e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:17.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.627+0000 7fd796d9d640 1 --2- 172.21.15.123:0/473865016 >> v2:172.21.15.188:3300/0 conn(0x7fd79815e990 0x7fd79815ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:17.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.627+0000 7fd79759e640 1 -- 172.21.15.123:0/473865016 >> v2:172.21.15.188:3300/0 conn(0x7fd79815e990 msgr2=0x7fd79815ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:17.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.627+0000 7fd79759e640 1 --2- 172.21.15.123:0/473865016 >> v2:172.21.15.188:3300/0 conn(0x7fd79815e990 0x7fd79815ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:17.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.627+0000 7fd79759e640 1 -- 172.21.15.123:0/473865016 >> v1:172.21.15.123:6789/0 conn(0x7fd7980b5520 legacy=0x7fd79806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:17.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.627+0000 7fd79759e640 1 -- 172.21.15.123:0/473865016 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd79815fb10 con 0x7fd798162a00 2024-09-15T23:23:17.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.627+0000 7fd795d9b640 1 -- 172.21.15.123:0/473865016 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3183320770 0 0) 0x7fd79815f2b0 con 0x7fd7980b5520 2024-09-15T23:23:17.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.628+0000 7fd79759e640 1 --2- 172.21.15.123:0/473865016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd798162a00 0x7fd798162e70 secure :-1 s=READY pgs=2250 cs=0 l=1 rev1=1 crypto rx=0x7fd798068890 tx=0x7fd79002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb57074e4ff2264 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:17.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.628+0000 7fd795d9b640 1 -- 172.21.15.123:0/473865016 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd790037070 con 0x7fd798162a00 2024-09-15T23:23:17.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.628+0000 7fd795d9b640 1 -- 172.21.15.123:0/473865016 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd790032440 con 0x7fd798162a00 2024-09-15T23:23:17.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.628+0000 7fd795d9b640 1 -- 172.21.15.123:0/473865016 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd790032810 con 0x7fd798162a00 2024-09-15T23:23:17.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.629+0000 7fd79d1c4640 1 -- 172.21.15.123:0/473865016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd798162a00 msgr2=0x7fd798162e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:17.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.629+0000 7fd79d1c4640 1 --2- 172.21.15.123:0/473865016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd798162a00 0x7fd798162e70 secure :-1 s=READY pgs=2250 cs=0 l=1 rev1=1 crypto rx=0x7fd798068890 tx=0x7fd79002a1a0 comp rx=0 tx=0).stop 2024-09-15T23:23:17.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.629+0000 7fd79d1c4640 1 -- 172.21.15.123:0/473865016 shutdown_connections 2024-09-15T23:23:17.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.629+0000 7fd79d1c4640 1 --2- 172.21.15.123:0/473865016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd798162a00 0x7fd798162e70 unknown :-1 s=CLOSED pgs=2250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:17.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.629+0000 7fd79d1c4640 1 --2- 172.21.15.123:0/473865016 >> v2:172.21.15.188:3300/0 conn(0x7fd79815e990 0x7fd79815ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:17.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.629+0000 7fd79d1c4640 1 -- 172.21.15.123:0/473865016 >> 172.21.15.123:0/473865016 conn(0x7fd7980d25d0 msgr2=0x7fd7980d29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:17.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.629+0000 7fd79d1c4640 1 -- 172.21.15.123:0/473865016 shutdown_connections 2024-09-15T23:23:17.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.629+0000 7fd79d1c4640 1 -- 172.21.15.123:0/473865016 wait complete. 2024-09-15T23:23:17.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.630+0000 7fd79d1c4640 1 Processor -- start 2024-09-15T23:23:17.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.630+0000 7fd79d1c4640 1 -- start start 2024-09-15T23:23:17.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.631+0000 7fd79d1c4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7980b5520 0x7fd79815dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:17.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.631+0000 7fd79d1c4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd79815e990 0x7fd79814aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:17.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.631+0000 7fd79d1c4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd798162a00 0x7fd7980b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:17.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.631+0000 7fd79d1c4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd79806d430 con 0x7fd7980b5520 2024-09-15T23:23:17.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.631+0000 7fd79d1c4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd7980b6ff0 con 0x7fd79815e990 2024-09-15T23:23:17.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.631+0000 7fd79d1c4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd79815c190 con 0x7fd798162a00 2024-09-15T23:23:17.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.631+0000 7fd796d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7980b5520 0x7fd79815dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:17.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.631+0000 7fd796d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7980b5520 0x7fd79815dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37672/0 (socket says 172.21.15.123:37672) 2024-09-15T23:23:17.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.631+0000 7fd796d9d640 1 -- 172.21.15.123:0/1102002862 learned_addr learned my addr 172.21.15.123:0/1102002862 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:17.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.631+0000 7fd79659c640 1 --2- 172.21.15.123:0/1102002862 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd79815e990 0x7fd79814aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:17.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.631+0000 7fd796d9d640 1 -- 172.21.15.123:0/1102002862 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd798162a00 msgr2=0x7fd7980b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:17.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.631+0000 7fd79759e640 1 --2- 172.21.15.123:0/1102002862 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd798162a00 0x7fd7980b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:17.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.631+0000 7fd796d9d640 1 --2- 172.21.15.123:0/1102002862 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd798162a00 0x7fd7980b30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:17.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.631+0000 7fd796d9d640 1 -- 172.21.15.123:0/1102002862 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd79815e990 msgr2=0x7fd79814aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:17.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.631+0000 7fd796d9d640 1 --2- 172.21.15.123:0/1102002862 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd79815e990 0x7fd79814aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:17.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.632+0000 7fd796d9d640 1 -- 172.21.15.123:0/1102002862 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd79815c470 con 0x7fd7980b5520 2024-09-15T23:23:17.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.632+0000 7fd796d9d640 1 --2- 172.21.15.123:0/1102002862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7980b5520 0x7fd79815dc40 secure :-1 s=READY pgs=2251 cs=0 l=1 rev1=1 crypto rx=0x7fd788009db0 tx=0x7fd78800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:17.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.632+0000 7fd77f7fe640 1 -- 172.21.15.123:0/1102002862 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd788018020 con 0x7fd7980b5520 2024-09-15T23:23:17.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.632+0000 7fd77f7fe640 1 -- 172.21.15.123:0/1102002862 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd788014480 con 0x7fd7980b5520 2024-09-15T23:23:17.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.632+0000 7fd79d1c4640 1 -- 172.21.15.123:0/1102002862 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd79815c750 con 0x7fd7980b5520 2024-09-15T23:23:17.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.632+0000 7fd77f7fe640 1 -- 172.21.15.123:0/1102002862 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd788014850 con 0x7fd7980b5520 2024-09-15T23:23:17.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.632+0000 7fd79d1c4640 1 -- 172.21.15.123:0/1102002862 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7980cbbc0 con 0x7fd7980b5520 2024-09-15T23:23:17.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.633+0000 7fd79d1c4640 1 -- 172.21.15.123:0/1102002862 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd798162e70 con 0x7fd7980b5520 2024-09-15T23:23:17.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.633+0000 7fd77f7fe640 1 -- 172.21.15.123:0/1102002862 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd788005d10 con 0x7fd7980b5520 2024-09-15T23:23:17.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.634+0000 7fd77f7fe640 1 --2- 172.21.15.123:0/1102002862 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd78406c2b0 0x7fd78406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:17.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.634+0000 7fd77f7fe640 1 -- 172.21.15.123:0/1102002862 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7fd78808bf80 con 0x7fd7980b5520 2024-09-15T23:23:17.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.634+0000 7fd79659c640 1 --2- 172.21.15.123:0/1102002862 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd78406c2b0 0x7fd78406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:17.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.635+0000 7fd79659c640 1 --2- 172.21.15.123:0/1102002862 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd78406c2b0 0x7fd78406e770 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fd78c007fd0 tx=0x7fd78c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:17.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.638+0000 7fd77f7fe640 1 -- 172.21.15.123:0/1102002862 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd788022070 con 0x7fd7980b5520 2024-09-15T23:23:17.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.868+0000 7fd79d1c4640 1 -- 172.21.15.123:0/1102002862 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fd79806f830 con 0x7fd7980b5520 2024-09-15T23:23:17.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.870+0000 7fd77f7fe640 1 -- 172.21.15.123:0/1102002862 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) ==== 190+0+147 (secure 0 0 0) 0x7fd788010040 con 0x7fd7980b5520 2024-09-15T23:23:17.871 INFO:teuthology.orchestra.run.smithi123.stdout:[client.0] 2024-09-15T23:23:17.871 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCNaedmzQPqJRAAhUf1dnVYohN4obCfeu8+7g== 2024-09-15T23:23:17.871 INFO:teuthology.orchestra.run.smithi123.stdout: caps mds = "allow" 2024-09-15T23:23:17.871 INFO:teuthology.orchestra.run.smithi123.stdout: caps mon = "allow r" 2024-09-15T23:23:17.871 INFO:teuthology.orchestra.run.smithi123.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T23:23:17.872 INFO:teuthology.orchestra.run.smithi123.stderr:updated caps for client.0 2024-09-15T23:23:17.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.873+0000 7fd79d1c4640 1 -- 172.21.15.123:0/1102002862 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd78406c2b0 msgr2=0x7fd78406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:17.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.873+0000 7fd79d1c4640 1 --2- 172.21.15.123:0/1102002862 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd78406c2b0 0x7fd78406e770 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fd78c007fd0 tx=0x7fd78c009040 comp rx=0 tx=0).stop 2024-09-15T23:23:17.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.873+0000 7fd79d1c4640 1 -- 172.21.15.123:0/1102002862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7980b5520 msgr2=0x7fd79815dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:17.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.873+0000 7fd79d1c4640 1 --2- 172.21.15.123:0/1102002862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7980b5520 0x7fd79815dc40 secure :-1 s=READY pgs=2251 cs=0 l=1 rev1=1 crypto rx=0x7fd788009db0 tx=0x7fd78800c490 comp rx=0 tx=0).stop 2024-09-15T23:23:17.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.873+0000 7fd79d1c4640 1 -- 172.21.15.123:0/1102002862 shutdown_connections 2024-09-15T23:23:17.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.873+0000 7fd79d1c4640 1 --2- 172.21.15.123:0/1102002862 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd798162a00 0x7fd7980b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:17.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.873+0000 7fd79d1c4640 1 --2- 172.21.15.123:0/1102002862 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd79815e990 0x7fd79814aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:17.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.873+0000 7fd79d1c4640 1 --2- 172.21.15.123:0/1102002862 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd78406c2b0 0x7fd78406e770 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:17.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.873+0000 7fd79d1c4640 1 --2- 172.21.15.123:0/1102002862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7980b5520 0x7fd79815dc40 unknown :-1 s=CLOSED pgs=2251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:17.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.873+0000 7fd79d1c4640 1 -- 172.21.15.123:0/1102002862 >> 172.21.15.123:0/1102002862 conn(0x7fd7980d25d0 msgr2=0x7fd79806e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:17.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.873+0000 7fd79d1c4640 1 -- 172.21.15.123:0/1102002862 shutdown_connections 2024-09-15T23:23:17.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.873+0000 7fd79d1c4640 1 -- 172.21.15.123:0/1102002862 wait complete. 2024-09-15T23:23:17.886 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:23:17.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.982+0000 7fa42794b640 1 Processor -- start 2024-09-15T23:23:17.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.983+0000 7fa42794b640 1 -- start start 2024-09-15T23:23:17.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.983+0000 7fa42794b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa42015e790 0x7fa420073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:17.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.984+0000 7fa42794b640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4201631c0 con 0x7fa420162c60 2024-09-15T23:23:17.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.984+0000 7fa42794b640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4200ae9a0 con 0x7fa42006f730 2024-09-15T23:23:17.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.984+0000 7fa42794b640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fa42015eb70 con 0x7fa42015e790 2024-09-15T23:23:17.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.984+0000 7fa4256e7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa42015e790 0x7fa420073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:17.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.984+0000 7fa424ee6640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa420162c60 0x7fa4200b5430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:46900/0 (socket says 172.21.15.123:46900) 2024-09-15T23:23:17.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.984+0000 7fa4256e7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa42015e790 0x7fa420073a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37674/0 (socket says 172.21.15.123:37674) 2024-09-15T23:23:17.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.984+0000 7fa424ee6640 1 -- 172.21.15.123:0/1307089702 learned_addr learned my addr 172.21.15.123:0/1307089702 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:23:17.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.984+0000 7fa4256e7640 1 -- 172.21.15.123:0/1307089702 >> v1:172.21.15.188:6789/0 conn(0x7fa42006f730 legacy=0x7fa42006fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:17.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.984+0000 7fa4256e7640 1 -- 172.21.15.123:0/1307089702 >> v1:172.21.15.123:6789/0 conn(0x7fa420162c60 legacy=0x7fa4200b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:17.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.984+0000 7fa4256e7640 1 -- 172.21.15.123:0/1307089702 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4200aec40 con 0x7fa42015e790 2024-09-15T23:23:17.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.984+0000 7fa413fff640 1 -- 172.21.15.123:0/1307089702 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2744243747 0 0) 0x7fa4201631c0 con 0x7fa420162c60 2024-09-15T23:23:17.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.985+0000 7fa4256e7640 1 --2- 172.21.15.123:0/1307089702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa42015e790 0x7fa420073a40 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 crypto rx=0x7fa4200aeb70 tx=0x7fa41402a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=495c2555dbbf1eb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:17.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.985+0000 7fa413fff640 1 -- 172.21.15.123:0/1307089702 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa414037070 con 0x7fa42015e790 2024-09-15T23:23:17.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.985+0000 7fa413fff640 1 -- 172.21.15.123:0/1307089702 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa41402adb0 con 0x7fa42015e790 2024-09-15T23:23:17.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.985+0000 7fa413fff640 1 -- 172.21.15.123:0/1307089702 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa414032660 con 0x7fa42015e790 2024-09-15T23:23:17.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.985+0000 7fa42794b640 1 -- 172.21.15.123:0/1307089702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa42015e790 msgr2=0x7fa420073a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:17.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.985+0000 7fa42794b640 1 --2- 172.21.15.123:0/1307089702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa42015e790 0x7fa420073a40 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 crypto rx=0x7fa4200aeb70 tx=0x7fa41402a0a0 comp rx=0 tx=0).stop 2024-09-15T23:23:17.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.985+0000 7fa42794b640 1 -- 172.21.15.123:0/1307089702 shutdown_connections 2024-09-15T23:23:17.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.985+0000 7fa42794b640 1 --2- 172.21.15.123:0/1307089702 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa42015e790 0x7fa420073a40 unknown :-1 s=CLOSED pgs=2253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:17.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.985+0000 7fa42794b640 1 -- 172.21.15.123:0/1307089702 >> 172.21.15.123:0/1307089702 conn(0x7fa4200b0a80 msgr2=0x7fa4200b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:17.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.986+0000 7fa42794b640 1 -- 172.21.15.123:0/1307089702 shutdown_connections 2024-09-15T23:23:17.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.986+0000 7fa42794b640 1 -- 172.21.15.123:0/1307089702 wait complete. 2024-09-15T23:23:17.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.987+0000 7fa42794b640 1 Processor -- start 2024-09-15T23:23:17.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.987+0000 7fa42794b640 1 -- start start 2024-09-15T23:23:17.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.987+0000 7fa42794b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa42006f730 0x7fa4200c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:17.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.987+0000 7fa42794b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa42015e790 0x7fa4200cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:17.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.987+0000 7fa42794b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa420162c60 0x7fa4200cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:17.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.987+0000 7fa42794b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa4200b5b40 con 0x7fa42015e790 2024-09-15T23:23:17.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.987+0000 7fa42794b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa4200af200 con 0x7fa42006f730 2024-09-15T23:23:17.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.987+0000 7fa42794b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa42006f430 con 0x7fa420162c60 2024-09-15T23:23:17.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.987+0000 7fa424ee6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa42015e790 0x7fa4200cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:17.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.987+0000 7fa424ee6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa42015e790 0x7fa4200cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37678/0 (socket says 172.21.15.123:37678) 2024-09-15T23:23:17.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.987+0000 7fa424ee6640 1 -- 172.21.15.123:0/1849985761 learned_addr learned my addr 172.21.15.123:0/1849985761 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:17.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.988+0000 7fa4256e7640 1 --2- 172.21.15.123:0/1849985761 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa42006f730 0x7fa4200c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:17.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.988+0000 7fa424ee6640 1 -- 172.21.15.123:0/1849985761 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa420162c60 msgr2=0x7fa4200cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:17.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.988+0000 7fa425ee8640 1 --2- 172.21.15.123:0/1849985761 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa420162c60 0x7fa4200cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:17.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.988+0000 7fa424ee6640 1 --2- 172.21.15.123:0/1849985761 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa420162c60 0x7fa4200cbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:17.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.988+0000 7fa424ee6640 1 -- 172.21.15.123:0/1849985761 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa42006f730 msgr2=0x7fa4200c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:17.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.988+0000 7fa424ee6640 1 --2- 172.21.15.123:0/1849985761 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa42006f730 0x7fa4200c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:17.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.988+0000 7fa424ee6640 1 -- 172.21.15.123:0/1849985761 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4200ccce0 con 0x7fa42015e790 2024-09-15T23:23:17.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.988+0000 7fa424ee6640 1 --2- 172.21.15.123:0/1849985761 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa42015e790 0x7fa4200cb5a0 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 crypto rx=0x7fa41c00c430 tx=0x7fa41c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:17.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.988+0000 7fa411ffb640 1 -- 172.21.15.123:0/1849985761 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41c0074e0 con 0x7fa42015e790 2024-09-15T23:23:17.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.988+0000 7fa411ffb640 1 -- 172.21.15.123:0/1849985761 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa41c0047e0 con 0x7fa42015e790 2024-09-15T23:23:17.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.988+0000 7fa42794b640 1 -- 172.21.15.123:0/1849985761 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4200cc160 con 0x7fa42015e790 2024-09-15T23:23:17.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.988+0000 7fa411ffb640 1 -- 172.21.15.123:0/1849985761 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41c004bd0 con 0x7fa42015e790 2024-09-15T23:23:17.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.988+0000 7fa42794b640 1 -- 172.21.15.123:0/1849985761 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4200cc720 con 0x7fa42015e790 2024-09-15T23:23:17.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.989+0000 7fa42794b640 1 -- 172.21.15.123:0/1849985761 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa420073a40 con 0x7fa42015e790 2024-09-15T23:23:17.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.990+0000 7fa411ffb640 1 -- 172.21.15.123:0/1849985761 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa41c011070 con 0x7fa42015e790 2024-09-15T23:23:17.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.990+0000 7fa411ffb640 1 --2- 172.21.15.123:0/1849985761 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa40406c2b0 0x7fa40406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:17.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.990+0000 7fa411ffb640 1 -- 172.21.15.123:0/1849985761 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7fa41c08b090 con 0x7fa42015e790 2024-09-15T23:23:17.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.990+0000 7fa4256e7640 1 --2- 172.21.15.123:0/1849985761 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa40406c2b0 0x7fa40406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:17.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.991+0000 7fa4256e7640 1 --2- 172.21.15.123:0/1849985761 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa40406c2b0 0x7fa40406e770 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fa414034000 tx=0x7fa41402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:17.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:17.995+0000 7fa411ffb640 1 -- 172.21.15.123:0/1849985761 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa41c00e280 con 0x7fa42015e790 2024-09-15T23:23:18.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.195+0000 7fa42794b640 1 -- 172.21.15.123:0/1849985761 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4200b5900 con 0x7fa42015e790 2024-09-15T23:23:18.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.195+0000 7fa411ffb640 1 -- 172.21.15.123:0/1849985761 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) ==== 95+0+5248 (secure 0 0 0) 0x7fa41c059890 con 0x7fa42015e790 2024-09-15T23:23:18.197 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:23:18.197 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":120,"btime":"2024-09-15T23:23:11:879993+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8785,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2171656296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2171656296},{"type":"v1","addr":"172.21.15.188:6836","nonce":2171656296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":8788,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/136119431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":136119431},{"type":"v1","addr":"172.21.15.188:6837","nonce":136119431}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":10473,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/2374047694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2374047694},{"type":"v1","addr":"172.21.15.123:6833","nonce":2374047694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":120,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:23:09.208435+0000","modified":"2024-09-15T23:23:11.247532+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10491},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10491":{"gid":10491,"name":"a","rank":0,"incarnation":118,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/2653908784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2653908784},{"type":"v1","addr":"172.21.15.123:6835","nonce":2653908784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10491,"qdb_cluster":[10491]},"id":13}]} 2024-09-15T23:23:18.197 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 120 2024-09-15T23:23:18.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.198+0000 7fa42794b640 1 -- 172.21.15.123:0/1849985761 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa40406c2b0 msgr2=0x7fa40406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:18.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.198+0000 7fa42794b640 1 --2- 172.21.15.123:0/1849985761 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa40406c2b0 0x7fa40406e770 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fa414034000 tx=0x7fa41402e000 comp rx=0 tx=0).stop 2024-09-15T23:23:18.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.198+0000 7fa42794b640 1 -- 172.21.15.123:0/1849985761 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa42015e790 msgr2=0x7fa4200cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:18.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.198+0000 7fa42794b640 1 --2- 172.21.15.123:0/1849985761 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa42015e790 0x7fa4200cb5a0 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 crypto rx=0x7fa41c00c430 tx=0x7fa41c00c8f0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.198+0000 7fa42794b640 1 -- 172.21.15.123:0/1849985761 shutdown_connections 2024-09-15T23:23:18.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.198+0000 7fa42794b640 1 --2- 172.21.15.123:0/1849985761 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa420162c60 0x7fa4200cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.198+0000 7fa42794b640 1 --2- 172.21.15.123:0/1849985761 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa40406c2b0 0x7fa40406e770 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.198+0000 7fa42794b640 1 --2- 172.21.15.123:0/1849985761 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa42015e790 0x7fa4200cb5a0 unknown :-1 s=CLOSED pgs=2254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.198+0000 7fa42794b640 1 --2- 172.21.15.123:0/1849985761 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa42006f730 0x7fa4200c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.198+0000 7fa42794b640 1 -- 172.21.15.123:0/1849985761 >> 172.21.15.123:0/1849985761 conn(0x7fa4200b0a80 msgr2=0x7fa4200cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:18.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.198+0000 7fa42794b640 1 -- 172.21.15.123:0/1849985761 shutdown_connections 2024-09-15T23:23:18.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.198+0000 7fa42794b640 1 -- 172.21.15.123:0/1849985761 wait complete. 2024-09-15T23:23:18.613 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 120, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:23:09.208435+0000', 'modified': '2024-09-15T23:23:11.247532+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10491}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10491': {'gid': 10491, 'name': 'a', 'rank': 0, 'incarnation': 118, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.123:6835/2653908784', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6834', 'nonce': 2653908784}, {'type': 'v1', 'addr': '172.21.15.123:6835', 'nonce': 2653908784}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [27], 'metadata_pool': 26, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 10491, 'qdb_cluster': [10491]} 2024-09-15T23:23:18.613 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:23:18.613 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-15T23:23:18.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.713+0000 7fc6293d6640 1 Processor -- start 2024-09-15T23:23:18.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.713+0000 7fc6293d6640 1 -- start start 2024-09-15T23:23:18.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.713+0000 7fc6293d6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc62415ed20 0x7fc6240b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:18.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.713+0000 7fc6293d6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc6240d23b0 0x7fc6240b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:18.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.713+0000 7fc6293d6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc6240cf2d0 0x7fc6240cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:18.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.713+0000 7fc6293d6640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc6240d0e70 con 0x7fc6240cf2d0 2024-09-15T23:23:18.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.713+0000 7fc6293d6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fc6240d41c0 con 0x7fc6240d23b0 2024-09-15T23:23:18.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.713+0000 7fc6293d6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc6240d35b0 con 0x7fc62415ed20 2024-09-15T23:23:18.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.714+0000 7fc6237fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc6240cf2d0 0x7fc6240cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:18.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.714+0000 7fc6237fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc6240cf2d0 0x7fc6240cf760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37680/0 (socket says 172.21.15.123:37680) 2024-09-15T23:23:18.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.714+0000 7fc6237fe640 1 -- 172.21.15.123:0/2310356505 learned_addr learned my addr 172.21.15.123:0/2310356505 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:18.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.714+0000 7fc6227fc640 1 --2- 172.21.15.123:0/2310356505 >> v2:172.21.15.188:3300/0 conn(0x7fc6240d23b0 0x7fc6240b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:18.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.714+0000 7fc6237fe640 1 -- 172.21.15.123:0/2310356505 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc62415ed20 msgr2=0x7fc6240b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:18.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.714+0000 7fc622ffd640 1 --2- 172.21.15.123:0/2310356505 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc62415ed20 0x7fc6240b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:18.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.714+0000 7fc6237fe640 1 --2- 172.21.15.123:0/2310356505 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc62415ed20 0x7fc6240b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.714+0000 7fc6237fe640 1 -- 172.21.15.123:0/2310356505 >> v2:172.21.15.188:3300/0 conn(0x7fc6240d23b0 msgr2=0x7fc6240b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:18.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.714+0000 7fc6237fe640 1 --2- 172.21.15.123:0/2310356505 >> v2:172.21.15.188:3300/0 conn(0x7fc6240d23b0 0x7fc6240b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.714+0000 7fc6237fe640 1 -- 172.21.15.123:0/2310356505 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6240d3890 con 0x7fc6240cf2d0 2024-09-15T23:23:18.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.714+0000 7fc6227fc640 1 --2- 172.21.15.123:0/2310356505 >> v2:172.21.15.188:3300/0 conn(0x7fc6240d23b0 0x7fc6240b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:23:18.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.714+0000 7fc622ffd640 1 --2- 172.21.15.123:0/2310356505 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc62415ed20 0x7fc6240b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:23:18.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.715+0000 7fc6237fe640 1 --2- 172.21.15.123:0/2310356505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6240cf2d0 0x7fc6240cf760 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 crypto rx=0x7fc624075830 tx=0x7fc61c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39659506129fe3e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:18.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.715+0000 7fc621ffb640 1 -- 172.21.15.123:0/2310356505 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61c036070 con 0x7fc6240cf2d0 2024-09-15T23:23:18.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.715+0000 7fc621ffb640 1 -- 172.21.15.123:0/2310356505 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc61c031600 con 0x7fc6240cf2d0 2024-09-15T23:23:18.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.715+0000 7fc621ffb640 1 -- 172.21.15.123:0/2310356505 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61c0319d0 con 0x7fc6240cf2d0 2024-09-15T23:23:18.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.715+0000 7fc6293d6640 1 -- 172.21.15.123:0/2310356505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6240cf2d0 msgr2=0x7fc6240cf760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:18.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.715+0000 7fc6293d6640 1 --2- 172.21.15.123:0/2310356505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6240cf2d0 0x7fc6240cf760 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 crypto rx=0x7fc624075830 tx=0x7fc61c02a6a0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.715+0000 7fc6293d6640 1 -- 172.21.15.123:0/2310356505 shutdown_connections 2024-09-15T23:23:18.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.715+0000 7fc6293d6640 1 --2- 172.21.15.123:0/2310356505 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6240cf2d0 0x7fc6240cf760 unknown :-1 s=CLOSED pgs=2255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.715+0000 7fc6293d6640 1 --2- 172.21.15.123:0/2310356505 >> v2:172.21.15.188:3300/0 conn(0x7fc6240d23b0 0x7fc6240b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.715+0000 7fc6293d6640 1 --2- 172.21.15.123:0/2310356505 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc62415ed20 0x7fc6240b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.715+0000 7fc6293d6640 1 -- 172.21.15.123:0/2310356505 >> 172.21.15.123:0/2310356505 conn(0x7fc6240d1260 msgr2=0x7fc6240d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:18.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.715+0000 7fc6293d6640 1 -- 172.21.15.123:0/2310356505 shutdown_connections 2024-09-15T23:23:18.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.715+0000 7fc6293d6640 1 -- 172.21.15.123:0/2310356505 wait complete. 2024-09-15T23:23:18.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.717+0000 7fc6293d6640 1 Processor -- start 2024-09-15T23:23:18.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.717+0000 7fc6293d6640 1 -- start start 2024-09-15T23:23:18.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.717+0000 7fc6293d6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6240cf2d0 0x7fc6241f8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:18.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.717+0000 7fc6293d6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6240d23b0 0x7fc624154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:18.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.717+0000 7fc6293d6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc62415ed20 0x7fc6240cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:18.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.717+0000 7fc6293d6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc6240d32a0 con 0x7fc6240d23b0 2024-09-15T23:23:18.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.717+0000 7fc6293d6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc6240d3e50 con 0x7fc62415ed20 2024-09-15T23:23:18.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.717+0000 7fc6293d6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc62415f100 con 0x7fc6240cf2d0 2024-09-15T23:23:18.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.718+0000 7fc6227fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6240d23b0 0x7fc624154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:18.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.718+0000 7fc6227fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6240d23b0 0x7fc624154950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37684/0 (socket says 172.21.15.123:37684) 2024-09-15T23:23:18.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.718+0000 7fc6227fc640 1 -- 172.21.15.123:0/3843700829 learned_addr learned my addr 172.21.15.123:0/3843700829 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:18.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.718+0000 7fc6237fe640 1 --2- 172.21.15.123:0/3843700829 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc62415ed20 0x7fc6240cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:18.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.718+0000 7fc622ffd640 1 --2- 172.21.15.123:0/3843700829 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6240cf2d0 0x7fc6241f8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:18.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.718+0000 7fc6227fc640 1 -- 172.21.15.123:0/3843700829 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6240cf2d0 msgr2=0x7fc6241f8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:18.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.718+0000 7fc6227fc640 1 --2- 172.21.15.123:0/3843700829 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6240cf2d0 0x7fc6241f8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.718+0000 7fc6227fc640 1 -- 172.21.15.123:0/3843700829 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc62415ed20 msgr2=0x7fc6240cdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:18.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.718+0000 7fc6227fc640 1 --2- 172.21.15.123:0/3843700829 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc62415ed20 0x7fc6240cdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.718+0000 7fc6227fc640 1 -- 172.21.15.123:0/3843700829 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6240ce040 con 0x7fc6240d23b0 2024-09-15T23:23:18.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.718+0000 7fc6227fc640 1 --2- 172.21.15.123:0/3843700829 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6240d23b0 0x7fc624154950 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 crypto rx=0x7fc61800c820 tx=0x7fc61800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:18.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.718+0000 7fc60b7fe640 1 -- 172.21.15.123:0/3843700829 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc618004230 con 0x7fc6240d23b0 2024-09-15T23:23:18.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.718+0000 7fc60b7fe640 1 -- 172.21.15.123:0/3843700829 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6180043f0 con 0x7fc6240d23b0 2024-09-15T23:23:18.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.718+0000 7fc6293d6640 1 -- 172.21.15.123:0/3843700829 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6240ce2f0 con 0x7fc6240d23b0 2024-09-15T23:23:18.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.718+0000 7fc60b7fe640 1 -- 172.21.15.123:0/3843700829 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc618007a70 con 0x7fc6240d23b0 2024-09-15T23:23:18.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.718+0000 7fc6293d6640 1 -- 172.21.15.123:0/3843700829 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6240ce8b0 con 0x7fc6240d23b0 2024-09-15T23:23:18.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.720+0000 7fc60b7fe640 1 -- 172.21.15.123:0/3843700829 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc618007c10 con 0x7fc6240d23b0 2024-09-15T23:23:18.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.720+0000 7fc60b7fe640 1 --2- 172.21.15.123:0/3843700829 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc61006c2b0 0x7fc61006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:18.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.720+0000 7fc60b7fe640 1 -- 172.21.15.123:0/3843700829 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7fc61808b4d0 con 0x7fc6240d23b0 2024-09-15T23:23:18.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.720+0000 7fc622ffd640 1 --2- 172.21.15.123:0/3843700829 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc61006c2b0 0x7fc61006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:18.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.721+0000 7fc622ffd640 1 --2- 172.21.15.123:0/3843700829 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc61006c2b0 0x7fc61006e770 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fc61400a950 tx=0x7fc614008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:18.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.721+0000 7fc62c253740 1 Processor -- start 2024-09-15T23:23:18.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.721+0000 7fc62c253740 1 -- start start 2024-09-15T23:23:18.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.722+0000 7fc62c253740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5574b24c82c0 0x5574b250da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:18.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.722+0000 7fc62c253740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5574b24c5a80 0x5574b24c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:18.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.722+0000 7fc62c253740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5574b24c9a50 0x5574b24c28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:18.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.722+0000 7fc62c253740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5574b242a520 con 0x5574b24c5a80 2024-09-15T23:23:18.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.722+0000 7fc62c253740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5574b23d23e0 con 0x5574b24c82c0 2024-09-15T23:23:18.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.722+0000 7fc62c253740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5574b24264e0 con 0x5574b24c9a50 2024-09-15T23:23:18.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.722+0000 7fc6227fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5574b24c5a80 0x5574b24c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:18.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.722+0000 7fc6227fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5574b24c5a80 0x5574b24c86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37686/0 (socket says 172.21.15.123:37686) 2024-09-15T23:23:18.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.722+0000 7fc6227fc640 1 -- 172.21.15.123:0/1324132460 learned_addr learned my addr 172.21.15.123:0/1324132460 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:18.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.722+0000 7fc622ffd640 1 --2- 172.21.15.123:0/1324132460 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5574b24c82c0 0x5574b250da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:18.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.722+0000 7fc6237fe640 1 --2- 172.21.15.123:0/1324132460 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5574b24c9a50 0x5574b24c28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:18.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.722+0000 7fc6227fc640 1 -- 172.21.15.123:0/1324132460 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5574b24c9a50 msgr2=0x5574b24c28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:18.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.722+0000 7fc6227fc640 1 --2- 172.21.15.123:0/1324132460 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5574b24c9a50 0x5574b24c28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.722+0000 7fc6227fc640 1 -- 172.21.15.123:0/1324132460 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5574b24c82c0 msgr2=0x5574b250da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:18.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.722+0000 7fc6227fc640 1 --2- 172.21.15.123:0/1324132460 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5574b24c82c0 0x5574b250da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.722+0000 7fc6227fc640 1 -- 172.21.15.123:0/1324132460 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574b23ed2f0 con 0x5574b24c5a80 2024-09-15T23:23:18.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.722+0000 7fc6227fc640 1 --2- 172.21.15.123:0/1324132460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5574b24c5a80 0x5574b24c86a0 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 crypto rx=0x7fc618061bf0 tx=0x7fc618059c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b430affb0039236 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:18.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.722+0000 7fc608ff9640 1 -- 172.21.15.123:0/1324132460 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc618062120 con 0x5574b24c5a80 2024-09-15T23:23:18.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.723+0000 7fc608ff9640 1 -- 172.21.15.123:0/1324132460 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc61800ce10 con 0x5574b24c5a80 2024-09-15T23:23:18.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.723+0000 7fc608ff9640 1 -- 172.21.15.123:0/1324132460 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc618055b20 con 0x5574b24c5a80 2024-09-15T23:23:18.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.723+0000 7fc62c253740 1 -- 172.21.15.123:0/1324132460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5574b24c5a80 msgr2=0x5574b24c86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:18.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.723+0000 7fc62c253740 1 --2- 172.21.15.123:0/1324132460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5574b24c5a80 0x5574b24c86a0 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 crypto rx=0x7fc618061bf0 tx=0x7fc618059c70 comp rx=0 tx=0).stop 2024-09-15T23:23:18.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.723+0000 7fc62c253740 1 -- 172.21.15.123:0/1324132460 shutdown_connections 2024-09-15T23:23:18.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.723+0000 7fc62c253740 1 --2- 172.21.15.123:0/1324132460 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5574b24c9a50 0x5574b24c28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.723+0000 7fc62c253740 1 --2- 172.21.15.123:0/1324132460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5574b24c5a80 0x5574b24c86a0 unknown :-1 s=CLOSED pgs=2257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.723+0000 7fc62c253740 1 --2- 172.21.15.123:0/1324132460 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5574b24c82c0 0x5574b250da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.723+0000 7fc62c253740 1 -- 172.21.15.123:0/1324132460 >> 172.21.15.123:0/1324132460 conn(0x5574b24c4a80 msgr2=0x5574b250cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:18.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.723+0000 7fc62c253740 1 -- 172.21.15.123:0/1324132460 shutdown_connections 2024-09-15T23:23:18.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.723+0000 7fc62c253740 1 -- 172.21.15.123:0/1324132460 wait complete. 2024-09-15T23:23:18.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.724+0000 7fc62c253740 1 -- start start 2024-09-15T23:23:18.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.724+0000 7fc62c253740 1 Processor -- start 2024-09-15T23:23:18.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.725+0000 7fc62c253740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5574b24c82c0 0x5574b2509fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:18.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.725+0000 7fc62c253740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5574b24c9a50 0x5574b24f0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:18.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.725+0000 7fc62c253740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5574b250a520 0x5574b24f10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:18.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.725+0000 7fc62c253740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5574b24c3f20 con 0x5574b24c82c0 2024-09-15T23:23:18.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.725+0000 7fc62c253740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5574b23b3450 con 0x5574b24c9a50 2024-09-15T23:23:18.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.725+0000 7fc62c253740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5574b250e290 con 0x5574b250a520 2024-09-15T23:23:18.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.725+0000 7fc62c253740 10 client.0 _ll_register_callbacks cb 0x5574b213cac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:23:18.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.725+0000 7fc622ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5574b24c82c0 0x5574b2509fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:18.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.725+0000 7fc622ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5574b24c82c0 0x5574b2509fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37696/0 (socket says 172.21.15.123:37696) 2024-09-15T23:23:18.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.725+0000 7fc622ffd640 1 -- 172.21.15.123:0/1145832894 learned_addr learned my addr 172.21.15.123:0/1145832894 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:18.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.725+0000 7fc6227fc640 1 --2- 172.21.15.123:0/1145832894 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5574b24c9a50 0x5574b24f0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:18.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.725+0000 7fc6237fe640 1 --2- 172.21.15.123:0/1145832894 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5574b250a520 0x5574b24f10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:18.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.725+0000 7fc622ffd640 1 -- 172.21.15.123:0/1145832894 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5574b250a520 msgr2=0x5574b24f10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:18.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.725+0000 7fc622ffd640 1 --2- 172.21.15.123:0/1145832894 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5574b250a520 0x5574b24f10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.725+0000 7fc622ffd640 1 -- 172.21.15.123:0/1145832894 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5574b24c9a50 msgr2=0x5574b24f0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:18.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.725+0000 7fc622ffd640 1 --2- 172.21.15.123:0/1145832894 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5574b24c9a50 0x5574b24f0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.725+0000 7fc622ffd640 1 -- 172.21.15.123:0/1145832894 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574b213d2d0 con 0x5574b24c82c0 2024-09-15T23:23:18.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.725+0000 7fc622ffd640 1 --2- 172.21.15.123:0/1145832894 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5574b24c82c0 0x5574b2509fe0 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 crypto rx=0x7fc6140137d0 tx=0x7fc6140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0efa36445e571d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:18.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.725+0000 7fc601ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:23:18.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.725+0000 7fc601ffb640 1 -- 172.21.15.123:0/1145832894 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc614024070 con 0x5574b24c82c0 2024-09-15T23:23:18.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.725+0000 7fc601ffb640 1 -- 172.21.15.123:0/1145832894 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7fc614014b90 con 0x5574b24c82c0 2024-09-15T23:23:18.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.725+0000 7fc62c253740 1 -- 172.21.15.123:0/1145832894 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc61800ce10 con 0x5574b24c82c0 2024-09-15T23:23:18.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.725+0000 7fc601ffb640 1 -- 172.21.15.123:0/1145832894 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=120) ==== 24+0+0 (secure 0 0 0) 0x7fc61402f050 con 0x5574b24c82c0 2024-09-15T23:23:18.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.725+0000 7fc62c253740 10 client.10644 fetch_fsmap learned FSMap version 120 2024-09-15T23:23:18.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.725+0000 7fc62c253740 1 -- 172.21.15.123:0/1145832894 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=120,monmap=2+}) -- 0x5574b22076b0 con 0x5574b24c82c0 2024-09-15T23:23:18.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.726+0000 7fc601ffb640 1 -- 172.21.15.123:0/1145832894 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc61800ce10 con 0x5574b24c82c0 2024-09-15T23:23:18.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.726+0000 7fc601ffb640 1 -- 172.21.15.123:0/1145832894 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 120) ==== 3502+0+0 (secure 0 0 0) 0x7fc614032020 con 0x5574b24c82c0 2024-09-15T23:23:18.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.726+0000 7fc62c253740 10 client.10644 fetch_fsmap finished waiting for FSMap version 120 2024-09-15T23:23:18.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.726+0000 7fc62c253740 10 client.10644 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T23:23:18.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.726+0000 7fc62c253740 20 client.10644 populate_metadata read hostname 'smithi123' 2024-09-15T23:23:18.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.726+0000 7fc62c253740 1 --2- 172.21.15.123:0/1145832894 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x5574b2508260 0x5574b2508640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:18.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.726+0000 7fc62c253740 4 client.10644 mds_command: new command op to 10491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:23:18.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.726+0000 7fc62c253740 1 -- 172.21.15.123:0/1145832894 --> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5574b2437c50 con 0x5574b2508260 2024-09-15T23:23:18.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.726+0000 7fc6227fc640 1 --2- 172.21.15.123:0/1145832894 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x5574b2508260 0x5574b2508640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:18.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.726+0000 7fc601ffb640 10 client.10644 ms_handle_connect on v2:172.21.15.123:6834/2653908784 2024-09-15T23:23:18.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.726+0000 7fc6227fc640 1 --2- 172.21.15.123:0/1145832894 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x5574b2508260 0x5574b2508640 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4feb9ccb2b588c41 server_cookie=4dd5dfd5f15e8c4c in_seq=0 out_seq=0 2024-09-15T23:23:18.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.727+0000 7fc601ffb640 1 -- 172.21.15.123:0/1145832894 <== mds.0 v2:172.21.15.123:6834/2653908784 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5574b2437c50 con 0x5574b2508260 2024-09-15T23:23:18.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.727+0000 7fc601ffb640 10 client.10644 handle_command_reply: tid=0 2024-09-15T23:23:18.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.727+0000 7fc62c253740 1 client.10644 shutdown 2024-09-15T23:23:18.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.727+0000 7fc62c253740 1 -- 172.21.15.123:0/1145832894 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5574b24c82c0 msgr2=0x5574b2509fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:18.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.727+0000 7fc62c253740 1 --2- 172.21.15.123:0/1145832894 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5574b24c82c0 0x5574b2509fe0 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 crypto rx=0x7fc6140137d0 tx=0x7fc6140046c0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.727+0000 7fc62c253740 1 -- 172.21.15.123:0/1145832894 shutdown_connections 2024-09-15T23:23:18.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.727+0000 7fc62c253740 1 --2- 172.21.15.123:0/1145832894 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x5574b2508260 0x5574b2508640 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.727+0000 7fc62c253740 1 --2- 172.21.15.123:0/1145832894 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5574b250a520 0x5574b24f10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.727+0000 7fc62c253740 1 --2- 172.21.15.123:0/1145832894 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5574b24c9a50 0x5574b24f0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.727+0000 7fc601ffb640 0 client.10644 ms_handle_reset on v2:172.21.15.123:6834/2653908784 2024-09-15T23:23:18.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.727+0000 7fc62c253740 1 --2- 172.21.15.123:0/1145832894 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5574b24c82c0 0x5574b2509fe0 unknown :-1 s=CLOSED pgs=2258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.727+0000 7fc62c253740 1 -- 172.21.15.123:0/1145832894 >> 172.21.15.123:0/1145832894 conn(0x5574b24c5a80 msgr2=0x5574b250aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:18.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.727+0000 7fc62c253740 1 -- 172.21.15.123:0/1145832894 shutdown_connections 2024-09-15T23:23:18.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.727+0000 7fc62c253740 1 -- 172.21.15.123:0/1145832894 wait complete. 2024-09-15T23:23:18.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.727+0000 7fc62c253740 20 client.10644 trim_cache size 0 max 16384 2024-09-15T23:23:18.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.745+0000 7fc62c253740 1 Processor -- start 2024-09-15T23:23:18.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.745+0000 7fc62c253740 1 -- start start 2024-09-15T23:23:18.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.745+0000 7fc62c253740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5574b24c82c0 0x5574b24c30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:18.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.745+0000 7fc62c253740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5574b24c9a50 0x5574b2506520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:18.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.745+0000 7fc62c253740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5574b250a520 0x5574b2506a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:18.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.745+0000 7fc62c253740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc6241ffbd0 con 0x5574b250a520 2024-09-15T23:23:18.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.745+0000 7fc62c253740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc62415fc50 con 0x5574b24c82c0 2024-09-15T23:23:18.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.745+0000 7fc62c253740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc6241ff650 con 0x5574b24c9a50 2024-09-15T23:23:18.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.746+0000 7fc6237fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5574b250a520 0x5574b2506a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:18.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.746+0000 7fc6237fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5574b250a520 0x5574b2506a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37704/0 (socket says 172.21.15.123:37704) 2024-09-15T23:23:18.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.746+0000 7fc6237fe640 1 -- 172.21.15.123:0/3180127721 learned_addr learned my addr 172.21.15.123:0/3180127721 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:18.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.746+0000 7fc622ffd640 1 --2- 172.21.15.123:0/3180127721 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5574b24c82c0 0x5574b24c30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:18.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.746+0000 7fc6227fc640 1 --2- 172.21.15.123:0/3180127721 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5574b24c9a50 0x5574b2506520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:18.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.746+0000 7fc6237fe640 1 -- 172.21.15.123:0/3180127721 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5574b24c9a50 msgr2=0x5574b2506520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:18.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.746+0000 7fc6237fe640 1 --2- 172.21.15.123:0/3180127721 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5574b24c9a50 0x5574b2506520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.746+0000 7fc6237fe640 1 -- 172.21.15.123:0/3180127721 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5574b24c82c0 msgr2=0x5574b24c30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:18.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.746+0000 7fc6237fe640 1 --2- 172.21.15.123:0/3180127721 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5574b24c82c0 0x5574b24c30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.746+0000 7fc6237fe640 1 -- 172.21.15.123:0/3180127721 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574b24be8b0 con 0x5574b250a520 2024-09-15T23:23:18.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.746+0000 7fc6237fe640 1 --2- 172.21.15.123:0/3180127721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5574b250a520 0x5574b2506a60 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0093e0 tx=0x7fc61c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=629495fd07b57f7f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:18.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.746+0000 7fc603fff640 1 -- 172.21.15.123:0/3180127721 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61c036040 con 0x5574b250a520 2024-09-15T23:23:18.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.746+0000 7fc603fff640 1 -- 172.21.15.123:0/3180127721 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc61c031840 con 0x5574b250a520 2024-09-15T23:23:18.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.746+0000 7fc603fff640 1 -- 172.21.15.123:0/3180127721 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61c031c30 con 0x5574b250a520 2024-09-15T23:23:18.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.747+0000 7fc62c253740 1 -- 172.21.15.123:0/3180127721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5574b250a520 msgr2=0x5574b2506a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:18.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.747+0000 7fc62c253740 1 --2- 172.21.15.123:0/3180127721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5574b250a520 0x5574b2506a60 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0093e0 tx=0x7fc61c02e000 comp rx=0 tx=0).stop 2024-09-15T23:23:18.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.747+0000 7fc62c253740 1 -- 172.21.15.123:0/3180127721 shutdown_connections 2024-09-15T23:23:18.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.747+0000 7fc62c253740 1 --2- 172.21.15.123:0/3180127721 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5574b250a520 0x5574b2506a60 unknown :-1 s=CLOSED pgs=2259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.747+0000 7fc62c253740 1 --2- 172.21.15.123:0/3180127721 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5574b24c9a50 0x5574b2506520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.747+0000 7fc62c253740 1 --2- 172.21.15.123:0/3180127721 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5574b24c82c0 0x5574b24c30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.747+0000 7fc62c253740 1 -- 172.21.15.123:0/3180127721 >> 172.21.15.123:0/3180127721 conn(0x5574b24c5a80 msgr2=0x5574b250aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:18.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.747+0000 7fc62c253740 1 -- 172.21.15.123:0/3180127721 shutdown_connections 2024-09-15T23:23:18.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.747+0000 7fc62c253740 1 -- 172.21.15.123:0/3180127721 wait complete. 2024-09-15T23:23:18.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.747+0000 7fc62c253740 1 -- start start 2024-09-15T23:23:18.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.747+0000 7fc62c253740 1 Processor -- start 2024-09-15T23:23:18.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.748+0000 7fc62c253740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5574b24c82c0 0x5574b250d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:18.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.748+0000 7fc62c253740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5574b24c9a50 0x5574b2506710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:18.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.748+0000 7fc62c253740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5574b250a520 0x5574b258aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:18.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.748+0000 7fc62c253740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5574b24e2fa0 con 0x5574b24c82c0 2024-09-15T23:23:18.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.748+0000 7fc62c253740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5574b24e2b50 con 0x5574b250a520 2024-09-15T23:23:18.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.748+0000 7fc62c253740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5574b25208d0 con 0x5574b24c9a50 2024-09-15T23:23:18.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.748+0000 7fc62c253740 10 client.0 _ll_register_callbacks cb 0x7fc61400e850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:23:18.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.748+0000 7fc622ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5574b24c82c0 0x5574b250d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:18.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.748+0000 7fc622ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5574b24c82c0 0x5574b250d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37710/0 (socket says 172.21.15.123:37710) 2024-09-15T23:23:18.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.748+0000 7fc622ffd640 1 -- 172.21.15.123:0/4253619157 learned_addr learned my addr 172.21.15.123:0/4253619157 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:18.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.748+0000 7fc6227fc640 1 --2- 172.21.15.123:0/4253619157 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5574b24c9a50 0x5574b2506710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:18.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.749+0000 7fc622ffd640 1 -- 172.21.15.123:0/4253619157 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5574b24c9a50 msgr2=0x5574b2506710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:18.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.749+0000 7fc622ffd640 1 --2- 172.21.15.123:0/4253619157 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5574b24c9a50 0x5574b2506710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.749+0000 7fc622ffd640 1 -- 172.21.15.123:0/4253619157 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5574b250a520 msgr2=0x5574b258aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:18.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.749+0000 7fc622ffd640 1 --2- 172.21.15.123:0/4253619157 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5574b250a520 0x5574b258aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.749+0000 7fc622ffd640 1 -- 172.21.15.123:0/4253619157 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574b24c2070 con 0x5574b24c82c0 2024-09-15T23:23:18.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.749+0000 7fc622ffd640 1 --2- 172.21.15.123:0/4253619157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5574b24c82c0 0x5574b250d460 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 crypto rx=0x7fc61400eda0 tx=0x7fc614020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdbd53eb5aaf281a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:18.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.749+0000 7fc601ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:23:18.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.749+0000 7fc601ffb640 1 -- 172.21.15.123:0/4253619157 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc614024040 con 0x5574b24c82c0 2024-09-15T23:23:18.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.749+0000 7fc601ffb640 1 -- 172.21.15.123:0/4253619157 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7fc614029850 con 0x5574b24c82c0 2024-09-15T23:23:18.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.749+0000 7fc62c253740 1 -- 172.21.15.123:0/4253619157 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc61c031840 con 0x5574b24c82c0 2024-09-15T23:23:18.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.749+0000 7fc601ffb640 1 -- 172.21.15.123:0/4253619157 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=120) ==== 24+0+0 (secure 0 0 0) 0x7fc614045050 con 0x5574b24c82c0 2024-09-15T23:23:18.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.749+0000 7fc62c253740 10 client.10650 fetch_fsmap learned FSMap version 120 2024-09-15T23:23:18.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.749+0000 7fc62c253740 1 -- 172.21.15.123:0/4253619157 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=120,monmap=2+}) -- 0x5574b2507b10 con 0x5574b24c82c0 2024-09-15T23:23:18.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.749+0000 7fc601ffb640 1 -- 172.21.15.123:0/4253619157 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc61c031840 con 0x5574b24c82c0 2024-09-15T23:23:18.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.749+0000 7fc601ffb640 1 -- 172.21.15.123:0/4253619157 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 120) ==== 3502+0+0 (secure 0 0 0) 0x7fc614048020 con 0x5574b24c82c0 2024-09-15T23:23:18.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.749+0000 7fc62c253740 10 client.10650 fetch_fsmap finished waiting for FSMap version 120 2024-09-15T23:23:18.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.749+0000 7fc62c253740 10 client.10650 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T23:23:18.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.749+0000 7fc62c253740 20 client.10650 populate_metadata read hostname 'smithi123' 2024-09-15T23:23:18.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.749+0000 7fc62c253740 1 --2- 172.21.15.123:0/4253619157 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x5574b250ce40 0x5574b251b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:18.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.749+0000 7fc62c253740 4 client.10650 mds_command: new command op to 10491 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:23:18.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.749+0000 7fc62c253740 1 -- 172.21.15.123:0/4253619157 --> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] -- command(tid 0: {"prefix": "status"}) -- 0x5574b24f3e60 con 0x5574b250ce40 2024-09-15T23:23:18.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.749+0000 7fc6227fc640 1 --2- 172.21.15.123:0/4253619157 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x5574b250ce40 0x5574b251b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:18.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.750+0000 7fc6227fc640 1 --2- 172.21.15.123:0/4253619157 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x5574b250ce40 0x5574b251b5f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f000a23bb341e54 server_cookie=aae7f6d69a5fda00 in_seq=0 out_seq=0 2024-09-15T23:23:18.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.750+0000 7fc601ffb640 10 client.10650 ms_handle_connect on v2:172.21.15.123:6834/2653908784 2024-09-15T23:23:18.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.750+0000 7fc601ffb640 1 -- 172.21.15.123:0/4253619157 <== mds.0 v2:172.21.15.123:6834/2653908784 1 ==== command_reply(tid 0: 0 ) ==== 8+0+329 (crc 0 0 0) 0x5574b24f3e60 con 0x5574b250ce40 2024-09-15T23:23:18.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.750+0000 7fc601ffb640 10 client.10650 handle_command_reply: tid=0 2024-09-15T23:23:18.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.750+0000 7fc62c253740 1 client.10650 shutdown 2024-09-15T23:23:18.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.750+0000 7fc62c253740 1 -- 172.21.15.123:0/4253619157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5574b24c82c0 msgr2=0x5574b250d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:18.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.750+0000 7fc62c253740 1 --2- 172.21.15.123:0/4253619157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5574b24c82c0 0x5574b250d460 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 crypto rx=0x7fc61400eda0 tx=0x7fc614020000 comp rx=0 tx=0).stop 2024-09-15T23:23:18.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.750+0000 7fc62c253740 1 -- 172.21.15.123:0/4253619157 shutdown_connections 2024-09-15T23:23:18.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.750+0000 7fc62c253740 1 --2- 172.21.15.123:0/4253619157 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x5574b250ce40 0x5574b251b5f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.750+0000 7fc62c253740 1 --2- 172.21.15.123:0/4253619157 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5574b250a520 0x5574b258aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.750+0000 7fc601ffb640 0 client.10650 ms_handle_reset on v2:172.21.15.123:6834/2653908784 2024-09-15T23:23:18.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.750+0000 7fc62c253740 1 --2- 172.21.15.123:0/4253619157 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5574b24c9a50 0x5574b2506710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.750+0000 7fc62c253740 1 --2- 172.21.15.123:0/4253619157 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5574b24c82c0 0x5574b250d460 unknown :-1 s=CLOSED pgs=2260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.750+0000 7fc62c253740 1 -- 172.21.15.123:0/4253619157 >> 172.21.15.123:0/4253619157 conn(0x5574b24c5a80 msgr2=0x5574b2508a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:18.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.750+0000 7fc62c253740 1 -- 172.21.15.123:0/4253619157 shutdown_connections 2024-09-15T23:23:18.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.750+0000 7fc62c253740 1 -- 172.21.15.123:0/4253619157 wait complete. 2024-09-15T23:23:18.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.750+0000 7fc62c253740 20 client.10650 trim_cache size 0 max 16384 2024-09-15T23:23:18.759 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:23:18.759 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "cb968ac4-8d3a-4b17-a673-6177aeaea589", 2024-09-15T23:23:18.759 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2024-09-15T23:23:18.759 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 10491, 2024-09-15T23:23:18.759 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-09-15T23:23:18.759 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-09-15T23:23:18.759 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-09-15T23:23:18.759 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 8.8758593989999994, 2024-09-15T23:23:18.759 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 120, 2024-09-15T23:23:18.760 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 194, 2024-09-15T23:23:18.760 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 194, 2024-09-15T23:23:18.760 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 12.967376752 2024-09-15T23:23:18.760 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:23:18.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.751+0000 7fc6293d6640 1 -- 172.21.15.123:0/3843700829 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc61006c2b0 msgr2=0x7fc61006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:18.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.751+0000 7fc6293d6640 1 --2- 172.21.15.123:0/3843700829 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc61006c2b0 0x7fc61006e770 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fc61400a950 tx=0x7fc614008040 comp rx=0 tx=0).stop 2024-09-15T23:23:18.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.751+0000 7fc6293d6640 1 -- 172.21.15.123:0/3843700829 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6240d23b0 msgr2=0x7fc624154950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:18.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.751+0000 7fc6293d6640 1 --2- 172.21.15.123:0/3843700829 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6240d23b0 0x7fc624154950 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 crypto rx=0x7fc61800c820 tx=0x7fc61800cce0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.751+0000 7fc6293d6640 1 -- 172.21.15.123:0/3843700829 shutdown_connections 2024-09-15T23:23:18.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.751+0000 7fc6293d6640 1 --2- 172.21.15.123:0/3843700829 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc62415ed20 0x7fc6240cdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.751+0000 7fc6293d6640 1 --2- 172.21.15.123:0/3843700829 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc61006c2b0 0x7fc61006e770 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.751+0000 7fc6293d6640 1 --2- 172.21.15.123:0/3843700829 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6240d23b0 0x7fc624154950 unknown :-1 s=CLOSED pgs=2256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.751+0000 7fc6293d6640 1 --2- 172.21.15.123:0/3843700829 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6240cf2d0 0x7fc6241f8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.751+0000 7fc6293d6640 1 -- 172.21.15.123:0/3843700829 >> 172.21.15.123:0/3843700829 conn(0x7fc6240d1260 msgr2=0x7fc6240d47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:18.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.751+0000 7fc6293d6640 1 -- 172.21.15.123:0/3843700829 shutdown_connections 2024-09-15T23:23:18.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.751+0000 7fc6293d6640 1 -- 172.21.15.123:0/3843700829 wait complete. 2024-09-15T23:23:18.763 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:23:18.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.860+0000 7fc5a754b640 1 Processor -- start 2024-09-15T23:23:18.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.860+0000 7fc5a754b640 1 -- start start 2024-09-15T23:23:18.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.861+0000 7fc5a754b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc5a015e790 0x7fc5a0073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:18.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.861+0000 7fc5a754b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc5a0162c60 0x7fc5a00b5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:18.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.861+0000 7fc5a754b640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5a01631c0 con 0x7fc5a00b5970 2024-09-15T23:23:18.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.861+0000 7fc5a754b640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc5a015eb70 con 0x7fc5a0162c60 2024-09-15T23:23:18.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.861+0000 7fc5a754b640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fc5a00ae9a0 con 0x7fc5a015e790 2024-09-15T23:23:18.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.861+0000 7fc5a4ae6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc5a0162c60 0x7fc5a00b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:18.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.861+0000 7fc5a4ae6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc5a0162c60 0x7fc5a00b5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37726/0 (socket says 172.21.15.123:37726) 2024-09-15T23:23:18.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.861+0000 7fc5a4ae6640 1 -- 172.21.15.123:0/826686484 learned_addr learned my addr 172.21.15.123:0/826686484 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:18.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.861+0000 7fc5a4ae6640 1 -- 172.21.15.123:0/826686484 >> v2:172.21.15.188:3300/0 conn(0x7fc5a015e790 msgr2=0x7fc5a0073a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:18.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.861+0000 7fc5a52e7640 1 --2- 172.21.15.123:0/826686484 >> v2:172.21.15.188:3300/0 conn(0x7fc5a015e790 0x7fc5a0073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:18.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.861+0000 7fc5a4ae6640 1 --2- 172.21.15.123:0/826686484 >> v2:172.21.15.188:3300/0 conn(0x7fc5a015e790 0x7fc5a0073a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.861+0000 7fc5a4ae6640 1 -- 172.21.15.123:0/826686484 >> v1:172.21.15.188:6789/0 conn(0x7fc5a00b5970 legacy=0x7fc5a006f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:18.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.861+0000 7fc5a4ae6640 1 -- 172.21.15.123:0/826686484 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5a00aec40 con 0x7fc5a0162c60 2024-09-15T23:23:18.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.862+0000 7fc5a4ae6640 1 --2- 172.21.15.123:0/826686484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5a0162c60 0x7fc5a00b5430 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7fc5a00b27d0 tx=0x7fc59002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=613fc578be7d6a54 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:18.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.862+0000 7fc597fff640 1 -- 172.21.15.123:0/826686484 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc590037070 con 0x7fc5a0162c60 2024-09-15T23:23:18.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.862+0000 7fc597fff640 1 -- 172.21.15.123:0/826686484 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc59002ae20 con 0x7fc5a0162c60 2024-09-15T23:23:18.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.862+0000 7fc597fff640 1 -- 172.21.15.123:0/826686484 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc590032660 con 0x7fc5a0162c60 2024-09-15T23:23:18.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.862+0000 7fc5a754b640 1 -- 172.21.15.123:0/826686484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5a0162c60 msgr2=0x7fc5a00b5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:18.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.862+0000 7fc5a754b640 1 --2- 172.21.15.123:0/826686484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5a0162c60 0x7fc5a00b5430 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7fc5a00b27d0 tx=0x7fc59002a110 comp rx=0 tx=0).stop 2024-09-15T23:23:18.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.863+0000 7fc5a754b640 1 -- 172.21.15.123:0/826686484 shutdown_connections 2024-09-15T23:23:18.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.863+0000 7fc5a754b640 1 --2- 172.21.15.123:0/826686484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5a0162c60 0x7fc5a00b5430 unknown :-1 s=CLOSED pgs=2261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.863+0000 7fc5a754b640 1 --2- 172.21.15.123:0/826686484 >> v2:172.21.15.188:3300/0 conn(0x7fc5a015e790 0x7fc5a0073a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.863+0000 7fc5a754b640 1 -- 172.21.15.123:0/826686484 >> 172.21.15.123:0/826686484 conn(0x7fc5a00b0a80 msgr2=0x7fc5a00b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:18.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.863+0000 7fc5a754b640 1 -- 172.21.15.123:0/826686484 shutdown_connections 2024-09-15T23:23:18.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.863+0000 7fc5a754b640 1 -- 172.21.15.123:0/826686484 wait complete. 2024-09-15T23:23:18.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.864+0000 7fc5a754b640 1 Processor -- start 2024-09-15T23:23:18.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.864+0000 7fc5a754b640 1 -- start start 2024-09-15T23:23:18.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.864+0000 7fc5a754b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5a00b5970 0x7fc5a01e80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:18.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.865+0000 7fc5a754b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc5a015e790 0x7fc5a01e8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:18.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.865+0000 7fc5a754b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5a0162c60 0x7fc5a014ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:18.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.865+0000 7fc5a754b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a006f430 con 0x7fc5a0162c60 2024-09-15T23:23:18.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.865+0000 7fc5a754b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a00af200 con 0x7fc5a015e790 2024-09-15T23:23:18.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.865+0000 7fc5a754b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc5a006fe40 con 0x7fc5a00b5970 2024-09-15T23:23:18.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.865+0000 7fc5a5ae8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5a0162c60 0x7fc5a014ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:18.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.865+0000 7fc5a5ae8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5a0162c60 0x7fc5a014ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37734/0 (socket says 172.21.15.123:37734) 2024-09-15T23:23:18.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.865+0000 7fc5a5ae8640 1 -- 172.21.15.123:0/2880836138 learned_addr learned my addr 172.21.15.123:0/2880836138 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:18.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.865+0000 7fc5a4ae6640 1 --2- 172.21.15.123:0/2880836138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc5a015e790 0x7fc5a01e8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:18.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.865+0000 7fc5a52e7640 1 --2- 172.21.15.123:0/2880836138 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5a00b5970 0x7fc5a01e80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:18.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.865+0000 7fc5a5ae8640 1 -- 172.21.15.123:0/2880836138 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5a00b5970 msgr2=0x7fc5a01e80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:18.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.865+0000 7fc5a5ae8640 1 --2- 172.21.15.123:0/2880836138 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5a00b5970 0x7fc5a01e80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.865+0000 7fc5a5ae8640 1 -- 172.21.15.123:0/2880836138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc5a015e790 msgr2=0x7fc5a01e8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:18.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.865+0000 7fc5a5ae8640 1 --2- 172.21.15.123:0/2880836138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc5a015e790 0x7fc5a01e8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.865+0000 7fc5a5ae8640 1 -- 172.21.15.123:0/2880836138 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5a015cc90 con 0x7fc5a0162c60 2024-09-15T23:23:18.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.865+0000 7fc5a5ae8640 1 --2- 172.21.15.123:0/2880836138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5a0162c60 0x7fc5a014ce20 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 crypto rx=0x7fc59800c7b0 tx=0x7fc59800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:18.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.865+0000 7fc595ffb640 1 -- 172.21.15.123:0/2880836138 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc598017070 con 0x7fc5a0162c60 2024-09-15T23:23:18.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.865+0000 7fc595ffb640 1 -- 172.21.15.123:0/2880836138 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc598003da0 con 0x7fc5a0162c60 2024-09-15T23:23:18.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.865+0000 7fc595ffb640 1 -- 172.21.15.123:0/2880836138 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5980052b0 con 0x7fc5a0162c60 2024-09-15T23:23:18.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.865+0000 7fc5a754b640 1 -- 172.21.15.123:0/2880836138 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5a015cf70 con 0x7fc5a0162c60 2024-09-15T23:23:18.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.866+0000 7fc5a754b640 1 -- 172.21.15.123:0/2880836138 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5a015d530 con 0x7fc5a0162c60 2024-09-15T23:23:18.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.866+0000 7fc5a754b640 1 -- 172.21.15.123:0/2880836138 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5a015d870 con 0x7fc5a0162c60 2024-09-15T23:23:18.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.867+0000 7fc595ffb640 1 -- 172.21.15.123:0/2880836138 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc59801a070 con 0x7fc5a0162c60 2024-09-15T23:23:18.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.867+0000 7fc595ffb640 1 --2- 172.21.15.123:0/2880836138 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc58406c2b0 0x7fc58406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:18.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.868+0000 7fc595ffb640 1 -- 172.21.15.123:0/2880836138 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7fc59808a940 con 0x7fc5a0162c60 2024-09-15T23:23:18.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.868+0000 7fc5a52e7640 1 --2- 172.21.15.123:0/2880836138 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc58406c2b0 0x7fc58406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:18.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.868+0000 7fc5a52e7640 1 --2- 172.21.15.123:0/2880836138 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc58406c2b0 0x7fc58406e770 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fc5a015e1a0 tx=0x7fc59c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:18.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:18.872+0000 7fc595ffb640 1 -- 172.21.15.123:0/2880836138 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc5a015d870 con 0x7fc5a0162c60 2024-09-15T23:23:19.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.072+0000 7fc5a754b640 1 -- 172.21.15.123:0/2880836138 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc5a0073a40 con 0x7fc5a0162c60 2024-09-15T23:23:19.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.073+0000 7fc595ffb640 1 -- 172.21.15.123:0/2880836138 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v120) ==== 53+0+73 (secure 0 0 0) 0x7fc598058af0 con 0x7fc5a0162c60 2024-09-15T23:23:19.074 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:23:19.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.075+0000 7fc5a754b640 1 -- 172.21.15.123:0/2880836138 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc58406c2b0 msgr2=0x7fc58406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:19.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.075+0000 7fc5a754b640 1 --2- 172.21.15.123:0/2880836138 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc58406c2b0 0x7fc58406e770 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fc5a015e1a0 tx=0x7fc59c008040 comp rx=0 tx=0).stop 2024-09-15T23:23:19.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.075+0000 7fc5a754b640 1 -- 172.21.15.123:0/2880836138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5a0162c60 msgr2=0x7fc5a014ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:19.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.075+0000 7fc5a754b640 1 --2- 172.21.15.123:0/2880836138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5a0162c60 0x7fc5a014ce20 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 crypto rx=0x7fc59800c7b0 tx=0x7fc59800cc70 comp rx=0 tx=0).stop 2024-09-15T23:23:19.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.075+0000 7fc5a754b640 1 -- 172.21.15.123:0/2880836138 shutdown_connections 2024-09-15T23:23:19.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.075+0000 7fc5a754b640 1 --2- 172.21.15.123:0/2880836138 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc58406c2b0 0x7fc58406e770 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:19.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.075+0000 7fc5a754b640 1 --2- 172.21.15.123:0/2880836138 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5a0162c60 0x7fc5a014ce20 unknown :-1 s=CLOSED pgs=2262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:19.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.075+0000 7fc5a754b640 1 --2- 172.21.15.123:0/2880836138 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc5a015e790 0x7fc5a01e8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:19.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.075+0000 7fc5a754b640 1 --2- 172.21.15.123:0/2880836138 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc5a00b5970 0x7fc5a01e80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:19.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.075+0000 7fc5a754b640 1 -- 172.21.15.123:0/2880836138 >> 172.21.15.123:0/2880836138 conn(0x7fc5a00b0a80 msgr2=0x7fc5a00b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:19.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.075+0000 7fc5a754b640 1 -- 172.21.15.123:0/2880836138 shutdown_connections 2024-09-15T23:23:19.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.075+0000 7fc5a754b640 1 -- 172.21.15.123:0/2880836138 wait complete. 2024-09-15T23:23:19.087 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T23:23:19.087 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:23:19.087 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-09-15T23:23:19.087 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T23:23:19.087 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T23:23:19.087 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T23:23:19.087 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T23:23:19.087 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:23:19.087 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:23:19.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:23:19.088 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-09-15T23:23:19.103 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:23:19.103 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:23:19.103 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:23:19.103 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:23:19.103 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-09-15T23:23:19.103 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:23:19.104 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:23:19.104 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-09-15T23:23:19.104 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f0 2024-09-15T23:23:19.104 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:23:19.104 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:23:19.104 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f1 2024-09-15T23:23:19.104 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:23:19.104 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:23:19.104 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:23:19.104 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:23:19.104 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T23:23:19.104 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42141sec preferred_lft 42141sec 2024-09-15T23:23:19.104 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link noprefixroute 2024-09-15T23:23:19.105 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:23:19.105 INFO:teuthology.orchestra.run.smithi123.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:23:19.105 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 46:55:5a:e0:32:4d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:23:19.105 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:23:19.105 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:23:19.105 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::1c6f:d5ff:fe19:ff05/64 scope link 2024-09-15T23:23:19.105 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:23:19.105 INFO:teuthology.orchestra.run.smithi123.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:23:19.105 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 46:55:5a:e0:32:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:23:19.105 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::4455:5aff:fee0:324d/64 scope link 2024-09-15T23:23:19.105 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:23:19.105 INFO:teuthology.orchestra.run.smithi123.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:23:19.105 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether be:c1:f3:63:cb:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:23:19.105 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::bcc1:f3ff:fe63:cb24/64 scope link 2024-09-15T23:23:19.106 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:23:19.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:23:19.106 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:23:19.167 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-09-15T23:23:19.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:23:19.169 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-09-15T23:23:19.224 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-09-15T23:23:19.224 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:23:19.224 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:23:19.224 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:23:19.224 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:23:19.225 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:23:19.225 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:23:19.225 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:23:19.225 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:23:19.225 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:23:19.225 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:23:19.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:23:19.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:23:19.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:23:19.351 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-09-15T23:23:19.366 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T23:23:19.366 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:23:19.367 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:23:19.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:23:19.367 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2024-09-15T23:23:19.432 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:23:19.432 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T23:23:19.488 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:23:19.488 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:23:19.488 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:23:19.544 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T23:23:19.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:23:19.545 DEBUG:teuthology.orchestra.run.smithi123:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:23:19.628 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:23:19.629 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:23:19.629 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:23:19.637 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:23:19.637 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:23:19.637 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:23:19.637 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.188:3300,172.21.15.188:3301" 2024-09-15T23:23:19.637 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T23:23:19.642 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:23:19.642 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:23:19.642 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:23:19.642 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.188:3300,172.21.15.188:3301" 2024-09-15T23:23:19.642 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T23:23:19.642 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:6789,172.21.15.188:6789,172.21.15.188:6790" 2024-09-15T23:23:19.642 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.123:6789,172.21.15.188:6789,172.21.15.188:6790:/ 2024-09-15T23:23:19.642 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=cb968ac4-8d3a-4b17-a673-6177aeaea589" will pass to kernel 2024-09-15T23:23:19.643 INFO:teuthology.orchestra.run.smithi123.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-15T23:23:19.643 INFO:teuthology.orchestra.run.smithi123.stdout: You just mounted a file system that supports labels which does not 2024-09-15T23:23:19.643 INFO:teuthology.orchestra.run.smithi123.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T23:23:19.643 INFO:teuthology.orchestra.run.smithi123.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T23:23:19.643 INFO:teuthology.orchestra.run.smithi123.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T23:23:19.644 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T23:23:19.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:23:19.645 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:23:19.710 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T23:23:19.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:23:19.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:23:19.810 INFO:teuthology.orchestra.run.smithi123.stdout:client10659 2024-09-15T23:23:19.810 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:23:19.810 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:23:19.827 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 damage ls 2024-09-15T23:23:19.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.969+0000 7faf63bf6640 1 Processor -- start 2024-09-15T23:23:19.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.969+0000 7faf63bf6640 1 -- start start 2024-09-15T23:23:19.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.970+0000 7faf63bf6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7faf5c153550 0x7faf5c15d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:19.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.970+0000 7faf63bf6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faf5c0b3e80 0x7faf5c0b58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:19.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.970+0000 7faf63bf6640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf5c0b4310 con 0x7faf5c0b53b0 2024-09-15T23:23:19.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.970+0000 7faf63bf6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7faf5c0b45f0 con 0x7faf5c153550 2024-09-15T23:23:19.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.970+0000 7faf63bf6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7faf5c0b48d0 con 0x7faf5c0b3e80 2024-09-15T23:23:19.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.970+0000 7faf61992640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7faf5c153550 0x7faf5c15d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:19.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.970+0000 7faf61191640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faf5c0b3e80 0x7faf5c0b58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:19.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.970+0000 7faf61992640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7faf5c153550 0x7faf5c15d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:43698/0 (socket says 172.21.15.123:43698) 2024-09-15T23:23:19.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.970+0000 7faf61992640 1 -- 172.21.15.123:0/4011518853 learned_addr learned my addr 172.21.15.123:0/4011518853 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:19.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.971+0000 7faf61992640 1 -- 172.21.15.123:0/4011518853 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faf5c0b3e80 msgr2=0x7faf5c0b58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:19.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.971+0000 7faf61992640 1 --2- 172.21.15.123:0/4011518853 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faf5c0b3e80 0x7faf5c0b58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:19.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.971+0000 7faf61992640 1 -- 172.21.15.123:0/4011518853 >> v1:172.21.15.188:6789/0 conn(0x7faf5c0b53b0 legacy=0x7faf5c0cfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:19.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.971+0000 7faf61992640 1 -- 172.21.15.123:0/4011518853 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf5c0b4bb0 con 0x7faf5c153550 2024-09-15T23:23:19.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.971+0000 7faf61191640 1 --2- 172.21.15.123:0/4011518853 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faf5c0b3e80 0x7faf5c0b58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:23:19.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.971+0000 7faf61992640 1 --2- 172.21.15.123:0/4011518853 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf5c153550 0x7faf5c15d5a0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7faf58009870 tx=0x7faf5802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5b7c44e7096a7f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:19.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.971+0000 7faf60990640 1 -- 172.21.15.123:0/4011518853 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf58037070 con 0x7faf5c153550 2024-09-15T23:23:19.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.972+0000 7faf60990640 1 -- 172.21.15.123:0/4011518853 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf58032440 con 0x7faf5c153550 2024-09-15T23:23:19.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.972+0000 7faf60990640 1 -- 172.21.15.123:0/4011518853 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf58032810 con 0x7faf5c153550 2024-09-15T23:23:19.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.972+0000 7faf63bf6640 1 -- 172.21.15.123:0/4011518853 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf5c153550 msgr2=0x7faf5c15d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:19.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.972+0000 7faf63bf6640 1 --2- 172.21.15.123:0/4011518853 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf5c153550 0x7faf5c15d5a0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7faf58009870 tx=0x7faf5802a270 comp rx=0 tx=0).stop 2024-09-15T23:23:19.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.972+0000 7faf63bf6640 1 -- 172.21.15.123:0/4011518853 shutdown_connections 2024-09-15T23:23:19.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.972+0000 7faf63bf6640 1 --2- 172.21.15.123:0/4011518853 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faf5c0b3e80 0x7faf5c0b58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:19.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.972+0000 7faf63bf6640 1 --2- 172.21.15.123:0/4011518853 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf5c153550 0x7faf5c15d5a0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:19.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.972+0000 7faf63bf6640 1 -- 172.21.15.123:0/4011518853 >> 172.21.15.123:0/4011518853 conn(0x7faf5c06db30 msgr2=0x7faf5c06df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:19.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.972+0000 7faf63bf6640 1 -- 172.21.15.123:0/4011518853 shutdown_connections 2024-09-15T23:23:19.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.972+0000 7faf63bf6640 1 -- 172.21.15.123:0/4011518853 wait complete. 2024-09-15T23:23:19.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.973+0000 7faf63bf6640 1 Processor -- start 2024-09-15T23:23:19.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.973+0000 7faf63bf6640 1 -- start start 2024-09-15T23:23:19.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.974+0000 7faf63bf6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf5c0b53b0 0x7faf5c159260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:19.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.974+0000 7faf63bf6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf5c153550 0x7faf5c1506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:19.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.974+0000 7faf63bf6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faf5c15b630 0x7faf5c15bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:19.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.974+0000 7faf63bf6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c070120 con 0x7faf5c153550 2024-09-15T23:23:19.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.974+0000 7faf63bf6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c153930 con 0x7faf5c0b53b0 2024-09-15T23:23:19.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.974+0000 7faf63bf6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7faf5c0b5df0 con 0x7faf5c15b630 2024-09-15T23:23:19.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.974+0000 7faf61191640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf5c153550 0x7faf5c1506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:19.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.974+0000 7faf61191640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf5c153550 0x7faf5c1506d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37744/0 (socket says 172.21.15.123:37744) 2024-09-15T23:23:19.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.974+0000 7faf61191640 1 -- 172.21.15.123:0/3310006848 learned_addr learned my addr 172.21.15.123:0/3310006848 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:19.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.974+0000 7faf61992640 1 --2- 172.21.15.123:0/3310006848 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf5c0b53b0 0x7faf5c159260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:19.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.975+0000 7faf62193640 1 --2- 172.21.15.123:0/3310006848 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faf5c15b630 0x7faf5c15bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:19.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.975+0000 7faf61191640 1 -- 172.21.15.123:0/3310006848 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faf5c15b630 msgr2=0x7faf5c15bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:19.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.975+0000 7faf61191640 1 --2- 172.21.15.123:0/3310006848 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faf5c15b630 0x7faf5c15bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:19.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.975+0000 7faf61191640 1 -- 172.21.15.123:0/3310006848 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf5c0b53b0 msgr2=0x7faf5c159260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:19.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.975+0000 7faf61191640 1 --2- 172.21.15.123:0/3310006848 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf5c0b53b0 0x7faf5c159260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:19.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.975+0000 7faf61191640 1 -- 172.21.15.123:0/3310006848 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf5c15a1c0 con 0x7faf5c153550 2024-09-15T23:23:19.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.975+0000 7faf61992640 1 --2- 172.21.15.123:0/3310006848 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf5c0b53b0 0x7faf5c159260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:23:19.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.975+0000 7faf61191640 1 --2- 172.21.15.123:0/3310006848 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf5c153550 0x7faf5c1506d0 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 crypto rx=0x7faf4c00ec10 tx=0x7faf4c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:19.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.975+0000 7faf527fc640 1 -- 172.21.15.123:0/3310006848 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4c017070 con 0x7faf5c153550 2024-09-15T23:23:19.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.975+0000 7faf527fc640 1 -- 172.21.15.123:0/3310006848 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf4c00cc30 con 0x7faf5c153550 2024-09-15T23:23:19.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.975+0000 7faf63bf6640 1 -- 172.21.15.123:0/3310006848 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf5c150c10 con 0x7faf5c153550 2024-09-15T23:23:19.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.975+0000 7faf527fc640 1 -- 172.21.15.123:0/3310006848 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4c013470 con 0x7faf5c153550 2024-09-15T23:23:19.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.975+0000 7faf63bf6640 1 -- 172.21.15.123:0/3310006848 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf5c159c00 con 0x7faf5c153550 2024-09-15T23:23:19.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.977+0000 7faf527fc640 1 -- 172.21.15.123:0/3310006848 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7faf4c01a070 con 0x7faf5c153550 2024-09-15T23:23:19.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.977+0000 7faf527fc640 1 --2- 172.21.15.123:0/3310006848 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7faf4006c2b0 0x7faf4006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:19.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.977+0000 7faf527fc640 1 -- 172.21.15.123:0/3310006848 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7faf4c08b470 con 0x7faf5c153550 2024-09-15T23:23:19.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.977+0000 7faf61992640 1 --2- 172.21.15.123:0/3310006848 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7faf4006c2b0 0x7faf4006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:19.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.978+0000 7faf66a6d740 1 Processor -- start 2024-09-15T23:23:19.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.978+0000 7faf61992640 1 --2- 172.21.15.123:0/3310006848 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7faf4006c2b0 0x7faf4006e770 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7faf58034000 tx=0x7faf5802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:19.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.978+0000 7faf66a6d740 1 -- start start 2024-09-15T23:23:19.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.979+0000 7faf66a6d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563090aa75d0 0x563090aa79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:19.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.979+0000 7faf66a6d740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563090aa4d90 0x563090aa6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:19.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.979+0000 7faf66a6d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563090aa51f0 0x563090a87550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:19.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.979+0000 7faf66a6d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5630909c35d0 con 0x563090aa75d0 2024-09-15T23:23:19.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.979+0000 7faf66a6d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56309096b470 con 0x563090aa51f0 2024-09-15T23:23:19.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.979+0000 7faf66a6d740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5630909bf590 con 0x563090aa4d90 2024-09-15T23:23:19.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.979+0000 7faf61992640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563090aa75d0 0x563090aa79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:19.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.979+0000 7faf61992640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563090aa75d0 0x563090aa79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37760/0 (socket says 172.21.15.123:37760) 2024-09-15T23:23:19.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.979+0000 7faf61992640 1 -- 172.21.15.123:0/1922256880 learned_addr learned my addr 172.21.15.123:0/1922256880 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:19.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.979+0000 7faf61191640 1 --2- 172.21.15.123:0/1922256880 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563090aa4d90 0x563090aa6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:19.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.979+0000 7faf61992640 1 -- 172.21.15.123:0/1922256880 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563090aa4d90 msgr2=0x563090aa6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:19.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.979+0000 7faf61992640 1 --2- 172.21.15.123:0/1922256880 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563090aa4d90 0x563090aa6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:19.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.979+0000 7faf61992640 1 -- 172.21.15.123:0/1922256880 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563090aa51f0 msgr2=0x563090a87550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:19.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.979+0000 7faf61992640 1 --2- 172.21.15.123:0/1922256880 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563090aa51f0 0x563090a87550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:19.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.979+0000 7faf61992640 1 -- 172.21.15.123:0/1922256880 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563090953860 con 0x563090aa75d0 2024-09-15T23:23:19.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.979+0000 7faf61992640 1 --2- 172.21.15.123:0/1922256880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563090aa75d0 0x563090aa79b0 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7faf58035040 tx=0x7faf5802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b10569ce70b803f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:19.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.979+0000 7faf3f7fe640 1 -- 172.21.15.123:0/1922256880 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5804e070 con 0x563090aa75d0 2024-09-15T23:23:19.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.979+0000 7faf3f7fe640 1 -- 172.21.15.123:0/1922256880 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf5803e460 con 0x563090aa75d0 2024-09-15T23:23:19.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.979+0000 7faf3f7fe640 1 -- 172.21.15.123:0/1922256880 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf58037040 con 0x563090aa75d0 2024-09-15T23:23:19.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.980+0000 7faf66a6d740 1 -- 172.21.15.123:0/1922256880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563090aa75d0 msgr2=0x563090aa79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:19.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.980+0000 7faf66a6d740 1 --2- 172.21.15.123:0/1922256880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563090aa75d0 0x563090aa79b0 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7faf58035040 tx=0x7faf5802c000 comp rx=0 tx=0).stop 2024-09-15T23:23:19.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.980+0000 7faf66a6d740 1 -- 172.21.15.123:0/1922256880 shutdown_connections 2024-09-15T23:23:19.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.980+0000 7faf66a6d740 1 --2- 172.21.15.123:0/1922256880 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563090aa51f0 0x563090a87550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:19.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.980+0000 7faf66a6d740 1 --2- 172.21.15.123:0/1922256880 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563090aa4d90 0x563090aa6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:19.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.980+0000 7faf66a6d740 1 --2- 172.21.15.123:0/1922256880 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563090aa75d0 0x563090aa79b0 unknown :-1 s=CLOSED pgs=2265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:19.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.980+0000 7faf66a6d740 1 -- 172.21.15.123:0/1922256880 >> 172.21.15.123:0/1922256880 conn(0x563090a5d230 msgr2=0x563090aa5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:19.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.980+0000 7faf66a6d740 1 -- 172.21.15.123:0/1922256880 shutdown_connections 2024-09-15T23:23:19.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.980+0000 7faf66a6d740 1 -- 172.21.15.123:0/1922256880 wait complete. 2024-09-15T23:23:19.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.981+0000 7faf66a6d740 1 -- start start 2024-09-15T23:23:19.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.981+0000 7faf66a6d740 1 Processor -- start 2024-09-15T23:23:19.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.982+0000 7faf66a6d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563090aa51f0 0x563090ab5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:19.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.982+0000 7faf66a6d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563090aa75d0 0x563090a850b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:19.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.982+0000 7faf66a6d740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563090a8a930 0x563090a9df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:19.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.982+0000 7faf66a6d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x563090aa3cf0 con 0x563090aa51f0 2024-09-15T23:23:19.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.982+0000 7faf66a6d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56309094c620 con 0x563090aa75d0 2024-09-15T23:23:19.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.982+0000 7faf66a6d740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x563090aa3fd0 con 0x563090a8a930 2024-09-15T23:23:19.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.982+0000 7faf66a6d740 10 client.0 _ll_register_callbacks cb 0x5630909705b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:23:19.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.982+0000 7faf61992640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563090aa51f0 0x563090ab5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:19.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.982+0000 7faf61992640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563090aa51f0 0x563090ab5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37774/0 (socket says 172.21.15.123:37774) 2024-09-15T23:23:19.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.982+0000 7faf61992640 1 -- 172.21.15.123:0/3637184617 learned_addr learned my addr 172.21.15.123:0/3637184617 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:19.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.982+0000 7faf61191640 1 --2- 172.21.15.123:0/3637184617 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563090aa75d0 0x563090a850b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:19.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.982+0000 7faf61992640 1 -- 172.21.15.123:0/3637184617 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563090a8a930 msgr2=0x563090a9df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:19.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.982+0000 7faf62193640 1 --2- 172.21.15.123:0/3637184617 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563090a8a930 0x563090a9df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:19.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.982+0000 7faf61992640 1 --2- 172.21.15.123:0/3637184617 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563090a8a930 0x563090a9df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:19.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.982+0000 7faf61992640 1 -- 172.21.15.123:0/3637184617 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563090aa75d0 msgr2=0x563090a850b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:19.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.982+0000 7faf61992640 1 --2- 172.21.15.123:0/3637184617 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563090aa75d0 0x563090a850b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:19.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.982+0000 7faf61992640 1 -- 172.21.15.123:0/3637184617 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630906d63f0 con 0x563090aa51f0 2024-09-15T23:23:19.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.982+0000 7faf62193640 1 --2- 172.21.15.123:0/3637184617 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563090a8a930 0x563090a9df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:23:19.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.982+0000 7faf61191640 1 --2- 172.21.15.123:0/3637184617 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563090aa75d0 0x563090a850b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:23:19.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.982+0000 7faf61992640 1 --2- 172.21.15.123:0/3637184617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563090aa51f0 0x563090ab5590 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 crypto rx=0x7faf58009990 tx=0x7faf58004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5009976a8b429cfb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:19.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.982+0000 7faf3cff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:23:19.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.982+0000 7faf3cff9640 1 -- 172.21.15.123:0/3637184617 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5804e070 con 0x563090aa51f0 2024-09-15T23:23:19.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.982+0000 7faf3cff9640 1 -- 172.21.15.123:0/3637184617 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7faf5803ed60 con 0x563090aa51f0 2024-09-15T23:23:19.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.982+0000 7faf66a6d740 1 -- 172.21.15.123:0/3637184617 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf5803e460 con 0x563090aa51f0 2024-09-15T23:23:19.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.982+0000 7faf3cff9640 1 -- 172.21.15.123:0/3637184617 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=120) ==== 24+0+0 (secure 0 0 0) 0x7faf58059050 con 0x563090aa51f0 2024-09-15T23:23:19.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.983+0000 7faf66a6d740 10 client.10668 fetch_fsmap learned FSMap version 120 2024-09-15T23:23:19.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.983+0000 7faf66a6d740 1 -- 172.21.15.123:0/3637184617 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=120,monmap=2+}) -- 0x5630907a07d0 con 0x563090aa51f0 2024-09-15T23:23:19.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.983+0000 7faf3cff9640 1 -- 172.21.15.123:0/3637184617 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf5803e460 con 0x563090aa51f0 2024-09-15T23:23:19.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.983+0000 7faf3cff9640 1 -- 172.21.15.123:0/3637184617 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 120) ==== 3502+0+0 (secure 0 0 0) 0x7faf5805c020 con 0x563090aa51f0 2024-09-15T23:23:19.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.983+0000 7faf66a6d740 10 client.10668 fetch_fsmap finished waiting for FSMap version 120 2024-09-15T23:23:19.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.983+0000 7faf66a6d740 10 client.10668 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-09-15T23:23:19.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.983+0000 7faf66a6d740 20 client.10668 populate_metadata read hostname 'smithi123' 2024-09-15T23:23:19.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.983+0000 7faf66a6d740 1 --2- 172.21.15.123:0/3637184617 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x563090a9d960 0x563090a88620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:19.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.983+0000 7faf66a6d740 4 client.10668 mds_command: new command op to 10491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:23:19.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.983+0000 7faf66a6d740 1 -- 172.21.15.123:0/3637184617 --> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563090a22030 con 0x563090a9d960 2024-09-15T23:23:19.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.983+0000 7faf61191640 1 --2- 172.21.15.123:0/3637184617 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x563090a9d960 0x563090a88620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:19.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.983+0000 7faf3cff9640 10 client.10668 ms_handle_connect on v2:172.21.15.123:6834/2653908784 2024-09-15T23:23:19.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.983+0000 7faf61191640 1 --2- 172.21.15.123:0/3637184617 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x563090a9d960 0x563090a88620 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c18b0fe21b67813 server_cookie=f66e63f83914de3f in_seq=0 out_seq=0 2024-09-15T23:23:19.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.984+0000 7faf3cff9640 1 -- 172.21.15.123:0/3637184617 <== mds.0 v2:172.21.15.123:6834/2653908784 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563090a22030 con 0x563090a9d960 2024-09-15T23:23:19.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.984+0000 7faf3cff9640 10 client.10668 handle_command_reply: tid=0 2024-09-15T23:23:19.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.984+0000 7faf66a6d740 1 client.10668 shutdown 2024-09-15T23:23:19.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.984+0000 7faf66a6d740 1 -- 172.21.15.123:0/3637184617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563090aa51f0 msgr2=0x563090ab5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:19.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.984+0000 7faf66a6d740 1 --2- 172.21.15.123:0/3637184617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563090aa51f0 0x563090ab5590 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 crypto rx=0x7faf58009990 tx=0x7faf58004730 comp rx=0 tx=0).stop 2024-09-15T23:23:19.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.984+0000 7faf66a6d740 1 -- 172.21.15.123:0/3637184617 shutdown_connections 2024-09-15T23:23:19.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.984+0000 7faf66a6d740 1 --2- 172.21.15.123:0/3637184617 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x563090a9d960 0x563090a88620 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:19.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.984+0000 7faf66a6d740 1 --2- 172.21.15.123:0/3637184617 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563090a8a930 0x563090a9df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:19.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.984+0000 7faf66a6d740 1 --2- 172.21.15.123:0/3637184617 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563090aa75d0 0x563090a850b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:19.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.984+0000 7faf3cff9640 0 client.10668 ms_handle_reset on v2:172.21.15.123:6834/2653908784 2024-09-15T23:23:19.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.984+0000 7faf66a6d740 1 --2- 172.21.15.123:0/3637184617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563090aa51f0 0x563090ab5590 unknown :-1 s=CLOSED pgs=2266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:19.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.984+0000 7faf66a6d740 1 -- 172.21.15.123:0/3637184617 >> 172.21.15.123:0/3637184617 conn(0x563090aa4d90 msgr2=0x563090aa8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:19.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.984+0000 7faf66a6d740 1 -- 172.21.15.123:0/3637184617 shutdown_connections 2024-09-15T23:23:19.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.984+0000 7faf66a6d740 1 -- 172.21.15.123:0/3637184617 wait complete. 2024-09-15T23:23:19.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.984+0000 7faf66a6d740 20 client.10668 trim_cache size 0 max 16384 2024-09-15T23:23:19.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.997+0000 7faf66a6d740 1 Processor -- start 2024-09-15T23:23:19.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.997+0000 7faf66a6d740 1 -- start start 2024-09-15T23:23:20.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.998+0000 7faf66a6d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563090a8a930 0x563090a885c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.998+0000 7faf66a6d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563090aa51f0 0x563090a88b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.998+0000 7faf66a6d740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563090aa75d0 0x563090a9ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.998+0000 7faf66a6d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c1fe940 con 0x563090aa51f0 2024-09-15T23:23:20.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.998+0000 7faf66a6d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c1fd9a0 con 0x563090a8a930 2024-09-15T23:23:20.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.998+0000 7faf66a6d740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7faf5c1fcd00 con 0x563090aa75d0 2024-09-15T23:23:20.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.998+0000 7faf61191640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563090aa51f0 0x563090a88b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.998+0000 7faf61191640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563090aa51f0 0x563090a88b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37782/0 (socket says 172.21.15.123:37782) 2024-09-15T23:23:20.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.998+0000 7faf61191640 1 -- 172.21.15.123:0/261705832 learned_addr learned my addr 172.21.15.123:0/261705832 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:20.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.998+0000 7faf61191640 1 -- 172.21.15.123:0/261705832 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563090aa75d0 msgr2=0x563090a9ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:20.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.998+0000 7faf61191640 1 --2- 172.21.15.123:0/261705832 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563090aa75d0 0x563090a9ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.998+0000 7faf61191640 1 -- 172.21.15.123:0/261705832 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563090a8a930 msgr2=0x563090a885c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:20.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.998+0000 7faf61191640 1 --2- 172.21.15.123:0/261705832 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563090a8a930 0x563090a885c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.998+0000 7faf61191640 1 -- 172.21.15.123:0/261705832 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563090aa8500 con 0x563090aa51f0 2024-09-15T23:23:20.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.998+0000 7faf61191640 1 --2- 172.21.15.123:0/261705832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563090aa51f0 0x563090a88b00 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0593f0 tx=0x7faf4c089870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7615f04b5c77dae server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:20.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.999+0000 7faf3effd640 1 -- 172.21.15.123:0/261705832 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4c071070 con 0x563090aa51f0 2024-09-15T23:23:20.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.999+0000 7faf3effd640 1 -- 172.21.15.123:0/261705832 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf4c062040 con 0x563090aa51f0 2024-09-15T23:23:20.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.999+0000 7faf3effd640 1 -- 172.21.15.123:0/261705832 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4c021040 con 0x563090aa51f0 2024-09-15T23:23:20.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.999+0000 7faf66a6d740 1 -- 172.21.15.123:0/261705832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563090aa51f0 msgr2=0x563090a88b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:20.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.999+0000 7faf66a6d740 1 --2- 172.21.15.123:0/261705832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563090aa51f0 0x563090a88b00 secure :-1 s=READY pgs=2267 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0593f0 tx=0x7faf4c089870 comp rx=0 tx=0).stop 2024-09-15T23:23:20.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.999+0000 7faf66a6d740 1 -- 172.21.15.123:0/261705832 shutdown_connections 2024-09-15T23:23:20.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.999+0000 7faf66a6d740 1 --2- 172.21.15.123:0/261705832 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563090aa75d0 0x563090a9ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.999+0000 7faf66a6d740 1 --2- 172.21.15.123:0/261705832 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563090aa51f0 0x563090a88b00 unknown :-1 s=CLOSED pgs=2267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.999+0000 7faf66a6d740 1 --2- 172.21.15.123:0/261705832 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563090a8a930 0x563090a885c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.999+0000 7faf66a6d740 1 -- 172.21.15.123:0/261705832 >> 172.21.15.123:0/261705832 conn(0x563090aa4d90 msgr2=0x563090a56880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:20.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.999+0000 7faf66a6d740 1 -- 172.21.15.123:0/261705832 shutdown_connections 2024-09-15T23:23:20.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:19.999+0000 7faf66a6d740 1 -- 172.21.15.123:0/261705832 wait complete. 2024-09-15T23:23:20.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.000+0000 7faf66a6d740 1 -- start start 2024-09-15T23:23:20.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.000+0000 7faf66a6d740 1 Processor -- start 2024-09-15T23:23:20.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.001+0000 7faf66a6d740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563090a8a930 0x563090b27040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.001+0000 7faf66a6d740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563090aa51f0 0x563090a9f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.001+0000 7faf66a6d740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563090aa75d0 0x563090b1dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.001+0000 7faf66a6d740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c1fd350 con 0x563090aa51f0 2024-09-15T23:23:20.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.001+0000 7faf66a6d740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x563090b27870 con 0x563090a8a930 2024-09-15T23:23:20.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.001+0000 7faf66a6d740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x563090abf130 con 0x563090aa75d0 2024-09-15T23:23:20.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.001+0000 7faf66a6d740 10 client.0 _ll_register_callbacks cb 0x7faf580096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:23:20.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.001+0000 7faf61191640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563090aa51f0 0x563090a9f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.001+0000 7faf61191640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563090aa51f0 0x563090a9f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37786/0 (socket says 172.21.15.123:37786) 2024-09-15T23:23:20.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.001+0000 7faf61191640 1 -- 172.21.15.123:0/3716548220 learned_addr learned my addr 172.21.15.123:0/3716548220 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:20.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.001+0000 7faf61992640 1 --2- 172.21.15.123:0/3716548220 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563090a8a930 0x563090b27040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.001+0000 7faf62193640 1 --2- 172.21.15.123:0/3716548220 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563090aa75d0 0x563090b1dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.001+0000 7faf61191640 1 -- 172.21.15.123:0/3716548220 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563090aa75d0 msgr2=0x563090b1dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:20.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.001+0000 7faf61191640 1 --2- 172.21.15.123:0/3716548220 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563090aa75d0 0x563090b1dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.001+0000 7faf61191640 1 -- 172.21.15.123:0/3716548220 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563090a8a930 msgr2=0x563090b27040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:20.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.001+0000 7faf61191640 1 --2- 172.21.15.123:0/3716548220 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563090a8a930 0x563090b27040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.001+0000 7faf61191640 1 -- 172.21.15.123:0/3716548220 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563090b2a720 con 0x563090aa51f0 2024-09-15T23:23:20.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.001+0000 7faf62193640 1 --2- 172.21.15.123:0/3716548220 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563090aa75d0 0x563090b1dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:23:20.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.001+0000 7faf61191640 1 --2- 172.21.15.123:0/3716548220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563090aa51f0 0x563090a9f950 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0593a0 tx=0x7faf5803b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbd8bf10366f7a25 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:20.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.001+0000 7faf3cff9640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:23:20.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.001+0000 7faf3cff9640 1 -- 172.21.15.123:0/3716548220 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4c021030 con 0x563090aa51f0 2024-09-15T23:23:20.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.001+0000 7faf3cff9640 1 -- 172.21.15.123:0/3716548220 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7faf4c055ad0 con 0x563090aa51f0 2024-09-15T23:23:20.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.001+0000 7faf66a6d740 1 -- 172.21.15.123:0/3716548220 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf4c062040 con 0x563090aa51f0 2024-09-15T23:23:20.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.001+0000 7faf3cff9640 1 -- 172.21.15.123:0/3716548220 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=120) ==== 24+0+0 (secure 0 0 0) 0x7faf4c071040 con 0x563090aa51f0 2024-09-15T23:23:20.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.002+0000 7faf66a6d740 10 client.10674 fetch_fsmap learned FSMap version 120 2024-09-15T23:23:20.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.002+0000 7faf66a6d740 1 -- 172.21.15.123:0/3716548220 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=120,monmap=2+}) -- 0x563090ac9040 con 0x563090aa51f0 2024-09-15T23:23:20.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.002+0000 7faf3cff9640 1 -- 172.21.15.123:0/3716548220 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf4c062040 con 0x563090aa51f0 2024-09-15T23:23:20.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.002+0000 7faf3cff9640 1 -- 172.21.15.123:0/3716548220 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 120) ==== 3502+0+0 (secure 0 0 0) 0x7faf4c024060 con 0x563090aa51f0 2024-09-15T23:23:20.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.002+0000 7faf66a6d740 10 client.10674 fetch_fsmap finished waiting for FSMap version 120 2024-09-15T23:23:20.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.002+0000 7faf66a6d740 10 client.10674 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-09-15T23:23:20.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.002+0000 7faf66a6d740 20 client.10674 populate_metadata read hostname 'smithi123' 2024-09-15T23:23:20.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.002+0000 7faf66a6d740 1 --2- 172.21.15.123:0/3716548220 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x563090a887a0 0x563090b2abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.002+0000 7faf66a6d740 4 client.10674 mds_command: new command op to 10491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:23:20.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.002+0000 7faf66a6d740 1 -- 172.21.15.123:0/3716548220 --> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5630909d0d00 con 0x563090a887a0 2024-09-15T23:23:20.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.002+0000 7faf61992640 1 --2- 172.21.15.123:0/3716548220 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x563090a887a0 0x563090b2abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.002+0000 7faf3cff9640 10 client.10674 ms_handle_connect on v2:172.21.15.123:6834/2653908784 2024-09-15T23:23:20.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.002+0000 7faf61992640 1 --2- 172.21.15.123:0/3716548220 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x563090a887a0 0x563090b2abd0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d3b3747c06a3fa3 server_cookie=4387d3e486b2796b in_seq=0 out_seq=0 2024-09-15T23:23:20.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.002+0000 7faf3cff9640 1 -- 172.21.15.123:0/3716548220 <== mds.0 v2:172.21.15.123:6834/2653908784 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5630909d0d00 con 0x563090a887a0 2024-09-15T23:23:20.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.002+0000 7faf3cff9640 10 client.10674 handle_command_reply: tid=0 2024-09-15T23:23:20.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.002+0000 7faf66a6d740 1 client.10674 shutdown 2024-09-15T23:23:20.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.002+0000 7faf66a6d740 1 -- 172.21.15.123:0/3716548220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563090aa51f0 msgr2=0x563090a9f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:20.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.002+0000 7faf66a6d740 1 --2- 172.21.15.123:0/3716548220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563090aa51f0 0x563090a9f950 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0593a0 tx=0x7faf5803b000 comp rx=0 tx=0).stop 2024-09-15T23:23:20.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.002+0000 7faf66a6d740 1 -- 172.21.15.123:0/3716548220 shutdown_connections 2024-09-15T23:23:20.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.002+0000 7faf66a6d740 1 --2- 172.21.15.123:0/3716548220 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x563090a887a0 0x563090b2abd0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.002+0000 7faf66a6d740 1 --2- 172.21.15.123:0/3716548220 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x563090aa75d0 0x563090b1dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.002+0000 7faf66a6d740 1 --2- 172.21.15.123:0/3716548220 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563090aa51f0 0x563090a9f950 unknown :-1 s=CLOSED pgs=2268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.002+0000 7faf3cff9640 0 client.10674 ms_handle_reset on v2:172.21.15.123:6834/2653908784 2024-09-15T23:23:20.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.002+0000 7faf66a6d740 1 --2- 172.21.15.123:0/3716548220 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x563090a8a930 0x563090b27040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.002+0000 7faf66a6d740 1 -- 172.21.15.123:0/3716548220 >> 172.21.15.123:0/3716548220 conn(0x563090aa4d90 msgr2=0x563090a56880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:20.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.003+0000 7faf66a6d740 1 -- 172.21.15.123:0/3716548220 shutdown_connections 2024-09-15T23:23:20.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.003+0000 7faf66a6d740 1 -- 172.21.15.123:0/3716548220 wait complete. 2024-09-15T23:23:20.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.003+0000 7faf66a6d740 20 client.10674 trim_cache size 0 max 16384 2024-09-15T23:23:20.016 INFO:teuthology.orchestra.run.smithi123.stdout:[] 2024-09-15T23:23:20.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.003+0000 7faf63bf6640 1 -- 172.21.15.123:0/3310006848 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7faf4006c2b0 msgr2=0x7faf4006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:20.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.003+0000 7faf63bf6640 1 --2- 172.21.15.123:0/3310006848 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7faf4006c2b0 0x7faf4006e770 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7faf58034000 tx=0x7faf5802e000 comp rx=0 tx=0).stop 2024-09-15T23:23:20.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.003+0000 7faf63bf6640 1 -- 172.21.15.123:0/3310006848 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf5c153550 msgr2=0x7faf5c1506d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:20.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.003+0000 7faf63bf6640 1 --2- 172.21.15.123:0/3310006848 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf5c153550 0x7faf5c1506d0 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 crypto rx=0x7faf4c00ec10 tx=0x7faf4c00c520 comp rx=0 tx=0).stop 2024-09-15T23:23:20.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.003+0000 7faf63bf6640 1 -- 172.21.15.123:0/3310006848 shutdown_connections 2024-09-15T23:23:20.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.003+0000 7faf63bf6640 1 --2- 172.21.15.123:0/3310006848 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7faf5c15b630 0x7faf5c15bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.003+0000 7faf63bf6640 1 --2- 172.21.15.123:0/3310006848 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7faf4006c2b0 0x7faf4006e770 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.003+0000 7faf63bf6640 1 --2- 172.21.15.123:0/3310006848 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faf5c153550 0x7faf5c1506d0 unknown :-1 s=CLOSED pgs=2264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.003+0000 7faf63bf6640 1 --2- 172.21.15.123:0/3310006848 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7faf5c0b53b0 0x7faf5c159260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.003+0000 7faf63bf6640 1 -- 172.21.15.123:0/3310006848 >> 172.21.15.123:0/3310006848 conn(0x7faf5c06db30 msgr2=0x7faf5c0b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:20.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.003+0000 7faf63bf6640 1 -- 172.21.15.123:0/3310006848 shutdown_connections 2024-09-15T23:23:20.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.003+0000 7faf63bf6640 1 -- 172.21.15.123:0/3310006848 wait complete. 2024-09-15T23:23:20.019 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-15T23:23:20.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.114+0000 7feaf0230640 1 Processor -- start 2024-09-15T23:23:20.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.115+0000 7feaf0230640 1 -- start start 2024-09-15T23:23:20.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.116+0000 7feaf0230640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7feae813eb20 0x7feae815c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.116+0000 7feaf0230640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feae8071180 con 0x7feae80b2d40 2024-09-15T23:23:20.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.116+0000 7feaf0230640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feae8071460 con 0x7feae806c320 2024-09-15T23:23:20.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.116+0000 7feaf0230640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7feae8071ab0 con 0x7feae813eb20 2024-09-15T23:23:20.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.116+0000 7feaedfcc640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7feae80b2d40 0x7feae806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:46912/0 (socket says 172.21.15.123:46912) 2024-09-15T23:23:20.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.116+0000 7feaedfcc640 1 -- 172.21.15.123:0/2868095413 learned_addr learned my addr 172.21.15.123:0/2868095413 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:23:20.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.116+0000 7feaee7cd640 1 --2- 172.21.15.123:0/2868095413 >> v2:172.21.15.188:3300/0 conn(0x7feae813eb20 0x7feae815c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.116+0000 7feaecfca640 1 -- 172.21.15.123:0/2868095413 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3796040641 0 0) 0x7feae8071180 con 0x7feae80b2d40 2024-09-15T23:23:20.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.116+0000 7feaecfca640 1 -- 172.21.15.123:0/2868095413 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fead0003520 con 0x7feae80b2d40 2024-09-15T23:23:20.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.116+0000 7feaee7cd640 1 -- 172.21.15.123:0/2868095413 >> v1:172.21.15.188:6789/0 conn(0x7feae806c320 legacy=0x7feae815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:20.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.116+0000 7feaee7cd640 1 -- 172.21.15.123:0/2868095413 >> v1:172.21.15.123:6789/0 conn(0x7feae80b2d40 legacy=0x7feae806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:20.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.116+0000 7feaee7cd640 1 -- 172.21.15.123:0/2868095413 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae8071740 con 0x7feae813eb20 2024-09-15T23:23:20.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.117+0000 7feaee7cd640 1 --2- 172.21.15.123:0/2868095413 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feae813eb20 0x7feae815c400 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fead8009d90 tx=0x7fead802a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b860cab0d3d9580 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:20.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.117+0000 7feaecfca640 1 -- 172.21.15.123:0/2868095413 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead8007740 con 0x7feae813eb20 2024-09-15T23:23:20.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.117+0000 7feaecfca640 1 -- 172.21.15.123:0/2868095413 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fead80078e0 con 0x7feae813eb20 2024-09-15T23:23:20.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.117+0000 7feaecfca640 1 -- 172.21.15.123:0/2868095413 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead8007cb0 con 0x7feae813eb20 2024-09-15T23:23:20.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.117+0000 7feaf0230640 1 -- 172.21.15.123:0/2868095413 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feae813eb20 msgr2=0x7feae815c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:20.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.117+0000 7feaf0230640 1 --2- 172.21.15.123:0/2868095413 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feae813eb20 0x7feae815c400 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fead8009d90 tx=0x7fead802a6f0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.118+0000 7feaf0230640 1 -- 172.21.15.123:0/2868095413 shutdown_connections 2024-09-15T23:23:20.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.118+0000 7feaf0230640 1 --2- 172.21.15.123:0/2868095413 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feae813eb20 0x7feae815c400 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.118+0000 7feaf0230640 1 -- 172.21.15.123:0/2868095413 >> 172.21.15.123:0/2868095413 conn(0x7feae80ccec0 msgr2=0x7feae80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:20.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.118+0000 7feaf0230640 1 -- 172.21.15.123:0/2868095413 shutdown_connections 2024-09-15T23:23:20.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.118+0000 7feaf0230640 1 -- 172.21.15.123:0/2868095413 wait complete. 2024-09-15T23:23:20.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.119+0000 7feaf0230640 1 Processor -- start 2024-09-15T23:23:20.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.119+0000 7feaf0230640 1 -- start start 2024-09-15T23:23:20.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.119+0000 7feaf0230640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feae806c320 0x7feae81592c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.119+0000 7feaf0230640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feae80b2d40 0x7feae815ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.120+0000 7feaf0230640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feae813eb20 0x7feae815f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.120+0000 7feaf0230640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7feae81666e0 con 0x7feae813eb20 2024-09-15T23:23:20.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.120+0000 7feaf0230640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7feae8166560 con 0x7feae806c320 2024-09-15T23:23:20.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.120+0000 7feaf0230640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7feae8166860 con 0x7feae80b2d40 2024-09-15T23:23:20.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.120+0000 7feaee7cd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feae813eb20 0x7feae815f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.120+0000 7feaee7cd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feae813eb20 0x7feae815f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37798/0 (socket says 172.21.15.123:37798) 2024-09-15T23:23:20.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.120+0000 7feaee7cd640 1 -- 172.21.15.123:0/150127727 learned_addr learned my addr 172.21.15.123:0/150127727 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:20.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.120+0000 7feaedfcc640 1 --2- 172.21.15.123:0/150127727 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feae806c320 0x7feae81592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.120+0000 7feaed7cb640 1 --2- 172.21.15.123:0/150127727 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feae80b2d40 0x7feae815ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.120+0000 7feaee7cd640 1 -- 172.21.15.123:0/150127727 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feae80b2d40 msgr2=0x7feae815ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:20.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.120+0000 7feaee7cd640 1 --2- 172.21.15.123:0/150127727 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feae80b2d40 0x7feae815ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.120+0000 7feaee7cd640 1 -- 172.21.15.123:0/150127727 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feae806c320 msgr2=0x7feae81592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:20.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.120+0000 7feaee7cd640 1 --2- 172.21.15.123:0/150127727 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feae806c320 0x7feae81592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.120+0000 7feaee7cd640 1 -- 172.21.15.123:0/150127727 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae81598a0 con 0x7feae813eb20 2024-09-15T23:23:20.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.120+0000 7feaee7cd640 1 --2- 172.21.15.123:0/150127727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feae813eb20 0x7feae815f280 secure :-1 s=READY pgs=2270 cs=0 l=1 rev1=1 crypto rx=0x7fead8009eb0 tx=0x7fead8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:20.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.120+0000 7feae67fc640 1 -- 172.21.15.123:0/150127727 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead803f070 con 0x7feae813eb20 2024-09-15T23:23:20.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.120+0000 7feae67fc640 1 -- 172.21.15.123:0/150127727 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fead8031bc0 con 0x7feae813eb20 2024-09-15T23:23:20.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.120+0000 7feae67fc640 1 -- 172.21.15.123:0/150127727 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead8009450 con 0x7feae813eb20 2024-09-15T23:23:20.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.120+0000 7feaf0230640 1 -- 172.21.15.123:0/150127727 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feae8159b80 con 0x7feae813eb20 2024-09-15T23:23:20.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.120+0000 7feaf0230640 1 -- 172.21.15.123:0/150127727 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feae815a140 con 0x7feae813eb20 2024-09-15T23:23:20.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.121+0000 7feaf0230640 1 -- 172.21.15.123:0/150127727 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feae806bc10 con 0x7feae813eb20 2024-09-15T23:23:20.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.122+0000 7feae67fc640 1 -- 172.21.15.123:0/150127727 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fead803b410 con 0x7feae813eb20 2024-09-15T23:23:20.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.122+0000 7feae67fc640 1 --2- 172.21.15.123:0/150127727 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fead406c2e0 0x7fead406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.122+0000 7feae67fc640 1 -- 172.21.15.123:0/150127727 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7fead80ac9f0 con 0x7feae813eb20 2024-09-15T23:23:20.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.122+0000 7feaedfcc640 1 --2- 172.21.15.123:0/150127727 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fead406c2e0 0x7fead406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.123+0000 7feaedfcc640 1 --2- 172.21.15.123:0/150127727 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fead406c2e0 0x7fead406e7a0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7feae00011e0 tx=0x7feae0007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:20.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.127+0000 7feae67fc640 1 -- 172.21.15.123:0/150127727 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fead807ab10 con 0x7feae813eb20 2024-09-15T23:23:20.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.327+0000 7feaf0230640 1 -- 172.21.15.123:0/150127727 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7feae80b6350 con 0x7feae813eb20 2024-09-15T23:23:20.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.328+0000 7feae67fc640 1 -- 172.21.15.123:0/150127727 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fead807ee10 con 0x7feae813eb20 2024-09-15T23:23:20.329 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:23:20.329 INFO:teuthology.orchestra.run.smithi123.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-15T23:23:20.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.330+0000 7feaf0230640 1 -- 172.21.15.123:0/150127727 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fead406c2e0 msgr2=0x7fead406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:20.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.330+0000 7feaf0230640 1 --2- 172.21.15.123:0/150127727 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fead406c2e0 0x7fead406e7a0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7feae00011e0 tx=0x7feae0007d30 comp rx=0 tx=0).stop 2024-09-15T23:23:20.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.330+0000 7feaf0230640 1 -- 172.21.15.123:0/150127727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feae813eb20 msgr2=0x7feae815f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:20.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.330+0000 7feaf0230640 1 --2- 172.21.15.123:0/150127727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feae813eb20 0x7feae815f280 secure :-1 s=READY pgs=2270 cs=0 l=1 rev1=1 crypto rx=0x7fead8009eb0 tx=0x7fead8004a40 comp rx=0 tx=0).stop 2024-09-15T23:23:20.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.330+0000 7feaf0230640 1 -- 172.21.15.123:0/150127727 shutdown_connections 2024-09-15T23:23:20.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.330+0000 7feaf0230640 1 --2- 172.21.15.123:0/150127727 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fead406c2e0 0x7fead406e7a0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.330+0000 7feaf0230640 1 --2- 172.21.15.123:0/150127727 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7feae813eb20 0x7feae815f280 unknown :-1 s=CLOSED pgs=2270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.330+0000 7feaf0230640 1 --2- 172.21.15.123:0/150127727 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7feae80b2d40 0x7feae815ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.330+0000 7feaf0230640 1 --2- 172.21.15.123:0/150127727 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7feae806c320 0x7feae81592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.330+0000 7feaf0230640 1 -- 172.21.15.123:0/150127727 >> 172.21.15.123:0/150127727 conn(0x7feae80ccec0 msgr2=0x7feae8158050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:20.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.330+0000 7feaf0230640 1 -- 172.21.15.123:0/150127727 shutdown_connections 2024-09-15T23:23:20.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.330+0000 7feaf0230640 1 -- 172.21.15.123:0/150127727 wait complete. 2024-09-15T23:23:20.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:23:20.342 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.13:0 scrub start '~mdsdir' recursive 2024-09-15T23:23:20.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.443+0000 7f8246465640 1 Processor -- start 2024-09-15T23:23:20.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.443+0000 7f8246465640 1 -- start start 2024-09-15T23:23:20.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.444+0000 7f8246465640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f824015e890 0x7f82400d2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.444+0000 7f8246465640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f824006ea60 con 0x7f82400d30c0 2024-09-15T23:23:20.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.444+0000 7f8246465640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f824006ed40 con 0x7f824015e4b0 2024-09-15T23:23:20.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.444+0000 7f8246465640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f824006e810 con 0x7f824015e890 2024-09-15T23:23:20.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.444+0000 7f8244a02640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f82400d30c0 0x7f824006cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:46918/0 (socket says 172.21.15.123:46918) 2024-09-15T23:23:20.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.444+0000 7f8244a02640 1 -- 172.21.15.123:0/3915177694 learned_addr learned my addr 172.21.15.123:0/3915177694 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:23:20.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.445+0000 7f823f7fe640 1 --2- 172.21.15.123:0/3915177694 >> v2:172.21.15.188:3300/0 conn(0x7f824015e890 0x7f82400d2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.445+0000 7f823effd640 1 -- 172.21.15.123:0/3915177694 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1304047783 0 0) 0x7f824006ea60 con 0x7f82400d30c0 2024-09-15T23:23:20.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.445+0000 7f823effd640 1 -- 172.21.15.123:0/3915177694 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8228003520 con 0x7f82400d30c0 2024-09-15T23:23:20.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.445+0000 7f823effd640 1 -- 172.21.15.123:0/3915177694 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2651402663 0 0) 0x7f8228003520 con 0x7f82400d30c0 2024-09-15T23:23:20.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.445+0000 7f823f7fe640 1 -- 172.21.15.123:0/3915177694 >> v1:172.21.15.188:6789/0 conn(0x7f824015e4b0 legacy=0x7f8240073490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:20.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.445+0000 7f823f7fe640 1 -- 172.21.15.123:0/3915177694 >> v1:172.21.15.123:6789/0 conn(0x7f82400d30c0 legacy=0x7f824006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:20.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.445+0000 7f823f7fe640 1 -- 172.21.15.123:0/3915177694 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82400d2380 con 0x7f824015e890 2024-09-15T23:23:20.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.446+0000 7f823f7fe640 1 --2- 172.21.15.123:0/3915177694 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f824015e890 0x7f82400d2b80 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f824006e990 tx=0x7f823402a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cd6c35a9c0e23ab server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:20.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.446+0000 7f823effd640 1 -- 172.21.15.123:0/3915177694 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8234037070 con 0x7f824015e890 2024-09-15T23:23:20.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.446+0000 7f823effd640 1 -- 172.21.15.123:0/3915177694 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f823402aba0 con 0x7f824015e890 2024-09-15T23:23:20.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.446+0000 7f823effd640 1 -- 172.21.15.123:0/3915177694 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82380019f0 con 0x7f824015e890 2024-09-15T23:23:20.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.446+0000 7f8246465640 1 -- 172.21.15.123:0/3915177694 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f824015e890 msgr2=0x7f82400d2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:20.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.446+0000 7f8246465640 1 --2- 172.21.15.123:0/3915177694 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f824015e890 0x7f82400d2b80 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f824006e990 tx=0x7f823402a110 comp rx=0 tx=0).stop 2024-09-15T23:23:20.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.446+0000 7f8246465640 1 -- 172.21.15.123:0/3915177694 shutdown_connections 2024-09-15T23:23:20.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.446+0000 7f8246465640 1 --2- 172.21.15.123:0/3915177694 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f824015e890 0x7f82400d2b80 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.446+0000 7f8246465640 1 -- 172.21.15.123:0/3915177694 >> 172.21.15.123:0/3915177694 conn(0x7f8240067950 msgr2=0x7f8240067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:20.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.446+0000 7f8246465640 1 -- 172.21.15.123:0/3915177694 shutdown_connections 2024-09-15T23:23:20.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.446+0000 7f8246465640 1 -- 172.21.15.123:0/3915177694 wait complete. 2024-09-15T23:23:20.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.448+0000 7f8246465640 1 Processor -- start 2024-09-15T23:23:20.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.448+0000 7f8246465640 1 -- start start 2024-09-15T23:23:20.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.448+0000 7f8246465640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82400d30c0 0x7f82400cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.448+0000 7f8246465640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f824015e4b0 0x7f824015b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.448+0000 7f8246465640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f824015bce0 0x7f82401f68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.448+0000 7f8246465640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f82400d26f0 con 0x7f824015e4b0 2024-09-15T23:23:20.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.448+0000 7f8246465640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f82400d2130 con 0x7f82400d30c0 2024-09-15T23:23:20.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.448+0000 7f8246465640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f824006d430 con 0x7f824015bce0 2024-09-15T23:23:20.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.449+0000 7f823f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f824015e4b0 0x7f824015b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.449+0000 7f823f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f824015e4b0 0x7f824015b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37800/0 (socket says 172.21.15.123:37800) 2024-09-15T23:23:20.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.449+0000 7f823f7fe640 1 -- 172.21.15.123:0/1891577977 learned_addr learned my addr 172.21.15.123:0/1891577977 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:20.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.449+0000 7f823ffff640 1 --2- 172.21.15.123:0/1891577977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82400d30c0 0x7f82400cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.449+0000 7f8244a02640 1 --2- 172.21.15.123:0/1891577977 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f824015bce0 0x7f82401f68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.449+0000 7f823f7fe640 1 -- 172.21.15.123:0/1891577977 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f824015bce0 msgr2=0x7f82401f68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:20.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.449+0000 7f823f7fe640 1 --2- 172.21.15.123:0/1891577977 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f824015bce0 0x7f82401f68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.449+0000 7f823f7fe640 1 -- 172.21.15.123:0/1891577977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82400d30c0 msgr2=0x7f82400cbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:20.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.449+0000 7f823f7fe640 1 --2- 172.21.15.123:0/1891577977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82400d30c0 0x7f82400cbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.449+0000 7f823f7fe640 1 -- 172.21.15.123:0/1891577977 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82401f42f0 con 0x7f824015e4b0 2024-09-15T23:23:20.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.449+0000 7f823f7fe640 1 --2- 172.21.15.123:0/1891577977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f824015e4b0 0x7f824015b7a0 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7f8234035040 tx=0x7f82340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:20.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.449+0000 7f823cff9640 1 -- 172.21.15.123:0/1891577977 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8234042020 con 0x7f824015e4b0 2024-09-15T23:23:20.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.449+0000 7f823cff9640 1 -- 172.21.15.123:0/1891577977 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f823403d670 con 0x7f824015e4b0 2024-09-15T23:23:20.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.449+0000 7f823cff9640 1 -- 172.21.15.123:0/1891577977 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8234037040 con 0x7f824015e4b0 2024-09-15T23:23:20.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.449+0000 7f8246465640 1 -- 172.21.15.123:0/1891577977 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f824015c310 con 0x7f824015e4b0 2024-09-15T23:23:20.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.449+0000 7f8246465640 1 -- 172.21.15.123:0/1891577977 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f824015c8d0 con 0x7f824015e4b0 2024-09-15T23:23:20.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.451+0000 7f823cff9640 1 -- 172.21.15.123:0/1891577977 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8234045020 con 0x7f824015e4b0 2024-09-15T23:23:20.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.451+0000 7f823cff9640 1 --2- 172.21.15.123:0/1891577977 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f822c06c2b0 0x7f822c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.451+0000 7f823cff9640 1 -- 172.21.15.123:0/1891577977 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7f82340ab910 con 0x7f824015e4b0 2024-09-15T23:23:20.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.451+0000 7f823ffff640 1 --2- 172.21.15.123:0/1891577977 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f822c06c2b0 0x7f822c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.452+0000 7f823ffff640 1 --2- 172.21.15.123:0/1891577977 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f822c06c2b0 0x7f822c06e770 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f8240161df0 tx=0x7f8230009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:20.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.452+0000 7f8249206740 1 Processor -- start 2024-09-15T23:23:20.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.452+0000 7f8249206740 1 -- start start 2024-09-15T23:23:20.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.453+0000 7f8249206740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ae029b5500 0x55ae029b58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.453+0000 7f8249206740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ae029b2cc0 0x55ae029b4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.453+0000 7f8249206740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ae029b3120 0x55ae02995480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.453+0000 7f8249206740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55ae028d1ac0 con 0x55ae029b2cc0 2024-09-15T23:23:20.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.453+0000 7f8249206740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55ae028797b0 con 0x55ae029b5500 2024-09-15T23:23:20.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.453+0000 7f8249206740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55ae028cda80 con 0x55ae029b3120 2024-09-15T23:23:20.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.453+0000 7f823f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ae029b2cc0 0x55ae029b4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.453+0000 7f823f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ae029b2cc0 0x55ae029b4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37802/0 (socket says 172.21.15.123:37802) 2024-09-15T23:23:20.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.453+0000 7f823f7fe640 1 -- 172.21.15.123:0/273422149 learned_addr learned my addr 172.21.15.123:0/273422149 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:20.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.453+0000 7f8244a02640 1 --2- 172.21.15.123:0/273422149 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ae029b3120 0x55ae02995480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.453+0000 7f823ffff640 1 --2- 172.21.15.123:0/273422149 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ae029b5500 0x55ae029b58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.453+0000 7f823f7fe640 1 -- 172.21.15.123:0/273422149 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ae029b3120 msgr2=0x55ae02995480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:20.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.453+0000 7f823f7fe640 1 --2- 172.21.15.123:0/273422149 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ae029b3120 0x55ae02995480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.453+0000 7f823f7fe640 1 -- 172.21.15.123:0/273422149 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ae029b5500 msgr2=0x55ae029b58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:20.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.453+0000 7f823f7fe640 1 --2- 172.21.15.123:0/273422149 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ae029b5500 0x55ae029b58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.453+0000 7f823f7fe640 1 -- 172.21.15.123:0/273422149 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae026b0a20 con 0x55ae029b2cc0 2024-09-15T23:23:20.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.453+0000 7f823ffff640 1 --2- 172.21.15.123:0/273422149 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ae029b5500 0x55ae029b58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:23:20.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.453+0000 7f823f7fe640 1 --2- 172.21.15.123:0/273422149 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ae029b2cc0 0x55ae029b4850 secure :-1 s=READY pgs=2273 cs=0 l=1 rev1=1 crypto rx=0x7f82340820c0 tx=0x7f82340794e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ff94293eb1faf4a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:20.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.453+0000 7f8225ffb640 1 -- 172.21.15.123:0/273422149 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823407ddc0 con 0x55ae029b2cc0 2024-09-15T23:23:20.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.453+0000 7f8225ffb640 1 -- 172.21.15.123:0/273422149 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82340825f0 con 0x55ae029b2cc0 2024-09-15T23:23:20.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.453+0000 7f8225ffb640 1 -- 172.21.15.123:0/273422149 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8234076130 con 0x55ae029b2cc0 2024-09-15T23:23:20.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.454+0000 7f8249206740 1 -- 172.21.15.123:0/273422149 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ae029b2cc0 msgr2=0x55ae029b4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:20.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.454+0000 7f8249206740 1 --2- 172.21.15.123:0/273422149 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ae029b2cc0 0x55ae029b4850 secure :-1 s=READY pgs=2273 cs=0 l=1 rev1=1 crypto rx=0x7f82340820c0 tx=0x7f82340794e0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.454+0000 7f8249206740 1 -- 172.21.15.123:0/273422149 shutdown_connections 2024-09-15T23:23:20.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.454+0000 7f8249206740 1 --2- 172.21.15.123:0/273422149 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ae029b3120 0x55ae02995480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.454+0000 7f8249206740 1 --2- 172.21.15.123:0/273422149 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ae029b2cc0 0x55ae029b4850 unknown :-1 s=CLOSED pgs=2273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.454+0000 7f8249206740 1 --2- 172.21.15.123:0/273422149 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ae029b5500 0x55ae029b58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.454+0000 7f8249206740 1 -- 172.21.15.123:0/273422149 >> 172.21.15.123:0/273422149 conn(0x55ae0296b160 msgr2=0x55ae029b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:20.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.454+0000 7f8249206740 1 -- 172.21.15.123:0/273422149 shutdown_connections 2024-09-15T23:23:20.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.454+0000 7f8249206740 1 -- 172.21.15.123:0/273422149 wait complete. 2024-09-15T23:23:20.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.455+0000 7f8249206740 1 -- start start 2024-09-15T23:23:20.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.455+0000 7f8249206740 1 Processor -- start 2024-09-15T23:23:20.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.456+0000 7f8249206740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ae029b3120 0x55ae029aaef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.456+0000 7f8249206740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ae029b5500 0x55ae029987d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.456+0000 7f8249206740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ae029ab750 0x55ae029930e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.456+0000 7f8249206740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55ae029b1c20 con 0x55ae029b5500 2024-09-15T23:23:20.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.456+0000 7f8249206740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55ae0285a7b0 con 0x55ae029b3120 2024-09-15T23:23:20.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.456+0000 7f8249206740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55ae029b1f00 con 0x55ae029ab750 2024-09-15T23:23:20.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.456+0000 7f8249206740 10 client.0 _ll_register_callbacks cb 0x55ae025e3e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:23:20.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.456+0000 7f823f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ae029b5500 0x55ae029987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.456+0000 7f823f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ae029b5500 0x55ae029987d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37814/0 (socket says 172.21.15.123:37814) 2024-09-15T23:23:20.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.456+0000 7f823f7fe640 1 -- 172.21.15.123:0/407926299 learned_addr learned my addr 172.21.15.123:0/407926299 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:20.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.456+0000 7f823ffff640 1 --2- 172.21.15.123:0/407926299 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ae029b3120 0x55ae029aaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.456+0000 7f8244a02640 1 --2- 172.21.15.123:0/407926299 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ae029ab750 0x55ae029930e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.456+0000 7f823f7fe640 1 -- 172.21.15.123:0/407926299 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ae029ab750 msgr2=0x55ae029930e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:20.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.456+0000 7f823f7fe640 1 --2- 172.21.15.123:0/407926299 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ae029ab750 0x55ae029930e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.456+0000 7f823f7fe640 1 -- 172.21.15.123:0/407926299 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ae029b3120 msgr2=0x55ae029aaef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:20.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.456+0000 7f823f7fe640 1 --2- 172.21.15.123:0/407926299 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ae029b3120 0x55ae029aaef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.456+0000 7f823f7fe640 1 -- 172.21.15.123:0/407926299 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae025a4310 con 0x55ae029b5500 2024-09-15T23:23:20.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.456+0000 7f823f7fe640 1 --2- 172.21.15.123:0/407926299 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ae029b5500 0x55ae029987d0 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7f823402a700 tx=0x7f8234009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a819d417cf05646 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:20.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.456+0000 7f821effd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:23:20.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.456+0000 7f821effd640 1 -- 172.21.15.123:0/407926299 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82340a9070 con 0x55ae029b5500 2024-09-15T23:23:20.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.456+0000 7f821effd640 1 -- 172.21.15.123:0/407926299 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7f8234098960 con 0x55ae029b5500 2024-09-15T23:23:20.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.456+0000 7f8249206740 1 -- 172.21.15.123:0/407926299 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82340825f0 con 0x55ae029b5500 2024-09-15T23:23:20.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.456+0000 7f821effd640 1 -- 172.21.15.123:0/407926299 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=120) ==== 24+0+0 (secure 0 0 0) 0x7f82340800c0 con 0x55ae029b5500 2024-09-15T23:23:20.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.456+0000 7f8249206740 10 client.10692 fetch_fsmap learned FSMap version 120 2024-09-15T23:23:20.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.456+0000 7f8249206740 1 -- 172.21.15.123:0/407926299 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=120,monmap=2+}) -- 0x55ae027111b0 con 0x55ae029b5500 2024-09-15T23:23:20.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.457+0000 7f821effd640 1 -- 172.21.15.123:0/407926299 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82340825f0 con 0x55ae029b5500 2024-09-15T23:23:20.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.457+0000 7f821effd640 1 -- 172.21.15.123:0/407926299 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 120) ==== 3502+0+0 (secure 0 0 0) 0x7f8234082160 con 0x55ae029b5500 2024-09-15T23:23:20.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.457+0000 7f8249206740 10 client.10692 fetch_fsmap finished waiting for FSMap version 120 2024-09-15T23:23:20.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.457+0000 7f8249206740 10 client.10692 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-09-15T23:23:20.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.457+0000 7f8249206740 20 client.10692 populate_metadata read hostname 'smithi123' 2024-09-15T23:23:20.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.457+0000 7f8249206740 1 --2- 172.21.15.123:0/407926299 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x55ae02994ad0 0x55ae029adf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.457+0000 7f8249206740 4 client.10692 mds_command: new command op to 10491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:23:20.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.457+0000 7f8249206740 1 -- 172.21.15.123:0/407926299 --> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae028df1f0 con 0x55ae02994ad0 2024-09-15T23:23:20.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.457+0000 7f823ffff640 1 --2- 172.21.15.123:0/407926299 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x55ae02994ad0 0x55ae029adf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.457+0000 7f823ffff640 1 --2- 172.21.15.123:0/407926299 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x55ae02994ad0 0x55ae029adf90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2f4ce5fa061de92 server_cookie=dd4dc2aac31b39ec in_seq=0 out_seq=0 2024-09-15T23:23:20.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.457+0000 7f821effd640 10 client.10692 ms_handle_connect on v2:172.21.15.123:6834/2653908784 2024-09-15T23:23:20.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.458+0000 7f821effd640 1 -- 172.21.15.123:0/407926299 <== mds.0 v2:172.21.15.123:6834/2653908784 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ae028df1f0 con 0x55ae02994ad0 2024-09-15T23:23:20.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.458+0000 7f821effd640 10 client.10692 handle_command_reply: tid=0 2024-09-15T23:23:20.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.458+0000 7f8249206740 1 client.10692 shutdown 2024-09-15T23:23:20.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.458+0000 7f8249206740 1 -- 172.21.15.123:0/407926299 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ae029b5500 msgr2=0x55ae029987d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:20.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.458+0000 7f8249206740 1 --2- 172.21.15.123:0/407926299 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ae029b5500 0x55ae029987d0 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7f823402a700 tx=0x7f8234009190 comp rx=0 tx=0).stop 2024-09-15T23:23:20.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.458+0000 7f8249206740 1 -- 172.21.15.123:0/407926299 shutdown_connections 2024-09-15T23:23:20.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.458+0000 7f8249206740 1 --2- 172.21.15.123:0/407926299 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x55ae02994ad0 0x55ae029adf90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.458+0000 7f8249206740 1 --2- 172.21.15.123:0/407926299 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ae029ab750 0x55ae029930e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.458+0000 7f821effd640 0 client.10692 ms_handle_reset on v2:172.21.15.123:6834/2653908784 2024-09-15T23:23:20.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.458+0000 7f8249206740 1 --2- 172.21.15.123:0/407926299 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ae029b5500 0x55ae029987d0 unknown :-1 s=CLOSED pgs=2274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.458+0000 7f8249206740 1 --2- 172.21.15.123:0/407926299 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ae029b3120 0x55ae029aaef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.458+0000 7f8249206740 1 -- 172.21.15.123:0/407926299 >> 172.21.15.123:0/407926299 conn(0x55ae029b2cc0 msgr2=0x55ae02995a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:20.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.458+0000 7f8249206740 1 -- 172.21.15.123:0/407926299 shutdown_connections 2024-09-15T23:23:20.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.458+0000 7f8249206740 1 -- 172.21.15.123:0/407926299 wait complete. 2024-09-15T23:23:20.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.458+0000 7f8249206740 20 client.10692 trim_cache size 0 max 16384 2024-09-15T23:23:20.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.475+0000 7f8249206740 1 Processor -- start 2024-09-15T23:23:20.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.475+0000 7f8249206740 1 -- start start 2024-09-15T23:23:20.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.476+0000 7f8249206740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ae029ab750 0x55ae029c6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.476+0000 7f8249206740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ae029b3120 0x55ae02996ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.476+0000 7f8249206740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ae029b5500 0x55ae02997430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.476+0000 7f8249206740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f82402009f0 con 0x55ae029b3120 2024-09-15T23:23:20.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.476+0000 7f8249206740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f82401ffa50 con 0x55ae029b5500 2024-09-15T23:23:20.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.476+0000 7f8249206740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f82401563f0 con 0x55ae029ab750 2024-09-15T23:23:20.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.476+0000 7f823f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ae029b3120 0x55ae02996ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.476+0000 7f823f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ae029b3120 0x55ae02996ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37818/0 (socket says 172.21.15.123:37818) 2024-09-15T23:23:20.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.476+0000 7f823f7fe640 1 -- 172.21.15.123:0/1410101902 learned_addr learned my addr 172.21.15.123:0/1410101902 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:20.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.476+0000 7f823f7fe640 1 -- 172.21.15.123:0/1410101902 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ae029ab750 msgr2=0x55ae029c6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:20.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.476+0000 7f823f7fe640 1 --2- 172.21.15.123:0/1410101902 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ae029ab750 0x55ae029c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.476+0000 7f823f7fe640 1 -- 172.21.15.123:0/1410101902 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ae029b5500 msgr2=0x55ae02997430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:20.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.476+0000 7f823f7fe640 1 --2- 172.21.15.123:0/1410101902 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ae029b5500 0x55ae02997430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.476+0000 7f823f7fe640 1 -- 172.21.15.123:0/1410101902 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae02969fc0 con 0x55ae029b3120 2024-09-15T23:23:20.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.476+0000 7f823f7fe640 1 --2- 172.21.15.123:0/1410101902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ae029b3120 0x55ae02996ef0 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 crypto rx=0x7f8234076440 tx=0x7f82340a5070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4286d555ba25b60d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:20.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.477+0000 7f82257fa640 1 -- 172.21.15.123:0/1410101902 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82340a9050 con 0x55ae029b3120 2024-09-15T23:23:20.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.477+0000 7f82257fa640 1 -- 172.21.15.123:0/1410101902 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82340825f0 con 0x55ae029b3120 2024-09-15T23:23:20.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.477+0000 7f82257fa640 1 -- 172.21.15.123:0/1410101902 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8234082160 con 0x55ae029b3120 2024-09-15T23:23:20.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.477+0000 7f8249206740 1 -- 172.21.15.123:0/1410101902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ae029b3120 msgr2=0x55ae02996ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:20.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.477+0000 7f8249206740 1 --2- 172.21.15.123:0/1410101902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ae029b3120 0x55ae02996ef0 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 crypto rx=0x7f8234076440 tx=0x7f82340a5070 comp rx=0 tx=0).stop 2024-09-15T23:23:20.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.477+0000 7f8249206740 1 -- 172.21.15.123:0/1410101902 shutdown_connections 2024-09-15T23:23:20.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.477+0000 7f8249206740 1 --2- 172.21.15.123:0/1410101902 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ae029b5500 0x55ae02997430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.477+0000 7f8249206740 1 --2- 172.21.15.123:0/1410101902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ae029b3120 0x55ae02996ef0 unknown :-1 s=CLOSED pgs=2275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.477+0000 7f8249206740 1 --2- 172.21.15.123:0/1410101902 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ae029ab750 0x55ae029c6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.477+0000 7f8249206740 1 -- 172.21.15.123:0/1410101902 >> 172.21.15.123:0/1410101902 conn(0x55ae029b2cc0 msgr2=0x55ae029b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:20.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.477+0000 7f8249206740 1 -- 172.21.15.123:0/1410101902 shutdown_connections 2024-09-15T23:23:20.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.477+0000 7f8249206740 1 -- 172.21.15.123:0/1410101902 wait complete. 2024-09-15T23:23:20.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.478+0000 7f8249206740 1 -- start start 2024-09-15T23:23:20.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.478+0000 7f8249206740 1 Processor -- start 2024-09-15T23:23:20.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.479+0000 7f8249206740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ae029ab750 0x55ae029b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.479+0000 7f8249206740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ae029b3120 0x55ae029c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.479+0000 7f8249206740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ae029b5500 0x55ae029a94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.479+0000 7f8249206740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f82401f82c0 con 0x55ae029ab750 2024-09-15T23:23:20.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.479+0000 7f8249206740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55ae0296b550 con 0x55ae029b5500 2024-09-15T23:23:20.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.479+0000 7f8249206740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55ae02a30f30 con 0x55ae029b3120 2024-09-15T23:23:20.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.479+0000 7f8249206740 10 client.0 _ll_register_callbacks cb 0x7f82380017d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:23:20.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.479+0000 7f823ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ae029ab750 0x55ae029b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.479+0000 7f823ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ae029ab750 0x55ae029b5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37826/0 (socket says 172.21.15.123:37826) 2024-09-15T23:23:20.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.479+0000 7f823ffff640 1 -- 172.21.15.123:0/1549888780 learned_addr learned my addr 172.21.15.123:0/1549888780 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:20.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.479+0000 7f823f7fe640 1 --2- 172.21.15.123:0/1549888780 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ae029b3120 0x55ae029c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.479+0000 7f823ffff640 1 -- 172.21.15.123:0/1549888780 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ae029b3120 msgr2=0x55ae029c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:20.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.479+0000 7f823ffff640 1 --2- 172.21.15.123:0/1549888780 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ae029b3120 0x55ae029c6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.479+0000 7f823ffff640 1 -- 172.21.15.123:0/1549888780 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ae029b5500 msgr2=0x55ae029a94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:20.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.479+0000 7f8244a02640 1 --2- 172.21.15.123:0/1549888780 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ae029b5500 0x55ae029a94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.479+0000 7f823ffff640 1 --2- 172.21.15.123:0/1549888780 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ae029b5500 0x55ae029a94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.479+0000 7f823ffff640 1 -- 172.21.15.123:0/1549888780 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae0257d3d0 con 0x55ae029ab750 2024-09-15T23:23:20.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.479+0000 7f823f7fe640 1 --2- 172.21.15.123:0/1549888780 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ae029b3120 0x55ae029c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:23:20.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.479+0000 7f8244a02640 1 --2- 172.21.15.123:0/1549888780 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ae029b5500 0x55ae029a94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:23:20.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.479+0000 7f823ffff640 1 --2- 172.21.15.123:0/1549888780 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ae029ab750 0x55ae029b5db0 secure :-1 s=READY pgs=2276 cs=0 l=1 rev1=1 crypto rx=0x7f823000fde0 tx=0x7f8230007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=860dd159522163c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:20.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.479+0000 7f821effd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:23:20.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.479+0000 7f821effd640 1 -- 172.21.15.123:0/1549888780 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82300160d0 con 0x55ae029ab750 2024-09-15T23:23:20.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.479+0000 7f821effd640 1 -- 172.21.15.123:0/1549888780 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7f8230010040 con 0x55ae029ab750 2024-09-15T23:23:20.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.479+0000 7f8249206740 1 -- 172.21.15.123:0/1549888780 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82340825f0 con 0x55ae029ab750 2024-09-15T23:23:20.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.480+0000 7f821effd640 1 -- 172.21.15.123:0/1549888780 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=120) ==== 24+0+0 (secure 0 0 0) 0x7f8230035050 con 0x55ae029ab750 2024-09-15T23:23:20.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.480+0000 7f8249206740 10 client.10698 fetch_fsmap learned FSMap version 120 2024-09-15T23:23:20.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.480+0000 7f8249206740 1 -- 172.21.15.123:0/1549888780 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=120,monmap=2+}) -- 0x55ae02968b50 con 0x55ae029ab750 2024-09-15T23:23:20.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.480+0000 7f821effd640 1 -- 172.21.15.123:0/1549888780 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82340825f0 con 0x55ae029ab750 2024-09-15T23:23:20.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.480+0000 7f821effd640 1 -- 172.21.15.123:0/1549888780 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 120) ==== 3502+0+0 (secure 0 0 0) 0x7f8230038020 con 0x55ae029ab750 2024-09-15T23:23:20.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.480+0000 7f8249206740 10 client.10698 fetch_fsmap finished waiting for FSMap version 120 2024-09-15T23:23:20.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.480+0000 7f8249206740 10 client.10698 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-09-15T23:23:20.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.480+0000 7f8249206740 20 client.10698 populate_metadata read hostname 'smithi123' 2024-09-15T23:23:20.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.480+0000 7f8249206740 1 --2- 172.21.15.123:0/1549888780 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x55ae029c6670 0x55ae029a99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.480+0000 7f8249206740 4 client.10698 mds_command: new command op to 10491 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}] 2024-09-15T23:23:20.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.480+0000 7f8249206740 1 -- 172.21.15.123:0/1549888780 --> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] -- command(tid 0: {"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}) -- 0x55ae028d9540 con 0x55ae029c6670 2024-09-15T23:23:20.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.480+0000 7f823f7fe640 1 --2- 172.21.15.123:0/1549888780 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x55ae029c6670 0x55ae029a99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.480+0000 7f821effd640 10 client.10698 ms_handle_connect on v2:172.21.15.123:6834/2653908784 2024-09-15T23:23:20.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.480+0000 7f823f7fe640 1 --2- 172.21.15.123:0/1549888780 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x55ae029c6670 0x55ae029a99e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f72b7c68b34b8e8 server_cookie=68c029361ca43f4d in_seq=0 out_seq=0 2024-09-15T23:23:20.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.481+0000 7f821effd640 1 -- 172.21.15.123:0/1549888780 <== mds.0 v2:172.21.15.123:6834/2653908784 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ae028d9540 con 0x55ae029c6670 2024-09-15T23:23:20.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.481+0000 7f821effd640 10 client.10698 handle_command_reply: tid=0 2024-09-15T23:23:20.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.481+0000 7f8249206740 1 client.10698 shutdown 2024-09-15T23:23:20.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.481+0000 7f8249206740 1 -- 172.21.15.123:0/1549888780 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ae029ab750 msgr2=0x55ae029b5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:20.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.481+0000 7f8249206740 1 --2- 172.21.15.123:0/1549888780 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ae029ab750 0x55ae029b5db0 secure :-1 s=READY pgs=2276 cs=0 l=1 rev1=1 crypto rx=0x7f823000fde0 tx=0x7f8230007e30 comp rx=0 tx=0).stop 2024-09-15T23:23:20.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.481+0000 7f8249206740 1 -- 172.21.15.123:0/1549888780 shutdown_connections 2024-09-15T23:23:20.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.481+0000 7f8249206740 1 --2- 172.21.15.123:0/1549888780 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x55ae029c6670 0x55ae029a99e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.481+0000 7f8249206740 1 --2- 172.21.15.123:0/1549888780 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55ae029b5500 0x55ae029a94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.481+0000 7f8249206740 1 --2- 172.21.15.123:0/1549888780 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55ae029b3120 0x55ae029c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.481+0000 7f8249206740 1 --2- 172.21.15.123:0/1549888780 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ae029ab750 0x55ae029b5db0 unknown :-1 s=CLOSED pgs=2276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.481+0000 7f8249206740 1 -- 172.21.15.123:0/1549888780 >> 172.21.15.123:0/1549888780 conn(0x55ae029b2cc0 msgr2=0x55ae029b47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:20.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.481+0000 7f821effd640 0 client.10698 ms_handle_reset on v2:172.21.15.123:6834/2653908784 2024-09-15T23:23:20.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.481+0000 7f8249206740 1 -- 172.21.15.123:0/1549888780 shutdown_connections 2024-09-15T23:23:20.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.481+0000 7f8249206740 1 -- 172.21.15.123:0/1549888780 wait complete. 2024-09-15T23:23:20.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.481+0000 7f8249206740 20 client.10698 trim_cache size 0 max 16384 2024-09-15T23:23:20.489 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:23:20.489 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0, 2024-09-15T23:23:20.489 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_tag": "5b40f675-b932-4768-b00f-f16e9795909e", 2024-09-15T23:23:20.489 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": "asynchronous" 2024-09-15T23:23:20.489 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:23:20.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.482+0000 7f8246465640 1 -- 172.21.15.123:0/1891577977 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f822c06c2b0 msgr2=0x7f822c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:20.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.482+0000 7f8246465640 1 --2- 172.21.15.123:0/1891577977 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f822c06c2b0 0x7f822c06e770 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f8240161df0 tx=0x7f8230009040 comp rx=0 tx=0).stop 2024-09-15T23:23:20.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.482+0000 7f8246465640 1 -- 172.21.15.123:0/1891577977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f824015e4b0 msgr2=0x7f824015b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:20.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.482+0000 7f8246465640 1 --2- 172.21.15.123:0/1891577977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f824015e4b0 0x7f824015b7a0 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7f8234035040 tx=0x7f82340046c0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.482+0000 7f8246465640 1 -- 172.21.15.123:0/1891577977 shutdown_connections 2024-09-15T23:23:20.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.482+0000 7f8246465640 1 --2- 172.21.15.123:0/1891577977 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f824015bce0 0x7f82401f68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.482+0000 7f8246465640 1 --2- 172.21.15.123:0/1891577977 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f822c06c2b0 0x7f822c06e770 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.482+0000 7f8246465640 1 --2- 172.21.15.123:0/1891577977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f824015e4b0 0x7f824015b7a0 unknown :-1 s=CLOSED pgs=2272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.482+0000 7f8246465640 1 --2- 172.21.15.123:0/1891577977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f82400d30c0 0x7f82400cbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.482+0000 7f8246465640 1 -- 172.21.15.123:0/1891577977 >> 172.21.15.123:0/1891577977 conn(0x7f8240067950 msgr2=0x7f82401595b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:20.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.482+0000 7f8246465640 1 -- 172.21.15.123:0/1891577977 shutdown_connections 2024-09-15T23:23:20.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.482+0000 7f8246465640 1 -- 172.21.15.123:0/1891577977 wait complete. 2024-09-15T23:23:20.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:23:20.494 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.13:0 scrub status 2024-09-15T23:23:20.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.593+0000 7fef3720e640 1 Processor -- start 2024-09-15T23:23:20.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.593+0000 7fef3720e640 1 -- start start 2024-09-15T23:23:20.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.594+0000 7fef3720e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fef3006bfd0 0x7fef3006c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.594+0000 7fef3720e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fef300d3930 0x7fef30162ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.594+0000 7fef3720e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef3006c8f0 con 0x7fef300b3350 2024-09-15T23:23:20.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.594+0000 7fef3720e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fef300b78a0 con 0x7fef300d3930 2024-09-15T23:23:20.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.594+0000 7fef3720e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fef300cffb0 con 0x7fef3006bfd0 2024-09-15T23:23:20.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.594+0000 7fef357ab640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fef300d3930 0x7fef30162ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.594+0000 7fef357ab640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fef300d3930 0x7fef30162ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37832/0 (socket says 172.21.15.123:37832) 2024-09-15T23:23:20.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.594+0000 7fef2ffff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fef300b3350 0x7fef301623a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:46926/0 (socket says 172.21.15.123:46926) 2024-09-15T23:23:20.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.594+0000 7fef357ab640 1 -- 172.21.15.123:0/236978923 learned_addr learned my addr 172.21.15.123:0/236978923 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:20.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.595+0000 7fef34faa640 1 --2- 172.21.15.123:0/236978923 >> v2:172.21.15.188:3300/0 conn(0x7fef3006bfd0 0x7fef3006c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.595+0000 7fef357ab640 1 -- 172.21.15.123:0/236978923 >> v2:172.21.15.188:3300/0 conn(0x7fef3006bfd0 msgr2=0x7fef3006c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:20.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.595+0000 7fef357ab640 1 --2- 172.21.15.123:0/236978923 >> v2:172.21.15.188:3300/0 conn(0x7fef3006bfd0 0x7fef3006c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.595+0000 7fef357ab640 1 -- 172.21.15.123:0/236978923 >> v1:172.21.15.123:6789/0 conn(0x7fef300b3350 legacy=0x7fef301623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:20.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.595+0000 7fef357ab640 1 -- 172.21.15.123:0/236978923 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef300cf710 con 0x7fef300d3930 2024-09-15T23:23:20.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.595+0000 7fef357ab640 1 --2- 172.21.15.123:0/236978923 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef300d3930 0x7fef30162ab0 secure :-1 s=READY pgs=2278 cs=0 l=1 rev1=1 crypto rx=0x7fef3006b0d0 tx=0x7fef2802a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d664328fbed9ba07 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:20.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.596+0000 7fef2f7fe640 1 -- 172.21.15.123:0/236978923 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef28036070 con 0x7fef300d3930 2024-09-15T23:23:20.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.596+0000 7fef2f7fe640 1 -- 172.21.15.123:0/236978923 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef28031600 con 0x7fef300d3930 2024-09-15T23:23:20.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.596+0000 7fef2f7fe640 1 -- 172.21.15.123:0/236978923 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef280319d0 con 0x7fef300d3930 2024-09-15T23:23:20.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.596+0000 7fef3720e640 1 -- 172.21.15.123:0/236978923 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef300d3930 msgr2=0x7fef30162ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:20.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.596+0000 7fef3720e640 1 --2- 172.21.15.123:0/236978923 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef300d3930 0x7fef30162ab0 secure :-1 s=READY pgs=2278 cs=0 l=1 rev1=1 crypto rx=0x7fef3006b0d0 tx=0x7fef2802a760 comp rx=0 tx=0).stop 2024-09-15T23:23:20.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.596+0000 7fef3720e640 1 -- 172.21.15.123:0/236978923 shutdown_connections 2024-09-15T23:23:20.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.596+0000 7fef3720e640 1 --2- 172.21.15.123:0/236978923 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef300d3930 0x7fef30162ab0 unknown :-1 s=CLOSED pgs=2278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.596+0000 7fef3720e640 1 --2- 172.21.15.123:0/236978923 >> v2:172.21.15.188:3300/0 conn(0x7fef3006bfd0 0x7fef3006c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.596+0000 7fef3720e640 1 -- 172.21.15.123:0/236978923 >> 172.21.15.123:0/236978923 conn(0x7fef300d11c0 msgr2=0x7fef300d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:20.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.596+0000 7fef3720e640 1 -- 172.21.15.123:0/236978923 shutdown_connections 2024-09-15T23:23:20.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.596+0000 7fef3720e640 1 -- 172.21.15.123:0/236978923 wait complete. 2024-09-15T23:23:20.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.597+0000 7fef3720e640 1 Processor -- start 2024-09-15T23:23:20.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.597+0000 7fef3720e640 1 -- start start 2024-09-15T23:23:20.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.598+0000 7fef3720e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef3006bfd0 0x7fef301f5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.598+0000 7fef3720e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef300b3350 0x7fef301f46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.598+0000 7fef3720e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fef300d3930 0x7fef300d2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.598+0000 7fef3720e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fef300d2400 con 0x7fef3006bfd0 2024-09-15T23:23:20.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.598+0000 7fef3720e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fef300cfcd0 con 0x7fef300b3350 2024-09-15T23:23:20.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.598+0000 7fef3720e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fef3006cd50 con 0x7fef300d3930 2024-09-15T23:23:20.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.598+0000 7fef34faa640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef3006bfd0 0x7fef301f5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.598+0000 7fef34faa640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef3006bfd0 0x7fef301f5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37840/0 (socket says 172.21.15.123:37840) 2024-09-15T23:23:20.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.598+0000 7fef34faa640 1 -- 172.21.15.123:0/4151547690 learned_addr learned my addr 172.21.15.123:0/4151547690 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:20.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.599+0000 7fef357ab640 1 --2- 172.21.15.123:0/4151547690 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fef300d3930 0x7fef300d2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.599+0000 7fef2ffff640 1 --2- 172.21.15.123:0/4151547690 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef300b3350 0x7fef301f46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.599+0000 7fef34faa640 1 -- 172.21.15.123:0/4151547690 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fef300d3930 msgr2=0x7fef300d2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.599+0000 7fef34faa640 1 --2- 172.21.15.123:0/4151547690 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fef300d3930 0x7fef300d2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.599+0000 7fef34faa640 1 -- 172.21.15.123:0/4151547690 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef300b3350 msgr2=0x7fef301f46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.599+0000 7fef34faa640 1 --2- 172.21.15.123:0/4151547690 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef300b3350 0x7fef301f46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.599+0000 7fef34faa640 1 -- 172.21.15.123:0/4151547690 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef301f9300 con 0x7fef3006bfd0 2024-09-15T23:23:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.599+0000 7fef2ffff640 1 --2- 172.21.15.123:0/4151547690 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef300b3350 0x7fef301f46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:23:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.599+0000 7fef34faa640 1 --2- 172.21.15.123:0/4151547690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef3006bfd0 0x7fef301f5870 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 crypto rx=0x7fef2000d800 tx=0x7fef2000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.599+0000 7fef2d7fa640 1 -- 172.21.15.123:0/4151547690 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2000b6c0 con 0x7fef3006bfd0 2024-09-15T23:23:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.599+0000 7fef2d7fa640 1 -- 172.21.15.123:0/4151547690 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef20019070 con 0x7fef3006bfd0 2024-09-15T23:23:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.599+0000 7fef3720e640 1 -- 172.21.15.123:0/4151547690 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef301f8780 con 0x7fef3006bfd0 2024-09-15T23:23:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.599+0000 7fef2d7fa640 1 -- 172.21.15.123:0/4151547690 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2000ba80 con 0x7fef3006bfd0 2024-09-15T23:23:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.599+0000 7fef3720e640 1 -- 172.21.15.123:0/4151547690 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef301f8d40 con 0x7fef3006bfd0 2024-09-15T23:23:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.600+0000 7fef2d7fa640 1 -- 172.21.15.123:0/4151547690 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fef2000bc20 con 0x7fef3006bfd0 2024-09-15T23:23:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.601+0000 7fef2d7fa640 1 --2- 172.21.15.123:0/4151547690 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fef1c06c2b0 0x7fef1c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.601+0000 7fef2d7fa640 1 -- 172.21.15.123:0/4151547690 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7fef2008b900 con 0x7fef3006bfd0 2024-09-15T23:23:20.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.601+0000 7fef2ffff640 1 --2- 172.21.15.123:0/4151547690 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fef1c06c2b0 0x7fef1c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.602+0000 7fef2ffff640 1 --2- 172.21.15.123:0/4151547690 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fef1c06c2b0 0x7fef1c06e770 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fef301620d0 tx=0x7fef24009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:20.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.602+0000 7fef3a086740 1 Processor -- start 2024-09-15T23:23:20.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.602+0000 7fef3a086740 1 -- start start 2024-09-15T23:23:20.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.603+0000 7fef3a086740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c6d332f920 0x55c6d33750c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.603+0000 7fef3a086740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c6d332d0e0 0x55c6d332fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.603+0000 7fef3a086740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c6d33310b0 0x55c6d332a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.603+0000 7fef3a086740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55c6d32926f0 con 0x55c6d332d0e0 2024-09-15T23:23:20.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.603+0000 7fef3a086740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55c6d323a330 con 0x55c6d33310b0 2024-09-15T23:23:20.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.603+0000 7fef3a086740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55c6d328e6b0 con 0x55c6d332f920 2024-09-15T23:23:20.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.603+0000 7fef2ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c6d332d0e0 0x55c6d332fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.603+0000 7fef2ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c6d332d0e0 0x55c6d332fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37850/0 (socket says 172.21.15.123:37850) 2024-09-15T23:23:20.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.603+0000 7fef2ffff640 1 -- 172.21.15.123:0/2914550543 learned_addr learned my addr 172.21.15.123:0/2914550543 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:20.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.603+0000 7fef34faa640 1 --2- 172.21.15.123:0/2914550543 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c6d332f920 0x55c6d33750c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.603+0000 7fef357ab640 1 --2- 172.21.15.123:0/2914550543 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c6d33310b0 0x55c6d332a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.603+0000 7fef2ffff640 1 -- 172.21.15.123:0/2914550543 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c6d332f920 msgr2=0x55c6d33750c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:20.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.603+0000 7fef2ffff640 1 --2- 172.21.15.123:0/2914550543 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c6d332f920 0x55c6d33750c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.603+0000 7fef2ffff640 1 -- 172.21.15.123:0/2914550543 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c6d33310b0 msgr2=0x55c6d332a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:20.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.603+0000 7fef2ffff640 1 --2- 172.21.15.123:0/2914550543 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c6d33310b0 0x55c6d332a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.603+0000 7fef2ffff640 1 -- 172.21.15.123:0/2914550543 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6d32600d0 con 0x55c6d332d0e0 2024-09-15T23:23:20.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.603+0000 7fef2ffff640 1 --2- 172.21.15.123:0/2914550543 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c6d332d0e0 0x55c6d332fd00 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7fef240073f0 tx=0x7fef24010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92fe31d090fa7a17 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:20.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.603+0000 7fef167fc640 1 -- 172.21.15.123:0/2914550543 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2400dbb0 con 0x55c6d332d0e0 2024-09-15T23:23:20.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.603+0000 7fef167fc640 1 -- 172.21.15.123:0/2914550543 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef2400dd50 con 0x55c6d332d0e0 2024-09-15T23:23:20.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.603+0000 7fef167fc640 1 -- 172.21.15.123:0/2914550543 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef24020650 con 0x55c6d332d0e0 2024-09-15T23:23:20.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.604+0000 7fef3a086740 1 -- 172.21.15.123:0/2914550543 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c6d332d0e0 msgr2=0x55c6d332fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:20.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.604+0000 7fef3a086740 1 --2- 172.21.15.123:0/2914550543 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c6d332d0e0 0x55c6d332fd00 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7fef240073f0 tx=0x7fef24010000 comp rx=0 tx=0).stop 2024-09-15T23:23:20.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.604+0000 7fef3a086740 1 -- 172.21.15.123:0/2914550543 shutdown_connections 2024-09-15T23:23:20.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.604+0000 7fef3a086740 1 --2- 172.21.15.123:0/2914550543 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c6d33310b0 0x55c6d332a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.604+0000 7fef3a086740 1 --2- 172.21.15.123:0/2914550543 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c6d332d0e0 0x55c6d332fd00 unknown :-1 s=CLOSED pgs=2280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.604+0000 7fef3a086740 1 --2- 172.21.15.123:0/2914550543 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c6d332f920 0x55c6d33750c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.604+0000 7fef3a086740 1 -- 172.21.15.123:0/2914550543 >> 172.21.15.123:0/2914550543 conn(0x55c6d332c370 msgr2=0x55c6d3374590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:20.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.604+0000 7fef3a086740 1 -- 172.21.15.123:0/2914550543 shutdown_connections 2024-09-15T23:23:20.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.604+0000 7fef3a086740 1 -- 172.21.15.123:0/2914550543 wait complete. 2024-09-15T23:23:20.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.604+0000 7fef3a086740 1 -- start start 2024-09-15T23:23:20.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.605+0000 7fef3a086740 1 Processor -- start 2024-09-15T23:23:20.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.605+0000 7fef3a086740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c6d332f920 0x55c6d3350a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.605+0000 7fef3a086740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c6d33310b0 0x55c6d334d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.605+0000 7fef3a086740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c6d334e580 0x55c6d332e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.605+0000 7fef3a086740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55c6d332b810 con 0x55c6d332f920 2024-09-15T23:23:20.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.605+0000 7fef3a086740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55c6d321b4f0 con 0x55c6d334e580 2024-09-15T23:23:20.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.605+0000 7fef3a086740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55c6d33758f0 con 0x55c6d33310b0 2024-09-15T23:23:20.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.605+0000 7fef3a086740 10 client.0 _ll_register_callbacks cb 0x55c6d323cb50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:23:20.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.606+0000 7fef34faa640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c6d332f920 0x55c6d3350a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.606+0000 7fef34faa640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c6d332f920 0x55c6d3350a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37862/0 (socket says 172.21.15.123:37862) 2024-09-15T23:23:20.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.606+0000 7fef34faa640 1 -- 172.21.15.123:0/2204849909 learned_addr learned my addr 172.21.15.123:0/2204849909 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:20.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.606+0000 7fef2ffff640 1 --2- 172.21.15.123:0/2204849909 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c6d33310b0 0x55c6d334d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.606+0000 7fef357ab640 1 --2- 172.21.15.123:0/2204849909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c6d334e580 0x55c6d332e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.606+0000 7fef34faa640 1 -- 172.21.15.123:0/2204849909 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c6d33310b0 msgr2=0x55c6d334d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:20.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.606+0000 7fef34faa640 1 --2- 172.21.15.123:0/2204849909 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c6d33310b0 0x55c6d334d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.606+0000 7fef34faa640 1 -- 172.21.15.123:0/2204849909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c6d334e580 msgr2=0x55c6d332e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:20.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.606+0000 7fef34faa640 1 --2- 172.21.15.123:0/2204849909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c6d334e580 0x55c6d332e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.606+0000 7fef34faa640 1 -- 172.21.15.123:0/2204849909 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6d306f7d0 con 0x55c6d332f920 2024-09-15T23:23:20.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.606+0000 7fef34faa640 1 --2- 172.21.15.123:0/2204849909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c6d332f920 0x55c6d3350a20 secure :-1 s=READY pgs=2281 cs=0 l=1 rev1=1 crypto rx=0x7fef20089e50 tx=0x7fef20059970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1eae63381b69f42 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:20.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.606+0000 7fef0f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:23:20.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.606+0000 7fef0f7fe640 1 -- 172.21.15.123:0/2204849909 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef20055fe0 con 0x55c6d332f920 2024-09-15T23:23:20.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.606+0000 7fef0f7fe640 1 -- 172.21.15.123:0/2204849909 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7fef2006de00 con 0x55c6d332f920 2024-09-15T23:23:20.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.606+0000 7fef3a086740 1 -- 172.21.15.123:0/2204849909 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef2400dd50 con 0x55c6d332f920 2024-09-15T23:23:20.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.606+0000 7fef0f7fe640 1 -- 172.21.15.123:0/2204849909 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=120) ==== 24+0+0 (secure 0 0 0) 0x7fef20076050 con 0x55c6d332f920 2024-09-15T23:23:20.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.606+0000 7fef3a086740 10 client.10713 fetch_fsmap learned FSMap version 120 2024-09-15T23:23:20.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.606+0000 7fef3a086740 1 -- 172.21.15.123:0/2204849909 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=120,monmap=2+}) -- 0x55c6d2fa53f0 con 0x55c6d332f920 2024-09-15T23:23:20.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.606+0000 7fef0f7fe640 1 -- 172.21.15.123:0/2204849909 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef2400dd50 con 0x55c6d332f920 2024-09-15T23:23:20.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.606+0000 7fef0f7fe640 1 -- 172.21.15.123:0/2204849909 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 120) ==== 3502+0+0 (secure 0 0 0) 0x7fef20013070 con 0x55c6d332f920 2024-09-15T23:23:20.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.607+0000 7fef3a086740 10 client.10713 fetch_fsmap finished waiting for FSMap version 120 2024-09-15T23:23:20.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.607+0000 7fef3a086740 10 client.10713 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-09-15T23:23:20.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.607+0000 7fef3a086740 20 client.10713 populate_metadata read hostname 'smithi123' 2024-09-15T23:23:20.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.607+0000 7fef3a086740 1 --2- 172.21.15.123:0/2204849909 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x55c6d334ec90 0x55c6d334f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.607+0000 7fef3a086740 4 client.10713 mds_command: new command op to 10491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:23:20.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.607+0000 7fef3a086740 1 -- 172.21.15.123:0/2204849909 --> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c6d329fe20 con 0x55c6d334ec90 2024-09-15T23:23:20.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.607+0000 7fef2ffff640 1 --2- 172.21.15.123:0/2204849909 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x55c6d334ec90 0x55c6d334f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.607+0000 7fef0f7fe640 10 client.10713 ms_handle_connect on v2:172.21.15.123:6834/2653908784 2024-09-15T23:23:20.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.607+0000 7fef2ffff640 1 --2- 172.21.15.123:0/2204849909 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x55c6d334ec90 0x55c6d334f070 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82cefaf5ba41f9f server_cookie=dd1ed5f7326af359 in_seq=0 out_seq=0 2024-09-15T23:23:20.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.607+0000 7fef0f7fe640 1 -- 172.21.15.123:0/2204849909 <== mds.0 v2:172.21.15.123:6834/2653908784 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c6d329fe20 con 0x55c6d334ec90 2024-09-15T23:23:20.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.607+0000 7fef0f7fe640 10 client.10713 handle_command_reply: tid=0 2024-09-15T23:23:20.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.607+0000 7fef3a086740 1 client.10713 shutdown 2024-09-15T23:23:20.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.608+0000 7fef3a086740 1 -- 172.21.15.123:0/2204849909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c6d332f920 msgr2=0x55c6d3350a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:20.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.608+0000 7fef3a086740 1 --2- 172.21.15.123:0/2204849909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c6d332f920 0x55c6d3350a20 secure :-1 s=READY pgs=2281 cs=0 l=1 rev1=1 crypto rx=0x7fef20089e50 tx=0x7fef20059970 comp rx=0 tx=0).stop 2024-09-15T23:23:20.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.608+0000 7fef3a086740 1 -- 172.21.15.123:0/2204849909 shutdown_connections 2024-09-15T23:23:20.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.608+0000 7fef3a086740 1 --2- 172.21.15.123:0/2204849909 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x55c6d334ec90 0x55c6d334f070 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.608+0000 7fef3a086740 1 --2- 172.21.15.123:0/2204849909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c6d334e580 0x55c6d332e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.608+0000 7fef3a086740 1 --2- 172.21.15.123:0/2204849909 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c6d33310b0 0x55c6d334d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.608+0000 7fef0f7fe640 0 client.10713 ms_handle_reset on v2:172.21.15.123:6834/2653908784 2024-09-15T23:23:20.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.608+0000 7fef3a086740 1 --2- 172.21.15.123:0/2204849909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c6d332f920 0x55c6d3350a20 unknown :-1 s=CLOSED pgs=2281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.608+0000 7fef3a086740 1 -- 172.21.15.123:0/2204849909 >> 172.21.15.123:0/2204849909 conn(0x55c6d332d0e0 msgr2=0x55c6d3372610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:20.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.608+0000 7fef3a086740 1 -- 172.21.15.123:0/2204849909 shutdown_connections 2024-09-15T23:23:20.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.608+0000 7fef3a086740 1 -- 172.21.15.123:0/2204849909 wait complete. 2024-09-15T23:23:20.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.608+0000 7fef3a086740 20 client.10713 trim_cache size 0 max 16384 2024-09-15T23:23:20.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.625+0000 7fef3a086740 1 Processor -- start 2024-09-15T23:23:20.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.625+0000 7fef3a086740 1 -- start start 2024-09-15T23:23:20.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.625+0000 7fef3a086740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c6d332f920 0x55c6d33574f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.625+0000 7fef3a086740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c6d33310b0 0x55c6d3355790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.625+0000 7fef3a086740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c6d334e580 0x55c6d3355cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.625+0000 7fef3a086740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fef30200ac0 con 0x55c6d33310b0 2024-09-15T23:23:20.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.625+0000 7fef3a086740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fef301ffb40 con 0x55c6d334e580 2024-09-15T23:23:20.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.625+0000 7fef3a086740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fef301618a0 con 0x55c6d332f920 2024-09-15T23:23:20.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.626+0000 7fef2ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c6d33310b0 0x55c6d3355790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.626+0000 7fef2ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c6d33310b0 0x55c6d3355790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37878/0 (socket says 172.21.15.123:37878) 2024-09-15T23:23:20.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.626+0000 7fef2ffff640 1 -- 172.21.15.123:0/1748848032 learned_addr learned my addr 172.21.15.123:0/1748848032 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:20.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.626+0000 7fef2ffff640 1 -- 172.21.15.123:0/1748848032 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c6d332f920 msgr2=0x55c6d33574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:20.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.626+0000 7fef2ffff640 1 --2- 172.21.15.123:0/1748848032 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c6d332f920 0x55c6d33574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.626+0000 7fef2ffff640 1 -- 172.21.15.123:0/1748848032 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c6d334e580 msgr2=0x55c6d3355cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:20.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.626+0000 7fef2ffff640 1 --2- 172.21.15.123:0/1748848032 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c6d334e580 0x55c6d3355cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.626+0000 7fef2ffff640 1 -- 172.21.15.123:0/1748848032 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6d2f650f0 con 0x55c6d33310b0 2024-09-15T23:23:20.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.626+0000 7fef2ffff640 1 --2- 172.21.15.123:0/1748848032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c6d33310b0 0x55c6d3355790 secure :-1 s=READY pgs=2282 cs=0 l=1 rev1=1 crypto rx=0x7fef24009010 tx=0x7fef24007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=938d4dae759b22d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:20.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.626+0000 7fef15ffb640 1 -- 172.21.15.123:0/1748848032 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef24032070 con 0x55c6d33310b0 2024-09-15T23:23:20.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.626+0000 7fef15ffb640 1 -- 172.21.15.123:0/1748848032 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef2400dbb0 con 0x55c6d33310b0 2024-09-15T23:23:20.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.626+0000 7fef15ffb640 1 -- 172.21.15.123:0/1748848032 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef2402f430 con 0x55c6d33310b0 2024-09-15T23:23:20.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.627+0000 7fef3a086740 1 -- 172.21.15.123:0/1748848032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c6d33310b0 msgr2=0x55c6d3355790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:20.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.627+0000 7fef3a086740 1 --2- 172.21.15.123:0/1748848032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c6d33310b0 0x55c6d3355790 secure :-1 s=READY pgs=2282 cs=0 l=1 rev1=1 crypto rx=0x7fef24009010 tx=0x7fef24007000 comp rx=0 tx=0).stop 2024-09-15T23:23:20.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.627+0000 7fef3a086740 1 -- 172.21.15.123:0/1748848032 shutdown_connections 2024-09-15T23:23:20.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.627+0000 7fef3a086740 1 --2- 172.21.15.123:0/1748848032 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c6d334e580 0x55c6d3355cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.627+0000 7fef3a086740 1 --2- 172.21.15.123:0/1748848032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c6d33310b0 0x55c6d3355790 unknown :-1 s=CLOSED pgs=2282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.627+0000 7fef3a086740 1 --2- 172.21.15.123:0/1748848032 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c6d332f920 0x55c6d33574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.627+0000 7fef3a086740 1 -- 172.21.15.123:0/1748848032 >> 172.21.15.123:0/1748848032 conn(0x55c6d332d0e0 msgr2=0x55c6d3372610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:20.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.627+0000 7fef3a086740 1 -- 172.21.15.123:0/1748848032 shutdown_connections 2024-09-15T23:23:20.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.627+0000 7fef3a086740 1 -- 172.21.15.123:0/1748848032 wait complete. 2024-09-15T23:23:20.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.627+0000 7fef3a086740 1 -- start start 2024-09-15T23:23:20.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.628+0000 7fef3a086740 1 Processor -- start 2024-09-15T23:23:20.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.628+0000 7fef3a086740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c6d332f920 0x55c6d33e92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.628+0000 7fef3a086740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c6d33310b0 0x55c6d33779a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.628+0000 7fef3a086740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c6d334e580 0x55c6d3377ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.628+0000 7fef3a086740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fef301ff520 con 0x55c6d332f920 2024-09-15T23:23:20.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.628+0000 7fef3a086740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55c6d33759f0 con 0x55c6d33310b0 2024-09-15T23:23:20.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.628+0000 7fef3a086740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55c6d33f5ef0 con 0x55c6d334e580 2024-09-15T23:23:20.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.628+0000 7fef3a086740 10 client.0 _ll_register_callbacks cb 0x7fef2000d750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:23:20.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.628+0000 7fef34faa640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c6d332f920 0x55c6d33e92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.628+0000 7fef34faa640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c6d332f920 0x55c6d33e92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37880/0 (socket says 172.21.15.123:37880) 2024-09-15T23:23:20.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.628+0000 7fef34faa640 1 -- 172.21.15.123:0/3055211705 learned_addr learned my addr 172.21.15.123:0/3055211705 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:20.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.629+0000 7fef34faa640 1 -- 172.21.15.123:0/3055211705 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c6d334e580 msgr2=0x55c6d3377ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:20.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.629+0000 7fef34faa640 1 --2- 172.21.15.123:0/3055211705 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c6d334e580 0x55c6d3377ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.629+0000 7fef34faa640 1 -- 172.21.15.123:0/3055211705 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c6d33310b0 msgr2=0x55c6d33779a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:20.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.629+0000 7fef34faa640 1 --2- 172.21.15.123:0/3055211705 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c6d33310b0 0x55c6d33779a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.629+0000 7fef34faa640 1 -- 172.21.15.123:0/3055211705 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6d332ad90 con 0x55c6d332f920 2024-09-15T23:23:20.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.629+0000 7fef34faa640 1 --2- 172.21.15.123:0/3055211705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c6d332f920 0x55c6d33e92f0 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7fef2005dee0 tx=0x7fef2001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a5de209a9cfd82f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:20.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.629+0000 7fef0f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:23:20.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.629+0000 7fef0f7fe640 1 -- 172.21.15.123:0/3055211705 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef20055fe0 con 0x55c6d332f920 2024-09-15T23:23:20.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.629+0000 7fef0f7fe640 1 -- 172.21.15.123:0/3055211705 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7fef2006de00 con 0x55c6d332f920 2024-09-15T23:23:20.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.629+0000 7fef3a086740 1 -- 172.21.15.123:0/3055211705 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef2400dbb0 con 0x55c6d332f920 2024-09-15T23:23:20.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.629+0000 7fef0f7fe640 1 -- 172.21.15.123:0/3055211705 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=120) ==== 24+0+0 (secure 0 0 0) 0x7fef20059740 con 0x55c6d332f920 2024-09-15T23:23:20.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.629+0000 7fef3a086740 10 client.10719 fetch_fsmap learned FSMap version 120 2024-09-15T23:23:20.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.629+0000 7fef3a086740 1 -- 172.21.15.123:0/3055211705 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=120,monmap=2+}) -- 0x55c6d33e9830 con 0x55c6d332f920 2024-09-15T23:23:20.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.629+0000 7fef0f7fe640 1 -- 172.21.15.123:0/3055211705 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef2400dbb0 con 0x55c6d332f920 2024-09-15T23:23:20.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.629+0000 7fef0f7fe640 1 -- 172.21.15.123:0/3055211705 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 120) ==== 3502+0+0 (secure 0 0 0) 0x7fef20058830 con 0x55c6d332f920 2024-09-15T23:23:20.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.629+0000 7fef3a086740 10 client.10719 fetch_fsmap finished waiting for FSMap version 120 2024-09-15T23:23:20.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.629+0000 7fef3a086740 10 client.10719 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-09-15T23:23:20.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.629+0000 7fef3a086740 20 client.10719 populate_metadata read hostname 'smithi123' 2024-09-15T23:23:20.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.629+0000 7fef3a086740 1 --2- 172.21.15.123:0/3055211705 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x55c6d334ec90 0x55c6d33705e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:20.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.629+0000 7fef3a086740 4 client.10719 mds_command: new command op to 10491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:23:20.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.629+0000 7fef3a086740 1 -- 172.21.15.123:0/3055211705 --> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c6d329a170 con 0x55c6d334ec90 2024-09-15T23:23:20.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.629+0000 7fef2ffff640 1 --2- 172.21.15.123:0/3055211705 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x55c6d334ec90 0x55c6d33705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:20.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.630+0000 7fef2ffff640 1 --2- 172.21.15.123:0/3055211705 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x55c6d334ec90 0x55c6d33705e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cb62969c3dafecf server_cookie=f57cf62de81c813e in_seq=0 out_seq=0 2024-09-15T23:23:20.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.630+0000 7fef0f7fe640 10 client.10719 ms_handle_connect on v2:172.21.15.123:6834/2653908784 2024-09-15T23:23:20.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.630+0000 7fef0f7fe640 1 -- 172.21.15.123:0/3055211705 <== mds.0 v2:172.21.15.123:6834/2653908784 1 ==== command_reply(tid 0: 0 ) ==== 8+0+257 (crc 0 0 0) 0x55c6d329a170 con 0x55c6d334ec90 2024-09-15T23:23:20.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.630+0000 7fef0f7fe640 10 client.10719 handle_command_reply: tid=0 2024-09-15T23:23:20.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.630+0000 7fef3a086740 1 client.10719 shutdown 2024-09-15T23:23:20.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.630+0000 7fef3a086740 1 -- 172.21.15.123:0/3055211705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c6d332f920 msgr2=0x55c6d33e92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:20.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.630+0000 7fef3a086740 1 --2- 172.21.15.123:0/3055211705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c6d332f920 0x55c6d33e92f0 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7fef2005dee0 tx=0x7fef2001e000 comp rx=0 tx=0).stop 2024-09-15T23:23:20.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.630+0000 7fef3a086740 1 -- 172.21.15.123:0/3055211705 shutdown_connections 2024-09-15T23:23:20.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.630+0000 7fef3a086740 1 --2- 172.21.15.123:0/3055211705 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x55c6d334ec90 0x55c6d33705e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.630+0000 7fef3a086740 1 --2- 172.21.15.123:0/3055211705 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55c6d334e580 0x55c6d3377ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.630+0000 7fef3a086740 1 --2- 172.21.15.123:0/3055211705 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55c6d33310b0 0x55c6d33779a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.630+0000 7fef0f7fe640 0 client.10719 ms_handle_reset on v2:172.21.15.123:6834/2653908784 2024-09-15T23:23:20.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.630+0000 7fef3a086740 1 --2- 172.21.15.123:0/3055211705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c6d332f920 0x55c6d33e92f0 unknown :-1 s=CLOSED pgs=2283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.630+0000 7fef3a086740 1 -- 172.21.15.123:0/3055211705 >> 172.21.15.123:0/3055211705 conn(0x55c6d332d0e0 msgr2=0x55c6d3376410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:20.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.630+0000 7fef3a086740 1 -- 172.21.15.123:0/3055211705 shutdown_connections 2024-09-15T23:23:20.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.630+0000 7fef3a086740 1 -- 172.21.15.123:0/3055211705 wait complete. 2024-09-15T23:23:20.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.630+0000 7fef3a086740 20 client.10719 trim_cache size 0 max 16384 2024-09-15T23:23:20.638 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:23:20.638 INFO:teuthology.orchestra.run.smithi123.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-15T23:23:20.638 INFO:teuthology.orchestra.run.smithi123.stdout: "scrubs": { 2024-09-15T23:23:20.638 INFO:teuthology.orchestra.run.smithi123.stdout: "5b40f675-b932-4768-b00f-f16e9795909e": { 2024-09-15T23:23:20.638 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "~mds0", 2024-09-15T23:23:20.638 INFO:teuthology.orchestra.run.smithi123.stdout: "tag": "5b40f675-b932-4768-b00f-f16e9795909e", 2024-09-15T23:23:20.638 INFO:teuthology.orchestra.run.smithi123.stdout: "options": "recursive" 2024-09-15T23:23:20.638 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:23:20.638 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:23:20.638 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:23:20.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.631+0000 7fef3720e640 1 -- 172.21.15.123:0/4151547690 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fef1c06c2b0 msgr2=0x7fef1c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:20.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.631+0000 7fef3720e640 1 --2- 172.21.15.123:0/4151547690 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fef1c06c2b0 0x7fef1c06e770 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fef301620d0 tx=0x7fef24009040 comp rx=0 tx=0).stop 2024-09-15T23:23:20.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.631+0000 7fef3720e640 1 -- 172.21.15.123:0/4151547690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef3006bfd0 msgr2=0x7fef301f5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:20.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.631+0000 7fef3720e640 1 --2- 172.21.15.123:0/4151547690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef3006bfd0 0x7fef301f5870 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 crypto rx=0x7fef2000d800 tx=0x7fef2000dcc0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.631+0000 7fef3720e640 1 -- 172.21.15.123:0/4151547690 shutdown_connections 2024-09-15T23:23:20.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.631+0000 7fef3720e640 1 --2- 172.21.15.123:0/4151547690 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fef300d3930 0x7fef300d2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.631+0000 7fef3720e640 1 --2- 172.21.15.123:0/4151547690 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fef300b3350 0x7fef301f46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.631+0000 7fef3720e640 1 --2- 172.21.15.123:0/4151547690 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fef1c06c2b0 0x7fef1c06e770 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.631+0000 7fef3720e640 1 --2- 172.21.15.123:0/4151547690 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fef3006bfd0 0x7fef301f5870 unknown :-1 s=CLOSED pgs=2279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:20.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.631+0000 7fef3720e640 1 -- 172.21.15.123:0/4151547690 >> 172.21.15.123:0/4151547690 conn(0x7fef300d11c0 msgr2=0x7fef300b7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:20.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.631+0000 7fef3720e640 1 -- 172.21.15.123:0/4151547690 shutdown_connections 2024-09-15T23:23:20.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:20.631+0000 7fef3720e640 1 -- 172.21.15.123:0/4151547690 wait complete. 2024-09-15T23:23:20.642 INFO:tasks.cephfs.filesystem:scrub status for tag:5b40f675-b932-4768-b00f-f16e9795909e - {'path': '~mds0', 'tag': '5b40f675-b932-4768-b00f-f16e9795909e', 'options': 'recursive'} 2024-09-15T23:23:40.606 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:23:40.609 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:23:50.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:23:50.644 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.13:0 scrub status 2024-09-15T23:23:50.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.760+0000 7fc861a3c640 1 Processor -- start 2024-09-15T23:23:50.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.760+0000 7fc861a3c640 1 -- start start 2024-09-15T23:23:50.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.760+0000 7fc861a3c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc85c15b7c0 0x7fc85c0b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.760+0000 7fc861a3c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc85c0cead0 0x7fc85c071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.760+0000 7fc861a3c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc85c0cf2e0 con 0x7fc85c0ccf30 2024-09-15T23:23:50.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.760+0000 7fc861a3c640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc85c070fe0 con 0x7fc85c0cead0 2024-09-15T23:23:50.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.760+0000 7fc861a3c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fc85c0712c0 con 0x7fc85c15b7c0 2024-09-15T23:23:50.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.761+0000 7fc85b7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc85c0cead0 0x7fc85c071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.761+0000 7fc85b7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc85c0cead0 0x7fc85c071ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48246/0 (socket says 172.21.15.123:48246) 2024-09-15T23:23:50.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.761+0000 7fc85b7fe640 1 -- 172.21.15.123:0/921051520 learned_addr learned my addr 172.21.15.123:0/921051520 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:50.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.761+0000 7fc8527fc640 1 --2- 172.21.15.123:0/921051520 >> v2:172.21.15.188:3300/0 conn(0x7fc85c15b7c0 0x7fc85c0b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.761+0000 7fc85b7fe640 1 -- 172.21.15.123:0/921051520 >> v2:172.21.15.188:3300/0 conn(0x7fc85c15b7c0 msgr2=0x7fc85c0b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:50.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.761+0000 7fc85b7fe640 1 --2- 172.21.15.123:0/921051520 >> v2:172.21.15.188:3300/0 conn(0x7fc85c15b7c0 0x7fc85c0b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.761+0000 7fc85b7fe640 1 -- 172.21.15.123:0/921051520 >> v1:172.21.15.188:6789/0 conn(0x7fc85c0ccf30 legacy=0x7fc85c0cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:50.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.761+0000 7fc85b7fe640 1 -- 172.21.15.123:0/921051520 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc85c0715a0 con 0x7fc85c0cead0 2024-09-15T23:23:50.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.762+0000 7fc85b7fe640 1 --2- 172.21.15.123:0/921051520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc85c0cead0 0x7fc85c071ac0 secure :-1 s=READY pgs=2284 cs=0 l=1 rev1=1 crypto rx=0x7fc85c06dc70 tx=0x7fc85402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e99cf09f5682acb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:50.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.762+0000 7fc85a7fc640 1 -- 172.21.15.123:0/921051520 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc854036070 con 0x7fc85c0cead0 2024-09-15T23:23:50.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.762+0000 7fc85a7fc640 1 -- 172.21.15.123:0/921051520 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc854031600 con 0x7fc85c0cead0 2024-09-15T23:23:50.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.762+0000 7fc85a7fc640 1 -- 172.21.15.123:0/921051520 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8540319d0 con 0x7fc85c0cead0 2024-09-15T23:23:50.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.762+0000 7fc861a3c640 1 -- 172.21.15.123:0/921051520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc85c0cead0 msgr2=0x7fc85c071ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:50.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.762+0000 7fc861a3c640 1 --2- 172.21.15.123:0/921051520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc85c0cead0 0x7fc85c071ac0 secure :-1 s=READY pgs=2284 cs=0 l=1 rev1=1 crypto rx=0x7fc85c06dc70 tx=0x7fc85402a660 comp rx=0 tx=0).stop 2024-09-15T23:23:50.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.762+0000 7fc861a3c640 1 -- 172.21.15.123:0/921051520 shutdown_connections 2024-09-15T23:23:50.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.762+0000 7fc861a3c640 1 --2- 172.21.15.123:0/921051520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc85c0cead0 0x7fc85c071ac0 unknown :-1 s=CLOSED pgs=2284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.762+0000 7fc861a3c640 1 --2- 172.21.15.123:0/921051520 >> v2:172.21.15.188:3300/0 conn(0x7fc85c15b7c0 0x7fc85c0b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.762+0000 7fc861a3c640 1 -- 172.21.15.123:0/921051520 >> 172.21.15.123:0/921051520 conn(0x7fc85c06d0f0 msgr2=0x7fc85c06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:50.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.762+0000 7fc861a3c640 1 -- 172.21.15.123:0/921051520 shutdown_connections 2024-09-15T23:23:50.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.763+0000 7fc861a3c640 1 -- 172.21.15.123:0/921051520 wait complete. 2024-09-15T23:23:50.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.764+0000 7fc861a3c640 1 Processor -- start 2024-09-15T23:23:50.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.764+0000 7fc861a3c640 1 -- start start 2024-09-15T23:23:50.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.765+0000 7fc861a3c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc85c0ccf30 0x7fc85c1519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.765+0000 7fc861a3c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc85c0cead0 0x7fc85c156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.765+0000 7fc861a3c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc85c15b7c0 0x7fc85c1434a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.765+0000 7fc861a3c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc85c0cf080 con 0x7fc85c15b7c0 2024-09-15T23:23:50.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.765+0000 7fc861a3c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc85c0cef00 con 0x7fc85c0cead0 2024-09-15T23:23:50.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.765+0000 7fc861a3c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc85c072000 con 0x7fc85c0ccf30 2024-09-15T23:23:50.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.765+0000 7fc85b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc85c15b7c0 0x7fc85c1434a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.765+0000 7fc85b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc85c15b7c0 0x7fc85c1434a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48248/0 (socket says 172.21.15.123:48248) 2024-09-15T23:23:50.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.765+0000 7fc85b7fe640 1 -- 172.21.15.123:0/1348782745 learned_addr learned my addr 172.21.15.123:0/1348782745 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:50.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.765+0000 7fc8527fc640 1 --2- 172.21.15.123:0/1348782745 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc85c0cead0 0x7fc85c156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.765+0000 7fc85affd640 1 --2- 172.21.15.123:0/1348782745 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc85c0ccf30 0x7fc85c1519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.765+0000 7fc85b7fe640 1 -- 172.21.15.123:0/1348782745 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc85c0ccf30 msgr2=0x7fc85c1519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:50.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.765+0000 7fc85b7fe640 1 --2- 172.21.15.123:0/1348782745 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc85c0ccf30 0x7fc85c1519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.765+0000 7fc85b7fe640 1 -- 172.21.15.123:0/1348782745 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc85c0cead0 msgr2=0x7fc85c156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:50.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.765+0000 7fc85b7fe640 1 --2- 172.21.15.123:0/1348782745 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc85c0cead0 0x7fc85c156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.765+0000 7fc85b7fe640 1 -- 172.21.15.123:0/1348782745 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc85c1571d0 con 0x7fc85c15b7c0 2024-09-15T23:23:50.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.765+0000 7fc85b7fe640 1 --2- 172.21.15.123:0/1348782745 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc85c15b7c0 0x7fc85c1434a0 secure :-1 s=READY pgs=2285 cs=0 l=1 rev1=1 crypto rx=0x7fc854009f40 tx=0x7fc854004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:50.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.765+0000 7fc858ff9640 1 -- 172.21.15.123:0/1348782745 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc854041020 con 0x7fc85c15b7c0 2024-09-15T23:23:50.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.766+0000 7fc858ff9640 1 -- 172.21.15.123:0/1348782745 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc854007780 con 0x7fc85c15b7c0 2024-09-15T23:23:50.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.766+0000 7fc858ff9640 1 -- 172.21.15.123:0/1348782745 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc854036040 con 0x7fc85c15b7c0 2024-09-15T23:23:50.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.766+0000 7fc861a3c640 1 -- 172.21.15.123:0/1348782745 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc85c150940 con 0x7fc85c15b7c0 2024-09-15T23:23:50.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.766+0000 7fc861a3c640 1 -- 172.21.15.123:0/1348782745 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc85c150f00 con 0x7fc85c15b7c0 2024-09-15T23:23:50.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.767+0000 7fc858ff9640 1 -- 172.21.15.123:0/1348782745 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc854044020 con 0x7fc85c15b7c0 2024-09-15T23:23:50.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.768+0000 7fc858ff9640 1 --2- 172.21.15.123:0/1348782745 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc83c06c2b0 0x7fc83c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.768+0000 7fc858ff9640 1 -- 172.21.15.123:0/1348782745 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7fc8540ac060 con 0x7fc85c15b7c0 2024-09-15T23:23:50.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.768+0000 7fc85affd640 1 --2- 172.21.15.123:0/1348782745 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc83c06c2b0 0x7fc83c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.768+0000 7fc85affd640 1 --2- 172.21.15.123:0/1348782745 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc83c06c2b0 0x7fc83c06e770 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fc84c004f60 tx=0x7fc84c007e30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:50.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.769+0000 7fc8647d5740 1 Processor -- start 2024-09-15T23:23:50.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.769+0000 7fc8647d5740 1 -- start start 2024-09-15T23:23:50.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.770+0000 7fc8647d5740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f495207780 0x55f495207b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.770+0000 7fc8647d5740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f495222140 0x55f4952238f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.770+0000 7fc8647d5740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f4951db0e0 0x55f495223e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.770+0000 7fc8647d5740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55f4951406f0 con 0x55f4951db0e0 2024-09-15T23:23:50.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.770+0000 7fc8647d5740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55f4950e8330 con 0x55f495222140 2024-09-15T23:23:50.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.770+0000 7fc8647d5740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55f49513c6b0 con 0x55f495207780 2024-09-15T23:23:50.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.770+0000 7fc85b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f4951db0e0 0x55f495223e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.770+0000 7fc85affd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f495207780 0x55f495207b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.770+0000 7fc85b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f4951db0e0 0x55f495223e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48250/0 (socket says 172.21.15.123:48250) 2024-09-15T23:23:50.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.770+0000 7fc85b7fe640 1 -- 172.21.15.123:0/608944597 learned_addr learned my addr 172.21.15.123:0/608944597 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:50.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.770+0000 7fc8527fc640 1 --2- 172.21.15.123:0/608944597 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f495222140 0x55f4952238f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.770+0000 7fc85b7fe640 1 -- 172.21.15.123:0/608944597 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f495207780 msgr2=0x55f495207b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:50.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.770+0000 7fc85b7fe640 1 --2- 172.21.15.123:0/608944597 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f495207780 0x55f495207b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.770+0000 7fc85b7fe640 1 -- 172.21.15.123:0/608944597 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f495222140 msgr2=0x55f4952238f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:50.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.770+0000 7fc85b7fe640 1 --2- 172.21.15.123:0/608944597 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f495222140 0x55f4952238f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.770+0000 7fc85b7fe640 1 -- 172.21.15.123:0/608944597 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f49510e0d0 con 0x55f4951db0e0 2024-09-15T23:23:50.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.770+0000 7fc85b7fe640 1 --2- 172.21.15.123:0/608944597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f4951db0e0 0x55f495223e30 secure :-1 s=READY pgs=2286 cs=0 l=1 rev1=1 crypto rx=0x7fc8540aa5b0 tx=0x7fc854009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c217f669de088e93 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:50.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.770+0000 7fc8517fa640 1 -- 172.21.15.123:0/608944597 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8540a8070 con 0x55f4951db0e0 2024-09-15T23:23:50.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.770+0000 7fc8517fa640 1 -- 172.21.15.123:0/608944597 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc85407e3f0 con 0x55f4951db0e0 2024-09-15T23:23:50.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.770+0000 7fc8517fa640 1 -- 172.21.15.123:0/608944597 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc854082cb0 con 0x55f4951db0e0 2024-09-15T23:23:50.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.771+0000 7fc8647d5740 1 -- 172.21.15.123:0/608944597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f4951db0e0 msgr2=0x55f495223e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:50.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.771+0000 7fc8647d5740 1 --2- 172.21.15.123:0/608944597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f4951db0e0 0x55f495223e30 secure :-1 s=READY pgs=2286 cs=0 l=1 rev1=1 crypto rx=0x7fc8540aa5b0 tx=0x7fc854009510 comp rx=0 tx=0).stop 2024-09-15T23:23:50.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.771+0000 7fc8647d5740 1 -- 172.21.15.123:0/608944597 shutdown_connections 2024-09-15T23:23:50.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.771+0000 7fc8647d5740 1 --2- 172.21.15.123:0/608944597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f4951db0e0 0x55f495223e30 unknown :-1 s=CLOSED pgs=2286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.771+0000 7fc8647d5740 1 --2- 172.21.15.123:0/608944597 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f495222140 0x55f4952238f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.771+0000 7fc8647d5740 1 --2- 172.21.15.123:0/608944597 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f495207780 0x55f495207b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.771+0000 7fc8647d5740 1 -- 172.21.15.123:0/608944597 >> 172.21.15.123:0/608944597 conn(0x55f4951da370 msgr2=0x55f495222590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:50.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.771+0000 7fc8647d5740 1 -- 172.21.15.123:0/608944597 shutdown_connections 2024-09-15T23:23:50.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.771+0000 7fc8647d5740 1 -- 172.21.15.123:0/608944597 wait complete. 2024-09-15T23:23:50.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.772+0000 7fc8647d5740 1 -- start start 2024-09-15T23:23:50.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.772+0000 7fc8647d5740 1 Processor -- start 2024-09-15T23:23:50.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.773+0000 7fc8647d5740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f495207780 0x55f49521f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.773+0000 7fc8647d5740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f495222140 0x55f49521d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.773+0000 7fc8647d5740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f49520a100 0x55f49521dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.773+0000 7fc8647d5740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55f4951406f0 con 0x55f495222140 2024-09-15T23:23:50.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.773+0000 7fc8647d5740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55f4950c94f0 con 0x55f495207780 2024-09-15T23:23:50.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.773+0000 7fc8647d5740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55f495208540 con 0x55f49520a100 2024-09-15T23:23:50.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.773+0000 7fc8647d5740 10 client.0 _ll_register_callbacks cb 0x55f4950eab50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:23:50.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.773+0000 7fc8527fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f495222140 0x55f49521d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.773+0000 7fc8527fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f495222140 0x55f49521d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48258/0 (socket says 172.21.15.123:48258) 2024-09-15T23:23:50.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.773+0000 7fc8527fc640 1 -- 172.21.15.123:0/3088829617 learned_addr learned my addr 172.21.15.123:0/3088829617 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:50.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.773+0000 7fc85affd640 1 --2- 172.21.15.123:0/3088829617 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f495207780 0x55f49521f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.773+0000 7fc85b7fe640 1 --2- 172.21.15.123:0/3088829617 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f49520a100 0x55f49521dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.773+0000 7fc8527fc640 1 -- 172.21.15.123:0/3088829617 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f49520a100 msgr2=0x55f49521dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:50.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.773+0000 7fc8527fc640 1 --2- 172.21.15.123:0/3088829617 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f49520a100 0x55f49521dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.773+0000 7fc8527fc640 1 -- 172.21.15.123:0/3088829617 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f495207780 msgr2=0x55f49521f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:50.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.773+0000 7fc8527fc640 1 --2- 172.21.15.123:0/3088829617 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f495207780 0x55f49521f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.773+0000 7fc8527fc640 1 -- 172.21.15.123:0/3088829617 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f494f1d7d0 con 0x55f495222140 2024-09-15T23:23:50.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.773+0000 7fc85b7fe640 1 --2- 172.21.15.123:0/3088829617 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f49520a100 0x55f49521dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:23:50.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.773+0000 7fc8527fc640 1 --2- 172.21.15.123:0/3088829617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f495222140 0x55f49521d840 secure :-1 s=READY pgs=2287 cs=0 l=1 rev1=1 crypto rx=0x7fc844013620 tx=0x7fc844013a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e28065fd2df691 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:50.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.773+0000 7fc83a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:23:50.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.773+0000 7fc83a7fc640 1 -- 172.21.15.123:0/3088829617 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc844004300 con 0x55f495222140 2024-09-15T23:23:50.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.774+0000 7fc83a7fc640 1 -- 172.21.15.123:0/3088829617 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7fc844003610 con 0x55f495222140 2024-09-15T23:23:50.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.774+0000 7fc8647d5740 1 -- 172.21.15.123:0/3088829617 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc85407e3f0 con 0x55f495222140 2024-09-15T23:23:50.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.774+0000 7fc83a7fc640 1 -- 172.21.15.123:0/3088829617 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=120) ==== 24+0+0 (secure 0 0 0) 0x7fc8440044a0 con 0x55f495222140 2024-09-15T23:23:50.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.774+0000 7fc8647d5740 10 client.10731 fetch_fsmap learned FSMap version 120 2024-09-15T23:23:50.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.774+0000 7fc8647d5740 1 -- 172.21.15.123:0/3088829617 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=120,monmap=2+}) -- 0x55f494e533f0 con 0x55f495222140 2024-09-15T23:23:50.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.774+0000 7fc83a7fc640 1 -- 172.21.15.123:0/3088829617 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc85407e3f0 con 0x55f495222140 2024-09-15T23:23:50.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.774+0000 7fc83a7fc640 1 -- 172.21.15.123:0/3088829617 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 120) ==== 3502+0+0 (secure 0 0 0) 0x7fc844028080 con 0x55f495222140 2024-09-15T23:23:50.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.774+0000 7fc8647d5740 10 client.10731 fetch_fsmap finished waiting for FSMap version 120 2024-09-15T23:23:50.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.774+0000 7fc8647d5740 10 client.10731 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-09-15T23:23:50.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.774+0000 7fc8647d5740 20 client.10731 populate_metadata read hostname 'smithi123' 2024-09-15T23:23:50.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.774+0000 7fc8647d5740 1 --2- 172.21.15.123:0/3088829617 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x55f49521e2c0 0x55f4951dc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.774+0000 7fc8647d5740 4 client.10731 mds_command: new command op to 10491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:23:50.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.774+0000 7fc8647d5740 1 -- 172.21.15.123:0/3088829617 --> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f49514de20 con 0x55f49521e2c0 2024-09-15T23:23:50.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.774+0000 7fc85affd640 1 --2- 172.21.15.123:0/3088829617 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x55f49521e2c0 0x55f4951dc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.774+0000 7fc83a7fc640 10 client.10731 ms_handle_connect on v2:172.21.15.123:6834/2653908784 2024-09-15T23:23:50.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.774+0000 7fc85affd640 1 --2- 172.21.15.123:0/3088829617 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x55f49521e2c0 0x55f4951dc700 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3f6f5e2c538b059 server_cookie=54a5c874cd812e3f in_seq=0 out_seq=0 2024-09-15T23:23:50.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.775+0000 7fc83a7fc640 1 -- 172.21.15.123:0/3088829617 <== mds.0 v2:172.21.15.123:6834/2653908784 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f49514de20 con 0x55f49521e2c0 2024-09-15T23:23:50.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.775+0000 7fc83a7fc640 10 client.10731 handle_command_reply: tid=0 2024-09-15T23:23:50.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.775+0000 7fc8647d5740 1 client.10731 shutdown 2024-09-15T23:23:50.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.775+0000 7fc8647d5740 1 -- 172.21.15.123:0/3088829617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f495222140 msgr2=0x55f49521d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:50.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.775+0000 7fc8647d5740 1 --2- 172.21.15.123:0/3088829617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f495222140 0x55f49521d840 secure :-1 s=READY pgs=2287 cs=0 l=1 rev1=1 crypto rx=0x7fc844013620 tx=0x7fc844013a20 comp rx=0 tx=0).stop 2024-09-15T23:23:50.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.775+0000 7fc8647d5740 1 -- 172.21.15.123:0/3088829617 shutdown_connections 2024-09-15T23:23:50.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.775+0000 7fc8647d5740 1 --2- 172.21.15.123:0/3088829617 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x55f49521e2c0 0x55f4951dc700 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.775+0000 7fc8647d5740 1 --2- 172.21.15.123:0/3088829617 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f49520a100 0x55f49521dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.775+0000 7fc8647d5740 1 --2- 172.21.15.123:0/3088829617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f495222140 0x55f49521d840 unknown :-1 s=CLOSED pgs=2287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.775+0000 7fc83a7fc640 0 client.10731 ms_handle_reset on v2:172.21.15.123:6834/2653908784 2024-09-15T23:23:50.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.775+0000 7fc8647d5740 1 --2- 172.21.15.123:0/3088829617 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f495207780 0x55f49521f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.775+0000 7fc8647d5740 1 -- 172.21.15.123:0/3088829617 >> 172.21.15.123:0/3088829617 conn(0x55f4951db0e0 msgr2=0x55f4951d70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:50.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.775+0000 7fc8647d5740 1 -- 172.21.15.123:0/3088829617 shutdown_connections 2024-09-15T23:23:50.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.775+0000 7fc8647d5740 1 -- 172.21.15.123:0/3088829617 wait complete. 2024-09-15T23:23:50.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.775+0000 7fc8647d5740 20 client.10731 trim_cache size 0 max 16384 2024-09-15T23:23:50.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.793+0000 7fc8647d5740 1 Processor -- start 2024-09-15T23:23:50.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.793+0000 7fc8647d5740 1 -- start start 2024-09-15T23:23:50.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.794+0000 7fc8647d5740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f495207780 0x55f495249cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.794+0000 7fc8647d5740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f49520a100 0x55f49521ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.794+0000 7fc8647d5740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f495222140 0x55f49521f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.794+0000 7fc8647d5740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc85c14fab0 con 0x55f495207780 2024-09-15T23:23:50.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.794+0000 7fc8647d5740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc85c168280 con 0x55f495222140 2024-09-15T23:23:50.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.794+0000 7fc8647d5740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc85c1675e0 con 0x55f49520a100 2024-09-15T23:23:50.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.794+0000 7fc85affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f495207780 0x55f495249cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.794+0000 7fc85affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f495207780 0x55f495249cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48272/0 (socket says 172.21.15.123:48272) 2024-09-15T23:23:50.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.794+0000 7fc85affd640 1 -- 172.21.15.123:0/3060624081 learned_addr learned my addr 172.21.15.123:0/3060624081 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:50.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.795+0000 7fc85affd640 1 -- 172.21.15.123:0/3060624081 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f49520a100 msgr2=0x55f49521ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:50.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.795+0000 7fc85affd640 1 --2- 172.21.15.123:0/3060624081 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f49520a100 0x55f49521ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.795+0000 7fc85affd640 1 -- 172.21.15.123:0/3060624081 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f495222140 msgr2=0x55f49521f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:50.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.795+0000 7fc85b7fe640 1 --2- 172.21.15.123:0/3060624081 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f495222140 0x55f49521f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.795+0000 7fc85affd640 1 --2- 172.21.15.123:0/3060624081 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f495222140 0x55f49521f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.795+0000 7fc85affd640 1 -- 172.21.15.123:0/3060624081 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f494e130f0 con 0x55f495207780 2024-09-15T23:23:50.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.795+0000 7fc85b7fe640 1 --2- 172.21.15.123:0/3060624081 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f495222140 0x55f49521f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:23:50.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.795+0000 7fc85affd640 1 --2- 172.21.15.123:0/3060624081 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f495207780 0x55f495249cb0 secure :-1 s=READY pgs=2288 cs=0 l=1 rev1=1 crypto rx=0x7fc84c00f900 tx=0x7fc84c00a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a432ac93684488 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:50.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.795+0000 7fc850ff9640 1 -- 172.21.15.123:0/3060624081 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84c0043f0 con 0x55f495207780 2024-09-15T23:23:50.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.795+0000 7fc850ff9640 1 -- 172.21.15.123:0/3060624081 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc84c01b040 con 0x55f495207780 2024-09-15T23:23:50.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.795+0000 7fc850ff9640 1 -- 172.21.15.123:0/3060624081 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84c004590 con 0x55f495207780 2024-09-15T23:23:50.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.796+0000 7fc8647d5740 1 -- 172.21.15.123:0/3060624081 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f495207780 msgr2=0x55f495249cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:50.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.796+0000 7fc8647d5740 1 --2- 172.21.15.123:0/3060624081 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f495207780 0x55f495249cb0 secure :-1 s=READY pgs=2288 cs=0 l=1 rev1=1 crypto rx=0x7fc84c00f900 tx=0x7fc84c00a000 comp rx=0 tx=0).stop 2024-09-15T23:23:50.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.796+0000 7fc8647d5740 1 -- 172.21.15.123:0/3060624081 shutdown_connections 2024-09-15T23:23:50.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.796+0000 7fc8647d5740 1 --2- 172.21.15.123:0/3060624081 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f495222140 0x55f49521f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.796+0000 7fc8647d5740 1 --2- 172.21.15.123:0/3060624081 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f49520a100 0x55f49521ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.796+0000 7fc8647d5740 1 --2- 172.21.15.123:0/3060624081 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f495207780 0x55f495249cb0 unknown :-1 s=CLOSED pgs=2288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.796+0000 7fc8647d5740 1 -- 172.21.15.123:0/3060624081 >> 172.21.15.123:0/3060624081 conn(0x55f4951db0e0 msgr2=0x55f495222520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:50.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.796+0000 7fc8647d5740 1 -- 172.21.15.123:0/3060624081 shutdown_connections 2024-09-15T23:23:50.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.796+0000 7fc8647d5740 1 -- 172.21.15.123:0/3060624081 wait complete. 2024-09-15T23:23:50.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.796+0000 7fc8647d5740 1 -- start start 2024-09-15T23:23:50.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.796+0000 7fc8647d5740 1 Processor -- start 2024-09-15T23:23:50.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.797+0000 7fc8647d5740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f495207780 0x55f495238fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.797+0000 7fc8647d5740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f49520a100 0x55f49528aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.797+0000 7fc8647d5740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f495222140 0x55f4952a8e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.797+0000 7fc8647d5740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc85c167c30 con 0x55f49520a100 2024-09-15T23:23:50.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.797+0000 7fc8647d5740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55f4951dada0 con 0x55f495207780 2024-09-15T23:23:50.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.797+0000 7fc8647d5740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55f4952399e0 con 0x55f495222140 2024-09-15T23:23:50.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.797+0000 7fc8647d5740 10 client.0 _ll_register_callbacks cb 0x7fc8440075e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:23:50.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.797+0000 7fc8527fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f49520a100 0x55f49528aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.797+0000 7fc8527fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f49520a100 0x55f49528aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48274/0 (socket says 172.21.15.123:48274) 2024-09-15T23:23:50.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.797+0000 7fc8527fc640 1 -- 172.21.15.123:0/710112351 learned_addr learned my addr 172.21.15.123:0/710112351 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:50.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.797+0000 7fc85affd640 1 --2- 172.21.15.123:0/710112351 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f495207780 0x55f495238fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.797+0000 7fc85b7fe640 1 --2- 172.21.15.123:0/710112351 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f495222140 0x55f4952a8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.797+0000 7fc8527fc640 1 -- 172.21.15.123:0/710112351 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f495222140 msgr2=0x55f4952a8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:50.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.797+0000 7fc8527fc640 1 --2- 172.21.15.123:0/710112351 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f495222140 0x55f4952a8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.797+0000 7fc8527fc640 1 -- 172.21.15.123:0/710112351 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f495207780 msgr2=0x55f495238fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:50.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.797+0000 7fc8527fc640 1 --2- 172.21.15.123:0/710112351 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f495207780 0x55f495238fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.797+0000 7fc8527fc640 1 -- 172.21.15.123:0/710112351 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f495239510 con 0x55f49520a100 2024-09-15T23:23:50.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.797+0000 7fc85affd640 1 --2- 172.21.15.123:0/710112351 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f495207780 0x55f495238fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:23:50.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.798+0000 7fc8527fc640 1 --2- 172.21.15.123:0/710112351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f49520a100 0x55f49528aec0 secure :-1 s=READY pgs=2289 cs=0 l=1 rev1=1 crypto rx=0x7fc844000c00 tx=0x7fc844004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b05970c7be93723f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:50.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.798+0000 7fc83a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:23:50.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.798+0000 7fc83a7fc640 1 -- 172.21.15.123:0/710112351 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc844004300 con 0x55f49520a100 2024-09-15T23:23:50.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.798+0000 7fc83a7fc640 1 -- 172.21.15.123:0/710112351 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7fc844031aa0 con 0x55f49520a100 2024-09-15T23:23:50.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.798+0000 7fc8647d5740 1 -- 172.21.15.123:0/710112351 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc84c01b040 con 0x55f49520a100 2024-09-15T23:23:50.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.798+0000 7fc83a7fc640 1 -- 172.21.15.123:0/710112351 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=120) ==== 24+0+0 (secure 0 0 0) 0x7fc844031ca0 con 0x55f49520a100 2024-09-15T23:23:50.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.798+0000 7fc8647d5740 10 client.10737 fetch_fsmap learned FSMap version 120 2024-09-15T23:23:50.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.798+0000 7fc8647d5740 1 -- 172.21.15.123:0/710112351 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=120,monmap=2+}) -- 0x55f495223ec0 con 0x55f49520a100 2024-09-15T23:23:50.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.798+0000 7fc83a7fc640 1 -- 172.21.15.123:0/710112351 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc84c01b040 con 0x55f49520a100 2024-09-15T23:23:50.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.798+0000 7fc83a7fc640 1 -- 172.21.15.123:0/710112351 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 120) ==== 3502+0+0 (secure 0 0 0) 0x7fc844038050 con 0x55f49520a100 2024-09-15T23:23:50.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.798+0000 7fc8647d5740 10 client.10737 fetch_fsmap finished waiting for FSMap version 120 2024-09-15T23:23:50.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.798+0000 7fc8647d5740 10 client.10737 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-09-15T23:23:50.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.798+0000 7fc8647d5740 20 client.10737 populate_metadata read hostname 'smithi123' 2024-09-15T23:23:50.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.798+0000 7fc8647d5740 1 --2- 172.21.15.123:0/710112351 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x55f4952a9380 0x55f49521eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.798+0000 7fc8647d5740 4 client.10737 mds_command: new command op to 10491 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:23:50.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.798+0000 7fc8647d5740 1 -- 172.21.15.123:0/710112351 --> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f495148170 con 0x55f4952a9380 2024-09-15T23:23:50.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.798+0000 7fc85affd640 1 --2- 172.21.15.123:0/710112351 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x55f4952a9380 0x55f49521eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.799+0000 7fc83a7fc640 10 client.10737 ms_handle_connect on v2:172.21.15.123:6834/2653908784 2024-09-15T23:23:50.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.799+0000 7fc85affd640 1 --2- 172.21.15.123:0/710112351 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x55f4952a9380 0x55f49521eae0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8f49d664344101a server_cookie=503dae88c225e782 in_seq=0 out_seq=0 2024-09-15T23:23:50.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.799+0000 7fc83a7fc640 1 -- 172.21.15.123:0/710112351 <== mds.0 v2:172.21.15.123:6834/2653908784 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55f495148170 con 0x55f4952a9380 2024-09-15T23:23:50.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.799+0000 7fc83a7fc640 10 client.10737 handle_command_reply: tid=0 2024-09-15T23:23:50.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.799+0000 7fc8647d5740 1 client.10737 shutdown 2024-09-15T23:23:50.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.799+0000 7fc8647d5740 1 -- 172.21.15.123:0/710112351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f49520a100 msgr2=0x55f49528aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:50.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.799+0000 7fc8647d5740 1 --2- 172.21.15.123:0/710112351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f49520a100 0x55f49528aec0 secure :-1 s=READY pgs=2289 cs=0 l=1 rev1=1 crypto rx=0x7fc844000c00 tx=0x7fc844004730 comp rx=0 tx=0).stop 2024-09-15T23:23:50.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.799+0000 7fc8647d5740 1 -- 172.21.15.123:0/710112351 shutdown_connections 2024-09-15T23:23:50.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.799+0000 7fc8647d5740 1 --2- 172.21.15.123:0/710112351 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x55f4952a9380 0x55f49521eae0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.799+0000 7fc8647d5740 1 --2- 172.21.15.123:0/710112351 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f495222140 0x55f4952a8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.799+0000 7fc8647d5740 1 --2- 172.21.15.123:0/710112351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f49520a100 0x55f49528aec0 unknown :-1 s=CLOSED pgs=2289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.799+0000 7fc83a7fc640 0 client.10737 ms_handle_reset on v2:172.21.15.123:6834/2653908784 2024-09-15T23:23:50.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.799+0000 7fc8647d5740 1 --2- 172.21.15.123:0/710112351 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f495207780 0x55f495238fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.799+0000 7fc8647d5740 1 -- 172.21.15.123:0/710112351 >> 172.21.15.123:0/710112351 conn(0x55f4951db0e0 msgr2=0x55f4951dc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:50.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.799+0000 7fc8647d5740 1 -- 172.21.15.123:0/710112351 shutdown_connections 2024-09-15T23:23:50.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.799+0000 7fc8647d5740 1 -- 172.21.15.123:0/710112351 wait complete. 2024-09-15T23:23:50.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.799+0000 7fc8647d5740 20 client.10737 trim_cache size 0 max 16384 2024-09-15T23:23:50.808 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:23:50.808 INFO:teuthology.orchestra.run.smithi123.stdout: "status": "no active scrubs running", 2024-09-15T23:23:50.808 INFO:teuthology.orchestra.run.smithi123.stdout: "scrubs": {} 2024-09-15T23:23:50.808 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:23:50.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.800+0000 7fc861a3c640 1 -- 172.21.15.123:0/1348782745 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc83c06c2b0 msgr2=0x7fc83c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:50.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.800+0000 7fc861a3c640 1 --2- 172.21.15.123:0/1348782745 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc83c06c2b0 0x7fc83c06e770 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fc84c004f60 tx=0x7fc84c007e30 comp rx=0 tx=0).stop 2024-09-15T23:23:50.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.800+0000 7fc861a3c640 1 -- 172.21.15.123:0/1348782745 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc85c15b7c0 msgr2=0x7fc85c1434a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:50.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.800+0000 7fc861a3c640 1 --2- 172.21.15.123:0/1348782745 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc85c15b7c0 0x7fc85c1434a0 secure :-1 s=READY pgs=2285 cs=0 l=1 rev1=1 crypto rx=0x7fc854009f40 tx=0x7fc854004a40 comp rx=0 tx=0).stop 2024-09-15T23:23:50.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.800+0000 7fc861a3c640 1 -- 172.21.15.123:0/1348782745 shutdown_connections 2024-09-15T23:23:50.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.800+0000 7fc861a3c640 1 --2- 172.21.15.123:0/1348782745 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc83c06c2b0 0x7fc83c06e770 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.800+0000 7fc861a3c640 1 --2- 172.21.15.123:0/1348782745 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc85c15b7c0 0x7fc85c1434a0 unknown :-1 s=CLOSED pgs=2285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.800+0000 7fc861a3c640 1 --2- 172.21.15.123:0/1348782745 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc85c0cead0 0x7fc85c156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.800+0000 7fc861a3c640 1 --2- 172.21.15.123:0/1348782745 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc85c0ccf30 0x7fc85c1519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.800+0000 7fc861a3c640 1 -- 172.21.15.123:0/1348782745 >> 172.21.15.123:0/1348782745 conn(0x7fc85c06d0f0 msgr2=0x7fc85c14e390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:50.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.800+0000 7fc861a3c640 1 -- 172.21.15.123:0/1348782745 shutdown_connections 2024-09-15T23:23:50.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.800+0000 7fc861a3c640 1 -- 172.21.15.123:0/1348782745 wait complete. 2024-09-15T23:23:50.812 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T23:23:50.812 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 damage ls 2024-09-15T23:23:50.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.912+0000 7f6a61853640 1 Processor -- start 2024-09-15T23:23:50.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.912+0000 7f6a61853640 1 -- start start 2024-09-15T23:23:50.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.913+0000 7f6a61853640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6a5c06bfd0 0x7f6a5c06c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.913+0000 7f6a61853640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f6a5c0b3350 0x7f6a5c1623a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.913+0000 7f6a61853640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a5c06c8f0 con 0x7f6a5c0b38a0 2024-09-15T23:23:50.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.913+0000 7f6a61853640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f6a5c0b78a0 con 0x7f6a5c06bfd0 2024-09-15T23:23:50.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.913+0000 7f6a61853640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f6a5c0cffb0 con 0x7f6a5c0b3350 2024-09-15T23:23:50.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.913+0000 7f6a5affd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6a5c06bfd0 0x7f6a5c06c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.913+0000 7f6a5affd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6a5c06bfd0 0x7f6a5c06c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48284/0 (socket says 172.21.15.123:48284) 2024-09-15T23:23:50.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.913+0000 7f6a5affd640 1 -- 172.21.15.123:0/662492913 learned_addr learned my addr 172.21.15.123:0/662492913 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:50.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.913+0000 7f6a5a7fc640 1 --2- 172.21.15.123:0/662492913 >> v2:172.21.15.188:3300/0 conn(0x7f6a5c0b3350 0x7f6a5c1623a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.913+0000 7f6a5affd640 1 -- 172.21.15.123:0/662492913 >> v2:172.21.15.188:3300/0 conn(0x7f6a5c0b3350 msgr2=0x7f6a5c1623a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:50.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.913+0000 7f6a5affd640 1 --2- 172.21.15.123:0/662492913 >> v2:172.21.15.188:3300/0 conn(0x7f6a5c0b3350 0x7f6a5c1623a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.913+0000 7f6a5affd640 1 -- 172.21.15.123:0/662492913 >> v1:172.21.15.188:6789/0 conn(0x7f6a5c0b38a0 legacy=0x7f6a5c1628e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:50.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.914+0000 7f6a5affd640 1 -- 172.21.15.123:0/662492913 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a5c0cf710 con 0x7f6a5c06bfd0 2024-09-15T23:23:50.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.914+0000 7f6a5affd640 1 --2- 172.21.15.123:0/662492913 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a5c06bfd0 0x7f6a5c06c3b0 secure :-1 s=READY pgs=2290 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c0d05e0 tx=0x7f6a5402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c405797d76de1a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:50.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.914+0000 7f6a59ffb640 1 -- 172.21.15.123:0/662492913 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a54037070 con 0x7f6a5c06bfd0 2024-09-15T23:23:50.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.914+0000 7f6a59ffb640 1 -- 172.21.15.123:0/662492913 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a54032640 con 0x7f6a5c06bfd0 2024-09-15T23:23:50.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.914+0000 7f6a59ffb640 1 -- 172.21.15.123:0/662492913 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a54032a10 con 0x7f6a5c06bfd0 2024-09-15T23:23:50.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.915+0000 7f6a61853640 1 -- 172.21.15.123:0/662492913 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a5c06bfd0 msgr2=0x7f6a5c06c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:50.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.915+0000 7f6a61853640 1 --2- 172.21.15.123:0/662492913 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a5c06bfd0 0x7f6a5c06c3b0 secure :-1 s=READY pgs=2290 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c0d05e0 tx=0x7f6a5402a300 comp rx=0 tx=0).stop 2024-09-15T23:23:50.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.915+0000 7f6a61853640 1 -- 172.21.15.123:0/662492913 shutdown_connections 2024-09-15T23:23:50.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.915+0000 7f6a61853640 1 --2- 172.21.15.123:0/662492913 >> v2:172.21.15.188:3300/0 conn(0x7f6a5c0b3350 0x7f6a5c1623a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.915+0000 7f6a61853640 1 --2- 172.21.15.123:0/662492913 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a5c06bfd0 0x7f6a5c06c3b0 unknown :-1 s=CLOSED pgs=2290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.915+0000 7f6a61853640 1 -- 172.21.15.123:0/662492913 >> 172.21.15.123:0/662492913 conn(0x7f6a5c0d11c0 msgr2=0x7f6a5c0d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:50.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.915+0000 7f6a61853640 1 -- 172.21.15.123:0/662492913 shutdown_connections 2024-09-15T23:23:50.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.915+0000 7f6a61853640 1 -- 172.21.15.123:0/662492913 wait complete. 2024-09-15T23:23:50.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.916+0000 7f6a61853640 1 Processor -- start 2024-09-15T23:23:50.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.916+0000 7f6a61853640 1 -- start start 2024-09-15T23:23:50.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.917+0000 7f6a61853640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a5c06bfd0 0x7f6a5c156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.917+0000 7f6a61853640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a5c0b3350 0x7f6a5c0ce310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.917+0000 7f6a61853640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a5c0b38a0 0x7f6a5c0d2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.917+0000 7f6a61853640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5c0d2400 con 0x7f6a5c0b3350 2024-09-15T23:23:50.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.917+0000 7f6a61853640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5c0cfcd0 con 0x7f6a5c06bfd0 2024-09-15T23:23:50.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.917+0000 7f6a61853640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6a5c06cd50 con 0x7f6a5c0b38a0 2024-09-15T23:23:50.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.917+0000 7f6a5a7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a5c0b3350 0x7f6a5c0ce310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.917+0000 7f6a5a7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a5c0b3350 0x7f6a5c0ce310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48286/0 (socket says 172.21.15.123:48286) 2024-09-15T23:23:50.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.917+0000 7f6a5a7fc640 1 -- 172.21.15.123:0/1005195174 learned_addr learned my addr 172.21.15.123:0/1005195174 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:50.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.917+0000 7f6a5a7fc640 1 -- 172.21.15.123:0/1005195174 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a5c0b38a0 msgr2=0x7f6a5c0d2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:50.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.917+0000 7f6a5a7fc640 1 --2- 172.21.15.123:0/1005195174 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a5c0b38a0 0x7f6a5c0d2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.917+0000 7f6a5affd640 1 --2- 172.21.15.123:0/1005195174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a5c06bfd0 0x7f6a5c156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.917+0000 7f6a5a7fc640 1 -- 172.21.15.123:0/1005195174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a5c06bfd0 msgr2=0x7f6a5c156fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:50.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.917+0000 7f6a5a7fc640 1 --2- 172.21.15.123:0/1005195174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a5c06bfd0 0x7f6a5c156fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.917+0000 7f6a5a7fc640 1 -- 172.21.15.123:0/1005195174 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a5c0ccfd0 con 0x7f6a5c0b3350 2024-09-15T23:23:50.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.918+0000 7f6a5a7fc640 1 --2- 172.21.15.123:0/1005195174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a5c0b3350 0x7f6a5c0ce310 secure :-1 s=READY pgs=2291 cs=0 l=1 rev1=1 crypto rx=0x7f6a4400ce10 tx=0x7f6a4400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:50.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.918+0000 7f6a53fff640 1 -- 172.21.15.123:0/1005195174 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a44003b90 con 0x7f6a5c0b3350 2024-09-15T23:23:50.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.918+0000 7f6a53fff640 1 -- 172.21.15.123:0/1005195174 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a44003d30 con 0x7f6a5c0b3350 2024-09-15T23:23:50.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.918+0000 7f6a53fff640 1 -- 172.21.15.123:0/1005195174 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a44004240 con 0x7f6a5c0b3350 2024-09-15T23:23:50.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.918+0000 7f6a61853640 1 -- 172.21.15.123:0/1005195174 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a5c0cd270 con 0x7f6a5c0b3350 2024-09-15T23:23:50.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.918+0000 7f6a61853640 1 -- 172.21.15.123:0/1005195174 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a5c0cdb10 con 0x7f6a5c0b3350 2024-09-15T23:23:50.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.919+0000 7f6a53fff640 1 -- 172.21.15.123:0/1005195174 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6a440043e0 con 0x7f6a5c0b3350 2024-09-15T23:23:50.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.920+0000 7f6a53fff640 1 --2- 172.21.15.123:0/1005195174 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6a3c06c2b0 0x7f6a3c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.920+0000 7f6a53fff640 1 -- 172.21.15.123:0/1005195174 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7f6a4408bf10 con 0x7f6a5c0b3350 2024-09-15T23:23:50.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.920+0000 7f6a5affd640 1 --2- 172.21.15.123:0/1005195174 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6a3c06c2b0 0x7f6a3c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.920+0000 7f6a5affd640 1 --2- 172.21.15.123:0/1005195174 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6a3c06c2b0 0x7f6a3c06e770 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f6a54034000 tx=0x7f6a5402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:50.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.921+0000 7f6a645ef740 1 Processor -- start 2024-09-15T23:23:50.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.921+0000 7f6a645ef740 1 -- start start 2024-09-15T23:23:50.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.922+0000 7f6a645ef740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55abf575a5d0 0x55abf575a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.922+0000 7f6a645ef740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55abf5757d90 0x55abf5759920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.922+0000 7f6a645ef740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55abf57581f0 0x55abf573a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.922+0000 7f6a645ef740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55abf56765d0 con 0x55abf5757d90 2024-09-15T23:23:50.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.922+0000 7f6a645ef740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55abf561e470 con 0x55abf575a5d0 2024-09-15T23:23:50.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.922+0000 7f6a645ef740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55abf5672590 con 0x55abf57581f0 2024-09-15T23:23:50.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.922+0000 7f6a5a7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55abf5757d90 0x55abf5759920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.922+0000 7f6a5a7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55abf5757d90 0x55abf5759920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48292/0 (socket says 172.21.15.123:48292) 2024-09-15T23:23:50.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.922+0000 7f6a5a7fc640 1 -- 172.21.15.123:0/2644854123 learned_addr learned my addr 172.21.15.123:0/2644854123 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:50.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.922+0000 7f6a5affd640 1 --2- 172.21.15.123:0/2644854123 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55abf575a5d0 0x55abf575a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.922+0000 7f6a5b7fe640 1 --2- 172.21.15.123:0/2644854123 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55abf57581f0 0x55abf573a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.922+0000 7f6a5a7fc640 1 -- 172.21.15.123:0/2644854123 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55abf57581f0 msgr2=0x55abf573a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:50.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.922+0000 7f6a5a7fc640 1 --2- 172.21.15.123:0/2644854123 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55abf57581f0 0x55abf573a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.922+0000 7f6a5a7fc640 1 -- 172.21.15.123:0/2644854123 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55abf575a5d0 msgr2=0x55abf575a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:50.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.922+0000 7f6a5a7fc640 1 --2- 172.21.15.123:0/2644854123 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55abf575a5d0 0x55abf575a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.922+0000 7f6a5a7fc640 1 -- 172.21.15.123:0/2644854123 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abf5606860 con 0x55abf5757d90 2024-09-15T23:23:50.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.922+0000 7f6a5b7fe640 1 --2- 172.21.15.123:0/2644854123 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55abf57581f0 0x55abf573a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:23:50.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.922+0000 7f6a5a7fc640 1 --2- 172.21.15.123:0/2644854123 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55abf5757d90 0x55abf5759920 secure :-1 s=READY pgs=2292 cs=0 l=1 rev1=1 crypto rx=0x7f6a44003fd0 tx=0x7f6a4400aef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be4ba36db681582f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:50.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.922+0000 7f6a517fa640 1 -- 172.21.15.123:0/2644854123 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a44087020 con 0x55abf5757d90 2024-09-15T23:23:50.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.922+0000 7f6a517fa640 1 -- 172.21.15.123:0/2644854123 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a44059f80 con 0x55abf5757d90 2024-09-15T23:23:50.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.922+0000 7f6a517fa640 1 -- 172.21.15.123:0/2644854123 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4405e330 con 0x55abf5757d90 2024-09-15T23:23:50.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.923+0000 7f6a645ef740 1 -- 172.21.15.123:0/2644854123 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55abf5757d90 msgr2=0x55abf5759920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:50.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.923+0000 7f6a645ef740 1 --2- 172.21.15.123:0/2644854123 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55abf5757d90 0x55abf5759920 secure :-1 s=READY pgs=2292 cs=0 l=1 rev1=1 crypto rx=0x7f6a44003fd0 tx=0x7f6a4400aef0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.923+0000 7f6a645ef740 1 -- 172.21.15.123:0/2644854123 shutdown_connections 2024-09-15T23:23:50.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.923+0000 7f6a645ef740 1 --2- 172.21.15.123:0/2644854123 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55abf57581f0 0x55abf573a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.923+0000 7f6a645ef740 1 --2- 172.21.15.123:0/2644854123 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55abf5757d90 0x55abf5759920 unknown :-1 s=CLOSED pgs=2292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.923+0000 7f6a645ef740 1 --2- 172.21.15.123:0/2644854123 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55abf575a5d0 0x55abf575a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.923+0000 7f6a645ef740 1 -- 172.21.15.123:0/2644854123 >> 172.21.15.123:0/2644854123 conn(0x55abf5710230 msgr2=0x55abf5758640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:50.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.923+0000 7f6a645ef740 1 -- 172.21.15.123:0/2644854123 shutdown_connections 2024-09-15T23:23:50.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.923+0000 7f6a645ef740 1 -- 172.21.15.123:0/2644854123 wait complete. 2024-09-15T23:23:50.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.924+0000 7f6a645ef740 1 -- start start 2024-09-15T23:23:50.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.924+0000 7f6a645ef740 1 Processor -- start 2024-09-15T23:23:50.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.924+0000 7f6a645ef740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55abf57581f0 0x55abf573de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.924+0000 7f6a645ef740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55abf575a5d0 0x55abf5754850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.924+0000 7f6a645ef740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55abf5754d90 0x55abf5737fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.924+0000 7f6a645ef740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55abf5756cf0 con 0x55abf5754d90 2024-09-15T23:23:50.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.924+0000 7f6a645ef740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55abf55ff620 con 0x55abf57581f0 2024-09-15T23:23:50.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.924+0000 7f6a645ef740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55abf5756fd0 con 0x55abf575a5d0 2024-09-15T23:23:50.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.924+0000 7f6a645ef740 10 client.0 _ll_register_callbacks cb 0x55abf56235b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:23:50.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.925+0000 7f6a5b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55abf5754d90 0x55abf5737fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.925+0000 7f6a5b7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55abf5754d90 0x55abf5737fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48298/0 (socket says 172.21.15.123:48298) 2024-09-15T23:23:50.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.925+0000 7f6a5b7fe640 1 -- 172.21.15.123:0/1076879471 learned_addr learned my addr 172.21.15.123:0/1076879471 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:50.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.925+0000 7f6a5affd640 1 --2- 172.21.15.123:0/1076879471 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55abf57581f0 0x55abf573de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.925+0000 7f6a5a7fc640 1 --2- 172.21.15.123:0/1076879471 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55abf575a5d0 0x55abf5754850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.925+0000 7f6a5b7fe640 1 -- 172.21.15.123:0/1076879471 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55abf575a5d0 msgr2=0x55abf5754850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:50.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.925+0000 7f6a5b7fe640 1 --2- 172.21.15.123:0/1076879471 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55abf575a5d0 0x55abf5754850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.925+0000 7f6a5b7fe640 1 -- 172.21.15.123:0/1076879471 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55abf57581f0 msgr2=0x55abf573de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:50.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.925+0000 7f6a5b7fe640 1 --2- 172.21.15.123:0/1076879471 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55abf57581f0 0x55abf573de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.925+0000 7f6a5b7fe640 1 -- 172.21.15.123:0/1076879471 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abf53893f0 con 0x55abf5754d90 2024-09-15T23:23:50.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.925+0000 7f6a5b7fe640 1 --2- 172.21.15.123:0/1076879471 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55abf5754d90 0x55abf5737fc0 secure :-1 s=READY pgs=2293 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c00bf40 tx=0x7f6a4c00d5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b14ef3a2a788441 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:50.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.925+0000 7f6a3a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:23:50.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.925+0000 7f6a3a7fc640 1 -- 172.21.15.123:0/1076879471 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c014430 con 0x55abf5754d90 2024-09-15T23:23:50.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.925+0000 7f6a3a7fc640 1 -- 172.21.15.123:0/1076879471 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7f6a4c0145d0 con 0x55abf5754d90 2024-09-15T23:23:50.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.925+0000 7f6a645ef740 1 -- 172.21.15.123:0/1076879471 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a44059f80 con 0x55abf5754d90 2024-09-15T23:23:50.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.925+0000 7f6a3a7fc640 1 -- 172.21.15.123:0/1076879471 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=120) ==== 24+0+0 (secure 0 0 0) 0x7f6a4c021050 con 0x55abf5754d90 2024-09-15T23:23:50.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.925+0000 7f6a645ef740 10 client.10749 fetch_fsmap learned FSMap version 120 2024-09-15T23:23:50.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.925+0000 7f6a645ef740 1 -- 172.21.15.123:0/1076879471 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=120,monmap=2+}) -- 0x55abf54537d0 con 0x55abf5754d90 2024-09-15T23:23:50.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.925+0000 7f6a3a7fc640 1 -- 172.21.15.123:0/1076879471 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a44059f80 con 0x55abf5754d90 2024-09-15T23:23:50.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.926+0000 7f6a3a7fc640 1 -- 172.21.15.123:0/1076879471 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 120) ==== 3502+0+0 (secure 0 0 0) 0x7f6a4c024020 con 0x55abf5754d90 2024-09-15T23:23:50.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.926+0000 7f6a645ef740 10 client.10749 fetch_fsmap finished waiting for FSMap version 120 2024-09-15T23:23:50.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.926+0000 7f6a645ef740 10 client.10749 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-09-15T23:23:50.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.926+0000 7f6a645ef740 20 client.10749 populate_metadata read hostname 'smithi123' 2024-09-15T23:23:50.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.926+0000 7f6a645ef740 1 --2- 172.21.15.123:0/1076879471 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x55abf576c4b0 0x55abf576c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.926+0000 7f6a645ef740 4 client.10749 mds_command: new command op to 10491 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:23:50.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.926+0000 7f6a645ef740 1 -- 172.21.15.123:0/1076879471 --> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55abf56d5030 con 0x55abf576c4b0 2024-09-15T23:23:50.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.926+0000 7f6a5affd640 1 --2- 172.21.15.123:0/1076879471 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x55abf576c4b0 0x55abf576c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.926+0000 7f6a3a7fc640 10 client.10749 ms_handle_connect on v2:172.21.15.123:6834/2653908784 2024-09-15T23:23:50.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.926+0000 7f6a5affd640 1 --2- 172.21.15.123:0/1076879471 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x55abf576c4b0 0x55abf576c890 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a5507425f4e2ec server_cookie=978cbf415490346e in_seq=0 out_seq=0 2024-09-15T23:23:50.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.927+0000 7f6a3a7fc640 1 -- 172.21.15.123:0/1076879471 <== mds.0 v2:172.21.15.123:6834/2653908784 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55abf56d5030 con 0x55abf576c4b0 2024-09-15T23:23:50.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.927+0000 7f6a3a7fc640 10 client.10749 handle_command_reply: tid=0 2024-09-15T23:23:50.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.927+0000 7f6a645ef740 1 client.10749 shutdown 2024-09-15T23:23:50.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.927+0000 7f6a645ef740 1 -- 172.21.15.123:0/1076879471 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55abf5754d90 msgr2=0x55abf5737fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:50.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.927+0000 7f6a645ef740 1 --2- 172.21.15.123:0/1076879471 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55abf5754d90 0x55abf5737fc0 secure :-1 s=READY pgs=2293 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c00bf40 tx=0x7f6a4c00d5f0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.927+0000 7f6a645ef740 1 -- 172.21.15.123:0/1076879471 shutdown_connections 2024-09-15T23:23:50.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.927+0000 7f6a645ef740 1 --2- 172.21.15.123:0/1076879471 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x55abf576c4b0 0x55abf576c890 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.927+0000 7f6a645ef740 1 --2- 172.21.15.123:0/1076879471 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55abf5754d90 0x55abf5737fc0 unknown :-1 s=CLOSED pgs=2293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.927+0000 7f6a645ef740 1 --2- 172.21.15.123:0/1076879471 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55abf575a5d0 0x55abf5754850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.927+0000 7f6a3a7fc640 0 client.10749 ms_handle_reset on v2:172.21.15.123:6834/2653908784 2024-09-15T23:23:50.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.927+0000 7f6a645ef740 1 --2- 172.21.15.123:0/1076879471 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55abf57581f0 0x55abf573de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.927+0000 7f6a645ef740 1 -- 172.21.15.123:0/1076879471 >> 172.21.15.123:0/1076879471 conn(0x55abf5757d90 msgr2=0x55abf575bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:50.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.927+0000 7f6a645ef740 1 -- 172.21.15.123:0/1076879471 shutdown_connections 2024-09-15T23:23:50.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.927+0000 7f6a645ef740 1 -- 172.21.15.123:0/1076879471 wait complete. 2024-09-15T23:23:50.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.927+0000 7f6a645ef740 20 client.10749 trim_cache size 0 max 16384 2024-09-15T23:23:50.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.940+0000 7f6a645ef740 1 Processor -- start 2024-09-15T23:23:50.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.940+0000 7f6a645ef740 1 -- start start 2024-09-15T23:23:50.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.941+0000 7f6a645ef740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55abf5754d90 0x55abf5754090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.941+0000 7f6a645ef740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55abf57581f0 0x55abf570e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.941+0000 7f6a645ef740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55abf575a5d0 0x55abf57395f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.941+0000 7f6a645ef740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5c200e70 con 0x55abf57581f0 2024-09-15T23:23:50.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.941+0000 7f6a645ef740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5c1603b0 con 0x55abf5754d90 2024-09-15T23:23:50.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.941+0000 7f6a645ef740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6a5c0ca6b0 con 0x55abf575a5d0 2024-09-15T23:23:50.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.941+0000 7f6a5a7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55abf57581f0 0x55abf570e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.941+0000 7f6a5a7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55abf57581f0 0x55abf570e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48308/0 (socket says 172.21.15.123:48308) 2024-09-15T23:23:50.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.941+0000 7f6a5a7fc640 1 -- 172.21.15.123:0/153969072 learned_addr learned my addr 172.21.15.123:0/153969072 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:50.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.941+0000 7f6a5affd640 1 --2- 172.21.15.123:0/153969072 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55abf5754d90 0x55abf5754090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.941+0000 7f6a5a7fc640 1 -- 172.21.15.123:0/153969072 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55abf575a5d0 msgr2=0x55abf57395f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:50.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.941+0000 7f6a5a7fc640 1 --2- 172.21.15.123:0/153969072 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55abf575a5d0 0x55abf57395f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.941+0000 7f6a5a7fc640 1 -- 172.21.15.123:0/153969072 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55abf5754d90 msgr2=0x55abf5754090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:50.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.941+0000 7f6a5a7fc640 1 --2- 172.21.15.123:0/153969072 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55abf5754d90 0x55abf5754090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.941+0000 7f6a5a7fc640 1 -- 172.21.15.123:0/153969072 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abf575ad20 con 0x55abf57581f0 2024-09-15T23:23:50.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.941+0000 7f6a5affd640 1 --2- 172.21.15.123:0/153969072 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55abf5754d90 0x55abf5754090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:23:50.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.941+0000 7f6a5a7fc640 1 --2- 172.21.15.123:0/153969072 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55abf57581f0 0x55abf570e390 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 crypto rx=0x7f6a440563e0 tx=0x7f6a4408b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cbb481b840a3fc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:50.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.941+0000 7f6a50ff9640 1 -- 172.21.15.123:0/153969072 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a44087070 con 0x55abf57581f0 2024-09-15T23:23:50.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.941+0000 7f6a50ff9640 1 -- 172.21.15.123:0/153969072 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a44059f80 con 0x55abf57581f0 2024-09-15T23:23:50.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.941+0000 7f6a50ff9640 1 -- 172.21.15.123:0/153969072 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a44062b60 con 0x55abf57581f0 2024-09-15T23:23:50.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.942+0000 7f6a645ef740 1 -- 172.21.15.123:0/153969072 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55abf57581f0 msgr2=0x55abf570e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:50.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.942+0000 7f6a645ef740 1 --2- 172.21.15.123:0/153969072 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55abf57581f0 0x55abf570e390 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 crypto rx=0x7f6a440563e0 tx=0x7f6a4408b000 comp rx=0 tx=0).stop 2024-09-15T23:23:50.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.942+0000 7f6a645ef740 1 -- 172.21.15.123:0/153969072 shutdown_connections 2024-09-15T23:23:50.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.942+0000 7f6a645ef740 1 --2- 172.21.15.123:0/153969072 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55abf575a5d0 0x55abf57395f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.942+0000 7f6a645ef740 1 --2- 172.21.15.123:0/153969072 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55abf57581f0 0x55abf570e390 unknown :-1 s=CLOSED pgs=2294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.942+0000 7f6a645ef740 1 --2- 172.21.15.123:0/153969072 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55abf5754d90 0x55abf5754090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.942+0000 7f6a645ef740 1 -- 172.21.15.123:0/153969072 >> 172.21.15.123:0/153969072 conn(0x55abf5757d90 msgr2=0x55abf5759740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:50.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.942+0000 7f6a645ef740 1 -- 172.21.15.123:0/153969072 shutdown_connections 2024-09-15T23:23:50.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.942+0000 7f6a645ef740 1 -- 172.21.15.123:0/153969072 wait complete. 2024-09-15T23:23:50.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.942+0000 7f6a645ef740 1 -- start start 2024-09-15T23:23:50.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.943+0000 7f6a645ef740 1 Processor -- start 2024-09-15T23:23:50.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.943+0000 7f6a645ef740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55abf5754d90 0x55abf573ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.943+0000 7f6a645ef740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55abf57581f0 0x55abf57d63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.943+0000 7f6a645ef740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55abf575a5d0 0x55abf574ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.943+0000 7f6a645ef740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55abf5709d90 con 0x55abf5754d90 2024-09-15T23:23:50.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.943+0000 7f6a645ef740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6a5c15fd40 con 0x55abf575a5d0 2024-09-15T23:23:50.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.943+0000 7f6a645ef740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55abf57099a0 con 0x55abf57581f0 2024-09-15T23:23:50.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.943+0000 7f6a645ef740 10 client.0 _ll_register_callbacks cb 0x7f6a4c00bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:23:50.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.943+0000 7f6a5affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55abf5754d90 0x55abf573ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.943+0000 7f6a5affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55abf5754d90 0x55abf573ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48322/0 (socket says 172.21.15.123:48322) 2024-09-15T23:23:50.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.943+0000 7f6a5affd640 1 -- 172.21.15.123:0/3603812051 learned_addr learned my addr 172.21.15.123:0/3603812051 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:50.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.944+0000 7f6a5a7fc640 1 --2- 172.21.15.123:0/3603812051 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55abf57581f0 0x55abf57d63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.944+0000 7f6a5b7fe640 1 --2- 172.21.15.123:0/3603812051 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55abf575a5d0 0x55abf574ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.944+0000 7f6a5affd640 1 -- 172.21.15.123:0/3603812051 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55abf57581f0 msgr2=0x55abf57d63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:50.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.944+0000 7f6a5affd640 1 --2- 172.21.15.123:0/3603812051 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55abf57581f0 0x55abf57d63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.944+0000 7f6a5affd640 1 -- 172.21.15.123:0/3603812051 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55abf575a5d0 msgr2=0x55abf574ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:50.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.944+0000 7f6a5affd640 1 --2- 172.21.15.123:0/3603812051 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55abf575a5d0 0x55abf574ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.944+0000 7f6a5affd640 1 -- 172.21.15.123:0/3603812051 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abf5739100 con 0x55abf5754d90 2024-09-15T23:23:50.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.944+0000 7f6a5affd640 1 --2- 172.21.15.123:0/3603812051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55abf5754d90 0x55abf573ac70 secure :-1 s=READY pgs=2295 cs=0 l=1 rev1=1 crypto rx=0x7f6a54009990 tx=0x7f6a54004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81316b94225824d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:50.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.944+0000 7f6a3a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:23:50.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.944+0000 7f6a3a7fc640 1 -- 172.21.15.123:0/3603812051 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a54037040 con 0x55abf5754d90 2024-09-15T23:23:50.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.944+0000 7f6a3a7fc640 1 -- 172.21.15.123:0/3603812051 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7f6a5404c860 con 0x55abf5754d90 2024-09-15T23:23:50.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.944+0000 7f6a645ef740 1 -- 172.21.15.123:0/3603812051 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a44059f80 con 0x55abf5754d90 2024-09-15T23:23:50.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.944+0000 7f6a3a7fc640 1 -- 172.21.15.123:0/3603812051 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=120) ==== 24+0+0 (secure 0 0 0) 0x7f6a54060050 con 0x55abf5754d90 2024-09-15T23:23:50.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.944+0000 7f6a645ef740 10 client.10755 fetch_fsmap learned FSMap version 120 2024-09-15T23:23:50.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.944+0000 7f6a645ef740 1 -- 172.21.15.123:0/3603812051 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=120,monmap=2+}) -- 0x55abf57da580 con 0x55abf5754d90 2024-09-15T23:23:50.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.944+0000 7f6a3a7fc640 1 -- 172.21.15.123:0/3603812051 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a44059f80 con 0x55abf5754d90 2024-09-15T23:23:50.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.944+0000 7f6a3a7fc640 1 -- 172.21.15.123:0/3603812051 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 120) ==== 3502+0+0 (secure 0 0 0) 0x7f6a54063020 con 0x55abf5754d90 2024-09-15T23:23:50.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.944+0000 7f6a645ef740 10 client.10755 fetch_fsmap finished waiting for FSMap version 120 2024-09-15T23:23:50.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.944+0000 7f6a645ef740 10 client.10755 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.a 2024-09-15T23:23:50.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.944+0000 7f6a645ef740 20 client.10755 populate_metadata read hostname 'smithi123' 2024-09-15T23:23:50.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.944+0000 7f6a645ef740 1 --2- 172.21.15.123:0/3603812051 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x55abf57659c0 0x55abf574efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:50.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.944+0000 7f6a645ef740 4 client.10755 mds_command: new command op to 10491 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:23:50.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.944+0000 7f6a645ef740 1 -- 172.21.15.123:0/3603812051 --> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55abf5683d00 con 0x55abf57659c0 2024-09-15T23:23:50.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.944+0000 7f6a5a7fc640 1 --2- 172.21.15.123:0/3603812051 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x55abf57659c0 0x55abf574efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:50.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.945+0000 7f6a3a7fc640 10 client.10755 ms_handle_connect on v2:172.21.15.123:6834/2653908784 2024-09-15T23:23:50.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.945+0000 7f6a5a7fc640 1 --2- 172.21.15.123:0/3603812051 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x55abf57659c0 0x55abf574efd0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76450473813c2572 server_cookie=53a684ce64196b98 in_seq=0 out_seq=0 2024-09-15T23:23:50.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.945+0000 7f6a3a7fc640 1 -- 172.21.15.123:0/3603812051 <== mds.0 v2:172.21.15.123:6834/2653908784 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55abf5683d00 con 0x55abf57659c0 2024-09-15T23:23:50.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.945+0000 7f6a3a7fc640 10 client.10755 handle_command_reply: tid=0 2024-09-15T23:23:50.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.945+0000 7f6a645ef740 1 client.10755 shutdown 2024-09-15T23:23:50.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.945+0000 7f6a645ef740 1 -- 172.21.15.123:0/3603812051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55abf5754d90 msgr2=0x55abf573ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:50.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.945+0000 7f6a645ef740 1 --2- 172.21.15.123:0/3603812051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55abf5754d90 0x55abf573ac70 secure :-1 s=READY pgs=2295 cs=0 l=1 rev1=1 crypto rx=0x7f6a54009990 tx=0x7f6a54004730 comp rx=0 tx=0).stop 2024-09-15T23:23:50.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.945+0000 7f6a645ef740 1 -- 172.21.15.123:0/3603812051 shutdown_connections 2024-09-15T23:23:50.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.945+0000 7f6a645ef740 1 --2- 172.21.15.123:0/3603812051 >> [v2:172.21.15.123:6834/2653908784,v1:172.21.15.123:6835/2653908784] conn(0x55abf57659c0 0x55abf574efd0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.945+0000 7f6a645ef740 1 --2- 172.21.15.123:0/3603812051 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55abf575a5d0 0x55abf574ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.945+0000 7f6a645ef740 1 --2- 172.21.15.123:0/3603812051 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55abf57581f0 0x55abf57d63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.945+0000 7f6a3a7fc640 0 client.10755 ms_handle_reset on v2:172.21.15.123:6834/2653908784 2024-09-15T23:23:50.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.945+0000 7f6a645ef740 1 --2- 172.21.15.123:0/3603812051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55abf5754d90 0x55abf573ac70 unknown :-1 s=CLOSED pgs=2295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.945+0000 7f6a645ef740 1 -- 172.21.15.123:0/3603812051 >> 172.21.15.123:0/3603812051 conn(0x55abf5757d90 msgr2=0x55abf5737b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:50.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.945+0000 7f6a645ef740 1 -- 172.21.15.123:0/3603812051 shutdown_connections 2024-09-15T23:23:50.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.945+0000 7f6a645ef740 1 -- 172.21.15.123:0/3603812051 wait complete. 2024-09-15T23:23:50.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.945+0000 7f6a645ef740 20 client.10755 trim_cache size 0 max 16384 2024-09-15T23:23:50.953 INFO:teuthology.orchestra.run.smithi123.stdout:[] 2024-09-15T23:23:50.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.946+0000 7f6a61853640 1 -- 172.21.15.123:0/1005195174 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6a3c06c2b0 msgr2=0x7f6a3c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:50.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.946+0000 7f6a61853640 1 --2- 172.21.15.123:0/1005195174 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6a3c06c2b0 0x7f6a3c06e770 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f6a54034000 tx=0x7f6a5402e000 comp rx=0 tx=0).stop 2024-09-15T23:23:50.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.946+0000 7f6a61853640 1 -- 172.21.15.123:0/1005195174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a5c0b3350 msgr2=0x7f6a5c0ce310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:50.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.946+0000 7f6a61853640 1 --2- 172.21.15.123:0/1005195174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a5c0b3350 0x7f6a5c0ce310 secure :-1 s=READY pgs=2291 cs=0 l=1 rev1=1 crypto rx=0x7f6a4400ce10 tx=0x7f6a4400a660 comp rx=0 tx=0).stop 2024-09-15T23:23:50.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.946+0000 7f6a61853640 1 -- 172.21.15.123:0/1005195174 shutdown_connections 2024-09-15T23:23:50.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.946+0000 7f6a61853640 1 --2- 172.21.15.123:0/1005195174 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6a5c0b38a0 0x7f6a5c0d2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.946+0000 7f6a61853640 1 --2- 172.21.15.123:0/1005195174 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6a3c06c2b0 0x7f6a3c06e770 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.946+0000 7f6a61853640 1 --2- 172.21.15.123:0/1005195174 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a5c0b3350 0x7f6a5c0ce310 unknown :-1 s=CLOSED pgs=2291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.946+0000 7f6a61853640 1 --2- 172.21.15.123:0/1005195174 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6a5c06bfd0 0x7f6a5c156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:50.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.946+0000 7f6a61853640 1 -- 172.21.15.123:0/1005195174 >> 172.21.15.123:0/1005195174 conn(0x7f6a5c0d11c0 msgr2=0x7f6a5c0b8370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:50.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.946+0000 7f6a61853640 1 -- 172.21.15.123:0/1005195174 shutdown_connections 2024-09-15T23:23:50.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:50.946+0000 7f6a61853640 1 -- 172.21.15.123:0/1005195174 wait complete. 2024-09-15T23:23:50.958 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-15T23:23:51.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.054+0000 7f5024d8f640 1 Processor -- start 2024-09-15T23:23:51.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.054+0000 7f5024d8f640 1 -- start start 2024-09-15T23:23:51.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.055+0000 7f5024d8f640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f502015ab40 0x7f502006c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:51.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.055+0000 7f5024d8f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50200720b0 0x7f5020073990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:51.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.055+0000 7f5024d8f640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f502015af20 0x7f502015b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:51.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.055+0000 7f5024d8f640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f5020072520 con 0x7f502015af20 2024-09-15T23:23:51.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.055+0000 7f5024d8f640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f5020071010 con 0x7f502015ab40 2024-09-15T23:23:51.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.055+0000 7f5024d8f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f50200712f0 con 0x7f50200720b0 2024-09-15T23:23:51.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.055+0000 7f501ed9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f502015af20 0x7f502015b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:51.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.055+0000 7f501ed9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f502015af20 0x7f502015b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48336/0 (socket says 172.21.15.123:48336) 2024-09-15T23:23:51.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.055+0000 7f501ed9d640 1 -- 172.21.15.123:0/2749638438 learned_addr learned my addr 172.21.15.123:0/2749638438 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:51.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.055+0000 7f501ed9d640 1 -- 172.21.15.123:0/2749638438 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50200720b0 msgr2=0x7f5020073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:51.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.055+0000 7f501ed9d640 1 --2- 172.21.15.123:0/2749638438 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50200720b0 0x7f5020073990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:51.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.055+0000 7f501ed9d640 1 -- 172.21.15.123:0/2749638438 >> v2:172.21.15.188:3300/0 conn(0x7f502015ab40 msgr2=0x7f502006c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:51.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.055+0000 7f501ed9d640 1 --2- 172.21.15.123:0/2749638438 >> v2:172.21.15.188:3300/0 conn(0x7f502015ab40 0x7f502006c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:51.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.055+0000 7f501ed9d640 1 -- 172.21.15.123:0/2749638438 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50200715d0 con 0x7f502015af20 2024-09-15T23:23:51.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.056+0000 7f501ed9d640 1 --2- 172.21.15.123:0/2749638438 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f502015af20 0x7f502015b390 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 crypto rx=0x7f50200b6090 tx=0x7f501802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11dfce503144e71c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:51.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.056+0000 7f501d59a640 1 -- 172.21.15.123:0/2749638438 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5018036070 con 0x7f502015af20 2024-09-15T23:23:51.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.056+0000 7f501d59a640 1 -- 172.21.15.123:0/2749638438 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5018031600 con 0x7f502015af20 2024-09-15T23:23:51.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.056+0000 7f501d59a640 1 -- 172.21.15.123:0/2749638438 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50180319d0 con 0x7f502015af20 2024-09-15T23:23:51.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.056+0000 7f5024d8f640 1 -- 172.21.15.123:0/2749638438 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f502015af20 msgr2=0x7f502015b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:51.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.056+0000 7f5024d8f640 1 --2- 172.21.15.123:0/2749638438 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f502015af20 0x7f502015b390 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 crypto rx=0x7f50200b6090 tx=0x7f501802a5f0 comp rx=0 tx=0).stop 2024-09-15T23:23:51.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.057+0000 7f5024d8f640 1 -- 172.21.15.123:0/2749638438 shutdown_connections 2024-09-15T23:23:51.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.057+0000 7f5024d8f640 1 --2- 172.21.15.123:0/2749638438 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f502015af20 0x7f502015b390 unknown :-1 s=CLOSED pgs=2296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:51.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.057+0000 7f5024d8f640 1 --2- 172.21.15.123:0/2749638438 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50200720b0 0x7f5020073990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:51.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.057+0000 7f5024d8f640 1 --2- 172.21.15.123:0/2749638438 >> v2:172.21.15.188:3300/0 conn(0x7f502015ab40 0x7f502006c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:51.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.057+0000 7f5024d8f640 1 -- 172.21.15.123:0/2749638438 >> 172.21.15.123:0/2749638438 conn(0x7f50200ccec0 msgr2=0x7f50200cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:51.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.057+0000 7f5024d8f640 1 -- 172.21.15.123:0/2749638438 shutdown_connections 2024-09-15T23:23:51.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.057+0000 7f5024d8f640 1 -- 172.21.15.123:0/2749638438 wait complete. 2024-09-15T23:23:51.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.058+0000 7f5024d8f640 1 Processor -- start 2024-09-15T23:23:51.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.058+0000 7f5024d8f640 1 -- start start 2024-09-15T23:23:51.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.059+0000 7f5024d8f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50200720b0 0x7f5020155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:51.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.059+0000 7f5024d8f640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f502015ab40 0x7f50201564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:51.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.059+0000 7f5024d8f640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f502015af20 0x7f50201f4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:51.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.059+0000 7f5024d8f640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f502015b8d0 con 0x7f50200720b0 2024-09-15T23:23:51.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.059+0000 7f5024d8f640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5020073ed0 con 0x7f502015ab40 2024-09-15T23:23:51.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.059+0000 7f5024d8f640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f502015ba50 con 0x7f502015af20 2024-09-15T23:23:51.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.059+0000 7f501e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50200720b0 0x7f5020155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:51.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.059+0000 7f501e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50200720b0 0x7f5020155fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48342/0 (socket says 172.21.15.123:48342) 2024-09-15T23:23:51.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.059+0000 7f501e59c640 1 -- 172.21.15.123:0/3431725964 learned_addr learned my addr 172.21.15.123:0/3431725964 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:51.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.059+0000 7f501ed9d640 1 --2- 172.21.15.123:0/3431725964 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f502015af20 0x7f50201f4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:51.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.059+0000 7f501dd9b640 1 --2- 172.21.15.123:0/3431725964 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f502015ab40 0x7f50201564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:51.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.059+0000 7f501e59c640 1 -- 172.21.15.123:0/3431725964 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f502015af20 msgr2=0x7f50201f4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:51.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.059+0000 7f501e59c640 1 --2- 172.21.15.123:0/3431725964 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f502015af20 0x7f50201f4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:51.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.059+0000 7f501e59c640 1 -- 172.21.15.123:0/3431725964 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f502015ab40 msgr2=0x7f50201564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:51.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.059+0000 7f501e59c640 1 --2- 172.21.15.123:0/3431725964 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f502015ab40 0x7f50201564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:51.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.059+0000 7f501e59c640 1 -- 172.21.15.123:0/3431725964 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50201f4f00 con 0x7f50200720b0 2024-09-15T23:23:51.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.059+0000 7f501ed9d640 1 --2- 172.21.15.123:0/3431725964 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f502015af20 0x7f50201f4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:23:51.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.059+0000 7f501dd9b640 1 --2- 172.21.15.123:0/3431725964 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f502015ab40 0x7f50201564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:23:51.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.059+0000 7f501e59c640 1 --2- 172.21.15.123:0/3431725964 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50200720b0 0x7f5020155fb0 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 crypto rx=0x7f501000b4a0 tx=0x7f501000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:51.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.059+0000 7f500effd640 1 -- 172.21.15.123:0/3431725964 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5010014070 con 0x7f50200720b0 2024-09-15T23:23:51.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.059+0000 7f500effd640 1 -- 172.21.15.123:0/3431725964 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5010010610 con 0x7f50200720b0 2024-09-15T23:23:51.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.059+0000 7f5024d8f640 1 -- 172.21.15.123:0/3431725964 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50201f51e0 con 0x7f50200720b0 2024-09-15T23:23:51.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.059+0000 7f500effd640 1 -- 172.21.15.123:0/3431725964 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5010010a00 con 0x7f50200720b0 2024-09-15T23:23:51.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.059+0000 7f5024d8f640 1 -- 172.21.15.123:0/3431725964 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50201f5bb0 con 0x7f50200720b0 2024-09-15T23:23:51.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.060+0000 7f5024d8f640 1 -- 172.21.15.123:0/3431725964 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f502006c6a0 con 0x7f50200720b0 2024-09-15T23:23:51.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.061+0000 7f500effd640 1 -- 172.21.15.123:0/3431725964 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5010017070 con 0x7f50200720b0 2024-09-15T23:23:51.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.061+0000 7f500effd640 1 --2- 172.21.15.123:0/3431725964 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f500006c2b0 0x7f500006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:51.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.061+0000 7f500effd640 1 -- 172.21.15.123:0/3431725964 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7f501008ae30 con 0x7f50200720b0 2024-09-15T23:23:51.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.061+0000 7f501dd9b640 1 --2- 172.21.15.123:0/3431725964 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f500006c2b0 0x7f500006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:51.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.062+0000 7f501dd9b640 1 --2- 172.21.15.123:0/3431725964 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f500006c2b0 0x7f500006e770 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f5014006fd0 tx=0x7f5014008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:51.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.066+0000 7f500effd640 1 -- 172.21.15.123:0/3431725964 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5010059630 con 0x7f50200720b0 2024-09-15T23:23:51.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.265+0000 7f5024d8f640 1 -- 172.21.15.123:0/3431725964 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f50201f5680 con 0x7f50200720b0 2024-09-15T23:23:51.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.266+0000 7f500effd640 1 -- 172.21.15.123:0/3431725964 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f5010058f30 con 0x7f50200720b0 2024-09-15T23:23:51.267 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:23:51.267 INFO:teuthology.orchestra.run.smithi123.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-15T23:23:51.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.268+0000 7f5024d8f640 1 -- 172.21.15.123:0/3431725964 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f500006c2b0 msgr2=0x7f500006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:51.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.268+0000 7f5024d8f640 1 --2- 172.21.15.123:0/3431725964 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f500006c2b0 0x7f500006e770 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f5014006fd0 tx=0x7f5014008040 comp rx=0 tx=0).stop 2024-09-15T23:23:51.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.268+0000 7f5024d8f640 1 -- 172.21.15.123:0/3431725964 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50200720b0 msgr2=0x7f5020155fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:51.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.268+0000 7f5024d8f640 1 --2- 172.21.15.123:0/3431725964 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50200720b0 0x7f5020155fb0 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 crypto rx=0x7f501000b4a0 tx=0x7f501000b960 comp rx=0 tx=0).stop 2024-09-15T23:23:51.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.268+0000 7f5024d8f640 1 -- 172.21.15.123:0/3431725964 shutdown_connections 2024-09-15T23:23:51.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.268+0000 7f5024d8f640 1 --2- 172.21.15.123:0/3431725964 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f502015af20 0x7f50201f4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:51.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.268+0000 7f5024d8f640 1 --2- 172.21.15.123:0/3431725964 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f502015ab40 0x7f50201564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:51.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.268+0000 7f5024d8f640 1 --2- 172.21.15.123:0/3431725964 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f500006c2b0 0x7f500006e770 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:51.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.268+0000 7f5024d8f640 1 --2- 172.21.15.123:0/3431725964 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50200720b0 0x7f5020155fb0 unknown :-1 s=CLOSED pgs=2297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:51.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.268+0000 7f5024d8f640 1 -- 172.21.15.123:0/3431725964 >> 172.21.15.123:0/3431725964 conn(0x7f50200ccec0 msgr2=0x7f50201593a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:51.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.268+0000 7f5024d8f640 1 -- 172.21.15.123:0/3431725964 shutdown_connections 2024-09-15T23:23:51.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.268+0000 7f5024d8f640 1 -- 172.21.15.123:0/3431725964 wait complete. 2024-09-15T23:23:51.280 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:23:51.280 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:23:51.327 DEBUG:teuthology.orchestra.run.smithi188:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:23:51.380 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:23:51.380 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:23:51.380 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:23:51.380 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:23:51.396 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:23:51.396 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:23:51.452 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:23:51.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.590+0000 7f7ddf62c640 1 Processor -- start 2024-09-15T23:23:51.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.590+0000 7f7ddf62c640 1 -- start start 2024-09-15T23:23:51.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.591+0000 7f7ddf62c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f7dd813eb20 0x7f7dd815c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:51.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.591+0000 7f7ddf62c640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dd8071180 con 0x7f7dd806c320 2024-09-15T23:23:51.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.591+0000 7f7ddf62c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dd8071460 con 0x7f7dd80b2d40 2024-09-15T23:23:51.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.591+0000 7f7ddf62c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f7dd8071ab0 con 0x7f7dd813eb20 2024-09-15T23:23:51.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.591+0000 7f7ddcbc7640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7dd806c320 0x7f7dd815bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56444/0 (socket says 172.21.15.123:56444) 2024-09-15T23:23:51.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.591+0000 7f7ddcbc7640 1 -- 172.21.15.123:0/2455825134 learned_addr learned my addr 172.21.15.123:0/2455825134 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:23:51.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.591+0000 7f7dddbc9640 1 --2- 172.21.15.123:0/2455825134 >> v2:172.21.15.188:3300/0 conn(0x7f7dd813eb20 0x7f7dd815c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:51.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.591+0000 7f7dcffff640 1 -- 172.21.15.123:0/2455825134 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3571787042 0 0) 0x7f7dd8071180 con 0x7f7dd806c320 2024-09-15T23:23:51.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.591+0000 7f7dcffff640 1 -- 172.21.15.123:0/2455825134 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7dc4003520 con 0x7f7dd806c320 2024-09-15T23:23:51.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.591+0000 7f7dcffff640 1 -- 172.21.15.123:0/2455825134 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 441527390 0 0) 0x7f7dc4003520 con 0x7f7dd806c320 2024-09-15T23:23:51.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.591+0000 7f7dcffff640 1 -- 172.21.15.123:0/2455825134 >> v2:172.21.15.188:3300/0 conn(0x7f7dd813eb20 msgr2=0x7f7dd815c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:51.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.591+0000 7f7dcffff640 1 --2- 172.21.15.123:0/2455825134 >> v2:172.21.15.188:3300/0 conn(0x7f7dd813eb20 0x7f7dd815c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:51.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.591+0000 7f7dcffff640 1 -- 172.21.15.123:0/2455825134 >> v1:172.21.15.188:6789/0 conn(0x7f7dd80b2d40 legacy=0x7f7dd806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:51.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.591+0000 7f7dcffff640 1 -- 172.21.15.123:0/2455825134 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dd8071740 con 0x7f7dd806c320 2024-09-15T23:23:51.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.591+0000 7f7dcffff640 1 -- 172.21.15.123:0/2455825134 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f7dc8001670 con 0x7f7dd806c320 2024-09-15T23:23:51.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.591+0000 7f7dcffff640 1 -- 172.21.15.123:0/2455825134 >> v1:172.21.15.123:6789/0 conn(0x7f7dd806c320 legacy=0x7f7dd815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:51.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.591+0000 7f7dcffff640 1 --2- 172.21.15.123:0/2455825134 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7dc40039b0 0x7f7dc4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:51.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.591+0000 7f7dcffff640 1 --2- 172.21.15.123:0/2455825134 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7dc4004800 0x7f7dc4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:51.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.591+0000 7f7dcffff640 1 --2- 172.21.15.123:0/2455825134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7dc40051c0 0x7f7dc400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:51.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.591+0000 7f7dcffff640 1 -- 172.21.15.123:0/2455825134 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd8071ab0 con 0x7f7dc40051c0 2024-09-15T23:23:51.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.591+0000 7f7dcffff640 1 -- 172.21.15.123:0/2455825134 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc400c060 con 0x7f7dc4004800 2024-09-15T23:23:51.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.591+0000 7f7dcffff640 1 -- 172.21.15.123:0/2455825134 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7dc400e470 con 0x7f7dc40039b0 2024-09-15T23:23:51.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.592+0000 7f7dddbc9640 1 --2- 172.21.15.123:0/2455825134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7dc40051c0 0x7f7dc400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:51.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.592+0000 7f7ddcbc7640 1 --2- 172.21.15.123:0/2455825134 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7dc4004800 0x7f7dc4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:51.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.592+0000 7f7ddd3c8640 1 --2- 172.21.15.123:0/2455825134 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7dc40039b0 0x7f7dc4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:51.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.592+0000 7f7dddbc9640 1 -- 172.21.15.123:0/2455825134 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7dc40039b0 msgr2=0x7f7dc4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:51.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.592+0000 7f7dddbc9640 1 --2- 172.21.15.123:0/2455825134 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7dc40039b0 0x7f7dc4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:51.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.592+0000 7f7dddbc9640 1 -- 172.21.15.123:0/2455825134 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7dc4004800 msgr2=0x7f7dc4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:51.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.592+0000 7f7dddbc9640 1 --2- 172.21.15.123:0/2455825134 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7dc4004800 0x7f7dc4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:51.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.592+0000 7f7dddbc9640 1 -- 172.21.15.123:0/2455825134 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc4003520 con 0x7f7dc40051c0 2024-09-15T23:23:51.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.592+0000 7f7dddbc9640 1 -- 172.21.15.123:0/2455825134 reap_dead start 2024-09-15T23:23:51.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.592+0000 7f7dddbc9640 1 --2- 172.21.15.123:0/2455825134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7dc40051c0 0x7f7dc400b9c0 secure :-1 s=READY pgs=2299 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0009fc0 tx=0x7f7dc4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c6fcda76e8f8e55 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:51.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.593+0000 7f7dcffff640 1 -- 172.21.15.123:0/2455825134 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0035020 con 0x7f7dc40051c0 2024-09-15T23:23:51.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.593+0000 7f7dcffff640 1 -- 172.21.15.123:0/2455825134 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd0003b90 con 0x7f7dc40051c0 2024-09-15T23:23:51.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.593+0000 7f7dcffff640 1 -- 172.21.15.123:0/2455825134 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0009c10 con 0x7f7dc40051c0 2024-09-15T23:23:51.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.593+0000 7f7ddf62c640 1 -- 172.21.15.123:0/2455825134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7dc40051c0 msgr2=0x7f7dc400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:51.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.593+0000 7f7ddf62c640 1 --2- 172.21.15.123:0/2455825134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7dc40051c0 0x7f7dc400b9c0 secure :-1 s=READY pgs=2299 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0009fc0 tx=0x7f7dc4005830 comp rx=0 tx=0).stop 2024-09-15T23:23:51.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.593+0000 7f7ddf62c640 1 -- 172.21.15.123:0/2455825134 shutdown_connections 2024-09-15T23:23:51.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.593+0000 7f7ddf62c640 1 --2- 172.21.15.123:0/2455825134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7dc40051c0 0x7f7dc400b9c0 unknown :-1 s=CLOSED pgs=2299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:51.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.593+0000 7f7ddf62c640 1 -- 172.21.15.123:0/2455825134 >> 172.21.15.123:0/2455825134 conn(0x7f7dd80ccec0 msgr2=0x7f7dd80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:51.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.593+0000 7f7ddf62c640 1 -- 172.21.15.123:0/2455825134 shutdown_connections 2024-09-15T23:23:51.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.593+0000 7f7ddf62c640 1 -- 172.21.15.123:0/2455825134 wait complete. 2024-09-15T23:23:51.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.594+0000 7f7ddf62c640 1 Processor -- start 2024-09-15T23:23:51.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.594+0000 7f7ddf62c640 1 -- start start 2024-09-15T23:23:51.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.595+0000 7f7ddf62c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7dc40051c0 0x7f7dd81f5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:51.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.595+0000 7f7ddf62c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7dd815e370 0x7f7dd815e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:51.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.595+0000 7f7ddf62c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7dd8158500 0x7f7dd8158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:51.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.595+0000 7f7ddf62c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd806bfa0 con 0x7f7dc40051c0 2024-09-15T23:23:51.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.595+0000 7f7ddf62c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd806be20 con 0x7f7dd8158500 2024-09-15T23:23:51.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.595+0000 7f7ddf62c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7dd806c120 con 0x7f7dd815e370 2024-09-15T23:23:51.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.595+0000 7f7ddd3c8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7dc40051c0 0x7f7dd81f5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:51.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.595+0000 7f7ddd3c8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7dc40051c0 0x7f7dd81f5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48368/0 (socket says 172.21.15.123:48368) 2024-09-15T23:23:51.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.595+0000 7f7ddd3c8640 1 -- 172.21.15.123:0/2356001559 learned_addr learned my addr 172.21.15.123:0/2356001559 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:51.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.595+0000 7f7dddbc9640 1 --2- 172.21.15.123:0/2356001559 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7dd8158500 0x7f7dd8158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:51.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.595+0000 7f7ddcbc7640 1 --2- 172.21.15.123:0/2356001559 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7dd815e370 0x7f7dd815e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:51.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.595+0000 7f7ddd3c8640 1 -- 172.21.15.123:0/2356001559 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7dd815e370 msgr2=0x7f7dd815e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:51.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.596+0000 7f7ddd3c8640 1 --2- 172.21.15.123:0/2356001559 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7dd815e370 0x7f7dd815e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:51.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.596+0000 7f7ddd3c8640 1 -- 172.21.15.123:0/2356001559 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7dd8158500 msgr2=0x7f7dd8158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:51.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.596+0000 7f7ddd3c8640 1 --2- 172.21.15.123:0/2356001559 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7dd8158500 0x7f7dd8158980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:51.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.596+0000 7f7ddd3c8640 1 -- 172.21.15.123:0/2356001559 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dd815ed10 con 0x7f7dc40051c0 2024-09-15T23:23:51.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.596+0000 7f7ddcbc7640 1 --2- 172.21.15.123:0/2356001559 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7dd815e370 0x7f7dd815e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:23:51.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.596+0000 7f7dddbc9640 1 --2- 172.21.15.123:0/2356001559 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7dd8158500 0x7f7dd8158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:23:51.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.596+0000 7f7ddd3c8640 1 --2- 172.21.15.123:0/2356001559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7dc40051c0 0x7f7dd81f5420 secure :-1 s=READY pgs=2300 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400e4b0 tx=0x7f7dd400e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:51.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.596+0000 7f7dcdffb640 1 -- 172.21.15.123:0/2356001559 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd40052e0 con 0x7f7dc40051c0 2024-09-15T23:23:51.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.596+0000 7f7dcdffb640 1 -- 172.21.15.123:0/2356001559 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd4018070 con 0x7f7dc40051c0 2024-09-15T23:23:51.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.596+0000 7f7ddf62c640 1 -- 172.21.15.123:0/2356001559 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dd815d5b0 con 0x7f7dc40051c0 2024-09-15T23:23:51.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.596+0000 7f7dcdffb640 1 -- 172.21.15.123:0/2356001559 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4003830 con 0x7f7dc40051c0 2024-09-15T23:23:51.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.596+0000 7f7ddf62c640 1 -- 172.21.15.123:0/2356001559 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dd815db70 con 0x7f7dc40051c0 2024-09-15T23:23:51.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.597+0000 7f7ddf62c640 1 -- 172.21.15.123:0/2356001559 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dd815bcf0 con 0x7f7dc40051c0 2024-09-15T23:23:51.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.597+0000 7f7dcdffb640 1 -- 172.21.15.123:0/2356001559 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7dd40039d0 con 0x7f7dc40051c0 2024-09-15T23:23:51.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.598+0000 7f7dcdffb640 1 --2- 172.21.15.123:0/2356001559 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7dbc06c2b0 0x7f7dbc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:51.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.598+0000 7f7dcdffb640 1 -- 172.21.15.123:0/2356001559 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7f7dd408b0a0 con 0x7f7dc40051c0 2024-09-15T23:23:51.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.598+0000 7f7ddcbc7640 1 --2- 172.21.15.123:0/2356001559 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7dbc06c2b0 0x7f7dbc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:51.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.599+0000 7f7ddcbc7640 1 --2- 172.21.15.123:0/2356001559 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7dbc06c2b0 0x7f7dbc06e770 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f7dd80ccd80 tx=0x7f7dc8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:51.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.602+0000 7f7dcdffb640 1 -- 172.21.15.123:0/2356001559 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7dd4059770 con 0x7f7dc40051c0 2024-09-15T23:23:51.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.780+0000 7f7ddf62c640 1 -- 172.21.15.123:0/2356001559 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7dd806c9c0 con 0x7f7dc40051c0 2024-09-15T23:23:51.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.780+0000 7f7dcdffb640 1 -- 172.21.15.123:0/2356001559 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v194) ==== 80+0+0 (secure 0 0 0) 0x7f7dd4059070 con 0x7f7dc40051c0 2024-09-15T23:23:51.781 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-15T23:23:51.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.782+0000 7f7ddf62c640 1 -- 172.21.15.123:0/2356001559 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7dbc06c2b0 msgr2=0x7f7dbc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:51.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.782+0000 7f7ddf62c640 1 --2- 172.21.15.123:0/2356001559 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7dbc06c2b0 0x7f7dbc06e770 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f7dd80ccd80 tx=0x7f7dc8009040 comp rx=0 tx=0).stop 2024-09-15T23:23:51.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.782+0000 7f7ddf62c640 1 -- 172.21.15.123:0/2356001559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7dc40051c0 msgr2=0x7f7dd81f5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:51.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.782+0000 7f7ddf62c640 1 --2- 172.21.15.123:0/2356001559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7dc40051c0 0x7f7dd81f5420 secure :-1 s=READY pgs=2300 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400e4b0 tx=0x7f7dd400e970 comp rx=0 tx=0).stop 2024-09-15T23:23:51.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.782+0000 7f7ddf62c640 1 -- 172.21.15.123:0/2356001559 shutdown_connections 2024-09-15T23:23:51.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.782+0000 7f7ddf62c640 1 --2- 172.21.15.123:0/2356001559 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7dd8158500 0x7f7dd8158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:51.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.782+0000 7f7ddf62c640 1 --2- 172.21.15.123:0/2356001559 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7dd815e370 0x7f7dd815e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:51.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.782+0000 7f7ddf62c640 1 --2- 172.21.15.123:0/2356001559 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7dbc06c2b0 0x7f7dbc06e770 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:51.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.782+0000 7f7ddf62c640 1 --2- 172.21.15.123:0/2356001559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7dc40051c0 0x7f7dd81f5420 unknown :-1 s=CLOSED pgs=2300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:51.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.782+0000 7f7ddf62c640 1 -- 172.21.15.123:0/2356001559 >> 172.21.15.123:0/2356001559 conn(0x7f7dd80ccec0 msgr2=0x7f7dd815b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:51.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.782+0000 7f7ddf62c640 1 -- 172.21.15.123:0/2356001559 shutdown_connections 2024-09-15T23:23:51.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:51.782+0000 7f7ddf62c640 1 -- 172.21.15.123:0/2356001559 wait complete. 2024-09-15T23:23:51.794 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-15T23:23:51.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:23:51.794 DEBUG:teuthology.orchestra.run.smithi123:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-15T23:23:51.822 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-09-15T23:23:51.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:23:51.822 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T23:23:51.879 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:23:51.879 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:23:51.879 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:23:51.899 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:23:51.899 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:23:51.899 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:23:51.899 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:23:51.935 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:23:51.935 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:23:51.935 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:23:51.936 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:23:51.958 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:23:51.958 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:23:52.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.073+0000 7fb7f1ed0640 1 Processor -- start 2024-09-15T23:23:52.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.073+0000 7fb7f1ed0640 1 -- start start 2024-09-15T23:23:52.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.074+0000 7fb7f1ed0640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb7ec06cf30 0x7fb7ec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:52.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.074+0000 7fb7f1ed0640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7ec0cc990 con 0x7fb7ec15e6d0 2024-09-15T23:23:52.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.074+0000 7fb7f1ed0640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7ec162440 con 0x7fb7ec0cb980 2024-09-15T23:23:52.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.074+0000 7fb7f1ed0640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fb7ec0cc3d0 con 0x7fb7ec06cf30 2024-09-15T23:23:52.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.074+0000 7fb7ebfff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb7ec06cf30 0x7fb7ec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:52.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.074+0000 7fb7ebfff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb7ec06cf30 0x7fb7ec06d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48370/0 (socket says 172.21.15.123:48370) 2024-09-15T23:23:52.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.074+0000 7fb7ebfff640 1 -- 172.21.15.123:0/149390828 learned_addr learned my addr 172.21.15.123:0/149390828 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:52.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.074+0000 7fb7eb7fe640 1 --1- 172.21.15.123:0/149390828 >> v1:172.21.15.123:6789/0 conn(0x7fb7ec15e6d0 0x7fb7ec15f790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56448/0 (socket says 172.21.15.123:56448) 2024-09-15T23:23:52.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.074+0000 7fb7ebfff640 1 -- 172.21.15.123:0/149390828 >> v1:172.21.15.188:6789/0 conn(0x7fb7ec0cb980 legacy=0x7fb7ec162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:52.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.074+0000 7fb7ebfff640 1 -- 172.21.15.123:0/149390828 >> v1:172.21.15.123:6789/0 conn(0x7fb7ec15e6d0 legacy=0x7fb7ec15f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:52.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.074+0000 7fb7ea7fc640 1 -- 172.21.15.123:0/149390828 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2076527497 0 0) 0x7fb7ec0cc990 con 0x7fb7ec15e6d0 2024-09-15T23:23:52.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.074+0000 7fb7ebfff640 1 -- 172.21.15.123:0/149390828 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7ec0cc6b0 con 0x7fb7ec06cf30 2024-09-15T23:23:52.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.075+0000 7fb7ebfff640 1 --2- 172.21.15.123:0/149390828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7ec06cf30 0x7fb7ec06d3c0 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4009870 tx=0x7fb7e402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bde6c73ffcb65d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:52.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.075+0000 7fb7ea7fc640 1 -- 172.21.15.123:0/149390828 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e4037070 con 0x7fb7ec06cf30 2024-09-15T23:23:52.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.075+0000 7fb7ea7fc640 1 -- 172.21.15.123:0/149390828 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e4032440 con 0x7fb7ec06cf30 2024-09-15T23:23:52.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.075+0000 7fb7ea7fc640 1 -- 172.21.15.123:0/149390828 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e4032810 con 0x7fb7ec06cf30 2024-09-15T23:23:52.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.076+0000 7fb7f1ed0640 1 -- 172.21.15.123:0/149390828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7ec06cf30 msgr2=0x7fb7ec06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:52.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.076+0000 7fb7f1ed0640 1 --2- 172.21.15.123:0/149390828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7ec06cf30 0x7fb7ec06d3c0 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4009870 tx=0x7fb7e402a180 comp rx=0 tx=0).stop 2024-09-15T23:23:52.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.076+0000 7fb7f1ed0640 1 -- 172.21.15.123:0/149390828 shutdown_connections 2024-09-15T23:23:52.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.076+0000 7fb7f1ed0640 1 --2- 172.21.15.123:0/149390828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7ec06cf30 0x7fb7ec06d3c0 unknown :-1 s=CLOSED pgs=2302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:52.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.076+0000 7fb7f1ed0640 1 -- 172.21.15.123:0/149390828 >> 172.21.15.123:0/149390828 conn(0x7fb7ec0b4300 msgr2=0x7fb7ec0b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:52.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.076+0000 7fb7f1ed0640 1 -- 172.21.15.123:0/149390828 shutdown_connections 2024-09-15T23:23:52.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.076+0000 7fb7f1ed0640 1 -- 172.21.15.123:0/149390828 wait complete. 2024-09-15T23:23:52.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.077+0000 7fb7f1ed0640 1 Processor -- start 2024-09-15T23:23:52.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.077+0000 7fb7f1ed0640 1 -- start start 2024-09-15T23:23:52.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.078+0000 7fb7f1ed0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb7ec06cf30 0x7fb7ec0b6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:52.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.078+0000 7fb7f1ed0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7ec0cb980 0x7fb7ec0cf540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:52.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.078+0000 7fb7f1ed0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb7ec15e6d0 0x7fb7ec0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:52.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.078+0000 7fb7f1ed0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ec15ec30 con 0x7fb7ec0cb980 2024-09-15T23:23:52.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.078+0000 7fb7f1ed0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ec15eab0 con 0x7fb7ec15e6d0 2024-09-15T23:23:52.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.078+0000 7fb7f1ed0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb7ec0709a0 con 0x7fb7ec06cf30 2024-09-15T23:23:52.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.078+0000 7fb7eaffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7ec0cb980 0x7fb7ec0cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:52.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.078+0000 7fb7eaffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7ec0cb980 0x7fb7ec0cf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48372/0 (socket says 172.21.15.123:48372) 2024-09-15T23:23:52.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.078+0000 7fb7eaffd640 1 -- 172.21.15.123:0/4130630878 learned_addr learned my addr 172.21.15.123:0/4130630878 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:52.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.078+0000 7fb7eaffd640 1 -- 172.21.15.123:0/4130630878 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb7ec06cf30 msgr2=0x7fb7ec0b6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:52.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.078+0000 7fb7eaffd640 1 --2- 172.21.15.123:0/4130630878 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb7ec06cf30 0x7fb7ec0b6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:52.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.078+0000 7fb7eaffd640 1 -- 172.21.15.123:0/4130630878 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb7ec15e6d0 msgr2=0x7fb7ec0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:52.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.078+0000 7fb7eaffd640 1 --2- 172.21.15.123:0/4130630878 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb7ec15e6d0 0x7fb7ec0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:52.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.078+0000 7fb7eaffd640 1 -- 172.21.15.123:0/4130630878 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7ec0cdc80 con 0x7fb7ec0cb980 2024-09-15T23:23:52.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.079+0000 7fb7eaffd640 1 --2- 172.21.15.123:0/4130630878 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7ec0cb980 0x7fb7ec0cf540 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000c430 tx=0x7fb7e000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:52.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.079+0000 7fb7d3fff640 1 -- 172.21.15.123:0/4130630878 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0011790 con 0x7fb7ec0cb980 2024-09-15T23:23:52.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.079+0000 7fb7d3fff640 1 -- 172.21.15.123:0/4130630878 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e0017070 con 0x7fb7ec0cb980 2024-09-15T23:23:52.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.079+0000 7fb7f1ed0640 1 -- 172.21.15.123:0/4130630878 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7ec15dcf0 con 0x7fb7ec0cb980 2024-09-15T23:23:52.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.079+0000 7fb7d3fff640 1 -- 172.21.15.123:0/4130630878 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0011b70 con 0x7fb7ec0cb980 2024-09-15T23:23:52.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.079+0000 7fb7f1ed0640 1 -- 172.21.15.123:0/4130630878 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7ec0ce200 con 0x7fb7ec0cb980 2024-09-15T23:23:52.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.080+0000 7fb7f1ed0640 1 -- 172.21.15.123:0/4130630878 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7ec06d3c0 con 0x7fb7ec0cb980 2024-09-15T23:23:52.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.080+0000 7fb7d3fff640 1 -- 172.21.15.123:0/4130630878 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb7e0011d10 con 0x7fb7ec0cb980 2024-09-15T23:23:52.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.081+0000 7fb7d3fff640 1 --2- 172.21.15.123:0/4130630878 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb7d806c2b0 0x7fb7d806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:52.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.081+0000 7fb7d3fff640 1 -- 172.21.15.123:0/4130630878 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7fb7e008b280 con 0x7fb7ec0cb980 2024-09-15T23:23:52.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.081+0000 7fb7eb7fe640 1 --2- 172.21.15.123:0/4130630878 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb7d806c2b0 0x7fb7d806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:52.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.082+0000 7fb7eb7fe640 1 --2- 172.21.15.123:0/4130630878 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb7d806c2b0 0x7fb7d806e770 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc007fd0 tx=0x7fb7dc007ce0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:52.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.085+0000 7fb7d3fff640 1 -- 172.21.15.123:0/4130630878 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb7e00599f0 con 0x7fb7ec0cb980 2024-09-15T23:23:52.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.284+0000 7fb7f1ed0640 1 -- 172.21.15.123:0/4130630878 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb7ec15ad30 con 0x7fb7ec0cb980 2024-09-15T23:23:52.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.284+0000 7fb7d3fff640 1 -- 172.21.15.123:0/4130630878 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) ==== 95+0+5248 (secure 0 0 0) 0x7fb7e00592f0 con 0x7fb7ec0cb980 2024-09-15T23:23:52.286 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:23:52.286 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":120,"btime":"2024-09-15T23:23:11:879993+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8785,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2171656296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2171656296},{"type":"v1","addr":"172.21.15.188:6836","nonce":2171656296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":8788,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/136119431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":136119431},{"type":"v1","addr":"172.21.15.188:6837","nonce":136119431}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":10473,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/2374047694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2374047694},{"type":"v1","addr":"172.21.15.123:6833","nonce":2374047694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":120,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:23:09.208435+0000","modified":"2024-09-15T23:23:11.247532+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10491},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10491":{"gid":10491,"name":"a","rank":0,"incarnation":118,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/2653908784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2653908784},{"type":"v1","addr":"172.21.15.123:6835","nonce":2653908784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10491,"qdb_cluster":[10491]},"id":13}]} 2024-09-15T23:23:52.286 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 120 2024-09-15T23:23:52.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.286+0000 7fb7f1ed0640 1 -- 172.21.15.123:0/4130630878 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb7d806c2b0 msgr2=0x7fb7d806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:52.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.286+0000 7fb7f1ed0640 1 --2- 172.21.15.123:0/4130630878 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb7d806c2b0 0x7fb7d806e770 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc007fd0 tx=0x7fb7dc007ce0 comp rx=0 tx=0).stop 2024-09-15T23:23:52.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.286+0000 7fb7f1ed0640 1 -- 172.21.15.123:0/4130630878 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7ec0cb980 msgr2=0x7fb7ec0cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:52.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.286+0000 7fb7f1ed0640 1 --2- 172.21.15.123:0/4130630878 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7ec0cb980 0x7fb7ec0cf540 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000c430 tx=0x7fb7e000c8f0 comp rx=0 tx=0).stop 2024-09-15T23:23:52.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.287+0000 7fb7f1ed0640 1 -- 172.21.15.123:0/4130630878 shutdown_connections 2024-09-15T23:23:52.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.287+0000 7fb7f1ed0640 1 --2- 172.21.15.123:0/4130630878 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb7ec15e6d0 0x7fb7ec0cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:52.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.287+0000 7fb7f1ed0640 1 --2- 172.21.15.123:0/4130630878 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb7d806c2b0 0x7fb7d806e770 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:52.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.287+0000 7fb7f1ed0640 1 --2- 172.21.15.123:0/4130630878 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7ec0cb980 0x7fb7ec0cf540 unknown :-1 s=CLOSED pgs=2303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:52.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.287+0000 7fb7f1ed0640 1 --2- 172.21.15.123:0/4130630878 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb7ec06cf30 0x7fb7ec0b6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:52.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.287+0000 7fb7f1ed0640 1 -- 172.21.15.123:0/4130630878 >> 172.21.15.123:0/4130630878 conn(0x7fb7ec0b4300 msgr2=0x7fb7ec073140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:52.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.287+0000 7fb7f1ed0640 1 -- 172.21.15.123:0/4130630878 shutdown_connections 2024-09-15T23:23:52.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.287+0000 7fb7f1ed0640 1 -- 172.21.15.123:0/4130630878 wait complete. 2024-09-15T23:23:52.299 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:23:52.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.397+0000 7f23c31fd640 1 Processor -- start 2024-09-15T23:23:52.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.397+0000 7f23c31fd640 1 -- start start 2024-09-15T23:23:52.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.398+0000 7f23c31fd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f23bc162c60 0x7f23bc073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:52.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.398+0000 7f23c31fd640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23bc1631c0 con 0x7f23bc15e790 2024-09-15T23:23:52.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.398+0000 7f23c31fd640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23bc0ae9a0 con 0x7f23bc06f730 2024-09-15T23:23:52.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.398+0000 7f23c31fd640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f23bc15eb70 con 0x7f23bc162c60 2024-09-15T23:23:52.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.398+0000 7f23c0f99640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f23bc15e790 0x7f23bc0b5430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56462/0 (socket says 172.21.15.123:56462) 2024-09-15T23:23:52.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.398+0000 7f23c0f99640 1 -- 172.21.15.123:0/2206060547 learned_addr learned my addr 172.21.15.123:0/2206060547 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:23:52.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.398+0000 7f23bb7fe640 1 -- 172.21.15.123:0/2206060547 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 154915505 0 0) 0x7f23bc1631c0 con 0x7f23bc15e790 2024-09-15T23:23:52.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.398+0000 7f23bb7fe640 1 -- 172.21.15.123:0/2206060547 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23ac003520 con 0x7f23bc15e790 2024-09-15T23:23:52.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.398+0000 7f23bbfff640 1 --2- 172.21.15.123:0/2206060547 >> v2:172.21.15.188:3300/0 conn(0x7f23bc162c60 0x7f23bc073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:52.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.398+0000 7f23bb7fe640 1 -- 172.21.15.123:0/2206060547 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 91631725 0 0) 0x7f23ac003520 con 0x7f23bc15e790 2024-09-15T23:23:52.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.398+0000 7f23bb7fe640 1 -- 172.21.15.123:0/2206060547 >> v2:172.21.15.188:3300/0 conn(0x7f23bc162c60 msgr2=0x7f23bc073a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:52.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.398+0000 7f23bb7fe640 1 --2- 172.21.15.123:0/2206060547 >> v2:172.21.15.188:3300/0 conn(0x7f23bc162c60 0x7f23bc073a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:52.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.398+0000 7f23bb7fe640 1 -- 172.21.15.123:0/2206060547 >> v1:172.21.15.188:6789/0 conn(0x7f23bc06f730 legacy=0x7f23bc0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:52.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.398+0000 7f23bb7fe640 1 -- 172.21.15.123:0/2206060547 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23bc0aec40 con 0x7f23bc15e790 2024-09-15T23:23:52.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.398+0000 7f23bb7fe640 1 -- 172.21.15.123:0/2206060547 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f23b0001670 con 0x7f23bc15e790 2024-09-15T23:23:52.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.398+0000 7f23bb7fe640 1 -- 172.21.15.123:0/2206060547 >> v1:172.21.15.123:6789/0 conn(0x7f23bc15e790 legacy=0x7f23bc0b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:52.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.398+0000 7f23bb7fe640 1 --2- 172.21.15.123:0/2206060547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23ac0039b0 0x7f23ac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:52.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.398+0000 7f23bb7fe640 1 --2- 172.21.15.123:0/2206060547 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f23ac004800 0x7f23ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:52.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.398+0000 7f23bb7fe640 1 --2- 172.21.15.123:0/2206060547 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f23ac0052e0 0x7f23ac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:52.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.398+0000 7f23bb7fe640 1 -- 172.21.15.123:0/2206060547 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f23ac00c180 con 0x7f23ac0039b0 2024-09-15T23:23:52.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.398+0000 7f23bb7fe640 1 -- 172.21.15.123:0/2206060547 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f23ac00c330 con 0x7f23ac004800 2024-09-15T23:23:52.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.398+0000 7f23bb7fe640 1 -- 172.21.15.123:0/2206060547 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f23ac00c530 con 0x7f23ac0052e0 2024-09-15T23:23:52.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.398+0000 7f23bbfff640 1 --2- 172.21.15.123:0/2206060547 >> v2:172.21.15.188:3300/0 conn(0x7f23bc162c60 0x7f23bc073a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:23:52.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.398+0000 7f23c0f99640 1 --2- 172.21.15.123:0/2206060547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23ac0039b0 0x7f23ac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:52.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.399+0000 7f23c179a640 1 --2- 172.21.15.123:0/2206060547 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f23ac0052e0 0x7f23ac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:52.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.399+0000 7f23bbfff640 1 --2- 172.21.15.123:0/2206060547 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f23ac004800 0x7f23ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:52.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.399+0000 7f23c0f99640 1 -- 172.21.15.123:0/2206060547 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f23ac0052e0 msgr2=0x7f23ac00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:52.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.399+0000 7f23c0f99640 1 --2- 172.21.15.123:0/2206060547 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f23ac0052e0 0x7f23ac00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:52.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.399+0000 7f23c0f99640 1 -- 172.21.15.123:0/2206060547 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f23ac004800 msgr2=0x7f23ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:52.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.399+0000 7f23c0f99640 1 --2- 172.21.15.123:0/2206060547 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f23ac004800 0x7f23ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:52.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.399+0000 7f23c0f99640 1 -- 172.21.15.123:0/2206060547 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23ac003520 con 0x7f23ac0039b0 2024-09-15T23:23:52.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.399+0000 7f23c179a640 1 -- 172.21.15.123:0/2206060547 reap_dead start 2024-09-15T23:23:52.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.399+0000 7f23c0f99640 1 --2- 172.21.15.123:0/2206060547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23ac0039b0 0x7f23ac003dd0 secure :-1 s=READY pgs=2305 cs=0 l=1 rev1=1 crypto rx=0x7f23b000c210 tx=0x7f23ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc41f04cc971da server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:52.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.399+0000 7f23bb7fe640 1 -- 172.21.15.123:0/2206060547 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b0007d10 con 0x7f23ac0039b0 2024-09-15T23:23:52.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.400+0000 7f23bb7fe640 1 -- 172.21.15.123:0/2206060547 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b0005ad0 con 0x7f23ac0039b0 2024-09-15T23:23:52.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.400+0000 7f23bb7fe640 1 -- 172.21.15.123:0/2206060547 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b0007070 con 0x7f23ac0039b0 2024-09-15T23:23:52.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.400+0000 7f23c31fd640 1 -- 172.21.15.123:0/2206060547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23ac0039b0 msgr2=0x7f23ac003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:52.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.400+0000 7f23c31fd640 1 --2- 172.21.15.123:0/2206060547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23ac0039b0 0x7f23ac003dd0 secure :-1 s=READY pgs=2305 cs=0 l=1 rev1=1 crypto rx=0x7f23b000c210 tx=0x7f23ac005830 comp rx=0 tx=0).stop 2024-09-15T23:23:52.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.400+0000 7f23c31fd640 1 -- 172.21.15.123:0/2206060547 shutdown_connections 2024-09-15T23:23:52.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.400+0000 7f23c31fd640 1 --2- 172.21.15.123:0/2206060547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23ac0039b0 0x7f23ac003dd0 unknown :-1 s=CLOSED pgs=2305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:52.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.400+0000 7f23c31fd640 1 -- 172.21.15.123:0/2206060547 >> 172.21.15.123:0/2206060547 conn(0x7f23bc0b0a80 msgr2=0x7f23bc0b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:52.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.400+0000 7f23c31fd640 1 -- 172.21.15.123:0/2206060547 shutdown_connections 2024-09-15T23:23:52.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.400+0000 7f23c31fd640 1 -- 172.21.15.123:0/2206060547 wait complete. 2024-09-15T23:23:52.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.401+0000 7f23c31fd640 1 Processor -- start 2024-09-15T23:23:52.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.401+0000 7f23c31fd640 1 -- start start 2024-09-15T23:23:52.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.402+0000 7f23c31fd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f23ac0039b0 0x7f23bc0d02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:52.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.402+0000 7f23c31fd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23bc1ee390 0x7f23bc14fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:52.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.402+0000 7f23c31fd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f23bc1ee810 0x7f23bc0cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:52.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.402+0000 7f23c31fd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc06f430 con 0x7f23bc1ee390 2024-09-15T23:23:52.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.402+0000 7f23c31fd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f23bc0af200 con 0x7f23bc1ee810 2024-09-15T23:23:52.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.402+0000 7f23c31fd640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f23bc073a40 con 0x7f23ac0039b0 2024-09-15T23:23:52.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.402+0000 7f23bbfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23bc1ee390 0x7f23bc14fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:52.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.402+0000 7f23bbfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23bc1ee390 0x7f23bc14fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48386/0 (socket says 172.21.15.123:48386) 2024-09-15T23:23:52.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.402+0000 7f23bbfff640 1 -- 172.21.15.123:0/3954876801 learned_addr learned my addr 172.21.15.123:0/3954876801 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:52.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.402+0000 7f23c179a640 1 --2- 172.21.15.123:0/3954876801 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f23bc1ee810 0x7f23bc0cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:52.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.402+0000 7f23c0f99640 1 --2- 172.21.15.123:0/3954876801 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f23ac0039b0 0x7f23bc0d02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:52.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.403+0000 7f23bbfff640 1 -- 172.21.15.123:0/3954876801 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f23ac0039b0 msgr2=0x7f23bc0d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:52.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.403+0000 7f23bbfff640 1 --2- 172.21.15.123:0/3954876801 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f23ac0039b0 0x7f23bc0d02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:52.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.403+0000 7f23bbfff640 1 -- 172.21.15.123:0/3954876801 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f23bc1ee810 msgr2=0x7f23bc0cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:52.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.403+0000 7f23bbfff640 1 --2- 172.21.15.123:0/3954876801 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f23bc1ee810 0x7f23bc0cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:52.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.403+0000 7f23bbfff640 1 -- 172.21.15.123:0/3954876801 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23bc150390 con 0x7f23bc1ee390 2024-09-15T23:23:52.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.403+0000 7f23bbfff640 1 --2- 172.21.15.123:0/3954876801 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23bc1ee390 0x7f23bc14fa40 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7f23a8010810 tx=0x7f23a8010cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:52.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.403+0000 7f23b97fa640 1 -- 172.21.15.123:0/3954876801 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a801a020 con 0x7f23bc1ee390 2024-09-15T23:23:52.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.403+0000 7f23b97fa640 1 -- 172.21.15.123:0/3954876801 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23a800e950 con 0x7f23bc1ee390 2024-09-15T23:23:52.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.403+0000 7f23c31fd640 1 -- 172.21.15.123:0/3954876801 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23bc150670 con 0x7f23bc1ee390 2024-09-15T23:23:52.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.403+0000 7f23b97fa640 1 -- 172.21.15.123:0/3954876801 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a800f040 con 0x7f23bc1ee390 2024-09-15T23:23:52.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.403+0000 7f23c31fd640 1 -- 172.21.15.123:0/3954876801 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23bc15fb00 con 0x7f23bc1ee390 2024-09-15T23:23:52.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.404+0000 7f23c31fd640 1 -- 172.21.15.123:0/3954876801 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23bc06fb80 con 0x7f23bc1ee390 2024-09-15T23:23:52.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.405+0000 7f23b97fa640 1 -- 172.21.15.123:0/3954876801 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f23a801d020 con 0x7f23bc1ee390 2024-09-15T23:23:52.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.405+0000 7f23b97fa640 1 --2- 172.21.15.123:0/3954876801 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f23a006c2b0 0x7f23a006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:52.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.405+0000 7f23b97fa640 1 -- 172.21.15.123:0/3954876801 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7f23a808ba70 con 0x7f23bc1ee390 2024-09-15T23:23:52.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.405+0000 7f23c0f99640 1 --2- 172.21.15.123:0/3954876801 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f23a006c2b0 0x7f23a006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:52.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.406+0000 7f23c0f99640 1 --2- 172.21.15.123:0/3954876801 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f23a006c2b0 0x7f23a006e770 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f23b0032000 tx=0x7f23b002d000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:52.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.409+0000 7f23b97fa640 1 -- 172.21.15.123:0/3954876801 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f23a8024020 con 0x7f23bc1ee390 2024-09-15T23:23:52.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.606+0000 7f23c31fd640 1 -- 172.21.15.123:0/3954876801 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f23bc073590 con 0x7f23bc1ee390 2024-09-15T23:23:52.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.606+0000 7f23b97fa640 1 -- 172.21.15.123:0/3954876801 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) ==== 95+0+5248 (secure 0 0 0) 0x7f23a8059c20 con 0x7f23bc1ee390 2024-09-15T23:23:52.608 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:23:52.608 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":120,"btime":"2024-09-15T23:23:11:879993+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8785,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2171656296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2171656296},{"type":"v1","addr":"172.21.15.188:6836","nonce":2171656296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":8788,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/136119431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":136119431},{"type":"v1","addr":"172.21.15.188:6837","nonce":136119431}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":10473,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/2374047694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2374047694},{"type":"v1","addr":"172.21.15.123:6833","nonce":2374047694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":120,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:23:09.208435+0000","modified":"2024-09-15T23:23:11.247532+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10491},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10491":{"gid":10491,"name":"a","rank":0,"incarnation":118,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/2653908784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2653908784},{"type":"v1","addr":"172.21.15.123:6835","nonce":2653908784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10491,"qdb_cluster":[10491]},"id":13}]} 2024-09-15T23:23:52.608 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 120 2024-09-15T23:23:52.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.608+0000 7f23c31fd640 1 -- 172.21.15.123:0/3954876801 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f23a006c2b0 msgr2=0x7f23a006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:52.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.608+0000 7f23c31fd640 1 --2- 172.21.15.123:0/3954876801 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f23a006c2b0 0x7f23a006e770 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f23b0032000 tx=0x7f23b002d000 comp rx=0 tx=0).stop 2024-09-15T23:23:52.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.608+0000 7f23c31fd640 1 -- 172.21.15.123:0/3954876801 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23bc1ee390 msgr2=0x7f23bc14fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:52.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.608+0000 7f23c31fd640 1 --2- 172.21.15.123:0/3954876801 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23bc1ee390 0x7f23bc14fa40 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7f23a8010810 tx=0x7f23a8010cd0 comp rx=0 tx=0).stop 2024-09-15T23:23:52.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.608+0000 7f23c31fd640 1 -- 172.21.15.123:0/3954876801 shutdown_connections 2024-09-15T23:23:52.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.608+0000 7f23c31fd640 1 --2- 172.21.15.123:0/3954876801 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f23bc1ee810 0x7f23bc0cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:52.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.608+0000 7f23c31fd640 1 --2- 172.21.15.123:0/3954876801 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f23a006c2b0 0x7f23a006e770 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:52.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.608+0000 7f23c31fd640 1 --2- 172.21.15.123:0/3954876801 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f23bc1ee390 0x7f23bc14fa40 unknown :-1 s=CLOSED pgs=2306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:52.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.608+0000 7f23c31fd640 1 --2- 172.21.15.123:0/3954876801 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f23ac0039b0 0x7f23bc0d02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:52.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.608+0000 7f23c31fd640 1 -- 172.21.15.123:0/3954876801 >> 172.21.15.123:0/3954876801 conn(0x7f23bc0b0a80 msgr2=0x7f23bc071e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:52.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.608+0000 7f23c31fd640 1 -- 172.21.15.123:0/3954876801 shutdown_connections 2024-09-15T23:23:52.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.608+0000 7f23c31fd640 1 -- 172.21.15.123:0/3954876801 wait complete. 2024-09-15T23:23:52.620 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:23:52.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.717+0000 7ff018f03640 1 Processor -- start 2024-09-15T23:23:52.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.717+0000 7ff018f03640 1 -- start start 2024-09-15T23:23:52.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.718+0000 7ff018f03640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff01406bc10 0x7ff01406bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:52.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.718+0000 7ff018f03640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff0140b3790 0x7ff0141624e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:52.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.718+0000 7ff018f03640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff01406c530 con 0x7ff0140cef60 2024-09-15T23:23:52.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.718+0000 7ff018f03640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7ff0140cd690 con 0x7ff0140b3790 2024-09-15T23:23:52.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.718+0000 7ff018f03640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ff0140d06f0 con 0x7ff01406bc10 2024-09-15T23:23:52.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.718+0000 7ff012d9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff0140b3790 0x7ff0141624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:52.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.718+0000 7ff012d9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff0140b3790 0x7ff0141624e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48398/0 (socket says 172.21.15.123:48398) 2024-09-15T23:23:52.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.718+0000 7ff012d9d640 1 -- 172.21.15.123:0/890517957 learned_addr learned my addr 172.21.15.123:0/890517957 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:52.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.718+0000 7ff012d9d640 1 -- 172.21.15.123:0/890517957 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff01406bc10 msgr2=0x7ff01406bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:52.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.718+0000 7ff01259c640 1 --2- 172.21.15.123:0/890517957 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff01406bc10 0x7ff01406bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:52.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.718+0000 7ff012d9d640 1 --2- 172.21.15.123:0/890517957 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff01406bc10 0x7ff01406bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:52.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.718+0000 7ff012d9d640 1 -- 172.21.15.123:0/890517957 >> v1:172.21.15.188:6789/0 conn(0x7ff0140cef60 legacy=0x7ff01415eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:52.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.718+0000 7ff012d9d640 1 -- 172.21.15.123:0/890517957 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0140b4090 con 0x7ff0140b3790 2024-09-15T23:23:52.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.719+0000 7ff012d9d640 1 --2- 172.21.15.123:0/890517957 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0140b3790 0x7ff0141624e0 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7ff0040098a0 tx=0x7ff00402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a16e18b6807b3b08 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:52.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.719+0000 7ff01159a640 1 -- 172.21.15.123:0/890517957 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff004037070 con 0x7ff0140b3790 2024-09-15T23:23:52.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.719+0000 7ff01159a640 1 -- 172.21.15.123:0/890517957 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff004032440 con 0x7ff0140b3790 2024-09-15T23:23:52.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.719+0000 7ff01159a640 1 -- 172.21.15.123:0/890517957 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff004032810 con 0x7ff0140b3790 2024-09-15T23:23:52.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.720+0000 7ff018f03640 1 -- 172.21.15.123:0/890517957 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0140b3790 msgr2=0x7ff0141624e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:52.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.720+0000 7ff018f03640 1 --2- 172.21.15.123:0/890517957 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0140b3790 0x7ff0141624e0 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7ff0040098a0 tx=0x7ff00402a250 comp rx=0 tx=0).stop 2024-09-15T23:23:52.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.720+0000 7ff018f03640 1 -- 172.21.15.123:0/890517957 shutdown_connections 2024-09-15T23:23:52.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.720+0000 7ff018f03640 1 --2- 172.21.15.123:0/890517957 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0140b3790 0x7ff0141624e0 unknown :-1 s=CLOSED pgs=2307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:52.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.720+0000 7ff018f03640 1 --2- 172.21.15.123:0/890517957 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff01406bc10 0x7ff01406bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:52.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.720+0000 7ff018f03640 1 -- 172.21.15.123:0/890517957 >> 172.21.15.123:0/890517957 conn(0x7ff01406cd20 msgr2=0x7ff01406d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:52.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.720+0000 7ff018f03640 1 -- 172.21.15.123:0/890517957 shutdown_connections 2024-09-15T23:23:52.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.720+0000 7ff018f03640 1 -- 172.21.15.123:0/890517957 wait complete. 2024-09-15T23:23:52.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.721+0000 7ff018f03640 1 Processor -- start 2024-09-15T23:23:52.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.721+0000 7ff018f03640 1 -- start start 2024-09-15T23:23:52.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.722+0000 7ff018f03640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff01406bc10 0x7ff0141f4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:52.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.722+0000 7ff018f03640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0140b3790 0x7ff01414bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:52.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.722+0000 7ff018f03640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0140cef60 0x7ff0141593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:52.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.722+0000 7ff018f03640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff0140d0f10 con 0x7ff0140cef60 2024-09-15T23:23:52.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.722+0000 7ff018f03640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff0140d0c30 con 0x7ff0140b3790 2024-09-15T23:23:52.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.722+0000 7ff018f03640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ff0140b3c40 con 0x7ff01406bc10 2024-09-15T23:23:52.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.722+0000 7ff012d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0140cef60 0x7ff0141593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:52.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.722+0000 7ff012d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0140cef60 0x7ff0141593a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48414/0 (socket says 172.21.15.123:48414) 2024-09-15T23:23:52.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.722+0000 7ff012d9d640 1 -- 172.21.15.123:0/565635440 learned_addr learned my addr 172.21.15.123:0/565635440 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:52.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.722+0000 7ff01259c640 1 --2- 172.21.15.123:0/565635440 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff01406bc10 0x7ff0141f4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:52.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.722+0000 7ff011d9b640 1 --2- 172.21.15.123:0/565635440 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0140b3790 0x7ff01414bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:52.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.722+0000 7ff012d9d640 1 -- 172.21.15.123:0/565635440 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff01406bc10 msgr2=0x7ff0141f4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:52.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.722+0000 7ff012d9d640 1 --2- 172.21.15.123:0/565635440 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff01406bc10 0x7ff0141f4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:52.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.722+0000 7ff012d9d640 1 -- 172.21.15.123:0/565635440 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0140b3790 msgr2=0x7ff01414bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:52.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.722+0000 7ff012d9d640 1 --2- 172.21.15.123:0/565635440 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0140b3790 0x7ff01414bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:52.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.722+0000 7ff012d9d640 1 -- 172.21.15.123:0/565635440 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff014157f30 con 0x7ff0140cef60 2024-09-15T23:23:52.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.722+0000 7ff011d9b640 1 --2- 172.21.15.123:0/565635440 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0140b3790 0x7ff01414bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:23:52.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.722+0000 7ff012d9d640 1 --2- 172.21.15.123:0/565635440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0140cef60 0x7ff0141593a0 secure :-1 s=READY pgs=2308 cs=0 l=1 rev1=1 crypto rx=0x7ff0040098a0 tx=0x7ff0040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:52.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.723+0000 7ff002ffd640 1 -- 172.21.15.123:0/565635440 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff004041020 con 0x7ff0140cef60 2024-09-15T23:23:52.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.723+0000 7ff002ffd640 1 -- 172.21.15.123:0/565635440 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff004030800 con 0x7ff0140cef60 2024-09-15T23:23:52.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.723+0000 7ff018f03640 1 -- 172.21.15.123:0/565635440 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff01415a4f0 con 0x7ff0140cef60 2024-09-15T23:23:52.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.723+0000 7ff002ffd640 1 -- 172.21.15.123:0/565635440 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff004037040 con 0x7ff0140cef60 2024-09-15T23:23:52.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.723+0000 7ff018f03640 1 -- 172.21.15.123:0/565635440 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff01415aab0 con 0x7ff0140cef60 2024-09-15T23:23:52.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.724+0000 7ff018f03640 1 -- 172.21.15.123:0/565635440 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff01406bff0 con 0x7ff0140cef60 2024-09-15T23:23:52.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.724+0000 7ff002ffd640 1 -- 172.21.15.123:0/565635440 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff004044020 con 0x7ff0140cef60 2024-09-15T23:23:52.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.725+0000 7ff002ffd640 1 --2- 172.21.15.123:0/565635440 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7feff406c2b0 0x7feff406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:52.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.725+0000 7ff002ffd640 1 -- 172.21.15.123:0/565635440 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7ff0040abd40 con 0x7ff0140cef60 2024-09-15T23:23:52.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.725+0000 7ff01259c640 1 --2- 172.21.15.123:0/565635440 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7feff406c2b0 0x7feff406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:52.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.725+0000 7ff01259c640 1 --2- 172.21.15.123:0/565635440 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7feff406c2b0 0x7feff406e770 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7ff00c00f360 tx=0x7ff00c007710 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:52.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.729+0000 7ff002ffd640 1 -- 172.21.15.123:0/565635440 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff00404b030 con 0x7ff0140cef60 2024-09-15T23:23:52.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.893+0000 7ff018f03640 1 -- 172.21.15.123:0/565635440 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff014161ce0 con 0x7ff0140cef60 2024-09-15T23:23:52.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.894+0000 7ff002ffd640 1 -- 172.21.15.123:0/565635440 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v194) ==== 74+0+16699 (secure 0 0 0) 0x7ff00407a420 con 0x7ff0140cef60 2024-09-15T23:23:52.896 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:23:52.897 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":194,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:23:10.873327+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:23:07.827379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"193","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-15T23:23:08.184780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"194","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:23:52.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.896+0000 7ff018f03640 1 -- 172.21.15.123:0/565635440 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7feff406c2b0 msgr2=0x7feff406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:52.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.896+0000 7ff018f03640 1 --2- 172.21.15.123:0/565635440 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7feff406c2b0 0x7feff406e770 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7ff00c00f360 tx=0x7ff00c007710 comp rx=0 tx=0).stop 2024-09-15T23:23:52.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.896+0000 7ff018f03640 1 -- 172.21.15.123:0/565635440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0140cef60 msgr2=0x7ff0141593a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:52.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.896+0000 7ff018f03640 1 --2- 172.21.15.123:0/565635440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0140cef60 0x7ff0141593a0 secure :-1 s=READY pgs=2308 cs=0 l=1 rev1=1 crypto rx=0x7ff0040098a0 tx=0x7ff0040046c0 comp rx=0 tx=0).stop 2024-09-15T23:23:52.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.896+0000 7ff018f03640 1 -- 172.21.15.123:0/565635440 shutdown_connections 2024-09-15T23:23:52.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.896+0000 7ff018f03640 1 --2- 172.21.15.123:0/565635440 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7feff406c2b0 0x7feff406e770 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:52.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.896+0000 7ff018f03640 1 --2- 172.21.15.123:0/565635440 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0140cef60 0x7ff0141593a0 unknown :-1 s=CLOSED pgs=2308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:52.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.896+0000 7ff018f03640 1 --2- 172.21.15.123:0/565635440 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff0140b3790 0x7ff01414bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:52.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.896+0000 7ff018f03640 1 --2- 172.21.15.123:0/565635440 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff01406bc10 0x7ff0141f4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:52.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.897+0000 7ff018f03640 1 -- 172.21.15.123:0/565635440 >> 172.21.15.123:0/565635440 conn(0x7ff01406cd20 msgr2=0x7ff014160110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:52.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.897+0000 7ff018f03640 1 -- 172.21.15.123:0/565635440 shutdown_connections 2024-09-15T23:23:52.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:52.897+0000 7ff018f03640 1 -- 172.21.15.123:0/565635440 wait complete. 2024-09-15T23:23:52.909 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T23:23:52.909 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:23:53.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.007+0000 7f35055cd640 1 Processor -- start 2024-09-15T23:23:53.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.007+0000 7f35055cd640 1 -- start start 2024-09-15T23:23:53.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.008+0000 7f35055cd640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f350015e6d0 0x7f3500071390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:53.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.008+0000 7f35055cd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f350006cd20 0x7f35000b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:53.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.008+0000 7f35055cd640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f350015eab0 con 0x7f3500070b80 2024-09-15T23:23:53.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.008+0000 7f35055cd640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f350015ed70 con 0x7f350006cd20 2024-09-15T23:23:53.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.008+0000 7f35055cd640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f350015f050 con 0x7f350015e6d0 2024-09-15T23:23:53.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.008+0000 7f34fe7fc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f350006cd20 0x7f35000b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:53.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.008+0000 7f34ff7fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f3500070b80 0x7f35000731a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56470/0 (socket says 172.21.15.123:56470) 2024-09-15T23:23:53.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.008+0000 7f34fe7fc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f350006cd20 0x7f35000b6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48426/0 (socket says 172.21.15.123:48426) 2024-09-15T23:23:53.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.008+0000 7f34ff7fe640 1 -- 172.21.15.123:0/1828441469 learned_addr learned my addr 172.21.15.123:0/1828441469 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:23:53.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.009+0000 7f34feffd640 1 --2- 172.21.15.123:0/1828441469 >> v2:172.21.15.188:3300/0 conn(0x7f350015e6d0 0x7f3500071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:53.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.009+0000 7f34fe7fc640 1 -- 172.21.15.123:0/1828441469 >> v2:172.21.15.188:3300/0 conn(0x7f350015e6d0 msgr2=0x7f3500071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:53.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.009+0000 7f34fe7fc640 1 --2- 172.21.15.123:0/1828441469 >> v2:172.21.15.188:3300/0 conn(0x7f350015e6d0 0x7f3500071390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:53.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.009+0000 7f34fe7fc640 1 -- 172.21.15.123:0/1828441469 >> v1:172.21.15.123:6789/0 conn(0x7f3500070b80 legacy=0x7f35000731a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:53.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.009+0000 7f34fe7fc640 1 -- 172.21.15.123:0/1828441469 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f350015f330 con 0x7f350006cd20 2024-09-15T23:23:53.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.009+0000 7f34feffd640 1 --2- 172.21.15.123:0/1828441469 >> v2:172.21.15.188:3300/0 conn(0x7f350015e6d0 0x7f3500071390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:23:53.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.009+0000 7f34fe7fc640 1 --2- 172.21.15.123:0/1828441469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f350006cd20 0x7f35000b6d60 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 crypto rx=0x7f350006fb10 tx=0x7f34f402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=628027728d3cabe1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:53.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.010+0000 7f34fdffb640 1 -- 172.21.15.123:0/1828441469 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f4037070 con 0x7f350006cd20 2024-09-15T23:23:53.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.010+0000 7f34fdffb640 1 -- 172.21.15.123:0/1828441469 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34f4032440 con 0x7f350006cd20 2024-09-15T23:23:53.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.010+0000 7f34fdffb640 1 -- 172.21.15.123:0/1828441469 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f4032810 con 0x7f350006cd20 2024-09-15T23:23:53.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.010+0000 7f35055cd640 1 -- 172.21.15.123:0/1828441469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f350006cd20 msgr2=0x7f35000b6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:53.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.010+0000 7f35055cd640 1 --2- 172.21.15.123:0/1828441469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f350006cd20 0x7f35000b6d60 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 crypto rx=0x7f350006fb10 tx=0x7f34f402a1a0 comp rx=0 tx=0).stop 2024-09-15T23:23:53.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.010+0000 7f35055cd640 1 -- 172.21.15.123:0/1828441469 shutdown_connections 2024-09-15T23:23:53.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.010+0000 7f35055cd640 1 --2- 172.21.15.123:0/1828441469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f350006cd20 0x7f35000b6d60 unknown :-1 s=CLOSED pgs=2310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:53.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.010+0000 7f35055cd640 1 --2- 172.21.15.123:0/1828441469 >> v2:172.21.15.188:3300/0 conn(0x7f350015e6d0 0x7f3500071390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:53.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.010+0000 7f35055cd640 1 -- 172.21.15.123:0/1828441469 >> 172.21.15.123:0/1828441469 conn(0x7f3500067fb0 msgr2=0x7f350006f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:53.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.010+0000 7f35055cd640 1 -- 172.21.15.123:0/1828441469 shutdown_connections 2024-09-15T23:23:53.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.010+0000 7f35055cd640 1 -- 172.21.15.123:0/1828441469 wait complete. 2024-09-15T23:23:53.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.011+0000 7f35055cd640 1 Processor -- start 2024-09-15T23:23:53.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.012+0000 7f35055cd640 1 -- start start 2024-09-15T23:23:53.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.012+0000 7f35055cd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f350006cd20 0x7f350014a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:53.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.012+0000 7f35055cd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3500070b80 0x7f350014fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:53.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.012+0000 7f35055cd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f350015e6d0 0x7f3500150270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:53.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.012+0000 7f35055cd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f35000718d0 con 0x7f350006cd20 2024-09-15T23:23:53.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.012+0000 7f35055cd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f350015f8f0 con 0x7f350015e6d0 2024-09-15T23:23:53.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.012+0000 7f35055cd640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f3500071a50 con 0x7f3500070b80 2024-09-15T23:23:53.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.012+0000 7f34feffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f350006cd20 0x7f350014a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:53.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.012+0000 7f34feffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f350006cd20 0x7f350014a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48440/0 (socket says 172.21.15.123:48440) 2024-09-15T23:23:53.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.012+0000 7f34feffd640 1 -- 172.21.15.123:0/4218570625 learned_addr learned my addr 172.21.15.123:0/4218570625 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:53.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.012+0000 7f34fe7fc640 1 --2- 172.21.15.123:0/4218570625 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3500070b80 0x7f350014fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:53.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.012+0000 7f34ff7fe640 1 --2- 172.21.15.123:0/4218570625 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f350015e6d0 0x7f3500150270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:53.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.013+0000 7f34feffd640 1 -- 172.21.15.123:0/4218570625 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3500070b80 msgr2=0x7f350014fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:53.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.013+0000 7f34feffd640 1 --2- 172.21.15.123:0/4218570625 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3500070b80 0x7f350014fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:53.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.013+0000 7f34feffd640 1 -- 172.21.15.123:0/4218570625 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f350015e6d0 msgr2=0x7f3500150270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:53.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.013+0000 7f34feffd640 1 --2- 172.21.15.123:0/4218570625 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f350015e6d0 0x7f3500150270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:53.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.013+0000 7f34feffd640 1 -- 172.21.15.123:0/4218570625 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f350014aeb0 con 0x7f350006cd20 2024-09-15T23:23:53.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.013+0000 7f34feffd640 1 --2- 172.21.15.123:0/4218570625 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f350006cd20 0x7f350014a320 secure :-1 s=READY pgs=2311 cs=0 l=1 rev1=1 crypto rx=0x7f34f000c820 tx=0x7f34f000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:53.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.013+0000 7f34e77fe640 1 -- 172.21.15.123:0/4218570625 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f0015070 con 0x7f350006cd20 2024-09-15T23:23:53.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.013+0000 7f34e77fe640 1 -- 172.21.15.123:0/4218570625 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34f0007a30 con 0x7f350006cd20 2024-09-15T23:23:53.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.013+0000 7f35055cd640 1 -- 172.21.15.123:0/4218570625 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f350014b190 con 0x7f350006cd20 2024-09-15T23:23:53.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.013+0000 7f34e77fe640 1 -- 172.21.15.123:0/4218570625 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f0007de0 con 0x7f350006cd20 2024-09-15T23:23:53.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.013+0000 7f35055cd640 1 -- 172.21.15.123:0/4218570625 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f350014b750 con 0x7f350006cd20 2024-09-15T23:23:53.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.014+0000 7f35055cd640 1 -- 172.21.15.123:0/4218570625 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3500071390 con 0x7f350006cd20 2024-09-15T23:23:53.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.015+0000 7f34e77fe640 1 -- 172.21.15.123:0/4218570625 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f34f0018070 con 0x7f350006cd20 2024-09-15T23:23:53.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.015+0000 7f34e77fe640 1 --2- 172.21.15.123:0/4218570625 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f34ec06c2b0 0x7f34ec06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:53.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.015+0000 7f34e77fe640 1 -- 172.21.15.123:0/4218570625 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7f34f008b330 con 0x7f350006cd20 2024-09-15T23:23:53.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.015+0000 7f34fe7fc640 1 --2- 172.21.15.123:0/4218570625 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f34ec06c2b0 0x7f34ec06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:53.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.016+0000 7f34fe7fc640 1 --2- 172.21.15.123:0/4218570625 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f34ec06c2b0 0x7f34ec06e770 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f34f4034000 tx=0x7f34f402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:53.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.019+0000 7f34e77fe640 1 -- 172.21.15.123:0/4218570625 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f34f0059aa0 con 0x7f350006cd20 2024-09-15T23:23:53.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.220+0000 7f35055cd640 1 -- 172.21.15.123:0/4218570625 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f350006d890 con 0x7f350006cd20 2024-09-15T23:23:53.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.221+0000 7f34e77fe640 1 -- 172.21.15.123:0/4218570625 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) ==== 95+0+5248 (secure 0 0 0) 0x7f34f00593a0 con 0x7f350006cd20 2024-09-15T23:23:53.222 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:23:53.222 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":120,"btime":"2024-09-15T23:23:11:879993+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8785,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2171656296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2171656296},{"type":"v1","addr":"172.21.15.188:6836","nonce":2171656296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":8788,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/136119431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":136119431},{"type":"v1","addr":"172.21.15.188:6837","nonce":136119431}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":10473,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/2374047694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2374047694},{"type":"v1","addr":"172.21.15.123:6833","nonce":2374047694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":120,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:23:09.208435+0000","modified":"2024-09-15T23:23:11.247532+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10491},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10491":{"gid":10491,"name":"a","rank":0,"incarnation":118,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/2653908784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2653908784},{"type":"v1","addr":"172.21.15.123:6835","nonce":2653908784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10491,"qdb_cluster":[10491]},"id":13}]} 2024-09-15T23:23:53.222 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 120 2024-09-15T23:23:53.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.223+0000 7f35055cd640 1 -- 172.21.15.123:0/4218570625 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f34ec06c2b0 msgr2=0x7f34ec06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:53.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.223+0000 7f35055cd640 1 --2- 172.21.15.123:0/4218570625 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f34ec06c2b0 0x7f34ec06e770 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f34f4034000 tx=0x7f34f402e000 comp rx=0 tx=0).stop 2024-09-15T23:23:53.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.223+0000 7f35055cd640 1 -- 172.21.15.123:0/4218570625 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f350006cd20 msgr2=0x7f350014a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:53.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.223+0000 7f35055cd640 1 --2- 172.21.15.123:0/4218570625 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f350006cd20 0x7f350014a320 secure :-1 s=READY pgs=2311 cs=0 l=1 rev1=1 crypto rx=0x7f34f000c820 tx=0x7f34f000cce0 comp rx=0 tx=0).stop 2024-09-15T23:23:53.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.223+0000 7f35055cd640 1 -- 172.21.15.123:0/4218570625 shutdown_connections 2024-09-15T23:23:53.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.223+0000 7f35055cd640 1 --2- 172.21.15.123:0/4218570625 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f350015e6d0 0x7f3500150270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:53.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.223+0000 7f35055cd640 1 --2- 172.21.15.123:0/4218570625 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3500070b80 0x7f350014fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:53.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.223+0000 7f35055cd640 1 --2- 172.21.15.123:0/4218570625 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f34ec06c2b0 0x7f34ec06e770 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:53.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.223+0000 7f35055cd640 1 --2- 172.21.15.123:0/4218570625 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f350006cd20 0x7f350014a320 unknown :-1 s=CLOSED pgs=2311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:53.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.223+0000 7f35055cd640 1 -- 172.21.15.123:0/4218570625 >> 172.21.15.123:0/4218570625 conn(0x7f3500067fb0 msgr2=0x7f3500154570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:53.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.223+0000 7f35055cd640 1 -- 172.21.15.123:0/4218570625 shutdown_connections 2024-09-15T23:23:53.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.223+0000 7f35055cd640 1 -- 172.21.15.123:0/4218570625 wait complete. 2024-09-15T23:23:53.235 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:23:53.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.332+0000 7f7294c53640 1 Processor -- start 2024-09-15T23:23:53.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.332+0000 7f7294c53640 1 -- start start 2024-09-15T23:23:53.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.333+0000 7f7294c53640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f72900b6970 0x7f72900b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:53.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.333+0000 7f7294c53640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72900d23b0 0x7f72900b8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:53.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.333+0000 7f7294c53640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72900d0e70 con 0x7f729015ed20 2024-09-15T23:23:53.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.333+0000 7f7294c53640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f72900d41c0 con 0x7f72900b6970 2024-09-15T23:23:53.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.333+0000 7f7294c53640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f72900d35b0 con 0x7f72900d23b0 2024-09-15T23:23:53.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.333+0000 7f7285d9b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f72900b6970 0x7f72900b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:53.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.333+0000 7f728e59c640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f729015ed20 0x7f72900b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:50402/0 (socket says 172.21.15.123:50402) 2024-09-15T23:23:53.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.333+0000 7f728ed9d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72900d23b0 0x7f72900b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:53.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.333+0000 7f7285d9b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f72900b6970 0x7f72900b80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:43264/0 (socket says 172.21.15.123:43264) 2024-09-15T23:23:53.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.333+0000 7f728e59c640 1 -- 172.21.15.123:0/1286167878 learned_addr learned my addr 172.21.15.123:0/1286167878 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:23:53.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.334+0000 7f7285d9b640 1 -- 172.21.15.123:0/1286167878 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72900d23b0 msgr2=0x7f72900b8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:53.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.334+0000 7f7285d9b640 1 --2- 172.21.15.123:0/1286167878 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72900d23b0 0x7f72900b8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:53.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.334+0000 7f7285d9b640 1 -- 172.21.15.123:0/1286167878 >> v1:172.21.15.188:6789/0 conn(0x7f729015ed20 legacy=0x7f72900b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:53.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.334+0000 7f7285d9b640 1 -- 172.21.15.123:0/1286167878 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72900d3890 con 0x7f72900b6970 2024-09-15T23:23:53.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.334+0000 7f728dd9b640 1 -- 172.21.15.123:0/1286167878 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 376832508 0 0) 0x7f7280001110 con 0x7f729015ed20 2024-09-15T23:23:53.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.334+0000 7f728ed9d640 1 --2- 172.21.15.123:0/1286167878 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72900d23b0 0x7f72900b8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:23:53.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.334+0000 7f7285d9b640 1 --2- 172.21.15.123:0/1286167878 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f72900b6970 0x7f72900b80d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f72780097a0 tx=0x7f727802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bfff28e911db5e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:53.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.335+0000 7f728dd9b640 1 -- 172.21.15.123:0/1286167878 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7278037070 con 0x7f72900b6970 2024-09-15T23:23:53.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.335+0000 7f728dd9b640 1 -- 172.21.15.123:0/1286167878 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f727802ae50 con 0x7f72900b6970 2024-09-15T23:23:53.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.335+0000 7f728dd9b640 1 -- 172.21.15.123:0/1286167878 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7278032660 con 0x7f72900b6970 2024-09-15T23:23:53.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.335+0000 7f7294c53640 1 -- 172.21.15.123:0/1286167878 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f72900b6970 msgr2=0x7f72900b80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:53.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.335+0000 7f7294c53640 1 --2- 172.21.15.123:0/1286167878 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f72900b6970 0x7f72900b80d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f72780097a0 tx=0x7f727802a100 comp rx=0 tx=0).stop 2024-09-15T23:23:53.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.335+0000 7f7294c53640 1 -- 172.21.15.123:0/1286167878 shutdown_connections 2024-09-15T23:23:53.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.335+0000 7f7294c53640 1 --2- 172.21.15.123:0/1286167878 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f72900b6970 0x7f72900b80d0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:53.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.335+0000 7f7294c53640 1 --2- 172.21.15.123:0/1286167878 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72900d23b0 0x7f72900b8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:53.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.335+0000 7f7294c53640 1 -- 172.21.15.123:0/1286167878 >> 172.21.15.123:0/1286167878 conn(0x7f72900d1260 msgr2=0x7f72900d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:53.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.335+0000 7f7294c53640 1 -- 172.21.15.123:0/1286167878 shutdown_connections 2024-09-15T23:23:53.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.335+0000 7f7294c53640 1 -- 172.21.15.123:0/1286167878 wait complete. 2024-09-15T23:23:53.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.337+0000 7f7294c53640 1 Processor -- start 2024-09-15T23:23:53.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.337+0000 7f7294c53640 1 -- start start 2024-09-15T23:23:53.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.337+0000 7f7294c53640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72900b6970 0x7f729015bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:53.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.337+0000 7f7294c53640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72900d23b0 0x7f7290159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:53.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.337+0000 7f7294c53640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f729015ed20 0x7f72901e8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:53.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.337+0000 7f7294c53640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f72900d32a0 con 0x7f72900b6970 2024-09-15T23:23:53.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.337+0000 7f7294c53640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f72900d3e50 con 0x7f729015ed20 2024-09-15T23:23:53.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.337+0000 7f7294c53640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f729015f100 con 0x7f72900d23b0 2024-09-15T23:23:53.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.337+0000 7f728e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72900b6970 0x7f729015bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:53.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.338+0000 7f728e59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72900b6970 0x7f729015bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48450/0 (socket says 172.21.15.123:48450) 2024-09-15T23:23:53.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.338+0000 7f728e59c640 1 -- 172.21.15.123:0/637886337 learned_addr learned my addr 172.21.15.123:0/637886337 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:53.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.338+0000 7f7285d9b640 1 --2- 172.21.15.123:0/637886337 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72900d23b0 0x7f7290159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:53.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.338+0000 7f728ed9d640 1 --2- 172.21.15.123:0/637886337 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f729015ed20 0x7f72901e8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:53.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.338+0000 7f728e59c640 1 -- 172.21.15.123:0/637886337 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72900d23b0 msgr2=0x7f7290159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:53.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.338+0000 7f728e59c640 1 --2- 172.21.15.123:0/637886337 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72900d23b0 0x7f7290159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:53.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.338+0000 7f728e59c640 1 -- 172.21.15.123:0/637886337 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f729015ed20 msgr2=0x7f72901e8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:53.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.338+0000 7f728e59c640 1 --2- 172.21.15.123:0/637886337 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f729015ed20 0x7f72901e8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:53.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.338+0000 7f728e59c640 1 -- 172.21.15.123:0/637886337 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72900ce640 con 0x7f72900b6970 2024-09-15T23:23:53.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.338+0000 7f728ed9d640 1 --2- 172.21.15.123:0/637886337 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f729015ed20 0x7f72901e8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:23:53.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.338+0000 7f728e59c640 1 --2- 172.21.15.123:0/637886337 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72900b6970 0x7f729015bbf0 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 crypto rx=0x7f728000c780 tx=0x7f728000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:53.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.338+0000 7f72877fe640 1 -- 172.21.15.123:0/637886337 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7280018070 con 0x7f72900b6970 2024-09-15T23:23:53.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.338+0000 7f72877fe640 1 -- 172.21.15.123:0/637886337 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72800072d0 con 0x7f72900b6970 2024-09-15T23:23:53.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.338+0000 7f7294c53640 1 -- 172.21.15.123:0/637886337 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72901e7340 con 0x7f72900b6970 2024-09-15T23:23:53.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.338+0000 7f72877fe640 1 -- 172.21.15.123:0/637886337 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72800047e0 con 0x7f72900b6970 2024-09-15T23:23:53.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.338+0000 7f7294c53640 1 -- 172.21.15.123:0/637886337 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72901e7900 con 0x7f72900b6970 2024-09-15T23:23:53.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.339+0000 7f7294c53640 1 -- 172.21.15.123:0/637886337 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72900b7010 con 0x7f72900b6970 2024-09-15T23:23:53.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.340+0000 7f72877fe640 1 -- 172.21.15.123:0/637886337 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7280004980 con 0x7f72900b6970 2024-09-15T23:23:53.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.340+0000 7f72877fe640 1 --2- 172.21.15.123:0/637886337 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f727006c2b0 0x7f727006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:53.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.340+0000 7f72877fe640 1 -- 172.21.15.123:0/637886337 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7f728008a870 con 0x7f72900b6970 2024-09-15T23:23:53.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.340+0000 7f7285d9b640 1 --2- 172.21.15.123:0/637886337 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f727006c2b0 0x7f727006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:53.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.341+0000 7f7285d9b640 1 --2- 172.21.15.123:0/637886337 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f727006c2b0 0x7f727006e770 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f7278034000 tx=0x7f727802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:53.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.344+0000 7f72877fe640 1 -- 172.21.15.123:0/637886337 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f72900d0e70 con 0x7f72900b6970 2024-09-15T23:23:53.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.542+0000 7f7294c53640 1 -- 172.21.15.123:0/637886337 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72901623a0 con 0x7f72900b6970 2024-09-15T23:23:53.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.542+0000 7f72877fe640 1 -- 172.21.15.123:0/637886337 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 120 v120) ==== 95+0+5248 (secure 0 0 0) 0x7f7280004c70 con 0x7f72900b6970 2024-09-15T23:23:53.543 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:23:53.543 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":120,"btime":"2024-09-15T23:23:11:879993+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8785,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2171656296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2171656296},{"type":"v1","addr":"172.21.15.188:6836","nonce":2171656296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":8788,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/136119431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":136119431},{"type":"v1","addr":"172.21.15.188:6837","nonce":136119431}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":10473,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/2374047694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2374047694},{"type":"v1","addr":"172.21.15.123:6833","nonce":2374047694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":120,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:23:09.208435+0000","modified":"2024-09-15T23:23:11.247532+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10491},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10491":{"gid":10491,"name":"a","rank":0,"incarnation":118,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6835/2653908784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2653908784},{"type":"v1","addr":"172.21.15.123:6835","nonce":2653908784}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10491,"qdb_cluster":[10491]},"id":13}]} 2024-09-15T23:23:53.544 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 120 2024-09-15T23:23:53.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.544+0000 7f7294c53640 1 -- 172.21.15.123:0/637886337 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f727006c2b0 msgr2=0x7f727006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:53.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.544+0000 7f7294c53640 1 --2- 172.21.15.123:0/637886337 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f727006c2b0 0x7f727006e770 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f7278034000 tx=0x7f727802e000 comp rx=0 tx=0).stop 2024-09-15T23:23:53.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.544+0000 7f7294c53640 1 -- 172.21.15.123:0/637886337 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72900b6970 msgr2=0x7f729015bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:53.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.544+0000 7f7294c53640 1 --2- 172.21.15.123:0/637886337 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72900b6970 0x7f729015bbf0 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 crypto rx=0x7f728000c780 tx=0x7f728000cc40 comp rx=0 tx=0).stop 2024-09-15T23:23:53.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.544+0000 7f7294c53640 1 -- 172.21.15.123:0/637886337 shutdown_connections 2024-09-15T23:23:53.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.544+0000 7f7294c53640 1 --2- 172.21.15.123:0/637886337 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f729015ed20 0x7f72901e8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:53.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.544+0000 7f7294c53640 1 --2- 172.21.15.123:0/637886337 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f72900d23b0 0x7f7290159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:53.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.544+0000 7f7294c53640 1 --2- 172.21.15.123:0/637886337 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f727006c2b0 0x7f727006e770 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:53.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.544+0000 7f7294c53640 1 --2- 172.21.15.123:0/637886337 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72900b6970 0x7f729015bbf0 unknown :-1 s=CLOSED pgs=2312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:53.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.544+0000 7f7294c53640 1 -- 172.21.15.123:0/637886337 >> 172.21.15.123:0/637886337 conn(0x7f72900d1260 msgr2=0x7f72900b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:53.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.544+0000 7f7294c53640 1 -- 172.21.15.123:0/637886337 shutdown_connections 2024-09-15T23:23:53.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.544+0000 7f7294c53640 1 -- 172.21.15.123:0/637886337 wait complete. 2024-09-15T23:23:53.556 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:23:53.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.654+0000 7f9b4272c640 1 Processor -- start 2024-09-15T23:23:53.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.654+0000 7f9b4272c640 1 -- start start 2024-09-15T23:23:53.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.655+0000 7f9b4272c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9b3c1461a0 0x7f9b3c15d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:53.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.655+0000 7f9b4272c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f9b3c06c320 0x7f9b3c06e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:53.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.655+0000 7f9b4272c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b3c0728d0 con 0x7f9b3c0720c0 2024-09-15T23:23:53.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.655+0000 7f9b4272c640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f9b3c15ddc0 con 0x7f9b3c1461a0 2024-09-15T23:23:53.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.655+0000 7f9b4272c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f9b3c146580 con 0x7f9b3c06c320 2024-09-15T23:23:53.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.655+0000 7f9b3bfff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9b3c1461a0 0x7f9b3c15d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:53.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.655+0000 7f9b3bfff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9b3c1461a0 0x7f9b3c15d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48466/0 (socket says 172.21.15.123:48466) 2024-09-15T23:23:53.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.655+0000 7f9b3bfff640 1 -- 172.21.15.123:0/2600153231 learned_addr learned my addr 172.21.15.123:0/2600153231 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:53.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.655+0000 7f9b40cc9640 1 --2- 172.21.15.123:0/2600153231 >> v2:172.21.15.188:3300/0 conn(0x7f9b3c06c320 0x7f9b3c06e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:53.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.655+0000 7f9b3bfff640 1 -- 172.21.15.123:0/2600153231 >> v2:172.21.15.188:3300/0 conn(0x7f9b3c06c320 msgr2=0x7f9b3c06e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:53.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.655+0000 7f9b3bfff640 1 --2- 172.21.15.123:0/2600153231 >> v2:172.21.15.188:3300/0 conn(0x7f9b3c06c320 0x7f9b3c06e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:53.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.655+0000 7f9b3bfff640 1 -- 172.21.15.123:0/2600153231 >> v1:172.21.15.188:6789/0 conn(0x7f9b3c0720c0 legacy=0x7f9b3c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:53.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.655+0000 7f9b3bfff640 1 -- 172.21.15.123:0/2600153231 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b3c072bb0 con 0x7f9b3c1461a0 2024-09-15T23:23:53.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.656+0000 7f9b3bfff640 1 --2- 172.21.15.123:0/2600153231 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b3c1461a0 0x7f9b3c15d840 secure :-1 s=READY pgs=2313 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c0c6bb0 tx=0x7f9b2c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38eb209b45a7bd22 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:53.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.656+0000 7f9b3affd640 1 -- 172.21.15.123:0/2600153231 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c037070 con 0x7f9b3c1461a0 2024-09-15T23:23:53.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.656+0000 7f9b3affd640 1 -- 172.21.15.123:0/2600153231 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b2c032440 con 0x7f9b3c1461a0 2024-09-15T23:23:53.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.656+0000 7f9b3affd640 1 -- 172.21.15.123:0/2600153231 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c032810 con 0x7f9b3c1461a0 2024-09-15T23:23:53.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.657+0000 7f9b4272c640 1 -- 172.21.15.123:0/2600153231 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b3c1461a0 msgr2=0x7f9b3c15d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:53.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.657+0000 7f9b4272c640 1 --2- 172.21.15.123:0/2600153231 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b3c1461a0 0x7f9b3c15d840 secure :-1 s=READY pgs=2313 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c0c6bb0 tx=0x7f9b2c02a230 comp rx=0 tx=0).stop 2024-09-15T23:23:53.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.657+0000 7f9b4272c640 1 -- 172.21.15.123:0/2600153231 shutdown_connections 2024-09-15T23:23:53.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.657+0000 7f9b4272c640 1 --2- 172.21.15.123:0/2600153231 >> v2:172.21.15.188:3300/0 conn(0x7f9b3c06c320 0x7f9b3c06e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:53.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.657+0000 7f9b4272c640 1 --2- 172.21.15.123:0/2600153231 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b3c1461a0 0x7f9b3c15d840 unknown :-1 s=CLOSED pgs=2313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:53.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.657+0000 7f9b4272c640 1 -- 172.21.15.123:0/2600153231 >> 172.21.15.123:0/2600153231 conn(0x7f9b3c06cd20 msgr2=0x7f9b3c06d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:53.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.657+0000 7f9b4272c640 1 -- 172.21.15.123:0/2600153231 shutdown_connections 2024-09-15T23:23:53.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.657+0000 7f9b4272c640 1 -- 172.21.15.123:0/2600153231 wait complete. 2024-09-15T23:23:53.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.658+0000 7f9b4272c640 1 Processor -- start 2024-09-15T23:23:53.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.658+0000 7f9b4272c640 1 -- start start 2024-09-15T23:23:53.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.659+0000 7f9b4272c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b3c06c320 0x7f9b3c13b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:53.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.659+0000 7f9b4272c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b3c0720c0 0x7f9b3c0b6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:53.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.659+0000 7f9b4272c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b3c1461a0 0x7f9b3c0b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:53.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.659+0000 7f9b4272c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c072530 con 0x7f9b3c06c320 2024-09-15T23:23:53.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.659+0000 7f9b4272c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c073170 con 0x7f9b3c0720c0 2024-09-15T23:23:53.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.659+0000 7f9b4272c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9b3c0726b0 con 0x7f9b3c1461a0 2024-09-15T23:23:53.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.659+0000 7f9b3bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b3c06c320 0x7f9b3c13b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:53.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.659+0000 7f9b3bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b3c06c320 0x7f9b3c13b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48472/0 (socket says 172.21.15.123:48472) 2024-09-15T23:23:53.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.659+0000 7f9b3bfff640 1 -- 172.21.15.123:0/1142744403 learned_addr learned my addr 172.21.15.123:0/1142744403 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:53.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.659+0000 7f9b3b7fe640 1 --2- 172.21.15.123:0/1142744403 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b3c0720c0 0x7f9b3c0b6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:53.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.659+0000 7f9b40cc9640 1 --2- 172.21.15.123:0/1142744403 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b3c1461a0 0x7f9b3c0b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:53.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.659+0000 7f9b3bfff640 1 -- 172.21.15.123:0/1142744403 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b3c1461a0 msgr2=0x7f9b3c0b50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:53.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.659+0000 7f9b3bfff640 1 --2- 172.21.15.123:0/1142744403 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b3c1461a0 0x7f9b3c0b50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:53.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.659+0000 7f9b3bfff640 1 -- 172.21.15.123:0/1142744403 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b3c0720c0 msgr2=0x7f9b3c0b6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:53.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.659+0000 7f9b3bfff640 1 --2- 172.21.15.123:0/1142744403 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b3c0720c0 0x7f9b3c0b6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:53.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.659+0000 7f9b3bfff640 1 -- 172.21.15.123:0/1142744403 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b3c13ffc0 con 0x7f9b3c06c320 2024-09-15T23:23:53.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.659+0000 7f9b3bfff640 1 --2- 172.21.15.123:0/1142744403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b3c06c320 0x7f9b3c13b210 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c000c00 tx=0x7f9b2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:53.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.660+0000 7f9b38ff9640 1 -- 172.21.15.123:0/1142744403 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c041020 con 0x7f9b3c06c320 2024-09-15T23:23:53.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.660+0000 7f9b38ff9640 1 -- 172.21.15.123:0/1142744403 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b2c0306c0 con 0x7f9b3c06c320 2024-09-15T23:23:53.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.660+0000 7f9b4272c640 1 -- 172.21.15.123:0/1142744403 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b3c0b6c50 con 0x7f9b3c06c320 2024-09-15T23:23:53.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.660+0000 7f9b38ff9640 1 -- 172.21.15.123:0/1142744403 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c037040 con 0x7f9b3c06c320 2024-09-15T23:23:53.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.660+0000 7f9b4272c640 1 -- 172.21.15.123:0/1142744403 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b3c0b5c30 con 0x7f9b3c06c320 2024-09-15T23:23:53.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.661+0000 7f9b4272c640 1 -- 172.21.15.123:0/1142744403 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b3c0b5a40 con 0x7f9b3c06c320 2024-09-15T23:23:53.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.661+0000 7f9b38ff9640 1 -- 172.21.15.123:0/1142744403 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9b2c044020 con 0x7f9b3c06c320 2024-09-15T23:23:53.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.661+0000 7f9b38ff9640 1 --2- 172.21.15.123:0/1142744403 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9b2806c2e0 0x7f9b2806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:53.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.662+0000 7f9b38ff9640 1 -- 172.21.15.123:0/1142744403 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7f9b2c0abc90 con 0x7f9b3c06c320 2024-09-15T23:23:53.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.662+0000 7f9b3b7fe640 1 --2- 172.21.15.123:0/1142744403 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9b2806c2e0 0x7f9b2806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:53.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.662+0000 7f9b3b7fe640 1 --2- 172.21.15.123:0/1142744403 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9b2806c2e0 0x7f9b2806e7a0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c13f750 tx=0x7f9b30009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:53.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.666+0000 7f9b38ff9640 1 -- 172.21.15.123:0/1142744403 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9b2c04b030 con 0x7f9b3c06c320 2024-09-15T23:23:53.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.832+0000 7f9b4272c640 1 -- 172.21.15.123:0/1142744403 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9b3c15d840 con 0x7f9b3c06c320 2024-09-15T23:23:53.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.833+0000 7f9b38ff9640 1 -- 172.21.15.123:0/1142744403 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v194) ==== 74+0+16699 (secure 0 0 0) 0x7f9b2c07a400 con 0x7f9b3c06c320 2024-09-15T23:23:53.835 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:23:53.835 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":194,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:23:10.873327+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:23:07.827379+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"193","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-15T23:23:08.184780+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"194","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:23:53.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.835+0000 7f9b4272c640 1 -- 172.21.15.123:0/1142744403 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9b2806c2e0 msgr2=0x7f9b2806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:53.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.835+0000 7f9b4272c640 1 --2- 172.21.15.123:0/1142744403 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9b2806c2e0 0x7f9b2806e7a0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c13f750 tx=0x7f9b30009040 comp rx=0 tx=0).stop 2024-09-15T23:23:53.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.835+0000 7f9b4272c640 1 -- 172.21.15.123:0/1142744403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b3c06c320 msgr2=0x7f9b3c13b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:53.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.835+0000 7f9b4272c640 1 --2- 172.21.15.123:0/1142744403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b3c06c320 0x7f9b3c13b210 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c000c00 tx=0x7f9b2c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:23:53.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.835+0000 7f9b4272c640 1 -- 172.21.15.123:0/1142744403 shutdown_connections 2024-09-15T23:23:53.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.835+0000 7f9b4272c640 1 --2- 172.21.15.123:0/1142744403 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b3c1461a0 0x7f9b3c0b50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:53.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.835+0000 7f9b4272c640 1 --2- 172.21.15.123:0/1142744403 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b3c0720c0 0x7f9b3c0b6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:53.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.835+0000 7f9b4272c640 1 --2- 172.21.15.123:0/1142744403 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9b2806c2e0 0x7f9b2806e7a0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:53.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.835+0000 7f9b4272c640 1 --2- 172.21.15.123:0/1142744403 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b3c06c320 0x7f9b3c13b210 unknown :-1 s=CLOSED pgs=2314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:53.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.835+0000 7f9b4272c640 1 -- 172.21.15.123:0/1142744403 >> 172.21.15.123:0/1142744403 conn(0x7f9b3c06cd20 msgr2=0x7f9b3c15c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:53.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.835+0000 7f9b4272c640 1 -- 172.21.15.123:0/1142744403 shutdown_connections 2024-09-15T23:23:53.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.835+0000 7f9b4272c640 1 -- 172.21.15.123:0/1142744403 wait complete. 2024-09-15T23:23:53.847 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T23:23:53.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.946+0000 7f1234f6d640 1 Processor -- start 2024-09-15T23:23:53.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.946+0000 7f1234f6d640 1 -- start start 2024-09-15T23:23:53.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.947+0000 7f1234f6d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f12300b2d40 0x7f123006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:53.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.947+0000 7f1234f6d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f123013eb20 0x7f123006c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:53.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.947+0000 7f1234f6d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1230071180 con 0x7f123015bcf0 2024-09-15T23:23:53.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.947+0000 7f1234f6d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f123015c890 con 0x7f12300b2d40 2024-09-15T23:23:53.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.947+0000 7f1234f6d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f1230071ab0 con 0x7f123013eb20 2024-09-15T23:23:53.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.947+0000 7f122e59c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f12300b2d40 0x7f123006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:53.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.947+0000 7f122ed9d640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f123015bcf0 0x7f123015c180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56478/0 (socket says 172.21.15.123:56478) 2024-09-15T23:23:53.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.947+0000 7f122ed9d640 1 -- 172.21.15.123:0/3919523731 learned_addr learned my addr 172.21.15.123:0/3919523731 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:23:53.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.947+0000 7f122e59c640 1 --2- 172.21.15.123:0/3919523731 >> v2:172.21.15.123:3300/0 conn(0x7f12300b2d40 0x7f123006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48476/0 (socket says 172.21.15.123:48476) 2024-09-15T23:23:53.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.947+0000 7f122dd9b640 1 --2- 172.21.15.123:0/3919523731 >> v2:172.21.15.188:3300/0 conn(0x7f123013eb20 0x7f123006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:53.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.947+0000 7f122e59c640 1 -- 172.21.15.123:0/3919523731 >> v2:172.21.15.188:3300/0 conn(0x7f123013eb20 msgr2=0x7f123006c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:53.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.947+0000 7f122e59c640 1 --2- 172.21.15.123:0/3919523731 >> v2:172.21.15.188:3300/0 conn(0x7f123013eb20 0x7f123006c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:53.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.947+0000 7f122e59c640 1 -- 172.21.15.123:0/3919523731 >> v1:172.21.15.123:6789/0 conn(0x7f123015bcf0 legacy=0x7f123015c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:53.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.947+0000 7f122e59c640 1 -- 172.21.15.123:0/3919523731 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1230071460 con 0x7f12300b2d40 2024-09-15T23:23:53.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.947+0000 7f122d59a640 1 -- 172.21.15.123:0/3919523731 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2580878469 0 0) 0x7f1230071180 con 0x7f123015bcf0 2024-09-15T23:23:53.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.948+0000 7f122e59c640 1 --2- 172.21.15.123:0/3919523731 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12300b2d40 0x7f123006bc10 secure :-1 s=READY pgs=2316 cs=0 l=1 rev1=1 crypto rx=0x7f12300d1500 tx=0x7f122002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd936ce33d8f531 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:53.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.948+0000 7f122d59a640 1 -- 172.21.15.123:0/3919523731 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1220037070 con 0x7f12300b2d40 2024-09-15T23:23:53.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.948+0000 7f122d59a640 1 -- 172.21.15.123:0/3919523731 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1220032440 con 0x7f12300b2d40 2024-09-15T23:23:53.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.948+0000 7f122d59a640 1 -- 172.21.15.123:0/3919523731 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1220032810 con 0x7f12300b2d40 2024-09-15T23:23:53.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.949+0000 7f1234f6d640 1 -- 172.21.15.123:0/3919523731 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12300b2d40 msgr2=0x7f123006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:53.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.949+0000 7f1234f6d640 1 --2- 172.21.15.123:0/3919523731 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12300b2d40 0x7f123006bc10 secure :-1 s=READY pgs=2316 cs=0 l=1 rev1=1 crypto rx=0x7f12300d1500 tx=0x7f122002a1a0 comp rx=0 tx=0).stop 2024-09-15T23:23:53.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.949+0000 7f1234f6d640 1 -- 172.21.15.123:0/3919523731 shutdown_connections 2024-09-15T23:23:53.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.949+0000 7f1234f6d640 1 --2- 172.21.15.123:0/3919523731 >> v2:172.21.15.188:3300/0 conn(0x7f123013eb20 0x7f123006c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:53.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.949+0000 7f1234f6d640 1 --2- 172.21.15.123:0/3919523731 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12300b2d40 0x7f123006bc10 unknown :-1 s=CLOSED pgs=2316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:53.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.949+0000 7f1234f6d640 1 -- 172.21.15.123:0/3919523731 >> 172.21.15.123:0/3919523731 conn(0x7f12300ccec0 msgr2=0x7f12300cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:53.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.949+0000 7f1234f6d640 1 -- 172.21.15.123:0/3919523731 shutdown_connections 2024-09-15T23:23:53.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.949+0000 7f1234f6d640 1 -- 172.21.15.123:0/3919523731 wait complete. 2024-09-15T23:23:53.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.950+0000 7f1234f6d640 1 Processor -- start 2024-09-15T23:23:53.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.950+0000 7f1234f6d640 1 -- start start 2024-09-15T23:23:53.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.951+0000 7f1234f6d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12300b2d40 0x7f123013d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:53.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.951+0000 7f1234f6d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f123013eb20 0x7f12300c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:53.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.951+0000 7f1234f6d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f123015bcf0 0x7f12300cf160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:53.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.951+0000 7f1234f6d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f12300720c0 con 0x7f123013eb20 2024-09-15T23:23:53.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.951+0000 7f1234f6d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1230071f40 con 0x7f123015bcf0 2024-09-15T23:23:53.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.951+0000 7f1234f6d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1230072240 con 0x7f12300b2d40 2024-09-15T23:23:53.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.951+0000 7f122dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f123013eb20 0x7f12300c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:53.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.951+0000 7f122dd9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f123013eb20 0x7f12300c55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48480/0 (socket says 172.21.15.123:48480) 2024-09-15T23:23:53.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.951+0000 7f122dd9b640 1 -- 172.21.15.123:0/2458438699 learned_addr learned my addr 172.21.15.123:0/2458438699 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:53.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.951+0000 7f122dd9b640 1 -- 172.21.15.123:0/2458438699 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12300b2d40 msgr2=0x7f123013d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:53.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.951+0000 7f122dd9b640 1 --2- 172.21.15.123:0/2458438699 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12300b2d40 0x7f123013d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:53.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.951+0000 7f122dd9b640 1 -- 172.21.15.123:0/2458438699 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f123015bcf0 msgr2=0x7f12300cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:53.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.951+0000 7f122dd9b640 1 --2- 172.21.15.123:0/2458438699 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f123015bcf0 0x7f12300cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:53.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.951+0000 7f122dd9b640 1 -- 172.21.15.123:0/2458438699 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12300c60b0 con 0x7f123013eb20 2024-09-15T23:23:53.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.951+0000 7f122dd9b640 1 --2- 172.21.15.123:0/2458438699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f123013eb20 0x7f12300c55f0 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 crypto rx=0x7f122400d800 tx=0x7f122400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:53.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.951+0000 7f121effd640 1 -- 172.21.15.123:0/2458438699 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122400b6c0 con 0x7f123013eb20 2024-09-15T23:23:53.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.951+0000 7f121effd640 1 -- 172.21.15.123:0/2458438699 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1224019070 con 0x7f123013eb20 2024-09-15T23:23:53.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.951+0000 7f1234f6d640 1 -- 172.21.15.123:0/2458438699 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1230157280 con 0x7f123013eb20 2024-09-15T23:23:53.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.952+0000 7f121effd640 1 -- 172.21.15.123:0/2458438699 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122400bac0 con 0x7f123013eb20 2024-09-15T23:23:53.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.952+0000 7f1234f6d640 1 -- 172.21.15.123:0/2458438699 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f123013ded0 con 0x7f123013eb20 2024-09-15T23:23:53.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.952+0000 7f1234f6d640 1 -- 172.21.15.123:0/2458438699 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f123015c180 con 0x7f123013eb20 2024-09-15T23:23:53.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.953+0000 7f121effd640 1 -- 172.21.15.123:0/2458438699 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f122400bc60 con 0x7f123013eb20 2024-09-15T23:23:53.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.953+0000 7f121effd640 1 --2- 172.21.15.123:0/2458438699 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f121006c2b0 0x7f121006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:53.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.953+0000 7f121effd640 1 -- 172.21.15.123:0/2458438699 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(194..194 src has 1..194) ==== 5709+0+0 (secure 0 0 0) 0x7f122408b900 con 0x7f123013eb20 2024-09-15T23:23:53.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.954+0000 7f122e59c640 1 --2- 172.21.15.123:0/2458438699 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f121006c2b0 0x7f121006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:53.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.954+0000 7f122e59c640 1 --2- 172.21.15.123:0/2458438699 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f121006c2b0 0x7f121006e770 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f1220034000 tx=0x7f122002c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:53.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:53.958+0000 7f121effd640 1 -- 172.21.15.123:0/2458438699 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f122405a070 con 0x7f123013eb20 2024-09-15T23:23:54.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.159+0000 7f1234f6d640 1 -- 172.21.15.123:0/2458438699 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f123006c9c0 con 0x7f123013eb20 2024-09-15T23:23:54.161 INFO:tasks.ceph.mon.a.smithi123.stderr:2024-09-15T23:23:54.160+0000 7f8a6ccf0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:23:54.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.161+0000 7f121effd640 1 -- 172.21.15.123:0/2458438699 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v121) ==== 161+0+0 (secure 0 0 0) 0x7f1224059970 con 0x7f123013eb20 2024-09-15T23:23:54.162 INFO:teuthology.orchestra.run.smithi123.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T23:23:54.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.164+0000 7f1234f6d640 1 -- 172.21.15.123:0/2458438699 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f121006c2b0 msgr2=0x7f121006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:54.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.164+0000 7f1234f6d640 1 --2- 172.21.15.123:0/2458438699 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f121006c2b0 0x7f121006e770 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f1220034000 tx=0x7f122002c000 comp rx=0 tx=0).stop 2024-09-15T23:23:54.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.164+0000 7f1234f6d640 1 -- 172.21.15.123:0/2458438699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f123013eb20 msgr2=0x7f12300c55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:54.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.164+0000 7f1234f6d640 1 --2- 172.21.15.123:0/2458438699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f123013eb20 0x7f12300c55f0 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 crypto rx=0x7f122400d800 tx=0x7f122400dcc0 comp rx=0 tx=0).stop 2024-09-15T23:23:54.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.165+0000 7f1234f6d640 1 -- 172.21.15.123:0/2458438699 shutdown_connections 2024-09-15T23:23:54.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.165+0000 7f1234f6d640 1 --2- 172.21.15.123:0/2458438699 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f123015bcf0 0x7f12300cf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:54.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.165+0000 7f1234f6d640 1 --2- 172.21.15.123:0/2458438699 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f121006c2b0 0x7f121006e770 secure :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f1220034000 tx=0x7f122002c000 comp rx=0 tx=0).stop 2024-09-15T23:23:54.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.165+0000 7f1234f6d640 1 --2- 172.21.15.123:0/2458438699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f123013eb20 0x7f12300c55f0 secure :-1 s=CLOSED pgs=2317 cs=0 l=1 rev1=1 crypto rx=0x7f122400d800 tx=0x7f122400dcc0 comp rx=0 tx=0).stop 2024-09-15T23:23:54.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.165+0000 7f1234f6d640 1 --2- 172.21.15.123:0/2458438699 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12300b2d40 0x7f123013d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:54.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.165+0000 7f1234f6d640 1 -- 172.21.15.123:0/2458438699 >> 172.21.15.123:0/2458438699 conn(0x7f12300ccec0 msgr2=0x7f123015a550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:54.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.165+0000 7f1234f6d640 1 -- 172.21.15.123:0/2458438699 shutdown_connections 2024-09-15T23:23:54.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.165+0000 7f1234f6d640 1 -- 172.21.15.123:0/2458438699 wait complete. 2024-09-15T23:23:54.167 INFO:tasks.ceph.mds.a.smithi123.stderr: -3402> 2024-09-15T23:23:15.856+0000 7f72c660e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:23:54.177 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T23:23:54.197 INFO:tasks.ceph.mds.a.smithi123.stdout:starting mds.a at 2024-09-15T23:23:54.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.277+0000 7f094f34b640 1 Processor -- start 2024-09-15T23:23:54.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.277+0000 7f094f34b640 1 -- start start 2024-09-15T23:23:54.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.278+0000 7f094f34b640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f094815ec00 0x7f0948071db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:54.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.278+0000 7f094f34b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f09480722f0 0x7f09481601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:54.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.278+0000 7f094f34b640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f094815f0c0 con 0x7f094815c160 2024-09-15T23:23:54.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.278+0000 7f094f34b640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f0948072760 con 0x7f09480722f0 2024-09-15T23:23:54.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.278+0000 7f094f34b640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f0948071ab0 con 0x7f094815ec00 2024-09-15T23:23:54.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.278+0000 7f094d8e8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f09480722f0 0x7f09481601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:54.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.278+0000 7f094d8e8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f09480722f0 0x7f09481601a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48502/0 (socket says 172.21.15.123:48502) 2024-09-15T23:23:54.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.278+0000 7f094d8e8640 1 -- 172.21.15.123:0/4146872998 learned_addr learned my addr 172.21.15.123:0/4146872998 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:54.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.278+0000 7f094d0e7640 1 --1- 172.21.15.123:0/4146872998 >> v1:172.21.15.123:6789/0 conn(0x7f094815c160 0x7f09480713a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56490/0 (socket says 172.21.15.123:56490) 2024-09-15T23:23:54.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.278+0000 7f094d8e8640 1 -- 172.21.15.123:0/4146872998 >> v2:172.21.15.188:3300/0 conn(0x7f094815ec00 msgr2=0x7f0948071db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:54.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.278+0000 7f094d8e8640 1 --2- 172.21.15.123:0/4146872998 >> v2:172.21.15.188:3300/0 conn(0x7f094815ec00 0x7f0948071db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:54.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.278+0000 7f094d8e8640 1 -- 172.21.15.123:0/4146872998 >> v1:172.21.15.123:6789/0 conn(0x7f094815c160 legacy=0x7f09480713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:54.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.278+0000 7f094d8e8640 1 -- 172.21.15.123:0/4146872998 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f094815f3a0 con 0x7f09480722f0 2024-09-15T23:23:54.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.278+0000 7f0947fff640 1 -- 172.21.15.123:0/4146872998 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3384376748 0 0) 0x7f094815f0c0 con 0x7f094815c160 2024-09-15T23:23:54.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.279+0000 7f094d8e8640 1 --2- 172.21.15.123:0/4146872998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09480722f0 0x7f09481601a0 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 crypto rx=0x7f09480b24c0 tx=0x7f094002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33dae85f023080f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:54.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.279+0000 7f0947fff640 1 -- 172.21.15.123:0/4146872998 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0940037070 con 0x7f09480722f0 2024-09-15T23:23:54.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.279+0000 7f0947fff640 1 -- 172.21.15.123:0/4146872998 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0940032440 con 0x7f09480722f0 2024-09-15T23:23:54.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.279+0000 7f0947fff640 1 -- 172.21.15.123:0/4146872998 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0940032810 con 0x7f09480722f0 2024-09-15T23:23:54.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.280+0000 7f094f34b640 1 -- 172.21.15.123:0/4146872998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09480722f0 msgr2=0x7f09481601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:54.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.280+0000 7f094f34b640 1 --2- 172.21.15.123:0/4146872998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09480722f0 0x7f09481601a0 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 crypto rx=0x7f09480b24c0 tx=0x7f094002a270 comp rx=0 tx=0).stop 2024-09-15T23:23:54.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.280+0000 7f094f34b640 1 -- 172.21.15.123:0/4146872998 shutdown_connections 2024-09-15T23:23:54.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.280+0000 7f094f34b640 1 --2- 172.21.15.123:0/4146872998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09480722f0 0x7f09481601a0 unknown :-1 s=CLOSED pgs=2322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:54.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.280+0000 7f094f34b640 1 --2- 172.21.15.123:0/4146872998 >> v2:172.21.15.188:3300/0 conn(0x7f094815ec00 0x7f0948071db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:54.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.280+0000 7f094f34b640 1 -- 172.21.15.123:0/4146872998 >> 172.21.15.123:0/4146872998 conn(0x7f09480b2510 msgr2=0x7f09480b28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:54.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.280+0000 7f094f34b640 1 -- 172.21.15.123:0/4146872998 shutdown_connections 2024-09-15T23:23:54.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.280+0000 7f094f34b640 1 -- 172.21.15.123:0/4146872998 wait complete. 2024-09-15T23:23:54.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.281+0000 7f094f34b640 1 Processor -- start 2024-09-15T23:23:54.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.281+0000 7f094f34b640 1 -- start start 2024-09-15T23:23:54.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.282+0000 7f094f34b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09480722f0 0x7f09481f15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:54.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.282+0000 7f094f34b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f094815c160 0x7f09480cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:54.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.282+0000 7f094f34b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f094815ec00 0x7f09480cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:54.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.282+0000 7f094f34b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f094815c540 con 0x7f09480722f0 2024-09-15T23:23:54.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.282+0000 7f094f34b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f094815f960 con 0x7f094815ec00 2024-09-15T23:23:54.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.282+0000 7f094f34b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f09481606e0 con 0x7f094815c160 2024-09-15T23:23:54.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.282+0000 7f094d0e7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09480722f0 0x7f09481f15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:54.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.282+0000 7f094d0e7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09480722f0 0x7f09481f15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48508/0 (socket says 172.21.15.123:48508) 2024-09-15T23:23:54.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.282+0000 7f094d0e7640 1 -- 172.21.15.123:0/3052848901 learned_addr learned my addr 172.21.15.123:0/3052848901 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:54.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.282+0000 7f094d8e8640 1 --2- 172.21.15.123:0/3052848901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f094815ec00 0x7f09480cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:54.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.282+0000 7f094c8e6640 1 --2- 172.21.15.123:0/3052848901 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f094815c160 0x7f09480cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:54.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.282+0000 7f094d0e7640 1 -- 172.21.15.123:0/3052848901 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f094815c160 msgr2=0x7f09480cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:54.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.282+0000 7f094d0e7640 1 --2- 172.21.15.123:0/3052848901 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f094815c160 0x7f09480cf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:54.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.282+0000 7f094d0e7640 1 -- 172.21.15.123:0/3052848901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f094815ec00 msgr2=0x7f09480cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:54.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.282+0000 7f094d0e7640 1 --2- 172.21.15.123:0/3052848901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f094815ec00 0x7f09480cf7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:54.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.282+0000 7f094d0e7640 1 -- 172.21.15.123:0/3052848901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f094806e4f0 con 0x7f09480722f0 2024-09-15T23:23:54.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.282+0000 7f094d8e8640 1 --2- 172.21.15.123:0/3052848901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f094815ec00 0x7f09480cf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:23:54.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.282+0000 7f094c8e6640 1 --2- 172.21.15.123:0/3052848901 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f094815c160 0x7f09480cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:23:54.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.282+0000 7f094d0e7640 1 --2- 172.21.15.123:0/3052848901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09480722f0 0x7f09481f15f0 secure :-1 s=READY pgs=2323 cs=0 l=1 rev1=1 crypto rx=0x7f093800c890 tx=0x7f093800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:54.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.282+0000 7f0945ffb640 1 -- 172.21.15.123:0/3052848901 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0938018070 con 0x7f09480722f0 2024-09-15T23:23:54.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.282+0000 7f0945ffb640 1 -- 172.21.15.123:0/3052848901 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f093800a640 con 0x7f09480722f0 2024-09-15T23:23:54.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.282+0000 7f094f34b640 1 -- 172.21.15.123:0/3052848901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f094806e7d0 con 0x7f09480722f0 2024-09-15T23:23:54.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.282+0000 7f0945ffb640 1 -- 172.21.15.123:0/3052848901 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093800aa30 con 0x7f09480722f0 2024-09-15T23:23:54.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.283+0000 7f094f34b640 1 -- 172.21.15.123:0/3052848901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f094806ed90 con 0x7f09480722f0 2024-09-15T23:23:54.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.284+0000 7f094f34b640 1 -- 172.21.15.123:0/3052848901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09481601a0 con 0x7f09480722f0 2024-09-15T23:23:54.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.284+0000 7f0945ffb640 1 -- 172.21.15.123:0/3052848901 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f093801b070 con 0x7f09480722f0 2024-09-15T23:23:54.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.285+0000 7f0945ffb640 1 --2- 172.21.15.123:0/3052848901 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f093406c2b0 0x7f093406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:54.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.285+0000 7f0945ffb640 1 -- 172.21.15.123:0/3052848901 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 5795+0+0 (secure 0 0 0) 0x7f093808ab40 con 0x7f09480722f0 2024-09-15T23:23:54.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.285+0000 7f094c8e6640 1 --2- 172.21.15.123:0/3052848901 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f093406c2b0 0x7f093406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:54.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.286+0000 7f094c8e6640 1 --2- 172.21.15.123:0/3052848901 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f093406c2b0 0x7f093406e770 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f094806fa90 tx=0x7f093c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:54.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.289+0000 7f0945ffb640 1 -- 172.21.15.123:0/3052848901 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0938059250 con 0x7f09480722f0 2024-09-15T23:23:54.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:54.490+0000 7f094f34b640 1 -- 172.21.15.123:0/3052848901 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f09480b2130 con 0x7f09480722f0 2024-09-15T23:23:55.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.163+0000 7f0945ffb640 1 -- 172.21.15.123:0/3052848901 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v122) ==== 104+0+0 (secure 0 0 0) 0x7f0938058b50 con 0x7f09480722f0 2024-09-15T23:23:55.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.165+0000 7f094f34b640 1 -- 172.21.15.123:0/3052848901 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f093406c2b0 msgr2=0x7f093406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:55.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.165+0000 7f094f34b640 1 --2- 172.21.15.123:0/3052848901 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f093406c2b0 0x7f093406e770 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f094806fa90 tx=0x7f093c008040 comp rx=0 tx=0).stop 2024-09-15T23:23:55.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.165+0000 7f094f34b640 1 -- 172.21.15.123:0/3052848901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09480722f0 msgr2=0x7f09481f15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:55.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.165+0000 7f094f34b640 1 --2- 172.21.15.123:0/3052848901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09480722f0 0x7f09481f15f0 secure :-1 s=READY pgs=2323 cs=0 l=1 rev1=1 crypto rx=0x7f093800c890 tx=0x7f093800cd50 comp rx=0 tx=0).stop 2024-09-15T23:23:55.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.165+0000 7f094f34b640 1 -- 172.21.15.123:0/3052848901 shutdown_connections 2024-09-15T23:23:55.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.165+0000 7f094f34b640 1 --2- 172.21.15.123:0/3052848901 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f094815ec00 0x7f09480cf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:55.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.165+0000 7f094f34b640 1 --2- 172.21.15.123:0/3052848901 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f094815c160 0x7f09480cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:55.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.165+0000 7f094f34b640 1 --2- 172.21.15.123:0/3052848901 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f093406c2b0 0x7f093406e770 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:55.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.165+0000 7f094f34b640 1 --2- 172.21.15.123:0/3052848901 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09480722f0 0x7f09481f15f0 unknown :-1 s=CLOSED pgs=2323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:55.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.165+0000 7f094f34b640 1 -- 172.21.15.123:0/3052848901 >> 172.21.15.123:0/3052848901 conn(0x7f09480b2510 msgr2=0x7f09480713a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:55.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.165+0000 7f094f34b640 1 -- 172.21.15.123:0/3052848901 shutdown_connections 2024-09-15T23:23:55.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.166+0000 7f094f34b640 1 -- 172.21.15.123:0/3052848901 wait complete. 2024-09-15T23:23:55.179 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T23:23:55.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.322+0000 7fd1c0cac640 1 Processor -- start 2024-09-15T23:23:55.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.322+0000 7fd1c0cac640 1 -- start start 2024-09-15T23:23:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.323+0000 7fd1c0cac640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd1bc15ea90 0x7fd1bc0d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.323+0000 7fd1c0cac640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fd1bc0d16e0 0x7fd1bc0b7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.323+0000 7fd1c0cac640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1bc0cf060 con 0x7fd1bc0d40b0 2024-09-15T23:23:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.323+0000 7fd1c0cac640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fd1bc0d34c0 con 0x7fd1bc15ea90 2024-09-15T23:23:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.323+0000 7fd1c0cac640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fd1bc0cf340 con 0x7fd1bc0d16e0 2024-09-15T23:23:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.323+0000 7fd1ba59c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd1bc15ea90 0x7fd1bc0d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.323+0000 7fd1b9d9b640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd1bc0d40b0 0x7fd1bc0d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56498/0 (socket says 172.21.15.123:56498) 2024-09-15T23:23:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.323+0000 7fd1b9d9b640 1 -- 172.21.15.123:0/2173198933 learned_addr learned my addr 172.21.15.123:0/2173198933 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:23:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.324+0000 7fd1bad9d640 1 --2- 172.21.15.123:0/2173198933 >> v2:172.21.15.188:3300/0 conn(0x7fd1bc0d16e0 0x7fd1bc0b7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:55.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.324+0000 7fd1ba59c640 1 -- 172.21.15.123:0/2173198933 >> v2:172.21.15.188:3300/0 conn(0x7fd1bc0d16e0 msgr2=0x7fd1bc0b7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:55.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.324+0000 7fd1ba59c640 1 --2- 172.21.15.123:0/2173198933 >> v2:172.21.15.188:3300/0 conn(0x7fd1bc0d16e0 0x7fd1bc0b7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:55.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.324+0000 7fd1ba59c640 1 -- 172.21.15.123:0/2173198933 >> v1:172.21.15.123:6789/0 conn(0x7fd1bc0d40b0 legacy=0x7fd1bc0d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:55.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.324+0000 7fd1ba59c640 1 -- 172.21.15.123:0/2173198933 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1bc0cf620 con 0x7fd1bc15ea90 2024-09-15T23:23:55.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.324+0000 7fd1b959a640 1 -- 172.21.15.123:0/2173198933 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3024271444 0 0) 0x7fd1bc0cf060 con 0x7fd1bc0d40b0 2024-09-15T23:23:55.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.324+0000 7fd1ba59c640 1 --2- 172.21.15.123:0/2173198933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1bc15ea90 0x7fd1bc0d2f80 secure :-1 s=READY pgs=2325 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc0c8290 tx=0x7fd1ac02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fea5b397e6d08947 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:55.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.325+0000 7fd1b959a640 1 -- 172.21.15.123:0/2173198933 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac007740 con 0x7fd1bc15ea90 2024-09-15T23:23:55.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.325+0000 7fd1b959a640 1 -- 172.21.15.123:0/2173198933 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1ac0078e0 con 0x7fd1bc15ea90 2024-09-15T23:23:55.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.325+0000 7fd1b959a640 1 -- 172.21.15.123:0/2173198933 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac007cb0 con 0x7fd1bc15ea90 2024-09-15T23:23:55.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.325+0000 7fd1c0cac640 1 -- 172.21.15.123:0/2173198933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1bc15ea90 msgr2=0x7fd1bc0d2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:55.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.325+0000 7fd1c0cac640 1 --2- 172.21.15.123:0/2173198933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1bc15ea90 0x7fd1bc0d2f80 secure :-1 s=READY pgs=2325 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc0c8290 tx=0x7fd1ac02a5f0 comp rx=0 tx=0).stop 2024-09-15T23:23:55.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.325+0000 7fd1c0cac640 1 -- 172.21.15.123:0/2173198933 shutdown_connections 2024-09-15T23:23:55.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.325+0000 7fd1c0cac640 1 --2- 172.21.15.123:0/2173198933 >> v2:172.21.15.188:3300/0 conn(0x7fd1bc0d16e0 0x7fd1bc0b7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:55.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.325+0000 7fd1c0cac640 1 --2- 172.21.15.123:0/2173198933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1bc15ea90 0x7fd1bc0d2f80 unknown :-1 s=CLOSED pgs=2325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:55.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.325+0000 7fd1c0cac640 1 -- 172.21.15.123:0/2173198933 >> 172.21.15.123:0/2173198933 conn(0x7fd1bc06c0e0 msgr2=0x7fd1bc06c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:55.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.325+0000 7fd1c0cac640 1 -- 172.21.15.123:0/2173198933 shutdown_connections 2024-09-15T23:23:55.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.325+0000 7fd1c0cac640 1 -- 172.21.15.123:0/2173198933 wait complete. 2024-09-15T23:23:55.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.327+0000 7fd1c0cac640 1 Processor -- start 2024-09-15T23:23:55.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.327+0000 7fd1c0cac640 1 -- start start 2024-09-15T23:23:55.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.327+0000 7fd1c0cac640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd1bc0d16e0 0x7fd1bc154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:55.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.327+0000 7fd1c0cac640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd1bc0d40b0 0x7fd1bc0b6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:55.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.327+0000 7fd1c0cac640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1bc15ea90 0x7fd1bc0ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:55.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.327+0000 7fd1c0cac640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd1bc15ee70 con 0x7fd1bc15ea90 2024-09-15T23:23:55.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.328+0000 7fd1c0cac640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd1bc0cfbe0 con 0x7fd1bc0d16e0 2024-09-15T23:23:55.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.328+0000 7fd1c0cac640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd1bc0b8000 con 0x7fd1bc0d40b0 2024-09-15T23:23:55.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.328+0000 7fd1bad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1bc15ea90 0x7fd1bc0ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:55.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.328+0000 7fd1bad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1bc15ea90 0x7fd1bc0ae8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48524/0 (socket says 172.21.15.123:48524) 2024-09-15T23:23:55.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.328+0000 7fd1bad9d640 1 -- 172.21.15.123:0/3070333603 learned_addr learned my addr 172.21.15.123:0/3070333603 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:55.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.328+0000 7fd1ba59c640 1 --2- 172.21.15.123:0/3070333603 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd1bc0d16e0 0x7fd1bc154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:55.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.328+0000 7fd1b9d9b640 1 --2- 172.21.15.123:0/3070333603 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd1bc0d40b0 0x7fd1bc0b6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:55.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.328+0000 7fd1bad9d640 1 -- 172.21.15.123:0/3070333603 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd1bc0d40b0 msgr2=0x7fd1bc0b6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:55.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.328+0000 7fd1bad9d640 1 --2- 172.21.15.123:0/3070333603 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd1bc0d40b0 0x7fd1bc0b6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:55.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.328+0000 7fd1bad9d640 1 -- 172.21.15.123:0/3070333603 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd1bc0d16e0 msgr2=0x7fd1bc154cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:55.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.328+0000 7fd1bad9d640 1 --2- 172.21.15.123:0/3070333603 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd1bc0d16e0 0x7fd1bc154cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:55.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.328+0000 7fd1bad9d640 1 -- 172.21.15.123:0/3070333603 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1bc0ace60 con 0x7fd1bc15ea90 2024-09-15T23:23:55.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.328+0000 7fd1b9d9b640 1 --2- 172.21.15.123:0/3070333603 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd1bc0d40b0 0x7fd1bc0b6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:23:55.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.328+0000 7fd1bad9d640 1 --2- 172.21.15.123:0/3070333603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1bc15ea90 0x7fd1bc0ae8e0 secure :-1 s=READY pgs=2326 cs=0 l=1 rev1=1 crypto rx=0x7fd1b400d5d0 tx=0x7fd1b400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:55.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.328+0000 7fd1b2ffd640 1 -- 172.21.15.123:0/3070333603 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b40125f0 con 0x7fd1bc15ea90 2024-09-15T23:23:55.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.328+0000 7fd1b2ffd640 1 -- 172.21.15.123:0/3070333603 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1b4019070 con 0x7fd1bc15ea90 2024-09-15T23:23:55.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.328+0000 7fd1c0cac640 1 -- 172.21.15.123:0/3070333603 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1bc0ad140 con 0x7fd1bc15ea90 2024-09-15T23:23:55.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.328+0000 7fd1b2ffd640 1 -- 172.21.15.123:0/3070333603 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b40129d0 con 0x7fd1bc15ea90 2024-09-15T23:23:55.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.328+0000 7fd1c0cac640 1 -- 172.21.15.123:0/3070333603 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1bc0ad700 con 0x7fd1bc15ea90 2024-09-15T23:23:55.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.329+0000 7fd1c0cac640 1 -- 172.21.15.123:0/3070333603 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1bc0adc00 con 0x7fd1bc15ea90 2024-09-15T23:23:55.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.330+0000 7fd1b2ffd640 1 -- 172.21.15.123:0/3070333603 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd1b4012b70 con 0x7fd1bc15ea90 2024-09-15T23:23:55.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.330+0000 7fd1b2ffd640 1 --2- 172.21.15.123:0/3070333603 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd19c06c2b0 0x7fd19c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:55.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.330+0000 7fd1b2ffd640 1 -- 172.21.15.123:0/3070333603 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 5795+0+0 (secure 0 0 0) 0x7fd1b408b8a0 con 0x7fd1bc15ea90 2024-09-15T23:23:55.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.330+0000 7fd1ba59c640 1 --2- 172.21.15.123:0/3070333603 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd19c06c2b0 0x7fd19c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:55.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.331+0000 7fd1ba59c640 1 --2- 172.21.15.123:0/3070333603 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd19c06c2b0 0x7fd19c06e770 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac034000 tx=0x7fd1ac033040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:55.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.334+0000 7fd1b2ffd640 1 -- 172.21.15.123:0/3070333603 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd1bc0adc00 con 0x7fd1bc15ea90 2024-09-15T23:23:55.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:55.502+0000 7fd1c0cac640 1 -- 172.21.15.123:0/3070333603 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd1bc0d05c0 con 0x7fd1bc15ea90 2024-09-15T23:23:56.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.168+0000 7fd1b2ffd640 1 -- 172.21.15.123:0/3070333603 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v196) ==== 181+0+0 (secure 0 0 0) 0x7fd1b4059fb0 con 0x7fd1bc15ea90 2024-09-15T23:23:56.173 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' removed 2024-09-15T23:23:56.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.171+0000 7fd1c0cac640 1 -- 172.21.15.123:0/3070333603 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd19c06c2b0 msgr2=0x7fd19c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:56.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.171+0000 7fd1c0cac640 1 --2- 172.21.15.123:0/3070333603 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd19c06c2b0 0x7fd19c06e770 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac034000 tx=0x7fd1ac033040 comp rx=0 tx=0).stop 2024-09-15T23:23:56.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.171+0000 7fd1c0cac640 1 -- 172.21.15.123:0/3070333603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1bc15ea90 msgr2=0x7fd1bc0ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:56.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.171+0000 7fd1c0cac640 1 --2- 172.21.15.123:0/3070333603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1bc15ea90 0x7fd1bc0ae8e0 secure :-1 s=READY pgs=2326 cs=0 l=1 rev1=1 crypto rx=0x7fd1b400d5d0 tx=0x7fd1b400da90 comp rx=0 tx=0).stop 2024-09-15T23:23:56.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.171+0000 7fd1c0cac640 1 -- 172.21.15.123:0/3070333603 shutdown_connections 2024-09-15T23:23:56.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.171+0000 7fd1c0cac640 1 --2- 172.21.15.123:0/3070333603 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd19c06c2b0 0x7fd19c06e770 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:56.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.171+0000 7fd1c0cac640 1 --2- 172.21.15.123:0/3070333603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd1bc15ea90 0x7fd1bc0ae8e0 unknown :-1 s=CLOSED pgs=2326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:56.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.171+0000 7fd1c0cac640 1 --2- 172.21.15.123:0/3070333603 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd1bc0d40b0 0x7fd1bc0b6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:56.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.171+0000 7fd1c0cac640 1 --2- 172.21.15.123:0/3070333603 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd1bc0d16e0 0x7fd1bc154cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:56.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.172+0000 7fd1c0cac640 1 -- 172.21.15.123:0/3070333603 >> 172.21.15.123:0/3070333603 conn(0x7fd1bc06c0e0 msgr2=0x7fd1bc161a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:56.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.172+0000 7fd1c0cac640 1 -- 172.21.15.123:0/3070333603 shutdown_connections 2024-09-15T23:23:56.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.172+0000 7fd1c0cac640 1 -- 172.21.15.123:0/3070333603 wait complete. 2024-09-15T23:23:56.186 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T23:23:56.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.290+0000 7f7eaca23640 1 Processor -- start 2024-09-15T23:23:56.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.290+0000 7f7eaca23640 1 -- start start 2024-09-15T23:23:56.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.291+0000 7f7eaca23640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7ea815ea90 0x7f7ea80d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:56.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.291+0000 7f7eaca23640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ea80cf060 con 0x7f7ea80d40b0 2024-09-15T23:23:56.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.291+0000 7f7eaca23640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ea80cf340 con 0x7f7ea80d16e0 2024-09-15T23:23:56.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.291+0000 7f7eaca23640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f7ea80d34c0 con 0x7f7ea815ea90 2024-09-15T23:23:56.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.291+0000 7f7ea659c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7ea815ea90 0x7f7ea80d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:56.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.291+0000 7f7ea5d9b640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7ea80d40b0 0x7f7ea80d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:57348/0 (socket says 172.21.15.123:57348) 2024-09-15T23:23:56.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.291+0000 7f7ea659c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7ea815ea90 0x7f7ea80d2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60970/0 (socket says 172.21.15.123:60970) 2024-09-15T23:23:56.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.291+0000 7f7ea5d9b640 1 -- 172.21.15.123:0/1584107219 learned_addr learned my addr 172.21.15.123:0/1584107219 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:23:56.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.291+0000 7f7ea659c640 1 -- 172.21.15.123:0/1584107219 >> v1:172.21.15.188:6789/0 conn(0x7f7ea80d16e0 legacy=0x7f7ea80b7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:56.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.291+0000 7f7ea659c640 1 -- 172.21.15.123:0/1584107219 >> v1:172.21.15.123:6789/0 conn(0x7f7ea80d40b0 legacy=0x7f7ea80d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:56.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.291+0000 7f7ea559a640 1 -- 172.21.15.123:0/1584107219 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 799138807 0 0) 0x7f7ea80cf060 con 0x7f7ea80d40b0 2024-09-15T23:23:56.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.291+0000 7f7ea659c640 1 -- 172.21.15.123:0/1584107219 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ea80cf620 con 0x7f7ea815ea90 2024-09-15T23:23:56.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.292+0000 7f7ea659c640 1 --2- 172.21.15.123:0/1584107219 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ea815ea90 0x7f7ea80d2f80 secure :-1 s=READY pgs=2328 cs=0 l=1 rev1=1 crypto rx=0x7f7e980097a0 tx=0x7f7e9802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b53498024affff49 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:56.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.292+0000 7f7ea559a640 1 -- 172.21.15.123:0/1584107219 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e98037070 con 0x7f7ea815ea90 2024-09-15T23:23:56.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.292+0000 7f7ea559a640 1 -- 172.21.15.123:0/1584107219 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e9802ae50 con 0x7f7ea815ea90 2024-09-15T23:23:56.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.292+0000 7f7ea559a640 1 -- 172.21.15.123:0/1584107219 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e98032660 con 0x7f7ea815ea90 2024-09-15T23:23:56.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.292+0000 7f7eaca23640 1 -- 172.21.15.123:0/1584107219 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ea815ea90 msgr2=0x7f7ea80d2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:56.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.292+0000 7f7eaca23640 1 --2- 172.21.15.123:0/1584107219 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ea815ea90 0x7f7ea80d2f80 secure :-1 s=READY pgs=2328 cs=0 l=1 rev1=1 crypto rx=0x7f7e980097a0 tx=0x7f7e9802a140 comp rx=0 tx=0).stop 2024-09-15T23:23:56.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.293+0000 7f7eaca23640 1 -- 172.21.15.123:0/1584107219 shutdown_connections 2024-09-15T23:23:56.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.293+0000 7f7eaca23640 1 --2- 172.21.15.123:0/1584107219 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ea815ea90 0x7f7ea80d2f80 unknown :-1 s=CLOSED pgs=2328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:56.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.293+0000 7f7eaca23640 1 -- 172.21.15.123:0/1584107219 >> 172.21.15.123:0/1584107219 conn(0x7f7ea806c0e0 msgr2=0x7f7ea806c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:56.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.293+0000 7f7eaca23640 1 -- 172.21.15.123:0/1584107219 shutdown_connections 2024-09-15T23:23:56.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.293+0000 7f7eaca23640 1 -- 172.21.15.123:0/1584107219 wait complete. 2024-09-15T23:23:56.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.294+0000 7f7eaca23640 1 Processor -- start 2024-09-15T23:23:56.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.294+0000 7f7eaca23640 1 -- start start 2024-09-15T23:23:56.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.295+0000 7f7eaca23640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ea80d16e0 0x7f7ea8161100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:56.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.295+0000 7f7eaca23640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ea80d40b0 0x7f7ea8150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:56.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.295+0000 7f7eaca23640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ea815ea90 0x7f7ea80cde10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:56.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.295+0000 7f7eaca23640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea815ee70 con 0x7f7ea80d16e0 2024-09-15T23:23:56.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.295+0000 7f7eaca23640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea80cfbe0 con 0x7f7ea815ea90 2024-09-15T23:23:56.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.295+0000 7f7eaca23640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7ea80b81d0 con 0x7f7ea80d40b0 2024-09-15T23:23:56.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.295+0000 7f7ea659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ea80d16e0 0x7f7ea8161100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:56.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.295+0000 7f7ea659c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ea80d16e0 0x7f7ea8161100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60974/0 (socket says 172.21.15.123:60974) 2024-09-15T23:23:56.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.295+0000 7f7ea659c640 1 -- 172.21.15.123:0/2250390724 learned_addr learned my addr 172.21.15.123:0/2250390724 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:56.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.295+0000 7f7ea5d9b640 1 --2- 172.21.15.123:0/2250390724 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ea80d40b0 0x7f7ea8150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:56.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.295+0000 7f7ea6d9d640 1 --2- 172.21.15.123:0/2250390724 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ea815ea90 0x7f7ea80cde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:56.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.296+0000 7f7ea659c640 1 -- 172.21.15.123:0/2250390724 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ea80d40b0 msgr2=0x7f7ea8150f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:56.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.296+0000 7f7ea659c640 1 --2- 172.21.15.123:0/2250390724 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ea80d40b0 0x7f7ea8150f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:56.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.296+0000 7f7ea659c640 1 -- 172.21.15.123:0/2250390724 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ea815ea90 msgr2=0x7f7ea80cde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:56.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.296+0000 7f7ea659c640 1 --2- 172.21.15.123:0/2250390724 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ea815ea90 0x7f7ea80cde10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:56.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.296+0000 7f7ea659c640 1 -- 172.21.15.123:0/2250390724 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ea80ce350 con 0x7f7ea80d16e0 2024-09-15T23:23:56.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.296+0000 7f7ea659c640 1 --2- 172.21.15.123:0/2250390724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ea80d16e0 0x7f7ea8161100 secure :-1 s=READY pgs=2329 cs=0 l=1 rev1=1 crypto rx=0x7f7e980097a0 tx=0x7f7e980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:56.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.298+0000 7f7e96ffd640 1 -- 172.21.15.123:0/2250390724 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e98037040 con 0x7f7ea80d16e0 2024-09-15T23:23:56.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.298+0000 7f7e96ffd640 1 -- 172.21.15.123:0/2250390724 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e98004030 con 0x7f7ea80d16e0 2024-09-15T23:23:56.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.298+0000 7f7e96ffd640 1 -- 172.21.15.123:0/2250390724 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e98006e10 con 0x7f7ea80d16e0 2024-09-15T23:23:56.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.298+0000 7f7eaca23640 1 -- 172.21.15.123:0/2250390724 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ea80cc910 con 0x7f7ea80d16e0 2024-09-15T23:23:56.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.298+0000 7f7eaca23640 1 -- 172.21.15.123:0/2250390724 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ea80cced0 con 0x7f7ea80d16e0 2024-09-15T23:23:56.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.300+0000 7f7eaca23640 1 -- 172.21.15.123:0/2250390724 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ea80b3650 con 0x7f7ea80d16e0 2024-09-15T23:23:56.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.300+0000 7f7e96ffd640 1 -- 172.21.15.123:0/2250390724 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7e9803d650 con 0x7f7ea80d16e0 2024-09-15T23:23:56.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.301+0000 7f7e96ffd640 1 --2- 172.21.15.123:0/2250390724 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7e8806c300 0x7f7e8806e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:56.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.301+0000 7f7e96ffd640 1 -- 172.21.15.123:0/2250390724 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(196..196 src has 1..196) ==== 5415+0+0 (secure 0 0 0) 0x7f7e980ab820 con 0x7f7ea80d16e0 2024-09-15T23:23:56.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.301+0000 7f7ea5d9b640 1 --2- 172.21.15.123:0/2250390724 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7e8806c300 0x7f7e8806e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:56.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.302+0000 7f7ea5d9b640 1 --2- 172.21.15.123:0/2250390724 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7e8806c300 0x7f7e8806e7c0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c000f60 tx=0x7f7e9c007d50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:56.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.306+0000 7f7e96ffd640 1 -- 172.21.15.123:0/2250390724 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7ea80b3650 con 0x7f7ea80d16e0 2024-09-15T23:23:56.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:56.470+0000 7f7eaca23640 1 -- 172.21.15.123:0/2250390724 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7ea81f4cc0 con 0x7f7ea80d16e0 2024-09-15T23:23:57.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.170+0000 7f7e96ffd640 1 -- 172.21.15.123:0/2250390724 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v197) ==== 169+0+0 (secure 0 0 0) 0x7f7e98042020 con 0x7f7ea80d16e0 2024-09-15T23:23:57.171 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' removed 2024-09-15T23:23:57.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.173+0000 7f7eaca23640 1 -- 172.21.15.123:0/2250390724 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7e8806c300 msgr2=0x7f7e8806e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:57.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.173+0000 7f7eaca23640 1 --2- 172.21.15.123:0/2250390724 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7e8806c300 0x7f7e8806e7c0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c000f60 tx=0x7f7e9c007d50 comp rx=0 tx=0).stop 2024-09-15T23:23:57.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.173+0000 7f7eaca23640 1 -- 172.21.15.123:0/2250390724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ea80d16e0 msgr2=0x7f7ea8161100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:57.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.173+0000 7f7eaca23640 1 --2- 172.21.15.123:0/2250390724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ea80d16e0 0x7f7ea8161100 secure :-1 s=READY pgs=2329 cs=0 l=1 rev1=1 crypto rx=0x7f7e980097a0 tx=0x7f7e980046c0 comp rx=0 tx=0).stop 2024-09-15T23:23:57.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.174+0000 7f7eaca23640 1 -- 172.21.15.123:0/2250390724 shutdown_connections 2024-09-15T23:23:57.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.174+0000 7f7eaca23640 1 --2- 172.21.15.123:0/2250390724 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f7ea815ea90 0x7f7ea80cde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:57.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.174+0000 7f7eaca23640 1 --2- 172.21.15.123:0/2250390724 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f7ea80d40b0 0x7f7ea8150f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:57.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.174+0000 7f7eaca23640 1 --2- 172.21.15.123:0/2250390724 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f7e8806c300 0x7f7e8806e7c0 secure :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c000f60 tx=0x7f7e9c007d50 comp rx=0 tx=0).stop 2024-09-15T23:23:57.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.174+0000 7f7eaca23640 1 --2- 172.21.15.123:0/2250390724 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ea80d16e0 0x7f7ea8161100 unknown :-1 s=CLOSED pgs=2329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:57.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.174+0000 7f7eaca23640 1 -- 172.21.15.123:0/2250390724 >> 172.21.15.123:0/2250390724 conn(0x7f7ea806c0e0 msgr2=0x7f7ea80b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:57.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.176+0000 7f7eaca23640 1 -- 172.21.15.123:0/2250390724 shutdown_connections 2024-09-15T23:23:57.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.177+0000 7f7eaca23640 1 -- 172.21.15.123:0/2250390724 wait complete. 2024-09-15T23:23:57.197 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T23:23:57.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.301+0000 7f5d51f78640 1 Processor -- start 2024-09-15T23:23:57.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.301+0000 7f5d51f78640 1 -- start start 2024-09-15T23:23:57.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.302+0000 7f5d51f78640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5d4c14c510 0x7f5d4c070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:57.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.302+0000 7f5d51f78640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f5d4c06c320 0x7f5d4c0ce860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:57.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.302+0000 7f5d51f78640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d4c14c8f0 con 0x7f5d4c071480 2024-09-15T23:23:57.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.302+0000 7f5d51f78640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f5d4c0ce0f0 con 0x7f5d4c14c510 2024-09-15T23:23:57.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.302+0000 7f5d51f78640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f5d4c073a80 con 0x7f5d4c06c320 2024-09-15T23:23:57.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.302+0000 7f5d4b7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5d4c14c510 0x7f5d4c070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:57.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.302+0000 7f5d4b7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5d4c14c510 0x7f5d4c070f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60980/0 (socket says 172.21.15.123:60980) 2024-09-15T23:23:57.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.302+0000 7f5d4b7fe640 1 -- 172.21.15.123:0/4229680491 learned_addr learned my addr 172.21.15.123:0/4229680491 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:57.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.303+0000 7f5d4b7fe640 1 -- 172.21.15.123:0/4229680491 >> v2:172.21.15.188:3300/0 conn(0x7f5d4c06c320 msgr2=0x7f5d4c0ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:57.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.303+0000 7f5d4b7fe640 1 --2- 172.21.15.123:0/4229680491 >> v2:172.21.15.188:3300/0 conn(0x7f5d4c06c320 0x7f5d4c0ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:57.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.303+0000 7f5d4b7fe640 1 -- 172.21.15.123:0/4229680491 >> v1:172.21.15.188:6789/0 conn(0x7f5d4c071480 legacy=0x7f5d4c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:57.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.303+0000 7f5d4b7fe640 1 -- 172.21.15.123:0/4229680491 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d4c073d60 con 0x7f5d4c14c510 2024-09-15T23:23:57.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.303+0000 7f5d4b7fe640 1 --2- 172.21.15.123:0/4229680491 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d4c14c510 0x7f5d4c070f40 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c0ce270 tx=0x7f5d4402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5079fb9e2f05eed1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:57.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.304+0000 7f5d4a7fc640 1 -- 172.21.15.123:0/4229680491 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d44036070 con 0x7f5d4c14c510 2024-09-15T23:23:57.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.304+0000 7f5d4a7fc640 1 -- 172.21.15.123:0/4229680491 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d44031600 con 0x7f5d4c14c510 2024-09-15T23:23:57.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.304+0000 7f5d4a7fc640 1 -- 172.21.15.123:0/4229680491 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d440319d0 con 0x7f5d4c14c510 2024-09-15T23:23:57.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.305+0000 7f5d51f78640 1 -- 172.21.15.123:0/4229680491 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d4c14c510 msgr2=0x7f5d4c070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:57.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.305+0000 7f5d51f78640 1 --2- 172.21.15.123:0/4229680491 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d4c14c510 0x7f5d4c070f40 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 crypto rx=0x7f5d4c0ce270 tx=0x7f5d4402a6f0 comp rx=0 tx=0).stop 2024-09-15T23:23:57.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.305+0000 7f5d51f78640 1 -- 172.21.15.123:0/4229680491 shutdown_connections 2024-09-15T23:23:57.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.305+0000 7f5d51f78640 1 --2- 172.21.15.123:0/4229680491 >> v2:172.21.15.188:3300/0 conn(0x7f5d4c06c320 0x7f5d4c0ce860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:57.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.305+0000 7f5d51f78640 1 --2- 172.21.15.123:0/4229680491 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d4c14c510 0x7f5d4c070f40 unknown :-1 s=CLOSED pgs=2330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:57.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.305+0000 7f5d51f78640 1 -- 172.21.15.123:0/4229680491 >> 172.21.15.123:0/4229680491 conn(0x7f5d4c06d0f0 msgr2=0x7f5d4c06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:57.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.305+0000 7f5d51f78640 1 -- 172.21.15.123:0/4229680491 shutdown_connections 2024-09-15T23:23:57.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.305+0000 7f5d51f78640 1 -- 172.21.15.123:0/4229680491 wait complete. 2024-09-15T23:23:57.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.306+0000 7f5d51f78640 1 Processor -- start 2024-09-15T23:23:57.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.306+0000 7f5d51f78640 1 -- start start 2024-09-15T23:23:57.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.307+0000 7f5d51f78640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5d4c06c320 0x7f5d4c160d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:57.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.307+0000 7f5d51f78640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d4c071480 0x7f5d4c13add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:57.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.307+0000 7f5d51f78640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5d4c14c510 0x7f5d4c13c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:57.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.307+0000 7f5d51f78640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4c073610 con 0x7f5d4c071480 2024-09-15T23:23:57.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.307+0000 7f5d51f78640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4c0ce340 con 0x7f5d4c06c320 2024-09-15T23:23:57.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.307+0000 7f5d51f78640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5d4c073790 con 0x7f5d4c14c510 2024-09-15T23:23:57.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.307+0000 7f5d4affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d4c071480 0x7f5d4c13add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:57.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.307+0000 7f5d4affd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d4c071480 0x7f5d4c13add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60982/0 (socket says 172.21.15.123:60982) 2024-09-15T23:23:57.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.307+0000 7f5d4affd640 1 -- 172.21.15.123:0/202757223 learned_addr learned my addr 172.21.15.123:0/202757223 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:57.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.307+0000 7f5d4bfff640 1 --2- 172.21.15.123:0/202757223 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5d4c14c510 0x7f5d4c13c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:57.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.308+0000 7f5d4affd640 1 -- 172.21.15.123:0/202757223 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5d4c14c510 msgr2=0x7f5d4c13c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:57.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.308+0000 7f5d4affd640 1 --2- 172.21.15.123:0/202757223 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5d4c14c510 0x7f5d4c13c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:57.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.308+0000 7f5d4affd640 1 -- 172.21.15.123:0/202757223 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5d4c06c320 msgr2=0x7f5d4c160d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:57.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.308+0000 7f5d4affd640 1 --2- 172.21.15.123:0/202757223 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5d4c06c320 0x7f5d4c160d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:57.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.308+0000 7f5d4affd640 1 -- 172.21.15.123:0/202757223 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d4c1618b0 con 0x7f5d4c071480 2024-09-15T23:23:57.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.308+0000 7f5d4affd640 1 --2- 172.21.15.123:0/202757223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d4c071480 0x7f5d4c13add0 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c00c440 tx=0x7f5d3c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:57.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.308+0000 7f5d33fff640 1 -- 172.21.15.123:0/202757223 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c017070 con 0x7f5d4c071480 2024-09-15T23:23:57.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.308+0000 7f5d33fff640 1 -- 172.21.15.123:0/202757223 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d3c0035f0 con 0x7f5d4c071480 2024-09-15T23:23:57.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.308+0000 7f5d51f78640 1 -- 172.21.15.123:0/202757223 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d4c139d30 con 0x7f5d4c071480 2024-09-15T23:23:57.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.308+0000 7f5d33fff640 1 -- 172.21.15.123:0/202757223 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c0039e0 con 0x7f5d4c071480 2024-09-15T23:23:57.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.308+0000 7f5d51f78640 1 -- 172.21.15.123:0/202757223 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d4c13ce80 con 0x7f5d4c071480 2024-09-15T23:23:57.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.309+0000 7f5d51f78640 1 -- 172.21.15.123:0/202757223 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d4c163190 con 0x7f5d4c071480 2024-09-15T23:23:57.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.309+0000 7f5d33fff640 1 -- 172.21.15.123:0/202757223 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5d3c01a070 con 0x7f5d4c071480 2024-09-15T23:23:57.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.310+0000 7f5d33fff640 1 --2- 172.21.15.123:0/202757223 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5d3806c2b0 0x7f5d3806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:57.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.310+0000 7f5d33fff640 1 -- 172.21.15.123:0/202757223 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(197..197 src has 1..197) ==== 4943+0+0 (secure 0 0 0) 0x7f5d3c08a3e0 con 0x7f5d4c071480 2024-09-15T23:23:57.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.310+0000 7f5d4b7fe640 1 --2- 172.21.15.123:0/202757223 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5d3806c2b0 0x7f5d3806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:57.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.311+0000 7f5d4b7fe640 1 --2- 172.21.15.123:0/202757223 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5d3806c2b0 0x7f5d3806e770 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f5d44033000 tx=0x7f5d4402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:57.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.314+0000 7f5d33fff640 1 -- 172.21.15.123:0/202757223 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5d3c058ee0 con 0x7f5d4c071480 2024-09-15T23:23:57.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.479+0000 7f5d51f78640 1 -- 172.21.15.123:0/202757223 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f5d4c0cdda0 con 0x7f5d4c071480 2024-09-15T23:23:57.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.482+0000 7f5d33fff640 1 -- 172.21.15.123:0/202757223 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v47) ==== 104+0+0 (secure 0 0 0) 0x7f5d3c0010c0 con 0x7f5d4c071480 2024-09-15T23:23:57.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.484+0000 7f5d51f78640 1 -- 172.21.15.123:0/202757223 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5d3806c2b0 msgr2=0x7f5d3806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:57.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.484+0000 7f5d51f78640 1 --2- 172.21.15.123:0/202757223 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5d3806c2b0 0x7f5d3806e770 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f5d44033000 tx=0x7f5d4402e000 comp rx=0 tx=0).stop 2024-09-15T23:23:57.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.484+0000 7f5d51f78640 1 -- 172.21.15.123:0/202757223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d4c071480 msgr2=0x7f5d4c13add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:57.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.484+0000 7f5d51f78640 1 --2- 172.21.15.123:0/202757223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d4c071480 0x7f5d4c13add0 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c00c440 tx=0x7f5d3c00c900 comp rx=0 tx=0).stop 2024-09-15T23:23:57.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.484+0000 7f5d51f78640 1 -- 172.21.15.123:0/202757223 shutdown_connections 2024-09-15T23:23:57.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.484+0000 7f5d51f78640 1 --2- 172.21.15.123:0/202757223 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5d4c14c510 0x7f5d4c13c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:57.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.484+0000 7f5d51f78640 1 --2- 172.21.15.123:0/202757223 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5d3806c2b0 0x7f5d3806e770 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:57.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.484+0000 7f5d51f78640 1 --2- 172.21.15.123:0/202757223 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d4c071480 0x7f5d4c13add0 unknown :-1 s=CLOSED pgs=2331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:57.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.484+0000 7f5d51f78640 1 --2- 172.21.15.123:0/202757223 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5d4c06c320 0x7f5d4c160d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:57.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.484+0000 7f5d51f78640 1 -- 172.21.15.123:0/202757223 >> 172.21.15.123:0/202757223 conn(0x7f5d4c06d0f0 msgr2=0x7f5d4c142190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:57.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.485+0000 7f5d51f78640 1 -- 172.21.15.123:0/202757223 shutdown_connections 2024-09-15T23:23:57.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.485+0000 7f5d51f78640 1 -- 172.21.15.123:0/202757223 wait complete. 2024-09-15T23:23:57.497 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace' 2024-09-15T23:23:57.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.593+0000 7fd67b8f1640 1 Processor -- start 2024-09-15T23:23:57.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.593+0000 7fd67b8f1640 1 -- start start 2024-09-15T23:23:57.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.594+0000 7fd67b8f1640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd67406c320 0x7fd67415bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:57.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.594+0000 7fd67b8f1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd67413eb20 0x7fd67415c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:57.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.594+0000 7fd67b8f1640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd674071180 con 0x7fd6740b2d40 2024-09-15T23:23:57.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.594+0000 7fd67b8f1640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fd674071ab0 con 0x7fd67406c320 2024-09-15T23:23:57.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.594+0000 7fd67b8f1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd674071460 con 0x7fd67413eb20 2024-09-15T23:23:57.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.594+0000 7fd678e8c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd67406c320 0x7fd67415bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:57.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.594+0000 7fd678e8c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd67406c320 0x7fd67415bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60986/0 (socket says 172.21.15.123:60986) 2024-09-15T23:23:57.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.594+0000 7fd678e8c640 1 -- 172.21.15.123:0/3525534058 learned_addr learned my addr 172.21.15.123:0/3525534058 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:57.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.594+0000 7fd679e8e640 1 --2- 172.21.15.123:0/3525534058 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd67413eb20 0x7fd67415c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:57.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.595+0000 7fd678e8c640 1 -- 172.21.15.123:0/3525534058 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd67413eb20 msgr2=0x7fd67415c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:57.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.595+0000 7fd678e8c640 1 --2- 172.21.15.123:0/3525534058 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd67413eb20 0x7fd67415c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:57.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.595+0000 7fd678e8c640 1 -- 172.21.15.123:0/3525534058 >> v1:172.21.15.188:6789/0 conn(0x7fd6740b2d40 legacy=0x7fd67406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:57.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.595+0000 7fd678e8c640 1 -- 172.21.15.123:0/3525534058 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd674071740 con 0x7fd67406c320 2024-09-15T23:23:57.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.595+0000 7fd678e8c640 1 --2- 172.21.15.123:0/3525534058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd67406c320 0x7fd67415bcf0 secure :-1 s=READY pgs=2332 cs=0 l=1 rev1=1 crypto rx=0x7fd664009870 tx=0x7fd66402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=922a590f6bd30e74 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:57.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.595+0000 7fd66bfff640 1 -- 172.21.15.123:0/3525534058 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd664037070 con 0x7fd67406c320 2024-09-15T23:23:57.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.595+0000 7fd66bfff640 1 -- 172.21.15.123:0/3525534058 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd664032440 con 0x7fd67406c320 2024-09-15T23:23:57.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.595+0000 7fd66bfff640 1 -- 172.21.15.123:0/3525534058 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd664032810 con 0x7fd67406c320 2024-09-15T23:23:57.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.596+0000 7fd67b8f1640 1 -- 172.21.15.123:0/3525534058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd67406c320 msgr2=0x7fd67415bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:57.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.596+0000 7fd67b8f1640 1 --2- 172.21.15.123:0/3525534058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd67406c320 0x7fd67415bcf0 secure :-1 s=READY pgs=2332 cs=0 l=1 rev1=1 crypto rx=0x7fd664009870 tx=0x7fd66402a270 comp rx=0 tx=0).stop 2024-09-15T23:23:57.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.596+0000 7fd67b8f1640 1 -- 172.21.15.123:0/3525534058 shutdown_connections 2024-09-15T23:23:57.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.596+0000 7fd67b8f1640 1 --2- 172.21.15.123:0/3525534058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd67406c320 0x7fd67415bcf0 unknown :-1 s=CLOSED pgs=2332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:57.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.596+0000 7fd67b8f1640 1 --2- 172.21.15.123:0/3525534058 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd67413eb20 0x7fd67415c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:57.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.596+0000 7fd67b8f1640 1 -- 172.21.15.123:0/3525534058 >> 172.21.15.123:0/3525534058 conn(0x7fd6740ccec0 msgr2=0x7fd6740cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:57.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.596+0000 7fd67b8f1640 1 -- 172.21.15.123:0/3525534058 shutdown_connections 2024-09-15T23:23:57.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.596+0000 7fd67b8f1640 1 -- 172.21.15.123:0/3525534058 wait complete. 2024-09-15T23:23:57.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.597+0000 7fd67b8f1640 1 Processor -- start 2024-09-15T23:23:57.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.597+0000 7fd67b8f1640 1 -- start start 2024-09-15T23:23:57.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.598+0000 7fd67b8f1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd67406c320 0x7fd67415e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:57.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.598+0000 7fd67b8f1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6740b2d40 0x7fd67413d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:57.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.598+0000 7fd67b8f1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd67413eb20 0x7fd67413dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:57.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.598+0000 7fd67b8f1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd6740720c0 con 0x7fd6740b2d40 2024-09-15T23:23:57.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.598+0000 7fd67b8f1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd674071f40 con 0x7fd67406c320 2024-09-15T23:23:57.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.598+0000 7fd67b8f1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd674072240 con 0x7fd67413eb20 2024-09-15T23:23:57.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.598+0000 7fd678e8c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6740b2d40 0x7fd67413d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:57.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.598+0000 7fd678e8c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6740b2d40 0x7fd67413d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:60996/0 (socket says 172.21.15.123:60996) 2024-09-15T23:23:57.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.598+0000 7fd678e8c640 1 -- 172.21.15.123:0/2903624288 learned_addr learned my addr 172.21.15.123:0/2903624288 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:57.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.598+0000 7fd679e8e640 1 --2- 172.21.15.123:0/2903624288 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd67413eb20 0x7fd67413dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:57.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.598+0000 7fd67968d640 1 --2- 172.21.15.123:0/2903624288 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd67406c320 0x7fd67415e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:57.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.598+0000 7fd678e8c640 1 -- 172.21.15.123:0/2903624288 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd67413eb20 msgr2=0x7fd67413dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:57.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.598+0000 7fd678e8c640 1 --2- 172.21.15.123:0/2903624288 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd67413eb20 0x7fd67413dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:57.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.598+0000 7fd678e8c640 1 -- 172.21.15.123:0/2903624288 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd67406c320 msgr2=0x7fd67415e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:57.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.598+0000 7fd678e8c640 1 --2- 172.21.15.123:0/2903624288 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd67406c320 0x7fd67415e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:57.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.598+0000 7fd678e8c640 1 -- 172.21.15.123:0/2903624288 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd67415d640 con 0x7fd6740b2d40 2024-09-15T23:23:57.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.598+0000 7fd679e8e640 1 --2- 172.21.15.123:0/2903624288 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd67413eb20 0x7fd67413dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:23:57.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.598+0000 7fd67968d640 1 --2- 172.21.15.123:0/2903624288 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd67406c320 0x7fd67415e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:23:57.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.599+0000 7fd678e8c640 1 --2- 172.21.15.123:0/2903624288 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6740b2d40 0x7fd67413d5e0 secure :-1 s=READY pgs=2333 cs=0 l=1 rev1=1 crypto rx=0x7fd664000c00 tx=0x7fd6640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:57.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.599+0000 7fd669ffb640 1 -- 172.21.15.123:0/2903624288 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd664041020 con 0x7fd6740b2d40 2024-09-15T23:23:57.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.599+0000 7fd669ffb640 1 -- 172.21.15.123:0/2903624288 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6640306c0 con 0x7fd6740b2d40 2024-09-15T23:23:57.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.599+0000 7fd67b8f1640 1 -- 172.21.15.123:0/2903624288 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd67415f990 con 0x7fd6740b2d40 2024-09-15T23:23:57.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.599+0000 7fd669ffb640 1 -- 172.21.15.123:0/2903624288 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd664037040 con 0x7fd6740b2d40 2024-09-15T23:23:57.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.599+0000 7fd67b8f1640 1 -- 172.21.15.123:0/2903624288 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd67415dbc0 con 0x7fd6740b2d40 2024-09-15T23:23:57.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.600+0000 7fd67b8f1640 1 -- 172.21.15.123:0/2903624288 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd67406bc10 con 0x7fd6740b2d40 2024-09-15T23:23:57.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.600+0000 7fd669ffb640 1 -- 172.21.15.123:0/2903624288 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd664044020 con 0x7fd6740b2d40 2024-09-15T23:23:57.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.601+0000 7fd669ffb640 1 --2- 172.21.15.123:0/2903624288 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd65806c2b0 0x7fd65806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:57.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.601+0000 7fd669ffb640 1 -- 172.21.15.123:0/2903624288 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(197..197 src has 1..197) ==== 4943+0+0 (secure 0 0 0) 0x7fd6640ab540 con 0x7fd6740b2d40 2024-09-15T23:23:57.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.601+0000 7fd67968d640 1 --2- 172.21.15.123:0/2903624288 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd65806c2b0 0x7fd65806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:57.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.602+0000 7fd67968d640 1 --2- 172.21.15.123:0/2903624288 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd65806c2b0 0x7fd65806e770 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fd67415f080 tx=0x7fd670009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:57.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.605+0000 7fd669ffb640 1 -- 172.21.15.123:0/2903624288 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd66404b070 con 0x7fd6740b2d40 2024-09-15T23:23:57.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:57.832+0000 7fd67b8f1640 1 -- 172.21.15.123:0/2903624288 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]} v 0) -- 0x7fd67406c9c0 con 0x7fd6740b2d40 2024-09-15T23:23:58.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.178+0000 7fd669ffb640 1 -- 172.21.15.123:0/2903624288 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]}]=0 v576) ==== 140+0+0 (secure 0 0 0) 0x7fd66407a040 con 0x7fd6740b2d40 2024-09-15T23:23:58.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.180+0000 7fd67b8f1640 1 -- 172.21.15.123:0/2903624288 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd65806c2b0 msgr2=0x7fd65806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:58.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.180+0000 7fd67b8f1640 1 --2- 172.21.15.123:0/2903624288 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd65806c2b0 0x7fd65806e770 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fd67415f080 tx=0x7fd670009040 comp rx=0 tx=0).stop 2024-09-15T23:23:58.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.180+0000 7fd67b8f1640 1 -- 172.21.15.123:0/2903624288 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6740b2d40 msgr2=0x7fd67413d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:58.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.180+0000 7fd67b8f1640 1 --2- 172.21.15.123:0/2903624288 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6740b2d40 0x7fd67413d5e0 secure :-1 s=READY pgs=2333 cs=0 l=1 rev1=1 crypto rx=0x7fd664000c00 tx=0x7fd6640046c0 comp rx=0 tx=0).stop 2024-09-15T23:23:58.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.180+0000 7fd67b8f1640 1 -- 172.21.15.123:0/2903624288 shutdown_connections 2024-09-15T23:23:58.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.180+0000 7fd67b8f1640 1 --2- 172.21.15.123:0/2903624288 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd67413eb20 0x7fd67413dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:58.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.180+0000 7fd67b8f1640 1 --2- 172.21.15.123:0/2903624288 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd65806c2b0 0x7fd65806e770 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:58.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.180+0000 7fd67b8f1640 1 --2- 172.21.15.123:0/2903624288 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6740b2d40 0x7fd67413d5e0 unknown :-1 s=CLOSED pgs=2333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:58.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.180+0000 7fd67b8f1640 1 --2- 172.21.15.123:0/2903624288 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd67406c320 0x7fd67415e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:58.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.180+0000 7fd67b8f1640 1 -- 172.21.15.123:0/2903624288 >> 172.21.15.123:0/2903624288 conn(0x7fd6740ccec0 msgr2=0x7fd6740ce720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:58.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.181+0000 7fd67b8f1640 1 -- 172.21.15.123:0/2903624288 shutdown_connections 2024-09-15T23:23:58.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.181+0000 7fd67b8f1640 1 -- 172.21.15.123:0/2903624288 wait complete. 2024-09-15T23:23:58.193 INFO:tasks.cephfs_test_runner:test_mdsdir_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) ... ok 2024-09-15T23:23:58.193 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-15T23:23:58.194 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:23:58.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.290+0000 7f20786e6640 1 Processor -- start 2024-09-15T23:23:58.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.290+0000 7f20786e6640 1 -- start start 2024-09-15T23:23:58.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.291+0000 7f20786e6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f207015ed20 0x7f20700b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:58.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.291+0000 7f20786e6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f20700d23b0 0x7f20700b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:58.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.291+0000 7f20786e6640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20700d0e70 con 0x7f20700cf2d0 2024-09-15T23:23:58.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.291+0000 7f20786e6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f20700d41c0 con 0x7f20700d23b0 2024-09-15T23:23:58.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.291+0000 7f20786e6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f20700d35b0 con 0x7f207015ed20 2024-09-15T23:23:58.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.292+0000 7f2076482640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f207015ed20 0x7f20700b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:58.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.292+0000 7f2075c81640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f20700d23b0 0x7f20700b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:58.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.292+0000 7f2076482640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f207015ed20 0x7f20700b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:59516/0 (socket says 172.21.15.123:59516) 2024-09-15T23:23:58.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.292+0000 7f2076482640 1 -- 172.21.15.123:0/1116761895 learned_addr learned my addr 172.21.15.123:0/1116761895 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:58.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.292+0000 7f2076c83640 1 --1- 172.21.15.123:0/1116761895 >> v1:172.21.15.188:6789/0 conn(0x7f20700cf2d0 0x7f20700cf760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:47098/0 (socket says 172.21.15.123:47098) 2024-09-15T23:23:58.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.292+0000 7f2075480640 1 -- 172.21.15.123:0/1116761895 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2831735952 0 0) 0x7f2068001490 con 0x7f20700cf2d0 2024-09-15T23:23:58.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.292+0000 7f2075480640 1 -- 172.21.15.123:0/1116761895 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f205c003520 con 0x7f20700cf2d0 2024-09-15T23:23:58.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.292+0000 7f2076482640 1 -- 172.21.15.123:0/1116761895 >> v2:172.21.15.188:3300/0 conn(0x7f20700d23b0 msgr2=0x7f20700b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:58.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.292+0000 7f2076482640 1 --2- 172.21.15.123:0/1116761895 >> v2:172.21.15.188:3300/0 conn(0x7f20700d23b0 0x7f20700b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:58.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.292+0000 7f2076482640 1 -- 172.21.15.123:0/1116761895 >> v1:172.21.15.188:6789/0 conn(0x7f20700cf2d0 legacy=0x7f20700cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:58.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.292+0000 7f2076482640 1 -- 172.21.15.123:0/1116761895 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20700d3890 con 0x7f207015ed20 2024-09-15T23:23:58.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.292+0000 7f2075c81640 1 --2- 172.21.15.123:0/1116761895 >> v2:172.21.15.188:3300/0 conn(0x7f20700d23b0 0x7f20700b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:23:58.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.293+0000 7f2076482640 1 --2- 172.21.15.123:0/1116761895 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f207015ed20 0x7f20700b6260 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f206c009870 tx=0x7f206c02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f931b48077bfc064 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:58.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.293+0000 7f2075480640 1 -- 172.21.15.123:0/1116761895 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206c037070 con 0x7f207015ed20 2024-09-15T23:23:58.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.293+0000 7f2075480640 1 -- 172.21.15.123:0/1116761895 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f206c032440 con 0x7f207015ed20 2024-09-15T23:23:58.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.293+0000 7f2075480640 1 -- 172.21.15.123:0/1116761895 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206c0327f0 con 0x7f207015ed20 2024-09-15T23:23:58.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.294+0000 7f20786e6640 1 -- 172.21.15.123:0/1116761895 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f207015ed20 msgr2=0x7f20700b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:58.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.294+0000 7f20786e6640 1 --2- 172.21.15.123:0/1116761895 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f207015ed20 0x7f20700b6260 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f206c009870 tx=0x7f206c02a270 comp rx=0 tx=0).stop 2024-09-15T23:23:58.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.294+0000 7f20786e6640 1 -- 172.21.15.123:0/1116761895 shutdown_connections 2024-09-15T23:23:58.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.294+0000 7f20786e6640 1 --2- 172.21.15.123:0/1116761895 >> v2:172.21.15.188:3300/0 conn(0x7f20700d23b0 0x7f20700b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:58.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.294+0000 7f20786e6640 1 --2- 172.21.15.123:0/1116761895 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f207015ed20 0x7f20700b6260 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:58.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.294+0000 7f20786e6640 1 -- 172.21.15.123:0/1116761895 >> 172.21.15.123:0/1116761895 conn(0x7f20700d1260 msgr2=0x7f20700d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:58.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.294+0000 7f20786e6640 1 -- 172.21.15.123:0/1116761895 shutdown_connections 2024-09-15T23:23:58.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.294+0000 7f20786e6640 1 -- 172.21.15.123:0/1116761895 wait complete. 2024-09-15T23:23:58.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.295+0000 7f20786e6640 1 Processor -- start 2024-09-15T23:23:58.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.295+0000 7f20786e6640 1 -- start start 2024-09-15T23:23:58.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.296+0000 7f20786e6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20700cf2d0 0x7f207014b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:58.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.296+0000 7f20786e6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20700d23b0 0x7f207015fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:58.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.296+0000 7f20786e6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f207015ed20 0x7f20701f4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:58.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.296+0000 7f20786e6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f20700d32a0 con 0x7f20700cf2d0 2024-09-15T23:23:58.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.296+0000 7f20786e6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f20700d3e50 con 0x7f207015ed20 2024-09-15T23:23:58.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.296+0000 7f20786e6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f207015f100 con 0x7f20700d23b0 2024-09-15T23:23:58.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.296+0000 7f2076482640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20700cf2d0 0x7f207014b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:58.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.296+0000 7f2076482640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20700cf2d0 0x7f207014b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32768/0 (socket says 172.21.15.123:32768) 2024-09-15T23:23:58.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.296+0000 7f2076482640 1 -- 172.21.15.123:0/1425374409 learned_addr learned my addr 172.21.15.123:0/1425374409 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:58.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.296+0000 7f2075c81640 1 --2- 172.21.15.123:0/1425374409 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20700d23b0 0x7f207015fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:58.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.296+0000 7f2076c83640 1 --2- 172.21.15.123:0/1425374409 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f207015ed20 0x7f20701f4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:58.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.296+0000 7f2076482640 1 -- 172.21.15.123:0/1425374409 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20700d23b0 msgr2=0x7f207015fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:58.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.296+0000 7f2076482640 1 --2- 172.21.15.123:0/1425374409 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20700d23b0 0x7f207015fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:58.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.296+0000 7f2076482640 1 -- 172.21.15.123:0/1425374409 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f207015ed20 msgr2=0x7f20701f4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:58.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.296+0000 7f2076482640 1 --2- 172.21.15.123:0/1425374409 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f207015ed20 0x7f20701f4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:58.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.296+0000 7f2076482640 1 -- 172.21.15.123:0/1425374409 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20701559a0 con 0x7f20700cf2d0 2024-09-15T23:23:58.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.296+0000 7f2076482640 1 --2- 172.21.15.123:0/1425374409 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20700cf2d0 0x7f207014b8a0 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 crypto rx=0x7f206c009870 tx=0x7f206c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:58.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.296+0000 7f2066ffd640 1 -- 172.21.15.123:0/1425374409 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206c037040 con 0x7f20700cf2d0 2024-09-15T23:23:58.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.296+0000 7f2066ffd640 1 -- 172.21.15.123:0/1425374409 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f206c004230 con 0x7f20700cf2d0 2024-09-15T23:23:58.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.296+0000 7f20786e6640 1 -- 172.21.15.123:0/1425374409 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2070155c80 con 0x7f20700cf2d0 2024-09-15T23:23:58.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.296+0000 7f2066ffd640 1 -- 172.21.15.123:0/1425374409 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206c003610 con 0x7f20700cf2d0 2024-09-15T23:23:58.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.296+0000 7f20786e6640 1 -- 172.21.15.123:0/1425374409 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2070156240 con 0x7f20700cf2d0 2024-09-15T23:23:58.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.297+0000 7f20786e6640 1 -- 172.21.15.123:0/1425374409 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20700b7010 con 0x7f20700cf2d0 2024-09-15T23:23:58.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.298+0000 7f2066ffd640 1 -- 172.21.15.123:0/1425374409 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f206c0037b0 con 0x7f20700cf2d0 2024-09-15T23:23:58.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.298+0000 7f2066ffd640 1 --2- 172.21.15.123:0/1425374409 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f205406c2e0 0x7f205406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:58.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.298+0000 7f2066ffd640 1 -- 172.21.15.123:0/1425374409 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(197..197 src has 1..197) ==== 4943+0+0 (secure 0 0 0) 0x7f206c0abcc0 con 0x7f20700cf2d0 2024-09-15T23:23:58.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.298+0000 7f2075c81640 1 --2- 172.21.15.123:0/1425374409 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f205406c2e0 0x7f205406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:58.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.299+0000 7f2075c81640 1 --2- 172.21.15.123:0/1425374409 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f205406c2e0 0x7f205406e7a0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f2060009560 tx=0x7f2060009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:58.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.302+0000 7f2066ffd640 1 -- 172.21.15.123:0/1425374409 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f206c07a290 con 0x7f20700cf2d0 2024-09-15T23:23:58.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.467+0000 7f20786e6640 1 -- 172.21.15.123:0/1425374409 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f20700b3f20 con 0x7f20700cf2d0 2024-09-15T23:23:58.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.468+0000 7f2066ffd640 1 -- 172.21.15.123:0/1425374409 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v197) ==== 74+0+13068 (secure 0 0 0) 0x7f206c07e590 con 0x7f20700cf2d0 2024-09-15T23:23:58.469 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:23:58.469 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":197,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:23:57.169128+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":192,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6835/2653908784":"2024-09-16T23:23:54.161058+0000","172.21.15.123:6834/2653908784":"2024-09-16T23:23:54.161058+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:23:58.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.470+0000 7f20786e6640 1 -- 172.21.15.123:0/1425374409 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f205406c2e0 msgr2=0x7f205406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:58.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.470+0000 7f20786e6640 1 --2- 172.21.15.123:0/1425374409 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f205406c2e0 0x7f205406e7a0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f2060009560 tx=0x7f2060009190 comp rx=0 tx=0).stop 2024-09-15T23:23:58.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.470+0000 7f20786e6640 1 -- 172.21.15.123:0/1425374409 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20700cf2d0 msgr2=0x7f207014b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:58.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.470+0000 7f20786e6640 1 --2- 172.21.15.123:0/1425374409 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20700cf2d0 0x7f207014b8a0 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 crypto rx=0x7f206c009870 tx=0x7f206c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:23:58.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.470+0000 7f20786e6640 1 -- 172.21.15.123:0/1425374409 shutdown_connections 2024-09-15T23:23:58.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.470+0000 7f20786e6640 1 --2- 172.21.15.123:0/1425374409 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f207015ed20 0x7f20701f4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:58.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.470+0000 7f20786e6640 1 --2- 172.21.15.123:0/1425374409 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f20700d23b0 0x7f207015fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:58.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.470+0000 7f20786e6640 1 --2- 172.21.15.123:0/1425374409 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f205406c2e0 0x7f205406e7a0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:58.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.470+0000 7f20786e6640 1 --2- 172.21.15.123:0/1425374409 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20700cf2d0 0x7f207014b8a0 unknown :-1 s=CLOSED pgs=2334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:58.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.470+0000 7f20786e6640 1 -- 172.21.15.123:0/1425374409 >> 172.21.15.123:0/1425374409 conn(0x7f20700d1260 msgr2=0x7f20700d1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:58.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.470+0000 7f20786e6640 1 -- 172.21.15.123:0/1425374409 shutdown_connections 2024-09-15T23:23:58.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.470+0000 7f20786e6640 1 -- 172.21.15.123:0/1425374409 wait complete. 2024-09-15T23:23:58.482 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T23:12:01.531886+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T23:23:58.482 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T23:23:58.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.583+0000 7f249b186640 1 Processor -- start 2024-09-15T23:23:58.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.583+0000 7f249b186640 1 -- start start 2024-09-15T23:23:58.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.584+0000 7f249b186640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f24940b5520 0x7f249406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:58.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.584+0000 7f249b186640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f249415f550 con 0x7f249406d260 2024-09-15T23:23:58.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.584+0000 7f249b186640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f249415f830 con 0x7f249415e990 2024-09-15T23:23:58.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.584+0000 7f249b186640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f249415fb10 con 0x7f24940b5520 2024-09-15T23:23:58.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.584+0000 7f2499723640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f249406d260 0x7f2494162a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:57350/0 (socket says 172.21.15.123:57350) 2024-09-15T23:23:58.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.584+0000 7f2499723640 1 -- 172.21.15.123:0/810753515 learned_addr learned my addr 172.21.15.123:0/810753515 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:23:58.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.584+0000 7f24937fe640 1 -- 172.21.15.123:0/810753515 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3580449104 0 0) 0x7f249415f550 con 0x7f249406d260 2024-09-15T23:23:58.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.584+0000 7f2493fff640 1 --2- 172.21.15.123:0/810753515 >> v2:172.21.15.188:3300/0 conn(0x7f24940b5520 0x7f249406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:58.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.584+0000 7f24937fe640 1 -- 172.21.15.123:0/810753515 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f247c003520 con 0x7f249406d260 2024-09-15T23:23:58.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.585+0000 7f24937fe640 1 -- 172.21.15.123:0/810753515 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1086835434 0 0) 0x7f247c003520 con 0x7f249406d260 2024-09-15T23:23:58.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.585+0000 7f24937fe640 1 -- 172.21.15.123:0/810753515 >> v2:172.21.15.188:3300/0 conn(0x7f24940b5520 msgr2=0x7f249406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:58.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.585+0000 7f24937fe640 1 --2- 172.21.15.123:0/810753515 >> v2:172.21.15.188:3300/0 conn(0x7f24940b5520 0x7f249406cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:58.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.585+0000 7f24937fe640 1 -- 172.21.15.123:0/810753515 >> v1:172.21.15.188:6789/0 conn(0x7f249415e990 legacy=0x7f249415ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:58.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.585+0000 7f24937fe640 1 -- 172.21.15.123:0/810753515 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24941624e0 con 0x7f249406d260 2024-09-15T23:23:58.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.585+0000 7f24937fe640 1 -- 172.21.15.123:0/810753515 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f248c001670 con 0x7f249406d260 2024-09-15T23:23:58.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.585+0000 7f24937fe640 1 -- 172.21.15.123:0/810753515 >> v1:172.21.15.123:6789/0 conn(0x7f249406d260 legacy=0x7f2494162a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:58.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.585+0000 7f24937fe640 1 --2- 172.21.15.123:0/810753515 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f247c0039b0 0x7f247c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:58.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.585+0000 7f24937fe640 1 --2- 172.21.15.123:0/810753515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f247c004800 0x7f247c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:58.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.585+0000 7f24937fe640 1 --2- 172.21.15.123:0/810753515 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f247c0051c0 0x7f247c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:58.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.585+0000 7f24937fe640 1 -- 172.21.15.123:0/810753515 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f249415fb10 con 0x7f247c004800 2024-09-15T23:23:58.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.585+0000 7f24937fe640 1 -- 172.21.15.123:0/810753515 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f247c00c060 con 0x7f247c0051c0 2024-09-15T23:23:58.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.585+0000 7f24937fe640 1 -- 172.21.15.123:0/810753515 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f247c00c260 con 0x7f247c0039b0 2024-09-15T23:23:58.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.585+0000 7f2493fff640 1 --2- 172.21.15.123:0/810753515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f247c004800 0x7f247c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:58.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.585+0000 7f2498f22640 1 --2- 172.21.15.123:0/810753515 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f247c0039b0 0x7f247c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:58.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.585+0000 7f2499723640 1 --2- 172.21.15.123:0/810753515 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f247c0051c0 0x7f247c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:58.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.585+0000 7f2493fff640 1 -- 172.21.15.123:0/810753515 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f247c0039b0 msgr2=0x7f247c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:58.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.585+0000 7f2493fff640 1 --2- 172.21.15.123:0/810753515 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f247c0039b0 0x7f247c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:58.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.585+0000 7f2493fff640 1 -- 172.21.15.123:0/810753515 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f247c0051c0 msgr2=0x7f247c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:58.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.585+0000 7f2493fff640 1 --2- 172.21.15.123:0/810753515 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f247c0051c0 0x7f247c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:58.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.585+0000 7f2493fff640 1 -- 172.21.15.123:0/810753515 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f247c003520 con 0x7f247c004800 2024-09-15T23:23:58.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.585+0000 7f2499723640 1 --2- 172.21.15.123:0/810753515 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f247c0051c0 0x7f247c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:23:58.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.585+0000 7f2499723640 1 -- 172.21.15.123:0/810753515 reap_dead start 2024-09-15T23:23:58.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.586+0000 7f2493fff640 1 --2- 172.21.15.123:0/810753515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f247c004800 0x7f247c004c80 secure :-1 s=READY pgs=2336 cs=0 l=1 rev1=1 crypto rx=0x7f2488009fc0 tx=0x7f247c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25fd6b57292f366a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:58.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.586+0000 7f24937fe640 1 -- 172.21.15.123:0/810753515 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2488009c10 con 0x7f247c004800 2024-09-15T23:23:58.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.586+0000 7f24937fe640 1 -- 172.21.15.123:0/810753515 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2488036070 con 0x7f247c004800 2024-09-15T23:23:58.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.586+0000 7f24937fe640 1 -- 172.21.15.123:0/810753515 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2488031880 con 0x7f247c004800 2024-09-15T23:23:58.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.586+0000 7f249b186640 1 -- 172.21.15.123:0/810753515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f247c004800 msgr2=0x7f247c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:58.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.586+0000 7f249b186640 1 --2- 172.21.15.123:0/810753515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f247c004800 0x7f247c004c80 secure :-1 s=READY pgs=2336 cs=0 l=1 rev1=1 crypto rx=0x7f2488009fc0 tx=0x7f247c005830 comp rx=0 tx=0).stop 2024-09-15T23:23:58.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.586+0000 7f249b186640 1 -- 172.21.15.123:0/810753515 shutdown_connections 2024-09-15T23:23:58.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.586+0000 7f249b186640 1 --2- 172.21.15.123:0/810753515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f247c004800 0x7f247c004c80 unknown :-1 s=CLOSED pgs=2336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:58.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.586+0000 7f249b186640 1 -- 172.21.15.123:0/810753515 >> 172.21.15.123:0/810753515 conn(0x7f24940d25d0 msgr2=0x7f24940d29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:58.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.587+0000 7f249b186640 1 -- 172.21.15.123:0/810753515 shutdown_connections 2024-09-15T23:23:58.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.587+0000 7f249b186640 1 -- 172.21.15.123:0/810753515 wait complete. 2024-09-15T23:23:58.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.588+0000 7f249b186640 1 Processor -- start 2024-09-15T23:23:58.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.588+0000 7f249b186640 1 -- start start 2024-09-15T23:23:58.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.589+0000 7f249b186640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f247c004800 0x7f2494151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:58.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.589+0000 7f249b186640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24941f5920 0x7f24941f71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:58.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.589+0000 7f249b186640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f24941f76f0 0x7f24941537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:58.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.589+0000 7f249b186640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f249406d0b0 con 0x7f24941f5920 2024-09-15T23:23:58.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.589+0000 7f249b186640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f249406cf30 con 0x7f24941f76f0 2024-09-15T23:23:58.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.589+0000 7f249b186640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f249415ed70 con 0x7f247c004800 2024-09-15T23:23:58.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.589+0000 7f2493fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24941f5920 0x7f24941f71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:58.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.589+0000 7f2493fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24941f5920 0x7f24941f71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32798/0 (socket says 172.21.15.123:32798) 2024-09-15T23:23:58.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.589+0000 7f2493fff640 1 -- 172.21.15.123:0/455593547 learned_addr learned my addr 172.21.15.123:0/455593547 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:58.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.589+0000 7f2499723640 1 --2- 172.21.15.123:0/455593547 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f24941f76f0 0x7f24941537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:58.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.589+0000 7f2498f22640 1 --2- 172.21.15.123:0/455593547 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f247c004800 0x7f2494151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:58.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.589+0000 7f2493fff640 1 -- 172.21.15.123:0/455593547 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f247c004800 msgr2=0x7f2494151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:58.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.589+0000 7f2493fff640 1 --2- 172.21.15.123:0/455593547 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f247c004800 0x7f2494151820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:58.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.589+0000 7f2493fff640 1 -- 172.21.15.123:0/455593547 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f24941f76f0 msgr2=0x7f24941537c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:58.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.589+0000 7f2493fff640 1 --2- 172.21.15.123:0/455593547 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f24941f76f0 0x7f24941537c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:58.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.589+0000 7f2493fff640 1 -- 172.21.15.123:0/455593547 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24941f7b70 con 0x7f24941f5920 2024-09-15T23:23:58.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.589+0000 7f2493fff640 1 --2- 172.21.15.123:0/455593547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24941f5920 0x7f24941f71b0 secure :-1 s=READY pgs=2337 cs=0 l=1 rev1=1 crypto rx=0x7f248802aee0 tx=0x7f2488009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:58.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.589+0000 7f24917fa640 1 -- 172.21.15.123:0/455593547 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2488009c10 con 0x7f24941f5920 2024-09-15T23:23:58.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.589+0000 7f24917fa640 1 -- 172.21.15.123:0/455593547 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2488003990 con 0x7f24941f5920 2024-09-15T23:23:58.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.589+0000 7f249b186640 1 -- 172.21.15.123:0/455593547 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2494154560 con 0x7f24941f5920 2024-09-15T23:23:58.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.589+0000 7f24917fa640 1 -- 172.21.15.123:0/455593547 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2488003d60 con 0x7f24941f5920 2024-09-15T23:23:58.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.589+0000 7f249b186640 1 -- 172.21.15.123:0/455593547 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24940cc990 con 0x7f24941f5920 2024-09-15T23:23:58.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.590+0000 7f249b186640 1 -- 172.21.15.123:0/455593547 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f249415f100 con 0x7f24941f5920 2024-09-15T23:23:58.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.591+0000 7f24917fa640 1 -- 172.21.15.123:0/455593547 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2488005d10 con 0x7f24941f5920 2024-09-15T23:23:58.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.591+0000 7f24917fa640 1 --2- 172.21.15.123:0/455593547 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f248006c2b0 0x7f248006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:58.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.591+0000 7f24917fa640 1 -- 172.21.15.123:0/455593547 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(197..197 src has 1..197) ==== 4943+0+0 (secure 0 0 0) 0x7f24880ac430 con 0x7f24941f5920 2024-09-15T23:23:58.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.591+0000 7f2498f22640 1 --2- 172.21.15.123:0/455593547 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f248006c2b0 0x7f248006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:58.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.592+0000 7f2498f22640 1 --2- 172.21.15.123:0/455593547 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f248006c2b0 0x7f248006e770 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f2484000c00 tx=0x7f2484009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:58.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.595+0000 7f24917fa640 1 -- 172.21.15.123:0/455593547 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f248807af30 con 0x7f24941f5920 2024-09-15T23:23:58.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.760+0000 7f249b186640 1 -- 172.21.15.123:0/455593547 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f249406ea90 con 0x7f24941f5920 2024-09-15T23:23:58.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.760+0000 7f24917fa640 1 -- 172.21.15.123:0/455593547 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v197) ==== 93+0+10 (secure 0 0 0) 0x7f248807a830 con 0x7f24941f5920 2024-09-15T23:23:58.761 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-09-15T23:23:58.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.762+0000 7f249b186640 1 -- 172.21.15.123:0/455593547 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f248006c2b0 msgr2=0x7f248006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:58.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.762+0000 7f249b186640 1 --2- 172.21.15.123:0/455593547 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f248006c2b0 0x7f248006e770 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f2484000c00 tx=0x7f2484009040 comp rx=0 tx=0).stop 2024-09-15T23:23:58.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.762+0000 7f249b186640 1 -- 172.21.15.123:0/455593547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24941f5920 msgr2=0x7f24941f71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:58.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.762+0000 7f249b186640 1 --2- 172.21.15.123:0/455593547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24941f5920 0x7f24941f71b0 secure :-1 s=READY pgs=2337 cs=0 l=1 rev1=1 crypto rx=0x7f248802aee0 tx=0x7f2488009750 comp rx=0 tx=0).stop 2024-09-15T23:23:58.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.762+0000 7f249b186640 1 -- 172.21.15.123:0/455593547 shutdown_connections 2024-09-15T23:23:58.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.762+0000 7f249b186640 1 --2- 172.21.15.123:0/455593547 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f24941f76f0 0x7f24941537c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:58.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.762+0000 7f249b186640 1 --2- 172.21.15.123:0/455593547 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f248006c2b0 0x7f248006e770 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:58.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.762+0000 7f249b186640 1 --2- 172.21.15.123:0/455593547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24941f5920 0x7f24941f71b0 unknown :-1 s=CLOSED pgs=2337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:58.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.762+0000 7f249b186640 1 --2- 172.21.15.123:0/455593547 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f247c004800 0x7f2494151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:58.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.762+0000 7f249b186640 1 -- 172.21.15.123:0/455593547 >> 172.21.15.123:0/455593547 conn(0x7f24940d25d0 msgr2=0x7f24940b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:58.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.762+0000 7f249b186640 1 -- 172.21.15.123:0/455593547 shutdown_connections 2024-09-15T23:23:58.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.762+0000 7f249b186640 1 -- 172.21.15.123:0/455593547 wait complete. 2024-09-15T23:23:58.774 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace' 2024-09-15T23:23:58.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.871+0000 7f26c1823640 1 Processor -- start 2024-09-15T23:23:58.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.872+0000 7f26c1823640 1 -- start start 2024-09-15T23:23:58.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.872+0000 7f26c1823640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f26bc15ed20 0x7f26bc0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:58.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.872+0000 7f26c1823640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26bc0d23b0 0x7f26bc0b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:58.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.872+0000 7f26c1823640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26bc0d0e70 con 0x7f26bc0cf2d0 2024-09-15T23:23:58.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.872+0000 7f26c1823640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f26bc0d41c0 con 0x7f26bc15ed20 2024-09-15T23:23:58.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.872+0000 7f26c1823640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f26bc0d35b0 con 0x7f26bc0d23b0 2024-09-15T23:23:58.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.872+0000 7f26baffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f26bc15ed20 0x7f26bc0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:58.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.873+0000 7f26bb7fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f26bc0cf2d0 0x7f26bc0cf760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:57360/0 (socket says 172.21.15.123:57360) 2024-09-15T23:23:58.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.873+0000 7f26baffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f26bc15ed20 0x7f26bc0b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32804/0 (socket says 172.21.15.123:32804) 2024-09-15T23:23:58.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.873+0000 7f26bb7fe640 1 -- 172.21.15.123:0/1915855555 learned_addr learned my addr 172.21.15.123:0/1915855555 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:23:58.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.873+0000 7f26ba7fc640 1 --2- 172.21.15.123:0/1915855555 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26bc0d23b0 0x7f26bc0b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:58.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.873+0000 7f26baffd640 1 -- 172.21.15.123:0/1915855555 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26bc0d23b0 msgr2=0x7f26bc0b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:58.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.873+0000 7f26baffd640 1 --2- 172.21.15.123:0/1915855555 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26bc0d23b0 0x7f26bc0b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:58.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.873+0000 7f26baffd640 1 -- 172.21.15.123:0/1915855555 >> v1:172.21.15.123:6789/0 conn(0x7f26bc0cf2d0 legacy=0x7f26bc0cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:58.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.873+0000 7f26baffd640 1 -- 172.21.15.123:0/1915855555 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26bc0d3890 con 0x7f26bc15ed20 2024-09-15T23:23:58.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.873+0000 7f26b9ffb640 1 -- 172.21.15.123:0/1915855555 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 75180104 0 0) 0x7f26ac001110 con 0x7f26bc0cf2d0 2024-09-15T23:23:58.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.874+0000 7f26baffd640 1 --2- 172.21.15.123:0/1915855555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26bc15ed20 0x7f26bc0b6260 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7f26b4009d90 tx=0x7f26b402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d78a325c078b38 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:58.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.874+0000 7f26b9ffb640 1 -- 172.21.15.123:0/1915855555 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b4007740 con 0x7f26bc15ed20 2024-09-15T23:23:58.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.874+0000 7f26b9ffb640 1 -- 172.21.15.123:0/1915855555 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26b40078e0 con 0x7f26bc15ed20 2024-09-15T23:23:58.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.874+0000 7f26b9ffb640 1 -- 172.21.15.123:0/1915855555 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b4007cb0 con 0x7f26bc15ed20 2024-09-15T23:23:58.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.874+0000 7f26c1823640 1 -- 172.21.15.123:0/1915855555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26bc15ed20 msgr2=0x7f26bc0b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:58.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.874+0000 7f26c1823640 1 --2- 172.21.15.123:0/1915855555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26bc15ed20 0x7f26bc0b6260 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7f26b4009d90 tx=0x7f26b402a660 comp rx=0 tx=0).stop 2024-09-15T23:23:58.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.874+0000 7f26c1823640 1 -- 172.21.15.123:0/1915855555 shutdown_connections 2024-09-15T23:23:58.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.874+0000 7f26c1823640 1 --2- 172.21.15.123:0/1915855555 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26bc0d23b0 0x7f26bc0b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:58.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.874+0000 7f26c1823640 1 --2- 172.21.15.123:0/1915855555 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26bc15ed20 0x7f26bc0b6260 unknown :-1 s=CLOSED pgs=2339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:58.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.874+0000 7f26c1823640 1 -- 172.21.15.123:0/1915855555 >> 172.21.15.123:0/1915855555 conn(0x7f26bc0d1260 msgr2=0x7f26bc0d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:58.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.874+0000 7f26c1823640 1 -- 172.21.15.123:0/1915855555 shutdown_connections 2024-09-15T23:23:58.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.874+0000 7f26c1823640 1 -- 172.21.15.123:0/1915855555 wait complete. 2024-09-15T23:23:58.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.875+0000 7f26c1823640 1 Processor -- start 2024-09-15T23:23:58.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.876+0000 7f26c1823640 1 -- start start 2024-09-15T23:23:58.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.876+0000 7f26c1823640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26bc0cf2d0 0x7f26bc162020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:58.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.876+0000 7f26c1823640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26bc0d23b0 0x7f26bc0cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:58.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.876+0000 7f26c1823640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26bc15ed20 0x7f26bc154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:58.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.876+0000 7f26c1823640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f26bc0d32a0 con 0x7f26bc15ed20 2024-09-15T23:23:58.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.876+0000 7f26c1823640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f26bc0d3e50 con 0x7f26bc0cf2d0 2024-09-15T23:23:58.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.876+0000 7f26c1823640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f26bc15f100 con 0x7f26bc0d23b0 2024-09-15T23:23:58.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.876+0000 7f26bb7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26bc15ed20 0x7f26bc154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:58.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.876+0000 7f26bb7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26bc15ed20 0x7f26bc154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32812/0 (socket says 172.21.15.123:32812) 2024-09-15T23:23:58.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.876+0000 7f26bb7fe640 1 -- 172.21.15.123:0/3014441182 learned_addr learned my addr 172.21.15.123:0/3014441182 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:58.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.877+0000 7f26bb7fe640 1 -- 172.21.15.123:0/3014441182 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26bc0d23b0 msgr2=0x7f26bc0cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:58.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.877+0000 7f26bb7fe640 1 --2- 172.21.15.123:0/3014441182 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26bc0d23b0 0x7f26bc0cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:58.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.877+0000 7f26bb7fe640 1 -- 172.21.15.123:0/3014441182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26bc0cf2d0 msgr2=0x7f26bc162020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:58.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.877+0000 7f26bb7fe640 1 --2- 172.21.15.123:0/3014441182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26bc0cf2d0 0x7f26bc162020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:58.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.877+0000 7f26bb7fe640 1 -- 172.21.15.123:0/3014441182 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26bc0cbdf0 con 0x7f26bc15ed20 2024-09-15T23:23:58.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.877+0000 7f26bb7fe640 1 --2- 172.21.15.123:0/3014441182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26bc15ed20 0x7f26bc154830 secure :-1 s=READY pgs=2340 cs=0 l=1 rev1=1 crypto rx=0x7f26ac00c780 tx=0x7f26ac00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:58.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.877+0000 7f26a3fff640 1 -- 172.21.15.123:0/3014441182 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ac018070 con 0x7f26bc15ed20 2024-09-15T23:23:58.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.877+0000 7f26a3fff640 1 -- 172.21.15.123:0/3014441182 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26ac0070d0 con 0x7f26bc15ed20 2024-09-15T23:23:58.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.877+0000 7f26c1823640 1 -- 172.21.15.123:0/3014441182 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26bc154d70 con 0x7f26bc15ed20 2024-09-15T23:23:58.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.877+0000 7f26a3fff640 1 -- 172.21.15.123:0/3014441182 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ac007500 con 0x7f26bc15ed20 2024-09-15T23:23:58.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.877+0000 7f26c1823640 1 -- 172.21.15.123:0/3014441182 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26bc0cc370 con 0x7f26bc15ed20 2024-09-15T23:23:58.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.878+0000 7f26c1823640 1 -- 172.21.15.123:0/3014441182 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26bc0ccc60 con 0x7f26bc15ed20 2024-09-15T23:23:58.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.878+0000 7f26a3fff640 1 -- 172.21.15.123:0/3014441182 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f26ac01b070 con 0x7f26bc15ed20 2024-09-15T23:23:58.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.879+0000 7f26a3fff640 1 --2- 172.21.15.123:0/3014441182 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f26a806c2b0 0x7f26a806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:58.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.879+0000 7f26a3fff640 1 -- 172.21.15.123:0/3014441182 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(197..197 src has 1..197) ==== 4943+0+0 (secure 0 0 0) 0x7f26ac08a3b0 con 0x7f26bc15ed20 2024-09-15T23:23:58.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.879+0000 7f26baffd640 1 --2- 172.21.15.123:0/3014441182 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f26a806c2b0 0x7f26a806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:58.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.880+0000 7f26baffd640 1 --2- 172.21.15.123:0/3014441182 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f26a806c2b0 0x7f26a806e770 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f26b4034000 tx=0x7f26b402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:58.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:58.883+0000 7f26a3fff640 1 -- 172.21.15.123:0/3014441182 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f26bc0d0e70 con 0x7f26bc15ed20 2024-09-15T23:23:59.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.111+0000 7f26c1823640 1 -- 172.21.15.123:0/3014441182 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]} v 0) -- 0x7f26bc0b7010 con 0x7f26bc15ed20 2024-09-15T23:23:59.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.179+0000 7f26a3fff640 1 -- 172.21.15.123:0/3014441182 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]}]=0 v577) ==== 136+0+0 (secure 0 0 0) 0x7f26ac058e20 con 0x7f26bc15ed20 2024-09-15T23:23:59.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.182+0000 7f26c1823640 1 -- 172.21.15.123:0/3014441182 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f26a806c2b0 msgr2=0x7f26a806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:59.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.182+0000 7f26c1823640 1 --2- 172.21.15.123:0/3014441182 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f26a806c2b0 0x7f26a806e770 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f26b4034000 tx=0x7f26b402e000 comp rx=0 tx=0).stop 2024-09-15T23:23:59.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.182+0000 7f26c1823640 1 -- 172.21.15.123:0/3014441182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26bc15ed20 msgr2=0x7f26bc154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:59.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.182+0000 7f26c1823640 1 --2- 172.21.15.123:0/3014441182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26bc15ed20 0x7f26bc154830 secure :-1 s=READY pgs=2340 cs=0 l=1 rev1=1 crypto rx=0x7f26ac00c780 tx=0x7f26ac00cc40 comp rx=0 tx=0).stop 2024-09-15T23:23:59.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.183+0000 7f26c1823640 1 -- 172.21.15.123:0/3014441182 shutdown_connections 2024-09-15T23:23:59.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.183+0000 7f26c1823640 1 --2- 172.21.15.123:0/3014441182 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f26a806c2b0 0x7f26a806e770 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:59.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.183+0000 7f26c1823640 1 --2- 172.21.15.123:0/3014441182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26bc15ed20 0x7f26bc154830 unknown :-1 s=CLOSED pgs=2340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:59.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.183+0000 7f26c1823640 1 --2- 172.21.15.123:0/3014441182 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f26bc0d23b0 0x7f26bc0cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:59.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.183+0000 7f26c1823640 1 --2- 172.21.15.123:0/3014441182 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f26bc0cf2d0 0x7f26bc162020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:59.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.183+0000 7f26c1823640 1 -- 172.21.15.123:0/3014441182 >> 172.21.15.123:0/3014441182 conn(0x7f26bc0d1260 msgr2=0x7f26bc0d4740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:59.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.183+0000 7f26c1823640 1 -- 172.21.15.123:0/3014441182 shutdown_connections 2024-09-15T23:23:59.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.183+0000 7f26c1823640 1 -- 172.21.15.123:0/3014441182 wait complete. 2024-09-15T23:23:59.195 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T23:23:59.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.293+0000 7f68d83ef640 1 Processor -- start 2024-09-15T23:23:59.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.294+0000 7f68d83ef640 1 -- start start 2024-09-15T23:23:59.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.294+0000 7f68d83ef640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f68d0155950 0x7f68d0073600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:59.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.294+0000 7f68d83ef640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68d0073cc0 con 0x7f68d00afb20 2024-09-15T23:23:59.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.294+0000 7f68d83ef640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68d0071aa0 con 0x7f68d0162c80 2024-09-15T23:23:59.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.294+0000 7f68d83ef640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f68d0070370 con 0x7f68d0155950 2024-09-15T23:23:59.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.295+0000 7f68d618b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f68d0155950 0x7f68d0073600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:59.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.295+0000 7f68d698c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f68d00afb20 0x7f68d015f2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:57374/0 (socket says 172.21.15.123:57374) 2024-09-15T23:23:59.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.295+0000 7f68d698c640 1 -- 172.21.15.123:0/1922333825 learned_addr learned my addr 172.21.15.123:0/1922333825 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:23:59.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.295+0000 7f68d618b640 1 -- 172.21.15.123:0/1922333825 >> v1:172.21.15.188:6789/0 conn(0x7f68d0162c80 legacy=0x7f68d006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:59.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.295+0000 7f68d618b640 1 -- 172.21.15.123:0/1922333825 >> v1:172.21.15.123:6789/0 conn(0x7f68d00afb20 legacy=0x7f68d015f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:59.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.295+0000 7f68d618b640 1 -- 172.21.15.123:0/1922333825 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68d0071d80 con 0x7f68d0155950 2024-09-15T23:23:59.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.295+0000 7f68d5189640 1 -- 172.21.15.123:0/1922333825 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2496597317 0 0) 0x7f68d0073cc0 con 0x7f68d00afb20 2024-09-15T23:23:59.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.296+0000 7f68d618b640 1 --2- 172.21.15.123:0/1922333825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68d0155950 0x7f68d0073600 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 crypto rx=0x7f68c80097a0 tx=0x7f68c802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=668c7b3987abbc8e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:59.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.296+0000 7f68d5189640 1 -- 172.21.15.123:0/1922333825 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c8037070 con 0x7f68d0155950 2024-09-15T23:23:59.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.296+0000 7f68d5189640 1 -- 172.21.15.123:0/1922333825 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68c8032440 con 0x7f68d0155950 2024-09-15T23:23:59.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.296+0000 7f68d5189640 1 -- 172.21.15.123:0/1922333825 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c8032810 con 0x7f68d0155950 2024-09-15T23:23:59.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.296+0000 7f68d83ef640 1 -- 172.21.15.123:0/1922333825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68d0155950 msgr2=0x7f68d0073600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:59.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.296+0000 7f68d83ef640 1 --2- 172.21.15.123:0/1922333825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68d0155950 0x7f68d0073600 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 crypto rx=0x7f68c80097a0 tx=0x7f68c802a1e0 comp rx=0 tx=0).stop 2024-09-15T23:23:59.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.296+0000 7f68d83ef640 1 -- 172.21.15.123:0/1922333825 shutdown_connections 2024-09-15T23:23:59.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.296+0000 7f68d83ef640 1 --2- 172.21.15.123:0/1922333825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68d0155950 0x7f68d0073600 unknown :-1 s=CLOSED pgs=2342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:59.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.296+0000 7f68d83ef640 1 -- 172.21.15.123:0/1922333825 >> 172.21.15.123:0/1922333825 conn(0x7f68d006db30 msgr2=0x7f68d006df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:59.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.296+0000 7f68d83ef640 1 -- 172.21.15.123:0/1922333825 shutdown_connections 2024-09-15T23:23:59.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.296+0000 7f68d83ef640 1 -- 172.21.15.123:0/1922333825 wait complete. 2024-09-15T23:23:59.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.298+0000 7f68d83ef640 1 Processor -- start 2024-09-15T23:23:59.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.298+0000 7f68d83ef640 1 -- start start 2024-09-15T23:23:59.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.298+0000 7f68d83ef640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68d00afb20 0x7f68d0144a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:59.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.298+0000 7f68d83ef640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68d0162c80 0x7f68d0161730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:59.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.298+0000 7f68d83ef640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68d0161c70 0x7f68d00ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:59.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.298+0000 7f68d83ef640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f68d0072060 con 0x7f68d00afb20 2024-09-15T23:23:59.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.298+0000 7f68d83ef640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f68d01630e0 con 0x7f68d0161c70 2024-09-15T23:23:59.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.298+0000 7f68d83ef640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f68d00721e0 con 0x7f68d0162c80 2024-09-15T23:23:59.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.298+0000 7f68d618b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68d00afb20 0x7f68d0144a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:59.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.298+0000 7f68d618b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68d00afb20 0x7f68d0144a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32830/0 (socket says 172.21.15.123:32830) 2024-09-15T23:23:59.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.298+0000 7f68d618b640 1 -- 172.21.15.123:0/3638535185 learned_addr learned my addr 172.21.15.123:0/3638535185 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:59.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.299+0000 7f68d618b640 1 -- 172.21.15.123:0/3638535185 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68d0162c80 msgr2=0x7f68d0161730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:59.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.299+0000 7f68d618b640 1 --2- 172.21.15.123:0/3638535185 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68d0162c80 0x7f68d0161730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:59.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.299+0000 7f68d618b640 1 -- 172.21.15.123:0/3638535185 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68d0161c70 msgr2=0x7f68d00ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:59.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.299+0000 7f68d618b640 1 --2- 172.21.15.123:0/3638535185 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68d0161c70 0x7f68d00ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:59.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.299+0000 7f68d618b640 1 -- 172.21.15.123:0/3638535185 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68d01622f0 con 0x7f68d00afb20 2024-09-15T23:23:59.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.299+0000 7f68d618b640 1 --2- 172.21.15.123:0/3638535185 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68d00afb20 0x7f68d0144a40 secure :-1 s=READY pgs=2343 cs=0 l=1 rev1=1 crypto rx=0x7f68c80097a0 tx=0x7f68c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:59.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.299+0000 7f68ceffd640 1 -- 172.21.15.123:0/3638535185 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c8041070 con 0x7f68d00afb20 2024-09-15T23:23:59.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.299+0000 7f68ceffd640 1 -- 172.21.15.123:0/3638535185 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68c803c870 con 0x7f68d00afb20 2024-09-15T23:23:59.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.299+0000 7f68d83ef640 1 -- 172.21.15.123:0/3638535185 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68d01625d0 con 0x7f68d00afb20 2024-09-15T23:23:59.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.299+0000 7f68ceffd640 1 -- 172.21.15.123:0/3638535185 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c8037040 con 0x7f68d00afb20 2024-09-15T23:23:59.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.299+0000 7f68d83ef640 1 -- 172.21.15.123:0/3638535185 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68d00b1ce0 con 0x7f68d00afb20 2024-09-15T23:23:59.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.300+0000 7f68d83ef640 1 -- 172.21.15.123:0/3638535185 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68d0073600 con 0x7f68d00afb20 2024-09-15T23:23:59.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.300+0000 7f68ceffd640 1 -- 172.21.15.123:0/3638535185 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f68c8044070 con 0x7f68d00afb20 2024-09-15T23:23:59.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.301+0000 7f68ceffd640 1 --2- 172.21.15.123:0/3638535185 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f68bc06c2b0 0x7f68bc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:59.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.301+0000 7f68ceffd640 1 -- 172.21.15.123:0/3638535185 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(197..197 src has 1..197) ==== 4943+0+0 (secure 0 0 0) 0x7f68c80abeb0 con 0x7f68d00afb20 2024-09-15T23:23:59.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.301+0000 7f68d598a640 1 --2- 172.21.15.123:0/3638535185 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f68bc06c2b0 0x7f68bc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:59.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.302+0000 7f68d598a640 1 --2- 172.21.15.123:0/3638535185 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f68bc06c2b0 0x7f68bc06e770 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f68d00d0740 tx=0x7f68c4009230 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:59.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.305+0000 7f68ceffd640 1 -- 172.21.15.123:0/3638535185 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f68c807aad0 con 0x7f68d00afb20 2024-09-15T23:23:59.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.473+0000 7f68d83ef640 1 -- 172.21.15.123:0/3638535185 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f68d00cd320 con 0x7f68d00afb20 2024-09-15T23:23:59.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.477+0000 7f68ceffd640 1 -- 172.21.15.123:0/3638535185 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v48)=0 v48) ==== 122+0+0 (secure 0 0 0) 0x7f68c807a3d0 con 0x7f68d00afb20 2024-09-15T23:23:59.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.479+0000 7f68d83ef640 1 -- 172.21.15.123:0/3638535185 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f68bc06c2b0 msgr2=0x7f68bc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:59.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.479+0000 7f68d83ef640 1 --2- 172.21.15.123:0/3638535185 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f68bc06c2b0 0x7f68bc06e770 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f68d00d0740 tx=0x7f68c4009230 comp rx=0 tx=0).stop 2024-09-15T23:23:59.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.479+0000 7f68d83ef640 1 -- 172.21.15.123:0/3638535185 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68d00afb20 msgr2=0x7f68d0144a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:59.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.479+0000 7f68d83ef640 1 --2- 172.21.15.123:0/3638535185 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68d00afb20 0x7f68d0144a40 secure :-1 s=READY pgs=2343 cs=0 l=1 rev1=1 crypto rx=0x7f68c80097a0 tx=0x7f68c80046c0 comp rx=0 tx=0).stop 2024-09-15T23:23:59.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.479+0000 7f68d83ef640 1 -- 172.21.15.123:0/3638535185 shutdown_connections 2024-09-15T23:23:59.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.479+0000 7f68d83ef640 1 --2- 172.21.15.123:0/3638535185 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f68d0161c70 0x7f68d00ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:59.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.479+0000 7f68d83ef640 1 --2- 172.21.15.123:0/3638535185 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f68d0162c80 0x7f68d0161730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:59.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.479+0000 7f68d83ef640 1 --2- 172.21.15.123:0/3638535185 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f68bc06c2b0 0x7f68bc06e770 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:59.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.479+0000 7f68d83ef640 1 --2- 172.21.15.123:0/3638535185 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f68d00afb20 0x7f68d0144a40 unknown :-1 s=CLOSED pgs=2343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:59.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.479+0000 7f68d83ef640 1 -- 172.21.15.123:0/3638535185 >> 172.21.15.123:0/3638535185 conn(0x7f68d006db30 msgr2=0x7f68d0154610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:59.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.479+0000 7f68d83ef640 1 -- 172.21.15.123:0/3638535185 shutdown_connections 2024-09-15T23:23:59.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.479+0000 7f68d83ef640 1 -- 172.21.15.123:0/3638535185 wait complete. 2024-09-15T23:23:59.491 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:23:59.491 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:23:59.529 DEBUG:teuthology.orchestra.run.smithi188:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:23:59.573 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:23:59.574 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:23:59.574 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:23:59.589 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:23:59.589 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:23:59.590 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:23:59.632 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:23:59.632 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:23:59.632 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:23:59.649 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:23:59.649 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:23:59.649 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:23:59.689 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:23:59.689 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-15T23:23:59.689 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:23:59.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.786+0000 7f971def1640 1 Processor -- start 2024-09-15T23:23:59.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.786+0000 7f971def1640 1 -- start start 2024-09-15T23:23:59.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.787+0000 7f971def1640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f971806c320 0x7f971815bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:59.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.787+0000 7f971def1640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f971813eb20 0x7f971815c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:59.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.787+0000 7f971def1640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9718071180 con 0x7f97180b2d40 2024-09-15T23:23:59.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.787+0000 7f971def1640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f9718071ab0 con 0x7f971806c320 2024-09-15T23:23:59.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.787+0000 7f971def1640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f9718071460 con 0x7f971813eb20 2024-09-15T23:23:59.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.787+0000 7f9716ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f971806c320 0x7f971815bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:59.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.787+0000 7f9716ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f971806c320 0x7f971815bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32832/0 (socket says 172.21.15.123:32832) 2024-09-15T23:23:59.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.787+0000 7f9716ffd640 1 -- 172.21.15.123:0/821576339 learned_addr learned my addr 172.21.15.123:0/821576339 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:59.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.787+0000 7f9717fff640 1 --2- 172.21.15.123:0/821576339 >> v2:172.21.15.188:3300/0 conn(0x7f971813eb20 0x7f971815c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:59.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.788+0000 7f9716ffd640 1 -- 172.21.15.123:0/821576339 >> v2:172.21.15.188:3300/0 conn(0x7f971813eb20 msgr2=0x7f971815c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:59.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.788+0000 7f9716ffd640 1 --2- 172.21.15.123:0/821576339 >> v2:172.21.15.188:3300/0 conn(0x7f971813eb20 0x7f971815c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:59.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.788+0000 7f9716ffd640 1 -- 172.21.15.123:0/821576339 >> v1:172.21.15.188:6789/0 conn(0x7f97180b2d40 legacy=0x7f971806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:23:59.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.788+0000 7f9716ffd640 1 -- 172.21.15.123:0/821576339 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9718071740 con 0x7f971806c320 2024-09-15T23:23:59.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.788+0000 7f9717fff640 1 --2- 172.21.15.123:0/821576339 >> v2:172.21.15.188:3300/0 conn(0x7f971813eb20 0x7f971815c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:23:59.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.788+0000 7f9716ffd640 1 --2- 172.21.15.123:0/821576339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f971806c320 0x7f971815bcf0 secure :-1 s=READY pgs=2344 cs=0 l=1 rev1=1 crypto rx=0x7f97181595c0 tx=0x7f970c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b05c3dfa3023dc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:59.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.788+0000 7f97167fc640 1 -- 172.21.15.123:0/821576339 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970c037070 con 0x7f971806c320 2024-09-15T23:23:59.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.788+0000 7f97167fc640 1 -- 172.21.15.123:0/821576339 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f970c032440 con 0x7f971806c320 2024-09-15T23:23:59.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.789+0000 7f97167fc640 1 -- 172.21.15.123:0/821576339 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970c032810 con 0x7f971806c320 2024-09-15T23:23:59.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.789+0000 7f971def1640 1 -- 172.21.15.123:0/821576339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f971806c320 msgr2=0x7f971815bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:59.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.789+0000 7f971def1640 1 --2- 172.21.15.123:0/821576339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f971806c320 0x7f971815bcf0 secure :-1 s=READY pgs=2344 cs=0 l=1 rev1=1 crypto rx=0x7f97181595c0 tx=0x7f970c02a270 comp rx=0 tx=0).stop 2024-09-15T23:23:59.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.789+0000 7f971def1640 1 -- 172.21.15.123:0/821576339 shutdown_connections 2024-09-15T23:23:59.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.789+0000 7f971def1640 1 --2- 172.21.15.123:0/821576339 >> v2:172.21.15.188:3300/0 conn(0x7f971813eb20 0x7f971815c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:59.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.789+0000 7f971def1640 1 --2- 172.21.15.123:0/821576339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f971806c320 0x7f971815bcf0 unknown :-1 s=CLOSED pgs=2344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:59.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.789+0000 7f971def1640 1 -- 172.21.15.123:0/821576339 >> 172.21.15.123:0/821576339 conn(0x7f97180ccec0 msgr2=0x7f97180cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:59.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.789+0000 7f971def1640 1 -- 172.21.15.123:0/821576339 shutdown_connections 2024-09-15T23:23:59.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.789+0000 7f971def1640 1 -- 172.21.15.123:0/821576339 wait complete. 2024-09-15T23:23:59.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.790+0000 7f971def1640 1 Processor -- start 2024-09-15T23:23:59.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.790+0000 7f971def1640 1 -- start start 2024-09-15T23:23:59.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.791+0000 7f971def1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f971806c320 0x7f97181541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:59.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.791+0000 7f971def1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f97180b2d40 0x7f97180b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:59.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.791+0000 7f971def1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f971813eb20 0x7f971815b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:59.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.791+0000 7f971def1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f97180720c0 con 0x7f971813eb20 2024-09-15T23:23:59.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.791+0000 7f971def1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9718071f40 con 0x7f97180b2d40 2024-09-15T23:23:59.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.791+0000 7f971def1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9718072240 con 0x7f971806c320 2024-09-15T23:23:59.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.791+0000 7f9717fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f971813eb20 0x7f971815b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:59.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.791+0000 7f9717fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f971813eb20 0x7f971815b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32838/0 (socket says 172.21.15.123:32838) 2024-09-15T23:23:59.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.791+0000 7f9717fff640 1 -- 172.21.15.123:0/1630877107 learned_addr learned my addr 172.21.15.123:0/1630877107 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:23:59.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.791+0000 7f9716ffd640 1 --2- 172.21.15.123:0/1630877107 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f97180b2d40 0x7f97180b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:59.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.791+0000 7f97177fe640 1 --2- 172.21.15.123:0/1630877107 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f971806c320 0x7f97181541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:59.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.792+0000 7f9717fff640 1 -- 172.21.15.123:0/1630877107 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f971806c320 msgr2=0x7f97181541f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:59.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.792+0000 7f9717fff640 1 --2- 172.21.15.123:0/1630877107 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f971806c320 0x7f97181541f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:59.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.792+0000 7f9717fff640 1 -- 172.21.15.123:0/1630877107 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f97180b2d40 msgr2=0x7f97180b3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:59.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.792+0000 7f9717fff640 1 --2- 172.21.15.123:0/1630877107 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f97180b2d40 0x7f97180b3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:59.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.792+0000 7f9717fff640 1 -- 172.21.15.123:0/1630877107 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f971813ccd0 con 0x7f971813eb20 2024-09-15T23:23:59.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.792+0000 7f9716ffd640 1 --2- 172.21.15.123:0/1630877107 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f97180b2d40 0x7f97180b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:23:59.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.792+0000 7f9717fff640 1 --2- 172.21.15.123:0/1630877107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f971813eb20 0x7f971815b5a0 secure :-1 s=READY pgs=2345 cs=0 l=1 rev1=1 crypto rx=0x7f9710007df0 tx=0x7f971000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:59.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.792+0000 7f96fffff640 1 -- 172.21.15.123:0/1630877107 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971001a070 con 0x7f971813eb20 2024-09-15T23:23:59.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.792+0000 7f96fffff640 1 -- 172.21.15.123:0/1630877107 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9710003990 con 0x7f971813eb20 2024-09-15T23:23:59.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.792+0000 7f971def1640 1 -- 172.21.15.123:0/1630877107 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f971813cfb0 con 0x7f971813eb20 2024-09-15T23:23:59.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.792+0000 7f96fffff640 1 -- 172.21.15.123:0/1630877107 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9710003d80 con 0x7f971813eb20 2024-09-15T23:23:59.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.792+0000 7f971def1640 1 -- 172.21.15.123:0/1630877107 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f971813da90 con 0x7f971813eb20 2024-09-15T23:23:59.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.793+0000 7f971def1640 1 -- 172.21.15.123:0/1630877107 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f971806bc10 con 0x7f971813eb20 2024-09-15T23:23:59.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.793+0000 7f96fffff640 1 -- 172.21.15.123:0/1630877107 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f971001d070 con 0x7f971813eb20 2024-09-15T23:23:59.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.794+0000 7f96fffff640 1 --2- 172.21.15.123:0/1630877107 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f970406c2b0 0x7f970406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:59.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.794+0000 7f96fffff640 1 -- 172.21.15.123:0/1630877107 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(197..197 src has 1..197) ==== 4943+0+0 (secure 0 0 0) 0x7f971008b320 con 0x7f971813eb20 2024-09-15T23:23:59.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.794+0000 7f97177fe640 1 --2- 172.21.15.123:0/1630877107 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f970406c2b0 0x7f970406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:59.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.794+0000 7f97177fe640 1 --2- 172.21.15.123:0/1630877107 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f970406c2b0 0x7f970406e770 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f971813df10 tx=0x7f9708009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:59.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.798+0000 7f96fffff640 1 -- 172.21.15.123:0/1630877107 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9710010070 con 0x7f971813eb20 2024-09-15T23:23:59.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.996+0000 7f971def1640 1 -- 172.21.15.123:0/1630877107 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f971806c9c0 con 0x7f971813eb20 2024-09-15T23:23:59.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.997+0000 7f96fffff640 1 -- 172.21.15.123:0/1630877107 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 122 v122) ==== 95+0+3927 (secure 0 0 0) 0x7f9710059e20 con 0x7f971813eb20 2024-09-15T23:23:59.998 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:23:59.998 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":122,"btime":"2024-09-15T23:23:55:162646+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8785,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/2171656296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":2171656296},{"type":"v1","addr":"172.21.15.188:6836","nonce":2171656296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":8788,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/136119431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":136119431},{"type":"v1","addr":"172.21.15.188:6837","nonce":136119431}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":10473,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6833/2374047694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":2374047694},{"type":"v1","addr":"172.21.15.123:6833","nonce":2374047694}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":116},{"gid":10821,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/2915409682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":2915409682},{"type":"v1","addr":"172.21.15.123:6835","nonce":2915409682}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":122}],"filesystems":[]} 2024-09-15T23:23:59.998 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 122 2024-09-15T23:24:00.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.999+0000 7f971def1640 1 -- 172.21.15.123:0/1630877107 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f970406c2b0 msgr2=0x7f970406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:00.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.999+0000 7f971def1640 1 --2- 172.21.15.123:0/1630877107 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f970406c2b0 0x7f970406e770 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f971813df10 tx=0x7f9708009040 comp rx=0 tx=0).stop 2024-09-15T23:24:00.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.999+0000 7f971def1640 1 -- 172.21.15.123:0/1630877107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f971813eb20 msgr2=0x7f971815b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:00.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.999+0000 7f971def1640 1 --2- 172.21.15.123:0/1630877107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f971813eb20 0x7f971815b5a0 secure :-1 s=READY pgs=2345 cs=0 l=1 rev1=1 crypto rx=0x7f9710007df0 tx=0x7f971000d4a0 comp rx=0 tx=0).stop 2024-09-15T23:24:00.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.999+0000 7f971def1640 1 -- 172.21.15.123:0/1630877107 shutdown_connections 2024-09-15T23:24:00.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.999+0000 7f971def1640 1 --2- 172.21.15.123:0/1630877107 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f970406c2b0 0x7f970406e770 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:00.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.999+0000 7f971def1640 1 --2- 172.21.15.123:0/1630877107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f971813eb20 0x7f971815b5a0 unknown :-1 s=CLOSED pgs=2345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:00.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.999+0000 7f971def1640 1 --2- 172.21.15.123:0/1630877107 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f97180b2d40 0x7f97180b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:00.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.999+0000 7f971def1640 1 --2- 172.21.15.123:0/1630877107 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f971806c320 0x7f97181541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:00.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.999+0000 7f971def1640 1 -- 172.21.15.123:0/1630877107 >> 172.21.15.123:0/1630877107 conn(0x7f97180ccec0 msgr2=0x7f971815f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:00.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.999+0000 7f971def1640 1 -- 172.21.15.123:0/1630877107 shutdown_connections 2024-09-15T23:24:00.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:23:59.999+0000 7f971def1640 1 -- 172.21.15.123:0/1630877107 wait complete. 2024-09-15T23:24:00.012 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T23:24:00.012 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T23:24:00.012 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T23:24:00.013 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:24:00.013 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T23:24:00.013 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T23:24:00.013 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T23:24:00.013 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:24:00.013 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T23:24:00.013 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T23:24:00.014 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T23:24:00.014 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:24:00.014 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T23:24:00.014 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T23:24:00.014 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T23:24:00.014 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:24:00.022 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T23:24:00.022 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T23:24:00.023 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T23:24:00.023 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T23:24:00.025 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T23:24:00.025 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T23:24:00.026 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T23:24:00.026 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T23:24:00.064 INFO:tasks.ceph.mds.a:Started 2024-09-15T23:24:00.065 DEBUG:teuthology.parallel:result is None 2024-09-15T23:24:00.065 INFO:tasks.ceph.mds.c:Started 2024-09-15T23:24:00.065 DEBUG:teuthology.parallel:result is None 2024-09-15T23:24:00.068 INFO:tasks.ceph.mds.b:Started 2024-09-15T23:24:00.068 DEBUG:teuthology.parallel:result is None 2024-09-15T23:24:00.069 INFO:tasks.ceph.mds.d:Started 2024-09-15T23:24:00.069 DEBUG:teuthology.parallel:result is None 2024-09-15T23:24:00.069 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T23:24:00.139 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-15T23:24:00.139 INFO:tasks.ceph.mds.a.smithi123.stdout:starting mds.a at 2024-09-15T23:24:00.149 INFO:tasks.ceph.mds.b.smithi188.stdout:starting mds.b at 2024-09-15T23:24:00.149 INFO:tasks.ceph.mds.d.smithi188.stdout:starting mds.d at 2024-09-15T23:24:00.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.173+0000 7f2300627640 1 Processor -- start 2024-09-15T23:24:00.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.173+0000 7f2300627640 1 -- start start 2024-09-15T23:24:00.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.174+0000 7f2300627640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f22f80b6970 0x7f22f80b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:00.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.174+0000 7f2300627640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22f80d0e70 con 0x7f22f80d23b0 2024-09-15T23:24:00.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.174+0000 7f2300627640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22f80d41c0 con 0x7f22f815ed20 2024-09-15T23:24:00.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.174+0000 7f2300627640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f22f80d35b0 con 0x7f22f80b6970 2024-09-15T23:24:00.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.174+0000 7f22febc4640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f22f80d23b0 0x7f22f80b8610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:57400/0 (socket says 172.21.15.123:57400) 2024-09-15T23:24:00.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.174+0000 7f22febc4640 1 -- 172.21.15.123:0/851776615 learned_addr learned my addr 172.21.15.123:0/851776615 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:00.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.174+0000 7f22fdbc2640 1 --2- 172.21.15.123:0/851776615 >> v2:172.21.15.188:3300/0 conn(0x7f22f80b6970 0x7f22f80b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:00.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.174+0000 7f22fd3c1640 1 -- 172.21.15.123:0/851776615 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3405001202 0 0) 0x7f22f0001490 con 0x7f22f80d23b0 2024-09-15T23:24:00.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.174+0000 7f22fd3c1640 1 -- 172.21.15.123:0/851776615 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22e4003520 con 0x7f22f80d23b0 2024-09-15T23:24:00.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.174+0000 7f22fd3c1640 1 -- 172.21.15.123:0/851776615 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 898465146 0 0) 0x7f22e4003520 con 0x7f22f80d23b0 2024-09-15T23:24:00.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.174+0000 7f22fd3c1640 1 -- 172.21.15.123:0/851776615 >> v2:172.21.15.188:3300/0 conn(0x7f22f80b6970 msgr2=0x7f22f80b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:00.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.174+0000 7f22fd3c1640 1 --2- 172.21.15.123:0/851776615 >> v2:172.21.15.188:3300/0 conn(0x7f22f80b6970 0x7f22f80b80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:00.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.174+0000 7f22fd3c1640 1 -- 172.21.15.123:0/851776615 >> v1:172.21.15.188:6789/0 conn(0x7f22f815ed20 legacy=0x7f22f80b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:00.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.174+0000 7f22fd3c1640 1 -- 172.21.15.123:0/851776615 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f80d3890 con 0x7f22f80d23b0 2024-09-15T23:24:00.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.174+0000 7f22fd3c1640 1 -- 172.21.15.123:0/851776615 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f22f0001bc0 con 0x7f22f80d23b0 2024-09-15T23:24:00.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.174+0000 7f22fd3c1640 1 -- 172.21.15.123:0/851776615 >> v1:172.21.15.123:6789/0 conn(0x7f22f80d23b0 legacy=0x7f22f80b8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:00.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.174+0000 7f22fd3c1640 1 --2- 172.21.15.123:0/851776615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22e40039b0 0x7f22e4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:00.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.174+0000 7f22fd3c1640 1 --2- 172.21.15.123:0/851776615 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22e4004800 0x7f22e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:00.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.174+0000 7f22fd3c1640 1 --2- 172.21.15.123:0/851776615 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f22e40051c0 0x7f22e400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:00.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.174+0000 7f22fd3c1640 1 -- 172.21.15.123:0/851776615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f22f80d35b0 con 0x7f22e40039b0 2024-09-15T23:24:00.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.174+0000 7f22fd3c1640 1 -- 172.21.15.123:0/851776615 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f22e400c160 con 0x7f22e4004800 2024-09-15T23:24:00.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.174+0000 7f22fd3c1640 1 -- 172.21.15.123:0/851776615 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f22e400c360 con 0x7f22e40051c0 2024-09-15T23:24:00.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.174+0000 7f22fe3c3640 1 --2- 172.21.15.123:0/851776615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22e40039b0 0x7f22e4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:00.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.175+0000 7f22fdbc2640 1 --2- 172.21.15.123:0/851776615 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22e4004800 0x7f22e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:00.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.175+0000 7f22febc4640 1 --2- 172.21.15.123:0/851776615 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f22e40051c0 0x7f22e400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:00.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.175+0000 7f22fe3c3640 1 -- 172.21.15.123:0/851776615 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f22e40051c0 msgr2=0x7f22e400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:00.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.175+0000 7f22fe3c3640 1 --2- 172.21.15.123:0/851776615 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f22e40051c0 0x7f22e400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:00.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.175+0000 7f22fe3c3640 1 -- 172.21.15.123:0/851776615 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22e4004800 msgr2=0x7f22e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:00.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.175+0000 7f22fe3c3640 1 --2- 172.21.15.123:0/851776615 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22e4004800 0x7f22e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:00.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.175+0000 7f22fe3c3640 1 -- 172.21.15.123:0/851776615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22e4003520 con 0x7f22e40039b0 2024-09-15T23:24:00.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.175+0000 7f22febc4640 1 --2- 172.21.15.123:0/851776615 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f22e40051c0 0x7f22e400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:24:00.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.175+0000 7f22febc4640 1 -- 172.21.15.123:0/851776615 reap_dead start 2024-09-15T23:24:00.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.175+0000 7f22fe3c3640 1 --2- 172.21.15.123:0/851776615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22e40039b0 0x7f22e4003dd0 secure :-1 s=READY pgs=2352 cs=0 l=1 rev1=1 crypto rx=0x7f22f4001750 tx=0x7f22e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c504fd7284e693 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:00.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.176+0000 7f22fd3c1640 1 -- 172.21.15.123:0/851776615 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f4001370 con 0x7f22e40039b0 2024-09-15T23:24:00.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.176+0000 7f22fd3c1640 1 -- 172.21.15.123:0/851776615 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22f40052d0 con 0x7f22e40039b0 2024-09-15T23:24:00.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.176+0000 7f22fd3c1640 1 -- 172.21.15.123:0/851776615 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f402abc0 con 0x7f22e40039b0 2024-09-15T23:24:00.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.176+0000 7f2300627640 1 -- 172.21.15.123:0/851776615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22e40039b0 msgr2=0x7f22e4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:00.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.176+0000 7f2300627640 1 --2- 172.21.15.123:0/851776615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22e40039b0 0x7f22e4003dd0 secure :-1 s=READY pgs=2352 cs=0 l=1 rev1=1 crypto rx=0x7f22f4001750 tx=0x7f22e4005830 comp rx=0 tx=0).stop 2024-09-15T23:24:00.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.176+0000 7f2300627640 1 -- 172.21.15.123:0/851776615 shutdown_connections 2024-09-15T23:24:00.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.176+0000 7f2300627640 1 --2- 172.21.15.123:0/851776615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22e40039b0 0x7f22e4003dd0 unknown :-1 s=CLOSED pgs=2352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:00.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.176+0000 7f2300627640 1 -- 172.21.15.123:0/851776615 >> 172.21.15.123:0/851776615 conn(0x7f22f80d1260 msgr2=0x7f22f80d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:00.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.176+0000 7f2300627640 1 -- 172.21.15.123:0/851776615 shutdown_connections 2024-09-15T23:24:00.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.176+0000 7f2300627640 1 -- 172.21.15.123:0/851776615 wait complete. 2024-09-15T23:24:00.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.177+0000 7f2300627640 1 Processor -- start 2024-09-15T23:24:00.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.177+0000 7f2300627640 1 -- start start 2024-09-15T23:24:00.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.178+0000 7f2300627640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22e40039b0 0x7f22f80b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:00.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.178+0000 7f2300627640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f22f80ca480 0x7f22f80ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:00.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.178+0000 7f2300627640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22f80cae40 0x7f22f81f5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:00.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.178+0000 7f2300627640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f22f80d32a0 con 0x7f22f80cae40 2024-09-15T23:24:00.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.178+0000 7f2300627640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f22f80d3e50 con 0x7f22e40039b0 2024-09-15T23:24:00.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.178+0000 7f2300627640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f22f815f100 con 0x7f22f80ca480 2024-09-15T23:24:00.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.178+0000 7f22febc4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22f80cae40 0x7f22f81f5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:00.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.178+0000 7f22febc4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22f80cae40 0x7f22f81f5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32888/0 (socket says 172.21.15.123:32888) 2024-09-15T23:24:00.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.178+0000 7f22febc4640 1 -- 172.21.15.123:0/2799483809 learned_addr learned my addr 172.21.15.123:0/2799483809 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:00.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.178+0000 7f22fdbc2640 1 --2- 172.21.15.123:0/2799483809 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f22f80ca480 0x7f22f80ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:00.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.178+0000 7f22fe3c3640 1 --2- 172.21.15.123:0/2799483809 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22e40039b0 0x7f22f80b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:00.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.178+0000 7f22febc4640 1 -- 172.21.15.123:0/2799483809 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f22f80ca480 msgr2=0x7f22f80ca900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:00.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.178+0000 7f22febc4640 1 --2- 172.21.15.123:0/2799483809 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f22f80ca480 0x7f22f80ca900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:00.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.178+0000 7f22febc4640 1 -- 172.21.15.123:0/2799483809 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22e40039b0 msgr2=0x7f22f80b2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:00.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.178+0000 7f22febc4640 1 --2- 172.21.15.123:0/2799483809 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22e40039b0 0x7f22f80b2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:00.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.178+0000 7f22febc4640 1 -- 172.21.15.123:0/2799483809 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f80cc630 con 0x7f22f80cae40 2024-09-15T23:24:00.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.178+0000 7f22fe3c3640 1 --2- 172.21.15.123:0/2799483809 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22e40039b0 0x7f22f80b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:24:00.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.179+0000 7f22febc4640 1 --2- 172.21.15.123:0/2799483809 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22f80cae40 0x7f22f81f5100 secure :-1 s=READY pgs=2353 cs=0 l=1 rev1=1 crypto rx=0x7f22f80cf070 tx=0x7f22f0007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:00.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.179+0000 7f22eeffd640 1 -- 172.21.15.123:0/2799483809 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f0019070 con 0x7f22f80cae40 2024-09-15T23:24:00.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.179+0000 7f22eeffd640 1 -- 172.21.15.123:0/2799483809 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22f000e960 con 0x7f22f80cae40 2024-09-15T23:24:00.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.179+0000 7f2300627640 1 -- 172.21.15.123:0/2799483809 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22f80cc910 con 0x7f22f80cae40 2024-09-15T23:24:00.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.179+0000 7f22eeffd640 1 -- 172.21.15.123:0/2799483809 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22f0001500 con 0x7f22f80cae40 2024-09-15T23:24:00.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.179+0000 7f2300627640 1 -- 172.21.15.123:0/2799483809 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22f80cced0 con 0x7f22f80cae40 2024-09-15T23:24:00.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.180+0000 7f2300627640 1 -- 172.21.15.123:0/2799483809 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22f81f4de0 con 0x7f22f80cae40 2024-09-15T23:24:00.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.180+0000 7f22eeffd640 1 -- 172.21.15.123:0/2799483809 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f22f001c070 con 0x7f22f80cae40 2024-09-15T23:24:00.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.181+0000 7f22eeffd640 1 --2- 172.21.15.123:0/2799483809 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f22dc06c2b0 0x7f22dc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:00.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.181+0000 7f22eeffd640 1 -- 172.21.15.123:0/2799483809 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(197..197 src has 1..197) ==== 4943+0+0 (secure 0 0 0) 0x7f22f008ac00 con 0x7f22f80cae40 2024-09-15T23:24:00.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.181+0000 7f22fe3c3640 1 --2- 172.21.15.123:0/2799483809 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f22dc06c2b0 0x7f22dc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:00.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.181+0000 7f22fe3c3640 1 --2- 172.21.15.123:0/2799483809 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f22dc06c2b0 0x7f22dc06e770 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f22f4032000 tx=0x7f22f402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:00.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.190+0000 7f22eeffd640 1 -- 172.21.15.123:0/2799483809 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f22f81f4de0 con 0x7f22f80cae40 2024-09-15T23:24:00.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:00.371+0000 7f2300627640 1 -- 172.21.15.123:0/2799483809 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f22f80b7010 con 0x7f22f80cae40 2024-09-15T23:24:01.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.209+0000 7f22eeffd640 1 -- 172.21.15.123:0/2799483809 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v202) ==== 97+0+0 (secure 0 0 0) 0x7f22f0091080 con 0x7f22f80cae40 2024-09-15T23:24:01.210 INFO:teuthology.orchestra.run.smithi123.stderr: removed all blocklist entries 2024-09-15T23:24:01.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.212+0000 7f2300627640 1 -- 172.21.15.123:0/2799483809 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f22dc06c2b0 msgr2=0x7f22dc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:01.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.212+0000 7f2300627640 1 --2- 172.21.15.123:0/2799483809 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f22dc06c2b0 0x7f22dc06e770 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f22f4032000 tx=0x7f22f402e000 comp rx=0 tx=0).stop 2024-09-15T23:24:01.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.212+0000 7f2300627640 1 -- 172.21.15.123:0/2799483809 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22f80cae40 msgr2=0x7f22f81f5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:01.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.212+0000 7f2300627640 1 --2- 172.21.15.123:0/2799483809 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22f80cae40 0x7f22f81f5100 secure :-1 s=READY pgs=2353 cs=0 l=1 rev1=1 crypto rx=0x7f22f80cf070 tx=0x7f22f0007b00 comp rx=0 tx=0).stop 2024-09-15T23:24:01.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.212+0000 7f2300627640 1 -- 172.21.15.123:0/2799483809 shutdown_connections 2024-09-15T23:24:01.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.212+0000 7f2300627640 1 --2- 172.21.15.123:0/2799483809 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f22dc06c2b0 0x7f22dc06e770 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:01.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.212+0000 7f2300627640 1 --2- 172.21.15.123:0/2799483809 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22f80cae40 0x7f22f81f5100 unknown :-1 s=CLOSED pgs=2353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:01.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.212+0000 7f2300627640 1 --2- 172.21.15.123:0/2799483809 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f22f80ca480 0x7f22f80ca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:01.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.212+0000 7f2300627640 1 --2- 172.21.15.123:0/2799483809 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f22e40039b0 0x7f22f80b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:01.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.212+0000 7f2300627640 1 -- 172.21.15.123:0/2799483809 >> 172.21.15.123:0/2799483809 conn(0x7f22f80d1260 msgr2=0x7f22f80b4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:01.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.212+0000 7f2300627640 1 -- 172.21.15.123:0/2799483809 shutdown_connections 2024-09-15T23:24:01.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.212+0000 7f2300627640 1 -- 172.21.15.123:0/2799483809 wait complete. 2024-09-15T23:24:01.226 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T23:24:01.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.329+0000 7f12bd8b7640 1 Processor -- start 2024-09-15T23:24:01.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.329+0000 7f12bd8b7640 1 -- start start 2024-09-15T23:24:01.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.330+0000 7f12bd8b7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f12b81624b0 0x7f12b815ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:01.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.330+0000 7f12bd8b7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12b80b66a0 0x7f12b80b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:01.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.330+0000 7f12bd8b7640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12b815f590 con 0x7f12b815eb60 2024-09-15T23:24:01.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.330+0000 7f12bd8b7640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f12b80b7070 con 0x7f12b81624b0 2024-09-15T23:24:01.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.330+0000 7f12bd8b7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f12b815f870 con 0x7f12b80b66a0 2024-09-15T23:24:01.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.330+0000 7f12b67fc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f12b81624b0 0x7f12b815ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:01.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.330+0000 7f12b67fc640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f12b81624b0 0x7f12b815ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32892/0 (socket says 172.21.15.123:32892) 2024-09-15T23:24:01.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.330+0000 7f12b67fc640 1 -- 172.21.15.123:0/2747925644 learned_addr learned my addr 172.21.15.123:0/2747925644 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:01.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.331+0000 7f12b67fc640 1 -- 172.21.15.123:0/2747925644 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12b80b66a0 msgr2=0x7f12b80b6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:01.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.331+0000 7f12b67fc640 1 --2- 172.21.15.123:0/2747925644 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12b80b66a0 0x7f12b80b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:01.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.331+0000 7f12b67fc640 1 -- 172.21.15.123:0/2747925644 >> v1:172.21.15.188:6789/0 conn(0x7f12b815eb60 legacy=0x7f12b80d2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:01.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.331+0000 7f12b67fc640 1 -- 172.21.15.123:0/2747925644 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12b815fb50 con 0x7f12b81624b0 2024-09-15T23:24:01.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.331+0000 7f12b67fc640 1 --2- 172.21.15.123:0/2747925644 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12b81624b0 0x7f12b815ef40 secure :-1 s=READY pgs=2354 cs=0 l=1 rev1=1 crypto rx=0x7f12ac009870 tx=0x7f12ac02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d69a3516f57f99 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:01.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.331+0000 7f12b5ffb640 1 -- 172.21.15.123:0/2747925644 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ac037070 con 0x7f12b81624b0 2024-09-15T23:24:01.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.331+0000 7f12b5ffb640 1 -- 172.21.15.123:0/2747925644 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12ac02ae10 con 0x7f12b81624b0 2024-09-15T23:24:01.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.331+0000 7f12b5ffb640 1 -- 172.21.15.123:0/2747925644 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ac032660 con 0x7f12b81624b0 2024-09-15T23:24:01.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.332+0000 7f12bd8b7640 1 -- 172.21.15.123:0/2747925644 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12b81624b0 msgr2=0x7f12b815ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:01.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.332+0000 7f12bd8b7640 1 --2- 172.21.15.123:0/2747925644 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12b81624b0 0x7f12b815ef40 secure :-1 s=READY pgs=2354 cs=0 l=1 rev1=1 crypto rx=0x7f12ac009870 tx=0x7f12ac02a100 comp rx=0 tx=0).stop 2024-09-15T23:24:01.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.332+0000 7f12bd8b7640 1 -- 172.21.15.123:0/2747925644 shutdown_connections 2024-09-15T23:24:01.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.332+0000 7f12bd8b7640 1 --2- 172.21.15.123:0/2747925644 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12b81624b0 0x7f12b815ef40 unknown :-1 s=CLOSED pgs=2354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:01.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.332+0000 7f12bd8b7640 1 --2- 172.21.15.123:0/2747925644 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12b80b66a0 0x7f12b80b6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:01.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.332+0000 7f12bd8b7640 1 -- 172.21.15.123:0/2747925644 >> 172.21.15.123:0/2747925644 conn(0x7f12b80d16f0 msgr2=0x7f12b80d1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:01.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.332+0000 7f12bd8b7640 1 -- 172.21.15.123:0/2747925644 shutdown_connections 2024-09-15T23:24:01.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.332+0000 7f12bd8b7640 1 -- 172.21.15.123:0/2747925644 wait complete. 2024-09-15T23:24:01.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.333+0000 7f12bd8b7640 1 Processor -- start 2024-09-15T23:24:01.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.333+0000 7f12bd8b7640 1 -- start start 2024-09-15T23:24:01.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.334+0000 7f12bd8b7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12b80b66a0 0x7f12b814f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:01.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.334+0000 7f12bd8b7640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12b815eb60 0x7f12b815d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:01.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.334+0000 7f12bd8b7640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12b81624b0 0x7f12b815d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:01.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.334+0000 7f12bd8b7640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f12b80d4480 con 0x7f12b80b66a0 2024-09-15T23:24:01.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.334+0000 7f12bd8b7640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f12b80cef40 con 0x7f12b815eb60 2024-09-15T23:24:01.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.334+0000 7f12bd8b7640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f12b80d4600 con 0x7f12b81624b0 2024-09-15T23:24:01.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.334+0000 7f12b6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12b80b66a0 0x7f12b814f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:01.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.334+0000 7f12b6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12b80b66a0 0x7f12b814f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32902/0 (socket says 172.21.15.123:32902) 2024-09-15T23:24:01.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.334+0000 7f12b6ffd640 1 -- 172.21.15.123:0/512315170 learned_addr learned my addr 172.21.15.123:0/512315170 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:01.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.334+0000 7f12b67fc640 1 --2- 172.21.15.123:0/512315170 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12b815eb60 0x7f12b815d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:01.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.334+0000 7f12b77fe640 1 --2- 172.21.15.123:0/512315170 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12b81624b0 0x7f12b815d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:01.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.334+0000 7f12b6ffd640 1 -- 172.21.15.123:0/512315170 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12b81624b0 msgr2=0x7f12b815d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:01.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.334+0000 7f12b6ffd640 1 --2- 172.21.15.123:0/512315170 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12b81624b0 0x7f12b815d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:01.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.334+0000 7f12b6ffd640 1 -- 172.21.15.123:0/512315170 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12b815eb60 msgr2=0x7f12b815d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:01.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.334+0000 7f12b6ffd640 1 --2- 172.21.15.123:0/512315170 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12b815eb60 0x7f12b815d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:01.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.334+0000 7f12b6ffd640 1 -- 172.21.15.123:0/512315170 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12b814fb60 con 0x7f12b80b66a0 2024-09-15T23:24:01.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.334+0000 7f12b77fe640 1 --2- 172.21.15.123:0/512315170 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12b81624b0 0x7f12b815d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:24:01.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.334+0000 7f12b67fc640 1 --2- 172.21.15.123:0/512315170 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12b815eb60 0x7f12b815d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:24:01.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.335+0000 7f12b6ffd640 1 --2- 172.21.15.123:0/512315170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12b80b66a0 0x7f12b814f620 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 crypto rx=0x7f12a800b410 tx=0x7f12a800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:01.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.335+0000 7f129ffff640 1 -- 172.21.15.123:0/512315170 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a8015020 con 0x7f12b80b66a0 2024-09-15T23:24:01.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.335+0000 7f129ffff640 1 -- 172.21.15.123:0/512315170 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12a8011830 con 0x7f12b80b66a0 2024-09-15T23:24:01.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.335+0000 7f12bd8b7640 1 -- 172.21.15.123:0/512315170 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12b80cc5c0 con 0x7f12b80b66a0 2024-09-15T23:24:01.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.335+0000 7f129ffff640 1 -- 172.21.15.123:0/512315170 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a8011c20 con 0x7f12b80b66a0 2024-09-15T23:24:01.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.335+0000 7f12bd8b7640 1 -- 172.21.15.123:0/512315170 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12b80ccb80 con 0x7f12b80b66a0 2024-09-15T23:24:01.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.336+0000 7f12bd8b7640 1 -- 172.21.15.123:0/512315170 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12b80b6b30 con 0x7f12b80b66a0 2024-09-15T23:24:01.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.336+0000 7f129ffff640 1 -- 172.21.15.123:0/512315170 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f12a8018020 con 0x7f12b80b66a0 2024-09-15T23:24:01.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.337+0000 7f129ffff640 1 --2- 172.21.15.123:0/512315170 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f12a406c2b0 0x7f12a406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:01.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.337+0000 7f129ffff640 1 -- 172.21.15.123:0/512315170 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 4857+0+0 (secure 0 0 0) 0x7f12a808b030 con 0x7f12b80b66a0 2024-09-15T23:24:01.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.337+0000 7f12b67fc640 1 --2- 172.21.15.123:0/512315170 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f12a406c2b0 0x7f12a406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:01.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.337+0000 7f12b67fc640 1 --2- 172.21.15.123:0/512315170 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f12a406c2b0 0x7f12a406e770 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f12ac034000 tx=0x7f12ac02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:01.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.341+0000 7f129ffff640 1 -- 172.21.15.123:0/512315170 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f12a801f020 con 0x7f12b80b66a0 2024-09-15T23:24:01.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.566+0000 7f12bd8b7640 1 -- 172.21.15.123:0/512315170 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f12b80d2520 con 0x7f12b80b66a0 2024-09-15T23:24:01.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.566+0000 7f129ffff640 1 -- 172.21.15.123:0/512315170 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v24) ==== 80+0+5304 (secure 0 0 0) 0x7f12a80172c0 con 0x7f12b80b66a0 2024-09-15T23:24:01.568 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:01.568 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:24:01.568 INFO:teuthology.orchestra.run.smithi123.stdout: "auth_dump": [ 2024-09-15T23:24:01.568 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:24:01.568 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.a", 2024-09-15T23:24:01.568 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm9ATVDhAAnukyZogTuG4YCbzRXSCkiQ==", 2024-09-15T23:24:01.568 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:24:01.568 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:24:01.569 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:24:01.569 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:24:01.569 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:24:01.569 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:24:01.569 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:24:01.569 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:24:01.569 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.b", 2024-09-15T23:24:01.569 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm4KmaGhAAbf6vcffqiJTOYXK5DCXcZA==", 2024-09-15T23:24:01.569 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:24:01.569 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:24:01.569 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:24:01.569 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:24:01.569 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:24:01.570 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:24:01.570 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:24:01.570 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:24:01.570 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.c", 2024-09-15T23:24:01.570 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmua/VFRAAwbPm2TslrfQkrvHiO8oeLg==", 2024-09-15T23:24:01.570 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:24:01.570 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:24:01.570 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:24:01.570 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:24:01.570 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:24:01.570 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:24:01.570 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:24:01.570 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:24:01.571 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.d", 2024-09-15T23:24:01.571 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmzw3eIRAAaE+5y9USwp+xM3MTAndn7Q==", 2024-09-15T23:24:01.571 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:24:01.571 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:24:01.571 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:24:01.571 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:24:01.571 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:24:01.571 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:24:01.571 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:24:01.571 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:24:01.571 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.0", 2024-09-15T23:24:01.571 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCRaedmFrHGAxAAy/jTkothESNn2DC9xcHDAQ==", 2024-09-15T23:24:01.571 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:24:01.572 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:24:01.572 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:24:01.572 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:24:01.572 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:24:01.572 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:24:01.572 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:24:01.572 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.1", 2024-09-15T23:24:01.572 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCUaedm6vZlIxAAdsnLqFSng6SRpCT6UZKGsw==", 2024-09-15T23:24:01.572 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:24:01.572 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:24:01.572 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:24:01.572 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:24:01.572 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:24:01.572 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:24:01.573 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:24:01.573 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.2", 2024-09-15T23:24:01.573 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCYaedmXgVwFRAA1mOzzRafhKMsU7kTAT6TqA==", 2024-09-15T23:24:01.573 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:24:01.573 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:24:01.573 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:24:01.573 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:24:01.573 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:24:01.573 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:24:01.573 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:24:01.573 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.3", 2024-09-15T23:24:01.573 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCcaedm+APAFhAAb8blNFzswwHriSmCrMuA0A==", 2024-09-15T23:24:01.574 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:24:01.574 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:24:01.574 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:24:01.574 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:24:01.574 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:24:01.574 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:24:01.574 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:24:01.574 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.4", 2024-09-15T23:24:01.574 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCjaedmReUmABAAXpxsK7osxn/ZelVXKiCLOw==", 2024-09-15T23:24:01.574 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:24:01.574 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:24:01.574 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:24:01.574 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:24:01.574 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:24:01.575 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:24:01.575 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:24:01.575 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.5", 2024-09-15T23:24:01.575 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCnaedmtbdmARAAdxguBdtwBmtiaIx/y992GA==", 2024-09-15T23:24:01.575 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:24:01.575 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:24:01.575 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:24:01.575 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:24:01.575 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:24:01.575 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:24:01.575 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:24:01.575 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.6", 2024-09-15T23:24:01.575 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCraedmkR+NAxAAd2GAAH0BgOMonU8iTSn+Fw==", 2024-09-15T23:24:01.575 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:24:01.576 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:24:01.576 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:24:01.576 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:24:01.576 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:24:01.576 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:24:01.576 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:24:01.576 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.7", 2024-09-15T23:24:01.576 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCvaedmAaCwBBAAdpDtCbXchArmy019wiOdSQ==", 2024-09-15T23:24:01.576 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:24:01.576 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-09-15T23:24:01.576 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-09-15T23:24:01.576 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:24:01.576 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:24:01.576 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:24:01.577 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:24:01.577 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.0", 2024-09-15T23:24:01.577 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmzQPqJRAAhUf1dnVYohN4obCfeu8+7g==", 2024-09-15T23:24:01.577 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:24:01.577 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:24:01.577 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow r", 2024-09-15T23:24:01.577 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-15T23:24:01.577 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:24:01.577 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:24:01.577 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:24:01.577 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.1", 2024-09-15T23:24:01.577 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmdKK0LhAAXXmUkxVwMEjRTRXUh9CL/g==", 2024-09-15T23:24:01.577 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:24:01.578 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:24:01.578 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:24:01.578 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:24:01.578 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:24:01.578 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:24:01.578 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:24:01.578 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:24:01.578 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.2", 2024-09-15T23:24:01.578 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmRz55KxAARi7B4WYOY1QqH1CK81z9pA==", 2024-09-15T23:24:01.578 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:24:01.578 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:24:01.578 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:24:01.578 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:24:01.579 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:24:01.579 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:24:01.579 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:24:01.579 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:24:01.579 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.3", 2024-09-15T23:24:01.579 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmbWo8NBAAR1qGX1bs35ojx6lMxftcfg==", 2024-09-15T23:24:01.579 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:24:01.579 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-09-15T23:24:01.579 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-09-15T23:24:01.579 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-09-15T23:24:01.579 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-09-15T23:24:01.579 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:24:01.579 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:24:01.579 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:24:01.580 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.admin", 2024-09-15T23:24:01.580 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCMaedmVUW0LhAAqgPFk1HtxsZXcIStNN43pA==", 2024-09-15T23:24:01.580 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:24:01.580 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:24:01.580 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-09-15T23:24:01.580 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-09-15T23:24:01.580 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:24:01.580 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:24:01.580 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:24:01.580 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:24:01.580 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.x", 2024-09-15T23:24:01.580 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedmGPSBCxAAHAhXQERogdAOm0ZPNtlxpw==", 2024-09-15T23:24:01.580 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:24:01.581 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:24:01.581 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-15T23:24:01.581 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:24:01.581 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:24:01.581 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-09-15T23:24:01.581 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:24:01.581 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.y", 2024-09-15T23:24:01.581 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCNaedm5Om4BxAA/7ZtMMlbUA3bvMCfaNMQyg==", 2024-09-15T23:24:01.581 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-09-15T23:24:01.581 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-09-15T23:24:01.581 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-09-15T23:24:01.581 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-09-15T23:24:01.581 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:24:01.581 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:24:01.582 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-09-15T23:24:01.582 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:24:01.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.568+0000 7f12bd8b7640 1 -- 172.21.15.123:0/512315170 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f12a406c2b0 msgr2=0x7f12a406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:01.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.568+0000 7f12bd8b7640 1 --2- 172.21.15.123:0/512315170 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f12a406c2b0 0x7f12a406e770 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f12ac034000 tx=0x7f12ac02e000 comp rx=0 tx=0).stop 2024-09-15T23:24:01.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.568+0000 7f12bd8b7640 1 -- 172.21.15.123:0/512315170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12b80b66a0 msgr2=0x7f12b814f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:01.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.568+0000 7f12bd8b7640 1 --2- 172.21.15.123:0/512315170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12b80b66a0 0x7f12b814f620 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 crypto rx=0x7f12a800b410 tx=0x7f12a800b8d0 comp rx=0 tx=0).stop 2024-09-15T23:24:01.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.568+0000 7f12bd8b7640 1 -- 172.21.15.123:0/512315170 shutdown_connections 2024-09-15T23:24:01.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.568+0000 7f12bd8b7640 1 --2- 172.21.15.123:0/512315170 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12b81624b0 0x7f12b815d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:01.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.568+0000 7f12bd8b7640 1 --2- 172.21.15.123:0/512315170 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12b815eb60 0x7f12b815d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:01.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.568+0000 7f12bd8b7640 1 --2- 172.21.15.123:0/512315170 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f12a406c2b0 0x7f12a406e770 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:01.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.568+0000 7f12bd8b7640 1 --2- 172.21.15.123:0/512315170 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12b80b66a0 0x7f12b814f620 unknown :-1 s=CLOSED pgs=2355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:01.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.568+0000 7f12bd8b7640 1 -- 172.21.15.123:0/512315170 >> 172.21.15.123:0/512315170 conn(0x7f12b80d16f0 msgr2=0x7f12b806e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:01.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.569+0000 7f12bd8b7640 1 -- 172.21.15.123:0/512315170 shutdown_connections 2024-09-15T23:24:01.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.569+0000 7f12bd8b7640 1 -- 172.21.15.123:0/512315170 wait complete. 2024-09-15T23:24:01.585 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T23:24:01.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.682+0000 7f3af036d640 1 Processor -- start 2024-09-15T23:24:01.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.682+0000 7f3af036d640 1 -- start start 2024-09-15T23:24:01.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.683+0000 7f3af036d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3ae806bc10 0x7f3ae806bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:01.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.683+0000 7f3af036d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3ae80cef60 0x7f3ae815eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:01.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.683+0000 7f3af036d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ae806c530 con 0x7f3ae80b3790 2024-09-15T23:24:01.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.683+0000 7f3af036d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f3ae80cd690 con 0x7f3ae80cef60 2024-09-15T23:24:01.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.683+0000 7f3af036d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f3ae80d06f0 con 0x7f3ae806bc10 2024-09-15T23:24:01.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.683+0000 7f3aed908640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3ae80cef60 0x7f3ae815eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:01.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.683+0000 7f3aee90a640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f3ae80b3790 0x7f3ae80b67a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:57412/0 (socket says 172.21.15.123:57412) 2024-09-15T23:24:01.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.683+0000 7f3aee90a640 1 -- 172.21.15.123:0/3784871689 learned_addr learned my addr 172.21.15.123:0/3784871689 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:01.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.683+0000 7f3aee109640 1 --2- 172.21.15.123:0/3784871689 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3ae806bc10 0x7f3ae806bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:01.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.683+0000 7f3aed908640 1 -- 172.21.15.123:0/3784871689 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3ae806bc10 msgr2=0x7f3ae806bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:01.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.683+0000 7f3aed908640 1 --2- 172.21.15.123:0/3784871689 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3ae806bc10 0x7f3ae806bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:01.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.683+0000 7f3aed908640 1 -- 172.21.15.123:0/3784871689 >> v1:172.21.15.123:6789/0 conn(0x7f3ae80b3790 legacy=0x7f3ae80b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:01.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.683+0000 7f3aed908640 1 -- 172.21.15.123:0/3784871689 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae815f060 con 0x7f3ae80cef60 2024-09-15T23:24:01.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.683+0000 7f3aed107640 1 -- 172.21.15.123:0/3784871689 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1439639980 0 0) 0x7f3ae806c530 con 0x7f3ae80b3790 2024-09-15T23:24:01.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.684+0000 7f3aed908640 1 --2- 172.21.15.123:0/3784871689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ae80cef60 0x7f3ae815eb20 secure :-1 s=READY pgs=2357 cs=0 l=1 rev1=1 crypto rx=0x7f3ad80097d0 tx=0x7f3ad802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=768e7c76aee2a141 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:01.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.684+0000 7f3aed107640 1 -- 172.21.15.123:0/3784871689 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8037070 con 0x7f3ae80cef60 2024-09-15T23:24:01.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.684+0000 7f3aed107640 1 -- 172.21.15.123:0/3784871689 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ad802ae40 con 0x7f3ae80cef60 2024-09-15T23:24:01.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.684+0000 7f3aed107640 1 -- 172.21.15.123:0/3784871689 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8032660 con 0x7f3ae80cef60 2024-09-15T23:24:01.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.685+0000 7f3af036d640 1 -- 172.21.15.123:0/3784871689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ae80cef60 msgr2=0x7f3ae815eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:01.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.685+0000 7f3af036d640 1 --2- 172.21.15.123:0/3784871689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ae80cef60 0x7f3ae815eb20 secure :-1 s=READY pgs=2357 cs=0 l=1 rev1=1 crypto rx=0x7f3ad80097d0 tx=0x7f3ad802a130 comp rx=0 tx=0).stop 2024-09-15T23:24:01.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.685+0000 7f3af036d640 1 -- 172.21.15.123:0/3784871689 shutdown_connections 2024-09-15T23:24:01.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.685+0000 7f3af036d640 1 --2- 172.21.15.123:0/3784871689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ae80cef60 0x7f3ae815eb20 unknown :-1 s=CLOSED pgs=2357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:01.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.685+0000 7f3af036d640 1 --2- 172.21.15.123:0/3784871689 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3ae806bc10 0x7f3ae806bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:01.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.685+0000 7f3af036d640 1 -- 172.21.15.123:0/3784871689 >> 172.21.15.123:0/3784871689 conn(0x7f3ae806cd20 msgr2=0x7f3ae806d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:01.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.685+0000 7f3af036d640 1 -- 172.21.15.123:0/3784871689 shutdown_connections 2024-09-15T23:24:01.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.685+0000 7f3af036d640 1 -- 172.21.15.123:0/3784871689 wait complete. 2024-09-15T23:24:01.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.686+0000 7f3af036d640 1 Processor -- start 2024-09-15T23:24:01.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.686+0000 7f3af036d640 1 -- start start 2024-09-15T23:24:01.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.687+0000 7f3af036d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3ae806bc10 0x7f3ae80b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:01.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.687+0000 7f3af036d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3ae80b3790 0x7f3ae80cb280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:01.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.687+0000 7f3af036d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ae80cef60 0x7f3ae80cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:01.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.687+0000 7f3af036d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae80d0c30 con 0x7f3ae80cef60 2024-09-15T23:24:01.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.687+0000 7f3af036d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae80d0950 con 0x7f3ae80b3790 2024-09-15T23:24:01.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.687+0000 7f3af036d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f3ae80d0f10 con 0x7f3ae806bc10 2024-09-15T23:24:01.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.687+0000 7f3aee90a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ae80cef60 0x7f3ae80cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:01.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.687+0000 7f3aee90a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ae80cef60 0x7f3ae80cb7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32918/0 (socket says 172.21.15.123:32918) 2024-09-15T23:24:01.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.687+0000 7f3aee90a640 1 -- 172.21.15.123:0/4174749966 learned_addr learned my addr 172.21.15.123:0/4174749966 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:01.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.687+0000 7f3aee109640 1 --2- 172.21.15.123:0/4174749966 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3ae806bc10 0x7f3ae80b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:01.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.687+0000 7f3aed908640 1 --2- 172.21.15.123:0/4174749966 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3ae80b3790 0x7f3ae80cb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:01.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.687+0000 7f3aee90a640 1 -- 172.21.15.123:0/4174749966 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3ae806bc10 msgr2=0x7f3ae80b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:01.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.687+0000 7f3aee90a640 1 --2- 172.21.15.123:0/4174749966 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3ae806bc10 0x7f3ae80b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:01.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.687+0000 7f3aee90a640 1 -- 172.21.15.123:0/4174749966 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3ae80b3790 msgr2=0x7f3ae80cb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:01.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.687+0000 7f3aee90a640 1 --2- 172.21.15.123:0/4174749966 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3ae80b3790 0x7f3ae80cb280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:01.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.687+0000 7f3aee90a640 1 -- 172.21.15.123:0/4174749966 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae814af80 con 0x7f3ae80cef60 2024-09-15T23:24:01.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.687+0000 7f3aed908640 1 --2- 172.21.15.123:0/4174749966 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3ae80b3790 0x7f3ae80cb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:24:01.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.687+0000 7f3aee90a640 1 --2- 172.21.15.123:0/4174749966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ae80cef60 0x7f3ae80cb7c0 secure :-1 s=READY pgs=2358 cs=0 l=1 rev1=1 crypto rx=0x7f3ae400c480 tx=0x7f3ae400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:01.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.687+0000 7f3adeffd640 1 -- 172.21.15.123:0/4174749966 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4018070 con 0x7f3ae80cef60 2024-09-15T23:24:01.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.687+0000 7f3adeffd640 1 -- 172.21.15.123:0/4174749966 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ae4007500 con 0x7f3ae80cef60 2024-09-15T23:24:01.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.687+0000 7f3af036d640 1 -- 172.21.15.123:0/4174749966 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ae814b260 con 0x7f3ae80cef60 2024-09-15T23:24:01.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.687+0000 7f3adeffd640 1 -- 172.21.15.123:0/4174749966 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4004a20 con 0x7f3ae80cef60 2024-09-15T23:24:01.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.687+0000 7f3af036d640 1 -- 172.21.15.123:0/4174749966 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ae814b820 con 0x7f3ae80cef60 2024-09-15T23:24:01.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.688+0000 7f3af036d640 1 -- 172.21.15.123:0/4174749966 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ae80b3c40 con 0x7f3ae80cef60 2024-09-15T23:24:01.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.689+0000 7f3adeffd640 1 -- 172.21.15.123:0/4174749966 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3ae401b070 con 0x7f3ae80cef60 2024-09-15T23:24:01.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.689+0000 7f3adeffd640 1 --2- 172.21.15.123:0/4174749966 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3acc06c2b0 0x7f3acc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:01.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.689+0000 7f3adeffd640 1 -- 172.21.15.123:0/4174749966 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 4857+0+0 (secure 0 0 0) 0x7f3ae408a3c0 con 0x7f3ae80cef60 2024-09-15T23:24:01.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.689+0000 7f3aee109640 1 --2- 172.21.15.123:0/4174749966 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3acc06c2b0 0x7f3acc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:01.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.690+0000 7f3aee109640 1 --2- 172.21.15.123:0/4174749966 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3acc06c2b0 0x7f3acc06e770 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f3ae00074a0 tx=0x7f3ae000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:01.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.693+0000 7f3adeffd640 1 -- 172.21.15.123:0/4174749966 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3ae4058f10 con 0x7f3ae80cef60 2024-09-15T23:24:01.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.862+0000 7f3af036d640 1 -- 172.21.15.123:0/4174749966 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f3ae8072f20 con 0x7f3ae80cef60 2024-09-15T23:24:01.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.862+0000 7f3adeffd640 1 -- 172.21.15.123:0/4174749966 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v202) ==== 84+0+65 (secure 0 0 0) 0x7f3ae4058810 con 0x7f3ae80cef60 2024-09-15T23:24:01.863 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:01.864 INFO:teuthology.orchestra.run.smithi123.stdout:[ 2024-09-15T23:24:01.864 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-09-15T23:24:01.864 INFO:teuthology.orchestra.run.smithi123.stdout: "poolnum": 1, 2024-09-15T23:24:01.864 INFO:teuthology.orchestra.run.smithi123.stdout: "poolname": ".mgr" 2024-09-15T23:24:01.864 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:24:01.864 INFO:teuthology.orchestra.run.smithi123.stdout:] 2024-09-15T23:24:01.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.864+0000 7f3af036d640 1 -- 172.21.15.123:0/4174749966 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3acc06c2b0 msgr2=0x7f3acc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:01.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.864+0000 7f3af036d640 1 --2- 172.21.15.123:0/4174749966 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3acc06c2b0 0x7f3acc06e770 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f3ae00074a0 tx=0x7f3ae000b040 comp rx=0 tx=0).stop 2024-09-15T23:24:01.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.864+0000 7f3af036d640 1 -- 172.21.15.123:0/4174749966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ae80cef60 msgr2=0x7f3ae80cb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:01.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.864+0000 7f3af036d640 1 --2- 172.21.15.123:0/4174749966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ae80cef60 0x7f3ae80cb7c0 secure :-1 s=READY pgs=2358 cs=0 l=1 rev1=1 crypto rx=0x7f3ae400c480 tx=0x7f3ae400c940 comp rx=0 tx=0).stop 2024-09-15T23:24:01.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.864+0000 7f3af036d640 1 -- 172.21.15.123:0/4174749966 shutdown_connections 2024-09-15T23:24:01.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.864+0000 7f3af036d640 1 --2- 172.21.15.123:0/4174749966 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3acc06c2b0 0x7f3acc06e770 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:01.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.864+0000 7f3af036d640 1 --2- 172.21.15.123:0/4174749966 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3ae80cef60 0x7f3ae80cb7c0 unknown :-1 s=CLOSED pgs=2358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:01.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.864+0000 7f3af036d640 1 --2- 172.21.15.123:0/4174749966 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3ae80b3790 0x7f3ae80cb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:01.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.864+0000 7f3af036d640 1 --2- 172.21.15.123:0/4174749966 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3ae806bc10 0x7f3ae80b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:01.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.864+0000 7f3af036d640 1 -- 172.21.15.123:0/4174749966 >> 172.21.15.123:0/4174749966 conn(0x7f3ae806cd20 msgr2=0x7f3ae806d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:01.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.864+0000 7f3af036d640 1 -- 172.21.15.123:0/4174749966 shutdown_connections 2024-09-15T23:24:01.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.864+0000 7f3af036d640 1 -- 172.21.15.123:0/4174749966 wait complete. 2024-09-15T23:24:01.876 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T23:24:01.876 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T23:24:01.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.977+0000 7f8a5cc77640 1 Processor -- start 2024-09-15T23:24:01.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.977+0000 7f8a5cc77640 1 -- start start 2024-09-15T23:24:01.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.978+0000 7f8a5cc77640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8a581454b0 0x7f8a580b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:01.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.978+0000 7f8a5cc77640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8a581459a0 0x7f8a580b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:01.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.978+0000 7f8a5cc77640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a58146220 con 0x7f8a580b1db0 2024-09-15T23:24:01.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.978+0000 7f8a5cc77640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f8a580b1920 con 0x7f8a581454b0 2024-09-15T23:24:01.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.978+0000 7f8a5cc77640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8a580cf640 con 0x7f8a581459a0 2024-09-15T23:24:01.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.978+0000 7f8a5659c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8a581454b0 0x7f8a580b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:01.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.978+0000 7f8a5659c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8a581454b0 0x7f8a580b58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32932/0 (socket says 172.21.15.123:32932) 2024-09-15T23:24:01.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.978+0000 7f8a5659c640 1 -- 172.21.15.123:0/3868512104 learned_addr learned my addr 172.21.15.123:0/3868512104 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:01.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.978+0000 7f8a4dd9b640 1 --2- 172.21.15.123:0/3868512104 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8a581459a0 0x7f8a580b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:01.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.978+0000 7f8a5659c640 1 -- 172.21.15.123:0/3868512104 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8a581459a0 msgr2=0x7f8a580b5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:01.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.978+0000 7f8a5659c640 1 --2- 172.21.15.123:0/3868512104 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8a581459a0 0x7f8a580b5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:01.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.978+0000 7f8a5659c640 1 -- 172.21.15.123:0/3868512104 >> v1:172.21.15.188:6789/0 conn(0x7f8a580b1db0 legacy=0x7f8a580b2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:01.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.978+0000 7f8a5659c640 1 -- 172.21.15.123:0/3868512104 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a580cf8e0 con 0x7f8a581454b0 2024-09-15T23:24:01.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.979+0000 7f8a5659c640 1 --2- 172.21.15.123:0/3868512104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a581454b0 0x7f8a580b58f0 secure :-1 s=READY pgs=2359 cs=0 l=1 rev1=1 crypto rx=0x7f8a48009870 tx=0x7f8a4802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea52ad478a956fa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:01.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.979+0000 7f8a55d9b640 1 -- 172.21.15.123:0/3868512104 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a48037070 con 0x7f8a581454b0 2024-09-15T23:24:01.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.979+0000 7f8a55d9b640 1 -- 172.21.15.123:0/3868512104 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a4802ae50 con 0x7f8a581454b0 2024-09-15T23:24:01.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.979+0000 7f8a55d9b640 1 -- 172.21.15.123:0/3868512104 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a48032860 con 0x7f8a581454b0 2024-09-15T23:24:01.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.980+0000 7f8a5cc77640 1 -- 172.21.15.123:0/3868512104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a581454b0 msgr2=0x7f8a580b58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:01.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.980+0000 7f8a5cc77640 1 --2- 172.21.15.123:0/3868512104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a581454b0 0x7f8a580b58f0 secure :-1 s=READY pgs=2359 cs=0 l=1 rev1=1 crypto rx=0x7f8a48009870 tx=0x7f8a4802a300 comp rx=0 tx=0).stop 2024-09-15T23:24:01.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.980+0000 7f8a5cc77640 1 -- 172.21.15.123:0/3868512104 shutdown_connections 2024-09-15T23:24:01.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.980+0000 7f8a5cc77640 1 --2- 172.21.15.123:0/3868512104 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8a581459a0 0x7f8a580b5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:01.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.980+0000 7f8a5cc77640 1 --2- 172.21.15.123:0/3868512104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a581454b0 0x7f8a580b58f0 unknown :-1 s=CLOSED pgs=2359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:01.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.980+0000 7f8a5cc77640 1 -- 172.21.15.123:0/3868512104 >> 172.21.15.123:0/3868512104 conn(0x7f8a5806c240 msgr2=0x7f8a5806d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:01.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.980+0000 7f8a5cc77640 1 -- 172.21.15.123:0/3868512104 shutdown_connections 2024-09-15T23:24:01.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.980+0000 7f8a5cc77640 1 -- 172.21.15.123:0/3868512104 wait complete. 2024-09-15T23:24:01.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.981+0000 7f8a5cc77640 1 Processor -- start 2024-09-15T23:24:01.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.981+0000 7f8a5cc77640 1 -- start start 2024-09-15T23:24:01.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.982+0000 7f8a5cc77640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a580b1db0 0x7f8a5815b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:01.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.982+0000 7f8a5cc77640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8a581454b0 0x7f8a5813f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:01.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.982+0000 7f8a5cc77640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a581459a0 0x7f8a580ab110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:01.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.982+0000 7f8a5cc77640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8a580d0180 con 0x7f8a581459a0 2024-09-15T23:24:01.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.982+0000 7f8a5cc77640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8a580cfea0 con 0x7f8a580b1db0 2024-09-15T23:24:01.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.982+0000 7f8a5cc77640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8a580b0e50 con 0x7f8a581454b0 2024-09-15T23:24:01.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.982+0000 7f8a56d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a581459a0 0x7f8a580ab110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:01.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.982+0000 7f8a56d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a581459a0 0x7f8a580ab110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32946/0 (socket says 172.21.15.123:32946) 2024-09-15T23:24:01.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.982+0000 7f8a56d9d640 1 -- 172.21.15.123:0/3106651524 learned_addr learned my addr 172.21.15.123:0/3106651524 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:01.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.982+0000 7f8a5659c640 1 --2- 172.21.15.123:0/3106651524 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a580b1db0 0x7f8a5815b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:01.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.982+0000 7f8a4dd9b640 1 --2- 172.21.15.123:0/3106651524 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8a581454b0 0x7f8a5813f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:01.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.982+0000 7f8a56d9d640 1 -- 172.21.15.123:0/3106651524 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8a581454b0 msgr2=0x7f8a5813f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:01.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.982+0000 7f8a56d9d640 1 --2- 172.21.15.123:0/3106651524 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8a581454b0 0x7f8a5813f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:01.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.983+0000 7f8a56d9d640 1 -- 172.21.15.123:0/3106651524 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a580b1db0 msgr2=0x7f8a5815b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:01.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.983+0000 7f8a56d9d640 1 --2- 172.21.15.123:0/3106651524 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a580b1db0 0x7f8a5815b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:01.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.983+0000 7f8a56d9d640 1 -- 172.21.15.123:0/3106651524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a5815c390 con 0x7f8a581459a0 2024-09-15T23:24:01.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.983+0000 7f8a56d9d640 1 --2- 172.21.15.123:0/3106651524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a581459a0 0x7f8a580ab110 secure :-1 s=READY pgs=2360 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000c7d0 tx=0x7f8a5000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:01.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.983+0000 7f8a4f7fe640 1 -- 172.21.15.123:0/3106651524 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a50003b70 con 0x7f8a581459a0 2024-09-15T23:24:01.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.983+0000 7f8a4f7fe640 1 -- 172.21.15.123:0/3106651524 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a50003d30 con 0x7f8a581459a0 2024-09-15T23:24:01.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.983+0000 7f8a5cc77640 1 -- 172.21.15.123:0/3106651524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a5813e100 con 0x7f8a581459a0 2024-09-15T23:24:01.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.983+0000 7f8a4f7fe640 1 -- 172.21.15.123:0/3106651524 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5000aa90 con 0x7f8a581459a0 2024-09-15T23:24:01.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.983+0000 7f8a5cc77640 1 -- 172.21.15.123:0/3106651524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a5813e9a0 con 0x7f8a581459a0 2024-09-15T23:24:01.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.984+0000 7f8a5cc77640 1 -- 172.21.15.123:0/3106651524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a580b58f0 con 0x7f8a581459a0 2024-09-15T23:24:01.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.984+0000 7f8a4f7fe640 1 -- 172.21.15.123:0/3106651524 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8a5000ac30 con 0x7f8a581459a0 2024-09-15T23:24:01.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.985+0000 7f8a4f7fe640 1 --2- 172.21.15.123:0/3106651524 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8a3806c2b0 0x7f8a3806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:01.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.985+0000 7f8a4f7fe640 1 -- 172.21.15.123:0/3106651524 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(202..202 src has 1..202) ==== 4857+0+0 (secure 0 0 0) 0x7f8a5008ae10 con 0x7f8a581459a0 2024-09-15T23:24:01.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.985+0000 7f8a5659c640 1 --2- 172.21.15.123:0/3106651524 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8a3806c2b0 0x7f8a3806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:01.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.986+0000 7f8a5659c640 1 --2- 172.21.15.123:0/3106651524 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8a3806c2b0 0x7f8a3806e770 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f8a48034000 tx=0x7f8a4802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:01.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:01.989+0000 7f8a4f7fe640 1 -- 172.21.15.123:0/3106651524 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8a58146220 con 0x7f8a581459a0 2024-09-15T23:24:02.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.154+0000 7f8a5cc77640 1 -- 172.21.15.123:0/3106651524 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f8a581443a0 con 0x7f8a581459a0 2024-09-15T23:24:02.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.214+0000 7f8a4f7fe640 1 -- 172.21.15.123:0/3106651524 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v203) ==== 138+0+0 (secure 0 0 0) 0x7f8a50059310 con 0x7f8a581459a0 2024-09-15T23:24:02.215 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' created 2024-09-15T23:24:02.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.216+0000 7f8a5cc77640 1 -- 172.21.15.123:0/3106651524 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8a3806c2b0 msgr2=0x7f8a3806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:02.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.216+0000 7f8a5cc77640 1 --2- 172.21.15.123:0/3106651524 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8a3806c2b0 0x7f8a3806e770 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f8a48034000 tx=0x7f8a4802e000 comp rx=0 tx=0).stop 2024-09-15T23:24:02.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.216+0000 7f8a5cc77640 1 -- 172.21.15.123:0/3106651524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a581459a0 msgr2=0x7f8a580ab110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:02.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.216+0000 7f8a5cc77640 1 --2- 172.21.15.123:0/3106651524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a581459a0 0x7f8a580ab110 secure :-1 s=READY pgs=2360 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000c7d0 tx=0x7f8a5000cc90 comp rx=0 tx=0).stop 2024-09-15T23:24:02.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.216+0000 7f8a5cc77640 1 -- 172.21.15.123:0/3106651524 shutdown_connections 2024-09-15T23:24:02.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.216+0000 7f8a5cc77640 1 --2- 172.21.15.123:0/3106651524 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8a3806c2b0 0x7f8a3806e770 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:02.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.216+0000 7f8a5cc77640 1 --2- 172.21.15.123:0/3106651524 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8a581459a0 0x7f8a580ab110 unknown :-1 s=CLOSED pgs=2360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:02.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.216+0000 7f8a5cc77640 1 --2- 172.21.15.123:0/3106651524 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8a581454b0 0x7f8a5813f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:02.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.216+0000 7f8a5cc77640 1 --2- 172.21.15.123:0/3106651524 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8a580b1db0 0x7f8a5815b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:02.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.216+0000 7f8a5cc77640 1 -- 172.21.15.123:0/3106651524 >> 172.21.15.123:0/3106651524 conn(0x7f8a5806c240 msgr2=0x7f8a580b2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:02.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.216+0000 7f8a5cc77640 1 -- 172.21.15.123:0/3106651524 shutdown_connections 2024-09-15T23:24:02.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.216+0000 7f8a5cc77640 1 -- 172.21.15.123:0/3106651524 wait complete. 2024-09-15T23:24:02.231 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T23:24:02.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.336+0000 7f160a9cf640 1 Processor -- start 2024-09-15T23:24:02.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.337+0000 7f160a9cf640 1 -- start start 2024-09-15T23:24:02.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.337+0000 7f160a9cf640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f160415c760 0x7f1604073210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:02.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.337+0000 7f160a9cf640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f160406bc10 0x7f160406c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:02.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.337+0000 7f160a9cf640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16040cf3d0 con 0x7f16040b4320 2024-09-15T23:24:02.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.337+0000 7f160a9cf640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f1604073810 con 0x7f160415c760 2024-09-15T23:24:02.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.337+0000 7f160a9cf640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1604073af0 con 0x7f160406bc10 2024-09-15T23:24:02.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.337+0000 7f16037fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f16040b4320 0x7f1604070220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:57418/0 (socket says 172.21.15.123:57418) 2024-09-15T23:24:02.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.337+0000 7f16037fe640 1 -- 172.21.15.123:0/3880291997 learned_addr learned my addr 172.21.15.123:0/3880291997 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:02.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.338+0000 7f1608f6c640 1 --2- 172.21.15.123:0/3880291997 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f160406bc10 0x7f160406c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:02.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.338+0000 7f1602ffd640 1 -- 172.21.15.123:0/3880291997 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 652385314 0 0) 0x7f16040cf3d0 con 0x7f16040b4320 2024-09-15T23:24:02.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.338+0000 7f1603fff640 1 --2- 172.21.15.123:0/3880291997 >> v2:172.21.15.188:3300/0 conn(0x7f160415c760 0x7f1604073210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:02.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.338+0000 7f1602ffd640 1 -- 172.21.15.123:0/3880291997 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15ec003520 con 0x7f16040b4320 2024-09-15T23:24:02.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.338+0000 7f1602ffd640 1 -- 172.21.15.123:0/3880291997 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4106039869 0 0) 0x7f15ec003520 con 0x7f16040b4320 2024-09-15T23:24:02.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.338+0000 7f1602ffd640 1 -- 172.21.15.123:0/3880291997 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f160406bc10 msgr2=0x7f160406c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:02.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.338+0000 7f1602ffd640 1 --2- 172.21.15.123:0/3880291997 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f160406bc10 0x7f160406c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:02.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.338+0000 7f1602ffd640 1 -- 172.21.15.123:0/3880291997 >> v2:172.21.15.188:3300/0 conn(0x7f160415c760 msgr2=0x7f1604073210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:02.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.338+0000 7f1602ffd640 1 --2- 172.21.15.123:0/3880291997 >> v2:172.21.15.188:3300/0 conn(0x7f160415c760 0x7f1604073210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:02.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.338+0000 7f1602ffd640 1 -- 172.21.15.123:0/3880291997 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1604073dd0 con 0x7f16040b4320 2024-09-15T23:24:02.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.338+0000 7f1602ffd640 1 -- 172.21.15.123:0/3880291997 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f15f8001670 con 0x7f16040b4320 2024-09-15T23:24:02.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.338+0000 7f1602ffd640 1 -- 172.21.15.123:0/3880291997 >> v1:172.21.15.123:6789/0 conn(0x7f16040b4320 legacy=0x7f1604070220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:02.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.338+0000 7f1602ffd640 1 --2- 172.21.15.123:0/3880291997 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f160406bc10 0x7f15ec0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:02.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.338+0000 7f1602ffd640 1 --2- 172.21.15.123:0/3880291997 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f15ec003f30 0x7f15ec004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:02.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.338+0000 7f1602ffd640 1 --2- 172.21.15.123:0/3880291997 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15ec004d40 0x7f15ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:02.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.338+0000 7f1602ffd640 1 -- 172.21.15.123:0/3880291997 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1604073810 con 0x7f15ec004d40 2024-09-15T23:24:02.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.338+0000 7f1602ffd640 1 -- 172.21.15.123:0/3880291997 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1604073af0 con 0x7f15ec003f30 2024-09-15T23:24:02.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.338+0000 7f1602ffd640 1 -- 172.21.15.123:0/3880291997 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f15ec00ba10 con 0x7f160406bc10 2024-09-15T23:24:02.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.338+0000 7f1608f6c640 1 --2- 172.21.15.123:0/3880291997 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15ec004d40 0x7f15ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:02.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.338+0000 7f1603fff640 1 --2- 172.21.15.123:0/3880291997 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f160406bc10 0x7f15ec0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:02.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.338+0000 7f16037fe640 1 --2- 172.21.15.123:0/3880291997 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f15ec003f30 0x7f15ec004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:02.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.338+0000 7f1608f6c640 1 -- 172.21.15.123:0/3880291997 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f160406bc10 msgr2=0x7f15ec0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:02.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.338+0000 7f1608f6c640 1 --2- 172.21.15.123:0/3880291997 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f160406bc10 0x7f15ec0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:02.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.338+0000 7f1608f6c640 1 -- 172.21.15.123:0/3880291997 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f15ec003f30 msgr2=0x7f15ec004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:02.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.338+0000 7f1608f6c640 1 --2- 172.21.15.123:0/3880291997 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f15ec003f30 0x7f15ec004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:02.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.338+0000 7f1608f6c640 1 -- 172.21.15.123:0/3880291997 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15ec003520 con 0x7f15ec004d40 2024-09-15T23:24:02.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.339+0000 7f1608f6c640 1 --2- 172.21.15.123:0/3880291997 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15ec004d40 0x7f15ec0051c0 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 crypto rx=0x7f15fc00e170 tx=0x7f15ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f424f4ef7c6a18 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:02.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.339+0000 7f1602ffd640 1 -- 172.21.15.123:0/3880291997 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15fc034020 con 0x7f15ec004d40 2024-09-15T23:24:02.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.339+0000 7f1602ffd640 1 -- 172.21.15.123:0/3880291997 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15fc0305f0 con 0x7f15ec004d40 2024-09-15T23:24:02.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.339+0000 7f1602ffd640 1 -- 172.21.15.123:0/3880291997 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15fc009c10 con 0x7f15ec004d40 2024-09-15T23:24:02.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.340+0000 7f160a9cf640 1 -- 172.21.15.123:0/3880291997 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15ec004d40 msgr2=0x7f15ec0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:02.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.340+0000 7f160a9cf640 1 --2- 172.21.15.123:0/3880291997 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15ec004d40 0x7f15ec0051c0 secure :-1 s=READY pgs=2362 cs=0 l=1 rev1=1 crypto rx=0x7f15fc00e170 tx=0x7f15ec005830 comp rx=0 tx=0).stop 2024-09-15T23:24:02.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.340+0000 7f1608f6c640 1 -- 172.21.15.123:0/3880291997 reap_dead start 2024-09-15T23:24:02.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.340+0000 7f160a9cf640 1 -- 172.21.15.123:0/3880291997 shutdown_connections 2024-09-15T23:24:02.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.340+0000 7f160a9cf640 1 -- 172.21.15.123:0/3880291997 >> 172.21.15.123:0/3880291997 conn(0x7f16040d14d0 msgr2=0x7f16040d18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:02.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.340+0000 7f160a9cf640 1 -- 172.21.15.123:0/3880291997 shutdown_connections 2024-09-15T23:24:02.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.340+0000 7f160a9cf640 1 -- 172.21.15.123:0/3880291997 wait complete. 2024-09-15T23:24:02.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.341+0000 7f160a9cf640 1 Processor -- start 2024-09-15T23:24:02.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.341+0000 7f160a9cf640 1 -- start start 2024-09-15T23:24:02.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.342+0000 7f160a9cf640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f15ec004d40 0x7f16040c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:02.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.342+0000 7f160a9cf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1604159fc0 0x7f1604150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:02.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.342+0000 7f160a9cf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16041f2250 0x7f16041f26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:02.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.342+0000 7f160a9cf640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f16040b4770 con 0x7f1604159fc0 2024-09-15T23:24:02.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.342+0000 7f160a9cf640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f160415cb40 con 0x7f16041f2250 2024-09-15T23:24:02.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.342+0000 7f160a9cf640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f16040b48f0 con 0x7f15ec004d40 2024-09-15T23:24:02.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.342+0000 7f16037fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1604159fc0 0x7f1604150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:02.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.342+0000 7f16037fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1604159fc0 0x7f1604150940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32960/0 (socket says 172.21.15.123:32960) 2024-09-15T23:24:02.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.342+0000 7f16037fe640 1 -- 172.21.15.123:0/724084114 learned_addr learned my addr 172.21.15.123:0/724084114 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:02.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.342+0000 7f1603fff640 1 --2- 172.21.15.123:0/724084114 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f15ec004d40 0x7f16040c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:02.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.342+0000 7f1608f6c640 1 --2- 172.21.15.123:0/724084114 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16041f2250 0x7f16041f26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:02.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.342+0000 7f16037fe640 1 -- 172.21.15.123:0/724084114 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f15ec004d40 msgr2=0x7f16040c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:02.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.342+0000 7f16037fe640 1 --2- 172.21.15.123:0/724084114 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f15ec004d40 0x7f16040c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:02.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.342+0000 7f16037fe640 1 -- 172.21.15.123:0/724084114 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16041f2250 msgr2=0x7f16041f26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:02.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.342+0000 7f16037fe640 1 --2- 172.21.15.123:0/724084114 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16041f2250 0x7f16041f26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:02.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.342+0000 7f16037fe640 1 -- 172.21.15.123:0/724084114 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16040c9e80 con 0x7f1604159fc0 2024-09-15T23:24:02.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.342+0000 7f1608f6c640 1 --2- 172.21.15.123:0/724084114 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16041f2250 0x7f16041f26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:24:02.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.343+0000 7f16037fe640 1 --2- 172.21.15.123:0/724084114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1604159fc0 0x7f1604150940 secure :-1 s=READY pgs=2363 cs=0 l=1 rev1=1 crypto rx=0x7f15f80072c0 tx=0x7f15f80076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:02.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.343+0000 7f1600ff9640 1 -- 172.21.15.123:0/724084114 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f800f9c0 con 0x7f1604159fc0 2024-09-15T23:24:02.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.343+0000 7f1600ff9640 1 -- 172.21.15.123:0/724084114 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f8018070 con 0x7f1604159fc0 2024-09-15T23:24:02.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.343+0000 7f160a9cf640 1 -- 172.21.15.123:0/724084114 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16040ca140 con 0x7f1604159fc0 2024-09-15T23:24:02.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.343+0000 7f1600ff9640 1 -- 172.21.15.123:0/724084114 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f800fdc0 con 0x7f1604159fc0 2024-09-15T23:24:02.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.343+0000 7f160a9cf640 1 -- 172.21.15.123:0/724084114 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16040ca700 con 0x7f1604159fc0 2024-09-15T23:24:02.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.344+0000 7f160a9cf640 1 -- 172.21.15.123:0/724084114 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16040d0d00 con 0x7f1604159fc0 2024-09-15T23:24:02.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.344+0000 7f1600ff9640 1 -- 172.21.15.123:0/724084114 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f15f801d460 con 0x7f1604159fc0 2024-09-15T23:24:02.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.345+0000 7f1600ff9640 1 --2- 172.21.15.123:0/724084114 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f15f006c2b0 0x7f15f006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:02.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.345+0000 7f1600ff9640 1 -- 172.21.15.123:0/724084114 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(203..203 src has 1..203) ==== 5227+0+0 (secure 0 0 0) 0x7f15f808b270 con 0x7f1604159fc0 2024-09-15T23:24:02.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.345+0000 7f1603fff640 1 --2- 172.21.15.123:0/724084114 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f15f006c2b0 0x7f15f006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:02.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.346+0000 7f1603fff640 1 --2- 172.21.15.123:0/724084114 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f15f006c2b0 0x7f15f006e770 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f15f4009c40 tx=0x7f15f4009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:02.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.349+0000 7f1600ff9640 1 -- 172.21.15.123:0/724084114 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f15f8059c50 con 0x7f1604159fc0 2024-09-15T23:24:02.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:02.515+0000 7f160a9cf640 1 -- 172.21.15.123:0/724084114 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f16040d0530 con 0x7f1604159fc0 2024-09-15T23:24:03.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.216+0000 7f1600ff9640 1 -- 172.21.15.123:0/724084114 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v204) ==== 170+0+0 (secure 0 0 0) 0x7f15f8059550 con 0x7f1604159fc0 2024-09-15T23:24:03.217 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' created 2024-09-15T23:24:03.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.219+0000 7f160a9cf640 1 -- 172.21.15.123:0/724084114 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f15f006c2b0 msgr2=0x7f15f006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:03.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.219+0000 7f160a9cf640 1 --2- 172.21.15.123:0/724084114 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f15f006c2b0 0x7f15f006e770 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f15f4009c40 tx=0x7f15f4009190 comp rx=0 tx=0).stop 2024-09-15T23:24:03.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.219+0000 7f160a9cf640 1 -- 172.21.15.123:0/724084114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1604159fc0 msgr2=0x7f1604150940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:03.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.219+0000 7f160a9cf640 1 --2- 172.21.15.123:0/724084114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1604159fc0 0x7f1604150940 secure :-1 s=READY pgs=2363 cs=0 l=1 rev1=1 crypto rx=0x7f15f80072c0 tx=0x7f15f80076c0 comp rx=0 tx=0).stop 2024-09-15T23:24:03.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.219+0000 7f160a9cf640 1 -- 172.21.15.123:0/724084114 shutdown_connections 2024-09-15T23:24:03.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.219+0000 7f160a9cf640 1 --2- 172.21.15.123:0/724084114 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16041f2250 0x7f16041f26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:03.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.219+0000 7f160a9cf640 1 --2- 172.21.15.123:0/724084114 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f15f006c2b0 0x7f15f006e770 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:03.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.219+0000 7f160a9cf640 1 --2- 172.21.15.123:0/724084114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1604159fc0 0x7f1604150940 unknown :-1 s=CLOSED pgs=2363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:03.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.219+0000 7f160a9cf640 1 --2- 172.21.15.123:0/724084114 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f15ec004d40 0x7f16040c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:03.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.219+0000 7f160a9cf640 1 -- 172.21.15.123:0/724084114 >> 172.21.15.123:0/724084114 conn(0x7f16040d14d0 msgr2=0x7f160406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:03.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.219+0000 7f160a9cf640 1 -- 172.21.15.123:0/724084114 shutdown_connections 2024-09-15T23:24:03.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.219+0000 7f160a9cf640 1 -- 172.21.15.123:0/724084114 wait complete. 2024-09-15T23:24:03.241 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T23:24:03.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.343+0000 7f0cd02f1640 1 Processor -- start 2024-09-15T23:24:03.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.343+0000 7f0cd02f1640 1 -- start start 2024-09-15T23:24:03.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.344+0000 7f0cd02f1640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f0cc806c320 0x7f0cc8073ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:03.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.344+0000 7f0cd02f1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0cc8070f40 0x7f0cc815b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:03.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.344+0000 7f0cd02f1640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cc8158d00 con 0x7f0cc8158920 2024-09-15T23:24:03.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.344+0000 7f0cd02f1640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f0cc8072130 con 0x7f0cc806c320 2024-09-15T23:24:03.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.344+0000 7f0cd02f1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0cc80ce0f0 con 0x7f0cc8070f40 2024-09-15T23:24:03.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.344+0000 7f0cce08d640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f0cc8158920 0x7f0cc806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:57420/0 (socket says 172.21.15.123:57420) 2024-09-15T23:24:03.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.344+0000 7f0cce08d640 1 -- 172.21.15.123:0/1048942488 learned_addr learned my addr 172.21.15.123:0/1048942488 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:03.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.344+0000 7f0ccd88c640 1 --2- 172.21.15.123:0/1048942488 >> v2:172.21.15.188:3300/0 conn(0x7f0cc806c320 0x7f0cc8073ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:03.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.344+0000 7f0cce88e640 1 --2- 172.21.15.123:0/1048942488 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0cc8070f40 0x7f0cc815b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:03.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.344+0000 7f0ccd08b640 1 -- 172.21.15.123:0/1048942488 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1551910721 0 0) 0x7f0cb8001490 con 0x7f0cc8158920 2024-09-15T23:24:03.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.344+0000 7f0ccd08b640 1 -- 172.21.15.123:0/1048942488 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0cb0003520 con 0x7f0cc8158920 2024-09-15T23:24:03.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.344+0000 7f0cce88e640 1 -- 172.21.15.123:0/1048942488 >> v2:172.21.15.188:3300/0 conn(0x7f0cc806c320 msgr2=0x7f0cc8073ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:03.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.344+0000 7f0cce88e640 1 --2- 172.21.15.123:0/1048942488 >> v2:172.21.15.188:3300/0 conn(0x7f0cc806c320 0x7f0cc8073ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:03.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.344+0000 7f0cce88e640 1 -- 172.21.15.123:0/1048942488 >> v1:172.21.15.123:6789/0 conn(0x7f0cc8158920 legacy=0x7f0cc806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:03.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.344+0000 7f0ccd08b640 1 -- 172.21.15.123:0/1048942488 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3390301631 0 0) 0x7f0cb0003520 con 0x7f0cc8158920 2024-09-15T23:24:03.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.344+0000 7f0cce88e640 1 -- 172.21.15.123:0/1048942488 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc8071500 con 0x7f0cc8070f40 2024-09-15T23:24:03.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.344+0000 7f0ccd88c640 1 --2- 172.21.15.123:0/1048942488 >> v2:172.21.15.188:3300/0 conn(0x7f0cc806c320 0x7f0cc8073ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:24:03.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.345+0000 7f0cce88e640 1 --2- 172.21.15.123:0/1048942488 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0cc8070f40 0x7f0cc815b2c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0cc00097a0 tx=0x7f0cc002a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e1a4bc9e8630964 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:03.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.345+0000 7f0ccd08b640 1 -- 172.21.15.123:0/1048942488 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc0037070 con 0x7f0cc8070f40 2024-09-15T23:24:03.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.345+0000 7f0ccd08b640 1 -- 172.21.15.123:0/1048942488 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cc002aa90 con 0x7f0cc8070f40 2024-09-15T23:24:03.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.345+0000 7f0ccd08b640 1 -- 172.21.15.123:0/1048942488 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb8001bc0 con 0x7f0cc8070f40 2024-09-15T23:24:03.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.346+0000 7f0cd02f1640 1 -- 172.21.15.123:0/1048942488 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0cc8070f40 msgr2=0x7f0cc815b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:03.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.346+0000 7f0cd02f1640 1 --2- 172.21.15.123:0/1048942488 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0cc8070f40 0x7f0cc815b2c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0cc00097a0 tx=0x7f0cc002a000 comp rx=0 tx=0).stop 2024-09-15T23:24:03.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.346+0000 7f0cd02f1640 1 -- 172.21.15.123:0/1048942488 shutdown_connections 2024-09-15T23:24:03.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.346+0000 7f0cd02f1640 1 --2- 172.21.15.123:0/1048942488 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0cc8070f40 0x7f0cc815b2c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:03.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.346+0000 7f0cd02f1640 1 --2- 172.21.15.123:0/1048942488 >> v2:172.21.15.188:3300/0 conn(0x7f0cc806c320 0x7f0cc8073ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:03.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.346+0000 7f0cd02f1640 1 -- 172.21.15.123:0/1048942488 >> 172.21.15.123:0/1048942488 conn(0x7f0cc806d0f0 msgr2=0x7f0cc806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:03.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.346+0000 7f0cd02f1640 1 -- 172.21.15.123:0/1048942488 shutdown_connections 2024-09-15T23:24:03.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.346+0000 7f0cd02f1640 1 -- 172.21.15.123:0/1048942488 wait complete. 2024-09-15T23:24:03.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.347+0000 7f0cd02f1640 1 Processor -- start 2024-09-15T23:24:03.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.347+0000 7f0cd02f1640 1 -- start start 2024-09-15T23:24:03.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.348+0000 7f0cd02f1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0cc806c320 0x7f0cc814b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:03.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.348+0000 7f0cd02f1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cc8070f40 0x7f0cc80caf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:03.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.348+0000 7f0cd02f1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0cc8158920 0x7f0cc80b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:03.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.348+0000 7f0cd02f1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc806cc30 con 0x7f0cc8070f40 2024-09-15T23:24:03.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.348+0000 7f0cd02f1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc8071dc0 con 0x7f0cc806c320 2024-09-15T23:24:03.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.348+0000 7f0cd02f1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0cc80725c0 con 0x7f0cc8158920 2024-09-15T23:24:03.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.348+0000 7f0ccd88c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cc8070f40 0x7f0cc80caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:03.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.348+0000 7f0ccd88c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cc8070f40 0x7f0cc80caf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32970/0 (socket says 172.21.15.123:32970) 2024-09-15T23:24:03.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.348+0000 7f0ccd88c640 1 -- 172.21.15.123:0/2213680404 learned_addr learned my addr 172.21.15.123:0/2213680404 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:03.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.348+0000 7f0cce08d640 1 --2- 172.21.15.123:0/2213680404 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0cc806c320 0x7f0cc814b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:03.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.348+0000 7f0cce88e640 1 --2- 172.21.15.123:0/2213680404 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0cc8158920 0x7f0cc80b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:03.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.348+0000 7f0ccd88c640 1 -- 172.21.15.123:0/2213680404 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0cc8158920 msgr2=0x7f0cc80b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:03.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.348+0000 7f0ccd88c640 1 --2- 172.21.15.123:0/2213680404 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0cc8158920 0x7f0cc80b26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:03.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.348+0000 7f0ccd88c640 1 -- 172.21.15.123:0/2213680404 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0cc806c320 msgr2=0x7f0cc814b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:03.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.348+0000 7f0ccd88c640 1 --2- 172.21.15.123:0/2213680404 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0cc806c320 0x7f0cc814b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:03.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.348+0000 7f0ccd88c640 1 -- 172.21.15.123:0/2213680404 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc80cb860 con 0x7f0cc8070f40 2024-09-15T23:24:03.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.348+0000 7f0ccd88c640 1 --2- 172.21.15.123:0/2213680404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cc8070f40 0x7f0cc80caf30 secure :-1 s=READY pgs=2365 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc00e960 tx=0x7f0cbc00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:03.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.348+0000 7f0cc6ffd640 1 -- 172.21.15.123:0/2213680404 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc017070 con 0x7f0cc8070f40 2024-09-15T23:24:03.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.349+0000 7f0cc6ffd640 1 -- 172.21.15.123:0/2213680404 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cbc00ca00 con 0x7f0cc8070f40 2024-09-15T23:24:03.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.349+0000 7f0cc6ffd640 1 -- 172.21.15.123:0/2213680404 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc00cdd0 con 0x7f0cc8070f40 2024-09-15T23:24:03.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.349+0000 7f0cd02f1640 1 -- 172.21.15.123:0/2213680404 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cc80cbb40 con 0x7f0cc8070f40 2024-09-15T23:24:03.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.349+0000 7f0cd02f1640 1 -- 172.21.15.123:0/2213680404 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cc80cc100 con 0x7f0cc8070f40 2024-09-15T23:24:03.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.349+0000 7f0cd02f1640 1 -- 172.21.15.123:0/2213680404 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cc8073ac0 con 0x7f0cc8070f40 2024-09-15T23:24:03.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.350+0000 7f0cc6ffd640 1 -- 172.21.15.123:0/2213680404 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0cbc01a070 con 0x7f0cc8070f40 2024-09-15T23:24:03.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.350+0000 7f0cc6ffd640 1 --2- 172.21.15.123:0/2213680404 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0cb406c2e0 0x7f0cb406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:03.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.351+0000 7f0cc6ffd640 1 -- 172.21.15.123:0/2213680404 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(204..204 src has 1..204) ==== 5609+0+0 (secure 0 0 0) 0x7f0cbc08b650 con 0x7f0cc8070f40 2024-09-15T23:24:03.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.351+0000 7f0cce08d640 1 --2- 172.21.15.123:0/2213680404 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0cb406c2e0 0x7f0cb406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:03.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.351+0000 7f0cce08d640 1 --2- 172.21.15.123:0/2213680404 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0cb406c2e0 0x7f0cb406e7a0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8005c00 tx=0x7f0cb8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:03.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.355+0000 7f0cc6ffd640 1 -- 172.21.15.123:0/2213680404 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0cbc0596f0 con 0x7f0cc8070f40 2024-09-15T23:24:03.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:03.554+0000 7f0cd02f1640 1 -- 172.21.15.123:0/2213680404 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f0cc80686b0 con 0x7f0cc8070f40 2024-09-15T23:24:04.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.241+0000 7f0cc6ffd640 1 -- 172.21.15.123:0/2213680404 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 28 and data pool 29 v124) ==== 174+0+0 (secure 0 0 0) 0x7f0cbc05d9f0 con 0x7f0cc8070f40 2024-09-15T23:24:04.243 INFO:teuthology.orchestra.run.smithi123.stderr:new fs with metadata pool 28 and data pool 29 2024-09-15T23:24:04.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.247+0000 7f0cd02f1640 1 -- 172.21.15.123:0/2213680404 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0cb406c2e0 msgr2=0x7f0cb406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:04.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.247+0000 7f0cd02f1640 1 --2- 172.21.15.123:0/2213680404 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0cb406c2e0 0x7f0cb406e7a0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8005c00 tx=0x7f0cb8009040 comp rx=0 tx=0).stop 2024-09-15T23:24:04.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.247+0000 7f0cd02f1640 1 -- 172.21.15.123:0/2213680404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cc8070f40 msgr2=0x7f0cc80caf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:04.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.247+0000 7f0cd02f1640 1 --2- 172.21.15.123:0/2213680404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cc8070f40 0x7f0cc80caf30 secure :-1 s=READY pgs=2365 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc00e960 tx=0x7f0cbc00ee20 comp rx=0 tx=0).stop 2024-09-15T23:24:04.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.249+0000 7f0cd02f1640 1 -- 172.21.15.123:0/2213680404 shutdown_connections 2024-09-15T23:24:04.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.249+0000 7f0cd02f1640 1 --2- 172.21.15.123:0/2213680404 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0cc8158920 0x7f0cc80b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:04.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.249+0000 7f0cd02f1640 1 --2- 172.21.15.123:0/2213680404 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0cb406c2e0 0x7f0cb406e7a0 secure :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8005c00 tx=0x7f0cb8009040 comp rx=0 tx=0).stop 2024-09-15T23:24:04.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.249+0000 7f0cd02f1640 1 --2- 172.21.15.123:0/2213680404 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0cc8070f40 0x7f0cc80caf30 secure :-1 s=CLOSED pgs=2365 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc00e960 tx=0x7f0cbc00ee20 comp rx=0 tx=0).stop 2024-09-15T23:24:04.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.249+0000 7f0cd02f1640 1 --2- 172.21.15.123:0/2213680404 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0cc806c320 0x7f0cc814b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:04.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.249+0000 7f0cd02f1640 1 -- 172.21.15.123:0/2213680404 >> 172.21.15.123:0/2213680404 conn(0x7f0cc806d0f0 msgr2=0x7f0cc80b5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:04.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.253+0000 7f0cd02f1640 1 -- 172.21.15.123:0/2213680404 shutdown_connections 2024-09-15T23:24:04.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.255+0000 7f0cd02f1640 1 -- 172.21.15.123:0/2213680404 wait complete. 2024-09-15T23:24:04.271 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:24:04.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.372+0000 7fa7de5e4640 1 Processor -- start 2024-09-15T23:24:04.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.372+0000 7fa7de5e4640 1 -- start start 2024-09-15T23:24:04.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.373+0000 7fa7de5e4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa7d8145ed0 0x7fa7d80b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:04.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.373+0000 7fa7de5e4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7d80b4020 con 0x7fa7d80b5f90 2024-09-15T23:24:04.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.373+0000 7fa7de5e4640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7d80b42c0 con 0x7fa7d8073180 2024-09-15T23:24:04.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.373+0000 7fa7de5e4640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fa7d80b63d0 con 0x7fa7d8145ed0 2024-09-15T23:24:04.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.373+0000 7fa7d7fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa7d8145ed0 0x7fa7d80b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:04.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.373+0000 7fa7dcb81640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa7d80b5f90 0x7fa7d815cdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:57436/0 (socket says 172.21.15.123:57436) 2024-09-15T23:24:04.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.373+0000 7fa7dcb81640 1 -- 172.21.15.123:0/1454152252 learned_addr learned my addr 172.21.15.123:0/1454152252 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:04.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.373+0000 7fa7d7fff640 1 -- 172.21.15.123:0/1454152252 >> v1:172.21.15.188:6789/0 conn(0x7fa7d8073180 legacy=0x7fa7d80b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:04.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.373+0000 7fa7d7fff640 1 -- 172.21.15.123:0/1454152252 >> v1:172.21.15.123:6789/0 conn(0x7fa7d80b5f90 legacy=0x7fa7d815cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:04.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.373+0000 7fa7d7fff640 1 -- 172.21.15.123:0/1454152252 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7d80b45a0 con 0x7fa7d8145ed0 2024-09-15T23:24:04.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.373+0000 7fa7d6ffd640 1 -- 172.21.15.123:0/1454152252 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1470805644 0 0) 0x7fa7d80b4020 con 0x7fa7d80b5f90 2024-09-15T23:24:04.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.374+0000 7fa7d7fff640 1 --2- 172.21.15.123:0/1454152252 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d8145ed0 0x7fa7d80b5080 secure :-1 s=READY pgs=2367 cs=0 l=1 rev1=1 crypto rx=0x7fa7c80097a0 tx=0x7fa7c802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed4565a59916d7db server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:04.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.374+0000 7fa7d6ffd640 1 -- 172.21.15.123:0/1454152252 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8037070 con 0x7fa7d8145ed0 2024-09-15T23:24:04.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.374+0000 7fa7d6ffd640 1 -- 172.21.15.123:0/1454152252 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7c8032440 con 0x7fa7d8145ed0 2024-09-15T23:24:04.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.374+0000 7fa7d6ffd640 1 -- 172.21.15.123:0/1454152252 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8032810 con 0x7fa7d8145ed0 2024-09-15T23:24:04.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.375+0000 7fa7de5e4640 1 -- 172.21.15.123:0/1454152252 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d8145ed0 msgr2=0x7fa7d80b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:04.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.375+0000 7fa7de5e4640 1 --2- 172.21.15.123:0/1454152252 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d8145ed0 0x7fa7d80b5080 secure :-1 s=READY pgs=2367 cs=0 l=1 rev1=1 crypto rx=0x7fa7c80097a0 tx=0x7fa7c802a230 comp rx=0 tx=0).stop 2024-09-15T23:24:04.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.375+0000 7fa7de5e4640 1 -- 172.21.15.123:0/1454152252 shutdown_connections 2024-09-15T23:24:04.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.375+0000 7fa7de5e4640 1 --2- 172.21.15.123:0/1454152252 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d8145ed0 0x7fa7d80b5080 unknown :-1 s=CLOSED pgs=2367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:04.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.375+0000 7fa7de5e4640 1 -- 172.21.15.123:0/1454152252 >> 172.21.15.123:0/1454152252 conn(0x7fa7d80ccec0 msgr2=0x7fa7d80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:04.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.375+0000 7fa7de5e4640 1 -- 172.21.15.123:0/1454152252 shutdown_connections 2024-09-15T23:24:04.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.375+0000 7fa7de5e4640 1 -- 172.21.15.123:0/1454152252 wait complete. 2024-09-15T23:24:04.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.376+0000 7fa7de5e4640 1 Processor -- start 2024-09-15T23:24:04.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.376+0000 7fa7de5e4640 1 -- start start 2024-09-15T23:24:04.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.377+0000 7fa7de5e4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7d8073180 0x7fa7d81562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:04.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.377+0000 7fa7de5e4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa7d80b5f90 0x7fa7d8143110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:04.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.377+0000 7fa7de5e4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d8145ed0 0x7fa7d8156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:04.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.377+0000 7fa7de5e4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d81462b0 con 0x7fa7d8145ed0 2024-09-15T23:24:04.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.377+0000 7fa7de5e4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d80b4b60 con 0x7fa7d80b5f90 2024-09-15T23:24:04.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.377+0000 7fa7de5e4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa7d8146430 con 0x7fa7d8073180 2024-09-15T23:24:04.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.377+0000 7fa7dcb81640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d8145ed0 0x7fa7d8156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:04.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.377+0000 7fa7dcb81640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d8145ed0 0x7fa7d8156f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32988/0 (socket says 172.21.15.123:32988) 2024-09-15T23:24:04.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.377+0000 7fa7dcb81640 1 -- 172.21.15.123:0/3347955607 learned_addr learned my addr 172.21.15.123:0/3347955607 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:04.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.377+0000 7fa7d77fe640 1 --2- 172.21.15.123:0/3347955607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa7d80b5f90 0x7fa7d8143110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:04.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.377+0000 7fa7d7fff640 1 --2- 172.21.15.123:0/3347955607 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7d8073180 0x7fa7d81562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:04.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.377+0000 7fa7dcb81640 1 -- 172.21.15.123:0/3347955607 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7d8073180 msgr2=0x7fa7d81562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:04.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.377+0000 7fa7dcb81640 1 --2- 172.21.15.123:0/3347955607 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7d8073180 0x7fa7d81562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:04.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.377+0000 7fa7dcb81640 1 -- 172.21.15.123:0/3347955607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa7d80b5f90 msgr2=0x7fa7d8143110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:04.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.377+0000 7fa7dcb81640 1 --2- 172.21.15.123:0/3347955607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa7d80b5f90 0x7fa7d8143110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:04.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.377+0000 7fa7dcb81640 1 -- 172.21.15.123:0/3347955607 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7d81449c0 con 0x7fa7d8145ed0 2024-09-15T23:24:04.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.377+0000 7fa7dcb81640 1 --2- 172.21.15.123:0/3347955607 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d8145ed0 0x7fa7d8156f10 secure :-1 s=READY pgs=2368 cs=0 l=1 rev1=1 crypto rx=0x7fa7d000caf0 tx=0x7fa7d000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:04.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.377+0000 7fa7d4ff9640 1 -- 172.21.15.123:0/3347955607 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d000aca0 con 0x7fa7d8145ed0 2024-09-15T23:24:04.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.378+0000 7fa7d4ff9640 1 -- 172.21.15.123:0/3347955607 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7d000ae40 con 0x7fa7d8145ed0 2024-09-15T23:24:04.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.378+0000 7fa7de5e4640 1 -- 172.21.15.123:0/3347955607 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7d8143650 con 0x7fa7d8145ed0 2024-09-15T23:24:04.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.378+0000 7fa7d4ff9640 1 -- 172.21.15.123:0/3347955607 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d0012620 con 0x7fa7d8145ed0 2024-09-15T23:24:04.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.378+0000 7fa7de5e4640 1 -- 172.21.15.123:0/3347955607 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7d8143c00 con 0x7fa7d8145ed0 2024-09-15T23:24:04.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.378+0000 7fa7de5e4640 1 -- 172.21.15.123:0/3347955607 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7d80b5080 con 0x7fa7d8145ed0 2024-09-15T23:24:04.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.379+0000 7fa7d4ff9640 1 -- 172.21.15.123:0/3347955607 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa7d0012880 con 0x7fa7d8145ed0 2024-09-15T23:24:04.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.379+0000 7fa7d4ff9640 1 --2- 172.21.15.123:0/3347955607 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa7c406c2b0 0x7fa7c406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:04.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.380+0000 7fa7d4ff9640 1 -- 172.21.15.123:0/3347955607 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(205..205 src has 1..205) ==== 5709+0+0 (secure 0 0 0) 0x7fa7d008b920 con 0x7fa7d8145ed0 2024-09-15T23:24:04.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.380+0000 7fa7d7fff640 1 --2- 172.21.15.123:0/3347955607 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa7c406c2b0 0x7fa7c406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:04.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.380+0000 7fa7d7fff640 1 --2- 172.21.15.123:0/3347955607 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa7c406c2b0 0x7fa7c406e770 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8034000 tx=0x7fa7c802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:04.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.384+0000 7fa7d4ff9640 1 -- 172.21.15.123:0/3347955607 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa7d0059ad0 con 0x7fa7d8145ed0 2024-09-15T23:24:04.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.551+0000 7fa7de5e4640 1 -- 172.21.15.123:0/3347955607 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa7d80cd7d0 con 0x7fa7d8145ed0 2024-09-15T23:24:04.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.552+0000 7fa7d4ff9640 1 -- 172.21.15.123:0/3347955607 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v205) ==== 74+0+16780 (secure 0 0 0) 0x7fa7d005ddd0 con 0x7fa7d8145ed0 2024-09-15T23:24:04.553 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:04.554 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":205,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:24:03.556021+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:24:02.173413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"205","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-09-15T23:24:02.534783+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"205","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:24:04.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.554+0000 7fa7de5e4640 1 -- 172.21.15.123:0/3347955607 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa7c406c2b0 msgr2=0x7fa7c406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:04.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.554+0000 7fa7de5e4640 1 --2- 172.21.15.123:0/3347955607 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa7c406c2b0 0x7fa7c406e770 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8034000 tx=0x7fa7c802e000 comp rx=0 tx=0).stop 2024-09-15T23:24:04.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.554+0000 7fa7de5e4640 1 -- 172.21.15.123:0/3347955607 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d8145ed0 msgr2=0x7fa7d8156f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:04.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.554+0000 7fa7de5e4640 1 --2- 172.21.15.123:0/3347955607 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d8145ed0 0x7fa7d8156f10 secure :-1 s=READY pgs=2368 cs=0 l=1 rev1=1 crypto rx=0x7fa7d000caf0 tx=0x7fa7d000a060 comp rx=0 tx=0).stop 2024-09-15T23:24:04.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.554+0000 7fa7de5e4640 1 -- 172.21.15.123:0/3347955607 shutdown_connections 2024-09-15T23:24:04.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.554+0000 7fa7de5e4640 1 --2- 172.21.15.123:0/3347955607 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa7c406c2b0 0x7fa7c406e770 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:04.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.554+0000 7fa7de5e4640 1 --2- 172.21.15.123:0/3347955607 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7d8145ed0 0x7fa7d8156f10 unknown :-1 s=CLOSED pgs=2368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:04.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.554+0000 7fa7de5e4640 1 --2- 172.21.15.123:0/3347955607 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa7d80b5f90 0x7fa7d8143110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:04.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.554+0000 7fa7de5e4640 1 --2- 172.21.15.123:0/3347955607 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7d8073180 0x7fa7d81562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:04.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.554+0000 7fa7de5e4640 1 -- 172.21.15.123:0/3347955607 >> 172.21.15.123:0/3347955607 conn(0x7fa7d80ccec0 msgr2=0x7fa7d80b56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:04.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.554+0000 7fa7de5e4640 1 -- 172.21.15.123:0/3347955607 shutdown_connections 2024-09-15T23:24:04.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.554+0000 7fa7de5e4640 1 -- 172.21.15.123:0/3347955607 wait complete. 2024-09-15T23:24:04.567 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:24:04.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.664+0000 7f3936bb9640 1 Processor -- start 2024-09-15T23:24:04.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.664+0000 7f3936bb9640 1 -- start start 2024-09-15T23:24:04.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.665+0000 7f3936bb9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f393015ed20 0x7f39300b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:04.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.665+0000 7f3936bb9640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f39300d23b0 0x7f39300b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:04.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.665+0000 7f3936bb9640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f39300cf2d0 0x7f39300cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:04.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.665+0000 7f3936bb9640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f39300d0e70 con 0x7f39300cf2d0 2024-09-15T23:24:04.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.665+0000 7f3936bb9640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f39300d41c0 con 0x7f39300d23b0 2024-09-15T23:24:04.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.665+0000 7f3936bb9640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f39300d35b0 con 0x7f393015ed20 2024-09-15T23:24:04.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.665+0000 7f3935156640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f39300cf2d0 0x7f39300cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:04.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.665+0000 7f3935156640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f39300cf2d0 0x7f39300cf760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:32998/0 (socket says 172.21.15.123:32998) 2024-09-15T23:24:04.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.665+0000 7f3935156640 1 -- 172.21.15.123:0/3314674581 learned_addr learned my addr 172.21.15.123:0/3314674581 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:04.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.666+0000 7f3934955640 1 --2- 172.21.15.123:0/3314674581 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f393015ed20 0x7f39300b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:04.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.666+0000 7f392ffff640 1 --2- 172.21.15.123:0/3314674581 >> v2:172.21.15.188:3300/0 conn(0x7f39300d23b0 0x7f39300b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:04.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.666+0000 7f3935156640 1 -- 172.21.15.123:0/3314674581 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f393015ed20 msgr2=0x7f39300b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:04.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.666+0000 7f3935156640 1 --2- 172.21.15.123:0/3314674581 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f393015ed20 0x7f39300b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:04.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.666+0000 7f3935156640 1 -- 172.21.15.123:0/3314674581 >> v2:172.21.15.188:3300/0 conn(0x7f39300d23b0 msgr2=0x7f39300b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:04.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.666+0000 7f3935156640 1 --2- 172.21.15.123:0/3314674581 >> v2:172.21.15.188:3300/0 conn(0x7f39300d23b0 0x7f39300b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:04.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.666+0000 7f3935156640 1 -- 172.21.15.123:0/3314674581 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39300d3890 con 0x7f39300cf2d0 2024-09-15T23:24:04.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.666+0000 7f392ffff640 1 --2- 172.21.15.123:0/3314674581 >> v2:172.21.15.188:3300/0 conn(0x7f39300d23b0 0x7f39300b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:24:04.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.666+0000 7f3935156640 1 --2- 172.21.15.123:0/3314674581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39300cf2d0 0x7f39300cf760 secure :-1 s=READY pgs=2369 cs=0 l=1 rev1=1 crypto rx=0x7f3930075830 tx=0x7f392802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69fda4faeebfd685 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:04.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.667+0000 7f392f7fe640 1 -- 172.21.15.123:0/3314674581 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3928037070 con 0x7f39300cf2d0 2024-09-15T23:24:04.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.667+0000 7f392f7fe640 1 -- 172.21.15.123:0/3314674581 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3928032440 con 0x7f39300cf2d0 2024-09-15T23:24:04.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.667+0000 7f392f7fe640 1 -- 172.21.15.123:0/3314674581 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3928032810 con 0x7f39300cf2d0 2024-09-15T23:24:04.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.667+0000 7f3936bb9640 1 -- 172.21.15.123:0/3314674581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39300cf2d0 msgr2=0x7f39300cf760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:04.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.667+0000 7f3936bb9640 1 --2- 172.21.15.123:0/3314674581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39300cf2d0 0x7f39300cf760 secure :-1 s=READY pgs=2369 cs=0 l=1 rev1=1 crypto rx=0x7f3930075830 tx=0x7f392802a1e0 comp rx=0 tx=0).stop 2024-09-15T23:24:04.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.667+0000 7f3936bb9640 1 -- 172.21.15.123:0/3314674581 shutdown_connections 2024-09-15T23:24:04.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.667+0000 7f3936bb9640 1 --2- 172.21.15.123:0/3314674581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39300cf2d0 0x7f39300cf760 unknown :-1 s=CLOSED pgs=2369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:04.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.667+0000 7f3936bb9640 1 --2- 172.21.15.123:0/3314674581 >> v2:172.21.15.188:3300/0 conn(0x7f39300d23b0 0x7f39300b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:04.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.667+0000 7f3936bb9640 1 --2- 172.21.15.123:0/3314674581 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f393015ed20 0x7f39300b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:04.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.667+0000 7f3936bb9640 1 -- 172.21.15.123:0/3314674581 >> 172.21.15.123:0/3314674581 conn(0x7f39300d1260 msgr2=0x7f39300d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:04.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.667+0000 7f3936bb9640 1 -- 172.21.15.123:0/3314674581 shutdown_connections 2024-09-15T23:24:04.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.667+0000 7f3936bb9640 1 -- 172.21.15.123:0/3314674581 wait complete. 2024-09-15T23:24:04.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.668+0000 7f3936bb9640 1 Processor -- start 2024-09-15T23:24:04.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.668+0000 7f3936bb9640 1 -- start start 2024-09-15T23:24:04.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.669+0000 7f3936bb9640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39300cf2d0 0x7f3930154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:04.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.669+0000 7f3936bb9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39300d23b0 0x7f39300ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:04.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.669+0000 7f3936bb9640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f393015ed20 0x7f3930161980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:04.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.669+0000 7f3936bb9640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f39300d32a0 con 0x7f39300d23b0 2024-09-15T23:24:04.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.669+0000 7f3936bb9640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f39300d3e50 con 0x7f393015ed20 2024-09-15T23:24:04.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.669+0000 7f3936bb9640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f393015f100 con 0x7f39300cf2d0 2024-09-15T23:24:04.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.669+0000 7f392ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39300d23b0 0x7f39300ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:04.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.669+0000 7f392ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39300d23b0 0x7f39300ce4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33006/0 (socket says 172.21.15.123:33006) 2024-09-15T23:24:04.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.669+0000 7f392ffff640 1 -- 172.21.15.123:0/2247347421 learned_addr learned my addr 172.21.15.123:0/2247347421 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:04.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.670+0000 7f392ffff640 1 -- 172.21.15.123:0/2247347421 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39300cf2d0 msgr2=0x7f3930154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:04.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.670+0000 7f392ffff640 1 --2- 172.21.15.123:0/2247347421 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39300cf2d0 0x7f3930154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:04.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.670+0000 7f392ffff640 1 -- 172.21.15.123:0/2247347421 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f393015ed20 msgr2=0x7f3930161980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:04.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.670+0000 7f392ffff640 1 --2- 172.21.15.123:0/2247347421 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f393015ed20 0x7f3930161980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:04.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.670+0000 7f392ffff640 1 -- 172.21.15.123:0/2247347421 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39301553e0 con 0x7f39300d23b0 2024-09-15T23:24:04.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.670+0000 7f392ffff640 1 --2- 172.21.15.123:0/2247347421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39300d23b0 0x7f39300ce4b0 secure :-1 s=READY pgs=2370 cs=0 l=1 rev1=1 crypto rx=0x7f3924007e80 tx=0x7f392400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:04.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.670+0000 7f392d7fa640 1 -- 172.21.15.123:0/2247347421 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3924014620 con 0x7f39300d23b0 2024-09-15T23:24:04.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.670+0000 7f392d7fa640 1 -- 172.21.15.123:0/2247347421 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3924019070 con 0x7f39300d23b0 2024-09-15T23:24:04.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.670+0000 7f3936bb9640 1 -- 172.21.15.123:0/2247347421 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3930156700 con 0x7f39300d23b0 2024-09-15T23:24:04.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.670+0000 7f392d7fa640 1 -- 172.21.15.123:0/2247347421 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3924014a00 con 0x7f39300d23b0 2024-09-15T23:24:04.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.670+0000 7f3936bb9640 1 -- 172.21.15.123:0/2247347421 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3930156fa0 con 0x7f39300d23b0 2024-09-15T23:24:04.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.671+0000 7f3936bb9640 1 -- 172.21.15.123:0/2247347421 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39300b7010 con 0x7f39300d23b0 2024-09-15T23:24:04.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.671+0000 7f392d7fa640 1 -- 172.21.15.123:0/2247347421 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3924014ba0 con 0x7f39300d23b0 2024-09-15T23:24:04.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.672+0000 7f392d7fa640 1 --2- 172.21.15.123:0/2247347421 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f391c06c2e0 0x7f391c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:04.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.672+0000 7f392d7fa640 1 -- 172.21.15.123:0/2247347421 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(205..205 src has 1..205) ==== 5709+0+0 (secure 0 0 0) 0x7f392408bd60 con 0x7f39300d23b0 2024-09-15T23:24:04.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.672+0000 7f3934955640 1 --2- 172.21.15.123:0/2247347421 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f391c06c2e0 0x7f391c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:04.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.673+0000 7f3934955640 1 --2- 172.21.15.123:0/2247347421 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f391c06c2e0 0x7f391c06e7a0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f3920006fd0 tx=0x7f3920008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:04.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.676+0000 7f392d7fa640 1 -- 172.21.15.123:0/2247347421 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3924059df0 con 0x7f39300d23b0 2024-09-15T23:24:04.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.841+0000 7f3936bb9640 1 -- 172.21.15.123:0/2247347421 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f39300b3f20 con 0x7f39300d23b0 2024-09-15T23:24:04.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.842+0000 7f392d7fa640 1 -- 172.21.15.123:0/2247347421 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v205) ==== 74+0+16780 (secure 0 0 0) 0x7f392405e0f0 con 0x7f39300d23b0 2024-09-15T23:24:04.843 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:04.844 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":205,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:24:03.556021+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:24:02.173413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"205","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-09-15T23:24:02.534783+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"205","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:24:04.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.844+0000 7f3936bb9640 1 -- 172.21.15.123:0/2247347421 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f391c06c2e0 msgr2=0x7f391c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:04.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.844+0000 7f3936bb9640 1 --2- 172.21.15.123:0/2247347421 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f391c06c2e0 0x7f391c06e7a0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f3920006fd0 tx=0x7f3920008040 comp rx=0 tx=0).stop 2024-09-15T23:24:04.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.844+0000 7f3936bb9640 1 -- 172.21.15.123:0/2247347421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39300d23b0 msgr2=0x7f39300ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:04.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.844+0000 7f3936bb9640 1 --2- 172.21.15.123:0/2247347421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39300d23b0 0x7f39300ce4b0 secure :-1 s=READY pgs=2370 cs=0 l=1 rev1=1 crypto rx=0x7f3924007e80 tx=0x7f392400e4b0 comp rx=0 tx=0).stop 2024-09-15T23:24:04.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.844+0000 7f3936bb9640 1 -- 172.21.15.123:0/2247347421 shutdown_connections 2024-09-15T23:24:04.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.844+0000 7f3936bb9640 1 --2- 172.21.15.123:0/2247347421 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f393015ed20 0x7f3930161980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:04.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.844+0000 7f3936bb9640 1 --2- 172.21.15.123:0/2247347421 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f391c06c2e0 0x7f391c06e7a0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:04.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.844+0000 7f3936bb9640 1 --2- 172.21.15.123:0/2247347421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39300d23b0 0x7f39300ce4b0 unknown :-1 s=CLOSED pgs=2370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:04.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.844+0000 7f3936bb9640 1 --2- 172.21.15.123:0/2247347421 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f39300cf2d0 0x7f3930154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:04.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.844+0000 7f3936bb9640 1 -- 172.21.15.123:0/2247347421 >> 172.21.15.123:0/2247347421 conn(0x7f39300d1260 msgr2=0x7f39300b58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:04.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.844+0000 7f3936bb9640 1 -- 172.21.15.123:0/2247347421 shutdown_connections 2024-09-15T23:24:04.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.844+0000 7f3936bb9640 1 -- 172.21.15.123:0/2247347421 wait complete. 2024-09-15T23:24:04.857 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T23:24:04.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.957+0000 7f0c3df2c640 1 Processor -- start 2024-09-15T23:24:04.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.958+0000 7f0c3df2c640 1 -- start start 2024-09-15T23:24:04.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.958+0000 7f0c3df2c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f0c380732e0 0x7f0c380736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:04.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.958+0000 7f0c3df2c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0c380cce30 0x7f0c380cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:04.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.958+0000 7f0c3df2c640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c380714b0 con 0x7f0c38071c70 2024-09-15T23:24:04.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.958+0000 7f0c3df2c640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f0c38073c00 con 0x7f0c380cce30 2024-09-15T23:24:04.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.958+0000 7f0c3df2c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f0c380cd880 con 0x7f0c380732e0 2024-09-15T23:24:04.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.959+0000 7f0c36ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0c380cce30 0x7f0c380cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:04.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.959+0000 7f0c37fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f0c38071c70 0x7f0c3815c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:57448/0 (socket says 172.21.15.123:57448) 2024-09-15T23:24:04.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.959+0000 7f0c37fff640 1 -- 172.21.15.123:0/1320216456 learned_addr learned my addr 172.21.15.123:0/1320216456 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:04.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.959+0000 7f0c36ffd640 1 -- 172.21.15.123:0/1320216456 >> v2:172.21.15.188:3300/0 conn(0x7f0c380732e0 msgr2=0x7f0c380736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:04.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.959+0000 7f0c377fe640 1 --2- 172.21.15.123:0/1320216456 >> v2:172.21.15.188:3300/0 conn(0x7f0c380732e0 0x7f0c380736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:04.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.959+0000 7f0c36ffd640 1 --2- 172.21.15.123:0/1320216456 >> v2:172.21.15.188:3300/0 conn(0x7f0c380732e0 0x7f0c380736c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:04.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.959+0000 7f0c367fc640 1 -- 172.21.15.123:0/1320216456 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1886681879 0 0) 0x7f0c380714b0 con 0x7f0c38071c70 2024-09-15T23:24:04.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.959+0000 7f0c36ffd640 1 -- 172.21.15.123:0/1320216456 >> v1:172.21.15.123:6789/0 conn(0x7f0c38071c70 legacy=0x7f0c3815c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:04.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.959+0000 7f0c36ffd640 1 -- 172.21.15.123:0/1320216456 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c380cdb60 con 0x7f0c380cce30 2024-09-15T23:24:04.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.960+0000 7f0c36ffd640 1 --2- 172.21.15.123:0/1320216456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c380cce30 0x7f0c380cd2a0 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 crypto rx=0x7f0c380b6780 tx=0x7f0c2c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c83210237cbdf10 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:04.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.960+0000 7f0c367fc640 1 -- 172.21.15.123:0/1320216456 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c037070 con 0x7f0c380cce30 2024-09-15T23:24:04.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.960+0000 7f0c367fc640 1 -- 172.21.15.123:0/1320216456 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c2c032440 con 0x7f0c380cce30 2024-09-15T23:24:04.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.960+0000 7f0c367fc640 1 -- 172.21.15.123:0/1320216456 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c02ae60 con 0x7f0c380cce30 2024-09-15T23:24:04.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.960+0000 7f0c3df2c640 1 -- 172.21.15.123:0/1320216456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c380cce30 msgr2=0x7f0c380cd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:04.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.960+0000 7f0c3df2c640 1 --2- 172.21.15.123:0/1320216456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c380cce30 0x7f0c380cd2a0 secure :-1 s=READY pgs=2372 cs=0 l=1 rev1=1 crypto rx=0x7f0c380b6780 tx=0x7f0c2c02a110 comp rx=0 tx=0).stop 2024-09-15T23:24:04.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.960+0000 7f0c3df2c640 1 -- 172.21.15.123:0/1320216456 shutdown_connections 2024-09-15T23:24:04.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.960+0000 7f0c3df2c640 1 --2- 172.21.15.123:0/1320216456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c380cce30 0x7f0c380cd2a0 unknown :-1 s=CLOSED pgs=2372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:04.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.960+0000 7f0c3df2c640 1 --2- 172.21.15.123:0/1320216456 >> v2:172.21.15.188:3300/0 conn(0x7f0c380732e0 0x7f0c380736c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:04.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.960+0000 7f0c3df2c640 1 -- 172.21.15.123:0/1320216456 >> 172.21.15.123:0/1320216456 conn(0x7f0c3806d0f0 msgr2=0x7f0c3806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:04.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.960+0000 7f0c3df2c640 1 -- 172.21.15.123:0/1320216456 shutdown_connections 2024-09-15T23:24:04.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.960+0000 7f0c3df2c640 1 -- 172.21.15.123:0/1320216456 wait complete. 2024-09-15T23:24:04.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.961+0000 7f0c3df2c640 1 Processor -- start 2024-09-15T23:24:04.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.962+0000 7f0c3df2c640 1 -- start start 2024-09-15T23:24:04.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.962+0000 7f0c3df2c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c38071c70 0x7f0c3814bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:04.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.962+0000 7f0c3df2c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c380732e0 0x7f0c380cc050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:04.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.962+0000 7f0c3df2c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c380cce30 0x7f0c3814d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:04.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.962+0000 7f0c3df2c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0c3806bf70 con 0x7f0c380cce30 2024-09-15T23:24:04.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.962+0000 7f0c3df2c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0c3806bdf0 con 0x7f0c38071c70 2024-09-15T23:24:04.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.962+0000 7f0c3df2c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0c3815cfe0 con 0x7f0c380732e0 2024-09-15T23:24:04.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.962+0000 7f0c37fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c380cce30 0x7f0c3814d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:04.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.962+0000 7f0c37fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c380cce30 0x7f0c3814d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33028/0 (socket says 172.21.15.123:33028) 2024-09-15T23:24:04.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.963+0000 7f0c37fff640 1 -- 172.21.15.123:0/52807478 learned_addr learned my addr 172.21.15.123:0/52807478 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:04.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.963+0000 7f0c377fe640 1 --2- 172.21.15.123:0/52807478 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c38071c70 0x7f0c3814bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:04.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.963+0000 7f0c37fff640 1 -- 172.21.15.123:0/52807478 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c380732e0 msgr2=0x7f0c380cc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:04.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.963+0000 7f0c36ffd640 1 --2- 172.21.15.123:0/52807478 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c380732e0 0x7f0c380cc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:04.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.963+0000 7f0c37fff640 1 --2- 172.21.15.123:0/52807478 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c380732e0 0x7f0c380cc050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:04.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.963+0000 7f0c37fff640 1 -- 172.21.15.123:0/52807478 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c38071c70 msgr2=0x7f0c3814bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:04.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.963+0000 7f0c37fff640 1 --2- 172.21.15.123:0/52807478 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c38071c70 0x7f0c3814bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:04.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.963+0000 7f0c37fff640 1 -- 172.21.15.123:0/52807478 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c3814c4d0 con 0x7f0c380cce30 2024-09-15T23:24:04.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.963+0000 7f0c377fe640 1 --2- 172.21.15.123:0/52807478 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c38071c70 0x7f0c3814bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:24:04.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.963+0000 7f0c37fff640 1 --2- 172.21.15.123:0/52807478 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c380cce30 0x7f0c3814d810 secure :-1 s=READY pgs=2373 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000c7a0 tx=0x7f0c3000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:04.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.963+0000 7f0c1ffff640 1 -- 172.21.15.123:0/52807478 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c30018070 con 0x7f0c380cce30 2024-09-15T23:24:04.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.963+0000 7f0c1ffff640 1 -- 172.21.15.123:0/52807478 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c3000a640 con 0x7f0c380cce30 2024-09-15T23:24:04.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.963+0000 7f0c1ffff640 1 -- 172.21.15.123:0/52807478 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3000aa70 con 0x7f0c380cce30 2024-09-15T23:24:04.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.963+0000 7f0c3df2c640 1 -- 172.21.15.123:0/52807478 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c3814c770 con 0x7f0c380cce30 2024-09-15T23:24:04.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.963+0000 7f0c3df2c640 1 -- 172.21.15.123:0/52807478 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c3814cd30 con 0x7f0c380cce30 2024-09-15T23:24:04.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.964+0000 7f0c3df2c640 1 -- 172.21.15.123:0/52807478 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c3815d370 con 0x7f0c380cce30 2024-09-15T23:24:04.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.964+0000 7f0c1ffff640 1 -- 172.21.15.123:0/52807478 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0c3001b070 con 0x7f0c380cce30 2024-09-15T23:24:04.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.965+0000 7f0c1ffff640 1 --2- 172.21.15.123:0/52807478 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0c2406c2b0 0x7f0c2406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:04.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.965+0000 7f0c1ffff640 1 -- 172.21.15.123:0/52807478 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(205..205 src has 1..205) ==== 5709+0+0 (secure 0 0 0) 0x7f0c3008aa90 con 0x7f0c380cce30 2024-09-15T23:24:04.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.965+0000 7f0c377fe640 1 --2- 172.21.15.123:0/52807478 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0c2406c2b0 0x7f0c2406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:04.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.966+0000 7f0c377fe640 1 --2- 172.21.15.123:0/52807478 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0c2406c2b0 0x7f0c2406e770 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f0c28008890 tx=0x7f0c28008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:04.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:04.969+0000 7f0c1ffff640 1 -- 172.21.15.123:0/52807478 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0c30059200 con 0x7f0c380cce30 2024-09-15T23:24:05.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.168+0000 7f0c3df2c640 1 -- 172.21.15.123:0/52807478 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f0c380711f0 con 0x7f0c380cce30 2024-09-15T23:24:05.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.330+0000 7f0c1ffff640 1 -- 172.21.15.123:0/52807478 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v126) ==== 118+0+0 (secure 0 0 0) 0x7f0c30058b00 con 0x7f0c380cce30 2024-09-15T23:24:05.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.332+0000 7f0c3df2c640 1 -- 172.21.15.123:0/52807478 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0c2406c2b0 msgr2=0x7f0c2406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:05.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.332+0000 7f0c3df2c640 1 --2- 172.21.15.123:0/52807478 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0c2406c2b0 0x7f0c2406e770 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f0c28008890 tx=0x7f0c28008040 comp rx=0 tx=0).stop 2024-09-15T23:24:05.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.332+0000 7f0c3df2c640 1 -- 172.21.15.123:0/52807478 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c380cce30 msgr2=0x7f0c3814d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:05.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.332+0000 7f0c3df2c640 1 --2- 172.21.15.123:0/52807478 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c380cce30 0x7f0c3814d810 secure :-1 s=READY pgs=2373 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000c7a0 tx=0x7f0c3000cc60 comp rx=0 tx=0).stop 2024-09-15T23:24:05.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.332+0000 7f0c3df2c640 1 -- 172.21.15.123:0/52807478 shutdown_connections 2024-09-15T23:24:05.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.332+0000 7f0c3df2c640 1 --2- 172.21.15.123:0/52807478 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0c2406c2b0 0x7f0c2406e770 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:05.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.332+0000 7f0c3df2c640 1 --2- 172.21.15.123:0/52807478 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c380cce30 0x7f0c3814d810 unknown :-1 s=CLOSED pgs=2373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:05.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.332+0000 7f0c3df2c640 1 --2- 172.21.15.123:0/52807478 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0c380732e0 0x7f0c380cc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:05.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.332+0000 7f0c3df2c640 1 --2- 172.21.15.123:0/52807478 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0c38071c70 0x7f0c3814bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:05.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.332+0000 7f0c3df2c640 1 -- 172.21.15.123:0/52807478 >> 172.21.15.123:0/52807478 conn(0x7f0c3806d0f0 msgr2=0x7f0c38072990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:05.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.333+0000 7f0c3df2c640 1 -- 172.21.15.123:0/52807478 shutdown_connections 2024-09-15T23:24:05.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.333+0000 7f0c3df2c640 1 -- 172.21.15.123:0/52807478 wait complete. 2024-09-15T23:24:05.345 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T23:24:05.345 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T23:24:05.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.446+0000 7f8627a65640 1 Processor -- start 2024-09-15T23:24:05.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.446+0000 7f8627a65640 1 -- start start 2024-09-15T23:24:05.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.447+0000 7f8627a65640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f862015c7f0 0x7f86200b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:05.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.447+0000 7f8627a65640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f86200b1c30 0x7f86200730f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:05.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.447+0000 7f8627a65640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f862015cbd0 con 0x7f8620073630 2024-09-15T23:24:05.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.447+0000 7f8627a65640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f86200cecf0 con 0x7f86200b1c30 2024-09-15T23:24:05.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.447+0000 7f8627a65640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8620070470 con 0x7f862015c7f0 2024-09-15T23:24:05.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.447+0000 7f8625000640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f86200b1c30 0x7f86200730f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:05.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.447+0000 7f8625000640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f86200b1c30 0x7f86200730f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:56422/0 (socket says 172.21.15.123:56422) 2024-09-15T23:24:05.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.447+0000 7f8625000640 1 -- 172.21.15.123:0/908213880 learned_addr learned my addr 172.21.15.123:0/908213880 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:05.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.447+0000 7f8625801640 1 --2- 172.21.15.123:0/908213880 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f862015c7f0 0x7f86200b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:05.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.447+0000 7f8625000640 1 -- 172.21.15.123:0/908213880 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f862015c7f0 msgr2=0x7f86200b16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:05.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.447+0000 7f8625000640 1 --2- 172.21.15.123:0/908213880 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f862015c7f0 0x7f86200b16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:05.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.447+0000 7f8625000640 1 -- 172.21.15.123:0/908213880 >> v1:172.21.15.188:6789/0 conn(0x7f8620073630 legacy=0x7f86200d0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:05.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.447+0000 7f8625000640 1 -- 172.21.15.123:0/908213880 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86200ce0e0 con 0x7f86200b1c30 2024-09-15T23:24:05.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.448+0000 7f8625000640 1 --2- 172.21.15.123:0/908213880 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86200b1c30 0x7f86200730f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f8614009e50 tx=0x7f861402a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d3c7c31470b5594 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:05.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.448+0000 7f861ffff640 1 -- 172.21.15.123:0/908213880 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8614036070 con 0x7f86200b1c30 2024-09-15T23:24:05.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.448+0000 7f861ffff640 1 -- 172.21.15.123:0/908213880 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8614031600 con 0x7f86200b1c30 2024-09-15T23:24:05.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.448+0000 7f861ffff640 1 -- 172.21.15.123:0/908213880 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86140319d0 con 0x7f86200b1c30 2024-09-15T23:24:05.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.449+0000 7f8627a65640 1 -- 172.21.15.123:0/908213880 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86200b1c30 msgr2=0x7f86200730f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:05.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.449+0000 7f8627a65640 1 --2- 172.21.15.123:0/908213880 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86200b1c30 0x7f86200730f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f8614009e50 tx=0x7f861402a710 comp rx=0 tx=0).stop 2024-09-15T23:24:05.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.449+0000 7f8627a65640 1 -- 172.21.15.123:0/908213880 shutdown_connections 2024-09-15T23:24:05.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.449+0000 7f8627a65640 1 --2- 172.21.15.123:0/908213880 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86200b1c30 0x7f86200730f0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:05.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.449+0000 7f8627a65640 1 --2- 172.21.15.123:0/908213880 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f862015c7f0 0x7f86200b16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:05.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.449+0000 7f8627a65640 1 -- 172.21.15.123:0/908213880 >> 172.21.15.123:0/908213880 conn(0x7f86200d2570 msgr2=0x7f86200d2980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:05.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.449+0000 7f8627a65640 1 -- 172.21.15.123:0/908213880 shutdown_connections 2024-09-15T23:24:05.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.449+0000 7f8627a65640 1 -- 172.21.15.123:0/908213880 wait complete. 2024-09-15T23:24:05.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.450+0000 7f8627a65640 1 Processor -- start 2024-09-15T23:24:05.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.450+0000 7f8627a65640 1 -- start start 2024-09-15T23:24:05.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.451+0000 7f8627a65640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8620073630 0x7f8620152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:05.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.451+0000 7f8627a65640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86200b1c30 0x7f86201f2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:05.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.451+0000 7f8627a65640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f862015c7f0 0x7f862015d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:05.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.451+0000 7f8627a65640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f86200ce980 con 0x7f862015c7f0 2024-09-15T23:24:05.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.451+0000 7f8627a65640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f86200ce6a0 con 0x7f86200b1c30 2024-09-15T23:24:05.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.451+0000 7f8627a65640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f86200b5440 con 0x7f8620073630 2024-09-15T23:24:05.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.451+0000 7f8626002640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f862015c7f0 0x7f862015d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:05.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.451+0000 7f8626002640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f862015c7f0 0x7f862015d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33032/0 (socket says 172.21.15.123:33032) 2024-09-15T23:24:05.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.451+0000 7f8626002640 1 -- 172.21.15.123:0/279525051 learned_addr learned my addr 172.21.15.123:0/279525051 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:05.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.451+0000 7f8625000640 1 --2- 172.21.15.123:0/279525051 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86200b1c30 0x7f86201f2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:05.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.451+0000 7f8625801640 1 --2- 172.21.15.123:0/279525051 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8620073630 0x7f8620152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:05.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.452+0000 7f8626002640 1 -- 172.21.15.123:0/279525051 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8620073630 msgr2=0x7f8620152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:05.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.452+0000 7f8626002640 1 --2- 172.21.15.123:0/279525051 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8620073630 0x7f8620152120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:05.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.452+0000 7f8626002640 1 -- 172.21.15.123:0/279525051 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86200b1c30 msgr2=0x7f86201f2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:05.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.452+0000 7f8626002640 1 --2- 172.21.15.123:0/279525051 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86200b1c30 0x7f86201f2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:05.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.452+0000 7f8626002640 1 -- 172.21.15.123:0/279525051 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86200caab0 con 0x7f862015c7f0 2024-09-15T23:24:05.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.452+0000 7f8626002640 1 --2- 172.21.15.123:0/279525051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f862015c7f0 0x7f862015d7d0 secure :-1 s=READY pgs=2374 cs=0 l=1 rev1=1 crypto rx=0x7f861000c3c0 tx=0x7f861000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:05.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.452+0000 7f861dffb640 1 -- 172.21.15.123:0/279525051 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8610017070 con 0x7f862015c7f0 2024-09-15T23:24:05.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.452+0000 7f861dffb640 1 -- 172.21.15.123:0/279525051 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86100052d0 con 0x7f862015c7f0 2024-09-15T23:24:05.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.452+0000 7f8627a65640 1 -- 172.21.15.123:0/279525051 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86200cad90 con 0x7f862015c7f0 2024-09-15T23:24:05.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.452+0000 7f861dffb640 1 -- 172.21.15.123:0/279525051 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8610003810 con 0x7f862015c7f0 2024-09-15T23:24:05.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.452+0000 7f8627a65640 1 -- 172.21.15.123:0/279525051 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86200cb350 con 0x7f862015c7f0 2024-09-15T23:24:05.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.453+0000 7f8627a65640 1 -- 172.21.15.123:0/279525051 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86200cdd00 con 0x7f862015c7f0 2024-09-15T23:24:05.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.454+0000 7f861dffb640 1 -- 172.21.15.123:0/279525051 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f861001a070 con 0x7f862015c7f0 2024-09-15T23:24:05.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.454+0000 7f861dffb640 1 --2- 172.21.15.123:0/279525051 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f860c06c2b0 0x7f860c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:05.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.454+0000 7f861dffb640 1 -- 172.21.15.123:0/279525051 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 5709+0+0 (secure 0 0 0) 0x7f861008a690 con 0x7f862015c7f0 2024-09-15T23:24:05.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.455+0000 7f8625801640 1 --2- 172.21.15.123:0/279525051 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f860c06c2b0 0x7f860c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:05.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.455+0000 7f8625801640 1 --2- 172.21.15.123:0/279525051 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f860c06c2b0 0x7f860c06e770 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f8620160200 tx=0x7f8618009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:05.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.459+0000 7f861dffb640 1 -- 172.21.15.123:0/279525051 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f86100587b0 con 0x7f862015c7f0 2024-09-15T23:24:05.489 INFO:tasks.ceph.mds.c.smithi123.stderr:2024-09-15T23:24:05.488+0000 7ff858d42640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:24:05.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:05.657+0000 7f8627a65640 1 -- 172.21.15.123:0/279525051 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f86200c9380 con 0x7f862015c7f0 2024-09-15T23:24:06.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.336+0000 7f861dffb640 1 -- 172.21.15.123:0/279525051 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v127) ==== 122+0+0 (secure 0 0 0) 0x7f861005cab0 con 0x7f862015c7f0 2024-09-15T23:24:06.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.339+0000 7f8627a65640 1 -- 172.21.15.123:0/279525051 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f860c06c2b0 msgr2=0x7f860c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:06.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.339+0000 7f8627a65640 1 --2- 172.21.15.123:0/279525051 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f860c06c2b0 0x7f860c06e770 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f8620160200 tx=0x7f8618009190 comp rx=0 tx=0).stop 2024-09-15T23:24:06.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.339+0000 7f8627a65640 1 -- 172.21.15.123:0/279525051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f862015c7f0 msgr2=0x7f862015d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:06.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.339+0000 7f8627a65640 1 --2- 172.21.15.123:0/279525051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f862015c7f0 0x7f862015d7d0 secure :-1 s=READY pgs=2374 cs=0 l=1 rev1=1 crypto rx=0x7f861000c3c0 tx=0x7f861000c880 comp rx=0 tx=0).stop 2024-09-15T23:24:06.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.339+0000 7f8627a65640 1 -- 172.21.15.123:0/279525051 shutdown_connections 2024-09-15T23:24:06.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.339+0000 7f8627a65640 1 --2- 172.21.15.123:0/279525051 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f860c06c2b0 0x7f860c06e770 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:06.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.339+0000 7f8627a65640 1 --2- 172.21.15.123:0/279525051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f862015c7f0 0x7f862015d7d0 unknown :-1 s=CLOSED pgs=2374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:06.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.339+0000 7f8627a65640 1 --2- 172.21.15.123:0/279525051 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f86200b1c30 0x7f86201f2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:06.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.339+0000 7f8627a65640 1 --2- 172.21.15.123:0/279525051 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8620073630 0x7f8620152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:06.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.339+0000 7f8627a65640 1 -- 172.21.15.123:0/279525051 >> 172.21.15.123:0/279525051 conn(0x7f86200d2570 msgr2=0x7f86200b2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:06.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.339+0000 7f8627a65640 1 -- 172.21.15.123:0/279525051 shutdown_connections 2024-09-15T23:24:06.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.339+0000 7f8627a65640 1 -- 172.21.15.123:0/279525051 wait complete. 2024-09-15T23:24:06.351 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T23:24:06.352 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:24:06.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.449+0000 7f1ddf0f1640 1 Processor -- start 2024-09-15T23:24:06.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.449+0000 7f1ddf0f1640 1 -- start start 2024-09-15T23:24:06.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.450+0000 7f1ddf0f1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1dd80720b0 0x7f1dd815b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:06.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.450+0000 7f1ddf0f1640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dd8072500 con 0x7f1dd806c6a0 2024-09-15T23:24:06.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.450+0000 7f1ddf0f1640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dd8071010 con 0x7f1dd815ab40 2024-09-15T23:24:06.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.450+0000 7f1ddf0f1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1dd806cb10 con 0x7f1dd80720b0 2024-09-15T23:24:06.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.450+0000 7f1dcffff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1dd806c6a0 0x7f1dd815af20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39152/0 (socket says 172.21.15.123:39152) 2024-09-15T23:24:06.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.450+0000 7f1dcffff640 1 -- 172.21.15.123:0/3075637240 learned_addr learned my addr 172.21.15.123:0/3075637240 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:06.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.450+0000 7f1ddd68e640 1 --2- 172.21.15.123:0/3075637240 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1dd80720b0 0x7f1dd815b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:06.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.450+0000 7f1dcf7fe640 1 -- 172.21.15.123:0/3075637240 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3111363391 0 0) 0x7f1dd8072500 con 0x7f1dd806c6a0 2024-09-15T23:24:06.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.450+0000 7f1dcf7fe640 1 -- 172.21.15.123:0/3075637240 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1dc0003520 con 0x7f1dd806c6a0 2024-09-15T23:24:06.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.450+0000 7f1dcf7fe640 1 -- 172.21.15.123:0/3075637240 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2594888576 0 0) 0x7f1dd8071010 con 0x7f1dd815ab40 2024-09-15T23:24:06.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.450+0000 7f1dcf7fe640 1 -- 172.21.15.123:0/3075637240 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1dd8072500 con 0x7f1dd815ab40 2024-09-15T23:24:06.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.450+0000 7f1dcf7fe640 1 -- 172.21.15.123:0/3075637240 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4136350049 0 0) 0x7f1dc0003520 con 0x7f1dd806c6a0 2024-09-15T23:24:06.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.450+0000 7f1dcf7fe640 1 -- 172.21.15.123:0/3075637240 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1dd80720b0 msgr2=0x7f1dd815b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:06.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.450+0000 7f1dcf7fe640 1 --2- 172.21.15.123:0/3075637240 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1dd80720b0 0x7f1dd815b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:06.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.450+0000 7f1dcf7fe640 1 -- 172.21.15.123:0/3075637240 >> v1:172.21.15.188:6789/0 conn(0x7f1dd815ab40 legacy=0x7f1dd8073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:06.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.450+0000 7f1dcf7fe640 1 -- 172.21.15.123:0/3075637240 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dd80712f0 con 0x7f1dd806c6a0 2024-09-15T23:24:06.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.450+0000 7f1dcf7fe640 1 -- 172.21.15.123:0/3075637240 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f1dc8001690 con 0x7f1dd806c6a0 2024-09-15T23:24:06.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.450+0000 7f1dcf7fe640 1 -- 172.21.15.123:0/3075637240 >> v1:172.21.15.123:6789/0 conn(0x7f1dd806c6a0 legacy=0x7f1dd815af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:06.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.450+0000 7f1dcf7fe640 1 --2- 172.21.15.123:0/3075637240 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1dc0003b70 0x7f1dc0003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:06.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.450+0000 7f1dcf7fe640 1 --2- 172.21.15.123:0/3075637240 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1dc0004800 0x7f1dc0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:06.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.450+0000 7f1dcf7fe640 1 --2- 172.21.15.123:0/3075637240 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1dc00051c0 0x7f1dc000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:06.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.451+0000 7f1dcf7fe640 1 -- 172.21.15.123:0/3075637240 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc000c000 con 0x7f1dc0003b70 2024-09-15T23:24:06.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.451+0000 7f1dcf7fe640 1 -- 172.21.15.123:0/3075637240 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc000c1b0 con 0x7f1dc0004800 2024-09-15T23:24:06.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.451+0000 7f1dcf7fe640 1 -- 172.21.15.123:0/3075637240 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1dc000c3b0 con 0x7f1dc00051c0 2024-09-15T23:24:06.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.451+0000 7f1ddd68e640 1 --2- 172.21.15.123:0/3075637240 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1dd80720b0 0x7f1dd815b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:24:06.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.451+0000 7f1ddce8d640 1 --2- 172.21.15.123:0/3075637240 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1dc0003b70 0x7f1dc0003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:06.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.451+0000 7f1dcffff640 1 --2- 172.21.15.123:0/3075637240 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1dc0004800 0x7f1dc0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:06.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.451+0000 7f1ddd68e640 1 --2- 172.21.15.123:0/3075637240 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1dc00051c0 0x7f1dc000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:06.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.451+0000 7f1ddce8d640 1 -- 172.21.15.123:0/3075637240 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1dc00051c0 msgr2=0x7f1dc000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:06.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.451+0000 7f1ddce8d640 1 --2- 172.21.15.123:0/3075637240 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1dc00051c0 0x7f1dc000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:06.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.451+0000 7f1ddce8d640 1 -- 172.21.15.123:0/3075637240 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1dc0004800 msgr2=0x7f1dc0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:06.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.451+0000 7f1ddce8d640 1 --2- 172.21.15.123:0/3075637240 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1dc0004800 0x7f1dc0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:06.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.451+0000 7f1ddce8d640 1 -- 172.21.15.123:0/3075637240 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc0003520 con 0x7f1dc0003b70 2024-09-15T23:24:06.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.452+0000 7f1ddce8d640 1 --2- 172.21.15.123:0/3075637240 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1dc0003b70 0x7f1dc0003f70 secure :-1 s=READY pgs=2376 cs=0 l=1 rev1=1 crypto rx=0x7f1dd40018c0 tx=0x7f1dc0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7e6ee6b34c46558 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:06.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.452+0000 7f1dcf7fe640 1 -- 172.21.15.123:0/3075637240 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd40014e0 con 0x7f1dc0003b70 2024-09-15T23:24:06.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.452+0000 7f1dcf7fe640 1 -- 172.21.15.123:0/3075637240 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dd40052f0 con 0x7f1dc0003b70 2024-09-15T23:24:06.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.452+0000 7f1dcf7fe640 1 -- 172.21.15.123:0/3075637240 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd402ac90 con 0x7f1dc0003b70 2024-09-15T23:24:06.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.452+0000 7f1ddf0f1640 1 -- 172.21.15.123:0/3075637240 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1dc0003b70 msgr2=0x7f1dc0003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:06.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.452+0000 7f1ddf0f1640 1 --2- 172.21.15.123:0/3075637240 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1dc0003b70 0x7f1dc0003f70 secure :-1 s=READY pgs=2376 cs=0 l=1 rev1=1 crypto rx=0x7f1dd40018c0 tx=0x7f1dc0005830 comp rx=0 tx=0).stop 2024-09-15T23:24:06.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.452+0000 7f1ddd68e640 1 -- 172.21.15.123:0/3075637240 reap_dead start 2024-09-15T23:24:06.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.452+0000 7f1ddf0f1640 1 -- 172.21.15.123:0/3075637240 shutdown_connections 2024-09-15T23:24:06.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.452+0000 7f1ddf0f1640 1 -- 172.21.15.123:0/3075637240 >> 172.21.15.123:0/3075637240 conn(0x7f1dd80ccec0 msgr2=0x7f1dd80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:06.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.452+0000 7f1ddf0f1640 1 -- 172.21.15.123:0/3075637240 shutdown_connections 2024-09-15T23:24:06.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.452+0000 7f1ddf0f1640 1 -- 172.21.15.123:0/3075637240 wait complete. 2024-09-15T23:24:06.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.453+0000 7f1ddf0f1640 1 Processor -- start 2024-09-15T23:24:06.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.453+0000 7f1ddf0f1640 1 -- start start 2024-09-15T23:24:06.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.454+0000 7f1ddf0f1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1dc0003b70 0x7f1dd80af930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:06.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.454+0000 7f1ddf0f1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1dd80b2410 0x7f1dd80c95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:06.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.454+0000 7f1ddf0f1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1dd80b2870 0x7f1dd80c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:06.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.454+0000 7f1ddf0f1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd815b630 con 0x7f1dc0003b70 2024-09-15T23:24:06.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.454+0000 7f1ddf0f1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd80718b0 con 0x7f1dd80b2410 2024-09-15T23:24:06.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.454+0000 7f1ddf0f1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1dd815b7b0 con 0x7f1dd80b2870 2024-09-15T23:24:06.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.454+0000 7f1ddce8d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1dc0003b70 0x7f1dd80af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:06.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.454+0000 7f1ddce8d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1dc0003b70 0x7f1dd80af930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38994/0 (socket says 172.21.15.123:38994) 2024-09-15T23:24:06.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.454+0000 7f1ddce8d640 1 -- 172.21.15.123:0/3570881870 learned_addr learned my addr 172.21.15.123:0/3570881870 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:06.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.454+0000 7f1ddd68e640 1 --2- 172.21.15.123:0/3570881870 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1dd80b2870 0x7f1dd80c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:06.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.455+0000 7f1dcffff640 1 --2- 172.21.15.123:0/3570881870 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1dd80b2410 0x7f1dd80c95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:06.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.455+0000 7f1ddce8d640 1 -- 172.21.15.123:0/3570881870 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1dd80b2870 msgr2=0x7f1dd80c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:06.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.455+0000 7f1ddce8d640 1 --2- 172.21.15.123:0/3570881870 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1dd80b2870 0x7f1dd80c9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:06.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.455+0000 7f1ddce8d640 1 -- 172.21.15.123:0/3570881870 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1dd80b2410 msgr2=0x7f1dd80c95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:06.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.455+0000 7f1ddce8d640 1 --2- 172.21.15.123:0/3570881870 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1dd80b2410 0x7f1dd80c95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:06.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.455+0000 7f1ddce8d640 1 -- 172.21.15.123:0/3570881870 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dd8150550 con 0x7f1dc0003b70 2024-09-15T23:24:06.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.455+0000 7f1dcffff640 1 --2- 172.21.15.123:0/3570881870 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1dd80b2410 0x7f1dd80c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:24:06.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.455+0000 7f1ddce8d640 1 --2- 172.21.15.123:0/3570881870 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1dc0003b70 0x7f1dd80af930 secure :-1 s=READY pgs=2377 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4005040 tx=0x7f1dd40012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:06.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.455+0000 7f1dcd7fa640 1 -- 172.21.15.123:0/3570881870 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd403f020 con 0x7f1dc0003b70 2024-09-15T23:24:06.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.455+0000 7f1dcd7fa640 1 -- 172.21.15.123:0/3570881870 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dd40054a0 con 0x7f1dc0003b70 2024-09-15T23:24:06.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.455+0000 7f1ddf0f1640 1 -- 172.21.15.123:0/3570881870 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dd80b1930 con 0x7f1dc0003b70 2024-09-15T23:24:06.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.455+0000 7f1dcd7fa640 1 -- 172.21.15.123:0/3570881870 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4003a40 con 0x7f1dc0003b70 2024-09-15T23:24:06.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.455+0000 7f1ddf0f1640 1 -- 172.21.15.123:0/3570881870 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dd80b1ef0 con 0x7f1dc0003b70 2024-09-15T23:24:06.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.456+0000 7f1ddf0f1640 1 -- 172.21.15.123:0/3570881870 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dd815af20 con 0x7f1dc0003b70 2024-09-15T23:24:06.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.456+0000 7f1dcd7fa640 1 -- 172.21.15.123:0/3570881870 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1dd4042020 con 0x7f1dc0003b70 2024-09-15T23:24:06.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.457+0000 7f1dcd7fa640 1 --2- 172.21.15.123:0/3570881870 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1dc406c2e0 0x7f1dc406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:06.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.457+0000 7f1dcd7fa640 1 -- 172.21.15.123:0/3570881870 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 5709+0+0 (secure 0 0 0) 0x7f1dd40aaf30 con 0x7f1dc0003b70 2024-09-15T23:24:06.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.457+0000 7f1dcffff640 1 --2- 172.21.15.123:0/3570881870 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1dc406c2e0 0x7f1dc406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:06.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.457+0000 7f1dcffff640 1 --2- 172.21.15.123:0/3570881870 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1dc406c2e0 0x7f1dc406e7a0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f1dd80b52a0 tx=0x7f1dc8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:06.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.461+0000 7f1dcd7fa640 1 -- 172.21.15.123:0/3570881870 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1dd4049030 con 0x7f1dc0003b70 2024-09-15T23:24:06.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.659+0000 7f1ddf0f1640 1 -- 172.21.15.123:0/3570881870 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1dd80b1700 con 0x7f1dc0003b70 2024-09-15T23:24:06.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.660+0000 7f1dcd7fa640 1 -- 172.21.15.123:0/3570881870 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 127 v127) ==== 95+0+5247 (secure 0 0 0) 0x7f1dd40796a0 con 0x7f1dc0003b70 2024-09-15T23:24:06.661 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:06.661 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":127,"btime":"2024-09-15T23:24:06:331850+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7922,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/173351117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":173351117},{"type":"v1","addr":"172.21.15.123:6835","nonce":173351117}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123},{"gid":7928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/4283187910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":4283187910},{"type":"v1","addr":"172.21.15.188:6837","nonce":4283187910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123},{"gid":9061,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/3180373488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3180373488},{"type":"v1","addr":"172.21.15.188:6836","nonce":3180373488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123}],"filesystems":[{"mdsmap":{"epoch":127,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:24:03.556320+0000","modified":"2024-09-15T23:24:05.658884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10905},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10905":{"gid":10905,"name":"c","rank":0,"incarnation":124,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6834/1661365546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":1661365546},{"type":"v1","addr":"172.21.15.123:6834","nonce":1661365546}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10905,"qdb_cluster":[10905]},"id":14}]} 2024-09-15T23:24:06.662 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 127 2024-09-15T23:24:06.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.662+0000 7f1ddf0f1640 1 -- 172.21.15.123:0/3570881870 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1dc406c2e0 msgr2=0x7f1dc406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:06.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.662+0000 7f1ddf0f1640 1 --2- 172.21.15.123:0/3570881870 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1dc406c2e0 0x7f1dc406e7a0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f1dd80b52a0 tx=0x7f1dc8009040 comp rx=0 tx=0).stop 2024-09-15T23:24:06.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.662+0000 7f1ddf0f1640 1 -- 172.21.15.123:0/3570881870 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1dc0003b70 msgr2=0x7f1dd80af930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:06.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.662+0000 7f1ddf0f1640 1 --2- 172.21.15.123:0/3570881870 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1dc0003b70 0x7f1dd80af930 secure :-1 s=READY pgs=2377 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4005040 tx=0x7f1dd40012d0 comp rx=0 tx=0).stop 2024-09-15T23:24:06.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.662+0000 7f1ddf0f1640 1 -- 172.21.15.123:0/3570881870 shutdown_connections 2024-09-15T23:24:06.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.662+0000 7f1ddf0f1640 1 --2- 172.21.15.123:0/3570881870 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1dd80b2870 0x7f1dd80c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:06.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.662+0000 7f1ddf0f1640 1 --2- 172.21.15.123:0/3570881870 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1dd80b2410 0x7f1dd80c95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:06.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.662+0000 7f1ddf0f1640 1 --2- 172.21.15.123:0/3570881870 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1dc406c2e0 0x7f1dc406e7a0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:06.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.662+0000 7f1ddf0f1640 1 --2- 172.21.15.123:0/3570881870 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1dc0003b70 0x7f1dd80af930 unknown :-1 s=CLOSED pgs=2377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:06.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.662+0000 7f1ddf0f1640 1 -- 172.21.15.123:0/3570881870 >> 172.21.15.123:0/3570881870 conn(0x7f1dd80ccec0 msgr2=0x7f1dd80b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:06.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.662+0000 7f1ddf0f1640 1 -- 172.21.15.123:0/3570881870 shutdown_connections 2024-09-15T23:24:06.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.662+0000 7f1ddf0f1640 1 -- 172.21.15.123:0/3570881870 wait complete. 2024-09-15T23:24:06.674 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:24:06.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.771+0000 7f960b8c3640 1 Processor -- start 2024-09-15T23:24:06.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.771+0000 7f960b8c3640 1 -- start start 2024-09-15T23:24:06.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.772+0000 7f960b8c3640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f960406c320 0x7f960415bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:06.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.772+0000 7f960b8c3640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f960413eb20 0x7f960415c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:06.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.772+0000 7f960b8c3640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9604071180 con 0x7f96040b2d40 2024-09-15T23:24:06.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.772+0000 7f960b8c3640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f9604071ab0 con 0x7f960406c320 2024-09-15T23:24:06.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.772+0000 7f960b8c3640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9604071460 con 0x7f960413eb20 2024-09-15T23:24:06.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.772+0000 7f9608e5e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f960406c320 0x7f960415bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:06.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.772+0000 7f960965f640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f96040b2d40 0x7f960406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39164/0 (socket says 172.21.15.123:39164) 2024-09-15T23:24:06.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.772+0000 7f960965f640 1 -- 172.21.15.123:0/1912758620 learned_addr learned my addr 172.21.15.123:0/1912758620 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:06.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.773+0000 7f9608e5e640 1 -- 172.21.15.123:0/1912758620 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f960413eb20 msgr2=0x7f960415c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:06.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.773+0000 7f9609e60640 1 --2- 172.21.15.123:0/1912758620 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f960413eb20 0x7f960415c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:06.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.773+0000 7f9603fff640 1 -- 172.21.15.123:0/1912758620 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3605818206 0 0) 0x7f9604071180 con 0x7f96040b2d40 2024-09-15T23:24:06.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.773+0000 7f9608e5e640 1 --2- 172.21.15.123:0/1912758620 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f960413eb20 0x7f960415c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:06.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.773+0000 7f9608e5e640 1 -- 172.21.15.123:0/1912758620 >> v1:172.21.15.123:6789/0 conn(0x7f96040b2d40 legacy=0x7f960406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:06.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.773+0000 7f9608e5e640 1 -- 172.21.15.123:0/1912758620 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9604071740 con 0x7f960406c320 2024-09-15T23:24:06.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.773+0000 7f9609e60640 1 --2- 172.21.15.123:0/1912758620 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f960413eb20 0x7f960415c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:24:06.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.773+0000 7f9608e5e640 1 --2- 172.21.15.123:0/1912758620 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f960406c320 0x7f960415bcf0 secure :-1 s=READY pgs=2379 cs=0 l=1 rev1=1 crypto rx=0x7f95f80097a0 tx=0x7f95f802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5209d018bc7edea server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:06.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.774+0000 7f9603fff640 1 -- 172.21.15.123:0/1912758620 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f8037070 con 0x7f960406c320 2024-09-15T23:24:06.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.774+0000 7f9603fff640 1 -- 172.21.15.123:0/1912758620 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95f8032440 con 0x7f960406c320 2024-09-15T23:24:06.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.774+0000 7f9603fff640 1 -- 172.21.15.123:0/1912758620 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f8032810 con 0x7f960406c320 2024-09-15T23:24:06.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.774+0000 7f960b8c3640 1 -- 172.21.15.123:0/1912758620 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f960406c320 msgr2=0x7f960415bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:06.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.774+0000 7f960b8c3640 1 --2- 172.21.15.123:0/1912758620 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f960406c320 0x7f960415bcf0 secure :-1 s=READY pgs=2379 cs=0 l=1 rev1=1 crypto rx=0x7f95f80097a0 tx=0x7f95f802a180 comp rx=0 tx=0).stop 2024-09-15T23:24:06.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.774+0000 7f960b8c3640 1 -- 172.21.15.123:0/1912758620 shutdown_connections 2024-09-15T23:24:06.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.774+0000 7f960b8c3640 1 --2- 172.21.15.123:0/1912758620 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f960413eb20 0x7f960415c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:06.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.774+0000 7f960b8c3640 1 --2- 172.21.15.123:0/1912758620 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f960406c320 0x7f960415bcf0 unknown :-1 s=CLOSED pgs=2379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:06.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.774+0000 7f960b8c3640 1 -- 172.21.15.123:0/1912758620 >> 172.21.15.123:0/1912758620 conn(0x7f96040ccec0 msgr2=0x7f96040cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:06.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.774+0000 7f960b8c3640 1 -- 172.21.15.123:0/1912758620 shutdown_connections 2024-09-15T23:24:06.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.774+0000 7f960b8c3640 1 -- 172.21.15.123:0/1912758620 wait complete. 2024-09-15T23:24:06.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.775+0000 7f960b8c3640 1 Processor -- start 2024-09-15T23:24:06.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.775+0000 7f960b8c3640 1 -- start start 2024-09-15T23:24:06.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.776+0000 7f960b8c3640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f960406c320 0x7f960415fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:06.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.776+0000 7f960b8c3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f96040b2d40 0x7f960415d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:06.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.776+0000 7f960b8c3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f960413eb20 0x7f960415e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:06.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.776+0000 7f960b8c3640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f96040720c0 con 0x7f960413eb20 2024-09-15T23:24:06.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.776+0000 7f960b8c3640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9604071f40 con 0x7f96040b2d40 2024-09-15T23:24:06.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.776+0000 7f960b8c3640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9604072240 con 0x7f960406c320 2024-09-15T23:24:06.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.776+0000 7f9609e60640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f960413eb20 0x7f960415e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:06.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.776+0000 7f9609e60640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f960413eb20 0x7f960415e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39014/0 (socket says 172.21.15.123:39014) 2024-09-15T23:24:06.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.776+0000 7f9609e60640 1 -- 172.21.15.123:0/3796649339 learned_addr learned my addr 172.21.15.123:0/3796649339 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:06.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.776+0000 7f9608e5e640 1 --2- 172.21.15.123:0/3796649339 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f96040b2d40 0x7f960415d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:06.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.776+0000 7f9609e60640 1 -- 172.21.15.123:0/3796649339 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f960406c320 msgr2=0x7f960415fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:06.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.776+0000 7f9609e60640 1 --2- 172.21.15.123:0/3796649339 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f960406c320 0x7f960415fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:06.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.776+0000 7f9609e60640 1 -- 172.21.15.123:0/3796649339 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f96040b2d40 msgr2=0x7f960415d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:06.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.776+0000 7f9609e60640 1 --2- 172.21.15.123:0/3796649339 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f96040b2d40 0x7f960415d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:06.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.776+0000 7f9609e60640 1 -- 172.21.15.123:0/3796649339 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f960415e5a0 con 0x7f960413eb20 2024-09-15T23:24:06.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.777+0000 7f9609e60640 1 --2- 172.21.15.123:0/3796649339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f960413eb20 0x7f960415e7b0 secure :-1 s=READY pgs=2380 cs=0 l=1 rev1=1 crypto rx=0x7f95fc00c7f0 tx=0x7f95fc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:06.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.777+0000 7f9601ffb640 1 -- 172.21.15.123:0/3796649339 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc015020 con 0x7f960413eb20 2024-09-15T23:24:06.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.777+0000 7f9601ffb640 1 -- 172.21.15.123:0/3796649339 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95fc004230 con 0x7f960413eb20 2024-09-15T23:24:06.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.777+0000 7f960b8c3640 1 -- 172.21.15.123:0/3796649339 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f960415dd00 con 0x7f960413eb20 2024-09-15T23:24:06.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.777+0000 7f9601ffb640 1 -- 172.21.15.123:0/3796649339 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc007620 con 0x7f960413eb20 2024-09-15T23:24:06.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.777+0000 7f960b8c3640 1 -- 172.21.15.123:0/3796649339 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f960415e2c0 con 0x7f960413eb20 2024-09-15T23:24:06.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.778+0000 7f960b8c3640 1 -- 172.21.15.123:0/3796649339 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f960406bc10 con 0x7f960413eb20 2024-09-15T23:24:06.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.778+0000 7f9601ffb640 1 -- 172.21.15.123:0/3796649339 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f95fc018020 con 0x7f960413eb20 2024-09-15T23:24:06.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.779+0000 7f9601ffb640 1 --2- 172.21.15.123:0/3796649339 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f95f006c2b0 0x7f95f006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:06.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.779+0000 7f9601ffb640 1 -- 172.21.15.123:0/3796649339 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 5709+0+0 (secure 0 0 0) 0x7f95fc08b6f0 con 0x7f960413eb20 2024-09-15T23:24:06.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.779+0000 7f960965f640 1 --2- 172.21.15.123:0/3796649339 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f95f006c2b0 0x7f95f006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:06.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.780+0000 7f960965f640 1 --2- 172.21.15.123:0/3796649339 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f95f006c2b0 0x7f95f006e770 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f95f4001560 tx=0x7f95f4007ca0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:06.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.783+0000 7f9601ffb640 1 -- 172.21.15.123:0/3796649339 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f95fc01f020 con 0x7f960413eb20 2024-09-15T23:24:06.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.949+0000 7f960b8c3640 1 -- 172.21.15.123:0/3796649339 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9604156f20 con 0x7f960413eb20 2024-09-15T23:24:06.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.950+0000 7f9601ffb640 1 -- 172.21.15.123:0/3796649339 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v206) ==== 74+0+16767 (secure 0 0 0) 0x7f95fc059f20 con 0x7f960413eb20 2024-09-15T23:24:06.951 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:06.951 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":206,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:24:05.228587+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:24:02.173413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"205","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-09-15T23:24:02.534783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"206","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:24:06.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.952+0000 7f960b8c3640 1 -- 172.21.15.123:0/3796649339 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f95f006c2b0 msgr2=0x7f95f006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:06.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.952+0000 7f960b8c3640 1 --2- 172.21.15.123:0/3796649339 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f95f006c2b0 0x7f95f006e770 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f95f4001560 tx=0x7f95f4007ca0 comp rx=0 tx=0).stop 2024-09-15T23:24:06.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.952+0000 7f960b8c3640 1 -- 172.21.15.123:0/3796649339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f960413eb20 msgr2=0x7f960415e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:06.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.952+0000 7f960b8c3640 1 --2- 172.21.15.123:0/3796649339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f960413eb20 0x7f960415e7b0 secure :-1 s=READY pgs=2380 cs=0 l=1 rev1=1 crypto rx=0x7f95fc00c7f0 tx=0x7f95fc00ccb0 comp rx=0 tx=0).stop 2024-09-15T23:24:06.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.952+0000 7f960b8c3640 1 -- 172.21.15.123:0/3796649339 shutdown_connections 2024-09-15T23:24:06.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.952+0000 7f960b8c3640 1 --2- 172.21.15.123:0/3796649339 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f95f006c2b0 0x7f95f006e770 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:06.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.952+0000 7f960b8c3640 1 --2- 172.21.15.123:0/3796649339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f960413eb20 0x7f960415e7b0 unknown :-1 s=CLOSED pgs=2380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:06.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.952+0000 7f960b8c3640 1 --2- 172.21.15.123:0/3796649339 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f96040b2d40 0x7f960415d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:06.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.952+0000 7f960b8c3640 1 --2- 172.21.15.123:0/3796649339 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f960406c320 0x7f960415fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:06.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.952+0000 7f960b8c3640 1 -- 172.21.15.123:0/3796649339 >> 172.21.15.123:0/3796649339 conn(0x7f96040ccec0 msgr2=0x7f96041580d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:06.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.952+0000 7f960b8c3640 1 -- 172.21.15.123:0/3796649339 shutdown_connections 2024-09-15T23:24:06.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:06.952+0000 7f960b8c3640 1 -- 172.21.15.123:0/3796649339 wait complete. 2024-09-15T23:24:06.964 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T23:24:06.965 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:24:07.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.061+0000 7f9b365a6640 1 Processor -- start 2024-09-15T23:24:07.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.061+0000 7f9b365a6640 1 -- start start 2024-09-15T23:24:07.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.062+0000 7f9b365a6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9b300b2d40 0x7f9b3006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:07.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.062+0000 7f9b365a6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f9b3013eb20 0x7f9b3006c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:07.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.062+0000 7f9b365a6640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b30071180 con 0x7f9b3015bcf0 2024-09-15T23:24:07.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.062+0000 7f9b365a6640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f9b3015c890 con 0x7f9b300b2d40 2024-09-15T23:24:07.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.062+0000 7f9b365a6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f9b30071ab0 con 0x7f9b3013eb20 2024-09-15T23:24:07.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.062+0000 7f9b2ffff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9b300b2d40 0x7f9b3006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:07.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.062+0000 7f9b34b43640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f9b3015bcf0 0x7f9b3015c180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39180/0 (socket says 172.21.15.123:39180) 2024-09-15T23:24:07.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.062+0000 7f9b2ffff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9b300b2d40 0x7f9b3006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39022/0 (socket says 172.21.15.123:39022) 2024-09-15T23:24:07.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.062+0000 7f9b34b43640 1 -- 172.21.15.123:0/3400036744 learned_addr learned my addr 172.21.15.123:0/3400036744 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:07.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.062+0000 7f9b2ffff640 1 -- 172.21.15.123:0/3400036744 >> v2:172.21.15.188:3300/0 conn(0x7f9b3013eb20 msgr2=0x7f9b3006c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:07.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.062+0000 7f9b2f7fe640 1 --2- 172.21.15.123:0/3400036744 >> v2:172.21.15.188:3300/0 conn(0x7f9b3013eb20 0x7f9b3006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:07.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.062+0000 7f9b2ffff640 1 --2- 172.21.15.123:0/3400036744 >> v2:172.21.15.188:3300/0 conn(0x7f9b3013eb20 0x7f9b3006c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:07.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.062+0000 7f9b2ffff640 1 -- 172.21.15.123:0/3400036744 >> v1:172.21.15.123:6789/0 conn(0x7f9b3015bcf0 legacy=0x7f9b3015c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:07.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.062+0000 7f9b2ffff640 1 -- 172.21.15.123:0/3400036744 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b30071460 con 0x7f9b300b2d40 2024-09-15T23:24:07.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.062+0000 7f9b2effd640 1 -- 172.21.15.123:0/3400036744 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 118534158 0 0) 0x7f9b30071180 con 0x7f9b3015bcf0 2024-09-15T23:24:07.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.063+0000 7f9b2ffff640 1 --2- 172.21.15.123:0/3400036744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b300b2d40 0x7f9b3006bc10 secure :-1 s=READY pgs=2382 cs=0 l=1 rev1=1 crypto rx=0x7f9b300d1500 tx=0x7f9b2002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3885124a6f0edfd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:07.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.063+0000 7f9b2effd640 1 -- 172.21.15.123:0/3400036744 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b20037070 con 0x7f9b300b2d40 2024-09-15T23:24:07.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.063+0000 7f9b2effd640 1 -- 172.21.15.123:0/3400036744 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b20032440 con 0x7f9b300b2d40 2024-09-15T23:24:07.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.063+0000 7f9b2effd640 1 -- 172.21.15.123:0/3400036744 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b20032810 con 0x7f9b300b2d40 2024-09-15T23:24:07.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.064+0000 7f9b365a6640 1 -- 172.21.15.123:0/3400036744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b300b2d40 msgr2=0x7f9b3006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:07.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.064+0000 7f9b365a6640 1 --2- 172.21.15.123:0/3400036744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b300b2d40 0x7f9b3006bc10 secure :-1 s=READY pgs=2382 cs=0 l=1 rev1=1 crypto rx=0x7f9b300d1500 tx=0x7f9b2002a1a0 comp rx=0 tx=0).stop 2024-09-15T23:24:07.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.064+0000 7f9b365a6640 1 -- 172.21.15.123:0/3400036744 shutdown_connections 2024-09-15T23:24:07.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.064+0000 7f9b365a6640 1 --2- 172.21.15.123:0/3400036744 >> v2:172.21.15.188:3300/0 conn(0x7f9b3013eb20 0x7f9b3006c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:07.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.064+0000 7f9b365a6640 1 --2- 172.21.15.123:0/3400036744 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b300b2d40 0x7f9b3006bc10 unknown :-1 s=CLOSED pgs=2382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:07.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.064+0000 7f9b365a6640 1 -- 172.21.15.123:0/3400036744 >> 172.21.15.123:0/3400036744 conn(0x7f9b300ccec0 msgr2=0x7f9b300cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:07.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.064+0000 7f9b365a6640 1 -- 172.21.15.123:0/3400036744 shutdown_connections 2024-09-15T23:24:07.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.064+0000 7f9b365a6640 1 -- 172.21.15.123:0/3400036744 wait complete. 2024-09-15T23:24:07.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.065+0000 7f9b365a6640 1 Processor -- start 2024-09-15T23:24:07.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.065+0000 7f9b365a6640 1 -- start start 2024-09-15T23:24:07.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.066+0000 7f9b365a6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b300b2d40 0x7f9b30157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:07.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.066+0000 7f9b365a6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b3013eb20 0x7f9b30156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:07.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.066+0000 7f9b365a6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b3015bcf0 0x7f9b3015cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:07.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.066+0000 7f9b365a6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9b300720c0 con 0x7f9b3015bcf0 2024-09-15T23:24:07.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.066+0000 7f9b365a6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9b30071f40 con 0x7f9b3013eb20 2024-09-15T23:24:07.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.066+0000 7f9b365a6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9b30072240 con 0x7f9b300b2d40 2024-09-15T23:24:07.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.066+0000 7f9b34b43640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b3015bcf0 0x7f9b3015cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:07.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.066+0000 7f9b34b43640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b3015bcf0 0x7f9b3015cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39030/0 (socket says 172.21.15.123:39030) 2024-09-15T23:24:07.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.066+0000 7f9b34b43640 1 -- 172.21.15.123:0/3965537297 learned_addr learned my addr 172.21.15.123:0/3965537297 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:07.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.066+0000 7f9b2ffff640 1 --2- 172.21.15.123:0/3965537297 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b300b2d40 0x7f9b30157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:07.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.066+0000 7f9b34b43640 1 -- 172.21.15.123:0/3965537297 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b300b2d40 msgr2=0x7f9b30157f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:07.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.066+0000 7f9b34b43640 1 --2- 172.21.15.123:0/3965537297 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b300b2d40 0x7f9b30157f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:07.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.066+0000 7f9b34b43640 1 -- 172.21.15.123:0/3965537297 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b3013eb20 msgr2=0x7f9b30156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:07.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.066+0000 7f9b34b43640 1 --2- 172.21.15.123:0/3965537297 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b3013eb20 0x7f9b30156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:07.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.066+0000 7f9b34b43640 1 -- 172.21.15.123:0/3965537297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b3015da40 con 0x7f9b3015bcf0 2024-09-15T23:24:07.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.066+0000 7f9b34b43640 1 --2- 172.21.15.123:0/3965537297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b3015bcf0 0x7f9b3015cac0 secure :-1 s=READY pgs=2383 cs=0 l=1 rev1=1 crypto rx=0x7f9b2800c730 tx=0x7f9b2800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:07.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.066+0000 7f9b2cff9640 1 -- 172.21.15.123:0/3965537297 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b28018070 con 0x7f9b3015bcf0 2024-09-15T23:24:07.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.066+0000 7f9b2cff9640 1 -- 172.21.15.123:0/3965537297 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b2800ce40 con 0x7f9b3015bcf0 2024-09-15T23:24:07.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.067+0000 7f9b365a6640 1 -- 172.21.15.123:0/3965537297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b3015d480 con 0x7f9b3015bcf0 2024-09-15T23:24:07.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.067+0000 7f9b2cff9640 1 -- 172.21.15.123:0/3965537297 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2800a860 con 0x7f9b3015bcf0 2024-09-15T23:24:07.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.067+0000 7f9b365a6640 1 -- 172.21.15.123:0/3965537297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b3015e4b0 con 0x7f9b3015bcf0 2024-09-15T23:24:07.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.067+0000 7f9b365a6640 1 -- 172.21.15.123:0/3965537297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b3015c180 con 0x7f9b3015bcf0 2024-09-15T23:24:07.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.068+0000 7f9b2cff9640 1 -- 172.21.15.123:0/3965537297 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9b2801b070 con 0x7f9b3015bcf0 2024-09-15T23:24:07.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.068+0000 7f9b2cff9640 1 --2- 172.21.15.123:0/3965537297 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9b1c06c2b0 0x7f9b1c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:07.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.069+0000 7f9b2cff9640 1 -- 172.21.15.123:0/3965537297 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 5709+0+0 (secure 0 0 0) 0x7f9b2808a990 con 0x7f9b3015bcf0 2024-09-15T23:24:07.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.069+0000 7f9b2ffff640 1 --2- 172.21.15.123:0/3965537297 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9b1c06c2b0 0x7f9b1c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:07.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.069+0000 7f9b2ffff640 1 --2- 172.21.15.123:0/3965537297 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9b1c06c2b0 0x7f9b1c06e770 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f9b20034000 tx=0x7f9b2002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:07.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.073+0000 7f9b2cff9640 1 -- 172.21.15.123:0/3965537297 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9b28059100 con 0x7f9b3015bcf0 2024-09-15T23:24:07.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.234+0000 7f9b365a6640 1 -- 172.21.15.123:0/3965537297 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9b3006c9c0 con 0x7f9b1c06c2b0 2024-09-15T23:24:07.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.241+0000 7f9b2cff9640 1 -- 172.21.15.123:0/3965537297 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242644 (secure 0 0 0) 0x7f9b3006c9c0 con 0x7f9b1c06c2b0 2024-09-15T23:24:07.244 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:07.246 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:24:07.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.244+0000 7f9b365a6640 1 -- 172.21.15.123:0/3965537297 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9b1c06c2b0 msgr2=0x7f9b1c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:07.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.244+0000 7f9b365a6640 1 --2- 172.21.15.123:0/3965537297 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9b1c06c2b0 0x7f9b1c06e770 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f9b20034000 tx=0x7f9b2002e000 comp rx=0 tx=0).stop 2024-09-15T23:24:07.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.244+0000 7f9b365a6640 1 -- 172.21.15.123:0/3965537297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b3015bcf0 msgr2=0x7f9b3015cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:07.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.244+0000 7f9b365a6640 1 --2- 172.21.15.123:0/3965537297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b3015bcf0 0x7f9b3015cac0 secure :-1 s=READY pgs=2383 cs=0 l=1 rev1=1 crypto rx=0x7f9b2800c730 tx=0x7f9b2800cbf0 comp rx=0 tx=0).stop 2024-09-15T23:24:07.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.244+0000 7f9b365a6640 1 -- 172.21.15.123:0/3965537297 shutdown_connections 2024-09-15T23:24:07.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.244+0000 7f9b365a6640 1 --2- 172.21.15.123:0/3965537297 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9b1c06c2b0 0x7f9b1c06e770 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:07.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.244+0000 7f9b365a6640 1 --2- 172.21.15.123:0/3965537297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b3015bcf0 0x7f9b3015cac0 unknown :-1 s=CLOSED pgs=2383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:07.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.244+0000 7f9b365a6640 1 --2- 172.21.15.123:0/3965537297 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b3013eb20 0x7f9b30156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:07.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.244+0000 7f9b365a6640 1 --2- 172.21.15.123:0/3965537297 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b300b2d40 0x7f9b30157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:07.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.244+0000 7f9b365a6640 1 -- 172.21.15.123:0/3965537297 >> 172.21.15.123:0/3965537297 conn(0x7f9b300ccec0 msgr2=0x7f9b30140960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:07.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.244+0000 7f9b365a6640 1 -- 172.21.15.123:0/3965537297 shutdown_connections 2024-09-15T23:24:07.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.244+0000 7f9b365a6640 1 -- 172.21.15.123:0/3965537297 wait complete. 2024-09-15T23:24:07.256 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":561,"stamp":"2024-09-15T23:24:05.674086+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":112,"acting":112,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":452368,"kb_used_data":20992,"kb_used_omap":12,"kb_used_meta":431155,"kb_avail":754522352,"statfs":{"total":773094113280,"available":772630888448,"internally_reserved":0,"allocated":21495808,"data_stored":10160822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":441503280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000916"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.227236+0000","last_change":"2024-09-15T23:24:03.227236+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.227236+0000","last_undegraded":"2024-09-15T23:24:03.227236+0000","last_fullsized":"2024-09-15T23:24:03.227236+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.224505+0000","last_change":"2024-09-15T23:24:03.224505+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.224505+0000","last_undegraded":"2024-09-15T23:24:03.224505+0000","last_fullsized":"2024-09-15T23:24:03.224505+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.224018+0000","last_change":"2024-09-15T23:24:03.224018+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.224018+0000","last_undegraded":"2024-09-15T23:24:03.224018+0000","last_fullsized":"2024-09-15T23:24:03.224018+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.223475+0000","last_change":"2024-09-15T23:24:03.223475+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.223475+0000","last_undegraded":"2024-09-15T23:24:03.223475+0000","last_fullsized":"2024-09-15T23:24:03.223475+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.228486+0000","last_change":"2024-09-15T23:24:03.228486+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.228486+0000","last_undegraded":"2024-09-15T23:24:03.228486+0000","last_fullsized":"2024-09-15T23:24:03.228486+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.222842+0000","last_change":"2024-09-15T23:24:03.222842+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.222842+0000","last_undegraded":"2024-09-15T23:24:03.222842+0000","last_fullsized":"2024-09-15T23:24:03.222842+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.227577+0000","last_change":"2024-09-15T23:24:03.227577+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.227577+0000","last_undegraded":"2024-09-15T23:24:03.227577+0000","last_fullsized":"2024-09-15T23:24:03.227577+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.226388+0000","last_change":"2024-09-15T23:24:03.226388+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.226388+0000","last_undegraded":"2024-09-15T23:24:03.226388+0000","last_fullsized":"2024-09-15T23:24:03.226388+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.224847+0000","last_change":"2024-09-15T23:24:03.224847+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.224847+0000","last_undegraded":"2024-09-15T23:24:03.224847+0000","last_fullsized":"2024-09-15T23:24:03.224847+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.230590+0000","last_change":"2024-09-15T23:24:03.230590+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.230590+0000","last_undegraded":"2024-09-15T23:24:03.230590+0000","last_fullsized":"2024-09-15T23:24:03.230590+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.226794+0000","last_change":"2024-09-15T23:24:03.226794+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.226794+0000","last_undegraded":"2024-09-15T23:24:03.226794+0000","last_fullsized":"2024-09-15T23:24:03.226794+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.224229+0000","last_change":"2024-09-15T23:24:03.224229+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.224229+0000","last_undegraded":"2024-09-15T23:24:03.224229+0000","last_fullsized":"2024-09-15T23:24:03.224229+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.223368+0000","last_change":"2024-09-15T23:24:03.223368+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.223368+0000","last_undegraded":"2024-09-15T23:24:03.223368+0000","last_fullsized":"2024-09-15T23:24:03.223368+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.223265+0000","last_change":"2024-09-15T23:24:03.223265+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.223265+0000","last_undegraded":"2024-09-15T23:24:03.223265+0000","last_fullsized":"2024-09-15T23:24:03.223265+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.228304+0000","last_change":"2024-09-15T23:24:03.228304+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.228304+0000","last_undegraded":"2024-09-15T23:24:03.228304+0000","last_fullsized":"2024-09-15T23:24:03.228304+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.226416+0000","last_change":"2024-09-15T23:24:03.226416+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.226416+0000","last_undegraded":"2024-09-15T23:24:03.226416+0000","last_fullsized":"2024-09-15T23:24:03.226416+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.223740+0000","last_change":"2024-09-15T23:24:03.223740+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.223740+0000","last_undegraded":"2024-09-15T23:24:03.223740+0000","last_fullsized":"2024-09-15T23:24:03.223740+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:02.210764+0000","last_change":"2024-09-15T23:24:02.210764+0000","last_active":"2024-09-15T23:24:02.210764+0000","last_peered":"2024-09-15T23:24:02.210764+0000","last_clean":"2024-09-15T23:24:02.210764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:02.210764+0000","last_undegraded":"2024-09-15T23:24:02.210764+0000","last_fullsized":"2024-09-15T23:24:02.210764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.233971+0000","last_change":"2024-09-15T23:24:03.232380+0000","last_active":"2024-09-15T23:24:03.233971+0000","last_peered":"2024-09-15T23:24:03.233971+0000","last_clean":"2024-09-15T23:24:03.233971+0000","last_became_active":"2024-09-15T23:24:03.225881+0000","last_became_peered":"2024-09-15T23:24:03.225881+0000","last_unstale":"2024-09-15T23:24:03.233971+0000","last_undegraded":"2024-09-15T23:24:03.233971+0000","last_fullsized":"2024-09-15T23:24:03.233971+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:52:16.001769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.229217+0000","last_change":"2024-09-15T23:24:03.229217+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.229217+0000","last_undegraded":"2024-09-15T23:24:03.229217+0000","last_fullsized":"2024-09-15T23:24:03.229217+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.237582+0000","last_change":"2024-09-15T23:24:03.236362+0000","last_active":"2024-09-15T23:24:03.237582+0000","last_peered":"2024-09-15T23:24:03.237582+0000","last_clean":"2024-09-15T23:24:03.237582+0000","last_became_active":"2024-09-15T23:24:03.236134+0000","last_became_peered":"2024-09-15T23:24:03.236134+0000","last_unstale":"2024-09-15T23:24:03.237582+0000","last_undegraded":"2024-09-15T23:24:03.237582+0000","last_fullsized":"2024-09-15T23:24:03.237582+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:29:01.714652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.223497+0000","last_change":"2024-09-15T23:24:03.223497+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.223497+0000","last_undegraded":"2024-09-15T23:24:03.223497+0000","last_fullsized":"2024-09-15T23:24:03.223497+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:02.210764+0000","last_change":"2024-09-15T23:24:02.210764+0000","last_active":"2024-09-15T23:24:02.210764+0000","last_peered":"2024-09-15T23:24:02.210764+0000","last_clean":"2024-09-15T23:24:02.210764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:02.210764+0000","last_undegraded":"2024-09-15T23:24:02.210764+0000","last_fullsized":"2024-09-15T23:24:02.210764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.230537+0000","last_change":"2024-09-15T23:24:03.226435+0000","last_active":"2024-09-15T23:24:03.230537+0000","last_peered":"2024-09-15T23:24:03.230537+0000","last_clean":"2024-09-15T23:24:03.230537+0000","last_became_active":"2024-09-15T23:24:03.226192+0000","last_became_peered":"2024-09-15T23:24:03.226192+0000","last_unstale":"2024-09-15T23:24:03.230537+0000","last_undegraded":"2024-09-15T23:24:03.230537+0000","last_fullsized":"2024-09-15T23:24:03.230537+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:10:29.458773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.242172+0000","last_change":"2024-09-15T23:24:03.238146+0000","last_active":"2024-09-15T23:24:03.242172+0000","last_peered":"2024-09-15T23:24:03.242172+0000","last_clean":"2024-09-15T23:24:03.242172+0000","last_became_active":"2024-09-15T23:24:03.237891+0000","last_became_peered":"2024-09-15T23:24:03.237891+0000","last_unstale":"2024-09-15T23:24:03.242172+0000","last_undegraded":"2024-09-15T23:24:03.242172+0000","last_fullsized":"2024-09-15T23:24:03.242172+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:02:57.404523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.223037+0000","last_change":"2024-09-15T23:24:03.223037+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.223037+0000","last_undegraded":"2024-09-15T23:24:03.223037+0000","last_fullsized":"2024-09-15T23:24:03.223037+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:02.210764+0000","last_change":"2024-09-15T23:24:02.210764+0000","last_active":"2024-09-15T23:24:02.210764+0000","last_peered":"2024-09-15T23:24:02.210764+0000","last_clean":"2024-09-15T23:24:02.210764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:02.210764+0000","last_undegraded":"2024-09-15T23:24:02.210764+0000","last_fullsized":"2024-09-15T23:24:02.210764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.226896+0000","last_change":"2024-09-15T23:24:03.226896+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.226896+0000","last_undegraded":"2024-09-15T23:24:03.226896+0000","last_fullsized":"2024-09-15T23:24:03.226896+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.239471+0000","last_change":"2024-09-15T23:24:03.233947+0000","last_active":"2024-09-15T23:24:03.239471+0000","last_peered":"2024-09-15T23:24:03.239471+0000","last_clean":"2024-09-15T23:24:03.239471+0000","last_became_active":"2024-09-15T23:24:03.233577+0000","last_became_peered":"2024-09-15T23:24:03.233577+0000","last_unstale":"2024-09-15T23:24:03.239471+0000","last_undegraded":"2024-09-15T23:24:03.239471+0000","last_fullsized":"2024-09-15T23:24:03.239471+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:19:20.973913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.222988+0000","last_change":"2024-09-15T23:24:03.222988+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.222988+0000","last_undegraded":"2024-09-15T23:24:03.222988+0000","last_fullsized":"2024-09-15T23:24:03.222988+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:02.210764+0000","last_change":"2024-09-15T23:24:02.210764+0000","last_active":"2024-09-15T23:24:02.210764+0000","last_peered":"2024-09-15T23:24:02.210764+0000","last_clean":"2024-09-15T23:24:02.210764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:02.210764+0000","last_undegraded":"2024-09-15T23:24:02.210764+0000","last_fullsized":"2024-09-15T23:24:02.210764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.227189+0000","last_change":"2024-09-15T23:24:03.227189+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.227189+0000","last_undegraded":"2024-09-15T23:24:03.227189+0000","last_fullsized":"2024-09-15T23:24:03.227189+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:02.210764+0000","last_change":"2024-09-15T23:24:02.210764+0000","last_active":"2024-09-15T23:24:02.210764+0000","last_peered":"2024-09-15T23:24:02.210764+0000","last_clean":"2024-09-15T23:24:02.210764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:02.210764+0000","last_undegraded":"2024-09-15T23:24:02.210764+0000","last_fullsized":"2024-09-15T23:24:02.210764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.226402+0000","last_change":"2024-09-15T23:24:03.226402+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.226402+0000","last_undegraded":"2024-09-15T23:24:03.226402+0000","last_fullsized":"2024-09-15T23:24:03.226402+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:02.210764+0000","last_change":"2024-09-15T23:24:02.210764+0000","last_active":"2024-09-15T23:24:02.210764+0000","last_peered":"2024-09-15T23:24:02.210764+0000","last_clean":"2024-09-15T23:24:02.210764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:02.210764+0000","last_undegraded":"2024-09-15T23:24:02.210764+0000","last_fullsized":"2024-09-15T23:24:02.210764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:02.210764+0000","last_change":"2024-09-15T23:24:02.210764+0000","last_active":"2024-09-15T23:24:02.210764+0000","last_peered":"2024-09-15T23:24:02.210764+0000","last_clean":"2024-09-15T23:24:02.210764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:02.210764+0000","last_undegraded":"2024-09-15T23:24:02.210764+0000","last_fullsized":"2024-09-15T23:24:02.210764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.227303+0000","last_change":"2024-09-15T23:24:03.227303+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.227303+0000","last_undegraded":"2024-09-15T23:24:03.227303+0000","last_fullsized":"2024-09-15T23:24:03.227303+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:02.210764+0000","last_change":"2024-09-15T23:24:02.210764+0000","last_active":"2024-09-15T23:24:02.210764+0000","last_peered":"2024-09-15T23:24:02.210764+0000","last_clean":"2024-09-15T23:24:02.210764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:02.210764+0000","last_undegraded":"2024-09-15T23:24:02.210764+0000","last_fullsized":"2024-09-15T23:24:02.210764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.227693+0000","last_change":"2024-09-15T23:24:03.227693+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.227693+0000","last_undegraded":"2024-09-15T23:24:03.227693+0000","last_fullsized":"2024-09-15T23:24:03.227693+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:02.210764+0000","last_change":"2024-09-15T23:24:02.210764+0000","last_active":"2024-09-15T23:24:02.210764+0000","last_peered":"2024-09-15T23:24:02.210764+0000","last_clean":"2024-09-15T23:24:02.210764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:02.210764+0000","last_undegraded":"2024-09-15T23:24:02.210764+0000","last_fullsized":"2024-09-15T23:24:02.210764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.223048+0000","last_change":"2024-09-15T23:24:03.223048+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.223048+0000","last_undegraded":"2024-09-15T23:24:03.223048+0000","last_fullsized":"2024-09-15T23:24:03.223048+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.235426+0000","last_change":"2024-09-15T23:24:03.234776+0000","last_active":"2024-09-15T23:24:03.235426+0000","last_peered":"2024-09-15T23:24:03.235426+0000","last_clean":"2024-09-15T23:24:03.235426+0000","last_became_active":"2024-09-15T23:24:03.234449+0000","last_became_peered":"2024-09-15T23:24:03.234449+0000","last_unstale":"2024-09-15T23:24:03.235426+0000","last_undegraded":"2024-09-15T23:24:03.235426+0000","last_fullsized":"2024-09-15T23:24:03.235426+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:47:38.673671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.240876+0000","last_change":"2024-09-15T23:24:03.235856+0000","last_active":"2024-09-15T23:24:03.240876+0000","last_peered":"2024-09-15T23:24:03.240876+0000","last_clean":"2024-09-15T23:24:03.240876+0000","last_became_active":"2024-09-15T23:24:03.235564+0000","last_became_peered":"2024-09-15T23:24:03.235564+0000","last_unstale":"2024-09-15T23:24:03.240876+0000","last_undegraded":"2024-09-15T23:24:03.240876+0000","last_fullsized":"2024-09-15T23:24:03.240876+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:01.343626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:02.210764+0000","last_change":"2024-09-15T23:24:02.210764+0000","last_active":"2024-09-15T23:24:02.210764+0000","last_peered":"2024-09-15T23:24:02.210764+0000","last_clean":"2024-09-15T23:24:02.210764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:02.210764+0000","last_undegraded":"2024-09-15T23:24:02.210764+0000","last_fullsized":"2024-09-15T23:24:02.210764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.223231+0000","last_change":"2024-09-15T23:24:03.223231+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.223231+0000","last_undegraded":"2024-09-15T23:24:03.223231+0000","last_fullsized":"2024-09-15T23:24:03.223231+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.237191+0000","last_change":"2024-09-15T23:24:03.233389+0000","last_active":"2024-09-15T23:24:03.237191+0000","last_peered":"2024-09-15T23:24:03.237191+0000","last_clean":"2024-09-15T23:24:03.237191+0000","last_became_active":"2024-09-15T23:24:03.233139+0000","last_became_peered":"2024-09-15T23:24:03.233139+0000","last_unstale":"2024-09-15T23:24:03.237191+0000","last_undegraded":"2024-09-15T23:24:03.237191+0000","last_fullsized":"2024-09-15T23:24:03.237191+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:06:36.696878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.228859+0000","last_change":"2024-09-15T23:24:03.228859+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.228859+0000","last_undegraded":"2024-09-15T23:24:03.228859+0000","last_fullsized":"2024-09-15T23:24:03.228859+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:02.210764+0000","last_change":"2024-09-15T23:24:02.210764+0000","last_active":"2024-09-15T23:24:02.210764+0000","last_peered":"2024-09-15T23:24:02.210764+0000","last_clean":"2024-09-15T23:24:02.210764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:02.210764+0000","last_undegraded":"2024-09-15T23:24:02.210764+0000","last_fullsized":"2024-09-15T23:24:02.210764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.239487+0000","last_change":"2024-09-15T23:24:03.234239+0000","last_active":"2024-09-15T23:24:03.239487+0000","last_peered":"2024-09-15T23:24:03.239487+0000","last_clean":"2024-09-15T23:24:03.239487+0000","last_became_active":"2024-09-15T23:24:03.233978+0000","last_became_peered":"2024-09-15T23:24:03.233978+0000","last_unstale":"2024-09-15T23:24:03.239487+0000","last_undegraded":"2024-09-15T23:24:03.239487+0000","last_fullsized":"2024-09-15T23:24:03.239487+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:06:10.713689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.229398+0000","last_change":"2024-09-15T23:24:03.229398+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.229398+0000","last_undegraded":"2024-09-15T23:24:03.229398+0000","last_fullsized":"2024-09-15T23:24:03.229398+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.239117+0000","last_change":"2024-09-15T23:24:03.236689+0000","last_active":"2024-09-15T23:24:03.239117+0000","last_peered":"2024-09-15T23:24:03.239117+0000","last_clean":"2024-09-15T23:24:03.239117+0000","last_became_active":"2024-09-15T23:24:03.236226+0000","last_became_peered":"2024-09-15T23:24:03.236226+0000","last_unstale":"2024-09-15T23:24:03.239117+0000","last_undegraded":"2024-09-15T23:24:03.239117+0000","last_fullsized":"2024-09-15T23:24:03.239117+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:25.462598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.237912+0000","last_change":"2024-09-15T23:24:03.235609+0000","last_active":"2024-09-15T23:24:03.237912+0000","last_peered":"2024-09-15T23:24:03.237912+0000","last_clean":"2024-09-15T23:24:03.237912+0000","last_became_active":"2024-09-15T23:24:03.235358+0000","last_became_peered":"2024-09-15T23:24:03.235358+0000","last_unstale":"2024-09-15T23:24:03.237912+0000","last_undegraded":"2024-09-15T23:24:03.237912+0000","last_fullsized":"2024-09-15T23:24:03.237912+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:39.184956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.241274+0000","last_change":"2024-09-15T23:24:03.240718+0000","last_active":"2024-09-15T23:24:03.241274+0000","last_peered":"2024-09-15T23:24:03.241274+0000","last_clean":"2024-09-15T23:24:03.241274+0000","last_became_active":"2024-09-15T23:24:03.240388+0000","last_became_peered":"2024-09-15T23:24:03.240388+0000","last_unstale":"2024-09-15T23:24:03.241274+0000","last_undegraded":"2024-09-15T23:24:03.241274+0000","last_fullsized":"2024-09-15T23:24:03.241274+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:37:34.205282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:02.210764+0000","last_change":"2024-09-15T23:24:02.210764+0000","last_active":"2024-09-15T23:24:02.210764+0000","last_peered":"2024-09-15T23:24:02.210764+0000","last_clean":"2024-09-15T23:24:02.210764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:02.210764+0000","last_undegraded":"2024-09-15T23:24:02.210764+0000","last_fullsized":"2024-09-15T23:24:02.210764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.223056+0000","last_change":"2024-09-15T23:24:03.223056+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.223056+0000","last_undegraded":"2024-09-15T23:24:03.223056+0000","last_fullsized":"2024-09-15T23:24:03.223056+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.240856+0000","last_change":"2024-09-15T23:24:03.234599+0000","last_active":"2024-09-15T23:24:03.240856+0000","last_peered":"2024-09-15T23:24:03.240856+0000","last_clean":"2024-09-15T23:24:03.240856+0000","last_became_active":"2024-09-15T23:24:03.234337+0000","last_became_peered":"2024-09-15T23:24:03.234337+0000","last_unstale":"2024-09-15T23:24:03.240856+0000","last_undegraded":"2024-09-15T23:24:03.240856+0000","last_fullsized":"2024-09-15T23:24:03.240856+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:39.273467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.222576+0000","last_change":"2024-09-15T23:24:03.222576+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.222576+0000","last_undegraded":"2024-09-15T23:24:03.222576+0000","last_fullsized":"2024-09-15T23:24:03.222576+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.239699+0000","last_change":"2024-09-15T23:24:03.234545+0000","last_active":"2024-09-15T23:24:03.239699+0000","last_peered":"2024-09-15T23:24:03.239699+0000","last_clean":"2024-09-15T23:24:03.239699+0000","last_became_active":"2024-09-15T23:24:03.234294+0000","last_became_peered":"2024-09-15T23:24:03.234294+0000","last_unstale":"2024-09-15T23:24:03.239699+0000","last_undegraded":"2024-09-15T23:24:03.239699+0000","last_fullsized":"2024-09-15T23:24:03.239699+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:17:01.629821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.237340+0000","last_change":"2024-09-15T23:24:03.235147+0000","last_active":"2024-09-15T23:24:03.237340+0000","last_peered":"2024-09-15T23:24:03.237340+0000","last_clean":"2024-09-15T23:24:03.237340+0000","last_became_active":"2024-09-15T23:24:03.234881+0000","last_became_peered":"2024-09-15T23:24:03.234881+0000","last_unstale":"2024-09-15T23:24:03.237340+0000","last_undegraded":"2024-09-15T23:24:03.237340+0000","last_fullsized":"2024-09-15T23:24:03.237340+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:28.821635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.222054+0000","last_change":"2024-09-15T23:24:03.222054+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.222054+0000","last_undegraded":"2024-09-15T23:24:03.222054+0000","last_fullsized":"2024-09-15T23:24:03.222054+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.238608+0000","last_change":"2024-09-15T23:24:03.237859+0000","last_active":"2024-09-15T23:24:03.238608+0000","last_peered":"2024-09-15T23:24:03.238608+0000","last_clean":"2024-09-15T23:24:03.238608+0000","last_became_active":"2024-09-15T23:24:03.237582+0000","last_became_peered":"2024-09-15T23:24:03.237582+0000","last_unstale":"2024-09-15T23:24:03.238608+0000","last_undegraded":"2024-09-15T23:24:03.238608+0000","last_fullsized":"2024-09-15T23:24:03.238608+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:57.451165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.222550+0000","last_change":"2024-09-15T23:24:03.222550+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.222550+0000","last_undegraded":"2024-09-15T23:24:03.222550+0000","last_fullsized":"2024-09-15T23:24:03.222550+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:02.210764+0000","last_change":"2024-09-15T23:24:02.210764+0000","last_active":"2024-09-15T23:24:02.210764+0000","last_peered":"2024-09-15T23:24:02.210764+0000","last_clean":"2024-09-15T23:24:02.210764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:02.210764+0000","last_undegraded":"2024-09-15T23:24:02.210764+0000","last_fullsized":"2024-09-15T23:24:02.210764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.222629+0000","last_change":"2024-09-15T23:24:03.222629+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.222629+0000","last_undegraded":"2024-09-15T23:24:03.222629+0000","last_fullsized":"2024-09-15T23:24:03.222629+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:02.210764+0000","last_change":"2024-09-15T23:24:02.210764+0000","last_active":"2024-09-15T23:24:02.210764+0000","last_peered":"2024-09-15T23:24:02.210764+0000","last_clean":"2024-09-15T23:24:02.210764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:02.210764+0000","last_undegraded":"2024-09-15T23:24:02.210764+0000","last_fullsized":"2024-09-15T23:24:02.210764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.230004+0000","last_change":"2024-09-15T23:24:03.230004+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.230004+0000","last_undegraded":"2024-09-15T23:24:03.230004+0000","last_fullsized":"2024-09-15T23:24:03.230004+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.239455+0000","last_change":"2024-09-15T23:24:03.233988+0000","last_active":"2024-09-15T23:24:03.239455+0000","last_peered":"2024-09-15T23:24:03.239455+0000","last_clean":"2024-09-15T23:24:03.239455+0000","last_became_active":"2024-09-15T23:24:03.233730+0000","last_became_peered":"2024-09-15T23:24:03.233730+0000","last_unstale":"2024-09-15T23:24:03.239455+0000","last_undegraded":"2024-09-15T23:24:03.239455+0000","last_fullsized":"2024-09-15T23:24:03.239455+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:10.138162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.229178+0000","last_change":"2024-09-15T23:24:03.229178+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.229178+0000","last_undegraded":"2024-09-15T23:24:03.229178+0000","last_fullsized":"2024-09-15T23:24:03.229178+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.230402+0000","last_change":"2024-09-15T23:24:03.226290+0000","last_active":"2024-09-15T23:24:03.230402+0000","last_peered":"2024-09-15T23:24:03.230402+0000","last_clean":"2024-09-15T23:24:03.230402+0000","last_became_active":"2024-09-15T23:24:03.226044+0000","last_became_peered":"2024-09-15T23:24:03.226044+0000","last_unstale":"2024-09-15T23:24:03.230402+0000","last_undegraded":"2024-09-15T23:24:03.230402+0000","last_fullsized":"2024-09-15T23:24:03.230402+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:49.262116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":511,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.219541+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:24:03.219541+0000","last_peered":"2024-09-15T23:24:03.219541+0000","last_clean":"2024-09-15T23:24:03.219541+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:24:03.219541+0000","last_undegraded":"2024-09-15T23:24:03.219541+0000","last_fullsized":"2024-09-15T23:24:03.219541+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":74,"acting":74,"num_store_stats":4},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60056,"kb_used_data":2500,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311784,"statfs":{"total":96636764160,"available":96575266816,"internally_reserved":0,"allocated":2560000,"data_stored":1132693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55900,"kb_used_data":2488,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315940,"statfs":{"total":96636764160,"available":96579522560,"internally_reserved":0,"allocated":2547712,"data_stored":1126418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476885,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56476,"kb_used_data":3068,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315364,"statfs":{"total":96636764160,"available":96578932736,"internally_reserved":0,"allocated":3141632,"data_stored":1716786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476885,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51736,"kb_used_data":2500,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320104,"statfs":{"total":96636764160,"available":96583786496,"internally_reserved":0,"allocated":2560000,"data_stored":1132693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542291,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51720,"kb_used_data":2476,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320120,"statfs":{"total":96636764160,"available":96583802880,"internally_reserved":0,"allocated":2535424,"data_stored":1120601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542291,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55880,"kb_used_data":2476,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315960,"statfs":{"total":96636764160,"available":96579543040,"internally_reserved":0,"allocated":2535424,"data_stored":1120601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542290,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60604,"kb_used_data":3044,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311236,"statfs":{"total":96636764160,"available":96574705664,"internally_reserved":0,"allocated":3117056,"data_stored":1705842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542292,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59996,"kb_used_data":2440,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311844,"statfs":{"total":96636764160,"available":96575328256,"internally_reserved":0,"allocated":2498560,"data_stored":1105188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:24:07.261 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:24:07.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.393+0000 7ff10b16d640 1 Processor -- start 2024-09-15T23:24:07.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.393+0000 7ff10b16d640 1 -- start start 2024-09-15T23:24:07.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.394+0000 7ff10b16d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff1040b2d40 0x7ff10406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:07.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.394+0000 7ff10b16d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff10413eb20 0x7ff10406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:07.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.394+0000 7ff10b16d640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff104071180 con 0x7ff10415bcf0 2024-09-15T23:24:07.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.394+0000 7ff10b16d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7ff104071ab0 con 0x7ff10413eb20 2024-09-15T23:24:07.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.394+0000 7ff10b16d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ff104071460 con 0x7ff1040b2d40 2024-09-15T23:24:07.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.394+0000 7ff103fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff10413eb20 0x7ff10406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:07.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.394+0000 7ff108f09640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff1040b2d40 0x7ff10406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:07.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.394+0000 7ff103fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7ff10413eb20 0x7ff10406c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:60974/0 (socket says 172.21.15.123:60974) 2024-09-15T23:24:07.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.394+0000 7ff108f09640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff1040b2d40 0x7ff10406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:52966/0 (socket says 172.21.15.123:52966) 2024-09-15T23:24:07.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.394+0000 7ff103fff640 1 -- 172.21.15.123:0/2287669969 learned_addr learned my addr 172.21.15.123:0/2287669969 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:07.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.394+0000 7ff10970a640 1 --1- 172.21.15.123:0/2287669969 >> v1:172.21.15.188:6789/0 conn(0x7ff10415bcf0 0x7ff10415c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:57934/0 (socket says 172.21.15.123:57934) 2024-09-15T23:24:07.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.395+0000 7ff103fff640 1 -- 172.21.15.123:0/2287669969 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff1040b2d40 msgr2=0x7ff10406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:07.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.395+0000 7ff103fff640 1 --2- 172.21.15.123:0/2287669969 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff1040b2d40 0x7ff10406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:07.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.395+0000 7ff103fff640 1 -- 172.21.15.123:0/2287669969 >> v1:172.21.15.188:6789/0 conn(0x7ff10415bcf0 legacy=0x7ff10415c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:07.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.395+0000 7ff103fff640 1 -- 172.21.15.123:0/2287669969 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff104071740 con 0x7ff10413eb20 2024-09-15T23:24:07.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.395+0000 7ff1037fe640 1 -- 172.21.15.123:0/2287669969 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3480095533 0 0) 0x7ff104071180 con 0x7ff10415bcf0 2024-09-15T23:24:07.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.395+0000 7ff108f09640 1 --2- 172.21.15.123:0/2287669969 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff1040b2d40 0x7ff10406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:24:07.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.396+0000 7ff103fff640 1 --2- 172.21.15.123:0/2287669969 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff10413eb20 0x7ff10406c150 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff104071c30 tx=0x7ff0f802c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adb5b22e30b8de8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:07.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.396+0000 7ff1037fe640 1 -- 172.21.15.123:0/2287669969 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f8036020 con 0x7ff10413eb20 2024-09-15T23:24:07.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.396+0000 7ff1037fe640 1 -- 172.21.15.123:0/2287669969 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0f8032800 con 0x7ff10413eb20 2024-09-15T23:24:07.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.396+0000 7ff1037fe640 1 -- 172.21.15.123:0/2287669969 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f8032bd0 con 0x7ff10413eb20 2024-09-15T23:24:07.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.396+0000 7ff10b16d640 1 -- 172.21.15.123:0/2287669969 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff10413eb20 msgr2=0x7ff10406c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:07.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.396+0000 7ff10b16d640 1 --2- 172.21.15.123:0/2287669969 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff10413eb20 0x7ff10406c150 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff104071c30 tx=0x7ff0f802c900 comp rx=0 tx=0).stop 2024-09-15T23:24:07.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.396+0000 7ff10b16d640 1 -- 172.21.15.123:0/2287669969 shutdown_connections 2024-09-15T23:24:07.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.396+0000 7ff10b16d640 1 --2- 172.21.15.123:0/2287669969 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff10413eb20 0x7ff10406c150 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:07.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.396+0000 7ff10b16d640 1 --2- 172.21.15.123:0/2287669969 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff1040b2d40 0x7ff10406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:07.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.396+0000 7ff10b16d640 1 -- 172.21.15.123:0/2287669969 >> 172.21.15.123:0/2287669969 conn(0x7ff1040ccec0 msgr2=0x7ff1040cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:07.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.396+0000 7ff10b16d640 1 -- 172.21.15.123:0/2287669969 shutdown_connections 2024-09-15T23:24:07.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.396+0000 7ff10b16d640 1 -- 172.21.15.123:0/2287669969 wait complete. 2024-09-15T23:24:07.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.397+0000 7ff10b16d640 1 Processor -- start 2024-09-15T23:24:07.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.398+0000 7ff10b16d640 1 -- start start 2024-09-15T23:24:07.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.398+0000 7ff10b16d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff1040b2d40 0x7ff1041e21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:07.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.398+0000 7ff10b16d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff10413eb20 0x7ff10413d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:07.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.398+0000 7ff10b16d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff10415bcf0 0x7ff104157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:07.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.398+0000 7ff10b16d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff1040722d0 con 0x7ff10415bcf0 2024-09-15T23:24:07.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.398+0000 7ff10b16d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ff104072150 con 0x7ff10413eb20 2024-09-15T23:24:07.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.398+0000 7ff10b16d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ff104072450 con 0x7ff1040b2d40 2024-09-15T23:24:07.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.399+0000 7ff10970a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff10415bcf0 0x7ff104157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:07.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.399+0000 7ff10970a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff10415bcf0 0x7ff104157610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39044/0 (socket says 172.21.15.123:39044) 2024-09-15T23:24:07.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.399+0000 7ff10970a640 1 -- 172.21.15.123:0/3630295631 learned_addr learned my addr 172.21.15.123:0/3630295631 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:07.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.399+0000 7ff108f09640 1 --2- 172.21.15.123:0/3630295631 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff1040b2d40 0x7ff1041e21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:07.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.399+0000 7ff103fff640 1 --2- 172.21.15.123:0/3630295631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff10413eb20 0x7ff10413d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:07.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.399+0000 7ff10970a640 1 -- 172.21.15.123:0/3630295631 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff1040b2d40 msgr2=0x7ff1041e21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:07.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.399+0000 7ff10970a640 1 --2- 172.21.15.123:0/3630295631 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff1040b2d40 0x7ff1041e21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:07.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.399+0000 7ff10970a640 1 -- 172.21.15.123:0/3630295631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff10413eb20 msgr2=0x7ff10413d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:07.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.399+0000 7ff10970a640 1 --2- 172.21.15.123:0/3630295631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff10413eb20 0x7ff10413d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:07.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.399+0000 7ff10970a640 1 -- 172.21.15.123:0/3630295631 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1041e28c0 con 0x7ff10415bcf0 2024-09-15T23:24:07.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.399+0000 7ff103fff640 1 --2- 172.21.15.123:0/3630295631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff10413eb20 0x7ff10413d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:24:07.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.399+0000 7ff108f09640 1 --2- 172.21.15.123:0/3630295631 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff1040b2d40 0x7ff1041e21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:24:07.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.399+0000 7ff10970a640 1 --2- 172.21.15.123:0/3630295631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff10415bcf0 0x7ff104157610 secure :-1 s=READY pgs=2384 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc00c700 tx=0x7ff0fc00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:07.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.399+0000 7ff1017fa640 1 -- 172.21.15.123:0/3630295631 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc018070 con 0x7ff10415bcf0 2024-09-15T23:24:07.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.399+0000 7ff1017fa640 1 -- 172.21.15.123:0/3630295631 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0fc00ce10 con 0x7ff10415bcf0 2024-09-15T23:24:07.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.399+0000 7ff1017fa640 1 -- 172.21.15.123:0/3630295631 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc00a880 con 0x7ff10415bcf0 2024-09-15T23:24:07.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.399+0000 7ff10b16d640 1 -- 172.21.15.123:0/3630295631 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1041e2ba0 con 0x7ff10415bcf0 2024-09-15T23:24:07.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.399+0000 7ff10b16d640 1 -- 172.21.15.123:0/3630295631 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff104157b50 con 0x7ff10415bcf0 2024-09-15T23:24:07.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.400+0000 7ff10b16d640 1 -- 172.21.15.123:0/3630295631 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff104072890 con 0x7ff10415bcf0 2024-09-15T23:24:07.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.401+0000 7ff1017fa640 1 -- 172.21.15.123:0/3630295631 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff0fc01b070 con 0x7ff10415bcf0 2024-09-15T23:24:07.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.401+0000 7ff1017fa640 1 --2- 172.21.15.123:0/3630295631 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff0f006c2b0 0x7ff0f006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:07.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.401+0000 7ff1017fa640 1 -- 172.21.15.123:0/3630295631 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 5709+0+0 (secure 0 0 0) 0x7ff0fc08a9d0 con 0x7ff10415bcf0 2024-09-15T23:24:07.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.401+0000 7ff108f09640 1 --2- 172.21.15.123:0/3630295631 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff0f006c2b0 0x7ff0f006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:07.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.402+0000 7ff108f09640 1 --2- 172.21.15.123:0/3630295631 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff0f006c2b0 0x7ff0f006e770 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4009ac0 tx=0x7ff0f4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:07.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.405+0000 7ff1017fa640 1 -- 172.21.15.123:0/3630295631 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff0fc059140 con 0x7ff10415bcf0 2024-09-15T23:24:07.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.566+0000 7ff10b16d640 1 -- 172.21.15.123:0/3630295631 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff10413ddb0 con 0x7ff0f006c2b0 2024-09-15T23:24:07.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.572+0000 7ff1017fa640 1 -- 172.21.15.123:0/3630295631 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242644 (secure 0 0 0) 0x7ff0f4010910 con 0x7ff0f006c2b0 2024-09-15T23:24:07.575 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:07.577 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:24:07.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.575+0000 7ff10b16d640 1 -- 172.21.15.123:0/3630295631 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff0f006c2b0 msgr2=0x7ff0f006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:07.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.575+0000 7ff10b16d640 1 --2- 172.21.15.123:0/3630295631 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff0f006c2b0 0x7ff0f006e770 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4009ac0 tx=0x7ff0f4008040 comp rx=0 tx=0).stop 2024-09-15T23:24:07.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.575+0000 7ff10b16d640 1 -- 172.21.15.123:0/3630295631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff10415bcf0 msgr2=0x7ff104157610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:07.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.575+0000 7ff10b16d640 1 --2- 172.21.15.123:0/3630295631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff10415bcf0 0x7ff104157610 secure :-1 s=READY pgs=2384 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc00c700 tx=0x7ff0fc00cbc0 comp rx=0 tx=0).stop 2024-09-15T23:24:07.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.575+0000 7ff10b16d640 1 -- 172.21.15.123:0/3630295631 shutdown_connections 2024-09-15T23:24:07.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.575+0000 7ff10b16d640 1 --2- 172.21.15.123:0/3630295631 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ff0f006c2b0 0x7ff0f006e770 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:07.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.575+0000 7ff10b16d640 1 --2- 172.21.15.123:0/3630295631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff10415bcf0 0x7ff104157610 unknown :-1 s=CLOSED pgs=2384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:07.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.575+0000 7ff10b16d640 1 --2- 172.21.15.123:0/3630295631 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ff10413eb20 0x7ff10413d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:07.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.575+0000 7ff10b16d640 1 --2- 172.21.15.123:0/3630295631 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ff1040b2d40 0x7ff1041e21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:07.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.575+0000 7ff10b16d640 1 -- 172.21.15.123:0/3630295631 >> 172.21.15.123:0/3630295631 conn(0x7ff1040ccec0 msgr2=0x7ff104072ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:07.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.575+0000 7ff10b16d640 1 -- 172.21.15.123:0/3630295631 shutdown_connections 2024-09-15T23:24:07.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.575+0000 7ff10b16d640 1 -- 172.21.15.123:0/3630295631 wait complete. 2024-09-15T23:24:07.587 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":561,"stamp":"2024-09-15T23:24:05.674086+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":112,"acting":112,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":452368,"kb_used_data":20992,"kb_used_omap":12,"kb_used_meta":431155,"kb_avail":754522352,"statfs":{"total":773094113280,"available":772630888448,"internally_reserved":0,"allocated":21495808,"data_stored":10160822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":441503280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000916"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.227236+0000","last_change":"2024-09-15T23:24:03.227236+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.227236+0000","last_undegraded":"2024-09-15T23:24:03.227236+0000","last_fullsized":"2024-09-15T23:24:03.227236+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.224505+0000","last_change":"2024-09-15T23:24:03.224505+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.224505+0000","last_undegraded":"2024-09-15T23:24:03.224505+0000","last_fullsized":"2024-09-15T23:24:03.224505+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.224018+0000","last_change":"2024-09-15T23:24:03.224018+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.224018+0000","last_undegraded":"2024-09-15T23:24:03.224018+0000","last_fullsized":"2024-09-15T23:24:03.224018+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.223475+0000","last_change":"2024-09-15T23:24:03.223475+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.223475+0000","last_undegraded":"2024-09-15T23:24:03.223475+0000","last_fullsized":"2024-09-15T23:24:03.223475+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.228486+0000","last_change":"2024-09-15T23:24:03.228486+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.228486+0000","last_undegraded":"2024-09-15T23:24:03.228486+0000","last_fullsized":"2024-09-15T23:24:03.228486+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.222842+0000","last_change":"2024-09-15T23:24:03.222842+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.222842+0000","last_undegraded":"2024-09-15T23:24:03.222842+0000","last_fullsized":"2024-09-15T23:24:03.222842+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.227577+0000","last_change":"2024-09-15T23:24:03.227577+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.227577+0000","last_undegraded":"2024-09-15T23:24:03.227577+0000","last_fullsized":"2024-09-15T23:24:03.227577+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.226388+0000","last_change":"2024-09-15T23:24:03.226388+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.226388+0000","last_undegraded":"2024-09-15T23:24:03.226388+0000","last_fullsized":"2024-09-15T23:24:03.226388+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.224847+0000","last_change":"2024-09-15T23:24:03.224847+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.224847+0000","last_undegraded":"2024-09-15T23:24:03.224847+0000","last_fullsized":"2024-09-15T23:24:03.224847+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.230590+0000","last_change":"2024-09-15T23:24:03.230590+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.230590+0000","last_undegraded":"2024-09-15T23:24:03.230590+0000","last_fullsized":"2024-09-15T23:24:03.230590+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.226794+0000","last_change":"2024-09-15T23:24:03.226794+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.226794+0000","last_undegraded":"2024-09-15T23:24:03.226794+0000","last_fullsized":"2024-09-15T23:24:03.226794+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.224229+0000","last_change":"2024-09-15T23:24:03.224229+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.224229+0000","last_undegraded":"2024-09-15T23:24:03.224229+0000","last_fullsized":"2024-09-15T23:24:03.224229+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.223368+0000","last_change":"2024-09-15T23:24:03.223368+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.223368+0000","last_undegraded":"2024-09-15T23:24:03.223368+0000","last_fullsized":"2024-09-15T23:24:03.223368+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.223265+0000","last_change":"2024-09-15T23:24:03.223265+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.223265+0000","last_undegraded":"2024-09-15T23:24:03.223265+0000","last_fullsized":"2024-09-15T23:24:03.223265+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.228304+0000","last_change":"2024-09-15T23:24:03.228304+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.228304+0000","last_undegraded":"2024-09-15T23:24:03.228304+0000","last_fullsized":"2024-09-15T23:24:03.228304+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.226416+0000","last_change":"2024-09-15T23:24:03.226416+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.226416+0000","last_undegraded":"2024-09-15T23:24:03.226416+0000","last_fullsized":"2024-09-15T23:24:03.226416+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.223740+0000","last_change":"2024-09-15T23:24:03.223740+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.223740+0000","last_undegraded":"2024-09-15T23:24:03.223740+0000","last_fullsized":"2024-09-15T23:24:03.223740+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:02.210764+0000","last_change":"2024-09-15T23:24:02.210764+0000","last_active":"2024-09-15T23:24:02.210764+0000","last_peered":"2024-09-15T23:24:02.210764+0000","last_clean":"2024-09-15T23:24:02.210764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:02.210764+0000","last_undegraded":"2024-09-15T23:24:02.210764+0000","last_fullsized":"2024-09-15T23:24:02.210764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.233971+0000","last_change":"2024-09-15T23:24:03.232380+0000","last_active":"2024-09-15T23:24:03.233971+0000","last_peered":"2024-09-15T23:24:03.233971+0000","last_clean":"2024-09-15T23:24:03.233971+0000","last_became_active":"2024-09-15T23:24:03.225881+0000","last_became_peered":"2024-09-15T23:24:03.225881+0000","last_unstale":"2024-09-15T23:24:03.233971+0000","last_undegraded":"2024-09-15T23:24:03.233971+0000","last_fullsized":"2024-09-15T23:24:03.233971+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:52:16.001769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.229217+0000","last_change":"2024-09-15T23:24:03.229217+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.229217+0000","last_undegraded":"2024-09-15T23:24:03.229217+0000","last_fullsized":"2024-09-15T23:24:03.229217+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.237582+0000","last_change":"2024-09-15T23:24:03.236362+0000","last_active":"2024-09-15T23:24:03.237582+0000","last_peered":"2024-09-15T23:24:03.237582+0000","last_clean":"2024-09-15T23:24:03.237582+0000","last_became_active":"2024-09-15T23:24:03.236134+0000","last_became_peered":"2024-09-15T23:24:03.236134+0000","last_unstale":"2024-09-15T23:24:03.237582+0000","last_undegraded":"2024-09-15T23:24:03.237582+0000","last_fullsized":"2024-09-15T23:24:03.237582+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:29:01.714652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.223497+0000","last_change":"2024-09-15T23:24:03.223497+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.223497+0000","last_undegraded":"2024-09-15T23:24:03.223497+0000","last_fullsized":"2024-09-15T23:24:03.223497+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:02.210764+0000","last_change":"2024-09-15T23:24:02.210764+0000","last_active":"2024-09-15T23:24:02.210764+0000","last_peered":"2024-09-15T23:24:02.210764+0000","last_clean":"2024-09-15T23:24:02.210764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:02.210764+0000","last_undegraded":"2024-09-15T23:24:02.210764+0000","last_fullsized":"2024-09-15T23:24:02.210764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.230537+0000","last_change":"2024-09-15T23:24:03.226435+0000","last_active":"2024-09-15T23:24:03.230537+0000","last_peered":"2024-09-15T23:24:03.230537+0000","last_clean":"2024-09-15T23:24:03.230537+0000","last_became_active":"2024-09-15T23:24:03.226192+0000","last_became_peered":"2024-09-15T23:24:03.226192+0000","last_unstale":"2024-09-15T23:24:03.230537+0000","last_undegraded":"2024-09-15T23:24:03.230537+0000","last_fullsized":"2024-09-15T23:24:03.230537+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:10:29.458773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.242172+0000","last_change":"2024-09-15T23:24:03.238146+0000","last_active":"2024-09-15T23:24:03.242172+0000","last_peered":"2024-09-15T23:24:03.242172+0000","last_clean":"2024-09-15T23:24:03.242172+0000","last_became_active":"2024-09-15T23:24:03.237891+0000","last_became_peered":"2024-09-15T23:24:03.237891+0000","last_unstale":"2024-09-15T23:24:03.242172+0000","last_undegraded":"2024-09-15T23:24:03.242172+0000","last_fullsized":"2024-09-15T23:24:03.242172+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:02:57.404523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.223037+0000","last_change":"2024-09-15T23:24:03.223037+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.223037+0000","last_undegraded":"2024-09-15T23:24:03.223037+0000","last_fullsized":"2024-09-15T23:24:03.223037+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:02.210764+0000","last_change":"2024-09-15T23:24:02.210764+0000","last_active":"2024-09-15T23:24:02.210764+0000","last_peered":"2024-09-15T23:24:02.210764+0000","last_clean":"2024-09-15T23:24:02.210764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:02.210764+0000","last_undegraded":"2024-09-15T23:24:02.210764+0000","last_fullsized":"2024-09-15T23:24:02.210764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.226896+0000","last_change":"2024-09-15T23:24:03.226896+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.226896+0000","last_undegraded":"2024-09-15T23:24:03.226896+0000","last_fullsized":"2024-09-15T23:24:03.226896+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.239471+0000","last_change":"2024-09-15T23:24:03.233947+0000","last_active":"2024-09-15T23:24:03.239471+0000","last_peered":"2024-09-15T23:24:03.239471+0000","last_clean":"2024-09-15T23:24:03.239471+0000","last_became_active":"2024-09-15T23:24:03.233577+0000","last_became_peered":"2024-09-15T23:24:03.233577+0000","last_unstale":"2024-09-15T23:24:03.239471+0000","last_undegraded":"2024-09-15T23:24:03.239471+0000","last_fullsized":"2024-09-15T23:24:03.239471+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:19:20.973913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.222988+0000","last_change":"2024-09-15T23:24:03.222988+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.222988+0000","last_undegraded":"2024-09-15T23:24:03.222988+0000","last_fullsized":"2024-09-15T23:24:03.222988+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:02.210764+0000","last_change":"2024-09-15T23:24:02.210764+0000","last_active":"2024-09-15T23:24:02.210764+0000","last_peered":"2024-09-15T23:24:02.210764+0000","last_clean":"2024-09-15T23:24:02.210764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:02.210764+0000","last_undegraded":"2024-09-15T23:24:02.210764+0000","last_fullsized":"2024-09-15T23:24:02.210764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.227189+0000","last_change":"2024-09-15T23:24:03.227189+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.227189+0000","last_undegraded":"2024-09-15T23:24:03.227189+0000","last_fullsized":"2024-09-15T23:24:03.227189+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:02.210764+0000","last_change":"2024-09-15T23:24:02.210764+0000","last_active":"2024-09-15T23:24:02.210764+0000","last_peered":"2024-09-15T23:24:02.210764+0000","last_clean":"2024-09-15T23:24:02.210764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:02.210764+0000","last_undegraded":"2024-09-15T23:24:02.210764+0000","last_fullsized":"2024-09-15T23:24:02.210764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.226402+0000","last_change":"2024-09-15T23:24:03.226402+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.226402+0000","last_undegraded":"2024-09-15T23:24:03.226402+0000","last_fullsized":"2024-09-15T23:24:03.226402+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:02.210764+0000","last_change":"2024-09-15T23:24:02.210764+0000","last_active":"2024-09-15T23:24:02.210764+0000","last_peered":"2024-09-15T23:24:02.210764+0000","last_clean":"2024-09-15T23:24:02.210764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:02.210764+0000","last_undegraded":"2024-09-15T23:24:02.210764+0000","last_fullsized":"2024-09-15T23:24:02.210764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:02.210764+0000","last_change":"2024-09-15T23:24:02.210764+0000","last_active":"2024-09-15T23:24:02.210764+0000","last_peered":"2024-09-15T23:24:02.210764+0000","last_clean":"2024-09-15T23:24:02.210764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:02.210764+0000","last_undegraded":"2024-09-15T23:24:02.210764+0000","last_fullsized":"2024-09-15T23:24:02.210764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.227303+0000","last_change":"2024-09-15T23:24:03.227303+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.227303+0000","last_undegraded":"2024-09-15T23:24:03.227303+0000","last_fullsized":"2024-09-15T23:24:03.227303+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:02.210764+0000","last_change":"2024-09-15T23:24:02.210764+0000","last_active":"2024-09-15T23:24:02.210764+0000","last_peered":"2024-09-15T23:24:02.210764+0000","last_clean":"2024-09-15T23:24:02.210764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:02.210764+0000","last_undegraded":"2024-09-15T23:24:02.210764+0000","last_fullsized":"2024-09-15T23:24:02.210764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.227693+0000","last_change":"2024-09-15T23:24:03.227693+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.227693+0000","last_undegraded":"2024-09-15T23:24:03.227693+0000","last_fullsized":"2024-09-15T23:24:03.227693+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:02.210764+0000","last_change":"2024-09-15T23:24:02.210764+0000","last_active":"2024-09-15T23:24:02.210764+0000","last_peered":"2024-09-15T23:24:02.210764+0000","last_clean":"2024-09-15T23:24:02.210764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:02.210764+0000","last_undegraded":"2024-09-15T23:24:02.210764+0000","last_fullsized":"2024-09-15T23:24:02.210764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.223048+0000","last_change":"2024-09-15T23:24:03.223048+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.223048+0000","last_undegraded":"2024-09-15T23:24:03.223048+0000","last_fullsized":"2024-09-15T23:24:03.223048+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.235426+0000","last_change":"2024-09-15T23:24:03.234776+0000","last_active":"2024-09-15T23:24:03.235426+0000","last_peered":"2024-09-15T23:24:03.235426+0000","last_clean":"2024-09-15T23:24:03.235426+0000","last_became_active":"2024-09-15T23:24:03.234449+0000","last_became_peered":"2024-09-15T23:24:03.234449+0000","last_unstale":"2024-09-15T23:24:03.235426+0000","last_undegraded":"2024-09-15T23:24:03.235426+0000","last_fullsized":"2024-09-15T23:24:03.235426+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:47:38.673671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.240876+0000","last_change":"2024-09-15T23:24:03.235856+0000","last_active":"2024-09-15T23:24:03.240876+0000","last_peered":"2024-09-15T23:24:03.240876+0000","last_clean":"2024-09-15T23:24:03.240876+0000","last_became_active":"2024-09-15T23:24:03.235564+0000","last_became_peered":"2024-09-15T23:24:03.235564+0000","last_unstale":"2024-09-15T23:24:03.240876+0000","last_undegraded":"2024-09-15T23:24:03.240876+0000","last_fullsized":"2024-09-15T23:24:03.240876+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:01.343626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:02.210764+0000","last_change":"2024-09-15T23:24:02.210764+0000","last_active":"2024-09-15T23:24:02.210764+0000","last_peered":"2024-09-15T23:24:02.210764+0000","last_clean":"2024-09-15T23:24:02.210764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:02.210764+0000","last_undegraded":"2024-09-15T23:24:02.210764+0000","last_fullsized":"2024-09-15T23:24:02.210764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.223231+0000","last_change":"2024-09-15T23:24:03.223231+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.223231+0000","last_undegraded":"2024-09-15T23:24:03.223231+0000","last_fullsized":"2024-09-15T23:24:03.223231+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.237191+0000","last_change":"2024-09-15T23:24:03.233389+0000","last_active":"2024-09-15T23:24:03.237191+0000","last_peered":"2024-09-15T23:24:03.237191+0000","last_clean":"2024-09-15T23:24:03.237191+0000","last_became_active":"2024-09-15T23:24:03.233139+0000","last_became_peered":"2024-09-15T23:24:03.233139+0000","last_unstale":"2024-09-15T23:24:03.237191+0000","last_undegraded":"2024-09-15T23:24:03.237191+0000","last_fullsized":"2024-09-15T23:24:03.237191+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:06:36.696878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.228859+0000","last_change":"2024-09-15T23:24:03.228859+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.228859+0000","last_undegraded":"2024-09-15T23:24:03.228859+0000","last_fullsized":"2024-09-15T23:24:03.228859+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:02.210764+0000","last_change":"2024-09-15T23:24:02.210764+0000","last_active":"2024-09-15T23:24:02.210764+0000","last_peered":"2024-09-15T23:24:02.210764+0000","last_clean":"2024-09-15T23:24:02.210764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:02.210764+0000","last_undegraded":"2024-09-15T23:24:02.210764+0000","last_fullsized":"2024-09-15T23:24:02.210764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.239487+0000","last_change":"2024-09-15T23:24:03.234239+0000","last_active":"2024-09-15T23:24:03.239487+0000","last_peered":"2024-09-15T23:24:03.239487+0000","last_clean":"2024-09-15T23:24:03.239487+0000","last_became_active":"2024-09-15T23:24:03.233978+0000","last_became_peered":"2024-09-15T23:24:03.233978+0000","last_unstale":"2024-09-15T23:24:03.239487+0000","last_undegraded":"2024-09-15T23:24:03.239487+0000","last_fullsized":"2024-09-15T23:24:03.239487+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:06:10.713689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.229398+0000","last_change":"2024-09-15T23:24:03.229398+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.229398+0000","last_undegraded":"2024-09-15T23:24:03.229398+0000","last_fullsized":"2024-09-15T23:24:03.229398+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.239117+0000","last_change":"2024-09-15T23:24:03.236689+0000","last_active":"2024-09-15T23:24:03.239117+0000","last_peered":"2024-09-15T23:24:03.239117+0000","last_clean":"2024-09-15T23:24:03.239117+0000","last_became_active":"2024-09-15T23:24:03.236226+0000","last_became_peered":"2024-09-15T23:24:03.236226+0000","last_unstale":"2024-09-15T23:24:03.239117+0000","last_undegraded":"2024-09-15T23:24:03.239117+0000","last_fullsized":"2024-09-15T23:24:03.239117+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:25.462598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.237912+0000","last_change":"2024-09-15T23:24:03.235609+0000","last_active":"2024-09-15T23:24:03.237912+0000","last_peered":"2024-09-15T23:24:03.237912+0000","last_clean":"2024-09-15T23:24:03.237912+0000","last_became_active":"2024-09-15T23:24:03.235358+0000","last_became_peered":"2024-09-15T23:24:03.235358+0000","last_unstale":"2024-09-15T23:24:03.237912+0000","last_undegraded":"2024-09-15T23:24:03.237912+0000","last_fullsized":"2024-09-15T23:24:03.237912+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:39.184956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.241274+0000","last_change":"2024-09-15T23:24:03.240718+0000","last_active":"2024-09-15T23:24:03.241274+0000","last_peered":"2024-09-15T23:24:03.241274+0000","last_clean":"2024-09-15T23:24:03.241274+0000","last_became_active":"2024-09-15T23:24:03.240388+0000","last_became_peered":"2024-09-15T23:24:03.240388+0000","last_unstale":"2024-09-15T23:24:03.241274+0000","last_undegraded":"2024-09-15T23:24:03.241274+0000","last_fullsized":"2024-09-15T23:24:03.241274+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:37:34.205282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:02.210764+0000","last_change":"2024-09-15T23:24:02.210764+0000","last_active":"2024-09-15T23:24:02.210764+0000","last_peered":"2024-09-15T23:24:02.210764+0000","last_clean":"2024-09-15T23:24:02.210764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:02.210764+0000","last_undegraded":"2024-09-15T23:24:02.210764+0000","last_fullsized":"2024-09-15T23:24:02.210764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.223056+0000","last_change":"2024-09-15T23:24:03.223056+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.223056+0000","last_undegraded":"2024-09-15T23:24:03.223056+0000","last_fullsized":"2024-09-15T23:24:03.223056+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.240856+0000","last_change":"2024-09-15T23:24:03.234599+0000","last_active":"2024-09-15T23:24:03.240856+0000","last_peered":"2024-09-15T23:24:03.240856+0000","last_clean":"2024-09-15T23:24:03.240856+0000","last_became_active":"2024-09-15T23:24:03.234337+0000","last_became_peered":"2024-09-15T23:24:03.234337+0000","last_unstale":"2024-09-15T23:24:03.240856+0000","last_undegraded":"2024-09-15T23:24:03.240856+0000","last_fullsized":"2024-09-15T23:24:03.240856+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:39.273467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.222576+0000","last_change":"2024-09-15T23:24:03.222576+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.222576+0000","last_undegraded":"2024-09-15T23:24:03.222576+0000","last_fullsized":"2024-09-15T23:24:03.222576+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.239699+0000","last_change":"2024-09-15T23:24:03.234545+0000","last_active":"2024-09-15T23:24:03.239699+0000","last_peered":"2024-09-15T23:24:03.239699+0000","last_clean":"2024-09-15T23:24:03.239699+0000","last_became_active":"2024-09-15T23:24:03.234294+0000","last_became_peered":"2024-09-15T23:24:03.234294+0000","last_unstale":"2024-09-15T23:24:03.239699+0000","last_undegraded":"2024-09-15T23:24:03.239699+0000","last_fullsized":"2024-09-15T23:24:03.239699+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:17:01.629821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:03.215032+0000","last_change":"2024-09-15T23:24:03.215032+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.215032+0000","last_undegraded":"2024-09-15T23:24:03.215032+0000","last_fullsized":"2024-09-15T23:24:03.215032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.237340+0000","last_change":"2024-09-15T23:24:03.235147+0000","last_active":"2024-09-15T23:24:03.237340+0000","last_peered":"2024-09-15T23:24:03.237340+0000","last_clean":"2024-09-15T23:24:03.237340+0000","last_became_active":"2024-09-15T23:24:03.234881+0000","last_became_peered":"2024-09-15T23:24:03.234881+0000","last_unstale":"2024-09-15T23:24:03.237340+0000","last_undegraded":"2024-09-15T23:24:03.237340+0000","last_fullsized":"2024-09-15T23:24:03.237340+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:28.821635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.222054+0000","last_change":"2024-09-15T23:24:03.222054+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.222054+0000","last_undegraded":"2024-09-15T23:24:03.222054+0000","last_fullsized":"2024-09-15T23:24:03.222054+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.238608+0000","last_change":"2024-09-15T23:24:03.237859+0000","last_active":"2024-09-15T23:24:03.238608+0000","last_peered":"2024-09-15T23:24:03.238608+0000","last_clean":"2024-09-15T23:24:03.238608+0000","last_became_active":"2024-09-15T23:24:03.237582+0000","last_became_peered":"2024-09-15T23:24:03.237582+0000","last_unstale":"2024-09-15T23:24:03.238608+0000","last_undegraded":"2024-09-15T23:24:03.238608+0000","last_fullsized":"2024-09-15T23:24:03.238608+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:57.451165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.222550+0000","last_change":"2024-09-15T23:24:03.222550+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.222550+0000","last_undegraded":"2024-09-15T23:24:03.222550+0000","last_fullsized":"2024-09-15T23:24:03.222550+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:02.210764+0000","last_change":"2024-09-15T23:24:02.210764+0000","last_active":"2024-09-15T23:24:02.210764+0000","last_peered":"2024-09-15T23:24:02.210764+0000","last_clean":"2024-09-15T23:24:02.210764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:02.210764+0000","last_undegraded":"2024-09-15T23:24:02.210764+0000","last_fullsized":"2024-09-15T23:24:02.210764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.222629+0000","last_change":"2024-09-15T23:24:03.222629+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.222629+0000","last_undegraded":"2024-09-15T23:24:03.222629+0000","last_fullsized":"2024-09-15T23:24:03.222629+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T23:24:02.210764+0000","last_change":"2024-09-15T23:24:02.210764+0000","last_active":"2024-09-15T23:24:02.210764+0000","last_peered":"2024-09-15T23:24:02.210764+0000","last_clean":"2024-09-15T23:24:02.210764+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:02.210764+0000","last_undegraded":"2024-09-15T23:24:02.210764+0000","last_fullsized":"2024-09-15T23:24:02.210764+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.230004+0000","last_change":"2024-09-15T23:24:03.230004+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.230004+0000","last_undegraded":"2024-09-15T23:24:03.230004+0000","last_fullsized":"2024-09-15T23:24:03.230004+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.239455+0000","last_change":"2024-09-15T23:24:03.233988+0000","last_active":"2024-09-15T23:24:03.239455+0000","last_peered":"2024-09-15T23:24:03.239455+0000","last_clean":"2024-09-15T23:24:03.239455+0000","last_became_active":"2024-09-15T23:24:03.233730+0000","last_became_peered":"2024-09-15T23:24:03.233730+0000","last_unstale":"2024-09-15T23:24:03.239455+0000","last_undegraded":"2024-09-15T23:24:03.239455+0000","last_fullsized":"2024-09-15T23:24:03.239455+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:10.138162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.229178+0000","last_change":"2024-09-15T23:24:03.229178+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.229178+0000","last_undegraded":"2024-09-15T23:24:03.229178+0000","last_fullsized":"2024-09-15T23:24:03.229178+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.230402+0000","last_change":"2024-09-15T23:24:03.226290+0000","last_active":"2024-09-15T23:24:03.230402+0000","last_peered":"2024-09-15T23:24:03.230402+0000","last_clean":"2024-09-15T23:24:03.230402+0000","last_became_active":"2024-09-15T23:24:03.226044+0000","last_became_peered":"2024-09-15T23:24:03.226044+0000","last_unstale":"2024-09-15T23:24:03.230402+0000","last_undegraded":"2024-09-15T23:24:03.230402+0000","last_fullsized":"2024-09-15T23:24:03.230402+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:49.262116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":511,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.219541+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:24:03.219541+0000","last_peered":"2024-09-15T23:24:03.219541+0000","last_clean":"2024-09-15T23:24:03.219541+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:24:03.219541+0000","last_undegraded":"2024-09-15T23:24:03.219541+0000","last_fullsized":"2024-09-15T23:24:03.219541+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":74,"acting":74,"num_store_stats":4},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":36,"acting":36,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60056,"kb_used_data":2500,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311784,"statfs":{"total":96636764160,"available":96575266816,"internally_reserved":0,"allocated":2560000,"data_stored":1132693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55900,"kb_used_data":2488,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315940,"statfs":{"total":96636764160,"available":96579522560,"internally_reserved":0,"allocated":2547712,"data_stored":1126418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476885,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56476,"kb_used_data":3068,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315364,"statfs":{"total":96636764160,"available":96578932736,"internally_reserved":0,"allocated":3141632,"data_stored":1716786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476885,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51736,"kb_used_data":2500,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320104,"statfs":{"total":96636764160,"available":96583786496,"internally_reserved":0,"allocated":2560000,"data_stored":1132693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542291,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51720,"kb_used_data":2476,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320120,"statfs":{"total":96636764160,"available":96583802880,"internally_reserved":0,"allocated":2535424,"data_stored":1120601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542291,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55880,"kb_used_data":2476,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315960,"statfs":{"total":96636764160,"available":96579543040,"internally_reserved":0,"allocated":2535424,"data_stored":1120601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542290,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60604,"kb_used_data":3044,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311236,"statfs":{"total":96636764160,"available":96574705664,"internally_reserved":0,"allocated":3117056,"data_stored":1705842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542292,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59996,"kb_used_data":2440,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311844,"statfs":{"total":96636764160,"available":96575328256,"internally_reserved":0,"allocated":2498560,"data_stored":1105188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:24:07.591 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:24:07.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.725+0000 7f0e3858d640 1 Processor -- start 2024-09-15T23:24:07.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.725+0000 7f0e3858d640 1 -- start start 2024-09-15T23:24:07.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.726+0000 7f0e3858d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0e300b6830 0x7f0e3006e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:07.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.726+0000 7f0e3858d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f0e300b02b0 0x7f0e3006e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:07.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.726+0000 7f0e3858d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e30067b50 con 0x7f0e3015c4b0 2024-09-15T23:24:07.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.726+0000 7f0e3858d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f0e300ce860 con 0x7f0e300b6830 2024-09-15T23:24:07.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.726+0000 7f0e3858d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f0e30070130 con 0x7f0e300b02b0 2024-09-15T23:24:07.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.726+0000 7f0e35b28640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0e300b6830 0x7f0e3006e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:07.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.726+0000 7f0e36329640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f0e3015c4b0 0x7f0e300b6120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39194/0 (socket says 172.21.15.123:39194) 2024-09-15T23:24:07.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.726+0000 7f0e35b28640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0e300b6830 0x7f0e3006e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39050/0 (socket says 172.21.15.123:39050) 2024-09-15T23:24:07.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.726+0000 7f0e36329640 1 -- 172.21.15.123:0/3294278202 learned_addr learned my addr 172.21.15.123:0/3294278202 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:07.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.726+0000 7f0e36b2a640 1 --2- 172.21.15.123:0/3294278202 >> v2:172.21.15.188:3300/0 conn(0x7f0e300b02b0 0x7f0e3006e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:07.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.726+0000 7f0e35b28640 1 -- 172.21.15.123:0/3294278202 >> v2:172.21.15.188:3300/0 conn(0x7f0e300b02b0 msgr2=0x7f0e3006e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:07.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.726+0000 7f0e35b28640 1 --2- 172.21.15.123:0/3294278202 >> v2:172.21.15.188:3300/0 conn(0x7f0e300b02b0 0x7f0e3006e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:07.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.726+0000 7f0e35b28640 1 -- 172.21.15.123:0/3294278202 >> v1:172.21.15.123:6789/0 conn(0x7f0e3015c4b0 legacy=0x7f0e300b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:07.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.726+0000 7f0e35b28640 1 -- 172.21.15.123:0/3294278202 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e3006fe50 con 0x7f0e300b6830 2024-09-15T23:24:07.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.727+0000 7f0e35b28640 1 --2- 172.21.15.123:0/3294278202 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e300b6830 0x7f0e3006e1e0 secure :-1 s=READY pgs=2386 cs=0 l=1 rev1=1 crypto rx=0x7f0e300ceae0 tx=0x7f0e2002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4839beac6d7bd68 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:07.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.727+0000 7f0e35327640 1 -- 172.21.15.123:0/3294278202 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e20037070 con 0x7f0e300b6830 2024-09-15T23:24:07.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.727+0000 7f0e35327640 1 -- 172.21.15.123:0/3294278202 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e20032440 con 0x7f0e300b6830 2024-09-15T23:24:07.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.727+0000 7f0e35327640 1 -- 172.21.15.123:0/3294278202 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e20032810 con 0x7f0e300b6830 2024-09-15T23:24:07.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.728+0000 7f0e3858d640 1 -- 172.21.15.123:0/3294278202 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e300b6830 msgr2=0x7f0e3006e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:07.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.728+0000 7f0e3858d640 1 --2- 172.21.15.123:0/3294278202 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e300b6830 0x7f0e3006e1e0 secure :-1 s=READY pgs=2386 cs=0 l=1 rev1=1 crypto rx=0x7f0e300ceae0 tx=0x7f0e2002a1a0 comp rx=0 tx=0).stop 2024-09-15T23:24:07.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.728+0000 7f0e3858d640 1 -- 172.21.15.123:0/3294278202 shutdown_connections 2024-09-15T23:24:07.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.728+0000 7f0e3858d640 1 --2- 172.21.15.123:0/3294278202 >> v2:172.21.15.188:3300/0 conn(0x7f0e300b02b0 0x7f0e3006e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:07.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.728+0000 7f0e3858d640 1 --2- 172.21.15.123:0/3294278202 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e300b6830 0x7f0e3006e1e0 unknown :-1 s=CLOSED pgs=2386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:07.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.728+0000 7f0e3858d640 1 -- 172.21.15.123:0/3294278202 >> 172.21.15.123:0/3294278202 conn(0x7f0e300b0a80 msgr2=0x7f0e300b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:07.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.728+0000 7f0e3858d640 1 -- 172.21.15.123:0/3294278202 shutdown_connections 2024-09-15T23:24:07.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.728+0000 7f0e3858d640 1 -- 172.21.15.123:0/3294278202 wait complete. 2024-09-15T23:24:07.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.729+0000 7f0e3858d640 1 Processor -- start 2024-09-15T23:24:07.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.729+0000 7f0e3858d640 1 -- start start 2024-09-15T23:24:07.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.730+0000 7f0e3858d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0e300b02b0 0x7f0e301f4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:07.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.730+0000 7f0e3858d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0e300b6830 0x7f0e300ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:07.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.730+0000 7f0e3858d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e3015c4b0 0x7f0e300aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:07.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.730+0000 7f0e3858d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0e3006dcc0 con 0x7f0e3015c4b0 2024-09-15T23:24:07.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.730+0000 7f0e3858d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f0e300ce580 con 0x7f0e300b02b0 2024-09-15T23:24:07.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.730+0000 7f0e3858d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f0e3015c890 con 0x7f0e300b6830 2024-09-15T23:24:07.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.730+0000 7f0e36b2a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e3015c4b0 0x7f0e300aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:07.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.730+0000 7f0e36b2a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e3015c4b0 0x7f0e300aedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39058/0 (socket says 172.21.15.123:39058) 2024-09-15T23:24:07.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.730+0000 7f0e36b2a640 1 -- 172.21.15.123:0/4151187894 learned_addr learned my addr 172.21.15.123:0/4151187894 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:07.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.730+0000 7f0e36329640 1 --2- 172.21.15.123:0/4151187894 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0e300b02b0 0x7f0e301f4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:07.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.730+0000 7f0e35b28640 1 --2- 172.21.15.123:0/4151187894 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0e300b6830 0x7f0e300ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:07.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.730+0000 7f0e36b2a640 1 -- 172.21.15.123:0/4151187894 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0e300b6830 msgr2=0x7f0e300ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:07.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.730+0000 7f0e36b2a640 1 --2- 172.21.15.123:0/4151187894 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0e300b6830 0x7f0e300ae870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:07.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.730+0000 7f0e36b2a640 1 -- 172.21.15.123:0/4151187894 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0e300b02b0 msgr2=0x7f0e301f4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:07.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.730+0000 7f0e36b2a640 1 --2- 172.21.15.123:0/4151187894 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0e300b02b0 0x7f0e301f4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:07.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.730+0000 7f0e36b2a640 1 -- 172.21.15.123:0/4151187894 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e301f48c0 con 0x7f0e3015c4b0 2024-09-15T23:24:07.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.730+0000 7f0e36b2a640 1 --2- 172.21.15.123:0/4151187894 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e3015c4b0 0x7f0e300aedb0 secure :-1 s=READY pgs=2387 cs=0 l=1 rev1=1 crypto rx=0x7f0e28007e60 tx=0x7f0e2800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:07.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.730+0000 7f0e26ffd640 1 -- 172.21.15.123:0/4151187894 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e28014420 con 0x7f0e3015c4b0 2024-09-15T23:24:07.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.730+0000 7f0e26ffd640 1 -- 172.21.15.123:0/4151187894 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e28019070 con 0x7f0e3015c4b0 2024-09-15T23:24:07.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.730+0000 7f0e26ffd640 1 -- 172.21.15.123:0/4151187894 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e28014820 con 0x7f0e3015c4b0 2024-09-15T23:24:07.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.730+0000 7f0e3858d640 1 -- 172.21.15.123:0/4151187894 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e301f4ba0 con 0x7f0e3015c4b0 2024-09-15T23:24:07.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.730+0000 7f0e3858d640 1 -- 172.21.15.123:0/4151187894 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e301f5160 con 0x7f0e3015c4b0 2024-09-15T23:24:07.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.731+0000 7f0e3858d640 1 -- 172.21.15.123:0/4151187894 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e300d08e0 con 0x7f0e3015c4b0 2024-09-15T23:24:07.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.732+0000 7f0e26ffd640 1 -- 172.21.15.123:0/4151187894 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0e280149c0 con 0x7f0e3015c4b0 2024-09-15T23:24:07.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.732+0000 7f0e26ffd640 1 --2- 172.21.15.123:0/4151187894 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0e1406c2b0 0x7f0e1406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:07.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.732+0000 7f0e26ffd640 1 -- 172.21.15.123:0/4151187894 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 5709+0+0 (secure 0 0 0) 0x7f0e2808bc50 con 0x7f0e3015c4b0 2024-09-15T23:24:07.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.732+0000 7f0e36329640 1 --2- 172.21.15.123:0/4151187894 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0e1406c2b0 0x7f0e1406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:07.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.733+0000 7f0e36329640 1 --2- 172.21.15.123:0/4151187894 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0e1406c2b0 0x7f0e1406e770 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c000f60 tx=0x7f0e2c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:07.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.736+0000 7f0e26ffd640 1 -- 172.21.15.123:0/4151187894 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0e28091020 con 0x7f0e3015c4b0 2024-09-15T23:24:07.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.898+0000 7f0e3858d640 1 -- 172.21.15.123:0/4151187894 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0e300b6460 con 0x7f0e1406c2b0 2024-09-15T23:24:07.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.904+0000 7f0e26ffd640 1 -- 172.21.15.123:0/4151187894 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249401 (secure 0 0 0) 0x7f0e300b6460 con 0x7f0e1406c2b0 2024-09-15T23:24:07.908 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:07.909 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:24:07.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.907+0000 7f0e3858d640 1 -- 172.21.15.123:0/4151187894 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0e1406c2b0 msgr2=0x7f0e1406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:07.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.907+0000 7f0e3858d640 1 --2- 172.21.15.123:0/4151187894 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0e1406c2b0 0x7f0e1406e770 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c000f60 tx=0x7f0e2c009040 comp rx=0 tx=0).stop 2024-09-15T23:24:07.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.907+0000 7f0e3858d640 1 -- 172.21.15.123:0/4151187894 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e3015c4b0 msgr2=0x7f0e300aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:07.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.907+0000 7f0e3858d640 1 --2- 172.21.15.123:0/4151187894 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e3015c4b0 0x7f0e300aedb0 secure :-1 s=READY pgs=2387 cs=0 l=1 rev1=1 crypto rx=0x7f0e28007e60 tx=0x7f0e2800e4b0 comp rx=0 tx=0).stop 2024-09-15T23:24:07.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.907+0000 7f0e3858d640 1 -- 172.21.15.123:0/4151187894 shutdown_connections 2024-09-15T23:24:07.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.907+0000 7f0e3858d640 1 --2- 172.21.15.123:0/4151187894 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f0e1406c2b0 0x7f0e1406e770 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:07.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.907+0000 7f0e3858d640 1 --2- 172.21.15.123:0/4151187894 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e3015c4b0 0x7f0e300aedb0 unknown :-1 s=CLOSED pgs=2387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:07.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.907+0000 7f0e3858d640 1 --2- 172.21.15.123:0/4151187894 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0e300b6830 0x7f0e300ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:07.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.907+0000 7f0e3858d640 1 --2- 172.21.15.123:0/4151187894 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f0e300b02b0 0x7f0e301f4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:07.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.907+0000 7f0e3858d640 1 -- 172.21.15.123:0/4151187894 >> 172.21.15.123:0/4151187894 conn(0x7f0e300b0a80 msgr2=0x7f0e30158900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:07.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.907+0000 7f0e3858d640 1 -- 172.21.15.123:0/4151187894 shutdown_connections 2024-09-15T23:24:07.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:07.907+0000 7f0e3858d640 1 -- 172.21.15.123:0/4151187894 wait complete. 2024-09-15T23:24:07.919 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":562,"stamp":"2024-09-15T23:24:07.674492+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592686,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":182,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":452652,"kb_used_data":21280,"kb_used_omap":12,"kb_used_meta":431155,"kb_avail":754522068,"statfs":{"total":773094113280,"available":772630597632,"internally_reserved":0,"allocated":21790720,"data_stored":10286142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":441503280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2318,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.458601"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.227236+0000","last_change":"2024-09-15T23:24:03.227236+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.227236+0000","last_undegraded":"2024-09-15T23:24:03.227236+0000","last_fullsized":"2024-09-15T23:24:03.227236+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.224505+0000","last_change":"2024-09-15T23:24:03.224505+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.224505+0000","last_undegraded":"2024-09-15T23:24:03.224505+0000","last_fullsized":"2024-09-15T23:24:03.224505+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.224018+0000","last_change":"2024-09-15T23:24:03.224018+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.224018+0000","last_undegraded":"2024-09-15T23:24:03.224018+0000","last_fullsized":"2024-09-15T23:24:03.224018+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499039+0000","last_change":"2024-09-15T23:24:04.244198+0000","last_active":"2024-09-15T23:24:05.499039+0000","last_peered":"2024-09-15T23:24:05.499039+0000","last_clean":"2024-09-15T23:24:05.499039+0000","last_became_active":"2024-09-15T23:24:04.243898+0000","last_became_peered":"2024-09-15T23:24:04.243898+0000","last_unstale":"2024-09-15T23:24:05.499039+0000","last_undegraded":"2024-09-15T23:24:05.499039+0000","last_fullsized":"2024-09-15T23:24:05.499039+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:38.945626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498934+0000","last_change":"2024-09-15T23:24:04.245896+0000","last_active":"2024-09-15T23:24:05.498934+0000","last_peered":"2024-09-15T23:24:05.498934+0000","last_clean":"2024-09-15T23:24:05.498934+0000","last_became_active":"2024-09-15T23:24:04.245613+0000","last_became_peered":"2024-09-15T23:24:04.245613+0000","last_unstale":"2024-09-15T23:24:05.498934+0000","last_undegraded":"2024-09-15T23:24:05.498934+0000","last_fullsized":"2024-09-15T23:24:05.498934+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:05:01.144617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499266+0000","last_change":"2024-09-15T23:24:04.247643+0000","last_active":"2024-09-15T23:24:05.499266+0000","last_peered":"2024-09-15T23:24:05.499266+0000","last_clean":"2024-09-15T23:24:05.499266+0000","last_became_active":"2024-09-15T23:24:04.247094+0000","last_became_peered":"2024-09-15T23:24:04.247094+0000","last_unstale":"2024-09-15T23:24:05.499266+0000","last_undegraded":"2024-09-15T23:24:05.499266+0000","last_fullsized":"2024-09-15T23:24:05.499266+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:13:13.901339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.223475+0000","last_change":"2024-09-15T23:24:03.223475+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.223475+0000","last_undegraded":"2024-09-15T23:24:03.223475+0000","last_fullsized":"2024-09-15T23:24:03.223475+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.346013+0000","last_change":"2024-09-15T23:24:04.255143+0000","last_active":"2024-09-15T23:24:05.346013+0000","last_peered":"2024-09-15T23:24:05.346013+0000","last_clean":"2024-09-15T23:24:05.346013+0000","last_became_active":"2024-09-15T23:24:04.254835+0000","last_became_peered":"2024-09-15T23:24:04.254835+0000","last_unstale":"2024-09-15T23:24:05.346013+0000","last_undegraded":"2024-09-15T23:24:05.346013+0000","last_fullsized":"2024-09-15T23:24:05.346013+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:44.443319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.228486+0000","last_change":"2024-09-15T23:24:03.228486+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.228486+0000","last_undegraded":"2024-09-15T23:24:03.228486+0000","last_fullsized":"2024-09-15T23:24:03.228486+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498816+0000","last_change":"2024-09-15T23:24:04.248229+0000","last_active":"2024-09-15T23:24:05.498816+0000","last_peered":"2024-09-15T23:24:05.498816+0000","last_clean":"2024-09-15T23:24:05.498816+0000","last_became_active":"2024-09-15T23:24:04.247914+0000","last_became_peered":"2024-09-15T23:24:04.247914+0000","last_unstale":"2024-09-15T23:24:05.498816+0000","last_undegraded":"2024-09-15T23:24:05.498816+0000","last_fullsized":"2024-09-15T23:24:05.498816+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:09.507578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.222842+0000","last_change":"2024-09-15T23:24:03.222842+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.222842+0000","last_undegraded":"2024-09-15T23:24:03.222842+0000","last_fullsized":"2024-09-15T23:24:03.222842+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.227577+0000","last_change":"2024-09-15T23:24:03.227577+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.227577+0000","last_undegraded":"2024-09-15T23:24:03.227577+0000","last_fullsized":"2024-09-15T23:24:03.227577+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.226388+0000","last_change":"2024-09-15T23:24:03.226388+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.226388+0000","last_undegraded":"2024-09-15T23:24:03.226388+0000","last_fullsized":"2024-09-15T23:24:03.226388+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.224847+0000","last_change":"2024-09-15T23:24:03.224847+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.224847+0000","last_undegraded":"2024-09-15T23:24:03.224847+0000","last_fullsized":"2024-09-15T23:24:03.224847+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499212+0000","last_change":"2024-09-15T23:24:04.240413+0000","last_active":"2024-09-15T23:24:05.499212+0000","last_peered":"2024-09-15T23:24:05.499212+0000","last_clean":"2024-09-15T23:24:05.499212+0000","last_became_active":"2024-09-15T23:24:04.240130+0000","last_became_peered":"2024-09-15T23:24:04.240130+0000","last_unstale":"2024-09-15T23:24:05.499212+0000","last_undegraded":"2024-09-15T23:24:05.499212+0000","last_fullsized":"2024-09-15T23:24:05.499212+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:37.856457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.230590+0000","last_change":"2024-09-15T23:24:03.230590+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.230590+0000","last_undegraded":"2024-09-15T23:24:03.230590+0000","last_fullsized":"2024-09-15T23:24:03.230590+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.226794+0000","last_change":"2024-09-15T23:24:03.226794+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.226794+0000","last_undegraded":"2024-09-15T23:24:03.226794+0000","last_fullsized":"2024-09-15T23:24:03.226794+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.244597+0000","last_change":"2024-09-15T23:24:04.256728+0000","last_active":"2024-09-15T23:24:05.244597+0000","last_peered":"2024-09-15T23:24:05.244597+0000","last_clean":"2024-09-15T23:24:05.244597+0000","last_became_active":"2024-09-15T23:24:04.256464+0000","last_became_peered":"2024-09-15T23:24:04.256464+0000","last_unstale":"2024-09-15T23:24:05.244597+0000","last_undegraded":"2024-09-15T23:24:05.244597+0000","last_fullsized":"2024-09-15T23:24:05.244597+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:26:25.300606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499663+0000","last_change":"2024-09-15T23:24:04.235940+0000","last_active":"2024-09-15T23:24:05.499663+0000","last_peered":"2024-09-15T23:24:05.499663+0000","last_clean":"2024-09-15T23:24:05.499663+0000","last_became_active":"2024-09-15T23:24:04.235624+0000","last_became_peered":"2024-09-15T23:24:04.235624+0000","last_unstale":"2024-09-15T23:24:05.499663+0000","last_undegraded":"2024-09-15T23:24:05.499663+0000","last_fullsized":"2024-09-15T23:24:05.499663+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:23:10.557907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.244582+0000","last_change":"2024-09-15T23:24:04.251374+0000","last_active":"2024-09-15T23:24:05.244582+0000","last_peered":"2024-09-15T23:24:05.244582+0000","last_clean":"2024-09-15T23:24:05.244582+0000","last_became_active":"2024-09-15T23:24:04.251046+0000","last_became_peered":"2024-09-15T23:24:04.251046+0000","last_unstale":"2024-09-15T23:24:05.244582+0000","last_undegraded":"2024-09-15T23:24:05.244582+0000","last_fullsized":"2024-09-15T23:24:05.244582+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:18.413148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.244614+0000","last_change":"2024-09-15T23:24:04.254788+0000","last_active":"2024-09-15T23:24:05.244614+0000","last_peered":"2024-09-15T23:24:05.244614+0000","last_clean":"2024-09-15T23:24:05.244614+0000","last_became_active":"2024-09-15T23:24:04.254416+0000","last_became_peered":"2024-09-15T23:24:04.254416+0000","last_unstale":"2024-09-15T23:24:05.244614+0000","last_undegraded":"2024-09-15T23:24:05.244614+0000","last_fullsized":"2024-09-15T23:24:05.244614+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:25:57.392070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499304+0000","last_change":"2024-09-15T23:24:04.240142+0000","last_active":"2024-09-15T23:24:05.499304+0000","last_peered":"2024-09-15T23:24:05.499304+0000","last_clean":"2024-09-15T23:24:05.499304+0000","last_became_active":"2024-09-15T23:24:04.239869+0000","last_became_peered":"2024-09-15T23:24:04.239869+0000","last_unstale":"2024-09-15T23:24:05.499304+0000","last_undegraded":"2024-09-15T23:24:05.499304+0000","last_fullsized":"2024-09-15T23:24:05.499304+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:32.692520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.224229+0000","last_change":"2024-09-15T23:24:03.224229+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.224229+0000","last_undegraded":"2024-09-15T23:24:03.224229+0000","last_fullsized":"2024-09-15T23:24:03.224229+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498650+0000","last_change":"2024-09-15T23:24:04.240899+0000","last_active":"2024-09-15T23:24:05.498650+0000","last_peered":"2024-09-15T23:24:05.498650+0000","last_clean":"2024-09-15T23:24:05.498650+0000","last_became_active":"2024-09-15T23:24:04.240636+0000","last_became_peered":"2024-09-15T23:24:04.240636+0000","last_unstale":"2024-09-15T23:24:05.498650+0000","last_undegraded":"2024-09-15T23:24:05.498650+0000","last_fullsized":"2024-09-15T23:24:05.498650+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:18:51.671914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.223368+0000","last_change":"2024-09-15T23:24:03.223368+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.223368+0000","last_undegraded":"2024-09-15T23:24:03.223368+0000","last_fullsized":"2024-09-15T23:24:03.223368+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499702+0000","last_change":"2024-09-15T23:24:04.236738+0000","last_active":"2024-09-15T23:24:05.499702+0000","last_peered":"2024-09-15T23:24:05.499702+0000","last_clean":"2024-09-15T23:24:05.499702+0000","last_became_active":"2024-09-15T23:24:04.236454+0000","last_became_peered":"2024-09-15T23:24:04.236454+0000","last_unstale":"2024-09-15T23:24:05.499702+0000","last_undegraded":"2024-09-15T23:24:05.499702+0000","last_fullsized":"2024-09-15T23:24:05.499702+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:14:03.841374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.223265+0000","last_change":"2024-09-15T23:24:03.223265+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.223265+0000","last_undegraded":"2024-09-15T23:24:03.223265+0000","last_fullsized":"2024-09-15T23:24:03.223265+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.346194+0000","last_change":"2024-09-15T23:24:04.247692+0000","last_active":"2024-09-15T23:24:05.346194+0000","last_peered":"2024-09-15T23:24:05.346194+0000","last_clean":"2024-09-15T23:24:05.346194+0000","last_became_active":"2024-09-15T23:24:04.247381+0000","last_became_peered":"2024-09-15T23:24:04.247381+0000","last_unstale":"2024-09-15T23:24:05.346194+0000","last_undegraded":"2024-09-15T23:24:05.346194+0000","last_fullsized":"2024-09-15T23:24:05.346194+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:40:00.524589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.228304+0000","last_change":"2024-09-15T23:24:03.228304+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.228304+0000","last_undegraded":"2024-09-15T23:24:03.228304+0000","last_fullsized":"2024-09-15T23:24:03.228304+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.226416+0000","last_change":"2024-09-15T23:24:03.226416+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.226416+0000","last_undegraded":"2024-09-15T23:24:03.226416+0000","last_fullsized":"2024-09-15T23:24:03.226416+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.244369+0000","last_change":"2024-09-15T23:24:04.249444+0000","last_active":"2024-09-15T23:24:05.244369+0000","last_peered":"2024-09-15T23:24:05.244369+0000","last_clean":"2024-09-15T23:24:05.244369+0000","last_became_active":"2024-09-15T23:24:04.249083+0000","last_became_peered":"2024-09-15T23:24:04.249083+0000","last_unstale":"2024-09-15T23:24:05.244369+0000","last_undegraded":"2024-09-15T23:24:05.244369+0000","last_fullsized":"2024-09-15T23:24:05.244369+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:59.472118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.346074+0000","last_change":"2024-09-15T23:24:04.243542+0000","last_active":"2024-09-15T23:24:05.346074+0000","last_peered":"2024-09-15T23:24:05.346074+0000","last_clean":"2024-09-15T23:24:05.346074+0000","last_became_active":"2024-09-15T23:24:04.243220+0000","last_became_peered":"2024-09-15T23:24:04.243220+0000","last_unstale":"2024-09-15T23:24:05.346074+0000","last_undegraded":"2024-09-15T23:24:05.346074+0000","last_fullsized":"2024-09-15T23:24:05.346074+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:48:50.324247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.223740+0000","last_change":"2024-09-15T23:24:03.223740+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.223740+0000","last_undegraded":"2024-09-15T23:24:03.223740+0000","last_fullsized":"2024-09-15T23:24:03.223740+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1f","version":"205'4","reported_seq":18,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499727+0000","last_change":"2024-09-15T23:24:03.237701+0000","last_active":"2024-09-15T23:24:05.499727+0000","last_peered":"2024-09-15T23:24:05.499727+0000","last_clean":"2024-09-15T23:24:05.499727+0000","last_became_active":"2024-09-15T23:24:03.237407+0000","last_became_peered":"2024-09-15T23:24:03.237407+0000","last_unstale":"2024-09-15T23:24:05.499727+0000","last_undegraded":"2024-09-15T23:24:05.499727+0000","last_fullsized":"2024-09-15T23:24:05.499727+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:01:57.916838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499776+0000","last_change":"2024-09-15T23:24:04.241162+0000","last_active":"2024-09-15T23:24:05.499776+0000","last_peered":"2024-09-15T23:24:05.499776+0000","last_clean":"2024-09-15T23:24:05.499776+0000","last_became_active":"2024-09-15T23:24:04.240909+0000","last_became_peered":"2024-09-15T23:24:04.240909+0000","last_unstale":"2024-09-15T23:24:05.499776+0000","last_undegraded":"2024-09-15T23:24:05.499776+0000","last_fullsized":"2024-09-15T23:24:05.499776+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:22.005817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.233971+0000","last_change":"2024-09-15T23:24:03.232380+0000","last_active":"2024-09-15T23:24:03.233971+0000","last_peered":"2024-09-15T23:24:03.233971+0000","last_clean":"2024-09-15T23:24:03.233971+0000","last_became_active":"2024-09-15T23:24:03.225881+0000","last_became_peered":"2024-09-15T23:24:03.225881+0000","last_unstale":"2024-09-15T23:24:03.233971+0000","last_undegraded":"2024-09-15T23:24:03.233971+0000","last_fullsized":"2024-09-15T23:24:03.233971+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:52:16.001769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.229217+0000","last_change":"2024-09-15T23:24:03.229217+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.229217+0000","last_undegraded":"2024-09-15T23:24:03.229217+0000","last_fullsized":"2024-09-15T23:24:03.229217+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.237582+0000","last_change":"2024-09-15T23:24:03.236362+0000","last_active":"2024-09-15T23:24:03.237582+0000","last_peered":"2024-09-15T23:24:03.237582+0000","last_clean":"2024-09-15T23:24:03.237582+0000","last_became_active":"2024-09-15T23:24:03.236134+0000","last_became_peered":"2024-09-15T23:24:03.236134+0000","last_unstale":"2024-09-15T23:24:03.237582+0000","last_undegraded":"2024-09-15T23:24:03.237582+0000","last_fullsized":"2024-09-15T23:24:03.237582+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:29:01.714652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.223497+0000","last_change":"2024-09-15T23:24:03.223497+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.223497+0000","last_undegraded":"2024-09-15T23:24:03.223497+0000","last_fullsized":"2024-09-15T23:24:03.223497+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1b","version":"205'1","reported_seq":15,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498815+0000","last_change":"2024-09-15T23:24:03.233549+0000","last_active":"2024-09-15T23:24:05.498815+0000","last_peered":"2024-09-15T23:24:05.498815+0000","last_clean":"2024-09-15T23:24:05.498815+0000","last_became_active":"2024-09-15T23:24:03.233220+0000","last_became_peered":"2024-09-15T23:24:03.233220+0000","last_unstale":"2024-09-15T23:24:05.498815+0000","last_undegraded":"2024-09-15T23:24:05.498815+0000","last_fullsized":"2024-09-15T23:24:05.498815+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:27:10.001446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499430+0000","last_change":"2024-09-15T23:24:04.239016+0000","last_active":"2024-09-15T23:24:05.499430+0000","last_peered":"2024-09-15T23:24:05.499430+0000","last_clean":"2024-09-15T23:24:05.499430+0000","last_became_active":"2024-09-15T23:24:04.238588+0000","last_became_peered":"2024-09-15T23:24:04.238588+0000","last_unstale":"2024-09-15T23:24:05.499430+0000","last_undegraded":"2024-09-15T23:24:05.499430+0000","last_fullsized":"2024-09-15T23:24:05.499430+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:32:33.096858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.230537+0000","last_change":"2024-09-15T23:24:03.226435+0000","last_active":"2024-09-15T23:24:03.230537+0000","last_peered":"2024-09-15T23:24:03.230537+0000","last_clean":"2024-09-15T23:24:03.230537+0000","last_became_active":"2024-09-15T23:24:03.226192+0000","last_became_peered":"2024-09-15T23:24:03.226192+0000","last_unstale":"2024-09-15T23:24:03.230537+0000","last_undegraded":"2024-09-15T23:24:03.230537+0000","last_fullsized":"2024-09-15T23:24:03.230537+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:10:29.458773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499088+0000","last_change":"2024-09-15T23:24:04.239606+0000","last_active":"2024-09-15T23:24:05.499088+0000","last_peered":"2024-09-15T23:24:05.499088+0000","last_clean":"2024-09-15T23:24:05.499088+0000","last_became_active":"2024-09-15T23:24:04.239300+0000","last_became_peered":"2024-09-15T23:24:04.239300+0000","last_unstale":"2024-09-15T23:24:05.499088+0000","last_undegraded":"2024-09-15T23:24:05.499088+0000","last_fullsized":"2024-09-15T23:24:05.499088+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:55.718328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.242172+0000","last_change":"2024-09-15T23:24:03.238146+0000","last_active":"2024-09-15T23:24:03.242172+0000","last_peered":"2024-09-15T23:24:03.242172+0000","last_clean":"2024-09-15T23:24:03.242172+0000","last_became_active":"2024-09-15T23:24:03.237891+0000","last_became_peered":"2024-09-15T23:24:03.237891+0000","last_unstale":"2024-09-15T23:24:03.242172+0000","last_undegraded":"2024-09-15T23:24:03.242172+0000","last_fullsized":"2024-09-15T23:24:03.242172+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:02:57.404523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.223037+0000","last_change":"2024-09-15T23:24:03.223037+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.223037+0000","last_undegraded":"2024-09-15T23:24:03.223037+0000","last_fullsized":"2024-09-15T23:24:03.223037+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":14,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.244228+0000","last_change":"2024-09-15T23:24:03.238917+0000","last_active":"2024-09-15T23:24:05.244228+0000","last_peered":"2024-09-15T23:24:05.244228+0000","last_clean":"2024-09-15T23:24:05.244228+0000","last_became_active":"2024-09-15T23:24:03.238111+0000","last_became_peered":"2024-09-15T23:24:03.238111+0000","last_unstale":"2024-09-15T23:24:05.244228+0000","last_undegraded":"2024-09-15T23:24:05.244228+0000","last_fullsized":"2024-09-15T23:24:05.244228+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:25.882975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.226896+0000","last_change":"2024-09-15T23:24:03.226896+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.226896+0000","last_undegraded":"2024-09-15T23:24:03.226896+0000","last_fullsized":"2024-09-15T23:24:03.226896+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.239471+0000","last_change":"2024-09-15T23:24:03.233947+0000","last_active":"2024-09-15T23:24:03.239471+0000","last_peered":"2024-09-15T23:24:03.239471+0000","last_clean":"2024-09-15T23:24:03.239471+0000","last_became_active":"2024-09-15T23:24:03.233577+0000","last_became_peered":"2024-09-15T23:24:03.233577+0000","last_unstale":"2024-09-15T23:24:03.239471+0000","last_undegraded":"2024-09-15T23:24:03.239471+0000","last_fullsized":"2024-09-15T23:24:03.239471+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:19:20.973913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.222988+0000","last_change":"2024-09-15T23:24:03.222988+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.222988+0000","last_undegraded":"2024-09-15T23:24:03.222988+0000","last_fullsized":"2024-09-15T23:24:03.222988+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":14,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499015+0000","last_change":"2024-09-15T23:24:03.234732+0000","last_active":"2024-09-15T23:24:05.499015+0000","last_peered":"2024-09-15T23:24:05.499015+0000","last_clean":"2024-09-15T23:24:05.499015+0000","last_became_active":"2024-09-15T23:24:03.234455+0000","last_became_peered":"2024-09-15T23:24:03.234455+0000","last_unstale":"2024-09-15T23:24:05.499015+0000","last_undegraded":"2024-09-15T23:24:05.499015+0000","last_fullsized":"2024-09-15T23:24:05.499015+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:58.467849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.227189+0000","last_change":"2024-09-15T23:24:03.227189+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.227189+0000","last_undegraded":"2024-09-15T23:24:03.227189+0000","last_fullsized":"2024-09-15T23:24:03.227189+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"205'3","reported_seq":17,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.346184+0000","last_change":"2024-09-15T23:24:03.234930+0000","last_active":"2024-09-15T23:24:05.346184+0000","last_peered":"2024-09-15T23:24:05.346184+0000","last_clean":"2024-09-15T23:24:05.346184+0000","last_became_active":"2024-09-15T23:24:03.234624+0000","last_became_peered":"2024-09-15T23:24:03.234624+0000","last_unstale":"2024-09-15T23:24:05.346184+0000","last_undegraded":"2024-09-15T23:24:05.346184+0000","last_fullsized":"2024-09-15T23:24:05.346184+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:01:57.916838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.226402+0000","last_change":"2024-09-15T23:24:03.226402+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.226402+0000","last_undegraded":"2024-09-15T23:24:03.226402+0000","last_fullsized":"2024-09-15T23:24:03.226402+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.14","version":"205'6","reported_seq":20,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.244626+0000","last_change":"2024-09-15T23:24:03.229069+0000","last_active":"2024-09-15T23:24:05.244626+0000","last_peered":"2024-09-15T23:24:05.244626+0000","last_clean":"2024-09-15T23:24:05.244626+0000","last_became_active":"2024-09-15T23:24:03.228795+0000","last_became_peered":"2024-09-15T23:24:03.228795+0000","last_unstale":"2024-09-15T23:24:05.244626+0000","last_undegraded":"2024-09-15T23:24:05.244626+0000","last_fullsized":"2024-09-15T23:24:05.244626+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:50.332347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499480+0000","last_change":"2024-09-15T23:24:04.240484+0000","last_active":"2024-09-15T23:24:05.499480+0000","last_peered":"2024-09-15T23:24:05.499480+0000","last_clean":"2024-09-15T23:24:05.499480+0000","last_became_active":"2024-09-15T23:24:04.239740+0000","last_became_peered":"2024-09-15T23:24:04.239740+0000","last_unstale":"2024-09-15T23:24:05.499480+0000","last_undegraded":"2024-09-15T23:24:05.499480+0000","last_fullsized":"2024-09-15T23:24:05.499480+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:45.895857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.13","version":"205'2","reported_seq":16,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.346119+0000","last_change":"2024-09-15T23:24:03.237296+0000","last_active":"2024-09-15T23:24:05.346119+0000","last_peered":"2024-09-15T23:24:05.346119+0000","last_clean":"2024-09-15T23:24:05.346119+0000","last_became_active":"2024-09-15T23:24:03.237024+0000","last_became_peered":"2024-09-15T23:24:03.237024+0000","last_unstale":"2024-09-15T23:24:05.346119+0000","last_undegraded":"2024-09-15T23:24:05.346119+0000","last_fullsized":"2024-09-15T23:24:05.346119+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:22.254679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.227303+0000","last_change":"2024-09-15T23:24:03.227303+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.227303+0000","last_undegraded":"2024-09-15T23:24:03.227303+0000","last_fullsized":"2024-09-15T23:24:03.227303+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":14,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499467+0000","last_change":"2024-09-15T23:24:03.236841+0000","last_active":"2024-09-15T23:24:05.499467+0000","last_peered":"2024-09-15T23:24:05.499467+0000","last_clean":"2024-09-15T23:24:05.499467+0000","last_became_active":"2024-09-15T23:24:03.236129+0000","last_became_peered":"2024-09-15T23:24:03.236129+0000","last_unstale":"2024-09-15T23:24:05.499467+0000","last_undegraded":"2024-09-15T23:24:05.499467+0000","last_fullsized":"2024-09-15T23:24:05.499467+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:01:21.387520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.227693+0000","last_change":"2024-09-15T23:24:03.227693+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.227693+0000","last_undegraded":"2024-09-15T23:24:03.227693+0000","last_fullsized":"2024-09-15T23:24:03.227693+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":14,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499333+0000","last_change":"2024-09-15T23:24:03.231444+0000","last_active":"2024-09-15T23:24:05.499333+0000","last_peered":"2024-09-15T23:24:05.499333+0000","last_clean":"2024-09-15T23:24:05.499333+0000","last_became_active":"2024-09-15T23:24:03.231172+0000","last_became_peered":"2024-09-15T23:24:03.231172+0000","last_unstale":"2024-09-15T23:24:05.499333+0000","last_undegraded":"2024-09-15T23:24:05.499333+0000","last_fullsized":"2024-09-15T23:24:05.499333+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:52:31.013796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.223048+0000","last_change":"2024-09-15T23:24:03.223048+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.223048+0000","last_undegraded":"2024-09-15T23:24:03.223048+0000","last_fullsized":"2024-09-15T23:24:03.223048+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.235426+0000","last_change":"2024-09-15T23:24:03.234776+0000","last_active":"2024-09-15T23:24:03.235426+0000","last_peered":"2024-09-15T23:24:03.235426+0000","last_clean":"2024-09-15T23:24:03.235426+0000","last_became_active":"2024-09-15T23:24:03.234449+0000","last_became_peered":"2024-09-15T23:24:03.234449+0000","last_unstale":"2024-09-15T23:24:03.235426+0000","last_undegraded":"2024-09-15T23:24:03.235426+0000","last_fullsized":"2024-09-15T23:24:03.235426+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:47:38.673671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498900+0000","last_change":"2024-09-15T23:24:04.241959+0000","last_active":"2024-09-15T23:24:05.498900+0000","last_peered":"2024-09-15T23:24:05.498900+0000","last_clean":"2024-09-15T23:24:05.498900+0000","last_became_active":"2024-09-15T23:24:04.241644+0000","last_became_peered":"2024-09-15T23:24:04.241644+0000","last_unstale":"2024-09-15T23:24:05.498900+0000","last_undegraded":"2024-09-15T23:24:05.498900+0000","last_fullsized":"2024-09-15T23:24:05.498900+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:58:16.996796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.240876+0000","last_change":"2024-09-15T23:24:03.235856+0000","last_active":"2024-09-15T23:24:03.240876+0000","last_peered":"2024-09-15T23:24:03.240876+0000","last_clean":"2024-09-15T23:24:03.240876+0000","last_became_active":"2024-09-15T23:24:03.235564+0000","last_became_peered":"2024-09-15T23:24:03.235564+0000","last_unstale":"2024-09-15T23:24:03.240876+0000","last_undegraded":"2024-09-15T23:24:03.240876+0000","last_fullsized":"2024-09-15T23:24:03.240876+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:01.343626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.244706+0000","last_change":"2024-09-15T23:24:04.251386+0000","last_active":"2024-09-15T23:24:05.244706+0000","last_peered":"2024-09-15T23:24:05.244706+0000","last_clean":"2024-09-15T23:24:05.244706+0000","last_became_active":"2024-09-15T23:24:04.250821+0000","last_became_peered":"2024-09-15T23:24:04.250821+0000","last_unstale":"2024-09-15T23:24:05.244706+0000","last_undegraded":"2024-09-15T23:24:05.244706+0000","last_fullsized":"2024-09-15T23:24:05.244706+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:24.970281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.e","version":"205'2","reported_seq":16,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.244754+0000","last_change":"2024-09-15T23:24:03.233419+0000","last_active":"2024-09-15T23:24:05.244754+0000","last_peered":"2024-09-15T23:24:05.244754+0000","last_clean":"2024-09-15T23:24:05.244754+0000","last_became_active":"2024-09-15T23:24:03.232860+0000","last_became_peered":"2024-09-15T23:24:03.232860+0000","last_unstale":"2024-09-15T23:24:05.244754+0000","last_undegraded":"2024-09-15T23:24:05.244754+0000","last_fullsized":"2024-09-15T23:24:05.244754+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:14.313547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.223231+0000","last_change":"2024-09-15T23:24:03.223231+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.223231+0000","last_undegraded":"2024-09-15T23:24:03.223231+0000","last_fullsized":"2024-09-15T23:24:03.223231+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.237191+0000","last_change":"2024-09-15T23:24:03.233389+0000","last_active":"2024-09-15T23:24:03.237191+0000","last_peered":"2024-09-15T23:24:03.237191+0000","last_clean":"2024-09-15T23:24:03.237191+0000","last_became_active":"2024-09-15T23:24:03.233139+0000","last_became_peered":"2024-09-15T23:24:03.233139+0000","last_unstale":"2024-09-15T23:24:03.237191+0000","last_undegraded":"2024-09-15T23:24:03.237191+0000","last_fullsized":"2024-09-15T23:24:03.237191+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:06:36.696878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.228859+0000","last_change":"2024-09-15T23:24:03.228859+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.228859+0000","last_undegraded":"2024-09-15T23:24:03.228859+0000","last_fullsized":"2024-09-15T23:24:03.228859+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":14,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498976+0000","last_change":"2024-09-15T23:24:03.236047+0000","last_active":"2024-09-15T23:24:05.498976+0000","last_peered":"2024-09-15T23:24:05.498976+0000","last_clean":"2024-09-15T23:24:05.498976+0000","last_became_active":"2024-09-15T23:24:03.235739+0000","last_became_peered":"2024-09-15T23:24:03.235739+0000","last_unstale":"2024-09-15T23:24:05.498976+0000","last_undegraded":"2024-09-15T23:24:05.498976+0000","last_fullsized":"2024-09-15T23:24:05.498976+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:53:15.816067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.244610+0000","last_change":"2024-09-15T23:24:04.250765+0000","last_active":"2024-09-15T23:24:05.244610+0000","last_peered":"2024-09-15T23:24:05.244610+0000","last_clean":"2024-09-15T23:24:05.244610+0000","last_became_active":"2024-09-15T23:24:04.250457+0000","last_became_peered":"2024-09-15T23:24:04.250457+0000","last_unstale":"2024-09-15T23:24:05.244610+0000","last_undegraded":"2024-09-15T23:24:05.244610+0000","last_fullsized":"2024-09-15T23:24:05.244610+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:55:27.067955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.239487+0000","last_change":"2024-09-15T23:24:03.234239+0000","last_active":"2024-09-15T23:24:03.239487+0000","last_peered":"2024-09-15T23:24:03.239487+0000","last_clean":"2024-09-15T23:24:03.239487+0000","last_became_active":"2024-09-15T23:24:03.233978+0000","last_became_peered":"2024-09-15T23:24:03.233978+0000","last_unstale":"2024-09-15T23:24:03.239487+0000","last_undegraded":"2024-09-15T23:24:03.239487+0000","last_fullsized":"2024-09-15T23:24:03.239487+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:06:10.713689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.229398+0000","last_change":"2024-09-15T23:24:03.229398+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.229398+0000","last_undegraded":"2024-09-15T23:24:03.229398+0000","last_fullsized":"2024-09-15T23:24:03.229398+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.239117+0000","last_change":"2024-09-15T23:24:03.236689+0000","last_active":"2024-09-15T23:24:03.239117+0000","last_peered":"2024-09-15T23:24:03.239117+0000","last_clean":"2024-09-15T23:24:03.239117+0000","last_became_active":"2024-09-15T23:24:03.236226+0000","last_became_peered":"2024-09-15T23:24:03.236226+0000","last_unstale":"2024-09-15T23:24:03.239117+0000","last_undegraded":"2024-09-15T23:24:03.239117+0000","last_fullsized":"2024-09-15T23:24:03.239117+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:25.462598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498657+0000","last_change":"2024-09-15T23:24:04.253235+0000","last_active":"2024-09-15T23:24:05.498657+0000","last_peered":"2024-09-15T23:24:05.498657+0000","last_clean":"2024-09-15T23:24:05.498657+0000","last_became_active":"2024-09-15T23:24:04.252940+0000","last_became_peered":"2024-09-15T23:24:04.252940+0000","last_unstale":"2024-09-15T23:24:05.498657+0000","last_undegraded":"2024-09-15T23:24:05.498657+0000","last_fullsized":"2024-09-15T23:24:05.498657+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:37:08.840834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.237912+0000","last_change":"2024-09-15T23:24:03.235609+0000","last_active":"2024-09-15T23:24:03.237912+0000","last_peered":"2024-09-15T23:24:03.237912+0000","last_clean":"2024-09-15T23:24:03.237912+0000","last_became_active":"2024-09-15T23:24:03.235358+0000","last_became_peered":"2024-09-15T23:24:03.235358+0000","last_unstale":"2024-09-15T23:24:03.237912+0000","last_undegraded":"2024-09-15T23:24:03.237912+0000","last_fullsized":"2024-09-15T23:24:03.237912+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:39.184956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.346109+0000","last_change":"2024-09-15T23:24:04.243440+0000","last_active":"2024-09-15T23:24:05.346109+0000","last_peered":"2024-09-15T23:24:05.346109+0000","last_clean":"2024-09-15T23:24:05.346109+0000","last_became_active":"2024-09-15T23:24:04.243165+0000","last_became_peered":"2024-09-15T23:24:04.243165+0000","last_unstale":"2024-09-15T23:24:05.346109+0000","last_undegraded":"2024-09-15T23:24:05.346109+0000","last_fullsized":"2024-09-15T23:24:05.346109+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:00:47.871432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.241274+0000","last_change":"2024-09-15T23:24:03.240718+0000","last_active":"2024-09-15T23:24:03.241274+0000","last_peered":"2024-09-15T23:24:03.241274+0000","last_clean":"2024-09-15T23:24:03.241274+0000","last_became_active":"2024-09-15T23:24:03.240388+0000","last_became_peered":"2024-09-15T23:24:03.240388+0000","last_unstale":"2024-09-15T23:24:03.241274+0000","last_undegraded":"2024-09-15T23:24:03.241274+0000","last_fullsized":"2024-09-15T23:24:03.241274+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:37:34.205282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.244662+0000","last_change":"2024-09-15T23:24:04.251014+0000","last_active":"2024-09-15T23:24:05.244662+0000","last_peered":"2024-09-15T23:24:05.244662+0000","last_clean":"2024-09-15T23:24:05.244662+0000","last_became_active":"2024-09-15T23:24:04.250672+0000","last_became_peered":"2024-09-15T23:24:04.250672+0000","last_unstale":"2024-09-15T23:24:05.244662+0000","last_undegraded":"2024-09-15T23:24:05.244662+0000","last_fullsized":"2024-09-15T23:24:05.244662+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:53:01.003383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"205'2","reported_seq":16,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.244579+0000","last_change":"2024-09-15T23:24:03.232730+0000","last_active":"2024-09-15T23:24:05.244579+0000","last_peered":"2024-09-15T23:24:05.244579+0000","last_clean":"2024-09-15T23:24:05.244579+0000","last_became_active":"2024-09-15T23:24:03.232300+0000","last_became_peered":"2024-09-15T23:24:03.232300+0000","last_unstale":"2024-09-15T23:24:05.244579+0000","last_undegraded":"2024-09-15T23:24:05.244579+0000","last_fullsized":"2024-09-15T23:24:05.244579+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:26.469934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.223056+0000","last_change":"2024-09-15T23:24:03.223056+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.223056+0000","last_undegraded":"2024-09-15T23:24:03.223056+0000","last_fullsized":"2024-09-15T23:24:03.223056+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.240856+0000","last_change":"2024-09-15T23:24:03.234599+0000","last_active":"2024-09-15T23:24:03.240856+0000","last_peered":"2024-09-15T23:24:03.240856+0000","last_clean":"2024-09-15T23:24:03.240856+0000","last_became_active":"2024-09-15T23:24:03.234337+0000","last_became_peered":"2024-09-15T23:24:03.234337+0000","last_unstale":"2024-09-15T23:24:03.240856+0000","last_undegraded":"2024-09-15T23:24:03.240856+0000","last_fullsized":"2024-09-15T23:24:03.240856+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:39.273467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.222576+0000","last_change":"2024-09-15T23:24:03.222576+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.222576+0000","last_undegraded":"2024-09-15T23:24:03.222576+0000","last_fullsized":"2024-09-15T23:24:03.222576+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.239699+0000","last_change":"2024-09-15T23:24:03.234545+0000","last_active":"2024-09-15T23:24:03.239699+0000","last_peered":"2024-09-15T23:24:03.239699+0000","last_clean":"2024-09-15T23:24:03.239699+0000","last_became_active":"2024-09-15T23:24:03.234294+0000","last_became_peered":"2024-09-15T23:24:03.234294+0000","last_unstale":"2024-09-15T23:24:03.239699+0000","last_undegraded":"2024-09-15T23:24:03.239699+0000","last_fullsized":"2024-09-15T23:24:03.239699+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:17:01.629821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498793+0000","last_change":"2024-09-15T23:24:04.245309+0000","last_active":"2024-09-15T23:24:05.498793+0000","last_peered":"2024-09-15T23:24:05.498793+0000","last_clean":"2024-09-15T23:24:05.498793+0000","last_became_active":"2024-09-15T23:24:04.245005+0000","last_became_peered":"2024-09-15T23:24:04.245005+0000","last_unstale":"2024-09-15T23:24:05.498793+0000","last_undegraded":"2024-09-15T23:24:05.498793+0000","last_fullsized":"2024-09-15T23:24:05.498793+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:10:46.962223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.237340+0000","last_change":"2024-09-15T23:24:03.235147+0000","last_active":"2024-09-15T23:24:03.237340+0000","last_peered":"2024-09-15T23:24:03.237340+0000","last_clean":"2024-09-15T23:24:03.237340+0000","last_became_active":"2024-09-15T23:24:03.234881+0000","last_became_peered":"2024-09-15T23:24:03.234881+0000","last_unstale":"2024-09-15T23:24:03.237340+0000","last_undegraded":"2024-09-15T23:24:03.237340+0000","last_fullsized":"2024-09-15T23:24:03.237340+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:28.821635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.222054+0000","last_change":"2024-09-15T23:24:03.222054+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.222054+0000","last_undegraded":"2024-09-15T23:24:03.222054+0000","last_fullsized":"2024-09-15T23:24:03.222054+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.238608+0000","last_change":"2024-09-15T23:24:03.237859+0000","last_active":"2024-09-15T23:24:03.238608+0000","last_peered":"2024-09-15T23:24:03.238608+0000","last_clean":"2024-09-15T23:24:03.238608+0000","last_became_active":"2024-09-15T23:24:03.237582+0000","last_became_peered":"2024-09-15T23:24:03.237582+0000","last_unstale":"2024-09-15T23:24:03.238608+0000","last_undegraded":"2024-09-15T23:24:03.238608+0000","last_fullsized":"2024-09-15T23:24:03.238608+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:57.451165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.222550+0000","last_change":"2024-09-15T23:24:03.222550+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.222550+0000","last_undegraded":"2024-09-15T23:24:03.222550+0000","last_fullsized":"2024-09-15T23:24:03.222550+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":14,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499581+0000","last_change":"2024-09-15T23:24:03.234428+0000","last_active":"2024-09-15T23:24:05.499581+0000","last_peered":"2024-09-15T23:24:05.499581+0000","last_clean":"2024-09-15T23:24:05.499581+0000","last_became_active":"2024-09-15T23:24:03.234081+0000","last_became_peered":"2024-09-15T23:24:03.234081+0000","last_unstale":"2024-09-15T23:24:05.499581+0000","last_undegraded":"2024-09-15T23:24:05.499581+0000","last_fullsized":"2024-09-15T23:24:05.499581+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:12:32.460158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.222629+0000","last_change":"2024-09-15T23:24:03.222629+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.222629+0000","last_undegraded":"2024-09-15T23:24:03.222629+0000","last_fullsized":"2024-09-15T23:24:03.222629+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":14,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.346088+0000","last_change":"2024-09-15T23:24:03.235840+0000","last_active":"2024-09-15T23:24:05.346088+0000","last_peered":"2024-09-15T23:24:05.346088+0000","last_clean":"2024-09-15T23:24:05.346088+0000","last_became_active":"2024-09-15T23:24:03.235577+0000","last_became_peered":"2024-09-15T23:24:03.235577+0000","last_unstale":"2024-09-15T23:24:05.346088+0000","last_undegraded":"2024-09-15T23:24:05.346088+0000","last_fullsized":"2024-09-15T23:24:05.346088+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:52:31.013796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.230004+0000","last_change":"2024-09-15T23:24:03.230004+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.230004+0000","last_undegraded":"2024-09-15T23:24:03.230004+0000","last_fullsized":"2024-09-15T23:24:03.230004+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.239455+0000","last_change":"2024-09-15T23:24:03.233988+0000","last_active":"2024-09-15T23:24:03.239455+0000","last_peered":"2024-09-15T23:24:03.239455+0000","last_clean":"2024-09-15T23:24:03.239455+0000","last_became_active":"2024-09-15T23:24:03.233730+0000","last_became_peered":"2024-09-15T23:24:03.233730+0000","last_unstale":"2024-09-15T23:24:03.239455+0000","last_undegraded":"2024-09-15T23:24:03.239455+0000","last_fullsized":"2024-09-15T23:24:03.239455+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:10.138162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.229178+0000","last_change":"2024-09-15T23:24:03.229178+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.229178+0000","last_undegraded":"2024-09-15T23:24:03.229178+0000","last_fullsized":"2024-09-15T23:24:03.229178+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.230402+0000","last_change":"2024-09-15T23:24:03.226290+0000","last_active":"2024-09-15T23:24:03.230402+0000","last_peered":"2024-09-15T23:24:03.230402+0000","last_clean":"2024-09-15T23:24:03.230402+0000","last_became_active":"2024-09-15T23:24:03.226044+0000","last_became_peered":"2024-09-15T23:24:03.226044+0000","last_unstale":"2024-09-15T23:24:03.230402+0000","last_undegraded":"2024-09-15T23:24:03.230402+0000","last_fullsized":"2024-09-15T23:24:03.230402+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:49.262116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":511,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.219541+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:24:03.219541+0000","last_peered":"2024-09-15T23:24:03.219541+0000","last_clean":"2024-09-15T23:24:03.219541+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:24:03.219541+0000","last_undegraded":"2024-09-15T23:24:03.219541+0000","last_fullsized":"2024-09-15T23:24:03.219541+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":2318,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60056,"kb_used_data":2500,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311784,"statfs":{"total":96636764160,"available":96575266816,"internally_reserved":0,"allocated":2560000,"data_stored":1132693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55900,"kb_used_data":2488,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315940,"statfs":{"total":96636764160,"available":96579522560,"internally_reserved":0,"allocated":2547712,"data_stored":1126418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476885,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56476,"kb_used_data":3068,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315364,"statfs":{"total":96636764160,"available":96578932736,"internally_reserved":0,"allocated":3141632,"data_stored":1716786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476885,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51736,"kb_used_data":2500,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320104,"statfs":{"total":96636764160,"available":96583786496,"internally_reserved":0,"allocated":2560000,"data_stored":1132693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542292,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51768,"kb_used_data":2532,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320072,"statfs":{"total":96636764160,"available":96583753728,"internally_reserved":0,"allocated":2592768,"data_stored":1146440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542292,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55940,"kb_used_data":2536,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315900,"statfs":{"total":96636764160,"available":96579481600,"internally_reserved":0,"allocated":2596864,"data_stored":1145914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542291,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60680,"kb_used_data":3120,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311160,"statfs":{"total":96636764160,"available":96574627840,"internally_reserved":0,"allocated":3194880,"data_stored":1737818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542293,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60096,"kb_used_data":2536,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311744,"statfs":{"total":96636764160,"available":96575225856,"internally_reserved":0,"allocated":2596864,"data_stored":1147380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:24:07.924 INFO:tasks.ceph.ceph_manager.ceph:PG 29.3f is not active+clean 2024-09-15T23:24:07.924 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.227236+0000', 'last_change': '2024-09-15T23:24:03.227236+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.227236+0000', 'last_undegraded': '2024-09-15T23:24:03.227236+0000', 'last_fullsized': '2024-09-15T23:24:03.227236+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:24:07.924 INFO:tasks.ceph.ceph_manager.ceph:PG 29.3e is not active+clean 2024-09-15T23:24:07.924 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.224505+0000', 'last_change': '2024-09-15T23:24:03.224505+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.224505+0000', 'last_undegraded': '2024-09-15T23:24:03.224505+0000', 'last_fullsized': '2024-09-15T23:24:03.224505+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:24:07.924 INFO:tasks.ceph.ceph_manager.ceph:PG 29.3d is not active+clean 2024-09-15T23:24:07.924 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.224018+0000', 'last_change': '2024-09-15T23:24:03.224018+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.224018+0000', 'last_undegraded': '2024-09-15T23:24:03.224018+0000', 'last_fullsized': '2024-09-15T23:24:03.224018+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:24:07.924 INFO:tasks.ceph.ceph_manager.ceph:PG 29.39 is not active+clean 2024-09-15T23:24:07.924 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.223475+0000', 'last_change': '2024-09-15T23:24:03.223475+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.223475+0000', 'last_undegraded': '2024-09-15T23:24:03.223475+0000', 'last_fullsized': '2024-09-15T23:24:03.223475+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:24:07.924 INFO:tasks.ceph.ceph_manager.ceph:PG 29.37 is not active+clean 2024-09-15T23:24:07.925 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.228486+0000', 'last_change': '2024-09-15T23:24:03.228486+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.228486+0000', 'last_undegraded': '2024-09-15T23:24:03.228486+0000', 'last_fullsized': '2024-09-15T23:24:03.228486+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:24:07.925 INFO:tasks.ceph.ceph_manager.ceph:PG 29.35 is not active+clean 2024-09-15T23:24:07.925 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.222842+0000', 'last_change': '2024-09-15T23:24:03.222842+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.222842+0000', 'last_undegraded': '2024-09-15T23:24:03.222842+0000', 'last_fullsized': '2024-09-15T23:24:03.222842+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:24:07.925 INFO:tasks.ceph.ceph_manager.ceph:PG 29.34 is not active+clean 2024-09-15T23:24:07.925 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.227577+0000', 'last_change': '2024-09-15T23:24:03.227577+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.227577+0000', 'last_undegraded': '2024-09-15T23:24:03.227577+0000', 'last_fullsized': '2024-09-15T23:24:03.227577+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:24:07.925 INFO:tasks.ceph.ceph_manager.ceph:PG 29.33 is not active+clean 2024-09-15T23:24:07.925 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.226388+0000', 'last_change': '2024-09-15T23:24:03.226388+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.226388+0000', 'last_undegraded': '2024-09-15T23:24:03.226388+0000', 'last_fullsized': '2024-09-15T23:24:03.226388+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:24:07.925 INFO:tasks.ceph.ceph_manager.ceph:PG 29.32 is not active+clean 2024-09-15T23:24:07.925 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.224847+0000', 'last_change': '2024-09-15T23:24:03.224847+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.224847+0000', 'last_undegraded': '2024-09-15T23:24:03.224847+0000', 'last_fullsized': '2024-09-15T23:24:03.224847+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:24:07.925 INFO:tasks.ceph.ceph_manager.ceph:PG 29.30 is not active+clean 2024-09-15T23:24:07.925 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.230590+0000', 'last_change': '2024-09-15T23:24:03.230590+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.230590+0000', 'last_undegraded': '2024-09-15T23:24:03.230590+0000', 'last_fullsized': '2024-09-15T23:24:03.230590+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:24:07.926 INFO:tasks.ceph.ceph_manager.ceph:PG 29.2f is not active+clean 2024-09-15T23:24:07.926 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.226794+0000', 'last_change': '2024-09-15T23:24:03.226794+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.226794+0000', 'last_undegraded': '2024-09-15T23:24:03.226794+0000', 'last_fullsized': '2024-09-15T23:24:03.226794+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:24:07.926 INFO:tasks.ceph.ceph_manager.ceph:PG 29.29 is not active+clean 2024-09-15T23:24:07.926 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.224229+0000', 'last_change': '2024-09-15T23:24:03.224229+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.224229+0000', 'last_undegraded': '2024-09-15T23:24:03.224229+0000', 'last_fullsized': '2024-09-15T23:24:03.224229+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:24:07.926 INFO:tasks.ceph.ceph_manager.ceph:PG 29.27 is not active+clean 2024-09-15T23:24:07.926 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.223368+0000', 'last_change': '2024-09-15T23:24:03.223368+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.223368+0000', 'last_undegraded': '2024-09-15T23:24:03.223368+0000', 'last_fullsized': '2024-09-15T23:24:03.223368+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:24:07.926 INFO:tasks.ceph.ceph_manager.ceph:PG 29.25 is not active+clean 2024-09-15T23:24:07.926 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.223265+0000', 'last_change': '2024-09-15T23:24:03.223265+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.223265+0000', 'last_undegraded': '2024-09-15T23:24:03.223265+0000', 'last_fullsized': '2024-09-15T23:24:03.223265+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:24:07.926 INFO:tasks.ceph.ceph_manager.ceph:PG 29.23 is not active+clean 2024-09-15T23:24:07.926 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.228304+0000', 'last_change': '2024-09-15T23:24:03.228304+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.228304+0000', 'last_undegraded': '2024-09-15T23:24:03.228304+0000', 'last_fullsized': '2024-09-15T23:24:03.228304+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:24:07.926 INFO:tasks.ceph.ceph_manager.ceph:PG 29.22 is not active+clean 2024-09-15T23:24:07.927 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.226416+0000', 'last_change': '2024-09-15T23:24:03.226416+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.226416+0000', 'last_undegraded': '2024-09-15T23:24:03.226416+0000', 'last_fullsized': '2024-09-15T23:24:03.226416+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:24:07.927 INFO:tasks.ceph.ceph_manager.ceph:PG 29.1e is not active+clean 2024-09-15T23:24:07.927 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.223740+0000', 'last_change': '2024-09-15T23:24:03.223740+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.223740+0000', 'last_undegraded': '2024-09-15T23:24:03.223740+0000', 'last_fullsized': '2024-09-15T23:24:03.223740+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:24:07.927 INFO:tasks.ceph.ceph_manager.ceph:PG 29.1d is not active+clean 2024-09-15T23:24:07.927 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.229217+0000', 'last_change': '2024-09-15T23:24:03.229217+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.229217+0000', 'last_undegraded': '2024-09-15T23:24:03.229217+0000', 'last_fullsized': '2024-09-15T23:24:03.229217+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:24:07.927 INFO:tasks.ceph.ceph_manager.ceph:PG 29.1a is not active+clean 2024-09-15T23:24:07.927 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.223497+0000', 'last_change': '2024-09-15T23:24:03.223497+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.223497+0000', 'last_undegraded': '2024-09-15T23:24:03.223497+0000', 'last_fullsized': '2024-09-15T23:24:03.223497+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:24:07.927 INFO:tasks.ceph.ceph_manager.ceph:PG 29.19 is not active+clean 2024-09-15T23:24:07.927 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.223037+0000', 'last_change': '2024-09-15T23:24:03.223037+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.223037+0000', 'last_undegraded': '2024-09-15T23:24:03.223037+0000', 'last_fullsized': '2024-09-15T23:24:03.223037+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:24:07.927 INFO:tasks.ceph.ceph_manager.ceph:PG 29.16 is not active+clean 2024-09-15T23:24:07.927 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.226896+0000', 'last_change': '2024-09-15T23:24:03.226896+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.226896+0000', 'last_undegraded': '2024-09-15T23:24:03.226896+0000', 'last_fullsized': '2024-09-15T23:24:03.226896+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:24:07.928 INFO:tasks.ceph.ceph_manager.ceph:PG 29.17 is not active+clean 2024-09-15T23:24:07.928 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.222988+0000', 'last_change': '2024-09-15T23:24:03.222988+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.222988+0000', 'last_undegraded': '2024-09-15T23:24:03.222988+0000', 'last_fullsized': '2024-09-15T23:24:03.222988+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:24:07.928 INFO:tasks.ceph.ceph_manager.ceph:PG 29.14 is not active+clean 2024-09-15T23:24:07.928 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.227189+0000', 'last_change': '2024-09-15T23:24:03.227189+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.227189+0000', 'last_undegraded': '2024-09-15T23:24:03.227189+0000', 'last_fullsized': '2024-09-15T23:24:03.227189+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:24:07.928 INFO:tasks.ceph.ceph_manager.ceph:PG 29.15 is not active+clean 2024-09-15T23:24:07.928 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.226402+0000', 'last_change': '2024-09-15T23:24:03.226402+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.226402+0000', 'last_undegraded': '2024-09-15T23:24:03.226402+0000', 'last_fullsized': '2024-09-15T23:24:03.226402+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:24:07.928 INFO:tasks.ceph.ceph_manager.ceph:PG 29.13 is not active+clean 2024-09-15T23:24:07.928 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.227303+0000', 'last_change': '2024-09-15T23:24:03.227303+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.227303+0000', 'last_undegraded': '2024-09-15T23:24:03.227303+0000', 'last_fullsized': '2024-09-15T23:24:03.227303+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T23:24:07.928 INFO:tasks.ceph.ceph_manager.ceph:PG 29.10 is not active+clean 2024-09-15T23:24:07.928 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.227693+0000', 'last_change': '2024-09-15T23:24:03.227693+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.227693+0000', 'last_undegraded': '2024-09-15T23:24:03.227693+0000', 'last_fullsized': '2024-09-15T23:24:03.227693+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:24:07.929 INFO:tasks.ceph.ceph_manager.ceph:PG 29.11 is not active+clean 2024-09-15T23:24:07.929 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.223048+0000', 'last_change': '2024-09-15T23:24:03.223048+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.223048+0000', 'last_undegraded': '2024-09-15T23:24:03.223048+0000', 'last_fullsized': '2024-09-15T23:24:03.223048+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:24:07.929 INFO:tasks.ceph.ceph_manager.ceph:PG 29.c is not active+clean 2024-09-15T23:24:07.929 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.223231+0000', 'last_change': '2024-09-15T23:24:03.223231+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.223231+0000', 'last_undegraded': '2024-09-15T23:24:03.223231+0000', 'last_fullsized': '2024-09-15T23:24:03.223231+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:24:07.929 INFO:tasks.ceph.ceph_manager.ceph:PG 29.d is not active+clean 2024-09-15T23:24:07.929 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.228859+0000', 'last_change': '2024-09-15T23:24:03.228859+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.228859+0000', 'last_undegraded': '2024-09-15T23:24:03.228859+0000', 'last_fullsized': '2024-09-15T23:24:03.228859+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:24:07.929 INFO:tasks.ceph.ceph_manager.ceph:PG 29.b is not active+clean 2024-09-15T23:24:07.929 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.229398+0000', 'last_change': '2024-09-15T23:24:03.229398+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.229398+0000', 'last_undegraded': '2024-09-15T23:24:03.229398+0000', 'last_fullsized': '2024-09-15T23:24:03.229398+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:24:07.929 INFO:tasks.ceph.ceph_manager.ceph:PG 29.7 is not active+clean 2024-09-15T23:24:07.929 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.223056+0000', 'last_change': '2024-09-15T23:24:03.223056+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.223056+0000', 'last_undegraded': '2024-09-15T23:24:03.223056+0000', 'last_fullsized': '2024-09-15T23:24:03.223056+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:24:07.929 INFO:tasks.ceph.ceph_manager.ceph:PG 29.4 is not active+clean 2024-09-15T23:24:07.930 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.222576+0000', 'last_change': '2024-09-15T23:24:03.222576+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.222576+0000', 'last_undegraded': '2024-09-15T23:24:03.222576+0000', 'last_fullsized': '2024-09-15T23:24:03.222576+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:24:07.930 INFO:tasks.ceph.ceph_manager.ceph:PG 29.2 is not active+clean 2024-09-15T23:24:07.930 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.222054+0000', 'last_change': '2024-09-15T23:24:03.222054+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.222054+0000', 'last_undegraded': '2024-09-15T23:24:03.222054+0000', 'last_fullsized': '2024-09-15T23:24:03.222054+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:24:07.930 INFO:tasks.ceph.ceph_manager.ceph:PG 29.3 is not active+clean 2024-09-15T23:24:07.930 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.222550+0000', 'last_change': '2024-09-15T23:24:03.222550+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.222550+0000', 'last_undegraded': '2024-09-15T23:24:03.222550+0000', 'last_fullsized': '2024-09-15T23:24:03.222550+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T23:24:07.930 INFO:tasks.ceph.ceph_manager.ceph:PG 29.0 is not active+clean 2024-09-15T23:24:07.930 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.222629+0000', 'last_change': '2024-09-15T23:24:03.222629+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.222629+0000', 'last_undegraded': '2024-09-15T23:24:03.222629+0000', 'last_fullsized': '2024-09-15T23:24:03.222629+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T23:24:07.930 INFO:tasks.ceph.ceph_manager.ceph:PG 29.1 is not active+clean 2024-09-15T23:24:07.930 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.230004+0000', 'last_change': '2024-09-15T23:24:03.230004+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.230004+0000', 'last_undegraded': '2024-09-15T23:24:03.230004+0000', 'last_fullsized': '2024-09-15T23:24:03.230004+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:24:07.930 INFO:tasks.ceph.ceph_manager.ceph:PG 29.1c is not active+clean 2024-09-15T23:24:07.930 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '29.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 204, 'state': 'creating+peering', 'last_fresh': '2024-09-15T23:24:03.229178+0000', 'last_change': '2024-09-15T23:24:03.229178+0000', 'last_active': '2024-09-15T23:24:03.215032+0000', 'last_peered': '2024-09-15T23:24:03.215032+0000', 'last_clean': '2024-09-15T23:24:03.215032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T23:24:03.229178+0000', 'last_undegraded': '2024-09-15T23:24:03.229178+0000', 'last_fullsized': '2024-09-15T23:24:03.229178+0000', 'mapping_epoch': 204, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 204, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'last_clean_scrub_stamp': '2024-09-15T23:24:03.215032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T23:24:07.931 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T23:24:08.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.056+0000 7f8fe0911640 1 Processor -- start 2024-09-15T23:24:08.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.056+0000 7f8fe0911640 1 -- start start 2024-09-15T23:24:08.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.057+0000 7f8fe0911640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f8fdc06c320 0x7f8fdc15bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:08.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.057+0000 7f8fe0911640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8fdc13eb20 0x7f8fdc15c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:08.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.057+0000 7f8fe0911640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fdc071180 con 0x7f8fdc0b2d40 2024-09-15T23:24:08.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.057+0000 7f8fe0911640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f8fdc071ab0 con 0x7f8fdc13eb20 2024-09-15T23:24:08.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.057+0000 7f8fe0911640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f8fdc071460 con 0x7f8fdc06c320 2024-09-15T23:24:08.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.057+0000 7f8fdad9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8fdc13eb20 0x7f8fdc15c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:08.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.057+0000 7f8fdad9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8fdc13eb20 0x7f8fdc15c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39064/0 (socket says 172.21.15.123:39064) 2024-09-15T23:24:08.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.057+0000 7f8fdad9d640 1 -- 172.21.15.123:0/2292949018 learned_addr learned my addr 172.21.15.123:0/2292949018 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:08.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.057+0000 7f8fd9d9b640 1 --2- 172.21.15.123:0/2292949018 >> v2:172.21.15.188:3300/0 conn(0x7f8fdc06c320 0x7f8fdc15bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:08.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.057+0000 7f8fdad9d640 1 -- 172.21.15.123:0/2292949018 >> v2:172.21.15.188:3300/0 conn(0x7f8fdc06c320 msgr2=0x7f8fdc15bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:08.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.057+0000 7f8fdad9d640 1 --2- 172.21.15.123:0/2292949018 >> v2:172.21.15.188:3300/0 conn(0x7f8fdc06c320 0x7f8fdc15bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:08.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.057+0000 7f8fdad9d640 1 -- 172.21.15.123:0/2292949018 >> v1:172.21.15.188:6789/0 conn(0x7f8fdc0b2d40 legacy=0x7f8fdc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:08.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.057+0000 7f8fdad9d640 1 -- 172.21.15.123:0/2292949018 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fdc071740 con 0x7f8fdc13eb20 2024-09-15T23:24:08.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.058+0000 7f8fdad9d640 1 --2- 172.21.15.123:0/2292949018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fdc13eb20 0x7f8fdc15c230 secure :-1 s=READY pgs=2388 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc0d1500 tx=0x7f8fd402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cc8931d15430e9e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:08.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.058+0000 7f8fd959a640 1 -- 172.21.15.123:0/2292949018 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd4036070 con 0x7f8fdc13eb20 2024-09-15T23:24:08.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.058+0000 7f8fd959a640 1 -- 172.21.15.123:0/2292949018 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fd4031600 con 0x7f8fdc13eb20 2024-09-15T23:24:08.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.058+0000 7f8fd959a640 1 -- 172.21.15.123:0/2292949018 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd40319d0 con 0x7f8fdc13eb20 2024-09-15T23:24:08.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.059+0000 7f8fe0911640 1 -- 172.21.15.123:0/2292949018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fdc13eb20 msgr2=0x7f8fdc15c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:08.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.059+0000 7f8fe0911640 1 --2- 172.21.15.123:0/2292949018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fdc13eb20 0x7f8fdc15c230 secure :-1 s=READY pgs=2388 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc0d1500 tx=0x7f8fd402a730 comp rx=0 tx=0).stop 2024-09-15T23:24:08.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.059+0000 7f8fe0911640 1 -- 172.21.15.123:0/2292949018 shutdown_connections 2024-09-15T23:24:08.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.059+0000 7f8fe0911640 1 --2- 172.21.15.123:0/2292949018 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fdc13eb20 0x7f8fdc15c230 unknown :-1 s=CLOSED pgs=2388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:08.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.059+0000 7f8fe0911640 1 --2- 172.21.15.123:0/2292949018 >> v2:172.21.15.188:3300/0 conn(0x7f8fdc06c320 0x7f8fdc15bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:08.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.059+0000 7f8fe0911640 1 -- 172.21.15.123:0/2292949018 >> 172.21.15.123:0/2292949018 conn(0x7f8fdc0ccec0 msgr2=0x7f8fdc0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:08.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.059+0000 7f8fe0911640 1 -- 172.21.15.123:0/2292949018 shutdown_connections 2024-09-15T23:24:08.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.059+0000 7f8fe0911640 1 -- 172.21.15.123:0/2292949018 wait complete. 2024-09-15T23:24:08.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.060+0000 7f8fe0911640 1 Processor -- start 2024-09-15T23:24:08.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.060+0000 7f8fe0911640 1 -- start start 2024-09-15T23:24:08.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.061+0000 7f8fe0911640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8fdc06c320 0x7f8fdc0b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:08.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.061+0000 7f8fe0911640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fdc0b2d40 0x7f8fdc1675b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:08.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.061+0000 7f8fe0911640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8fdc13eb20 0x7f8fdc15b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:08.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.061+0000 7f8fe0911640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8fdc0720a0 con 0x7f8fdc0b2d40 2024-09-15T23:24:08.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.061+0000 7f8fe0911640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8fdc071f20 con 0x7f8fdc13eb20 2024-09-15T23:24:08.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.061+0000 7f8fe0911640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8fdc072220 con 0x7f8fdc06c320 2024-09-15T23:24:08.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.061+0000 7f8fd9d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fdc0b2d40 0x7f8fdc1675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:08.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.061+0000 7f8fd9d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fdc0b2d40 0x7f8fdc1675b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39078/0 (socket says 172.21.15.123:39078) 2024-09-15T23:24:08.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.061+0000 7f8fd9d9b640 1 -- 172.21.15.123:0/2027655204 learned_addr learned my addr 172.21.15.123:0/2027655204 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:08.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.061+0000 7f8fda59c640 1 --2- 172.21.15.123:0/2027655204 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8fdc06c320 0x7f8fdc0b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:08.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.061+0000 7f8fdad9d640 1 --2- 172.21.15.123:0/2027655204 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8fdc13eb20 0x7f8fdc15b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:08.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.061+0000 7f8fd9d9b640 1 -- 172.21.15.123:0/2027655204 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8fdc06c320 msgr2=0x7f8fdc0b45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:08.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.061+0000 7f8fd9d9b640 1 --2- 172.21.15.123:0/2027655204 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8fdc06c320 0x7f8fdc0b45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:08.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.062+0000 7f8fd9d9b640 1 -- 172.21.15.123:0/2027655204 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8fdc13eb20 msgr2=0x7f8fdc15b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:08.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.062+0000 7f8fd9d9b640 1 --2- 172.21.15.123:0/2027655204 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8fdc13eb20 0x7f8fdc15b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:08.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.062+0000 7f8fd9d9b640 1 -- 172.21.15.123:0/2027655204 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fdc166510 con 0x7f8fdc0b2d40 2024-09-15T23:24:08.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.062+0000 7f8fdad9d640 1 --2- 172.21.15.123:0/2027655204 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8fdc13eb20 0x7f8fdc15b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:24:08.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.062+0000 7f8fd9d9b640 1 --2- 172.21.15.123:0/2027655204 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fdc0b2d40 0x7f8fdc1675b0 secure :-1 s=READY pgs=2389 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000e9b0 tx=0x7f8fd000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:08.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.062+0000 7f8fcaffd640 1 -- 172.21.15.123:0/2027655204 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0017070 con 0x7f8fdc0b2d40 2024-09-15T23:24:08.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.062+0000 7f8fcaffd640 1 -- 172.21.15.123:0/2027655204 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fd000c9a0 con 0x7f8fdc0b2d40 2024-09-15T23:24:08.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.062+0000 7f8fe0911640 1 -- 172.21.15.123:0/2027655204 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fdc1667f0 con 0x7f8fdc0b2d40 2024-09-15T23:24:08.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.062+0000 7f8fcaffd640 1 -- 172.21.15.123:0/2027655204 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd000cd90 con 0x7f8fdc0b2d40 2024-09-15T23:24:08.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.062+0000 7f8fe0911640 1 -- 172.21.15.123:0/2027655204 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fdc167090 con 0x7f8fdc0b2d40 2024-09-15T23:24:08.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.063+0000 7f8fe0911640 1 -- 172.21.15.123:0/2027655204 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fdc1669c0 con 0x7f8fdc0b2d40 2024-09-15T23:24:08.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.063+0000 7f8fcaffd640 1 -- 172.21.15.123:0/2027655204 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8fd001a070 con 0x7f8fdc0b2d40 2024-09-15T23:24:08.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.064+0000 7f8fcaffd640 1 --2- 172.21.15.123:0/2027655204 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8fbc06c2b0 0x7f8fbc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:08.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.064+0000 7f8fcaffd640 1 -- 172.21.15.123:0/2027655204 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 5709+0+0 (secure 0 0 0) 0x7f8fd008b7b0 con 0x7f8fdc0b2d40 2024-09-15T23:24:08.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.064+0000 7f8fda59c640 1 --2- 172.21.15.123:0/2027655204 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8fbc06c2b0 0x7f8fbc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:08.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.064+0000 7f8fda59c640 1 --2- 172.21.15.123:0/2027655204 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8fbc06c2b0 0x7f8fbc06e770 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc001640 tx=0x7f8fcc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:08.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.068+0000 7f8fcaffd640 1 -- 172.21.15.123:0/2027655204 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8fd0059f20 con 0x7f8fdc0b2d40 2024-09-15T23:24:08.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.298+0000 7f8fe0911640 1 -- 172.21.15.123:0/2027655204 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f8fdc06bc10 con 0x7f8fdc0b2d40 2024-09-15T23:24:08.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.299+0000 7f8fcaffd640 1 -- 172.21.15.123:0/2027655204 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1158 (secure 0 0 0) 0x7f8fd0059820 con 0x7f8fdc0b2d40 2024-09-15T23:24:08.300 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:08.300 INFO:teuthology.orchestra.run.smithi123.stdout:{"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":738,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":206,"num_osds":8,"num_up_osds":8,"osd_up_since":1726441922,"num_in_osds":8,"osd_in_since":1726441911,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":41},{"state_name":"creating+peering","count":37},{"state_name":"active+clean","count":19}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":463224832,"bytes_avail":772630888448,"bytes_total":773094113280,"unknown_pgs_ratio":0.42268040776252747,"inactive_pgs_ratio":0.38144329190254211},"fsmap":{"epoch":127,"btime":"2024-09-15T23:24:06:331850+0000","id":14,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":14,"rank":0,"name":"c","status":"up:active","gid":10905}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":30,"modified":"2024-09-15T23:22:15.647794+0000","services":{}},"progress_events":{}} 2024-09-15T23:24:08.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.301+0000 7f8fe0911640 1 -- 172.21.15.123:0/2027655204 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8fbc06c2b0 msgr2=0x7f8fbc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:08.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.301+0000 7f8fe0911640 1 --2- 172.21.15.123:0/2027655204 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8fbc06c2b0 0x7f8fbc06e770 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc001640 tx=0x7f8fcc009040 comp rx=0 tx=0).stop 2024-09-15T23:24:08.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.301+0000 7f8fe0911640 1 -- 172.21.15.123:0/2027655204 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fdc0b2d40 msgr2=0x7f8fdc1675b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:08.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.301+0000 7f8fe0911640 1 --2- 172.21.15.123:0/2027655204 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fdc0b2d40 0x7f8fdc1675b0 secure :-1 s=READY pgs=2389 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000e9b0 tx=0x7f8fd000ee70 comp rx=0 tx=0).stop 2024-09-15T23:24:08.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.301+0000 7f8fe0911640 1 -- 172.21.15.123:0/2027655204 shutdown_connections 2024-09-15T23:24:08.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.301+0000 7f8fe0911640 1 --2- 172.21.15.123:0/2027655204 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8fdc13eb20 0x7f8fdc15b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:08.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.301+0000 7f8fe0911640 1 --2- 172.21.15.123:0/2027655204 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8fbc06c2b0 0x7f8fbc06e770 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:08.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.301+0000 7f8fe0911640 1 --2- 172.21.15.123:0/2027655204 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8fdc0b2d40 0x7f8fdc1675b0 unknown :-1 s=CLOSED pgs=2389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:08.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.301+0000 7f8fe0911640 1 --2- 172.21.15.123:0/2027655204 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8fdc06c320 0x7f8fdc0b45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:08.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.301+0000 7f8fe0911640 1 -- 172.21.15.123:0/2027655204 >> 172.21.15.123:0/2027655204 conn(0x7f8fdc0ccec0 msgr2=0x7f8fdc0d0400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:08.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.301+0000 7f8fe0911640 1 -- 172.21.15.123:0/2027655204 shutdown_connections 2024-09-15T23:24:08.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.301+0000 7f8fe0911640 1 -- 172.21.15.123:0/2027655204 wait complete. 2024-09-15T23:24:08.313 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-15T23:24:08.313 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:24:08.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.412+0000 7f271d391640 1 Processor -- start 2024-09-15T23:24:08.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.412+0000 7f271d391640 1 -- start start 2024-09-15T23:24:08.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.413+0000 7f271d391640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f271815ed20 0x7f27180b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:08.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.413+0000 7f271d391640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f27180d23b0 0x7f27180b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:08.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.413+0000 7f271d391640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27180d0e70 con 0x7f27180cf2d0 2024-09-15T23:24:08.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.413+0000 7f271d391640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f27180d41c0 con 0x7f271815ed20 2024-09-15T23:24:08.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.413+0000 7f271d391640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f27180d35b0 con 0x7f27180d23b0 2024-09-15T23:24:08.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.413+0000 7f27177fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f27180cf2d0 0x7f27180cf760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39204/0 (socket says 172.21.15.123:39204) 2024-09-15T23:24:08.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.413+0000 7f27177fe640 1 -- 172.21.15.123:0/2042433910 learned_addr learned my addr 172.21.15.123:0/2042433910 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:08.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.413+0000 7f2716ffd640 1 --2- 172.21.15.123:0/2042433910 >> v2:172.21.15.188:3300/0 conn(0x7f271815ed20 0x7f27180b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:08.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.413+0000 7f270e7fc640 1 --2- 172.21.15.123:0/2042433910 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f27180d23b0 0x7f27180b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:08.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.413+0000 7f27167fc640 1 -- 172.21.15.123:0/2042433910 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3023269043 0 0) 0x7f2710001490 con 0x7f27180cf2d0 2024-09-15T23:24:08.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.413+0000 7f27167fc640 1 -- 172.21.15.123:0/2042433910 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2704003520 con 0x7f27180cf2d0 2024-09-15T23:24:08.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.413+0000 7f27167fc640 1 -- 172.21.15.123:0/2042433910 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1044050997 0 0) 0x7f2704003520 con 0x7f27180cf2d0 2024-09-15T23:24:08.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.413+0000 7f27167fc640 1 -- 172.21.15.123:0/2042433910 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f27180d23b0 msgr2=0x7f27180b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:08.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.413+0000 7f27167fc640 1 --2- 172.21.15.123:0/2042433910 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f27180d23b0 0x7f27180b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:08.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.413+0000 7f27167fc640 1 -- 172.21.15.123:0/2042433910 >> v2:172.21.15.188:3300/0 conn(0x7f271815ed20 msgr2=0x7f27180b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:08.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.413+0000 7f27167fc640 1 --2- 172.21.15.123:0/2042433910 >> v2:172.21.15.188:3300/0 conn(0x7f271815ed20 0x7f27180b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:08.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.413+0000 7f27167fc640 1 -- 172.21.15.123:0/2042433910 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27180d3890 con 0x7f27180cf2d0 2024-09-15T23:24:08.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.413+0000 7f27167fc640 1 -- 172.21.15.123:0/2042433910 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f2710001bc0 con 0x7f27180cf2d0 2024-09-15T23:24:08.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.413+0000 7f27167fc640 1 -- 172.21.15.123:0/2042433910 >> v1:172.21.15.123:6789/0 conn(0x7f27180cf2d0 legacy=0x7f27180cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:08.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.413+0000 7f27167fc640 1 --2- 172.21.15.123:0/2042433910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27040039b0 0x7f2704003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:08.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.413+0000 7f27167fc640 1 --2- 172.21.15.123:0/2042433910 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f27180d23b0 0x7f2704004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:08.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.413+0000 7f27167fc640 1 --2- 172.21.15.123:0/2042433910 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2704004d40 0x7f27040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:08.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.413+0000 7f27167fc640 1 -- 172.21.15.123:0/2042433910 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f27180d41c0 con 0x7f27040039b0 2024-09-15T23:24:08.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.413+0000 7f27167fc640 1 -- 172.21.15.123:0/2042433910 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f27180d35b0 con 0x7f2704004d40 2024-09-15T23:24:08.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.413+0000 7f27167fc640 1 -- 172.21.15.123:0/2042433910 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f270400b9c0 con 0x7f27180d23b0 2024-09-15T23:24:08.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.413+0000 7f2716ffd640 1 --2- 172.21.15.123:0/2042433910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27040039b0 0x7f2704003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:08.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.414+0000 7f270e7fc640 1 --2- 172.21.15.123:0/2042433910 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f27180d23b0 0x7f2704004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:08.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.414+0000 7f27177fe640 1 --2- 172.21.15.123:0/2042433910 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2704004d40 0x7f27040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:08.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.414+0000 7f2716ffd640 1 -- 172.21.15.123:0/2042433910 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f27180d23b0 msgr2=0x7f2704004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:08.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.414+0000 7f2716ffd640 1 --2- 172.21.15.123:0/2042433910 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f27180d23b0 0x7f2704004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:08.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.414+0000 7f2716ffd640 1 -- 172.21.15.123:0/2042433910 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2704004d40 msgr2=0x7f27040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:08.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.414+0000 7f2716ffd640 1 --2- 172.21.15.123:0/2042433910 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2704004d40 0x7f27040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:08.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.414+0000 7f2716ffd640 1 -- 172.21.15.123:0/2042433910 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2704003520 con 0x7f27040039b0 2024-09-15T23:24:08.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.414+0000 7f2716ffd640 1 --2- 172.21.15.123:0/2042433910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27040039b0 0x7f2704003dd0 secure :-1 s=READY pgs=2391 cs=0 l=1 rev1=1 crypto rx=0x7f2708009ac0 tx=0x7f2704005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf84f9e588541231 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:08.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.414+0000 7f27167fc640 1 -- 172.21.15.123:0/2042433910 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2708036070 con 0x7f27040039b0 2024-09-15T23:24:08.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.415+0000 7f27167fc640 1 -- 172.21.15.123:0/2042433910 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2708031400 con 0x7f27040039b0 2024-09-15T23:24:08.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.415+0000 7f27167fc640 1 -- 172.21.15.123:0/2042433910 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2708009690 con 0x7f27040039b0 2024-09-15T23:24:08.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.415+0000 7f271d391640 1 -- 172.21.15.123:0/2042433910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27040039b0 msgr2=0x7f2704003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:08.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.415+0000 7f271d391640 1 --2- 172.21.15.123:0/2042433910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27040039b0 0x7f2704003dd0 secure :-1 s=READY pgs=2391 cs=0 l=1 rev1=1 crypto rx=0x7f2708009ac0 tx=0x7f2704005830 comp rx=0 tx=0).stop 2024-09-15T23:24:08.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.415+0000 7f27177fe640 1 -- 172.21.15.123:0/2042433910 reap_dead start 2024-09-15T23:24:08.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.415+0000 7f271d391640 1 -- 172.21.15.123:0/2042433910 shutdown_connections 2024-09-15T23:24:08.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.415+0000 7f271d391640 1 -- 172.21.15.123:0/2042433910 >> 172.21.15.123:0/2042433910 conn(0x7f27180d1260 msgr2=0x7f27180d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:08.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.415+0000 7f271d391640 1 -- 172.21.15.123:0/2042433910 shutdown_connections 2024-09-15T23:24:08.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.415+0000 7f271d391640 1 -- 172.21.15.123:0/2042433910 wait complete. 2024-09-15T23:24:08.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.416+0000 7f271d391640 1 Processor -- start 2024-09-15T23:24:08.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.416+0000 7f271d391640 1 -- start start 2024-09-15T23:24:08.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.417+0000 7f271d391640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27040039b0 0x7f27180acf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:08.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.417+0000 7f271d391640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f27181f4870 0x7f27180abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:08.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.417+0000 7f271d391640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27180ce4e0 0x7f271815cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:08.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.417+0000 7f271d391640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f27180d32a0 con 0x7f27040039b0 2024-09-15T23:24:08.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.417+0000 7f271d391640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f27180d3e50 con 0x7f27180ce4e0 2024-09-15T23:24:08.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.417+0000 7f271d391640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f271815f100 con 0x7f27181f4870 2024-09-15T23:24:08.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.417+0000 7f2716ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27040039b0 0x7f27180acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:08.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.417+0000 7f2716ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27040039b0 0x7f27180acf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39090/0 (socket says 172.21.15.123:39090) 2024-09-15T23:24:08.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.417+0000 7f2716ffd640 1 -- 172.21.15.123:0/640526624 learned_addr learned my addr 172.21.15.123:0/640526624 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:08.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.417+0000 7f270e7fc640 1 --2- 172.21.15.123:0/640526624 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f27181f4870 0x7f27180abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:08.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.417+0000 7f27177fe640 1 --2- 172.21.15.123:0/640526624 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27180ce4e0 0x7f271815cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:08.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.418+0000 7f2716ffd640 1 -- 172.21.15.123:0/640526624 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f27181f4870 msgr2=0x7f27180abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:08.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.418+0000 7f2716ffd640 1 --2- 172.21.15.123:0/640526624 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f27181f4870 0x7f27180abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:08.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.418+0000 7f2716ffd640 1 -- 172.21.15.123:0/640526624 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27180ce4e0 msgr2=0x7f271815cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:08.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.418+0000 7f2716ffd640 1 --2- 172.21.15.123:0/640526624 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27180ce4e0 0x7f271815cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:08.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.418+0000 7f2716ffd640 1 -- 172.21.15.123:0/640526624 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27180ac310 con 0x7f27040039b0 2024-09-15T23:24:08.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.418+0000 7f2716ffd640 1 --2- 172.21.15.123:0/640526624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27040039b0 0x7f27180acf30 secure :-1 s=READY pgs=2392 cs=0 l=1 rev1=1 crypto rx=0x7f2708034040 tx=0x7f2708004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:08.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.418+0000 7f270ffff640 1 -- 172.21.15.123:0/640526624 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2708040020 con 0x7f27040039b0 2024-09-15T23:24:08.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.418+0000 7f270ffff640 1 -- 172.21.15.123:0/640526624 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2708003890 con 0x7f27040039b0 2024-09-15T23:24:08.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.418+0000 7f271d391640 1 -- 172.21.15.123:0/640526624 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27180ad580 con 0x7f27040039b0 2024-09-15T23:24:08.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.418+0000 7f270ffff640 1 -- 172.21.15.123:0/640526624 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2708036040 con 0x7f27040039b0 2024-09-15T23:24:08.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.418+0000 7f271d391640 1 -- 172.21.15.123:0/640526624 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27180cbb00 con 0x7f27040039b0 2024-09-15T23:24:08.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.419+0000 7f271d391640 1 -- 172.21.15.123:0/640526624 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27180b7010 con 0x7f27040039b0 2024-09-15T23:24:08.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.419+0000 7f270ffff640 1 -- 172.21.15.123:0/640526624 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2708043020 con 0x7f27040039b0 2024-09-15T23:24:08.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.420+0000 7f270ffff640 1 --2- 172.21.15.123:0/640526624 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f26f806c2b0 0x7f26f806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:08.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.420+0000 7f270ffff640 1 -- 172.21.15.123:0/640526624 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 5709+0+0 (secure 0 0 0) 0x7f27080ab360 con 0x7f27040039b0 2024-09-15T23:24:08.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.420+0000 7f270e7fc640 1 --2- 172.21.15.123:0/640526624 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f26f806c2b0 0x7f26f806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:08.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.420+0000 7f270e7fc640 1 --2- 172.21.15.123:0/640526624 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f26f806c2b0 0x7f26f806e770 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f27181f4c50 tx=0x7f2700009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:08.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.424+0000 7f270ffff640 1 -- 172.21.15.123:0/640526624 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f270804a070 con 0x7f27040039b0 2024-09-15T23:24:08.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.587+0000 7f271d391640 1 -- 172.21.15.123:0/640526624 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f27180d0a90 con 0x7f26f806c2b0 2024-09-15T23:24:08.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.593+0000 7f270ffff640 1 -- 172.21.15.123:0/640526624 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249401 (secure 0 0 0) 0x7f27180d0a90 con 0x7f26f806c2b0 2024-09-15T23:24:08.597 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:08.599 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:24:08.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.597+0000 7f271d391640 1 -- 172.21.15.123:0/640526624 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f26f806c2b0 msgr2=0x7f26f806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:08.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.597+0000 7f271d391640 1 --2- 172.21.15.123:0/640526624 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f26f806c2b0 0x7f26f806e770 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f27181f4c50 tx=0x7f2700009190 comp rx=0 tx=0).stop 2024-09-15T23:24:08.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.597+0000 7f271d391640 1 -- 172.21.15.123:0/640526624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27040039b0 msgr2=0x7f27180acf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:08.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.597+0000 7f271d391640 1 --2- 172.21.15.123:0/640526624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27040039b0 0x7f27180acf30 secure :-1 s=READY pgs=2392 cs=0 l=1 rev1=1 crypto rx=0x7f2708034040 tx=0x7f2708004730 comp rx=0 tx=0).stop 2024-09-15T23:24:08.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.597+0000 7f271d391640 1 -- 172.21.15.123:0/640526624 shutdown_connections 2024-09-15T23:24:08.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.597+0000 7f271d391640 1 --2- 172.21.15.123:0/640526624 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f27180ce4e0 0x7f271815cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:08.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.597+0000 7f271d391640 1 --2- 172.21.15.123:0/640526624 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f27181f4870 0x7f27180abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:08.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.597+0000 7f271d391640 1 --2- 172.21.15.123:0/640526624 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f26f806c2b0 0x7f26f806e770 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:08.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.597+0000 7f271d391640 1 --2- 172.21.15.123:0/640526624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27040039b0 0x7f27180acf30 unknown :-1 s=CLOSED pgs=2392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:08.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.597+0000 7f271d391640 1 -- 172.21.15.123:0/640526624 >> 172.21.15.123:0/640526624 conn(0x7f27180d1260 msgr2=0x7f27180d4740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:08.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.597+0000 7f271d391640 1 -- 172.21.15.123:0/640526624 shutdown_connections 2024-09-15T23:24:08.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:08.597+0000 7f271d391640 1 -- 172.21.15.123:0/640526624 wait complete. 2024-09-15T23:24:08.608 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":562,"stamp":"2024-09-15T23:24:07.674492+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592686,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":182,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":83,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":452652,"kb_used_data":21280,"kb_used_omap":12,"kb_used_meta":431155,"kb_avail":754522068,"statfs":{"total":773094113280,"available":772630597632,"internally_reserved":0,"allocated":21790720,"data_stored":10286142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":441503280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2318,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.458601"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.227236+0000","last_change":"2024-09-15T23:24:03.227236+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.227236+0000","last_undegraded":"2024-09-15T23:24:03.227236+0000","last_fullsized":"2024-09-15T23:24:03.227236+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.224505+0000","last_change":"2024-09-15T23:24:03.224505+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.224505+0000","last_undegraded":"2024-09-15T23:24:03.224505+0000","last_fullsized":"2024-09-15T23:24:03.224505+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.224018+0000","last_change":"2024-09-15T23:24:03.224018+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.224018+0000","last_undegraded":"2024-09-15T23:24:03.224018+0000","last_fullsized":"2024-09-15T23:24:03.224018+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499039+0000","last_change":"2024-09-15T23:24:04.244198+0000","last_active":"2024-09-15T23:24:05.499039+0000","last_peered":"2024-09-15T23:24:05.499039+0000","last_clean":"2024-09-15T23:24:05.499039+0000","last_became_active":"2024-09-15T23:24:04.243898+0000","last_became_peered":"2024-09-15T23:24:04.243898+0000","last_unstale":"2024-09-15T23:24:05.499039+0000","last_undegraded":"2024-09-15T23:24:05.499039+0000","last_fullsized":"2024-09-15T23:24:05.499039+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:38.945626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498934+0000","last_change":"2024-09-15T23:24:04.245896+0000","last_active":"2024-09-15T23:24:05.498934+0000","last_peered":"2024-09-15T23:24:05.498934+0000","last_clean":"2024-09-15T23:24:05.498934+0000","last_became_active":"2024-09-15T23:24:04.245613+0000","last_became_peered":"2024-09-15T23:24:04.245613+0000","last_unstale":"2024-09-15T23:24:05.498934+0000","last_undegraded":"2024-09-15T23:24:05.498934+0000","last_fullsized":"2024-09-15T23:24:05.498934+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:05:01.144617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499266+0000","last_change":"2024-09-15T23:24:04.247643+0000","last_active":"2024-09-15T23:24:05.499266+0000","last_peered":"2024-09-15T23:24:05.499266+0000","last_clean":"2024-09-15T23:24:05.499266+0000","last_became_active":"2024-09-15T23:24:04.247094+0000","last_became_peered":"2024-09-15T23:24:04.247094+0000","last_unstale":"2024-09-15T23:24:05.499266+0000","last_undegraded":"2024-09-15T23:24:05.499266+0000","last_fullsized":"2024-09-15T23:24:05.499266+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:13:13.901339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.223475+0000","last_change":"2024-09-15T23:24:03.223475+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.223475+0000","last_undegraded":"2024-09-15T23:24:03.223475+0000","last_fullsized":"2024-09-15T23:24:03.223475+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.346013+0000","last_change":"2024-09-15T23:24:04.255143+0000","last_active":"2024-09-15T23:24:05.346013+0000","last_peered":"2024-09-15T23:24:05.346013+0000","last_clean":"2024-09-15T23:24:05.346013+0000","last_became_active":"2024-09-15T23:24:04.254835+0000","last_became_peered":"2024-09-15T23:24:04.254835+0000","last_unstale":"2024-09-15T23:24:05.346013+0000","last_undegraded":"2024-09-15T23:24:05.346013+0000","last_fullsized":"2024-09-15T23:24:05.346013+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:44.443319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.228486+0000","last_change":"2024-09-15T23:24:03.228486+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.228486+0000","last_undegraded":"2024-09-15T23:24:03.228486+0000","last_fullsized":"2024-09-15T23:24:03.228486+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498816+0000","last_change":"2024-09-15T23:24:04.248229+0000","last_active":"2024-09-15T23:24:05.498816+0000","last_peered":"2024-09-15T23:24:05.498816+0000","last_clean":"2024-09-15T23:24:05.498816+0000","last_became_active":"2024-09-15T23:24:04.247914+0000","last_became_peered":"2024-09-15T23:24:04.247914+0000","last_unstale":"2024-09-15T23:24:05.498816+0000","last_undegraded":"2024-09-15T23:24:05.498816+0000","last_fullsized":"2024-09-15T23:24:05.498816+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:09.507578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.222842+0000","last_change":"2024-09-15T23:24:03.222842+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.222842+0000","last_undegraded":"2024-09-15T23:24:03.222842+0000","last_fullsized":"2024-09-15T23:24:03.222842+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.227577+0000","last_change":"2024-09-15T23:24:03.227577+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.227577+0000","last_undegraded":"2024-09-15T23:24:03.227577+0000","last_fullsized":"2024-09-15T23:24:03.227577+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.226388+0000","last_change":"2024-09-15T23:24:03.226388+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.226388+0000","last_undegraded":"2024-09-15T23:24:03.226388+0000","last_fullsized":"2024-09-15T23:24:03.226388+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.224847+0000","last_change":"2024-09-15T23:24:03.224847+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.224847+0000","last_undegraded":"2024-09-15T23:24:03.224847+0000","last_fullsized":"2024-09-15T23:24:03.224847+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499212+0000","last_change":"2024-09-15T23:24:04.240413+0000","last_active":"2024-09-15T23:24:05.499212+0000","last_peered":"2024-09-15T23:24:05.499212+0000","last_clean":"2024-09-15T23:24:05.499212+0000","last_became_active":"2024-09-15T23:24:04.240130+0000","last_became_peered":"2024-09-15T23:24:04.240130+0000","last_unstale":"2024-09-15T23:24:05.499212+0000","last_undegraded":"2024-09-15T23:24:05.499212+0000","last_fullsized":"2024-09-15T23:24:05.499212+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:37.856457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.230590+0000","last_change":"2024-09-15T23:24:03.230590+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.230590+0000","last_undegraded":"2024-09-15T23:24:03.230590+0000","last_fullsized":"2024-09-15T23:24:03.230590+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.226794+0000","last_change":"2024-09-15T23:24:03.226794+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.226794+0000","last_undegraded":"2024-09-15T23:24:03.226794+0000","last_fullsized":"2024-09-15T23:24:03.226794+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.244597+0000","last_change":"2024-09-15T23:24:04.256728+0000","last_active":"2024-09-15T23:24:05.244597+0000","last_peered":"2024-09-15T23:24:05.244597+0000","last_clean":"2024-09-15T23:24:05.244597+0000","last_became_active":"2024-09-15T23:24:04.256464+0000","last_became_peered":"2024-09-15T23:24:04.256464+0000","last_unstale":"2024-09-15T23:24:05.244597+0000","last_undegraded":"2024-09-15T23:24:05.244597+0000","last_fullsized":"2024-09-15T23:24:05.244597+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:26:25.300606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499663+0000","last_change":"2024-09-15T23:24:04.235940+0000","last_active":"2024-09-15T23:24:05.499663+0000","last_peered":"2024-09-15T23:24:05.499663+0000","last_clean":"2024-09-15T23:24:05.499663+0000","last_became_active":"2024-09-15T23:24:04.235624+0000","last_became_peered":"2024-09-15T23:24:04.235624+0000","last_unstale":"2024-09-15T23:24:05.499663+0000","last_undegraded":"2024-09-15T23:24:05.499663+0000","last_fullsized":"2024-09-15T23:24:05.499663+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:23:10.557907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.244582+0000","last_change":"2024-09-15T23:24:04.251374+0000","last_active":"2024-09-15T23:24:05.244582+0000","last_peered":"2024-09-15T23:24:05.244582+0000","last_clean":"2024-09-15T23:24:05.244582+0000","last_became_active":"2024-09-15T23:24:04.251046+0000","last_became_peered":"2024-09-15T23:24:04.251046+0000","last_unstale":"2024-09-15T23:24:05.244582+0000","last_undegraded":"2024-09-15T23:24:05.244582+0000","last_fullsized":"2024-09-15T23:24:05.244582+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:18.413148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.244614+0000","last_change":"2024-09-15T23:24:04.254788+0000","last_active":"2024-09-15T23:24:05.244614+0000","last_peered":"2024-09-15T23:24:05.244614+0000","last_clean":"2024-09-15T23:24:05.244614+0000","last_became_active":"2024-09-15T23:24:04.254416+0000","last_became_peered":"2024-09-15T23:24:04.254416+0000","last_unstale":"2024-09-15T23:24:05.244614+0000","last_undegraded":"2024-09-15T23:24:05.244614+0000","last_fullsized":"2024-09-15T23:24:05.244614+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:25:57.392070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499304+0000","last_change":"2024-09-15T23:24:04.240142+0000","last_active":"2024-09-15T23:24:05.499304+0000","last_peered":"2024-09-15T23:24:05.499304+0000","last_clean":"2024-09-15T23:24:05.499304+0000","last_became_active":"2024-09-15T23:24:04.239869+0000","last_became_peered":"2024-09-15T23:24:04.239869+0000","last_unstale":"2024-09-15T23:24:05.499304+0000","last_undegraded":"2024-09-15T23:24:05.499304+0000","last_fullsized":"2024-09-15T23:24:05.499304+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:32.692520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.224229+0000","last_change":"2024-09-15T23:24:03.224229+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.224229+0000","last_undegraded":"2024-09-15T23:24:03.224229+0000","last_fullsized":"2024-09-15T23:24:03.224229+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498650+0000","last_change":"2024-09-15T23:24:04.240899+0000","last_active":"2024-09-15T23:24:05.498650+0000","last_peered":"2024-09-15T23:24:05.498650+0000","last_clean":"2024-09-15T23:24:05.498650+0000","last_became_active":"2024-09-15T23:24:04.240636+0000","last_became_peered":"2024-09-15T23:24:04.240636+0000","last_unstale":"2024-09-15T23:24:05.498650+0000","last_undegraded":"2024-09-15T23:24:05.498650+0000","last_fullsized":"2024-09-15T23:24:05.498650+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:18:51.671914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.223368+0000","last_change":"2024-09-15T23:24:03.223368+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.223368+0000","last_undegraded":"2024-09-15T23:24:03.223368+0000","last_fullsized":"2024-09-15T23:24:03.223368+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499702+0000","last_change":"2024-09-15T23:24:04.236738+0000","last_active":"2024-09-15T23:24:05.499702+0000","last_peered":"2024-09-15T23:24:05.499702+0000","last_clean":"2024-09-15T23:24:05.499702+0000","last_became_active":"2024-09-15T23:24:04.236454+0000","last_became_peered":"2024-09-15T23:24:04.236454+0000","last_unstale":"2024-09-15T23:24:05.499702+0000","last_undegraded":"2024-09-15T23:24:05.499702+0000","last_fullsized":"2024-09-15T23:24:05.499702+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:14:03.841374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.223265+0000","last_change":"2024-09-15T23:24:03.223265+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.223265+0000","last_undegraded":"2024-09-15T23:24:03.223265+0000","last_fullsized":"2024-09-15T23:24:03.223265+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.346194+0000","last_change":"2024-09-15T23:24:04.247692+0000","last_active":"2024-09-15T23:24:05.346194+0000","last_peered":"2024-09-15T23:24:05.346194+0000","last_clean":"2024-09-15T23:24:05.346194+0000","last_became_active":"2024-09-15T23:24:04.247381+0000","last_became_peered":"2024-09-15T23:24:04.247381+0000","last_unstale":"2024-09-15T23:24:05.346194+0000","last_undegraded":"2024-09-15T23:24:05.346194+0000","last_fullsized":"2024-09-15T23:24:05.346194+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:40:00.524589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.228304+0000","last_change":"2024-09-15T23:24:03.228304+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.228304+0000","last_undegraded":"2024-09-15T23:24:03.228304+0000","last_fullsized":"2024-09-15T23:24:03.228304+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.226416+0000","last_change":"2024-09-15T23:24:03.226416+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.226416+0000","last_undegraded":"2024-09-15T23:24:03.226416+0000","last_fullsized":"2024-09-15T23:24:03.226416+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.244369+0000","last_change":"2024-09-15T23:24:04.249444+0000","last_active":"2024-09-15T23:24:05.244369+0000","last_peered":"2024-09-15T23:24:05.244369+0000","last_clean":"2024-09-15T23:24:05.244369+0000","last_became_active":"2024-09-15T23:24:04.249083+0000","last_became_peered":"2024-09-15T23:24:04.249083+0000","last_unstale":"2024-09-15T23:24:05.244369+0000","last_undegraded":"2024-09-15T23:24:05.244369+0000","last_fullsized":"2024-09-15T23:24:05.244369+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:59.472118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.346074+0000","last_change":"2024-09-15T23:24:04.243542+0000","last_active":"2024-09-15T23:24:05.346074+0000","last_peered":"2024-09-15T23:24:05.346074+0000","last_clean":"2024-09-15T23:24:05.346074+0000","last_became_active":"2024-09-15T23:24:04.243220+0000","last_became_peered":"2024-09-15T23:24:04.243220+0000","last_unstale":"2024-09-15T23:24:05.346074+0000","last_undegraded":"2024-09-15T23:24:05.346074+0000","last_fullsized":"2024-09-15T23:24:05.346074+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:48:50.324247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.223740+0000","last_change":"2024-09-15T23:24:03.223740+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.223740+0000","last_undegraded":"2024-09-15T23:24:03.223740+0000","last_fullsized":"2024-09-15T23:24:03.223740+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1f","version":"205'4","reported_seq":18,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499727+0000","last_change":"2024-09-15T23:24:03.237701+0000","last_active":"2024-09-15T23:24:05.499727+0000","last_peered":"2024-09-15T23:24:05.499727+0000","last_clean":"2024-09-15T23:24:05.499727+0000","last_became_active":"2024-09-15T23:24:03.237407+0000","last_became_peered":"2024-09-15T23:24:03.237407+0000","last_unstale":"2024-09-15T23:24:05.499727+0000","last_undegraded":"2024-09-15T23:24:05.499727+0000","last_fullsized":"2024-09-15T23:24:05.499727+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:01:57.916838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499776+0000","last_change":"2024-09-15T23:24:04.241162+0000","last_active":"2024-09-15T23:24:05.499776+0000","last_peered":"2024-09-15T23:24:05.499776+0000","last_clean":"2024-09-15T23:24:05.499776+0000","last_became_active":"2024-09-15T23:24:04.240909+0000","last_became_peered":"2024-09-15T23:24:04.240909+0000","last_unstale":"2024-09-15T23:24:05.499776+0000","last_undegraded":"2024-09-15T23:24:05.499776+0000","last_fullsized":"2024-09-15T23:24:05.499776+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:22.005817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.233971+0000","last_change":"2024-09-15T23:24:03.232380+0000","last_active":"2024-09-15T23:24:03.233971+0000","last_peered":"2024-09-15T23:24:03.233971+0000","last_clean":"2024-09-15T23:24:03.233971+0000","last_became_active":"2024-09-15T23:24:03.225881+0000","last_became_peered":"2024-09-15T23:24:03.225881+0000","last_unstale":"2024-09-15T23:24:03.233971+0000","last_undegraded":"2024-09-15T23:24:03.233971+0000","last_fullsized":"2024-09-15T23:24:03.233971+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:52:16.001769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.229217+0000","last_change":"2024-09-15T23:24:03.229217+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.229217+0000","last_undegraded":"2024-09-15T23:24:03.229217+0000","last_fullsized":"2024-09-15T23:24:03.229217+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.237582+0000","last_change":"2024-09-15T23:24:03.236362+0000","last_active":"2024-09-15T23:24:03.237582+0000","last_peered":"2024-09-15T23:24:03.237582+0000","last_clean":"2024-09-15T23:24:03.237582+0000","last_became_active":"2024-09-15T23:24:03.236134+0000","last_became_peered":"2024-09-15T23:24:03.236134+0000","last_unstale":"2024-09-15T23:24:03.237582+0000","last_undegraded":"2024-09-15T23:24:03.237582+0000","last_fullsized":"2024-09-15T23:24:03.237582+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:29:01.714652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.223497+0000","last_change":"2024-09-15T23:24:03.223497+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.223497+0000","last_undegraded":"2024-09-15T23:24:03.223497+0000","last_fullsized":"2024-09-15T23:24:03.223497+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1b","version":"205'1","reported_seq":15,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498815+0000","last_change":"2024-09-15T23:24:03.233549+0000","last_active":"2024-09-15T23:24:05.498815+0000","last_peered":"2024-09-15T23:24:05.498815+0000","last_clean":"2024-09-15T23:24:05.498815+0000","last_became_active":"2024-09-15T23:24:03.233220+0000","last_became_peered":"2024-09-15T23:24:03.233220+0000","last_unstale":"2024-09-15T23:24:05.498815+0000","last_undegraded":"2024-09-15T23:24:05.498815+0000","last_fullsized":"2024-09-15T23:24:05.498815+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:27:10.001446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499430+0000","last_change":"2024-09-15T23:24:04.239016+0000","last_active":"2024-09-15T23:24:05.499430+0000","last_peered":"2024-09-15T23:24:05.499430+0000","last_clean":"2024-09-15T23:24:05.499430+0000","last_became_active":"2024-09-15T23:24:04.238588+0000","last_became_peered":"2024-09-15T23:24:04.238588+0000","last_unstale":"2024-09-15T23:24:05.499430+0000","last_undegraded":"2024-09-15T23:24:05.499430+0000","last_fullsized":"2024-09-15T23:24:05.499430+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:32:33.096858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.230537+0000","last_change":"2024-09-15T23:24:03.226435+0000","last_active":"2024-09-15T23:24:03.230537+0000","last_peered":"2024-09-15T23:24:03.230537+0000","last_clean":"2024-09-15T23:24:03.230537+0000","last_became_active":"2024-09-15T23:24:03.226192+0000","last_became_peered":"2024-09-15T23:24:03.226192+0000","last_unstale":"2024-09-15T23:24:03.230537+0000","last_undegraded":"2024-09-15T23:24:03.230537+0000","last_fullsized":"2024-09-15T23:24:03.230537+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:10:29.458773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499088+0000","last_change":"2024-09-15T23:24:04.239606+0000","last_active":"2024-09-15T23:24:05.499088+0000","last_peered":"2024-09-15T23:24:05.499088+0000","last_clean":"2024-09-15T23:24:05.499088+0000","last_became_active":"2024-09-15T23:24:04.239300+0000","last_became_peered":"2024-09-15T23:24:04.239300+0000","last_unstale":"2024-09-15T23:24:05.499088+0000","last_undegraded":"2024-09-15T23:24:05.499088+0000","last_fullsized":"2024-09-15T23:24:05.499088+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:55.718328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.242172+0000","last_change":"2024-09-15T23:24:03.238146+0000","last_active":"2024-09-15T23:24:03.242172+0000","last_peered":"2024-09-15T23:24:03.242172+0000","last_clean":"2024-09-15T23:24:03.242172+0000","last_became_active":"2024-09-15T23:24:03.237891+0000","last_became_peered":"2024-09-15T23:24:03.237891+0000","last_unstale":"2024-09-15T23:24:03.242172+0000","last_undegraded":"2024-09-15T23:24:03.242172+0000","last_fullsized":"2024-09-15T23:24:03.242172+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:02:57.404523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.223037+0000","last_change":"2024-09-15T23:24:03.223037+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.223037+0000","last_undegraded":"2024-09-15T23:24:03.223037+0000","last_fullsized":"2024-09-15T23:24:03.223037+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":14,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.244228+0000","last_change":"2024-09-15T23:24:03.238917+0000","last_active":"2024-09-15T23:24:05.244228+0000","last_peered":"2024-09-15T23:24:05.244228+0000","last_clean":"2024-09-15T23:24:05.244228+0000","last_became_active":"2024-09-15T23:24:03.238111+0000","last_became_peered":"2024-09-15T23:24:03.238111+0000","last_unstale":"2024-09-15T23:24:05.244228+0000","last_undegraded":"2024-09-15T23:24:05.244228+0000","last_fullsized":"2024-09-15T23:24:05.244228+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:25.882975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.226896+0000","last_change":"2024-09-15T23:24:03.226896+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.226896+0000","last_undegraded":"2024-09-15T23:24:03.226896+0000","last_fullsized":"2024-09-15T23:24:03.226896+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.239471+0000","last_change":"2024-09-15T23:24:03.233947+0000","last_active":"2024-09-15T23:24:03.239471+0000","last_peered":"2024-09-15T23:24:03.239471+0000","last_clean":"2024-09-15T23:24:03.239471+0000","last_became_active":"2024-09-15T23:24:03.233577+0000","last_became_peered":"2024-09-15T23:24:03.233577+0000","last_unstale":"2024-09-15T23:24:03.239471+0000","last_undegraded":"2024-09-15T23:24:03.239471+0000","last_fullsized":"2024-09-15T23:24:03.239471+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:19:20.973913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.222988+0000","last_change":"2024-09-15T23:24:03.222988+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.222988+0000","last_undegraded":"2024-09-15T23:24:03.222988+0000","last_fullsized":"2024-09-15T23:24:03.222988+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":14,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499015+0000","last_change":"2024-09-15T23:24:03.234732+0000","last_active":"2024-09-15T23:24:05.499015+0000","last_peered":"2024-09-15T23:24:05.499015+0000","last_clean":"2024-09-15T23:24:05.499015+0000","last_became_active":"2024-09-15T23:24:03.234455+0000","last_became_peered":"2024-09-15T23:24:03.234455+0000","last_unstale":"2024-09-15T23:24:05.499015+0000","last_undegraded":"2024-09-15T23:24:05.499015+0000","last_fullsized":"2024-09-15T23:24:05.499015+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:58.467849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.227189+0000","last_change":"2024-09-15T23:24:03.227189+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.227189+0000","last_undegraded":"2024-09-15T23:24:03.227189+0000","last_fullsized":"2024-09-15T23:24:03.227189+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"205'3","reported_seq":17,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.346184+0000","last_change":"2024-09-15T23:24:03.234930+0000","last_active":"2024-09-15T23:24:05.346184+0000","last_peered":"2024-09-15T23:24:05.346184+0000","last_clean":"2024-09-15T23:24:05.346184+0000","last_became_active":"2024-09-15T23:24:03.234624+0000","last_became_peered":"2024-09-15T23:24:03.234624+0000","last_unstale":"2024-09-15T23:24:05.346184+0000","last_undegraded":"2024-09-15T23:24:05.346184+0000","last_fullsized":"2024-09-15T23:24:05.346184+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:01:57.916838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.226402+0000","last_change":"2024-09-15T23:24:03.226402+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.226402+0000","last_undegraded":"2024-09-15T23:24:03.226402+0000","last_fullsized":"2024-09-15T23:24:03.226402+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.14","version":"205'6","reported_seq":20,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.244626+0000","last_change":"2024-09-15T23:24:03.229069+0000","last_active":"2024-09-15T23:24:05.244626+0000","last_peered":"2024-09-15T23:24:05.244626+0000","last_clean":"2024-09-15T23:24:05.244626+0000","last_became_active":"2024-09-15T23:24:03.228795+0000","last_became_peered":"2024-09-15T23:24:03.228795+0000","last_unstale":"2024-09-15T23:24:05.244626+0000","last_undegraded":"2024-09-15T23:24:05.244626+0000","last_fullsized":"2024-09-15T23:24:05.244626+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:50.332347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499480+0000","last_change":"2024-09-15T23:24:04.240484+0000","last_active":"2024-09-15T23:24:05.499480+0000","last_peered":"2024-09-15T23:24:05.499480+0000","last_clean":"2024-09-15T23:24:05.499480+0000","last_became_active":"2024-09-15T23:24:04.239740+0000","last_became_peered":"2024-09-15T23:24:04.239740+0000","last_unstale":"2024-09-15T23:24:05.499480+0000","last_undegraded":"2024-09-15T23:24:05.499480+0000","last_fullsized":"2024-09-15T23:24:05.499480+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:45.895857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.13","version":"205'2","reported_seq":16,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.346119+0000","last_change":"2024-09-15T23:24:03.237296+0000","last_active":"2024-09-15T23:24:05.346119+0000","last_peered":"2024-09-15T23:24:05.346119+0000","last_clean":"2024-09-15T23:24:05.346119+0000","last_became_active":"2024-09-15T23:24:03.237024+0000","last_became_peered":"2024-09-15T23:24:03.237024+0000","last_unstale":"2024-09-15T23:24:05.346119+0000","last_undegraded":"2024-09-15T23:24:05.346119+0000","last_fullsized":"2024-09-15T23:24:05.346119+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:22.254679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.227303+0000","last_change":"2024-09-15T23:24:03.227303+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.227303+0000","last_undegraded":"2024-09-15T23:24:03.227303+0000","last_fullsized":"2024-09-15T23:24:03.227303+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":14,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499467+0000","last_change":"2024-09-15T23:24:03.236841+0000","last_active":"2024-09-15T23:24:05.499467+0000","last_peered":"2024-09-15T23:24:05.499467+0000","last_clean":"2024-09-15T23:24:05.499467+0000","last_became_active":"2024-09-15T23:24:03.236129+0000","last_became_peered":"2024-09-15T23:24:03.236129+0000","last_unstale":"2024-09-15T23:24:05.499467+0000","last_undegraded":"2024-09-15T23:24:05.499467+0000","last_fullsized":"2024-09-15T23:24:05.499467+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:01:21.387520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.227693+0000","last_change":"2024-09-15T23:24:03.227693+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.227693+0000","last_undegraded":"2024-09-15T23:24:03.227693+0000","last_fullsized":"2024-09-15T23:24:03.227693+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":14,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499333+0000","last_change":"2024-09-15T23:24:03.231444+0000","last_active":"2024-09-15T23:24:05.499333+0000","last_peered":"2024-09-15T23:24:05.499333+0000","last_clean":"2024-09-15T23:24:05.499333+0000","last_became_active":"2024-09-15T23:24:03.231172+0000","last_became_peered":"2024-09-15T23:24:03.231172+0000","last_unstale":"2024-09-15T23:24:05.499333+0000","last_undegraded":"2024-09-15T23:24:05.499333+0000","last_fullsized":"2024-09-15T23:24:05.499333+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:52:31.013796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.223048+0000","last_change":"2024-09-15T23:24:03.223048+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.223048+0000","last_undegraded":"2024-09-15T23:24:03.223048+0000","last_fullsized":"2024-09-15T23:24:03.223048+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.235426+0000","last_change":"2024-09-15T23:24:03.234776+0000","last_active":"2024-09-15T23:24:03.235426+0000","last_peered":"2024-09-15T23:24:03.235426+0000","last_clean":"2024-09-15T23:24:03.235426+0000","last_became_active":"2024-09-15T23:24:03.234449+0000","last_became_peered":"2024-09-15T23:24:03.234449+0000","last_unstale":"2024-09-15T23:24:03.235426+0000","last_undegraded":"2024-09-15T23:24:03.235426+0000","last_fullsized":"2024-09-15T23:24:03.235426+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:47:38.673671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498900+0000","last_change":"2024-09-15T23:24:04.241959+0000","last_active":"2024-09-15T23:24:05.498900+0000","last_peered":"2024-09-15T23:24:05.498900+0000","last_clean":"2024-09-15T23:24:05.498900+0000","last_became_active":"2024-09-15T23:24:04.241644+0000","last_became_peered":"2024-09-15T23:24:04.241644+0000","last_unstale":"2024-09-15T23:24:05.498900+0000","last_undegraded":"2024-09-15T23:24:05.498900+0000","last_fullsized":"2024-09-15T23:24:05.498900+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:58:16.996796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.240876+0000","last_change":"2024-09-15T23:24:03.235856+0000","last_active":"2024-09-15T23:24:03.240876+0000","last_peered":"2024-09-15T23:24:03.240876+0000","last_clean":"2024-09-15T23:24:03.240876+0000","last_became_active":"2024-09-15T23:24:03.235564+0000","last_became_peered":"2024-09-15T23:24:03.235564+0000","last_unstale":"2024-09-15T23:24:03.240876+0000","last_undegraded":"2024-09-15T23:24:03.240876+0000","last_fullsized":"2024-09-15T23:24:03.240876+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:01.343626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.244706+0000","last_change":"2024-09-15T23:24:04.251386+0000","last_active":"2024-09-15T23:24:05.244706+0000","last_peered":"2024-09-15T23:24:05.244706+0000","last_clean":"2024-09-15T23:24:05.244706+0000","last_became_active":"2024-09-15T23:24:04.250821+0000","last_became_peered":"2024-09-15T23:24:04.250821+0000","last_unstale":"2024-09-15T23:24:05.244706+0000","last_undegraded":"2024-09-15T23:24:05.244706+0000","last_fullsized":"2024-09-15T23:24:05.244706+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:24.970281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.e","version":"205'2","reported_seq":16,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.244754+0000","last_change":"2024-09-15T23:24:03.233419+0000","last_active":"2024-09-15T23:24:05.244754+0000","last_peered":"2024-09-15T23:24:05.244754+0000","last_clean":"2024-09-15T23:24:05.244754+0000","last_became_active":"2024-09-15T23:24:03.232860+0000","last_became_peered":"2024-09-15T23:24:03.232860+0000","last_unstale":"2024-09-15T23:24:05.244754+0000","last_undegraded":"2024-09-15T23:24:05.244754+0000","last_fullsized":"2024-09-15T23:24:05.244754+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:14.313547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.223231+0000","last_change":"2024-09-15T23:24:03.223231+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.223231+0000","last_undegraded":"2024-09-15T23:24:03.223231+0000","last_fullsized":"2024-09-15T23:24:03.223231+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.237191+0000","last_change":"2024-09-15T23:24:03.233389+0000","last_active":"2024-09-15T23:24:03.237191+0000","last_peered":"2024-09-15T23:24:03.237191+0000","last_clean":"2024-09-15T23:24:03.237191+0000","last_became_active":"2024-09-15T23:24:03.233139+0000","last_became_peered":"2024-09-15T23:24:03.233139+0000","last_unstale":"2024-09-15T23:24:03.237191+0000","last_undegraded":"2024-09-15T23:24:03.237191+0000","last_fullsized":"2024-09-15T23:24:03.237191+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:06:36.696878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.228859+0000","last_change":"2024-09-15T23:24:03.228859+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.228859+0000","last_undegraded":"2024-09-15T23:24:03.228859+0000","last_fullsized":"2024-09-15T23:24:03.228859+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":14,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498976+0000","last_change":"2024-09-15T23:24:03.236047+0000","last_active":"2024-09-15T23:24:05.498976+0000","last_peered":"2024-09-15T23:24:05.498976+0000","last_clean":"2024-09-15T23:24:05.498976+0000","last_became_active":"2024-09-15T23:24:03.235739+0000","last_became_peered":"2024-09-15T23:24:03.235739+0000","last_unstale":"2024-09-15T23:24:05.498976+0000","last_undegraded":"2024-09-15T23:24:05.498976+0000","last_fullsized":"2024-09-15T23:24:05.498976+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:53:15.816067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.244610+0000","last_change":"2024-09-15T23:24:04.250765+0000","last_active":"2024-09-15T23:24:05.244610+0000","last_peered":"2024-09-15T23:24:05.244610+0000","last_clean":"2024-09-15T23:24:05.244610+0000","last_became_active":"2024-09-15T23:24:04.250457+0000","last_became_peered":"2024-09-15T23:24:04.250457+0000","last_unstale":"2024-09-15T23:24:05.244610+0000","last_undegraded":"2024-09-15T23:24:05.244610+0000","last_fullsized":"2024-09-15T23:24:05.244610+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:55:27.067955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.239487+0000","last_change":"2024-09-15T23:24:03.234239+0000","last_active":"2024-09-15T23:24:03.239487+0000","last_peered":"2024-09-15T23:24:03.239487+0000","last_clean":"2024-09-15T23:24:03.239487+0000","last_became_active":"2024-09-15T23:24:03.233978+0000","last_became_peered":"2024-09-15T23:24:03.233978+0000","last_unstale":"2024-09-15T23:24:03.239487+0000","last_undegraded":"2024-09-15T23:24:03.239487+0000","last_fullsized":"2024-09-15T23:24:03.239487+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:06:10.713689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.229398+0000","last_change":"2024-09-15T23:24:03.229398+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.229398+0000","last_undegraded":"2024-09-15T23:24:03.229398+0000","last_fullsized":"2024-09-15T23:24:03.229398+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.239117+0000","last_change":"2024-09-15T23:24:03.236689+0000","last_active":"2024-09-15T23:24:03.239117+0000","last_peered":"2024-09-15T23:24:03.239117+0000","last_clean":"2024-09-15T23:24:03.239117+0000","last_became_active":"2024-09-15T23:24:03.236226+0000","last_became_peered":"2024-09-15T23:24:03.236226+0000","last_unstale":"2024-09-15T23:24:03.239117+0000","last_undegraded":"2024-09-15T23:24:03.239117+0000","last_fullsized":"2024-09-15T23:24:03.239117+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:25.462598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498657+0000","last_change":"2024-09-15T23:24:04.253235+0000","last_active":"2024-09-15T23:24:05.498657+0000","last_peered":"2024-09-15T23:24:05.498657+0000","last_clean":"2024-09-15T23:24:05.498657+0000","last_became_active":"2024-09-15T23:24:04.252940+0000","last_became_peered":"2024-09-15T23:24:04.252940+0000","last_unstale":"2024-09-15T23:24:05.498657+0000","last_undegraded":"2024-09-15T23:24:05.498657+0000","last_fullsized":"2024-09-15T23:24:05.498657+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:37:08.840834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.237912+0000","last_change":"2024-09-15T23:24:03.235609+0000","last_active":"2024-09-15T23:24:03.237912+0000","last_peered":"2024-09-15T23:24:03.237912+0000","last_clean":"2024-09-15T23:24:03.237912+0000","last_became_active":"2024-09-15T23:24:03.235358+0000","last_became_peered":"2024-09-15T23:24:03.235358+0000","last_unstale":"2024-09-15T23:24:03.237912+0000","last_undegraded":"2024-09-15T23:24:03.237912+0000","last_fullsized":"2024-09-15T23:24:03.237912+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:08:39.184956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.346109+0000","last_change":"2024-09-15T23:24:04.243440+0000","last_active":"2024-09-15T23:24:05.346109+0000","last_peered":"2024-09-15T23:24:05.346109+0000","last_clean":"2024-09-15T23:24:05.346109+0000","last_became_active":"2024-09-15T23:24:04.243165+0000","last_became_peered":"2024-09-15T23:24:04.243165+0000","last_unstale":"2024-09-15T23:24:05.346109+0000","last_undegraded":"2024-09-15T23:24:05.346109+0000","last_fullsized":"2024-09-15T23:24:05.346109+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:00:47.871432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.241274+0000","last_change":"2024-09-15T23:24:03.240718+0000","last_active":"2024-09-15T23:24:03.241274+0000","last_peered":"2024-09-15T23:24:03.241274+0000","last_clean":"2024-09-15T23:24:03.241274+0000","last_became_active":"2024-09-15T23:24:03.240388+0000","last_became_peered":"2024-09-15T23:24:03.240388+0000","last_unstale":"2024-09-15T23:24:03.241274+0000","last_undegraded":"2024-09-15T23:24:03.241274+0000","last_fullsized":"2024-09-15T23:24:03.241274+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:37:34.205282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.244662+0000","last_change":"2024-09-15T23:24:04.251014+0000","last_active":"2024-09-15T23:24:05.244662+0000","last_peered":"2024-09-15T23:24:05.244662+0000","last_clean":"2024-09-15T23:24:05.244662+0000","last_became_active":"2024-09-15T23:24:04.250672+0000","last_became_peered":"2024-09-15T23:24:04.250672+0000","last_unstale":"2024-09-15T23:24:05.244662+0000","last_undegraded":"2024-09-15T23:24:05.244662+0000","last_fullsized":"2024-09-15T23:24:05.244662+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:53:01.003383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"205'2","reported_seq":16,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.244579+0000","last_change":"2024-09-15T23:24:03.232730+0000","last_active":"2024-09-15T23:24:05.244579+0000","last_peered":"2024-09-15T23:24:05.244579+0000","last_clean":"2024-09-15T23:24:05.244579+0000","last_became_active":"2024-09-15T23:24:03.232300+0000","last_became_peered":"2024-09-15T23:24:03.232300+0000","last_unstale":"2024-09-15T23:24:05.244579+0000","last_undegraded":"2024-09-15T23:24:05.244579+0000","last_fullsized":"2024-09-15T23:24:05.244579+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:26.469934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.223056+0000","last_change":"2024-09-15T23:24:03.223056+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.223056+0000","last_undegraded":"2024-09-15T23:24:03.223056+0000","last_fullsized":"2024-09-15T23:24:03.223056+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.240856+0000","last_change":"2024-09-15T23:24:03.234599+0000","last_active":"2024-09-15T23:24:03.240856+0000","last_peered":"2024-09-15T23:24:03.240856+0000","last_clean":"2024-09-15T23:24:03.240856+0000","last_became_active":"2024-09-15T23:24:03.234337+0000","last_became_peered":"2024-09-15T23:24:03.234337+0000","last_unstale":"2024-09-15T23:24:03.240856+0000","last_undegraded":"2024-09-15T23:24:03.240856+0000","last_fullsized":"2024-09-15T23:24:03.240856+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:22:39.273467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.222576+0000","last_change":"2024-09-15T23:24:03.222576+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.222576+0000","last_undegraded":"2024-09-15T23:24:03.222576+0000","last_fullsized":"2024-09-15T23:24:03.222576+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.239699+0000","last_change":"2024-09-15T23:24:03.234545+0000","last_active":"2024-09-15T23:24:03.239699+0000","last_peered":"2024-09-15T23:24:03.239699+0000","last_clean":"2024-09-15T23:24:03.239699+0000","last_became_active":"2024-09-15T23:24:03.234294+0000","last_became_peered":"2024-09-15T23:24:03.234294+0000","last_unstale":"2024-09-15T23:24:03.239699+0000","last_undegraded":"2024-09-15T23:24:03.239699+0000","last_fullsized":"2024-09-15T23:24:03.239699+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:17:01.629821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498793+0000","last_change":"2024-09-15T23:24:04.245309+0000","last_active":"2024-09-15T23:24:05.498793+0000","last_peered":"2024-09-15T23:24:05.498793+0000","last_clean":"2024-09-15T23:24:05.498793+0000","last_became_active":"2024-09-15T23:24:04.245005+0000","last_became_peered":"2024-09-15T23:24:04.245005+0000","last_unstale":"2024-09-15T23:24:05.498793+0000","last_undegraded":"2024-09-15T23:24:05.498793+0000","last_fullsized":"2024-09-15T23:24:05.498793+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:10:46.962223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.237340+0000","last_change":"2024-09-15T23:24:03.235147+0000","last_active":"2024-09-15T23:24:03.237340+0000","last_peered":"2024-09-15T23:24:03.237340+0000","last_clean":"2024-09-15T23:24:03.237340+0000","last_became_active":"2024-09-15T23:24:03.234881+0000","last_became_peered":"2024-09-15T23:24:03.234881+0000","last_unstale":"2024-09-15T23:24:03.237340+0000","last_undegraded":"2024-09-15T23:24:03.237340+0000","last_fullsized":"2024-09-15T23:24:03.237340+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:28.821635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.222054+0000","last_change":"2024-09-15T23:24:03.222054+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.222054+0000","last_undegraded":"2024-09-15T23:24:03.222054+0000","last_fullsized":"2024-09-15T23:24:03.222054+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.238608+0000","last_change":"2024-09-15T23:24:03.237859+0000","last_active":"2024-09-15T23:24:03.238608+0000","last_peered":"2024-09-15T23:24:03.238608+0000","last_clean":"2024-09-15T23:24:03.238608+0000","last_became_active":"2024-09-15T23:24:03.237582+0000","last_became_peered":"2024-09-15T23:24:03.237582+0000","last_unstale":"2024-09-15T23:24:03.238608+0000","last_undegraded":"2024-09-15T23:24:03.238608+0000","last_fullsized":"2024-09-15T23:24:03.238608+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:57.451165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.222550+0000","last_change":"2024-09-15T23:24:03.222550+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.222550+0000","last_undegraded":"2024-09-15T23:24:03.222550+0000","last_fullsized":"2024-09-15T23:24:03.222550+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":14,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499581+0000","last_change":"2024-09-15T23:24:03.234428+0000","last_active":"2024-09-15T23:24:05.499581+0000","last_peered":"2024-09-15T23:24:05.499581+0000","last_clean":"2024-09-15T23:24:05.499581+0000","last_became_active":"2024-09-15T23:24:03.234081+0000","last_became_peered":"2024-09-15T23:24:03.234081+0000","last_unstale":"2024-09-15T23:24:05.499581+0000","last_undegraded":"2024-09-15T23:24:05.499581+0000","last_fullsized":"2024-09-15T23:24:05.499581+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:12:32.460158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.222629+0000","last_change":"2024-09-15T23:24:03.222629+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.222629+0000","last_undegraded":"2024-09-15T23:24:03.222629+0000","last_fullsized":"2024-09-15T23:24:03.222629+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":14,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.346088+0000","last_change":"2024-09-15T23:24:03.235840+0000","last_active":"2024-09-15T23:24:05.346088+0000","last_peered":"2024-09-15T23:24:05.346088+0000","last_clean":"2024-09-15T23:24:05.346088+0000","last_became_active":"2024-09-15T23:24:03.235577+0000","last_became_peered":"2024-09-15T23:24:03.235577+0000","last_unstale":"2024-09-15T23:24:05.346088+0000","last_undegraded":"2024-09-15T23:24:05.346088+0000","last_fullsized":"2024-09-15T23:24:05.346088+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:52:31.013796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.230004+0000","last_change":"2024-09-15T23:24:03.230004+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.230004+0000","last_undegraded":"2024-09-15T23:24:03.230004+0000","last_fullsized":"2024-09-15T23:24:03.230004+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.239455+0000","last_change":"2024-09-15T23:24:03.233988+0000","last_active":"2024-09-15T23:24:03.239455+0000","last_peered":"2024-09-15T23:24:03.239455+0000","last_clean":"2024-09-15T23:24:03.239455+0000","last_became_active":"2024-09-15T23:24:03.233730+0000","last_became_peered":"2024-09-15T23:24:03.233730+0000","last_unstale":"2024-09-15T23:24:03.239455+0000","last_undegraded":"2024-09-15T23:24:03.239455+0000","last_fullsized":"2024-09-15T23:24:03.239455+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:10.138162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":1,"reported_epoch":204,"state":"creating+peering","last_fresh":"2024-09-15T23:24:03.229178+0000","last_change":"2024-09-15T23:24:03.229178+0000","last_active":"2024-09-15T23:24:03.215032+0000","last_peered":"2024-09-15T23:24:03.215032+0000","last_clean":"2024-09-15T23:24:03.215032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T23:24:03.229178+0000","last_undegraded":"2024-09-15T23:24:03.229178+0000","last_fullsized":"2024-09-15T23:24:03.229178+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":9,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.230402+0000","last_change":"2024-09-15T23:24:03.226290+0000","last_active":"2024-09-15T23:24:03.230402+0000","last_peered":"2024-09-15T23:24:03.230402+0000","last_clean":"2024-09-15T23:24:03.230402+0000","last_became_active":"2024-09-15T23:24:03.226044+0000","last_became_peered":"2024-09-15T23:24:03.226044+0000","last_unstale":"2024-09-15T23:24:03.230402+0000","last_undegraded":"2024-09-15T23:24:03.230402+0000","last_fullsized":"2024-09-15T23:24:03.230402+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:49.262116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":511,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-15T23:24:03.219541+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:24:03.219541+0000","last_peered":"2024-09-15T23:24:03.219541+0000","last_clean":"2024-09-15T23:24:03.219541+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:24:03.219541+0000","last_undegraded":"2024-09-15T23:24:03.219541+0000","last_fullsized":"2024-09-15T23:24:03.219541+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":2318,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476886,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60056,"kb_used_data":2500,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311784,"statfs":{"total":96636764160,"available":96575266816,"internally_reserved":0,"allocated":2560000,"data_stored":1132693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476883,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55900,"kb_used_data":2488,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315940,"statfs":{"total":96636764160,"available":96579522560,"internally_reserved":0,"allocated":2547712,"data_stored":1126418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476885,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56476,"kb_used_data":3068,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315364,"statfs":{"total":96636764160,"available":96578932736,"internally_reserved":0,"allocated":3141632,"data_stored":1716786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476885,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51736,"kb_used_data":2500,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320104,"statfs":{"total":96636764160,"available":96583786496,"internally_reserved":0,"allocated":2560000,"data_stored":1132693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542292,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51768,"kb_used_data":2532,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320072,"statfs":{"total":96636764160,"available":96583753728,"internally_reserved":0,"allocated":2592768,"data_stored":1146440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542292,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55940,"kb_used_data":2536,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315900,"statfs":{"total":96636764160,"available":96579481600,"internally_reserved":0,"allocated":2596864,"data_stored":1145914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542291,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60680,"kb_used_data":3120,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311160,"statfs":{"total":96636764160,"available":96574627840,"internally_reserved":0,"allocated":3194880,"data_stored":1737818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542293,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60096,"kb_used_data":2536,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311744,"statfs":{"total":96636764160,"available":96575225856,"internally_reserved":0,"allocated":2596864,"data_stored":1147380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:24:10.747 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:24:10.781 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:24:11.613 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:24:11.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.722+0000 7f3e1285c640 1 Processor -- start 2024-09-15T23:24:11.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.722+0000 7f3e1285c640 1 -- start start 2024-09-15T23:24:11.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.723+0000 7f3e1285c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3e0c0d1da0 0x7f3e0c0cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:11.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.723+0000 7f3e1285c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3e0c0cf7f0 0x7f3e0c0b77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:11.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.723+0000 7f3e1285c640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e0c0d47e0 con 0x7f3e0c15e950 2024-09-15T23:24:11.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.723+0000 7f3e1285c640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f3e0c15ed30 con 0x7f3e0c0d1da0 2024-09-15T23:24:11.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.723+0000 7f3e1285c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f3e0c0d4a80 con 0x7f3e0c0cf7f0 2024-09-15T23:24:11.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.724+0000 7f3e0b7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3e0c0d1da0 0x7f3e0c0cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:11.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.724+0000 7f3e0b7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3e0c0d1da0 0x7f3e0c0cf2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39102/0 (socket says 172.21.15.123:39102) 2024-09-15T23:24:11.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.724+0000 7f3e0b7fe640 1 -- 172.21.15.123:0/3638313998 learned_addr learned my addr 172.21.15.123:0/3638313998 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:11.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.724+0000 7f3e0b7fe640 1 -- 172.21.15.123:0/3638313998 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3e0c0cf7f0 msgr2=0x7f3e0c0b77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:11.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.724+0000 7f3e0b7fe640 1 --2- 172.21.15.123:0/3638313998 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3e0c0cf7f0 0x7f3e0c0b77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:11.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.724+0000 7f3e0b7fe640 1 -- 172.21.15.123:0/3638313998 >> v1:172.21.15.188:6789/0 conn(0x7f3e0c15e950 legacy=0x7f3e0c0d1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:11.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.724+0000 7f3e0b7fe640 1 -- 172.21.15.123:0/3638313998 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0c0d4d60 con 0x7f3e0c0d1da0 2024-09-15T23:24:11.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.725+0000 7f3e0b7fe640 1 --2- 172.21.15.123:0/3638313998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e0c0d1da0 0x7f3e0c0cf2b0 secure :-1 s=READY pgs=2393 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0d2370 tx=0x7f3e0002a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d52eb9a808860db9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:11.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.725+0000 7f3e0affd640 1 -- 172.21.15.123:0/3638313998 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e00037070 con 0x7f3e0c0d1da0 2024-09-15T23:24:11.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.725+0000 7f3e0affd640 1 -- 172.21.15.123:0/3638313998 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e00032440 con 0x7f3e0c0d1da0 2024-09-15T23:24:11.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.725+0000 7f3e0affd640 1 -- 172.21.15.123:0/3638313998 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e00032810 con 0x7f3e0c0d1da0 2024-09-15T23:24:11.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.725+0000 7f3e1285c640 1 -- 172.21.15.123:0/3638313998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e0c0d1da0 msgr2=0x7f3e0c0cf2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:11.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.725+0000 7f3e1285c640 1 --2- 172.21.15.123:0/3638313998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e0c0d1da0 0x7f3e0c0cf2b0 secure :-1 s=READY pgs=2393 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c0d2370 tx=0x7f3e0002a160 comp rx=0 tx=0).stop 2024-09-15T23:24:11.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.725+0000 7f3e1285c640 1 -- 172.21.15.123:0/3638313998 shutdown_connections 2024-09-15T23:24:11.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.725+0000 7f3e1285c640 1 --2- 172.21.15.123:0/3638313998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e0c0d1da0 0x7f3e0c0cf2b0 unknown :-1 s=CLOSED pgs=2393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:11.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.725+0000 7f3e1285c640 1 --2- 172.21.15.123:0/3638313998 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3e0c0cf7f0 0x7f3e0c0b77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:11.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.725+0000 7f3e1285c640 1 -- 172.21.15.123:0/3638313998 >> 172.21.15.123:0/3638313998 conn(0x7f3e0c067b30 msgr2=0x7f3e0c067f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:11.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.725+0000 7f3e1285c640 1 -- 172.21.15.123:0/3638313998 shutdown_connections 2024-09-15T23:24:11.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.725+0000 7f3e1285c640 1 -- 172.21.15.123:0/3638313998 wait complete. 2024-09-15T23:24:11.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.727+0000 7f3e1285c640 1 Processor -- start 2024-09-15T23:24:11.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.727+0000 7f3e1285c640 1 -- start start 2024-09-15T23:24:11.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.728+0000 7f3e1285c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3e0c0cf7f0 0x7f3e0c156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:11.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.728+0000 7f3e1285c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3e0c0d1da0 0x7f3e0c155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:11.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.728+0000 7f3e1285c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e0c15e950 0x7f3e0c1f5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:11.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.728+0000 7f3e1285c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c0cfdb0 con 0x7f3e0c15e950 2024-09-15T23:24:11.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.728+0000 7f3e1285c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c0cfc30 con 0x7f3e0c0cf7f0 2024-09-15T23:24:11.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.728+0000 7f3e1285c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f3e0c0b7d10 con 0x7f3e0c0d1da0 2024-09-15T23:24:11.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.728+0000 7f3e10df9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e0c15e950 0x7f3e0c1f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:11.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.728+0000 7f3e10df9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e0c15e950 0x7f3e0c1f5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39118/0 (socket says 172.21.15.123:39118) 2024-09-15T23:24:11.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.728+0000 7f3e10df9640 1 -- 172.21.15.123:0/3041378497 learned_addr learned my addr 172.21.15.123:0/3041378497 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:11.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.728+0000 7f3e0b7fe640 1 --2- 172.21.15.123:0/3041378497 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3e0c0d1da0 0x7f3e0c155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:11.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.728+0000 7f3e0bfff640 1 --2- 172.21.15.123:0/3041378497 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3e0c0cf7f0 0x7f3e0c156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:11.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.728+0000 7f3e10df9640 1 -- 172.21.15.123:0/3041378497 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3e0c0d1da0 msgr2=0x7f3e0c155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:11.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.728+0000 7f3e10df9640 1 --2- 172.21.15.123:0/3041378497 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3e0c0d1da0 0x7f3e0c155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:11.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.728+0000 7f3e10df9640 1 -- 172.21.15.123:0/3041378497 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3e0c0cf7f0 msgr2=0x7f3e0c156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:11.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.728+0000 7f3e10df9640 1 --2- 172.21.15.123:0/3041378497 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3e0c0cf7f0 0x7f3e0c156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:11.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.728+0000 7f3e10df9640 1 -- 172.21.15.123:0/3041378497 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0c156c60 con 0x7f3e0c15e950 2024-09-15T23:24:11.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.728+0000 7f3e10df9640 1 --2- 172.21.15.123:0/3041378497 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e0c15e950 0x7f3e0c1f5240 secure :-1 s=READY pgs=2394 cs=0 l=1 rev1=1 crypto rx=0x7f3e0400b970 tx=0x7f3e0400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:11.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.728+0000 7f3e08ff9640 1 -- 172.21.15.123:0/3041378497 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e04019070 con 0x7f3e0c15e950 2024-09-15T23:24:11.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.728+0000 7f3e08ff9640 1 -- 172.21.15.123:0/3041378497 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e0400cb60 con 0x7f3e0c15e950 2024-09-15T23:24:11.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.728+0000 7f3e1285c640 1 -- 172.21.15.123:0/3041378497 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e0c156f40 con 0x7f3e0c15e950 2024-09-15T23:24:11.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.728+0000 7f3e08ff9640 1 -- 172.21.15.123:0/3041378497 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e04014440 con 0x7f3e0c15e950 2024-09-15T23:24:11.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.728+0000 7f3e1285c640 1 -- 172.21.15.123:0/3041378497 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e0c157500 con 0x7f3e0c15e950 2024-09-15T23:24:11.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.729+0000 7f3e1285c640 1 -- 172.21.15.123:0/3041378497 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e0c0b77d0 con 0x7f3e0c15e950 2024-09-15T23:24:11.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.730+0000 7f3e08ff9640 1 -- 172.21.15.123:0/3041378497 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3e0401c070 con 0x7f3e0c15e950 2024-09-15T23:24:11.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.730+0000 7f3e08ff9640 1 --2- 172.21.15.123:0/3041378497 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3df806c2b0 0x7f3df806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:11.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.731+0000 7f3e08ff9640 1 -- 172.21.15.123:0/3041378497 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 5709+0+0 (secure 0 0 0) 0x7f3e0408b0c0 con 0x7f3e0c15e950 2024-09-15T23:24:11.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.731+0000 7f3e0bfff640 1 --2- 172.21.15.123:0/3041378497 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3df806c2b0 0x7f3df806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:11.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.731+0000 7f3e0bfff640 1 --2- 172.21.15.123:0/3041378497 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3df806c2b0 0x7f3df806e770 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc006fd0 tx=0x7f3dfc009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:11.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.735+0000 7f3e08ff9640 1 -- 172.21.15.123:0/3041378497 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3e04059270 con 0x7f3e0c15e950 2024-09-15T23:24:11.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.896+0000 7f3e1285c640 1 -- 172.21.15.123:0/3041378497 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3e0c068040 con 0x7f3df806c2b0 2024-09-15T23:24:11.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.902+0000 7f3e08ff9640 1 -- 172.21.15.123:0/3041378497 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252440 (secure 0 0 0) 0x7f3e0c068040 con 0x7f3df806c2b0 2024-09-15T23:24:11.906 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:11.907 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:24:11.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.905+0000 7f3e1285c640 1 -- 172.21.15.123:0/3041378497 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3df806c2b0 msgr2=0x7f3df806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:11.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.905+0000 7f3e1285c640 1 --2- 172.21.15.123:0/3041378497 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3df806c2b0 0x7f3df806e770 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc006fd0 tx=0x7f3dfc009060 comp rx=0 tx=0).stop 2024-09-15T23:24:11.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.905+0000 7f3e1285c640 1 -- 172.21.15.123:0/3041378497 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e0c15e950 msgr2=0x7f3e0c1f5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:11.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.905+0000 7f3e1285c640 1 --2- 172.21.15.123:0/3041378497 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e0c15e950 0x7f3e0c1f5240 secure :-1 s=READY pgs=2394 cs=0 l=1 rev1=1 crypto rx=0x7f3e0400b970 tx=0x7f3e0400be30 comp rx=0 tx=0).stop 2024-09-15T23:24:11.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.905+0000 7f3e1285c640 1 -- 172.21.15.123:0/3041378497 shutdown_connections 2024-09-15T23:24:11.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.905+0000 7f3e1285c640 1 --2- 172.21.15.123:0/3041378497 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3df806c2b0 0x7f3df806e770 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:11.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.905+0000 7f3e1285c640 1 --2- 172.21.15.123:0/3041378497 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e0c15e950 0x7f3e0c1f5240 unknown :-1 s=CLOSED pgs=2394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:11.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.905+0000 7f3e1285c640 1 --2- 172.21.15.123:0/3041378497 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f3e0c0d1da0 0x7f3e0c155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:11.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.905+0000 7f3e1285c640 1 --2- 172.21.15.123:0/3041378497 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3e0c0cf7f0 0x7f3e0c156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:11.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.905+0000 7f3e1285c640 1 -- 172.21.15.123:0/3041378497 >> 172.21.15.123:0/3041378497 conn(0x7f3e0c067b30 msgr2=0x7f3e0c0b4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:11.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.905+0000 7f3e1285c640 1 -- 172.21.15.123:0/3041378497 shutdown_connections 2024-09-15T23:24:11.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:11.905+0000 7f3e1285c640 1 -- 172.21.15.123:0/3041378497 wait complete. 2024-09-15T23:24:11.918 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":564,"stamp":"2024-09-15T23:24:11.675739+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":452784,"kb_used_data":21416,"kb_used_omap":12,"kb_used_meta":431155,"kb_avail":754521936,"statfs":{"total":773094113280,"available":772630462464,"internally_reserved":0,"allocated":21929984,"data_stored":10351700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":441503280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002179"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.233230+0000","last_change":"2024-09-15T23:24:04.249830+0000","last_active":"2024-09-15T23:24:05.233230+0000","last_peered":"2024-09-15T23:24:05.233230+0000","last_clean":"2024-09-15T23:24:05.233230+0000","last_became_active":"2024-09-15T23:24:04.249547+0000","last_became_peered":"2024-09-15T23:24:04.249547+0000","last_unstale":"2024-09-15T23:24:05.233230+0000","last_undegraded":"2024-09-15T23:24:05.233230+0000","last_fullsized":"2024-09-15T23:24:05.233230+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:15.331569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498492+0000","last_change":"2024-09-15T23:24:04.253781+0000","last_active":"2024-09-15T23:24:05.498492+0000","last_peered":"2024-09-15T23:24:05.498492+0000","last_clean":"2024-09-15T23:24:05.498492+0000","last_became_active":"2024-09-15T23:24:04.253435+0000","last_became_peered":"2024-09-15T23:24:04.253435+0000","last_unstale":"2024-09-15T23:24:05.498492+0000","last_undegraded":"2024-09-15T23:24:05.498492+0000","last_fullsized":"2024-09-15T23:24:05.498492+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:01.393550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498566+0000","last_change":"2024-09-15T23:24:04.248373+0000","last_active":"2024-09-15T23:24:05.498566+0000","last_peered":"2024-09-15T23:24:05.498566+0000","last_clean":"2024-09-15T23:24:05.498566+0000","last_became_active":"2024-09-15T23:24:04.247772+0000","last_became_peered":"2024-09-15T23:24:04.247772+0000","last_unstale":"2024-09-15T23:24:05.498566+0000","last_undegraded":"2024-09-15T23:24:05.498566+0000","last_fullsized":"2024-09-15T23:24:05.498566+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:37.856457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499039+0000","last_change":"2024-09-15T23:24:04.244198+0000","last_active":"2024-09-15T23:24:05.499039+0000","last_peered":"2024-09-15T23:24:05.499039+0000","last_clean":"2024-09-15T23:24:05.499039+0000","last_became_active":"2024-09-15T23:24:04.243898+0000","last_became_peered":"2024-09-15T23:24:04.243898+0000","last_unstale":"2024-09-15T23:24:05.499039+0000","last_undegraded":"2024-09-15T23:24:05.499039+0000","last_fullsized":"2024-09-15T23:24:05.499039+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:38.945626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498934+0000","last_change":"2024-09-15T23:24:04.245896+0000","last_active":"2024-09-15T23:24:05.498934+0000","last_peered":"2024-09-15T23:24:05.498934+0000","last_clean":"2024-09-15T23:24:05.498934+0000","last_became_active":"2024-09-15T23:24:04.245613+0000","last_became_peered":"2024-09-15T23:24:04.245613+0000","last_unstale":"2024-09-15T23:24:05.498934+0000","last_undegraded":"2024-09-15T23:24:05.498934+0000","last_fullsized":"2024-09-15T23:24:05.498934+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:05:01.144617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499266+0000","last_change":"2024-09-15T23:24:04.247643+0000","last_active":"2024-09-15T23:24:05.499266+0000","last_peered":"2024-09-15T23:24:05.499266+0000","last_clean":"2024-09-15T23:24:05.499266+0000","last_became_active":"2024-09-15T23:24:04.247094+0000","last_became_peered":"2024-09-15T23:24:04.247094+0000","last_unstale":"2024-09-15T23:24:05.499266+0000","last_undegraded":"2024-09-15T23:24:05.499266+0000","last_fullsized":"2024-09-15T23:24:05.499266+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:13:13.901339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498251+0000","last_change":"2024-09-15T23:24:04.252745+0000","last_active":"2024-09-15T23:24:05.498251+0000","last_peered":"2024-09-15T23:24:05.498251+0000","last_clean":"2024-09-15T23:24:05.498251+0000","last_became_active":"2024-09-15T23:24:04.252491+0000","last_became_peered":"2024-09-15T23:24:04.252491+0000","last_unstale":"2024-09-15T23:24:05.498251+0000","last_undegraded":"2024-09-15T23:24:05.498251+0000","last_fullsized":"2024-09-15T23:24:05.498251+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:44.443319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.346013+0000","last_change":"2024-09-15T23:24:04.255143+0000","last_active":"2024-09-15T23:24:05.346013+0000","last_peered":"2024-09-15T23:24:05.346013+0000","last_clean":"2024-09-15T23:24:05.346013+0000","last_became_active":"2024-09-15T23:24:04.254835+0000","last_became_peered":"2024-09-15T23:24:04.254835+0000","last_unstale":"2024-09-15T23:24:05.346013+0000","last_undegraded":"2024-09-15T23:24:05.346013+0000","last_fullsized":"2024-09-15T23:24:05.346013+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:44.443319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.233429+0000","last_change":"2024-09-15T23:24:04.252323+0000","last_active":"2024-09-15T23:24:05.233429+0000","last_peered":"2024-09-15T23:24:05.233429+0000","last_clean":"2024-09-15T23:24:05.233429+0000","last_became_active":"2024-09-15T23:24:04.252042+0000","last_became_peered":"2024-09-15T23:24:04.252042+0000","last_unstale":"2024-09-15T23:24:05.233429+0000","last_undegraded":"2024-09-15T23:24:05.233429+0000","last_fullsized":"2024-09-15T23:24:05.233429+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:15.331569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498816+0000","last_change":"2024-09-15T23:24:04.248229+0000","last_active":"2024-09-15T23:24:05.498816+0000","last_peered":"2024-09-15T23:24:05.498816+0000","last_clean":"2024-09-15T23:24:05.498816+0000","last_became_active":"2024-09-15T23:24:04.247914+0000","last_became_peered":"2024-09-15T23:24:04.247914+0000","last_unstale":"2024-09-15T23:24:05.498816+0000","last_undegraded":"2024-09-15T23:24:05.498816+0000","last_fullsized":"2024-09-15T23:24:05.498816+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:09.507578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498701+0000","last_change":"2024-09-15T23:24:04.252190+0000","last_active":"2024-09-15T23:24:05.498701+0000","last_peered":"2024-09-15T23:24:05.498701+0000","last_clean":"2024-09-15T23:24:05.498701+0000","last_became_active":"2024-09-15T23:24:04.248111+0000","last_became_peered":"2024-09-15T23:24:04.248111+0000","last_unstale":"2024-09-15T23:24:05.498701+0000","last_undegraded":"2024-09-15T23:24:05.498701+0000","last_fullsized":"2024-09-15T23:24:05.498701+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:45.895857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.233450+0000","last_change":"2024-09-15T23:24:04.248777+0000","last_active":"2024-09-15T23:24:05.233450+0000","last_peered":"2024-09-15T23:24:05.233450+0000","last_clean":"2024-09-15T23:24:05.233450+0000","last_became_active":"2024-09-15T23:24:04.248531+0000","last_became_peered":"2024-09-15T23:24:04.248531+0000","last_unstale":"2024-09-15T23:24:05.233450+0000","last_undegraded":"2024-09-15T23:24:05.233450+0000","last_fullsized":"2024-09-15T23:24:05.233450+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:42.652302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.232603+0000","last_change":"2024-09-15T23:24:04.255746+0000","last_active":"2024-09-15T23:24:05.232603+0000","last_peered":"2024-09-15T23:24:05.232603+0000","last_clean":"2024-09-15T23:24:05.232603+0000","last_became_active":"2024-09-15T23:24:04.255328+0000","last_became_peered":"2024-09-15T23:24:04.255328+0000","last_unstale":"2024-09-15T23:24:05.232603+0000","last_undegraded":"2024-09-15T23:24:05.232603+0000","last_fullsized":"2024-09-15T23:24:05.232603+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:27:49.029046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498328+0000","last_change":"2024-09-15T23:24:04.241121+0000","last_active":"2024-09-15T23:24:05.498328+0000","last_peered":"2024-09-15T23:24:05.498328+0000","last_clean":"2024-09-15T23:24:05.498328+0000","last_became_active":"2024-09-15T23:24:04.240786+0000","last_became_peered":"2024-09-15T23:24:04.240786+0000","last_unstale":"2024-09-15T23:24:05.498328+0000","last_undegraded":"2024-09-15T23:24:05.498328+0000","last_fullsized":"2024-09-15T23:24:05.498328+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:00:47.871432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499212+0000","last_change":"2024-09-15T23:24:04.240413+0000","last_active":"2024-09-15T23:24:05.499212+0000","last_peered":"2024-09-15T23:24:05.499212+0000","last_clean":"2024-09-15T23:24:05.499212+0000","last_became_active":"2024-09-15T23:24:04.240130+0000","last_became_peered":"2024-09-15T23:24:04.240130+0000","last_unstale":"2024-09-15T23:24:05.499212+0000","last_undegraded":"2024-09-15T23:24:05.499212+0000","last_fullsized":"2024-09-15T23:24:05.499212+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:37.856457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.233862+0000","last_change":"2024-09-15T23:24:04.249425+0000","last_active":"2024-09-15T23:24:05.233862+0000","last_peered":"2024-09-15T23:24:05.233862+0000","last_clean":"2024-09-15T23:24:05.233862+0000","last_became_active":"2024-09-15T23:24:04.249145+0000","last_became_peered":"2024-09-15T23:24:04.249145+0000","last_unstale":"2024-09-15T23:24:05.233862+0000","last_undegraded":"2024-09-15T23:24:05.233862+0000","last_fullsized":"2024-09-15T23:24:05.233862+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:52:32.018064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.233365+0000","last_change":"2024-09-15T23:24:04.243651+0000","last_active":"2024-09-15T23:24:05.233365+0000","last_peered":"2024-09-15T23:24:05.233365+0000","last_clean":"2024-09-15T23:24:05.233365+0000","last_became_active":"2024-09-15T23:24:04.243335+0000","last_became_peered":"2024-09-15T23:24:04.243335+0000","last_unstale":"2024-09-15T23:24:05.233365+0000","last_undegraded":"2024-09-15T23:24:05.233365+0000","last_fullsized":"2024-09-15T23:24:05.233365+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:21.858404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.244597+0000","last_change":"2024-09-15T23:24:04.256728+0000","last_active":"2024-09-15T23:24:05.244597+0000","last_peered":"2024-09-15T23:24:05.244597+0000","last_clean":"2024-09-15T23:24:05.244597+0000","last_became_active":"2024-09-15T23:24:04.256464+0000","last_became_peered":"2024-09-15T23:24:04.256464+0000","last_unstale":"2024-09-15T23:24:05.244597+0000","last_undegraded":"2024-09-15T23:24:05.244597+0000","last_fullsized":"2024-09-15T23:24:05.244597+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:26:25.300606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499663+0000","last_change":"2024-09-15T23:24:04.235940+0000","last_active":"2024-09-15T23:24:05.499663+0000","last_peered":"2024-09-15T23:24:05.499663+0000","last_clean":"2024-09-15T23:24:05.499663+0000","last_became_active":"2024-09-15T23:24:04.235624+0000","last_became_peered":"2024-09-15T23:24:04.235624+0000","last_unstale":"2024-09-15T23:24:05.499663+0000","last_undegraded":"2024-09-15T23:24:05.499663+0000","last_fullsized":"2024-09-15T23:24:05.499663+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:23:10.557907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.244582+0000","last_change":"2024-09-15T23:24:04.251374+0000","last_active":"2024-09-15T23:24:05.244582+0000","last_peered":"2024-09-15T23:24:05.244582+0000","last_clean":"2024-09-15T23:24:05.244582+0000","last_became_active":"2024-09-15T23:24:04.251046+0000","last_became_peered":"2024-09-15T23:24:04.251046+0000","last_unstale":"2024-09-15T23:24:05.244582+0000","last_undegraded":"2024-09-15T23:24:05.244582+0000","last_fullsized":"2024-09-15T23:24:05.244582+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:06:18.413148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.244614+0000","last_change":"2024-09-15T23:24:04.254788+0000","last_active":"2024-09-15T23:24:05.244614+0000","last_peered":"2024-09-15T23:24:05.244614+0000","last_clean":"2024-09-15T23:24:05.244614+0000","last_became_active":"2024-09-15T23:24:04.254416+0000","last_became_peered":"2024-09-15T23:24:04.254416+0000","last_unstale":"2024-09-15T23:24:05.244614+0000","last_undegraded":"2024-09-15T23:24:05.244614+0000","last_fullsized":"2024-09-15T23:24:05.244614+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:25:57.392070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499304+0000","last_change":"2024-09-15T23:24:04.240142+0000","last_active":"2024-09-15T23:24:05.499304+0000","last_peered":"2024-09-15T23:24:05.499304+0000","last_clean":"2024-09-15T23:24:05.499304+0000","last_became_active":"2024-09-15T23:24:04.239869+0000","last_became_peered":"2024-09-15T23:24:04.239869+0000","last_unstale":"2024-09-15T23:24:05.499304+0000","last_undegraded":"2024-09-15T23:24:05.499304+0000","last_fullsized":"2024-09-15T23:24:05.499304+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:32.692520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.232313+0000","last_change":"2024-09-15T23:24:04.235748+0000","last_active":"2024-09-15T23:24:05.232313+0000","last_peered":"2024-09-15T23:24:05.232313+0000","last_clean":"2024-09-15T23:24:05.232313+0000","last_became_active":"2024-09-15T23:24:04.235495+0000","last_became_peered":"2024-09-15T23:24:04.235495+0000","last_unstale":"2024-09-15T23:24:05.232313+0000","last_undegraded":"2024-09-15T23:24:05.232313+0000","last_fullsized":"2024-09-15T23:24:05.232313+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:49:39.324972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498650+0000","last_change":"2024-09-15T23:24:04.240899+0000","last_active":"2024-09-15T23:24:05.498650+0000","last_peered":"2024-09-15T23:24:05.498650+0000","last_clean":"2024-09-15T23:24:05.498650+0000","last_became_active":"2024-09-15T23:24:04.240636+0000","last_became_peered":"2024-09-15T23:24:04.240636+0000","last_unstale":"2024-09-15T23:24:05.498650+0000","last_undegraded":"2024-09-15T23:24:05.498650+0000","last_fullsized":"2024-09-15T23:24:05.498650+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:18:51.671914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498542+0000","last_change":"2024-09-15T23:24:04.249393+0000","last_active":"2024-09-15T23:24:05.498542+0000","last_peered":"2024-09-15T23:24:05.498542+0000","last_clean":"2024-09-15T23:24:05.498542+0000","last_became_active":"2024-09-15T23:24:04.249110+0000","last_became_peered":"2024-09-15T23:24:04.249110+0000","last_unstale":"2024-09-15T23:24:05.498542+0000","last_undegraded":"2024-09-15T23:24:05.498542+0000","last_fullsized":"2024-09-15T23:24:05.498542+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:55.718328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499702+0000","last_change":"2024-09-15T23:24:04.236738+0000","last_active":"2024-09-15T23:24:05.499702+0000","last_peered":"2024-09-15T23:24:05.499702+0000","last_clean":"2024-09-15T23:24:05.499702+0000","last_became_active":"2024-09-15T23:24:04.236454+0000","last_became_peered":"2024-09-15T23:24:04.236454+0000","last_unstale":"2024-09-15T23:24:05.499702+0000","last_undegraded":"2024-09-15T23:24:05.499702+0000","last_fullsized":"2024-09-15T23:24:05.499702+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:14:03.841374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498668+0000","last_change":"2024-09-15T23:24:04.250128+0000","last_active":"2024-09-15T23:24:05.498668+0000","last_peered":"2024-09-15T23:24:05.498668+0000","last_clean":"2024-09-15T23:24:05.498668+0000","last_became_active":"2024-09-15T23:24:04.248272+0000","last_became_peered":"2024-09-15T23:24:04.248272+0000","last_unstale":"2024-09-15T23:24:05.498668+0000","last_undegraded":"2024-09-15T23:24:05.498668+0000","last_fullsized":"2024-09-15T23:24:05.498668+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:32:33.096858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.346194+0000","last_change":"2024-09-15T23:24:04.247692+0000","last_active":"2024-09-15T23:24:05.346194+0000","last_peered":"2024-09-15T23:24:05.346194+0000","last_clean":"2024-09-15T23:24:05.346194+0000","last_became_active":"2024-09-15T23:24:04.247381+0000","last_became_peered":"2024-09-15T23:24:04.247381+0000","last_unstale":"2024-09-15T23:24:05.346194+0000","last_undegraded":"2024-09-15T23:24:05.346194+0000","last_fullsized":"2024-09-15T23:24:05.346194+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:40:00.524589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.233585+0000","last_change":"2024-09-15T23:24:04.251023+0000","last_active":"2024-09-15T23:24:05.233585+0000","last_peered":"2024-09-15T23:24:05.233585+0000","last_clean":"2024-09-15T23:24:05.233585+0000","last_became_active":"2024-09-15T23:24:04.250759+0000","last_became_peered":"2024-09-15T23:24:04.250759+0000","last_unstale":"2024-09-15T23:24:05.233585+0000","last_undegraded":"2024-09-15T23:24:05.233585+0000","last_fullsized":"2024-09-15T23:24:05.233585+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:03:21.858404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.232925+0000","last_change":"2024-09-15T23:24:04.238042+0000","last_active":"2024-09-15T23:24:05.232925+0000","last_peered":"2024-09-15T23:24:05.232925+0000","last_clean":"2024-09-15T23:24:05.232925+0000","last_became_active":"2024-09-15T23:24:04.237765+0000","last_became_peered":"2024-09-15T23:24:04.237765+0000","last_unstale":"2024-09-15T23:24:05.232925+0000","last_undegraded":"2024-09-15T23:24:05.232925+0000","last_fullsized":"2024-09-15T23:24:05.232925+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:59:09.393727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.244369+0000","last_change":"2024-09-15T23:24:04.249444+0000","last_active":"2024-09-15T23:24:05.244369+0000","last_peered":"2024-09-15T23:24:05.244369+0000","last_clean":"2024-09-15T23:24:05.244369+0000","last_became_active":"2024-09-15T23:24:04.249083+0000","last_became_peered":"2024-09-15T23:24:04.249083+0000","last_unstale":"2024-09-15T23:24:05.244369+0000","last_undegraded":"2024-09-15T23:24:05.244369+0000","last_fullsized":"2024-09-15T23:24:05.244369+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:59.472118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.346074+0000","last_change":"2024-09-15T23:24:04.243542+0000","last_active":"2024-09-15T23:24:05.346074+0000","last_peered":"2024-09-15T23:24:05.346074+0000","last_clean":"2024-09-15T23:24:05.346074+0000","last_became_active":"2024-09-15T23:24:04.243220+0000","last_became_peered":"2024-09-15T23:24:04.243220+0000","last_unstale":"2024-09-15T23:24:05.346074+0000","last_undegraded":"2024-09-15T23:24:05.346074+0000","last_fullsized":"2024-09-15T23:24:05.346074+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:48:50.324247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498605+0000","last_change":"2024-09-15T23:24:04.244430+0000","last_active":"2024-09-15T23:24:05.498605+0000","last_peered":"2024-09-15T23:24:05.498605+0000","last_clean":"2024-09-15T23:24:05.498605+0000","last_became_active":"2024-09-15T23:24:04.244164+0000","last_became_peered":"2024-09-15T23:24:04.244164+0000","last_unstale":"2024-09-15T23:24:05.498605+0000","last_undegraded":"2024-09-15T23:24:05.498605+0000","last_fullsized":"2024-09-15T23:24:05.498605+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:32.692520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1f","version":"205'4","reported_seq":18,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499727+0000","last_change":"2024-09-15T23:24:03.237701+0000","last_active":"2024-09-15T23:24:05.499727+0000","last_peered":"2024-09-15T23:24:05.499727+0000","last_clean":"2024-09-15T23:24:05.499727+0000","last_became_active":"2024-09-15T23:24:03.237407+0000","last_became_peered":"2024-09-15T23:24:03.237407+0000","last_unstale":"2024-09-15T23:24:05.499727+0000","last_undegraded":"2024-09-15T23:24:05.499727+0000","last_fullsized":"2024-09-15T23:24:05.499727+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:01:57.916838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499776+0000","last_change":"2024-09-15T23:24:04.241162+0000","last_active":"2024-09-15T23:24:05.499776+0000","last_peered":"2024-09-15T23:24:05.499776+0000","last_clean":"2024-09-15T23:24:05.499776+0000","last_became_active":"2024-09-15T23:24:04.240909+0000","last_became_peered":"2024-09-15T23:24:04.240909+0000","last_unstale":"2024-09-15T23:24:05.499776+0000","last_undegraded":"2024-09-15T23:24:05.499776+0000","last_fullsized":"2024-09-15T23:24:05.499776+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:52:22.005817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1e","version":"205'1","reported_seq":15,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.232859+0000","last_change":"2024-09-15T23:24:03.232380+0000","last_active":"2024-09-15T23:24:05.232859+0000","last_peered":"2024-09-15T23:24:05.232859+0000","last_clean":"2024-09-15T23:24:05.232859+0000","last_became_active":"2024-09-15T23:24:03.225881+0000","last_became_peered":"2024-09-15T23:24:03.225881+0000","last_unstale":"2024-09-15T23:24:05.232859+0000","last_undegraded":"2024-09-15T23:24:05.232859+0000","last_fullsized":"2024-09-15T23:24:05.232859+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:12:46.213242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.233971+0000","last_change":"2024-09-15T23:24:04.254186+0000","last_active":"2024-09-15T23:24:05.233971+0000","last_peered":"2024-09-15T23:24:05.233971+0000","last_clean":"2024-09-15T23:24:05.233971+0000","last_became_active":"2024-09-15T23:24:04.253756+0000","last_became_peered":"2024-09-15T23:24:04.253756+0000","last_unstale":"2024-09-15T23:24:05.233971+0000","last_undegraded":"2024-09-15T23:24:05.233971+0000","last_fullsized":"2024-09-15T23:24:05.233971+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:01:58.921107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1c","version":"205'2","reported_seq":16,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.233661+0000","last_change":"2024-09-15T23:24:03.236362+0000","last_active":"2024-09-15T23:24:05.233661+0000","last_peered":"2024-09-15T23:24:05.233661+0000","last_clean":"2024-09-15T23:24:05.233661+0000","last_became_active":"2024-09-15T23:24:03.236134+0000","last_became_peered":"2024-09-15T23:24:03.236134+0000","last_unstale":"2024-09-15T23:24:05.233661+0000","last_undegraded":"2024-09-15T23:24:05.233661+0000","last_fullsized":"2024-09-15T23:24:05.233661+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:58:45.790108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498333+0000","last_change":"2024-09-15T23:24:04.241049+0000","last_active":"2024-09-15T23:24:05.498333+0000","last_peered":"2024-09-15T23:24:05.498333+0000","last_clean":"2024-09-15T23:24:05.498333+0000","last_became_active":"2024-09-15T23:24:04.240356+0000","last_became_peered":"2024-09-15T23:24:04.240356+0000","last_unstale":"2024-09-15T23:24:05.498333+0000","last_undegraded":"2024-09-15T23:24:05.498333+0000","last_fullsized":"2024-09-15T23:24:05.498333+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:40:00.524589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1b","version":"205'1","reported_seq":15,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498815+0000","last_change":"2024-09-15T23:24:03.233549+0000","last_active":"2024-09-15T23:24:05.498815+0000","last_peered":"2024-09-15T23:24:05.498815+0000","last_clean":"2024-09-15T23:24:05.498815+0000","last_became_active":"2024-09-15T23:24:03.233220+0000","last_became_peered":"2024-09-15T23:24:03.233220+0000","last_unstale":"2024-09-15T23:24:05.498815+0000","last_undegraded":"2024-09-15T23:24:05.498815+0000","last_fullsized":"2024-09-15T23:24:05.498815+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:27:10.001446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499430+0000","last_change":"2024-09-15T23:24:04.239016+0000","last_active":"2024-09-15T23:24:05.499430+0000","last_peered":"2024-09-15T23:24:05.499430+0000","last_clean":"2024-09-15T23:24:05.499430+0000","last_became_active":"2024-09-15T23:24:04.238588+0000","last_became_peered":"2024-09-15T23:24:04.238588+0000","last_unstale":"2024-09-15T23:24:05.499430+0000","last_undegraded":"2024-09-15T23:24:05.499430+0000","last_fullsized":"2024-09-15T23:24:05.499430+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:32:33.096858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1a","version":"205'1","reported_seq":15,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.232529+0000","last_change":"2024-09-15T23:24:03.226435+0000","last_active":"2024-09-15T23:24:05.232529+0000","last_peered":"2024-09-15T23:24:05.232529+0000","last_clean":"2024-09-15T23:24:05.232529+0000","last_became_active":"2024-09-15T23:24:03.226192+0000","last_became_peered":"2024-09-15T23:24:03.226192+0000","last_unstale":"2024-09-15T23:24:05.232529+0000","last_undegraded":"2024-09-15T23:24:05.232529+0000","last_fullsized":"2024-09-15T23:24:05.232529+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:26:03.730518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499088+0000","last_change":"2024-09-15T23:24:04.239606+0000","last_active":"2024-09-15T23:24:05.499088+0000","last_peered":"2024-09-15T23:24:05.499088+0000","last_clean":"2024-09-15T23:24:05.499088+0000","last_became_active":"2024-09-15T23:24:04.239300+0000","last_became_peered":"2024-09-15T23:24:04.239300+0000","last_unstale":"2024-09-15T23:24:05.499088+0000","last_undegraded":"2024-09-15T23:24:05.499088+0000","last_fullsized":"2024-09-15T23:24:05.499088+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:18:55.718328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":14,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.233319+0000","last_change":"2024-09-15T23:24:03.238146+0000","last_active":"2024-09-15T23:24:05.233319+0000","last_peered":"2024-09-15T23:24:05.233319+0000","last_clean":"2024-09-15T23:24:05.233319+0000","last_became_active":"2024-09-15T23:24:03.237891+0000","last_became_peered":"2024-09-15T23:24:03.237891+0000","last_unstale":"2024-09-15T23:24:05.233319+0000","last_undegraded":"2024-09-15T23:24:05.233319+0000","last_fullsized":"2024-09-15T23:24:05.233319+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:47:38.673671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.232421+0000","last_change":"2024-09-15T23:24:04.235105+0000","last_active":"2024-09-15T23:24:05.232421+0000","last_peered":"2024-09-15T23:24:05.232421+0000","last_clean":"2024-09-15T23:24:05.232421+0000","last_became_active":"2024-09-15T23:24:04.234800+0000","last_became_peered":"2024-09-15T23:24:04.234800+0000","last_unstale":"2024-09-15T23:24:05.232421+0000","last_undegraded":"2024-09-15T23:24:05.232421+0000","last_fullsized":"2024-09-15T23:24:05.232421+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:35.847266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":14,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.244228+0000","last_change":"2024-09-15T23:24:03.238917+0000","last_active":"2024-09-15T23:24:05.244228+0000","last_peered":"2024-09-15T23:24:05.244228+0000","last_clean":"2024-09-15T23:24:05.244228+0000","last_became_active":"2024-09-15T23:24:03.238111+0000","last_became_peered":"2024-09-15T23:24:03.238111+0000","last_unstale":"2024-09-15T23:24:05.244228+0000","last_undegraded":"2024-09-15T23:24:05.244228+0000","last_fullsized":"2024-09-15T23:24:05.244228+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:59:25.882975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.233944+0000","last_change":"2024-09-15T23:24:04.238739+0000","last_active":"2024-09-15T23:24:05.233944+0000","last_peered":"2024-09-15T23:24:05.233944+0000","last_clean":"2024-09-15T23:24:05.233944+0000","last_became_active":"2024-09-15T23:24:04.238404+0000","last_became_peered":"2024-09-15T23:24:04.238404+0000","last_unstale":"2024-09-15T23:24:05.233944+0000","last_undegraded":"2024-09-15T23:24:05.233944+0000","last_fullsized":"2024-09-15T23:24:05.233944+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:14:53.815630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":14,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.233365+0000","last_change":"2024-09-15T23:24:03.233947+0000","last_active":"2024-09-15T23:24:05.233365+0000","last_peered":"2024-09-15T23:24:05.233365+0000","last_clean":"2024-09-15T23:24:05.233365+0000","last_became_active":"2024-09-15T23:24:03.233577+0000","last_became_peered":"2024-09-15T23:24:03.233577+0000","last_unstale":"2024-09-15T23:24:05.233365+0000","last_undegraded":"2024-09-15T23:24:05.233365+0000","last_fullsized":"2024-09-15T23:24:05.233365+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:11:18.292055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498574+0000","last_change":"2024-09-15T23:24:04.248104+0000","last_active":"2024-09-15T23:24:05.498574+0000","last_peered":"2024-09-15T23:24:05.498574+0000","last_clean":"2024-09-15T23:24:05.498574+0000","last_became_active":"2024-09-15T23:24:04.247868+0000","last_became_peered":"2024-09-15T23:24:04.247868+0000","last_unstale":"2024-09-15T23:24:05.498574+0000","last_undegraded":"2024-09-15T23:24:05.498574+0000","last_fullsized":"2024-09-15T23:24:05.498574+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:13:13.901339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":14,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499015+0000","last_change":"2024-09-15T23:24:03.234732+0000","last_active":"2024-09-15T23:24:05.499015+0000","last_peered":"2024-09-15T23:24:05.499015+0000","last_clean":"2024-09-15T23:24:05.499015+0000","last_became_active":"2024-09-15T23:24:03.234455+0000","last_became_peered":"2024-09-15T23:24:03.234455+0000","last_unstale":"2024-09-15T23:24:05.499015+0000","last_undegraded":"2024-09-15T23:24:05.499015+0000","last_fullsized":"2024-09-15T23:24:05.499015+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:55:58.467849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.233579+0000","last_change":"2024-09-15T23:24:04.248726+0000","last_active":"2024-09-15T23:24:05.233579+0000","last_peered":"2024-09-15T23:24:05.233579+0000","last_clean":"2024-09-15T23:24:05.233579+0000","last_became_active":"2024-09-15T23:24:04.246897+0000","last_became_peered":"2024-09-15T23:24:04.246897+0000","last_unstale":"2024-09-15T23:24:05.233579+0000","last_undegraded":"2024-09-15T23:24:05.233579+0000","last_fullsized":"2024-09-15T23:24:05.233579+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:07:16.068589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"205'3","reported_seq":17,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.346184+0000","last_change":"2024-09-15T23:24:03.234930+0000","last_active":"2024-09-15T23:24:05.346184+0000","last_peered":"2024-09-15T23:24:05.346184+0000","last_clean":"2024-09-15T23:24:05.346184+0000","last_became_active":"2024-09-15T23:24:03.234624+0000","last_became_peered":"2024-09-15T23:24:03.234624+0000","last_unstale":"2024-09-15T23:24:05.346184+0000","last_undegraded":"2024-09-15T23:24:05.346184+0000","last_fullsized":"2024-09-15T23:24:05.346184+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:01:57.916838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.233113+0000","last_change":"2024-09-15T23:24:04.243015+0000","last_active":"2024-09-15T23:24:05.233113+0000","last_peered":"2024-09-15T23:24:05.233113+0000","last_clean":"2024-09-15T23:24:05.233113+0000","last_became_active":"2024-09-15T23:24:04.242760+0000","last_became_peered":"2024-09-15T23:24:04.242760+0000","last_unstale":"2024-09-15T23:24:05.233113+0000","last_undegraded":"2024-09-15T23:24:05.233113+0000","last_fullsized":"2024-09-15T23:24:05.233113+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:01.896060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.14","version":"205'6","reported_seq":20,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.244626+0000","last_change":"2024-09-15T23:24:03.229069+0000","last_active":"2024-09-15T23:24:05.244626+0000","last_peered":"2024-09-15T23:24:05.244626+0000","last_clean":"2024-09-15T23:24:05.244626+0000","last_became_active":"2024-09-15T23:24:03.228795+0000","last_became_peered":"2024-09-15T23:24:03.228795+0000","last_unstale":"2024-09-15T23:24:05.244626+0000","last_undegraded":"2024-09-15T23:24:05.244626+0000","last_fullsized":"2024-09-15T23:24:05.244626+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:50.332347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499480+0000","last_change":"2024-09-15T23:24:04.240484+0000","last_active":"2024-09-15T23:24:05.499480+0000","last_peered":"2024-09-15T23:24:05.499480+0000","last_clean":"2024-09-15T23:24:05.499480+0000","last_became_active":"2024-09-15T23:24:04.239740+0000","last_became_peered":"2024-09-15T23:24:04.239740+0000","last_unstale":"2024-09-15T23:24:05.499480+0000","last_undegraded":"2024-09-15T23:24:05.499480+0000","last_fullsized":"2024-09-15T23:24:05.499480+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:45.895857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.13","version":"205'2","reported_seq":16,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.346119+0000","last_change":"2024-09-15T23:24:03.237296+0000","last_active":"2024-09-15T23:24:05.346119+0000","last_peered":"2024-09-15T23:24:05.346119+0000","last_clean":"2024-09-15T23:24:05.346119+0000","last_became_active":"2024-09-15T23:24:03.237024+0000","last_became_peered":"2024-09-15T23:24:03.237024+0000","last_unstale":"2024-09-15T23:24:05.346119+0000","last_undegraded":"2024-09-15T23:24:05.346119+0000","last_fullsized":"2024-09-15T23:24:05.346119+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:22.254679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.233090+0000","last_change":"2024-09-15T23:24:04.240775+0000","last_active":"2024-09-15T23:24:05.233090+0000","last_peered":"2024-09-15T23:24:05.233090+0000","last_clean":"2024-09-15T23:24:05.233090+0000","last_became_active":"2024-09-15T23:24:04.240497+0000","last_became_peered":"2024-09-15T23:24:04.240497+0000","last_unstale":"2024-09-15T23:24:05.233090+0000","last_undegraded":"2024-09-15T23:24:05.233090+0000","last_fullsized":"2024-09-15T23:24:05.233090+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:18:58.952293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":14,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499467+0000","last_change":"2024-09-15T23:24:03.236841+0000","last_active":"2024-09-15T23:24:05.499467+0000","last_peered":"2024-09-15T23:24:05.499467+0000","last_clean":"2024-09-15T23:24:05.499467+0000","last_became_active":"2024-09-15T23:24:03.236129+0000","last_became_peered":"2024-09-15T23:24:03.236129+0000","last_unstale":"2024-09-15T23:24:05.499467+0000","last_undegraded":"2024-09-15T23:24:05.499467+0000","last_fullsized":"2024-09-15T23:24:05.499467+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:01:21.387520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.234000+0000","last_change":"2024-09-15T23:24:04.252992+0000","last_active":"2024-09-15T23:24:05.234000+0000","last_peered":"2024-09-15T23:24:05.234000+0000","last_clean":"2024-09-15T23:24:05.234000+0000","last_became_active":"2024-09-15T23:24:04.252720+0000","last_became_peered":"2024-09-15T23:24:04.252720+0000","last_unstale":"2024-09-15T23:24:05.234000+0000","last_undegraded":"2024-09-15T23:24:05.234000+0000","last_fullsized":"2024-09-15T23:24:05.234000+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:01:22.391789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":14,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499333+0000","last_change":"2024-09-15T23:24:03.231444+0000","last_active":"2024-09-15T23:24:05.499333+0000","last_peered":"2024-09-15T23:24:05.499333+0000","last_clean":"2024-09-15T23:24:05.499333+0000","last_became_active":"2024-09-15T23:24:03.231172+0000","last_became_peered":"2024-09-15T23:24:03.231172+0000","last_unstale":"2024-09-15T23:24:05.499333+0000","last_undegraded":"2024-09-15T23:24:05.499333+0000","last_fullsized":"2024-09-15T23:24:05.499333+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:52:31.013796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498245+0000","last_change":"2024-09-15T23:24:04.241708+0000","last_active":"2024-09-15T23:24:05.498245+0000","last_peered":"2024-09-15T23:24:05.498245+0000","last_clean":"2024-09-15T23:24:05.498245+0000","last_became_active":"2024-09-15T23:24:04.241463+0000","last_became_peered":"2024-09-15T23:24:04.241463+0000","last_unstale":"2024-09-15T23:24:05.498245+0000","last_undegraded":"2024-09-15T23:24:05.498245+0000","last_fullsized":"2024-09-15T23:24:05.498245+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:48:50.324247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.10","version":"205'8","reported_seq":22,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498168+0000","last_change":"2024-09-15T23:24:03.234776+0000","last_active":"2024-09-15T23:24:05.498168+0000","last_peered":"2024-09-15T23:24:05.498168+0000","last_clean":"2024-09-15T23:24:05.498168+0000","last_became_active":"2024-09-15T23:24:03.234449+0000","last_became_peered":"2024-09-15T23:24:03.234449+0000","last_unstale":"2024-09-15T23:24:05.498168+0000","last_undegraded":"2024-09-15T23:24:05.498168+0000","last_fullsized":"2024-09-15T23:24:05.498168+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:40.076171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498900+0000","last_change":"2024-09-15T23:24:04.241959+0000","last_active":"2024-09-15T23:24:05.498900+0000","last_peered":"2024-09-15T23:24:05.498900+0000","last_clean":"2024-09-15T23:24:05.498900+0000","last_became_active":"2024-09-15T23:24:04.241644+0000","last_became_peered":"2024-09-15T23:24:04.241644+0000","last_unstale":"2024-09-15T23:24:05.498900+0000","last_undegraded":"2024-09-15T23:24:05.498900+0000","last_fullsized":"2024-09-15T23:24:05.498900+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:58:16.996796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.f","version":"205'1","reported_seq":15,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.233453+0000","last_change":"2024-09-15T23:24:03.235856+0000","last_active":"2024-09-15T23:24:05.233453+0000","last_peered":"2024-09-15T23:24:05.233453+0000","last_clean":"2024-09-15T23:24:05.233453+0000","last_became_active":"2024-09-15T23:24:03.235564+0000","last_became_peered":"2024-09-15T23:24:03.235564+0000","last_unstale":"2024-09-15T23:24:05.233453+0000","last_undegraded":"2024-09-15T23:24:05.233453+0000","last_fullsized":"2024-09-15T23:24:05.233453+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:06:13.280066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.244706+0000","last_change":"2024-09-15T23:24:04.251386+0000","last_active":"2024-09-15T23:24:05.244706+0000","last_peered":"2024-09-15T23:24:05.244706+0000","last_clean":"2024-09-15T23:24:05.244706+0000","last_became_active":"2024-09-15T23:24:04.250821+0000","last_became_peered":"2024-09-15T23:24:04.250821+0000","last_unstale":"2024-09-15T23:24:05.244706+0000","last_undegraded":"2024-09-15T23:24:05.244706+0000","last_fullsized":"2024-09-15T23:24:05.244706+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:24.970281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.e","version":"205'2","reported_seq":16,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.244754+0000","last_change":"2024-09-15T23:24:03.233419+0000","last_active":"2024-09-15T23:24:05.244754+0000","last_peered":"2024-09-15T23:24:05.244754+0000","last_clean":"2024-09-15T23:24:05.244754+0000","last_became_active":"2024-09-15T23:24:03.232860+0000","last_became_peered":"2024-09-15T23:24:03.232860+0000","last_unstale":"2024-09-15T23:24:05.244754+0000","last_undegraded":"2024-09-15T23:24:05.244754+0000","last_fullsized":"2024-09-15T23:24:05.244754+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:14.313547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498540+0000","last_change":"2024-09-15T23:24:04.242502+0000","last_active":"2024-09-15T23:24:05.498540+0000","last_peered":"2024-09-15T23:24:05.498540+0000","last_clean":"2024-09-15T23:24:05.498540+0000","last_became_active":"2024-09-15T23:24:04.242211+0000","last_became_peered":"2024-09-15T23:24:04.242211+0000","last_unstale":"2024-09-15T23:24:05.498540+0000","last_undegraded":"2024-09-15T23:24:05.498540+0000","last_fullsized":"2024-09-15T23:24:05.498540+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:53:47.290488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.d","version":"205'1","reported_seq":15,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.233453+0000","last_change":"2024-09-15T23:24:03.233389+0000","last_active":"2024-09-15T23:24:05.233453+0000","last_peered":"2024-09-15T23:24:05.233453+0000","last_clean":"2024-09-15T23:24:05.233453+0000","last_became_active":"2024-09-15T23:24:03.233139+0000","last_became_peered":"2024-09-15T23:24:03.233139+0000","last_unstale":"2024-09-15T23:24:05.233453+0000","last_undegraded":"2024-09-15T23:24:05.233453+0000","last_fullsized":"2024-09-15T23:24:05.233453+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:56:42.032110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.234011+0000","last_change":"2024-09-15T23:24:04.246845+0000","last_active":"2024-09-15T23:24:05.234011+0000","last_peered":"2024-09-15T23:24:05.234011+0000","last_clean":"2024-09-15T23:24:05.234011+0000","last_became_active":"2024-09-15T23:24:04.246519+0000","last_became_peered":"2024-09-15T23:24:04.246519+0000","last_unstale":"2024-09-15T23:24:05.234011+0000","last_undegraded":"2024-09-15T23:24:05.234011+0000","last_fullsized":"2024-09-15T23:24:05.234011+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:12:33.464427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":14,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498976+0000","last_change":"2024-09-15T23:24:03.236047+0000","last_active":"2024-09-15T23:24:05.498976+0000","last_peered":"2024-09-15T23:24:05.498976+0000","last_clean":"2024-09-15T23:24:05.498976+0000","last_became_active":"2024-09-15T23:24:03.235739+0000","last_became_peered":"2024-09-15T23:24:03.235739+0000","last_unstale":"2024-09-15T23:24:05.498976+0000","last_undegraded":"2024-09-15T23:24:05.498976+0000","last_fullsized":"2024-09-15T23:24:05.498976+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:53:15.816067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.244610+0000","last_change":"2024-09-15T23:24:04.250765+0000","last_active":"2024-09-15T23:24:05.244610+0000","last_peered":"2024-09-15T23:24:05.244610+0000","last_clean":"2024-09-15T23:24:05.244610+0000","last_became_active":"2024-09-15T23:24:04.250457+0000","last_became_peered":"2024-09-15T23:24:04.250457+0000","last_unstale":"2024-09-15T23:24:05.244610+0000","last_undegraded":"2024-09-15T23:24:05.244610+0000","last_fullsized":"2024-09-15T23:24:05.244610+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:55:27.067955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.b","version":"205'2","reported_seq":16,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.232683+0000","last_change":"2024-09-15T23:24:03.234239+0000","last_active":"2024-09-15T23:24:05.232683+0000","last_peered":"2024-09-15T23:24:05.232683+0000","last_clean":"2024-09-15T23:24:05.232683+0000","last_became_active":"2024-09-15T23:24:03.233978+0000","last_became_peered":"2024-09-15T23:24:03.233978+0000","last_unstale":"2024-09-15T23:24:05.232683+0000","last_undegraded":"2024-09-15T23:24:05.232683+0000","last_fullsized":"2024-09-15T23:24:05.232683+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:38:50.321876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.233496+0000","last_change":"2024-09-15T23:24:04.251666+0000","last_active":"2024-09-15T23:24:05.233496+0000","last_peered":"2024-09-15T23:24:05.233496+0000","last_clean":"2024-09-15T23:24:05.233496+0000","last_became_active":"2024-09-15T23:24:04.251423+0000","last_became_peered":"2024-09-15T23:24:04.251423+0000","last_unstale":"2024-09-15T23:24:05.233496+0000","last_undegraded":"2024-09-15T23:24:05.233496+0000","last_fullsized":"2024-09-15T23:24:05.233496+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:10:23.515160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":14,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.233013+0000","last_change":"2024-09-15T23:24:03.236689+0000","last_active":"2024-09-15T23:24:05.233013+0000","last_peered":"2024-09-15T23:24:05.233013+0000","last_clean":"2024-09-15T23:24:05.233013+0000","last_became_active":"2024-09-15T23:24:03.236226+0000","last_became_peered":"2024-09-15T23:24:03.236226+0000","last_unstale":"2024-09-15T23:24:05.233013+0000","last_undegraded":"2024-09-15T23:24:05.233013+0000","last_fullsized":"2024-09-15T23:24:05.233013+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:30:03.239848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498657+0000","last_change":"2024-09-15T23:24:04.253235+0000","last_active":"2024-09-15T23:24:05.498657+0000","last_peered":"2024-09-15T23:24:05.498657+0000","last_clean":"2024-09-15T23:24:05.498657+0000","last_became_active":"2024-09-15T23:24:04.252940+0000","last_became_peered":"2024-09-15T23:24:04.252940+0000","last_unstale":"2024-09-15T23:24:05.498657+0000","last_undegraded":"2024-09-15T23:24:05.498657+0000","last_fullsized":"2024-09-15T23:24:05.498657+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:37:08.840834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":14,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498344+0000","last_change":"2024-09-15T23:24:03.235609+0000","last_active":"2024-09-15T23:24:05.498344+0000","last_peered":"2024-09-15T23:24:05.498344+0000","last_clean":"2024-09-15T23:24:05.498344+0000","last_became_active":"2024-09-15T23:24:03.235358+0000","last_became_peered":"2024-09-15T23:24:03.235358+0000","last_unstale":"2024-09-15T23:24:05.498344+0000","last_undegraded":"2024-09-15T23:24:05.498344+0000","last_fullsized":"2024-09-15T23:24:05.498344+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:05:32.955280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.346109+0000","last_change":"2024-09-15T23:24:04.243440+0000","last_active":"2024-09-15T23:24:05.346109+0000","last_peered":"2024-09-15T23:24:05.346109+0000","last_clean":"2024-09-15T23:24:05.346109+0000","last_became_active":"2024-09-15T23:24:04.243165+0000","last_became_peered":"2024-09-15T23:24:04.243165+0000","last_unstale":"2024-09-15T23:24:05.346109+0000","last_undegraded":"2024-09-15T23:24:05.346109+0000","last_fullsized":"2024-09-15T23:24:05.346109+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:00:47.871432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":14,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498206+0000","last_change":"2024-09-15T23:24:03.240718+0000","last_active":"2024-09-15T23:24:05.498206+0000","last_peered":"2024-09-15T23:24:05.498206+0000","last_clean":"2024-09-15T23:24:05.498206+0000","last_became_active":"2024-09-15T23:24:03.240388+0000","last_became_peered":"2024-09-15T23:24:03.240388+0000","last_unstale":"2024-09-15T23:24:05.498206+0000","last_undegraded":"2024-09-15T23:24:05.498206+0000","last_fullsized":"2024-09-15T23:24:05.498206+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:49:38.320704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.244662+0000","last_change":"2024-09-15T23:24:04.251014+0000","last_active":"2024-09-15T23:24:05.244662+0000","last_peered":"2024-09-15T23:24:05.244662+0000","last_clean":"2024-09-15T23:24:05.244662+0000","last_became_active":"2024-09-15T23:24:04.250672+0000","last_became_peered":"2024-09-15T23:24:04.250672+0000","last_unstale":"2024-09-15T23:24:05.244662+0000","last_undegraded":"2024-09-15T23:24:05.244662+0000","last_fullsized":"2024-09-15T23:24:05.244662+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:53:01.003383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"205'2","reported_seq":16,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.244579+0000","last_change":"2024-09-15T23:24:03.232730+0000","last_active":"2024-09-15T23:24:05.244579+0000","last_peered":"2024-09-15T23:24:05.244579+0000","last_clean":"2024-09-15T23:24:05.244579+0000","last_became_active":"2024-09-15T23:24:03.232300+0000","last_became_peered":"2024-09-15T23:24:03.232300+0000","last_unstale":"2024-09-15T23:24:05.244579+0000","last_undegraded":"2024-09-15T23:24:05.244579+0000","last_fullsized":"2024-09-15T23:24:05.244579+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:46:26.469934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.233279+0000","last_change":"2024-09-15T23:24:04.238668+0000","last_active":"2024-09-15T23:24:05.233279+0000","last_peered":"2024-09-15T23:24:05.233279+0000","last_clean":"2024-09-15T23:24:05.233279+0000","last_became_active":"2024-09-15T23:24:04.238414+0000","last_became_peered":"2024-09-15T23:24:04.238414+0000","last_unstale":"2024-09-15T23:24:05.233279+0000","last_undegraded":"2024-09-15T23:24:05.233279+0000","last_fullsized":"2024-09-15T23:24:05.233279+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:10:23.515160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.6","version":"206'1","reported_seq":15,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.232992+0000","last_change":"2024-09-15T23:24:03.234599+0000","last_active":"2024-09-15T23:24:05.232992+0000","last_peered":"2024-09-15T23:24:05.232992+0000","last_clean":"2024-09-15T23:24:05.232992+0000","last_became_active":"2024-09-15T23:24:03.234337+0000","last_became_peered":"2024-09-15T23:24:03.234337+0000","last_unstale":"2024-09-15T23:24:05.232992+0000","last_undegraded":"2024-09-15T23:24:05.232992+0000","last_fullsized":"2024-09-15T23:24:05.232992+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:43.291778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.232370+0000","last_change":"2024-09-15T23:24:04.250973+0000","last_active":"2024-09-15T23:24:05.232370+0000","last_peered":"2024-09-15T23:24:05.232370+0000","last_clean":"2024-09-15T23:24:05.232370+0000","last_became_active":"2024-09-15T23:24:04.250712+0000","last_became_peered":"2024-09-15T23:24:04.250712+0000","last_unstale":"2024-09-15T23:24:05.232370+0000","last_undegraded":"2024-09-15T23:24:05.232370+0000","last_fullsized":"2024-09-15T23:24:05.232370+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:01.977714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":14,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.234052+0000","last_change":"2024-09-15T23:24:03.234545+0000","last_active":"2024-09-15T23:24:05.234052+0000","last_peered":"2024-09-15T23:24:05.234052+0000","last_clean":"2024-09-15T23:24:05.234052+0000","last_became_active":"2024-09-15T23:24:03.234294+0000","last_became_peered":"2024-09-15T23:24:03.234294+0000","last_unstale":"2024-09-15T23:24:05.234052+0000","last_undegraded":"2024-09-15T23:24:05.234052+0000","last_fullsized":"2024-09-15T23:24:05.234052+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:43:28.821635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498793+0000","last_change":"2024-09-15T23:24:04.245309+0000","last_active":"2024-09-15T23:24:05.498793+0000","last_peered":"2024-09-15T23:24:05.498793+0000","last_clean":"2024-09-15T23:24:05.498793+0000","last_became_active":"2024-09-15T23:24:04.245005+0000","last_became_peered":"2024-09-15T23:24:04.245005+0000","last_unstale":"2024-09-15T23:24:05.498793+0000","last_undegraded":"2024-09-15T23:24:05.498793+0000","last_fullsized":"2024-09-15T23:24:05.498793+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:10:46.962223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":14,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498450+0000","last_change":"2024-09-15T23:24:03.235147+0000","last_active":"2024-09-15T23:24:05.498450+0000","last_peered":"2024-09-15T23:24:05.498450+0000","last_clean":"2024-09-15T23:24:05.498450+0000","last_became_active":"2024-09-15T23:24:03.234881+0000","last_became_peered":"2024-09-15T23:24:03.234881+0000","last_unstale":"2024-09-15T23:24:05.498450+0000","last_undegraded":"2024-09-15T23:24:05.498450+0000","last_fullsized":"2024-09-15T23:24:05.498450+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:21:34.842997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.232519+0000","last_change":"2024-09-15T23:24:04.243408+0000","last_active":"2024-09-15T23:24:05.232519+0000","last_peered":"2024-09-15T23:24:05.232519+0000","last_clean":"2024-09-15T23:24:05.232519+0000","last_became_active":"2024-09-15T23:24:04.243107+0000","last_became_peered":"2024-09-15T23:24:04.243107+0000","last_unstale":"2024-09-15T23:24:05.232519+0000","last_undegraded":"2024-09-15T23:24:05.232519+0000","last_fullsized":"2024-09-15T23:24:05.232519+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:01.540564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":14,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498373+0000","last_change":"2024-09-15T23:24:03.237859+0000","last_active":"2024-09-15T23:24:05.498373+0000","last_peered":"2024-09-15T23:24:05.498373+0000","last_clean":"2024-09-15T23:24:05.498373+0000","last_became_active":"2024-09-15T23:24:03.237582+0000","last_became_peered":"2024-09-15T23:24:03.237582+0000","last_unstale":"2024-09-15T23:24:05.498373+0000","last_undegraded":"2024-09-15T23:24:05.498373+0000","last_fullsized":"2024-09-15T23:24:05.498373+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:00.973446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.232699+0000","last_change":"2024-09-15T23:24:04.253243+0000","last_active":"2024-09-15T23:24:05.232699+0000","last_peered":"2024-09-15T23:24:05.232699+0000","last_clean":"2024-09-15T23:24:05.232699+0000","last_became_active":"2024-09-15T23:24:04.252968+0000","last_became_peered":"2024-09-15T23:24:04.252968+0000","last_unstale":"2024-09-15T23:24:05.232699+0000","last_undegraded":"2024-09-15T23:24:05.232699+0000","last_fullsized":"2024-09-15T23:24:05.232699+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:03.095275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":14,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.499581+0000","last_change":"2024-09-15T23:24:03.234428+0000","last_active":"2024-09-15T23:24:05.499581+0000","last_peered":"2024-09-15T23:24:05.499581+0000","last_clean":"2024-09-15T23:24:05.499581+0000","last_became_active":"2024-09-15T23:24:03.234081+0000","last_became_peered":"2024-09-15T23:24:03.234081+0000","last_unstale":"2024-09-15T23:24:05.499581+0000","last_undegraded":"2024-09-15T23:24:05.499581+0000","last_fullsized":"2024-09-15T23:24:05.499581+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:12:32.460158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.498131+0000","last_change":"2024-09-15T23:24:04.245408+0000","last_active":"2024-09-15T23:24:05.498131+0000","last_peered":"2024-09-15T23:24:05.498131+0000","last_clean":"2024-09-15T23:24:05.498131+0000","last_became_active":"2024-09-15T23:24:04.245111+0000","last_became_peered":"2024-09-15T23:24:04.245111+0000","last_unstale":"2024-09-15T23:24:05.498131+0000","last_undegraded":"2024-09-15T23:24:05.498131+0000","last_fullsized":"2024-09-15T23:24:05.498131+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:45:06.790418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":14,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.346088+0000","last_change":"2024-09-15T23:24:03.235840+0000","last_active":"2024-09-15T23:24:05.346088+0000","last_peered":"2024-09-15T23:24:05.346088+0000","last_clean":"2024-09-15T23:24:05.346088+0000","last_became_active":"2024-09-15T23:24:03.235577+0000","last_became_peered":"2024-09-15T23:24:03.235577+0000","last_unstale":"2024-09-15T23:24:05.346088+0000","last_undegraded":"2024-09-15T23:24:05.346088+0000","last_fullsized":"2024-09-15T23:24:05.346088+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:52:31.013796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.233288+0000","last_change":"2024-09-15T23:24:04.250329+0000","last_active":"2024-09-15T23:24:05.233288+0000","last_peered":"2024-09-15T23:24:05.233288+0000","last_clean":"2024-09-15T23:24:05.233288+0000","last_became_active":"2024-09-15T23:24:04.249891+0000","last_became_peered":"2024-09-15T23:24:04.249891+0000","last_unstale":"2024-09-15T23:24:05.233288+0000","last_undegraded":"2024-09-15T23:24:05.233288+0000","last_fullsized":"2024-09-15T23:24:05.233288+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:03.095275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":14,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.232213+0000","last_change":"2024-09-15T23:24:03.233988+0000","last_active":"2024-09-15T23:24:05.232213+0000","last_peered":"2024-09-15T23:24:05.232213+0000","last_clean":"2024-09-15T23:24:05.232213+0000","last_became_active":"2024-09-15T23:24:03.233730+0000","last_became_peered":"2024-09-15T23:24:03.233730+0000","last_unstale":"2024-09-15T23:24:05.232213+0000","last_undegraded":"2024-09-15T23:24:05.232213+0000","last_fullsized":"2024-09-15T23:24:05.232213+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:44:03.657126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":12,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.233812+0000","last_change":"2024-09-15T23:24:04.252588+0000","last_active":"2024-09-15T23:24:05.233812+0000","last_peered":"2024-09-15T23:24:05.233812+0000","last_clean":"2024-09-15T23:24:05.233812+0000","last_became_active":"2024-09-15T23:24:04.252308+0000","last_became_peered":"2024-09-15T23:24:04.252308+0000","last_unstale":"2024-09-15T23:24:05.233812+0000","last_undegraded":"2024-09-15T23:24:05.233812+0000","last_fullsized":"2024-09-15T23:24:05.233812+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":204,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:03.215032+0000","last_clean_scrub_stamp":"2024-09-15T23:24:03.215032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:23.258947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1d","version":"205'2","reported_seq":16,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.233178+0000","last_change":"2024-09-15T23:24:03.226290+0000","last_active":"2024-09-15T23:24:05.233178+0000","last_peered":"2024-09-15T23:24:05.233178+0000","last_clean":"2024-09-15T23:24:05.233178+0000","last_became_active":"2024-09-15T23:24:03.226044+0000","last_became_peered":"2024-09-15T23:24:03.226044+0000","last_unstale":"2024-09-15T23:24:05.233178+0000","last_undegraded":"2024-09-15T23:24:05.233178+0000","last_fullsized":"2024-09-15T23:24:05.233178+0000","mapping_epoch":203,"log_start":"0'0","ondisk_log_start":"0'0","created":203,"last_epoch_clean":204,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:02.210764+0000","last_clean_scrub_stamp":"2024-09-15T23:24:02.210764+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:56:35.536756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":515,"reported_epoch":206,"state":"active+clean","last_fresh":"2024-09-15T23:24:05.232323+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:24:05.232323+0000","last_peered":"2024-09-15T23:24:05.232323+0000","last_clean":"2024-09-15T23:24:05.232323+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:24:05.232323+0000","last_undegraded":"2024-09-15T23:24:05.232323+0000","last_fullsized":"2024-09-15T23:24:05.232323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476887,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60088,"kb_used_data":2524,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311752,"statfs":{"total":96636764160,"available":96575234048,"internally_reserved":0,"allocated":2584576,"data_stored":1145768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476884,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55932,"kb_used_data":2528,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315908,"statfs":{"total":96636764160,"available":96579489792,"internally_reserved":0,"allocated":2588672,"data_stored":1145802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476886,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56520,"kb_used_data":3116,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315320,"statfs":{"total":96636764160,"available":96578887680,"internally_reserved":0,"allocated":3190784,"data_stored":1736810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476886,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51760,"kb_used_data":2524,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320080,"statfs":{"total":96636764160,"available":96583761920,"internally_reserved":0,"allocated":2584576,"data_stored":1145768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542293,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51768,"kb_used_data":2532,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320072,"statfs":{"total":96636764160,"available":96583753728,"internally_reserved":0,"allocated":2592768,"data_stored":1146440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542293,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55940,"kb_used_data":2536,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315900,"statfs":{"total":96636764160,"available":96579481600,"internally_reserved":0,"allocated":2596864,"data_stored":1145914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542292,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60680,"kb_used_data":3120,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311160,"statfs":{"total":96636764160,"available":96574627840,"internally_reserved":0,"allocated":3194880,"data_stored":1737818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542294,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60096,"kb_used_data":2536,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311744,"statfs":{"total":96636764160,"available":96575225856,"internally_reserved":0,"allocated":2596864,"data_stored":1147380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:24:11.922 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T23:24:11.922 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T23:24:12.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.061+0000 7f5eff9c4640 1 Processor -- start 2024-09-15T23:24:12.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.061+0000 7f5eff9c4640 1 -- start start 2024-09-15T23:24:12.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.062+0000 7f5eff9c4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5ef80b5520 0x7f5ef806cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:12.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.062+0000 7f5eff9c4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ef815f550 con 0x7f5ef806d260 2024-09-15T23:24:12.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.062+0000 7f5eff9c4640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ef815f830 con 0x7f5ef815e990 2024-09-15T23:24:12.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.062+0000 7f5eff9c4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5ef815fb10 con 0x7f5ef80b5520 2024-09-15T23:24:12.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.062+0000 7f5efdf61640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f5ef806d260 0x7f5ef8162a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39206/0 (socket says 172.21.15.123:39206) 2024-09-15T23:24:12.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.062+0000 7f5efdf61640 1 -- 172.21.15.123:0/162269662 learned_addr learned my addr 172.21.15.123:0/162269662 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:12.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.062+0000 7f5efcf5f640 1 --2- 172.21.15.123:0/162269662 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5ef80b5520 0x7f5ef806cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:12.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.062+0000 7f5eeffff640 1 -- 172.21.15.123:0/162269662 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2347282007 0 0) 0x7f5ef815f550 con 0x7f5ef806d260 2024-09-15T23:24:12.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.062+0000 7f5eeffff640 1 -- 172.21.15.123:0/162269662 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ee4003520 con 0x7f5ef806d260 2024-09-15T23:24:12.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.062+0000 7f5eeffff640 1 -- 172.21.15.123:0/162269662 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3708299571 0 0) 0x7f5ee4003520 con 0x7f5ef806d260 2024-09-15T23:24:12.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.062+0000 7f5eeffff640 1 -- 172.21.15.123:0/162269662 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5ef80b5520 msgr2=0x7f5ef806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:12.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.062+0000 7f5eeffff640 1 --2- 172.21.15.123:0/162269662 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5ef80b5520 0x7f5ef806cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:12.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.062+0000 7f5eeffff640 1 -- 172.21.15.123:0/162269662 >> v1:172.21.15.188:6789/0 conn(0x7f5ef815e990 legacy=0x7f5ef815ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:12.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.062+0000 7f5eeffff640 1 -- 172.21.15.123:0/162269662 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ef81624e0 con 0x7f5ef806d260 2024-09-15T23:24:12.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.062+0000 7f5eeffff640 1 -- 172.21.15.123:0/162269662 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f5ef0001670 con 0x7f5ef806d260 2024-09-15T23:24:12.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.062+0000 7f5eeffff640 1 -- 172.21.15.123:0/162269662 >> v1:172.21.15.123:6789/0 conn(0x7f5ef806d260 legacy=0x7f5ef8162a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:12.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.062+0000 7f5eeffff640 1 --2- 172.21.15.123:0/162269662 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5ee40039e0 0x7f5ee4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:12.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.062+0000 7f5eeffff640 1 --2- 172.21.15.123:0/162269662 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ee4004390 0x7f5ee4004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:12.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.062+0000 7f5eeffff640 1 --2- 172.21.15.123:0/162269662 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5ef80b5520 0x7f5ee40050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:12.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.062+0000 7f5eeffff640 1 -- 172.21.15.123:0/162269662 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef815fb10 con 0x7f5ee4004390 2024-09-15T23:24:12.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.062+0000 7f5eeffff640 1 -- 172.21.15.123:0/162269662 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee400b9c0 con 0x7f5ee40039e0 2024-09-15T23:24:12.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.062+0000 7f5eeffff640 1 -- 172.21.15.123:0/162269662 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5ee400bbc0 con 0x7f5ef80b5520 2024-09-15T23:24:12.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.063+0000 7f5efcf5f640 1 --2- 172.21.15.123:0/162269662 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ee4004390 0x7f5ee4004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:12.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.063+0000 7f5efd760640 1 --2- 172.21.15.123:0/162269662 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5ee40039e0 0x7f5ee4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:12.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.063+0000 7f5efdf61640 1 --2- 172.21.15.123:0/162269662 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5ef80b5520 0x7f5ee40050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:12.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.063+0000 7f5efcf5f640 1 -- 172.21.15.123:0/162269662 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5ef80b5520 msgr2=0x7f5ee40050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:12.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.063+0000 7f5efcf5f640 1 --2- 172.21.15.123:0/162269662 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5ef80b5520 0x7f5ee40050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:12.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.063+0000 7f5efcf5f640 1 -- 172.21.15.123:0/162269662 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5ee40039e0 msgr2=0x7f5ee4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:12.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.063+0000 7f5efcf5f640 1 --2- 172.21.15.123:0/162269662 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5ee40039e0 0x7f5ee4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:12.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.063+0000 7f5efcf5f640 1 -- 172.21.15.123:0/162269662 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee4003520 con 0x7f5ee4004390 2024-09-15T23:24:12.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.063+0000 7f5efcf5f640 1 --2- 172.21.15.123:0/162269662 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ee4004390 0x7f5ee4004860 secure :-1 s=READY pgs=2396 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8009ac0 tx=0x7f5ee4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1690f46b32fa0260 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:12.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.064+0000 7f5eeffff640 1 -- 172.21.15.123:0/162269662 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee8036070 con 0x7f5ee4004390 2024-09-15T23:24:12.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.064+0000 7f5eeffff640 1 -- 172.21.15.123:0/162269662 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ee8031400 con 0x7f5ee4004390 2024-09-15T23:24:12.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.064+0000 7f5eeffff640 1 -- 172.21.15.123:0/162269662 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee8009690 con 0x7f5ee4004390 2024-09-15T23:24:12.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.064+0000 7f5eff9c4640 1 -- 172.21.15.123:0/162269662 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ee4004390 msgr2=0x7f5ee4004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:12.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.064+0000 7f5eff9c4640 1 --2- 172.21.15.123:0/162269662 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ee4004390 0x7f5ee4004860 secure :-1 s=READY pgs=2396 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8009ac0 tx=0x7f5ee4005830 comp rx=0 tx=0).stop 2024-09-15T23:24:12.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.064+0000 7f5efdf61640 1 -- 172.21.15.123:0/162269662 reap_dead start 2024-09-15T23:24:12.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.064+0000 7f5eff9c4640 1 -- 172.21.15.123:0/162269662 shutdown_connections 2024-09-15T23:24:12.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.064+0000 7f5eff9c4640 1 -- 172.21.15.123:0/162269662 >> 172.21.15.123:0/162269662 conn(0x7f5ef80d25d0 msgr2=0x7f5ef80d29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:12.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.064+0000 7f5eff9c4640 1 -- 172.21.15.123:0/162269662 shutdown_connections 2024-09-15T23:24:12.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.064+0000 7f5eff9c4640 1 -- 172.21.15.123:0/162269662 wait complete. 2024-09-15T23:24:12.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.065+0000 7f5eff9c4640 1 Processor -- start 2024-09-15T23:24:12.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.065+0000 7f5eff9c4640 1 -- start start 2024-09-15T23:24:12.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.066+0000 7f5eff9c4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5ee4004390 0x7f5ef8159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:12.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.066+0000 7f5eff9c4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5ef80d1d10 0x7f5ef80d0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:12.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.066+0000 7f5eff9c4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ef80708a0 0x7f5ef8070d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:12.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.066+0000 7f5eff9c4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef806cd20 con 0x7f5ef80708a0 2024-09-15T23:24:12.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.066+0000 7f5eff9c4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef806cea0 con 0x7f5ee4004390 2024-09-15T23:24:12.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.066+0000 7f5eff9c4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5ef806d020 con 0x7f5ef80d1d10 2024-09-15T23:24:12.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.066+0000 7f5efdf61640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ef80708a0 0x7f5ef8070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:12.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.066+0000 7f5efdf61640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ef80708a0 0x7f5ef8070d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39130/0 (socket says 172.21.15.123:39130) 2024-09-15T23:24:12.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.066+0000 7f5efdf61640 1 -- 172.21.15.123:0/3465120281 learned_addr learned my addr 172.21.15.123:0/3465120281 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:12.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.066+0000 7f5efcf5f640 1 --2- 172.21.15.123:0/3465120281 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5ef80d1d10 0x7f5ef80d0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:12.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.066+0000 7f5efd760640 1 --2- 172.21.15.123:0/3465120281 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5ee4004390 0x7f5ef8159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:12.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.066+0000 7f5efdf61640 1 -- 172.21.15.123:0/3465120281 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5ef80d1d10 msgr2=0x7f5ef80d0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:12.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.066+0000 7f5efdf61640 1 --2- 172.21.15.123:0/3465120281 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5ef80d1d10 0x7f5ef80d0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:12.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.067+0000 7f5efdf61640 1 -- 172.21.15.123:0/3465120281 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5ee4004390 msgr2=0x7f5ef8159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:12.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.067+0000 7f5efdf61640 1 --2- 172.21.15.123:0/3465120281 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5ee4004390 0x7f5ef8159360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:12.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.067+0000 7f5efdf61640 1 -- 172.21.15.123:0/3465120281 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ef80d17f0 con 0x7f5ef80708a0 2024-09-15T23:24:12.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.067+0000 7f5efdf61640 1 --2- 172.21.15.123:0/3465120281 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ef80708a0 0x7f5ef8070d20 secure :-1 s=READY pgs=2397 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8069240 tx=0x7f5ef000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:12.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.067+0000 7f5eedffb640 1 -- 172.21.15.123:0/3465120281 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0019070 con 0x7f5ef80708a0 2024-09-15T23:24:12.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.067+0000 7f5eedffb640 1 -- 172.21.15.123:0/3465120281 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ef000c5e0 con 0x7f5ef80708a0 2024-09-15T23:24:12.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.067+0000 7f5eff9c4640 1 -- 172.21.15.123:0/3465120281 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ef80d0c70 con 0x7f5ef80708a0 2024-09-15T23:24:12.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.067+0000 7f5eedffb640 1 -- 172.21.15.123:0/3465120281 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef000c9d0 con 0x7f5ef80708a0 2024-09-15T23:24:12.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.067+0000 7f5eff9c4640 1 -- 172.21.15.123:0/3465120281 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ef80d1230 con 0x7f5ef80708a0 2024-09-15T23:24:12.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.068+0000 7f5eff9c4640 1 -- 172.21.15.123:0/3465120281 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ef80758d0 con 0x7f5ef80708a0 2024-09-15T23:24:12.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.068+0000 7f5eedffb640 1 -- 172.21.15.123:0/3465120281 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5ef001c070 con 0x7f5ef80708a0 2024-09-15T23:24:12.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.069+0000 7f5eedffb640 1 --2- 172.21.15.123:0/3465120281 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5edc06c2b0 0x7f5edc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:12.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.069+0000 7f5eedffb640 1 -- 172.21.15.123:0/3465120281 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 5709+0+0 (secure 0 0 0) 0x7f5ef008a8a0 con 0x7f5ef80708a0 2024-09-15T23:24:12.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.069+0000 7f5efd760640 1 --2- 172.21.15.123:0/3465120281 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5edc06c2b0 0x7f5edc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:12.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.070+0000 7f5efd760640 1 --2- 172.21.15.123:0/3465120281 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5edc06c2b0 0x7f5edc06e770 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4000f80 tx=0x7f5ef4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:12.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.073+0000 7f5eedffb640 1 -- 172.21.15.123:0/3465120281 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5ef80758d0 con 0x7f5ef80708a0 2024-09-15T23:24:12.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.306+0000 7f5eff9c4640 1 -- 172.21.15.123:0/3465120281 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f5ef8068f10 con 0x7f5ef80708a0 2024-09-15T23:24:12.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.309+0000 7f5eedffb640 1 -- 172.21.15.123:0/3465120281 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v25) ==== 190+0+147 (secure 0 0 0) 0x7f5ef8068f10 con 0x7f5ef80708a0 2024-09-15T23:24:12.310 INFO:teuthology.orchestra.run.smithi123.stdout:[client.0] 2024-09-15T23:24:12.310 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCNaedmzQPqJRAAhUf1dnVYohN4obCfeu8+7g== 2024-09-15T23:24:12.310 INFO:teuthology.orchestra.run.smithi123.stdout: caps mds = "allow" 2024-09-15T23:24:12.310 INFO:teuthology.orchestra.run.smithi123.stdout: caps mon = "allow r" 2024-09-15T23:24:12.310 INFO:teuthology.orchestra.run.smithi123.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T23:24:12.310 INFO:teuthology.orchestra.run.smithi123.stderr:updated caps for client.0 2024-09-15T23:24:12.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.311+0000 7f5eff9c4640 1 -- 172.21.15.123:0/3465120281 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5edc06c2b0 msgr2=0x7f5edc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:12.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.311+0000 7f5eff9c4640 1 --2- 172.21.15.123:0/3465120281 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5edc06c2b0 0x7f5edc06e770 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4000f80 tx=0x7f5ef4009040 comp rx=0 tx=0).stop 2024-09-15T23:24:12.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.311+0000 7f5eff9c4640 1 -- 172.21.15.123:0/3465120281 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ef80708a0 msgr2=0x7f5ef8070d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:12.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.311+0000 7f5eff9c4640 1 --2- 172.21.15.123:0/3465120281 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ef80708a0 0x7f5ef8070d20 secure :-1 s=READY pgs=2397 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8069240 tx=0x7f5ef000eb90 comp rx=0 tx=0).stop 2024-09-15T23:24:12.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.311+0000 7f5eff9c4640 1 -- 172.21.15.123:0/3465120281 shutdown_connections 2024-09-15T23:24:12.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.311+0000 7f5eff9c4640 1 --2- 172.21.15.123:0/3465120281 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5edc06c2b0 0x7f5edc06e770 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:12.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.311+0000 7f5eff9c4640 1 --2- 172.21.15.123:0/3465120281 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ef80708a0 0x7f5ef8070d20 unknown :-1 s=CLOSED pgs=2397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:12.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.311+0000 7f5eff9c4640 1 --2- 172.21.15.123:0/3465120281 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5ef80d1d10 0x7f5ef80d0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:12.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.311+0000 7f5eff9c4640 1 --2- 172.21.15.123:0/3465120281 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5ee4004390 0x7f5ef8159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:12.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.311+0000 7f5eff9c4640 1 -- 172.21.15.123:0/3465120281 >> 172.21.15.123:0/3465120281 conn(0x7f5ef80d25d0 msgr2=0x7f5ef8159a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:12.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.311+0000 7f5eff9c4640 1 -- 172.21.15.123:0/3465120281 shutdown_connections 2024-09-15T23:24:12.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.311+0000 7f5eff9c4640 1 -- 172.21.15.123:0/3465120281 wait complete. 2024-09-15T23:24:12.323 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:24:12.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.420+0000 7f009e65e640 1 Processor -- start 2024-09-15T23:24:12.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.420+0000 7f009e65e640 1 -- start start 2024-09-15T23:24:12.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.421+0000 7f009e65e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f0098162490 0x7f009815ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:12.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.421+0000 7f009e65e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f00980b66b0 0x7f00980b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:12.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.421+0000 7f009e65e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f009815f570 con 0x7f009815eab0 2024-09-15T23:24:12.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.421+0000 7f009e65e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f00980b7040 con 0x7f0098162490 2024-09-15T23:24:12.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.421+0000 7f009e65e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f009815f850 con 0x7f00980b66b0 2024-09-15T23:24:12.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.421+0000 7f0097fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f009815eab0 0x7f00980d2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39208/0 (socket says 172.21.15.123:39208) 2024-09-15T23:24:12.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.421+0000 7f0097fff640 1 -- 172.21.15.123:0/4064380345 learned_addr learned my addr 172.21.15.123:0/4064380345 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:12.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.421+0000 7f009cbfb640 1 --2- 172.21.15.123:0/4064380345 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f00980b66b0 0x7f00980b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:12.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.421+0000 7f008ffff640 1 --2- 172.21.15.123:0/4064380345 >> v2:172.21.15.188:3300/0 conn(0x7f0098162490 0x7f009815ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:12.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.421+0000 7f00977fe640 1 -- 172.21.15.123:0/4064380345 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1010327090 0 0) 0x7f009815f570 con 0x7f009815eab0 2024-09-15T23:24:12.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.421+0000 7f00977fe640 1 -- 172.21.15.123:0/4064380345 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0084003520 con 0x7f009815eab0 2024-09-15T23:24:12.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.422+0000 7f00977fe640 1 -- 172.21.15.123:0/4064380345 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3944770610 0 0) 0x7f0084003520 con 0x7f009815eab0 2024-09-15T23:24:12.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.422+0000 7f00977fe640 1 -- 172.21.15.123:0/4064380345 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f00980b66b0 msgr2=0x7f00980b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:12.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.422+0000 7f00977fe640 1 --2- 172.21.15.123:0/4064380345 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f00980b66b0 0x7f00980b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:12.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.422+0000 7f00977fe640 1 -- 172.21.15.123:0/4064380345 >> v2:172.21.15.188:3300/0 conn(0x7f0098162490 msgr2=0x7f009815ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:12.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.422+0000 7f00977fe640 1 --2- 172.21.15.123:0/4064380345 >> v2:172.21.15.188:3300/0 conn(0x7f0098162490 0x7f009815ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:12.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.422+0000 7f00977fe640 1 -- 172.21.15.123:0/4064380345 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f009815fb30 con 0x7f009815eab0 2024-09-15T23:24:12.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.422+0000 7f00977fe640 1 -- 172.21.15.123:0/4064380345 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f0088001670 con 0x7f009815eab0 2024-09-15T23:24:12.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.422+0000 7f00977fe640 1 -- 172.21.15.123:0/4064380345 >> v1:172.21.15.123:6789/0 conn(0x7f009815eab0 legacy=0x7f00980d2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:12.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.422+0000 7f00977fe640 1 --2- 172.21.15.123:0/4064380345 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f00840039b0 0x7f0084003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:12.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.422+0000 7f00977fe640 1 --2- 172.21.15.123:0/4064380345 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f00980b66b0 0x7f0084004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:12.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.422+0000 7f00977fe640 1 --2- 172.21.15.123:0/4064380345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0084004d40 0x7f00840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:12.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.422+0000 7f00977fe640 1 -- 172.21.15.123:0/4064380345 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f00980b7040 con 0x7f0084004d40 2024-09-15T23:24:12.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.422+0000 7f00977fe640 1 -- 172.21.15.123:0/4064380345 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f009815f850 con 0x7f00840039b0 2024-09-15T23:24:12.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.422+0000 7f00977fe640 1 -- 172.21.15.123:0/4064380345 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f008400b9c0 con 0x7f00980b66b0 2024-09-15T23:24:12.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.422+0000 7f009cbfb640 1 --2- 172.21.15.123:0/4064380345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0084004d40 0x7f00840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:12.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.422+0000 7f008ffff640 1 --2- 172.21.15.123:0/4064380345 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f00980b66b0 0x7f0084004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:12.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.422+0000 7f0097fff640 1 --2- 172.21.15.123:0/4064380345 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f00840039b0 0x7f0084003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:12.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.422+0000 7f009cbfb640 1 -- 172.21.15.123:0/4064380345 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f00980b66b0 msgr2=0x7f0084004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:12.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.422+0000 7f009cbfb640 1 --2- 172.21.15.123:0/4064380345 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f00980b66b0 0x7f0084004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:12.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.422+0000 7f009cbfb640 1 -- 172.21.15.123:0/4064380345 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f00840039b0 msgr2=0x7f0084003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:12.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.422+0000 7f009cbfb640 1 --2- 172.21.15.123:0/4064380345 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f00840039b0 0x7f0084003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:12.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.422+0000 7f009cbfb640 1 -- 172.21.15.123:0/4064380345 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0084003520 con 0x7f0084004d40 2024-09-15T23:24:12.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.423+0000 7f009cbfb640 1 --2- 172.21.15.123:0/4064380345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0084004d40 0x7f00840051c0 secure :-1 s=READY pgs=2399 cs=0 l=1 rev1=1 crypto rx=0x7f0090009fc0 tx=0x7f0084005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=872a198c9d409e4d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:12.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.423+0000 7f00977fe640 1 -- 172.21.15.123:0/4064380345 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0090009c10 con 0x7f0084004d40 2024-09-15T23:24:12.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.423+0000 7f00977fe640 1 -- 172.21.15.123:0/4064380345 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0090036070 con 0x7f0084004d40 2024-09-15T23:24:12.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.423+0000 7f00977fe640 1 -- 172.21.15.123:0/4064380345 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0090031880 con 0x7f0084004d40 2024-09-15T23:24:12.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.424+0000 7f009e65e640 1 -- 172.21.15.123:0/4064380345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0084004d40 msgr2=0x7f00840051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:12.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.424+0000 7f009e65e640 1 --2- 172.21.15.123:0/4064380345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0084004d40 0x7f00840051c0 secure :-1 s=READY pgs=2399 cs=0 l=1 rev1=1 crypto rx=0x7f0090009fc0 tx=0x7f0084005830 comp rx=0 tx=0).stop 2024-09-15T23:24:12.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.424+0000 7f009cbfb640 1 -- 172.21.15.123:0/4064380345 reap_dead start 2024-09-15T23:24:12.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.424+0000 7f009e65e640 1 -- 172.21.15.123:0/4064380345 shutdown_connections 2024-09-15T23:24:12.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.424+0000 7f009e65e640 1 -- 172.21.15.123:0/4064380345 >> 172.21.15.123:0/4064380345 conn(0x7f00980d16d0 msgr2=0x7f00980d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:12.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.424+0000 7f009e65e640 1 -- 172.21.15.123:0/4064380345 shutdown_connections 2024-09-15T23:24:12.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.424+0000 7f009e65e640 1 -- 172.21.15.123:0/4064380345 wait complete. 2024-09-15T23:24:12.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.425+0000 7f009e65e640 1 Processor -- start 2024-09-15T23:24:12.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.425+0000 7f009e65e640 1 -- start start 2024-09-15T23:24:12.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.426+0000 7f009e65e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0084004d40 0x7f0098160a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:12.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.426+0000 7f009e65e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f00980c9a00 0x7f00980ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:12.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.426+0000 7f009e65e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f009815b7b0 0x7f009815bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:12.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.426+0000 7f009e65e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f00980d4460 con 0x7f00980c9a00 2024-09-15T23:24:12.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.426+0000 7f009e65e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f00980cef20 con 0x7f009815b7b0 2024-09-15T23:24:12.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.426+0000 7f009e65e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f00980d45e0 con 0x7f0084004d40 2024-09-15T23:24:12.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.426+0000 7f008ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f00980c9a00 0x7f00980ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:12.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.426+0000 7f008ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f00980c9a00 0x7f00980ce3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39154/0 (socket says 172.21.15.123:39154) 2024-09-15T23:24:12.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.426+0000 7f008ffff640 1 -- 172.21.15.123:0/3951518825 learned_addr learned my addr 172.21.15.123:0/3951518825 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:12.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.426+0000 7f0097fff640 1 --2- 172.21.15.123:0/3951518825 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0084004d40 0x7f0098160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:12.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.426+0000 7f009cbfb640 1 --2- 172.21.15.123:0/3951518825 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f009815b7b0 0x7f009815bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:12.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.426+0000 7f008ffff640 1 -- 172.21.15.123:0/3951518825 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0084004d40 msgr2=0x7f0098160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:12.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.426+0000 7f008ffff640 1 --2- 172.21.15.123:0/3951518825 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0084004d40 0x7f0098160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:12.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.426+0000 7f008ffff640 1 -- 172.21.15.123:0/3951518825 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f009815b7b0 msgr2=0x7f009815bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:12.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.426+0000 7f008ffff640 1 --2- 172.21.15.123:0/3951518825 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f009815b7b0 0x7f009815bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:12.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.426+0000 7f008ffff640 1 -- 172.21.15.123:0/3951518825 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00980ce8e0 con 0x7f00980c9a00 2024-09-15T23:24:12.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.426+0000 7f009cbfb640 1 --2- 172.21.15.123:0/3951518825 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f009815b7b0 0x7f009815bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:24:12.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.426+0000 7f008ffff640 1 --2- 172.21.15.123:0/3951518825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f00980c9a00 0x7f00980ce3a0 secure :-1 s=READY pgs=2400 cs=0 l=1 rev1=1 crypto rx=0x7f0080011aa0 tx=0x7f0080011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:12.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.426+0000 7f00957fa640 1 -- 172.21.15.123:0/3951518825 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008000fb80 con 0x7f00980c9a00 2024-09-15T23:24:12.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.426+0000 7f00957fa640 1 -- 172.21.15.123:0/3951518825 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f008000fd20 con 0x7f00980c9a00 2024-09-15T23:24:12.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.426+0000 7f009e65e640 1 -- 172.21.15.123:0/3951518825 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0098161120 con 0x7f00980c9a00 2024-09-15T23:24:12.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.426+0000 7f00957fa640 1 -- 172.21.15.123:0/3951518825 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0080014660 con 0x7f00980c9a00 2024-09-15T23:24:12.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.426+0000 7f009e65e640 1 -- 172.21.15.123:0/3951518825 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00981616e0 con 0x7f00980c9a00 2024-09-15T23:24:12.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.427+0000 7f009e65e640 1 -- 172.21.15.123:0/3951518825 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f009815f570 con 0x7f00980c9a00 2024-09-15T23:24:12.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.428+0000 7f00957fa640 1 -- 172.21.15.123:0/3951518825 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0080012040 con 0x7f00980c9a00 2024-09-15T23:24:12.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.428+0000 7f00957fa640 1 --2- 172.21.15.123:0/3951518825 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f007806c2b0 0x7f007806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:12.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.428+0000 7f00957fa640 1 -- 172.21.15.123:0/3951518825 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 5709+0+0 (secure 0 0 0) 0x7f008008bb00 con 0x7f00980c9a00 2024-09-15T23:24:12.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.429+0000 7f0097fff640 1 --2- 172.21.15.123:0/3951518825 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f007806c2b0 0x7f007806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:12.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.429+0000 7f0097fff640 1 --2- 172.21.15.123:0/3951518825 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f007806c2b0 0x7f007806e770 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f0088001d30 tx=0x7f0088007970 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:12.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.432+0000 7f00957fa640 1 -- 172.21.15.123:0/3951518825 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0080019030 con 0x7f00980c9a00 2024-09-15T23:24:12.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.634+0000 7f009e65e640 1 -- 172.21.15.123:0/3951518825 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00980d2500 con 0x7f00980c9a00 2024-09-15T23:24:12.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.635+0000 7f00957fa640 1 -- 172.21.15.123:0/3951518825 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 127 v127) ==== 95+0+5247 (secure 0 0 0) 0x7f008005a270 con 0x7f00980c9a00 2024-09-15T23:24:12.636 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:12.636 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":127,"btime":"2024-09-15T23:24:06:331850+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7922,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/173351117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":173351117},{"type":"v1","addr":"172.21.15.123:6835","nonce":173351117}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123},{"gid":7928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/4283187910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":4283187910},{"type":"v1","addr":"172.21.15.188:6837","nonce":4283187910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123},{"gid":9061,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/3180373488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3180373488},{"type":"v1","addr":"172.21.15.188:6836","nonce":3180373488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123}],"filesystems":[{"mdsmap":{"epoch":127,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:24:03.556320+0000","modified":"2024-09-15T23:24:05.658884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10905},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10905":{"gid":10905,"name":"c","rank":0,"incarnation":124,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6834/1661365546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":1661365546},{"type":"v1","addr":"172.21.15.123:6834","nonce":1661365546}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10905,"qdb_cluster":[10905]},"id":14}]} 2024-09-15T23:24:12.636 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 127 2024-09-15T23:24:12.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.637+0000 7f009e65e640 1 -- 172.21.15.123:0/3951518825 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f007806c2b0 msgr2=0x7f007806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:12.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.637+0000 7f009e65e640 1 --2- 172.21.15.123:0/3951518825 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f007806c2b0 0x7f007806e770 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f0088001d30 tx=0x7f0088007970 comp rx=0 tx=0).stop 2024-09-15T23:24:12.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.637+0000 7f009e65e640 1 -- 172.21.15.123:0/3951518825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f00980c9a00 msgr2=0x7f00980ce3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:12.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.637+0000 7f009e65e640 1 --2- 172.21.15.123:0/3951518825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f00980c9a00 0x7f00980ce3a0 secure :-1 s=READY pgs=2400 cs=0 l=1 rev1=1 crypto rx=0x7f0080011aa0 tx=0x7f0080011f60 comp rx=0 tx=0).stop 2024-09-15T23:24:12.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.637+0000 7f009e65e640 1 -- 172.21.15.123:0/3951518825 shutdown_connections 2024-09-15T23:24:12.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.637+0000 7f009e65e640 1 --2- 172.21.15.123:0/3951518825 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f009815b7b0 0x7f009815bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:12.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.637+0000 7f009e65e640 1 --2- 172.21.15.123:0/3951518825 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f007806c2b0 0x7f007806e770 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:12.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.637+0000 7f009e65e640 1 --2- 172.21.15.123:0/3951518825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f00980c9a00 0x7f00980ce3a0 unknown :-1 s=CLOSED pgs=2400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:12.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.637+0000 7f009e65e640 1 --2- 172.21.15.123:0/3951518825 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f0084004d40 0x7f0098160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:12.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.637+0000 7f009e65e640 1 -- 172.21.15.123:0/3951518825 >> 172.21.15.123:0/3951518825 conn(0x7f00980d16d0 msgr2=0x7f00980b4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:12.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.637+0000 7f009e65e640 1 -- 172.21.15.123:0/3951518825 shutdown_connections 2024-09-15T23:24:12.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:12.637+0000 7f009e65e640 1 -- 172.21.15.123:0/3951518825 wait complete. 2024-09-15T23:24:13.052 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 127, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:24:03.556320+0000', 'modified': '2024-09-15T23:24:05.658884+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10905}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10905': {'gid': 10905, 'name': 'c', 'rank': 0, 'incarnation': 124, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.123:6834/1661365546', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6832', 'nonce': 1661365546}, {'type': 'v1', 'addr': '172.21.15.123:6834', 'nonce': 1661365546}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [29], 'metadata_pool': 28, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 10905, 'qdb_cluster': [10905]} 2024-09-15T23:24:13.052 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:24:13.053 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-15T23:24:13.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.153+0000 7f0516318640 1 Processor -- start 2024-09-15T23:24:13.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.153+0000 7f0516318640 1 -- start start 2024-09-15T23:24:13.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.154+0000 7f0516318640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f051015c4b0 0x7f05100b6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:13.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.154+0000 7f0516318640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f05100b02b0 0x7f05100b6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:13.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.154+0000 7f0516318640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0510067b50 con 0x7f05100d08e0 2024-09-15T23:24:13.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.154+0000 7f0516318640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f05100ce860 con 0x7f05100b02b0 2024-09-15T23:24:13.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.154+0000 7f0516318640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f0510070130 con 0x7f051015c4b0 2024-09-15T23:24:13.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.154+0000 7f050f7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f05100b02b0 0x7f05100b6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:13.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.154+0000 7f05148b5640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f05100d08e0 0x7f0510160120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39222/0 (socket says 172.21.15.123:39222) 2024-09-15T23:24:13.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.154+0000 7f05148b5640 1 -- 172.21.15.123:0/1123671654 learned_addr learned my addr 172.21.15.123:0/1123671654 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:13.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.154+0000 7f050ffff640 1 --2- 172.21.15.123:0/1123671654 >> v2:172.21.15.188:3300/0 conn(0x7f051015c4b0 0x7f05100b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:13.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.154+0000 7f050f7fe640 1 -- 172.21.15.123:0/1123671654 >> v2:172.21.15.188:3300/0 conn(0x7f051015c4b0 msgr2=0x7f05100b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:13.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.154+0000 7f050f7fe640 1 --2- 172.21.15.123:0/1123671654 >> v2:172.21.15.188:3300/0 conn(0x7f051015c4b0 0x7f05100b6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.154+0000 7f050effd640 1 -- 172.21.15.123:0/1123671654 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2318443930 0 0) 0x7f0508001490 con 0x7f05100d08e0 2024-09-15T23:24:13.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.154+0000 7f050f7fe640 1 -- 172.21.15.123:0/1123671654 >> v1:172.21.15.123:6789/0 conn(0x7f05100d08e0 legacy=0x7f0510160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:13.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.154+0000 7f050f7fe640 1 -- 172.21.15.123:0/1123671654 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f051006fe50 con 0x7f05100b02b0 2024-09-15T23:24:13.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.155+0000 7f050f7fe640 1 --2- 172.21.15.123:0/1123671654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05100b02b0 0x7f05100b6660 secure :-1 s=READY pgs=2402 cs=0 l=1 rev1=1 crypto rx=0x7f0510069d90 tx=0x7f050402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca30457b25ab5a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:13.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.155+0000 7f050effd640 1 -- 172.21.15.123:0/1123671654 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0504037070 con 0x7f05100b02b0 2024-09-15T23:24:13.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.155+0000 7f050effd640 1 -- 172.21.15.123:0/1123671654 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0504032440 con 0x7f05100b02b0 2024-09-15T23:24:13.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.155+0000 7f050effd640 1 -- 172.21.15.123:0/1123671654 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0504032810 con 0x7f05100b02b0 2024-09-15T23:24:13.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.156+0000 7f0516318640 1 -- 172.21.15.123:0/1123671654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05100b02b0 msgr2=0x7f05100b6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:13.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.156+0000 7f0516318640 1 --2- 172.21.15.123:0/1123671654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05100b02b0 0x7f05100b6660 secure :-1 s=READY pgs=2402 cs=0 l=1 rev1=1 crypto rx=0x7f0510069d90 tx=0x7f050402a1a0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.156+0000 7f0516318640 1 -- 172.21.15.123:0/1123671654 shutdown_connections 2024-09-15T23:24:13.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.156+0000 7f0516318640 1 --2- 172.21.15.123:0/1123671654 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05100b02b0 0x7f05100b6660 unknown :-1 s=CLOSED pgs=2402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.156+0000 7f0516318640 1 --2- 172.21.15.123:0/1123671654 >> v2:172.21.15.188:3300/0 conn(0x7f051015c4b0 0x7f05100b6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.156+0000 7f0516318640 1 -- 172.21.15.123:0/1123671654 >> 172.21.15.123:0/1123671654 conn(0x7f05100b0a80 msgr2=0x7f05100b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:13.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.156+0000 7f0516318640 1 -- 172.21.15.123:0/1123671654 shutdown_connections 2024-09-15T23:24:13.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.156+0000 7f0516318640 1 -- 172.21.15.123:0/1123671654 wait complete. 2024-09-15T23:24:13.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.157+0000 7f0516318640 1 Processor -- start 2024-09-15T23:24:13.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.157+0000 7f0516318640 1 -- start start 2024-09-15T23:24:13.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.158+0000 7f0516318640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05100b02b0 0x7f0510153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:13.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.158+0000 7f0516318640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05100d08e0 0x7f05100aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:13.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.158+0000 7f0516318640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f051015c4b0 0x7f05100b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:13.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.158+0000 7f0516318640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f051006dcc0 con 0x7f05100d08e0 2024-09-15T23:24:13.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.158+0000 7f0516318640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f05100ce580 con 0x7f051015c4b0 2024-09-15T23:24:13.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.158+0000 7f0516318640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f051015c890 con 0x7f05100b02b0 2024-09-15T23:24:13.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.158+0000 7f050f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05100d08e0 0x7f05100aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:13.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.158+0000 7f050f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05100d08e0 0x7f05100aeae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39178/0 (socket says 172.21.15.123:39178) 2024-09-15T23:24:13.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.158+0000 7f050f7fe640 1 -- 172.21.15.123:0/728483823 learned_addr learned my addr 172.21.15.123:0/728483823 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:13.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.158+0000 7f050f7fe640 1 -- 172.21.15.123:0/728483823 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05100b02b0 msgr2=0x7f0510153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:13.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.158+0000 7f050f7fe640 1 --2- 172.21.15.123:0/728483823 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05100b02b0 0x7f0510153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.158+0000 7f050f7fe640 1 -- 172.21.15.123:0/728483823 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f051015c4b0 msgr2=0x7f05100b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:13.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.158+0000 7f050f7fe640 1 --2- 172.21.15.123:0/728483823 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f051015c4b0 0x7f05100b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.158+0000 7f050f7fe640 1 -- 172.21.15.123:0/728483823 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05100b5d80 con 0x7f05100d08e0 2024-09-15T23:24:13.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.158+0000 7f050f7fe640 1 --2- 172.21.15.123:0/728483823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05100d08e0 0x7f05100aeae0 secure :-1 s=READY pgs=2403 cs=0 l=1 rev1=1 crypto rx=0x7f0504000c00 tx=0x7f05040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:13.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.159+0000 7f050cff9640 1 -- 172.21.15.123:0/728483823 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0504037040 con 0x7f05100d08e0 2024-09-15T23:24:13.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.159+0000 7f050cff9640 1 -- 172.21.15.123:0/728483823 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0504042070 con 0x7f05100d08e0 2024-09-15T23:24:13.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.159+0000 7f0516318640 1 -- 172.21.15.123:0/728483823 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05101531f0 con 0x7f05100d08e0 2024-09-15T23:24:13.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.159+0000 7f050cff9640 1 -- 172.21.15.123:0/728483823 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0504030960 con 0x7f05100d08e0 2024-09-15T23:24:13.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.159+0000 7f0516318640 1 -- 172.21.15.123:0/728483823 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05100af020 con 0x7f05100d08e0 2024-09-15T23:24:13.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.160+0000 7f050cff9640 1 -- 172.21.15.123:0/728483823 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0504030b00 con 0x7f05100d08e0 2024-09-15T23:24:13.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.161+0000 7f050cff9640 1 --2- 172.21.15.123:0/728483823 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f04fc06c2e0 0x7f04fc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:13.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.161+0000 7f050cff9640 1 -- 172.21.15.123:0/728483823 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 5709+0+0 (secure 0 0 0) 0x7f05040abd00 con 0x7f05100d08e0 2024-09-15T23:24:13.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.161+0000 7f050ffff640 1 --2- 172.21.15.123:0/728483823 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f04fc06c2e0 0x7f04fc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:13.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.162+0000 7f050ffff640 1 --2- 172.21.15.123:0/728483823 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f04fc06c2e0 0x7f04fc06e7a0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f0500006a90 tx=0x7f0500006a20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:13.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.162+0000 7f05190b2740 1 Processor -- start 2024-09-15T23:24:13.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.162+0000 7f05190b2740 1 -- start start 2024-09-15T23:24:13.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.162+0000 7f05190b2740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56426bf2a2c0 0x56426bf6fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:13.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.162+0000 7f05190b2740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56426bf27a80 0x56426bf2a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:13.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.162+0000 7f05190b2740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56426bf2ba50 0x56426bf248b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:13.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.162+0000 7f05190b2740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56426be8c520 con 0x56426bf27a80 2024-09-15T23:24:13.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.162+0000 7f05190b2740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56426be343e0 con 0x56426bf2a2c0 2024-09-15T23:24:13.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.162+0000 7f05190b2740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x56426be884e0 con 0x56426bf2ba50 2024-09-15T23:24:13.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.162+0000 7f050f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56426bf27a80 0x56426bf2a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:13.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.162+0000 7f050f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56426bf27a80 0x56426bf2a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39194/0 (socket says 172.21.15.123:39194) 2024-09-15T23:24:13.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.163+0000 7f050f7fe640 1 -- 172.21.15.123:0/3518461883 learned_addr learned my addr 172.21.15.123:0/3518461883 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:13.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.163+0000 7f050ffff640 1 --2- 172.21.15.123:0/3518461883 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56426bf2a2c0 0x56426bf6fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:13.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.163+0000 7f05148b5640 1 --2- 172.21.15.123:0/3518461883 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56426bf2ba50 0x56426bf248b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:13.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.163+0000 7f050f7fe640 1 -- 172.21.15.123:0/3518461883 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56426bf2ba50 msgr2=0x56426bf248b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:13.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.163+0000 7f050f7fe640 1 --2- 172.21.15.123:0/3518461883 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56426bf2ba50 0x56426bf248b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.163+0000 7f050f7fe640 1 -- 172.21.15.123:0/3518461883 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56426bf2a2c0 msgr2=0x56426bf6fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:13.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.163+0000 7f050f7fe640 1 --2- 172.21.15.123:0/3518461883 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56426bf2a2c0 0x56426bf6fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.163+0000 7f050f7fe640 1 -- 172.21.15.123:0/3518461883 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56426be4f2f0 con 0x56426bf27a80 2024-09-15T23:24:13.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.163+0000 7f050ffff640 1 --2- 172.21.15.123:0/3518461883 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56426bf2a2c0 0x56426bf6fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:24:13.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.163+0000 7f050f7fe640 1 --2- 172.21.15.123:0/3518461883 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56426bf27a80 0x56426bf2a6a0 secure :-1 s=READY pgs=2404 cs=0 l=1 rev1=1 crypto rx=0x7f05040aa1a0 tx=0x7f0504079a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b88ea9425dc8b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:13.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.163+0000 7f04f5ffb640 1 -- 172.21.15.123:0/3518461883 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0504079e90 con 0x56426bf27a80 2024-09-15T23:24:13.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.163+0000 7f04f5ffb640 1 -- 172.21.15.123:0/3518461883 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f050407e240 con 0x56426bf27a80 2024-09-15T23:24:13.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.163+0000 7f04f5ffb640 1 -- 172.21.15.123:0/3518461883 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0504082a70 con 0x56426bf27a80 2024-09-15T23:24:13.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.164+0000 7f05190b2740 1 -- 172.21.15.123:0/3518461883 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56426bf27a80 msgr2=0x56426bf2a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:13.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.164+0000 7f05190b2740 1 --2- 172.21.15.123:0/3518461883 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56426bf27a80 0x56426bf2a6a0 secure :-1 s=READY pgs=2404 cs=0 l=1 rev1=1 crypto rx=0x7f05040aa1a0 tx=0x7f0504079a90 comp rx=0 tx=0).stop 2024-09-15T23:24:13.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.164+0000 7f05190b2740 1 -- 172.21.15.123:0/3518461883 shutdown_connections 2024-09-15T23:24:13.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.164+0000 7f05190b2740 1 --2- 172.21.15.123:0/3518461883 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56426bf2ba50 0x56426bf248b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.164+0000 7f05190b2740 1 --2- 172.21.15.123:0/3518461883 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56426bf27a80 0x56426bf2a6a0 unknown :-1 s=CLOSED pgs=2404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.164+0000 7f05190b2740 1 --2- 172.21.15.123:0/3518461883 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56426bf2a2c0 0x56426bf6fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.164+0000 7f05190b2740 1 -- 172.21.15.123:0/3518461883 >> 172.21.15.123:0/3518461883 conn(0x56426bf26a80 msgr2=0x56426bf6ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:13.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.164+0000 7f05190b2740 1 -- 172.21.15.123:0/3518461883 shutdown_connections 2024-09-15T23:24:13.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.164+0000 7f05190b2740 1 -- 172.21.15.123:0/3518461883 wait complete. 2024-09-15T23:24:13.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.164+0000 7f05190b2740 1 -- start start 2024-09-15T23:24:13.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.165+0000 7f05190b2740 1 Processor -- start 2024-09-15T23:24:13.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.165+0000 7f05190b2740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56426bf2a2c0 0x56426bf54600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:13.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.165+0000 7f05190b2740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56426bf2ba50 0x56426bf68c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:13.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.165+0000 7f05190b2740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56426bf4f850 0x56426bf6b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:13.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.165+0000 7f05190b2740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56426be8c520 con 0x56426bf2ba50 2024-09-15T23:24:13.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.165+0000 7f05190b2740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56426be15450 con 0x56426bf2a2c0 2024-09-15T23:24:13.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.165+0000 7f05190b2740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x56426bf25f20 con 0x56426bf4f850 2024-09-15T23:24:13.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.165+0000 7f05190b2740 10 client.0 _ll_register_callbacks cb 0x56426bb9eac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:24:13.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.165+0000 7f050f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56426bf2ba50 0x56426bf68c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:13.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.165+0000 7f050f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56426bf2ba50 0x56426bf68c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39196/0 (socket says 172.21.15.123:39196) 2024-09-15T23:24:13.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.165+0000 7f050f7fe640 1 -- 172.21.15.123:0/3056942462 learned_addr learned my addr 172.21.15.123:0/3056942462 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:13.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.165+0000 7f05148b5640 1 --2- 172.21.15.123:0/3056942462 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56426bf4f850 0x56426bf6b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:13.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.165+0000 7f050ffff640 1 --2- 172.21.15.123:0/3056942462 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56426bf2a2c0 0x56426bf54600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:13.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.166+0000 7f050f7fe640 1 -- 172.21.15.123:0/3056942462 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56426bf4f850 msgr2=0x56426bf6b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:13.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.166+0000 7f050f7fe640 1 --2- 172.21.15.123:0/3056942462 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56426bf4f850 0x56426bf6b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.166+0000 7f050f7fe640 1 -- 172.21.15.123:0/3056942462 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56426bf2a2c0 msgr2=0x56426bf54600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:13.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.166+0000 7f050f7fe640 1 --2- 172.21.15.123:0/3056942462 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56426bf2a2c0 0x56426bf54600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.166+0000 7f050f7fe640 1 -- 172.21.15.123:0/3056942462 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56426bb9f2d0 con 0x56426bf2ba50 2024-09-15T23:24:13.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.166+0000 7f05148b5640 1 --2- 172.21.15.123:0/3056942462 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56426bf4f850 0x56426bf6b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:24:13.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.166+0000 7f050ffff640 1 --2- 172.21.15.123:0/3056942462 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56426bf2a2c0 0x56426bf54600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:24:13.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.166+0000 7f050f7fe640 1 --2- 172.21.15.123:0/3056942462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56426bf2ba50 0x56426bf68c10 secure :-1 s=READY pgs=2405 cs=0 l=1 rev1=1 crypto rx=0x7f0504079b90 tx=0x7f0504049070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd01448848754a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:13.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.166+0000 7f04eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:24:13.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.166+0000 7f04eeffd640 1 -- 172.21.15.123:0/3056942462 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0504082a70 con 0x56426bf2ba50 2024-09-15T23:24:13.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.166+0000 7f04eeffd640 1 -- 172.21.15.123:0/3056942462 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(206..206 src has 1..206) ==== 5709+0+0 (secure 0 0 0) 0x7f0504078190 con 0x56426bf2ba50 2024-09-15T23:24:13.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.166+0000 7f05190b2740 1 -- 172.21.15.123:0/3056942462 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f050407e240 con 0x56426bf2ba50 2024-09-15T23:24:13.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.166+0000 7f04eeffd640 1 -- 172.21.15.123:0/3056942462 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=127) ==== 24+0+0 (secure 0 0 0) 0x7f050408e080 con 0x56426bf2ba50 2024-09-15T23:24:13.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.166+0000 7f05190b2740 10 client.11067 fetch_fsmap learned FSMap version 127 2024-09-15T23:24:13.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.166+0000 7f05190b2740 1 -- 172.21.15.123:0/3056942462 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=127,monmap=2+}) -- 0x56426bc696b0 con 0x56426bf2ba50 2024-09-15T23:24:13.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.166+0000 7f04eeffd640 1 -- 172.21.15.123:0/3056942462 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f050407e240 con 0x56426bf2ba50 2024-09-15T23:24:13.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.166+0000 7f04eeffd640 1 -- 172.21.15.123:0/3056942462 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 127) ==== 3502+0+0 (secure 0 0 0) 0x7f050403a070 con 0x56426bf2ba50 2024-09-15T23:24:13.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.166+0000 7f05190b2740 10 client.11067 fetch_fsmap finished waiting for FSMap version 127 2024-09-15T23:24:13.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.166+0000 7f05190b2740 10 client.11067 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T23:24:13.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.166+0000 7f05190b2740 20 client.11067 populate_metadata read hostname 'smithi123' 2024-09-15T23:24:13.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.166+0000 7f05190b2740 1 --2- 172.21.15.123:0/3056942462 >> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] conn(0x56426bf6b130 0x56426bf51dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:13.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.166+0000 7f05190b2740 4 client.11067 mds_command: new command op to 10905 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:24:13.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.166+0000 7f05190b2740 1 -- 172.21.15.123:0/3056942462 --> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56426be99c50 con 0x56426bf6b130 2024-09-15T23:24:13.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.167+0000 7f050ffff640 1 --2- 172.21.15.123:0/3056942462 >> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] conn(0x56426bf6b130 0x56426bf51dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:13.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.167+0000 7f04eeffd640 10 client.11067 ms_handle_connect on v2:172.21.15.123:6832/1661365546 2024-09-15T23:24:13.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.167+0000 7f050ffff640 1 --2- 172.21.15.123:0/3056942462 >> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] conn(0x56426bf6b130 0x56426bf51dc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7b3043e34ef05c8 server_cookie=e3cf91fb91b7a103 in_seq=0 out_seq=0 2024-09-15T23:24:13.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.167+0000 7f04eeffd640 1 -- 172.21.15.123:0/3056942462 <== mds.0 v2:172.21.15.123:6832/1661365546 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56426be99c50 con 0x56426bf6b130 2024-09-15T23:24:13.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.167+0000 7f04eeffd640 10 client.11067 handle_command_reply: tid=0 2024-09-15T23:24:13.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.167+0000 7f05190b2740 1 client.11067 shutdown 2024-09-15T23:24:13.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.168+0000 7f05190b2740 1 -- 172.21.15.123:0/3056942462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56426bf2ba50 msgr2=0x56426bf68c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:13.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.168+0000 7f05190b2740 1 --2- 172.21.15.123:0/3056942462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56426bf2ba50 0x56426bf68c10 secure :-1 s=READY pgs=2405 cs=0 l=1 rev1=1 crypto rx=0x7f0504079b90 tx=0x7f0504049070 comp rx=0 tx=0).stop 2024-09-15T23:24:13.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.168+0000 7f05190b2740 1 -- 172.21.15.123:0/3056942462 shutdown_connections 2024-09-15T23:24:13.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.168+0000 7f05190b2740 1 --2- 172.21.15.123:0/3056942462 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56426bf4f850 0x56426bf6b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.168+0000 7f05190b2740 1 --2- 172.21.15.123:0/3056942462 >> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] conn(0x56426bf6b130 0x56426bf51dc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.168+0000 7f05190b2740 1 --2- 172.21.15.123:0/3056942462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56426bf2ba50 0x56426bf68c10 unknown :-1 s=CLOSED pgs=2405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.168+0000 7f04eeffd640 0 client.11067 ms_handle_reset on v2:172.21.15.123:6832/1661365546 2024-09-15T23:24:13.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.168+0000 7f05190b2740 1 --2- 172.21.15.123:0/3056942462 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56426bf2a2c0 0x56426bf54600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.168+0000 7f05190b2740 1 -- 172.21.15.123:0/3056942462 >> 172.21.15.123:0/3056942462 conn(0x56426bf27a80 msgr2=0x56426bf6cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:13.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.168+0000 7f05190b2740 1 -- 172.21.15.123:0/3056942462 shutdown_connections 2024-09-15T23:24:13.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.168+0000 7f05190b2740 1 -- 172.21.15.123:0/3056942462 wait complete. 2024-09-15T23:24:13.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.168+0000 7f05190b2740 20 client.11067 trim_cache size 0 max 16384 2024-09-15T23:24:13.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.185+0000 7f05190b2740 1 Processor -- start 2024-09-15T23:24:13.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.185+0000 7f05190b2740 1 -- start start 2024-09-15T23:24:13.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.186+0000 7f05190b2740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56426bf2a2c0 0x56426bf6d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:13.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.186+0000 7f05190b2740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56426bf2ba50 0x56426bf92320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:13.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.186+0000 7f05190b2740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56426bf4f850 0x56426bf92860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:13.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.186+0000 7f05190b2740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f05101ffe40 con 0x56426bf4f850 2024-09-15T23:24:13.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.186+0000 7f05190b2740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f05100b41a0 con 0x56426bf2a2c0 2024-09-15T23:24:13.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.186+0000 7f05190b2740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f05100b47f0 con 0x56426bf2ba50 2024-09-15T23:24:13.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.186+0000 7f05148b5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56426bf4f850 0x56426bf92860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:13.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.186+0000 7f05148b5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56426bf4f850 0x56426bf92860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39210/0 (socket says 172.21.15.123:39210) 2024-09-15T23:24:13.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.186+0000 7f05148b5640 1 -- 172.21.15.123:0/1330429634 learned_addr learned my addr 172.21.15.123:0/1330429634 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:13.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.186+0000 7f05148b5640 1 -- 172.21.15.123:0/1330429634 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56426bf2ba50 msgr2=0x56426bf92320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:13.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.186+0000 7f05148b5640 1 --2- 172.21.15.123:0/1330429634 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56426bf2ba50 0x56426bf92320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.186+0000 7f05148b5640 1 -- 172.21.15.123:0/1330429634 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56426bf2a2c0 msgr2=0x56426bf6d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:13.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.186+0000 7f05148b5640 1 --2- 172.21.15.123:0/1330429634 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56426bf2a2c0 0x56426bf6d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.186+0000 7f05148b5640 1 -- 172.21.15.123:0/1330429634 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56426bf26260 con 0x56426bf4f850 2024-09-15T23:24:13.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.187+0000 7f05148b5640 1 --2- 172.21.15.123:0/1330429634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56426bf4f850 0x56426bf92860 secure :-1 s=READY pgs=2406 cs=0 l=1 rev1=1 crypto rx=0x7f0508005f40 tx=0x7f0508001c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e797fbb1b7c5006 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:13.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.187+0000 7f04f57fa640 1 -- 172.21.15.123:0/1330429634 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05080071d0 con 0x56426bf4f850 2024-09-15T23:24:13.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.187+0000 7f04f57fa640 1 -- 172.21.15.123:0/1330429634 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0508019070 con 0x56426bf4f850 2024-09-15T23:24:13.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.187+0000 7f04f57fa640 1 -- 172.21.15.123:0/1330429634 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0508007570 con 0x56426bf4f850 2024-09-15T23:24:13.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.187+0000 7f05190b2740 1 -- 172.21.15.123:0/1330429634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56426bf4f850 msgr2=0x56426bf92860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:13.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.187+0000 7f05190b2740 1 --2- 172.21.15.123:0/1330429634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56426bf4f850 0x56426bf92860 secure :-1 s=READY pgs=2406 cs=0 l=1 rev1=1 crypto rx=0x7f0508005f40 tx=0x7f0508001c90 comp rx=0 tx=0).stop 2024-09-15T23:24:13.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.187+0000 7f05190b2740 1 -- 172.21.15.123:0/1330429634 shutdown_connections 2024-09-15T23:24:13.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.187+0000 7f05190b2740 1 --2- 172.21.15.123:0/1330429634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56426bf4f850 0x56426bf92860 unknown :-1 s=CLOSED pgs=2406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.187+0000 7f05190b2740 1 --2- 172.21.15.123:0/1330429634 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56426bf2ba50 0x56426bf92320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.187+0000 7f05190b2740 1 --2- 172.21.15.123:0/1330429634 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56426bf2a2c0 0x56426bf6d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.187+0000 7f05190b2740 1 -- 172.21.15.123:0/1330429634 >> 172.21.15.123:0/1330429634 conn(0x56426bf27a80 msgr2=0x56426bf40b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:13.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.187+0000 7f05190b2740 1 -- 172.21.15.123:0/1330429634 shutdown_connections 2024-09-15T23:24:13.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.187+0000 7f05190b2740 1 -- 172.21.15.123:0/1330429634 wait complete. 2024-09-15T23:24:13.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.188+0000 7f05190b2740 1 -- start start 2024-09-15T23:24:13.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.188+0000 7f05190b2740 1 Processor -- start 2024-09-15T23:24:13.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.189+0000 7f05190b2740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56426bf2a2c0 0x56426bfea210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:13.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.189+0000 7f05190b2740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56426bf2ba50 0x56426bf65f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:13.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.189+0000 7f05190b2740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56426bf4f850 0x56426bf664b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:13.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.189+0000 7f05190b2740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56426be8c520 con 0x56426bf2a2c0 2024-09-15T23:24:13.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.189+0000 7f05190b2740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x56426bf25f20 con 0x56426bf4f850 2024-09-15T23:24:13.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.189+0000 7f05190b2740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x56426be15450 con 0x56426bf2ba50 2024-09-15T23:24:13.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.189+0000 7f05190b2740 10 client.0 _ll_register_callbacks cb 0x7f0504079c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:24:13.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.189+0000 7f050ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56426bf2a2c0 0x56426bfea210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:13.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.189+0000 7f050ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56426bf2a2c0 0x56426bfea210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39212/0 (socket says 172.21.15.123:39212) 2024-09-15T23:24:13.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.189+0000 7f050ffff640 1 -- 172.21.15.123:0/1552111430 learned_addr learned my addr 172.21.15.123:0/1552111430 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:13.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.189+0000 7f050ffff640 1 -- 172.21.15.123:0/1552111430 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56426bf2ba50 msgr2=0x56426bf65f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:13.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.189+0000 7f050ffff640 1 --2- 172.21.15.123:0/1552111430 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56426bf2ba50 0x56426bf65f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.189+0000 7f050ffff640 1 -- 172.21.15.123:0/1552111430 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56426bf4f850 msgr2=0x56426bf664b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:13.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.189+0000 7f050ffff640 1 --2- 172.21.15.123:0/1552111430 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56426bf4f850 0x56426bf664b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.189+0000 7f050ffff640 1 -- 172.21.15.123:0/1552111430 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56426bfedd20 con 0x56426bf2a2c0 2024-09-15T23:24:13.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.189+0000 7f050ffff640 1 --2- 172.21.15.123:0/1552111430 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56426bf2a2c0 0x56426bfea210 secure :-1 s=READY pgs=2407 cs=0 l=1 rev1=1 crypto rx=0x7f05000096f0 tx=0x7f05000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b551a9cdb38246ba server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:13.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.189+0000 7f04eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:24:13.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.189+0000 7f04eeffd640 1 -- 172.21.15.123:0/1552111430 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0500031060 con 0x56426bf2a2c0 2024-09-15T23:24:13.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.190+0000 7f04eeffd640 1 -- 172.21.15.123:0/1552111430 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(206..206 src has 1..206) ==== 5709+0+0 (secure 0 0 0) 0x7f050002c440 con 0x56426bf2a2c0 2024-09-15T23:24:13.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.190+0000 7f05190b2740 1 -- 172.21.15.123:0/1552111430 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0508019070 con 0x56426bf2a2c0 2024-09-15T23:24:13.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.190+0000 7f04eeffd640 1 -- 172.21.15.123:0/1552111430 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=127) ==== 24+0+0 (secure 0 0 0) 0x7f0500037050 con 0x56426bf2a2c0 2024-09-15T23:24:13.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.190+0000 7f05190b2740 10 client.11073 fetch_fsmap learned FSMap version 127 2024-09-15T23:24:13.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.190+0000 7f05190b2740 1 -- 172.21.15.123:0/1552111430 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=127,monmap=2+}) -- 0x56426bf91600 con 0x56426bf2a2c0 2024-09-15T23:24:13.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.190+0000 7f04eeffd640 1 -- 172.21.15.123:0/1552111430 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0508019070 con 0x56426bf2a2c0 2024-09-15T23:24:13.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.190+0000 7f04eeffd640 1 -- 172.21.15.123:0/1552111430 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 127) ==== 3502+0+0 (secure 0 0 0) 0x7f050003a020 con 0x56426bf2a2c0 2024-09-15T23:24:13.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.190+0000 7f05190b2740 10 client.11073 fetch_fsmap finished waiting for FSMap version 127 2024-09-15T23:24:13.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.190+0000 7f05190b2740 10 client.11073 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T23:24:13.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.190+0000 7f05190b2740 20 client.11073 populate_metadata read hostname 'smithi123' 2024-09-15T23:24:13.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.190+0000 7f05190b2740 1 --2- 172.21.15.123:0/1552111430 >> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] conn(0x56426bff10d0 0x56426bf67290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:13.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.190+0000 7f05190b2740 4 client.11073 mds_command: new command op to 10905 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:24:13.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.190+0000 7f05190b2740 1 -- 172.21.15.123:0/1552111430 --> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] -- command(tid 0: {"prefix": "status"}) -- 0x56426bf2b620 con 0x56426bff10d0 2024-09-15T23:24:13.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.190+0000 7f050f7fe640 1 --2- 172.21.15.123:0/1552111430 >> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] conn(0x56426bff10d0 0x56426bf67290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:13.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.190+0000 7f04eeffd640 10 client.11073 ms_handle_connect on v2:172.21.15.123:6832/1661365546 2024-09-15T23:24:13.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.190+0000 7f050f7fe640 1 --2- 172.21.15.123:0/1552111430 >> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] conn(0x56426bff10d0 0x56426bf67290 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9635361f2615e794 server_cookie=82d4ab852540f530 in_seq=0 out_seq=0 2024-09-15T23:24:13.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.191+0000 7f04eeffd640 1 -- 172.21.15.123:0/1552111430 <== mds.0 v2:172.21.15.123:6832/1661365546 1 ==== command_reply(tid 0: 0 ) ==== 8+0+329 (crc 0 0 0) 0x56426bf2b620 con 0x56426bff10d0 2024-09-15T23:24:13.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.191+0000 7f04eeffd640 10 client.11073 handle_command_reply: tid=0 2024-09-15T23:24:13.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.191+0000 7f05190b2740 1 client.11073 shutdown 2024-09-15T23:24:13.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.191+0000 7f05190b2740 1 -- 172.21.15.123:0/1552111430 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56426bf2a2c0 msgr2=0x56426bfea210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:13.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.191+0000 7f05190b2740 1 --2- 172.21.15.123:0/1552111430 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56426bf2a2c0 0x56426bfea210 secure :-1 s=READY pgs=2407 cs=0 l=1 rev1=1 crypto rx=0x7f05000096f0 tx=0x7f05000046c0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.191+0000 7f05190b2740 1 -- 172.21.15.123:0/1552111430 shutdown_connections 2024-09-15T23:24:13.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.191+0000 7f05190b2740 1 --2- 172.21.15.123:0/1552111430 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x56426bf4f850 0x56426bf664b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.191+0000 7f05190b2740 1 --2- 172.21.15.123:0/1552111430 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x56426bf2ba50 0x56426bf65f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.191+0000 7f05190b2740 1 --2- 172.21.15.123:0/1552111430 >> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] conn(0x56426bff10d0 0x56426bf67290 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.191+0000 7f05190b2740 1 --2- 172.21.15.123:0/1552111430 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56426bf2a2c0 0x56426bfea210 unknown :-1 s=CLOSED pgs=2407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.191+0000 7f04eeffd640 0 client.11073 ms_handle_reset on v2:172.21.15.123:6832/1661365546 2024-09-15T23:24:13.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.191+0000 7f05190b2740 1 -- 172.21.15.123:0/1552111430 >> 172.21.15.123:0/1552111430 conn(0x56426bf27a80 msgr2=0x56426bf6e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:13.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.191+0000 7f05190b2740 1 -- 172.21.15.123:0/1552111430 shutdown_connections 2024-09-15T23:24:13.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.191+0000 7f05190b2740 1 -- 172.21.15.123:0/1552111430 wait complete. 2024-09-15T23:24:13.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.191+0000 7f05190b2740 20 client.11073 trim_cache size 0 max 16384 2024-09-15T23:24:13.199 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:24:13.199 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "cb968ac4-8d3a-4b17-a673-6177aeaea589", 2024-09-15T23:24:13.199 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2024-09-15T23:24:13.199 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 10905, 2024-09-15T23:24:13.199 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-09-15T23:24:13.199 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-09-15T23:24:13.199 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-09-15T23:24:13.199 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 8.9526989649999997, 2024-09-15T23:24:13.199 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 127, 2024-09-15T23:24:13.199 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 206, 2024-09-15T23:24:13.199 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 206, 2024-09-15T23:24:13.199 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 13.051452759 2024-09-15T23:24:13.199 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:24:13.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.191+0000 7f0516318640 1 -- 172.21.15.123:0/728483823 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f04fc06c2e0 msgr2=0x7f04fc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:13.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.191+0000 7f0516318640 1 --2- 172.21.15.123:0/728483823 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f04fc06c2e0 0x7f04fc06e7a0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f0500006a90 tx=0x7f0500006a20 comp rx=0 tx=0).stop 2024-09-15T23:24:13.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.191+0000 7f0516318640 1 -- 172.21.15.123:0/728483823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05100d08e0 msgr2=0x7f05100aeae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:13.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.191+0000 7f0516318640 1 --2- 172.21.15.123:0/728483823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05100d08e0 0x7f05100aeae0 secure :-1 s=READY pgs=2403 cs=0 l=1 rev1=1 crypto rx=0x7f0504000c00 tx=0x7f05040046c0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.191+0000 7f0516318640 1 -- 172.21.15.123:0/728483823 shutdown_connections 2024-09-15T23:24:13.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.191+0000 7f0516318640 1 --2- 172.21.15.123:0/728483823 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f051015c4b0 0x7f05100b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.191+0000 7f0516318640 1 --2- 172.21.15.123:0/728483823 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f04fc06c2e0 0x7f04fc06e7a0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.191+0000 7f0516318640 1 --2- 172.21.15.123:0/728483823 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05100d08e0 0x7f05100aeae0 unknown :-1 s=CLOSED pgs=2403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.191+0000 7f0516318640 1 --2- 172.21.15.123:0/728483823 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f05100b02b0 0x7f0510153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.191+0000 7f0516318640 1 -- 172.21.15.123:0/728483823 >> 172.21.15.123:0/728483823 conn(0x7f05100b0a80 msgr2=0x7f05100b1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:13.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.192+0000 7f0516318640 1 -- 172.21.15.123:0/728483823 shutdown_connections 2024-09-15T23:24:13.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.192+0000 7f0516318640 1 -- 172.21.15.123:0/728483823 wait complete. 2024-09-15T23:24:13.203 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T23:24:13.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.300+0000 7f2e1c5e4640 1 Processor -- start 2024-09-15T23:24:13.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.300+0000 7f2e1c5e4640 1 -- start start 2024-09-15T23:24:13.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.301+0000 7f2e1c5e4640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2e1406bc10 0x7f2e1406bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:13.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.301+0000 7f2e1c5e4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e140b3790 0x7f2e141624e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:13.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.301+0000 7f2e1c5e4640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e1406c530 con 0x7f2e140cef60 2024-09-15T23:24:13.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.301+0000 7f2e1c5e4640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f2e140cd690 con 0x7f2e1406bc10 2024-09-15T23:24:13.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.301+0000 7f2e1c5e4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f2e140d06f0 con 0x7f2e140b3790 2024-09-15T23:24:13.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.301+0000 7f2e1ab81640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e140b3790 0x7f2e141624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:13.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.301+0000 7f2e1a380640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f2e1406bc10 0x7f2e1406bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:13.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.301+0000 7f2e19b7f640 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f2e140cef60 0x7f2e1415eb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:57976/0 (socket says 172.21.15.123:57976) 2024-09-15T23:24:13.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.302+0000 7f2e19b7f640 1 -- 172.21.15.123:0/1673641224 learned_addr learned my addr 172.21.15.123:0/1673641224 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:13.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.302+0000 7f2e1ab81640 1 -- 172.21.15.123:0/1673641224 >> v2:172.21.15.188:3300/0 conn(0x7f2e1406bc10 msgr2=0x7f2e1406bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:13.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.302+0000 7f2e1ab81640 1 --2- 172.21.15.123:0/1673641224 >> v2:172.21.15.188:3300/0 conn(0x7f2e1406bc10 0x7f2e1406bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.302+0000 7f2e1ab81640 1 -- 172.21.15.123:0/1673641224 >> v1:172.21.15.188:6789/0 conn(0x7f2e140cef60 legacy=0x7f2e1415eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:13.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.302+0000 7f2e1ab81640 1 -- 172.21.15.123:0/1673641224 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e140b4090 con 0x7f2e140b3790 2024-09-15T23:24:13.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.303+0000 7f2e1ab81640 1 --2- 172.21.15.123:0/1673641224 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e140b3790 0x7f2e141624e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c009d90 tx=0x7f2e0c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39b20c9b49ebf5ee server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:13.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.303+0000 7f2e1937e640 1 -- 172.21.15.123:0/1673641224 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c007740 con 0x7f2e140b3790 2024-09-15T23:24:13.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.303+0000 7f2e1937e640 1 -- 172.21.15.123:0/1673641224 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e0c0078e0 con 0x7f2e140b3790 2024-09-15T23:24:13.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.303+0000 7f2e1937e640 1 -- 172.21.15.123:0/1673641224 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c007cb0 con 0x7f2e140b3790 2024-09-15T23:24:13.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.303+0000 7f2e1c5e4640 1 -- 172.21.15.123:0/1673641224 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e140b3790 msgr2=0x7f2e141624e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:13.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.303+0000 7f2e1c5e4640 1 --2- 172.21.15.123:0/1673641224 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e140b3790 0x7f2e141624e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c009d90 tx=0x7f2e0c02a660 comp rx=0 tx=0).stop 2024-09-15T23:24:13.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.303+0000 7f2e1c5e4640 1 -- 172.21.15.123:0/1673641224 shutdown_connections 2024-09-15T23:24:13.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.303+0000 7f2e1c5e4640 1 --2- 172.21.15.123:0/1673641224 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e140b3790 0x7f2e141624e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.303+0000 7f2e1c5e4640 1 --2- 172.21.15.123:0/1673641224 >> v2:172.21.15.188:3300/0 conn(0x7f2e1406bc10 0x7f2e1406bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.303+0000 7f2e1c5e4640 1 -- 172.21.15.123:0/1673641224 >> 172.21.15.123:0/1673641224 conn(0x7f2e1406cd20 msgr2=0x7f2e1406d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:13.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.303+0000 7f2e1c5e4640 1 -- 172.21.15.123:0/1673641224 shutdown_connections 2024-09-15T23:24:13.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.303+0000 7f2e1c5e4640 1 -- 172.21.15.123:0/1673641224 wait complete. 2024-09-15T23:24:13.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.305+0000 7f2e1c5e4640 1 Processor -- start 2024-09-15T23:24:13.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.305+0000 7f2e1c5e4640 1 -- start start 2024-09-15T23:24:13.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.305+0000 7f2e1c5e4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e1406bc10 0x7f2e1414a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:13.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.305+0000 7f2e1c5e4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e140b3790 0x7f2e1414ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:13.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.305+0000 7f2e1c5e4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e140cef60 0x7f2e1414cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:13.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.305+0000 7f2e1c5e4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2e140d0f10 con 0x7f2e140b3790 2024-09-15T23:24:13.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.305+0000 7f2e1c5e4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f2e140d0c30 con 0x7f2e1406bc10 2024-09-15T23:24:13.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.305+0000 7f2e1c5e4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f2e140b3c00 con 0x7f2e140cef60 2024-09-15T23:24:13.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.305+0000 7f2e19b7f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e140b3790 0x7f2e1414ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:13.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.306+0000 7f2e19b7f640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e140b3790 0x7f2e1414ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39220/0 (socket says 172.21.15.123:39220) 2024-09-15T23:24:13.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.306+0000 7f2e19b7f640 1 -- 172.21.15.123:0/3315294827 learned_addr learned my addr 172.21.15.123:0/3315294827 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:13.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.306+0000 7f2e1ab81640 1 --2- 172.21.15.123:0/3315294827 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e140cef60 0x7f2e1414cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:13.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.306+0000 7f2e1a380640 1 --2- 172.21.15.123:0/3315294827 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e1406bc10 0x7f2e1414a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:13.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.306+0000 7f2e1ab81640 1 -- 172.21.15.123:0/3315294827 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e1406bc10 msgr2=0x7f2e1414a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:13.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.306+0000 7f2e1ab81640 1 --2- 172.21.15.123:0/3315294827 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e1406bc10 0x7f2e1414a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.306+0000 7f2e1ab81640 1 -- 172.21.15.123:0/3315294827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e140b3790 msgr2=0x7f2e1414ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:13.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.306+0000 7f2e1ab81640 1 --2- 172.21.15.123:0/3315294827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e140b3790 0x7f2e1414ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.306+0000 7f2e1ab81640 1 -- 172.21.15.123:0/3315294827 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e1414d610 con 0x7f2e140cef60 2024-09-15T23:24:13.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.306+0000 7f2e19b7f640 1 --2- 172.21.15.123:0/3315294827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e140b3790 0x7f2e1414ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:24:13.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.306+0000 7f2e1ab81640 1 --2- 172.21.15.123:0/3315294827 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e140cef60 0x7f2e1414cb90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2e141635a0 tx=0x7f2e0c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:13.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.306+0000 7f2e0affd640 1 -- 172.21.15.123:0/3315294827 <== mon.2 v2:172.21.15.188:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c03f070 con 0x7f2e140cef60 2024-09-15T23:24:13.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.306+0000 7f2e0affd640 1 -- 172.21.15.123:0/3315294827 <== mon.2 v2:172.21.15.188:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e0c031c60 con 0x7f2e140cef60 2024-09-15T23:24:13.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.306+0000 7f2e0affd640 1 -- 172.21.15.123:0/3315294827 <== mon.2 v2:172.21.15.188:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c009450 con 0x7f2e140cef60 2024-09-15T23:24:13.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.306+0000 7f2e1c5e4640 1 -- 172.21.15.123:0/3315294827 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e1414d8f0 con 0x7f2e140cef60 2024-09-15T23:24:13.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.306+0000 7f2e1c5e4640 1 -- 172.21.15.123:0/3315294827 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e140aa8c0 con 0x7f2e140cef60 2024-09-15T23:24:13.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.307+0000 7f2e1c5e4640 1 -- 172.21.15.123:0/3315294827 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e1406bff0 con 0x7f2e140cef60 2024-09-15T23:24:13.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.308+0000 7f2e0affd640 1 -- 172.21.15.123:0/3315294827 <== mon.2 v2:172.21.15.188:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2e0c043650 con 0x7f2e140cef60 2024-09-15T23:24:13.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.308+0000 7f2e0affd640 1 --2- 172.21.15.123:0/3315294827 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2df806c2b0 0x7f2df806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:13.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.308+0000 7f2e0affd640 1 -- 172.21.15.123:0/3315294827 <== mon.2 v2:172.21.15.188:3301/0 5 ==== osd_map(206..206 src has 1..206) ==== 5709+0+0 (secure 0 0 0) 0x7f2e0c0aca00 con 0x7f2e140cef60 2024-09-15T23:24:13.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.309+0000 7f2e1a380640 1 --2- 172.21.15.123:0/3315294827 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2df806c2b0 0x7f2df806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:13.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.309+0000 7f2e1a380640 1 --2- 172.21.15.123:0/3315294827 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2df806c2b0 0x7f2df806e770 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f2e10009aa0 tx=0x7f2e10009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:13.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.312+0000 7f2e0affd640 1 -- 172.21.15.123:0/3315294827 <== mon.2 v2:172.21.15.188:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2e0c07ab90 con 0x7f2e140cef60 2024-09-15T23:24:13.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.514+0000 7f2e1c5e4640 1 -- 172.21.15.123:0/3315294827 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2e14072f20 con 0x7f2e140cef60 2024-09-15T23:24:13.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.515+0000 7f2e0affd640 1 -- 172.21.15.123:0/3315294827 <== mon.2 v2:172.21.15.188:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v127) ==== 53+0+73 (secure 0 0 0) 0x7f2e0c07ee90 con 0x7f2e140cef60 2024-09-15T23:24:13.516 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T23:24:13.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.517+0000 7f2e1c5e4640 1 -- 172.21.15.123:0/3315294827 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2df806c2b0 msgr2=0x7f2df806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:13.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.517+0000 7f2e1c5e4640 1 --2- 172.21.15.123:0/3315294827 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2df806c2b0 0x7f2df806e770 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f2e10009aa0 tx=0x7f2e10009190 comp rx=0 tx=0).stop 2024-09-15T23:24:13.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.517+0000 7f2e1c5e4640 1 -- 172.21.15.123:0/3315294827 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e140cef60 msgr2=0x7f2e1414cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:13.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.517+0000 7f2e1c5e4640 1 --2- 172.21.15.123:0/3315294827 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e140cef60 0x7f2e1414cb90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2e141635a0 tx=0x7f2e0c004a40 comp rx=0 tx=0).stop 2024-09-15T23:24:13.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.517+0000 7f2e1c5e4640 1 -- 172.21.15.123:0/3315294827 shutdown_connections 2024-09-15T23:24:13.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.517+0000 7f2e1c5e4640 1 --2- 172.21.15.123:0/3315294827 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f2e140cef60 0x7f2e1414cb90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.517+0000 7f2e1c5e4640 1 --2- 172.21.15.123:0/3315294827 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f2df806c2b0 0x7f2df806e770 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.517+0000 7f2e1c5e4640 1 --2- 172.21.15.123:0/3315294827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e140b3790 0x7f2e1414ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.517+0000 7f2e1c5e4640 1 --2- 172.21.15.123:0/3315294827 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f2e1406bc10 0x7f2e1414a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:13.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.517+0000 7f2e1c5e4640 1 -- 172.21.15.123:0/3315294827 >> 172.21.15.123:0/3315294827 conn(0x7f2e1406cd20 msgr2=0x7f2e140ce140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:13.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.517+0000 7f2e1c5e4640 1 -- 172.21.15.123:0/3315294827 shutdown_connections 2024-09-15T23:24:13.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13.517+0000 7f2e1c5e4640 1 -- 172.21.15.123:0/3315294827 wait complete. 2024-09-15T23:24:13.529 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T23:24:13.529 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:24:13.529 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-09-15T23:24:13.529 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T23:24:13.529 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T23:24:13.529 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T23:24:13.529 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T23:24:13.529 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:24:13.529 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:24:13.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:24:13.530 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-09-15T23:24:13.545 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:24:13.545 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:24:13.545 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:24:13.545 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:24:13.546 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-09-15T23:24:13.546 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:24:13.546 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:24:13.546 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-09-15T23:24:13.546 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f0 2024-09-15T23:24:13.546 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:24:13.546 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:24:13.546 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f1 2024-09-15T23:24:13.546 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:24:13.546 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:24:13.546 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:24:13.546 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:24:13.546 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T23:24:13.546 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42087sec preferred_lft 42087sec 2024-09-15T23:24:13.547 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link noprefixroute 2024-09-15T23:24:13.547 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:24:13.547 INFO:teuthology.orchestra.run.smithi123.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T23:24:13.547 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 46:55:5a:e0:32:4d brd ff:ff:ff:ff:ff:ff 2024-09-15T23:24:13.547 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T23:24:13.547 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:24:13.547 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::1c6f:d5ff:fe19:ff05/64 scope link 2024-09-15T23:24:13.547 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:24:13.547 INFO:teuthology.orchestra.run.smithi123.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:24:13.547 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 46:55:5a:e0:32:4d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:24:13.547 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::4455:5aff:fee0:324d/64 scope link 2024-09-15T23:24:13.547 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:24:13.547 INFO:teuthology.orchestra.run.smithi123.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T23:24:13.548 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether be:c1:f3:63:cb:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:24:13.548 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::bcc1:f3ff:fe63:cb24/64 scope link 2024-09-15T23:24:13.548 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:24:13.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:24:13.548 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:24:13.609 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-09-15T23:24:13.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:24:13.611 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-09-15T23:24:13.667 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-09-15T23:24:13.667 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:24:13.667 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:24:13.667 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:24:13.668 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:24:13.668 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:24:13.668 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-09-15T23:24:13.668 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:24:13.668 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:24:13.668 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:24:13.668 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-09-15T23:24:13.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:24:13.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:24:13.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:24:13.794 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-09-15T23:24:13.809 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T23:24:13.809 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:24:13.809 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:24:13.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:24:13.809 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2024-09-15T23:24:13.873 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:24:13.874 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T23:24:13.930 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:24:13.930 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:24:13.930 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:24:13.985 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T23:24:13.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:24:13.985 DEBUG:teuthology.orchestra.run.smithi123:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:24:14.068 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:24:14.068 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:24:14.068 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:24:14.077 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:24:14.077 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:24:14.077 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:24:14.077 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.188:3300,172.21.15.188:3301" 2024-09-15T23:24:14.077 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T23:24:14.082 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T23:24:14.082 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T23:24:14.082 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-09-15T23:24:14.082 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.188:3300,172.21.15.188:3301" 2024-09-15T23:24:14.082 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T23:24:14.082 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:6789,172.21.15.188:6789,172.21.15.188:6790" 2024-09-15T23:24:14.082 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.123:6789,172.21.15.188:6789,172.21.15.188:6790:/ 2024-09-15T23:24:14.082 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=cb968ac4-8d3a-4b17-a673-6177aeaea589" will pass to kernel 2024-09-15T23:24:14.083 INFO:teuthology.orchestra.run.smithi123.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-15T23:24:14.083 INFO:teuthology.orchestra.run.smithi123.stdout: You just mounted a file system that supports labels which does not 2024-09-15T23:24:14.083 INFO:teuthology.orchestra.run.smithi123.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T23:24:14.083 INFO:teuthology.orchestra.run.smithi123.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T23:24:14.083 INFO:teuthology.orchestra.run.smithi123.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T23:24:14.084 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T23:24:14.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:24:14.085 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:24:14.150 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T23:24:14.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:24:14.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:24:14.250 INFO:teuthology.orchestra.run.smithi123.stdout:client8024 2024-09-15T23:24:14.250 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:24:14.250 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:24:14.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:24:14.266 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2024-09-15T23:24:14.326 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:24:14.326 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:24:14.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:24:14.382 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=subdir/sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-09-15T23:24:14.472 INFO:teuthology.orchestra.run.smithi123.stderr:6+0 records in 2024-09-15T23:24:14.473 INFO:teuthology.orchestra.run.smithi123.stderr:6+0 records out 2024-09-15T23:24:14.473 INFO:teuthology.orchestra.run.smithi123.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0340872 s, 185 MB/s 2024-09-15T23:24:14.474 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T23:24:14.476 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T23:24:14.517 INFO:teuthology.orchestra.run.smithi123.stdout:[global] 2024-09-15T23:24:14.517 INFO:teuthology.orchestra.run.smithi123.stdout: chdir = "" 2024-09-15T23:24:14.517 INFO:teuthology.orchestra.run.smithi123.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T23:24:14.517 INFO:teuthology.orchestra.run.smithi123.stdout: auth supported = cephx 2024-09-15T23:24:14.517 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.517 INFO:teuthology.orchestra.run.smithi123.stdout: filestore xattr use omap = true 2024-09-15T23:24:14.517 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.517 INFO:teuthology.orchestra.run.smithi123.stdout: mon clock drift allowed = 1.000 2024-09-15T23:24:14.517 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.518 INFO:teuthology.orchestra.run.smithi123.stdout: osd crush chooseleaf type = 0 2024-09-15T23:24:14.518 INFO:teuthology.orchestra.run.smithi123.stdout: auth debug = true 2024-09-15T23:24:14.518 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.518 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on old message = true 2024-09-15T23:24:14.518 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on bug = true 2024-09-15T23:24:14.518 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.518 INFO:teuthology.orchestra.run.smithi123.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T23:24:14.518 INFO:teuthology.orchestra.run.smithi123.stdout: mon pg warn max object skew = 0 2024-09-15T23:24:14.518 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.518 INFO:teuthology.orchestra.run.smithi123.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T23:24:14.518 INFO:teuthology.orchestra.run.smithi123.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T23:24:14.518 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.518 INFO:teuthology.orchestra.run.smithi123.stdout: osd pool default size = 2 2024-09-15T23:24:14.519 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.519 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd allow primary affinity = true 2024-09-15T23:24:14.519 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd allow pg remap = true 2024-09-15T23:24:14.519 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on legacy crush tunables = false 2024-09-15T23:24:14.519 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on crush straw calc version zero = false 2024-09-15T23:24:14.519 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on no sortbitwise = false 2024-09-15T23:24:14.519 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on osd down out interval zero = false 2024-09-15T23:24:14.519 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on too few osds = false 2024-09-15T23:24:14.519 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T23:24:14.519 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T23:24:14.519 INFO:teuthology.orchestra.run.smithi123.stdout: mon_allow_pool_size_one = true 2024-09-15T23:24:14.519 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.519 INFO:teuthology.orchestra.run.smithi123.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T23:24:14.520 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.520 INFO:teuthology.orchestra.run.smithi123.stdout: osd default data pool replay window = 5 2024-09-15T23:24:14.520 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.520 INFO:teuthology.orchestra.run.smithi123.stdout: mon allow pool delete = true 2024-09-15T23:24:14.520 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.520 INFO:teuthology.orchestra.run.smithi123.stdout: mon cluster log file level = debug 2024-09-15T23:24:14.520 INFO:teuthology.orchestra.run.smithi123.stdout: debug asserts on shutdown = true 2024-09-15T23:24:14.520 INFO:teuthology.orchestra.run.smithi123.stdout: mon health detail to clog = false 2024-09-15T23:24:14.520 INFO:teuthology.orchestra.run.smithi123.stdout: mon host = "172.21.15.123,172.21.15.188,[v2:172.21.15.188:3301,v1:172.21.15.188:6790]" 2024-09-15T23:24:14.520 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on skipped message = False 2024-09-15T23:24:14.520 INFO:teuthology.orchestra.run.smithi123.stdout: fsid = cb968ac4-8d3a-4b17-a673-6177aeaea589 2024-09-15T23:24:14.520 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.520 INFO:teuthology.orchestra.run.smithi123.stdout:[osd] 2024-09-15T23:24:14.520 INFO:teuthology.orchestra.run.smithi123.stdout: osd journal size = 100 2024-09-15T23:24:14.521 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.521 INFO:teuthology.orchestra.run.smithi123.stdout: osd scrub load threshold = 5.0 2024-09-15T23:24:14.521 INFO:teuthology.orchestra.run.smithi123.stdout: osd scrub max interval = 600 2024-09-15T23:24:14.521 INFO:teuthology.orchestra.run.smithi123.stdout: osd mclock profile = high_recovery_ops 2024-09-15T23:24:14.521 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.521 INFO:teuthology.orchestra.run.smithi123.stdout: osd recover clone overlap = true 2024-09-15T23:24:14.521 INFO:teuthology.orchestra.run.smithi123.stdout: osd recovery max chunk = 1048576 2024-09-15T23:24:14.521 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.521 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug shutdown = true 2024-09-15T23:24:14.521 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug op order = true 2024-09-15T23:24:14.521 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug verify stray on activate = true 2024-09-15T23:24:14.521 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug trim objects = true 2024-09-15T23:24:14.521 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.522 INFO:teuthology.orchestra.run.smithi123.stdout: osd open classes on start = true 2024-09-15T23:24:14.522 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug pg log writeout = true 2024-09-15T23:24:14.522 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.522 INFO:teuthology.orchestra.run.smithi123.stdout: osd deep scrub update digest min age = 30 2024-09-15T23:24:14.522 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.522 INFO:teuthology.orchestra.run.smithi123.stdout: osd map max advance = 10 2024-09-15T23:24:14.522 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.522 INFO:teuthology.orchestra.run.smithi123.stdout: journal zero on create = true 2024-09-15T23:24:14.522 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.522 INFO:teuthology.orchestra.run.smithi123.stdout: filestore ondisk finisher threads = 3 2024-09-15T23:24:14.522 INFO:teuthology.orchestra.run.smithi123.stdout: filestore apply finisher threads = 3 2024-09-15T23:24:14.522 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.522 INFO:teuthology.orchestra.run.smithi123.stdout: bdev debug aio = true 2024-09-15T23:24:14.522 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug misdirected ops = true 2024-09-15T23:24:14.523 INFO:teuthology.orchestra.run.smithi123.stdout: bdev async discard = True 2024-09-15T23:24:14.523 INFO:teuthology.orchestra.run.smithi123.stdout: bdev enable discard = True 2024-09-15T23:24:14.523 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore allocator = bitmap 2024-09-15T23:24:14.523 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore block size = 96636764160 2024-09-15T23:24:14.523 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore fsck on mount = True 2024-09-15T23:24:14.523 INFO:teuthology.orchestra.run.smithi123.stdout: debug bluefs = 1/20 2024-09-15T23:24:14.523 INFO:teuthology.orchestra.run.smithi123.stdout: debug bluestore = 1/20 2024-09-15T23:24:14.523 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-09-15T23:24:14.523 INFO:teuthology.orchestra.run.smithi123.stdout: debug osd = 20 2024-09-15T23:24:14.523 INFO:teuthology.orchestra.run.smithi123.stdout: debug rocksdb = 4/10 2024-09-15T23:24:14.523 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T23:24:14.523 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd full ratio = 0.9 2024-09-15T23:24:14.523 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd nearfull ratio = 0.8 2024-09-15T23:24:14.524 INFO:teuthology.orchestra.run.smithi123.stdout: osd failsafe full ratio = 0.95 2024-09-15T23:24:14.524 INFO:teuthology.orchestra.run.smithi123.stdout: osd objectstore = bluestore 2024-09-15T23:24:14.524 INFO:teuthology.orchestra.run.smithi123.stdout: osd op complaint time = 180 2024-09-15T23:24:14.524 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.524 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr] 2024-09-15T23:24:14.524 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-09-15T23:24:14.524 INFO:teuthology.orchestra.run.smithi123.stdout: debug mgr = 20 2024-09-15T23:24:14.524 INFO:teuthology.orchestra.run.smithi123.stdout: debug mon = 20 2024-09-15T23:24:14.524 INFO:teuthology.orchestra.run.smithi123.stdout: debug auth = 20 2024-09-15T23:24:14.524 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:24:14.524 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:24:14.524 INFO:teuthology.orchestra.run.smithi123.stdout: mgr/telemetry/nag = false 2024-09-15T23:24:14.524 INFO:teuthology.orchestra.run.smithi123.stdout: debug client = 20 2024-09-15T23:24:14.525 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.525 INFO:teuthology.orchestra.run.smithi123.stdout:[mon] 2024-09-15T23:24:14.525 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-09-15T23:24:14.525 INFO:teuthology.orchestra.run.smithi123.stdout: debug mon = 20 2024-09-15T23:24:14.525 INFO:teuthology.orchestra.run.smithi123.stdout: debug paxos = 20 2024-09-15T23:24:14.525 INFO:teuthology.orchestra.run.smithi123.stdout: debug auth = 20 2024-09-15T23:24:14.525 INFO:teuthology.orchestra.run.smithi123.stdout: mon data avail warn = 5 2024-09-15T23:24:14.525 INFO:teuthology.orchestra.run.smithi123.stdout: mon mgr mkfs grace = 240 2024-09-15T23:24:14.525 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:24:14.525 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd reporter subtree level = osd 2024-09-15T23:24:14.525 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd prime pg temp = true 2024-09-15T23:24:14.525 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:24:14.525 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.525 INFO:teuthology.orchestra.run.smithi123.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T23:24:14.526 INFO:teuthology.orchestra.run.smithi123.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T23:24:14.526 INFO:teuthology.orchestra.run.smithi123.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T23:24:14.526 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.526 INFO:teuthology.orchestra.run.smithi123.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T23:24:14.526 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T23:24:14.526 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T23:24:14.526 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.526 INFO:teuthology.orchestra.run.smithi123.stdout: # 1m isn't quite enough 2024-09-15T23:24:14.526 INFO:teuthology.orchestra.run.smithi123.stdout: mon_down_mkfs_grace = 2m 2024-09-15T23:24:14.526 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.526 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_filestore_osds = false 2024-09-15T23:24:14.526 INFO:teuthology.orchestra.run.smithi123.stdout: mon down mkfs grace = 300 2024-09-15T23:24:14.526 INFO:teuthology.orchestra.run.smithi123.stdout: mon op complaint time = 120 2024-09-15T23:24:14.526 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on pool no app = False 2024-09-15T23:24:14.527 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.527 INFO:teuthology.orchestra.run.smithi123.stdout:[client] 2024-09-15T23:24:14.527 INFO:teuthology.orchestra.run.smithi123.stdout: rgw cache enabled = true 2024-09-15T23:24:14.527 INFO:teuthology.orchestra.run.smithi123.stdout: rgw enable ops log = true 2024-09-15T23:24:14.527 INFO:teuthology.orchestra.run.smithi123.stdout: rgw enable usage log = true 2024-09-15T23:24:14.527 INFO:teuthology.orchestra.run.smithi123.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T23:24:14.527 INFO:teuthology.orchestra.run.smithi123.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T23:24:14.527 INFO:teuthology.orchestra.run.smithi123.stdout: client mount timeout = 600 2024-09-15T23:24:14.527 INFO:teuthology.orchestra.run.smithi123.stdout: debug client = 20 2024-09-15T23:24:14.527 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-09-15T23:24:14.527 INFO:teuthology.orchestra.run.smithi123.stdout: pid file = "" 2024-09-15T23:24:14.527 INFO:teuthology.orchestra.run.smithi123.stdout: rados mon op timeout = 900 2024-09-15T23:24:14.527 INFO:teuthology.orchestra.run.smithi123.stdout: rados osd op timeout = 900 2024-09-15T23:24:14.528 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.a] 2024-09-15T23:24:14.528 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.b] 2024-09-15T23:24:14.528 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.c] 2024-09-15T23:24:14.528 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.a] 2024-09-15T23:24:14.528 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.c] 2024-09-15T23:24:14.528 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.b] 2024-09-15T23:24:14.528 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.d] 2024-09-15T23:24:14.528 INFO:teuthology.orchestra.run.smithi123.stdout:[mds] 2024-09-15T23:24:14.528 INFO:teuthology.orchestra.run.smithi123.stdout: debug mds = 20 2024-09-15T23:24:14.528 INFO:teuthology.orchestra.run.smithi123.stdout: debug mds balancer = 20 2024-09-15T23:24:14.528 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-09-15T23:24:14.528 INFO:teuthology.orchestra.run.smithi123.stdout: mds cache max size = 1000 2024-09-15T23:24:14.529 INFO:teuthology.orchestra.run.smithi123.stdout: mds debug frag = True 2024-09-15T23:24:14.529 INFO:teuthology.orchestra.run.smithi123.stdout: mds debug scatterstat = True 2024-09-15T23:24:14.529 INFO:teuthology.orchestra.run.smithi123.stdout: mds log max segments = 1 2024-09-15T23:24:14.529 INFO:teuthology.orchestra.run.smithi123.stdout: mds op complaint time = 180 2024-09-15T23:24:14.529 INFO:teuthology.orchestra.run.smithi123.stdout: mds verify scatter = False 2024-09-15T23:24:14.529 INFO:teuthology.orchestra.run.smithi123.stdout: osd op complaint time = 180 2024-09-15T23:24:14.529 INFO:teuthology.orchestra.run.smithi123.stdout: rados mon op timeout = 900 2024-09-15T23:24:14.529 INFO:teuthology.orchestra.run.smithi123.stdout: rados osd op timeout = 900 2024-09-15T23:24:14.530 INFO:teuthology.orchestra.run.smithi188.stdout:[global] 2024-09-15T23:24:14.530 INFO:teuthology.orchestra.run.smithi188.stdout: chdir = "" 2024-09-15T23:24:14.530 INFO:teuthology.orchestra.run.smithi188.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T23:24:14.530 INFO:teuthology.orchestra.run.smithi188.stdout: auth supported = cephx 2024-09-15T23:24:14.530 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.530 INFO:teuthology.orchestra.run.smithi188.stdout: filestore xattr use omap = true 2024-09-15T23:24:14.530 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.530 INFO:teuthology.orchestra.run.smithi188.stdout: mon clock drift allowed = 1.000 2024-09-15T23:24:14.530 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.530 INFO:teuthology.orchestra.run.smithi188.stdout: osd crush chooseleaf type = 0 2024-09-15T23:24:14.530 INFO:teuthology.orchestra.run.smithi188.stdout: auth debug = true 2024-09-15T23:24:14.530 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.531 INFO:teuthology.orchestra.run.smithi188.stdout: ms die on old message = true 2024-09-15T23:24:14.531 INFO:teuthology.orchestra.run.smithi188.stdout: ms die on bug = true 2024-09-15T23:24:14.531 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.531 INFO:teuthology.orchestra.run.smithi188.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T23:24:14.531 INFO:teuthology.orchestra.run.smithi188.stdout: mon pg warn max object skew = 0 2024-09-15T23:24:14.531 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.531 INFO:teuthology.orchestra.run.smithi188.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T23:24:14.531 INFO:teuthology.orchestra.run.smithi188.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T23:24:14.531 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.531 INFO:teuthology.orchestra.run.smithi188.stdout: osd pool default size = 2 2024-09-15T23:24:14.531 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.531 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd allow primary affinity = true 2024-09-15T23:24:14.531 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd allow pg remap = true 2024-09-15T23:24:14.532 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on legacy crush tunables = false 2024-09-15T23:24:14.532 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on crush straw calc version zero = false 2024-09-15T23:24:14.532 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on no sortbitwise = false 2024-09-15T23:24:14.532 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on osd down out interval zero = false 2024-09-15T23:24:14.532 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on too few osds = false 2024-09-15T23:24:14.532 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T23:24:14.532 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T23:24:14.532 INFO:teuthology.orchestra.run.smithi188.stdout: mon_allow_pool_size_one = true 2024-09-15T23:24:14.532 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.532 INFO:teuthology.orchestra.run.smithi188.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T23:24:14.532 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.532 INFO:teuthology.orchestra.run.smithi188.stdout: osd default data pool replay window = 5 2024-09-15T23:24:14.532 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.532 INFO:teuthology.orchestra.run.smithi188.stdout: mon allow pool delete = true 2024-09-15T23:24:14.533 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.533 INFO:teuthology.orchestra.run.smithi188.stdout: mon cluster log file level = debug 2024-09-15T23:24:14.533 INFO:teuthology.orchestra.run.smithi188.stdout: debug asserts on shutdown = true 2024-09-15T23:24:14.533 INFO:teuthology.orchestra.run.smithi188.stdout: mon health detail to clog = false 2024-09-15T23:24:14.533 INFO:teuthology.orchestra.run.smithi188.stdout: mon host = "172.21.15.123,172.21.15.188,[v2:172.21.15.188:3301,v1:172.21.15.188:6790]" 2024-09-15T23:24:14.533 INFO:teuthology.orchestra.run.smithi188.stdout: ms die on skipped message = False 2024-09-15T23:24:14.533 INFO:teuthology.orchestra.run.smithi188.stdout: fsid = cb968ac4-8d3a-4b17-a673-6177aeaea589 2024-09-15T23:24:14.533 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.533 INFO:teuthology.orchestra.run.smithi188.stdout:[osd] 2024-09-15T23:24:14.533 INFO:teuthology.orchestra.run.smithi188.stdout: osd journal size = 100 2024-09-15T23:24:14.533 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.533 INFO:teuthology.orchestra.run.smithi188.stdout: osd scrub load threshold = 5.0 2024-09-15T23:24:14.533 INFO:teuthology.orchestra.run.smithi188.stdout: osd scrub max interval = 600 2024-09-15T23:24:14.534 INFO:teuthology.orchestra.run.smithi188.stdout: osd mclock profile = high_recovery_ops 2024-09-15T23:24:14.534 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.534 INFO:teuthology.orchestra.run.smithi188.stdout: osd recover clone overlap = true 2024-09-15T23:24:14.534 INFO:teuthology.orchestra.run.smithi188.stdout: osd recovery max chunk = 1048576 2024-09-15T23:24:14.534 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.534 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug shutdown = true 2024-09-15T23:24:14.534 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug op order = true 2024-09-15T23:24:14.534 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug verify stray on activate = true 2024-09-15T23:24:14.534 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug trim objects = true 2024-09-15T23:24:14.534 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.534 INFO:teuthology.orchestra.run.smithi188.stdout: osd open classes on start = true 2024-09-15T23:24:14.534 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug pg log writeout = true 2024-09-15T23:24:14.534 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.534 INFO:teuthology.orchestra.run.smithi188.stdout: osd deep scrub update digest min age = 30 2024-09-15T23:24:14.535 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.535 INFO:teuthology.orchestra.run.smithi188.stdout: osd map max advance = 10 2024-09-15T23:24:14.535 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.535 INFO:teuthology.orchestra.run.smithi188.stdout: journal zero on create = true 2024-09-15T23:24:14.535 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.535 INFO:teuthology.orchestra.run.smithi188.stdout: filestore ondisk finisher threads = 3 2024-09-15T23:24:14.535 INFO:teuthology.orchestra.run.smithi188.stdout: filestore apply finisher threads = 3 2024-09-15T23:24:14.535 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.535 INFO:teuthology.orchestra.run.smithi188.stdout: bdev debug aio = true 2024-09-15T23:24:14.535 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug misdirected ops = true 2024-09-15T23:24:14.535 INFO:teuthology.orchestra.run.smithi188.stdout: bdev async discard = True 2024-09-15T23:24:14.535 INFO:teuthology.orchestra.run.smithi188.stdout: bdev enable discard = True 2024-09-15T23:24:14.535 INFO:teuthology.orchestra.run.smithi188.stdout: bluestore allocator = bitmap 2024-09-15T23:24:14.535 INFO:teuthology.orchestra.run.smithi188.stdout: bluestore block size = 96636764160 2024-09-15T23:24:14.536 INFO:teuthology.orchestra.run.smithi188.stdout: bluestore fsck on mount = True 2024-09-15T23:24:14.536 INFO:teuthology.orchestra.run.smithi188.stdout: debug bluefs = 1/20 2024-09-15T23:24:14.536 INFO:teuthology.orchestra.run.smithi188.stdout: debug bluestore = 1/20 2024-09-15T23:24:14.536 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2024-09-15T23:24:14.536 INFO:teuthology.orchestra.run.smithi188.stdout: debug osd = 20 2024-09-15T23:24:14.536 INFO:teuthology.orchestra.run.smithi188.stdout: debug rocksdb = 4/10 2024-09-15T23:24:14.536 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T23:24:14.536 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd full ratio = 0.9 2024-09-15T23:24:14.536 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd nearfull ratio = 0.8 2024-09-15T23:24:14.536 INFO:teuthology.orchestra.run.smithi188.stdout: osd failsafe full ratio = 0.95 2024-09-15T23:24:14.536 INFO:teuthology.orchestra.run.smithi188.stdout: osd objectstore = bluestore 2024-09-15T23:24:14.536 INFO:teuthology.orchestra.run.smithi188.stdout: osd op complaint time = 180 2024-09-15T23:24:14.536 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.537 INFO:teuthology.orchestra.run.smithi188.stdout:[mgr] 2024-09-15T23:24:14.537 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2024-09-15T23:24:14.537 INFO:teuthology.orchestra.run.smithi188.stdout: debug mgr = 20 2024-09-15T23:24:14.537 INFO:teuthology.orchestra.run.smithi188.stdout: debug mon = 20 2024-09-15T23:24:14.537 INFO:teuthology.orchestra.run.smithi188.stdout: debug auth = 20 2024-09-15T23:24:14.537 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:24:14.537 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:24:14.537 INFO:teuthology.orchestra.run.smithi188.stdout: mgr/telemetry/nag = false 2024-09-15T23:24:14.537 INFO:teuthology.orchestra.run.smithi188.stdout: debug client = 20 2024-09-15T23:24:14.537 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.537 INFO:teuthology.orchestra.run.smithi188.stdout:[mon] 2024-09-15T23:24:14.537 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2024-09-15T23:24:14.537 INFO:teuthology.orchestra.run.smithi188.stdout: debug mon = 20 2024-09-15T23:24:14.538 INFO:teuthology.orchestra.run.smithi188.stdout: debug paxos = 20 2024-09-15T23:24:14.538 INFO:teuthology.orchestra.run.smithi188.stdout: debug auth = 20 2024-09-15T23:24:14.538 INFO:teuthology.orchestra.run.smithi188.stdout: mon data avail warn = 5 2024-09-15T23:24:14.538 INFO:teuthology.orchestra.run.smithi188.stdout: mon mgr mkfs grace = 240 2024-09-15T23:24:14.538 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:24:14.538 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd reporter subtree level = osd 2024-09-15T23:24:14.538 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd prime pg temp = true 2024-09-15T23:24:14.538 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:24:14.538 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.538 INFO:teuthology.orchestra.run.smithi188.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T23:24:14.538 INFO:teuthology.orchestra.run.smithi188.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T23:24:14.538 INFO:teuthology.orchestra.run.smithi188.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T23:24:14.538 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.539 INFO:teuthology.orchestra.run.smithi188.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T23:24:14.539 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T23:24:14.539 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T23:24:14.539 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.539 INFO:teuthology.orchestra.run.smithi188.stdout: # 1m isn't quite enough 2024-09-15T23:24:14.539 INFO:teuthology.orchestra.run.smithi188.stdout: mon_down_mkfs_grace = 2m 2024-09-15T23:24:14.539 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.539 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_filestore_osds = false 2024-09-15T23:24:14.539 INFO:teuthology.orchestra.run.smithi188.stdout: mon down mkfs grace = 300 2024-09-15T23:24:14.539 INFO:teuthology.orchestra.run.smithi188.stdout: mon op complaint time = 120 2024-09-15T23:24:14.539 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on pool no app = False 2024-09-15T23:24:14.539 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.539 INFO:teuthology.orchestra.run.smithi188.stdout:[client] 2024-09-15T23:24:14.539 INFO:teuthology.orchestra.run.smithi188.stdout: rgw cache enabled = true 2024-09-15T23:24:14.540 INFO:teuthology.orchestra.run.smithi188.stdout: rgw enable ops log = true 2024-09-15T23:24:14.540 INFO:teuthology.orchestra.run.smithi188.stdout: rgw enable usage log = true 2024-09-15T23:24:14.540 INFO:teuthology.orchestra.run.smithi188.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T23:24:14.540 INFO:teuthology.orchestra.run.smithi188.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T23:24:14.540 INFO:teuthology.orchestra.run.smithi188.stdout: client mount timeout = 600 2024-09-15T23:24:14.540 INFO:teuthology.orchestra.run.smithi188.stdout: debug client = 20 2024-09-15T23:24:14.540 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2024-09-15T23:24:14.540 INFO:teuthology.orchestra.run.smithi188.stdout: pid file = "" 2024-09-15T23:24:14.540 INFO:teuthology.orchestra.run.smithi188.stdout: rados mon op timeout = 900 2024-09-15T23:24:14.540 INFO:teuthology.orchestra.run.smithi188.stdout: rados osd op timeout = 900 2024-09-15T23:24:14.540 INFO:teuthology.orchestra.run.smithi188.stdout:[mon.a] 2024-09-15T23:24:14.540 INFO:teuthology.orchestra.run.smithi188.stdout:[mon.b] 2024-09-15T23:24:14.540 INFO:teuthology.orchestra.run.smithi188.stdout:[mon.c] 2024-09-15T23:24:14.540 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.a] 2024-09-15T23:24:14.541 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.c] 2024-09-15T23:24:14.541 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.b] 2024-09-15T23:24:14.541 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.d] 2024-09-15T23:24:14.541 INFO:teuthology.orchestra.run.smithi188.stdout:[mds] 2024-09-15T23:24:14.541 INFO:teuthology.orchestra.run.smithi188.stdout: debug mds = 20 2024-09-15T23:24:14.541 INFO:teuthology.orchestra.run.smithi188.stdout: debug mds balancer = 20 2024-09-15T23:24:14.541 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2024-09-15T23:24:14.541 INFO:teuthology.orchestra.run.smithi188.stdout: mds cache max size = 1000 2024-09-15T23:24:14.541 INFO:teuthology.orchestra.run.smithi188.stdout: mds debug frag = True 2024-09-15T23:24:14.541 INFO:teuthology.orchestra.run.smithi188.stdout: mds debug scatterstat = True 2024-09-15T23:24:14.541 INFO:teuthology.orchestra.run.smithi188.stdout: mds log max segments = 1 2024-09-15T23:24:14.541 INFO:teuthology.orchestra.run.smithi188.stdout: mds op complaint time = 180 2024-09-15T23:24:14.541 INFO:teuthology.orchestra.run.smithi188.stdout: mds verify scatter = False 2024-09-15T23:24:14.542 INFO:teuthology.orchestra.run.smithi188.stdout: osd op complaint time = 180 2024-09-15T23:24:14.542 INFO:teuthology.orchestra.run.smithi188.stdout: rados mon op timeout = 900 2024-09-15T23:24:14.542 INFO:teuthology.orchestra.run.smithi188.stdout: rados osd op timeout = 900 2024-09-15T23:24:14.544 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T23:24:14.585 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T23:24:14.626 INFO:teuthology.orchestra.run.smithi123.stdout:[global] 2024-09-15T23:24:14.626 INFO:teuthology.orchestra.run.smithi123.stdout: chdir = "" 2024-09-15T23:24:14.626 INFO:teuthology.orchestra.run.smithi123.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T23:24:14.627 INFO:teuthology.orchestra.run.smithi123.stdout: auth supported = cephx 2024-09-15T23:24:14.627 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.627 INFO:teuthology.orchestra.run.smithi123.stdout: filestore xattr use omap = true 2024-09-15T23:24:14.627 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.627 INFO:teuthology.orchestra.run.smithi123.stdout: mon clock drift allowed = 1.000 2024-09-15T23:24:14.627 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.627 INFO:teuthology.orchestra.run.smithi123.stdout: osd crush chooseleaf type = 0 2024-09-15T23:24:14.627 INFO:teuthology.orchestra.run.smithi123.stdout: auth debug = true 2024-09-15T23:24:14.627 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.627 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on old message = true 2024-09-15T23:24:14.627 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on bug = true 2024-09-15T23:24:14.627 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.627 INFO:teuthology.orchestra.run.smithi123.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T23:24:14.628 INFO:teuthology.orchestra.run.smithi123.stdout: mon pg warn max object skew = 0 2024-09-15T23:24:14.628 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.628 INFO:teuthology.orchestra.run.smithi123.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T23:24:14.628 INFO:teuthology.orchestra.run.smithi123.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T23:24:14.628 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.628 INFO:teuthology.orchestra.run.smithi123.stdout: osd pool default size = 2 2024-09-15T23:24:14.628 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.628 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd allow primary affinity = true 2024-09-15T23:24:14.628 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd allow pg remap = true 2024-09-15T23:24:14.628 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on legacy crush tunables = false 2024-09-15T23:24:14.628 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on crush straw calc version zero = false 2024-09-15T23:24:14.628 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on no sortbitwise = false 2024-09-15T23:24:14.628 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on osd down out interval zero = false 2024-09-15T23:24:14.629 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on too few osds = false 2024-09-15T23:24:14.629 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T23:24:14.629 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T23:24:14.629 INFO:teuthology.orchestra.run.smithi123.stdout: mon_allow_pool_size_one = true 2024-09-15T23:24:14.629 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.629 INFO:teuthology.orchestra.run.smithi123.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T23:24:14.629 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.629 INFO:teuthology.orchestra.run.smithi123.stdout: osd default data pool replay window = 5 2024-09-15T23:24:14.629 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.629 INFO:teuthology.orchestra.run.smithi123.stdout: mon allow pool delete = true 2024-09-15T23:24:14.629 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.629 INFO:teuthology.orchestra.run.smithi123.stdout: mon cluster log file level = debug 2024-09-15T23:24:14.629 INFO:teuthology.orchestra.run.smithi123.stdout: debug asserts on shutdown = true 2024-09-15T23:24:14.629 INFO:teuthology.orchestra.run.smithi123.stdout: mon health detail to clog = false 2024-09-15T23:24:14.630 INFO:teuthology.orchestra.run.smithi123.stdout: mon host = "172.21.15.123,172.21.15.188,[v2:172.21.15.188:3301,v1:172.21.15.188:6790]" 2024-09-15T23:24:14.630 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on skipped message = False 2024-09-15T23:24:14.630 INFO:teuthology.orchestra.run.smithi123.stdout: fsid = cb968ac4-8d3a-4b17-a673-6177aeaea589 2024-09-15T23:24:14.630 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.630 INFO:teuthology.orchestra.run.smithi123.stdout:[osd] 2024-09-15T23:24:14.630 INFO:teuthology.orchestra.run.smithi123.stdout: osd journal size = 100 2024-09-15T23:24:14.630 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.630 INFO:teuthology.orchestra.run.smithi123.stdout: osd scrub load threshold = 5.0 2024-09-15T23:24:14.630 INFO:teuthology.orchestra.run.smithi123.stdout: osd scrub max interval = 600 2024-09-15T23:24:14.630 INFO:teuthology.orchestra.run.smithi123.stdout: osd mclock profile = high_recovery_ops 2024-09-15T23:24:14.630 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.630 INFO:teuthology.orchestra.run.smithi123.stdout: osd recover clone overlap = true 2024-09-15T23:24:14.630 INFO:teuthology.orchestra.run.smithi123.stdout: osd recovery max chunk = 1048576 2024-09-15T23:24:14.630 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.631 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug shutdown = true 2024-09-15T23:24:14.631 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug op order = true 2024-09-15T23:24:14.631 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug verify stray on activate = true 2024-09-15T23:24:14.631 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug trim objects = true 2024-09-15T23:24:14.631 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.631 INFO:teuthology.orchestra.run.smithi123.stdout: osd open classes on start = true 2024-09-15T23:24:14.631 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug pg log writeout = true 2024-09-15T23:24:14.631 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.631 INFO:teuthology.orchestra.run.smithi123.stdout: osd deep scrub update digest min age = 30 2024-09-15T23:24:14.631 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.631 INFO:teuthology.orchestra.run.smithi123.stdout: osd map max advance = 10 2024-09-15T23:24:14.631 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.631 INFO:teuthology.orchestra.run.smithi123.stdout: journal zero on create = true 2024-09-15T23:24:14.631 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.632 INFO:teuthology.orchestra.run.smithi123.stdout: filestore ondisk finisher threads = 3 2024-09-15T23:24:14.632 INFO:teuthology.orchestra.run.smithi123.stdout: filestore apply finisher threads = 3 2024-09-15T23:24:14.632 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.632 INFO:teuthology.orchestra.run.smithi123.stdout: bdev debug aio = true 2024-09-15T23:24:14.632 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug misdirected ops = true 2024-09-15T23:24:14.632 INFO:teuthology.orchestra.run.smithi123.stdout: bdev async discard = True 2024-09-15T23:24:14.632 INFO:teuthology.orchestra.run.smithi123.stdout: bdev enable discard = True 2024-09-15T23:24:14.632 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore allocator = bitmap 2024-09-15T23:24:14.632 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore block size = 96636764160 2024-09-15T23:24:14.632 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore fsck on mount = True 2024-09-15T23:24:14.632 INFO:teuthology.orchestra.run.smithi123.stdout: debug bluefs = 1/20 2024-09-15T23:24:14.632 INFO:teuthology.orchestra.run.smithi123.stdout: debug bluestore = 1/20 2024-09-15T23:24:14.632 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-09-15T23:24:14.633 INFO:teuthology.orchestra.run.smithi123.stdout: debug osd = 20 2024-09-15T23:24:14.633 INFO:teuthology.orchestra.run.smithi123.stdout: debug rocksdb = 4/10 2024-09-15T23:24:14.633 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T23:24:14.633 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd full ratio = 0.9 2024-09-15T23:24:14.633 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd nearfull ratio = 0.8 2024-09-15T23:24:14.633 INFO:teuthology.orchestra.run.smithi123.stdout: osd failsafe full ratio = 0.95 2024-09-15T23:24:14.633 INFO:teuthology.orchestra.run.smithi123.stdout: osd objectstore = bluestore 2024-09-15T23:24:14.633 INFO:teuthology.orchestra.run.smithi123.stdout: osd op complaint time = 180 2024-09-15T23:24:14.633 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.633 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr] 2024-09-15T23:24:14.633 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-09-15T23:24:14.633 INFO:teuthology.orchestra.run.smithi123.stdout: debug mgr = 20 2024-09-15T23:24:14.633 INFO:teuthology.orchestra.run.smithi123.stdout: debug mon = 20 2024-09-15T23:24:14.634 INFO:teuthology.orchestra.run.smithi123.stdout: debug auth = 20 2024-09-15T23:24:14.634 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:24:14.634 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:24:14.634 INFO:teuthology.orchestra.run.smithi123.stdout: mgr/telemetry/nag = false 2024-09-15T23:24:14.634 INFO:teuthology.orchestra.run.smithi123.stdout: debug client = 20 2024-09-15T23:24:14.634 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.634 INFO:teuthology.orchestra.run.smithi123.stdout:[mon] 2024-09-15T23:24:14.634 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-09-15T23:24:14.634 INFO:teuthology.orchestra.run.smithi123.stdout: debug mon = 20 2024-09-15T23:24:14.634 INFO:teuthology.orchestra.run.smithi123.stdout: debug paxos = 20 2024-09-15T23:24:14.634 INFO:teuthology.orchestra.run.smithi123.stdout: debug auth = 20 2024-09-15T23:24:14.634 INFO:teuthology.orchestra.run.smithi123.stdout: mon data avail warn = 5 2024-09-15T23:24:14.634 INFO:teuthology.orchestra.run.smithi123.stdout: mon mgr mkfs grace = 240 2024-09-15T23:24:14.634 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:24:14.635 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd reporter subtree level = osd 2024-09-15T23:24:14.635 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd prime pg temp = true 2024-09-15T23:24:14.635 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:24:14.635 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.635 INFO:teuthology.orchestra.run.smithi123.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T23:24:14.635 INFO:teuthology.orchestra.run.smithi123.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T23:24:14.635 INFO:teuthology.orchestra.run.smithi123.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T23:24:14.635 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.635 INFO:teuthology.orchestra.run.smithi123.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T23:24:14.635 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T23:24:14.635 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T23:24:14.635 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.635 INFO:teuthology.orchestra.run.smithi123.stdout: # 1m isn't quite enough 2024-09-15T23:24:14.636 INFO:teuthology.orchestra.run.smithi123.stdout: mon_down_mkfs_grace = 2m 2024-09-15T23:24:14.636 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.636 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_filestore_osds = false 2024-09-15T23:24:14.636 INFO:teuthology.orchestra.run.smithi123.stdout: mon down mkfs grace = 300 2024-09-15T23:24:14.636 INFO:teuthology.orchestra.run.smithi123.stdout: mon op complaint time = 120 2024-09-15T23:24:14.636 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on pool no app = False 2024-09-15T23:24:14.636 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:14.636 INFO:teuthology.orchestra.run.smithi123.stdout:[client] 2024-09-15T23:24:14.636 INFO:teuthology.orchestra.run.smithi123.stdout: rgw cache enabled = true 2024-09-15T23:24:14.636 INFO:teuthology.orchestra.run.smithi123.stdout: rgw enable ops log = true 2024-09-15T23:24:14.636 INFO:teuthology.orchestra.run.smithi123.stdout: rgw enable usage log = true 2024-09-15T23:24:14.636 INFO:teuthology.orchestra.run.smithi123.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T23:24:14.636 INFO:teuthology.orchestra.run.smithi123.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T23:24:14.636 INFO:teuthology.orchestra.run.smithi123.stdout: client mount timeout = 600 2024-09-15T23:24:14.637 INFO:teuthology.orchestra.run.smithi123.stdout: debug client = 20 2024-09-15T23:24:14.637 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-09-15T23:24:14.637 INFO:teuthology.orchestra.run.smithi123.stdout: pid file = "" 2024-09-15T23:24:14.637 INFO:teuthology.orchestra.run.smithi123.stdout: rados mon op timeout = 900 2024-09-15T23:24:14.637 INFO:teuthology.orchestra.run.smithi123.stdout: rados osd op timeout = 900 2024-09-15T23:24:14.637 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.a] 2024-09-15T23:24:14.637 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.b] 2024-09-15T23:24:14.637 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.c] 2024-09-15T23:24:14.637 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.a] 2024-09-15T23:24:14.637 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.c] 2024-09-15T23:24:14.637 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.b] 2024-09-15T23:24:14.637 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.d] 2024-09-15T23:24:14.637 INFO:teuthology.orchestra.run.smithi123.stdout:[mds] 2024-09-15T23:24:14.637 INFO:teuthology.orchestra.run.smithi123.stdout: debug mds = 20 2024-09-15T23:24:14.638 INFO:teuthology.orchestra.run.smithi123.stdout: debug mds balancer = 20 2024-09-15T23:24:14.638 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-09-15T23:24:14.638 INFO:teuthology.orchestra.run.smithi123.stdout: mds cache max size = 1000 2024-09-15T23:24:14.638 INFO:teuthology.orchestra.run.smithi123.stdout: mds debug frag = True 2024-09-15T23:24:14.638 INFO:teuthology.orchestra.run.smithi123.stdout: mds debug scatterstat = False 2024-09-15T23:24:14.638 INFO:teuthology.orchestra.run.smithi123.stdout: mds log max segments = 1 2024-09-15T23:24:14.638 INFO:teuthology.orchestra.run.smithi123.stdout: mds op complaint time = 180 2024-09-15T23:24:14.638 INFO:teuthology.orchestra.run.smithi123.stdout: mds verify scatter = False 2024-09-15T23:24:14.638 INFO:teuthology.orchestra.run.smithi123.stdout: osd op complaint time = 180 2024-09-15T23:24:14.638 INFO:teuthology.orchestra.run.smithi123.stdout: rados mon op timeout = 900 2024-09-15T23:24:14.638 INFO:teuthology.orchestra.run.smithi123.stdout: rados osd op timeout = 900 2024-09-15T23:24:14.639 INFO:teuthology.orchestra.run.smithi188.stdout:[global] 2024-09-15T23:24:14.639 INFO:teuthology.orchestra.run.smithi188.stdout: chdir = "" 2024-09-15T23:24:14.639 INFO:teuthology.orchestra.run.smithi188.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T23:24:14.639 INFO:teuthology.orchestra.run.smithi188.stdout: auth supported = cephx 2024-09-15T23:24:14.639 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.639 INFO:teuthology.orchestra.run.smithi188.stdout: filestore xattr use omap = true 2024-09-15T23:24:14.639 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.640 INFO:teuthology.orchestra.run.smithi188.stdout: mon clock drift allowed = 1.000 2024-09-15T23:24:14.640 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.640 INFO:teuthology.orchestra.run.smithi188.stdout: osd crush chooseleaf type = 0 2024-09-15T23:24:14.640 INFO:teuthology.orchestra.run.smithi188.stdout: auth debug = true 2024-09-15T23:24:14.640 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.640 INFO:teuthology.orchestra.run.smithi188.stdout: ms die on old message = true 2024-09-15T23:24:14.640 INFO:teuthology.orchestra.run.smithi188.stdout: ms die on bug = true 2024-09-15T23:24:14.640 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.640 INFO:teuthology.orchestra.run.smithi188.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T23:24:14.640 INFO:teuthology.orchestra.run.smithi188.stdout: mon pg warn max object skew = 0 2024-09-15T23:24:14.640 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.640 INFO:teuthology.orchestra.run.smithi188.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T23:24:14.640 INFO:teuthology.orchestra.run.smithi188.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T23:24:14.641 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.641 INFO:teuthology.orchestra.run.smithi188.stdout: osd pool default size = 2 2024-09-15T23:24:14.641 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.641 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd allow primary affinity = true 2024-09-15T23:24:14.641 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd allow pg remap = true 2024-09-15T23:24:14.641 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on legacy crush tunables = false 2024-09-15T23:24:14.641 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on crush straw calc version zero = false 2024-09-15T23:24:14.641 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on no sortbitwise = false 2024-09-15T23:24:14.641 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on osd down out interval zero = false 2024-09-15T23:24:14.641 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on too few osds = false 2024-09-15T23:24:14.641 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T23:24:14.641 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T23:24:14.641 INFO:teuthology.orchestra.run.smithi188.stdout: mon_allow_pool_size_one = true 2024-09-15T23:24:14.642 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.642 INFO:teuthology.orchestra.run.smithi188.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T23:24:14.642 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.642 INFO:teuthology.orchestra.run.smithi188.stdout: osd default data pool replay window = 5 2024-09-15T23:24:14.642 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.642 INFO:teuthology.orchestra.run.smithi188.stdout: mon allow pool delete = true 2024-09-15T23:24:14.642 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.642 INFO:teuthology.orchestra.run.smithi188.stdout: mon cluster log file level = debug 2024-09-15T23:24:14.642 INFO:teuthology.orchestra.run.smithi188.stdout: debug asserts on shutdown = true 2024-09-15T23:24:14.642 INFO:teuthology.orchestra.run.smithi188.stdout: mon health detail to clog = false 2024-09-15T23:24:14.642 INFO:teuthology.orchestra.run.smithi188.stdout: mon host = "172.21.15.123,172.21.15.188,[v2:172.21.15.188:3301,v1:172.21.15.188:6790]" 2024-09-15T23:24:14.642 INFO:teuthology.orchestra.run.smithi188.stdout: ms die on skipped message = False 2024-09-15T23:24:14.642 INFO:teuthology.orchestra.run.smithi188.stdout: fsid = cb968ac4-8d3a-4b17-a673-6177aeaea589 2024-09-15T23:24:14.643 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.643 INFO:teuthology.orchestra.run.smithi188.stdout:[osd] 2024-09-15T23:24:14.643 INFO:teuthology.orchestra.run.smithi188.stdout: osd journal size = 100 2024-09-15T23:24:14.643 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.643 INFO:teuthology.orchestra.run.smithi188.stdout: osd scrub load threshold = 5.0 2024-09-15T23:24:14.643 INFO:teuthology.orchestra.run.smithi188.stdout: osd scrub max interval = 600 2024-09-15T23:24:14.643 INFO:teuthology.orchestra.run.smithi188.stdout: osd mclock profile = high_recovery_ops 2024-09-15T23:24:14.643 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.643 INFO:teuthology.orchestra.run.smithi188.stdout: osd recover clone overlap = true 2024-09-15T23:24:14.643 INFO:teuthology.orchestra.run.smithi188.stdout: osd recovery max chunk = 1048576 2024-09-15T23:24:14.643 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.643 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug shutdown = true 2024-09-15T23:24:14.643 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug op order = true 2024-09-15T23:24:14.643 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug verify stray on activate = true 2024-09-15T23:24:14.644 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug trim objects = true 2024-09-15T23:24:14.644 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.644 INFO:teuthology.orchestra.run.smithi188.stdout: osd open classes on start = true 2024-09-15T23:24:14.644 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug pg log writeout = true 2024-09-15T23:24:14.644 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.644 INFO:teuthology.orchestra.run.smithi188.stdout: osd deep scrub update digest min age = 30 2024-09-15T23:24:14.644 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.644 INFO:teuthology.orchestra.run.smithi188.stdout: osd map max advance = 10 2024-09-15T23:24:14.644 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.644 INFO:teuthology.orchestra.run.smithi188.stdout: journal zero on create = true 2024-09-15T23:24:14.644 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.644 INFO:teuthology.orchestra.run.smithi188.stdout: filestore ondisk finisher threads = 3 2024-09-15T23:24:14.644 INFO:teuthology.orchestra.run.smithi188.stdout: filestore apply finisher threads = 3 2024-09-15T23:24:14.645 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.645 INFO:teuthology.orchestra.run.smithi188.stdout: bdev debug aio = true 2024-09-15T23:24:14.645 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug misdirected ops = true 2024-09-15T23:24:14.645 INFO:teuthology.orchestra.run.smithi188.stdout: bdev async discard = True 2024-09-15T23:24:14.645 INFO:teuthology.orchestra.run.smithi188.stdout: bdev enable discard = True 2024-09-15T23:24:14.645 INFO:teuthology.orchestra.run.smithi188.stdout: bluestore allocator = bitmap 2024-09-15T23:24:14.645 INFO:teuthology.orchestra.run.smithi188.stdout: bluestore block size = 96636764160 2024-09-15T23:24:14.645 INFO:teuthology.orchestra.run.smithi188.stdout: bluestore fsck on mount = True 2024-09-15T23:24:14.645 INFO:teuthology.orchestra.run.smithi188.stdout: debug bluefs = 1/20 2024-09-15T23:24:14.645 INFO:teuthology.orchestra.run.smithi188.stdout: debug bluestore = 1/20 2024-09-15T23:24:14.645 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2024-09-15T23:24:14.645 INFO:teuthology.orchestra.run.smithi188.stdout: debug osd = 20 2024-09-15T23:24:14.645 INFO:teuthology.orchestra.run.smithi188.stdout: debug rocksdb = 4/10 2024-09-15T23:24:14.645 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T23:24:14.646 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd full ratio = 0.9 2024-09-15T23:24:14.646 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd nearfull ratio = 0.8 2024-09-15T23:24:14.646 INFO:teuthology.orchestra.run.smithi188.stdout: osd failsafe full ratio = 0.95 2024-09-15T23:24:14.646 INFO:teuthology.orchestra.run.smithi188.stdout: osd objectstore = bluestore 2024-09-15T23:24:14.646 INFO:teuthology.orchestra.run.smithi188.stdout: osd op complaint time = 180 2024-09-15T23:24:14.646 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.646 INFO:teuthology.orchestra.run.smithi188.stdout:[mgr] 2024-09-15T23:24:14.646 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2024-09-15T23:24:14.646 INFO:teuthology.orchestra.run.smithi188.stdout: debug mgr = 20 2024-09-15T23:24:14.646 INFO:teuthology.orchestra.run.smithi188.stdout: debug mon = 20 2024-09-15T23:24:14.646 INFO:teuthology.orchestra.run.smithi188.stdout: debug auth = 20 2024-09-15T23:24:14.646 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:24:14.646 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:24:14.646 INFO:teuthology.orchestra.run.smithi188.stdout: mgr/telemetry/nag = false 2024-09-15T23:24:14.647 INFO:teuthology.orchestra.run.smithi188.stdout: debug client = 20 2024-09-15T23:24:14.647 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.647 INFO:teuthology.orchestra.run.smithi188.stdout:[mon] 2024-09-15T23:24:14.647 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2024-09-15T23:24:14.647 INFO:teuthology.orchestra.run.smithi188.stdout: debug mon = 20 2024-09-15T23:24:14.647 INFO:teuthology.orchestra.run.smithi188.stdout: debug paxos = 20 2024-09-15T23:24:14.647 INFO:teuthology.orchestra.run.smithi188.stdout: debug auth = 20 2024-09-15T23:24:14.647 INFO:teuthology.orchestra.run.smithi188.stdout: mon data avail warn = 5 2024-09-15T23:24:14.647 INFO:teuthology.orchestra.run.smithi188.stdout: mon mgr mkfs grace = 240 2024-09-15T23:24:14.647 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min pgs per osd = 4 2024-09-15T23:24:14.647 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd reporter subtree level = osd 2024-09-15T23:24:14.647 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd prime pg temp = true 2024-09-15T23:24:14.647 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min bytes per osd = 10 2024-09-15T23:24:14.647 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.647 INFO:teuthology.orchestra.run.smithi188.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T23:24:14.648 INFO:teuthology.orchestra.run.smithi188.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T23:24:14.648 INFO:teuthology.orchestra.run.smithi188.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T23:24:14.648 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.648 INFO:teuthology.orchestra.run.smithi188.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T23:24:14.648 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T23:24:14.648 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T23:24:14.648 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.648 INFO:teuthology.orchestra.run.smithi188.stdout: # 1m isn't quite enough 2024-09-15T23:24:14.648 INFO:teuthology.orchestra.run.smithi188.stdout: mon_down_mkfs_grace = 2m 2024-09-15T23:24:14.648 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.648 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_filestore_osds = false 2024-09-15T23:24:14.648 INFO:teuthology.orchestra.run.smithi188.stdout: mon down mkfs grace = 300 2024-09-15T23:24:14.648 INFO:teuthology.orchestra.run.smithi188.stdout: mon op complaint time = 120 2024-09-15T23:24:14.648 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on pool no app = False 2024-09-15T23:24:14.649 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-09-15T23:24:14.649 INFO:teuthology.orchestra.run.smithi188.stdout:[client] 2024-09-15T23:24:14.649 INFO:teuthology.orchestra.run.smithi188.stdout: rgw cache enabled = true 2024-09-15T23:24:14.649 INFO:teuthology.orchestra.run.smithi188.stdout: rgw enable ops log = true 2024-09-15T23:24:14.649 INFO:teuthology.orchestra.run.smithi188.stdout: rgw enable usage log = true 2024-09-15T23:24:14.649 INFO:teuthology.orchestra.run.smithi188.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T23:24:14.649 INFO:teuthology.orchestra.run.smithi188.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T23:24:14.649 INFO:teuthology.orchestra.run.smithi188.stdout: client mount timeout = 600 2024-09-15T23:24:14.649 INFO:teuthology.orchestra.run.smithi188.stdout: debug client = 20 2024-09-15T23:24:14.649 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2024-09-15T23:24:14.649 INFO:teuthology.orchestra.run.smithi188.stdout: pid file = "" 2024-09-15T23:24:14.649 INFO:teuthology.orchestra.run.smithi188.stdout: rados mon op timeout = 900 2024-09-15T23:24:14.649 INFO:teuthology.orchestra.run.smithi188.stdout: rados osd op timeout = 900 2024-09-15T23:24:14.650 INFO:teuthology.orchestra.run.smithi188.stdout:[mon.a] 2024-09-15T23:24:14.650 INFO:teuthology.orchestra.run.smithi188.stdout:[mon.b] 2024-09-15T23:24:14.650 INFO:teuthology.orchestra.run.smithi188.stdout:[mon.c] 2024-09-15T23:24:14.650 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.a] 2024-09-15T23:24:14.650 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.c] 2024-09-15T23:24:14.650 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.b] 2024-09-15T23:24:14.650 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.d] 2024-09-15T23:24:14.650 INFO:teuthology.orchestra.run.smithi188.stdout:[mds] 2024-09-15T23:24:14.650 INFO:teuthology.orchestra.run.smithi188.stdout: debug mds = 20 2024-09-15T23:24:14.650 INFO:teuthology.orchestra.run.smithi188.stdout: debug mds balancer = 20 2024-09-15T23:24:14.650 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2024-09-15T23:24:14.650 INFO:teuthology.orchestra.run.smithi188.stdout: mds cache max size = 1000 2024-09-15T23:24:14.650 INFO:teuthology.orchestra.run.smithi188.stdout: mds debug frag = True 2024-09-15T23:24:14.650 INFO:teuthology.orchestra.run.smithi188.stdout: mds debug scatterstat = False 2024-09-15T23:24:14.650 INFO:teuthology.orchestra.run.smithi188.stdout: mds log max segments = 1 2024-09-15T23:24:14.651 INFO:teuthology.orchestra.run.smithi188.stdout: mds op complaint time = 180 2024-09-15T23:24:14.651 INFO:teuthology.orchestra.run.smithi188.stdout: mds verify scatter = False 2024-09-15T23:24:14.651 INFO:teuthology.orchestra.run.smithi188.stdout: osd op complaint time = 180 2024-09-15T23:24:14.651 INFO:teuthology.orchestra.run.smithi188.stdout: rados mon op timeout = 900 2024-09-15T23:24:14.651 INFO:teuthology.orchestra.run.smithi188.stdout: rados osd op timeout = 900 2024-09-15T23:24:14.652 DEBUG:teuthology.orchestra.run.smithi123:> stdin-killer -- python3 -c ' 2024-09-15T23:24:14.652 DEBUG:teuthology.orchestra.run.smithi123:> import os 2024-09-15T23:24:14.653 DEBUG:teuthology.orchestra.run.smithi123:> import stat 2024-09-15T23:24:14.653 DEBUG:teuthology.orchestra.run.smithi123:> import json 2024-09-15T23:24:14.653 DEBUG:teuthology.orchestra.run.smithi123:> import sys 2024-09-15T23:24:14.653 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-15T23:24:14.653 DEBUG:teuthology.orchestra.run.smithi123:> try: 2024-09-15T23:24:14.653 DEBUG:teuthology.orchestra.run.smithi123:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2024-09-15T23:24:14.653 DEBUG:teuthology.orchestra.run.smithi123:> except OSError as e: 2024-09-15T23:24:14.653 DEBUG:teuthology.orchestra.run.smithi123:> sys.exit(e.errno) 2024-09-15T23:24:14.653 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-15T23:24:14.653 DEBUG:teuthology.orchestra.run.smithi123:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-15T23:24:14.653 DEBUG:teuthology.orchestra.run.smithi123:> print(json.dumps( 2024-09-15T23:24:14.653 DEBUG:teuthology.orchestra.run.smithi123:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-15T23:24:14.653 DEBUG:teuthology.orchestra.run.smithi123:> indent=2)) 2024-09-15T23:24:14.653 DEBUG:teuthology.orchestra.run.smithi123:> ' 2024-09-15T23:24:14.758 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:24:14.759 INFO:teuthology.orchestra.run.smithi123.stdout: "st_mode": 33188, 2024-09-15T23:24:14.759 INFO:teuthology.orchestra.run.smithi123.stdout: "st_ino": 1099511627777, 2024-09-15T23:24:14.759 INFO:teuthology.orchestra.run.smithi123.stdout: "st_dev": 41, 2024-09-15T23:24:14.759 INFO:teuthology.orchestra.run.smithi123.stdout: "st_nlink": 1, 2024-09-15T23:24:14.759 INFO:teuthology.orchestra.run.smithi123.stdout: "st_uid": 1000, 2024-09-15T23:24:14.759 INFO:teuthology.orchestra.run.smithi123.stdout: "st_gid": 1333, 2024-09-15T23:24:14.759 INFO:teuthology.orchestra.run.smithi123.stdout: "st_size": 6291456, 2024-09-15T23:24:14.759 INFO:teuthology.orchestra.run.smithi123.stdout: "st_atime": 1726442654.4362135, 2024-09-15T23:24:14.759 INFO:teuthology.orchestra.run.smithi123.stdout: "st_mtime": 1726442654.455213, 2024-09-15T23:24:14.759 INFO:teuthology.orchestra.run.smithi123.stdout: "st_ctime": 1726442654.455213 2024-09-15T23:24:14.759 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:24:14.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:24:14.767 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:24:14.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.904+0000 7fba3084c640 1 Processor -- start 2024-09-15T23:24:14.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.904+0000 7fba3084c640 1 -- start start 2024-09-15T23:24:14.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.905+0000 7fba3084c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fba2c0b6970 0x7fba2c0b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:14.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.905+0000 7fba3084c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fba2c0d23b0 0x7fba2c0b8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:14.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.905+0000 7fba3084c640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba2c0d0e70 con 0x7fba2c15ed20 2024-09-15T23:24:14.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.905+0000 7fba3084c640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fba2c0d41c0 con 0x7fba2c0d23b0 2024-09-15T23:24:14.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.905+0000 7fba3084c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fba2c0d35b0 con 0x7fba2c0b6970 2024-09-15T23:24:14.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.905+0000 7fba2ad9d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fba2c0d23b0 0x7fba2c0b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:14.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.905+0000 7fba2a59c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fba2c15ed20 0x7fba2c0b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39234/0 (socket says 172.21.15.123:39234) 2024-09-15T23:24:14.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.905+0000 7fba2a59c640 1 -- 172.21.15.123:0/685580794 learned_addr learned my addr 172.21.15.123:0/685580794 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:14.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.906+0000 7fba2ad9d640 1 -- 172.21.15.123:0/685580794 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fba2c0b6970 msgr2=0x7fba2c0b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:14.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.906+0000 7fba2ad9d640 1 --2- 172.21.15.123:0/685580794 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fba2c0b6970 0x7fba2c0b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:14.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.906+0000 7fba2ad9d640 1 -- 172.21.15.123:0/685580794 >> v1:172.21.15.123:6789/0 conn(0x7fba2c15ed20 legacy=0x7fba2c0b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:14.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.906+0000 7fba2ad9d640 1 -- 172.21.15.123:0/685580794 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba2c0d3890 con 0x7fba2c0d23b0 2024-09-15T23:24:14.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.906+0000 7fba2959a640 1 -- 172.21.15.123:0/685580794 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1633038272 0 0) 0x7fba1c001490 con 0x7fba2c15ed20 2024-09-15T23:24:14.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.906+0000 7fba2ad9d640 1 --2- 172.21.15.123:0/685580794 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba2c0d23b0 0x7fba2c0b8610 secure :-1 s=READY pgs=2409 cs=0 l=1 rev1=1 crypto rx=0x7fba240097a0 tx=0x7fba2402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bea76f5b4a64d3b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:14.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.907+0000 7fba2959a640 1 -- 172.21.15.123:0/685580794 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba24037070 con 0x7fba2c0d23b0 2024-09-15T23:24:14.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.907+0000 7fba2959a640 1 -- 172.21.15.123:0/685580794 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba2402ae50 con 0x7fba2c0d23b0 2024-09-15T23:24:14.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.907+0000 7fba2959a640 1 -- 172.21.15.123:0/685580794 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba24032660 con 0x7fba2c0d23b0 2024-09-15T23:24:14.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.907+0000 7fba3084c640 1 -- 172.21.15.123:0/685580794 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba2c0d23b0 msgr2=0x7fba2c0b8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:14.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.907+0000 7fba3084c640 1 --2- 172.21.15.123:0/685580794 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba2c0d23b0 0x7fba2c0b8610 secure :-1 s=READY pgs=2409 cs=0 l=1 rev1=1 crypto rx=0x7fba240097a0 tx=0x7fba2402a100 comp rx=0 tx=0).stop 2024-09-15T23:24:14.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.907+0000 7fba3084c640 1 -- 172.21.15.123:0/685580794 shutdown_connections 2024-09-15T23:24:14.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.907+0000 7fba3084c640 1 --2- 172.21.15.123:0/685580794 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba2c0d23b0 0x7fba2c0b8610 unknown :-1 s=CLOSED pgs=2409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:14.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.907+0000 7fba3084c640 1 --2- 172.21.15.123:0/685580794 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fba2c0b6970 0x7fba2c0b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:14.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.907+0000 7fba3084c640 1 -- 172.21.15.123:0/685580794 >> 172.21.15.123:0/685580794 conn(0x7fba2c0d1260 msgr2=0x7fba2c0d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:14.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.907+0000 7fba3084c640 1 -- 172.21.15.123:0/685580794 shutdown_connections 2024-09-15T23:24:14.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.907+0000 7fba3084c640 1 -- 172.21.15.123:0/685580794 wait complete. 2024-09-15T23:24:14.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.909+0000 7fba3084c640 1 Processor -- start 2024-09-15T23:24:14.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.909+0000 7fba3084c640 1 -- start start 2024-09-15T23:24:14.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.909+0000 7fba3084c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba2c0b6970 0x7fba2c0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:14.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.909+0000 7fba3084c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fba2c0d23b0 0x7fba2c154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:14.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.909+0000 7fba3084c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba2c15ed20 0x7fba2c1f8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:14.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.909+0000 7fba3084c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fba2c0d32a0 con 0x7fba2c0b6970 2024-09-15T23:24:14.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.909+0000 7fba3084c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fba2c0d3e50 con 0x7fba2c15ed20 2024-09-15T23:24:14.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.909+0000 7fba3084c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fba2c15f100 con 0x7fba2c0d23b0 2024-09-15T23:24:14.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.909+0000 7fba2a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba2c0b6970 0x7fba2c0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:14.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.909+0000 7fba2a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba2c0b6970 0x7fba2c0cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39226/0 (socket says 172.21.15.123:39226) 2024-09-15T23:24:14.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.909+0000 7fba2a59c640 1 -- 172.21.15.123:0/2641160208 learned_addr learned my addr 172.21.15.123:0/2641160208 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:14.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.910+0000 7fba2a59c640 1 -- 172.21.15.123:0/2641160208 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fba2c0d23b0 msgr2=0x7fba2c154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:14.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.910+0000 7fba2a59c640 1 --2- 172.21.15.123:0/2641160208 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fba2c0d23b0 0x7fba2c154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:14.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.910+0000 7fba2a59c640 1 -- 172.21.15.123:0/2641160208 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba2c15ed20 msgr2=0x7fba2c1f8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:14.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.910+0000 7fba2a59c640 1 --2- 172.21.15.123:0/2641160208 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba2c15ed20 0x7fba2c1f8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:14.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.910+0000 7fba2a59c640 1 -- 172.21.15.123:0/2641160208 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba2c1f9150 con 0x7fba2c0b6970 2024-09-15T23:24:14.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.910+0000 7fba2a59c640 1 --2- 172.21.15.123:0/2641160208 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba2c0b6970 0x7fba2c0cdcf0 secure :-1 s=READY pgs=2410 cs=0 l=1 rev1=1 crypto rx=0x7fba1c00c7c0 tx=0x7fba1c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:14.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.910+0000 7fba1affd640 1 -- 172.21.15.123:0/2641160208 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1c018070 con 0x7fba2c0b6970 2024-09-15T23:24:14.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.910+0000 7fba1affd640 1 -- 172.21.15.123:0/2641160208 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba1c00a5e0 con 0x7fba2c0b6970 2024-09-15T23:24:14.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.910+0000 7fba3084c640 1 -- 172.21.15.123:0/2641160208 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba2c0ccc50 con 0x7fba2c0b6970 2024-09-15T23:24:14.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.910+0000 7fba1affd640 1 -- 172.21.15.123:0/2641160208 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1c00a9d0 con 0x7fba2c0b6970 2024-09-15T23:24:14.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.910+0000 7fba3084c640 1 -- 172.21.15.123:0/2641160208 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba2c0cd210 con 0x7fba2c0b6970 2024-09-15T23:24:14.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.911+0000 7fba3084c640 1 -- 172.21.15.123:0/2641160208 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba2c0b7010 con 0x7fba2c0b6970 2024-09-15T23:24:14.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.911+0000 7fba1affd640 1 -- 172.21.15.123:0/2641160208 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fba1c01b070 con 0x7fba2c0b6970 2024-09-15T23:24:14.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.912+0000 7fba1affd640 1 --2- 172.21.15.123:0/2641160208 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fba0c06c2b0 0x7fba0c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:14.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.912+0000 7fba1affd640 1 -- 172.21.15.123:0/2641160208 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 5709+0+0 (secure 0 0 0) 0x7fba1c08aa10 con 0x7fba2c0b6970 2024-09-15T23:24:14.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.912+0000 7fba29d9b640 1 --2- 172.21.15.123:0/2641160208 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fba0c06c2b0 0x7fba0c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:14.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.913+0000 7fba29d9b640 1 --2- 172.21.15.123:0/2641160208 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fba0c06c2b0 0x7fba0c06e770 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fba2c15bf90 tx=0x7fba20006c90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:14.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:14.916+0000 7fba1affd640 1 -- 172.21.15.123:0/2641160208 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fba2c1f9150 con 0x7fba2c0b6970 2024-09-15T23:24:15.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.117+0000 7fba3084c640 1 -- 172.21.15.123:0/2641160208 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba2c0b3f20 con 0x7fba2c0b6970 2024-09-15T23:24:15.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.118+0000 7fba1affd640 1 -- 172.21.15.123:0/2641160208 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 127 v127) ==== 95+0+5247 (secure 0 0 0) 0x7fba2c0d0e70 con 0x7fba2c0b6970 2024-09-15T23:24:15.119 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:15.119 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":127,"btime":"2024-09-15T23:24:06:331850+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7922,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/173351117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":173351117},{"type":"v1","addr":"172.21.15.123:6835","nonce":173351117}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123},{"gid":7928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/4283187910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":4283187910},{"type":"v1","addr":"172.21.15.188:6837","nonce":4283187910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123},{"gid":9061,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/3180373488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3180373488},{"type":"v1","addr":"172.21.15.188:6836","nonce":3180373488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123}],"filesystems":[{"mdsmap":{"epoch":127,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:24:03.556320+0000","modified":"2024-09-15T23:24:05.658884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10905},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10905":{"gid":10905,"name":"c","rank":0,"incarnation":124,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6834/1661365546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":1661365546},{"type":"v1","addr":"172.21.15.123:6834","nonce":1661365546}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10905,"qdb_cluster":[10905]},"id":14}]} 2024-09-15T23:24:15.119 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 127 2024-09-15T23:24:15.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.119+0000 7fba3084c640 1 -- 172.21.15.123:0/2641160208 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fba0c06c2b0 msgr2=0x7fba0c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:15.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.119+0000 7fba3084c640 1 --2- 172.21.15.123:0/2641160208 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fba0c06c2b0 0x7fba0c06e770 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fba2c15bf90 tx=0x7fba20006c90 comp rx=0 tx=0).stop 2024-09-15T23:24:15.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.119+0000 7fba3084c640 1 -- 172.21.15.123:0/2641160208 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba2c0b6970 msgr2=0x7fba2c0cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:15.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.119+0000 7fba3084c640 1 --2- 172.21.15.123:0/2641160208 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba2c0b6970 0x7fba2c0cdcf0 secure :-1 s=READY pgs=2410 cs=0 l=1 rev1=1 crypto rx=0x7fba1c00c7c0 tx=0x7fba1c00cc80 comp rx=0 tx=0).stop 2024-09-15T23:24:15.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.120+0000 7fba3084c640 1 -- 172.21.15.123:0/2641160208 shutdown_connections 2024-09-15T23:24:15.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.120+0000 7fba3084c640 1 --2- 172.21.15.123:0/2641160208 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fba2c15ed20 0x7fba2c1f8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.120+0000 7fba3084c640 1 --2- 172.21.15.123:0/2641160208 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fba2c0d23b0 0x7fba2c154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.120+0000 7fba3084c640 1 --2- 172.21.15.123:0/2641160208 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fba0c06c2b0 0x7fba0c06e770 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.120+0000 7fba3084c640 1 --2- 172.21.15.123:0/2641160208 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba2c0b6970 0x7fba2c0cdcf0 unknown :-1 s=CLOSED pgs=2410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.120+0000 7fba3084c640 1 -- 172.21.15.123:0/2641160208 >> 172.21.15.123:0/2641160208 conn(0x7fba2c0d1260 msgr2=0x7fba2c0b9e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:15.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.120+0000 7fba3084c640 1 -- 172.21.15.123:0/2641160208 shutdown_connections 2024-09-15T23:24:15.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.120+0000 7fba3084c640 1 -- 172.21.15.123:0/2641160208 wait complete. 2024-09-15T23:24:15.132 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-15T23:24:15.254 INFO:teuthology.orchestra.run.smithi123.stdout:{"message":"","return_code":0} 2024-09-15T23:24:15.254 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-15T23:24:15.254 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent '' 2024-09-15T23:24:15.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.297+0000 7f38c1eeef40 1 Processor -- start 2024-09-15T23:24:15.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.297+0000 7f38c1eeef40 1 -- start start 2024-09-15T23:24:15.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.298+0000 7f38c1eeef40 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5612a3423000 0x5612a34acea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.298+0000 7f38c1eeef40 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5612a343ba00 0x5612a33f3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.298+0000 7f38c1eeef40 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612a34c9080 0x5612a343cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.298+0000 7f38c1eeef40 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5612a33f45a0 con 0x5612a343ba00 2024-09-15T23:24:15.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.298+0000 7f38c1eeef40 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5612a3423410 con 0x5612a34c9080 2024-09-15T23:24:15.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.298+0000 7f38c1eeef40 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5612a33f4840 con 0x5612a3423000 2024-09-15T23:24:15.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.298+0000 7f38bf1e3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5612a343ba00 0x5612a33f3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.298+0000 7f38bf1e3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5612a343ba00 0x5612a33f3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39242/0 (socket says 172.21.15.123:39242) 2024-09-15T23:24:15.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.298+0000 7f38bf1e3640 1 -- 172.21.15.123:0/537760317 learned_addr learned my addr 172.21.15.123:0/537760317 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:15.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.298+0000 7f38bf9e4640 1 --2- 172.21.15.123:0/537760317 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5612a3423000 0x5612a34acea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.298+0000 7f38c01e5640 1 --2- 172.21.15.123:0/537760317 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612a34c9080 0x5612a343cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.298+0000 7f38bf1e3640 1 -- 172.21.15.123:0/537760317 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5612a3423000 msgr2=0x5612a34acea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:15.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.298+0000 7f38bf1e3640 1 --2- 172.21.15.123:0/537760317 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5612a3423000 0x5612a34acea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.298+0000 7f38bf1e3640 1 -- 172.21.15.123:0/537760317 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612a34c9080 msgr2=0x5612a343cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:15.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.298+0000 7f38bf1e3640 1 --2- 172.21.15.123:0/537760317 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612a34c9080 0x5612a343cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.298+0000 7f38bf1e3640 1 -- 172.21.15.123:0/537760317 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612a331ecb0 con 0x5612a343ba00 2024-09-15T23:24:15.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.299+0000 7f38bf1e3640 1 --2- 172.21.15.123:0/537760317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5612a343ba00 0x5612a33f3640 secure :-1 s=READY pgs=2412 cs=0 l=1 rev1=1 crypto rx=0x7f38b400a470 tx=0x7f38b400a930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37cdd8f977892129 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:15.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.299+0000 7f38be1e1640 1 -- 172.21.15.123:0/537760317 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b400b930 con 0x5612a343ba00 2024-09-15T23:24:15.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.299+0000 7f38be1e1640 1 -- 172.21.15.123:0/537760317 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38b400f070 con 0x5612a343ba00 2024-09-15T23:24:15.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.299+0000 7f38be1e1640 1 -- 172.21.15.123:0/537760317 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b400bd30 con 0x5612a343ba00 2024-09-15T23:24:15.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.299+0000 7f38c1eeef40 1 -- 172.21.15.123:0/537760317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5612a343ba00 msgr2=0x5612a33f3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:15.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.299+0000 7f38c1eeef40 1 --2- 172.21.15.123:0/537760317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5612a343ba00 0x5612a33f3640 secure :-1 s=READY pgs=2412 cs=0 l=1 rev1=1 crypto rx=0x7f38b400a470 tx=0x7f38b400a930 comp rx=0 tx=0).stop 2024-09-15T23:24:15.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.299+0000 7f38c1eeef40 1 -- 172.21.15.123:0/537760317 shutdown_connections 2024-09-15T23:24:15.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.299+0000 7f38c1eeef40 1 --2- 172.21.15.123:0/537760317 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612a34c9080 0x5612a343cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.299+0000 7f38c1eeef40 1 --2- 172.21.15.123:0/537760317 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5612a343ba00 0x5612a33f3640 unknown :-1 s=CLOSED pgs=2412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.299+0000 7f38c1eeef40 1 --2- 172.21.15.123:0/537760317 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5612a3423000 0x5612a34acea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.299+0000 7f38c1eeef40 1 -- 172.21.15.123:0/537760317 >> 172.21.15.123:0/537760317 conn(0x5612a3420710 msgr2=0x5612a3420af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:15.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.299+0000 7f38c1eeef40 1 -- 172.21.15.123:0/537760317 shutdown_connections 2024-09-15T23:24:15.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.299+0000 7f38c1eeef40 1 -- 172.21.15.123:0/537760317 wait complete. 2024-09-15T23:24:15.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.300+0000 7f38c1eeef40 1 Processor -- start 2024-09-15T23:24:15.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.300+0000 7f38c1eeef40 1 -- start start 2024-09-15T23:24:15.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.300+0000 7f38c1eeef40 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5612a3423000 0x5612a34a70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.300+0000 7f38c1eeef40 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612a343ba00 0x5612a34c16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.300+0000 7f38c1eeef40 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5612a34c9080 0x5612a34c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.300+0000 7f38c1eeef40 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5612a34a8190 con 0x5612a34c9080 2024-09-15T23:24:15.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.300+0000 7f38c1eeef40 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5612a33f3db0 con 0x5612a343ba00 2024-09-15T23:24:15.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.300+0000 7f38c1eeef40 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5612a34ca500 con 0x5612a3423000 2024-09-15T23:24:15.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.301+0000 7f38c01e5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5612a34c9080 0x5612a34c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.301+0000 7f38c01e5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5612a34c9080 0x5612a34c1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39252/0 (socket says 172.21.15.123:39252) 2024-09-15T23:24:15.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.301+0000 7f38c01e5640 1 -- 172.21.15.123:0/170247264 learned_addr learned my addr 172.21.15.123:0/170247264 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:15.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.301+0000 7f38bf9e4640 1 --2- 172.21.15.123:0/170247264 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5612a3423000 0x5612a34a70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.301+0000 7f38bf1e3640 1 --2- 172.21.15.123:0/170247264 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612a343ba00 0x5612a34c16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.301+0000 7f38c01e5640 1 -- 172.21.15.123:0/170247264 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5612a3423000 msgr2=0x5612a34a70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:15.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.301+0000 7f38c01e5640 1 --2- 172.21.15.123:0/170247264 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5612a3423000 0x5612a34a70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.301+0000 7f38c01e5640 1 -- 172.21.15.123:0/170247264 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612a343ba00 msgr2=0x5612a34c16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:15.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.301+0000 7f38c01e5640 1 --2- 172.21.15.123:0/170247264 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5612a343ba00 0x5612a34c16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.301+0000 7f38c01e5640 1 -- 172.21.15.123:0/170247264 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612a34b0170 con 0x5612a34c9080 2024-09-15T23:24:15.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.301+0000 7f38c01e5640 1 --2- 172.21.15.123:0/170247264 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5612a34c9080 0x5612a34c1bf0 secure :-1 s=READY pgs=2413 cs=0 l=1 rev1=1 crypto rx=0x7f38b800a230 tx=0x7f38b800a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:15.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.301+0000 7f38bd1df640 1 -- 172.21.15.123:0/170247264 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b8015030 con 0x5612a34c9080 2024-09-15T23:24:15.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.301+0000 7f38bd1df640 1 -- 172.21.15.123:0/170247264 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38b8011630 con 0x5612a34c9080 2024-09-15T23:24:15.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.301+0000 7f38c1eeef40 1 -- 172.21.15.123:0/170247264 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612a34b0760 con 0x5612a34c9080 2024-09-15T23:24:15.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.301+0000 7f38bd1df640 1 -- 172.21.15.123:0/170247264 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b8011820 con 0x5612a34c9080 2024-09-15T23:24:15.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.301+0000 7f38c1eeef40 1 -- 172.21.15.123:0/170247264 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612a34bf230 con 0x5612a34c9080 2024-09-15T23:24:15.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.303+0000 7f38bd1df640 1 -- 172.21.15.123:0/170247264 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f38b8018070 con 0x5612a34c9080 2024-09-15T23:24:15.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.303+0000 7f38bd1df640 1 --2- 172.21.15.123:0/170247264 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f38ac06ac90 0x7f38ac06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.303+0000 7f38bd1df640 1 -- 172.21.15.123:0/170247264 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 5709+0+0 (secure 0 0 0) 0x7f38b8089e00 con 0x5612a34c9080 2024-09-15T23:24:15.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.303+0000 7f38bf9e4640 1 --2- 172.21.15.123:0/170247264 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f38ac06ac90 0x7f38ac06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.303+0000 7f38c1eeef40 1 --2- 172.21.15.123:0/170247264 >> [v2:172.21.15.123:6808/290001388,v1:172.21.15.123:6809/290001388] conn(0x5612a34a9460 0x5612a34a9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.303+0000 7f38c1eeef40 1 -- 172.21.15.123:0/170247264 --> [v2:172.21.15.123:6808/290001388,v1:172.21.15.123:6809/290001388] -- osd_op(unknown.0.0:1 29.7 29:e2e07930:::10000000001.00000000:head [setxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e206) -- 0x5612a34ac1e0 con 0x5612a34a9460 2024-09-15T23:24:15.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.303+0000 7f38bf1e3640 1 --2- 172.21.15.123:0/170247264 >> [v2:172.21.15.123:6808/290001388,v1:172.21.15.123:6809/290001388] conn(0x5612a34a9460 0x5612a34a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.304+0000 7f38bf1e3640 1 --2- 172.21.15.123:0/170247264 >> [v2:172.21.15.123:6808/290001388,v1:172.21.15.123:6809/290001388] conn(0x5612a34a9460 0x5612a34a9860 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:15.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.304+0000 7f38bf9e4640 1 --2- 172.21.15.123:0/170247264 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f38ac06ac90 0x7f38ac06d150 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f38b0057000 tx=0x7f38b005e040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:15.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.305+0000 7f38bf1e3640 1 -- 172.21.15.123:0/170247264 <== osd.1 v2:172.21.15.123:6808/290001388 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr] v206'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f38b400c840 con 0x5612a34a9460 2024-09-15T23:24:15.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.305+0000 7f38c1eeef40 1 -- 172.21.15.123:0/170247264 >> [v2:172.21.15.123:6808/290001388,v1:172.21.15.123:6809/290001388] conn(0x5612a34a9460 msgr2=0x5612a34a9860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:15.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.305+0000 7f38c1eeef40 1 --2- 172.21.15.123:0/170247264 >> [v2:172.21.15.123:6808/290001388,v1:172.21.15.123:6809/290001388] conn(0x5612a34a9460 0x5612a34a9860 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.305+0000 7f38c1eeef40 1 -- 172.21.15.123:0/170247264 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f38ac06ac90 msgr2=0x7f38ac06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:15.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.305+0000 7f38c1eeef40 1 --2- 172.21.15.123:0/170247264 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f38ac06ac90 0x7f38ac06d150 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f38b0057000 tx=0x7f38b005e040 comp rx=0 tx=0).stop 2024-09-15T23:24:15.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.305+0000 7f38c1eeef40 1 -- 172.21.15.123:0/170247264 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5612a34c9080 msgr2=0x5612a34c1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:15.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.305+0000 7f38c1eeef40 1 --2- 172.21.15.123:0/170247264 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5612a34c9080 0x5612a34c1bf0 secure :-1 s=READY pgs=2413 cs=0 l=1 rev1=1 crypto rx=0x7f38b800a230 tx=0x7f38b800a6f0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.305+0000 7f38c01e5640 1 -- 172.21.15.123:0/170247264 reap_dead start 2024-09-15T23:24:15.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.305+0000 7f38c1eeef40 1 -- 172.21.15.123:0/170247264 shutdown_connections 2024-09-15T23:24:15.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.305+0000 7f38c1eeef40 1 -- 172.21.15.123:0/170247264 >> 172.21.15.123:0/170247264 conn(0x5612a3420710 msgr2=0x5612a3420af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:15.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.305+0000 7f38c1eeef40 1 -- 172.21.15.123:0/170247264 shutdown_connections 2024-09-15T23:24:15.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.305+0000 7f38c1eeef40 1 -- 172.21.15.123:0/170247264 wait complete. 2024-09-15T23:24:15.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:24:15.311 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.14:0 scrub start / recursive,repair 2024-09-15T23:24:15.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.412+0000 7f405cbe4640 1 Processor -- start 2024-09-15T23:24:15.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.412+0000 7f405cbe4640 1 -- start start 2024-09-15T23:24:15.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.413+0000 7f405cbe4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f40580b6f90 0x7f40580b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.413+0000 7f405cbe4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40580d2540 con 0x7f4058161cf0 2024-09-15T23:24:15.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.413+0000 7f405cbe4640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40580d2820 con 0x7f40581622d0 2024-09-15T23:24:15.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.413+0000 7f405cbe4640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f40581620d0 con 0x7f40580b6f90 2024-09-15T23:24:15.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.413+0000 7f4055d9b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f40580b6f90 0x7f40580b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.413+0000 7f405659c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f4058161cf0 0x7f40580b41e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39248/0 (socket says 172.21.15.123:39248) 2024-09-15T23:24:15.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.413+0000 7f405659c640 1 -- 172.21.15.123:0/3359128414 learned_addr learned my addr 172.21.15.123:0/3359128414 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:15.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.414+0000 7f4055d9b640 1 -- 172.21.15.123:0/3359128414 >> v1:172.21.15.188:6789/0 conn(0x7f40581622d0 legacy=0x7f4058162760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:15.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.414+0000 7f4055d9b640 1 -- 172.21.15.123:0/3359128414 >> v1:172.21.15.123:6789/0 conn(0x7f4058161cf0 legacy=0x7f40580b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:15.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.414+0000 7f4055d9b640 1 -- 172.21.15.123:0/3359128414 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40580d2b00 con 0x7f40580b6f90 2024-09-15T23:24:15.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.414+0000 7f405559a640 1 -- 172.21.15.123:0/3359128414 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2529882346 0 0) 0x7f40580d2540 con 0x7f4058161cf0 2024-09-15T23:24:15.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.414+0000 7f4055d9b640 1 --2- 172.21.15.123:0/3359128414 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40580b6f90 0x7f40580b73d0 secure :-1 s=READY pgs=2415 cs=0 l=1 rev1=1 crypto rx=0x7f404c0097a0 tx=0x7f404c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a5f47e98182032 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:15.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.414+0000 7f405559a640 1 -- 172.21.15.123:0/3359128414 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404c037070 con 0x7f40580b6f90 2024-09-15T23:24:15.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.415+0000 7f405559a640 1 -- 172.21.15.123:0/3359128414 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f404c032440 con 0x7f40580b6f90 2024-09-15T23:24:15.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.415+0000 7f405559a640 1 -- 172.21.15.123:0/3359128414 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404c032810 con 0x7f40580b6f90 2024-09-15T23:24:15.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.415+0000 7f405cbe4640 1 -- 172.21.15.123:0/3359128414 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40580b6f90 msgr2=0x7f40580b73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:15.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.415+0000 7f405cbe4640 1 --2- 172.21.15.123:0/3359128414 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40580b6f90 0x7f40580b73d0 secure :-1 s=READY pgs=2415 cs=0 l=1 rev1=1 crypto rx=0x7f404c0097a0 tx=0x7f404c02a1e0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.415+0000 7f405cbe4640 1 -- 172.21.15.123:0/3359128414 shutdown_connections 2024-09-15T23:24:15.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.415+0000 7f405cbe4640 1 --2- 172.21.15.123:0/3359128414 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40580b6f90 0x7f40580b73d0 unknown :-1 s=CLOSED pgs=2415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.415+0000 7f405cbe4640 1 -- 172.21.15.123:0/3359128414 >> 172.21.15.123:0/3359128414 conn(0x7f4058067950 msgr2=0x7f4058067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:15.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.415+0000 7f405cbe4640 1 -- 172.21.15.123:0/3359128414 shutdown_connections 2024-09-15T23:24:15.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.415+0000 7f405cbe4640 1 -- 172.21.15.123:0/3359128414 wait complete. 2024-09-15T23:24:15.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.416+0000 7f405cbe4640 1 Processor -- start 2024-09-15T23:24:15.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.417+0000 7f405cbe4640 1 -- start start 2024-09-15T23:24:15.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.417+0000 7f405cbe4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f40580b6f90 0x7f40580cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.417+0000 7f405cbe4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4058161cf0 0x7f40580cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.417+0000 7f405cbe4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40581622d0 0x7f40580d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.417+0000 7f405cbe4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f40580d3300 con 0x7f40581622d0 2024-09-15T23:24:15.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.417+0000 7f405cbe4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f40580b4ca0 con 0x7f40580b6f90 2024-09-15T23:24:15.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.417+0000 7f405cbe4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f40580b7910 con 0x7f4058161cf0 2024-09-15T23:24:15.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.417+0000 7f4056d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40581622d0 0x7f40580d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.417+0000 7f4056d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40581622d0 0x7f40580d10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39274/0 (socket says 172.21.15.123:39274) 2024-09-15T23:24:15.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.417+0000 7f4056d9d640 1 -- 172.21.15.123:0/2621822276 learned_addr learned my addr 172.21.15.123:0/2621822276 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:15.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.418+0000 7f4056d9d640 1 -- 172.21.15.123:0/2621822276 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4058161cf0 msgr2=0x7f40580cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:15.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.418+0000 7f405659c640 1 --2- 172.21.15.123:0/2621822276 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f40580b6f90 0x7f40580cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.418+0000 7f4056d9d640 1 --2- 172.21.15.123:0/2621822276 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4058161cf0 0x7f40580cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.418+0000 7f4056d9d640 1 -- 172.21.15.123:0/2621822276 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f40580b6f90 msgr2=0x7f40580cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:15.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.418+0000 7f4056d9d640 1 --2- 172.21.15.123:0/2621822276 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f40580b6f90 0x7f40580cf7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.418+0000 7f4056d9d640 1 -- 172.21.15.123:0/2621822276 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40580d1cb0 con 0x7f40581622d0 2024-09-15T23:24:15.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.418+0000 7f4056d9d640 1 --2- 172.21.15.123:0/2621822276 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40581622d0 0x7f40580d10f0 secure :-1 s=READY pgs=2416 cs=0 l=1 rev1=1 crypto rx=0x7f405000b4c0 tx=0x7f405000b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:15.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.418+0000 7f4046ffd640 1 -- 172.21.15.123:0/2621822276 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4050015020 con 0x7f40581622d0 2024-09-15T23:24:15.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.418+0000 7f4046ffd640 1 -- 172.21.15.123:0/2621822276 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4050011850 con 0x7f40581622d0 2024-09-15T23:24:15.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.418+0000 7f405cbe4640 1 -- 172.21.15.123:0/2621822276 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40580d19d0 con 0x7f40581622d0 2024-09-15T23:24:15.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.418+0000 7f4046ffd640 1 -- 172.21.15.123:0/2621822276 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4050011c40 con 0x7f40581622d0 2024-09-15T23:24:15.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.418+0000 7f405cbe4640 1 -- 172.21.15.123:0/2621822276 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4058157220 con 0x7f40581622d0 2024-09-15T23:24:15.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.419+0000 7f4046ffd640 1 -- 172.21.15.123:0/2621822276 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4050018020 con 0x7f40581622d0 2024-09-15T23:24:15.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.420+0000 7f4046ffd640 1 --2- 172.21.15.123:0/2621822276 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f403806c2b0 0x7f403806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.420+0000 7f4046ffd640 1 -- 172.21.15.123:0/2621822276 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 5709+0+0 (secure 0 0 0) 0x7f405008b2f0 con 0x7f40581622d0 2024-09-15T23:24:15.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.420+0000 7f405659c640 1 --2- 172.21.15.123:0/2621822276 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f403806c2b0 0x7f403806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.421+0000 7f405659c640 1 --2- 172.21.15.123:0/2621822276 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f403806c2b0 0x7f403806e770 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f40480012e0 tx=0x7f4048009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:15.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.421+0000 7f405fa59740 1 Processor -- start 2024-09-15T23:24:15.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.421+0000 7f405fa59740 1 -- start start 2024-09-15T23:24:15.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.422+0000 7f405fa59740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559191695690 0x559191695a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.422+0000 7f405fa59740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559191692e50 0x5591916949e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.422+0000 7f405fa59740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5591916932b0 0x559191675610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.422+0000 7f405fa59740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x559191611000 con 0x559191692e50 2024-09-15T23:24:15.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.422+0000 7f405fa59740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5591915b19f0 con 0x5591916932b0 2024-09-15T23:24:15.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.422+0000 7f405fa59740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x5591915597c0 con 0x559191695690 2024-09-15T23:24:15.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.422+0000 7f4055d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559191692e50 0x5591916949e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.422+0000 7f4055d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559191692e50 0x5591916949e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39276/0 (socket says 172.21.15.123:39276) 2024-09-15T23:24:15.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.422+0000 7f4055d9b640 1 -- 172.21.15.123:0/4170949303 learned_addr learned my addr 172.21.15.123:0/4170949303 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:15.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.422+0000 7f405659c640 1 --2- 172.21.15.123:0/4170949303 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559191695690 0x559191695a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.422+0000 7f4056d9d640 1 --2- 172.21.15.123:0/4170949303 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5591916932b0 0x559191675610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.422+0000 7f4055d9b640 1 -- 172.21.15.123:0/4170949303 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559191695690 msgr2=0x559191695a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:15.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.422+0000 7f4055d9b640 1 --2- 172.21.15.123:0/4170949303 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559191695690 0x559191695a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.422+0000 7f4055d9b640 1 -- 172.21.15.123:0/4170949303 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5591916932b0 msgr2=0x559191675610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:15.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.422+0000 7f4055d9b640 1 --2- 172.21.15.123:0/4170949303 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5591916932b0 0x559191675610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.422+0000 7f4055d9b640 1 -- 172.21.15.123:0/4170949303 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591912a8470 con 0x559191692e50 2024-09-15T23:24:15.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.422+0000 7f4055d9b640 1 --2- 172.21.15.123:0/4170949303 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559191692e50 0x5591916949e0 secure :-1 s=READY pgs=2417 cs=0 l=1 rev1=1 crypto rx=0x7f404c000c00 tx=0x7f404c02c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=696a610be86ae5d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:15.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.423+0000 7f4037fff640 1 -- 172.21.15.123:0/4170949303 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404c041070 con 0x559191692e50 2024-09-15T23:24:15.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.423+0000 7f4037fff640 1 -- 172.21.15.123:0/4170949303 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f404c03c720 con 0x559191692e50 2024-09-15T23:24:15.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.423+0000 7f4037fff640 1 -- 172.21.15.123:0/4170949303 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404c037040 con 0x559191692e50 2024-09-15T23:24:15.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.423+0000 7f405fa59740 1 -- 172.21.15.123:0/4170949303 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559191692e50 msgr2=0x5591916949e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:15.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.423+0000 7f405fa59740 1 --2- 172.21.15.123:0/4170949303 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559191692e50 0x5591916949e0 secure :-1 s=READY pgs=2417 cs=0 l=1 rev1=1 crypto rx=0x7f404c000c00 tx=0x7f404c02c070 comp rx=0 tx=0).stop 2024-09-15T23:24:15.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.423+0000 7f405fa59740 1 -- 172.21.15.123:0/4170949303 shutdown_connections 2024-09-15T23:24:15.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.423+0000 7f405fa59740 1 --2- 172.21.15.123:0/4170949303 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5591916932b0 0x559191675610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.423+0000 7f405fa59740 1 --2- 172.21.15.123:0/4170949303 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559191692e50 0x5591916949e0 unknown :-1 s=CLOSED pgs=2417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.423+0000 7f405fa59740 1 --2- 172.21.15.123:0/4170949303 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559191695690 0x559191695a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.423+0000 7f405fa59740 1 -- 172.21.15.123:0/4170949303 >> 172.21.15.123:0/4170949303 conn(0x55919164b580 msgr2=0x559191693700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:15.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.423+0000 7f405fa59740 1 -- 172.21.15.123:0/4170949303 shutdown_connections 2024-09-15T23:24:15.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.423+0000 7f405fa59740 1 -- 172.21.15.123:0/4170949303 wait complete. 2024-09-15T23:24:15.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.424+0000 7f405fa59740 1 -- start start 2024-09-15T23:24:15.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.424+0000 7f405fa59740 1 Processor -- start 2024-09-15T23:24:15.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.425+0000 7f405fa59740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5591916932b0 0x559191669be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.425+0000 7f405fa59740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559191695690 0x559191690350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.425+0000 7f405fa59740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559191679370 0x559191690890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.425+0000 7f405fa59740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55919153a680 con 0x559191695690 2024-09-15T23:24:15.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.425+0000 7f405fa59740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x5591915ad9b0 con 0x559191679370 2024-09-15T23:24:15.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.425+0000 7f405fa59740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x559191691db0 con 0x5591916932b0 2024-09-15T23:24:15.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.425+0000 7f405fa59740 10 client.0 _ll_register_callbacks cb 0x5591912c3c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:24:15.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.425+0000 7f4055d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559191695690 0x559191690350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.425+0000 7f4055d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559191695690 0x559191690350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39288/0 (socket says 172.21.15.123:39288) 2024-09-15T23:24:15.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.425+0000 7f4055d9b640 1 -- 172.21.15.123:0/1852804052 learned_addr learned my addr 172.21.15.123:0/1852804052 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:15.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.425+0000 7f405659c640 1 --2- 172.21.15.123:0/1852804052 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5591916932b0 0x559191669be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.425+0000 7f4055d9b640 1 -- 172.21.15.123:0/1852804052 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5591916932b0 msgr2=0x559191669be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:15.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.425+0000 7f4055d9b640 1 --2- 172.21.15.123:0/1852804052 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5591916932b0 0x559191669be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.425+0000 7f4055d9b640 1 -- 172.21.15.123:0/1852804052 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559191679370 msgr2=0x559191690890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:15.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.425+0000 7f4055d9b640 1 --2- 172.21.15.123:0/1852804052 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559191679370 0x559191690890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.425+0000 7f4055d9b640 1 -- 172.21.15.123:0/1852804052 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55919138c7e0 con 0x559191695690 2024-09-15T23:24:15.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.425+0000 7f4055d9b640 1 --2- 172.21.15.123:0/1852804052 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559191695690 0x559191690350 secure :-1 s=READY pgs=2418 cs=0 l=1 rev1=1 crypto rx=0x7f404c0098c0 tx=0x7f404c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abd5656a5e978dbc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:15.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.425+0000 7f40357fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:24:15.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.426+0000 7f40357fa640 1 -- 172.21.15.123:0/1852804052 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404c041070 con 0x559191695690 2024-09-15T23:24:15.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.426+0000 7f40357fa640 1 -- 172.21.15.123:0/1852804052 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(206..206 src has 1..206) ==== 5709+0+0 (secure 0 0 0) 0x7f404c004450 con 0x559191695690 2024-09-15T23:24:15.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.426+0000 7f405fa59740 1 -- 172.21.15.123:0/1852804052 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f404c03c720 con 0x559191695690 2024-09-15T23:24:15.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.426+0000 7f40357fa640 1 -- 172.21.15.123:0/1852804052 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=127) ==== 24+0+0 (secure 0 0 0) 0x7f404c057050 con 0x559191695690 2024-09-15T23:24:15.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.426+0000 7f405fa59740 10 client.11109 fetch_fsmap learned FSMap version 127 2024-09-15T23:24:15.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.426+0000 7f405fa59740 1 -- 172.21.15.123:0/1852804052 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=127,monmap=2+}) -- 0x5591913ecf70 con 0x559191695690 2024-09-15T23:24:15.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.426+0000 7f40357fa640 1 -- 172.21.15.123:0/1852804052 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f404c03c720 con 0x559191695690 2024-09-15T23:24:15.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.426+0000 7f40357fa640 1 -- 172.21.15.123:0/1852804052 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 127) ==== 3502+0+0 (secure 0 0 0) 0x7f404c05a020 con 0x559191695690 2024-09-15T23:24:15.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.426+0000 7f405fa59740 10 client.11109 fetch_fsmap finished waiting for FSMap version 127 2024-09-15T23:24:15.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.426+0000 7f405fa59740 10 client.11109 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.c 2024-09-15T23:24:15.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.426+0000 7f405fa59740 20 client.11109 populate_metadata read hostname 'smithi123' 2024-09-15T23:24:15.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.426+0000 7f405fa59740 1 --2- 172.21.15.123:0/1852804052 >> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] conn(0x559191666260 0x55919164dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.426+0000 7f405fa59740 4 client.11109 mds_command: new command op to 10905 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:24:15.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.426+0000 7f405fa59740 1 -- 172.21.15.123:0/1852804052 --> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5591915bf120 con 0x559191666260 2024-09-15T23:24:15.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.426+0000 7f405659c640 1 --2- 172.21.15.123:0/1852804052 >> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] conn(0x559191666260 0x55919164dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.426+0000 7f40357fa640 10 client.11109 ms_handle_connect on v2:172.21.15.123:6832/1661365546 2024-09-15T23:24:15.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.427+0000 7f405659c640 1 --2- 172.21.15.123:0/1852804052 >> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] conn(0x559191666260 0x55919164dfd0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a00f1815fdd6d09 server_cookie=dd798eeb3949463e in_seq=0 out_seq=0 2024-09-15T23:24:15.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.427+0000 7f40357fa640 1 -- 172.21.15.123:0/1852804052 <== mds.0 v2:172.21.15.123:6832/1661365546 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5591915bf120 con 0x559191666260 2024-09-15T23:24:15.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.427+0000 7f40357fa640 10 client.11109 handle_command_reply: tid=0 2024-09-15T23:24:15.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.427+0000 7f405fa59740 1 client.11109 shutdown 2024-09-15T23:24:15.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.427+0000 7f405fa59740 1 -- 172.21.15.123:0/1852804052 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559191695690 msgr2=0x559191690350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:15.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.427+0000 7f405fa59740 1 --2- 172.21.15.123:0/1852804052 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559191695690 0x559191690350 secure :-1 s=READY pgs=2418 cs=0 l=1 rev1=1 crypto rx=0x7f404c0098c0 tx=0x7f404c004730 comp rx=0 tx=0).stop 2024-09-15T23:24:15.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.427+0000 7f405fa59740 1 -- 172.21.15.123:0/1852804052 shutdown_connections 2024-09-15T23:24:15.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.427+0000 7f405fa59740 1 --2- 172.21.15.123:0/1852804052 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559191679370 0x559191690890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.427+0000 7f405fa59740 1 --2- 172.21.15.123:0/1852804052 >> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] conn(0x559191666260 0x55919164dfd0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.427+0000 7f405fa59740 1 --2- 172.21.15.123:0/1852804052 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559191695690 0x559191690350 unknown :-1 s=CLOSED pgs=2418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.427+0000 7f405fa59740 1 --2- 172.21.15.123:0/1852804052 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x5591916932b0 0x559191669be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.427+0000 7f40357fa640 0 client.11109 ms_handle_reset on v2:172.21.15.123:6832/1661365546 2024-09-15T23:24:15.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.427+0000 7f405fa59740 1 -- 172.21.15.123:0/1852804052 >> 172.21.15.123:0/1852804052 conn(0x559191692e50 msgr2=0x5591916936d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:15.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.427+0000 7f405fa59740 1 -- 172.21.15.123:0/1852804052 shutdown_connections 2024-09-15T23:24:15.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.427+0000 7f405fa59740 1 -- 172.21.15.123:0/1852804052 wait complete. 2024-09-15T23:24:15.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.428+0000 7f405fa59740 20 client.11109 trim_cache size 0 max 16384 2024-09-15T23:24:15.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.444+0000 7f405fa59740 1 Processor -- start 2024-09-15T23:24:15.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.444+0000 7f405fa59740 1 -- start start 2024-09-15T23:24:15.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.445+0000 7f405fa59740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559191679370 0x5591916906e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.445+0000 7f405fa59740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5591916932b0 0x559191693690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.445+0000 7f405fa59740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559191695690 0x559191693bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.445+0000 7f405fa59740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4058200a10 con 0x5591916932b0 2024-09-15T23:24:15.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.445+0000 7f405fa59740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f40581ffad0 con 0x559191695690 2024-09-15T23:24:15.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.445+0000 7f405fa59740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f40581561e0 con 0x559191679370 2024-09-15T23:24:15.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.445+0000 7f4055d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5591916932b0 0x559191693690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.445+0000 7f4055d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5591916932b0 0x559191693690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39294/0 (socket says 172.21.15.123:39294) 2024-09-15T23:24:15.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.445+0000 7f4055d9b640 1 -- 172.21.15.123:0/208839751 learned_addr learned my addr 172.21.15.123:0/208839751 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:15.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.446+0000 7f4055d9b640 1 -- 172.21.15.123:0/208839751 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559191679370 msgr2=0x5591916906e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:15.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.446+0000 7f4055d9b640 1 --2- 172.21.15.123:0/208839751 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559191679370 0x5591916906e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.446+0000 7f4055d9b640 1 -- 172.21.15.123:0/208839751 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559191695690 msgr2=0x559191693bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:15.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.446+0000 7f4055d9b640 1 --2- 172.21.15.123:0/208839751 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559191695690 0x559191693bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.446+0000 7f4055d9b640 1 -- 172.21.15.123:0/208839751 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559191284170 con 0x5591916932b0 2024-09-15T23:24:15.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.446+0000 7f4055d9b640 1 --2- 172.21.15.123:0/208839751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5591916932b0 0x559191693690 secure :-1 s=READY pgs=2419 cs=0 l=1 rev1=1 crypto rx=0x7f404c02a7d0 tx=0x7f404c048070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d34e39329be4c955 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:15.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.446+0000 7f40377fe640 1 -- 172.21.15.123:0/208839751 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404c041070 con 0x5591916932b0 2024-09-15T23:24:15.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.446+0000 7f40377fe640 1 -- 172.21.15.123:0/208839751 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f404c04a070 con 0x5591916932b0 2024-09-15T23:24:15.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.446+0000 7f40377fe640 1 -- 172.21.15.123:0/208839751 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404c054070 con 0x5591916932b0 2024-09-15T23:24:15.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.446+0000 7f405fa59740 1 -- 172.21.15.123:0/208839751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5591916932b0 msgr2=0x559191693690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:15.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.446+0000 7f405fa59740 1 --2- 172.21.15.123:0/208839751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5591916932b0 0x559191693690 secure :-1 s=READY pgs=2419 cs=0 l=1 rev1=1 crypto rx=0x7f404c02a7d0 tx=0x7f404c048070 comp rx=0 tx=0).stop 2024-09-15T23:24:15.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.446+0000 7f405fa59740 1 -- 172.21.15.123:0/208839751 shutdown_connections 2024-09-15T23:24:15.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.446+0000 7f405fa59740 1 --2- 172.21.15.123:0/208839751 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x559191695690 0x559191693bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.446+0000 7f405fa59740 1 --2- 172.21.15.123:0/208839751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5591916932b0 0x559191693690 unknown :-1 s=CLOSED pgs=2419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.446+0000 7f405fa59740 1 --2- 172.21.15.123:0/208839751 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559191679370 0x5591916906e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.446+0000 7f405fa59740 1 -- 172.21.15.123:0/208839751 >> 172.21.15.123:0/208839751 conn(0x559191692e50 msgr2=0x559191689e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:15.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.447+0000 7f405fa59740 1 -- 172.21.15.123:0/208839751 shutdown_connections 2024-09-15T23:24:15.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.447+0000 7f405fa59740 1 -- 172.21.15.123:0/208839751 wait complete. 2024-09-15T23:24:15.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.447+0000 7f405fa59740 1 -- start start 2024-09-15T23:24:15.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.447+0000 7f405fa59740 1 Processor -- start 2024-09-15T23:24:15.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.448+0000 7f405fa59740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559191679370 0x559191664630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.448+0000 7f405fa59740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5591916932b0 0x559191714cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.448+0000 7f405fa59740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559191695690 0x5591916b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.448+0000 7f405fa59740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55919164c090 con 0x559191695690 2024-09-15T23:24:15.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.448+0000 7f405fa59740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f4058156830 con 0x5591916932b0 2024-09-15T23:24:15.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.448+0000 7f405fa59740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x559191690c20 con 0x559191679370 2024-09-15T23:24:15.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.448+0000 7f405fa59740 10 client.0 _ll_register_callbacks cb 0x7f4050059130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:24:15.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.448+0000 7f4056d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559191695690 0x5591916b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.448+0000 7f4056d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559191695690 0x5591916b4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39298/0 (socket says 172.21.15.123:39298) 2024-09-15T23:24:15.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.448+0000 7f4056d9d640 1 -- 172.21.15.123:0/1258168142 learned_addr learned my addr 172.21.15.123:0/1258168142 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:15.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.448+0000 7f4055d9b640 1 --2- 172.21.15.123:0/1258168142 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5591916932b0 0x559191714cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.448+0000 7f4056d9d640 1 -- 172.21.15.123:0/1258168142 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559191679370 msgr2=0x559191664630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:15.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.448+0000 7f4056d9d640 1 --2- 172.21.15.123:0/1258168142 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559191679370 0x559191664630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.448+0000 7f4056d9d640 1 -- 172.21.15.123:0/1258168142 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5591916932b0 msgr2=0x559191714cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:15.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.448+0000 7f4056d9d640 1 --2- 172.21.15.123:0/1258168142 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5591916932b0 0x559191714cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.448+0000 7f4056d9d640 1 -- 172.21.15.123:0/1258168142 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591916b5230 con 0x559191695690 2024-09-15T23:24:15.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.449+0000 7f4056d9d640 1 --2- 172.21.15.123:0/1258168142 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559191695690 0x5591916b4cf0 secure :-1 s=READY pgs=2420 cs=0 l=1 rev1=1 crypto rx=0x7f40500557c0 tx=0x7f4050059b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78392eb3036edc4e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:15.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.449+0000 7f40357fa640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:24:15.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.449+0000 7f40357fa640 1 -- 172.21.15.123:0/1258168142 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4050061f40 con 0x559191695690 2024-09-15T23:24:15.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.449+0000 7f40357fa640 1 -- 172.21.15.123:0/1258168142 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(206..206 src has 1..206) ==== 5709+0+0 (secure 0 0 0) 0x7f405008b0b0 con 0x559191695690 2024-09-15T23:24:15.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.449+0000 7f405fa59740 1 -- 172.21.15.123:0/1258168142 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f404c04a070 con 0x559191695690 2024-09-15T23:24:15.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.449+0000 7f40357fa640 1 -- 172.21.15.123:0/1258168142 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=127) ==== 24+0+0 (secure 0 0 0) 0x7f4050057660 con 0x559191695690 2024-09-15T23:24:15.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.449+0000 7f405fa59740 10 client.11115 fetch_fsmap learned FSMap version 127 2024-09-15T23:24:15.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.449+0000 7f405fa59740 1 -- 172.21.15.123:0/1258168142 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=127,monmap=2+}) -- 0x55919168c610 con 0x559191695690 2024-09-15T23:24:15.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.449+0000 7f40357fa640 1 -- 172.21.15.123:0/1258168142 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f404c04a070 con 0x559191695690 2024-09-15T23:24:15.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.449+0000 7f40357fa640 1 -- 172.21.15.123:0/1258168142 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 127) ==== 3502+0+0 (secure 0 0 0) 0x7f40500559d0 con 0x559191695690 2024-09-15T23:24:15.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.449+0000 7f405fa59740 10 client.11115 fetch_fsmap finished waiting for FSMap version 127 2024-09-15T23:24:15.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.449+0000 7f405fa59740 10 client.11115 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.c 2024-09-15T23:24:15.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.449+0000 7f405fa59740 20 client.11115 populate_metadata read hostname 'smithi123' 2024-09-15T23:24:15.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.449+0000 7f405fa59740 1 --2- 172.21.15.123:0/1258168142 >> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] conn(0x55919168cdb0 0x55919168d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.449+0000 7f405fa59740 4 client.11115 mds_command: new command op to 10905 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}] 2024-09-15T23:24:15.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.449+0000 7f405fa59740 1 -- 172.21.15.123:0/1258168142 --> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}) -- 0x5591915b9470 con 0x55919168cdb0 2024-09-15T23:24:15.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.449+0000 7f405659c640 1 --2- 172.21.15.123:0/1258168142 >> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] conn(0x55919168cdb0 0x55919168d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.449+0000 7f40357fa640 10 client.11115 ms_handle_connect on v2:172.21.15.123:6832/1661365546 2024-09-15T23:24:15.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.450+0000 7f405659c640 1 --2- 172.21.15.123:0/1258168142 >> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] conn(0x55919168cdb0 0x55919168d190 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb6bd28f79edad21 server_cookie=ed5839e841263aa7 in_seq=0 out_seq=0 2024-09-15T23:24:15.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.450+0000 7f40357fa640 1 -- 172.21.15.123:0/1258168142 <== mds.0 v2:172.21.15.123:6832/1661365546 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5591915b9470 con 0x55919168cdb0 2024-09-15T23:24:15.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.450+0000 7f40357fa640 10 client.11115 handle_command_reply: tid=0 2024-09-15T23:24:15.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.450+0000 7f405fa59740 1 client.11115 shutdown 2024-09-15T23:24:15.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.450+0000 7f405fa59740 1 -- 172.21.15.123:0/1258168142 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559191695690 msgr2=0x5591916b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:15.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.450+0000 7f405fa59740 1 --2- 172.21.15.123:0/1258168142 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559191695690 0x5591916b4cf0 secure :-1 s=READY pgs=2420 cs=0 l=1 rev1=1 crypto rx=0x7f40500557c0 tx=0x7f4050059b90 comp rx=0 tx=0).stop 2024-09-15T23:24:15.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.450+0000 7f405fa59740 1 -- 172.21.15.123:0/1258168142 shutdown_connections 2024-09-15T23:24:15.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.450+0000 7f405fa59740 1 --2- 172.21.15.123:0/1258168142 >> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] conn(0x55919168cdb0 0x55919168d190 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.450+0000 7f405fa59740 1 --2- 172.21.15.123:0/1258168142 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559191695690 0x5591916b4cf0 unknown :-1 s=CLOSED pgs=2420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.450+0000 7f405fa59740 1 --2- 172.21.15.123:0/1258168142 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x5591916932b0 0x559191714cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.450+0000 7f405fa59740 1 --2- 172.21.15.123:0/1258168142 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x559191679370 0x559191664630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.450+0000 7f40357fa640 0 client.11115 ms_handle_reset on v2:172.21.15.123:6832/1661365546 2024-09-15T23:24:15.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.450+0000 7f405fa59740 1 -- 172.21.15.123:0/1258168142 >> 172.21.15.123:0/1258168142 conn(0x559191692e50 msgr2=0x559191674120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:15.460 INFO:tasks.ceph.mds.c.smithi123.stderr:2024-09-15T23:24:15.450+0000 7ff854d3a640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/sixmegs auth v6 ap=1 DIRTYPARENT s=5242880 n(v0 rc2024-09-15T23:24:14.452213+0000 b5242880 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={8024=0-12582912@1} caps={8024=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@4},l=8024 | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x5637080c0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(29)0x10000000001:[<0x10000000000/sixmegs v6>,<0x1/subdir v8>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-15T23:24:15.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.451+0000 7f405fa59740 1 -- 172.21.15.123:0/1258168142 shutdown_connections 2024-09-15T23:24:15.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.451+0000 7f405fa59740 1 -- 172.21.15.123:0/1258168142 wait complete. 2024-09-15T23:24:15.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.451+0000 7f405fa59740 20 client.11115 trim_cache size 0 max 16384 2024-09-15T23:24:15.461 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:24:15.462 INFO:teuthology.orchestra.run.smithi123.stdout: "return_code": 0, 2024-09-15T23:24:15.462 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_tag": "4d7003c9-e7af-4361-9a24-c05e16c15f09", 2024-09-15T23:24:15.462 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": "asynchronous" 2024-09-15T23:24:15.462 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:24:15.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.451+0000 7f405cbe4640 1 -- 172.21.15.123:0/2621822276 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f403806c2b0 msgr2=0x7f403806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:15.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.451+0000 7f405cbe4640 1 --2- 172.21.15.123:0/2621822276 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f403806c2b0 0x7f403806e770 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f40480012e0 tx=0x7f4048009040 comp rx=0 tx=0).stop 2024-09-15T23:24:15.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.451+0000 7f405cbe4640 1 -- 172.21.15.123:0/2621822276 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40581622d0 msgr2=0x7f40580d10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:15.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.451+0000 7f405cbe4640 1 --2- 172.21.15.123:0/2621822276 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40581622d0 0x7f40580d10f0 secure :-1 s=READY pgs=2416 cs=0 l=1 rev1=1 crypto rx=0x7f405000b4c0 tx=0x7f405000b980 comp rx=0 tx=0).stop 2024-09-15T23:24:15.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.451+0000 7f405cbe4640 1 -- 172.21.15.123:0/2621822276 shutdown_connections 2024-09-15T23:24:15.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.451+0000 7f405cbe4640 1 --2- 172.21.15.123:0/2621822276 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f403806c2b0 0x7f403806e770 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.451+0000 7f405cbe4640 1 --2- 172.21.15.123:0/2621822276 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f40581622d0 0x7f40580d10f0 unknown :-1 s=CLOSED pgs=2416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.451+0000 7f405cbe4640 1 --2- 172.21.15.123:0/2621822276 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f4058161cf0 0x7f40580cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.451+0000 7f405cbe4640 1 --2- 172.21.15.123:0/2621822276 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f40580b6f90 0x7f40580cf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.451+0000 7f405cbe4640 1 -- 172.21.15.123:0/2621822276 >> 172.21.15.123:0/2621822276 conn(0x7f4058067950 msgr2=0x7f4058160a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:15.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.451+0000 7f405cbe4640 1 -- 172.21.15.123:0/2621822276 shutdown_connections 2024-09-15T23:24:15.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.451+0000 7f405cbe4640 1 -- 172.21.15.123:0/2621822276 wait complete. 2024-09-15T23:24:15.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:24:15.465 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.14:0 scrub status 2024-09-15T23:24:15.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.564+0000 7fb9a9a77640 1 Processor -- start 2024-09-15T23:24:15.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.564+0000 7fb9a9a77640 1 -- start start 2024-09-15T23:24:15.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.565+0000 7fb9a9a77640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb9a4162a00 0x7fb9a4162e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.565+0000 7fb9a9a77640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9a415f550 con 0x7fb9a415e990 2024-09-15T23:24:15.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.565+0000 7fb9a9a77640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9a415f830 con 0x7fb9a40b5520 2024-09-15T23:24:15.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.565+0000 7fb9a9a77640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fb9a415fb10 con 0x7fb9a4162a00 2024-09-15T23:24:15.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.565+0000 7fb9a3fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb9a4162a00 0x7fb9a4162e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.565+0000 7fb9a37fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb9a415e990 0x7fb9a415ed70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:39250/0 (socket says 172.21.15.123:39250) 2024-09-15T23:24:15.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.565+0000 7fb9a37fe640 1 -- 172.21.15.123:0/2444487629 learned_addr learned my addr 172.21.15.123:0/2444487629 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:15.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.566+0000 7fb9a3fff640 1 -- 172.21.15.123:0/2444487629 >> v1:172.21.15.188:6789/0 conn(0x7fb9a40b5520 legacy=0x7fb9a406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:15.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.566+0000 7fb9a3fff640 1 -- 172.21.15.123:0/2444487629 >> v1:172.21.15.123:6789/0 conn(0x7fb9a415e990 legacy=0x7fb9a415ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:15.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.566+0000 7fb9a27fc640 1 -- 172.21.15.123:0/2444487629 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 519036126 0 0) 0x7fb9a415f550 con 0x7fb9a415e990 2024-09-15T23:24:15.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.566+0000 7fb9a3fff640 1 -- 172.21.15.123:0/2444487629 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9a41624e0 con 0x7fb9a4162a00 2024-09-15T23:24:15.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.566+0000 7fb9a3fff640 1 --2- 172.21.15.123:0/2444487629 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9a4162a00 0x7fb9a4162e70 secure :-1 s=READY pgs=2422 cs=0 l=1 rev1=1 crypto rx=0x7fb99c0097a0 tx=0x7fb99c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a60b4847c5af30 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:15.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.566+0000 7fb9a27fc640 1 -- 172.21.15.123:0/2444487629 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99c037070 con 0x7fb9a4162a00 2024-09-15T23:24:15.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.567+0000 7fb9a27fc640 1 -- 172.21.15.123:0/2444487629 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb99c032440 con 0x7fb9a4162a00 2024-09-15T23:24:15.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.567+0000 7fb9a27fc640 1 -- 172.21.15.123:0/2444487629 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99c032810 con 0x7fb9a4162a00 2024-09-15T23:24:15.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.567+0000 7fb9a9a77640 1 -- 172.21.15.123:0/2444487629 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9a4162a00 msgr2=0x7fb9a4162e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:15.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.567+0000 7fb9a9a77640 1 --2- 172.21.15.123:0/2444487629 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9a4162a00 0x7fb9a4162e70 secure :-1 s=READY pgs=2422 cs=0 l=1 rev1=1 crypto rx=0x7fb99c0097a0 tx=0x7fb99c02a230 comp rx=0 tx=0).stop 2024-09-15T23:24:15.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.567+0000 7fb9a9a77640 1 -- 172.21.15.123:0/2444487629 shutdown_connections 2024-09-15T23:24:15.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.567+0000 7fb9a9a77640 1 --2- 172.21.15.123:0/2444487629 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9a4162a00 0x7fb9a4162e70 unknown :-1 s=CLOSED pgs=2422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.567+0000 7fb9a9a77640 1 -- 172.21.15.123:0/2444487629 >> 172.21.15.123:0/2444487629 conn(0x7fb9a40d25d0 msgr2=0x7fb9a40d29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:15.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.567+0000 7fb9a9a77640 1 -- 172.21.15.123:0/2444487629 shutdown_connections 2024-09-15T23:24:15.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.567+0000 7fb9a9a77640 1 -- 172.21.15.123:0/2444487629 wait complete. 2024-09-15T23:24:15.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.568+0000 7fb9a9a77640 1 Processor -- start 2024-09-15T23:24:15.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.568+0000 7fb9a9a77640 1 -- start start 2024-09-15T23:24:15.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.569+0000 7fb9a9a77640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb9a40b5520 0x7fb9a40cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.569+0000 7fb9a9a77640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9a415e990 0x7fb9a40d15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.569+0000 7fb9a9a77640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9a4162a00 0x7fb9a4158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.569+0000 7fb9a9a77640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a40b7170 con 0x7fb9a415e990 2024-09-15T23:24:15.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.569+0000 7fb9a9a77640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a40b6ff0 con 0x7fb9a4162a00 2024-09-15T23:24:15.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.569+0000 7fb9a9a77640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb9a40b72f0 con 0x7fb9a40b5520 2024-09-15T23:24:15.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.569+0000 7fb9a2ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9a415e990 0x7fb9a40d15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.569+0000 7fb9a2ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9a415e990 0x7fb9a40d15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39314/0 (socket says 172.21.15.123:39314) 2024-09-15T23:24:15.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.569+0000 7fb9a2ffd640 1 -- 172.21.15.123:0/1704995105 learned_addr learned my addr 172.21.15.123:0/1704995105 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:15.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.570+0000 7fb9a3fff640 1 --2- 172.21.15.123:0/1704995105 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9a4162a00 0x7fb9a4158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.570+0000 7fb9a2ffd640 1 -- 172.21.15.123:0/1704995105 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb9a40b5520 msgr2=0x7fb9a40cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:15.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.570+0000 7fb9a37fe640 1 --2- 172.21.15.123:0/1704995105 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb9a40b5520 0x7fb9a40cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.570+0000 7fb9a2ffd640 1 --2- 172.21.15.123:0/1704995105 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb9a40b5520 0x7fb9a40cfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.570+0000 7fb9a2ffd640 1 -- 172.21.15.123:0/1704995105 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9a4162a00 msgr2=0x7fb9a4158d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:15.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.570+0000 7fb9a2ffd640 1 --2- 172.21.15.123:0/1704995105 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9a4162a00 0x7fb9a4158d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.570+0000 7fb9a2ffd640 1 -- 172.21.15.123:0/1704995105 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9a41f5290 con 0x7fb9a415e990 2024-09-15T23:24:15.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.570+0000 7fb9a3fff640 1 --2- 172.21.15.123:0/1704995105 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9a4162a00 0x7fb9a4158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:24:15.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.570+0000 7fb9a37fe640 1 --2- 172.21.15.123:0/1704995105 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb9a40b5520 0x7fb9a40cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:24:15.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.570+0000 7fb9a2ffd640 1 --2- 172.21.15.123:0/1704995105 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9a415e990 0x7fb9a40d15d0 secure :-1 s=READY pgs=2423 cs=0 l=1 rev1=1 crypto rx=0x7fb99800c480 tx=0x7fb99800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:15.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.570+0000 7fb98bfff640 1 -- 172.21.15.123:0/1704995105 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9980052d0 con 0x7fb9a415e990 2024-09-15T23:24:15.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.570+0000 7fb98bfff640 1 -- 172.21.15.123:0/1704995105 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb998005470 con 0x7fb9a415e990 2024-09-15T23:24:15.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.570+0000 7fb98bfff640 1 -- 172.21.15.123:0/1704995105 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb998012870 con 0x7fb9a415e990 2024-09-15T23:24:15.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.570+0000 7fb9a9a77640 1 -- 172.21.15.123:0/1704995105 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9a415c3a0 con 0x7fb9a415e990 2024-09-15T23:24:15.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.570+0000 7fb9a9a77640 1 -- 172.21.15.123:0/1704995105 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9a415c960 con 0x7fb9a415e990 2024-09-15T23:24:15.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.572+0000 7fb98bfff640 1 -- 172.21.15.123:0/1704995105 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb998012a10 con 0x7fb9a415e990 2024-09-15T23:24:15.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.572+0000 7fb98bfff640 1 --2- 172.21.15.123:0/1704995105 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb99006c2b0 0x7fb99006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.572+0000 7fb98bfff640 1 -- 172.21.15.123:0/1704995105 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 5709+0+0 (secure 0 0 0) 0x7fb99808b0d0 con 0x7fb9a415e990 2024-09-15T23:24:15.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.573+0000 7fb9a37fe640 1 --2- 172.21.15.123:0/1704995105 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb99006c2b0 0x7fb99006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.573+0000 7fb9ac80f740 1 Processor -- start 2024-09-15T23:24:15.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.573+0000 7fb9ac80f740 1 -- start start 2024-09-15T23:24:15.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.573+0000 7fb9a37fe640 1 --2- 172.21.15.123:0/1704995105 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb99006c2b0 0x7fb99006e770 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fb9940012e0 tx=0x7fb994009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:15.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.574+0000 7fb9ac80f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55beeae90920 0x55beeaed60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.574+0000 7fb9ac80f740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55beeae8e0e0 0x55beeae90d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.574+0000 7fb9ac80f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55beeae920b0 0x55beeae8b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.574+0000 7fb9ac80f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55beeadf36f0 con 0x55beeae920b0 2024-09-15T23:24:15.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.574+0000 7fb9ac80f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55beead9b330 con 0x55beeae90920 2024-09-15T23:24:15.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.574+0000 7fb9ac80f740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55beeadef6b0 con 0x55beeae8e0e0 2024-09-15T23:24:15.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.574+0000 7fb9a3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55beeae920b0 0x55beeae8b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.574+0000 7fb9a3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55beeae920b0 0x55beeae8b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39330/0 (socket says 172.21.15.123:39330) 2024-09-15T23:24:15.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.574+0000 7fb9a3fff640 1 -- 172.21.15.123:0/1640681933 learned_addr learned my addr 172.21.15.123:0/1640681933 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:15.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.574+0000 7fb9a37fe640 1 --2- 172.21.15.123:0/1640681933 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55beeae90920 0x55beeaed60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.574+0000 7fb9a2ffd640 1 --2- 172.21.15.123:0/1640681933 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55beeae8e0e0 0x55beeae90d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.574+0000 7fb9a3fff640 1 -- 172.21.15.123:0/1640681933 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55beeae8e0e0 msgr2=0x55beeae90d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:15.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.574+0000 7fb9a3fff640 1 --2- 172.21.15.123:0/1640681933 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55beeae8e0e0 0x55beeae90d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.574+0000 7fb9a3fff640 1 -- 172.21.15.123:0/1640681933 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55beeae90920 msgr2=0x55beeaed60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:15.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.574+0000 7fb9a3fff640 1 --2- 172.21.15.123:0/1640681933 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55beeae90920 0x55beeaed60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.574+0000 7fb9a3fff640 1 -- 172.21.15.123:0/1640681933 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55beeadc10d0 con 0x55beeae920b0 2024-09-15T23:24:15.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.574+0000 7fb9a37fe640 1 --2- 172.21.15.123:0/1640681933 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55beeae90920 0x55beeaed60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:24:15.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.574+0000 7fb9a3fff640 1 --2- 172.21.15.123:0/1640681933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55beeae920b0 0x55beeae8b1a0 secure :-1 s=READY pgs=2424 cs=0 l=1 rev1=1 crypto rx=0x7fb99c02a820 tx=0x7fb99c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44bf1d5dab46a2a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:15.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.575+0000 7fb9897fa640 1 -- 172.21.15.123:0/1640681933 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99c037040 con 0x55beeae920b0 2024-09-15T23:24:15.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.575+0000 7fb9897fa640 1 -- 172.21.15.123:0/1640681933 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb99c042070 con 0x55beeae920b0 2024-09-15T23:24:15.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.575+0000 7fb9897fa640 1 -- 172.21.15.123:0/1640681933 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99c0328e0 con 0x55beeae920b0 2024-09-15T23:24:15.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.575+0000 7fb9ac80f740 1 -- 172.21.15.123:0/1640681933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55beeae920b0 msgr2=0x55beeae8b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:15.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.575+0000 7fb9ac80f740 1 --2- 172.21.15.123:0/1640681933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55beeae920b0 0x55beeae8b1a0 secure :-1 s=READY pgs=2424 cs=0 l=1 rev1=1 crypto rx=0x7fb99c02a820 tx=0x7fb99c02c000 comp rx=0 tx=0).stop 2024-09-15T23:24:15.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.575+0000 7fb9ac80f740 1 -- 172.21.15.123:0/1640681933 shutdown_connections 2024-09-15T23:24:15.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.575+0000 7fb9ac80f740 1 --2- 172.21.15.123:0/1640681933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55beeae920b0 0x55beeae8b1a0 unknown :-1 s=CLOSED pgs=2424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.575+0000 7fb9ac80f740 1 --2- 172.21.15.123:0/1640681933 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55beeae8e0e0 0x55beeae90d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.575+0000 7fb9ac80f740 1 --2- 172.21.15.123:0/1640681933 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55beeae90920 0x55beeaed60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.575+0000 7fb9ac80f740 1 -- 172.21.15.123:0/1640681933 >> 172.21.15.123:0/1640681933 conn(0x55beeae8d370 msgr2=0x55beeaed5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:15.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.575+0000 7fb9ac80f740 1 -- 172.21.15.123:0/1640681933 shutdown_connections 2024-09-15T23:24:15.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.575+0000 7fb9ac80f740 1 -- 172.21.15.123:0/1640681933 wait complete. 2024-09-15T23:24:15.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.576+0000 7fb9ac80f740 1 -- start start 2024-09-15T23:24:15.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.576+0000 7fb9ac80f740 1 Processor -- start 2024-09-15T23:24:15.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.577+0000 7fb9ac80f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55beeae90920 0x55beeaeb98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.577+0000 7fb9ac80f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55beeae920b0 0x55beeaeb1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.577+0000 7fb9ac80f740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55beeaebae00 0x55beeaeda8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.577+0000 7fb9ac80f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55beeae8c810 con 0x55beeae90920 2024-09-15T23:24:15.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.577+0000 7fb9ac80f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55beead7c4f0 con 0x55beeae920b0 2024-09-15T23:24:15.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.577+0000 7fb9ac80f740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55beeaed68f0 con 0x55beeaebae00 2024-09-15T23:24:15.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.577+0000 7fb9a37fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55beeae90920 0x55beeaeb98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.577+0000 7fb9ac80f740 10 client.0 _ll_register_callbacks cb 0x55beead9db50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:24:15.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.577+0000 7fb9a37fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55beeae90920 0x55beeaeb98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39338/0 (socket says 172.21.15.123:39338) 2024-09-15T23:24:15.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.577+0000 7fb9a37fe640 1 -- 172.21.15.123:0/3921322991 learned_addr learned my addr 172.21.15.123:0/3921322991 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:15.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.577+0000 7fb9a2ffd640 1 --2- 172.21.15.123:0/3921322991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55beeae920b0 0x55beeaeb1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.577+0000 7fb9a3fff640 1 --2- 172.21.15.123:0/3921322991 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55beeaebae00 0x55beeaeda8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.577+0000 7fb9a37fe640 1 -- 172.21.15.123:0/3921322991 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55beeaebae00 msgr2=0x55beeaeda8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:15.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.577+0000 7fb9a37fe640 1 --2- 172.21.15.123:0/3921322991 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55beeaebae00 0x55beeaeda8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.577+0000 7fb9a37fe640 1 -- 172.21.15.123:0/3921322991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55beeae920b0 msgr2=0x55beeaeb1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:15.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.577+0000 7fb9a37fe640 1 --2- 172.21.15.123:0/3921322991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55beeae920b0 0x55beeaeb1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.577+0000 7fb9a37fe640 1 -- 172.21.15.123:0/3921322991 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55beeabd07d0 con 0x55beeae90920 2024-09-15T23:24:15.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.577+0000 7fb9a3fff640 1 --2- 172.21.15.123:0/3921322991 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55beeaebae00 0x55beeaeda8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:24:15.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.577+0000 7fb9a37fe640 1 --2- 172.21.15.123:0/3921322991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55beeae90920 0x55beeaeb98f0 secure :-1 s=READY pgs=2425 cs=0 l=1 rev1=1 crypto rx=0x7fb994007150 tx=0x7fb994001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae777e0f140edd7c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:15.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.577+0000 7fb9827fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:24:15.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.577+0000 7fb9827fc640 1 -- 172.21.15.123:0/3921322991 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb994026060 con 0x55beeae90920 2024-09-15T23:24:15.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.577+0000 7fb9827fc640 1 -- 172.21.15.123:0/3921322991 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(206..206 src has 1..206) ==== 5709+0+0 (secure 0 0 0) 0x7fb994021a90 con 0x55beeae90920 2024-09-15T23:24:15.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.578+0000 7fb9ac80f740 1 -- 172.21.15.123:0/3921322991 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb99c042070 con 0x55beeae90920 2024-09-15T23:24:15.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.578+0000 7fb9827fc640 1 -- 172.21.15.123:0/3921322991 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=127) ==== 24+0+0 (secure 0 0 0) 0x7fb994021c90 con 0x55beeae90920 2024-09-15T23:24:15.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.578+0000 7fb9ac80f740 10 client.11130 fetch_fsmap learned FSMap version 127 2024-09-15T23:24:15.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.578+0000 7fb9ac80f740 1 -- 172.21.15.123:0/3921322991 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=127,monmap=2+}) -- 0x55beeab063f0 con 0x55beeae90920 2024-09-15T23:24:15.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.578+0000 7fb9827fc640 1 -- 172.21.15.123:0/3921322991 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb99c042070 con 0x55beeae90920 2024-09-15T23:24:15.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.578+0000 7fb9827fc640 1 -- 172.21.15.123:0/3921322991 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 127) ==== 3502+0+0 (secure 0 0 0) 0x7fb9940144f0 con 0x55beeae90920 2024-09-15T23:24:15.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.578+0000 7fb9ac80f740 10 client.11130 fetch_fsmap finished waiting for FSMap version 127 2024-09-15T23:24:15.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.578+0000 7fb9ac80f740 10 client.11130 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.c 2024-09-15T23:24:15.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.578+0000 7fb9ac80f740 20 client.11130 populate_metadata read hostname 'smithi123' 2024-09-15T23:24:15.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.578+0000 7fb9ac80f740 1 --2- 172.21.15.123:0/3921322991 >> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] conn(0x55beeaebb280 0x55beeaeb3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.578+0000 7fb9ac80f740 4 client.11130 mds_command: new command op to 10905 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:24:15.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.578+0000 7fb9ac80f740 1 -- 172.21.15.123:0/3921322991 --> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55beeae00e20 con 0x55beeaebb280 2024-09-15T23:24:15.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.578+0000 7fb9a2ffd640 1 --2- 172.21.15.123:0/3921322991 >> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] conn(0x55beeaebb280 0x55beeaeb3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.578+0000 7fb9827fc640 10 client.11130 ms_handle_connect on v2:172.21.15.123:6832/1661365546 2024-09-15T23:24:15.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.578+0000 7fb9a2ffd640 1 --2- 172.21.15.123:0/3921322991 >> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] conn(0x55beeaebb280 0x55beeaeb3750 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a9d1d91f78d9556 server_cookie=62d1ec657ca7f373 in_seq=0 out_seq=0 2024-09-15T23:24:15.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.579+0000 7fb9827fc640 1 -- 172.21.15.123:0/3921322991 <== mds.0 v2:172.21.15.123:6832/1661365546 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55beeae00e20 con 0x55beeaebb280 2024-09-15T23:24:15.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.579+0000 7fb9827fc640 10 client.11130 handle_command_reply: tid=0 2024-09-15T23:24:15.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.579+0000 7fb9ac80f740 1 client.11130 shutdown 2024-09-15T23:24:15.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.579+0000 7fb9ac80f740 1 -- 172.21.15.123:0/3921322991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55beeae90920 msgr2=0x55beeaeb98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:15.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.579+0000 7fb9ac80f740 1 --2- 172.21.15.123:0/3921322991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55beeae90920 0x55beeaeb98f0 secure :-1 s=READY pgs=2425 cs=0 l=1 rev1=1 crypto rx=0x7fb994007150 tx=0x7fb994001630 comp rx=0 tx=0).stop 2024-09-15T23:24:15.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.579+0000 7fb9ac80f740 1 -- 172.21.15.123:0/3921322991 shutdown_connections 2024-09-15T23:24:15.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.579+0000 7fb9ac80f740 1 --2- 172.21.15.123:0/3921322991 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55beeaebae00 0x55beeaeda8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.579+0000 7fb9ac80f740 1 --2- 172.21.15.123:0/3921322991 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55beeae920b0 0x55beeaeb1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.579+0000 7fb9ac80f740 1 --2- 172.21.15.123:0/3921322991 >> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] conn(0x55beeaebb280 0x55beeaeb3750 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.579+0000 7fb9ac80f740 1 --2- 172.21.15.123:0/3921322991 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55beeae90920 0x55beeaeb98f0 unknown :-1 s=CLOSED pgs=2425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.579+0000 7fb9ac80f740 1 -- 172.21.15.123:0/3921322991 >> 172.21.15.123:0/3921322991 conn(0x55beeae8e0e0 msgr2=0x55beeaed3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:15.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.579+0000 7fb9827fc640 0 client.11130 ms_handle_reset on v2:172.21.15.123:6832/1661365546 2024-09-15T23:24:15.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.579+0000 7fb9ac80f740 1 -- 172.21.15.123:0/3921322991 shutdown_connections 2024-09-15T23:24:15.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.579+0000 7fb9ac80f740 1 -- 172.21.15.123:0/3921322991 wait complete. 2024-09-15T23:24:15.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.579+0000 7fb9ac80f740 20 client.11130 trim_cache size 0 max 16384 2024-09-15T23:24:15.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.596+0000 7fb9ac80f740 1 Processor -- start 2024-09-15T23:24:15.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.597+0000 7fb9ac80f740 1 -- start start 2024-09-15T23:24:15.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.597+0000 7fb9ac80f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55beeae8e0e0 0x55beeaeb1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.597+0000 7fb9ac80f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55beeae90920 0x55beeaed3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.597+0000 7fb9ac80f740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55beeae920b0 0x55beeaed3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.597+0000 7fb9ac80f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a4200bb0 con 0x55beeae8e0e0 2024-09-15T23:24:15.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.597+0000 7fb9ac80f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a41f88e0 con 0x55beeae90920 2024-09-15T23:24:15.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.597+0000 7fb9ac80f740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb9a41f7c40 con 0x55beeae920b0 2024-09-15T23:24:15.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.598+0000 7fb9a37fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55beeae8e0e0 0x55beeaeb1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.598+0000 7fb9a37fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55beeae8e0e0 0x55beeaeb1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39354/0 (socket says 172.21.15.123:39354) 2024-09-15T23:24:15.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.598+0000 7fb9a37fe640 1 -- 172.21.15.123:0/2100416205 learned_addr learned my addr 172.21.15.123:0/2100416205 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:15.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.598+0000 7fb9a2ffd640 1 --2- 172.21.15.123:0/2100416205 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55beeae90920 0x55beeaed3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.598+0000 7fb9a3fff640 1 --2- 172.21.15.123:0/2100416205 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55beeae920b0 0x55beeaed3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.598+0000 7fb9a37fe640 1 -- 172.21.15.123:0/2100416205 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55beeae920b0 msgr2=0x55beeaed3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:15.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.598+0000 7fb9a37fe640 1 --2- 172.21.15.123:0/2100416205 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55beeae920b0 0x55beeaed3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.598+0000 7fb9a37fe640 1 -- 172.21.15.123:0/2100416205 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55beeae90920 msgr2=0x55beeaed3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:15.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.598+0000 7fb9a37fe640 1 --2- 172.21.15.123:0/2100416205 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55beeae90920 0x55beeaed3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.598+0000 7fb9a37fe640 1 -- 172.21.15.123:0/2100416205 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55beeaac60f0 con 0x55beeae8e0e0 2024-09-15T23:24:15.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.598+0000 7fb9a2ffd640 1 --2- 172.21.15.123:0/2100416205 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55beeae90920 0x55beeaed3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:24:15.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.598+0000 7fb9a37fe640 1 --2- 172.21.15.123:0/2100416205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55beeae8e0e0 0x55beeaeb1d60 secure :-1 s=READY pgs=2426 cs=0 l=1 rev1=1 crypto rx=0x7fb994001330 tx=0x7fb99401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10c434f13fd2490 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:15.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.598+0000 7fb988ff9640 1 -- 172.21.15.123:0/2100416205 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9940079e0 con 0x55beeae8e0e0 2024-09-15T23:24:15.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.598+0000 7fb988ff9640 1 -- 172.21.15.123:0/2100416205 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9940144f0 con 0x55beeae8e0e0 2024-09-15T23:24:15.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.598+0000 7fb988ff9640 1 -- 172.21.15.123:0/2100416205 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb994014c40 con 0x55beeae8e0e0 2024-09-15T23:24:15.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.599+0000 7fb9ac80f740 1 -- 172.21.15.123:0/2100416205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55beeae8e0e0 msgr2=0x55beeaeb1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:15.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.599+0000 7fb9ac80f740 1 --2- 172.21.15.123:0/2100416205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55beeae8e0e0 0x55beeaeb1d60 secure :-1 s=READY pgs=2426 cs=0 l=1 rev1=1 crypto rx=0x7fb994001330 tx=0x7fb99401e000 comp rx=0 tx=0).stop 2024-09-15T23:24:15.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.599+0000 7fb9ac80f740 1 -- 172.21.15.123:0/2100416205 shutdown_connections 2024-09-15T23:24:15.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.599+0000 7fb9ac80f740 1 --2- 172.21.15.123:0/2100416205 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55beeae920b0 0x55beeaed3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.599+0000 7fb9ac80f740 1 --2- 172.21.15.123:0/2100416205 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55beeae90920 0x55beeaed3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.599+0000 7fb9ac80f740 1 --2- 172.21.15.123:0/2100416205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55beeae8e0e0 0x55beeaeb1d60 unknown :-1 s=CLOSED pgs=2426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.599+0000 7fb9ac80f740 1 -- 172.21.15.123:0/2100416205 >> 172.21.15.123:0/2100416205 conn(0x55beeaedd6f0 msgr2=0x55beeaed5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:15.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.599+0000 7fb9ac80f740 1 -- 172.21.15.123:0/2100416205 shutdown_connections 2024-09-15T23:24:15.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.599+0000 7fb9ac80f740 1 -- 172.21.15.123:0/2100416205 wait complete. 2024-09-15T23:24:15.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.599+0000 7fb9ac80f740 1 -- start start 2024-09-15T23:24:15.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.599+0000 7fb9ac80f740 1 Processor -- start 2024-09-15T23:24:15.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.600+0000 7fb9ac80f740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55beeae8e0e0 0x55beeaf53150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.600+0000 7fb9ac80f740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55beeae90920 0x55beeaeb5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.600+0000 7fb9ac80f740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55beeae920b0 0x55beeaeb61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.600+0000 7fb9ac80f740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a41f8290 con 0x55beeae8e0e0 2024-09-15T23:24:15.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.600+0000 7fb9ac80f740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55beeaeb96b0 con 0x55beeae90920 2024-09-15T23:24:15.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.600+0000 7fb9ac80f740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55beeaef9180 con 0x55beeae920b0 2024-09-15T23:24:15.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.600+0000 7fb9ac80f740 10 client.0 _ll_register_callbacks cb 0x7fb994005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:24:15.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.600+0000 7fb9a37fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55beeae8e0e0 0x55beeaf53150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.600+0000 7fb9a37fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55beeae8e0e0 0x55beeaf53150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39358/0 (socket says 172.21.15.123:39358) 2024-09-15T23:24:15.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.600+0000 7fb9a37fe640 1 -- 172.21.15.123:0/3890130803 learned_addr learned my addr 172.21.15.123:0/3890130803 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:15.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.600+0000 7fb9a37fe640 1 -- 172.21.15.123:0/3890130803 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55beeae920b0 msgr2=0x55beeaeb61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:15.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.600+0000 7fb9a37fe640 1 --2- 172.21.15.123:0/3890130803 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55beeae920b0 0x55beeaeb61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.600+0000 7fb9a2ffd640 1 --2- 172.21.15.123:0/3890130803 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55beeae90920 0x55beeaeb5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.600+0000 7fb9a37fe640 1 -- 172.21.15.123:0/3890130803 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55beeae90920 msgr2=0x55beeaeb5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:15.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.600+0000 7fb9a37fe640 1 --2- 172.21.15.123:0/3890130803 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55beeae90920 0x55beeaeb5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.601+0000 7fb9a37fe640 1 -- 172.21.15.123:0/3890130803 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55beeaf53690 con 0x55beeae8e0e0 2024-09-15T23:24:15.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.601+0000 7fb9a37fe640 1 --2- 172.21.15.123:0/3890130803 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55beeae8e0e0 0x55beeaf53150 secure :-1 s=READY pgs=2427 cs=0 l=1 rev1=1 crypto rx=0x7fb994002230 tx=0x7fb994007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48fe06309699ecfd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:15.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.601+0000 7fb9827fc640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:24:15.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.601+0000 7fb9827fc640 1 -- 172.21.15.123:0/3890130803 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb994021450 con 0x55beeae8e0e0 2024-09-15T23:24:15.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.601+0000 7fb9827fc640 1 -- 172.21.15.123:0/3890130803 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(206..206 src has 1..206) ==== 5709+0+0 (secure 0 0 0) 0x7fb99403eab0 con 0x55beeae8e0e0 2024-09-15T23:24:15.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.601+0000 7fb9ac80f740 1 -- 172.21.15.123:0/3890130803 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9940144f0 con 0x55beeae8e0e0 2024-09-15T23:24:15.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.601+0000 7fb9827fc640 1 -- 172.21.15.123:0/3890130803 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=127) ==== 24+0+0 (secure 0 0 0) 0x7fb99403ecb0 con 0x55beeae8e0e0 2024-09-15T23:24:15.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.601+0000 7fb9ac80f740 10 client.11136 fetch_fsmap learned FSMap version 127 2024-09-15T23:24:15.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.601+0000 7fb9ac80f740 1 -- 172.21.15.123:0/3890130803 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=127,monmap=2+}) -- 0x55beeaef8ec0 con 0x55beeae8e0e0 2024-09-15T23:24:15.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.601+0000 7fb9827fc640 1 -- 172.21.15.123:0/3890130803 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9940144f0 con 0x55beeae8e0e0 2024-09-15T23:24:15.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.601+0000 7fb9827fc640 1 -- 172.21.15.123:0/3890130803 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 127) ==== 3502+0+0 (secure 0 0 0) 0x7fb9940215f0 con 0x55beeae8e0e0 2024-09-15T23:24:15.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.601+0000 7fb9ac80f740 10 client.11136 fetch_fsmap finished waiting for FSMap version 127 2024-09-15T23:24:15.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.601+0000 7fb9ac80f740 10 client.11136 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.c 2024-09-15T23:24:15.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.601+0000 7fb9ac80f740 20 client.11136 populate_metadata read hostname 'smithi123' 2024-09-15T23:24:15.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.601+0000 7fb9ac80f740 1 --2- 172.21.15.123:0/3890130803 >> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] conn(0x55beeaebae00 0x55beeaee43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:15.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.601+0000 7fb9ac80f740 4 client.11136 mds_command: new command op to 10905 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:24:15.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.601+0000 7fb9ac80f740 1 -- 172.21.15.123:0/3890130803 --> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55beeadfb170 con 0x55beeaebae00 2024-09-15T23:24:15.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.601+0000 7fb9a2ffd640 1 --2- 172.21.15.123:0/3890130803 >> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] conn(0x55beeaebae00 0x55beeaee43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:15.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.602+0000 7fb9827fc640 10 client.11136 ms_handle_connect on v2:172.21.15.123:6832/1661365546 2024-09-15T23:24:15.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.602+0000 7fb9a2ffd640 1 --2- 172.21.15.123:0/3890130803 >> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] conn(0x55beeaebae00 0x55beeaee43c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac3a6a002d2361da server_cookie=17ca8307819710b9 in_seq=0 out_seq=0 2024-09-15T23:24:15.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.602+0000 7fb9827fc640 1 -- 172.21.15.123:0/3890130803 <== mds.0 v2:172.21.15.123:6832/1661365546 1 ==== command_reply(tid 0: 0 ) ==== 8+0+260 (crc 0 0 0) 0x55beeadfb170 con 0x55beeaebae00 2024-09-15T23:24:15.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.602+0000 7fb9827fc640 10 client.11136 handle_command_reply: tid=0 2024-09-15T23:24:15.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.602+0000 7fb9ac80f740 1 client.11136 shutdown 2024-09-15T23:24:15.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.602+0000 7fb9ac80f740 1 -- 172.21.15.123:0/3890130803 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55beeae8e0e0 msgr2=0x55beeaf53150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:15.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.602+0000 7fb9ac80f740 1 --2- 172.21.15.123:0/3890130803 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55beeae8e0e0 0x55beeaf53150 secure :-1 s=READY pgs=2427 cs=0 l=1 rev1=1 crypto rx=0x7fb994002230 tx=0x7fb994007000 comp rx=0 tx=0).stop 2024-09-15T23:24:15.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.602+0000 7fb9ac80f740 1 -- 172.21.15.123:0/3890130803 shutdown_connections 2024-09-15T23:24:15.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.602+0000 7fb9ac80f740 1 --2- 172.21.15.123:0/3890130803 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55beeae920b0 0x55beeaeb61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.602+0000 7fb9ac80f740 1 --2- 172.21.15.123:0/3890130803 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55beeae90920 0x55beeaeb5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.602+0000 7fb9ac80f740 1 --2- 172.21.15.123:0/3890130803 >> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] conn(0x55beeaebae00 0x55beeaee43c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.602+0000 7fb9ac80f740 1 --2- 172.21.15.123:0/3890130803 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55beeae8e0e0 0x55beeaf53150 unknown :-1 s=CLOSED pgs=2427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.602+0000 7fb9ac80f740 1 -- 172.21.15.123:0/3890130803 >> 172.21.15.123:0/3890130803 conn(0x55beeaedd6f0 msgr2=0x55beeaed3730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:15.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.602+0000 7fb9827fc640 0 client.11136 ms_handle_reset on v2:172.21.15.123:6832/1661365546 2024-09-15T23:24:15.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.602+0000 7fb9ac80f740 1 -- 172.21.15.123:0/3890130803 shutdown_connections 2024-09-15T23:24:15.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.602+0000 7fb9ac80f740 1 -- 172.21.15.123:0/3890130803 wait complete. 2024-09-15T23:24:15.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.602+0000 7fb9ac80f740 20 client.11136 trim_cache size 0 max 16384 2024-09-15T23:24:15.614 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:24:15.615 INFO:teuthology.orchestra.run.smithi123.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-15T23:24:15.615 INFO:teuthology.orchestra.run.smithi123.stdout: "scrubs": { 2024-09-15T23:24:15.615 INFO:teuthology.orchestra.run.smithi123.stdout: "4d7003c9-e7af-4361-9a24-c05e16c15f09": { 2024-09-15T23:24:15.615 INFO:teuthology.orchestra.run.smithi123.stdout: "path": "/", 2024-09-15T23:24:15.615 INFO:teuthology.orchestra.run.smithi123.stdout: "tag": "4d7003c9-e7af-4361-9a24-c05e16c15f09", 2024-09-15T23:24:15.615 INFO:teuthology.orchestra.run.smithi123.stdout: "options": "recursive,repair" 2024-09-15T23:24:15.616 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:24:15.616 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-09-15T23:24:15.616 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:24:15.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.603+0000 7fb9a9a77640 1 -- 172.21.15.123:0/1704995105 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb99006c2b0 msgr2=0x7fb99006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:15.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.603+0000 7fb9a9a77640 1 --2- 172.21.15.123:0/1704995105 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb99006c2b0 0x7fb99006e770 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fb9940012e0 tx=0x7fb994009040 comp rx=0 tx=0).stop 2024-09-15T23:24:15.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.603+0000 7fb9a9a77640 1 -- 172.21.15.123:0/1704995105 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9a415e990 msgr2=0x7fb9a40d15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:15.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.603+0000 7fb9a9a77640 1 --2- 172.21.15.123:0/1704995105 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9a415e990 0x7fb9a40d15d0 secure :-1 s=READY pgs=2423 cs=0 l=1 rev1=1 crypto rx=0x7fb99800c480 tx=0x7fb99800c940 comp rx=0 tx=0).stop 2024-09-15T23:24:15.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.603+0000 7fb9a9a77640 1 -- 172.21.15.123:0/1704995105 shutdown_connections 2024-09-15T23:24:15.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.603+0000 7fb9a9a77640 1 --2- 172.21.15.123:0/1704995105 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb9a4162a00 0x7fb9a4158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.603+0000 7fb9a9a77640 1 --2- 172.21.15.123:0/1704995105 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb99006c2b0 0x7fb99006e770 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.603+0000 7fb9a9a77640 1 --2- 172.21.15.123:0/1704995105 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9a415e990 0x7fb9a40d15d0 unknown :-1 s=CLOSED pgs=2423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.603+0000 7fb9a9a77640 1 --2- 172.21.15.123:0/1704995105 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb9a40b5520 0x7fb9a40cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:15.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.603+0000 7fb9a9a77640 1 -- 172.21.15.123:0/1704995105 >> 172.21.15.123:0/1704995105 conn(0x7fb9a40d25d0 msgr2=0x7fb9a4158200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:15.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.603+0000 7fb9a9a77640 1 -- 172.21.15.123:0/1704995105 shutdown_connections 2024-09-15T23:24:15.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:15.603+0000 7fb9a9a77640 1 -- 172.21.15.123:0/1704995105 wait complete. 2024-09-15T23:24:15.619 INFO:tasks.cephfs.filesystem:scrub status for tag:4d7003c9-e7af-4361-9a24-c05e16c15f09 - {'path': '/', 'tag': '4d7003c9-e7af-4361-9a24-c05e16c15f09', 'options': 'recursive,repair'} 2024-09-15T23:24:40.849 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:24:40.852 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:24:45.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:24:45.620 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.14:0 scrub status 2024-09-15T23:24:45.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.733+0000 7f5ecd78d640 1 Processor -- start 2024-09-15T23:24:45.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.733+0000 7f5ecd78d640 1 -- start start 2024-09-15T23:24:45.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.734+0000 7f5ecd78d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f5ec8071db0 0x7f5ec8072240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:45.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.734+0000 7f5ecd78d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5ec8160100 0x7f5ec8160570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:45.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.734+0000 7f5ecd78d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ec81590f0 con 0x7f5ec8158d10 2024-09-15T23:24:45.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.734+0000 7f5ecd78d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f5ec8071ab0 con 0x7f5ec8071db0 2024-09-15T23:24:45.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.734+0000 7f5ecd78d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5ec815f040 con 0x7f5ec8160100 2024-09-15T23:24:45.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.734+0000 7f5ec6ffd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f5ec8158d10 0x7f5ec80713a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:48336/0 (socket says 172.21.15.123:48336) 2024-09-15T23:24:45.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.734+0000 7f5ec6ffd640 1 -- 172.21.15.123:0/3162227325 learned_addr learned my addr 172.21.15.123:0/3162227325 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:45.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.734+0000 7f5ec77fe640 1 --2- 172.21.15.123:0/3162227325 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5ec8160100 0x7f5ec8160570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:45.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.734+0000 7f5ec67fc640 1 --2- 172.21.15.123:0/3162227325 >> v2:172.21.15.188:3300/0 conn(0x7f5ec8071db0 0x7f5ec8072240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:45.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.734+0000 7f5ec5ffb640 1 -- 172.21.15.123:0/3162227325 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3086325741 0 0) 0x7f5ec81590f0 con 0x7f5ec8158d10 2024-09-15T23:24:45.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.734+0000 7f5ec5ffb640 1 -- 172.21.15.123:0/3162227325 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5eb0003520 con 0x7f5ec8158d10 2024-09-15T23:24:45.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.734+0000 7f5ec5ffb640 1 -- 172.21.15.123:0/3162227325 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1404430748 0 0) 0x7f5eb0003520 con 0x7f5ec8158d10 2024-09-15T23:24:45.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.734+0000 7f5ec5ffb640 1 -- 172.21.15.123:0/3162227325 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5ec8160100 msgr2=0x7f5ec8160570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:45.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.734+0000 7f5ec5ffb640 1 --2- 172.21.15.123:0/3162227325 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5ec8160100 0x7f5ec8160570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:45.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.734+0000 7f5ec5ffb640 1 -- 172.21.15.123:0/3162227325 >> v2:172.21.15.188:3300/0 conn(0x7f5ec8071db0 msgr2=0x7f5ec8072240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:45.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.734+0000 7f5ec5ffb640 1 --2- 172.21.15.123:0/3162227325 >> v2:172.21.15.188:3300/0 conn(0x7f5ec8071db0 0x7f5ec8072240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:45.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.734+0000 7f5ec5ffb640 1 -- 172.21.15.123:0/3162227325 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec815f320 con 0x7f5ec8158d10 2024-09-15T23:24:45.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.734+0000 7f5ec5ffb640 1 -- 172.21.15.123:0/3162227325 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f5eb8001670 con 0x7f5ec8158d10 2024-09-15T23:24:45.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.734+0000 7f5ec5ffb640 1 -- 172.21.15.123:0/3162227325 >> v1:172.21.15.123:6789/0 conn(0x7f5ec8158d10 legacy=0x7f5ec80713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:45.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.734+0000 7f5ec5ffb640 1 --2- 172.21.15.123:0/3162227325 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5eb00039b0 0x7f5eb0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:45.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.734+0000 7f5ec5ffb640 1 --2- 172.21.15.123:0/3162227325 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5ec8160100 0x7f5eb0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:45.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.734+0000 7f5ec5ffb640 1 --2- 172.21.15.123:0/3162227325 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5eb0004d40 0x7f5eb00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:45.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.734+0000 7f5ec5ffb640 1 -- 172.21.15.123:0/3162227325 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec815f040 con 0x7f5eb0004d40 2024-09-15T23:24:45.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.734+0000 7f5ec5ffb640 1 -- 172.21.15.123:0/3162227325 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5eb000b9c0 con 0x7f5eb00039b0 2024-09-15T23:24:45.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.734+0000 7f5ec5ffb640 1 -- 172.21.15.123:0/3162227325 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5eb000bb40 con 0x7f5ec8160100 2024-09-15T23:24:45.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.734+0000 7f5ec77fe640 1 --2- 172.21.15.123:0/3162227325 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5eb0004d40 0x7f5eb00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:45.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.735+0000 7f5ec6ffd640 1 --2- 172.21.15.123:0/3162227325 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5eb00039b0 0x7f5eb0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:45.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.735+0000 7f5ec67fc640 1 --2- 172.21.15.123:0/3162227325 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5ec8160100 0x7f5eb0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:45.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.735+0000 7f5ec77fe640 1 -- 172.21.15.123:0/3162227325 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5ec8160100 msgr2=0x7f5eb0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:45.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.735+0000 7f5ec77fe640 1 --2- 172.21.15.123:0/3162227325 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5ec8160100 0x7f5eb0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:45.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.735+0000 7f5ec77fe640 1 -- 172.21.15.123:0/3162227325 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5eb00039b0 msgr2=0x7f5eb0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:45.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.735+0000 7f5ec77fe640 1 --2- 172.21.15.123:0/3162227325 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5eb00039b0 0x7f5eb0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:45.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.735+0000 7f5ec77fe640 1 -- 172.21.15.123:0/3162227325 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eb0003520 con 0x7f5eb0004d40 2024-09-15T23:24:45.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.735+0000 7f5ec77fe640 1 --2- 172.21.15.123:0/3162227325 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5eb0004d40 0x7f5eb00051c0 secure :-1 s=READY pgs=2429 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0009fc0 tx=0x7f5eb0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb5472667cf6e62f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:45.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.736+0000 7f5ec5ffb640 1 -- 172.21.15.123:0/3162227325 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec0009c10 con 0x7f5eb0004d40 2024-09-15T23:24:45.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.736+0000 7f5ec5ffb640 1 -- 172.21.15.123:0/3162227325 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ec0036070 con 0x7f5eb0004d40 2024-09-15T23:24:45.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.736+0000 7f5ec5ffb640 1 -- 172.21.15.123:0/3162227325 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec0031880 con 0x7f5eb0004d40 2024-09-15T23:24:45.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.736+0000 7f5ecd78d640 1 -- 172.21.15.123:0/3162227325 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5eb0004d40 msgr2=0x7f5eb00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:45.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.736+0000 7f5ecd78d640 1 --2- 172.21.15.123:0/3162227325 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5eb0004d40 0x7f5eb00051c0 secure :-1 s=READY pgs=2429 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0009fc0 tx=0x7f5eb0005830 comp rx=0 tx=0).stop 2024-09-15T23:24:45.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.736+0000 7f5ec77fe640 1 -- 172.21.15.123:0/3162227325 reap_dead start 2024-09-15T23:24:45.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.736+0000 7f5ecd78d640 1 -- 172.21.15.123:0/3162227325 shutdown_connections 2024-09-15T23:24:45.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.736+0000 7f5ecd78d640 1 -- 172.21.15.123:0/3162227325 >> 172.21.15.123:0/3162227325 conn(0x7f5ec80b2510 msgr2=0x7f5ec80b28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:45.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.736+0000 7f5ecd78d640 1 -- 172.21.15.123:0/3162227325 shutdown_connections 2024-09-15T23:24:45.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.736+0000 7f5ecd78d640 1 -- 172.21.15.123:0/3162227325 wait complete. 2024-09-15T23:24:45.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.738+0000 7f5ecd78d640 1 Processor -- start 2024-09-15T23:24:45.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.738+0000 7f5ecd78d640 1 -- start start 2024-09-15T23:24:45.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.738+0000 7f5ecd78d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5eb0004d40 0x7f5ec8152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:45.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.738+0000 7f5ecd78d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5ec8148640 0x7f5ec8147e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:45.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.738+0000 7f5ecd78d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ec8154780 0x7f5ec8154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:45.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.738+0000 7f5ecd78d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec815fbc0 con 0x7f5ec8154780 2024-09-15T23:24:45.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.738+0000 7f5ecd78d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec815f8e0 con 0x7f5eb0004d40 2024-09-15T23:24:45.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.738+0000 7f5ecd78d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5ec815ec00 con 0x7f5ec8148640 2024-09-15T23:24:45.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.739+0000 7f5ec77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ec8154780 0x7f5ec8154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:45.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.739+0000 7f5ec77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ec8154780 0x7f5ec8154c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50320/0 (socket says 172.21.15.123:50320) 2024-09-15T23:24:45.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.739+0000 7f5ec77fe640 1 -- 172.21.15.123:0/3159648094 learned_addr learned my addr 172.21.15.123:0/3159648094 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:45.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.739+0000 7f5ec67fc640 1 --2- 172.21.15.123:0/3159648094 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5ec8148640 0x7f5ec8147e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:45.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.739+0000 7f5ec6ffd640 1 --2- 172.21.15.123:0/3159648094 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5eb0004d40 0x7f5ec8152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:45.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.739+0000 7f5ec77fe640 1 -- 172.21.15.123:0/3159648094 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5ec8148640 msgr2=0x7f5ec8147e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:45.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.739+0000 7f5ec77fe640 1 --2- 172.21.15.123:0/3159648094 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5ec8148640 0x7f5ec8147e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:45.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.739+0000 7f5ec77fe640 1 -- 172.21.15.123:0/3159648094 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5eb0004d40 msgr2=0x7f5ec8152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:45.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.739+0000 7f5ec77fe640 1 --2- 172.21.15.123:0/3159648094 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5eb0004d40 0x7f5ec8152590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:45.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.739+0000 7f5ec77fe640 1 -- 172.21.15.123:0/3159648094 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec8155450 con 0x7f5ec8154780 2024-09-15T23:24:45.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.739+0000 7f5ec77fe640 1 --2- 172.21.15.123:0/3159648094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ec8154780 0x7f5ec8154c30 secure :-1 s=READY pgs=2430 cs=0 l=1 rev1=1 crypto rx=0x7f5ec000e230 tx=0x7f5ec0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:45.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.739+0000 7f5eaf7fe640 1 -- 172.21.15.123:0/3159648094 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec0009c10 con 0x7f5ec8154780 2024-09-15T23:24:45.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.739+0000 7f5eaf7fe640 1 -- 172.21.15.123:0/3159648094 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ec0031dd0 con 0x7f5ec8154780 2024-09-15T23:24:45.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.739+0000 7f5eaf7fe640 1 -- 172.21.15.123:0/3159648094 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec0003bd0 con 0x7f5ec8154780 2024-09-15T23:24:45.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.739+0000 7f5ecd78d640 1 -- 172.21.15.123:0/3159648094 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ec8152ed0 con 0x7f5ec8154780 2024-09-15T23:24:45.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.739+0000 7f5ecd78d640 1 -- 172.21.15.123:0/3159648094 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ec81559a0 con 0x7f5ec8154780 2024-09-15T23:24:45.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.741+0000 7f5eaf7fe640 1 -- 172.21.15.123:0/3159648094 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5ec0005d10 con 0x7f5ec8154780 2024-09-15T23:24:45.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.742+0000 7f5eaf7fe640 1 --2- 172.21.15.123:0/3159648094 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5eb406c2e0 0x7f5eb406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:45.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.742+0000 7f5eaf7fe640 1 -- 172.21.15.123:0/3159648094 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 5709+0+0 (secure 0 0 0) 0x7f5ec00ac9b0 con 0x7f5ec8154780 2024-09-15T23:24:45.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.742+0000 7f5ec6ffd640 1 --2- 172.21.15.123:0/3159648094 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5eb406c2e0 0x7f5eb406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:45.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.742+0000 7f5ed0607740 1 Processor -- start 2024-09-15T23:24:45.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.743+0000 7f5ec6ffd640 1 --2- 172.21.15.123:0/3159648094 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5eb406c2e0 0x7f5eb406e7a0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8007fd0 tx=0x7f5eb8007970 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:45.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.743+0000 7f5ed0607740 1 -- start start 2024-09-15T23:24:45.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.743+0000 7f5ed0607740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d233362920 0x55d2333a80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:45.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.743+0000 7f5ed0607740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d2333600e0 0x55d233362d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:45.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.743+0000 7f5ed0607740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d2333640b0 0x55d23335d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:45.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.743+0000 7f5ed0607740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d2332c56f0 con 0x55d2333600e0 2024-09-15T23:24:45.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.743+0000 7f5ed0607740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55d23326d330 con 0x55d233362920 2024-09-15T23:24:45.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.743+0000 7f5ed0607740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55d2332c16b0 con 0x55d2333640b0 2024-09-15T23:24:45.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.744+0000 7f5ec67fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d2333600e0 0x55d233362d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:45.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.744+0000 7f5ec67fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d2333600e0 0x55d233362d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50326/0 (socket says 172.21.15.123:50326) 2024-09-15T23:24:45.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.744+0000 7f5ec67fc640 1 -- 172.21.15.123:0/957106983 learned_addr learned my addr 172.21.15.123:0/957106983 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:45.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.744+0000 7f5ec6ffd640 1 --2- 172.21.15.123:0/957106983 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d233362920 0x55d2333a80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:45.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.744+0000 7f5ec77fe640 1 --2- 172.21.15.123:0/957106983 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d2333640b0 0x55d23335d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:45.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.744+0000 7f5ec67fc640 1 -- 172.21.15.123:0/957106983 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d2333640b0 msgr2=0x55d23335d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:45.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.744+0000 7f5ec67fc640 1 --2- 172.21.15.123:0/957106983 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d2333640b0 0x55d23335d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:45.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.744+0000 7f5ec67fc640 1 -- 172.21.15.123:0/957106983 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d233362920 msgr2=0x55d2333a80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:45.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.744+0000 7f5ec67fc640 1 --2- 172.21.15.123:0/957106983 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d233362920 0x55d2333a80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:45.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.744+0000 7f5ec67fc640 1 -- 172.21.15.123:0/957106983 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2332930d0 con 0x55d2333600e0 2024-09-15T23:24:45.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.744+0000 7f5ec67fc640 1 --2- 172.21.15.123:0/957106983 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d2333600e0 0x55d233362d00 secure :-1 s=READY pgs=2431 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc009cf0 tx=0x7f5ebc014780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95cfd7b8a97a6bb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:45.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.744+0000 7f5eacff9640 1 -- 172.21.15.123:0/957106983 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc015420 con 0x55d2333600e0 2024-09-15T23:24:45.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.744+0000 7f5eacff9640 1 -- 172.21.15.123:0/957106983 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ebc019070 con 0x55d2333600e0 2024-09-15T23:24:45.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.744+0000 7f5eacff9640 1 -- 172.21.15.123:0/957106983 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc0157e0 con 0x55d2333600e0 2024-09-15T23:24:45.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.745+0000 7f5ed0607740 1 -- 172.21.15.123:0/957106983 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d2333600e0 msgr2=0x55d233362d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:45.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.745+0000 7f5ed0607740 1 --2- 172.21.15.123:0/957106983 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d2333600e0 0x55d233362d00 secure :-1 s=READY pgs=2431 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc009cf0 tx=0x7f5ebc014780 comp rx=0 tx=0).stop 2024-09-15T23:24:45.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.745+0000 7f5ed0607740 1 -- 172.21.15.123:0/957106983 shutdown_connections 2024-09-15T23:24:45.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.745+0000 7f5ed0607740 1 --2- 172.21.15.123:0/957106983 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d2333640b0 0x55d23335d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:45.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.745+0000 7f5ed0607740 1 --2- 172.21.15.123:0/957106983 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d2333600e0 0x55d233362d00 unknown :-1 s=CLOSED pgs=2431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:45.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.745+0000 7f5ed0607740 1 --2- 172.21.15.123:0/957106983 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d233362920 0x55d2333a80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:45.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.745+0000 7f5ed0607740 1 -- 172.21.15.123:0/957106983 >> 172.21.15.123:0/957106983 conn(0x55d23335f370 msgr2=0x55d2333a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:45.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.745+0000 7f5ed0607740 1 -- 172.21.15.123:0/957106983 shutdown_connections 2024-09-15T23:24:45.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.745+0000 7f5ed0607740 1 -- 172.21.15.123:0/957106983 wait complete. 2024-09-15T23:24:45.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.745+0000 7f5ed0607740 1 -- start start 2024-09-15T23:24:45.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.745+0000 7f5ed0607740 1 Processor -- start 2024-09-15T23:24:45.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.746+0000 7f5ed0607740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d233362920 0x55d23338b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:45.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.746+0000 7f5ed0607740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d2333640b0 0x55d2333ba3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:45.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.746+0000 7f5ed0607740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2333a4420 0x55d2333a48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:45.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.746+0000 7f5ed0607740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d23335e810 con 0x55d2333640b0 2024-09-15T23:24:45.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.746+0000 7f5ed0607740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55d23324e4f0 con 0x55d2333a4420 2024-09-15T23:24:45.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.746+0000 7f5ed0607740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55d2333a88f0 con 0x55d233362920 2024-09-15T23:24:45.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.746+0000 7f5ed0607740 10 client.0 _ll_register_callbacks cb 0x55d23326fb50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:24:45.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.746+0000 7f5ec67fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d2333640b0 0x55d2333ba3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:45.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.746+0000 7f5ec67fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d2333640b0 0x55d2333ba3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50328/0 (socket says 172.21.15.123:50328) 2024-09-15T23:24:45.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.746+0000 7f5ec67fc640 1 -- 172.21.15.123:0/949106176 learned_addr learned my addr 172.21.15.123:0/949106176 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:45.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.746+0000 7f5ec6ffd640 1 --2- 172.21.15.123:0/949106176 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d233362920 0x55d23338b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:45.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.746+0000 7f5ec77fe640 1 --2- 172.21.15.123:0/949106176 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2333a4420 0x55d2333a48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:45.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.747+0000 7f5ec67fc640 1 -- 172.21.15.123:0/949106176 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d233362920 msgr2=0x55d23338b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:45.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.747+0000 7f5ec67fc640 1 --2- 172.21.15.123:0/949106176 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d233362920 0x55d23338b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:45.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.747+0000 7f5ec67fc640 1 -- 172.21.15.123:0/949106176 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2333a4420 msgr2=0x55d2333a48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:45.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.747+0000 7f5ec67fc640 1 --2- 172.21.15.123:0/949106176 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2333a4420 0x55d2333a48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:45.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.747+0000 7f5ec67fc640 1 -- 172.21.15.123:0/949106176 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2330a27d0 con 0x55d2333640b0 2024-09-15T23:24:45.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.747+0000 7f5ec77fe640 1 --2- 172.21.15.123:0/949106176 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2333a4420 0x55d2333a48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:24:45.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.747+0000 7f5ec6ffd640 1 --2- 172.21.15.123:0/949106176 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d233362920 0x55d23338b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:24:45.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.747+0000 7f5ec67fc640 1 --2- 172.21.15.123:0/949106176 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d2333640b0 0x55d2333ba3a0 secure :-1 s=READY pgs=2432 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc009c90 tx=0x7f5ebc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=554f8d40de4875e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:45.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.747+0000 7f5ea5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:24:45.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.747+0000 7f5ea5ffb640 1 -- 172.21.15.123:0/949106176 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc02c020 con 0x55d2333640b0 2024-09-15T23:24:45.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.747+0000 7f5ea5ffb640 1 -- 172.21.15.123:0/949106176 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(206..206 src has 1..206) ==== 5709+0+0 (secure 0 0 0) 0x7f5ebc006600 con 0x55d2333640b0 2024-09-15T23:24:45.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.747+0000 7f5ed0607740 1 -- 172.21.15.123:0/949106176 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ebc019070 con 0x55d2333640b0 2024-09-15T23:24:45.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.747+0000 7f5ea5ffb640 1 -- 172.21.15.123:0/949106176 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=127) ==== 24+0+0 (secure 0 0 0) 0x7f5ebc005e40 con 0x55d2333640b0 2024-09-15T23:24:45.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.747+0000 7f5ed0607740 10 client.11148 fetch_fsmap learned FSMap version 127 2024-09-15T23:24:45.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.747+0000 7f5ed0607740 1 -- 172.21.15.123:0/949106176 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=127,monmap=2+}) -- 0x55d232fd83f0 con 0x55d2333640b0 2024-09-15T23:24:45.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.747+0000 7f5ea5ffb640 1 -- 172.21.15.123:0/949106176 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ebc019070 con 0x55d2333640b0 2024-09-15T23:24:45.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.747+0000 7f5ea5ffb640 1 -- 172.21.15.123:0/949106176 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 127) ==== 3502+0+0 (secure 0 0 0) 0x7f5ebc004020 con 0x55d2333640b0 2024-09-15T23:24:45.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.747+0000 7f5ed0607740 10 client.11148 fetch_fsmap finished waiting for FSMap version 127 2024-09-15T23:24:45.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.747+0000 7f5ed0607740 10 client.11148 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.c 2024-09-15T23:24:45.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.747+0000 7f5ed0607740 20 client.11148 populate_metadata read hostname 'smithi123' 2024-09-15T23:24:45.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.747+0000 7f5ed0607740 1 --2- 172.21.15.123:0/949106176 >> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] conn(0x55d2333a2ef0 0x55d2333a32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:45.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.747+0000 7f5ed0607740 4 client.11148 mds_command: new command op to 10905 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:24:45.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.747+0000 7f5ed0607740 1 -- 172.21.15.123:0/949106176 --> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d2332d2e20 con 0x55d2333a2ef0 2024-09-15T23:24:45.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.748+0000 7f5ec6ffd640 1 --2- 172.21.15.123:0/949106176 >> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] conn(0x55d2333a2ef0 0x55d2333a32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:45.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.748+0000 7f5ea5ffb640 10 client.11148 ms_handle_connect on v2:172.21.15.123:6832/1661365546 2024-09-15T23:24:45.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.748+0000 7f5ec6ffd640 1 --2- 172.21.15.123:0/949106176 >> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] conn(0x55d2333a2ef0 0x55d2333a32f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d41ebe170c355d1 server_cookie=776477b26c4cb3cf in_seq=0 out_seq=0 2024-09-15T23:24:45.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.748+0000 7f5ea5ffb640 1 -- 172.21.15.123:0/949106176 <== mds.0 v2:172.21.15.123:6832/1661365546 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d2332d2e20 con 0x55d2333a2ef0 2024-09-15T23:24:45.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.748+0000 7f5ea5ffb640 10 client.11148 handle_command_reply: tid=0 2024-09-15T23:24:45.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.748+0000 7f5ed0607740 1 client.11148 shutdown 2024-09-15T23:24:45.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.749+0000 7f5ed0607740 1 -- 172.21.15.123:0/949106176 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d2333640b0 msgr2=0x55d2333ba3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:45.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.749+0000 7f5ed0607740 1 --2- 172.21.15.123:0/949106176 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d2333640b0 0x55d2333ba3a0 secure :-1 s=READY pgs=2432 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc009c90 tx=0x7f5ebc0046c0 comp rx=0 tx=0).stop 2024-09-15T23:24:45.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.749+0000 7f5ed0607740 1 -- 172.21.15.123:0/949106176 shutdown_connections 2024-09-15T23:24:45.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.749+0000 7f5ed0607740 1 --2- 172.21.15.123:0/949106176 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2333a4420 0x55d2333a48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:45.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.749+0000 7f5ed0607740 1 --2- 172.21.15.123:0/949106176 >> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] conn(0x55d2333a2ef0 0x55d2333a32f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:45.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.749+0000 7f5ed0607740 1 --2- 172.21.15.123:0/949106176 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d2333640b0 0x55d2333ba3a0 unknown :-1 s=CLOSED pgs=2432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:45.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.749+0000 7f5ed0607740 1 --2- 172.21.15.123:0/949106176 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d233362920 0x55d23338b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:45.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.749+0000 7f5ea5ffb640 0 client.11148 ms_handle_reset on v2:172.21.15.123:6832/1661365546 2024-09-15T23:24:45.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.749+0000 7f5ed0607740 1 -- 172.21.15.123:0/949106176 >> 172.21.15.123:0/949106176 conn(0x55d2333600e0 msgr2=0x55d2333a6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:45.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.749+0000 7f5ed0607740 1 -- 172.21.15.123:0/949106176 shutdown_connections 2024-09-15T23:24:45.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.749+0000 7f5ed0607740 1 -- 172.21.15.123:0/949106176 wait complete. 2024-09-15T23:24:45.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.749+0000 7f5ed0607740 20 client.11148 trim_cache size 0 max 16384 2024-09-15T23:24:45.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.766+0000 7f5ed0607740 1 Processor -- start 2024-09-15T23:24:45.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.766+0000 7f5ed0607740 1 -- start start 2024-09-15T23:24:45.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.767+0000 7f5ed0607740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d233362920 0x55d23335eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:45.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.767+0000 7f5ed0607740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2333640b0 0x55d2333a5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:45.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.767+0000 7f5ed0607740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d2333a4420 0x55d23335d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:45.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.767+0000 7f5ed0607740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec8201360 con 0x55d2333a4420 2024-09-15T23:24:45.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.767+0000 7f5ed0607740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec8200340 con 0x55d2333640b0 2024-09-15T23:24:45.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.767+0000 7f5ed0607740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f5ec815a460 con 0x55d233362920 2024-09-15T23:24:45.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.767+0000 7f5ec77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d2333a4420 0x55d23335d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:45.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.767+0000 7f5ec77fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d2333a4420 0x55d23335d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50340/0 (socket says 172.21.15.123:50340) 2024-09-15T23:24:45.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.767+0000 7f5ec77fe640 1 -- 172.21.15.123:0/2963836641 learned_addr learned my addr 172.21.15.123:0/2963836641 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:45.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.767+0000 7f5ec77fe640 1 -- 172.21.15.123:0/2963836641 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d233362920 msgr2=0x55d23335eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:45.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.767+0000 7f5ec77fe640 1 --2- 172.21.15.123:0/2963836641 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d233362920 0x55d23335eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:45.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.767+0000 7f5ec77fe640 1 -- 172.21.15.123:0/2963836641 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2333640b0 msgr2=0x55d2333a5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:45.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.767+0000 7f5ec77fe640 1 --2- 172.21.15.123:0/2963836641 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2333640b0 0x55d2333a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:45.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.767+0000 7f5ec77fe640 1 -- 172.21.15.123:0/2963836641 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d232f980f0 con 0x55d2333a4420 2024-09-15T23:24:45.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.767+0000 7f5ec77fe640 1 --2- 172.21.15.123:0/2963836641 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d2333a4420 0x55d23335d300 secure :-1 s=READY pgs=2433 cs=0 l=1 rev1=1 crypto rx=0x7f5ec007a7b0 tx=0x7f5ec000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f3d6958f4ab6d9c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:45.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.767+0000 7f5ea7fff640 1 -- 172.21.15.123:0/2963836641 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec007aab0 con 0x55d2333a4420 2024-09-15T23:24:45.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.767+0000 7f5ea7fff640 1 -- 172.21.15.123:0/2963836641 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ec00a9070 con 0x55d2333a4420 2024-09-15T23:24:45.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.767+0000 7f5ea7fff640 1 -- 172.21.15.123:0/2963836641 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec007ee60 con 0x55d2333a4420 2024-09-15T23:24:45.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.768+0000 7f5ed0607740 1 -- 172.21.15.123:0/2963836641 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d2333a4420 msgr2=0x55d23335d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:45.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.768+0000 7f5ed0607740 1 --2- 172.21.15.123:0/2963836641 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d2333a4420 0x55d23335d300 secure :-1 s=READY pgs=2433 cs=0 l=1 rev1=1 crypto rx=0x7f5ec007a7b0 tx=0x7f5ec000b040 comp rx=0 tx=0).stop 2024-09-15T23:24:45.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.768+0000 7f5ed0607740 1 -- 172.21.15.123:0/2963836641 shutdown_connections 2024-09-15T23:24:45.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.768+0000 7f5ed0607740 1 --2- 172.21.15.123:0/2963836641 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d2333a4420 0x55d23335d300 unknown :-1 s=CLOSED pgs=2433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:45.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.768+0000 7f5ed0607740 1 --2- 172.21.15.123:0/2963836641 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2333640b0 0x55d2333a5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:45.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.768+0000 7f5ed0607740 1 --2- 172.21.15.123:0/2963836641 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d233362920 0x55d23335eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:45.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.768+0000 7f5ed0607740 1 -- 172.21.15.123:0/2963836641 >> 172.21.15.123:0/2963836641 conn(0x55d2333600e0 msgr2=0x55d2333589f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:45.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.768+0000 7f5ed0607740 1 -- 172.21.15.123:0/2963836641 shutdown_connections 2024-09-15T23:24:45.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.768+0000 7f5ed0607740 1 -- 172.21.15.123:0/2963836641 wait complete. 2024-09-15T23:24:45.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.768+0000 7f5ed0607740 1 -- start start 2024-09-15T23:24:45.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.768+0000 7f5ed0607740 1 Processor -- start 2024-09-15T23:24:45.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.769+0000 7f5ed0607740 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d233362920 0x55d233422e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:45.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.769+0000 7f5ed0607740 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d2333640b0 0x55d2333b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:45.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.769+0000 7f5ed0607740 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2333a4420 0x55d2333b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:45.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.769+0000 7f5ed0607740 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d233363190 con 0x55d233362920 2024-09-15T23:24:45.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.769+0000 7f5ed0607740 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec815aab0 con 0x55d2333a4420 2024-09-15T23:24:45.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.769+0000 7f5ed0607740 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55d23338bfb0 con 0x55d2333640b0 2024-09-15T23:24:45.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.769+0000 7f5ed0607740 10 client.0 _ll_register_callbacks cb 0x7f5ebc009ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:24:45.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.769+0000 7f5ec6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d233362920 0x55d233422e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:45.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.769+0000 7f5ec6ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d233362920 0x55d233422e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50350/0 (socket says 172.21.15.123:50350) 2024-09-15T23:24:45.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.769+0000 7f5ec6ffd640 1 -- 172.21.15.123:0/1550848684 learned_addr learned my addr 172.21.15.123:0/1550848684 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:45.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.769+0000 7f5ec77fe640 1 --2- 172.21.15.123:0/1550848684 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2333a4420 0x55d2333b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:45.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.769+0000 7f5ec67fc640 1 --2- 172.21.15.123:0/1550848684 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d2333640b0 0x55d2333b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:45.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.770+0000 7f5ec6ffd640 1 -- 172.21.15.123:0/1550848684 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d2333640b0 msgr2=0x55d2333b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:45.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.770+0000 7f5ec6ffd640 1 --2- 172.21.15.123:0/1550848684 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d2333640b0 0x55d2333b5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:45.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.770+0000 7f5ec6ffd640 1 -- 172.21.15.123:0/1550848684 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2333a4420 msgr2=0x55d2333b61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:45.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.770+0000 7f5ec6ffd640 1 --2- 172.21.15.123:0/1550848684 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2333a4420 0x55d2333b61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:45.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.770+0000 7f5ec6ffd640 1 -- 172.21.15.123:0/1550848684 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2334233a0 con 0x55d233362920 2024-09-15T23:24:45.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.770+0000 7f5ec67fc640 1 --2- 172.21.15.123:0/1550848684 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d2333640b0 0x55d2333b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:24:45.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.770+0000 7f5ec6ffd640 1 --2- 172.21.15.123:0/1550848684 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d233362920 0x55d233422e60 secure :-1 s=READY pgs=2434 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8001eb0 tx=0x7f5eb8000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae56868aac15a60 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:45.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.770+0000 7f5ea5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-09-15T23:24:45.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.770+0000 7f5ea5ffb640 1 -- 172.21.15.123:0/1550848684 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8015830 con 0x55d233362920 2024-09-15T23:24:45.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.770+0000 7f5ea5ffb640 1 -- 172.21.15.123:0/1550848684 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(206..206 src has 1..206) ==== 5709+0+0 (secure 0 0 0) 0x7f5eb8010040 con 0x55d233362920 2024-09-15T23:24:45.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.770+0000 7f5ed0607740 1 -- 172.21.15.123:0/1550848684 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5ec00a9070 con 0x55d233362920 2024-09-15T23:24:45.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.770+0000 7f5ea5ffb640 1 -- 172.21.15.123:0/1550848684 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=127) ==== 24+0+0 (secure 0 0 0) 0x7f5eb80159d0 con 0x55d233362920 2024-09-15T23:24:45.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.770+0000 7f5ed0607740 10 client.11154 fetch_fsmap learned FSMap version 127 2024-09-15T23:24:45.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.770+0000 7f5ed0607740 1 -- 172.21.15.123:0/1550848684 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=127,monmap=2+}) -- 0x55d233388b50 con 0x55d233362920 2024-09-15T23:24:45.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.770+0000 7f5ea5ffb640 1 -- 172.21.15.123:0/1550848684 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ec00a9070 con 0x55d233362920 2024-09-15T23:24:45.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.770+0000 7f5ea5ffb640 1 -- 172.21.15.123:0/1550848684 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 127) ==== 3502+0+0 (secure 0 0 0) 0x7f5eb8015b70 con 0x55d233362920 2024-09-15T23:24:45.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.770+0000 7f5ed0607740 10 client.11154 fetch_fsmap finished waiting for FSMap version 127 2024-09-15T23:24:45.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.770+0000 7f5ed0607740 10 client.11154 resolve_mds: resolved 14:0 to role '14:0' aka daemon mds.c 2024-09-15T23:24:45.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.770+0000 7f5ed0607740 20 client.11154 populate_metadata read hostname 'smithi123' 2024-09-15T23:24:45.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.770+0000 7f5ed0607740 1 --2- 172.21.15.123:0/1550848684 >> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] conn(0x55d23335c760 0x55d233425cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:45.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.770+0000 7f5ed0607740 4 client.11154 mds_command: new command op to 10905 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:24:45.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.770+0000 7f5ed0607740 1 -- 172.21.15.123:0/1550848684 --> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d2332cd170 con 0x55d23335c760 2024-09-15T23:24:45.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.770+0000 7f5ec67fc640 1 --2- 172.21.15.123:0/1550848684 >> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] conn(0x55d23335c760 0x55d233425cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:45.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.771+0000 7f5ea5ffb640 10 client.11154 ms_handle_connect on v2:172.21.15.123:6832/1661365546 2024-09-15T23:24:45.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.771+0000 7f5ec67fc640 1 --2- 172.21.15.123:0/1550848684 >> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] conn(0x55d23335c760 0x55d233425cd0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=deb2d6a6638cb48d server_cookie=8130c10dcae40676 in_seq=0 out_seq=0 2024-09-15T23:24:45.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.771+0000 7f5ea5ffb640 1 -- 172.21.15.123:0/1550848684 <== mds.0 v2:172.21.15.123:6832/1661365546 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55d2332cd170 con 0x55d23335c760 2024-09-15T23:24:45.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.771+0000 7f5ea5ffb640 10 client.11154 handle_command_reply: tid=0 2024-09-15T23:24:45.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.771+0000 7f5ed0607740 1 client.11154 shutdown 2024-09-15T23:24:45.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.771+0000 7f5ed0607740 1 -- 172.21.15.123:0/1550848684 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d233362920 msgr2=0x55d233422e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:45.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.771+0000 7f5ed0607740 1 --2- 172.21.15.123:0/1550848684 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d233362920 0x55d233422e60 secure :-1 s=READY pgs=2434 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8001eb0 tx=0x7f5eb8000fe0 comp rx=0 tx=0).stop 2024-09-15T23:24:45.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.771+0000 7f5ed0607740 1 -- 172.21.15.123:0/1550848684 shutdown_connections 2024-09-15T23:24:45.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.771+0000 7f5ed0607740 1 --2- 172.21.15.123:0/1550848684 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55d2333a4420 0x55d2333b61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:45.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.771+0000 7f5ed0607740 1 --2- 172.21.15.123:0/1550848684 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55d2333640b0 0x55d2333b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:45.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.771+0000 7f5ed0607740 1 --2- 172.21.15.123:0/1550848684 >> [v2:172.21.15.123:6832/1661365546,v1:172.21.15.123:6834/1661365546] conn(0x55d23335c760 0x55d233425cd0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:45.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.771+0000 7f5ed0607740 1 --2- 172.21.15.123:0/1550848684 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d233362920 0x55d233422e60 unknown :-1 s=CLOSED pgs=2434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:45.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.771+0000 7f5ea5ffb640 0 client.11154 ms_handle_reset on v2:172.21.15.123:6832/1661365546 2024-09-15T23:24:45.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.771+0000 7f5ed0607740 1 -- 172.21.15.123:0/1550848684 >> 172.21.15.123:0/1550848684 conn(0x55d2333600e0 msgr2=0x55d23338cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:45.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.771+0000 7f5ed0607740 1 -- 172.21.15.123:0/1550848684 shutdown_connections 2024-09-15T23:24:45.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.771+0000 7f5ed0607740 1 -- 172.21.15.123:0/1550848684 wait complete. 2024-09-15T23:24:45.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.771+0000 7f5ed0607740 20 client.11154 trim_cache size 0 max 16384 2024-09-15T23:24:45.780 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:24:45.780 INFO:teuthology.orchestra.run.smithi123.stdout: "status": "no active scrubs running", 2024-09-15T23:24:45.780 INFO:teuthology.orchestra.run.smithi123.stdout: "scrubs": {} 2024-09-15T23:24:45.781 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:24:45.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.772+0000 7f5ecd78d640 1 -- 172.21.15.123:0/3159648094 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5eb406c2e0 msgr2=0x7f5eb406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:45.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.772+0000 7f5ecd78d640 1 --2- 172.21.15.123:0/3159648094 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5eb406c2e0 0x7f5eb406e7a0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8007fd0 tx=0x7f5eb8007970 comp rx=0 tx=0).stop 2024-09-15T23:24:45.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.772+0000 7f5ecd78d640 1 -- 172.21.15.123:0/3159648094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ec8154780 msgr2=0x7f5ec8154c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:45.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.772+0000 7f5ecd78d640 1 --2- 172.21.15.123:0/3159648094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ec8154780 0x7f5ec8154c30 secure :-1 s=READY pgs=2430 cs=0 l=1 rev1=1 crypto rx=0x7f5ec000e230 tx=0x7f5ec0009750 comp rx=0 tx=0).stop 2024-09-15T23:24:45.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.772+0000 7f5ecd78d640 1 -- 172.21.15.123:0/3159648094 shutdown_connections 2024-09-15T23:24:45.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.772+0000 7f5ecd78d640 1 --2- 172.21.15.123:0/3159648094 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f5eb406c2e0 0x7f5eb406e7a0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:45.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.772+0000 7f5ecd78d640 1 --2- 172.21.15.123:0/3159648094 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5ec8154780 0x7f5ec8154c30 unknown :-1 s=CLOSED pgs=2430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:45.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.772+0000 7f5ecd78d640 1 --2- 172.21.15.123:0/3159648094 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f5ec8148640 0x7f5ec8147e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:45.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.772+0000 7f5ecd78d640 1 --2- 172.21.15.123:0/3159648094 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f5eb0004d40 0x7f5ec8152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:45.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.772+0000 7f5ecd78d640 1 -- 172.21.15.123:0/3159648094 >> 172.21.15.123:0/3159648094 conn(0x7f5ec80b2510 msgr2=0x7f5ec806e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:45.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.772+0000 7f5ecd78d640 1 -- 172.21.15.123:0/3159648094 shutdown_connections 2024-09-15T23:24:45.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.772+0000 7f5ecd78d640 1 -- 172.21.15.123:0/3159648094 wait complete. 2024-09-15T23:24:45.784 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T23:24:45.784 DEBUG:teuthology.orchestra.run.smithi123:> stdin-killer -- python3 -c ' 2024-09-15T23:24:45.784 DEBUG:teuthology.orchestra.run.smithi123:> import os 2024-09-15T23:24:45.784 DEBUG:teuthology.orchestra.run.smithi123:> import stat 2024-09-15T23:24:45.784 DEBUG:teuthology.orchestra.run.smithi123:> import json 2024-09-15T23:24:45.784 DEBUG:teuthology.orchestra.run.smithi123:> import sys 2024-09-15T23:24:45.784 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-15T23:24:45.785 DEBUG:teuthology.orchestra.run.smithi123:> try: 2024-09-15T23:24:45.785 DEBUG:teuthology.orchestra.run.smithi123:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2024-09-15T23:24:45.785 DEBUG:teuthology.orchestra.run.smithi123:> except OSError as e: 2024-09-15T23:24:45.785 DEBUG:teuthology.orchestra.run.smithi123:> sys.exit(e.errno) 2024-09-15T23:24:45.785 DEBUG:teuthology.orchestra.run.smithi123:> 2024-09-15T23:24:45.785 DEBUG:teuthology.orchestra.run.smithi123:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-09-15T23:24:45.785 DEBUG:teuthology.orchestra.run.smithi123:> print(json.dumps( 2024-09-15T23:24:45.785 DEBUG:teuthology.orchestra.run.smithi123:> dict([(a, getattr(s, a)) for a in attrs]), 2024-09-15T23:24:45.785 DEBUG:teuthology.orchestra.run.smithi123:> indent=2)) 2024-09-15T23:24:45.785 DEBUG:teuthology.orchestra.run.smithi123:> ' 2024-09-15T23:24:45.852 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:24:45.852 INFO:teuthology.orchestra.run.smithi123.stdout: "st_mode": 33188, 2024-09-15T23:24:45.852 INFO:teuthology.orchestra.run.smithi123.stdout: "st_ino": 1099511627777, 2024-09-15T23:24:45.852 INFO:teuthology.orchestra.run.smithi123.stdout: "st_dev": 41, 2024-09-15T23:24:45.853 INFO:teuthology.orchestra.run.smithi123.stdout: "st_nlink": 1, 2024-09-15T23:24:45.853 INFO:teuthology.orchestra.run.smithi123.stdout: "st_uid": 1000, 2024-09-15T23:24:45.853 INFO:teuthology.orchestra.run.smithi123.stdout: "st_gid": 1333, 2024-09-15T23:24:45.853 INFO:teuthology.orchestra.run.smithi123.stdout: "st_size": 6291456, 2024-09-15T23:24:45.853 INFO:teuthology.orchestra.run.smithi123.stdout: "st_atime": 1726442654.4362135, 2024-09-15T23:24:45.853 INFO:teuthology.orchestra.run.smithi123.stdout: "st_mtime": 1726442654.455213, 2024-09-15T23:24:45.853 INFO:teuthology.orchestra.run.smithi123.stdout: "st_ctime": 1726442654.455213 2024-09-15T23:24:45.853 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:24:45.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:24:45.862 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:24:46.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.999+0000 7fbbe4e5e640 1 Processor -- start 2024-09-15T23:24:46.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:45.999+0000 7fbbe4e5e640 1 -- start start 2024-09-15T23:24:46.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.000+0000 7fbbe4e5e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbbe00b2d40 0x7fbbe006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:46.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.000+0000 7fbbe4e5e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fbbe006c150 0x7fbbe015c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:46.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.000+0000 7fbbe4e5e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbe0071180 con 0x7fbbe013eb20 2024-09-15T23:24:46.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.000+0000 7fbbe4e5e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fbbe0071ab0 con 0x7fbbe006c150 2024-09-15T23:24:46.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.000+0000 7fbbe4e5e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbbe0071460 con 0x7fbbe00b2d40 2024-09-15T23:24:46.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.000+0000 7fbbddd9b640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fbbe013eb20 0x7fbbe015bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:48338/0 (socket says 172.21.15.123:48338) 2024-09-15T23:24:46.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.000+0000 7fbbddd9b640 1 -- 172.21.15.123:0/3515747039 learned_addr learned my addr 172.21.15.123:0/3515747039 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:46.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.000+0000 7fbbded9d640 1 --2- 172.21.15.123:0/3515747039 >> v2:172.21.15.188:3300/0 conn(0x7fbbe006c150 0x7fbbe015c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:46.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.000+0000 7fbbde59c640 1 --2- 172.21.15.123:0/3515747039 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbbe00b2d40 0x7fbbe006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:46.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.000+0000 7fbbdd59a640 1 -- 172.21.15.123:0/3515747039 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1072115249 0 0) 0x7fbbe0071180 con 0x7fbbe013eb20 2024-09-15T23:24:46.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.000+0000 7fbbdd59a640 1 -- 172.21.15.123:0/3515747039 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbc8003520 con 0x7fbbe013eb20 2024-09-15T23:24:46.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.001+0000 7fbbded9d640 1 -- 172.21.15.123:0/3515747039 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbbe00b2d40 msgr2=0x7fbbe006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:46.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.001+0000 7fbbded9d640 1 --2- 172.21.15.123:0/3515747039 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbbe00b2d40 0x7fbbe006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:46.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.001+0000 7fbbdd59a640 1 -- 172.21.15.123:0/3515747039 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2299480040 0 0) 0x7fbbc8003520 con 0x7fbbe013eb20 2024-09-15T23:24:46.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.001+0000 7fbbded9d640 1 -- 172.21.15.123:0/3515747039 >> v1:172.21.15.123:6789/0 conn(0x7fbbe013eb20 legacy=0x7fbbe015bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:46.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.001+0000 7fbbded9d640 1 -- 172.21.15.123:0/3515747039 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbe0071740 con 0x7fbbe006c150 2024-09-15T23:24:46.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.001+0000 7fbbded9d640 1 --2- 172.21.15.123:0/3515747039 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbe006c150 0x7fbbe015c400 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0071c30 tx=0x7fbbd802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=360da4071ae1b9c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:46.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.002+0000 7fbbdd59a640 1 -- 172.21.15.123:0/3515747039 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd8037070 con 0x7fbbe006c150 2024-09-15T23:24:46.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.002+0000 7fbbdd59a640 1 -- 172.21.15.123:0/3515747039 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbd802aba0 con 0x7fbbe006c150 2024-09-15T23:24:46.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.002+0000 7fbbdd59a640 1 -- 172.21.15.123:0/3515747039 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4001670 con 0x7fbbe006c150 2024-09-15T23:24:46.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.002+0000 7fbbe4e5e640 1 -- 172.21.15.123:0/3515747039 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbe006c150 msgr2=0x7fbbe015c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:46.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.002+0000 7fbbe4e5e640 1 --2- 172.21.15.123:0/3515747039 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbe006c150 0x7fbbe015c400 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0071c30 tx=0x7fbbd802a110 comp rx=0 tx=0).stop 2024-09-15T23:24:46.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.002+0000 7fbbe4e5e640 1 -- 172.21.15.123:0/3515747039 shutdown_connections 2024-09-15T23:24:46.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.002+0000 7fbbe4e5e640 1 --2- 172.21.15.123:0/3515747039 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbe006c150 0x7fbbe015c400 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:46.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.002+0000 7fbbe4e5e640 1 --2- 172.21.15.123:0/3515747039 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbbe00b2d40 0x7fbbe006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:46.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.002+0000 7fbbe4e5e640 1 -- 172.21.15.123:0/3515747039 >> 172.21.15.123:0/3515747039 conn(0x7fbbe00ccec0 msgr2=0x7fbbe00cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:46.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.002+0000 7fbbe4e5e640 1 -- 172.21.15.123:0/3515747039 shutdown_connections 2024-09-15T23:24:46.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.002+0000 7fbbe4e5e640 1 -- 172.21.15.123:0/3515747039 wait complete. 2024-09-15T23:24:46.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.004+0000 7fbbe4e5e640 1 Processor -- start 2024-09-15T23:24:46.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.004+0000 7fbbe4e5e640 1 -- start start 2024-09-15T23:24:46.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.004+0000 7fbbe4e5e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbe006c150 0x7fbbe015fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:46.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.004+0000 7fbbe4e5e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbe00b2d40 0x7fbbe015e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:46.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.004+0000 7fbbe4e5e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbbe013eb20 0x7fbbe0154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:46.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.004+0000 7fbbe4e5e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe00722d0 con 0x7fbbe006c150 2024-09-15T23:24:46.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.004+0000 7fbbe4e5e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe0072150 con 0x7fbbe00b2d40 2024-09-15T23:24:46.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.004+0000 7fbbe4e5e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbbe0072450 con 0x7fbbe013eb20 2024-09-15T23:24:46.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.005+0000 7fbbde59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbe006c150 0x7fbbe015fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:46.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.005+0000 7fbbde59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbe006c150 0x7fbbe015fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50358/0 (socket says 172.21.15.123:50358) 2024-09-15T23:24:46.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.005+0000 7fbbde59c640 1 -- 172.21.15.123:0/1773282945 learned_addr learned my addr 172.21.15.123:0/1773282945 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:46.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.005+0000 7fbbddd9b640 1 --2- 172.21.15.123:0/1773282945 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbe00b2d40 0x7fbbe015e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:46.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.005+0000 7fbbded9d640 1 --2- 172.21.15.123:0/1773282945 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbbe013eb20 0x7fbbe0154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:46.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.005+0000 7fbbde59c640 1 -- 172.21.15.123:0/1773282945 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbbe013eb20 msgr2=0x7fbbe0154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:46.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.005+0000 7fbbde59c640 1 --2- 172.21.15.123:0/1773282945 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbbe013eb20 0x7fbbe0154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:46.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.005+0000 7fbbde59c640 1 -- 172.21.15.123:0/1773282945 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbe00b2d40 msgr2=0x7fbbe015e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:46.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.005+0000 7fbbde59c640 1 --2- 172.21.15.123:0/1773282945 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbe00b2d40 0x7fbbe015e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:46.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.005+0000 7fbbde59c640 1 -- 172.21.15.123:0/1773282945 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbe0154d80 con 0x7fbbe006c150 2024-09-15T23:24:46.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.005+0000 7fbbde59c640 1 --2- 172.21.15.123:0/1773282945 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbe006c150 0x7fbbe015fa10 secure :-1 s=READY pgs=2436 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0009db0 tx=0x7fbbd000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:46.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.005+0000 7fbbceffd640 1 -- 172.21.15.123:0/1773282945 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd0018020 con 0x7fbbe006c150 2024-09-15T23:24:46.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.005+0000 7fbbceffd640 1 -- 172.21.15.123:0/1773282945 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbd0014480 con 0x7fbbe006c150 2024-09-15T23:24:46.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.005+0000 7fbbceffd640 1 -- 172.21.15.123:0/1773282945 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd0014850 con 0x7fbbe006c150 2024-09-15T23:24:46.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.005+0000 7fbbe4e5e640 1 -- 172.21.15.123:0/1773282945 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbe015d2c0 con 0x7fbbe006c150 2024-09-15T23:24:46.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.005+0000 7fbbe4e5e640 1 -- 172.21.15.123:0/1773282945 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbe015d880 con 0x7fbbe006c150 2024-09-15T23:24:46.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.006+0000 7fbbe4e5e640 1 -- 172.21.15.123:0/1773282945 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbe006bc10 con 0x7fbbe006c150 2024-09-15T23:24:46.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.007+0000 7fbbceffd640 1 -- 172.21.15.123:0/1773282945 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbbd0005d10 con 0x7fbbe006c150 2024-09-15T23:24:46.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.007+0000 7fbbceffd640 1 --2- 172.21.15.123:0/1773282945 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbbc006c2b0 0x7fbbc006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:46.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.007+0000 7fbbceffd640 1 -- 172.21.15.123:0/1773282945 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 5709+0+0 (secure 0 0 0) 0x7fbbd008bda0 con 0x7fbbe006c150 2024-09-15T23:24:46.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.007+0000 7fbbddd9b640 1 --2- 172.21.15.123:0/1773282945 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbbc006c2b0 0x7fbbc006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:46.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.008+0000 7fbbddd9b640 1 --2- 172.21.15.123:0/1773282945 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbbc006c2b0 0x7fbbc006e770 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fbbe00ccb30 tx=0x7fbbd4001d40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:46.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.012+0000 7fbbceffd640 1 -- 172.21.15.123:0/1773282945 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbbd0022070 con 0x7fbbe006c150 2024-09-15T23:24:46.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.208+0000 7fbbe4e5e640 1 -- 172.21.15.123:0/1773282945 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbbe006c9c0 con 0x7fbbe006c150 2024-09-15T23:24:46.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.209+0000 7fbbceffd640 1 -- 172.21.15.123:0/1773282945 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 127 v127) ==== 95+0+5247 (secure 0 0 0) 0x7fbbd0010040 con 0x7fbbe006c150 2024-09-15T23:24:46.210 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:46.210 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":127,"btime":"2024-09-15T23:24:06:331850+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7922,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/173351117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":173351117},{"type":"v1","addr":"172.21.15.123:6835","nonce":173351117}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123},{"gid":7928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/4283187910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":4283187910},{"type":"v1","addr":"172.21.15.188:6837","nonce":4283187910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123},{"gid":9061,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/3180373488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3180373488},{"type":"v1","addr":"172.21.15.188:6836","nonce":3180373488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123}],"filesystems":[{"mdsmap":{"epoch":127,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:24:03.556320+0000","modified":"2024-09-15T23:24:05.658884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10905},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10905":{"gid":10905,"name":"c","rank":0,"incarnation":124,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6834/1661365546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":1661365546},{"type":"v1","addr":"172.21.15.123:6834","nonce":1661365546}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10905,"qdb_cluster":[10905]},"id":14}]} 2024-09-15T23:24:46.211 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 127 2024-09-15T23:24:46.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.211+0000 7fbbe4e5e640 1 -- 172.21.15.123:0/1773282945 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbbc006c2b0 msgr2=0x7fbbc006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:46.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.211+0000 7fbbe4e5e640 1 --2- 172.21.15.123:0/1773282945 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbbc006c2b0 0x7fbbc006e770 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fbbe00ccb30 tx=0x7fbbd4001d40 comp rx=0 tx=0).stop 2024-09-15T23:24:46.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.211+0000 7fbbe4e5e640 1 -- 172.21.15.123:0/1773282945 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbe006c150 msgr2=0x7fbbe015fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:46.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.211+0000 7fbbe4e5e640 1 --2- 172.21.15.123:0/1773282945 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbe006c150 0x7fbbe015fa10 secure :-1 s=READY pgs=2436 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0009db0 tx=0x7fbbd000c490 comp rx=0 tx=0).stop 2024-09-15T23:24:46.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.211+0000 7fbbe4e5e640 1 -- 172.21.15.123:0/1773282945 shutdown_connections 2024-09-15T23:24:46.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.211+0000 7fbbe4e5e640 1 --2- 172.21.15.123:0/1773282945 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbbe013eb20 0x7fbbe0154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:46.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.211+0000 7fbbe4e5e640 1 --2- 172.21.15.123:0/1773282945 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbe00b2d40 0x7fbbe015e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:46.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.211+0000 7fbbe4e5e640 1 --2- 172.21.15.123:0/1773282945 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbbc006c2b0 0x7fbbc006e770 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:46.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.211+0000 7fbbe4e5e640 1 --2- 172.21.15.123:0/1773282945 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbe006c150 0x7fbbe015fa10 unknown :-1 s=CLOSED pgs=2436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:46.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.211+0000 7fbbe4e5e640 1 -- 172.21.15.123:0/1773282945 >> 172.21.15.123:0/1773282945 conn(0x7fbbe00ccec0 msgr2=0x7fbbe00b39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:46.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.211+0000 7fbbe4e5e640 1 -- 172.21.15.123:0/1773282945 shutdown_connections 2024-09-15T23:24:46.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.211+0000 7fbbe4e5e640 1 -- 172.21.15.123:0/1773282945 wait complete. 2024-09-15T23:24:46.224 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-09-15T23:24:46.342 INFO:teuthology.orchestra.run.smithi123.stdout:{"message":"","return_code":0} 2024-09-15T23:24:46.342 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-09-15T23:24:46.343 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-09-15T23:24:46.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.385+0000 7f3a68722f40 1 Processor -- start 2024-09-15T23:24:46.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.385+0000 7f3a68722f40 1 -- start start 2024-09-15T23:24:46.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.386+0000 7f3a68722f40 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f7ce14cc10 0x55f7ce1ea410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:46.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.386+0000 7f3a68722f40 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f7ce14cff0 0x55f7ce1f7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:46.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.386+0000 7f3a68722f40 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f7ce1ef9f0 0x55f7ce166820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:46.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.386+0000 7f3a68722f40 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55f7ce15d8a0 con 0x55f7ce1ef9f0 2024-09-15T23:24:46.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.386+0000 7f3a68722f40 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55f7ce06f510 con 0x55f7ce14cff0 2024-09-15T23:24:46.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.386+0000 7f3a68722f40 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55f7ce15db40 con 0x55f7ce14cc10 2024-09-15T23:24:46.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.386+0000 7f3a66a19640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f7ce1ef9f0 0x55f7ce166820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:46.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.386+0000 7f3a66a19640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f7ce1ef9f0 0x55f7ce166820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50542/0 (socket says 172.21.15.123:50542) 2024-09-15T23:24:46.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.386+0000 7f3a66a19640 1 -- 172.21.15.123:0/3485061112 learned_addr learned my addr 172.21.15.123:0/3485061112 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:46.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.386+0000 7f3a5ffff640 1 --2- 172.21.15.123:0/3485061112 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f7ce14cff0 0x55f7ce1f7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:46.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.386+0000 7f3a66218640 1 --2- 172.21.15.123:0/3485061112 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f7ce14cc10 0x55f7ce1ea410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:46.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.386+0000 7f3a66a19640 1 -- 172.21.15.123:0/3485061112 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f7ce14cc10 msgr2=0x55f7ce1ea410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:46.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.386+0000 7f3a66a19640 1 --2- 172.21.15.123:0/3485061112 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f7ce14cc10 0x55f7ce1ea410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:46.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.386+0000 7f3a66a19640 1 -- 172.21.15.123:0/3485061112 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f7ce14cff0 msgr2=0x55f7ce1f7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:46.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.386+0000 7f3a66a19640 1 --2- 172.21.15.123:0/3485061112 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f7ce14cff0 0x55f7ce1f7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:46.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.387+0000 7f3a66a19640 1 -- 172.21.15.123:0/3485061112 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7ce164110 con 0x55f7ce1ef9f0 2024-09-15T23:24:46.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.387+0000 7f3a5ffff640 1 --2- 172.21.15.123:0/3485061112 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f7ce14cff0 0x55f7ce1f7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:24:46.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.387+0000 7f3a66a19640 1 --2- 172.21.15.123:0/3485061112 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f7ce1ef9f0 0x55f7ce166820 secure :-1 s=READY pgs=2437 cs=0 l=1 rev1=1 crypto rx=0x7f3a60005fd0 tx=0x7f3a60050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cddc3342afe53c5f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:46.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.387+0000 7f3a65216640 1 -- 172.21.15.123:0/3485061112 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6004f990 con 0x55f7ce1ef9f0 2024-09-15T23:24:46.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.387+0000 7f3a65216640 1 -- 172.21.15.123:0/3485061112 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a6004fb30 con 0x55f7ce1ef9f0 2024-09-15T23:24:46.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.387+0000 7f3a65216640 1 -- 172.21.15.123:0/3485061112 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a60057400 con 0x55f7ce1ef9f0 2024-09-15T23:24:46.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.387+0000 7f3a68722f40 1 -- 172.21.15.123:0/3485061112 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f7ce1ef9f0 msgr2=0x55f7ce166820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:46.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.387+0000 7f3a68722f40 1 --2- 172.21.15.123:0/3485061112 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f7ce1ef9f0 0x55f7ce166820 secure :-1 s=READY pgs=2437 cs=0 l=1 rev1=1 crypto rx=0x7f3a60005fd0 tx=0x7f3a60050000 comp rx=0 tx=0).stop 2024-09-15T23:24:46.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.387+0000 7f3a68722f40 1 -- 172.21.15.123:0/3485061112 shutdown_connections 2024-09-15T23:24:46.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.387+0000 7f3a68722f40 1 --2- 172.21.15.123:0/3485061112 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f7ce1ef9f0 0x55f7ce166820 unknown :-1 s=CLOSED pgs=2437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:46.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.387+0000 7f3a68722f40 1 --2- 172.21.15.123:0/3485061112 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f7ce14cff0 0x55f7ce1f7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:46.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.387+0000 7f3a68722f40 1 --2- 172.21.15.123:0/3485061112 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f7ce14cc10 0x55f7ce1ea410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:46.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.387+0000 7f3a68722f40 1 -- 172.21.15.123:0/3485061112 >> 172.21.15.123:0/3485061112 conn(0x55f7ce14a710 msgr2=0x55f7ce165c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:46.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.387+0000 7f3a68722f40 1 -- 172.21.15.123:0/3485061112 shutdown_connections 2024-09-15T23:24:46.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.387+0000 7f3a68722f40 1 -- 172.21.15.123:0/3485061112 wait complete. 2024-09-15T23:24:46.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.388+0000 7f3a68722f40 1 Processor -- start 2024-09-15T23:24:46.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.388+0000 7f3a68722f40 1 -- start start 2024-09-15T23:24:46.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.389+0000 7f3a68722f40 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f7ce14cc10 0x55f7ce1de1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:46.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.389+0000 7f3a68722f40 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f7ce14cff0 0x55f7ce166820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:46.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.389+0000 7f3a68722f40 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f7ce1ef9f0 0x55f7ce166d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:46.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.389+0000 7f3a68722f40 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55f7ce1eb080 con 0x55f7ce1ef9f0 2024-09-15T23:24:46.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.389+0000 7f3a68722f40 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x55f7ce1eaac0 con 0x55f7ce14cc10 2024-09-15T23:24:46.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.389+0000 7f3a68722f40 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x55f7ce1f4c90 con 0x55f7ce14cff0 2024-09-15T23:24:46.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.389+0000 7f3a66a19640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f7ce1ef9f0 0x55f7ce166d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:46.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.389+0000 7f3a66a19640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f7ce1ef9f0 0x55f7ce166d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50552/0 (socket says 172.21.15.123:50552) 2024-09-15T23:24:46.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.389+0000 7f3a66a19640 1 -- 172.21.15.123:0/1865108548 learned_addr learned my addr 172.21.15.123:0/1865108548 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:46.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.389+0000 7f3a66218640 1 --2- 172.21.15.123:0/1865108548 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f7ce14cc10 0x55f7ce1de1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:46.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.389+0000 7f3a5ffff640 1 --2- 172.21.15.123:0/1865108548 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f7ce14cff0 0x55f7ce166820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:46.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.389+0000 7f3a66a19640 1 -- 172.21.15.123:0/1865108548 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f7ce14cff0 msgr2=0x55f7ce166820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:46.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.389+0000 7f3a66a19640 1 --2- 172.21.15.123:0/1865108548 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f7ce14cff0 0x55f7ce166820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:46.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.389+0000 7f3a66a19640 1 -- 172.21.15.123:0/1865108548 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f7ce14cc10 msgr2=0x55f7ce1de1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:46.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.389+0000 7f3a66a19640 1 --2- 172.21.15.123:0/1865108548 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f7ce14cc10 0x55f7ce1de1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:46.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.389+0000 7f3a66a19640 1 -- 172.21.15.123:0/1865108548 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7ce165ee0 con 0x55f7ce1ef9f0 2024-09-15T23:24:46.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.389+0000 7f3a66218640 1 --2- 172.21.15.123:0/1865108548 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x55f7ce14cc10 0x55f7ce1de1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:24:46.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.389+0000 7f3a5ffff640 1 --2- 172.21.15.123:0/1865108548 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x55f7ce14cff0 0x55f7ce166820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:24:46.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.389+0000 7f3a66a19640 1 --2- 172.21.15.123:0/1865108548 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f7ce1ef9f0 0x55f7ce166d60 secure :-1 s=READY pgs=2438 cs=0 l=1 rev1=1 crypto rx=0x7f3a600461b0 tx=0x7f3a60003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:46.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.389+0000 7f3a5f7fe640 1 -- 172.21.15.123:0/1865108548 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6004f5c0 con 0x55f7ce1ef9f0 2024-09-15T23:24:46.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.389+0000 7f3a5f7fe640 1 -- 172.21.15.123:0/1865108548 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a60057a60 con 0x55f7ce1ef9f0 2024-09-15T23:24:46.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.389+0000 7f3a68722f40 1 -- 172.21.15.123:0/1865108548 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f7ce1661c0 con 0x55f7ce1ef9f0 2024-09-15T23:24:46.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.389+0000 7f3a5f7fe640 1 -- 172.21.15.123:0/1865108548 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a60057e50 con 0x55f7ce1ef9f0 2024-09-15T23:24:46.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.389+0000 7f3a68722f40 1 -- 172.21.15.123:0/1865108548 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7ce1ecce0 con 0x55f7ce1ef9f0 2024-09-15T23:24:46.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.391+0000 7f3a5f7fe640 1 -- 172.21.15.123:0/1865108548 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3a6006b040 con 0x55f7ce1ef9f0 2024-09-15T23:24:46.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.391+0000 7f3a5f7fe640 1 --2- 172.21.15.123:0/1865108548 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3a4806ae60 0x7f3a4806d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:46.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.391+0000 7f3a5f7fe640 1 -- 172.21.15.123:0/1865108548 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 5709+0+0 (secure 0 0 0) 0x7f3a600cf4e0 con 0x55f7ce1ef9f0 2024-09-15T23:24:46.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.391+0000 7f3a68722f40 1 --2- 172.21.15.123:0/1865108548 >> [v2:172.21.15.123:6808/290001388,v1:172.21.15.123:6809/290001388] conn(0x55f7ce165a20 0x55f7ce1632b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:46.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.391+0000 7f3a68722f40 1 -- 172.21.15.123:0/1865108548 --> [v2:172.21.15.123:6808/290001388,v1:172.21.15.123:6809/290001388] -- osd_op(unknown.0.0:1 29.7 29:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e206) -- 0x55f7ce1ee900 con 0x55f7ce165a20 2024-09-15T23:24:46.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.391+0000 7f3a66218640 1 --2- 172.21.15.123:0/1865108548 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3a4806ae60 0x7f3a4806d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:46.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.391+0000 7f3a5ffff640 1 --2- 172.21.15.123:0/1865108548 >> [v2:172.21.15.123:6808/290001388,v1:172.21.15.123:6809/290001388] conn(0x55f7ce165a20 0x55f7ce1632b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:46.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.392+0000 7f3a5ffff640 1 --2- 172.21.15.123:0/1865108548 >> [v2:172.21.15.123:6808/290001388,v1:172.21.15.123:6809/290001388] conn(0x55f7ce165a20 0x55f7ce1632b0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:46.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.392+0000 7f3a66218640 1 --2- 172.21.15.123:0/1865108548 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3a4806ae60 0x7f3a4806d320 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f3a58003c70 tx=0x7f3a58003050 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:46.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.392+0000 7f3a5ffff640 1 -- 172.21.15.123:0/1865108548 <== osd.1 v2:172.21.15.123:6808/290001388 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv5 ondisk = 0) ==== 164+0+95 (crc 0 0 0) 0x7f3a50009b50 con 0x55f7ce165a20 2024-09-15T23:24:46.400 INFO:teuthology.orchestra.run.smithi123.stdout:Ysixmegssubdir 2024-09-15T23:24:46.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.392+0000 7f3a68722f40 1 -- 172.21.15.123:0/1865108548 >> [v2:172.21.15.123:6808/290001388,v1:172.21.15.123:6809/290001388] conn(0x55f7ce165a20 msgr2=0x55f7ce1632b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:46.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.392+0000 7f3a68722f40 1 --2- 172.21.15.123:0/1865108548 >> [v2:172.21.15.123:6808/290001388,v1:172.21.15.123:6809/290001388] conn(0x55f7ce165a20 0x55f7ce1632b0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:46.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.392+0000 7f3a68722f40 1 -- 172.21.15.123:0/1865108548 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3a4806ae60 msgr2=0x7f3a4806d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:46.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.392+0000 7f3a68722f40 1 --2- 172.21.15.123:0/1865108548 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f3a4806ae60 0x7f3a4806d320 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f3a58003c70 tx=0x7f3a58003050 comp rx=0 tx=0).stop 2024-09-15T23:24:46.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.392+0000 7f3a68722f40 1 -- 172.21.15.123:0/1865108548 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f7ce1ef9f0 msgr2=0x55f7ce166d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:46.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.392+0000 7f3a68722f40 1 --2- 172.21.15.123:0/1865108548 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55f7ce1ef9f0 0x55f7ce166d60 secure :-1 s=READY pgs=2438 cs=0 l=1 rev1=1 crypto rx=0x7f3a600461b0 tx=0x7f3a60003330 comp rx=0 tx=0).stop 2024-09-15T23:24:46.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.392+0000 7f3a66a19640 1 -- 172.21.15.123:0/1865108548 reap_dead start 2024-09-15T23:24:46.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.392+0000 7f3a68722f40 1 -- 172.21.15.123:0/1865108548 shutdown_connections 2024-09-15T23:24:46.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.392+0000 7f3a68722f40 1 -- 172.21.15.123:0/1865108548 >> 172.21.15.123:0/1865108548 conn(0x55f7ce14a710 msgr2=0x55f7ce1f7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:46.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.392+0000 7f3a68722f40 1 -- 172.21.15.123:0/1865108548 shutdown_connections 2024-09-15T23:24:46.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.392+0000 7f3a68722f40 1 -- 172.21.15.123:0/1865108548 wait complete. 2024-09-15T23:24:46.403 DEBUG:teuthology.orchestra.run.smithi123:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-09-15T23:24:46.541 INFO:teuthology.orchestra.run.smithi123.stderr:error: stray data at end of buffer, offset 95 2024-09-15T23:24:46.549 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:24:46.549 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T23:24:46.550 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:24:46.583 DEBUG:teuthology.orchestra.run.smithi188:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T23:24:46.636 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T23:24:46.636 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:24:46.636 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:24:46.636 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:24:46.652 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:24:46.652 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:24:46.709 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T23:24:46.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.846+0000 7f332b52a640 1 Processor -- start 2024-09-15T23:24:46.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.846+0000 7f332b52a640 1 -- start start 2024-09-15T23:24:46.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.847+0000 7f332b52a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f332406fe40 0x7f3324073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:46.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.847+0000 7f332b52a640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33241631c0 con 0x7f3324162c60 2024-09-15T23:24:46.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.847+0000 7f332b52a640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33240ae9a0 con 0x7f332415e790 2024-09-15T23:24:46.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.847+0000 7f332b52a640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f332415eb70 con 0x7f332406fe40 2024-09-15T23:24:46.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.847+0000 7f3329ac7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f332406fe40 0x7f3324073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:46.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.847+0000 7f3328ac5640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f3324162c60 0x7f332406f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51658/0 (socket says 172.21.15.123:51658) 2024-09-15T23:24:46.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.847+0000 7f3328ac5640 1 -- 172.21.15.123:0/1538158982 learned_addr learned my addr 172.21.15.123:0/1538158982 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:46.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.847+0000 7f3329ac7640 1 --2- 172.21.15.123:0/1538158982 >> v2:172.21.15.123:3300/0 conn(0x7f332406fe40 0x7f3324073a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50566/0 (socket says 172.21.15.123:50566) 2024-09-15T23:24:46.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.847+0000 7f3329ac7640 1 -- 172.21.15.123:0/1538158982 >> v1:172.21.15.188:6789/0 conn(0x7f332415e790 legacy=0x7f33240b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:46.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.847+0000 7f3329ac7640 1 -- 172.21.15.123:0/1538158982 >> v1:172.21.15.123:6789/0 conn(0x7f3324162c60 legacy=0x7f332406f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:46.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.847+0000 7f3329ac7640 1 -- 172.21.15.123:0/1538158982 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33240aec40 con 0x7f332406fe40 2024-09-15T23:24:46.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.847+0000 7f331bfff640 1 -- 172.21.15.123:0/1538158982 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2449200529 0 0) 0x7f33241631c0 con 0x7f3324162c60 2024-09-15T23:24:46.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.848+0000 7f3329ac7640 1 --2- 172.21.15.123:0/1538158982 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f332406fe40 0x7f3324073a40 secure :-1 s=READY pgs=2440 cs=0 l=1 rev1=1 crypto rx=0x7f331c009d90 tx=0x7f331c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d43cbbc96da9cef0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:46.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.848+0000 7f331bfff640 1 -- 172.21.15.123:0/1538158982 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f331c031600 con 0x7f332406fe40 2024-09-15T23:24:46.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.848+0000 7f331bfff640 1 -- 172.21.15.123:0/1538158982 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f331c0317a0 con 0x7f332406fe40 2024-09-15T23:24:46.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.848+0000 7f331bfff640 1 -- 172.21.15.123:0/1538158982 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f331c031b70 con 0x7f332406fe40 2024-09-15T23:24:46.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.849+0000 7f332b52a640 1 -- 172.21.15.123:0/1538158982 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f332406fe40 msgr2=0x7f3324073a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:46.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.849+0000 7f332b52a640 1 --2- 172.21.15.123:0/1538158982 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f332406fe40 0x7f3324073a40 secure :-1 s=READY pgs=2440 cs=0 l=1 rev1=1 crypto rx=0x7f331c009d90 tx=0x7f331c02a610 comp rx=0 tx=0).stop 2024-09-15T23:24:46.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.849+0000 7f332b52a640 1 -- 172.21.15.123:0/1538158982 shutdown_connections 2024-09-15T23:24:46.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.849+0000 7f332b52a640 1 --2- 172.21.15.123:0/1538158982 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f332406fe40 0x7f3324073a40 unknown :-1 s=CLOSED pgs=2440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:46.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.849+0000 7f332b52a640 1 -- 172.21.15.123:0/1538158982 >> 172.21.15.123:0/1538158982 conn(0x7f33240b0a80 msgr2=0x7f33240b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:46.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.849+0000 7f332b52a640 1 -- 172.21.15.123:0/1538158982 shutdown_connections 2024-09-15T23:24:46.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.849+0000 7f332b52a640 1 -- 172.21.15.123:0/1538158982 wait complete. 2024-09-15T23:24:46.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.850+0000 7f332b52a640 1 Processor -- start 2024-09-15T23:24:46.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.850+0000 7f332b52a640 1 -- start start 2024-09-15T23:24:46.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.851+0000 7f332b52a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f332406fe40 0x7f332414cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:46.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.851+0000 7f332b52a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f332415e790 0x7f332415cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:46.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.851+0000 7f332b52a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3324162c60 0x7f332415d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:46.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.851+0000 7f332b52a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f33240b5b40 con 0x7f332406fe40 2024-09-15T23:24:46.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.851+0000 7f332b52a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f33240af200 con 0x7f3324162c60 2024-09-15T23:24:46.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.851+0000 7f332b52a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f332406f430 con 0x7f332415e790 2024-09-15T23:24:46.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.851+0000 7f33292c6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f332406fe40 0x7f332414cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:46.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.851+0000 7f33292c6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f332406fe40 0x7f332414cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50568/0 (socket says 172.21.15.123:50568) 2024-09-15T23:24:46.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.851+0000 7f33292c6640 1 -- 172.21.15.123:0/1438993732 learned_addr learned my addr 172.21.15.123:0/1438993732 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:46.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.851+0000 7f33292c6640 1 -- 172.21.15.123:0/1438993732 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f332415e790 msgr2=0x7f332415cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:46.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.851+0000 7f3328ac5640 1 --2- 172.21.15.123:0/1438993732 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f332415e790 0x7f332415cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:46.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.851+0000 7f3329ac7640 1 --2- 172.21.15.123:0/1438993732 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3324162c60 0x7f332415d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:46.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.851+0000 7f33292c6640 1 --2- 172.21.15.123:0/1438993732 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f332415e790 0x7f332415cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:46.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.851+0000 7f33292c6640 1 -- 172.21.15.123:0/1438993732 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3324162c60 msgr2=0x7f332415d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:46.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.851+0000 7f33292c6640 1 --2- 172.21.15.123:0/1438993732 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3324162c60 0x7f332415d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:46.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.851+0000 7f33292c6640 1 -- 172.21.15.123:0/1438993732 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33241535c0 con 0x7f332406fe40 2024-09-15T23:24:46.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.851+0000 7f3328ac5640 1 --2- 172.21.15.123:0/1438993732 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f332415e790 0x7f332415cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:24:46.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.851+0000 7f33292c6640 1 --2- 172.21.15.123:0/1438993732 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f332406fe40 0x7f332414cde0 secure :-1 s=READY pgs=2441 cs=0 l=1 rev1=1 crypto rx=0x7f332000c410 tx=0x7f332000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:46.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.851+0000 7f3319ffb640 1 -- 172.21.15.123:0/1438993732 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3320017070 con 0x7f332406fe40 2024-09-15T23:24:46.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.851+0000 7f3319ffb640 1 -- 172.21.15.123:0/1438993732 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33200035f0 con 0x7f332406fe40 2024-09-15T23:24:46.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.851+0000 7f332b52a640 1 -- 172.21.15.123:0/1438993732 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33241538a0 con 0x7f332406fe40 2024-09-15T23:24:46.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.851+0000 7f3319ffb640 1 -- 172.21.15.123:0/1438993732 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3320003a20 con 0x7f332406fe40 2024-09-15T23:24:46.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.852+0000 7f332b52a640 1 -- 172.21.15.123:0/1438993732 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3324155600 con 0x7f332406fe40 2024-09-15T23:24:46.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.852+0000 7f332b52a640 1 -- 172.21.15.123:0/1438993732 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3324073a40 con 0x7f332406fe40 2024-09-15T23:24:46.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.853+0000 7f3319ffb640 1 -- 172.21.15.123:0/1438993732 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f332001a070 con 0x7f332406fe40 2024-09-15T23:24:46.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.853+0000 7f3319ffb640 1 --2- 172.21.15.123:0/1438993732 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f330806c2b0 0x7f330806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:46.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.854+0000 7f3319ffb640 1 -- 172.21.15.123:0/1438993732 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 5709+0+0 (secure 0 0 0) 0x7f332008a840 con 0x7f332406fe40 2024-09-15T23:24:46.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.854+0000 7f3328ac5640 1 --2- 172.21.15.123:0/1438993732 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f330806c2b0 0x7f330806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:46.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.854+0000 7f3328ac5640 1 --2- 172.21.15.123:0/1438993732 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f330806c2b0 0x7f330806e770 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f3324152db0 tx=0x7f3314009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:46.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:46.858+0000 7f3319ffb640 1 -- 172.21.15.123:0/1438993732 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3320059040 con 0x7f332406fe40 2024-09-15T23:24:47.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.033+0000 7f332b52a640 1 -- 172.21.15.123:0/1438993732 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f332415a810 con 0x7f332406fe40 2024-09-15T23:24:47.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.034+0000 7f3319ffb640 1 -- 172.21.15.123:0/1438993732 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v206) ==== 80+0+0 (secure 0 0 0) 0x7f3320058940 con 0x7f332406fe40 2024-09-15T23:24:47.035 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-09-15T23:24:47.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.035+0000 7f332b52a640 1 -- 172.21.15.123:0/1438993732 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f330806c2b0 msgr2=0x7f330806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:47.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.035+0000 7f332b52a640 1 --2- 172.21.15.123:0/1438993732 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f330806c2b0 0x7f330806e770 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f3324152db0 tx=0x7f3314009040 comp rx=0 tx=0).stop 2024-09-15T23:24:47.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.035+0000 7f332b52a640 1 -- 172.21.15.123:0/1438993732 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f332406fe40 msgr2=0x7f332414cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:47.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.035+0000 7f332b52a640 1 --2- 172.21.15.123:0/1438993732 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f332406fe40 0x7f332414cde0 secure :-1 s=READY pgs=2441 cs=0 l=1 rev1=1 crypto rx=0x7f332000c410 tx=0x7f332000c8d0 comp rx=0 tx=0).stop 2024-09-15T23:24:47.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.035+0000 7f332b52a640 1 -- 172.21.15.123:0/1438993732 shutdown_connections 2024-09-15T23:24:47.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.036+0000 7f332b52a640 1 --2- 172.21.15.123:0/1438993732 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f3324162c60 0x7f332415d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:47.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.036+0000 7f332b52a640 1 --2- 172.21.15.123:0/1438993732 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f332415e790 0x7f332415cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:47.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.036+0000 7f332b52a640 1 --2- 172.21.15.123:0/1438993732 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f330806c2b0 0x7f330806e770 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:47.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.036+0000 7f332b52a640 1 --2- 172.21.15.123:0/1438993732 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f332406fe40 0x7f332414cde0 unknown :-1 s=CLOSED pgs=2441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:47.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.036+0000 7f332b52a640 1 -- 172.21.15.123:0/1438993732 >> 172.21.15.123:0/1438993732 conn(0x7f33240b0a80 msgr2=0x7f332406e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:47.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.036+0000 7f332b52a640 1 -- 172.21.15.123:0/1438993732 shutdown_connections 2024-09-15T23:24:47.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.036+0000 7f332b52a640 1 -- 172.21.15.123:0/1438993732 wait complete. 2024-09-15T23:24:47.047 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-15T23:24:47.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:24:47.047 DEBUG:teuthology.orchestra.run.smithi123:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-15T23:24:47.097 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-09-15T23:24:47.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:24:47.098 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T23:24:47.127 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:24:47.127 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:24:47.127 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:24:47.144 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:24:47.145 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:24:47.145 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:24:47.145 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:24:47.183 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:24:47.184 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T23:24:47.184 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:24:47.184 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:24:47.202 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:24:47.202 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:24:47.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.321+0000 7fb7c3227640 1 Processor -- start 2024-09-15T23:24:47.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.321+0000 7fb7c3227640 1 -- start start 2024-09-15T23:24:47.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.321+0000 7fb7c3227640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb7bc0d23b0 0x7fb7bc0b87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:47.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.321+0000 7fb7c3227640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7bc0d0e70 con 0x7fb7bc0b6970 2024-09-15T23:24:47.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.321+0000 7fb7c3227640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7bc0d41c0 con 0x7fb7bc15ed20 2024-09-15T23:24:47.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.321+0000 7fb7c3227640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fb7bc0d35b0 con 0x7fb7bc0d23b0 2024-09-15T23:24:47.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.322+0000 7fb7c17c4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb7bc0d23b0 0x7fb7bc0b87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:47.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.322+0000 7fb7c17c4640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb7bc0d23b0 0x7fb7bc0b87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50572/0 (socket says 172.21.15.123:50572) 2024-09-15T23:24:47.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.322+0000 7fb7bbfff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb7bc0b6970 0x7fb7bc0b80d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51670/0 (socket says 172.21.15.123:51670) 2024-09-15T23:24:47.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.322+0000 7fb7c17c4640 1 -- 172.21.15.123:0/2947864110 learned_addr learned my addr 172.21.15.123:0/2947864110 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:47.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.322+0000 7fb7c17c4640 1 -- 172.21.15.123:0/2947864110 >> v1:172.21.15.188:6789/0 conn(0x7fb7bc15ed20 legacy=0x7fb7bc0b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:47.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.322+0000 7fb7c17c4640 1 -- 172.21.15.123:0/2947864110 >> v1:172.21.15.123:6789/0 conn(0x7fb7bc0b6970 legacy=0x7fb7bc0b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:47.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.322+0000 7fb7c17c4640 1 -- 172.21.15.123:0/2947864110 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7bc0d3890 con 0x7fb7bc0d23b0 2024-09-15T23:24:47.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.322+0000 7fb7bb7fe640 1 -- 172.21.15.123:0/2947864110 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2358072928 0 0) 0x7fb7a8001110 con 0x7fb7bc0b6970 2024-09-15T23:24:47.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.323+0000 7fb7c17c4640 1 --2- 172.21.15.123:0/2947864110 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7bc0d23b0 0x7fb7bc0b87e0 secure :-1 s=READY pgs=2443 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4009e50 tx=0x7fb7b402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829e9f616d6b0690 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:47.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.323+0000 7fb7bb7fe640 1 -- 172.21.15.123:0/2947864110 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b4036070 con 0x7fb7bc0d23b0 2024-09-15T23:24:47.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.323+0000 7fb7bb7fe640 1 -- 172.21.15.123:0/2947864110 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7b4031600 con 0x7fb7bc0d23b0 2024-09-15T23:24:47.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.323+0000 7fb7bb7fe640 1 -- 172.21.15.123:0/2947864110 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b40319d0 con 0x7fb7bc0d23b0 2024-09-15T23:24:47.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.323+0000 7fb7c3227640 1 -- 172.21.15.123:0/2947864110 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7bc0d23b0 msgr2=0x7fb7bc0b87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:47.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.323+0000 7fb7c3227640 1 --2- 172.21.15.123:0/2947864110 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7bc0d23b0 0x7fb7bc0b87e0 secure :-1 s=READY pgs=2443 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4009e50 tx=0x7fb7b402a730 comp rx=0 tx=0).stop 2024-09-15T23:24:47.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.323+0000 7fb7c3227640 1 -- 172.21.15.123:0/2947864110 shutdown_connections 2024-09-15T23:24:47.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.323+0000 7fb7c3227640 1 --2- 172.21.15.123:0/2947864110 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7bc0d23b0 0x7fb7bc0b87e0 unknown :-1 s=CLOSED pgs=2443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:47.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.323+0000 7fb7c3227640 1 -- 172.21.15.123:0/2947864110 >> 172.21.15.123:0/2947864110 conn(0x7fb7bc0d1260 msgr2=0x7fb7bc0d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:47.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.323+0000 7fb7c3227640 1 -- 172.21.15.123:0/2947864110 shutdown_connections 2024-09-15T23:24:47.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.323+0000 7fb7c3227640 1 -- 172.21.15.123:0/2947864110 wait complete. 2024-09-15T23:24:47.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.324+0000 7fb7c3227640 1 Processor -- start 2024-09-15T23:24:47.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.325+0000 7fb7c3227640 1 -- start start 2024-09-15T23:24:47.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.325+0000 7fb7c3227640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb7bc0b6970 0x7fb7bc161e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:47.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.325+0000 7fb7c3227640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb7bc0d23b0 0x7fb7bc157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:47.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.325+0000 7fb7c3227640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7bc15ed20 0x7fb7bc157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:47.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.325+0000 7fb7c3227640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb7bc0d32a0 con 0x7fb7bc15ed20 2024-09-15T23:24:47.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.325+0000 7fb7c3227640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb7bc0d3e50 con 0x7fb7bc0d23b0 2024-09-15T23:24:47.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.325+0000 7fb7c3227640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb7bc15f100 con 0x7fb7bc0b6970 2024-09-15T23:24:47.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.325+0000 7fb7c17c4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7bc15ed20 0x7fb7bc157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:47.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.326+0000 7fb7c17c4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7bc15ed20 0x7fb7bc157ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50580/0 (socket says 172.21.15.123:50580) 2024-09-15T23:24:47.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.326+0000 7fb7c17c4640 1 -- 172.21.15.123:0/2913939692 learned_addr learned my addr 172.21.15.123:0/2913939692 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:47.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.326+0000 7fb7bbfff640 1 --2- 172.21.15.123:0/2913939692 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb7bc0d23b0 0x7fb7bc157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:47.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.326+0000 7fb7c0fc3640 1 --2- 172.21.15.123:0/2913939692 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb7bc0b6970 0x7fb7bc161e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:47.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.326+0000 7fb7c17c4640 1 -- 172.21.15.123:0/2913939692 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb7bc0b6970 msgr2=0x7fb7bc161e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:47.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.326+0000 7fb7c17c4640 1 --2- 172.21.15.123:0/2913939692 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb7bc0b6970 0x7fb7bc161e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:47.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.326+0000 7fb7c17c4640 1 -- 172.21.15.123:0/2913939692 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb7bc0d23b0 msgr2=0x7fb7bc157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:47.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.326+0000 7fb7c17c4640 1 --2- 172.21.15.123:0/2913939692 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb7bc0d23b0 0x7fb7bc157570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:47.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.326+0000 7fb7c17c4640 1 -- 172.21.15.123:0/2913939692 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7bc154d80 con 0x7fb7bc15ed20 2024-09-15T23:24:47.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.326+0000 7fb7c17c4640 1 --2- 172.21.15.123:0/2913939692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7bc15ed20 0x7fb7bc157ab0 secure :-1 s=READY pgs=2444 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4009e50 tx=0x7fb7b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:47.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.326+0000 7fb7b97fa640 1 -- 172.21.15.123:0/2913939692 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b4041020 con 0x7fb7bc15ed20 2024-09-15T23:24:47.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.326+0000 7fb7b97fa640 1 -- 172.21.15.123:0/2913939692 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7b4037040 con 0x7fb7bc15ed20 2024-09-15T23:24:47.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.326+0000 7fb7c3227640 1 -- 172.21.15.123:0/2913939692 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7bc162390 con 0x7fb7bc15ed20 2024-09-15T23:24:47.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.326+0000 7fb7b97fa640 1 -- 172.21.15.123:0/2913939692 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b4036050 con 0x7fb7bc15ed20 2024-09-15T23:24:47.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.326+0000 7fb7c3227640 1 -- 172.21.15.123:0/2913939692 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7bc1569c0 con 0x7fb7bc15ed20 2024-09-15T23:24:47.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.327+0000 7fb7c3227640 1 -- 172.21.15.123:0/2913939692 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7bc156c00 con 0x7fb7bc15ed20 2024-09-15T23:24:47.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.328+0000 7fb7b97fa640 1 -- 172.21.15.123:0/2913939692 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb7b4007c70 con 0x7fb7bc15ed20 2024-09-15T23:24:47.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.328+0000 7fb7b97fa640 1 --2- 172.21.15.123:0/2913939692 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb7a006c2b0 0x7fb7a006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:47.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.328+0000 7fb7b97fa640 1 -- 172.21.15.123:0/2913939692 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 5709+0+0 (secure 0 0 0) 0x7fb7b40abab0 con 0x7fb7bc15ed20 2024-09-15T23:24:47.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.328+0000 7fb7c0fc3640 1 --2- 172.21.15.123:0/2913939692 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb7a006c2b0 0x7fb7a006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:47.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.329+0000 7fb7c0fc3640 1 --2- 172.21.15.123:0/2913939692 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb7a006c2b0 0x7fb7a006e770 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fb7b0000f60 tx=0x7fb7b0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:47.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.333+0000 7fb7b97fa640 1 -- 172.21.15.123:0/2913939692 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb7bc156c00 con 0x7fb7bc15ed20 2024-09-15T23:24:47.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.533+0000 7fb7c3227640 1 -- 172.21.15.123:0/2913939692 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb7bc0d1f60 con 0x7fb7bc15ed20 2024-09-15T23:24:47.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.534+0000 7fb7b97fa640 1 -- 172.21.15.123:0/2913939692 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 127 v127) ==== 95+0+5247 (secure 0 0 0) 0x7fb7bc0d1f60 con 0x7fb7bc15ed20 2024-09-15T23:24:47.535 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:47.535 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":127,"btime":"2024-09-15T23:24:06:331850+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7922,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/173351117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":173351117},{"type":"v1","addr":"172.21.15.123:6835","nonce":173351117}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123},{"gid":7928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/4283187910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":4283187910},{"type":"v1","addr":"172.21.15.188:6837","nonce":4283187910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123},{"gid":9061,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/3180373488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3180373488},{"type":"v1","addr":"172.21.15.188:6836","nonce":3180373488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123}],"filesystems":[{"mdsmap":{"epoch":127,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:24:03.556320+0000","modified":"2024-09-15T23:24:05.658884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10905},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10905":{"gid":10905,"name":"c","rank":0,"incarnation":124,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6834/1661365546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":1661365546},{"type":"v1","addr":"172.21.15.123:6834","nonce":1661365546}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10905,"qdb_cluster":[10905]},"id":14}]} 2024-09-15T23:24:47.535 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 127 2024-09-15T23:24:47.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.536+0000 7fb7c3227640 1 -- 172.21.15.123:0/2913939692 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb7a006c2b0 msgr2=0x7fb7a006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:47.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.536+0000 7fb7c3227640 1 --2- 172.21.15.123:0/2913939692 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb7a006c2b0 0x7fb7a006e770 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fb7b0000f60 tx=0x7fb7b0009040 comp rx=0 tx=0).stop 2024-09-15T23:24:47.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.536+0000 7fb7c3227640 1 -- 172.21.15.123:0/2913939692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7bc15ed20 msgr2=0x7fb7bc157ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:47.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.536+0000 7fb7c3227640 1 --2- 172.21.15.123:0/2913939692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7bc15ed20 0x7fb7bc157ab0 secure :-1 s=READY pgs=2444 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4009e50 tx=0x7fb7b4004a40 comp rx=0 tx=0).stop 2024-09-15T23:24:47.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.536+0000 7fb7c3227640 1 -- 172.21.15.123:0/2913939692 shutdown_connections 2024-09-15T23:24:47.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.536+0000 7fb7c3227640 1 --2- 172.21.15.123:0/2913939692 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb7a006c2b0 0x7fb7a006e770 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:47.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.536+0000 7fb7c3227640 1 --2- 172.21.15.123:0/2913939692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb7bc15ed20 0x7fb7bc157ab0 unknown :-1 s=CLOSED pgs=2444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:47.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.536+0000 7fb7c3227640 1 --2- 172.21.15.123:0/2913939692 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb7bc0d23b0 0x7fb7bc157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:47.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.536+0000 7fb7c3227640 1 --2- 172.21.15.123:0/2913939692 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb7bc0b6970 0x7fb7bc161e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:47.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.536+0000 7fb7c3227640 1 -- 172.21.15.123:0/2913939692 >> 172.21.15.123:0/2913939692 conn(0x7fb7bc0d1260 msgr2=0x7fb7bc0b5620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:47.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.536+0000 7fb7c3227640 1 -- 172.21.15.123:0/2913939692 shutdown_connections 2024-09-15T23:24:47.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.536+0000 7fb7c3227640 1 -- 172.21.15.123:0/2913939692 wait complete. 2024-09-15T23:24:47.548 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:24:47.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.645+0000 7fa56dbfd640 1 Processor -- start 2024-09-15T23:24:47.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.645+0000 7fa56dbfd640 1 -- start start 2024-09-15T23:24:47.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.646+0000 7fa56dbfd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa56806bc10 0x7fa56806bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:47.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.646+0000 7fa56dbfd640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa56806c530 con 0x7fa5680b3790 2024-09-15T23:24:47.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.646+0000 7fa56dbfd640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5680b4090 con 0x7fa5680cef60 2024-09-15T23:24:47.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.646+0000 7fa56dbfd640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa5680cd690 con 0x7fa56806bc10 2024-09-15T23:24:47.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.646+0000 7fa567fff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa5680b3790 0x7fa5681624e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51686/0 (socket says 172.21.15.123:51686) 2024-09-15T23:24:47.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.646+0000 7fa567fff640 1 -- 172.21.15.123:0/685286455 learned_addr learned my addr 172.21.15.123:0/685286455 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:47.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.646+0000 7fa5677fe640 1 --2- 172.21.15.123:0/685286455 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa56806bc10 0x7fa56806bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:47.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.646+0000 7fa5667fc640 1 -- 172.21.15.123:0/685286455 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3285643913 0 0) 0x7fa56806c530 con 0x7fa5680b3790 2024-09-15T23:24:47.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.646+0000 7fa5667fc640 1 -- 172.21.15.123:0/685286455 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa550003520 con 0x7fa5680b3790 2024-09-15T23:24:47.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.646+0000 7fa5667fc640 1 -- 172.21.15.123:0/685286455 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4268547691 0 0) 0x7fa550003520 con 0x7fa5680b3790 2024-09-15T23:24:47.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.646+0000 7fa5667fc640 1 -- 172.21.15.123:0/685286455 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa56806bc10 msgr2=0x7fa56806bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:47.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.646+0000 7fa5667fc640 1 --2- 172.21.15.123:0/685286455 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa56806bc10 0x7fa56806bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:47.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.646+0000 7fa5667fc640 1 -- 172.21.15.123:0/685286455 >> v1:172.21.15.188:6789/0 conn(0x7fa5680cef60 legacy=0x7fa56815eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:47.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.646+0000 7fa5667fc640 1 -- 172.21.15.123:0/685286455 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5680d0950 con 0x7fa5680b3790 2024-09-15T23:24:47.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.646+0000 7fa5667fc640 1 -- 172.21.15.123:0/685286455 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fa5600019f0 con 0x7fa5680b3790 2024-09-15T23:24:47.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.646+0000 7fa5667fc640 1 -- 172.21.15.123:0/685286455 >> v1:172.21.15.123:6789/0 conn(0x7fa5680b3790 legacy=0x7fa5681624e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:47.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.646+0000 7fa5667fc640 1 --2- 172.21.15.123:0/685286455 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa56806bc10 0x7fa5500039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:47.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.646+0000 7fa5667fc640 1 --2- 172.21.15.123:0/685286455 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa550003f20 0x7fa550004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:47.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.646+0000 7fa5667fc640 1 --2- 172.21.15.123:0/685286455 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa550004d40 0x7fa5500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:47.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.646+0000 7fa5667fc640 1 -- 172.21.15.123:0/685286455 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa5680cd690 con 0x7fa550003f20 2024-09-15T23:24:47.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.646+0000 7fa5667fc640 1 -- 172.21.15.123:0/685286455 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa55000ba20 con 0x7fa550004d40 2024-09-15T23:24:47.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.646+0000 7fa5667fc640 1 -- 172.21.15.123:0/685286455 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa55000bc20 con 0x7fa56806bc10 2024-09-15T23:24:47.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.646+0000 7fa566ffd640 1 --2- 172.21.15.123:0/685286455 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa550003f20 0x7fa550004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:47.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.647+0000 7fa567fff640 1 --2- 172.21.15.123:0/685286455 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa550004d40 0x7fa5500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:47.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.647+0000 7fa5677fe640 1 --2- 172.21.15.123:0/685286455 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa56806bc10 0x7fa5500039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:47.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.647+0000 7fa566ffd640 1 -- 172.21.15.123:0/685286455 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa56806bc10 msgr2=0x7fa5500039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:47.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.647+0000 7fa566ffd640 1 --2- 172.21.15.123:0/685286455 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa56806bc10 0x7fa5500039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:47.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.647+0000 7fa566ffd640 1 -- 172.21.15.123:0/685286455 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa550004d40 msgr2=0x7fa5500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:47.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.647+0000 7fa566ffd640 1 --2- 172.21.15.123:0/685286455 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa550004d40 0x7fa5500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:47.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.647+0000 7fa566ffd640 1 -- 172.21.15.123:0/685286455 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa550003520 con 0x7fa550003f20 2024-09-15T23:24:47.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.647+0000 7fa566ffd640 1 --2- 172.21.15.123:0/685286455 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa550003f20 0x7fa550004800 secure :-1 s=READY pgs=2446 cs=0 l=1 rev1=1 crypto rx=0x7fa55c001830 tx=0x7fa550005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e0daa29ae2ab3d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:47.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.648+0000 7fa5667fc640 1 -- 172.21.15.123:0/685286455 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55c037070 con 0x7fa550003f20 2024-09-15T23:24:47.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.648+0000 7fa5667fc640 1 -- 172.21.15.123:0/685286455 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa55c02ab00 con 0x7fa550003f20 2024-09-15T23:24:47.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.648+0000 7fa5667fc640 1 -- 172.21.15.123:0/685286455 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55c001430 con 0x7fa550003f20 2024-09-15T23:24:47.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.648+0000 7fa56dbfd640 1 -- 172.21.15.123:0/685286455 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa550003f20 msgr2=0x7fa550004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:47.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.648+0000 7fa56dbfd640 1 --2- 172.21.15.123:0/685286455 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa550003f20 0x7fa550004800 secure :-1 s=READY pgs=2446 cs=0 l=1 rev1=1 crypto rx=0x7fa55c001830 tx=0x7fa550005830 comp rx=0 tx=0).stop 2024-09-15T23:24:47.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.648+0000 7fa567fff640 1 -- 172.21.15.123:0/685286455 reap_dead start 2024-09-15T23:24:47.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.648+0000 7fa56dbfd640 1 -- 172.21.15.123:0/685286455 shutdown_connections 2024-09-15T23:24:47.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.648+0000 7fa56dbfd640 1 -- 172.21.15.123:0/685286455 >> 172.21.15.123:0/685286455 conn(0x7fa56806cd20 msgr2=0x7fa56806d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:47.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.648+0000 7fa56dbfd640 1 -- 172.21.15.123:0/685286455 shutdown_connections 2024-09-15T23:24:47.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.648+0000 7fa56dbfd640 1 -- 172.21.15.123:0/685286455 wait complete. 2024-09-15T23:24:47.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.649+0000 7fa56dbfd640 1 Processor -- start 2024-09-15T23:24:47.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.650+0000 7fa56dbfd640 1 -- start start 2024-09-15T23:24:47.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.650+0000 7fa56dbfd640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa550003f20 0x7fa5680b72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:47.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.650+0000 7fa56dbfd640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa568157820 0x7fa568149140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:47.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.650+0000 7fa56dbfd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa56815bdf0 0x7fa56815c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:47.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.650+0000 7fa56dbfd640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa5680d0f10 con 0x7fa56815bdf0 2024-09-15T23:24:47.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.650+0000 7fa56dbfd640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa5680d06f0 con 0x7fa568157820 2024-09-15T23:24:47.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.650+0000 7fa56dbfd640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa5680b3c40 con 0x7fa550003f20 2024-09-15T23:24:47.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.650+0000 7fa567fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa56815bdf0 0x7fa56815c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:47.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.650+0000 7fa567fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa56815bdf0 0x7fa56815c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50588/0 (socket says 172.21.15.123:50588) 2024-09-15T23:24:47.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.650+0000 7fa567fff640 1 -- 172.21.15.123:0/1773218570 learned_addr learned my addr 172.21.15.123:0/1773218570 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:47.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.650+0000 7fa5677fe640 1 --2- 172.21.15.123:0/1773218570 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa550003f20 0x7fa5680b72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:47.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.650+0000 7fa566ffd640 1 --2- 172.21.15.123:0/1773218570 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa568157820 0x7fa568149140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:47.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.651+0000 7fa567fff640 1 -- 172.21.15.123:0/1773218570 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa550003f20 msgr2=0x7fa5680b72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:47.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.651+0000 7fa567fff640 1 --2- 172.21.15.123:0/1773218570 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa550003f20 0x7fa5680b72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:47.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.651+0000 7fa567fff640 1 -- 172.21.15.123:0/1773218570 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa568157820 msgr2=0x7fa568149140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:47.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.651+0000 7fa567fff640 1 --2- 172.21.15.123:0/1773218570 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa568157820 0x7fa568149140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:47.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.651+0000 7fa567fff640 1 -- 172.21.15.123:0/1773218570 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa568149680 con 0x7fa56815bdf0 2024-09-15T23:24:47.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.651+0000 7fa567fff640 1 --2- 172.21.15.123:0/1773218570 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa56815bdf0 0x7fa56815c270 secure :-1 s=READY pgs=2447 cs=0 l=1 rev1=1 crypto rx=0x7fa560000f80 tx=0x7fa560007b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:47.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.651+0000 7fa54ffff640 1 -- 172.21.15.123:0/1773218570 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa560017020 con 0x7fa56815bdf0 2024-09-15T23:24:47.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.651+0000 7fa54ffff640 1 -- 172.21.15.123:0/1773218570 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa56000aaf0 con 0x7fa56815bdf0 2024-09-15T23:24:47.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.651+0000 7fa56dbfd640 1 -- 172.21.15.123:0/1773218570 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5680b6250 con 0x7fa56815bdf0 2024-09-15T23:24:47.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.651+0000 7fa54ffff640 1 -- 172.21.15.123:0/1773218570 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5600133f0 con 0x7fa56815bdf0 2024-09-15T23:24:47.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.651+0000 7fa56dbfd640 1 -- 172.21.15.123:0/1773218570 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5680b6810 con 0x7fa56815bdf0 2024-09-15T23:24:47.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.652+0000 7fa56dbfd640 1 -- 172.21.15.123:0/1773218570 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa56806bff0 con 0x7fa56815bdf0 2024-09-15T23:24:47.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.652+0000 7fa54ffff640 1 -- 172.21.15.123:0/1773218570 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa56001a020 con 0x7fa56815bdf0 2024-09-15T23:24:47.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.653+0000 7fa54ffff640 1 --2- 172.21.15.123:0/1773218570 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa55406c2b0 0x7fa55406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:47.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.653+0000 7fa54ffff640 1 -- 172.21.15.123:0/1773218570 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 5709+0+0 (secure 0 0 0) 0x7fa56008baf0 con 0x7fa56815bdf0 2024-09-15T23:24:47.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.653+0000 7fa5677fe640 1 --2- 172.21.15.123:0/1773218570 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa55406c2b0 0x7fa55406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:47.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.654+0000 7fa5677fe640 1 --2- 172.21.15.123:0/1773218570 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa55406c2b0 0x7fa55406e770 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fa5680b3760 tx=0x7fa558009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:47.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.657+0000 7fa54ffff640 1 -- 172.21.15.123:0/1773218570 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa560021020 con 0x7fa56815bdf0 2024-09-15T23:24:47.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.855+0000 7fa56dbfd640 1 -- 172.21.15.123:0/1773218570 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa568072f20 con 0x7fa56815bdf0 2024-09-15T23:24:47.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.856+0000 7fa54ffff640 1 -- 172.21.15.123:0/1773218570 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 127 v127) ==== 95+0+5247 (secure 0 0 0) 0x7fa56005a2f0 con 0x7fa56815bdf0 2024-09-15T23:24:47.857 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:47.857 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":127,"btime":"2024-09-15T23:24:06:331850+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7922,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/173351117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":173351117},{"type":"v1","addr":"172.21.15.123:6835","nonce":173351117}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123},{"gid":7928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/4283187910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":4283187910},{"type":"v1","addr":"172.21.15.188:6837","nonce":4283187910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123},{"gid":9061,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/3180373488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3180373488},{"type":"v1","addr":"172.21.15.188:6836","nonce":3180373488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123}],"filesystems":[{"mdsmap":{"epoch":127,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:24:03.556320+0000","modified":"2024-09-15T23:24:05.658884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10905},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10905":{"gid":10905,"name":"c","rank":0,"incarnation":124,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6834/1661365546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":1661365546},{"type":"v1","addr":"172.21.15.123:6834","nonce":1661365546}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10905,"qdb_cluster":[10905]},"id":14}]} 2024-09-15T23:24:47.858 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 127 2024-09-15T23:24:47.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.858+0000 7fa56dbfd640 1 -- 172.21.15.123:0/1773218570 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa55406c2b0 msgr2=0x7fa55406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:47.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.858+0000 7fa56dbfd640 1 --2- 172.21.15.123:0/1773218570 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa55406c2b0 0x7fa55406e770 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fa5680b3760 tx=0x7fa558009190 comp rx=0 tx=0).stop 2024-09-15T23:24:47.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.858+0000 7fa56dbfd640 1 -- 172.21.15.123:0/1773218570 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa56815bdf0 msgr2=0x7fa56815c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:47.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.858+0000 7fa56dbfd640 1 --2- 172.21.15.123:0/1773218570 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa56815bdf0 0x7fa56815c270 secure :-1 s=READY pgs=2447 cs=0 l=1 rev1=1 crypto rx=0x7fa560000f80 tx=0x7fa560007b10 comp rx=0 tx=0).stop 2024-09-15T23:24:47.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.858+0000 7fa56dbfd640 1 -- 172.21.15.123:0/1773218570 shutdown_connections 2024-09-15T23:24:47.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.858+0000 7fa56dbfd640 1 --2- 172.21.15.123:0/1773218570 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa55406c2b0 0x7fa55406e770 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:47.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.858+0000 7fa56dbfd640 1 --2- 172.21.15.123:0/1773218570 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa56815bdf0 0x7fa56815c270 unknown :-1 s=CLOSED pgs=2447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:47.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.858+0000 7fa56dbfd640 1 --2- 172.21.15.123:0/1773218570 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa568157820 0x7fa568149140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:47.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.858+0000 7fa56dbfd640 1 --2- 172.21.15.123:0/1773218570 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa550003f20 0x7fa5680b72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:47.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.858+0000 7fa56dbfd640 1 -- 172.21.15.123:0/1773218570 >> 172.21.15.123:0/1773218570 conn(0x7fa56806cd20 msgr2=0x7fa5680d12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:47.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.858+0000 7fa56dbfd640 1 -- 172.21.15.123:0/1773218570 shutdown_connections 2024-09-15T23:24:47.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.858+0000 7fa56dbfd640 1 -- 172.21.15.123:0/1773218570 wait complete. 2024-09-15T23:24:47.870 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:24:47.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.966+0000 7f9b5eef1640 1 Processor -- start 2024-09-15T23:24:47.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.966+0000 7f9b5eef1640 1 -- start start 2024-09-15T23:24:47.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.967+0000 7f9b5eef1640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f9b580b2d40 0x7f9b5806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:47.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.967+0000 7f9b5eef1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b5806c150 0x7f9b5815c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:47.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.967+0000 7f9b5eef1640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b58071180 con 0x7f9b5813eb20 2024-09-15T23:24:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.967+0000 7f9b5eef1640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f9b58071ab0 con 0x7f9b580b2d40 2024-09-15T23:24:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.967+0000 7f9b5eef1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9b58071460 con 0x7f9b5806c150 2024-09-15T23:24:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.967+0000 7f9b4ffff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f9b5813eb20 0x7f9b5815bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51690/0 (socket says 172.21.15.123:51690) 2024-09-15T23:24:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.967+0000 7f9b4ffff640 1 -- 172.21.15.123:0/2207520783 learned_addr learned my addr 172.21.15.123:0/2207520783 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.967+0000 7f9b5d48e640 1 --2- 172.21.15.123:0/2207520783 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b5806c150 0x7f9b5815c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.967+0000 7f9b5cc8d640 1 --2- 172.21.15.123:0/2207520783 >> v2:172.21.15.188:3300/0 conn(0x7f9b580b2d40 0x7f9b5806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.967+0000 7f9b4f7fe640 1 -- 172.21.15.123:0/2207520783 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1141524435 0 0) 0x7f9b58071180 con 0x7f9b5813eb20 2024-09-15T23:24:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.967+0000 7f9b4f7fe640 1 -- 172.21.15.123:0/2207520783 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b40003520 con 0x7f9b5813eb20 2024-09-15T23:24:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.967+0000 7f9b5cc8d640 1 -- 172.21.15.123:0/2207520783 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b5806c150 msgr2=0x7f9b5815c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.967+0000 7f9b5cc8d640 1 --2- 172.21.15.123:0/2207520783 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b5806c150 0x7f9b5815c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.967+0000 7f9b5cc8d640 1 -- 172.21.15.123:0/2207520783 >> v1:172.21.15.123:6789/0 conn(0x7f9b5813eb20 legacy=0x7f9b5815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.967+0000 7f9b5cc8d640 1 -- 172.21.15.123:0/2207520783 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b58071740 con 0x7f9b580b2d40 2024-09-15T23:24:47.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.967+0000 7f9b5d48e640 1 --2- 172.21.15.123:0/2207520783 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b5806c150 0x7f9b5815c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:24:47.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.968+0000 7f9b5cc8d640 1 --2- 172.21.15.123:0/2207520783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b580b2d40 0x7f9b5806bc10 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9b540097a0 tx=0x7f9b5402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24d196a564aca3c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:47.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.968+0000 7f9b4f7fe640 1 -- 172.21.15.123:0/2207520783 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b54037070 con 0x7f9b580b2d40 2024-09-15T23:24:47.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.968+0000 7f9b4f7fe640 1 -- 172.21.15.123:0/2207520783 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b54032440 con 0x7f9b580b2d40 2024-09-15T23:24:47.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.968+0000 7f9b4f7fe640 1 -- 172.21.15.123:0/2207520783 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b540327f0 con 0x7f9b580b2d40 2024-09-15T23:24:47.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.969+0000 7f9b5eef1640 1 -- 172.21.15.123:0/2207520783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b580b2d40 msgr2=0x7f9b5806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:47.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.969+0000 7f9b5eef1640 1 --2- 172.21.15.123:0/2207520783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b580b2d40 0x7f9b5806bc10 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9b540097a0 tx=0x7f9b5402a180 comp rx=0 tx=0).stop 2024-09-15T23:24:47.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.969+0000 7f9b5eef1640 1 -- 172.21.15.123:0/2207520783 shutdown_connections 2024-09-15T23:24:47.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.969+0000 7f9b5eef1640 1 --2- 172.21.15.123:0/2207520783 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b5806c150 0x7f9b5815c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:47.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.969+0000 7f9b5eef1640 1 --2- 172.21.15.123:0/2207520783 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b580b2d40 0x7f9b5806bc10 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:47.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.969+0000 7f9b5eef1640 1 -- 172.21.15.123:0/2207520783 >> 172.21.15.123:0/2207520783 conn(0x7f9b580ccec0 msgr2=0x7f9b580cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:47.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.969+0000 7f9b5eef1640 1 -- 172.21.15.123:0/2207520783 shutdown_connections 2024-09-15T23:24:47.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.969+0000 7f9b5eef1640 1 -- 172.21.15.123:0/2207520783 wait complete. 2024-09-15T23:24:47.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.970+0000 7f9b5eef1640 1 Processor -- start 2024-09-15T23:24:47.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.970+0000 7f9b5eef1640 1 -- start start 2024-09-15T23:24:47.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.971+0000 7f9b5eef1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b5806c150 0x7f9b580cb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:47.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.971+0000 7f9b5eef1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b580b2d40 0x7f9b58158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:47.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.971+0000 7f9b5eef1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b5813eb20 0x7f9b5813d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:47.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.971+0000 7f9b5eef1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9b580722d0 con 0x7f9b5806c150 2024-09-15T23:24:47.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.971+0000 7f9b5eef1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f9b58072150 con 0x7f9b580b2d40 2024-09-15T23:24:47.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.971+0000 7f9b5eef1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f9b58072450 con 0x7f9b5813eb20 2024-09-15T23:24:47.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.971+0000 7f9b5cc8d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b5806c150 0x7f9b580cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:47.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.971+0000 7f9b5cc8d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b5806c150 0x7f9b580cb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50598/0 (socket says 172.21.15.123:50598) 2024-09-15T23:24:47.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.971+0000 7f9b5cc8d640 1 -- 172.21.15.123:0/1959519812 learned_addr learned my addr 172.21.15.123:0/1959519812 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:47.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.971+0000 7f9b5d48e640 1 --2- 172.21.15.123:0/1959519812 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b5813eb20 0x7f9b5813d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:47.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.971+0000 7f9b4ffff640 1 --2- 172.21.15.123:0/1959519812 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b580b2d40 0x7f9b58158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:47.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.971+0000 7f9b5cc8d640 1 -- 172.21.15.123:0/1959519812 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b5813eb20 msgr2=0x7f9b5813d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:47.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.971+0000 7f9b5cc8d640 1 --2- 172.21.15.123:0/1959519812 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b5813eb20 0x7f9b5813d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:47.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.971+0000 7f9b5cc8d640 1 -- 172.21.15.123:0/1959519812 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b580b2d40 msgr2=0x7f9b58158ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:47.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.971+0000 7f9b5cc8d640 1 --2- 172.21.15.123:0/1959519812 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b580b2d40 0x7f9b58158ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:47.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.971+0000 7f9b5cc8d640 1 -- 172.21.15.123:0/1959519812 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b580cb660 con 0x7f9b5806c150 2024-09-15T23:24:47.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.971+0000 7f9b5d48e640 1 --2- 172.21.15.123:0/1959519812 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b5813eb20 0x7f9b5813d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:24:47.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.971+0000 7f9b4ffff640 1 --2- 172.21.15.123:0/1959519812 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b580b2d40 0x7f9b58158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:24:47.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.972+0000 7f9b5cc8d640 1 --2- 172.21.15.123:0/1959519812 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b5806c150 0x7f9b580cb080 secure :-1 s=READY pgs=2449 cs=0 l=1 rev1=1 crypto rx=0x7f9b54035040 tx=0x7f9b540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:47.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.972+0000 7f9b4d7fa640 1 -- 172.21.15.123:0/1959519812 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b54037040 con 0x7f9b5806c150 2024-09-15T23:24:47.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.972+0000 7f9b4d7fa640 1 -- 172.21.15.123:0/1959519812 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b540044c0 con 0x7f9b5806c150 2024-09-15T23:24:47.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.972+0000 7f9b5eef1640 1 -- 172.21.15.123:0/1959519812 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b580cb940 con 0x7f9b5806c150 2024-09-15T23:24:47.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.972+0000 7f9b4d7fa640 1 -- 172.21.15.123:0/1959519812 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b540325f0 con 0x7f9b5806c150 2024-09-15T23:24:47.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.972+0000 7f9b5eef1640 1 -- 172.21.15.123:0/1959519812 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b58159020 con 0x7f9b5806c150 2024-09-15T23:24:47.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.973+0000 7f9b5eef1640 1 -- 172.21.15.123:0/1959519812 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b5806bc10 con 0x7f9b5806c150 2024-09-15T23:24:47.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.973+0000 7f9b4d7fa640 1 -- 172.21.15.123:0/1959519812 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9b54044020 con 0x7f9b5806c150 2024-09-15T23:24:47.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.974+0000 7f9b4d7fa640 1 --2- 172.21.15.123:0/1959519812 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9b4406c2e0 0x7f9b4406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:47.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.974+0000 7f9b4d7fa640 1 -- 172.21.15.123:0/1959519812 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 5709+0+0 (secure 0 0 0) 0x7f9b540ab6f0 con 0x7f9b5806c150 2024-09-15T23:24:47.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.974+0000 7f9b4ffff640 1 --2- 172.21.15.123:0/1959519812 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9b4406c2e0 0x7f9b4406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:47.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.974+0000 7f9b4ffff640 1 --2- 172.21.15.123:0/1959519812 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9b4406c2e0 0x7f9b4406e7a0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f9b5815fc50 tx=0x7f9b48009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:47.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:47.978+0000 7f9b4d7fa640 1 -- 172.21.15.123:0/1959519812 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9b54079e50 con 0x7f9b5806c150 2024-09-15T23:24:48.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.143+0000 7f9b5eef1640 1 -- 172.21.15.123:0/1959519812 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9b5806c9c0 con 0x7f9b5806c150 2024-09-15T23:24:48.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.144+0000 7f9b4d7fa640 1 -- 172.21.15.123:0/1959519812 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v206) ==== 74+0+16767 (secure 0 0 0) 0x7f9b54079750 con 0x7f9b5806c150 2024-09-15T23:24:48.145 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:48.146 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":206,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:24:05.228587+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:24:02.173413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"205","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-09-15T23:24:02.534783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"206","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:24:48.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.146+0000 7f9b5eef1640 1 -- 172.21.15.123:0/1959519812 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9b4406c2e0 msgr2=0x7f9b4406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:48.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.146+0000 7f9b5eef1640 1 --2- 172.21.15.123:0/1959519812 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9b4406c2e0 0x7f9b4406e7a0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f9b5815fc50 tx=0x7f9b48009040 comp rx=0 tx=0).stop 2024-09-15T23:24:48.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.146+0000 7f9b5eef1640 1 -- 172.21.15.123:0/1959519812 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b5806c150 msgr2=0x7f9b580cb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:48.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.146+0000 7f9b5eef1640 1 --2- 172.21.15.123:0/1959519812 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b5806c150 0x7f9b580cb080 secure :-1 s=READY pgs=2449 cs=0 l=1 rev1=1 crypto rx=0x7f9b54035040 tx=0x7f9b540046c0 comp rx=0 tx=0).stop 2024-09-15T23:24:48.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.146+0000 7f9b5eef1640 1 -- 172.21.15.123:0/1959519812 shutdown_connections 2024-09-15T23:24:48.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.146+0000 7f9b5eef1640 1 --2- 172.21.15.123:0/1959519812 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f9b5813eb20 0x7f9b5813d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:48.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.146+0000 7f9b5eef1640 1 --2- 172.21.15.123:0/1959519812 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f9b580b2d40 0x7f9b58158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:48.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.146+0000 7f9b5eef1640 1 --2- 172.21.15.123:0/1959519812 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f9b4406c2e0 0x7f9b4406e7a0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:48.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.146+0000 7f9b5eef1640 1 --2- 172.21.15.123:0/1959519812 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b5806c150 0x7f9b580cb080 unknown :-1 s=CLOSED pgs=2449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:48.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.146+0000 7f9b5eef1640 1 -- 172.21.15.123:0/1959519812 >> 172.21.15.123:0/1959519812 conn(0x7f9b580ccec0 msgr2=0x7f9b580b4b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:48.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.146+0000 7f9b5eef1640 1 -- 172.21.15.123:0/1959519812 shutdown_connections 2024-09-15T23:24:48.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.146+0000 7f9b5eef1640 1 -- 172.21.15.123:0/1959519812 wait complete. 2024-09-15T23:24:48.158 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T23:24:48.159 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:24:48.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.256+0000 7f24a9f11640 1 Processor -- start 2024-09-15T23:24:48.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.256+0000 7f24a9f11640 1 -- start start 2024-09-15T23:24:48.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.256+0000 7f24a9f11640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f24a40d0200 0x7f24a40d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:48.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.256+0000 7f24a9f11640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f24a40d1620 0x7f24a40d1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:48.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.256+0000 7f24a9f11640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24a4073400 con 0x7f24a415c4f0 2024-09-15T23:24:48.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.256+0000 7f24a9f11640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f24a40d0bb0 con 0x7f24a40d1620 2024-09-15T23:24:48.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.256+0000 7f24a9f11640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f24a40736e0 con 0x7f24a40d0200 2024-09-15T23:24:48.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.257+0000 7f24a3fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f24a40d1620 0x7f24a40d1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:48.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.257+0000 7f24a3fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f24a40d1620 0x7f24a40d1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50602/0 (socket says 172.21.15.123:50602) 2024-09-15T23:24:48.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.257+0000 7f24a3fff640 1 -- 172.21.15.123:0/1264691641 learned_addr learned my addr 172.21.15.123:0/1264691641 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:48.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.257+0000 7f249bfff640 1 --2- 172.21.15.123:0/1264691641 >> v2:172.21.15.188:3300/0 conn(0x7f24a40d0200 0x7f24a40d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:48.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.257+0000 7f24a3fff640 1 -- 172.21.15.123:0/1264691641 >> v2:172.21.15.188:3300/0 conn(0x7f24a40d0200 msgr2=0x7f24a40d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:48.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.257+0000 7f24a3fff640 1 --2- 172.21.15.123:0/1264691641 >> v2:172.21.15.188:3300/0 conn(0x7f24a40d0200 0x7f24a40d0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:48.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.257+0000 7f24a3fff640 1 -- 172.21.15.123:0/1264691641 >> v1:172.21.15.188:6789/0 conn(0x7f24a415c4f0 legacy=0x7f24a415d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:48.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.257+0000 7f24a3fff640 1 -- 172.21.15.123:0/1264691641 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a40739c0 con 0x7f24a40d1620 2024-09-15T23:24:48.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.258+0000 7f24a3fff640 1 --2- 172.21.15.123:0/1264691641 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24a40d1620 0x7f24a40d1a70 secure :-1 s=READY pgs=2450 cs=0 l=1 rev1=1 crypto rx=0x7f24a40700b0 tx=0x7f249c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7712635ed467d8f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:48.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.258+0000 7f24a2ffd640 1 -- 172.21.15.123:0/1264691641 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c036070 con 0x7f24a40d1620 2024-09-15T23:24:48.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.258+0000 7f24a2ffd640 1 -- 172.21.15.123:0/1264691641 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f249c031600 con 0x7f24a40d1620 2024-09-15T23:24:48.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.258+0000 7f24a2ffd640 1 -- 172.21.15.123:0/1264691641 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f249c0319d0 con 0x7f24a40d1620 2024-09-15T23:24:48.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.258+0000 7f24a9f11640 1 -- 172.21.15.123:0/1264691641 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24a40d1620 msgr2=0x7f24a40d1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:48.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.258+0000 7f24a9f11640 1 --2- 172.21.15.123:0/1264691641 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24a40d1620 0x7f24a40d1a70 secure :-1 s=READY pgs=2450 cs=0 l=1 rev1=1 crypto rx=0x7f24a40700b0 tx=0x7f249c02a6f0 comp rx=0 tx=0).stop 2024-09-15T23:24:48.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.258+0000 7f24a9f11640 1 -- 172.21.15.123:0/1264691641 shutdown_connections 2024-09-15T23:24:48.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.258+0000 7f24a9f11640 1 --2- 172.21.15.123:0/1264691641 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24a40d1620 0x7f24a40d1a70 unknown :-1 s=CLOSED pgs=2450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:48.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.258+0000 7f24a9f11640 1 --2- 172.21.15.123:0/1264691641 >> v2:172.21.15.188:3300/0 conn(0x7f24a40d0200 0x7f24a40d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:48.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.258+0000 7f24a9f11640 1 -- 172.21.15.123:0/1264691641 >> 172.21.15.123:0/1264691641 conn(0x7f24a406f400 msgr2=0x7f24a406f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:48.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.258+0000 7f24a9f11640 1 -- 172.21.15.123:0/1264691641 shutdown_connections 2024-09-15T23:24:48.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.258+0000 7f24a9f11640 1 -- 172.21.15.123:0/1264691641 wait complete. 2024-09-15T23:24:48.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.260+0000 7f24a9f11640 1 Processor -- start 2024-09-15T23:24:48.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.260+0000 7f24a9f11640 1 -- start start 2024-09-15T23:24:48.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.260+0000 7f24a9f11640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24a40d0200 0x7f24a41466c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:48.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.260+0000 7f24a9f11640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24a40d1620 0x7f24a40cc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:48.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.260+0000 7f24a9f11640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f24a415c4f0 0x7f24a4146f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:48.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.260+0000 7f24a9f11640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f24a40d0fa0 con 0x7f24a40d1620 2024-09-15T23:24:48.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.260+0000 7f24a9f11640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f24a4073f80 con 0x7f24a415c4f0 2024-09-15T23:24:48.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.260+0000 7f24a9f11640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f24a415c8d0 con 0x7f24a40d0200 2024-09-15T23:24:48.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.260+0000 7f249bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24a40d1620 0x7f24a40cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:48.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.260+0000 7f249bfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24a40d1620 0x7f24a40cc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50604/0 (socket says 172.21.15.123:50604) 2024-09-15T23:24:48.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.260+0000 7f249bfff640 1 -- 172.21.15.123:0/2832782352 learned_addr learned my addr 172.21.15.123:0/2832782352 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:48.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.261+0000 7f24a3fff640 1 --2- 172.21.15.123:0/2832782352 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f24a415c4f0 0x7f24a4146f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:48.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.261+0000 7f24a37fe640 1 --2- 172.21.15.123:0/2832782352 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24a40d0200 0x7f24a41466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:48.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.261+0000 7f249bfff640 1 -- 172.21.15.123:0/2832782352 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24a40d0200 msgr2=0x7f24a41466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:48.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.261+0000 7f249bfff640 1 --2- 172.21.15.123:0/2832782352 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24a40d0200 0x7f24a41466c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:48.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.261+0000 7f249bfff640 1 -- 172.21.15.123:0/2832782352 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f24a415c4f0 msgr2=0x7f24a4146f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:48.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.261+0000 7f249bfff640 1 --2- 172.21.15.123:0/2832782352 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f24a415c4f0 0x7f24a4146f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:48.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.261+0000 7f249bfff640 1 -- 172.21.15.123:0/2832782352 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a4146c00 con 0x7f24a40d1620 2024-09-15T23:24:48.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.261+0000 7f249bfff640 1 --2- 172.21.15.123:0/2832782352 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24a40d1620 0x7f24a40cc470 secure :-1 s=READY pgs=2451 cs=0 l=1 rev1=1 crypto rx=0x7f248c00d5f0 tx=0x7f248c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:48.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.261+0000 7f24a0ff9640 1 -- 172.21.15.123:0/2832782352 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248c0125f0 con 0x7f24a40d1620 2024-09-15T23:24:48.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.261+0000 7f24a0ff9640 1 -- 172.21.15.123:0/2832782352 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f248c019070 con 0x7f24a40d1620 2024-09-15T23:24:48.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.261+0000 7f24a0ff9640 1 -- 172.21.15.123:0/2832782352 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248c0129d0 con 0x7f24a40d1620 2024-09-15T23:24:48.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.261+0000 7f24a9f11640 1 -- 172.21.15.123:0/2832782352 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24a41e5fd0 con 0x7f24a40d1620 2024-09-15T23:24:48.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.261+0000 7f24a9f11640 1 -- 172.21.15.123:0/2832782352 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24a41e6590 con 0x7f24a40d1620 2024-09-15T23:24:48.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.262+0000 7f24a9f11640 1 -- 172.21.15.123:0/2832782352 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24a4073080 con 0x7f24a40d1620 2024-09-15T23:24:48.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.262+0000 7f24a0ff9640 1 -- 172.21.15.123:0/2832782352 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f248c012b70 con 0x7f24a40d1620 2024-09-15T23:24:48.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.263+0000 7f24a0ff9640 1 --2- 172.21.15.123:0/2832782352 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f248406c2b0 0x7f248406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:48.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.263+0000 7f24a0ff9640 1 -- 172.21.15.123:0/2832782352 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 5709+0+0 (secure 0 0 0) 0x7f248c08b880 con 0x7f24a40d1620 2024-09-15T23:24:48.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.263+0000 7f24a37fe640 1 --2- 172.21.15.123:0/2832782352 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f248406c2b0 0x7f248406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:48.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.264+0000 7f24a37fe640 1 --2- 172.21.15.123:0/2832782352 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f248406c2b0 0x7f248406e770 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f2494006fd0 tx=0x7f2494008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:48.268 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.267+0000 7f24a0ff9640 1 -- 172.21.15.123:0/2832782352 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f248c059f70 con 0x7f24a40d1620 2024-09-15T23:24:48.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.468+0000 7f24a9f11640 1 -- 172.21.15.123:0/2832782352 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24a40b6fe0 con 0x7f24a40d1620 2024-09-15T23:24:48.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.469+0000 7f24a0ff9640 1 -- 172.21.15.123:0/2832782352 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 127 v127) ==== 95+0+5247 (secure 0 0 0) 0x7f248c059870 con 0x7f24a40d1620 2024-09-15T23:24:48.470 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:48.470 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":127,"btime":"2024-09-15T23:24:06:331850+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7922,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/173351117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":173351117},{"type":"v1","addr":"172.21.15.123:6835","nonce":173351117}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123},{"gid":7928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/4283187910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":4283187910},{"type":"v1","addr":"172.21.15.188:6837","nonce":4283187910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123},{"gid":9061,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/3180373488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3180373488},{"type":"v1","addr":"172.21.15.188:6836","nonce":3180373488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123}],"filesystems":[{"mdsmap":{"epoch":127,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:24:03.556320+0000","modified":"2024-09-15T23:24:05.658884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10905},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10905":{"gid":10905,"name":"c","rank":0,"incarnation":124,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6834/1661365546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":1661365546},{"type":"v1","addr":"172.21.15.123:6834","nonce":1661365546}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10905,"qdb_cluster":[10905]},"id":14}]} 2024-09-15T23:24:48.470 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 127 2024-09-15T23:24:48.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.471+0000 7f24a9f11640 1 -- 172.21.15.123:0/2832782352 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f248406c2b0 msgr2=0x7f248406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:48.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.471+0000 7f24a9f11640 1 --2- 172.21.15.123:0/2832782352 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f248406c2b0 0x7f248406e770 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f2494006fd0 tx=0x7f2494008040 comp rx=0 tx=0).stop 2024-09-15T23:24:48.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.471+0000 7f24a9f11640 1 -- 172.21.15.123:0/2832782352 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24a40d1620 msgr2=0x7f24a40cc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:48.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.471+0000 7f24a9f11640 1 --2- 172.21.15.123:0/2832782352 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24a40d1620 0x7f24a40cc470 secure :-1 s=READY pgs=2451 cs=0 l=1 rev1=1 crypto rx=0x7f248c00d5f0 tx=0x7f248c00dab0 comp rx=0 tx=0).stop 2024-09-15T23:24:48.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.471+0000 7f24a9f11640 1 -- 172.21.15.123:0/2832782352 shutdown_connections 2024-09-15T23:24:48.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.471+0000 7f24a9f11640 1 --2- 172.21.15.123:0/2832782352 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f24a415c4f0 0x7f24a4146f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:48.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.471+0000 7f24a9f11640 1 --2- 172.21.15.123:0/2832782352 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f248406c2b0 0x7f248406e770 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:48.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.471+0000 7f24a9f11640 1 --2- 172.21.15.123:0/2832782352 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24a40d1620 0x7f24a40cc470 unknown :-1 s=CLOSED pgs=2451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:48.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.471+0000 7f24a9f11640 1 --2- 172.21.15.123:0/2832782352 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f24a40d0200 0x7f24a41466c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:48.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.471+0000 7f24a9f11640 1 -- 172.21.15.123:0/2832782352 >> 172.21.15.123:0/2832782352 conn(0x7f24a406f400 msgr2=0x7f24a40ce810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:48.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.471+0000 7f24a9f11640 1 -- 172.21.15.123:0/2832782352 shutdown_connections 2024-09-15T23:24:48.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.471+0000 7f24a9f11640 1 -- 172.21.15.123:0/2832782352 wait complete. 2024-09-15T23:24:48.483 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:24:48.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.580+0000 7ffb01e53640 1 Processor -- start 2024-09-15T23:24:48.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.580+0000 7ffb01e53640 1 -- start start 2024-09-15T23:24:48.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.581+0000 7ffb01e53640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffafc15eab0 0x7ffafc15ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:48.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.581+0000 7ffb01e53640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffafc15f570 con 0x7ffafc162490 2024-09-15T23:24:48.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.581+0000 7ffb01e53640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffafc15f850 con 0x7ffafc0b66b0 2024-09-15T23:24:48.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.581+0000 7ffb01e53640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ffafc15fb30 con 0x7ffafc15eab0 2024-09-15T23:24:48.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.581+0000 7ffafaffd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ffafc162490 0x7ffafc0d2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51698/0 (socket says 172.21.15.123:51698) 2024-09-15T23:24:48.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.581+0000 7ffafaffd640 1 -- 172.21.15.123:0/1715967695 learned_addr learned my addr 172.21.15.123:0/1715967695 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:48.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.581+0000 7ffafa7fc640 1 -- 172.21.15.123:0/1715967695 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 404954409 0 0) 0x7ffafc15f570 con 0x7ffafc162490 2024-09-15T23:24:48.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.581+0000 7ffafa7fc640 1 -- 172.21.15.123:0/1715967695 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffae4003520 con 0x7ffafc162490 2024-09-15T23:24:48.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.581+0000 7ffafb7fe640 1 --2- 172.21.15.123:0/1715967695 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffafc15eab0 0x7ffafc15ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:48.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.581+0000 7ffafa7fc640 1 -- 172.21.15.123:0/1715967695 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2478798675 0 0) 0x7ffae4003520 con 0x7ffafc162490 2024-09-15T23:24:48.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.581+0000 7ffafa7fc640 1 -- 172.21.15.123:0/1715967695 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffafc15eab0 msgr2=0x7ffafc15ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:48.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.581+0000 7ffafa7fc640 1 --2- 172.21.15.123:0/1715967695 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffafc15eab0 0x7ffafc15ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:48.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.581+0000 7ffafa7fc640 1 -- 172.21.15.123:0/1715967695 >> v1:172.21.15.188:6789/0 conn(0x7ffafc0b66b0 legacy=0x7ffafc0d35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:48.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.581+0000 7ffafa7fc640 1 -- 172.21.15.123:0/1715967695 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffafc15fe10 con 0x7ffafc162490 2024-09-15T23:24:48.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.581+0000 7ffafb7fe640 1 --2- 172.21.15.123:0/1715967695 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffafc15eab0 0x7ffafc15ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:24:48.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.581+0000 7ffafa7fc640 1 -- 172.21.15.123:0/1715967695 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7ffaf0001670 con 0x7ffafc162490 2024-09-15T23:24:48.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.581+0000 7ffafa7fc640 1 -- 172.21.15.123:0/1715967695 >> v1:172.21.15.123:6789/0 conn(0x7ffafc162490 legacy=0x7ffafc0d2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:48.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.581+0000 7ffafa7fc640 1 --2- 172.21.15.123:0/1715967695 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffafc15eab0 0x7ffae40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:48.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.581+0000 7ffafa7fc640 1 --2- 172.21.15.123:0/1715967695 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffae4003fd0 0x7ffae4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:48.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.581+0000 7ffafa7fc640 1 --2- 172.21.15.123:0/1715967695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffae4004d40 0x7ffae40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:48.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.581+0000 7ffafa7fc640 1 -- 172.21.15.123:0/1715967695 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ffafc15fb30 con 0x7ffae4004d40 2024-09-15T23:24:48.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.581+0000 7ffafa7fc640 1 -- 172.21.15.123:0/1715967695 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ffae400bb20 con 0x7ffae4003fd0 2024-09-15T23:24:48.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.581+0000 7ffafa7fc640 1 -- 172.21.15.123:0/1715967695 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ffae400bd20 con 0x7ffafc15eab0 2024-09-15T23:24:48.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.582+0000 7ffafbfff640 1 --2- 172.21.15.123:0/1715967695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffae4004d40 0x7ffae40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:48.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.582+0000 7ffafb7fe640 1 --2- 172.21.15.123:0/1715967695 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffafc15eab0 0x7ffae40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:48.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.582+0000 7ffafaffd640 1 --2- 172.21.15.123:0/1715967695 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffae4003fd0 0x7ffae4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:48.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.582+0000 7ffafbfff640 1 -- 172.21.15.123:0/1715967695 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffafc15eab0 msgr2=0x7ffae40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:48.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.582+0000 7ffafbfff640 1 --2- 172.21.15.123:0/1715967695 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffafc15eab0 0x7ffae40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:48.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.582+0000 7ffafbfff640 1 -- 172.21.15.123:0/1715967695 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffae4003fd0 msgr2=0x7ffae4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:48.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.582+0000 7ffafbfff640 1 --2- 172.21.15.123:0/1715967695 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffae4003fd0 0x7ffae4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:48.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.582+0000 7ffafbfff640 1 -- 172.21.15.123:0/1715967695 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffae4003520 con 0x7ffae4004d40 2024-09-15T23:24:48.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.582+0000 7ffafb7fe640 1 --2- 172.21.15.123:0/1715967695 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffafc15eab0 0x7ffae40039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:24:48.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.582+0000 7ffafbfff640 1 --2- 172.21.15.123:0/1715967695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffae4004d40 0x7ffae40051c0 secure :-1 s=READY pgs=2453 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4001750 tx=0x7ffae4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d6bde759406cb12 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:48.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.583+0000 7ffafa7fc640 1 -- 172.21.15.123:0/1715967695 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf4001370 con 0x7ffae4004d40 2024-09-15T23:24:48.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.583+0000 7ffafa7fc640 1 -- 172.21.15.123:0/1715967695 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf40052d0 con 0x7ffae4004d40 2024-09-15T23:24:48.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.583+0000 7ffafa7fc640 1 -- 172.21.15.123:0/1715967695 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf402abe0 con 0x7ffae4004d40 2024-09-15T23:24:48.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.583+0000 7ffb01e53640 1 -- 172.21.15.123:0/1715967695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffae4004d40 msgr2=0x7ffae40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:48.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.583+0000 7ffb01e53640 1 --2- 172.21.15.123:0/1715967695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffae4004d40 0x7ffae40051c0 secure :-1 s=READY pgs=2453 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4001750 tx=0x7ffae4005830 comp rx=0 tx=0).stop 2024-09-15T23:24:48.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.583+0000 7ffafbfff640 1 -- 172.21.15.123:0/1715967695 reap_dead start 2024-09-15T23:24:48.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.583+0000 7ffb01e53640 1 -- 172.21.15.123:0/1715967695 shutdown_connections 2024-09-15T23:24:48.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.583+0000 7ffb01e53640 1 -- 172.21.15.123:0/1715967695 >> 172.21.15.123:0/1715967695 conn(0x7ffafc0d16d0 msgr2=0x7ffafc0d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:48.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.583+0000 7ffb01e53640 1 -- 172.21.15.123:0/1715967695 shutdown_connections 2024-09-15T23:24:48.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.583+0000 7ffb01e53640 1 -- 172.21.15.123:0/1715967695 wait complete. 2024-09-15T23:24:48.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.584+0000 7ffb01e53640 1 Processor -- start 2024-09-15T23:24:48.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.585+0000 7ffb01e53640 1 -- start start 2024-09-15T23:24:48.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.585+0000 7ffb01e53640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffae4004d40 0x7ffafc159260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:48.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.585+0000 7ffb01e53640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffafc0ccb00 0x7ffafc0ca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:48.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.585+0000 7ffb01e53640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffafc0caf00 0x7ffafc0b7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:48.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.585+0000 7ffb01e53640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ffafc0d45e0 con 0x7ffafc0caf00 2024-09-15T23:24:48.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.585+0000 7ffb01e53640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7ffafc0d4460 con 0x7ffae4004d40 2024-09-15T23:24:48.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.585+0000 7ffb01e53640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7ffafc0d3cf0 con 0x7ffafc0ccb00 2024-09-15T23:24:48.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.585+0000 7ffafbfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffafc0caf00 0x7ffafc0b7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:48.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.585+0000 7ffafbfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffafc0caf00 0x7ffafc0b7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50626/0 (socket says 172.21.15.123:50626) 2024-09-15T23:24:48.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.585+0000 7ffafbfff640 1 -- 172.21.15.123:0/3747541436 learned_addr learned my addr 172.21.15.123:0/3747541436 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:48.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.586+0000 7ffafb7fe640 1 --2- 172.21.15.123:0/3747541436 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffae4004d40 0x7ffafc159260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:48.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.586+0000 7ffafaffd640 1 --2- 172.21.15.123:0/3747541436 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffafc0ccb00 0x7ffafc0ca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:48.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.586+0000 7ffafbfff640 1 -- 172.21.15.123:0/3747541436 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffafc0ccb00 msgr2=0x7ffafc0ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:48.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.586+0000 7ffafbfff640 1 --2- 172.21.15.123:0/3747541436 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffafc0ccb00 0x7ffafc0ca9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:48.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.586+0000 7ffafbfff640 1 -- 172.21.15.123:0/3747541436 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffae4004d40 msgr2=0x7ffafc159260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:48.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.586+0000 7ffafbfff640 1 --2- 172.21.15.123:0/3747541436 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffae4004d40 0x7ffafc159260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:48.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.586+0000 7ffafbfff640 1 -- 172.21.15.123:0/3747541436 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffafc0c9920 con 0x7ffafc0caf00 2024-09-15T23:24:48.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.586+0000 7ffafaffd640 1 --2- 172.21.15.123:0/3747541436 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffafc0ccb00 0x7ffafc0ca9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:24:48.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.586+0000 7ffafb7fe640 1 --2- 172.21.15.123:0/3747541436 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffae4004d40 0x7ffafc159260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:24:48.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.586+0000 7ffafbfff640 1 --2- 172.21.15.123:0/3747541436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffafc0caf00 0x7ffafc0b7a60 secure :-1 s=READY pgs=2454 cs=0 l=1 rev1=1 crypto rx=0x7ffaf402a590 tx=0x7ffaf4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:48.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.586+0000 7ffae3fff640 1 -- 172.21.15.123:0/3747541436 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf4037040 con 0x7ffafc0caf00 2024-09-15T23:24:48.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.586+0000 7ffae3fff640 1 -- 172.21.15.123:0/3747541436 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf4040070 con 0x7ffafc0caf00 2024-09-15T23:24:48.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.586+0000 7ffb01e53640 1 -- 172.21.15.123:0/3747541436 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffafc0c9c00 con 0x7ffafc0caf00 2024-09-15T23:24:48.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.586+0000 7ffae3fff640 1 -- 172.21.15.123:0/3747541436 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf4001370 con 0x7ffafc0caf00 2024-09-15T23:24:48.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.586+0000 7ffb01e53640 1 -- 172.21.15.123:0/3747541436 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffafc0ca1c0 con 0x7ffafc0caf00 2024-09-15T23:24:48.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.587+0000 7ffb01e53640 1 -- 172.21.15.123:0/3747541436 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffafc15f570 con 0x7ffafc0caf00 2024-09-15T23:24:48.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.588+0000 7ffae3fff640 1 -- 172.21.15.123:0/3747541436 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ffaf40052d0 con 0x7ffafc0caf00 2024-09-15T23:24:48.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.588+0000 7ffae3fff640 1 --2- 172.21.15.123:0/3747541436 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ffae806c330 0x7ffae806e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:48.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.588+0000 7ffae3fff640 1 -- 172.21.15.123:0/3747541436 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 5709+0+0 (secure 0 0 0) 0x7ffaf40aabc0 con 0x7ffafc0caf00 2024-09-15T23:24:48.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.588+0000 7ffafb7fe640 1 --2- 172.21.15.123:0/3747541436 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ffae806c330 0x7ffae806e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:48.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.589+0000 7ffafb7fe640 1 --2- 172.21.15.123:0/3747541436 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ffae806c330 0x7ffae806e7f0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7ffafc0b9a80 tx=0x7ffaec00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:48.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.593+0000 7ffae3fff640 1 -- 172.21.15.123:0/3747541436 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffaf4079380 con 0x7ffafc0caf00 2024-09-15T23:24:48.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.792+0000 7ffb01e53640 1 -- 172.21.15.123:0/3747541436 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffafc0d2500 con 0x7ffafc0caf00 2024-09-15T23:24:48.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.792+0000 7ffae3fff640 1 -- 172.21.15.123:0/3747541436 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 127 v127) ==== 95+0+5247 (secure 0 0 0) 0x7ffaf40ae020 con 0x7ffafc0caf00 2024-09-15T23:24:48.793 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:48.794 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":127,"btime":"2024-09-15T23:24:06:331850+0000","default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7922,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/173351117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":173351117},{"type":"v1","addr":"172.21.15.123:6835","nonce":173351117}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123},{"gid":7928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/4283187910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":4283187910},{"type":"v1","addr":"172.21.15.188:6837","nonce":4283187910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123},{"gid":9061,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/3180373488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3180373488},{"type":"v1","addr":"172.21.15.188:6836","nonce":3180373488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123}],"filesystems":[{"mdsmap":{"epoch":127,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:24:03.556320+0000","modified":"2024-09-15T23:24:05.658884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":10905},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10905":{"gid":10905,"name":"c","rank":0,"incarnation":124,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6834/1661365546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":1661365546},{"type":"v1","addr":"172.21.15.123:6834","nonce":1661365546}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":10905,"qdb_cluster":[10905]},"id":14}]} 2024-09-15T23:24:48.794 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 127 2024-09-15T23:24:48.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.794+0000 7ffb01e53640 1 -- 172.21.15.123:0/3747541436 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ffae806c330 msgr2=0x7ffae806e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:48.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.794+0000 7ffb01e53640 1 --2- 172.21.15.123:0/3747541436 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ffae806c330 0x7ffae806e7f0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7ffafc0b9a80 tx=0x7ffaec00b040 comp rx=0 tx=0).stop 2024-09-15T23:24:48.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.794+0000 7ffb01e53640 1 -- 172.21.15.123:0/3747541436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffafc0caf00 msgr2=0x7ffafc0b7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:48.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.794+0000 7ffb01e53640 1 --2- 172.21.15.123:0/3747541436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffafc0caf00 0x7ffafc0b7a60 secure :-1 s=READY pgs=2454 cs=0 l=1 rev1=1 crypto rx=0x7ffaf402a590 tx=0x7ffaf4001120 comp rx=0 tx=0).stop 2024-09-15T23:24:48.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.794+0000 7ffb01e53640 1 -- 172.21.15.123:0/3747541436 shutdown_connections 2024-09-15T23:24:48.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.794+0000 7ffb01e53640 1 --2- 172.21.15.123:0/3747541436 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7ffae806c330 0x7ffae806e7f0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:48.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.794+0000 7ffb01e53640 1 --2- 172.21.15.123:0/3747541436 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffafc0caf00 0x7ffafc0b7a60 unknown :-1 s=CLOSED pgs=2454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:48.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.794+0000 7ffb01e53640 1 --2- 172.21.15.123:0/3747541436 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7ffafc0ccb00 0x7ffafc0ca9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:48.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.794+0000 7ffb01e53640 1 --2- 172.21.15.123:0/3747541436 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7ffae4004d40 0x7ffafc159260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:48.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.794+0000 7ffb01e53640 1 -- 172.21.15.123:0/3747541436 >> 172.21.15.123:0/3747541436 conn(0x7ffafc0d16d0 msgr2=0x7ffafc0b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:48.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.794+0000 7ffb01e53640 1 -- 172.21.15.123:0/3747541436 shutdown_connections 2024-09-15T23:24:48.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.794+0000 7ffb01e53640 1 -- 172.21.15.123:0/3747541436 wait complete. 2024-09-15T23:24:48.807 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:24:48.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.903+0000 7f500c9cf640 1 Processor -- start 2024-09-15T23:24:48.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.903+0000 7f500c9cf640 1 -- start start 2024-09-15T23:24:48.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.904+0000 7f500c9cf640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f500815eab0 0x7f500815ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:48.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.904+0000 7f500c9cf640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50080b66b0 0x7f50080b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:48.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.904+0000 7f500c9cf640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f500815f570 con 0x7f5008162490 2024-09-15T23:24:48.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.904+0000 7f500c9cf640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f50080b7040 con 0x7f500815eab0 2024-09-15T23:24:48.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.904+0000 7f500c9cf640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f500815f850 con 0x7f50080b66b0 2024-09-15T23:24:48.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.904+0000 7f500659c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f500815eab0 0x7f500815ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:48.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.904+0000 7f500659c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f500815eab0 0x7f500815ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50628/0 (socket says 172.21.15.123:50628) 2024-09-15T23:24:48.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.904+0000 7f5005d9b640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f5008162490 0x7f50080d2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51700/0 (socket says 172.21.15.123:51700) 2024-09-15T23:24:48.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.904+0000 7f500659c640 1 -- 172.21.15.123:0/4189358344 learned_addr learned my addr 172.21.15.123:0/4189358344 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:48.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.905+0000 7f5006d9d640 1 --2- 172.21.15.123:0/4189358344 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50080b66b0 0x7f50080b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:48.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.905+0000 7f500659c640 1 -- 172.21.15.123:0/4189358344 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50080b66b0 msgr2=0x7f50080b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:48.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.905+0000 7f500659c640 1 --2- 172.21.15.123:0/4189358344 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50080b66b0 0x7f50080b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:48.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.905+0000 7f500659c640 1 -- 172.21.15.123:0/4189358344 >> v1:172.21.15.123:6789/0 conn(0x7f5008162490 legacy=0x7f50080d2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:48.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.905+0000 7f500659c640 1 -- 172.21.15.123:0/4189358344 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f500815fb30 con 0x7f500815eab0 2024-09-15T23:24:48.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.905+0000 7f500559a640 1 -- 172.21.15.123:0/4189358344 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4288109359 0 0) 0x7f500815f570 con 0x7f5008162490 2024-09-15T23:24:48.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.905+0000 7f500659c640 1 --2- 172.21.15.123:0/4189358344 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f500815eab0 0x7f500815ee90 secure :-1 s=READY pgs=2456 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8009e50 tx=0x7f4ff802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea57a56a973676e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:48.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.905+0000 7f500559a640 1 -- 172.21.15.123:0/4189358344 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8036070 con 0x7f500815eab0 2024-09-15T23:24:48.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.906+0000 7f500559a640 1 -- 172.21.15.123:0/4189358344 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ff8031600 con 0x7f500815eab0 2024-09-15T23:24:48.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.906+0000 7f500559a640 1 -- 172.21.15.123:0/4189358344 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff80319d0 con 0x7f500815eab0 2024-09-15T23:24:48.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.906+0000 7f500c9cf640 1 -- 172.21.15.123:0/4189358344 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f500815eab0 msgr2=0x7f500815ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:48.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.906+0000 7f500c9cf640 1 --2- 172.21.15.123:0/4189358344 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f500815eab0 0x7f500815ee90 secure :-1 s=READY pgs=2456 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8009e50 tx=0x7f4ff802a710 comp rx=0 tx=0).stop 2024-09-15T23:24:48.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.906+0000 7f500c9cf640 1 -- 172.21.15.123:0/4189358344 shutdown_connections 2024-09-15T23:24:48.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.906+0000 7f500c9cf640 1 --2- 172.21.15.123:0/4189358344 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50080b66b0 0x7f50080b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:48.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.906+0000 7f500c9cf640 1 --2- 172.21.15.123:0/4189358344 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f500815eab0 0x7f500815ee90 unknown :-1 s=CLOSED pgs=2456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:48.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.906+0000 7f500c9cf640 1 -- 172.21.15.123:0/4189358344 >> 172.21.15.123:0/4189358344 conn(0x7f50080d16d0 msgr2=0x7f50080d1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:48.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.906+0000 7f500c9cf640 1 -- 172.21.15.123:0/4189358344 shutdown_connections 2024-09-15T23:24:48.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.906+0000 7f500c9cf640 1 -- 172.21.15.123:0/4189358344 wait complete. 2024-09-15T23:24:48.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.907+0000 7f500c9cf640 1 Processor -- start 2024-09-15T23:24:48.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.907+0000 7f500c9cf640 1 -- start start 2024-09-15T23:24:48.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.908+0000 7f500c9cf640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50080b66b0 0x7f50080cad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:48.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.908+0000 7f500c9cf640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f500815eab0 0x7f50081f81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:48.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.908+0000 7f500c9cf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5008162490 0x7f50081f3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:48.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.908+0000 7f500c9cf640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f50080d4460 con 0x7f5008162490 2024-09-15T23:24:48.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.908+0000 7f500c9cf640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f50080cef20 con 0x7f50080b66b0 2024-09-15T23:24:48.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.908+0000 7f500c9cf640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f50080d45e0 con 0x7f500815eab0 2024-09-15T23:24:48.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.908+0000 7f5006d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5008162490 0x7f50081f3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:48.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.908+0000 7f5006d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5008162490 0x7f50081f3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50634/0 (socket says 172.21.15.123:50634) 2024-09-15T23:24:48.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.908+0000 7f5006d9d640 1 -- 172.21.15.123:0/89667922 learned_addr learned my addr 172.21.15.123:0/89667922 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:48.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.908+0000 7f5005d9b640 1 --2- 172.21.15.123:0/89667922 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f500815eab0 0x7f50081f81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:48.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.908+0000 7f500659c640 1 --2- 172.21.15.123:0/89667922 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50080b66b0 0x7f50080cad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:48.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.909+0000 7f5006d9d640 1 -- 172.21.15.123:0/89667922 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f500815eab0 msgr2=0x7f50081f81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:48.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.909+0000 7f5006d9d640 1 --2- 172.21.15.123:0/89667922 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f500815eab0 0x7f50081f81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:48.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.909+0000 7f5006d9d640 1 -- 172.21.15.123:0/89667922 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50080b66b0 msgr2=0x7f50080cad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:48.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.909+0000 7f5006d9d640 1 --2- 172.21.15.123:0/89667922 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50080b66b0 0x7f50080cad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:48.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.909+0000 7f5006d9d640 1 -- 172.21.15.123:0/89667922 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50081f8730 con 0x7f5008162490 2024-09-15T23:24:48.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.909+0000 7f500659c640 1 --2- 172.21.15.123:0/89667922 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50080b66b0 0x7f50080cad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:24:48.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.909+0000 7f5006d9d640 1 --2- 172.21.15.123:0/89667922 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5008162490 0x7f50081f3b80 secure :-1 s=READY pgs=2457 cs=0 l=1 rev1=1 crypto rx=0x7f500000d5d0 tx=0x7f500000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:48.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.909+0000 7f4ff6ffd640 1 -- 172.21.15.123:0/89667922 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50000125f0 con 0x7f5008162490 2024-09-15T23:24:48.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.909+0000 7f4ff6ffd640 1 -- 172.21.15.123:0/89667922 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5000019070 con 0x7f5008162490 2024-09-15T23:24:48.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.909+0000 7f500c9cf640 1 -- 172.21.15.123:0/89667922 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50080b9400 con 0x7f5008162490 2024-09-15T23:24:48.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.909+0000 7f4ff6ffd640 1 -- 172.21.15.123:0/89667922 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50000129f0 con 0x7f5008162490 2024-09-15T23:24:48.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.909+0000 7f500c9cf640 1 -- 172.21.15.123:0/89667922 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50080b96a0 con 0x7f5008162490 2024-09-15T23:24:48.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.910+0000 7f500c9cf640 1 -- 172.21.15.123:0/89667922 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f500815f570 con 0x7f5008162490 2024-09-15T23:24:48.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.910+0000 7f4ff6ffd640 1 -- 172.21.15.123:0/89667922 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5000012b90 con 0x7f5008162490 2024-09-15T23:24:48.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.911+0000 7f4ff6ffd640 1 --2- 172.21.15.123:0/89667922 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4fe806c2b0 0x7f4fe806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:48.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.911+0000 7f4ff6ffd640 1 -- 172.21.15.123:0/89667922 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 5709+0+0 (secure 0 0 0) 0x7f500008b790 con 0x7f5008162490 2024-09-15T23:24:48.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.911+0000 7f500659c640 1 --2- 172.21.15.123:0/89667922 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4fe806c2b0 0x7f4fe806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:48.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.912+0000 7f500659c640 1 --2- 172.21.15.123:0/89667922 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4fe806c2b0 0x7f4fe806e770 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8033000 tx=0x7f4ff8009000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:48.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:48.915+0000 7f4ff6ffd640 1 -- 172.21.15.123:0/89667922 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f50081f8730 con 0x7f5008162490 2024-09-15T23:24:49.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.081+0000 7f500c9cf640 1 -- 172.21.15.123:0/89667922 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f50080d2500 con 0x7f5008162490 2024-09-15T23:24:49.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.082+0000 7f4ff6ffd640 1 -- 172.21.15.123:0/89667922 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v206) ==== 74+0+16767 (secure 0 0 0) 0x7f5000059f10 con 0x7f5008162490 2024-09-15T23:24:49.083 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:49.083 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":206,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:24:05.228587+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:24:02.173413+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"205","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":29,"pool_name":"cephfs_data","create_time":"2024-09-15T23:24:02.534783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"206","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:24:49.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.084+0000 7f500c9cf640 1 -- 172.21.15.123:0/89667922 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4fe806c2b0 msgr2=0x7f4fe806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:49.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.084+0000 7f500c9cf640 1 --2- 172.21.15.123:0/89667922 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4fe806c2b0 0x7f4fe806e770 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8033000 tx=0x7f4ff8009000 comp rx=0 tx=0).stop 2024-09-15T23:24:49.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.084+0000 7f500c9cf640 1 -- 172.21.15.123:0/89667922 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5008162490 msgr2=0x7f50081f3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:49.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.084+0000 7f500c9cf640 1 --2- 172.21.15.123:0/89667922 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5008162490 0x7f50081f3b80 secure :-1 s=READY pgs=2457 cs=0 l=1 rev1=1 crypto rx=0x7f500000d5d0 tx=0x7f500000da90 comp rx=0 tx=0).stop 2024-09-15T23:24:49.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.084+0000 7f500c9cf640 1 -- 172.21.15.123:0/89667922 shutdown_connections 2024-09-15T23:24:49.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.084+0000 7f500c9cf640 1 --2- 172.21.15.123:0/89667922 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f4fe806c2b0 0x7f4fe806e770 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:49.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.084+0000 7f500c9cf640 1 --2- 172.21.15.123:0/89667922 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5008162490 0x7f50081f3b80 unknown :-1 s=CLOSED pgs=2457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:49.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.084+0000 7f500c9cf640 1 --2- 172.21.15.123:0/89667922 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f500815eab0 0x7f50081f81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:49.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.084+0000 7f500c9cf640 1 --2- 172.21.15.123:0/89667922 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50080b66b0 0x7f50080cad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:49.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.084+0000 7f500c9cf640 1 -- 172.21.15.123:0/89667922 >> 172.21.15.123:0/89667922 conn(0x7f50080d16d0 msgr2=0x7f50080d2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:49.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.084+0000 7f500c9cf640 1 -- 172.21.15.123:0/89667922 shutdown_connections 2024-09-15T23:24:49.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.084+0000 7f500c9cf640 1 -- 172.21.15.123:0/89667922 wait complete. 2024-09-15T23:24:49.097 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T23:24:49.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.194+0000 7f12f5ee6640 1 Processor -- start 2024-09-15T23:24:49.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.194+0000 7f12f5ee6640 1 -- start start 2024-09-15T23:24:49.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.195+0000 7f12f5ee6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12f006fe40 0x7f12f0073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:49.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.195+0000 7f12f5ee6640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12f01631c0 con 0x7f12f0162c60 2024-09-15T23:24:49.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.195+0000 7f12f5ee6640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12f00ae9a0 con 0x7f12f015e790 2024-09-15T23:24:49.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.195+0000 7f12f5ee6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f12f015eb70 con 0x7f12f006fe40 2024-09-15T23:24:49.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.195+0000 7f12eeffd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f12f0162c60 0x7f12f006f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51714/0 (socket says 172.21.15.123:51714) 2024-09-15T23:24:49.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.195+0000 7f12eeffd640 1 -- 172.21.15.123:0/4213493990 learned_addr learned my addr 172.21.15.123:0/4213493990 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:49.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.195+0000 7f12effff640 1 --2- 172.21.15.123:0/4213493990 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12f006fe40 0x7f12f0073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:49.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.195+0000 7f12ee7fc640 1 -- 172.21.15.123:0/4213493990 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3148069264 0 0) 0x7f12f01631c0 con 0x7f12f0162c60 2024-09-15T23:24:49.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.195+0000 7f12ee7fc640 1 -- 172.21.15.123:0/4213493990 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12dc003520 con 0x7f12f0162c60 2024-09-15T23:24:49.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.195+0000 7f12ee7fc640 1 -- 172.21.15.123:0/4213493990 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 122584196 0 0) 0x7f12dc003520 con 0x7f12f0162c60 2024-09-15T23:24:49.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.195+0000 7f12ee7fc640 1 -- 172.21.15.123:0/4213493990 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12f006fe40 msgr2=0x7f12f0073a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:49.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.195+0000 7f12ee7fc640 1 --2- 172.21.15.123:0/4213493990 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12f006fe40 0x7f12f0073a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:49.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.195+0000 7f12ee7fc640 1 -- 172.21.15.123:0/4213493990 >> v1:172.21.15.188:6789/0 conn(0x7f12f015e790 legacy=0x7f12f00b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:49.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.195+0000 7f12ee7fc640 1 -- 172.21.15.123:0/4213493990 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f00aec40 con 0x7f12f0162c60 2024-09-15T23:24:49.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.195+0000 7f12ee7fc640 1 -- 172.21.15.123:0/4213493990 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f12e0001670 con 0x7f12f0162c60 2024-09-15T23:24:49.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.195+0000 7f12ee7fc640 1 -- 172.21.15.123:0/4213493990 >> v1:172.21.15.123:6789/0 conn(0x7f12f0162c60 legacy=0x7f12f006f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:49.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.195+0000 7f12ee7fc640 1 --2- 172.21.15.123:0/4213493990 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12f006fe40 0x7f12dc0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:49.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.195+0000 7f12ee7fc640 1 --2- 172.21.15.123:0/4213493990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12dc003f60 0x7f12dc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:49.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.195+0000 7f12ee7fc640 1 --2- 172.21.15.123:0/4213493990 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12dc004d40 0x7f12dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:49.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.195+0000 7f12ee7fc640 1 -- 172.21.15.123:0/4213493990 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f12dc00bb50 con 0x7f12dc003f60 2024-09-15T23:24:49.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.195+0000 7f12ee7fc640 1 -- 172.21.15.123:0/4213493990 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f12dc00bcd0 con 0x7f12dc004d40 2024-09-15T23:24:49.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.195+0000 7f12ee7fc640 1 -- 172.21.15.123:0/4213493990 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f12dc00bed0 con 0x7f12f006fe40 2024-09-15T23:24:49.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.195+0000 7f12eeffd640 1 --2- 172.21.15.123:0/4213493990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12dc003f60 0x7f12dc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:49.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.196+0000 7f12ef7fe640 1 --2- 172.21.15.123:0/4213493990 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12f006fe40 0x7f12dc0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:49.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.196+0000 7f12effff640 1 --2- 172.21.15.123:0/4213493990 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12dc004d40 0x7f12dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:49.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.196+0000 7f12eeffd640 1 -- 172.21.15.123:0/4213493990 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12f006fe40 msgr2=0x7f12dc0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:49.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.196+0000 7f12eeffd640 1 --2- 172.21.15.123:0/4213493990 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12f006fe40 0x7f12dc0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:49.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.196+0000 7f12eeffd640 1 -- 172.21.15.123:0/4213493990 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12dc004d40 msgr2=0x7f12dc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:49.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.196+0000 7f12eeffd640 1 --2- 172.21.15.123:0/4213493990 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12dc004d40 0x7f12dc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:49.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.196+0000 7f12eeffd640 1 -- 172.21.15.123:0/4213493990 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12dc003520 con 0x7f12dc003f60 2024-09-15T23:24:49.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.196+0000 7f12effff640 1 --2- 172.21.15.123:0/4213493990 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12dc004d40 0x7f12dc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:24:49.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.196+0000 7f12eeffd640 1 --2- 172.21.15.123:0/4213493990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12dc003f60 0x7f12dc004800 secure :-1 s=READY pgs=2459 cs=0 l=1 rev1=1 crypto rx=0x7f12e000c240 tx=0x7f12dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ad4a5acf277e0d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:49.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.196+0000 7f12ee7fc640 1 -- 172.21.15.123:0/4213493990 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e0007d10 con 0x7f12dc003f60 2024-09-15T23:24:49.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.197+0000 7f12ee7fc640 1 -- 172.21.15.123:0/4213493990 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12e0005ad0 con 0x7f12dc003f60 2024-09-15T23:24:49.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.197+0000 7f12ee7fc640 1 -- 172.21.15.123:0/4213493990 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e0007070 con 0x7f12dc003f60 2024-09-15T23:24:49.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.197+0000 7f12f5ee6640 1 -- 172.21.15.123:0/4213493990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12dc003f60 msgr2=0x7f12dc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:49.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.197+0000 7f12f5ee6640 1 --2- 172.21.15.123:0/4213493990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12dc003f60 0x7f12dc004800 secure :-1 s=READY pgs=2459 cs=0 l=1 rev1=1 crypto rx=0x7f12e000c240 tx=0x7f12dc005830 comp rx=0 tx=0).stop 2024-09-15T23:24:49.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.197+0000 7f12effff640 1 -- 172.21.15.123:0/4213493990 reap_dead start 2024-09-15T23:24:49.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.197+0000 7f12f5ee6640 1 -- 172.21.15.123:0/4213493990 shutdown_connections 2024-09-15T23:24:49.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.197+0000 7f12f5ee6640 1 -- 172.21.15.123:0/4213493990 >> 172.21.15.123:0/4213493990 conn(0x7f12f00b0a80 msgr2=0x7f12f00b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:49.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.197+0000 7f12f5ee6640 1 -- 172.21.15.123:0/4213493990 shutdown_connections 2024-09-15T23:24:49.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.197+0000 7f12f5ee6640 1 -- 172.21.15.123:0/4213493990 wait complete. 2024-09-15T23:24:49.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.198+0000 7f12f5ee6640 1 Processor -- start 2024-09-15T23:24:49.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.198+0000 7f12f5ee6640 1 -- start start 2024-09-15T23:24:49.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.199+0000 7f12f5ee6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12dc003f60 0x7f12f014dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:49.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.199+0000 7f12f5ee6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12f00cf880 0x7f12f00cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.199+0000 7f12f5ee6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12f00b1710 0x7f12f00b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.199+0000 7f12f5ee6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f12f00b5b40 con 0x7f12f00b1710 2024-09-15T23:24:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.199+0000 7f12f5ee6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f12f00af200 con 0x7f12dc003f60 2024-09-15T23:24:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.199+0000 7f12f5ee6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f12f006f430 con 0x7f12f00cf880 2024-09-15T23:24:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.199+0000 7f12effff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12f00b1710 0x7f12f00b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.199+0000 7f12effff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12f00b1710 0x7f12f00b1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50662/0 (socket says 172.21.15.123:50662) 2024-09-15T23:24:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.199+0000 7f12effff640 1 -- 172.21.15.123:0/1961875785 learned_addr learned my addr 172.21.15.123:0/1961875785 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.200+0000 7f12effff640 1 -- 172.21.15.123:0/1961875785 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12f00cf880 msgr2=0x7f12f00cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.200+0000 7f12eeffd640 1 --2- 172.21.15.123:0/1961875785 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12f00cf880 0x7f12f00cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.200+0000 7f12ef7fe640 1 --2- 172.21.15.123:0/1961875785 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12dc003f60 0x7f12f014dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.200+0000 7f12effff640 1 --2- 172.21.15.123:0/1961875785 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12f00cf880 0x7f12f00cdee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:49.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.200+0000 7f12effff640 1 -- 172.21.15.123:0/1961875785 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12dc003f60 msgr2=0x7f12f014dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:49.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.200+0000 7f12effff640 1 --2- 172.21.15.123:0/1961875785 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12dc003f60 0x7f12f014dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:49.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.200+0000 7f12effff640 1 -- 172.21.15.123:0/1961875785 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f014e100 con 0x7f12f00b1710 2024-09-15T23:24:49.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.200+0000 7f12effff640 1 --2- 172.21.15.123:0/1961875785 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12f00b1710 0x7f12f00b1b90 secure :-1 s=READY pgs=2460 cs=0 l=1 rev1=1 crypto rx=0x7f12e8009fd0 tx=0x7f12e8010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:49.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.200+0000 7f12e7fff640 1 -- 172.21.15.123:0/1961875785 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e801a030 con 0x7f12f00b1710 2024-09-15T23:24:49.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.200+0000 7f12e7fff640 1 -- 172.21.15.123:0/1961875785 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12e8010e30 con 0x7f12f00b1710 2024-09-15T23:24:49.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.200+0000 7f12e7fff640 1 -- 172.21.15.123:0/1961875785 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e8003bd0 con 0x7f12f00b1710 2024-09-15T23:24:49.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.200+0000 7f12f5ee6640 1 -- 172.21.15.123:0/1961875785 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12f00cd440 con 0x7f12f00b1710 2024-09-15T23:24:49.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.200+0000 7f12f5ee6640 1 -- 172.21.15.123:0/1961875785 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12f0161660 con 0x7f12f00b1710 2024-09-15T23:24:49.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.201+0000 7f12f5ee6640 1 -- 172.21.15.123:0/1961875785 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12f00b20d0 con 0x7f12f00b1710 2024-09-15T23:24:49.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.202+0000 7f12e7fff640 1 -- 172.21.15.123:0/1961875785 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f12e8005d10 con 0x7f12f00b1710 2024-09-15T23:24:49.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.202+0000 7f12e7fff640 1 --2- 172.21.15.123:0/1961875785 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f12d006c2b0 0x7f12d006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:49.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.202+0000 7f12e7fff640 1 -- 172.21.15.123:0/1961875785 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 5709+0+0 (secure 0 0 0) 0x7f12e808baf0 con 0x7f12f00b1710 2024-09-15T23:24:49.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.202+0000 7f12ef7fe640 1 --2- 172.21.15.123:0/1961875785 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f12d006c2b0 0x7f12d006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:49.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.203+0000 7f12ef7fe640 1 --2- 172.21.15.123:0/1961875785 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f12d006c2b0 0x7f12d006e770 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f12f01e9110 tx=0x7f12d8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:49.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.206+0000 7f12e7fff640 1 -- 172.21.15.123:0/1961875785 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f12e8025020 con 0x7f12f00b1710 2024-09-15T23:24:49.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.405+0000 7f12f5ee6640 1 -- 172.21.15.123:0/1961875785 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f12f0073a40 con 0x7f12f00b1710 2024-09-15T23:24:49.406 INFO:tasks.ceph.mon.a.smithi123.stderr:2024-09-15T23:24:49.406+0000 7f8a6ccf0640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:24:49.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.407+0000 7f12e7fff640 1 -- 172.21.15.123:0/1961875785 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v128) ==== 161+0+0 (secure 0 0 0) 0x7f12e805a2f0 con 0x7f12f00b1710 2024-09-15T23:24:49.408 INFO:teuthology.orchestra.run.smithi123.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T23:24:49.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.411+0000 7f12f5ee6640 1 -- 172.21.15.123:0/1961875785 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f12d006c2b0 msgr2=0x7f12d006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:49.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.411+0000 7f12f5ee6640 1 --2- 172.21.15.123:0/1961875785 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f12d006c2b0 0x7f12d006e770 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f12f01e9110 tx=0x7f12d8009040 comp rx=0 tx=0).stop 2024-09-15T23:24:49.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.411+0000 7f12f5ee6640 1 -- 172.21.15.123:0/1961875785 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12f00b1710 msgr2=0x7f12f00b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:49.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.411+0000 7f12f5ee6640 1 --2- 172.21.15.123:0/1961875785 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12f00b1710 0x7f12f00b1b90 secure :-1 s=READY pgs=2460 cs=0 l=1 rev1=1 crypto rx=0x7f12e8009fd0 tx=0x7f12e8010590 comp rx=0 tx=0).stop 2024-09-15T23:24:49.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.411+0000 7f12f5ee6640 1 -- 172.21.15.123:0/1961875785 shutdown_connections 2024-09-15T23:24:49.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.411+0000 7f12f5ee6640 1 --2- 172.21.15.123:0/1961875785 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f12d006c2b0 0x7f12d006e770 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:49.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.411+0000 7f12f5ee6640 1 --2- 172.21.15.123:0/1961875785 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f12f00b1710 0x7f12f00b1b90 unknown :-1 s=CLOSED pgs=2460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:49.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.411+0000 7f12f5ee6640 1 --2- 172.21.15.123:0/1961875785 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f12f00cf880 0x7f12f00cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:49.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.411+0000 7f12f5ee6640 1 --2- 172.21.15.123:0/1961875785 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f12dc003f60 0x7f12f014dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:49.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.411+0000 7f12f5ee6640 1 -- 172.21.15.123:0/1961875785 >> 172.21.15.123:0/1961875785 conn(0x7f12f00b0a80 msgr2=0x7f12f00af620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:49.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.411+0000 7f12f5ee6640 1 -- 172.21.15.123:0/1961875785 shutdown_connections 2024-09-15T23:24:49.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.411+0000 7f12f5ee6640 1 -- 172.21.15.123:0/1961875785 wait complete. 2024-09-15T23:24:49.414 INFO:tasks.ceph.mds.c.smithi123.stderr: -6391> 2024-09-15T23:24:05.488+0000 7ff858d42640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:24:49.417 INFO:tasks.ceph.mds.c.smithi123.stderr: -3119> 2024-09-15T23:24:15.450+0000 7ff854d3a640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/sixmegs auth v6 ap=1 DIRTYPARENT s=5242880 n(v0 rc2024-09-15T23:24:14.452213+0000 b5242880 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={8024=0-12582912@1} caps={8024=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@4},l=8024 | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x5637080c0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(29)0x10000000001:[<0x10000000000/sixmegs v6>,<0x1/subdir v8>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-09-15T23:24:49.424 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T23:24:49.446 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-09-15T23:24:49.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.524+0000 7f83510c0640 1 Processor -- start 2024-09-15T23:24:49.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.524+0000 7f83510c0640 1 -- start start 2024-09-15T23:24:49.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.525+0000 7f83510c0640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f834c0b38a0 0x7f834c0d3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:49.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.525+0000 7f83510c0640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f834c0cf710 con 0x7f834c0b3350 2024-09-15T23:24:49.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.525+0000 7f83510c0640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f834c0cf9f0 con 0x7f834c06bfd0 2024-09-15T23:24:49.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.525+0000 7f83510c0640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f834c0b78a0 con 0x7f834c0b38a0 2024-09-15T23:24:49.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.525+0000 7f834b59e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f834c0b38a0 0x7f834c0d3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:49.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.525+0000 7f834259c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f834c0b3350 0x7f834c0d2920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51740/0 (socket says 172.21.15.123:51740) 2024-09-15T23:24:49.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.525+0000 7f834259c640 1 -- 172.21.15.123:0/300950450 learned_addr learned my addr 172.21.15.123:0/300950450 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:49.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.526+0000 7f834b59e640 1 -- 172.21.15.123:0/300950450 >> v1:172.21.15.188:6789/0 conn(0x7f834c06bfd0 legacy=0x7f834c06c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:49.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.526+0000 7f834b59e640 1 -- 172.21.15.123:0/300950450 >> v1:172.21.15.123:6789/0 conn(0x7f834c0b3350 legacy=0x7f834c0d2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:49.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.526+0000 7f834a59c640 1 -- 172.21.15.123:0/300950450 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1520206696 0 0) 0x7f834c0cf710 con 0x7f834c0b3350 2024-09-15T23:24:49.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.526+0000 7f834b59e640 1 -- 172.21.15.123:0/300950450 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f834c0cfcd0 con 0x7f834c0b38a0 2024-09-15T23:24:49.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.526+0000 7f834b59e640 1 --2- 172.21.15.123:0/300950450 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f834c0b38a0 0x7f834c0d3030 secure :-1 s=READY pgs=2465 cs=0 l=1 rev1=1 crypto rx=0x7f8344009d90 tx=0x7f834402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57c7790172961f92 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:49.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.526+0000 7f834a59c640 1 -- 172.21.15.123:0/300950450 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8344007740 con 0x7f834c0b38a0 2024-09-15T23:24:49.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.527+0000 7f834a59c640 1 -- 172.21.15.123:0/300950450 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83440078e0 con 0x7f834c0b38a0 2024-09-15T23:24:49.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.527+0000 7f834a59c640 1 -- 172.21.15.123:0/300950450 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8344007cb0 con 0x7f834c0b38a0 2024-09-15T23:24:49.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.527+0000 7f83510c0640 1 -- 172.21.15.123:0/300950450 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f834c0b38a0 msgr2=0x7f834c0d3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:49.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.527+0000 7f83510c0640 1 --2- 172.21.15.123:0/300950450 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f834c0b38a0 0x7f834c0d3030 secure :-1 s=READY pgs=2465 cs=0 l=1 rev1=1 crypto rx=0x7f8344009d90 tx=0x7f834402a730 comp rx=0 tx=0).stop 2024-09-15T23:24:49.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.527+0000 7f83510c0640 1 -- 172.21.15.123:0/300950450 shutdown_connections 2024-09-15T23:24:49.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.527+0000 7f83510c0640 1 --2- 172.21.15.123:0/300950450 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f834c0b38a0 0x7f834c0d3030 unknown :-1 s=CLOSED pgs=2465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:49.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.527+0000 7f83510c0640 1 -- 172.21.15.123:0/300950450 >> 172.21.15.123:0/300950450 conn(0x7f834c0d11c0 msgr2=0x7f834c0d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:49.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.527+0000 7f83510c0640 1 -- 172.21.15.123:0/300950450 shutdown_connections 2024-09-15T23:24:49.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.527+0000 7f83510c0640 1 -- 172.21.15.123:0/300950450 wait complete. 2024-09-15T23:24:49.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.528+0000 7f83510c0640 1 Processor -- start 2024-09-15T23:24:49.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.529+0000 7f83510c0640 1 -- start start 2024-09-15T23:24:49.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.529+0000 7f83510c0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f834c06bfd0 0x7f834c15b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:49.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.529+0000 7f83510c0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f834c0b3350 0x7f834c0cc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:49.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.529+0000 7f83510c0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f834c0b38a0 0x7f834c0b9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:49.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.529+0000 7f83510c0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f834c06cd50 con 0x7f834c0b3350 2024-09-15T23:24:49.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.529+0000 7f83510c0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f834c0cffb0 con 0x7f834c06bfd0 2024-09-15T23:24:49.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.529+0000 7f83510c0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f834c15eae0 con 0x7f834c0b38a0 2024-09-15T23:24:49.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.529+0000 7f834259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f834c0b3350 0x7f834c0cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:49.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.529+0000 7f834259c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f834c0b3350 0x7f834c0cc100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50698/0 (socket says 172.21.15.123:50698) 2024-09-15T23:24:49.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.529+0000 7f834259c640 1 -- 172.21.15.123:0/2535347064 learned_addr learned my addr 172.21.15.123:0/2535347064 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:49.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.530+0000 7f834b59e640 1 --2- 172.21.15.123:0/2535347064 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f834c0b38a0 0x7f834c0b9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:49.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.530+0000 7f834ad9d640 1 --2- 172.21.15.123:0/2535347064 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f834c06bfd0 0x7f834c15b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:49.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.530+0000 7f834259c640 1 -- 172.21.15.123:0/2535347064 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f834c0b38a0 msgr2=0x7f834c0b9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:49.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.530+0000 7f834259c640 1 --2- 172.21.15.123:0/2535347064 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f834c0b38a0 0x7f834c0b9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:49.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.530+0000 7f834259c640 1 -- 172.21.15.123:0/2535347064 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f834c06bfd0 msgr2=0x7f834c15b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:49.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.530+0000 7f834259c640 1 --2- 172.21.15.123:0/2535347064 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f834c06bfd0 0x7f834c15b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:49.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.530+0000 7f834259c640 1 -- 172.21.15.123:0/2535347064 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f834c0b2960 con 0x7f834c0b3350 2024-09-15T23:24:49.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.530+0000 7f834ad9d640 1 --2- 172.21.15.123:0/2535347064 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f834c06bfd0 0x7f834c15b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:24:49.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.530+0000 7f834259c640 1 --2- 172.21.15.123:0/2535347064 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f834c0b3350 0x7f834c0cc100 secure :-1 s=READY pgs=2466 cs=0 l=1 rev1=1 crypto rx=0x7f833400c4d0 tx=0x7f833400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:49.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.530+0000 7f8343fff640 1 -- 172.21.15.123:0/2535347064 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8334018070 con 0x7f834c0b3350 2024-09-15T23:24:49.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.530+0000 7f8343fff640 1 -- 172.21.15.123:0/2535347064 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8334007500 con 0x7f834c0b3350 2024-09-15T23:24:49.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.530+0000 7f83510c0640 1 -- 172.21.15.123:0/2535347064 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f834c0cc640 con 0x7f834c0b3350 2024-09-15T23:24:49.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.530+0000 7f8343fff640 1 -- 172.21.15.123:0/2535347064 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8334004a20 con 0x7f834c0b3350 2024-09-15T23:24:49.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.530+0000 7f83510c0640 1 -- 172.21.15.123:0/2535347064 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f834c0b2ee0 con 0x7f834c0b3350 2024-09-15T23:24:49.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.531+0000 7f83510c0640 1 -- 172.21.15.123:0/2535347064 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f834c0b3120 con 0x7f834c0b3350 2024-09-15T23:24:49.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.532+0000 7f8343fff640 1 -- 172.21.15.123:0/2535347064 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f833401b070 con 0x7f834c0b3350 2024-09-15T23:24:49.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.532+0000 7f8343fff640 1 --2- 172.21.15.123:0/2535347064 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f832c06c2e0 0x7f832c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:49.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.532+0000 7f8343fff640 1 -- 172.21.15.123:0/2535347064 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 5795+0+0 (secure 0 0 0) 0x7f833408a710 con 0x7f834c0b3350 2024-09-15T23:24:49.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.532+0000 7f834ad9d640 1 --2- 172.21.15.123:0/2535347064 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f832c06c2e0 0x7f832c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:49.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.533+0000 7f834ad9d640 1 --2- 172.21.15.123:0/2535347064 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f832c06c2e0 0x7f832c06e7a0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f833c001750 tx=0x7f833c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:49.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.537+0000 7f8343fff640 1 -- 172.21.15.123:0/2535347064 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f834c0b3120 con 0x7f834c0b3350 2024-09-15T23:24:49.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:49.738+0000 7f83510c0640 1 -- 172.21.15.123:0/2535347064 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f834c0d0cf0 con 0x7f834c0b3350 2024-09-15T23:24:50.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.439+0000 7f8343fff640 1 -- 172.21.15.123:0/2535347064 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v129) ==== 104+0+0 (secure 0 0 0) 0x7f83340587d0 con 0x7f834c0b3350 2024-09-15T23:24:50.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.441+0000 7f83510c0640 1 -- 172.21.15.123:0/2535347064 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f832c06c2e0 msgr2=0x7f832c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:50.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.441+0000 7f83510c0640 1 --2- 172.21.15.123:0/2535347064 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f832c06c2e0 0x7f832c06e7a0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f833c001750 tx=0x7f833c009040 comp rx=0 tx=0).stop 2024-09-15T23:24:50.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.441+0000 7f83510c0640 1 -- 172.21.15.123:0/2535347064 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f834c0b3350 msgr2=0x7f834c0cc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:50.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.441+0000 7f83510c0640 1 --2- 172.21.15.123:0/2535347064 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f834c0b3350 0x7f834c0cc100 secure :-1 s=READY pgs=2466 cs=0 l=1 rev1=1 crypto rx=0x7f833400c4d0 tx=0x7f833400c990 comp rx=0 tx=0).stop 2024-09-15T23:24:50.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.441+0000 7f83510c0640 1 -- 172.21.15.123:0/2535347064 shutdown_connections 2024-09-15T23:24:50.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.441+0000 7f83510c0640 1 --2- 172.21.15.123:0/2535347064 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f834c0b38a0 0x7f834c0b9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:50.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.441+0000 7f83510c0640 1 --2- 172.21.15.123:0/2535347064 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f832c06c2e0 0x7f832c06e7a0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:50.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.441+0000 7f83510c0640 1 --2- 172.21.15.123:0/2535347064 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f834c0b3350 0x7f834c0cc100 unknown :-1 s=CLOSED pgs=2466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:50.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.441+0000 7f83510c0640 1 --2- 172.21.15.123:0/2535347064 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f834c06bfd0 0x7f834c15b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:50.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.441+0000 7f83510c0640 1 -- 172.21.15.123:0/2535347064 >> 172.21.15.123:0/2535347064 conn(0x7f834c0d11c0 msgr2=0x7f834c0b7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:50.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.441+0000 7f83510c0640 1 -- 172.21.15.123:0/2535347064 shutdown_connections 2024-09-15T23:24:50.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.441+0000 7f83510c0640 1 -- 172.21.15.123:0/2535347064 wait complete. 2024-09-15T23:24:50.455 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T23:24:50.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.598+0000 7f4520a82640 1 Processor -- start 2024-09-15T23:24:50.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.598+0000 7f4520a82640 1 -- start start 2024-09-15T23:24:50.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.599+0000 7f4520a82640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f451c15ea90 0x7f451c0d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:50.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.599+0000 7f4520a82640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f451c0d40b0 0x7f451c0d0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:50.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.599+0000 7f4520a82640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f451c0cf060 con 0x7f451c0d1510 2024-09-15T23:24:50.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.599+0000 7f4520a82640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f451c0d34c0 con 0x7f451c15ea90 2024-09-15T23:24:50.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.599+0000 7f4520a82640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f451c0d1960 con 0x7f451c0d40b0 2024-09-15T23:24:50.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.599+0000 7f451a59c640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f451c15ea90 0x7f451c0d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:50.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.599+0000 7f451ad9d640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f451c0d1510 0x7f451c0b6210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51752/0 (socket says 172.21.15.123:51752) 2024-09-15T23:24:50.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.599+0000 7f451ad9d640 1 -- 172.21.15.123:0/3116695666 learned_addr learned my addr 172.21.15.123:0/3116695666 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:50.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.600+0000 7f451a59c640 1 -- 172.21.15.123:0/3116695666 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f451c0d40b0 msgr2=0x7f451c0d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:50.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.600+0000 7f4519d9b640 1 --2- 172.21.15.123:0/3116695666 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f451c0d40b0 0x7f451c0d0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:50.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.600+0000 7f451a59c640 1 --2- 172.21.15.123:0/3116695666 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f451c0d40b0 0x7f451c0d0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:50.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.600+0000 7f451959a640 1 -- 172.21.15.123:0/3116695666 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4183914985 0 0) 0x7f451c0cf060 con 0x7f451c0d1510 2024-09-15T23:24:50.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.600+0000 7f451a59c640 1 -- 172.21.15.123:0/3116695666 >> v1:172.21.15.123:6789/0 conn(0x7f451c0d1510 legacy=0x7f451c0b6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:50.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.600+0000 7f451a59c640 1 -- 172.21.15.123:0/3116695666 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f451c0cf340 con 0x7f451c15ea90 2024-09-15T23:24:50.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.600+0000 7f451a59c640 1 --2- 172.21.15.123:0/3116695666 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f451c15ea90 0x7f451c0d2f80 secure :-1 s=READY pgs=2468 cs=0 l=1 rev1=1 crypto rx=0x7f450c009d90 tx=0x7f450c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f33c3e8824afd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:50.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.601+0000 7f451959a640 1 -- 172.21.15.123:0/3116695666 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450c007740 con 0x7f451c15ea90 2024-09-15T23:24:50.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.601+0000 7f451959a640 1 -- 172.21.15.123:0/3116695666 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f450c0078e0 con 0x7f451c15ea90 2024-09-15T23:24:50.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.601+0000 7f451959a640 1 -- 172.21.15.123:0/3116695666 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450c007cb0 con 0x7f451c15ea90 2024-09-15T23:24:50.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.601+0000 7f4520a82640 1 -- 172.21.15.123:0/3116695666 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f451c15ea90 msgr2=0x7f451c0d2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:50.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.601+0000 7f4520a82640 1 --2- 172.21.15.123:0/3116695666 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f451c15ea90 0x7f451c0d2f80 secure :-1 s=READY pgs=2468 cs=0 l=1 rev1=1 crypto rx=0x7f450c009d90 tx=0x7f450c02a660 comp rx=0 tx=0).stop 2024-09-15T23:24:50.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.601+0000 7f4520a82640 1 -- 172.21.15.123:0/3116695666 shutdown_connections 2024-09-15T23:24:50.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.601+0000 7f4520a82640 1 --2- 172.21.15.123:0/3116695666 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f451c0d40b0 0x7f451c0d0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:50.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.601+0000 7f4520a82640 1 --2- 172.21.15.123:0/3116695666 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f451c15ea90 0x7f451c0d2f80 unknown :-1 s=CLOSED pgs=2468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:50.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.601+0000 7f4520a82640 1 -- 172.21.15.123:0/3116695666 >> 172.21.15.123:0/3116695666 conn(0x7f451c06c0e0 msgr2=0x7f451c06c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:50.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.601+0000 7f4520a82640 1 -- 172.21.15.123:0/3116695666 shutdown_connections 2024-09-15T23:24:50.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.601+0000 7f4520a82640 1 -- 172.21.15.123:0/3116695666 wait complete. 2024-09-15T23:24:50.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.602+0000 7f4520a82640 1 Processor -- start 2024-09-15T23:24:50.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.603+0000 7f4520a82640 1 -- start start 2024-09-15T23:24:50.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.603+0000 7f4520a82640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f451c0d1510 0x7f451c158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:50.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.603+0000 7f4520a82640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f451c0d40b0 0x7f451c157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:50.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.603+0000 7f4520a82640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f451c15ea90 0x7f451c0c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:50.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.603+0000 7f4520a82640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f451c0cfbe0 con 0x7f451c0d1510 2024-09-15T23:24:50.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.603+0000 7f4520a82640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f451c0cf900 con 0x7f451c0d40b0 2024-09-15T23:24:50.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.603+0000 7f4520a82640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f451c15ee70 con 0x7f451c15ea90 2024-09-15T23:24:50.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.603+0000 7f451a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f451c0d1510 0x7f451c158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:50.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.603+0000 7f451a59c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f451c0d1510 0x7f451c158a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50718/0 (socket says 172.21.15.123:50718) 2024-09-15T23:24:50.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.603+0000 7f451a59c640 1 -- 172.21.15.123:0/2868480767 learned_addr learned my addr 172.21.15.123:0/2868480767 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:50.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.604+0000 7f451a59c640 1 -- 172.21.15.123:0/2868480767 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f451c15ea90 msgr2=0x7f451c0c9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:50.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.604+0000 7f451a59c640 1 --2- 172.21.15.123:0/2868480767 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f451c15ea90 0x7f451c0c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:50.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.604+0000 7f451a59c640 1 -- 172.21.15.123:0/2868480767 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f451c0d40b0 msgr2=0x7f451c157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:50.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.604+0000 7f451a59c640 1 --2- 172.21.15.123:0/2868480767 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f451c0d40b0 0x7f451c157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:50.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.604+0000 7f451a59c640 1 -- 172.21.15.123:0/2868480767 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f451c157f60 con 0x7f451c0d1510 2024-09-15T23:24:50.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.604+0000 7f451a59c640 1 --2- 172.21.15.123:0/2868480767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f451c0d1510 0x7f451c158a20 secure :-1 s=READY pgs=2469 cs=0 l=1 rev1=1 crypto rx=0x7f450c009d90 tx=0x7f450c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:50.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.604+0000 7f4512ffd640 1 -- 172.21.15.123:0/2868480767 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450c03f070 con 0x7f451c0d1510 2024-09-15T23:24:50.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.604+0000 7f4512ffd640 1 -- 172.21.15.123:0/2868480767 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f450c031c40 con 0x7f451c0d1510 2024-09-15T23:24:50.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.604+0000 7f4520a82640 1 -- 172.21.15.123:0/2868480767 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f451c0cb990 con 0x7f451c0d1510 2024-09-15T23:24:50.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.604+0000 7f4512ffd640 1 -- 172.21.15.123:0/2868480767 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f450c043410 con 0x7f451c0d1510 2024-09-15T23:24:50.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.604+0000 7f4520a82640 1 -- 172.21.15.123:0/2868480767 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f451c0cbf50 con 0x7f451c0d1510 2024-09-15T23:24:50.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.605+0000 7f4520a82640 1 -- 172.21.15.123:0/2868480767 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f451c0d0fd0 con 0x7f451c0d1510 2024-09-15T23:24:50.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.605+0000 7f4512ffd640 1 -- 172.21.15.123:0/2868480767 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f450c0435b0 con 0x7f451c0d1510 2024-09-15T23:24:50.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.606+0000 7f4512ffd640 1 --2- 172.21.15.123:0/2868480767 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f44fc06c2e0 0x7f44fc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:50.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.606+0000 7f4512ffd640 1 -- 172.21.15.123:0/2868480767 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 5795+0+0 (secure 0 0 0) 0x7f450c0ac930 con 0x7f451c0d1510 2024-09-15T23:24:50.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.606+0000 7f4519d9b640 1 --2- 172.21.15.123:0/2868480767 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f44fc06c2e0 0x7f44fc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:50.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.606+0000 7f4519d9b640 1 --2- 172.21.15.123:0/2868480767 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f44fc06c2e0 0x7f44fc06e7a0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f4504006fd0 tx=0x7f4504008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:50.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.610+0000 7f4512ffd640 1 -- 172.21.15.123:0/2868480767 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f450c07b0d0 con 0x7f451c0d1510 2024-09-15T23:24:50.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:50.776+0000 7f4520a82640 1 -- 172.21.15.123:0/2868480767 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f451c0d3d10 con 0x7f451c0d1510 2024-09-15T23:24:51.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.448+0000 7f4512ffd640 1 -- 172.21.15.123:0/2868480767 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v208) ==== 181+0+0 (secure 0 0 0) 0x7f450c07a9d0 con 0x7f451c0d1510 2024-09-15T23:24:51.449 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' removed 2024-09-15T23:24:51.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.450+0000 7f4520a82640 1 -- 172.21.15.123:0/2868480767 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f44fc06c2e0 msgr2=0x7f44fc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:51.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.450+0000 7f4520a82640 1 --2- 172.21.15.123:0/2868480767 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f44fc06c2e0 0x7f44fc06e7a0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f4504006fd0 tx=0x7f4504008040 comp rx=0 tx=0).stop 2024-09-15T23:24:51.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.450+0000 7f4520a82640 1 -- 172.21.15.123:0/2868480767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f451c0d1510 msgr2=0x7f451c158a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:51.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.450+0000 7f4520a82640 1 --2- 172.21.15.123:0/2868480767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f451c0d1510 0x7f451c158a20 secure :-1 s=READY pgs=2469 cs=0 l=1 rev1=1 crypto rx=0x7f450c009d90 tx=0x7f450c004a40 comp rx=0 tx=0).stop 2024-09-15T23:24:51.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.451+0000 7f4520a82640 1 -- 172.21.15.123:0/2868480767 shutdown_connections 2024-09-15T23:24:51.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.451+0000 7f4520a82640 1 --2- 172.21.15.123:0/2868480767 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f451c15ea90 0x7f451c0c9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:51.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.451+0000 7f4520a82640 1 --2- 172.21.15.123:0/2868480767 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f451c0d40b0 0x7f451c157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:51.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.451+0000 7f4520a82640 1 --2- 172.21.15.123:0/2868480767 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f44fc06c2e0 0x7f44fc06e7a0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:51.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.451+0000 7f4520a82640 1 --2- 172.21.15.123:0/2868480767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f451c0d1510 0x7f451c158a20 unknown :-1 s=CLOSED pgs=2469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:51.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.451+0000 7f4520a82640 1 -- 172.21.15.123:0/2868480767 >> 172.21.15.123:0/2868480767 conn(0x7f451c06c0e0 msgr2=0x7f451c15d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:51.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.452+0000 7f4520a82640 1 -- 172.21.15.123:0/2868480767 shutdown_connections 2024-09-15T23:24:51.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.452+0000 7f4520a82640 1 -- 172.21.15.123:0/2868480767 wait complete. 2024-09-15T23:24:51.464 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T23:24:51.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.566+0000 7fbbd3b11640 1 Processor -- start 2024-09-15T23:24:51.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.566+0000 7fbbd3b11640 1 -- start start 2024-09-15T23:24:51.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.567+0000 7fbbd3b11640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbbcc0b2370 0x7fbbcc0cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:51.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.567+0000 7fbbd3b11640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbcc0b0680 con 0x7fbbcc155b20 2024-09-15T23:24:51.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.567+0000 7fbbd3b11640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbcc0ccf70 con 0x7fbbcc0cf960 2024-09-15T23:24:51.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.567+0000 7fbbd3b11640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fbbcc0b01e0 con 0x7fbbcc0b2370 2024-09-15T23:24:51.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.567+0000 7fbbd10ac640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbbcc0b2370 0x7fbbcc0cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:51.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.567+0000 7fbbd18ad640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fbbcc155b20 0x7fbbcc0b1c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51768/0 (socket says 172.21.15.123:51768) 2024-09-15T23:24:51.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.567+0000 7fbbd18ad640 1 -- 172.21.15.123:0/3614737776 learned_addr learned my addr 172.21.15.123:0/3614737776 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:51.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.567+0000 7fbbd10ac640 1 -- 172.21.15.123:0/3614737776 >> v1:172.21.15.188:6789/0 conn(0x7fbbcc0cf960 legacy=0x7fbbcc15c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:51.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.567+0000 7fbbd10ac640 1 -- 172.21.15.123:0/3614737776 >> v1:172.21.15.123:6789/0 conn(0x7fbbcc155b20 legacy=0x7fbbcc0b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:51.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.567+0000 7fbbd10ac640 1 -- 172.21.15.123:0/3614737776 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbcc0ce940 con 0x7fbbcc0b2370 2024-09-15T23:24:51.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.567+0000 7fbbd08ab640 1 -- 172.21.15.123:0/3614737776 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 281674674 0 0) 0x7fbbcc0b0680 con 0x7fbbcc155b20 2024-09-15T23:24:51.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.568+0000 7fbbd10ac640 1 --2- 172.21.15.123:0/3614737776 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbcc0b2370 0x7fbbcc0cf420 secure :-1 s=READY pgs=2471 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc0097a0 tx=0x7fbbbc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=769e7c35636109f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:51.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.568+0000 7fbbd08ab640 1 -- 172.21.15.123:0/3614737776 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc037070 con 0x7fbbcc0b2370 2024-09-15T23:24:51.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.568+0000 7fbbd08ab640 1 -- 172.21.15.123:0/3614737776 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbbc032440 con 0x7fbbcc0b2370 2024-09-15T23:24:51.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.568+0000 7fbbd08ab640 1 -- 172.21.15.123:0/3614737776 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc032810 con 0x7fbbcc0b2370 2024-09-15T23:24:51.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.569+0000 7fbbd3b11640 1 -- 172.21.15.123:0/3614737776 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbcc0b2370 msgr2=0x7fbbcc0cf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:51.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.569+0000 7fbbd3b11640 1 --2- 172.21.15.123:0/3614737776 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbcc0b2370 0x7fbbcc0cf420 secure :-1 s=READY pgs=2471 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc0097a0 tx=0x7fbbbc02a1e0 comp rx=0 tx=0).stop 2024-09-15T23:24:51.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.569+0000 7fbbd3b11640 1 -- 172.21.15.123:0/3614737776 shutdown_connections 2024-09-15T23:24:51.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.569+0000 7fbbd3b11640 1 --2- 172.21.15.123:0/3614737776 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbcc0b2370 0x7fbbcc0cf420 unknown :-1 s=CLOSED pgs=2471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:51.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.569+0000 7fbbd3b11640 1 -- 172.21.15.123:0/3614737776 >> 172.21.15.123:0/3614737776 conn(0x7fbbcc06c240 msgr2=0x7fbbcc06d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:51.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.569+0000 7fbbd3b11640 1 -- 172.21.15.123:0/3614737776 shutdown_connections 2024-09-15T23:24:51.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.569+0000 7fbbd3b11640 1 -- 172.21.15.123:0/3614737776 wait complete. 2024-09-15T23:24:51.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.570+0000 7fbbd3b11640 1 Processor -- start 2024-09-15T23:24:51.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.570+0000 7fbbd3b11640 1 -- start start 2024-09-15T23:24:51.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.571+0000 7fbbd3b11640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbcc0b2370 0x7fbbcc1ee6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:51.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.571+0000 7fbbd3b11640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbcc0cf960 0x7fbbcc1f5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:51.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.571+0000 7fbbd3b11640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbbcc155b20 0x7fbbcc1f4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:51.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.571+0000 7fbbd3b11640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbbcc0cfdf0 con 0x7fbbcc0cf960 2024-09-15T23:24:51.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.571+0000 7fbbd3b11640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbbcc0cef00 con 0x7fbbcc0b2370 2024-09-15T23:24:51.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.571+0000 7fbbd3b11640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbbcc0ce610 con 0x7fbbcc155b20 2024-09-15T23:24:51.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.571+0000 7fbbd10ac640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbcc0cf960 0x7fbbcc1f5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:51.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.571+0000 7fbbd10ac640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbcc0cf960 0x7fbbcc1f5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50734/0 (socket says 172.21.15.123:50734) 2024-09-15T23:24:51.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.571+0000 7fbbd10ac640 1 -- 172.21.15.123:0/2490131647 learned_addr learned my addr 172.21.15.123:0/2490131647 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:51.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.571+0000 7fbbd18ad640 1 --2- 172.21.15.123:0/2490131647 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbcc0b2370 0x7fbbcc1ee6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:51.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.571+0000 7fbbd20ae640 1 --2- 172.21.15.123:0/2490131647 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbbcc155b20 0x7fbbcc1f4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:51.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.571+0000 7fbbd10ac640 1 -- 172.21.15.123:0/2490131647 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbbcc155b20 msgr2=0x7fbbcc1f4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:51.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.571+0000 7fbbd10ac640 1 --2- 172.21.15.123:0/2490131647 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbbcc155b20 0x7fbbcc1f4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:51.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.571+0000 7fbbd10ac640 1 -- 172.21.15.123:0/2490131647 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbcc0b2370 msgr2=0x7fbbcc1ee6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:51.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.571+0000 7fbbd10ac640 1 --2- 172.21.15.123:0/2490131647 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbcc0b2370 0x7fbbcc1ee6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:51.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.571+0000 7fbbd10ac640 1 -- 172.21.15.123:0/2490131647 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbcc0b35e0 con 0x7fbbcc0cf960 2024-09-15T23:24:51.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.571+0000 7fbbd10ac640 1 --2- 172.21.15.123:0/2490131647 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbcc0cf960 0x7fbbcc1f5710 secure :-1 s=READY pgs=2472 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc0098c0 tx=0x7fbbbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:51.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.572+0000 7fbbc27fc640 1 -- 172.21.15.123:0/2490131647 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc041070 con 0x7fbbcc0cf960 2024-09-15T23:24:51.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.572+0000 7fbbc27fc640 1 -- 172.21.15.123:0/2490131647 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbbc03c870 con 0x7fbbcc0cf960 2024-09-15T23:24:51.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.572+0000 7fbbc27fc640 1 -- 172.21.15.123:0/2490131647 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc037040 con 0x7fbbcc0cf960 2024-09-15T23:24:51.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.572+0000 7fbbd3b11640 1 -- 172.21.15.123:0/2490131647 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbcc1f4e10 con 0x7fbbcc0cf960 2024-09-15T23:24:51.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.572+0000 7fbbd3b11640 1 -- 172.21.15.123:0/2490131647 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbcc1f53d0 con 0x7fbbcc0cf960 2024-09-15T23:24:51.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.573+0000 7fbbd3b11640 1 -- 172.21.15.123:0/2490131647 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbcc0ccb20 con 0x7fbbcc0cf960 2024-09-15T23:24:51.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.573+0000 7fbbc27fc640 1 -- 172.21.15.123:0/2490131647 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbbbc044070 con 0x7fbbcc0cf960 2024-09-15T23:24:51.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.573+0000 7fbbc27fc640 1 --2- 172.21.15.123:0/2490131647 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbbb006c2b0 0x7fbbb006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:51.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.574+0000 7fbbc27fc640 1 -- 172.21.15.123:0/2490131647 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(208..208 src has 1..208) ==== 5357+0+0 (secure 0 0 0) 0x7fbbbc0abd50 con 0x7fbbcc0cf960 2024-09-15T23:24:51.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.574+0000 7fbbd18ad640 1 --2- 172.21.15.123:0/2490131647 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbbb006c2b0 0x7fbbb006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:51.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.574+0000 7fbbd18ad640 1 --2- 172.21.15.123:0/2490131647 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbbb006c2b0 0x7fbbb006e770 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8007fd0 tx=0x7fbbc8007de0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:51.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.578+0000 7fbbc27fc640 1 -- 172.21.15.123:0/2490131647 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbbbc0af030 con 0x7fbbcc0cf960 2024-09-15T23:24:51.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:51.744+0000 7fbbd3b11640 1 -- 172.21.15.123:0/2490131647 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbbcc1f5c50 con 0x7fbbcc0cf960 2024-09-15T23:24:52.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.453+0000 7fbbc27fc640 1 -- 172.21.15.123:0/2490131647 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v209) ==== 169+0+0 (secure 0 0 0) 0x7fbbbc07a180 con 0x7fbbcc0cf960 2024-09-15T23:24:52.454 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' removed 2024-09-15T23:24:52.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.457+0000 7fbbd3b11640 1 -- 172.21.15.123:0/2490131647 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbbb006c2b0 msgr2=0x7fbbb006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:52.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.457+0000 7fbbd3b11640 1 --2- 172.21.15.123:0/2490131647 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbbb006c2b0 0x7fbbb006e770 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8007fd0 tx=0x7fbbc8007de0 comp rx=0 tx=0).stop 2024-09-15T23:24:52.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.457+0000 7fbbd3b11640 1 -- 172.21.15.123:0/2490131647 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbcc0cf960 msgr2=0x7fbbcc1f5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:52.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.457+0000 7fbbd3b11640 1 --2- 172.21.15.123:0/2490131647 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbcc0cf960 0x7fbbcc1f5710 secure :-1 s=READY pgs=2472 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc0098c0 tx=0x7fbbbc0046c0 comp rx=0 tx=0).stop 2024-09-15T23:24:52.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.457+0000 7fbbd3b11640 1 -- 172.21.15.123:0/2490131647 shutdown_connections 2024-09-15T23:24:52.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.457+0000 7fbbd3b11640 1 --2- 172.21.15.123:0/2490131647 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbbcc155b20 0x7fbbcc1f4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:52.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.457+0000 7fbbd3b11640 1 --2- 172.21.15.123:0/2490131647 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbbb006c2b0 0x7fbbb006e770 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:52.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.457+0000 7fbbd3b11640 1 --2- 172.21.15.123:0/2490131647 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbcc0cf960 0x7fbbcc1f5710 unknown :-1 s=CLOSED pgs=2472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:52.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.457+0000 7fbbd3b11640 1 --2- 172.21.15.123:0/2490131647 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbbcc0b2370 0x7fbbcc1ee6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:52.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.457+0000 7fbbd3b11640 1 -- 172.21.15.123:0/2490131647 >> 172.21.15.123:0/2490131647 conn(0x7fbbcc06c240 msgr2=0x7fbbcc0b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:52.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.457+0000 7fbbd3b11640 1 -- 172.21.15.123:0/2490131647 shutdown_connections 2024-09-15T23:24:52.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.457+0000 7fbbd3b11640 1 -- 172.21.15.123:0/2490131647 wait complete. 2024-09-15T23:24:52.471 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T23:24:52.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.570+0000 7fe076791640 1 Processor -- start 2024-09-15T23:24:52.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.570+0000 7fe076791640 1 -- start start 2024-09-15T23:24:52.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.571+0000 7fe076791640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe0700b3350 0x7fe0700d2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:52.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.571+0000 7fe076791640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0700b38a0 0x7fe0700d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:52.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.571+0000 7fe076791640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0700cf710 con 0x7fe07006bfd0 2024-09-15T23:24:52.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.571+0000 7fe076791640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe0700b78a0 con 0x7fe0700b3350 2024-09-15T23:24:52.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.571+0000 7fe076791640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe0700cffb0 con 0x7fe0700b38a0 2024-09-15T23:24:52.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.571+0000 7fe06f7fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe0700b3350 0x7fe0700d2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:52.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.571+0000 7fe06ffff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe07006bfd0 0x7fe07006c3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51770/0 (socket says 172.21.15.123:51770) 2024-09-15T23:24:52.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.571+0000 7fe06ffff640 1 -- 172.21.15.123:0/522152343 learned_addr learned my addr 172.21.15.123:0/522152343 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:52.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.572+0000 7fe074d2e640 1 --2- 172.21.15.123:0/522152343 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0700b38a0 0x7fe0700d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:52.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.572+0000 7fe06f7fe640 1 -- 172.21.15.123:0/522152343 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0700b38a0 msgr2=0x7fe0700d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:52.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.572+0000 7fe06f7fe640 1 --2- 172.21.15.123:0/522152343 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0700b38a0 0x7fe0700d2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:52.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.572+0000 7fe06f7fe640 1 -- 172.21.15.123:0/522152343 >> v1:172.21.15.123:6789/0 conn(0x7fe07006bfd0 legacy=0x7fe07006c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:52.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.572+0000 7fe06f7fe640 1 -- 172.21.15.123:0/522152343 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0700cf9f0 con 0x7fe0700b3350 2024-09-15T23:24:52.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.572+0000 7fe06effd640 1 -- 172.21.15.123:0/522152343 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2228857206 0 0) 0x7fe0700cf710 con 0x7fe07006bfd0 2024-09-15T23:24:52.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.572+0000 7fe06f7fe640 1 --2- 172.21.15.123:0/522152343 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0700b3350 0x7fe0700d2920 secure :-1 s=READY pgs=2474 cs=0 l=1 rev1=1 crypto rx=0x7fe0640097a0 tx=0x7fe06402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ecfacf22dbcc73 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:52.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.573+0000 7fe06effd640 1 -- 172.21.15.123:0/522152343 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe064037070 con 0x7fe0700b3350 2024-09-15T23:24:52.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.573+0000 7fe06effd640 1 -- 172.21.15.123:0/522152343 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe064032440 con 0x7fe0700b3350 2024-09-15T23:24:52.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.573+0000 7fe06effd640 1 -- 172.21.15.123:0/522152343 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe064032810 con 0x7fe0700b3350 2024-09-15T23:24:52.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.573+0000 7fe076791640 1 -- 172.21.15.123:0/522152343 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0700b3350 msgr2=0x7fe0700d2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:52.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.573+0000 7fe076791640 1 --2- 172.21.15.123:0/522152343 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0700b3350 0x7fe0700d2920 secure :-1 s=READY pgs=2474 cs=0 l=1 rev1=1 crypto rx=0x7fe0640097a0 tx=0x7fe06402a210 comp rx=0 tx=0).stop 2024-09-15T23:24:52.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.573+0000 7fe076791640 1 -- 172.21.15.123:0/522152343 shutdown_connections 2024-09-15T23:24:52.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.573+0000 7fe076791640 1 --2- 172.21.15.123:0/522152343 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0700b38a0 0x7fe0700d2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:52.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.573+0000 7fe076791640 1 --2- 172.21.15.123:0/522152343 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0700b3350 0x7fe0700d2920 unknown :-1 s=CLOSED pgs=2474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:52.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.573+0000 7fe076791640 1 -- 172.21.15.123:0/522152343 >> 172.21.15.123:0/522152343 conn(0x7fe0700d11c0 msgr2=0x7fe0700d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:52.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.573+0000 7fe076791640 1 -- 172.21.15.123:0/522152343 shutdown_connections 2024-09-15T23:24:52.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.573+0000 7fe076791640 1 -- 172.21.15.123:0/522152343 wait complete. 2024-09-15T23:24:52.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.574+0000 7fe076791640 1 Processor -- start 2024-09-15T23:24:52.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.575+0000 7fe076791640 1 -- start start 2024-09-15T23:24:52.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.575+0000 7fe076791640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe07006bfd0 0x7fe070154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:52.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.575+0000 7fe076791640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0700b3350 0x7fe070159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:52.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.575+0000 7fe076791640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0700b38a0 0x7fe0701608c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:52.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.575+0000 7fe076791640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe07006cd50 con 0x7fe0700b3350 2024-09-15T23:24:52.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.575+0000 7fe076791640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fe0700d2400 con 0x7fe07006bfd0 2024-09-15T23:24:52.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.575+0000 7fe076791640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fe07015eae0 con 0x7fe0700b38a0 2024-09-15T23:24:52.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.575+0000 7fe06f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0700b3350 0x7fe070159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:52.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.575+0000 7fe06f7fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0700b3350 0x7fe070159350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50744/0 (socket says 172.21.15.123:50744) 2024-09-15T23:24:52.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.575+0000 7fe06f7fe640 1 -- 172.21.15.123:0/4210633560 learned_addr learned my addr 172.21.15.123:0/4210633560 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:52.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.576+0000 7fe06f7fe640 1 -- 172.21.15.123:0/4210633560 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0700b38a0 msgr2=0x7fe0701608c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:52.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.576+0000 7fe06f7fe640 1 --2- 172.21.15.123:0/4210633560 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0700b38a0 0x7fe0701608c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:52.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.576+0000 7fe06f7fe640 1 -- 172.21.15.123:0/4210633560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe07006bfd0 msgr2=0x7fe070154f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:52.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.576+0000 7fe06f7fe640 1 --2- 172.21.15.123:0/4210633560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe07006bfd0 0x7fe070154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:52.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.576+0000 7fe06f7fe640 1 -- 172.21.15.123:0/4210633560 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe070155490 con 0x7fe0700b3350 2024-09-15T23:24:52.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.576+0000 7fe06f7fe640 1 --2- 172.21.15.123:0/4210633560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0700b3350 0x7fe070159350 secure :-1 s=READY pgs=2475 cs=0 l=1 rev1=1 crypto rx=0x7fe0640097a0 tx=0x7fe0640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:52.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.576+0000 7fe06cff9640 1 -- 172.21.15.123:0/4210633560 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe064037050 con 0x7fe0700b3350 2024-09-15T23:24:52.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.576+0000 7fe06cff9640 1 -- 172.21.15.123:0/4210633560 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe064038040 con 0x7fe0700b3350 2024-09-15T23:24:52.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.576+0000 7fe076791640 1 -- 172.21.15.123:0/4210633560 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe070159cf0 con 0x7fe0700b3350 2024-09-15T23:24:52.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.576+0000 7fe06cff9640 1 -- 172.21.15.123:0/4210633560 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe064006e10 con 0x7fe0700b3350 2024-09-15T23:24:52.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.576+0000 7fe076791640 1 -- 172.21.15.123:0/4210633560 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe07015a590 con 0x7fe0700b3350 2024-09-15T23:24:52.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.577+0000 7fe076791640 1 -- 172.21.15.123:0/4210633560 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe07006c3b0 con 0x7fe0700b3350 2024-09-15T23:24:52.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.577+0000 7fe06cff9640 1 -- 172.21.15.123:0/4210633560 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe064030980 con 0x7fe0700b3350 2024-09-15T23:24:52.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.578+0000 7fe06cff9640 1 --2- 172.21.15.123:0/4210633560 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe05c06c2b0 0x7fe05c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:52.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.578+0000 7fe06cff9640 1 -- 172.21.15.123:0/4210633560 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 4943+0+0 (secure 0 0 0) 0x7fe0640abb60 con 0x7fe0700b3350 2024-09-15T23:24:52.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.578+0000 7fe06ffff640 1 --2- 172.21.15.123:0/4210633560 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe05c06c2b0 0x7fe05c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:52.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.579+0000 7fe06ffff640 1 --2- 172.21.15.123:0/4210633560 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe05c06c2b0 0x7fe05c06e770 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fe060007fd0 tx=0x7fe060007920 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:52.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.582+0000 7fe06cff9640 1 -- 172.21.15.123:0/4210633560 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe06407a660 con 0x7fe0700b3350 2024-09-15T23:24:52.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.747+0000 7fe076791640 1 -- 172.21.15.123:0/4210633560 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fe070161dd0 con 0x7fe0700b3350 2024-09-15T23:24:52.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.750+0000 7fe06cff9640 1 -- 172.21.15.123:0/4210633560 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v49) ==== 104+0+0 (secure 0 0 0) 0x7fe064079f60 con 0x7fe0700b3350 2024-09-15T23:24:52.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.752+0000 7fe076791640 1 -- 172.21.15.123:0/4210633560 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe05c06c2b0 msgr2=0x7fe05c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:52.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.752+0000 7fe076791640 1 --2- 172.21.15.123:0/4210633560 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe05c06c2b0 0x7fe05c06e770 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fe060007fd0 tx=0x7fe060007920 comp rx=0 tx=0).stop 2024-09-15T23:24:52.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.752+0000 7fe076791640 1 -- 172.21.15.123:0/4210633560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0700b3350 msgr2=0x7fe070159350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:52.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.752+0000 7fe076791640 1 --2- 172.21.15.123:0/4210633560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0700b3350 0x7fe070159350 secure :-1 s=READY pgs=2475 cs=0 l=1 rev1=1 crypto rx=0x7fe0640097a0 tx=0x7fe0640046c0 comp rx=0 tx=0).stop 2024-09-15T23:24:52.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.753+0000 7fe076791640 1 -- 172.21.15.123:0/4210633560 shutdown_connections 2024-09-15T23:24:52.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.753+0000 7fe076791640 1 --2- 172.21.15.123:0/4210633560 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fe0700b38a0 0x7fe0701608c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:52.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.753+0000 7fe076791640 1 --2- 172.21.15.123:0/4210633560 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fe05c06c2b0 0x7fe05c06e770 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:52.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.753+0000 7fe076791640 1 --2- 172.21.15.123:0/4210633560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe0700b3350 0x7fe070159350 unknown :-1 s=CLOSED pgs=2475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:52.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.753+0000 7fe076791640 1 --2- 172.21.15.123:0/4210633560 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fe07006bfd0 0x7fe070154f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:52.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.753+0000 7fe076791640 1 -- 172.21.15.123:0/4210633560 >> 172.21.15.123:0/4210633560 conn(0x7fe0700d11c0 msgr2=0x7fe07015dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:52.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.753+0000 7fe076791640 1 -- 172.21.15.123:0/4210633560 shutdown_connections 2024-09-15T23:24:52.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.753+0000 7fe076791640 1 -- 172.21.15.123:0/4210633560 wait complete. 2024-09-15T23:24:52.764 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace' 2024-09-15T23:24:52.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.861+0000 7f33aaa5e640 1 Processor -- start 2024-09-15T23:24:52.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.862+0000 7f33aaa5e640 1 -- start start 2024-09-15T23:24:52.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.862+0000 7f33aaa5e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f33a415ed20 0x7f33a40b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:52.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.862+0000 7f33aaa5e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f33a40b90e0 0x7f33a40b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:52.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.862+0000 7f33aaa5e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33a40d0e70 con 0x7f33a40d23b0 2024-09-15T23:24:52.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.862+0000 7f33aaa5e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f33a40d41c0 con 0x7f33a415ed20 2024-09-15T23:24:52.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.862+0000 7f33aaa5e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f33a40d35b0 con 0x7f33a40b90e0 2024-09-15T23:24:52.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.863+0000 7f33a3fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f33a415ed20 0x7f33a40b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:52.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.863+0000 7f33a3fff640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f33a415ed20 0x7f33a40b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50750/0 (socket says 172.21.15.123:50750) 2024-09-15T23:24:52.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.863+0000 7f33a3fff640 1 -- 172.21.15.123:0/303610857 learned_addr learned my addr 172.21.15.123:0/303610857 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:52.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.863+0000 7f33a8ffb640 1 --2- 172.21.15.123:0/303610857 >> v2:172.21.15.188:3300/0 conn(0x7f33a40b90e0 0x7f33a40b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:52.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.863+0000 7f33a3fff640 1 -- 172.21.15.123:0/303610857 >> v2:172.21.15.188:3300/0 conn(0x7f33a40b90e0 msgr2=0x7f33a40b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:52.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.863+0000 7f33a3fff640 1 --2- 172.21.15.123:0/303610857 >> v2:172.21.15.188:3300/0 conn(0x7f33a40b90e0 0x7f33a40b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:52.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.863+0000 7f33a3fff640 1 -- 172.21.15.123:0/303610857 >> v1:172.21.15.188:6789/0 conn(0x7f33a40d23b0 legacy=0x7f33a40cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:52.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.863+0000 7f33a3fff640 1 -- 172.21.15.123:0/303610857 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a40d3890 con 0x7f33a415ed20 2024-09-15T23:24:52.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.863+0000 7f33a3fff640 1 --2- 172.21.15.123:0/303610857 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33a415ed20 0x7f33a40b6260 secure :-1 s=READY pgs=2476 cs=0 l=1 rev1=1 crypto rx=0x7f33a40cedc0 tx=0x7f339402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d378f6ce0adcbc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:52.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.864+0000 7f33a2ffd640 1 -- 172.21.15.123:0/303610857 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3394037070 con 0x7f33a415ed20 2024-09-15T23:24:52.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.864+0000 7f33a2ffd640 1 -- 172.21.15.123:0/303610857 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3394032440 con 0x7f33a415ed20 2024-09-15T23:24:52.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.864+0000 7f33a2ffd640 1 -- 172.21.15.123:0/303610857 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3394032810 con 0x7f33a415ed20 2024-09-15T23:24:52.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.864+0000 7f33aaa5e640 1 -- 172.21.15.123:0/303610857 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33a415ed20 msgr2=0x7f33a40b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:52.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.864+0000 7f33aaa5e640 1 --2- 172.21.15.123:0/303610857 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33a415ed20 0x7f33a40b6260 secure :-1 s=READY pgs=2476 cs=0 l=1 rev1=1 crypto rx=0x7f33a40cedc0 tx=0x7f339402a1a0 comp rx=0 tx=0).stop 2024-09-15T23:24:52.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.864+0000 7f33aaa5e640 1 -- 172.21.15.123:0/303610857 shutdown_connections 2024-09-15T23:24:52.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.864+0000 7f33aaa5e640 1 --2- 172.21.15.123:0/303610857 >> v2:172.21.15.188:3300/0 conn(0x7f33a40b90e0 0x7f33a40b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:52.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.864+0000 7f33aaa5e640 1 --2- 172.21.15.123:0/303610857 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33a415ed20 0x7f33a40b6260 unknown :-1 s=CLOSED pgs=2476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:52.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.864+0000 7f33aaa5e640 1 -- 172.21.15.123:0/303610857 >> 172.21.15.123:0/303610857 conn(0x7f33a40d1260 msgr2=0x7f33a40d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:52.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.864+0000 7f33aaa5e640 1 -- 172.21.15.123:0/303610857 shutdown_connections 2024-09-15T23:24:52.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.864+0000 7f33aaa5e640 1 -- 172.21.15.123:0/303610857 wait complete. 2024-09-15T23:24:52.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.865+0000 7f33aaa5e640 1 Processor -- start 2024-09-15T23:24:52.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.866+0000 7f33aaa5e640 1 -- start start 2024-09-15T23:24:52.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.866+0000 7f33aaa5e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33a40b90e0 0x7f33a41547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:52.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.866+0000 7f33aaa5e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33a40d23b0 0x7f33a4154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:52.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.866+0000 7f33aaa5e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33a415ed20 0x7f33a41e8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:52.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.866+0000 7f33aaa5e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f33a40d32a0 con 0x7f33a40b90e0 2024-09-15T23:24:52.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.866+0000 7f33aaa5e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f33a40d3e50 con 0x7f33a40d23b0 2024-09-15T23:24:52.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.866+0000 7f33aaa5e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f33a415f100 con 0x7f33a415ed20 2024-09-15T23:24:52.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.866+0000 7f33a3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33a40b90e0 0x7f33a41547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:52.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.866+0000 7f33a3fff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33a40b90e0 0x7f33a41547e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50762/0 (socket says 172.21.15.123:50762) 2024-09-15T23:24:52.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.866+0000 7f33a3fff640 1 -- 172.21.15.123:0/3966231905 learned_addr learned my addr 172.21.15.123:0/3966231905 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:52.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.867+0000 7f33a37fe640 1 --2- 172.21.15.123:0/3966231905 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33a40d23b0 0x7f33a4154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:52.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.867+0000 7f33a8ffb640 1 --2- 172.21.15.123:0/3966231905 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33a415ed20 0x7f33a41e8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:52.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.867+0000 7f33a3fff640 1 -- 172.21.15.123:0/3966231905 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33a415ed20 msgr2=0x7f33a41e8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:52.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.867+0000 7f33a3fff640 1 --2- 172.21.15.123:0/3966231905 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33a415ed20 0x7f33a41e8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:52.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.867+0000 7f33a3fff640 1 -- 172.21.15.123:0/3966231905 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33a40d23b0 msgr2=0x7f33a4154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:52.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.867+0000 7f33a3fff640 1 --2- 172.21.15.123:0/3966231905 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33a40d23b0 0x7f33a4154250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:52.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.867+0000 7f33a3fff640 1 -- 172.21.15.123:0/3966231905 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a40cb220 con 0x7f33a40b90e0 2024-09-15T23:24:52.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.867+0000 7f33a3fff640 1 --2- 172.21.15.123:0/3966231905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33a40b90e0 0x7f33a41547e0 secure :-1 s=READY pgs=2477 cs=0 l=1 rev1=1 crypto rx=0x7f3394000c00 tx=0x7f33940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:52.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.867+0000 7f33a0ff9640 1 -- 172.21.15.123:0/3966231905 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3394041020 con 0x7f33a40b90e0 2024-09-15T23:24:52.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.867+0000 7f33a0ff9640 1 -- 172.21.15.123:0/3966231905 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33940306c0 con 0x7f33a40b90e0 2024-09-15T23:24:52.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.867+0000 7f33a0ff9640 1 -- 172.21.15.123:0/3966231905 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3394037040 con 0x7f33a40b90e0 2024-09-15T23:24:52.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.867+0000 7f33aaa5e640 1 -- 172.21.15.123:0/3966231905 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33a40ca6a0 con 0x7f33a40b90e0 2024-09-15T23:24:52.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.867+0000 7f33aaa5e640 1 -- 172.21.15.123:0/3966231905 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33a40cac60 con 0x7f33a40b90e0 2024-09-15T23:24:52.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.868+0000 7f33aaa5e640 1 -- 172.21.15.123:0/3966231905 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33a40b7010 con 0x7f33a40b90e0 2024-09-15T23:24:52.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.869+0000 7f33a0ff9640 1 -- 172.21.15.123:0/3966231905 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3394044020 con 0x7f33a40b90e0 2024-09-15T23:24:52.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.869+0000 7f33a0ff9640 1 --2- 172.21.15.123:0/3966231905 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f339006c2e0 0x7f339006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:52.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.869+0000 7f33a0ff9640 1 -- 172.21.15.123:0/3966231905 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 4943+0+0 (secure 0 0 0) 0x7f33940ab790 con 0x7f33a40b90e0 2024-09-15T23:24:52.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.869+0000 7f33a37fe640 1 --2- 172.21.15.123:0/3966231905 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f339006c2e0 0x7f339006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:52.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.870+0000 7f33a37fe640 1 --2- 172.21.15.123:0/3966231905 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f339006c2e0 0x7f339006e7a0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f33a41ea670 tx=0x7f3398007e30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:52.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:52.873+0000 7f33a0ff9640 1 -- 172.21.15.123:0/3966231905 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f339404b030 con 0x7f33a40b90e0 2024-09-15T23:24:53.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:53.109+0000 7f33aaa5e640 1 -- 172.21.15.123:0/3966231905 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]} v 0) -- 0x7f33a40b3f20 con 0x7f33a40b90e0 2024-09-15T23:24:53.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:53.455+0000 7f33a0ff9640 1 -- 172.21.15.123:0/3966231905 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]}]=0 v618) ==== 133+0+0 (secure 0 0 0) 0x7f33a40d0e70 con 0x7f33a40b90e0 2024-09-15T23:24:53.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:53.457+0000 7f33aaa5e640 1 -- 172.21.15.123:0/3966231905 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f339006c2e0 msgr2=0x7f339006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:53.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:53.457+0000 7f33aaa5e640 1 --2- 172.21.15.123:0/3966231905 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f339006c2e0 0x7f339006e7a0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f33a41ea670 tx=0x7f3398007e30 comp rx=0 tx=0).stop 2024-09-15T23:24:53.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:53.457+0000 7f33aaa5e640 1 -- 172.21.15.123:0/3966231905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33a40b90e0 msgr2=0x7f33a41547e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:53.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:53.457+0000 7f33aaa5e640 1 --2- 172.21.15.123:0/3966231905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33a40b90e0 0x7f33a41547e0 secure :-1 s=READY pgs=2477 cs=0 l=1 rev1=1 crypto rx=0x7f3394000c00 tx=0x7f33940046c0 comp rx=0 tx=0).stop 2024-09-15T23:24:53.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:53.457+0000 7f33aaa5e640 1 -- 172.21.15.123:0/3966231905 shutdown_connections 2024-09-15T23:24:53.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:53.457+0000 7f33aaa5e640 1 --2- 172.21.15.123:0/3966231905 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f33a415ed20 0x7f33a41e8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:53.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:53.457+0000 7f33aaa5e640 1 --2- 172.21.15.123:0/3966231905 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f33a40d23b0 0x7f33a4154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:53.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:53.457+0000 7f33aaa5e640 1 --2- 172.21.15.123:0/3966231905 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f339006c2e0 0x7f339006e7a0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:53.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:53.457+0000 7f33aaa5e640 1 --2- 172.21.15.123:0/3966231905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33a40b90e0 0x7f33a41547e0 unknown :-1 s=CLOSED pgs=2477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:53.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:53.457+0000 7f33aaa5e640 1 -- 172.21.15.123:0/3966231905 >> 172.21.15.123:0/3966231905 conn(0x7f33a40d1260 msgr2=0x7f33a41ea6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:53.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:53.457+0000 7f33aaa5e640 1 -- 172.21.15.123:0/3966231905 shutdown_connections 2024-09-15T23:24:53.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:53.457+0000 7f33aaa5e640 1 -- 172.21.15.123:0/3966231905 wait complete. 2024-09-15T23:24:53.471 INFO:tasks.cephfs_test_runner:test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) ... ERROR 2024-09-15T23:24:53.471 INFO:tasks.cephfs_test_runner: 2024-09-15T23:24:53.471 INFO:tasks.cephfs_test_runner:====================================================================== 2024-09-15T23:24:53.471 INFO:tasks.cephfs_test_runner:ERROR: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-15T23:24:53.471 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-15T23:24:53.471 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-09-15T23:24:53.472 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/test_scrub.py", line 175, in test_scrub_backtrace 2024-09-15T23:24:53.472 INFO:tasks.cephfs_test_runner: self._scrub(BacktraceWorkload(self, self.fs, self.mount_a)) 2024-09-15T23:24:53.472 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/test_scrub.py", line 143, in _scrub 2024-09-15T23:24:53.472 INFO:tasks.cephfs_test_runner: errors = workload.validate() 2024-09-15T23:24:53.472 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/test_scrub.py", line 70, in validate 2024-09-15T23:24:53.472 INFO:tasks.cephfs_test_runner: bt = self._filesystem.read_backtrace(st['st_ino']) 2024-09-15T23:24:53.472 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/filesystem.py", line 1508, in read_backtrace 2024-09-15T23:24:53.472 INFO:tasks.cephfs_test_runner: return self._read_data_xattr(ino_no, "parent", "inode_backtrace_t", pool) 2024-09-15T23:24:53.472 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/filesystem.py", line 1464, in _read_data_xattr 2024-09-15T23:24:53.472 INFO:tasks.cephfs_test_runner: return json.loads(self.dencoder(obj_type, obj_blob).strip()) 2024-09-15T23:24:53.472 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/filesystem.py", line 1267, in dencoder 2024-09-15T23:24:53.472 INFO:tasks.cephfs_test_runner: p = self.mon_manager.controller.run(args=args, stdin=BytesIO(obj_blob), stdout=BytesIO()) 2024-09-15T23:24:53.472 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run 2024-09-15T23:24:53.472 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-09-15T23:24:53.472 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run 2024-09-15T23:24:53.473 INFO:tasks.cephfs_test_runner: r.wait() 2024-09-15T23:24:53.473 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait 2024-09-15T23:24:53.473 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-09-15T23:24:53.473 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-09-15T23:24:53.473 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-09-15T23:24:53.473 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi123 with status 1: 'ceph-dencoder type inode_backtrace_t import - decode dump_json' 2024-09-15T23:24:53.473 INFO:tasks.cephfs_test_runner: 2024-09-15T23:24:53.473 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-15T23:24:53.473 INFO:tasks.cephfs_test_runner:Ran 13 tests in 738.208s 2024-09-15T23:24:53.473 INFO:tasks.cephfs_test_runner: 2024-09-15T23:24:53.473 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-09-15T23:24:53.473 INFO:tasks.cephfs_test_runner: 2024-09-15T23:24:53.474 INFO:tasks.cephfs_test_runner:====================================================================== 2024-09-15T23:24:53.474 INFO:tasks.cephfs_test_runner:ERROR: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-15T23:24:53.474 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-15T23:24:53.474 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-09-15T23:24:53.474 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/test_scrub.py", line 175, in test_scrub_backtrace 2024-09-15T23:24:53.474 INFO:tasks.cephfs_test_runner: self._scrub(BacktraceWorkload(self, self.fs, self.mount_a)) 2024-09-15T23:24:53.474 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/test_scrub.py", line 143, in _scrub 2024-09-15T23:24:53.474 INFO:tasks.cephfs_test_runner: errors = workload.validate() 2024-09-15T23:24:53.474 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/test_scrub.py", line 70, in validate 2024-09-15T23:24:53.474 INFO:tasks.cephfs_test_runner: bt = self._filesystem.read_backtrace(st['st_ino']) 2024-09-15T23:24:53.474 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/filesystem.py", line 1508, in read_backtrace 2024-09-15T23:24:53.474 INFO:tasks.cephfs_test_runner: return self._read_data_xattr(ino_no, "parent", "inode_backtrace_t", pool) 2024-09-15T23:24:53.475 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/filesystem.py", line 1464, in _read_data_xattr 2024-09-15T23:24:53.475 INFO:tasks.cephfs_test_runner: return json.loads(self.dencoder(obj_type, obj_blob).strip()) 2024-09-15T23:24:53.475 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs/filesystem.py", line 1267, in dencoder 2024-09-15T23:24:53.475 INFO:tasks.cephfs_test_runner: p = self.mon_manager.controller.run(args=args, stdin=BytesIO(obj_blob), stdout=BytesIO()) 2024-09-15T23:24:53.475 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run 2024-09-15T23:24:53.475 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-09-15T23:24:53.475 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run 2024-09-15T23:24:53.475 INFO:tasks.cephfs_test_runner: r.wait() 2024-09-15T23:24:53.475 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait 2024-09-15T23:24:53.475 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-09-15T23:24:53.475 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-09-15T23:24:53.475 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-09-15T23:24:53.475 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi123 with status 1: 'ceph-dencoder type inode_backtrace_t import - decode dump_json' 2024-09-15T23:24:53.476 INFO:tasks.cephfs_test_runner: 2024-09-15T23:24:53.476 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-15T23:24:53.678 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=4bc2ec913c4a49b59d2a9ca06b0c6320 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2024-09-15T23:24:53.679 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-15T23:24:53.689 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-15T23:24:53.697 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-15T23:24:53.698 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:24:53.698 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:24:53.718 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:24:53.718 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-09-15T23:24:53.718 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:24:53.775 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056025,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=600 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T23:24:53.775 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:24:53.775 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:24:53.795 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:24:53.795 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-09-15T23:24:53.796 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:24:53.855 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056013,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1016 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248720k,nr_inodes=812180,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497440k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T23:24:53.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:24:53.855 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-09-15T23:24:53.871 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T23:24:53.871 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:24:53.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:24:53.872 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T23:24:53.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:24:53.939 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:24:54.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:24:54.005 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link delete ceph-brx 2024-09-15T23:24:54.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:24:54.102 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-09-15T23:24:54.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:24:54.118 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link delete ceph-brx 2024-09-15T23:24:54.185 INFO:teuthology.orchestra.run.smithi123.stderr:Cannot find device "ceph-brx" 2024-09-15T23:24:54.186 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:24:54.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:24:54.187 DEBUG:teuthology.orchestra.run.smithi188:> ip netns list 2024-09-15T23:24:54.206 INFO:teuthology.orchestra.run.smithi188.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-15T23:24:54.206 INFO:teuthology.orchestra.run.smithi188.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-15T23:24:54.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:24:54.207 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-15T23:24:54.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:24:54.277 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T23:24:54.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:24:54.346 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link delete ceph-brx 2024-09-15T23:24:54.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:24:54.439 DEBUG:teuthology.orchestra.run.smithi188:> ip netns list 2024-09-15T23:24:54.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:24:54.455 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link delete ceph-brx 2024-09-15T23:24:54.523 INFO:teuthology.orchestra.run.smithi188.stderr:Cannot find device "ceph-brx" 2024-09-15T23:24:54.524 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:24:54.525 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-15T23:24:54.533 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T23:24:54.533 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:24:54.636 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.635+0000 7fa8ccc8d640 1 Processor -- start 2024-09-15T23:24:54.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.635+0000 7fa8ccc8d640 1 -- start start 2024-09-15T23:24:54.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.636+0000 7fa8ccc8d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8c8073890 0x7fa8c80b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:54.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.636+0000 7fa8ccc8d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8c80b4020 con 0x7fa8c8145ed0 2024-09-15T23:24:54.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.636+0000 7fa8ccc8d640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8c80b42c0 con 0x7fa8c80b5880 2024-09-15T23:24:54.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.636+0000 7fa8ccc8d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa8c80b45a0 con 0x7fa8c8073890 2024-09-15T23:24:54.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.636+0000 7fa8c659c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa8c8145ed0 0x7fa8c8073180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51780/0 (socket says 172.21.15.123:51780) 2024-09-15T23:24:54.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.636+0000 7fa8c659c640 1 -- 172.21.15.123:0/410590977 learned_addr learned my addr 172.21.15.123:0/410590977 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:54.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.637+0000 7fa8c559a640 1 -- 172.21.15.123:0/410590977 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3463925015 0 0) 0x7fa8c80b4020 con 0x7fa8c8145ed0 2024-09-15T23:24:54.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.637+0000 7fa8c559a640 1 -- 172.21.15.123:0/410590977 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8b4003520 con 0x7fa8c8145ed0 2024-09-15T23:24:54.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.637+0000 7fa8c5d9b640 1 --2- 172.21.15.123:0/410590977 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8c8073890 0x7fa8c80b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:54.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.637+0000 7fa8c559a640 1 -- 172.21.15.123:0/410590977 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 171238546 0 0) 0x7fa8b4003520 con 0x7fa8c8145ed0 2024-09-15T23:24:54.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.637+0000 7fa8c559a640 1 -- 172.21.15.123:0/410590977 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8c8073890 msgr2=0x7fa8c80b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:54.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.637+0000 7fa8c559a640 1 --2- 172.21.15.123:0/410590977 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8c8073890 0x7fa8c80b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:54.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.637+0000 7fa8c559a640 1 -- 172.21.15.123:0/410590977 >> v1:172.21.15.188:6789/0 conn(0x7fa8c80b5880 legacy=0x7fa8c80b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:54.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.637+0000 7fa8c559a640 1 -- 172.21.15.123:0/410590977 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c80b4880 con 0x7fa8c8145ed0 2024-09-15T23:24:54.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.637+0000 7fa8c559a640 1 -- 172.21.15.123:0/410590977 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fa8b80019f0 con 0x7fa8c8145ed0 2024-09-15T23:24:54.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.637+0000 7fa8c559a640 1 -- 172.21.15.123:0/410590977 >> v1:172.21.15.123:6789/0 conn(0x7fa8c8145ed0 legacy=0x7fa8c8073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:54.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.637+0000 7fa8c559a640 1 --2- 172.21.15.123:0/410590977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8b40039e0 0x7fa8b4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:54.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.637+0000 7fa8c559a640 1 --2- 172.21.15.123:0/410590977 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8c8073890 0x7fa8b4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:54.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.637+0000 7fa8c559a640 1 --2- 172.21.15.123:0/410590977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8b4004d40 0x7fa8b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:54.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.637+0000 7fa8c559a640 1 -- 172.21.15.123:0/410590977 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c80b45a0 con 0x7fa8b4004d40 2024-09-15T23:24:54.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.637+0000 7fa8c559a640 1 -- 172.21.15.123:0/410590977 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b400ba70 con 0x7fa8b40039e0 2024-09-15T23:24:54.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.637+0000 7fa8c559a640 1 -- 172.21.15.123:0/410590977 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa8b400bc70 con 0x7fa8c8073890 2024-09-15T23:24:54.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.637+0000 7fa8c6d9d640 1 --2- 172.21.15.123:0/410590977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8b4004d40 0x7fa8b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:54.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.637+0000 7fa8c659c640 1 --2- 172.21.15.123:0/410590977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8b40039e0 0x7fa8b4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:54.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.637+0000 7fa8c5d9b640 1 --2- 172.21.15.123:0/410590977 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8c8073890 0x7fa8b4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:54.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.637+0000 7fa8c6d9d640 1 -- 172.21.15.123:0/410590977 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8c8073890 msgr2=0x7fa8b4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:54.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.637+0000 7fa8c6d9d640 1 --2- 172.21.15.123:0/410590977 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8c8073890 0x7fa8b4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:54.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.637+0000 7fa8c6d9d640 1 -- 172.21.15.123:0/410590977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8b40039e0 msgr2=0x7fa8b4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:54.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.637+0000 7fa8c6d9d640 1 --2- 172.21.15.123:0/410590977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8b40039e0 0x7fa8b4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:54.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.638+0000 7fa8c6d9d640 1 -- 172.21.15.123:0/410590977 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8b4003520 con 0x7fa8b4004d40 2024-09-15T23:24:54.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.638+0000 7fa8c6d9d640 1 --2- 172.21.15.123:0/410590977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8b4004d40 0x7fa8b40051c0 secure :-1 s=READY pgs=2479 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0001720 tx=0x7fa8b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a22c8abdabf68c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:54.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.638+0000 7fa8c559a640 1 -- 172.21.15.123:0/410590977 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0001370 con 0x7fa8b4004d40 2024-09-15T23:24:54.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.638+0000 7fa8c559a640 1 -- 172.21.15.123:0/410590977 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8c00052d0 con 0x7fa8b4004d40 2024-09-15T23:24:54.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.638+0000 7fa8c559a640 1 -- 172.21.15.123:0/410590977 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c002abc0 con 0x7fa8b4004d40 2024-09-15T23:24:54.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.639+0000 7fa8ccc8d640 1 -- 172.21.15.123:0/410590977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8b4004d40 msgr2=0x7fa8b40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:54.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.639+0000 7fa8ccc8d640 1 --2- 172.21.15.123:0/410590977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8b4004d40 0x7fa8b40051c0 secure :-1 s=READY pgs=2479 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0001720 tx=0x7fa8b4005830 comp rx=0 tx=0).stop 2024-09-15T23:24:54.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.639+0000 7fa8c6d9d640 1 -- 172.21.15.123:0/410590977 reap_dead start 2024-09-15T23:24:54.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.639+0000 7fa8ccc8d640 1 -- 172.21.15.123:0/410590977 shutdown_connections 2024-09-15T23:24:54.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.639+0000 7fa8ccc8d640 1 -- 172.21.15.123:0/410590977 >> 172.21.15.123:0/410590977 conn(0x7fa8c80ccec0 msgr2=0x7fa8c80cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:54.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.639+0000 7fa8ccc8d640 1 -- 172.21.15.123:0/410590977 shutdown_connections 2024-09-15T23:24:54.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.639+0000 7fa8ccc8d640 1 -- 172.21.15.123:0/410590977 wait complete. 2024-09-15T23:24:54.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.640+0000 7fa8ccc8d640 1 Processor -- start 2024-09-15T23:24:54.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.640+0000 7fa8ccc8d640 1 -- start start 2024-09-15T23:24:54.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.641+0000 7fa8ccc8d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8b4004d40 0x7fa8c8131760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:54.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.641+0000 7fa8ccc8d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8c8134210 0x7fa8c81f5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:54.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.641+0000 7fa8ccc8d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8c81f6310 0x7fa8c8152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:54.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.641+0000 7fa8ccc8d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c8146430 con 0x7fa8c8134210 2024-09-15T23:24:54.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.641+0000 7fa8ccc8d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa8c81462b0 con 0x7fa8b4004d40 2024-09-15T23:24:54.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.641+0000 7fa8ccc8d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa8c80b5080 con 0x7fa8c81f6310 2024-09-15T23:24:54.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.641+0000 7fa8c5d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8c8134210 0x7fa8c81f5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:54.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.641+0000 7fa8c5d9b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8c8134210 0x7fa8c81f5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50772/0 (socket says 172.21.15.123:50772) 2024-09-15T23:24:54.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.641+0000 7fa8c5d9b640 1 -- 172.21.15.123:0/284280985 learned_addr learned my addr 172.21.15.123:0/284280985 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:54.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.641+0000 7fa8c6d9d640 1 --2- 172.21.15.123:0/284280985 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8c81f6310 0x7fa8c8152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:54.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.641+0000 7fa8c659c640 1 --2- 172.21.15.123:0/284280985 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8b4004d40 0x7fa8c8131760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:54.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.641+0000 7fa8c5d9b640 1 -- 172.21.15.123:0/284280985 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8c81f6310 msgr2=0x7fa8c8152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:54.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.641+0000 7fa8c5d9b640 1 --2- 172.21.15.123:0/284280985 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8c81f6310 0x7fa8c8152150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:54.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.641+0000 7fa8c5d9b640 1 -- 172.21.15.123:0/284280985 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8b4004d40 msgr2=0x7fa8c8131760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:54.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.641+0000 7fa8c5d9b640 1 --2- 172.21.15.123:0/284280985 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8b4004d40 0x7fa8c8131760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:54.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.642+0000 7fa8c5d9b640 1 -- 172.21.15.123:0/284280985 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c8134690 con 0x7fa8c8134210 2024-09-15T23:24:54.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.642+0000 7fa8c5d9b640 1 --2- 172.21.15.123:0/284280985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8c8134210 0x7fa8c81f5dd0 secure :-1 s=READY pgs=2480 cs=0 l=1 rev1=1 crypto rx=0x7fa8b00119a0 tx=0x7fa8b0011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:54.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.642+0000 7fa8beffd640 1 -- 172.21.15.123:0/284280985 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b000faf0 con 0x7fa8c8134210 2024-09-15T23:24:54.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.642+0000 7fa8beffd640 1 -- 172.21.15.123:0/284280985 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8b000fc90 con 0x7fa8c8134210 2024-09-15T23:24:54.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.642+0000 7fa8ccc8d640 1 -- 172.21.15.123:0/284280985 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8c8152d60 con 0x7fa8c8134210 2024-09-15T23:24:54.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.642+0000 7fa8beffd640 1 -- 172.21.15.123:0/284280985 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b0014440 con 0x7fa8c8134210 2024-09-15T23:24:54.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.642+0000 7fa8ccc8d640 1 -- 172.21.15.123:0/284280985 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8c8153320 con 0x7fa8c8134210 2024-09-15T23:24:54.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.643+0000 7fa8ccc8d640 1 -- 172.21.15.123:0/284280985 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8c80b5380 con 0x7fa8c8134210 2024-09-15T23:24:54.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.643+0000 7fa8beffd640 1 -- 172.21.15.123:0/284280985 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa8b0012040 con 0x7fa8c8134210 2024-09-15T23:24:54.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.644+0000 7fa8beffd640 1 --2- 172.21.15.123:0/284280985 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa8a806c2e0 0x7fa8a806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:54.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.644+0000 7fa8beffd640 1 -- 172.21.15.123:0/284280985 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 4943+0+0 (secure 0 0 0) 0x7fa8b008b710 con 0x7fa8c8134210 2024-09-15T23:24:54.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.644+0000 7fa8c659c640 1 --2- 172.21.15.123:0/284280985 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa8a806c2e0 0x7fa8a806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:54.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.644+0000 7fa8c659c640 1 --2- 172.21.15.123:0/284280985 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa8a806c2e0 0x7fa8a806e7a0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8004d20 tx=0x7fa8b8006040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:54.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.648+0000 7fa8beffd640 1 -- 172.21.15.123:0/284280985 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa8b0019030 con 0x7fa8c8134210 2024-09-15T23:24:54.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.809+0000 7fa8ccc8d640 1 -- 172.21.15.123:0/284280985 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa8c81450b0 con 0x7fa8a806c2e0 2024-09-15T23:24:54.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.810+0000 7fa8beffd640 1 -- 172.21.15.123:0/284280985 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13520 (secure 0 0 0) 0x7fa8c81450b0 con 0x7fa8a806c2e0 2024-09-15T23:24:54.811 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:54.811 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:24:54.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.812+0000 7fa8ccc8d640 1 -- 172.21.15.123:0/284280985 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa8a806c2e0 msgr2=0x7fa8a806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:54.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.812+0000 7fa8ccc8d640 1 --2- 172.21.15.123:0/284280985 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa8a806c2e0 0x7fa8a806e7a0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8004d20 tx=0x7fa8b8006040 comp rx=0 tx=0).stop 2024-09-15T23:24:54.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.812+0000 7fa8ccc8d640 1 -- 172.21.15.123:0/284280985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8c8134210 msgr2=0x7fa8c81f5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:54.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.812+0000 7fa8ccc8d640 1 --2- 172.21.15.123:0/284280985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8c8134210 0x7fa8c81f5dd0 secure :-1 s=READY pgs=2480 cs=0 l=1 rev1=1 crypto rx=0x7fa8b00119a0 tx=0x7fa8b0011e60 comp rx=0 tx=0).stop 2024-09-15T23:24:54.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.812+0000 7fa8ccc8d640 1 -- 172.21.15.123:0/284280985 shutdown_connections 2024-09-15T23:24:54.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.812+0000 7fa8ccc8d640 1 --2- 172.21.15.123:0/284280985 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8c81f6310 0x7fa8c8152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:54.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.812+0000 7fa8ccc8d640 1 --2- 172.21.15.123:0/284280985 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa8a806c2e0 0x7fa8a806e7a0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:54.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.812+0000 7fa8ccc8d640 1 --2- 172.21.15.123:0/284280985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8c8134210 0x7fa8c81f5dd0 unknown :-1 s=CLOSED pgs=2480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:54.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.812+0000 7fa8ccc8d640 1 --2- 172.21.15.123:0/284280985 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8b4004d40 0x7fa8c8131760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:54.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.812+0000 7fa8ccc8d640 1 -- 172.21.15.123:0/284280985 >> 172.21.15.123:0/284280985 conn(0x7fa8c80ccec0 msgr2=0x7fa8c80b5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:54.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.812+0000 7fa8ccc8d640 1 -- 172.21.15.123:0/284280985 shutdown_connections 2024-09-15T23:24:54.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.812+0000 7fa8ccc8d640 1 -- 172.21.15.123:0/284280985 wait complete. 2024-09-15T23:24:54.824 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":588,"stamp":"2024-09-15T23:24:53.687127+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":155,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":459200,"kb_used_data":23696,"kb_used_omap":12,"kb_used_meta":435315,"kb_avail":754515520,"statfs":{"total":773094113280,"available":772623892480,"internally_reserved":0,"allocated":24264704,"data_stored":12573830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":445763120},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6306365,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-6,"num_read_kb":-3,"num_write":-79,"num_write_kb":-6187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001505"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":521,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-15T23:24:52.457341+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:24:52.457341+0000","last_peered":"2024-09-15T23:24:52.457341+0000","last_clean":"2024-09-15T23:24:52.457341+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:24:52.457341+0000","last_undegraded":"2024-09-15T23:24:52.457341+0000","last_fullsized":"2024-09-15T23:24:52.457341+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476896,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60128,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311712,"statfs":{"total":96636764160,"available":96575193088,"internally_reserved":0,"allocated":2629632,"data_stored":1163417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476893,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55968,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315872,"statfs":{"total":96636764160,"available":96579452928,"internally_reserved":0,"allocated":2629632,"data_stored":1163417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476895,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60708,"kb_used_data":3148,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311132,"statfs":{"total":96636764160,"available":96574599168,"internally_reserved":0,"allocated":3223552,"data_stored":1753785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476895,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51808,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320032,"statfs":{"total":96636764160,"available":96583712768,"internally_reserved":0,"allocated":2629632,"data_stored":1163417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542301,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51780,"kb_used_data":2544,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320060,"statfs":{"total":96636764160,"available":96583741440,"internally_reserved":0,"allocated":2605056,"data_stored":1152521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542301,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57992,"kb_used_data":4596,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94313848,"statfs":{"total":96636764160,"available":96577380352,"internally_reserved":0,"allocated":4706304,"data_stored":3249147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542300,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60700,"kb_used_data":3144,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311140,"statfs":{"total":96636764160,"available":96574607360,"internally_reserved":0,"allocated":3219456,"data_stored":1759282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542302,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60116,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311724,"statfs":{"total":96636764160,"available":96575205376,"internally_reserved":0,"allocated":2621440,"data_stored":1168844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:24:54.824 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:24:54.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.921+0000 7fc6c46ba640 1 Processor -- start 2024-09-15T23:24:54.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.921+0000 7fc6c46ba640 1 -- start start 2024-09-15T23:24:54.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.922+0000 7fc6c46ba640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fc6bc145ed0 0x7fc6bc0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:54.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.922+0000 7fc6c46ba640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6bc0b5f90 0x7fc6bc0735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:54.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.922+0000 7fc6c46ba640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6bc0b4020 con 0x7fc6bc073180 2024-09-15T23:24:54.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.922+0000 7fc6c46ba640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fc6bc073b00 con 0x7fc6bc145ed0 2024-09-15T23:24:54.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.922+0000 7fc6c46ba640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc6bc0b42c0 con 0x7fc6bc0b5f90 2024-09-15T23:24:54.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.922+0000 7fc6c1c55640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc6bc073180 0x7fc6bc0b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51792/0 (socket says 172.21.15.123:51792) 2024-09-15T23:24:54.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.922+0000 7fc6c1c55640 1 -- 172.21.15.123:0/3302268177 learned_addr learned my addr 172.21.15.123:0/3302268177 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:54.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.922+0000 7fc6c1454640 1 -- 172.21.15.123:0/3302268177 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2430297702 0 0) 0x7fc6bc0b4020 con 0x7fc6bc073180 2024-09-15T23:24:54.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.922+0000 7fc6c1454640 1 -- 172.21.15.123:0/3302268177 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6a8003520 con 0x7fc6bc073180 2024-09-15T23:24:54.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.922+0000 7fc6c2c57640 1 --2- 172.21.15.123:0/3302268177 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6bc0b5f90 0x7fc6bc0735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:54.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.922+0000 7fc6c2456640 1 --2- 172.21.15.123:0/3302268177 >> v2:172.21.15.188:3300/0 conn(0x7fc6bc145ed0 0x7fc6bc0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:54.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.922+0000 7fc6c1454640 1 -- 172.21.15.123:0/3302268177 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2490753578 0 0) 0x7fc6a8003520 con 0x7fc6bc073180 2024-09-15T23:24:54.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.923+0000 7fc6c1454640 1 -- 172.21.15.123:0/3302268177 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6bc0b5f90 msgr2=0x7fc6bc0735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:54.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.923+0000 7fc6c1454640 1 --2- 172.21.15.123:0/3302268177 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6bc0b5f90 0x7fc6bc0735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:54.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.923+0000 7fc6c1454640 1 -- 172.21.15.123:0/3302268177 >> v2:172.21.15.188:3300/0 conn(0x7fc6bc145ed0 msgr2=0x7fc6bc0b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:54.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.923+0000 7fc6c1454640 1 --2- 172.21.15.123:0/3302268177 >> v2:172.21.15.188:3300/0 conn(0x7fc6bc145ed0 0x7fc6bc0b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:54.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.923+0000 7fc6c1454640 1 -- 172.21.15.123:0/3302268177 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6bc0b45a0 con 0x7fc6bc073180 2024-09-15T23:24:54.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.923+0000 7fc6c1454640 1 -- 172.21.15.123:0/3302268177 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fc6ac001690 con 0x7fc6bc073180 2024-09-15T23:24:54.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.923+0000 7fc6c1454640 1 -- 172.21.15.123:0/3302268177 >> v1:172.21.15.123:6789/0 conn(0x7fc6bc073180 legacy=0x7fc6bc0b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:54.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.923+0000 7fc6c1454640 1 --2- 172.21.15.123:0/3302268177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6a80039b0 0x7fc6a8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:54.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.923+0000 7fc6c1454640 1 --2- 172.21.15.123:0/3302268177 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6a8004800 0x7fc6a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:54.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.923+0000 7fc6c1454640 1 --2- 172.21.15.123:0/3302268177 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6bc0b5f90 0x7fc6a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:54.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.923+0000 7fc6c1454640 1 -- 172.21.15.123:0/3302268177 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc6bc073b00 con 0x7fc6a80039b0 2024-09-15T23:24:54.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.923+0000 7fc6c1454640 1 -- 172.21.15.123:0/3302268177 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc6bc0b42c0 con 0x7fc6a8004800 2024-09-15T23:24:54.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.923+0000 7fc6c1454640 1 -- 172.21.15.123:0/3302268177 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc6a800b9c0 con 0x7fc6bc0b5f90 2024-09-15T23:24:54.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.923+0000 7fc6c2456640 1 --2- 172.21.15.123:0/3302268177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6a80039b0 0x7fc6a8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:54.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.923+0000 7fc6c2c57640 1 --2- 172.21.15.123:0/3302268177 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6bc0b5f90 0x7fc6a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:54.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.923+0000 7fc6c1c55640 1 --2- 172.21.15.123:0/3302268177 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6a8004800 0x7fc6a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:54.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.923+0000 7fc6c2456640 1 -- 172.21.15.123:0/3302268177 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6bc0b5f90 msgr2=0x7fc6a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:54.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.923+0000 7fc6c2456640 1 --2- 172.21.15.123:0/3302268177 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6bc0b5f90 0x7fc6a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:54.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.923+0000 7fc6c2456640 1 -- 172.21.15.123:0/3302268177 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6a8004800 msgr2=0x7fc6a8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:54.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.923+0000 7fc6c2456640 1 --2- 172.21.15.123:0/3302268177 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6a8004800 0x7fc6a8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:54.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.923+0000 7fc6c2456640 1 -- 172.21.15.123:0/3302268177 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6a8003520 con 0x7fc6a80039b0 2024-09-15T23:24:54.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.924+0000 7fc6c2456640 1 --2- 172.21.15.123:0/3302268177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6a80039b0 0x7fc6a8003df0 secure :-1 s=READY pgs=2482 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8009af0 tx=0x7fc6a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd2a6345df44e57 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:54.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.924+0000 7fc6c1454640 1 -- 172.21.15.123:0/3302268177 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b8036070 con 0x7fc6a80039b0 2024-09-15T23:24:54.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.924+0000 7fc6c1454640 1 -- 172.21.15.123:0/3302268177 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6b8031400 con 0x7fc6a80039b0 2024-09-15T23:24:54.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.924+0000 7fc6c1454640 1 -- 172.21.15.123:0/3302268177 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b8009690 con 0x7fc6a80039b0 2024-09-15T23:24:54.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.924+0000 7fc6c46ba640 1 -- 172.21.15.123:0/3302268177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6a80039b0 msgr2=0x7fc6a8003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:54.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.924+0000 7fc6c46ba640 1 --2- 172.21.15.123:0/3302268177 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6a80039b0 0x7fc6a8003df0 secure :-1 s=READY pgs=2482 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8009af0 tx=0x7fc6a8005830 comp rx=0 tx=0).stop 2024-09-15T23:24:54.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.924+0000 7fc6c2c57640 1 -- 172.21.15.123:0/3302268177 reap_dead start 2024-09-15T23:24:54.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.924+0000 7fc6c46ba640 1 -- 172.21.15.123:0/3302268177 shutdown_connections 2024-09-15T23:24:54.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.924+0000 7fc6c46ba640 1 -- 172.21.15.123:0/3302268177 >> 172.21.15.123:0/3302268177 conn(0x7fc6bc0ccec0 msgr2=0x7fc6bc0cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:54.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.924+0000 7fc6c46ba640 1 -- 172.21.15.123:0/3302268177 shutdown_connections 2024-09-15T23:24:54.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.924+0000 7fc6c46ba640 1 -- 172.21.15.123:0/3302268177 wait complete. 2024-09-15T23:24:54.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.926+0000 7fc6c46ba640 1 Processor -- start 2024-09-15T23:24:54.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.926+0000 7fc6c46ba640 1 -- start start 2024-09-15T23:24:54.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.926+0000 7fc6c46ba640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6a80039b0 0x7fc6bc0caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:54.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.926+0000 7fc6c46ba640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6bc0c7f60 0x7fc6bc1f21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:54.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.926+0000 7fc6c46ba640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6bc1f26e0 0x7fc6bc0c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:54.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.926+0000 7fc6c46ba640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc6bc1462b0 con 0x7fc6bc1f26e0 2024-09-15T23:24:54.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.926+0000 7fc6c46ba640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fc6bc0b4b60 con 0x7fc6bc0c7f60 2024-09-15T23:24:54.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.926+0000 7fc6c46ba640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fc6bc146430 con 0x7fc6a80039b0 2024-09-15T23:24:54.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.926+0000 7fc6c2c57640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6bc1f26e0 0x7fc6bc0c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:54.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.926+0000 7fc6c2c57640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6bc1f26e0 0x7fc6bc0c9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50788/0 (socket says 172.21.15.123:50788) 2024-09-15T23:24:54.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.926+0000 7fc6c2c57640 1 -- 172.21.15.123:0/1170016673 learned_addr learned my addr 172.21.15.123:0/1170016673 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:54.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.926+0000 7fc6c1c55640 1 --2- 172.21.15.123:0/1170016673 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6bc0c7f60 0x7fc6bc1f21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:54.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.926+0000 7fc6c2456640 1 --2- 172.21.15.123:0/1170016673 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6a80039b0 0x7fc6bc0caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:54.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.927+0000 7fc6c2c57640 1 -- 172.21.15.123:0/1170016673 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6a80039b0 msgr2=0x7fc6bc0caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:54.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.927+0000 7fc6c2c57640 1 --2- 172.21.15.123:0/1170016673 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6a80039b0 0x7fc6bc0caeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:54.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.927+0000 7fc6c2c57640 1 -- 172.21.15.123:0/1170016673 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6bc0c7f60 msgr2=0x7fc6bc1f21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:54.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.927+0000 7fc6c2c57640 1 --2- 172.21.15.123:0/1170016673 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6bc0c7f60 0x7fc6bc1f21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:54.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.927+0000 7fc6c2c57640 1 -- 172.21.15.123:0/1170016673 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6bc0c8b50 con 0x7fc6bc1f26e0 2024-09-15T23:24:54.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.927+0000 7fc6c2c57640 1 --2- 172.21.15.123:0/1170016673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6bc1f26e0 0x7fc6bc0c9bf0 secure :-1 s=READY pgs=2483 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc146780 tx=0x7fc6b40115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:54.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.927+0000 7fc6b2ffd640 1 -- 172.21.15.123:0/1170016673 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b4011e40 con 0x7fc6bc1f26e0 2024-09-15T23:24:54.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.927+0000 7fc6b2ffd640 1 -- 172.21.15.123:0/1170016673 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6b401b070 con 0x7fc6bc1f26e0 2024-09-15T23:24:54.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.927+0000 7fc6c46ba640 1 -- 172.21.15.123:0/1170016673 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6bc0c8e30 con 0x7fc6bc1f26e0 2024-09-15T23:24:54.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.927+0000 7fc6b2ffd640 1 -- 172.21.15.123:0/1170016673 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b4003990 con 0x7fc6bc1f26e0 2024-09-15T23:24:54.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.927+0000 7fc6c46ba640 1 -- 172.21.15.123:0/1170016673 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6bc0c93f0 con 0x7fc6bc1f26e0 2024-09-15T23:24:54.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.928+0000 7fc6c46ba640 1 -- 172.21.15.123:0/1170016673 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6bc0b5080 con 0x7fc6bc1f26e0 2024-09-15T23:24:54.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.929+0000 7fc6b2ffd640 1 -- 172.21.15.123:0/1170016673 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc6b4005d10 con 0x7fc6bc1f26e0 2024-09-15T23:24:54.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.929+0000 7fc6b2ffd640 1 --2- 172.21.15.123:0/1170016673 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc6a006c2b0 0x7fc6a006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:54.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.929+0000 7fc6b2ffd640 1 -- 172.21.15.123:0/1170016673 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 4943+0+0 (secure 0 0 0) 0x7fc6b408b5c0 con 0x7fc6bc1f26e0 2024-09-15T23:24:54.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.929+0000 7fc6c2456640 1 --2- 172.21.15.123:0/1170016673 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc6a006c2b0 0x7fc6a006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:54.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.930+0000 7fc6c2456640 1 --2- 172.21.15.123:0/1170016673 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc6a006c2b0 0x7fc6a006e770 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8033000 tx=0x7fc6b8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:54.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:54.933+0000 7fc6b2ffd640 1 -- 172.21.15.123:0/1170016673 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc6b4025020 con 0x7fc6bc1f26e0 2024-09-15T23:24:55.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.096+0000 7fc6c46ba640 1 -- 172.21.15.123:0/1170016673 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc6bc0b36c0 con 0x7fc6a006c2b0 2024-09-15T23:24:55.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.097+0000 7fc6b2ffd640 1 -- 172.21.15.123:0/1170016673 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13520 (secure 0 0 0) 0x7fc6bc0b36c0 con 0x7fc6a006c2b0 2024-09-15T23:24:55.098 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:55.098 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:24:55.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.099+0000 7fc6c46ba640 1 -- 172.21.15.123:0/1170016673 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc6a006c2b0 msgr2=0x7fc6a006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:55.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.099+0000 7fc6c46ba640 1 --2- 172.21.15.123:0/1170016673 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc6a006c2b0 0x7fc6a006e770 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8033000 tx=0x7fc6b8008030 comp rx=0 tx=0).stop 2024-09-15T23:24:55.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.099+0000 7fc6c46ba640 1 -- 172.21.15.123:0/1170016673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6bc1f26e0 msgr2=0x7fc6bc0c9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:55.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.099+0000 7fc6c46ba640 1 --2- 172.21.15.123:0/1170016673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6bc1f26e0 0x7fc6bc0c9bf0 secure :-1 s=READY pgs=2483 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc146780 tx=0x7fc6b40115a0 comp rx=0 tx=0).stop 2024-09-15T23:24:55.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.099+0000 7fc6c46ba640 1 -- 172.21.15.123:0/1170016673 shutdown_connections 2024-09-15T23:24:55.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.099+0000 7fc6c46ba640 1 --2- 172.21.15.123:0/1170016673 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fc6a006c2b0 0x7fc6a006e770 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:55.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.099+0000 7fc6c46ba640 1 --2- 172.21.15.123:0/1170016673 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6bc1f26e0 0x7fc6bc0c9bf0 unknown :-1 s=CLOSED pgs=2483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:55.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.099+0000 7fc6c46ba640 1 --2- 172.21.15.123:0/1170016673 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fc6bc0c7f60 0x7fc6bc1f21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:55.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.099+0000 7fc6c46ba640 1 --2- 172.21.15.123:0/1170016673 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fc6a80039b0 0x7fc6bc0caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:55.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.099+0000 7fc6c46ba640 1 -- 172.21.15.123:0/1170016673 >> 172.21.15.123:0/1170016673 conn(0x7fc6bc0ccec0 msgr2=0x7fc6bc144c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:55.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.099+0000 7fc6c46ba640 1 -- 172.21.15.123:0/1170016673 shutdown_connections 2024-09-15T23:24:55.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.099+0000 7fc6c46ba640 1 -- 172.21.15.123:0/1170016673 wait complete. 2024-09-15T23:24:55.111 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":588,"stamp":"2024-09-15T23:24:53.687127+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":155,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":459200,"kb_used_data":23696,"kb_used_omap":12,"kb_used_meta":435315,"kb_avail":754515520,"statfs":{"total":773094113280,"available":772623892480,"internally_reserved":0,"allocated":24264704,"data_stored":12573830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":445763120},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6306365,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-6,"num_read_kb":-3,"num_write":-79,"num_write_kb":-6187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001505"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":521,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-15T23:24:52.457341+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:24:52.457341+0000","last_peered":"2024-09-15T23:24:52.457341+0000","last_clean":"2024-09-15T23:24:52.457341+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:24:52.457341+0000","last_undegraded":"2024-09-15T23:24:52.457341+0000","last_fullsized":"2024-09-15T23:24:52.457341+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476896,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60128,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311712,"statfs":{"total":96636764160,"available":96575193088,"internally_reserved":0,"allocated":2629632,"data_stored":1163417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476893,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55968,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315872,"statfs":{"total":96636764160,"available":96579452928,"internally_reserved":0,"allocated":2629632,"data_stored":1163417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476895,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60708,"kb_used_data":3148,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311132,"statfs":{"total":96636764160,"available":96574599168,"internally_reserved":0,"allocated":3223552,"data_stored":1753785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476895,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51808,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320032,"statfs":{"total":96636764160,"available":96583712768,"internally_reserved":0,"allocated":2629632,"data_stored":1163417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542301,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51780,"kb_used_data":2544,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320060,"statfs":{"total":96636764160,"available":96583741440,"internally_reserved":0,"allocated":2605056,"data_stored":1152521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542301,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57992,"kb_used_data":4596,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94313848,"statfs":{"total":96636764160,"available":96577380352,"internally_reserved":0,"allocated":4706304,"data_stored":3249147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542300,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60700,"kb_used_data":3144,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311140,"statfs":{"total":96636764160,"available":96574607360,"internally_reserved":0,"allocated":3219456,"data_stored":1759282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542302,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60116,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311724,"statfs":{"total":96636764160,"available":96575205376,"internally_reserved":0,"allocated":2621440,"data_stored":1168844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:24:55.111 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T23:24:55.112 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:24:55.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.210+0000 7fdbf64d0640 1 Processor -- start 2024-09-15T23:24:55.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.210+0000 7fdbf64d0640 1 -- start start 2024-09-15T23:24:55.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.210+0000 7fdbf64d0640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fdbf015ed20 0x7fdbf00b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:55.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.210+0000 7fdbf64d0640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbf00d0e70 con 0x7fdbf00b90e0 2024-09-15T23:24:55.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.210+0000 7fdbf64d0640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbf00d00f0 con 0x7fdbf00d23b0 2024-09-15T23:24:55.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.210+0000 7fdbf64d0640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fdbf00d41c0 con 0x7fdbf015ed20 2024-09-15T23:24:55.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.210+0000 7fdbf4a6d640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fdbf00b90e0 0x7fdbf00cf9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51798/0 (socket says 172.21.15.123:51798) 2024-09-15T23:24:55.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.210+0000 7fdbf4a6d640 1 -- 172.21.15.123:0/2780590866 learned_addr learned my addr 172.21.15.123:0/2780590866 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:55.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.211+0000 7fdbeffff640 1 --2- 172.21.15.123:0/2780590866 >> v2:172.21.15.188:3300/0 conn(0x7fdbf015ed20 0x7fdbf00b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:55.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.211+0000 7fdbeeffd640 1 -- 172.21.15.123:0/2780590866 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1653464965 0 0) 0x7fdbe8001490 con 0x7fdbf00b90e0 2024-09-15T23:24:55.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.211+0000 7fdbeeffd640 1 -- 172.21.15.123:0/2780590866 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbdc003520 con 0x7fdbf00b90e0 2024-09-15T23:24:55.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.211+0000 7fdbeeffd640 1 -- 172.21.15.123:0/2780590866 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2208638645 0 0) 0x7fdbdc003520 con 0x7fdbf00b90e0 2024-09-15T23:24:55.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.211+0000 7fdbeeffd640 1 -- 172.21.15.123:0/2780590866 >> v2:172.21.15.188:3300/0 conn(0x7fdbf015ed20 msgr2=0x7fdbf00b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:55.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.211+0000 7fdbeeffd640 1 --2- 172.21.15.123:0/2780590866 >> v2:172.21.15.188:3300/0 conn(0x7fdbf015ed20 0x7fdbf00b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:55.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.211+0000 7fdbeeffd640 1 -- 172.21.15.123:0/2780590866 >> v1:172.21.15.188:6789/0 conn(0x7fdbf00d23b0 legacy=0x7fdbf00cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:55.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.211+0000 7fdbeeffd640 1 -- 172.21.15.123:0/2780590866 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbf00d35b0 con 0x7fdbf00b90e0 2024-09-15T23:24:55.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.211+0000 7fdbeeffd640 1 -- 172.21.15.123:0/2780590866 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fdbe8001bc0 con 0x7fdbf00b90e0 2024-09-15T23:24:55.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.211+0000 7fdbeeffd640 1 -- 172.21.15.123:0/2780590866 >> v1:172.21.15.123:6789/0 conn(0x7fdbf00b90e0 legacy=0x7fdbf00cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:55.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.211+0000 7fdbeeffd640 1 --2- 172.21.15.123:0/2780590866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbdc0039b0 0x7fdbdc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:55.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.211+0000 7fdbeeffd640 1 --2- 172.21.15.123:0/2780590866 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdbdc004800 0x7fdbdc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:55.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.211+0000 7fdbeeffd640 1 --2- 172.21.15.123:0/2780590866 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdbdc0052e0 0x7fdbdc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:55.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.211+0000 7fdbeeffd640 1 -- 172.21.15.123:0/2780590866 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf00d41c0 con 0x7fdbdc0039b0 2024-09-15T23:24:55.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.211+0000 7fdbeeffd640 1 -- 172.21.15.123:0/2780590866 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fdbdc00c1b0 con 0x7fdbdc0052e0 2024-09-15T23:24:55.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.211+0000 7fdbeeffd640 1 -- 172.21.15.123:0/2780590866 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fdbdc00c3b0 con 0x7fdbdc004800 2024-09-15T23:24:55.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.211+0000 7fdbeffff640 1 --2- 172.21.15.123:0/2780590866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbdc0039b0 0x7fdbdc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:55.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.211+0000 7fdbf4a6d640 1 --2- 172.21.15.123:0/2780590866 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdbdc0052e0 0x7fdbdc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:55.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.211+0000 7fdbef7fe640 1 --2- 172.21.15.123:0/2780590866 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdbdc004800 0x7fdbdc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:55.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.211+0000 7fdbeffff640 1 -- 172.21.15.123:0/2780590866 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdbdc004800 msgr2=0x7fdbdc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:55.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.211+0000 7fdbeffff640 1 --2- 172.21.15.123:0/2780590866 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdbdc004800 0x7fdbdc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:55.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.211+0000 7fdbeffff640 1 -- 172.21.15.123:0/2780590866 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdbdc0052e0 msgr2=0x7fdbdc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:55.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.211+0000 7fdbeffff640 1 --2- 172.21.15.123:0/2780590866 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdbdc0052e0 0x7fdbdc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:55.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.211+0000 7fdbeffff640 1 -- 172.21.15.123:0/2780590866 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbdc003520 con 0x7fdbdc0039b0 2024-09-15T23:24:55.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.211+0000 7fdbf4a6d640 1 -- 172.21.15.123:0/2780590866 reap_dead start 2024-09-15T23:24:55.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.212+0000 7fdbeffff640 1 --2- 172.21.15.123:0/2780590866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbdc0039b0 0x7fdbdc003dd0 secure :-1 s=READY pgs=2485 cs=0 l=1 rev1=1 crypto rx=0x7fdbe000ba00 tx=0x7fdbdc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6faccd9db55dff6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:55.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.212+0000 7fdbeeffd640 1 -- 172.21.15.123:0/2780590866 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0030070 con 0x7fdbdc0039b0 2024-09-15T23:24:55.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.212+0000 7fdbeeffd640 1 -- 172.21.15.123:0/2780590866 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbe002adb0 con 0x7fdbdc0039b0 2024-09-15T23:24:55.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.212+0000 7fdbeeffd640 1 -- 172.21.15.123:0/2780590866 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe000b600 con 0x7fdbdc0039b0 2024-09-15T23:24:55.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.213+0000 7fdbf64d0640 1 -- 172.21.15.123:0/2780590866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbdc0039b0 msgr2=0x7fdbdc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:55.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.213+0000 7fdbf64d0640 1 --2- 172.21.15.123:0/2780590866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbdc0039b0 0x7fdbdc003dd0 secure :-1 s=READY pgs=2485 cs=0 l=1 rev1=1 crypto rx=0x7fdbe000ba00 tx=0x7fdbdc005830 comp rx=0 tx=0).stop 2024-09-15T23:24:55.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.213+0000 7fdbf64d0640 1 -- 172.21.15.123:0/2780590866 shutdown_connections 2024-09-15T23:24:55.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.213+0000 7fdbf64d0640 1 --2- 172.21.15.123:0/2780590866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbdc0039b0 0x7fdbdc003dd0 unknown :-1 s=CLOSED pgs=2485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:55.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.213+0000 7fdbf64d0640 1 -- 172.21.15.123:0/2780590866 >> 172.21.15.123:0/2780590866 conn(0x7fdbf00d1260 msgr2=0x7fdbf00d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:55.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.213+0000 7fdbf64d0640 1 -- 172.21.15.123:0/2780590866 shutdown_connections 2024-09-15T23:24:55.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.213+0000 7fdbf64d0640 1 -- 172.21.15.123:0/2780590866 wait complete. 2024-09-15T23:24:55.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.214+0000 7fdbf64d0640 1 Processor -- start 2024-09-15T23:24:55.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.214+0000 7fdbf64d0640 1 -- start start 2024-09-15T23:24:55.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.215+0000 7fdbf64d0640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbdc0039b0 0x7fdbf015c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:55.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.215+0000 7fdbf64d0640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdbf01f8060 0x7fdbf00adb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:55.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.215+0000 7fdbf64d0640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdbf00d49d0 0x7fdbf00d4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:55.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.215+0000 7fdbf64d0640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf00d3e50 con 0x7fdbdc0039b0 2024-09-15T23:24:55.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.215+0000 7fdbf64d0640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf00d3b70 con 0x7fdbf00d49d0 2024-09-15T23:24:55.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.215+0000 7fdbf64d0640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fdbf00d32a0 con 0x7fdbf01f8060 2024-09-15T23:24:55.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.215+0000 7fdbeffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbdc0039b0 0x7fdbf015c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:55.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.215+0000 7fdbeffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbdc0039b0 0x7fdbf015c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50806/0 (socket says 172.21.15.123:50806) 2024-09-15T23:24:55.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.215+0000 7fdbeffff640 1 -- 172.21.15.123:0/3619123736 learned_addr learned my addr 172.21.15.123:0/3619123736 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:55.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.215+0000 7fdbef7fe640 1 --2- 172.21.15.123:0/3619123736 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdbf01f8060 0x7fdbf00adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:55.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.215+0000 7fdbf4a6d640 1 --2- 172.21.15.123:0/3619123736 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdbf00d49d0 0x7fdbf00d4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:55.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.215+0000 7fdbeffff640 1 -- 172.21.15.123:0/3619123736 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdbf01f8060 msgr2=0x7fdbf00adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:55.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.215+0000 7fdbeffff640 1 --2- 172.21.15.123:0/3619123736 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdbf01f8060 0x7fdbf00adb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:55.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.215+0000 7fdbeffff640 1 -- 172.21.15.123:0/3619123736 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdbf00d49d0 msgr2=0x7fdbf00d4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:55.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.215+0000 7fdbeffff640 1 --2- 172.21.15.123:0/3619123736 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdbf00d49d0 0x7fdbf00d4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:55.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.215+0000 7fdbeffff640 1 -- 172.21.15.123:0/3619123736 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbf01f88b0 con 0x7fdbdc0039b0 2024-09-15T23:24:55.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.215+0000 7fdbeffff640 1 --2- 172.21.15.123:0/3619123736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbdc0039b0 0x7fdbf015c1c0 secure :-1 s=READY pgs=2486 cs=0 l=1 rev1=1 crypto rx=0x7fdbe000bb20 tx=0x7fdbe0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:55.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.216+0000 7fdbecff9640 1 -- 172.21.15.123:0/3619123736 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0043020 con 0x7fdbdc0039b0 2024-09-15T23:24:55.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.216+0000 7fdbecff9640 1 -- 172.21.15.123:0/3619123736 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbe003f680 con 0x7fdbdc0039b0 2024-09-15T23:24:55.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.216+0000 7fdbf64d0640 1 -- 172.21.15.123:0/3619123736 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbf01f8b90 con 0x7fdbdc0039b0 2024-09-15T23:24:55.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.216+0000 7fdbecff9640 1 -- 172.21.15.123:0/3619123736 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe000b600 con 0x7fdbdc0039b0 2024-09-15T23:24:55.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.216+0000 7fdbf64d0640 1 -- 172.21.15.123:0/3619123736 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbf00ab130 con 0x7fdbdc0039b0 2024-09-15T23:24:55.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.217+0000 7fdbf64d0640 1 -- 172.21.15.123:0/3619123736 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbf015f100 con 0x7fdbdc0039b0 2024-09-15T23:24:55.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.217+0000 7fdbecff9640 1 -- 172.21.15.123:0/3619123736 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdbe0046020 con 0x7fdbdc0039b0 2024-09-15T23:24:55.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.217+0000 7fdbecff9640 1 --2- 172.21.15.123:0/3619123736 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdbd006c2e0 0x7fdbd006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:55.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.218+0000 7fdbecff9640 1 -- 172.21.15.123:0/3619123736 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 4943+0+0 (secure 0 0 0) 0x7fdbe00ab880 con 0x7fdbdc0039b0 2024-09-15T23:24:55.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.218+0000 7fdbef7fe640 1 --2- 172.21.15.123:0/3619123736 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdbd006c2e0 0x7fdbd006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:55.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.218+0000 7fdbef7fe640 1 --2- 172.21.15.123:0/3619123736 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdbd006c2e0 0x7fdbd006e7a0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8007fd0 tx=0x7fdbd8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:55.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.222+0000 7fdbecff9640 1 -- 172.21.15.123:0/3619123736 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdbe004d070 con 0x7fdbdc0039b0 2024-09-15T23:24:55.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.384+0000 7fdbf64d0640 1 -- 172.21.15.123:0/3619123736 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdbf00b3f20 con 0x7fdbd006c2e0 2024-09-15T23:24:55.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.385+0000 7fdbecff9640 1 -- 172.21.15.123:0/3619123736 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13520 (secure 0 0 0) 0x7fdbf00b3f20 con 0x7fdbd006c2e0 2024-09-15T23:24:55.387 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:55.387 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:24:55.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.387+0000 7fdbf64d0640 1 -- 172.21.15.123:0/3619123736 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdbd006c2e0 msgr2=0x7fdbd006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:55.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.387+0000 7fdbf64d0640 1 --2- 172.21.15.123:0/3619123736 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdbd006c2e0 0x7fdbd006e7a0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8007fd0 tx=0x7fdbd8009040 comp rx=0 tx=0).stop 2024-09-15T23:24:55.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.387+0000 7fdbf64d0640 1 -- 172.21.15.123:0/3619123736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbdc0039b0 msgr2=0x7fdbf015c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:55.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.387+0000 7fdbf64d0640 1 --2- 172.21.15.123:0/3619123736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbdc0039b0 0x7fdbf015c1c0 secure :-1 s=READY pgs=2486 cs=0 l=1 rev1=1 crypto rx=0x7fdbe000bb20 tx=0x7fdbe0004730 comp rx=0 tx=0).stop 2024-09-15T23:24:55.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.387+0000 7fdbf64d0640 1 -- 172.21.15.123:0/3619123736 shutdown_connections 2024-09-15T23:24:55.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.387+0000 7fdbf64d0640 1 --2- 172.21.15.123:0/3619123736 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fdbf00d49d0 0x7fdbf00d4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:55.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.387+0000 7fdbf64d0640 1 --2- 172.21.15.123:0/3619123736 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fdbf01f8060 0x7fdbf00adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:55.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.387+0000 7fdbf64d0640 1 --2- 172.21.15.123:0/3619123736 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fdbd006c2e0 0x7fdbd006e7a0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:55.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.387+0000 7fdbf64d0640 1 --2- 172.21.15.123:0/3619123736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdbdc0039b0 0x7fdbf015c1c0 unknown :-1 s=CLOSED pgs=2486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:55.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.387+0000 7fdbf64d0640 1 -- 172.21.15.123:0/3619123736 >> 172.21.15.123:0/3619123736 conn(0x7fdbf00d1260 msgr2=0x7fdbf015cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:55.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.387+0000 7fdbf64d0640 1 -- 172.21.15.123:0/3619123736 shutdown_connections 2024-09-15T23:24:55.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.387+0000 7fdbf64d0640 1 -- 172.21.15.123:0/3619123736 wait complete. 2024-09-15T23:24:55.399 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":588,"stamp":"2024-09-15T23:24:53.687127+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":155,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":459200,"kb_used_data":23696,"kb_used_omap":12,"kb_used_meta":435315,"kb_avail":754515520,"statfs":{"total":773094113280,"available":772623892480,"internally_reserved":0,"allocated":24264704,"data_stored":12573830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":445763120},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6306365,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-6,"num_read_kb":-3,"num_write":-79,"num_write_kb":-6187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001505"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":521,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-15T23:24:52.457341+0000","last_change":"2024-09-15T23:12:04.001607+0000","last_active":"2024-09-15T23:24:52.457341+0000","last_peered":"2024-09-15T23:24:52.457341+0000","last_clean":"2024-09-15T23:24:52.457341+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:24:52.457341+0000","last_undegraded":"2024-09-15T23:24:52.457341+0000","last_fullsized":"2024-09-15T23:24:52.457341+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:12:01.975111+0000","last_clean_scrub_stamp":"2024-09-15T23:12:01.975111+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:34:46.589226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476896,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60128,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311712,"statfs":{"total":96636764160,"available":96575193088,"internally_reserved":0,"allocated":2629632,"data_stored":1163417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476893,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55968,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315872,"statfs":{"total":96636764160,"available":96579452928,"internally_reserved":0,"allocated":2629632,"data_stored":1163417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476895,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60708,"kb_used_data":3148,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311132,"statfs":{"total":96636764160,"available":96574599168,"internally_reserved":0,"allocated":3223552,"data_stored":1753785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476895,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51808,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320032,"statfs":{"total":96636764160,"available":96583712768,"internally_reserved":0,"allocated":2629632,"data_stored":1163417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542301,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51780,"kb_used_data":2544,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320060,"statfs":{"total":96636764160,"available":96583741440,"internally_reserved":0,"allocated":2605056,"data_stored":1152521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542301,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57992,"kb_used_data":4596,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94313848,"statfs":{"total":96636764160,"available":96577380352,"internally_reserved":0,"allocated":4706304,"data_stored":3249147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542300,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60700,"kb_used_data":3144,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311140,"statfs":{"total":96636764160,"available":96574607360,"internally_reserved":0,"allocated":3219456,"data_stored":1759282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542302,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60116,"kb_used_data":2560,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311724,"statfs":{"total":96636764160,"available":96575205376,"internally_reserved":0,"allocated":2621440,"data_stored":1168844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:24:55.400 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:24:55.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.497+0000 7f62c4b31640 1 Processor -- start 2024-09-15T23:24:55.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.497+0000 7f62c4b31640 1 -- start start 2024-09-15T23:24:55.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.498+0000 7f62c4b31640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f62c00b6970 0x7f62c00b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:55.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.498+0000 7f62c4b31640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f62c00d23b0 0x7f62c00b8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:55.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.498+0000 7f62c4b31640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62c00d0e70 con 0x7f62c015ed20 2024-09-15T23:24:55.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.498+0000 7f62c4b31640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f62c00d41c0 con 0x7f62c00b6970 2024-09-15T23:24:55.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.498+0000 7f62c4b31640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f62c00d35b0 con 0x7f62c00d23b0 2024-09-15T23:24:55.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.499+0000 7f62be59c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f62c015ed20 0x7f62c00b6260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:51806/0 (socket says 172.21.15.123:51806) 2024-09-15T23:24:55.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.499+0000 7f62be59c640 1 -- 172.21.15.123:0/1867425108 learned_addr learned my addr 172.21.15.123:0/1867425108 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:55.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.499+0000 7f62bd59a640 1 -- 172.21.15.123:0/1867425108 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4235811548 0 0) 0x7f62b0001490 con 0x7f62c015ed20 2024-09-15T23:24:55.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.499+0000 7f62bd59a640 1 -- 172.21.15.123:0/1867425108 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62ac003520 con 0x7f62c015ed20 2024-09-15T23:24:55.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.499+0000 7f62bed9d640 1 --2- 172.21.15.123:0/1867425108 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f62c00d23b0 0x7f62c00b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:55.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.499+0000 7f62bdd9b640 1 --2- 172.21.15.123:0/1867425108 >> v2:172.21.15.188:3300/0 conn(0x7f62c00b6970 0x7f62c00b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:55.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.499+0000 7f62bd59a640 1 -- 172.21.15.123:0/1867425108 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 950126437 0 0) 0x7f62ac003520 con 0x7f62c015ed20 2024-09-15T23:24:55.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.499+0000 7f62bd59a640 1 -- 172.21.15.123:0/1867425108 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f62c00d23b0 msgr2=0x7f62c00b8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:55.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.499+0000 7f62bd59a640 1 --2- 172.21.15.123:0/1867425108 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f62c00d23b0 0x7f62c00b8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:55.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.499+0000 7f62bd59a640 1 -- 172.21.15.123:0/1867425108 >> v2:172.21.15.188:3300/0 conn(0x7f62c00b6970 msgr2=0x7f62c00b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:55.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.499+0000 7f62bd59a640 1 --2- 172.21.15.123:0/1867425108 >> v2:172.21.15.188:3300/0 conn(0x7f62c00b6970 0x7f62c00b80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:55.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.499+0000 7f62bd59a640 1 -- 172.21.15.123:0/1867425108 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62c00d3890 con 0x7f62c015ed20 2024-09-15T23:24:55.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.499+0000 7f62bd59a640 1 -- 172.21.15.123:0/1867425108 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f62b0001bc0 con 0x7f62c015ed20 2024-09-15T23:24:55.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.499+0000 7f62bdd9b640 1 --2- 172.21.15.123:0/1867425108 >> v2:172.21.15.188:3300/0 conn(0x7f62c00b6970 0x7f62c00b80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:24:55.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.499+0000 7f62bd59a640 1 -- 172.21.15.123:0/1867425108 >> v1:172.21.15.123:6789/0 conn(0x7f62c015ed20 legacy=0x7f62c00b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:55.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.499+0000 7f62bd59a640 1 --2- 172.21.15.123:0/1867425108 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f62c00d23b0 0x7f62ac0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:55.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.499+0000 7f62bd59a640 1 --2- 172.21.15.123:0/1867425108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62ac003f30 0x7f62ac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:55.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.499+0000 7f62bd59a640 1 --2- 172.21.15.123:0/1867425108 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f62ac004d40 0x7f62ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:55.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.499+0000 7f62bd59a640 1 -- 172.21.15.123:0/1867425108 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f62c00d41c0 con 0x7f62ac003f30 2024-09-15T23:24:55.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.499+0000 7f62bd59a640 1 -- 172.21.15.123:0/1867425108 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f62c00d35b0 con 0x7f62ac004d40 2024-09-15T23:24:55.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.499+0000 7f62bd59a640 1 -- 172.21.15.123:0/1867425108 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f62ac00bac0 con 0x7f62c00d23b0 2024-09-15T23:24:55.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.499+0000 7f62bdd9b640 1 --2- 172.21.15.123:0/1867425108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62ac003f30 0x7f62ac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:55.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.499+0000 7f62bed9d640 1 --2- 172.21.15.123:0/1867425108 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f62ac004d40 0x7f62ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:55.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.499+0000 7f62be59c640 1 --2- 172.21.15.123:0/1867425108 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f62c00d23b0 0x7f62ac0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:55.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.499+0000 7f62bdd9b640 1 -- 172.21.15.123:0/1867425108 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f62c00d23b0 msgr2=0x7f62ac0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:55.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.499+0000 7f62bdd9b640 1 --2- 172.21.15.123:0/1867425108 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f62c00d23b0 0x7f62ac0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:55.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.499+0000 7f62bdd9b640 1 -- 172.21.15.123:0/1867425108 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f62ac004d40 msgr2=0x7f62ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:55.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.499+0000 7f62bdd9b640 1 --2- 172.21.15.123:0/1867425108 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f62ac004d40 0x7f62ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:55.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.499+0000 7f62bdd9b640 1 -- 172.21.15.123:0/1867425108 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62ac003520 con 0x7f62ac003f30 2024-09-15T23:24:55.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.500+0000 7f62be59c640 1 --2- 172.21.15.123:0/1867425108 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f62c00d23b0 0x7f62ac0039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:24:55.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.500+0000 7f62bdd9b640 1 --2- 172.21.15.123:0/1867425108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62ac003f30 0x7f62ac004800 secure :-1 s=READY pgs=2488 cs=0 l=1 rev1=1 crypto rx=0x7f62a80098d0 tx=0x7f62ac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ca9495ea97c9a94 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:55.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.500+0000 7f62bd59a640 1 -- 172.21.15.123:0/1867425108 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a800f040 con 0x7f62ac003f30 2024-09-15T23:24:55.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.500+0000 7f62bd59a640 1 -- 172.21.15.123:0/1867425108 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62a802ad50 con 0x7f62ac003f30 2024-09-15T23:24:55.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.500+0000 7f62bd59a640 1 -- 172.21.15.123:0/1867425108 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a8004250 con 0x7f62ac003f30 2024-09-15T23:24:55.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.501+0000 7f62c4b31640 1 -- 172.21.15.123:0/1867425108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62ac003f30 msgr2=0x7f62ac004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:55.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.501+0000 7f62c4b31640 1 --2- 172.21.15.123:0/1867425108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62ac003f30 0x7f62ac004800 secure :-1 s=READY pgs=2488 cs=0 l=1 rev1=1 crypto rx=0x7f62a80098d0 tx=0x7f62ac005830 comp rx=0 tx=0).stop 2024-09-15T23:24:55.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.501+0000 7f62bed9d640 1 -- 172.21.15.123:0/1867425108 reap_dead start 2024-09-15T23:24:55.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.501+0000 7f62c4b31640 1 -- 172.21.15.123:0/1867425108 shutdown_connections 2024-09-15T23:24:55.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.501+0000 7f62c4b31640 1 -- 172.21.15.123:0/1867425108 >> 172.21.15.123:0/1867425108 conn(0x7f62c00d1260 msgr2=0x7f62c00d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:55.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.501+0000 7f62c4b31640 1 -- 172.21.15.123:0/1867425108 shutdown_connections 2024-09-15T23:24:55.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.501+0000 7f62c4b31640 1 -- 172.21.15.123:0/1867425108 wait complete. 2024-09-15T23:24:55.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.502+0000 7f62c4b31640 1 Processor -- start 2024-09-15T23:24:55.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.502+0000 7f62c4b31640 1 -- start start 2024-09-15T23:24:55.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.503+0000 7f62c4b31640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f62ac003f30 0x7f62c0161c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:55.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.503+0000 7f62c4b31640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f62c0154730 0x7f62c0154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:55.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.503+0000 7f62c4b31640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62c0156cb0 0x7f62c0157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:55.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.503+0000 7f62c4b31640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f62c00d32a0 con 0x7f62c0156cb0 2024-09-15T23:24:55.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.503+0000 7f62c4b31640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f62c00d3e50 con 0x7f62ac003f30 2024-09-15T23:24:55.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.503+0000 7f62c4b31640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f62c015f100 con 0x7f62c0154730 2024-09-15T23:24:55.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.503+0000 7f62bed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62c0156cb0 0x7f62c0157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:55.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.503+0000 7f62bed9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62c0156cb0 0x7f62c0157120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50824/0 (socket says 172.21.15.123:50824) 2024-09-15T23:24:55.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.503+0000 7f62bed9d640 1 -- 172.21.15.123:0/2300717113 learned_addr learned my addr 172.21.15.123:0/2300717113 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:55.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.503+0000 7f62bdd9b640 1 --2- 172.21.15.123:0/2300717113 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f62c0154730 0x7f62c0154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:55.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.503+0000 7f62be59c640 1 --2- 172.21.15.123:0/2300717113 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f62ac003f30 0x7f62c0161c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:55.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.503+0000 7f62bed9d640 1 -- 172.21.15.123:0/2300717113 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f62c0154730 msgr2=0x7f62c0154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:55.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.503+0000 7f62bed9d640 1 --2- 172.21.15.123:0/2300717113 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f62c0154730 0x7f62c0154bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:55.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.503+0000 7f62bed9d640 1 -- 172.21.15.123:0/2300717113 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f62ac003f30 msgr2=0x7f62c0161c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:55.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.503+0000 7f62bed9d640 1 --2- 172.21.15.123:0/2300717113 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f62ac003f30 0x7f62c0161c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:55.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.503+0000 7f62bed9d640 1 -- 172.21.15.123:0/2300717113 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62c01550f0 con 0x7f62c0156cb0 2024-09-15T23:24:55.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.503+0000 7f62be59c640 1 --2- 172.21.15.123:0/2300717113 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f62ac003f30 0x7f62c0161c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:24:55.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.504+0000 7f62bed9d640 1 --2- 172.21.15.123:0/2300717113 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62c0156cb0 0x7f62c0157120 secure :-1 s=READY pgs=2489 cs=0 l=1 rev1=1 crypto rx=0x7f62c008d9c0 tx=0x7f62b8011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:55.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.504+0000 7f62b6ffd640 1 -- 172.21.15.123:0/2300717113 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b8019020 con 0x7f62c0156cb0 2024-09-15T23:24:55.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.504+0000 7f62b6ffd640 1 -- 172.21.15.123:0/2300717113 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62b8004240 con 0x7f62c0156cb0 2024-09-15T23:24:55.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.504+0000 7f62c4b31640 1 -- 172.21.15.123:0/2300717113 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62c0157a20 con 0x7f62c0156cb0 2024-09-15T23:24:55.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.504+0000 7f62b6ffd640 1 -- 172.21.15.123:0/2300717113 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b800f770 con 0x7f62c0156cb0 2024-09-15T23:24:55.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.504+0000 7f62c4b31640 1 -- 172.21.15.123:0/2300717113 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62c0157fe0 con 0x7f62c0156cb0 2024-09-15T23:24:55.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.505+0000 7f62c4b31640 1 -- 172.21.15.123:0/2300717113 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62c00b7010 con 0x7f62c0156cb0 2024-09-15T23:24:55.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.505+0000 7f62b6ffd640 1 -- 172.21.15.123:0/2300717113 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f62b801c020 con 0x7f62c0156cb0 2024-09-15T23:24:55.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.506+0000 7f62b6ffd640 1 --2- 172.21.15.123:0/2300717113 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f62a006c2b0 0x7f62a006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:55.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.506+0000 7f62b6ffd640 1 -- 172.21.15.123:0/2300717113 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 4943+0+0 (secure 0 0 0) 0x7f62b808b330 con 0x7f62c0156cb0 2024-09-15T23:24:55.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.506+0000 7f62be59c640 1 --2- 172.21.15.123:0/2300717113 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f62a006c2b0 0x7f62a006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:55.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.506+0000 7f62be59c640 1 --2- 172.21.15.123:0/2300717113 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f62a006c2b0 0x7f62a006e770 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f62c00ce6d0 tx=0x7f62b0001250 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:55.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.510+0000 7f62b6ffd640 1 -- 172.21.15.123:0/2300717113 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f62b8023020 con 0x7f62c0156cb0 2024-09-15T23:24:55.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.676+0000 7f62c4b31640 1 -- 172.21.15.123:0/2300717113 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f62c00d0a90 con 0x7f62c0156cb0 2024-09-15T23:24:55.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.677+0000 7f62b6ffd640 1 -- 172.21.15.123:0/2300717113 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v209) ==== 74+0+13068 (secure 0 0 0) 0x7f62b8059db0 con 0x7f62c0156cb0 2024-09-15T23:24:55.679 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:24:55.679 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":209,"fsid":"cb968ac4-8d3a-4b17-a673-6177aeaea589","created":"2024-09-15T23:11:49.432084+0000","modified":"2024-09-15T23:24:52.449166+0000","last_up_change":"2024-09-15T23:12:02.976589+0000","last_in_change":"2024-09-15T23:11:51.580838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:12:01.531886+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9557a101-be0e-4cb6-abc3-392cc1a54f21","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6817","nonce":2610756058}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6819","nonce":2610756058}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6823","nonce":2610756058}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":2610756058},{"type":"v1","addr":"172.21.15.123:6821","nonce":2610756058}]},"public_addr":"172.21.15.123:6817/2610756058","cluster_addr":"172.21.15.123:6819/2610756058","heartbeat_back_addr":"172.21.15.123:6823/2610756058","heartbeat_front_addr":"172.21.15.123:6821/2610756058","state":["exists","up"]},{"osd":1,"uuid":"8b9f5628-6722-4dc2-88bd-404dd735e753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6809","nonce":290001388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6811","nonce":290001388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6815","nonce":290001388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":290001388},{"type":"v1","addr":"172.21.15.123:6813","nonce":290001388}]},"public_addr":"172.21.15.123:6809/290001388","cluster_addr":"172.21.15.123:6811/290001388","heartbeat_back_addr":"172.21.15.123:6815/290001388","heartbeat_front_addr":"172.21.15.123:6813/290001388","state":["exists","up"]},{"osd":2,"uuid":"e5ce4ef9-7ed6-47d6-b613-1d4cebc7915c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6801","nonce":256503513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6803","nonce":256503513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6807","nonce":256503513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":256503513},{"type":"v1","addr":"172.21.15.123:6805","nonce":256503513}]},"public_addr":"172.21.15.123:6801/256503513","cluster_addr":"172.21.15.123:6803/256503513","heartbeat_back_addr":"172.21.15.123:6807/256503513","heartbeat_front_addr":"172.21.15.123:6805/256503513","state":["exists","up"]},{"osd":3,"uuid":"3d9bcd26-9d4b-427e-b655-e6f90ff495e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6825","nonce":829220507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6827","nonce":829220507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6831","nonce":829220507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":829220507},{"type":"v1","addr":"172.21.15.123:6829","nonce":829220507}]},"public_addr":"172.21.15.123:6825/829220507","cluster_addr":"172.21.15.123:6827/829220507","heartbeat_back_addr":"172.21.15.123:6831/829220507","heartbeat_front_addr":"172.21.15.123:6829/829220507","state":["exists","up"]},{"osd":4,"uuid":"546e8ebe-0094-4902-95c7-3a90321218fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6800","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6801","nonce":3901678408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6802","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6803","nonce":3901678408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6806","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6807","nonce":3901678408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6804","nonce":3901678408},{"type":"v1","addr":"172.21.15.188:6805","nonce":3901678408}]},"public_addr":"172.21.15.188:6801/3901678408","cluster_addr":"172.21.15.188:6803/3901678408","heartbeat_back_addr":"172.21.15.188:6807/3901678408","heartbeat_front_addr":"172.21.15.188:6805/3901678408","state":["exists","up"]},{"osd":5,"uuid":"472bfb57-51b2-4e8d-9838-108a90fb9480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6808","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6809","nonce":1860798982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6810","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6811","nonce":1860798982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6814","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6815","nonce":1860798982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6812","nonce":1860798982},{"type":"v1","addr":"172.21.15.188:6813","nonce":1860798982}]},"public_addr":"172.21.15.188:6809/1860798982","cluster_addr":"172.21.15.188:6811/1860798982","heartbeat_back_addr":"172.21.15.188:6815/1860798982","heartbeat_front_addr":"172.21.15.188:6813/1860798982","state":["exists","up"]},{"osd":6,"uuid":"985819ed-52ac-4708-8d8f-22625ecba0f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6816","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6817","nonce":226100332}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6818","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6819","nonce":226100332}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6822","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6823","nonce":226100332}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6820","nonce":226100332},{"type":"v1","addr":"172.21.15.188:6821","nonce":226100332}]},"public_addr":"172.21.15.188:6817/226100332","cluster_addr":"172.21.15.188:6819/226100332","heartbeat_back_addr":"172.21.15.188:6823/226100332","heartbeat_front_addr":"172.21.15.188:6821/226100332","state":["exists","up"]},{"osd":7,"uuid":"629f5732-0148-4782-949d-abdcdcd5fa75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":204,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6826","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6827","nonce":1725565174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6828","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6829","nonce":1725565174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6832","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6833","nonce":1725565174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6830","nonce":1725565174},{"type":"v1","addr":"172.21.15.188:6831","nonce":1725565174}]},"public_addr":"172.21.15.188:6827/1725565174","cluster_addr":"172.21.15.188:6829/1725565174","heartbeat_back_addr":"172.21.15.188:6833/1725565174","heartbeat_front_addr":"172.21.15.188:6831/1725565174","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.558596+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.919146+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.908960+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.662324+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.195425+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.056490+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.673693+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:11:58.850685+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6834/1661365546":"2024-09-16T23:24:49.406668+0000","172.21.15.123:6832/1661365546":"2024-09-16T23:24:49.406668+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:24:55.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.679+0000 7f62c4b31640 1 -- 172.21.15.123:0/2300717113 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f62a006c2b0 msgr2=0x7f62a006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:55.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.679+0000 7f62c4b31640 1 --2- 172.21.15.123:0/2300717113 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f62a006c2b0 0x7f62a006e770 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f62c00ce6d0 tx=0x7f62b0001250 comp rx=0 tx=0).stop 2024-09-15T23:24:55.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.679+0000 7f62c4b31640 1 -- 172.21.15.123:0/2300717113 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62c0156cb0 msgr2=0x7f62c0157120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:55.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.679+0000 7f62c4b31640 1 --2- 172.21.15.123:0/2300717113 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62c0156cb0 0x7f62c0157120 secure :-1 s=READY pgs=2489 cs=0 l=1 rev1=1 crypto rx=0x7f62c008d9c0 tx=0x7f62b8011cf0 comp rx=0 tx=0).stop 2024-09-15T23:24:55.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.679+0000 7f62c4b31640 1 -- 172.21.15.123:0/2300717113 shutdown_connections 2024-09-15T23:24:55.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.679+0000 7f62c4b31640 1 --2- 172.21.15.123:0/2300717113 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f62a006c2b0 0x7f62a006e770 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:55.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.679+0000 7f62c4b31640 1 --2- 172.21.15.123:0/2300717113 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f62c0156cb0 0x7f62c0157120 unknown :-1 s=CLOSED pgs=2489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:55.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.679+0000 7f62c4b31640 1 --2- 172.21.15.123:0/2300717113 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f62c0154730 0x7f62c0154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:55.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.679+0000 7f62c4b31640 1 --2- 172.21.15.123:0/2300717113 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f62ac003f30 0x7f62c0161c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:55.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.679+0000 7f62c4b31640 1 -- 172.21.15.123:0/2300717113 >> 172.21.15.123:0/2300717113 conn(0x7f62c00d1260 msgr2=0x7f62c00b5340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:55.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.679+0000 7f62c4b31640 1 -- 172.21.15.123:0/2300717113 shutdown_connections 2024-09-15T23:24:55.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:55.679+0000 7f62c4b31640 1 -- 172.21.15.123:0/2300717113 wait complete. 2024-09-15T23:24:56.692 INFO:tasks.ceph:Scrubbing osd.0 2024-09-15T23:24:56.693 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-15T23:24:56.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.803+0000 7f810b68d640 1 Processor -- start 2024-09-15T23:24:56.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.803+0000 7f810b68d640 1 -- start start 2024-09-15T23:24:56.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.804+0000 7f810b68d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f810415ea90 0x7f81040d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:56.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.804+0000 7f810b68d640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f81040d16e0 0x7f81040b7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:56.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.804+0000 7f810b68d640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81040cf060 con 0x7f81040d40b0 2024-09-15T23:24:56.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.804+0000 7f810b68d640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f81040d34c0 con 0x7f81040d16e0 2024-09-15T23:24:56.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.804+0000 7f810b68d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f81040cf340 con 0x7f810415ea90 2024-09-15T23:24:56.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.804+0000 7f8109c2a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f81040d16e0 0x7f81040b7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:56.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.804+0000 7f8109c2a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f81040d16e0 0x7f81040b7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48398/0 (socket says 172.21.15.123:48398) 2024-09-15T23:24:56.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.804+0000 7f8109c2a640 1 -- 172.21.15.123:0/3524119240 learned_addr learned my addr 172.21.15.123:0/3524119240 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:56.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.804+0000 7f8109429640 1 --2- 172.21.15.123:0/3524119240 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f810415ea90 0x7f81040d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:56.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.804+0000 7f8109c2a640 1 -- 172.21.15.123:0/3524119240 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f810415ea90 msgr2=0x7f81040d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:56.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.804+0000 7f8109c2a640 1 --2- 172.21.15.123:0/3524119240 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f810415ea90 0x7f81040d2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:56.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.804+0000 7f8109c2a640 1 -- 172.21.15.123:0/3524119240 >> v1:172.21.15.188:6789/0 conn(0x7f81040d40b0 legacy=0x7f81040d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:56.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.804+0000 7f8109c2a640 1 -- 172.21.15.123:0/3524119240 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81040cf620 con 0x7f81040d16e0 2024-09-15T23:24:56.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.805+0000 7f8109c2a640 1 --2- 172.21.15.123:0/3524119240 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81040d16e0 0x7f81040b7ac0 secure :-1 s=READY pgs=2490 cs=0 l=1 rev1=1 crypto rx=0x7f80fc009e50 tx=0x7f80fc02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=686c7818b0d0f3f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:56.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.805+0000 7f80fbfff640 1 -- 172.21.15.123:0/3524119240 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80fc036070 con 0x7f81040d16e0 2024-09-15T23:24:56.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.805+0000 7f80fbfff640 1 -- 172.21.15.123:0/3524119240 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80fc031600 con 0x7f81040d16e0 2024-09-15T23:24:56.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.805+0000 7f80fbfff640 1 -- 172.21.15.123:0/3524119240 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80fc0319d0 con 0x7f81040d16e0 2024-09-15T23:24:56.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.805+0000 7f810b68d640 1 -- 172.21.15.123:0/3524119240 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81040d16e0 msgr2=0x7f81040b7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:56.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.805+0000 7f810b68d640 1 --2- 172.21.15.123:0/3524119240 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81040d16e0 0x7f81040b7ac0 secure :-1 s=READY pgs=2490 cs=0 l=1 rev1=1 crypto rx=0x7f80fc009e50 tx=0x7f80fc02a710 comp rx=0 tx=0).stop 2024-09-15T23:24:56.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.805+0000 7f810b68d640 1 -- 172.21.15.123:0/3524119240 shutdown_connections 2024-09-15T23:24:56.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.805+0000 7f810b68d640 1 --2- 172.21.15.123:0/3524119240 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81040d16e0 0x7f81040b7ac0 unknown :-1 s=CLOSED pgs=2490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:56.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.805+0000 7f810b68d640 1 --2- 172.21.15.123:0/3524119240 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f810415ea90 0x7f81040d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:56.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.805+0000 7f810b68d640 1 -- 172.21.15.123:0/3524119240 >> 172.21.15.123:0/3524119240 conn(0x7f810406c0e0 msgr2=0x7f810406c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:56.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.806+0000 7f810b68d640 1 -- 172.21.15.123:0/3524119240 shutdown_connections 2024-09-15T23:24:56.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.806+0000 7f810b68d640 1 -- 172.21.15.123:0/3524119240 wait complete. 2024-09-15T23:24:56.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.807+0000 7f810b68d640 1 Processor -- start 2024-09-15T23:24:56.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.807+0000 7f810b68d640 1 -- start start 2024-09-15T23:24:56.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.807+0000 7f810b68d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f81040d16e0 0x7f810415da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:56.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.807+0000 7f810b68d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81040d40b0 0x7f81040b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:56.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.807+0000 7f810b68d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f810415ea90 0x7f8104161560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:56.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.807+0000 7f810b68d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f810415ee70 con 0x7f81040d40b0 2024-09-15T23:24:56.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.807+0000 7f810b68d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f81040cfbe0 con 0x7f810415ea90 2024-09-15T23:24:56.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.807+0000 7f810b68d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f81040b8000 con 0x7f81040d16e0 2024-09-15T23:24:56.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.808+0000 7f8108c28640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81040d40b0 0x7f81040b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:56.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.808+0000 7f8108c28640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81040d40b0 0x7f81040b2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48414/0 (socket says 172.21.15.123:48414) 2024-09-15T23:24:56.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.808+0000 7f8108c28640 1 -- 172.21.15.123:0/1131937909 learned_addr learned my addr 172.21.15.123:0/1131937909 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:56.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.808+0000 7f8109429640 1 --2- 172.21.15.123:0/1131937909 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f81040d16e0 0x7f810415da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:56.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.808+0000 7f8109c2a640 1 --2- 172.21.15.123:0/1131937909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f810415ea90 0x7f8104161560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:56.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.808+0000 7f8108c28640 1 -- 172.21.15.123:0/1131937909 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f81040d16e0 msgr2=0x7f810415da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:56.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.808+0000 7f8108c28640 1 --2- 172.21.15.123:0/1131937909 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f81040d16e0 0x7f810415da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:56.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.808+0000 7f8108c28640 1 -- 172.21.15.123:0/1131937909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f810415ea90 msgr2=0x7f8104161560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:56.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.808+0000 7f8108c28640 1 --2- 172.21.15.123:0/1131937909 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f810415ea90 0x7f8104161560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:56.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.808+0000 7f8108c28640 1 -- 172.21.15.123:0/1131937909 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81041f50c0 con 0x7f81040d40b0 2024-09-15T23:24:56.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.808+0000 7f8108c28640 1 --2- 172.21.15.123:0/1131937909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81040d40b0 0x7f81040b2d60 secure :-1 s=READY pgs=2491 cs=0 l=1 rev1=1 crypto rx=0x7f80f400c440 tx=0x7f80f4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:56.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.808+0000 7f80f9ffb640 1 -- 172.21.15.123:0/1131937909 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f40052d0 con 0x7f81040d40b0 2024-09-15T23:24:56.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.808+0000 7f80f9ffb640 1 -- 172.21.15.123:0/1131937909 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80f4005470 con 0x7f81040d40b0 2024-09-15T23:24:56.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.808+0000 7f810b68d640 1 -- 172.21.15.123:0/1131937909 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81041f53a0 con 0x7f81040d40b0 2024-09-15T23:24:56.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.808+0000 7f80f9ffb640 1 -- 172.21.15.123:0/1131937909 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80f4007260 con 0x7f81040d40b0 2024-09-15T23:24:56.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.808+0000 7f810b68d640 1 -- 172.21.15.123:0/1131937909 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81041f5960 con 0x7f81040d40b0 2024-09-15T23:24:56.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.809+0000 7f810b68d640 1 -- 172.21.15.123:0/1131937909 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f81040b7ac0 con 0x7f81040d40b0 2024-09-15T23:24:56.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.810+0000 7f80f9ffb640 1 -- 172.21.15.123:0/1131937909 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f80f4007400 con 0x7f81040d40b0 2024-09-15T23:24:56.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.810+0000 7f80f9ffb640 1 --2- 172.21.15.123:0/1131937909 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f80e806c2b0 0x7f80e806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:56.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.810+0000 7f80f9ffb640 1 -- 172.21.15.123:0/1131937909 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 4943+0+0 (secure 0 0 0) 0x7f80f408a5a0 con 0x7f81040d40b0 2024-09-15T23:24:56.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.810+0000 7f80f9ffb640 1 --2- 172.21.15.123:0/1131937909 >> [v2:172.21.15.123:6816/2610756058,v1:172.21.15.123:6817/2610756058] conn(0x7f80e8072170 0x7f80e8074590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:56.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.810+0000 7f8109429640 1 --2- 172.21.15.123:0/1131937909 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f80e806c2b0 0x7f80e806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:56.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.810+0000 7f80f9ffb640 1 -- 172.21.15.123:0/1131937909 --> [v2:172.21.15.123:6816/2610756058,v1:172.21.15.123:6817/2610756058] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f80f4009e50 con 0x7f80e8072170 2024-09-15T23:24:56.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.810+0000 7f80f9ffb640 1 -- 172.21.15.123:0/1131937909 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=209) ==== 24+0+0 (secure 0 0 0) 0x7f80f4091050 con 0x7f81040d40b0 2024-09-15T23:24:56.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.811+0000 7f8109c2a640 1 --2- 172.21.15.123:0/1131937909 >> [v2:172.21.15.123:6816/2610756058,v1:172.21.15.123:6817/2610756058] conn(0x7f80e8072170 0x7f80e8074590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:56.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.811+0000 7f8109429640 1 --2- 172.21.15.123:0/1131937909 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f80e806c2b0 0x7f80e806e770 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f8100009aa0 tx=0x7f8100009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:56.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.811+0000 7f8109c2a640 1 --2- 172.21.15.123:0/1131937909 >> [v2:172.21.15.123:6816/2610756058,v1:172.21.15.123:6817/2610756058] conn(0x7f80e8072170 0x7f80e8074590 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:56.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.812+0000 7f80f9ffb640 1 -- 172.21.15.123:0/1131937909 <== osd.0 v2:172.21.15.123:6816/2610756058 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f80f4009e50 con 0x7f80e8072170 2024-09-15T23:24:56.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.824+0000 7f810b68d640 1 -- 172.21.15.123:0/1131937909 --> [v2:172.21.15.123:6816/2610756058,v1:172.21.15.123:6817/2610756058] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f81040b3e70 con 0x7f80e8072170 2024-09-15T23:24:56.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.824+0000 7f80f9ffb640 1 -- 172.21.15.123:0/1131937909 <== osd.0 v2:172.21.15.123:6816/2610756058 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f81040b3e70 con 0x7f80e8072170 2024-09-15T23:24:56.836 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:24:56.836 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T23:24:56.836 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:24:56.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.824+0000 7f810b68d640 1 -- 172.21.15.123:0/1131937909 >> [v2:172.21.15.123:6816/2610756058,v1:172.21.15.123:6817/2610756058] conn(0x7f80e8072170 msgr2=0x7f80e8074590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:56.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.824+0000 7f810b68d640 1 --2- 172.21.15.123:0/1131937909 >> [v2:172.21.15.123:6816/2610756058,v1:172.21.15.123:6817/2610756058] conn(0x7f80e8072170 0x7f80e8074590 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:56.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.825+0000 7f810b68d640 1 -- 172.21.15.123:0/1131937909 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f80e806c2b0 msgr2=0x7f80e806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:56.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.825+0000 7f810b68d640 1 --2- 172.21.15.123:0/1131937909 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f80e806c2b0 0x7f80e806e770 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f8100009aa0 tx=0x7f8100009190 comp rx=0 tx=0).stop 2024-09-15T23:24:56.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.825+0000 7f810b68d640 1 -- 172.21.15.123:0/1131937909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81040d40b0 msgr2=0x7f81040b2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:56.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.825+0000 7f810b68d640 1 --2- 172.21.15.123:0/1131937909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81040d40b0 0x7f81040b2d60 secure :-1 s=READY pgs=2491 cs=0 l=1 rev1=1 crypto rx=0x7f80f400c440 tx=0x7f80f4001e70 comp rx=0 tx=0).stop 2024-09-15T23:24:56.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.825+0000 7f8109c2a640 1 -- 172.21.15.123:0/1131937909 reap_dead start 2024-09-15T23:24:56.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.825+0000 7f810b68d640 1 -- 172.21.15.123:0/1131937909 shutdown_connections 2024-09-15T23:24:56.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.825+0000 7f810b68d640 1 -- 172.21.15.123:0/1131937909 >> 172.21.15.123:0/1131937909 conn(0x7f810406c0e0 msgr2=0x7f81040d29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:56.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.825+0000 7f810b68d640 1 -- 172.21.15.123:0/1131937909 shutdown_connections 2024-09-15T23:24:56.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.825+0000 7f810b68d640 1 -- 172.21.15.123:0/1131937909 wait complete. 2024-09-15T23:24:56.843 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-15T23:24:56.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.940+0000 7fb36d7f1640 1 Processor -- start 2024-09-15T23:24:56.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.940+0000 7fb36d7f1640 1 -- start start 2024-09-15T23:24:56.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.941+0000 7fb36d7f1640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fb36815ed20 0x7fb3680b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:56.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.941+0000 7fb36d7f1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb3680b90e0 0x7fb3680b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:56.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.941+0000 7fb36d7f1640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3680d0e70 con 0x7fb3680d23b0 2024-09-15T23:24:56.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.941+0000 7fb36d7f1640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fb3680d41c0 con 0x7fb36815ed20 2024-09-15T23:24:56.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.941+0000 7fb36d7f1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb3680d35b0 con 0x7fb3680b90e0 2024-09-15T23:24:56.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.941+0000 7fb35e7fc640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb3680d23b0 0x7fb3680cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55088/0 (socket says 172.21.15.123:55088) 2024-09-15T23:24:56.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.941+0000 7fb35e7fc640 1 -- 172.21.15.123:0/3700164106 learned_addr learned my addr 172.21.15.123:0/3700164106 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:56.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.941+0000 7fb366ffd640 1 --2- 172.21.15.123:0/3700164106 >> v2:172.21.15.188:3300/0 conn(0x7fb36815ed20 0x7fb3680b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:56.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.941+0000 7fb3677fe640 1 --2- 172.21.15.123:0/3700164106 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb3680b90e0 0x7fb3680b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:56.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.941+0000 7fb3667fc640 1 -- 172.21.15.123:0/3700164106 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3993224890 0 0) 0x7fb350001110 con 0x7fb3680d23b0 2024-09-15T23:24:56.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.941+0000 7fb3667fc640 1 -- 172.21.15.123:0/3700164106 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb354003520 con 0x7fb3680d23b0 2024-09-15T23:24:56.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.941+0000 7fb3667fc640 1 -- 172.21.15.123:0/3700164106 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3074855791 0 0) 0x7fb354003520 con 0x7fb3680d23b0 2024-09-15T23:24:56.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.941+0000 7fb366ffd640 1 -- 172.21.15.123:0/3700164106 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb3680b90e0 msgr2=0x7fb3680b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:56.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.941+0000 7fb366ffd640 1 --2- 172.21.15.123:0/3700164106 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb3680b90e0 0x7fb3680b67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:56.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.941+0000 7fb366ffd640 1 -- 172.21.15.123:0/3700164106 >> v1:172.21.15.123:6789/0 conn(0x7fb3680d23b0 legacy=0x7fb3680cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:56.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.941+0000 7fb366ffd640 1 -- 172.21.15.123:0/3700164106 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3680d3890 con 0x7fb36815ed20 2024-09-15T23:24:56.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.942+0000 7fb366ffd640 1 --2- 172.21.15.123:0/3700164106 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb36815ed20 0x7fb3680b6260 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb3580097a0 tx=0x7fb35802a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3dde5ee7acd8e9d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:56.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.942+0000 7fb3667fc640 1 -- 172.21.15.123:0/3700164106 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb358037070 con 0x7fb36815ed20 2024-09-15T23:24:56.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.942+0000 7fb3667fc640 1 -- 172.21.15.123:0/3700164106 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb35802ab10 con 0x7fb36815ed20 2024-09-15T23:24:56.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.942+0000 7fb3667fc640 1 -- 172.21.15.123:0/3700164106 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb350001840 con 0x7fb36815ed20 2024-09-15T23:24:56.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.943+0000 7fb36d7f1640 1 -- 172.21.15.123:0/3700164106 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb36815ed20 msgr2=0x7fb3680b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:56.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.943+0000 7fb36d7f1640 1 --2- 172.21.15.123:0/3700164106 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb36815ed20 0x7fb3680b6260 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb3580097a0 tx=0x7fb35802a080 comp rx=0 tx=0).stop 2024-09-15T23:24:56.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.943+0000 7fb36d7f1640 1 -- 172.21.15.123:0/3700164106 shutdown_connections 2024-09-15T23:24:56.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.943+0000 7fb36d7f1640 1 --2- 172.21.15.123:0/3700164106 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb3680b90e0 0x7fb3680b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:56.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.943+0000 7fb36d7f1640 1 --2- 172.21.15.123:0/3700164106 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb36815ed20 0x7fb3680b6260 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:56.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.943+0000 7fb36d7f1640 1 -- 172.21.15.123:0/3700164106 >> 172.21.15.123:0/3700164106 conn(0x7fb3680d1260 msgr2=0x7fb3680d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:56.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.943+0000 7fb36d7f1640 1 -- 172.21.15.123:0/3700164106 shutdown_connections 2024-09-15T23:24:56.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.943+0000 7fb36d7f1640 1 -- 172.21.15.123:0/3700164106 wait complete. 2024-09-15T23:24:56.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.944+0000 7fb36d7f1640 1 Processor -- start 2024-09-15T23:24:56.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.944+0000 7fb36d7f1640 1 -- start start 2024-09-15T23:24:56.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.945+0000 7fb36d7f1640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb3680b90e0 0x7fb36814fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:56.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.945+0000 7fb36d7f1640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3680d23b0 0x7fb3680ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:56.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.945+0000 7fb36d7f1640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb36815ed20 0x7fb3680b4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:56.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.945+0000 7fb36d7f1640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb3680d32a0 con 0x7fb3680d23b0 2024-09-15T23:24:56.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.945+0000 7fb36d7f1640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fb3680d3e50 con 0x7fb36815ed20 2024-09-15T23:24:56.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.945+0000 7fb36d7f1640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fb36815f100 con 0x7fb3680b90e0 2024-09-15T23:24:56.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.945+0000 7fb35e7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3680d23b0 0x7fb3680ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:56.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.945+0000 7fb35e7fc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3680d23b0 0x7fb3680ce0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48420/0 (socket says 172.21.15.123:48420) 2024-09-15T23:24:56.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.945+0000 7fb35e7fc640 1 -- 172.21.15.123:0/994609165 learned_addr learned my addr 172.21.15.123:0/994609165 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:56.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.945+0000 7fb366ffd640 1 --2- 172.21.15.123:0/994609165 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb3680b90e0 0x7fb36814fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:56.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.945+0000 7fb3677fe640 1 --2- 172.21.15.123:0/994609165 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb36815ed20 0x7fb3680b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:56.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.945+0000 7fb35e7fc640 1 -- 172.21.15.123:0/994609165 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb3680b90e0 msgr2=0x7fb36814fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:56.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.945+0000 7fb35e7fc640 1 --2- 172.21.15.123:0/994609165 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb3680b90e0 0x7fb36814fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:56.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.945+0000 7fb35e7fc640 1 -- 172.21.15.123:0/994609165 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb36815ed20 msgr2=0x7fb3680b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:56.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.945+0000 7fb35e7fc640 1 --2- 172.21.15.123:0/994609165 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb36815ed20 0x7fb3680b4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:56.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.946+0000 7fb35e7fc640 1 -- 172.21.15.123:0/994609165 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb368150450 con 0x7fb3680d23b0 2024-09-15T23:24:56.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.946+0000 7fb35e7fc640 1 --2- 172.21.15.123:0/994609165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3680d23b0 0x7fb3680ce0c0 secure :-1 s=READY pgs=2493 cs=0 l=1 rev1=1 crypto rx=0x7fb350001eb0 tx=0x7fb35000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:56.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.946+0000 7fb35ffff640 1 -- 172.21.15.123:0/994609165 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb350017070 con 0x7fb3680d23b0 2024-09-15T23:24:56.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.946+0000 7fb35ffff640 1 -- 172.21.15.123:0/994609165 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb350005ad0 con 0x7fb3680d23b0 2024-09-15T23:24:56.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.946+0000 7fb36d7f1640 1 -- 172.21.15.123:0/994609165 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3681f8540 con 0x7fb3680d23b0 2024-09-15T23:24:56.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.946+0000 7fb35ffff640 1 -- 172.21.15.123:0/994609165 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb350007070 con 0x7fb3680d23b0 2024-09-15T23:24:56.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.946+0000 7fb36d7f1640 1 -- 172.21.15.123:0/994609165 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3681f8b00 con 0x7fb3680d23b0 2024-09-15T23:24:56.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.947+0000 7fb36d7f1640 1 -- 172.21.15.123:0/994609165 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3680b7010 con 0x7fb3680d23b0 2024-09-15T23:24:56.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.947+0000 7fb35ffff640 1 -- 172.21.15.123:0/994609165 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb35001a070 con 0x7fb3680d23b0 2024-09-15T23:24:56.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.948+0000 7fb35ffff640 1 --2- 172.21.15.123:0/994609165 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb34806c2b0 0x7fb34806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:56.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.948+0000 7fb35ffff640 1 -- 172.21.15.123:0/994609165 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 4943+0+0 (secure 0 0 0) 0x7fb35008a5f0 con 0x7fb3680d23b0 2024-09-15T23:24:56.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.948+0000 7fb366ffd640 1 --2- 172.21.15.123:0/994609165 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb34806c2b0 0x7fb34806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:56.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.949+0000 7fb366ffd640 1 --2- 172.21.15.123:0/994609165 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb34806c2b0 0x7fb34806e770 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fb358034000 tx=0x7fb35802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:56.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:56.952+0000 7fb35ffff640 1 -- 172.21.15.123:0/994609165 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb3680d0e70 con 0x7fb3680d23b0 2024-09-15T23:24:57.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.117+0000 7fb36d7f1640 1 -- 172.21.15.123:0/994609165 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fb3681611a0 con 0x7fb34806c2b0 2024-09-15T23:24:57.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.118+0000 7fb35ffff640 1 -- 172.21.15.123:0/994609165 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb3681611a0 con 0x7fb34806c2b0 2024-09-15T23:24:57.119 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 0 to deep-scrub 2024-09-15T23:24:57.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.120+0000 7fb36d7f1640 1 -- 172.21.15.123:0/994609165 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb34806c2b0 msgr2=0x7fb34806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:57.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.120+0000 7fb36d7f1640 1 --2- 172.21.15.123:0/994609165 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb34806c2b0 0x7fb34806e770 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fb358034000 tx=0x7fb35802e000 comp rx=0 tx=0).stop 2024-09-15T23:24:57.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.120+0000 7fb36d7f1640 1 -- 172.21.15.123:0/994609165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3680d23b0 msgr2=0x7fb3680ce0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:57.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.120+0000 7fb36d7f1640 1 --2- 172.21.15.123:0/994609165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3680d23b0 0x7fb3680ce0c0 secure :-1 s=READY pgs=2493 cs=0 l=1 rev1=1 crypto rx=0x7fb350001eb0 tx=0x7fb35000cb90 comp rx=0 tx=0).stop 2024-09-15T23:24:57.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.120+0000 7fb36d7f1640 1 -- 172.21.15.123:0/994609165 shutdown_connections 2024-09-15T23:24:57.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.120+0000 7fb36d7f1640 1 --2- 172.21.15.123:0/994609165 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fb36815ed20 0x7fb3680b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:57.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.120+0000 7fb36d7f1640 1 --2- 172.21.15.123:0/994609165 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fb34806c2b0 0x7fb34806e770 secure :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fb358034000 tx=0x7fb35802e000 comp rx=0 tx=0).stop 2024-09-15T23:24:57.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.120+0000 7fb36d7f1640 1 --2- 172.21.15.123:0/994609165 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb3680d23b0 0x7fb3680ce0c0 unknown :-1 s=CLOSED pgs=2493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:57.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.120+0000 7fb36d7f1640 1 --2- 172.21.15.123:0/994609165 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fb3680b90e0 0x7fb36814fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:57.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.120+0000 7fb36d7f1640 1 -- 172.21.15.123:0/994609165 >> 172.21.15.123:0/994609165 conn(0x7fb3680d1260 msgr2=0x7fb3680ca1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:57.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.120+0000 7fb36d7f1640 1 -- 172.21.15.123:0/994609165 shutdown_connections 2024-09-15T23:24:57.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.120+0000 7fb36d7f1640 1 -- 172.21.15.123:0/994609165 wait complete. 2024-09-15T23:24:57.131 INFO:tasks.ceph:Scrubbing osd.1 2024-09-15T23:24:57.132 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-15T23:24:57.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.232+0000 7fbd53d5b640 1 Processor -- start 2024-09-15T23:24:57.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.233+0000 7fbd53d5b640 1 -- start start 2024-09-15T23:24:57.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.233+0000 7fbd53d5b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd4c15ea90 0x7fbd4c0d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:57.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.233+0000 7fbd53d5b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbd4c0d16e0 0x7fbd4c0b7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:57.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.233+0000 7fbd53d5b640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd4c0cf060 con 0x7fbd4c0d40b0 2024-09-15T23:24:57.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.233+0000 7fbd53d5b640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fbd4c0d34c0 con 0x7fbd4c0d16e0 2024-09-15T23:24:57.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.233+0000 7fbd53d5b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbd4c0cf340 con 0x7fbd4c15ea90 2024-09-15T23:24:57.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.234+0000 7fbd522f8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbd4c0d16e0 0x7fbd4c0b7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:57.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.234+0000 7fbd522f8640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbd4c0d16e0 0x7fbd4c0b7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48426/0 (socket says 172.21.15.123:48426) 2024-09-15T23:24:57.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.234+0000 7fbd522f8640 1 -- 172.21.15.123:0/3222848068 learned_addr learned my addr 172.21.15.123:0/3222848068 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:57.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.234+0000 7fbd51af7640 1 --2- 172.21.15.123:0/3222848068 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd4c15ea90 0x7fbd4c0d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:57.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.234+0000 7fbd522f8640 1 -- 172.21.15.123:0/3222848068 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd4c15ea90 msgr2=0x7fbd4c0d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:57.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.234+0000 7fbd522f8640 1 --2- 172.21.15.123:0/3222848068 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd4c15ea90 0x7fbd4c0d2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:57.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.234+0000 7fbd522f8640 1 -- 172.21.15.123:0/3222848068 >> v1:172.21.15.188:6789/0 conn(0x7fbd4c0d40b0 legacy=0x7fbd4c0d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:57.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.234+0000 7fbd522f8640 1 -- 172.21.15.123:0/3222848068 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd4c0cf620 con 0x7fbd4c0d16e0 2024-09-15T23:24:57.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.235+0000 7fbd522f8640 1 --2- 172.21.15.123:0/3222848068 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd4c0d16e0 0x7fbd4c0b7ac0 secure :-1 s=READY pgs=2494 cs=0 l=1 rev1=1 crypto rx=0x7fbd44009e50 tx=0x7fbd4402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afee268cb893cbc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:57.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.235+0000 7fbd50af5640 1 -- 172.21.15.123:0/3222848068 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd44036070 con 0x7fbd4c0d16e0 2024-09-15T23:24:57.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.235+0000 7fbd50af5640 1 -- 172.21.15.123:0/3222848068 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd44031600 con 0x7fbd4c0d16e0 2024-09-15T23:24:57.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.235+0000 7fbd50af5640 1 -- 172.21.15.123:0/3222848068 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd440319d0 con 0x7fbd4c0d16e0 2024-09-15T23:24:57.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.235+0000 7fbd53d5b640 1 -- 172.21.15.123:0/3222848068 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd4c0d16e0 msgr2=0x7fbd4c0b7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:57.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.235+0000 7fbd53d5b640 1 --2- 172.21.15.123:0/3222848068 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd4c0d16e0 0x7fbd4c0b7ac0 secure :-1 s=READY pgs=2494 cs=0 l=1 rev1=1 crypto rx=0x7fbd44009e50 tx=0x7fbd4402a710 comp rx=0 tx=0).stop 2024-09-15T23:24:57.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.235+0000 7fbd53d5b640 1 -- 172.21.15.123:0/3222848068 shutdown_connections 2024-09-15T23:24:57.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.235+0000 7fbd53d5b640 1 --2- 172.21.15.123:0/3222848068 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd4c0d16e0 0x7fbd4c0b7ac0 unknown :-1 s=CLOSED pgs=2494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:57.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.235+0000 7fbd53d5b640 1 --2- 172.21.15.123:0/3222848068 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd4c15ea90 0x7fbd4c0d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:57.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.235+0000 7fbd53d5b640 1 -- 172.21.15.123:0/3222848068 >> 172.21.15.123:0/3222848068 conn(0x7fbd4c06c0e0 msgr2=0x7fbd4c06c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:57.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.235+0000 7fbd53d5b640 1 -- 172.21.15.123:0/3222848068 shutdown_connections 2024-09-15T23:24:57.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.235+0000 7fbd53d5b640 1 -- 172.21.15.123:0/3222848068 wait complete. 2024-09-15T23:24:57.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.237+0000 7fbd53d5b640 1 Processor -- start 2024-09-15T23:24:57.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.237+0000 7fbd53d5b640 1 -- start start 2024-09-15T23:24:57.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.237+0000 7fbd53d5b640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbd4c0d16e0 0x7fbd4c15da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:57.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.237+0000 7fbd53d5b640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd4c0d40b0 0x7fbd4c0b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:57.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.237+0000 7fbd53d5b640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd4c15ea90 0x7fbd4c161560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:57.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.237+0000 7fbd53d5b640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4c15ee70 con 0x7fbd4c0d40b0 2024-09-15T23:24:57.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.237+0000 7fbd53d5b640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbd4c0cfbe0 con 0x7fbd4c0d16e0 2024-09-15T23:24:57.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.237+0000 7fbd53d5b640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbd4c0b8000 con 0x7fbd4c15ea90 2024-09-15T23:24:57.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.237+0000 7fbd512f6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd4c0d40b0 0x7fbd4c0b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:57.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.237+0000 7fbd512f6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd4c0d40b0 0x7fbd4c0b2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48434/0 (socket says 172.21.15.123:48434) 2024-09-15T23:24:57.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.237+0000 7fbd512f6640 1 -- 172.21.15.123:0/1015116656 learned_addr learned my addr 172.21.15.123:0/1015116656 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:57.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.237+0000 7fbd51af7640 1 --2- 172.21.15.123:0/1015116656 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbd4c0d16e0 0x7fbd4c15da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:57.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.237+0000 7fbd522f8640 1 --2- 172.21.15.123:0/1015116656 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd4c15ea90 0x7fbd4c161560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:57.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.238+0000 7fbd512f6640 1 -- 172.21.15.123:0/1015116656 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd4c15ea90 msgr2=0x7fbd4c161560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:57.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.238+0000 7fbd512f6640 1 --2- 172.21.15.123:0/1015116656 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbd4c15ea90 0x7fbd4c161560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:57.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.238+0000 7fbd512f6640 1 -- 172.21.15.123:0/1015116656 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbd4c0d16e0 msgr2=0x7fbd4c15da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:57.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.238+0000 7fbd512f6640 1 --2- 172.21.15.123:0/1015116656 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbd4c0d16e0 0x7fbd4c15da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:57.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.238+0000 7fbd512f6640 1 -- 172.21.15.123:0/1015116656 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd4c1f50c0 con 0x7fbd4c0d40b0 2024-09-15T23:24:57.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.238+0000 7fbd512f6640 1 --2- 172.21.15.123:0/1015116656 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd4c0d40b0 0x7fbd4c0b2d60 secure :-1 s=READY pgs=2495 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c00c440 tx=0x7fbd3c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:57.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.238+0000 7fbd427fc640 1 -- 172.21.15.123:0/1015116656 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c0052d0 con 0x7fbd4c0d40b0 2024-09-15T23:24:57.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.238+0000 7fbd427fc640 1 -- 172.21.15.123:0/1015116656 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd3c005470 con 0x7fbd4c0d40b0 2024-09-15T23:24:57.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.238+0000 7fbd427fc640 1 -- 172.21.15.123:0/1015116656 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c007260 con 0x7fbd4c0d40b0 2024-09-15T23:24:57.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.238+0000 7fbd53d5b640 1 -- 172.21.15.123:0/1015116656 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd4c1f53a0 con 0x7fbd4c0d40b0 2024-09-15T23:24:57.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.238+0000 7fbd53d5b640 1 -- 172.21.15.123:0/1015116656 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd4c1f5960 con 0x7fbd4c0d40b0 2024-09-15T23:24:57.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.239+0000 7fbd53d5b640 1 -- 172.21.15.123:0/1015116656 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbd4c0b7ac0 con 0x7fbd4c0d40b0 2024-09-15T23:24:57.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.239+0000 7fbd427fc640 1 -- 172.21.15.123:0/1015116656 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbd3c007400 con 0x7fbd4c0d40b0 2024-09-15T23:24:57.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.240+0000 7fbd427fc640 1 --2- 172.21.15.123:0/1015116656 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbd3006c2b0 0x7fbd3006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:57.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.240+0000 7fbd427fc640 1 -- 172.21.15.123:0/1015116656 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 4943+0+0 (secure 0 0 0) 0x7fbd3c08a5a0 con 0x7fbd4c0d40b0 2024-09-15T23:24:57.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.240+0000 7fbd427fc640 1 --2- 172.21.15.123:0/1015116656 >> [v2:172.21.15.123:6808/290001388,v1:172.21.15.123:6809/290001388] conn(0x7fbd30072170 0x7fbd30074590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:57.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.240+0000 7fbd427fc640 1 -- 172.21.15.123:0/1015116656 --> [v2:172.21.15.123:6808/290001388,v1:172.21.15.123:6809/290001388] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd3c009e50 con 0x7fbd30072170 2024-09-15T23:24:57.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.240+0000 7fbd427fc640 1 -- 172.21.15.123:0/1015116656 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=209) ==== 24+0+0 (secure 0 0 0) 0x7fbd3c091050 con 0x7fbd4c0d40b0 2024-09-15T23:24:57.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.240+0000 7fbd51af7640 1 --2- 172.21.15.123:0/1015116656 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbd3006c2b0 0x7fbd3006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:57.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.240+0000 7fbd522f8640 1 --2- 172.21.15.123:0/1015116656 >> [v2:172.21.15.123:6808/290001388,v1:172.21.15.123:6809/290001388] conn(0x7fbd30072170 0x7fbd30074590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:57.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.241+0000 7fbd51af7640 1 --2- 172.21.15.123:0/1015116656 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbd3006c2b0 0x7fbd3006e770 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fbd48009aa0 tx=0x7fbd48009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:57.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.241+0000 7fbd522f8640 1 --2- 172.21.15.123:0/1015116656 >> [v2:172.21.15.123:6808/290001388,v1:172.21.15.123:6809/290001388] conn(0x7fbd30072170 0x7fbd30074590 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:57.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.241+0000 7fbd427fc640 1 -- 172.21.15.123:0/1015116656 <== osd.1 v2:172.21.15.123:6808/290001388 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbd3c009e50 con 0x7fbd30072170 2024-09-15T23:24:57.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.253+0000 7fbd53d5b640 1 -- 172.21.15.123:0/1015116656 --> [v2:172.21.15.123:6808/290001388,v1:172.21.15.123:6809/290001388] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbd4c0b3e50 con 0x7fbd30072170 2024-09-15T23:24:57.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.254+0000 7fbd427fc640 1 -- 172.21.15.123:0/1015116656 <== osd.1 v2:172.21.15.123:6808/290001388 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbd4c0b3e50 con 0x7fbd30072170 2024-09-15T23:24:57.255 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:24:57.255 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T23:24:57.255 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:24:57.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.254+0000 7fbd53d5b640 1 -- 172.21.15.123:0/1015116656 >> [v2:172.21.15.123:6808/290001388,v1:172.21.15.123:6809/290001388] conn(0x7fbd30072170 msgr2=0x7fbd30074590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:57.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.254+0000 7fbd53d5b640 1 --2- 172.21.15.123:0/1015116656 >> [v2:172.21.15.123:6808/290001388,v1:172.21.15.123:6809/290001388] conn(0x7fbd30072170 0x7fbd30074590 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:57.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.254+0000 7fbd53d5b640 1 -- 172.21.15.123:0/1015116656 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbd3006c2b0 msgr2=0x7fbd3006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:57.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.254+0000 7fbd53d5b640 1 --2- 172.21.15.123:0/1015116656 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbd3006c2b0 0x7fbd3006e770 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fbd48009aa0 tx=0x7fbd48009190 comp rx=0 tx=0).stop 2024-09-15T23:24:57.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.254+0000 7fbd53d5b640 1 -- 172.21.15.123:0/1015116656 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd4c0d40b0 msgr2=0x7fbd4c0b2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:57.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.254+0000 7fbd53d5b640 1 --2- 172.21.15.123:0/1015116656 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbd4c0d40b0 0x7fbd4c0b2d60 secure :-1 s=READY pgs=2495 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c00c440 tx=0x7fbd3c001e70 comp rx=0 tx=0).stop 2024-09-15T23:24:57.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.254+0000 7fbd522f8640 1 -- 172.21.15.123:0/1015116656 reap_dead start 2024-09-15T23:24:57.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.254+0000 7fbd53d5b640 1 -- 172.21.15.123:0/1015116656 shutdown_connections 2024-09-15T23:24:57.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.254+0000 7fbd53d5b640 1 -- 172.21.15.123:0/1015116656 >> 172.21.15.123:0/1015116656 conn(0x7fbd4c06c0e0 msgr2=0x7fbd4c0d29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:57.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.254+0000 7fbd53d5b640 1 -- 172.21.15.123:0/1015116656 shutdown_connections 2024-09-15T23:24:57.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.254+0000 7fbd53d5b640 1 -- 172.21.15.123:0/1015116656 wait complete. 2024-09-15T23:24:57.266 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-15T23:24:57.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.364+0000 7fea3765e640 1 Processor -- start 2024-09-15T23:24:57.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.364+0000 7fea3765e640 1 -- start start 2024-09-15T23:24:57.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.365+0000 7fea3765e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fea301461a0 0x7fea3015d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:57.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.365+0000 7fea3765e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fea3006c320 0x7fea3006e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:57.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.365+0000 7fea3765e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea300728d0 con 0x7fea300720c0 2024-09-15T23:24:57.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.365+0000 7fea3765e640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fea3015ddc0 con 0x7fea3006c320 2024-09-15T23:24:57.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.365+0000 7fea3765e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fea30146580 con 0x7fea301461a0 2024-09-15T23:24:57.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.365+0000 7fea35bfb640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fea3006c320 0x7fea3006e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:57.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.365+0000 7fea34bf9640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fea300720c0 0x7fea3006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55104/0 (socket says 172.21.15.123:55104) 2024-09-15T23:24:57.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.365+0000 7fea353fa640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fea301461a0 0x7fea3015d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:57.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.365+0000 7fea34bf9640 1 -- 172.21.15.123:0/1162857080 learned_addr learned my addr 172.21.15.123:0/1162857080 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:57.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.365+0000 7fea35bfb640 1 -- 172.21.15.123:0/1162857080 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fea301461a0 msgr2=0x7fea3015d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:57.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.365+0000 7fea35bfb640 1 --2- 172.21.15.123:0/1162857080 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fea301461a0 0x7fea3015d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:57.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.365+0000 7fea35bfb640 1 -- 172.21.15.123:0/1162857080 >> v1:172.21.15.123:6789/0 conn(0x7fea300720c0 legacy=0x7fea3006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:57.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.365+0000 7fea27fff640 1 -- 172.21.15.123:0/1162857080 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3762895705 0 0) 0x7fea300728d0 con 0x7fea300720c0 2024-09-15T23:24:57.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.365+0000 7fea35bfb640 1 -- 172.21.15.123:0/1162857080 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea30072bb0 con 0x7fea3006c320 2024-09-15T23:24:57.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.366+0000 7fea35bfb640 1 --2- 172.21.15.123:0/1162857080 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea3006c320 0x7fea3006e550 secure :-1 s=READY pgs=2497 cs=0 l=1 rev1=1 crypto rx=0x7fea28009d90 tx=0x7fea2802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc258f581b5b678 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:57.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.366+0000 7fea27fff640 1 -- 172.21.15.123:0/1162857080 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea28007740 con 0x7fea3006c320 2024-09-15T23:24:57.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.366+0000 7fea27fff640 1 -- 172.21.15.123:0/1162857080 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea280078e0 con 0x7fea3006c320 2024-09-15T23:24:57.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.366+0000 7fea27fff640 1 -- 172.21.15.123:0/1162857080 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea28007cb0 con 0x7fea3006c320 2024-09-15T23:24:57.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.367+0000 7fea3765e640 1 -- 172.21.15.123:0/1162857080 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea3006c320 msgr2=0x7fea3006e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:57.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.367+0000 7fea3765e640 1 --2- 172.21.15.123:0/1162857080 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea3006c320 0x7fea3006e550 secure :-1 s=READY pgs=2497 cs=0 l=1 rev1=1 crypto rx=0x7fea28009d90 tx=0x7fea2802a660 comp rx=0 tx=0).stop 2024-09-15T23:24:57.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.367+0000 7fea3765e640 1 -- 172.21.15.123:0/1162857080 shutdown_connections 2024-09-15T23:24:57.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.367+0000 7fea3765e640 1 --2- 172.21.15.123:0/1162857080 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea3006c320 0x7fea3006e550 unknown :-1 s=CLOSED pgs=2497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:57.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.367+0000 7fea3765e640 1 --2- 172.21.15.123:0/1162857080 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fea301461a0 0x7fea3015d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:57.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.367+0000 7fea3765e640 1 -- 172.21.15.123:0/1162857080 >> 172.21.15.123:0/1162857080 conn(0x7fea3006cd20 msgr2=0x7fea3006d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:57.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.367+0000 7fea3765e640 1 -- 172.21.15.123:0/1162857080 shutdown_connections 2024-09-15T23:24:57.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.367+0000 7fea3765e640 1 -- 172.21.15.123:0/1162857080 wait complete. 2024-09-15T23:24:57.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.368+0000 7fea3765e640 1 Processor -- start 2024-09-15T23:24:57.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.368+0000 7fea3765e640 1 -- start start 2024-09-15T23:24:57.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.369+0000 7fea3765e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fea3006c320 0x7fea30137b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:57.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.369+0000 7fea3765e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea300720c0 0x7fea300cac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:57.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.369+0000 7fea3765e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea301461a0 0x7fea300cb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:57.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.369+0000 7fea3765e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fea30072500 con 0x7fea301461a0 2024-09-15T23:24:57.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.369+0000 7fea3765e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fea30073170 con 0x7fea300720c0 2024-09-15T23:24:57.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.369+0000 7fea3765e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fea30072680 con 0x7fea3006c320 2024-09-15T23:24:57.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.369+0000 7fea35bfb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea301461a0 0x7fea300cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:57.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.369+0000 7fea35bfb640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea301461a0 0x7fea300cb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48452/0 (socket says 172.21.15.123:48452) 2024-09-15T23:24:57.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.369+0000 7fea35bfb640 1 -- 172.21.15.123:0/2338534284 learned_addr learned my addr 172.21.15.123:0/2338534284 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:57.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.369+0000 7fea353fa640 1 --2- 172.21.15.123:0/2338534284 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fea3006c320 0x7fea30137b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:57.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.369+0000 7fea34bf9640 1 --2- 172.21.15.123:0/2338534284 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea300720c0 0x7fea300cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:57.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.369+0000 7fea35bfb640 1 -- 172.21.15.123:0/2338534284 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fea3006c320 msgr2=0x7fea30137b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:57.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.369+0000 7fea35bfb640 1 --2- 172.21.15.123:0/2338534284 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fea3006c320 0x7fea30137b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:57.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.369+0000 7fea35bfb640 1 -- 172.21.15.123:0/2338534284 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea300720c0 msgr2=0x7fea300cac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:57.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.369+0000 7fea35bfb640 1 --2- 172.21.15.123:0/2338534284 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea300720c0 0x7fea300cac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:57.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.369+0000 7fea35bfb640 1 -- 172.21.15.123:0/2338534284 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea301f2450 con 0x7fea301461a0 2024-09-15T23:24:57.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.369+0000 7fea35bfb640 1 --2- 172.21.15.123:0/2338534284 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea301461a0 0x7fea300cb160 secure :-1 s=READY pgs=2498 cs=0 l=1 rev1=1 crypto rx=0x7fea28009d90 tx=0x7fea28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:57.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.369+0000 7fea25ffb640 1 -- 172.21.15.123:0/2338534284 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea28040070 con 0x7fea301461a0 2024-09-15T23:24:57.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.369+0000 7fea25ffb640 1 -- 172.21.15.123:0/2338534284 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea28031bc0 con 0x7fea301461a0 2024-09-15T23:24:57.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.369+0000 7fea3765e640 1 -- 172.21.15.123:0/2338534284 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea301e8710 con 0x7fea301461a0 2024-09-15T23:24:57.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.369+0000 7fea25ffb640 1 -- 172.21.15.123:0/2338534284 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea28009450 con 0x7fea301461a0 2024-09-15T23:24:57.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.370+0000 7fea3765e640 1 -- 172.21.15.123:0/2338534284 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea300c8710 con 0x7fea301461a0 2024-09-15T23:24:57.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.371+0000 7fea3765e640 1 -- 172.21.15.123:0/2338534284 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea3015d840 con 0x7fea301461a0 2024-09-15T23:24:57.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.371+0000 7fea25ffb640 1 -- 172.21.15.123:0/2338534284 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fea28039040 con 0x7fea301461a0 2024-09-15T23:24:57.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.371+0000 7fea25ffb640 1 --2- 172.21.15.123:0/2338534284 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fea1406c2b0 0x7fea1406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:57.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.372+0000 7fea25ffb640 1 -- 172.21.15.123:0/2338534284 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 4943+0+0 (secure 0 0 0) 0x7fea280ac420 con 0x7fea301461a0 2024-09-15T23:24:57.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.372+0000 7fea353fa640 1 --2- 172.21.15.123:0/2338534284 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fea1406c2b0 0x7fea1406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:57.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.372+0000 7fea353fa640 1 --2- 172.21.15.123:0/2338534284 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fea1406c2b0 0x7fea1406e770 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fea2c009aa0 tx=0x7fea2c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:57.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.376+0000 7fea25ffb640 1 -- 172.21.15.123:0/2338534284 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fea2807a8d0 con 0x7fea301461a0 2024-09-15T23:24:57.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.543+0000 7fea3765e640 1 -- 172.21.15.123:0/2338534284 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fea301e89f0 con 0x7fea1406c2b0 2024-09-15T23:24:57.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.543+0000 7fea25ffb640 1 -- 172.21.15.123:0/2338534284 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fea301e89f0 con 0x7fea1406c2b0 2024-09-15T23:24:57.545 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 1 to deep-scrub 2024-09-15T23:24:57.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.545+0000 7fea3765e640 1 -- 172.21.15.123:0/2338534284 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fea1406c2b0 msgr2=0x7fea1406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:57.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.545+0000 7fea3765e640 1 --2- 172.21.15.123:0/2338534284 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fea1406c2b0 0x7fea1406e770 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fea2c009aa0 tx=0x7fea2c009190 comp rx=0 tx=0).stop 2024-09-15T23:24:57.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.545+0000 7fea3765e640 1 -- 172.21.15.123:0/2338534284 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea301461a0 msgr2=0x7fea300cb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:57.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.545+0000 7fea3765e640 1 --2- 172.21.15.123:0/2338534284 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea301461a0 0x7fea300cb160 secure :-1 s=READY pgs=2498 cs=0 l=1 rev1=1 crypto rx=0x7fea28009d90 tx=0x7fea28004a40 comp rx=0 tx=0).stop 2024-09-15T23:24:57.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.545+0000 7fea3765e640 1 -- 172.21.15.123:0/2338534284 shutdown_connections 2024-09-15T23:24:57.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.545+0000 7fea3765e640 1 --2- 172.21.15.123:0/2338534284 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fea1406c2b0 0x7fea1406e770 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:57.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.545+0000 7fea3765e640 1 --2- 172.21.15.123:0/2338534284 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea301461a0 0x7fea300cb160 unknown :-1 s=CLOSED pgs=2498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:57.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.545+0000 7fea3765e640 1 --2- 172.21.15.123:0/2338534284 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fea300720c0 0x7fea300cac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:57.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.545+0000 7fea3765e640 1 --2- 172.21.15.123:0/2338534284 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fea3006c320 0x7fea30137b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:57.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.545+0000 7fea3765e640 1 -- 172.21.15.123:0/2338534284 >> 172.21.15.123:0/2338534284 conn(0x7fea3006cd20 msgr2=0x7fea3006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:57.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.545+0000 7fea3765e640 1 -- 172.21.15.123:0/2338534284 shutdown_connections 2024-09-15T23:24:57.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.545+0000 7fea3765e640 1 -- 172.21.15.123:0/2338534284 wait complete. 2024-09-15T23:24:57.558 INFO:tasks.ceph:Scrubbing osd.2 2024-09-15T23:24:57.558 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-15T23:24:57.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.661+0000 7f1bd93d6640 1 Processor -- start 2024-09-15T23:24:57.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.661+0000 7f1bd93d6640 1 -- start start 2024-09-15T23:24:57.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.662+0000 7f1bd93d6640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1bd415ea90 0x7f1bd40d2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:57.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.662+0000 7f1bd93d6640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1bd40d4120 0x7f1bd40d0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:57.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.662+0000 7f1bd93d6640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bd40d3490 con 0x7f1bd40d1510 2024-09-15T23:24:57.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.662+0000 7f1bd93d6640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f1bd40d19a0 con 0x7f1bd415ea90 2024-09-15T23:24:57.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.662+0000 7f1bd93d6640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f1bd40cf040 con 0x7f1bd40d4120 2024-09-15T23:24:57.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.662+0000 7f1bd2ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1bd415ea90 0x7f1bd40d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:57.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.662+0000 7f1bd37fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1bd40d1510 0x7f1bd40b6210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55110/0 (socket says 172.21.15.123:55110) 2024-09-15T23:24:57.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.662+0000 7f1bd37fe640 1 -- 172.21.15.123:0/2738315890 learned_addr learned my addr 172.21.15.123:0/2738315890 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:57.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.662+0000 7f1bcbfff640 1 --2- 172.21.15.123:0/2738315890 >> v2:172.21.15.188:3300/0 conn(0x7f1bd40d4120 0x7f1bd40d0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:57.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.662+0000 7f1bd2ffd640 1 -- 172.21.15.123:0/2738315890 >> v2:172.21.15.188:3300/0 conn(0x7f1bd40d4120 msgr2=0x7f1bd40d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:57.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.662+0000 7f1bd2ffd640 1 --2- 172.21.15.123:0/2738315890 >> v2:172.21.15.188:3300/0 conn(0x7f1bd40d4120 0x7f1bd40d0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:57.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.662+0000 7f1bd2ffd640 1 -- 172.21.15.123:0/2738315890 >> v1:172.21.15.123:6789/0 conn(0x7f1bd40d1510 legacy=0x7f1bd40b6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:57.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.662+0000 7f1bd2ffd640 1 -- 172.21.15.123:0/2738315890 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd40cf320 con 0x7f1bd415ea90 2024-09-15T23:24:57.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.662+0000 7f1bd27fc640 1 -- 172.21.15.123:0/2738315890 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 125741390 0 0) 0x7f1bd40d3490 con 0x7f1bd40d1510 2024-09-15T23:24:57.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.663+0000 7f1bd2ffd640 1 --2- 172.21.15.123:0/2738315890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bd415ea90 0x7f1bd40d2f50 secure :-1 s=READY pgs=2500 cs=0 l=1 rev1=1 crypto rx=0x7f1bd40d0060 tx=0x7f1bc402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5062f3e5df91862 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:57.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.663+0000 7f1bd27fc640 1 -- 172.21.15.123:0/2738315890 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4037070 con 0x7f1bd415ea90 2024-09-15T23:24:57.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.663+0000 7f1bd27fc640 1 -- 172.21.15.123:0/2738315890 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bc4032440 con 0x7f1bd415ea90 2024-09-15T23:24:57.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.663+0000 7f1bd27fc640 1 -- 172.21.15.123:0/2738315890 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc402ae60 con 0x7f1bd415ea90 2024-09-15T23:24:57.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.664+0000 7f1bd93d6640 1 -- 172.21.15.123:0/2738315890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bd415ea90 msgr2=0x7f1bd40d2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:57.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.664+0000 7f1bd93d6640 1 --2- 172.21.15.123:0/2738315890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bd415ea90 0x7f1bd40d2f50 secure :-1 s=READY pgs=2500 cs=0 l=1 rev1=1 crypto rx=0x7f1bd40d0060 tx=0x7f1bc402a110 comp rx=0 tx=0).stop 2024-09-15T23:24:57.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.664+0000 7f1bd93d6640 1 -- 172.21.15.123:0/2738315890 shutdown_connections 2024-09-15T23:24:57.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.664+0000 7f1bd93d6640 1 --2- 172.21.15.123:0/2738315890 >> v2:172.21.15.188:3300/0 conn(0x7f1bd40d4120 0x7f1bd40d0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:57.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.664+0000 7f1bd93d6640 1 --2- 172.21.15.123:0/2738315890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bd415ea90 0x7f1bd40d2f50 unknown :-1 s=CLOSED pgs=2500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:57.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.664+0000 7f1bd93d6640 1 -- 172.21.15.123:0/2738315890 >> 172.21.15.123:0/2738315890 conn(0x7f1bd406c0e0 msgr2=0x7f1bd406c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:57.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.664+0000 7f1bd93d6640 1 -- 172.21.15.123:0/2738315890 shutdown_connections 2024-09-15T23:24:57.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.664+0000 7f1bd93d6640 1 -- 172.21.15.123:0/2738315890 wait complete. 2024-09-15T23:24:57.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.665+0000 7f1bd93d6640 1 Processor -- start 2024-09-15T23:24:57.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.665+0000 7f1bd93d6640 1 -- start start 2024-09-15T23:24:57.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.666+0000 7f1bd93d6640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1bd40d1510 0x7f1bd40b2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:57.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.666+0000 7f1bd93d6640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bd40d4120 0x7f1bd40ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:57.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.666+0000 7f1bd93d6640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1bd415ea90 0x7f1bd40b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:57.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.666+0000 7f1bd93d6640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd415ee70 con 0x7f1bd40d4120 2024-09-15T23:24:57.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.666+0000 7f1bd93d6640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd40cf8e0 con 0x7f1bd415ea90 2024-09-15T23:24:57.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.666+0000 7f1bd93d6640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f1bd40b8a60 con 0x7f1bd40d1510 2024-09-15T23:24:57.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.666+0000 7f1bcbfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bd40d4120 0x7f1bd40ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:57.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.666+0000 7f1bcbfff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bd40d4120 0x7f1bd40ccb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48476/0 (socket says 172.21.15.123:48476) 2024-09-15T23:24:57.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.666+0000 7f1bcbfff640 1 -- 172.21.15.123:0/1721416961 learned_addr learned my addr 172.21.15.123:0/1721416961 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:57.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.666+0000 7f1bd37fe640 1 --2- 172.21.15.123:0/1721416961 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1bd415ea90 0x7f1bd40b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:57.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.666+0000 7f1bcbfff640 1 -- 172.21.15.123:0/1721416961 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1bd40d1510 msgr2=0x7f1bd40b2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:57.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.666+0000 7f1bcbfff640 1 --2- 172.21.15.123:0/1721416961 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f1bd40d1510 0x7f1bd40b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:57.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.666+0000 7f1bcbfff640 1 -- 172.21.15.123:0/1721416961 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1bd415ea90 msgr2=0x7f1bd40b61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:57.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.666+0000 7f1bcbfff640 1 --2- 172.21.15.123:0/1721416961 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1bd415ea90 0x7f1bd40b61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:57.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.666+0000 7f1bcbfff640 1 -- 172.21.15.123:0/1721416961 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd40cbab0 con 0x7f1bd40d4120 2024-09-15T23:24:57.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.666+0000 7f1bcbfff640 1 --2- 172.21.15.123:0/1721416961 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bd40d4120 0x7f1bd40ccb50 secure :-1 s=READY pgs=2501 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc00e9b0 tx=0x7f1bbc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:57.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.666+0000 7f1bcb7fe640 1 -- 172.21.15.123:0/1721416961 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc017070 con 0x7f1bd40d4120 2024-09-15T23:24:57.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.666+0000 7f1bcb7fe640 1 -- 172.21.15.123:0/1721416961 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bbc00c9a0 con 0x7f1bd40d4120 2024-09-15T23:24:57.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.666+0000 7f1bcb7fe640 1 -- 172.21.15.123:0/1721416961 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc00cd70 con 0x7f1bd40d4120 2024-09-15T23:24:57.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.666+0000 7f1bd93d6640 1 -- 172.21.15.123:0/1721416961 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bd40cbd90 con 0x7f1bd40d4120 2024-09-15T23:24:57.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.666+0000 7f1bd93d6640 1 -- 172.21.15.123:0/1721416961 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bd40cc350 con 0x7f1bd40d4120 2024-09-15T23:24:57.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.667+0000 7f1bd93d6640 1 -- 172.21.15.123:0/1721416961 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1bd40cb860 con 0x7f1bd40d4120 2024-09-15T23:24:57.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.668+0000 7f1bcb7fe640 1 -- 172.21.15.123:0/1721416961 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1bbc01a070 con 0x7f1bd40d4120 2024-09-15T23:24:57.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.668+0000 7f1bcb7fe640 1 --2- 172.21.15.123:0/1721416961 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1bb406c2e0 0x7f1bb406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:57.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.668+0000 7f1bcb7fe640 1 -- 172.21.15.123:0/1721416961 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 4943+0+0 (secure 0 0 0) 0x7f1bbc08b2d0 con 0x7f1bd40d4120 2024-09-15T23:24:57.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.668+0000 7f1bcb7fe640 1 --2- 172.21.15.123:0/1721416961 >> [v2:172.21.15.123:6800/256503513,v1:172.21.15.123:6801/256503513] conn(0x7f1bb40721a0 0x7f1bb40745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:57.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.668+0000 7f1bcb7fe640 1 -- 172.21.15.123:0/1721416961 --> [v2:172.21.15.123:6800/256503513,v1:172.21.15.123:6801/256503513] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1bbc016ec0 con 0x7f1bb40721a0 2024-09-15T23:24:57.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.668+0000 7f1bcb7fe640 1 -- 172.21.15.123:0/1721416961 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=209) ==== 24+0+0 (secure 0 0 0) 0x7f1bbc092050 con 0x7f1bd40d4120 2024-09-15T23:24:57.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.668+0000 7f1bd2ffd640 1 --2- 172.21.15.123:0/1721416961 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1bb406c2e0 0x7f1bb406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:57.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.669+0000 7f1bd37fe640 1 --2- 172.21.15.123:0/1721416961 >> [v2:172.21.15.123:6800/256503513,v1:172.21.15.123:6801/256503513] conn(0x7f1bb40721a0 0x7f1bb40745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:57.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.669+0000 7f1bd37fe640 1 --2- 172.21.15.123:0/1721416961 >> [v2:172.21.15.123:6800/256503513,v1:172.21.15.123:6801/256503513] conn(0x7f1bb40721a0 0x7f1bb40745c0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:57.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.669+0000 7f1bd2ffd640 1 --2- 172.21.15.123:0/1721416961 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1bb406c2e0 0x7f1bb406e7a0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4034000 tx=0x7f1bc402c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:57.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.669+0000 7f1bcb7fe640 1 -- 172.21.15.123:0/1721416961 <== osd.2 v2:172.21.15.123:6800/256503513 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1bbc016ec0 con 0x7f1bb40721a0 2024-09-15T23:24:57.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.682+0000 7f1bd93d6640 1 -- 172.21.15.123:0/1721416961 --> [v2:172.21.15.123:6800/256503513,v1:172.21.15.123:6801/256503513] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1bd406c770 con 0x7f1bb40721a0 2024-09-15T23:24:57.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.682+0000 7f1bcb7fe640 1 -- 172.21.15.123:0/1721416961 <== osd.2 v2:172.21.15.123:6800/256503513 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1bd406c770 con 0x7f1bb40721a0 2024-09-15T23:24:57.683 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:24:57.683 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T23:24:57.684 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:24:57.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.682+0000 7f1bd93d6640 1 -- 172.21.15.123:0/1721416961 >> [v2:172.21.15.123:6800/256503513,v1:172.21.15.123:6801/256503513] conn(0x7f1bb40721a0 msgr2=0x7f1bb40745c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:57.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.682+0000 7f1bd93d6640 1 --2- 172.21.15.123:0/1721416961 >> [v2:172.21.15.123:6800/256503513,v1:172.21.15.123:6801/256503513] conn(0x7f1bb40721a0 0x7f1bb40745c0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:57.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.682+0000 7f1bd93d6640 1 -- 172.21.15.123:0/1721416961 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1bb406c2e0 msgr2=0x7f1bb406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:57.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.682+0000 7f1bd93d6640 1 --2- 172.21.15.123:0/1721416961 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f1bb406c2e0 0x7f1bb406e7a0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4034000 tx=0x7f1bc402c000 comp rx=0 tx=0).stop 2024-09-15T23:24:57.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.682+0000 7f1bd93d6640 1 -- 172.21.15.123:0/1721416961 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bd40d4120 msgr2=0x7f1bd40ccb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:57.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.682+0000 7f1bd93d6640 1 --2- 172.21.15.123:0/1721416961 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1bd40d4120 0x7f1bd40ccb50 secure :-1 s=READY pgs=2501 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc00e9b0 tx=0x7f1bbc00ee70 comp rx=0 tx=0).stop 2024-09-15T23:24:57.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.682+0000 7f1bd37fe640 1 -- 172.21.15.123:0/1721416961 reap_dead start 2024-09-15T23:24:57.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.682+0000 7f1bd93d6640 1 -- 172.21.15.123:0/1721416961 shutdown_connections 2024-09-15T23:24:57.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.682+0000 7f1bd93d6640 1 -- 172.21.15.123:0/1721416961 >> 172.21.15.123:0/1721416961 conn(0x7f1bd406c0e0 msgr2=0x7f1bd415db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:57.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.682+0000 7f1bd93d6640 1 -- 172.21.15.123:0/1721416961 shutdown_connections 2024-09-15T23:24:57.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.682+0000 7f1bd93d6640 1 -- 172.21.15.123:0/1721416961 wait complete. 2024-09-15T23:24:57.694 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-15T23:24:57.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.792+0000 7fa74ee23640 1 Processor -- start 2024-09-15T23:24:57.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.792+0000 7fa74ee23640 1 -- start start 2024-09-15T23:24:57.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.793+0000 7fa74ee23640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa74806fe40 0x7fa748073a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:57.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.793+0000 7fa74ee23640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7481631c0 con 0x7fa748162c60 2024-09-15T23:24:57.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.793+0000 7fa74ee23640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7480ae9a0 con 0x7fa74815e790 2024-09-15T23:24:57.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.793+0000 7fa74ee23640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fa74815eb70 con 0x7fa74806fe40 2024-09-15T23:24:57.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.793+0000 7fa73ffff640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa748162c60 0x7fa74806f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55112/0 (socket says 172.21.15.123:55112) 2024-09-15T23:24:57.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.793+0000 7fa73ffff640 1 -- 172.21.15.123:0/3369474111 learned_addr learned my addr 172.21.15.123:0/3369474111 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:57.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.793+0000 7fa73f7fe640 1 -- 172.21.15.123:0/3369474111 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3547433036 0 0) 0x7fa7481631c0 con 0x7fa748162c60 2024-09-15T23:24:57.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.793+0000 7fa73f7fe640 1 -- 172.21.15.123:0/3369474111 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa730003520 con 0x7fa748162c60 2024-09-15T23:24:57.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.793+0000 7fa73f7fe640 1 -- 172.21.15.123:0/3369474111 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4119827384 0 0) 0x7fa730003520 con 0x7fa748162c60 2024-09-15T23:24:57.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.793+0000 7fa73f7fe640 1 -- 172.21.15.123:0/3369474111 >> v2:172.21.15.188:3300/0 conn(0x7fa74806fe40 msgr2=0x7fa748073a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:57.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.793+0000 7fa73f7fe640 1 --2- 172.21.15.123:0/3369474111 >> v2:172.21.15.188:3300/0 conn(0x7fa74806fe40 0x7fa748073a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:57.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.793+0000 7fa73f7fe640 1 -- 172.21.15.123:0/3369474111 >> v1:172.21.15.188:6789/0 conn(0x7fa74815e790 legacy=0x7fa7480b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:57.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.793+0000 7fa73f7fe640 1 -- 172.21.15.123:0/3369474111 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7480aec40 con 0x7fa748162c60 2024-09-15T23:24:57.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.793+0000 7fa73f7fe640 1 -- 172.21.15.123:0/3369474111 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fa738001670 con 0x7fa748162c60 2024-09-15T23:24:57.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.793+0000 7fa73f7fe640 1 -- 172.21.15.123:0/3369474111 >> v1:172.21.15.123:6789/0 conn(0x7fa748162c60 legacy=0x7fa74806f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:57.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.793+0000 7fa73f7fe640 1 --2- 172.21.15.123:0/3369474111 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7300039b0 0x7fa730003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:57.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.793+0000 7fa73f7fe640 1 --2- 172.21.15.123:0/3369474111 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa730004800 0x7fa730004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:57.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.794+0000 7fa73f7fe640 1 --2- 172.21.15.123:0/3369474111 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7300053c0 0x7fa73000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:57.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.794+0000 7fa73f7fe640 1 -- 172.21.15.123:0/3369474111 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa73000c230 con 0x7fa7300053c0 2024-09-15T23:24:57.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.794+0000 7fa73f7fe640 1 -- 172.21.15.123:0/3369474111 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa73000c3e0 con 0x7fa730004800 2024-09-15T23:24:57.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.794+0000 7fa73f7fe640 1 -- 172.21.15.123:0/3369474111 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa73000c5e0 con 0x7fa7300039b0 2024-09-15T23:24:57.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.794+0000 7fa74d3c0640 1 --2- 172.21.15.123:0/3369474111 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7300053c0 0x7fa73000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:57.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.794+0000 7fa73ffff640 1 --2- 172.21.15.123:0/3369474111 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa730004800 0x7fa730004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:57.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.794+0000 7fa74cbbf640 1 --2- 172.21.15.123:0/3369474111 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7300039b0 0x7fa730003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:57.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.794+0000 7fa74d3c0640 1 -- 172.21.15.123:0/3369474111 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7300039b0 msgr2=0x7fa730003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:57.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.794+0000 7fa74d3c0640 1 --2- 172.21.15.123:0/3369474111 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa7300039b0 0x7fa730003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:57.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.794+0000 7fa74d3c0640 1 -- 172.21.15.123:0/3369474111 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa730004800 msgr2=0x7fa730004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:57.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.794+0000 7fa74d3c0640 1 --2- 172.21.15.123:0/3369474111 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa730004800 0x7fa730004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:57.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.794+0000 7fa74d3c0640 1 -- 172.21.15.123:0/3369474111 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa730003520 con 0x7fa7300053c0 2024-09-15T23:24:57.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.795+0000 7fa74d3c0640 1 -- 172.21.15.123:0/3369474111 reap_dead start 2024-09-15T23:24:57.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.795+0000 7fa74d3c0640 1 --2- 172.21.15.123:0/3369474111 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7300053c0 0x7fa73000b9c0 secure :-1 s=READY pgs=2503 cs=0 l=1 rev1=1 crypto rx=0x7fa740009860 tx=0x7fa730005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d9548969168a4c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:57.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.795+0000 7fa73f7fe640 1 -- 172.21.15.123:0/3369474111 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa740009460 con 0x7fa7300053c0 2024-09-15T23:24:57.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.795+0000 7fa73f7fe640 1 -- 172.21.15.123:0/3369474111 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa740004240 con 0x7fa7300053c0 2024-09-15T23:24:57.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.795+0000 7fa73f7fe640 1 -- 172.21.15.123:0/3369474111 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa74002a880 con 0x7fa7300053c0 2024-09-15T23:24:57.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.795+0000 7fa74ee23640 1 -- 172.21.15.123:0/3369474111 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7300053c0 msgr2=0x7fa73000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:57.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.795+0000 7fa74ee23640 1 --2- 172.21.15.123:0/3369474111 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7300053c0 0x7fa73000b9c0 secure :-1 s=READY pgs=2503 cs=0 l=1 rev1=1 crypto rx=0x7fa740009860 tx=0x7fa730005830 comp rx=0 tx=0).stop 2024-09-15T23:24:57.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.795+0000 7fa74ee23640 1 -- 172.21.15.123:0/3369474111 shutdown_connections 2024-09-15T23:24:57.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.795+0000 7fa74ee23640 1 --2- 172.21.15.123:0/3369474111 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7300053c0 0x7fa73000b9c0 unknown :-1 s=CLOSED pgs=2503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:57.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.795+0000 7fa74ee23640 1 -- 172.21.15.123:0/3369474111 >> 172.21.15.123:0/3369474111 conn(0x7fa7480b0a80 msgr2=0x7fa7480b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:57.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.795+0000 7fa74ee23640 1 -- 172.21.15.123:0/3369474111 shutdown_connections 2024-09-15T23:24:57.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.795+0000 7fa74ee23640 1 -- 172.21.15.123:0/3369474111 wait complete. 2024-09-15T23:24:57.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.796+0000 7fa74ee23640 1 Processor -- start 2024-09-15T23:24:57.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.797+0000 7fa74ee23640 1 -- start start 2024-09-15T23:24:57.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.797+0000 7fa74ee23640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7300053c0 0x7fa74815ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:57.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.797+0000 7fa74ee23640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa74815bfd0 0x7fa748149430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:57.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.797+0000 7fa74ee23640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa748149970 0x7fa7480cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:57.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.797+0000 7fa74ee23640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa74806f430 con 0x7fa7300053c0 2024-09-15T23:24:57.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.797+0000 7fa74ee23640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa7480af200 con 0x7fa748149970 2024-09-15T23:24:57.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.797+0000 7fa74ee23640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa748073a40 con 0x7fa74815bfd0 2024-09-15T23:24:57.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.797+0000 7fa74cbbf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7300053c0 0x7fa74815ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:57.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.797+0000 7fa74cbbf640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7300053c0 0x7fa74815ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48484/0 (socket says 172.21.15.123:48484) 2024-09-15T23:24:57.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.797+0000 7fa74cbbf640 1 -- 172.21.15.123:0/2679107977 learned_addr learned my addr 172.21.15.123:0/2679107977 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:57.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.798+0000 7fa73ffff640 1 --2- 172.21.15.123:0/2679107977 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa74815bfd0 0x7fa748149430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.798+0000 7fa74d3c0640 1 --2- 172.21.15.123:0/2679107977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa748149970 0x7fa7480cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.798+0000 7fa74cbbf640 1 -- 172.21.15.123:0/2679107977 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa74815bfd0 msgr2=0x7fa748149430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.798+0000 7fa74cbbf640 1 --2- 172.21.15.123:0/2679107977 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa74815bfd0 0x7fa748149430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.798+0000 7fa74cbbf640 1 -- 172.21.15.123:0/2679107977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa748149970 msgr2=0x7fa7480cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.798+0000 7fa74cbbf640 1 --2- 172.21.15.123:0/2679107977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa748149970 0x7fa7480cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.798+0000 7fa74cbbf640 1 -- 172.21.15.123:0/2679107977 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7481588a0 con 0x7fa7300053c0 2024-09-15T23:24:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.798+0000 7fa73ffff640 1 --2- 172.21.15.123:0/2679107977 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa74815bfd0 0x7fa748149430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:24:57.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.798+0000 7fa74cbbf640 1 --2- 172.21.15.123:0/2679107977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7300053c0 0x7fa74815ba90 secure :-1 s=READY pgs=2504 cs=0 l=1 rev1=1 crypto rx=0x7fa744002230 tx=0x7fa74400fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:57.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.798+0000 7fa73d7fa640 1 -- 172.21.15.123:0/2679107977 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa744003b80 con 0x7fa7300053c0 2024-09-15T23:24:57.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.798+0000 7fa73d7fa640 1 -- 172.21.15.123:0/2679107977 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa744018070 con 0x7fa7300053c0 2024-09-15T23:24:57.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.798+0000 7fa74ee23640 1 -- 172.21.15.123:0/2679107977 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa748158b10 con 0x7fa7300053c0 2024-09-15T23:24:57.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.798+0000 7fa73d7fa640 1 -- 172.21.15.123:0/2679107977 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa74400d7f0 con 0x7fa7300053c0 2024-09-15T23:24:57.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.798+0000 7fa74ee23640 1 -- 172.21.15.123:0/2679107977 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7481590d0 con 0x7fa7300053c0 2024-09-15T23:24:57.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.799+0000 7fa74ee23640 1 -- 172.21.15.123:0/2679107977 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7481592d0 con 0x7fa7300053c0 2024-09-15T23:24:57.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.799+0000 7fa73d7fa640 1 -- 172.21.15.123:0/2679107977 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa74400d990 con 0x7fa7300053c0 2024-09-15T23:24:57.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.800+0000 7fa73d7fa640 1 --2- 172.21.15.123:0/2679107977 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa73406c2e0 0x7fa73406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:57.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.800+0000 7fa73d7fa640 1 -- 172.21.15.123:0/2679107977 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 4943+0+0 (secure 0 0 0) 0x7fa74408b220 con 0x7fa7300053c0 2024-09-15T23:24:57.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.800+0000 7fa73ffff640 1 --2- 172.21.15.123:0/2679107977 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa73406c2e0 0x7fa73406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:57.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.801+0000 7fa73ffff640 1 --2- 172.21.15.123:0/2679107977 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa73406c2e0 0x7fa73406e7a0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fa748149f50 tx=0x7fa738009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:57.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.804+0000 7fa73d7fa640 1 -- 172.21.15.123:0/2679107977 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa7481592d0 con 0x7fa7300053c0 2024-09-15T23:24:57.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.969+0000 7fa74ee23640 1 -- 172.21.15.123:0/2679107977 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fa7480b1ec0 con 0x7fa73406c2e0 2024-09-15T23:24:57.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.970+0000 7fa73d7fa640 1 -- 172.21.15.123:0/2679107977 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa7480b1ec0 con 0x7fa73406c2e0 2024-09-15T23:24:57.971 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 2 to deep-scrub 2024-09-15T23:24:57.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.972+0000 7fa74ee23640 1 -- 172.21.15.123:0/2679107977 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa73406c2e0 msgr2=0x7fa73406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:57.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.972+0000 7fa74ee23640 1 --2- 172.21.15.123:0/2679107977 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa73406c2e0 0x7fa73406e7a0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fa748149f50 tx=0x7fa738009040 comp rx=0 tx=0).stop 2024-09-15T23:24:57.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.972+0000 7fa74ee23640 1 -- 172.21.15.123:0/2679107977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7300053c0 msgr2=0x7fa74815ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:57.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.972+0000 7fa74ee23640 1 --2- 172.21.15.123:0/2679107977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7300053c0 0x7fa74815ba90 secure :-1 s=READY pgs=2504 cs=0 l=1 rev1=1 crypto rx=0x7fa744002230 tx=0x7fa74400fe10 comp rx=0 tx=0).stop 2024-09-15T23:24:57.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.972+0000 7fa74ee23640 1 -- 172.21.15.123:0/2679107977 shutdown_connections 2024-09-15T23:24:57.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.972+0000 7fa74ee23640 1 --2- 172.21.15.123:0/2679107977 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa748149970 0x7fa7480cf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:57.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.972+0000 7fa74ee23640 1 --2- 172.21.15.123:0/2679107977 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa74815bfd0 0x7fa748149430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:57.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.972+0000 7fa74ee23640 1 --2- 172.21.15.123:0/2679107977 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa73406c2e0 0x7fa73406e7a0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:57.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.972+0000 7fa74ee23640 1 --2- 172.21.15.123:0/2679107977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa7300053c0 0x7fa74815ba90 unknown :-1 s=CLOSED pgs=2504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:57.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.972+0000 7fa74ee23640 1 -- 172.21.15.123:0/2679107977 >> 172.21.15.123:0/2679107977 conn(0x7fa7480b0a80 msgr2=0x7fa7480d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:57.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.972+0000 7fa74ee23640 1 -- 172.21.15.123:0/2679107977 shutdown_connections 2024-09-15T23:24:57.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:57.972+0000 7fa74ee23640 1 -- 172.21.15.123:0/2679107977 wait complete. 2024-09-15T23:24:57.984 INFO:tasks.ceph:Scrubbing osd.3 2024-09-15T23:24:57.984 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-15T23:24:58.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.086+0000 7fa89f1f8640 1 Processor -- start 2024-09-15T23:24:58.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.086+0000 7fa89f1f8640 1 -- start start 2024-09-15T23:24:58.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.087+0000 7fa89f1f8640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa8980d16e0 0x7fa8980d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:58.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.087+0000 7fa89f1f8640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8980d40b0 0x7fa8980b7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:58.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.087+0000 7fa89f1f8640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8980cf060 con 0x7fa89815ea90 2024-09-15T23:24:58.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.087+0000 7fa89f1f8640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fa8980d34c0 con 0x7fa8980d16e0 2024-09-15T23:24:58.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.087+0000 7fa89f1f8640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa8980cf340 con 0x7fa8980d40b0 2024-09-15T23:24:58.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.087+0000 7fa89d795640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8980d40b0 0x7fa8980b7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:58.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.087+0000 7fa897fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa8980d16e0 0x7fa8980d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:58.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.088+0000 7fa89d795640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8980d40b0 0x7fa8980b7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3301/0 says I am v2:172.21.15.123:52606/0 (socket says 172.21.15.123:52606) 2024-09-15T23:24:58.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.088+0000 7fa897fff640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fa8980d16e0 0x7fa8980d2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.188:3300/0 says I am v2:172.21.15.123:47568/0 (socket says 172.21.15.123:47568) 2024-09-15T23:24:58.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.088+0000 7fa89d795640 1 -- 172.21.15.123:0/3614191492 learned_addr learned my addr 172.21.15.123:0/3614191492 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:58.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.088+0000 7fa89cf94640 1 --1- 172.21.15.123:0/3614191492 >> v1:172.21.15.188:6789/0 conn(0x7fa89815ea90 0x7fa8980d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.123:56066/0 (socket says 172.21.15.123:56066) 2024-09-15T23:24:58.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.088+0000 7fa897fff640 1 -- 172.21.15.123:0/3614191492 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8980d40b0 msgr2=0x7fa8980b7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:58.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.088+0000 7fa897fff640 1 --2- 172.21.15.123:0/3614191492 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8980d40b0 0x7fa8980b7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.088+0000 7fa897fff640 1 -- 172.21.15.123:0/3614191492 >> v1:172.21.15.188:6789/0 conn(0x7fa89815ea90 legacy=0x7fa8980d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:58.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.088+0000 7fa897fff640 1 -- 172.21.15.123:0/3614191492 --> v2:172.21.15.188:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8980cf620 con 0x7fa8980d16e0 2024-09-15T23:24:58.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.088+0000 7fa89d795640 1 --2- 172.21.15.123:0/3614191492 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8980d40b0 0x7fa8980b7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:24:58.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.089+0000 7fa897fff640 1 --2- 172.21.15.123:0/3614191492 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8980d16e0 0x7fa8980d2f80 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fa88c009d90 tx=0x7fa88c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=737adf3841c02e88 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:58.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.089+0000 7fa8977fe640 1 -- 172.21.15.123:0/3614191492 <== mon.1 v2:172.21.15.188:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88c007740 con 0x7fa8980d16e0 2024-09-15T23:24:58.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.089+0000 7fa8977fe640 1 -- 172.21.15.123:0/3614191492 <== mon.1 v2:172.21.15.188:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa88c0078e0 con 0x7fa8980d16e0 2024-09-15T23:24:58.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.089+0000 7fa8977fe640 1 -- 172.21.15.123:0/3614191492 <== mon.1 v2:172.21.15.188:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88c007cb0 con 0x7fa8980d16e0 2024-09-15T23:24:58.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.089+0000 7fa89f1f8640 1 -- 172.21.15.123:0/3614191492 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8980d16e0 msgr2=0x7fa8980d2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:58.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.089+0000 7fa89f1f8640 1 --2- 172.21.15.123:0/3614191492 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8980d16e0 0x7fa8980d2f80 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fa88c009d90 tx=0x7fa88c02a660 comp rx=0 tx=0).stop 2024-09-15T23:24:58.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.089+0000 7fa89f1f8640 1 -- 172.21.15.123:0/3614191492 shutdown_connections 2024-09-15T23:24:58.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.089+0000 7fa89f1f8640 1 --2- 172.21.15.123:0/3614191492 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8980d16e0 0x7fa8980d2f80 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.089+0000 7fa89f1f8640 1 --2- 172.21.15.123:0/3614191492 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa8980d40b0 0x7fa8980b7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.089+0000 7fa89f1f8640 1 -- 172.21.15.123:0/3614191492 >> 172.21.15.123:0/3614191492 conn(0x7fa89806c0e0 msgr2=0x7fa89806c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:58.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.089+0000 7fa89f1f8640 1 -- 172.21.15.123:0/3614191492 shutdown_connections 2024-09-15T23:24:58.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.089+0000 7fa89f1f8640 1 -- 172.21.15.123:0/3614191492 wait complete. 2024-09-15T23:24:58.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.090+0000 7fa89f1f8640 1 Processor -- start 2024-09-15T23:24:58.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.090+0000 7fa89f1f8640 1 -- start start 2024-09-15T23:24:58.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.091+0000 7fa89f1f8640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8980d16e0 0x7fa8981e8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:58.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.091+0000 7fa89f1f8640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8980d40b0 0x7fa8981e8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:58.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.091+0000 7fa89f1f8640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa89815ea90 0x7fa8981e9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:58.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.091+0000 7fa89f1f8640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa89815ee70 con 0x7fa8980d16e0 2024-09-15T23:24:58.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.091+0000 7fa89f1f8640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fa8980cfbe0 con 0x7fa8980d40b0 2024-09-15T23:24:58.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.091+0000 7fa89f1f8640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fa8980b8000 con 0x7fa89815ea90 2024-09-15T23:24:58.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.091+0000 7fa89cf94640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8980d16e0 0x7fa8981e8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:58.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.091+0000 7fa89cf94640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8980d16e0 0x7fa8981e8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48492/0 (socket says 172.21.15.123:48492) 2024-09-15T23:24:58.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.091+0000 7fa89cf94640 1 -- 172.21.15.123:0/2859195761 learned_addr learned my addr 172.21.15.123:0/2859195761 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:58.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.092+0000 7fa897fff640 1 --2- 172.21.15.123:0/2859195761 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8980d40b0 0x7fa8981e8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:58.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.092+0000 7fa89d795640 1 --2- 172.21.15.123:0/2859195761 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa89815ea90 0x7fa8981e9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:58.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.092+0000 7fa89cf94640 1 -- 172.21.15.123:0/2859195761 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa89815ea90 msgr2=0x7fa8981e9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:58.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.092+0000 7fa89cf94640 1 --2- 172.21.15.123:0/2859195761 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fa89815ea90 0x7fa8981e9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.092+0000 7fa89cf94640 1 -- 172.21.15.123:0/2859195761 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8980d40b0 msgr2=0x7fa8981e8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:58.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.092+0000 7fa89cf94640 1 --2- 172.21.15.123:0/2859195761 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fa8980d40b0 0x7fa8981e8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.092+0000 7fa89cf94640 1 -- 172.21.15.123:0/2859195761 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8980cbfd0 con 0x7fa8980d16e0 2024-09-15T23:24:58.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.092+0000 7fa89cf94640 1 --2- 172.21.15.123:0/2859195761 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8980d16e0 0x7fa8981e8ab0 secure :-1 s=READY pgs=2505 cs=0 l=1 rev1=1 crypto rx=0x7fa88800c3f0 tx=0x7fa88800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:58.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.092+0000 7fa8957fa640 1 -- 172.21.15.123:0/2859195761 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8880074e0 con 0x7fa8980d16e0 2024-09-15T23:24:58.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.092+0000 7fa8957fa640 1 -- 172.21.15.123:0/2859195761 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa888007680 con 0x7fa8980d16e0 2024-09-15T23:24:58.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.092+0000 7fa89f1f8640 1 -- 172.21.15.123:0/2859195761 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa89815f630 con 0x7fa8980d16e0 2024-09-15T23:24:58.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.092+0000 7fa8957fa640 1 -- 172.21.15.123:0/2859195761 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa888004a00 con 0x7fa8980d16e0 2024-09-15T23:24:58.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.092+0000 7fa89f1f8640 1 -- 172.21.15.123:0/2859195761 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa898147580 con 0x7fa8980d16e0 2024-09-15T23:24:58.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.093+0000 7fa89f1f8640 1 -- 172.21.15.123:0/2859195761 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa89815f3e0 con 0x7fa8980d16e0 2024-09-15T23:24:58.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.093+0000 7fa8957fa640 1 -- 172.21.15.123:0/2859195761 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa88801a020 con 0x7fa8980d16e0 2024-09-15T23:24:58.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.094+0000 7fa8957fa640 1 --2- 172.21.15.123:0/2859195761 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa88406c2b0 0x7fa88406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:58.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.094+0000 7fa8957fa640 1 -- 172.21.15.123:0/2859195761 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 4943+0+0 (secure 0 0 0) 0x7fa88808a830 con 0x7fa8980d16e0 2024-09-15T23:24:58.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.094+0000 7fa8957fa640 1 --2- 172.21.15.123:0/2859195761 >> [v2:172.21.15.123:6824/829220507,v1:172.21.15.123:6825/829220507] conn(0x7fa884072170 0x7fa884074590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:58.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.094+0000 7fa897fff640 1 --2- 172.21.15.123:0/2859195761 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa88406c2b0 0x7fa88406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:58.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.094+0000 7fa8957fa640 1 -- 172.21.15.123:0/2859195761 --> [v2:172.21.15.123:6824/829220507,v1:172.21.15.123:6825/829220507] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa884074c40 con 0x7fa884072170 2024-09-15T23:24:58.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.094+0000 7fa8957fa640 1 -- 172.21.15.123:0/2859195761 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=209) ==== 24+0+0 (secure 0 0 0) 0x7fa888091050 con 0x7fa8980d16e0 2024-09-15T23:24:58.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.094+0000 7fa89d795640 1 --2- 172.21.15.123:0/2859195761 >> [v2:172.21.15.123:6824/829220507,v1:172.21.15.123:6825/829220507] conn(0x7fa884072170 0x7fa884074590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:58.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.095+0000 7fa89d795640 1 --2- 172.21.15.123:0/2859195761 >> [v2:172.21.15.123:6824/829220507,v1:172.21.15.123:6825/829220507] conn(0x7fa884072170 0x7fa884074590 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:58.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.095+0000 7fa897fff640 1 --2- 172.21.15.123:0/2859195761 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa88406c2b0 0x7fa88406e770 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fa88c034000 tx=0x7fa88c02f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:58.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.095+0000 7fa8957fa640 1 -- 172.21.15.123:0/2859195761 <== osd.3 v2:172.21.15.123:6824/829220507 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa884074c40 con 0x7fa884072170 2024-09-15T23:24:58.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.107+0000 7fa89f1f8640 1 -- 172.21.15.123:0/2859195761 --> [v2:172.21.15.123:6824/829220507,v1:172.21.15.123:6825/829220507] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa8980d2f80 con 0x7fa884072170 2024-09-15T23:24:58.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.108+0000 7fa8957fa640 1 -- 172.21.15.123:0/2859195761 <== osd.3 v2:172.21.15.123:6824/829220507 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa8980d2f80 con 0x7fa884072170 2024-09-15T23:24:58.109 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:24:58.109 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T23:24:58.109 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:24:58.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.108+0000 7fa89f1f8640 1 -- 172.21.15.123:0/2859195761 >> [v2:172.21.15.123:6824/829220507,v1:172.21.15.123:6825/829220507] conn(0x7fa884072170 msgr2=0x7fa884074590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:58.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.108+0000 7fa89f1f8640 1 --2- 172.21.15.123:0/2859195761 >> [v2:172.21.15.123:6824/829220507,v1:172.21.15.123:6825/829220507] conn(0x7fa884072170 0x7fa884074590 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.108+0000 7fa89f1f8640 1 -- 172.21.15.123:0/2859195761 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa88406c2b0 msgr2=0x7fa88406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:58.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.108+0000 7fa89f1f8640 1 --2- 172.21.15.123:0/2859195761 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fa88406c2b0 0x7fa88406e770 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fa88c034000 tx=0x7fa88c02f000 comp rx=0 tx=0).stop 2024-09-15T23:24:58.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.108+0000 7fa89f1f8640 1 -- 172.21.15.123:0/2859195761 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8980d16e0 msgr2=0x7fa8981e8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:58.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.108+0000 7fa89f1f8640 1 --2- 172.21.15.123:0/2859195761 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8980d16e0 0x7fa8981e8ab0 secure :-1 s=READY pgs=2505 cs=0 l=1 rev1=1 crypto rx=0x7fa88800c3f0 tx=0x7fa88800c8b0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.108+0000 7fa89d795640 1 -- 172.21.15.123:0/2859195761 reap_dead start 2024-09-15T23:24:58.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.108+0000 7fa89f1f8640 1 -- 172.21.15.123:0/2859195761 shutdown_connections 2024-09-15T23:24:58.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.108+0000 7fa89f1f8640 1 -- 172.21.15.123:0/2859195761 >> 172.21.15.123:0/2859195761 conn(0x7fa89806c0e0 msgr2=0x7fa8980c8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:58.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.108+0000 7fa89f1f8640 1 -- 172.21.15.123:0/2859195761 shutdown_connections 2024-09-15T23:24:58.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.108+0000 7fa89f1f8640 1 -- 172.21.15.123:0/2859195761 wait complete. 2024-09-15T23:24:58.119 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-15T23:24:58.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.217+0000 7f6b6fa53640 1 Processor -- start 2024-09-15T23:24:58.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.217+0000 7f6b6fa53640 1 -- start start 2024-09-15T23:24:58.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.218+0000 7f6b6fa53640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f6b6815ab40 0x7f6b6806c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:58.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.218+0000 7f6b6fa53640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6b6815af20 0x7f6b6815b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:58.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.218+0000 7f6b6fa53640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b68072520 con 0x7f6b680720b0 2024-09-15T23:24:58.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.218+0000 7f6b6fa53640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f6b68071010 con 0x7f6b6815af20 2024-09-15T23:24:58.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.218+0000 7f6b6fa53640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f6b680712f0 con 0x7f6b6815ab40 2024-09-15T23:24:58.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.218+0000 7f6b6dff0640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6b6815af20 0x7f6b6815b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:58.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.218+0000 7f6b6dff0640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f6b6815af20 0x7f6b6815b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48500/0 (socket says 172.21.15.123:48500) 2024-09-15T23:24:58.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.218+0000 7f6b6dff0640 1 -- 172.21.15.123:0/780686645 learned_addr learned my addr 172.21.15.123:0/780686645 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:58.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.219+0000 7f6b6d7ef640 1 --2- 172.21.15.123:0/780686645 >> v2:172.21.15.188:3300/0 conn(0x7f6b6815ab40 0x7f6b6806c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:58.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.219+0000 7f6b6dff0640 1 -- 172.21.15.123:0/780686645 >> v2:172.21.15.188:3300/0 conn(0x7f6b6815ab40 msgr2=0x7f6b6806c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:58.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.219+0000 7f6b6dff0640 1 --2- 172.21.15.123:0/780686645 >> v2:172.21.15.188:3300/0 conn(0x7f6b6815ab40 0x7f6b6806c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.219+0000 7f6b6dff0640 1 -- 172.21.15.123:0/780686645 >> v1:172.21.15.188:6789/0 conn(0x7f6b680720b0 legacy=0x7f6b68073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:58.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.219+0000 7f6b6dff0640 1 -- 172.21.15.123:0/780686645 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b680715d0 con 0x7f6b6815af20 2024-09-15T23:24:58.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.219+0000 7f6b6dff0640 1 --2- 172.21.15.123:0/780686645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b6815af20 0x7f6b6815b370 secure :-1 s=READY pgs=2506 cs=0 l=1 rev1=1 crypto rx=0x7f6b680d1500 tx=0x7f6b6002b550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d563e5d04d7d8b25 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:58.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.219+0000 7f6b5ffff640 1 -- 172.21.15.123:0/780686645 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b6000b040 con 0x7f6b6815af20 2024-09-15T23:24:58.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.219+0000 7f6b5ffff640 1 -- 172.21.15.123:0/780686645 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b60030710 con 0x7f6b6815af20 2024-09-15T23:24:58.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.220+0000 7f6b5ffff640 1 -- 172.21.15.123:0/780686645 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b60030ae0 con 0x7f6b6815af20 2024-09-15T23:24:58.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.220+0000 7f6b6fa53640 1 -- 172.21.15.123:0/780686645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b6815af20 msgr2=0x7f6b6815b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:58.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.220+0000 7f6b6fa53640 1 --2- 172.21.15.123:0/780686645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b6815af20 0x7f6b6815b370 secure :-1 s=READY pgs=2506 cs=0 l=1 rev1=1 crypto rx=0x7f6b680d1500 tx=0x7f6b6002b550 comp rx=0 tx=0).stop 2024-09-15T23:24:58.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.220+0000 7f6b6fa53640 1 -- 172.21.15.123:0/780686645 shutdown_connections 2024-09-15T23:24:58.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.220+0000 7f6b6fa53640 1 --2- 172.21.15.123:0/780686645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b6815af20 0x7f6b6815b370 unknown :-1 s=CLOSED pgs=2506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.220+0000 7f6b6fa53640 1 --2- 172.21.15.123:0/780686645 >> v2:172.21.15.188:3300/0 conn(0x7f6b6815ab40 0x7f6b6806c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.220+0000 7f6b6fa53640 1 -- 172.21.15.123:0/780686645 >> 172.21.15.123:0/780686645 conn(0x7f6b680ccec0 msgr2=0x7f6b680cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:58.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.220+0000 7f6b6fa53640 1 -- 172.21.15.123:0/780686645 shutdown_connections 2024-09-15T23:24:58.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.220+0000 7f6b6fa53640 1 -- 172.21.15.123:0/780686645 wait complete. 2024-09-15T23:24:58.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.221+0000 7f6b6fa53640 1 Processor -- start 2024-09-15T23:24:58.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.221+0000 7f6b6fa53640 1 -- start start 2024-09-15T23:24:58.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.222+0000 7f6b6fa53640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b680720b0 0x7f6b680ced70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:58.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.222+0000 7f6b6fa53640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6b6815ab40 0x7f6b681e3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:58.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.222+0000 7f6b6fa53640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6b6815af20 0x7f6b681e4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:58.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.222+0000 7f6b6fa53640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6b6815ba30 con 0x7f6b680720b0 2024-09-15T23:24:58.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.222+0000 7f6b6fa53640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f6b6815b8b0 con 0x7f6b6815ab40 2024-09-15T23:24:58.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.222+0000 7f6b6fa53640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f6b6806bc10 con 0x7f6b6815af20 2024-09-15T23:24:58.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.222+0000 7f6b6d7ef640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b680720b0 0x7f6b680ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:58.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.222+0000 7f6b6d7ef640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b680720b0 0x7f6b680ced70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48502/0 (socket says 172.21.15.123:48502) 2024-09-15T23:24:58.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.222+0000 7f6b6d7ef640 1 -- 172.21.15.123:0/2947488532 learned_addr learned my addr 172.21.15.123:0/2947488532 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:58.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.222+0000 7f6b6cfee640 1 --2- 172.21.15.123:0/2947488532 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6b6815ab40 0x7f6b681e3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:58.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.222+0000 7f6b6dff0640 1 --2- 172.21.15.123:0/2947488532 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6b6815af20 0x7f6b681e4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:58.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.222+0000 7f6b6d7ef640 1 -- 172.21.15.123:0/2947488532 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6b6815af20 msgr2=0x7f6b681e4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:58.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.222+0000 7f6b6d7ef640 1 --2- 172.21.15.123:0/2947488532 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6b6815af20 0x7f6b681e4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.222+0000 7f6b6d7ef640 1 -- 172.21.15.123:0/2947488532 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6b6815ab40 msgr2=0x7f6b681e3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:58.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.222+0000 7f6b6d7ef640 1 --2- 172.21.15.123:0/2947488532 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6b6815ab40 0x7f6b681e3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.222+0000 7f6b6d7ef640 1 -- 172.21.15.123:0/2947488532 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b680c6f70 con 0x7f6b680720b0 2024-09-15T23:24:58.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.222+0000 7f6b6dff0640 1 --2- 172.21.15.123:0/2947488532 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6b6815af20 0x7f6b681e4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:24:58.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.223+0000 7f6b6d7ef640 1 --2- 172.21.15.123:0/2947488532 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b680720b0 0x7f6b680ced70 secure :-1 s=READY pgs=2507 cs=0 l=1 rev1=1 crypto rx=0x7f6b64007ef0 tx=0x7f6b6400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:58.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.223+0000 7f6b5dffb640 1 -- 172.21.15.123:0/2947488532 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b64014620 con 0x7f6b680720b0 2024-09-15T23:24:58.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.223+0000 7f6b5dffb640 1 -- 172.21.15.123:0/2947488532 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b64019070 con 0x7f6b680720b0 2024-09-15T23:24:58.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.223+0000 7f6b6fa53640 1 -- 172.21.15.123:0/2947488532 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b680c7250 con 0x7f6b680720b0 2024-09-15T23:24:58.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.223+0000 7f6b5dffb640 1 -- 172.21.15.123:0/2947488532 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b64014a00 con 0x7f6b680720b0 2024-09-15T23:24:58.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.223+0000 7f6b6fa53640 1 -- 172.21.15.123:0/2947488532 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b68146c30 con 0x7f6b680720b0 2024-09-15T23:24:58.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.224+0000 7f6b6fa53640 1 -- 172.21.15.123:0/2947488532 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b6806bfd0 con 0x7f6b680720b0 2024-09-15T23:24:58.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.224+0000 7f6b5dffb640 1 -- 172.21.15.123:0/2947488532 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6b64014ba0 con 0x7f6b680720b0 2024-09-15T23:24:58.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.225+0000 7f6b5dffb640 1 --2- 172.21.15.123:0/2947488532 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6b4c06c2b0 0x7f6b4c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:58.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.225+0000 7f6b5dffb640 1 -- 172.21.15.123:0/2947488532 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 4943+0+0 (secure 0 0 0) 0x7f6b6408b9c0 con 0x7f6b680720b0 2024-09-15T23:24:58.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.225+0000 7f6b6cfee640 1 --2- 172.21.15.123:0/2947488532 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6b4c06c2b0 0x7f6b4c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:58.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.225+0000 7f6b6cfee640 1 --2- 172.21.15.123:0/2947488532 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6b4c06c2b0 0x7f6b4c06e770 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f6b681f5460 tx=0x7f6b58007e30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:58.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.229+0000 7f6b5dffb640 1 -- 172.21.15.123:0/2947488532 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6b6408de20 con 0x7f6b680720b0 2024-09-15T23:24:58.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.392+0000 7f6b6fa53640 1 -- 172.21.15.123:0/2947488532 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f6b680cfb00 con 0x7f6b4c06c2b0 2024-09-15T23:24:58.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.393+0000 7f6b5dffb640 1 -- 172.21.15.123:0/2947488532 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6b680cfb00 con 0x7f6b4c06c2b0 2024-09-15T23:24:58.394 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 3 to deep-scrub 2024-09-15T23:24:58.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.395+0000 7f6b6fa53640 1 -- 172.21.15.123:0/2947488532 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6b4c06c2b0 msgr2=0x7f6b4c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:58.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.395+0000 7f6b6fa53640 1 --2- 172.21.15.123:0/2947488532 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6b4c06c2b0 0x7f6b4c06e770 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f6b681f5460 tx=0x7f6b58007e30 comp rx=0 tx=0).stop 2024-09-15T23:24:58.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.395+0000 7f6b6fa53640 1 -- 172.21.15.123:0/2947488532 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b680720b0 msgr2=0x7f6b680ced70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:58.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.395+0000 7f6b6fa53640 1 --2- 172.21.15.123:0/2947488532 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b680720b0 0x7f6b680ced70 secure :-1 s=READY pgs=2507 cs=0 l=1 rev1=1 crypto rx=0x7f6b64007ef0 tx=0x7f6b6400e4b0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.395+0000 7f6b6fa53640 1 -- 172.21.15.123:0/2947488532 shutdown_connections 2024-09-15T23:24:58.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.395+0000 7f6b6fa53640 1 --2- 172.21.15.123:0/2947488532 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6b6815af20 0x7f6b681e4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.395+0000 7f6b6fa53640 1 --2- 172.21.15.123:0/2947488532 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6b6815ab40 0x7f6b681e3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.395+0000 7f6b6fa53640 1 --2- 172.21.15.123:0/2947488532 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f6b4c06c2b0 0x7f6b4c06e770 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.395+0000 7f6b6fa53640 1 --2- 172.21.15.123:0/2947488532 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6b680720b0 0x7f6b680ced70 unknown :-1 s=CLOSED pgs=2507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.395+0000 7f6b6fa53640 1 -- 172.21.15.123:0/2947488532 >> 172.21.15.123:0/2947488532 conn(0x7f6b680ccec0 msgr2=0x7f6b68159540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:58.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.395+0000 7f6b6fa53640 1 -- 172.21.15.123:0/2947488532 shutdown_connections 2024-09-15T23:24:58.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.395+0000 7f6b6fa53640 1 -- 172.21.15.123:0/2947488532 wait complete. 2024-09-15T23:24:58.407 INFO:tasks.ceph:Scrubbing osd.4 2024-09-15T23:24:58.407 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-15T23:24:58.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.510+0000 7fcb4e318640 1 Processor -- start 2024-09-15T23:24:58.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.510+0000 7fcb4e318640 1 -- start start 2024-09-15T23:24:58.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.510+0000 7fcb4e318640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcb4815ea90 0x7fcb480d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:58.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.510+0000 7fcb4e318640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcb480d40b0 0x7fcb480d0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:58.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.510+0000 7fcb4e318640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fcb480d1510 0x7fcb480b6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:58.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.511+0000 7fcb4e318640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fcb480d1980 con 0x7fcb480d40b0 2024-09-15T23:24:58.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.511+0000 7fcb4e318640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fcb480d34c0 con 0x7fcb480d1510 2024-09-15T23:24:58.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.511+0000 7fcb4e318640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fcb480cf060 con 0x7fcb4815ea90 2024-09-15T23:24:58.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.511+0000 7fcb477fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcb480d40b0 0x7fcb480d0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:58.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.511+0000 7fcb477fe640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcb480d40b0 0x7fcb480d0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48504/0 (socket says 172.21.15.123:48504) 2024-09-15T23:24:58.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.511+0000 7fcb477fe640 1 -- 172.21.15.123:0/3720625074 learned_addr learned my addr 172.21.15.123:0/3720625074 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:58.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.511+0000 7fcb477fe640 1 -- 172.21.15.123:0/3720625074 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcb4815ea90 msgr2=0x7fcb480d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:58.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.511+0000 7fcb47fff640 1 --2- 172.21.15.123:0/3720625074 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcb4815ea90 0x7fcb480d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:58.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.511+0000 7fcb4c8b5640 1 --2- 172.21.15.123:0/3720625074 >> v2:172.21.15.188:3300/0 conn(0x7fcb480d1510 0x7fcb480b6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:58.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.511+0000 7fcb477fe640 1 --2- 172.21.15.123:0/3720625074 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcb4815ea90 0x7fcb480d2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.511+0000 7fcb477fe640 1 -- 172.21.15.123:0/3720625074 >> v2:172.21.15.188:3300/0 conn(0x7fcb480d1510 msgr2=0x7fcb480b6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:58.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.511+0000 7fcb477fe640 1 --2- 172.21.15.123:0/3720625074 >> v2:172.21.15.188:3300/0 conn(0x7fcb480d1510 0x7fcb480b6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.511+0000 7fcb477fe640 1 -- 172.21.15.123:0/3720625074 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb480cf340 con 0x7fcb480d40b0 2024-09-15T23:24:58.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.511+0000 7fcb4c8b5640 1 --2- 172.21.15.123:0/3720625074 >> v2:172.21.15.188:3300/0 conn(0x7fcb480d1510 0x7fcb480b6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:24:58.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.511+0000 7fcb47fff640 1 --2- 172.21.15.123:0/3720625074 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcb4815ea90 0x7fcb480d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:24:58.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.512+0000 7fcb477fe640 1 --2- 172.21.15.123:0/3720625074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb480d40b0 0x7fcb480d0fd0 secure :-1 s=READY pgs=2508 cs=0 l=1 rev1=1 crypto rx=0x7fcb480cecf0 tx=0x7fcb3c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28de68d89ff1c54d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:58.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.512+0000 7fcb46ffd640 1 -- 172.21.15.123:0/3720625074 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c037070 con 0x7fcb480d40b0 2024-09-15T23:24:58.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.512+0000 7fcb46ffd640 1 -- 172.21.15.123:0/3720625074 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb3c032440 con 0x7fcb480d40b0 2024-09-15T23:24:58.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.512+0000 7fcb46ffd640 1 -- 172.21.15.123:0/3720625074 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c032810 con 0x7fcb480d40b0 2024-09-15T23:24:58.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.512+0000 7fcb4e318640 1 -- 172.21.15.123:0/3720625074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb480d40b0 msgr2=0x7fcb480d0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:58.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.512+0000 7fcb4e318640 1 --2- 172.21.15.123:0/3720625074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb480d40b0 0x7fcb480d0fd0 secure :-1 s=READY pgs=2508 cs=0 l=1 rev1=1 crypto rx=0x7fcb480cecf0 tx=0x7fcb3c02a1e0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.512+0000 7fcb4e318640 1 -- 172.21.15.123:0/3720625074 shutdown_connections 2024-09-15T23:24:58.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.512+0000 7fcb4e318640 1 --2- 172.21.15.123:0/3720625074 >> v2:172.21.15.188:3300/0 conn(0x7fcb480d1510 0x7fcb480b6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.512+0000 7fcb4e318640 1 --2- 172.21.15.123:0/3720625074 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb480d40b0 0x7fcb480d0fd0 unknown :-1 s=CLOSED pgs=2508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.512+0000 7fcb4e318640 1 --2- 172.21.15.123:0/3720625074 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcb4815ea90 0x7fcb480d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.512+0000 7fcb4e318640 1 -- 172.21.15.123:0/3720625074 >> 172.21.15.123:0/3720625074 conn(0x7fcb4806c0e0 msgr2=0x7fcb4806c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:58.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.512+0000 7fcb4e318640 1 -- 172.21.15.123:0/3720625074 shutdown_connections 2024-09-15T23:24:58.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.512+0000 7fcb4e318640 1 -- 172.21.15.123:0/3720625074 wait complete. 2024-09-15T23:24:58.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.514+0000 7fcb4e318640 1 Processor -- start 2024-09-15T23:24:58.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.514+0000 7fcb4e318640 1 -- start start 2024-09-15T23:24:58.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.514+0000 7fcb4e318640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb480d1510 0x7fcb480b4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:58.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.514+0000 7fcb4e318640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb480d40b0 0x7fcb480b6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:58.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.514+0000 7fcb4e318640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcb4815ea90 0x7fcb480c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:58.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.514+0000 7fcb4e318640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcb480cfbe0 con 0x7fcb480d40b0 2024-09-15T23:24:58.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.514+0000 7fcb4e318640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fcb480cf900 con 0x7fcb480d1510 2024-09-15T23:24:58.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.514+0000 7fcb4e318640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fcb4815ee70 con 0x7fcb4815ea90 2024-09-15T23:24:58.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.515+0000 7fcb477fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb480d40b0 0x7fcb480b6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:58.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.515+0000 7fcb477fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb480d40b0 0x7fcb480b6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48514/0 (socket says 172.21.15.123:48514) 2024-09-15T23:24:58.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.515+0000 7fcb477fe640 1 -- 172.21.15.123:0/1063070548 learned_addr learned my addr 172.21.15.123:0/1063070548 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:58.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.515+0000 7fcb47fff640 1 --2- 172.21.15.123:0/1063070548 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb480d1510 0x7fcb480b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:58.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.515+0000 7fcb4c8b5640 1 --2- 172.21.15.123:0/1063070548 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcb4815ea90 0x7fcb480c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:58.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.515+0000 7fcb477fe640 1 -- 172.21.15.123:0/1063070548 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcb4815ea90 msgr2=0x7fcb480c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:58.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.515+0000 7fcb477fe640 1 --2- 172.21.15.123:0/1063070548 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcb4815ea90 0x7fcb480c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.515+0000 7fcb477fe640 1 -- 172.21.15.123:0/1063070548 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb480d1510 msgr2=0x7fcb480b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:58.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.515+0000 7fcb477fe640 1 --2- 172.21.15.123:0/1063070548 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcb480d1510 0x7fcb480b4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.515+0000 7fcb477fe640 1 -- 172.21.15.123:0/1063070548 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb480cbab0 con 0x7fcb480d40b0 2024-09-15T23:24:58.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.515+0000 7fcb477fe640 1 --2- 172.21.15.123:0/1063070548 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb480d40b0 0x7fcb480b6910 secure :-1 s=READY pgs=2509 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c000c00 tx=0x7fcb3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:58.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.515+0000 7fcb44ff9640 1 -- 172.21.15.123:0/1063070548 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c037040 con 0x7fcb480d40b0 2024-09-15T23:24:58.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.515+0000 7fcb44ff9640 1 -- 172.21.15.123:0/1063070548 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb3c042070 con 0x7fcb480d40b0 2024-09-15T23:24:58.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.515+0000 7fcb44ff9640 1 -- 172.21.15.123:0/1063070548 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c030bb0 con 0x7fcb480d40b0 2024-09-15T23:24:58.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.515+0000 7fcb4e318640 1 -- 172.21.15.123:0/1063070548 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb480cbd90 con 0x7fcb480d40b0 2024-09-15T23:24:58.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.515+0000 7fcb4e318640 1 -- 172.21.15.123:0/1063070548 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb480b6e50 con 0x7fcb480d40b0 2024-09-15T23:24:58.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.516+0000 7fcb4e318640 1 -- 172.21.15.123:0/1063070548 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcb480d0fd0 con 0x7fcb480d40b0 2024-09-15T23:24:58.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.517+0000 7fcb44ff9640 1 -- 172.21.15.123:0/1063070548 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcb3c047460 con 0x7fcb480d40b0 2024-09-15T23:24:58.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.517+0000 7fcb44ff9640 1 --2- 172.21.15.123:0/1063070548 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcb3406c2b0 0x7fcb3406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:58.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.517+0000 7fcb44ff9640 1 -- 172.21.15.123:0/1063070548 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 4943+0+0 (secure 0 0 0) 0x7fcb3c0abc20 con 0x7fcb480d40b0 2024-09-15T23:24:58.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.517+0000 7fcb44ff9640 1 --2- 172.21.15.123:0/1063070548 >> [v2:172.21.15.188:6800/3901678408,v1:172.21.15.188:6801/3901678408] conn(0x7fcb34072170 0x7fcb34074590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:58.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.517+0000 7fcb44ff9640 1 -- 172.21.15.123:0/1063070548 --> [v2:172.21.15.188:6800/3901678408,v1:172.21.15.188:6801/3901678408] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcb3c032440 con 0x7fcb34072170 2024-09-15T23:24:58.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.517+0000 7fcb44ff9640 1 -- 172.21.15.123:0/1063070548 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=209) ==== 24+0+0 (secure 0 0 0) 0x7fcb3c0ae320 con 0x7fcb480d40b0 2024-09-15T23:24:58.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.517+0000 7fcb47fff640 1 --2- 172.21.15.123:0/1063070548 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcb3406c2b0 0x7fcb3406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:58.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.518+0000 7fcb4c8b5640 1 --2- 172.21.15.123:0/1063070548 >> [v2:172.21.15.188:6800/3901678408,v1:172.21.15.188:6801/3901678408] conn(0x7fcb34072170 0x7fcb34074590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:58.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.518+0000 7fcb47fff640 1 --2- 172.21.15.123:0/1063070548 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcb3406c2b0 0x7fcb3406e770 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fcb3800aac0 tx=0x7fcb38008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:58.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.518+0000 7fcb4c8b5640 1 --2- 172.21.15.123:0/1063070548 >> [v2:172.21.15.188:6800/3901678408,v1:172.21.15.188:6801/3901678408] conn(0x7fcb34072170 0x7fcb34074590 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:58.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.519+0000 7fcb44ff9640 1 -- 172.21.15.123:0/1063070548 <== osd.4 v2:172.21.15.188:6800/3901678408 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcb3c032440 con 0x7fcb34072170 2024-09-15T23:24:58.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.531+0000 7fcb4e318640 1 -- 172.21.15.123:0/1063070548 --> [v2:172.21.15.188:6800/3901678408,v1:172.21.15.188:6801/3901678408] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fcb4815f280 con 0x7fcb34072170 2024-09-15T23:24:58.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.532+0000 7fcb44ff9640 1 -- 172.21.15.123:0/1063070548 <== osd.4 v2:172.21.15.188:6800/3901678408 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fcb4815f280 con 0x7fcb34072170 2024-09-15T23:24:58.533 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:24:58.533 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T23:24:58.533 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:24:58.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.532+0000 7fcb4e318640 1 -- 172.21.15.123:0/1063070548 >> [v2:172.21.15.188:6800/3901678408,v1:172.21.15.188:6801/3901678408] conn(0x7fcb34072170 msgr2=0x7fcb34074590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:58.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.532+0000 7fcb4e318640 1 --2- 172.21.15.123:0/1063070548 >> [v2:172.21.15.188:6800/3901678408,v1:172.21.15.188:6801/3901678408] conn(0x7fcb34072170 0x7fcb34074590 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.532+0000 7fcb4e318640 1 -- 172.21.15.123:0/1063070548 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcb3406c2b0 msgr2=0x7fcb3406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:58.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.532+0000 7fcb4e318640 1 --2- 172.21.15.123:0/1063070548 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcb3406c2b0 0x7fcb3406e770 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fcb3800aac0 tx=0x7fcb38008040 comp rx=0 tx=0).stop 2024-09-15T23:24:58.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.532+0000 7fcb4e318640 1 -- 172.21.15.123:0/1063070548 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb480d40b0 msgr2=0x7fcb480b6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:58.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.532+0000 7fcb4e318640 1 --2- 172.21.15.123:0/1063070548 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb480d40b0 0x7fcb480b6910 secure :-1 s=READY pgs=2509 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c000c00 tx=0x7fcb3c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.532+0000 7fcb4c8b5640 1 -- 172.21.15.123:0/1063070548 reap_dead start 2024-09-15T23:24:58.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.532+0000 7fcb4e318640 1 -- 172.21.15.123:0/1063070548 shutdown_connections 2024-09-15T23:24:58.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.532+0000 7fcb4e318640 1 -- 172.21.15.123:0/1063070548 >> 172.21.15.123:0/1063070548 conn(0x7fcb4806c0e0 msgr2=0x7fcb480b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:58.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.532+0000 7fcb4e318640 1 -- 172.21.15.123:0/1063070548 shutdown_connections 2024-09-15T23:24:58.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.532+0000 7fcb4e318640 1 -- 172.21.15.123:0/1063070548 wait complete. 2024-09-15T23:24:58.543 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-15T23:24:58.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.642+0000 7f16d7aa5640 1 Processor -- start 2024-09-15T23:24:58.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.642+0000 7f16d7aa5640 1 -- start start 2024-09-15T23:24:58.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.643+0000 7f16d7aa5640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f16d006cd20 0x7f16d00b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:58.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.643+0000 7f16d7aa5640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16d0070b80 0x7f16d00b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:58.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.643+0000 7f16d7aa5640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16d015eab0 con 0x7f16d015e6d0 2024-09-15T23:24:58.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.643+0000 7f16d7aa5640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f16d00b77e0 con 0x7f16d006cd20 2024-09-15T23:24:58.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.643+0000 7f16d7aa5640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f16d015ed70 con 0x7f16d0070b80 2024-09-15T23:24:58.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.643+0000 7f16d5841640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f16d015e6d0 0x7f16d0071390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55114/0 (socket says 172.21.15.123:55114) 2024-09-15T23:24:58.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.643+0000 7f16d5841640 1 -- 172.21.15.123:0/2285040300 learned_addr learned my addr 172.21.15.123:0/2285040300 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:58.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.643+0000 7f16d6042640 1 --2- 172.21.15.123:0/2285040300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16d0070b80 0x7f16d00b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:58.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.643+0000 7f16d483f640 1 -- 172.21.15.123:0/2285040300 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3968909016 0 0) 0x7f16d015eab0 con 0x7f16d015e6d0 2024-09-15T23:24:58.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.643+0000 7f16d5040640 1 --2- 172.21.15.123:0/2285040300 >> v2:172.21.15.188:3300/0 conn(0x7f16d006cd20 0x7f16d00b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:58.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.643+0000 7f16d483f640 1 -- 172.21.15.123:0/2285040300 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16b8003520 con 0x7f16d015e6d0 2024-09-15T23:24:58.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.643+0000 7f16d483f640 1 -- 172.21.15.123:0/2285040300 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2146652353 0 0) 0x7f16b8003520 con 0x7f16d015e6d0 2024-09-15T23:24:58.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.643+0000 7f16d483f640 1 -- 172.21.15.123:0/2285040300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16d0070b80 msgr2=0x7f16d00b72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:58.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.643+0000 7f16d483f640 1 --2- 172.21.15.123:0/2285040300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16d0070b80 0x7f16d00b72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.643+0000 7f16d483f640 1 -- 172.21.15.123:0/2285040300 >> v2:172.21.15.188:3300/0 conn(0x7f16d006cd20 msgr2=0x7f16d00b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:58.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.643+0000 7f16d483f640 1 --2- 172.21.15.123:0/2285040300 >> v2:172.21.15.188:3300/0 conn(0x7f16d006cd20 0x7f16d00b6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.643+0000 7f16d483f640 1 -- 172.21.15.123:0/2285040300 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16d015f050 con 0x7f16d015e6d0 2024-09-15T23:24:58.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.643+0000 7f16d6042640 1 --2- 172.21.15.123:0/2285040300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16d0070b80 0x7f16d00b72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:24:58.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.643+0000 7f16d483f640 1 -- 172.21.15.123:0/2285040300 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f16c80019f0 con 0x7f16d015e6d0 2024-09-15T23:24:58.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.643+0000 7f16d483f640 1 -- 172.21.15.123:0/2285040300 >> v1:172.21.15.123:6789/0 conn(0x7f16d015e6d0 legacy=0x7f16d0071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:58.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.643+0000 7f16d483f640 1 --2- 172.21.15.123:0/2285040300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16b80039b0 0x7f16b8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:58.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.643+0000 7f16d483f640 1 --2- 172.21.15.123:0/2285040300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16d0070b80 0x7f16b8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:58.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.643+0000 7f16d483f640 1 --2- 172.21.15.123:0/2285040300 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16b8004d40 0x7f16b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:58.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.643+0000 7f16d483f640 1 -- 172.21.15.123:0/2285040300 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f16d015ed70 con 0x7f16b80039b0 2024-09-15T23:24:58.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.643+0000 7f16d483f640 1 -- 172.21.15.123:0/2285040300 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f16b800b9c0 con 0x7f16b8004d40 2024-09-15T23:24:58.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.643+0000 7f16d483f640 1 -- 172.21.15.123:0/2285040300 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f16b800bb40 con 0x7f16d0070b80 2024-09-15T23:24:58.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.643+0000 7f16d5841640 1 --2- 172.21.15.123:0/2285040300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16b80039b0 0x7f16b8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:58.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.644+0000 7f16d6042640 1 --2- 172.21.15.123:0/2285040300 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16b8004d40 0x7f16b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:58.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.644+0000 7f16d5040640 1 --2- 172.21.15.123:0/2285040300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16d0070b80 0x7f16b8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:58.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.644+0000 7f16d5841640 1 -- 172.21.15.123:0/2285040300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16d0070b80 msgr2=0x7f16b8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:58.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.644+0000 7f16d5841640 1 --2- 172.21.15.123:0/2285040300 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16d0070b80 0x7f16b8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.644+0000 7f16d5841640 1 -- 172.21.15.123:0/2285040300 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16b8004d40 msgr2=0x7f16b80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:58.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.644+0000 7f16d5841640 1 --2- 172.21.15.123:0/2285040300 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16b8004d40 0x7f16b80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.644+0000 7f16d5841640 1 -- 172.21.15.123:0/2285040300 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16b8003520 con 0x7f16b80039b0 2024-09-15T23:24:58.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.644+0000 7f16d5841640 1 --2- 172.21.15.123:0/2285040300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16b80039b0 0x7f16b8003dd0 secure :-1 s=READY pgs=2511 cs=0 l=1 rev1=1 crypto rx=0x7f16c800a880 tx=0x7f16b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aea1f83d5ce67e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:58.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.645+0000 7f16d483f640 1 -- 172.21.15.123:0/2285040300 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c800a4a0 con 0x7f16b80039b0 2024-09-15T23:24:58.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.645+0000 7f16d483f640 1 -- 172.21.15.123:0/2285040300 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16c802f070 con 0x7f16b80039b0 2024-09-15T23:24:58.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.645+0000 7f16d483f640 1 -- 172.21.15.123:0/2285040300 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c802bd00 con 0x7f16b80039b0 2024-09-15T23:24:58.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.645+0000 7f16d7aa5640 1 -- 172.21.15.123:0/2285040300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16b80039b0 msgr2=0x7f16b8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:58.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.645+0000 7f16d7aa5640 1 --2- 172.21.15.123:0/2285040300 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16b80039b0 0x7f16b8003dd0 secure :-1 s=READY pgs=2511 cs=0 l=1 rev1=1 crypto rx=0x7f16c800a880 tx=0x7f16b8005830 comp rx=0 tx=0).stop 2024-09-15T23:24:58.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.645+0000 7f16d6042640 1 -- 172.21.15.123:0/2285040300 reap_dead start 2024-09-15T23:24:58.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.645+0000 7f16d7aa5640 1 -- 172.21.15.123:0/2285040300 shutdown_connections 2024-09-15T23:24:58.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.645+0000 7f16d7aa5640 1 -- 172.21.15.123:0/2285040300 >> 172.21.15.123:0/2285040300 conn(0x7f16d0067fb0 msgr2=0x7f16d006f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:58.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.645+0000 7f16d7aa5640 1 -- 172.21.15.123:0/2285040300 shutdown_connections 2024-09-15T23:24:58.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.645+0000 7f16d7aa5640 1 -- 172.21.15.123:0/2285040300 wait complete. 2024-09-15T23:24:58.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.646+0000 7f16d7aa5640 1 Processor -- start 2024-09-15T23:24:58.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.646+0000 7f16d7aa5640 1 -- start start 2024-09-15T23:24:58.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.647+0000 7f16d7aa5640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16b80039b0 0x7f16d01441c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:58.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.647+0000 7f16d7aa5640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16d014e300 0x7f16d00d24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:58.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.647+0000 7f16d7aa5640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16d00d0c00 0x7f16d00cb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:58.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.647+0000 7f16d7aa5640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f16d015f8f0 con 0x7f16d00d0c00 2024-09-15T23:24:58.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.647+0000 7f16d7aa5640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f16d015f610 con 0x7f16b80039b0 2024-09-15T23:24:58.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.647+0000 7f16d7aa5640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f16d00b72a0 con 0x7f16d014e300 2024-09-15T23:24:58.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.647+0000 7f16d6042640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16d00d0c00 0x7f16d00cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:58.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.647+0000 7f16d6042640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16d00d0c00 0x7f16d00cb940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48538/0 (socket says 172.21.15.123:48538) 2024-09-15T23:24:58.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.647+0000 7f16d6042640 1 -- 172.21.15.123:0/1666566614 learned_addr learned my addr 172.21.15.123:0/1666566614 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:58.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.647+0000 7f16d5040640 1 --2- 172.21.15.123:0/1666566614 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16d014e300 0x7f16d00d24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:58.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.647+0000 7f16d5841640 1 --2- 172.21.15.123:0/1666566614 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16b80039b0 0x7f16d01441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:58.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.648+0000 7f16d6042640 1 -- 172.21.15.123:0/1666566614 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16d014e300 msgr2=0x7f16d00d24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:58.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.648+0000 7f16d6042640 1 --2- 172.21.15.123:0/1666566614 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16d014e300 0x7f16d00d24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.648+0000 7f16d6042640 1 -- 172.21.15.123:0/1666566614 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16b80039b0 msgr2=0x7f16d01441c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:58.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.648+0000 7f16d6042640 1 --2- 172.21.15.123:0/1666566614 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16b80039b0 0x7f16d01441c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.648+0000 7f16d6042640 1 -- 172.21.15.123:0/1666566614 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16d00d1450 con 0x7f16d00d0c00 2024-09-15T23:24:58.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.648+0000 7f16d5841640 1 --2- 172.21.15.123:0/1666566614 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16b80039b0 0x7f16d01441c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:24:58.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.648+0000 7f16d6042640 1 --2- 172.21.15.123:0/1666566614 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16d00d0c00 0x7f16d00cb940 secure :-1 s=READY pgs=2512 cs=0 l=1 rev1=1 crypto rx=0x7f16d0070420 tx=0x7f16c0011c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:58.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.648+0000 7f16ce7fc640 1 -- 172.21.15.123:0/1666566614 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c0019070 con 0x7f16d00d0c00 2024-09-15T23:24:58.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.648+0000 7f16ce7fc640 1 -- 172.21.15.123:0/1666566614 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16c0004020 con 0x7f16d00d0c00 2024-09-15T23:24:58.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.648+0000 7f16d7aa5640 1 -- 172.21.15.123:0/1666566614 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16d00d1730 con 0x7f16d00d0c00 2024-09-15T23:24:58.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.648+0000 7f16ce7fc640 1 -- 172.21.15.123:0/1666566614 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c0004410 con 0x7f16d00d0c00 2024-09-15T23:24:58.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.648+0000 7f16d7aa5640 1 -- 172.21.15.123:0/1666566614 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16d00d1cf0 con 0x7f16d00d0c00 2024-09-15T23:24:58.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.649+0000 7f16d7aa5640 1 -- 172.21.15.123:0/1666566614 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16d00b7680 con 0x7f16d00d0c00 2024-09-15T23:24:58.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.649+0000 7f16ce7fc640 1 -- 172.21.15.123:0/1666566614 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f16c0012040 con 0x7f16d00d0c00 2024-09-15T23:24:58.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.650+0000 7f16ce7fc640 1 --2- 172.21.15.123:0/1666566614 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f16bc06c2b0 0x7f16bc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:58.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.650+0000 7f16ce7fc640 1 -- 172.21.15.123:0/1666566614 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 4943+0+0 (secure 0 0 0) 0x7f16c008ad00 con 0x7f16d00d0c00 2024-09-15T23:24:58.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.650+0000 7f16d5841640 1 --2- 172.21.15.123:0/1666566614 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f16bc06c2b0 0x7f16bc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:58.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.651+0000 7f16d5841640 1 --2- 172.21.15.123:0/1666566614 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f16bc06c2b0 0x7f16bc06e770 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f16c8033000 tx=0x7f16c8007000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:58.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.654+0000 7f16ce7fc640 1 -- 172.21.15.123:0/1666566614 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f16c0059800 con 0x7f16d00d0c00 2024-09-15T23:24:58.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.820+0000 7f16d7aa5640 1 -- 172.21.15.123:0/1666566614 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f16d00b2620 con 0x7f16bc06c2b0 2024-09-15T23:24:58.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.821+0000 7f16ce7fc640 1 -- 172.21.15.123:0/1666566614 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f16d00b2620 con 0x7f16bc06c2b0 2024-09-15T23:24:58.822 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 4 to deep-scrub 2024-09-15T23:24:58.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.823+0000 7f16d7aa5640 1 -- 172.21.15.123:0/1666566614 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f16bc06c2b0 msgr2=0x7f16bc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:58.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.823+0000 7f16d7aa5640 1 --2- 172.21.15.123:0/1666566614 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f16bc06c2b0 0x7f16bc06e770 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f16c8033000 tx=0x7f16c8007000 comp rx=0 tx=0).stop 2024-09-15T23:24:58.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.823+0000 7f16d7aa5640 1 -- 172.21.15.123:0/1666566614 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16d00d0c00 msgr2=0x7f16d00cb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:58.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.823+0000 7f16d7aa5640 1 --2- 172.21.15.123:0/1666566614 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16d00d0c00 0x7f16d00cb940 secure :-1 s=READY pgs=2512 cs=0 l=1 rev1=1 crypto rx=0x7f16d0070420 tx=0x7f16c0011c30 comp rx=0 tx=0).stop 2024-09-15T23:24:58.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.823+0000 7f16d7aa5640 1 -- 172.21.15.123:0/1666566614 shutdown_connections 2024-09-15T23:24:58.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.823+0000 7f16d7aa5640 1 --2- 172.21.15.123:0/1666566614 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f16bc06c2b0 0x7f16bc06e770 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.823+0000 7f16d7aa5640 1 --2- 172.21.15.123:0/1666566614 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16d00d0c00 0x7f16d00cb940 unknown :-1 s=CLOSED pgs=2512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.823+0000 7f16d7aa5640 1 --2- 172.21.15.123:0/1666566614 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f16d014e300 0x7f16d00d24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.823+0000 7f16d7aa5640 1 --2- 172.21.15.123:0/1666566614 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f16b80039b0 0x7f16d01441c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.823+0000 7f16d7aa5640 1 -- 172.21.15.123:0/1666566614 >> 172.21.15.123:0/1666566614 conn(0x7f16d0067fb0 msgr2=0x7f16d006d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:58.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.823+0000 7f16d7aa5640 1 -- 172.21.15.123:0/1666566614 shutdown_connections 2024-09-15T23:24:58.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.823+0000 7f16d7aa5640 1 -- 172.21.15.123:0/1666566614 wait complete. 2024-09-15T23:24:58.834 INFO:tasks.ceph:Scrubbing osd.5 2024-09-15T23:24:58.835 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-15T23:24:58.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.935+0000 7f50594c3640 1 Processor -- start 2024-09-15T23:24:58.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.935+0000 7f50594c3640 1 -- start start 2024-09-15T23:24:58.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.936+0000 7f50594c3640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5054155b20 0x7f50540b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:58.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.936+0000 7f50594c3640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50540b0680 con 0x7f50540cfb30 2024-09-15T23:24:58.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.936+0000 7f50594c3640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50540ccf70 con 0x7f50540b21a0 2024-09-15T23:24:58.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.936+0000 7f50594c3640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f50540b01e0 con 0x7f5054155b20 2024-09-15T23:24:58.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.936+0000 7f5052ffd640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5054155b20 0x7f50540b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:58.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.936+0000 7f50537fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f50540cfb30 0x7f505415c3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55124/0 (socket says 172.21.15.123:55124) 2024-09-15T23:24:58.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.936+0000 7f50537fe640 1 -- 172.21.15.123:0/3708119601 learned_addr learned my addr 172.21.15.123:0/3708119601 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:58.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.936+0000 7f5052ffd640 1 -- 172.21.15.123:0/3708119601 >> v1:172.21.15.188:6789/0 conn(0x7f50540b21a0 legacy=0x7f50540cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:58.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.936+0000 7f5052ffd640 1 -- 172.21.15.123:0/3708119601 >> v1:172.21.15.123:6789/0 conn(0x7f50540cfb30 legacy=0x7f505415c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:58.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.936+0000 7f5052ffd640 1 -- 172.21.15.123:0/3708119601 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50540ce940 con 0x7f5054155b20 2024-09-15T23:24:58.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.937+0000 7f5052ffd640 1 --2- 172.21.15.123:0/3708119601 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5054155b20 0x7f50540b1c60 secure :-1 s=READY pgs=2514 cs=0 l=1 rev1=1 crypto rx=0x7f5044009d90 tx=0x7f504402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb98ff5a051f516 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:58.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.937+0000 7f5051ffb640 1 -- 172.21.15.123:0/3708119601 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5044007740 con 0x7f5054155b20 2024-09-15T23:24:58.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.937+0000 7f5051ffb640 1 -- 172.21.15.123:0/3708119601 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50440078e0 con 0x7f5054155b20 2024-09-15T23:24:58.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.937+0000 7f5051ffb640 1 -- 172.21.15.123:0/3708119601 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5044007cb0 con 0x7f5054155b20 2024-09-15T23:24:58.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.938+0000 7f50594c3640 1 -- 172.21.15.123:0/3708119601 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5054155b20 msgr2=0x7f50540b1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:58.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.938+0000 7f50594c3640 1 --2- 172.21.15.123:0/3708119601 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5054155b20 0x7f50540b1c60 secure :-1 s=READY pgs=2514 cs=0 l=1 rev1=1 crypto rx=0x7f5044009d90 tx=0x7f504402a6a0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.938+0000 7f50594c3640 1 -- 172.21.15.123:0/3708119601 shutdown_connections 2024-09-15T23:24:58.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.938+0000 7f50594c3640 1 --2- 172.21.15.123:0/3708119601 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5054155b20 0x7f50540b1c60 unknown :-1 s=CLOSED pgs=2514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.938+0000 7f50594c3640 1 -- 172.21.15.123:0/3708119601 >> 172.21.15.123:0/3708119601 conn(0x7f505406c240 msgr2=0x7f505406d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:58.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.938+0000 7f50594c3640 1 -- 172.21.15.123:0/3708119601 shutdown_connections 2024-09-15T23:24:58.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.938+0000 7f50594c3640 1 -- 172.21.15.123:0/3708119601 wait complete. 2024-09-15T23:24:58.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.939+0000 7f50594c3640 1 Processor -- start 2024-09-15T23:24:58.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.939+0000 7f50594c3640 1 -- start start 2024-09-15T23:24:58.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.940+0000 7f50594c3640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50540b21a0 0x7f50541f6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:58.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.940+0000 7f50594c3640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50540cfb30 0x7f50541e5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:58.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.940+0000 7f50594c3640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5054155b20 0x7f5054154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:58.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.940+0000 7f50594c3640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f50540ce610 con 0x7f5054155b20 2024-09-15T23:24:58.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.940+0000 7f50594c3640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f50540cef00 con 0x7f50540cfb30 2024-09-15T23:24:58.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.940+0000 7f50594c3640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f50540ccb20 con 0x7f50540b21a0 2024-09-15T23:24:58.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.940+0000 7f50537fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5054155b20 0x7f5054154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:58.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.940+0000 7f50537fe640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5054155b20 0x7f5054154100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48556/0 (socket says 172.21.15.123:48556) 2024-09-15T23:24:58.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.940+0000 7f50537fe640 1 -- 172.21.15.123:0/3879387290 learned_addr learned my addr 172.21.15.123:0/3879387290 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:58.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.940+0000 7f5052ffd640 1 --2- 172.21.15.123:0/3879387290 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50540b21a0 0x7f50541f6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:58.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.940+0000 7f50527fc640 1 --2- 172.21.15.123:0/3879387290 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50540cfb30 0x7f50541e5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:58.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.940+0000 7f50537fe640 1 -- 172.21.15.123:0/3879387290 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50540b21a0 msgr2=0x7f50541f6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:58.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.940+0000 7f50537fe640 1 --2- 172.21.15.123:0/3879387290 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f50540b21a0 0x7f50541f6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.940+0000 7f50537fe640 1 -- 172.21.15.123:0/3879387290 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50540cfb30 msgr2=0x7f50541e5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:58.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.940+0000 7f50537fe640 1 --2- 172.21.15.123:0/3879387290 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f50540cfb30 0x7f50541e5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.940+0000 7f50537fe640 1 -- 172.21.15.123:0/3879387290 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f505415d890 con 0x7f5054155b20 2024-09-15T23:24:58.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.940+0000 7f50537fe640 1 --2- 172.21.15.123:0/3879387290 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5054155b20 0x7f5054154100 secure :-1 s=READY pgs=2515 cs=0 l=1 rev1=1 crypto rx=0x7f504c00c3c0 tx=0x7f504c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:58.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.940+0000 7f503b7fe640 1 -- 172.21.15.123:0/3879387290 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f504c017070 con 0x7f5054155b20 2024-09-15T23:24:58.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.940+0000 7f503b7fe640 1 -- 172.21.15.123:0/3879387290 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f504c005ce0 con 0x7f5054155b20 2024-09-15T23:24:58.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.940+0000 7f503b7fe640 1 -- 172.21.15.123:0/3879387290 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f504c0072f0 con 0x7f5054155b20 2024-09-15T23:24:58.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.940+0000 7f50594c3640 1 -- 172.21.15.123:0/3879387290 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f505415db70 con 0x7f5054155b20 2024-09-15T23:24:58.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.941+0000 7f50594c3640 1 -- 172.21.15.123:0/3879387290 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50541e5fe0 con 0x7f5054155b20 2024-09-15T23:24:58.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.941+0000 7f50594c3640 1 -- 172.21.15.123:0/3879387290 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f50541554b0 con 0x7f5054155b20 2024-09-15T23:24:58.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.942+0000 7f503b7fe640 1 -- 172.21.15.123:0/3879387290 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f504c01a070 con 0x7f5054155b20 2024-09-15T23:24:58.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.942+0000 7f503b7fe640 1 --2- 172.21.15.123:0/3879387290 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f504006c2b0 0x7f504006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:58.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.943+0000 7f503b7fe640 1 -- 172.21.15.123:0/3879387290 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 4943+0+0 (secure 0 0 0) 0x7f504c08a3a0 con 0x7f5054155b20 2024-09-15T23:24:58.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.943+0000 7f503b7fe640 1 --2- 172.21.15.123:0/3879387290 >> [v2:172.21.15.188:6808/1860798982,v1:172.21.15.188:6809/1860798982] conn(0x7f5040072170 0x7f5040074590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:58.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.943+0000 7f503b7fe640 1 -- 172.21.15.123:0/3879387290 --> [v2:172.21.15.188:6808/1860798982,v1:172.21.15.188:6809/1860798982] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f504c014ec0 con 0x7f5040072170 2024-09-15T23:24:58.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.943+0000 7f503b7fe640 1 -- 172.21.15.123:0/3879387290 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=209) ==== 24+0+0 (secure 0 0 0) 0x7f504c091050 con 0x7f5054155b20 2024-09-15T23:24:58.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.943+0000 7f5052ffd640 1 --2- 172.21.15.123:0/3879387290 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f504006c2b0 0x7f504006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:58.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.943+0000 7f50527fc640 1 --2- 172.21.15.123:0/3879387290 >> [v2:172.21.15.188:6808/1860798982,v1:172.21.15.188:6809/1860798982] conn(0x7f5040072170 0x7f5040074590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:58.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.943+0000 7f5052ffd640 1 --2- 172.21.15.123:0/3879387290 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f504006c2b0 0x7f504006e770 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f5044034000 tx=0x7f504402f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:58.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.943+0000 7f50527fc640 1 --2- 172.21.15.123:0/3879387290 >> [v2:172.21.15.188:6808/1860798982,v1:172.21.15.188:6809/1860798982] conn(0x7f5040072170 0x7f5040074590 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:58.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.944+0000 7f503b7fe640 1 -- 172.21.15.123:0/3879387290 <== osd.5 v2:172.21.15.188:6808/1860798982 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f504c014ec0 con 0x7f5040072170 2024-09-15T23:24:58.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.956+0000 7f50594c3640 1 -- 172.21.15.123:0/3879387290 --> [v2:172.21.15.188:6808/1860798982,v1:172.21.15.188:6809/1860798982] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f50540b1c60 con 0x7f5040072170 2024-09-15T23:24:58.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.957+0000 7f503b7fe640 1 -- 172.21.15.123:0/3879387290 <== osd.5 v2:172.21.15.188:6808/1860798982 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f50540b1c60 con 0x7f5040072170 2024-09-15T23:24:58.958 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:24:58.958 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T23:24:58.958 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:24:58.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.957+0000 7f50594c3640 1 -- 172.21.15.123:0/3879387290 >> [v2:172.21.15.188:6808/1860798982,v1:172.21.15.188:6809/1860798982] conn(0x7f5040072170 msgr2=0x7f5040074590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:58.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.957+0000 7f50594c3640 1 --2- 172.21.15.123:0/3879387290 >> [v2:172.21.15.188:6808/1860798982,v1:172.21.15.188:6809/1860798982] conn(0x7f5040072170 0x7f5040074590 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:58.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.957+0000 7f50594c3640 1 -- 172.21.15.123:0/3879387290 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f504006c2b0 msgr2=0x7f504006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:58.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.957+0000 7f50594c3640 1 --2- 172.21.15.123:0/3879387290 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f504006c2b0 0x7f504006e770 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f5044034000 tx=0x7f504402f000 comp rx=0 tx=0).stop 2024-09-15T23:24:58.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.957+0000 7f50594c3640 1 -- 172.21.15.123:0/3879387290 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5054155b20 msgr2=0x7f5054154100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:58.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.957+0000 7f50594c3640 1 --2- 172.21.15.123:0/3879387290 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5054155b20 0x7f5054154100 secure :-1 s=READY pgs=2515 cs=0 l=1 rev1=1 crypto rx=0x7f504c00c3c0 tx=0x7f504c00c880 comp rx=0 tx=0).stop 2024-09-15T23:24:58.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.957+0000 7f50537fe640 1 -- 172.21.15.123:0/3879387290 reap_dead start 2024-09-15T23:24:58.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.957+0000 7f50594c3640 1 -- 172.21.15.123:0/3879387290 shutdown_connections 2024-09-15T23:24:58.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.957+0000 7f50594c3640 1 -- 172.21.15.123:0/3879387290 >> 172.21.15.123:0/3879387290 conn(0x7f505406c240 msgr2=0x7f5054072190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:58.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.957+0000 7f50594c3640 1 -- 172.21.15.123:0/3879387290 shutdown_connections 2024-09-15T23:24:58.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:58.957+0000 7f50594c3640 1 -- 172.21.15.123:0/3879387290 wait complete. 2024-09-15T23:24:58.969 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-15T23:24:59.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.066+0000 7fbddbc80640 1 Processor -- start 2024-09-15T23:24:59.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.066+0000 7fbddbc80640 1 -- start start 2024-09-15T23:24:59.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.067+0000 7fbddbc80640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fbdd40b2d40 0x7fbdd406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.067+0000 7fbddbc80640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbdd413eb20 0x7fbdd406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.067+0000 7fbddbc80640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdd4071180 con 0x7fbdd415bcf0 2024-09-15T23:24:59.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.067+0000 7fbddbc80640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fbdd415c890 con 0x7fbdd413eb20 2024-09-15T23:24:59.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.067+0000 7fbddbc80640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fbdd4071ab0 con 0x7fbdd40b2d40 2024-09-15T23:24:59.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.067+0000 7fbdd921b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbdd413eb20 0x7fbdd406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:59.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.067+0000 7fbdd921b640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbdd413eb20 0x7fbdd406c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48570/0 (socket says 172.21.15.123:48570) 2024-09-15T23:24:59.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.067+0000 7fbdd921b640 1 -- 172.21.15.123:0/1781657026 learned_addr learned my addr 172.21.15.123:0/1781657026 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:59.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.067+0000 7fbdd9a1c640 1 --2- 172.21.15.123:0/1781657026 >> v2:172.21.15.188:3300/0 conn(0x7fbdd40b2d40 0x7fbdd406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:59.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.067+0000 7fbdd921b640 1 -- 172.21.15.123:0/1781657026 >> v2:172.21.15.188:3300/0 conn(0x7fbdd40b2d40 msgr2=0x7fbdd406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:59.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.067+0000 7fbdd921b640 1 --2- 172.21.15.123:0/1781657026 >> v2:172.21.15.188:3300/0 conn(0x7fbdd40b2d40 0x7fbdd406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.067+0000 7fbdd921b640 1 -- 172.21.15.123:0/1781657026 >> v1:172.21.15.188:6789/0 conn(0x7fbdd415bcf0 legacy=0x7fbdd415c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:59.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.067+0000 7fbdd921b640 1 -- 172.21.15.123:0/1781657026 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd4071460 con 0x7fbdd413eb20 2024-09-15T23:24:59.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.067+0000 7fbdd9a1c640 1 --2- 172.21.15.123:0/1781657026 >> v2:172.21.15.188:3300/0 conn(0x7fbdd40b2d40 0x7fbdd406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:24:59.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.068+0000 7fbdd921b640 1 --2- 172.21.15.123:0/1781657026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdd413eb20 0x7fbdd406c150 secure :-1 s=READY pgs=2516 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4069be0 tx=0x7fbdc802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7205de117656e2c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:59.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.068+0000 7fbdd8a1a640 1 -- 172.21.15.123:0/1781657026 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8037070 con 0x7fbdd413eb20 2024-09-15T23:24:59.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.068+0000 7fbdd8a1a640 1 -- 172.21.15.123:0/1781657026 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc8032440 con 0x7fbdd413eb20 2024-09-15T23:24:59.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.068+0000 7fbdd8a1a640 1 -- 172.21.15.123:0/1781657026 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8032810 con 0x7fbdd413eb20 2024-09-15T23:24:59.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.069+0000 7fbddbc80640 1 -- 172.21.15.123:0/1781657026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdd413eb20 msgr2=0x7fbdd406c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:59.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.069+0000 7fbddbc80640 1 --2- 172.21.15.123:0/1781657026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdd413eb20 0x7fbdd406c150 secure :-1 s=READY pgs=2516 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4069be0 tx=0x7fbdc802a230 comp rx=0 tx=0).stop 2024-09-15T23:24:59.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.069+0000 7fbddbc80640 1 -- 172.21.15.123:0/1781657026 shutdown_connections 2024-09-15T23:24:59.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.069+0000 7fbddbc80640 1 --2- 172.21.15.123:0/1781657026 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdd413eb20 0x7fbdd406c150 unknown :-1 s=CLOSED pgs=2516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.069+0000 7fbddbc80640 1 --2- 172.21.15.123:0/1781657026 >> v2:172.21.15.188:3300/0 conn(0x7fbdd40b2d40 0x7fbdd406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.069+0000 7fbddbc80640 1 -- 172.21.15.123:0/1781657026 >> 172.21.15.123:0/1781657026 conn(0x7fbdd40ccec0 msgr2=0x7fbdd40cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:59.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.069+0000 7fbddbc80640 1 -- 172.21.15.123:0/1781657026 shutdown_connections 2024-09-15T23:24:59.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.069+0000 7fbddbc80640 1 -- 172.21.15.123:0/1781657026 wait complete. 2024-09-15T23:24:59.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.070+0000 7fbddbc80640 1 Processor -- start 2024-09-15T23:24:59.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.070+0000 7fbddbc80640 1 -- start start 2024-09-15T23:24:59.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.071+0000 7fbddbc80640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdd40b2d40 0x7fbdd4154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.071+0000 7fbddbc80640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbdd413eb20 0x7fbdd413d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.071+0000 7fbddbc80640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdd415bcf0 0x7fbdd413d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.071+0000 7fbddbc80640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd40720c0 con 0x7fbdd40b2d40 2024-09-15T23:24:59.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.071+0000 7fbddbc80640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd4071f40 con 0x7fbdd415bcf0 2024-09-15T23:24:59.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.071+0000 7fbddbc80640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fbdd4072240 con 0x7fbdd413eb20 2024-09-15T23:24:59.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.071+0000 7fbdd9a1c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdd40b2d40 0x7fbdd4154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:59.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.071+0000 7fbdd9a1c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdd40b2d40 0x7fbdd4154d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48576/0 (socket says 172.21.15.123:48576) 2024-09-15T23:24:59.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.071+0000 7fbdd9a1c640 1 -- 172.21.15.123:0/845567575 learned_addr learned my addr 172.21.15.123:0/845567575 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:59.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.071+0000 7fbdd921b640 1 --2- 172.21.15.123:0/845567575 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbdd413eb20 0x7fbdd413d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:59.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.071+0000 7fbdda21d640 1 --2- 172.21.15.123:0/845567575 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdd415bcf0 0x7fbdd413d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:59.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.071+0000 7fbdd9a1c640 1 -- 172.21.15.123:0/845567575 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbdd413eb20 msgr2=0x7fbdd413d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:59.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.071+0000 7fbdd9a1c640 1 --2- 172.21.15.123:0/845567575 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbdd413eb20 0x7fbdd413d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.071+0000 7fbdd9a1c640 1 -- 172.21.15.123:0/845567575 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdd415bcf0 msgr2=0x7fbdd413d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:59.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.071+0000 7fbdd9a1c640 1 --2- 172.21.15.123:0/845567575 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdd415bcf0 0x7fbdd413d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.071+0000 7fbdd9a1c640 1 -- 172.21.15.123:0/845567575 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd4158100 con 0x7fbdd40b2d40 2024-09-15T23:24:59.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.071+0000 7fbdda21d640 1 --2- 172.21.15.123:0/845567575 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdd415bcf0 0x7fbdd413d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:24:59.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.071+0000 7fbdd9a1c640 1 --2- 172.21.15.123:0/845567575 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdd40b2d40 0x7fbdd4154d40 secure :-1 s=READY pgs=2517 cs=0 l=1 rev1=1 crypto rx=0x7fbdc400cf90 tx=0x7fbdc400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:59.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.072+0000 7fbdd27fc640 1 -- 172.21.15.123:0/845567575 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc401a070 con 0x7fbdd40b2d40 2024-09-15T23:24:59.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.072+0000 7fbdd27fc640 1 -- 172.21.15.123:0/845567575 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc400d840 con 0x7fbdd40b2d40 2024-09-15T23:24:59.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.072+0000 7fbddbc80640 1 -- 172.21.15.123:0/845567575 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdd415cda0 con 0x7fbdd40b2d40 2024-09-15T23:24:59.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.072+0000 7fbdd27fc640 1 -- 172.21.15.123:0/845567575 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc400dc10 con 0x7fbdd40b2d40 2024-09-15T23:24:59.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.072+0000 7fbddbc80640 1 -- 172.21.15.123:0/845567575 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdd4157b40 con 0x7fbdd40b2d40 2024-09-15T23:24:59.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.073+0000 7fbddbc80640 1 -- 172.21.15.123:0/845567575 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdd40d0b10 con 0x7fbdd40b2d40 2024-09-15T23:24:59.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.073+0000 7fbdd27fc640 1 -- 172.21.15.123:0/845567575 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbdc401d070 con 0x7fbdd40b2d40 2024-09-15T23:24:59.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.074+0000 7fbdd27fc640 1 --2- 172.21.15.123:0/845567575 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbdc006c2e0 0x7fbdc006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.074+0000 7fbdd27fc640 1 -- 172.21.15.123:0/845567575 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 4943+0+0 (secure 0 0 0) 0x7fbdc408b7f0 con 0x7fbdd40b2d40 2024-09-15T23:24:59.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.074+0000 7fbdd921b640 1 --2- 172.21.15.123:0/845567575 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbdc006c2e0 0x7fbdc006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:59.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.074+0000 7fbdd921b640 1 --2- 172.21.15.123:0/845567575 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbdc006c2e0 0x7fbdc006e7a0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8034000 tx=0x7fbdc802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:59.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.078+0000 7fbdd27fc640 1 -- 172.21.15.123:0/845567575 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbdd40d0b10 con 0x7fbdd40b2d40 2024-09-15T23:24:59.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.244+0000 7fbddbc80640 1 -- 172.21.15.123:0/845567575 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fbdd40cf210 con 0x7fbdc006c2e0 2024-09-15T23:24:59.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.245+0000 7fbdd27fc640 1 -- 172.21.15.123:0/845567575 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbdd40cf210 con 0x7fbdc006c2e0 2024-09-15T23:24:59.246 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 5 to deep-scrub 2024-09-15T23:24:59.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.247+0000 7fbddbc80640 1 -- 172.21.15.123:0/845567575 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbdc006c2e0 msgr2=0x7fbdc006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:59.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.247+0000 7fbddbc80640 1 --2- 172.21.15.123:0/845567575 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbdc006c2e0 0x7fbdc006e7a0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8034000 tx=0x7fbdc802e000 comp rx=0 tx=0).stop 2024-09-15T23:24:59.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.247+0000 7fbddbc80640 1 -- 172.21.15.123:0/845567575 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdd40b2d40 msgr2=0x7fbdd4154d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:59.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.247+0000 7fbddbc80640 1 --2- 172.21.15.123:0/845567575 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdd40b2d40 0x7fbdd4154d40 secure :-1 s=READY pgs=2517 cs=0 l=1 rev1=1 crypto rx=0x7fbdc400cf90 tx=0x7fbdc400a7d0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.247+0000 7fbddbc80640 1 -- 172.21.15.123:0/845567575 shutdown_connections 2024-09-15T23:24:59.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.247+0000 7fbddbc80640 1 --2- 172.21.15.123:0/845567575 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fbdd415bcf0 0x7fbdd413d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.247+0000 7fbddbc80640 1 --2- 172.21.15.123:0/845567575 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fbdd413eb20 0x7fbdd413d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.247+0000 7fbddbc80640 1 --2- 172.21.15.123:0/845567575 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fbdc006c2e0 0x7fbdc006e7a0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.247+0000 7fbddbc80640 1 --2- 172.21.15.123:0/845567575 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbdd40b2d40 0x7fbdd4154d40 unknown :-1 s=CLOSED pgs=2517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.247+0000 7fbddbc80640 1 -- 172.21.15.123:0/845567575 >> 172.21.15.123:0/845567575 conn(0x7fbdd40ccec0 msgr2=0x7fbdd40d0400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:59.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.247+0000 7fbddbc80640 1 -- 172.21.15.123:0/845567575 shutdown_connections 2024-09-15T23:24:59.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.247+0000 7fbddbc80640 1 -- 172.21.15.123:0/845567575 wait complete. 2024-09-15T23:24:59.258 INFO:tasks.ceph:Scrubbing osd.6 2024-09-15T23:24:59.259 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-15T23:24:59.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.361+0000 7f8f5d6e4640 1 Processor -- start 2024-09-15T23:24:59.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.361+0000 7f8f5d6e4640 1 -- start start 2024-09-15T23:24:59.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.361+0000 7f8f5d6e4640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f8f580d16e0 0x7f8f580d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.361+0000 7f8f5d6e4640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f580cf060 con 0x7f8f5815ea90 2024-09-15T23:24:59.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.361+0000 7f8f5d6e4640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f580cf340 con 0x7f8f580d40b0 2024-09-15T23:24:59.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.361+0000 7f8f5d6e4640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f8f580d34c0 con 0x7f8f580d16e0 2024-09-15T23:24:59.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.362+0000 7f8f56ffd640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8f5815ea90 0x7f8f580d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55128/0 (socket says 172.21.15.123:55128) 2024-09-15T23:24:59.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.362+0000 7f8f56ffd640 1 -- 172.21.15.123:0/125476983 learned_addr learned my addr 172.21.15.123:0/125476983 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:59.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.362+0000 7f8f4e7fc640 1 --2- 172.21.15.123:0/125476983 >> v2:172.21.15.188:3300/0 conn(0x7f8f580d16e0 0x7f8f580d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:59.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.362+0000 7f8f567fc640 1 -- 172.21.15.123:0/125476983 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 959862603 0 0) 0x7f8f580cf060 con 0x7f8f5815ea90 2024-09-15T23:24:59.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.362+0000 7f8f567fc640 1 -- 172.21.15.123:0/125476983 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f44003520 con 0x7f8f5815ea90 2024-09-15T23:24:59.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.362+0000 7f8f567fc640 1 -- 172.21.15.123:0/125476983 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1826680869 0 0) 0x7f8f44003520 con 0x7f8f5815ea90 2024-09-15T23:24:59.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.362+0000 7f8f567fc640 1 -- 172.21.15.123:0/125476983 >> v2:172.21.15.188:3300/0 conn(0x7f8f580d16e0 msgr2=0x7f8f580d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:59.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.362+0000 7f8f567fc640 1 --2- 172.21.15.123:0/125476983 >> v2:172.21.15.188:3300/0 conn(0x7f8f580d16e0 0x7f8f580d2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.362+0000 7f8f567fc640 1 -- 172.21.15.123:0/125476983 >> v1:172.21.15.188:6789/0 conn(0x7f8f580d40b0 legacy=0x7f8f580b7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:59.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.362+0000 7f8f567fc640 1 -- 172.21.15.123:0/125476983 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f580cf620 con 0x7f8f5815ea90 2024-09-15T23:24:59.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.362+0000 7f8f567fc640 1 -- 172.21.15.123:0/125476983 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f8f48001670 con 0x7f8f5815ea90 2024-09-15T23:24:59.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.362+0000 7f8f567fc640 1 -- 172.21.15.123:0/125476983 >> v1:172.21.15.123:6789/0 conn(0x7f8f5815ea90 legacy=0x7f8f580d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:59.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.362+0000 7f8f567fc640 1 --2- 172.21.15.123:0/125476983 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8f440039b0 0x7f8f44003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.362+0000 7f8f567fc640 1 --2- 172.21.15.123:0/125476983 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f44004800 0x7f8f44004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.362+0000 7f8f567fc640 1 --2- 172.21.15.123:0/125476983 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f440051c0 0x7f8f4400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.362+0000 7f8f567fc640 1 -- 172.21.15.123:0/125476983 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8f580d34c0 con 0x7f8f44004800 2024-09-15T23:24:59.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.362+0000 7f8f567fc640 1 -- 172.21.15.123:0/125476983 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4400c160 con 0x7f8f440051c0 2024-09-15T23:24:59.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.362+0000 7f8f567fc640 1 -- 172.21.15.123:0/125476983 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8f4400c360 con 0x7f8f440039b0 2024-09-15T23:24:59.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.362+0000 7f8f4e7fc640 1 --2- 172.21.15.123:0/125476983 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f44004800 0x7f8f44004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:59.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.362+0000 7f8f56ffd640 1 --2- 172.21.15.123:0/125476983 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8f440039b0 0x7f8f44003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:59.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.362+0000 7f8f577fe640 1 --2- 172.21.15.123:0/125476983 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f440051c0 0x7f8f4400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:59.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.363+0000 7f8f4e7fc640 1 -- 172.21.15.123:0/125476983 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8f440039b0 msgr2=0x7f8f44003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:59.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.363+0000 7f8f4e7fc640 1 --2- 172.21.15.123:0/125476983 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8f440039b0 0x7f8f44003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.363+0000 7f8f4e7fc640 1 -- 172.21.15.123:0/125476983 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f440051c0 msgr2=0x7f8f4400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:59.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.363+0000 7f8f4e7fc640 1 --2- 172.21.15.123:0/125476983 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f440051c0 0x7f8f4400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.363+0000 7f8f577fe640 1 -- 172.21.15.123:0/125476983 reap_dead start 2024-09-15T23:24:59.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.363+0000 7f8f4e7fc640 1 -- 172.21.15.123:0/125476983 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f44003520 con 0x7f8f44004800 2024-09-15T23:24:59.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.363+0000 7f8f4e7fc640 1 --2- 172.21.15.123:0/125476983 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f44004800 0x7f8f44004c80 secure :-1 s=READY pgs=2519 cs=0 l=1 rev1=1 crypto rx=0x7f8f40009a90 tx=0x7f8f44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8b8367ae960a46 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:59.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.363+0000 7f8f567fc640 1 -- 172.21.15.123:0/125476983 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f40036070 con 0x7f8f44004800 2024-09-15T23:24:59.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.363+0000 7f8f567fc640 1 -- 172.21.15.123:0/125476983 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f40031400 con 0x7f8f44004800 2024-09-15T23:24:59.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.363+0000 7f8f567fc640 1 -- 172.21.15.123:0/125476983 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f40009690 con 0x7f8f44004800 2024-09-15T23:24:59.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.364+0000 7f8f5d6e4640 1 -- 172.21.15.123:0/125476983 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f44004800 msgr2=0x7f8f44004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:59.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.364+0000 7f8f5d6e4640 1 --2- 172.21.15.123:0/125476983 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f44004800 0x7f8f44004c80 secure :-1 s=READY pgs=2519 cs=0 l=1 rev1=1 crypto rx=0x7f8f40009a90 tx=0x7f8f44005830 comp rx=0 tx=0).stop 2024-09-15T23:24:59.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.364+0000 7f8f5d6e4640 1 -- 172.21.15.123:0/125476983 shutdown_connections 2024-09-15T23:24:59.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.364+0000 7f8f5d6e4640 1 --2- 172.21.15.123:0/125476983 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f44004800 0x7f8f44004c80 unknown :-1 s=CLOSED pgs=2519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.364+0000 7f8f5d6e4640 1 -- 172.21.15.123:0/125476983 >> 172.21.15.123:0/125476983 conn(0x7f8f5806c0e0 msgr2=0x7f8f5806c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:59.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.364+0000 7f8f5d6e4640 1 -- 172.21.15.123:0/125476983 shutdown_connections 2024-09-15T23:24:59.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.364+0000 7f8f5d6e4640 1 -- 172.21.15.123:0/125476983 wait complete. 2024-09-15T23:24:59.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.365+0000 7f8f5d6e4640 1 Processor -- start 2024-09-15T23:24:59.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.365+0000 7f8f5d6e4640 1 -- start start 2024-09-15T23:24:59.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.366+0000 7f8f5d6e4640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f44004800 0x7f8f5815a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.366+0000 7f8f5d6e4640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8f5815c550 0x7f8f580cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.366+0000 7f8f5d6e4640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f580ce0b0 0x7f8f580b5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.366+0000 7f8f5d6e4640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8f5815ee70 con 0x7f8f44004800 2024-09-15T23:24:59.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.366+0000 7f8f5d6e4640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f8f580cfbe0 con 0x7f8f580ce0b0 2024-09-15T23:24:59.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.366+0000 7f8f5d6e4640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f8f580d2f80 con 0x7f8f5815c550 2024-09-15T23:24:59.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.366+0000 7f8f56ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f44004800 0x7f8f5815a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:59.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.366+0000 7f8f56ffd640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f44004800 0x7f8f5815a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48600/0 (socket says 172.21.15.123:48600) 2024-09-15T23:24:59.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.366+0000 7f8f56ffd640 1 -- 172.21.15.123:0/3985981257 learned_addr learned my addr 172.21.15.123:0/3985981257 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:59.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.366+0000 7f8f56ffd640 1 -- 172.21.15.123:0/3985981257 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8f5815c550 msgr2=0x7f8f580cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:59.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.366+0000 7f8f56ffd640 1 --2- 172.21.15.123:0/3985981257 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f8f5815c550 0x7f8f580cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.366+0000 7f8f56ffd640 1 -- 172.21.15.123:0/3985981257 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f580ce0b0 msgr2=0x7f8f580b5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:59.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.366+0000 7f8f56ffd640 1 --2- 172.21.15.123:0/3985981257 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f8f580ce0b0 0x7f8f580b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.366+0000 7f8f56ffd640 1 -- 172.21.15.123:0/3985981257 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f580cb9e0 con 0x7f8f44004800 2024-09-15T23:24:59.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.367+0000 7f8f56ffd640 1 --2- 172.21.15.123:0/3985981257 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f44004800 0x7f8f5815a6d0 secure :-1 s=READY pgs=2520 cs=0 l=1 rev1=1 crypto rx=0x7f8f48001b80 tx=0x7f8f48007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:59.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.367+0000 7f8f4ffff640 1 -- 172.21.15.123:0/3985981257 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4800f9f0 con 0x7f8f44004800 2024-09-15T23:24:59.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.367+0000 7f8f4ffff640 1 -- 172.21.15.123:0/3985981257 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f48018070 con 0x7f8f44004800 2024-09-15T23:24:59.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.367+0000 7f8f4ffff640 1 -- 172.21.15.123:0/3985981257 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4800fe10 con 0x7f8f44004800 2024-09-15T23:24:59.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.367+0000 7f8f5d6e4640 1 -- 172.21.15.123:0/3985981257 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f580cbcc0 con 0x7f8f44004800 2024-09-15T23:24:59.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.367+0000 7f8f5d6e4640 1 -- 172.21.15.123:0/3985981257 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f580cc280 con 0x7f8f44004800 2024-09-15T23:24:59.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.368+0000 7f8f5d6e4640 1 -- 172.21.15.123:0/3985981257 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8f580d0fd0 con 0x7f8f44004800 2024-09-15T23:24:59.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.368+0000 7f8f4ffff640 1 -- 172.21.15.123:0/3985981257 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8f4801d460 con 0x7f8f44004800 2024-09-15T23:24:59.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.369+0000 7f8f4ffff640 1 --2- 172.21.15.123:0/3985981257 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8f3806c2e0 0x7f8f3806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.369+0000 7f8f4ffff640 1 -- 172.21.15.123:0/3985981257 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 4943+0+0 (secure 0 0 0) 0x7f8f4808b3e0 con 0x7f8f44004800 2024-09-15T23:24:59.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.369+0000 7f8f4ffff640 1 --2- 172.21.15.123:0/3985981257 >> [v2:172.21.15.188:6816/226100332,v1:172.21.15.188:6817/226100332] conn(0x7f8f380721a0 0x7f8f380745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.369+0000 7f8f4ffff640 1 -- 172.21.15.123:0/3985981257 --> [v2:172.21.15.188:6816/226100332,v1:172.21.15.188:6817/226100332] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8f4800f020 con 0x7f8f380721a0 2024-09-15T23:24:59.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.369+0000 7f8f4ffff640 1 -- 172.21.15.123:0/3985981257 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=209) ==== 24+0+0 (secure 0 0 0) 0x7f8f48092050 con 0x7f8f44004800 2024-09-15T23:24:59.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.369+0000 7f8f4e7fc640 1 --2- 172.21.15.123:0/3985981257 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8f3806c2e0 0x7f8f3806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:59.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.369+0000 7f8f577fe640 1 --2- 172.21.15.123:0/3985981257 >> [v2:172.21.15.188:6816/226100332,v1:172.21.15.188:6817/226100332] conn(0x7f8f380721a0 0x7f8f380745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:59.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.370+0000 7f8f4e7fc640 1 --2- 172.21.15.123:0/3985981257 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8f3806c2e0 0x7f8f3806e7a0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f8f40033000 tx=0x7f8f4002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:59.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.370+0000 7f8f577fe640 1 --2- 172.21.15.123:0/3985981257 >> [v2:172.21.15.188:6816/226100332,v1:172.21.15.188:6817/226100332] conn(0x7f8f380721a0 0x7f8f380745c0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:59.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.370+0000 7f8f4ffff640 1 -- 172.21.15.123:0/3985981257 <== osd.6 v2:172.21.15.188:6816/226100332 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8f4800f020 con 0x7f8f380721a0 2024-09-15T23:24:59.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.383+0000 7f8f5d6e4640 1 -- 172.21.15.123:0/3985981257 --> [v2:172.21.15.188:6816/226100332,v1:172.21.15.188:6817/226100332] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8f580b92e0 con 0x7f8f380721a0 2024-09-15T23:24:59.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.383+0000 7f8f4ffff640 1 -- 172.21.15.123:0/3985981257 <== osd.6 v2:172.21.15.188:6816/226100332 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8f580b92e0 con 0x7f8f380721a0 2024-09-15T23:24:59.384 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:24:59.385 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T23:24:59.385 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:24:59.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.384+0000 7f8f5d6e4640 1 -- 172.21.15.123:0/3985981257 >> [v2:172.21.15.188:6816/226100332,v1:172.21.15.188:6817/226100332] conn(0x7f8f380721a0 msgr2=0x7f8f380745c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:59.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.384+0000 7f8f5d6e4640 1 --2- 172.21.15.123:0/3985981257 >> [v2:172.21.15.188:6816/226100332,v1:172.21.15.188:6817/226100332] conn(0x7f8f380721a0 0x7f8f380745c0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.384+0000 7f8f5d6e4640 1 -- 172.21.15.123:0/3985981257 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8f3806c2e0 msgr2=0x7f8f3806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:59.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.384+0000 7f8f5d6e4640 1 --2- 172.21.15.123:0/3985981257 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f8f3806c2e0 0x7f8f3806e7a0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f8f40033000 tx=0x7f8f4002e000 comp rx=0 tx=0).stop 2024-09-15T23:24:59.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.384+0000 7f8f5d6e4640 1 -- 172.21.15.123:0/3985981257 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f44004800 msgr2=0x7f8f5815a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:59.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.384+0000 7f8f5d6e4640 1 --2- 172.21.15.123:0/3985981257 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f44004800 0x7f8f5815a6d0 secure :-1 s=READY pgs=2520 cs=0 l=1 rev1=1 crypto rx=0x7f8f48001b80 tx=0x7f8f48007720 comp rx=0 tx=0).stop 2024-09-15T23:24:59.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.384+0000 7f8f577fe640 1 -- 172.21.15.123:0/3985981257 reap_dead start 2024-09-15T23:24:59.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.384+0000 7f8f5d6e4640 1 -- 172.21.15.123:0/3985981257 shutdown_connections 2024-09-15T23:24:59.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.384+0000 7f8f5d6e4640 1 -- 172.21.15.123:0/3985981257 >> 172.21.15.123:0/3985981257 conn(0x7f8f5806c0e0 msgr2=0x7f8f580c95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:59.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.384+0000 7f8f5d6e4640 1 -- 172.21.15.123:0/3985981257 shutdown_connections 2024-09-15T23:24:59.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.384+0000 7f8f5d6e4640 1 -- 172.21.15.123:0/3985981257 wait complete. 2024-09-15T23:24:59.395 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-15T23:24:59.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.494+0000 7f65b3d31640 1 Processor -- start 2024-09-15T23:24:59.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.494+0000 7f65b3d31640 1 -- start start 2024-09-15T23:24:59.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.495+0000 7f65b3d31640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f65ac15e6d0 0x7f65ac071390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.495+0000 7f65b3d31640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65ac15eab0 con 0x7f65ac06cd20 2024-09-15T23:24:59.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.495+0000 7f65b3d31640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65ac15ed70 con 0x7f65ac070b80 2024-09-15T23:24:59.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.495+0000 7f65b3d31640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f65ac15f050 con 0x7f65ac15e6d0 2024-09-15T23:24:59.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.495+0000 7f65b12cc640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f65ac06cd20 0x7f65ac0b6d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55136/0 (socket says 172.21.15.123:55136) 2024-09-15T23:24:59.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.495+0000 7f65b12cc640 1 -- 172.21.15.123:0/2989310581 learned_addr learned my addr 172.21.15.123:0/2989310581 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:59.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.495+0000 7f65b0acb640 1 -- 172.21.15.123:0/2989310581 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2612710449 0 0) 0x7f65ac15eab0 con 0x7f65ac06cd20 2024-09-15T23:24:59.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.495+0000 7f65b0acb640 1 -- 172.21.15.123:0/2989310581 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6598003520 con 0x7f65ac06cd20 2024-09-15T23:24:59.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.495+0000 7f65b1acd640 1 --2- 172.21.15.123:0/2989310581 >> v2:172.21.15.188:3300/0 conn(0x7f65ac15e6d0 0x7f65ac071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:59.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.495+0000 7f65b0acb640 1 -- 172.21.15.123:0/2989310581 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3687646244 0 0) 0x7f6598003520 con 0x7f65ac06cd20 2024-09-15T23:24:59.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.495+0000 7f65b0acb640 1 -- 172.21.15.123:0/2989310581 >> v2:172.21.15.188:3300/0 conn(0x7f65ac15e6d0 msgr2=0x7f65ac071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:59.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.495+0000 7f65b0acb640 1 --2- 172.21.15.123:0/2989310581 >> v2:172.21.15.188:3300/0 conn(0x7f65ac15e6d0 0x7f65ac071390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.495+0000 7f65b0acb640 1 -- 172.21.15.123:0/2989310581 >> v1:172.21.15.188:6789/0 conn(0x7f65ac070b80 legacy=0x7f65ac1622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:59.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.495+0000 7f65b0acb640 1 -- 172.21.15.123:0/2989310581 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65ac15f330 con 0x7f65ac06cd20 2024-09-15T23:24:59.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.495+0000 7f65b0acb640 1 -- 172.21.15.123:0/2989310581 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f659c001670 con 0x7f65ac06cd20 2024-09-15T23:24:59.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.495+0000 7f65b0acb640 1 -- 172.21.15.123:0/2989310581 >> v1:172.21.15.123:6789/0 conn(0x7f65ac06cd20 legacy=0x7f65ac0b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:59.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.495+0000 7f65b0acb640 1 --2- 172.21.15.123:0/2989310581 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65980039b0 0x7f6598003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.496+0000 7f65b0acb640 1 --2- 172.21.15.123:0/2989310581 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6598004800 0x7f6598004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.496+0000 7f65b0acb640 1 --2- 172.21.15.123:0/2989310581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65980051c0 0x7f659800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.496+0000 7f65b0acb640 1 -- 172.21.15.123:0/2989310581 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f65ac15f050 con 0x7f65980051c0 2024-09-15T23:24:59.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.496+0000 7f65b0acb640 1 -- 172.21.15.123:0/2989310581 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f659800c060 con 0x7f65980039b0 2024-09-15T23:24:59.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.496+0000 7f65b0acb640 1 -- 172.21.15.123:0/2989310581 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f659800c260 con 0x7f6598004800 2024-09-15T23:24:59.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.496+0000 7f65b22ce640 1 --2- 172.21.15.123:0/2989310581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65980051c0 0x7f659800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:59.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.496+0000 7f65b1acd640 1 --2- 172.21.15.123:0/2989310581 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65980039b0 0x7f6598003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:59.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.496+0000 7f65b12cc640 1 --2- 172.21.15.123:0/2989310581 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6598004800 0x7f6598004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:59.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.496+0000 7f65b22ce640 1 -- 172.21.15.123:0/2989310581 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6598004800 msgr2=0x7f6598004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:59.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.496+0000 7f65b22ce640 1 --2- 172.21.15.123:0/2989310581 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6598004800 0x7f6598004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.496+0000 7f65b22ce640 1 -- 172.21.15.123:0/2989310581 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65980039b0 msgr2=0x7f6598003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:59.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.496+0000 7f65b22ce640 1 --2- 172.21.15.123:0/2989310581 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65980039b0 0x7f6598003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.496+0000 7f65b22ce640 1 -- 172.21.15.123:0/2989310581 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6598003520 con 0x7f65980051c0 2024-09-15T23:24:59.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.496+0000 7f65b1acd640 1 --2- 172.21.15.123:0/2989310581 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65980039b0 0x7f6598003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:24:59.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.496+0000 7f65b12cc640 1 --2- 172.21.15.123:0/2989310581 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6598004800 0x7f6598004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:24:59.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.497+0000 7f65b22ce640 1 -- 172.21.15.123:0/2989310581 reap_dead start 2024-09-15T23:24:59.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.497+0000 7f65b22ce640 1 --2- 172.21.15.123:0/2989310581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65980051c0 0x7f659800b9c0 secure :-1 s=READY pgs=2522 cs=0 l=1 rev1=1 crypto rx=0x7f65a4001e50 tx=0x7f6598005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aac914a643d78d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:59.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.497+0000 7f65b0acb640 1 -- 172.21.15.123:0/2989310581 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a8009690 con 0x7f65980051c0 2024-09-15T23:24:59.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.497+0000 7f65b0acb640 1 -- 172.21.15.123:0/2989310581 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a4003970 con 0x7f65980051c0 2024-09-15T23:24:59.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.497+0000 7f65b0acb640 1 -- 172.21.15.123:0/2989310581 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a4001a70 con 0x7f65980051c0 2024-09-15T23:24:59.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.497+0000 7f65b3d31640 1 -- 172.21.15.123:0/2989310581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65980051c0 msgr2=0x7f659800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:59.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.497+0000 7f65b3d31640 1 --2- 172.21.15.123:0/2989310581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65980051c0 0x7f659800b9c0 secure :-1 s=READY pgs=2522 cs=0 l=1 rev1=1 crypto rx=0x7f65a4001e50 tx=0x7f6598005830 comp rx=0 tx=0).stop 2024-09-15T23:24:59.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.497+0000 7f65b3d31640 1 -- 172.21.15.123:0/2989310581 shutdown_connections 2024-09-15T23:24:59.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.497+0000 7f65b3d31640 1 --2- 172.21.15.123:0/2989310581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65980051c0 0x7f659800b9c0 unknown :-1 s=CLOSED pgs=2522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.497+0000 7f65b3d31640 1 -- 172.21.15.123:0/2989310581 >> 172.21.15.123:0/2989310581 conn(0x7f65ac067fb0 msgr2=0x7f65ac06f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:59.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.497+0000 7f65b3d31640 1 -- 172.21.15.123:0/2989310581 shutdown_connections 2024-09-15T23:24:59.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.497+0000 7f65b3d31640 1 -- 172.21.15.123:0/2989310581 wait complete. 2024-09-15T23:24:59.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.499+0000 7f65b3d31640 1 Processor -- start 2024-09-15T23:24:59.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.499+0000 7f65b3d31640 1 -- start start 2024-09-15T23:24:59.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.499+0000 7f65b3d31640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65980051c0 0x7f65ac15aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.499+0000 7f65b3d31640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65ac14f200 0x7f65ac15d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.499+0000 7f65b3d31640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f65ac15da90 0x7f65ac152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.499+0000 7f65b3d31640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f65ac071390 con 0x7f65ac14f200 2024-09-15T23:24:59.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.499+0000 7f65b3d31640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f65ac15f8f0 con 0x7f65980051c0 2024-09-15T23:24:59.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.499+0000 7f65b3d31640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f65ac071510 con 0x7f65ac15da90 2024-09-15T23:24:59.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.499+0000 7f65b12cc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65ac14f200 0x7f65ac15d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:59.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.499+0000 7f65b12cc640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65ac14f200 0x7f65ac15d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48620/0 (socket says 172.21.15.123:48620) 2024-09-15T23:24:59.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.499+0000 7f65b12cc640 1 -- 172.21.15.123:0/2547594924 learned_addr learned my addr 172.21.15.123:0/2547594924 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:59.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.500+0000 7f65b22ce640 1 --2- 172.21.15.123:0/2547594924 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f65ac15da90 0x7f65ac152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:59.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.500+0000 7f65b1acd640 1 --2- 172.21.15.123:0/2547594924 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65980051c0 0x7f65ac15aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:59.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.500+0000 7f65b12cc640 1 -- 172.21.15.123:0/2547594924 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f65ac15da90 msgr2=0x7f65ac152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:59.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.500+0000 7f65b12cc640 1 --2- 172.21.15.123:0/2547594924 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f65ac15da90 0x7f65ac152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.500+0000 7f65b12cc640 1 -- 172.21.15.123:0/2547594924 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65980051c0 msgr2=0x7f65ac15aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:59.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.500+0000 7f65b12cc640 1 --2- 172.21.15.123:0/2547594924 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65980051c0 0x7f65ac15aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.500+0000 7f65b12cc640 1 -- 172.21.15.123:0/2547594924 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65ac1539b0 con 0x7f65ac14f200 2024-09-15T23:24:59.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.500+0000 7f65b12cc640 1 --2- 172.21.15.123:0/2547594924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65ac14f200 0x7f65ac15d550 secure :-1 s=READY pgs=2523 cs=0 l=1 rev1=1 crypto rx=0x7f659c00e7f0 tx=0x7f659c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:59.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.500+0000 7f65a27fc640 1 -- 172.21.15.123:0/2547594924 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f659c00c870 con 0x7f65ac14f200 2024-09-15T23:24:59.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.500+0000 7f65a27fc640 1 -- 172.21.15.123:0/2547594924 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f659c018070 con 0x7f65ac14f200 2024-09-15T23:24:59.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.500+0000 7f65a27fc640 1 -- 172.21.15.123:0/2547594924 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f659c00cc10 con 0x7f65ac14f200 2024-09-15T23:24:59.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.500+0000 7f65b3d31640 1 -- 172.21.15.123:0/2547594924 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65ac153c50 con 0x7f65ac14f200 2024-09-15T23:24:59.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.500+0000 7f65b3d31640 1 -- 172.21.15.123:0/2547594924 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65ac154210 con 0x7f65ac14f200 2024-09-15T23:24:59.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.501+0000 7f65b3d31640 1 -- 172.21.15.123:0/2547594924 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65ac0718a0 con 0x7f65ac14f200 2024-09-15T23:24:59.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.502+0000 7f65a27fc640 1 -- 172.21.15.123:0/2547594924 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f659c01d460 con 0x7f65ac14f200 2024-09-15T23:24:59.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.502+0000 7f65a27fc640 1 --2- 172.21.15.123:0/2547594924 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f659006c2b0 0x7f659006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.502+0000 7f65a27fc640 1 -- 172.21.15.123:0/2547594924 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 4943+0+0 (secure 0 0 0) 0x7f659c08b0a0 con 0x7f65ac14f200 2024-09-15T23:24:59.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.502+0000 7f65b1acd640 1 --2- 172.21.15.123:0/2547594924 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f659006c2b0 0x7f659006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:59.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.503+0000 7f65b1acd640 1 --2- 172.21.15.123:0/2547594924 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f659006c2b0 0x7f659006e770 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f65a8009a80 tx=0x7f65a8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:59.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.506+0000 7f65a27fc640 1 -- 172.21.15.123:0/2547594924 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f659c059a80 con 0x7f65ac14f200 2024-09-15T23:24:59.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.671+0000 7f65b3d31640 1 -- 172.21.15.123:0/2547594924 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f65ac160b90 con 0x7f659006c2b0 2024-09-15T23:24:59.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.672+0000 7f65a27fc640 1 -- 172.21.15.123:0/2547594924 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f65ac160b90 con 0x7f659006c2b0 2024-09-15T23:24:59.673 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 6 to deep-scrub 2024-09-15T23:24:59.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.674+0000 7f65b3d31640 1 -- 172.21.15.123:0/2547594924 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f659006c2b0 msgr2=0x7f659006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:59.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.674+0000 7f65b3d31640 1 --2- 172.21.15.123:0/2547594924 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f659006c2b0 0x7f659006e770 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f65a8009a80 tx=0x7f65a8008040 comp rx=0 tx=0).stop 2024-09-15T23:24:59.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.674+0000 7f65b3d31640 1 -- 172.21.15.123:0/2547594924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65ac14f200 msgr2=0x7f65ac15d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:59.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.674+0000 7f65b3d31640 1 --2- 172.21.15.123:0/2547594924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65ac14f200 0x7f65ac15d550 secure :-1 s=READY pgs=2523 cs=0 l=1 rev1=1 crypto rx=0x7f659c00e7f0 tx=0x7f659c00ecb0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.674+0000 7f65b3d31640 1 -- 172.21.15.123:0/2547594924 shutdown_connections 2024-09-15T23:24:59.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.674+0000 7f65b3d31640 1 --2- 172.21.15.123:0/2547594924 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f65ac15da90 0x7f65ac152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.674+0000 7f65b3d31640 1 --2- 172.21.15.123:0/2547594924 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f659006c2b0 0x7f659006e770 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.674+0000 7f65b3d31640 1 --2- 172.21.15.123:0/2547594924 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65ac14f200 0x7f65ac15d550 unknown :-1 s=CLOSED pgs=2523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.674+0000 7f65b3d31640 1 --2- 172.21.15.123:0/2547594924 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f65980051c0 0x7f65ac15aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.674+0000 7f65b3d31640 1 -- 172.21.15.123:0/2547594924 >> 172.21.15.123:0/2547594924 conn(0x7f65ac067fb0 msgr2=0x7f65ac162a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:59.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.674+0000 7f65b3d31640 1 -- 172.21.15.123:0/2547594924 shutdown_connections 2024-09-15T23:24:59.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.674+0000 7f65b3d31640 1 -- 172.21.15.123:0/2547594924 wait complete. 2024-09-15T23:24:59.685 INFO:tasks.ceph:Scrubbing osd.7 2024-09-15T23:24:59.686 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-15T23:24:59.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.787+0000 7fcc4ca8d640 1 Processor -- start 2024-09-15T23:24:59.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.787+0000 7fcc4ca8d640 1 -- start start 2024-09-15T23:24:59.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.788+0000 7fcc4ca8d640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7fcc480d0b10 0x7fcc480d22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.788+0000 7fcc4ca8d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcc480d0ef0 0x7fcc480cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.788+0000 7fcc4ca8d640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc480d2830 con 0x7fcc480cf4c0 2024-09-15T23:24:59.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.788+0000 7fcc4ca8d640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7fcc48073b30 con 0x7fcc480d0b10 2024-09-15T23:24:59.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.788+0000 7fcc4ca8d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fcc480b48a0 con 0x7fcc480d0ef0 2024-09-15T23:24:59.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.788+0000 7fcc46d9d640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fcc480cf4c0 0x7fcc48160330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55152/0 (socket says 172.21.15.123:55152) 2024-09-15T23:24:59.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.788+0000 7fcc46d9d640 1 -- 172.21.15.123:0/658096499 learned_addr learned my addr 172.21.15.123:0/658096499 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:59.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.788+0000 7fcc4659c640 1 --2- 172.21.15.123:0/658096499 >> v2:172.21.15.188:3300/0 conn(0x7fcc480d0b10 0x7fcc480d22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:59.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.788+0000 7fcc45d9b640 1 --2- 172.21.15.123:0/658096499 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcc480d0ef0 0x7fcc480cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:59.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.788+0000 7fcc4559a640 1 -- 172.21.15.123:0/658096499 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2327879275 0 0) 0x7fcc480d2830 con 0x7fcc480cf4c0 2024-09-15T23:24:59.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.788+0000 7fcc4559a640 1 -- 172.21.15.123:0/658096499 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc30003520 con 0x7fcc480cf4c0 2024-09-15T23:24:59.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.789+0000 7fcc4559a640 1 -- 172.21.15.123:0/658096499 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3202051334 0 0) 0x7fcc30003520 con 0x7fcc480cf4c0 2024-09-15T23:24:59.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.789+0000 7fcc4559a640 1 -- 172.21.15.123:0/658096499 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcc480d0ef0 msgr2=0x7fcc480cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:59.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.789+0000 7fcc4559a640 1 --2- 172.21.15.123:0/658096499 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcc480d0ef0 0x7fcc480cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.789+0000 7fcc4559a640 1 -- 172.21.15.123:0/658096499 >> v2:172.21.15.188:3300/0 conn(0x7fcc480d0b10 msgr2=0x7fcc480d22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:59.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.789+0000 7fcc4559a640 1 --2- 172.21.15.123:0/658096499 >> v2:172.21.15.188:3300/0 conn(0x7fcc480d0b10 0x7fcc480d22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.789+0000 7fcc4559a640 1 -- 172.21.15.123:0/658096499 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc480b74f0 con 0x7fcc480cf4c0 2024-09-15T23:24:59.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.789+0000 7fcc4559a640 1 -- 172.21.15.123:0/658096499 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7fcc400019f0 con 0x7fcc480cf4c0 2024-09-15T23:24:59.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.789+0000 7fcc4559a640 1 -- 172.21.15.123:0/658096499 >> v1:172.21.15.123:6789/0 conn(0x7fcc480cf4c0 legacy=0x7fcc48160330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:59.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.789+0000 7fcc4559a640 1 --2- 172.21.15.123:0/658096499 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcc480d0ef0 0x7fcc300039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.789+0000 7fcc4559a640 1 --2- 172.21.15.123:0/658096499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc30003f30 0x7fcc30004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.789+0000 7fcc4559a640 1 --2- 172.21.15.123:0/658096499 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc30004d40 0x7fcc300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.789+0000 7fcc4559a640 1 -- 172.21.15.123:0/658096499 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcc480b48a0 con 0x7fcc30004d40 2024-09-15T23:24:59.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.789+0000 7fcc4559a640 1 -- 172.21.15.123:0/658096499 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3000b9c0 con 0x7fcc30003f30 2024-09-15T23:24:59.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.789+0000 7fcc4559a640 1 -- 172.21.15.123:0/658096499 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fcc3000bb40 con 0x7fcc480d0ef0 2024-09-15T23:24:59.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.789+0000 7fcc46d9d640 1 --2- 172.21.15.123:0/658096499 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc30004d40 0x7fcc300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:59.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.789+0000 7fcc4659c640 1 --2- 172.21.15.123:0/658096499 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcc480d0ef0 0x7fcc300039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:59.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.789+0000 7fcc45d9b640 1 --2- 172.21.15.123:0/658096499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc30003f30 0x7fcc30004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:59.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.789+0000 7fcc46d9d640 1 -- 172.21.15.123:0/658096499 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcc480d0ef0 msgr2=0x7fcc300039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:59.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.789+0000 7fcc46d9d640 1 --2- 172.21.15.123:0/658096499 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcc480d0ef0 0x7fcc300039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.789+0000 7fcc46d9d640 1 -- 172.21.15.123:0/658096499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc30003f30 msgr2=0x7fcc30004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:59.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.789+0000 7fcc46d9d640 1 --2- 172.21.15.123:0/658096499 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc30003f30 0x7fcc30004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.789+0000 7fcc46d9d640 1 -- 172.21.15.123:0/658096499 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc30003520 con 0x7fcc30004d40 2024-09-15T23:24:59.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.790+0000 7fcc46d9d640 1 --2- 172.21.15.123:0/658096499 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc30004d40 0x7fcc300051c0 secure :-1 s=READY pgs=2525 cs=0 l=1 rev1=1 crypto rx=0x7fcc4000a870 tx=0x7fcc30005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573fb57b524a084b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:59.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.790+0000 7fcc4559a640 1 -- 172.21.15.123:0/658096499 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc4000a4c0 con 0x7fcc30004d40 2024-09-15T23:24:59.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.790+0000 7fcc4559a640 1 -- 172.21.15.123:0/658096499 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc4002f070 con 0x7fcc30004d40 2024-09-15T23:24:59.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.790+0000 7fcc4559a640 1 -- 172.21.15.123:0/658096499 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc4002bcb0 con 0x7fcc30004d40 2024-09-15T23:24:59.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.791+0000 7fcc4ca8d640 1 -- 172.21.15.123:0/658096499 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc30004d40 msgr2=0x7fcc300051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:59.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.791+0000 7fcc4ca8d640 1 --2- 172.21.15.123:0/658096499 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc30004d40 0x7fcc300051c0 secure :-1 s=READY pgs=2525 cs=0 l=1 rev1=1 crypto rx=0x7fcc4000a870 tx=0x7fcc30005830 comp rx=0 tx=0).stop 2024-09-15T23:24:59.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.791+0000 7fcc46d9d640 1 -- 172.21.15.123:0/658096499 reap_dead start 2024-09-15T23:24:59.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.791+0000 7fcc4ca8d640 1 -- 172.21.15.123:0/658096499 shutdown_connections 2024-09-15T23:24:59.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.791+0000 7fcc4ca8d640 1 -- 172.21.15.123:0/658096499 >> 172.21.15.123:0/658096499 conn(0x7fcc48067950 msgr2=0x7fcc48067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:59.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.791+0000 7fcc4ca8d640 1 -- 172.21.15.123:0/658096499 shutdown_connections 2024-09-15T23:24:59.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.791+0000 7fcc4ca8d640 1 -- 172.21.15.123:0/658096499 wait complete. 2024-09-15T23:24:59.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.792+0000 7fcc4ca8d640 1 Processor -- start 2024-09-15T23:24:59.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.792+0000 7fcc4ca8d640 1 -- start start 2024-09-15T23:24:59.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.793+0000 7fcc4ca8d640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc30004d40 0x7fcc4806e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.793+0000 7fcc4ca8d640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcc480b3bf0 0x7fcc48158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.793+0000 7fcc4ca8d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc480ae870 0x7fcc480aecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.793+0000 7fcc4ca8d640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcc480b4530 con 0x7fcc480ae870 2024-09-15T23:24:59.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.793+0000 7fcc4ca8d640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fcc480b4250 con 0x7fcc30004d40 2024-09-15T23:24:59.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.793+0000 7fcc4ca8d640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fcc480b6940 con 0x7fcc480b3bf0 2024-09-15T23:24:59.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.793+0000 7fcc46d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc480ae870 0x7fcc480aecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:59.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.793+0000 7fcc46d9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc480ae870 0x7fcc480aecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48634/0 (socket says 172.21.15.123:48634) 2024-09-15T23:24:59.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.793+0000 7fcc46d9d640 1 -- 172.21.15.123:0/3020893265 learned_addr learned my addr 172.21.15.123:0/3020893265 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:59.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.793+0000 7fcc45d9b640 1 --2- 172.21.15.123:0/3020893265 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcc480b3bf0 0x7fcc48158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:59.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.793+0000 7fcc4659c640 1 --2- 172.21.15.123:0/3020893265 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc30004d40 0x7fcc4806e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:59.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.793+0000 7fcc46d9d640 1 -- 172.21.15.123:0/3020893265 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcc480b3bf0 msgr2=0x7fcc48158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:59.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.793+0000 7fcc46d9d640 1 --2- 172.21.15.123:0/3020893265 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fcc480b3bf0 0x7fcc48158080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.793+0000 7fcc46d9d640 1 -- 172.21.15.123:0/3020893265 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc30004d40 msgr2=0x7fcc4806e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:59.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.793+0000 7fcc46d9d640 1 --2- 172.21.15.123:0/3020893265 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fcc30004d40 0x7fcc4806e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.793+0000 7fcc46d9d640 1 -- 172.21.15.123:0/3020893265 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc481585c0 con 0x7fcc480ae870 2024-09-15T23:24:59.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.793+0000 7fcc46d9d640 1 --2- 172.21.15.123:0/3020893265 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc480ae870 0x7fcc480aecf0 secure :-1 s=READY pgs=2526 cs=0 l=1 rev1=1 crypto rx=0x7fcc4002b520 tx=0x7fcc40001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:59.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.793+0000 7fcc36ffd640 1 -- 172.21.15.123:0/3020893265 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc4000a4c0 con 0x7fcc480ae870 2024-09-15T23:24:59.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.793+0000 7fcc36ffd640 1 -- 172.21.15.123:0/3020893265 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc40034470 con 0x7fcc480ae870 2024-09-15T23:24:59.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.793+0000 7fcc4ca8d640 1 -- 172.21.15.123:0/3020893265 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc48158860 con 0x7fcc480ae870 2024-09-15T23:24:59.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.793+0000 7fcc36ffd640 1 -- 172.21.15.123:0/3020893265 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc40002030 con 0x7fcc480ae870 2024-09-15T23:24:59.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.793+0000 7fcc4ca8d640 1 -- 172.21.15.123:0/3020893265 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc48158e20 con 0x7fcc480ae870 2024-09-15T23:24:59.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.794+0000 7fcc4ca8d640 1 -- 172.21.15.123:0/3020893265 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcc480b7110 con 0x7fcc480ae870 2024-09-15T23:24:59.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.795+0000 7fcc36ffd640 1 -- 172.21.15.123:0/3020893265 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcc40034820 con 0x7fcc480ae870 2024-09-15T23:24:59.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.795+0000 7fcc36ffd640 1 --2- 172.21.15.123:0/3020893265 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcc2806c2b0 0x7fcc2806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.795+0000 7fcc36ffd640 1 -- 172.21.15.123:0/3020893265 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 4943+0+0 (secure 0 0 0) 0x7fcc400ab3c0 con 0x7fcc480ae870 2024-09-15T23:24:59.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.795+0000 7fcc36ffd640 1 --2- 172.21.15.123:0/3020893265 >> [v2:172.21.15.188:6826/1725565174,v1:172.21.15.188:6827/1725565174] conn(0x7fcc28072170 0x7fcc28074590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.795+0000 7fcc36ffd640 1 -- 172.21.15.123:0/3020893265 --> [v2:172.21.15.188:6826/1725565174,v1:172.21.15.188:6827/1725565174] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcc40006e50 con 0x7fcc28072170 2024-09-15T23:24:59.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.795+0000 7fcc4659c640 1 --2- 172.21.15.123:0/3020893265 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcc2806c2b0 0x7fcc2806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:59.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.795+0000 7fcc36ffd640 1 -- 172.21.15.123:0/3020893265 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=209) ==== 24+0+0 (secure 0 0 0) 0x7fcc400b2050 con 0x7fcc480ae870 2024-09-15T23:24:59.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.796+0000 7fcc45d9b640 1 --2- 172.21.15.123:0/3020893265 >> [v2:172.21.15.188:6826/1725565174,v1:172.21.15.188:6827/1725565174] conn(0x7fcc28072170 0x7fcc28074590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:59.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.796+0000 7fcc4659c640 1 --2- 172.21.15.123:0/3020893265 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcc2806c2b0 0x7fcc2806e770 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fcc48156810 tx=0x7fcc38008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:59.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.796+0000 7fcc45d9b640 1 --2- 172.21.15.123:0/3020893265 >> [v2:172.21.15.188:6826/1725565174,v1:172.21.15.188:6827/1725565174] conn(0x7fcc28072170 0x7fcc28074590 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:59.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.797+0000 7fcc36ffd640 1 -- 172.21.15.123:0/3020893265 <== osd.7 v2:172.21.15.188:6826/1725565174 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcc40006e50 con 0x7fcc28072170 2024-09-15T23:24:59.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.809+0000 7fcc4ca8d640 1 -- 172.21.15.123:0/3020893265 --> [v2:172.21.15.188:6826/1725565174,v1:172.21.15.188:6827/1725565174] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fcc48159060 con 0x7fcc28072170 2024-09-15T23:24:59.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.810+0000 7fcc36ffd640 1 -- 172.21.15.123:0/3020893265 <== osd.7 v2:172.21.15.188:6826/1725565174 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fcc48159060 con 0x7fcc28072170 2024-09-15T23:24:59.811 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-09-15T23:24:59.811 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T23:24:59.811 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-09-15T23:24:59.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.810+0000 7fcc4ca8d640 1 -- 172.21.15.123:0/3020893265 >> [v2:172.21.15.188:6826/1725565174,v1:172.21.15.188:6827/1725565174] conn(0x7fcc28072170 msgr2=0x7fcc28074590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:59.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.810+0000 7fcc4ca8d640 1 --2- 172.21.15.123:0/3020893265 >> [v2:172.21.15.188:6826/1725565174,v1:172.21.15.188:6827/1725565174] conn(0x7fcc28072170 0x7fcc28074590 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.810+0000 7fcc4ca8d640 1 -- 172.21.15.123:0/3020893265 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcc2806c2b0 msgr2=0x7fcc2806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:59.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.810+0000 7fcc4ca8d640 1 --2- 172.21.15.123:0/3020893265 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fcc2806c2b0 0x7fcc2806e770 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fcc48156810 tx=0x7fcc38008040 comp rx=0 tx=0).stop 2024-09-15T23:24:59.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.810+0000 7fcc4ca8d640 1 -- 172.21.15.123:0/3020893265 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc480ae870 msgr2=0x7fcc480aecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:59.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.810+0000 7fcc4ca8d640 1 --2- 172.21.15.123:0/3020893265 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc480ae870 0x7fcc480aecf0 secure :-1 s=READY pgs=2526 cs=0 l=1 rev1=1 crypto rx=0x7fcc4002b520 tx=0x7fcc40001360 comp rx=0 tx=0).stop 2024-09-15T23:24:59.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.810+0000 7fcc46d9d640 1 -- 172.21.15.123:0/3020893265 reap_dead start 2024-09-15T23:24:59.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.810+0000 7fcc4ca8d640 1 -- 172.21.15.123:0/3020893265 shutdown_connections 2024-09-15T23:24:59.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.810+0000 7fcc4ca8d640 1 -- 172.21.15.123:0/3020893265 >> 172.21.15.123:0/3020893265 conn(0x7fcc48067950 msgr2=0x7fcc4815c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:59.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.810+0000 7fcc4ca8d640 1 -- 172.21.15.123:0/3020893265 shutdown_connections 2024-09-15T23:24:59.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.810+0000 7fcc4ca8d640 1 -- 172.21.15.123:0/3020893265 wait complete. 2024-09-15T23:24:59.822 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-15T23:24:59.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.919+0000 7f756bf2a640 1 Processor -- start 2024-09-15T23:24:59.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.919+0000 7f756bf2a640 1 -- start start 2024-09-15T23:24:59.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.920+0000 7f756bf2a640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f756413eb20 0x7f756415c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.920+0000 7f756bf2a640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7564071180 con 0x7f756406c320 2024-09-15T23:24:59.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.920+0000 7f756bf2a640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7564071460 con 0x7f75640b2d40 2024-09-15T23:24:59.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.920+0000 7f756bf2a640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f7564071ab0 con 0x7f756413eb20 2024-09-15T23:24:59.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.920+0000 7f756a4c7640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f756413eb20 0x7f756415c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:59.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.920+0000 7f75694c5640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f756406c320 0x7f756415bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55154/0 (socket says 172.21.15.123:55154) 2024-09-15T23:24:59.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.920+0000 7f75694c5640 1 -- 172.21.15.123:0/2817314407 learned_addr learned my addr 172.21.15.123:0/2817314407 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:24:59.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.921+0000 7f756a4c7640 1 -- 172.21.15.123:0/2817314407 >> v1:172.21.15.188:6789/0 conn(0x7f75640b2d40 legacy=0x7f756406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:24:59.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.921+0000 7f756a4c7640 1 -- 172.21.15.123:0/2817314407 >> v1:172.21.15.123:6789/0 conn(0x7f756406c320 legacy=0x7f756415bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:59.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.921+0000 7f756a4c7640 1 -- 172.21.15.123:0/2817314407 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7564071740 con 0x7f756413eb20 2024-09-15T23:24:59.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.921+0000 7f756a4c7640 1 --2- 172.21.15.123:0/2817314407 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f756413eb20 0x7f756415c400 secure :-1 s=READY pgs=2528 cs=0 l=1 rev1=1 crypto rx=0x7f755c0097a0 tx=0x7f755c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6913c2f97cb8348 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:59.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.922+0000 7f7568cc4640 1 -- 172.21.15.123:0/2817314407 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c037070 con 0x7f756413eb20 2024-09-15T23:24:59.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.922+0000 7f7568cc4640 1 -- 172.21.15.123:0/2817314407 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f755c032440 con 0x7f756413eb20 2024-09-15T23:24:59.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.922+0000 7f7568cc4640 1 -- 172.21.15.123:0/2817314407 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c032810 con 0x7f756413eb20 2024-09-15T23:24:59.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.922+0000 7f756bf2a640 1 -- 172.21.15.123:0/2817314407 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f756413eb20 msgr2=0x7f756415c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:59.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.922+0000 7f756bf2a640 1 --2- 172.21.15.123:0/2817314407 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f756413eb20 0x7f756415c400 secure :-1 s=READY pgs=2528 cs=0 l=1 rev1=1 crypto rx=0x7f755c0097a0 tx=0x7f755c02a1e0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.922+0000 7f756bf2a640 1 -- 172.21.15.123:0/2817314407 shutdown_connections 2024-09-15T23:24:59.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.922+0000 7f756bf2a640 1 --2- 172.21.15.123:0/2817314407 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f756413eb20 0x7f756415c400 unknown :-1 s=CLOSED pgs=2528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.922+0000 7f756bf2a640 1 -- 172.21.15.123:0/2817314407 >> 172.21.15.123:0/2817314407 conn(0x7f75640ccec0 msgr2=0x7f75640cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:59.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.922+0000 7f756bf2a640 1 -- 172.21.15.123:0/2817314407 shutdown_connections 2024-09-15T23:24:59.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.922+0000 7f756bf2a640 1 -- 172.21.15.123:0/2817314407 wait complete. 2024-09-15T23:24:59.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.923+0000 7f756bf2a640 1 Processor -- start 2024-09-15T23:24:59.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.923+0000 7f756bf2a640 1 -- start start 2024-09-15T23:24:59.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.924+0000 7f756bf2a640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f756406c320 0x7f756413de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.924+0000 7f756bf2a640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75640b2d40 0x7f756413d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.924+0000 7f756bf2a640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f756413eb20 0x7f756413c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.924+0000 7f756bf2a640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f75641666e0 con 0x7f756413eb20 2024-09-15T23:24:59.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.924+0000 7f756bf2a640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f7564166560 con 0x7f75640b2d40 2024-09-15T23:24:59.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.924+0000 7f756bf2a640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f7564166860 con 0x7f756406c320 2024-09-15T23:24:59.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.924+0000 7f756a4c7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f756413eb20 0x7f756413c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:59.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.924+0000 7f756a4c7640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f756413eb20 0x7f756413c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48662/0 (socket says 172.21.15.123:48662) 2024-09-15T23:24:59.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.924+0000 7f756a4c7640 1 -- 172.21.15.123:0/3586063087 learned_addr learned my addr 172.21.15.123:0/3586063087 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:24:59.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.924+0000 7f756a4c7640 1 -- 172.21.15.123:0/3586063087 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f756406c320 msgr2=0x7f756413de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:59.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.924+0000 7f756a4c7640 1 --2- 172.21.15.123:0/3586063087 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f756406c320 0x7f756413de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.924+0000 7f756a4c7640 1 -- 172.21.15.123:0/3586063087 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75640b2d40 msgr2=0x7f756413d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:59.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.924+0000 7f756a4c7640 1 --2- 172.21.15.123:0/3586063087 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75640b2d40 0x7f756413d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:59.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.924+0000 7f756a4c7640 1 -- 172.21.15.123:0/3586063087 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f756413d8f0 con 0x7f756413eb20 2024-09-15T23:24:59.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.925+0000 7f756a4c7640 1 --2- 172.21.15.123:0/3586063087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f756413eb20 0x7f756413c210 secure :-1 s=READY pgs=2529 cs=0 l=1 rev1=1 crypto rx=0x7f755c0098c0 tx=0x7f755c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:59.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.925+0000 7f755a7fc640 1 -- 172.21.15.123:0/3586063087 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c037040 con 0x7f756413eb20 2024-09-15T23:24:59.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.925+0000 7f755a7fc640 1 -- 172.21.15.123:0/3586063087 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f755c042070 con 0x7f756413eb20 2024-09-15T23:24:59.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.925+0000 7f756bf2a640 1 -- 172.21.15.123:0/3586063087 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75641f27d0 con 0x7f756413eb20 2024-09-15T23:24:59.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.925+0000 7f755a7fc640 1 -- 172.21.15.123:0/3586063087 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c030b30 con 0x7f756413eb20 2024-09-15T23:24:59.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.925+0000 7f756bf2a640 1 -- 172.21.15.123:0/3586063087 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f756413db90 con 0x7f756413eb20 2024-09-15T23:24:59.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.926+0000 7f756bf2a640 1 -- 172.21.15.123:0/3586063087 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7564141570 con 0x7f756413eb20 2024-09-15T23:24:59.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.926+0000 7f755a7fc640 1 -- 172.21.15.123:0/3586063087 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f755c030cd0 con 0x7f756413eb20 2024-09-15T23:24:59.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.927+0000 7f755a7fc640 1 --2- 172.21.15.123:0/3586063087 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f754806c2b0 0x7f754806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:59.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.927+0000 7f755a7fc640 1 -- 172.21.15.123:0/3586063087 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 4943+0+0 (secure 0 0 0) 0x7f755c0abc90 con 0x7f756413eb20 2024-09-15T23:24:59.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.927+0000 7f7569cc6640 1 --2- 172.21.15.123:0/3586063087 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f754806c2b0 0x7f754806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:59.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.927+0000 7f7569cc6640 1 --2- 172.21.15.123:0/3586063087 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f754806c2b0 0x7f754806e770 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f75600043c0 tx=0x7f7560007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:59.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:24:59.931+0000 7f755a7fc640 1 -- 172.21.15.123:0/3586063087 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7564141570 con 0x7f756413eb20 2024-09-15T23:25:00.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.096+0000 7f756bf2a640 1 -- 172.21.15.123:0/3586063087 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f756406bc10 con 0x7f754806c2b0 2024-09-15T23:25:00.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.096+0000 7f755a7fc640 1 -- 172.21.15.123:0/3586063087 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f756406bc10 con 0x7f754806c2b0 2024-09-15T23:25:00.098 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 7 to deep-scrub 2024-09-15T23:25:00.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.098+0000 7f756bf2a640 1 -- 172.21.15.123:0/3586063087 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f754806c2b0 msgr2=0x7f754806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:00.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.098+0000 7f756bf2a640 1 --2- 172.21.15.123:0/3586063087 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f754806c2b0 0x7f754806e770 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f75600043c0 tx=0x7f7560007d30 comp rx=0 tx=0).stop 2024-09-15T23:25:00.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.098+0000 7f756bf2a640 1 -- 172.21.15.123:0/3586063087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f756413eb20 msgr2=0x7f756413c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:00.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.098+0000 7f756bf2a640 1 --2- 172.21.15.123:0/3586063087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f756413eb20 0x7f756413c210 secure :-1 s=READY pgs=2529 cs=0 l=1 rev1=1 crypto rx=0x7f755c0098c0 tx=0x7f755c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.098+0000 7f756bf2a640 1 -- 172.21.15.123:0/3586063087 shutdown_connections 2024-09-15T23:25:00.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.098+0000 7f756bf2a640 1 --2- 172.21.15.123:0/3586063087 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f754806c2b0 0x7f754806e770 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.098+0000 7f756bf2a640 1 --2- 172.21.15.123:0/3586063087 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f756413eb20 0x7f756413c210 unknown :-1 s=CLOSED pgs=2529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.098+0000 7f756bf2a640 1 --2- 172.21.15.123:0/3586063087 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f75640b2d40 0x7f756413d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.098+0000 7f756bf2a640 1 --2- 172.21.15.123:0/3586063087 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f756406c320 0x7f756413de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.098+0000 7f756bf2a640 1 -- 172.21.15.123:0/3586063087 >> 172.21.15.123:0/3586063087 conn(0x7f75640ccec0 msgr2=0x7f756413ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:25:00.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.099+0000 7f756bf2a640 1 -- 172.21.15.123:0/3586063087 shutdown_connections 2024-09-15T23:25:00.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.099+0000 7f756bf2a640 1 -- 172.21.15.123:0/3586063087 wait complete. 2024-09-15T23:25:00.110 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:25:00.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.207+0000 7f127664c640 1 Processor -- start 2024-09-15T23:25:00.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.207+0000 7f127664c640 1 -- start start 2024-09-15T23:25:00.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.208+0000 7f127664c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f127015e6d0 0x7f1270071390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:00.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.208+0000 7f127664c640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f1270070b80 0x7f12701622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:00.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.208+0000 7f127664c640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f127015eab0 con 0x7f127006cd20 2024-09-15T23:25:00.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.208+0000 7f127664c640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f127015ed70 con 0x7f1270070b80 2024-09-15T23:25:00.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.208+0000 7f127664c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f127015f050 con 0x7f127015e6d0 2024-09-15T23:25:00.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.208+0000 7f126f7fe640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f127006cd20 0x7f12700b6d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55158/0 (socket says 172.21.15.123:55158) 2024-09-15T23:25:00.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.208+0000 7f126f7fe640 1 -- 172.21.15.123:0/121596370 learned_addr learned my addr 172.21.15.123:0/121596370 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:25:00.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.208+0000 7f126ffff640 1 --2- 172.21.15.123:0/121596370 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f127015e6d0 0x7f1270071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:00.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.208+0000 7f1274be9640 1 --2- 172.21.15.123:0/121596370 >> v2:172.21.15.188:3300/0 conn(0x7f1270070b80 0x7f12701622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:00.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.208+0000 7f126effd640 1 -- 172.21.15.123:0/121596370 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1976759490 0 0) 0x7f127015eab0 con 0x7f127006cd20 2024-09-15T23:25:00.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.208+0000 7f126effd640 1 -- 172.21.15.123:0/121596370 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1258003520 con 0x7f127006cd20 2024-09-15T23:25:00.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.208+0000 7f126effd640 1 -- 172.21.15.123:0/121596370 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 705883277 0 0) 0x7f1258003520 con 0x7f127006cd20 2024-09-15T23:25:00.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.208+0000 7f126effd640 1 -- 172.21.15.123:0/121596370 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f127015e6d0 msgr2=0x7f1270071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:25:00.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.208+0000 7f126effd640 1 --2- 172.21.15.123:0/121596370 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f127015e6d0 0x7f1270071390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.208+0000 7f126effd640 1 -- 172.21.15.123:0/121596370 >> v2:172.21.15.188:3300/0 conn(0x7f1270070b80 msgr2=0x7f12701622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:25:00.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.208+0000 7f126effd640 1 --2- 172.21.15.123:0/121596370 >> v2:172.21.15.188:3300/0 conn(0x7f1270070b80 0x7f12701622a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.208+0000 7f126effd640 1 -- 172.21.15.123:0/121596370 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f127015f330 con 0x7f127006cd20 2024-09-15T23:25:00.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.208+0000 7f126effd640 1 -- 172.21.15.123:0/121596370 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f1264001670 con 0x7f127006cd20 2024-09-15T23:25:00.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.208+0000 7f1274be9640 1 --2- 172.21.15.123:0/121596370 >> v2:172.21.15.188:3300/0 conn(0x7f1270070b80 0x7f12701622a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:25:00.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.208+0000 7f126effd640 1 -- 172.21.15.123:0/121596370 >> v1:172.21.15.123:6789/0 conn(0x7f127006cd20 legacy=0x7f12700b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:00.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.208+0000 7f126effd640 1 --2- 172.21.15.123:0/121596370 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f127015e6d0 0x7f12580039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:00.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.208+0000 7f126effd640 1 --2- 172.21.15.123:0/121596370 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1258003f30 0x7f1258004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:00.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.208+0000 7f126effd640 1 --2- 172.21.15.123:0/121596370 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1258004d40 0x7f12580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:00.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.208+0000 7f126effd640 1 -- 172.21.15.123:0/121596370 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f127015ed70 con 0x7f1258004d40 2024-09-15T23:25:00.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.208+0000 7f126effd640 1 -- 172.21.15.123:0/121596370 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f127015f050 con 0x7f1258003f30 2024-09-15T23:25:00.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.208+0000 7f126effd640 1 -- 172.21.15.123:0/121596370 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f125800b9c0 con 0x7f127015e6d0 2024-09-15T23:25:00.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.209+0000 7f1274be9640 1 --2- 172.21.15.123:0/121596370 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1258004d40 0x7f12580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:00.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.209+0000 7f126ffff640 1 --2- 172.21.15.123:0/121596370 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f127015e6d0 0x7f12580039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:00.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.209+0000 7f126f7fe640 1 --2- 172.21.15.123:0/121596370 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1258003f30 0x7f1258004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:00.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.209+0000 7f1274be9640 1 -- 172.21.15.123:0/121596370 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f127015e6d0 msgr2=0x7f12580039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:25:00.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.209+0000 7f1274be9640 1 --2- 172.21.15.123:0/121596370 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f127015e6d0 0x7f12580039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.209+0000 7f1274be9640 1 -- 172.21.15.123:0/121596370 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1258003f30 msgr2=0x7f1258004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:25:00.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.209+0000 7f1274be9640 1 --2- 172.21.15.123:0/121596370 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f1258003f30 0x7f1258004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.209+0000 7f1274be9640 1 -- 172.21.15.123:0/121596370 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1258003520 con 0x7f1258004d40 2024-09-15T23:25:00.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.209+0000 7f1274be9640 1 --2- 172.21.15.123:0/121596370 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1258004d40 0x7f12580051c0 secure :-1 s=READY pgs=2531 cs=0 l=1 rev1=1 crypto rx=0x7f126800e350 tx=0x7f1258005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b7c0b1eebc8739 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:25:00.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.210+0000 7f126effd640 1 -- 172.21.15.123:0/121596370 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1268009de0 con 0x7f1258004d40 2024-09-15T23:25:00.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.210+0000 7f126effd640 1 -- 172.21.15.123:0/121596370 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f126802e650 con 0x7f1258004d40 2024-09-15T23:25:00.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.210+0000 7f126effd640 1 -- 172.21.15.123:0/121596370 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126802ea00 con 0x7f1258004d40 2024-09-15T23:25:00.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.210+0000 7f127664c640 1 -- 172.21.15.123:0/121596370 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1258004d40 msgr2=0x7f12580051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:00.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.210+0000 7f127664c640 1 --2- 172.21.15.123:0/121596370 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1258004d40 0x7f12580051c0 secure :-1 s=READY pgs=2531 cs=0 l=1 rev1=1 crypto rx=0x7f126800e350 tx=0x7f1258005830 comp rx=0 tx=0).stop 2024-09-15T23:25:00.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.210+0000 7f1274be9640 1 -- 172.21.15.123:0/121596370 reap_dead start 2024-09-15T23:25:00.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.210+0000 7f127664c640 1 -- 172.21.15.123:0/121596370 shutdown_connections 2024-09-15T23:25:00.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.210+0000 7f127664c640 1 -- 172.21.15.123:0/121596370 >> 172.21.15.123:0/121596370 conn(0x7f1270067fb0 msgr2=0x7f127006f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:25:00.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.210+0000 7f127664c640 1 -- 172.21.15.123:0/121596370 shutdown_connections 2024-09-15T23:25:00.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.210+0000 7f127664c640 1 -- 172.21.15.123:0/121596370 wait complete. 2024-09-15T23:25:00.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.211+0000 7f127664c640 1 Processor -- start 2024-09-15T23:25:00.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.212+0000 7f127664c640 1 -- start start 2024-09-15T23:25:00.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.212+0000 7f127664c640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1258004d40 0x7f127014d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:00.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.212+0000 7f127664c640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f127014fd30 0x7f127014da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:00.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.212+0000 7f127664c640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f127014dfd0 0x7f127014e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:00.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.212+0000 7f127664c640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f12700b7470 con 0x7f1258004d40 2024-09-15T23:25:00.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.212+0000 7f127664c640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f127015f8f0 con 0x7f127014fd30 2024-09-15T23:25:00.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.212+0000 7f127664c640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f12700b75f0 con 0x7f127014dfd0 2024-09-15T23:25:00.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.212+0000 7f126ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1258004d40 0x7f127014d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:00.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.212+0000 7f126ffff640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1258004d40 0x7f127014d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48670/0 (socket says 172.21.15.123:48670) 2024-09-15T23:25:00.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.212+0000 7f126ffff640 1 -- 172.21.15.123:0/1236931581 learned_addr learned my addr 172.21.15.123:0/1236931581 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:25:00.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.212+0000 7f126ffff640 1 -- 172.21.15.123:0/1236931581 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f127014dfd0 msgr2=0x7f127014e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:00.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.213+0000 7f126ffff640 1 --2- 172.21.15.123:0/1236931581 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f127014dfd0 0x7f127014e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.213+0000 7f126ffff640 1 -- 172.21.15.123:0/1236931581 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f127014fd30 msgr2=0x7f127014da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:00.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.213+0000 7f126ffff640 1 --2- 172.21.15.123:0/1236931581 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f127014fd30 0x7f127014da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.213+0000 7f126ffff640 1 -- 172.21.15.123:0/1236931581 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f127015ab80 con 0x7f1258004d40 2024-09-15T23:25:00.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.213+0000 7f126ffff640 1 --2- 172.21.15.123:0/1236931581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1258004d40 0x7f127014d210 secure :-1 s=READY pgs=2532 cs=0 l=1 rev1=1 crypto rx=0x7f1260011a00 tx=0x7f1260011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:25:00.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.213+0000 7f126cff9640 1 -- 172.21.15.123:0/1236931581 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126000fad0 con 0x7f1258004d40 2024-09-15T23:25:00.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.213+0000 7f126cff9640 1 -- 172.21.15.123:0/1236931581 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f126000fc70 con 0x7f1258004d40 2024-09-15T23:25:00.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.213+0000 7f126cff9640 1 -- 172.21.15.123:0/1236931581 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1260014440 con 0x7f1258004d40 2024-09-15T23:25:00.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.213+0000 7f127664c640 1 -- 172.21.15.123:0/1236931581 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f127015ae60 con 0x7f1258004d40 2024-09-15T23:25:00.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.213+0000 7f127664c640 1 -- 172.21.15.123:0/1236931581 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f127015b420 con 0x7f1258004d40 2024-09-15T23:25:00.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.214+0000 7f127664c640 1 -- 172.21.15.123:0/1236931581 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12700d36c0 con 0x7f1258004d40 2024-09-15T23:25:00.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.214+0000 7f126cff9640 1 -- 172.21.15.123:0/1236931581 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1260012040 con 0x7f1258004d40 2024-09-15T23:25:00.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.215+0000 7f126cff9640 1 --2- 172.21.15.123:0/1236931581 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f125c06c2e0 0x7f125c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:00.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.215+0000 7f126cff9640 1 -- 172.21.15.123:0/1236931581 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 4943+0+0 (secure 0 0 0) 0x7f126008b740 con 0x7f1258004d40 2024-09-15T23:25:00.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.215+0000 7f126f7fe640 1 --2- 172.21.15.123:0/1236931581 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f125c06c2e0 0x7f125c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:00.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.216+0000 7f126f7fe640 1 --2- 172.21.15.123:0/1236931581 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f125c06c2e0 0x7f125c06e7a0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f1264001bb0 tx=0x7f1264001b40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:25:00.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.219+0000 7f126cff9640 1 -- 172.21.15.123:0/1236931581 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1260019030 con 0x7f1258004d40 2024-09-15T23:25:00.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.382+0000 7f127664c640 1 -- 172.21.15.123:0/1236931581 --> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f127015eab0 con 0x7f125c06c2e0 2024-09-15T23:25:00.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.383+0000 7f126cff9640 1 -- 172.21.15.123:0/1236931581 <== mgr.4102 v2:172.21.15.188:6824/2945144488 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13440 (secure 0 0 0) 0x7f127015eab0 con 0x7f125c06c2e0 2024-09-15T23:25:00.385 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:25:00.385 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-09-15T23:25:00.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.385+0000 7f127664c640 1 -- 172.21.15.123:0/1236931581 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f125c06c2e0 msgr2=0x7f125c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:00.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.385+0000 7f127664c640 1 --2- 172.21.15.123:0/1236931581 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f125c06c2e0 0x7f125c06e7a0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f1264001bb0 tx=0x7f1264001b40 comp rx=0 tx=0).stop 2024-09-15T23:25:00.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.385+0000 7f127664c640 1 -- 172.21.15.123:0/1236931581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1258004d40 msgr2=0x7f127014d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:00.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.385+0000 7f127664c640 1 --2- 172.21.15.123:0/1236931581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1258004d40 0x7f127014d210 secure :-1 s=READY pgs=2532 cs=0 l=1 rev1=1 crypto rx=0x7f1260011a00 tx=0x7f1260011ec0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.385+0000 7f127664c640 1 -- 172.21.15.123:0/1236931581 shutdown_connections 2024-09-15T23:25:00.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.385+0000 7f127664c640 1 --2- 172.21.15.123:0/1236931581 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f127014dfd0 0x7f127014e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.385+0000 7f127664c640 1 --2- 172.21.15.123:0/1236931581 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f127014fd30 0x7f127014da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.385+0000 7f127664c640 1 --2- 172.21.15.123:0/1236931581 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f125c06c2e0 0x7f125c06e7a0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.385+0000 7f127664c640 1 --2- 172.21.15.123:0/1236931581 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1258004d40 0x7f127014d210 unknown :-1 s=CLOSED pgs=2532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.385+0000 7f127664c640 1 -- 172.21.15.123:0/1236931581 >> 172.21.15.123:0/1236931581 conn(0x7f1270067fb0 msgr2=0x7f127015fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:25:00.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.385+0000 7f127664c640 1 -- 172.21.15.123:0/1236931581 shutdown_connections 2024-09-15T23:25:00.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.385+0000 7f127664c640 1 -- 172.21.15.123:0/1236931581 wait complete. 2024-09-15T23:25:00.397 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":591,"stamp":"2024-09-15T23:24:59.688391+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":457216,"kb_used_data":21704,"kb_used_omap":12,"kb_used_meta":435315,"kb_avail":754517504,"statfs":{"total":773094113280,"available":772625924096,"internally_reserved":0,"allocated":22224896,"data_stored":10488072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":445763120},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6291456,"num_objects":-2,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":-7,"num_write_kb":-6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.238856"},"pg_stats":[{"pgid":"1.0","version":"209'119","reported_seq":532,"reported_epoch":209,"state":"active+clean","last_fresh":"2024-09-15T23:24:57.622323+0000","last_change":"2024-09-15T23:24:57.622372+0000","last_active":"2024-09-15T23:24:57.622323+0000","last_peered":"2024-09-15T23:24:57.622323+0000","last_clean":"2024-09-15T23:24:57.622323+0000","last_became_active":"2024-09-15T23:12:03.998298+0000","last_became_peered":"2024-09-15T23:12:03.998298+0000","last_unstale":"2024-09-15T23:24:57.622323+0000","last_undegraded":"2024-09-15T23:24:57.622323+0000","last_fullsized":"2024-09-15T23:24:57.622323+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"209'119","last_scrub_stamp":"2024-09-15T23:24:57.622223+0000","last_deep_scrub":"209'119","last_deep_scrub_stamp":"2024-09-15T23:24:57.622223+0000","last_clean_scrub_stamp":"2024-09-15T23:24:57.622223+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:53:16.413008+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476897,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60128,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311712,"statfs":{"total":96636764160,"available":96575193088,"internally_reserved":0,"allocated":2629632,"data_stored":1163417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":58915271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55968,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315872,"statfs":{"total":96636764160,"available":96579452928,"internally_reserved":0,"allocated":2629632,"data_stored":1163417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":16,"seq":68719476896,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60708,"kb_used_data":3148,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311132,"statfs":{"total":96636764160,"available":96574599168,"internally_reserved":0,"allocated":3223552,"data_stored":1753785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51808,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320032,"statfs":{"total":96636764160,"available":96583712768,"internally_reserved":0,"allocated":2629632,"data_stored":1163417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542302,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51808,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320032,"statfs":{"total":96636764160,"available":96583712768,"internally_reserved":0,"allocated":2629632,"data_stored":1163417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542302,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55968,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315872,"statfs":{"total":96636764160,"available":96579452928,"internally_reserved":0,"allocated":2629632,"data_stored":1163417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542301,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60704,"kb_used_data":3148,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311136,"statfs":{"total":96636764160,"available":96574603264,"internally_reserved":0,"allocated":3223552,"data_stored":1753785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542303,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60124,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311716,"statfs":{"total":96636764160,"available":96575197184,"internally_reserved":0,"allocated":2629632,"data_stored":1163417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:25:00.400 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-15T23:25:00.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.498+0000 7f635341e640 1 Processor -- start 2024-09-15T23:25:00.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.498+0000 7f635341e640 1 -- start start 2024-09-15T23:25:00.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.499+0000 7f635341e640 1 --2- >> v2:172.21.15.188:3300/0 conn(0x7f634c15ea80 0x7f634c0d3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:00.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.499+0000 7f635341e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f634c0d4390 0x7f634c0b6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:00.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.499+0000 7f635341e640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f634c0d2c80 con 0x7f634c0b6b60 2024-09-15T23:25:00.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.499+0000 7f635341e640 1 -- --> v2:172.21.15.188:3300/0 -- mon_getmap magic: 0 -- 0x7f634c0d2f60 con 0x7f634c15ea80 2024-09-15T23:25:00.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.499+0000 7f635341e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f634c0d3240 con 0x7f634c0d4390 2024-09-15T23:25:00.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.499+0000 7f63519bb640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f634c0b6b60 0x7f634c06d8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55166/0 (socket says 172.21.15.123:55166) 2024-09-15T23:25:00.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.499+0000 7f63519bb640 1 -- 172.21.15.123:0/3550266743 learned_addr learned my addr 172.21.15.123:0/3550266743 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:25:00.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.500+0000 7f6343fff640 1 -- 172.21.15.123:0/3550266743 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 909569077 0 0) 0x7f634c0d2c80 con 0x7f634c0b6b60 2024-09-15T23:25:00.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.500+0000 7f6343fff640 1 -- 172.21.15.123:0/3550266743 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6338003520 con 0x7f634c0b6b60 2024-09-15T23:25:00.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.500+0000 7f63511ba640 1 --2- 172.21.15.123:0/3550266743 >> v2:172.21.15.188:3300/0 conn(0x7f634c15ea80 0x7f634c0d3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:00.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.500+0000 7f63509b9640 1 --2- 172.21.15.123:0/3550266743 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f634c0d4390 0x7f634c0b6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:00.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.500+0000 7f6343fff640 1 -- 172.21.15.123:0/3550266743 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1301304198 0 0) 0x7f6338003520 con 0x7f634c0b6b60 2024-09-15T23:25:00.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.500+0000 7f6343fff640 1 -- 172.21.15.123:0/3550266743 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f634c0d4390 msgr2=0x7f634c0b6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:25:00.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.500+0000 7f6343fff640 1 --2- 172.21.15.123:0/3550266743 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f634c0d4390 0x7f634c0b6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.500+0000 7f6343fff640 1 -- 172.21.15.123:0/3550266743 >> v2:172.21.15.188:3300/0 conn(0x7f634c15ea80 msgr2=0x7f634c0d3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:25:00.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.500+0000 7f6343fff640 1 --2- 172.21.15.123:0/3550266743 >> v2:172.21.15.188:3300/0 conn(0x7f634c15ea80 0x7f634c0d3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.500+0000 7f6343fff640 1 -- 172.21.15.123:0/3550266743 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f634c0d3520 con 0x7f634c0b6b60 2024-09-15T23:25:00.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.500+0000 7f6343fff640 1 -- 172.21.15.123:0/3550266743 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2369711747 0 0) 0x7f63440019f0 con 0x7f634c0b6b60 2024-09-15T23:25:00.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.500+0000 7f63509b9640 1 --2- 172.21.15.123:0/3550266743 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f634c0d4390 0x7f634c0b6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:25:00.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.500+0000 7f6343fff640 1 -- 172.21.15.123:0/3550266743 >> v1:172.21.15.123:6789/0 conn(0x7f634c0b6b60 legacy=0x7f634c06d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:00.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.500+0000 7f6343fff640 1 --2- 172.21.15.123:0/3550266743 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63380039b0 0x7f6338003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:00.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.500+0000 7f6343fff640 1 --2- 172.21.15.123:0/3550266743 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6338004800 0x7f6338004c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:00.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.500+0000 7f6343fff640 1 --2- 172.21.15.123:0/3550266743 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6338005140 0x7f633800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:00.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.500+0000 7f6343fff640 1 -- 172.21.15.123:0/3550266743 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f634c0d2f60 con 0x7f63380039b0 2024-09-15T23:25:00.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.500+0000 7f6343fff640 1 -- 172.21.15.123:0/3550266743 --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f634c0d3240 con 0x7f6338005140 2024-09-15T23:25:00.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.500+0000 7f6343fff640 1 -- 172.21.15.123:0/3550266743 --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f633800bf00 con 0x7f6338004800 2024-09-15T23:25:00.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.500+0000 7f63511ba640 1 --2- 172.21.15.123:0/3550266743 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63380039b0 0x7f6338003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:00.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.500+0000 7f63509b9640 1 --2- 172.21.15.123:0/3550266743 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6338004800 0x7f6338004c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:00.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.500+0000 7f63519bb640 1 --2- 172.21.15.123:0/3550266743 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6338005140 0x7f633800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:00.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.500+0000 7f63511ba640 1 -- 172.21.15.123:0/3550266743 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6338004800 msgr2=0x7f6338004c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:25:00.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.500+0000 7f63511ba640 1 --2- 172.21.15.123:0/3550266743 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f6338004800 0x7f6338004c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.500+0000 7f63511ba640 1 -- 172.21.15.123:0/3550266743 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6338005140 msgr2=0x7f633800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:25:00.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.500+0000 7f63511ba640 1 --2- 172.21.15.123:0/3550266743 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f6338005140 0x7f633800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.500+0000 7f63511ba640 1 -- 172.21.15.123:0/3550266743 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6338003520 con 0x7f63380039b0 2024-09-15T23:25:00.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.501+0000 7f63511ba640 1 --2- 172.21.15.123:0/3550266743 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63380039b0 0x7f6338003dd0 secure :-1 s=READY pgs=2534 cs=0 l=1 rev1=1 crypto rx=0x7f6348009ac0 tx=0x7f6338005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0d506c22012244 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:25:00.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.501+0000 7f6343fff640 1 -- 172.21.15.123:0/3550266743 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6348036070 con 0x7f63380039b0 2024-09-15T23:25:00.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.501+0000 7f6343fff640 1 -- 172.21.15.123:0/3550266743 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6348031400 con 0x7f63380039b0 2024-09-15T23:25:00.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.501+0000 7f6343fff640 1 -- 172.21.15.123:0/3550266743 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6348009690 con 0x7f63380039b0 2024-09-15T23:25:00.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.502+0000 7f635341e640 1 -- 172.21.15.123:0/3550266743 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63380039b0 msgr2=0x7f6338003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:00.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.502+0000 7f635341e640 1 --2- 172.21.15.123:0/3550266743 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63380039b0 0x7f6338003dd0 secure :-1 s=READY pgs=2534 cs=0 l=1 rev1=1 crypto rx=0x7f6348009ac0 tx=0x7f6338005830 comp rx=0 tx=0).stop 2024-09-15T23:25:00.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.502+0000 7f63519bb640 1 -- 172.21.15.123:0/3550266743 reap_dead start 2024-09-15T23:25:00.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.502+0000 7f635341e640 1 -- 172.21.15.123:0/3550266743 shutdown_connections 2024-09-15T23:25:00.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.502+0000 7f635341e640 1 -- 172.21.15.123:0/3550266743 >> 172.21.15.123:0/3550266743 conn(0x7f634c0d1620 msgr2=0x7f634c0d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:25:00.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.502+0000 7f635341e640 1 -- 172.21.15.123:0/3550266743 shutdown_connections 2024-09-15T23:25:00.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.502+0000 7f635341e640 1 -- 172.21.15.123:0/3550266743 wait complete. 2024-09-15T23:25:00.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.503+0000 7f635341e640 1 Processor -- start 2024-09-15T23:25:00.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.503+0000 7f635341e640 1 -- start start 2024-09-15T23:25:00.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.504+0000 7f635341e640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f63380039b0 0x7f634c14e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:00.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.504+0000 7f635341e640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f634c150990 0x7f634c150df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:00.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.504+0000 7f635341e640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f634c0d3a40 0x7f634c0d3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:00.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.504+0000 7f635341e640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f634c0d2810 con 0x7f634c150990 2024-09-15T23:25:00.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.504+0000 7f635341e640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7f634c15ee60 con 0x7f63380039b0 2024-09-15T23:25:00.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.504+0000 7f635341e640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7f634c0d2990 con 0x7f634c0d3a40 2024-09-15T23:25:00.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.504+0000 7f63509b9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f634c150990 0x7f634c150df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:00.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.504+0000 7f63509b9640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f634c150990 0x7f634c150df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48700/0 (socket says 172.21.15.123:48700) 2024-09-15T23:25:00.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.504+0000 7f63509b9640 1 -- 172.21.15.123:0/4200500054 learned_addr learned my addr 172.21.15.123:0/4200500054 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:25:00.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.504+0000 7f63511ba640 1 --2- 172.21.15.123:0/4200500054 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f63380039b0 0x7f634c14e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:00.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.504+0000 7f63519bb640 1 --2- 172.21.15.123:0/4200500054 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f634c0d3a40 0x7f634c0d3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:00.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.504+0000 7f63509b9640 1 -- 172.21.15.123:0/4200500054 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f634c0d3a40 msgr2=0x7f634c0d3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:00.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.504+0000 7f63509b9640 1 --2- 172.21.15.123:0/4200500054 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f634c0d3a40 0x7f634c0d3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.504+0000 7f63509b9640 1 -- 172.21.15.123:0/4200500054 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f63380039b0 msgr2=0x7f634c14e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:00.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.504+0000 7f63509b9640 1 --2- 172.21.15.123:0/4200500054 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f63380039b0 0x7f634c14e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.504+0000 7f63509b9640 1 -- 172.21.15.123:0/4200500054 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f634c151430 con 0x7f634c150990 2024-09-15T23:25:00.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.504+0000 7f63511ba640 1 --2- 172.21.15.123:0/4200500054 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f63380039b0 0x7f634c14e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:25:00.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.504+0000 7f63509b9640 1 --2- 172.21.15.123:0/4200500054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f634c150990 0x7f634c150df0 secure :-1 s=READY pgs=2535 cs=0 l=1 rev1=1 crypto rx=0x7f633c0108f0 tx=0x7f633c010db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:25:00.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.504+0000 7f6341ffb640 1 -- 172.21.15.123:0/4200500054 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c01a070 con 0x7f634c150990 2024-09-15T23:25:00.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.504+0000 7f6341ffb640 1 -- 172.21.15.123:0/4200500054 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f633c005b90 con 0x7f634c150990 2024-09-15T23:25:00.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.504+0000 7f635341e640 1 -- 172.21.15.123:0/4200500054 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f634c151710 con 0x7f634c150990 2024-09-15T23:25:00.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.504+0000 7f6341ffb640 1 -- 172.21.15.123:0/4200500054 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c00f040 con 0x7f634c150990 2024-09-15T23:25:00.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.505+0000 7f635341e640 1 -- 172.21.15.123:0/4200500054 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f634c14ec10 con 0x7f634c150990 2024-09-15T23:25:00.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.506+0000 7f635341e640 1 -- 172.21.15.123:0/4200500054 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f634c0b6620 con 0x7f634c150990 2024-09-15T23:25:00.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.506+0000 7f6341ffb640 1 -- 172.21.15.123:0/4200500054 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f633c00c8e0 con 0x7f634c150990 2024-09-15T23:25:00.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.506+0000 7f6341ffb640 1 --2- 172.21.15.123:0/4200500054 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f633006c2e0 0x7f633006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:00.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.507+0000 7f6341ffb640 1 -- 172.21.15.123:0/4200500054 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 4943+0+0 (secure 0 0 0) 0x7f633c08b4d0 con 0x7f634c150990 2024-09-15T23:25:00.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.507+0000 7f63511ba640 1 --2- 172.21.15.123:0/4200500054 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f633006c2e0 0x7f633006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:00.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.507+0000 7f63511ba640 1 --2- 172.21.15.123:0/4200500054 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f633006c2e0 0x7f633006e7a0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f6348033000 tx=0x7f6348008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:25:00.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.511+0000 7f6341ffb640 1 -- 172.21.15.123:0/4200500054 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f633c059f40 con 0x7f634c150990 2024-09-15T23:25:00.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.678+0000 7f635341e640 1 -- 172.21.15.123:0/4200500054 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f634c0ce710 con 0x7f634c150990 2024-09-15T23:25:00.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.683+0000 7f6341ffb640 1 -- 172.21.15.123:0/4200500054 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v50)=0 v50) ==== 123+0+0 (secure 0 0 0) 0x7f633c059840 con 0x7f634c150990 2024-09-15T23:25:00.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.684+0000 7f6341ffb640 1 -- 172.21.15.123:0/4200500054 <== mon.0 v2:172.21.15.123:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f633c00ee80 con 0x7f634c150990 2024-09-15T23:25:00.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.686+0000 7f635341e640 1 -- 172.21.15.123:0/4200500054 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f633006c2e0 msgr2=0x7f633006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:00.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.686+0000 7f635341e640 1 --2- 172.21.15.123:0/4200500054 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f633006c2e0 0x7f633006e7a0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f6348033000 tx=0x7f6348008030 comp rx=0 tx=0).stop 2024-09-15T23:25:00.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.686+0000 7f635341e640 1 -- 172.21.15.123:0/4200500054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f634c150990 msgr2=0x7f634c150df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:00.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.686+0000 7f635341e640 1 --2- 172.21.15.123:0/4200500054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f634c150990 0x7f634c150df0 secure :-1 s=READY pgs=2535 cs=0 l=1 rev1=1 crypto rx=0x7f633c0108f0 tx=0x7f633c010db0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.686+0000 7f635341e640 1 -- 172.21.15.123:0/4200500054 shutdown_connections 2024-09-15T23:25:00.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.686+0000 7f635341e640 1 --2- 172.21.15.123:0/4200500054 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7f634c0d3a40 0x7f634c0d3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.686+0000 7f635341e640 1 --2- 172.21.15.123:0/4200500054 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7f633006c2e0 0x7f633006e7a0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.686+0000 7f635341e640 1 --2- 172.21.15.123:0/4200500054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f634c150990 0x7f634c150df0 unknown :-1 s=CLOSED pgs=2535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.686+0000 7f635341e640 1 --2- 172.21.15.123:0/4200500054 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7f63380039b0 0x7f634c14e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.686+0000 7f635341e640 1 -- 172.21.15.123:0/4200500054 >> 172.21.15.123:0/4200500054 conn(0x7f634c0d1620 msgr2=0x7f634c0b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:25:00.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.686+0000 7f635341e640 1 -- 172.21.15.123:0/4200500054 shutdown_connections 2024-09-15T23:25:00.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.686+0000 7f635341e640 1 -- 172.21.15.123:0/4200500054 wait complete. 2024-09-15T23:25:00.698 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T23:25:00.698 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T23:25:00.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.795+0000 7fd6d0800640 1 Processor -- start 2024-09-15T23:25:00.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.795+0000 7fd6d0800640 1 -- start start 2024-09-15T23:25:00.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.796+0000 7fd6d0800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd6cc06c320 0x7fd6cc1691a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:00.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.796+0000 7fd6d0800640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6cc0b00a0 con 0x7fd6cc070370 2024-09-15T23:25:00.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.796+0000 7fd6d0800640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6cc0b0b10 con 0x7fd6cc15c0d0 2024-09-15T23:25:00.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.796+0000 7fd6d0800640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fd6cc15fb80 con 0x7fd6cc06c320 2024-09-15T23:25:00.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.796+0000 7fd6cb59e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd6cc06c320 0x7fd6cc1691a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:00.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.796+0000 7fd6c259c640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd6cc070370 0x7fd6cc06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:55180/0 (socket says 172.21.15.123:55180) 2024-09-15T23:25:00.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.796+0000 7fd6cb59e640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd6cc06c320 0x7fd6cc1691a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48706/0 (socket says 172.21.15.123:48706) 2024-09-15T23:25:00.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.796+0000 7fd6c259c640 1 -- 172.21.15.123:0/2486038057 learned_addr learned my addr 172.21.15.123:0/2486038057 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-09-15T23:25:00.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.797+0000 7fd6cb59e640 1 -- 172.21.15.123:0/2486038057 >> v1:172.21.15.188:6789/0 conn(0x7fd6cc15c0d0 legacy=0x7fd6cc0734d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:25:00.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.797+0000 7fd6cb59e640 1 -- 172.21.15.123:0/2486038057 >> v1:172.21.15.123:6789/0 conn(0x7fd6cc070370 legacy=0x7fd6cc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:00.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.797+0000 7fd6ca59c640 1 -- 172.21.15.123:0/2486038057 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 639530798 0 0) 0x7fd6cc0b00a0 con 0x7fd6cc070370 2024-09-15T23:25:00.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.797+0000 7fd6cb59e640 1 -- 172.21.15.123:0/2486038057 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6cc073d40 con 0x7fd6cc06c320 2024-09-15T23:25:00.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.797+0000 7fd6cb59e640 1 --2- 172.21.15.123:0/2486038057 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6cc06c320 0x7fd6cc1691a0 secure :-1 s=READY pgs=2537 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4009d90 tx=0x7fd6c402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ff1b5f60bfc2f96 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:25:00.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.798+0000 7fd6ca59c640 1 -- 172.21.15.123:0/2486038057 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4007740 con 0x7fd6cc06c320 2024-09-15T23:25:00.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.798+0000 7fd6ca59c640 1 -- 172.21.15.123:0/2486038057 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd6c40078e0 con 0x7fd6cc06c320 2024-09-15T23:25:00.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.798+0000 7fd6ca59c640 1 -- 172.21.15.123:0/2486038057 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4007cd0 con 0x7fd6cc06c320 2024-09-15T23:25:00.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.798+0000 7fd6d0800640 1 -- 172.21.15.123:0/2486038057 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6cc06c320 msgr2=0x7fd6cc1691a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:00.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.798+0000 7fd6d0800640 1 --2- 172.21.15.123:0/2486038057 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6cc06c320 0x7fd6cc1691a0 secure :-1 s=READY pgs=2537 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4009d90 tx=0x7fd6c402a6a0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.798+0000 7fd6d0800640 1 -- 172.21.15.123:0/2486038057 shutdown_connections 2024-09-15T23:25:00.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.798+0000 7fd6d0800640 1 --2- 172.21.15.123:0/2486038057 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6cc06c320 0x7fd6cc1691a0 unknown :-1 s=CLOSED pgs=2537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.798+0000 7fd6d0800640 1 -- 172.21.15.123:0/2486038057 >> 172.21.15.123:0/2486038057 conn(0x7fd6cc0b2ee0 msgr2=0x7fd6cc0b32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:25:00.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.798+0000 7fd6d0800640 1 -- 172.21.15.123:0/2486038057 shutdown_connections 2024-09-15T23:25:00.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.798+0000 7fd6d0800640 1 -- 172.21.15.123:0/2486038057 wait complete. 2024-09-15T23:25:00.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.799+0000 7fd6d0800640 1 Processor -- start 2024-09-15T23:25:00.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.800+0000 7fd6d0800640 1 -- start start 2024-09-15T23:25:00.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.800+0000 7fd6d0800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6cc06c320 0x7fd6cc1490a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:00.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.800+0000 7fd6d0800640 1 --2- >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6cc070370 0x7fd6cc0b0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:00.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.800+0000 7fd6d0800640 1 --2- >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6cc15c0d0 0x7fd6cc154900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:00.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.800+0000 7fd6d0800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd6cc074020 con 0x7fd6cc06c320 2024-09-15T23:25:00.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.800+0000 7fd6d0800640 1 -- --> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] -- mon_getmap magic: 0 -- 0x7fd6cc0b05f0 con 0x7fd6cc15c0d0 2024-09-15T23:25:00.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.800+0000 7fd6d0800640 1 -- --> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] -- mon_getmap magic: 0 -- 0x7fd6cc15c4b0 con 0x7fd6cc070370 2024-09-15T23:25:00.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.800+0000 7fd6cad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6cc06c320 0x7fd6cc1490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:00.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.800+0000 7fd6cad9d640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6cc06c320 0x7fd6cc1490a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48722/0 (socket says 172.21.15.123:48722) 2024-09-15T23:25:00.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.800+0000 7fd6cad9d640 1 -- 172.21.15.123:0/1057734819 learned_addr learned my addr 172.21.15.123:0/1057734819 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-09-15T23:25:00.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.801+0000 7fd6cad9d640 1 -- 172.21.15.123:0/1057734819 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6cc070370 msgr2=0x7fd6cc0b0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:00.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.801+0000 7fd6cb59e640 1 --2- 172.21.15.123:0/1057734819 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6cc15c0d0 0x7fd6cc154900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:00.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.801+0000 7fd6cad9d640 1 --2- 172.21.15.123:0/1057734819 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6cc070370 0x7fd6cc0b0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.801+0000 7fd6cad9d640 1 -- 172.21.15.123:0/1057734819 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6cc15c0d0 msgr2=0x7fd6cc154900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:00.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.801+0000 7fd6cad9d640 1 --2- 172.21.15.123:0/1057734819 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6cc15c0d0 0x7fd6cc154900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:00.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.801+0000 7fd6cad9d640 1 -- 172.21.15.123:0/1057734819 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6cc0b17a0 con 0x7fd6cc06c320 2024-09-15T23:25:00.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.801+0000 7fd6cad9d640 1 --2- 172.21.15.123:0/1057734819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6cc06c320 0x7fd6cc1490a0 secure :-1 s=READY pgs=2538 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc00b420 tx=0x7fd6bc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:25:00.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.801+0000 7fd6c3fff640 1 -- 172.21.15.123:0/1057734819 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc011830 con 0x7fd6cc06c320 2024-09-15T23:25:00.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.801+0000 7fd6c3fff640 1 -- 172.21.15.123:0/1057734819 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd6bc016070 con 0x7fd6cc06c320 2024-09-15T23:25:00.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.801+0000 7fd6d0800640 1 -- 172.21.15.123:0/1057734819 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6cc0b1a80 con 0x7fd6cc06c320 2024-09-15T23:25:00.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.801+0000 7fd6c3fff640 1 -- 172.21.15.123:0/1057734819 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc011c30 con 0x7fd6cc06c320 2024-09-15T23:25:00.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.801+0000 7fd6d0800640 1 -- 172.21.15.123:0/1057734819 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6cc160a90 con 0x7fd6cc06c320 2024-09-15T23:25:00.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.802+0000 7fd6d0800640 1 -- 172.21.15.123:0/1057734819 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6cc06bc10 con 0x7fd6cc06c320 2024-09-15T23:25:00.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.803+0000 7fd6c3fff640 1 -- 172.21.15.123:0/1057734819 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd6bc01b460 con 0x7fd6cc06c320 2024-09-15T23:25:00.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.803+0000 7fd6c3fff640 1 --2- 172.21.15.123:0/1057734819 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd6ac06c2b0 0x7fd6ac06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:00.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.803+0000 7fd6c3fff640 1 -- 172.21.15.123:0/1057734819 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 4943+0+0 (secure 0 0 0) 0x7fd6bc08ac70 con 0x7fd6cc06c320 2024-09-15T23:25:00.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.803+0000 7fd6c259c640 1 --2- 172.21.15.123:0/1057734819 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd6ac06c2b0 0x7fd6ac06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:00.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.804+0000 7fd6c259c640 1 --2- 172.21.15.123:0/1057734819 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd6ac06c2b0 0x7fd6ac06e770 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4005880 tx=0x7fd6b4007950 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:25:00.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:00.807+0000 7fd6c3fff640 1 -- 172.21.15.123:0/1057734819 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd6bc020020 con 0x7fd6cc06c320 2024-09-15T23:25:01.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:01.007+0000 7fd6d0800640 1 -- 172.21.15.123:0/1057734819 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6cc0afa70 con 0x7fd6cc06c320 2024-09-15T23:25:01.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:01.007+0000 7fd6c3fff640 1 -- 172.21.15.123:0/1057734819 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 129 v129) ==== 95+0+3926 (secure 0 0 0) 0x7fd6bc0596e0 con 0x7fd6cc06c320 2024-09-15T23:25:01.009 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-09-15T23:25:01.009 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":129,"btime":"2024-09-15T23:24:50:438563+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7922,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/173351117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6833","nonce":173351117},{"type":"v1","addr":"172.21.15.123:6835","nonce":173351117}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123},{"gid":7928,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6837/4283187910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6835","nonce":4283187910},{"type":"v1","addr":"172.21.15.188:6837","nonce":4283187910}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123},{"gid":9061,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.188:6836/3180373488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.188:6834","nonce":3180373488},{"type":"v1","addr":"172.21.15.188:6836","nonce":3180373488}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":123},{"gid":11229,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6834/1660027970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":1660027970},{"type":"v1","addr":"172.21.15.123:6834","nonce":1660027970}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":129}],"filesystems":[]} 2024-09-15T23:25:01.009 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 129 2024-09-15T23:25:01.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:01.009+0000 7fd6d0800640 1 -- 172.21.15.123:0/1057734819 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd6ac06c2b0 msgr2=0x7fd6ac06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:01.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:01.009+0000 7fd6d0800640 1 --2- 172.21.15.123:0/1057734819 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd6ac06c2b0 0x7fd6ac06e770 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4005880 tx=0x7fd6b4007950 comp rx=0 tx=0).stop 2024-09-15T23:25:01.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:01.009+0000 7fd6d0800640 1 -- 172.21.15.123:0/1057734819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6cc06c320 msgr2=0x7fd6cc1490a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:01.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:01.009+0000 7fd6d0800640 1 --2- 172.21.15.123:0/1057734819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6cc06c320 0x7fd6cc1490a0 secure :-1 s=READY pgs=2538 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc00b420 tx=0x7fd6bc00b8e0 comp rx=0 tx=0).stop 2024-09-15T23:25:01.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:01.009+0000 7fd6d0800640 1 -- 172.21.15.123:0/1057734819 shutdown_connections 2024-09-15T23:25:01.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:01.009+0000 7fd6d0800640 1 --2- 172.21.15.123:0/1057734819 >> [v2:172.21.15.188:3300/0,v1:172.21.15.188:6789/0] conn(0x7fd6cc15c0d0 0x7fd6cc154900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:01.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:01.009+0000 7fd6d0800640 1 --2- 172.21.15.123:0/1057734819 >> [v2:172.21.15.188:3301/0,v1:172.21.15.188:6790/0] conn(0x7fd6cc070370 0x7fd6cc0b0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:01.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:01.009+0000 7fd6d0800640 1 --2- 172.21.15.123:0/1057734819 >> [v2:172.21.15.188:6824/2945144488,v1:172.21.15.188:6825/2945144488] conn(0x7fd6ac06c2b0 0x7fd6ac06e770 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:01.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:01.009+0000 7fd6d0800640 1 --2- 172.21.15.123:0/1057734819 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6cc06c320 0x7fd6cc1490a0 unknown :-1 s=CLOSED pgs=2538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:01.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:01.009+0000 7fd6d0800640 1 -- 172.21.15.123:0/1057734819 >> 172.21.15.123:0/1057734819 conn(0x7fd6cc0b2ee0 msgr2=0x7fd6cc0ae900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:25:01.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:01.009+0000 7fd6d0800640 1 -- 172.21.15.123:0/1057734819 shutdown_connections 2024-09-15T23:25:01.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-09-15T23:25:01.009+0000 7fd6d0800640 1 -- 172.21.15.123:0/1057734819 wait complete. 2024-09-15T23:25:01.022 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-15T23:25:01.022 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-15T23:25:01.022 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T23:25:01.022 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:25:01.031 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T23:25:01.031 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T23:25:01.031 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:25:01.079 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T23:25:01.080 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T23:25:01.080 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:25:01.091 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T23:25:01.092 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T23:25:01.092 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:25:01.143 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T23:25:01.143 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-15T23:25:01.144 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-15T23:25:01.144 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:25:01.177 INFO:tasks.ceph.osd.0:Stopped 2024-09-15T23:25:01.178 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-15T23:25:01.178 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:25:01.248 INFO:tasks.ceph.osd.1:Stopped 2024-09-15T23:25:01.248 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-15T23:25:01.248 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:25:01.315 INFO:tasks.ceph.osd.2:Stopped 2024-09-15T23:25:01.316 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-15T23:25:01.316 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:25:01.391 INFO:tasks.ceph.osd.3:Stopped 2024-09-15T23:25:01.392 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-15T23:25:01.392 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:25:01.435 INFO:tasks.ceph.osd.4:Stopped 2024-09-15T23:25:01.435 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-15T23:25:01.435 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:25:01.475 INFO:tasks.ceph.osd.5:Stopped 2024-09-15T23:25:01.475 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-15T23:25:01.476 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:25:01.550 INFO:tasks.ceph.osd.6:Stopped 2024-09-15T23:25:01.550 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-15T23:25:01.550 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:25:01.624 INFO:tasks.ceph.osd.7:Stopped 2024-09-15T23:25:01.625 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-15T23:25:01.625 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-15T23:25:01.625 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:25:01.649 INFO:tasks.ceph.mgr.y:Stopped 2024-09-15T23:25:01.649 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-15T23:25:01.650 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:25:01.695 INFO:tasks.ceph.mgr.x:Stopped 2024-09-15T23:25:01.695 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-15T23:25:01.695 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-15T23:25:01.695 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:25:01.707 INFO:tasks.ceph.mon.a:Stopped 2024-09-15T23:25:01.707 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-15T23:25:01.707 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:25:01.747 INFO:tasks.ceph.mon.b:Stopped 2024-09-15T23:25:01.747 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-15T23:25:01.747 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:25:01.800 INFO:tasks.ceph.mon.c:Stopped 2024-09-15T23:25:01.800 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-15T23:25:01.800 DEBUG:teuthology.orchestra.run.smithi123:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'Replacing daemon mds' | egrep -v 'Scrub error on inode' | egrep -v 'Behind on trimming' | egrep -v 'Metadata damage detected' | egrep -v 'bad backtrace on inode' | egrep -v 'overall HEALTH_' | egrep -v '\(MDS_TRIM\)' | head -n 1 2024-09-15T23:25:01.834 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi123.front.sepia.ceph.com 2024-09-15T23:25:01.834 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-15T23:25:02.138 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi123.front.sepia.ceph.com 2024-09-15T23:25:02.139 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-15T23:25:02.246 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi123.front.sepia.ceph.com 2024-09-15T23:25:02.246 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-15T23:25:02.294 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi123.front.sepia.ceph.com 2024-09-15T23:25:02.294 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-15T23:25:02.345 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi188.front.sepia.ceph.com 2024-09-15T23:25:02.345 DEBUG:teuthology.orchestra.run.smithi188:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-15T23:25:02.655 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi188.front.sepia.ceph.com 2024-09-15T23:25:02.655 DEBUG:teuthology.orchestra.run.smithi188:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-15T23:25:02.774 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi188.front.sepia.ceph.com 2024-09-15T23:25:02.774 DEBUG:teuthology.orchestra.run.smithi188:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-15T23:25:02.831 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi188.front.sepia.ceph.com 2024-09-15T23:25:02.832 DEBUG:teuthology.orchestra.run.smithi188:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-15T23:25:02.889 INFO:tasks.ceph:Archiving mon data... 2024-09-15T23:25:02.890 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906308/data/mon.a.tgz 2024-09-15T23:25:02.890 DEBUG:teuthology.orchestra.run.smithi123:> mktemp 2024-09-15T23:25:02.906 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/tmp.kyUX6HuH3w 2024-09-15T23:25:02.907 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.kyUX6HuH3w 2024-09-15T23:25:03.078 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0666 /tmp/tmp.kyUX6HuH3w 2024-09-15T23:25:03.161 DEBUG:teuthology.orchestra.remote:smithi123:/tmp/tmp.kyUX6HuH3w is 502KB 2024-09-15T23:25:03.261 DEBUG:teuthology.orchestra.run.smithi123:> rm -fr /tmp/tmp.kyUX6HuH3w 2024-09-15T23:25:03.277 DEBUG:teuthology.misc:Transferring archived files from smithi188:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906308/data/mon.b.tgz 2024-09-15T23:25:03.277 DEBUG:teuthology.orchestra.run.smithi188:> mktemp 2024-09-15T23:25:03.294 INFO:teuthology.orchestra.run.smithi188.stdout:/tmp/tmp.d0npg8pi0b 2024-09-15T23:25:03.295 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.d0npg8pi0b 2024-09-15T23:25:03.466 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 0666 /tmp/tmp.d0npg8pi0b 2024-09-15T23:25:03.548 DEBUG:teuthology.orchestra.remote:smithi188:/tmp/tmp.d0npg8pi0b is 507KB 2024-09-15T23:25:03.618 DEBUG:teuthology.orchestra.run.smithi188:> rm -fr /tmp/tmp.d0npg8pi0b 2024-09-15T23:25:03.633 DEBUG:teuthology.misc:Transferring archived files from smithi188:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906308/data/mon.c.tgz 2024-09-15T23:25:03.633 DEBUG:teuthology.orchestra.run.smithi188:> mktemp 2024-09-15T23:25:03.687 INFO:teuthology.orchestra.run.smithi188.stdout:/tmp/tmp.8Vo5N54gyC 2024-09-15T23:25:03.688 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.8Vo5N54gyC 2024-09-15T23:25:03.844 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 0666 /tmp/tmp.8Vo5N54gyC 2024-09-15T23:25:03.927 DEBUG:teuthology.orchestra.remote:smithi188:/tmp/tmp.8Vo5N54gyC is 507KB 2024-09-15T23:25:04.023 DEBUG:teuthology.orchestra.run.smithi188:> rm -fr /tmp/tmp.8Vo5N54gyC 2024-09-15T23:25:04.038 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-15T23:25:04.038 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-15T23:25:04.041 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-15T23:25:04.122 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-15T23:25:04.157 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-15T23:25:04.157 INFO:tasks.ceph:Archiving crash dumps... 2024-09-15T23:25:04.159 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906308/remote/smithi123/crash 2024-09-15T23:25:04.160 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-15T23:25:04.190 DEBUG:teuthology.misc:Transferring archived files from smithi188:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906308/remote/smithi188/crash 2024-09-15T23:25:04.191 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-15T23:25:04.221 INFO:tasks.ceph:Shutting down logrotate 2024-09-15T23:25:04.222 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:25:04.232 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T23:25:04.317 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-15T23:25:04.342 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-15T23:25:04.367 INFO:tasks.ceph:Compressing logs... 2024-09-15T23:25:04.367 DEBUG:teuthology.orchestra.run.smithi123:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T23:25:04.385 DEBUG:teuthology.orchestra.run.smithi188:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T23:25:04.449 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36601.log 2024-09-15T23:25:04.449 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-15T23:25:04.449 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.36601.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-15T23:25:04.449 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-osd.7.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.36601.log.gz -5 2024-09-15T23:25:04.450 INFO:teuthology.orchestra.run.smithi188.stderr: --verbose -- /var/log/ceph/ceph-client.admin.36561.log 2024-09-15T23:25:04.450 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-15T23:25:04.450 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.36561.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-15T23:25:04.450 INFO:teuthology.orchestra.run.smithi188.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36561.log.gz 2024-09-15T23:25:04.450 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42393.log 2024-09-15T23:25:04.450 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36852.log 2024-09-15T23:25:04.450 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.1.42393.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42393.log.gz 2024-09-15T23:25:04.450 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36641.log 2024-09-15T23:25:04.451 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36681.log 2024-09-15T23:25:04.451 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.36852.log: /var/log/ceph/ceph-client.admin.36641.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-15T23:25:04.451 INFO:teuthology.orchestra.run.smithi188.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36852.log.gz 2024-09-15T23:25:04.451 INFO:teuthology.orchestra.run.smithi188.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36641.log.gz 2024-09-15T23:25:04.451 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.36681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42398.log 2024-09-15T23:25:04.451 INFO:teuthology.orchestra.run.smithi188.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36681.log.gz 2024-09-15T23:25:04.451 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42793.log 2024-09-15T23:25:04.451 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.1.42398.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42398.log.gz 2024-09-15T23:25:04.452 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42797.log 2024-09-15T23:25:04.452 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-15T23:25:04.452 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.3.42793.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42793.log.gz 2024-09-15T23:25:04.452 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.3.42797.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-15T23:25:04.452 INFO:teuthology.orchestra.run.smithi188.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42797.log.gz 2024-09-15T23:25:04.452 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-15T23:25:04.452 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-15T23:25:04.452 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph.log: 94.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-15T23:25:04.452 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-15T23:25:04.453 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-mds.d.log: 92.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-15T23:25:04.453 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-15T23:25:04.467 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36725.log 2024-09-15T23:25:04.474 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36772.log 2024-09-15T23:25:04.474 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.36725.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36725.log.gz 2024-09-15T23:25:04.488 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36812.log 2024-09-15T23:25:04.496 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.36772.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.36772.log.gz 2024-09-15T23:25:04.496 INFO:teuthology.orchestra.run.smithi188.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-15T23:25:04.496 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ceph-client.admin.36812.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36812.log.gz 2024-09-15T23:25:04.631 INFO:teuthology.orchestra.run.smithi188.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-15T23:25:04.812 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-15T23:25:04.812 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55129.log 2024-09-15T23:25:04.813 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80524.log 2024-09-15T23:25:04.813 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42779.log 2024-09-15T23:25:04.813 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.55129.log: /var/log/ceph/ceph-client.0.80524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70317.log 2024-09-15T23:25:04.813 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.80524.log.gz 2024-09-15T23:25:04.813 INFO:teuthology.orchestra.run.smithi123.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55129.log.gz 2024-09-15T23:25:04.813 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68616.log 2024-09-15T23:25:04.814 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42779.log.gz 2024-09-15T23:25:04.814 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.70317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108980.log 2024-09-15T23:25:04.814 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70317.log.gz 2024-09-15T23:25:04.814 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.68616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42867.log 2024-09-15T23:25:04.814 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.108980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48335.log 2024-09-15T23:25:04.814 INFO:teuthology.orchestra.run.smithi123.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.68616.log.gz 2024-09-15T23:25:04.815 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42867.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.108980.log.gz 2024-09-15T23:25:04.815 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47090.log 2024-09-15T23:25:04.815 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82658.log 2024-09-15T23:25:04.815 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.48335.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42867.log.gz 2024-09-15T23:25:04.815 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48335.log.gz 2024-09-15T23:25:04.815 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.47090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104706.log 2024-09-15T23:25:04.816 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47090.log.gz 2024-09-15T23:25:04.816 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.82658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66817.log 2024-09-15T23:25:04.816 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.104706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97745.log 2024-09-15T23:25:04.816 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.82658.log.gz 2024-09-15T23:25:04.816 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.66817.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.104706.log.gz 2024-09-15T23:25:04.816 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44631.log 2024-09-15T23:25:04.817 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66817.log.gz 2024-09-15T23:25:04.817 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.97745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78131.log 2024-09-15T23:25:04.817 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44631.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.97745.log.gz 2024-09-15T23:25:04.817 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98404.log 2024-09-15T23:25:04.817 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44631.log.gz 2024-09-15T23:25:04.817 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.78131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88028.log 2024-09-15T23:25:04.818 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.98404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44811.log 2024-09-15T23:25:04.818 INFO:teuthology.orchestra.run.smithi123.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.78131.log.gz 2024-09-15T23:25:04.818 INFO:teuthology.orchestra.run.smithi123.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.98404.log.gz 2024-09-15T23:25:04.818 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.88028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109106.log 2024-09-15T23:25:04.818 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106143.log 2024-09-15T23:25:04.818 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.88028.log.gz 2024-09-15T23:25:04.818 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44811.log: /var/log/ceph/ceph-client.admin.109106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65408.log 2024-09-15T23:25:04.819 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44811.log.gz 2024-09-15T23:25:04.819 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.106143.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109106.log.gz 2024-09-15T23:25:04.819 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57540.log 2024-09-15T23:25:04.819 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.106143.log.gz 2024-09-15T23:25:04.819 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.65408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55911.log 2024-09-15T23:25:04.819 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65408.log.gz 2024-09-15T23:25:04.820 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.57540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70131.log 2024-09-15T23:25:04.820 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.55911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47485.log 2024-09-15T23:25:04.820 INFO:teuthology.orchestra.run.smithi123.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.57540.log.gz 2024-09-15T23:25:04.820 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.70131.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55911.log.gz 2024-09-15T23:25:04.820 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91918.log 2024-09-15T23:25:04.820 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105155.log 2024-09-15T23:25:04.820 INFO:teuthology.orchestra.run.smithi123.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.70131.log.gz 2024-09-15T23:25:04.821 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.47485.log: /var/log/ceph/ceph-client.admin.91918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94362.log 2024-09-15T23:25:04.821 INFO:teuthology.orchestra.run.smithi123.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47485.log.gz 2024-09-15T23:25:04.821 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.105155.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.91918.log.gz 2024-09-15T23:25:04.821 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91636.log 2024-09-15T23:25:04.821 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.105155.log.gz 2024-09-15T23:25:04.821 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.94362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80185.log 2024-09-15T23:25:04.822 INFO:teuthology.orchestra.run.smithi123.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.94362.log.gz 2024-09-15T23:25:04.822 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.91636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43835.log 2024-09-15T23:25:04.822 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.80185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82323.log 2024-09-15T23:25:04.822 INFO:teuthology.orchestra.run.smithi123.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.91636.log.gz 2024-09-15T23:25:04.822 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43835.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.80185.log.gz 2024-09-15T23:25:04.823 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93085.log 2024-09-15T23:25:04.823 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43835.log.gz 2024-09-15T23:25:04.823 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65406.log 2024-09-15T23:25:04.823 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.82323.log: /var/log/ceph/ceph-client.admin.93085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106228.log 2024-09-15T23:25:04.823 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.65406.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.93085.log.gz 2024-09-15T23:25:04.823 INFO:teuthology.orchestra.run.smithi123.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.82323.log.gz 2024-09-15T23:25:04.823 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57211.log 2024-09-15T23:25:04.824 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65406.log.gz 2024-09-15T23:25:04.824 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.106228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64375.log 2024-09-15T23:25:04.824 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.57211.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.106228.log.gz 2024-09-15T23:25:04.824 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58304.log 2024-09-15T23:25:04.824 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.64375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64110.log 2024-09-15T23:25:04.824 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.58304.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.57211.log.gz 2024-09-15T23:25:04.825 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64375.log.gz 2024-09-15T23:25:04.825 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60471.log 2024-09-15T23:25:04.825 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58304.log.gz 2024-09-15T23:25:04.825 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.64110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44379.log 2024-09-15T23:25:04.825 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64110.log.gz 2024-09-15T23:25:04.825 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.60471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84231.log 2024-09-15T23:25:04.826 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44379.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.60471.log.gz 2024-09-15T23:25:04.826 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94148.log 2024-09-15T23:25:04.826 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44379.log.gz 2024-09-15T23:25:04.826 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.84231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94530.log 2024-09-15T23:25:04.826 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.84231.log.gz 2024-09-15T23:25:04.826 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.94148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107677.log 2024-09-15T23:25:04.826 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.94530.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94148.log.gz 2024-09-15T23:25:04.827 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47390.log 2024-09-15T23:25:04.827 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94530.log.gz 2024-09-15T23:25:04.827 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.107677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102668.log 2024-09-15T23:25:04.827 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107677.log.gz 2024-09-15T23:25:04.827 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.47390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45855.log 2024-09-15T23:25:04.828 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.102668.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47390.log.gz 2024-09-15T23:25:04.828 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57854.log 2024-09-15T23:25:04.828 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.102668.log.gz 2024-09-15T23:25:04.828 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63980.log 2024-09-15T23:25:04.828 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45855.log.gz 2024-09-15T23:25:04.828 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.57854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83639.log 2024-09-15T23:25:04.828 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.63980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79891.log 2024-09-15T23:25:04.829 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.63980.log.gz 2024-09-15T23:25:04.829 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.83639.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.57854.log.gz 2024-09-15T23:25:04.829 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93211.log 2024-09-15T23:25:04.829 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.83639.log.gzgzip 2024-09-15T23:25:04.829 INFO:teuthology.orchestra.run.smithi123.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.104611.log 2024-09-15T23:25:04.829 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.79891.log: /var/log/ceph/ceph-client.admin.93211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.106794.log 2024-09-15T23:25:04.830 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.79891.log.gz 2024-09-15T23:25:04.830 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93211.log.gz 2024-09-15T23:25:04.830 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.104611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105975.log 2024-09-15T23:25:04.830 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.106794.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.104611.log.gz 2024-09-15T23:25:04.830 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102889.log 2024-09-15T23:25:04.830 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.106794.log.gz 2024-09-15T23:25:04.831 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.105975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42556.log 2024-09-15T23:25:04.831 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.105975.log.gz 2024-09-15T23:25:04.831 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99295.log 2024-09-15T23:25:04.831 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.102889.log: /var/log/ceph/ceph-client.admin.42556.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.102889.log.gz 2024-09-15T23:25:04.831 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106498.log 2024-09-15T23:25:04.831 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.99295.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42556.log.gz 2024-09-15T23:25:04.832 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42993.log 2024-09-15T23:25:04.832 INFO:teuthology.orchestra.run.smithi123.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.99295.log.gz 2024-09-15T23:25:04.832 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.106498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106312.log 2024-09-15T23:25:04.832 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.106498.log.gz 2024-09-15T23:25:04.832 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59938.log 2024-09-15T23:25:04.832 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.106312.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42993.log.gz 2024-09-15T23:25:04.832 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43501.log 2024-09-15T23:25:04.833 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.106312.log.gz 2024-09-15T23:25:04.833 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.59938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71690.log 2024-09-15T23:25:04.833 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59938.log.gz 2024-09-15T23:25:04.833 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84273.log 2024-09-15T23:25:04.833 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43501.log.gz 2024-09-15T23:25:04.833 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.71690.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.0.71690.log.gz -5 2024-09-15T23:25:04.834 INFO:teuthology.orchestra.run.smithi123.stderr: --verbose -- /var/log/ceph/ceph-client.admin.71222.log 2024-09-15T23:25:04.834 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.84273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67284.log 2024-09-15T23:25:04.834 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.84273.log.gz 2024-09-15T23:25:04.834 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.71222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92086.log 2024-09-15T23:25:04.834 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.67284.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.71222.log.gz 2024-09-15T23:25:04.834 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47346.log 2024-09-15T23:25:04.834 INFO:teuthology.orchestra.run.smithi123.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.67284.log.gz 2024-09-15T23:25:04.835 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.92086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61658.log 2024-09-15T23:25:04.835 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.47346.log: gzip 88.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.92086.log.gz --verbose 2024-09-15T23:25:04.835 INFO:teuthology.orchestra.run.smithi123.stderr: -- /var/log/ceph/ceph-client.admin.55389.log 2024-09-15T23:25:04.835 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.61658.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47346.log.gz 2024-09-15T23:25:04.835 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94097.log 2024-09-15T23:25:04.835 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61658.log.gz 2024-09-15T23:25:04.836 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.55389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67978.log 2024-09-15T23:25:04.836 INFO:teuthology.orchestra.run.smithi123.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55389.log.gz/var/log/ceph/ceph-client.admin.94097.log: 2024-09-15T23:25:04.836 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92428.log 2024-09-15T23:25:04.836 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.94097.log.gz 2024-09-15T23:25:04.836 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.67978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98320.log 2024-09-15T23:25:04.836 INFO:teuthology.orchestra.run.smithi123.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67978.log.gz 2024-09-15T23:25:04.837 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.92428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101628.log 2024-09-15T23:25:04.837 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.98320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107248.log 2024-09-15T23:25:04.837 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.92428.log.gz 2024-09-15T23:25:04.837 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.101628.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98320.log.gz 2024-09-15T23:25:04.837 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60551.log 2024-09-15T23:25:04.837 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.101628.log.gz 2024-09-15T23:25:04.837 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.107248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92212.log 2024-09-15T23:25:04.838 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.60551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93482.log 2024-09-15T23:25:04.838 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.92212.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60551.log.gz 2024-09-15T23:25:04.838 INFO:teuthology.orchestra.run.smithi123.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.107248.log.gz 2024-09-15T23:25:04.838 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67242.log 2024-09-15T23:25:04.838 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.92212.log.gz 2024-09-15T23:25:04.838 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.93482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108896.log 2024-09-15T23:25:04.838 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.93482.log.gz 2024-09-15T23:25:04.839 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.67242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98488.log 2024-09-15T23:25:04.839 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4%/var/log/ceph/ceph-client.admin.108896.log: -- replaced with /var/log/ceph/ceph-client.admin.67242.log.gz 2024-09-15T23:25:04.839 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63158.log 2024-09-15T23:25:04.839 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108896.log.gz 2024-09-15T23:25:04.839 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.98488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65753.log 2024-09-15T23:25:04.839 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98488.log.gz 2024-09-15T23:25:04.840 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.63158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84525.log 2024-09-15T23:25:04.840 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.65753.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63158.log.gz 2024-09-15T23:25:04.840 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59087.log 2024-09-15T23:25:04.840 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.84525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63597.log 2024-09-15T23:25:04.840 INFO:teuthology.orchestra.run.smithi123.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.84525.log.gz 2024-09-15T23:25:04.840 INFO:teuthology.orchestra.run.smithi123.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.65753.log.gz 2024-09-15T23:25:04.840 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.59087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82752.log 2024-09-15T23:25:04.840 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.63597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65665.log 2024-09-15T23:25:04.841 INFO:teuthology.orchestra.run.smithi123.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.59087.log.gz 2024-09-15T23:25:04.841 INFO:teuthology.orchestra.run.smithi123.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63597.log.gz 2024-09-15T23:25:04.841 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.82752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80228.log 2024-09-15T23:25:04.841 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.82752.log.gz 2024-09-15T23:25:04.841 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.65665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103223.log 2024-09-15T23:25:04.841 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.80228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43847.log 2024-09-15T23:25:04.842 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.65665.log.gz 2024-09-15T23:25:04.842 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.103223.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.80228.log.gz 2024-09-15T23:25:04.842 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79042.log 2024-09-15T23:25:04.842 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103223.log.gz 2024-09-15T23:25:04.842 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86493.log 2024-09-15T23:25:04.843 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.79042.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43847.log.gz 2024-09-15T23:25:04.843 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70173.log 2024-09-15T23:25:04.843 INFO:teuthology.orchestra.run.smithi123.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.79042.log.gz 2024-09-15T23:25:04.843 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.86493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107990.log 2024-09-15T23:25:04.843 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.70173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89440.log 2024-09-15T23:25:04.843 INFO:teuthology.orchestra.run.smithi123.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.86493.log.gz 2024-09-15T23:25:04.844 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.107990.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.70173.log.gz 2024-09-15T23:25:04.844 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88835.log 2024-09-15T23:25:04.844 INFO:teuthology.orchestra.run.smithi123.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.107990.log.gz 2024-09-15T23:25:04.844 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59143.log 2024-09-15T23:25:04.844 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.89440.log: /var/log/ceph/ceph-client.admin.88835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69566.log 2024-09-15T23:25:04.844 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.89440.log.gz 2024-09-15T23:25:04.844 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.59143.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.88835.log.gz 2024-09-15T23:25:04.845 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87629.log 2024-09-15T23:25:04.845 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.69566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66546.log 2024-09-15T23:25:04.845 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.87629.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.59143.log.gz 2024-09-15T23:25:04.845 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.69566.log.gz 2024-09-15T23:25:04.845 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93127.log 2024-09-15T23:25:04.845 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.87629.log.gz 2024-09-15T23:25:04.846 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.66546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99505.log 2024-09-15T23:25:04.846 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.93127.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.66546.log.gz 2024-09-15T23:25:04.846 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47569.log 2024-09-15T23:25:04.846 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.99505.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93127.log.gz 2024-09-15T23:25:04.846 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92128.log 2024-09-15T23:25:04.846 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.47569.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.99505.log.gz 2024-09-15T23:25:04.847 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83340.log 2024-09-15T23:25:04.847 INFO:teuthology.orchestra.run.smithi123.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47569.log.gz 2024-09-15T23:25:04.847 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.92128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78560.log 2024-09-15T23:25:04.847 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.83340.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.92128.log.gz -5 2024-09-15T23:25:04.847 INFO:teuthology.orchestra.run.smithi123.stderr: --verbose -- /var/log/ceph/ceph-client.admin.66106.log 2024-09-15T23:25:04.847 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.83340.log.gz 2024-09-15T23:25:04.847 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.78560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64627.log 2024-09-15T23:25:04.848 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.78560.log.gz 2024-09-15T23:25:04.848 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.66106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46794.log 2024-09-15T23:25:04.848 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.64627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105834.log 2024-09-15T23:25:04.848 INFO:teuthology.orchestra.run.smithi123.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.66106.log.gz 2024-09-15T23:25:04.848 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46794.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64627.log.gz 2024-09-15T23:25:04.848 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-15T23:25:04.849 INFO:teuthology.orchestra.run.smithi123.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46794.log.gz 2024-09-15T23:25:04.849 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.105834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67326.log 2024-09-15T23:25:04.849 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.105834.log.gz 2024-09-15T23:25:04.849 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46041.log 2024-09-15T23:25:04.849 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.67326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87850.log 2024-09-15T23:25:04.849 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46041.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.67326.log.gz 2024-09-15T23:25:04.849 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67370.log 2024-09-15T23:25:04.850 INFO:teuthology.orchestra.run.smithi123.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46041.log.gz 2024-09-15T23:25:04.850 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.87850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92536.log 2024-09-15T23:25:04.850 INFO:teuthology.orchestra.run.smithi123.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.87850.log.gz 2024-09-15T23:25:04.850 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.67370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97260.log 2024-09-15T23:25:04.850 INFO:teuthology.orchestra.run.smithi123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.67370.log.gz 2024-09-15T23:25:04.850 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.92536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64543.log 2024-09-15T23:25:04.851 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59812.log 2024-09-15T23:25:04.851 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.97260.log: /var/log/ceph/ceph-client.admin.64543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93440.log 2024-09-15T23:25:04.851 INFO:teuthology.orchestra.run.smithi123.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.92536.log.gz 2024-09-15T23:25:04.851 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.97260.log.gz 2024-09-15T23:25:04.851 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0%/var/log/ceph/ceph-client.admin.59812.log: -- replaced with /var/log/ceph/ceph-client.admin.64543.log.gz 2024-09-15T23:25:04.851 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62711.log 2024-09-15T23:25:04.851 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.93440.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.59812.log.gz 2024-09-15T23:25:04.852 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45592.log 2024-09-15T23:25:04.852 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69135.log 2024-09-15T23:25:04.852 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.93440.log.gz 2024-09-15T23:25:04.852 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.62711.log: /var/log/ceph/ceph-client.2.45592.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45592.log.gz 2024-09-15T23:25:04.852 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66985.log 2024-09-15T23:25:04.852 INFO:teuthology.orchestra.run.smithi123.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62711.log.gz 2024-09-15T23:25:04.852 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107803.log 2024-09-15T23:25:04.852 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.69135.log: /var/log/ceph/ceph-client.admin.66985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62791.log 2024-09-15T23:25:04.853 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.69135.log.gz 2024-09-15T23:25:04.853 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.107803.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.66985.log.gz 2024-09-15T23:25:04.853 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78770.log 2024-09-15T23:25:04.853 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.107803.log.gz 2024-09-15T23:25:04.853 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.62791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98194.log 2024-09-15T23:25:04.853 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.62791.log.gz 2024-09-15T23:25:04.853 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88366.log 2024-09-15T23:25:04.853 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.78770.log: /var/log/ceph/ceph-client.admin.98194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105281.log 2024-09-15T23:25:04.854 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.78770.log.gz 2024-09-15T23:25:04.854 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.88366.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98194.log.gz 2024-09-15T23:25:04.854 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70886.log 2024-09-15T23:25:04.854 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.105281.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.88366.log.gz 2024-09-15T23:25:04.854 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36845.log 2024-09-15T23:25:04.854 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105281.log.gz 2024-09-15T23:25:04.854 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.70886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63776.log 2024-09-15T23:25:04.854 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.70886.log.gz 2024-09-15T23:25:04.854 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98007.log 2024-09-15T23:25:04.855 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36845.log: /var/log/ceph/ceph-client.admin.63776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94278.log 2024-09-15T23:25:04.855 INFO:teuthology.orchestra.run.smithi123.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36845.log.gz 2024-09-15T23:25:04.855 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.63776.log.gz 2024-09-15T23:25:04.855 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.98007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47909.log 2024-09-15T23:25:04.855 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92320.log 2024-09-15T23:25:04.855 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6%/var/log/ceph/ceph-client.admin.94278.log: -- replaced with /var/log/ceph/ceph-client.admin.98007.log.gz 2024-09-15T23:25:04.855 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.47909.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.94278.log.gz 2024-09-15T23:25:04.855 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70659.log 2024-09-15T23:25:04.856 INFO:teuthology.orchestra.run.smithi123.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47909.log.gz 2024-09-15T23:25:04.856 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46836.log 2024-09-15T23:25:04.856 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.92320.log: /var/log/ceph/ceph-client.admin.70659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78686.log 2024-09-15T23:25:04.856 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.70659.log.gz 2024-09-15T23:25:04.856 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98583.log 2024-09-15T23:25:04.856 INFO:teuthology.orchestra.run.smithi123.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.92320.log.gz 2024-09-15T23:25:04.856 INFO:teuthology.orchestra.run.smithi123.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46836.log.gz 2024-09-15T23:25:04.856 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108266.log 2024-09-15T23:25:04.857 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.78686.log: /var/log/ceph/ceph-client.admin.98583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68539.log 2024-09-15T23:25:04.857 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.78686.log.gz 2024-09-15T23:25:04.857 INFO:teuthology.orchestra.run.smithi123.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.98583.log.gz 2024-09-15T23:25:04.857 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.108266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104800.log 2024-09-15T23:25:04.857 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108476.log 2024-09-15T23:25:04.857 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108266.log.gz 2024-09-15T23:25:04.857 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.68539.log: /var/log/ceph/ceph-client.admin.104800.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.68539.log.gz 2024-09-15T23:25:04.857 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62104.log 2024-09-15T23:25:04.858 INFO:teuthology.orchestra.run.smithi123.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.104800.log.gz 2024-09-15T23:25:04.858 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63074.log 2024-09-15T23:25:04.858 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.108476.log: /var/log/ceph/ceph-client.admin.62104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70701.log 2024-09-15T23:25:04.858 INFO:teuthology.orchestra.run.smithi123.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.108476.log.gz 2024-09-15T23:25:04.858 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62104.log.gz 2024-09-15T23:25:04.858 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.63074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91876.log 2024-09-15T23:25:04.858 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63074.log.gz 2024-09-15T23:25:04.858 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94806.log 2024-09-15T23:25:04.858 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.70701.log: /var/log/ceph/ceph-client.admin.91876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103951.log 2024-09-15T23:25:04.859 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70701.log.gz 2024-09-15T23:25:04.859 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.94806.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.91876.log.gz 2024-09-15T23:25:04.859 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98679.log 2024-09-15T23:25:04.859 INFO:teuthology.orchestra.run.smithi123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.94806.log.gz 2024-09-15T23:25:04.859 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.103951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43510.log 2024-09-15T23:25:04.859 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.103951.log.gz 2024-09-15T23:25:04.859 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108812.log 2024-09-15T23:25:04.859 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.98679.log: /var/log/ceph/ceph-client.admin.43510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56417.log 2024-09-15T23:25:04.859 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98679.log.gz 2024-09-15T23:25:04.860 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.108812.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43510.log.gz 2024-09-15T23:25:04.860 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43508.log 2024-09-15T23:25:04.860 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83214.log 2024-09-15T23:25:04.860 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.56417.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.108812.log.gz 2024-09-15T23:25:04.860 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87755.log 2024-09-15T23:25:04.860 INFO:teuthology.orchestra.run.smithi123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56417.log.gz 2024-09-15T23:25:04.860 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43508.log.gz 2024-09-15T23:25:04.860 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105748.log 2024-09-15T23:25:04.861 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.83214.log: /var/log/ceph/ceph-client.admin.87755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56459.log 2024-09-15T23:25:04.861 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.83214.log.gz 2024-09-15T23:25:04.861 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.87755.log.gz 2024-09-15T23:25:04.861 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.105748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94232.log 2024-09-15T23:25:04.861 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.105748.log.gz 2024-09-15T23:25:04.861 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.56459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58172.log 2024-09-15T23:25:04.861 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.56459.log.gz 2024-09-15T23:25:04.861 INFO:teuthology.orchestra.run.smithi123.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.68981.log 2024-09-15T23:25:04.862 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.94232.log: /var/log/ceph/ceph-client.admin.58172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66378.log 2024-09-15T23:25:04.862 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94232.log.gz 2024-09-15T23:25:04.862 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.68981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45771.log 2024-09-15T23:25:04.862 INFO:teuthology.orchestra.run.smithi123.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.58172.log.gz 2024-09-15T23:25:04.862 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68981.log.gz 2024-09-15T23:25:04.862 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.66378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45813.log 2024-09-15T23:25:04.862 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83853.log 2024-09-15T23:25:04.862 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.66378.log.gz 2024-09-15T23:25:04.863 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45771.log.gz 2024-09-15T23:25:04.863 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104395.log 2024-09-15T23:25:04.863 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65605.log 2024-09-15T23:25:04.863 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45813.log.gz 2024-09-15T23:25:04.863 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.83853.log: /var/log/ceph/ceph-client.admin.104395.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.83853.log.gz 2024-09-15T23:25:04.863 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99421.log 2024-09-15T23:25:04.863 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70359.log 2024-09-15T23:25:04.863 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.65605.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.104395.log.gz 2024-09-15T23:25:04.863 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.99421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103316.log 2024-09-15T23:25:04.864 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.65605.log.gz 2024-09-15T23:25:04.864 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99421.log.gz 2024-09-15T23:25:04.864 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65249.log 2024-09-15T23:25:04.864 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.70359.log: /var/log/ceph/ceph-client.admin.103316.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70359.log.gz 2024-09-15T23:25:04.864 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94698.log 2024-09-15T23:25:04.864 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.103316.log.gz 2024-09-15T23:25:04.864 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56375.log 2024-09-15T23:25:04.864 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.65249.log: /var/log/ceph/ceph-client.admin.94698.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30363.log 2024-09-15T23:25:04.865 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65249.log.gz 2024-09-15T23:25:04.865 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.56375.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94698.log.gz 2024-09-15T23:25:04.865 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44589.log 2024-09-15T23:25:04.865 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56375.log.gz 2024-09-15T23:25:04.865 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph.tmp-client.admin.30363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88070.log 2024-09-15T23:25:04.865 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30363.log.gz 2024-09-15T23:25:04.865 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67810.log 2024-09-15T23:25:04.865 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.88070.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44589.log.gz 2024-09-15T23:25:04.866 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89007.log 2024-09-15T23:25:04.866 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.88070.log.gz 2024-09-15T23:25:04.866 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.67810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59407.log 2024-09-15T23:25:04.866 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99085.log 2024-09-15T23:25:04.866 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.67810.log.gz 2024-09-15T23:25:04.866 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.89007.log: /var/log/ceph/ceph-client.admin.59407.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.89007.log.gz 2024-09-15T23:25:04.866 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99379.log 2024-09-15T23:25:04.866 INFO:teuthology.orchestra.run.smithi123.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59407.log.gz 2024-09-15T23:25:04.867 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79765.log 2024-09-15T23:25:04.867 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.99085.log: /var/log/ceph/ceph-client.admin.99379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108518.log 2024-09-15T23:25:04.867 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.99085.log.gz 2024-09-15T23:25:04.867 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.79765.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.99379.log.gz 2024-09-15T23:25:04.867 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66943.log 2024-09-15T23:25:04.867 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.79765.log.gz 2024-09-15T23:25:04.867 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.108518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88408.log 2024-09-15T23:25:04.867 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69650.log 2024-09-15T23:25:04.868 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108518.log.gz 2024-09-15T23:25:04.868 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.66943.log: /var/log/ceph/ceph-client.admin.88408.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.66943.log.gzgzip 2024-09-15T23:25:04.868 INFO:teuthology.orchestra.run.smithi123.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.87671.log 2024-09-15T23:25:04.868 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.88408.log.gz 2024-09-15T23:25:04.868 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91834.log 2024-09-15T23:25:04.868 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.69650.log: /var/log/ceph/ceph-client.admin.87671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47615.log 2024-09-15T23:25:04.868 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.69650.log.gz 2024-09-15T23:25:04.868 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4%/var/log/ceph/ceph-client.admin.91834.log: -- replaced with /var/log/ceph/ceph-client.admin.87671.log.gz 2024-09-15T23:25:04.869 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44505.log 2024-09-15T23:25:04.869 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.91834.log.gz 2024-09-15T23:25:04.869 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.47615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94320.log 2024-09-15T23:25:04.869 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47615.log.gz 2024-09-15T23:25:04.869 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55568.log 2024-09-15T23:25:04.869 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44505.log: /var/log/ceph/ceph-client.admin.94320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86794.log 2024-09-15T23:25:04.869 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44505.log.gz 2024-09-15T23:25:04.869 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94320.log.gz 2024-09-15T23:25:04.869 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.55568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103051.log 2024-09-15T23:25:04.870 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55568.log.gz 2024-09-15T23:25:04.870 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.99805.log 2024-09-15T23:25:04.870 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.86794.log: /var/log/ceph/ceph-client.admin.103051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79551.log 2024-09-15T23:25:04.870 INFO:teuthology.orchestra.run.smithi123.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.86794.log.gz 2024-09-15T23:25:04.870 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.99805.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103051.log.gz 2024-09-15T23:25:04.870 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43844.log 2024-09-15T23:25:04.870 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.99805.log.gz 2024-09-15T23:25:04.870 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.79551.log: /var/log/ceph/ceph-client.admin.57937.log 2024-09-15T23:25:04.871 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43844.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.79551.log.gz 2024-09-15T23:25:04.871 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69878.log 2024-09-15T23:25:04.871 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8%/var/log/ceph/ceph-client.admin.57937.log: -- replaced with /var/log/ceph/ceph-client.admin.43844.log.gz 2024-09-15T23:25:04.871 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105239.log 2024-09-15T23:25:04.871 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48035.log 2024-09-15T23:25:04.871 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.69878.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.57937.log.gz 2024-09-15T23:25:04.871 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.105239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98829.log 2024-09-15T23:25:04.871 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.69878.log.gz 2024-09-15T23:25:04.872 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105239.log.gz 2024-09-15T23:25:04.872 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.48035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.106798.log 2024-09-15T23:25:04.872 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.48035.log.gz -5 2024-09-15T23:25:04.872 INFO:teuthology.orchestra.run.smithi123.stderr: --verbose -- /var/log/ceph/ceph-client.admin.70745.log 2024-09-15T23:25:04.872 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.98829.log: /var/log/ceph/ceph-client.0.106798.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98829.log.gz 2024-09-15T23:25:04.872 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.106798.log.gz 2024-09-15T23:25:04.872 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68740.log 2024-09-15T23:25:04.873 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62105.log 2024-09-15T23:25:04.873 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.70745.log: /var/log/ceph/ceph-client.admin.68740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86559.log 2024-09-15T23:25:04.873 INFO:teuthology.orchestra.run.smithi123.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.70745.log.gz 2024-09-15T23:25:04.873 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.62105.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.68740.log.gz 2024-09-15T23:25:04.873 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65292.log 2024-09-15T23:25:04.873 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62105.log.gz 2024-09-15T23:25:04.873 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.86559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107331.log 2024-09-15T23:25:04.873 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89272.log 2024-09-15T23:25:04.874 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.65292.log: /var/log/ceph/ceph-client.admin.107331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93967.log 2024-09-15T23:25:04.874 INFO:teuthology.orchestra.run.smithi123.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.65292.log.gz 2024-09-15T23:25:04.874 INFO:teuthology.orchestra.run.smithi123.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.86559.log.gz 2024-09-15T23:25:04.874 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.107331.log.gz 2024-09-15T23:25:04.874 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.89272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97501.log 2024-09-15T23:25:04.874 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.93967.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.89272.log.gz 2024-09-15T23:25:04.874 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97176.log 2024-09-15T23:25:04.874 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.97501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62645.log 2024-09-15T23:25:04.875 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.93967.log.gz 2024-09-15T23:25:04.875 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.97176.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97501.log.gz 2024-09-15T23:25:04.875 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84375.log 2024-09-15T23:25:04.875 INFO:teuthology.orchestra.run.smithi123.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97176.log.gz 2024-09-15T23:25:04.875 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.62645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47951.log 2024-09-15T23:25:04.875 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70257.log 2024-09-15T23:25:04.875 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.84375.log: /var/log/ceph/ceph-client.admin.47951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71054.log 2024-09-15T23:25:04.875 INFO:teuthology.orchestra.run.smithi123.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.84375.log.gz 2024-09-15T23:25:04.876 INFO:teuthology.orchestra.run.smithi123.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.62645.log.gz 2024-09-15T23:25:04.876 INFO:teuthology.orchestra.run.smithi123.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47951.log.gz 2024-09-15T23:25:04.876 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.70257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97608.log 2024-09-15T23:25:04.876 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.71054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78644.log 2024-09-15T23:25:04.876 INFO:teuthology.orchestra.run.smithi123.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.70257.log.gz 2024-09-15T23:25:04.876 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.97608.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.71054.log.gz 2024-09-15T23:25:04.876 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79639.log 2024-09-15T23:25:04.876 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97608.log.gz 2024-09-15T23:25:04.877 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.78644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82563.log 2024-09-15T23:25:04.877 INFO:teuthology.orchestra.run.smithi123.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.78644.log.gz 2024-09-15T23:25:04.877 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108770.log 2024-09-15T23:25:04.877 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.79639.log: /var/log/ceph/ceph-client.admin.82563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88238.log 2024-09-15T23:25:04.877 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.79639.log.gz 2024-09-15T23:25:04.877 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.82563.log.gz 2024-09-15T23:25:04.877 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.108770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109064.log 2024-09-15T23:25:04.877 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79305.log 2024-09-15T23:25:04.878 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.88238.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.108770.log.gz 2024-09-15T23:25:04.878 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.109064.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.88238.log.gz 2024-09-15T23:25:04.878 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93253.log 2024-09-15T23:25:04.878 INFO:teuthology.orchestra.run.smithi123.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.109064.log.gz 2024-09-15T23:25:04.878 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.79305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87089.log 2024-09-15T23:25:04.878 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.79305.log.gz 2024-09-15T23:25:04.878 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.93253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58643.log 2024-09-15T23:25:04.878 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43509.log 2024-09-15T23:25:04.879 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93253.log.gz 2024-09-15T23:25:04.879 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.87089.log: /var/log/ceph/ceph-client.admin.58643.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.87089.log.gz 2024-09-15T23:25:04.879 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94190.log 2024-09-15T23:25:04.879 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93763.log 2024-09-15T23:25:04.879 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43509.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.58643.log.gz 2024-09-15T23:25:04.879 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.94190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57276.log 2024-09-15T23:25:04.880 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43509.log.gz 2024-09-15T23:25:04.880 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82878.log 2024-09-15T23:25:04.880 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.93763.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.94190.log.gz 2024-09-15T23:25:04.880 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.57276.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93763.log.gz 2024-09-15T23:25:04.880 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66242.log 2024-09-15T23:25:04.880 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57342.log 2024-09-15T23:25:04.880 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.82878.log: /var/log/ceph/ceph-client.admin.66242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102049.log 2024-09-15T23:25:04.880 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.82878.log.gz 2024-09-15T23:25:04.881 INFO:teuthology.orchestra.run.smithi123.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.57276.log.gz 2024-09-15T23:25:04.881 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.66242.log.gz 2024-09-15T23:25:04.881 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.57342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61028.log 2024-09-15T23:25:04.881 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.102049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43203.log 2024-09-15T23:25:04.881 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.61028.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102049.log.gz 2024-09-15T23:25:04.881 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66588.log 90.7% -- replaced with /var/log/ceph/ceph-client.admin.57342.log.gz 2024-09-15T23:25:04.881 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61028.log.gz 2024-09-15T23:25:04.882 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-15T23:25:04.882 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99043.log 2024-09-15T23:25:04.882 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43203.log.gz 2024-09-15T23:25:04.882 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.66588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61070.log 2024-09-15T23:25:04.882 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66588.log.gz 2024-09-15T23:25:04.882 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.99043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60940.log 2024-09-15T23:25:04.882 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99043.log.gz 2024-09-15T23:25:04.882 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43077.log 2024-09-15T23:25:04.882 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.61070.log: /var/log/ceph/ceph-client.admin.60940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66775.log 2024-09-15T23:25:04.883 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61070.log.gz 2024-09-15T23:25:04.883 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43077.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60940.log.gz 2024-09-15T23:25:04.883 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44082.log 2024-09-15T23:25:04.883 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59275.log 2024-09-15T23:25:04.883 INFO:teuthology.orchestra.run.smithi123.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43077.log.gz 2024-09-15T23:25:04.883 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.66775.log: /var/log/ceph/ceph-client.admin.44082.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.66775.log.gz 2024-09-15T23:25:04.883 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61616.log 2024-09-15T23:25:04.883 INFO:teuthology.orchestra.run.smithi123.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44082.log.gz 2024-09-15T23:25:04.884 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78865.log 2024-09-15T23:25:04.884 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.59275.log: /var/log/ceph/ceph-client.admin.61616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46230.log 2024-09-15T23:25:04.884 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.78865.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61616.log.gz 2024-09-15T23:25:04.884 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43836.log 2024-09-15T23:25:04.884 INFO:teuthology.orchestra.run.smithi123.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.59275.log.gz 2024-09-15T23:25:04.884 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46230.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.78865.log.gz 2024-09-15T23:25:04.884 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62541.log 2024-09-15T23:25:04.884 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43836.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46230.log.gz 2024-09-15T23:25:04.885 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99463.log 2024-09-15T23:25:04.885 INFO:teuthology.orchestra.run.smithi123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43836.log.gz 2024-09-15T23:25:04.885 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.62541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59449.log 2024-09-15T23:25:04.885 INFO:teuthology.orchestra.run.smithi123.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62541.log.gz 2024-09-15T23:25:04.885 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.99463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54874.log 2024-09-15T23:25:04.885 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.99463.log.gz 2024-09-15T23:25:04.885 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.59449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64585.log 2024-09-15T23:25:04.886 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.54874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105010.log 2024-09-15T23:25:04.886 INFO:teuthology.orchestra.run.smithi123.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.59449.log.gz 2024-09-15T23:25:04.886 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.64585.log: -- /var/log/ceph/ceph-client.admin.105790.log 2024-09-15T23:25:04.886 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.105010.log: gzip 87.8% 90.8% -- replaced with /var/log/ceph/ceph-client.admin.64585.log.gz -- replaced with /var/log/ceph/ceph-client.admin.54874.log.gz 2024-09-15T23:25:04.886 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-15T23:25:04.886 INFO:teuthology.orchestra.run.smithi123.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.98236.log 2024-09-15T23:25:04.886 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105010.log.gz 2024-09-15T23:25:04.886 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.105790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104968.log 2024-09-15T23:25:04.887 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.98236.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105790.log.gz 2024-09-15T23:25:04.887 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65407.log 2024-09-15T23:25:04.887 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98236.log.gz 2024-09-15T23:25:04.887 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.104968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88673.log 2024-09-15T23:25:04.887 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.104968.log.gz 2024-09-15T23:25:04.887 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.65407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43846.log 2024-09-15T23:25:04.887 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94994.log 2024-09-15T23:25:04.887 INFO:teuthology.orchestra.run.smithi123.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.65407.log.gz 2024-09-15T23:25:04.888 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.88673.log: /var/log/ceph/ceph-client.admin.43846.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.88673.log.gz 2024-09-15T23:25:04.888 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93626.log 2024-09-15T23:25:04.888 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43846.log.gz 2024-09-15T23:25:04.888 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60292.log 2024-09-15T23:25:04.888 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.94994.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.94994.log.gz 2024-09-15T23:25:04.888 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.93626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83477.log 2024-09-15T23:25:04.888 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93626.log.gz 2024-09-15T23:25:04.888 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.60292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84717.log 2024-09-15T23:25:04.889 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60292.log.gz 2024-09-15T23:25:04.889 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47783.log 2024-09-15T23:25:04.889 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.83477.log: /var/log/ceph/ceph-client.0.84717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46439.log 2024-09-15T23:25:04.889 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.84717.log.gz 2024-09-15T23:25:04.889 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.83477.log.gz 2024-09-15T23:25:04.889 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.47783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47741.log 2024-09-15T23:25:04.889 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46439.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47783.log.gz 2024-09-15T23:25:04.889 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102229.log 2024-09-15T23:25:04.890 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46439.log.gz 2024-09-15T23:25:04.890 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107042.log 2024-09-15T23:25:04.890 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.47741.log: /var/log/ceph/ceph-client.admin.102229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97881.log 2024-09-15T23:25:04.890 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47741.log.gz 2024-09-15T23:25:04.890 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.107042.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.102229.log.gz 2024-09-15T23:25:04.890 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108938.log 2024-09-15T23:25:04.890 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87347.log 2024-09-15T23:25:04.890 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.97881.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.107042.log.gz 2024-09-15T23:25:04.891 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.108938.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97881.log.gz 2024-09-15T23:25:04.891 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62391.log 2024-09-15T23:25:04.891 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108938.log.gz 2024-09-15T23:25:04.891 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97448.log 2024-09-15T23:25:04.891 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.87347.log: /var/log/ceph/ceph-client.admin.62391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87197.log 2024-09-15T23:25:04.891 INFO:teuthology.orchestra.run.smithi123.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.87347.log.gz 2024-09-15T23:25:04.891 INFO:teuthology.orchestra.run.smithi123.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.62391.log.gz 2024-09-15T23:25:04.891 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.97448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87431.log 2024-09-15T23:25:04.892 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97448.log.gz 2024-09-15T23:25:04.892 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98745.log 2024-09-15T23:25:04.892 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.87197.log: /var/log/ceph/ceph-client.admin.87431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78197.log 2024-09-15T23:25:04.892 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.87431.log.gz 2024-09-15T23:25:04.892 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.98745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64022.log 2024-09-15T23:25:04.892 INFO:teuthology.orchestra.run.smithi123.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.87197.log.gz 2024-09-15T23:25:04.892 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98745.log.gz 2024-09-15T23:25:04.892 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.78197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83046.log 2024-09-15T23:25:04.893 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59209.log 2024-09-15T23:25:04.893 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.64022.log: /var/log/ceph/ceph-client.admin.83046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57755.log 2024-09-15T23:25:04.893 INFO:teuthology.orchestra.run.smithi123.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.78197.log.gz 2024-09-15T23:25:04.893 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.64022.log.gz 2024-09-15T23:25:04.893 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.83046.log.gz 2024-09-15T23:25:04.893 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.59209.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-15T23:25:04.893 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.57755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109188.log 2024-09-15T23:25:04.894 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69963.log 2024-09-15T23:25:04.894 INFO:teuthology.orchestra.run.smithi123.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.59209.log.gz 2024-09-15T23:25:04.894 INFO:teuthology.orchestra.run.smithi123.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.57755.log.gz 2024-09-15T23:25:04.894 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.109188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91960.log 2024-09-15T23:25:04.894 INFO:teuthology.orchestra.run.smithi123.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.109188.log.gz 2024-09-15T23:25:04.894 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.69963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55736.log 2024-09-15T23:25:04.894 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56771.log 2024-09-15T23:25:04.894 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.91960.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.69963.log.gz 2024-09-15T23:25:04.895 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.55736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98917.log 2024-09-15T23:25:04.895 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.91960.log.gz 2024-09-15T23:25:04.895 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55736.log.gz 2024-09-15T23:25:04.895 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.56771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89314.log 2024-09-15T23:25:04.895 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82920.log 2024-09-15T23:25:04.895 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.98917.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.56771.log.gz 2024-09-15T23:25:04.895 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.89314.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98917.log.gz 2024-09-15T23:25:04.895 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67414.log 2024-09-15T23:25:04.896 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.89314.log.gz 2024-09-15T23:25:04.896 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.82920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104287.log 2024-09-15T23:25:04.896 INFO:teuthology.orchestra.run.smithi123.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.82920.log.gz 2024-09-15T23:25:04.896 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.67414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89566.log 2024-09-15T23:25:04.896 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67414.log.gz 2024-09-15T23:25:04.896 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106540.log 2024-09-15T23:25:04.896 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.104287.log: 90.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-15T23:25:04.897 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.89566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70047.log 2024-09-15T23:25:04.897 INFO:teuthology.orchestra.run.smithi123.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.104287.log.gz 2024-09-15T23:25:04.897 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45150.log 2024-09-15T23:25:04.897 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.106540.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.89566.log.gz 2024-09-15T23:25:04.897 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.70047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60040.log 2024-09-15T23:25:04.897 INFO:teuthology.orchestra.run.smithi123.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.106540.log.gz 2024-09-15T23:25:04.897 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.45150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69921.log 2024-09-15T23:25:04.897 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.70047.log.gz 2024-09-15T23:25:04.898 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45150.log.gz 2024-09-15T23:25:04.898 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.60040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63345.log 2024-09-15T23:25:04.898 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60040.log.gz 2024-09-15T23:25:04.898 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.69921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57672.log 2024-09-15T23:25:04.898 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- 88.5% /var/log/ceph/ceph-client.admin.83767.log 2024-09-15T23:25:04.898 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69921.log.gz 2024-09-15T23:25:04.898 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.63345.log: /var/log/ceph/ceph-client.admin.57672.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63345.log.gz 2024-09-15T23:25:04.899 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103135.log 2024-09-15T23:25:04.899 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61980.log 2024-09-15T23:25:04.899 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.83767.log: /var/log/ceph/ceph-client.admin.103135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64459.log 2024-09-15T23:25:04.899 INFO:teuthology.orchestra.run.smithi123.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.57672.log.gz 2024-09-15T23:25:04.899 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.83767.log.gz 2024-09-15T23:25:04.899 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103135.log.gz 2024-09-15T23:25:04.899 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.61980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55694.log 2024-09-15T23:25:04.900 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.64459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61196.log 2024-09-15T23:25:04.900 INFO:teuthology.orchestra.run.smithi123.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.61980.log.gz 2024-09-15T23:25:04.900 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.64459.log.gz 2024-09-15T23:25:04.900 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.55694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44182.log 2024-09-15T23:25:04.900 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.61196.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55694.log.gz 2024-09-15T23:25:04.900 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56291.log 2024-09-15T23:25:04.900 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61196.log.gz 2024-09-15T23:25:04.901 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59728.log 2024-09-15T23:25:04.901 INFO:teuthology.orchestra.run.smithi123.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44182.log.gz 2024-09-15T23:25:04.901 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.56291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59854.log 2024-09-15T23:25:04.901 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99211.log 2024-09-15T23:25:04.901 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.59728.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56291.log.gz 2024-09-15T23:25:04.901 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.59854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102355.log 89.5% 2024-09-15T23:25:04.901 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59728.log.gz 2024-09-15T23:25:04.901 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.99801.log 2024-09-15T23:25:04.902 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59854.log.gz 2024-09-15T23:25:04.902 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.99211.log: /var/log/ceph/ceph-client.admin.102355.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.99211.log.gz 2024-09-15T23:25:04.902 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93001.log 2024-09-15T23:25:04.902 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46997.log 2024-09-15T23:25:04.902 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.99801.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102355.log.gz 2024-09-15T23:25:04.902 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.99801.log.gz 2024-09-15T23:25:04.902 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.93001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93668.log 2024-09-15T23:25:04.902 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8%/var/log/ceph/ceph-client.admin.46997.log: -- replaced with /var/log/ceph/ceph-client.admin.93001.log.gz 2024-09-15T23:25:04.903 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79975.log 2024-09-15T23:25:04.903 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46997.log.gz 2024-09-15T23:25:04.903 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.93668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57474.log 2024-09-15T23:25:04.903 INFO:teuthology.orchestra.run.smithi123.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.93668.log.gz 2024-09-15T23:25:04.903 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.79975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46916.log 2024-09-15T23:25:04.903 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.57474.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.79975.log.gz 2024-09-15T23:25:04.903 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62106.log 2024-09-15T23:25:04.903 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108392.log 2024-09-15T23:25:04.904 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46916.log.gz 2024-09-15T23:25:04.904 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.62106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106606.log 2024-09-15T23:25:04.904 INFO:teuthology.orchestra.run.smithi123.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.57474.log.gz 2024-09-15T23:25:04.904 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.108392.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62106.log.gz 2024-09-15T23:25:04.904 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108560.log 2024-09-15T23:25:04.904 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83811.log 2024-09-15T23:25:04.904 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.106606.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.108392.log.gz 2024-09-15T23:25:04.904 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.108560.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.106606.log.gz 2024-09-15T23:25:04.905 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67160.log 2024-09-15T23:25:04.905 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66504.log 2024-09-15T23:25:04.905 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.108560.log.gz 2024-09-15T23:25:04.905 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.83811.log: /var/log/ceph/ceph-client.admin.67160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98446.log 2024-09-15T23:25:04.905 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.83811.log.gz 2024-09-15T23:25:04.905 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60250.log 2024-09-15T23:25:04.905 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.66504.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.67160.log.gz 2024-09-15T23:25:04.905 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.98446.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.66504.log.gz 2024-09-15T23:25:04.906 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92644.log 2024-09-15T23:25:04.906 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98446.log.gz 2024-09-15T23:25:04.906 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.60250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87544.log 2024-09-15T23:25:04.906 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60250.log.gz 2024-09-15T23:25:04.906 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.92644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79210.log 2024-09-15T23:25:04.906 INFO:teuthology.orchestra.run.smithi123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92644.log.gzgzip 2024-09-15T23:25:04.906 INFO:teuthology.orchestra.run.smithi123.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.64291.log 2024-09-15T23:25:04.906 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.87544.log: /var/log/ceph/ceph-client.admin.79210.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.87544.log.gz 2024-09-15T23:25:04.907 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103422.log 2024-09-15T23:25:04.907 INFO:teuthology.orchestra.run.smithi123.stderr:gzip 87.8% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.79210.log.gz -- 2024-09-15T23:25:04.907 INFO:teuthology.orchestra.run.smithi123.stderr: /var/log/ceph/ceph-client.admin.64066.log 2024-09-15T23:25:04.907 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.64291.log: /var/log/ceph/ceph-client.admin.103422.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64291.log.gz 2024-09-15T23:25:04.907 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104545.log 2024-09-15T23:25:04.907 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102626.log 2024-09-15T23:25:04.907 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103422.log.gz 2024-09-15T23:25:04.907 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.64066.log: /var/log/ceph/ceph-client.admin.104545.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64066.log.gz 2024-09-15T23:25:04.908 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42598.log 2024-09-15T23:25:04.908 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58412.log 2024-09-15T23:25:04.908 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.102626.log: /var/log/ceph/ceph-client.admin.42598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92254.log 2024-09-15T23:25:04.908 INFO:teuthology.orchestra.run.smithi123.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.104545.log.gz 2024-09-15T23:25:04.908 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102626.log.gz 2024-09-15T23:25:04.908 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.58412.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42598.log.gzgzip 2024-09-15T23:25:04.908 INFO:teuthology.orchestra.run.smithi123.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.79126.log 2024-09-15T23:25:04.908 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67456.log 2024-09-15T23:25:04.909 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.92254.log: /var/log/ceph/ceph-client.admin.79126.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.58412.log.gz 2024-09-15T23:25:04.909 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57408.log 2024-09-15T23:25:04.909 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.79126.log.gz/var/log/ceph/ceph-client.admin.67456.log: 2024-09-15T23:25:04.909 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47867.log 2024-09-15T23:25:04.909 INFO:teuthology.orchestra.run.smithi123.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.92254.log.gz 2024-09-15T23:25:04.909 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.67456.log.gz 2024-09-15T23:25:04.909 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.57408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48331.log 2024-09-15T23:25:04.909 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.47867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43845.log 2024-09-15T23:25:04.910 INFO:teuthology.orchestra.run.smithi123.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47867.log.gz/var/log/ceph/ceph-client.0.48331.log: 2024-09-15T23:25:04.910 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103464.log 2024-09-15T23:25:04.910 INFO:teuthology.orchestra.run.smithi123.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.57408.log.gz 2024-09-15T23:25:04.910 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48331.log.gz 2024-09-15T23:25:04.910 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56035.log 2024-09-15T23:25:04.910 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43845.log.gz 2024-09-15T23:25:04.910 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.103464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47262.log 2024-09-15T23:25:04.910 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.103464.log.gz 2024-09-15T23:25:04.911 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5/var/log/ceph/ceph-client.admin.56035.log: --verbose -- /var/log/ceph/ceph-client.admin.109146.log 2024-09-15T23:25:04.911 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.47262.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56035.log.gz 2024-09-15T23:25:04.911 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67582.log 2024-09-15T23:25:04.911 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57984.log 2024-09-15T23:25:04.911 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.109146.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47262.log.gz 2024-09-15T23:25:04.911 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.67582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54724.log 2024-09-15T23:25:04.911 INFO:teuthology.orchestra.run.smithi123.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.109146.log.gz 2024-09-15T23:25:04.911 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 88.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.67582.log.gz 2024-09-15T23:25:04.912 INFO:teuthology.orchestra.run.smithi123.stderr: /var/log/ceph/ceph-client.admin.102542.log 2024-09-15T23:25:04.912 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.57984.log: /var/log/ceph/ceph-client.admin.54724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68739.log 2024-09-15T23:25:04.912 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57984.log.gz 2024-09-15T23:25:04.912 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63639.log 2024-09-15T23:25:04.912 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.102542.log: /var/log/ceph/ceph-client.admin.68739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103716.log 2024-09-15T23:25:04.912 INFO:teuthology.orchestra.run.smithi123.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.54724.log.gz 2024-09-15T23:25:04.912 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.102542.log.gz 2024-09-15T23:25:04.912 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.63639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44421.log 2024-09-15T23:25:04.913 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68739.log.gz 2024-09-15T23:25:04.913 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.103716.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.63639.log.gz 2024-09-15T23:25:04.913 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107845.log 2024-09-15T23:25:04.913 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109022.log 2024-09-15T23:25:04.913 INFO:teuthology.orchestra.run.smithi123.stderr: 89.3%/var/log/ceph/ceph-client.admin.44421.log: -- replaced with /var/log/ceph/ceph-client.admin.103716.log.gz 2024-09-15T23:25:04.913 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.107845.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44421.log.gz 2024-09-15T23:25:04.913 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45897.log 2024-09-15T23:25:04.913 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64161.log 2024-09-15T23:25:04.914 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.109022.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.107845.log.gz 2024-09-15T23:25:04.914 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79723.log 2024-09-15T23:25:04.914 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.109022.log.gz 2024-09-15T23:25:04.914 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96810.log 2024-09-15T23:25:04.914 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.64161.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45897.log.gz 2024-09-15T23:25:04.914 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.79723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70840.log 2024-09-15T23:25:04.914 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.64161.log.gz 2024-09-15T23:25:04.914 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67708.log 2024-09-15T23:25:04.914 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.96810.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.79723.log.gz 2024-09-15T23:25:04.915 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.70840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106101.log 2024-09-15T23:25:04.915 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.67708.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.96810.log.gz 2024-09-15T23:25:04.915 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.70840.log.gz 2024-09-15T23:25:04.915 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86751.log 2024-09-15T23:25:04.915 INFO:teuthology.orchestra.run.smithi123.stderr:gzip/var/log/ceph/ceph-client.admin.106101.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.78281.log 2024-09-15T23:25:04.915 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67708.log.gz 2024-09-15T23:25:04.915 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96876.log 2024-09-15T23:25:04.916 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.86751.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.106101.log.gz 2024-09-15T23:25:04.916 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.78281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89188.log 2024-09-15T23:25:04.916 INFO:teuthology.orchestra.run.smithi123.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.86751.log.gz 2024-09-15T23:25:04.916 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59980.log 2024-09-15T23:25:04.916 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.96876.log: /var/log/ceph/ceph-client.admin.89188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46649.log 2024-09-15T23:25:04.916 INFO:teuthology.orchestra.run.smithi123.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.78281.log.gz 2024-09-15T23:25:04.916 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8%/var/log/ceph/ceph-client.admin.59980.log: -- replaced with /var/log/ceph/ceph-client.admin.89188.log.gz 90.7% -- replaced with /var/log/ceph/ceph-client.admin.96876.log.gz 2024-09-15T23:25:04.916 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84417.log 2024-09-15T23:25:04.917 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-15T23:25:04.917 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67624.log 2024-09-15T23:25:04.917 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59980.log.gz 2024-09-15T23:25:04.917 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46649.log: /var/log/ceph/ceph-client.admin.84417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105929.log 2024-09-15T23:25:04.917 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46649.log.gz 2024-09-15T23:25:04.917 INFO:teuthology.orchestra.run.smithi123.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.84417.log.gz 2024-09-15T23:25:04.917 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.67624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102794.log 2024-09-15T23:25:04.917 INFO:teuthology.orchestra.run.smithi123.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.67624.log.gz 2024-09-15T23:25:04.917 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.105929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79385.log 2024-09-15T23:25:04.918 INFO:teuthology.orchestra.run.smithi123.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.105929.log.gz 2024-09-15T23:25:04.918 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.102794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56645.log 2024-09-15T23:25:04.918 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102794.log.gz 2024-09-15T23:25:04.918 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.79385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88963.log 2024-09-15T23:25:04.918 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.56645.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.79385.log.gz 2024-09-15T23:25:04.918 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87305.log 2024-09-15T23:25:04.918 INFO:teuthology.orchestra.run.smithi123.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56645.log.gz 2024-09-15T23:25:04.918 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.88963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55213.log 2024-09-15T23:25:04.919 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.87305.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.88963.log.gz 2024-09-15T23:25:04.919 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46565.log 2024-09-15T23:25:04.919 INFO:teuthology.orchestra.run.smithi123.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.87305.log.gz 2024-09-15T23:25:04.919 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.55213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92002.log 2024-09-15T23:25:04.919 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55213.log.gz 2024-09-15T23:25:04.919 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47040.log 2024-09-15T23:25:04.919 INFO:teuthology.orchestra.run.smithi123.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46565.log.gz 2024-09-15T23:25:04.920 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.92002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80143.log 2024-09-15T23:25:04.920 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose 88.1% -- /var/log/ceph/ceph-client.admin.104926.log -- replaced with /var/log/ceph/ceph-client.admin.92002.log.gz 2024-09-15T23:25:04.920 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-15T23:25:04.920 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.47040.log: /var/log/ceph/ceph-client.admin.80143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101931.log 2024-09-15T23:25:04.920 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47040.log.gz 2024-09-15T23:25:04.920 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103274.log 2024-09-15T23:25:04.920 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.80143.log.gz 2024-09-15T23:25:04.920 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.104926.log: /var/log/ceph/ceph-client.admin.101931.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.104926.log.gz 2024-09-15T23:25:04.921 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55831.log 2024-09-15T23:25:04.921 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62433.log 2024-09-15T23:25:04.921 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.103274.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.101931.log.gz 2024-09-15T23:25:04.921 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.55831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61238.log 2024-09-15T23:25:04.921 INFO:teuthology.orchestra.run.smithi123.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.103274.log.gz 2024-09-15T23:25:04.921 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.62433.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55831.log.gz 2024-09-15T23:25:04.921 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89104.log 2024-09-15T23:25:04.922 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.61238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86879.log 2024-09-15T23:25:04.922 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61238.log.gz 2024-09-15T23:25:04.922 INFO:teuthology.orchestra.run.smithi123.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.62433.log.gz 2024-09-15T23:25:04.922 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.89104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55171.log 2024-09-15T23:25:04.922 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.86879.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.89104.log.gz 2024-09-15T23:25:04.922 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105544.log 2024-09-15T23:25:04.922 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.86879.log.gz 2024-09-15T23:25:04.922 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.55171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107164.log 2024-09-15T23:25:04.923 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42686.log 2024-09-15T23:25:04.923 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.105544.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55171.log.gz 2024-09-15T23:25:04.923 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.107164.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105544.log.gz 2024-09-15T23:25:04.923 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63032.log 2024-09-15T23:25:04.923 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44178.log 2024-09-15T23:25:04.923 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42686.log: /var/log/ceph/ceph-client.admin.63032.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.107164.log.gz 2024-09-15T23:25:04.923 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96942.log 2024-09-15T23:25:04.923 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42686.log.gz 2024-09-15T23:25:04.924 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44178.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.63032.log.gz 2024-09-15T23:25:04.924 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107098.log 2024-09-15T23:25:04.924 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44178.log.gz 2024-09-15T23:25:04.924 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.96942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67894.log 2024-09-15T23:25:04.924 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86963.log 2024-09-15T23:25:04.924 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.107098.log: /var/log/ceph/ceph-client.admin.67894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82389.log 2024-09-15T23:25:04.924 INFO:teuthology.orchestra.run.smithi123.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.96942.log.gz 2024-09-15T23:25:04.925 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.86963.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.67894.log.gz -5 2024-09-15T23:25:04.925 INFO:teuthology.orchestra.run.smithi123.stderr: --verbose -- /var/log/ceph/ceph-client.admin.59770.log 2024-09-15T23:25:04.925 INFO:teuthology.orchestra.run.smithi123.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.107098.log.gz 2024-09-15T23:25:04.925 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.82389.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.86963.log.gz 2024-09-15T23:25:04.925 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47993.log 2024-09-15T23:25:04.925 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.59770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97923.log 2024-09-15T23:25:04.925 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.47993.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59770.log.gz 2024-09-15T23:25:04.925 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99253.log 2024-09-15T23:25:04.926 INFO:teuthology.orchestra.run.smithi123.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.82389.log.gz 2024-09-15T23:25:04.926 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64819.log 2024-09-15T23:25:04.926 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.97923.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47993.log.gz 2024-09-15T23:25:04.926 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.99253.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.97923.log.gz 2024-09-15T23:25:04.926 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86709.log 2024-09-15T23:25:04.926 INFO:teuthology.orchestra.run.smithi123.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.99253.log.gz 2024-09-15T23:25:04.926 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.64819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86625.log 2024-09-15T23:25:04.926 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.86709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56333.log 2024-09-15T23:25:04.927 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64819.log.gz 2024-09-15T23:25:04.927 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.86625.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.86709.log.gz 2024-09-15T23:25:04.927 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55297.log 2024-09-15T23:25:04.927 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.86625.log.gz 2024-09-15T23:25:04.927 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.56333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88196.log 2024-09-15T23:25:04.927 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47527.log 2024-09-15T23:25:04.927 INFO:teuthology.orchestra.run.smithi123.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.56333.log.gz 2024-09-15T23:25:04.928 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.55297.log: /var/log/ceph/ceph-client.admin.88196.log: gzip 89.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.55297.log.gz 2024-09-15T23:25:04.928 INFO:teuthology.orchestra.run.smithi123.stderr: --verbose -- /var/log/ceph/ceph-client.admin.91768.log 2024-09-15T23:25:04.928 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.88196.log.gz 2024-09-15T23:25:04.928 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88877.log 2024-09-15T23:25:04.928 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.47527.log: /var/log/ceph/ceph-client.admin.91768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105878.log 2024-09-15T23:25:04.928 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47527.log.gz 2024-09-15T23:25:04.928 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.88877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67498.log 2024-09-15T23:25:04.928 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.88877.log.gz 2024-09-15T23:25:04.929 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.105878.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.91768.log.gz 2024-09-15T23:25:04.929 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-15T23:25:04.929 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61534.log 2024-09-15T23:25:04.929 INFO:teuthology.orchestra.run.smithi123.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.105878.log.gz 2024-09-15T23:25:04.929 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.67498.log: /var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107593.log 2024-09-15T23:25:04.929 INFO:teuthology.orchestra.run.smithi123.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.67498.log.gz 2024-09-15T23:25:04.929 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.61534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88112.log 2024-09-15T23:25:04.929 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.61534.log.gz 2024-09-15T23:25:04.930 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.107593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64501.log 2024-09-15T23:25:04.930 INFO:teuthology.orchestra.run.smithi123.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.107593.log.gz 2024-09-15T23:25:04.930 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.88112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102397.log 2024-09-15T23:25:04.930 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.64501.log: gzip -5 88.4% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.88112.log.gz /var/log/ceph/ceph-client.0.80528.log 2024-09-15T23:25:04.930 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-15T23:25:04.930 INFO:teuthology.orchestra.run.smithi123.stderr: 87.8%/var/log/ceph/ceph-client.admin.102397.log: -- replaced with /var/log/ceph/ceph-client.admin.64501.log.gz 2024-09-15T23:25:04.930 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105449.log 2024-09-15T23:25:04.931 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.80528.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102397.log.gz 2024-09-15T23:25:04.931 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61776.log 2024-09-15T23:25:04.931 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.80528.log.gz 2024-09-15T23:25:04.931 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.105449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46523.log 2024-09-15T23:25:04.931 INFO:teuthology.orchestra.run.smithi123.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.105449.log.gz 2024-09-15T23:25:04.931 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.61776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86427.log 2024-09-15T23:25:04.931 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61776.log.gz 2024-09-15T23:25:04.931 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94572.log 2024-09-15T23:25:04.932 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.86427.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46523.log.gz 2024-09-15T23:25:04.932 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89716.log 2024-09-15T23:25:04.932 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.94572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108434.log 2024-09-15T23:25:04.932 INFO:teuthology.orchestra.run.smithi123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.94572.log.gz 2024-09-15T23:25:04.932 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.89716.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.86427.log.gz 2024-09-15T23:25:04.932 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97134.log 2024-09-15T23:25:04.932 INFO:teuthology.orchestra.run.smithi123.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.89716.log.gz 2024-09-15T23:25:04.933 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.108434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46751.log 2024-09-15T23:25:04.933 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.97134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78812.log 2024-09-15T23:25:04.933 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.108434.log.gz 2024-09-15T23:25:04.933 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97134.log.gz 2024-09-15T23:25:04.933 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44180.log 2024-09-15T23:25:04.933 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94614.log 2024-09-15T23:25:04.933 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.78812.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46751.log.gz 2024-09-15T23:25:04.933 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79933.log 2024-09-15T23:25:04.934 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.78812.log.gz 2024-09-15T23:25:04.934 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.94614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66011.log 88.8% 2024-09-15T23:25:04.934 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44180.log.gz 2024-09-15T23:25:04.934 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94614.log.gz 2024-09-15T23:25:04.934 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60856.log 2024-09-15T23:25:04.934 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.79933.log: gzip/var/log/ceph/ceph-client.0.66011.log: -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.0.66011.log.gz 2024-09-15T23:25:04.934 INFO:teuthology.orchestra.run.smithi123.stderr: /var/log/ceph/ceph-client.admin.84333.log 88.1% -- replaced with /var/log/ceph/ceph-client.admin.79933.log.gz 2024-09-15T23:25:04.934 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-15T23:25:04.935 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.60856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103179.log 2024-09-15T23:25:04.935 INFO:teuthology.orchestra.run.smithi123.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.60856.log.gz 2024-09-15T23:25:04.935 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.84333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64669.log 2024-09-15T23:25:04.935 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.103179.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.84333.log.gz 2024-09-15T23:25:04.935 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64245.log 2024-09-15T23:25:04.935 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.103179.log.gz 2024-09-15T23:25:04.935 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.64669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59896.log 2024-09-15T23:25:04.936 INFO:teuthology.orchestra.run.smithi123.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.64669.log.gz 2024-09-15T23:25:04.936 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.64245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87491.log 2024-09-15T23:25:04.936 INFO:teuthology.orchestra.run.smithi123.stderr: 87.6%/var/log/ceph/ceph-client.admin.59896.log: -- replaced with /var/log/ceph/ceph-client.admin.64245.log.gz 2024-09-15T23:25:04.936 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79509.log 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59896.log.gz 2024-09-15T23:25:04.936 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-15T23:25:04.936 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.87491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108644.log 2024-09-15T23:25:04.936 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.79509.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.87491.log.gz 2024-09-15T23:25:04.936 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79168.log 2024-09-15T23:25:04.937 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.108644.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.79509.log.gz 2024-09-15T23:25:04.937 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107499.log 2024-09-15T23:25:04.937 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108644.log.gz 2024-09-15T23:25:04.937 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.79168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43161.log 2024-09-15T23:25:04.937 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94656.log 2024-09-15T23:25:04.937 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.107499.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.79168.log.gz 2024-09-15T23:25:04.937 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87263.log 2024-09-15T23:25:04.937 INFO:teuthology.orchestra.run.smithi123.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.107499.log.gz 2024-09-15T23:25:04.938 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.94656.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43161.log.gz 2024-09-15T23:25:04.938 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66901.log 2024-09-15T23:25:04.938 INFO:teuthology.orchestra.run.smithi123.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.94656.log.gz 2024-09-15T23:25:04.938 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94053.log 2024-09-15T23:25:04.938 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.87263.log: gzip/var/log/ceph/ceph-client.admin.66901.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.48143.log 2024-09-15T23:25:04.938 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6%/var/log/ceph/ceph-client.admin.94053.log: -- replaced with /var/log/ceph/ceph-client.admin.87263.log.gz 2024-09-15T23:25:04.938 INFO:teuthology.orchestra.run.smithi123.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.66901.log.gz 2024-09-15T23:25:04.939 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47657.log 2024-09-15T23:25:04.939 INFO:teuthology.orchestra.run.smithi123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.94053.log.gz 2024-09-15T23:25:04.939 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.48143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89230.log 2024-09-15T23:25:04.939 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.47657.log: gzip 88.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.48143.log.gz --verbose 2024-09-15T23:25:04.939 INFO:teuthology.orchestra.run.smithi123.stderr: -- /var/log/ceph/ceph-client.admin.63938.log 2024-09-15T23:25:04.939 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47657.log.gz 2024-09-15T23:25:04.939 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.89230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45939.log 2024-09-15T23:25:04.939 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48077.log 2024-09-15T23:25:04.940 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.63938.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.89230.log.gz 2024-09-15T23:25:04.940 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47434.log 2024-09-15T23:25:04.940 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.63938.log.gz 2024-09-15T23:25:04.940 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45939.log.gz 2024-09-15T23:25:04.940 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69818.log 2024-09-15T23:25:04.940 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.48077.log: /var/log/ceph/ceph-client.admin.47434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65011.log 2024-09-15T23:25:04.940 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.69818.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47434.log.gz 2024-09-15T23:25:04.940 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- 91.2% -- replaced with /var/log/ceph/ceph-client.admin.48077.log.gz 2024-09-15T23:25:04.941 INFO:teuthology.orchestra.run.smithi123.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.69818.log.gz 2024-09-15T23:25:04.941 INFO:teuthology.orchestra.run.smithi123.stderr: /var/log/ceph/ceph-client.admin.83382.log 2024-09-15T23:25:04.941 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.65011.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.65011.log.gz 2024-09-15T23:25:04.941 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56121.log 2024-09-15T23:25:04.941 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.83382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62906.log 2024-09-15T23:25:04.941 INFO:teuthology.orchestra.run.smithi123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.83382.log.gz 2024-09-15T23:25:04.941 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.56121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64753.log 2024-09-15T23:25:04.941 INFO:teuthology.orchestra.run.smithi123.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.56121.log.gz 2024-09-15T23:25:04.942 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.62906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98362.log 2024-09-15T23:25:04.942 INFO:teuthology.orchestra.run.smithi123.stderr:gzip/var/log/ceph/ceph-client.admin.64753.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.70617.log 2024-09-15T23:25:04.942 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.62906.log.gz 2024-09-15T23:25:04.942 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.98362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61903.log 2024-09-15T23:25:04.942 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98362.log.gz/var/log/ceph/ceph-client.admin.70617.log: 2024-09-15T23:25:04.942 INFO:teuthology.orchestra.run.smithi123.stderr:gzip 90.9% -- replaced with /var/log/ceph/ceph-client.admin.64753.log.gz 2024-09-15T23:25:04.942 INFO:teuthology.orchestra.run.smithi123.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.105365.log 2024-09-15T23:25:04.943 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.70617.log.gz 2024-09-15T23:25:04.943 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.61903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69776.log 2024-09-15T23:25:04.943 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61903.log.gz 2024-09-15T23:25:04.943 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.105365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79681.log 2024-09-15T23:25:04.943 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.69776.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.105365.log.gz 2024-09-15T23:25:04.943 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78347.log 2024-09-15T23:25:04.943 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.69776.log.gz 2024-09-15T23:25:04.943 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.79681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105052.log 2024-09-15T23:25:04.943 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.78347.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.79681.log.gz 2024-09-15T23:25:04.944 INFO:teuthology.orchestra.run.smithi123.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.58346.log 2024-09-15T23:25:04.944 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.105052.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.78347.log.gz 2024-09-15T23:25:04.944 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106414.log 2024-09-15T23:25:04.944 INFO:teuthology.orchestra.run.smithi123.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.105052.log.gz 2024-09-15T23:25:04.944 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55339.log 2024-09-15T23:25:04.944 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.58346.log: /var/log/ceph/ceph-client.admin.106414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98278.log 2024-09-15T23:25:04.944 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.55339.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106414.log.gz 2024-09-15T23:25:04.944 INFO:teuthology.orchestra.run.smithi123.stderr: 91.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101575.log 2024-09-15T23:25:04.945 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58346.log.gz 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55339.log.gz 2024-09-15T23:25:04.945 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-15T23:25:04.945 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69692.log 2024-09-15T23:25:04.945 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.98278.log: /var/log/ceph/ceph-client.admin.101575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106999.log 2024-09-15T23:25:04.945 INFO:teuthology.orchestra.run.smithi123.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.98278.log.gz 2024-09-15T23:25:04.945 INFO:teuthology.orchestra.run.smithi123.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.101575.log.gz 2024-09-15T23:25:04.945 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.69692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93169.log 2024-09-15T23:25:04.945 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.106999.log: gzip -5 --verbose -- 89.3% /var/log/ceph/ceph-client.admin.47699.log -- replaced with /var/log/ceph/ceph-client.admin.69692.log.gz 2024-09-15T23:25:04.945 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-15T23:25:04.946 INFO:teuthology.orchestra.run.smithi123.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.106999.log.gz 2024-09-15T23:25:04.946 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.93169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89482.log 2024-09-15T23:25:04.946 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.47699.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.93169.log.gz 2024-09-15T23:25:04.946 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57606.log 2024-09-15T23:25:04.946 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2%/var/log/ceph/ceph-client.admin.89482.log: gzip -- replaced with /var/log/ceph/ceph-client.admin.47699.log.gz 2024-09-15T23:25:04.946 INFO:teuthology.orchestra.run.smithi123.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.68128.log 2024-09-15T23:25:04.946 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.57606.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.89482.log.gz 2024-09-15T23:25:04.946 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71432.log 2024-09-15T23:25:04.947 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.68128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103093.log 2024-09-15T23:25:04.947 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.68128.log.gz 2024-09-15T23:25:04.947 INFO:teuthology.orchestra.run.smithi123.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.57606.log.gz 2024-09-15T23:25:04.947 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93542.log 2024-09-15T23:25:04.947 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.71432.log: /var/log/ceph/ceph-client.admin.103093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.104139.log 2024-09-15T23:25:04.947 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.103093.log.gz 2024-09-15T23:25:04.947 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.93542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105706.log 2024-09-15T23:25:04.947 INFO:teuthology.orchestra.run.smithi123.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.71432.log.gz 2024-09-15T23:25:04.948 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103885.log 2024-09-15T23:25:04.948 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.104139.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.93542.log.gz 2024-09-15T23:25:04.948 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.104139.log.gz 2024-09-15T23:25:04.948 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.105706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55610.log 2024-09-15T23:25:04.948 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105706.log.gz 2024-09-15T23:25:04.948 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.103885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58957.log 2024-09-15T23:25:04.948 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.55610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60717.log 2024-09-15T23:25:04.948 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% 91.4% -- replaced with /var/log/ceph/ceph-client.admin.103885.log.gz 2024-09-15T23:25:04.949 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55610.log.gz 2024-09-15T23:25:04.949 INFO:teuthology.orchestra.run.smithi123.stderr:gzip/var/log/ceph/ceph-client.admin.58957.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.97050.log 2024-09-15T23:25:04.949 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.60717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55993.log 2024-09-15T23:25:04.949 INFO:teuthology.orchestra.run.smithi123.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.60717.log.gz 2024-09-15T23:25:04.949 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.97050.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.58957.log.gz 2024-09-15T23:25:04.949 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97050.log.gz 2024-09-15T23:25:04.949 INFO:teuthology.orchestra.run.smithi123.stderr: /var/log/ceph/ceph-mon.a.log 2024-09-15T23:25:04.949 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.55993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66007.log 2024-09-15T23:25:04.950 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-mon.a.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44181.log 2024-09-15T23:25:04.950 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55993.log.gz 2024-09-15T23:25:04.950 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.66007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58577.log 2024-09-15T23:25:04.950 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.66007.log.gz 2024-09-15T23:25:04.950 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60986.log 2024-09-15T23:25:04.950 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.58577.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44181.log.gz 2024-09-15T23:25:04.950 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86667.log 2024-09-15T23:25:04.950 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.60986.log: gzip -5 --verbose -- 90.8% -- replaced with /var/log/ceph/ceph-client.admin.58577.log.gz 2024-09-15T23:25:04.951 INFO:teuthology.orchestra.run.smithi123.stderr: /var/log/ceph/ceph-client.admin.61700.log 2024-09-15T23:25:04.951 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.60986.log.gz 2024-09-15T23:25:04.951 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.86667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54592.log 2024-09-15T23:25:04.951 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.86667.log.gz 2024-09-15T23:25:04.951 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62990.log 2024-09-15T23:25:04.951 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.61700.log: /var/log/ceph/ceph-client.admin.54592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43245.log 2024-09-15T23:25:04.951 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.62990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66691.log 2024-09-15T23:25:04.951 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61700.log.gz 2024-09-15T23:25:04.952 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43245.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.54592.log.gz 2024-09-15T23:25:04.952 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62990.log.gz 2024-09-15T23:25:04.952 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65172.log 2024-09-15T23:25:04.952 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43245.log.gz 2024-09-15T23:25:04.952 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105112.log 2024-09-15T23:25:04.952 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.66691.log: /var/log/ceph/ceph-client.admin.65172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69608.log 2024-09-15T23:25:04.952 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.66691.log.gz 2024-09-15T23:25:04.953 INFO:teuthology.orchestra.run.smithi123.stderr: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62303.log 2024-09-15T23:25:04.953 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65172.log.gz 2024-09-15T23:25:04.953 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.105112.log: /var/log/ceph/ceph-client.admin.69608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54658.log 2024-09-15T23:25:04.953 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.62303.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.69608.log.gz 2024-09-15T23:25:04.953 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103674.log 2024-09-15T23:25:04.953 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.105112.log.gz 2024-09-15T23:25:04.953 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.54658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94009.log 2024-09-15T23:25:04.953 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62303.log.gz 2024-09-15T23:25:04.954 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.103674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56687.log 2024-09-15T23:25:04.954 INFO:teuthology.orchestra.run.smithi123.stderr: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92470.log 2024-09-15T23:25:04.954 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.103674.log.gz 2024-09-15T23:25:04.954 INFO:teuthology.orchestra.run.smithi123.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.54658.log.gz 2024-09-15T23:25:04.954 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.94009.log: /var/log/ceph/ceph-client.admin.56687.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.94009.log.gz 2024-09-15T23:25:04.954 INFO:teuthology.orchestra.run.smithi123.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56687.log.gz 2024-09-15T23:25:04.954 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56813.log 2024-09-15T23:25:04.954 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.92470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65711.log 2024-09-15T23:25:04.955 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.56813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79000.log 2024-09-15T23:25:04.955 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.65711.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.92470.log.gz 2024-09-15T23:25:04.955 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64333.log 2024-09-15T23:25:04.955 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% 91.1% -- replaced with /var/log/ceph/ceph-client.admin.65711.log.gz 2024-09-15T23:25:04.955 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56813.log.gz 2024-09-15T23:25:04.955 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88450.log 2024-09-15T23:25:04.955 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.79000.log: /var/log/ceph/ceph-client.admin.64333.log: gzip -5 --verbose 89.1% -- /var/log/ceph/ceph-client.admin.83895.log 2024-09-15T23:25:04.955 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.79000.log.gz 2024-09-15T23:25:04.956 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.88450.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.64333.log.gz 2024-09-15T23:25:04.956 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43511.log 2024-09-15T23:25:04.956 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.83895.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.88450.log.gz 2024-09-15T23:25:04.956 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78958.log 2024-09-15T23:25:04.956 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.83895.log.gz 2024-09-15T23:25:04.956 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58040.log 2024-09-15T23:25:04.956 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43511.log.gz 2024-09-15T23:25:04.956 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.78958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55652.log 2024-09-15T23:25:04.957 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.78958.log.gz 2024-09-15T23:25:04.957 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.58040.log: /var/log/ceph/ceph-client.admin.55652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94404.log 2024-09-15T23:25:04.957 INFO:teuthology.orchestra.run.smithi123.stderr:gzip 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55652.log.gz 2024-09-15T23:25:04.957 INFO:teuthology.orchestra.run.smithi123.stderr: -5 --verbose 91.0% -- replaced with /var/log/ceph/ceph-client.admin.58040.log.gz 2024-09-15T23:25:04.957 INFO:teuthology.orchestra.run.smithi123.stderr: -- /var/log/ceph/ceph-client.admin.43035.log 2024-09-15T23:25:04.957 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.94404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36742.log 2024-09-15T23:25:04.957 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94404.log.gz 2024-09-15T23:25:04.957 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55442.log 2024-09-15T23:25:04.958 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43035.log.gz 2024-09-15T23:25:04.958 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64203.log 2024-09-15T23:25:04.958 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36742.log.gz 2024-09-15T23:25:04.958 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.55442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103632.log 2024-09-15T23:25:04.958 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55442.log.gz 2024-09-15T23:25:04.958 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.64203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88322.log 2024-09-15T23:25:04.958 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.103632.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.64203.log.gz 2024-09-15T23:25:04.958 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71306.log 2024-09-15T23:25:04.959 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.88322.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103632.log.gz 2024-09-15T23:25:04.959 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42737.log 2024-09-15T23:25:04.959 INFO:teuthology.orchestra.run.smithi123.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.88322.log.gz 2024-09-15T23:25:04.959 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.71306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105323.log 2024-09-15T23:25:04.959 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.71306.log.gz 2024-09-15T23:25:04.959 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71138.log 2024-09-15T23:25:04.959 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42737.log.gz 2024-09-15T23:25:04.959 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.105323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47220.log 2024-09-15T23:25:04.960 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105323.log.gz 2024-09-15T23:25:04.960 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.71138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44081.log 2024-09-15T23:25:04.960 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.47220.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.71138.log.gz 2024-09-15T23:25:04.960 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108350.log 2024-09-15T23:25:04.960 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47220.log.gz 2024-09-15T23:25:04.960 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67852.log 2024-09-15T23:25:04.960 INFO:teuthology.orchestra.run.smithi123.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44081.log.gz 2024-09-15T23:25:04.960 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.108350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71498.log 2024-09-15T23:25:04.961 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.67852.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.108350.log.gz 2024-09-15T23:25:04.961 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88535.log 2024-09-15T23:25:04.961 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.67852.log.gz 2024-09-15T23:25:04.961 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.71498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58512.log 2024-09-15T23:25:04.961 INFO:teuthology.orchestra.run.smithi123.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.71498.log.gz 2024-09-15T23:25:04.961 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.88535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44083.log 2024-09-15T23:25:04.961 INFO:teuthology.orchestra.run.smithi123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.88535.log.gz 2024-09-15T23:25:04.961 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.58512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.104143.log 2024-09-15T23:25:04.962 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44083.log: gzip -5 --verbose 91.0% -- replaced with /var/log/ceph/ceph-client.admin.58512.log.gz 2024-09-15T23:25:04.962 INFO:teuthology.orchestra.run.smithi123.stderr: -- /var/log/ceph/ceph-client.admin.60761.log 2024-09-15T23:25:04.962 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44083.log.gz 2024-09-15T23:25:04.962 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.104143.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.104143.log.gz 2024-09-15T23:25:04.962 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-15T23:25:04.962 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60166.log 2024-09-15T23:25:04.962 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.60761.log: /var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94488.log 2024-09-15T23:25:04.963 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60761.log.gz 2024-09-15T23:25:04.963 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.60166.log: -- /var/log/ceph/ceph-client.admin.89356.log 2024-09-15T23:25:04.963 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.94488.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60166.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71012.log 2024-09-15T23:25:04.963 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-15T23:25:04.963 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94488.log.gz 2024-09-15T23:25:04.963 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62499.log 2024-09-15T23:25:04.963 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.89356.log: /var/log/ceph/ceph-client.admin.71012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92686.log 2024-09-15T23:25:04.963 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.62499.log: 88.9% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.71012.log.gz 2024-09-15T23:25:04.964 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.89356.log.gz 2024-09-15T23:25:04.964 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57071.log 2024-09-15T23:25:04.964 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62499.log.gz 2024-09-15T23:25:04.964 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5/var/log/ceph/ceph-client.admin.92686.log: --verbose -- /var/log/ceph/ceph-client.admin.101801.log 2024-09-15T23:25:04.964 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.57071.log: 88.6% 0.0% -- replaced with /var/log/ceph/ceph-client.0.57071.log.gz 2024-09-15T23:25:04.964 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.92686.log.gz 2024-09-15T23:25:04.964 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64711.log 2024-09-15T23:25:04.965 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.101801.log: -- /var/log/ceph/ceph-client.admin.78728.log 2024-09-15T23:25:04.965 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.64711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92044.log 2024-09-15T23:25:04.965 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2%/var/log/ceph/ceph-client.admin.78728.log: -- replaced with /var/log/ceph/ceph-client.admin.64711.log.gz 91.2% -- replaced with /var/log/ceph/ceph-client.admin.101801.log.gz 2024-09-15T23:25:04.965 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-15T23:25:04.965 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69389.log 2024-09-15T23:25:04.965 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.78728.log.gz 2024-09-15T23:25:04.965 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.92044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47304.log 2024-09-15T23:25:04.965 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.69389.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.92044.log.gz 2024-09-15T23:25:04.966 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70089.log 2024-09-15T23:25:04.966 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.69389.log.gz 2024-09-15T23:25:04.966 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97965.log 2024-09-15T23:25:04.966 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.47304.log: /var/log/ceph/ceph-client.admin.70089.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47304.log.gz 2024-09-15T23:25:04.966 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70089.log.gz 2024-09-15T23:25:04.966 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36481.log 2024-09-15T23:25:04.966 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92170.log 2024-09-15T23:25:04.966 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.97965.log: /var/log/ceph/ceph-client.admin.36481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102313.log 2024-09-15T23:25:04.967 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.92170.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.97965.log.gz 2024-09-15T23:25:04.967 INFO:teuthology.orchestra.run.smithi123.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36481.log.gz 2024-09-15T23:25:04.967 INFO:teuthology.orchestra.run.smithi123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92170.log.gz 2024-09-15T23:25:04.967 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43119.log 2024-09-15T23:25:04.967 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60376.log 2024-09-15T23:25:04.967 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.102313.log: /var/log/ceph/ceph-client.admin.43119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68316.log 2024-09-15T23:25:04.967 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.102313.log.gz 2024-09-15T23:25:04.968 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9%/var/log/ceph/ceph-client.admin.60376.log: -- replaced with /var/log/ceph/ceph-client.admin.43119.log.gz 2024-09-15T23:25:04.968 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60376.log.gz 2024-09-15T23:25:04.968 INFO:teuthology.orchestra.run.smithi123.stderr: --verbose -- /var/log/ceph/ceph-client.admin.98873.log 2024-09-15T23:25:04.968 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.68316.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.68316.log.gz 2024-09-15T23:25:04.968 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97302.log 2024-09-15T23:25:04.968 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.98873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47825.log 2024-09-15T23:25:04.968 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83004.log 2024-09-15T23:25:04.968 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.97302.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.98873.log.gz 2024-09-15T23:25:04.969 INFO:teuthology.orchestra.run.smithi123.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.97302.log.gz 2024-09-15T23:25:04.969 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.47825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103590.log 2024-09-15T23:25:04.969 INFO:teuthology.orchestra.run.smithi123.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47825.log.gz 2024-09-15T23:25:04.969 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.83004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95076.log 2024-09-15T23:25:04.969 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.103590.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.83004.log.gz 2024-09-15T23:25:04.969 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46481.log 2024-09-15T23:25:04.969 INFO:teuthology.orchestra.run.smithi123.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.103590.log.gz 2024-09-15T23:25:04.970 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.95076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46152.log 2024-09-15T23:25:04.970 INFO:teuthology.orchestra.run.smithi123.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95076.log.gz 2024-09-15T23:25:04.970 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88753.log 2024-09-15T23:25:04.970 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46481.log: /var/log/ceph/ceph-client.admin.46152.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46481.log.gz 2024-09-15T23:25:04.970 INFO:teuthology.orchestra.run.smithi123.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46152.log.gz 2024-09-15T23:25:04.970 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84105.log 2024-09-15T23:25:04.970 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63303.log 2024-09-15T23:25:04.970 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.88753.log: /var/log/ceph/ceph-client.admin.84105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43287.log 2024-09-15T23:25:04.971 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.88753.log.gz 2024-09-15T23:25:04.971 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.63303.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.84105.log.gz 2024-09-15T23:25:04.971 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-15T23:25:04.971 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106059.log 2024-09-15T23:25:04.971 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63303.log.gz 2024-09-15T23:25:04.971 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-mgr.y.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43287.log.gz 2024-09-15T23:25:04.971 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97406.log 2024-09-15T23:25:04.971 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108308.log 2024-09-15T23:25:04.972 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.97406.log: /var/log/ceph/ceph-client.admin.106059.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.106059.log.gz 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97406.log.gz 2024-09-15T23:25:04.972 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-15T23:25:04.972 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87944.log 2024-09-15T23:25:04.972 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.108308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45155.log 2024-09-15T23:25:04.972 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.108308.log.gz 2024-09-15T23:25:04.972 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.87944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59040.log 2024-09-15T23:25:04.972 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.45155.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.87944.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.0.45155.log.gz 2024-09-15T23:25:04.972 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-15T23:25:04.973 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82794.log 2024-09-15T23:25:04.973 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.59040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82257.log 2024-09-15T23:25:04.973 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.82794.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.59040.log.gz 2024-09-15T23:25:04.973 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.82794.log.gz 2024-09-15T23:25:04.973 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97218.log 2024-09-15T23:25:04.973 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.82257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78916.log 2024-09-15T23:25:04.973 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.97218.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.82257.log.gz 2024-09-15T23:25:04.973 INFO:teuthology.orchestra.run.smithi123.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.97218.log.gz 2024-09-15T23:25:04.974 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98959.log 2024-09-15T23:25:04.974 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70789.log 2024-09-15T23:25:04.974 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.78916.log: /var/log/ceph/ceph-client.admin.98959.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.78916.log.gz 2024-09-15T23:25:04.974 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98959.log.gz 2024-09-15T23:25:04.974 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87986.log 2024-09-15T23:25:04.974 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82836.log 2024-09-15T23:25:04.974 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.87986.log: /var/log/ceph/ceph-client.admin.70789.log: 88.8% 89.4% -- replaced with /var/log/ceph/ceph-client.admin.87986.log.gz 2024-09-15T23:25:04.974 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70789.log.gz 2024-09-15T23:25:04.974 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104884.log 2024-09-15T23:25:04.975 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-15T23:25:04.975 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.82836.log: /var/log/ceph/ceph-client.admin.104884.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.82836.log.gz 2024-09-15T23:25:04.975 INFO:teuthology.orchestra.run.smithi123.stderr: 94.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97092.log 2024-09-15T23:25:04.975 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-15T23:25:04.975 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.104884.log.gz 2024-09-15T23:25:04.975 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph.log: 86.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-15T23:25:04.975 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71348.log 2024-09-15T23:25:04.976 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.97092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63261.log 2024-09-15T23:25:04.976 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.71348.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97092.log.gz 2024-09-15T23:25:04.976 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63387.log 2024-09-15T23:25:04.976 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.71348.log.gz 2024-09-15T23:25:04.976 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58775.log 2024-09-15T23:25:04.976 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.63261.log: /var/log/ceph/ceph-client.admin.63387.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.63261.log.gz 2024-09-15T23:25:04.976 INFO:teuthology.orchestra.run.smithi123.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.63387.log.gz 2024-09-15T23:25:04.976 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103548.log 2024-09-15T23:25:04.977 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.58775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98787.log 2024-09-15T23:25:04.977 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.103548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43502.log 2024-09-15T23:25:04.977 INFO:teuthology.orchestra.run.smithi123.stderr: 87.4% 91.1% -- replaced with /var/log/ceph/ceph-client.admin.58775.log.gz 2024-09-15T23:25:04.977 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.103548.log.gz 2024-09-15T23:25:04.977 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.98787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83088.log 2024-09-15T23:25:04.977 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98787.log.gz 2024-09-15T23:25:04.977 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61280.log 2024-09-15T23:25:04.978 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43502.log.gz 2024-09-15T23:25:04.978 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.83088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83298.log 2024-09-15T23:25:04.978 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.83088.log.gz 2024-09-15T23:25:04.978 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99001.log 2024-09-15T23:25:04.978 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.61280.log: /var/log/ceph/ceph-client.admin.83298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103801.log 2024-09-15T23:25:04.978 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.99001.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.83298.log.gz 2024-09-15T23:25:04.978 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99001.log.gz 2024-09-15T23:25:04.978 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80059.log 2024-09-15T23:25:04.979 INFO:teuthology.orchestra.run.smithi123.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.61280.log.gz 2024-09-15T23:25:04.979 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.103801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42414.log 2024-09-15T23:25:04.979 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.80059.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103801.log.gz 2024-09-15T23:25:04.979 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83937.log 2024-09-15T23:25:04.979 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.80059.log.gz 2024-09-15T23:25:04.979 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93356.log 2024-09-15T23:25:04.979 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42414.log: /var/log/ceph/ceph-client.admin.83937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44183.log 2024-09-15T23:25:04.979 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.93356.log: 88.9% 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42414.log.gz 2024-09-15T23:25:04.980 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.83937.log.gz 2024-09-15T23:25:04.980 INFO:teuthology.orchestra.run.smithi123.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.93356.log.gz 2024-09-15T23:25:04.980 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79595.log 2024-09-15T23:25:04.980 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.44183.log: -- /var/log/ceph/ceph-client.admin.80101.log 2024-09-15T23:25:04.980 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.79595.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44183.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104329.log 2024-09-15T23:25:04.980 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-15T23:25:04.980 INFO:teuthology.orchestra.run.smithi123.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.79595.log.gz 2024-09-15T23:25:04.980 INFO:teuthology.orchestra.run.smithi123.stderr:gzip/var/log/ceph/ceph-client.admin.80101.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.55255.log 2024-09-15T23:25:04.981 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.104329.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.80101.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.89904.log 2024-09-15T23:25:04.981 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-15T23:25:04.981 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42318.log 2024-09-15T23:25:04.981 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.55255.log: /var/log/ceph/ceph-client.0.89904.log: 90.7% 0.0% -- replaced with /var/log/ceph/ceph-client.0.89904.log.gz 2024-09-15T23:25:04.981 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.104329.log.gz 2024-09-15T23:25:04.981 INFO:teuthology.orchestra.run.smithi123.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55255.log.gz 2024-09-15T23:25:04.981 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62345.log 2024-09-15T23:25:04.981 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70928.log 2024-09-15T23:25:04.982 INFO:teuthology.orchestra.run.smithi123.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42318.log.gz/var/log/ceph/ceph-client.admin.62345.log: 2024-09-15T23:25:04.982 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71264.log 2024-09-15T23:25:04.982 INFO:teuthology.orchestra.run.smithi123.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.62345.log.gz 2024-09-15T23:25:04.982 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60208.log 2024-09-15T23:25:04.982 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.70928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98049.log 2024-09-15T23:25:04.982 INFO:teuthology.orchestra.run.smithi123.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.70928.log.gz 2024-09-15T23:25:04.982 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.71264.log: gzip/var/log/ceph/ceph-client.admin.60208.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.66420.log 2024-09-15T23:25:04.983 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.98049.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.60208.log.gz 2024-09-15T23:25:04.983 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.71264.log.gz 2024-09-15T23:25:04.983 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48413.log 2024-09-15T23:25:04.983 INFO:teuthology.orchestra.run.smithi123.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.98049.log.gz 2024-09-15T23:25:04.983 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.66420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107719.log 2024-09-15T23:25:04.983 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.66420.log.gz 2024-09-15T23:25:04.983 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102455.log 2024-09-15T23:25:04.983 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.48413.log: /var/log/ceph/ceph-client.admin.107719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80270.log 2024-09-15T23:25:04.984 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.102455.log: 88.5% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.107719.log.gz 2024-09-15T23:25:04.984 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48413.log.gz 2024-09-15T23:25:04.984 INFO:teuthology.orchestra.run.smithi123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.102455.log.gz 2024-09-15T23:25:04.984 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99127.log 2024-09-15T23:25:04.984 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.80270.log: -- /var/log/ceph/ceph-client.admin.102752.log 2024-09-15T23:25:04.984 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.99127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44673.log 2024-09-15T23:25:04.984 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99127.log.gz 2024-09-15T23:25:04.985 INFO:teuthology.orchestra.run.smithi123.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.80270.log.gz 2024-09-15T23:25:04.985 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.102752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98147.log 2024-09-15T23:25:04.985 INFO:teuthology.orchestra.run.smithi123.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.102752.log.gz/var/log/ceph/ceph-client.admin.44673.log: 2024-09-15T23:25:04.985 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59515.log 2024-09-15T23:25:04.985 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97364.log 2024-09-15T23:25:04.985 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.59515.log: 91.2%/var/log/ceph/ceph-client.admin.98147.log: -- replaced with /var/log/ceph/ceph-client.admin.44673.log.gz 2024-09-15T23:25:04.985 INFO:teuthology.orchestra.run.smithi123.stderr: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69177.log 2024-09-15T23:25:04.985 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.98147.log.gz 2024-09-15T23:25:04.985 INFO:teuthology.orchestra.run.smithi123.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.59515.log.gz/var/log/ceph/ceph-client.admin.97364.log: 2024-09-15T23:25:04.986 INFO:teuthology.orchestra.run.smithi123.stderr:gzip 89.3% -- replaced with /var/log/ceph/ceph-client.admin.97364.log.gz 2024-09-15T23:25:04.986 INFO:teuthology.orchestra.run.smithi123.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.63116.log 2024-09-15T23:25:04.986 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.69177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108728.log 88.3% -- replaced with /var/log/ceph/ceph-client.admin.69177.log.gz 2024-09-15T23:25:04.986 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-15T23:25:04.986 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.63116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106185.log 2024-09-15T23:25:04.986 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.63116.log.gz 2024-09-15T23:25:04.986 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.108728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63429.log 2024-09-15T23:25:04.986 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108728.log.gz 2024-09-15T23:25:04.987 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92602.log 2024-09-15T23:25:04.987 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.106185.log: /var/log/ceph/ceph-client.admin.63429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40954.log 2024-09-15T23:25:04.987 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.92602.log: 87.8% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63429.log.gz 2024-09-15T23:25:04.987 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.106185.log.gz 2024-09-15T23:25:04.987 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92602.log.gz 2024-09-15T23:25:04.987 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88492.log 2024-09-15T23:25:04.987 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.40954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83557.log 2024-09-15T23:25:04.987 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7%/var/log/ceph/ceph-client.admin.88492.log: -- replaced with /var/log/ceph/ceph-client.admin.40954.log.gz 2024-09-15T23:25:04.988 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101533.log 2024-09-15T23:25:04.988 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.88492.log.gz 2024-09-15T23:25:04.988 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45729.log 2024-09-15T23:25:04.988 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.83557.log: /var/log/ceph/ceph-client.admin.101533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63555.log 2024-09-15T23:25:04.988 INFO:teuthology.orchestra.run.smithi123.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.83557.log.gz 2024-09-15T23:25:04.988 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45729.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.101533.log.gz 2024-09-15T23:25:04.988 INFO:teuthology.orchestra.run.smithi123.stderr:gzip 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45729.log.gz 2024-09-15T23:25:04.989 INFO:teuthology.orchestra.run.smithi123.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.79084.log 2024-09-15T23:25:04.989 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.63555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106456.log 2024-09-15T23:25:04.989 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.63555.log.gz/var/log/ceph/ceph-client.admin.79084.log: 2024-09-15T23:25:04.989 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101670.log 2024-09-15T23:25:04.989 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.79084.log.gz 2024-09-15T23:25:04.989 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103506.log 2024-09-15T23:25:04.989 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.106456.log: /var/log/ceph/ceph-client.admin.101670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102500.log 2024-09-15T23:25:04.989 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.103506.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.106456.log.gz 2024-09-15T23:25:04.990 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.103506.log.gz 91.1% -- replaced with /var/log/ceph/ceph-client.admin.101670.log.gz 2024-09-15T23:25:04.990 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86837.log 2024-09-15T23:25:04.990 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-15T23:25:04.990 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55526.log 2024-09-15T23:25:04.990 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.102500.log: /var/log/ceph/ceph-client.admin.86837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91702.log 2024-09-15T23:25:04.990 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.86837.log.gz 2024-09-15T23:25:04.990 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.55526.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102500.log.gz 2024-09-15T23:25:04.990 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101866.log 2024-09-15T23:25:04.991 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55526.log.gz 2024-09-15T23:25:04.991 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.91702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71390.log 2024-09-15T23:25:04.991 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94998.log 2024-09-15T23:25:04.991 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.101866.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.91702.log.gz 2024-09-15T23:25:04.991 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.71390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70455.log 2024-09-15T23:25:04.991 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.71390.log.gz 2024-09-15T23:25:04.991 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.94998.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.94998.log.gz 2024-09-15T23:25:04.991 INFO:teuthology.orchestra.run.smithi123.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.101866.log.gz 2024-09-15T23:25:04.991 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108602.log 2024-09-15T23:25:04.992 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.70455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60334.log 2024-09-15T23:25:04.992 INFO:teuthology.orchestra.run.smithi123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.70455.log.gz 2024-09-15T23:25:04.992 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.108602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59341.log 2024-09-15T23:25:04.992 INFO:teuthology.orchestra.run.smithi123.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.108602.log.gz/var/log/ceph/ceph-client.admin.60334.log: 2024-09-15T23:25:04.992 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68742.log 2024-09-15T23:25:04.992 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60334.log.gz 2024-09-15T23:25:04.992 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103843.log 2024-09-15T23:25:04.992 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.59341.log: /var/log/ceph/ceph-client.admin.68742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45596.log 2024-09-15T23:25:04.993 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.103843.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68742.log.gz 2024-09-15T23:25:04.993 INFO:teuthology.orchestra.run.smithi123.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.103843.log.gz 2024-09-15T23:25:04.993 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107948.log 2024-09-15T23:25:04.993 INFO:teuthology.orchestra.run.smithi123.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.59341.log.gz 2024-09-15T23:25:04.993 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.2.45596.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.2.45596.log.gz 2024-09-15T23:25:04.993 INFO:teuthology.orchestra.run.smithi123.stderr: --verbose -- /var/log/ceph/ceph-client.admin.99613.log 2024-09-15T23:25:04.993 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.107948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56603.log 2024-09-15T23:25:04.993 INFO:teuthology.orchestra.run.smithi123.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.107948.log.gz 2024-09-15T23:25:04.994 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.99613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60633.log 2024-09-15T23:25:04.994 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.99613.log.gzgzip 2024-09-15T23:25:04.994 INFO:teuthology.orchestra.run.smithi123.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.107905.log 2024-09-15T23:25:04.994 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.56603.log: /var/log/ceph/ceph-client.admin.60633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84147.log 2024-09-15T23:25:04.994 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.107905.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56603.log.gz 2024-09-15T23:25:04.994 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60633.log.gz 2024-09-15T23:25:04.994 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84189.log 2024-09-15T23:25:04.994 INFO:teuthology.orchestra.run.smithi123.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.107905.log.gz 2024-09-15T23:25:04.995 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43842.log 2024-09-15T23:25:04.995 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.84147.log: /var/log/ceph/ceph-client.admin.84189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104479.log 2024-09-15T23:25:04.995 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.84147.log.gz 2024-09-15T23:25:04.995 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43842.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.84189.log.gz 2024-09-15T23:25:04.995 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69027.log 2024-09-15T23:25:04.995 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.104479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79807.log 2024-09-15T23:25:04.995 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43842.log.gz 2024-09-15T23:25:04.995 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.69027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42514.log 2024-09-15T23:25:04.996 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.69027.log.gz 91.1% 2024-09-15T23:25:04.996 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.104479.log.gz 2024-09-15T23:25:04.996 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.79807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56501.log 2024-09-15T23:25:04.996 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.79807.log.gz 2024-09-15T23:25:04.996 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84459.log 2024-09-15T23:25:04.996 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42514.log.gz 2024-09-15T23:25:04.996 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.56501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107761.log 2024-09-15T23:25:04.996 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56501.log.gz 2024-09-15T23:25:04.997 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.84459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93584.log 2024-09-15T23:25:04.997 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.107761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60898.log 2024-09-15T23:25:04.997 INFO:teuthology.orchestra.run.smithi123.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.84459.log.gz 2024-09-15T23:25:04.997 INFO:teuthology.orchestra.run.smithi123.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.107761.log.gz/var/log/ceph/ceph-client.admin.93584.log: 2024-09-15T23:25:04.997 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93398.log 2024-09-15T23:25:04.997 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.60898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97008.log 2024-09-15T23:25:04.997 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4%/var/log/ceph/ceph-client.admin.93398.log: -- replaced with /var/log/ceph/ceph-client.admin.93584.log.gz 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60898.log.gz 2024-09-15T23:25:04.997 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-15T23:25:04.998 INFO:teuthology.orchestra.run.smithi123.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93398.log.gz 2024-09-15T23:25:04.998 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61346.log 2024-09-15T23:25:04.998 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.97008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46320.log 2024-09-15T23:25:04.998 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97008.log.gz 2024-09-15T23:25:04.998 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.61346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56077.log 2024-09-15T23:25:04.998 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61346.log.gz 2024-09-15T23:25:04.998 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83130.log 2024-09-15T23:25:04.998 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46320.log: /var/log/ceph/ceph-client.admin.56077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62583.log 2024-09-15T23:25:04.999 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.83130.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46320.log.gz 2024-09-15T23:25:04.999 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56077.log.gz 2024-09-15T23:25:04.999 INFO:teuthology.orchestra.run.smithi123.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.83130.log.gz 2024-09-15T23:25:04.999 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43843.log 2024-09-15T23:25:04.999 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.62583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68020.log 2024-09-15T23:25:04.999 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62583.log.gz 2024-09-15T23:25:04.999 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84021.log 2024-09-15T23:25:04.999 INFO:teuthology.orchestra.run.smithi123.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43843.log.gz 2024-09-15T23:25:05.000 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88154.log 2024-09-15T23:25:05.000 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.68020.log: /var/log/ceph/ceph-client.admin.84021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102271.log 2024-09-15T23:25:05.000 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.88154.log: 88.3% 89.4% -- replaced with /var/log/ceph/ceph-client.admin.84021.log.gz 2024-09-15T23:25:05.000 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68020.log.gz 2024-09-15T23:25:05.000 INFO:teuthology.orchestra.run.smithi123.stderr:gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.88154.log.gz 2024-09-15T23:25:05.000 INFO:teuthology.orchestra.run.smithi123.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.89524.log 2024-09-15T23:25:05.000 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.102271.log: gzip -5 --verbose -- 87.6% -- replaced with /var/log/ceph/ceph-client.admin.102271.log.gz 2024-09-15T23:25:05.000 INFO:teuthology.orchestra.run.smithi123.stderr: /var/log/ceph/ceph-client.admin.54993.log 2024-09-15T23:25:05.001 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.89524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62948.log 2024-09-15T23:25:05.001 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.89524.log.gz 2024-09-15T23:25:05.001 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.54993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108686.log 2024-09-15T23:25:05.001 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54993.log.gz 2024-09-15T23:25:05.001 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45981.log 2024-09-15T23:25:05.001 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.62948.log: /var/log/ceph/ceph-client.admin.108686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89058.log 2024-09-15T23:25:05.001 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45981.log: 88.3% 89.3% -- replaced with /var/log/ceph/ceph-client.admin.62948.log.gz 2024-09-15T23:25:05.001 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.108686.log.gz 2024-09-15T23:25:05.002 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45981.log.gz 2024-09-15T23:25:05.002 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94740.log 2024-09-15T23:25:05.002 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69261.log 2024-09-15T23:25:05.002 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.89058.log: /var/log/ceph/ceph-client.admin.94740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88578.log 2024-09-15T23:25:05.002 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.69261.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.89058.log.gz 2024-09-15T23:25:05.002 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92728.log 2024-09-15T23:25:05.002 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.69261.log.gz 91.0% -- replaced with /var/log/ceph/ceph-client.admin.94740.log.gz 2024-09-15T23:25:05.003 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-15T23:25:05.003 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107374.log 2024-09-15T23:25:05.003 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.88578.log: /var/log/ceph/ceph-client.admin.92728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105624.log 2024-09-15T23:25:05.003 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2%/var/log/ceph/ceph-client.admin.107374.log: -- replaced with /var/log/ceph/ceph-client.admin.88578.log.gz 2024-09-15T23:25:05.003 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.92728.log.gz 2024-09-15T23:25:05.003 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83256.log 2024-09-15T23:25:05.003 INFO:teuthology.orchestra.run.smithi123.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.107374.log.gz 2024-09-15T23:25:05.003 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99337.log 2024-09-15T23:25:05.004 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.105624.log: /var/log/ceph/ceph-client.admin.83256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63471.log 2024-09-15T23:25:05.004 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.105624.log.gz 2024-09-15T23:25:05.004 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.99337.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.83256.log.gz 2024-09-15T23:25:05.004 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56249.log 2024-09-15T23:25:05.004 INFO:teuthology.orchestra.run.smithi123.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.99337.log.gz 2024-09-15T23:25:05.004 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.63471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93043.log 2024-09-15T23:25:05.004 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63471.log.gz/var/log/ceph/ceph-client.admin.56249.log: 2024-09-15T23:25:05.005 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83172.log 2024-09-15T23:25:05.005 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56249.log.gz 2024-09-15T23:25:05.005 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69069.log 2024-09-15T23:25:05.005 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.93043.log: /var/log/ceph/ceph-client.admin.83172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87005.log 2024-09-15T23:25:05.005 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.69069.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.83172.log.gz 89.4% -- replaced with /var/log/ceph/ceph-client.admin.93043.log.gz 2024-09-15T23:25:05.005 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-15T23:25:05.005 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92907.log 2024-09-15T23:25:05.005 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93863.log 91.3% 2024-09-15T23:25:05.006 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69069.log.gz 2024-09-15T23:25:05.006 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.87005.log: /var/log/ceph/ceph-client.admin.92907.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.87005.log.gz 2024-09-15T23:25:05.006 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.92907.log.gz 2024-09-15T23:25:05.006 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79849.log 2024-09-15T23:25:05.006 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.93863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80336.log 2024-09-15T23:25:05.006 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93863.log.gz 2024-09-15T23:25:05.006 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.79849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82962.log 2024-09-15T23:25:05.006 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.79849.log.gz/var/log/ceph/ceph-client.admin.80336.log: 2024-09-15T23:25:05.007 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56165.log 2024-09-15T23:25:05.007 INFO:teuthology.orchestra.run.smithi123.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.80336.log.gz 2024-09-15T23:25:05.007 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61112.log 2024-09-15T23:25:05.007 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.82962.log: /var/log/ceph/ceph-client.admin.56165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67080.log 2024-09-15T23:25:05.007 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.61112.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.82962.log.gz 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56165.log.gz 2024-09-15T23:25:05.007 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-15T23:25:05.007 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61112.log.gz 2024-09-15T23:25:05.007 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68062.log 2024-09-15T23:25:05.008 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.67080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87713.log 2024-09-15T23:25:05.008 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6%/var/log/ceph/ceph-client.admin.68062.log: -- replaced with /var/log/ceph/ceph-client.admin.67080.log.gz 2024-09-15T23:25:05.008 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89146.log 2024-09-15T23:25:05.008 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84063.log 2024-09-15T23:25:05.008 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.87713.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.68062.log.gz 2024-09-15T23:25:05.008 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.89146.log: 88.2% 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58709.log 2024-09-15T23:25:05.008 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.89146.log.gz 2024-09-15T23:25:05.009 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.87713.log.gz 2024-09-15T23:25:05.009 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89650.log 2024-09-15T23:25:05.009 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.84063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66462.log 2024-09-15T23:25:05.009 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.58709.log: /var/log/ceph/ceph-client.admin.89650.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.84063.log.gz 2024-09-15T23:25:05.009 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63856.log 2024-09-15T23:25:05.009 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.66462.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.58709.log.gz 2024-09-15T23:25:05.009 INFO:teuthology.orchestra.run.smithi123.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.89650.log.gz 2024-09-15T23:25:05.009 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.66462.log.gz 2024-09-15T23:25:05.009 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42642.log 2024-09-15T23:25:05.010 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42951.log 2024-09-15T23:25:05.010 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.63856.log: /var/log/ceph/ceph-client.admin.42642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58238.log 2024-09-15T23:25:05.010 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63856.log.gz 2024-09-15T23:25:05.010 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42951.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42642.log.gz 2024-09-15T23:25:05.010 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61538.log 2024-09-15T23:25:05.010 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42951.log.gz 2024-09-15T23:25:05.010 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.58238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69323.log 2024-09-15T23:25:05.010 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.61538.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.0.61538.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.105197.log 2024-09-15T23:25:05.011 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-15T23:25:05.011 INFO:teuthology.orchestra.run.smithi123.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.58238.log.gz 2024-09-15T23:25:05.011 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.69323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98091.log 2024-09-15T23:25:05.011 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.105197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68939.log 2024-09-15T23:25:05.011 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.98091.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.105197.log.gz 2024-09-15T23:25:05.011 INFO:teuthology.orchestra.run.smithi123.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.69323.log.gz 2024-09-15T23:25:05.011 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.98091.log.gz 2024-09-15T23:25:05.012 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87587.log 2024-09-15T23:25:05.012 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.68939.log: -- /var/log/ceph/ceph-client.admin.94446.log 2024-09-15T23:25:05.012 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.87587.log: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71096.log 2024-09-15T23:25:05.012 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68939.log.gz 2024-09-15T23:25:05.012 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.87587.log.gz 2024-09-15T23:25:05.012 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60124.log 2024-09-15T23:25:05.012 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.94446.log: /var/log/ceph/ceph-client.admin.71096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107635.log 2024-09-15T23:25:05.012 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.60124.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94446.log.gz 2024-09-15T23:25:05.013 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.71096.log.gz 2024-09-15T23:25:05.013 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99169.log 2024-09-15T23:25:05.013 INFO:teuthology.orchestra.run.smithi123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.60124.log.gz 2024-09-15T23:25:05.013 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87131.log 2024-09-15T23:25:05.014 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.107635.log: /var/log/ceph/ceph-client.admin.99169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68741.log 2024-09-15T23:25:05.014 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.107635.log.gz 2024-09-15T23:25:05.014 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.87131.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.99169.log.gz 2024-09-15T23:25:05.015 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56879.log 2024-09-15T23:25:05.015 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.68741.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.87131.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78602.log 2024-09-15T23:25:05.015 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-15T23:25:05.015 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.68741.log.gz 2024-09-15T23:25:05.016 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60082.log 2024-09-15T23:25:05.016 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.56879.log: /var/log/ceph/ceph-client.admin.78602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42909.log 2024-09-15T23:25:05.016 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.60082.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56879.log.gz 2024-09-15T23:25:05.017 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.78602.log.gz 2024-09-15T23:25:05.017 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66648.log 2024-09-15T23:25:05.017 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60082.log.gz 2024-09-15T23:25:05.018 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45288.log 2024-09-15T23:25:05.018 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.42909.log: /var/log/ceph/ceph-client.admin.66648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71686.log 2024-09-15T23:25:05.018 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.45288.log: 88.3% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42909.log.gz 2024-09-15T23:25:05.018 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66648.log.gz 2024-09-15T23:25:05.019 INFO:teuthology.orchestra.run.smithi123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45288.log.gz 2024-09-15T23:25:05.019 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47177.log 2024-09-15T23:25:05.019 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92770.log 2024-09-15T23:25:05.020 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.71686.log: /var/log/ceph/ceph-client.admin.47177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67768.log 2024-09-15T23:25:05.020 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.71686.log.gz 2024-09-15T23:25:05.020 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.92770.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47177.log.gz 2024-09-15T23:25:05.020 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92386.log 2024-09-15T23:25:05.021 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.92770.log.gz 2024-09-15T23:25:05.021 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67666.log 2024-09-15T23:25:05.021 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.67768.log: /var/log/ceph/ceph-client.admin.92386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56207.log 2024-09-15T23:25:05.022 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.67666.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92386.log.gz 2024-09-15T23:25:05.022 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67768.log.gz 2024-09-15T23:25:05.022 INFO:teuthology.orchestra.run.smithi123.stderr: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89608.log 2024-09-15T23:25:05.022 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67666.log.gz 2024-09-15T23:25:05.023 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.56207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71768.log 2024-09-15T23:25:05.023 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83723.log 2024-09-15T23:25:05.023 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56207.log.gz 2024-09-15T23:25:05.023 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.89608.log: /var/log/ceph/ceph-client.admin.71768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57067.log 2024-09-15T23:25:05.024 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.83723.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.89608.log.gz 2024-09-15T23:25:05.024 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.71768.log.gz 2024-09-15T23:25:05.024 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.83723.log.gz 2024-09-15T23:25:05.025 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46607.log 2024-09-15T23:25:05.025 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92812.log 2024-09-15T23:25:05.025 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.57067.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104221.log 2024-09-15T23:25:05.026 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46607.log: -- replaced with /var/log/ceph/ceph-client.0.57067.log.gz 2024-09-15T23:25:05.026 INFO:teuthology.orchestra.run.smithi123.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46607.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56729.log 2024-09-15T23:25:05.026 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-15T23:25:05.027 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.92812.log: /var/log/ceph/ceph-client.admin.104221.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.92812.log.gz 2024-09-15T23:25:05.027 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108854.log 2024-09-15T23:25:05.027 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- 91.2% -- replaced with /var/log/ceph/ceph-client.admin.104221.log.gz 2024-09-15T23:25:05.027 INFO:teuthology.orchestra.run.smithi123.stderr: /var/log/ceph/ceph-client.admin.58858.log 2024-09-15T23:25:05.028 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.108854.log: /var/log/ceph/ceph-client.admin.56729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88919.log 2024-09-15T23:25:05.028 INFO:teuthology.orchestra.run.smithi123.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.108854.log.gz 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56729.log.gz 2024-09-15T23:25:05.028 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-15T23:25:05.029 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.58858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84713.log 2024-09-15T23:25:05.029 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.88919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60675.log 2024-09-15T23:25:05.029 INFO:teuthology.orchestra.run.smithi123.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.58858.log.gz/var/log/ceph/ceph-client.0.84713.log: 2024-09-15T23:25:05.029 INFO:teuthology.orchestra.run.smithi123.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.88919.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.0.84713.log.gz 2024-09-15T23:25:05.030 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-15T23:25:05.030 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101736.log 2024-09-15T23:25:05.030 INFO:teuthology.orchestra.run.smithi123.stderr:gzip/var/log/ceph/ceph-client.admin.60675.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.55484.log 2024-09-15T23:25:05.030 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.101736.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.60675.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86921.log 2024-09-15T23:25:05.031 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-15T23:25:05.031 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89908.log 2024-09-15T23:25:05.031 INFO:teuthology.orchestra.run.smithi123.stderr: 90.8%/var/log/ceph/ceph-client.admin.55484.log: -- replaced with /var/log/ceph/ceph-client.admin.101736.log.gz 2024-09-15T23:25:05.031 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.86921.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55484.log.gz 2024-09-15T23:25:05.032 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.86921.log.gz 2024-09-15T23:25:05.032 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105407.log 2024-09-15T23:25:05.032 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.89908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.89908.log.gz 2024-09-15T23:25:05.032 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61154.log 2024-09-15T23:25:05.033 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.105407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82521.log 2024-09-15T23:25:05.033 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.61154.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.105407.log.gz 2024-09-15T23:25:05.033 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43507.log 2024-09-15T23:25:05.033 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61154.log.gz 2024-09-15T23:25:05.034 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43498.log 2024-09-15T23:25:05.034 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.82521.log: /var/log/ceph/ceph-client.admin.43507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46397.log 2024-09-15T23:25:05.034 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43498.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.82521.log.gz 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43507.log.gz 2024-09-15T23:25:05.035 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-15T23:25:05.035 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43498.log.gz 2024-09-15T23:25:05.035 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55087.log 2024-09-15T23:25:05.035 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60805.log 2024-09-15T23:25:05.036 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.55087.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46397.log.gz 2024-09-15T23:25:05.036 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69219.log 2024-09-15T23:25:05.036 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55087.log.gz 2024-09-15T23:25:05.036 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106354.log 2024-09-15T23:25:05.037 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.60805.log: /var/log/ceph/ceph-client.admin.69219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93303.log 2024-09-15T23:25:05.037 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.106354.log: 88.9% 89.2% -- replaced with /var/log/ceph/ceph-client.admin.69219.log.gz 2024-09-15T23:25:05.037 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60805.log.gz 2024-09-15T23:25:05.037 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.106354.log.gz 2024-09-15T23:25:05.038 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83681.log 2024-09-15T23:25:05.038 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.93303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58106.log 2024-09-15T23:25:05.038 INFO:teuthology.orchestra.run.smithi123.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93303.log.gz/var/log/ceph/ceph-client.admin.83681.log: 2024-09-15T23:25:05.038 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88280.log 2024-09-15T23:25:05.039 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.83681.log.gz 2024-09-15T23:25:05.039 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.58106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99547.log 2024-09-15T23:25:05.039 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106017.log 2024-09-15T23:25:05.040 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.88280.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.58106.log.gz 2024-09-15T23:25:05.040 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.99547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97839.log 2024-09-15T23:25:05.040 INFO:teuthology.orchestra.run.smithi123.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.88280.log.gz 2024-09-15T23:25:05.040 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.106017.log: gzip 91.1% -- replaced with /var/log/ceph/ceph-client.admin.99547.log.gz 2024-09-15T23:25:05.041 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.106017.log.gz 2024-09-15T23:25:05.041 INFO:teuthology.orchestra.run.smithi123.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.69451.log 2024-09-15T23:25:05.041 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5/var/log/ceph/ceph-client.admin.97839.log: --verbose -- /var/log/ceph/ceph-client.admin.65819.log 2024-09-15T23:25:05.042 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.69451.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.97839.log.gz 2024-09-15T23:25:05.042 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42821.log 2024-09-15T23:25:05.042 INFO:teuthology.orchestra.run.smithi123.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.69451.log.gz 2024-09-15T23:25:05.042 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62103.log 2024-09-15T23:25:05.043 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.65819.log: /var/log/ceph/ceph-client.admin.42821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95118.log 2024-09-15T23:25:05.043 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.62103.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42821.log.gz 2024-09-15T23:25:05.043 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.65819.log.gz 2024-09-15T23:25:05.044 INFO:teuthology.orchestra.run.smithi123.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62103.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102144.log 2024-09-15T23:25:05.044 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-15T23:25:05.044 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.95118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66733.log 2024-09-15T23:25:05.044 INFO:teuthology.orchestra.run.smithi123.stderr: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108032.log 2024-09-15T23:25:05.045 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95118.log.gz 2024-09-15T23:25:05.045 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.102144.log: /var/log/ceph/ceph-client.admin.66733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70215.log 2024-09-15T23:25:05.045 INFO:teuthology.orchestra.run.smithi123.stderr: 89.4%/var/log/ceph/ceph-client.admin.108032.log: -- replaced with /var/log/ceph/ceph-client.admin.102144.log.gz 88.9% -- replaced with /var/log/ceph/ceph-client.admin.66733.log.gz 2024-09-15T23:25:05.045 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-15T23:25:05.046 INFO:teuthology.orchestra.run.smithi123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108032.log.gz 2024-09-15T23:25:05.046 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46691.log 2024-09-15T23:25:05.046 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.70215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65405.log 2024-09-15T23:25:05.046 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.70215.log.gz 2024-09-15T23:25:05.047 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.46691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103759.log 2024-09-15T23:25:05.047 INFO:teuthology.orchestra.run.smithi123.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46691.log.gz 2024-09-15T23:25:05.047 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102584.log 2024-09-15T23:25:05.048 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.65405.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-15T23:25:05.048 INFO:teuthology.orchestra.run.smithi123.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.65405.log.gz/var/log/ceph/ceph-client.admin.103759.log: 2024-09-15T23:25:05.048 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.102584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108074.log 2024-09-15T23:25:05.048 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.102584.log.gz 2024-09-15T23:25:05.049 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.103759.log.gz 2024-09-15T23:25:05.049 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87047.log 2024-09-15T23:25:05.049 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97566.log 2024-09-15T23:25:05.050 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.108074.log: /var/log/ceph/ceph-client.admin.87047.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108074.log.gz 2024-09-15T23:25:05.050 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.87047.log.gz 2024-09-15T23:25:05.050 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80017.log 2024-09-15T23:25:05.050 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106270.log 2024-09-15T23:25:05.051 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.97566.log: /var/log/ceph/ceph-client.admin.80017.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.97566.log.gz 2024-09-15T23:25:05.051 INFO:teuthology.orchestra.run.smithi123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.80017.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67936.log 2024-09-15T23:25:05.051 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-15T23:25:05.052 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56543.log 2024-09-15T23:25:05.052 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.67936.log: /var/log/ceph/ceph-client.admin.106270.log: 88.2% 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67936.log.gz 2024-09-15T23:25:05.052 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.106270.log.gz 2024-09-15T23:25:05.053 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-15T23:25:05.053 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.56543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44463.log 2024-09-15T23:25:05.053 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56543.log.gz 2024-09-15T23:25:05.053 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64417.log 2024-09-15T23:25:05.054 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44463.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44463.log.gz 2024-09-15T23:25:05.054 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70005.log 2024-09-15T23:25:05.054 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.64417.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64417.log.gz 2024-09-15T23:25:05.054 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47135.log 2024-09-15T23:25:05.055 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.70005.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.70005.log.gz 2024-09-15T23:25:05.055 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78065.log 2024-09-15T23:25:05.055 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.47135.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47135.log.gz 2024-09-15T23:25:05.055 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68432.log 2024-09-15T23:25:05.056 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.78065.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.78065.log.gz 2024-09-15T23:25:05.056 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70535.log 2024-09-15T23:25:05.056 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.68432.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68432.log.gz 2024-09-15T23:25:05.057 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59634.log 2024-09-15T23:25:05.057 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.70535.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70535.log.gz 2024-09-15T23:25:05.057 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69734.log 2024-09-15T23:25:05.057 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.59634.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59634.log.gz 2024-09-15T23:25:05.058 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104842.log 2024-09-15T23:25:05.058 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.69734.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.69734.log.gz 2024-09-15T23:25:05.058 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66859.log 2024-09-15T23:25:05.059 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.104842.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.104842.log.gz 2024-09-15T23:25:05.059 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78466.log 2024-09-15T23:25:05.059 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.66859.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.66859.log.gz 2024-09-15T23:25:05.059 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102187.log 2024-09-15T23:25:05.060 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.78466.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.78466.log.gz 2024-09-15T23:25:05.060 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82455.log 2024-09-15T23:25:05.060 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.102187.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102187.log.gz 2024-09-15T23:25:05.061 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63513.log 2024-09-15T23:25:05.061 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.82455.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.82455.log.gz 2024-09-15T23:25:05.061 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79467.log 2024-09-15T23:25:05.062 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.63513.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.63513.log.gz 2024-09-15T23:25:05.062 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43329.log 2024-09-15T23:25:05.062 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.79467.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.79467.log.gz 2024-09-15T23:25:05.062 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71180.log 2024-09-15T23:25:05.063 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.43329.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43329.log.gz 2024-09-15T23:25:05.063 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103358.log 2024-09-15T23:25:05.063 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.71180.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.71180.log.gz 2024-09-15T23:25:05.064 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93925.log 2024-09-15T23:25:05.064 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.103358.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103358.log.gz 2024-09-15T23:25:05.064 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68320.log 2024-09-15T23:25:05.064 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.93925.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.93925.log.gz 2024-09-15T23:25:05.065 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54808.log 2024-09-15T23:25:05.065 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.68320.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.68320.log.gz 2024-09-15T23:25:05.065 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89398.log 2024-09-15T23:25:05.066 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.54808.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.54808.log.gz 2024-09-15T23:25:05.066 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44547.log 2024-09-15T23:25:05.066 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.89398.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.89398.log.gz 2024-09-15T23:25:05.066 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63218.log 2024-09-15T23:25:05.067 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.44547.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44547.log.gz 2024-09-15T23:25:05.067 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65007.log 2024-09-15T23:25:05.067 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.63218.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.63218.log.gz 2024-09-15T23:25:05.067 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66336.log 2024-09-15T23:25:05.068 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.65007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.65007.log.gz 2024-09-15T23:25:05.068 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97650.log 2024-09-15T23:25:05.068 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.66336.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.66336.log.gz 2024-09-15T23:25:05.069 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102989.log 2024-09-15T23:25:05.069 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.97650.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.97650.log.gz 2024-09-15T23:25:05.069 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87389.log 2024-09-15T23:25:05.069 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.102989.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102989.log.gz 2024-09-15T23:25:05.070 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63681.log 2024-09-15T23:25:05.070 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.87389.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.87389.log.gz 2024-09-15T23:25:05.070 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70970.log 2024-09-15T23:25:05.070 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.63681.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63681.log.gz 2024-09-15T23:25:05.071 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102710.log 2024-09-15T23:25:05.071 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.70970.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.70970.log.gz 2024-09-15T23:25:05.071 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83979.log 2024-09-15T23:25:05.071 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.102710.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.102710.log.gz 2024-09-15T23:25:05.072 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67540.log 2024-09-15T23:25:05.072 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.83979.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.83979.log.gz 2024-09-15T23:25:05.072 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.67540.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.67540.log.gz 2024-09-15T23:25:05.074 INFO:teuthology.orchestra.run.smithi188.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-15T23:25:05.074 INFO:teuthology.orchestra.run.smithi188.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-15T23:25:05.437 INFO:teuthology.orchestra.run.smithi123.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-15T23:25:05.730 INFO:teuthology.orchestra.run.smithi123.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-15T23:25:06.210 INFO:teuthology.orchestra.run.smithi188.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-15T23:25:06.213 INFO:teuthology.orchestra.run.smithi123.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-15T23:25:06.395 INFO:teuthology.orchestra.run.smithi188.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-15T23:25:06.667 INFO:teuthology.orchestra.run.smithi188.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-15T23:25:06.817 INFO:teuthology.orchestra.run.smithi123.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-15T23:25:06.847 INFO:teuthology.orchestra.run.smithi123.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-15T23:25:06.914 INFO:teuthology.orchestra.run.smithi188.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-15T23:25:06.964 INFO:teuthology.orchestra.run.smithi123.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-15T23:25:10.740 INFO:teuthology.orchestra.run.smithi188.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-15T23:25:10.742 INFO:teuthology.orchestra.run.smithi188.stderr: 2024-09-15T23:25:10.742 INFO:teuthology.orchestra.run.smithi188.stderr:real 0m6.316s 2024-09-15T23:25:10.742 INFO:teuthology.orchestra.run.smithi188.stderr:user 0m15.259s 2024-09-15T23:25:10.743 INFO:teuthology.orchestra.run.smithi188.stderr:sys 0m0.515s 2024-09-15T23:25:46.213 INFO:teuthology.orchestra.run.smithi123.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-15T23:25:46.215 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-09-15T23:25:46.215 INFO:teuthology.orchestra.run.smithi123.stderr:real 0m41.817s 2024-09-15T23:25:46.215 INFO:teuthology.orchestra.run.smithi123.stderr:user 0m50.774s 2024-09-15T23:25:46.215 INFO:teuthology.orchestra.run.smithi123.stderr:sys 0m2.243s 2024-09-15T23:25:46.216 INFO:tasks.ceph:Archiving logs... 2024-09-15T23:25:46.216 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906308/remote/smithi123/log 2024-09-15T23:25:46.217 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T23:25:54.041 DEBUG:teuthology.misc:Transferring archived files from smithi188:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906308/remote/smithi188/log 2024-09-15T23:25:54.042 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T23:25:56.167 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-15T23:25:56.179 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-15T23:25:56.180 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T23:25:56.183 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T23:25:56.274 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-15T23:25:56.283 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-15T23:25:56.283 DEBUG:teuthology.orchestra.run.smithi123:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T23:25:56.290 DEBUG:teuthology.orchestra.run.smithi188:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T23:25:56.304 INFO:teuthology.orchestra.run.smithi123.stderr:bash: line 1: ntpq: command not found 2024-09-15T23:25:56.306 INFO:teuthology.orchestra.run.smithi188.stderr:bash: line 1: ntpq: command not found 2024-09-15T23:25:56.309 INFO:teuthology.orchestra.run.smithi123.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T23:25:56.309 INFO:teuthology.orchestra.run.smithi123.stdout:=============================================================================== 2024-09-15T23:25:56.309 INFO:teuthology.orchestra.run.smithi123.stdout:^* hv01.front.sepia.ceph.com 3 7 377 7 +613us[ +611us] +/- 41ms 2024-09-15T23:25:56.310 INFO:teuthology.orchestra.run.smithi123.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 6 -1355us[-1355us] +/- 68ms 2024-09-15T23:25:56.310 INFO:teuthology.orchestra.run.smithi123.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 5 +424us[ +424us] +/- 78ms 2024-09-15T23:25:56.310 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:25:56.312 INFO:teuthology.orchestra.run.smithi188.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T23:25:56.312 INFO:teuthology.orchestra.run.smithi188.stdout:=============================================================================== 2024-09-15T23:25:56.312 INFO:teuthology.orchestra.run.smithi188.stdout:^* hv01.front.sepia.ceph.com 3 6 377 6 +612us[ +610us] +/- 41ms 2024-09-15T23:25:56.313 INFO:teuthology.orchestra.run.smithi188.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 7 -1347us[-1349us] +/- 68ms 2024-09-15T23:25:56.313 INFO:teuthology.orchestra.run.smithi188.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 7 +431us[ +429us] +/- 78ms 2024-09-15T23:25:56.313 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:25:56.313 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-15T23:25:56.322 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-15T23:25:56.323 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-15T23:25:56.331 DEBUG:teuthology.orchestra.run.smithi123:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-15T23:25:56.445 DEBUG:teuthology.orchestra.run.smithi188:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-15T23:25:56.516 DEBUG:teuthology.orchestra.run.smithi123:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T23:25:56.547 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:25:56.547 DEBUG:teuthology.orchestra.run.smithi188:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T23:25:56.577 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:25:56.577 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-15T23:25:56.587 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-15T23:25:56.595 INFO:teuthology.task.internal:Duration was 1208.273627 seconds 2024-09-15T23:25:56.596 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-15T23:25:56.604 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-15T23:25:56.604 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T23:25:56.607 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T23:25:56.644 INFO:teuthology.orchestra.run.smithi123.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T23:25:56.657 INFO:teuthology.orchestra.run.smithi188.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T23:25:56.834 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-15T23:25:56.835 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi123.front.sepia.ceph.com 2024-09-15T23:25:56.835 DEBUG:teuthology.orchestra.run.smithi123:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T23:25:56.895 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi188.front.sepia.ceph.com 2024-09-15T23:25:56.896 DEBUG:teuthology.orchestra.run.smithi188:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T23:25:56.923 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-15T23:25:56.924 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T23:25:56.938 DEBUG:teuthology.orchestra.run.smithi188:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T23:25:56.990 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-15T23:25:56.990 DEBUG:teuthology.orchestra.run.smithi123:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T23:25:57.004 DEBUG:teuthology.orchestra.run.smithi188:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T23:25:57.141 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-15T23:25:57.151 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-15T23:25:57.152 DEBUG:teuthology.orchestra.run.smithi123:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T23:25:57.176 DEBUG:teuthology.orchestra.run.smithi188:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T23:25:57.201 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-15T23:25:57.211 DEBUG:teuthology.orchestra.run.smithi123:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T23:25:57.219 DEBUG:teuthology.orchestra.run.smithi188:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T23:25:57.240 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = core 2024-09-15T23:25:57.265 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern = core 2024-09-15T23:25:57.278 DEBUG:teuthology.orchestra.run.smithi123:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T23:25:57.325 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:25:57.325 DEBUG:teuthology.orchestra.run.smithi188:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T23:25:57.340 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:25:57.340 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-15T23:25:57.350 INFO:teuthology.task.internal:Transferring archived files... 2024-09-15T23:25:57.351 DEBUG:teuthology.misc:Transferring archived files from smithi123:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906308/remote/smithi123 2024-09-15T23:25:57.351 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T23:25:57.402 DEBUG:teuthology.misc:Transferring archived files from smithi188:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906308/remote/smithi188 2024-09-15T23:25:57.402 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T23:25:57.436 INFO:teuthology.task.internal:Removing archive directory... 2024-09-15T23:25:57.437 DEBUG:teuthology.orchestra.run.smithi123:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T23:25:57.439 DEBUG:teuthology.orchestra.run.smithi188:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T23:25:57.485 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-15T23:25:57.496 INFO:teuthology.task.internal:Not uploading archives. 2024-09-15T23:25:57.496 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-15T23:25:57.505 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-15T23:25:57.505 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T23:25:57.508 DEBUG:teuthology.orchestra.run.smithi188:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T23:25:57.520 INFO:teuthology.orchestra.run.smithi123.stdout: 265861 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 23:25 /home/ubuntu/cephtest 2024-09-15T23:25:57.540 INFO:teuthology.orchestra.run.smithi188.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 23:25 /home/ubuntu/cephtest 2024-09-15T23:25:57.541 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-15T23:25:57.551 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-15T23:25:57.573 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/scrub} duration: 1208.273627281189 failure_reason: 'Test failure: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub)' flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=4bc2ec913c4a49b59d2a9ca06b0c6320 status: fail success: false 2024-09-15T23:25:57.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T23:25:57.687 INFO:teuthology.run:FAIL